[==========] Running 8 tests from 2 test suites.
[----------] Global test environment set-up.
[----------] 6 tests from LeaderRebalancerTest
[ RUN      ] LeaderRebalancerTest.FunctionalTestForDivided
WARNING: Logging before InitGoogleLogging() is written to STDERR
I20260709 13:03:40.778196 18300 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.17.223.62:38721
I20260709 13:03:40.779803 18300 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260709 13:03:40.780939 18300 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:03:40.797204 18307 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:03:40.797195 18309 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:03:40.799789 18300 server_base.cc:1061] running on GCE node
W20260709 13:03:40.797791 18306 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:03:42.017854 18300 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:03:42.018128 18300 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:03:42.018337 18300 hybrid_clock.cc:648] HybridClock initialized: now 1783602222018317 us; error 0 us; skew 500 ppm
I20260709 13:03:42.019215 18300 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:03:42.024521 18300 webserver.cc:533] Webserver started at http://127.17.223.62:36215/ using document root <none> and password file <none>
I20260709 13:03:42.025379 18300 fs_manager.cc:362] Metadata directory not provided
I20260709 13:03:42.025619 18300 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:03:42.026053 18300 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:03:42.031782 18300 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskKd2k48/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602220613947-18300-0/minicluster-data/master-0-root/instance:
uuid: "e191e627772746b097dd78deefcf2f77"
format_stamp: "Formatted at 2026-07-09 13:03:42 on dist-test-slave-vl1s"
I20260709 13:03:42.039340 18300 fs_manager.cc:696] Time spent creating directory manager: real 0.007s	user 0.007s	sys 0.000s
I20260709 13:03:42.044207 18315 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:03:42.045259 18300 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.005s	sys 0.000s
I20260709 13:03:42.045601 18300 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskKd2k48/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602220613947-18300-0/minicluster-data/master-0-root
uuid: "e191e627772746b097dd78deefcf2f77"
format_stamp: "Formatted at 2026-07-09 13:03:42 on dist-test-slave-vl1s"
I20260709 13:03:42.045940 18300 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskKd2k48/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602220613947-18300-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskKd2k48/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602220613947-18300-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskKd2k48/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602220613947-18300-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:03:42.108315 18300 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:03:42.109894 18300 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260709 13:03:42.110366 18300 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:03:42.181771 18300 rpc_server.cc:307] RPC server started. Bound to: 127.17.223.62:38721
I20260709 13:03:42.181847 18366 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.17.223.62:38721 every 8 connection(s)
I20260709 13:03:42.189946 18367 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:42.211228 18367 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e191e627772746b097dd78deefcf2f77: Bootstrap starting.
I20260709 13:03:42.216931 18367 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P e191e627772746b097dd78deefcf2f77: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:42.218796 18367 log.cc:826] T 00000000000000000000000000000000 P e191e627772746b097dd78deefcf2f77: Log is configured to *not* fsync() on all Append() calls
I20260709 13:03:42.223374 18367 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e191e627772746b097dd78deefcf2f77: No bootstrap required, opened a new log
I20260709 13:03:42.243723 18367 raft_consensus.cc:359] T 00000000000000000000000000000000 P e191e627772746b097dd78deefcf2f77 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e191e627772746b097dd78deefcf2f77" member_type: VOTER }
I20260709 13:03:42.244278 18367 raft_consensus.cc:385] T 00000000000000000000000000000000 P e191e627772746b097dd78deefcf2f77 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:42.244508 18367 raft_consensus.cc:740] T 00000000000000000000000000000000 P e191e627772746b097dd78deefcf2f77 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e191e627772746b097dd78deefcf2f77, State: Initialized, Role: FOLLOWER
I20260709 13:03:42.245362 18367 consensus_queue.cc:260] T 00000000000000000000000000000000 P e191e627772746b097dd78deefcf2f77 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e191e627772746b097dd78deefcf2f77" member_type: VOTER }
I20260709 13:03:42.245826 18367 raft_consensus.cc:399] T 00000000000000000000000000000000 P e191e627772746b097dd78deefcf2f77 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 13:03:42.246090 18367 raft_consensus.cc:493] T 00000000000000000000000000000000 P e191e627772746b097dd78deefcf2f77 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 13:03:42.246376 18367 raft_consensus.cc:3060] T 00000000000000000000000000000000 P e191e627772746b097dd78deefcf2f77 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:42.250365 18367 raft_consensus.cc:515] T 00000000000000000000000000000000 P e191e627772746b097dd78deefcf2f77 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e191e627772746b097dd78deefcf2f77" member_type: VOTER }
I20260709 13:03:42.251112 18367 leader_election.cc:304] T 00000000000000000000000000000000 P e191e627772746b097dd78deefcf2f77 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: e191e627772746b097dd78deefcf2f77; no voters: 
I20260709 13:03:42.252774 18367 leader_election.cc:290] T 00000000000000000000000000000000 P e191e627772746b097dd78deefcf2f77 [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 13:03:42.253141 18370 raft_consensus.cc:2804] T 00000000000000000000000000000000 P e191e627772746b097dd78deefcf2f77 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:03:42.255432 18370 raft_consensus.cc:697] T 00000000000000000000000000000000 P e191e627772746b097dd78deefcf2f77 [term 1 LEADER]: Becoming Leader. State: Replica: e191e627772746b097dd78deefcf2f77, State: Running, Role: LEADER
I20260709 13:03:42.256395 18370 consensus_queue.cc:237] T 00000000000000000000000000000000 P e191e627772746b097dd78deefcf2f77 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e191e627772746b097dd78deefcf2f77" member_type: VOTER }
I20260709 13:03:42.257418 18367 sys_catalog.cc:565] T 00000000000000000000000000000000 P e191e627772746b097dd78deefcf2f77 [sys.catalog]: configured and running, proceeding with master startup.
I20260709 13:03:42.268874 18371 sys_catalog.cc:455] T 00000000000000000000000000000000 P e191e627772746b097dd78deefcf2f77 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "e191e627772746b097dd78deefcf2f77" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e191e627772746b097dd78deefcf2f77" member_type: VOTER } }
I20260709 13:03:42.269795 18371 sys_catalog.cc:458] T 00000000000000000000000000000000 P e191e627772746b097dd78deefcf2f77 [sys.catalog]: This master's current role is: LEADER
I20260709 13:03:42.271281 18372 sys_catalog.cc:455] T 00000000000000000000000000000000 P e191e627772746b097dd78deefcf2f77 [sys.catalog]: SysCatalogTable state changed. Reason: New leader e191e627772746b097dd78deefcf2f77. Latest consensus state: current_term: 1 leader_uuid: "e191e627772746b097dd78deefcf2f77" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e191e627772746b097dd78deefcf2f77" member_type: VOTER } }
I20260709 13:03:42.272106 18372 sys_catalog.cc:458] T 00000000000000000000000000000000 P e191e627772746b097dd78deefcf2f77 [sys.catalog]: This master's current role is: LEADER
I20260709 13:03:42.282220 18380 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 13:03:42.294209 18380 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 13:03:42.296481 18300 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 13:03:42.311426 18380 catalog_manager.cc:1383] Generated new cluster ID: 191438a22ae54ee29eb92c3087811476
I20260709 13:03:42.311717 18380 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 13:03:42.332005 18380 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 13:03:42.333561 18380 catalog_manager.cc:1540] Loading token signing keys...
I20260709 13:03:42.348629 18380 catalog_manager.cc:6070] T 00000000000000000000000000000000 P e191e627772746b097dd78deefcf2f77: Generated new TSK 0
I20260709 13:03:42.349566 18380 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 13:03:42.363653 18300 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:03:42.373706 18389 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:03:42.375247 18390 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:03:42.380702 18392 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:03:42.380978 18300 server_base.cc:1061] running on GCE node
I20260709 13:03:42.381974 18300 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:03:42.382277 18300 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:03:42.382508 18300 hybrid_clock.cc:648] HybridClock initialized: now 1783602222382481 us; error 0 us; skew 500 ppm
I20260709 13:03:42.383315 18300 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:03:42.388741 18300 webserver.cc:533] Webserver started at http://127.17.223.1:35979/ using document root <none> and password file <none>
I20260709 13:03:42.389410 18300 fs_manager.cc:362] Metadata directory not provided
I20260709 13:03:42.389676 18300 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:03:42.389999 18300 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:03:42.391541 18300 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskKd2k48/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602220613947-18300-0/minicluster-data/ts-0-root/instance:
uuid: "6ba6d37b4c6344ec882213fb72cc10a3"
format_stamp: "Formatted at 2026-07-09 13:03:42 on dist-test-slave-vl1s"
I20260709 13:03:42.397365 18300 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.005s	sys 0.001s
I20260709 13:03:42.402014 18397 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:03:42.402892 18300 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.003s	sys 0.000s
I20260709 13:03:42.403205 18300 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskKd2k48/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602220613947-18300-0/minicluster-data/ts-0-root
uuid: "6ba6d37b4c6344ec882213fb72cc10a3"
format_stamp: "Formatted at 2026-07-09 13:03:42 on dist-test-slave-vl1s"
I20260709 13:03:42.403507 18300 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskKd2k48/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602220613947-18300-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskKd2k48/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602220613947-18300-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskKd2k48/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602220613947-18300-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:03:42.438946 18300 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:03:42.440282 18300 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:03:42.443037 18300 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:03:42.447650 18300 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:03:42.447865 18300 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:03:42.448175 18300 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:03:42.448325 18300 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:03:42.551947 18300 rpc_server.cc:307] RPC server started. Bound to: 127.17.223.1:33623
I20260709 13:03:42.552016 18459 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.17.223.1:33623 every 8 connection(s)
I20260709 13:03:42.559222 18300 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:03:42.574076 18464 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:03:42.575510 18465 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:03:42.579358 18467 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:03:42.580811 18300 server_base.cc:1061] running on GCE node
I20260709 13:03:42.581818 18300 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:03:42.582105 18300 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:03:42.582309 18300 hybrid_clock.cc:648] HybridClock initialized: now 1783602222582293 us; error 0 us; skew 500 ppm
I20260709 13:03:42.583391 18300 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:03:42.586573 18300 webserver.cc:533] Webserver started at http://127.17.223.2:46061/ using document root <none> and password file <none>
I20260709 13:03:42.587266 18300 fs_manager.cc:362] Metadata directory not provided
I20260709 13:03:42.587505 18300 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:03:42.587831 18300 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:03:42.589341 18300 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskKd2k48/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602220613947-18300-0/minicluster-data/ts-1-root/instance:
uuid: "e5d4c60ba4c64aa78850cf308be78a8d"
format_stamp: "Formatted at 2026-07-09 13:03:42 on dist-test-slave-vl1s"
I20260709 13:03:42.594115 18460 heartbeater.cc:344] Connected to a master server at 127.17.223.62:38721
I20260709 13:03:42.594763 18460 heartbeater.cc:461] Registering TS with master...
I20260709 13:03:42.595994 18460 heartbeater.cc:507] Master 127.17.223.62:38721 requested a full tablet report, sending...
I20260709 13:03:42.596123 18300 fs_manager.cc:696] Time spent creating directory manager: real 0.006s	user 0.001s	sys 0.007s
I20260709 13:03:42.599159 18332 ts_manager.cc:194] Registered new tserver with Master: 6ba6d37b4c6344ec882213fb72cc10a3 (127.17.223.1:33623)
I20260709 13:03:42.601367 18472 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:03:42.602283 18300 fs_manager.cc:730] Time spent opening block manager: real 0.004s	user 0.002s	sys 0.000s
I20260709 13:03:42.602344 18332 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:51190
I20260709 13:03:42.602697 18300 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskKd2k48/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602220613947-18300-0/minicluster-data/ts-1-root
uuid: "e5d4c60ba4c64aa78850cf308be78a8d"
format_stamp: "Formatted at 2026-07-09 13:03:42 on dist-test-slave-vl1s"
I20260709 13:03:42.603084 18300 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskKd2k48/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602220613947-18300-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskKd2k48/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602220613947-18300-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskKd2k48/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602220613947-18300-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:03:42.620688 18300 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:03:42.622386 18300 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:03:42.624923 18300 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:03:42.628628 18300 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:03:42.628891 18300 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:03:42.629185 18300 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:03:42.629387 18300 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:03:42.717662 18300 rpc_server.cc:307] RPC server started. Bound to: 127.17.223.2:37301
I20260709 13:03:42.717756 18534 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.17.223.2:37301 every 8 connection(s)
I20260709 13:03:42.724284 18300 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:03:42.736733 18538 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:03:42.738152 18535 heartbeater.cc:344] Connected to a master server at 127.17.223.62:38721
I20260709 13:03:42.738555 18535 heartbeater.cc:461] Registering TS with master...
I20260709 13:03:42.739629 18535 heartbeater.cc:507] Master 127.17.223.62:38721 requested a full tablet report, sending...
I20260709 13:03:42.741956 18332 ts_manager.cc:194] Registered new tserver with Master: e5d4c60ba4c64aa78850cf308be78a8d (127.17.223.2:37301)
I20260709 13:03:42.743681 18332 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:51202
W20260709 13:03:42.743784 18539 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:03:42.748678 18541 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:03:42.749429 18300 server_base.cc:1061] running on GCE node
I20260709 13:03:42.750295 18300 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:03:42.750512 18300 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:03:42.750715 18300 hybrid_clock.cc:648] HybridClock initialized: now 1783602222750693 us; error 0 us; skew 500 ppm
I20260709 13:03:42.751219 18300 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:03:42.753551 18300 webserver.cc:533] Webserver started at http://127.17.223.3:43331/ using document root <none> and password file <none>
I20260709 13:03:42.754014 18300 fs_manager.cc:362] Metadata directory not provided
I20260709 13:03:42.754217 18300 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:03:42.754472 18300 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:03:42.755589 18300 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskKd2k48/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602220613947-18300-0/minicluster-data/ts-2-root/instance:
uuid: "e34192eeaeb246a790a18368773bbe15"
format_stamp: "Formatted at 2026-07-09 13:03:42 on dist-test-slave-vl1s"
I20260709 13:03:42.760041 18300 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.005s	sys 0.000s
I20260709 13:03:42.763350 18546 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:03:42.764107 18300 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.001s
I20260709 13:03:42.764374 18300 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskKd2k48/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602220613947-18300-0/minicluster-data/ts-2-root
uuid: "e34192eeaeb246a790a18368773bbe15"
format_stamp: "Formatted at 2026-07-09 13:03:42 on dist-test-slave-vl1s"
I20260709 13:03:42.764658 18300 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskKd2k48/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602220613947-18300-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskKd2k48/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602220613947-18300-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskKd2k48/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602220613947-18300-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:03:42.780390 18300 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:03:42.781651 18300 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:03:42.783093 18300 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:03:42.785130 18300 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:03:42.785372 18300 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:03:42.785665 18300 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:03:42.785835 18300 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:03:42.873865 18300 rpc_server.cc:307] RPC server started. Bound to: 127.17.223.3:42349
I20260709 13:03:42.874020 18608 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.17.223.3:42349 every 8 connection(s)
I20260709 13:03:42.891302 18609 heartbeater.cc:344] Connected to a master server at 127.17.223.62:38721
I20260709 13:03:42.891744 18609 heartbeater.cc:461] Registering TS with master...
I20260709 13:03:42.892496 18609 heartbeater.cc:507] Master 127.17.223.62:38721 requested a full tablet report, sending...
I20260709 13:03:42.894520 18332 ts_manager.cc:194] Registered new tserver with Master: e34192eeaeb246a790a18368773bbe15 (127.17.223.3:42349)
I20260709 13:03:42.894987 18300 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.014488028s
I20260709 13:03:42.896250 18332 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:51212
I20260709 13:03:42.943626 18332 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:51218:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q""\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:03:42.947234 18332 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:03:43.071501 18493 tablet_service.cc:1511] Processing CreateTablet for tablet b68da910d10d4d6a80b0055f7061ad27 (DEFAULT_TABLE table=test-workload [id=b17ae8478d904427817f96a3a40f38e9]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:03:43.069772 18496 tablet_service.cc:1511] Processing CreateTablet for tablet f5116788673d45ad9561408373f762a5 (DEFAULT_TABLE table=test-workload [id=b17ae8478d904427817f96a3a40f38e9]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:03:43.078061 18500 tablet_service.cc:1511] Processing CreateTablet for tablet 5c30ad177b44422f982d86fe00ab6c4a (DEFAULT_TABLE table=test-workload [id=b17ae8478d904427817f96a3a40f38e9]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:03:43.068130 18499 tablet_service.cc:1511] Processing CreateTablet for tablet 24b316d8ce55441ea9cf056818fd658a (DEFAULT_TABLE table=test-workload [id=b17ae8478d904427817f96a3a40f38e9]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:03:43.079140 18496 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f5116788673d45ad9561408373f762a5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:43.077607 18495 tablet_service.cc:1511] Processing CreateTablet for tablet 476ca419566a4bc1883e94647b632918 (DEFAULT_TABLE table=test-workload [id=b17ae8478d904427817f96a3a40f38e9]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:03:43.068661 18498 tablet_service.cc:1511] Processing CreateTablet for tablet a9e6e2dfc9624bbb887e108176acff29 (DEFAULT_TABLE table=test-workload [id=b17ae8478d904427817f96a3a40f38e9]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:03:43.084528 18495 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 476ca419566a4bc1883e94647b632918. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:43.080747 18494 tablet_service.cc:1511] Processing CreateTablet for tablet ba252d6f681a44948699b78102577c8b (DEFAULT_TABLE table=test-workload [id=b17ae8478d904427817f96a3a40f38e9]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:03:43.077543 18497 tablet_service.cc:1511] Processing CreateTablet for tablet a5d1966171cd4c25a9045a79b6ce1b58 (DEFAULT_TABLE table=test-workload [id=b17ae8478d904427817f96a3a40f38e9]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:03:43.091825 18500 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5c30ad177b44422f982d86fe00ab6c4a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:43.085829 18425 tablet_service.cc:1511] Processing CreateTablet for tablet 5c30ad177b44422f982d86fe00ab6c4a (DEFAULT_TABLE table=test-workload [id=b17ae8478d904427817f96a3a40f38e9]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:03:43.099134 18423 tablet_service.cc:1511] Processing CreateTablet for tablet a9e6e2dfc9624bbb887e108176acff29 (DEFAULT_TABLE table=test-workload [id=b17ae8478d904427817f96a3a40f38e9]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:03:43.100735 18493 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b68da910d10d4d6a80b0055f7061ad27. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:43.089584 18424 tablet_service.cc:1511] Processing CreateTablet for tablet 24b316d8ce55441ea9cf056818fd658a (DEFAULT_TABLE table=test-workload [id=b17ae8478d904427817f96a3a40f38e9]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:03:43.100852 18574 tablet_service.cc:1511] Processing CreateTablet for tablet 5c30ad177b44422f982d86fe00ab6c4a (DEFAULT_TABLE table=test-workload [id=b17ae8478d904427817f96a3a40f38e9]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:03:43.099124 18573 tablet_service.cc:1511] Processing CreateTablet for tablet 24b316d8ce55441ea9cf056818fd658a (DEFAULT_TABLE table=test-workload [id=b17ae8478d904427817f96a3a40f38e9]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:03:43.101383 18572 tablet_service.cc:1511] Processing CreateTablet for tablet a9e6e2dfc9624bbb887e108176acff29 (DEFAULT_TABLE table=test-workload [id=b17ae8478d904427817f96a3a40f38e9]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:03:43.107522 18425 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5c30ad177b44422f982d86fe00ab6c4a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:43.110134 18499 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 24b316d8ce55441ea9cf056818fd658a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:43.114209 18494 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ba252d6f681a44948699b78102577c8b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:43.114238 18421 tablet_service.cc:1511] Processing CreateTablet for tablet f5116788673d45ad9561408373f762a5 (DEFAULT_TABLE table=test-workload [id=b17ae8478d904427817f96a3a40f38e9]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:03:43.112807 18574 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5c30ad177b44422f982d86fe00ab6c4a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:43.114648 18423 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a9e6e2dfc9624bbb887e108176acff29. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:43.114648 18571 tablet_service.cc:1511] Processing CreateTablet for tablet a5d1966171cd4c25a9045a79b6ce1b58 (DEFAULT_TABLE table=test-workload [id=b17ae8478d904427817f96a3a40f38e9]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:03:43.105361 18422 tablet_service.cc:1511] Processing CreateTablet for tablet a5d1966171cd4c25a9045a79b6ce1b58 (DEFAULT_TABLE table=test-workload [id=b17ae8478d904427817f96a3a40f38e9]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:03:43.124454 18492 tablet_service.cc:1511] Processing CreateTablet for tablet 63053c1fc3214bcd99d7c93f71c98ff3 (DEFAULT_TABLE table=test-workload [id=b17ae8478d904427817f96a3a40f38e9]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:03:43.121438 18424 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 24b316d8ce55441ea9cf056818fd658a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:43.117941 18420 tablet_service.cc:1511] Processing CreateTablet for tablet 476ca419566a4bc1883e94647b632918 (DEFAULT_TABLE table=test-workload [id=b17ae8478d904427817f96a3a40f38e9]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:03:43.136585 18417 tablet_service.cc:1511] Processing CreateTablet for tablet 63053c1fc3214bcd99d7c93f71c98ff3 (DEFAULT_TABLE table=test-workload [id=b17ae8478d904427817f96a3a40f38e9]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:03:43.138351 18570 tablet_service.cc:1511] Processing CreateTablet for tablet f5116788673d45ad9561408373f762a5 (DEFAULT_TABLE table=test-workload [id=b17ae8478d904427817f96a3a40f38e9]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:03:43.141638 18572 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a9e6e2dfc9624bbb887e108176acff29. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:43.132170 18569 tablet_service.cc:1511] Processing CreateTablet for tablet 476ca419566a4bc1883e94647b632918 (DEFAULT_TABLE table=test-workload [id=b17ae8478d904427817f96a3a40f38e9]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:03:43.155474 18498 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a9e6e2dfc9624bbb887e108176acff29. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:43.156689 18497 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a5d1966171cd4c25a9045a79b6ce1b58. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:43.157044 18421 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f5116788673d45ad9561408373f762a5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:43.133495 18419 tablet_service.cc:1511] Processing CreateTablet for tablet ba252d6f681a44948699b78102577c8b (DEFAULT_TABLE table=test-workload [id=b17ae8478d904427817f96a3a40f38e9]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:03:43.158289 18420 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 476ca419566a4bc1883e94647b632918. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:43.159314 18419 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ba252d6f681a44948699b78102577c8b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:43.143049 18567 tablet_service.cc:1511] Processing CreateTablet for tablet b68da910d10d4d6a80b0055f7061ad27 (DEFAULT_TABLE table=test-workload [id=b17ae8478d904427817f96a3a40f38e9]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:03:43.160759 18422 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a5d1966171cd4c25a9045a79b6ce1b58. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:43.142472 18568 tablet_service.cc:1511] Processing CreateTablet for tablet ba252d6f681a44948699b78102577c8b (DEFAULT_TABLE table=test-workload [id=b17ae8478d904427817f96a3a40f38e9]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:03:43.144590 18418 tablet_service.cc:1511] Processing CreateTablet for tablet b68da910d10d4d6a80b0055f7061ad27 (DEFAULT_TABLE table=test-workload [id=b17ae8478d904427817f96a3a40f38e9]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:03:43.165196 18570 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f5116788673d45ad9561408373f762a5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:43.167779 18573 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 24b316d8ce55441ea9cf056818fd658a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:43.169248 18568 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ba252d6f681a44948699b78102577c8b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:43.172448 18569 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 476ca419566a4bc1883e94647b632918. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:43.174096 18566 tablet_service.cc:1511] Processing CreateTablet for tablet 63053c1fc3214bcd99d7c93f71c98ff3 (DEFAULT_TABLE table=test-workload [id=b17ae8478d904427817f96a3a40f38e9]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:03:43.175549 18566 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 63053c1fc3214bcd99d7c93f71c98ff3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:43.179498 18567 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b68da910d10d4d6a80b0055f7061ad27. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:43.192968 18492 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 63053c1fc3214bcd99d7c93f71c98ff3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:43.195161 18571 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a5d1966171cd4c25a9045a79b6ce1b58. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:43.195667 18417 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 63053c1fc3214bcd99d7c93f71c98ff3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:43.205278 18418 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b68da910d10d4d6a80b0055f7061ad27. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:03:43.302088 18379 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:03:43.370038 18627 tablet_bootstrap.cc:492] T a9e6e2dfc9624bbb887e108176acff29 P e34192eeaeb246a790a18368773bbe15: Bootstrap starting.
I20260709 13:03:43.407296 18629 tablet_bootstrap.cc:492] T b68da910d10d4d6a80b0055f7061ad27 P 6ba6d37b4c6344ec882213fb72cc10a3: Bootstrap starting.
I20260709 13:03:43.405922 18628 tablet_bootstrap.cc:492] T ba252d6f681a44948699b78102577c8b P e5d4c60ba4c64aa78850cf308be78a8d: Bootstrap starting.
I20260709 13:03:43.420464 18627 tablet_bootstrap.cc:654] T a9e6e2dfc9624bbb887e108176acff29 P e34192eeaeb246a790a18368773bbe15: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:43.436416 18629 tablet_bootstrap.cc:654] T b68da910d10d4d6a80b0055f7061ad27 P 6ba6d37b4c6344ec882213fb72cc10a3: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:43.439785 18628 tablet_bootstrap.cc:654] T ba252d6f681a44948699b78102577c8b P e5d4c60ba4c64aa78850cf308be78a8d: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:43.454479 18629 tablet_bootstrap.cc:492] T b68da910d10d4d6a80b0055f7061ad27 P 6ba6d37b4c6344ec882213fb72cc10a3: No bootstrap required, opened a new log
I20260709 13:03:43.455026 18629 ts_tablet_manager.cc:1403] T b68da910d10d4d6a80b0055f7061ad27 P 6ba6d37b4c6344ec882213fb72cc10a3: Time spent bootstrapping tablet: real 0.050s	user 0.005s	sys 0.009s
I20260709 13:03:43.459548 18627 tablet_bootstrap.cc:492] T a9e6e2dfc9624bbb887e108176acff29 P e34192eeaeb246a790a18368773bbe15: No bootstrap required, opened a new log
I20260709 13:03:43.460000 18627 ts_tablet_manager.cc:1403] T a9e6e2dfc9624bbb887e108176acff29 P e34192eeaeb246a790a18368773bbe15: Time spent bootstrapping tablet: real 0.091s	user 0.013s	sys 0.011s
I20260709 13:03:43.460973 18628 tablet_bootstrap.cc:492] T ba252d6f681a44948699b78102577c8b P e5d4c60ba4c64aa78850cf308be78a8d: No bootstrap required, opened a new log
I20260709 13:03:43.460800 18629 raft_consensus.cc:359] T b68da910d10d4d6a80b0055f7061ad27 P 6ba6d37b4c6344ec882213fb72cc10a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ba6d37b4c6344ec882213fb72cc10a3" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 33623 } } peers { permanent_uuid: "e5d4c60ba4c64aa78850cf308be78a8d" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 37301 } } peers { permanent_uuid: "e34192eeaeb246a790a18368773bbe15" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 42349 } }
I20260709 13:03:43.461484 18628 ts_tablet_manager.cc:1403] T ba252d6f681a44948699b78102577c8b P e5d4c60ba4c64aa78850cf308be78a8d: Time spent bootstrapping tablet: real 0.095s	user 0.015s	sys 0.000s
I20260709 13:03:43.461618 18629 raft_consensus.cc:385] T b68da910d10d4d6a80b0055f7061ad27 P 6ba6d37b4c6344ec882213fb72cc10a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:43.462024 18629 raft_consensus.cc:740] T b68da910d10d4d6a80b0055f7061ad27 P 6ba6d37b4c6344ec882213fb72cc10a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6ba6d37b4c6344ec882213fb72cc10a3, State: Initialized, Role: FOLLOWER
I20260709 13:03:43.462822 18627 raft_consensus.cc:359] T a9e6e2dfc9624bbb887e108176acff29 P e34192eeaeb246a790a18368773bbe15 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ba6d37b4c6344ec882213fb72cc10a3" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 33623 } } peers { permanent_uuid: "e5d4c60ba4c64aa78850cf308be78a8d" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 37301 } } peers { permanent_uuid: "e34192eeaeb246a790a18368773bbe15" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 42349 } }
I20260709 13:03:43.462796 18629 consensus_queue.cc:260] T b68da910d10d4d6a80b0055f7061ad27 P 6ba6d37b4c6344ec882213fb72cc10a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ba6d37b4c6344ec882213fb72cc10a3" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 33623 } } peers { permanent_uuid: "e5d4c60ba4c64aa78850cf308be78a8d" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 37301 } } peers { permanent_uuid: "e34192eeaeb246a790a18368773bbe15" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 42349 } }
I20260709 13:03:43.463580 18627 raft_consensus.cc:385] T a9e6e2dfc9624bbb887e108176acff29 P e34192eeaeb246a790a18368773bbe15 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:43.463909 18627 raft_consensus.cc:740] T a9e6e2dfc9624bbb887e108176acff29 P e34192eeaeb246a790a18368773bbe15 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e34192eeaeb246a790a18368773bbe15, State: Initialized, Role: FOLLOWER
I20260709 13:03:43.464900 18628 raft_consensus.cc:359] T ba252d6f681a44948699b78102577c8b P e5d4c60ba4c64aa78850cf308be78a8d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ba6d37b4c6344ec882213fb72cc10a3" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 33623 } } peers { permanent_uuid: "e5d4c60ba4c64aa78850cf308be78a8d" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 37301 } } peers { permanent_uuid: "e34192eeaeb246a790a18368773bbe15" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 42349 } }
I20260709 13:03:43.464813 18627 consensus_queue.cc:260] T a9e6e2dfc9624bbb887e108176acff29 P e34192eeaeb246a790a18368773bbe15 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ba6d37b4c6344ec882213fb72cc10a3" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 33623 } } peers { permanent_uuid: "e5d4c60ba4c64aa78850cf308be78a8d" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 37301 } } peers { permanent_uuid: "e34192eeaeb246a790a18368773bbe15" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 42349 } }
I20260709 13:03:43.465798 18628 raft_consensus.cc:385] T ba252d6f681a44948699b78102577c8b P e5d4c60ba4c64aa78850cf308be78a8d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:43.466233 18628 raft_consensus.cc:740] T ba252d6f681a44948699b78102577c8b P e5d4c60ba4c64aa78850cf308be78a8d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e5d4c60ba4c64aa78850cf308be78a8d, State: Initialized, Role: FOLLOWER
I20260709 13:03:43.467202 18628 consensus_queue.cc:260] T ba252d6f681a44948699b78102577c8b P e5d4c60ba4c64aa78850cf308be78a8d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ba6d37b4c6344ec882213fb72cc10a3" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 33623 } } peers { permanent_uuid: "e5d4c60ba4c64aa78850cf308be78a8d" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 37301 } } peers { permanent_uuid: "e34192eeaeb246a790a18368773bbe15" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 42349 } }
I20260709 13:03:43.473505 18628 ts_tablet_manager.cc:1434] T ba252d6f681a44948699b78102577c8b P e5d4c60ba4c64aa78850cf308be78a8d: Time spent starting tablet: real 0.011s	user 0.009s	sys 0.000s
W20260709 13:03:43.474064 18536 tablet.cc:2406] T ba252d6f681a44948699b78102577c8b P e5d4c60ba4c64aa78850cf308be78a8d: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260709 13:03:43.474381 18535 heartbeater.cc:499] Master 127.17.223.62:38721 was elected leader, sending a full tablet report...
I20260709 13:03:43.477231 18629 ts_tablet_manager.cc:1434] T b68da910d10d4d6a80b0055f7061ad27 P 6ba6d37b4c6344ec882213fb72cc10a3: Time spent starting tablet: real 0.022s	user 0.007s	sys 0.011s
I20260709 13:03:43.477833 18460 heartbeater.cc:499] Master 127.17.223.62:38721 was elected leader, sending a full tablet report...
I20260709 13:03:43.478499 18629 tablet_bootstrap.cc:492] T 24b316d8ce55441ea9cf056818fd658a P 6ba6d37b4c6344ec882213fb72cc10a3: Bootstrap starting.
I20260709 13:03:43.487284 18628 tablet_bootstrap.cc:492] T 24b316d8ce55441ea9cf056818fd658a P e5d4c60ba4c64aa78850cf308be78a8d: Bootstrap starting.
I20260709 13:03:43.487589 18629 tablet_bootstrap.cc:654] T 24b316d8ce55441ea9cf056818fd658a P 6ba6d37b4c6344ec882213fb72cc10a3: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:43.495298 18627 ts_tablet_manager.cc:1434] T a9e6e2dfc9624bbb887e108176acff29 P e34192eeaeb246a790a18368773bbe15: Time spent starting tablet: real 0.035s	user 0.017s	sys 0.019s
I20260709 13:03:43.496837 18609 heartbeater.cc:499] Master 127.17.223.62:38721 was elected leader, sending a full tablet report...
I20260709 13:03:43.499907 18627 tablet_bootstrap.cc:492] T ba252d6f681a44948699b78102577c8b P e34192eeaeb246a790a18368773bbe15: Bootstrap starting.
I20260709 13:03:43.506804 18628 tablet_bootstrap.cc:654] T 24b316d8ce55441ea9cf056818fd658a P e5d4c60ba4c64aa78850cf308be78a8d: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:43.511811 18627 tablet_bootstrap.cc:654] T ba252d6f681a44948699b78102577c8b P e34192eeaeb246a790a18368773bbe15: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:43.512933 18629 tablet_bootstrap.cc:492] T 24b316d8ce55441ea9cf056818fd658a P 6ba6d37b4c6344ec882213fb72cc10a3: No bootstrap required, opened a new log
I20260709 13:03:43.513419 18629 ts_tablet_manager.cc:1403] T 24b316d8ce55441ea9cf056818fd658a P 6ba6d37b4c6344ec882213fb72cc10a3: Time spent bootstrapping tablet: real 0.035s	user 0.011s	sys 0.018s
I20260709 13:03:43.517176 18629 raft_consensus.cc:359] T 24b316d8ce55441ea9cf056818fd658a P 6ba6d37b4c6344ec882213fb72cc10a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ba6d37b4c6344ec882213fb72cc10a3" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 33623 } } peers { permanent_uuid: "e5d4c60ba4c64aa78850cf308be78a8d" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 37301 } } peers { permanent_uuid: "e34192eeaeb246a790a18368773bbe15" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 42349 } }
I20260709 13:03:43.518151 18629 raft_consensus.cc:385] T 24b316d8ce55441ea9cf056818fd658a P 6ba6d37b4c6344ec882213fb72cc10a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:43.518587 18629 raft_consensus.cc:740] T 24b316d8ce55441ea9cf056818fd658a P 6ba6d37b4c6344ec882213fb72cc10a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6ba6d37b4c6344ec882213fb72cc10a3, State: Initialized, Role: FOLLOWER
I20260709 13:03:43.519847 18629 consensus_queue.cc:260] T 24b316d8ce55441ea9cf056818fd658a P 6ba6d37b4c6344ec882213fb72cc10a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ba6d37b4c6344ec882213fb72cc10a3" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 33623 } } peers { permanent_uuid: "e5d4c60ba4c64aa78850cf308be78a8d" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 37301 } } peers { permanent_uuid: "e34192eeaeb246a790a18368773bbe15" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 42349 } }
I20260709 13:03:43.523363 18629 ts_tablet_manager.cc:1434] T 24b316d8ce55441ea9cf056818fd658a P 6ba6d37b4c6344ec882213fb72cc10a3: Time spent starting tablet: real 0.010s	user 0.010s	sys 0.001s
I20260709 13:03:43.524729 18629 tablet_bootstrap.cc:492] T 476ca419566a4bc1883e94647b632918 P 6ba6d37b4c6344ec882213fb72cc10a3: Bootstrap starting.
I20260709 13:03:43.532636 18627 tablet_bootstrap.cc:492] T ba252d6f681a44948699b78102577c8b P e34192eeaeb246a790a18368773bbe15: No bootstrap required, opened a new log
I20260709 13:03:43.533133 18627 ts_tablet_manager.cc:1403] T ba252d6f681a44948699b78102577c8b P e34192eeaeb246a790a18368773bbe15: Time spent bootstrapping tablet: real 0.034s	user 0.014s	sys 0.012s
I20260709 13:03:43.533914 18629 tablet_bootstrap.cc:654] T 476ca419566a4bc1883e94647b632918 P 6ba6d37b4c6344ec882213fb72cc10a3: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:43.536182 18633 raft_consensus.cc:493] T b68da910d10d4d6a80b0055f7061ad27 P 6ba6d37b4c6344ec882213fb72cc10a3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:43.536801 18633 raft_consensus.cc:515] T b68da910d10d4d6a80b0055f7061ad27 P 6ba6d37b4c6344ec882213fb72cc10a3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ba6d37b4c6344ec882213fb72cc10a3" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 33623 } } peers { permanent_uuid: "e5d4c60ba4c64aa78850cf308be78a8d" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 37301 } } peers { permanent_uuid: "e34192eeaeb246a790a18368773bbe15" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 42349 } }
I20260709 13:03:43.540777 18633 leader_election.cc:290] T b68da910d10d4d6a80b0055f7061ad27 P 6ba6d37b4c6344ec882213fb72cc10a3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e5d4c60ba4c64aa78850cf308be78a8d (127.17.223.2:37301), e34192eeaeb246a790a18368773bbe15 (127.17.223.3:42349)
I20260709 13:03:43.541764 18627 raft_consensus.cc:359] T ba252d6f681a44948699b78102577c8b P e34192eeaeb246a790a18368773bbe15 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ba6d37b4c6344ec882213fb72cc10a3" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 33623 } } peers { permanent_uuid: "e5d4c60ba4c64aa78850cf308be78a8d" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 37301 } } peers { permanent_uuid: "e34192eeaeb246a790a18368773bbe15" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 42349 } }
I20260709 13:03:43.542722 18627 raft_consensus.cc:385] T ba252d6f681a44948699b78102577c8b P e34192eeaeb246a790a18368773bbe15 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:43.543076 18627 raft_consensus.cc:740] T ba252d6f681a44948699b78102577c8b P e34192eeaeb246a790a18368773bbe15 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e34192eeaeb246a790a18368773bbe15, State: Initialized, Role: FOLLOWER
I20260709 13:03:43.544003 18627 consensus_queue.cc:260] T ba252d6f681a44948699b78102577c8b P e34192eeaeb246a790a18368773bbe15 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ba6d37b4c6344ec882213fb72cc10a3" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 33623 } } peers { permanent_uuid: "e5d4c60ba4c64aa78850cf308be78a8d" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 37301 } } peers { permanent_uuid: "e34192eeaeb246a790a18368773bbe15" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 42349 } }
I20260709 13:03:43.546840 18628 tablet_bootstrap.cc:492] T 24b316d8ce55441ea9cf056818fd658a P e5d4c60ba4c64aa78850cf308be78a8d: No bootstrap required, opened a new log
I20260709 13:03:43.547374 18627 ts_tablet_manager.cc:1434] T ba252d6f681a44948699b78102577c8b P e34192eeaeb246a790a18368773bbe15: Time spent starting tablet: real 0.014s	user 0.010s	sys 0.000s
I20260709 13:03:43.548348 18627 tablet_bootstrap.cc:492] T 63053c1fc3214bcd99d7c93f71c98ff3 P e34192eeaeb246a790a18368773bbe15: Bootstrap starting.
I20260709 13:03:43.550294 18629 tablet_bootstrap.cc:492] T 476ca419566a4bc1883e94647b632918 P 6ba6d37b4c6344ec882213fb72cc10a3: No bootstrap required, opened a new log
I20260709 13:03:43.550776 18629 ts_tablet_manager.cc:1403] T 476ca419566a4bc1883e94647b632918 P 6ba6d37b4c6344ec882213fb72cc10a3: Time spent bootstrapping tablet: real 0.026s	user 0.007s	sys 0.017s
I20260709 13:03:43.547379 18628 ts_tablet_manager.cc:1403] T 24b316d8ce55441ea9cf056818fd658a P e5d4c60ba4c64aa78850cf308be78a8d: Time spent bootstrapping tablet: real 0.060s	user 0.014s	sys 0.024s
I20260709 13:03:43.556895 18634 raft_consensus.cc:493] T a9e6e2dfc9624bbb887e108176acff29 P e34192eeaeb246a790a18368773bbe15 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:43.557353 18634 raft_consensus.cc:515] T a9e6e2dfc9624bbb887e108176acff29 P e34192eeaeb246a790a18368773bbe15 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ba6d37b4c6344ec882213fb72cc10a3" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 33623 } } peers { permanent_uuid: "e5d4c60ba4c64aa78850cf308be78a8d" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 37301 } } peers { permanent_uuid: "e34192eeaeb246a790a18368773bbe15" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 42349 } }
I20260709 13:03:43.554749 18629 raft_consensus.cc:359] T 476ca419566a4bc1883e94647b632918 P 6ba6d37b4c6344ec882213fb72cc10a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ba6d37b4c6344ec882213fb72cc10a3" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 33623 } } peers { permanent_uuid: "e5d4c60ba4c64aa78850cf308be78a8d" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 37301 } } peers { permanent_uuid: "e34192eeaeb246a790a18368773bbe15" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 42349 } }
I20260709 13:03:43.557344 18628 raft_consensus.cc:359] T 24b316d8ce55441ea9cf056818fd658a P e5d4c60ba4c64aa78850cf308be78a8d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ba6d37b4c6344ec882213fb72cc10a3" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 33623 } } peers { permanent_uuid: "e5d4c60ba4c64aa78850cf308be78a8d" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 37301 } } peers { permanent_uuid: "e34192eeaeb246a790a18368773bbe15" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 42349 } }
I20260709 13:03:43.559475 18628 raft_consensus.cc:385] T 24b316d8ce55441ea9cf056818fd658a P e5d4c60ba4c64aa78850cf308be78a8d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:43.559816 18628 raft_consensus.cc:740] T 24b316d8ce55441ea9cf056818fd658a P e5d4c60ba4c64aa78850cf308be78a8d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e5d4c60ba4c64aa78850cf308be78a8d, State: Initialized, Role: FOLLOWER
I20260709 13:03:43.560778 18634 leader_election.cc:290] T a9e6e2dfc9624bbb887e108176acff29 P e34192eeaeb246a790a18368773bbe15 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6ba6d37b4c6344ec882213fb72cc10a3 (127.17.223.1:33623), e5d4c60ba4c64aa78850cf308be78a8d (127.17.223.2:37301)
I20260709 13:03:43.559271 18629 raft_consensus.cc:385] T 476ca419566a4bc1883e94647b632918 P 6ba6d37b4c6344ec882213fb72cc10a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:43.561031 18628 consensus_queue.cc:260] T 24b316d8ce55441ea9cf056818fd658a P e5d4c60ba4c64aa78850cf308be78a8d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ba6d37b4c6344ec882213fb72cc10a3" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 33623 } } peers { permanent_uuid: "e5d4c60ba4c64aa78850cf308be78a8d" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 37301 } } peers { permanent_uuid: "e34192eeaeb246a790a18368773bbe15" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 42349 } }
I20260709 13:03:43.562781 18629 raft_consensus.cc:740] T 476ca419566a4bc1883e94647b632918 P 6ba6d37b4c6344ec882213fb72cc10a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6ba6d37b4c6344ec882213fb72cc10a3, State: Initialized, Role: FOLLOWER
I20260709 13:03:43.568182 18627 tablet_bootstrap.cc:654] T 63053c1fc3214bcd99d7c93f71c98ff3 P e34192eeaeb246a790a18368773bbe15: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:43.575055 18629 consensus_queue.cc:260] T 476ca419566a4bc1883e94647b632918 P 6ba6d37b4c6344ec882213fb72cc10a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ba6d37b4c6344ec882213fb72cc10a3" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 33623 } } peers { permanent_uuid: "e5d4c60ba4c64aa78850cf308be78a8d" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 37301 } } peers { permanent_uuid: "e34192eeaeb246a790a18368773bbe15" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 42349 } }
I20260709 13:03:43.570636 18628 ts_tablet_manager.cc:1434] T 24b316d8ce55441ea9cf056818fd658a P e5d4c60ba4c64aa78850cf308be78a8d: Time spent starting tablet: real 0.018s	user 0.005s	sys 0.000s
I20260709 13:03:43.577536 18628 tablet_bootstrap.cc:492] T a5d1966171cd4c25a9045a79b6ce1b58 P e5d4c60ba4c64aa78850cf308be78a8d: Bootstrap starting.
I20260709 13:03:43.583468 18629 ts_tablet_manager.cc:1434] T 476ca419566a4bc1883e94647b632918 P 6ba6d37b4c6344ec882213fb72cc10a3: Time spent starting tablet: real 0.032s	user 0.007s	sys 0.000s
I20260709 13:03:43.584384 18629 tablet_bootstrap.cc:492] T f5116788673d45ad9561408373f762a5 P 6ba6d37b4c6344ec882213fb72cc10a3: Bootstrap starting.
I20260709 13:03:43.587282 18634 raft_consensus.cc:493] T ba252d6f681a44948699b78102577c8b P e34192eeaeb246a790a18368773bbe15 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:43.587759 18634 raft_consensus.cc:515] T ba252d6f681a44948699b78102577c8b P e34192eeaeb246a790a18368773bbe15 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ba6d37b4c6344ec882213fb72cc10a3" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 33623 } } peers { permanent_uuid: "e5d4c60ba4c64aa78850cf308be78a8d" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 37301 } } peers { permanent_uuid: "e34192eeaeb246a790a18368773bbe15" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 42349 } }
I20260709 13:03:43.589840 18634 leader_election.cc:290] T ba252d6f681a44948699b78102577c8b P e34192eeaeb246a790a18368773bbe15 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6ba6d37b4c6344ec882213fb72cc10a3 (127.17.223.1:33623), e5d4c60ba4c64aa78850cf308be78a8d (127.17.223.2:37301)
I20260709 13:03:43.596881 18629 tablet_bootstrap.cc:654] T f5116788673d45ad9561408373f762a5 P 6ba6d37b4c6344ec882213fb72cc10a3: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:43.602399 18628 tablet_bootstrap.cc:654] T a5d1966171cd4c25a9045a79b6ce1b58 P e5d4c60ba4c64aa78850cf308be78a8d: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:43.616358 18633 raft_consensus.cc:493] T 24b316d8ce55441ea9cf056818fd658a P 6ba6d37b4c6344ec882213fb72cc10a3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:43.617470 18633 raft_consensus.cc:515] T 24b316d8ce55441ea9cf056818fd658a P 6ba6d37b4c6344ec882213fb72cc10a3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ba6d37b4c6344ec882213fb72cc10a3" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 33623 } } peers { permanent_uuid: "e5d4c60ba4c64aa78850cf308be78a8d" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 37301 } } peers { permanent_uuid: "e34192eeaeb246a790a18368773bbe15" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 42349 } }
I20260709 13:03:43.620496 18633 leader_election.cc:290] T 24b316d8ce55441ea9cf056818fd658a P 6ba6d37b4c6344ec882213fb72cc10a3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e5d4c60ba4c64aa78850cf308be78a8d (127.17.223.2:37301), e34192eeaeb246a790a18368773bbe15 (127.17.223.3:42349)
I20260709 13:03:43.620184 18434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba252d6f681a44948699b78102577c8b" candidate_uuid: "e34192eeaeb246a790a18368773bbe15" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6ba6d37b4c6344ec882213fb72cc10a3" is_pre_election: true
I20260709 13:03:43.623471 18435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9e6e2dfc9624bbb887e108176acff29" candidate_uuid: "e34192eeaeb246a790a18368773bbe15" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6ba6d37b4c6344ec882213fb72cc10a3" is_pre_election: true
W20260709 13:03:43.628219 18548 leader_election.cc:343] T ba252d6f681a44948699b78102577c8b P e34192eeaeb246a790a18368773bbe15 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6ba6d37b4c6344ec882213fb72cc10a3 (127.17.223.1:33623): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:43.629104 18583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24b316d8ce55441ea9cf056818fd658a" candidate_uuid: "6ba6d37b4c6344ec882213fb72cc10a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e34192eeaeb246a790a18368773bbe15" is_pre_election: true
I20260709 13:03:43.630121 18584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b68da910d10d4d6a80b0055f7061ad27" candidate_uuid: "6ba6d37b4c6344ec882213fb72cc10a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e34192eeaeb246a790a18368773bbe15" is_pre_election: true
W20260709 13:03:43.634752 18401 leader_election.cc:343] T 24b316d8ce55441ea9cf056818fd658a P 6ba6d37b4c6344ec882213fb72cc10a3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e34192eeaeb246a790a18368773bbe15 (127.17.223.3:42349): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:03:43.635602 18548 leader_election.cc:343] T a9e6e2dfc9624bbb887e108176acff29 P e34192eeaeb246a790a18368773bbe15 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6ba6d37b4c6344ec882213fb72cc10a3 (127.17.223.1:33623): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:43.639025 18635 raft_consensus.cc:493] T ba252d6f681a44948699b78102577c8b P e5d4c60ba4c64aa78850cf308be78a8d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:03:43.638428 18401 leader_election.cc:343] T b68da910d10d4d6a80b0055f7061ad27 P 6ba6d37b4c6344ec882213fb72cc10a3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e34192eeaeb246a790a18368773bbe15 (127.17.223.3:42349): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:43.639731 18635 raft_consensus.cc:515] T ba252d6f681a44948699b78102577c8b P e5d4c60ba4c64aa78850cf308be78a8d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ba6d37b4c6344ec882213fb72cc10a3" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 33623 } } peers { permanent_uuid: "e5d4c60ba4c64aa78850cf308be78a8d" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 37301 } } peers { permanent_uuid: "e34192eeaeb246a790a18368773bbe15" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 42349 } }
I20260709 13:03:43.643476 18635 leader_election.cc:290] T ba252d6f681a44948699b78102577c8b P e5d4c60ba4c64aa78850cf308be78a8d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6ba6d37b4c6344ec882213fb72cc10a3 (127.17.223.1:33623), e34192eeaeb246a790a18368773bbe15 (127.17.223.3:42349)
I20260709 13:03:43.646845 18627 tablet_bootstrap.cc:492] T 63053c1fc3214bcd99d7c93f71c98ff3 P e34192eeaeb246a790a18368773bbe15: No bootstrap required, opened a new log
I20260709 13:03:43.647337 18627 ts_tablet_manager.cc:1403] T 63053c1fc3214bcd99d7c93f71c98ff3 P e34192eeaeb246a790a18368773bbe15: Time spent bootstrapping tablet: real 0.099s	user 0.016s	sys 0.030s
I20260709 13:03:43.650419 18627 raft_consensus.cc:359] T 63053c1fc3214bcd99d7c93f71c98ff3 P e34192eeaeb246a790a18368773bbe15 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ba6d37b4c6344ec882213fb72cc10a3" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 33623 } } peers { permanent_uuid: "e5d4c60ba4c64aa78850cf308be78a8d" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 37301 } } peers { permanent_uuid: "e34192eeaeb246a790a18368773bbe15" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 42349 } }
I20260709 13:03:43.651168 18627 raft_consensus.cc:385] T 63053c1fc3214bcd99d7c93f71c98ff3 P e34192eeaeb246a790a18368773bbe15 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:43.651477 18627 raft_consensus.cc:740] T 63053c1fc3214bcd99d7c93f71c98ff3 P e34192eeaeb246a790a18368773bbe15 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e34192eeaeb246a790a18368773bbe15, State: Initialized, Role: FOLLOWER
I20260709 13:03:43.652221 18627 consensus_queue.cc:260] T 63053c1fc3214bcd99d7c93f71c98ff3 P e34192eeaeb246a790a18368773bbe15 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ba6d37b4c6344ec882213fb72cc10a3" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 33623 } } peers { permanent_uuid: "e5d4c60ba4c64aa78850cf308be78a8d" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 37301 } } peers { permanent_uuid: "e34192eeaeb246a790a18368773bbe15" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 42349 } }
I20260709 13:03:43.652757 18628 tablet_bootstrap.cc:492] T a5d1966171cd4c25a9045a79b6ce1b58 P e5d4c60ba4c64aa78850cf308be78a8d: No bootstrap required, opened a new log
I20260709 13:03:43.654322 18628 ts_tablet_manager.cc:1403] T a5d1966171cd4c25a9045a79b6ce1b58 P e5d4c60ba4c64aa78850cf308be78a8d: Time spent bootstrapping tablet: real 0.077s	user 0.009s	sys 0.005s
I20260709 13:03:43.655051 18629 tablet_bootstrap.cc:492] T f5116788673d45ad9561408373f762a5 P 6ba6d37b4c6344ec882213fb72cc10a3: No bootstrap required, opened a new log
I20260709 13:03:43.655460 18629 ts_tablet_manager.cc:1403] T f5116788673d45ad9561408373f762a5 P 6ba6d37b4c6344ec882213fb72cc10a3: Time spent bootstrapping tablet: real 0.071s	user 0.014s	sys 0.004s
I20260709 13:03:43.659399 18629 raft_consensus.cc:359] T f5116788673d45ad9561408373f762a5 P 6ba6d37b4c6344ec882213fb72cc10a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ba6d37b4c6344ec882213fb72cc10a3" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 33623 } } peers { permanent_uuid: "e5d4c60ba4c64aa78850cf308be78a8d" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 37301 } } peers { permanent_uuid: "e34192eeaeb246a790a18368773bbe15" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 42349 } }
I20260709 13:03:43.660391 18627 ts_tablet_manager.cc:1434] T 63053c1fc3214bcd99d7c93f71c98ff3 P e34192eeaeb246a790a18368773bbe15: Time spent starting tablet: real 0.013s	user 0.007s	sys 0.000s
I20260709 13:03:43.660384 18628 raft_consensus.cc:359] T a5d1966171cd4c25a9045a79b6ce1b58 P e5d4c60ba4c64aa78850cf308be78a8d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ba6d37b4c6344ec882213fb72cc10a3" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 33623 } } peers { permanent_uuid: "e5d4c60ba4c64aa78850cf308be78a8d" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 37301 } } peers { permanent_uuid: "e34192eeaeb246a790a18368773bbe15" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 42349 } }
I20260709 13:03:43.665410 18628 raft_consensus.cc:385] T a5d1966171cd4c25a9045a79b6ce1b58 P e5d4c60ba4c64aa78850cf308be78a8d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:43.665781 18628 raft_consensus.cc:740] T a5d1966171cd4c25a9045a79b6ce1b58 P e5d4c60ba4c64aa78850cf308be78a8d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e5d4c60ba4c64aa78850cf308be78a8d, State: Initialized, Role: FOLLOWER
I20260709 13:03:43.661453 18627 tablet_bootstrap.cc:492] T 5c30ad177b44422f982d86fe00ab6c4a P e34192eeaeb246a790a18368773bbe15: Bootstrap starting.
I20260709 13:03:43.660585 18629 raft_consensus.cc:385] T f5116788673d45ad9561408373f762a5 P 6ba6d37b4c6344ec882213fb72cc10a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:43.690784 18629 raft_consensus.cc:740] T f5116788673d45ad9561408373f762a5 P 6ba6d37b4c6344ec882213fb72cc10a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6ba6d37b4c6344ec882213fb72cc10a3, State: Initialized, Role: FOLLOWER
I20260709 13:03:43.672017 18628 consensus_queue.cc:260] T a5d1966171cd4c25a9045a79b6ce1b58 P e5d4c60ba4c64aa78850cf308be78a8d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ba6d37b4c6344ec882213fb72cc10a3" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 33623 } } peers { permanent_uuid: "e5d4c60ba4c64aa78850cf308be78a8d" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 37301 } } peers { permanent_uuid: "e34192eeaeb246a790a18368773bbe15" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 42349 } }
I20260709 13:03:43.692778 18629 consensus_queue.cc:260] T f5116788673d45ad9561408373f762a5 P 6ba6d37b4c6344ec882213fb72cc10a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ba6d37b4c6344ec882213fb72cc10a3" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 33623 } } peers { permanent_uuid: "e5d4c60ba4c64aa78850cf308be78a8d" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 37301 } } peers { permanent_uuid: "e34192eeaeb246a790a18368773bbe15" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 42349 } }
I20260709 13:03:43.689899 18509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24b316d8ce55441ea9cf056818fd658a" candidate_uuid: "6ba6d37b4c6344ec882213fb72cc10a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e5d4c60ba4c64aa78850cf308be78a8d" is_pre_election: true
I20260709 13:03:43.699214 18509 raft_consensus.cc:2468] T 24b316d8ce55441ea9cf056818fd658a P e5d4c60ba4c64aa78850cf308be78a8d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ba6d37b4c6344ec882213fb72cc10a3 in term 0.
I20260709 13:03:43.672319 18508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9e6e2dfc9624bbb887e108176acff29" candidate_uuid: "e34192eeaeb246a790a18368773bbe15" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e5d4c60ba4c64aa78850cf308be78a8d" is_pre_election: true
I20260709 13:03:43.702363 18400 leader_election.cc:304] T 24b316d8ce55441ea9cf056818fd658a P 6ba6d37b4c6344ec882213fb72cc10a3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6ba6d37b4c6344ec882213fb72cc10a3, e5d4c60ba4c64aa78850cf308be78a8d; no voters: e34192eeaeb246a790a18368773bbe15
I20260709 13:03:43.704449 18633 raft_consensus.cc:2804] T 24b316d8ce55441ea9cf056818fd658a P 6ba6d37b4c6344ec882213fb72cc10a3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:03:43.704841 18633 raft_consensus.cc:493] T 24b316d8ce55441ea9cf056818fd658a P 6ba6d37b4c6344ec882213fb72cc10a3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:43.705215 18633 raft_consensus.cc:3060] T 24b316d8ce55441ea9cf056818fd658a P 6ba6d37b4c6344ec882213fb72cc10a3 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:03:43.729738 18549 leader_election.cc:343] T a9e6e2dfc9624bbb887e108176acff29 P e34192eeaeb246a790a18368773bbe15 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e5d4c60ba4c64aa78850cf308be78a8d (127.17.223.2:37301): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:43.730458 18549 leader_election.cc:304] T a9e6e2dfc9624bbb887e108176acff29 P e34192eeaeb246a790a18368773bbe15 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e34192eeaeb246a790a18368773bbe15; no voters: 6ba6d37b4c6344ec882213fb72cc10a3, e5d4c60ba4c64aa78850cf308be78a8d
I20260709 13:03:43.733366 18634 raft_consensus.cc:2749] T a9e6e2dfc9624bbb887e108176acff29 P e34192eeaeb246a790a18368773bbe15 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:03:43.666848 18510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b68da910d10d4d6a80b0055f7061ad27" candidate_uuid: "6ba6d37b4c6344ec882213fb72cc10a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e5d4c60ba4c64aa78850cf308be78a8d" is_pre_election: true
W20260709 13:03:43.736215 18400 leader_election.cc:343] T b68da910d10d4d6a80b0055f7061ad27 P 6ba6d37b4c6344ec882213fb72cc10a3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e5d4c60ba4c64aa78850cf308be78a8d (127.17.223.2:37301): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:43.736720 18400 leader_election.cc:304] T b68da910d10d4d6a80b0055f7061ad27 P 6ba6d37b4c6344ec882213fb72cc10a3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ba6d37b4c6344ec882213fb72cc10a3; no voters: e34192eeaeb246a790a18368773bbe15, e5d4c60ba4c64aa78850cf308be78a8d
I20260709 13:03:43.737152 18633 raft_consensus.cc:515] T 24b316d8ce55441ea9cf056818fd658a P 6ba6d37b4c6344ec882213fb72cc10a3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ba6d37b4c6344ec882213fb72cc10a3" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 33623 } } peers { permanent_uuid: "e5d4c60ba4c64aa78850cf308be78a8d" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 37301 } } peers { permanent_uuid: "e34192eeaeb246a790a18368773bbe15" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 42349 } }
I20260709 13:03:43.672971 18507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba252d6f681a44948699b78102577c8b" candidate_uuid: "e34192eeaeb246a790a18368773bbe15" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e5d4c60ba4c64aa78850cf308be78a8d" is_pre_election: true
I20260709 13:03:43.743435 18629 ts_tablet_manager.cc:1434] T f5116788673d45ad9561408373f762a5 P 6ba6d37b4c6344ec882213fb72cc10a3: Time spent starting tablet: real 0.088s	user 0.023s	sys 0.009s
I20260709 13:03:43.744443 18629 tablet_bootstrap.cc:492] T 5c30ad177b44422f982d86fe00ab6c4a P 6ba6d37b4c6344ec882213fb72cc10a3: Bootstrap starting.
I20260709 13:03:43.745705 18628 ts_tablet_manager.cc:1434] T a5d1966171cd4c25a9045a79b6ce1b58 P e5d4c60ba4c64aa78850cf308be78a8d: Time spent starting tablet: real 0.091s	user 0.030s	sys 0.034s
I20260709 13:03:43.746615 18628 tablet_bootstrap.cc:492] T 63053c1fc3214bcd99d7c93f71c98ff3 P e5d4c60ba4c64aa78850cf308be78a8d: Bootstrap starting.
I20260709 13:03:43.744535 18627 tablet_bootstrap.cc:654] T 5c30ad177b44422f982d86fe00ab6c4a P e34192eeaeb246a790a18368773bbe15: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:43.740890 18507 raft_consensus.cc:2468] T ba252d6f681a44948699b78102577c8b P e5d4c60ba4c64aa78850cf308be78a8d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e34192eeaeb246a790a18368773bbe15 in term 0.
I20260709 13:03:43.754252 18549 leader_election.cc:304] T ba252d6f681a44948699b78102577c8b P e34192eeaeb246a790a18368773bbe15 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e34192eeaeb246a790a18368773bbe15, e5d4c60ba4c64aa78850cf308be78a8d; no voters: 6ba6d37b4c6344ec882213fb72cc10a3
I20260709 13:03:43.755388 18634 raft_consensus.cc:2804] T ba252d6f681a44948699b78102577c8b P e34192eeaeb246a790a18368773bbe15 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:03:43.755751 18634 raft_consensus.cc:493] T ba252d6f681a44948699b78102577c8b P e34192eeaeb246a790a18368773bbe15 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:43.756062 18634 raft_consensus.cc:3060] T ba252d6f681a44948699b78102577c8b P e34192eeaeb246a790a18368773bbe15 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:43.759603 18584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24b316d8ce55441ea9cf056818fd658a" candidate_uuid: "6ba6d37b4c6344ec882213fb72cc10a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e34192eeaeb246a790a18368773bbe15"
W20260709 13:03:43.762892 18401 leader_election.cc:343] T 24b316d8ce55441ea9cf056818fd658a P 6ba6d37b4c6344ec882213fb72cc10a3 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer e34192eeaeb246a790a18368773bbe15 (127.17.223.3:42349): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:43.757093 18633 leader_election.cc:290] T 24b316d8ce55441ea9cf056818fd658a P 6ba6d37b4c6344ec882213fb72cc10a3 [CANDIDATE]: Term 1 election: Requested vote from peers e5d4c60ba4c64aa78850cf308be78a8d (127.17.223.2:37301), e34192eeaeb246a790a18368773bbe15 (127.17.223.3:42349)
I20260709 13:03:43.764389 18633 raft_consensus.cc:2749] T b68da910d10d4d6a80b0055f7061ad27 P 6ba6d37b4c6344ec882213fb72cc10a3 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:03:43.767256 18507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24b316d8ce55441ea9cf056818fd658a" candidate_uuid: "6ba6d37b4c6344ec882213fb72cc10a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e5d4c60ba4c64aa78850cf308be78a8d"
I20260709 13:03:43.767307 18435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba252d6f681a44948699b78102577c8b" candidate_uuid: "e5d4c60ba4c64aa78850cf308be78a8d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6ba6d37b4c6344ec882213fb72cc10a3" is_pre_election: true
I20260709 13:03:43.767908 18507 raft_consensus.cc:3060] T 24b316d8ce55441ea9cf056818fd658a P e5d4c60ba4c64aa78850cf308be78a8d [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:03:43.769850 18474 leader_election.cc:343] T ba252d6f681a44948699b78102577c8b P e5d4c60ba4c64aa78850cf308be78a8d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6ba6d37b4c6344ec882213fb72cc10a3 (127.17.223.1:33623): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:43.770828 18584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba252d6f681a44948699b78102577c8b" candidate_uuid: "e5d4c60ba4c64aa78850cf308be78a8d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e34192eeaeb246a790a18368773bbe15" is_pre_election: true
I20260709 13:03:43.773411 18634 raft_consensus.cc:515] T ba252d6f681a44948699b78102577c8b P e34192eeaeb246a790a18368773bbe15 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ba6d37b4c6344ec882213fb72cc10a3" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 33623 } } peers { permanent_uuid: "e5d4c60ba4c64aa78850cf308be78a8d" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 37301 } } peers { permanent_uuid: "e34192eeaeb246a790a18368773bbe15" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 42349 } }
I20260709 13:03:43.775619 18584 raft_consensus.cc:2393] T ba252d6f681a44948699b78102577c8b P e34192eeaeb246a790a18368773bbe15 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e5d4c60ba4c64aa78850cf308be78a8d in current term 1: Already voted for candidate e34192eeaeb246a790a18368773bbe15 in this term.
I20260709 13:03:43.776916 18629 tablet_bootstrap.cc:654] T 5c30ad177b44422f982d86fe00ab6c4a P 6ba6d37b4c6344ec882213fb72cc10a3: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:43.780696 18476 leader_election.cc:304] T ba252d6f681a44948699b78102577c8b P e5d4c60ba4c64aa78850cf308be78a8d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5d4c60ba4c64aa78850cf308be78a8d; no voters: 6ba6d37b4c6344ec882213fb72cc10a3, e34192eeaeb246a790a18368773bbe15
I20260709 13:03:43.781642 18628 tablet_bootstrap.cc:654] T 63053c1fc3214bcd99d7c93f71c98ff3 P e5d4c60ba4c64aa78850cf308be78a8d: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:43.781967 18635 raft_consensus.cc:3060] T ba252d6f681a44948699b78102577c8b P e5d4c60ba4c64aa78850cf308be78a8d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:43.787405 18627 tablet_bootstrap.cc:492] T 5c30ad177b44422f982d86fe00ab6c4a P e34192eeaeb246a790a18368773bbe15: No bootstrap required, opened a new log
I20260709 13:03:43.787856 18627 ts_tablet_manager.cc:1403] T 5c30ad177b44422f982d86fe00ab6c4a P e34192eeaeb246a790a18368773bbe15: Time spent bootstrapping tablet: real 0.127s	user 0.025s	sys 0.038s
I20260709 13:03:43.789486 18435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba252d6f681a44948699b78102577c8b" candidate_uuid: "e34192eeaeb246a790a18368773bbe15" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6ba6d37b4c6344ec882213fb72cc10a3"
I20260709 13:03:43.790630 18635 raft_consensus.cc:2749] T ba252d6f681a44948699b78102577c8b P e5d4c60ba4c64aa78850cf308be78a8d [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:03:43.791522 18548 leader_election.cc:343] T ba252d6f681a44948699b78102577c8b P e34192eeaeb246a790a18368773bbe15 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6ba6d37b4c6344ec882213fb72cc10a3 (127.17.223.1:33623): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:43.791491 18627 raft_consensus.cc:359] T 5c30ad177b44422f982d86fe00ab6c4a P e34192eeaeb246a790a18368773bbe15 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5d4c60ba4c64aa78850cf308be78a8d" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 37301 } } peers { permanent_uuid: "6ba6d37b4c6344ec882213fb72cc10a3" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 33623 } } peers { permanent_uuid: "e34192eeaeb246a790a18368773bbe15" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 42349 } }
I20260709 13:03:43.792280 18627 raft_consensus.cc:385] T 5c30ad177b44422f982d86fe00ab6c4a P e34192eeaeb246a790a18368773bbe15 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:43.792583 18627 raft_consensus.cc:740] T 5c30ad177b44422f982d86fe00ab6c4a P e34192eeaeb246a790a18368773bbe15 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e34192eeaeb246a790a18368773bbe15, State: Initialized, Role: FOLLOWER
I20260709 13:03:43.793268 18627 consensus_queue.cc:260] T 5c30ad177b44422f982d86fe00ab6c4a P e34192eeaeb246a790a18368773bbe15 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5d4c60ba4c64aa78850cf308be78a8d" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 37301 } } peers { permanent_uuid: "6ba6d37b4c6344ec882213fb72cc10a3" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 33623 } } peers { permanent_uuid: "e34192eeaeb246a790a18368773bbe15" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 42349 } }
I20260709 13:03:43.794739 18634 leader_election.cc:290] T ba252d6f681a44948699b78102577c8b P e34192eeaeb246a790a18368773bbe15 [CANDIDATE]: Term 1 election: Requested vote from peers 6ba6d37b4c6344ec882213fb72cc10a3 (127.17.223.1:33623), e5d4c60ba4c64aa78850cf308be78a8d (127.17.223.2:37301)
I20260709 13:03:43.796428 18510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba252d6f681a44948699b78102577c8b" candidate_uuid: "e34192eeaeb246a790a18368773bbe15" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e5d4c60ba4c64aa78850cf308be78a8d"
I20260709 13:03:43.798740 18629 tablet_bootstrap.cc:492] T 5c30ad177b44422f982d86fe00ab6c4a P 6ba6d37b4c6344ec882213fb72cc10a3: No bootstrap required, opened a new log
I20260709 13:03:43.799232 18629 ts_tablet_manager.cc:1403] T 5c30ad177b44422f982d86fe00ab6c4a P 6ba6d37b4c6344ec882213fb72cc10a3: Time spent bootstrapping tablet: real 0.055s	user 0.012s	sys 0.008s
I20260709 13:03:43.799510 18507 raft_consensus.cc:2468] T 24b316d8ce55441ea9cf056818fd658a P e5d4c60ba4c64aa78850cf308be78a8d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ba6d37b4c6344ec882213fb72cc10a3 in term 1.
I20260709 13:03:43.800743 18400 leader_election.cc:304] T 24b316d8ce55441ea9cf056818fd658a P 6ba6d37b4c6344ec882213fb72cc10a3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6ba6d37b4c6344ec882213fb72cc10a3, e5d4c60ba4c64aa78850cf308be78a8d; no voters: e34192eeaeb246a790a18368773bbe15
I20260709 13:03:43.802577 18650 raft_consensus.cc:2804] T 24b316d8ce55441ea9cf056818fd658a P 6ba6d37b4c6344ec882213fb72cc10a3 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:03:43.803087 18650 raft_consensus.cc:697] T 24b316d8ce55441ea9cf056818fd658a P 6ba6d37b4c6344ec882213fb72cc10a3 [term 1 LEADER]: Becoming Leader. State: Replica: 6ba6d37b4c6344ec882213fb72cc10a3, State: Running, Role: LEADER
I20260709 13:03:43.803423 18629 raft_consensus.cc:359] T 5c30ad177b44422f982d86fe00ab6c4a P 6ba6d37b4c6344ec882213fb72cc10a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5d4c60ba4c64aa78850cf308be78a8d" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 37301 } } peers { permanent_uuid: "6ba6d37b4c6344ec882213fb72cc10a3" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 33623 } } peers { permanent_uuid: "e34192eeaeb246a790a18368773bbe15" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 42349 } }
I20260709 13:03:43.804201 18629 raft_consensus.cc:385] T 5c30ad177b44422f982d86fe00ab6c4a P 6ba6d37b4c6344ec882213fb72cc10a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:43.803893 18650 consensus_queue.cc:237] T 24b316d8ce55441ea9cf056818fd658a P 6ba6d37b4c6344ec882213fb72cc10a3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ba6d37b4c6344ec882213fb72cc10a3" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 33623 } } peers { permanent_uuid: "e5d4c60ba4c64aa78850cf308be78a8d" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 37301 } } peers { permanent_uuid: "e34192eeaeb246a790a18368773bbe15" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 42349 } }
I20260709 13:03:43.804507 18629 raft_consensus.cc:740] T 5c30ad177b44422f982d86fe00ab6c4a P 6ba6d37b4c6344ec882213fb72cc10a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6ba6d37b4c6344ec882213fb72cc10a3, State: Initialized, Role: FOLLOWER
I20260709 13:03:43.805759 18628 tablet_bootstrap.cc:492] T 63053c1fc3214bcd99d7c93f71c98ff3 P e5d4c60ba4c64aa78850cf308be78a8d: No bootstrap required, opened a new log
I20260709 13:03:43.805778 18629 consensus_queue.cc:260] T 5c30ad177b44422f982d86fe00ab6c4a P 6ba6d37b4c6344ec882213fb72cc10a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5d4c60ba4c64aa78850cf308be78a8d" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 37301 } } peers { permanent_uuid: "6ba6d37b4c6344ec882213fb72cc10a3" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 33623 } } peers { permanent_uuid: "e34192eeaeb246a790a18368773bbe15" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 42349 } }
I20260709 13:03:43.806396 18628 ts_tablet_manager.cc:1403] T 63053c1fc3214bcd99d7c93f71c98ff3 P e5d4c60ba4c64aa78850cf308be78a8d: Time spent bootstrapping tablet: real 0.060s	user 0.012s	sys 0.003s
I20260709 13:03:43.808482 18629 ts_tablet_manager.cc:1434] T 5c30ad177b44422f982d86fe00ab6c4a P 6ba6d37b4c6344ec882213fb72cc10a3: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.000s
I20260709 13:03:43.809491 18629 tablet_bootstrap.cc:492] T ba252d6f681a44948699b78102577c8b P 6ba6d37b4c6344ec882213fb72cc10a3: Bootstrap starting.
I20260709 13:03:43.809975 18628 raft_consensus.cc:359] T 63053c1fc3214bcd99d7c93f71c98ff3 P e5d4c60ba4c64aa78850cf308be78a8d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ba6d37b4c6344ec882213fb72cc10a3" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 33623 } } peers { permanent_uuid: "e5d4c60ba4c64aa78850cf308be78a8d" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 37301 } } peers { permanent_uuid: "e34192eeaeb246a790a18368773bbe15" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 42349 } }
I20260709 13:03:43.810753 18628 raft_consensus.cc:385] T 63053c1fc3214bcd99d7c93f71c98ff3 P e5d4c60ba4c64aa78850cf308be78a8d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:43.811092 18628 raft_consensus.cc:740] T 63053c1fc3214bcd99d7c93f71c98ff3 P e5d4c60ba4c64aa78850cf308be78a8d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e5d4c60ba4c64aa78850cf308be78a8d, State: Initialized, Role: FOLLOWER
I20260709 13:03:43.811388 18510 raft_consensus.cc:2468] T ba252d6f681a44948699b78102577c8b P e5d4c60ba4c64aa78850cf308be78a8d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e34192eeaeb246a790a18368773bbe15 in term 1.
I20260709 13:03:43.812016 18628 consensus_queue.cc:260] T 63053c1fc3214bcd99d7c93f71c98ff3 P e5d4c60ba4c64aa78850cf308be78a8d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ba6d37b4c6344ec882213fb72cc10a3" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 33623 } } peers { permanent_uuid: "e5d4c60ba4c64aa78850cf308be78a8d" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 37301 } } peers { permanent_uuid: "e34192eeaeb246a790a18368773bbe15" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 42349 } }
I20260709 13:03:43.812593 18549 leader_election.cc:304] T ba252d6f681a44948699b78102577c8b P e34192eeaeb246a790a18368773bbe15 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e34192eeaeb246a790a18368773bbe15, e5d4c60ba4c64aa78850cf308be78a8d; no voters: 6ba6d37b4c6344ec882213fb72cc10a3
I20260709 13:03:43.814662 18634 raft_consensus.cc:2804] T ba252d6f681a44948699b78102577c8b P e34192eeaeb246a790a18368773bbe15 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:03:43.815141 18634 raft_consensus.cc:697] T ba252d6f681a44948699b78102577c8b P e34192eeaeb246a790a18368773bbe15 [term 1 LEADER]: Becoming Leader. State: Replica: e34192eeaeb246a790a18368773bbe15, State: Running, Role: LEADER
I20260709 13:03:43.816339 18629 tablet_bootstrap.cc:654] T ba252d6f681a44948699b78102577c8b P 6ba6d37b4c6344ec882213fb72cc10a3: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:43.815914 18634 consensus_queue.cc:237] T ba252d6f681a44948699b78102577c8b P e34192eeaeb246a790a18368773bbe15 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ba6d37b4c6344ec882213fb72cc10a3" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 33623 } } peers { permanent_uuid: "e5d4c60ba4c64aa78850cf308be78a8d" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 37301 } } peers { permanent_uuid: "e34192eeaeb246a790a18368773bbe15" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 42349 } }
I20260709 13:03:43.819761 18628 ts_tablet_manager.cc:1434] T 63053c1fc3214bcd99d7c93f71c98ff3 P e5d4c60ba4c64aa78850cf308be78a8d: Time spent starting tablet: real 0.013s	user 0.006s	sys 0.001s
I20260709 13:03:43.821127 18628 tablet_bootstrap.cc:492] T 5c30ad177b44422f982d86fe00ab6c4a P e5d4c60ba4c64aa78850cf308be78a8d: Bootstrap starting.
I20260709 13:03:43.828415 18629 tablet_bootstrap.cc:492] T ba252d6f681a44948699b78102577c8b P 6ba6d37b4c6344ec882213fb72cc10a3: No bootstrap required, opened a new log
I20260709 13:03:43.828900 18629 ts_tablet_manager.cc:1403] T ba252d6f681a44948699b78102577c8b P 6ba6d37b4c6344ec882213fb72cc10a3: Time spent bootstrapping tablet: real 0.020s	user 0.012s	sys 0.004s
I20260709 13:03:43.829192 18628 tablet_bootstrap.cc:654] T 5c30ad177b44422f982d86fe00ab6c4a P e5d4c60ba4c64aa78850cf308be78a8d: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:43.832060 18629 raft_consensus.cc:359] T ba252d6f681a44948699b78102577c8b P 6ba6d37b4c6344ec882213fb72cc10a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ba6d37b4c6344ec882213fb72cc10a3" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 33623 } } peers { permanent_uuid: "e5d4c60ba4c64aa78850cf308be78a8d" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 37301 } } peers { permanent_uuid: "e34192eeaeb246a790a18368773bbe15" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 42349 } }
I20260709 13:03:43.832914 18629 raft_consensus.cc:385] T ba252d6f681a44948699b78102577c8b P 6ba6d37b4c6344ec882213fb72cc10a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:43.833278 18629 raft_consensus.cc:740] T ba252d6f681a44948699b78102577c8b P 6ba6d37b4c6344ec882213fb72cc10a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6ba6d37b4c6344ec882213fb72cc10a3, State: Initialized, Role: FOLLOWER
I20260709 13:03:43.834453 18629 consensus_queue.cc:260] T ba252d6f681a44948699b78102577c8b P 6ba6d37b4c6344ec882213fb72cc10a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ba6d37b4c6344ec882213fb72cc10a3" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 33623 } } peers { permanent_uuid: "e5d4c60ba4c64aa78850cf308be78a8d" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 37301 } } peers { permanent_uuid: "e34192eeaeb246a790a18368773bbe15" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 42349 } }
I20260709 13:03:43.837389 18629 ts_tablet_manager.cc:1434] T ba252d6f681a44948699b78102577c8b P 6ba6d37b4c6344ec882213fb72cc10a3: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 13:03:43.838433 18650 raft_consensus.cc:493] T 476ca419566a4bc1883e94647b632918 P 6ba6d37b4c6344ec882213fb72cc10a3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:43.838079 18329 catalog_manager.cc:5697] T 24b316d8ce55441ea9cf056818fd658a P 6ba6d37b4c6344ec882213fb72cc10a3 reported cstate change: term changed from 0 to 1, leader changed from <none> to 6ba6d37b4c6344ec882213fb72cc10a3 (127.17.223.1). New cstate: current_term: 1 leader_uuid: "6ba6d37b4c6344ec882213fb72cc10a3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ba6d37b4c6344ec882213fb72cc10a3" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 33623 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e5d4c60ba4c64aa78850cf308be78a8d" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 37301 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e34192eeaeb246a790a18368773bbe15" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 42349 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:43.839068 18650 raft_consensus.cc:515] T 476ca419566a4bc1883e94647b632918 P 6ba6d37b4c6344ec882213fb72cc10a3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ba6d37b4c6344ec882213fb72cc10a3" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 33623 } } peers { permanent_uuid: "e5d4c60ba4c64aa78850cf308be78a8d" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 37301 } } peers { permanent_uuid: "e34192eeaeb246a790a18368773bbe15" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 42349 } }
I20260709 13:03:43.842432 18510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "476ca419566a4bc1883e94647b632918" candidate_uuid: "6ba6d37b4c6344ec882213fb72cc10a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e5d4c60ba4c64aa78850cf308be78a8d" is_pre_election: true
I20260709 13:03:43.843211 18584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "476ca419566a4bc1883e94647b632918" candidate_uuid: "6ba6d37b4c6344ec882213fb72cc10a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e34192eeaeb246a790a18368773bbe15" is_pre_election: true
W20260709 13:03:43.843881 18400 leader_election.cc:343] T 476ca419566a4bc1883e94647b632918 P 6ba6d37b4c6344ec882213fb72cc10a3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e5d4c60ba4c64aa78850cf308be78a8d (127.17.223.2:37301): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:43.845343 18650 leader_election.cc:290] T 476ca419566a4bc1883e94647b632918 P 6ba6d37b4c6344ec882213fb72cc10a3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e5d4c60ba4c64aa78850cf308be78a8d (127.17.223.2:37301), e34192eeaeb246a790a18368773bbe15 (127.17.223.3:42349)
W20260709 13:03:43.845638 18401 leader_election.cc:343] T 476ca419566a4bc1883e94647b632918 P 6ba6d37b4c6344ec882213fb72cc10a3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e34192eeaeb246a790a18368773bbe15 (127.17.223.3:42349): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:43.846103 18401 leader_election.cc:304] T 476ca419566a4bc1883e94647b632918 P 6ba6d37b4c6344ec882213fb72cc10a3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ba6d37b4c6344ec882213fb72cc10a3; no voters: e34192eeaeb246a790a18368773bbe15, e5d4c60ba4c64aa78850cf308be78a8d
I20260709 13:03:43.846514 18629 tablet_bootstrap.cc:492] T a9e6e2dfc9624bbb887e108176acff29 P 6ba6d37b4c6344ec882213fb72cc10a3: Bootstrap starting.
I20260709 13:03:43.848690 18650 raft_consensus.cc:2749] T 476ca419566a4bc1883e94647b632918 P 6ba6d37b4c6344ec882213fb72cc10a3 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:03:43.850728 18627 ts_tablet_manager.cc:1434] T 5c30ad177b44422f982d86fe00ab6c4a P e34192eeaeb246a790a18368773bbe15: Time spent starting tablet: real 0.063s	user 0.002s	sys 0.013s
I20260709 13:03:43.852751 18627 tablet_bootstrap.cc:492] T 476ca419566a4bc1883e94647b632918 P e34192eeaeb246a790a18368773bbe15: Bootstrap starting.
I20260709 13:03:43.852658 18655 raft_consensus.cc:493] T 63053c1fc3214bcd99d7c93f71c98ff3 P e34192eeaeb246a790a18368773bbe15 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:43.854189 18655 raft_consensus.cc:515] T 63053c1fc3214bcd99d7c93f71c98ff3 P e34192eeaeb246a790a18368773bbe15 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ba6d37b4c6344ec882213fb72cc10a3" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 33623 } } peers { permanent_uuid: "e5d4c60ba4c64aa78850cf308be78a8d" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 37301 } } peers { permanent_uuid: "e34192eeaeb246a790a18368773bbe15" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 42349 } }
I20260709 13:03:43.858083 18655 leader_election.cc:290] T 63053c1fc3214bcd99d7c93f71c98ff3 P e34192eeaeb246a790a18368773bbe15 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6ba6d37b4c6344ec882213fb72cc10a3 (127.17.223.1:33623), e5d4c60ba4c64aa78850cf308be78a8d (127.17.223.2:37301)
I20260709 13:03:43.859761 18510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63053c1fc3214bcd99d7c93f71c98ff3" candidate_uuid: "e34192eeaeb246a790a18368773bbe15" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e5d4c60ba4c64aa78850cf308be78a8d" is_pre_election: true
I20260709 13:03:43.860427 18510 raft_consensus.cc:2468] T 63053c1fc3214bcd99d7c93f71c98ff3 P e5d4c60ba4c64aa78850cf308be78a8d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e34192eeaeb246a790a18368773bbe15 in term 0.
I20260709 13:03:43.860715 18435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63053c1fc3214bcd99d7c93f71c98ff3" candidate_uuid: "e34192eeaeb246a790a18368773bbe15" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6ba6d37b4c6344ec882213fb72cc10a3" is_pre_election: true
I20260709 13:03:43.861963 18629 tablet_bootstrap.cc:654] T a9e6e2dfc9624bbb887e108176acff29 P 6ba6d37b4c6344ec882213fb72cc10a3: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:43.862972 18549 leader_election.cc:304] T 63053c1fc3214bcd99d7c93f71c98ff3 P e34192eeaeb246a790a18368773bbe15 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e34192eeaeb246a790a18368773bbe15, e5d4c60ba4c64aa78850cf308be78a8d; no voters: 
I20260709 13:03:43.860766 18330 catalog_manager.cc:5697] T ba252d6f681a44948699b78102577c8b P e34192eeaeb246a790a18368773bbe15 reported cstate change: term changed from 0 to 1, leader changed from <none> to e34192eeaeb246a790a18368773bbe15 (127.17.223.3). New cstate: current_term: 1 leader_uuid: "e34192eeaeb246a790a18368773bbe15" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ba6d37b4c6344ec882213fb72cc10a3" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 33623 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e5d4c60ba4c64aa78850cf308be78a8d" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 37301 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e34192eeaeb246a790a18368773bbe15" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 42349 } health_report { overall_health: HEALTHY } } }
I20260709 13:03:43.863806 18655 raft_consensus.cc:2804] T 63053c1fc3214bcd99d7c93f71c98ff3 P e34192eeaeb246a790a18368773bbe15 [term 0 FOLLOWER]: Leader pre-election won for term 1
W20260709 13:03:43.863596 18548 leader_election.cc:343] T 63053c1fc3214bcd99d7c93f71c98ff3 P e34192eeaeb246a790a18368773bbe15 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6ba6d37b4c6344ec882213fb72cc10a3 (127.17.223.1:33623): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:43.864353 18655 raft_consensus.cc:493] T 63053c1fc3214bcd99d7c93f71c98ff3 P e34192eeaeb246a790a18368773bbe15 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:43.865342 18655 raft_consensus.cc:3060] T 63053c1fc3214bcd99d7c93f71c98ff3 P e34192eeaeb246a790a18368773bbe15 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:43.861668 18628 tablet_bootstrap.cc:492] T 5c30ad177b44422f982d86fe00ab6c4a P e5d4c60ba4c64aa78850cf308be78a8d: No bootstrap required, opened a new log
I20260709 13:03:43.871305 18627 tablet_bootstrap.cc:654] T 476ca419566a4bc1883e94647b632918 P e34192eeaeb246a790a18368773bbe15: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:43.866837 18628 ts_tablet_manager.cc:1403] T 5c30ad177b44422f982d86fe00ab6c4a P e5d4c60ba4c64aa78850cf308be78a8d: Time spent bootstrapping tablet: real 0.046s	user 0.023s	sys 0.012s
I20260709 13:03:43.877055 18655 raft_consensus.cc:515] T 63053c1fc3214bcd99d7c93f71c98ff3 P e34192eeaeb246a790a18368773bbe15 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ba6d37b4c6344ec882213fb72cc10a3" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 33623 } } peers { permanent_uuid: "e5d4c60ba4c64aa78850cf308be78a8d" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 37301 } } peers { permanent_uuid: "e34192eeaeb246a790a18368773bbe15" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 42349 } }
I20260709 13:03:43.877113 18628 raft_consensus.cc:359] T 5c30ad177b44422f982d86fe00ab6c4a P e5d4c60ba4c64aa78850cf308be78a8d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5d4c60ba4c64aa78850cf308be78a8d" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 37301 } } peers { permanent_uuid: "6ba6d37b4c6344ec882213fb72cc10a3" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 33623 } } peers { permanent_uuid: "e34192eeaeb246a790a18368773bbe15" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 42349 } }
I20260709 13:03:43.886858 18628 raft_consensus.cc:385] T 5c30ad177b44422f982d86fe00ab6c4a P e5d4c60ba4c64aa78850cf308be78a8d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:43.887243 18628 raft_consensus.cc:740] T 5c30ad177b44422f982d86fe00ab6c4a P e5d4c60ba4c64aa78850cf308be78a8d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e5d4c60ba4c64aa78850cf308be78a8d, State: Initialized, Role: FOLLOWER
I20260709 13:03:43.888514 18627 tablet_bootstrap.cc:492] T 476ca419566a4bc1883e94647b632918 P e34192eeaeb246a790a18368773bbe15: No bootstrap required, opened a new log
I20260709 13:03:43.888934 18627 ts_tablet_manager.cc:1403] T 476ca419566a4bc1883e94647b632918 P e34192eeaeb246a790a18368773bbe15: Time spent bootstrapping tablet: real 0.036s	user 0.012s	sys 0.006s
I20260709 13:03:43.890038 18655 leader_election.cc:290] T 63053c1fc3214bcd99d7c93f71c98ff3 P e34192eeaeb246a790a18368773bbe15 [CANDIDATE]: Term 1 election: Requested vote from peers 6ba6d37b4c6344ec882213fb72cc10a3 (127.17.223.1:33623), e5d4c60ba4c64aa78850cf308be78a8d (127.17.223.2:37301)
I20260709 13:03:43.890211 18629 tablet_bootstrap.cc:492] T a9e6e2dfc9624bbb887e108176acff29 P 6ba6d37b4c6344ec882213fb72cc10a3: No bootstrap required, opened a new log
I20260709 13:03:43.890709 18629 ts_tablet_manager.cc:1403] T a9e6e2dfc9624bbb887e108176acff29 P 6ba6d37b4c6344ec882213fb72cc10a3: Time spent bootstrapping tablet: real 0.044s	user 0.009s	sys 0.013s
I20260709 13:03:43.891204 18435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63053c1fc3214bcd99d7c93f71c98ff3" candidate_uuid: "e34192eeaeb246a790a18368773bbe15" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6ba6d37b4c6344ec882213fb72cc10a3"
I20260709 13:03:43.891706 18627 raft_consensus.cc:359] T 476ca419566a4bc1883e94647b632918 P e34192eeaeb246a790a18368773bbe15 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ba6d37b4c6344ec882213fb72cc10a3" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 33623 } } peers { permanent_uuid: "e5d4c60ba4c64aa78850cf308be78a8d" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 37301 } } peers { permanent_uuid: "e34192eeaeb246a790a18368773bbe15" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 42349 } }
I20260709 13:03:43.892382 18627 raft_consensus.cc:385] T 476ca419566a4bc1883e94647b632918 P e34192eeaeb246a790a18368773bbe15 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:43.892681 18627 raft_consensus.cc:740] T 476ca419566a4bc1883e94647b632918 P e34192eeaeb246a790a18368773bbe15 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e34192eeaeb246a790a18368773bbe15, State: Initialized, Role: FOLLOWER
I20260709 13:03:43.893409 18629 raft_consensus.cc:359] T a9e6e2dfc9624bbb887e108176acff29 P 6ba6d37b4c6344ec882213fb72cc10a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ba6d37b4c6344ec882213fb72cc10a3" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 33623 } } peers { permanent_uuid: "e5d4c60ba4c64aa78850cf308be78a8d" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 37301 } } peers { permanent_uuid: "e34192eeaeb246a790a18368773bbe15" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 42349 } }
I20260709 13:03:43.892791 18510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63053c1fc3214bcd99d7c93f71c98ff3" candidate_uuid: "e34192eeaeb246a790a18368773bbe15" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e5d4c60ba4c64aa78850cf308be78a8d"
I20260709 13:03:43.888012 18628 consensus_queue.cc:260] T 5c30ad177b44422f982d86fe00ab6c4a P e5d4c60ba4c64aa78850cf308be78a8d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5d4c60ba4c64aa78850cf308be78a8d" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 37301 } } peers { permanent_uuid: "6ba6d37b4c6344ec882213fb72cc10a3" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 33623 } } peers { permanent_uuid: "e34192eeaeb246a790a18368773bbe15" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 42349 } }
I20260709 13:03:43.894100 18629 raft_consensus.cc:385] T a9e6e2dfc9624bbb887e108176acff29 P 6ba6d37b4c6344ec882213fb72cc10a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:43.894429 18629 raft_consensus.cc:740] T a9e6e2dfc9624bbb887e108176acff29 P 6ba6d37b4c6344ec882213fb72cc10a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6ba6d37b4c6344ec882213fb72cc10a3, State: Initialized, Role: FOLLOWER
I20260709 13:03:43.894745 18635 raft_consensus.cc:493] T 5c30ad177b44422f982d86fe00ab6c4a P e5d4c60ba4c64aa78850cf308be78a8d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:43.895277 18629 consensus_queue.cc:260] T a9e6e2dfc9624bbb887e108176acff29 P 6ba6d37b4c6344ec882213fb72cc10a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ba6d37b4c6344ec882213fb72cc10a3" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 33623 } } peers { permanent_uuid: "e5d4c60ba4c64aa78850cf308be78a8d" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 37301 } } peers { permanent_uuid: "e34192eeaeb246a790a18368773bbe15" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 42349 } }
I20260709 13:03:43.895323 18635 raft_consensus.cc:515] T 5c30ad177b44422f982d86fe00ab6c4a P e5d4c60ba4c64aa78850cf308be78a8d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5d4c60ba4c64aa78850cf308be78a8d" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 37301 } } peers { permanent_uuid: "6ba6d37b4c6344ec882213fb72cc10a3" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 33623 } } peers { permanent_uuid: "e34192eeaeb246a790a18368773bbe15" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 42349 } }
I20260709 13:03:43.893715 18627 consensus_queue.cc:260] T 476ca419566a4bc1883e94647b632918 P e34192eeaeb246a790a18368773bbe15 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ba6d37b4c6344ec882213fb72cc10a3" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 33623 } } peers { permanent_uuid: "e5d4c60ba4c64aa78850cf308be78a8d" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 37301 } } peers { permanent_uuid: "e34192eeaeb246a790a18368773bbe15" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 42349 } }
W20260709 13:03:43.894071 18548 leader_election.cc:343] T 63053c1fc3214bcd99d7c93f71c98ff3 P e34192eeaeb246a790a18368773bbe15 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6ba6d37b4c6344ec882213fb72cc10a3 (127.17.223.1:33623): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:43.894381 18510 raft_consensus.cc:3060] T 63053c1fc3214bcd99d7c93f71c98ff3 P e5d4c60ba4c64aa78850cf308be78a8d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:43.900390 18627 ts_tablet_manager.cc:1434] T 476ca419566a4bc1883e94647b632918 P e34192eeaeb246a790a18368773bbe15: Time spent starting tablet: real 0.011s	user 0.005s	sys 0.000s
I20260709 13:03:43.904356 18629 ts_tablet_manager.cc:1434] T a9e6e2dfc9624bbb887e108176acff29 P 6ba6d37b4c6344ec882213fb72cc10a3: Time spent starting tablet: real 0.013s	user 0.006s	sys 0.001s
I20260709 13:03:43.905376 18629 tablet_bootstrap.cc:492] T a5d1966171cd4c25a9045a79b6ce1b58 P 6ba6d37b4c6344ec882213fb72cc10a3: Bootstrap starting.
I20260709 13:03:43.904755 18627 tablet_bootstrap.cc:492] T a5d1966171cd4c25a9045a79b6ce1b58 P e34192eeaeb246a790a18368773bbe15: Bootstrap starting.
I20260709 13:03:43.916626 18629 tablet_bootstrap.cc:654] T a5d1966171cd4c25a9045a79b6ce1b58 P 6ba6d37b4c6344ec882213fb72cc10a3: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:43.921670 18627 tablet_bootstrap.cc:654] T a5d1966171cd4c25a9045a79b6ce1b58 P e34192eeaeb246a790a18368773bbe15: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:43.924237 18435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c30ad177b44422f982d86fe00ab6c4a" candidate_uuid: "e5d4c60ba4c64aa78850cf308be78a8d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6ba6d37b4c6344ec882213fb72cc10a3" is_pre_election: true
I20260709 13:03:43.925025 18435 raft_consensus.cc:2468] T 5c30ad177b44422f982d86fe00ab6c4a P 6ba6d37b4c6344ec882213fb72cc10a3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5d4c60ba4c64aa78850cf308be78a8d in term 0.
I20260709 13:03:43.926787 18474 leader_election.cc:304] T 5c30ad177b44422f982d86fe00ab6c4a P e5d4c60ba4c64aa78850cf308be78a8d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6ba6d37b4c6344ec882213fb72cc10a3, e5d4c60ba4c64aa78850cf308be78a8d; no voters: 
I20260709 13:03:43.932368 18668 raft_consensus.cc:2804] T 5c30ad177b44422f982d86fe00ab6c4a P e5d4c60ba4c64aa78850cf308be78a8d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:03:43.932638 18629 tablet_bootstrap.cc:492] T a5d1966171cd4c25a9045a79b6ce1b58 P 6ba6d37b4c6344ec882213fb72cc10a3: No bootstrap required, opened a new log
I20260709 13:03:43.932818 18668 raft_consensus.cc:493] T 5c30ad177b44422f982d86fe00ab6c4a P e5d4c60ba4c64aa78850cf308be78a8d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:43.933122 18629 ts_tablet_manager.cc:1403] T a5d1966171cd4c25a9045a79b6ce1b58 P 6ba6d37b4c6344ec882213fb72cc10a3: Time spent bootstrapping tablet: real 0.028s	user 0.011s	sys 0.003s
I20260709 13:03:43.933198 18668 raft_consensus.cc:3060] T 5c30ad177b44422f982d86fe00ab6c4a P e5d4c60ba4c64aa78850cf308be78a8d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:43.936936 18635 leader_election.cc:290] T 5c30ad177b44422f982d86fe00ab6c4a P e5d4c60ba4c64aa78850cf308be78a8d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6ba6d37b4c6344ec882213fb72cc10a3 (127.17.223.1:33623), e34192eeaeb246a790a18368773bbe15 (127.17.223.3:42349)
I20260709 13:03:43.938095 18584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c30ad177b44422f982d86fe00ab6c4a" candidate_uuid: "e5d4c60ba4c64aa78850cf308be78a8d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e34192eeaeb246a790a18368773bbe15" is_pre_election: true
I20260709 13:03:43.939771 18629 raft_consensus.cc:359] T a5d1966171cd4c25a9045a79b6ce1b58 P 6ba6d37b4c6344ec882213fb72cc10a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ba6d37b4c6344ec882213fb72cc10a3" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 33623 } } peers { permanent_uuid: "e5d4c60ba4c64aa78850cf308be78a8d" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 37301 } } peers { permanent_uuid: "e34192eeaeb246a790a18368773bbe15" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 42349 } }
I20260709 13:03:43.943054 18629 raft_consensus.cc:385] T a5d1966171cd4c25a9045a79b6ce1b58 P 6ba6d37b4c6344ec882213fb72cc10a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:43.943118 18584 raft_consensus.cc:2468] T 5c30ad177b44422f982d86fe00ab6c4a P e34192eeaeb246a790a18368773bbe15 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5d4c60ba4c64aa78850cf308be78a8d in term 0.
I20260709 13:03:43.943373 18629 raft_consensus.cc:740] T a5d1966171cd4c25a9045a79b6ce1b58 P 6ba6d37b4c6344ec882213fb72cc10a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6ba6d37b4c6344ec882213fb72cc10a3, State: Initialized, Role: FOLLOWER
I20260709 13:03:43.944072 18629 consensus_queue.cc:260] T a5d1966171cd4c25a9045a79b6ce1b58 P 6ba6d37b4c6344ec882213fb72cc10a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ba6d37b4c6344ec882213fb72cc10a3" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 33623 } } peers { permanent_uuid: "e5d4c60ba4c64aa78850cf308be78a8d" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 37301 } } peers { permanent_uuid: "e34192eeaeb246a790a18368773bbe15" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 42349 } }
I20260709 13:03:43.944660 18510 raft_consensus.cc:2468] T 63053c1fc3214bcd99d7c93f71c98ff3 P e5d4c60ba4c64aa78850cf308be78a8d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e34192eeaeb246a790a18368773bbe15 in term 1.
I20260709 13:03:43.952283 18549 leader_election.cc:304] T 63053c1fc3214bcd99d7c93f71c98ff3 P e34192eeaeb246a790a18368773bbe15 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e34192eeaeb246a790a18368773bbe15, e5d4c60ba4c64aa78850cf308be78a8d; no voters: 6ba6d37b4c6344ec882213fb72cc10a3
I20260709 13:03:43.953143 18655 raft_consensus.cc:2804] T 63053c1fc3214bcd99d7c93f71c98ff3 P e34192eeaeb246a790a18368773bbe15 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:03:43.960052 18629 ts_tablet_manager.cc:1434] T a5d1966171cd4c25a9045a79b6ce1b58 P 6ba6d37b4c6344ec882213fb72cc10a3: Time spent starting tablet: real 0.027s	user 0.007s	sys 0.001s
I20260709 13:03:43.962036 18629 tablet_bootstrap.cc:492] T 63053c1fc3214bcd99d7c93f71c98ff3 P 6ba6d37b4c6344ec882213fb72cc10a3: Bootstrap starting.
I20260709 13:03:43.960999 18655 raft_consensus.cc:697] T 63053c1fc3214bcd99d7c93f71c98ff3 P e34192eeaeb246a790a18368773bbe15 [term 1 LEADER]: Becoming Leader. State: Replica: e34192eeaeb246a790a18368773bbe15, State: Running, Role: LEADER
I20260709 13:03:43.964871 18655 consensus_queue.cc:237] T 63053c1fc3214bcd99d7c93f71c98ff3 P e34192eeaeb246a790a18368773bbe15 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ba6d37b4c6344ec882213fb72cc10a3" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 33623 } } peers { permanent_uuid: "e5d4c60ba4c64aa78850cf308be78a8d" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 37301 } } peers { permanent_uuid: "e34192eeaeb246a790a18368773bbe15" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 42349 } }
I20260709 13:03:43.979256 18629 tablet_bootstrap.cc:654] T 63053c1fc3214bcd99d7c93f71c98ff3 P 6ba6d37b4c6344ec882213fb72cc10a3: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:43.992290 18629 tablet_bootstrap.cc:492] T 63053c1fc3214bcd99d7c93f71c98ff3 P 6ba6d37b4c6344ec882213fb72cc10a3: No bootstrap required, opened a new log
I20260709 13:03:43.992728 18629 ts_tablet_manager.cc:1403] T 63053c1fc3214bcd99d7c93f71c98ff3 P 6ba6d37b4c6344ec882213fb72cc10a3: Time spent bootstrapping tablet: real 0.031s	user 0.012s	sys 0.001s
I20260709 13:03:43.993793 18628 ts_tablet_manager.cc:1434] T 5c30ad177b44422f982d86fe00ab6c4a P e5d4c60ba4c64aa78850cf308be78a8d: Time spent starting tablet: real 0.122s	user 0.012s	sys 0.031s
I20260709 13:03:43.992007 18330 catalog_manager.cc:5697] T 63053c1fc3214bcd99d7c93f71c98ff3 P e34192eeaeb246a790a18368773bbe15 reported cstate change: term changed from 0 to 1, leader changed from <none> to e34192eeaeb246a790a18368773bbe15 (127.17.223.3). New cstate: current_term: 1 leader_uuid: "e34192eeaeb246a790a18368773bbe15" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ba6d37b4c6344ec882213fb72cc10a3" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 33623 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e5d4c60ba4c64aa78850cf308be78a8d" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 37301 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e34192eeaeb246a790a18368773bbe15" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 42349 } health_report { overall_health: HEALTHY } } }
I20260709 13:03:43.994762 18627 tablet_bootstrap.cc:492] T a5d1966171cd4c25a9045a79b6ce1b58 P e34192eeaeb246a790a18368773bbe15: No bootstrap required, opened a new log
I20260709 13:03:43.995196 18627 ts_tablet_manager.cc:1403] T a5d1966171cd4c25a9045a79b6ce1b58 P e34192eeaeb246a790a18368773bbe15: Time spent bootstrapping tablet: real 0.094s	user 0.046s	sys 0.015s
I20260709 13:03:43.995280 18628 tablet_bootstrap.cc:492] T a9e6e2dfc9624bbb887e108176acff29 P e5d4c60ba4c64aa78850cf308be78a8d: Bootstrap starting.
I20260709 13:03:43.992005 18668 raft_consensus.cc:515] T 5c30ad177b44422f982d86fe00ab6c4a P e5d4c60ba4c64aa78850cf308be78a8d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5d4c60ba4c64aa78850cf308be78a8d" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 37301 } } peers { permanent_uuid: "6ba6d37b4c6344ec882213fb72cc10a3" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 33623 } } peers { permanent_uuid: "e34192eeaeb246a790a18368773bbe15" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 42349 } }
I20260709 13:03:43.998380 18627 raft_consensus.cc:359] T a5d1966171cd4c25a9045a79b6ce1b58 P e34192eeaeb246a790a18368773bbe15 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ba6d37b4c6344ec882213fb72cc10a3" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 33623 } } peers { permanent_uuid: "e5d4c60ba4c64aa78850cf308be78a8d" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 37301 } } peers { permanent_uuid: "e34192eeaeb246a790a18368773bbe15" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 42349 } }
I20260709 13:03:43.999089 18627 raft_consensus.cc:385] T a5d1966171cd4c25a9045a79b6ce1b58 P e34192eeaeb246a790a18368773bbe15 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:43.999357 18627 raft_consensus.cc:740] T a5d1966171cd4c25a9045a79b6ce1b58 P e34192eeaeb246a790a18368773bbe15 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e34192eeaeb246a790a18368773bbe15, State: Initialized, Role: FOLLOWER
I20260709 13:03:44.001591 18668 leader_election.cc:290] T 5c30ad177b44422f982d86fe00ab6c4a P e5d4c60ba4c64aa78850cf308be78a8d [CANDIDATE]: Term 1 election: Requested vote from peers 6ba6d37b4c6344ec882213fb72cc10a3 (127.17.223.1:33623), e34192eeaeb246a790a18368773bbe15 (127.17.223.3:42349)
I20260709 13:03:44.002439 18627 consensus_queue.cc:260] T a5d1966171cd4c25a9045a79b6ce1b58 P e34192eeaeb246a790a18368773bbe15 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ba6d37b4c6344ec882213fb72cc10a3" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 33623 } } peers { permanent_uuid: "e5d4c60ba4c64aa78850cf308be78a8d" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 37301 } } peers { permanent_uuid: "e34192eeaeb246a790a18368773bbe15" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 42349 } }
I20260709 13:03:44.003342 18435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c30ad177b44422f982d86fe00ab6c4a" candidate_uuid: "e5d4c60ba4c64aa78850cf308be78a8d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6ba6d37b4c6344ec882213fb72cc10a3"
I20260709 13:03:44.003868 18435 raft_consensus.cc:3060] T 5c30ad177b44422f982d86fe00ab6c4a P 6ba6d37b4c6344ec882213fb72cc10a3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:44.005316 18627 ts_tablet_manager.cc:1434] T a5d1966171cd4c25a9045a79b6ce1b58 P e34192eeaeb246a790a18368773bbe15: Time spent starting tablet: real 0.010s	user 0.007s	sys 0.000s
I20260709 13:03:44.004825 18629 raft_consensus.cc:359] T 63053c1fc3214bcd99d7c93f71c98ff3 P 6ba6d37b4c6344ec882213fb72cc10a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ba6d37b4c6344ec882213fb72cc10a3" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 33623 } } peers { permanent_uuid: "e5d4c60ba4c64aa78850cf308be78a8d" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 37301 } } peers { permanent_uuid: "e34192eeaeb246a790a18368773bbe15" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 42349 } }
I20260709 13:03:44.006808 18629 raft_consensus.cc:385] T 63053c1fc3214bcd99d7c93f71c98ff3 P 6ba6d37b4c6344ec882213fb72cc10a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:44.007091 18629 raft_consensus.cc:740] T 63053c1fc3214bcd99d7c93f71c98ff3 P 6ba6d37b4c6344ec882213fb72cc10a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6ba6d37b4c6344ec882213fb72cc10a3, State: Initialized, Role: FOLLOWER
I20260709 13:03:44.007736 18629 consensus_queue.cc:260] T 63053c1fc3214bcd99d7c93f71c98ff3 P 6ba6d37b4c6344ec882213fb72cc10a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ba6d37b4c6344ec882213fb72cc10a3" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 33623 } } peers { permanent_uuid: "e5d4c60ba4c64aa78850cf308be78a8d" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 37301 } } peers { permanent_uuid: "e34192eeaeb246a790a18368773bbe15" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 42349 } }
I20260709 13:03:44.008505 18584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c30ad177b44422f982d86fe00ab6c4a" candidate_uuid: "e5d4c60ba4c64aa78850cf308be78a8d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e34192eeaeb246a790a18368773bbe15"
I20260709 13:03:44.009044 18628 tablet_bootstrap.cc:654] T a9e6e2dfc9624bbb887e108176acff29 P e5d4c60ba4c64aa78850cf308be78a8d: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:44.009086 18584 raft_consensus.cc:3060] T 5c30ad177b44422f982d86fe00ab6c4a P e34192eeaeb246a790a18368773bbe15 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:44.016534 18584 raft_consensus.cc:2468] T 5c30ad177b44422f982d86fe00ab6c4a P e34192eeaeb246a790a18368773bbe15 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e5d4c60ba4c64aa78850cf308be78a8d in term 1.
I20260709 13:03:44.009757 18629 ts_tablet_manager.cc:1434] T 63053c1fc3214bcd99d7c93f71c98ff3 P 6ba6d37b4c6344ec882213fb72cc10a3: Time spent starting tablet: real 0.017s	user 0.003s	sys 0.000s
I20260709 13:03:44.006464 18627 tablet_bootstrap.cc:492] T b68da910d10d4d6a80b0055f7061ad27 P e34192eeaeb246a790a18368773bbe15: Bootstrap starting.
I20260709 13:03:44.017750 18476 leader_election.cc:304] T 5c30ad177b44422f982d86fe00ab6c4a P e5d4c60ba4c64aa78850cf308be78a8d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e34192eeaeb246a790a18368773bbe15, e5d4c60ba4c64aa78850cf308be78a8d; no voters: 
I20260709 13:03:44.022584 18668 raft_consensus.cc:2804] T 5c30ad177b44422f982d86fe00ab6c4a P e5d4c60ba4c64aa78850cf308be78a8d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:03:44.023104 18668 raft_consensus.cc:697] T 5c30ad177b44422f982d86fe00ab6c4a P e5d4c60ba4c64aa78850cf308be78a8d [term 1 LEADER]: Becoming Leader. State: Replica: e5d4c60ba4c64aa78850cf308be78a8d, State: Running, Role: LEADER
I20260709 13:03:44.023890 18665 raft_consensus.cc:493] T a5d1966171cd4c25a9045a79b6ce1b58 P e5d4c60ba4c64aa78850cf308be78a8d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:44.024367 18665 raft_consensus.cc:515] T a5d1966171cd4c25a9045a79b6ce1b58 P e5d4c60ba4c64aa78850cf308be78a8d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ba6d37b4c6344ec882213fb72cc10a3" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 33623 } } peers { permanent_uuid: "e5d4c60ba4c64aa78850cf308be78a8d" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 37301 } } peers { permanent_uuid: "e34192eeaeb246a790a18368773bbe15" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 42349 } }
I20260709 13:03:44.024448 18668 consensus_queue.cc:237] T 5c30ad177b44422f982d86fe00ab6c4a P e5d4c60ba4c64aa78850cf308be78a8d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5d4c60ba4c64aa78850cf308be78a8d" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 37301 } } peers { permanent_uuid: "6ba6d37b4c6344ec882213fb72cc10a3" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 33623 } } peers { permanent_uuid: "e34192eeaeb246a790a18368773bbe15" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 42349 } }
I20260709 13:03:44.025377 18627 tablet_bootstrap.cc:654] T b68da910d10d4d6a80b0055f7061ad27 P e34192eeaeb246a790a18368773bbe15: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:44.026935 18665 leader_election.cc:290] T a5d1966171cd4c25a9045a79b6ce1b58 P e5d4c60ba4c64aa78850cf308be78a8d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6ba6d37b4c6344ec882213fb72cc10a3 (127.17.223.1:33623), e34192eeaeb246a790a18368773bbe15 (127.17.223.3:42349)
I20260709 13:03:44.027557 18434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5d1966171cd4c25a9045a79b6ce1b58" candidate_uuid: "e5d4c60ba4c64aa78850cf308be78a8d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6ba6d37b4c6344ec882213fb72cc10a3" is_pre_election: true
I20260709 13:03:44.028167 18434 raft_consensus.cc:2468] T a5d1966171cd4c25a9045a79b6ce1b58 P 6ba6d37b4c6344ec882213fb72cc10a3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5d4c60ba4c64aa78850cf308be78a8d in term 0.
I20260709 13:03:44.029543 18435 raft_consensus.cc:2468] T 5c30ad177b44422f982d86fe00ab6c4a P 6ba6d37b4c6344ec882213fb72cc10a3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e5d4c60ba4c64aa78850cf308be78a8d in term 1.
I20260709 13:03:44.029826 18474 leader_election.cc:304] T a5d1966171cd4c25a9045a79b6ce1b58 P e5d4c60ba4c64aa78850cf308be78a8d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6ba6d37b4c6344ec882213fb72cc10a3, e5d4c60ba4c64aa78850cf308be78a8d; no voters: 
I20260709 13:03:44.030539 18584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5d1966171cd4c25a9045a79b6ce1b58" candidate_uuid: "e5d4c60ba4c64aa78850cf308be78a8d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e34192eeaeb246a790a18368773bbe15" is_pre_election: true
I20260709 13:03:44.038834 18665 raft_consensus.cc:2804] T a5d1966171cd4c25a9045a79b6ce1b58 P e5d4c60ba4c64aa78850cf308be78a8d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:03:44.038951 18584 raft_consensus.cc:2468] T a5d1966171cd4c25a9045a79b6ce1b58 P e34192eeaeb246a790a18368773bbe15 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5d4c60ba4c64aa78850cf308be78a8d in term 0.
I20260709 13:03:44.039424 18665 raft_consensus.cc:493] T a5d1966171cd4c25a9045a79b6ce1b58 P e5d4c60ba4c64aa78850cf308be78a8d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:44.039906 18665 raft_consensus.cc:3060] T a5d1966171cd4c25a9045a79b6ce1b58 P e5d4c60ba4c64aa78850cf308be78a8d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:44.032233 18627 tablet_bootstrap.cc:492] T b68da910d10d4d6a80b0055f7061ad27 P e34192eeaeb246a790a18368773bbe15: No bootstrap required, opened a new log
I20260709 13:03:44.043591 18627 ts_tablet_manager.cc:1403] T b68da910d10d4d6a80b0055f7061ad27 P e34192eeaeb246a790a18368773bbe15: Time spent bootstrapping tablet: real 0.037s	user 0.012s	sys 0.000s
I20260709 13:03:44.044271 18329 catalog_manager.cc:5697] T 5c30ad177b44422f982d86fe00ab6c4a P e5d4c60ba4c64aa78850cf308be78a8d reported cstate change: term changed from 0 to 1, leader changed from <none> to e5d4c60ba4c64aa78850cf308be78a8d (127.17.223.2). New cstate: current_term: 1 leader_uuid: "e5d4c60ba4c64aa78850cf308be78a8d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5d4c60ba4c64aa78850cf308be78a8d" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 37301 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6ba6d37b4c6344ec882213fb72cc10a3" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 33623 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e34192eeaeb246a790a18368773bbe15" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 42349 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:44.046375 18627 raft_consensus.cc:359] T b68da910d10d4d6a80b0055f7061ad27 P e34192eeaeb246a790a18368773bbe15 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ba6d37b4c6344ec882213fb72cc10a3" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 33623 } } peers { permanent_uuid: "e5d4c60ba4c64aa78850cf308be78a8d" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 37301 } } peers { permanent_uuid: "e34192eeaeb246a790a18368773bbe15" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 42349 } }
I20260709 13:03:44.047115 18627 raft_consensus.cc:385] T b68da910d10d4d6a80b0055f7061ad27 P e34192eeaeb246a790a18368773bbe15 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:44.047425 18627 raft_consensus.cc:740] T b68da910d10d4d6a80b0055f7061ad27 P e34192eeaeb246a790a18368773bbe15 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e34192eeaeb246a790a18368773bbe15, State: Initialized, Role: FOLLOWER
I20260709 13:03:44.046988 18665 raft_consensus.cc:515] T a5d1966171cd4c25a9045a79b6ce1b58 P e5d4c60ba4c64aa78850cf308be78a8d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ba6d37b4c6344ec882213fb72cc10a3" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 33623 } } peers { permanent_uuid: "e5d4c60ba4c64aa78850cf308be78a8d" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 37301 } } peers { permanent_uuid: "e34192eeaeb246a790a18368773bbe15" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 42349 } }
I20260709 13:03:44.048142 18627 consensus_queue.cc:260] T b68da910d10d4d6a80b0055f7061ad27 P e34192eeaeb246a790a18368773bbe15 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ba6d37b4c6344ec882213fb72cc10a3" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 33623 } } peers { permanent_uuid: "e5d4c60ba4c64aa78850cf308be78a8d" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 37301 } } peers { permanent_uuid: "e34192eeaeb246a790a18368773bbe15" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 42349 } }
I20260709 13:03:44.049777 18665 leader_election.cc:290] T a5d1966171cd4c25a9045a79b6ce1b58 P e5d4c60ba4c64aa78850cf308be78a8d [CANDIDATE]: Term 1 election: Requested vote from peers 6ba6d37b4c6344ec882213fb72cc10a3 (127.17.223.1:33623), e34192eeaeb246a790a18368773bbe15 (127.17.223.3:42349)
I20260709 13:03:44.051218 18627 ts_tablet_manager.cc:1434] T b68da910d10d4d6a80b0055f7061ad27 P e34192eeaeb246a790a18368773bbe15: Time spent starting tablet: real 0.007s	user 0.003s	sys 0.003s
I20260709 13:03:44.052192 18627 tablet_bootstrap.cc:492] T f5116788673d45ad9561408373f762a5 P e34192eeaeb246a790a18368773bbe15: Bootstrap starting.
I20260709 13:03:44.052932 18628 tablet_bootstrap.cc:492] T a9e6e2dfc9624bbb887e108176acff29 P e5d4c60ba4c64aa78850cf308be78a8d: No bootstrap required, opened a new log
I20260709 13:03:44.053417 18628 ts_tablet_manager.cc:1403] T a9e6e2dfc9624bbb887e108176acff29 P e5d4c60ba4c64aa78850cf308be78a8d: Time spent bootstrapping tablet: real 0.058s	user 0.020s	sys 0.004s
I20260709 13:03:44.054064 18584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5d1966171cd4c25a9045a79b6ce1b58" candidate_uuid: "e5d4c60ba4c64aa78850cf308be78a8d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e34192eeaeb246a790a18368773bbe15"
I20260709 13:03:44.054636 18584 raft_consensus.cc:3060] T a5d1966171cd4c25a9045a79b6ce1b58 P e34192eeaeb246a790a18368773bbe15 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:44.056331 18628 raft_consensus.cc:359] T a9e6e2dfc9624bbb887e108176acff29 P e5d4c60ba4c64aa78850cf308be78a8d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ba6d37b4c6344ec882213fb72cc10a3" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 33623 } } peers { permanent_uuid: "e5d4c60ba4c64aa78850cf308be78a8d" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 37301 } } peers { permanent_uuid: "e34192eeaeb246a790a18368773bbe15" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 42349 } }
I20260709 13:03:44.057056 18628 raft_consensus.cc:385] T a9e6e2dfc9624bbb887e108176acff29 P e5d4c60ba4c64aa78850cf308be78a8d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:44.057359 18628 raft_consensus.cc:740] T a9e6e2dfc9624bbb887e108176acff29 P e5d4c60ba4c64aa78850cf308be78a8d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e5d4c60ba4c64aa78850cf308be78a8d, State: Initialized, Role: FOLLOWER
I20260709 13:03:44.058559 18435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5d1966171cd4c25a9045a79b6ce1b58" candidate_uuid: "e5d4c60ba4c64aa78850cf308be78a8d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6ba6d37b4c6344ec882213fb72cc10a3"
I20260709 13:03:44.058318 18628 consensus_queue.cc:260] T a9e6e2dfc9624bbb887e108176acff29 P e5d4c60ba4c64aa78850cf308be78a8d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ba6d37b4c6344ec882213fb72cc10a3" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 33623 } } peers { permanent_uuid: "e5d4c60ba4c64aa78850cf308be78a8d" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 37301 } } peers { permanent_uuid: "e34192eeaeb246a790a18368773bbe15" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 42349 } }
I20260709 13:03:44.059235 18627 tablet_bootstrap.cc:654] T f5116788673d45ad9561408373f762a5 P e34192eeaeb246a790a18368773bbe15: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:44.059175 18435 raft_consensus.cc:3060] T a5d1966171cd4c25a9045a79b6ce1b58 P 6ba6d37b4c6344ec882213fb72cc10a3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:44.060966 18628 ts_tablet_manager.cc:1434] T a9e6e2dfc9624bbb887e108176acff29 P e5d4c60ba4c64aa78850cf308be78a8d: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 13:03:44.061923 18628 tablet_bootstrap.cc:492] T f5116788673d45ad9561408373f762a5 P e5d4c60ba4c64aa78850cf308be78a8d: Bootstrap starting.
I20260709 13:03:44.065361 18627 tablet_bootstrap.cc:492] T f5116788673d45ad9561408373f762a5 P e34192eeaeb246a790a18368773bbe15: No bootstrap required, opened a new log
I20260709 13:03:44.065797 18627 ts_tablet_manager.cc:1403] T f5116788673d45ad9561408373f762a5 P e34192eeaeb246a790a18368773bbe15: Time spent bootstrapping tablet: real 0.014s	user 0.004s	sys 0.007s
I20260709 13:03:44.067305 18628 tablet_bootstrap.cc:654] T f5116788673d45ad9561408373f762a5 P e5d4c60ba4c64aa78850cf308be78a8d: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:44.068246 18627 raft_consensus.cc:359] T f5116788673d45ad9561408373f762a5 P e34192eeaeb246a790a18368773bbe15 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ba6d37b4c6344ec882213fb72cc10a3" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 33623 } } peers { permanent_uuid: "e5d4c60ba4c64aa78850cf308be78a8d" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 37301 } } peers { permanent_uuid: "e34192eeaeb246a790a18368773bbe15" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 42349 } }
I20260709 13:03:44.068907 18627 raft_consensus.cc:385] T f5116788673d45ad9561408373f762a5 P e34192eeaeb246a790a18368773bbe15 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:44.069168 18627 raft_consensus.cc:740] T f5116788673d45ad9561408373f762a5 P e34192eeaeb246a790a18368773bbe15 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e34192eeaeb246a790a18368773bbe15, State: Initialized, Role: FOLLOWER
I20260709 13:03:44.069820 18627 consensus_queue.cc:260] T f5116788673d45ad9561408373f762a5 P e34192eeaeb246a790a18368773bbe15 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ba6d37b4c6344ec882213fb72cc10a3" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 33623 } } peers { permanent_uuid: "e5d4c60ba4c64aa78850cf308be78a8d" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 37301 } } peers { permanent_uuid: "e34192eeaeb246a790a18368773bbe15" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 42349 } }
I20260709 13:03:44.070386 18584 raft_consensus.cc:2468] T a5d1966171cd4c25a9045a79b6ce1b58 P e34192eeaeb246a790a18368773bbe15 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e5d4c60ba4c64aa78850cf308be78a8d in term 1.
I20260709 13:03:44.072002 18627 ts_tablet_manager.cc:1434] T f5116788673d45ad9561408373f762a5 P e34192eeaeb246a790a18368773bbe15: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.001s
I20260709 13:03:44.071692 18435 raft_consensus.cc:2468] T a5d1966171cd4c25a9045a79b6ce1b58 P 6ba6d37b4c6344ec882213fb72cc10a3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e5d4c60ba4c64aa78850cf308be78a8d in term 1.
I20260709 13:03:44.073127 18627 tablet_bootstrap.cc:492] T 24b316d8ce55441ea9cf056818fd658a P e34192eeaeb246a790a18368773bbe15: Bootstrap starting.
I20260709 13:03:44.073719 18474 leader_election.cc:304] T a5d1966171cd4c25a9045a79b6ce1b58 P e5d4c60ba4c64aa78850cf308be78a8d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6ba6d37b4c6344ec882213fb72cc10a3, e5d4c60ba4c64aa78850cf308be78a8d; no voters: 
I20260709 13:03:44.075130 18665 raft_consensus.cc:2804] T a5d1966171cd4c25a9045a79b6ce1b58 P e5d4c60ba4c64aa78850cf308be78a8d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:03:44.075618 18665 raft_consensus.cc:697] T a5d1966171cd4c25a9045a79b6ce1b58 P e5d4c60ba4c64aa78850cf308be78a8d [term 1 LEADER]: Becoming Leader. State: Replica: e5d4c60ba4c64aa78850cf308be78a8d, State: Running, Role: LEADER
I20260709 13:03:44.081401 18627 tablet_bootstrap.cc:654] T 24b316d8ce55441ea9cf056818fd658a P e34192eeaeb246a790a18368773bbe15: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:44.076428 18665 consensus_queue.cc:237] T a5d1966171cd4c25a9045a79b6ce1b58 P e5d4c60ba4c64aa78850cf308be78a8d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ba6d37b4c6344ec882213fb72cc10a3" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 33623 } } peers { permanent_uuid: "e5d4c60ba4c64aa78850cf308be78a8d" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 37301 } } peers { permanent_uuid: "e34192eeaeb246a790a18368773bbe15" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 42349 } }
I20260709 13:03:44.085337 18650 raft_consensus.cc:493] T f5116788673d45ad9561408373f762a5 P 6ba6d37b4c6344ec882213fb72cc10a3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:44.085816 18650 raft_consensus.cc:515] T f5116788673d45ad9561408373f762a5 P 6ba6d37b4c6344ec882213fb72cc10a3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ba6d37b4c6344ec882213fb72cc10a3" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 33623 } } peers { permanent_uuid: "e5d4c60ba4c64aa78850cf308be78a8d" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 37301 } } peers { permanent_uuid: "e34192eeaeb246a790a18368773bbe15" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 42349 } }
I20260709 13:03:44.087898 18650 leader_election.cc:290] T f5116788673d45ad9561408373f762a5 P 6ba6d37b4c6344ec882213fb72cc10a3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e5d4c60ba4c64aa78850cf308be78a8d (127.17.223.2:37301), e34192eeaeb246a790a18368773bbe15 (127.17.223.3:42349)
I20260709 13:03:44.090086 18510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5116788673d45ad9561408373f762a5" candidate_uuid: "6ba6d37b4c6344ec882213fb72cc10a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e5d4c60ba4c64aa78850cf308be78a8d" is_pre_election: true
I20260709 13:03:44.090277 18584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5116788673d45ad9561408373f762a5" candidate_uuid: "6ba6d37b4c6344ec882213fb72cc10a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e34192eeaeb246a790a18368773bbe15" is_pre_election: true
I20260709 13:03:44.091143 18584 raft_consensus.cc:2468] T f5116788673d45ad9561408373f762a5 P e34192eeaeb246a790a18368773bbe15 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ba6d37b4c6344ec882213fb72cc10a3 in term 0.
I20260709 13:03:44.088992 18628 tablet_bootstrap.cc:492] T f5116788673d45ad9561408373f762a5 P e5d4c60ba4c64aa78850cf308be78a8d: No bootstrap required, opened a new log
W20260709 13:03:44.091777 18400 leader_election.cc:343] T f5116788673d45ad9561408373f762a5 P 6ba6d37b4c6344ec882213fb72cc10a3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e5d4c60ba4c64aa78850cf308be78a8d (127.17.223.2:37301): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:44.092183 18628 ts_tablet_manager.cc:1403] T f5116788673d45ad9561408373f762a5 P e5d4c60ba4c64aa78850cf308be78a8d: Time spent bootstrapping tablet: real 0.030s	user 0.008s	sys 0.004s
I20260709 13:03:44.092403 18401 leader_election.cc:304] T f5116788673d45ad9561408373f762a5 P 6ba6d37b4c6344ec882213fb72cc10a3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6ba6d37b4c6344ec882213fb72cc10a3, e34192eeaeb246a790a18368773bbe15; no voters: e5d4c60ba4c64aa78850cf308be78a8d
I20260709 13:03:44.093689 18650 raft_consensus.cc:2804] T f5116788673d45ad9561408373f762a5 P 6ba6d37b4c6344ec882213fb72cc10a3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:03:44.094115 18650 raft_consensus.cc:493] T f5116788673d45ad9561408373f762a5 P 6ba6d37b4c6344ec882213fb72cc10a3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:44.094553 18650 raft_consensus.cc:3060] T f5116788673d45ad9561408373f762a5 P 6ba6d37b4c6344ec882213fb72cc10a3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:44.096863 18628 raft_consensus.cc:359] T f5116788673d45ad9561408373f762a5 P e5d4c60ba4c64aa78850cf308be78a8d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ba6d37b4c6344ec882213fb72cc10a3" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 33623 } } peers { permanent_uuid: "e5d4c60ba4c64aa78850cf308be78a8d" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 37301 } } peers { permanent_uuid: "e34192eeaeb246a790a18368773bbe15" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 42349 } }
I20260709 13:03:44.097930 18628 raft_consensus.cc:385] T f5116788673d45ad9561408373f762a5 P e5d4c60ba4c64aa78850cf308be78a8d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:44.098389 18628 raft_consensus.cc:740] T f5116788673d45ad9561408373f762a5 P e5d4c60ba4c64aa78850cf308be78a8d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e5d4c60ba4c64aa78850cf308be78a8d, State: Initialized, Role: FOLLOWER
I20260709 13:03:44.099539 18627 tablet_bootstrap.cc:492] T 24b316d8ce55441ea9cf056818fd658a P e34192eeaeb246a790a18368773bbe15: No bootstrap required, opened a new log
I20260709 13:03:44.100080 18627 ts_tablet_manager.cc:1403] T 24b316d8ce55441ea9cf056818fd658a P e34192eeaeb246a790a18368773bbe15: Time spent bootstrapping tablet: real 0.027s	user 0.012s	sys 0.003s
I20260709 13:03:44.099555 18628 consensus_queue.cc:260] T f5116788673d45ad9561408373f762a5 P e5d4c60ba4c64aa78850cf308be78a8d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ba6d37b4c6344ec882213fb72cc10a3" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 33623 } } peers { permanent_uuid: "e5d4c60ba4c64aa78850cf308be78a8d" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 37301 } } peers { permanent_uuid: "e34192eeaeb246a790a18368773bbe15" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 42349 } }
I20260709 13:03:44.101874 18650 raft_consensus.cc:515] T f5116788673d45ad9561408373f762a5 P 6ba6d37b4c6344ec882213fb72cc10a3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ba6d37b4c6344ec882213fb72cc10a3" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 33623 } } peers { permanent_uuid: "e5d4c60ba4c64aa78850cf308be78a8d" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 37301 } } peers { permanent_uuid: "e34192eeaeb246a790a18368773bbe15" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 42349 } }
I20260709 13:03:44.102891 18627 raft_consensus.cc:359] T 24b316d8ce55441ea9cf056818fd658a P e34192eeaeb246a790a18368773bbe15 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ba6d37b4c6344ec882213fb72cc10a3" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 33623 } } peers { permanent_uuid: "e5d4c60ba4c64aa78850cf308be78a8d" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 37301 } } peers { permanent_uuid: "e34192eeaeb246a790a18368773bbe15" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 42349 } }
I20260709 13:03:44.103418 18628 ts_tablet_manager.cc:1434] T f5116788673d45ad9561408373f762a5 P e5d4c60ba4c64aa78850cf308be78a8d: Time spent starting tablet: real 0.011s	user 0.009s	sys 0.000s
I20260709 13:03:44.103530 18627 raft_consensus.cc:385] T 24b316d8ce55441ea9cf056818fd658a P e34192eeaeb246a790a18368773bbe15 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:44.104137 18627 raft_consensus.cc:740] T 24b316d8ce55441ea9cf056818fd658a P e34192eeaeb246a790a18368773bbe15 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e34192eeaeb246a790a18368773bbe15, State: Initialized, Role: FOLLOWER
I20260709 13:03:44.104586 18510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5116788673d45ad9561408373f762a5" candidate_uuid: "6ba6d37b4c6344ec882213fb72cc10a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e5d4c60ba4c64aa78850cf308be78a8d"
I20260709 13:03:44.104802 18627 consensus_queue.cc:260] T 24b316d8ce55441ea9cf056818fd658a P e34192eeaeb246a790a18368773bbe15 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ba6d37b4c6344ec882213fb72cc10a3" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 33623 } } peers { permanent_uuid: "e5d4c60ba4c64aa78850cf308be78a8d" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 37301 } } peers { permanent_uuid: "e34192eeaeb246a790a18368773bbe15" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 42349 } }
I20260709 13:03:44.105137 18510 raft_consensus.cc:3060] T f5116788673d45ad9561408373f762a5 P e5d4c60ba4c64aa78850cf308be78a8d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:44.105475 18628 tablet_bootstrap.cc:492] T 476ca419566a4bc1883e94647b632918 P e5d4c60ba4c64aa78850cf308be78a8d: Bootstrap starting.
I20260709 13:03:44.111534 18510 raft_consensus.cc:2468] T f5116788673d45ad9561408373f762a5 P e5d4c60ba4c64aa78850cf308be78a8d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ba6d37b4c6344ec882213fb72cc10a3 in term 1.
I20260709 13:03:44.112746 18400 leader_election.cc:304] T f5116788673d45ad9561408373f762a5 P 6ba6d37b4c6344ec882213fb72cc10a3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6ba6d37b4c6344ec882213fb72cc10a3, e5d4c60ba4c64aa78850cf308be78a8d; no voters: 
I20260709 13:03:44.113705 18633 raft_consensus.cc:2804] T f5116788673d45ad9561408373f762a5 P 6ba6d37b4c6344ec882213fb72cc10a3 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:03:44.115213 18628 tablet_bootstrap.cc:654] T 476ca419566a4bc1883e94647b632918 P e5d4c60ba4c64aa78850cf308be78a8d: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:44.117244 18584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5116788673d45ad9561408373f762a5" candidate_uuid: "6ba6d37b4c6344ec882213fb72cc10a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e34192eeaeb246a790a18368773bbe15"
I20260709 13:03:44.118013 18584 raft_consensus.cc:3060] T f5116788673d45ad9561408373f762a5 P e34192eeaeb246a790a18368773bbe15 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:44.121784 18627 ts_tablet_manager.cc:1434] T 24b316d8ce55441ea9cf056818fd658a P e34192eeaeb246a790a18368773bbe15: Time spent starting tablet: real 0.021s	user 0.007s	sys 0.000s
I20260709 13:03:44.126345 18584 raft_consensus.cc:2468] T f5116788673d45ad9561408373f762a5 P e34192eeaeb246a790a18368773bbe15 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ba6d37b4c6344ec882213fb72cc10a3 in term 1.
I20260709 13:03:44.126513 18633 raft_consensus.cc:697] T f5116788673d45ad9561408373f762a5 P 6ba6d37b4c6344ec882213fb72cc10a3 [term 1 LEADER]: Becoming Leader. State: Replica: 6ba6d37b4c6344ec882213fb72cc10a3, State: Running, Role: LEADER
I20260709 13:03:44.127636 18650 leader_election.cc:290] T f5116788673d45ad9561408373f762a5 P 6ba6d37b4c6344ec882213fb72cc10a3 [CANDIDATE]: Term 1 election: Requested vote from peers e5d4c60ba4c64aa78850cf308be78a8d (127.17.223.2:37301), e34192eeaeb246a790a18368773bbe15 (127.17.223.3:42349)
I20260709 13:03:44.127338 18633 consensus_queue.cc:237] T f5116788673d45ad9561408373f762a5 P 6ba6d37b4c6344ec882213fb72cc10a3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ba6d37b4c6344ec882213fb72cc10a3" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 33623 } } peers { permanent_uuid: "e5d4c60ba4c64aa78850cf308be78a8d" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 37301 } } peers { permanent_uuid: "e34192eeaeb246a790a18368773bbe15" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 42349 } }
I20260709 13:03:44.136250 18628 tablet_bootstrap.cc:492] T 476ca419566a4bc1883e94647b632918 P e5d4c60ba4c64aa78850cf308be78a8d: No bootstrap required, opened a new log
I20260709 13:03:44.136693 18628 ts_tablet_manager.cc:1403] T 476ca419566a4bc1883e94647b632918 P e5d4c60ba4c64aa78850cf308be78a8d: Time spent bootstrapping tablet: real 0.032s	user 0.013s	sys 0.003s
I20260709 13:03:44.135736 18331 catalog_manager.cc:5697] T a5d1966171cd4c25a9045a79b6ce1b58 P e5d4c60ba4c64aa78850cf308be78a8d reported cstate change: term changed from 0 to 1, leader changed from <none> to e5d4c60ba4c64aa78850cf308be78a8d (127.17.223.2). New cstate: current_term: 1 leader_uuid: "e5d4c60ba4c64aa78850cf308be78a8d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ba6d37b4c6344ec882213fb72cc10a3" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 33623 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e5d4c60ba4c64aa78850cf308be78a8d" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 37301 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e34192eeaeb246a790a18368773bbe15" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 42349 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:44.139070 18678 raft_consensus.cc:493] T a9e6e2dfc9624bbb887e108176acff29 P 6ba6d37b4c6344ec882213fb72cc10a3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:44.139314 18628 raft_consensus.cc:359] T 476ca419566a4bc1883e94647b632918 P e5d4c60ba4c64aa78850cf308be78a8d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ba6d37b4c6344ec882213fb72cc10a3" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 33623 } } peers { permanent_uuid: "e5d4c60ba4c64aa78850cf308be78a8d" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 37301 } } peers { permanent_uuid: "e34192eeaeb246a790a18368773bbe15" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 42349 } }
I20260709 13:03:44.139523 18678 raft_consensus.cc:515] T a9e6e2dfc9624bbb887e108176acff29 P 6ba6d37b4c6344ec882213fb72cc10a3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ba6d37b4c6344ec882213fb72cc10a3" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 33623 } } peers { permanent_uuid: "e5d4c60ba4c64aa78850cf308be78a8d" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 37301 } } peers { permanent_uuid: "e34192eeaeb246a790a18368773bbe15" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 42349 } }
I20260709 13:03:44.139982 18628 raft_consensus.cc:385] T 476ca419566a4bc1883e94647b632918 P e5d4c60ba4c64aa78850cf308be78a8d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:44.140259 18628 raft_consensus.cc:740] T 476ca419566a4bc1883e94647b632918 P e5d4c60ba4c64aa78850cf308be78a8d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e5d4c60ba4c64aa78850cf308be78a8d, State: Initialized, Role: FOLLOWER
I20260709 13:03:44.142628 18510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9e6e2dfc9624bbb887e108176acff29" candidate_uuid: "6ba6d37b4c6344ec882213fb72cc10a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e5d4c60ba4c64aa78850cf308be78a8d" is_pre_election: true
I20260709 13:03:44.142906 18628 consensus_queue.cc:260] T 476ca419566a4bc1883e94647b632918 P e5d4c60ba4c64aa78850cf308be78a8d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ba6d37b4c6344ec882213fb72cc10a3" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 33623 } } peers { permanent_uuid: "e5d4c60ba4c64aa78850cf308be78a8d" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 37301 } } peers { permanent_uuid: "e34192eeaeb246a790a18368773bbe15" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 42349 } }
I20260709 13:03:44.143253 18510 raft_consensus.cc:2468] T a9e6e2dfc9624bbb887e108176acff29 P e5d4c60ba4c64aa78850cf308be78a8d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ba6d37b4c6344ec882213fb72cc10a3 in term 0.
I20260709 13:03:44.144893 18628 ts_tablet_manager.cc:1434] T 476ca419566a4bc1883e94647b632918 P e5d4c60ba4c64aa78850cf308be78a8d: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.001s
I20260709 13:03:44.144761 18400 leader_election.cc:304] T a9e6e2dfc9624bbb887e108176acff29 P 6ba6d37b4c6344ec882213fb72cc10a3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6ba6d37b4c6344ec882213fb72cc10a3, e5d4c60ba4c64aa78850cf308be78a8d; no voters: 
I20260709 13:03:44.145776 18628 tablet_bootstrap.cc:492] T b68da910d10d4d6a80b0055f7061ad27 P e5d4c60ba4c64aa78850cf308be78a8d: Bootstrap starting.
I20260709 13:03:44.145875 18650 raft_consensus.cc:2804] T a9e6e2dfc9624bbb887e108176acff29 P 6ba6d37b4c6344ec882213fb72cc10a3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:03:44.146229 18650 raft_consensus.cc:493] T a9e6e2dfc9624bbb887e108176acff29 P 6ba6d37b4c6344ec882213fb72cc10a3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:44.146541 18650 raft_consensus.cc:3060] T a9e6e2dfc9624bbb887e108176acff29 P 6ba6d37b4c6344ec882213fb72cc10a3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:44.151844 18628 tablet_bootstrap.cc:654] T b68da910d10d4d6a80b0055f7061ad27 P e5d4c60ba4c64aa78850cf308be78a8d: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:44.153173 18650 raft_consensus.cc:515] T a9e6e2dfc9624bbb887e108176acff29 P 6ba6d37b4c6344ec882213fb72cc10a3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ba6d37b4c6344ec882213fb72cc10a3" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 33623 } } peers { permanent_uuid: "e5d4c60ba4c64aa78850cf308be78a8d" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 37301 } } peers { permanent_uuid: "e34192eeaeb246a790a18368773bbe15" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 42349 } }
I20260709 13:03:44.156463 18510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9e6e2dfc9624bbb887e108176acff29" candidate_uuid: "6ba6d37b4c6344ec882213fb72cc10a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e5d4c60ba4c64aa78850cf308be78a8d"
I20260709 13:03:44.157223 18510 raft_consensus.cc:3060] T a9e6e2dfc9624bbb887e108176acff29 P e5d4c60ba4c64aa78850cf308be78a8d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:44.162781 18628 tablet_bootstrap.cc:492] T b68da910d10d4d6a80b0055f7061ad27 P e5d4c60ba4c64aa78850cf308be78a8d: No bootstrap required, opened a new log
I20260709 13:03:44.163229 18628 ts_tablet_manager.cc:1403] T b68da910d10d4d6a80b0055f7061ad27 P e5d4c60ba4c64aa78850cf308be78a8d: Time spent bootstrapping tablet: real 0.018s	user 0.013s	sys 0.004s
I20260709 13:03:44.164258 18510 raft_consensus.cc:2468] T a9e6e2dfc9624bbb887e108176acff29 P e5d4c60ba4c64aa78850cf308be78a8d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ba6d37b4c6344ec882213fb72cc10a3 in term 1.
I20260709 13:03:44.165686 18400 leader_election.cc:304] T a9e6e2dfc9624bbb887e108176acff29 P 6ba6d37b4c6344ec882213fb72cc10a3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6ba6d37b4c6344ec882213fb72cc10a3, e5d4c60ba4c64aa78850cf308be78a8d; no voters: 
I20260709 13:03:44.165748 18628 raft_consensus.cc:359] T b68da910d10d4d6a80b0055f7061ad27 P e5d4c60ba4c64aa78850cf308be78a8d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ba6d37b4c6344ec882213fb72cc10a3" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 33623 } } peers { permanent_uuid: "e5d4c60ba4c64aa78850cf308be78a8d" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 37301 } } peers { permanent_uuid: "e34192eeaeb246a790a18368773bbe15" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 42349 } }
I20260709 13:03:44.166554 18628 raft_consensus.cc:385] T b68da910d10d4d6a80b0055f7061ad27 P e5d4c60ba4c64aa78850cf308be78a8d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:44.166551 18584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9e6e2dfc9624bbb887e108176acff29" candidate_uuid: "6ba6d37b4c6344ec882213fb72cc10a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e34192eeaeb246a790a18368773bbe15" is_pre_election: true
I20260709 13:03:44.167093 18628 raft_consensus.cc:740] T b68da910d10d4d6a80b0055f7061ad27 P e5d4c60ba4c64aa78850cf308be78a8d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e5d4c60ba4c64aa78850cf308be78a8d, State: Initialized, Role: FOLLOWER
I20260709 13:03:44.167402 18584 raft_consensus.cc:2468] T a9e6e2dfc9624bbb887e108176acff29 P e34192eeaeb246a790a18368773bbe15 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ba6d37b4c6344ec882213fb72cc10a3 in term 0.
I20260709 13:03:44.167785 18628 consensus_queue.cc:260] T b68da910d10d4d6a80b0055f7061ad27 P e5d4c60ba4c64aa78850cf308be78a8d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ba6d37b4c6344ec882213fb72cc10a3" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 33623 } } peers { permanent_uuid: "e5d4c60ba4c64aa78850cf308be78a8d" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 37301 } } peers { permanent_uuid: "e34192eeaeb246a790a18368773bbe15" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 42349 } }
I20260709 13:03:44.169227 18633 raft_consensus.cc:2804] T a9e6e2dfc9624bbb887e108176acff29 P 6ba6d37b4c6344ec882213fb72cc10a3 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:03:44.169752 18633 raft_consensus.cc:697] T a9e6e2dfc9624bbb887e108176acff29 P 6ba6d37b4c6344ec882213fb72cc10a3 [term 1 LEADER]: Becoming Leader. State: Replica: 6ba6d37b4c6344ec882213fb72cc10a3, State: Running, Role: LEADER
I20260709 13:03:44.170527 18633 consensus_queue.cc:237] T a9e6e2dfc9624bbb887e108176acff29 P 6ba6d37b4c6344ec882213fb72cc10a3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ba6d37b4c6344ec882213fb72cc10a3" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 33623 } } peers { permanent_uuid: "e5d4c60ba4c64aa78850cf308be78a8d" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 37301 } } peers { permanent_uuid: "e34192eeaeb246a790a18368773bbe15" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 42349 } }
I20260709 13:03:44.170910 18678 leader_election.cc:290] T a9e6e2dfc9624bbb887e108176acff29 P 6ba6d37b4c6344ec882213fb72cc10a3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e5d4c60ba4c64aa78850cf308be78a8d (127.17.223.2:37301), e34192eeaeb246a790a18368773bbe15 (127.17.223.3:42349)
I20260709 13:03:44.173780 18628 ts_tablet_manager.cc:1434] T b68da910d10d4d6a80b0055f7061ad27 P e5d4c60ba4c64aa78850cf308be78a8d: Time spent starting tablet: real 0.010s	user 0.007s	sys 0.000s
I20260709 13:03:44.173647 18584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9e6e2dfc9624bbb887e108176acff29" candidate_uuid: "6ba6d37b4c6344ec882213fb72cc10a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e34192eeaeb246a790a18368773bbe15"
I20260709 13:03:44.174175 18584 raft_consensus.cc:3060] T a9e6e2dfc9624bbb887e108176acff29 P e34192eeaeb246a790a18368773bbe15 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:44.174796 18650 leader_election.cc:290] T a9e6e2dfc9624bbb887e108176acff29 P 6ba6d37b4c6344ec882213fb72cc10a3 [CANDIDATE]: Term 1 election: Requested vote from peers e5d4c60ba4c64aa78850cf308be78a8d (127.17.223.2:37301), e34192eeaeb246a790a18368773bbe15 (127.17.223.3:42349)
I20260709 13:03:44.175985 18331 catalog_manager.cc:5697] T f5116788673d45ad9561408373f762a5 P 6ba6d37b4c6344ec882213fb72cc10a3 reported cstate change: term changed from 0 to 1, leader changed from <none> to 6ba6d37b4c6344ec882213fb72cc10a3 (127.17.223.1). New cstate: current_term: 1 leader_uuid: "6ba6d37b4c6344ec882213fb72cc10a3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ba6d37b4c6344ec882213fb72cc10a3" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 33623 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e5d4c60ba4c64aa78850cf308be78a8d" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 37301 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e34192eeaeb246a790a18368773bbe15" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 42349 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:44.180470 18584 raft_consensus.cc:2468] T a9e6e2dfc9624bbb887e108176acff29 P e34192eeaeb246a790a18368773bbe15 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ba6d37b4c6344ec882213fb72cc10a3 in term 1.
I20260709 13:03:44.204162 18330 catalog_manager.cc:5697] T a9e6e2dfc9624bbb887e108176acff29 P 6ba6d37b4c6344ec882213fb72cc10a3 reported cstate change: term changed from 0 to 1, leader changed from <none> to 6ba6d37b4c6344ec882213fb72cc10a3 (127.17.223.1). New cstate: current_term: 1 leader_uuid: "6ba6d37b4c6344ec882213fb72cc10a3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ba6d37b4c6344ec882213fb72cc10a3" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 33623 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e5d4c60ba4c64aa78850cf308be78a8d" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 37301 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e34192eeaeb246a790a18368773bbe15" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 42349 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:44.208130 18655 raft_consensus.cc:493] T 24b316d8ce55441ea9cf056818fd658a P e34192eeaeb246a790a18368773bbe15 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:44.208616 18655 raft_consensus.cc:515] T 24b316d8ce55441ea9cf056818fd658a P e34192eeaeb246a790a18368773bbe15 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ba6d37b4c6344ec882213fb72cc10a3" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 33623 } } peers { permanent_uuid: "e5d4c60ba4c64aa78850cf308be78a8d" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 37301 } } peers { permanent_uuid: "e34192eeaeb246a790a18368773bbe15" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 42349 } }
I20260709 13:03:44.210412 18655 leader_election.cc:290] T 24b316d8ce55441ea9cf056818fd658a P e34192eeaeb246a790a18368773bbe15 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6ba6d37b4c6344ec882213fb72cc10a3 (127.17.223.1:33623), e5d4c60ba4c64aa78850cf308be78a8d (127.17.223.2:37301)
I20260709 13:03:44.211493 18435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24b316d8ce55441ea9cf056818fd658a" candidate_uuid: "e34192eeaeb246a790a18368773bbe15" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6ba6d37b4c6344ec882213fb72cc10a3" is_pre_election: true
I20260709 13:03:44.212527 18510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24b316d8ce55441ea9cf056818fd658a" candidate_uuid: "e34192eeaeb246a790a18368773bbe15" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e5d4c60ba4c64aa78850cf308be78a8d" is_pre_election: true
I20260709 13:03:44.213238 18510 raft_consensus.cc:2393] T 24b316d8ce55441ea9cf056818fd658a P e5d4c60ba4c64aa78850cf308be78a8d [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e34192eeaeb246a790a18368773bbe15 in current term 1: Already voted for candidate 6ba6d37b4c6344ec882213fb72cc10a3 in this term.
I20260709 13:03:44.214351 18549 leader_election.cc:304] T 24b316d8ce55441ea9cf056818fd658a P e34192eeaeb246a790a18368773bbe15 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e34192eeaeb246a790a18368773bbe15; no voters: 6ba6d37b4c6344ec882213fb72cc10a3, e5d4c60ba4c64aa78850cf308be78a8d
I20260709 13:03:44.215080 18655 raft_consensus.cc:3060] T 24b316d8ce55441ea9cf056818fd658a P e34192eeaeb246a790a18368773bbe15 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:44.219285 18655 raft_consensus.cc:2749] T 24b316d8ce55441ea9cf056818fd658a P e34192eeaeb246a790a18368773bbe15 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:03:44.227120 18655 raft_consensus.cc:493] T 476ca419566a4bc1883e94647b632918 P e34192eeaeb246a790a18368773bbe15 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:44.227509 18655 raft_consensus.cc:515] T 476ca419566a4bc1883e94647b632918 P e34192eeaeb246a790a18368773bbe15 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ba6d37b4c6344ec882213fb72cc10a3" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 33623 } } peers { permanent_uuid: "e5d4c60ba4c64aa78850cf308be78a8d" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 37301 } } peers { permanent_uuid: "e34192eeaeb246a790a18368773bbe15" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 42349 } }
I20260709 13:03:44.229257 18655 leader_election.cc:290] T 476ca419566a4bc1883e94647b632918 P e34192eeaeb246a790a18368773bbe15 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6ba6d37b4c6344ec882213fb72cc10a3 (127.17.223.1:33623), e5d4c60ba4c64aa78850cf308be78a8d (127.17.223.2:37301)
I20260709 13:03:44.230206 18435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "476ca419566a4bc1883e94647b632918" candidate_uuid: "e34192eeaeb246a790a18368773bbe15" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6ba6d37b4c6344ec882213fb72cc10a3" is_pre_election: true
I20260709 13:03:44.230378 18510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "476ca419566a4bc1883e94647b632918" candidate_uuid: "e34192eeaeb246a790a18368773bbe15" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e5d4c60ba4c64aa78850cf308be78a8d" is_pre_election: true
I20260709 13:03:44.230782 18435 raft_consensus.cc:2468] T 476ca419566a4bc1883e94647b632918 P 6ba6d37b4c6344ec882213fb72cc10a3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e34192eeaeb246a790a18368773bbe15 in term 0.
I20260709 13:03:44.231011 18510 raft_consensus.cc:2468] T 476ca419566a4bc1883e94647b632918 P e5d4c60ba4c64aa78850cf308be78a8d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e34192eeaeb246a790a18368773bbe15 in term 0.
I20260709 13:03:44.231824 18548 leader_election.cc:304] T 476ca419566a4bc1883e94647b632918 P e34192eeaeb246a790a18368773bbe15 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6ba6d37b4c6344ec882213fb72cc10a3, e34192eeaeb246a790a18368773bbe15; no voters: 
I20260709 13:03:44.232635 18655 raft_consensus.cc:2804] T 476ca419566a4bc1883e94647b632918 P e34192eeaeb246a790a18368773bbe15 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:03:44.232980 18655 raft_consensus.cc:493] T 476ca419566a4bc1883e94647b632918 P e34192eeaeb246a790a18368773bbe15 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:44.233268 18655 raft_consensus.cc:3060] T 476ca419566a4bc1883e94647b632918 P e34192eeaeb246a790a18368773bbe15 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:44.237896 18655 raft_consensus.cc:515] T 476ca419566a4bc1883e94647b632918 P e34192eeaeb246a790a18368773bbe15 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ba6d37b4c6344ec882213fb72cc10a3" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 33623 } } peers { permanent_uuid: "e5d4c60ba4c64aa78850cf308be78a8d" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 37301 } } peers { permanent_uuid: "e34192eeaeb246a790a18368773bbe15" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 42349 } }
I20260709 13:03:44.239974 18655 leader_election.cc:290] T 476ca419566a4bc1883e94647b632918 P e34192eeaeb246a790a18368773bbe15 [CANDIDATE]: Term 1 election: Requested vote from peers 6ba6d37b4c6344ec882213fb72cc10a3 (127.17.223.1:33623), e5d4c60ba4c64aa78850cf308be78a8d (127.17.223.2:37301)
I20260709 13:03:44.240316 18435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "476ca419566a4bc1883e94647b632918" candidate_uuid: "e34192eeaeb246a790a18368773bbe15" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6ba6d37b4c6344ec882213fb72cc10a3"
I20260709 13:03:44.240628 18510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "476ca419566a4bc1883e94647b632918" candidate_uuid: "e34192eeaeb246a790a18368773bbe15" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e5d4c60ba4c64aa78850cf308be78a8d"
I20260709 13:03:44.240877 18435 raft_consensus.cc:3060] T 476ca419566a4bc1883e94647b632918 P 6ba6d37b4c6344ec882213fb72cc10a3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:44.241225 18510 raft_consensus.cc:3060] T 476ca419566a4bc1883e94647b632918 P e5d4c60ba4c64aa78850cf308be78a8d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:44.243849 18633 raft_consensus.cc:493] T ba252d6f681a44948699b78102577c8b P 6ba6d37b4c6344ec882213fb72cc10a3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:44.244298 18633 raft_consensus.cc:515] T ba252d6f681a44948699b78102577c8b P 6ba6d37b4c6344ec882213fb72cc10a3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ba6d37b4c6344ec882213fb72cc10a3" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 33623 } } peers { permanent_uuid: "e5d4c60ba4c64aa78850cf308be78a8d" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 37301 } } peers { permanent_uuid: "e34192eeaeb246a790a18368773bbe15" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 42349 } }
I20260709 13:03:44.246301 18633 leader_election.cc:290] T ba252d6f681a44948699b78102577c8b P 6ba6d37b4c6344ec882213fb72cc10a3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e5d4c60ba4c64aa78850cf308be78a8d (127.17.223.2:37301), e34192eeaeb246a790a18368773bbe15 (127.17.223.3:42349)
I20260709 13:03:44.247201 18435 raft_consensus.cc:2468] T 476ca419566a4bc1883e94647b632918 P 6ba6d37b4c6344ec882213fb72cc10a3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e34192eeaeb246a790a18368773bbe15 in term 1.
I20260709 13:03:44.247843 18584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba252d6f681a44948699b78102577c8b" candidate_uuid: "6ba6d37b4c6344ec882213fb72cc10a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e34192eeaeb246a790a18368773bbe15" is_pre_election: true
I20260709 13:03:44.248528 18507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba252d6f681a44948699b78102577c8b" candidate_uuid: "6ba6d37b4c6344ec882213fb72cc10a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e5d4c60ba4c64aa78850cf308be78a8d" is_pre_election: true
I20260709 13:03:44.249264 18507 raft_consensus.cc:2393] T ba252d6f681a44948699b78102577c8b P e5d4c60ba4c64aa78850cf308be78a8d [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6ba6d37b4c6344ec882213fb72cc10a3 in current term 1: Already voted for candidate e34192eeaeb246a790a18368773bbe15 in this term.
I20260709 13:03:44.249181 18548 leader_election.cc:304] T 476ca419566a4bc1883e94647b632918 P e34192eeaeb246a790a18368773bbe15 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6ba6d37b4c6344ec882213fb72cc10a3, e34192eeaeb246a790a18368773bbe15; no voters: 
I20260709 13:03:44.249855 18510 raft_consensus.cc:2468] T 476ca419566a4bc1883e94647b632918 P e5d4c60ba4c64aa78850cf308be78a8d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e34192eeaeb246a790a18368773bbe15 in term 1.
I20260709 13:03:44.250269 18655 raft_consensus.cc:2804] T 476ca419566a4bc1883e94647b632918 P e34192eeaeb246a790a18368773bbe15 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:03:44.250221 18400 leader_election.cc:304] T ba252d6f681a44948699b78102577c8b P 6ba6d37b4c6344ec882213fb72cc10a3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ba6d37b4c6344ec882213fb72cc10a3; no voters: e34192eeaeb246a790a18368773bbe15, e5d4c60ba4c64aa78850cf308be78a8d
I20260709 13:03:44.251482 18633 raft_consensus.cc:3060] T ba252d6f681a44948699b78102577c8b P 6ba6d37b4c6344ec882213fb72cc10a3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:44.251629 18655 raft_consensus.cc:697] T 476ca419566a4bc1883e94647b632918 P e34192eeaeb246a790a18368773bbe15 [term 1 LEADER]: Becoming Leader. State: Replica: e34192eeaeb246a790a18368773bbe15, State: Running, Role: LEADER
I20260709 13:03:44.252458 18655 consensus_queue.cc:237] T 476ca419566a4bc1883e94647b632918 P e34192eeaeb246a790a18368773bbe15 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ba6d37b4c6344ec882213fb72cc10a3" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 33623 } } peers { permanent_uuid: "e5d4c60ba4c64aa78850cf308be78a8d" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 37301 } } peers { permanent_uuid: "e34192eeaeb246a790a18368773bbe15" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 42349 } }
I20260709 13:03:44.257977 18633 raft_consensus.cc:2749] T ba252d6f681a44948699b78102577c8b P 6ba6d37b4c6344ec882213fb72cc10a3 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:03:44.259884 18330 catalog_manager.cc:5697] T 476ca419566a4bc1883e94647b632918 P e34192eeaeb246a790a18368773bbe15 reported cstate change: term changed from 0 to 1, leader changed from <none> to e34192eeaeb246a790a18368773bbe15 (127.17.223.3). New cstate: current_term: 1 leader_uuid: "e34192eeaeb246a790a18368773bbe15" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ba6d37b4c6344ec882213fb72cc10a3" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 33623 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e5d4c60ba4c64aa78850cf308be78a8d" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 37301 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e34192eeaeb246a790a18368773bbe15" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 42349 } health_report { overall_health: HEALTHY } } }
I20260709 13:03:44.263954 18655 raft_consensus.cc:493] T b68da910d10d4d6a80b0055f7061ad27 P e34192eeaeb246a790a18368773bbe15 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:44.264420 18655 raft_consensus.cc:515] T b68da910d10d4d6a80b0055f7061ad27 P e34192eeaeb246a790a18368773bbe15 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ba6d37b4c6344ec882213fb72cc10a3" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 33623 } } peers { permanent_uuid: "e5d4c60ba4c64aa78850cf308be78a8d" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 37301 } } peers { permanent_uuid: "e34192eeaeb246a790a18368773bbe15" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 42349 } }
I20260709 13:03:44.267333 18435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b68da910d10d4d6a80b0055f7061ad27" candidate_uuid: "e34192eeaeb246a790a18368773bbe15" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6ba6d37b4c6344ec882213fb72cc10a3" is_pre_election: true
I20260709 13:03:44.268133 18655 leader_election.cc:290] T b68da910d10d4d6a80b0055f7061ad27 P e34192eeaeb246a790a18368773bbe15 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6ba6d37b4c6344ec882213fb72cc10a3 (127.17.223.1:33623), e5d4c60ba4c64aa78850cf308be78a8d (127.17.223.2:37301)
I20260709 13:03:44.268417 18510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b68da910d10d4d6a80b0055f7061ad27" candidate_uuid: "e34192eeaeb246a790a18368773bbe15" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e5d4c60ba4c64aa78850cf308be78a8d" is_pre_election: true
I20260709 13:03:44.268615 18435 raft_consensus.cc:2468] T b68da910d10d4d6a80b0055f7061ad27 P 6ba6d37b4c6344ec882213fb72cc10a3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e34192eeaeb246a790a18368773bbe15 in term 0.
I20260709 13:03:44.269016 18510 raft_consensus.cc:2468] T b68da910d10d4d6a80b0055f7061ad27 P e5d4c60ba4c64aa78850cf308be78a8d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e34192eeaeb246a790a18368773bbe15 in term 0.
I20260709 13:03:44.269650 18548 leader_election.cc:304] T b68da910d10d4d6a80b0055f7061ad27 P e34192eeaeb246a790a18368773bbe15 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6ba6d37b4c6344ec882213fb72cc10a3, e34192eeaeb246a790a18368773bbe15; no voters: 
I20260709 13:03:44.270707 18655 raft_consensus.cc:2804] T b68da910d10d4d6a80b0055f7061ad27 P e34192eeaeb246a790a18368773bbe15 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:03:44.271068 18655 raft_consensus.cc:493] T b68da910d10d4d6a80b0055f7061ad27 P e34192eeaeb246a790a18368773bbe15 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:44.271384 18655 raft_consensus.cc:3060] T b68da910d10d4d6a80b0055f7061ad27 P e34192eeaeb246a790a18368773bbe15 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:44.277390 18655 raft_consensus.cc:515] T b68da910d10d4d6a80b0055f7061ad27 P e34192eeaeb246a790a18368773bbe15 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ba6d37b4c6344ec882213fb72cc10a3" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 33623 } } peers { permanent_uuid: "e5d4c60ba4c64aa78850cf308be78a8d" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 37301 } } peers { permanent_uuid: "e34192eeaeb246a790a18368773bbe15" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 42349 } }
I20260709 13:03:44.279356 18655 leader_election.cc:290] T b68da910d10d4d6a80b0055f7061ad27 P e34192eeaeb246a790a18368773bbe15 [CANDIDATE]: Term 1 election: Requested vote from peers 6ba6d37b4c6344ec882213fb72cc10a3 (127.17.223.1:33623), e5d4c60ba4c64aa78850cf308be78a8d (127.17.223.2:37301)
I20260709 13:03:44.280190 18435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b68da910d10d4d6a80b0055f7061ad27" candidate_uuid: "e34192eeaeb246a790a18368773bbe15" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6ba6d37b4c6344ec882213fb72cc10a3"
I20260709 13:03:44.280484 18510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b68da910d10d4d6a80b0055f7061ad27" candidate_uuid: "e34192eeaeb246a790a18368773bbe15" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e5d4c60ba4c64aa78850cf308be78a8d"
I20260709 13:03:44.280715 18435 raft_consensus.cc:3060] T b68da910d10d4d6a80b0055f7061ad27 P 6ba6d37b4c6344ec882213fb72cc10a3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:44.281108 18510 raft_consensus.cc:3060] T b68da910d10d4d6a80b0055f7061ad27 P e5d4c60ba4c64aa78850cf308be78a8d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:44.285089 18633 consensus_queue.cc:1048] T 24b316d8ce55441ea9cf056818fd658a P 6ba6d37b4c6344ec882213fb72cc10a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5d4c60ba4c64aa78850cf308be78a8d" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 37301 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:03:44.286757 18435 raft_consensus.cc:2468] T b68da910d10d4d6a80b0055f7061ad27 P 6ba6d37b4c6344ec882213fb72cc10a3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e34192eeaeb246a790a18368773bbe15 in term 1.
I20260709 13:03:44.287982 18548 leader_election.cc:304] T b68da910d10d4d6a80b0055f7061ad27 P e34192eeaeb246a790a18368773bbe15 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6ba6d37b4c6344ec882213fb72cc10a3, e34192eeaeb246a790a18368773bbe15; no voters: 
I20260709 13:03:44.289625 18655 raft_consensus.cc:2804] T b68da910d10d4d6a80b0055f7061ad27 P e34192eeaeb246a790a18368773bbe15 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:03:44.290122 18510 raft_consensus.cc:2468] T b68da910d10d4d6a80b0055f7061ad27 P e5d4c60ba4c64aa78850cf308be78a8d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e34192eeaeb246a790a18368773bbe15 in term 1.
I20260709 13:03:44.290591 18655 raft_consensus.cc:697] T b68da910d10d4d6a80b0055f7061ad27 P e34192eeaeb246a790a18368773bbe15 [term 1 LEADER]: Becoming Leader. State: Replica: e34192eeaeb246a790a18368773bbe15, State: Running, Role: LEADER
I20260709 13:03:44.292955 18655 consensus_queue.cc:237] T b68da910d10d4d6a80b0055f7061ad27 P e34192eeaeb246a790a18368773bbe15 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ba6d37b4c6344ec882213fb72cc10a3" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 33623 } } peers { permanent_uuid: "e5d4c60ba4c64aa78850cf308be78a8d" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 37301 } } peers { permanent_uuid: "e34192eeaeb246a790a18368773bbe15" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 42349 } }
I20260709 13:03:44.299258 18634 consensus_queue.cc:1048] T ba252d6f681a44948699b78102577c8b P e34192eeaeb246a790a18368773bbe15 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5d4c60ba4c64aa78850cf308be78a8d" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 37301 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:03:44.312784 18330 catalog_manager.cc:5697] T b68da910d10d4d6a80b0055f7061ad27 P e34192eeaeb246a790a18368773bbe15 reported cstate change: term changed from 0 to 1, leader changed from <none> to e34192eeaeb246a790a18368773bbe15 (127.17.223.3). New cstate: current_term: 1 leader_uuid: "e34192eeaeb246a790a18368773bbe15" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ba6d37b4c6344ec882213fb72cc10a3" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 33623 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e5d4c60ba4c64aa78850cf308be78a8d" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 37301 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e34192eeaeb246a790a18368773bbe15" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 42349 } health_report { overall_health: HEALTHY } } }
I20260709 13:03:44.331034 18650 consensus_queue.cc:1048] T 24b316d8ce55441ea9cf056818fd658a P 6ba6d37b4c6344ec882213fb72cc10a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e34192eeaeb246a790a18368773bbe15" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 42349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:03:44.337049 18655 consensus_queue.cc:1048] T ba252d6f681a44948699b78102577c8b P e34192eeaeb246a790a18368773bbe15 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ba6d37b4c6344ec882213fb72cc10a3" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 33623 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:03:44.361971 18434 raft_consensus.cc:3060] T 63053c1fc3214bcd99d7c93f71c98ff3 P 6ba6d37b4c6344ec882213fb72cc10a3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:44.375411 18655 consensus_queue.cc:1048] T 63053c1fc3214bcd99d7c93f71c98ff3 P e34192eeaeb246a790a18368773bbe15 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5d4c60ba4c64aa78850cf308be78a8d" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 37301 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:03:44.387212 18655 consensus_queue.cc:1048] T 63053c1fc3214bcd99d7c93f71c98ff3 P e34192eeaeb246a790a18368773bbe15 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ba6d37b4c6344ec882213fb72cc10a3" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 33623 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:03:44.428035 18508 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5c30ad177b44422f982d86fe00ab6c4a"
dest_uuid: "e5d4c60ba4c64aa78850cf308be78a8d"
mode: GRACEFUL
new_leader_uuid: "6ba6d37b4c6344ec882213fb72cc10a3"
 from {username='slave'} at 127.0.0.1:58824
I20260709 13:03:44.428817 18508 raft_consensus.cc:606] T 5c30ad177b44422f982d86fe00ab6c4a P e5d4c60ba4c64aa78850cf308be78a8d [term 1 LEADER]: Received request to transfer leadership to TS 6ba6d37b4c6344ec882213fb72cc10a3
I20260709 13:03:44.447170 18507 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a5d1966171cd4c25a9045a79b6ce1b58"
dest_uuid: "e5d4c60ba4c64aa78850cf308be78a8d"
mode: GRACEFUL
new_leader_uuid: "6ba6d37b4c6344ec882213fb72cc10a3"
 from {username='slave'} at 127.0.0.1:58824
I20260709 13:03:44.447896 18507 raft_consensus.cc:606] T a5d1966171cd4c25a9045a79b6ce1b58 P e5d4c60ba4c64aa78850cf308be78a8d [term 1 LEADER]: Received request to transfer leadership to TS 6ba6d37b4c6344ec882213fb72cc10a3
I20260709 13:03:44.463388 18433 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f5116788673d45ad9561408373f762a5"
dest_uuid: "6ba6d37b4c6344ec882213fb72cc10a3"
mode: GRACEFUL
new_leader_uuid: "e5d4c60ba4c64aa78850cf308be78a8d"
 from {username='slave'} at 127.0.0.1:50382
I20260709 13:03:44.464017 18433 raft_consensus.cc:606] T f5116788673d45ad9561408373f762a5 P 6ba6d37b4c6344ec882213fb72cc10a3 [term 1 LEADER]: Received request to transfer leadership to TS e5d4c60ba4c64aa78850cf308be78a8d
I20260709 13:03:44.474001 18665 consensus_queue.cc:1048] T a5d1966171cd4c25a9045a79b6ce1b58 P e5d4c60ba4c64aa78850cf308be78a8d [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ba6d37b4c6344ec882213fb72cc10a3" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 33623 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:03:44.474243 18668 consensus_queue.cc:1048] T 5c30ad177b44422f982d86fe00ab6c4a P e5d4c60ba4c64aa78850cf308be78a8d [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ba6d37b4c6344ec882213fb72cc10a3" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 33623 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:03:44.481241 18584 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "476ca419566a4bc1883e94647b632918"
dest_uuid: "e34192eeaeb246a790a18368773bbe15"
mode: GRACEFUL
new_leader_uuid: "e5d4c60ba4c64aa78850cf308be78a8d"
 from {username='slave'} at 127.0.0.1:52594
I20260709 13:03:44.481873 18584 raft_consensus.cc:606] T 476ca419566a4bc1883e94647b632918 P e34192eeaeb246a790a18368773bbe15 [term 1 LEADER]: Received request to transfer leadership to TS e5d4c60ba4c64aa78850cf308be78a8d
I20260709 13:03:44.484006 18668 raft_consensus.cc:993] T 5c30ad177b44422f982d86fe00ab6c4a P e5d4c60ba4c64aa78850cf308be78a8d: : Instructing follower 6ba6d37b4c6344ec882213fb72cc10a3 to start an election
I20260709 13:03:44.484472 18665 raft_consensus.cc:1081] T 5c30ad177b44422f982d86fe00ab6c4a P e5d4c60ba4c64aa78850cf308be78a8d [term 1 LEADER]: Signalling peer 6ba6d37b4c6344ec882213fb72cc10a3 to start an election
I20260709 13:03:44.486460 18435 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "5c30ad177b44422f982d86fe00ab6c4a"
dest_uuid: "6ba6d37b4c6344ec882213fb72cc10a3"
 from {username='slave'} at 127.0.0.1:50368
I20260709 13:03:44.487083 18435 raft_consensus.cc:493] T 5c30ad177b44422f982d86fe00ab6c4a P 6ba6d37b4c6344ec882213fb72cc10a3 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:03:44.487452 18435 raft_consensus.cc:3060] T 5c30ad177b44422f982d86fe00ab6c4a P 6ba6d37b4c6344ec882213fb72cc10a3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:44.492136 18665 consensus_queue.cc:1048] T 5c30ad177b44422f982d86fe00ab6c4a P e5d4c60ba4c64aa78850cf308be78a8d [LEADER]: Connected to new peer: Peer: permanent_uuid: "e34192eeaeb246a790a18368773bbe15" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 42349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:03:44.494060 18435 raft_consensus.cc:515] T 5c30ad177b44422f982d86fe00ab6c4a P 6ba6d37b4c6344ec882213fb72cc10a3 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5d4c60ba4c64aa78850cf308be78a8d" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 37301 } } peers { permanent_uuid: "6ba6d37b4c6344ec882213fb72cc10a3" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 33623 } } peers { permanent_uuid: "e34192eeaeb246a790a18368773bbe15" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 42349 } }
I20260709 13:03:44.500309 18433 raft_consensus.cc:1240] T 5c30ad177b44422f982d86fe00ab6c4a P 6ba6d37b4c6344ec882213fb72cc10a3 [term 2 FOLLOWER]: Rejecting Update request from peer e5d4c60ba4c64aa78850cf308be78a8d for earlier term 1. Current term is 2. Ops: []
I20260709 13:03:44.501657 18583 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ba252d6f681a44948699b78102577c8b"
dest_uuid: "e34192eeaeb246a790a18368773bbe15"
mode: GRACEFUL
new_leader_uuid: "e5d4c60ba4c64aa78850cf308be78a8d"
 from {username='slave'} at 127.0.0.1:52594
I20260709 13:03:44.502401 18583 raft_consensus.cc:606] T ba252d6f681a44948699b78102577c8b P e34192eeaeb246a790a18368773bbe15 [term 1 LEADER]: Received request to transfer leadership to TS e5d4c60ba4c64aa78850cf308be78a8d
I20260709 13:03:44.498010 18665 raft_consensus.cc:993] T a5d1966171cd4c25a9045a79b6ce1b58 P e5d4c60ba4c64aa78850cf308be78a8d: : Instructing follower 6ba6d37b4c6344ec882213fb72cc10a3 to start an election
I20260709 13:03:44.505465 18668 consensus_queue.cc:1059] T 5c30ad177b44422f982d86fe00ab6c4a P e5d4c60ba4c64aa78850cf308be78a8d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6ba6d37b4c6344ec882213fb72cc10a3" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 33623 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:03:44.506098 18702 raft_consensus.cc:1081] T a5d1966171cd4c25a9045a79b6ce1b58 P e5d4c60ba4c64aa78850cf308be78a8d [term 1 LEADER]: Signalling peer 6ba6d37b4c6344ec882213fb72cc10a3 to start an election
I20260709 13:03:44.510015 18583 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b68da910d10d4d6a80b0055f7061ad27"
dest_uuid: "e34192eeaeb246a790a18368773bbe15"
mode: GRACEFUL
new_leader_uuid: "e5d4c60ba4c64aa78850cf308be78a8d"
 from {username='slave'} at 127.0.0.1:52594
I20260709 13:03:44.510496 18433 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a5d1966171cd4c25a9045a79b6ce1b58"
dest_uuid: "6ba6d37b4c6344ec882213fb72cc10a3"
 from {username='slave'} at 127.0.0.1:50368
I20260709 13:03:44.511150 18433 raft_consensus.cc:493] T a5d1966171cd4c25a9045a79b6ce1b58 P 6ba6d37b4c6344ec882213fb72cc10a3 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:03:44.511569 18433 raft_consensus.cc:3060] T a5d1966171cd4c25a9045a79b6ce1b58 P 6ba6d37b4c6344ec882213fb72cc10a3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:44.510601 18583 raft_consensus.cc:606] T b68da910d10d4d6a80b0055f7061ad27 P e34192eeaeb246a790a18368773bbe15 [term 1 LEADER]: Received request to transfer leadership to TS e5d4c60ba4c64aa78850cf308be78a8d
I20260709 13:03:44.521711 18435 leader_election.cc:290] T 5c30ad177b44422f982d86fe00ab6c4a P 6ba6d37b4c6344ec882213fb72cc10a3 [CANDIDATE]: Term 2 election: Requested vote from peers e5d4c60ba4c64aa78850cf308be78a8d (127.17.223.2:37301), e34192eeaeb246a790a18368773bbe15 (127.17.223.3:42349)
I20260709 13:03:44.522399 18582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c30ad177b44422f982d86fe00ab6c4a" candidate_uuid: "6ba6d37b4c6344ec882213fb72cc10a3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e34192eeaeb246a790a18368773bbe15"
I20260709 13:03:44.525066 18582 raft_consensus.cc:3060] T 5c30ad177b44422f982d86fe00ab6c4a P e34192eeaeb246a790a18368773bbe15 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:44.525513 18507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c30ad177b44422f982d86fe00ab6c4a" candidate_uuid: "6ba6d37b4c6344ec882213fb72cc10a3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e5d4c60ba4c64aa78850cf308be78a8d"
I20260709 13:03:44.526084 18507 raft_consensus.cc:3055] T 5c30ad177b44422f982d86fe00ab6c4a P e5d4c60ba4c64aa78850cf308be78a8d [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:03:44.526782 18507 raft_consensus.cc:740] T 5c30ad177b44422f982d86fe00ab6c4a P e5d4c60ba4c64aa78850cf308be78a8d [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e5d4c60ba4c64aa78850cf308be78a8d, State: Running, Role: LEADER
I20260709 13:03:44.527661 18507 consensus_queue.cc:260] T 5c30ad177b44422f982d86fe00ab6c4a P e5d4c60ba4c64aa78850cf308be78a8d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5d4c60ba4c64aa78850cf308be78a8d" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 37301 } } peers { permanent_uuid: "6ba6d37b4c6344ec882213fb72cc10a3" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 33623 } } peers { permanent_uuid: "e34192eeaeb246a790a18368773bbe15" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 42349 } }
I20260709 13:03:44.518451 18433 raft_consensus.cc:515] T a5d1966171cd4c25a9045a79b6ce1b58 P 6ba6d37b4c6344ec882213fb72cc10a3 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ba6d37b4c6344ec882213fb72cc10a3" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 33623 } } peers { permanent_uuid: "e5d4c60ba4c64aa78850cf308be78a8d" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 37301 } } peers { permanent_uuid: "e34192eeaeb246a790a18368773bbe15" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 42349 } }
I20260709 13:03:44.526265 18703 consensus_queue.cc:1048] T a5d1966171cd4c25a9045a79b6ce1b58 P e5d4c60ba4c64aa78850cf308be78a8d [LEADER]: Connected to new peer: Peer: permanent_uuid: "e34192eeaeb246a790a18368773bbe15" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 42349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.006s
I20260709 13:03:44.529821 18507 raft_consensus.cc:3060] T 5c30ad177b44422f982d86fe00ab6c4a P e5d4c60ba4c64aa78850cf308be78a8d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:44.535709 18582 raft_consensus.cc:2468] T 5c30ad177b44422f982d86fe00ab6c4a P e34192eeaeb246a790a18368773bbe15 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ba6d37b4c6344ec882213fb72cc10a3 in term 2.
I20260709 13:03:44.538436 18507 raft_consensus.cc:2468] T 5c30ad177b44422f982d86fe00ab6c4a P e5d4c60ba4c64aa78850cf308be78a8d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ba6d37b4c6344ec882213fb72cc10a3 in term 2.
W20260709 13:03:44.538993 18665 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 2 current term: 2 is higher.
I20260709 13:03:44.539629 18508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5d1966171cd4c25a9045a79b6ce1b58" candidate_uuid: "6ba6d37b4c6344ec882213fb72cc10a3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e5d4c60ba4c64aa78850cf308be78a8d"
I20260709 13:03:44.540290 18508 raft_consensus.cc:3055] T a5d1966171cd4c25a9045a79b6ce1b58 P e5d4c60ba4c64aa78850cf308be78a8d [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:03:44.539894 18433 leader_election.cc:290] T a5d1966171cd4c25a9045a79b6ce1b58 P 6ba6d37b4c6344ec882213fb72cc10a3 [CANDIDATE]: Term 2 election: Requested vote from peers e5d4c60ba4c64aa78850cf308be78a8d (127.17.223.2:37301), e34192eeaeb246a790a18368773bbe15 (127.17.223.3:42349)
I20260709 13:03:44.540683 18508 raft_consensus.cc:740] T a5d1966171cd4c25a9045a79b6ce1b58 P e5d4c60ba4c64aa78850cf308be78a8d [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e5d4c60ba4c64aa78850cf308be78a8d, State: Running, Role: LEADER
I20260709 13:03:44.540968 18583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5d1966171cd4c25a9045a79b6ce1b58" candidate_uuid: "6ba6d37b4c6344ec882213fb72cc10a3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e34192eeaeb246a790a18368773bbe15"
I20260709 13:03:44.541563 18508 consensus_queue.cc:260] T a5d1966171cd4c25a9045a79b6ce1b58 P e5d4c60ba4c64aa78850cf308be78a8d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ba6d37b4c6344ec882213fb72cc10a3" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 33623 } } peers { permanent_uuid: "e5d4c60ba4c64aa78850cf308be78a8d" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 37301 } } peers { permanent_uuid: "e34192eeaeb246a790a18368773bbe15" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 42349 } }
I20260709 13:03:44.542569 18508 raft_consensus.cc:3060] T a5d1966171cd4c25a9045a79b6ce1b58 P e5d4c60ba4c64aa78850cf308be78a8d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:44.545233 18401 leader_election.cc:304] T 5c30ad177b44422f982d86fe00ab6c4a P 6ba6d37b4c6344ec882213fb72cc10a3 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6ba6d37b4c6344ec882213fb72cc10a3, e34192eeaeb246a790a18368773bbe15; no voters: 
I20260709 13:03:44.546155 18633 raft_consensus.cc:2804] T 5c30ad177b44422f982d86fe00ab6c4a P 6ba6d37b4c6344ec882213fb72cc10a3 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:03:44.546594 18633 raft_consensus.cc:697] T 5c30ad177b44422f982d86fe00ab6c4a P 6ba6d37b4c6344ec882213fb72cc10a3 [term 2 LEADER]: Becoming Leader. State: Replica: 6ba6d37b4c6344ec882213fb72cc10a3, State: Running, Role: LEADER
I20260709 13:03:44.547390 18633 consensus_queue.cc:237] T 5c30ad177b44422f982d86fe00ab6c4a P 6ba6d37b4c6344ec882213fb72cc10a3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5d4c60ba4c64aa78850cf308be78a8d" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 37301 } } peers { permanent_uuid: "6ba6d37b4c6344ec882213fb72cc10a3" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 33623 } } peers { permanent_uuid: "e34192eeaeb246a790a18368773bbe15" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 42349 } }
I20260709 13:03:44.557433 18330 catalog_manager.cc:5697] T 5c30ad177b44422f982d86fe00ab6c4a P 6ba6d37b4c6344ec882213fb72cc10a3 reported cstate change: term changed from 1 to 2, leader changed from e5d4c60ba4c64aa78850cf308be78a8d (127.17.223.2) to 6ba6d37b4c6344ec882213fb72cc10a3 (127.17.223.1). New cstate: current_term: 2 leader_uuid: "6ba6d37b4c6344ec882213fb72cc10a3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5d4c60ba4c64aa78850cf308be78a8d" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 37301 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6ba6d37b4c6344ec882213fb72cc10a3" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 33623 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e34192eeaeb246a790a18368773bbe15" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 42349 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:44.560914 18508 raft_consensus.cc:2468] T a5d1966171cd4c25a9045a79b6ce1b58 P e5d4c60ba4c64aa78850cf308be78a8d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ba6d37b4c6344ec882213fb72cc10a3 in term 2.
I20260709 13:03:44.564803 18400 leader_election.cc:304] T a5d1966171cd4c25a9045a79b6ce1b58 P 6ba6d37b4c6344ec882213fb72cc10a3 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6ba6d37b4c6344ec882213fb72cc10a3, e5d4c60ba4c64aa78850cf308be78a8d; no voters: e34192eeaeb246a790a18368773bbe15
I20260709 13:03:44.566815 18682 raft_consensus.cc:2804] T a5d1966171cd4c25a9045a79b6ce1b58 P 6ba6d37b4c6344ec882213fb72cc10a3 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:03:44.567305 18682 raft_consensus.cc:697] T a5d1966171cd4c25a9045a79b6ce1b58 P 6ba6d37b4c6344ec882213fb72cc10a3 [term 2 LEADER]: Becoming Leader. State: Replica: 6ba6d37b4c6344ec882213fb72cc10a3, State: Running, Role: LEADER
I20260709 13:03:44.568171 18682 consensus_queue.cc:237] T a5d1966171cd4c25a9045a79b6ce1b58 P 6ba6d37b4c6344ec882213fb72cc10a3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ba6d37b4c6344ec882213fb72cc10a3" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 33623 } } peers { permanent_uuid: "e5d4c60ba4c64aa78850cf308be78a8d" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 37301 } } peers { permanent_uuid: "e34192eeaeb246a790a18368773bbe15" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 42349 } }
I20260709 13:03:44.581508 18330 catalog_manager.cc:5697] T a5d1966171cd4c25a9045a79b6ce1b58 P 6ba6d37b4c6344ec882213fb72cc10a3 reported cstate change: term changed from 1 to 2, leader changed from e5d4c60ba4c64aa78850cf308be78a8d (127.17.223.2) to 6ba6d37b4c6344ec882213fb72cc10a3 (127.17.223.1). New cstate: current_term: 2 leader_uuid: "6ba6d37b4c6344ec882213fb72cc10a3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ba6d37b4c6344ec882213fb72cc10a3" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 33623 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e5d4c60ba4c64aa78850cf308be78a8d" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 37301 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e34192eeaeb246a790a18368773bbe15" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 42349 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:44.596266 18682 consensus_queue.cc:1048] T a9e6e2dfc9624bbb887e108176acff29 P 6ba6d37b4c6344ec882213fb72cc10a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5d4c60ba4c64aa78850cf308be78a8d" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 37301 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:03:44.608155 18678 consensus_queue.cc:1048] T a9e6e2dfc9624bbb887e108176acff29 P 6ba6d37b4c6344ec882213fb72cc10a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e34192eeaeb246a790a18368773bbe15" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 42349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:03:44.673573 18634 consensus_queue.cc:1048] T 476ca419566a4bc1883e94647b632918 P e34192eeaeb246a790a18368773bbe15 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ba6d37b4c6344ec882213fb72cc10a3" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 33623 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:03:44.684621 18634 consensus_queue.cc:1048] T 476ca419566a4bc1883e94647b632918 P e34192eeaeb246a790a18368773bbe15 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5d4c60ba4c64aa78850cf308be78a8d" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 37301 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:03:44.688359 18678 consensus_queue.cc:1048] T f5116788673d45ad9561408373f762a5 P 6ba6d37b4c6344ec882213fb72cc10a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e34192eeaeb246a790a18368773bbe15" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 42349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:03:44.707780 18682 consensus_queue.cc:1048] T f5116788673d45ad9561408373f762a5 P 6ba6d37b4c6344ec882213fb72cc10a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5d4c60ba4c64aa78850cf308be78a8d" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 37301 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:03:44.714087 18634 raft_consensus.cc:993] T 476ca419566a4bc1883e94647b632918 P e34192eeaeb246a790a18368773bbe15: : Instructing follower e5d4c60ba4c64aa78850cf308be78a8d to start an election
I20260709 13:03:44.714555 18634 raft_consensus.cc:1081] T 476ca419566a4bc1883e94647b632918 P e34192eeaeb246a790a18368773bbe15 [term 1 LEADER]: Signalling peer e5d4c60ba4c64aa78850cf308be78a8d to start an election
I20260709 13:03:44.717331 18510 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "476ca419566a4bc1883e94647b632918"
dest_uuid: "e5d4c60ba4c64aa78850cf308be78a8d"
 from {username='slave'} at 127.0.0.1:58812
I20260709 13:03:44.717880 18510 raft_consensus.cc:493] T 476ca419566a4bc1883e94647b632918 P e5d4c60ba4c64aa78850cf308be78a8d [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:03:44.718242 18510 raft_consensus.cc:3060] T 476ca419566a4bc1883e94647b632918 P e5d4c60ba4c64aa78850cf308be78a8d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:44.728396 18510 raft_consensus.cc:515] T 476ca419566a4bc1883e94647b632918 P e5d4c60ba4c64aa78850cf308be78a8d [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ba6d37b4c6344ec882213fb72cc10a3" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 33623 } } peers { permanent_uuid: "e5d4c60ba4c64aa78850cf308be78a8d" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 37301 } } peers { permanent_uuid: "e34192eeaeb246a790a18368773bbe15" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 42349 } }
I20260709 13:03:44.730368 18682 raft_consensus.cc:993] T f5116788673d45ad9561408373f762a5 P 6ba6d37b4c6344ec882213fb72cc10a3: : Instructing follower e5d4c60ba4c64aa78850cf308be78a8d to start an election
I20260709 13:03:44.730849 18682 raft_consensus.cc:1081] T f5116788673d45ad9561408373f762a5 P 6ba6d37b4c6344ec882213fb72cc10a3 [term 1 LEADER]: Signalling peer e5d4c60ba4c64aa78850cf308be78a8d to start an election
I20260709 13:03:44.731732 18510 leader_election.cc:290] T 476ca419566a4bc1883e94647b632918 P e5d4c60ba4c64aa78850cf308be78a8d [CANDIDATE]: Term 2 election: Requested vote from peers 6ba6d37b4c6344ec882213fb72cc10a3 (127.17.223.1:33623), e34192eeaeb246a790a18368773bbe15 (127.17.223.3:42349)
I20260709 13:03:44.732738 18584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "476ca419566a4bc1883e94647b632918" candidate_uuid: "e5d4c60ba4c64aa78850cf308be78a8d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e34192eeaeb246a790a18368773bbe15"
I20260709 13:03:44.733304 18584 raft_consensus.cc:3055] T 476ca419566a4bc1883e94647b632918 P e34192eeaeb246a790a18368773bbe15 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:03:44.733577 18584 raft_consensus.cc:740] T 476ca419566a4bc1883e94647b632918 P e34192eeaeb246a790a18368773bbe15 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e34192eeaeb246a790a18368773bbe15, State: Running, Role: LEADER
I20260709 13:03:44.734081 18510 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f5116788673d45ad9561408373f762a5"
dest_uuid: "e5d4c60ba4c64aa78850cf308be78a8d"
 from {username='slave'} at 127.0.0.1:58808
I20260709 13:03:44.734266 18584 consensus_queue.cc:260] T 476ca419566a4bc1883e94647b632918 P e34192eeaeb246a790a18368773bbe15 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ba6d37b4c6344ec882213fb72cc10a3" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 33623 } } peers { permanent_uuid: "e5d4c60ba4c64aa78850cf308be78a8d" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 37301 } } peers { permanent_uuid: "e34192eeaeb246a790a18368773bbe15" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 42349 } }
I20260709 13:03:44.734642 18510 raft_consensus.cc:493] T f5116788673d45ad9561408373f762a5 P e5d4c60ba4c64aa78850cf308be78a8d [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:03:44.735122 18510 raft_consensus.cc:3060] T f5116788673d45ad9561408373f762a5 P e5d4c60ba4c64aa78850cf308be78a8d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:44.735316 18584 raft_consensus.cc:3060] T 476ca419566a4bc1883e94647b632918 P e34192eeaeb246a790a18368773bbe15 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:44.732664 18433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "476ca419566a4bc1883e94647b632918" candidate_uuid: "e5d4c60ba4c64aa78850cf308be78a8d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "6ba6d37b4c6344ec882213fb72cc10a3"
I20260709 13:03:44.738940 18433 raft_consensus.cc:3060] T 476ca419566a4bc1883e94647b632918 P 6ba6d37b4c6344ec882213fb72cc10a3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:44.741747 18510 raft_consensus.cc:515] T f5116788673d45ad9561408373f762a5 P e5d4c60ba4c64aa78850cf308be78a8d [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ba6d37b4c6344ec882213fb72cc10a3" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 33623 } } peers { permanent_uuid: "e5d4c60ba4c64aa78850cf308be78a8d" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 37301 } } peers { permanent_uuid: "e34192eeaeb246a790a18368773bbe15" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 42349 } }
I20260709 13:03:44.744331 18510 leader_election.cc:290] T f5116788673d45ad9561408373f762a5 P e5d4c60ba4c64aa78850cf308be78a8d [CANDIDATE]: Term 2 election: Requested vote from peers 6ba6d37b4c6344ec882213fb72cc10a3 (127.17.223.1:33623), e34192eeaeb246a790a18368773bbe15 (127.17.223.3:42349)
I20260709 13:03:44.744488 18435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5116788673d45ad9561408373f762a5" candidate_uuid: "e5d4c60ba4c64aa78850cf308be78a8d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "6ba6d37b4c6344ec882213fb72cc10a3"
I20260709 13:03:44.745090 18435 raft_consensus.cc:3055] T f5116788673d45ad9561408373f762a5 P 6ba6d37b4c6344ec882213fb72cc10a3 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:03:44.745390 18582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5116788673d45ad9561408373f762a5" candidate_uuid: "e5d4c60ba4c64aa78850cf308be78a8d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e34192eeaeb246a790a18368773bbe15"
I20260709 13:03:44.745944 18582 raft_consensus.cc:3060] T f5116788673d45ad9561408373f762a5 P e34192eeaeb246a790a18368773bbe15 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:44.748137 18584 raft_consensus.cc:2468] T 476ca419566a4bc1883e94647b632918 P e34192eeaeb246a790a18368773bbe15 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e5d4c60ba4c64aa78850cf308be78a8d in term 2.
I20260709 13:03:44.748827 18433 raft_consensus.cc:2468] T 476ca419566a4bc1883e94647b632918 P 6ba6d37b4c6344ec882213fb72cc10a3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e5d4c60ba4c64aa78850cf308be78a8d in term 2.
I20260709 13:03:44.749419 18476 leader_election.cc:304] T 476ca419566a4bc1883e94647b632918 P e5d4c60ba4c64aa78850cf308be78a8d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e34192eeaeb246a790a18368773bbe15, e5d4c60ba4c64aa78850cf308be78a8d; no voters: 
I20260709 13:03:44.745400 18435 raft_consensus.cc:740] T f5116788673d45ad9561408373f762a5 P 6ba6d37b4c6344ec882213fb72cc10a3 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 6ba6d37b4c6344ec882213fb72cc10a3, State: Running, Role: LEADER
I20260709 13:03:44.750453 18665 raft_consensus.cc:2804] T 476ca419566a4bc1883e94647b632918 P e5d4c60ba4c64aa78850cf308be78a8d [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:03:44.751513 18665 raft_consensus.cc:697] T 476ca419566a4bc1883e94647b632918 P e5d4c60ba4c64aa78850cf308be78a8d [term 2 LEADER]: Becoming Leader. State: Replica: e5d4c60ba4c64aa78850cf308be78a8d, State: Running, Role: LEADER
I20260709 13:03:44.751334 18435 consensus_queue.cc:260] T f5116788673d45ad9561408373f762a5 P 6ba6d37b4c6344ec882213fb72cc10a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ba6d37b4c6344ec882213fb72cc10a3" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 33623 } } peers { permanent_uuid: "e5d4c60ba4c64aa78850cf308be78a8d" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 37301 } } peers { permanent_uuid: "e34192eeaeb246a790a18368773bbe15" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 42349 } }
I20260709 13:03:44.752538 18435 raft_consensus.cc:3060] T f5116788673d45ad9561408373f762a5 P 6ba6d37b4c6344ec882213fb72cc10a3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:44.752367 18665 consensus_queue.cc:237] T 476ca419566a4bc1883e94647b632918 P e5d4c60ba4c64aa78850cf308be78a8d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ba6d37b4c6344ec882213fb72cc10a3" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 33623 } } peers { permanent_uuid: "e5d4c60ba4c64aa78850cf308be78a8d" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 37301 } } peers { permanent_uuid: "e34192eeaeb246a790a18368773bbe15" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 42349 } }
I20260709 13:03:44.752871 18582 raft_consensus.cc:2468] T f5116788673d45ad9561408373f762a5 P e34192eeaeb246a790a18368773bbe15 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e5d4c60ba4c64aa78850cf308be78a8d in term 2.
I20260709 13:03:44.754245 18476 leader_election.cc:304] T f5116788673d45ad9561408373f762a5 P e5d4c60ba4c64aa78850cf308be78a8d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e34192eeaeb246a790a18368773bbe15, e5d4c60ba4c64aa78850cf308be78a8d; no voters: 
I20260709 13:03:44.754977 18702 raft_consensus.cc:2804] T f5116788673d45ad9561408373f762a5 P e5d4c60ba4c64aa78850cf308be78a8d [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:03:44.755476 18702 raft_consensus.cc:697] T f5116788673d45ad9561408373f762a5 P e5d4c60ba4c64aa78850cf308be78a8d [term 2 LEADER]: Becoming Leader. State: Replica: e5d4c60ba4c64aa78850cf308be78a8d, State: Running, Role: LEADER
I20260709 13:03:44.756266 18702 consensus_queue.cc:237] T f5116788673d45ad9561408373f762a5 P e5d4c60ba4c64aa78850cf308be78a8d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ba6d37b4c6344ec882213fb72cc10a3" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 33623 } } peers { permanent_uuid: "e5d4c60ba4c64aa78850cf308be78a8d" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 37301 } } peers { permanent_uuid: "e34192eeaeb246a790a18368773bbe15" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 42349 } }
I20260709 13:03:44.759361 18435 raft_consensus.cc:2468] T f5116788673d45ad9561408373f762a5 P 6ba6d37b4c6344ec882213fb72cc10a3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e5d4c60ba4c64aa78850cf308be78a8d in term 2.
I20260709 13:03:44.764384 18330 catalog_manager.cc:5697] T f5116788673d45ad9561408373f762a5 P e5d4c60ba4c64aa78850cf308be78a8d reported cstate change: term changed from 1 to 2, leader changed from 6ba6d37b4c6344ec882213fb72cc10a3 (127.17.223.1) to e5d4c60ba4c64aa78850cf308be78a8d (127.17.223.2). New cstate: current_term: 2 leader_uuid: "e5d4c60ba4c64aa78850cf308be78a8d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ba6d37b4c6344ec882213fb72cc10a3" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 33623 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e5d4c60ba4c64aa78850cf308be78a8d" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 37301 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e34192eeaeb246a790a18368773bbe15" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 42349 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:44.765419 18330 catalog_manager.cc:5697] T 476ca419566a4bc1883e94647b632918 P e5d4c60ba4c64aa78850cf308be78a8d reported cstate change: term changed from 1 to 2, leader changed from e34192eeaeb246a790a18368773bbe15 (127.17.223.3) to e5d4c60ba4c64aa78850cf308be78a8d (127.17.223.2). New cstate: current_term: 2 leader_uuid: "e5d4c60ba4c64aa78850cf308be78a8d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ba6d37b4c6344ec882213fb72cc10a3" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 33623 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e5d4c60ba4c64aa78850cf308be78a8d" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 37301 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e34192eeaeb246a790a18368773bbe15" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 42349 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:44.786791 18709 consensus_queue.cc:1048] T b68da910d10d4d6a80b0055f7061ad27 P e34192eeaeb246a790a18368773bbe15 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ba6d37b4c6344ec882213fb72cc10a3" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 33623 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:03:44.798236 18634 consensus_queue.cc:1048] T b68da910d10d4d6a80b0055f7061ad27 P e34192eeaeb246a790a18368773bbe15 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5d4c60ba4c64aa78850cf308be78a8d" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 37301 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:03:44.808382 18634 raft_consensus.cc:993] T b68da910d10d4d6a80b0055f7061ad27 P e34192eeaeb246a790a18368773bbe15: : Instructing follower e5d4c60ba4c64aa78850cf308be78a8d to start an election
I20260709 13:03:44.808892 18655 raft_consensus.cc:1081] T b68da910d10d4d6a80b0055f7061ad27 P e34192eeaeb246a790a18368773bbe15 [term 1 LEADER]: Signalling peer e5d4c60ba4c64aa78850cf308be78a8d to start an election
I20260709 13:03:44.810613 18510 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b68da910d10d4d6a80b0055f7061ad27"
dest_uuid: "e5d4c60ba4c64aa78850cf308be78a8d"
 from {username='slave'} at 127.0.0.1:58812
I20260709 13:03:44.811213 18510 raft_consensus.cc:493] T b68da910d10d4d6a80b0055f7061ad27 P e5d4c60ba4c64aa78850cf308be78a8d [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:03:44.811578 18510 raft_consensus.cc:3060] T b68da910d10d4d6a80b0055f7061ad27 P e5d4c60ba4c64aa78850cf308be78a8d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:44.816452 18510 raft_consensus.cc:515] T b68da910d10d4d6a80b0055f7061ad27 P e5d4c60ba4c64aa78850cf308be78a8d [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ba6d37b4c6344ec882213fb72cc10a3" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 33623 } } peers { permanent_uuid: "e5d4c60ba4c64aa78850cf308be78a8d" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 37301 } } peers { permanent_uuid: "e34192eeaeb246a790a18368773bbe15" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 42349 } }
I20260709 13:03:44.819427 18510 leader_election.cc:290] T b68da910d10d4d6a80b0055f7061ad27 P e5d4c60ba4c64aa78850cf308be78a8d [CANDIDATE]: Term 2 election: Requested vote from peers 6ba6d37b4c6344ec882213fb72cc10a3 (127.17.223.1:33623), e34192eeaeb246a790a18368773bbe15 (127.17.223.3:42349)
I20260709 13:03:44.821050 18433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b68da910d10d4d6a80b0055f7061ad27" candidate_uuid: "e5d4c60ba4c64aa78850cf308be78a8d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "6ba6d37b4c6344ec882213fb72cc10a3"
I20260709 13:03:44.821786 18433 raft_consensus.cc:3060] T b68da910d10d4d6a80b0055f7061ad27 P 6ba6d37b4c6344ec882213fb72cc10a3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:44.825584 18582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b68da910d10d4d6a80b0055f7061ad27" candidate_uuid: "e5d4c60ba4c64aa78850cf308be78a8d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e34192eeaeb246a790a18368773bbe15"
I20260709 13:03:44.826249 18582 raft_consensus.cc:3055] T b68da910d10d4d6a80b0055f7061ad27 P e34192eeaeb246a790a18368773bbe15 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:03:44.826640 18582 raft_consensus.cc:740] T b68da910d10d4d6a80b0055f7061ad27 P e34192eeaeb246a790a18368773bbe15 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e34192eeaeb246a790a18368773bbe15, State: Running, Role: LEADER
I20260709 13:03:44.827560 18582 consensus_queue.cc:260] T b68da910d10d4d6a80b0055f7061ad27 P e34192eeaeb246a790a18368773bbe15 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ba6d37b4c6344ec882213fb72cc10a3" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 33623 } } peers { permanent_uuid: "e5d4c60ba4c64aa78850cf308be78a8d" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 37301 } } peers { permanent_uuid: "e34192eeaeb246a790a18368773bbe15" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 42349 } }
I20260709 13:03:44.828959 18582 raft_consensus.cc:3060] T b68da910d10d4d6a80b0055f7061ad27 P e34192eeaeb246a790a18368773bbe15 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:44.829882 18433 raft_consensus.cc:2468] T b68da910d10d4d6a80b0055f7061ad27 P 6ba6d37b4c6344ec882213fb72cc10a3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e5d4c60ba4c64aa78850cf308be78a8d in term 2.
I20260709 13:03:44.831110 18474 leader_election.cc:304] T b68da910d10d4d6a80b0055f7061ad27 P e5d4c60ba4c64aa78850cf308be78a8d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6ba6d37b4c6344ec882213fb72cc10a3, e5d4c60ba4c64aa78850cf308be78a8d; no voters: 
I20260709 13:03:44.831885 18665 raft_consensus.cc:2804] T b68da910d10d4d6a80b0055f7061ad27 P e5d4c60ba4c64aa78850cf308be78a8d [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:03:44.832369 18665 raft_consensus.cc:697] T b68da910d10d4d6a80b0055f7061ad27 P e5d4c60ba4c64aa78850cf308be78a8d [term 2 LEADER]: Becoming Leader. State: Replica: e5d4c60ba4c64aa78850cf308be78a8d, State: Running, Role: LEADER
I20260709 13:03:44.833160 18665 consensus_queue.cc:237] T b68da910d10d4d6a80b0055f7061ad27 P e5d4c60ba4c64aa78850cf308be78a8d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ba6d37b4c6344ec882213fb72cc10a3" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 33623 } } peers { permanent_uuid: "e5d4c60ba4c64aa78850cf308be78a8d" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 37301 } } peers { permanent_uuid: "e34192eeaeb246a790a18368773bbe15" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 42349 } }
I20260709 13:03:44.835201 18582 raft_consensus.cc:2468] T b68da910d10d4d6a80b0055f7061ad27 P e34192eeaeb246a790a18368773bbe15 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e5d4c60ba4c64aa78850cf308be78a8d in term 2.
I20260709 13:03:44.840915 18330 catalog_manager.cc:5697] T b68da910d10d4d6a80b0055f7061ad27 P e5d4c60ba4c64aa78850cf308be78a8d reported cstate change: term changed from 1 to 2, leader changed from e34192eeaeb246a790a18368773bbe15 (127.17.223.3) to e5d4c60ba4c64aa78850cf308be78a8d (127.17.223.2). New cstate: current_term: 2 leader_uuid: "e5d4c60ba4c64aa78850cf308be78a8d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ba6d37b4c6344ec882213fb72cc10a3" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 33623 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e5d4c60ba4c64aa78850cf308be78a8d" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 37301 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e34192eeaeb246a790a18368773bbe15" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 42349 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:44.950100 18582 raft_consensus.cc:3060] T a5d1966171cd4c25a9045a79b6ce1b58 P e34192eeaeb246a790a18368773bbe15 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:44.957134 18582 raft_consensus.cc:1275] T a5d1966171cd4c25a9045a79b6ce1b58 P e34192eeaeb246a790a18368773bbe15 [term 2 FOLLOWER]: Refusing update from remote peer 6ba6d37b4c6344ec882213fb72cc10a3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:03:44.958640 18650 consensus_queue.cc:1048] T a5d1966171cd4c25a9045a79b6ce1b58 P 6ba6d37b4c6344ec882213fb72cc10a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e34192eeaeb246a790a18368773bbe15" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 42349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:03:44.966871 18507 raft_consensus.cc:1275] T a5d1966171cd4c25a9045a79b6ce1b58 P e5d4c60ba4c64aa78850cf308be78a8d [term 2 FOLLOWER]: Refusing update from remote peer 6ba6d37b4c6344ec882213fb72cc10a3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:03:44.968479 18633 consensus_queue.cc:1048] T a5d1966171cd4c25a9045a79b6ce1b58 P 6ba6d37b4c6344ec882213fb72cc10a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5d4c60ba4c64aa78850cf308be78a8d" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 37301 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:03:45.009928 18655 raft_consensus.cc:993] T ba252d6f681a44948699b78102577c8b P e34192eeaeb246a790a18368773bbe15: : Instructing follower e5d4c60ba4c64aa78850cf308be78a8d to start an election
I20260709 13:03:45.010402 18634 raft_consensus.cc:1081] T ba252d6f681a44948699b78102577c8b P e34192eeaeb246a790a18368773bbe15 [term 1 LEADER]: Signalling peer e5d4c60ba4c64aa78850cf308be78a8d to start an election
I20260709 13:03:45.011864 18507 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ba252d6f681a44948699b78102577c8b"
dest_uuid: "e5d4c60ba4c64aa78850cf308be78a8d"
 from {username='slave'} at 127.0.0.1:58812
I20260709 13:03:45.012410 18507 raft_consensus.cc:493] T ba252d6f681a44948699b78102577c8b P e5d4c60ba4c64aa78850cf308be78a8d [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:03:45.012785 18507 raft_consensus.cc:3060] T ba252d6f681a44948699b78102577c8b P e5d4c60ba4c64aa78850cf308be78a8d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:45.019304 18507 raft_consensus.cc:515] T ba252d6f681a44948699b78102577c8b P e5d4c60ba4c64aa78850cf308be78a8d [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ba6d37b4c6344ec882213fb72cc10a3" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 33623 } } peers { permanent_uuid: "e5d4c60ba4c64aa78850cf308be78a8d" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 37301 } } peers { permanent_uuid: "e34192eeaeb246a790a18368773bbe15" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 42349 } }
I20260709 13:03:45.021895 18433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba252d6f681a44948699b78102577c8b" candidate_uuid: "e5d4c60ba4c64aa78850cf308be78a8d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "6ba6d37b4c6344ec882213fb72cc10a3"
I20260709 13:03:45.022439 18433 raft_consensus.cc:3060] T ba252d6f681a44948699b78102577c8b P 6ba6d37b4c6344ec882213fb72cc10a3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:45.022370 18582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba252d6f681a44948699b78102577c8b" candidate_uuid: "e5d4c60ba4c64aa78850cf308be78a8d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e34192eeaeb246a790a18368773bbe15"
I20260709 13:03:45.023134 18582 raft_consensus.cc:3055] T ba252d6f681a44948699b78102577c8b P e34192eeaeb246a790a18368773bbe15 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:03:45.023522 18582 raft_consensus.cc:740] T ba252d6f681a44948699b78102577c8b P e34192eeaeb246a790a18368773bbe15 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e34192eeaeb246a790a18368773bbe15, State: Running, Role: LEADER
I20260709 13:03:45.023674 18507 leader_election.cc:290] T ba252d6f681a44948699b78102577c8b P e5d4c60ba4c64aa78850cf308be78a8d [CANDIDATE]: Term 2 election: Requested vote from peers 6ba6d37b4c6344ec882213fb72cc10a3 (127.17.223.1:33623), e34192eeaeb246a790a18368773bbe15 (127.17.223.3:42349)
I20260709 13:03:45.024561 18582 consensus_queue.cc:260] T ba252d6f681a44948699b78102577c8b P e34192eeaeb246a790a18368773bbe15 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ba6d37b4c6344ec882213fb72cc10a3" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 33623 } } peers { permanent_uuid: "e5d4c60ba4c64aa78850cf308be78a8d" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 37301 } } peers { permanent_uuid: "e34192eeaeb246a790a18368773bbe15" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 42349 } }
I20260709 13:03:45.025533 18582 raft_consensus.cc:3060] T ba252d6f681a44948699b78102577c8b P e34192eeaeb246a790a18368773bbe15 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:45.029171 18433 raft_consensus.cc:2468] T ba252d6f681a44948699b78102577c8b P 6ba6d37b4c6344ec882213fb72cc10a3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e5d4c60ba4c64aa78850cf308be78a8d in term 2.
I20260709 13:03:45.029927 18582 raft_consensus.cc:2468] T ba252d6f681a44948699b78102577c8b P e34192eeaeb246a790a18368773bbe15 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e5d4c60ba4c64aa78850cf308be78a8d in term 2.
I20260709 13:03:45.030339 18474 leader_election.cc:304] T ba252d6f681a44948699b78102577c8b P e5d4c60ba4c64aa78850cf308be78a8d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6ba6d37b4c6344ec882213fb72cc10a3, e5d4c60ba4c64aa78850cf308be78a8d; no voters: 
I20260709 13:03:45.031145 18665 raft_consensus.cc:2804] T ba252d6f681a44948699b78102577c8b P e5d4c60ba4c64aa78850cf308be78a8d [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:03:45.031529 18665 raft_consensus.cc:697] T ba252d6f681a44948699b78102577c8b P e5d4c60ba4c64aa78850cf308be78a8d [term 2 LEADER]: Becoming Leader. State: Replica: e5d4c60ba4c64aa78850cf308be78a8d, State: Running, Role: LEADER
I20260709 13:03:45.032274 18665 consensus_queue.cc:237] T ba252d6f681a44948699b78102577c8b P e5d4c60ba4c64aa78850cf308be78a8d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ba6d37b4c6344ec882213fb72cc10a3" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 33623 } } peers { permanent_uuid: "e5d4c60ba4c64aa78850cf308be78a8d" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 37301 } } peers { permanent_uuid: "e34192eeaeb246a790a18368773bbe15" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 42349 } }
I20260709 13:03:45.038563 18332 catalog_manager.cc:5697] T ba252d6f681a44948699b78102577c8b P e5d4c60ba4c64aa78850cf308be78a8d reported cstate change: term changed from 1 to 2, leader changed from e34192eeaeb246a790a18368773bbe15 (127.17.223.3) to e5d4c60ba4c64aa78850cf308be78a8d (127.17.223.2). New cstate: current_term: 2 leader_uuid: "e5d4c60ba4c64aa78850cf308be78a8d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ba6d37b4c6344ec882213fb72cc10a3" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 33623 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e5d4c60ba4c64aa78850cf308be78a8d" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 37301 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e34192eeaeb246a790a18368773bbe15" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 42349 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:45.153234 18582 raft_consensus.cc:1275] T 5c30ad177b44422f982d86fe00ab6c4a P e34192eeaeb246a790a18368773bbe15 [term 2 FOLLOWER]: Refusing update from remote peer 6ba6d37b4c6344ec882213fb72cc10a3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:03:45.154649 18633 consensus_queue.cc:1048] T 5c30ad177b44422f982d86fe00ab6c4a P 6ba6d37b4c6344ec882213fb72cc10a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e34192eeaeb246a790a18368773bbe15" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 42349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:03:45.162861 18582 raft_consensus.cc:1275] T f5116788673d45ad9561408373f762a5 P e34192eeaeb246a790a18368773bbe15 [term 2 FOLLOWER]: Refusing update from remote peer e5d4c60ba4c64aa78850cf308be78a8d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:03:45.163901 18507 raft_consensus.cc:1275] T 5c30ad177b44422f982d86fe00ab6c4a P e5d4c60ba4c64aa78850cf308be78a8d [term 2 FOLLOWER]: Refusing update from remote peer 6ba6d37b4c6344ec882213fb72cc10a3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:03:45.165282 18665 consensus_queue.cc:1048] T f5116788673d45ad9561408373f762a5 P e5d4c60ba4c64aa78850cf308be78a8d [LEADER]: Connected to new peer: Peer: permanent_uuid: "e34192eeaeb246a790a18368773bbe15" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 42349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:03:45.167532 18633 consensus_queue.cc:1048] T 5c30ad177b44422f982d86fe00ab6c4a P 6ba6d37b4c6344ec882213fb72cc10a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5d4c60ba4c64aa78850cf308be78a8d" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 37301 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:03:45.180063 18433 raft_consensus.cc:1275] T f5116788673d45ad9561408373f762a5 P 6ba6d37b4c6344ec882213fb72cc10a3 [term 2 FOLLOWER]: Refusing update from remote peer e5d4c60ba4c64aa78850cf308be78a8d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:03:45.181977 18665 consensus_queue.cc:1048] T f5116788673d45ad9561408373f762a5 P e5d4c60ba4c64aa78850cf308be78a8d [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ba6d37b4c6344ec882213fb72cc10a3" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 33623 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:03:45.261884 18433 raft_consensus.cc:1275] T b68da910d10d4d6a80b0055f7061ad27 P 6ba6d37b4c6344ec882213fb72cc10a3 [term 2 FOLLOWER]: Refusing update from remote peer e5d4c60ba4c64aa78850cf308be78a8d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:03:45.263343 18665 consensus_queue.cc:1048] T b68da910d10d4d6a80b0055f7061ad27 P e5d4c60ba4c64aa78850cf308be78a8d [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ba6d37b4c6344ec882213fb72cc10a3" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 33623 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:03:45.270824 18584 raft_consensus.cc:1275] T b68da910d10d4d6a80b0055f7061ad27 P e34192eeaeb246a790a18368773bbe15 [term 2 FOLLOWER]: Refusing update from remote peer e5d4c60ba4c64aa78850cf308be78a8d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:03:45.272432 18702 consensus_queue.cc:1048] T b68da910d10d4d6a80b0055f7061ad27 P e5d4c60ba4c64aa78850cf308be78a8d [LEADER]: Connected to new peer: Peer: permanent_uuid: "e34192eeaeb246a790a18368773bbe15" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 42349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:03:45.306607 18433 raft_consensus.cc:1275] T 476ca419566a4bc1883e94647b632918 P 6ba6d37b4c6344ec882213fb72cc10a3 [term 2 FOLLOWER]: Refusing update from remote peer e5d4c60ba4c64aa78850cf308be78a8d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:03:45.307978 18665 consensus_queue.cc:1048] T 476ca419566a4bc1883e94647b632918 P e5d4c60ba4c64aa78850cf308be78a8d [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ba6d37b4c6344ec882213fb72cc10a3" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 33623 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:03:45.316938 18584 raft_consensus.cc:1275] T 476ca419566a4bc1883e94647b632918 P e34192eeaeb246a790a18368773bbe15 [term 2 FOLLOWER]: Refusing update from remote peer e5d4c60ba4c64aa78850cf308be78a8d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:03:45.318953 18665 consensus_queue.cc:1048] T 476ca419566a4bc1883e94647b632918 P e5d4c60ba4c64aa78850cf308be78a8d [LEADER]: Connected to new peer: Peer: permanent_uuid: "e34192eeaeb246a790a18368773bbe15" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 42349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:03:45.435441 18584 raft_consensus.cc:1275] T ba252d6f681a44948699b78102577c8b P e34192eeaeb246a790a18368773bbe15 [term 2 FOLLOWER]: Refusing update from remote peer e5d4c60ba4c64aa78850cf308be78a8d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:03:45.436856 18665 consensus_queue.cc:1048] T ba252d6f681a44948699b78102577c8b P e5d4c60ba4c64aa78850cf308be78a8d [LEADER]: Connected to new peer: Peer: permanent_uuid: "e34192eeaeb246a790a18368773bbe15" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 42349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:03:45.450635 18433 raft_consensus.cc:1275] T ba252d6f681a44948699b78102577c8b P 6ba6d37b4c6344ec882213fb72cc10a3 [term 2 FOLLOWER]: Refusing update from remote peer e5d4c60ba4c64aa78850cf308be78a8d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:03:45.452458 18715 consensus_queue.cc:1048] T ba252d6f681a44948699b78102577c8b P e5d4c60ba4c64aa78850cf308be78a8d [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ba6d37b4c6344ec882213fb72cc10a3" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 33623 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:03:47.544667 18300 auto_leader_rebalancer-test.cc:316] The leader distribution is 
I20260709 13:03:47.545449 18300 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:03:47.560506 18510 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "476ca419566a4bc1883e94647b632918"
dest_uuid: "e5d4c60ba4c64aa78850cf308be78a8d"
mode: GRACEFUL
new_leader_uuid: "e34192eeaeb246a790a18368773bbe15"
 from {username='slave'} at 127.0.0.1:58832
I20260709 13:03:47.560952 18510 raft_consensus.cc:606] T 476ca419566a4bc1883e94647b632918 P e5d4c60ba4c64aa78850cf308be78a8d [term 2 LEADER]: Received request to transfer leadership to TS e34192eeaeb246a790a18368773bbe15
I20260709 13:03:47.570982 18433 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a5d1966171cd4c25a9045a79b6ce1b58"
dest_uuid: "6ba6d37b4c6344ec882213fb72cc10a3"
mode: GRACEFUL
new_leader_uuid: "e34192eeaeb246a790a18368773bbe15"
 from {username='slave'} at 127.0.0.1:50390
I20260709 13:03:47.571602 18433 raft_consensus.cc:606] T a5d1966171cd4c25a9045a79b6ce1b58 P 6ba6d37b4c6344ec882213fb72cc10a3 [term 2 LEADER]: Received request to transfer leadership to TS e34192eeaeb246a790a18368773bbe15
I20260709 13:03:47.572872 18300 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 13:03:47.573488 18300 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:03:47.904536 18633 raft_consensus.cc:993] T a5d1966171cd4c25a9045a79b6ce1b58 P 6ba6d37b4c6344ec882213fb72cc10a3: : Instructing follower e34192eeaeb246a790a18368773bbe15 to start an election
I20260709 13:03:47.905045 18719 raft_consensus.cc:1081] T a5d1966171cd4c25a9045a79b6ce1b58 P 6ba6d37b4c6344ec882213fb72cc10a3 [term 2 LEADER]: Signalling peer e34192eeaeb246a790a18368773bbe15 to start an election
I20260709 13:03:47.906554 18582 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a5d1966171cd4c25a9045a79b6ce1b58"
dest_uuid: "e34192eeaeb246a790a18368773bbe15"
 from {username='slave'} at 127.0.0.1:52578
I20260709 13:03:47.907029 18582 raft_consensus.cc:493] T a5d1966171cd4c25a9045a79b6ce1b58 P e34192eeaeb246a790a18368773bbe15 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:03:47.907279 18582 raft_consensus.cc:3060] T a5d1966171cd4c25a9045a79b6ce1b58 P e34192eeaeb246a790a18368773bbe15 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:03:47.911633 18582 raft_consensus.cc:515] T a5d1966171cd4c25a9045a79b6ce1b58 P e34192eeaeb246a790a18368773bbe15 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ba6d37b4c6344ec882213fb72cc10a3" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 33623 } } peers { permanent_uuid: "e5d4c60ba4c64aa78850cf308be78a8d" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 37301 } } peers { permanent_uuid: "e34192eeaeb246a790a18368773bbe15" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 42349 } }
I20260709 13:03:47.913304 18582 leader_election.cc:290] T a5d1966171cd4c25a9045a79b6ce1b58 P e34192eeaeb246a790a18368773bbe15 [CANDIDATE]: Term 3 election: Requested vote from peers 6ba6d37b4c6344ec882213fb72cc10a3 (127.17.223.1:33623), e5d4c60ba4c64aa78850cf308be78a8d (127.17.223.2:37301)
I20260709 13:03:47.914083 18433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5d1966171cd4c25a9045a79b6ce1b58" candidate_uuid: "e34192eeaeb246a790a18368773bbe15" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "6ba6d37b4c6344ec882213fb72cc10a3"
I20260709 13:03:47.914373 18510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5d1966171cd4c25a9045a79b6ce1b58" candidate_uuid: "e34192eeaeb246a790a18368773bbe15" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "e5d4c60ba4c64aa78850cf308be78a8d"
I20260709 13:03:47.914644 18433 raft_consensus.cc:3055] T a5d1966171cd4c25a9045a79b6ce1b58 P 6ba6d37b4c6344ec882213fb72cc10a3 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:03:47.914955 18510 raft_consensus.cc:3060] T a5d1966171cd4c25a9045a79b6ce1b58 P e5d4c60ba4c64aa78850cf308be78a8d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:03:47.915019 18433 raft_consensus.cc:740] T a5d1966171cd4c25a9045a79b6ce1b58 P 6ba6d37b4c6344ec882213fb72cc10a3 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 6ba6d37b4c6344ec882213fb72cc10a3, State: Running, Role: LEADER
I20260709 13:03:47.915848 18433 consensus_queue.cc:260] T a5d1966171cd4c25a9045a79b6ce1b58 P 6ba6d37b4c6344ec882213fb72cc10a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ba6d37b4c6344ec882213fb72cc10a3" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 33623 } } peers { permanent_uuid: "e5d4c60ba4c64aa78850cf308be78a8d" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 37301 } } peers { permanent_uuid: "e34192eeaeb246a790a18368773bbe15" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 42349 } }
I20260709 13:03:47.916719 18433 raft_consensus.cc:3060] T a5d1966171cd4c25a9045a79b6ce1b58 P 6ba6d37b4c6344ec882213fb72cc10a3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:03:47.919456 18510 raft_consensus.cc:2468] T a5d1966171cd4c25a9045a79b6ce1b58 P e5d4c60ba4c64aa78850cf308be78a8d [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e34192eeaeb246a790a18368773bbe15 in term 3.
I20260709 13:03:47.920490 18549 leader_election.cc:304] T a5d1966171cd4c25a9045a79b6ce1b58 P e34192eeaeb246a790a18368773bbe15 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e34192eeaeb246a790a18368773bbe15, e5d4c60ba4c64aa78850cf308be78a8d; no voters: 
I20260709 13:03:47.921160 18634 raft_consensus.cc:2804] T a5d1966171cd4c25a9045a79b6ce1b58 P e34192eeaeb246a790a18368773bbe15 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:03:47.921073 18433 raft_consensus.cc:2468] T a5d1966171cd4c25a9045a79b6ce1b58 P 6ba6d37b4c6344ec882213fb72cc10a3 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e34192eeaeb246a790a18368773bbe15 in term 3.
I20260709 13:03:47.922346 18634 raft_consensus.cc:697] T a5d1966171cd4c25a9045a79b6ce1b58 P e34192eeaeb246a790a18368773bbe15 [term 3 LEADER]: Becoming Leader. State: Replica: e34192eeaeb246a790a18368773bbe15, State: Running, Role: LEADER
I20260709 13:03:47.923197 18634 consensus_queue.cc:237] T a5d1966171cd4c25a9045a79b6ce1b58 P e34192eeaeb246a790a18368773bbe15 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ba6d37b4c6344ec882213fb72cc10a3" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 33623 } } peers { permanent_uuid: "e5d4c60ba4c64aa78850cf308be78a8d" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 37301 } } peers { permanent_uuid: "e34192eeaeb246a790a18368773bbe15" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 42349 } }
I20260709 13:03:47.931915 18332 catalog_manager.cc:5697] T a5d1966171cd4c25a9045a79b6ce1b58 P e34192eeaeb246a790a18368773bbe15 reported cstate change: term changed from 2 to 3, leader changed from 6ba6d37b4c6344ec882213fb72cc10a3 (127.17.223.1) to e34192eeaeb246a790a18368773bbe15 (127.17.223.3). New cstate: current_term: 3 leader_uuid: "e34192eeaeb246a790a18368773bbe15" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ba6d37b4c6344ec882213fb72cc10a3" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 33623 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e5d4c60ba4c64aa78850cf308be78a8d" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 37301 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e34192eeaeb246a790a18368773bbe15" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 42349 } health_report { overall_health: HEALTHY } } }
I20260709 13:03:47.995738 18718 raft_consensus.cc:993] T 476ca419566a4bc1883e94647b632918 P e5d4c60ba4c64aa78850cf308be78a8d: : Instructing follower e34192eeaeb246a790a18368773bbe15 to start an election
I20260709 13:03:47.996176 18729 raft_consensus.cc:1081] T 476ca419566a4bc1883e94647b632918 P e5d4c60ba4c64aa78850cf308be78a8d [term 2 LEADER]: Signalling peer e34192eeaeb246a790a18368773bbe15 to start an election
I20260709 13:03:47.997587 18582 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "476ca419566a4bc1883e94647b632918"
dest_uuid: "e34192eeaeb246a790a18368773bbe15"
 from {username='slave'} at 127.0.0.1:52586
I20260709 13:03:47.998067 18582 raft_consensus.cc:493] T 476ca419566a4bc1883e94647b632918 P e34192eeaeb246a790a18368773bbe15 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:03:47.998369 18582 raft_consensus.cc:3060] T 476ca419566a4bc1883e94647b632918 P e34192eeaeb246a790a18368773bbe15 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:03:48.002921 18582 raft_consensus.cc:515] T 476ca419566a4bc1883e94647b632918 P e34192eeaeb246a790a18368773bbe15 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ba6d37b4c6344ec882213fb72cc10a3" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 33623 } } peers { permanent_uuid: "e5d4c60ba4c64aa78850cf308be78a8d" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 37301 } } peers { permanent_uuid: "e34192eeaeb246a790a18368773bbe15" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 42349 } }
I20260709 13:03:48.004503 18582 leader_election.cc:290] T 476ca419566a4bc1883e94647b632918 P e34192eeaeb246a790a18368773bbe15 [CANDIDATE]: Term 3 election: Requested vote from peers 6ba6d37b4c6344ec882213fb72cc10a3 (127.17.223.1:33623), e5d4c60ba4c64aa78850cf308be78a8d (127.17.223.2:37301)
I20260709 13:03:48.005621 18510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "476ca419566a4bc1883e94647b632918" candidate_uuid: "e34192eeaeb246a790a18368773bbe15" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "e5d4c60ba4c64aa78850cf308be78a8d"
I20260709 13:03:48.005548 18433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "476ca419566a4bc1883e94647b632918" candidate_uuid: "e34192eeaeb246a790a18368773bbe15" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "6ba6d37b4c6344ec882213fb72cc10a3"
I20260709 13:03:48.006233 18510 raft_consensus.cc:3055] T 476ca419566a4bc1883e94647b632918 P e5d4c60ba4c64aa78850cf308be78a8d [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:03:48.006304 18433 raft_consensus.cc:3060] T 476ca419566a4bc1883e94647b632918 P 6ba6d37b4c6344ec882213fb72cc10a3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:03:48.006708 18510 raft_consensus.cc:740] T 476ca419566a4bc1883e94647b632918 P e5d4c60ba4c64aa78850cf308be78a8d [term 2 LEADER]: Becoming Follower/Learner. State: Replica: e5d4c60ba4c64aa78850cf308be78a8d, State: Running, Role: LEADER
I20260709 13:03:48.007508 18510 consensus_queue.cc:260] T 476ca419566a4bc1883e94647b632918 P e5d4c60ba4c64aa78850cf308be78a8d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ba6d37b4c6344ec882213fb72cc10a3" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 33623 } } peers { permanent_uuid: "e5d4c60ba4c64aa78850cf308be78a8d" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 37301 } } peers { permanent_uuid: "e34192eeaeb246a790a18368773bbe15" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 42349 } }
I20260709 13:03:48.008687 18510 raft_consensus.cc:3060] T 476ca419566a4bc1883e94647b632918 P e5d4c60ba4c64aa78850cf308be78a8d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:03:48.013151 18433 raft_consensus.cc:2468] T 476ca419566a4bc1883e94647b632918 P 6ba6d37b4c6344ec882213fb72cc10a3 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e34192eeaeb246a790a18368773bbe15 in term 3.
I20260709 13:03:48.014457 18548 leader_election.cc:304] T 476ca419566a4bc1883e94647b632918 P e34192eeaeb246a790a18368773bbe15 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6ba6d37b4c6344ec882213fb72cc10a3, e34192eeaeb246a790a18368773bbe15; no voters: 
I20260709 13:03:48.014842 18510 raft_consensus.cc:2468] T 476ca419566a4bc1883e94647b632918 P e5d4c60ba4c64aa78850cf308be78a8d [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e34192eeaeb246a790a18368773bbe15 in term 3.
I20260709 13:03:48.015223 18634 raft_consensus.cc:2804] T 476ca419566a4bc1883e94647b632918 P e34192eeaeb246a790a18368773bbe15 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:03:48.015708 18634 raft_consensus.cc:697] T 476ca419566a4bc1883e94647b632918 P e34192eeaeb246a790a18368773bbe15 [term 3 LEADER]: Becoming Leader. State: Replica: e34192eeaeb246a790a18368773bbe15, State: Running, Role: LEADER
I20260709 13:03:48.016460 18634 consensus_queue.cc:237] T 476ca419566a4bc1883e94647b632918 P e34192eeaeb246a790a18368773bbe15 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ba6d37b4c6344ec882213fb72cc10a3" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 33623 } } peers { permanent_uuid: "e5d4c60ba4c64aa78850cf308be78a8d" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 37301 } } peers { permanent_uuid: "e34192eeaeb246a790a18368773bbe15" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 42349 } }
I20260709 13:03:48.024035 18332 catalog_manager.cc:5697] T 476ca419566a4bc1883e94647b632918 P e34192eeaeb246a790a18368773bbe15 reported cstate change: term changed from 2 to 3, leader changed from e5d4c60ba4c64aa78850cf308be78a8d (127.17.223.2) to e34192eeaeb246a790a18368773bbe15 (127.17.223.3). New cstate: current_term: 3 leader_uuid: "e34192eeaeb246a790a18368773bbe15" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ba6d37b4c6344ec882213fb72cc10a3" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 33623 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e5d4c60ba4c64aa78850cf308be78a8d" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 37301 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e34192eeaeb246a790a18368773bbe15" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 42349 } health_report { overall_health: HEALTHY } } }
I20260709 13:03:48.333755 18433 raft_consensus.cc:1275] T a5d1966171cd4c25a9045a79b6ce1b58 P 6ba6d37b4c6344ec882213fb72cc10a3 [term 3 FOLLOWER]: Refusing update from remote peer e34192eeaeb246a790a18368773bbe15: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:03:48.334967 18634 consensus_queue.cc:1048] T a5d1966171cd4c25a9045a79b6ce1b58 P e34192eeaeb246a790a18368773bbe15 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ba6d37b4c6344ec882213fb72cc10a3" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 33623 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:03:48.344518 18510 raft_consensus.cc:1275] T a5d1966171cd4c25a9045a79b6ce1b58 P e5d4c60ba4c64aa78850cf308be78a8d [term 3 FOLLOWER]: Refusing update from remote peer e34192eeaeb246a790a18368773bbe15: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:03:48.345878 18634 consensus_queue.cc:1048] T a5d1966171cd4c25a9045a79b6ce1b58 P e34192eeaeb246a790a18368773bbe15 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5d4c60ba4c64aa78850cf308be78a8d" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 37301 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:03:48.425588 18433 raft_consensus.cc:1275] T 476ca419566a4bc1883e94647b632918 P 6ba6d37b4c6344ec882213fb72cc10a3 [term 3 FOLLOWER]: Refusing update from remote peer e34192eeaeb246a790a18368773bbe15: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:03:48.426785 18634 consensus_queue.cc:1048] T 476ca419566a4bc1883e94647b632918 P e34192eeaeb246a790a18368773bbe15 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ba6d37b4c6344ec882213fb72cc10a3" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 33623 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:03:48.435861 18510 raft_consensus.cc:1275] T 476ca419566a4bc1883e94647b632918 P e5d4c60ba4c64aa78850cf308be78a8d [term 3 FOLLOWER]: Refusing update from remote peer e34192eeaeb246a790a18368773bbe15: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:03:48.437251 18723 consensus_queue.cc:1048] T 476ca419566a4bc1883e94647b632918 P e34192eeaeb246a790a18368773bbe15 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5d4c60ba4c64aa78850cf308be78a8d" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 37301 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:03:48.574337 18300 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:03:48.583846 18433 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5c30ad177b44422f982d86fe00ab6c4a"
dest_uuid: "6ba6d37b4c6344ec882213fb72cc10a3"
mode: GRACEFUL
new_leader_uuid: "e5d4c60ba4c64aa78850cf308be78a8d"
 from {username='slave'} at 127.0.0.1:50382
I20260709 13:03:48.584360 18433 raft_consensus.cc:606] T 5c30ad177b44422f982d86fe00ab6c4a P 6ba6d37b4c6344ec882213fb72cc10a3 [term 2 LEADER]: Received request to transfer leadership to TS e5d4c60ba4c64aa78850cf308be78a8d
I20260709 13:03:48.588760 18433 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "24b316d8ce55441ea9cf056818fd658a"
dest_uuid: "6ba6d37b4c6344ec882213fb72cc10a3"
mode: GRACEFUL
new_leader_uuid: "e5d4c60ba4c64aa78850cf308be78a8d"
 from {username='slave'} at 127.0.0.1:50382
I20260709 13:03:48.589234 18433 raft_consensus.cc:606] T 24b316d8ce55441ea9cf056818fd658a P 6ba6d37b4c6344ec882213fb72cc10a3 [term 1 LEADER]: Received request to transfer leadership to TS e5d4c60ba4c64aa78850cf308be78a8d
I20260709 13:03:48.593588 18433 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a9e6e2dfc9624bbb887e108176acff29"
dest_uuid: "6ba6d37b4c6344ec882213fb72cc10a3"
mode: GRACEFUL
new_leader_uuid: "e5d4c60ba4c64aa78850cf308be78a8d"
 from {username='slave'} at 127.0.0.1:50382
I20260709 13:03:48.594062 18433 raft_consensus.cc:606] T a9e6e2dfc9624bbb887e108176acff29 P 6ba6d37b4c6344ec882213fb72cc10a3 [term 1 LEADER]: Received request to transfer leadership to TS e5d4c60ba4c64aa78850cf308be78a8d
I20260709 13:03:48.598187 18582 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a5d1966171cd4c25a9045a79b6ce1b58"
dest_uuid: "e34192eeaeb246a790a18368773bbe15"
mode: GRACEFUL
new_leader_uuid: "e5d4c60ba4c64aa78850cf308be78a8d"
 from {username='slave'} at 127.0.0.1:52594
I20260709 13:03:48.598613 18582 raft_consensus.cc:606] T a5d1966171cd4c25a9045a79b6ce1b58 P e34192eeaeb246a790a18368773bbe15 [term 3 LEADER]: Received request to transfer leadership to TS e5d4c60ba4c64aa78850cf308be78a8d
I20260709 13:03:48.605388 18582 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "476ca419566a4bc1883e94647b632918"
dest_uuid: "e34192eeaeb246a790a18368773bbe15"
mode: GRACEFUL
new_leader_uuid: "e5d4c60ba4c64aa78850cf308be78a8d"
 from {username='slave'} at 127.0.0.1:52594
I20260709 13:03:48.605813 18582 raft_consensus.cc:606] T 476ca419566a4bc1883e94647b632918 P e34192eeaeb246a790a18368773bbe15 [term 3 LEADER]: Received request to transfer leadership to TS e5d4c60ba4c64aa78850cf308be78a8d
I20260709 13:03:48.700685 18719 raft_consensus.cc:993] T 5c30ad177b44422f982d86fe00ab6c4a P 6ba6d37b4c6344ec882213fb72cc10a3: : Instructing follower e5d4c60ba4c64aa78850cf308be78a8d to start an election
I20260709 13:03:48.701097 18739 raft_consensus.cc:1081] T 5c30ad177b44422f982d86fe00ab6c4a P 6ba6d37b4c6344ec882213fb72cc10a3 [term 2 LEADER]: Signalling peer e5d4c60ba4c64aa78850cf308be78a8d to start an election
I20260709 13:03:48.702490 18510 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "5c30ad177b44422f982d86fe00ab6c4a"
dest_uuid: "e5d4c60ba4c64aa78850cf308be78a8d"
 from {username='slave'} at 127.0.0.1:58808
I20260709 13:03:48.702996 18510 raft_consensus.cc:493] T 5c30ad177b44422f982d86fe00ab6c4a P e5d4c60ba4c64aa78850cf308be78a8d [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:03:48.703266 18510 raft_consensus.cc:3060] T 5c30ad177b44422f982d86fe00ab6c4a P e5d4c60ba4c64aa78850cf308be78a8d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:03:48.707825 18510 raft_consensus.cc:515] T 5c30ad177b44422f982d86fe00ab6c4a P e5d4c60ba4c64aa78850cf308be78a8d [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5d4c60ba4c64aa78850cf308be78a8d" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 37301 } } peers { permanent_uuid: "6ba6d37b4c6344ec882213fb72cc10a3" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 33623 } } peers { permanent_uuid: "e34192eeaeb246a790a18368773bbe15" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 42349 } }
I20260709 13:03:48.709283 18510 leader_election.cc:290] T 5c30ad177b44422f982d86fe00ab6c4a P e5d4c60ba4c64aa78850cf308be78a8d [CANDIDATE]: Term 3 election: Requested vote from peers 6ba6d37b4c6344ec882213fb72cc10a3 (127.17.223.1:33623), e34192eeaeb246a790a18368773bbe15 (127.17.223.3:42349)
I20260709 13:03:48.710294 18433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c30ad177b44422f982d86fe00ab6c4a" candidate_uuid: "e5d4c60ba4c64aa78850cf308be78a8d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "6ba6d37b4c6344ec882213fb72cc10a3"
I20260709 13:03:48.710458 18582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c30ad177b44422f982d86fe00ab6c4a" candidate_uuid: "e5d4c60ba4c64aa78850cf308be78a8d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "e34192eeaeb246a790a18368773bbe15"
I20260709 13:03:48.710909 18433 raft_consensus.cc:3055] T 5c30ad177b44422f982d86fe00ab6c4a P 6ba6d37b4c6344ec882213fb72cc10a3 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:03:48.711077 18582 raft_consensus.cc:3060] T 5c30ad177b44422f982d86fe00ab6c4a P e34192eeaeb246a790a18368773bbe15 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:03:48.711288 18433 raft_consensus.cc:740] T 5c30ad177b44422f982d86fe00ab6c4a P 6ba6d37b4c6344ec882213fb72cc10a3 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 6ba6d37b4c6344ec882213fb72cc10a3, State: Running, Role: LEADER
I20260709 13:03:48.712132 18433 consensus_queue.cc:260] T 5c30ad177b44422f982d86fe00ab6c4a P 6ba6d37b4c6344ec882213fb72cc10a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5d4c60ba4c64aa78850cf308be78a8d" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 37301 } } peers { permanent_uuid: "6ba6d37b4c6344ec882213fb72cc10a3" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 33623 } } peers { permanent_uuid: "e34192eeaeb246a790a18368773bbe15" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 42349 } }
I20260709 13:03:48.713071 18433 raft_consensus.cc:3060] T 5c30ad177b44422f982d86fe00ab6c4a P 6ba6d37b4c6344ec882213fb72cc10a3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:03:48.715677 18582 raft_consensus.cc:2468] T 5c30ad177b44422f982d86fe00ab6c4a P e34192eeaeb246a790a18368773bbe15 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e5d4c60ba4c64aa78850cf308be78a8d in term 3.
I20260709 13:03:48.716719 18476 leader_election.cc:304] T 5c30ad177b44422f982d86fe00ab6c4a P e5d4c60ba4c64aa78850cf308be78a8d [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e34192eeaeb246a790a18368773bbe15, e5d4c60ba4c64aa78850cf308be78a8d; no voters: 
I20260709 13:03:48.717518 18729 raft_consensus.cc:2804] T 5c30ad177b44422f982d86fe00ab6c4a P e5d4c60ba4c64aa78850cf308be78a8d [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:03:48.718137 18433 raft_consensus.cc:2468] T 5c30ad177b44422f982d86fe00ab6c4a P 6ba6d37b4c6344ec882213fb72cc10a3 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e5d4c60ba4c64aa78850cf308be78a8d in term 3.
I20260709 13:03:48.718434 18729 raft_consensus.cc:697] T 5c30ad177b44422f982d86fe00ab6c4a P e5d4c60ba4c64aa78850cf308be78a8d [term 3 LEADER]: Becoming Leader. State: Replica: e5d4c60ba4c64aa78850cf308be78a8d, State: Running, Role: LEADER
I20260709 13:03:48.719355 18729 consensus_queue.cc:237] T 5c30ad177b44422f982d86fe00ab6c4a P e5d4c60ba4c64aa78850cf308be78a8d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5d4c60ba4c64aa78850cf308be78a8d" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 37301 } } peers { permanent_uuid: "6ba6d37b4c6344ec882213fb72cc10a3" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 33623 } } peers { permanent_uuid: "e34192eeaeb246a790a18368773bbe15" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 42349 } }
I20260709 13:03:48.725135 18332 catalog_manager.cc:5697] T 5c30ad177b44422f982d86fe00ab6c4a P e5d4c60ba4c64aa78850cf308be78a8d reported cstate change: term changed from 2 to 3, leader changed from 6ba6d37b4c6344ec882213fb72cc10a3 (127.17.223.1) to e5d4c60ba4c64aa78850cf308be78a8d (127.17.223.2). New cstate: current_term: 3 leader_uuid: "e5d4c60ba4c64aa78850cf308be78a8d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5d4c60ba4c64aa78850cf308be78a8d" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 37301 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6ba6d37b4c6344ec882213fb72cc10a3" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 33623 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e34192eeaeb246a790a18368773bbe15" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 42349 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:48.741216 18634 raft_consensus.cc:993] T a5d1966171cd4c25a9045a79b6ce1b58 P e34192eeaeb246a790a18368773bbe15: : Instructing follower e5d4c60ba4c64aa78850cf308be78a8d to start an election
I20260709 13:03:48.741675 18723 raft_consensus.cc:1081] T a5d1966171cd4c25a9045a79b6ce1b58 P e34192eeaeb246a790a18368773bbe15 [term 3 LEADER]: Signalling peer e5d4c60ba4c64aa78850cf308be78a8d to start an election
I20260709 13:03:48.743304 18510 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a5d1966171cd4c25a9045a79b6ce1b58"
dest_uuid: "e5d4c60ba4c64aa78850cf308be78a8d"
 from {username='slave'} at 127.0.0.1:58812
I20260709 13:03:48.743767 18510 raft_consensus.cc:493] T a5d1966171cd4c25a9045a79b6ce1b58 P e5d4c60ba4c64aa78850cf308be78a8d [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:03:48.744042 18510 raft_consensus.cc:3060] T a5d1966171cd4c25a9045a79b6ce1b58 P e5d4c60ba4c64aa78850cf308be78a8d [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:03:48.747835 18510 raft_consensus.cc:515] T a5d1966171cd4c25a9045a79b6ce1b58 P e5d4c60ba4c64aa78850cf308be78a8d [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ba6d37b4c6344ec882213fb72cc10a3" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 33623 } } peers { permanent_uuid: "e5d4c60ba4c64aa78850cf308be78a8d" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 37301 } } peers { permanent_uuid: "e34192eeaeb246a790a18368773bbe15" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 42349 } }
I20260709 13:03:48.749240 18510 leader_election.cc:290] T a5d1966171cd4c25a9045a79b6ce1b58 P e5d4c60ba4c64aa78850cf308be78a8d [CANDIDATE]: Term 4 election: Requested vote from peers 6ba6d37b4c6344ec882213fb72cc10a3 (127.17.223.1:33623), e34192eeaeb246a790a18368773bbe15 (127.17.223.3:42349)
I20260709 13:03:48.750283 18582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5d1966171cd4c25a9045a79b6ce1b58" candidate_uuid: "e5d4c60ba4c64aa78850cf308be78a8d" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "e34192eeaeb246a790a18368773bbe15"
I20260709 13:03:48.750283 18433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5d1966171cd4c25a9045a79b6ce1b58" candidate_uuid: "e5d4c60ba4c64aa78850cf308be78a8d" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "6ba6d37b4c6344ec882213fb72cc10a3"
I20260709 13:03:48.751240 18433 raft_consensus.cc:3060] T a5d1966171cd4c25a9045a79b6ce1b58 P 6ba6d37b4c6344ec882213fb72cc10a3 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:03:48.751220 18582 raft_consensus.cc:3055] T a5d1966171cd4c25a9045a79b6ce1b58 P e34192eeaeb246a790a18368773bbe15 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:03:48.751942 18582 raft_consensus.cc:740] T a5d1966171cd4c25a9045a79b6ce1b58 P e34192eeaeb246a790a18368773bbe15 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: e34192eeaeb246a790a18368773bbe15, State: Running, Role: LEADER
I20260709 13:03:48.752804 18582 consensus_queue.cc:260] T a5d1966171cd4c25a9045a79b6ce1b58 P e34192eeaeb246a790a18368773bbe15 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ba6d37b4c6344ec882213fb72cc10a3" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 33623 } } peers { permanent_uuid: "e5d4c60ba4c64aa78850cf308be78a8d" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 37301 } } peers { permanent_uuid: "e34192eeaeb246a790a18368773bbe15" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 42349 } }
I20260709 13:03:48.753976 18582 raft_consensus.cc:3060] T a5d1966171cd4c25a9045a79b6ce1b58 P e34192eeaeb246a790a18368773bbe15 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:03:48.758104 18433 raft_consensus.cc:2468] T a5d1966171cd4c25a9045a79b6ce1b58 P 6ba6d37b4c6344ec882213fb72cc10a3 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e5d4c60ba4c64aa78850cf308be78a8d in term 4.
I20260709 13:03:48.759229 18474 leader_election.cc:304] T a5d1966171cd4c25a9045a79b6ce1b58 P e5d4c60ba4c64aa78850cf308be78a8d [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6ba6d37b4c6344ec882213fb72cc10a3, e5d4c60ba4c64aa78850cf308be78a8d; no voters: 
I20260709 13:03:48.759898 18729 raft_consensus.cc:2804] T a5d1966171cd4c25a9045a79b6ce1b58 P e5d4c60ba4c64aa78850cf308be78a8d [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:03:48.760142 18582 raft_consensus.cc:2468] T a5d1966171cd4c25a9045a79b6ce1b58 P e34192eeaeb246a790a18368773bbe15 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e5d4c60ba4c64aa78850cf308be78a8d in term 4.
I20260709 13:03:48.760381 18729 raft_consensus.cc:697] T a5d1966171cd4c25a9045a79b6ce1b58 P e5d4c60ba4c64aa78850cf308be78a8d [term 4 LEADER]: Becoming Leader. State: Replica: e5d4c60ba4c64aa78850cf308be78a8d, State: Running, Role: LEADER
I20260709 13:03:48.761194 18729 consensus_queue.cc:237] T a5d1966171cd4c25a9045a79b6ce1b58 P e5d4c60ba4c64aa78850cf308be78a8d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ba6d37b4c6344ec882213fb72cc10a3" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 33623 } } peers { permanent_uuid: "e5d4c60ba4c64aa78850cf308be78a8d" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 37301 } } peers { permanent_uuid: "e34192eeaeb246a790a18368773bbe15" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 42349 } }
I20260709 13:03:48.766882 18332 catalog_manager.cc:5697] T a5d1966171cd4c25a9045a79b6ce1b58 P e5d4c60ba4c64aa78850cf308be78a8d reported cstate change: term changed from 3 to 4, leader changed from e34192eeaeb246a790a18368773bbe15 (127.17.223.3) to e5d4c60ba4c64aa78850cf308be78a8d (127.17.223.2). New cstate: current_term: 4 leader_uuid: "e5d4c60ba4c64aa78850cf308be78a8d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ba6d37b4c6344ec882213fb72cc10a3" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 33623 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e5d4c60ba4c64aa78850cf308be78a8d" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 37301 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e34192eeaeb246a790a18368773bbe15" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 42349 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:48.828440 18719 raft_consensus.cc:993] T a9e6e2dfc9624bbb887e108176acff29 P 6ba6d37b4c6344ec882213fb72cc10a3: : Instructing follower e5d4c60ba4c64aa78850cf308be78a8d to start an election
I20260709 13:03:48.828900 18739 raft_consensus.cc:1081] T a9e6e2dfc9624bbb887e108176acff29 P 6ba6d37b4c6344ec882213fb72cc10a3 [term 1 LEADER]: Signalling peer e5d4c60ba4c64aa78850cf308be78a8d to start an election
I20260709 13:03:48.830199 18510 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a9e6e2dfc9624bbb887e108176acff29"
dest_uuid: "e5d4c60ba4c64aa78850cf308be78a8d"
 from {username='slave'} at 127.0.0.1:58808
I20260709 13:03:48.830618 18510 raft_consensus.cc:493] T a9e6e2dfc9624bbb887e108176acff29 P e5d4c60ba4c64aa78850cf308be78a8d [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:03:48.830894 18510 raft_consensus.cc:3060] T a9e6e2dfc9624bbb887e108176acff29 P e5d4c60ba4c64aa78850cf308be78a8d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:48.834597 18510 raft_consensus.cc:515] T a9e6e2dfc9624bbb887e108176acff29 P e5d4c60ba4c64aa78850cf308be78a8d [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ba6d37b4c6344ec882213fb72cc10a3" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 33623 } } peers { permanent_uuid: "e5d4c60ba4c64aa78850cf308be78a8d" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 37301 } } peers { permanent_uuid: "e34192eeaeb246a790a18368773bbe15" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 42349 } }
I20260709 13:03:48.835911 18510 leader_election.cc:290] T a9e6e2dfc9624bbb887e108176acff29 P e5d4c60ba4c64aa78850cf308be78a8d [CANDIDATE]: Term 2 election: Requested vote from peers 6ba6d37b4c6344ec882213fb72cc10a3 (127.17.223.1:33623), e34192eeaeb246a790a18368773bbe15 (127.17.223.3:42349)
I20260709 13:03:48.836709 18433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9e6e2dfc9624bbb887e108176acff29" candidate_uuid: "e5d4c60ba4c64aa78850cf308be78a8d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "6ba6d37b4c6344ec882213fb72cc10a3"
I20260709 13:03:48.836915 18582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9e6e2dfc9624bbb887e108176acff29" candidate_uuid: "e5d4c60ba4c64aa78850cf308be78a8d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e34192eeaeb246a790a18368773bbe15"
I20260709 13:03:48.837168 18433 raft_consensus.cc:3055] T a9e6e2dfc9624bbb887e108176acff29 P 6ba6d37b4c6344ec882213fb72cc10a3 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:03:48.837463 18433 raft_consensus.cc:740] T a9e6e2dfc9624bbb887e108176acff29 P 6ba6d37b4c6344ec882213fb72cc10a3 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 6ba6d37b4c6344ec882213fb72cc10a3, State: Running, Role: LEADER
I20260709 13:03:48.837438 18582 raft_consensus.cc:3060] T a9e6e2dfc9624bbb887e108176acff29 P e34192eeaeb246a790a18368773bbe15 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:48.838233 18433 consensus_queue.cc:260] T a9e6e2dfc9624bbb887e108176acff29 P 6ba6d37b4c6344ec882213fb72cc10a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ba6d37b4c6344ec882213fb72cc10a3" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 33623 } } peers { permanent_uuid: "e5d4c60ba4c64aa78850cf308be78a8d" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 37301 } } peers { permanent_uuid: "e34192eeaeb246a790a18368773bbe15" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 42349 } }
I20260709 13:03:48.839035 18433 raft_consensus.cc:3060] T a9e6e2dfc9624bbb887e108176acff29 P 6ba6d37b4c6344ec882213fb72cc10a3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:48.841924 18582 raft_consensus.cc:2468] T a9e6e2dfc9624bbb887e108176acff29 P e34192eeaeb246a790a18368773bbe15 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e5d4c60ba4c64aa78850cf308be78a8d in term 2.
I20260709 13:03:48.842566 18433 raft_consensus.cc:2468] T a9e6e2dfc9624bbb887e108176acff29 P 6ba6d37b4c6344ec882213fb72cc10a3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e5d4c60ba4c64aa78850cf308be78a8d in term 2.
I20260709 13:03:48.842864 18476 leader_election.cc:304] T a9e6e2dfc9624bbb887e108176acff29 P e5d4c60ba4c64aa78850cf308be78a8d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e34192eeaeb246a790a18368773bbe15, e5d4c60ba4c64aa78850cf308be78a8d; no voters: 
I20260709 13:03:48.843559 18729 raft_consensus.cc:2804] T a9e6e2dfc9624bbb887e108176acff29 P e5d4c60ba4c64aa78850cf308be78a8d [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:03:48.843927 18729 raft_consensus.cc:697] T a9e6e2dfc9624bbb887e108176acff29 P e5d4c60ba4c64aa78850cf308be78a8d [term 2 LEADER]: Becoming Leader. State: Replica: e5d4c60ba4c64aa78850cf308be78a8d, State: Running, Role: LEADER
I20260709 13:03:48.844653 18729 consensus_queue.cc:237] T a9e6e2dfc9624bbb887e108176acff29 P e5d4c60ba4c64aa78850cf308be78a8d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ba6d37b4c6344ec882213fb72cc10a3" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 33623 } } peers { permanent_uuid: "e5d4c60ba4c64aa78850cf308be78a8d" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 37301 } } peers { permanent_uuid: "e34192eeaeb246a790a18368773bbe15" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 42349 } }
I20260709 13:03:48.851455 18332 catalog_manager.cc:5697] T a9e6e2dfc9624bbb887e108176acff29 P e5d4c60ba4c64aa78850cf308be78a8d reported cstate change: term changed from 1 to 2, leader changed from 6ba6d37b4c6344ec882213fb72cc10a3 (127.17.223.1) to e5d4c60ba4c64aa78850cf308be78a8d (127.17.223.2). New cstate: current_term: 2 leader_uuid: "e5d4c60ba4c64aa78850cf308be78a8d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ba6d37b4c6344ec882213fb72cc10a3" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 33623 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e5d4c60ba4c64aa78850cf308be78a8d" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 37301 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e34192eeaeb246a790a18368773bbe15" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 42349 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:48.986486 18634 raft_consensus.cc:993] T 476ca419566a4bc1883e94647b632918 P e34192eeaeb246a790a18368773bbe15: : Instructing follower e5d4c60ba4c64aa78850cf308be78a8d to start an election
I20260709 13:03:48.986961 18723 raft_consensus.cc:1081] T 476ca419566a4bc1883e94647b632918 P e34192eeaeb246a790a18368773bbe15 [term 3 LEADER]: Signalling peer e5d4c60ba4c64aa78850cf308be78a8d to start an election
I20260709 13:03:48.988437 18510 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "476ca419566a4bc1883e94647b632918"
dest_uuid: "e5d4c60ba4c64aa78850cf308be78a8d"
 from {username='slave'} at 127.0.0.1:58812
I20260709 13:03:48.988862 18510 raft_consensus.cc:493] T 476ca419566a4bc1883e94647b632918 P e5d4c60ba4c64aa78850cf308be78a8d [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:03:48.989161 18510 raft_consensus.cc:3060] T 476ca419566a4bc1883e94647b632918 P e5d4c60ba4c64aa78850cf308be78a8d [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:03:48.992962 18510 raft_consensus.cc:515] T 476ca419566a4bc1883e94647b632918 P e5d4c60ba4c64aa78850cf308be78a8d [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ba6d37b4c6344ec882213fb72cc10a3" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 33623 } } peers { permanent_uuid: "e5d4c60ba4c64aa78850cf308be78a8d" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 37301 } } peers { permanent_uuid: "e34192eeaeb246a790a18368773bbe15" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 42349 } }
I20260709 13:03:48.994288 18510 leader_election.cc:290] T 476ca419566a4bc1883e94647b632918 P e5d4c60ba4c64aa78850cf308be78a8d [CANDIDATE]: Term 4 election: Requested vote from peers 6ba6d37b4c6344ec882213fb72cc10a3 (127.17.223.1:33623), e34192eeaeb246a790a18368773bbe15 (127.17.223.3:42349)
I20260709 13:03:48.995153 18433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "476ca419566a4bc1883e94647b632918" candidate_uuid: "e5d4c60ba4c64aa78850cf308be78a8d" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "6ba6d37b4c6344ec882213fb72cc10a3"
I20260709 13:03:48.995328 18582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "476ca419566a4bc1883e94647b632918" candidate_uuid: "e5d4c60ba4c64aa78850cf308be78a8d" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "e34192eeaeb246a790a18368773bbe15"
I20260709 13:03:48.995736 18433 raft_consensus.cc:3060] T 476ca419566a4bc1883e94647b632918 P 6ba6d37b4c6344ec882213fb72cc10a3 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:03:48.996008 18582 raft_consensus.cc:3055] T 476ca419566a4bc1883e94647b632918 P e34192eeaeb246a790a18368773bbe15 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:03:48.996416 18582 raft_consensus.cc:740] T 476ca419566a4bc1883e94647b632918 P e34192eeaeb246a790a18368773bbe15 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: e34192eeaeb246a790a18368773bbe15, State: Running, Role: LEADER
I20260709 13:03:48.997087 18582 consensus_queue.cc:260] T 476ca419566a4bc1883e94647b632918 P e34192eeaeb246a790a18368773bbe15 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ba6d37b4c6344ec882213fb72cc10a3" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 33623 } } peers { permanent_uuid: "e5d4c60ba4c64aa78850cf308be78a8d" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 37301 } } peers { permanent_uuid: "e34192eeaeb246a790a18368773bbe15" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 42349 } }
I20260709 13:03:48.998121 18582 raft_consensus.cc:3060] T 476ca419566a4bc1883e94647b632918 P e34192eeaeb246a790a18368773bbe15 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:03:48.999958 18433 raft_consensus.cc:2468] T 476ca419566a4bc1883e94647b632918 P 6ba6d37b4c6344ec882213fb72cc10a3 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e5d4c60ba4c64aa78850cf308be78a8d in term 4.
I20260709 13:03:49.000880 18474 leader_election.cc:304] T 476ca419566a4bc1883e94647b632918 P e5d4c60ba4c64aa78850cf308be78a8d [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6ba6d37b4c6344ec882213fb72cc10a3, e5d4c60ba4c64aa78850cf308be78a8d; no voters: 
I20260709 13:03:49.001610 18729 raft_consensus.cc:2804] T 476ca419566a4bc1883e94647b632918 P e5d4c60ba4c64aa78850cf308be78a8d [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:03:49.001973 18729 raft_consensus.cc:697] T 476ca419566a4bc1883e94647b632918 P e5d4c60ba4c64aa78850cf308be78a8d [term 4 LEADER]: Becoming Leader. State: Replica: e5d4c60ba4c64aa78850cf308be78a8d, State: Running, Role: LEADER
I20260709 13:03:49.002657 18729 consensus_queue.cc:237] T 476ca419566a4bc1883e94647b632918 P e5d4c60ba4c64aa78850cf308be78a8d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ba6d37b4c6344ec882213fb72cc10a3" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 33623 } } peers { permanent_uuid: "e5d4c60ba4c64aa78850cf308be78a8d" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 37301 } } peers { permanent_uuid: "e34192eeaeb246a790a18368773bbe15" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 42349 } }
I20260709 13:03:49.002980 18582 raft_consensus.cc:2468] T 476ca419566a4bc1883e94647b632918 P e34192eeaeb246a790a18368773bbe15 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e5d4c60ba4c64aa78850cf308be78a8d in term 4.
I20260709 13:03:49.008356 18332 catalog_manager.cc:5697] T 476ca419566a4bc1883e94647b632918 P e5d4c60ba4c64aa78850cf308be78a8d reported cstate change: term changed from 3 to 4, leader changed from e34192eeaeb246a790a18368773bbe15 (127.17.223.3) to e5d4c60ba4c64aa78850cf308be78a8d (127.17.223.2). New cstate: current_term: 4 leader_uuid: "e5d4c60ba4c64aa78850cf308be78a8d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ba6d37b4c6344ec882213fb72cc10a3" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 33623 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e5d4c60ba4c64aa78850cf308be78a8d" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 37301 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e34192eeaeb246a790a18368773bbe15" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 42349 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:49.105768 18719 raft_consensus.cc:993] T 24b316d8ce55441ea9cf056818fd658a P 6ba6d37b4c6344ec882213fb72cc10a3: : Instructing follower e5d4c60ba4c64aa78850cf308be78a8d to start an election
I20260709 13:03:49.106200 18739 raft_consensus.cc:1081] T 24b316d8ce55441ea9cf056818fd658a P 6ba6d37b4c6344ec882213fb72cc10a3 [term 1 LEADER]: Signalling peer e5d4c60ba4c64aa78850cf308be78a8d to start an election
I20260709 13:03:49.107724 18510 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "24b316d8ce55441ea9cf056818fd658a"
dest_uuid: "e5d4c60ba4c64aa78850cf308be78a8d"
 from {username='slave'} at 127.0.0.1:58808
I20260709 13:03:49.108156 18510 raft_consensus.cc:493] T 24b316d8ce55441ea9cf056818fd658a P e5d4c60ba4c64aa78850cf308be78a8d [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:03:49.108419 18582 raft_consensus.cc:1275] T 5c30ad177b44422f982d86fe00ab6c4a P e34192eeaeb246a790a18368773bbe15 [term 3 FOLLOWER]: Refusing update from remote peer e5d4c60ba4c64aa78850cf308be78a8d: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:03:49.108421 18510 raft_consensus.cc:3060] T 24b316d8ce55441ea9cf056818fd658a P e5d4c60ba4c64aa78850cf308be78a8d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:49.109802 18729 consensus_queue.cc:1048] T 5c30ad177b44422f982d86fe00ab6c4a P e5d4c60ba4c64aa78850cf308be78a8d [LEADER]: Connected to new peer: Peer: permanent_uuid: "e34192eeaeb246a790a18368773bbe15" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 42349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:03:49.113659 18510 raft_consensus.cc:515] T 24b316d8ce55441ea9cf056818fd658a P e5d4c60ba4c64aa78850cf308be78a8d [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ba6d37b4c6344ec882213fb72cc10a3" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 33623 } } peers { permanent_uuid: "e5d4c60ba4c64aa78850cf308be78a8d" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 37301 } } peers { permanent_uuid: "e34192eeaeb246a790a18368773bbe15" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 42349 } }
I20260709 13:03:49.115780 18510 leader_election.cc:290] T 24b316d8ce55441ea9cf056818fd658a P e5d4c60ba4c64aa78850cf308be78a8d [CANDIDATE]: Term 2 election: Requested vote from peers 6ba6d37b4c6344ec882213fb72cc10a3 (127.17.223.1:33623), e34192eeaeb246a790a18368773bbe15 (127.17.223.3:42349)
I20260709 13:03:49.117462 18582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24b316d8ce55441ea9cf056818fd658a" candidate_uuid: "e5d4c60ba4c64aa78850cf308be78a8d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e34192eeaeb246a790a18368773bbe15"
I20260709 13:03:49.118047 18582 raft_consensus.cc:3060] T 24b316d8ce55441ea9cf056818fd658a P e34192eeaeb246a790a18368773bbe15 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:49.120217 18433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24b316d8ce55441ea9cf056818fd658a" candidate_uuid: "e5d4c60ba4c64aa78850cf308be78a8d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "6ba6d37b4c6344ec882213fb72cc10a3"
I20260709 13:03:49.122541 18433 raft_consensus.cc:3055] T 24b316d8ce55441ea9cf056818fd658a P 6ba6d37b4c6344ec882213fb72cc10a3 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:03:49.122848 18433 raft_consensus.cc:740] T 24b316d8ce55441ea9cf056818fd658a P 6ba6d37b4c6344ec882213fb72cc10a3 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 6ba6d37b4c6344ec882213fb72cc10a3, State: Running, Role: LEADER
I20260709 13:03:49.123502 18433 consensus_queue.cc:260] T 24b316d8ce55441ea9cf056818fd658a P 6ba6d37b4c6344ec882213fb72cc10a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ba6d37b4c6344ec882213fb72cc10a3" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 33623 } } peers { permanent_uuid: "e5d4c60ba4c64aa78850cf308be78a8d" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 37301 } } peers { permanent_uuid: "e34192eeaeb246a790a18368773bbe15" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 42349 } }
I20260709 13:03:49.124552 18433 raft_consensus.cc:3060] T 24b316d8ce55441ea9cf056818fd658a P 6ba6d37b4c6344ec882213fb72cc10a3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:49.121847 18435 raft_consensus.cc:1275] T 5c30ad177b44422f982d86fe00ab6c4a P 6ba6d37b4c6344ec882213fb72cc10a3 [term 3 FOLLOWER]: Refusing update from remote peer e5d4c60ba4c64aa78850cf308be78a8d: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:03:49.127892 18729 consensus_queue.cc:1048] T 5c30ad177b44422f982d86fe00ab6c4a P e5d4c60ba4c64aa78850cf308be78a8d [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ba6d37b4c6344ec882213fb72cc10a3" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 33623 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:03:49.130983 18433 raft_consensus.cc:2468] T 24b316d8ce55441ea9cf056818fd658a P 6ba6d37b4c6344ec882213fb72cc10a3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e5d4c60ba4c64aa78850cf308be78a8d in term 2.
I20260709 13:03:49.132349 18474 leader_election.cc:304] T 24b316d8ce55441ea9cf056818fd658a P e5d4c60ba4c64aa78850cf308be78a8d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6ba6d37b4c6344ec882213fb72cc10a3, e5d4c60ba4c64aa78850cf308be78a8d; no voters: 
I20260709 13:03:49.133349 18729 raft_consensus.cc:2804] T 24b316d8ce55441ea9cf056818fd658a P e5d4c60ba4c64aa78850cf308be78a8d [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:03:49.133824 18729 raft_consensus.cc:697] T 24b316d8ce55441ea9cf056818fd658a P e5d4c60ba4c64aa78850cf308be78a8d [term 2 LEADER]: Becoming Leader. State: Replica: e5d4c60ba4c64aa78850cf308be78a8d, State: Running, Role: LEADER
I20260709 13:03:49.134591 18729 consensus_queue.cc:237] T 24b316d8ce55441ea9cf056818fd658a P e5d4c60ba4c64aa78850cf308be78a8d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ba6d37b4c6344ec882213fb72cc10a3" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 33623 } } peers { permanent_uuid: "e5d4c60ba4c64aa78850cf308be78a8d" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 37301 } } peers { permanent_uuid: "e34192eeaeb246a790a18368773bbe15" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 42349 } }
I20260709 13:03:49.138377 18582 raft_consensus.cc:2468] T 24b316d8ce55441ea9cf056818fd658a P e34192eeaeb246a790a18368773bbe15 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e5d4c60ba4c64aa78850cf308be78a8d in term 2.
I20260709 13:03:49.142554 18332 catalog_manager.cc:5697] T 24b316d8ce55441ea9cf056818fd658a P e5d4c60ba4c64aa78850cf308be78a8d reported cstate change: term changed from 1 to 2, leader changed from 6ba6d37b4c6344ec882213fb72cc10a3 (127.17.223.1) to e5d4c60ba4c64aa78850cf308be78a8d (127.17.223.2). New cstate: current_term: 2 leader_uuid: "e5d4c60ba4c64aa78850cf308be78a8d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ba6d37b4c6344ec882213fb72cc10a3" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 33623 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e5d4c60ba4c64aa78850cf308be78a8d" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 37301 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e34192eeaeb246a790a18368773bbe15" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 42349 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:49.302579 18435 raft_consensus.cc:1275] T a5d1966171cd4c25a9045a79b6ce1b58 P 6ba6d37b4c6344ec882213fb72cc10a3 [term 4 FOLLOWER]: Refusing update from remote peer e5d4c60ba4c64aa78850cf308be78a8d: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:03:49.303767 18729 consensus_queue.cc:1048] T a5d1966171cd4c25a9045a79b6ce1b58 P e5d4c60ba4c64aa78850cf308be78a8d [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ba6d37b4c6344ec882213fb72cc10a3" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 33623 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:03:49.313692 18582 raft_consensus.cc:1275] T a5d1966171cd4c25a9045a79b6ce1b58 P e34192eeaeb246a790a18368773bbe15 [term 4 FOLLOWER]: Refusing update from remote peer e5d4c60ba4c64aa78850cf308be78a8d: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:03:49.314918 18740 consensus_queue.cc:1048] T a5d1966171cd4c25a9045a79b6ce1b58 P e5d4c60ba4c64aa78850cf308be78a8d [LEADER]: Connected to new peer: Peer: permanent_uuid: "e34192eeaeb246a790a18368773bbe15" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 42349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:03:49.378852 18435 raft_consensus.cc:1275] T a9e6e2dfc9624bbb887e108176acff29 P 6ba6d37b4c6344ec882213fb72cc10a3 [term 2 FOLLOWER]: Refusing update from remote peer e5d4c60ba4c64aa78850cf308be78a8d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:03:49.380055 18740 consensus_queue.cc:1048] T a9e6e2dfc9624bbb887e108176acff29 P e5d4c60ba4c64aa78850cf308be78a8d [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ba6d37b4c6344ec882213fb72cc10a3" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 33623 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:03:49.387956 18582 raft_consensus.cc:1275] T a9e6e2dfc9624bbb887e108176acff29 P e34192eeaeb246a790a18368773bbe15 [term 2 FOLLOWER]: Refusing update from remote peer e5d4c60ba4c64aa78850cf308be78a8d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:03:49.389767 18752 consensus_queue.cc:1048] T a9e6e2dfc9624bbb887e108176acff29 P e5d4c60ba4c64aa78850cf308be78a8d [LEADER]: Connected to new peer: Peer: permanent_uuid: "e34192eeaeb246a790a18368773bbe15" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 42349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:03:49.572810 18582 raft_consensus.cc:1275] T 476ca419566a4bc1883e94647b632918 P e34192eeaeb246a790a18368773bbe15 [term 4 FOLLOWER]: Refusing update from remote peer e5d4c60ba4c64aa78850cf308be78a8d: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:03:49.573376 18435 raft_consensus.cc:1275] T 24b316d8ce55441ea9cf056818fd658a P 6ba6d37b4c6344ec882213fb72cc10a3 [term 2 FOLLOWER]: Refusing update from remote peer e5d4c60ba4c64aa78850cf308be78a8d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:03:49.574155 18752 consensus_queue.cc:1048] T 476ca419566a4bc1883e94647b632918 P e5d4c60ba4c64aa78850cf308be78a8d [LEADER]: Connected to new peer: Peer: permanent_uuid: "e34192eeaeb246a790a18368773bbe15" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 42349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:03:49.574699 18753 consensus_queue.cc:1048] T 24b316d8ce55441ea9cf056818fd658a P e5d4c60ba4c64aa78850cf308be78a8d [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ba6d37b4c6344ec882213fb72cc10a3" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 33623 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:03:49.583951 18435 raft_consensus.cc:1275] T 476ca419566a4bc1883e94647b632918 P 6ba6d37b4c6344ec882213fb72cc10a3 [term 4 FOLLOWER]: Refusing update from remote peer e5d4c60ba4c64aa78850cf308be78a8d: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:03:49.587457 18753 consensus_queue.cc:1048] T 476ca419566a4bc1883e94647b632918 P e5d4c60ba4c64aa78850cf308be78a8d [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ba6d37b4c6344ec882213fb72cc10a3" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 33623 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:03:49.591337 18582 raft_consensus.cc:1275] T 24b316d8ce55441ea9cf056818fd658a P e34192eeaeb246a790a18368773bbe15 [term 2 FOLLOWER]: Refusing update from remote peer e5d4c60ba4c64aa78850cf308be78a8d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:03:49.593107 18753 consensus_queue.cc:1048] T 24b316d8ce55441ea9cf056818fd658a P e5d4c60ba4c64aa78850cf308be78a8d [LEADER]: Connected to new peer: Peer: permanent_uuid: "e34192eeaeb246a790a18368773bbe15" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 42349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:03:51.614499 18300 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:03:51.623443 18510 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "24b316d8ce55441ea9cf056818fd658a"
dest_uuid: "e5d4c60ba4c64aa78850cf308be78a8d"
mode: GRACEFUL
new_leader_uuid: "6ba6d37b4c6344ec882213fb72cc10a3"
 from {username='slave'} at 127.0.0.1:58832
I20260709 13:03:51.624022 18510 raft_consensus.cc:606] T 24b316d8ce55441ea9cf056818fd658a P e5d4c60ba4c64aa78850cf308be78a8d [term 2 LEADER]: Received request to transfer leadership to TS 6ba6d37b4c6344ec882213fb72cc10a3
I20260709 13:03:51.626391 18510 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5c30ad177b44422f982d86fe00ab6c4a"
dest_uuid: "e5d4c60ba4c64aa78850cf308be78a8d"
mode: GRACEFUL
new_leader_uuid: "e34192eeaeb246a790a18368773bbe15"
 from {username='slave'} at 127.0.0.1:58832
I20260709 13:03:51.626777 18510 raft_consensus.cc:606] T 5c30ad177b44422f982d86fe00ab6c4a P e5d4c60ba4c64aa78850cf308be78a8d [term 3 LEADER]: Received request to transfer leadership to TS e34192eeaeb246a790a18368773bbe15
I20260709 13:03:51.628744 18510 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a9e6e2dfc9624bbb887e108176acff29"
dest_uuid: "e5d4c60ba4c64aa78850cf308be78a8d"
mode: GRACEFUL
new_leader_uuid: "e34192eeaeb246a790a18368773bbe15"
 from {username='slave'} at 127.0.0.1:58832
I20260709 13:03:51.629097 18510 raft_consensus.cc:606] T a9e6e2dfc9624bbb887e108176acff29 P e5d4c60ba4c64aa78850cf308be78a8d [term 2 LEADER]: Received request to transfer leadership to TS e34192eeaeb246a790a18368773bbe15
I20260709 13:03:51.630986 18510 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b68da910d10d4d6a80b0055f7061ad27"
dest_uuid: "e5d4c60ba4c64aa78850cf308be78a8d"
mode: GRACEFUL
new_leader_uuid: "6ba6d37b4c6344ec882213fb72cc10a3"
 from {username='slave'} at 127.0.0.1:58832
I20260709 13:03:51.631357 18510 raft_consensus.cc:606] T b68da910d10d4d6a80b0055f7061ad27 P e5d4c60ba4c64aa78850cf308be78a8d [term 2 LEADER]: Received request to transfer leadership to TS 6ba6d37b4c6344ec882213fb72cc10a3
I20260709 13:03:51.633337 18510 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ba252d6f681a44948699b78102577c8b"
dest_uuid: "e5d4c60ba4c64aa78850cf308be78a8d"
mode: GRACEFUL
new_leader_uuid: "6ba6d37b4c6344ec882213fb72cc10a3"
 from {username='slave'} at 127.0.0.1:58832
I20260709 13:03:51.633689 18510 raft_consensus.cc:606] T ba252d6f681a44948699b78102577c8b P e5d4c60ba4c64aa78850cf308be78a8d [term 2 LEADER]: Received request to transfer leadership to TS 6ba6d37b4c6344ec882213fb72cc10a3
I20260709 13:03:51.634567 18300 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:03:51.634958 18300 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:03:51.668578 18740 raft_consensus.cc:993] T 24b316d8ce55441ea9cf056818fd658a P e5d4c60ba4c64aa78850cf308be78a8d: : Instructing follower 6ba6d37b4c6344ec882213fb72cc10a3 to start an election
I20260709 13:03:51.669174 18729 raft_consensus.cc:1081] T 24b316d8ce55441ea9cf056818fd658a P e5d4c60ba4c64aa78850cf308be78a8d [term 2 LEADER]: Signalling peer 6ba6d37b4c6344ec882213fb72cc10a3 to start an election
I20260709 13:03:51.670789 18433 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "24b316d8ce55441ea9cf056818fd658a"
dest_uuid: "6ba6d37b4c6344ec882213fb72cc10a3"
 from {username='slave'} at 127.0.0.1:50368
I20260709 13:03:51.671303 18433 raft_consensus.cc:493] T 24b316d8ce55441ea9cf056818fd658a P 6ba6d37b4c6344ec882213fb72cc10a3 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:03:51.671622 18433 raft_consensus.cc:3060] T 24b316d8ce55441ea9cf056818fd658a P 6ba6d37b4c6344ec882213fb72cc10a3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:03:51.676514 18433 raft_consensus.cc:515] T 24b316d8ce55441ea9cf056818fd658a P 6ba6d37b4c6344ec882213fb72cc10a3 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ba6d37b4c6344ec882213fb72cc10a3" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 33623 } } peers { permanent_uuid: "e5d4c60ba4c64aa78850cf308be78a8d" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 37301 } } peers { permanent_uuid: "e34192eeaeb246a790a18368773bbe15" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 42349 } }
I20260709 13:03:51.678109 18433 leader_election.cc:290] T 24b316d8ce55441ea9cf056818fd658a P 6ba6d37b4c6344ec882213fb72cc10a3 [CANDIDATE]: Term 3 election: Requested vote from peers e5d4c60ba4c64aa78850cf308be78a8d (127.17.223.2:37301), e34192eeaeb246a790a18368773bbe15 (127.17.223.3:42349)
I20260709 13:03:51.679293 18582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24b316d8ce55441ea9cf056818fd658a" candidate_uuid: "6ba6d37b4c6344ec882213fb72cc10a3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "e34192eeaeb246a790a18368773bbe15"
I20260709 13:03:51.679222 18510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24b316d8ce55441ea9cf056818fd658a" candidate_uuid: "6ba6d37b4c6344ec882213fb72cc10a3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "e5d4c60ba4c64aa78850cf308be78a8d"
I20260709 13:03:51.679908 18582 raft_consensus.cc:3060] T 24b316d8ce55441ea9cf056818fd658a P e34192eeaeb246a790a18368773bbe15 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:03:51.679965 18510 raft_consensus.cc:3055] T 24b316d8ce55441ea9cf056818fd658a P e5d4c60ba4c64aa78850cf308be78a8d [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:03:51.680296 18510 raft_consensus.cc:740] T 24b316d8ce55441ea9cf056818fd658a P e5d4c60ba4c64aa78850cf308be78a8d [term 2 LEADER]: Becoming Follower/Learner. State: Replica: e5d4c60ba4c64aa78850cf308be78a8d, State: Running, Role: LEADER
I20260709 13:03:51.680958 18510 consensus_queue.cc:260] T 24b316d8ce55441ea9cf056818fd658a P e5d4c60ba4c64aa78850cf308be78a8d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ba6d37b4c6344ec882213fb72cc10a3" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 33623 } } peers { permanent_uuid: "e5d4c60ba4c64aa78850cf308be78a8d" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 37301 } } peers { permanent_uuid: "e34192eeaeb246a790a18368773bbe15" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 42349 } }
I20260709 13:03:51.681963 18510 raft_consensus.cc:3060] T 24b316d8ce55441ea9cf056818fd658a P e5d4c60ba4c64aa78850cf308be78a8d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:03:51.684492 18582 raft_consensus.cc:2468] T 24b316d8ce55441ea9cf056818fd658a P e34192eeaeb246a790a18368773bbe15 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ba6d37b4c6344ec882213fb72cc10a3 in term 3.
I20260709 13:03:51.685751 18401 leader_election.cc:304] T 24b316d8ce55441ea9cf056818fd658a P 6ba6d37b4c6344ec882213fb72cc10a3 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6ba6d37b4c6344ec882213fb72cc10a3, e34192eeaeb246a790a18368773bbe15; no voters: 
I20260709 13:03:51.686856 18510 raft_consensus.cc:2468] T 24b316d8ce55441ea9cf056818fd658a P e5d4c60ba4c64aa78850cf308be78a8d [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ba6d37b4c6344ec882213fb72cc10a3 in term 3.
I20260709 13:03:51.687556 18763 raft_consensus.cc:2804] T 24b316d8ce55441ea9cf056818fd658a P 6ba6d37b4c6344ec882213fb72cc10a3 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:03:51.688684 18763 raft_consensus.cc:697] T 24b316d8ce55441ea9cf056818fd658a P 6ba6d37b4c6344ec882213fb72cc10a3 [term 3 LEADER]: Becoming Leader. State: Replica: 6ba6d37b4c6344ec882213fb72cc10a3, State: Running, Role: LEADER
I20260709 13:03:51.689688 18763 consensus_queue.cc:237] T 24b316d8ce55441ea9cf056818fd658a P 6ba6d37b4c6344ec882213fb72cc10a3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ba6d37b4c6344ec882213fb72cc10a3" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 33623 } } peers { permanent_uuid: "e5d4c60ba4c64aa78850cf308be78a8d" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 37301 } } peers { permanent_uuid: "e34192eeaeb246a790a18368773bbe15" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 42349 } }
I20260709 13:03:51.696749 18330 catalog_manager.cc:5697] T 24b316d8ce55441ea9cf056818fd658a P 6ba6d37b4c6344ec882213fb72cc10a3 reported cstate change: term changed from 2 to 3, leader changed from e5d4c60ba4c64aa78850cf308be78a8d (127.17.223.2) to 6ba6d37b4c6344ec882213fb72cc10a3 (127.17.223.1). New cstate: current_term: 3 leader_uuid: "6ba6d37b4c6344ec882213fb72cc10a3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ba6d37b4c6344ec882213fb72cc10a3" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 33623 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e5d4c60ba4c64aa78850cf308be78a8d" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 37301 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e34192eeaeb246a790a18368773bbe15" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 42349 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:51.708206 18740 raft_consensus.cc:993] T a9e6e2dfc9624bbb887e108176acff29 P e5d4c60ba4c64aa78850cf308be78a8d: : Instructing follower e34192eeaeb246a790a18368773bbe15 to start an election
I20260709 13:03:51.708724 18740 raft_consensus.cc:1081] T a9e6e2dfc9624bbb887e108176acff29 P e5d4c60ba4c64aa78850cf308be78a8d [term 2 LEADER]: Signalling peer e34192eeaeb246a790a18368773bbe15 to start an election
I20260709 13:03:51.710487 18582 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a9e6e2dfc9624bbb887e108176acff29"
dest_uuid: "e34192eeaeb246a790a18368773bbe15"
 from {username='slave'} at 127.0.0.1:52586
I20260709 13:03:51.710945 18582 raft_consensus.cc:493] T a9e6e2dfc9624bbb887e108176acff29 P e34192eeaeb246a790a18368773bbe15 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:03:51.711175 18582 raft_consensus.cc:3060] T a9e6e2dfc9624bbb887e108176acff29 P e34192eeaeb246a790a18368773bbe15 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:03:51.715014 18582 raft_consensus.cc:515] T a9e6e2dfc9624bbb887e108176acff29 P e34192eeaeb246a790a18368773bbe15 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ba6d37b4c6344ec882213fb72cc10a3" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 33623 } } peers { permanent_uuid: "e5d4c60ba4c64aa78850cf308be78a8d" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 37301 } } peers { permanent_uuid: "e34192eeaeb246a790a18368773bbe15" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 42349 } }
I20260709 13:03:51.716490 18582 leader_election.cc:290] T a9e6e2dfc9624bbb887e108176acff29 P e34192eeaeb246a790a18368773bbe15 [CANDIDATE]: Term 3 election: Requested vote from peers 6ba6d37b4c6344ec882213fb72cc10a3 (127.17.223.1:33623), e5d4c60ba4c64aa78850cf308be78a8d (127.17.223.2:37301)
I20260709 13:03:51.717392 18433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9e6e2dfc9624bbb887e108176acff29" candidate_uuid: "e34192eeaeb246a790a18368773bbe15" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "6ba6d37b4c6344ec882213fb72cc10a3"
I20260709 13:03:51.717576 18510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9e6e2dfc9624bbb887e108176acff29" candidate_uuid: "e34192eeaeb246a790a18368773bbe15" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "e5d4c60ba4c64aa78850cf308be78a8d"
I20260709 13:03:51.717887 18433 raft_consensus.cc:3060] T a9e6e2dfc9624bbb887e108176acff29 P 6ba6d37b4c6344ec882213fb72cc10a3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:03:51.718101 18510 raft_consensus.cc:3055] T a9e6e2dfc9624bbb887e108176acff29 P e5d4c60ba4c64aa78850cf308be78a8d [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:03:51.718397 18510 raft_consensus.cc:740] T a9e6e2dfc9624bbb887e108176acff29 P e5d4c60ba4c64aa78850cf308be78a8d [term 2 LEADER]: Becoming Follower/Learner. State: Replica: e5d4c60ba4c64aa78850cf308be78a8d, State: Running, Role: LEADER
I20260709 13:03:51.718993 18510 consensus_queue.cc:260] T a9e6e2dfc9624bbb887e108176acff29 P e5d4c60ba4c64aa78850cf308be78a8d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ba6d37b4c6344ec882213fb72cc10a3" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 33623 } } peers { permanent_uuid: "e5d4c60ba4c64aa78850cf308be78a8d" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 37301 } } peers { permanent_uuid: "e34192eeaeb246a790a18368773bbe15" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 42349 } }
I20260709 13:03:51.719831 18510 raft_consensus.cc:3060] T a9e6e2dfc9624bbb887e108176acff29 P e5d4c60ba4c64aa78850cf308be78a8d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:03:51.722079 18433 raft_consensus.cc:2468] T a9e6e2dfc9624bbb887e108176acff29 P 6ba6d37b4c6344ec882213fb72cc10a3 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e34192eeaeb246a790a18368773bbe15 in term 3.
I20260709 13:03:51.723186 18548 leader_election.cc:304] T a9e6e2dfc9624bbb887e108176acff29 P e34192eeaeb246a790a18368773bbe15 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6ba6d37b4c6344ec882213fb72cc10a3, e34192eeaeb246a790a18368773bbe15; no voters: 
I20260709 13:03:51.723510 18510 raft_consensus.cc:2468] T a9e6e2dfc9624bbb887e108176acff29 P e5d4c60ba4c64aa78850cf308be78a8d [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e34192eeaeb246a790a18368773bbe15 in term 3.
I20260709 13:03:51.723984 18760 raft_consensus.cc:2804] T a9e6e2dfc9624bbb887e108176acff29 P e34192eeaeb246a790a18368773bbe15 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:03:51.724426 18760 raft_consensus.cc:697] T a9e6e2dfc9624bbb887e108176acff29 P e34192eeaeb246a790a18368773bbe15 [term 3 LEADER]: Becoming Leader. State: Replica: e34192eeaeb246a790a18368773bbe15, State: Running, Role: LEADER
I20260709 13:03:51.725222 18760 consensus_queue.cc:237] T a9e6e2dfc9624bbb887e108176acff29 P e34192eeaeb246a790a18368773bbe15 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ba6d37b4c6344ec882213fb72cc10a3" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 33623 } } peers { permanent_uuid: "e5d4c60ba4c64aa78850cf308be78a8d" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 37301 } } peers { permanent_uuid: "e34192eeaeb246a790a18368773bbe15" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 42349 } }
I20260709 13:03:51.732306 18330 catalog_manager.cc:5697] T a9e6e2dfc9624bbb887e108176acff29 P e34192eeaeb246a790a18368773bbe15 reported cstate change: term changed from 2 to 3, leader changed from e5d4c60ba4c64aa78850cf308be78a8d (127.17.223.2) to e34192eeaeb246a790a18368773bbe15 (127.17.223.3). New cstate: current_term: 3 leader_uuid: "e34192eeaeb246a790a18368773bbe15" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ba6d37b4c6344ec882213fb72cc10a3" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 33623 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e5d4c60ba4c64aa78850cf308be78a8d" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 37301 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e34192eeaeb246a790a18368773bbe15" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 42349 } health_report { overall_health: HEALTHY } } }
I20260709 13:03:51.827510 18740 raft_consensus.cc:993] T ba252d6f681a44948699b78102577c8b P e5d4c60ba4c64aa78850cf308be78a8d: : Instructing follower 6ba6d37b4c6344ec882213fb72cc10a3 to start an election
I20260709 13:03:51.827962 18729 raft_consensus.cc:1081] T ba252d6f681a44948699b78102577c8b P e5d4c60ba4c64aa78850cf308be78a8d [term 2 LEADER]: Signalling peer 6ba6d37b4c6344ec882213fb72cc10a3 to start an election
I20260709 13:03:51.829382 18433 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ba252d6f681a44948699b78102577c8b"
dest_uuid: "6ba6d37b4c6344ec882213fb72cc10a3"
 from {username='slave'} at 127.0.0.1:50368
I20260709 13:03:51.829813 18433 raft_consensus.cc:493] T ba252d6f681a44948699b78102577c8b P 6ba6d37b4c6344ec882213fb72cc10a3 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:03:51.830086 18433 raft_consensus.cc:3060] T ba252d6f681a44948699b78102577c8b P 6ba6d37b4c6344ec882213fb72cc10a3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:03:51.833832 18433 raft_consensus.cc:515] T ba252d6f681a44948699b78102577c8b P 6ba6d37b4c6344ec882213fb72cc10a3 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ba6d37b4c6344ec882213fb72cc10a3" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 33623 } } peers { permanent_uuid: "e5d4c60ba4c64aa78850cf308be78a8d" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 37301 } } peers { permanent_uuid: "e34192eeaeb246a790a18368773bbe15" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 42349 } }
I20260709 13:03:51.835461 18433 leader_election.cc:290] T ba252d6f681a44948699b78102577c8b P 6ba6d37b4c6344ec882213fb72cc10a3 [CANDIDATE]: Term 3 election: Requested vote from peers e5d4c60ba4c64aa78850cf308be78a8d (127.17.223.2:37301), e34192eeaeb246a790a18368773bbe15 (127.17.223.3:42349)
I20260709 13:03:51.836402 18510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba252d6f681a44948699b78102577c8b" candidate_uuid: "6ba6d37b4c6344ec882213fb72cc10a3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "e5d4c60ba4c64aa78850cf308be78a8d"
I20260709 13:03:51.836479 18582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba252d6f681a44948699b78102577c8b" candidate_uuid: "6ba6d37b4c6344ec882213fb72cc10a3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "e34192eeaeb246a790a18368773bbe15"
I20260709 13:03:51.837105 18510 raft_consensus.cc:3055] T ba252d6f681a44948699b78102577c8b P e5d4c60ba4c64aa78850cf308be78a8d [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:03:51.837126 18582 raft_consensus.cc:3060] T ba252d6f681a44948699b78102577c8b P e34192eeaeb246a790a18368773bbe15 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:03:51.837519 18510 raft_consensus.cc:740] T ba252d6f681a44948699b78102577c8b P e5d4c60ba4c64aa78850cf308be78a8d [term 2 LEADER]: Becoming Follower/Learner. State: Replica: e5d4c60ba4c64aa78850cf308be78a8d, State: Running, Role: LEADER
I20260709 13:03:51.838243 18510 consensus_queue.cc:260] T ba252d6f681a44948699b78102577c8b P e5d4c60ba4c64aa78850cf308be78a8d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ba6d37b4c6344ec882213fb72cc10a3" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 33623 } } peers { permanent_uuid: "e5d4c60ba4c64aa78850cf308be78a8d" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 37301 } } peers { permanent_uuid: "e34192eeaeb246a790a18368773bbe15" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 42349 } }
I20260709 13:03:51.839362 18510 raft_consensus.cc:3060] T ba252d6f681a44948699b78102577c8b P e5d4c60ba4c64aa78850cf308be78a8d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:03:51.843223 18582 raft_consensus.cc:2468] T ba252d6f681a44948699b78102577c8b P e34192eeaeb246a790a18368773bbe15 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ba6d37b4c6344ec882213fb72cc10a3 in term 3.
I20260709 13:03:51.844192 18401 leader_election.cc:304] T ba252d6f681a44948699b78102577c8b P 6ba6d37b4c6344ec882213fb72cc10a3 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6ba6d37b4c6344ec882213fb72cc10a3, e34192eeaeb246a790a18368773bbe15; no voters: 
I20260709 13:03:51.844965 18763 raft_consensus.cc:2804] T ba252d6f681a44948699b78102577c8b P 6ba6d37b4c6344ec882213fb72cc10a3 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:03:51.845261 18510 raft_consensus.cc:2468] T ba252d6f681a44948699b78102577c8b P e5d4c60ba4c64aa78850cf308be78a8d [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ba6d37b4c6344ec882213fb72cc10a3 in term 3.
I20260709 13:03:51.845351 18763 raft_consensus.cc:697] T ba252d6f681a44948699b78102577c8b P 6ba6d37b4c6344ec882213fb72cc10a3 [term 3 LEADER]: Becoming Leader. State: Replica: 6ba6d37b4c6344ec882213fb72cc10a3, State: Running, Role: LEADER
I20260709 13:03:51.846325 18763 consensus_queue.cc:237] T ba252d6f681a44948699b78102577c8b P 6ba6d37b4c6344ec882213fb72cc10a3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ba6d37b4c6344ec882213fb72cc10a3" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 33623 } } peers { permanent_uuid: "e5d4c60ba4c64aa78850cf308be78a8d" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 37301 } } peers { permanent_uuid: "e34192eeaeb246a790a18368773bbe15" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 42349 } }
I20260709 13:03:51.852644 18330 catalog_manager.cc:5697] T ba252d6f681a44948699b78102577c8b P 6ba6d37b4c6344ec882213fb72cc10a3 reported cstate change: term changed from 2 to 3, leader changed from e5d4c60ba4c64aa78850cf308be78a8d (127.17.223.2) to 6ba6d37b4c6344ec882213fb72cc10a3 (127.17.223.1). New cstate: current_term: 3 leader_uuid: "6ba6d37b4c6344ec882213fb72cc10a3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ba6d37b4c6344ec882213fb72cc10a3" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 33623 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e5d4c60ba4c64aa78850cf308be78a8d" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 37301 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e34192eeaeb246a790a18368773bbe15" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 42349 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:51.982336 18740 raft_consensus.cc:993] T 5c30ad177b44422f982d86fe00ab6c4a P e5d4c60ba4c64aa78850cf308be78a8d: : Instructing follower e34192eeaeb246a790a18368773bbe15 to start an election
I20260709 13:03:51.982861 18729 raft_consensus.cc:1081] T 5c30ad177b44422f982d86fe00ab6c4a P e5d4c60ba4c64aa78850cf308be78a8d [term 3 LEADER]: Signalling peer e34192eeaeb246a790a18368773bbe15 to start an election
I20260709 13:03:51.984280 18582 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "5c30ad177b44422f982d86fe00ab6c4a"
dest_uuid: "e34192eeaeb246a790a18368773bbe15"
 from {username='slave'} at 127.0.0.1:52586
I20260709 13:03:51.984722 18582 raft_consensus.cc:493] T 5c30ad177b44422f982d86fe00ab6c4a P e34192eeaeb246a790a18368773bbe15 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:03:51.984994 18582 raft_consensus.cc:3060] T 5c30ad177b44422f982d86fe00ab6c4a P e34192eeaeb246a790a18368773bbe15 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:03:51.988953 18582 raft_consensus.cc:515] T 5c30ad177b44422f982d86fe00ab6c4a P e34192eeaeb246a790a18368773bbe15 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5d4c60ba4c64aa78850cf308be78a8d" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 37301 } } peers { permanent_uuid: "6ba6d37b4c6344ec882213fb72cc10a3" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 33623 } } peers { permanent_uuid: "e34192eeaeb246a790a18368773bbe15" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 42349 } }
I20260709 13:03:51.990438 18582 leader_election.cc:290] T 5c30ad177b44422f982d86fe00ab6c4a P e34192eeaeb246a790a18368773bbe15 [CANDIDATE]: Term 4 election: Requested vote from peers e5d4c60ba4c64aa78850cf308be78a8d (127.17.223.2:37301), 6ba6d37b4c6344ec882213fb72cc10a3 (127.17.223.1:33623)
I20260709 13:03:51.991482 18510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c30ad177b44422f982d86fe00ab6c4a" candidate_uuid: "e34192eeaeb246a790a18368773bbe15" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "e5d4c60ba4c64aa78850cf308be78a8d"
I20260709 13:03:51.991499 18433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c30ad177b44422f982d86fe00ab6c4a" candidate_uuid: "e34192eeaeb246a790a18368773bbe15" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "6ba6d37b4c6344ec882213fb72cc10a3"
I20260709 13:03:51.991998 18510 raft_consensus.cc:3055] T 5c30ad177b44422f982d86fe00ab6c4a P e5d4c60ba4c64aa78850cf308be78a8d [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:03:51.992074 18433 raft_consensus.cc:3060] T 5c30ad177b44422f982d86fe00ab6c4a P 6ba6d37b4c6344ec882213fb72cc10a3 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:03:51.992275 18510 raft_consensus.cc:740] T 5c30ad177b44422f982d86fe00ab6c4a P e5d4c60ba4c64aa78850cf308be78a8d [term 3 LEADER]: Becoming Follower/Learner. State: Replica: e5d4c60ba4c64aa78850cf308be78a8d, State: Running, Role: LEADER
I20260709 13:03:51.992993 18510 consensus_queue.cc:260] T 5c30ad177b44422f982d86fe00ab6c4a P e5d4c60ba4c64aa78850cf308be78a8d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5d4c60ba4c64aa78850cf308be78a8d" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 37301 } } peers { permanent_uuid: "6ba6d37b4c6344ec882213fb72cc10a3" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 33623 } } peers { permanent_uuid: "e34192eeaeb246a790a18368773bbe15" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 42349 } }
I20260709 13:03:51.993842 18510 raft_consensus.cc:3060] T 5c30ad177b44422f982d86fe00ab6c4a P e5d4c60ba4c64aa78850cf308be78a8d [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:03:51.996354 18433 raft_consensus.cc:2468] T 5c30ad177b44422f982d86fe00ab6c4a P 6ba6d37b4c6344ec882213fb72cc10a3 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e34192eeaeb246a790a18368773bbe15 in term 4.
I20260709 13:03:51.997253 18548 leader_election.cc:304] T 5c30ad177b44422f982d86fe00ab6c4a P e34192eeaeb246a790a18368773bbe15 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6ba6d37b4c6344ec882213fb72cc10a3, e34192eeaeb246a790a18368773bbe15; no voters: 
I20260709 13:03:51.997949 18760 raft_consensus.cc:2804] T 5c30ad177b44422f982d86fe00ab6c4a P e34192eeaeb246a790a18368773bbe15 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:03:51.998061 18510 raft_consensus.cc:2468] T 5c30ad177b44422f982d86fe00ab6c4a P e5d4c60ba4c64aa78850cf308be78a8d [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e34192eeaeb246a790a18368773bbe15 in term 4.
I20260709 13:03:51.998358 18760 raft_consensus.cc:697] T 5c30ad177b44422f982d86fe00ab6c4a P e34192eeaeb246a790a18368773bbe15 [term 4 LEADER]: Becoming Leader. State: Replica: e34192eeaeb246a790a18368773bbe15, State: Running, Role: LEADER
I20260709 13:03:51.999294 18760 consensus_queue.cc:237] T 5c30ad177b44422f982d86fe00ab6c4a P e34192eeaeb246a790a18368773bbe15 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5d4c60ba4c64aa78850cf308be78a8d" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 37301 } } peers { permanent_uuid: "6ba6d37b4c6344ec882213fb72cc10a3" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 33623 } } peers { permanent_uuid: "e34192eeaeb246a790a18368773bbe15" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 42349 } }
I20260709 13:03:52.006165 18330 catalog_manager.cc:5697] T 5c30ad177b44422f982d86fe00ab6c4a P e34192eeaeb246a790a18368773bbe15 reported cstate change: term changed from 3 to 4, leader changed from e5d4c60ba4c64aa78850cf308be78a8d (127.17.223.2) to e34192eeaeb246a790a18368773bbe15 (127.17.223.3). New cstate: current_term: 4 leader_uuid: "e34192eeaeb246a790a18368773bbe15" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5d4c60ba4c64aa78850cf308be78a8d" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 37301 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6ba6d37b4c6344ec882213fb72cc10a3" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 33623 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e34192eeaeb246a790a18368773bbe15" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 42349 } health_report { overall_health: HEALTHY } } }
I20260709 13:03:52.130334 18740 raft_consensus.cc:993] T b68da910d10d4d6a80b0055f7061ad27 P e5d4c60ba4c64aa78850cf308be78a8d: : Instructing follower 6ba6d37b4c6344ec882213fb72cc10a3 to start an election
I20260709 13:03:52.130791 18729 raft_consensus.cc:1081] T b68da910d10d4d6a80b0055f7061ad27 P e5d4c60ba4c64aa78850cf308be78a8d [term 2 LEADER]: Signalling peer 6ba6d37b4c6344ec882213fb72cc10a3 to start an election
I20260709 13:03:52.132263 18433 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b68da910d10d4d6a80b0055f7061ad27"
dest_uuid: "6ba6d37b4c6344ec882213fb72cc10a3"
 from {username='slave'} at 127.0.0.1:50368
I20260709 13:03:52.132673 18433 raft_consensus.cc:493] T b68da910d10d4d6a80b0055f7061ad27 P 6ba6d37b4c6344ec882213fb72cc10a3 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:03:52.132912 18433 raft_consensus.cc:3060] T b68da910d10d4d6a80b0055f7061ad27 P 6ba6d37b4c6344ec882213fb72cc10a3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:03:52.137279 18433 raft_consensus.cc:515] T b68da910d10d4d6a80b0055f7061ad27 P 6ba6d37b4c6344ec882213fb72cc10a3 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ba6d37b4c6344ec882213fb72cc10a3" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 33623 } } peers { permanent_uuid: "e5d4c60ba4c64aa78850cf308be78a8d" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 37301 } } peers { permanent_uuid: "e34192eeaeb246a790a18368773bbe15" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 42349 } }
I20260709 13:03:52.138918 18433 leader_election.cc:290] T b68da910d10d4d6a80b0055f7061ad27 P 6ba6d37b4c6344ec882213fb72cc10a3 [CANDIDATE]: Term 3 election: Requested vote from peers e5d4c60ba4c64aa78850cf308be78a8d (127.17.223.2:37301), e34192eeaeb246a790a18368773bbe15 (127.17.223.3:42349)
I20260709 13:03:52.139633 18510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b68da910d10d4d6a80b0055f7061ad27" candidate_uuid: "6ba6d37b4c6344ec882213fb72cc10a3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "e5d4c60ba4c64aa78850cf308be78a8d"
I20260709 13:03:52.140271 18582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b68da910d10d4d6a80b0055f7061ad27" candidate_uuid: "6ba6d37b4c6344ec882213fb72cc10a3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "e34192eeaeb246a790a18368773bbe15"
I20260709 13:03:52.140403 18510 raft_consensus.cc:3055] T b68da910d10d4d6a80b0055f7061ad27 P e5d4c60ba4c64aa78850cf308be78a8d [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:03:52.140728 18510 raft_consensus.cc:740] T b68da910d10d4d6a80b0055f7061ad27 P e5d4c60ba4c64aa78850cf308be78a8d [term 2 LEADER]: Becoming Follower/Learner. State: Replica: e5d4c60ba4c64aa78850cf308be78a8d, State: Running, Role: LEADER
I20260709 13:03:52.140756 18582 raft_consensus.cc:3060] T b68da910d10d4d6a80b0055f7061ad27 P e34192eeaeb246a790a18368773bbe15 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:03:52.141392 18510 consensus_queue.cc:260] T b68da910d10d4d6a80b0055f7061ad27 P e5d4c60ba4c64aa78850cf308be78a8d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ba6d37b4c6344ec882213fb72cc10a3" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 33623 } } peers { permanent_uuid: "e5d4c60ba4c64aa78850cf308be78a8d" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 37301 } } peers { permanent_uuid: "e34192eeaeb246a790a18368773bbe15" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 42349 } }
I20260709 13:03:52.142217 18510 raft_consensus.cc:3060] T b68da910d10d4d6a80b0055f7061ad27 P e5d4c60ba4c64aa78850cf308be78a8d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:03:52.145006 18582 raft_consensus.cc:2468] T b68da910d10d4d6a80b0055f7061ad27 P e34192eeaeb246a790a18368773bbe15 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ba6d37b4c6344ec882213fb72cc10a3 in term 3.
I20260709 13:03:52.145985 18510 raft_consensus.cc:2468] T b68da910d10d4d6a80b0055f7061ad27 P e5d4c60ba4c64aa78850cf308be78a8d [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ba6d37b4c6344ec882213fb72cc10a3 in term 3.
I20260709 13:03:52.145999 18401 leader_election.cc:304] T b68da910d10d4d6a80b0055f7061ad27 P 6ba6d37b4c6344ec882213fb72cc10a3 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6ba6d37b4c6344ec882213fb72cc10a3, e34192eeaeb246a790a18368773bbe15; no voters: 
I20260709 13:03:52.146888 18763 raft_consensus.cc:2804] T b68da910d10d4d6a80b0055f7061ad27 P 6ba6d37b4c6344ec882213fb72cc10a3 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:03:52.147269 18763 raft_consensus.cc:697] T b68da910d10d4d6a80b0055f7061ad27 P 6ba6d37b4c6344ec882213fb72cc10a3 [term 3 LEADER]: Becoming Leader. State: Replica: 6ba6d37b4c6344ec882213fb72cc10a3, State: Running, Role: LEADER
I20260709 13:03:52.148041 18763 consensus_queue.cc:237] T b68da910d10d4d6a80b0055f7061ad27 P 6ba6d37b4c6344ec882213fb72cc10a3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ba6d37b4c6344ec882213fb72cc10a3" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 33623 } } peers { permanent_uuid: "e5d4c60ba4c64aa78850cf308be78a8d" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 37301 } } peers { permanent_uuid: "e34192eeaeb246a790a18368773bbe15" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 42349 } }
I20260709 13:03:52.154502 18330 catalog_manager.cc:5697] T b68da910d10d4d6a80b0055f7061ad27 P 6ba6d37b4c6344ec882213fb72cc10a3 reported cstate change: term changed from 2 to 3, leader changed from e5d4c60ba4c64aa78850cf308be78a8d (127.17.223.2) to 6ba6d37b4c6344ec882213fb72cc10a3 (127.17.223.1). New cstate: current_term: 3 leader_uuid: "6ba6d37b4c6344ec882213fb72cc10a3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ba6d37b4c6344ec882213fb72cc10a3" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 33623 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e5d4c60ba4c64aa78850cf308be78a8d" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 37301 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e34192eeaeb246a790a18368773bbe15" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 42349 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:52.165256 18582 raft_consensus.cc:1275] T 24b316d8ce55441ea9cf056818fd658a P e34192eeaeb246a790a18368773bbe15 [term 3 FOLLOWER]: Refusing update from remote peer 6ba6d37b4c6344ec882213fb72cc10a3: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:03:52.166371 18763 consensus_queue.cc:1048] T 24b316d8ce55441ea9cf056818fd658a P 6ba6d37b4c6344ec882213fb72cc10a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e34192eeaeb246a790a18368773bbe15" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 42349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:03:52.176026 18510 raft_consensus.cc:1275] T 24b316d8ce55441ea9cf056818fd658a P e5d4c60ba4c64aa78850cf308be78a8d [term 3 FOLLOWER]: Refusing update from remote peer 6ba6d37b4c6344ec882213fb72cc10a3: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:03:52.178755 18764 consensus_queue.cc:1048] T 24b316d8ce55441ea9cf056818fd658a P 6ba6d37b4c6344ec882213fb72cc10a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5d4c60ba4c64aa78850cf308be78a8d" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 37301 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:03:52.237861 18433 raft_consensus.cc:1275] T a9e6e2dfc9624bbb887e108176acff29 P 6ba6d37b4c6344ec882213fb72cc10a3 [term 3 FOLLOWER]: Refusing update from remote peer e34192eeaeb246a790a18368773bbe15: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:03:52.239025 18760 consensus_queue.cc:1048] T a9e6e2dfc9624bbb887e108176acff29 P e34192eeaeb246a790a18368773bbe15 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ba6d37b4c6344ec882213fb72cc10a3" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 33623 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:03:52.248503 18510 raft_consensus.cc:1275] T a9e6e2dfc9624bbb887e108176acff29 P e5d4c60ba4c64aa78850cf308be78a8d [term 3 FOLLOWER]: Refusing update from remote peer e34192eeaeb246a790a18368773bbe15: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:03:52.251968 18781 consensus_queue.cc:1048] T a9e6e2dfc9624bbb887e108176acff29 P e34192eeaeb246a790a18368773bbe15 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5d4c60ba4c64aa78850cf308be78a8d" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 37301 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:03:52.253500 18582 raft_consensus.cc:1275] T ba252d6f681a44948699b78102577c8b P e34192eeaeb246a790a18368773bbe15 [term 3 FOLLOWER]: Refusing update from remote peer 6ba6d37b4c6344ec882213fb72cc10a3: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:03:52.254876 18777 consensus_queue.cc:1048] T ba252d6f681a44948699b78102577c8b P 6ba6d37b4c6344ec882213fb72cc10a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e34192eeaeb246a790a18368773bbe15" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 42349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:03:52.264786 18510 raft_consensus.cc:1275] T ba252d6f681a44948699b78102577c8b P e5d4c60ba4c64aa78850cf308be78a8d [term 3 FOLLOWER]: Refusing update from remote peer 6ba6d37b4c6344ec882213fb72cc10a3: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:03:52.269011 18764 consensus_queue.cc:1048] T ba252d6f681a44948699b78102577c8b P 6ba6d37b4c6344ec882213fb72cc10a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5d4c60ba4c64aa78850cf308be78a8d" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 37301 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:03:52.397022 18433 raft_consensus.cc:1275] T 5c30ad177b44422f982d86fe00ab6c4a P 6ba6d37b4c6344ec882213fb72cc10a3 [term 4 FOLLOWER]: Refusing update from remote peer e34192eeaeb246a790a18368773bbe15: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:03:52.398435 18781 consensus_queue.cc:1048] T 5c30ad177b44422f982d86fe00ab6c4a P e34192eeaeb246a790a18368773bbe15 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ba6d37b4c6344ec882213fb72cc10a3" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 33623 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:03:52.407202 18510 raft_consensus.cc:1275] T 5c30ad177b44422f982d86fe00ab6c4a P e5d4c60ba4c64aa78850cf308be78a8d [term 4 FOLLOWER]: Refusing update from remote peer e34192eeaeb246a790a18368773bbe15: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:03:52.409773 18762 consensus_queue.cc:1048] T 5c30ad177b44422f982d86fe00ab6c4a P e34192eeaeb246a790a18368773bbe15 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5d4c60ba4c64aa78850cf308be78a8d" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 37301 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:03:52.635778 18300 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:03:52.642218 18300 tablet_server.cc:179] TabletServer@127.17.223.1:0 shutting down...
I20260709 13:03:52.647585 18582 raft_consensus.cc:1275] T b68da910d10d4d6a80b0055f7061ad27 P e34192eeaeb246a790a18368773bbe15 [term 3 FOLLOWER]: Refusing update from remote peer 6ba6d37b4c6344ec882213fb72cc10a3: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:03:52.649626 18763 consensus_queue.cc:1048] T b68da910d10d4d6a80b0055f7061ad27 P 6ba6d37b4c6344ec882213fb72cc10a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e34192eeaeb246a790a18368773bbe15" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 42349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:03:52.668298 18510 raft_consensus.cc:1275] T b68da910d10d4d6a80b0055f7061ad27 P e5d4c60ba4c64aa78850cf308be78a8d [term 3 FOLLOWER]: Refusing update from remote peer 6ba6d37b4c6344ec882213fb72cc10a3: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:03:52.670099 18764 consensus_queue.cc:1048] T b68da910d10d4d6a80b0055f7061ad27 P 6ba6d37b4c6344ec882213fb72cc10a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5d4c60ba4c64aa78850cf308be78a8d" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 37301 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:03:52.701188 18300 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:03:52.702030 18300 tablet_replica.cc:333] T 63053c1fc3214bcd99d7c93f71c98ff3 P 6ba6d37b4c6344ec882213fb72cc10a3: stopping tablet replica
I20260709 13:03:52.703161 18300 raft_consensus.cc:2243] T 63053c1fc3214bcd99d7c93f71c98ff3 P 6ba6d37b4c6344ec882213fb72cc10a3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:52.703744 18300 raft_consensus.cc:2272] T 63053c1fc3214bcd99d7c93f71c98ff3 P 6ba6d37b4c6344ec882213fb72cc10a3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:52.706211 18300 tablet_replica.cc:333] T a5d1966171cd4c25a9045a79b6ce1b58 P 6ba6d37b4c6344ec882213fb72cc10a3: stopping tablet replica
I20260709 13:03:52.706734 18300 raft_consensus.cc:2243] T a5d1966171cd4c25a9045a79b6ce1b58 P 6ba6d37b4c6344ec882213fb72cc10a3 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:52.707273 18300 raft_consensus.cc:2272] T a5d1966171cd4c25a9045a79b6ce1b58 P 6ba6d37b4c6344ec882213fb72cc10a3 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:52.708827 18300 tablet_replica.cc:333] T a9e6e2dfc9624bbb887e108176acff29 P 6ba6d37b4c6344ec882213fb72cc10a3: stopping tablet replica
I20260709 13:03:52.709304 18300 raft_consensus.cc:2243] T a9e6e2dfc9624bbb887e108176acff29 P 6ba6d37b4c6344ec882213fb72cc10a3 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:52.709735 18300 raft_consensus.cc:2272] T a9e6e2dfc9624bbb887e108176acff29 P 6ba6d37b4c6344ec882213fb72cc10a3 [term 3 FOLLOWER]: Raft consensus is shut down!
W20260709 13:03:52.711755 18474 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:03:52.712002 18300 tablet_replica.cc:333] T ba252d6f681a44948699b78102577c8b P 6ba6d37b4c6344ec882213fb72cc10a3: stopping tablet replica
I20260709 13:03:52.712555 18300 raft_consensus.cc:2243] T ba252d6f681a44948699b78102577c8b P 6ba6d37b4c6344ec882213fb72cc10a3 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:03:52.713263 18300 raft_consensus.cc:2272] T ba252d6f681a44948699b78102577c8b P 6ba6d37b4c6344ec882213fb72cc10a3 [term 3 FOLLOWER]: Raft consensus is shut down!
W20260709 13:03:52.714553 18474 consensus_peers.cc:597] T 476ca419566a4bc1883e94647b632918 P e5d4c60ba4c64aa78850cf308be78a8d -> Peer 6ba6d37b4c6344ec882213fb72cc10a3 (127.17.223.1:33623): Couldn't send request to peer 6ba6d37b4c6344ec882213fb72cc10a3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:03:52.715521 18300 tablet_replica.cc:333] T 5c30ad177b44422f982d86fe00ab6c4a P 6ba6d37b4c6344ec882213fb72cc10a3: stopping tablet replica
I20260709 13:03:52.716050 18300 raft_consensus.cc:2243] T 5c30ad177b44422f982d86fe00ab6c4a P 6ba6d37b4c6344ec882213fb72cc10a3 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:52.716455 18300 raft_consensus.cc:2272] T 5c30ad177b44422f982d86fe00ab6c4a P 6ba6d37b4c6344ec882213fb72cc10a3 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:52.718513 18300 tablet_replica.cc:333] T f5116788673d45ad9561408373f762a5 P 6ba6d37b4c6344ec882213fb72cc10a3: stopping tablet replica
I20260709 13:03:52.719089 18300 raft_consensus.cc:2243] T f5116788673d45ad9561408373f762a5 P 6ba6d37b4c6344ec882213fb72cc10a3 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:52.719509 18300 raft_consensus.cc:2272] T f5116788673d45ad9561408373f762a5 P 6ba6d37b4c6344ec882213fb72cc10a3 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:52.721076 18300 tablet_replica.cc:333] T 476ca419566a4bc1883e94647b632918 P 6ba6d37b4c6344ec882213fb72cc10a3: stopping tablet replica
I20260709 13:03:52.721544 18300 raft_consensus.cc:2243] T 476ca419566a4bc1883e94647b632918 P 6ba6d37b4c6344ec882213fb72cc10a3 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:52.721988 18300 raft_consensus.cc:2272] T 476ca419566a4bc1883e94647b632918 P 6ba6d37b4c6344ec882213fb72cc10a3 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:52.723959 18300 tablet_replica.cc:333] T 24b316d8ce55441ea9cf056818fd658a P 6ba6d37b4c6344ec882213fb72cc10a3: stopping tablet replica
I20260709 13:03:52.724493 18300 raft_consensus.cc:2243] T 24b316d8ce55441ea9cf056818fd658a P 6ba6d37b4c6344ec882213fb72cc10a3 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:03:52.725224 18300 raft_consensus.cc:2272] T 24b316d8ce55441ea9cf056818fd658a P 6ba6d37b4c6344ec882213fb72cc10a3 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:52.727048 18300 tablet_replica.cc:333] T b68da910d10d4d6a80b0055f7061ad27 P 6ba6d37b4c6344ec882213fb72cc10a3: stopping tablet replica
I20260709 13:03:52.727478 18300 raft_consensus.cc:2243] T b68da910d10d4d6a80b0055f7061ad27 P 6ba6d37b4c6344ec882213fb72cc10a3 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:03:52.728150 18300 raft_consensus.cc:2272] T b68da910d10d4d6a80b0055f7061ad27 P 6ba6d37b4c6344ec882213fb72cc10a3 [term 3 FOLLOWER]: Raft consensus is shut down!
W20260709 13:03:52.736195 18548 consensus_peers.cc:597] T a9e6e2dfc9624bbb887e108176acff29 P e34192eeaeb246a790a18368773bbe15 -> Peer 6ba6d37b4c6344ec882213fb72cc10a3 (127.17.223.1:33623): Couldn't send request to peer 6ba6d37b4c6344ec882213fb72cc10a3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:03:52.825608 18300 tablet_server.cc:196] TabletServer@127.17.223.1:0 shutdown complete.
I20260709 13:03:52.845873 18300 tablet_server.cc:179] TabletServer@127.17.223.2:0 shutting down...
I20260709 13:03:52.870805 18300 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:03:52.871500 18300 tablet_replica.cc:333] T 476ca419566a4bc1883e94647b632918 P e5d4c60ba4c64aa78850cf308be78a8d: stopping tablet replica
I20260709 13:03:52.872270 18300 raft_consensus.cc:2243] T 476ca419566a4bc1883e94647b632918 P e5d4c60ba4c64aa78850cf308be78a8d [term 4 LEADER]: Raft consensus shutting down.
I20260709 13:03:52.873062 18300 raft_consensus.cc:2272] T 476ca419566a4bc1883e94647b632918 P e5d4c60ba4c64aa78850cf308be78a8d [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:52.874788 18300 tablet_replica.cc:333] T a9e6e2dfc9624bbb887e108176acff29 P e5d4c60ba4c64aa78850cf308be78a8d: stopping tablet replica
I20260709 13:03:52.875265 18300 raft_consensus.cc:2243] T a9e6e2dfc9624bbb887e108176acff29 P e5d4c60ba4c64aa78850cf308be78a8d [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:52.875650 18300 raft_consensus.cc:2272] T a9e6e2dfc9624bbb887e108176acff29 P e5d4c60ba4c64aa78850cf308be78a8d [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:52.877511 18300 tablet_replica.cc:333] T f5116788673d45ad9561408373f762a5 P e5d4c60ba4c64aa78850cf308be78a8d: stopping tablet replica
I20260709 13:03:52.877976 18300 raft_consensus.cc:2243] T f5116788673d45ad9561408373f762a5 P e5d4c60ba4c64aa78850cf308be78a8d [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:03:52.878738 18300 raft_consensus.cc:2272] T f5116788673d45ad9561408373f762a5 P e5d4c60ba4c64aa78850cf308be78a8d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:52.880271 18300 tablet_replica.cc:333] T 5c30ad177b44422f982d86fe00ab6c4a P e5d4c60ba4c64aa78850cf308be78a8d: stopping tablet replica
I20260709 13:03:52.880772 18300 raft_consensus.cc:2243] T 5c30ad177b44422f982d86fe00ab6c4a P e5d4c60ba4c64aa78850cf308be78a8d [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:52.881129 18300 raft_consensus.cc:2272] T 5c30ad177b44422f982d86fe00ab6c4a P e5d4c60ba4c64aa78850cf308be78a8d [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:52.883693 18300 tablet_replica.cc:333] T a5d1966171cd4c25a9045a79b6ce1b58 P e5d4c60ba4c64aa78850cf308be78a8d: stopping tablet replica
I20260709 13:03:52.884166 18300 raft_consensus.cc:2243] T a5d1966171cd4c25a9045a79b6ce1b58 P e5d4c60ba4c64aa78850cf308be78a8d [term 4 LEADER]: Raft consensus shutting down.
I20260709 13:03:52.884872 18300 raft_consensus.cc:2272] T a5d1966171cd4c25a9045a79b6ce1b58 P e5d4c60ba4c64aa78850cf308be78a8d [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:52.886371 18300 tablet_replica.cc:333] T 63053c1fc3214bcd99d7c93f71c98ff3 P e5d4c60ba4c64aa78850cf308be78a8d: stopping tablet replica
I20260709 13:03:52.886909 18300 raft_consensus.cc:2243] T 63053c1fc3214bcd99d7c93f71c98ff3 P e5d4c60ba4c64aa78850cf308be78a8d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:52.887286 18300 raft_consensus.cc:2272] T 63053c1fc3214bcd99d7c93f71c98ff3 P e5d4c60ba4c64aa78850cf308be78a8d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:52.888720 18300 tablet_replica.cc:333] T b68da910d10d4d6a80b0055f7061ad27 P e5d4c60ba4c64aa78850cf308be78a8d: stopping tablet replica
I20260709 13:03:52.889161 18300 raft_consensus.cc:2243] T b68da910d10d4d6a80b0055f7061ad27 P e5d4c60ba4c64aa78850cf308be78a8d [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:52.889514 18300 raft_consensus.cc:2272] T b68da910d10d4d6a80b0055f7061ad27 P e5d4c60ba4c64aa78850cf308be78a8d [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:52.891494 18300 tablet_replica.cc:333] T 24b316d8ce55441ea9cf056818fd658a P e5d4c60ba4c64aa78850cf308be78a8d: stopping tablet replica
I20260709 13:03:52.891942 18300 raft_consensus.cc:2243] T 24b316d8ce55441ea9cf056818fd658a P e5d4c60ba4c64aa78850cf308be78a8d [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:52.892299 18300 raft_consensus.cc:2272] T 24b316d8ce55441ea9cf056818fd658a P e5d4c60ba4c64aa78850cf308be78a8d [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:52.894032 18300 tablet_replica.cc:333] T ba252d6f681a44948699b78102577c8b P e5d4c60ba4c64aa78850cf308be78a8d: stopping tablet replica
I20260709 13:03:52.894455 18300 raft_consensus.cc:2243] T ba252d6f681a44948699b78102577c8b P e5d4c60ba4c64aa78850cf308be78a8d [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:52.894852 18300 raft_consensus.cc:2272] T ba252d6f681a44948699b78102577c8b P e5d4c60ba4c64aa78850cf308be78a8d [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:52.924283 18300 tablet_server.cc:196] TabletServer@127.17.223.2:0 shutdown complete.
W20260709 13:03:52.925892 18549 consensus_peers.cc:597] T 5c30ad177b44422f982d86fe00ab6c4a P e34192eeaeb246a790a18368773bbe15 -> Peer e5d4c60ba4c64aa78850cf308be78a8d (127.17.223.2:37301): Couldn't send request to peer e5d4c60ba4c64aa78850cf308be78a8d. Status: Network error: Client connection negotiation failed: client connection to 127.17.223.2:37301: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:03:52.941041 18300 tablet_server.cc:179] TabletServer@127.17.223.3:0 shutting down...
W20260709 13:03:52.961086 18548 consensus_peers.cc:597] T 5c30ad177b44422f982d86fe00ab6c4a P e34192eeaeb246a790a18368773bbe15 -> Peer 6ba6d37b4c6344ec882213fb72cc10a3 (127.17.223.1:33623): Couldn't send request to peer 6ba6d37b4c6344ec882213fb72cc10a3. Status: Network error: Client connection negotiation failed: client connection to 127.17.223.1:33623: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:03:52.965801 18300 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:03:52.966711 18300 tablet_replica.cc:333] T 24b316d8ce55441ea9cf056818fd658a P e34192eeaeb246a790a18368773bbe15: stopping tablet replica
I20260709 13:03:52.967661 18300 raft_consensus.cc:2243] T 24b316d8ce55441ea9cf056818fd658a P e34192eeaeb246a790a18368773bbe15 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:52.968222 18300 raft_consensus.cc:2272] T 24b316d8ce55441ea9cf056818fd658a P e34192eeaeb246a790a18368773bbe15 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:52.970358 18300 tablet_replica.cc:333] T b68da910d10d4d6a80b0055f7061ad27 P e34192eeaeb246a790a18368773bbe15: stopping tablet replica
I20260709 13:03:52.970916 18300 raft_consensus.cc:2243] T b68da910d10d4d6a80b0055f7061ad27 P e34192eeaeb246a790a18368773bbe15 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:52.971318 18300 raft_consensus.cc:2272] T b68da910d10d4d6a80b0055f7061ad27 P e34192eeaeb246a790a18368773bbe15 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:52.973490 18300 tablet_replica.cc:333] T a5d1966171cd4c25a9045a79b6ce1b58 P e34192eeaeb246a790a18368773bbe15: stopping tablet replica
I20260709 13:03:52.973953 18300 raft_consensus.cc:2243] T a5d1966171cd4c25a9045a79b6ce1b58 P e34192eeaeb246a790a18368773bbe15 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:52.974303 18300 raft_consensus.cc:2272] T a5d1966171cd4c25a9045a79b6ce1b58 P e34192eeaeb246a790a18368773bbe15 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:52.975950 18300 tablet_replica.cc:333] T 476ca419566a4bc1883e94647b632918 P e34192eeaeb246a790a18368773bbe15: stopping tablet replica
I20260709 13:03:52.976384 18300 raft_consensus.cc:2243] T 476ca419566a4bc1883e94647b632918 P e34192eeaeb246a790a18368773bbe15 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:52.976729 18300 raft_consensus.cc:2272] T 476ca419566a4bc1883e94647b632918 P e34192eeaeb246a790a18368773bbe15 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:52.978173 18300 tablet_replica.cc:333] T f5116788673d45ad9561408373f762a5 P e34192eeaeb246a790a18368773bbe15: stopping tablet replica
I20260709 13:03:52.978608 18300 raft_consensus.cc:2243] T f5116788673d45ad9561408373f762a5 P e34192eeaeb246a790a18368773bbe15 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:52.979031 18300 raft_consensus.cc:2272] T f5116788673d45ad9561408373f762a5 P e34192eeaeb246a790a18368773bbe15 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:52.980521 18300 tablet_replica.cc:333] T 5c30ad177b44422f982d86fe00ab6c4a P e34192eeaeb246a790a18368773bbe15: stopping tablet replica
I20260709 13:03:52.980929 18300 raft_consensus.cc:2243] T 5c30ad177b44422f982d86fe00ab6c4a P e34192eeaeb246a790a18368773bbe15 [term 4 LEADER]: Raft consensus shutting down.
I20260709 13:03:52.981575 18300 raft_consensus.cc:2272] T 5c30ad177b44422f982d86fe00ab6c4a P e34192eeaeb246a790a18368773bbe15 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:52.983525 18300 tablet_replica.cc:333] T 63053c1fc3214bcd99d7c93f71c98ff3 P e34192eeaeb246a790a18368773bbe15: stopping tablet replica
I20260709 13:03:52.983943 18300 raft_consensus.cc:2243] T 63053c1fc3214bcd99d7c93f71c98ff3 P e34192eeaeb246a790a18368773bbe15 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:03:52.984599 18300 raft_consensus.cc:2272] T 63053c1fc3214bcd99d7c93f71c98ff3 P e34192eeaeb246a790a18368773bbe15 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:52.986166 18300 tablet_replica.cc:333] T ba252d6f681a44948699b78102577c8b P e34192eeaeb246a790a18368773bbe15: stopping tablet replica
I20260709 13:03:52.986559 18300 raft_consensus.cc:2243] T ba252d6f681a44948699b78102577c8b P e34192eeaeb246a790a18368773bbe15 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:52.986975 18300 raft_consensus.cc:2272] T ba252d6f681a44948699b78102577c8b P e34192eeaeb246a790a18368773bbe15 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:52.989183 18300 tablet_replica.cc:333] T a9e6e2dfc9624bbb887e108176acff29 P e34192eeaeb246a790a18368773bbe15: stopping tablet replica
I20260709 13:03:52.989569 18300 raft_consensus.cc:2243] T a9e6e2dfc9624bbb887e108176acff29 P e34192eeaeb246a790a18368773bbe15 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:03:52.990162 18300 raft_consensus.cc:2272] T a9e6e2dfc9624bbb887e108176acff29 P e34192eeaeb246a790a18368773bbe15 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:53.016374 18300 tablet_server.cc:196] TabletServer@127.17.223.3:0 shutdown complete.
I20260709 13:03:53.032125 18300 master.cc:562] Master@127.17.223.62:38721 shutting down...
I20260709 13:03:53.183058 18300 raft_consensus.cc:2243] T 00000000000000000000000000000000 P e191e627772746b097dd78deefcf2f77 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:03:53.183666 18300 raft_consensus.cc:2272] T 00000000000000000000000000000000 P e191e627772746b097dd78deefcf2f77 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:53.184015 18300 tablet_replica.cc:333] T 00000000000000000000000000000000 P e191e627772746b097dd78deefcf2f77: stopping tablet replica
I20260709 13:03:53.203384 18300 master.cc:584] Master@127.17.223.62:38721 shutdown complete.
6ba6d37b4c6344ec882213fb72cc10a3  4
e34192eeaeb246a790a18368773bbe15  1
e5d4c60ba4c64aa78850cf308be78a8d  4
[       OK ] LeaderRebalancerTest.FunctionalTestForDivided (12468 ms)
[ RUN      ] LeaderRebalancerTest.FunctionalTestForNotDivided
I20260709 13:03:53.243695 18300 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.17.223.62:37375
I20260709 13:03:53.244885 18300 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:03:53.250468 18793 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:03:53.250869 18794 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:03:53.253286 18796 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:03:53.254156 18300 server_base.cc:1061] running on GCE node
I20260709 13:03:53.255192 18300 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:03:53.255388 18300 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:03:53.255604 18300 hybrid_clock.cc:648] HybridClock initialized: now 1783602233255561 us; error 0 us; skew 500 ppm
I20260709 13:03:53.256162 18300 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:03:53.258795 18300 webserver.cc:533] Webserver started at http://127.17.223.62:42789/ using document root <none> and password file <none>
I20260709 13:03:53.259302 18300 fs_manager.cc:362] Metadata directory not provided
I20260709 13:03:53.259496 18300 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:03:53.259781 18300 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:03:53.260877 18300 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskKd2k48/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602220613947-18300-0/minicluster-data/master-0-root/instance:
uuid: "469250a9d73b4634816682ddff6e8418"
format_stamp: "Formatted at 2026-07-09 13:03:53 on dist-test-slave-vl1s"
I20260709 13:03:53.265203 18300 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.002s	sys 0.004s
I20260709 13:03:53.268438 18801 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:03:53.269304 18300 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.001s	sys 0.000s
I20260709 13:03:53.269624 18300 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskKd2k48/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602220613947-18300-0/minicluster-data/master-0-root
uuid: "469250a9d73b4634816682ddff6e8418"
format_stamp: "Formatted at 2026-07-09 13:03:53 on dist-test-slave-vl1s"
I20260709 13:03:53.269934 18300 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskKd2k48/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602220613947-18300-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskKd2k48/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602220613947-18300-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskKd2k48/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602220613947-18300-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:03:53.286453 18300 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:03:53.287683 18300 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:03:53.325429 18300 rpc_server.cc:307] RPC server started. Bound to: 127.17.223.62:37375
I20260709 13:03:53.325567 18852 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.17.223.62:37375 every 8 connection(s)
I20260709 13:03:53.329304 18853 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:53.338361 18853 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 469250a9d73b4634816682ddff6e8418: Bootstrap starting.
I20260709 13:03:53.342885 18853 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 469250a9d73b4634816682ddff6e8418: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:53.346939 18853 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 469250a9d73b4634816682ddff6e8418: No bootstrap required, opened a new log
I20260709 13:03:53.348928 18853 raft_consensus.cc:359] T 00000000000000000000000000000000 P 469250a9d73b4634816682ddff6e8418 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "469250a9d73b4634816682ddff6e8418" member_type: VOTER }
I20260709 13:03:53.349303 18853 raft_consensus.cc:385] T 00000000000000000000000000000000 P 469250a9d73b4634816682ddff6e8418 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:53.349555 18853 raft_consensus.cc:740] T 00000000000000000000000000000000 P 469250a9d73b4634816682ddff6e8418 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 469250a9d73b4634816682ddff6e8418, State: Initialized, Role: FOLLOWER
I20260709 13:03:53.350157 18853 consensus_queue.cc:260] T 00000000000000000000000000000000 P 469250a9d73b4634816682ddff6e8418 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "469250a9d73b4634816682ddff6e8418" member_type: VOTER }
I20260709 13:03:53.350572 18853 raft_consensus.cc:399] T 00000000000000000000000000000000 P 469250a9d73b4634816682ddff6e8418 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 13:03:53.350848 18853 raft_consensus.cc:493] T 00000000000000000000000000000000 P 469250a9d73b4634816682ddff6e8418 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 13:03:53.351137 18853 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 469250a9d73b4634816682ddff6e8418 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:53.355083 18853 raft_consensus.cc:515] T 00000000000000000000000000000000 P 469250a9d73b4634816682ddff6e8418 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "469250a9d73b4634816682ddff6e8418" member_type: VOTER }
I20260709 13:03:53.355613 18853 leader_election.cc:304] T 00000000000000000000000000000000 P 469250a9d73b4634816682ddff6e8418 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 469250a9d73b4634816682ddff6e8418; no voters: 
I20260709 13:03:53.356717 18853 leader_election.cc:290] T 00000000000000000000000000000000 P 469250a9d73b4634816682ddff6e8418 [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 13:03:53.357122 18856 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 469250a9d73b4634816682ddff6e8418 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:03:53.358400 18856 raft_consensus.cc:697] T 00000000000000000000000000000000 P 469250a9d73b4634816682ddff6e8418 [term 1 LEADER]: Becoming Leader. State: Replica: 469250a9d73b4634816682ddff6e8418, State: Running, Role: LEADER
I20260709 13:03:53.359126 18856 consensus_queue.cc:237] T 00000000000000000000000000000000 P 469250a9d73b4634816682ddff6e8418 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "469250a9d73b4634816682ddff6e8418" member_type: VOTER }
I20260709 13:03:53.359723 18853 sys_catalog.cc:565] T 00000000000000000000000000000000 P 469250a9d73b4634816682ddff6e8418 [sys.catalog]: configured and running, proceeding with master startup.
I20260709 13:03:53.364514 18858 sys_catalog.cc:455] T 00000000000000000000000000000000 P 469250a9d73b4634816682ddff6e8418 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 469250a9d73b4634816682ddff6e8418. Latest consensus state: current_term: 1 leader_uuid: "469250a9d73b4634816682ddff6e8418" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "469250a9d73b4634816682ddff6e8418" member_type: VOTER } }
I20260709 13:03:53.365103 18858 sys_catalog.cc:458] T 00000000000000000000000000000000 P 469250a9d73b4634816682ddff6e8418 [sys.catalog]: This master's current role is: LEADER
I20260709 13:03:53.367192 18864 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 13:03:53.366914 18857 sys_catalog.cc:455] T 00000000000000000000000000000000 P 469250a9d73b4634816682ddff6e8418 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "469250a9d73b4634816682ddff6e8418" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "469250a9d73b4634816682ddff6e8418" member_type: VOTER } }
I20260709 13:03:53.367530 18857 sys_catalog.cc:458] T 00000000000000000000000000000000 P 469250a9d73b4634816682ddff6e8418 [sys.catalog]: This master's current role is: LEADER
I20260709 13:03:53.372445 18864 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 13:03:53.374827 18300 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 13:03:53.380620 18864 catalog_manager.cc:1383] Generated new cluster ID: 3cf9c79be2ed44d0aac64df9611552bf
I20260709 13:03:53.381031 18864 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 13:03:53.403806 18864 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 13:03:53.405074 18864 catalog_manager.cc:1540] Loading token signing keys...
I20260709 13:03:53.420277 18864 catalog_manager.cc:6070] T 00000000000000000000000000000000 P 469250a9d73b4634816682ddff6e8418: Generated new TSK 0
I20260709 13:03:53.420878 18864 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 13:03:53.441784 18300 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:03:53.447206 18874 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:03:53.448745 18875 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:03:53.450186 18300 server_base.cc:1061] running on GCE node
W20260709 13:03:53.450124 18877 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:03:53.451186 18300 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:03:53.451359 18300 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:03:53.451475 18300 hybrid_clock.cc:648] HybridClock initialized: now 1783602233451464 us; error 0 us; skew 500 ppm
I20260709 13:03:53.451975 18300 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:03:53.454195 18300 webserver.cc:533] Webserver started at http://127.17.223.1:41925/ using document root <none> and password file <none>
I20260709 13:03:53.454646 18300 fs_manager.cc:362] Metadata directory not provided
I20260709 13:03:53.454872 18300 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:03:53.455085 18300 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:03:53.456030 18300 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskKd2k48/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602220613947-18300-0/minicluster-data/ts-0-root/instance:
uuid: "c611bf5baef04660ada573aaf2ae7740"
format_stamp: "Formatted at 2026-07-09 13:03:53 on dist-test-slave-vl1s"
I20260709 13:03:53.460260 18300 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.005s	sys 0.000s
I20260709 13:03:53.463388 18882 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:03:53.464154 18300 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260709 13:03:53.464394 18300 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskKd2k48/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602220613947-18300-0/minicluster-data/ts-0-root
uuid: "c611bf5baef04660ada573aaf2ae7740"
format_stamp: "Formatted at 2026-07-09 13:03:53 on dist-test-slave-vl1s"
I20260709 13:03:53.464632 18300 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskKd2k48/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602220613947-18300-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskKd2k48/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602220613947-18300-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskKd2k48/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602220613947-18300-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:03:53.474189 18300 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:03:53.475382 18300 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:03:53.476693 18300 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:03:53.478950 18300 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:03:53.479126 18300 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:03:53.479386 18300 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:03:53.479566 18300 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:03:53.519840 18300 rpc_server.cc:307] RPC server started. Bound to: 127.17.223.1:46065
I20260709 13:03:53.519927 18944 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.17.223.1:46065 every 8 connection(s)
I20260709 13:03:53.524801 18300 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:03:53.531958 18949 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:03:53.532193 18950 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:03:53.535215 18300 server_base.cc:1061] running on GCE node
W20260709 13:03:53.535187 18952 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:03:53.536993 18300 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:03:53.537187 18300 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:03:53.537422 18300 hybrid_clock.cc:648] HybridClock initialized: now 1783602233537397 us; error 0 us; skew 500 ppm
I20260709 13:03:53.537933 18300 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:03:53.537976 18945 heartbeater.cc:344] Connected to a master server at 127.17.223.62:37375
I20260709 13:03:53.538378 18945 heartbeater.cc:461] Registering TS with master...
I20260709 13:03:53.539213 18945 heartbeater.cc:507] Master 127.17.223.62:37375 requested a full tablet report, sending...
I20260709 13:03:53.540727 18300 webserver.cc:533] Webserver started at http://127.17.223.2:45971/ using document root <none> and password file <none>
I20260709 13:03:53.541273 18300 fs_manager.cc:362] Metadata directory not provided
I20260709 13:03:53.541393 18818 ts_manager.cc:194] Registered new tserver with Master: c611bf5baef04660ada573aaf2ae7740 (127.17.223.1:46065)
I20260709 13:03:53.541507 18300 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:03:53.541894 18300 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:03:53.543108 18300 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskKd2k48/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602220613947-18300-0/minicluster-data/ts-1-root/instance:
uuid: "08100eb76c5a4fbd97f5a0b81c40f75d"
format_stamp: "Formatted at 2026-07-09 13:03:53 on dist-test-slave-vl1s"
I20260709 13:03:53.543200 18818 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:54982
I20260709 13:03:53.547950 18300 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.004s	sys 0.000s
I20260709 13:03:53.551247 18957 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:03:53.552013 18300 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.001s
I20260709 13:03:53.552313 18300 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskKd2k48/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602220613947-18300-0/minicluster-data/ts-1-root
uuid: "08100eb76c5a4fbd97f5a0b81c40f75d"
format_stamp: "Formatted at 2026-07-09 13:03:53 on dist-test-slave-vl1s"
I20260709 13:03:53.552598 18300 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskKd2k48/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602220613947-18300-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskKd2k48/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602220613947-18300-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskKd2k48/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602220613947-18300-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:03:53.563342 18300 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:03:53.564523 18300 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:03:53.566056 18300 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:03:53.568261 18300 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:03:53.568495 18300 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:03:53.568738 18300 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:03:53.568908 18300 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:03:53.608165 18300 rpc_server.cc:307] RPC server started. Bound to: 127.17.223.2:37843
I20260709 13:03:53.608256 19019 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.17.223.2:37843 every 8 connection(s)
I20260709 13:03:53.612661 18300 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:03:53.620091 19023 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:03:53.622125 19024 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:03:53.625118 19026 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:03:53.626047 18300 server_base.cc:1061] running on GCE node
I20260709 13:03:53.626420 19020 heartbeater.cc:344] Connected to a master server at 127.17.223.62:37375
I20260709 13:03:53.626873 19020 heartbeater.cc:461] Registering TS with master...
I20260709 13:03:53.627130 18300 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:03:53.627380 18300 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:03:53.627575 18300 hybrid_clock.cc:648] HybridClock initialized: now 1783602233627556 us; error 0 us; skew 500 ppm
I20260709 13:03:53.627744 19020 heartbeater.cc:507] Master 127.17.223.62:37375 requested a full tablet report, sending...
I20260709 13:03:53.628302 18300 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:03:53.629912 18818 ts_manager.cc:194] Registered new tserver with Master: 08100eb76c5a4fbd97f5a0b81c40f75d (127.17.223.2:37843)
I20260709 13:03:53.630908 18300 webserver.cc:533] Webserver started at http://127.17.223.3:45753/ using document root <none> and password file <none>
I20260709 13:03:53.631429 18300 fs_manager.cc:362] Metadata directory not provided
I20260709 13:03:53.631422 18818 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:54984
I20260709 13:03:53.631788 18300 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:03:53.632099 18300 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:03:53.633441 18300 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskKd2k48/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602220613947-18300-0/minicluster-data/ts-2-root/instance:
uuid: "99b9b6a915a94310ba479b4d3ee7c966"
format_stamp: "Formatted at 2026-07-09 13:03:53 on dist-test-slave-vl1s"
I20260709 13:03:53.637835 18300 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.002s	sys 0.004s
I20260709 13:03:53.641151 19031 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:03:53.642004 18300 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260709 13:03:53.642318 18300 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskKd2k48/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602220613947-18300-0/minicluster-data/ts-2-root
uuid: "99b9b6a915a94310ba479b4d3ee7c966"
format_stamp: "Formatted at 2026-07-09 13:03:53 on dist-test-slave-vl1s"
I20260709 13:03:53.642606 18300 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskKd2k48/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602220613947-18300-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskKd2k48/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602220613947-18300-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskKd2k48/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602220613947-18300-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:03:53.658057 18300 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:03:53.659394 18300 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:03:53.660920 18300 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:03:53.663305 18300 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:03:53.663542 18300 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:03:53.663793 18300 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:03:53.663976 18300 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:03:53.705227 18300 rpc_server.cc:307] RPC server started. Bound to: 127.17.223.3:36031
I20260709 13:03:53.705315 19093 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.17.223.3:36031 every 8 connection(s)
I20260709 13:03:53.719436 19094 heartbeater.cc:344] Connected to a master server at 127.17.223.62:37375
I20260709 13:03:53.719825 19094 heartbeater.cc:461] Registering TS with master...
I20260709 13:03:53.720611 19094 heartbeater.cc:507] Master 127.17.223.62:37375 requested a full tablet report, sending...
I20260709 13:03:53.722496 18818 ts_manager.cc:194] Registered new tserver with Master: 99b9b6a915a94310ba479b4d3ee7c966 (127.17.223.3:36031)
I20260709 13:03:53.722994 18300 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.014313212s
I20260709 13:03:53.724220 18818 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:54992
I20260709 13:03:53.747859 18818 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:55006:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\314\314\314\014\004\001\000\230\231\231\031\004\001\000dff&\004\001\0000333\004\001\000\374\377\377?\004\001\000\310\314\314L\004\001\000\224\231\231Y\004\001\000`fff\004\001\000,33s""\004\001\000\314\314\314\014\004\001\000\230\231\231\031\004\001\000dff&\004\001\0000333\004\001\000\374\377\377?\004\001\000\310\314\314L\004\001\000\224\231\231Y\004\001\000`fff\004\001\000,33s"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:03:53.750514 18818 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:03:53.822256 18910 tablet_service.cc:1511] Processing CreateTablet for tablet 7c52a94485bd40e6a022a546c42407b4 (DEFAULT_TABLE table=test-workload [id=5eb88eb16fba4650a4bae85635ba412d]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 13:03:53.823830 18910 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7c52a94485bd40e6a022a546c42407b4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:53.823380 18984 tablet_service.cc:1511] Processing CreateTablet for tablet a8c3aa064aaa42b5b251eab220ab5e44 (DEFAULT_TABLE table=test-workload [id=5eb88eb16fba4650a4bae85635ba412d]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 13:03:53.824909 18984 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a8c3aa064aaa42b5b251eab220ab5e44. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:53.825313 18982 tablet_service.cc:1511] Processing CreateTablet for tablet c6c129816ac441a8bef29b84b78b791e (DEFAULT_TABLE table=test-workload [id=5eb88eb16fba4650a4bae85635ba412d]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 13:03:53.826614 18982 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c6c129816ac441a8bef29b84b78b791e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:53.823380 18909 tablet_service.cc:1511] Processing CreateTablet for tablet a8c3aa064aaa42b5b251eab220ab5e44 (DEFAULT_TABLE table=test-workload [id=5eb88eb16fba4650a4bae85635ba412d]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 13:03:53.824534 18908 tablet_service.cc:1511] Processing CreateTablet for tablet 1109aee81b854cdcbac189f499fb0912 (DEFAULT_TABLE table=test-workload [id=5eb88eb16fba4650a4bae85635ba412d]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 13:03:53.823460 18983 tablet_service.cc:1511] Processing CreateTablet for tablet 1109aee81b854cdcbac189f499fb0912 (DEFAULT_TABLE table=test-workload [id=5eb88eb16fba4650a4bae85635ba412d]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 13:03:53.828032 18909 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a8c3aa064aaa42b5b251eab220ab5e44. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:53.828851 18983 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1109aee81b854cdcbac189f499fb0912. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:53.826261 18907 tablet_service.cc:1511] Processing CreateTablet for tablet c6c129816ac441a8bef29b84b78b791e (DEFAULT_TABLE table=test-workload [id=5eb88eb16fba4650a4bae85635ba412d]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 13:03:53.822256 18985 tablet_service.cc:1511] Processing CreateTablet for tablet 7c52a94485bd40e6a022a546c42407b4 (DEFAULT_TABLE table=test-workload [id=5eb88eb16fba4650a4bae85635ba412d]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 13:03:53.832033 18907 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c6c129816ac441a8bef29b84b78b791e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:53.832048 18985 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7c52a94485bd40e6a022a546c42407b4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:53.835044 18908 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1109aee81b854cdcbac189f499fb0912. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:53.839444 18906 tablet_service.cc:1511] Processing CreateTablet for tablet 382fc7fe4d2e47af99f993423be05a77 (DEFAULT_TABLE table=test-workload [id=5eb88eb16fba4650a4bae85635ba412d]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 13:03:53.840829 18906 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 382fc7fe4d2e47af99f993423be05a77. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:53.845641 18981 tablet_service.cc:1511] Processing CreateTablet for tablet 382fc7fe4d2e47af99f993423be05a77 (DEFAULT_TABLE table=test-workload [id=5eb88eb16fba4650a4bae85635ba412d]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 13:03:53.846441 18905 tablet_service.cc:1511] Processing CreateTablet for tablet 635268a9733742f3aa2abc8ce5779d9f (DEFAULT_TABLE table=test-workload [id=5eb88eb16fba4650a4bae85635ba412d]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 13:03:53.847481 18981 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 382fc7fe4d2e47af99f993423be05a77. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:53.848271 18905 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 635268a9733742f3aa2abc8ce5779d9f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:53.855024 18980 tablet_service.cc:1511] Processing CreateTablet for tablet 635268a9733742f3aa2abc8ce5779d9f (DEFAULT_TABLE table=test-workload [id=5eb88eb16fba4650a4bae85635ba412d]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 13:03:53.856653 18980 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 635268a9733742f3aa2abc8ce5779d9f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:53.864805 19059 tablet_service.cc:1511] Processing CreateTablet for tablet 7c52a94485bd40e6a022a546c42407b4 (DEFAULT_TABLE table=test-workload [id=5eb88eb16fba4650a4bae85635ba412d]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 13:03:53.868482 19059 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7c52a94485bd40e6a022a546c42407b4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:53.869127 19058 tablet_service.cc:1511] Processing CreateTablet for tablet a8c3aa064aaa42b5b251eab220ab5e44 (DEFAULT_TABLE table=test-workload [id=5eb88eb16fba4650a4bae85635ba412d]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 13:03:53.870419 19058 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a8c3aa064aaa42b5b251eab220ab5e44. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:53.872967 19057 tablet_service.cc:1511] Processing CreateTablet for tablet 1109aee81b854cdcbac189f499fb0912 (DEFAULT_TABLE table=test-workload [id=5eb88eb16fba4650a4bae85635ba412d]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 13:03:53.878893 19055 tablet_service.cc:1511] Processing CreateTablet for tablet 382fc7fe4d2e47af99f993423be05a77 (DEFAULT_TABLE table=test-workload [id=5eb88eb16fba4650a4bae85635ba412d]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 13:03:53.876080 19056 tablet_service.cc:1511] Processing CreateTablet for tablet c6c129816ac441a8bef29b84b78b791e (DEFAULT_TABLE table=test-workload [id=5eb88eb16fba4650a4bae85635ba412d]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 13:03:53.881434 19057 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1109aee81b854cdcbac189f499fb0912. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:53.882323 19056 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c6c129816ac441a8bef29b84b78b791e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:53.885244 18910 tablet_service.cc:1511] Processing CreateTablet for tablet b190be4cf1684677b783edcb8f9ae128 (DEFAULT_TABLE table=test-workload [id=5eb88eb16fba4650a4bae85635ba412d]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 13:03:53.886500 18910 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b190be4cf1684677b783edcb8f9ae128. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:53.889941 19054 tablet_service.cc:1511] Processing CreateTablet for tablet 635268a9733742f3aa2abc8ce5779d9f (DEFAULT_TABLE table=test-workload [id=5eb88eb16fba4650a4bae85635ba412d]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 13:03:53.891515 19054 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 635268a9733742f3aa2abc8ce5779d9f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:53.895001 19055 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 382fc7fe4d2e47af99f993423be05a77. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:53.899319 18982 tablet_service.cc:1511] Processing CreateTablet for tablet b190be4cf1684677b783edcb8f9ae128 (DEFAULT_TABLE table=test-workload [id=5eb88eb16fba4650a4bae85635ba412d]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 13:03:53.900624 18982 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b190be4cf1684677b783edcb8f9ae128. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:53.912497 18904 tablet_service.cc:1511] Processing CreateTablet for tablet 05ab4aa1987a441f8eb5811181a6f1c0 (DEFAULT_TABLE table=test-workload [id=5eb88eb16fba4650a4bae85635ba412d]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 13:03:53.914163 18904 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 05ab4aa1987a441f8eb5811181a6f1c0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:53.939495 19109 tablet_bootstrap.cc:492] T 7c52a94485bd40e6a022a546c42407b4 P c611bf5baef04660ada573aaf2ae7740: Bootstrap starting.
I20260709 13:03:53.948109 19053 tablet_service.cc:1511] Processing CreateTablet for tablet b190be4cf1684677b783edcb8f9ae128 (DEFAULT_TABLE table=test-workload [id=5eb88eb16fba4650a4bae85635ba412d]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 13:03:53.949465 19053 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b190be4cf1684677b783edcb8f9ae128. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:53.958660 18983 tablet_service.cc:1511] Processing CreateTablet for tablet 05ab4aa1987a441f8eb5811181a6f1c0 (DEFAULT_TABLE table=test-workload [id=5eb88eb16fba4650a4bae85635ba412d]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 13:03:53.960361 19052 tablet_service.cc:1511] Processing CreateTablet for tablet 05ab4aa1987a441f8eb5811181a6f1c0 (DEFAULT_TABLE table=test-workload [id=5eb88eb16fba4650a4bae85635ba412d]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 13:03:53.961344 18983 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 05ab4aa1987a441f8eb5811181a6f1c0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:53.961611 19052 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 05ab4aa1987a441f8eb5811181a6f1c0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:53.973686 19110 tablet_bootstrap.cc:492] T 382fc7fe4d2e47af99f993423be05a77 P 08100eb76c5a4fbd97f5a0b81c40f75d: Bootstrap starting.
I20260709 13:03:53.980479 18982 tablet_service.cc:1511] Processing CreateTablet for tablet f1e8623946e9415991e70fecebc84607 (DEFAULT_TABLE table=test-workload [id=5eb88eb16fba4650a4bae85635ba412d]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 13:03:53.981853 18982 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f1e8623946e9415991e70fecebc84607. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:53.988770 19111 tablet_bootstrap.cc:492] T a8c3aa064aaa42b5b251eab220ab5e44 P 99b9b6a915a94310ba479b4d3ee7c966: Bootstrap starting.
I20260709 13:03:53.986904 18906 tablet_service.cc:1511] Processing CreateTablet for tablet f1e8623946e9415991e70fecebc84607 (DEFAULT_TABLE table=test-workload [id=5eb88eb16fba4650a4bae85635ba412d]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 13:03:53.993078 18906 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f1e8623946e9415991e70fecebc84607. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:53.994362 19109 tablet_bootstrap.cc:654] T 7c52a94485bd40e6a022a546c42407b4 P c611bf5baef04660ada573aaf2ae7740: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:54.007194 19058 tablet_service.cc:1511] Processing CreateTablet for tablet f1e8623946e9415991e70fecebc84607 (DEFAULT_TABLE table=test-workload [id=5eb88eb16fba4650a4bae85635ba412d]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 13:03:54.009181 19058 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f1e8623946e9415991e70fecebc84607. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:54.008996 18904 tablet_service.cc:1511] Processing CreateTablet for tablet 4c9ffc27fdd54b68bb2d8e2e229ae923 (DEFAULT_TABLE table=test-workload [id=5eb88eb16fba4650a4bae85635ba412d]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 13:03:54.010632 18904 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4c9ffc27fdd54b68bb2d8e2e229ae923. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:54.010542 18983 tablet_service.cc:1511] Processing CreateTablet for tablet 4c9ffc27fdd54b68bb2d8e2e229ae923 (DEFAULT_TABLE table=test-workload [id=5eb88eb16fba4650a4bae85635ba412d]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 13:03:54.011871 18983 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4c9ffc27fdd54b68bb2d8e2e229ae923. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:54.012209 19053 tablet_service.cc:1511] Processing CreateTablet for tablet 4c9ffc27fdd54b68bb2d8e2e229ae923 (DEFAULT_TABLE table=test-workload [id=5eb88eb16fba4650a4bae85635ba412d]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 13:03:54.013361 19053 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4c9ffc27fdd54b68bb2d8e2e229ae923. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:54.016217 19110 tablet_bootstrap.cc:654] T 382fc7fe4d2e47af99f993423be05a77 P 08100eb76c5a4fbd97f5a0b81c40f75d: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:54.045135 19109 tablet_bootstrap.cc:492] T 7c52a94485bd40e6a022a546c42407b4 P c611bf5baef04660ada573aaf2ae7740: No bootstrap required, opened a new log
I20260709 13:03:54.046445 19111 tablet_bootstrap.cc:654] T a8c3aa064aaa42b5b251eab220ab5e44 P 99b9b6a915a94310ba479b4d3ee7c966: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:54.055310 19109 ts_tablet_manager.cc:1403] T 7c52a94485bd40e6a022a546c42407b4 P c611bf5baef04660ada573aaf2ae7740: Time spent bootstrapping tablet: real 0.116s	user 0.016s	sys 0.000s
I20260709 13:03:54.061301 19110 tablet_bootstrap.cc:492] T 382fc7fe4d2e47af99f993423be05a77 P 08100eb76c5a4fbd97f5a0b81c40f75d: No bootstrap required, opened a new log
I20260709 13:03:54.063488 19110 ts_tablet_manager.cc:1403] T 382fc7fe4d2e47af99f993423be05a77 P 08100eb76c5a4fbd97f5a0b81c40f75d: Time spent bootstrapping tablet: real 0.090s	user 0.019s	sys 0.026s
I20260709 13:03:54.061158 19109 raft_consensus.cc:359] T 7c52a94485bd40e6a022a546c42407b4 P c611bf5baef04660ada573aaf2ae7740 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c611bf5baef04660ada573aaf2ae7740" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 46065 } } peers { permanent_uuid: "08100eb76c5a4fbd97f5a0b81c40f75d" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 37843 } } peers { permanent_uuid: "99b9b6a915a94310ba479b4d3ee7c966" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36031 } }
I20260709 13:03:54.065492 19109 raft_consensus.cc:385] T 7c52a94485bd40e6a022a546c42407b4 P c611bf5baef04660ada573aaf2ae7740 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:54.065908 19109 raft_consensus.cc:740] T 7c52a94485bd40e6a022a546c42407b4 P c611bf5baef04660ada573aaf2ae7740 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c611bf5baef04660ada573aaf2ae7740, State: Initialized, Role: FOLLOWER
I20260709 13:03:54.066658 19109 consensus_queue.cc:260] T 7c52a94485bd40e6a022a546c42407b4 P c611bf5baef04660ada573aaf2ae7740 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c611bf5baef04660ada573aaf2ae7740" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 46065 } } peers { permanent_uuid: "08100eb76c5a4fbd97f5a0b81c40f75d" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 37843 } } peers { permanent_uuid: "99b9b6a915a94310ba479b4d3ee7c966" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36031 } }
I20260709 13:03:54.066701 19110 raft_consensus.cc:359] T 382fc7fe4d2e47af99f993423be05a77 P 08100eb76c5a4fbd97f5a0b81c40f75d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c611bf5baef04660ada573aaf2ae7740" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 46065 } } peers { permanent_uuid: "08100eb76c5a4fbd97f5a0b81c40f75d" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 37843 } } peers { permanent_uuid: "99b9b6a915a94310ba479b4d3ee7c966" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36031 } }
I20260709 13:03:54.069708 19110 raft_consensus.cc:385] T 382fc7fe4d2e47af99f993423be05a77 P 08100eb76c5a4fbd97f5a0b81c40f75d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:54.070111 19110 raft_consensus.cc:740] T 382fc7fe4d2e47af99f993423be05a77 P 08100eb76c5a4fbd97f5a0b81c40f75d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 08100eb76c5a4fbd97f5a0b81c40f75d, State: Initialized, Role: FOLLOWER
I20260709 13:03:54.069895 19111 tablet_bootstrap.cc:492] T a8c3aa064aaa42b5b251eab220ab5e44 P 99b9b6a915a94310ba479b4d3ee7c966: No bootstrap required, opened a new log
I20260709 13:03:54.070947 19111 ts_tablet_manager.cc:1403] T a8c3aa064aaa42b5b251eab220ab5e44 P 99b9b6a915a94310ba479b4d3ee7c966: Time spent bootstrapping tablet: real 0.082s	user 0.012s	sys 0.000s
I20260709 13:03:54.070981 19110 consensus_queue.cc:260] T 382fc7fe4d2e47af99f993423be05a77 P 08100eb76c5a4fbd97f5a0b81c40f75d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c611bf5baef04660ada573aaf2ae7740" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 46065 } } peers { permanent_uuid: "08100eb76c5a4fbd97f5a0b81c40f75d" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 37843 } } peers { permanent_uuid: "99b9b6a915a94310ba479b4d3ee7c966" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36031 } }
I20260709 13:03:54.073503 19020 heartbeater.cc:499] Master 127.17.223.62:37375 was elected leader, sending a full tablet report...
I20260709 13:03:54.073453 19111 raft_consensus.cc:359] T a8c3aa064aaa42b5b251eab220ab5e44 P 99b9b6a915a94310ba479b4d3ee7c966 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c611bf5baef04660ada573aaf2ae7740" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 46065 } } peers { permanent_uuid: "08100eb76c5a4fbd97f5a0b81c40f75d" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 37843 } } peers { permanent_uuid: "99b9b6a915a94310ba479b4d3ee7c966" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36031 } }
I20260709 13:03:54.074118 19110 ts_tablet_manager.cc:1434] T 382fc7fe4d2e47af99f993423be05a77 P 08100eb76c5a4fbd97f5a0b81c40f75d: Time spent starting tablet: real 0.010s	user 0.007s	sys 0.000s
I20260709 13:03:54.074189 19111 raft_consensus.cc:385] T a8c3aa064aaa42b5b251eab220ab5e44 P 99b9b6a915a94310ba479b4d3ee7c966 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:54.074621 19111 raft_consensus.cc:740] T a8c3aa064aaa42b5b251eab220ab5e44 P 99b9b6a915a94310ba479b4d3ee7c966 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 99b9b6a915a94310ba479b4d3ee7c966, State: Initialized, Role: FOLLOWER
I20260709 13:03:54.075469 19110 tablet_bootstrap.cc:492] T c6c129816ac441a8bef29b84b78b791e P 08100eb76c5a4fbd97f5a0b81c40f75d: Bootstrap starting.
I20260709 13:03:54.077833 18945 heartbeater.cc:499] Master 127.17.223.62:37375 was elected leader, sending a full tablet report...
I20260709 13:03:54.078382 19109 ts_tablet_manager.cc:1434] T 7c52a94485bd40e6a022a546c42407b4 P c611bf5baef04660ada573aaf2ae7740: Time spent starting tablet: real 0.021s	user 0.002s	sys 0.005s
I20260709 13:03:54.079296 19109 tablet_bootstrap.cc:492] T c6c129816ac441a8bef29b84b78b791e P c611bf5baef04660ada573aaf2ae7740: Bootstrap starting.
I20260709 13:03:54.075489 19111 consensus_queue.cc:260] T a8c3aa064aaa42b5b251eab220ab5e44 P 99b9b6a915a94310ba479b4d3ee7c966 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c611bf5baef04660ada573aaf2ae7740" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 46065 } } peers { permanent_uuid: "08100eb76c5a4fbd97f5a0b81c40f75d" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 37843 } } peers { permanent_uuid: "99b9b6a915a94310ba479b4d3ee7c966" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36031 } }
I20260709 13:03:54.081424 19094 heartbeater.cc:499] Master 127.17.223.62:37375 was elected leader, sending a full tablet report...
I20260709 13:03:54.084038 19110 tablet_bootstrap.cc:654] T c6c129816ac441a8bef29b84b78b791e P 08100eb76c5a4fbd97f5a0b81c40f75d: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:54.085515 19111 ts_tablet_manager.cc:1434] T a8c3aa064aaa42b5b251eab220ab5e44 P 99b9b6a915a94310ba479b4d3ee7c966: Time spent starting tablet: real 0.014s	user 0.006s	sys 0.000s
I20260709 13:03:54.091830 19110 tablet_bootstrap.cc:492] T c6c129816ac441a8bef29b84b78b791e P 08100eb76c5a4fbd97f5a0b81c40f75d: No bootstrap required, opened a new log
I20260709 13:03:54.092352 19110 ts_tablet_manager.cc:1403] T c6c129816ac441a8bef29b84b78b791e P 08100eb76c5a4fbd97f5a0b81c40f75d: Time spent bootstrapping tablet: real 0.017s	user 0.004s	sys 0.008s
I20260709 13:03:54.085601 19109 tablet_bootstrap.cc:654] T c6c129816ac441a8bef29b84b78b791e P c611bf5baef04660ada573aaf2ae7740: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:54.095013 19111 tablet_bootstrap.cc:492] T c6c129816ac441a8bef29b84b78b791e P 99b9b6a915a94310ba479b4d3ee7c966: Bootstrap starting.
I20260709 13:03:54.095372 19110 raft_consensus.cc:359] T c6c129816ac441a8bef29b84b78b791e P 08100eb76c5a4fbd97f5a0b81c40f75d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c611bf5baef04660ada573aaf2ae7740" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 46065 } } peers { permanent_uuid: "08100eb76c5a4fbd97f5a0b81c40f75d" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 37843 } } peers { permanent_uuid: "99b9b6a915a94310ba479b4d3ee7c966" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36031 } }
I20260709 13:03:54.096210 19110 raft_consensus.cc:385] T c6c129816ac441a8bef29b84b78b791e P 08100eb76c5a4fbd97f5a0b81c40f75d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:54.096585 19110 raft_consensus.cc:740] T c6c129816ac441a8bef29b84b78b791e P 08100eb76c5a4fbd97f5a0b81c40f75d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 08100eb76c5a4fbd97f5a0b81c40f75d, State: Initialized, Role: FOLLOWER
I20260709 13:03:54.097669 19110 consensus_queue.cc:260] T c6c129816ac441a8bef29b84b78b791e P 08100eb76c5a4fbd97f5a0b81c40f75d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c611bf5baef04660ada573aaf2ae7740" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 46065 } } peers { permanent_uuid: "08100eb76c5a4fbd97f5a0b81c40f75d" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 37843 } } peers { permanent_uuid: "99b9b6a915a94310ba479b4d3ee7c966" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36031 } }
I20260709 13:03:54.100160 19110 ts_tablet_manager.cc:1434] T c6c129816ac441a8bef29b84b78b791e P 08100eb76c5a4fbd97f5a0b81c40f75d: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 13:03:54.101150 19110 tablet_bootstrap.cc:492] T 7c52a94485bd40e6a022a546c42407b4 P 08100eb76c5a4fbd97f5a0b81c40f75d: Bootstrap starting.
I20260709 13:03:54.103860 19111 tablet_bootstrap.cc:654] T c6c129816ac441a8bef29b84b78b791e P 99b9b6a915a94310ba479b4d3ee7c966: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:54.107913 19110 tablet_bootstrap.cc:654] T 7c52a94485bd40e6a022a546c42407b4 P 08100eb76c5a4fbd97f5a0b81c40f75d: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:54.111404 19109 tablet_bootstrap.cc:492] T c6c129816ac441a8bef29b84b78b791e P c611bf5baef04660ada573aaf2ae7740: No bootstrap required, opened a new log
I20260709 13:03:54.111990 19109 ts_tablet_manager.cc:1403] T c6c129816ac441a8bef29b84b78b791e P c611bf5baef04660ada573aaf2ae7740: Time spent bootstrapping tablet: real 0.033s	user 0.008s	sys 0.014s
I20260709 13:03:54.113337 19111 tablet_bootstrap.cc:492] T c6c129816ac441a8bef29b84b78b791e P 99b9b6a915a94310ba479b4d3ee7c966: No bootstrap required, opened a new log
I20260709 13:03:54.113901 19111 ts_tablet_manager.cc:1403] T c6c129816ac441a8bef29b84b78b791e P 99b9b6a915a94310ba479b4d3ee7c966: Time spent bootstrapping tablet: real 0.019s	user 0.004s	sys 0.012s
I20260709 13:03:54.115280 19109 raft_consensus.cc:359] T c6c129816ac441a8bef29b84b78b791e P c611bf5baef04660ada573aaf2ae7740 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c611bf5baef04660ada573aaf2ae7740" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 46065 } } peers { permanent_uuid: "08100eb76c5a4fbd97f5a0b81c40f75d" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 37843 } } peers { permanent_uuid: "99b9b6a915a94310ba479b4d3ee7c966" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36031 } }
I20260709 13:03:54.116096 19109 raft_consensus.cc:385] T c6c129816ac441a8bef29b84b78b791e P c611bf5baef04660ada573aaf2ae7740 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:54.116448 19109 raft_consensus.cc:740] T c6c129816ac441a8bef29b84b78b791e P c611bf5baef04660ada573aaf2ae7740 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c611bf5baef04660ada573aaf2ae7740, State: Initialized, Role: FOLLOWER
I20260709 13:03:54.116851 19111 raft_consensus.cc:359] T c6c129816ac441a8bef29b84b78b791e P 99b9b6a915a94310ba479b4d3ee7c966 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c611bf5baef04660ada573aaf2ae7740" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 46065 } } peers { permanent_uuid: "08100eb76c5a4fbd97f5a0b81c40f75d" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 37843 } } peers { permanent_uuid: "99b9b6a915a94310ba479b4d3ee7c966" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36031 } }
I20260709 13:03:54.117558 19111 raft_consensus.cc:385] T c6c129816ac441a8bef29b84b78b791e P 99b9b6a915a94310ba479b4d3ee7c966 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:54.118124 19111 raft_consensus.cc:740] T c6c129816ac441a8bef29b84b78b791e P 99b9b6a915a94310ba479b4d3ee7c966 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 99b9b6a915a94310ba479b4d3ee7c966, State: Initialized, Role: FOLLOWER
I20260709 13:03:54.119196 19109 consensus_queue.cc:260] T c6c129816ac441a8bef29b84b78b791e P c611bf5baef04660ada573aaf2ae7740 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c611bf5baef04660ada573aaf2ae7740" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 46065 } } peers { permanent_uuid: "08100eb76c5a4fbd97f5a0b81c40f75d" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 37843 } } peers { permanent_uuid: "99b9b6a915a94310ba479b4d3ee7c966" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36031 } }
I20260709 13:03:54.119277 19111 consensus_queue.cc:260] T c6c129816ac441a8bef29b84b78b791e P 99b9b6a915a94310ba479b4d3ee7c966 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c611bf5baef04660ada573aaf2ae7740" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 46065 } } peers { permanent_uuid: "08100eb76c5a4fbd97f5a0b81c40f75d" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 37843 } } peers { permanent_uuid: "99b9b6a915a94310ba479b4d3ee7c966" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36031 } }
I20260709 13:03:54.122082 19116 raft_consensus.cc:493] T c6c129816ac441a8bef29b84b78b791e P c611bf5baef04660ada573aaf2ae7740 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:54.122368 19111 ts_tablet_manager.cc:1434] T c6c129816ac441a8bef29b84b78b791e P 99b9b6a915a94310ba479b4d3ee7c966: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 13:03:54.122548 19116 raft_consensus.cc:515] T c6c129816ac441a8bef29b84b78b791e P c611bf5baef04660ada573aaf2ae7740 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c611bf5baef04660ada573aaf2ae7740" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 46065 } } peers { permanent_uuid: "08100eb76c5a4fbd97f5a0b81c40f75d" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 37843 } } peers { permanent_uuid: "99b9b6a915a94310ba479b4d3ee7c966" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36031 } }
I20260709 13:03:54.125810 19110 tablet_bootstrap.cc:492] T 7c52a94485bd40e6a022a546c42407b4 P 08100eb76c5a4fbd97f5a0b81c40f75d: No bootstrap required, opened a new log
I20260709 13:03:54.126256 19110 ts_tablet_manager.cc:1403] T 7c52a94485bd40e6a022a546c42407b4 P 08100eb76c5a4fbd97f5a0b81c40f75d: Time spent bootstrapping tablet: real 0.025s	user 0.011s	sys 0.005s
I20260709 13:03:54.129142 19110 raft_consensus.cc:359] T 7c52a94485bd40e6a022a546c42407b4 P 08100eb76c5a4fbd97f5a0b81c40f75d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c611bf5baef04660ada573aaf2ae7740" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 46065 } } peers { permanent_uuid: "08100eb76c5a4fbd97f5a0b81c40f75d" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 37843 } } peers { permanent_uuid: "99b9b6a915a94310ba479b4d3ee7c966" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36031 } }
I20260709 13:03:54.130019 19110 raft_consensus.cc:385] T 7c52a94485bd40e6a022a546c42407b4 P 08100eb76c5a4fbd97f5a0b81c40f75d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:54.130381 19110 raft_consensus.cc:740] T 7c52a94485bd40e6a022a546c42407b4 P 08100eb76c5a4fbd97f5a0b81c40f75d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 08100eb76c5a4fbd97f5a0b81c40f75d, State: Initialized, Role: FOLLOWER
I20260709 13:03:54.128726 19109 ts_tablet_manager.cc:1434] T c6c129816ac441a8bef29b84b78b791e P c611bf5baef04660ada573aaf2ae7740: Time spent starting tablet: real 0.016s	user 0.005s	sys 0.002s
I20260709 13:03:54.129694 19111 tablet_bootstrap.cc:492] T 635268a9733742f3aa2abc8ce5779d9f P 99b9b6a915a94310ba479b4d3ee7c966: Bootstrap starting.
I20260709 13:03:54.132077 19115 raft_consensus.cc:493] T c6c129816ac441a8bef29b84b78b791e P 08100eb76c5a4fbd97f5a0b81c40f75d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:54.132587 19115 raft_consensus.cc:515] T c6c129816ac441a8bef29b84b78b791e P 08100eb76c5a4fbd97f5a0b81c40f75d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c611bf5baef04660ada573aaf2ae7740" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 46065 } } peers { permanent_uuid: "08100eb76c5a4fbd97f5a0b81c40f75d" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 37843 } } peers { permanent_uuid: "99b9b6a915a94310ba479b4d3ee7c966" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36031 } }
I20260709 13:03:54.133155 19116 leader_election.cc:290] T c6c129816ac441a8bef29b84b78b791e P c611bf5baef04660ada573aaf2ae7740 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 08100eb76c5a4fbd97f5a0b81c40f75d (127.17.223.2:37843), 99b9b6a915a94310ba479b4d3ee7c966 (127.17.223.3:36031)
I20260709 13:03:54.135409 19115 leader_election.cc:290] T c6c129816ac441a8bef29b84b78b791e P 08100eb76c5a4fbd97f5a0b81c40f75d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c611bf5baef04660ada573aaf2ae7740 (127.17.223.1:46065), 99b9b6a915a94310ba479b4d3ee7c966 (127.17.223.3:36031)
I20260709 13:03:54.139794 19111 tablet_bootstrap.cc:654] T 635268a9733742f3aa2abc8ce5779d9f P 99b9b6a915a94310ba479b4d3ee7c966: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:54.131340 19110 consensus_queue.cc:260] T 7c52a94485bd40e6a022a546c42407b4 P 08100eb76c5a4fbd97f5a0b81c40f75d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c611bf5baef04660ada573aaf2ae7740" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 46065 } } peers { permanent_uuid: "08100eb76c5a4fbd97f5a0b81c40f75d" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 37843 } } peers { permanent_uuid: "99b9b6a915a94310ba479b4d3ee7c966" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36031 } }
I20260709 13:03:54.132038 19109 tablet_bootstrap.cc:492] T b190be4cf1684677b783edcb8f9ae128 P c611bf5baef04660ada573aaf2ae7740: Bootstrap starting.
I20260709 13:03:54.145656 19110 ts_tablet_manager.cc:1434] T 7c52a94485bd40e6a022a546c42407b4 P 08100eb76c5a4fbd97f5a0b81c40f75d: Time spent starting tablet: real 0.019s	user 0.004s	sys 0.004s
I20260709 13:03:54.147269 19116 raft_consensus.cc:493] T 7c52a94485bd40e6a022a546c42407b4 P c611bf5baef04660ada573aaf2ae7740 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:54.151955 19110 tablet_bootstrap.cc:492] T a8c3aa064aaa42b5b251eab220ab5e44 P 08100eb76c5a4fbd97f5a0b81c40f75d: Bootstrap starting.
I20260709 13:03:54.151679 19116 raft_consensus.cc:515] T 7c52a94485bd40e6a022a546c42407b4 P c611bf5baef04660ada573aaf2ae7740 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c611bf5baef04660ada573aaf2ae7740" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 46065 } } peers { permanent_uuid: "08100eb76c5a4fbd97f5a0b81c40f75d" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 37843 } } peers { permanent_uuid: "99b9b6a915a94310ba479b4d3ee7c966" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36031 } }
I20260709 13:03:54.155058 19116 leader_election.cc:290] T 7c52a94485bd40e6a022a546c42407b4 P c611bf5baef04660ada573aaf2ae7740 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 08100eb76c5a4fbd97f5a0b81c40f75d (127.17.223.2:37843), 99b9b6a915a94310ba479b4d3ee7c966 (127.17.223.3:36031)
I20260709 13:03:54.160132 19110 tablet_bootstrap.cc:654] T a8c3aa064aaa42b5b251eab220ab5e44 P 08100eb76c5a4fbd97f5a0b81c40f75d: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:54.162148 19109 tablet_bootstrap.cc:654] T b190be4cf1684677b783edcb8f9ae128 P c611bf5baef04660ada573aaf2ae7740: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:54.220112 19069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6c129816ac441a8bef29b84b78b791e" candidate_uuid: "c611bf5baef04660ada573aaf2ae7740" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "99b9b6a915a94310ba479b4d3ee7c966" is_pre_election: true
I20260709 13:03:54.221184 19069 raft_consensus.cc:2468] T c6c129816ac441a8bef29b84b78b791e P 99b9b6a915a94310ba479b4d3ee7c966 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c611bf5baef04660ada573aaf2ae7740 in term 0.
I20260709 13:03:54.222781 19068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c52a94485bd40e6a022a546c42407b4" candidate_uuid: "c611bf5baef04660ada573aaf2ae7740" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "99b9b6a915a94310ba479b4d3ee7c966" is_pre_election: true
I20260709 13:03:54.224984 18995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6c129816ac441a8bef29b84b78b791e" candidate_uuid: "c611bf5baef04660ada573aaf2ae7740" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "08100eb76c5a4fbd97f5a0b81c40f75d" is_pre_election: true
I20260709 13:03:54.225809 18995 raft_consensus.cc:2468] T c6c129816ac441a8bef29b84b78b791e P 08100eb76c5a4fbd97f5a0b81c40f75d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c611bf5baef04660ada573aaf2ae7740 in term 0.
I20260709 13:03:54.224735 18886 leader_election.cc:304] T c6c129816ac441a8bef29b84b78b791e P c611bf5baef04660ada573aaf2ae7740 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 99b9b6a915a94310ba479b4d3ee7c966, c611bf5baef04660ada573aaf2ae7740; no voters: 
W20260709 13:03:54.227407 18886 leader_election.cc:343] T 7c52a94485bd40e6a022a546c42407b4 P c611bf5baef04660ada573aaf2ae7740 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 99b9b6a915a94310ba479b4d3ee7c966 (127.17.223.3:36031): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:54.228214 19116 raft_consensus.cc:2804] T c6c129816ac441a8bef29b84b78b791e P c611bf5baef04660ada573aaf2ae7740 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:03:54.228783 19116 raft_consensus.cc:493] T c6c129816ac441a8bef29b84b78b791e P c611bf5baef04660ada573aaf2ae7740 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:54.229264 19116 raft_consensus.cc:3060] T c6c129816ac441a8bef29b84b78b791e P c611bf5baef04660ada573aaf2ae7740 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:54.235749 18995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c52a94485bd40e6a022a546c42407b4" candidate_uuid: "c611bf5baef04660ada573aaf2ae7740" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "08100eb76c5a4fbd97f5a0b81c40f75d" is_pre_election: true
I20260709 13:03:54.236621 18995 raft_consensus.cc:2468] T 7c52a94485bd40e6a022a546c42407b4 P 08100eb76c5a4fbd97f5a0b81c40f75d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c611bf5baef04660ada573aaf2ae7740 in term 0.
I20260709 13:03:54.240420 18885 leader_election.cc:304] T 7c52a94485bd40e6a022a546c42407b4 P c611bf5baef04660ada573aaf2ae7740 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 08100eb76c5a4fbd97f5a0b81c40f75d, c611bf5baef04660ada573aaf2ae7740; no voters: 99b9b6a915a94310ba479b4d3ee7c966
I20260709 13:03:54.270491 19122 raft_consensus.cc:2804] T 7c52a94485bd40e6a022a546c42407b4 P c611bf5baef04660ada573aaf2ae7740 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:03:54.271106 19122 raft_consensus.cc:493] T 7c52a94485bd40e6a022a546c42407b4 P c611bf5baef04660ada573aaf2ae7740 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:54.271567 19122 raft_consensus.cc:3060] T 7c52a94485bd40e6a022a546c42407b4 P c611bf5baef04660ada573aaf2ae7740 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:54.273170 19109 tablet_bootstrap.cc:492] T b190be4cf1684677b783edcb8f9ae128 P c611bf5baef04660ada573aaf2ae7740: No bootstrap required, opened a new log
I20260709 13:03:54.273826 19109 ts_tablet_manager.cc:1403] T b190be4cf1684677b783edcb8f9ae128 P c611bf5baef04660ada573aaf2ae7740: Time spent bootstrapping tablet: real 0.142s	user 0.033s	sys 0.046s
I20260709 13:03:54.277812 19109 raft_consensus.cc:359] T b190be4cf1684677b783edcb8f9ae128 P c611bf5baef04660ada573aaf2ae7740 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c611bf5baef04660ada573aaf2ae7740" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 46065 } } peers { permanent_uuid: "08100eb76c5a4fbd97f5a0b81c40f75d" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 37843 } } peers { permanent_uuid: "99b9b6a915a94310ba479b4d3ee7c966" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36031 } }
I20260709 13:03:54.278923 19109 raft_consensus.cc:385] T b190be4cf1684677b783edcb8f9ae128 P c611bf5baef04660ada573aaf2ae7740 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:54.279357 19109 raft_consensus.cc:740] T b190be4cf1684677b783edcb8f9ae128 P c611bf5baef04660ada573aaf2ae7740 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c611bf5baef04660ada573aaf2ae7740, State: Initialized, Role: FOLLOWER
I20260709 13:03:54.280403 19109 consensus_queue.cc:260] T b190be4cf1684677b783edcb8f9ae128 P c611bf5baef04660ada573aaf2ae7740 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c611bf5baef04660ada573aaf2ae7740" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 46065 } } peers { permanent_uuid: "08100eb76c5a4fbd97f5a0b81c40f75d" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 37843 } } peers { permanent_uuid: "99b9b6a915a94310ba479b4d3ee7c966" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36031 } }
I20260709 13:03:54.287714 19110 tablet_bootstrap.cc:492] T a8c3aa064aaa42b5b251eab220ab5e44 P 08100eb76c5a4fbd97f5a0b81c40f75d: No bootstrap required, opened a new log
I20260709 13:03:54.288305 19110 ts_tablet_manager.cc:1403] T a8c3aa064aaa42b5b251eab220ab5e44 P 08100eb76c5a4fbd97f5a0b81c40f75d: Time spent bootstrapping tablet: real 0.137s	user 0.048s	sys 0.081s
I20260709 13:03:54.288546 19111 tablet_bootstrap.cc:492] T 635268a9733742f3aa2abc8ce5779d9f P 99b9b6a915a94310ba479b4d3ee7c966: No bootstrap required, opened a new log
I20260709 13:03:54.289055 19111 ts_tablet_manager.cc:1403] T 635268a9733742f3aa2abc8ce5779d9f P 99b9b6a915a94310ba479b4d3ee7c966: Time spent bootstrapping tablet: real 0.160s	user 0.045s	sys 0.106s
I20260709 13:03:54.288741 19116 raft_consensus.cc:515] T c6c129816ac441a8bef29b84b78b791e P c611bf5baef04660ada573aaf2ae7740 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c611bf5baef04660ada573aaf2ae7740" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 46065 } } peers { permanent_uuid: "08100eb76c5a4fbd97f5a0b81c40f75d" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 37843 } } peers { permanent_uuid: "99b9b6a915a94310ba479b4d3ee7c966" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36031 } }
I20260709 13:03:54.294126 19068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6c129816ac441a8bef29b84b78b791e" candidate_uuid: "08100eb76c5a4fbd97f5a0b81c40f75d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "99b9b6a915a94310ba479b4d3ee7c966" is_pre_election: true
I20260709 13:03:54.294836 19068 raft_consensus.cc:2468] T c6c129816ac441a8bef29b84b78b791e P 99b9b6a915a94310ba479b4d3ee7c966 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 08100eb76c5a4fbd97f5a0b81c40f75d in term 0.
I20260709 13:03:54.291327 19110 raft_consensus.cc:359] T a8c3aa064aaa42b5b251eab220ab5e44 P 08100eb76c5a4fbd97f5a0b81c40f75d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c611bf5baef04660ada573aaf2ae7740" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 46065 } } peers { permanent_uuid: "08100eb76c5a4fbd97f5a0b81c40f75d" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 37843 } } peers { permanent_uuid: "99b9b6a915a94310ba479b4d3ee7c966" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36031 } }
I20260709 13:03:54.295616 18920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6c129816ac441a8bef29b84b78b791e" candidate_uuid: "08100eb76c5a4fbd97f5a0b81c40f75d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c611bf5baef04660ada573aaf2ae7740" is_pre_election: true
I20260709 13:03:54.295975 19110 raft_consensus.cc:385] T a8c3aa064aaa42b5b251eab220ab5e44 P 08100eb76c5a4fbd97f5a0b81c40f75d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:54.295928 18961 leader_election.cc:304] T c6c129816ac441a8bef29b84b78b791e P 08100eb76c5a4fbd97f5a0b81c40f75d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 08100eb76c5a4fbd97f5a0b81c40f75d, 99b9b6a915a94310ba479b4d3ee7c966; no voters: 
I20260709 13:03:54.287209 19122 raft_consensus.cc:515] T 7c52a94485bd40e6a022a546c42407b4 P c611bf5baef04660ada573aaf2ae7740 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c611bf5baef04660ada573aaf2ae7740" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 46065 } } peers { permanent_uuid: "08100eb76c5a4fbd97f5a0b81c40f75d" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 37843 } } peers { permanent_uuid: "99b9b6a915a94310ba479b4d3ee7c966" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36031 } }
I20260709 13:03:54.296214 19116 leader_election.cc:290] T c6c129816ac441a8bef29b84b78b791e P c611bf5baef04660ada573aaf2ae7740 [CANDIDATE]: Term 1 election: Requested vote from peers 08100eb76c5a4fbd97f5a0b81c40f75d (127.17.223.2:37843), 99b9b6a915a94310ba479b4d3ee7c966 (127.17.223.3:36031)
I20260709 13:03:54.291932 19111 raft_consensus.cc:359] T 635268a9733742f3aa2abc8ce5779d9f P 99b9b6a915a94310ba479b4d3ee7c966 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c611bf5baef04660ada573aaf2ae7740" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 46065 } } peers { permanent_uuid: "08100eb76c5a4fbd97f5a0b81c40f75d" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 37843 } } peers { permanent_uuid: "99b9b6a915a94310ba479b4d3ee7c966" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36031 } }
I20260709 13:03:54.297874 18995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6c129816ac441a8bef29b84b78b791e" candidate_uuid: "c611bf5baef04660ada573aaf2ae7740" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "08100eb76c5a4fbd97f5a0b81c40f75d"
I20260709 13:03:54.297655 19068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6c129816ac441a8bef29b84b78b791e" candidate_uuid: "c611bf5baef04660ada573aaf2ae7740" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "99b9b6a915a94310ba479b4d3ee7c966"
I20260709 13:03:54.301005 19111 raft_consensus.cc:385] T 635268a9733742f3aa2abc8ce5779d9f P 99b9b6a915a94310ba479b4d3ee7c966 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:54.301362 19111 raft_consensus.cc:740] T 635268a9733742f3aa2abc8ce5779d9f P 99b9b6a915a94310ba479b4d3ee7c966 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 99b9b6a915a94310ba479b4d3ee7c966, State: Initialized, Role: FOLLOWER
I20260709 13:03:54.302452 19109 ts_tablet_manager.cc:1434] T b190be4cf1684677b783edcb8f9ae128 P c611bf5baef04660ada573aaf2ae7740: Time spent starting tablet: real 0.028s	user 0.021s	sys 0.003s
I20260709 13:03:54.302522 18994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c52a94485bd40e6a022a546c42407b4" candidate_uuid: "c611bf5baef04660ada573aaf2ae7740" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "08100eb76c5a4fbd97f5a0b81c40f75d"
I20260709 13:03:54.302409 19111 consensus_queue.cc:260] T 635268a9733742f3aa2abc8ce5779d9f P 99b9b6a915a94310ba479b4d3ee7c966 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c611bf5baef04660ada573aaf2ae7740" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 46065 } } peers { permanent_uuid: "08100eb76c5a4fbd97f5a0b81c40f75d" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 37843 } } peers { permanent_uuid: "99b9b6a915a94310ba479b4d3ee7c966" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36031 } }
I20260709 13:03:54.303263 18994 raft_consensus.cc:3060] T 7c52a94485bd40e6a022a546c42407b4 P 08100eb76c5a4fbd97f5a0b81c40f75d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:54.304962 19111 ts_tablet_manager.cc:1434] T 635268a9733742f3aa2abc8ce5779d9f P 99b9b6a915a94310ba479b4d3ee7c966: Time spent starting tablet: real 0.016s	user 0.005s	sys 0.000s
I20260709 13:03:54.305833 19111 tablet_bootstrap.cc:492] T 382fc7fe4d2e47af99f993423be05a77 P 99b9b6a915a94310ba479b4d3ee7c966: Bootstrap starting.
I20260709 13:03:54.306025 19109 tablet_bootstrap.cc:492] T 1109aee81b854cdcbac189f499fb0912 P c611bf5baef04660ada573aaf2ae7740: Bootstrap starting.
I20260709 13:03:54.296916 19115 raft_consensus.cc:2804] T c6c129816ac441a8bef29b84b78b791e P 08100eb76c5a4fbd97f5a0b81c40f75d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:03:54.301410 19068 raft_consensus.cc:3060] T c6c129816ac441a8bef29b84b78b791e P 99b9b6a915a94310ba479b4d3ee7c966 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:54.296446 18920 raft_consensus.cc:2393] T c6c129816ac441a8bef29b84b78b791e P c611bf5baef04660ada573aaf2ae7740 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 08100eb76c5a4fbd97f5a0b81c40f75d in current term 1: Already voted for candidate c611bf5baef04660ada573aaf2ae7740 in this term.
I20260709 13:03:54.296428 19110 raft_consensus.cc:740] T a8c3aa064aaa42b5b251eab220ab5e44 P 08100eb76c5a4fbd97f5a0b81c40f75d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 08100eb76c5a4fbd97f5a0b81c40f75d, State: Initialized, Role: FOLLOWER
I20260709 13:03:54.309492 19110 consensus_queue.cc:260] T a8c3aa064aaa42b5b251eab220ab5e44 P 08100eb76c5a4fbd97f5a0b81c40f75d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c611bf5baef04660ada573aaf2ae7740" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 46065 } } peers { permanent_uuid: "08100eb76c5a4fbd97f5a0b81c40f75d" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 37843 } } peers { permanent_uuid: "99b9b6a915a94310ba479b4d3ee7c966" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36031 } }
I20260709 13:03:54.312598 19109 tablet_bootstrap.cc:654] T 1109aee81b854cdcbac189f499fb0912 P c611bf5baef04660ada573aaf2ae7740: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:54.313911 19111 tablet_bootstrap.cc:654] T 382fc7fe4d2e47af99f993423be05a77 P 99b9b6a915a94310ba479b4d3ee7c966: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:54.314982 18995 raft_consensus.cc:3060] T c6c129816ac441a8bef29b84b78b791e P 08100eb76c5a4fbd97f5a0b81c40f75d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:54.322081 18995 raft_consensus.cc:2468] T c6c129816ac441a8bef29b84b78b791e P 08100eb76c5a4fbd97f5a0b81c40f75d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c611bf5baef04660ada573aaf2ae7740 in term 1.
I20260709 13:03:54.322600 19115 raft_consensus.cc:493] T c6c129816ac441a8bef29b84b78b791e P 08100eb76c5a4fbd97f5a0b81c40f75d [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:54.322999 19068 raft_consensus.cc:2468] T c6c129816ac441a8bef29b84b78b791e P 99b9b6a915a94310ba479b4d3ee7c966 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c611bf5baef04660ada573aaf2ae7740 in term 1.
I20260709 13:03:54.323153 19115 raft_consensus.cc:3060] T c6c129816ac441a8bef29b84b78b791e P 08100eb76c5a4fbd97f5a0b81c40f75d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:54.324113 18886 leader_election.cc:304] T c6c129816ac441a8bef29b84b78b791e P c611bf5baef04660ada573aaf2ae7740 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 99b9b6a915a94310ba479b4d3ee7c966, c611bf5baef04660ada573aaf2ae7740; no voters: 
I20260709 13:03:54.324908 19109 tablet_bootstrap.cc:492] T 1109aee81b854cdcbac189f499fb0912 P c611bf5baef04660ada573aaf2ae7740: No bootstrap required, opened a new log
I20260709 13:03:54.324987 19116 raft_consensus.cc:2804] T c6c129816ac441a8bef29b84b78b791e P c611bf5baef04660ada573aaf2ae7740 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:03:54.325567 19109 ts_tablet_manager.cc:1403] T 1109aee81b854cdcbac189f499fb0912 P c611bf5baef04660ada573aaf2ae7740: Time spent bootstrapping tablet: real 0.022s	user 0.013s	sys 0.000s
I20260709 13:03:54.325583 19116 raft_consensus.cc:697] T c6c129816ac441a8bef29b84b78b791e P c611bf5baef04660ada573aaf2ae7740 [term 1 LEADER]: Becoming Leader. State: Replica: c611bf5baef04660ada573aaf2ae7740, State: Running, Role: LEADER
I20260709 13:03:54.326628 19116 consensus_queue.cc:237] T c6c129816ac441a8bef29b84b78b791e P c611bf5baef04660ada573aaf2ae7740 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c611bf5baef04660ada573aaf2ae7740" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 46065 } } peers { permanent_uuid: "08100eb76c5a4fbd97f5a0b81c40f75d" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 37843 } } peers { permanent_uuid: "99b9b6a915a94310ba479b4d3ee7c966" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36031 } }
I20260709 13:03:54.329345 19109 raft_consensus.cc:359] T 1109aee81b854cdcbac189f499fb0912 P c611bf5baef04660ada573aaf2ae7740 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c611bf5baef04660ada573aaf2ae7740" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 46065 } } peers { permanent_uuid: "08100eb76c5a4fbd97f5a0b81c40f75d" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 37843 } } peers { permanent_uuid: "99b9b6a915a94310ba479b4d3ee7c966" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36031 } }
I20260709 13:03:54.330287 19109 raft_consensus.cc:385] T 1109aee81b854cdcbac189f499fb0912 P c611bf5baef04660ada573aaf2ae7740 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:54.330713 19109 raft_consensus.cc:740] T 1109aee81b854cdcbac189f499fb0912 P c611bf5baef04660ada573aaf2ae7740 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c611bf5baef04660ada573aaf2ae7740, State: Initialized, Role: FOLLOWER
I20260709 13:03:54.331837 19109 consensus_queue.cc:260] T 1109aee81b854cdcbac189f499fb0912 P c611bf5baef04660ada573aaf2ae7740 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c611bf5baef04660ada573aaf2ae7740" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 46065 } } peers { permanent_uuid: "08100eb76c5a4fbd97f5a0b81c40f75d" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 37843 } } peers { permanent_uuid: "99b9b6a915a94310ba479b4d3ee7c966" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36031 } }
I20260709 13:03:54.334563 19122 leader_election.cc:290] T 7c52a94485bd40e6a022a546c42407b4 P c611bf5baef04660ada573aaf2ae7740 [CANDIDATE]: Term 1 election: Requested vote from peers 08100eb76c5a4fbd97f5a0b81c40f75d (127.17.223.2:37843), 99b9b6a915a94310ba479b4d3ee7c966 (127.17.223.3:36031)
I20260709 13:03:54.335088 19109 ts_tablet_manager.cc:1434] T 1109aee81b854cdcbac189f499fb0912 P c611bf5baef04660ada573aaf2ae7740: Time spent starting tablet: real 0.009s	user 0.008s	sys 0.000s
I20260709 13:03:54.335031 19115 raft_consensus.cc:515] T c6c129816ac441a8bef29b84b78b791e P 08100eb76c5a4fbd97f5a0b81c40f75d [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c611bf5baef04660ada573aaf2ae7740" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 46065 } } peers { permanent_uuid: "08100eb76c5a4fbd97f5a0b81c40f75d" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 37843 } } peers { permanent_uuid: "99b9b6a915a94310ba479b4d3ee7c966" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36031 } }
I20260709 13:03:54.336026 19068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c52a94485bd40e6a022a546c42407b4" candidate_uuid: "c611bf5baef04660ada573aaf2ae7740" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "99b9b6a915a94310ba479b4d3ee7c966"
I20260709 13:03:54.336513 19109 tablet_bootstrap.cc:492] T a8c3aa064aaa42b5b251eab220ab5e44 P c611bf5baef04660ada573aaf2ae7740: Bootstrap starting.
W20260709 13:03:54.337352 18886 leader_election.cc:343] T 7c52a94485bd40e6a022a546c42407b4 P c611bf5baef04660ada573aaf2ae7740 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 99b9b6a915a94310ba479b4d3ee7c966 (127.17.223.3:36031): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:54.338773 19115 leader_election.cc:290] T c6c129816ac441a8bef29b84b78b791e P 08100eb76c5a4fbd97f5a0b81c40f75d [CANDIDATE]: Term 2 election: Requested vote from peers c611bf5baef04660ada573aaf2ae7740 (127.17.223.1:46065), 99b9b6a915a94310ba479b4d3ee7c966 (127.17.223.3:36031)
I20260709 13:03:54.340284 18920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6c129816ac441a8bef29b84b78b791e" candidate_uuid: "08100eb76c5a4fbd97f5a0b81c40f75d" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c611bf5baef04660ada573aaf2ae7740"
I20260709 13:03:54.340950 19068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6c129816ac441a8bef29b84b78b791e" candidate_uuid: "08100eb76c5a4fbd97f5a0b81c40f75d" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "99b9b6a915a94310ba479b4d3ee7c966"
I20260709 13:03:54.341230 19110 ts_tablet_manager.cc:1434] T a8c3aa064aaa42b5b251eab220ab5e44 P 08100eb76c5a4fbd97f5a0b81c40f75d: Time spent starting tablet: real 0.053s	user 0.004s	sys 0.014s
I20260709 13:03:54.341487 19068 raft_consensus.cc:3060] T c6c129816ac441a8bef29b84b78b791e P 99b9b6a915a94310ba479b4d3ee7c966 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:54.342206 19110 tablet_bootstrap.cc:492] T 1109aee81b854cdcbac189f499fb0912 P 08100eb76c5a4fbd97f5a0b81c40f75d: Bootstrap starting.
I20260709 13:03:54.343425 18994 raft_consensus.cc:2468] T 7c52a94485bd40e6a022a546c42407b4 P 08100eb76c5a4fbd97f5a0b81c40f75d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c611bf5baef04660ada573aaf2ae7740 in term 1.
I20260709 13:03:54.345650 18885 leader_election.cc:304] T 7c52a94485bd40e6a022a546c42407b4 P c611bf5baef04660ada573aaf2ae7740 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 08100eb76c5a4fbd97f5a0b81c40f75d, c611bf5baef04660ada573aaf2ae7740; no voters: 99b9b6a915a94310ba479b4d3ee7c966
I20260709 13:03:54.346827 19122 raft_consensus.cc:2804] T 7c52a94485bd40e6a022a546c42407b4 P c611bf5baef04660ada573aaf2ae7740 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:03:54.347277 19122 raft_consensus.cc:697] T 7c52a94485bd40e6a022a546c42407b4 P c611bf5baef04660ada573aaf2ae7740 [term 1 LEADER]: Becoming Leader. State: Replica: c611bf5baef04660ada573aaf2ae7740, State: Running, Role: LEADER
I20260709 13:03:54.348057 19122 consensus_queue.cc:237] T 7c52a94485bd40e6a022a546c42407b4 P c611bf5baef04660ada573aaf2ae7740 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c611bf5baef04660ada573aaf2ae7740" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 46065 } } peers { permanent_uuid: "08100eb76c5a4fbd97f5a0b81c40f75d" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 37843 } } peers { permanent_uuid: "99b9b6a915a94310ba479b4d3ee7c966" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36031 } }
I20260709 13:03:54.348503 19068 raft_consensus.cc:2468] T c6c129816ac441a8bef29b84b78b791e P 99b9b6a915a94310ba479b4d3ee7c966 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 08100eb76c5a4fbd97f5a0b81c40f75d in term 2.
I20260709 13:03:54.348790 19110 tablet_bootstrap.cc:654] T 1109aee81b854cdcbac189f499fb0912 P 08100eb76c5a4fbd97f5a0b81c40f75d: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:54.349750 18961 leader_election.cc:304] T c6c129816ac441a8bef29b84b78b791e P 08100eb76c5a4fbd97f5a0b81c40f75d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 08100eb76c5a4fbd97f5a0b81c40f75d, 99b9b6a915a94310ba479b4d3ee7c966; no voters: c611bf5baef04660ada573aaf2ae7740
I20260709 13:03:54.351289 19132 raft_consensus.cc:2804] T c6c129816ac441a8bef29b84b78b791e P 08100eb76c5a4fbd97f5a0b81c40f75d [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:03:54.351780 19132 raft_consensus.cc:697] T c6c129816ac441a8bef29b84b78b791e P 08100eb76c5a4fbd97f5a0b81c40f75d [term 2 LEADER]: Becoming Leader. State: Replica: 08100eb76c5a4fbd97f5a0b81c40f75d, State: Running, Role: LEADER
I20260709 13:03:54.353073 19111 tablet_bootstrap.cc:492] T 382fc7fe4d2e47af99f993423be05a77 P 99b9b6a915a94310ba479b4d3ee7c966: No bootstrap required, opened a new log
I20260709 13:03:54.353549 19111 ts_tablet_manager.cc:1403] T 382fc7fe4d2e47af99f993423be05a77 P 99b9b6a915a94310ba479b4d3ee7c966: Time spent bootstrapping tablet: real 0.048s	user 0.009s	sys 0.012s
I20260709 13:03:54.352581 19132 consensus_queue.cc:237] T c6c129816ac441a8bef29b84b78b791e P 08100eb76c5a4fbd97f5a0b81c40f75d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c611bf5baef04660ada573aaf2ae7740" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 46065 } } peers { permanent_uuid: "08100eb76c5a4fbd97f5a0b81c40f75d" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 37843 } } peers { permanent_uuid: "99b9b6a915a94310ba479b4d3ee7c966" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36031 } }
I20260709 13:03:54.356072 19109 tablet_bootstrap.cc:654] T a8c3aa064aaa42b5b251eab220ab5e44 P c611bf5baef04660ada573aaf2ae7740: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:54.356542 19111 raft_consensus.cc:359] T 382fc7fe4d2e47af99f993423be05a77 P 99b9b6a915a94310ba479b4d3ee7c966 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c611bf5baef04660ada573aaf2ae7740" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 46065 } } peers { permanent_uuid: "08100eb76c5a4fbd97f5a0b81c40f75d" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 37843 } } peers { permanent_uuid: "99b9b6a915a94310ba479b4d3ee7c966" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36031 } }
I20260709 13:03:54.357228 19111 raft_consensus.cc:385] T 382fc7fe4d2e47af99f993423be05a77 P 99b9b6a915a94310ba479b4d3ee7c966 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:54.357525 19111 raft_consensus.cc:740] T 382fc7fe4d2e47af99f993423be05a77 P 99b9b6a915a94310ba479b4d3ee7c966 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 99b9b6a915a94310ba479b4d3ee7c966, State: Initialized, Role: FOLLOWER
I20260709 13:03:54.360500 19110 tablet_bootstrap.cc:492] T 1109aee81b854cdcbac189f499fb0912 P 08100eb76c5a4fbd97f5a0b81c40f75d: No bootstrap required, opened a new log
I20260709 13:03:54.361045 19110 ts_tablet_manager.cc:1403] T 1109aee81b854cdcbac189f499fb0912 P 08100eb76c5a4fbd97f5a0b81c40f75d: Time spent bootstrapping tablet: real 0.019s	user 0.009s	sys 0.000s
I20260709 13:03:54.363543 19109 tablet_bootstrap.cc:492] T a8c3aa064aaa42b5b251eab220ab5e44 P c611bf5baef04660ada573aaf2ae7740: No bootstrap required, opened a new log
I20260709 13:03:54.364094 19109 ts_tablet_manager.cc:1403] T a8c3aa064aaa42b5b251eab220ab5e44 P c611bf5baef04660ada573aaf2ae7740: Time spent bootstrapping tablet: real 0.028s	user 0.012s	sys 0.000s
I20260709 13:03:54.364439 19110 raft_consensus.cc:359] T 1109aee81b854cdcbac189f499fb0912 P 08100eb76c5a4fbd97f5a0b81c40f75d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c611bf5baef04660ada573aaf2ae7740" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 46065 } } peers { permanent_uuid: "08100eb76c5a4fbd97f5a0b81c40f75d" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 37843 } } peers { permanent_uuid: "99b9b6a915a94310ba479b4d3ee7c966" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36031 } }
I20260709 13:03:54.365208 19110 raft_consensus.cc:385] T 1109aee81b854cdcbac189f499fb0912 P 08100eb76c5a4fbd97f5a0b81c40f75d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:54.365512 19110 raft_consensus.cc:740] T 1109aee81b854cdcbac189f499fb0912 P 08100eb76c5a4fbd97f5a0b81c40f75d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 08100eb76c5a4fbd97f5a0b81c40f75d, State: Initialized, Role: FOLLOWER
I20260709 13:03:54.358242 19111 consensus_queue.cc:260] T 382fc7fe4d2e47af99f993423be05a77 P 99b9b6a915a94310ba479b4d3ee7c966 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c611bf5baef04660ada573aaf2ae7740" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 46065 } } peers { permanent_uuid: "08100eb76c5a4fbd97f5a0b81c40f75d" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 37843 } } peers { permanent_uuid: "99b9b6a915a94310ba479b4d3ee7c966" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36031 } }
I20260709 13:03:54.367686 19111 ts_tablet_manager.cc:1434] T 382fc7fe4d2e47af99f993423be05a77 P 99b9b6a915a94310ba479b4d3ee7c966: Time spent starting tablet: real 0.014s	user 0.007s	sys 0.000s
I20260709 13:03:54.367466 19109 raft_consensus.cc:359] T a8c3aa064aaa42b5b251eab220ab5e44 P c611bf5baef04660ada573aaf2ae7740 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c611bf5baef04660ada573aaf2ae7740" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 46065 } } peers { permanent_uuid: "08100eb76c5a4fbd97f5a0b81c40f75d" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 37843 } } peers { permanent_uuid: "99b9b6a915a94310ba479b4d3ee7c966" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36031 } }
I20260709 13:03:54.368392 19109 raft_consensus.cc:385] T a8c3aa064aaa42b5b251eab220ab5e44 P c611bf5baef04660ada573aaf2ae7740 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:54.368775 19109 raft_consensus.cc:740] T a8c3aa064aaa42b5b251eab220ab5e44 P c611bf5baef04660ada573aaf2ae7740 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c611bf5baef04660ada573aaf2ae7740, State: Initialized, Role: FOLLOWER
I20260709 13:03:54.368973 18818 catalog_manager.cc:5697] T c6c129816ac441a8bef29b84b78b791e P 08100eb76c5a4fbd97f5a0b81c40f75d reported cstate change: term changed from 0 to 2, leader changed from <none> to 08100eb76c5a4fbd97f5a0b81c40f75d (127.17.223.2). New cstate: current_term: 2 leader_uuid: "08100eb76c5a4fbd97f5a0b81c40f75d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c611bf5baef04660ada573aaf2ae7740" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 46065 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "08100eb76c5a4fbd97f5a0b81c40f75d" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 37843 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "99b9b6a915a94310ba479b4d3ee7c966" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36031 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:54.368789 19111 tablet_bootstrap.cc:492] T 7c52a94485bd40e6a022a546c42407b4 P 99b9b6a915a94310ba479b4d3ee7c966: Bootstrap starting.
W20260709 13:03:54.370534 18866 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:03:54.371290 19117 raft_consensus.cc:493] T 635268a9733742f3aa2abc8ce5779d9f P 99b9b6a915a94310ba479b4d3ee7c966 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:54.371763 19117 raft_consensus.cc:515] T 635268a9733742f3aa2abc8ce5779d9f P 99b9b6a915a94310ba479b4d3ee7c966 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c611bf5baef04660ada573aaf2ae7740" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 46065 } } peers { permanent_uuid: "08100eb76c5a4fbd97f5a0b81c40f75d" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 37843 } } peers { permanent_uuid: "99b9b6a915a94310ba479b4d3ee7c966" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36031 } }
I20260709 13:03:54.374516 19117 leader_election.cc:290] T 635268a9733742f3aa2abc8ce5779d9f P 99b9b6a915a94310ba479b4d3ee7c966 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c611bf5baef04660ada573aaf2ae7740 (127.17.223.1:46065), 08100eb76c5a4fbd97f5a0b81c40f75d (127.17.223.2:37843)
I20260709 13:03:54.370101 19109 consensus_queue.cc:260] T a8c3aa064aaa42b5b251eab220ab5e44 P c611bf5baef04660ada573aaf2ae7740 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c611bf5baef04660ada573aaf2ae7740" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 46065 } } peers { permanent_uuid: "08100eb76c5a4fbd97f5a0b81c40f75d" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 37843 } } peers { permanent_uuid: "99b9b6a915a94310ba479b4d3ee7c966" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36031 } }
I20260709 13:03:54.376566 19132 raft_consensus.cc:493] T 382fc7fe4d2e47af99f993423be05a77 P 08100eb76c5a4fbd97f5a0b81c40f75d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:54.376739 19109 ts_tablet_manager.cc:1434] T a8c3aa064aaa42b5b251eab220ab5e44 P c611bf5baef04660ada573aaf2ae7740: Time spent starting tablet: real 0.012s	user 0.006s	sys 0.000s
I20260709 13:03:54.377028 19132 raft_consensus.cc:515] T 382fc7fe4d2e47af99f993423be05a77 P 08100eb76c5a4fbd97f5a0b81c40f75d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c611bf5baef04660ada573aaf2ae7740" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 46065 } } peers { permanent_uuid: "08100eb76c5a4fbd97f5a0b81c40f75d" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 37843 } } peers { permanent_uuid: "99b9b6a915a94310ba479b4d3ee7c966" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36031 } }
I20260709 13:03:54.379374 19132 leader_election.cc:290] T 382fc7fe4d2e47af99f993423be05a77 P 08100eb76c5a4fbd97f5a0b81c40f75d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c611bf5baef04660ada573aaf2ae7740 (127.17.223.1:46065), 99b9b6a915a94310ba479b4d3ee7c966 (127.17.223.3:36031)
I20260709 13:03:54.380045 19109 tablet_bootstrap.cc:492] T 382fc7fe4d2e47af99f993423be05a77 P c611bf5baef04660ada573aaf2ae7740: Bootstrap starting.
I20260709 13:03:54.380651 18920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "382fc7fe4d2e47af99f993423be05a77" candidate_uuid: "08100eb76c5a4fbd97f5a0b81c40f75d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c611bf5baef04660ada573aaf2ae7740" is_pre_election: true
I20260709 13:03:54.382292 19116 raft_consensus.cc:493] T b190be4cf1684677b783edcb8f9ae128 P c611bf5baef04660ada573aaf2ae7740 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:03:54.382401 18958 leader_election.cc:343] T 382fc7fe4d2e47af99f993423be05a77 P 08100eb76c5a4fbd97f5a0b81c40f75d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c611bf5baef04660ada573aaf2ae7740 (127.17.223.1:46065): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:54.382843 19116 raft_consensus.cc:515] T b190be4cf1684677b783edcb8f9ae128 P c611bf5baef04660ada573aaf2ae7740 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c611bf5baef04660ada573aaf2ae7740" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 46065 } } peers { permanent_uuid: "08100eb76c5a4fbd97f5a0b81c40f75d" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 37843 } } peers { permanent_uuid: "99b9b6a915a94310ba479b4d3ee7c966" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36031 } }
I20260709 13:03:54.385257 19111 tablet_bootstrap.cc:654] T 7c52a94485bd40e6a022a546c42407b4 P 99b9b6a915a94310ba479b4d3ee7c966: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:54.385531 19116 leader_election.cc:290] T b190be4cf1684677b783edcb8f9ae128 P c611bf5baef04660ada573aaf2ae7740 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 08100eb76c5a4fbd97f5a0b81c40f75d (127.17.223.2:37843), 99b9b6a915a94310ba479b4d3ee7c966 (127.17.223.3:36031)
I20260709 13:03:54.385726 19110 consensus_queue.cc:260] T 1109aee81b854cdcbac189f499fb0912 P 08100eb76c5a4fbd97f5a0b81c40f75d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c611bf5baef04660ada573aaf2ae7740" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 46065 } } peers { permanent_uuid: "08100eb76c5a4fbd97f5a0b81c40f75d" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 37843 } } peers { permanent_uuid: "99b9b6a915a94310ba479b4d3ee7c966" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36031 } }
I20260709 13:03:54.387115 18994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b190be4cf1684677b783edcb8f9ae128" candidate_uuid: "c611bf5baef04660ada573aaf2ae7740" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "08100eb76c5a4fbd97f5a0b81c40f75d" is_pre_election: true
W20260709 13:03:54.392792 18885 leader_election.cc:343] T b190be4cf1684677b783edcb8f9ae128 P c611bf5baef04660ada573aaf2ae7740 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 08100eb76c5a4fbd97f5a0b81c40f75d (127.17.223.2:37843): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:54.393707 19110 ts_tablet_manager.cc:1434] T 1109aee81b854cdcbac189f499fb0912 P 08100eb76c5a4fbd97f5a0b81c40f75d: Time spent starting tablet: real 0.032s	user 0.005s	sys 0.001s
I20260709 13:03:54.394820 19110 tablet_bootstrap.cc:492] T b190be4cf1684677b783edcb8f9ae128 P 08100eb76c5a4fbd97f5a0b81c40f75d: Bootstrap starting.
I20260709 13:03:54.391296 19109 tablet_bootstrap.cc:654] T 382fc7fe4d2e47af99f993423be05a77 P c611bf5baef04660ada573aaf2ae7740: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:54.406747 19109 tablet_bootstrap.cc:492] T 382fc7fe4d2e47af99f993423be05a77 P c611bf5baef04660ada573aaf2ae7740: No bootstrap required, opened a new log
I20260709 13:03:54.407459 19109 ts_tablet_manager.cc:1403] T 382fc7fe4d2e47af99f993423be05a77 P c611bf5baef04660ada573aaf2ae7740: Time spent bootstrapping tablet: real 0.028s	user 0.010s	sys 0.004s
I20260709 13:03:54.408985 18920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "635268a9733742f3aa2abc8ce5779d9f" candidate_uuid: "99b9b6a915a94310ba479b4d3ee7c966" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c611bf5baef04660ada573aaf2ae7740" is_pre_election: true
W20260709 13:03:54.411087 19032 leader_election.cc:343] T 635268a9733742f3aa2abc8ce5779d9f P 99b9b6a915a94310ba479b4d3ee7c966 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c611bf5baef04660ada573aaf2ae7740 (127.17.223.1:46065): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:54.412492 19117 raft_consensus.cc:493] T a8c3aa064aaa42b5b251eab220ab5e44 P 99b9b6a915a94310ba479b4d3ee7c966 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:54.412951 19117 raft_consensus.cc:515] T a8c3aa064aaa42b5b251eab220ab5e44 P 99b9b6a915a94310ba479b4d3ee7c966 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c611bf5baef04660ada573aaf2ae7740" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 46065 } } peers { permanent_uuid: "08100eb76c5a4fbd97f5a0b81c40f75d" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 37843 } } peers { permanent_uuid: "99b9b6a915a94310ba479b4d3ee7c966" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36031 } }
I20260709 13:03:54.413532 19068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b190be4cf1684677b783edcb8f9ae128" candidate_uuid: "c611bf5baef04660ada573aaf2ae7740" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "99b9b6a915a94310ba479b4d3ee7c966" is_pre_election: true
I20260709 13:03:54.415122 19117 leader_election.cc:290] T a8c3aa064aaa42b5b251eab220ab5e44 P 99b9b6a915a94310ba479b4d3ee7c966 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c611bf5baef04660ada573aaf2ae7740 (127.17.223.1:46065), 08100eb76c5a4fbd97f5a0b81c40f75d (127.17.223.2:37843)
I20260709 13:03:54.415333 19068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "382fc7fe4d2e47af99f993423be05a77" candidate_uuid: "08100eb76c5a4fbd97f5a0b81c40f75d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "99b9b6a915a94310ba479b4d3ee7c966" is_pre_election: true
I20260709 13:03:54.415973 19068 raft_consensus.cc:2468] T 382fc7fe4d2e47af99f993423be05a77 P 99b9b6a915a94310ba479b4d3ee7c966 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 08100eb76c5a4fbd97f5a0b81c40f75d in term 0.
I20260709 13:03:54.416714 19109 raft_consensus.cc:359] T 382fc7fe4d2e47af99f993423be05a77 P c611bf5baef04660ada573aaf2ae7740 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c611bf5baef04660ada573aaf2ae7740" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 46065 } } peers { permanent_uuid: "08100eb76c5a4fbd97f5a0b81c40f75d" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 37843 } } peers { permanent_uuid: "99b9b6a915a94310ba479b4d3ee7c966" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36031 } }
W20260709 13:03:54.417034 18886 leader_election.cc:343] T b190be4cf1684677b783edcb8f9ae128 P c611bf5baef04660ada573aaf2ae7740 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 99b9b6a915a94310ba479b4d3ee7c966 (127.17.223.3:36031): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:54.417593 18886 leader_election.cc:304] T b190be4cf1684677b783edcb8f9ae128 P c611bf5baef04660ada573aaf2ae7740 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c611bf5baef04660ada573aaf2ae7740; no voters: 08100eb76c5a4fbd97f5a0b81c40f75d, 99b9b6a915a94310ba479b4d3ee7c966
I20260709 13:03:54.418072 18961 leader_election.cc:304] T 382fc7fe4d2e47af99f993423be05a77 P 08100eb76c5a4fbd97f5a0b81c40f75d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 08100eb76c5a4fbd97f5a0b81c40f75d, 99b9b6a915a94310ba479b4d3ee7c966; no voters: c611bf5baef04660ada573aaf2ae7740
I20260709 13:03:54.418632 19109 raft_consensus.cc:385] T 382fc7fe4d2e47af99f993423be05a77 P c611bf5baef04660ada573aaf2ae7740 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:54.418735 18920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8c3aa064aaa42b5b251eab220ab5e44" candidate_uuid: "99b9b6a915a94310ba479b4d3ee7c966" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c611bf5baef04660ada573aaf2ae7740" is_pre_election: true
I20260709 13:03:54.418817 19122 raft_consensus.cc:2749] T b190be4cf1684677b783edcb8f9ae128 P c611bf5baef04660ada573aaf2ae7740 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:03:54.419159 19115 raft_consensus.cc:2804] T 382fc7fe4d2e47af99f993423be05a77 P 08100eb76c5a4fbd97f5a0b81c40f75d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:03:54.419106 19109 raft_consensus.cc:740] T 382fc7fe4d2e47af99f993423be05a77 P c611bf5baef04660ada573aaf2ae7740 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c611bf5baef04660ada573aaf2ae7740, State: Initialized, Role: FOLLOWER
I20260709 13:03:54.419443 18920 raft_consensus.cc:2468] T a8c3aa064aaa42b5b251eab220ab5e44 P c611bf5baef04660ada573aaf2ae7740 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 99b9b6a915a94310ba479b4d3ee7c966 in term 0.
I20260709 13:03:54.419720 19115 raft_consensus.cc:493] T 382fc7fe4d2e47af99f993423be05a77 P 08100eb76c5a4fbd97f5a0b81c40f75d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:54.420143 19115 raft_consensus.cc:3060] T 382fc7fe4d2e47af99f993423be05a77 P 08100eb76c5a4fbd97f5a0b81c40f75d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:54.420747 19032 leader_election.cc:304] T a8c3aa064aaa42b5b251eab220ab5e44 P 99b9b6a915a94310ba479b4d3ee7c966 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 99b9b6a915a94310ba479b4d3ee7c966, c611bf5baef04660ada573aaf2ae7740; no voters: 
I20260709 13:03:54.420495 19109 consensus_queue.cc:260] T 382fc7fe4d2e47af99f993423be05a77 P c611bf5baef04660ada573aaf2ae7740 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c611bf5baef04660ada573aaf2ae7740" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 46065 } } peers { permanent_uuid: "08100eb76c5a4fbd97f5a0b81c40f75d" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 37843 } } peers { permanent_uuid: "99b9b6a915a94310ba479b4d3ee7c966" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36031 } }
I20260709 13:03:54.421655 19117 raft_consensus.cc:2804] T a8c3aa064aaa42b5b251eab220ab5e44 P 99b9b6a915a94310ba479b4d3ee7c966 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:03:54.422058 19117 raft_consensus.cc:493] T a8c3aa064aaa42b5b251eab220ab5e44 P 99b9b6a915a94310ba479b4d3ee7c966 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:54.422394 19117 raft_consensus.cc:3060] T a8c3aa064aaa42b5b251eab220ab5e44 P 99b9b6a915a94310ba479b4d3ee7c966 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:54.423164 19110 tablet_bootstrap.cc:654] T b190be4cf1684677b783edcb8f9ae128 P 08100eb76c5a4fbd97f5a0b81c40f75d: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:54.424887 19109 ts_tablet_manager.cc:1434] T 382fc7fe4d2e47af99f993423be05a77 P c611bf5baef04660ada573aaf2ae7740: Time spent starting tablet: real 0.017s	user 0.007s	sys 0.000s
I20260709 13:03:54.429209 19117 raft_consensus.cc:515] T a8c3aa064aaa42b5b251eab220ab5e44 P 99b9b6a915a94310ba479b4d3ee7c966 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c611bf5baef04660ada573aaf2ae7740" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 46065 } } peers { permanent_uuid: "08100eb76c5a4fbd97f5a0b81c40f75d" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 37843 } } peers { permanent_uuid: "99b9b6a915a94310ba479b4d3ee7c966" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36031 } }
I20260709 13:03:54.429209 19109 tablet_bootstrap.cc:492] T 635268a9733742f3aa2abc8ce5779d9f P c611bf5baef04660ada573aaf2ae7740: Bootstrap starting.
I20260709 13:03:54.431066 19111 tablet_bootstrap.cc:492] T 7c52a94485bd40e6a022a546c42407b4 P 99b9b6a915a94310ba479b4d3ee7c966: No bootstrap required, opened a new log
I20260709 13:03:54.431524 19111 ts_tablet_manager.cc:1403] T 7c52a94485bd40e6a022a546c42407b4 P 99b9b6a915a94310ba479b4d3ee7c966: Time spent bootstrapping tablet: real 0.063s	user 0.025s	sys 0.007s
I20260709 13:03:54.432416 18920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8c3aa064aaa42b5b251eab220ab5e44" candidate_uuid: "99b9b6a915a94310ba479b4d3ee7c966" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c611bf5baef04660ada573aaf2ae7740"
I20260709 13:03:54.432603 19117 leader_election.cc:290] T a8c3aa064aaa42b5b251eab220ab5e44 P 99b9b6a915a94310ba479b4d3ee7c966 [CANDIDATE]: Term 1 election: Requested vote from peers c611bf5baef04660ada573aaf2ae7740 (127.17.223.1:46065), 08100eb76c5a4fbd97f5a0b81c40f75d (127.17.223.2:37843)
I20260709 13:03:54.433012 18920 raft_consensus.cc:3060] T a8c3aa064aaa42b5b251eab220ab5e44 P c611bf5baef04660ada573aaf2ae7740 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:54.427130 19115 raft_consensus.cc:515] T 382fc7fe4d2e47af99f993423be05a77 P 08100eb76c5a4fbd97f5a0b81c40f75d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c611bf5baef04660ada573aaf2ae7740" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 46065 } } peers { permanent_uuid: "08100eb76c5a4fbd97f5a0b81c40f75d" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 37843 } } peers { permanent_uuid: "99b9b6a915a94310ba479b4d3ee7c966" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36031 } }
I20260709 13:03:54.435107 19115 leader_election.cc:290] T 382fc7fe4d2e47af99f993423be05a77 P 08100eb76c5a4fbd97f5a0b81c40f75d [CANDIDATE]: Term 1 election: Requested vote from peers c611bf5baef04660ada573aaf2ae7740 (127.17.223.1:46065), 99b9b6a915a94310ba479b4d3ee7c966 (127.17.223.3:36031)
I20260709 13:03:54.436844 18919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "382fc7fe4d2e47af99f993423be05a77" candidate_uuid: "08100eb76c5a4fbd97f5a0b81c40f75d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c611bf5baef04660ada573aaf2ae7740"
I20260709 13:03:54.437462 19109 tablet_bootstrap.cc:654] T 635268a9733742f3aa2abc8ce5779d9f P c611bf5baef04660ada573aaf2ae7740: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:54.437495 18919 raft_consensus.cc:3060] T 382fc7fe4d2e47af99f993423be05a77 P c611bf5baef04660ada573aaf2ae7740 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:54.437629 18995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8c3aa064aaa42b5b251eab220ab5e44" candidate_uuid: "99b9b6a915a94310ba479b4d3ee7c966" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "08100eb76c5a4fbd97f5a0b81c40f75d" is_pre_election: true
I20260709 13:03:54.438303 18995 raft_consensus.cc:2468] T a8c3aa064aaa42b5b251eab220ab5e44 P 08100eb76c5a4fbd97f5a0b81c40f75d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 99b9b6a915a94310ba479b4d3ee7c966 in term 0.
I20260709 13:03:54.440129 18995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8c3aa064aaa42b5b251eab220ab5e44" candidate_uuid: "99b9b6a915a94310ba479b4d3ee7c966" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "08100eb76c5a4fbd97f5a0b81c40f75d"
I20260709 13:03:54.440465 18920 raft_consensus.cc:2468] T a8c3aa064aaa42b5b251eab220ab5e44 P c611bf5baef04660ada573aaf2ae7740 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 99b9b6a915a94310ba479b4d3ee7c966 in term 1.
I20260709 13:03:54.440677 18995 raft_consensus.cc:3060] T a8c3aa064aaa42b5b251eab220ab5e44 P 08100eb76c5a4fbd97f5a0b81c40f75d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:54.441854 19032 leader_election.cc:304] T a8c3aa064aaa42b5b251eab220ab5e44 P 99b9b6a915a94310ba479b4d3ee7c966 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 99b9b6a915a94310ba479b4d3ee7c966, c611bf5baef04660ada573aaf2ae7740; no voters: 
I20260709 13:03:54.445081 18994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "635268a9733742f3aa2abc8ce5779d9f" candidate_uuid: "99b9b6a915a94310ba479b4d3ee7c966" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "08100eb76c5a4fbd97f5a0b81c40f75d" is_pre_election: true
I20260709 13:03:54.446892 19117 raft_consensus.cc:2804] T a8c3aa064aaa42b5b251eab220ab5e44 P 99b9b6a915a94310ba479b4d3ee7c966 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:03:54.447403 18995 raft_consensus.cc:2468] T a8c3aa064aaa42b5b251eab220ab5e44 P 08100eb76c5a4fbd97f5a0b81c40f75d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 99b9b6a915a94310ba479b4d3ee7c966 in term 1.
I20260709 13:03:54.445981 19111 raft_consensus.cc:359] T 7c52a94485bd40e6a022a546c42407b4 P 99b9b6a915a94310ba479b4d3ee7c966 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c611bf5baef04660ada573aaf2ae7740" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 46065 } } peers { permanent_uuid: "08100eb76c5a4fbd97f5a0b81c40f75d" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 37843 } } peers { permanent_uuid: "99b9b6a915a94310ba479b4d3ee7c966" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36031 } }
I20260709 13:03:54.448582 19111 raft_consensus.cc:385] T 7c52a94485bd40e6a022a546c42407b4 P 99b9b6a915a94310ba479b4d3ee7c966 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:54.448896 19111 raft_consensus.cc:740] T 7c52a94485bd40e6a022a546c42407b4 P 99b9b6a915a94310ba479b4d3ee7c966 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 99b9b6a915a94310ba479b4d3ee7c966, State: Initialized, Role: FOLLOWER
I20260709 13:03:54.449502 19068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "382fc7fe4d2e47af99f993423be05a77" candidate_uuid: "08100eb76c5a4fbd97f5a0b81c40f75d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "99b9b6a915a94310ba479b4d3ee7c966"
I20260709 13:03:54.450069 19068 raft_consensus.cc:3060] T 382fc7fe4d2e47af99f993423be05a77 P 99b9b6a915a94310ba479b4d3ee7c966 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:54.449647 19111 consensus_queue.cc:260] T 7c52a94485bd40e6a022a546c42407b4 P 99b9b6a915a94310ba479b4d3ee7c966 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c611bf5baef04660ada573aaf2ae7740" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 46065 } } peers { permanent_uuid: "08100eb76c5a4fbd97f5a0b81c40f75d" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 37843 } } peers { permanent_uuid: "99b9b6a915a94310ba479b4d3ee7c966" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36031 } }
I20260709 13:03:54.454125 19110 tablet_bootstrap.cc:492] T b190be4cf1684677b783edcb8f9ae128 P 08100eb76c5a4fbd97f5a0b81c40f75d: No bootstrap required, opened a new log
I20260709 13:03:54.454768 19117 raft_consensus.cc:697] T a8c3aa064aaa42b5b251eab220ab5e44 P 99b9b6a915a94310ba479b4d3ee7c966 [term 1 LEADER]: Becoming Leader. State: Replica: 99b9b6a915a94310ba479b4d3ee7c966, State: Running, Role: LEADER
I20260709 13:03:54.455914 19117 consensus_queue.cc:237] T a8c3aa064aaa42b5b251eab220ab5e44 P 99b9b6a915a94310ba479b4d3ee7c966 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c611bf5baef04660ada573aaf2ae7740" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 46065 } } peers { permanent_uuid: "08100eb76c5a4fbd97f5a0b81c40f75d" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 37843 } } peers { permanent_uuid: "99b9b6a915a94310ba479b4d3ee7c966" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36031 } }
I20260709 13:03:54.456632 19068 raft_consensus.cc:2468] T 382fc7fe4d2e47af99f993423be05a77 P 99b9b6a915a94310ba479b4d3ee7c966 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 08100eb76c5a4fbd97f5a0b81c40f75d in term 1.
I20260709 13:03:54.457758 18961 leader_election.cc:304] T 382fc7fe4d2e47af99f993423be05a77 P 08100eb76c5a4fbd97f5a0b81c40f75d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 08100eb76c5a4fbd97f5a0b81c40f75d, 99b9b6a915a94310ba479b4d3ee7c966; no voters: 
I20260709 13:03:54.458046 18919 raft_consensus.cc:2468] T 382fc7fe4d2e47af99f993423be05a77 P c611bf5baef04660ada573aaf2ae7740 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 08100eb76c5a4fbd97f5a0b81c40f75d in term 1.
I20260709 13:03:54.458659 19115 raft_consensus.cc:2804] T 382fc7fe4d2e47af99f993423be05a77 P 08100eb76c5a4fbd97f5a0b81c40f75d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:03:54.459357 19115 raft_consensus.cc:697] T 382fc7fe4d2e47af99f993423be05a77 P 08100eb76c5a4fbd97f5a0b81c40f75d [term 1 LEADER]: Becoming Leader. State: Replica: 08100eb76c5a4fbd97f5a0b81c40f75d, State: Running, Role: LEADER
I20260709 13:03:54.460472 19115 consensus_queue.cc:237] T 382fc7fe4d2e47af99f993423be05a77 P 08100eb76c5a4fbd97f5a0b81c40f75d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c611bf5baef04660ada573aaf2ae7740" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 46065 } } peers { permanent_uuid: "08100eb76c5a4fbd97f5a0b81c40f75d" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 37843 } } peers { permanent_uuid: "99b9b6a915a94310ba479b4d3ee7c966" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36031 } }
I20260709 13:03:54.462575 19111 ts_tablet_manager.cc:1434] T 7c52a94485bd40e6a022a546c42407b4 P 99b9b6a915a94310ba479b4d3ee7c966: Time spent starting tablet: real 0.031s	user 0.008s	sys 0.000s
I20260709 13:03:54.463846 19111 tablet_bootstrap.cc:492] T 1109aee81b854cdcbac189f499fb0912 P 99b9b6a915a94310ba479b4d3ee7c966: Bootstrap starting.
I20260709 13:03:54.460088 19110 ts_tablet_manager.cc:1403] T b190be4cf1684677b783edcb8f9ae128 P 08100eb76c5a4fbd97f5a0b81c40f75d: Time spent bootstrapping tablet: real 0.066s	user 0.012s	sys 0.002s
W20260709 13:03:54.462033 19034 leader_election.cc:343] T 635268a9733742f3aa2abc8ce5779d9f P 99b9b6a915a94310ba479b4d3ee7c966 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 08100eb76c5a4fbd97f5a0b81c40f75d (127.17.223.2:37843): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:54.465411 19034 leader_election.cc:304] T 635268a9733742f3aa2abc8ce5779d9f P 99b9b6a915a94310ba479b4d3ee7c966 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 99b9b6a915a94310ba479b4d3ee7c966; no voters: 08100eb76c5a4fbd97f5a0b81c40f75d, c611bf5baef04660ada573aaf2ae7740
I20260709 13:03:54.466379 19149 raft_consensus.cc:2749] T 635268a9733742f3aa2abc8ce5779d9f P 99b9b6a915a94310ba479b4d3ee7c966 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:03:54.467566 19109 tablet_bootstrap.cc:492] T 635268a9733742f3aa2abc8ce5779d9f P c611bf5baef04660ada573aaf2ae7740: No bootstrap required, opened a new log
I20260709 13:03:54.468046 19109 ts_tablet_manager.cc:1403] T 635268a9733742f3aa2abc8ce5779d9f P c611bf5baef04660ada573aaf2ae7740: Time spent bootstrapping tablet: real 0.039s	user 0.018s	sys 0.015s
I20260709 13:03:54.470935 19111 tablet_bootstrap.cc:654] T 1109aee81b854cdcbac189f499fb0912 P 99b9b6a915a94310ba479b4d3ee7c966: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:54.470911 19110 raft_consensus.cc:359] T b190be4cf1684677b783edcb8f9ae128 P 08100eb76c5a4fbd97f5a0b81c40f75d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c611bf5baef04660ada573aaf2ae7740" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 46065 } } peers { permanent_uuid: "08100eb76c5a4fbd97f5a0b81c40f75d" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 37843 } } peers { permanent_uuid: "99b9b6a915a94310ba479b4d3ee7c966" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36031 } }
I20260709 13:03:54.471722 19110 raft_consensus.cc:385] T b190be4cf1684677b783edcb8f9ae128 P 08100eb76c5a4fbd97f5a0b81c40f75d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:54.472051 19110 raft_consensus.cc:740] T b190be4cf1684677b783edcb8f9ae128 P 08100eb76c5a4fbd97f5a0b81c40f75d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 08100eb76c5a4fbd97f5a0b81c40f75d, State: Initialized, Role: FOLLOWER
I20260709 13:03:54.472891 19110 consensus_queue.cc:260] T b190be4cf1684677b783edcb8f9ae128 P 08100eb76c5a4fbd97f5a0b81c40f75d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c611bf5baef04660ada573aaf2ae7740" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 46065 } } peers { permanent_uuid: "08100eb76c5a4fbd97f5a0b81c40f75d" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 37843 } } peers { permanent_uuid: "99b9b6a915a94310ba479b4d3ee7c966" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36031 } }
I20260709 13:03:54.473806 19109 raft_consensus.cc:359] T 635268a9733742f3aa2abc8ce5779d9f P c611bf5baef04660ada573aaf2ae7740 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c611bf5baef04660ada573aaf2ae7740" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 46065 } } peers { permanent_uuid: "08100eb76c5a4fbd97f5a0b81c40f75d" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 37843 } } peers { permanent_uuid: "99b9b6a915a94310ba479b4d3ee7c966" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36031 } }
I20260709 13:03:54.474824 19109 raft_consensus.cc:385] T 635268a9733742f3aa2abc8ce5779d9f P c611bf5baef04660ada573aaf2ae7740 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:54.475570 19110 ts_tablet_manager.cc:1434] T b190be4cf1684677b783edcb8f9ae128 P 08100eb76c5a4fbd97f5a0b81c40f75d: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.001s
I20260709 13:03:54.476076 19109 raft_consensus.cc:740] T 635268a9733742f3aa2abc8ce5779d9f P c611bf5baef04660ada573aaf2ae7740 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c611bf5baef04660ada573aaf2ae7740, State: Initialized, Role: FOLLOWER
I20260709 13:03:54.476874 19110 tablet_bootstrap.cc:492] T 635268a9733742f3aa2abc8ce5779d9f P 08100eb76c5a4fbd97f5a0b81c40f75d: Bootstrap starting.
I20260709 13:03:54.477414 19109 consensus_queue.cc:260] T 635268a9733742f3aa2abc8ce5779d9f P c611bf5baef04660ada573aaf2ae7740 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c611bf5baef04660ada573aaf2ae7740" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 46065 } } peers { permanent_uuid: "08100eb76c5a4fbd97f5a0b81c40f75d" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 37843 } } peers { permanent_uuid: "99b9b6a915a94310ba479b4d3ee7c966" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36031 } }
I20260709 13:03:54.480525 19109 ts_tablet_manager.cc:1434] T 635268a9733742f3aa2abc8ce5779d9f P c611bf5baef04660ada573aaf2ae7740: Time spent starting tablet: real 0.012s	user 0.008s	sys 0.000s
I20260709 13:03:54.481062 19111 tablet_bootstrap.cc:492] T 1109aee81b854cdcbac189f499fb0912 P 99b9b6a915a94310ba479b4d3ee7c966: No bootstrap required, opened a new log
I20260709 13:03:54.481634 19111 ts_tablet_manager.cc:1403] T 1109aee81b854cdcbac189f499fb0912 P 99b9b6a915a94310ba479b4d3ee7c966: Time spent bootstrapping tablet: real 0.018s	user 0.009s	sys 0.004s
I20260709 13:03:54.482405 19109 tablet_bootstrap.cc:492] T 05ab4aa1987a441f8eb5811181a6f1c0 P c611bf5baef04660ada573aaf2ae7740: Bootstrap starting.
I20260709 13:03:54.472747 18818 catalog_manager.cc:5697] T 7c52a94485bd40e6a022a546c42407b4 P c611bf5baef04660ada573aaf2ae7740 reported cstate change: term changed from 0 to 1, leader changed from <none> to c611bf5baef04660ada573aaf2ae7740 (127.17.223.1). New cstate: current_term: 1 leader_uuid: "c611bf5baef04660ada573aaf2ae7740" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c611bf5baef04660ada573aaf2ae7740" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 46065 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "08100eb76c5a4fbd97f5a0b81c40f75d" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 37843 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "99b9b6a915a94310ba479b4d3ee7c966" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36031 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:54.484393 19111 raft_consensus.cc:359] T 1109aee81b854cdcbac189f499fb0912 P 99b9b6a915a94310ba479b4d3ee7c966 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c611bf5baef04660ada573aaf2ae7740" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 46065 } } peers { permanent_uuid: "08100eb76c5a4fbd97f5a0b81c40f75d" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 37843 } } peers { permanent_uuid: "99b9b6a915a94310ba479b4d3ee7c966" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36031 } }
I20260709 13:03:54.485075 19111 raft_consensus.cc:385] T 1109aee81b854cdcbac189f499fb0912 P 99b9b6a915a94310ba479b4d3ee7c966 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:54.485374 19111 raft_consensus.cc:740] T 1109aee81b854cdcbac189f499fb0912 P 99b9b6a915a94310ba479b4d3ee7c966 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 99b9b6a915a94310ba479b4d3ee7c966, State: Initialized, Role: FOLLOWER
I20260709 13:03:54.490299 19110 tablet_bootstrap.cc:654] T 635268a9733742f3aa2abc8ce5779d9f P 08100eb76c5a4fbd97f5a0b81c40f75d: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:54.492561 19111 consensus_queue.cc:260] T 1109aee81b854cdcbac189f499fb0912 P 99b9b6a915a94310ba479b4d3ee7c966 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c611bf5baef04660ada573aaf2ae7740" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 46065 } } peers { permanent_uuid: "08100eb76c5a4fbd97f5a0b81c40f75d" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 37843 } } peers { permanent_uuid: "99b9b6a915a94310ba479b4d3ee7c966" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36031 } }
I20260709 13:03:54.493499 19109 tablet_bootstrap.cc:654] T 05ab4aa1987a441f8eb5811181a6f1c0 P c611bf5baef04660ada573aaf2ae7740: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:54.498185 19111 ts_tablet_manager.cc:1434] T 1109aee81b854cdcbac189f499fb0912 P 99b9b6a915a94310ba479b4d3ee7c966: Time spent starting tablet: real 0.016s	user 0.005s	sys 0.001s
I20260709 13:03:54.499470 19111 tablet_bootstrap.cc:492] T b190be4cf1684677b783edcb8f9ae128 P 99b9b6a915a94310ba479b4d3ee7c966: Bootstrap starting.
I20260709 13:03:54.502228 19110 tablet_bootstrap.cc:492] T 635268a9733742f3aa2abc8ce5779d9f P 08100eb76c5a4fbd97f5a0b81c40f75d: No bootstrap required, opened a new log
I20260709 13:03:54.503947 18815 catalog_manager.cc:5697] T a8c3aa064aaa42b5b251eab220ab5e44 P 99b9b6a915a94310ba479b4d3ee7c966 reported cstate change: term changed from 0 to 1, leader changed from <none> to 99b9b6a915a94310ba479b4d3ee7c966 (127.17.223.3). New cstate: current_term: 1 leader_uuid: "99b9b6a915a94310ba479b4d3ee7c966" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c611bf5baef04660ada573aaf2ae7740" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 46065 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "08100eb76c5a4fbd97f5a0b81c40f75d" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 37843 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "99b9b6a915a94310ba479b4d3ee7c966" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36031 } health_report { overall_health: HEALTHY } } }
I20260709 13:03:54.506789 19111 tablet_bootstrap.cc:654] T b190be4cf1684677b783edcb8f9ae128 P 99b9b6a915a94310ba479b4d3ee7c966: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:54.507679 18814 catalog_manager.cc:5697] T 382fc7fe4d2e47af99f993423be05a77 P 08100eb76c5a4fbd97f5a0b81c40f75d reported cstate change: term changed from 0 to 1, leader changed from <none> to 08100eb76c5a4fbd97f5a0b81c40f75d (127.17.223.2). New cstate: current_term: 1 leader_uuid: "08100eb76c5a4fbd97f5a0b81c40f75d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c611bf5baef04660ada573aaf2ae7740" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 46065 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "08100eb76c5a4fbd97f5a0b81c40f75d" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 37843 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "99b9b6a915a94310ba479b4d3ee7c966" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36031 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:54.512102 19109 tablet_bootstrap.cc:492] T 05ab4aa1987a441f8eb5811181a6f1c0 P c611bf5baef04660ada573aaf2ae7740: No bootstrap required, opened a new log
I20260709 13:03:54.512589 19109 ts_tablet_manager.cc:1403] T 05ab4aa1987a441f8eb5811181a6f1c0 P c611bf5baef04660ada573aaf2ae7740: Time spent bootstrapping tablet: real 0.031s	user 0.009s	sys 0.011s
I20260709 13:03:54.513067 19111 tablet_bootstrap.cc:492] T b190be4cf1684677b783edcb8f9ae128 P 99b9b6a915a94310ba479b4d3ee7c966: No bootstrap required, opened a new log
I20260709 13:03:54.513597 19111 ts_tablet_manager.cc:1403] T b190be4cf1684677b783edcb8f9ae128 P 99b9b6a915a94310ba479b4d3ee7c966: Time spent bootstrapping tablet: real 0.014s	user 0.010s	sys 0.001s
I20260709 13:03:54.515756 19110 ts_tablet_manager.cc:1403] T 635268a9733742f3aa2abc8ce5779d9f P 08100eb76c5a4fbd97f5a0b81c40f75d: Time spent bootstrapping tablet: real 0.039s	user 0.014s	sys 0.004s
I20260709 13:03:54.515415 19109 raft_consensus.cc:359] T 05ab4aa1987a441f8eb5811181a6f1c0 P c611bf5baef04660ada573aaf2ae7740 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c611bf5baef04660ada573aaf2ae7740" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 46065 } } peers { permanent_uuid: "08100eb76c5a4fbd97f5a0b81c40f75d" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 37843 } } peers { permanent_uuid: "99b9b6a915a94310ba479b4d3ee7c966" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36031 } }
I20260709 13:03:54.516152 19109 raft_consensus.cc:385] T 05ab4aa1987a441f8eb5811181a6f1c0 P c611bf5baef04660ada573aaf2ae7740 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:54.516472 19109 raft_consensus.cc:740] T 05ab4aa1987a441f8eb5811181a6f1c0 P c611bf5baef04660ada573aaf2ae7740 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c611bf5baef04660ada573aaf2ae7740, State: Initialized, Role: FOLLOWER
I20260709 13:03:54.516808 19111 raft_consensus.cc:359] T b190be4cf1684677b783edcb8f9ae128 P 99b9b6a915a94310ba479b4d3ee7c966 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c611bf5baef04660ada573aaf2ae7740" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 46065 } } peers { permanent_uuid: "08100eb76c5a4fbd97f5a0b81c40f75d" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 37843 } } peers { permanent_uuid: "99b9b6a915a94310ba479b4d3ee7c966" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36031 } }
I20260709 13:03:54.517609 19111 raft_consensus.cc:385] T b190be4cf1684677b783edcb8f9ae128 P 99b9b6a915a94310ba479b4d3ee7c966 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:54.517946 19111 raft_consensus.cc:740] T b190be4cf1684677b783edcb8f9ae128 P 99b9b6a915a94310ba479b4d3ee7c966 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 99b9b6a915a94310ba479b4d3ee7c966, State: Initialized, Role: FOLLOWER
I20260709 13:03:54.518857 19111 consensus_queue.cc:260] T b190be4cf1684677b783edcb8f9ae128 P 99b9b6a915a94310ba479b4d3ee7c966 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c611bf5baef04660ada573aaf2ae7740" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 46065 } } peers { permanent_uuid: "08100eb76c5a4fbd97f5a0b81c40f75d" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 37843 } } peers { permanent_uuid: "99b9b6a915a94310ba479b4d3ee7c966" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36031 } }
I20260709 13:03:54.519951 19109 consensus_queue.cc:260] T 05ab4aa1987a441f8eb5811181a6f1c0 P c611bf5baef04660ada573aaf2ae7740 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c611bf5baef04660ada573aaf2ae7740" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 46065 } } peers { permanent_uuid: "08100eb76c5a4fbd97f5a0b81c40f75d" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 37843 } } peers { permanent_uuid: "99b9b6a915a94310ba479b4d3ee7c966" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36031 } }
I20260709 13:03:54.521782 19111 ts_tablet_manager.cc:1434] T b190be4cf1684677b783edcb8f9ae128 P 99b9b6a915a94310ba479b4d3ee7c966: Time spent starting tablet: real 0.008s	user 0.009s	sys 0.000s
I20260709 13:03:54.522217 19109 ts_tablet_manager.cc:1434] T 05ab4aa1987a441f8eb5811181a6f1c0 P c611bf5baef04660ada573aaf2ae7740: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.001s
I20260709 13:03:54.523025 19111 tablet_bootstrap.cc:492] T 4c9ffc27fdd54b68bb2d8e2e229ae923 P 99b9b6a915a94310ba479b4d3ee7c966: Bootstrap starting.
I20260709 13:03:54.523417 19109 tablet_bootstrap.cc:492] T 4c9ffc27fdd54b68bb2d8e2e229ae923 P c611bf5baef04660ada573aaf2ae7740: Bootstrap starting.
I20260709 13:03:54.518792 19110 raft_consensus.cc:359] T 635268a9733742f3aa2abc8ce5779d9f P 08100eb76c5a4fbd97f5a0b81c40f75d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c611bf5baef04660ada573aaf2ae7740" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 46065 } } peers { permanent_uuid: "08100eb76c5a4fbd97f5a0b81c40f75d" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 37843 } } peers { permanent_uuid: "99b9b6a915a94310ba479b4d3ee7c966" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36031 } }
I20260709 13:03:54.526878 19122 raft_consensus.cc:493] T 05ab4aa1987a441f8eb5811181a6f1c0 P c611bf5baef04660ada573aaf2ae7740 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:54.527348 19122 raft_consensus.cc:515] T 05ab4aa1987a441f8eb5811181a6f1c0 P c611bf5baef04660ada573aaf2ae7740 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c611bf5baef04660ada573aaf2ae7740" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 46065 } } peers { permanent_uuid: "08100eb76c5a4fbd97f5a0b81c40f75d" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 37843 } } peers { permanent_uuid: "99b9b6a915a94310ba479b4d3ee7c966" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36031 } }
I20260709 13:03:54.529626 19122 leader_election.cc:290] T 05ab4aa1987a441f8eb5811181a6f1c0 P c611bf5baef04660ada573aaf2ae7740 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 08100eb76c5a4fbd97f5a0b81c40f75d (127.17.223.2:37843), 99b9b6a915a94310ba479b4d3ee7c966 (127.17.223.3:36031)
I20260709 13:03:54.530577 19111 tablet_bootstrap.cc:654] T 4c9ffc27fdd54b68bb2d8e2e229ae923 P 99b9b6a915a94310ba479b4d3ee7c966: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:54.526536 19110 raft_consensus.cc:385] T 635268a9733742f3aa2abc8ce5779d9f P 08100eb76c5a4fbd97f5a0b81c40f75d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:54.531385 19110 raft_consensus.cc:740] T 635268a9733742f3aa2abc8ce5779d9f P 08100eb76c5a4fbd97f5a0b81c40f75d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 08100eb76c5a4fbd97f5a0b81c40f75d, State: Initialized, Role: FOLLOWER
I20260709 13:03:54.532277 19110 consensus_queue.cc:260] T 635268a9733742f3aa2abc8ce5779d9f P 08100eb76c5a4fbd97f5a0b81c40f75d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c611bf5baef04660ada573aaf2ae7740" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 46065 } } peers { permanent_uuid: "08100eb76c5a4fbd97f5a0b81c40f75d" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 37843 } } peers { permanent_uuid: "99b9b6a915a94310ba479b4d3ee7c966" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36031 } }
I20260709 13:03:54.532759 19068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05ab4aa1987a441f8eb5811181a6f1c0" candidate_uuid: "c611bf5baef04660ada573aaf2ae7740" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "99b9b6a915a94310ba479b4d3ee7c966" is_pre_election: true
I20260709 13:03:54.534860 19110 ts_tablet_manager.cc:1434] T 635268a9733742f3aa2abc8ce5779d9f P 08100eb76c5a4fbd97f5a0b81c40f75d: Time spent starting tablet: real 0.019s	user 0.007s	sys 0.000s
I20260709 13:03:54.534970 18995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05ab4aa1987a441f8eb5811181a6f1c0" candidate_uuid: "c611bf5baef04660ada573aaf2ae7740" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "08100eb76c5a4fbd97f5a0b81c40f75d" is_pre_election: true
I20260709 13:03:54.536301 19109 tablet_bootstrap.cc:654] T 4c9ffc27fdd54b68bb2d8e2e229ae923 P c611bf5baef04660ada573aaf2ae7740: Neither blocks nor log segments found. Creating new log.
W20260709 13:03:54.536296 18886 leader_election.cc:343] T 05ab4aa1987a441f8eb5811181a6f1c0 P c611bf5baef04660ada573aaf2ae7740 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 99b9b6a915a94310ba479b4d3ee7c966 (127.17.223.3:36031): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:54.537225 19110 tablet_bootstrap.cc:492] T 05ab4aa1987a441f8eb5811181a6f1c0 P 08100eb76c5a4fbd97f5a0b81c40f75d: Bootstrap starting.
W20260709 13:03:54.538508 18885 leader_election.cc:343] T 05ab4aa1987a441f8eb5811181a6f1c0 P c611bf5baef04660ada573aaf2ae7740 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 08100eb76c5a4fbd97f5a0b81c40f75d (127.17.223.2:37843): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:54.539111 18885 leader_election.cc:304] T 05ab4aa1987a441f8eb5811181a6f1c0 P c611bf5baef04660ada573aaf2ae7740 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c611bf5baef04660ada573aaf2ae7740; no voters: 08100eb76c5a4fbd97f5a0b81c40f75d, 99b9b6a915a94310ba479b4d3ee7c966
I20260709 13:03:54.540464 19122 raft_consensus.cc:2749] T 05ab4aa1987a441f8eb5811181a6f1c0 P c611bf5baef04660ada573aaf2ae7740 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:03:54.547222 19110 tablet_bootstrap.cc:654] T 05ab4aa1987a441f8eb5811181a6f1c0 P 08100eb76c5a4fbd97f5a0b81c40f75d: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:54.547638 19111 tablet_bootstrap.cc:492] T 4c9ffc27fdd54b68bb2d8e2e229ae923 P 99b9b6a915a94310ba479b4d3ee7c966: No bootstrap required, opened a new log
I20260709 13:03:54.548120 19111 ts_tablet_manager.cc:1403] T 4c9ffc27fdd54b68bb2d8e2e229ae923 P 99b9b6a915a94310ba479b4d3ee7c966: Time spent bootstrapping tablet: real 0.025s	user 0.015s	sys 0.008s
I20260709 13:03:54.550865 19111 raft_consensus.cc:359] T 4c9ffc27fdd54b68bb2d8e2e229ae923 P 99b9b6a915a94310ba479b4d3ee7c966 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c611bf5baef04660ada573aaf2ae7740" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 46065 } } peers { permanent_uuid: "08100eb76c5a4fbd97f5a0b81c40f75d" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 37843 } } peers { permanent_uuid: "99b9b6a915a94310ba479b4d3ee7c966" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36031 } }
I20260709 13:03:54.551537 19111 raft_consensus.cc:385] T 4c9ffc27fdd54b68bb2d8e2e229ae923 P 99b9b6a915a94310ba479b4d3ee7c966 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:54.551843 19111 raft_consensus.cc:740] T 4c9ffc27fdd54b68bb2d8e2e229ae923 P 99b9b6a915a94310ba479b4d3ee7c966 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 99b9b6a915a94310ba479b4d3ee7c966, State: Initialized, Role: FOLLOWER
I20260709 13:03:54.552659 19111 consensus_queue.cc:260] T 4c9ffc27fdd54b68bb2d8e2e229ae923 P 99b9b6a915a94310ba479b4d3ee7c966 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c611bf5baef04660ada573aaf2ae7740" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 46065 } } peers { permanent_uuid: "08100eb76c5a4fbd97f5a0b81c40f75d" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 37843 } } peers { permanent_uuid: "99b9b6a915a94310ba479b4d3ee7c966" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36031 } }
I20260709 13:03:54.553351 19109 tablet_bootstrap.cc:492] T 4c9ffc27fdd54b68bb2d8e2e229ae923 P c611bf5baef04660ada573aaf2ae7740: No bootstrap required, opened a new log
I20260709 13:03:54.553987 19109 ts_tablet_manager.cc:1403] T 4c9ffc27fdd54b68bb2d8e2e229ae923 P c611bf5baef04660ada573aaf2ae7740: Time spent bootstrapping tablet: real 0.031s	user 0.009s	sys 0.009s
I20260709 13:03:54.555261 19111 ts_tablet_manager.cc:1434] T 4c9ffc27fdd54b68bb2d8e2e229ae923 P 99b9b6a915a94310ba479b4d3ee7c966: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:03:54.556125 19111 tablet_bootstrap.cc:492] T 05ab4aa1987a441f8eb5811181a6f1c0 P 99b9b6a915a94310ba479b4d3ee7c966: Bootstrap starting.
I20260709 13:03:54.556629 19110 tablet_bootstrap.cc:492] T 05ab4aa1987a441f8eb5811181a6f1c0 P 08100eb76c5a4fbd97f5a0b81c40f75d: No bootstrap required, opened a new log
I20260709 13:03:54.557823 19110 ts_tablet_manager.cc:1403] T 05ab4aa1987a441f8eb5811181a6f1c0 P 08100eb76c5a4fbd97f5a0b81c40f75d: Time spent bootstrapping tablet: real 0.021s	user 0.014s	sys 0.002s
I20260709 13:03:54.557338 19109 raft_consensus.cc:359] T 4c9ffc27fdd54b68bb2d8e2e229ae923 P c611bf5baef04660ada573aaf2ae7740 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c611bf5baef04660ada573aaf2ae7740" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 46065 } } peers { permanent_uuid: "08100eb76c5a4fbd97f5a0b81c40f75d" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 37843 } } peers { permanent_uuid: "99b9b6a915a94310ba479b4d3ee7c966" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36031 } }
I20260709 13:03:54.558357 19109 raft_consensus.cc:385] T 4c9ffc27fdd54b68bb2d8e2e229ae923 P c611bf5baef04660ada573aaf2ae7740 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:54.558781 19109 raft_consensus.cc:740] T 4c9ffc27fdd54b68bb2d8e2e229ae923 P c611bf5baef04660ada573aaf2ae7740 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c611bf5baef04660ada573aaf2ae7740, State: Initialized, Role: FOLLOWER
I20260709 13:03:54.559176 19115 raft_consensus.cc:493] T b190be4cf1684677b783edcb8f9ae128 P 08100eb76c5a4fbd97f5a0b81c40f75d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:54.559661 19115 raft_consensus.cc:515] T b190be4cf1684677b783edcb8f9ae128 P 08100eb76c5a4fbd97f5a0b81c40f75d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c611bf5baef04660ada573aaf2ae7740" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 46065 } } peers { permanent_uuid: "08100eb76c5a4fbd97f5a0b81c40f75d" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 37843 } } peers { permanent_uuid: "99b9b6a915a94310ba479b4d3ee7c966" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36031 } }
I20260709 13:03:54.559763 19109 consensus_queue.cc:260] T 4c9ffc27fdd54b68bb2d8e2e229ae923 P c611bf5baef04660ada573aaf2ae7740 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c611bf5baef04660ada573aaf2ae7740" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 46065 } } peers { permanent_uuid: "08100eb76c5a4fbd97f5a0b81c40f75d" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 37843 } } peers { permanent_uuid: "99b9b6a915a94310ba479b4d3ee7c966" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36031 } }
I20260709 13:03:54.561790 19115 leader_election.cc:290] T b190be4cf1684677b783edcb8f9ae128 P 08100eb76c5a4fbd97f5a0b81c40f75d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c611bf5baef04660ada573aaf2ae7740 (127.17.223.1:46065), 99b9b6a915a94310ba479b4d3ee7c966 (127.17.223.3:36031)
I20260709 13:03:54.562186 19111 tablet_bootstrap.cc:654] T 05ab4aa1987a441f8eb5811181a6f1c0 P 99b9b6a915a94310ba479b4d3ee7c966: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:54.562425 19109 ts_tablet_manager.cc:1434] T 4c9ffc27fdd54b68bb2d8e2e229ae923 P c611bf5baef04660ada573aaf2ae7740: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.001s
I20260709 13:03:54.563223 19117 raft_consensus.cc:493] T b190be4cf1684677b783edcb8f9ae128 P 99b9b6a915a94310ba479b4d3ee7c966 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:54.563517 19109 tablet_bootstrap.cc:492] T f1e8623946e9415991e70fecebc84607 P c611bf5baef04660ada573aaf2ae7740: Bootstrap starting.
I20260709 13:03:54.563684 19117 raft_consensus.cc:515] T b190be4cf1684677b783edcb8f9ae128 P 99b9b6a915a94310ba479b4d3ee7c966 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c611bf5baef04660ada573aaf2ae7740" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 46065 } } peers { permanent_uuid: "08100eb76c5a4fbd97f5a0b81c40f75d" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 37843 } } peers { permanent_uuid: "99b9b6a915a94310ba479b4d3ee7c966" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36031 } }
I20260709 13:03:54.566149 19068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b190be4cf1684677b783edcb8f9ae128" candidate_uuid: "08100eb76c5a4fbd97f5a0b81c40f75d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "99b9b6a915a94310ba479b4d3ee7c966" is_pre_election: true
I20260709 13:03:54.566877 19068 raft_consensus.cc:2468] T b190be4cf1684677b783edcb8f9ae128 P 99b9b6a915a94310ba479b4d3ee7c966 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 08100eb76c5a4fbd97f5a0b81c40f75d in term 0.
I20260709 13:03:54.567776 18919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b190be4cf1684677b783edcb8f9ae128" candidate_uuid: "99b9b6a915a94310ba479b4d3ee7c966" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c611bf5baef04660ada573aaf2ae7740" is_pre_election: true
I20260709 13:03:54.568604 18919 raft_consensus.cc:2468] T b190be4cf1684677b783edcb8f9ae128 P c611bf5baef04660ada573aaf2ae7740 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 99b9b6a915a94310ba479b4d3ee7c966 in term 0.
I20260709 13:03:54.572147 19109 tablet_bootstrap.cc:654] T f1e8623946e9415991e70fecebc84607 P c611bf5baef04660ada573aaf2ae7740: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:54.571856 19032 leader_election.cc:304] T b190be4cf1684677b783edcb8f9ae128 P 99b9b6a915a94310ba479b4d3ee7c966 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 99b9b6a915a94310ba479b4d3ee7c966, c611bf5baef04660ada573aaf2ae7740; no voters: 
I20260709 13:03:54.576359 19149 raft_consensus.cc:2804] T b190be4cf1684677b783edcb8f9ae128 P 99b9b6a915a94310ba479b4d3ee7c966 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:03:54.576843 19149 raft_consensus.cc:493] T b190be4cf1684677b783edcb8f9ae128 P 99b9b6a915a94310ba479b4d3ee7c966 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:54.577272 19149 raft_consensus.cc:3060] T b190be4cf1684677b783edcb8f9ae128 P 99b9b6a915a94310ba479b4d3ee7c966 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:54.582136 19122 raft_consensus.cc:493] T 1109aee81b854cdcbac189f499fb0912 P c611bf5baef04660ada573aaf2ae7740 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:54.582257 18919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b190be4cf1684677b783edcb8f9ae128" candidate_uuid: "08100eb76c5a4fbd97f5a0b81c40f75d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c611bf5baef04660ada573aaf2ae7740" is_pre_election: true
I20260709 13:03:54.582705 19122 raft_consensus.cc:515] T 1109aee81b854cdcbac189f499fb0912 P c611bf5baef04660ada573aaf2ae7740 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c611bf5baef04660ada573aaf2ae7740" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 46065 } } peers { permanent_uuid: "08100eb76c5a4fbd97f5a0b81c40f75d" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 37843 } } peers { permanent_uuid: "99b9b6a915a94310ba479b4d3ee7c966" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36031 } }
I20260709 13:03:54.583194 18919 raft_consensus.cc:2468] T b190be4cf1684677b783edcb8f9ae128 P c611bf5baef04660ada573aaf2ae7740 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 08100eb76c5a4fbd97f5a0b81c40f75d in term 0.
I20260709 13:03:54.566164 19117 leader_election.cc:290] T b190be4cf1684677b783edcb8f9ae128 P 99b9b6a915a94310ba479b4d3ee7c966 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c611bf5baef04660ada573aaf2ae7740 (127.17.223.1:46065), 08100eb76c5a4fbd97f5a0b81c40f75d (127.17.223.2:37843)
I20260709 13:03:54.574291 18995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b190be4cf1684677b783edcb8f9ae128" candidate_uuid: "99b9b6a915a94310ba479b4d3ee7c966" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "08100eb76c5a4fbd97f5a0b81c40f75d" is_pre_election: true
I20260709 13:03:54.585364 18995 raft_consensus.cc:2468] T b190be4cf1684677b783edcb8f9ae128 P 08100eb76c5a4fbd97f5a0b81c40f75d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 99b9b6a915a94310ba479b4d3ee7c966 in term 0.
I20260709 13:03:54.575157 18961 leader_election.cc:304] T b190be4cf1684677b783edcb8f9ae128 P 08100eb76c5a4fbd97f5a0b81c40f75d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 08100eb76c5a4fbd97f5a0b81c40f75d, 99b9b6a915a94310ba479b4d3ee7c966; no voters: 
I20260709 13:03:54.590087 19115 raft_consensus.cc:2804] T b190be4cf1684677b783edcb8f9ae128 P 08100eb76c5a4fbd97f5a0b81c40f75d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:03:54.590128 18995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1109aee81b854cdcbac189f499fb0912" candidate_uuid: "c611bf5baef04660ada573aaf2ae7740" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "08100eb76c5a4fbd97f5a0b81c40f75d" is_pre_election: true
I20260709 13:03:54.586320 19068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1109aee81b854cdcbac189f499fb0912" candidate_uuid: "c611bf5baef04660ada573aaf2ae7740" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "99b9b6a915a94310ba479b4d3ee7c966" is_pre_election: true
I20260709 13:03:54.590579 19115 raft_consensus.cc:493] T b190be4cf1684677b783edcb8f9ae128 P 08100eb76c5a4fbd97f5a0b81c40f75d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:54.591578 19115 raft_consensus.cc:3060] T b190be4cf1684677b783edcb8f9ae128 P 08100eb76c5a4fbd97f5a0b81c40f75d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:54.591622 18995 raft_consensus.cc:2468] T 1109aee81b854cdcbac189f499fb0912 P 08100eb76c5a4fbd97f5a0b81c40f75d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c611bf5baef04660ada573aaf2ae7740 in term 0.
I20260709 13:03:54.591636 19068 raft_consensus.cc:2468] T 1109aee81b854cdcbac189f499fb0912 P 99b9b6a915a94310ba479b4d3ee7c966 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c611bf5baef04660ada573aaf2ae7740 in term 0.
I20260709 13:03:54.593107 18886 leader_election.cc:304] T 1109aee81b854cdcbac189f499fb0912 P c611bf5baef04660ada573aaf2ae7740 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 99b9b6a915a94310ba479b4d3ee7c966, c611bf5baef04660ada573aaf2ae7740; no voters: 
I20260709 13:03:54.593840 19116 raft_consensus.cc:493] T 635268a9733742f3aa2abc8ce5779d9f P c611bf5baef04660ada573aaf2ae7740 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:54.593950 19149 raft_consensus.cc:515] T b190be4cf1684677b783edcb8f9ae128 P 99b9b6a915a94310ba479b4d3ee7c966 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c611bf5baef04660ada573aaf2ae7740" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 46065 } } peers { permanent_uuid: "08100eb76c5a4fbd97f5a0b81c40f75d" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 37843 } } peers { permanent_uuid: "99b9b6a915a94310ba479b4d3ee7c966" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36031 } }
I20260709 13:03:54.594317 19116 raft_consensus.cc:515] T 635268a9733742f3aa2abc8ce5779d9f P c611bf5baef04660ada573aaf2ae7740 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c611bf5baef04660ada573aaf2ae7740" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 46065 } } peers { permanent_uuid: "08100eb76c5a4fbd97f5a0b81c40f75d" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 37843 } } peers { permanent_uuid: "99b9b6a915a94310ba479b4d3ee7c966" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36031 } }
I20260709 13:03:54.584770 19122 leader_election.cc:290] T 1109aee81b854cdcbac189f499fb0912 P c611bf5baef04660ada573aaf2ae7740 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 08100eb76c5a4fbd97f5a0b81c40f75d (127.17.223.2:37843), 99b9b6a915a94310ba479b4d3ee7c966 (127.17.223.3:36031)
I20260709 13:03:54.595600 19122 raft_consensus.cc:2804] T 1109aee81b854cdcbac189f499fb0912 P c611bf5baef04660ada573aaf2ae7740 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:03:54.595935 19122 raft_consensus.cc:493] T 1109aee81b854cdcbac189f499fb0912 P c611bf5baef04660ada573aaf2ae7740 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:54.596259 19122 raft_consensus.cc:3060] T 1109aee81b854cdcbac189f499fb0912 P c611bf5baef04660ada573aaf2ae7740 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:54.596309 19116 leader_election.cc:290] T 635268a9733742f3aa2abc8ce5779d9f P c611bf5baef04660ada573aaf2ae7740 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 08100eb76c5a4fbd97f5a0b81c40f75d (127.17.223.2:37843), 99b9b6a915a94310ba479b4d3ee7c966 (127.17.223.3:36031)
I20260709 13:03:54.596699 19149 leader_election.cc:290] T b190be4cf1684677b783edcb8f9ae128 P 99b9b6a915a94310ba479b4d3ee7c966 [CANDIDATE]: Term 1 election: Requested vote from peers c611bf5baef04660ada573aaf2ae7740 (127.17.223.1:46065), 08100eb76c5a4fbd97f5a0b81c40f75d (127.17.223.2:37843)
I20260709 13:03:54.597441 18995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b190be4cf1684677b783edcb8f9ae128" candidate_uuid: "99b9b6a915a94310ba479b4d3ee7c966" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "08100eb76c5a4fbd97f5a0b81c40f75d"
I20260709 13:03:54.598332 18919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b190be4cf1684677b783edcb8f9ae128" candidate_uuid: "99b9b6a915a94310ba479b4d3ee7c966" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c611bf5baef04660ada573aaf2ae7740"
I20260709 13:03:54.598862 19068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "635268a9733742f3aa2abc8ce5779d9f" candidate_uuid: "c611bf5baef04660ada573aaf2ae7740" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "99b9b6a915a94310ba479b4d3ee7c966" is_pre_election: true
I20260709 13:03:54.599509 18994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "635268a9733742f3aa2abc8ce5779d9f" candidate_uuid: "c611bf5baef04660ada573aaf2ae7740" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "08100eb76c5a4fbd97f5a0b81c40f75d" is_pre_election: true
I20260709 13:03:54.599625 19068 raft_consensus.cc:2468] T 635268a9733742f3aa2abc8ce5779d9f P 99b9b6a915a94310ba479b4d3ee7c966 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c611bf5baef04660ada573aaf2ae7740 in term 0.
I20260709 13:03:54.600112 18994 raft_consensus.cc:2468] T 635268a9733742f3aa2abc8ce5779d9f P 08100eb76c5a4fbd97f5a0b81c40f75d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c611bf5baef04660ada573aaf2ae7740 in term 0.
I20260709 13:03:54.600431 19110 raft_consensus.cc:359] T 05ab4aa1987a441f8eb5811181a6f1c0 P 08100eb76c5a4fbd97f5a0b81c40f75d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c611bf5baef04660ada573aaf2ae7740" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 46065 } } peers { permanent_uuid: "08100eb76c5a4fbd97f5a0b81c40f75d" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 37843 } } peers { permanent_uuid: "99b9b6a915a94310ba479b4d3ee7c966" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36031 } }
I20260709 13:03:54.600827 18886 leader_election.cc:304] T 635268a9733742f3aa2abc8ce5779d9f P c611bf5baef04660ada573aaf2ae7740 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 99b9b6a915a94310ba479b4d3ee7c966, c611bf5baef04660ada573aaf2ae7740; no voters: 
I20260709 13:03:54.601135 19110 raft_consensus.cc:385] T 05ab4aa1987a441f8eb5811181a6f1c0 P 08100eb76c5a4fbd97f5a0b81c40f75d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:54.601401 19110 raft_consensus.cc:740] T 05ab4aa1987a441f8eb5811181a6f1c0 P 08100eb76c5a4fbd97f5a0b81c40f75d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 08100eb76c5a4fbd97f5a0b81c40f75d, State: Initialized, Role: FOLLOWER
I20260709 13:03:54.601701 19131 raft_consensus.cc:2804] T 635268a9733742f3aa2abc8ce5779d9f P c611bf5baef04660ada573aaf2ae7740 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:03:54.602051 19131 raft_consensus.cc:493] T 635268a9733742f3aa2abc8ce5779d9f P c611bf5baef04660ada573aaf2ae7740 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:54.602006 19110 consensus_queue.cc:260] T 05ab4aa1987a441f8eb5811181a6f1c0 P 08100eb76c5a4fbd97f5a0b81c40f75d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c611bf5baef04660ada573aaf2ae7740" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 46065 } } peers { permanent_uuid: "08100eb76c5a4fbd97f5a0b81c40f75d" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 37843 } } peers { permanent_uuid: "99b9b6a915a94310ba479b4d3ee7c966" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36031 } }
I20260709 13:03:54.598945 18919 raft_consensus.cc:3060] T b190be4cf1684677b783edcb8f9ae128 P c611bf5baef04660ada573aaf2ae7740 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:54.602499 19131 raft_consensus.cc:3060] T 635268a9733742f3aa2abc8ce5779d9f P c611bf5baef04660ada573aaf2ae7740 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:54.603610 19122 raft_consensus.cc:515] T 1109aee81b854cdcbac189f499fb0912 P c611bf5baef04660ada573aaf2ae7740 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c611bf5baef04660ada573aaf2ae7740" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 46065 } } peers { permanent_uuid: "08100eb76c5a4fbd97f5a0b81c40f75d" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 37843 } } peers { permanent_uuid: "99b9b6a915a94310ba479b4d3ee7c966" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36031 } }
I20260709 13:03:54.604147 19110 ts_tablet_manager.cc:1434] T 05ab4aa1987a441f8eb5811181a6f1c0 P 08100eb76c5a4fbd97f5a0b81c40f75d: Time spent starting tablet: real 0.046s	user 0.005s	sys 0.000s
I20260709 13:03:54.605058 19110 tablet_bootstrap.cc:492] T f1e8623946e9415991e70fecebc84607 P 08100eb76c5a4fbd97f5a0b81c40f75d: Bootstrap starting.
I20260709 13:03:54.606158 18994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1109aee81b854cdcbac189f499fb0912" candidate_uuid: "c611bf5baef04660ada573aaf2ae7740" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "08100eb76c5a4fbd97f5a0b81c40f75d"
I20260709 13:03:54.606521 19122 leader_election.cc:290] T 1109aee81b854cdcbac189f499fb0912 P c611bf5baef04660ada573aaf2ae7740 [CANDIDATE]: Term 1 election: Requested vote from peers 08100eb76c5a4fbd97f5a0b81c40f75d (127.17.223.2:37843), 99b9b6a915a94310ba479b4d3ee7c966 (127.17.223.3:36031)
I20260709 13:03:54.606657 18994 raft_consensus.cc:3060] T 1109aee81b854cdcbac189f499fb0912 P 08100eb76c5a4fbd97f5a0b81c40f75d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:54.607380 19068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1109aee81b854cdcbac189f499fb0912" candidate_uuid: "c611bf5baef04660ada573aaf2ae7740" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "99b9b6a915a94310ba479b4d3ee7c966"
I20260709 13:03:54.607923 19068 raft_consensus.cc:3060] T 1109aee81b854cdcbac189f499fb0912 P 99b9b6a915a94310ba479b4d3ee7c966 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:54.611022 19111 tablet_bootstrap.cc:492] T 05ab4aa1987a441f8eb5811181a6f1c0 P 99b9b6a915a94310ba479b4d3ee7c966: No bootstrap required, opened a new log
I20260709 13:03:54.611441 19111 ts_tablet_manager.cc:1403] T 05ab4aa1987a441f8eb5811181a6f1c0 P 99b9b6a915a94310ba479b4d3ee7c966: Time spent bootstrapping tablet: real 0.055s	user 0.023s	sys 0.011s
I20260709 13:03:54.612856 19115 raft_consensus.cc:515] T b190be4cf1684677b783edcb8f9ae128 P 08100eb76c5a4fbd97f5a0b81c40f75d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c611bf5baef04660ada573aaf2ae7740" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 46065 } } peers { permanent_uuid: "08100eb76c5a4fbd97f5a0b81c40f75d" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 37843 } } peers { permanent_uuid: "99b9b6a915a94310ba479b4d3ee7c966" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36031 } }
I20260709 13:03:54.613960 19111 raft_consensus.cc:359] T 05ab4aa1987a441f8eb5811181a6f1c0 P 99b9b6a915a94310ba479b4d3ee7c966 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c611bf5baef04660ada573aaf2ae7740" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 46065 } } peers { permanent_uuid: "08100eb76c5a4fbd97f5a0b81c40f75d" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 37843 } } peers { permanent_uuid: "99b9b6a915a94310ba479b4d3ee7c966" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36031 } }
I20260709 13:03:54.614998 18995 raft_consensus.cc:2393] T b190be4cf1684677b783edcb8f9ae128 P 08100eb76c5a4fbd97f5a0b81c40f75d [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 99b9b6a915a94310ba479b4d3ee7c966 in current term 1: Already voted for candidate 08100eb76c5a4fbd97f5a0b81c40f75d in this term.
I20260709 13:03:54.614558 19111 raft_consensus.cc:385] T 05ab4aa1987a441f8eb5811181a6f1c0 P 99b9b6a915a94310ba479b4d3ee7c966 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:54.615631 19068 raft_consensus.cc:2468] T 1109aee81b854cdcbac189f499fb0912 P 99b9b6a915a94310ba479b4d3ee7c966 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c611bf5baef04660ada573aaf2ae7740 in term 1.
I20260709 13:03:54.615747 19111 raft_consensus.cc:740] T 05ab4aa1987a441f8eb5811181a6f1c0 P 99b9b6a915a94310ba479b4d3ee7c966 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 99b9b6a915a94310ba479b4d3ee7c966, State: Initialized, Role: FOLLOWER
I20260709 13:03:54.616739 18886 leader_election.cc:304] T 1109aee81b854cdcbac189f499fb0912 P c611bf5baef04660ada573aaf2ae7740 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 99b9b6a915a94310ba479b4d3ee7c966, c611bf5baef04660ada573aaf2ae7740; no voters: 
I20260709 13:03:54.616873 19111 consensus_queue.cc:260] T 05ab4aa1987a441f8eb5811181a6f1c0 P 99b9b6a915a94310ba479b4d3ee7c966 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c611bf5baef04660ada573aaf2ae7740" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 46065 } } peers { permanent_uuid: "08100eb76c5a4fbd97f5a0b81c40f75d" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 37843 } } peers { permanent_uuid: "99b9b6a915a94310ba479b4d3ee7c966" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36031 } }
I20260709 13:03:54.617621 19122 raft_consensus.cc:2804] T 1109aee81b854cdcbac189f499fb0912 P c611bf5baef04660ada573aaf2ae7740 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:03:54.620535 19110 tablet_bootstrap.cc:654] T f1e8623946e9415991e70fecebc84607 P 08100eb76c5a4fbd97f5a0b81c40f75d: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:54.620612 19109 tablet_bootstrap.cc:492] T f1e8623946e9415991e70fecebc84607 P c611bf5baef04660ada573aaf2ae7740: No bootstrap required, opened a new log
I20260709 13:03:54.621086 19109 ts_tablet_manager.cc:1403] T f1e8623946e9415991e70fecebc84607 P c611bf5baef04660ada573aaf2ae7740: Time spent bootstrapping tablet: real 0.058s	user 0.007s	sys 0.010s
I20260709 13:03:54.622933 19131 raft_consensus.cc:515] T 635268a9733742f3aa2abc8ce5779d9f P c611bf5baef04660ada573aaf2ae7740 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c611bf5baef04660ada573aaf2ae7740" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 46065 } } peers { permanent_uuid: "08100eb76c5a4fbd97f5a0b81c40f75d" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 37843 } } peers { permanent_uuid: "99b9b6a915a94310ba479b4d3ee7c966" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36031 } }
I20260709 13:03:54.618214 19122 raft_consensus.cc:697] T 1109aee81b854cdcbac189f499fb0912 P c611bf5baef04660ada573aaf2ae7740 [term 1 LEADER]: Becoming Leader. State: Replica: c611bf5baef04660ada573aaf2ae7740, State: Running, Role: LEADER
I20260709 13:03:54.625933 18920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b190be4cf1684677b783edcb8f9ae128" candidate_uuid: "08100eb76c5a4fbd97f5a0b81c40f75d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c611bf5baef04660ada573aaf2ae7740"
I20260709 13:03:54.625850 19122 consensus_queue.cc:237] T 1109aee81b854cdcbac189f499fb0912 P c611bf5baef04660ada573aaf2ae7740 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c611bf5baef04660ada573aaf2ae7740" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 46065 } } peers { permanent_uuid: "08100eb76c5a4fbd97f5a0b81c40f75d" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 37843 } } peers { permanent_uuid: "99b9b6a915a94310ba479b4d3ee7c966" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36031 } }
I20260709 13:03:54.627252 19109 raft_consensus.cc:359] T f1e8623946e9415991e70fecebc84607 P c611bf5baef04660ada573aaf2ae7740 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c611bf5baef04660ada573aaf2ae7740" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 46065 } } peers { permanent_uuid: "08100eb76c5a4fbd97f5a0b81c40f75d" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 37843 } } peers { permanent_uuid: "99b9b6a915a94310ba479b4d3ee7c966" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36031 } }
I20260709 13:03:54.628005 19109 raft_consensus.cc:385] T f1e8623946e9415991e70fecebc84607 P c611bf5baef04660ada573aaf2ae7740 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:54.628268 19109 raft_consensus.cc:740] T f1e8623946e9415991e70fecebc84607 P c611bf5baef04660ada573aaf2ae7740 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c611bf5baef04660ada573aaf2ae7740, State: Initialized, Role: FOLLOWER
I20260709 13:03:54.628764 19115 leader_election.cc:290] T b190be4cf1684677b783edcb8f9ae128 P 08100eb76c5a4fbd97f5a0b81c40f75d [CANDIDATE]: Term 1 election: Requested vote from peers c611bf5baef04660ada573aaf2ae7740 (127.17.223.1:46065), 99b9b6a915a94310ba479b4d3ee7c966 (127.17.223.3:36031)
I20260709 13:03:54.629060 19109 consensus_queue.cc:260] T f1e8623946e9415991e70fecebc84607 P c611bf5baef04660ada573aaf2ae7740 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c611bf5baef04660ada573aaf2ae7740" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 46065 } } peers { permanent_uuid: "08100eb76c5a4fbd97f5a0b81c40f75d" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 37843 } } peers { permanent_uuid: "99b9b6a915a94310ba479b4d3ee7c966" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36031 } }
I20260709 13:03:54.631256 18995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "635268a9733742f3aa2abc8ce5779d9f" candidate_uuid: "c611bf5baef04660ada573aaf2ae7740" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "08100eb76c5a4fbd97f5a0b81c40f75d"
I20260709 13:03:54.631572 19109 ts_tablet_manager.cc:1434] T f1e8623946e9415991e70fecebc84607 P c611bf5baef04660ada573aaf2ae7740: Time spent starting tablet: real 0.010s	user 0.007s	sys 0.000s
I20260709 13:03:54.631845 18995 raft_consensus.cc:3060] T 635268a9733742f3aa2abc8ce5779d9f P 08100eb76c5a4fbd97f5a0b81c40f75d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:54.628279 19111 ts_tablet_manager.cc:1434] T 05ab4aa1987a441f8eb5811181a6f1c0 P 99b9b6a915a94310ba479b4d3ee7c966: Time spent starting tablet: real 0.017s	user 0.007s	sys 0.000s
I20260709 13:03:54.635094 18994 raft_consensus.cc:2468] T 1109aee81b854cdcbac189f499fb0912 P 08100eb76c5a4fbd97f5a0b81c40f75d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c611bf5baef04660ada573aaf2ae7740 in term 1.
I20260709 13:03:54.636659 19111 tablet_bootstrap.cc:492] T f1e8623946e9415991e70fecebc84607 P 99b9b6a915a94310ba479b4d3ee7c966: Bootstrap starting.
I20260709 13:03:54.638424 18995 raft_consensus.cc:2468] T 635268a9733742f3aa2abc8ce5779d9f P 08100eb76c5a4fbd97f5a0b81c40f75d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c611bf5baef04660ada573aaf2ae7740 in term 1.
I20260709 13:03:54.639357 19068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b190be4cf1684677b783edcb8f9ae128" candidate_uuid: "08100eb76c5a4fbd97f5a0b81c40f75d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "99b9b6a915a94310ba479b4d3ee7c966"
I20260709 13:03:54.643307 19068 raft_consensus.cc:2393] T b190be4cf1684677b783edcb8f9ae128 P 99b9b6a915a94310ba479b4d3ee7c966 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 08100eb76c5a4fbd97f5a0b81c40f75d in current term 1: Already voted for candidate 99b9b6a915a94310ba479b4d3ee7c966 in this term.
I20260709 13:03:54.644132 19131 leader_election.cc:290] T 635268a9733742f3aa2abc8ce5779d9f P c611bf5baef04660ada573aaf2ae7740 [CANDIDATE]: Term 1 election: Requested vote from peers 08100eb76c5a4fbd97f5a0b81c40f75d (127.17.223.2:37843), 99b9b6a915a94310ba479b4d3ee7c966 (127.17.223.3:36031)
I20260709 13:03:54.645004 19068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "635268a9733742f3aa2abc8ce5779d9f" candidate_uuid: "c611bf5baef04660ada573aaf2ae7740" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "99b9b6a915a94310ba479b4d3ee7c966"
I20260709 13:03:54.645532 19068 raft_consensus.cc:3060] T 635268a9733742f3aa2abc8ce5779d9f P 99b9b6a915a94310ba479b4d3ee7c966 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:54.645835 18919 raft_consensus.cc:2468] T b190be4cf1684677b783edcb8f9ae128 P c611bf5baef04660ada573aaf2ae7740 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 99b9b6a915a94310ba479b4d3ee7c966 in term 1.
I20260709 13:03:54.646709 19111 tablet_bootstrap.cc:654] T f1e8623946e9415991e70fecebc84607 P 99b9b6a915a94310ba479b4d3ee7c966: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:54.645908 18816 catalog_manager.cc:5697] T 1109aee81b854cdcbac189f499fb0912 P c611bf5baef04660ada573aaf2ae7740 reported cstate change: term changed from 0 to 1, leader changed from <none> to c611bf5baef04660ada573aaf2ae7740 (127.17.223.1). New cstate: current_term: 1 leader_uuid: "c611bf5baef04660ada573aaf2ae7740" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c611bf5baef04660ada573aaf2ae7740" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 46065 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "08100eb76c5a4fbd97f5a0b81c40f75d" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 37843 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "99b9b6a915a94310ba479b4d3ee7c966" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36031 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:54.649873 19110 tablet_bootstrap.cc:492] T f1e8623946e9415991e70fecebc84607 P 08100eb76c5a4fbd97f5a0b81c40f75d: No bootstrap required, opened a new log
I20260709 13:03:54.650282 19110 ts_tablet_manager.cc:1403] T f1e8623946e9415991e70fecebc84607 P 08100eb76c5a4fbd97f5a0b81c40f75d: Time spent bootstrapping tablet: real 0.045s	user 0.006s	sys 0.003s
I20260709 13:03:54.651242 19032 leader_election.cc:304] T b190be4cf1684677b783edcb8f9ae128 P 99b9b6a915a94310ba479b4d3ee7c966 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 99b9b6a915a94310ba479b4d3ee7c966, c611bf5baef04660ada573aaf2ae7740; no voters: 08100eb76c5a4fbd97f5a0b81c40f75d
I20260709 13:03:54.652727 19149 raft_consensus.cc:2804] T b190be4cf1684677b783edcb8f9ae128 P 99b9b6a915a94310ba479b4d3ee7c966 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:03:54.652838 19110 raft_consensus.cc:359] T f1e8623946e9415991e70fecebc84607 P 08100eb76c5a4fbd97f5a0b81c40f75d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c611bf5baef04660ada573aaf2ae7740" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 46065 } } peers { permanent_uuid: "08100eb76c5a4fbd97f5a0b81c40f75d" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 37843 } } peers { permanent_uuid: "99b9b6a915a94310ba479b4d3ee7c966" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36031 } }
I20260709 13:03:54.653575 19110 raft_consensus.cc:385] T f1e8623946e9415991e70fecebc84607 P 08100eb76c5a4fbd97f5a0b81c40f75d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:54.653434 19149 raft_consensus.cc:697] T b190be4cf1684677b783edcb8f9ae128 P 99b9b6a915a94310ba479b4d3ee7c966 [term 1 LEADER]: Becoming Leader. State: Replica: 99b9b6a915a94310ba479b4d3ee7c966, State: Running, Role: LEADER
I20260709 13:03:54.653862 19110 raft_consensus.cc:740] T f1e8623946e9415991e70fecebc84607 P 08100eb76c5a4fbd97f5a0b81c40f75d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 08100eb76c5a4fbd97f5a0b81c40f75d, State: Initialized, Role: FOLLOWER
I20260709 13:03:54.654764 19110 consensus_queue.cc:260] T f1e8623946e9415991e70fecebc84607 P 08100eb76c5a4fbd97f5a0b81c40f75d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c611bf5baef04660ada573aaf2ae7740" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 46065 } } peers { permanent_uuid: "08100eb76c5a4fbd97f5a0b81c40f75d" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 37843 } } peers { permanent_uuid: "99b9b6a915a94310ba479b4d3ee7c966" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36031 } }
I20260709 13:03:54.654598 19149 consensus_queue.cc:237] T b190be4cf1684677b783edcb8f9ae128 P 99b9b6a915a94310ba479b4d3ee7c966 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c611bf5baef04660ada573aaf2ae7740" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 46065 } } peers { permanent_uuid: "08100eb76c5a4fbd97f5a0b81c40f75d" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 37843 } } peers { permanent_uuid: "99b9b6a915a94310ba479b4d3ee7c966" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36031 } }
I20260709 13:03:54.658977 19110 ts_tablet_manager.cc:1434] T f1e8623946e9415991e70fecebc84607 P 08100eb76c5a4fbd97f5a0b81c40f75d: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.001s
I20260709 13:03:54.659850 19110 tablet_bootstrap.cc:492] T 4c9ffc27fdd54b68bb2d8e2e229ae923 P 08100eb76c5a4fbd97f5a0b81c40f75d: Bootstrap starting.
I20260709 13:03:54.661278 19068 raft_consensus.cc:2468] T 635268a9733742f3aa2abc8ce5779d9f P 99b9b6a915a94310ba479b4d3ee7c966 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c611bf5baef04660ada573aaf2ae7740 in term 1.
I20260709 13:03:54.662518 18886 leader_election.cc:304] T 635268a9733742f3aa2abc8ce5779d9f P c611bf5baef04660ada573aaf2ae7740 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 99b9b6a915a94310ba479b4d3ee7c966, c611bf5baef04660ada573aaf2ae7740; no voters: 
I20260709 13:03:54.663383 19131 raft_consensus.cc:2804] T 635268a9733742f3aa2abc8ce5779d9f P c611bf5baef04660ada573aaf2ae7740 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:03:54.663882 19131 raft_consensus.cc:697] T 635268a9733742f3aa2abc8ce5779d9f P c611bf5baef04660ada573aaf2ae7740 [term 1 LEADER]: Becoming Leader. State: Replica: c611bf5baef04660ada573aaf2ae7740, State: Running, Role: LEADER
I20260709 13:03:54.666633 19110 tablet_bootstrap.cc:654] T 4c9ffc27fdd54b68bb2d8e2e229ae923 P 08100eb76c5a4fbd97f5a0b81c40f75d: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:54.664673 19131 consensus_queue.cc:237] T 635268a9733742f3aa2abc8ce5779d9f P c611bf5baef04660ada573aaf2ae7740 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c611bf5baef04660ada573aaf2ae7740" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 46065 } } peers { permanent_uuid: "08100eb76c5a4fbd97f5a0b81c40f75d" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 37843 } } peers { permanent_uuid: "99b9b6a915a94310ba479b4d3ee7c966" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36031 } }
I20260709 13:03:54.664628 18961 leader_election.cc:304] T b190be4cf1684677b783edcb8f9ae128 P 08100eb76c5a4fbd97f5a0b81c40f75d [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 08100eb76c5a4fbd97f5a0b81c40f75d; no voters: 99b9b6a915a94310ba479b4d3ee7c966, c611bf5baef04660ada573aaf2ae7740
I20260709 13:03:54.671725 19115 raft_consensus.cc:2749] T b190be4cf1684677b783edcb8f9ae128 P 08100eb76c5a4fbd97f5a0b81c40f75d [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:03:54.675009 19110 tablet_bootstrap.cc:492] T 4c9ffc27fdd54b68bb2d8e2e229ae923 P 08100eb76c5a4fbd97f5a0b81c40f75d: No bootstrap required, opened a new log
I20260709 13:03:54.675524 19110 ts_tablet_manager.cc:1403] T 4c9ffc27fdd54b68bb2d8e2e229ae923 P 08100eb76c5a4fbd97f5a0b81c40f75d: Time spent bootstrapping tablet: real 0.016s	user 0.012s	sys 0.000s
I20260709 13:03:54.688795 19110 raft_consensus.cc:359] T 4c9ffc27fdd54b68bb2d8e2e229ae923 P 08100eb76c5a4fbd97f5a0b81c40f75d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c611bf5baef04660ada573aaf2ae7740" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 46065 } } peers { permanent_uuid: "08100eb76c5a4fbd97f5a0b81c40f75d" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 37843 } } peers { permanent_uuid: "99b9b6a915a94310ba479b4d3ee7c966" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36031 } }
I20260709 13:03:54.689327 19110 raft_consensus.cc:385] T 4c9ffc27fdd54b68bb2d8e2e229ae923 P 08100eb76c5a4fbd97f5a0b81c40f75d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:54.689579 19110 raft_consensus.cc:740] T 4c9ffc27fdd54b68bb2d8e2e229ae923 P 08100eb76c5a4fbd97f5a0b81c40f75d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 08100eb76c5a4fbd97f5a0b81c40f75d, State: Initialized, Role: FOLLOWER
I20260709 13:03:54.688964 18818 catalog_manager.cc:5697] T 635268a9733742f3aa2abc8ce5779d9f P c611bf5baef04660ada573aaf2ae7740 reported cstate change: term changed from 0 to 1, leader changed from <none> to c611bf5baef04660ada573aaf2ae7740 (127.17.223.1). New cstate: current_term: 1 leader_uuid: "c611bf5baef04660ada573aaf2ae7740" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c611bf5baef04660ada573aaf2ae7740" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 46065 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "08100eb76c5a4fbd97f5a0b81c40f75d" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 37843 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "99b9b6a915a94310ba479b4d3ee7c966" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36031 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:54.690346 19110 consensus_queue.cc:260] T 4c9ffc27fdd54b68bb2d8e2e229ae923 P 08100eb76c5a4fbd97f5a0b81c40f75d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c611bf5baef04660ada573aaf2ae7740" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 46065 } } peers { permanent_uuid: "08100eb76c5a4fbd97f5a0b81c40f75d" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 37843 } } peers { permanent_uuid: "99b9b6a915a94310ba479b4d3ee7c966" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36031 } }
I20260709 13:03:54.691107 19111 tablet_bootstrap.cc:492] T f1e8623946e9415991e70fecebc84607 P 99b9b6a915a94310ba479b4d3ee7c966: No bootstrap required, opened a new log
I20260709 13:03:54.691566 19111 ts_tablet_manager.cc:1403] T f1e8623946e9415991e70fecebc84607 P 99b9b6a915a94310ba479b4d3ee7c966: Time spent bootstrapping tablet: real 0.055s	user 0.021s	sys 0.024s
I20260709 13:03:54.692198 19110 ts_tablet_manager.cc:1434] T 4c9ffc27fdd54b68bb2d8e2e229ae923 P 08100eb76c5a4fbd97f5a0b81c40f75d: Time spent starting tablet: real 0.016s	user 0.005s	sys 0.000s
I20260709 13:03:54.694123 19111 raft_consensus.cc:359] T f1e8623946e9415991e70fecebc84607 P 99b9b6a915a94310ba479b4d3ee7c966 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c611bf5baef04660ada573aaf2ae7740" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 46065 } } peers { permanent_uuid: "08100eb76c5a4fbd97f5a0b81c40f75d" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 37843 } } peers { permanent_uuid: "99b9b6a915a94310ba479b4d3ee7c966" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36031 } }
I20260709 13:03:54.694839 19111 raft_consensus.cc:385] T f1e8623946e9415991e70fecebc84607 P 99b9b6a915a94310ba479b4d3ee7c966 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:54.695173 19111 raft_consensus.cc:740] T f1e8623946e9415991e70fecebc84607 P 99b9b6a915a94310ba479b4d3ee7c966 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 99b9b6a915a94310ba479b4d3ee7c966, State: Initialized, Role: FOLLOWER
I20260709 13:03:54.695020 18817 catalog_manager.cc:5697] T b190be4cf1684677b783edcb8f9ae128 P 99b9b6a915a94310ba479b4d3ee7c966 reported cstate change: term changed from 0 to 1, leader changed from <none> to 99b9b6a915a94310ba479b4d3ee7c966 (127.17.223.3). New cstate: current_term: 1 leader_uuid: "99b9b6a915a94310ba479b4d3ee7c966" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c611bf5baef04660ada573aaf2ae7740" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 46065 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "08100eb76c5a4fbd97f5a0b81c40f75d" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 37843 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "99b9b6a915a94310ba479b4d3ee7c966" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36031 } health_report { overall_health: HEALTHY } } }
I20260709 13:03:54.696401 19111 consensus_queue.cc:260] T f1e8623946e9415991e70fecebc84607 P 99b9b6a915a94310ba479b4d3ee7c966 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c611bf5baef04660ada573aaf2ae7740" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 46065 } } peers { permanent_uuid: "08100eb76c5a4fbd97f5a0b81c40f75d" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 37843 } } peers { permanent_uuid: "99b9b6a915a94310ba479b4d3ee7c966" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36031 } }
I20260709 13:03:54.698729 19111 ts_tablet_manager.cc:1434] T f1e8623946e9415991e70fecebc84607 P 99b9b6a915a94310ba479b4d3ee7c966: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.001s
I20260709 13:03:54.737244 19131 raft_consensus.cc:493] T 4c9ffc27fdd54b68bb2d8e2e229ae923 P c611bf5baef04660ada573aaf2ae7740 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:54.737747 19131 raft_consensus.cc:515] T 4c9ffc27fdd54b68bb2d8e2e229ae923 P c611bf5baef04660ada573aaf2ae7740 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c611bf5baef04660ada573aaf2ae7740" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 46065 } } peers { permanent_uuid: "08100eb76c5a4fbd97f5a0b81c40f75d" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 37843 } } peers { permanent_uuid: "99b9b6a915a94310ba479b4d3ee7c966" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36031 } }
I20260709 13:03:54.739547 19131 leader_election.cc:290] T 4c9ffc27fdd54b68bb2d8e2e229ae923 P c611bf5baef04660ada573aaf2ae7740 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 08100eb76c5a4fbd97f5a0b81c40f75d (127.17.223.2:37843), 99b9b6a915a94310ba479b4d3ee7c966 (127.17.223.3:36031)
I20260709 13:03:54.740388 18995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c9ffc27fdd54b68bb2d8e2e229ae923" candidate_uuid: "c611bf5baef04660ada573aaf2ae7740" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "08100eb76c5a4fbd97f5a0b81c40f75d" is_pre_election: true
I20260709 13:03:54.740618 19068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c9ffc27fdd54b68bb2d8e2e229ae923" candidate_uuid: "c611bf5baef04660ada573aaf2ae7740" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "99b9b6a915a94310ba479b4d3ee7c966" is_pre_election: true
I20260709 13:03:54.740893 18995 raft_consensus.cc:2468] T 4c9ffc27fdd54b68bb2d8e2e229ae923 P 08100eb76c5a4fbd97f5a0b81c40f75d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c611bf5baef04660ada573aaf2ae7740 in term 0.
I20260709 13:03:54.741195 19068 raft_consensus.cc:2468] T 4c9ffc27fdd54b68bb2d8e2e229ae923 P 99b9b6a915a94310ba479b4d3ee7c966 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c611bf5baef04660ada573aaf2ae7740 in term 0.
I20260709 13:03:54.741835 18885 leader_election.cc:304] T 4c9ffc27fdd54b68bb2d8e2e229ae923 P c611bf5baef04660ada573aaf2ae7740 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 08100eb76c5a4fbd97f5a0b81c40f75d, c611bf5baef04660ada573aaf2ae7740; no voters: 
I20260709 13:03:54.742796 19131 raft_consensus.cc:2804] T 4c9ffc27fdd54b68bb2d8e2e229ae923 P c611bf5baef04660ada573aaf2ae7740 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:03:54.743088 19131 raft_consensus.cc:493] T 4c9ffc27fdd54b68bb2d8e2e229ae923 P c611bf5baef04660ada573aaf2ae7740 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:54.743360 19131 raft_consensus.cc:3060] T 4c9ffc27fdd54b68bb2d8e2e229ae923 P c611bf5baef04660ada573aaf2ae7740 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:54.747946 19131 raft_consensus.cc:515] T 4c9ffc27fdd54b68bb2d8e2e229ae923 P c611bf5baef04660ada573aaf2ae7740 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c611bf5baef04660ada573aaf2ae7740" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 46065 } } peers { permanent_uuid: "08100eb76c5a4fbd97f5a0b81c40f75d" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 37843 } } peers { permanent_uuid: "99b9b6a915a94310ba479b4d3ee7c966" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36031 } }
I20260709 13:03:54.749473 19131 leader_election.cc:290] T 4c9ffc27fdd54b68bb2d8e2e229ae923 P c611bf5baef04660ada573aaf2ae7740 [CANDIDATE]: Term 1 election: Requested vote from peers 08100eb76c5a4fbd97f5a0b81c40f75d (127.17.223.2:37843), 99b9b6a915a94310ba479b4d3ee7c966 (127.17.223.3:36031)
I20260709 13:03:54.750360 18995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c9ffc27fdd54b68bb2d8e2e229ae923" candidate_uuid: "c611bf5baef04660ada573aaf2ae7740" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "08100eb76c5a4fbd97f5a0b81c40f75d"
I20260709 13:03:54.750464 19068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c9ffc27fdd54b68bb2d8e2e229ae923" candidate_uuid: "c611bf5baef04660ada573aaf2ae7740" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "99b9b6a915a94310ba479b4d3ee7c966"
I20260709 13:03:54.750895 18995 raft_consensus.cc:3060] T 4c9ffc27fdd54b68bb2d8e2e229ae923 P 08100eb76c5a4fbd97f5a0b81c40f75d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:54.751027 19068 raft_consensus.cc:3060] T 4c9ffc27fdd54b68bb2d8e2e229ae923 P 99b9b6a915a94310ba479b4d3ee7c966 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:54.755559 18995 raft_consensus.cc:2468] T 4c9ffc27fdd54b68bb2d8e2e229ae923 P 08100eb76c5a4fbd97f5a0b81c40f75d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c611bf5baef04660ada573aaf2ae7740 in term 1.
I20260709 13:03:54.755628 19068 raft_consensus.cc:2468] T 4c9ffc27fdd54b68bb2d8e2e229ae923 P 99b9b6a915a94310ba479b4d3ee7c966 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c611bf5baef04660ada573aaf2ae7740 in term 1.
I20260709 13:03:54.756565 18885 leader_election.cc:304] T 4c9ffc27fdd54b68bb2d8e2e229ae923 P c611bf5baef04660ada573aaf2ae7740 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 08100eb76c5a4fbd97f5a0b81c40f75d, c611bf5baef04660ada573aaf2ae7740; no voters: 
I20260709 13:03:54.757225 19131 raft_consensus.cc:2804] T 4c9ffc27fdd54b68bb2d8e2e229ae923 P c611bf5baef04660ada573aaf2ae7740 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:03:54.757688 19131 raft_consensus.cc:697] T 4c9ffc27fdd54b68bb2d8e2e229ae923 P c611bf5baef04660ada573aaf2ae7740 [term 1 LEADER]: Becoming Leader. State: Replica: c611bf5baef04660ada573aaf2ae7740, State: Running, Role: LEADER
I20260709 13:03:54.758435 19131 consensus_queue.cc:237] T 4c9ffc27fdd54b68bb2d8e2e229ae923 P c611bf5baef04660ada573aaf2ae7740 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c611bf5baef04660ada573aaf2ae7740" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 46065 } } peers { permanent_uuid: "08100eb76c5a4fbd97f5a0b81c40f75d" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 37843 } } peers { permanent_uuid: "99b9b6a915a94310ba479b4d3ee7c966" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36031 } }
I20260709 13:03:54.765211 18817 catalog_manager.cc:5697] T 4c9ffc27fdd54b68bb2d8e2e229ae923 P c611bf5baef04660ada573aaf2ae7740 reported cstate change: term changed from 0 to 1, leader changed from <none> to c611bf5baef04660ada573aaf2ae7740 (127.17.223.1). New cstate: current_term: 1 leader_uuid: "c611bf5baef04660ada573aaf2ae7740" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c611bf5baef04660ada573aaf2ae7740" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 46065 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "08100eb76c5a4fbd97f5a0b81c40f75d" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 37843 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "99b9b6a915a94310ba479b4d3ee7c966" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36031 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:54.823987 18995 raft_consensus.cc:1240] T c6c129816ac441a8bef29b84b78b791e P 08100eb76c5a4fbd97f5a0b81c40f75d [term 2 LEADER]: Rejecting Update request from peer c611bf5baef04660ada573aaf2ae7740 for earlier term 1. Current term is 2. Ops: []
I20260709 13:03:54.825387 19131 consensus_queue.cc:1059] T c6c129816ac441a8bef29b84b78b791e P c611bf5baef04660ada573aaf2ae7740 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "08100eb76c5a4fbd97f5a0b81c40f75d" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 37843 }, Status: INVALID_TERM, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:03:54.825955 19131 consensus_queue.cc:1243] T c6c129816ac441a8bef29b84b78b791e P c611bf5baef04660ada573aaf2ae7740 [LEADER]: Peer 08100eb76c5a4fbd97f5a0b81c40f75d log is divergent from this leader: its last log entry 2.1 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 0
I20260709 13:03:54.826334 19122 raft_consensus.cc:3055] T c6c129816ac441a8bef29b84b78b791e P c611bf5baef04660ada573aaf2ae7740 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:03:54.826637 19122 raft_consensus.cc:740] T c6c129816ac441a8bef29b84b78b791e P c611bf5baef04660ada573aaf2ae7740 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c611bf5baef04660ada573aaf2ae7740, State: Running, Role: LEADER
I20260709 13:03:54.827387 19122 consensus_queue.cc:260] T c6c129816ac441a8bef29b84b78b791e P c611bf5baef04660ada573aaf2ae7740 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c611bf5baef04660ada573aaf2ae7740" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 46065 } } peers { permanent_uuid: "08100eb76c5a4fbd97f5a0b81c40f75d" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 37843 } } peers { permanent_uuid: "99b9b6a915a94310ba479b4d3ee7c966" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36031 } }
I20260709 13:03:54.828284 19122 raft_consensus.cc:3060] T c6c129816ac441a8bef29b84b78b791e P c611bf5baef04660ada573aaf2ae7740 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:54.859894 18919 raft_consensus.cc:1275] T c6c129816ac441a8bef29b84b78b791e P c611bf5baef04660ada573aaf2ae7740 [term 2 FOLLOWER]: Refusing update from remote peer 08100eb76c5a4fbd97f5a0b81c40f75d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 1. (term mismatch)
I20260709 13:03:54.860286 18919 pending_rounds.cc:85] T c6c129816ac441a8bef29b84b78b791e P c611bf5baef04660ada573aaf2ae7740: Aborting all ops after (but not including) 0
I20260709 13:03:54.860630 18919 pending_rounds.cc:107] T c6c129816ac441a8bef29b84b78b791e P c611bf5baef04660ada573aaf2ae7740: Aborting uncommitted NO_OP operation due to leader change: 1.1
I20260709 13:03:54.860970 18919 raft_consensus.cc:2889] T c6c129816ac441a8bef29b84b78b791e P c611bf5baef04660ada573aaf2ae7740 [term 2 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:03:54.862473 19115 consensus_queue.cc:1048] T c6c129816ac441a8bef29b84b78b791e P 08100eb76c5a4fbd97f5a0b81c40f75d [LEADER]: Connected to new peer: Peer: permanent_uuid: "c611bf5baef04660ada573aaf2ae7740" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 46065 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:03:54.871816 19068 raft_consensus.cc:1275] T c6c129816ac441a8bef29b84b78b791e P 99b9b6a915a94310ba479b4d3ee7c966 [term 2 FOLLOWER]: Refusing update from remote peer 08100eb76c5a4fbd97f5a0b81c40f75d: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 13:03:54.873708 19169 consensus_queue.cc:1048] T c6c129816ac441a8bef29b84b78b791e P 08100eb76c5a4fbd97f5a0b81c40f75d [LEADER]: Connected to new peer: Peer: permanent_uuid: "99b9b6a915a94310ba479b4d3ee7c966" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36031 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:03:54.877951 19122 raft_consensus.cc:493] T f1e8623946e9415991e70fecebc84607 P c611bf5baef04660ada573aaf2ae7740 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:54.878543 19122 raft_consensus.cc:515] T f1e8623946e9415991e70fecebc84607 P c611bf5baef04660ada573aaf2ae7740 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c611bf5baef04660ada573aaf2ae7740" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 46065 } } peers { permanent_uuid: "08100eb76c5a4fbd97f5a0b81c40f75d" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 37843 } } peers { permanent_uuid: "99b9b6a915a94310ba479b4d3ee7c966" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36031 } }
I20260709 13:03:54.880419 19122 leader_election.cc:290] T f1e8623946e9415991e70fecebc84607 P c611bf5baef04660ada573aaf2ae7740 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 08100eb76c5a4fbd97f5a0b81c40f75d (127.17.223.2:37843), 99b9b6a915a94310ba479b4d3ee7c966 (127.17.223.3:36031)
I20260709 13:03:54.881115 18995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1e8623946e9415991e70fecebc84607" candidate_uuid: "c611bf5baef04660ada573aaf2ae7740" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "08100eb76c5a4fbd97f5a0b81c40f75d" is_pre_election: true
I20260709 13:03:54.881716 18995 raft_consensus.cc:2468] T f1e8623946e9415991e70fecebc84607 P 08100eb76c5a4fbd97f5a0b81c40f75d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c611bf5baef04660ada573aaf2ae7740 in term 0.
I20260709 13:03:54.881832 19069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1e8623946e9415991e70fecebc84607" candidate_uuid: "c611bf5baef04660ada573aaf2ae7740" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "99b9b6a915a94310ba479b4d3ee7c966" is_pre_election: true
I20260709 13:03:54.882689 19069 raft_consensus.cc:2468] T f1e8623946e9415991e70fecebc84607 P 99b9b6a915a94310ba479b4d3ee7c966 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c611bf5baef04660ada573aaf2ae7740 in term 0.
I20260709 13:03:54.882889 18885 leader_election.cc:304] T f1e8623946e9415991e70fecebc84607 P c611bf5baef04660ada573aaf2ae7740 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 08100eb76c5a4fbd97f5a0b81c40f75d, c611bf5baef04660ada573aaf2ae7740; no voters: 
I20260709 13:03:54.884137 19122 raft_consensus.cc:2804] T f1e8623946e9415991e70fecebc84607 P c611bf5baef04660ada573aaf2ae7740 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:03:54.884527 19122 raft_consensus.cc:493] T f1e8623946e9415991e70fecebc84607 P c611bf5baef04660ada573aaf2ae7740 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:54.884840 19122 raft_consensus.cc:3060] T f1e8623946e9415991e70fecebc84607 P c611bf5baef04660ada573aaf2ae7740 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:54.886369 19149 raft_consensus.cc:493] T 7c52a94485bd40e6a022a546c42407b4 P 99b9b6a915a94310ba479b4d3ee7c966 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:54.886782 19149 raft_consensus.cc:515] T 7c52a94485bd40e6a022a546c42407b4 P 99b9b6a915a94310ba479b4d3ee7c966 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c611bf5baef04660ada573aaf2ae7740" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 46065 } } peers { permanent_uuid: "08100eb76c5a4fbd97f5a0b81c40f75d" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 37843 } } peers { permanent_uuid: "99b9b6a915a94310ba479b4d3ee7c966" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36031 } }
I20260709 13:03:54.888471 19149 leader_election.cc:290] T 7c52a94485bd40e6a022a546c42407b4 P 99b9b6a915a94310ba479b4d3ee7c966 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c611bf5baef04660ada573aaf2ae7740 (127.17.223.1:46065), 08100eb76c5a4fbd97f5a0b81c40f75d (127.17.223.2:37843)
I20260709 13:03:54.889199 18919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c52a94485bd40e6a022a546c42407b4" candidate_uuid: "99b9b6a915a94310ba479b4d3ee7c966" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c611bf5baef04660ada573aaf2ae7740" is_pre_election: true
I20260709 13:03:54.889989 18995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c52a94485bd40e6a022a546c42407b4" candidate_uuid: "99b9b6a915a94310ba479b4d3ee7c966" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "08100eb76c5a4fbd97f5a0b81c40f75d" is_pre_election: true
I20260709 13:03:54.890961 18995 raft_consensus.cc:2393] T 7c52a94485bd40e6a022a546c42407b4 P 08100eb76c5a4fbd97f5a0b81c40f75d [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 99b9b6a915a94310ba479b4d3ee7c966 in current term 1: Already voted for candidate c611bf5baef04660ada573aaf2ae7740 in this term.
I20260709 13:03:54.892248 19034 leader_election.cc:304] T 7c52a94485bd40e6a022a546c42407b4 P 99b9b6a915a94310ba479b4d3ee7c966 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 99b9b6a915a94310ba479b4d3ee7c966; no voters: 08100eb76c5a4fbd97f5a0b81c40f75d, c611bf5baef04660ada573aaf2ae7740
I20260709 13:03:54.892717 19069 raft_consensus.cc:3060] T 7c52a94485bd40e6a022a546c42407b4 P 99b9b6a915a94310ba479b4d3ee7c966 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:54.895049 19117 consensus_queue.cc:1048] T a8c3aa064aaa42b5b251eab220ab5e44 P 99b9b6a915a94310ba479b4d3ee7c966 [LEADER]: Connected to new peer: Peer: permanent_uuid: "08100eb76c5a4fbd97f5a0b81c40f75d" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 37843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:03:54.890067 19122 raft_consensus.cc:515] T f1e8623946e9415991e70fecebc84607 P c611bf5baef04660ada573aaf2ae7740 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c611bf5baef04660ada573aaf2ae7740" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 46065 } } peers { permanent_uuid: "08100eb76c5a4fbd97f5a0b81c40f75d" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 37843 } } peers { permanent_uuid: "99b9b6a915a94310ba479b4d3ee7c966" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36031 } }
I20260709 13:03:54.897645 18994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1e8623946e9415991e70fecebc84607" candidate_uuid: "c611bf5baef04660ada573aaf2ae7740" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "08100eb76c5a4fbd97f5a0b81c40f75d"
I20260709 13:03:54.898211 18994 raft_consensus.cc:3060] T f1e8623946e9415991e70fecebc84607 P 08100eb76c5a4fbd97f5a0b81c40f75d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:54.900971 19149 raft_consensus.cc:2749] T 7c52a94485bd40e6a022a546c42407b4 P 99b9b6a915a94310ba479b4d3ee7c966 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:03:54.903388 19131 consensus_queue.cc:1048] T 7c52a94485bd40e6a022a546c42407b4 P c611bf5baef04660ada573aaf2ae7740 [LEADER]: Connected to new peer: Peer: permanent_uuid: "99b9b6a915a94310ba479b4d3ee7c966" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36031 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:03:54.905777 19069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1e8623946e9415991e70fecebc84607" candidate_uuid: "c611bf5baef04660ada573aaf2ae7740" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "99b9b6a915a94310ba479b4d3ee7c966"
I20260709 13:03:54.906327 19069 raft_consensus.cc:3060] T f1e8623946e9415991e70fecebc84607 P 99b9b6a915a94310ba479b4d3ee7c966 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:54.907155 19122 leader_election.cc:290] T f1e8623946e9415991e70fecebc84607 P c611bf5baef04660ada573aaf2ae7740 [CANDIDATE]: Term 1 election: Requested vote from peers 08100eb76c5a4fbd97f5a0b81c40f75d (127.17.223.2:37843), 99b9b6a915a94310ba479b4d3ee7c966 (127.17.223.3:36031)
I20260709 13:03:54.908268 18994 raft_consensus.cc:2468] T f1e8623946e9415991e70fecebc84607 P 08100eb76c5a4fbd97f5a0b81c40f75d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c611bf5baef04660ada573aaf2ae7740 in term 1.
I20260709 13:03:54.909861 18885 leader_election.cc:304] T f1e8623946e9415991e70fecebc84607 P c611bf5baef04660ada573aaf2ae7740 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 08100eb76c5a4fbd97f5a0b81c40f75d, c611bf5baef04660ada573aaf2ae7740; no voters: 
I20260709 13:03:54.910686 19122 raft_consensus.cc:2804] T f1e8623946e9415991e70fecebc84607 P c611bf5baef04660ada573aaf2ae7740 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:03:54.911193 19122 raft_consensus.cc:697] T f1e8623946e9415991e70fecebc84607 P c611bf5baef04660ada573aaf2ae7740 [term 1 LEADER]: Becoming Leader. State: Replica: c611bf5baef04660ada573aaf2ae7740, State: Running, Role: LEADER
I20260709 13:03:54.912035 19122 consensus_queue.cc:237] T f1e8623946e9415991e70fecebc84607 P c611bf5baef04660ada573aaf2ae7740 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c611bf5baef04660ada573aaf2ae7740" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 46065 } } peers { permanent_uuid: "08100eb76c5a4fbd97f5a0b81c40f75d" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 37843 } } peers { permanent_uuid: "99b9b6a915a94310ba479b4d3ee7c966" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36031 } }
I20260709 13:03:54.913911 19069 raft_consensus.cc:2468] T f1e8623946e9415991e70fecebc84607 P 99b9b6a915a94310ba479b4d3ee7c966 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c611bf5baef04660ada573aaf2ae7740 in term 1.
I20260709 13:03:54.921319 19117 consensus_queue.cc:1048] T a8c3aa064aaa42b5b251eab220ab5e44 P 99b9b6a915a94310ba479b4d3ee7c966 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c611bf5baef04660ada573aaf2ae7740" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 46065 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:03:54.932751 18818 catalog_manager.cc:5697] T f1e8623946e9415991e70fecebc84607 P c611bf5baef04660ada573aaf2ae7740 reported cstate change: term changed from 0 to 1, leader changed from <none> to c611bf5baef04660ada573aaf2ae7740 (127.17.223.1). New cstate: current_term: 1 leader_uuid: "c611bf5baef04660ada573aaf2ae7740" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c611bf5baef04660ada573aaf2ae7740" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 46065 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "08100eb76c5a4fbd97f5a0b81c40f75d" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 37843 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "99b9b6a915a94310ba479b4d3ee7c966" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36031 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:54.939850 19122 consensus_queue.cc:1048] T 7c52a94485bd40e6a022a546c42407b4 P c611bf5baef04660ada573aaf2ae7740 [LEADER]: Connected to new peer: Peer: permanent_uuid: "08100eb76c5a4fbd97f5a0b81c40f75d" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 37843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:03:54.986035 19169 consensus_queue.cc:1048] T 382fc7fe4d2e47af99f993423be05a77 P 08100eb76c5a4fbd97f5a0b81c40f75d [LEADER]: Connected to new peer: Peer: permanent_uuid: "c611bf5baef04660ada573aaf2ae7740" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 46065 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:03:54.995848 19115 consensus_queue.cc:1048] T 382fc7fe4d2e47af99f993423be05a77 P 08100eb76c5a4fbd97f5a0b81c40f75d [LEADER]: Connected to new peer: Peer: permanent_uuid: "99b9b6a915a94310ba479b4d3ee7c966" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36031 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:03:55.037465 19122 consensus_queue.cc:1048] T 1109aee81b854cdcbac189f499fb0912 P c611bf5baef04660ada573aaf2ae7740 [LEADER]: Connected to new peer: Peer: permanent_uuid: "08100eb76c5a4fbd97f5a0b81c40f75d" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 37843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:03:55.048269 19122 consensus_queue.cc:1048] T 1109aee81b854cdcbac189f499fb0912 P c611bf5baef04660ada573aaf2ae7740 [LEADER]: Connected to new peer: Peer: permanent_uuid: "99b9b6a915a94310ba479b4d3ee7c966" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36031 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:03:55.055454 19115 raft_consensus.cc:493] T 05ab4aa1987a441f8eb5811181a6f1c0 P 08100eb76c5a4fbd97f5a0b81c40f75d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:55.056005 19115 raft_consensus.cc:515] T 05ab4aa1987a441f8eb5811181a6f1c0 P 08100eb76c5a4fbd97f5a0b81c40f75d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c611bf5baef04660ada573aaf2ae7740" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 46065 } } peers { permanent_uuid: "08100eb76c5a4fbd97f5a0b81c40f75d" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 37843 } } peers { permanent_uuid: "99b9b6a915a94310ba479b4d3ee7c966" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36031 } }
I20260709 13:03:55.058522 19115 leader_election.cc:290] T 05ab4aa1987a441f8eb5811181a6f1c0 P 08100eb76c5a4fbd97f5a0b81c40f75d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c611bf5baef04660ada573aaf2ae7740 (127.17.223.1:46065), 99b9b6a915a94310ba479b4d3ee7c966 (127.17.223.3:36031)
I20260709 13:03:55.058844 18919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05ab4aa1987a441f8eb5811181a6f1c0" candidate_uuid: "08100eb76c5a4fbd97f5a0b81c40f75d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c611bf5baef04660ada573aaf2ae7740" is_pre_election: true
I20260709 13:03:55.059412 18919 raft_consensus.cc:2468] T 05ab4aa1987a441f8eb5811181a6f1c0 P c611bf5baef04660ada573aaf2ae7740 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 08100eb76c5a4fbd97f5a0b81c40f75d in term 0.
I20260709 13:03:55.059444 19067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05ab4aa1987a441f8eb5811181a6f1c0" candidate_uuid: "08100eb76c5a4fbd97f5a0b81c40f75d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "99b9b6a915a94310ba479b4d3ee7c966" is_pre_election: true
I20260709 13:03:55.060425 18958 leader_election.cc:304] T 05ab4aa1987a441f8eb5811181a6f1c0 P 08100eb76c5a4fbd97f5a0b81c40f75d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 08100eb76c5a4fbd97f5a0b81c40f75d, c611bf5baef04660ada573aaf2ae7740; no voters: 
I20260709 13:03:55.061283 19115 raft_consensus.cc:2804] T 05ab4aa1987a441f8eb5811181a6f1c0 P 08100eb76c5a4fbd97f5a0b81c40f75d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:03:55.061751 19115 raft_consensus.cc:493] T 05ab4aa1987a441f8eb5811181a6f1c0 P 08100eb76c5a4fbd97f5a0b81c40f75d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:55.062120 19115 raft_consensus.cc:3060] T 05ab4aa1987a441f8eb5811181a6f1c0 P 08100eb76c5a4fbd97f5a0b81c40f75d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:55.061206 19067 raft_consensus.cc:2468] T 05ab4aa1987a441f8eb5811181a6f1c0 P 99b9b6a915a94310ba479b4d3ee7c966 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 08100eb76c5a4fbd97f5a0b81c40f75d in term 0.
I20260709 13:03:55.069478 19115 raft_consensus.cc:515] T 05ab4aa1987a441f8eb5811181a6f1c0 P 08100eb76c5a4fbd97f5a0b81c40f75d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c611bf5baef04660ada573aaf2ae7740" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 46065 } } peers { permanent_uuid: "08100eb76c5a4fbd97f5a0b81c40f75d" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 37843 } } peers { permanent_uuid: "99b9b6a915a94310ba479b4d3ee7c966" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36031 } }
I20260709 13:03:55.071112 19115 leader_election.cc:290] T 05ab4aa1987a441f8eb5811181a6f1c0 P 08100eb76c5a4fbd97f5a0b81c40f75d [CANDIDATE]: Term 1 election: Requested vote from peers c611bf5baef04660ada573aaf2ae7740 (127.17.223.1:46065), 99b9b6a915a94310ba479b4d3ee7c966 (127.17.223.3:36031)
I20260709 13:03:55.071924 18919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05ab4aa1987a441f8eb5811181a6f1c0" candidate_uuid: "08100eb76c5a4fbd97f5a0b81c40f75d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c611bf5baef04660ada573aaf2ae7740"
I20260709 13:03:55.072094 19067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05ab4aa1987a441f8eb5811181a6f1c0" candidate_uuid: "08100eb76c5a4fbd97f5a0b81c40f75d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "99b9b6a915a94310ba479b4d3ee7c966"
I20260709 13:03:55.072486 18919 raft_consensus.cc:3060] T 05ab4aa1987a441f8eb5811181a6f1c0 P c611bf5baef04660ada573aaf2ae7740 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:55.072618 19067 raft_consensus.cc:3060] T 05ab4aa1987a441f8eb5811181a6f1c0 P 99b9b6a915a94310ba479b4d3ee7c966 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:55.077965 19067 raft_consensus.cc:2468] T 05ab4aa1987a441f8eb5811181a6f1c0 P 99b9b6a915a94310ba479b4d3ee7c966 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 08100eb76c5a4fbd97f5a0b81c40f75d in term 1.
I20260709 13:03:55.077960 18919 raft_consensus.cc:2468] T 05ab4aa1987a441f8eb5811181a6f1c0 P c611bf5baef04660ada573aaf2ae7740 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 08100eb76c5a4fbd97f5a0b81c40f75d in term 1.
I20260709 13:03:55.079085 18961 leader_election.cc:304] T 05ab4aa1987a441f8eb5811181a6f1c0 P 08100eb76c5a4fbd97f5a0b81c40f75d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 08100eb76c5a4fbd97f5a0b81c40f75d, 99b9b6a915a94310ba479b4d3ee7c966; no voters: 
I20260709 13:03:55.079748 19115 raft_consensus.cc:2804] T 05ab4aa1987a441f8eb5811181a6f1c0 P 08100eb76c5a4fbd97f5a0b81c40f75d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:03:55.080281 19115 raft_consensus.cc:697] T 05ab4aa1987a441f8eb5811181a6f1c0 P 08100eb76c5a4fbd97f5a0b81c40f75d [term 1 LEADER]: Becoming Leader. State: Replica: 08100eb76c5a4fbd97f5a0b81c40f75d, State: Running, Role: LEADER
I20260709 13:03:55.080986 19115 consensus_queue.cc:237] T 05ab4aa1987a441f8eb5811181a6f1c0 P 08100eb76c5a4fbd97f5a0b81c40f75d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c611bf5baef04660ada573aaf2ae7740" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 46065 } } peers { permanent_uuid: "08100eb76c5a4fbd97f5a0b81c40f75d" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 37843 } } peers { permanent_uuid: "99b9b6a915a94310ba479b4d3ee7c966" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36031 } }
I20260709 13:03:55.088279 18817 catalog_manager.cc:5697] T 05ab4aa1987a441f8eb5811181a6f1c0 P 08100eb76c5a4fbd97f5a0b81c40f75d reported cstate change: term changed from 0 to 1, leader changed from <none> to 08100eb76c5a4fbd97f5a0b81c40f75d (127.17.223.2). New cstate: current_term: 1 leader_uuid: "08100eb76c5a4fbd97f5a0b81c40f75d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c611bf5baef04660ada573aaf2ae7740" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 46065 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "08100eb76c5a4fbd97f5a0b81c40f75d" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 37843 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "99b9b6a915a94310ba479b4d3ee7c966" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36031 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:55.109622 19149 consensus_queue.cc:1048] T b190be4cf1684677b783edcb8f9ae128 P 99b9b6a915a94310ba479b4d3ee7c966 [LEADER]: Connected to new peer: Peer: permanent_uuid: "08100eb76c5a4fbd97f5a0b81c40f75d" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 37843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:03:55.118891 19176 consensus_queue.cc:1048] T b190be4cf1684677b783edcb8f9ae128 P 99b9b6a915a94310ba479b4d3ee7c966 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c611bf5baef04660ada573aaf2ae7740" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 46065 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:03:55.173470 19122 consensus_queue.cc:1048] T 635268a9733742f3aa2abc8ce5779d9f P c611bf5baef04660ada573aaf2ae7740 [LEADER]: Connected to new peer: Peer: permanent_uuid: "99b9b6a915a94310ba479b4d3ee7c966" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36031 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:03:55.183782 19116 consensus_queue.cc:1048] T 635268a9733742f3aa2abc8ce5779d9f P c611bf5baef04660ada573aaf2ae7740 [LEADER]: Connected to new peer: Peer: permanent_uuid: "08100eb76c5a4fbd97f5a0b81c40f75d" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 37843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:03:55.283062 19116 consensus_queue.cc:1048] T 4c9ffc27fdd54b68bb2d8e2e229ae923 P c611bf5baef04660ada573aaf2ae7740 [LEADER]: Connected to new peer: Peer: permanent_uuid: "08100eb76c5a4fbd97f5a0b81c40f75d" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 37843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:03:55.293939 19116 consensus_queue.cc:1048] T 4c9ffc27fdd54b68bb2d8e2e229ae923 P c611bf5baef04660ada573aaf2ae7740 [LEADER]: Connected to new peer: Peer: permanent_uuid: "99b9b6a915a94310ba479b4d3ee7c966" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36031 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:03:55.316421 19122 consensus_queue.cc:1048] T f1e8623946e9415991e70fecebc84607 P c611bf5baef04660ada573aaf2ae7740 [LEADER]: Connected to new peer: Peer: permanent_uuid: "99b9b6a915a94310ba479b4d3ee7c966" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36031 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:03:55.328997 19191 consensus_queue.cc:1048] T f1e8623946e9415991e70fecebc84607 P c611bf5baef04660ada573aaf2ae7740 [LEADER]: Connected to new peer: Peer: permanent_uuid: "08100eb76c5a4fbd97f5a0b81c40f75d" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 37843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:03:55.362792 19067 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a8c3aa064aaa42b5b251eab220ab5e44"
dest_uuid: "99b9b6a915a94310ba479b4d3ee7c966"
mode: GRACEFUL
new_leader_uuid: "c611bf5baef04660ada573aaf2ae7740"
 from {username='slave'} at 127.0.0.1:50614
I20260709 13:03:55.363332 19067 raft_consensus.cc:606] T a8c3aa064aaa42b5b251eab220ab5e44 P 99b9b6a915a94310ba479b4d3ee7c966 [term 1 LEADER]: Received request to transfer leadership to TS c611bf5baef04660ada573aaf2ae7740
I20260709 13:03:55.380488 18994 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c6c129816ac441a8bef29b84b78b791e"
dest_uuid: "08100eb76c5a4fbd97f5a0b81c40f75d"
mode: GRACEFUL
new_leader_uuid: "c611bf5baef04660ada573aaf2ae7740"
 from {username='slave'} at 127.0.0.1:48722
I20260709 13:03:55.381033 18994 raft_consensus.cc:606] T c6c129816ac441a8bef29b84b78b791e P 08100eb76c5a4fbd97f5a0b81c40f75d [term 2 LEADER]: Received request to transfer leadership to TS c611bf5baef04660ada573aaf2ae7740
I20260709 13:03:55.386838 18994 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "382fc7fe4d2e47af99f993423be05a77"
dest_uuid: "08100eb76c5a4fbd97f5a0b81c40f75d"
mode: GRACEFUL
new_leader_uuid: "c611bf5baef04660ada573aaf2ae7740"
 from {username='slave'} at 127.0.0.1:48722
I20260709 13:03:55.387281 18994 raft_consensus.cc:606] T 382fc7fe4d2e47af99f993423be05a77 P 08100eb76c5a4fbd97f5a0b81c40f75d [term 1 LEADER]: Received request to transfer leadership to TS c611bf5baef04660ada573aaf2ae7740
I20260709 13:03:55.400075 18919 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "635268a9733742f3aa2abc8ce5779d9f"
dest_uuid: "c611bf5baef04660ada573aaf2ae7740"
mode: GRACEFUL
new_leader_uuid: "08100eb76c5a4fbd97f5a0b81c40f75d"
 from {username='slave'} at 127.0.0.1:36638
I20260709 13:03:55.400538 18919 raft_consensus.cc:606] T 635268a9733742f3aa2abc8ce5779d9f P c611bf5baef04660ada573aaf2ae7740 [term 1 LEADER]: Received request to transfer leadership to TS 08100eb76c5a4fbd97f5a0b81c40f75d
I20260709 13:03:55.405406 19067 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b190be4cf1684677b783edcb8f9ae128"
dest_uuid: "99b9b6a915a94310ba479b4d3ee7c966"
mode: GRACEFUL
new_leader_uuid: "08100eb76c5a4fbd97f5a0b81c40f75d"
 from {username='slave'} at 127.0.0.1:50614
I20260709 13:03:55.405946 19132 raft_consensus.cc:993] T 382fc7fe4d2e47af99f993423be05a77 P 08100eb76c5a4fbd97f5a0b81c40f75d: : Instructing follower c611bf5baef04660ada573aaf2ae7740 to start an election
I20260709 13:03:55.405990 19067 raft_consensus.cc:606] T b190be4cf1684677b783edcb8f9ae128 P 99b9b6a915a94310ba479b4d3ee7c966 [term 1 LEADER]: Received request to transfer leadership to TS 08100eb76c5a4fbd97f5a0b81c40f75d
I20260709 13:03:55.406451 19115 raft_consensus.cc:1081] T 382fc7fe4d2e47af99f993423be05a77 P 08100eb76c5a4fbd97f5a0b81c40f75d [term 1 LEADER]: Signalling peer c611bf5baef04660ada573aaf2ae7740 to start an election
I20260709 13:03:55.407984 18919 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "382fc7fe4d2e47af99f993423be05a77"
dest_uuid: "c611bf5baef04660ada573aaf2ae7740"
 from {username='slave'} at 127.0.0.1:36612
I20260709 13:03:55.408504 18919 raft_consensus.cc:493] T 382fc7fe4d2e47af99f993423be05a77 P c611bf5baef04660ada573aaf2ae7740 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:03:55.408823 18919 raft_consensus.cc:3060] T 382fc7fe4d2e47af99f993423be05a77 P c611bf5baef04660ada573aaf2ae7740 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:55.413432 18920 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f1e8623946e9415991e70fecebc84607"
dest_uuid: "c611bf5baef04660ada573aaf2ae7740"
mode: GRACEFUL
new_leader_uuid: "08100eb76c5a4fbd97f5a0b81c40f75d"
 from {username='slave'} at 127.0.0.1:36638
I20260709 13:03:55.413900 18920 raft_consensus.cc:606] T f1e8623946e9415991e70fecebc84607 P c611bf5baef04660ada573aaf2ae7740 [term 1 LEADER]: Received request to transfer leadership to TS 08100eb76c5a4fbd97f5a0b81c40f75d
I20260709 13:03:55.414307 18919 raft_consensus.cc:515] T 382fc7fe4d2e47af99f993423be05a77 P c611bf5baef04660ada573aaf2ae7740 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c611bf5baef04660ada573aaf2ae7740" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 46065 } } peers { permanent_uuid: "08100eb76c5a4fbd97f5a0b81c40f75d" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 37843 } } peers { permanent_uuid: "99b9b6a915a94310ba479b4d3ee7c966" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36031 } }
I20260709 13:03:55.416467 18919 leader_election.cc:290] T 382fc7fe4d2e47af99f993423be05a77 P c611bf5baef04660ada573aaf2ae7740 [CANDIDATE]: Term 2 election: Requested vote from peers 08100eb76c5a4fbd97f5a0b81c40f75d (127.17.223.2:37843), 99b9b6a915a94310ba479b4d3ee7c966 (127.17.223.3:36031)
I20260709 13:03:55.416903 18994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "382fc7fe4d2e47af99f993423be05a77" candidate_uuid: "c611bf5baef04660ada573aaf2ae7740" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "08100eb76c5a4fbd97f5a0b81c40f75d"
I20260709 13:03:55.417402 18994 raft_consensus.cc:3055] T 382fc7fe4d2e47af99f993423be05a77 P 08100eb76c5a4fbd97f5a0b81c40f75d [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:03:55.417465 19067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "382fc7fe4d2e47af99f993423be05a77" candidate_uuid: "c611bf5baef04660ada573aaf2ae7740" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "99b9b6a915a94310ba479b4d3ee7c966"
I20260709 13:03:55.417639 18994 raft_consensus.cc:740] T 382fc7fe4d2e47af99f993423be05a77 P 08100eb76c5a4fbd97f5a0b81c40f75d [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 08100eb76c5a4fbd97f5a0b81c40f75d, State: Running, Role: LEADER
I20260709 13:03:55.417956 19067 raft_consensus.cc:3060] T 382fc7fe4d2e47af99f993423be05a77 P 99b9b6a915a94310ba479b4d3ee7c966 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:55.418339 18994 consensus_queue.cc:260] T 382fc7fe4d2e47af99f993423be05a77 P 08100eb76c5a4fbd97f5a0b81c40f75d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c611bf5baef04660ada573aaf2ae7740" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 46065 } } peers { permanent_uuid: "08100eb76c5a4fbd97f5a0b81c40f75d" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 37843 } } peers { permanent_uuid: "99b9b6a915a94310ba479b4d3ee7c966" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36031 } }
I20260709 13:03:55.419476 18994 raft_consensus.cc:3060] T 382fc7fe4d2e47af99f993423be05a77 P 08100eb76c5a4fbd97f5a0b81c40f75d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:55.420002 18919 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4c9ffc27fdd54b68bb2d8e2e229ae923"
dest_uuid: "c611bf5baef04660ada573aaf2ae7740"
mode: GRACEFUL
new_leader_uuid: "99b9b6a915a94310ba479b4d3ee7c966"
 from {username='slave'} at 127.0.0.1:36638
I20260709 13:03:55.420555 18919 raft_consensus.cc:606] T 4c9ffc27fdd54b68bb2d8e2e229ae923 P c611bf5baef04660ada573aaf2ae7740 [term 1 LEADER]: Received request to transfer leadership to TS 99b9b6a915a94310ba479b4d3ee7c966
I20260709 13:03:55.423622 19067 raft_consensus.cc:2468] T 382fc7fe4d2e47af99f993423be05a77 P 99b9b6a915a94310ba479b4d3ee7c966 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c611bf5baef04660ada573aaf2ae7740 in term 2.
I20260709 13:03:55.424257 18994 raft_consensus.cc:2468] T 382fc7fe4d2e47af99f993423be05a77 P 08100eb76c5a4fbd97f5a0b81c40f75d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c611bf5baef04660ada573aaf2ae7740 in term 2.
I20260709 13:03:55.424589 18886 leader_election.cc:304] T 382fc7fe4d2e47af99f993423be05a77 P c611bf5baef04660ada573aaf2ae7740 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 99b9b6a915a94310ba479b4d3ee7c966, c611bf5baef04660ada573aaf2ae7740; no voters: 
I20260709 13:03:55.425272 19191 raft_consensus.cc:2804] T 382fc7fe4d2e47af99f993423be05a77 P c611bf5baef04660ada573aaf2ae7740 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:03:55.425664 19191 raft_consensus.cc:697] T 382fc7fe4d2e47af99f993423be05a77 P c611bf5baef04660ada573aaf2ae7740 [term 2 LEADER]: Becoming Leader. State: Replica: c611bf5baef04660ada573aaf2ae7740, State: Running, Role: LEADER
I20260709 13:03:55.426445 19191 consensus_queue.cc:237] T 382fc7fe4d2e47af99f993423be05a77 P c611bf5baef04660ada573aaf2ae7740 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c611bf5baef04660ada573aaf2ae7740" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 46065 } } peers { permanent_uuid: "08100eb76c5a4fbd97f5a0b81c40f75d" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 37843 } } peers { permanent_uuid: "99b9b6a915a94310ba479b4d3ee7c966" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36031 } }
I20260709 13:03:55.431869 18818 catalog_manager.cc:5697] T 382fc7fe4d2e47af99f993423be05a77 P c611bf5baef04660ada573aaf2ae7740 reported cstate change: term changed from 1 to 2, leader changed from 08100eb76c5a4fbd97f5a0b81c40f75d (127.17.223.2) to c611bf5baef04660ada573aaf2ae7740 (127.17.223.1). New cstate: current_term: 2 leader_uuid: "c611bf5baef04660ada573aaf2ae7740" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c611bf5baef04660ada573aaf2ae7740" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 46065 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "08100eb76c5a4fbd97f5a0b81c40f75d" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 37843 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "99b9b6a915a94310ba479b4d3ee7c966" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36031 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:55.467621 19117 raft_consensus.cc:993] T a8c3aa064aaa42b5b251eab220ab5e44 P 99b9b6a915a94310ba479b4d3ee7c966: : Instructing follower c611bf5baef04660ada573aaf2ae7740 to start an election
I20260709 13:03:55.468137 19176 raft_consensus.cc:1081] T a8c3aa064aaa42b5b251eab220ab5e44 P 99b9b6a915a94310ba479b4d3ee7c966 [term 1 LEADER]: Signalling peer c611bf5baef04660ada573aaf2ae7740 to start an election
I20260709 13:03:55.469756 18919 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a8c3aa064aaa42b5b251eab220ab5e44"
dest_uuid: "c611bf5baef04660ada573aaf2ae7740"
 from {username='slave'} at 127.0.0.1:36628
I20260709 13:03:55.470317 18919 raft_consensus.cc:493] T a8c3aa064aaa42b5b251eab220ab5e44 P c611bf5baef04660ada573aaf2ae7740 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:03:55.470758 18919 raft_consensus.cc:3060] T a8c3aa064aaa42b5b251eab220ab5e44 P c611bf5baef04660ada573aaf2ae7740 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:55.476822 18919 raft_consensus.cc:515] T a8c3aa064aaa42b5b251eab220ab5e44 P c611bf5baef04660ada573aaf2ae7740 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c611bf5baef04660ada573aaf2ae7740" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 46065 } } peers { permanent_uuid: "08100eb76c5a4fbd97f5a0b81c40f75d" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 37843 } } peers { permanent_uuid: "99b9b6a915a94310ba479b4d3ee7c966" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36031 } }
I20260709 13:03:55.478878 18919 leader_election.cc:290] T a8c3aa064aaa42b5b251eab220ab5e44 P c611bf5baef04660ada573aaf2ae7740 [CANDIDATE]: Term 2 election: Requested vote from peers 08100eb76c5a4fbd97f5a0b81c40f75d (127.17.223.2:37843), 99b9b6a915a94310ba479b4d3ee7c966 (127.17.223.3:36031)
I20260709 13:03:55.479538 18994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8c3aa064aaa42b5b251eab220ab5e44" candidate_uuid: "c611bf5baef04660ada573aaf2ae7740" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "08100eb76c5a4fbd97f5a0b81c40f75d"
I20260709 13:03:55.479846 19067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8c3aa064aaa42b5b251eab220ab5e44" candidate_uuid: "c611bf5baef04660ada573aaf2ae7740" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "99b9b6a915a94310ba479b4d3ee7c966"
I20260709 13:03:55.480162 18994 raft_consensus.cc:3060] T a8c3aa064aaa42b5b251eab220ab5e44 P 08100eb76c5a4fbd97f5a0b81c40f75d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:55.480443 19067 raft_consensus.cc:3055] T a8c3aa064aaa42b5b251eab220ab5e44 P 99b9b6a915a94310ba479b4d3ee7c966 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:03:55.480798 19067 raft_consensus.cc:740] T a8c3aa064aaa42b5b251eab220ab5e44 P 99b9b6a915a94310ba479b4d3ee7c966 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 99b9b6a915a94310ba479b4d3ee7c966, State: Running, Role: LEADER
I20260709 13:03:55.481657 19067 consensus_queue.cc:260] T a8c3aa064aaa42b5b251eab220ab5e44 P 99b9b6a915a94310ba479b4d3ee7c966 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c611bf5baef04660ada573aaf2ae7740" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 46065 } } peers { permanent_uuid: "08100eb76c5a4fbd97f5a0b81c40f75d" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 37843 } } peers { permanent_uuid: "99b9b6a915a94310ba479b4d3ee7c966" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36031 } }
I20260709 13:03:55.482985 19067 raft_consensus.cc:3060] T a8c3aa064aaa42b5b251eab220ab5e44 P 99b9b6a915a94310ba479b4d3ee7c966 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:55.487428 18994 raft_consensus.cc:2468] T a8c3aa064aaa42b5b251eab220ab5e44 P 08100eb76c5a4fbd97f5a0b81c40f75d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c611bf5baef04660ada573aaf2ae7740 in term 2.
I20260709 13:03:55.488660 18885 leader_election.cc:304] T a8c3aa064aaa42b5b251eab220ab5e44 P c611bf5baef04660ada573aaf2ae7740 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 08100eb76c5a4fbd97f5a0b81c40f75d, c611bf5baef04660ada573aaf2ae7740; no voters: 
I20260709 13:03:55.489500 19191 raft_consensus.cc:2804] T a8c3aa064aaa42b5b251eab220ab5e44 P c611bf5baef04660ada573aaf2ae7740 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:03:55.489902 19191 raft_consensus.cc:697] T a8c3aa064aaa42b5b251eab220ab5e44 P c611bf5baef04660ada573aaf2ae7740 [term 2 LEADER]: Becoming Leader. State: Replica: c611bf5baef04660ada573aaf2ae7740, State: Running, Role: LEADER
I20260709 13:03:55.490254 19067 raft_consensus.cc:2468] T a8c3aa064aaa42b5b251eab220ab5e44 P 99b9b6a915a94310ba479b4d3ee7c966 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c611bf5baef04660ada573aaf2ae7740 in term 2.
I20260709 13:03:55.490640 19191 consensus_queue.cc:237] T a8c3aa064aaa42b5b251eab220ab5e44 P c611bf5baef04660ada573aaf2ae7740 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c611bf5baef04660ada573aaf2ae7740" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 46065 } } peers { permanent_uuid: "08100eb76c5a4fbd97f5a0b81c40f75d" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 37843 } } peers { permanent_uuid: "99b9b6a915a94310ba479b4d3ee7c966" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36031 } }
I20260709 13:03:55.497139 18818 catalog_manager.cc:5697] T a8c3aa064aaa42b5b251eab220ab5e44 P c611bf5baef04660ada573aaf2ae7740 reported cstate change: term changed from 1 to 2, leader changed from 99b9b6a915a94310ba479b4d3ee7c966 (127.17.223.3) to c611bf5baef04660ada573aaf2ae7740 (127.17.223.1). New cstate: current_term: 2 leader_uuid: "c611bf5baef04660ada573aaf2ae7740" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c611bf5baef04660ada573aaf2ae7740" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 46065 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "08100eb76c5a4fbd97f5a0b81c40f75d" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 37843 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "99b9b6a915a94310ba479b4d3ee7c966" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36031 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:55.569170 19115 consensus_queue.cc:1048] T 05ab4aa1987a441f8eb5811181a6f1c0 P 08100eb76c5a4fbd97f5a0b81c40f75d [LEADER]: Connected to new peer: Peer: permanent_uuid: "99b9b6a915a94310ba479b4d3ee7c966" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36031 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:03:55.579196 19115 consensus_queue.cc:1048] T 05ab4aa1987a441f8eb5811181a6f1c0 P 08100eb76c5a4fbd97f5a0b81c40f75d [LEADER]: Connected to new peer: Peer: permanent_uuid: "c611bf5baef04660ada573aaf2ae7740" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 46065 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:03:55.647383 19122 raft_consensus.cc:993] T 635268a9733742f3aa2abc8ce5779d9f P c611bf5baef04660ada573aaf2ae7740: : Instructing follower 08100eb76c5a4fbd97f5a0b81c40f75d to start an election
I20260709 13:03:55.647866 19122 raft_consensus.cc:1081] T 635268a9733742f3aa2abc8ce5779d9f P c611bf5baef04660ada573aaf2ae7740 [term 1 LEADER]: Signalling peer 08100eb76c5a4fbd97f5a0b81c40f75d to start an election
I20260709 13:03:55.649298 18994 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "635268a9733742f3aa2abc8ce5779d9f"
dest_uuid: "08100eb76c5a4fbd97f5a0b81c40f75d"
 from {username='slave'} at 127.0.0.1:48710
I20260709 13:03:55.649773 18994 raft_consensus.cc:493] T 635268a9733742f3aa2abc8ce5779d9f P 08100eb76c5a4fbd97f5a0b81c40f75d [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:03:55.650090 18994 raft_consensus.cc:3060] T 635268a9733742f3aa2abc8ce5779d9f P 08100eb76c5a4fbd97f5a0b81c40f75d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:55.654917 18994 raft_consensus.cc:515] T 635268a9733742f3aa2abc8ce5779d9f P 08100eb76c5a4fbd97f5a0b81c40f75d [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c611bf5baef04660ada573aaf2ae7740" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 46065 } } peers { permanent_uuid: "08100eb76c5a4fbd97f5a0b81c40f75d" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 37843 } } peers { permanent_uuid: "99b9b6a915a94310ba479b4d3ee7c966" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36031 } }
I20260709 13:03:55.656716 18994 leader_election.cc:290] T 635268a9733742f3aa2abc8ce5779d9f P 08100eb76c5a4fbd97f5a0b81c40f75d [CANDIDATE]: Term 2 election: Requested vote from peers c611bf5baef04660ada573aaf2ae7740 (127.17.223.1:46065), 99b9b6a915a94310ba479b4d3ee7c966 (127.17.223.3:36031)
I20260709 13:03:55.657516 18919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "635268a9733742f3aa2abc8ce5779d9f" candidate_uuid: "08100eb76c5a4fbd97f5a0b81c40f75d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c611bf5baef04660ada573aaf2ae7740"
I20260709 13:03:55.657814 19067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "635268a9733742f3aa2abc8ce5779d9f" candidate_uuid: "08100eb76c5a4fbd97f5a0b81c40f75d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "99b9b6a915a94310ba479b4d3ee7c966"
I20260709 13:03:55.657986 18919 raft_consensus.cc:3055] T 635268a9733742f3aa2abc8ce5779d9f P c611bf5baef04660ada573aaf2ae7740 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:03:55.658365 18919 raft_consensus.cc:740] T 635268a9733742f3aa2abc8ce5779d9f P c611bf5baef04660ada573aaf2ae7740 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c611bf5baef04660ada573aaf2ae7740, State: Running, Role: LEADER
I20260709 13:03:55.658411 19067 raft_consensus.cc:3060] T 635268a9733742f3aa2abc8ce5779d9f P 99b9b6a915a94310ba479b4d3ee7c966 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:55.659072 18919 consensus_queue.cc:260] T 635268a9733742f3aa2abc8ce5779d9f P c611bf5baef04660ada573aaf2ae7740 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c611bf5baef04660ada573aaf2ae7740" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 46065 } } peers { permanent_uuid: "08100eb76c5a4fbd97f5a0b81c40f75d" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 37843 } } peers { permanent_uuid: "99b9b6a915a94310ba479b4d3ee7c966" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36031 } }
I20260709 13:03:55.659919 18919 raft_consensus.cc:3060] T 635268a9733742f3aa2abc8ce5779d9f P c611bf5baef04660ada573aaf2ae7740 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:55.663407 19067 raft_consensus.cc:2468] T 635268a9733742f3aa2abc8ce5779d9f P 99b9b6a915a94310ba479b4d3ee7c966 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 08100eb76c5a4fbd97f5a0b81c40f75d in term 2.
I20260709 13:03:55.664390 18919 raft_consensus.cc:2468] T 635268a9733742f3aa2abc8ce5779d9f P c611bf5baef04660ada573aaf2ae7740 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 08100eb76c5a4fbd97f5a0b81c40f75d in term 2.
I20260709 13:03:55.664391 18961 leader_election.cc:304] T 635268a9733742f3aa2abc8ce5779d9f P 08100eb76c5a4fbd97f5a0b81c40f75d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 08100eb76c5a4fbd97f5a0b81c40f75d, 99b9b6a915a94310ba479b4d3ee7c966; no voters: 
I20260709 13:03:55.665271 19115 raft_consensus.cc:2804] T 635268a9733742f3aa2abc8ce5779d9f P 08100eb76c5a4fbd97f5a0b81c40f75d [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:03:55.665736 19115 raft_consensus.cc:697] T 635268a9733742f3aa2abc8ce5779d9f P 08100eb76c5a4fbd97f5a0b81c40f75d [term 2 LEADER]: Becoming Leader. State: Replica: 08100eb76c5a4fbd97f5a0b81c40f75d, State: Running, Role: LEADER
I20260709 13:03:55.666553 19115 consensus_queue.cc:237] T 635268a9733742f3aa2abc8ce5779d9f P 08100eb76c5a4fbd97f5a0b81c40f75d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c611bf5baef04660ada573aaf2ae7740" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 46065 } } peers { permanent_uuid: "08100eb76c5a4fbd97f5a0b81c40f75d" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 37843 } } peers { permanent_uuid: "99b9b6a915a94310ba479b4d3ee7c966" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36031 } }
I20260709 13:03:55.672650 18818 catalog_manager.cc:5697] T 635268a9733742f3aa2abc8ce5779d9f P 08100eb76c5a4fbd97f5a0b81c40f75d reported cstate change: term changed from 1 to 2, leader changed from c611bf5baef04660ada573aaf2ae7740 (127.17.223.1) to 08100eb76c5a4fbd97f5a0b81c40f75d (127.17.223.2). New cstate: current_term: 2 leader_uuid: "08100eb76c5a4fbd97f5a0b81c40f75d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c611bf5baef04660ada573aaf2ae7740" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 46065 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "08100eb76c5a4fbd97f5a0b81c40f75d" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 37843 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "99b9b6a915a94310ba479b4d3ee7c966" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36031 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:55.694046 19117 raft_consensus.cc:993] T b190be4cf1684677b783edcb8f9ae128 P 99b9b6a915a94310ba479b4d3ee7c966: : Instructing follower 08100eb76c5a4fbd97f5a0b81c40f75d to start an election
I20260709 13:03:55.694479 19176 raft_consensus.cc:1081] T b190be4cf1684677b783edcb8f9ae128 P 99b9b6a915a94310ba479b4d3ee7c966 [term 1 LEADER]: Signalling peer 08100eb76c5a4fbd97f5a0b81c40f75d to start an election
I20260709 13:03:55.695899 18994 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b190be4cf1684677b783edcb8f9ae128"
dest_uuid: "08100eb76c5a4fbd97f5a0b81c40f75d"
 from {username='slave'} at 127.0.0.1:48720
I20260709 13:03:55.696345 18994 raft_consensus.cc:493] T b190be4cf1684677b783edcb8f9ae128 P 08100eb76c5a4fbd97f5a0b81c40f75d [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:03:55.696638 18994 raft_consensus.cc:3060] T b190be4cf1684677b783edcb8f9ae128 P 08100eb76c5a4fbd97f5a0b81c40f75d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:55.701244 18994 raft_consensus.cc:515] T b190be4cf1684677b783edcb8f9ae128 P 08100eb76c5a4fbd97f5a0b81c40f75d [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c611bf5baef04660ada573aaf2ae7740" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 46065 } } peers { permanent_uuid: "08100eb76c5a4fbd97f5a0b81c40f75d" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 37843 } } peers { permanent_uuid: "99b9b6a915a94310ba479b4d3ee7c966" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36031 } }
I20260709 13:03:55.702984 18994 leader_election.cc:290] T b190be4cf1684677b783edcb8f9ae128 P 08100eb76c5a4fbd97f5a0b81c40f75d [CANDIDATE]: Term 2 election: Requested vote from peers c611bf5baef04660ada573aaf2ae7740 (127.17.223.1:46065), 99b9b6a915a94310ba479b4d3ee7c966 (127.17.223.3:36031)
I20260709 13:03:55.703740 18919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b190be4cf1684677b783edcb8f9ae128" candidate_uuid: "08100eb76c5a4fbd97f5a0b81c40f75d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c611bf5baef04660ada573aaf2ae7740"
I20260709 13:03:55.703943 19067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b190be4cf1684677b783edcb8f9ae128" candidate_uuid: "08100eb76c5a4fbd97f5a0b81c40f75d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "99b9b6a915a94310ba479b4d3ee7c966"
I20260709 13:03:55.704329 18919 raft_consensus.cc:3060] T b190be4cf1684677b783edcb8f9ae128 P c611bf5baef04660ada573aaf2ae7740 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:55.704465 19067 raft_consensus.cc:3055] T b190be4cf1684677b783edcb8f9ae128 P 99b9b6a915a94310ba479b4d3ee7c966 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:03:55.704821 19067 raft_consensus.cc:740] T b190be4cf1684677b783edcb8f9ae128 P 99b9b6a915a94310ba479b4d3ee7c966 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 99b9b6a915a94310ba479b4d3ee7c966, State: Running, Role: LEADER
I20260709 13:03:55.705830 19067 consensus_queue.cc:260] T b190be4cf1684677b783edcb8f9ae128 P 99b9b6a915a94310ba479b4d3ee7c966 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c611bf5baef04660ada573aaf2ae7740" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 46065 } } peers { permanent_uuid: "08100eb76c5a4fbd97f5a0b81c40f75d" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 37843 } } peers { permanent_uuid: "99b9b6a915a94310ba479b4d3ee7c966" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36031 } }
I20260709 13:03:55.707011 19067 raft_consensus.cc:3060] T b190be4cf1684677b783edcb8f9ae128 P 99b9b6a915a94310ba479b4d3ee7c966 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:55.711318 18919 raft_consensus.cc:2468] T b190be4cf1684677b783edcb8f9ae128 P c611bf5baef04660ada573aaf2ae7740 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 08100eb76c5a4fbd97f5a0b81c40f75d in term 2.
I20260709 13:03:55.712632 18958 leader_election.cc:304] T b190be4cf1684677b783edcb8f9ae128 P 08100eb76c5a4fbd97f5a0b81c40f75d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 08100eb76c5a4fbd97f5a0b81c40f75d, c611bf5baef04660ada573aaf2ae7740; no voters: 
I20260709 13:03:55.713423 19115 raft_consensus.cc:2804] T b190be4cf1684677b783edcb8f9ae128 P 08100eb76c5a4fbd97f5a0b81c40f75d [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:03:55.713675 19067 raft_consensus.cc:2468] T b190be4cf1684677b783edcb8f9ae128 P 99b9b6a915a94310ba479b4d3ee7c966 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 08100eb76c5a4fbd97f5a0b81c40f75d in term 2.
I20260709 13:03:55.713855 19115 raft_consensus.cc:697] T b190be4cf1684677b783edcb8f9ae128 P 08100eb76c5a4fbd97f5a0b81c40f75d [term 2 LEADER]: Becoming Leader. State: Replica: 08100eb76c5a4fbd97f5a0b81c40f75d, State: Running, Role: LEADER
I20260709 13:03:55.714761 19115 consensus_queue.cc:237] T b190be4cf1684677b783edcb8f9ae128 P 08100eb76c5a4fbd97f5a0b81c40f75d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c611bf5baef04660ada573aaf2ae7740" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 46065 } } peers { permanent_uuid: "08100eb76c5a4fbd97f5a0b81c40f75d" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 37843 } } peers { permanent_uuid: "99b9b6a915a94310ba479b4d3ee7c966" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36031 } }
I20260709 13:03:55.720331 18818 catalog_manager.cc:5697] T b190be4cf1684677b783edcb8f9ae128 P 08100eb76c5a4fbd97f5a0b81c40f75d reported cstate change: term changed from 1 to 2, leader changed from 99b9b6a915a94310ba479b4d3ee7c966 (127.17.223.3) to 08100eb76c5a4fbd97f5a0b81c40f75d (127.17.223.2). New cstate: current_term: 2 leader_uuid: "08100eb76c5a4fbd97f5a0b81c40f75d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c611bf5baef04660ada573aaf2ae7740" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 46065 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "08100eb76c5a4fbd97f5a0b81c40f75d" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 37843 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "99b9b6a915a94310ba479b4d3ee7c966" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36031 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:55.757377 19191 raft_consensus.cc:993] T f1e8623946e9415991e70fecebc84607 P c611bf5baef04660ada573aaf2ae7740: : Instructing follower 08100eb76c5a4fbd97f5a0b81c40f75d to start an election
I20260709 13:03:55.757844 19122 raft_consensus.cc:1081] T f1e8623946e9415991e70fecebc84607 P c611bf5baef04660ada573aaf2ae7740 [term 1 LEADER]: Signalling peer 08100eb76c5a4fbd97f5a0b81c40f75d to start an election
I20260709 13:03:55.759256 18994 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f1e8623946e9415991e70fecebc84607"
dest_uuid: "08100eb76c5a4fbd97f5a0b81c40f75d"
 from {username='slave'} at 127.0.0.1:48710
I20260709 13:03:55.759716 18994 raft_consensus.cc:493] T f1e8623946e9415991e70fecebc84607 P 08100eb76c5a4fbd97f5a0b81c40f75d [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:03:55.760007 18994 raft_consensus.cc:3060] T f1e8623946e9415991e70fecebc84607 P 08100eb76c5a4fbd97f5a0b81c40f75d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:55.764827 18994 raft_consensus.cc:515] T f1e8623946e9415991e70fecebc84607 P 08100eb76c5a4fbd97f5a0b81c40f75d [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c611bf5baef04660ada573aaf2ae7740" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 46065 } } peers { permanent_uuid: "08100eb76c5a4fbd97f5a0b81c40f75d" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 37843 } } peers { permanent_uuid: "99b9b6a915a94310ba479b4d3ee7c966" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36031 } }
I20260709 13:03:55.766398 18994 leader_election.cc:290] T f1e8623946e9415991e70fecebc84607 P 08100eb76c5a4fbd97f5a0b81c40f75d [CANDIDATE]: Term 2 election: Requested vote from peers c611bf5baef04660ada573aaf2ae7740 (127.17.223.1:46065), 99b9b6a915a94310ba479b4d3ee7c966 (127.17.223.3:36031)
I20260709 13:03:55.767119 18919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1e8623946e9415991e70fecebc84607" candidate_uuid: "08100eb76c5a4fbd97f5a0b81c40f75d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c611bf5baef04660ada573aaf2ae7740"
I20260709 13:03:55.767357 19067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1e8623946e9415991e70fecebc84607" candidate_uuid: "08100eb76c5a4fbd97f5a0b81c40f75d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "99b9b6a915a94310ba479b4d3ee7c966"
I20260709 13:03:55.767714 18919 raft_consensus.cc:3055] T f1e8623946e9415991e70fecebc84607 P c611bf5baef04660ada573aaf2ae7740 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:03:55.767853 19067 raft_consensus.cc:3060] T f1e8623946e9415991e70fecebc84607 P 99b9b6a915a94310ba479b4d3ee7c966 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:55.768054 18919 raft_consensus.cc:740] T f1e8623946e9415991e70fecebc84607 P c611bf5baef04660ada573aaf2ae7740 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c611bf5baef04660ada573aaf2ae7740, State: Running, Role: LEADER
I20260709 13:03:55.768872 18919 consensus_queue.cc:260] T f1e8623946e9415991e70fecebc84607 P c611bf5baef04660ada573aaf2ae7740 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c611bf5baef04660ada573aaf2ae7740" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 46065 } } peers { permanent_uuid: "08100eb76c5a4fbd97f5a0b81c40f75d" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 37843 } } peers { permanent_uuid: "99b9b6a915a94310ba479b4d3ee7c966" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36031 } }
I20260709 13:03:55.770007 18919 raft_consensus.cc:3060] T f1e8623946e9415991e70fecebc84607 P c611bf5baef04660ada573aaf2ae7740 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:55.774475 19067 raft_consensus.cc:2468] T f1e8623946e9415991e70fecebc84607 P 99b9b6a915a94310ba479b4d3ee7c966 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 08100eb76c5a4fbd97f5a0b81c40f75d in term 2.
I20260709 13:03:55.775724 18961 leader_election.cc:304] T f1e8623946e9415991e70fecebc84607 P 08100eb76c5a4fbd97f5a0b81c40f75d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 08100eb76c5a4fbd97f5a0b81c40f75d, 99b9b6a915a94310ba479b4d3ee7c966; no voters: 
I20260709 13:03:55.776419 19115 raft_consensus.cc:2804] T f1e8623946e9415991e70fecebc84607 P 08100eb76c5a4fbd97f5a0b81c40f75d [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:03:55.776362 18919 raft_consensus.cc:2468] T f1e8623946e9415991e70fecebc84607 P c611bf5baef04660ada573aaf2ae7740 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 08100eb76c5a4fbd97f5a0b81c40f75d in term 2.
I20260709 13:03:55.777034 19115 raft_consensus.cc:697] T f1e8623946e9415991e70fecebc84607 P 08100eb76c5a4fbd97f5a0b81c40f75d [term 2 LEADER]: Becoming Leader. State: Replica: 08100eb76c5a4fbd97f5a0b81c40f75d, State: Running, Role: LEADER
I20260709 13:03:55.777833 19115 consensus_queue.cc:237] T f1e8623946e9415991e70fecebc84607 P 08100eb76c5a4fbd97f5a0b81c40f75d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c611bf5baef04660ada573aaf2ae7740" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 46065 } } peers { permanent_uuid: "08100eb76c5a4fbd97f5a0b81c40f75d" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 37843 } } peers { permanent_uuid: "99b9b6a915a94310ba479b4d3ee7c966" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36031 } }
I20260709 13:03:55.783694 18818 catalog_manager.cc:5697] T f1e8623946e9415991e70fecebc84607 P 08100eb76c5a4fbd97f5a0b81c40f75d reported cstate change: term changed from 1 to 2, leader changed from c611bf5baef04660ada573aaf2ae7740 (127.17.223.1) to 08100eb76c5a4fbd97f5a0b81c40f75d (127.17.223.2). New cstate: current_term: 2 leader_uuid: "08100eb76c5a4fbd97f5a0b81c40f75d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c611bf5baef04660ada573aaf2ae7740" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 46065 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "08100eb76c5a4fbd97f5a0b81c40f75d" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 37843 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "99b9b6a915a94310ba479b4d3ee7c966" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36031 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:55.819864 19169 raft_consensus.cc:993] T c6c129816ac441a8bef29b84b78b791e P 08100eb76c5a4fbd97f5a0b81c40f75d: : Instructing follower c611bf5baef04660ada573aaf2ae7740 to start an election
I20260709 13:03:55.820413 19115 raft_consensus.cc:1081] T c6c129816ac441a8bef29b84b78b791e P 08100eb76c5a4fbd97f5a0b81c40f75d [term 2 LEADER]: Signalling peer c611bf5baef04660ada573aaf2ae7740 to start an election
I20260709 13:03:55.821771 18919 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c6c129816ac441a8bef29b84b78b791e"
dest_uuid: "c611bf5baef04660ada573aaf2ae7740"
 from {username='slave'} at 127.0.0.1:36612
I20260709 13:03:55.822238 18919 raft_consensus.cc:493] T c6c129816ac441a8bef29b84b78b791e P c611bf5baef04660ada573aaf2ae7740 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:03:55.822535 18919 raft_consensus.cc:3060] T c6c129816ac441a8bef29b84b78b791e P c611bf5baef04660ada573aaf2ae7740 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:03:55.827098 18919 raft_consensus.cc:515] T c6c129816ac441a8bef29b84b78b791e P c611bf5baef04660ada573aaf2ae7740 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c611bf5baef04660ada573aaf2ae7740" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 46065 } } peers { permanent_uuid: "08100eb76c5a4fbd97f5a0b81c40f75d" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 37843 } } peers { permanent_uuid: "99b9b6a915a94310ba479b4d3ee7c966" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36031 } }
I20260709 13:03:55.828902 18919 leader_election.cc:290] T c6c129816ac441a8bef29b84b78b791e P c611bf5baef04660ada573aaf2ae7740 [CANDIDATE]: Term 3 election: Requested vote from peers 08100eb76c5a4fbd97f5a0b81c40f75d (127.17.223.2:37843), 99b9b6a915a94310ba479b4d3ee7c966 (127.17.223.3:36031)
I20260709 13:03:55.829696 18994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6c129816ac441a8bef29b84b78b791e" candidate_uuid: "c611bf5baef04660ada573aaf2ae7740" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: true dest_uuid: "08100eb76c5a4fbd97f5a0b81c40f75d"
I20260709 13:03:55.830209 18994 raft_consensus.cc:3055] T c6c129816ac441a8bef29b84b78b791e P 08100eb76c5a4fbd97f5a0b81c40f75d [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:03:55.830250 19067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6c129816ac441a8bef29b84b78b791e" candidate_uuid: "c611bf5baef04660ada573aaf2ae7740" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: true dest_uuid: "99b9b6a915a94310ba479b4d3ee7c966"
I20260709 13:03:55.830618 18994 raft_consensus.cc:740] T c6c129816ac441a8bef29b84b78b791e P 08100eb76c5a4fbd97f5a0b81c40f75d [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 08100eb76c5a4fbd97f5a0b81c40f75d, State: Running, Role: LEADER
I20260709 13:03:55.830873 19067 raft_consensus.cc:3060] T c6c129816ac441a8bef29b84b78b791e P 99b9b6a915a94310ba479b4d3ee7c966 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:03:55.831473 18994 consensus_queue.cc:260] T c6c129816ac441a8bef29b84b78b791e P 08100eb76c5a4fbd97f5a0b81c40f75d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c611bf5baef04660ada573aaf2ae7740" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 46065 } } peers { permanent_uuid: "08100eb76c5a4fbd97f5a0b81c40f75d" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 37843 } } peers { permanent_uuid: "99b9b6a915a94310ba479b4d3ee7c966" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36031 } }
I20260709 13:03:55.832635 18994 raft_consensus.cc:3060] T c6c129816ac441a8bef29b84b78b791e P 08100eb76c5a4fbd97f5a0b81c40f75d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:03:55.837625 19067 raft_consensus.cc:2468] T c6c129816ac441a8bef29b84b78b791e P 99b9b6a915a94310ba479b4d3ee7c966 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c611bf5baef04660ada573aaf2ae7740 in term 3.
I20260709 13:03:55.838785 18886 leader_election.cc:304] T c6c129816ac441a8bef29b84b78b791e P c611bf5baef04660ada573aaf2ae7740 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 99b9b6a915a94310ba479b4d3ee7c966, c611bf5baef04660ada573aaf2ae7740; no voters: 
I20260709 13:03:55.839293 18994 raft_consensus.cc:2468] T c6c129816ac441a8bef29b84b78b791e P 08100eb76c5a4fbd97f5a0b81c40f75d [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c611bf5baef04660ada573aaf2ae7740 in term 3.
I20260709 13:03:55.839583 19122 raft_consensus.cc:2804] T c6c129816ac441a8bef29b84b78b791e P c611bf5baef04660ada573aaf2ae7740 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:03:55.840086 19122 raft_consensus.cc:697] T c6c129816ac441a8bef29b84b78b791e P c611bf5baef04660ada573aaf2ae7740 [term 3 LEADER]: Becoming Leader. State: Replica: c611bf5baef04660ada573aaf2ae7740, State: Running, Role: LEADER
I20260709 13:03:55.840770 19122 consensus_queue.cc:237] T c6c129816ac441a8bef29b84b78b791e P c611bf5baef04660ada573aaf2ae7740 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c611bf5baef04660ada573aaf2ae7740" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 46065 } } peers { permanent_uuid: "08100eb76c5a4fbd97f5a0b81c40f75d" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 37843 } } peers { permanent_uuid: "99b9b6a915a94310ba479b4d3ee7c966" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36031 } }
I20260709 13:03:55.846783 18818 catalog_manager.cc:5697] T c6c129816ac441a8bef29b84b78b791e P c611bf5baef04660ada573aaf2ae7740 reported cstate change: term changed from 2 to 3, leader changed from 08100eb76c5a4fbd97f5a0b81c40f75d (127.17.223.2) to c611bf5baef04660ada573aaf2ae7740 (127.17.223.1). New cstate: current_term: 3 leader_uuid: "c611bf5baef04660ada573aaf2ae7740" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c611bf5baef04660ada573aaf2ae7740" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 46065 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "08100eb76c5a4fbd97f5a0b81c40f75d" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 37843 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "99b9b6a915a94310ba479b4d3ee7c966" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36031 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:55.852692 19191 raft_consensus.cc:993] T 4c9ffc27fdd54b68bb2d8e2e229ae923 P c611bf5baef04660ada573aaf2ae7740: : Instructing follower 99b9b6a915a94310ba479b4d3ee7c966 to start an election
I20260709 13:03:55.853147 19191 raft_consensus.cc:1081] T 4c9ffc27fdd54b68bb2d8e2e229ae923 P c611bf5baef04660ada573aaf2ae7740 [term 1 LEADER]: Signalling peer 99b9b6a915a94310ba479b4d3ee7c966 to start an election
I20260709 13:03:55.854552 19067 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "4c9ffc27fdd54b68bb2d8e2e229ae923"
dest_uuid: "99b9b6a915a94310ba479b4d3ee7c966"
 from {username='slave'} at 127.0.0.1:50600
I20260709 13:03:55.855077 19067 raft_consensus.cc:493] T 4c9ffc27fdd54b68bb2d8e2e229ae923 P 99b9b6a915a94310ba479b4d3ee7c966 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:03:55.855360 19067 raft_consensus.cc:3060] T 4c9ffc27fdd54b68bb2d8e2e229ae923 P 99b9b6a915a94310ba479b4d3ee7c966 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:55.860199 19067 raft_consensus.cc:515] T 4c9ffc27fdd54b68bb2d8e2e229ae923 P 99b9b6a915a94310ba479b4d3ee7c966 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c611bf5baef04660ada573aaf2ae7740" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 46065 } } peers { permanent_uuid: "08100eb76c5a4fbd97f5a0b81c40f75d" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 37843 } } peers { permanent_uuid: "99b9b6a915a94310ba479b4d3ee7c966" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36031 } }
I20260709 13:03:55.861862 19067 leader_election.cc:290] T 4c9ffc27fdd54b68bb2d8e2e229ae923 P 99b9b6a915a94310ba479b4d3ee7c966 [CANDIDATE]: Term 2 election: Requested vote from peers c611bf5baef04660ada573aaf2ae7740 (127.17.223.1:46065), 08100eb76c5a4fbd97f5a0b81c40f75d (127.17.223.2:37843)
I20260709 13:03:55.862659 18919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c9ffc27fdd54b68bb2d8e2e229ae923" candidate_uuid: "99b9b6a915a94310ba479b4d3ee7c966" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c611bf5baef04660ada573aaf2ae7740"
I20260709 13:03:55.862897 18994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c9ffc27fdd54b68bb2d8e2e229ae923" candidate_uuid: "99b9b6a915a94310ba479b4d3ee7c966" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "08100eb76c5a4fbd97f5a0b81c40f75d"
I20260709 13:03:55.863291 18919 raft_consensus.cc:3055] T 4c9ffc27fdd54b68bb2d8e2e229ae923 P c611bf5baef04660ada573aaf2ae7740 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:03:55.863408 18994 raft_consensus.cc:3060] T 4c9ffc27fdd54b68bb2d8e2e229ae923 P 08100eb76c5a4fbd97f5a0b81c40f75d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:55.863670 18919 raft_consensus.cc:740] T 4c9ffc27fdd54b68bb2d8e2e229ae923 P c611bf5baef04660ada573aaf2ae7740 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c611bf5baef04660ada573aaf2ae7740, State: Running, Role: LEADER
I20260709 13:03:55.864462 18919 consensus_queue.cc:260] T 4c9ffc27fdd54b68bb2d8e2e229ae923 P c611bf5baef04660ada573aaf2ae7740 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c611bf5baef04660ada573aaf2ae7740" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 46065 } } peers { permanent_uuid: "08100eb76c5a4fbd97f5a0b81c40f75d" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 37843 } } peers { permanent_uuid: "99b9b6a915a94310ba479b4d3ee7c966" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36031 } }
I20260709 13:03:55.865649 18919 raft_consensus.cc:3060] T 4c9ffc27fdd54b68bb2d8e2e229ae923 P c611bf5baef04660ada573aaf2ae7740 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:55.870133 18994 raft_consensus.cc:2468] T 4c9ffc27fdd54b68bb2d8e2e229ae923 P 08100eb76c5a4fbd97f5a0b81c40f75d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 99b9b6a915a94310ba479b4d3ee7c966 in term 2.
I20260709 13:03:55.871341 19034 leader_election.cc:304] T 4c9ffc27fdd54b68bb2d8e2e229ae923 P 99b9b6a915a94310ba479b4d3ee7c966 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 08100eb76c5a4fbd97f5a0b81c40f75d, 99b9b6a915a94310ba479b4d3ee7c966; no voters: 
I20260709 13:03:55.872092 18919 raft_consensus.cc:2468] T 4c9ffc27fdd54b68bb2d8e2e229ae923 P c611bf5baef04660ada573aaf2ae7740 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 99b9b6a915a94310ba479b4d3ee7c966 in term 2.
I20260709 13:03:55.872217 19176 raft_consensus.cc:2804] T 4c9ffc27fdd54b68bb2d8e2e229ae923 P 99b9b6a915a94310ba479b4d3ee7c966 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:03:55.872736 19176 raft_consensus.cc:697] T 4c9ffc27fdd54b68bb2d8e2e229ae923 P 99b9b6a915a94310ba479b4d3ee7c966 [term 2 LEADER]: Becoming Leader. State: Replica: 99b9b6a915a94310ba479b4d3ee7c966, State: Running, Role: LEADER
I20260709 13:03:55.875414 19176 consensus_queue.cc:237] T 4c9ffc27fdd54b68bb2d8e2e229ae923 P 99b9b6a915a94310ba479b4d3ee7c966 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c611bf5baef04660ada573aaf2ae7740" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 46065 } } peers { permanent_uuid: "08100eb76c5a4fbd97f5a0b81c40f75d" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 37843 } } peers { permanent_uuid: "99b9b6a915a94310ba479b4d3ee7c966" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36031 } }
I20260709 13:03:55.877665 19067 raft_consensus.cc:1275] T 382fc7fe4d2e47af99f993423be05a77 P 99b9b6a915a94310ba479b4d3ee7c966 [term 2 FOLLOWER]: Refusing update from remote peer c611bf5baef04660ada573aaf2ae7740: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:03:55.879925 19191 consensus_queue.cc:1048] T 382fc7fe4d2e47af99f993423be05a77 P c611bf5baef04660ada573aaf2ae7740 [LEADER]: Connected to new peer: Peer: permanent_uuid: "99b9b6a915a94310ba479b4d3ee7c966" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36031 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:03:55.883200 18818 catalog_manager.cc:5697] T 4c9ffc27fdd54b68bb2d8e2e229ae923 P 99b9b6a915a94310ba479b4d3ee7c966 reported cstate change: term changed from 1 to 2, leader changed from c611bf5baef04660ada573aaf2ae7740 (127.17.223.1) to 99b9b6a915a94310ba479b4d3ee7c966 (127.17.223.3). New cstate: current_term: 2 leader_uuid: "99b9b6a915a94310ba479b4d3ee7c966" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c611bf5baef04660ada573aaf2ae7740" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 46065 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "08100eb76c5a4fbd97f5a0b81c40f75d" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 37843 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "99b9b6a915a94310ba479b4d3ee7c966" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36031 } health_report { overall_health: HEALTHY } } }
I20260709 13:03:55.885660 18994 raft_consensus.cc:1275] T 382fc7fe4d2e47af99f993423be05a77 P 08100eb76c5a4fbd97f5a0b81c40f75d [term 2 FOLLOWER]: Refusing update from remote peer c611bf5baef04660ada573aaf2ae7740: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:03:55.887791 19200 consensus_queue.cc:1048] T 382fc7fe4d2e47af99f993423be05a77 P c611bf5baef04660ada573aaf2ae7740 [LEADER]: Connected to new peer: Peer: permanent_uuid: "08100eb76c5a4fbd97f5a0b81c40f75d" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 37843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:03:55.946529 19067 raft_consensus.cc:1275] T a8c3aa064aaa42b5b251eab220ab5e44 P 99b9b6a915a94310ba479b4d3ee7c966 [term 2 FOLLOWER]: Refusing update from remote peer c611bf5baef04660ada573aaf2ae7740: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:03:55.947790 19116 consensus_queue.cc:1048] T a8c3aa064aaa42b5b251eab220ab5e44 P c611bf5baef04660ada573aaf2ae7740 [LEADER]: Connected to new peer: Peer: permanent_uuid: "99b9b6a915a94310ba479b4d3ee7c966" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36031 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:03:55.956558 18994 raft_consensus.cc:1275] T a8c3aa064aaa42b5b251eab220ab5e44 P 08100eb76c5a4fbd97f5a0b81c40f75d [term 2 FOLLOWER]: Refusing update from remote peer c611bf5baef04660ada573aaf2ae7740: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:03:55.960269 19116 consensus_queue.cc:1048] T a8c3aa064aaa42b5b251eab220ab5e44 P c611bf5baef04660ada573aaf2ae7740 [LEADER]: Connected to new peer: Peer: permanent_uuid: "08100eb76c5a4fbd97f5a0b81c40f75d" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 37843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:03:56.130935 19069 raft_consensus.cc:1275] T b190be4cf1684677b783edcb8f9ae128 P 99b9b6a915a94310ba479b4d3ee7c966 [term 2 FOLLOWER]: Refusing update from remote peer 08100eb76c5a4fbd97f5a0b81c40f75d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:03:56.132112 19115 consensus_queue.cc:1048] T b190be4cf1684677b783edcb8f9ae128 P 08100eb76c5a4fbd97f5a0b81c40f75d [LEADER]: Connected to new peer: Peer: permanent_uuid: "99b9b6a915a94310ba479b4d3ee7c966" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36031 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:03:56.138739 18919 raft_consensus.cc:1275] T 635268a9733742f3aa2abc8ce5779d9f P c611bf5baef04660ada573aaf2ae7740 [term 2 FOLLOWER]: Refusing update from remote peer 08100eb76c5a4fbd97f5a0b81c40f75d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:03:56.141311 19132 consensus_queue.cc:1048] T 635268a9733742f3aa2abc8ce5779d9f P 08100eb76c5a4fbd97f5a0b81c40f75d [LEADER]: Connected to new peer: Peer: permanent_uuid: "c611bf5baef04660ada573aaf2ae7740" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 46065 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:03:56.142445 18919 raft_consensus.cc:1275] T b190be4cf1684677b783edcb8f9ae128 P c611bf5baef04660ada573aaf2ae7740 [term 2 FOLLOWER]: Refusing update from remote peer 08100eb76c5a4fbd97f5a0b81c40f75d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:03:56.144080 19132 consensus_queue.cc:1048] T b190be4cf1684677b783edcb8f9ae128 P 08100eb76c5a4fbd97f5a0b81c40f75d [LEADER]: Connected to new peer: Peer: permanent_uuid: "c611bf5baef04660ada573aaf2ae7740" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 46065 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:03:56.154929 19069 raft_consensus.cc:1275] T 635268a9733742f3aa2abc8ce5779d9f P 99b9b6a915a94310ba479b4d3ee7c966 [term 2 FOLLOWER]: Refusing update from remote peer 08100eb76c5a4fbd97f5a0b81c40f75d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:03:56.158416 19132 consensus_queue.cc:1048] T 635268a9733742f3aa2abc8ce5779d9f P 08100eb76c5a4fbd97f5a0b81c40f75d [LEADER]: Connected to new peer: Peer: permanent_uuid: "99b9b6a915a94310ba479b4d3ee7c966" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36031 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:03:56.277159 19069 raft_consensus.cc:1275] T f1e8623946e9415991e70fecebc84607 P 99b9b6a915a94310ba479b4d3ee7c966 [term 2 FOLLOWER]: Refusing update from remote peer 08100eb76c5a4fbd97f5a0b81c40f75d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:03:56.278396 19132 consensus_queue.cc:1048] T f1e8623946e9415991e70fecebc84607 P 08100eb76c5a4fbd97f5a0b81c40f75d [LEADER]: Connected to new peer: Peer: permanent_uuid: "99b9b6a915a94310ba479b4d3ee7c966" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36031 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:03:56.284811 18920 raft_consensus.cc:1275] T f1e8623946e9415991e70fecebc84607 P c611bf5baef04660ada573aaf2ae7740 [term 2 FOLLOWER]: Refusing update from remote peer 08100eb76c5a4fbd97f5a0b81c40f75d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:03:56.286398 19205 consensus_queue.cc:1048] T f1e8623946e9415991e70fecebc84607 P 08100eb76c5a4fbd97f5a0b81c40f75d [LEADER]: Connected to new peer: Peer: permanent_uuid: "c611bf5baef04660ada573aaf2ae7740" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 46065 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:03:56.424401 18994 raft_consensus.cc:1275] T c6c129816ac441a8bef29b84b78b791e P 08100eb76c5a4fbd97f5a0b81c40f75d [term 3 FOLLOWER]: Refusing update from remote peer c611bf5baef04660ada573aaf2ae7740: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:03:56.425664 19122 consensus_queue.cc:1048] T c6c129816ac441a8bef29b84b78b791e P c611bf5baef04660ada573aaf2ae7740 [LEADER]: Connected to new peer: Peer: permanent_uuid: "08100eb76c5a4fbd97f5a0b81c40f75d" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 37843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:03:56.433660 19069 raft_consensus.cc:1275] T c6c129816ac441a8bef29b84b78b791e P 99b9b6a915a94310ba479b4d3ee7c966 [term 3 FOLLOWER]: Refusing update from remote peer c611bf5baef04660ada573aaf2ae7740: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:03:56.435217 19116 consensus_queue.cc:1048] T c6c129816ac441a8bef29b84b78b791e P c611bf5baef04660ada573aaf2ae7740 [LEADER]: Connected to new peer: Peer: permanent_uuid: "99b9b6a915a94310ba479b4d3ee7c966" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36031 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:03:56.479277 18920 raft_consensus.cc:1275] T 4c9ffc27fdd54b68bb2d8e2e229ae923 P c611bf5baef04660ada573aaf2ae7740 [term 2 FOLLOWER]: Refusing update from remote peer 99b9b6a915a94310ba479b4d3ee7c966: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:03:56.480436 19176 consensus_queue.cc:1048] T 4c9ffc27fdd54b68bb2d8e2e229ae923 P 99b9b6a915a94310ba479b4d3ee7c966 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c611bf5baef04660ada573aaf2ae7740" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 46065 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:03:56.491808 18994 raft_consensus.cc:1275] T 4c9ffc27fdd54b68bb2d8e2e229ae923 P 08100eb76c5a4fbd97f5a0b81c40f75d [term 2 FOLLOWER]: Refusing update from remote peer 99b9b6a915a94310ba479b4d3ee7c966: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:03:56.494277 19176 consensus_queue.cc:1048] T 4c9ffc27fdd54b68bb2d8e2e229ae923 P 99b9b6a915a94310ba479b4d3ee7c966 [LEADER]: Connected to new peer: Peer: permanent_uuid: "08100eb76c5a4fbd97f5a0b81c40f75d" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 37843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:03:58.450438 18300 auto_leader_rebalancer-test.cc:348] The leader distribution is 
I20260709 13:03:58.451472 18300 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:03:58.468621 18920 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7c52a94485bd40e6a022a546c42407b4"
dest_uuid: "c611bf5baef04660ada573aaf2ae7740"
mode: GRACEFUL
new_leader_uuid: "99b9b6a915a94310ba479b4d3ee7c966"
 from {username='slave'} at 127.0.0.1:36640
I20260709 13:03:58.469190 18920 raft_consensus.cc:606] T 7c52a94485bd40e6a022a546c42407b4 P c611bf5baef04660ada573aaf2ae7740 [term 1 LEADER]: Received request to transfer leadership to TS 99b9b6a915a94310ba479b4d3ee7c966
I20260709 13:03:58.471491 18920 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a8c3aa064aaa42b5b251eab220ab5e44"
dest_uuid: "c611bf5baef04660ada573aaf2ae7740"
mode: GRACEFUL
new_leader_uuid: "99b9b6a915a94310ba479b4d3ee7c966"
 from {username='slave'} at 127.0.0.1:36640
I20260709 13:03:58.472077 18920 raft_consensus.cc:606] T a8c3aa064aaa42b5b251eab220ab5e44 P c611bf5baef04660ada573aaf2ae7740 [term 2 LEADER]: Received request to transfer leadership to TS 99b9b6a915a94310ba479b4d3ee7c966
I20260709 13:03:58.473297 18300 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 13:03:58.473742 18300 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:03:58.529806 19116 raft_consensus.cc:993] T 7c52a94485bd40e6a022a546c42407b4 P c611bf5baef04660ada573aaf2ae7740: : Instructing follower 99b9b6a915a94310ba479b4d3ee7c966 to start an election
I20260709 13:03:58.530318 19216 raft_consensus.cc:1081] T 7c52a94485bd40e6a022a546c42407b4 P c611bf5baef04660ada573aaf2ae7740 [term 1 LEADER]: Signalling peer 99b9b6a915a94310ba479b4d3ee7c966 to start an election
I20260709 13:03:58.531852 19067 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "7c52a94485bd40e6a022a546c42407b4"
dest_uuid: "99b9b6a915a94310ba479b4d3ee7c966"
 from {username='slave'} at 127.0.0.1:50600
I20260709 13:03:58.532320 19067 raft_consensus.cc:493] T 7c52a94485bd40e6a022a546c42407b4 P 99b9b6a915a94310ba479b4d3ee7c966 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:03:58.532619 19067 raft_consensus.cc:3060] T 7c52a94485bd40e6a022a546c42407b4 P 99b9b6a915a94310ba479b4d3ee7c966 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:58.536965 19067 raft_consensus.cc:515] T 7c52a94485bd40e6a022a546c42407b4 P 99b9b6a915a94310ba479b4d3ee7c966 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c611bf5baef04660ada573aaf2ae7740" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 46065 } } peers { permanent_uuid: "08100eb76c5a4fbd97f5a0b81c40f75d" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 37843 } } peers { permanent_uuid: "99b9b6a915a94310ba479b4d3ee7c966" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36031 } }
I20260709 13:03:58.538476 19067 leader_election.cc:290] T 7c52a94485bd40e6a022a546c42407b4 P 99b9b6a915a94310ba479b4d3ee7c966 [CANDIDATE]: Term 2 election: Requested vote from peers c611bf5baef04660ada573aaf2ae7740 (127.17.223.1:46065), 08100eb76c5a4fbd97f5a0b81c40f75d (127.17.223.2:37843)
I20260709 13:03:58.539422 18920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c52a94485bd40e6a022a546c42407b4" candidate_uuid: "99b9b6a915a94310ba479b4d3ee7c966" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c611bf5baef04660ada573aaf2ae7740"
I20260709 13:03:58.539498 18994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c52a94485bd40e6a022a546c42407b4" candidate_uuid: "99b9b6a915a94310ba479b4d3ee7c966" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "08100eb76c5a4fbd97f5a0b81c40f75d"
I20260709 13:03:58.540055 18920 raft_consensus.cc:3055] T 7c52a94485bd40e6a022a546c42407b4 P c611bf5baef04660ada573aaf2ae7740 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:03:58.540208 18994 raft_consensus.cc:3060] T 7c52a94485bd40e6a022a546c42407b4 P 08100eb76c5a4fbd97f5a0b81c40f75d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:58.540365 18920 raft_consensus.cc:740] T 7c52a94485bd40e6a022a546c42407b4 P c611bf5baef04660ada573aaf2ae7740 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c611bf5baef04660ada573aaf2ae7740, State: Running, Role: LEADER
I20260709 13:03:58.541153 18920 consensus_queue.cc:260] T 7c52a94485bd40e6a022a546c42407b4 P c611bf5baef04660ada573aaf2ae7740 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c611bf5baef04660ada573aaf2ae7740" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 46065 } } peers { permanent_uuid: "08100eb76c5a4fbd97f5a0b81c40f75d" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 37843 } } peers { permanent_uuid: "99b9b6a915a94310ba479b4d3ee7c966" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36031 } }
I20260709 13:03:58.542022 18920 raft_consensus.cc:3060] T 7c52a94485bd40e6a022a546c42407b4 P c611bf5baef04660ada573aaf2ae7740 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:58.544487 18994 raft_consensus.cc:2468] T 7c52a94485bd40e6a022a546c42407b4 P 08100eb76c5a4fbd97f5a0b81c40f75d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 99b9b6a915a94310ba479b4d3ee7c966 in term 2.
I20260709 13:03:58.545590 19034 leader_election.cc:304] T 7c52a94485bd40e6a022a546c42407b4 P 99b9b6a915a94310ba479b4d3ee7c966 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 08100eb76c5a4fbd97f5a0b81c40f75d, 99b9b6a915a94310ba479b4d3ee7c966; no voters: 
I20260709 13:03:58.546248 19215 raft_consensus.cc:2804] T 7c52a94485bd40e6a022a546c42407b4 P 99b9b6a915a94310ba479b4d3ee7c966 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:03:58.546602 18920 raft_consensus.cc:2468] T 7c52a94485bd40e6a022a546c42407b4 P c611bf5baef04660ada573aaf2ae7740 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 99b9b6a915a94310ba479b4d3ee7c966 in term 2.
I20260709 13:03:58.547333 19215 raft_consensus.cc:697] T 7c52a94485bd40e6a022a546c42407b4 P 99b9b6a915a94310ba479b4d3ee7c966 [term 2 LEADER]: Becoming Leader. State: Replica: 99b9b6a915a94310ba479b4d3ee7c966, State: Running, Role: LEADER
I20260709 13:03:58.548189 19215 consensus_queue.cc:237] T 7c52a94485bd40e6a022a546c42407b4 P 99b9b6a915a94310ba479b4d3ee7c966 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c611bf5baef04660ada573aaf2ae7740" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 46065 } } peers { permanent_uuid: "08100eb76c5a4fbd97f5a0b81c40f75d" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 37843 } } peers { permanent_uuid: "99b9b6a915a94310ba479b4d3ee7c966" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36031 } }
I20260709 13:03:58.555160 18816 catalog_manager.cc:5697] T 7c52a94485bd40e6a022a546c42407b4 P 99b9b6a915a94310ba479b4d3ee7c966 reported cstate change: term changed from 1 to 2, leader changed from c611bf5baef04660ada573aaf2ae7740 (127.17.223.1) to 99b9b6a915a94310ba479b4d3ee7c966 (127.17.223.3). New cstate: current_term: 2 leader_uuid: "99b9b6a915a94310ba479b4d3ee7c966" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c611bf5baef04660ada573aaf2ae7740" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 46065 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "08100eb76c5a4fbd97f5a0b81c40f75d" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 37843 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "99b9b6a915a94310ba479b4d3ee7c966" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36031 } health_report { overall_health: HEALTHY } } }
I20260709 13:03:58.827433 19116 raft_consensus.cc:993] T a8c3aa064aaa42b5b251eab220ab5e44 P c611bf5baef04660ada573aaf2ae7740: : Instructing follower 99b9b6a915a94310ba479b4d3ee7c966 to start an election
I20260709 13:03:58.827850 19116 raft_consensus.cc:1081] T a8c3aa064aaa42b5b251eab220ab5e44 P c611bf5baef04660ada573aaf2ae7740 [term 2 LEADER]: Signalling peer 99b9b6a915a94310ba479b4d3ee7c966 to start an election
I20260709 13:03:58.829120 19067 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a8c3aa064aaa42b5b251eab220ab5e44"
dest_uuid: "99b9b6a915a94310ba479b4d3ee7c966"
 from {username='slave'} at 127.0.0.1:50600
I20260709 13:03:58.829576 19067 raft_consensus.cc:493] T a8c3aa064aaa42b5b251eab220ab5e44 P 99b9b6a915a94310ba479b4d3ee7c966 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:03:58.829844 19067 raft_consensus.cc:3060] T a8c3aa064aaa42b5b251eab220ab5e44 P 99b9b6a915a94310ba479b4d3ee7c966 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:03:58.834015 19067 raft_consensus.cc:515] T a8c3aa064aaa42b5b251eab220ab5e44 P 99b9b6a915a94310ba479b4d3ee7c966 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c611bf5baef04660ada573aaf2ae7740" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 46065 } } peers { permanent_uuid: "08100eb76c5a4fbd97f5a0b81c40f75d" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 37843 } } peers { permanent_uuid: "99b9b6a915a94310ba479b4d3ee7c966" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36031 } }
I20260709 13:03:58.835561 19067 leader_election.cc:290] T a8c3aa064aaa42b5b251eab220ab5e44 P 99b9b6a915a94310ba479b4d3ee7c966 [CANDIDATE]: Term 3 election: Requested vote from peers c611bf5baef04660ada573aaf2ae7740 (127.17.223.1:46065), 08100eb76c5a4fbd97f5a0b81c40f75d (127.17.223.2:37843)
I20260709 13:03:58.836401 18920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8c3aa064aaa42b5b251eab220ab5e44" candidate_uuid: "99b9b6a915a94310ba479b4d3ee7c966" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "c611bf5baef04660ada573aaf2ae7740"
I20260709 13:03:58.836647 18994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8c3aa064aaa42b5b251eab220ab5e44" candidate_uuid: "99b9b6a915a94310ba479b4d3ee7c966" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "08100eb76c5a4fbd97f5a0b81c40f75d"
I20260709 13:03:58.837024 18920 raft_consensus.cc:3055] T a8c3aa064aaa42b5b251eab220ab5e44 P c611bf5baef04660ada573aaf2ae7740 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:03:58.837105 18994 raft_consensus.cc:3060] T a8c3aa064aaa42b5b251eab220ab5e44 P 08100eb76c5a4fbd97f5a0b81c40f75d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:03:58.837462 18920 raft_consensus.cc:740] T a8c3aa064aaa42b5b251eab220ab5e44 P c611bf5baef04660ada573aaf2ae7740 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: c611bf5baef04660ada573aaf2ae7740, State: Running, Role: LEADER
I20260709 13:03:58.838264 18920 consensus_queue.cc:260] T a8c3aa064aaa42b5b251eab220ab5e44 P c611bf5baef04660ada573aaf2ae7740 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c611bf5baef04660ada573aaf2ae7740" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 46065 } } peers { permanent_uuid: "08100eb76c5a4fbd97f5a0b81c40f75d" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 37843 } } peers { permanent_uuid: "99b9b6a915a94310ba479b4d3ee7c966" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36031 } }
I20260709 13:03:58.839455 18920 raft_consensus.cc:3060] T a8c3aa064aaa42b5b251eab220ab5e44 P c611bf5baef04660ada573aaf2ae7740 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:03:58.843426 18994 raft_consensus.cc:2468] T a8c3aa064aaa42b5b251eab220ab5e44 P 08100eb76c5a4fbd97f5a0b81c40f75d [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 99b9b6a915a94310ba479b4d3ee7c966 in term 3.
I20260709 13:03:58.844566 19034 leader_election.cc:304] T a8c3aa064aaa42b5b251eab220ab5e44 P 99b9b6a915a94310ba479b4d3ee7c966 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 08100eb76c5a4fbd97f5a0b81c40f75d, 99b9b6a915a94310ba479b4d3ee7c966; no voters: 
I20260709 13:03:58.845314 19215 raft_consensus.cc:2804] T a8c3aa064aaa42b5b251eab220ab5e44 P 99b9b6a915a94310ba479b4d3ee7c966 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:03:58.845708 19215 raft_consensus.cc:697] T a8c3aa064aaa42b5b251eab220ab5e44 P 99b9b6a915a94310ba479b4d3ee7c966 [term 3 LEADER]: Becoming Leader. State: Replica: 99b9b6a915a94310ba479b4d3ee7c966, State: Running, Role: LEADER
I20260709 13:03:58.845733 18920 raft_consensus.cc:2468] T a8c3aa064aaa42b5b251eab220ab5e44 P c611bf5baef04660ada573aaf2ae7740 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 99b9b6a915a94310ba479b4d3ee7c966 in term 3.
I20260709 13:03:58.846513 19215 consensus_queue.cc:237] T a8c3aa064aaa42b5b251eab220ab5e44 P 99b9b6a915a94310ba479b4d3ee7c966 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c611bf5baef04660ada573aaf2ae7740" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 46065 } } peers { permanent_uuid: "08100eb76c5a4fbd97f5a0b81c40f75d" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 37843 } } peers { permanent_uuid: "99b9b6a915a94310ba479b4d3ee7c966" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36031 } }
I20260709 13:03:58.855194 18816 catalog_manager.cc:5697] T a8c3aa064aaa42b5b251eab220ab5e44 P 99b9b6a915a94310ba479b4d3ee7c966 reported cstate change: term changed from 2 to 3, leader changed from c611bf5baef04660ada573aaf2ae7740 (127.17.223.1) to 99b9b6a915a94310ba479b4d3ee7c966 (127.17.223.3). New cstate: current_term: 3 leader_uuid: "99b9b6a915a94310ba479b4d3ee7c966" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c611bf5baef04660ada573aaf2ae7740" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 46065 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "08100eb76c5a4fbd97f5a0b81c40f75d" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 37843 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "99b9b6a915a94310ba479b4d3ee7c966" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36031 } health_report { overall_health: HEALTHY } } }
I20260709 13:03:58.939481 18994 raft_consensus.cc:1275] T 7c52a94485bd40e6a022a546c42407b4 P 08100eb76c5a4fbd97f5a0b81c40f75d [term 2 FOLLOWER]: Refusing update from remote peer 99b9b6a915a94310ba479b4d3ee7c966: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:03:58.940948 19215 consensus_queue.cc:1048] T 7c52a94485bd40e6a022a546c42407b4 P 99b9b6a915a94310ba479b4d3ee7c966 [LEADER]: Connected to new peer: Peer: permanent_uuid: "08100eb76c5a4fbd97f5a0b81c40f75d" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 37843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:03:58.951457 18920 raft_consensus.cc:1275] T 7c52a94485bd40e6a022a546c42407b4 P c611bf5baef04660ada573aaf2ae7740 [term 2 FOLLOWER]: Refusing update from remote peer 99b9b6a915a94310ba479b4d3ee7c966: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:03:58.953286 19219 consensus_queue.cc:1048] T 7c52a94485bd40e6a022a546c42407b4 P 99b9b6a915a94310ba479b4d3ee7c966 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c611bf5baef04660ada573aaf2ae7740" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 46065 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:03:59.244733 18994 raft_consensus.cc:1275] T a8c3aa064aaa42b5b251eab220ab5e44 P 08100eb76c5a4fbd97f5a0b81c40f75d [term 3 FOLLOWER]: Refusing update from remote peer 99b9b6a915a94310ba479b4d3ee7c966: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:03:59.245790 19219 consensus_queue.cc:1048] T a8c3aa064aaa42b5b251eab220ab5e44 P 99b9b6a915a94310ba479b4d3ee7c966 [LEADER]: Connected to new peer: Peer: permanent_uuid: "08100eb76c5a4fbd97f5a0b81c40f75d" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 37843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:03:59.253481 18920 raft_consensus.cc:1275] T a8c3aa064aaa42b5b251eab220ab5e44 P c611bf5baef04660ada573aaf2ae7740 [term 3 FOLLOWER]: Refusing update from remote peer 99b9b6a915a94310ba479b4d3ee7c966: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:03:59.255245 19219 consensus_queue.cc:1048] T a8c3aa064aaa42b5b251eab220ab5e44 P 99b9b6a915a94310ba479b4d3ee7c966 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c611bf5baef04660ada573aaf2ae7740" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 46065 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:03:59.474537 18300 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:03:59.484061 19067 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7c52a94485bd40e6a022a546c42407b4"
dest_uuid: "99b9b6a915a94310ba479b4d3ee7c966"
mode: GRACEFUL
new_leader_uuid: "c611bf5baef04660ada573aaf2ae7740"
 from {username='slave'} at 127.0.0.1:50614
I20260709 13:03:59.484560 19067 raft_consensus.cc:606] T 7c52a94485bd40e6a022a546c42407b4 P 99b9b6a915a94310ba479b4d3ee7c966 [term 2 LEADER]: Received request to transfer leadership to TS c611bf5baef04660ada573aaf2ae7740
I20260709 13:03:59.488927 19067 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a8c3aa064aaa42b5b251eab220ab5e44"
dest_uuid: "99b9b6a915a94310ba479b4d3ee7c966"
mode: GRACEFUL
new_leader_uuid: "c611bf5baef04660ada573aaf2ae7740"
 from {username='slave'} at 127.0.0.1:50614
I20260709 13:03:59.489362 19067 raft_consensus.cc:606] T a8c3aa064aaa42b5b251eab220ab5e44 P 99b9b6a915a94310ba479b4d3ee7c966 [term 3 LEADER]: Received request to transfer leadership to TS c611bf5baef04660ada573aaf2ae7740
I20260709 13:03:59.500470 18994 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "635268a9733742f3aa2abc8ce5779d9f"
dest_uuid: "08100eb76c5a4fbd97f5a0b81c40f75d"
mode: GRACEFUL
new_leader_uuid: "c611bf5baef04660ada573aaf2ae7740"
 from {username='slave'} at 127.0.0.1:48722
I20260709 13:03:59.500931 18994 raft_consensus.cc:606] T 635268a9733742f3aa2abc8ce5779d9f P 08100eb76c5a4fbd97f5a0b81c40f75d [term 2 LEADER]: Received request to transfer leadership to TS c611bf5baef04660ada573aaf2ae7740
I20260709 13:03:59.504969 18994 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b190be4cf1684677b783edcb8f9ae128"
dest_uuid: "08100eb76c5a4fbd97f5a0b81c40f75d"
mode: GRACEFUL
new_leader_uuid: "c611bf5baef04660ada573aaf2ae7740"
 from {username='slave'} at 127.0.0.1:48722
I20260709 13:03:59.505443 18994 raft_consensus.cc:606] T b190be4cf1684677b783edcb8f9ae128 P 08100eb76c5a4fbd97f5a0b81c40f75d [term 2 LEADER]: Received request to transfer leadership to TS c611bf5baef04660ada573aaf2ae7740
I20260709 13:03:59.509958 18994 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "05ab4aa1987a441f8eb5811181a6f1c0"
dest_uuid: "08100eb76c5a4fbd97f5a0b81c40f75d"
mode: GRACEFUL
new_leader_uuid: "c611bf5baef04660ada573aaf2ae7740"
 from {username='slave'} at 127.0.0.1:48722
I20260709 13:03:59.510462 18994 raft_consensus.cc:606] T 05ab4aa1987a441f8eb5811181a6f1c0 P 08100eb76c5a4fbd97f5a0b81c40f75d [term 1 LEADER]: Received request to transfer leadership to TS c611bf5baef04660ada573aaf2ae7740
I20260709 13:03:59.511571 19232 raft_consensus.cc:993] T 7c52a94485bd40e6a022a546c42407b4 P 99b9b6a915a94310ba479b4d3ee7c966: : Instructing follower c611bf5baef04660ada573aaf2ae7740 to start an election
I20260709 13:03:59.511996 19219 raft_consensus.cc:1081] T 7c52a94485bd40e6a022a546c42407b4 P 99b9b6a915a94310ba479b4d3ee7c966 [term 2 LEADER]: Signalling peer c611bf5baef04660ada573aaf2ae7740 to start an election
I20260709 13:03:59.513487 18919 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "7c52a94485bd40e6a022a546c42407b4"
dest_uuid: "c611bf5baef04660ada573aaf2ae7740"
 from {username='slave'} at 127.0.0.1:36628
I20260709 13:03:59.514097 18919 raft_consensus.cc:493] T 7c52a94485bd40e6a022a546c42407b4 P c611bf5baef04660ada573aaf2ae7740 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:03:59.514509 18919 raft_consensus.cc:3060] T 7c52a94485bd40e6a022a546c42407b4 P c611bf5baef04660ada573aaf2ae7740 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:03:59.520643 18919 raft_consensus.cc:515] T 7c52a94485bd40e6a022a546c42407b4 P c611bf5baef04660ada573aaf2ae7740 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c611bf5baef04660ada573aaf2ae7740" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 46065 } } peers { permanent_uuid: "08100eb76c5a4fbd97f5a0b81c40f75d" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 37843 } } peers { permanent_uuid: "99b9b6a915a94310ba479b4d3ee7c966" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36031 } }
I20260709 13:03:59.523195 18994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c52a94485bd40e6a022a546c42407b4" candidate_uuid: "c611bf5baef04660ada573aaf2ae7740" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "08100eb76c5a4fbd97f5a0b81c40f75d"
I20260709 13:03:59.523774 18994 raft_consensus.cc:3060] T 7c52a94485bd40e6a022a546c42407b4 P 08100eb76c5a4fbd97f5a0b81c40f75d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:03:59.524325 19235 raft_consensus.cc:993] T 635268a9733742f3aa2abc8ce5779d9f P 08100eb76c5a4fbd97f5a0b81c40f75d: : Instructing follower c611bf5baef04660ada573aaf2ae7740 to start an election
I20260709 13:03:59.524812 19169 raft_consensus.cc:1081] T 635268a9733742f3aa2abc8ce5779d9f P 08100eb76c5a4fbd97f5a0b81c40f75d [term 2 LEADER]: Signalling peer c611bf5baef04660ada573aaf2ae7740 to start an election
I20260709 13:03:59.525141 18919 leader_election.cc:290] T 7c52a94485bd40e6a022a546c42407b4 P c611bf5baef04660ada573aaf2ae7740 [CANDIDATE]: Term 3 election: Requested vote from peers 08100eb76c5a4fbd97f5a0b81c40f75d (127.17.223.2:37843), 99b9b6a915a94310ba479b4d3ee7c966 (127.17.223.3:36031)
I20260709 13:03:59.526363 18919 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "635268a9733742f3aa2abc8ce5779d9f"
dest_uuid: "c611bf5baef04660ada573aaf2ae7740"
 from {username='slave'} at 127.0.0.1:36612
I20260709 13:03:59.526773 19067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c52a94485bd40e6a022a546c42407b4" candidate_uuid: "c611bf5baef04660ada573aaf2ae7740" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "99b9b6a915a94310ba479b4d3ee7c966"
I20260709 13:03:59.526841 18919 raft_consensus.cc:493] T 635268a9733742f3aa2abc8ce5779d9f P c611bf5baef04660ada573aaf2ae7740 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:03:59.527252 19067 raft_consensus.cc:3055] T 7c52a94485bd40e6a022a546c42407b4 P 99b9b6a915a94310ba479b4d3ee7c966 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:03:59.527283 18919 raft_consensus.cc:3060] T 635268a9733742f3aa2abc8ce5779d9f P c611bf5baef04660ada573aaf2ae7740 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:03:59.527606 19067 raft_consensus.cc:740] T 7c52a94485bd40e6a022a546c42407b4 P 99b9b6a915a94310ba479b4d3ee7c966 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 99b9b6a915a94310ba479b4d3ee7c966, State: Running, Role: LEADER
I20260709 13:03:59.528290 19067 consensus_queue.cc:260] T 7c52a94485bd40e6a022a546c42407b4 P 99b9b6a915a94310ba479b4d3ee7c966 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c611bf5baef04660ada573aaf2ae7740" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 46065 } } peers { permanent_uuid: "08100eb76c5a4fbd97f5a0b81c40f75d" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 37843 } } peers { permanent_uuid: "99b9b6a915a94310ba479b4d3ee7c966" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36031 } }
I20260709 13:03:59.529091 19067 raft_consensus.cc:3060] T 7c52a94485bd40e6a022a546c42407b4 P 99b9b6a915a94310ba479b4d3ee7c966 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:03:59.529971 18994 raft_consensus.cc:2468] T 7c52a94485bd40e6a022a546c42407b4 P 08100eb76c5a4fbd97f5a0b81c40f75d [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c611bf5baef04660ada573aaf2ae7740 in term 3.
I20260709 13:03:59.530944 18885 leader_election.cc:304] T 7c52a94485bd40e6a022a546c42407b4 P c611bf5baef04660ada573aaf2ae7740 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 08100eb76c5a4fbd97f5a0b81c40f75d, c611bf5baef04660ada573aaf2ae7740; no voters: 
I20260709 13:03:59.531723 19234 raft_consensus.cc:2804] T 7c52a94485bd40e6a022a546c42407b4 P c611bf5baef04660ada573aaf2ae7740 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:03:59.532158 19234 raft_consensus.cc:697] T 7c52a94485bd40e6a022a546c42407b4 P c611bf5baef04660ada573aaf2ae7740 [term 3 LEADER]: Becoming Leader. State: Replica: c611bf5baef04660ada573aaf2ae7740, State: Running, Role: LEADER
I20260709 13:03:59.532968 18919 raft_consensus.cc:515] T 635268a9733742f3aa2abc8ce5779d9f P c611bf5baef04660ada573aaf2ae7740 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c611bf5baef04660ada573aaf2ae7740" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 46065 } } peers { permanent_uuid: "08100eb76c5a4fbd97f5a0b81c40f75d" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 37843 } } peers { permanent_uuid: "99b9b6a915a94310ba479b4d3ee7c966" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36031 } }
I20260709 13:03:59.532953 19234 consensus_queue.cc:237] T 7c52a94485bd40e6a022a546c42407b4 P c611bf5baef04660ada573aaf2ae7740 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c611bf5baef04660ada573aaf2ae7740" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 46065 } } peers { permanent_uuid: "08100eb76c5a4fbd97f5a0b81c40f75d" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 37843 } } peers { permanent_uuid: "99b9b6a915a94310ba479b4d3ee7c966" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36031 } }
I20260709 13:03:59.534250 19067 raft_consensus.cc:2468] T 7c52a94485bd40e6a022a546c42407b4 P 99b9b6a915a94310ba479b4d3ee7c966 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c611bf5baef04660ada573aaf2ae7740 in term 3.
I20260709 13:03:59.535377 18994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "635268a9733742f3aa2abc8ce5779d9f" candidate_uuid: "c611bf5baef04660ada573aaf2ae7740" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "08100eb76c5a4fbd97f5a0b81c40f75d"
I20260709 13:03:59.535496 18919 leader_election.cc:290] T 635268a9733742f3aa2abc8ce5779d9f P c611bf5baef04660ada573aaf2ae7740 [CANDIDATE]: Term 3 election: Requested vote from peers 08100eb76c5a4fbd97f5a0b81c40f75d (127.17.223.2:37843), 99b9b6a915a94310ba479b4d3ee7c966 (127.17.223.3:36031)
I20260709 13:03:59.535931 18994 raft_consensus.cc:3055] T 635268a9733742f3aa2abc8ce5779d9f P 08100eb76c5a4fbd97f5a0b81c40f75d [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:03:59.535811 19067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "635268a9733742f3aa2abc8ce5779d9f" candidate_uuid: "c611bf5baef04660ada573aaf2ae7740" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "99b9b6a915a94310ba479b4d3ee7c966"
I20260709 13:03:59.536314 18994 raft_consensus.cc:740] T 635268a9733742f3aa2abc8ce5779d9f P 08100eb76c5a4fbd97f5a0b81c40f75d [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 08100eb76c5a4fbd97f5a0b81c40f75d, State: Running, Role: LEADER
I20260709 13:03:59.536978 18994 consensus_queue.cc:260] T 635268a9733742f3aa2abc8ce5779d9f P 08100eb76c5a4fbd97f5a0b81c40f75d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c611bf5baef04660ada573aaf2ae7740" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 46065 } } peers { permanent_uuid: "08100eb76c5a4fbd97f5a0b81c40f75d" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 37843 } } peers { permanent_uuid: "99b9b6a915a94310ba479b4d3ee7c966" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36031 } }
I20260709 13:03:59.537758 18994 raft_consensus.cc:3060] T 635268a9733742f3aa2abc8ce5779d9f P 08100eb76c5a4fbd97f5a0b81c40f75d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:03:59.538611 19067 raft_consensus.cc:3060] T 635268a9733742f3aa2abc8ce5779d9f P 99b9b6a915a94310ba479b4d3ee7c966 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:03:59.540946 18816 catalog_manager.cc:5697] T 7c52a94485bd40e6a022a546c42407b4 P c611bf5baef04660ada573aaf2ae7740 reported cstate change: term changed from 2 to 3, leader changed from 99b9b6a915a94310ba479b4d3ee7c966 (127.17.223.3) to c611bf5baef04660ada573aaf2ae7740 (127.17.223.1). New cstate: current_term: 3 leader_uuid: "c611bf5baef04660ada573aaf2ae7740" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c611bf5baef04660ada573aaf2ae7740" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 46065 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "08100eb76c5a4fbd97f5a0b81c40f75d" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 37843 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "99b9b6a915a94310ba479b4d3ee7c966" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36031 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:59.543409 18994 raft_consensus.cc:2468] T 635268a9733742f3aa2abc8ce5779d9f P 08100eb76c5a4fbd97f5a0b81c40f75d [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c611bf5baef04660ada573aaf2ae7740 in term 3.
I20260709 13:03:59.544579 18885 leader_election.cc:304] T 635268a9733742f3aa2abc8ce5779d9f P c611bf5baef04660ada573aaf2ae7740 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 08100eb76c5a4fbd97f5a0b81c40f75d, c611bf5baef04660ada573aaf2ae7740; no voters: 
I20260709 13:03:59.545163 19067 raft_consensus.cc:2468] T 635268a9733742f3aa2abc8ce5779d9f P 99b9b6a915a94310ba479b4d3ee7c966 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c611bf5baef04660ada573aaf2ae7740 in term 3.
I20260709 13:03:59.545295 19234 raft_consensus.cc:2804] T 635268a9733742f3aa2abc8ce5779d9f P c611bf5baef04660ada573aaf2ae7740 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:03:59.545816 19234 raft_consensus.cc:697] T 635268a9733742f3aa2abc8ce5779d9f P c611bf5baef04660ada573aaf2ae7740 [term 3 LEADER]: Becoming Leader. State: Replica: c611bf5baef04660ada573aaf2ae7740, State: Running, Role: LEADER
I20260709 13:03:59.546492 19234 consensus_queue.cc:237] T 635268a9733742f3aa2abc8ce5779d9f P c611bf5baef04660ada573aaf2ae7740 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c611bf5baef04660ada573aaf2ae7740" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 46065 } } peers { permanent_uuid: "08100eb76c5a4fbd97f5a0b81c40f75d" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 37843 } } peers { permanent_uuid: "99b9b6a915a94310ba479b4d3ee7c966" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36031 } }
I20260709 13:03:59.555614 18816 catalog_manager.cc:5697] T 635268a9733742f3aa2abc8ce5779d9f P c611bf5baef04660ada573aaf2ae7740 reported cstate change: term changed from 2 to 3, leader changed from 08100eb76c5a4fbd97f5a0b81c40f75d (127.17.223.2) to c611bf5baef04660ada573aaf2ae7740 (127.17.223.1). New cstate: current_term: 3 leader_uuid: "c611bf5baef04660ada573aaf2ae7740" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c611bf5baef04660ada573aaf2ae7740" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 46065 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "08100eb76c5a4fbd97f5a0b81c40f75d" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 37843 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "99b9b6a915a94310ba479b4d3ee7c966" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36031 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:59.750363 19232 raft_consensus.cc:993] T a8c3aa064aaa42b5b251eab220ab5e44 P 99b9b6a915a94310ba479b4d3ee7c966: : Instructing follower c611bf5baef04660ada573aaf2ae7740 to start an election
I20260709 13:03:59.750864 19219 raft_consensus.cc:1081] T a8c3aa064aaa42b5b251eab220ab5e44 P 99b9b6a915a94310ba479b4d3ee7c966 [term 3 LEADER]: Signalling peer c611bf5baef04660ada573aaf2ae7740 to start an election
I20260709 13:03:59.752389 18919 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a8c3aa064aaa42b5b251eab220ab5e44"
dest_uuid: "c611bf5baef04660ada573aaf2ae7740"
 from {username='slave'} at 127.0.0.1:36628
I20260709 13:03:59.752813 18919 raft_consensus.cc:493] T a8c3aa064aaa42b5b251eab220ab5e44 P c611bf5baef04660ada573aaf2ae7740 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:03:59.753106 18919 raft_consensus.cc:3060] T a8c3aa064aaa42b5b251eab220ab5e44 P c611bf5baef04660ada573aaf2ae7740 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:03:59.757197 18919 raft_consensus.cc:515] T a8c3aa064aaa42b5b251eab220ab5e44 P c611bf5baef04660ada573aaf2ae7740 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c611bf5baef04660ada573aaf2ae7740" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 46065 } } peers { permanent_uuid: "08100eb76c5a4fbd97f5a0b81c40f75d" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 37843 } } peers { permanent_uuid: "99b9b6a915a94310ba479b4d3ee7c966" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36031 } }
I20260709 13:03:59.758522 18919 leader_election.cc:290] T a8c3aa064aaa42b5b251eab220ab5e44 P c611bf5baef04660ada573aaf2ae7740 [CANDIDATE]: Term 4 election: Requested vote from peers 08100eb76c5a4fbd97f5a0b81c40f75d (127.17.223.2:37843), 99b9b6a915a94310ba479b4d3ee7c966 (127.17.223.3:36031)
I20260709 13:03:59.759336 18994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8c3aa064aaa42b5b251eab220ab5e44" candidate_uuid: "c611bf5baef04660ada573aaf2ae7740" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "08100eb76c5a4fbd97f5a0b81c40f75d"
I20260709 13:03:59.759531 19067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8c3aa064aaa42b5b251eab220ab5e44" candidate_uuid: "c611bf5baef04660ada573aaf2ae7740" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "99b9b6a915a94310ba479b4d3ee7c966"
I20260709 13:03:59.759806 18994 raft_consensus.cc:3060] T a8c3aa064aaa42b5b251eab220ab5e44 P 08100eb76c5a4fbd97f5a0b81c40f75d [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:03:59.760053 19067 raft_consensus.cc:3055] T a8c3aa064aaa42b5b251eab220ab5e44 P 99b9b6a915a94310ba479b4d3ee7c966 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:03:59.760378 19067 raft_consensus.cc:740] T a8c3aa064aaa42b5b251eab220ab5e44 P 99b9b6a915a94310ba479b4d3ee7c966 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 99b9b6a915a94310ba479b4d3ee7c966, State: Running, Role: LEADER
I20260709 13:03:59.761117 19067 consensus_queue.cc:260] T a8c3aa064aaa42b5b251eab220ab5e44 P 99b9b6a915a94310ba479b4d3ee7c966 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c611bf5baef04660ada573aaf2ae7740" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 46065 } } peers { permanent_uuid: "08100eb76c5a4fbd97f5a0b81c40f75d" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 37843 } } peers { permanent_uuid: "99b9b6a915a94310ba479b4d3ee7c966" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36031 } }
I20260709 13:03:59.761976 19067 raft_consensus.cc:3060] T a8c3aa064aaa42b5b251eab220ab5e44 P 99b9b6a915a94310ba479b4d3ee7c966 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:03:59.764045 18994 raft_consensus.cc:2468] T a8c3aa064aaa42b5b251eab220ab5e44 P 08100eb76c5a4fbd97f5a0b81c40f75d [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c611bf5baef04660ada573aaf2ae7740 in term 4.
I20260709 13:03:59.764986 18885 leader_election.cc:304] T a8c3aa064aaa42b5b251eab220ab5e44 P c611bf5baef04660ada573aaf2ae7740 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 08100eb76c5a4fbd97f5a0b81c40f75d, c611bf5baef04660ada573aaf2ae7740; no voters: 
I20260709 13:03:59.765676 19234 raft_consensus.cc:2804] T a8c3aa064aaa42b5b251eab220ab5e44 P c611bf5baef04660ada573aaf2ae7740 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:03:59.765730 19067 raft_consensus.cc:2468] T a8c3aa064aaa42b5b251eab220ab5e44 P 99b9b6a915a94310ba479b4d3ee7c966 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c611bf5baef04660ada573aaf2ae7740 in term 4.
I20260709 13:03:59.766209 19234 raft_consensus.cc:697] T a8c3aa064aaa42b5b251eab220ab5e44 P c611bf5baef04660ada573aaf2ae7740 [term 4 LEADER]: Becoming Leader. State: Replica: c611bf5baef04660ada573aaf2ae7740, State: Running, Role: LEADER
I20260709 13:03:59.766997 19234 consensus_queue.cc:237] T a8c3aa064aaa42b5b251eab220ab5e44 P c611bf5baef04660ada573aaf2ae7740 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c611bf5baef04660ada573aaf2ae7740" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 46065 } } peers { permanent_uuid: "08100eb76c5a4fbd97f5a0b81c40f75d" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 37843 } } peers { permanent_uuid: "99b9b6a915a94310ba479b4d3ee7c966" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36031 } }
I20260709 13:03:59.773100 18816 catalog_manager.cc:5697] T a8c3aa064aaa42b5b251eab220ab5e44 P c611bf5baef04660ada573aaf2ae7740 reported cstate change: term changed from 3 to 4, leader changed from 99b9b6a915a94310ba479b4d3ee7c966 (127.17.223.3) to c611bf5baef04660ada573aaf2ae7740 (127.17.223.1). New cstate: current_term: 4 leader_uuid: "c611bf5baef04660ada573aaf2ae7740" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c611bf5baef04660ada573aaf2ae7740" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 46065 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "08100eb76c5a4fbd97f5a0b81c40f75d" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 37843 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "99b9b6a915a94310ba479b4d3ee7c966" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36031 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:59.817561 19235 raft_consensus.cc:993] T 05ab4aa1987a441f8eb5811181a6f1c0 P 08100eb76c5a4fbd97f5a0b81c40f75d: : Instructing follower c611bf5baef04660ada573aaf2ae7740 to start an election
I20260709 13:03:59.817957 19169 raft_consensus.cc:1081] T 05ab4aa1987a441f8eb5811181a6f1c0 P 08100eb76c5a4fbd97f5a0b81c40f75d [term 1 LEADER]: Signalling peer c611bf5baef04660ada573aaf2ae7740 to start an election
I20260709 13:03:59.819245 18919 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "05ab4aa1987a441f8eb5811181a6f1c0"
dest_uuid: "c611bf5baef04660ada573aaf2ae7740"
 from {username='slave'} at 127.0.0.1:36612
I20260709 13:03:59.819689 18919 raft_consensus.cc:493] T 05ab4aa1987a441f8eb5811181a6f1c0 P c611bf5baef04660ada573aaf2ae7740 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:03:59.819947 18919 raft_consensus.cc:3060] T 05ab4aa1987a441f8eb5811181a6f1c0 P c611bf5baef04660ada573aaf2ae7740 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:59.824024 18919 raft_consensus.cc:515] T 05ab4aa1987a441f8eb5811181a6f1c0 P c611bf5baef04660ada573aaf2ae7740 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c611bf5baef04660ada573aaf2ae7740" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 46065 } } peers { permanent_uuid: "08100eb76c5a4fbd97f5a0b81c40f75d" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 37843 } } peers { permanent_uuid: "99b9b6a915a94310ba479b4d3ee7c966" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36031 } }
I20260709 13:03:59.825409 18919 leader_election.cc:290] T 05ab4aa1987a441f8eb5811181a6f1c0 P c611bf5baef04660ada573aaf2ae7740 [CANDIDATE]: Term 2 election: Requested vote from peers 08100eb76c5a4fbd97f5a0b81c40f75d (127.17.223.2:37843), 99b9b6a915a94310ba479b4d3ee7c966 (127.17.223.3:36031)
I20260709 13:03:59.826406 19067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05ab4aa1987a441f8eb5811181a6f1c0" candidate_uuid: "c611bf5baef04660ada573aaf2ae7740" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "99b9b6a915a94310ba479b4d3ee7c966"
I20260709 13:03:59.826399 18994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05ab4aa1987a441f8eb5811181a6f1c0" candidate_uuid: "c611bf5baef04660ada573aaf2ae7740" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "08100eb76c5a4fbd97f5a0b81c40f75d"
I20260709 13:03:59.826963 19067 raft_consensus.cc:3060] T 05ab4aa1987a441f8eb5811181a6f1c0 P 99b9b6a915a94310ba479b4d3ee7c966 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:59.827082 18994 raft_consensus.cc:3055] T 05ab4aa1987a441f8eb5811181a6f1c0 P 08100eb76c5a4fbd97f5a0b81c40f75d [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:03:59.827395 18994 raft_consensus.cc:740] T 05ab4aa1987a441f8eb5811181a6f1c0 P 08100eb76c5a4fbd97f5a0b81c40f75d [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 08100eb76c5a4fbd97f5a0b81c40f75d, State: Running, Role: LEADER
I20260709 13:03:59.828037 18994 consensus_queue.cc:260] T 05ab4aa1987a441f8eb5811181a6f1c0 P 08100eb76c5a4fbd97f5a0b81c40f75d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c611bf5baef04660ada573aaf2ae7740" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 46065 } } peers { permanent_uuid: "08100eb76c5a4fbd97f5a0b81c40f75d" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 37843 } } peers { permanent_uuid: "99b9b6a915a94310ba479b4d3ee7c966" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36031 } }
I20260709 13:03:59.828809 18994 raft_consensus.cc:3060] T 05ab4aa1987a441f8eb5811181a6f1c0 P 08100eb76c5a4fbd97f5a0b81c40f75d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:59.831197 19067 raft_consensus.cc:2468] T 05ab4aa1987a441f8eb5811181a6f1c0 P 99b9b6a915a94310ba479b4d3ee7c966 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c611bf5baef04660ada573aaf2ae7740 in term 2.
I20260709 13:03:59.832144 18886 leader_election.cc:304] T 05ab4aa1987a441f8eb5811181a6f1c0 P c611bf5baef04660ada573aaf2ae7740 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 99b9b6a915a94310ba479b4d3ee7c966, c611bf5baef04660ada573aaf2ae7740; no voters: 
I20260709 13:03:59.832806 19234 raft_consensus.cc:2804] T 05ab4aa1987a441f8eb5811181a6f1c0 P c611bf5baef04660ada573aaf2ae7740 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:03:59.832885 18994 raft_consensus.cc:2468] T 05ab4aa1987a441f8eb5811181a6f1c0 P 08100eb76c5a4fbd97f5a0b81c40f75d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c611bf5baef04660ada573aaf2ae7740 in term 2.
I20260709 13:03:59.833283 19234 raft_consensus.cc:697] T 05ab4aa1987a441f8eb5811181a6f1c0 P c611bf5baef04660ada573aaf2ae7740 [term 2 LEADER]: Becoming Leader. State: Replica: c611bf5baef04660ada573aaf2ae7740, State: Running, Role: LEADER
I20260709 13:03:59.834048 19234 consensus_queue.cc:237] T 05ab4aa1987a441f8eb5811181a6f1c0 P c611bf5baef04660ada573aaf2ae7740 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c611bf5baef04660ada573aaf2ae7740" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 46065 } } peers { permanent_uuid: "08100eb76c5a4fbd97f5a0b81c40f75d" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 37843 } } peers { permanent_uuid: "99b9b6a915a94310ba479b4d3ee7c966" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36031 } }
I20260709 13:03:59.840018 18816 catalog_manager.cc:5697] T 05ab4aa1987a441f8eb5811181a6f1c0 P c611bf5baef04660ada573aaf2ae7740 reported cstate change: term changed from 1 to 2, leader changed from 08100eb76c5a4fbd97f5a0b81c40f75d (127.17.223.2) to c611bf5baef04660ada573aaf2ae7740 (127.17.223.1). New cstate: current_term: 2 leader_uuid: "c611bf5baef04660ada573aaf2ae7740" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c611bf5baef04660ada573aaf2ae7740" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 46065 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "08100eb76c5a4fbd97f5a0b81c40f75d" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 37843 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "99b9b6a915a94310ba479b4d3ee7c966" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36031 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:59.916229 19235 raft_consensus.cc:993] T b190be4cf1684677b783edcb8f9ae128 P 08100eb76c5a4fbd97f5a0b81c40f75d: : Instructing follower c611bf5baef04660ada573aaf2ae7740 to start an election
I20260709 13:03:59.916666 19169 raft_consensus.cc:1081] T b190be4cf1684677b783edcb8f9ae128 P 08100eb76c5a4fbd97f5a0b81c40f75d [term 2 LEADER]: Signalling peer c611bf5baef04660ada573aaf2ae7740 to start an election
I20260709 13:03:59.917945 18919 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b190be4cf1684677b783edcb8f9ae128"
dest_uuid: "c611bf5baef04660ada573aaf2ae7740"
 from {username='slave'} at 127.0.0.1:36612
I20260709 13:03:59.918327 18919 raft_consensus.cc:493] T b190be4cf1684677b783edcb8f9ae128 P c611bf5baef04660ada573aaf2ae7740 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:03:59.918561 18919 raft_consensus.cc:3060] T b190be4cf1684677b783edcb8f9ae128 P c611bf5baef04660ada573aaf2ae7740 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:03:59.922459 18919 raft_consensus.cc:515] T b190be4cf1684677b783edcb8f9ae128 P c611bf5baef04660ada573aaf2ae7740 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c611bf5baef04660ada573aaf2ae7740" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 46065 } } peers { permanent_uuid: "08100eb76c5a4fbd97f5a0b81c40f75d" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 37843 } } peers { permanent_uuid: "99b9b6a915a94310ba479b4d3ee7c966" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36031 } }
I20260709 13:03:59.923906 18919 leader_election.cc:290] T b190be4cf1684677b783edcb8f9ae128 P c611bf5baef04660ada573aaf2ae7740 [CANDIDATE]: Term 3 election: Requested vote from peers 08100eb76c5a4fbd97f5a0b81c40f75d (127.17.223.2:37843), 99b9b6a915a94310ba479b4d3ee7c966 (127.17.223.3:36031)
I20260709 13:03:59.924693 18994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b190be4cf1684677b783edcb8f9ae128" candidate_uuid: "c611bf5baef04660ada573aaf2ae7740" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "08100eb76c5a4fbd97f5a0b81c40f75d"
I20260709 13:03:59.924872 19067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b190be4cf1684677b783edcb8f9ae128" candidate_uuid: "c611bf5baef04660ada573aaf2ae7740" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "99b9b6a915a94310ba479b4d3ee7c966"
I20260709 13:03:59.925221 18994 raft_consensus.cc:3055] T b190be4cf1684677b783edcb8f9ae128 P 08100eb76c5a4fbd97f5a0b81c40f75d [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:03:59.925364 19067 raft_consensus.cc:3060] T b190be4cf1684677b783edcb8f9ae128 P 99b9b6a915a94310ba479b4d3ee7c966 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:03:59.925515 18994 raft_consensus.cc:740] T b190be4cf1684677b783edcb8f9ae128 P 08100eb76c5a4fbd97f5a0b81c40f75d [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 08100eb76c5a4fbd97f5a0b81c40f75d, State: Running, Role: LEADER
I20260709 13:03:59.926222 18994 consensus_queue.cc:260] T b190be4cf1684677b783edcb8f9ae128 P 08100eb76c5a4fbd97f5a0b81c40f75d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c611bf5baef04660ada573aaf2ae7740" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 46065 } } peers { permanent_uuid: "08100eb76c5a4fbd97f5a0b81c40f75d" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 37843 } } peers { permanent_uuid: "99b9b6a915a94310ba479b4d3ee7c966" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36031 } }
I20260709 13:03:59.927037 18994 raft_consensus.cc:3060] T b190be4cf1684677b783edcb8f9ae128 P 08100eb76c5a4fbd97f5a0b81c40f75d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:03:59.929520 19067 raft_consensus.cc:2468] T b190be4cf1684677b783edcb8f9ae128 P 99b9b6a915a94310ba479b4d3ee7c966 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c611bf5baef04660ada573aaf2ae7740 in term 3.
I20260709 13:03:59.930418 18886 leader_election.cc:304] T b190be4cf1684677b783edcb8f9ae128 P c611bf5baef04660ada573aaf2ae7740 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 99b9b6a915a94310ba479b4d3ee7c966, c611bf5baef04660ada573aaf2ae7740; no voters: 
I20260709 13:03:59.931147 19234 raft_consensus.cc:2804] T b190be4cf1684677b783edcb8f9ae128 P c611bf5baef04660ada573aaf2ae7740 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:03:59.931794 18994 raft_consensus.cc:2468] T b190be4cf1684677b783edcb8f9ae128 P 08100eb76c5a4fbd97f5a0b81c40f75d [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c611bf5baef04660ada573aaf2ae7740 in term 3.
I20260709 13:03:59.931808 19234 raft_consensus.cc:697] T b190be4cf1684677b783edcb8f9ae128 P c611bf5baef04660ada573aaf2ae7740 [term 3 LEADER]: Becoming Leader. State: Replica: c611bf5baef04660ada573aaf2ae7740, State: Running, Role: LEADER
I20260709 13:03:59.932925 19234 consensus_queue.cc:237] T b190be4cf1684677b783edcb8f9ae128 P c611bf5baef04660ada573aaf2ae7740 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c611bf5baef04660ada573aaf2ae7740" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 46065 } } peers { permanent_uuid: "08100eb76c5a4fbd97f5a0b81c40f75d" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 37843 } } peers { permanent_uuid: "99b9b6a915a94310ba479b4d3ee7c966" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36031 } }
I20260709 13:03:59.939267 18816 catalog_manager.cc:5697] T b190be4cf1684677b783edcb8f9ae128 P c611bf5baef04660ada573aaf2ae7740 reported cstate change: term changed from 2 to 3, leader changed from 08100eb76c5a4fbd97f5a0b81c40f75d (127.17.223.2) to c611bf5baef04660ada573aaf2ae7740 (127.17.223.1). New cstate: current_term: 3 leader_uuid: "c611bf5baef04660ada573aaf2ae7740" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c611bf5baef04660ada573aaf2ae7740" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 46065 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "08100eb76c5a4fbd97f5a0b81c40f75d" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 37843 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "99b9b6a915a94310ba479b4d3ee7c966" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36031 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:00.009512 19067 raft_consensus.cc:1275] T 7c52a94485bd40e6a022a546c42407b4 P 99b9b6a915a94310ba479b4d3ee7c966 [term 3 FOLLOWER]: Refusing update from remote peer c611bf5baef04660ada573aaf2ae7740: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:04:00.010743 19234 consensus_queue.cc:1048] T 7c52a94485bd40e6a022a546c42407b4 P c611bf5baef04660ada573aaf2ae7740 [LEADER]: Connected to new peer: Peer: permanent_uuid: "99b9b6a915a94310ba479b4d3ee7c966" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36031 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:04:00.019738 18994 raft_consensus.cc:1275] T 7c52a94485bd40e6a022a546c42407b4 P 08100eb76c5a4fbd97f5a0b81c40f75d [term 3 FOLLOWER]: Refusing update from remote peer c611bf5baef04660ada573aaf2ae7740: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:04:00.021864 19244 consensus_queue.cc:1048] T 7c52a94485bd40e6a022a546c42407b4 P c611bf5baef04660ada573aaf2ae7740 [LEADER]: Connected to new peer: Peer: permanent_uuid: "08100eb76c5a4fbd97f5a0b81c40f75d" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 37843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:04:00.118547 18994 raft_consensus.cc:1275] T 635268a9733742f3aa2abc8ce5779d9f P 08100eb76c5a4fbd97f5a0b81c40f75d [term 3 FOLLOWER]: Refusing update from remote peer c611bf5baef04660ada573aaf2ae7740: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:04:00.119740 19244 consensus_queue.cc:1048] T 635268a9733742f3aa2abc8ce5779d9f P c611bf5baef04660ada573aaf2ae7740 [LEADER]: Connected to new peer: Peer: permanent_uuid: "08100eb76c5a4fbd97f5a0b81c40f75d" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 37843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:04:00.128871 19067 raft_consensus.cc:1275] T 635268a9733742f3aa2abc8ce5779d9f P 99b9b6a915a94310ba479b4d3ee7c966 [term 3 FOLLOWER]: Refusing update from remote peer c611bf5baef04660ada573aaf2ae7740: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:04:00.130657 19116 consensus_queue.cc:1048] T 635268a9733742f3aa2abc8ce5779d9f P c611bf5baef04660ada573aaf2ae7740 [LEADER]: Connected to new peer: Peer: permanent_uuid: "99b9b6a915a94310ba479b4d3ee7c966" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36031 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:04:00.244573 19067 raft_consensus.cc:1275] T 05ab4aa1987a441f8eb5811181a6f1c0 P 99b9b6a915a94310ba479b4d3ee7c966 [term 2 FOLLOWER]: Refusing update from remote peer c611bf5baef04660ada573aaf2ae7740: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:00.245738 19116 consensus_queue.cc:1048] T 05ab4aa1987a441f8eb5811181a6f1c0 P c611bf5baef04660ada573aaf2ae7740 [LEADER]: Connected to new peer: Peer: permanent_uuid: "99b9b6a915a94310ba479b4d3ee7c966" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36031 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:04:00.255676 18994 raft_consensus.cc:1275] T 05ab4aa1987a441f8eb5811181a6f1c0 P 08100eb76c5a4fbd97f5a0b81c40f75d [term 2 FOLLOWER]: Refusing update from remote peer c611bf5baef04660ada573aaf2ae7740: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:00.257526 19116 consensus_queue.cc:1048] T 05ab4aa1987a441f8eb5811181a6f1c0 P c611bf5baef04660ada573aaf2ae7740 [LEADER]: Connected to new peer: Peer: permanent_uuid: "08100eb76c5a4fbd97f5a0b81c40f75d" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 37843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:04:00.318816 18994 raft_consensus.cc:1275] T a8c3aa064aaa42b5b251eab220ab5e44 P 08100eb76c5a4fbd97f5a0b81c40f75d [term 4 FOLLOWER]: Refusing update from remote peer c611bf5baef04660ada573aaf2ae7740: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:04:00.320073 19116 consensus_queue.cc:1048] T a8c3aa064aaa42b5b251eab220ab5e44 P c611bf5baef04660ada573aaf2ae7740 [LEADER]: Connected to new peer: Peer: permanent_uuid: "08100eb76c5a4fbd97f5a0b81c40f75d" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 37843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:04:00.329937 19067 raft_consensus.cc:1275] T a8c3aa064aaa42b5b251eab220ab5e44 P 99b9b6a915a94310ba479b4d3ee7c966 [term 4 FOLLOWER]: Refusing update from remote peer c611bf5baef04660ada573aaf2ae7740: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:04:00.331456 19234 consensus_queue.cc:1048] T a8c3aa064aaa42b5b251eab220ab5e44 P c611bf5baef04660ada573aaf2ae7740 [LEADER]: Connected to new peer: Peer: permanent_uuid: "99b9b6a915a94310ba479b4d3ee7c966" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36031 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:04:00.441454 19067 raft_consensus.cc:1275] T b190be4cf1684677b783edcb8f9ae128 P 99b9b6a915a94310ba479b4d3ee7c966 [term 3 FOLLOWER]: Refusing update from remote peer c611bf5baef04660ada573aaf2ae7740: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:04:00.442832 19234 consensus_queue.cc:1048] T b190be4cf1684677b783edcb8f9ae128 P c611bf5baef04660ada573aaf2ae7740 [LEADER]: Connected to new peer: Peer: permanent_uuid: "99b9b6a915a94310ba479b4d3ee7c966" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36031 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:04:00.452001 18995 raft_consensus.cc:1275] T b190be4cf1684677b783edcb8f9ae128 P 08100eb76c5a4fbd97f5a0b81c40f75d [term 3 FOLLOWER]: Refusing update from remote peer c611bf5baef04660ada573aaf2ae7740: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:04:00.453441 19116 consensus_queue.cc:1048] T b190be4cf1684677b783edcb8f9ae128 P c611bf5baef04660ada573aaf2ae7740 [LEADER]: Connected to new peer: Peer: permanent_uuid: "08100eb76c5a4fbd97f5a0b81c40f75d" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 37843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:04:02.517951 18300 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:04:02.526383 18919 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1109aee81b854cdcbac189f499fb0912"
dest_uuid: "c611bf5baef04660ada573aaf2ae7740"
mode: GRACEFUL
new_leader_uuid: "08100eb76c5a4fbd97f5a0b81c40f75d"
 from {username='slave'} at 127.0.0.1:36640
I20260709 13:04:02.527067 18919 raft_consensus.cc:606] T 1109aee81b854cdcbac189f499fb0912 P c611bf5baef04660ada573aaf2ae7740 [term 1 LEADER]: Received request to transfer leadership to TS 08100eb76c5a4fbd97f5a0b81c40f75d
I20260709 13:04:02.530119 18919 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "635268a9733742f3aa2abc8ce5779d9f"
dest_uuid: "c611bf5baef04660ada573aaf2ae7740"
mode: GRACEFUL
new_leader_uuid: "99b9b6a915a94310ba479b4d3ee7c966"
 from {username='slave'} at 127.0.0.1:36640
I20260709 13:04:02.530640 18919 raft_consensus.cc:606] T 635268a9733742f3aa2abc8ce5779d9f P c611bf5baef04660ada573aaf2ae7740 [term 3 LEADER]: Received request to transfer leadership to TS 99b9b6a915a94310ba479b4d3ee7c966
I20260709 13:04:02.532861 18919 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b190be4cf1684677b783edcb8f9ae128"
dest_uuid: "c611bf5baef04660ada573aaf2ae7740"
mode: GRACEFUL
new_leader_uuid: "08100eb76c5a4fbd97f5a0b81c40f75d"
 from {username='slave'} at 127.0.0.1:36640
I20260709 13:04:02.533330 18919 raft_consensus.cc:606] T b190be4cf1684677b783edcb8f9ae128 P c611bf5baef04660ada573aaf2ae7740 [term 3 LEADER]: Received request to transfer leadership to TS 08100eb76c5a4fbd97f5a0b81c40f75d
I20260709 13:04:02.535753 18919 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c6c129816ac441a8bef29b84b78b791e"
dest_uuid: "c611bf5baef04660ada573aaf2ae7740"
mode: GRACEFUL
new_leader_uuid: "99b9b6a915a94310ba479b4d3ee7c966"
 from {username='slave'} at 127.0.0.1:36640
I20260709 13:04:02.536259 18919 raft_consensus.cc:606] T c6c129816ac441a8bef29b84b78b791e P c611bf5baef04660ada573aaf2ae7740 [term 3 LEADER]: Received request to transfer leadership to TS 99b9b6a915a94310ba479b4d3ee7c966
I20260709 13:04:02.537112 18300 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 4
I20260709 13:04:02.537576 18300 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:04:02.585115 19116 raft_consensus.cc:993] T b190be4cf1684677b783edcb8f9ae128 P c611bf5baef04660ada573aaf2ae7740: : Instructing follower 08100eb76c5a4fbd97f5a0b81c40f75d to start an election
I20260709 13:04:02.585644 19258 raft_consensus.cc:1081] T b190be4cf1684677b783edcb8f9ae128 P c611bf5baef04660ada573aaf2ae7740 [term 3 LEADER]: Signalling peer 08100eb76c5a4fbd97f5a0b81c40f75d to start an election
I20260709 13:04:02.587239 18995 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b190be4cf1684677b783edcb8f9ae128"
dest_uuid: "08100eb76c5a4fbd97f5a0b81c40f75d"
 from {username='slave'} at 127.0.0.1:48710
I20260709 13:04:02.587739 18995 raft_consensus.cc:493] T b190be4cf1684677b783edcb8f9ae128 P 08100eb76c5a4fbd97f5a0b81c40f75d [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:04:02.588076 18995 raft_consensus.cc:3060] T b190be4cf1684677b783edcb8f9ae128 P 08100eb76c5a4fbd97f5a0b81c40f75d [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:04:02.593360 18995 raft_consensus.cc:515] T b190be4cf1684677b783edcb8f9ae128 P 08100eb76c5a4fbd97f5a0b81c40f75d [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c611bf5baef04660ada573aaf2ae7740" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 46065 } } peers { permanent_uuid: "08100eb76c5a4fbd97f5a0b81c40f75d" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 37843 } } peers { permanent_uuid: "99b9b6a915a94310ba479b4d3ee7c966" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36031 } }
I20260709 13:04:02.595109 18995 leader_election.cc:290] T b190be4cf1684677b783edcb8f9ae128 P 08100eb76c5a4fbd97f5a0b81c40f75d [CANDIDATE]: Term 4 election: Requested vote from peers c611bf5baef04660ada573aaf2ae7740 (127.17.223.1:46065), 99b9b6a915a94310ba479b4d3ee7c966 (127.17.223.3:36031)
I20260709 13:04:02.596016 18919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b190be4cf1684677b783edcb8f9ae128" candidate_uuid: "08100eb76c5a4fbd97f5a0b81c40f75d" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "c611bf5baef04660ada573aaf2ae7740"
I20260709 13:04:02.596280 19069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b190be4cf1684677b783edcb8f9ae128" candidate_uuid: "08100eb76c5a4fbd97f5a0b81c40f75d" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "99b9b6a915a94310ba479b4d3ee7c966"
I20260709 13:04:02.596765 18919 raft_consensus.cc:3055] T b190be4cf1684677b783edcb8f9ae128 P c611bf5baef04660ada573aaf2ae7740 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:04:02.596836 19069 raft_consensus.cc:3060] T b190be4cf1684677b783edcb8f9ae128 P 99b9b6a915a94310ba479b4d3ee7c966 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:04:02.597019 18919 raft_consensus.cc:740] T b190be4cf1684677b783edcb8f9ae128 P c611bf5baef04660ada573aaf2ae7740 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: c611bf5baef04660ada573aaf2ae7740, State: Running, Role: LEADER
I20260709 13:04:02.597707 18919 consensus_queue.cc:260] T b190be4cf1684677b783edcb8f9ae128 P c611bf5baef04660ada573aaf2ae7740 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c611bf5baef04660ada573aaf2ae7740" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 46065 } } peers { permanent_uuid: "08100eb76c5a4fbd97f5a0b81c40f75d" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 37843 } } peers { permanent_uuid: "99b9b6a915a94310ba479b4d3ee7c966" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36031 } }
I20260709 13:04:02.598781 18919 raft_consensus.cc:3060] T b190be4cf1684677b783edcb8f9ae128 P c611bf5baef04660ada573aaf2ae7740 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:04:02.601946 19069 raft_consensus.cc:2468] T b190be4cf1684677b783edcb8f9ae128 P 99b9b6a915a94310ba479b4d3ee7c966 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 08100eb76c5a4fbd97f5a0b81c40f75d in term 4.
I20260709 13:04:02.603013 18919 raft_consensus.cc:2468] T b190be4cf1684677b783edcb8f9ae128 P c611bf5baef04660ada573aaf2ae7740 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 08100eb76c5a4fbd97f5a0b81c40f75d in term 4.
I20260709 13:04:02.603202 18961 leader_election.cc:304] T b190be4cf1684677b783edcb8f9ae128 P 08100eb76c5a4fbd97f5a0b81c40f75d [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 08100eb76c5a4fbd97f5a0b81c40f75d, 99b9b6a915a94310ba479b4d3ee7c966; no voters: 
I20260709 13:04:02.604136 19169 raft_consensus.cc:2804] T b190be4cf1684677b783edcb8f9ae128 P 08100eb76c5a4fbd97f5a0b81c40f75d [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:04:02.604861 19169 raft_consensus.cc:697] T b190be4cf1684677b783edcb8f9ae128 P 08100eb76c5a4fbd97f5a0b81c40f75d [term 4 LEADER]: Becoming Leader. State: Replica: 08100eb76c5a4fbd97f5a0b81c40f75d, State: Running, Role: LEADER
I20260709 13:04:02.605636 19169 consensus_queue.cc:237] T b190be4cf1684677b783edcb8f9ae128 P 08100eb76c5a4fbd97f5a0b81c40f75d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c611bf5baef04660ada573aaf2ae7740" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 46065 } } peers { permanent_uuid: "08100eb76c5a4fbd97f5a0b81c40f75d" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 37843 } } peers { permanent_uuid: "99b9b6a915a94310ba479b4d3ee7c966" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36031 } }
I20260709 13:04:02.612332 18818 catalog_manager.cc:5697] T b190be4cf1684677b783edcb8f9ae128 P 08100eb76c5a4fbd97f5a0b81c40f75d reported cstate change: term changed from 3 to 4, leader changed from c611bf5baef04660ada573aaf2ae7740 (127.17.223.1) to 08100eb76c5a4fbd97f5a0b81c40f75d (127.17.223.2). New cstate: current_term: 4 leader_uuid: "08100eb76c5a4fbd97f5a0b81c40f75d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c611bf5baef04660ada573aaf2ae7740" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 46065 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "08100eb76c5a4fbd97f5a0b81c40f75d" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 37843 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "99b9b6a915a94310ba479b4d3ee7c966" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36031 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:02.769666 19116 raft_consensus.cc:993] T 1109aee81b854cdcbac189f499fb0912 P c611bf5baef04660ada573aaf2ae7740: : Instructing follower 08100eb76c5a4fbd97f5a0b81c40f75d to start an election
I20260709 13:04:02.770053 19116 raft_consensus.cc:1081] T 1109aee81b854cdcbac189f499fb0912 P c611bf5baef04660ada573aaf2ae7740 [term 1 LEADER]: Signalling peer 08100eb76c5a4fbd97f5a0b81c40f75d to start an election
I20260709 13:04:02.771286 18995 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "1109aee81b854cdcbac189f499fb0912"
dest_uuid: "08100eb76c5a4fbd97f5a0b81c40f75d"
 from {username='slave'} at 127.0.0.1:48710
I20260709 13:04:02.771736 18995 raft_consensus.cc:493] T 1109aee81b854cdcbac189f499fb0912 P 08100eb76c5a4fbd97f5a0b81c40f75d [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:04:02.772037 18995 raft_consensus.cc:3060] T 1109aee81b854cdcbac189f499fb0912 P 08100eb76c5a4fbd97f5a0b81c40f75d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:02.776516 18995 raft_consensus.cc:515] T 1109aee81b854cdcbac189f499fb0912 P 08100eb76c5a4fbd97f5a0b81c40f75d [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c611bf5baef04660ada573aaf2ae7740" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 46065 } } peers { permanent_uuid: "08100eb76c5a4fbd97f5a0b81c40f75d" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 37843 } } peers { permanent_uuid: "99b9b6a915a94310ba479b4d3ee7c966" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36031 } }
I20260709 13:04:02.778029 18995 leader_election.cc:290] T 1109aee81b854cdcbac189f499fb0912 P 08100eb76c5a4fbd97f5a0b81c40f75d [CANDIDATE]: Term 2 election: Requested vote from peers c611bf5baef04660ada573aaf2ae7740 (127.17.223.1:46065), 99b9b6a915a94310ba479b4d3ee7c966 (127.17.223.3:36031)
I20260709 13:04:02.778883 18919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1109aee81b854cdcbac189f499fb0912" candidate_uuid: "08100eb76c5a4fbd97f5a0b81c40f75d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c611bf5baef04660ada573aaf2ae7740"
I20260709 13:04:02.779060 19069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1109aee81b854cdcbac189f499fb0912" candidate_uuid: "08100eb76c5a4fbd97f5a0b81c40f75d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "99b9b6a915a94310ba479b4d3ee7c966"
I20260709 13:04:02.779353 18919 raft_consensus.cc:3055] T 1109aee81b854cdcbac189f499fb0912 P c611bf5baef04660ada573aaf2ae7740 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:04:02.779597 19069 raft_consensus.cc:3060] T 1109aee81b854cdcbac189f499fb0912 P 99b9b6a915a94310ba479b4d3ee7c966 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:02.779745 18919 raft_consensus.cc:740] T 1109aee81b854cdcbac189f499fb0912 P c611bf5baef04660ada573aaf2ae7740 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c611bf5baef04660ada573aaf2ae7740, State: Running, Role: LEADER
I20260709 13:04:02.780508 18919 consensus_queue.cc:260] T 1109aee81b854cdcbac189f499fb0912 P c611bf5baef04660ada573aaf2ae7740 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c611bf5baef04660ada573aaf2ae7740" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 46065 } } peers { permanent_uuid: "08100eb76c5a4fbd97f5a0b81c40f75d" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 37843 } } peers { permanent_uuid: "99b9b6a915a94310ba479b4d3ee7c966" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36031 } }
I20260709 13:04:02.781334 18919 raft_consensus.cc:3060] T 1109aee81b854cdcbac189f499fb0912 P c611bf5baef04660ada573aaf2ae7740 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:02.784211 19069 raft_consensus.cc:2468] T 1109aee81b854cdcbac189f499fb0912 P 99b9b6a915a94310ba479b4d3ee7c966 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 08100eb76c5a4fbd97f5a0b81c40f75d in term 2.
I20260709 13:04:02.785212 18961 leader_election.cc:304] T 1109aee81b854cdcbac189f499fb0912 P 08100eb76c5a4fbd97f5a0b81c40f75d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 08100eb76c5a4fbd97f5a0b81c40f75d, 99b9b6a915a94310ba479b4d3ee7c966; no voters: 
I20260709 13:04:02.785494 18919 raft_consensus.cc:2468] T 1109aee81b854cdcbac189f499fb0912 P c611bf5baef04660ada573aaf2ae7740 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 08100eb76c5a4fbd97f5a0b81c40f75d in term 2.
I20260709 13:04:02.785921 19169 raft_consensus.cc:2804] T 1109aee81b854cdcbac189f499fb0912 P 08100eb76c5a4fbd97f5a0b81c40f75d [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:04:02.786403 19169 raft_consensus.cc:697] T 1109aee81b854cdcbac189f499fb0912 P 08100eb76c5a4fbd97f5a0b81c40f75d [term 2 LEADER]: Becoming Leader. State: Replica: 08100eb76c5a4fbd97f5a0b81c40f75d, State: Running, Role: LEADER
I20260709 13:04:02.787210 19169 consensus_queue.cc:237] T 1109aee81b854cdcbac189f499fb0912 P 08100eb76c5a4fbd97f5a0b81c40f75d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c611bf5baef04660ada573aaf2ae7740" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 46065 } } peers { permanent_uuid: "08100eb76c5a4fbd97f5a0b81c40f75d" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 37843 } } peers { permanent_uuid: "99b9b6a915a94310ba479b4d3ee7c966" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36031 } }
I20260709 13:04:02.793817 18818 catalog_manager.cc:5697] T 1109aee81b854cdcbac189f499fb0912 P 08100eb76c5a4fbd97f5a0b81c40f75d reported cstate change: term changed from 1 to 2, leader changed from c611bf5baef04660ada573aaf2ae7740 (127.17.223.1) to 08100eb76c5a4fbd97f5a0b81c40f75d (127.17.223.2). New cstate: current_term: 2 leader_uuid: "08100eb76c5a4fbd97f5a0b81c40f75d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c611bf5baef04660ada573aaf2ae7740" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 46065 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "08100eb76c5a4fbd97f5a0b81c40f75d" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 37843 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "99b9b6a915a94310ba479b4d3ee7c966" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36031 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:02.883196 19116 raft_consensus.cc:993] T 635268a9733742f3aa2abc8ce5779d9f P c611bf5baef04660ada573aaf2ae7740: : Instructing follower 99b9b6a915a94310ba479b4d3ee7c966 to start an election
I20260709 13:04:02.883613 19258 raft_consensus.cc:1081] T 635268a9733742f3aa2abc8ce5779d9f P c611bf5baef04660ada573aaf2ae7740 [term 3 LEADER]: Signalling peer 99b9b6a915a94310ba479b4d3ee7c966 to start an election
I20260709 13:04:02.884831 19069 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "635268a9733742f3aa2abc8ce5779d9f"
dest_uuid: "99b9b6a915a94310ba479b4d3ee7c966"
 from {username='slave'} at 127.0.0.1:50600
I20260709 13:04:02.885290 19069 raft_consensus.cc:493] T 635268a9733742f3aa2abc8ce5779d9f P 99b9b6a915a94310ba479b4d3ee7c966 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:04:02.885577 19069 raft_consensus.cc:3060] T 635268a9733742f3aa2abc8ce5779d9f P 99b9b6a915a94310ba479b4d3ee7c966 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:04:02.889883 19069 raft_consensus.cc:515] T 635268a9733742f3aa2abc8ce5779d9f P 99b9b6a915a94310ba479b4d3ee7c966 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c611bf5baef04660ada573aaf2ae7740" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 46065 } } peers { permanent_uuid: "08100eb76c5a4fbd97f5a0b81c40f75d" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 37843 } } peers { permanent_uuid: "99b9b6a915a94310ba479b4d3ee7c966" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36031 } }
I20260709 13:04:02.891690 19069 leader_election.cc:290] T 635268a9733742f3aa2abc8ce5779d9f P 99b9b6a915a94310ba479b4d3ee7c966 [CANDIDATE]: Term 4 election: Requested vote from peers c611bf5baef04660ada573aaf2ae7740 (127.17.223.1:46065), 08100eb76c5a4fbd97f5a0b81c40f75d (127.17.223.2:37843)
I20260709 13:04:02.892406 18919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "635268a9733742f3aa2abc8ce5779d9f" candidate_uuid: "99b9b6a915a94310ba479b4d3ee7c966" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "c611bf5baef04660ada573aaf2ae7740"
I20260709 13:04:02.892889 18919 raft_consensus.cc:3055] T 635268a9733742f3aa2abc8ce5779d9f P c611bf5baef04660ada573aaf2ae7740 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:04:02.892838 18995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "635268a9733742f3aa2abc8ce5779d9f" candidate_uuid: "99b9b6a915a94310ba479b4d3ee7c966" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "08100eb76c5a4fbd97f5a0b81c40f75d"
I20260709 13:04:02.893325 18919 raft_consensus.cc:740] T 635268a9733742f3aa2abc8ce5779d9f P c611bf5baef04660ada573aaf2ae7740 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: c611bf5baef04660ada573aaf2ae7740, State: Running, Role: LEADER
I20260709 13:04:02.893575 18995 raft_consensus.cc:3060] T 635268a9733742f3aa2abc8ce5779d9f P 08100eb76c5a4fbd97f5a0b81c40f75d [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:04:02.894064 18919 consensus_queue.cc:260] T 635268a9733742f3aa2abc8ce5779d9f P c611bf5baef04660ada573aaf2ae7740 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c611bf5baef04660ada573aaf2ae7740" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 46065 } } peers { permanent_uuid: "08100eb76c5a4fbd97f5a0b81c40f75d" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 37843 } } peers { permanent_uuid: "99b9b6a915a94310ba479b4d3ee7c966" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36031 } }
I20260709 13:04:02.894953 18919 raft_consensus.cc:3060] T 635268a9733742f3aa2abc8ce5779d9f P c611bf5baef04660ada573aaf2ae7740 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:04:02.898777 18919 raft_consensus.cc:2468] T 635268a9733742f3aa2abc8ce5779d9f P c611bf5baef04660ada573aaf2ae7740 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 99b9b6a915a94310ba479b4d3ee7c966 in term 4.
I20260709 13:04:02.898962 18995 raft_consensus.cc:2468] T 635268a9733742f3aa2abc8ce5779d9f P 08100eb76c5a4fbd97f5a0b81c40f75d [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 99b9b6a915a94310ba479b4d3ee7c966 in term 4.
I20260709 13:04:02.899791 19032 leader_election.cc:304] T 635268a9733742f3aa2abc8ce5779d9f P 99b9b6a915a94310ba479b4d3ee7c966 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 99b9b6a915a94310ba479b4d3ee7c966, c611bf5baef04660ada573aaf2ae7740; no voters: 
I20260709 13:04:02.900708 19219 raft_consensus.cc:2804] T 635268a9733742f3aa2abc8ce5779d9f P 99b9b6a915a94310ba479b4d3ee7c966 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:04:02.901657 19219 raft_consensus.cc:697] T 635268a9733742f3aa2abc8ce5779d9f P 99b9b6a915a94310ba479b4d3ee7c966 [term 4 LEADER]: Becoming Leader. State: Replica: 99b9b6a915a94310ba479b4d3ee7c966, State: Running, Role: LEADER
I20260709 13:04:02.902521 19219 consensus_queue.cc:237] T 635268a9733742f3aa2abc8ce5779d9f P 99b9b6a915a94310ba479b4d3ee7c966 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c611bf5baef04660ada573aaf2ae7740" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 46065 } } peers { permanent_uuid: "08100eb76c5a4fbd97f5a0b81c40f75d" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 37843 } } peers { permanent_uuid: "99b9b6a915a94310ba479b4d3ee7c966" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36031 } }
I20260709 13:04:02.909284 18818 catalog_manager.cc:5697] T 635268a9733742f3aa2abc8ce5779d9f P 99b9b6a915a94310ba479b4d3ee7c966 reported cstate change: term changed from 3 to 4, leader changed from c611bf5baef04660ada573aaf2ae7740 (127.17.223.1) to 99b9b6a915a94310ba479b4d3ee7c966 (127.17.223.3). New cstate: current_term: 4 leader_uuid: "99b9b6a915a94310ba479b4d3ee7c966" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c611bf5baef04660ada573aaf2ae7740" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 46065 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "08100eb76c5a4fbd97f5a0b81c40f75d" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 37843 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "99b9b6a915a94310ba479b4d3ee7c966" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36031 } health_report { overall_health: HEALTHY } } }
I20260709 13:04:03.087797 19116 raft_consensus.cc:993] T c6c129816ac441a8bef29b84b78b791e P c611bf5baef04660ada573aaf2ae7740: : Instructing follower 99b9b6a915a94310ba479b4d3ee7c966 to start an election
I20260709 13:04:03.088208 19258 raft_consensus.cc:1081] T c6c129816ac441a8bef29b84b78b791e P c611bf5baef04660ada573aaf2ae7740 [term 3 LEADER]: Signalling peer 99b9b6a915a94310ba479b4d3ee7c966 to start an election
I20260709 13:04:03.089632 19067 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c6c129816ac441a8bef29b84b78b791e"
dest_uuid: "99b9b6a915a94310ba479b4d3ee7c966"
 from {username='slave'} at 127.0.0.1:50600
I20260709 13:04:03.090054 19067 raft_consensus.cc:493] T c6c129816ac441a8bef29b84b78b791e P 99b9b6a915a94310ba479b4d3ee7c966 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:04:03.090271 19067 raft_consensus.cc:3060] T c6c129816ac441a8bef29b84b78b791e P 99b9b6a915a94310ba479b4d3ee7c966 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:04:03.094525 19067 raft_consensus.cc:515] T c6c129816ac441a8bef29b84b78b791e P 99b9b6a915a94310ba479b4d3ee7c966 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c611bf5baef04660ada573aaf2ae7740" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 46065 } } peers { permanent_uuid: "08100eb76c5a4fbd97f5a0b81c40f75d" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 37843 } } peers { permanent_uuid: "99b9b6a915a94310ba479b4d3ee7c966" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36031 } }
I20260709 13:04:03.095963 19067 leader_election.cc:290] T c6c129816ac441a8bef29b84b78b791e P 99b9b6a915a94310ba479b4d3ee7c966 [CANDIDATE]: Term 4 election: Requested vote from peers c611bf5baef04660ada573aaf2ae7740 (127.17.223.1:46065), 08100eb76c5a4fbd97f5a0b81c40f75d (127.17.223.2:37843)
I20260709 13:04:03.096796 18919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6c129816ac441a8bef29b84b78b791e" candidate_uuid: "99b9b6a915a94310ba479b4d3ee7c966" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: true dest_uuid: "c611bf5baef04660ada573aaf2ae7740"
I20260709 13:04:03.096920 18995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6c129816ac441a8bef29b84b78b791e" candidate_uuid: "99b9b6a915a94310ba479b4d3ee7c966" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: true dest_uuid: "08100eb76c5a4fbd97f5a0b81c40f75d"
I20260709 13:04:03.097430 18995 raft_consensus.cc:3060] T c6c129816ac441a8bef29b84b78b791e P 08100eb76c5a4fbd97f5a0b81c40f75d [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:04:03.097409 18919 raft_consensus.cc:3055] T c6c129816ac441a8bef29b84b78b791e P c611bf5baef04660ada573aaf2ae7740 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:04:03.097978 18919 raft_consensus.cc:740] T c6c129816ac441a8bef29b84b78b791e P c611bf5baef04660ada573aaf2ae7740 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: c611bf5baef04660ada573aaf2ae7740, State: Running, Role: LEADER
I20260709 13:04:03.098695 18919 consensus_queue.cc:260] T c6c129816ac441a8bef29b84b78b791e P c611bf5baef04660ada573aaf2ae7740 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c611bf5baef04660ada573aaf2ae7740" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 46065 } } peers { permanent_uuid: "08100eb76c5a4fbd97f5a0b81c40f75d" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 37843 } } peers { permanent_uuid: "99b9b6a915a94310ba479b4d3ee7c966" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36031 } }
I20260709 13:04:03.099542 18919 raft_consensus.cc:3060] T c6c129816ac441a8bef29b84b78b791e P c611bf5baef04660ada573aaf2ae7740 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:04:03.102227 18995 raft_consensus.cc:2468] T c6c129816ac441a8bef29b84b78b791e P 08100eb76c5a4fbd97f5a0b81c40f75d [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 99b9b6a915a94310ba479b4d3ee7c966 in term 4.
I20260709 13:04:03.103421 19034 leader_election.cc:304] T c6c129816ac441a8bef29b84b78b791e P 99b9b6a915a94310ba479b4d3ee7c966 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 08100eb76c5a4fbd97f5a0b81c40f75d, 99b9b6a915a94310ba479b4d3ee7c966; no voters: 
I20260709 13:04:03.103955 18919 raft_consensus.cc:2468] T c6c129816ac441a8bef29b84b78b791e P c611bf5baef04660ada573aaf2ae7740 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 99b9b6a915a94310ba479b4d3ee7c966 in term 4.
I20260709 13:04:03.104208 19219 raft_consensus.cc:2804] T c6c129816ac441a8bef29b84b78b791e P 99b9b6a915a94310ba479b4d3ee7c966 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:04:03.104704 19219 raft_consensus.cc:697] T c6c129816ac441a8bef29b84b78b791e P 99b9b6a915a94310ba479b4d3ee7c966 [term 4 LEADER]: Becoming Leader. State: Replica: 99b9b6a915a94310ba479b4d3ee7c966, State: Running, Role: LEADER
I20260709 13:04:03.105525 19219 consensus_queue.cc:237] T c6c129816ac441a8bef29b84b78b791e P 99b9b6a915a94310ba479b4d3ee7c966 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c611bf5baef04660ada573aaf2ae7740" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 46065 } } peers { permanent_uuid: "08100eb76c5a4fbd97f5a0b81c40f75d" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 37843 } } peers { permanent_uuid: "99b9b6a915a94310ba479b4d3ee7c966" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36031 } }
I20260709 13:04:03.111630 18818 catalog_manager.cc:5697] T c6c129816ac441a8bef29b84b78b791e P 99b9b6a915a94310ba479b4d3ee7c966 reported cstate change: term changed from 3 to 4, leader changed from c611bf5baef04660ada573aaf2ae7740 (127.17.223.1) to 99b9b6a915a94310ba479b4d3ee7c966 (127.17.223.3). New cstate: current_term: 4 leader_uuid: "99b9b6a915a94310ba479b4d3ee7c966" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c611bf5baef04660ada573aaf2ae7740" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 46065 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "08100eb76c5a4fbd97f5a0b81c40f75d" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 37843 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "99b9b6a915a94310ba479b4d3ee7c966" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36031 } health_report { overall_health: HEALTHY } } }
I20260709 13:04:03.182902 18919 raft_consensus.cc:1275] T 1109aee81b854cdcbac189f499fb0912 P c611bf5baef04660ada573aaf2ae7740 [term 2 FOLLOWER]: Refusing update from remote peer 08100eb76c5a4fbd97f5a0b81c40f75d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:03.184042 19169 consensus_queue.cc:1048] T 1109aee81b854cdcbac189f499fb0912 P 08100eb76c5a4fbd97f5a0b81c40f75d [LEADER]: Connected to new peer: Peer: permanent_uuid: "c611bf5baef04660ada573aaf2ae7740" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 46065 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:04:03.195858 19067 raft_consensus.cc:1275] T 1109aee81b854cdcbac189f499fb0912 P 99b9b6a915a94310ba479b4d3ee7c966 [term 2 FOLLOWER]: Refusing update from remote peer 08100eb76c5a4fbd97f5a0b81c40f75d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:03.197295 19169 consensus_queue.cc:1048] T 1109aee81b854cdcbac189f499fb0912 P 08100eb76c5a4fbd97f5a0b81c40f75d [LEADER]: Connected to new peer: Peer: permanent_uuid: "99b9b6a915a94310ba479b4d3ee7c966" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36031 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:04:03.209017 19067 raft_consensus.cc:1275] T b190be4cf1684677b783edcb8f9ae128 P 99b9b6a915a94310ba479b4d3ee7c966 [term 4 FOLLOWER]: Refusing update from remote peer 08100eb76c5a4fbd97f5a0b81c40f75d: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:04:03.210348 19169 consensus_queue.cc:1048] T b190be4cf1684677b783edcb8f9ae128 P 08100eb76c5a4fbd97f5a0b81c40f75d [LEADER]: Connected to new peer: Peer: permanent_uuid: "99b9b6a915a94310ba479b4d3ee7c966" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36031 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:04:03.214645 18919 raft_consensus.cc:1275] T b190be4cf1684677b783edcb8f9ae128 P c611bf5baef04660ada573aaf2ae7740 [term 4 FOLLOWER]: Refusing update from remote peer 08100eb76c5a4fbd97f5a0b81c40f75d: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:04:03.215881 19169 consensus_queue.cc:1048] T b190be4cf1684677b783edcb8f9ae128 P 08100eb76c5a4fbd97f5a0b81c40f75d [LEADER]: Connected to new peer: Peer: permanent_uuid: "c611bf5baef04660ada573aaf2ae7740" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 46065 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:04:03.389235 18995 raft_consensus.cc:1275] T 635268a9733742f3aa2abc8ce5779d9f P 08100eb76c5a4fbd97f5a0b81c40f75d [term 4 FOLLOWER]: Refusing update from remote peer 99b9b6a915a94310ba479b4d3ee7c966: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:04:03.390463 19219 consensus_queue.cc:1048] T 635268a9733742f3aa2abc8ce5779d9f P 99b9b6a915a94310ba479b4d3ee7c966 [LEADER]: Connected to new peer: Peer: permanent_uuid: "08100eb76c5a4fbd97f5a0b81c40f75d" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 37843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:04:03.400193 18920 raft_consensus.cc:1275] T 635268a9733742f3aa2abc8ce5779d9f P c611bf5baef04660ada573aaf2ae7740 [term 4 FOLLOWER]: Refusing update from remote peer 99b9b6a915a94310ba479b4d3ee7c966: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:04:03.401588 19279 consensus_queue.cc:1048] T 635268a9733742f3aa2abc8ce5779d9f P 99b9b6a915a94310ba479b4d3ee7c966 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c611bf5baef04660ada573aaf2ae7740" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 46065 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:04:03.538441 18300 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:04:03.544683 18300 tablet_server.cc:179] TabletServer@127.17.223.1:0 shutting down...
I20260709 13:04:03.569060 18300 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:04:03.569921 18300 tablet_replica.cc:333] T f1e8623946e9415991e70fecebc84607 P c611bf5baef04660ada573aaf2ae7740: stopping tablet replica
I20260709 13:04:03.570505 18300 raft_consensus.cc:2243] T f1e8623946e9415991e70fecebc84607 P c611bf5baef04660ada573aaf2ae7740 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:03.571071 18300 raft_consensus.cc:2272] T f1e8623946e9415991e70fecebc84607 P c611bf5baef04660ada573aaf2ae7740 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:03.572897 18300 tablet_replica.cc:333] T 4c9ffc27fdd54b68bb2d8e2e229ae923 P c611bf5baef04660ada573aaf2ae7740: stopping tablet replica
I20260709 13:04:03.573414 18300 raft_consensus.cc:2243] T 4c9ffc27fdd54b68bb2d8e2e229ae923 P c611bf5baef04660ada573aaf2ae7740 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:03.573833 18300 raft_consensus.cc:2272] T 4c9ffc27fdd54b68bb2d8e2e229ae923 P c611bf5baef04660ada573aaf2ae7740 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:03.575433 18300 tablet_replica.cc:333] T 635268a9733742f3aa2abc8ce5779d9f P c611bf5baef04660ada573aaf2ae7740: stopping tablet replica
I20260709 13:04:03.575929 18300 raft_consensus.cc:2243] T 635268a9733742f3aa2abc8ce5779d9f P c611bf5baef04660ada573aaf2ae7740 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:03.576323 18300 raft_consensus.cc:2272] T 635268a9733742f3aa2abc8ce5779d9f P c611bf5baef04660ada573aaf2ae7740 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:03.578276 18300 tablet_replica.cc:333] T 382fc7fe4d2e47af99f993423be05a77 P c611bf5baef04660ada573aaf2ae7740: stopping tablet replica
I20260709 13:04:03.578867 18300 raft_consensus.cc:2243] T 382fc7fe4d2e47af99f993423be05a77 P c611bf5baef04660ada573aaf2ae7740 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:04:03.579569 18300 raft_consensus.cc:2272] T 382fc7fe4d2e47af99f993423be05a77 P c611bf5baef04660ada573aaf2ae7740 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:03.581120 18300 tablet_replica.cc:333] T a8c3aa064aaa42b5b251eab220ab5e44 P c611bf5baef04660ada573aaf2ae7740: stopping tablet replica
I20260709 13:04:03.581602 18300 raft_consensus.cc:2243] T a8c3aa064aaa42b5b251eab220ab5e44 P c611bf5baef04660ada573aaf2ae7740 [term 4 LEADER]: Raft consensus shutting down.
I20260709 13:04:03.582259 18300 raft_consensus.cc:2272] T a8c3aa064aaa42b5b251eab220ab5e44 P c611bf5baef04660ada573aaf2ae7740 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:03.583945 18300 tablet_replica.cc:333] T 1109aee81b854cdcbac189f499fb0912 P c611bf5baef04660ada573aaf2ae7740: stopping tablet replica
I20260709 13:04:03.584443 18300 raft_consensus.cc:2243] T 1109aee81b854cdcbac189f499fb0912 P c611bf5baef04660ada573aaf2ae7740 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:03.584832 18300 raft_consensus.cc:2272] T 1109aee81b854cdcbac189f499fb0912 P c611bf5baef04660ada573aaf2ae7740 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:03.586843 18300 tablet_replica.cc:333] T b190be4cf1684677b783edcb8f9ae128 P c611bf5baef04660ada573aaf2ae7740: stopping tablet replica
I20260709 13:04:03.587328 18300 raft_consensus.cc:2243] T b190be4cf1684677b783edcb8f9ae128 P c611bf5baef04660ada573aaf2ae7740 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:03.587751 18300 raft_consensus.cc:2272] T b190be4cf1684677b783edcb8f9ae128 P c611bf5baef04660ada573aaf2ae7740 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:03.590121 18300 tablet_replica.cc:333] T 05ab4aa1987a441f8eb5811181a6f1c0 P c611bf5baef04660ada573aaf2ae7740: stopping tablet replica
I20260709 13:04:03.590585 18300 raft_consensus.cc:2243] T 05ab4aa1987a441f8eb5811181a6f1c0 P c611bf5baef04660ada573aaf2ae7740 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:04:03.591289 18300 raft_consensus.cc:2272] T 05ab4aa1987a441f8eb5811181a6f1c0 P c611bf5baef04660ada573aaf2ae7740 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:03.592751 18300 tablet_replica.cc:333] T c6c129816ac441a8bef29b84b78b791e P c611bf5baef04660ada573aaf2ae7740: stopping tablet replica
I20260709 13:04:03.593199 18300 raft_consensus.cc:2243] T c6c129816ac441a8bef29b84b78b791e P c611bf5baef04660ada573aaf2ae7740 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:03.593549 18300 raft_consensus.cc:2272] T c6c129816ac441a8bef29b84b78b791e P c611bf5baef04660ada573aaf2ae7740 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:03.595515 18300 tablet_replica.cc:333] T 7c52a94485bd40e6a022a546c42407b4 P c611bf5baef04660ada573aaf2ae7740: stopping tablet replica
I20260709 13:04:03.595610 18995 raft_consensus.cc:1275] T c6c129816ac441a8bef29b84b78b791e P 08100eb76c5a4fbd97f5a0b81c40f75d [term 4 FOLLOWER]: Refusing update from remote peer 99b9b6a915a94310ba479b4d3ee7c966: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:04:03.596012 18300 raft_consensus.cc:2243] T 7c52a94485bd40e6a022a546c42407b4 P c611bf5baef04660ada573aaf2ae7740 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:04:03.596863 18300 raft_consensus.cc:2272] T 7c52a94485bd40e6a022a546c42407b4 P c611bf5baef04660ada573aaf2ae7740 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:03.596728 19279 consensus_queue.cc:1048] T c6c129816ac441a8bef29b84b78b791e P 99b9b6a915a94310ba479b4d3ee7c966 [LEADER]: Connected to new peer: Peer: permanent_uuid: "08100eb76c5a4fbd97f5a0b81c40f75d" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 37843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
W20260709 13:04:03.605792 19032 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 3 similar messages]
W20260709 13:04:03.610975 19032 consensus_peers.cc:597] T c6c129816ac441a8bef29b84b78b791e P 99b9b6a915a94310ba479b4d3ee7c966 -> Peer c611bf5baef04660ada573aaf2ae7740 (127.17.223.1:46065): Couldn't send request to peer c611bf5baef04660ada573aaf2ae7740. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:03.622189 18300 tablet_server.cc:196] TabletServer@127.17.223.1:0 shutdown complete.
I20260709 13:04:03.641180 18300 tablet_server.cc:179] TabletServer@127.17.223.2:0 shutting down...
I20260709 13:04:03.664392 18300 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:04:03.665058 18300 tablet_replica.cc:333] T 4c9ffc27fdd54b68bb2d8e2e229ae923 P 08100eb76c5a4fbd97f5a0b81c40f75d: stopping tablet replica
I20260709 13:04:03.665634 18300 raft_consensus.cc:2243] T 4c9ffc27fdd54b68bb2d8e2e229ae923 P 08100eb76c5a4fbd97f5a0b81c40f75d [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:03.666283 18300 raft_consensus.cc:2272] T 4c9ffc27fdd54b68bb2d8e2e229ae923 P 08100eb76c5a4fbd97f5a0b81c40f75d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:03.668372 18300 tablet_replica.cc:333] T f1e8623946e9415991e70fecebc84607 P 08100eb76c5a4fbd97f5a0b81c40f75d: stopping tablet replica
I20260709 13:04:03.668879 18300 raft_consensus.cc:2243] T f1e8623946e9415991e70fecebc84607 P 08100eb76c5a4fbd97f5a0b81c40f75d [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:04:03.669674 18300 raft_consensus.cc:2272] T f1e8623946e9415991e70fecebc84607 P 08100eb76c5a4fbd97f5a0b81c40f75d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:03.671396 18300 tablet_replica.cc:333] T 635268a9733742f3aa2abc8ce5779d9f P 08100eb76c5a4fbd97f5a0b81c40f75d: stopping tablet replica
I20260709 13:04:03.671954 18300 raft_consensus.cc:2243] T 635268a9733742f3aa2abc8ce5779d9f P 08100eb76c5a4fbd97f5a0b81c40f75d [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:03.672359 18300 raft_consensus.cc:2272] T 635268a9733742f3aa2abc8ce5779d9f P 08100eb76c5a4fbd97f5a0b81c40f75d [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:03.674104 18300 tablet_replica.cc:333] T b190be4cf1684677b783edcb8f9ae128 P 08100eb76c5a4fbd97f5a0b81c40f75d: stopping tablet replica
I20260709 13:04:03.674597 18300 raft_consensus.cc:2243] T b190be4cf1684677b783edcb8f9ae128 P 08100eb76c5a4fbd97f5a0b81c40f75d [term 4 LEADER]: Raft consensus shutting down.
I20260709 13:04:03.675341 18300 raft_consensus.cc:2272] T b190be4cf1684677b783edcb8f9ae128 P 08100eb76c5a4fbd97f5a0b81c40f75d [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:03.677846 18300 tablet_replica.cc:333] T 1109aee81b854cdcbac189f499fb0912 P 08100eb76c5a4fbd97f5a0b81c40f75d: stopping tablet replica
I20260709 13:04:03.678349 18300 raft_consensus.cc:2243] T 1109aee81b854cdcbac189f499fb0912 P 08100eb76c5a4fbd97f5a0b81c40f75d [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:04:03.679098 18300 raft_consensus.cc:2272] T 1109aee81b854cdcbac189f499fb0912 P 08100eb76c5a4fbd97f5a0b81c40f75d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:03.680869 18300 tablet_replica.cc:333] T 05ab4aa1987a441f8eb5811181a6f1c0 P 08100eb76c5a4fbd97f5a0b81c40f75d: stopping tablet replica
I20260709 13:04:03.681349 18300 raft_consensus.cc:2243] T 05ab4aa1987a441f8eb5811181a6f1c0 P 08100eb76c5a4fbd97f5a0b81c40f75d [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:03.681751 18300 raft_consensus.cc:2272] T 05ab4aa1987a441f8eb5811181a6f1c0 P 08100eb76c5a4fbd97f5a0b81c40f75d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:03.683320 18300 tablet_replica.cc:333] T 7c52a94485bd40e6a022a546c42407b4 P 08100eb76c5a4fbd97f5a0b81c40f75d: stopping tablet replica
I20260709 13:04:03.683786 18300 raft_consensus.cc:2243] T 7c52a94485bd40e6a022a546c42407b4 P 08100eb76c5a4fbd97f5a0b81c40f75d [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:03.684168 18300 raft_consensus.cc:2272] T 7c52a94485bd40e6a022a546c42407b4 P 08100eb76c5a4fbd97f5a0b81c40f75d [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:03.685820 18300 tablet_replica.cc:333] T c6c129816ac441a8bef29b84b78b791e P 08100eb76c5a4fbd97f5a0b81c40f75d: stopping tablet replica
I20260709 13:04:03.686272 18300 raft_consensus.cc:2243] T c6c129816ac441a8bef29b84b78b791e P 08100eb76c5a4fbd97f5a0b81c40f75d [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:03.686658 18300 raft_consensus.cc:2272] T c6c129816ac441a8bef29b84b78b791e P 08100eb76c5a4fbd97f5a0b81c40f75d [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:03.688612 18300 tablet_replica.cc:333] T a8c3aa064aaa42b5b251eab220ab5e44 P 08100eb76c5a4fbd97f5a0b81c40f75d: stopping tablet replica
I20260709 13:04:03.689143 18300 raft_consensus.cc:2243] T a8c3aa064aaa42b5b251eab220ab5e44 P 08100eb76c5a4fbd97f5a0b81c40f75d [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:03.689580 18300 raft_consensus.cc:2272] T a8c3aa064aaa42b5b251eab220ab5e44 P 08100eb76c5a4fbd97f5a0b81c40f75d [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:03.691180 18300 tablet_replica.cc:333] T 382fc7fe4d2e47af99f993423be05a77 P 08100eb76c5a4fbd97f5a0b81c40f75d: stopping tablet replica
I20260709 13:04:03.691606 18300 raft_consensus.cc:2243] T 382fc7fe4d2e47af99f993423be05a77 P 08100eb76c5a4fbd97f5a0b81c40f75d [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:03.692011 18300 raft_consensus.cc:2272] T 382fc7fe4d2e47af99f993423be05a77 P 08100eb76c5a4fbd97f5a0b81c40f75d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:03.718835 18300 tablet_server.cc:196] TabletServer@127.17.223.2:0 shutdown complete.
I20260709 13:04:03.736061 18300 tablet_server.cc:179] TabletServer@127.17.223.3:0 shutting down...
I20260709 13:04:03.756875 18300 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:04:03.757550 18300 tablet_replica.cc:333] T f1e8623946e9415991e70fecebc84607 P 99b9b6a915a94310ba479b4d3ee7c966: stopping tablet replica
I20260709 13:04:03.758368 18300 raft_consensus.cc:2243] T f1e8623946e9415991e70fecebc84607 P 99b9b6a915a94310ba479b4d3ee7c966 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:03.758971 18300 raft_consensus.cc:2272] T f1e8623946e9415991e70fecebc84607 P 99b9b6a915a94310ba479b4d3ee7c966 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:03.761415 18300 tablet_replica.cc:333] T 4c9ffc27fdd54b68bb2d8e2e229ae923 P 99b9b6a915a94310ba479b4d3ee7c966: stopping tablet replica
I20260709 13:04:03.762105 18300 raft_consensus.cc:2243] T 4c9ffc27fdd54b68bb2d8e2e229ae923 P 99b9b6a915a94310ba479b4d3ee7c966 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:04:03.762887 18300 raft_consensus.cc:2272] T 4c9ffc27fdd54b68bb2d8e2e229ae923 P 99b9b6a915a94310ba479b4d3ee7c966 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:03.764592 18300 tablet_replica.cc:333] T b190be4cf1684677b783edcb8f9ae128 P 99b9b6a915a94310ba479b4d3ee7c966: stopping tablet replica
I20260709 13:04:03.765062 18300 raft_consensus.cc:2243] T b190be4cf1684677b783edcb8f9ae128 P 99b9b6a915a94310ba479b4d3ee7c966 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:03.765480 18300 raft_consensus.cc:2272] T b190be4cf1684677b783edcb8f9ae128 P 99b9b6a915a94310ba479b4d3ee7c966 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:03.767377 18300 tablet_replica.cc:333] T 1109aee81b854cdcbac189f499fb0912 P 99b9b6a915a94310ba479b4d3ee7c966: stopping tablet replica
I20260709 13:04:03.767858 18300 raft_consensus.cc:2243] T 1109aee81b854cdcbac189f499fb0912 P 99b9b6a915a94310ba479b4d3ee7c966 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:03.768218 18300 raft_consensus.cc:2272] T 1109aee81b854cdcbac189f499fb0912 P 99b9b6a915a94310ba479b4d3ee7c966 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:03.770807 18300 tablet_replica.cc:333] T 635268a9733742f3aa2abc8ce5779d9f P 99b9b6a915a94310ba479b4d3ee7c966: stopping tablet replica
I20260709 13:04:03.771278 18300 raft_consensus.cc:2243] T 635268a9733742f3aa2abc8ce5779d9f P 99b9b6a915a94310ba479b4d3ee7c966 [term 4 LEADER]: Raft consensus shutting down.
I20260709 13:04:03.772054 18300 raft_consensus.cc:2272] T 635268a9733742f3aa2abc8ce5779d9f P 99b9b6a915a94310ba479b4d3ee7c966 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:03.773890 18300 tablet_replica.cc:333] T 05ab4aa1987a441f8eb5811181a6f1c0 P 99b9b6a915a94310ba479b4d3ee7c966: stopping tablet replica
I20260709 13:04:03.774376 18300 raft_consensus.cc:2243] T 05ab4aa1987a441f8eb5811181a6f1c0 P 99b9b6a915a94310ba479b4d3ee7c966 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:03.774832 18300 raft_consensus.cc:2272] T 05ab4aa1987a441f8eb5811181a6f1c0 P 99b9b6a915a94310ba479b4d3ee7c966 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:03.776289 18300 tablet_replica.cc:333] T 7c52a94485bd40e6a022a546c42407b4 P 99b9b6a915a94310ba479b4d3ee7c966: stopping tablet replica
I20260709 13:04:03.776764 18300 raft_consensus.cc:2243] T 7c52a94485bd40e6a022a546c42407b4 P 99b9b6a915a94310ba479b4d3ee7c966 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:03.777158 18300 raft_consensus.cc:2272] T 7c52a94485bd40e6a022a546c42407b4 P 99b9b6a915a94310ba479b4d3ee7c966 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:03.778777 18300 tablet_replica.cc:333] T c6c129816ac441a8bef29b84b78b791e P 99b9b6a915a94310ba479b4d3ee7c966: stopping tablet replica
I20260709 13:04:03.779223 18300 raft_consensus.cc:2243] T c6c129816ac441a8bef29b84b78b791e P 99b9b6a915a94310ba479b4d3ee7c966 [term 4 LEADER]: Raft consensus shutting down.
I20260709 13:04:03.779889 18300 raft_consensus.cc:2272] T c6c129816ac441a8bef29b84b78b791e P 99b9b6a915a94310ba479b4d3ee7c966 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:03.781692 18300 tablet_replica.cc:333] T 382fc7fe4d2e47af99f993423be05a77 P 99b9b6a915a94310ba479b4d3ee7c966: stopping tablet replica
I20260709 13:04:03.782163 18300 raft_consensus.cc:2243] T 382fc7fe4d2e47af99f993423be05a77 P 99b9b6a915a94310ba479b4d3ee7c966 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:03.782562 18300 raft_consensus.cc:2272] T 382fc7fe4d2e47af99f993423be05a77 P 99b9b6a915a94310ba479b4d3ee7c966 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:03.784297 18300 tablet_replica.cc:333] T a8c3aa064aaa42b5b251eab220ab5e44 P 99b9b6a915a94310ba479b4d3ee7c966: stopping tablet replica
I20260709 13:04:03.784693 18300 raft_consensus.cc:2243] T a8c3aa064aaa42b5b251eab220ab5e44 P 99b9b6a915a94310ba479b4d3ee7c966 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:03.785050 18300 raft_consensus.cc:2272] T a8c3aa064aaa42b5b251eab220ab5e44 P 99b9b6a915a94310ba479b4d3ee7c966 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:03.803984 18300 tablet_server.cc:196] TabletServer@127.17.223.3:0 shutdown complete.
I20260709 13:04:03.821365 18300 master.cc:562] Master@127.17.223.62:37375 shutting down...
I20260709 13:04:03.839915 18300 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 469250a9d73b4634816682ddff6e8418 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:04:03.840391 18300 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 469250a9d73b4634816682ddff6e8418 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:03.840660 18300 tablet_replica.cc:333] T 00000000000000000000000000000000 P 469250a9d73b4634816682ddff6e8418: stopping tablet replica
I20260709 13:04:03.861428 18300 master.cc:584] Master@127.17.223.62:37375 shutdown complete.
08100eb76c5a4fbd97f5a0b81c40f75d  4
99b9b6a915a94310ba479b4d3ee7c966  1
c611bf5baef04660ada573aaf2ae7740  5
[       OK ] LeaderRebalancerTest.FunctionalTestForNotDivided (10658 ms)
[ RUN      ] LeaderRebalancerTest.AddTserver
I20260709 13:04:03.902275 18300 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.17.223.62:36283
I20260709 13:04:03.903503 18300 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:04:03.909044 19284 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:04:03.909126 19285 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:04:03.910063 19287 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:04:03.910229 18300 server_base.cc:1061] running on GCE node
I20260709 13:04:03.911461 18300 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:04:03.911633 18300 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:04:03.911837 18300 hybrid_clock.cc:648] HybridClock initialized: now 1783602243911802 us; error 0 us; skew 500 ppm
I20260709 13:04:03.912371 18300 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:04:03.914637 18300 webserver.cc:533] Webserver started at http://127.17.223.62:36177/ using document root <none> and password file <none>
I20260709 13:04:03.915202 18300 fs_manager.cc:362] Metadata directory not provided
I20260709 13:04:03.915355 18300 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:04:03.915697 18300 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:04:03.916790 18300 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskKd2k48/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602220613947-18300-0/minicluster-data/master-0-root/instance:
uuid: "97750b77d35444acb7791ebf26cc2685"
format_stamp: "Formatted at 2026-07-09 13:04:03 on dist-test-slave-vl1s"
I20260709 13:04:03.921361 18300 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.005s	sys 0.001s
I20260709 13:04:03.924695 19292 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:04:03.925540 18300 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260709 13:04:03.925786 18300 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskKd2k48/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602220613947-18300-0/minicluster-data/master-0-root
uuid: "97750b77d35444acb7791ebf26cc2685"
format_stamp: "Formatted at 2026-07-09 13:04:03 on dist-test-slave-vl1s"
I20260709 13:04:03.926056 18300 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskKd2k48/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602220613947-18300-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskKd2k48/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602220613947-18300-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskKd2k48/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602220613947-18300-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:04:03.938969 18300 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:04:03.940187 18300 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:04:03.977602 18300 rpc_server.cc:307] RPC server started. Bound to: 127.17.223.62:36283
I20260709 13:04:03.977690 19343 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.17.223.62:36283 every 8 connection(s)
I20260709 13:04:03.981698 19344 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:03.991072 19344 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 97750b77d35444acb7791ebf26cc2685: Bootstrap starting.
I20260709 13:04:03.995522 19344 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 97750b77d35444acb7791ebf26cc2685: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:03.999560 19344 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 97750b77d35444acb7791ebf26cc2685: No bootstrap required, opened a new log
I20260709 13:04:04.001605 19344 raft_consensus.cc:359] T 00000000000000000000000000000000 P 97750b77d35444acb7791ebf26cc2685 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "97750b77d35444acb7791ebf26cc2685" member_type: VOTER }
I20260709 13:04:04.001953 19344 raft_consensus.cc:385] T 00000000000000000000000000000000 P 97750b77d35444acb7791ebf26cc2685 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:04.002126 19344 raft_consensus.cc:740] T 00000000000000000000000000000000 P 97750b77d35444acb7791ebf26cc2685 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 97750b77d35444acb7791ebf26cc2685, State: Initialized, Role: FOLLOWER
I20260709 13:04:04.002681 19344 consensus_queue.cc:260] T 00000000000000000000000000000000 P 97750b77d35444acb7791ebf26cc2685 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "97750b77d35444acb7791ebf26cc2685" member_type: VOTER }
I20260709 13:04:04.003088 19344 raft_consensus.cc:399] T 00000000000000000000000000000000 P 97750b77d35444acb7791ebf26cc2685 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 13:04:04.003274 19344 raft_consensus.cc:493] T 00000000000000000000000000000000 P 97750b77d35444acb7791ebf26cc2685 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 13:04:04.003479 19344 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 97750b77d35444acb7791ebf26cc2685 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:04.007385 19344 raft_consensus.cc:515] T 00000000000000000000000000000000 P 97750b77d35444acb7791ebf26cc2685 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "97750b77d35444acb7791ebf26cc2685" member_type: VOTER }
I20260709 13:04:04.007833 19344 leader_election.cc:304] T 00000000000000000000000000000000 P 97750b77d35444acb7791ebf26cc2685 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 97750b77d35444acb7791ebf26cc2685; no voters: 
I20260709 13:04:04.008936 19344 leader_election.cc:290] T 00000000000000000000000000000000 P 97750b77d35444acb7791ebf26cc2685 [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 13:04:04.009389 19347 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 97750b77d35444acb7791ebf26cc2685 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:04.010769 19347 raft_consensus.cc:697] T 00000000000000000000000000000000 P 97750b77d35444acb7791ebf26cc2685 [term 1 LEADER]: Becoming Leader. State: Replica: 97750b77d35444acb7791ebf26cc2685, State: Running, Role: LEADER
I20260709 13:04:04.011377 19347 consensus_queue.cc:237] T 00000000000000000000000000000000 P 97750b77d35444acb7791ebf26cc2685 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "97750b77d35444acb7791ebf26cc2685" member_type: VOTER }
I20260709 13:04:04.011749 19344 sys_catalog.cc:565] T 00000000000000000000000000000000 P 97750b77d35444acb7791ebf26cc2685 [sys.catalog]: configured and running, proceeding with master startup.
I20260709 13:04:04.017268 19348 sys_catalog.cc:455] T 00000000000000000000000000000000 P 97750b77d35444acb7791ebf26cc2685 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "97750b77d35444acb7791ebf26cc2685" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "97750b77d35444acb7791ebf26cc2685" member_type: VOTER } }
I20260709 13:04:04.017580 19349 sys_catalog.cc:455] T 00000000000000000000000000000000 P 97750b77d35444acb7791ebf26cc2685 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 97750b77d35444acb7791ebf26cc2685. Latest consensus state: current_term: 1 leader_uuid: "97750b77d35444acb7791ebf26cc2685" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "97750b77d35444acb7791ebf26cc2685" member_type: VOTER } }
I20260709 13:04:04.018164 19348 sys_catalog.cc:458] T 00000000000000000000000000000000 P 97750b77d35444acb7791ebf26cc2685 [sys.catalog]: This master's current role is: LEADER
I20260709 13:04:04.018391 19349 sys_catalog.cc:458] T 00000000000000000000000000000000 P 97750b77d35444acb7791ebf26cc2685 [sys.catalog]: This master's current role is: LEADER
I20260709 13:04:04.024593 19355 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 13:04:04.029690 19355 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 13:04:04.030769 18300 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 13:04:04.037739 19355 catalog_manager.cc:1383] Generated new cluster ID: 53005f0884b94cfcb483540bf4b32af6
I20260709 13:04:04.038017 19355 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 13:04:04.068740 19355 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 13:04:04.069965 19355 catalog_manager.cc:1540] Loading token signing keys...
I20260709 13:04:04.085462 19355 catalog_manager.cc:6070] T 00000000000000000000000000000000 P 97750b77d35444acb7791ebf26cc2685: Generated new TSK 0
I20260709 13:04:04.086028 19355 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 13:04:04.097760 18300 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:04:04.105487 19365 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:04:04.106814 19366 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:04:04.112311 18300 server_base.cc:1061] running on GCE node
W20260709 13:04:04.114040 19368 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:04:04.115664 18300 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:04:04.116001 18300 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:04:04.116216 18300 hybrid_clock.cc:648] HybridClock initialized: now 1783602244116199 us; error 0 us; skew 500 ppm
I20260709 13:04:04.116991 18300 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:04:04.120188 18300 webserver.cc:533] Webserver started at http://127.17.223.1:35737/ using document root <none> and password file <none>
I20260709 13:04:04.120806 18300 fs_manager.cc:362] Metadata directory not provided
I20260709 13:04:04.121066 18300 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:04:04.121402 18300 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:04:04.123054 18300 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskKd2k48/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602220613947-18300-0/minicluster-data/ts-0-root/instance:
uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
format_stamp: "Formatted at 2026-07-09 13:04:04 on dist-test-slave-vl1s"
I20260709 13:04:04.129739 18300 fs_manager.cc:696] Time spent creating directory manager: real 0.006s	user 0.006s	sys 0.000s
I20260709 13:04:04.133829 19373 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:04:04.134865 18300 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.003s	sys 0.000s
I20260709 13:04:04.135308 18300 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskKd2k48/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602220613947-18300-0/minicluster-data/ts-0-root
uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
format_stamp: "Formatted at 2026-07-09 13:04:04 on dist-test-slave-vl1s"
I20260709 13:04:04.135743 18300 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskKd2k48/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602220613947-18300-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskKd2k48/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602220613947-18300-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskKd2k48/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602220613947-18300-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:04:04.156488 18300 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:04:04.158032 18300 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:04:04.159567 18300 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:04:04.161759 18300 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:04:04.161972 18300 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:04:04.162228 18300 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:04:04.162400 18300 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:04:04.201327 18300 rpc_server.cc:307] RPC server started. Bound to: 127.17.223.1:40321
I20260709 13:04:04.201421 19435 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.17.223.1:40321 every 8 connection(s)
I20260709 13:04:04.206205 18300 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:04:04.212559 19440 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:04:04.214988 19441 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:04:04.216358 18300 server_base.cc:1061] running on GCE node
W20260709 13:04:04.216440 19443 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:04:04.218086 18300 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:04:04.218393 18300 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:04:04.218627 18300 hybrid_clock.cc:648] HybridClock initialized: now 1783602244218606 us; error 0 us; skew 500 ppm
I20260709 13:04:04.219200 18300 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:04:04.219534 19436 heartbeater.cc:344] Connected to a master server at 127.17.223.62:36283
I20260709 13:04:04.219923 19436 heartbeater.cc:461] Registering TS with master...
I20260709 13:04:04.220844 19436 heartbeater.cc:507] Master 127.17.223.62:36283 requested a full tablet report, sending...
I20260709 13:04:04.221832 18300 webserver.cc:533] Webserver started at http://127.17.223.2:45823/ using document root <none> and password file <none>
I20260709 13:04:04.222422 18300 fs_manager.cc:362] Metadata directory not provided
I20260709 13:04:04.222616 18300 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:04:04.222966 18300 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:04:04.223294 19309 ts_manager.cc:194] Registered new tserver with Master: e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321)
I20260709 13:04:04.224160 18300 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskKd2k48/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602220613947-18300-0/minicluster-data/ts-1-root/instance:
uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
format_stamp: "Formatted at 2026-07-09 13:04:04 on dist-test-slave-vl1s"
I20260709 13:04:04.224999 19309 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:44676
I20260709 13:04:04.228753 18300 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.005s	sys 0.000s
I20260709 13:04:04.232133 19448 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:04:04.232919 18300 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260709 13:04:04.233217 18300 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskKd2k48/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602220613947-18300-0/minicluster-data/ts-1-root
uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
format_stamp: "Formatted at 2026-07-09 13:04:04 on dist-test-slave-vl1s"
I20260709 13:04:04.233513 18300 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskKd2k48/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602220613947-18300-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskKd2k48/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602220613947-18300-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskKd2k48/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602220613947-18300-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:04:04.257706 18300 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:04:04.258977 18300 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:04:04.260378 18300 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:04:04.262523 18300 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:04:04.262763 18300 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.001s	sys 0.000s
I20260709 13:04:04.262997 18300 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:04:04.263161 18300 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:04:04.301213 18300 rpc_server.cc:307] RPC server started. Bound to: 127.17.223.2:46257
I20260709 13:04:04.301383 19510 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.17.223.2:46257 every 8 connection(s)
I20260709 13:04:04.305747 18300 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:04:04.311734 19514 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:04:04.314571 19515 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:04:04.315950 18300 server_base.cc:1061] running on GCE node
W20260709 13:04:04.317260 19517 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:04:04.318176 18300 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:04:04.318403 18300 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:04:04.318619 18300 hybrid_clock.cc:648] HybridClock initialized: now 1783602244318598 us; error 0 us; skew 500 ppm
I20260709 13:04:04.318630 19511 heartbeater.cc:344] Connected to a master server at 127.17.223.62:36283
I20260709 13:04:04.319115 19511 heartbeater.cc:461] Registering TS with master...
I20260709 13:04:04.319324 18300 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:04:04.319855 19511 heartbeater.cc:507] Master 127.17.223.62:36283 requested a full tablet report, sending...
I20260709 13:04:04.322001 18300 webserver.cc:533] Webserver started at http://127.17.223.3:42529/ using document root <none> and password file <none>
I20260709 13:04:04.322022 19309 ts_manager.cc:194] Registered new tserver with Master: 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:04:04.322762 18300 fs_manager.cc:362] Metadata directory not provided
I20260709 13:04:04.323004 18300 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:04:04.323271 18300 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:04:04.323721 19309 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:44688
I20260709 13:04:04.324414 18300 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskKd2k48/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602220613947-18300-0/minicluster-data/ts-2-root/instance:
uuid: "e61c3a8f61bb48f8a963c9480e53c168"
format_stamp: "Formatted at 2026-07-09 13:04:04 on dist-test-slave-vl1s"
I20260709 13:04:04.329272 18300 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.006s	sys 0.000s
I20260709 13:04:04.332441 19522 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:04:04.333365 18300 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.001s	sys 0.000s
I20260709 13:04:04.333664 18300 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskKd2k48/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602220613947-18300-0/minicluster-data/ts-2-root
uuid: "e61c3a8f61bb48f8a963c9480e53c168"
format_stamp: "Formatted at 2026-07-09 13:04:04 on dist-test-slave-vl1s"
I20260709 13:04:04.333920 18300 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskKd2k48/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602220613947-18300-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskKd2k48/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602220613947-18300-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskKd2k48/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602220613947-18300-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:04:04.381668 18300 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:04:04.382936 18300 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:04:04.384399 18300 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:04:04.386641 18300 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:04:04.386924 18300 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:04:04.387204 18300 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:04:04.387378 18300 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:04:04.426505 18300 rpc_server.cc:307] RPC server started. Bound to: 127.17.223.3:36891
I20260709 13:04:04.426786 19584 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.17.223.3:36891 every 8 connection(s)
I20260709 13:04:04.441262 19585 heartbeater.cc:344] Connected to a master server at 127.17.223.62:36283
I20260709 13:04:04.441653 19585 heartbeater.cc:461] Registering TS with master...
I20260709 13:04:04.442360 19585 heartbeater.cc:507] Master 127.17.223.62:36283 requested a full tablet report, sending...
I20260709 13:04:04.444404 19309 ts_manager.cc:194] Registered new tserver with Master: e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:04:04.445479 18300 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.015546786s
I20260709 13:04:04.445745 19309 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:44698
I20260709 13:04:04.470088 19309 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44706:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\313c+\002\004\001\000\226\307V\004\004\001\000a+\202\006\004\001\000,\217\255\010\004\001\000\367\362\330\n\004\001\000\302V\004\r\004\001\000\215\272/\017\004\001\000X\036[\021\004\001\000#\202\206\023\004\001\000\356\345\261\025\004\001\000\271I\335\027\004\001\000\204\255\010\032\004\001\000O\0214\034\004\001\000\032u_\036\004\001\000\345\330\212 \004\001\000\260<\266\"\004\001\000{\240\341$\004\001\000F\004\r\'\004\001\000\021h8)\004\001\000\334\313c+\004\001\000\247/\217-\004\001\000r\223\272/\004\001\000=\367\3451\004\001\000\010[\0214\004\001\000\323\276<6\004\001\000\236\"h8\004\001\000i\206\223:\004\001\0004\352\276<\004\001\000\377M\352>\004\001\000\312\261\025A\004\001\000\225\025AC\004\001\000`ylE\004\001\000+\335\227G\004\001\000\366@\303I\004\001\000\301\244\356K\004\001\000\214\010\032N\004\001\000WlEP\004\001\000\"\320pR\004\001\000\3553\234T\004\001\000\270\227\307V\004\001\000\203\373\362X\004\001\000N_\036[\004\001\000\031\303I]\004\001\000\344&u_\004\001\000\257\212\240a\004\001\000z\356\313c\004\001\000ER\367e\004\001\000\020\266\"h\004\001\000\333\031Nj\004\001\000\246}yl\004\001\000q\341\244n\004\001\000<E\320p\004\001\000\007\251\373r\004\001\000\322\014\'u\004\001\000\235pRw\004\001\000h\324}y\004\001\00038\251{\004\001\000\376\233\324}""\004\001\000\313c+\002\004\001\000\226\307V\004\004\001\000a+\202\006\004\001\000,\217\255\010\004\001\000\367\362\330\n\004\001\000\302V\004\r\004\001\000\215\272/\017\004\001\000X\036[\021\004\001\000#\202\206\023\004\001\000\356\345\261\025\004\001\000\271I\335\027\004\001\000\204\255\010\032\004\001\000O\0214\034\004\001\000\032u_\036\004\001\000\345\330\212 \004\001\000\260<\266\"\004\001\000{\240\341$\004\001\000F\004\r\'\004\001\000\021h8)\004\001\000\334\313c+\004\001\000\247/\217-\004\001\000r\223\272/\004\001\000=\367\3451\004\001\000\010[\0214\004\001\000\323\276<6\004\001\000\236\"h8\004\001\000i\206\223:\004\001\0004\352\276<\004\001\000\377M\352>\004\001\000\312\261\025A\004\001\000\225\025AC\004\001\000`ylE\004\001\000+\335\227G\004\001\000\366@\303I\004\001\000\301\244\356K\004\001\000\214\010\032N\004\001\000WlEP\004\001\000\"\320pR\004\001\000\3553\234T\004\001\000\270\227\307V\004\001\000\203\373\362X\004\001\000N_\036[\004\001\000\031\303I]\004\001\000\344&u_\004\001\000\257\212\240a\004\001\000z\356\313c\004\001\000ER\367e\004\001\000\020\266\"h\004\001\000\333\031Nj\004\001\000\246}yl\004\001\000q\341\244n\004\001\000<E\320p\004\001\000\007\251\373r\004\001\000\322\014\'u\004\001\000\235pRw\004\001\000h\324}y\004\001\00038\251{\004\001\000\376\233\324}"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:04:04.475953 19309 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:04:04.665575 19476 tablet_service.cc:1511] Processing CreateTablet for tablet 1f85fc4b527a48848e5faa083b604e36 (DEFAULT_TABLE table=test-workload [id=ce1025c73cf04c4baf25820ae7ff0a53]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 13:04:04.666482 19550 tablet_service.cc:1511] Processing CreateTablet for tablet 1f85fc4b527a48848e5faa083b604e36 (DEFAULT_TABLE table=test-workload [id=ce1025c73cf04c4baf25820ae7ff0a53]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 13:04:04.667063 19476 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1f85fc4b527a48848e5faa083b604e36. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:04.667889 19550 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1f85fc4b527a48848e5faa083b604e36. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:04.668026 19475 tablet_service.cc:1511] Processing CreateTablet for tablet 217b5fae677b4971b3bbd2f357a1f7ff (DEFAULT_TABLE table=test-workload [id=ce1025c73cf04c4baf25820ae7ff0a53]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 13:04:04.669411 19475 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 217b5fae677b4971b3bbd2f357a1f7ff. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:04.672416 19474 tablet_service.cc:1511] Processing CreateTablet for tablet f1b10566f45d4a7d9029858330e02d5b (DEFAULT_TABLE table=test-workload [id=ce1025c73cf04c4baf25820ae7ff0a53]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 13:04:04.673743 19474 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f1b10566f45d4a7d9029858330e02d5b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:04.674154 19548 tablet_service.cc:1511] Processing CreateTablet for tablet f1b10566f45d4a7d9029858330e02d5b (DEFAULT_TABLE table=test-workload [id=ce1025c73cf04c4baf25820ae7ff0a53]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 13:04:04.675450 19548 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f1b10566f45d4a7d9029858330e02d5b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:04.681061 19473 tablet_service.cc:1511] Processing CreateTablet for tablet 0afb57ae58a24a01850491d69f0213dd (DEFAULT_TABLE table=test-workload [id=ce1025c73cf04c4baf25820ae7ff0a53]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 13:04:04.681403 19472 tablet_service.cc:1511] Processing CreateTablet for tablet ef32ce6fdd0e40d382c79974f30295c6 (DEFAULT_TABLE table=test-workload [id=ce1025c73cf04c4baf25820ae7ff0a53]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 13:04:04.682552 19473 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0afb57ae58a24a01850491d69f0213dd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:04.668035 19549 tablet_service.cc:1511] Processing CreateTablet for tablet 217b5fae677b4971b3bbd2f357a1f7ff (DEFAULT_TABLE table=test-workload [id=ce1025c73cf04c4baf25820ae7ff0a53]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 13:04:04.684864 19549 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 217b5fae677b4971b3bbd2f357a1f7ff. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:04.687412 19472 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ef32ce6fdd0e40d382c79974f30295c6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:04.688390 19471 tablet_service.cc:1511] Processing CreateTablet for tablet 70797e5783b5454ab0d0eea663e791e3 (DEFAULT_TABLE table=test-workload [id=ce1025c73cf04c4baf25820ae7ff0a53]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 13:04:04.689698 19471 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 70797e5783b5454ab0d0eea663e791e3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:04.693065 19545 tablet_service.cc:1511] Processing CreateTablet for tablet 70797e5783b5454ab0d0eea663e791e3 (DEFAULT_TABLE table=test-workload [id=ce1025c73cf04c4baf25820ae7ff0a53]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 13:04:04.693125 19547 tablet_service.cc:1511] Processing CreateTablet for tablet 0afb57ae58a24a01850491d69f0213dd (DEFAULT_TABLE table=test-workload [id=ce1025c73cf04c4baf25820ae7ff0a53]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 13:04:04.694573 19545 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 70797e5783b5454ab0d0eea663e791e3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:04.695075 19546 tablet_service.cc:1511] Processing CreateTablet for tablet ef32ce6fdd0e40d382c79974f30295c6 (DEFAULT_TABLE table=test-workload [id=ce1025c73cf04c4baf25820ae7ff0a53]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 13:04:04.696409 19546 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ef32ce6fdd0e40d382c79974f30295c6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:04.696959 19547 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0afb57ae58a24a01850491d69f0213dd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:04.702867 19470 tablet_service.cc:1511] Processing CreateTablet for tablet 7be9efa6559648dbb5a0f7684c4542d1 (DEFAULT_TABLE table=test-workload [id=ce1025c73cf04c4baf25820ae7ff0a53]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 13:04:04.704229 19470 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7be9efa6559648dbb5a0f7684c4542d1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:04.706925 19468 tablet_service.cc:1511] Processing CreateTablet for tablet 14efcc79969f41babe5529c22d59156d (DEFAULT_TABLE table=test-workload [id=ce1025c73cf04c4baf25820ae7ff0a53]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 13:04:04.708287 19468 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 14efcc79969f41babe5529c22d59156d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:04.716626 19544 tablet_service.cc:1511] Processing CreateTablet for tablet 7be9efa6559648dbb5a0f7684c4542d1 (DEFAULT_TABLE table=test-workload [id=ce1025c73cf04c4baf25820ae7ff0a53]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 13:04:04.718055 19544 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7be9efa6559648dbb5a0f7684c4542d1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:04.720513 19542 tablet_service.cc:1511] Processing CreateTablet for tablet 14efcc79969f41babe5529c22d59156d (DEFAULT_TABLE table=test-workload [id=ce1025c73cf04c4baf25820ae7ff0a53]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 13:04:04.721890 19542 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 14efcc79969f41babe5529c22d59156d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:04.721717 19467 tablet_service.cc:1511] Processing CreateTablet for tablet 2a16f7501e2444fb86d4e2778e734e02 (DEFAULT_TABLE table=test-workload [id=ce1025c73cf04c4baf25820ae7ff0a53]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 13:04:04.723148 19467 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2a16f7501e2444fb86d4e2778e734e02. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:04.723881 19541 tablet_service.cc:1511] Processing CreateTablet for tablet 2a16f7501e2444fb86d4e2778e734e02 (DEFAULT_TABLE table=test-workload [id=ce1025c73cf04c4baf25820ae7ff0a53]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 13:04:04.725255 19541 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2a16f7501e2444fb86d4e2778e734e02. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:04.754021 19474 tablet_service.cc:1511] Processing CreateTablet for tablet 46c5bfeecc314717bffe987e6844b6d0 (DEFAULT_TABLE table=test-workload [id=ce1025c73cf04c4baf25820ae7ff0a53]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 13:04:04.769905 19474 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 46c5bfeecc314717bffe987e6844b6d0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:04.771908 19475 tablet_service.cc:1511] Processing CreateTablet for tablet fa8650e71aa14778b3d73721fc50d9fc (DEFAULT_TABLE table=test-workload [id=ce1025c73cf04c4baf25820ae7ff0a53]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 13:04:04.773118 19475 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fa8650e71aa14778b3d73721fc50d9fc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:04.768113 19550 tablet_service.cc:1511] Processing CreateTablet for tablet 46c5bfeecc314717bffe987e6844b6d0 (DEFAULT_TABLE table=test-workload [id=ce1025c73cf04c4baf25820ae7ff0a53]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 13:04:04.777084 19550 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 46c5bfeecc314717bffe987e6844b6d0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:04.768625 19476 tablet_service.cc:1511] Processing CreateTablet for tablet 309c3ca0ca4b4f3ba129752ea2cb293b (DEFAULT_TABLE table=test-workload [id=ce1025c73cf04c4baf25820ae7ff0a53]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 13:04:04.779479 19476 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 309c3ca0ca4b4f3ba129752ea2cb293b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:04.765177 19473 tablet_service.cc:1511] Processing CreateTablet for tablet 2725d2c4cb054f18b0fc8f735c15f6c2 (DEFAULT_TABLE table=test-workload [id=ce1025c73cf04c4baf25820ae7ff0a53]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 13:04:04.783499 19473 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2725d2c4cb054f18b0fc8f735c15f6c2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:04.799713 19475 tablet_service.cc:1511] Processing CreateTablet for tablet 14935b3ddf914369822e4a0547aaa355 (DEFAULT_TABLE table=test-workload [id=ce1025c73cf04c4baf25820ae7ff0a53]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 13:04:04.801522 19475 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 14935b3ddf914369822e4a0547aaa355. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:04.806216 19469 tablet_service.cc:1511] Processing CreateTablet for tablet 40e1e16737a842ee936002830f36882e (DEFAULT_TABLE table=test-workload [id=ce1025c73cf04c4baf25820ae7ff0a53]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 13:04:04.806975 19472 tablet_service.cc:1511] Processing CreateTablet for tablet ed7fdbcb96d14d418db9ca90a792588a (DEFAULT_TABLE table=test-workload [id=ce1025c73cf04c4baf25820ae7ff0a53]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 13:04:04.807634 19469 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 40e1e16737a842ee936002830f36882e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:04.808405 19472 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ed7fdbcb96d14d418db9ca90a792588a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:04.809530 19543 tablet_service.cc:1511] Processing CreateTablet for tablet 40e1e16737a842ee936002830f36882e (DEFAULT_TABLE table=test-workload [id=ce1025c73cf04c4baf25820ae7ff0a53]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 13:04:04.810817 19543 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 40e1e16737a842ee936002830f36882e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:04.813840 19600 tablet_bootstrap.cc:492] T 1f85fc4b527a48848e5faa083b604e36 P e61c3a8f61bb48f8a963c9480e53c168: Bootstrap starting.
I20260709 13:04:04.821317 19547 tablet_service.cc:1511] Processing CreateTablet for tablet 2725d2c4cb054f18b0fc8f735c15f6c2 (DEFAULT_TABLE table=test-workload [id=ce1025c73cf04c4baf25820ae7ff0a53]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 13:04:04.824740 19541 tablet_service.cc:1511] Processing CreateTablet for tablet 309c3ca0ca4b4f3ba129752ea2cb293b (DEFAULT_TABLE table=test-workload [id=ce1025c73cf04c4baf25820ae7ff0a53]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 13:04:04.827271 19601 tablet_bootstrap.cc:492] T ef32ce6fdd0e40d382c79974f30295c6 P 0473d2b2d01f4459b1e90fd12cc7840e: Bootstrap starting.
I20260709 13:04:04.827955 19545 tablet_service.cc:1511] Processing CreateTablet for tablet fa8650e71aa14778b3d73721fc50d9fc (DEFAULT_TABLE table=test-workload [id=ce1025c73cf04c4baf25820ae7ff0a53]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 13:04:04.830984 19544 tablet_service.cc:1511] Processing CreateTablet for tablet 14935b3ddf914369822e4a0547aaa355 (DEFAULT_TABLE table=test-workload [id=ce1025c73cf04c4baf25820ae7ff0a53]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 13:04:04.836122 19475 tablet_service.cc:1511] Processing CreateTablet for tablet 2e36a9d6e29c4a7c860cf267efbd4c74 (DEFAULT_TABLE table=test-workload [id=ce1025c73cf04c4baf25820ae7ff0a53]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 13:04:04.837054 19547 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2725d2c4cb054f18b0fc8f735c15f6c2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:04.838354 19475 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2e36a9d6e29c4a7c860cf267efbd4c74. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:04.841239 19474 tablet_service.cc:1511] Processing CreateTablet for tablet 3e1f505cb0f1427bbd698ac889d80821 (DEFAULT_TABLE table=test-workload [id=ce1025c73cf04c4baf25820ae7ff0a53]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 13:04:04.846140 19541 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 309c3ca0ca4b4f3ba129752ea2cb293b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:04.836066 19471 tablet_service.cc:1511] Processing CreateTablet for tablet 22196caba61445d3bec98a0aab3c337d (DEFAULT_TABLE table=test-workload [id=ce1025c73cf04c4baf25820ae7ff0a53]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 13:04:04.852377 19542 tablet_service.cc:1511] Processing CreateTablet for tablet ed7fdbcb96d14d418db9ca90a792588a (DEFAULT_TABLE table=test-workload [id=ce1025c73cf04c4baf25820ae7ff0a53]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 13:04:04.856964 19546 tablet_service.cc:1511] Processing CreateTablet for tablet 2e36a9d6e29c4a7c860cf267efbd4c74 (DEFAULT_TABLE table=test-workload [id=ce1025c73cf04c4baf25820ae7ff0a53]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 13:04:04.849327 19600 tablet_bootstrap.cc:654] T 1f85fc4b527a48848e5faa083b604e36 P e61c3a8f61bb48f8a963c9480e53c168: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:04.849458 19544 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 14935b3ddf914369822e4a0547aaa355. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:04.858273 19546 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2e36a9d6e29c4a7c860cf267efbd4c74. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:04.859380 19472 tablet_service.cc:1511] Processing CreateTablet for tablet d1e5873a19244c5ebbcd38e126796ee7 (DEFAULT_TABLE table=test-workload [id=ce1025c73cf04c4baf25820ae7ff0a53]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 13:04:04.860739 19542 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ed7fdbcb96d14d418db9ca90a792588a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:04.861660 19474 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3e1f505cb0f1427bbd698ac889d80821. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:04.861881 19545 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fa8650e71aa14778b3d73721fc50d9fc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:04.863549 19472 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d1e5873a19244c5ebbcd38e126796ee7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:04.873627 19473 tablet_service.cc:1511] Processing CreateTablet for tablet b9f0d59553ad444883fcf5b5909f9798 (DEFAULT_TABLE table=test-workload [id=ce1025c73cf04c4baf25820ae7ff0a53]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 13:04:04.875061 19473 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b9f0d59553ad444883fcf5b5909f9798. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:04.879072 19471 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 22196caba61445d3bec98a0aab3c337d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:04.881246 19467 tablet_service.cc:1511] Processing CreateTablet for tablet 0cdf56e38bbc453d9438d359e5a69955 (DEFAULT_TABLE table=test-workload [id=ce1025c73cf04c4baf25820ae7ff0a53]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 13:04:04.882493 19467 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0cdf56e38bbc453d9438d359e5a69955. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:04.883829 19548 tablet_service.cc:1511] Processing CreateTablet for tablet 22196caba61445d3bec98a0aab3c337d (DEFAULT_TABLE table=test-workload [id=ce1025c73cf04c4baf25820ae7ff0a53]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 13:04:04.897347 19548 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 22196caba61445d3bec98a0aab3c337d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:04.898604 19600 tablet_bootstrap.cc:492] T 1f85fc4b527a48848e5faa083b604e36 P e61c3a8f61bb48f8a963c9480e53c168: No bootstrap required, opened a new log
I20260709 13:04:04.898411 19472 tablet_service.cc:1511] Processing CreateTablet for tablet 7f575b143b844aa096b50997dad3516a (DEFAULT_TABLE table=test-workload [id=ce1025c73cf04c4baf25820ae7ff0a53]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 13:04:04.899235 19600 ts_tablet_manager.cc:1403] T 1f85fc4b527a48848e5faa083b604e36 P e61c3a8f61bb48f8a963c9480e53c168: Time spent bootstrapping tablet: real 0.086s	user 0.007s	sys 0.006s
I20260709 13:04:04.905100 19469 tablet_service.cc:1511] Processing CreateTablet for tablet 86a6797bdfe94fa496c050ceae4bd0d9 (DEFAULT_TABLE table=test-workload [id=ce1025c73cf04c4baf25820ae7ff0a53]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 13:04:04.902288 19600 raft_consensus.cc:359] T 1f85fc4b527a48848e5faa083b604e36 P e61c3a8f61bb48f8a963c9480e53c168 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } }
I20260709 13:04:04.906201 19600 raft_consensus.cc:385] T 1f85fc4b527a48848e5faa083b604e36 P e61c3a8f61bb48f8a963c9480e53c168 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:04.906527 19600 raft_consensus.cc:740] T 1f85fc4b527a48848e5faa083b604e36 P e61c3a8f61bb48f8a963c9480e53c168 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e61c3a8f61bb48f8a963c9480e53c168, State: Initialized, Role: FOLLOWER
I20260709 13:04:04.907310 19468 tablet_service.cc:1511] Processing CreateTablet for tablet 96efeaaf1057492490e9a621f37e1a2d (DEFAULT_TABLE table=test-workload [id=ce1025c73cf04c4baf25820ae7ff0a53]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 13:04:04.908556 19468 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 96efeaaf1057492490e9a621f37e1a2d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:04.909102 19549 tablet_service.cc:1511] Processing CreateTablet for tablet d1e5873a19244c5ebbcd38e126796ee7 (DEFAULT_TABLE table=test-workload [id=ce1025c73cf04c4baf25820ae7ff0a53]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 13:04:04.909159 19476 tablet_service.cc:1511] Processing CreateTablet for tablet 172b3dd13109415a955b71ac0e9d2234 (DEFAULT_TABLE table=test-workload [id=ce1025c73cf04c4baf25820ae7ff0a53]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 13:04:04.910295 19472 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7f575b143b844aa096b50997dad3516a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:04.918942 19550 tablet_service.cc:1511] Processing CreateTablet for tablet 3e1f505cb0f1427bbd698ac889d80821 (DEFAULT_TABLE table=test-workload [id=ce1025c73cf04c4baf25820ae7ff0a53]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 13:04:04.910378 19549 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d1e5873a19244c5ebbcd38e126796ee7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:04.920233 19550 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3e1f505cb0f1427bbd698ac889d80821. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:04.913123 19470 tablet_service.cc:1511] Processing CreateTablet for tablet b08304a0a02b42d7840c4e8ee9a6bd1a (DEFAULT_TABLE table=test-workload [id=ce1025c73cf04c4baf25820ae7ff0a53]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 13:04:04.923437 19470 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b08304a0a02b42d7840c4e8ee9a6bd1a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:04.925849 19601 tablet_bootstrap.cc:654] T ef32ce6fdd0e40d382c79974f30295c6 P 0473d2b2d01f4459b1e90fd12cc7840e: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:04.916397 19600 consensus_queue.cc:260] T 1f85fc4b527a48848e5faa083b604e36 P e61c3a8f61bb48f8a963c9480e53c168 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } }
I20260709 13:04:04.926972 19476 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 172b3dd13109415a955b71ac0e9d2234. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:04.930053 19471 tablet_service.cc:1511] Processing CreateTablet for tablet f93ee515a9c14139bf566522ed8232f3 (DEFAULT_TABLE table=test-workload [id=ce1025c73cf04c4baf25820ae7ff0a53]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 13:04:04.931020 19469 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 86a6797bdfe94fa496c050ceae4bd0d9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:04.935981 19547 tablet_service.cc:1511] Processing CreateTablet for tablet b9f0d59553ad444883fcf5b5909f9798 (DEFAULT_TABLE table=test-workload [id=ce1025c73cf04c4baf25820ae7ff0a53]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 13:04:04.935148 19471 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f93ee515a9c14139bf566522ed8232f3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:04.937296 19547 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b9f0d59553ad444883fcf5b5909f9798. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:04.937662 19541 tablet_service.cc:1511] Processing CreateTablet for tablet 7f575b143b844aa096b50997dad3516a (DEFAULT_TABLE table=test-workload [id=ce1025c73cf04c4baf25820ae7ff0a53]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 13:04:04.939126 19541 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7f575b143b844aa096b50997dad3516a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:04.951541 19543 tablet_service.cc:1511] Processing CreateTablet for tablet 86a6797bdfe94fa496c050ceae4bd0d9 (DEFAULT_TABLE table=test-workload [id=ce1025c73cf04c4baf25820ae7ff0a53]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 13:04:04.952972 19543 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 86a6797bdfe94fa496c050ceae4bd0d9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:04.957719 19541 tablet_service.cc:1511] Processing CreateTablet for tablet 0cdf56e38bbc453d9438d359e5a69955 (DEFAULT_TABLE table=test-workload [id=ce1025c73cf04c4baf25820ae7ff0a53]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 13:04:04.957948 19475 tablet_service.cc:1511] Processing CreateTablet for tablet ff75a1d4cb1f493db8f71ddc136ba9ab (DEFAULT_TABLE table=test-workload [id=ce1025c73cf04c4baf25820ae7ff0a53]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 13:04:04.959227 19541 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0cdf56e38bbc453d9438d359e5a69955. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:04.959748 19475 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ff75a1d4cb1f493db8f71ddc136ba9ab. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:04.974251 19399 tablet_service.cc:1511] Processing CreateTablet for tablet f1b10566f45d4a7d9029858330e02d5b (DEFAULT_TABLE table=test-workload [id=ce1025c73cf04c4baf25820ae7ff0a53]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 13:04:04.976286 19399 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f1b10566f45d4a7d9029858330e02d5b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:04.981993 19546 tablet_service.cc:1511] Processing CreateTablet for tablet 96efeaaf1057492490e9a621f37e1a2d (DEFAULT_TABLE table=test-workload [id=ce1025c73cf04c4baf25820ae7ff0a53]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 13:04:04.982602 19400 tablet_service.cc:1511] Processing CreateTablet for tablet 217b5fae677b4971b3bbd2f357a1f7ff (DEFAULT_TABLE table=test-workload [id=ce1025c73cf04c4baf25820ae7ff0a53]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 13:04:04.983122 19475 tablet_service.cc:1511] Processing CreateTablet for tablet 1a61655d99124a29b486ba4a5b37faea (DEFAULT_TABLE table=test-workload [id=ce1025c73cf04c4baf25820ae7ff0a53]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 13:04:04.970160 19401 tablet_service.cc:1511] Processing CreateTablet for tablet 1f85fc4b527a48848e5faa083b604e36 (DEFAULT_TABLE table=test-workload [id=ce1025c73cf04c4baf25820ae7ff0a53]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 13:04:04.984202 19400 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 217b5fae677b4971b3bbd2f357a1f7ff. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:04.984510 19475 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1a61655d99124a29b486ba4a5b37faea. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:04.985059 19401 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1f85fc4b527a48848e5faa083b604e36. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:04.984758 19397 tablet_service.cc:1511] Processing CreateTablet for tablet ef32ce6fdd0e40d382c79974f30295c6 (DEFAULT_TABLE table=test-workload [id=ce1025c73cf04c4baf25820ae7ff0a53]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 13:04:04.986049 19397 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ef32ce6fdd0e40d382c79974f30295c6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:04.986271 19398 tablet_service.cc:1511] Processing CreateTablet for tablet 0afb57ae58a24a01850491d69f0213dd (DEFAULT_TABLE table=test-workload [id=ce1025c73cf04c4baf25820ae7ff0a53]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 13:04:04.987591 19398 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0afb57ae58a24a01850491d69f0213dd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:04.992012 19396 tablet_service.cc:1511] Processing CreateTablet for tablet 70797e5783b5454ab0d0eea663e791e3 (DEFAULT_TABLE table=test-workload [id=ce1025c73cf04c4baf25820ae7ff0a53]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 13:04:04.993497 19396 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 70797e5783b5454ab0d0eea663e791e3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:05.002043 19475 tablet_service.cc:1511] Processing CreateTablet for tablet a08760e15aac4630a629431f56024dc8 (DEFAULT_TABLE table=test-workload [id=ce1025c73cf04c4baf25820ae7ff0a53]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 13:04:05.003528 19475 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a08760e15aac4630a629431f56024dc8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:05.020390 19475 tablet_service.cc:1511] Processing CreateTablet for tablet edd7d470b5014c9489be7f41f64355c9 (DEFAULT_TABLE table=test-workload [id=ce1025c73cf04c4baf25820ae7ff0a53]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 13:04:05.022025 19475 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet edd7d470b5014c9489be7f41f64355c9. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:04:05.023598 19357 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:04:05.027418 19546 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 96efeaaf1057492490e9a621f37e1a2d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:05.034551 19395 tablet_service.cc:1511] Processing CreateTablet for tablet 7be9efa6559648dbb5a0f7684c4542d1 (DEFAULT_TABLE table=test-workload [id=ce1025c73cf04c4baf25820ae7ff0a53]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 13:04:05.036357 19395 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7be9efa6559648dbb5a0f7684c4542d1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:05.036957 19396 tablet_service.cc:1511] Processing CreateTablet for tablet 40e1e16737a842ee936002830f36882e (DEFAULT_TABLE table=test-workload [id=ce1025c73cf04c4baf25820ae7ff0a53]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 13:04:05.038203 19396 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 40e1e16737a842ee936002830f36882e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:05.038192 19600 ts_tablet_manager.cc:1434] T 1f85fc4b527a48848e5faa083b604e36 P e61c3a8f61bb48f8a963c9480e53c168: Time spent starting tablet: real 0.139s	user 0.026s	sys 0.033s
I20260709 13:04:05.039223 19585 heartbeater.cc:499] Master 127.17.223.62:36283 was elected leader, sending a full tablet report...
I20260709 13:04:05.044919 19600 tablet_bootstrap.cc:492] T 0afb57ae58a24a01850491d69f0213dd P e61c3a8f61bb48f8a963c9480e53c168: Bootstrap starting.
I20260709 13:04:05.043862 19545 tablet_service.cc:1511] Processing CreateTablet for tablet 172b3dd13109415a955b71ac0e9d2234 (DEFAULT_TABLE table=test-workload [id=ce1025c73cf04c4baf25820ae7ff0a53]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 13:04:05.046185 19545 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 172b3dd13109415a955b71ac0e9d2234. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:05.048774 19543 tablet_service.cc:1511] Processing CreateTablet for tablet b08304a0a02b42d7840c4e8ee9a6bd1a (DEFAULT_TABLE table=test-workload [id=ce1025c73cf04c4baf25820ae7ff0a53]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 13:04:05.051185 19543 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b08304a0a02b42d7840c4e8ee9a6bd1a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:05.083069 19399 tablet_service.cc:1511] Processing CreateTablet for tablet 14efcc79969f41babe5529c22d59156d (DEFAULT_TABLE table=test-workload [id=ce1025c73cf04c4baf25820ae7ff0a53]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 13:04:05.065354 19545 tablet_service.cc:1511] Processing CreateTablet for tablet 1a61655d99124a29b486ba4a5b37faea (DEFAULT_TABLE table=test-workload [id=ce1025c73cf04c4baf25820ae7ff0a53]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 13:04:05.084404 19399 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 14efcc79969f41babe5529c22d59156d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:05.084748 19545 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1a61655d99124a29b486ba4a5b37faea. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:05.084566 19394 tablet_service.cc:1511] Processing CreateTablet for tablet 2a16f7501e2444fb86d4e2778e734e02 (DEFAULT_TABLE table=test-workload [id=ce1025c73cf04c4baf25820ae7ff0a53]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 13:04:05.065168 19544 tablet_service.cc:1511] Processing CreateTablet for tablet ff75a1d4cb1f493db8f71ddc136ba9ab (DEFAULT_TABLE table=test-workload [id=ce1025c73cf04c4baf25820ae7ff0a53]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 13:04:05.086913 19394 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2a16f7501e2444fb86d4e2778e734e02. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:05.088227 19392 tablet_service.cc:1511] Processing CreateTablet for tablet 2725d2c4cb054f18b0fc8f735c15f6c2 (DEFAULT_TABLE table=test-workload [id=ce1025c73cf04c4baf25820ae7ff0a53]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 13:04:05.089859 19393 tablet_service.cc:1511] Processing CreateTablet for tablet 46c5bfeecc314717bffe987e6844b6d0 (DEFAULT_TABLE table=test-workload [id=ce1025c73cf04c4baf25820ae7ff0a53]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 13:04:05.090596 19547 tablet_service.cc:1511] Processing CreateTablet for tablet a08760e15aac4630a629431f56024dc8 (DEFAULT_TABLE table=test-workload [id=ce1025c73cf04c4baf25820ae7ff0a53]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 13:04:05.099054 19603 raft_consensus.cc:493] T 1f85fc4b527a48848e5faa083b604e36 P e61c3a8f61bb48f8a963c9480e53c168 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:05.100841 19398 tablet_service.cc:1511] Processing CreateTablet for tablet fa8650e71aa14778b3d73721fc50d9fc (DEFAULT_TABLE table=test-workload [id=ce1025c73cf04c4baf25820ae7ff0a53]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 13:04:05.100999 19400 tablet_service.cc:1511] Processing CreateTablet for tablet 309c3ca0ca4b4f3ba129752ea2cb293b (DEFAULT_TABLE table=test-workload [id=ce1025c73cf04c4baf25820ae7ff0a53]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 13:04:05.057976 19549 tablet_service.cc:1511] Processing CreateTablet for tablet f93ee515a9c14139bf566522ed8232f3 (DEFAULT_TABLE table=test-workload [id=ce1025c73cf04c4baf25820ae7ff0a53]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 13:04:05.104264 19600 tablet_bootstrap.cc:654] T 0afb57ae58a24a01850491d69f0213dd P e61c3a8f61bb48f8a963c9480e53c168: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:05.104882 19545 tablet_service.cc:1511] Processing CreateTablet for tablet edd7d470b5014c9489be7f41f64355c9 (DEFAULT_TABLE table=test-workload [id=ce1025c73cf04c4baf25820ae7ff0a53]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 13:04:05.115013 19603 raft_consensus.cc:515] T 1f85fc4b527a48848e5faa083b604e36 P e61c3a8f61bb48f8a963c9480e53c168 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } }
I20260709 13:04:05.117862 19603 leader_election.cc:290] T 1f85fc4b527a48848e5faa083b604e36 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321)
I20260709 13:04:05.054643 19468 tablet_service.cc:1511] Processing CreateTablet for tablet 9962423cb4e54fcfa5de01daf68a86e7 (DEFAULT_TABLE table=test-workload [id=ce1025c73cf04c4baf25820ae7ff0a53]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 13:04:05.063215 19467 tablet_service.cc:1511] Processing CreateTablet for tablet 4af19371ea874c09a0a2147040835cbb (DEFAULT_TABLE table=test-workload [id=ce1025c73cf04c4baf25820ae7ff0a53]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 13:04:05.128144 19400 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 309c3ca0ca4b4f3ba129752ea2cb293b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:05.131019 19398 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fa8650e71aa14778b3d73721fc50d9fc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:05.131656 19604 tablet_bootstrap.cc:492] T ef32ce6fdd0e40d382c79974f30295c6 P e5256d91808b47c195bc9b4dbd7f2b87: Bootstrap starting.
I20260709 13:04:05.090227 19474 tablet_service.cc:1511] Processing CreateTablet for tablet df751f992649444090e27965eb1af85d (DEFAULT_TABLE table=test-workload [id=ce1025c73cf04c4baf25820ae7ff0a53]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 13:04:05.140789 19393 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 46c5bfeecc314717bffe987e6844b6d0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:05.119880 19397 tablet_service.cc:1511] Processing CreateTablet for tablet 14935b3ddf914369822e4a0547aaa355 (DEFAULT_TABLE table=test-workload [id=ce1025c73cf04c4baf25820ae7ff0a53]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 13:04:05.106839 19542 tablet_service.cc:1511] Processing CreateTablet for tablet 9962423cb4e54fcfa5de01daf68a86e7 (DEFAULT_TABLE table=test-workload [id=ce1025c73cf04c4baf25820ae7ff0a53]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 13:04:05.163759 19472 tablet_service.cc:1511] Processing CreateTablet for tablet bc225c93219c45538b53a1bd3d387e4d (DEFAULT_TABLE table=test-workload [id=ce1025c73cf04c4baf25820ae7ff0a53]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 13:04:05.158643 19544 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ff75a1d4cb1f493db8f71ddc136ba9ab. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:05.128180 19470 tablet_service.cc:1511] Processing CreateTablet for tablet 62c6c134d3d24a1ab144dd9ee6bc3f64 (DEFAULT_TABLE table=test-workload [id=ce1025c73cf04c4baf25820ae7ff0a53]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 13:04:05.171638 19392 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2725d2c4cb054f18b0fc8f735c15f6c2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:05.176002 19397 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 14935b3ddf914369822e4a0547aaa355. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:05.182773 19467 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4af19371ea874c09a0a2147040835cbb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:05.187165 19473 tablet_service.cc:1511] Processing CreateTablet for tablet 6c5eebf646ad445a9d1b1adc319d7b16 (DEFAULT_TABLE table=test-workload [id=ce1025c73cf04c4baf25820ae7ff0a53]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 13:04:05.189558 19601 tablet_bootstrap.cc:492] T ef32ce6fdd0e40d382c79974f30295c6 P 0473d2b2d01f4459b1e90fd12cc7840e: No bootstrap required, opened a new log
I20260709 13:04:05.190073 19601 ts_tablet_manager.cc:1403] T ef32ce6fdd0e40d382c79974f30295c6 P 0473d2b2d01f4459b1e90fd12cc7840e: Time spent bootstrapping tablet: real 0.363s	user 0.012s	sys 0.026s
I20260709 13:04:05.190400 19395 tablet_service.cc:1511] Processing CreateTablet for tablet ed7fdbcb96d14d418db9ca90a792588a (DEFAULT_TABLE table=test-workload [id=ce1025c73cf04c4baf25820ae7ff0a53]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 13:04:05.192976 19601 raft_consensus.cc:359] T ef32ce6fdd0e40d382c79974f30295c6 P 0473d2b2d01f4459b1e90fd12cc7840e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:05.199918 19399 tablet_service.cc:1511] Processing CreateTablet for tablet 2e36a9d6e29c4a7c860cf267efbd4c74 (DEFAULT_TABLE table=test-workload [id=ce1025c73cf04c4baf25820ae7ff0a53]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 13:04:05.202092 19601 raft_consensus.cc:385] T ef32ce6fdd0e40d382c79974f30295c6 P 0473d2b2d01f4459b1e90fd12cc7840e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:05.202297 19470 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 62c6c134d3d24a1ab144dd9ee6bc3f64. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:05.202508 19601 raft_consensus.cc:740] T ef32ce6fdd0e40d382c79974f30295c6 P 0473d2b2d01f4459b1e90fd12cc7840e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0473d2b2d01f4459b1e90fd12cc7840e, State: Initialized, Role: FOLLOWER
I20260709 13:04:05.202765 19399 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2e36a9d6e29c4a7c860cf267efbd4c74. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:05.203346 19601 consensus_queue.cc:260] T ef32ce6fdd0e40d382c79974f30295c6 P 0473d2b2d01f4459b1e90fd12cc7840e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:05.203909 19472 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bc225c93219c45538b53a1bd3d387e4d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:05.205642 19549 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f93ee515a9c14139bf566522ed8232f3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:05.205916 19468 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9962423cb4e54fcfa5de01daf68a86e7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:05.207873 19542 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9962423cb4e54fcfa5de01daf68a86e7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:05.209199 19474 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet df751f992649444090e27965eb1af85d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:05.211295 19548 tablet_service.cc:1511] Processing CreateTablet for tablet 4af19371ea874c09a0a2147040835cbb (DEFAULT_TABLE table=test-workload [id=ce1025c73cf04c4baf25820ae7ff0a53]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 13:04:05.212837 19548 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4af19371ea874c09a0a2147040835cbb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:05.217517 19475 tablet_service.cc:1511] Processing CreateTablet for tablet 0e1085d23e8347fbbd5bce7542f4b1f4 (DEFAULT_TABLE table=test-workload [id=ce1025c73cf04c4baf25820ae7ff0a53]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 13:04:05.219974 19546 tablet_service.cc:1511] Processing CreateTablet for tablet df751f992649444090e27965eb1af85d (DEFAULT_TABLE table=test-workload [id=ce1025c73cf04c4baf25820ae7ff0a53]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 13:04:05.223028 19541 tablet_service.cc:1511] Processing CreateTablet for tablet 6c5eebf646ad445a9d1b1adc319d7b16 (DEFAULT_TABLE table=test-workload [id=ce1025c73cf04c4baf25820ae7ff0a53]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 13:04:05.227178 19473 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6c5eebf646ad445a9d1b1adc319d7b16. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:05.227522 19436 heartbeater.cc:499] Master 127.17.223.62:36283 was elected leader, sending a full tablet report...
I20260709 13:04:05.229967 19547 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a08760e15aac4630a629431f56024dc8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:05.262534 19541 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6c5eebf646ad445a9d1b1adc319d7b16. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:05.267153 19545 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet edd7d470b5014c9489be7f41f64355c9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:05.231062 19543 tablet_service.cc:1511] Processing CreateTablet for tablet 62c6c134d3d24a1ab144dd9ee6bc3f64 (DEFAULT_TABLE table=test-workload [id=ce1025c73cf04c4baf25820ae7ff0a53]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 13:04:05.232816 19550 tablet_service.cc:1511] Processing CreateTablet for tablet bc225c93219c45538b53a1bd3d387e4d (DEFAULT_TABLE table=test-workload [id=ce1025c73cf04c4baf25820ae7ff0a53]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 13:04:05.238794 19469 tablet_service.cc:1511] Processing CreateTablet for tablet 1efebf73c86e432baa55533136b6e12c (DEFAULT_TABLE table=test-workload [id=ce1025c73cf04c4baf25820ae7ff0a53]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 13:04:05.243564 19604 tablet_bootstrap.cc:654] T ef32ce6fdd0e40d382c79974f30295c6 P e5256d91808b47c195bc9b4dbd7f2b87: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:05.279465 19469 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1efebf73c86e432baa55533136b6e12c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:05.213052 19395 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ed7fdbcb96d14d418db9ca90a792588a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:05.247588 19476 tablet_service.cc:1511] Processing CreateTablet for tablet 36f6ba92b9ba46babe4ebd6c02e5fbd9 (DEFAULT_TABLE table=test-workload [id=ce1025c73cf04c4baf25820ae7ff0a53]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 13:04:05.285576 19475 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0e1085d23e8347fbbd5bce7542f4b1f4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:05.271131 19546 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet df751f992649444090e27965eb1af85d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:05.291102 19550 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bc225c93219c45538b53a1bd3d387e4d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:05.307668 19476 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 36f6ba92b9ba46babe4ebd6c02e5fbd9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:05.310904 19543 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 62c6c134d3d24a1ab144dd9ee6bc3f64. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:05.325892 19471 tablet_service.cc:1511] Processing CreateTablet for tablet 65d8cb8d6ec64f459d5a47cefab10acf (DEFAULT_TABLE table=test-workload [id=ce1025c73cf04c4baf25820ae7ff0a53]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 13:04:05.326444 19511 heartbeater.cc:499] Master 127.17.223.62:36283 was elected leader, sending a full tablet report...
I20260709 13:04:05.329759 19486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f85fc4b527a48848e5faa083b604e36" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
W20260709 13:04:05.331858 19526 leader_election.cc:343] T 1f85fc4b527a48848e5faa083b604e36 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:05.351166 19600 tablet_bootstrap.cc:492] T 0afb57ae58a24a01850491d69f0213dd P e61c3a8f61bb48f8a963c9480e53c168: No bootstrap required, opened a new log
I20260709 13:04:05.351779 19600 ts_tablet_manager.cc:1403] T 0afb57ae58a24a01850491d69f0213dd P e61c3a8f61bb48f8a963c9480e53c168: Time spent bootstrapping tablet: real 0.307s	user 0.033s	sys 0.022s
I20260709 13:04:05.355508 19468 tablet_service.cc:1511] Processing CreateTablet for tablet 21e14947d70440f19044d8f75c31e1f9 (DEFAULT_TABLE table=test-workload [id=ce1025c73cf04c4baf25820ae7ff0a53]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 13:04:05.364679 19397 tablet_service.cc:1511] Processing CreateTablet for tablet 3e1f505cb0f1427bbd698ac889d80821 (DEFAULT_TABLE table=test-workload [id=ce1025c73cf04c4baf25820ae7ff0a53]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 13:04:05.369210 19600 raft_consensus.cc:359] T 0afb57ae58a24a01850491d69f0213dd P e61c3a8f61bb48f8a963c9480e53c168 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:05.342417 19401 tablet_service.cc:1511] Processing CreateTablet for tablet 22196caba61445d3bec98a0aab3c337d (DEFAULT_TABLE table=test-workload [id=ce1025c73cf04c4baf25820ae7ff0a53]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 13:04:05.389768 19475 tablet_service.cc:1511] Processing CreateTablet for tablet 1dc5b3532fe54f74876d02beffa2c230 (DEFAULT_TABLE table=test-workload [id=ce1025c73cf04c4baf25820ae7ff0a53]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 13:04:05.394335 19609 raft_consensus.cc:493] T ef32ce6fdd0e40d382c79974f30295c6 P 0473d2b2d01f4459b1e90fd12cc7840e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:05.395067 19411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f85fc4b527a48848e5faa083b604e36" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:04:05.394902 19609 raft_consensus.cc:515] T ef32ce6fdd0e40d382c79974f30295c6 P 0473d2b2d01f4459b1e90fd12cc7840e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:05.384013 19600 raft_consensus.cc:385] T 0afb57ae58a24a01850491d69f0213dd P e61c3a8f61bb48f8a963c9480e53c168 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260709 13:04:05.398898 19523 leader_election.cc:343] T 1f85fc4b527a48848e5faa083b604e36 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:05.404273 19609 leader_election.cc:290] T ef32ce6fdd0e40d382c79974f30295c6 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:04:05.406879 19523 leader_election.cc:304] T 1f85fc4b527a48848e5faa083b604e36 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e61c3a8f61bb48f8a963c9480e53c168; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:04:05.408843 19603 raft_consensus.cc:2749] T 1f85fc4b527a48848e5faa083b604e36 P e61c3a8f61bb48f8a963c9480e53c168 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:04:05.410349 19547 tablet_service.cc:1511] Processing CreateTablet for tablet 0e1085d23e8347fbbd5bce7542f4b1f4 (DEFAULT_TABLE table=test-workload [id=ce1025c73cf04c4baf25820ae7ff0a53]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 13:04:05.411821 19547 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0e1085d23e8347fbbd5bce7542f4b1f4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:05.415956 19548 tablet_service.cc:1511] Processing CreateTablet for tablet 1efebf73c86e432baa55533136b6e12c (DEFAULT_TABLE table=test-workload [id=ce1025c73cf04c4baf25820ae7ff0a53]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 13:04:05.399353 19471 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 65d8cb8d6ec64f459d5a47cefab10acf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:05.419584 19601 ts_tablet_manager.cc:1434] T ef32ce6fdd0e40d382c79974f30295c6 P 0473d2b2d01f4459b1e90fd12cc7840e: Time spent starting tablet: real 0.229s	user 0.027s	sys 0.039s
I20260709 13:04:05.420845 19601 tablet_bootstrap.cc:492] T f1b10566f45d4a7d9029858330e02d5b P 0473d2b2d01f4459b1e90fd12cc7840e: Bootstrap starting.
I20260709 13:04:05.421314 19468 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 21e14947d70440f19044d8f75c31e1f9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:05.426900 19397 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3e1f505cb0f1427bbd698ac889d80821. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:05.432516 19604 tablet_bootstrap.cc:492] T ef32ce6fdd0e40d382c79974f30295c6 P e5256d91808b47c195bc9b4dbd7f2b87: No bootstrap required, opened a new log
I20260709 13:04:05.433169 19604 ts_tablet_manager.cc:1403] T ef32ce6fdd0e40d382c79974f30295c6 P e5256d91808b47c195bc9b4dbd7f2b87: Time spent bootstrapping tablet: real 0.302s	user 0.013s	sys 0.010s
I20260709 13:04:05.435031 19401 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 22196caba61445d3bec98a0aab3c337d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:05.401010 19600 raft_consensus.cc:740] T 0afb57ae58a24a01850491d69f0213dd P e61c3a8f61bb48f8a963c9480e53c168 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e61c3a8f61bb48f8a963c9480e53c168, State: Initialized, Role: FOLLOWER
I20260709 13:04:05.437713 19398 tablet_service.cc:1511] Processing CreateTablet for tablet d1e5873a19244c5ebbcd38e126796ee7 (DEFAULT_TABLE table=test-workload [id=ce1025c73cf04c4baf25820ae7ff0a53]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 13:04:05.439213 19398 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d1e5873a19244c5ebbcd38e126796ee7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:05.446899 19548 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1efebf73c86e432baa55533136b6e12c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:05.447633 19600 consensus_queue.cc:260] T 0afb57ae58a24a01850491d69f0213dd P e61c3a8f61bb48f8a963c9480e53c168 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:05.449174 19400 tablet_service.cc:1511] Processing CreateTablet for tablet 86a6797bdfe94fa496c050ceae4bd0d9 (DEFAULT_TABLE table=test-workload [id=ce1025c73cf04c4baf25820ae7ff0a53]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 13:04:05.452688 19600 ts_tablet_manager.cc:1434] T 0afb57ae58a24a01850491d69f0213dd P e61c3a8f61bb48f8a963c9480e53c168: Time spent starting tablet: real 0.101s	user 0.006s	sys 0.000s
I20260709 13:04:05.454145 19399 tablet_service.cc:1511] Processing CreateTablet for tablet 0cdf56e38bbc453d9438d359e5a69955 (DEFAULT_TABLE table=test-workload [id=ce1025c73cf04c4baf25820ae7ff0a53]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 13:04:05.435756 19396 tablet_service.cc:1511] Processing CreateTablet for tablet 7f575b143b844aa096b50997dad3516a (DEFAULT_TABLE table=test-workload [id=ce1025c73cf04c4baf25820ae7ff0a53]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 13:04:05.456606 19545 tablet_service.cc:1511] Processing CreateTablet for tablet 21e14947d70440f19044d8f75c31e1f9 (DEFAULT_TABLE table=test-workload [id=ce1025c73cf04c4baf25820ae7ff0a53]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 13:04:05.458834 19600 tablet_bootstrap.cc:492] T 2a16f7501e2444fb86d4e2778e734e02 P e61c3a8f61bb48f8a963c9480e53c168: Bootstrap starting.
I20260709 13:04:05.466765 19411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef32ce6fdd0e40d382c79974f30295c6" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:04:05.467612 19550 tablet_service.cc:1511] Processing CreateTablet for tablet 1dc5b3532fe54f74876d02beffa2c230 (DEFAULT_TABLE table=test-workload [id=ce1025c73cf04c4baf25820ae7ff0a53]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 13:04:05.471385 19394 tablet_service.cc:1511] Processing CreateTablet for tablet 6c5eebf646ad445a9d1b1adc319d7b16 (DEFAULT_TABLE table=test-workload [id=ce1025c73cf04c4baf25820ae7ff0a53]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 13:04:05.475129 19475 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1dc5b3532fe54f74876d02beffa2c230. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:05.454293 19546 tablet_service.cc:1511] Processing CreateTablet for tablet 36f6ba92b9ba46babe4ebd6c02e5fbd9 (DEFAULT_TABLE table=test-workload [id=ce1025c73cf04c4baf25820ae7ff0a53]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 13:04:05.454145 19543 tablet_service.cc:1511] Processing CreateTablet for tablet 65d8cb8d6ec64f459d5a47cefab10acf (DEFAULT_TABLE table=test-workload [id=ce1025c73cf04c4baf25820ae7ff0a53]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 13:04:05.485117 19604 raft_consensus.cc:359] T ef32ce6fdd0e40d382c79974f30295c6 P e5256d91808b47c195bc9b4dbd7f2b87 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:05.485832 19604 raft_consensus.cc:385] T ef32ce6fdd0e40d382c79974f30295c6 P e5256d91808b47c195bc9b4dbd7f2b87 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:05.486116 19604 raft_consensus.cc:740] T ef32ce6fdd0e40d382c79974f30295c6 P e5256d91808b47c195bc9b4dbd7f2b87 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e5256d91808b47c195bc9b4dbd7f2b87, State: Initialized, Role: FOLLOWER
I20260709 13:04:05.491670 19473 tablet_service.cc:1511] Processing CreateTablet for tablet 85c494af21f9457a85da47b9bc70c1fd (DEFAULT_TABLE table=test-workload [id=ce1025c73cf04c4baf25820ae7ff0a53]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 13:04:05.492965 19473 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 85c494af21f9457a85da47b9bc70c1fd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:05.504770 19601 tablet_bootstrap.cc:654] T f1b10566f45d4a7d9029858330e02d5b P 0473d2b2d01f4459b1e90fd12cc7840e: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:05.430150 19393 tablet_service.cc:1511] Processing CreateTablet for tablet b9f0d59553ad444883fcf5b5909f9798 (DEFAULT_TABLE table=test-workload [id=ce1025c73cf04c4baf25820ae7ff0a53]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 13:04:05.506841 19604 consensus_queue.cc:260] T ef32ce6fdd0e40d382c79974f30295c6 P e5256d91808b47c195bc9b4dbd7f2b87 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:05.516386 19470 tablet_service.cc:1511] Processing CreateTablet for tablet 179fd671030940b4b4a4e24bcc4aba0a (DEFAULT_TABLE table=test-workload [id=ce1025c73cf04c4baf25820ae7ff0a53]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 13:04:05.517683 19470 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 179fd671030940b4b4a4e24bcc4aba0a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:05.525313 19600 tablet_bootstrap.cc:654] T 2a16f7501e2444fb86d4e2778e734e02 P e61c3a8f61bb48f8a963c9480e53c168: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:05.525723 19411 raft_consensus.cc:2468] T ef32ce6fdd0e40d382c79974f30295c6 P e5256d91808b47c195bc9b4dbd7f2b87 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 0.
I20260709 13:04:05.544746 19449 leader_election.cc:304] T ef32ce6fdd0e40d382c79974f30295c6 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87; no voters: 
I20260709 13:04:05.530648 19467 tablet_service.cc:1511] Processing CreateTablet for tablet 4509b76741dc428e9201c70c1658da13 (DEFAULT_TABLE table=test-workload [id=ce1025c73cf04c4baf25820ae7ff0a53]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 13:04:05.545873 19611 raft_consensus.cc:2804] T ef32ce6fdd0e40d382c79974f30295c6 P 0473d2b2d01f4459b1e90fd12cc7840e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:05.546352 19611 raft_consensus.cc:493] T ef32ce6fdd0e40d382c79974f30295c6 P 0473d2b2d01f4459b1e90fd12cc7840e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:05.546741 19611 raft_consensus.cc:3060] T ef32ce6fdd0e40d382c79974f30295c6 P 0473d2b2d01f4459b1e90fd12cc7840e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:05.531335 19400 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 86a6797bdfe94fa496c050ceae4bd0d9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:05.530992 19469 tablet_service.cc:1511] Processing CreateTablet for tablet 76cb037fc9064d13b59a8969d897ce8c (DEFAULT_TABLE table=test-workload [id=ce1025c73cf04c4baf25820ae7ff0a53]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 13:04:05.532212 19545 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 21e14947d70440f19044d8f75c31e1f9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:05.537338 19541 tablet_service.cc:1511] Processing CreateTablet for tablet 179fd671030940b4b4a4e24bcc4aba0a (DEFAULT_TABLE table=test-workload [id=ce1025c73cf04c4baf25820ae7ff0a53]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 13:04:05.541625 19560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef32ce6fdd0e40d382c79974f30295c6" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:04:05.559298 19543 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 65d8cb8d6ec64f459d5a47cefab10acf. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:04:05.564893 19450 leader_election.cc:343] T ef32ce6fdd0e40d382c79974f30295c6 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:05.559670 19468 tablet_service.cc:1511] Processing CreateTablet for tablet 833a2f0775ed407a94b8924ce50adb63 (DEFAULT_TABLE table=test-workload [id=ce1025c73cf04c4baf25820ae7ff0a53]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 13:04:05.556427 19401 tablet_service.cc:1511] Processing CreateTablet for tablet b08304a0a02b42d7840c4e8ee9a6bd1a (DEFAULT_TABLE table=test-workload [id=ce1025c73cf04c4baf25820ae7ff0a53]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 13:04:05.559861 19547 tablet_service.cc:1511] Processing CreateTablet for tablet 4509b76741dc428e9201c70c1658da13 (DEFAULT_TABLE table=test-workload [id=ce1025c73cf04c4baf25820ae7ff0a53]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 13:04:05.567106 19547 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4509b76741dc428e9201c70c1658da13. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:05.568137 19395 tablet_service.cc:1511] Processing CreateTablet for tablet 172b3dd13109415a955b71ac0e9d2234 (DEFAULT_TABLE table=test-workload [id=ce1025c73cf04c4baf25820ae7ff0a53]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 13:04:05.545293 19392 tablet_service.cc:1511] Processing CreateTablet for tablet 96efeaaf1057492490e9a621f37e1a2d (DEFAULT_TABLE table=test-workload [id=ce1025c73cf04c4baf25820ae7ff0a53]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 13:04:05.559871 19396 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7f575b143b844aa096b50997dad3516a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:05.541599 19549 tablet_service.cc:1511] Processing CreateTablet for tablet 85c494af21f9457a85da47b9bc70c1fd (DEFAULT_TABLE table=test-workload [id=ce1025c73cf04c4baf25820ae7ff0a53]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 13:04:05.571039 19542 tablet_service.cc:1511] Processing CreateTablet for tablet ece3db938bc649d4a40a51522ed5259c (DEFAULT_TABLE table=test-workload [id=ce1025c73cf04c4baf25820ae7ff0a53]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 13:04:05.575477 19474 tablet_service.cc:1511] Processing CreateTablet for tablet ece3db938bc649d4a40a51522ed5259c (DEFAULT_TABLE table=test-workload [id=ce1025c73cf04c4baf25820ae7ff0a53]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 13:04:05.579013 19472 tablet_service.cc:1511] Processing CreateTablet for tablet 28af091831594f9d8e96482078cc7625 (DEFAULT_TABLE table=test-workload [id=ce1025c73cf04c4baf25820ae7ff0a53]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 13:04:05.579546 19541 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 179fd671030940b4b4a4e24bcc4aba0a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:05.547662 19544 tablet_service.cc:1511] Processing CreateTablet for tablet 76cb037fc9064d13b59a8969d897ce8c (DEFAULT_TABLE table=test-workload [id=ce1025c73cf04c4baf25820ae7ff0a53]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 13:04:05.581236 19544 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 76cb037fc9064d13b59a8969d897ce8c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:05.546602 19467 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4509b76741dc428e9201c70c1658da13. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:05.582978 19546 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 36f6ba92b9ba46babe4ebd6c02e5fbd9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:05.583225 19469 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 76cb037fc9064d13b59a8969d897ce8c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:05.586932 19401 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b08304a0a02b42d7840c4e8ee9a6bd1a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:05.587030 19474 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ece3db938bc649d4a40a51522ed5259c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:05.587284 19549 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 85c494af21f9457a85da47b9bc70c1fd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:05.588996 19468 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 833a2f0775ed407a94b8924ce50adb63. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:05.582581 19397 tablet_service.cc:1511] Processing CreateTablet for tablet ff75a1d4cb1f493db8f71ddc136ba9ab (DEFAULT_TABLE table=test-workload [id=ce1025c73cf04c4baf25820ae7ff0a53]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 13:04:05.566241 19398 tablet_service.cc:1511] Processing CreateTablet for tablet f93ee515a9c14139bf566522ed8232f3 (DEFAULT_TABLE table=test-workload [id=ce1025c73cf04c4baf25820ae7ff0a53]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 13:04:05.591116 19394 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6c5eebf646ad445a9d1b1adc319d7b16. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:05.592056 19398 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f93ee515a9c14139bf566522ed8232f3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:05.594964 19397 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ff75a1d4cb1f493db8f71ddc136ba9ab. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:05.596004 19550 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1dc5b3532fe54f74876d02beffa2c230. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:05.596704 19611 raft_consensus.cc:515] T ef32ce6fdd0e40d382c79974f30295c6 P 0473d2b2d01f4459b1e90fd12cc7840e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:05.599836 19471 tablet_service.cc:1511] Processing CreateTablet for tablet fa731b585f684a7fb2d106c50f143b83 (DEFAULT_TABLE table=test-workload [id=ce1025c73cf04c4baf25820ae7ff0a53]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 13:04:05.533443 19476 tablet_service.cc:1511] Processing CreateTablet for tablet 775c229504194560ba9589bc2199b089 (DEFAULT_TABLE table=test-workload [id=ce1025c73cf04c4baf25820ae7ff0a53]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 13:04:05.603034 19393 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b9f0d59553ad444883fcf5b5909f9798. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:05.607345 19411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef32ce6fdd0e40d382c79974f30295c6" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
I20260709 13:04:05.607928 19411 raft_consensus.cc:3060] T ef32ce6fdd0e40d382c79974f30295c6 P e5256d91808b47c195bc9b4dbd7f2b87 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:05.606168 19542 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ece3db938bc649d4a40a51522ed5259c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:05.619882 19399 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0cdf56e38bbc453d9438d359e5a69955. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:05.604686 19473 tablet_service.cc:1511] Processing CreateTablet for tablet ff9b0eddd810459b82d91c60777c10eb (DEFAULT_TABLE table=test-workload [id=ce1025c73cf04c4baf25820ae7ff0a53]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 13:04:05.623781 19560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef32ce6fdd0e40d382c79974f30295c6" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:04:05.629110 19411 raft_consensus.cc:2468] T ef32ce6fdd0e40d382c79974f30295c6 P e5256d91808b47c195bc9b4dbd7f2b87 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 1.
I20260709 13:04:05.623245 19611 leader_election.cc:290] T ef32ce6fdd0e40d382c79974f30295c6 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 1 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
W20260709 13:04:05.629350 19450 leader_election.cc:343] T ef32ce6fdd0e40d382c79974f30295c6 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:05.630435 19449 leader_election.cc:304] T ef32ce6fdd0e40d382c79974f30295c6 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87; no voters: e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:04:05.636952 19548 tablet_service.cc:1511] Processing CreateTablet for tablet 775c229504194560ba9589bc2199b089 (DEFAULT_TABLE table=test-workload [id=ce1025c73cf04c4baf25820ae7ff0a53]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 13:04:05.638576 19611 raft_consensus.cc:2804] T ef32ce6fdd0e40d382c79974f30295c6 P 0473d2b2d01f4459b1e90fd12cc7840e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:05.643821 19611 raft_consensus.cc:697] T ef32ce6fdd0e40d382c79974f30295c6 P 0473d2b2d01f4459b1e90fd12cc7840e [term 1 LEADER]: Becoming Leader. State: Replica: 0473d2b2d01f4459b1e90fd12cc7840e, State: Running, Role: LEADER
I20260709 13:04:05.644641 19611 consensus_queue.cc:237] T ef32ce6fdd0e40d382c79974f30295c6 P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:05.655205 19475 tablet_service.cc:1511] Processing CreateTablet for tablet ab43d85f64114d4ebf618930e43d9ed0 (DEFAULT_TABLE table=test-workload [id=ce1025c73cf04c4baf25820ae7ff0a53]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 13:04:05.656194 19400 tablet_service.cc:1511] Processing CreateTablet for tablet 1a61655d99124a29b486ba4a5b37faea (DEFAULT_TABLE table=test-workload [id=ce1025c73cf04c4baf25820ae7ff0a53]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 13:04:05.657501 19548 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 775c229504194560ba9589bc2199b089. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:05.647118 19472 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 28af091831594f9d8e96482078cc7625. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:05.659273 19475 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ab43d85f64114d4ebf618930e43d9ed0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:05.659528 19604 ts_tablet_manager.cc:1434] T ef32ce6fdd0e40d382c79974f30295c6 P e5256d91808b47c195bc9b4dbd7f2b87: Time spent starting tablet: real 0.226s	user 0.017s	sys 0.008s
I20260709 13:04:05.666939 19476 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 775c229504194560ba9589bc2199b089. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:05.667228 19604 tablet_bootstrap.cc:492] T 70797e5783b5454ab0d0eea663e791e3 P e5256d91808b47c195bc9b4dbd7f2b87: Bootstrap starting.
I20260709 13:04:05.677196 19475 tablet_service.cc:1511] Processing CreateTablet for tablet e381f1d6b8184797ad142de49be225a8 (DEFAULT_TABLE table=test-workload [id=ce1025c73cf04c4baf25820ae7ff0a53]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 13:04:05.678817 19475 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e381f1d6b8184797ad142de49be225a8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:05.686035 19541 tablet_service.cc:1511] Processing CreateTablet for tablet 833a2f0775ed407a94b8924ce50adb63 (DEFAULT_TABLE table=test-workload [id=ce1025c73cf04c4baf25820ae7ff0a53]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 13:04:05.687433 19541 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 833a2f0775ed407a94b8924ce50adb63. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:05.709318 19548 tablet_service.cc:1511] Processing CreateTablet for tablet 28af091831594f9d8e96482078cc7625 (DEFAULT_TABLE table=test-workload [id=ce1025c73cf04c4baf25820ae7ff0a53]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 13:04:05.696573 19392 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 96efeaaf1057492490e9a621f37e1a2d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:05.712041 19400 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1a61655d99124a29b486ba4a5b37faea. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:05.713300 19395 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 172b3dd13109415a955b71ac0e9d2234. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:05.717981 19545 tablet_service.cc:1511] Processing CreateTablet for tablet fa731b585f684a7fb2d106c50f143b83 (DEFAULT_TABLE table=test-workload [id=ce1025c73cf04c4baf25820ae7ff0a53]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 13:04:05.697113 19471 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fa731b585f684a7fb2d106c50f143b83. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:05.730965 19473 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ff9b0eddd810459b82d91c60777c10eb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:05.735379 19549 tablet_service.cc:1511] Processing CreateTablet for tablet ff9b0eddd810459b82d91c60777c10eb (DEFAULT_TABLE table=test-workload [id=ce1025c73cf04c4baf25820ae7ff0a53]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 13:04:05.737175 19547 tablet_service.cc:1511] Processing CreateTablet for tablet ab43d85f64114d4ebf618930e43d9ed0 (DEFAULT_TABLE table=test-workload [id=ce1025c73cf04c4baf25820ae7ff0a53]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 13:04:05.745368 19400 tablet_service.cc:1511] Processing CreateTablet for tablet a08760e15aac4630a629431f56024dc8 (DEFAULT_TABLE table=test-workload [id=ce1025c73cf04c4baf25820ae7ff0a53]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 13:04:05.746652 19400 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a08760e15aac4630a629431f56024dc8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:05.750631 19600 tablet_bootstrap.cc:492] T 2a16f7501e2444fb86d4e2778e734e02 P e61c3a8f61bb48f8a963c9480e53c168: No bootstrap required, opened a new log
I20260709 13:04:05.751189 19600 ts_tablet_manager.cc:1403] T 2a16f7501e2444fb86d4e2778e734e02 P e61c3a8f61bb48f8a963c9480e53c168: Time spent bootstrapping tablet: real 0.293s	user 0.014s	sys 0.015s
I20260709 13:04:05.754047 19600 raft_consensus.cc:359] T 2a16f7501e2444fb86d4e2778e734e02 P e61c3a8f61bb48f8a963c9480e53c168 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:05.756017 19601 tablet_bootstrap.cc:492] T f1b10566f45d4a7d9029858330e02d5b P 0473d2b2d01f4459b1e90fd12cc7840e: No bootstrap required, opened a new log
I20260709 13:04:05.757709 19475 tablet_service.cc:1511] Processing CreateTablet for tablet 2b74109013a140ada21feeef92d6f563 (DEFAULT_TABLE table=test-workload [id=ce1025c73cf04c4baf25820ae7ff0a53]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 13:04:05.762615 19467 tablet_service.cc:1511] Processing CreateTablet for tablet 48824d5acfbc485ebf8c2d944e7202de (DEFAULT_TABLE table=test-workload [id=ce1025c73cf04c4baf25820ae7ff0a53]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 13:04:05.764500 19468 tablet_service.cc:1511] Processing CreateTablet for tablet 5ec1c4ce15e04c7e8c283a62179f2a64 (DEFAULT_TABLE table=test-workload [id=ce1025c73cf04c4baf25820ae7ff0a53]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 13:04:05.791321 19601 ts_tablet_manager.cc:1403] T f1b10566f45d4a7d9029858330e02d5b P 0473d2b2d01f4459b1e90fd12cc7840e: Time spent bootstrapping tablet: real 0.371s	user 0.018s	sys 0.035s
I20260709 13:04:05.791612 19475 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2b74109013a140ada21feeef92d6f563. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:05.794049 19601 raft_consensus.cc:359] T f1b10566f45d4a7d9029858330e02d5b P 0473d2b2d01f4459b1e90fd12cc7840e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:05.789862 19600 raft_consensus.cc:385] T 2a16f7501e2444fb86d4e2778e734e02 P e61c3a8f61bb48f8a963c9480e53c168 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:05.766166 19548 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 28af091831594f9d8e96482078cc7625. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:05.795009 19601 raft_consensus.cc:385] T f1b10566f45d4a7d9029858330e02d5b P 0473d2b2d01f4459b1e90fd12cc7840e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:05.795056 19600 raft_consensus.cc:740] T 2a16f7501e2444fb86d4e2778e734e02 P e61c3a8f61bb48f8a963c9480e53c168 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e61c3a8f61bb48f8a963c9480e53c168, State: Initialized, Role: FOLLOWER
I20260709 13:04:05.795370 19468 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5ec1c4ce15e04c7e8c283a62179f2a64. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:05.795470 19601 raft_consensus.cc:740] T f1b10566f45d4a7d9029858330e02d5b P 0473d2b2d01f4459b1e90fd12cc7840e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0473d2b2d01f4459b1e90fd12cc7840e, State: Initialized, Role: FOLLOWER
I20260709 13:04:05.796223 19601 consensus_queue.cc:260] T f1b10566f45d4a7d9029858330e02d5b P 0473d2b2d01f4459b1e90fd12cc7840e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:05.797540 19543 tablet_service.cc:1511] Processing CreateTablet for tablet 48824d5acfbc485ebf8c2d944e7202de (DEFAULT_TABLE table=test-workload [id=ce1025c73cf04c4baf25820ae7ff0a53]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 13:04:05.798264 19601 ts_tablet_manager.cc:1434] T f1b10566f45d4a7d9029858330e02d5b P 0473d2b2d01f4459b1e90fd12cc7840e: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.000s
I20260709 13:04:05.798629 19467 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 48824d5acfbc485ebf8c2d944e7202de. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:05.798779 19543 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 48824d5acfbc485ebf8c2d944e7202de. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:05.801147 19545 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fa731b585f684a7fb2d106c50f143b83. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:05.775910 19542 tablet_service.cc:1511] Processing CreateTablet for tablet e381f1d6b8184797ad142de49be225a8 (DEFAULT_TABLE table=test-workload [id=ce1025c73cf04c4baf25820ae7ff0a53]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 13:04:05.802409 19542 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e381f1d6b8184797ad142de49be225a8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:05.777063 19399 tablet_service.cc:1511] Processing CreateTablet for tablet 9962423cb4e54fcfa5de01daf68a86e7 (DEFAULT_TABLE table=test-workload [id=ce1025c73cf04c4baf25820ae7ff0a53]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 13:04:05.781477 19397 tablet_service.cc:1511] Processing CreateTablet for tablet 4af19371ea874c09a0a2147040835cbb (DEFAULT_TABLE table=test-workload [id=ce1025c73cf04c4baf25820ae7ff0a53]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 13:04:05.781744 19398 tablet_service.cc:1511] Processing CreateTablet for tablet df751f992649444090e27965eb1af85d (DEFAULT_TABLE table=test-workload [id=ce1025c73cf04c4baf25820ae7ff0a53]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 13:04:05.784871 19550 tablet_service.cc:1511] Processing CreateTablet for tablet 2b74109013a140ada21feeef92d6f563 (DEFAULT_TABLE table=test-workload [id=ce1025c73cf04c4baf25820ae7ff0a53]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 13:04:05.785646 19546 tablet_service.cc:1511] Processing CreateTablet for tablet 5ec1c4ce15e04c7e8c283a62179f2a64 (DEFAULT_TABLE table=test-workload [id=ce1025c73cf04c4baf25820ae7ff0a53]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 13:04:05.786243 19394 tablet_service.cc:1511] Processing CreateTablet for tablet 1dc5b3532fe54f74876d02beffa2c230 (DEFAULT_TABLE table=test-workload [id=ce1025c73cf04c4baf25820ae7ff0a53]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 13:04:05.767135 19604 tablet_bootstrap.cc:654] T 70797e5783b5454ab0d0eea663e791e3 P e5256d91808b47c195bc9b4dbd7f2b87: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:05.766659 19400 tablet_service.cc:1511] Processing CreateTablet for tablet edd7d470b5014c9489be7f41f64355c9 (DEFAULT_TABLE table=test-workload [id=ce1025c73cf04c4baf25820ae7ff0a53]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 13:04:05.808322 19549 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ff9b0eddd810459b82d91c60777c10eb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:05.810550 19601 tablet_bootstrap.cc:492] T 0afb57ae58a24a01850491d69f0213dd P 0473d2b2d01f4459b1e90fd12cc7840e: Bootstrap starting.
I20260709 13:04:05.811697 19399 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9962423cb4e54fcfa5de01daf68a86e7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:05.815014 19600 consensus_queue.cc:260] T 2a16f7501e2444fb86d4e2778e734e02 P e61c3a8f61bb48f8a963c9480e53c168 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:05.824710 19600 ts_tablet_manager.cc:1434] T 2a16f7501e2444fb86d4e2778e734e02 P e61c3a8f61bb48f8a963c9480e53c168: Time spent starting tablet: real 0.073s	user 0.002s	sys 0.004s
I20260709 13:04:05.827868 19550 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2b74109013a140ada21feeef92d6f563. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:05.829442 19546 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5ec1c4ce15e04c7e8c283a62179f2a64. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:05.830443 19600 tablet_bootstrap.cc:492] T 70797e5783b5454ab0d0eea663e791e3 P e61c3a8f61bb48f8a963c9480e53c168: Bootstrap starting.
I20260709 13:04:05.831276 19400 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet edd7d470b5014c9489be7f41f64355c9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:05.834044 19398 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet df751f992649444090e27965eb1af85d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:05.836911 19547 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ab43d85f64114d4ebf618930e43d9ed0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:05.838327 19396 tablet_service.cc:1511] Processing CreateTablet for tablet 62c6c134d3d24a1ab144dd9ee6bc3f64 (DEFAULT_TABLE table=test-workload [id=ce1025c73cf04c4baf25820ae7ff0a53]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 13:04:05.826519 19601 tablet_bootstrap.cc:654] T 0afb57ae58a24a01850491d69f0213dd P 0473d2b2d01f4459b1e90fd12cc7840e: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:05.845916 19600 tablet_bootstrap.cc:654] T 70797e5783b5454ab0d0eea663e791e3 P e61c3a8f61bb48f8a963c9480e53c168: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:05.850704 19401 tablet_service.cc:1511] Processing CreateTablet for tablet 21e14947d70440f19044d8f75c31e1f9 (DEFAULT_TABLE table=test-workload [id=ce1025c73cf04c4baf25820ae7ff0a53]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 13:04:05.857447 19393 tablet_service.cc:1511] Processing CreateTablet for tablet bc225c93219c45538b53a1bd3d387e4d (DEFAULT_TABLE table=test-workload [id=ce1025c73cf04c4baf25820ae7ff0a53]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 13:04:05.860148 19395 tablet_service.cc:1511] Processing CreateTablet for tablet 0e1085d23e8347fbbd5bce7542f4b1f4 (DEFAULT_TABLE table=test-workload [id=ce1025c73cf04c4baf25820ae7ff0a53]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 13:04:05.862867 19399 tablet_service.cc:1511] Processing CreateTablet for tablet 1efebf73c86e432baa55533136b6e12c (DEFAULT_TABLE table=test-workload [id=ce1025c73cf04c4baf25820ae7ff0a53]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 13:04:05.872063 19392 tablet_service.cc:1511] Processing CreateTablet for tablet 36f6ba92b9ba46babe4ebd6c02e5fbd9 (DEFAULT_TABLE table=test-workload [id=ce1025c73cf04c4baf25820ae7ff0a53]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 13:04:05.875187 19397 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4af19371ea874c09a0a2147040835cbb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:05.875916 19399 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1efebf73c86e432baa55533136b6e12c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:05.876677 19393 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bc225c93219c45538b53a1bd3d387e4d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:05.890975 19401 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 21e14947d70440f19044d8f75c31e1f9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:05.901145 19392 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 36f6ba92b9ba46babe4ebd6c02e5fbd9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:05.904353 19396 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 62c6c134d3d24a1ab144dd9ee6bc3f64. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:05.905846 19604 tablet_bootstrap.cc:492] T 70797e5783b5454ab0d0eea663e791e3 P e5256d91808b47c195bc9b4dbd7f2b87: No bootstrap required, opened a new log
I20260709 13:04:05.906348 19604 ts_tablet_manager.cc:1403] T 70797e5783b5454ab0d0eea663e791e3 P e5256d91808b47c195bc9b4dbd7f2b87: Time spent bootstrapping tablet: real 0.239s	user 0.021s	sys 0.001s
I20260709 13:04:05.909503 19604 raft_consensus.cc:359] T 70797e5783b5454ab0d0eea663e791e3 P e5256d91808b47c195bc9b4dbd7f2b87 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:05.910233 19604 raft_consensus.cc:385] T 70797e5783b5454ab0d0eea663e791e3 P e5256d91808b47c195bc9b4dbd7f2b87 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:05.910542 19604 raft_consensus.cc:740] T 70797e5783b5454ab0d0eea663e791e3 P e5256d91808b47c195bc9b4dbd7f2b87 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e5256d91808b47c195bc9b4dbd7f2b87, State: Initialized, Role: FOLLOWER
I20260709 13:04:05.911077 19394 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1dc5b3532fe54f74876d02beffa2c230. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:05.911453 19604 consensus_queue.cc:260] T 70797e5783b5454ab0d0eea663e791e3 P e5256d91808b47c195bc9b4dbd7f2b87 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:05.913961 19604 ts_tablet_manager.cc:1434] T 70797e5783b5454ab0d0eea663e791e3 P e5256d91808b47c195bc9b4dbd7f2b87: Time spent starting tablet: real 0.007s	user 0.009s	sys 0.000s
I20260709 13:04:05.914891 19604 tablet_bootstrap.cc:492] T f1b10566f45d4a7d9029858330e02d5b P e5256d91808b47c195bc9b4dbd7f2b87: Bootstrap starting.
I20260709 13:04:05.919005 19395 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0e1085d23e8347fbbd5bce7542f4b1f4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:05.931984 19309 catalog_manager.cc:5697] T ef32ce6fdd0e40d382c79974f30295c6 P 0473d2b2d01f4459b1e90fd12cc7840e reported cstate change: term changed from 0 to 1, leader changed from <none> to 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2). New cstate: current_term: 1 leader_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:05.933391 19604 tablet_bootstrap.cc:654] T f1b10566f45d4a7d9029858330e02d5b P e5256d91808b47c195bc9b4dbd7f2b87: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:05.944964 19601 tablet_bootstrap.cc:492] T 0afb57ae58a24a01850491d69f0213dd P 0473d2b2d01f4459b1e90fd12cc7840e: No bootstrap required, opened a new log
I20260709 13:04:05.945477 19601 ts_tablet_manager.cc:1403] T 0afb57ae58a24a01850491d69f0213dd P 0473d2b2d01f4459b1e90fd12cc7840e: Time spent bootstrapping tablet: real 0.135s	user 0.017s	sys 0.011s
I20260709 13:04:05.950872 19601 raft_consensus.cc:359] T 0afb57ae58a24a01850491d69f0213dd P 0473d2b2d01f4459b1e90fd12cc7840e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:05.951625 19601 raft_consensus.cc:385] T 0afb57ae58a24a01850491d69f0213dd P 0473d2b2d01f4459b1e90fd12cc7840e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:05.951923 19601 raft_consensus.cc:740] T 0afb57ae58a24a01850491d69f0213dd P 0473d2b2d01f4459b1e90fd12cc7840e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0473d2b2d01f4459b1e90fd12cc7840e, State: Initialized, Role: FOLLOWER
I20260709 13:04:05.976342 19603 raft_consensus.cc:493] T 0afb57ae58a24a01850491d69f0213dd P e61c3a8f61bb48f8a963c9480e53c168 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:05.976892 19603 raft_consensus.cc:515] T 0afb57ae58a24a01850491d69f0213dd P e61c3a8f61bb48f8a963c9480e53c168 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:05.978971 19603 leader_election.cc:290] T 0afb57ae58a24a01850491d69f0213dd P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:04:05.980522 19486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0afb57ae58a24a01850491d69f0213dd" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:04:05.982239 19411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0afb57ae58a24a01850491d69f0213dd" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
W20260709 13:04:05.983605 19523 leader_election.cc:343] T 0afb57ae58a24a01850491d69f0213dd P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:05.987496 19393 tablet_service.cc:1511] Processing CreateTablet for tablet 65d8cb8d6ec64f459d5a47cefab10acf (DEFAULT_TABLE table=test-workload [id=ce1025c73cf04c4baf25820ae7ff0a53]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 13:04:05.988675 19398 tablet_service.cc:1511] Processing CreateTablet for tablet ece3db938bc649d4a40a51522ed5259c (DEFAULT_TABLE table=test-workload [id=ce1025c73cf04c4baf25820ae7ff0a53]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 13:04:05.989310 19393 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 65d8cb8d6ec64f459d5a47cefab10acf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:05.990394 19398 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ece3db938bc649d4a40a51522ed5259c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:05.990899 19601 consensus_queue.cc:260] T 0afb57ae58a24a01850491d69f0213dd P 0473d2b2d01f4459b1e90fd12cc7840e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:05.992472 19615 raft_consensus.cc:493] T 70797e5783b5454ab0d0eea663e791e3 P e5256d91808b47c195bc9b4dbd7f2b87 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:06.003091 19615 raft_consensus.cc:515] T 70797e5783b5454ab0d0eea663e791e3 P e5256d91808b47c195bc9b4dbd7f2b87 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:06.004685 19601 ts_tablet_manager.cc:1434] T 0afb57ae58a24a01850491d69f0213dd P 0473d2b2d01f4459b1e90fd12cc7840e: Time spent starting tablet: real 0.058s	user 0.002s	sys 0.004s
I20260709 13:04:06.005681 19615 leader_election.cc:290] T 70797e5783b5454ab0d0eea663e791e3 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:04:06.006304 19486 raft_consensus.cc:2468] T 0afb57ae58a24a01850491d69f0213dd P 0473d2b2d01f4459b1e90fd12cc7840e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 0.
I20260709 13:04:06.011792 19526 leader_election.cc:304] T 0afb57ae58a24a01850491d69f0213dd P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168; no voters: e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:04:06.013824 19603 raft_consensus.cc:2804] T 0afb57ae58a24a01850491d69f0213dd P e61c3a8f61bb48f8a963c9480e53c168 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:06.014362 19603 raft_consensus.cc:493] T 0afb57ae58a24a01850491d69f0213dd P e61c3a8f61bb48f8a963c9480e53c168 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:06.014778 19603 raft_consensus.cc:3060] T 0afb57ae58a24a01850491d69f0213dd P e61c3a8f61bb48f8a963c9480e53c168 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:06.005703 19601 tablet_bootstrap.cc:492] T 1f85fc4b527a48848e5faa083b604e36 P 0473d2b2d01f4459b1e90fd12cc7840e: Bootstrap starting.
W20260709 13:04:06.026283 19357 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:04:06.028703 19604 tablet_bootstrap.cc:492] T f1b10566f45d4a7d9029858330e02d5b P e5256d91808b47c195bc9b4dbd7f2b87: No bootstrap required, opened a new log
I20260709 13:04:06.029289 19604 ts_tablet_manager.cc:1403] T f1b10566f45d4a7d9029858330e02d5b P e5256d91808b47c195bc9b4dbd7f2b87: Time spent bootstrapping tablet: real 0.115s	user 0.016s	sys 0.032s
I20260709 13:04:06.032961 19604 raft_consensus.cc:359] T f1b10566f45d4a7d9029858330e02d5b P e5256d91808b47c195bc9b4dbd7f2b87 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:06.033846 19604 raft_consensus.cc:385] T f1b10566f45d4a7d9029858330e02d5b P e5256d91808b47c195bc9b4dbd7f2b87 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:06.034209 19604 raft_consensus.cc:740] T f1b10566f45d4a7d9029858330e02d5b P e5256d91808b47c195bc9b4dbd7f2b87 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e5256d91808b47c195bc9b4dbd7f2b87, State: Initialized, Role: FOLLOWER
I20260709 13:04:06.035414 19604 consensus_queue.cc:260] T f1b10566f45d4a7d9029858330e02d5b P e5256d91808b47c195bc9b4dbd7f2b87 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:06.047997 19600 tablet_bootstrap.cc:492] T 70797e5783b5454ab0d0eea663e791e3 P e61c3a8f61bb48f8a963c9480e53c168: No bootstrap required, opened a new log
I20260709 13:04:06.048321 19604 ts_tablet_manager.cc:1434] T f1b10566f45d4a7d9029858330e02d5b P e5256d91808b47c195bc9b4dbd7f2b87: Time spent starting tablet: real 0.019s	user 0.010s	sys 0.001s
I20260709 13:04:06.047570 19396 tablet_service.cc:1511] Processing CreateTablet for tablet 179fd671030940b4b4a4e24bcc4aba0a (DEFAULT_TABLE table=test-workload [id=ce1025c73cf04c4baf25820ae7ff0a53]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 13:04:06.048703 19600 ts_tablet_manager.cc:1403] T 70797e5783b5454ab0d0eea663e791e3 P e61c3a8f61bb48f8a963c9480e53c168: Time spent bootstrapping tablet: real 0.218s	user 0.021s	sys 0.026s
I20260709 13:04:06.051090 19399 tablet_service.cc:1511] Processing CreateTablet for tablet 85c494af21f9457a85da47b9bc70c1fd (DEFAULT_TABLE table=test-workload [id=ce1025c73cf04c4baf25820ae7ff0a53]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 13:04:06.051261 19392 tablet_service.cc:1511] Processing CreateTablet for tablet 4509b76741dc428e9201c70c1658da13 (DEFAULT_TABLE table=test-workload [id=ce1025c73cf04c4baf25820ae7ff0a53]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 13:04:06.051570 19600 raft_consensus.cc:359] T 70797e5783b5454ab0d0eea663e791e3 P e61c3a8f61bb48f8a963c9480e53c168 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:06.056710 19600 raft_consensus.cc:385] T 70797e5783b5454ab0d0eea663e791e3 P e61c3a8f61bb48f8a963c9480e53c168 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:06.057026 19600 raft_consensus.cc:740] T 70797e5783b5454ab0d0eea663e791e3 P e61c3a8f61bb48f8a963c9480e53c168 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e61c3a8f61bb48f8a963c9480e53c168, State: Initialized, Role: FOLLOWER
I20260709 13:04:06.057776 19600 consensus_queue.cc:260] T 70797e5783b5454ab0d0eea663e791e3 P e61c3a8f61bb48f8a963c9480e53c168 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:06.052990 19603 raft_consensus.cc:515] T 0afb57ae58a24a01850491d69f0213dd P e61c3a8f61bb48f8a963c9480e53c168 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:06.062105 19603 leader_election.cc:290] T 0afb57ae58a24a01850491d69f0213dd P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 1 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:04:06.063271 19486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0afb57ae58a24a01850491d69f0213dd" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:04:06.063839 19486 raft_consensus.cc:3060] T 0afb57ae58a24a01850491d69f0213dd P 0473d2b2d01f4459b1e90fd12cc7840e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:06.080068 19603 raft_consensus.cc:493] T 2a16f7501e2444fb86d4e2778e734e02 P e61c3a8f61bb48f8a963c9480e53c168 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:06.080821 19603 raft_consensus.cc:515] T 2a16f7501e2444fb86d4e2778e734e02 P e61c3a8f61bb48f8a963c9480e53c168 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:06.084142 19603 leader_election.cc:290] T 2a16f7501e2444fb86d4e2778e734e02 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:04:06.085328 19485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a16f7501e2444fb86d4e2778e734e02" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:04:06.086764 19411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0afb57ae58a24a01850491d69f0213dd" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
I20260709 13:04:06.078028 19400 tablet_service.cc:1511] Processing CreateTablet for tablet 76cb037fc9064d13b59a8969d897ce8c (DEFAULT_TABLE table=test-workload [id=ce1025c73cf04c4baf25820ae7ff0a53]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
W20260709 13:04:06.088699 19526 leader_election.cc:343] T 2a16f7501e2444fb86d4e2778e734e02 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:06.088028 19410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a16f7501e2444fb86d4e2778e734e02" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
W20260709 13:04:06.088508 19523 leader_election.cc:343] T 0afb57ae58a24a01850491d69f0213dd P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:04:06.090545 19523 leader_election.cc:343] T 2a16f7501e2444fb86d4e2778e734e02 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:06.091435 19396 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 179fd671030940b4b4a4e24bcc4aba0a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:06.091188 19523 leader_election.cc:304] T 2a16f7501e2444fb86d4e2778e734e02 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e61c3a8f61bb48f8a963c9480e53c168; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:04:06.092726 19392 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4509b76741dc428e9201c70c1658da13. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:06.093509 19400 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 76cb037fc9064d13b59a8969d897ce8c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:06.092734 19603 raft_consensus.cc:2749] T 2a16f7501e2444fb86d4e2778e734e02 P e61c3a8f61bb48f8a963c9480e53c168 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:04:06.094615 19399 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 85c494af21f9457a85da47b9bc70c1fd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:06.070758 19604 tablet_bootstrap.cc:492] T 217b5fae677b4971b3bbd2f357a1f7ff P e5256d91808b47c195bc9b4dbd7f2b87: Bootstrap starting.
I20260709 13:04:06.102108 19600 ts_tablet_manager.cc:1434] T 70797e5783b5454ab0d0eea663e791e3 P e61c3a8f61bb48f8a963c9480e53c168: Time spent starting tablet: real 0.053s	user 0.025s	sys 0.016s
I20260709 13:04:06.105837 19600 tablet_bootstrap.cc:492] T 7be9efa6559648dbb5a0f7684c4542d1 P e61c3a8f61bb48f8a963c9480e53c168: Bootstrap starting.
I20260709 13:04:06.108278 19486 raft_consensus.cc:2468] T 0afb57ae58a24a01850491d69f0213dd P 0473d2b2d01f4459b1e90fd12cc7840e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 1.
I20260709 13:04:06.109556 19526 leader_election.cc:304] T 0afb57ae58a24a01850491d69f0213dd P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168; no voters: e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:04:06.110347 19603 raft_consensus.cc:2804] T 0afb57ae58a24a01850491d69f0213dd P e61c3a8f61bb48f8a963c9480e53c168 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:06.110836 19603 raft_consensus.cc:697] T 0afb57ae58a24a01850491d69f0213dd P e61c3a8f61bb48f8a963c9480e53c168 [term 1 LEADER]: Becoming Leader. State: Replica: e61c3a8f61bb48f8a963c9480e53c168, State: Running, Role: LEADER
I20260709 13:04:06.111665 19603 consensus_queue.cc:237] T 0afb57ae58a24a01850491d69f0213dd P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:06.113926 19601 tablet_bootstrap.cc:654] T 1f85fc4b527a48848e5faa083b604e36 P 0473d2b2d01f4459b1e90fd12cc7840e: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:06.116356 19397 tablet_service.cc:1511] Processing CreateTablet for tablet 775c229504194560ba9589bc2199b089 (DEFAULT_TABLE table=test-workload [id=ce1025c73cf04c4baf25820ae7ff0a53]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 13:04:06.117652 19397 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 775c229504194560ba9589bc2199b089. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:06.115499 19400 tablet_service.cc:1511] Processing CreateTablet for tablet 833a2f0775ed407a94b8924ce50adb63 (DEFAULT_TABLE table=test-workload [id=ce1025c73cf04c4baf25820ae7ff0a53]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 13:04:06.121158 19486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70797e5783b5454ab0d0eea663e791e3" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
W20260709 13:04:06.123637 19377 leader_election.cc:343] T 70797e5783b5454ab0d0eea663e791e3 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:06.124505 19400 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 833a2f0775ed407a94b8924ce50adb63. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:06.131109 19560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70797e5783b5454ab0d0eea663e791e3" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:04:06.131769 19560 raft_consensus.cc:2468] T 70797e5783b5454ab0d0eea663e791e3 P e61c3a8f61bb48f8a963c9480e53c168 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 0.
I20260709 13:04:06.137998 19375 leader_election.cc:304] T 70797e5783b5454ab0d0eea663e791e3 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168; no voters: 0473d2b2d01f4459b1e90fd12cc7840e
I20260709 13:04:06.138768 19615 raft_consensus.cc:2804] T 70797e5783b5454ab0d0eea663e791e3 P e5256d91808b47c195bc9b4dbd7f2b87 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:06.139103 19615 raft_consensus.cc:493] T 70797e5783b5454ab0d0eea663e791e3 P e5256d91808b47c195bc9b4dbd7f2b87 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:06.139452 19615 raft_consensus.cc:3060] T 70797e5783b5454ab0d0eea663e791e3 P e5256d91808b47c195bc9b4dbd7f2b87 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:06.147327 19615 raft_consensus.cc:515] T 70797e5783b5454ab0d0eea663e791e3 P e5256d91808b47c195bc9b4dbd7f2b87 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:06.149747 19615 leader_election.cc:290] T 70797e5783b5454ab0d0eea663e791e3 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 1 election: Requested vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:04:06.150997 19560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70797e5783b5454ab0d0eea663e791e3" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:04:06.151470 19560 raft_consensus.cc:3060] T 70797e5783b5454ab0d0eea663e791e3 P e61c3a8f61bb48f8a963c9480e53c168 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:06.156524 19486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70797e5783b5454ab0d0eea663e791e3" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:04:06.160013 19600 tablet_bootstrap.cc:654] T 7be9efa6559648dbb5a0f7684c4542d1 P e61c3a8f61bb48f8a963c9480e53c168: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:06.131624 19398 tablet_service.cc:1511] Processing CreateTablet for tablet 28af091831594f9d8e96482078cc7625 (DEFAULT_TABLE table=test-workload [id=ce1025c73cf04c4baf25820ae7ff0a53]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 13:04:06.167030 19397 tablet_service.cc:1511] Processing CreateTablet for tablet fa731b585f684a7fb2d106c50f143b83 (DEFAULT_TABLE table=test-workload [id=ce1025c73cf04c4baf25820ae7ff0a53]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 13:04:06.168196 19397 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fa731b585f684a7fb2d106c50f143b83. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:04:06.164865 19377 leader_election.cc:343] T 70797e5783b5454ab0d0eea663e791e3 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:06.176733 19308 catalog_manager.cc:5697] T 0afb57ae58a24a01850491d69f0213dd P e61c3a8f61bb48f8a963c9480e53c168 reported cstate change: term changed from 0 to 1, leader changed from <none> to e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3). New cstate: current_term: 1 leader_uuid: "e61c3a8f61bb48f8a963c9480e53c168" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } health_report { overall_health: HEALTHY } } }
I20260709 13:04:06.181046 19400 tablet_service.cc:1511] Processing CreateTablet for tablet ab43d85f64114d4ebf618930e43d9ed0 (DEFAULT_TABLE table=test-workload [id=ce1025c73cf04c4baf25820ae7ff0a53]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 13:04:06.179862 19560 raft_consensus.cc:2468] T 70797e5783b5454ab0d0eea663e791e3 P e61c3a8f61bb48f8a963c9480e53c168 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 1.
I20260709 13:04:06.186164 19375 leader_election.cc:304] T 70797e5783b5454ab0d0eea663e791e3 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168; no voters: 0473d2b2d01f4459b1e90fd12cc7840e
I20260709 13:04:06.186398 19397 tablet_service.cc:1511] Processing CreateTablet for tablet 2b74109013a140ada21feeef92d6f563 (DEFAULT_TABLE table=test-workload [id=ce1025c73cf04c4baf25820ae7ff0a53]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 13:04:06.186848 19398 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 28af091831594f9d8e96482078cc7625. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:06.187284 19615 raft_consensus.cc:2804] T 70797e5783b5454ab0d0eea663e791e3 P e5256d91808b47c195bc9b4dbd7f2b87 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:06.187620 19397 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2b74109013a140ada21feeef92d6f563. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:06.188460 19400 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ab43d85f64114d4ebf618930e43d9ed0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:06.179685 19393 tablet_service.cc:1511] Processing CreateTablet for tablet ff9b0eddd810459b82d91c60777c10eb (DEFAULT_TABLE table=test-workload [id=ce1025c73cf04c4baf25820ae7ff0a53]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 13:04:06.189595 19393 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ff9b0eddd810459b82d91c60777c10eb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:06.198527 19601 tablet_bootstrap.cc:492] T 1f85fc4b527a48848e5faa083b604e36 P 0473d2b2d01f4459b1e90fd12cc7840e: No bootstrap required, opened a new log
I20260709 13:04:06.199221 19601 ts_tablet_manager.cc:1403] T 1f85fc4b527a48848e5faa083b604e36 P 0473d2b2d01f4459b1e90fd12cc7840e: Time spent bootstrapping tablet: real 0.194s	user 0.010s	sys 0.009s
I20260709 13:04:06.204159 19400 tablet_service.cc:1511] Processing CreateTablet for tablet 48824d5acfbc485ebf8c2d944e7202de (DEFAULT_TABLE table=test-workload [id=ce1025c73cf04c4baf25820ae7ff0a53]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 13:04:06.205157 19400 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 48824d5acfbc485ebf8c2d944e7202de. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:06.211303 19601 raft_consensus.cc:359] T 1f85fc4b527a48848e5faa083b604e36 P 0473d2b2d01f4459b1e90fd12cc7840e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } }
I20260709 13:04:06.212313 19601 raft_consensus.cc:385] T 1f85fc4b527a48848e5faa083b604e36 P 0473d2b2d01f4459b1e90fd12cc7840e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:06.212661 19601 raft_consensus.cc:740] T 1f85fc4b527a48848e5faa083b604e36 P 0473d2b2d01f4459b1e90fd12cc7840e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0473d2b2d01f4459b1e90fd12cc7840e, State: Initialized, Role: FOLLOWER
I20260709 13:04:06.213232 19604 tablet_bootstrap.cc:654] T 217b5fae677b4971b3bbd2f357a1f7ff P e5256d91808b47c195bc9b4dbd7f2b87: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:06.213662 19601 consensus_queue.cc:260] T 1f85fc4b527a48848e5faa083b604e36 P 0473d2b2d01f4459b1e90fd12cc7840e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } }
I20260709 13:04:06.211230 19401 tablet_service.cc:1511] Processing CreateTablet for tablet 5ec1c4ce15e04c7e8c283a62179f2a64 (DEFAULT_TABLE table=test-workload [id=ce1025c73cf04c4baf25820ae7ff0a53]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 13:04:06.227114 19601 ts_tablet_manager.cc:1434] T 1f85fc4b527a48848e5faa083b604e36 P 0473d2b2d01f4459b1e90fd12cc7840e: Time spent starting tablet: real 0.028s	user 0.008s	sys 0.000s
W20260709 13:04:06.230831 19450 consensus_peers.cc:597] T ef32ce6fdd0e40d382c79974f30295c6 P 0473d2b2d01f4459b1e90fd12cc7840e -> Peer e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891): Couldn't send request to peer e61c3a8f61bb48f8a963c9480e53c168. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:06.218978 19615 raft_consensus.cc:697] T 70797e5783b5454ab0d0eea663e791e3 P e5256d91808b47c195bc9b4dbd7f2b87 [term 1 LEADER]: Becoming Leader. State: Replica: e5256d91808b47c195bc9b4dbd7f2b87, State: Running, Role: LEADER
I20260709 13:04:06.208068 19399 tablet_service.cc:1511] Processing CreateTablet for tablet e381f1d6b8184797ad142de49be225a8 (DEFAULT_TABLE table=test-workload [id=ce1025c73cf04c4baf25820ae7ff0a53]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 13:04:06.235734 19633 raft_consensus.cc:493] T f1b10566f45d4a7d9029858330e02d5b P e5256d91808b47c195bc9b4dbd7f2b87 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:06.236768 19601 tablet_bootstrap.cc:492] T 217b5fae677b4971b3bbd2f357a1f7ff P 0473d2b2d01f4459b1e90fd12cc7840e: Bootstrap starting.
I20260709 13:04:06.246698 19633 raft_consensus.cc:515] T f1b10566f45d4a7d9029858330e02d5b P e5256d91808b47c195bc9b4dbd7f2b87 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:06.234359 19615 consensus_queue.cc:237] T 70797e5783b5454ab0d0eea663e791e3 P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:06.249962 19486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1b10566f45d4a7d9029858330e02d5b" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:04:06.251367 19486 raft_consensus.cc:2468] T f1b10566f45d4a7d9029858330e02d5b P 0473d2b2d01f4459b1e90fd12cc7840e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 0.
I20260709 13:04:06.252566 19377 leader_election.cc:304] T f1b10566f45d4a7d9029858330e02d5b P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87; no voters: 
I20260709 13:04:06.253547 19634 raft_consensus.cc:2804] T f1b10566f45d4a7d9029858330e02d5b P e5256d91808b47c195bc9b4dbd7f2b87 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:06.253943 19634 raft_consensus.cc:493] T f1b10566f45d4a7d9029858330e02d5b P e5256d91808b47c195bc9b4dbd7f2b87 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:06.254290 19634 raft_consensus.cc:3060] T f1b10566f45d4a7d9029858330e02d5b P e5256d91808b47c195bc9b4dbd7f2b87 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:06.257871 19601 tablet_bootstrap.cc:654] T 217b5fae677b4971b3bbd2f357a1f7ff P 0473d2b2d01f4459b1e90fd12cc7840e: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:06.261700 19634 raft_consensus.cc:515] T f1b10566f45d4a7d9029858330e02d5b P e5256d91808b47c195bc9b4dbd7f2b87 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:06.249962 19401 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5ec1c4ce15e04c7e8c283a62179f2a64. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:06.266484 19399 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e381f1d6b8184797ad142de49be225a8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:06.269030 19604 tablet_bootstrap.cc:492] T 217b5fae677b4971b3bbd2f357a1f7ff P e5256d91808b47c195bc9b4dbd7f2b87: No bootstrap required, opened a new log
I20260709 13:04:06.269667 19604 ts_tablet_manager.cc:1403] T 217b5fae677b4971b3bbd2f357a1f7ff P e5256d91808b47c195bc9b4dbd7f2b87: Time spent bootstrapping tablet: real 0.217s	user 0.005s	sys 0.015s
I20260709 13:04:06.271574 19560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1b10566f45d4a7d9029858330e02d5b" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
W20260709 13:04:06.273311 19375 leader_election.cc:343] T f1b10566f45d4a7d9029858330e02d5b P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:06.273599 19486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1b10566f45d4a7d9029858330e02d5b" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:04:06.274148 19486 raft_consensus.cc:3060] T f1b10566f45d4a7d9029858330e02d5b P 0473d2b2d01f4459b1e90fd12cc7840e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:06.274739 19604 raft_consensus.cc:359] T 217b5fae677b4971b3bbd2f357a1f7ff P e5256d91808b47c195bc9b4dbd7f2b87 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:06.275554 19604 raft_consensus.cc:385] T 217b5fae677b4971b3bbd2f357a1f7ff P e5256d91808b47c195bc9b4dbd7f2b87 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:06.275830 19604 raft_consensus.cc:740] T 217b5fae677b4971b3bbd2f357a1f7ff P e5256d91808b47c195bc9b4dbd7f2b87 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e5256d91808b47c195bc9b4dbd7f2b87, State: Initialized, Role: FOLLOWER
I20260709 13:04:06.276563 19604 consensus_queue.cc:260] T 217b5fae677b4971b3bbd2f357a1f7ff P e5256d91808b47c195bc9b4dbd7f2b87 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:06.275830 19601 tablet_bootstrap.cc:492] T 217b5fae677b4971b3bbd2f357a1f7ff P 0473d2b2d01f4459b1e90fd12cc7840e: No bootstrap required, opened a new log
I20260709 13:04:06.279837 19601 ts_tablet_manager.cc:1403] T 217b5fae677b4971b3bbd2f357a1f7ff P 0473d2b2d01f4459b1e90fd12cc7840e: Time spent bootstrapping tablet: real 0.043s	user 0.017s	sys 0.001s
I20260709 13:04:06.282837 19601 raft_consensus.cc:359] T 217b5fae677b4971b3bbd2f357a1f7ff P 0473d2b2d01f4459b1e90fd12cc7840e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:06.283573 19601 raft_consensus.cc:385] T 217b5fae677b4971b3bbd2f357a1f7ff P 0473d2b2d01f4459b1e90fd12cc7840e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:06.284421 19601 raft_consensus.cc:740] T 217b5fae677b4971b3bbd2f357a1f7ff P 0473d2b2d01f4459b1e90fd12cc7840e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0473d2b2d01f4459b1e90fd12cc7840e, State: Initialized, Role: FOLLOWER
I20260709 13:04:06.285022 19600 tablet_bootstrap.cc:492] T 7be9efa6559648dbb5a0f7684c4542d1 P e61c3a8f61bb48f8a963c9480e53c168: No bootstrap required, opened a new log
I20260709 13:04:06.285533 19600 ts_tablet_manager.cc:1403] T 7be9efa6559648dbb5a0f7684c4542d1 P e61c3a8f61bb48f8a963c9480e53c168: Time spent bootstrapping tablet: real 0.180s	user 0.015s	sys 0.020s
I20260709 13:04:06.285197 19601 consensus_queue.cc:260] T 217b5fae677b4971b3bbd2f357a1f7ff P 0473d2b2d01f4459b1e90fd12cc7840e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:06.271672 19633 leader_election.cc:290] T f1b10566f45d4a7d9029858330e02d5b P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:04:06.287632 19634 leader_election.cc:290] T f1b10566f45d4a7d9029858330e02d5b P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 1 election: Requested vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:04:06.288499 19611 raft_consensus.cc:493] T 1f85fc4b527a48848e5faa083b604e36 P 0473d2b2d01f4459b1e90fd12cc7840e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:06.288959 19611 raft_consensus.cc:515] T 1f85fc4b527a48848e5faa083b604e36 P 0473d2b2d01f4459b1e90fd12cc7840e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } }
I20260709 13:04:06.290752 19486 raft_consensus.cc:2468] T f1b10566f45d4a7d9029858330e02d5b P 0473d2b2d01f4459b1e90fd12cc7840e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 1.
I20260709 13:04:06.290356 19308 catalog_manager.cc:5697] T 70797e5783b5454ab0d0eea663e791e3 P e5256d91808b47c195bc9b4dbd7f2b87 reported cstate change: term changed from 0 to 1, leader changed from <none> to e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1). New cstate: current_term: 1 leader_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:06.292865 19377 leader_election.cc:304] T f1b10566f45d4a7d9029858330e02d5b P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87; no voters: 
I20260709 13:04:06.293162 19559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1b10566f45d4a7d9029858330e02d5b" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:04:06.293812 19560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f85fc4b527a48848e5faa083b604e36" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
W20260709 13:04:06.294590 19375 leader_election.cc:343] T f1b10566f45d4a7d9029858330e02d5b P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:06.291179 19611 leader_election.cc:290] T 1f85fc4b527a48848e5faa083b604e36 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891), e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321)
I20260709 13:04:06.294407 19560 raft_consensus.cc:2468] T 1f85fc4b527a48848e5faa083b604e36 P e61c3a8f61bb48f8a963c9480e53c168 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 0.
I20260709 13:04:06.295781 19600 raft_consensus.cc:359] T 7be9efa6559648dbb5a0f7684c4542d1 P e61c3a8f61bb48f8a963c9480e53c168 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:06.296501 19450 leader_election.cc:304] T 1f85fc4b527a48848e5faa083b604e36 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:04:06.296584 19600 raft_consensus.cc:385] T 7be9efa6559648dbb5a0f7684c4542d1 P e61c3a8f61bb48f8a963c9480e53c168 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:06.296679 19410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f85fc4b527a48848e5faa083b604e36" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:04:06.296859 19615 raft_consensus.cc:2804] T f1b10566f45d4a7d9029858330e02d5b P e5256d91808b47c195bc9b4dbd7f2b87 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:06.297125 19600 raft_consensus.cc:740] T 7be9efa6559648dbb5a0f7684c4542d1 P e61c3a8f61bb48f8a963c9480e53c168 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e61c3a8f61bb48f8a963c9480e53c168, State: Initialized, Role: FOLLOWER
I20260709 13:04:06.297406 19611 raft_consensus.cc:2804] T 1f85fc4b527a48848e5faa083b604e36 P 0473d2b2d01f4459b1e90fd12cc7840e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:06.297700 19615 raft_consensus.cc:697] T f1b10566f45d4a7d9029858330e02d5b P e5256d91808b47c195bc9b4dbd7f2b87 [term 1 LEADER]: Becoming Leader. State: Replica: e5256d91808b47c195bc9b4dbd7f2b87, State: Running, Role: LEADER
I20260709 13:04:06.297812 19611 raft_consensus.cc:493] T 1f85fc4b527a48848e5faa083b604e36 P 0473d2b2d01f4459b1e90fd12cc7840e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:06.299093 19600 consensus_queue.cc:260] T 7be9efa6559648dbb5a0f7684c4542d1 P e61c3a8f61bb48f8a963c9480e53c168 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:06.300733 19601 ts_tablet_manager.cc:1434] T 217b5fae677b4971b3bbd2f357a1f7ff P 0473d2b2d01f4459b1e90fd12cc7840e: Time spent starting tablet: real 0.021s	user 0.005s	sys 0.002s
I20260709 13:04:06.302211 19601 tablet_bootstrap.cc:492] T fa8650e71aa14778b3d73721fc50d9fc P 0473d2b2d01f4459b1e90fd12cc7840e: Bootstrap starting.
I20260709 13:04:06.299533 19615 consensus_queue.cc:237] T f1b10566f45d4a7d9029858330e02d5b P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
W20260709 13:04:06.298187 19449 leader_election.cc:343] T 1f85fc4b527a48848e5faa083b604e36 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:06.298223 19611 raft_consensus.cc:3060] T 1f85fc4b527a48848e5faa083b604e36 P 0473d2b2d01f4459b1e90fd12cc7840e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:06.307595 19600 ts_tablet_manager.cc:1434] T 7be9efa6559648dbb5a0f7684c4542d1 P e61c3a8f61bb48f8a963c9480e53c168: Time spent starting tablet: real 0.020s	user 0.003s	sys 0.003s
I20260709 13:04:06.308629 19600 tablet_bootstrap.cc:492] T 14efcc79969f41babe5529c22d59156d P e61c3a8f61bb48f8a963c9480e53c168: Bootstrap starting.
I20260709 13:04:06.312213 19601 tablet_bootstrap.cc:654] T fa8650e71aa14778b3d73721fc50d9fc P 0473d2b2d01f4459b1e90fd12cc7840e: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:06.324141 19600 tablet_bootstrap.cc:654] T 14efcc79969f41babe5529c22d59156d P e61c3a8f61bb48f8a963c9480e53c168: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:06.331739 19640 consensus_queue.cc:1048] T ef32ce6fdd0e40d382c79974f30295c6 P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:04:06.333851 19600 tablet_bootstrap.cc:492] T 14efcc79969f41babe5529c22d59156d P e61c3a8f61bb48f8a963c9480e53c168: No bootstrap required, opened a new log
I20260709 13:04:06.334326 19600 ts_tablet_manager.cc:1403] T 14efcc79969f41babe5529c22d59156d P e61c3a8f61bb48f8a963c9480e53c168: Time spent bootstrapping tablet: real 0.026s	user 0.008s	sys 0.002s
I20260709 13:04:06.342722 19600 raft_consensus.cc:359] T 14efcc79969f41babe5529c22d59156d P e61c3a8f61bb48f8a963c9480e53c168 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:06.343410 19600 raft_consensus.cc:385] T 14efcc79969f41babe5529c22d59156d P e61c3a8f61bb48f8a963c9480e53c168 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:06.343698 19600 raft_consensus.cc:740] T 14efcc79969f41babe5529c22d59156d P e61c3a8f61bb48f8a963c9480e53c168 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e61c3a8f61bb48f8a963c9480e53c168, State: Initialized, Role: FOLLOWER
I20260709 13:04:06.346213 19604 ts_tablet_manager.cc:1434] T 217b5fae677b4971b3bbd2f357a1f7ff P e5256d91808b47c195bc9b4dbd7f2b87: Time spent starting tablet: real 0.076s	user 0.014s	sys 0.013s
I20260709 13:04:06.346340 19611 raft_consensus.cc:515] T 1f85fc4b527a48848e5faa083b604e36 P 0473d2b2d01f4459b1e90fd12cc7840e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } }
I20260709 13:04:06.347291 19604 tablet_bootstrap.cc:492] T 0afb57ae58a24a01850491d69f0213dd P e5256d91808b47c195bc9b4dbd7f2b87: Bootstrap starting.
I20260709 13:04:06.349128 19560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f85fc4b527a48848e5faa083b604e36" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:04:06.349715 19560 raft_consensus.cc:3060] T 1f85fc4b527a48848e5faa083b604e36 P e61c3a8f61bb48f8a963c9480e53c168 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:06.350972 19600 consensus_queue.cc:260] T 14efcc79969f41babe5529c22d59156d P e61c3a8f61bb48f8a963c9480e53c168 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:06.355118 19604 tablet_bootstrap.cc:654] T 0afb57ae58a24a01850491d69f0213dd P e5256d91808b47c195bc9b4dbd7f2b87: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:06.356902 19560 raft_consensus.cc:2468] T 1f85fc4b527a48848e5faa083b604e36 P e61c3a8f61bb48f8a963c9480e53c168 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 1.
I20260709 13:04:06.358130 19450 leader_election.cc:304] T 1f85fc4b527a48848e5faa083b604e36 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:04:06.358973 19640 raft_consensus.cc:2804] T 1f85fc4b527a48848e5faa083b604e36 P 0473d2b2d01f4459b1e90fd12cc7840e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:06.362490 19600 ts_tablet_manager.cc:1434] T 14efcc79969f41babe5529c22d59156d P e61c3a8f61bb48f8a963c9480e53c168: Time spent starting tablet: real 0.028s	user 0.008s	sys 0.000s
I20260709 13:04:06.363677 19600 tablet_bootstrap.cc:492] T ef32ce6fdd0e40d382c79974f30295c6 P e61c3a8f61bb48f8a963c9480e53c168: Bootstrap starting.
I20260709 13:04:06.376978 19603 raft_consensus.cc:493] T 7be9efa6559648dbb5a0f7684c4542d1 P e61c3a8f61bb48f8a963c9480e53c168 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:06.377472 19603 raft_consensus.cc:515] T 7be9efa6559648dbb5a0f7684c4542d1 P e61c3a8f61bb48f8a963c9480e53c168 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:06.379510 19603 leader_election.cc:290] T 7be9efa6559648dbb5a0f7684c4542d1 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:04:06.385462 19410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7be9efa6559648dbb5a0f7684c4542d1" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:04:06.385926 19611 leader_election.cc:290] T 1f85fc4b527a48848e5faa083b604e36 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 1 election: Requested vote from peers e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891), e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321)
I20260709 13:04:06.381278 19600 tablet_bootstrap.cc:654] T ef32ce6fdd0e40d382c79974f30295c6 P e61c3a8f61bb48f8a963c9480e53c168: Neither blocks nor log segments found. Creating new log.
W20260709 13:04:06.386821 19523 leader_election.cc:343] T 7be9efa6559648dbb5a0f7684c4542d1 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:06.388149 19604 tablet_bootstrap.cc:492] T 0afb57ae58a24a01850491d69f0213dd P e5256d91808b47c195bc9b4dbd7f2b87: No bootstrap required, opened a new log
I20260709 13:04:06.388652 19604 ts_tablet_manager.cc:1403] T 0afb57ae58a24a01850491d69f0213dd P e5256d91808b47c195bc9b4dbd7f2b87: Time spent bootstrapping tablet: real 0.042s	user 0.009s	sys 0.007s
I20260709 13:04:06.391981 19604 raft_consensus.cc:359] T 0afb57ae58a24a01850491d69f0213dd P e5256d91808b47c195bc9b4dbd7f2b87 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:06.392748 19604 raft_consensus.cc:385] T 0afb57ae58a24a01850491d69f0213dd P e5256d91808b47c195bc9b4dbd7f2b87 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:06.393045 19604 raft_consensus.cc:740] T 0afb57ae58a24a01850491d69f0213dd P e5256d91808b47c195bc9b4dbd7f2b87 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e5256d91808b47c195bc9b4dbd7f2b87, State: Initialized, Role: FOLLOWER
I20260709 13:04:06.393715 19640 raft_consensus.cc:697] T 1f85fc4b527a48848e5faa083b604e36 P 0473d2b2d01f4459b1e90fd12cc7840e [term 1 LEADER]: Becoming Leader. State: Replica: 0473d2b2d01f4459b1e90fd12cc7840e, State: Running, Role: LEADER
I20260709 13:04:06.393747 19604 consensus_queue.cc:260] T 0afb57ae58a24a01850491d69f0213dd P e5256d91808b47c195bc9b4dbd7f2b87 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:06.394022 19600 tablet_bootstrap.cc:492] T ef32ce6fdd0e40d382c79974f30295c6 P e61c3a8f61bb48f8a963c9480e53c168: No bootstrap required, opened a new log
I20260709 13:04:06.394711 19640 consensus_queue.cc:237] T 1f85fc4b527a48848e5faa083b604e36 P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } }
I20260709 13:04:06.395920 19600 ts_tablet_manager.cc:1403] T ef32ce6fdd0e40d382c79974f30295c6 P e61c3a8f61bb48f8a963c9480e53c168: Time spent bootstrapping tablet: real 0.032s	user 0.010s	sys 0.004s
I20260709 13:04:06.396382 19604 ts_tablet_manager.cc:1434] T 0afb57ae58a24a01850491d69f0213dd P e5256d91808b47c195bc9b4dbd7f2b87: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.002s
I20260709 13:04:06.397451 19604 tablet_bootstrap.cc:492] T 7be9efa6559648dbb5a0f7684c4542d1 P e5256d91808b47c195bc9b4dbd7f2b87: Bootstrap starting.
I20260709 13:04:06.400441 19410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f85fc4b527a48848e5faa083b604e36" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
I20260709 13:04:06.400813 19486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7be9efa6559648dbb5a0f7684c4542d1" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
W20260709 13:04:06.401998 19526 leader_election.cc:343] T 7be9efa6559648dbb5a0f7684c4542d1 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:06.402433 19526 leader_election.cc:304] T 7be9efa6559648dbb5a0f7684c4542d1 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e61c3a8f61bb48f8a963c9480e53c168; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:04:06.403537 19603 raft_consensus.cc:2749] T 7be9efa6559648dbb5a0f7684c4542d1 P e61c3a8f61bb48f8a963c9480e53c168 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:04:06.404577 19449 leader_election.cc:343] T 1f85fc4b527a48848e5faa083b604e36 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:06.406957 19604 tablet_bootstrap.cc:654] T 7be9efa6559648dbb5a0f7684c4542d1 P e5256d91808b47c195bc9b4dbd7f2b87: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:06.428707 19601 tablet_bootstrap.cc:492] T fa8650e71aa14778b3d73721fc50d9fc P 0473d2b2d01f4459b1e90fd12cc7840e: No bootstrap required, opened a new log
I20260709 13:04:06.429208 19601 ts_tablet_manager.cc:1403] T fa8650e71aa14778b3d73721fc50d9fc P 0473d2b2d01f4459b1e90fd12cc7840e: Time spent bootstrapping tablet: real 0.127s	user 0.039s	sys 0.079s
I20260709 13:04:06.430495 19600 raft_consensus.cc:359] T ef32ce6fdd0e40d382c79974f30295c6 P e61c3a8f61bb48f8a963c9480e53c168 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:06.431254 19600 raft_consensus.cc:385] T ef32ce6fdd0e40d382c79974f30295c6 P e61c3a8f61bb48f8a963c9480e53c168 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:06.431530 19600 raft_consensus.cc:740] T ef32ce6fdd0e40d382c79974f30295c6 P e61c3a8f61bb48f8a963c9480e53c168 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e61c3a8f61bb48f8a963c9480e53c168, State: Initialized, Role: FOLLOWER
I20260709 13:04:06.431511 19308 catalog_manager.cc:5697] T f1b10566f45d4a7d9029858330e02d5b P e5256d91808b47c195bc9b4dbd7f2b87 reported cstate change: term changed from 0 to 1, leader changed from <none> to e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1). New cstate: current_term: 1 leader_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:06.432111 19601 raft_consensus.cc:359] T fa8650e71aa14778b3d73721fc50d9fc P 0473d2b2d01f4459b1e90fd12cc7840e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:06.432746 19601 raft_consensus.cc:385] T fa8650e71aa14778b3d73721fc50d9fc P 0473d2b2d01f4459b1e90fd12cc7840e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:06.432659 19600 consensus_queue.cc:260] T ef32ce6fdd0e40d382c79974f30295c6 P e61c3a8f61bb48f8a963c9480e53c168 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:06.433224 19601 raft_consensus.cc:740] T fa8650e71aa14778b3d73721fc50d9fc P 0473d2b2d01f4459b1e90fd12cc7840e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0473d2b2d01f4459b1e90fd12cc7840e, State: Initialized, Role: FOLLOWER
I20260709 13:04:06.432824 19309 catalog_manager.cc:5697] T 1f85fc4b527a48848e5faa083b604e36 P 0473d2b2d01f4459b1e90fd12cc7840e reported cstate change: term changed from 0 to 1, leader changed from <none> to 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2). New cstate: current_term: 1 leader_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:06.433967 19601 consensus_queue.cc:260] T fa8650e71aa14778b3d73721fc50d9fc P 0473d2b2d01f4459b1e90fd12cc7840e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:06.436470 19601 ts_tablet_manager.cc:1434] T fa8650e71aa14778b3d73721fc50d9fc P 0473d2b2d01f4459b1e90fd12cc7840e: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 13:04:06.437403 19601 tablet_bootstrap.cc:492] T 14935b3ddf914369822e4a0547aaa355 P 0473d2b2d01f4459b1e90fd12cc7840e: Bootstrap starting.
I20260709 13:04:06.437866 19600 ts_tablet_manager.cc:1434] T ef32ce6fdd0e40d382c79974f30295c6 P e61c3a8f61bb48f8a963c9480e53c168: Time spent starting tablet: real 0.041s	user 0.006s	sys 0.000s
I20260709 13:04:06.438860 19600 tablet_bootstrap.cc:492] T f1b10566f45d4a7d9029858330e02d5b P e61c3a8f61bb48f8a963c9480e53c168: Bootstrap starting.
I20260709 13:04:06.445503 19600 tablet_bootstrap.cc:654] T f1b10566f45d4a7d9029858330e02d5b P e61c3a8f61bb48f8a963c9480e53c168: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:06.446185 19601 tablet_bootstrap.cc:654] T 14935b3ddf914369822e4a0547aaa355 P 0473d2b2d01f4459b1e90fd12cc7840e: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:06.455643 19604 tablet_bootstrap.cc:492] T 7be9efa6559648dbb5a0f7684c4542d1 P e5256d91808b47c195bc9b4dbd7f2b87: No bootstrap required, opened a new log
I20260709 13:04:06.456204 19604 ts_tablet_manager.cc:1403] T 7be9efa6559648dbb5a0f7684c4542d1 P e5256d91808b47c195bc9b4dbd7f2b87: Time spent bootstrapping tablet: real 0.059s	user 0.005s	sys 0.006s
I20260709 13:04:06.456332 19601 tablet_bootstrap.cc:492] T 14935b3ddf914369822e4a0547aaa355 P 0473d2b2d01f4459b1e90fd12cc7840e: No bootstrap required, opened a new log
I20260709 13:04:06.456741 19601 ts_tablet_manager.cc:1403] T 14935b3ddf914369822e4a0547aaa355 P 0473d2b2d01f4459b1e90fd12cc7840e: Time spent bootstrapping tablet: real 0.020s	user 0.009s	sys 0.006s
I20260709 13:04:06.459254 19604 raft_consensus.cc:359] T 7be9efa6559648dbb5a0f7684c4542d1 P e5256d91808b47c195bc9b4dbd7f2b87 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:06.459501 19601 raft_consensus.cc:359] T 14935b3ddf914369822e4a0547aaa355 P 0473d2b2d01f4459b1e90fd12cc7840e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:06.460011 19604 raft_consensus.cc:385] T 7be9efa6559648dbb5a0f7684c4542d1 P e5256d91808b47c195bc9b4dbd7f2b87 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:06.460258 19601 raft_consensus.cc:385] T 14935b3ddf914369822e4a0547aaa355 P 0473d2b2d01f4459b1e90fd12cc7840e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:06.460357 19604 raft_consensus.cc:740] T 7be9efa6559648dbb5a0f7684c4542d1 P e5256d91808b47c195bc9b4dbd7f2b87 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e5256d91808b47c195bc9b4dbd7f2b87, State: Initialized, Role: FOLLOWER
I20260709 13:04:06.460635 19601 raft_consensus.cc:740] T 14935b3ddf914369822e4a0547aaa355 P 0473d2b2d01f4459b1e90fd12cc7840e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0473d2b2d01f4459b1e90fd12cc7840e, State: Initialized, Role: FOLLOWER
I20260709 13:04:06.461292 19604 consensus_queue.cc:260] T 7be9efa6559648dbb5a0f7684c4542d1 P e5256d91808b47c195bc9b4dbd7f2b87 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:06.461459 19601 consensus_queue.cc:260] T 14935b3ddf914369822e4a0547aaa355 P 0473d2b2d01f4459b1e90fd12cc7840e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:06.463806 19604 ts_tablet_manager.cc:1434] T 7be9efa6559648dbb5a0f7684c4542d1 P e5256d91808b47c195bc9b4dbd7f2b87: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.002s
I20260709 13:04:06.463961 19601 ts_tablet_manager.cc:1434] T 14935b3ddf914369822e4a0547aaa355 P 0473d2b2d01f4459b1e90fd12cc7840e: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.003s
I20260709 13:04:06.464821 19604 tablet_bootstrap.cc:492] T 14efcc79969f41babe5529c22d59156d P e5256d91808b47c195bc9b4dbd7f2b87: Bootstrap starting.
I20260709 13:04:06.465020 19601 tablet_bootstrap.cc:492] T 70797e5783b5454ab0d0eea663e791e3 P 0473d2b2d01f4459b1e90fd12cc7840e: Bootstrap starting.
I20260709 13:04:06.469308 19600 tablet_bootstrap.cc:492] T f1b10566f45d4a7d9029858330e02d5b P e61c3a8f61bb48f8a963c9480e53c168: No bootstrap required, opened a new log
I20260709 13:04:06.469769 19600 ts_tablet_manager.cc:1403] T f1b10566f45d4a7d9029858330e02d5b P e61c3a8f61bb48f8a963c9480e53c168: Time spent bootstrapping tablet: real 0.031s	user 0.007s	sys 0.008s
I20260709 13:04:06.471237 19601 tablet_bootstrap.cc:654] T 70797e5783b5454ab0d0eea663e791e3 P 0473d2b2d01f4459b1e90fd12cc7840e: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:06.471566 19604 tablet_bootstrap.cc:654] T 14efcc79969f41babe5529c22d59156d P e5256d91808b47c195bc9b4dbd7f2b87: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:06.472435 19600 raft_consensus.cc:359] T f1b10566f45d4a7d9029858330e02d5b P e61c3a8f61bb48f8a963c9480e53c168 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:06.475966 19600 raft_consensus.cc:385] T f1b10566f45d4a7d9029858330e02d5b P e61c3a8f61bb48f8a963c9480e53c168 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:06.476320 19600 raft_consensus.cc:740] T f1b10566f45d4a7d9029858330e02d5b P e61c3a8f61bb48f8a963c9480e53c168 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e61c3a8f61bb48f8a963c9480e53c168, State: Initialized, Role: FOLLOWER
I20260709 13:04:06.477340 19600 consensus_queue.cc:260] T f1b10566f45d4a7d9029858330e02d5b P e61c3a8f61bb48f8a963c9480e53c168 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:06.485800 19600 ts_tablet_manager.cc:1434] T f1b10566f45d4a7d9029858330e02d5b P e61c3a8f61bb48f8a963c9480e53c168: Time spent starting tablet: real 0.016s	user 0.006s	sys 0.001s
I20260709 13:04:06.486567 19600 tablet_bootstrap.cc:492] T 46c5bfeecc314717bffe987e6844b6d0 P e61c3a8f61bb48f8a963c9480e53c168: Bootstrap starting.
I20260709 13:04:06.492082 19600 tablet_bootstrap.cc:654] T 46c5bfeecc314717bffe987e6844b6d0 P e61c3a8f61bb48f8a963c9480e53c168: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:06.496608 19601 tablet_bootstrap.cc:492] T 70797e5783b5454ab0d0eea663e791e3 P 0473d2b2d01f4459b1e90fd12cc7840e: No bootstrap required, opened a new log
I20260709 13:04:06.496623 19604 tablet_bootstrap.cc:492] T 14efcc79969f41babe5529c22d59156d P e5256d91808b47c195bc9b4dbd7f2b87: No bootstrap required, opened a new log
I20260709 13:04:06.497107 19600 tablet_bootstrap.cc:492] T 46c5bfeecc314717bffe987e6844b6d0 P e61c3a8f61bb48f8a963c9480e53c168: No bootstrap required, opened a new log
I20260709 13:04:06.497138 19604 ts_tablet_manager.cc:1403] T 14efcc79969f41babe5529c22d59156d P e5256d91808b47c195bc9b4dbd7f2b87: Time spent bootstrapping tablet: real 0.033s	user 0.010s	sys 0.021s
I20260709 13:04:06.497125 19601 ts_tablet_manager.cc:1403] T 70797e5783b5454ab0d0eea663e791e3 P 0473d2b2d01f4459b1e90fd12cc7840e: Time spent bootstrapping tablet: real 0.032s	user 0.008s	sys 0.012s
I20260709 13:04:06.497843 19600 ts_tablet_manager.cc:1403] T 46c5bfeecc314717bffe987e6844b6d0 P e61c3a8f61bb48f8a963c9480e53c168: Time spent bootstrapping tablet: real 0.011s	user 0.007s	sys 0.003s
I20260709 13:04:06.499975 19600 raft_consensus.cc:359] T 46c5bfeecc314717bffe987e6844b6d0 P e61c3a8f61bb48f8a963c9480e53c168 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:06.500048 19601 raft_consensus.cc:359] T 70797e5783b5454ab0d0eea663e791e3 P 0473d2b2d01f4459b1e90fd12cc7840e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:06.500514 19600 raft_consensus.cc:385] T 46c5bfeecc314717bffe987e6844b6d0 P e61c3a8f61bb48f8a963c9480e53c168 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:06.500759 19601 raft_consensus.cc:385] T 70797e5783b5454ab0d0eea663e791e3 P 0473d2b2d01f4459b1e90fd12cc7840e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:06.500494 19604 raft_consensus.cc:359] T 14efcc79969f41babe5529c22d59156d P e5256d91808b47c195bc9b4dbd7f2b87 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:06.501000 19600 raft_consensus.cc:740] T 46c5bfeecc314717bffe987e6844b6d0 P e61c3a8f61bb48f8a963c9480e53c168 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e61c3a8f61bb48f8a963c9480e53c168, State: Initialized, Role: FOLLOWER
I20260709 13:04:06.501098 19601 raft_consensus.cc:740] T 70797e5783b5454ab0d0eea663e791e3 P 0473d2b2d01f4459b1e90fd12cc7840e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0473d2b2d01f4459b1e90fd12cc7840e, State: Initialized, Role: FOLLOWER
I20260709 13:04:06.501299 19604 raft_consensus.cc:385] T 14efcc79969f41babe5529c22d59156d P e5256d91808b47c195bc9b4dbd7f2b87 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:06.501601 19604 raft_consensus.cc:740] T 14efcc79969f41babe5529c22d59156d P e5256d91808b47c195bc9b4dbd7f2b87 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e5256d91808b47c195bc9b4dbd7f2b87, State: Initialized, Role: FOLLOWER
I20260709 13:04:06.501859 19600 consensus_queue.cc:260] T 46c5bfeecc314717bffe987e6844b6d0 P e61c3a8f61bb48f8a963c9480e53c168 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:06.501827 19601 consensus_queue.cc:260] T 70797e5783b5454ab0d0eea663e791e3 P 0473d2b2d01f4459b1e90fd12cc7840e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:06.502249 19604 consensus_queue.cc:260] T 14efcc79969f41babe5529c22d59156d P e5256d91808b47c195bc9b4dbd7f2b87 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:06.504248 19601 ts_tablet_manager.cc:1434] T 70797e5783b5454ab0d0eea663e791e3 P 0473d2b2d01f4459b1e90fd12cc7840e: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 13:04:06.504252 19604 ts_tablet_manager.cc:1434] T 14efcc79969f41babe5529c22d59156d P e5256d91808b47c195bc9b4dbd7f2b87: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 13:04:06.505491 19601 tablet_bootstrap.cc:492] T 46c5bfeecc314717bffe987e6844b6d0 P 0473d2b2d01f4459b1e90fd12cc7840e: Bootstrap starting.
I20260709 13:04:06.505512 19604 tablet_bootstrap.cc:492] T 1f85fc4b527a48848e5faa083b604e36 P e5256d91808b47c195bc9b4dbd7f2b87: Bootstrap starting.
I20260709 13:04:06.506462 19600 ts_tablet_manager.cc:1434] T 46c5bfeecc314717bffe987e6844b6d0 P e61c3a8f61bb48f8a963c9480e53c168: Time spent starting tablet: real 0.008s	user 0.002s	sys 0.003s
I20260709 13:04:06.507336 19600 tablet_bootstrap.cc:492] T 217b5fae677b4971b3bbd2f357a1f7ff P e61c3a8f61bb48f8a963c9480e53c168: Bootstrap starting.
I20260709 13:04:06.511675 19601 tablet_bootstrap.cc:654] T 46c5bfeecc314717bffe987e6844b6d0 P 0473d2b2d01f4459b1e90fd12cc7840e: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:06.511693 19604 tablet_bootstrap.cc:654] T 1f85fc4b527a48848e5faa083b604e36 P e5256d91808b47c195bc9b4dbd7f2b87: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:06.515889 19600 tablet_bootstrap.cc:654] T 217b5fae677b4971b3bbd2f357a1f7ff P e61c3a8f61bb48f8a963c9480e53c168: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:06.523995 19601 tablet_bootstrap.cc:492] T 46c5bfeecc314717bffe987e6844b6d0 P 0473d2b2d01f4459b1e90fd12cc7840e: No bootstrap required, opened a new log
I20260709 13:04:06.524170 19604 tablet_bootstrap.cc:492] T 1f85fc4b527a48848e5faa083b604e36 P e5256d91808b47c195bc9b4dbd7f2b87: No bootstrap required, opened a new log
I20260709 13:04:06.524887 19604 ts_tablet_manager.cc:1403] T 1f85fc4b527a48848e5faa083b604e36 P e5256d91808b47c195bc9b4dbd7f2b87: Time spent bootstrapping tablet: real 0.020s	user 0.009s	sys 0.008s
I20260709 13:04:06.524515 19601 ts_tablet_manager.cc:1403] T 46c5bfeecc314717bffe987e6844b6d0 P 0473d2b2d01f4459b1e90fd12cc7840e: Time spent bootstrapping tablet: real 0.019s	user 0.014s	sys 0.004s
I20260709 13:04:06.527518 19600 tablet_bootstrap.cc:492] T 217b5fae677b4971b3bbd2f357a1f7ff P e61c3a8f61bb48f8a963c9480e53c168: No bootstrap required, opened a new log
I20260709 13:04:06.527937 19600 ts_tablet_manager.cc:1403] T 217b5fae677b4971b3bbd2f357a1f7ff P e61c3a8f61bb48f8a963c9480e53c168: Time spent bootstrapping tablet: real 0.021s	user 0.009s	sys 0.006s
I20260709 13:04:06.527633 19601 raft_consensus.cc:359] T 46c5bfeecc314717bffe987e6844b6d0 P 0473d2b2d01f4459b1e90fd12cc7840e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:06.527766 19604 raft_consensus.cc:359] T 1f85fc4b527a48848e5faa083b604e36 P e5256d91808b47c195bc9b4dbd7f2b87 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } }
I20260709 13:04:06.528440 19601 raft_consensus.cc:385] T 46c5bfeecc314717bffe987e6844b6d0 P 0473d2b2d01f4459b1e90fd12cc7840e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:06.528481 19604 raft_consensus.cc:385] T 1f85fc4b527a48848e5faa083b604e36 P e5256d91808b47c195bc9b4dbd7f2b87 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:06.528847 19601 raft_consensus.cc:740] T 46c5bfeecc314717bffe987e6844b6d0 P 0473d2b2d01f4459b1e90fd12cc7840e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0473d2b2d01f4459b1e90fd12cc7840e, State: Initialized, Role: FOLLOWER
I20260709 13:04:06.528883 19604 raft_consensus.cc:740] T 1f85fc4b527a48848e5faa083b604e36 P e5256d91808b47c195bc9b4dbd7f2b87 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e5256d91808b47c195bc9b4dbd7f2b87, State: Initialized, Role: FOLLOWER
I20260709 13:04:06.529628 19601 consensus_queue.cc:260] T 46c5bfeecc314717bffe987e6844b6d0 P 0473d2b2d01f4459b1e90fd12cc7840e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:06.529628 19604 consensus_queue.cc:260] T 1f85fc4b527a48848e5faa083b604e36 P e5256d91808b47c195bc9b4dbd7f2b87 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } }
I20260709 13:04:06.530436 19600 raft_consensus.cc:359] T 217b5fae677b4971b3bbd2f357a1f7ff P e61c3a8f61bb48f8a963c9480e53c168 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:06.531128 19600 raft_consensus.cc:385] T 217b5fae677b4971b3bbd2f357a1f7ff P e61c3a8f61bb48f8a963c9480e53c168 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:06.531392 19600 raft_consensus.cc:740] T 217b5fae677b4971b3bbd2f357a1f7ff P e61c3a8f61bb48f8a963c9480e53c168 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e61c3a8f61bb48f8a963c9480e53c168, State: Initialized, Role: FOLLOWER
I20260709 13:04:06.531694 19604 ts_tablet_manager.cc:1434] T 1f85fc4b527a48848e5faa083b604e36 P e5256d91808b47c195bc9b4dbd7f2b87: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 13:04:06.531694 19601 ts_tablet_manager.cc:1434] T 46c5bfeecc314717bffe987e6844b6d0 P 0473d2b2d01f4459b1e90fd12cc7840e: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
I20260709 13:04:06.532655 19604 tablet_bootstrap.cc:492] T 14935b3ddf914369822e4a0547aaa355 P e5256d91808b47c195bc9b4dbd7f2b87: Bootstrap starting.
I20260709 13:04:06.533072 19601 tablet_bootstrap.cc:492] T ed7fdbcb96d14d418db9ca90a792588a P 0473d2b2d01f4459b1e90fd12cc7840e: Bootstrap starting.
I20260709 13:04:06.536160 19600 consensus_queue.cc:260] T 217b5fae677b4971b3bbd2f357a1f7ff P e61c3a8f61bb48f8a963c9480e53c168 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:06.538286 19600 ts_tablet_manager.cc:1434] T 217b5fae677b4971b3bbd2f357a1f7ff P e61c3a8f61bb48f8a963c9480e53c168: Time spent starting tablet: real 0.010s	user 0.005s	sys 0.000s
I20260709 13:04:06.538594 19601 tablet_bootstrap.cc:654] T ed7fdbcb96d14d418db9ca90a792588a P 0473d2b2d01f4459b1e90fd12cc7840e: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:06.540390 19600 tablet_bootstrap.cc:492] T 2725d2c4cb054f18b0fc8f735c15f6c2 P e61c3a8f61bb48f8a963c9480e53c168: Bootstrap starting.
I20260709 13:04:06.538638 19604 tablet_bootstrap.cc:654] T 14935b3ddf914369822e4a0547aaa355 P e5256d91808b47c195bc9b4dbd7f2b87: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:06.551120 19615 raft_consensus.cc:493] T 7be9efa6559648dbb5a0f7684c4542d1 P e5256d91808b47c195bc9b4dbd7f2b87 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:06.551633 19615 raft_consensus.cc:515] T 7be9efa6559648dbb5a0f7684c4542d1 P e5256d91808b47c195bc9b4dbd7f2b87 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:06.553529 19600 tablet_bootstrap.cc:654] T 2725d2c4cb054f18b0fc8f735c15f6c2 P e61c3a8f61bb48f8a963c9480e53c168: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:06.553666 19615 leader_election.cc:290] T 7be9efa6559648dbb5a0f7684c4542d1 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:04:06.555747 19486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7be9efa6559648dbb5a0f7684c4542d1" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
W20260709 13:04:06.558125 19377 leader_election.cc:343] T 7be9efa6559648dbb5a0f7684c4542d1 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:06.559149 19601 tablet_bootstrap.cc:492] T ed7fdbcb96d14d418db9ca90a792588a P 0473d2b2d01f4459b1e90fd12cc7840e: No bootstrap required, opened a new log
I20260709 13:04:06.559755 19601 ts_tablet_manager.cc:1403] T ed7fdbcb96d14d418db9ca90a792588a P 0473d2b2d01f4459b1e90fd12cc7840e: Time spent bootstrapping tablet: real 0.027s	user 0.010s	sys 0.006s
I20260709 13:04:06.559814 19560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7be9efa6559648dbb5a0f7684c4542d1" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:04:06.560745 19560 raft_consensus.cc:2468] T 7be9efa6559648dbb5a0f7684c4542d1 P e61c3a8f61bb48f8a963c9480e53c168 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 0.
I20260709 13:04:06.562398 19375 leader_election.cc:304] T 7be9efa6559648dbb5a0f7684c4542d1 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168; no voters: 0473d2b2d01f4459b1e90fd12cc7840e
I20260709 13:04:06.563509 19601 raft_consensus.cc:359] T ed7fdbcb96d14d418db9ca90a792588a P 0473d2b2d01f4459b1e90fd12cc7840e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:06.564388 19601 raft_consensus.cc:385] T ed7fdbcb96d14d418db9ca90a792588a P 0473d2b2d01f4459b1e90fd12cc7840e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:06.564721 19600 tablet_bootstrap.cc:492] T 2725d2c4cb054f18b0fc8f735c15f6c2 P e61c3a8f61bb48f8a963c9480e53c168: No bootstrap required, opened a new log
I20260709 13:04:06.564704 19601 raft_consensus.cc:740] T ed7fdbcb96d14d418db9ca90a792588a P 0473d2b2d01f4459b1e90fd12cc7840e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0473d2b2d01f4459b1e90fd12cc7840e, State: Initialized, Role: FOLLOWER
I20260709 13:04:06.565629 19600 ts_tablet_manager.cc:1403] T 2725d2c4cb054f18b0fc8f735c15f6c2 P e61c3a8f61bb48f8a963c9480e53c168: Time spent bootstrapping tablet: real 0.026s	user 0.013s	sys 0.004s
I20260709 13:04:06.565653 19601 consensus_queue.cc:260] T ed7fdbcb96d14d418db9ca90a792588a P 0473d2b2d01f4459b1e90fd12cc7840e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:06.566926 19639 raft_consensus.cc:493] T 14efcc79969f41babe5529c22d59156d P e5256d91808b47c195bc9b4dbd7f2b87 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:06.567363 19639 raft_consensus.cc:515] T 14efcc79969f41babe5529c22d59156d P e5256d91808b47c195bc9b4dbd7f2b87 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:06.567871 19601 ts_tablet_manager.cc:1434] T ed7fdbcb96d14d418db9ca90a792588a P 0473d2b2d01f4459b1e90fd12cc7840e: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 13:04:06.568389 19600 raft_consensus.cc:359] T 2725d2c4cb054f18b0fc8f735c15f6c2 P e61c3a8f61bb48f8a963c9480e53c168 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:06.569082 19600 raft_consensus.cc:385] T 2725d2c4cb054f18b0fc8f735c15f6c2 P e61c3a8f61bb48f8a963c9480e53c168 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:06.569514 19600 raft_consensus.cc:740] T 2725d2c4cb054f18b0fc8f735c15f6c2 P e61c3a8f61bb48f8a963c9480e53c168 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e61c3a8f61bb48f8a963c9480e53c168, State: Initialized, Role: FOLLOWER
I20260709 13:04:06.571058 19615 raft_consensus.cc:2804] T 7be9efa6559648dbb5a0f7684c4542d1 P e5256d91808b47c195bc9b4dbd7f2b87 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:06.572427 19640 raft_consensus.cc:493] T 46c5bfeecc314717bffe987e6844b6d0 P 0473d2b2d01f4459b1e90fd12cc7840e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:06.572507 19615 raft_consensus.cc:493] T 7be9efa6559648dbb5a0f7684c4542d1 P e5256d91808b47c195bc9b4dbd7f2b87 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:06.572657 19560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14efcc79969f41babe5529c22d59156d" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:04:06.573123 19615 raft_consensus.cc:3060] T 7be9efa6559648dbb5a0f7684c4542d1 P e5256d91808b47c195bc9b4dbd7f2b87 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:06.572980 19640 raft_consensus.cc:515] T 46c5bfeecc314717bffe987e6844b6d0 P 0473d2b2d01f4459b1e90fd12cc7840e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:06.571376 19486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14efcc79969f41babe5529c22d59156d" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
W20260709 13:04:06.574736 19377 leader_election.cc:343] T 14efcc79969f41babe5529c22d59156d P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:06.575075 19603 raft_consensus.cc:493] T 46c5bfeecc314717bffe987e6844b6d0 P e61c3a8f61bb48f8a963c9480e53c168 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:06.575546 19603 raft_consensus.cc:515] T 46c5bfeecc314717bffe987e6844b6d0 P e61c3a8f61bb48f8a963c9480e53c168 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:06.576481 19559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46c5bfeecc314717bffe987e6844b6d0" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:04:06.577152 19559 raft_consensus.cc:2468] T 46c5bfeecc314717bffe987e6844b6d0 P e61c3a8f61bb48f8a963c9480e53c168 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 0.
I20260709 13:04:06.569043 19601 tablet_bootstrap.cc:492] T 2725d2c4cb054f18b0fc8f735c15f6c2 P 0473d2b2d01f4459b1e90fd12cc7840e: Bootstrap starting.
I20260709 13:04:06.569563 19639 leader_election.cc:290] T 14efcc79969f41babe5529c22d59156d P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:04:06.570508 19600 consensus_queue.cc:260] T 2725d2c4cb054f18b0fc8f735c15f6c2 P e61c3a8f61bb48f8a963c9480e53c168 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:06.579710 19600 ts_tablet_manager.cc:1434] T 2725d2c4cb054f18b0fc8f735c15f6c2 P e61c3a8f61bb48f8a963c9480e53c168: Time spent starting tablet: real 0.014s	user 0.006s	sys 0.000s
I20260709 13:04:06.580101 19486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46c5bfeecc314717bffe987e6844b6d0" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:04:06.580821 19600 tablet_bootstrap.cc:492] T 40e1e16737a842ee936002830f36882e P e61c3a8f61bb48f8a963c9480e53c168: Bootstrap starting.
I20260709 13:04:06.580785 19486 raft_consensus.cc:2468] T 46c5bfeecc314717bffe987e6844b6d0 P 0473d2b2d01f4459b1e90fd12cc7840e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 0.
I20260709 13:04:06.582105 19526 leader_election.cc:304] T 46c5bfeecc314717bffe987e6844b6d0 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:04:06.582602 19410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46c5bfeecc314717bffe987e6844b6d0" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:04:06.583135 19630 raft_consensus.cc:2804] T 46c5bfeecc314717bffe987e6844b6d0 P e61c3a8f61bb48f8a963c9480e53c168 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:06.583539 19630 raft_consensus.cc:493] T 46c5bfeecc314717bffe987e6844b6d0 P e61c3a8f61bb48f8a963c9480e53c168 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:06.583938 19630 raft_consensus.cc:3060] T 46c5bfeecc314717bffe987e6844b6d0 P e61c3a8f61bb48f8a963c9480e53c168 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:04:06.584342 19449 leader_election.cc:343] T 46c5bfeecc314717bffe987e6844b6d0 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:06.585300 19601 tablet_bootstrap.cc:654] T 2725d2c4cb054f18b0fc8f735c15f6c2 P 0473d2b2d01f4459b1e90fd12cc7840e: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:06.586232 19410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46c5bfeecc314717bffe987e6844b6d0" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:04:06.575063 19640 leader_election.cc:290] T 46c5bfeecc314717bffe987e6844b6d0 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:04:06.577764 19603 leader_election.cc:290] T 46c5bfeecc314717bffe987e6844b6d0 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:04:06.585294 19450 leader_election.cc:304] T 46c5bfeecc314717bffe987e6844b6d0 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168; no voters: e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:04:06.573279 19560 raft_consensus.cc:2468] T 14efcc79969f41babe5529c22d59156d P e61c3a8f61bb48f8a963c9480e53c168 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 0.
I20260709 13:04:06.589361 19600 tablet_bootstrap.cc:654] T 40e1e16737a842ee936002830f36882e P e61c3a8f61bb48f8a963c9480e53c168: Neither blocks nor log segments found. Creating new log.
W20260709 13:04:06.589838 19523 leader_election.cc:343] T 46c5bfeecc314717bffe987e6844b6d0 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:06.589922 19615 raft_consensus.cc:515] T 7be9efa6559648dbb5a0f7684c4542d1 P e5256d91808b47c195bc9b4dbd7f2b87 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:06.591126 19640 raft_consensus.cc:2804] T 46c5bfeecc314717bffe987e6844b6d0 P 0473d2b2d01f4459b1e90fd12cc7840e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:06.591503 19640 raft_consensus.cc:493] T 46c5bfeecc314717bffe987e6844b6d0 P 0473d2b2d01f4459b1e90fd12cc7840e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:06.589520 19375 leader_election.cc:304] T 14efcc79969f41babe5529c22d59156d P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168; no voters: 0473d2b2d01f4459b1e90fd12cc7840e
I20260709 13:04:06.591960 19640 raft_consensus.cc:3060] T 46c5bfeecc314717bffe987e6844b6d0 P 0473d2b2d01f4459b1e90fd12cc7840e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:06.592025 19615 leader_election.cc:290] T 7be9efa6559648dbb5a0f7684c4542d1 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 1 election: Requested vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:04:06.593349 19639 raft_consensus.cc:2804] T 14efcc79969f41babe5529c22d59156d P e5256d91808b47c195bc9b4dbd7f2b87 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:06.593708 19639 raft_consensus.cc:493] T 14efcc79969f41babe5529c22d59156d P e5256d91808b47c195bc9b4dbd7f2b87 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:06.594019 19639 raft_consensus.cc:3060] T 14efcc79969f41babe5529c22d59156d P e5256d91808b47c195bc9b4dbd7f2b87 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:06.599105 19486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7be9efa6559648dbb5a0f7684c4542d1" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:04:06.600932 19560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7be9efa6559648dbb5a0f7684c4542d1" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:04:06.601504 19560 raft_consensus.cc:3060] T 7be9efa6559648dbb5a0f7684c4542d1 P e61c3a8f61bb48f8a963c9480e53c168 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:06.602380 19630 raft_consensus.cc:515] T 46c5bfeecc314717bffe987e6844b6d0 P e61c3a8f61bb48f8a963c9480e53c168 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:06.605772 19604 tablet_bootstrap.cc:492] T 14935b3ddf914369822e4a0547aaa355 P e5256d91808b47c195bc9b4dbd7f2b87: No bootstrap required, opened a new log
I20260709 13:04:06.606231 19604 ts_tablet_manager.cc:1403] T 14935b3ddf914369822e4a0547aaa355 P e5256d91808b47c195bc9b4dbd7f2b87: Time spent bootstrapping tablet: real 0.074s	user 0.014s	sys 0.017s
W20260709 13:04:06.606593 19377 leader_election.cc:343] T 7be9efa6559648dbb5a0f7684c4542d1 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:06.608003 19410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46c5bfeecc314717bffe987e6844b6d0" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
W20260709 13:04:06.611449 19523 leader_election.cc:343] T 46c5bfeecc314717bffe987e6844b6d0 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:06.612130 19410 raft_consensus.cc:3060] T 0afb57ae58a24a01850491d69f0213dd P e5256d91808b47c195bc9b4dbd7f2b87 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:06.613420 19486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46c5bfeecc314717bffe987e6844b6d0" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:04:06.614087 19630 leader_election.cc:290] T 46c5bfeecc314717bffe987e6844b6d0 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 1 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:04:06.607833 19640 raft_consensus.cc:515] T 46c5bfeecc314717bffe987e6844b6d0 P 0473d2b2d01f4459b1e90fd12cc7840e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:06.615954 19486 raft_consensus.cc:2393] T 46c5bfeecc314717bffe987e6844b6d0 P 0473d2b2d01f4459b1e90fd12cc7840e [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate e61c3a8f61bb48f8a963c9480e53c168 in current term 1: Already voted for candidate 0473d2b2d01f4459b1e90fd12cc7840e in this term.
I20260709 13:04:06.618296 19526 leader_election.cc:304] T 46c5bfeecc314717bffe987e6844b6d0 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e61c3a8f61bb48f8a963c9480e53c168; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:04:06.619535 19630 raft_consensus.cc:2749] T 46c5bfeecc314717bffe987e6844b6d0 P e61c3a8f61bb48f8a963c9480e53c168 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:04:06.620807 19604 raft_consensus.cc:359] T 14935b3ddf914369822e4a0547aaa355 P e5256d91808b47c195bc9b4dbd7f2b87 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:06.621454 19604 raft_consensus.cc:385] T 14935b3ddf914369822e4a0547aaa355 P e5256d91808b47c195bc9b4dbd7f2b87 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:06.621709 19604 raft_consensus.cc:740] T 14935b3ddf914369822e4a0547aaa355 P e5256d91808b47c195bc9b4dbd7f2b87 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e5256d91808b47c195bc9b4dbd7f2b87, State: Initialized, Role: FOLLOWER
I20260709 13:04:06.622346 19604 consensus_queue.cc:260] T 14935b3ddf914369822e4a0547aaa355 P e5256d91808b47c195bc9b4dbd7f2b87 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:06.623147 19639 raft_consensus.cc:515] T 14efcc79969f41babe5529c22d59156d P e5256d91808b47c195bc9b4dbd7f2b87 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:06.626632 19559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46c5bfeecc314717bffe987e6844b6d0" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:04:06.627422 19559 raft_consensus.cc:2393] T 46c5bfeecc314717bffe987e6844b6d0 P e61c3a8f61bb48f8a963c9480e53c168 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 0473d2b2d01f4459b1e90fd12cc7840e in current term 1: Already voted for candidate e61c3a8f61bb48f8a963c9480e53c168 in this term.
I20260709 13:04:06.624909 19640 leader_election.cc:290] T 46c5bfeecc314717bffe987e6844b6d0 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 1 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:04:06.625155 19601 tablet_bootstrap.cc:492] T 2725d2c4cb054f18b0fc8f735c15f6c2 P 0473d2b2d01f4459b1e90fd12cc7840e: No bootstrap required, opened a new log
I20260709 13:04:06.625105 19411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46c5bfeecc314717bffe987e6844b6d0" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
I20260709 13:04:06.629511 19601 ts_tablet_manager.cc:1403] T 2725d2c4cb054f18b0fc8f735c15f6c2 P 0473d2b2d01f4459b1e90fd12cc7840e: Time spent bootstrapping tablet: real 0.061s	user 0.017s	sys 0.020s
I20260709 13:04:06.629879 19486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14efcc79969f41babe5529c22d59156d" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:04:06.630733 19639 leader_election.cc:290] T 14efcc79969f41babe5529c22d59156d P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 1 election: Requested vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
W20260709 13:04:06.631189 19377 leader_election.cc:343] T 14efcc79969f41babe5529c22d59156d P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:06.631426 19559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14efcc79969f41babe5529c22d59156d" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:04:06.632279 19600 tablet_bootstrap.cc:492] T 40e1e16737a842ee936002830f36882e P e61c3a8f61bb48f8a963c9480e53c168: No bootstrap required, opened a new log
I20260709 13:04:06.634865 19559 raft_consensus.cc:3060] T 14efcc79969f41babe5529c22d59156d P e61c3a8f61bb48f8a963c9480e53c168 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:06.635370 19604 ts_tablet_manager.cc:1434] T 14935b3ddf914369822e4a0547aaa355 P e5256d91808b47c195bc9b4dbd7f2b87: Time spent starting tablet: real 0.029s	user 0.008s	sys 0.000s
I20260709 13:04:06.636387 19560 raft_consensus.cc:2468] T 7be9efa6559648dbb5a0f7684c4542d1 P e61c3a8f61bb48f8a963c9480e53c168 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 1.
I20260709 13:04:06.636659 19604 tablet_bootstrap.cc:492] T fa8650e71aa14778b3d73721fc50d9fc P e5256d91808b47c195bc9b4dbd7f2b87: Bootstrap starting.
I20260709 13:04:06.637615 19375 leader_election.cc:304] T 7be9efa6559648dbb5a0f7684c4542d1 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168; no voters: 0473d2b2d01f4459b1e90fd12cc7840e
I20260709 13:04:06.638875 19639 raft_consensus.cc:2804] T 7be9efa6559648dbb5a0f7684c4542d1 P e5256d91808b47c195bc9b4dbd7f2b87 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:06.639397 19639 raft_consensus.cc:697] T 7be9efa6559648dbb5a0f7684c4542d1 P e5256d91808b47c195bc9b4dbd7f2b87 [term 1 LEADER]: Becoming Leader. State: Replica: e5256d91808b47c195bc9b4dbd7f2b87, State: Running, Role: LEADER
I20260709 13:04:06.640467 19639 consensus_queue.cc:237] T 7be9efa6559648dbb5a0f7684c4542d1 P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:06.642735 19559 raft_consensus.cc:2468] T 14efcc79969f41babe5529c22d59156d P e61c3a8f61bb48f8a963c9480e53c168 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 1.
I20260709 13:04:06.642993 19604 tablet_bootstrap.cc:654] T fa8650e71aa14778b3d73721fc50d9fc P e5256d91808b47c195bc9b4dbd7f2b87: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:06.632951 19601 raft_consensus.cc:359] T 2725d2c4cb054f18b0fc8f735c15f6c2 P 0473d2b2d01f4459b1e90fd12cc7840e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:06.633680 19603 consensus_queue.cc:1048] T 0afb57ae58a24a01850491d69f0213dd P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:06.644465 19601 raft_consensus.cc:385] T 2725d2c4cb054f18b0fc8f735c15f6c2 P 0473d2b2d01f4459b1e90fd12cc7840e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:06.644393 19375 leader_election.cc:304] T 14efcc79969f41babe5529c22d59156d P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168; no voters: 0473d2b2d01f4459b1e90fd12cc7840e
I20260709 13:04:06.644826 19601 raft_consensus.cc:740] T 2725d2c4cb054f18b0fc8f735c15f6c2 P 0473d2b2d01f4459b1e90fd12cc7840e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0473d2b2d01f4459b1e90fd12cc7840e, State: Initialized, Role: FOLLOWER
I20260709 13:04:06.634994 19600 ts_tablet_manager.cc:1403] T 40e1e16737a842ee936002830f36882e P e61c3a8f61bb48f8a963c9480e53c168: Time spent bootstrapping tablet: real 0.054s	user 0.013s	sys 0.004s
I20260709 13:04:06.645557 19615 raft_consensus.cc:2804] T 14efcc79969f41babe5529c22d59156d P e5256d91808b47c195bc9b4dbd7f2b87 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:06.645452 19601 consensus_queue.cc:260] T 2725d2c4cb054f18b0fc8f735c15f6c2 P 0473d2b2d01f4459b1e90fd12cc7840e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:06.646179 19615 raft_consensus.cc:697] T 14efcc79969f41babe5529c22d59156d P e5256d91808b47c195bc9b4dbd7f2b87 [term 1 LEADER]: Becoming Leader. State: Replica: e5256d91808b47c195bc9b4dbd7f2b87, State: Running, Role: LEADER
I20260709 13:04:06.647054 19615 consensus_queue.cc:237] T 14efcc79969f41babe5529c22d59156d P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:06.647507 19601 ts_tablet_manager.cc:1434] T 2725d2c4cb054f18b0fc8f735c15f6c2 P 0473d2b2d01f4459b1e90fd12cc7840e: Time spent starting tablet: real 0.018s	user 0.004s	sys 0.002s
I20260709 13:04:06.648527 19601 tablet_bootstrap.cc:492] T 7be9efa6559648dbb5a0f7684c4542d1 P 0473d2b2d01f4459b1e90fd12cc7840e: Bootstrap starting.
I20260709 13:04:06.648635 19600 raft_consensus.cc:359] T 40e1e16737a842ee936002830f36882e P e61c3a8f61bb48f8a963c9480e53c168 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:06.649518 19600 raft_consensus.cc:385] T 40e1e16737a842ee936002830f36882e P e61c3a8f61bb48f8a963c9480e53c168 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:06.649838 19600 raft_consensus.cc:740] T 40e1e16737a842ee936002830f36882e P e61c3a8f61bb48f8a963c9480e53c168 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e61c3a8f61bb48f8a963c9480e53c168, State: Initialized, Role: FOLLOWER
W20260709 13:04:06.632311 19449 leader_election.cc:343] T 46c5bfeecc314717bffe987e6844b6d0 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:06.651489 19449 leader_election.cc:304] T 46c5bfeecc314717bffe987e6844b6d0 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e; no voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:04:06.654728 19603 consensus_queue.cc:1048] T 0afb57ae58a24a01850491d69f0213dd P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:06.655099 19601 tablet_bootstrap.cc:654] T 7be9efa6559648dbb5a0f7684c4542d1 P 0473d2b2d01f4459b1e90fd12cc7840e: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:06.655061 19611 raft_consensus.cc:2749] T 46c5bfeecc314717bffe987e6844b6d0 P 0473d2b2d01f4459b1e90fd12cc7840e [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:04:06.659448 19604 tablet_bootstrap.cc:492] T fa8650e71aa14778b3d73721fc50d9fc P e5256d91808b47c195bc9b4dbd7f2b87: No bootstrap required, opened a new log
I20260709 13:04:06.659895 19604 ts_tablet_manager.cc:1403] T fa8650e71aa14778b3d73721fc50d9fc P e5256d91808b47c195bc9b4dbd7f2b87: Time spent bootstrapping tablet: real 0.023s	user 0.015s	sys 0.001s
I20260709 13:04:06.662607 19603 raft_consensus.cc:493] T 2725d2c4cb054f18b0fc8f735c15f6c2 P e61c3a8f61bb48f8a963c9480e53c168 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:06.663106 19603 raft_consensus.cc:515] T 2725d2c4cb054f18b0fc8f735c15f6c2 P e61c3a8f61bb48f8a963c9480e53c168 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:06.663367 19600 consensus_queue.cc:260] T 40e1e16737a842ee936002830f36882e P e61c3a8f61bb48f8a963c9480e53c168 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:06.665784 19600 ts_tablet_manager.cc:1434] T 40e1e16737a842ee936002830f36882e P e61c3a8f61bb48f8a963c9480e53c168: Time spent starting tablet: real 0.020s	user 0.006s	sys 0.000s
I20260709 13:04:06.665867 19603 leader_election.cc:290] T 2725d2c4cb054f18b0fc8f735c15f6c2 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:04:06.667325 19485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2725d2c4cb054f18b0fc8f735c15f6c2" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:04:06.668164 19485 raft_consensus.cc:2468] T 2725d2c4cb054f18b0fc8f735c15f6c2 P 0473d2b2d01f4459b1e90fd12cc7840e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 0.
I20260709 13:04:06.667340 19411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2725d2c4cb054f18b0fc8f735c15f6c2" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
W20260709 13:04:06.670950 19523 leader_election.cc:343] T 2725d2c4cb054f18b0fc8f735c15f6c2 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:06.672462 19526 leader_election.cc:304] T 2725d2c4cb054f18b0fc8f735c15f6c2 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168; no voters: e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:04:06.673308 19630 raft_consensus.cc:493] T 40e1e16737a842ee936002830f36882e P e61c3a8f61bb48f8a963c9480e53c168 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:06.673605 19600 tablet_bootstrap.cc:492] T 309c3ca0ca4b4f3ba129752ea2cb293b P e61c3a8f61bb48f8a963c9480e53c168: Bootstrap starting.
I20260709 13:04:06.673784 19630 raft_consensus.cc:515] T 40e1e16737a842ee936002830f36882e P e61c3a8f61bb48f8a963c9480e53c168 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:06.676011 19630 leader_election.cc:290] T 40e1e16737a842ee936002830f36882e P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:04:06.676136 19601 tablet_bootstrap.cc:492] T 7be9efa6559648dbb5a0f7684c4542d1 P 0473d2b2d01f4459b1e90fd12cc7840e: No bootstrap required, opened a new log
I20260709 13:04:06.676523 19630 raft_consensus.cc:2804] T 2725d2c4cb054f18b0fc8f735c15f6c2 P e61c3a8f61bb48f8a963c9480e53c168 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:06.676666 19601 ts_tablet_manager.cc:1403] T 7be9efa6559648dbb5a0f7684c4542d1 P 0473d2b2d01f4459b1e90fd12cc7840e: Time spent bootstrapping tablet: real 0.028s	user 0.017s	sys 0.009s
I20260709 13:04:06.676892 19630 raft_consensus.cc:493] T 2725d2c4cb054f18b0fc8f735c15f6c2 P e61c3a8f61bb48f8a963c9480e53c168 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:06.677259 19630 raft_consensus.cc:3060] T 2725d2c4cb054f18b0fc8f735c15f6c2 P e61c3a8f61bb48f8a963c9480e53c168 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:06.679368 19411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40e1e16737a842ee936002830f36882e" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:04:06.680207 19600 tablet_bootstrap.cc:654] T 309c3ca0ca4b4f3ba129752ea2cb293b P e61c3a8f61bb48f8a963c9480e53c168: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:06.681087 19601 raft_consensus.cc:359] T 7be9efa6559648dbb5a0f7684c4542d1 P 0473d2b2d01f4459b1e90fd12cc7840e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:06.682682 19601 raft_consensus.cc:385] T 7be9efa6559648dbb5a0f7684c4542d1 P 0473d2b2d01f4459b1e90fd12cc7840e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:06.683342 19601 raft_consensus.cc:740] T 7be9efa6559648dbb5a0f7684c4542d1 P 0473d2b2d01f4459b1e90fd12cc7840e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0473d2b2d01f4459b1e90fd12cc7840e, State: Initialized, Role: FOLLOWER
I20260709 13:04:06.684449 19601 consensus_queue.cc:260] T 7be9efa6559648dbb5a0f7684c4542d1 P 0473d2b2d01f4459b1e90fd12cc7840e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
W20260709 13:04:06.685098 19523 leader_election.cc:343] T 40e1e16737a842ee936002830f36882e P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:06.686499 19601 ts_tablet_manager.cc:1434] T 7be9efa6559648dbb5a0f7684c4542d1 P 0473d2b2d01f4459b1e90fd12cc7840e: Time spent starting tablet: real 0.009s	user 0.004s	sys 0.000s
I20260709 13:04:06.687043 19485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40e1e16737a842ee936002830f36882e" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:04:06.687400 19601 tablet_bootstrap.cc:492] T 2a16f7501e2444fb86d4e2778e734e02 P 0473d2b2d01f4459b1e90fd12cc7840e: Bootstrap starting.
W20260709 13:04:06.688301 19526 leader_election.cc:343] T 40e1e16737a842ee936002830f36882e P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:06.688719 19526 leader_election.cc:304] T 40e1e16737a842ee936002830f36882e P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e61c3a8f61bb48f8a963c9480e53c168; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:04:06.689698 19603 raft_consensus.cc:2749] T 40e1e16737a842ee936002830f36882e P e61c3a8f61bb48f8a963c9480e53c168 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:04:06.697047 19630 raft_consensus.cc:515] T 2725d2c4cb054f18b0fc8f735c15f6c2 P e61c3a8f61bb48f8a963c9480e53c168 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:06.699127 19485 raft_consensus.cc:3060] T 70797e5783b5454ab0d0eea663e791e3 P 0473d2b2d01f4459b1e90fd12cc7840e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:06.700193 19604 raft_consensus.cc:359] T fa8650e71aa14778b3d73721fc50d9fc P e5256d91808b47c195bc9b4dbd7f2b87 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:06.701152 19604 raft_consensus.cc:385] T fa8650e71aa14778b3d73721fc50d9fc P e5256d91808b47c195bc9b4dbd7f2b87 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:06.701468 19604 raft_consensus.cc:740] T fa8650e71aa14778b3d73721fc50d9fc P e5256d91808b47c195bc9b4dbd7f2b87 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e5256d91808b47c195bc9b4dbd7f2b87, State: Initialized, Role: FOLLOWER
I20260709 13:04:06.703632 19640 raft_consensus.cc:493] T 14935b3ddf914369822e4a0547aaa355 P 0473d2b2d01f4459b1e90fd12cc7840e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:06.704459 19611 raft_consensus.cc:493] T 7be9efa6559648dbb5a0f7684c4542d1 P 0473d2b2d01f4459b1e90fd12cc7840e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:06.704221 19640 raft_consensus.cc:515] T 14935b3ddf914369822e4a0547aaa355 P 0473d2b2d01f4459b1e90fd12cc7840e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:06.704901 19611 raft_consensus.cc:515] T 7be9efa6559648dbb5a0f7684c4542d1 P 0473d2b2d01f4459b1e90fd12cc7840e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:06.706535 19640 leader_election.cc:290] T 14935b3ddf914369822e4a0547aaa355 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:04:06.708120 19559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14935b3ddf914369822e4a0547aaa355" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:04:06.709071 19409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7be9efa6559648dbb5a0f7684c4542d1" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:04:06.710289 19601 tablet_bootstrap.cc:654] T 2a16f7501e2444fb86d4e2778e734e02 P 0473d2b2d01f4459b1e90fd12cc7840e: Neither blocks nor log segments found. Creating new log.
W20260709 13:04:06.710469 19450 leader_election.cc:343] T 14935b3ddf914369822e4a0547aaa355 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:06.711020 19611 leader_election.cc:290] T 7be9efa6559648dbb5a0f7684c4542d1 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:04:06.711822 19411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14935b3ddf914369822e4a0547aaa355" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:04:06.712443 19411 raft_consensus.cc:2468] T 14935b3ddf914369822e4a0547aaa355 P e5256d91808b47c195bc9b4dbd7f2b87 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 0.
I20260709 13:04:06.712831 19559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7be9efa6559648dbb5a0f7684c4542d1" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:04:06.714058 19559 raft_consensus.cc:2393] T 7be9efa6559648dbb5a0f7684c4542d1 P e61c3a8f61bb48f8a963c9480e53c168 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0473d2b2d01f4459b1e90fd12cc7840e in current term 1: Already voted for candidate e5256d91808b47c195bc9b4dbd7f2b87 in this term.
I20260709 13:04:06.713833 19449 leader_election.cc:304] T 14935b3ddf914369822e4a0547aaa355 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87; no voters: e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:04:06.714921 19611 raft_consensus.cc:2804] T 14935b3ddf914369822e4a0547aaa355 P 0473d2b2d01f4459b1e90fd12cc7840e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:06.715390 19611 raft_consensus.cc:493] T 14935b3ddf914369822e4a0547aaa355 P 0473d2b2d01f4459b1e90fd12cc7840e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:06.715839 19611 raft_consensus.cc:3060] T 14935b3ddf914369822e4a0547aaa355 P 0473d2b2d01f4459b1e90fd12cc7840e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:06.715794 19450 leader_election.cc:304] T 7be9efa6559648dbb5a0f7684c4542d1 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e; no voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:04:06.717130 19640 raft_consensus.cc:3060] T 7be9efa6559648dbb5a0f7684c4542d1 P 0473d2b2d01f4459b1e90fd12cc7840e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:06.719950 19601 tablet_bootstrap.cc:492] T 2a16f7501e2444fb86d4e2778e734e02 P 0473d2b2d01f4459b1e90fd12cc7840e: No bootstrap required, opened a new log
I20260709 13:04:06.720386 19601 ts_tablet_manager.cc:1403] T 2a16f7501e2444fb86d4e2778e734e02 P 0473d2b2d01f4459b1e90fd12cc7840e: Time spent bootstrapping tablet: real 0.033s	user 0.009s	sys 0.000s
I20260709 13:04:06.724704 19611 raft_consensus.cc:515] T 14935b3ddf914369822e4a0547aaa355 P 0473d2b2d01f4459b1e90fd12cc7840e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:06.727473 19411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14935b3ddf914369822e4a0547aaa355" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
I20260709 13:04:06.728018 19411 raft_consensus.cc:3060] T 14935b3ddf914369822e4a0547aaa355 P e5256d91808b47c195bc9b4dbd7f2b87 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:06.728756 19640 raft_consensus.cc:2749] T 7be9efa6559648dbb5a0f7684c4542d1 P 0473d2b2d01f4459b1e90fd12cc7840e [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:04:06.730257 19601 raft_consensus.cc:359] T 2a16f7501e2444fb86d4e2778e734e02 P 0473d2b2d01f4459b1e90fd12cc7840e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:06.730947 19601 raft_consensus.cc:385] T 2a16f7501e2444fb86d4e2778e734e02 P 0473d2b2d01f4459b1e90fd12cc7840e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:06.731222 19601 raft_consensus.cc:740] T 2a16f7501e2444fb86d4e2778e734e02 P 0473d2b2d01f4459b1e90fd12cc7840e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0473d2b2d01f4459b1e90fd12cc7840e, State: Initialized, Role: FOLLOWER
I20260709 13:04:06.731870 19601 consensus_queue.cc:260] T 2a16f7501e2444fb86d4e2778e734e02 P 0473d2b2d01f4459b1e90fd12cc7840e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:06.733705 19634 raft_consensus.cc:493] T 217b5fae677b4971b3bbd2f357a1f7ff P e5256d91808b47c195bc9b4dbd7f2b87 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:06.734297 19634 raft_consensus.cc:515] T 217b5fae677b4971b3bbd2f357a1f7ff P e5256d91808b47c195bc9b4dbd7f2b87 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:06.737051 19634 leader_election.cc:290] T 217b5fae677b4971b3bbd2f357a1f7ff P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:04:06.737355 19601 ts_tablet_manager.cc:1434] T 2a16f7501e2444fb86d4e2778e734e02 P 0473d2b2d01f4459b1e90fd12cc7840e: Time spent starting tablet: real 0.017s	user 0.007s	sys 0.000s
I20260709 13:04:06.738238 19601 tablet_bootstrap.cc:492] T d1e5873a19244c5ebbcd38e126796ee7 P 0473d2b2d01f4459b1e90fd12cc7840e: Bootstrap starting.
I20260709 13:04:06.738791 19559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "217b5fae677b4971b3bbd2f357a1f7ff" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:04:06.739611 19559 raft_consensus.cc:2468] T 217b5fae677b4971b3bbd2f357a1f7ff P e61c3a8f61bb48f8a963c9480e53c168 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 0.
I20260709 13:04:06.739995 19411 raft_consensus.cc:2468] T 14935b3ddf914369822e4a0547aaa355 P e5256d91808b47c195bc9b4dbd7f2b87 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 1.
I20260709 13:04:06.741448 19449 leader_election.cc:304] T 14935b3ddf914369822e4a0547aaa355 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87; no voters: 
I20260709 13:04:06.742636 19484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "217b5fae677b4971b3bbd2f357a1f7ff" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:04:06.743664 19484 raft_consensus.cc:2468] T 217b5fae677b4971b3bbd2f357a1f7ff P 0473d2b2d01f4459b1e90fd12cc7840e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 0.
I20260709 13:04:06.743773 19640 raft_consensus.cc:2804] T 14935b3ddf914369822e4a0547aaa355 P 0473d2b2d01f4459b1e90fd12cc7840e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:06.744462 19640 raft_consensus.cc:697] T 14935b3ddf914369822e4a0547aaa355 P 0473d2b2d01f4459b1e90fd12cc7840e [term 1 LEADER]: Becoming Leader. State: Replica: 0473d2b2d01f4459b1e90fd12cc7840e, State: Running, Role: LEADER
I20260709 13:04:06.745488 19640 consensus_queue.cc:237] T 14935b3ddf914369822e4a0547aaa355 P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:06.741132 19375 leader_election.cc:304] T 217b5fae677b4971b3bbd2f357a1f7ff P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:04:06.750573 19601 tablet_bootstrap.cc:654] T d1e5873a19244c5ebbcd38e126796ee7 P 0473d2b2d01f4459b1e90fd12cc7840e: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:06.752060 19604 consensus_queue.cc:260] T fa8650e71aa14778b3d73721fc50d9fc P e5256d91808b47c195bc9b4dbd7f2b87 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:06.752946 19634 raft_consensus.cc:2804] T 217b5fae677b4971b3bbd2f357a1f7ff P e5256d91808b47c195bc9b4dbd7f2b87 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:06.754179 19634 raft_consensus.cc:493] T 217b5fae677b4971b3bbd2f357a1f7ff P e5256d91808b47c195bc9b4dbd7f2b87 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:06.754807 19634 raft_consensus.cc:3060] T 217b5fae677b4971b3bbd2f357a1f7ff P e5256d91808b47c195bc9b4dbd7f2b87 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:06.756088 19647 raft_consensus.cc:493] T 2a16f7501e2444fb86d4e2778e734e02 P 0473d2b2d01f4459b1e90fd12cc7840e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:06.756707 19647 raft_consensus.cc:515] T 2a16f7501e2444fb86d4e2778e734e02 P 0473d2b2d01f4459b1e90fd12cc7840e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:06.758002 19633 consensus_queue.cc:1048] T f1b10566f45d4a7d9029858330e02d5b P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:04:06.759452 19647 leader_election.cc:290] T 2a16f7501e2444fb86d4e2778e734e02 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:04:06.761857 19559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a16f7501e2444fb86d4e2778e734e02" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:04:06.762621 19559 raft_consensus.cc:2468] T 2a16f7501e2444fb86d4e2778e734e02 P e61c3a8f61bb48f8a963c9480e53c168 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 0.
I20260709 13:04:06.764093 19450 leader_election.cc:304] T 2a16f7501e2444fb86d4e2778e734e02 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:04:06.765120 19647 raft_consensus.cc:2804] T 2a16f7501e2444fb86d4e2778e734e02 P 0473d2b2d01f4459b1e90fd12cc7840e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:06.765661 19647 raft_consensus.cc:493] T 2a16f7501e2444fb86d4e2778e734e02 P 0473d2b2d01f4459b1e90fd12cc7840e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:06.766167 19647 raft_consensus.cc:3060] T 2a16f7501e2444fb86d4e2778e734e02 P 0473d2b2d01f4459b1e90fd12cc7840e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:06.771497 19409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a16f7501e2444fb86d4e2778e734e02" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:04:06.771997 19646 raft_consensus.cc:493] T fa8650e71aa14778b3d73721fc50d9fc P 0473d2b2d01f4459b1e90fd12cc7840e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:06.772573 19646 raft_consensus.cc:515] T fa8650e71aa14778b3d73721fc50d9fc P 0473d2b2d01f4459b1e90fd12cc7840e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
W20260709 13:04:06.773316 19449 leader_election.cc:343] T 2a16f7501e2444fb86d4e2778e734e02 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:06.775602 19646 leader_election.cc:290] T fa8650e71aa14778b3d73721fc50d9fc P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:04:06.777478 19559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa8650e71aa14778b3d73721fc50d9fc" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
W20260709 13:04:06.779194 19450 leader_election.cc:343] T fa8650e71aa14778b3d73721fc50d9fc P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:06.781553 19409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa8650e71aa14778b3d73721fc50d9fc" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:04:06.782434 19409 raft_consensus.cc:2468] T fa8650e71aa14778b3d73721fc50d9fc P e5256d91808b47c195bc9b4dbd7f2b87 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 0.
I20260709 13:04:06.786335 19449 leader_election.cc:304] T fa8650e71aa14778b3d73721fc50d9fc P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87; no voters: e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:04:06.787451 19646 raft_consensus.cc:2804] T fa8650e71aa14778b3d73721fc50d9fc P 0473d2b2d01f4459b1e90fd12cc7840e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:06.787899 19646 raft_consensus.cc:493] T fa8650e71aa14778b3d73721fc50d9fc P 0473d2b2d01f4459b1e90fd12cc7840e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:06.788288 19646 raft_consensus.cc:3060] T fa8650e71aa14778b3d73721fc50d9fc P 0473d2b2d01f4459b1e90fd12cc7840e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:06.801378 19615 consensus_queue.cc:1048] T 70797e5783b5454ab0d0eea663e791e3 P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:06.809036 19411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2725d2c4cb054f18b0fc8f735c15f6c2" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
I20260709 13:04:06.754207 19604 ts_tablet_manager.cc:1434] T fa8650e71aa14778b3d73721fc50d9fc P e5256d91808b47c195bc9b4dbd7f2b87: Time spent starting tablet: real 0.094s	user 0.005s	sys 0.001s
W20260709 13:04:06.810590 19523 leader_election.cc:343] T 2725d2c4cb054f18b0fc8f735c15f6c2 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:06.811609 19604 tablet_bootstrap.cc:492] T 2e36a9d6e29c4a7c860cf267efbd4c74 P e5256d91808b47c195bc9b4dbd7f2b87: Bootstrap starting.
I20260709 13:04:06.812966 19611 leader_election.cc:290] T 14935b3ddf914369822e4a0547aaa355 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 1 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:04:06.814514 19559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14935b3ddf914369822e4a0547aaa355" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:04:06.815316 19630 leader_election.cc:290] T 2725d2c4cb054f18b0fc8f735c15f6c2 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 1 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
W20260709 13:04:06.817113 19450 leader_election.cc:343] T 14935b3ddf914369822e4a0547aaa355 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:06.820336 19677 raft_consensus.cc:493] T 1f85fc4b527a48848e5faa083b604e36 P e5256d91808b47c195bc9b4dbd7f2b87 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:06.820878 19677 raft_consensus.cc:515] T 1f85fc4b527a48848e5faa083b604e36 P e5256d91808b47c195bc9b4dbd7f2b87 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } }
I20260709 13:04:06.830204 19559 raft_consensus.cc:3060] T f1b10566f45d4a7d9029858330e02d5b P e61c3a8f61bb48f8a963c9480e53c168 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:06.830418 19647 raft_consensus.cc:515] T 2a16f7501e2444fb86d4e2778e734e02 P 0473d2b2d01f4459b1e90fd12cc7840e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:06.798472 19646 raft_consensus.cc:515] T fa8650e71aa14778b3d73721fc50d9fc P 0473d2b2d01f4459b1e90fd12cc7840e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:06.830138 19634 raft_consensus.cc:515] T 217b5fae677b4971b3bbd2f357a1f7ff P e5256d91808b47c195bc9b4dbd7f2b87 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:06.843653 19560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa8650e71aa14778b3d73721fc50d9fc" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:04:06.849790 19484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2725d2c4cb054f18b0fc8f735c15f6c2" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:04:06.847049 19486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f85fc4b527a48848e5faa083b604e36" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:04:06.850579 19484 raft_consensus.cc:3060] T 2725d2c4cb054f18b0fc8f735c15f6c2 P 0473d2b2d01f4459b1e90fd12cc7840e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:06.847618 19677 leader_election.cc:290] T 1f85fc4b527a48848e5faa083b604e36 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:04:06.847470 19558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f85fc4b527a48848e5faa083b604e36" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:04:06.851821 19558 raft_consensus.cc:2393] T 1f85fc4b527a48848e5faa083b604e36 P e61c3a8f61bb48f8a963c9480e53c168 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e5256d91808b47c195bc9b4dbd7f2b87 in current term 1: Already voted for candidate 0473d2b2d01f4459b1e90fd12cc7840e in this term.
I20260709 13:04:06.852936 19558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "217b5fae677b4971b3bbd2f357a1f7ff" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:04:06.853191 19375 leader_election.cc:304] T 1f85fc4b527a48848e5faa083b604e36 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:04:06.853514 19558 raft_consensus.cc:3060] T 217b5fae677b4971b3bbd2f357a1f7ff P e61c3a8f61bb48f8a963c9480e53c168 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:06.853034 19486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "217b5fae677b4971b3bbd2f357a1f7ff" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:04:06.853965 19639 raft_consensus.cc:3060] T 1f85fc4b527a48848e5faa083b604e36 P e5256d91808b47c195bc9b4dbd7f2b87 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:06.854213 19634 leader_election.cc:290] T 217b5fae677b4971b3bbd2f357a1f7ff P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 1 election: Requested vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:04:06.854359 19486 raft_consensus.cc:3060] T 217b5fae677b4971b3bbd2f357a1f7ff P 0473d2b2d01f4459b1e90fd12cc7840e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:06.854766 19646 leader_election.cc:290] T fa8650e71aa14778b3d73721fc50d9fc P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 1 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:04:06.863190 19410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa8650e71aa14778b3d73721fc50d9fc" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
I20260709 13:04:06.863981 19410 raft_consensus.cc:3060] T fa8650e71aa14778b3d73721fc50d9fc P e5256d91808b47c195bc9b4dbd7f2b87 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:06.865067 19647 leader_election.cc:290] T 2a16f7501e2444fb86d4e2778e734e02 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 1 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:04:06.847853 19601 tablet_bootstrap.cc:492] T d1e5873a19244c5ebbcd38e126796ee7 P 0473d2b2d01f4459b1e90fd12cc7840e: No bootstrap required, opened a new log
I20260709 13:04:06.846189 19306 catalog_manager.cc:5697] T 14935b3ddf914369822e4a0547aaa355 P 0473d2b2d01f4459b1e90fd12cc7840e reported cstate change: term changed from 0 to 1, leader changed from <none> to 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2). New cstate: current_term: 1 leader_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:06.848093 19615 consensus_queue.cc:1048] T f1b10566f45d4a7d9029858330e02d5b P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:04:06.849774 19600 tablet_bootstrap.cc:492] T 309c3ca0ca4b4f3ba129752ea2cb293b P e61c3a8f61bb48f8a963c9480e53c168: No bootstrap required, opened a new log
I20260709 13:04:06.867619 19600 ts_tablet_manager.cc:1403] T 309c3ca0ca4b4f3ba129752ea2cb293b P e61c3a8f61bb48f8a963c9480e53c168: Time spent bootstrapping tablet: real 0.194s	user 0.011s	sys 0.011s
I20260709 13:04:06.872790 19600 raft_consensus.cc:359] T 309c3ca0ca4b4f3ba129752ea2cb293b P e61c3a8f61bb48f8a963c9480e53c168 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:06.874426 19600 raft_consensus.cc:385] T 309c3ca0ca4b4f3ba129752ea2cb293b P e61c3a8f61bb48f8a963c9480e53c168 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:06.874816 19600 raft_consensus.cc:740] T 309c3ca0ca4b4f3ba129752ea2cb293b P e61c3a8f61bb48f8a963c9480e53c168 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e61c3a8f61bb48f8a963c9480e53c168, State: Initialized, Role: FOLLOWER
I20260709 13:04:06.875099 19604 tablet_bootstrap.cc:654] T 2e36a9d6e29c4a7c860cf267efbd4c74 P e5256d91808b47c195bc9b4dbd7f2b87: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:06.868884 19601 ts_tablet_manager.cc:1403] T d1e5873a19244c5ebbcd38e126796ee7 P 0473d2b2d01f4459b1e90fd12cc7840e: Time spent bootstrapping tablet: real 0.130s	user 0.032s	sys 0.026s
I20260709 13:04:06.876714 19600 consensus_queue.cc:260] T 309c3ca0ca4b4f3ba129752ea2cb293b P e61c3a8f61bb48f8a963c9480e53c168 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:06.878005 19558 raft_consensus.cc:2468] T 217b5fae677b4971b3bbd2f357a1f7ff P e61c3a8f61bb48f8a963c9480e53c168 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 1.
I20260709 13:04:06.879931 19375 leader_election.cc:304] T 217b5fae677b4971b3bbd2f357a1f7ff P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
W20260709 13:04:06.876456 19450 leader_election.cc:343] T fa8650e71aa14778b3d73721fc50d9fc P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:06.884676 19410 raft_consensus.cc:2468] T fa8650e71aa14778b3d73721fc50d9fc P e5256d91808b47c195bc9b4dbd7f2b87 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 1.
I20260709 13:04:06.877543 19639 raft_consensus.cc:2749] T 1f85fc4b527a48848e5faa083b604e36 P e5256d91808b47c195bc9b4dbd7f2b87 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:04:06.880965 19411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a16f7501e2444fb86d4e2778e734e02" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
I20260709 13:04:06.892166 19677 consensus_queue.cc:1048] T 70797e5783b5454ab0d0eea663e791e3 P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:04:06.893338 19558 raft_consensus.cc:3060] T ef32ce6fdd0e40d382c79974f30295c6 P e61c3a8f61bb48f8a963c9480e53c168 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:06.893450 19679 raft_consensus.cc:2804] T 217b5fae677b4971b3bbd2f357a1f7ff P e5256d91808b47c195bc9b4dbd7f2b87 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:06.900419 19449 leader_election.cc:304] T fa8650e71aa14778b3d73721fc50d9fc P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87; no voters: e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:04:06.921084 19484 raft_consensus.cc:2468] T 2725d2c4cb054f18b0fc8f735c15f6c2 P 0473d2b2d01f4459b1e90fd12cc7840e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 1.
W20260709 13:04:06.913947 19523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.1:40321, user_credentials={real_user=slave}} blocked reactor thread for 72992.8us
I20260709 13:04:06.927480 19679 raft_consensus.cc:697] T 217b5fae677b4971b3bbd2f357a1f7ff P e5256d91808b47c195bc9b4dbd7f2b87 [term 1 LEADER]: Becoming Leader. State: Replica: e5256d91808b47c195bc9b4dbd7f2b87, State: Running, Role: LEADER
I20260709 13:04:06.930533 19647 raft_consensus.cc:2804] T fa8650e71aa14778b3d73721fc50d9fc P 0473d2b2d01f4459b1e90fd12cc7840e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:06.934753 19678 raft_consensus.cc:493] T ed7fdbcb96d14d418db9ca90a792588a P 0473d2b2d01f4459b1e90fd12cc7840e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:06.935178 19678 raft_consensus.cc:515] T ed7fdbcb96d14d418db9ca90a792588a P 0473d2b2d01f4459b1e90fd12cc7840e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:06.936978 19678 leader_election.cc:290] T ed7fdbcb96d14d418db9ca90a792588a P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:04:06.936589 19526 leader_election.cc:304] T 2725d2c4cb054f18b0fc8f735c15f6c2 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168; no voters: e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:04:06.938545 19646 consensus_queue.cc:1048] T 1f85fc4b527a48848e5faa083b604e36 P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 13:04:06.939178 19449 leader_election.cc:343] T 2a16f7501e2444fb86d4e2778e734e02 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:06.940457 19308 catalog_manager.cc:5697] T 7be9efa6559648dbb5a0f7684c4542d1 P e5256d91808b47c195bc9b4dbd7f2b87 reported cstate change: term changed from 0 to 1, leader changed from <none> to e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1). New cstate: current_term: 1 leader_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:06.941097 19411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed7fdbcb96d14d418db9ca90a792588a" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:04:06.933961 19647 raft_consensus.cc:697] T fa8650e71aa14778b3d73721fc50d9fc P 0473d2b2d01f4459b1e90fd12cc7840e [term 1 LEADER]: Becoming Leader. State: Replica: 0473d2b2d01f4459b1e90fd12cc7840e, State: Running, Role: LEADER
I20260709 13:04:06.944154 19559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed7fdbcb96d14d418db9ca90a792588a" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:04:06.944039 19647 consensus_queue.cc:237] T fa8650e71aa14778b3d73721fc50d9fc P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:06.930857 19486 raft_consensus.cc:2468] T 217b5fae677b4971b3bbd2f357a1f7ff P 0473d2b2d01f4459b1e90fd12cc7840e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 1.
I20260709 13:04:06.954815 19557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a16f7501e2444fb86d4e2778e734e02" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:04:06.961922 19601 raft_consensus.cc:359] T d1e5873a19244c5ebbcd38e126796ee7 P 0473d2b2d01f4459b1e90fd12cc7840e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:06.962884 19601 raft_consensus.cc:385] T d1e5873a19244c5ebbcd38e126796ee7 P 0473d2b2d01f4459b1e90fd12cc7840e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:06.963212 19601 raft_consensus.cc:740] T d1e5873a19244c5ebbcd38e126796ee7 P 0473d2b2d01f4459b1e90fd12cc7840e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0473d2b2d01f4459b1e90fd12cc7840e, State: Initialized, Role: FOLLOWER
I20260709 13:04:06.956748 19557 raft_consensus.cc:3060] T 2a16f7501e2444fb86d4e2778e734e02 P e61c3a8f61bb48f8a963c9480e53c168 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:06.929894 19679 consensus_queue.cc:237] T 217b5fae677b4971b3bbd2f357a1f7ff P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:06.965394 19600 ts_tablet_manager.cc:1434] T 309c3ca0ca4b4f3ba129752ea2cb293b P e61c3a8f61bb48f8a963c9480e53c168: Time spent starting tablet: real 0.097s	user 0.015s	sys 0.020s
I20260709 13:04:06.975952 19600 tablet_bootstrap.cc:492] T 7f575b143b844aa096b50997dad3516a P e61c3a8f61bb48f8a963c9480e53c168: Bootstrap starting.
I20260709 13:04:06.972124 19601 consensus_queue.cc:260] T d1e5873a19244c5ebbcd38e126796ee7 P 0473d2b2d01f4459b1e90fd12cc7840e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
W20260709 13:04:06.963511 19450 leader_election.cc:343] T ed7fdbcb96d14d418db9ca90a792588a P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:06.983846 19601 ts_tablet_manager.cc:1434] T d1e5873a19244c5ebbcd38e126796ee7 P 0473d2b2d01f4459b1e90fd12cc7840e: Time spent starting tablet: real 0.108s	user 0.008s	sys 0.000s
I20260709 13:04:06.985008 19601 tablet_bootstrap.cc:492] T 40e1e16737a842ee936002830f36882e P 0473d2b2d01f4459b1e90fd12cc7840e: Bootstrap starting.
W20260709 13:04:06.980731 19449 leader_election.cc:343] T ed7fdbcb96d14d418db9ca90a792588a P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:07.007543 19449 leader_election.cc:304] T ed7fdbcb96d14d418db9ca90a792588a P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e; no voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:04:07.015316 19684 raft_consensus.cc:2804] T 2725d2c4cb054f18b0fc8f735c15f6c2 P e61c3a8f61bb48f8a963c9480e53c168 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:07.024180 19600 tablet_bootstrap.cc:654] T 7f575b143b844aa096b50997dad3516a P e61c3a8f61bb48f8a963c9480e53c168: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:07.027892 19647 raft_consensus.cc:2749] T ed7fdbcb96d14d418db9ca90a792588a P 0473d2b2d01f4459b1e90fd12cc7840e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:04:07.032410 19604 tablet_bootstrap.cc:492] T 2e36a9d6e29c4a7c860cf267efbd4c74 P e5256d91808b47c195bc9b4dbd7f2b87: No bootstrap required, opened a new log
I20260709 13:04:07.032814 19604 ts_tablet_manager.cc:1403] T 2e36a9d6e29c4a7c860cf267efbd4c74 P e5256d91808b47c195bc9b4dbd7f2b87: Time spent bootstrapping tablet: real 0.221s	user 0.017s	sys 0.015s
I20260709 13:04:07.029968 19684 raft_consensus.cc:697] T 2725d2c4cb054f18b0fc8f735c15f6c2 P e61c3a8f61bb48f8a963c9480e53c168 [term 1 LEADER]: Becoming Leader. State: Replica: e61c3a8f61bb48f8a963c9480e53c168, State: Running, Role: LEADER
W20260709 13:04:07.028707 19449 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.1:40321, user_credentials={real_user=slave}} blocked reactor thread for 63845.3us
W20260709 13:04:07.040769 19357 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:04:07.040911 19557 raft_consensus.cc:2468] T 2a16f7501e2444fb86d4e2778e734e02 P e61c3a8f61bb48f8a963c9480e53c168 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 1.
I20260709 13:04:07.042359 19450 leader_election.cc:304] T 2a16f7501e2444fb86d4e2778e734e02 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168; no voters: e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:04:07.045773 19603 raft_consensus.cc:493] T f1b10566f45d4a7d9029858330e02d5b P e61c3a8f61bb48f8a963c9480e53c168 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e5256d91808b47c195bc9b4dbd7f2b87)
I20260709 13:04:07.046846 19603 raft_consensus.cc:515] T f1b10566f45d4a7d9029858330e02d5b P e61c3a8f61bb48f8a963c9480e53c168 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:07.048017 19601 tablet_bootstrap.cc:654] T 40e1e16737a842ee936002830f36882e P 0473d2b2d01f4459b1e90fd12cc7840e: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:07.043609 19646 raft_consensus.cc:2804] T 2a16f7501e2444fb86d4e2778e734e02 P 0473d2b2d01f4459b1e90fd12cc7840e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:07.036186 19684 consensus_queue.cc:237] T 2725d2c4cb054f18b0fc8f735c15f6c2 P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:07.049942 19646 raft_consensus.cc:697] T 2a16f7501e2444fb86d4e2778e734e02 P 0473d2b2d01f4459b1e90fd12cc7840e [term 1 LEADER]: Becoming Leader. State: Replica: 0473d2b2d01f4459b1e90fd12cc7840e, State: Running, Role: LEADER
I20260709 13:04:07.054843 19678 consensus_queue.cc:1048] T 1f85fc4b527a48848e5faa083b604e36 P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:07.055575 19604 raft_consensus.cc:359] T 2e36a9d6e29c4a7c860cf267efbd4c74 P e5256d91808b47c195bc9b4dbd7f2b87 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:07.055131 19646 consensus_queue.cc:237] T 2a16f7501e2444fb86d4e2778e734e02 P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:07.056252 19604 raft_consensus.cc:385] T 2e36a9d6e29c4a7c860cf267efbd4c74 P e5256d91808b47c195bc9b4dbd7f2b87 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:07.056567 19604 raft_consensus.cc:740] T 2e36a9d6e29c4a7c860cf267efbd4c74 P e5256d91808b47c195bc9b4dbd7f2b87 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e5256d91808b47c195bc9b4dbd7f2b87, State: Initialized, Role: FOLLOWER
I20260709 13:04:07.057390 19604 consensus_queue.cc:260] T 2e36a9d6e29c4a7c860cf267efbd4c74 P e5256d91808b47c195bc9b4dbd7f2b87 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:07.067672 19604 ts_tablet_manager.cc:1434] T 2e36a9d6e29c4a7c860cf267efbd4c74 P e5256d91808b47c195bc9b4dbd7f2b87: Time spent starting tablet: real 0.035s	user 0.007s	sys 0.001s
I20260709 13:04:07.068696 19604 tablet_bootstrap.cc:492] T 40e1e16737a842ee936002830f36882e P e5256d91808b47c195bc9b4dbd7f2b87: Bootstrap starting.
I20260709 13:04:07.078452 19685 raft_consensus.cc:493] T 2e36a9d6e29c4a7c860cf267efbd4c74 P e5256d91808b47c195bc9b4dbd7f2b87 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:07.078974 19685 raft_consensus.cc:515] T 2e36a9d6e29c4a7c860cf267efbd4c74 P e5256d91808b47c195bc9b4dbd7f2b87 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:07.084785 19685 leader_election.cc:290] T 2e36a9d6e29c4a7c860cf267efbd4c74 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:04:07.088968 19486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e36a9d6e29c4a7c860cf267efbd4c74" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:04:07.089057 19558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e36a9d6e29c4a7c860cf267efbd4c74" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
W20260709 13:04:07.093510 19377 leader_election.cc:343] T 2e36a9d6e29c4a7c860cf267efbd4c74 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:07.094633 19603 leader_election.cc:290] T f1b10566f45d4a7d9029858330e02d5b P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:04:07.095840 19486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1b10566f45d4a7d9029858330e02d5b" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:04:07.095840 19411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1b10566f45d4a7d9029858330e02d5b" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:04:07.095660 19306 catalog_manager.cc:5697] T fa8650e71aa14778b3d73721fc50d9fc P 0473d2b2d01f4459b1e90fd12cc7840e reported cstate change: term changed from 0 to 1, leader changed from <none> to 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2). New cstate: current_term: 1 leader_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:07.097621 19523 leader_election.cc:304] T f1b10566f45d4a7d9029858330e02d5b P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e61c3a8f61bb48f8a963c9480e53c168; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:04:07.098255 19603 raft_consensus.cc:2749] T f1b10566f45d4a7d9029858330e02d5b P e61c3a8f61bb48f8a963c9480e53c168 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:04:07.099022 19600 tablet_bootstrap.cc:492] T 7f575b143b844aa096b50997dad3516a P e61c3a8f61bb48f8a963c9480e53c168: No bootstrap required, opened a new log
W20260709 13:04:07.099309 19375 leader_election.cc:343] T 2e36a9d6e29c4a7c860cf267efbd4c74 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:07.099500 19600 ts_tablet_manager.cc:1403] T 7f575b143b844aa096b50997dad3516a P e61c3a8f61bb48f8a963c9480e53c168: Time spent bootstrapping tablet: real 0.124s	user 0.007s	sys 0.012s
I20260709 13:04:07.099761 19375 leader_election.cc:304] T 2e36a9d6e29c4a7c860cf267efbd4c74 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:04:07.102077 19685 raft_consensus.cc:2749] T 2e36a9d6e29c4a7c860cf267efbd4c74 P e5256d91808b47c195bc9b4dbd7f2b87 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:04:07.103017 19600 raft_consensus.cc:359] T 7f575b143b844aa096b50997dad3516a P e61c3a8f61bb48f8a963c9480e53c168 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:07.103536 19600 raft_consensus.cc:385] T 7f575b143b844aa096b50997dad3516a P e61c3a8f61bb48f8a963c9480e53c168 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:07.103780 19600 raft_consensus.cc:740] T 7f575b143b844aa096b50997dad3516a P e61c3a8f61bb48f8a963c9480e53c168 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e61c3a8f61bb48f8a963c9480e53c168, State: Initialized, Role: FOLLOWER
I20260709 13:04:07.104432 19600 consensus_queue.cc:260] T 7f575b143b844aa096b50997dad3516a P e61c3a8f61bb48f8a963c9480e53c168 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:07.106196 19600 ts_tablet_manager.cc:1434] T 7f575b143b844aa096b50997dad3516a P e61c3a8f61bb48f8a963c9480e53c168: Time spent starting tablet: real 0.006s	user 0.003s	sys 0.000s
I20260709 13:04:07.107198 19600 tablet_bootstrap.cc:492] T 2e36a9d6e29c4a7c860cf267efbd4c74 P e61c3a8f61bb48f8a963c9480e53c168: Bootstrap starting.
W20260709 13:04:07.112803 19377 consensus_peers.cc:597] T 14efcc79969f41babe5529c22d59156d P e5256d91808b47c195bc9b4dbd7f2b87 -> Peer 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257): Couldn't send request to peer 0473d2b2d01f4459b1e90fd12cc7840e. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:07.109834 19685 consensus_queue.cc:1048] T 7be9efa6559648dbb5a0f7684c4542d1 P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 13:04:07.115164 19685 consensus_queue.cc:1048] T 14efcc79969f41babe5529c22d59156d P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:07.118773 19308 catalog_manager.cc:5697] T 14efcc79969f41babe5529c22d59156d P e5256d91808b47c195bc9b4dbd7f2b87 reported cstate change: term changed from 0 to 1, leader changed from <none> to e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1). New cstate: current_term: 1 leader_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:07.120873 19308 catalog_manager.cc:5697] T 217b5fae677b4971b3bbd2f357a1f7ff P e5256d91808b47c195bc9b4dbd7f2b87 reported cstate change: term changed from 0 to 1, leader changed from <none> to e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1). New cstate: current_term: 1 leader_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:07.119510 19601 tablet_bootstrap.cc:492] T 40e1e16737a842ee936002830f36882e P 0473d2b2d01f4459b1e90fd12cc7840e: No bootstrap required, opened a new log
I20260709 13:04:07.122761 19601 ts_tablet_manager.cc:1403] T 40e1e16737a842ee936002830f36882e P 0473d2b2d01f4459b1e90fd12cc7840e: Time spent bootstrapping tablet: real 0.138s	user 0.012s	sys 0.007s
I20260709 13:04:07.129822 19604 tablet_bootstrap.cc:654] T 40e1e16737a842ee936002830f36882e P e5256d91808b47c195bc9b4dbd7f2b87: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:07.131171 19600 tablet_bootstrap.cc:654] T 2e36a9d6e29c4a7c860cf267efbd4c74 P e61c3a8f61bb48f8a963c9480e53c168: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:07.138162 19601 raft_consensus.cc:359] T 40e1e16737a842ee936002830f36882e P 0473d2b2d01f4459b1e90fd12cc7840e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:07.138892 19601 raft_consensus.cc:385] T 40e1e16737a842ee936002830f36882e P 0473d2b2d01f4459b1e90fd12cc7840e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:07.139153 19601 raft_consensus.cc:740] T 40e1e16737a842ee936002830f36882e P 0473d2b2d01f4459b1e90fd12cc7840e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0473d2b2d01f4459b1e90fd12cc7840e, State: Initialized, Role: FOLLOWER
I20260709 13:04:07.139741 19601 consensus_queue.cc:260] T 40e1e16737a842ee936002830f36882e P 0473d2b2d01f4459b1e90fd12cc7840e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:07.142305 19601 ts_tablet_manager.cc:1434] T 40e1e16737a842ee936002830f36882e P 0473d2b2d01f4459b1e90fd12cc7840e: Time spent starting tablet: real 0.019s	user 0.005s	sys 0.000s
I20260709 13:04:07.143440 19601 tablet_bootstrap.cc:492] T 14efcc79969f41babe5529c22d59156d P 0473d2b2d01f4459b1e90fd12cc7840e: Bootstrap starting.
I20260709 13:04:07.146113 19309 catalog_manager.cc:5697] T 2725d2c4cb054f18b0fc8f735c15f6c2 P e61c3a8f61bb48f8a963c9480e53c168 reported cstate change: term changed from 0 to 1, leader changed from <none> to e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3). New cstate: current_term: 1 leader_uuid: "e61c3a8f61bb48f8a963c9480e53c168" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } health_report { overall_health: HEALTHY } } }
I20260709 13:04:07.148756 19306 catalog_manager.cc:5697] T 2a16f7501e2444fb86d4e2778e734e02 P 0473d2b2d01f4459b1e90fd12cc7840e reported cstate change: term changed from 0 to 1, leader changed from <none> to 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2). New cstate: current_term: 1 leader_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:07.163599 19601 tablet_bootstrap.cc:654] T 14efcc79969f41babe5529c22d59156d P 0473d2b2d01f4459b1e90fd12cc7840e: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:07.170542 19679 consensus_queue.cc:1048] T 7be9efa6559648dbb5a0f7684c4542d1 P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:07.174953 19600 tablet_bootstrap.cc:492] T 2e36a9d6e29c4a7c860cf267efbd4c74 P e61c3a8f61bb48f8a963c9480e53c168: No bootstrap required, opened a new log
I20260709 13:04:07.175570 19600 ts_tablet_manager.cc:1403] T 2e36a9d6e29c4a7c860cf267efbd4c74 P e61c3a8f61bb48f8a963c9480e53c168: Time spent bootstrapping tablet: real 0.069s	user 0.019s	sys 0.007s
I20260709 13:04:07.178040 19600 raft_consensus.cc:359] T 2e36a9d6e29c4a7c860cf267efbd4c74 P e61c3a8f61bb48f8a963c9480e53c168 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:07.178763 19600 raft_consensus.cc:385] T 2e36a9d6e29c4a7c860cf267efbd4c74 P e61c3a8f61bb48f8a963c9480e53c168 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:07.179104 19600 raft_consensus.cc:740] T 2e36a9d6e29c4a7c860cf267efbd4c74 P e61c3a8f61bb48f8a963c9480e53c168 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e61c3a8f61bb48f8a963c9480e53c168, State: Initialized, Role: FOLLOWER
I20260709 13:04:07.179768 19600 consensus_queue.cc:260] T 2e36a9d6e29c4a7c860cf267efbd4c74 P e61c3a8f61bb48f8a963c9480e53c168 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:07.182482 19600 ts_tablet_manager.cc:1434] T 2e36a9d6e29c4a7c860cf267efbd4c74 P e61c3a8f61bb48f8a963c9480e53c168: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
W20260709 13:04:07.183385 19450 consensus_peers.cc:597] T 14935b3ddf914369822e4a0547aaa355 P 0473d2b2d01f4459b1e90fd12cc7840e -> Peer e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891): Couldn't send request to peer e61c3a8f61bb48f8a963c9480e53c168. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:07.183530 19600 tablet_bootstrap.cc:492] T fa8650e71aa14778b3d73721fc50d9fc P e61c3a8f61bb48f8a963c9480e53c168: Bootstrap starting.
I20260709 13:04:07.190296 19600 tablet_bootstrap.cc:654] T fa8650e71aa14778b3d73721fc50d9fc P e61c3a8f61bb48f8a963c9480e53c168: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:07.195992 19603 raft_consensus.cc:493] T 2e36a9d6e29c4a7c860cf267efbd4c74 P e61c3a8f61bb48f8a963c9480e53c168 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:07.196491 19603 raft_consensus.cc:515] T 2e36a9d6e29c4a7c860cf267efbd4c74 P e61c3a8f61bb48f8a963c9480e53c168 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:07.198547 19603 leader_election.cc:290] T 2e36a9d6e29c4a7c860cf267efbd4c74 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:04:07.198822 19600 tablet_bootstrap.cc:492] T fa8650e71aa14778b3d73721fc50d9fc P e61c3a8f61bb48f8a963c9480e53c168: No bootstrap required, opened a new log
I20260709 13:04:07.199358 19600 ts_tablet_manager.cc:1403] T fa8650e71aa14778b3d73721fc50d9fc P e61c3a8f61bb48f8a963c9480e53c168: Time spent bootstrapping tablet: real 0.016s	user 0.011s	sys 0.005s
I20260709 13:04:07.200069 19486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e36a9d6e29c4a7c860cf267efbd4c74" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:04:07.201139 19410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e36a9d6e29c4a7c860cf267efbd4c74" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:04:07.201762 19410 raft_consensus.cc:2468] T 2e36a9d6e29c4a7c860cf267efbd4c74 P e5256d91808b47c195bc9b4dbd7f2b87 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 0.
I20260709 13:04:07.202023 19600 raft_consensus.cc:359] T fa8650e71aa14778b3d73721fc50d9fc P e61c3a8f61bb48f8a963c9480e53c168 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:07.202775 19600 raft_consensus.cc:385] T fa8650e71aa14778b3d73721fc50d9fc P e61c3a8f61bb48f8a963c9480e53c168 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:07.203094 19600 raft_consensus.cc:740] T fa8650e71aa14778b3d73721fc50d9fc P e61c3a8f61bb48f8a963c9480e53c168 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e61c3a8f61bb48f8a963c9480e53c168, State: Initialized, Role: FOLLOWER
I20260709 13:04:07.203243 19523 leader_election.cc:304] T 2e36a9d6e29c4a7c860cf267efbd4c74 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:04:07.204007 19603 raft_consensus.cc:2804] T 2e36a9d6e29c4a7c860cf267efbd4c74 P e61c3a8f61bb48f8a963c9480e53c168 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:07.203850 19600 consensus_queue.cc:260] T fa8650e71aa14778b3d73721fc50d9fc P e61c3a8f61bb48f8a963c9480e53c168 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
W20260709 13:04:07.204229 19526 leader_election.cc:343] T 2e36a9d6e29c4a7c860cf267efbd4c74 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:07.204394 19603 raft_consensus.cc:493] T 2e36a9d6e29c4a7c860cf267efbd4c74 P e61c3a8f61bb48f8a963c9480e53c168 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:07.205076 19601 tablet_bootstrap.cc:492] T 14efcc79969f41babe5529c22d59156d P 0473d2b2d01f4459b1e90fd12cc7840e: No bootstrap required, opened a new log
I20260709 13:04:07.205260 19603 raft_consensus.cc:3060] T 2e36a9d6e29c4a7c860cf267efbd4c74 P e61c3a8f61bb48f8a963c9480e53c168 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:07.205538 19601 ts_tablet_manager.cc:1403] T 14efcc79969f41babe5529c22d59156d P 0473d2b2d01f4459b1e90fd12cc7840e: Time spent bootstrapping tablet: real 0.062s	user 0.014s	sys 0.003s
I20260709 13:04:07.206379 19600 ts_tablet_manager.cc:1434] T fa8650e71aa14778b3d73721fc50d9fc P e61c3a8f61bb48f8a963c9480e53c168: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.001s
I20260709 13:04:07.207299 19600 tablet_bootstrap.cc:492] T 86a6797bdfe94fa496c050ceae4bd0d9 P e61c3a8f61bb48f8a963c9480e53c168: Bootstrap starting.
I20260709 13:04:07.208132 19601 raft_consensus.cc:359] T 14efcc79969f41babe5529c22d59156d P 0473d2b2d01f4459b1e90fd12cc7840e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:07.208758 19601 raft_consensus.cc:385] T 14efcc79969f41babe5529c22d59156d P 0473d2b2d01f4459b1e90fd12cc7840e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:07.209019 19601 raft_consensus.cc:740] T 14efcc79969f41babe5529c22d59156d P 0473d2b2d01f4459b1e90fd12cc7840e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0473d2b2d01f4459b1e90fd12cc7840e, State: Initialized, Role: FOLLOWER
I20260709 13:04:07.212589 19603 raft_consensus.cc:515] T 2e36a9d6e29c4a7c860cf267efbd4c74 P e61c3a8f61bb48f8a963c9480e53c168 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:07.213488 19600 tablet_bootstrap.cc:654] T 86a6797bdfe94fa496c050ceae4bd0d9 P e61c3a8f61bb48f8a963c9480e53c168: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:07.212106 19601 consensus_queue.cc:260] T 14efcc79969f41babe5529c22d59156d P 0473d2b2d01f4459b1e90fd12cc7840e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:07.215481 19410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e36a9d6e29c4a7c860cf267efbd4c74" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
I20260709 13:04:07.216001 19410 raft_consensus.cc:3060] T 2e36a9d6e29c4a7c860cf267efbd4c74 P e5256d91808b47c195bc9b4dbd7f2b87 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:07.216355 19604 tablet_bootstrap.cc:492] T 40e1e16737a842ee936002830f36882e P e5256d91808b47c195bc9b4dbd7f2b87: No bootstrap required, opened a new log
I20260709 13:04:07.216596 19601 ts_tablet_manager.cc:1434] T 14efcc79969f41babe5529c22d59156d P 0473d2b2d01f4459b1e90fd12cc7840e: Time spent starting tablet: real 0.011s	user 0.005s	sys 0.000s
I20260709 13:04:07.216758 19604 ts_tablet_manager.cc:1403] T 40e1e16737a842ee936002830f36882e P e5256d91808b47c195bc9b4dbd7f2b87: Time spent bootstrapping tablet: real 0.148s	user 0.007s	sys 0.003s
I20260709 13:04:07.217417 19601 tablet_bootstrap.cc:492] T 309c3ca0ca4b4f3ba129752ea2cb293b P 0473d2b2d01f4459b1e90fd12cc7840e: Bootstrap starting.
I20260709 13:04:07.223119 19601 tablet_bootstrap.cc:654] T 309c3ca0ca4b4f3ba129752ea2cb293b P 0473d2b2d01f4459b1e90fd12cc7840e: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:07.228924 19486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e36a9d6e29c4a7c860cf267efbd4c74" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:04:07.229343 19604 raft_consensus.cc:359] T 40e1e16737a842ee936002830f36882e P e5256d91808b47c195bc9b4dbd7f2b87 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:07.230260 19604 raft_consensus.cc:385] T 40e1e16737a842ee936002830f36882e P e5256d91808b47c195bc9b4dbd7f2b87 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:07.230561 19604 raft_consensus.cc:740] T 40e1e16737a842ee936002830f36882e P e5256d91808b47c195bc9b4dbd7f2b87 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e5256d91808b47c195bc9b4dbd7f2b87, State: Initialized, Role: FOLLOWER
W20260709 13:04:07.231185 19526 leader_election.cc:343] T 2e36a9d6e29c4a7c860cf267efbd4c74 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:07.231973 19603 leader_election.cc:290] T 2e36a9d6e29c4a7c860cf267efbd4c74 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 1 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:04:07.226519 19410 raft_consensus.cc:2468] T 2e36a9d6e29c4a7c860cf267efbd4c74 P e5256d91808b47c195bc9b4dbd7f2b87 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 1.
I20260709 13:04:07.234079 19523 leader_election.cc:304] T 2e36a9d6e29c4a7c860cf267efbd4c74 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168; no voters: 0473d2b2d01f4459b1e90fd12cc7840e
I20260709 13:04:07.236093 19603 raft_consensus.cc:2804] T 2e36a9d6e29c4a7c860cf267efbd4c74 P e61c3a8f61bb48f8a963c9480e53c168 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:07.237205 19603 raft_consensus.cc:697] T 2e36a9d6e29c4a7c860cf267efbd4c74 P e61c3a8f61bb48f8a963c9480e53c168 [term 1 LEADER]: Becoming Leader. State: Replica: e61c3a8f61bb48f8a963c9480e53c168, State: Running, Role: LEADER
I20260709 13:04:07.238343 19603 consensus_queue.cc:237] T 2e36a9d6e29c4a7c860cf267efbd4c74 P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:07.239954 19604 consensus_queue.cc:260] T 40e1e16737a842ee936002830f36882e P e5256d91808b47c195bc9b4dbd7f2b87 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:07.241760 19604 ts_tablet_manager.cc:1434] T 40e1e16737a842ee936002830f36882e P e5256d91808b47c195bc9b4dbd7f2b87: Time spent starting tablet: real 0.025s	user 0.005s	sys 0.000s
I20260709 13:04:07.245590 19604 tablet_bootstrap.cc:492] T 46c5bfeecc314717bffe987e6844b6d0 P e5256d91808b47c195bc9b4dbd7f2b87: Bootstrap starting.
I20260709 13:04:07.247718 19600 tablet_bootstrap.cc:492] T 86a6797bdfe94fa496c050ceae4bd0d9 P e61c3a8f61bb48f8a963c9480e53c168: No bootstrap required, opened a new log
I20260709 13:04:07.248180 19600 ts_tablet_manager.cc:1403] T 86a6797bdfe94fa496c050ceae4bd0d9 P e61c3a8f61bb48f8a963c9480e53c168: Time spent bootstrapping tablet: real 0.041s	user 0.008s	sys 0.027s
I20260709 13:04:07.250970 19600 raft_consensus.cc:359] T 86a6797bdfe94fa496c050ceae4bd0d9 P e61c3a8f61bb48f8a963c9480e53c168 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:07.251451 19600 raft_consensus.cc:385] T 86a6797bdfe94fa496c050ceae4bd0d9 P e61c3a8f61bb48f8a963c9480e53c168 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:07.251554 19604 tablet_bootstrap.cc:654] T 46c5bfeecc314717bffe987e6844b6d0 P e5256d91808b47c195bc9b4dbd7f2b87: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:07.251693 19600 raft_consensus.cc:740] T 86a6797bdfe94fa496c050ceae4bd0d9 P e61c3a8f61bb48f8a963c9480e53c168 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e61c3a8f61bb48f8a963c9480e53c168, State: Initialized, Role: FOLLOWER
I20260709 13:04:07.252442 19600 consensus_queue.cc:260] T 86a6797bdfe94fa496c050ceae4bd0d9 P e61c3a8f61bb48f8a963c9480e53c168 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:07.254344 19600 ts_tablet_manager.cc:1434] T 86a6797bdfe94fa496c050ceae4bd0d9 P e61c3a8f61bb48f8a963c9480e53c168: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 13:04:07.255087 19600 tablet_bootstrap.cc:492] T d1e5873a19244c5ebbcd38e126796ee7 P e61c3a8f61bb48f8a963c9480e53c168: Bootstrap starting.
I20260709 13:04:07.256073 19603 raft_consensus.cc:493] T 309c3ca0ca4b4f3ba129752ea2cb293b P e61c3a8f61bb48f8a963c9480e53c168 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:07.255601 19307 catalog_manager.cc:5697] T 2e36a9d6e29c4a7c860cf267efbd4c74 P e61c3a8f61bb48f8a963c9480e53c168 reported cstate change: term changed from 0 to 1, leader changed from <none> to e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3). New cstate: current_term: 1 leader_uuid: "e61c3a8f61bb48f8a963c9480e53c168" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } health_report { overall_health: HEALTHY } } }
I20260709 13:04:07.256565 19603 raft_consensus.cc:515] T 309c3ca0ca4b4f3ba129752ea2cb293b P e61c3a8f61bb48f8a963c9480e53c168 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:07.259483 19410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "309c3ca0ca4b4f3ba129752ea2cb293b" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:04:07.260489 19600 tablet_bootstrap.cc:654] T d1e5873a19244c5ebbcd38e126796ee7 P e61c3a8f61bb48f8a963c9480e53c168: Neither blocks nor log segments found. Creating new log.
W20260709 13:04:07.260874 19523 leader_election.cc:343] T 309c3ca0ca4b4f3ba129752ea2cb293b P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:07.263015 19486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "309c3ca0ca4b4f3ba129752ea2cb293b" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
W20260709 13:04:07.264662 19526 leader_election.cc:343] T 309c3ca0ca4b4f3ba129752ea2cb293b P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:07.265235 19526 leader_election.cc:304] T 309c3ca0ca4b4f3ba129752ea2cb293b P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e61c3a8f61bb48f8a963c9480e53c168; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:04:07.266268 19684 raft_consensus.cc:2749] T 309c3ca0ca4b4f3ba129752ea2cb293b P e61c3a8f61bb48f8a963c9480e53c168 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:04:07.267206 19603 leader_election.cc:290] T 309c3ca0ca4b4f3ba129752ea2cb293b P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:04:07.275982 19601 tablet_bootstrap.cc:492] T 309c3ca0ca4b4f3ba129752ea2cb293b P 0473d2b2d01f4459b1e90fd12cc7840e: No bootstrap required, opened a new log
I20260709 13:04:07.277770 19601 ts_tablet_manager.cc:1403] T 309c3ca0ca4b4f3ba129752ea2cb293b P 0473d2b2d01f4459b1e90fd12cc7840e: Time spent bootstrapping tablet: real 0.061s	user 0.017s	sys 0.012s
I20260709 13:04:07.279953 19601 raft_consensus.cc:359] T 309c3ca0ca4b4f3ba129752ea2cb293b P 0473d2b2d01f4459b1e90fd12cc7840e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:07.280422 19601 raft_consensus.cc:385] T 309c3ca0ca4b4f3ba129752ea2cb293b P 0473d2b2d01f4459b1e90fd12cc7840e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:07.280784 19601 raft_consensus.cc:740] T 309c3ca0ca4b4f3ba129752ea2cb293b P 0473d2b2d01f4459b1e90fd12cc7840e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0473d2b2d01f4459b1e90fd12cc7840e, State: Initialized, Role: FOLLOWER
I20260709 13:04:07.281472 19601 consensus_queue.cc:260] T 309c3ca0ca4b4f3ba129752ea2cb293b P 0473d2b2d01f4459b1e90fd12cc7840e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:07.282409 19604 tablet_bootstrap.cc:492] T 46c5bfeecc314717bffe987e6844b6d0 P e5256d91808b47c195bc9b4dbd7f2b87: No bootstrap required, opened a new log
I20260709 13:04:07.282868 19604 ts_tablet_manager.cc:1403] T 46c5bfeecc314717bffe987e6844b6d0 P e5256d91808b47c195bc9b4dbd7f2b87: Time spent bootstrapping tablet: real 0.037s	user 0.005s	sys 0.006s
I20260709 13:04:07.283452 19601 ts_tablet_manager.cc:1434] T 309c3ca0ca4b4f3ba129752ea2cb293b P 0473d2b2d01f4459b1e90fd12cc7840e: Time spent starting tablet: real 0.005s	user 0.005s	sys 0.000s
I20260709 13:04:07.284425 19601 tablet_bootstrap.cc:492] T 22196caba61445d3bec98a0aab3c337d P 0473d2b2d01f4459b1e90fd12cc7840e: Bootstrap starting.
I20260709 13:04:07.285698 19604 raft_consensus.cc:359] T 46c5bfeecc314717bffe987e6844b6d0 P e5256d91808b47c195bc9b4dbd7f2b87 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:07.286324 19604 raft_consensus.cc:385] T 46c5bfeecc314717bffe987e6844b6d0 P e5256d91808b47c195bc9b4dbd7f2b87 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:07.286577 19604 raft_consensus.cc:740] T 46c5bfeecc314717bffe987e6844b6d0 P e5256d91808b47c195bc9b4dbd7f2b87 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e5256d91808b47c195bc9b4dbd7f2b87, State: Initialized, Role: FOLLOWER
I20260709 13:04:07.287230 19604 consensus_queue.cc:260] T 46c5bfeecc314717bffe987e6844b6d0 P e5256d91808b47c195bc9b4dbd7f2b87 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:07.290736 19604 ts_tablet_manager.cc:1434] T 46c5bfeecc314717bffe987e6844b6d0 P e5256d91808b47c195bc9b4dbd7f2b87: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 13:04:07.291023 19600 tablet_bootstrap.cc:492] T d1e5873a19244c5ebbcd38e126796ee7 P e61c3a8f61bb48f8a963c9480e53c168: No bootstrap required, opened a new log
I20260709 13:04:07.291505 19600 ts_tablet_manager.cc:1403] T d1e5873a19244c5ebbcd38e126796ee7 P e61c3a8f61bb48f8a963c9480e53c168: Time spent bootstrapping tablet: real 0.037s	user 0.021s	sys 0.013s
I20260709 13:04:07.292078 19601 tablet_bootstrap.cc:654] T 22196caba61445d3bec98a0aab3c337d P 0473d2b2d01f4459b1e90fd12cc7840e: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:07.294118 19600 raft_consensus.cc:359] T d1e5873a19244c5ebbcd38e126796ee7 P e61c3a8f61bb48f8a963c9480e53c168 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:07.294844 19600 raft_consensus.cc:385] T d1e5873a19244c5ebbcd38e126796ee7 P e61c3a8f61bb48f8a963c9480e53c168 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:07.295167 19600 raft_consensus.cc:740] T d1e5873a19244c5ebbcd38e126796ee7 P e61c3a8f61bb48f8a963c9480e53c168 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e61c3a8f61bb48f8a963c9480e53c168, State: Initialized, Role: FOLLOWER
I20260709 13:04:07.295897 19604 tablet_bootstrap.cc:492] T 309c3ca0ca4b4f3ba129752ea2cb293b P e5256d91808b47c195bc9b4dbd7f2b87: Bootstrap starting.
I20260709 13:04:07.296007 19600 consensus_queue.cc:260] T d1e5873a19244c5ebbcd38e126796ee7 P e61c3a8f61bb48f8a963c9480e53c168 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:07.298252 19600 ts_tablet_manager.cc:1434] T d1e5873a19244c5ebbcd38e126796ee7 P e61c3a8f61bb48f8a963c9480e53c168: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 13:04:07.299353 19600 tablet_bootstrap.cc:492] T 14935b3ddf914369822e4a0547aaa355 P e61c3a8f61bb48f8a963c9480e53c168: Bootstrap starting.
I20260709 13:04:07.303063 19601 tablet_bootstrap.cc:492] T 22196caba61445d3bec98a0aab3c337d P 0473d2b2d01f4459b1e90fd12cc7840e: No bootstrap required, opened a new log
I20260709 13:04:07.303611 19604 tablet_bootstrap.cc:654] T 309c3ca0ca4b4f3ba129752ea2cb293b P e5256d91808b47c195bc9b4dbd7f2b87: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:07.303624 19601 ts_tablet_manager.cc:1403] T 22196caba61445d3bec98a0aab3c337d P 0473d2b2d01f4459b1e90fd12cc7840e: Time spent bootstrapping tablet: real 0.019s	user 0.007s	sys 0.004s
I20260709 13:04:07.307142 19601 raft_consensus.cc:359] T 22196caba61445d3bec98a0aab3c337d P 0473d2b2d01f4459b1e90fd12cc7840e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:07.307907 19601 raft_consensus.cc:385] T 22196caba61445d3bec98a0aab3c337d P 0473d2b2d01f4459b1e90fd12cc7840e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:07.308231 19601 raft_consensus.cc:740] T 22196caba61445d3bec98a0aab3c337d P 0473d2b2d01f4459b1e90fd12cc7840e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0473d2b2d01f4459b1e90fd12cc7840e, State: Initialized, Role: FOLLOWER
I20260709 13:04:07.308871 19600 tablet_bootstrap.cc:654] T 14935b3ddf914369822e4a0547aaa355 P e61c3a8f61bb48f8a963c9480e53c168: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:07.309005 19601 consensus_queue.cc:260] T 22196caba61445d3bec98a0aab3c337d P 0473d2b2d01f4459b1e90fd12cc7840e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:07.311419 19601 ts_tablet_manager.cc:1434] T 22196caba61445d3bec98a0aab3c337d P 0473d2b2d01f4459b1e90fd12cc7840e: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:04:07.312299 19601 tablet_bootstrap.cc:492] T 2e36a9d6e29c4a7c860cf267efbd4c74 P 0473d2b2d01f4459b1e90fd12cc7840e: Bootstrap starting.
I20260709 13:04:07.318042 19601 tablet_bootstrap.cc:654] T 2e36a9d6e29c4a7c860cf267efbd4c74 P 0473d2b2d01f4459b1e90fd12cc7840e: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:07.323952 19600 tablet_bootstrap.cc:492] T 14935b3ddf914369822e4a0547aaa355 P e61c3a8f61bb48f8a963c9480e53c168: No bootstrap required, opened a new log
I20260709 13:04:07.324545 19600 ts_tablet_manager.cc:1403] T 14935b3ddf914369822e4a0547aaa355 P e61c3a8f61bb48f8a963c9480e53c168: Time spent bootstrapping tablet: real 0.025s	user 0.011s	sys 0.009s
I20260709 13:04:07.327855 19558 raft_consensus.cc:3060] T fa8650e71aa14778b3d73721fc50d9fc P e61c3a8f61bb48f8a963c9480e53c168 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:07.327898 19600 raft_consensus.cc:359] T 14935b3ddf914369822e4a0547aaa355 P e61c3a8f61bb48f8a963c9480e53c168 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:07.329265 19600 raft_consensus.cc:385] T 14935b3ddf914369822e4a0547aaa355 P e61c3a8f61bb48f8a963c9480e53c168 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:07.329597 19600 raft_consensus.cc:740] T 14935b3ddf914369822e4a0547aaa355 P e61c3a8f61bb48f8a963c9480e53c168 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e61c3a8f61bb48f8a963c9480e53c168, State: Initialized, Role: FOLLOWER
I20260709 13:04:07.330554 19600 consensus_queue.cc:260] T 14935b3ddf914369822e4a0547aaa355 P e61c3a8f61bb48f8a963c9480e53c168 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:07.335655 19604 tablet_bootstrap.cc:492] T 309c3ca0ca4b4f3ba129752ea2cb293b P e5256d91808b47c195bc9b4dbd7f2b87: No bootstrap required, opened a new log
I20260709 13:04:07.336118 19604 ts_tablet_manager.cc:1403] T 309c3ca0ca4b4f3ba129752ea2cb293b P e5256d91808b47c195bc9b4dbd7f2b87: Time spent bootstrapping tablet: real 0.040s	user 0.019s	sys 0.017s
I20260709 13:04:07.336753 19647 consensus_queue.cc:1048] T 14935b3ddf914369822e4a0547aaa355 P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:07.336807 19600 ts_tablet_manager.cc:1434] T 14935b3ddf914369822e4a0547aaa355 P e61c3a8f61bb48f8a963c9480e53c168: Time spent starting tablet: real 0.012s	user 0.006s	sys 0.002s
I20260709 13:04:07.338362 19600 tablet_bootstrap.cc:492] T 172b3dd13109415a955b71ac0e9d2234 P e61c3a8f61bb48f8a963c9480e53c168: Bootstrap starting.
I20260709 13:04:07.338649 19604 raft_consensus.cc:359] T 309c3ca0ca4b4f3ba129752ea2cb293b P e5256d91808b47c195bc9b4dbd7f2b87 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:07.339401 19601 tablet_bootstrap.cc:492] T 2e36a9d6e29c4a7c860cf267efbd4c74 P 0473d2b2d01f4459b1e90fd12cc7840e: No bootstrap required, opened a new log
I20260709 13:04:07.339519 19604 raft_consensus.cc:385] T 309c3ca0ca4b4f3ba129752ea2cb293b P e5256d91808b47c195bc9b4dbd7f2b87 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:07.339884 19604 raft_consensus.cc:740] T 309c3ca0ca4b4f3ba129752ea2cb293b P e5256d91808b47c195bc9b4dbd7f2b87 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e5256d91808b47c195bc9b4dbd7f2b87, State: Initialized, Role: FOLLOWER
I20260709 13:04:07.340046 19601 ts_tablet_manager.cc:1403] T 2e36a9d6e29c4a7c860cf267efbd4c74 P 0473d2b2d01f4459b1e90fd12cc7840e: Time spent bootstrapping tablet: real 0.028s	user 0.002s	sys 0.014s
I20260709 13:04:07.341044 19604 consensus_queue.cc:260] T 309c3ca0ca4b4f3ba129752ea2cb293b P e5256d91808b47c195bc9b4dbd7f2b87 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:07.343019 19647 consensus_queue.cc:1048] T fa8650e71aa14778b3d73721fc50d9fc P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:04:07.343148 19601 raft_consensus.cc:359] T 2e36a9d6e29c4a7c860cf267efbd4c74 P 0473d2b2d01f4459b1e90fd12cc7840e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:07.344203 19601 raft_consensus.cc:385] T 2e36a9d6e29c4a7c860cf267efbd4c74 P 0473d2b2d01f4459b1e90fd12cc7840e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:07.345242 19604 ts_tablet_manager.cc:1434] T 309c3ca0ca4b4f3ba129752ea2cb293b P e5256d91808b47c195bc9b4dbd7f2b87: Time spent starting tablet: real 0.009s	user 0.004s	sys 0.003s
I20260709 13:04:07.345165 19601 raft_consensus.cc:740] T 2e36a9d6e29c4a7c860cf267efbd4c74 P 0473d2b2d01f4459b1e90fd12cc7840e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0473d2b2d01f4459b1e90fd12cc7840e, State: Initialized, Role: FOLLOWER
I20260709 13:04:07.346307 19604 tablet_bootstrap.cc:492] T 2a16f7501e2444fb86d4e2778e734e02 P e5256d91808b47c195bc9b4dbd7f2b87: Bootstrap starting.
I20260709 13:04:07.346487 19611 raft_consensus.cc:493] T 14efcc79969f41babe5529c22d59156d P 0473d2b2d01f4459b1e90fd12cc7840e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:07.346868 19600 tablet_bootstrap.cc:654] T 172b3dd13109415a955b71ac0e9d2234 P e61c3a8f61bb48f8a963c9480e53c168: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:07.346963 19611 raft_consensus.cc:515] T 14efcc79969f41babe5529c22d59156d P 0473d2b2d01f4459b1e90fd12cc7840e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:07.349331 19611 leader_election.cc:290] T 14efcc79969f41babe5529c22d59156d P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:04:07.352027 19559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14efcc79969f41babe5529c22d59156d" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:04:07.352293 19601 consensus_queue.cc:260] T 2e36a9d6e29c4a7c860cf267efbd4c74 P 0473d2b2d01f4459b1e90fd12cc7840e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:07.354470 19411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14efcc79969f41babe5529c22d59156d" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:04:07.355906 19604 tablet_bootstrap.cc:654] T 2a16f7501e2444fb86d4e2778e734e02 P e5256d91808b47c195bc9b4dbd7f2b87: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:07.362380 19601 ts_tablet_manager.cc:1434] T 2e36a9d6e29c4a7c860cf267efbd4c74 P 0473d2b2d01f4459b1e90fd12cc7840e: Time spent starting tablet: real 0.022s	user 0.006s	sys 0.000s
I20260709 13:04:07.360862 19449 leader_election.cc:304] T 14efcc79969f41babe5529c22d59156d P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e; no voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:04:07.368377 19647 raft_consensus.cc:2749] T 14efcc79969f41babe5529c22d59156d P 0473d2b2d01f4459b1e90fd12cc7840e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:04:07.368994 19678 raft_consensus.cc:493] T d1e5873a19244c5ebbcd38e126796ee7 P 0473d2b2d01f4459b1e90fd12cc7840e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:07.369481 19678 raft_consensus.cc:515] T d1e5873a19244c5ebbcd38e126796ee7 P 0473d2b2d01f4459b1e90fd12cc7840e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:07.371481 19678 leader_election.cc:290] T d1e5873a19244c5ebbcd38e126796ee7 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:04:07.374591 19601 tablet_bootstrap.cc:492] T ff75a1d4cb1f493db8f71ddc136ba9ab P 0473d2b2d01f4459b1e90fd12cc7840e: Bootstrap starting.
I20260709 13:04:07.373205 19559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e5873a19244c5ebbcd38e126796ee7" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:04:07.383152 19559 raft_consensus.cc:2468] T d1e5873a19244c5ebbcd38e126796ee7 P e61c3a8f61bb48f8a963c9480e53c168 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 0.
I20260709 13:04:07.388348 19450 leader_election.cc:304] T d1e5873a19244c5ebbcd38e126796ee7 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:04:07.389561 19409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e5873a19244c5ebbcd38e126796ee7" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:04:07.390275 19646 raft_consensus.cc:2804] T d1e5873a19244c5ebbcd38e126796ee7 P 0473d2b2d01f4459b1e90fd12cc7840e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:07.390694 19646 raft_consensus.cc:493] T d1e5873a19244c5ebbcd38e126796ee7 P 0473d2b2d01f4459b1e90fd12cc7840e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:07.391034 19646 raft_consensus.cc:3060] T d1e5873a19244c5ebbcd38e126796ee7 P 0473d2b2d01f4459b1e90fd12cc7840e [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:04:07.406385 19449 leader_election.cc:343] T d1e5873a19244c5ebbcd38e126796ee7 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:07.420641 19600 tablet_bootstrap.cc:492] T 172b3dd13109415a955b71ac0e9d2234 P e61c3a8f61bb48f8a963c9480e53c168: No bootstrap required, opened a new log
I20260709 13:04:07.421401 19600 ts_tablet_manager.cc:1403] T 172b3dd13109415a955b71ac0e9d2234 P e61c3a8f61bb48f8a963c9480e53c168: Time spent bootstrapping tablet: real 0.083s	user 0.009s	sys 0.025s
I20260709 13:04:07.422380 19646 raft_consensus.cc:515] T d1e5873a19244c5ebbcd38e126796ee7 P 0473d2b2d01f4459b1e90fd12cc7840e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:07.433372 19409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e5873a19244c5ebbcd38e126796ee7" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
I20260709 13:04:07.433238 19600 raft_consensus.cc:359] T 172b3dd13109415a955b71ac0e9d2234 P e61c3a8f61bb48f8a963c9480e53c168 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:07.434227 19601 tablet_bootstrap.cc:654] T ff75a1d4cb1f493db8f71ddc136ba9ab P 0473d2b2d01f4459b1e90fd12cc7840e: Neither blocks nor log segments found. Creating new log.
W20260709 13:04:07.435263 19449 leader_election.cc:343] T d1e5873a19244c5ebbcd38e126796ee7 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:07.434053 19600 raft_consensus.cc:385] T 172b3dd13109415a955b71ac0e9d2234 P e61c3a8f61bb48f8a963c9480e53c168 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:07.437508 19600 raft_consensus.cc:740] T 172b3dd13109415a955b71ac0e9d2234 P e61c3a8f61bb48f8a963c9480e53c168 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e61c3a8f61bb48f8a963c9480e53c168, State: Initialized, Role: FOLLOWER
I20260709 13:04:07.437201 19604 tablet_bootstrap.cc:492] T 2a16f7501e2444fb86d4e2778e734e02 P e5256d91808b47c195bc9b4dbd7f2b87: No bootstrap required, opened a new log
I20260709 13:04:07.438169 19600 consensus_queue.cc:260] T 172b3dd13109415a955b71ac0e9d2234 P e61c3a8f61bb48f8a963c9480e53c168 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:07.439066 19604 ts_tablet_manager.cc:1403] T 2a16f7501e2444fb86d4e2778e734e02 P e5256d91808b47c195bc9b4dbd7f2b87: Time spent bootstrapping tablet: real 0.093s	user 0.023s	sys 0.043s
I20260709 13:04:07.440652 19600 ts_tablet_manager.cc:1434] T 172b3dd13109415a955b71ac0e9d2234 P e61c3a8f61bb48f8a963c9480e53c168: Time spent starting tablet: real 0.019s	user 0.008s	sys 0.001s
I20260709 13:04:07.441488 19600 tablet_bootstrap.cc:492] T b9f0d59553ad444883fcf5b5909f9798 P e61c3a8f61bb48f8a963c9480e53c168: Bootstrap starting.
I20260709 13:04:07.441548 19604 raft_consensus.cc:359] T 2a16f7501e2444fb86d4e2778e734e02 P e5256d91808b47c195bc9b4dbd7f2b87 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:07.442253 19604 raft_consensus.cc:385] T 2a16f7501e2444fb86d4e2778e734e02 P e5256d91808b47c195bc9b4dbd7f2b87 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:07.442499 19604 raft_consensus.cc:740] T 2a16f7501e2444fb86d4e2778e734e02 P e5256d91808b47c195bc9b4dbd7f2b87 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e5256d91808b47c195bc9b4dbd7f2b87, State: Initialized, Role: FOLLOWER
I20260709 13:04:07.443203 19604 consensus_queue.cc:260] T 2a16f7501e2444fb86d4e2778e734e02 P e5256d91808b47c195bc9b4dbd7f2b87 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:07.445686 19604 ts_tablet_manager.cc:1434] T 2a16f7501e2444fb86d4e2778e734e02 P e5256d91808b47c195bc9b4dbd7f2b87: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 13:04:07.446533 19604 tablet_bootstrap.cc:492] T 2725d2c4cb054f18b0fc8f735c15f6c2 P e5256d91808b47c195bc9b4dbd7f2b87: Bootstrap starting.
I20260709 13:04:07.446760 19611 raft_consensus.cc:493] T 40e1e16737a842ee936002830f36882e P 0473d2b2d01f4459b1e90fd12cc7840e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:07.447188 19611 raft_consensus.cc:515] T 40e1e16737a842ee936002830f36882e P 0473d2b2d01f4459b1e90fd12cc7840e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:07.449107 19611 leader_election.cc:290] T 40e1e16737a842ee936002830f36882e P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:04:07.450527 19600 tablet_bootstrap.cc:654] T b9f0d59553ad444883fcf5b5909f9798 P e61c3a8f61bb48f8a963c9480e53c168: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:07.451464 19601 tablet_bootstrap.cc:492] T ff75a1d4cb1f493db8f71ddc136ba9ab P 0473d2b2d01f4459b1e90fd12cc7840e: No bootstrap required, opened a new log
I20260709 13:04:07.454170 19601 ts_tablet_manager.cc:1403] T ff75a1d4cb1f493db8f71ddc136ba9ab P 0473d2b2d01f4459b1e90fd12cc7840e: Time spent bootstrapping tablet: real 0.080s	user 0.014s	sys 0.000s
I20260709 13:04:07.456638 19601 raft_consensus.cc:359] T ff75a1d4cb1f493db8f71ddc136ba9ab P 0473d2b2d01f4459b1e90fd12cc7840e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:07.452760 19633 consensus_queue.cc:1048] T 217b5fae677b4971b3bbd2f357a1f7ff P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:07.457239 19409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40e1e16737a842ee936002830f36882e" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:04:07.453564 19560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40e1e16737a842ee936002830f36882e" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:04:07.457847 19409 raft_consensus.cc:2468] T 40e1e16737a842ee936002830f36882e P e5256d91808b47c195bc9b4dbd7f2b87 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 0.
I20260709 13:04:07.458295 19560 raft_consensus.cc:2468] T 40e1e16737a842ee936002830f36882e P e61c3a8f61bb48f8a963c9480e53c168 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 0.
I20260709 13:04:07.458957 19647 consensus_queue.cc:1048] T fa8650e71aa14778b3d73721fc50d9fc P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:07.459764 19684 raft_consensus.cc:493] T 172b3dd13109415a955b71ac0e9d2234 P e61c3a8f61bb48f8a963c9480e53c168 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:07.459839 19450 leader_election.cc:304] T 40e1e16737a842ee936002830f36882e P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:04:07.460249 19684 raft_consensus.cc:515] T 172b3dd13109415a955b71ac0e9d2234 P e61c3a8f61bb48f8a963c9480e53c168 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:07.460889 19647 raft_consensus.cc:2804] T 40e1e16737a842ee936002830f36882e P 0473d2b2d01f4459b1e90fd12cc7840e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:07.461336 19647 raft_consensus.cc:493] T 40e1e16737a842ee936002830f36882e P 0473d2b2d01f4459b1e90fd12cc7840e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:07.461736 19647 raft_consensus.cc:3060] T 40e1e16737a842ee936002830f36882e P 0473d2b2d01f4459b1e90fd12cc7840e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:07.462414 19684 leader_election.cc:290] T 172b3dd13109415a955b71ac0e9d2234 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:04:07.464051 19604 tablet_bootstrap.cc:654] T 2725d2c4cb054f18b0fc8f735c15f6c2 P e5256d91808b47c195bc9b4dbd7f2b87: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:07.463989 19486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "172b3dd13109415a955b71ac0e9d2234" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:04:07.464695 19409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "172b3dd13109415a955b71ac0e9d2234" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:04:07.457260 19601 raft_consensus.cc:385] T ff75a1d4cb1f493db8f71ddc136ba9ab P 0473d2b2d01f4459b1e90fd12cc7840e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260709 13:04:07.469586 19523 leader_election.cc:343] T 172b3dd13109415a955b71ac0e9d2234 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:04:07.470163 19526 leader_election.cc:343] T 172b3dd13109415a955b71ac0e9d2234 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:07.470567 19526 leader_election.cc:304] T 172b3dd13109415a955b71ac0e9d2234 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e61c3a8f61bb48f8a963c9480e53c168; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:04:07.471657 19630 raft_consensus.cc:2749] T 172b3dd13109415a955b71ac0e9d2234 P e61c3a8f61bb48f8a963c9480e53c168 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:04:07.472707 19409 raft_consensus.cc:3060] T 2a16f7501e2444fb86d4e2778e734e02 P e5256d91808b47c195bc9b4dbd7f2b87 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:07.472886 19601 raft_consensus.cc:740] T ff75a1d4cb1f493db8f71ddc136ba9ab P 0473d2b2d01f4459b1e90fd12cc7840e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0473d2b2d01f4459b1e90fd12cc7840e, State: Initialized, Role: FOLLOWER
I20260709 13:04:07.471310 19647 raft_consensus.cc:515] T 40e1e16737a842ee936002830f36882e P 0473d2b2d01f4459b1e90fd12cc7840e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:07.473623 19601 consensus_queue.cc:260] T ff75a1d4cb1f493db8f71ddc136ba9ab P 0473d2b2d01f4459b1e90fd12cc7840e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:07.475694 19601 ts_tablet_manager.cc:1434] T ff75a1d4cb1f493db8f71ddc136ba9ab P 0473d2b2d01f4459b1e90fd12cc7840e: Time spent starting tablet: real 0.021s	user 0.006s	sys 0.000s
I20260709 13:04:07.476639 19601 tablet_bootstrap.cc:492] T 1a61655d99124a29b486ba4a5b37faea P 0473d2b2d01f4459b1e90fd12cc7840e: Bootstrap starting.
I20260709 13:04:07.476861 19560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40e1e16737a842ee936002830f36882e" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:04:07.477458 19560 raft_consensus.cc:3060] T 40e1e16737a842ee936002830f36882e P e61c3a8f61bb48f8a963c9480e53c168 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:07.481268 19409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40e1e16737a842ee936002830f36882e" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
I20260709 13:04:07.481935 19409 raft_consensus.cc:3060] T 40e1e16737a842ee936002830f36882e P e5256d91808b47c195bc9b4dbd7f2b87 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:07.482196 19611 consensus_queue.cc:1048] T 2a16f7501e2444fb86d4e2778e734e02 P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:07.488605 19409 raft_consensus.cc:2468] T 40e1e16737a842ee936002830f36882e P e5256d91808b47c195bc9b4dbd7f2b87 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 1.
I20260709 13:04:07.489650 19679 raft_consensus.cc:493] T 2a16f7501e2444fb86d4e2778e734e02 P e5256d91808b47c195bc9b4dbd7f2b87 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:07.490115 19679 raft_consensus.cc:515] T 2a16f7501e2444fb86d4e2778e734e02 P e5256d91808b47c195bc9b4dbd7f2b87 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:07.492169 19679 leader_election.cc:290] T 2a16f7501e2444fb86d4e2778e734e02 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:04:07.492656 19646 leader_election.cc:290] T d1e5873a19244c5ebbcd38e126796ee7 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 1 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:04:07.493161 19646 raft_consensus.cc:493] T 2e36a9d6e29c4a7c860cf267efbd4c74 P 0473d2b2d01f4459b1e90fd12cc7840e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:07.493567 19646 raft_consensus.cc:515] T 2e36a9d6e29c4a7c860cf267efbd4c74 P 0473d2b2d01f4459b1e90fd12cc7840e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:07.494956 19557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a16f7501e2444fb86d4e2778e734e02" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:04:07.495543 19557 raft_consensus.cc:2468] T 2a16f7501e2444fb86d4e2778e734e02 P e61c3a8f61bb48f8a963c9480e53c168 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 1.
I20260709 13:04:07.495788 19558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e5873a19244c5ebbcd38e126796ee7" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:04:07.496323 19558 raft_consensus.cc:3060] T d1e5873a19244c5ebbcd38e126796ee7 P e61c3a8f61bb48f8a963c9480e53c168 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:07.496701 19375 leader_election.cc:304] T 2a16f7501e2444fb86d4e2778e734e02 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:04:07.498215 19685 raft_consensus.cc:2804] T 2a16f7501e2444fb86d4e2778e734e02 P e5256d91808b47c195bc9b4dbd7f2b87 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:04:07.498610 19685 raft_consensus.cc:493] T 2a16f7501e2444fb86d4e2778e734e02 P e5256d91808b47c195bc9b4dbd7f2b87 [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:07.498973 19685 raft_consensus.cc:3060] T 2a16f7501e2444fb86d4e2778e734e02 P e5256d91808b47c195bc9b4dbd7f2b87 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:07.499100 19486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a16f7501e2444fb86d4e2778e734e02" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:04:07.486112 19560 raft_consensus.cc:2468] T 40e1e16737a842ee936002830f36882e P e61c3a8f61bb48f8a963c9480e53c168 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 1.
I20260709 13:04:07.501777 19647 leader_election.cc:290] T 40e1e16737a842ee936002830f36882e P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 1 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:04:07.502104 19450 leader_election.cc:304] T 40e1e16737a842ee936002830f36882e P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:04:07.503535 19633 consensus_queue.cc:1048] T 217b5fae677b4971b3bbd2f357a1f7ff P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:07.504197 19411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e36a9d6e29c4a7c860cf267efbd4c74" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:04:07.504958 19411 raft_consensus.cc:2393] T 2e36a9d6e29c4a7c860cf267efbd4c74 P e5256d91808b47c195bc9b4dbd7f2b87 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0473d2b2d01f4459b1e90fd12cc7840e in current term 1: Already voted for candidate e61c3a8f61bb48f8a963c9480e53c168 in this term.
I20260709 13:04:07.505360 19630 raft_consensus.cc:493] T 14935b3ddf914369822e4a0547aaa355 P e61c3a8f61bb48f8a963c9480e53c168 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:07.505824 19630 raft_consensus.cc:515] T 14935b3ddf914369822e4a0547aaa355 P e61c3a8f61bb48f8a963c9480e53c168 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:07.506758 19601 tablet_bootstrap.cc:654] T 1a61655d99124a29b486ba4a5b37faea P 0473d2b2d01f4459b1e90fd12cc7840e: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:07.507930 19630 leader_election.cc:290] T 14935b3ddf914369822e4a0547aaa355 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:04:07.508343 19600 tablet_bootstrap.cc:492] T b9f0d59553ad444883fcf5b5909f9798 P e61c3a8f61bb48f8a963c9480e53c168: No bootstrap required, opened a new log
I20260709 13:04:07.508803 19600 ts_tablet_manager.cc:1403] T b9f0d59553ad444883fcf5b5909f9798 P e61c3a8f61bb48f8a963c9480e53c168: Time spent bootstrapping tablet: real 0.067s	user 0.019s	sys 0.005s
I20260709 13:04:07.510660 19684 raft_consensus.cc:493] T 7f575b143b844aa096b50997dad3516a P e61c3a8f61bb48f8a963c9480e53c168 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:07.511161 19684 raft_consensus.cc:515] T 7f575b143b844aa096b50997dad3516a P e61c3a8f61bb48f8a963c9480e53c168 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:07.512074 19604 tablet_bootstrap.cc:492] T 2725d2c4cb054f18b0fc8f735c15f6c2 P e5256d91808b47c195bc9b4dbd7f2b87: No bootstrap required, opened a new log
I20260709 13:04:07.513092 19647 raft_consensus.cc:2804] T 40e1e16737a842ee936002830f36882e P 0473d2b2d01f4459b1e90fd12cc7840e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:07.516480 19604 ts_tablet_manager.cc:1403] T 2725d2c4cb054f18b0fc8f735c15f6c2 P e5256d91808b47c195bc9b4dbd7f2b87: Time spent bootstrapping tablet: real 0.070s	user 0.007s	sys 0.003s
I20260709 13:04:07.516770 19647 raft_consensus.cc:697] T 40e1e16737a842ee936002830f36882e P 0473d2b2d01f4459b1e90fd12cc7840e [term 1 LEADER]: Becoming Leader. State: Replica: 0473d2b2d01f4459b1e90fd12cc7840e, State: Running, Role: LEADER
I20260709 13:04:07.517656 19647 consensus_queue.cc:237] T 40e1e16737a842ee936002830f36882e P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:07.518507 19601 tablet_bootstrap.cc:492] T 1a61655d99124a29b486ba4a5b37faea P 0473d2b2d01f4459b1e90fd12cc7840e: No bootstrap required, opened a new log
I20260709 13:04:07.519001 19601 ts_tablet_manager.cc:1403] T 1a61655d99124a29b486ba4a5b37faea P 0473d2b2d01f4459b1e90fd12cc7840e: Time spent bootstrapping tablet: real 0.043s	user 0.011s	sys 0.005s
I20260709 13:04:07.521693 19646 leader_election.cc:290] T 2e36a9d6e29c4a7c860cf267efbd4c74 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:04:07.513536 19684 leader_election.cc:290] T 7f575b143b844aa096b50997dad3516a P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:04:07.523746 19560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e36a9d6e29c4a7c860cf267efbd4c74" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:04:07.524456 19601 raft_consensus.cc:359] T 1a61655d99124a29b486ba4a5b37faea P 0473d2b2d01f4459b1e90fd12cc7840e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:07.525218 19601 raft_consensus.cc:385] T 1a61655d99124a29b486ba4a5b37faea P 0473d2b2d01f4459b1e90fd12cc7840e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:07.525274 19450 leader_election.cc:304] T 2e36a9d6e29c4a7c860cf267efbd4c74 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e; no voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:04:07.525635 19601 raft_consensus.cc:740] T 1a61655d99124a29b486ba4a5b37faea P 0473d2b2d01f4459b1e90fd12cc7840e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0473d2b2d01f4459b1e90fd12cc7840e, State: Initialized, Role: FOLLOWER
I20260709 13:04:07.526034 19410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f575b143b844aa096b50997dad3516a" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:04:07.526546 19601 consensus_queue.cc:260] T 1a61655d99124a29b486ba4a5b37faea P 0473d2b2d01f4459b1e90fd12cc7840e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
W20260709 13:04:07.527158 19523 leader_election.cc:343] T 7f575b143b844aa096b50997dad3516a P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:07.527393 19646 raft_consensus.cc:493] T 309c3ca0ca4b4f3ba129752ea2cb293b P 0473d2b2d01f4459b1e90fd12cc7840e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:07.527529 19678 raft_consensus.cc:3060] T 2e36a9d6e29c4a7c860cf267efbd4c74 P 0473d2b2d01f4459b1e90fd12cc7840e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:07.527825 19646 raft_consensus.cc:515] T 309c3ca0ca4b4f3ba129752ea2cb293b P 0473d2b2d01f4459b1e90fd12cc7840e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:07.512780 19600 raft_consensus.cc:359] T b9f0d59553ad444883fcf5b5909f9798 P e61c3a8f61bb48f8a963c9480e53c168 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:07.529816 19600 raft_consensus.cc:385] T b9f0d59553ad444883fcf5b5909f9798 P e61c3a8f61bb48f8a963c9480e53c168 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:07.530097 19600 raft_consensus.cc:740] T b9f0d59553ad444883fcf5b5909f9798 P e61c3a8f61bb48f8a963c9480e53c168 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e61c3a8f61bb48f8a963c9480e53c168, State: Initialized, Role: FOLLOWER
I20260709 13:04:07.530774 19600 consensus_queue.cc:260] T b9f0d59553ad444883fcf5b5909f9798 P e61c3a8f61bb48f8a963c9480e53c168 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:07.531759 19604 raft_consensus.cc:359] T 2725d2c4cb054f18b0fc8f735c15f6c2 P e5256d91808b47c195bc9b4dbd7f2b87 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:07.532440 19604 raft_consensus.cc:385] T 2725d2c4cb054f18b0fc8f735c15f6c2 P e5256d91808b47c195bc9b4dbd7f2b87 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:07.532846 19600 ts_tablet_manager.cc:1434] T b9f0d59553ad444883fcf5b5909f9798 P e61c3a8f61bb48f8a963c9480e53c168: Time spent starting tablet: real 0.024s	user 0.008s	sys 0.000s
I20260709 13:04:07.534152 19600 tablet_bootstrap.cc:492] T 1a61655d99124a29b486ba4a5b37faea P e61c3a8f61bb48f8a963c9480e53c168: Bootstrap starting.
I20260709 13:04:07.535378 19411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14935b3ddf914369822e4a0547aaa355" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:04:07.535925 19601 ts_tablet_manager.cc:1434] T 1a61655d99124a29b486ba4a5b37faea P 0473d2b2d01f4459b1e90fd12cc7840e: Time spent starting tablet: real 0.016s	user 0.004s	sys 0.003s
I20260709 13:04:07.536867 19486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f575b143b844aa096b50997dad3516a" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:04:07.537333 19678 raft_consensus.cc:2749] T 2e36a9d6e29c4a7c860cf267efbd4c74 P 0473d2b2d01f4459b1e90fd12cc7840e [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:04:07.537631 19560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "309c3ca0ca4b4f3ba129752ea2cb293b" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:04:07.537904 19484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14935b3ddf914369822e4a0547aaa355" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:04:07.532688 19604 raft_consensus.cc:740] T 2725d2c4cb054f18b0fc8f735c15f6c2 P e5256d91808b47c195bc9b4dbd7f2b87 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e5256d91808b47c195bc9b4dbd7f2b87, State: Initialized, Role: FOLLOWER
I20260709 13:04:07.544301 19560 raft_consensus.cc:2468] T 309c3ca0ca4b4f3ba129752ea2cb293b P e61c3a8f61bb48f8a963c9480e53c168 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 0.
I20260709 13:04:07.544579 19604 consensus_queue.cc:260] T 2725d2c4cb054f18b0fc8f735c15f6c2 P e5256d91808b47c195bc9b4dbd7f2b87 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:07.545573 19450 leader_election.cc:304] T 309c3ca0ca4b4f3ba129752ea2cb293b P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:04:07.540221 19685 raft_consensus.cc:515] T 2a16f7501e2444fb86d4e2778e734e02 P e5256d91808b47c195bc9b4dbd7f2b87 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:07.541199 19601 tablet_bootstrap.cc:492] T a08760e15aac4630a629431f56024dc8 P 0473d2b2d01f4459b1e90fd12cc7840e: Bootstrap starting.
W20260709 13:04:07.542092 19526 leader_election.cc:343] T 7f575b143b844aa096b50997dad3516a P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:07.542645 19558 raft_consensus.cc:2468] T d1e5873a19244c5ebbcd38e126796ee7 P e61c3a8f61bb48f8a963c9480e53c168 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 1.
I20260709 13:04:07.538937 19646 leader_election.cc:290] T 309c3ca0ca4b4f3ba129752ea2cb293b P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:04:07.546844 19604 ts_tablet_manager.cc:1434] T 2725d2c4cb054f18b0fc8f735c15f6c2 P e5256d91808b47c195bc9b4dbd7f2b87: Time spent starting tablet: real 0.030s	user 0.007s	sys 0.000s
I20260709 13:04:07.546358 19611 raft_consensus.cc:2804] T 309c3ca0ca4b4f3ba129752ea2cb293b P 0473d2b2d01f4459b1e90fd12cc7840e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:07.548969 19600 tablet_bootstrap.cc:654] T 1a61655d99124a29b486ba4a5b37faea P e61c3a8f61bb48f8a963c9480e53c168: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:07.547946 19526 leader_election.cc:304] T 7f575b143b844aa096b50997dad3516a P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e61c3a8f61bb48f8a963c9480e53c168; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:04:07.549533 19450 leader_election.cc:304] T d1e5873a19244c5ebbcd38e126796ee7 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168; no voters: e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:04:07.550776 19526 leader_election.cc:304] T 14935b3ddf914369822e4a0547aaa355 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e61c3a8f61bb48f8a963c9480e53c168; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:04:07.551117 19684 raft_consensus.cc:2749] T 7f575b143b844aa096b50997dad3516a P e61c3a8f61bb48f8a963c9480e53c168 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:04:07.550156 19611 raft_consensus.cc:493] T 309c3ca0ca4b4f3ba129752ea2cb293b P 0473d2b2d01f4459b1e90fd12cc7840e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:07.551905 19684 raft_consensus.cc:2749] T 14935b3ddf914369822e4a0547aaa355 P e61c3a8f61bb48f8a963c9480e53c168 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:04:07.552188 19611 raft_consensus.cc:3060] T 309c3ca0ca4b4f3ba129752ea2cb293b P 0473d2b2d01f4459b1e90fd12cc7840e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:07.553242 19484 raft_consensus.cc:3060] T 14efcc79969f41babe5529c22d59156d P 0473d2b2d01f4459b1e90fd12cc7840e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:07.553582 19647 raft_consensus.cc:2804] T d1e5873a19244c5ebbcd38e126796ee7 P 0473d2b2d01f4459b1e90fd12cc7840e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:07.554098 19647 raft_consensus.cc:697] T d1e5873a19244c5ebbcd38e126796ee7 P 0473d2b2d01f4459b1e90fd12cc7840e [term 1 LEADER]: Becoming Leader. State: Replica: 0473d2b2d01f4459b1e90fd12cc7840e, State: Running, Role: LEADER
I20260709 13:04:07.555016 19411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "309c3ca0ca4b4f3ba129752ea2cb293b" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:04:07.555359 19604 tablet_bootstrap.cc:492] T ed7fdbcb96d14d418db9ca90a792588a P e5256d91808b47c195bc9b4dbd7f2b87: Bootstrap starting.
I20260709 13:04:07.560191 19409 raft_consensus.cc:1240] T 2a16f7501e2444fb86d4e2778e734e02 P e5256d91808b47c195bc9b4dbd7f2b87 [term 2 FOLLOWER]: Rejecting Update request from peer 0473d2b2d01f4459b1e90fd12cc7840e for earlier term 1. Current term is 2. Ops: [1.1-1.1]
I20260709 13:04:07.563534 19685 leader_election.cc:290] T 2a16f7501e2444fb86d4e2778e734e02 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 2 election: Requested vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:04:07.564359 19486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a16f7501e2444fb86d4e2778e734e02" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:04:07.565192 19630 raft_consensus.cc:493] T b9f0d59553ad444883fcf5b5909f9798 P e61c3a8f61bb48f8a963c9480e53c168 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:07.568687 19558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a16f7501e2444fb86d4e2778e734e02" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:04:07.570241 19558 raft_consensus.cc:3060] T 2a16f7501e2444fb86d4e2778e734e02 P e61c3a8f61bb48f8a963c9480e53c168 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:07.568316 19630 raft_consensus.cc:515] T b9f0d59553ad444883fcf5b5909f9798 P e61c3a8f61bb48f8a963c9480e53c168 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:07.573537 19604 tablet_bootstrap.cc:654] T ed7fdbcb96d14d418db9ca90a792588a P e5256d91808b47c195bc9b4dbd7f2b87: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:07.573720 19630 leader_election.cc:290] T b9f0d59553ad444883fcf5b5909f9798 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:04:07.574905 19486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9f0d59553ad444883fcf5b5909f9798" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
W20260709 13:04:07.579294 19526 leader_election.cc:343] T b9f0d59553ad444883fcf5b5909f9798 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:07.566624 19411 raft_consensus.cc:2468] T 309c3ca0ca4b4f3ba129752ea2cb293b P e5256d91808b47c195bc9b4dbd7f2b87 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 0.
I20260709 13:04:07.580857 19685 raft_consensus.cc:493] T 46c5bfeecc314717bffe987e6844b6d0 P e5256d91808b47c195bc9b4dbd7f2b87 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:07.588744 19646 consensus_queue.cc:1059] T 2a16f7501e2444fb86d4e2778e734e02 P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 }, Status: INVALID_TERM, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:04:07.589210 19685 raft_consensus.cc:515] T 46c5bfeecc314717bffe987e6844b6d0 P e5256d91808b47c195bc9b4dbd7f2b87 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:07.589695 19646 raft_consensus.cc:3055] T 2a16f7501e2444fb86d4e2778e734e02 P 0473d2b2d01f4459b1e90fd12cc7840e [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:04:07.590081 19646 raft_consensus.cc:740] T 2a16f7501e2444fb86d4e2778e734e02 P 0473d2b2d01f4459b1e90fd12cc7840e [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0473d2b2d01f4459b1e90fd12cc7840e, State: Running, Role: LEADER
I20260709 13:04:07.590955 19646 consensus_queue.cc:260] T 2a16f7501e2444fb86d4e2778e734e02 P 0473d2b2d01f4459b1e90fd12cc7840e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:07.591602 19685 leader_election.cc:290] T 46c5bfeecc314717bffe987e6844b6d0 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:04:07.592245 19646 raft_consensus.cc:3060] T 2a16f7501e2444fb86d4e2778e734e02 P 0473d2b2d01f4459b1e90fd12cc7840e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:07.581853 19647 consensus_queue.cc:237] T d1e5873a19244c5ebbcd38e126796ee7 P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:07.595309 19409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9f0d59553ad444883fcf5b5909f9798" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:04:07.595963 19560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46c5bfeecc314717bffe987e6844b6d0" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:04:07.599501 19560 raft_consensus.cc:2393] T 46c5bfeecc314717bffe987e6844b6d0 P e61c3a8f61bb48f8a963c9480e53c168 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e5256d91808b47c195bc9b4dbd7f2b87 in current term 1: Already voted for candidate e61c3a8f61bb48f8a963c9480e53c168 in this term.
I20260709 13:04:07.603947 19678 raft_consensus.cc:493] T 22196caba61445d3bec98a0aab3c337d P 0473d2b2d01f4459b1e90fd12cc7840e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:07.596601 19486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46c5bfeecc314717bffe987e6844b6d0" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
W20260709 13:04:07.604193 19523 leader_election.cc:343] T b9f0d59553ad444883fcf5b5909f9798 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:07.605798 19678 raft_consensus.cc:515] T 22196caba61445d3bec98a0aab3c337d P 0473d2b2d01f4459b1e90fd12cc7840e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:07.606397 19486 raft_consensus.cc:2393] T 46c5bfeecc314717bffe987e6844b6d0 P 0473d2b2d01f4459b1e90fd12cc7840e [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e5256d91808b47c195bc9b4dbd7f2b87 in current term 1: Already voted for candidate 0473d2b2d01f4459b1e90fd12cc7840e in this term.
I20260709 13:04:07.607863 19678 leader_election.cc:290] T 22196caba61445d3bec98a0aab3c337d P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:04:07.606030 19523 leader_election.cc:304] T b9f0d59553ad444883fcf5b5909f9798 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e61c3a8f61bb48f8a963c9480e53c168; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:04:07.611090 19377 leader_election.cc:304] T 46c5bfeecc314717bffe987e6844b6d0 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:04:07.612669 19685 raft_consensus.cc:3060] T 46c5bfeecc314717bffe987e6844b6d0 P e5256d91808b47c195bc9b4dbd7f2b87 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:07.614614 19558 raft_consensus.cc:2468] T 2a16f7501e2444fb86d4e2778e734e02 P e61c3a8f61bb48f8a963c9480e53c168 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 2.
I20260709 13:04:07.616443 19601 tablet_bootstrap.cc:654] T a08760e15aac4630a629431f56024dc8 P 0473d2b2d01f4459b1e90fd12cc7840e: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:07.623190 19600 tablet_bootstrap.cc:492] T 1a61655d99124a29b486ba4a5b37faea P e61c3a8f61bb48f8a963c9480e53c168: No bootstrap required, opened a new log
I20260709 13:04:07.623581 19600 ts_tablet_manager.cc:1403] T 1a61655d99124a29b486ba4a5b37faea P e61c3a8f61bb48f8a963c9480e53c168: Time spent bootstrapping tablet: real 0.090s	user 0.019s	sys 0.007s
I20260709 13:04:07.600132 19611 raft_consensus.cc:515] T 309c3ca0ca4b4f3ba129752ea2cb293b P 0473d2b2d01f4459b1e90fd12cc7840e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:07.624599 19559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22196caba61445d3bec98a0aab3c337d" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:04:07.625238 19678 raft_consensus.cc:493] T 1a61655d99124a29b486ba4a5b37faea P 0473d2b2d01f4459b1e90fd12cc7840e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:07.625689 19678 raft_consensus.cc:515] T 1a61655d99124a29b486ba4a5b37faea P 0473d2b2d01f4459b1e90fd12cc7840e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:07.626016 19611 leader_election.cc:290] T 309c3ca0ca4b4f3ba129752ea2cb293b P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 1 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:04:07.626505 19630 raft_consensus.cc:2749] T b9f0d59553ad444883fcf5b5909f9798 P e61c3a8f61bb48f8a963c9480e53c168 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:04:07.632719 19411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22196caba61445d3bec98a0aab3c337d" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
W20260709 13:04:07.634124 19450 leader_election.cc:343] T 22196caba61445d3bec98a0aab3c337d P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:04:07.637126 19449 leader_election.cc:343] T 22196caba61445d3bec98a0aab3c337d P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:07.637228 19409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "309c3ca0ca4b4f3ba129752ea2cb293b" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
I20260709 13:04:07.637812 19409 raft_consensus.cc:3060] T 309c3ca0ca4b4f3ba129752ea2cb293b P e5256d91808b47c195bc9b4dbd7f2b87 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:07.637585 19449 leader_election.cc:304] T 22196caba61445d3bec98a0aab3c337d P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e; no voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:04:07.640664 19411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a61655d99124a29b486ba4a5b37faea" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:04:07.641188 19647 raft_consensus.cc:2749] T 22196caba61445d3bec98a0aab3c337d P 0473d2b2d01f4459b1e90fd12cc7840e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:04:07.641750 19630 consensus_queue.cc:1048] T 2725d2c4cb054f18b0fc8f735c15f6c2 P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 13:04:07.642359 19449 leader_election.cc:343] T 1a61655d99124a29b486ba4a5b37faea P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:07.643296 19559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "309c3ca0ca4b4f3ba129752ea2cb293b" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:04:07.643507 19600 raft_consensus.cc:359] T 1a61655d99124a29b486ba4a5b37faea P e61c3a8f61bb48f8a963c9480e53c168 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:07.643864 19559 raft_consensus.cc:3060] T 309c3ca0ca4b4f3ba129752ea2cb293b P e61c3a8f61bb48f8a963c9480e53c168 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:07.644415 19560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a61655d99124a29b486ba4a5b37faea" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:04:07.632050 19678 leader_election.cc:290] T 1a61655d99124a29b486ba4a5b37faea P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:04:07.646481 19600 raft_consensus.cc:385] T 1a61655d99124a29b486ba4a5b37faea P e61c3a8f61bb48f8a963c9480e53c168 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:07.646855 19600 raft_consensus.cc:740] T 1a61655d99124a29b486ba4a5b37faea P e61c3a8f61bb48f8a963c9480e53c168 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e61c3a8f61bb48f8a963c9480e53c168, State: Initialized, Role: FOLLOWER
I20260709 13:04:07.649166 19600 consensus_queue.cc:260] T 1a61655d99124a29b486ba4a5b37faea P e61c3a8f61bb48f8a963c9480e53c168 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:07.650503 19560 raft_consensus.cc:2468] T 1a61655d99124a29b486ba4a5b37faea P e61c3a8f61bb48f8a963c9480e53c168 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 0.
I20260709 13:04:07.620153 19375 leader_election.cc:304] T 2a16f7501e2444fb86d4e2778e734e02 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168; no voters: 0473d2b2d01f4459b1e90fd12cc7840e
I20260709 13:04:07.651707 19679 raft_consensus.cc:2804] T 2a16f7501e2444fb86d4e2778e734e02 P e5256d91808b47c195bc9b4dbd7f2b87 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:04:07.652172 19679 raft_consensus.cc:697] T 2a16f7501e2444fb86d4e2778e734e02 P e5256d91808b47c195bc9b4dbd7f2b87 [term 2 LEADER]: Becoming Leader. State: Replica: e5256d91808b47c195bc9b4dbd7f2b87, State: Running, Role: LEADER
I20260709 13:04:07.652956 19679 consensus_queue.cc:237] T 2a16f7501e2444fb86d4e2778e734e02 P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:07.654199 19685 raft_consensus.cc:2749] T 46c5bfeecc314717bffe987e6844b6d0 P e5256d91808b47c195bc9b4dbd7f2b87 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:04:07.656394 19600 ts_tablet_manager.cc:1434] T 1a61655d99124a29b486ba4a5b37faea P e61c3a8f61bb48f8a963c9480e53c168: Time spent starting tablet: real 0.033s	user 0.005s	sys 0.002s
I20260709 13:04:07.657367 19600 tablet_bootstrap.cc:492] T ed7fdbcb96d14d418db9ca90a792588a P e61c3a8f61bb48f8a963c9480e53c168: Bootstrap starting.
I20260709 13:04:07.663415 19450 leader_election.cc:304] T 1a61655d99124a29b486ba4a5b37faea P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168; no voters: e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:04:07.664542 19611 raft_consensus.cc:2804] T 1a61655d99124a29b486ba4a5b37faea P 0473d2b2d01f4459b1e90fd12cc7840e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:07.665076 19611 raft_consensus.cc:493] T 1a61655d99124a29b486ba4a5b37faea P 0473d2b2d01f4459b1e90fd12cc7840e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:07.667523 19611 raft_consensus.cc:3060] T 1a61655d99124a29b486ba4a5b37faea P 0473d2b2d01f4459b1e90fd12cc7840e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:07.673807 19600 tablet_bootstrap.cc:654] T ed7fdbcb96d14d418db9ca90a792588a P e61c3a8f61bb48f8a963c9480e53c168: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:07.676285 19409 raft_consensus.cc:2468] T 309c3ca0ca4b4f3ba129752ea2cb293b P e5256d91808b47c195bc9b4dbd7f2b87 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 1.
I20260709 13:04:07.677963 19449 leader_election.cc:304] T 309c3ca0ca4b4f3ba129752ea2cb293b P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87; no voters: 
I20260709 13:04:07.678243 19409 raft_consensus.cc:3060] T 2725d2c4cb054f18b0fc8f735c15f6c2 P e5256d91808b47c195bc9b4dbd7f2b87 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:07.679255 19678 raft_consensus.cc:2804] T 309c3ca0ca4b4f3ba129752ea2cb293b P 0473d2b2d01f4459b1e90fd12cc7840e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:07.679903 19678 raft_consensus.cc:697] T 309c3ca0ca4b4f3ba129752ea2cb293b P 0473d2b2d01f4459b1e90fd12cc7840e [term 1 LEADER]: Becoming Leader. State: Replica: 0473d2b2d01f4459b1e90fd12cc7840e, State: Running, Role: LEADER
I20260709 13:04:07.680810 19678 consensus_queue.cc:237] T 309c3ca0ca4b4f3ba129752ea2cb293b P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:07.692606 19559 raft_consensus.cc:2468] T 309c3ca0ca4b4f3ba129752ea2cb293b P e61c3a8f61bb48f8a963c9480e53c168 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 1.
I20260709 13:04:07.695672 19630 consensus_queue.cc:1048] T 2e36a9d6e29c4a7c860cf267efbd4c74 P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:07.723585 19611 raft_consensus.cc:515] T 1a61655d99124a29b486ba4a5b37faea P 0473d2b2d01f4459b1e90fd12cc7840e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:07.725245 19630 consensus_queue.cc:1048] T 2725d2c4cb054f18b0fc8f735c15f6c2 P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 13:04:07.728554 19611 leader_election.cc:290] T 1a61655d99124a29b486ba4a5b37faea P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 1 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:04:07.735086 19560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a61655d99124a29b486ba4a5b37faea" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:04:07.735885 19560 raft_consensus.cc:3060] T 1a61655d99124a29b486ba4a5b37faea P e61c3a8f61bb48f8a963c9480e53c168 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:07.737323 19604 tablet_bootstrap.cc:492] T ed7fdbcb96d14d418db9ca90a792588a P e5256d91808b47c195bc9b4dbd7f2b87: No bootstrap required, opened a new log
I20260709 13:04:07.737808 19604 ts_tablet_manager.cc:1403] T ed7fdbcb96d14d418db9ca90a792588a P e5256d91808b47c195bc9b4dbd7f2b87: Time spent bootstrapping tablet: real 0.183s	user 0.018s	sys 0.022s
I20260709 13:04:07.741940 19409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a61655d99124a29b486ba4a5b37faea" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
W20260709 13:04:07.743736 19449 leader_election.cc:343] T 1a61655d99124a29b486ba4a5b37faea P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:07.743841 19306 catalog_manager.cc:5697] T 2a16f7501e2444fb86d4e2778e734e02 P e5256d91808b47c195bc9b4dbd7f2b87 reported cstate change: term changed from 1 to 2, leader changed from 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2) to e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1). New cstate: current_term: 2 leader_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:07.747506 19308 catalog_manager.cc:5697] T 40e1e16737a842ee936002830f36882e P 0473d2b2d01f4459b1e90fd12cc7840e reported cstate change: term changed from 0 to 1, leader changed from <none> to 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2). New cstate: current_term: 1 leader_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:07.750222 19308 catalog_manager.cc:5697] T d1e5873a19244c5ebbcd38e126796ee7 P 0473d2b2d01f4459b1e90fd12cc7840e reported cstate change: term changed from 0 to 1, leader changed from <none> to 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2). New cstate: current_term: 1 leader_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:07.761030 19604 raft_consensus.cc:359] T ed7fdbcb96d14d418db9ca90a792588a P e5256d91808b47c195bc9b4dbd7f2b87 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:07.762140 19604 raft_consensus.cc:385] T ed7fdbcb96d14d418db9ca90a792588a P e5256d91808b47c195bc9b4dbd7f2b87 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:07.762521 19604 raft_consensus.cc:740] T ed7fdbcb96d14d418db9ca90a792588a P e5256d91808b47c195bc9b4dbd7f2b87 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e5256d91808b47c195bc9b4dbd7f2b87, State: Initialized, Role: FOLLOWER
I20260709 13:04:07.765597 19604 consensus_queue.cc:260] T ed7fdbcb96d14d418db9ca90a792588a P e5256d91808b47c195bc9b4dbd7f2b87 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:07.764854 19611 raft_consensus.cc:493] T ff75a1d4cb1f493db8f71ddc136ba9ab P 0473d2b2d01f4459b1e90fd12cc7840e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:07.775010 19604 ts_tablet_manager.cc:1434] T ed7fdbcb96d14d418db9ca90a792588a P e5256d91808b47c195bc9b4dbd7f2b87: Time spent starting tablet: real 0.037s	user 0.009s	sys 0.000s
I20260709 13:04:07.775861 19604 tablet_bootstrap.cc:492] T 22196caba61445d3bec98a0aab3c337d P e5256d91808b47c195bc9b4dbd7f2b87: Bootstrap starting.
I20260709 13:04:07.774149 19630 raft_consensus.cc:493] T 86a6797bdfe94fa496c050ceae4bd0d9 P e61c3a8f61bb48f8a963c9480e53c168 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:07.781422 19630 raft_consensus.cc:515] T 86a6797bdfe94fa496c050ceae4bd0d9 P e61c3a8f61bb48f8a963c9480e53c168 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:07.787372 19411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86a6797bdfe94fa496c050ceae4bd0d9" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:04:07.769593 19611 raft_consensus.cc:515] T ff75a1d4cb1f493db8f71ddc136ba9ab P 0473d2b2d01f4459b1e90fd12cc7840e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:07.789690 19559 raft_consensus.cc:3060] T 14935b3ddf914369822e4a0547aaa355 P e61c3a8f61bb48f8a963c9480e53c168 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:07.790807 19630 leader_election.cc:290] T 86a6797bdfe94fa496c050ceae4bd0d9 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:04:07.792164 19611 leader_election.cc:290] T ff75a1d4cb1f493db8f71ddc136ba9ab P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:04:07.793987 19558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff75a1d4cb1f493db8f71ddc136ba9ab" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
W20260709 13:04:07.795598 19523 leader_election.cc:343] T 86a6797bdfe94fa496c050ceae4bd0d9 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:04:07.814105 19450 leader_election.cc:343] T ff75a1d4cb1f493db8f71ddc136ba9ab P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:07.814932 19485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86a6797bdfe94fa496c050ceae4bd0d9" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:04:07.793979 19560 raft_consensus.cc:2468] T 1a61655d99124a29b486ba4a5b37faea P e61c3a8f61bb48f8a963c9480e53c168 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 1.
I20260709 13:04:07.822219 19601 tablet_bootstrap.cc:492] T a08760e15aac4630a629431f56024dc8 P 0473d2b2d01f4459b1e90fd12cc7840e: No bootstrap required, opened a new log
I20260709 13:04:07.822759 19601 ts_tablet_manager.cc:1403] T a08760e15aac4630a629431f56024dc8 P 0473d2b2d01f4459b1e90fd12cc7840e: Time spent bootstrapping tablet: real 0.282s	user 0.027s	sys 0.030s
W20260709 13:04:07.822743 19526 leader_election.cc:343] T 86a6797bdfe94fa496c050ceae4bd0d9 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:07.823427 19526 leader_election.cc:304] T 86a6797bdfe94fa496c050ceae4bd0d9 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e61c3a8f61bb48f8a963c9480e53c168; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:04:07.828225 19630 raft_consensus.cc:2749] T 86a6797bdfe94fa496c050ceae4bd0d9 P e61c3a8f61bb48f8a963c9480e53c168 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:04:07.829277 19450 leader_election.cc:304] T 1a61655d99124a29b486ba4a5b37faea P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168; no voters: e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:04:07.831144 19678 raft_consensus.cc:2804] T 1a61655d99124a29b486ba4a5b37faea P 0473d2b2d01f4459b1e90fd12cc7840e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:07.831780 19678 raft_consensus.cc:697] T 1a61655d99124a29b486ba4a5b37faea P 0473d2b2d01f4459b1e90fd12cc7840e [term 1 LEADER]: Becoming Leader. State: Replica: 0473d2b2d01f4459b1e90fd12cc7840e, State: Running, Role: LEADER
I20260709 13:04:07.832819 19678 consensus_queue.cc:237] T 1a61655d99124a29b486ba4a5b37faea P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:07.838131 19600 tablet_bootstrap.cc:492] T ed7fdbcb96d14d418db9ca90a792588a P e61c3a8f61bb48f8a963c9480e53c168: No bootstrap required, opened a new log
I20260709 13:04:07.838862 19600 ts_tablet_manager.cc:1403] T ed7fdbcb96d14d418db9ca90a792588a P e61c3a8f61bb48f8a963c9480e53c168: Time spent bootstrapping tablet: real 0.182s	user 0.022s	sys 0.015s
I20260709 13:04:07.849737 19603 consensus_queue.cc:1048] T 2e36a9d6e29c4a7c860cf267efbd4c74 P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:04:07.857896 19604 tablet_bootstrap.cc:654] T 22196caba61445d3bec98a0aab3c337d P e5256d91808b47c195bc9b4dbd7f2b87: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:07.836917 19411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff75a1d4cb1f493db8f71ddc136ba9ab" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
W20260709 13:04:07.863509 19449 leader_election.cc:343] T ff75a1d4cb1f493db8f71ddc136ba9ab P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:07.864105 19449 leader_election.cc:304] T ff75a1d4cb1f493db8f71ddc136ba9ab P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e; no voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:04:07.865025 19611 raft_consensus.cc:2749] T ff75a1d4cb1f493db8f71ddc136ba9ab P 0473d2b2d01f4459b1e90fd12cc7840e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:04:07.868696 19601 raft_consensus.cc:359] T a08760e15aac4630a629431f56024dc8 P 0473d2b2d01f4459b1e90fd12cc7840e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:07.871122 19601 raft_consensus.cc:385] T a08760e15aac4630a629431f56024dc8 P 0473d2b2d01f4459b1e90fd12cc7840e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:07.871435 19601 raft_consensus.cc:740] T a08760e15aac4630a629431f56024dc8 P 0473d2b2d01f4459b1e90fd12cc7840e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0473d2b2d01f4459b1e90fd12cc7840e, State: Initialized, Role: FOLLOWER
I20260709 13:04:07.872539 19601 consensus_queue.cc:260] T a08760e15aac4630a629431f56024dc8 P 0473d2b2d01f4459b1e90fd12cc7840e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:07.878289 19601 ts_tablet_manager.cc:1434] T a08760e15aac4630a629431f56024dc8 P 0473d2b2d01f4459b1e90fd12cc7840e: Time spent starting tablet: real 0.055s	user 0.008s	sys 0.000s
I20260709 13:04:07.879776 19600 raft_consensus.cc:359] T ed7fdbcb96d14d418db9ca90a792588a P e61c3a8f61bb48f8a963c9480e53c168 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:07.881786 19600 raft_consensus.cc:385] T ed7fdbcb96d14d418db9ca90a792588a P e61c3a8f61bb48f8a963c9480e53c168 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:07.882102 19600 raft_consensus.cc:740] T ed7fdbcb96d14d418db9ca90a792588a P e61c3a8f61bb48f8a963c9480e53c168 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e61c3a8f61bb48f8a963c9480e53c168, State: Initialized, Role: FOLLOWER
I20260709 13:04:07.883306 19601 tablet_bootstrap.cc:492] T 96efeaaf1057492490e9a621f37e1a2d P 0473d2b2d01f4459b1e90fd12cc7840e: Bootstrap starting.
I20260709 13:04:07.883664 19600 consensus_queue.cc:260] T ed7fdbcb96d14d418db9ca90a792588a P e61c3a8f61bb48f8a963c9480e53c168 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:07.891327 19600 ts_tablet_manager.cc:1434] T ed7fdbcb96d14d418db9ca90a792588a P e61c3a8f61bb48f8a963c9480e53c168: Time spent starting tablet: real 0.052s	user 0.005s	sys 0.001s
I20260709 13:04:07.892266 19600 tablet_bootstrap.cc:492] T 22196caba61445d3bec98a0aab3c337d P e61c3a8f61bb48f8a963c9480e53c168: Bootstrap starting.
I20260709 13:04:07.894456 19307 catalog_manager.cc:5697] T 1a61655d99124a29b486ba4a5b37faea P 0473d2b2d01f4459b1e90fd12cc7840e reported cstate change: term changed from 0 to 1, leader changed from <none> to 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2). New cstate: current_term: 1 leader_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:07.896278 19307 catalog_manager.cc:5697] T 309c3ca0ca4b4f3ba129752ea2cb293b P 0473d2b2d01f4459b1e90fd12cc7840e reported cstate change: term changed from 0 to 1, leader changed from <none> to 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2). New cstate: current_term: 1 leader_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:07.898324 19600 tablet_bootstrap.cc:654] T 22196caba61445d3bec98a0aab3c337d P e61c3a8f61bb48f8a963c9480e53c168: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:07.906774 19601 tablet_bootstrap.cc:654] T 96efeaaf1057492490e9a621f37e1a2d P 0473d2b2d01f4459b1e90fd12cc7840e: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:07.912155 19604 tablet_bootstrap.cc:492] T 22196caba61445d3bec98a0aab3c337d P e5256d91808b47c195bc9b4dbd7f2b87: No bootstrap required, opened a new log
I20260709 13:04:07.912881 19604 ts_tablet_manager.cc:1403] T 22196caba61445d3bec98a0aab3c337d P e5256d91808b47c195bc9b4dbd7f2b87: Time spent bootstrapping tablet: real 0.137s	user 0.015s	sys 0.004s
I20260709 13:04:07.917235 19604 raft_consensus.cc:359] T 22196caba61445d3bec98a0aab3c337d P e5256d91808b47c195bc9b4dbd7f2b87 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:07.917999 19604 raft_consensus.cc:385] T 22196caba61445d3bec98a0aab3c337d P e5256d91808b47c195bc9b4dbd7f2b87 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:07.918318 19604 raft_consensus.cc:740] T 22196caba61445d3bec98a0aab3c337d P e5256d91808b47c195bc9b4dbd7f2b87 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e5256d91808b47c195bc9b4dbd7f2b87, State: Initialized, Role: FOLLOWER
I20260709 13:04:07.919054 19604 consensus_queue.cc:260] T 22196caba61445d3bec98a0aab3c337d P e5256d91808b47c195bc9b4dbd7f2b87 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:07.921470 19604 ts_tablet_manager.cc:1434] T 22196caba61445d3bec98a0aab3c337d P e5256d91808b47c195bc9b4dbd7f2b87: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.000s
I20260709 13:04:07.922469 19604 tablet_bootstrap.cc:492] T d1e5873a19244c5ebbcd38e126796ee7 P e5256d91808b47c195bc9b4dbd7f2b87: Bootstrap starting.
I20260709 13:04:07.937808 19678 consensus_queue.cc:1048] T 40e1e16737a842ee936002830f36882e P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:04:07.950338 19678 raft_consensus.cc:493] T a08760e15aac4630a629431f56024dc8 P 0473d2b2d01f4459b1e90fd12cc7840e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:07.952236 19678 raft_consensus.cc:515] T a08760e15aac4630a629431f56024dc8 P 0473d2b2d01f4459b1e90fd12cc7840e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:07.962332 19678 leader_election.cc:290] T a08760e15aac4630a629431f56024dc8 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:04:07.969509 19560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a08760e15aac4630a629431f56024dc8" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
W20260709 13:04:07.973013 19450 leader_election.cc:343] T a08760e15aac4630a629431f56024dc8 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:07.973922 19611 consensus_queue.cc:1048] T 40e1e16737a842ee936002830f36882e P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260709 13:04:08.033789 19449 consensus_peers.cc:597] T d1e5873a19244c5ebbcd38e126796ee7 P 0473d2b2d01f4459b1e90fd12cc7840e -> Peer e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321): Couldn't send request to peer e5256d91808b47c195bc9b4dbd7f2b87. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:08.037102 19409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a08760e15aac4630a629431f56024dc8" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
W20260709 13:04:08.038846 19449 leader_election.cc:343] T a08760e15aac4630a629431f56024dc8 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:08.039309 19449 leader_election.cc:304] T a08760e15aac4630a629431f56024dc8 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e; no voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:04:08.040756 19611 raft_consensus.cc:2749] T a08760e15aac4630a629431f56024dc8 P 0473d2b2d01f4459b1e90fd12cc7840e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:04:08.057403 19687 raft_consensus.cc:493] T ed7fdbcb96d14d418db9ca90a792588a P e61c3a8f61bb48f8a963c9480e53c168 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:08.058127 19687 raft_consensus.cc:515] T ed7fdbcb96d14d418db9ca90a792588a P e61c3a8f61bb48f8a963c9480e53c168 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:08.067371 19687 leader_election.cc:290] T ed7fdbcb96d14d418db9ca90a792588a P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:04:08.069448 19409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed7fdbcb96d14d418db9ca90a792588a" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:04:08.070317 19409 raft_consensus.cc:2468] T ed7fdbcb96d14d418db9ca90a792588a P e5256d91808b47c195bc9b4dbd7f2b87 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 0.
I20260709 13:04:08.072134 19484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed7fdbcb96d14d418db9ca90a792588a" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:04:08.072921 19484 raft_consensus.cc:2468] T ed7fdbcb96d14d418db9ca90a792588a P 0473d2b2d01f4459b1e90fd12cc7840e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 0.
I20260709 13:04:08.077571 19526 leader_election.cc:304] T ed7fdbcb96d14d418db9ca90a792588a P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:04:08.078739 19600 tablet_bootstrap.cc:492] T 22196caba61445d3bec98a0aab3c337d P e61c3a8f61bb48f8a963c9480e53c168: No bootstrap required, opened a new log
I20260709 13:04:08.079195 19600 ts_tablet_manager.cc:1403] T 22196caba61445d3bec98a0aab3c337d P e61c3a8f61bb48f8a963c9480e53c168: Time spent bootstrapping tablet: real 0.187s	user 0.020s	sys 0.018s
I20260709 13:04:08.079932 19687 raft_consensus.cc:2804] T ed7fdbcb96d14d418db9ca90a792588a P e61c3a8f61bb48f8a963c9480e53c168 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:08.080402 19687 raft_consensus.cc:493] T ed7fdbcb96d14d418db9ca90a792588a P e61c3a8f61bb48f8a963c9480e53c168 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:08.080852 19687 raft_consensus.cc:3060] T ed7fdbcb96d14d418db9ca90a792588a P e61c3a8f61bb48f8a963c9480e53c168 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:08.081885 19600 raft_consensus.cc:359] T 22196caba61445d3bec98a0aab3c337d P e61c3a8f61bb48f8a963c9480e53c168 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:08.082574 19600 raft_consensus.cc:385] T 22196caba61445d3bec98a0aab3c337d P e61c3a8f61bb48f8a963c9480e53c168 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:08.082882 19600 raft_consensus.cc:740] T 22196caba61445d3bec98a0aab3c337d P e61c3a8f61bb48f8a963c9480e53c168 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e61c3a8f61bb48f8a963c9480e53c168, State: Initialized, Role: FOLLOWER
I20260709 13:04:08.083417 19600 consensus_queue.cc:260] T 22196caba61445d3bec98a0aab3c337d P e61c3a8f61bb48f8a963c9480e53c168 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:08.085487 19684 raft_consensus.cc:493] T 22196caba61445d3bec98a0aab3c337d P e61c3a8f61bb48f8a963c9480e53c168 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:08.086045 19684 raft_consensus.cc:515] T 22196caba61445d3bec98a0aab3c337d P e61c3a8f61bb48f8a963c9480e53c168 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:08.088184 19684 leader_election.cc:290] T 22196caba61445d3bec98a0aab3c337d P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:04:08.092344 19409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22196caba61445d3bec98a0aab3c337d" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:04:08.093252 19409 raft_consensus.cc:2468] T 22196caba61445d3bec98a0aab3c337d P e5256d91808b47c195bc9b4dbd7f2b87 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 0.
I20260709 13:04:08.097390 19523 leader_election.cc:304] T 22196caba61445d3bec98a0aab3c337d P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:04:08.098806 19684 raft_consensus.cc:2804] T 22196caba61445d3bec98a0aab3c337d P e61c3a8f61bb48f8a963c9480e53c168 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:08.099294 19600 ts_tablet_manager.cc:1434] T 22196caba61445d3bec98a0aab3c337d P e61c3a8f61bb48f8a963c9480e53c168: Time spent starting tablet: real 0.020s	user 0.007s	sys 0.000s
I20260709 13:04:08.099364 19684 raft_consensus.cc:493] T 22196caba61445d3bec98a0aab3c337d P e61c3a8f61bb48f8a963c9480e53c168 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:08.101850 19684 raft_consensus.cc:3060] T 22196caba61445d3bec98a0aab3c337d P e61c3a8f61bb48f8a963c9480e53c168 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:08.102833 19600 tablet_bootstrap.cc:492] T 96efeaaf1057492490e9a621f37e1a2d P e61c3a8f61bb48f8a963c9480e53c168: Bootstrap starting.
I20260709 13:04:08.104112 19687 raft_consensus.cc:515] T ed7fdbcb96d14d418db9ca90a792588a P e61c3a8f61bb48f8a963c9480e53c168 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:08.108736 19687 leader_election.cc:290] T ed7fdbcb96d14d418db9ca90a792588a P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 1 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:04:08.109095 19409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed7fdbcb96d14d418db9ca90a792588a" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
I20260709 13:04:08.109560 19409 raft_consensus.cc:3060] T ed7fdbcb96d14d418db9ca90a792588a P e5256d91808b47c195bc9b4dbd7f2b87 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:08.110065 19604 tablet_bootstrap.cc:654] T d1e5873a19244c5ebbcd38e126796ee7 P e5256d91808b47c195bc9b4dbd7f2b87: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:08.113462 19601 tablet_bootstrap.cc:492] T 96efeaaf1057492490e9a621f37e1a2d P 0473d2b2d01f4459b1e90fd12cc7840e: No bootstrap required, opened a new log
I20260709 13:04:08.114006 19601 ts_tablet_manager.cc:1403] T 96efeaaf1057492490e9a621f37e1a2d P 0473d2b2d01f4459b1e90fd12cc7840e: Time spent bootstrapping tablet: real 0.232s	user 0.017s	sys 0.017s
I20260709 13:04:08.117990 19600 tablet_bootstrap.cc:654] T 96efeaaf1057492490e9a621f37e1a2d P e61c3a8f61bb48f8a963c9480e53c168: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:08.120607 19601 raft_consensus.cc:359] T 96efeaaf1057492490e9a621f37e1a2d P 0473d2b2d01f4459b1e90fd12cc7840e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:08.121390 19601 raft_consensus.cc:385] T 96efeaaf1057492490e9a621f37e1a2d P 0473d2b2d01f4459b1e90fd12cc7840e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:08.121646 19601 raft_consensus.cc:740] T 96efeaaf1057492490e9a621f37e1a2d P 0473d2b2d01f4459b1e90fd12cc7840e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0473d2b2d01f4459b1e90fd12cc7840e, State: Initialized, Role: FOLLOWER
I20260709 13:04:08.126346 19601 consensus_queue.cc:260] T 96efeaaf1057492490e9a621f37e1a2d P 0473d2b2d01f4459b1e90fd12cc7840e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:08.121702 19409 raft_consensus.cc:2468] T ed7fdbcb96d14d418db9ca90a792588a P e5256d91808b47c195bc9b4dbd7f2b87 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 1.
I20260709 13:04:08.130486 19601 ts_tablet_manager.cc:1434] T 96efeaaf1057492490e9a621f37e1a2d P 0473d2b2d01f4459b1e90fd12cc7840e: Time spent starting tablet: real 0.013s	user 0.006s	sys 0.000s
I20260709 13:04:08.132110 19601 tablet_bootstrap.cc:492] T 0cdf56e38bbc453d9438d359e5a69955 P 0473d2b2d01f4459b1e90fd12cc7840e: Bootstrap starting.
I20260709 13:04:08.134936 19600 tablet_bootstrap.cc:492] T 96efeaaf1057492490e9a621f37e1a2d P e61c3a8f61bb48f8a963c9480e53c168: No bootstrap required, opened a new log
I20260709 13:04:08.135538 19600 ts_tablet_manager.cc:1403] T 96efeaaf1057492490e9a621f37e1a2d P e61c3a8f61bb48f8a963c9480e53c168: Time spent bootstrapping tablet: real 0.034s	user 0.006s	sys 0.005s
I20260709 13:04:08.138549 19600 raft_consensus.cc:359] T 96efeaaf1057492490e9a621f37e1a2d P e61c3a8f61bb48f8a963c9480e53c168 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:08.139254 19600 raft_consensus.cc:385] T 96efeaaf1057492490e9a621f37e1a2d P e61c3a8f61bb48f8a963c9480e53c168 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:08.139516 19600 raft_consensus.cc:740] T 96efeaaf1057492490e9a621f37e1a2d P e61c3a8f61bb48f8a963c9480e53c168 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e61c3a8f61bb48f8a963c9480e53c168, State: Initialized, Role: FOLLOWER
I20260709 13:04:08.139851 19601 tablet_bootstrap.cc:654] T 0cdf56e38bbc453d9438d359e5a69955 P 0473d2b2d01f4459b1e90fd12cc7840e: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:08.140166 19600 consensus_queue.cc:260] T 96efeaaf1057492490e9a621f37e1a2d P e61c3a8f61bb48f8a963c9480e53c168 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:08.142552 19600 ts_tablet_manager.cc:1434] T 96efeaaf1057492490e9a621f37e1a2d P e61c3a8f61bb48f8a963c9480e53c168: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 13:04:08.144093 19600 tablet_bootstrap.cc:492] T 0cdf56e38bbc453d9438d359e5a69955 P e61c3a8f61bb48f8a963c9480e53c168: Bootstrap starting.
I20260709 13:04:08.150254 19600 tablet_bootstrap.cc:654] T 0cdf56e38bbc453d9438d359e5a69955 P e61c3a8f61bb48f8a963c9480e53c168: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:08.150944 19523 leader_election.cc:304] T ed7fdbcb96d14d418db9ca90a792588a P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:04:08.151888 19687 raft_consensus.cc:2804] T ed7fdbcb96d14d418db9ca90a792588a P e61c3a8f61bb48f8a963c9480e53c168 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:08.152354 19687 raft_consensus.cc:697] T ed7fdbcb96d14d418db9ca90a792588a P e61c3a8f61bb48f8a963c9480e53c168 [term 1 LEADER]: Becoming Leader. State: Replica: e61c3a8f61bb48f8a963c9480e53c168, State: Running, Role: LEADER
I20260709 13:04:08.153142 19687 consensus_queue.cc:237] T ed7fdbcb96d14d418db9ca90a792588a P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:08.167471 19559 raft_consensus.cc:1275] T 2a16f7501e2444fb86d4e2778e734e02 P e61c3a8f61bb48f8a963c9480e53c168 [term 2 FOLLOWER]: Refusing update from remote peer e5256d91808b47c195bc9b4dbd7f2b87: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 13:04:08.175172 19684 raft_consensus.cc:515] T 22196caba61445d3bec98a0aab3c337d P e61c3a8f61bb48f8a963c9480e53c168 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:08.176904 19684 leader_election.cc:290] T 22196caba61445d3bec98a0aab3c337d P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 1 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
W20260709 13:04:08.202925 19357 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:04:08.216737 19647 raft_consensus.cc:493] T 46c5bfeecc314717bffe987e6844b6d0 P 0473d2b2d01f4459b1e90fd12cc7840e [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:08.217439 19647 raft_consensus.cc:515] T 46c5bfeecc314717bffe987e6844b6d0 P 0473d2b2d01f4459b1e90fd12cc7840e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:08.230012 19647 leader_election.cc:290] T 46c5bfeecc314717bffe987e6844b6d0 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:04:08.347844 19484 raft_consensus.cc:1275] T 2a16f7501e2444fb86d4e2778e734e02 P 0473d2b2d01f4459b1e90fd12cc7840e [term 2 FOLLOWER]: Refusing update from remote peer e5256d91808b47c195bc9b4dbd7f2b87: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 1. (term mismatch)
I20260709 13:04:08.348258 19484 pending_rounds.cc:85] T 2a16f7501e2444fb86d4e2778e734e02 P 0473d2b2d01f4459b1e90fd12cc7840e: Aborting all ops after (but not including) 0
I20260709 13:04:08.348551 19484 pending_rounds.cc:107] T 2a16f7501e2444fb86d4e2778e734e02 P 0473d2b2d01f4459b1e90fd12cc7840e: Aborting uncommitted NO_OP operation due to leader change: 1.1
I20260709 13:04:08.348830 19484 raft_consensus.cc:2889] T 2a16f7501e2444fb86d4e2778e734e02 P 0473d2b2d01f4459b1e90fd12cc7840e [term 2 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:04:08.350855 19685 consensus_queue.cc:1048] T 2a16f7501e2444fb86d4e2778e734e02 P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:04:08.579164 19559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46c5bfeecc314717bffe987e6844b6d0" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:04:08.580047 19559 raft_consensus.cc:2468] T 46c5bfeecc314717bffe987e6844b6d0 P e61c3a8f61bb48f8a963c9480e53c168 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 1.
I20260709 13:04:08.610175 19450 leader_election.cc:304] T 46c5bfeecc314717bffe987e6844b6d0 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:04:08.612686 19600 tablet_bootstrap.cc:492] T 0cdf56e38bbc453d9438d359e5a69955 P e61c3a8f61bb48f8a963c9480e53c168: No bootstrap required, opened a new log
I20260709 13:04:08.613166 19600 ts_tablet_manager.cc:1403] T 0cdf56e38bbc453d9438d359e5a69955 P e61c3a8f61bb48f8a963c9480e53c168: Time spent bootstrapping tablet: real 0.469s	user 0.008s	sys 0.006s
I20260709 13:04:08.616119 19600 raft_consensus.cc:359] T 0cdf56e38bbc453d9438d359e5a69955 P e61c3a8f61bb48f8a963c9480e53c168 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:08.616789 19600 raft_consensus.cc:385] T 0cdf56e38bbc453d9438d359e5a69955 P e61c3a8f61bb48f8a963c9480e53c168 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:08.617076 19600 raft_consensus.cc:740] T 0cdf56e38bbc453d9438d359e5a69955 P e61c3a8f61bb48f8a963c9480e53c168 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e61c3a8f61bb48f8a963c9480e53c168, State: Initialized, Role: FOLLOWER
I20260709 13:04:08.617662 19647 raft_consensus.cc:2804] T 46c5bfeecc314717bffe987e6844b6d0 P 0473d2b2d01f4459b1e90fd12cc7840e [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:04:08.618266 19600 consensus_queue.cc:260] T 0cdf56e38bbc453d9438d359e5a69955 P e61c3a8f61bb48f8a963c9480e53c168 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
W20260709 13:04:08.619405 19377 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.2:46257, user_credentials={real_user=slave}} blocked reactor thread for 129589us
I20260709 13:04:08.620127 19600 ts_tablet_manager.cc:1434] T 0cdf56e38bbc453d9438d359e5a69955 P e61c3a8f61bb48f8a963c9480e53c168: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 13:04:08.620950 19600 tablet_bootstrap.cc:492] T b08304a0a02b42d7840c4e8ee9a6bd1a P e61c3a8f61bb48f8a963c9480e53c168: Bootstrap starting.
I20260709 13:04:08.618077 19647 raft_consensus.cc:493] T 46c5bfeecc314717bffe987e6844b6d0 P 0473d2b2d01f4459b1e90fd12cc7840e [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:08.624482 19647 raft_consensus.cc:3060] T 46c5bfeecc314717bffe987e6844b6d0 P 0473d2b2d01f4459b1e90fd12cc7840e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:08.626349 19409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46c5bfeecc314717bffe987e6844b6d0" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:04:08.627259 19409 raft_consensus.cc:2468] T 46c5bfeecc314717bffe987e6844b6d0 P e5256d91808b47c195bc9b4dbd7f2b87 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 1.
I20260709 13:04:08.637219 19761 consensus_queue.cc:1048] T 309c3ca0ca4b4f3ba129752ea2cb293b P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:08.636417 19647 raft_consensus.cc:515] T 46c5bfeecc314717bffe987e6844b6d0 P 0473d2b2d01f4459b1e90fd12cc7840e [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:08.647080 19647 leader_election.cc:290] T 46c5bfeecc314717bffe987e6844b6d0 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 2 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:04:08.649487 19600 tablet_bootstrap.cc:654] T b08304a0a02b42d7840c4e8ee9a6bd1a P e61c3a8f61bb48f8a963c9480e53c168: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:08.653332 19647 raft_consensus.cc:493] T 96efeaaf1057492490e9a621f37e1a2d P 0473d2b2d01f4459b1e90fd12cc7840e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:08.657189 19647 raft_consensus.cc:515] T 96efeaaf1057492490e9a621f37e1a2d P 0473d2b2d01f4459b1e90fd12cc7840e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:08.657840 19484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22196caba61445d3bec98a0aab3c337d" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:04:08.658416 19484 raft_consensus.cc:2468] T 22196caba61445d3bec98a0aab3c337d P 0473d2b2d01f4459b1e90fd12cc7840e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 0.
I20260709 13:04:08.659693 19484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed7fdbcb96d14d418db9ca90a792588a" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:04:08.660250 19484 raft_consensus.cc:3060] T ed7fdbcb96d14d418db9ca90a792588a P 0473d2b2d01f4459b1e90fd12cc7840e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:08.662422 19761 consensus_queue.cc:1048] T d1e5873a19244c5ebbcd38e126796ee7 P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.005s
I20260709 13:04:08.672149 19559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46c5bfeecc314717bffe987e6844b6d0" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:04:08.673179 19559 raft_consensus.cc:3060] T 46c5bfeecc314717bffe987e6844b6d0 P e61c3a8f61bb48f8a963c9480e53c168 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:08.674256 19485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22196caba61445d3bec98a0aab3c337d" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:04:08.675383 19485 raft_consensus.cc:3060] T 22196caba61445d3bec98a0aab3c337d P 0473d2b2d01f4459b1e90fd12cc7840e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:08.683846 19559 raft_consensus.cc:2468] T 46c5bfeecc314717bffe987e6844b6d0 P e61c3a8f61bb48f8a963c9480e53c168 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 2.
I20260709 13:04:08.685930 19407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46c5bfeecc314717bffe987e6844b6d0" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
I20260709 13:04:08.686499 19407 raft_consensus.cc:3060] T 46c5bfeecc314717bffe987e6844b6d0 P e5256d91808b47c195bc9b4dbd7f2b87 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:08.696214 19407 raft_consensus.cc:2468] T 46c5bfeecc314717bffe987e6844b6d0 P e5256d91808b47c195bc9b4dbd7f2b87 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 2.
I20260709 13:04:08.697057 19485 raft_consensus.cc:2468] T 22196caba61445d3bec98a0aab3c337d P 0473d2b2d01f4459b1e90fd12cc7840e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 1.
I20260709 13:04:08.698338 19484 raft_consensus.cc:2468] T ed7fdbcb96d14d418db9ca90a792588a P 0473d2b2d01f4459b1e90fd12cc7840e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 1.
W20260709 13:04:08.698589 19604 thread.cc:641] log-alloc [worker] (thread pool) Time spent creating pthread: real 0.567s	user 0.007s	sys 0.020s
W20260709 13:04:08.699043 19604 thread.cc:608] log-alloc [worker] (thread pool) Time spent starting thread: real 0.568s	user 0.009s	sys 0.020s
I20260709 13:04:08.702194 19604 tablet_bootstrap.cc:492] T d1e5873a19244c5ebbcd38e126796ee7 P e5256d91808b47c195bc9b4dbd7f2b87: No bootstrap required, opened a new log
I20260709 13:04:08.702572 19604 ts_tablet_manager.cc:1403] T d1e5873a19244c5ebbcd38e126796ee7 P e5256d91808b47c195bc9b4dbd7f2b87: Time spent bootstrapping tablet: real 0.780s	user 0.016s	sys 0.023s
I20260709 13:04:08.700969 19411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96efeaaf1057492490e9a621f37e1a2d" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:04:08.704288 19526 leader_election.cc:304] T 22196caba61445d3bec98a0aab3c337d P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:04:08.706154 19687 raft_consensus.cc:2804] T 22196caba61445d3bec98a0aab3c337d P e61c3a8f61bb48f8a963c9480e53c168 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:08.706619 19687 raft_consensus.cc:697] T 22196caba61445d3bec98a0aab3c337d P e61c3a8f61bb48f8a963c9480e53c168 [term 1 LEADER]: Becoming Leader. State: Replica: e61c3a8f61bb48f8a963c9480e53c168, State: Running, Role: LEADER
I20260709 13:04:08.707201 19600 tablet_bootstrap.cc:492] T b08304a0a02b42d7840c4e8ee9a6bd1a P e61c3a8f61bb48f8a963c9480e53c168: No bootstrap required, opened a new log
I20260709 13:04:08.707608 19600 ts_tablet_manager.cc:1403] T b08304a0a02b42d7840c4e8ee9a6bd1a P e61c3a8f61bb48f8a963c9480e53c168: Time spent bootstrapping tablet: real 0.087s	user 0.021s	sys 0.016s
I20260709 13:04:08.707412 19687 consensus_queue.cc:237] T 22196caba61445d3bec98a0aab3c337d P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:08.708575 19604 raft_consensus.cc:359] T d1e5873a19244c5ebbcd38e126796ee7 P e5256d91808b47c195bc9b4dbd7f2b87 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:08.709209 19604 raft_consensus.cc:385] T d1e5873a19244c5ebbcd38e126796ee7 P e5256d91808b47c195bc9b4dbd7f2b87 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:08.709458 19604 raft_consensus.cc:740] T d1e5873a19244c5ebbcd38e126796ee7 P e5256d91808b47c195bc9b4dbd7f2b87 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e5256d91808b47c195bc9b4dbd7f2b87, State: Initialized, Role: FOLLOWER
I20260709 13:04:08.709975 19600 raft_consensus.cc:359] T b08304a0a02b42d7840c4e8ee9a6bd1a P e61c3a8f61bb48f8a963c9480e53c168 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:08.710160 19604 consensus_queue.cc:260] T d1e5873a19244c5ebbcd38e126796ee7 P e5256d91808b47c195bc9b4dbd7f2b87 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:08.710625 19600 raft_consensus.cc:385] T b08304a0a02b42d7840c4e8ee9a6bd1a P e61c3a8f61bb48f8a963c9480e53c168 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:08.711045 19600 raft_consensus.cc:740] T b08304a0a02b42d7840c4e8ee9a6bd1a P e61c3a8f61bb48f8a963c9480e53c168 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e61c3a8f61bb48f8a963c9480e53c168, State: Initialized, Role: FOLLOWER
I20260709 13:04:08.711781 19600 consensus_queue.cc:260] T b08304a0a02b42d7840c4e8ee9a6bd1a P e61c3a8f61bb48f8a963c9480e53c168 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:08.713649 19604 ts_tablet_manager.cc:1434] T d1e5873a19244c5ebbcd38e126796ee7 P e5256d91808b47c195bc9b4dbd7f2b87: Time spent starting tablet: real 0.011s	user 0.006s	sys 0.000s
I20260709 13:04:08.714123 19600 ts_tablet_manager.cc:1434] T b08304a0a02b42d7840c4e8ee9a6bd1a P e61c3a8f61bb48f8a963c9480e53c168: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
I20260709 13:04:08.714740 19604 tablet_bootstrap.cc:492] T 3e1f505cb0f1427bbd698ac889d80821 P e5256d91808b47c195bc9b4dbd7f2b87: Bootstrap starting.
I20260709 13:04:08.715299 19600 tablet_bootstrap.cc:492] T 3e1f505cb0f1427bbd698ac889d80821 P e61c3a8f61bb48f8a963c9480e53c168: Bootstrap starting.
W20260709 13:04:08.713200 19523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.1:40321, user_credentials={real_user=slave}} blocked reactor thread for 562327us
I20260709 13:04:08.724597 19411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22196caba61445d3bec98a0aab3c337d" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
I20260709 13:04:08.725209 19411 raft_consensus.cc:3060] T 22196caba61445d3bec98a0aab3c337d P e5256d91808b47c195bc9b4dbd7f2b87 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:08.724924 19604 tablet_bootstrap.cc:654] T 3e1f505cb0f1427bbd698ac889d80821 P e5256d91808b47c195bc9b4dbd7f2b87: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:08.740733 19450 leader_election.cc:304] T 46c5bfeecc314717bffe987e6844b6d0 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:04:08.743842 19411 raft_consensus.cc:2468] T 22196caba61445d3bec98a0aab3c337d P e5256d91808b47c195bc9b4dbd7f2b87 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 1.
I20260709 13:04:08.744329 19558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96efeaaf1057492490e9a621f37e1a2d" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:04:08.744943 19558 raft_consensus.cc:2468] T 96efeaaf1057492490e9a621f37e1a2d P e61c3a8f61bb48f8a963c9480e53c168 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 0.
W20260709 13:04:08.753396 19601 thread.cc:641] log-alloc [worker] (thread pool) Time spent creating pthread: real 0.610s	user 0.026s	sys 0.078s
W20260709 13:04:08.753718 19601 thread.cc:608] log-alloc [worker] (thread pool) Time spent starting thread: real 0.611s	user 0.026s	sys 0.078s
I20260709 13:04:08.754426 19758 raft_consensus.cc:2804] T 46c5bfeecc314717bffe987e6844b6d0 P 0473d2b2d01f4459b1e90fd12cc7840e [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:04:08.757897 19601 tablet_bootstrap.cc:492] T 0cdf56e38bbc453d9438d359e5a69955 P 0473d2b2d01f4459b1e90fd12cc7840e: No bootstrap required, opened a new log
I20260709 13:04:08.758279 19601 ts_tablet_manager.cc:1403] T 0cdf56e38bbc453d9438d359e5a69955 P 0473d2b2d01f4459b1e90fd12cc7840e: Time spent bootstrapping tablet: real 0.626s	user 0.038s	sys 0.079s
I20260709 13:04:08.764561 19615 consensus_queue.cc:1048] T 2a16f7501e2444fb86d4e2778e734e02 P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:08.757500 19758 raft_consensus.cc:697] T 46c5bfeecc314717bffe987e6844b6d0 P 0473d2b2d01f4459b1e90fd12cc7840e [term 2 LEADER]: Becoming Leader. State: Replica: 0473d2b2d01f4459b1e90fd12cc7840e, State: Running, Role: LEADER
I20260709 13:04:08.753588 19450 leader_election.cc:304] T 96efeaaf1057492490e9a621f37e1a2d P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
W20260709 13:04:08.768719 19449 consensus_peers.cc:597] T 1a61655d99124a29b486ba4a5b37faea P 0473d2b2d01f4459b1e90fd12cc7840e -> Peer e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321): Couldn't send request to peer e5256d91808b47c195bc9b4dbd7f2b87. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:08.757570 19678 consensus_queue.cc:1048] T 309c3ca0ca4b4f3ba129752ea2cb293b P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.009s
I20260709 13:04:08.772213 19647 leader_election.cc:290] T 96efeaaf1057492490e9a621f37e1a2d P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:04:08.772930 19758 consensus_queue.cc:237] T 46c5bfeecc314717bffe987e6844b6d0 P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:08.771152 19601 raft_consensus.cc:359] T 0cdf56e38bbc453d9438d359e5a69955 P 0473d2b2d01f4459b1e90fd12cc7840e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:08.775019 19601 raft_consensus.cc:385] T 0cdf56e38bbc453d9438d359e5a69955 P 0473d2b2d01f4459b1e90fd12cc7840e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:08.775388 19601 raft_consensus.cc:740] T 0cdf56e38bbc453d9438d359e5a69955 P 0473d2b2d01f4459b1e90fd12cc7840e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0473d2b2d01f4459b1e90fd12cc7840e, State: Initialized, Role: FOLLOWER
W20260709 13:04:08.776324 19449 leader_election.cc:343] T 96efeaaf1057492490e9a621f37e1a2d P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:08.777040 19647 raft_consensus.cc:2804] T 96efeaaf1057492490e9a621f37e1a2d P 0473d2b2d01f4459b1e90fd12cc7840e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:08.777441 19647 raft_consensus.cc:493] T 96efeaaf1057492490e9a621f37e1a2d P 0473d2b2d01f4459b1e90fd12cc7840e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:08.777760 19647 raft_consensus.cc:3060] T 96efeaaf1057492490e9a621f37e1a2d P 0473d2b2d01f4459b1e90fd12cc7840e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:08.782491 19601 consensus_queue.cc:260] T 0cdf56e38bbc453d9438d359e5a69955 P 0473d2b2d01f4459b1e90fd12cc7840e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:08.789639 19601 ts_tablet_manager.cc:1434] T 0cdf56e38bbc453d9438d359e5a69955 P 0473d2b2d01f4459b1e90fd12cc7840e: Time spent starting tablet: real 0.031s	user 0.006s	sys 0.000s
I20260709 13:04:08.792222 19601 tablet_bootstrap.cc:492] T 3e1f505cb0f1427bbd698ac889d80821 P 0473d2b2d01f4459b1e90fd12cc7840e: Bootstrap starting.
I20260709 13:04:08.799261 19600 tablet_bootstrap.cc:654] T 3e1f505cb0f1427bbd698ac889d80821 P e61c3a8f61bb48f8a963c9480e53c168: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:08.804270 19604 tablet_bootstrap.cc:492] T 3e1f505cb0f1427bbd698ac889d80821 P e5256d91808b47c195bc9b4dbd7f2b87: No bootstrap required, opened a new log
I20260709 13:04:08.804802 19604 ts_tablet_manager.cc:1403] T 3e1f505cb0f1427bbd698ac889d80821 P e5256d91808b47c195bc9b4dbd7f2b87: Time spent bootstrapping tablet: real 0.090s	user 0.012s	sys 0.016s
I20260709 13:04:08.807822 19647 raft_consensus.cc:515] T 96efeaaf1057492490e9a621f37e1a2d P 0473d2b2d01f4459b1e90fd12cc7840e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:08.811324 19647 leader_election.cc:290] T 96efeaaf1057492490e9a621f37e1a2d P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 1 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:04:08.816514 19411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96efeaaf1057492490e9a621f37e1a2d" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
I20260709 13:04:08.819830 19604 raft_consensus.cc:359] T 3e1f505cb0f1427bbd698ac889d80821 P e5256d91808b47c195bc9b4dbd7f2b87 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:08.820660 19604 raft_consensus.cc:385] T 3e1f505cb0f1427bbd698ac889d80821 P e5256d91808b47c195bc9b4dbd7f2b87 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:08.821007 19604 raft_consensus.cc:740] T 3e1f505cb0f1427bbd698ac889d80821 P e5256d91808b47c195bc9b4dbd7f2b87 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e5256d91808b47c195bc9b4dbd7f2b87, State: Initialized, Role: FOLLOWER
I20260709 13:04:08.822789 19630 consensus_queue.cc:1048] T ed7fdbcb96d14d418db9ca90a792588a P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260709 13:04:08.823348 19449 leader_election.cc:343] T 96efeaaf1057492490e9a621f37e1a2d P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:08.823544 19604 consensus_queue.cc:260] T 3e1f505cb0f1427bbd698ac889d80821 P e5256d91808b47c195bc9b4dbd7f2b87 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:08.816083 19647 consensus_queue.cc:1048] T 1a61655d99124a29b486ba4a5b37faea P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.004s
I20260709 13:04:08.832496 19604 ts_tablet_manager.cc:1434] T 3e1f505cb0f1427bbd698ac889d80821 P e5256d91808b47c195bc9b4dbd7f2b87: Time spent starting tablet: real 0.027s	user 0.004s	sys 0.004s
I20260709 13:04:08.833194 19604 tablet_bootstrap.cc:492] T 86a6797bdfe94fa496c050ceae4bd0d9 P e5256d91808b47c195bc9b4dbd7f2b87: Bootstrap starting.
I20260709 13:04:08.856252 19604 tablet_bootstrap.cc:654] T 86a6797bdfe94fa496c050ceae4bd0d9 P e5256d91808b47c195bc9b4dbd7f2b87: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:08.877678 19760 raft_consensus.cc:493] T 3e1f505cb0f1427bbd698ac889d80821 P e5256d91808b47c195bc9b4dbd7f2b87 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:08.878499 19760 raft_consensus.cc:515] T 3e1f505cb0f1427bbd698ac889d80821 P e5256d91808b47c195bc9b4dbd7f2b87 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:08.897941 19307 catalog_manager.cc:5697] T 46c5bfeecc314717bffe987e6844b6d0 P 0473d2b2d01f4459b1e90fd12cc7840e reported cstate change: term changed from 0 to 2, leader changed from <none> to 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2). New cstate: current_term: 2 leader_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:08.877106 19557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96efeaaf1057492490e9a621f37e1a2d" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:04:08.915161 19306 catalog_manager.cc:5697] T ed7fdbcb96d14d418db9ca90a792588a P e5256d91808b47c195bc9b4dbd7f2b87 reported cstate change: term changed from 0 to 1, leader changed from <none> to e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3). New cstate: current_term: 1 leader_uuid: "e61c3a8f61bb48f8a963c9480e53c168" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } }
I20260709 13:04:08.919612 19684 consensus_queue.cc:1048] T ed7fdbcb96d14d418db9ca90a792588a P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:08.912117 19557 raft_consensus.cc:3060] T 96efeaaf1057492490e9a621f37e1a2d P e61c3a8f61bb48f8a963c9480e53c168 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:08.934592 19604 tablet_bootstrap.cc:492] T 86a6797bdfe94fa496c050ceae4bd0d9 P e5256d91808b47c195bc9b4dbd7f2b87: No bootstrap required, opened a new log
I20260709 13:04:08.935177 19604 ts_tablet_manager.cc:1403] T 86a6797bdfe94fa496c050ceae4bd0d9 P e5256d91808b47c195bc9b4dbd7f2b87: Time spent bootstrapping tablet: real 0.102s	user 0.012s	sys 0.002s
I20260709 13:04:08.939244 19601 tablet_bootstrap.cc:654] T 3e1f505cb0f1427bbd698ac889d80821 P 0473d2b2d01f4459b1e90fd12cc7840e: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:08.938973 19484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e1f505cb0f1427bbd698ac889d80821" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:04:08.938335 19604 raft_consensus.cc:359] T 86a6797bdfe94fa496c050ceae4bd0d9 P e5256d91808b47c195bc9b4dbd7f2b87 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:08.940961 19604 raft_consensus.cc:385] T 86a6797bdfe94fa496c050ceae4bd0d9 P e5256d91808b47c195bc9b4dbd7f2b87 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:08.941097 19760 leader_election.cc:290] T 3e1f505cb0f1427bbd698ac889d80821 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:04:08.927330 19615 raft_consensus.cc:493] T d1e5873a19244c5ebbcd38e126796ee7 P e5256d91808b47c195bc9b4dbd7f2b87 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:08.941365 19604 raft_consensus.cc:740] T 86a6797bdfe94fa496c050ceae4bd0d9 P e5256d91808b47c195bc9b4dbd7f2b87 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e5256d91808b47c195bc9b4dbd7f2b87, State: Initialized, Role: FOLLOWER
I20260709 13:04:08.945607 19769 raft_consensus.cc:493] T 0cdf56e38bbc453d9438d359e5a69955 P 0473d2b2d01f4459b1e90fd12cc7840e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:08.941994 19615 raft_consensus.cc:515] T d1e5873a19244c5ebbcd38e126796ee7 P e5256d91808b47c195bc9b4dbd7f2b87 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:08.946008 19604 consensus_queue.cc:260] T 86a6797bdfe94fa496c050ceae4bd0d9 P e5256d91808b47c195bc9b4dbd7f2b87 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
W20260709 13:04:08.949352 19377 leader_election.cc:343] T 3e1f505cb0f1427bbd698ac889d80821 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:08.955083 19604 ts_tablet_manager.cc:1434] T 86a6797bdfe94fa496c050ceae4bd0d9 P e5256d91808b47c195bc9b4dbd7f2b87: Time spent starting tablet: real 0.020s	user 0.007s	sys 0.001s
I20260709 13:04:08.946086 19769 raft_consensus.cc:515] T 0cdf56e38bbc453d9438d359e5a69955 P 0473d2b2d01f4459b1e90fd12cc7840e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:08.956703 19615 leader_election.cc:290] T d1e5873a19244c5ebbcd38e126796ee7 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:04:08.958626 19604 tablet_bootstrap.cc:492] T 1a61655d99124a29b486ba4a5b37faea P e5256d91808b47c195bc9b4dbd7f2b87: Bootstrap starting.
I20260709 13:04:08.965655 19600 tablet_bootstrap.cc:492] T 3e1f505cb0f1427bbd698ac889d80821 P e61c3a8f61bb48f8a963c9480e53c168: No bootstrap required, opened a new log
I20260709 13:04:08.966091 19600 ts_tablet_manager.cc:1403] T 3e1f505cb0f1427bbd698ac889d80821 P e61c3a8f61bb48f8a963c9480e53c168: Time spent bootstrapping tablet: real 0.251s	user 0.024s	sys 0.033s
I20260709 13:04:08.969403 19409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cdf56e38bbc453d9438d359e5a69955" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
W20260709 13:04:08.970755 19449 leader_election.cc:343] T 0cdf56e38bbc453d9438d359e5a69955 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:08.964632 19557 raft_consensus.cc:2468] T 96efeaaf1057492490e9a621f37e1a2d P e61c3a8f61bb48f8a963c9480e53c168 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 1.
I20260709 13:04:08.971601 19769 leader_election.cc:290] T 0cdf56e38bbc453d9438d359e5a69955 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:04:08.973675 19600 raft_consensus.cc:359] T 3e1f505cb0f1427bbd698ac889d80821 P e61c3a8f61bb48f8a963c9480e53c168 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:08.974443 19600 raft_consensus.cc:385] T 3e1f505cb0f1427bbd698ac889d80821 P e61c3a8f61bb48f8a963c9480e53c168 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:08.974732 19600 raft_consensus.cc:740] T 3e1f505cb0f1427bbd698ac889d80821 P e61c3a8f61bb48f8a963c9480e53c168 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e61c3a8f61bb48f8a963c9480e53c168, State: Initialized, Role: FOLLOWER
I20260709 13:04:08.974606 19484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e5873a19244c5ebbcd38e126796ee7" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:04:08.975544 19600 consensus_queue.cc:260] T 3e1f505cb0f1427bbd698ac889d80821 P e61c3a8f61bb48f8a963c9480e53c168 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:08.970996 19560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e1f505cb0f1427bbd698ac889d80821" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:04:08.977368 19556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e5873a19244c5ebbcd38e126796ee7" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:04:08.977563 19560 raft_consensus.cc:2468] T 3e1f505cb0f1427bbd698ac889d80821 P e61c3a8f61bb48f8a963c9480e53c168 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 0.
I20260709 13:04:08.978883 19450 leader_election.cc:304] T 96efeaaf1057492490e9a621f37e1a2d P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168; no voters: e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:04:08.979218 19600 ts_tablet_manager.cc:1434] T 3e1f505cb0f1427bbd698ac889d80821 P e61c3a8f61bb48f8a963c9480e53c168: Time spent starting tablet: real 0.013s	user 0.004s	sys 0.003s
I20260709 13:04:08.980249 19600 tablet_bootstrap.cc:492] T 4af19371ea874c09a0a2147040835cbb P e61c3a8f61bb48f8a963c9480e53c168: Bootstrap starting.
I20260709 13:04:08.982163 19560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cdf56e38bbc453d9438d359e5a69955" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:04:08.982803 19560 raft_consensus.cc:2468] T 0cdf56e38bbc453d9438d359e5a69955 P e61c3a8f61bb48f8a963c9480e53c168 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 0.
I20260709 13:04:08.983578 19769 raft_consensus.cc:2804] T 96efeaaf1057492490e9a621f37e1a2d P 0473d2b2d01f4459b1e90fd12cc7840e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:08.984073 19769 raft_consensus.cc:697] T 96efeaaf1057492490e9a621f37e1a2d P 0473d2b2d01f4459b1e90fd12cc7840e [term 1 LEADER]: Becoming Leader. State: Replica: 0473d2b2d01f4459b1e90fd12cc7840e, State: Running, Role: LEADER
I20260709 13:04:08.984889 19769 consensus_queue.cc:237] T 96efeaaf1057492490e9a621f37e1a2d P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:08.988809 19450 leader_election.cc:304] T 0cdf56e38bbc453d9438d359e5a69955 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168; no voters: e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:04:08.990474 19761 raft_consensus.cc:2804] T 0cdf56e38bbc453d9438d359e5a69955 P 0473d2b2d01f4459b1e90fd12cc7840e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:08.993927 19761 raft_consensus.cc:493] T 0cdf56e38bbc453d9438d359e5a69955 P 0473d2b2d01f4459b1e90fd12cc7840e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:08.994331 19761 raft_consensus.cc:3060] T 0cdf56e38bbc453d9438d359e5a69955 P 0473d2b2d01f4459b1e90fd12cc7840e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:08.979502 19375 leader_election.cc:304] T 3e1f505cb0f1427bbd698ac889d80821 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168; no voters: 0473d2b2d01f4459b1e90fd12cc7840e
I20260709 13:04:08.997969 19630 raft_consensus.cc:493] T b08304a0a02b42d7840c4e8ee9a6bd1a P e61c3a8f61bb48f8a963c9480e53c168 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:08.998570 19760 raft_consensus.cc:2804] T 3e1f505cb0f1427bbd698ac889d80821 P e5256d91808b47c195bc9b4dbd7f2b87 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:08.998445 19630 raft_consensus.cc:515] T b08304a0a02b42d7840c4e8ee9a6bd1a P e61c3a8f61bb48f8a963c9480e53c168 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:08.999011 19760 raft_consensus.cc:493] T 3e1f505cb0f1427bbd698ac889d80821 P e5256d91808b47c195bc9b4dbd7f2b87 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:08.999454 19760 raft_consensus.cc:3060] T 3e1f505cb0f1427bbd698ac889d80821 P e5256d91808b47c195bc9b4dbd7f2b87 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:09.000533 19630 leader_election.cc:290] T b08304a0a02b42d7840c4e8ee9a6bd1a P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:04:09.003782 19484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b08304a0a02b42d7840c4e8ee9a6bd1a" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
W20260709 13:04:09.006417 19526 leader_election.cc:343] T b08304a0a02b42d7840c4e8ee9a6bd1a P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:09.015442 19411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b08304a0a02b42d7840c4e8ee9a6bd1a" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
W20260709 13:04:09.017314 19523 leader_election.cc:343] T b08304a0a02b42d7840c4e8ee9a6bd1a P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:09.018009 19523 leader_election.cc:304] T b08304a0a02b42d7840c4e8ee9a6bd1a P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e61c3a8f61bb48f8a963c9480e53c168; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:04:09.020187 19630 raft_consensus.cc:2749] T b08304a0a02b42d7840c4e8ee9a6bd1a P e61c3a8f61bb48f8a963c9480e53c168 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:04:08.990662 19377 leader_election.cc:304] T d1e5873a19244c5ebbcd38e126796ee7 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:04:09.030843 19615 raft_consensus.cc:2749] T d1e5873a19244c5ebbcd38e126796ee7 P e5256d91808b47c195bc9b4dbd7f2b87 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:04:09.033170 19630 raft_consensus.cc:493] T 172b3dd13109415a955b71ac0e9d2234 P e61c3a8f61bb48f8a963c9480e53c168 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:09.043553 19630 raft_consensus.cc:515] T 172b3dd13109415a955b71ac0e9d2234 P e61c3a8f61bb48f8a963c9480e53c168 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
W20260709 13:04:09.052718 19779 log.cc:927] Time spent T 1a61655d99124a29b486ba4a5b37faea P e61c3a8f61bb48f8a963c9480e53c168: Append to log took a long time: real 0.096s	user 0.001s	sys 0.000s
I20260709 13:04:09.057667 19760 raft_consensus.cc:515] T 3e1f505cb0f1427bbd698ac889d80821 P e5256d91808b47c195bc9b4dbd7f2b87 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:09.062603 19601 tablet_bootstrap.cc:492] T 3e1f505cb0f1427bbd698ac889d80821 P 0473d2b2d01f4459b1e90fd12cc7840e: No bootstrap required, opened a new log
I20260709 13:04:09.063663 19601 ts_tablet_manager.cc:1403] T 3e1f505cb0f1427bbd698ac889d80821 P 0473d2b2d01f4459b1e90fd12cc7840e: Time spent bootstrapping tablet: real 0.273s	user 0.018s	sys 0.011s
I20260709 13:04:09.063057 19630 leader_election.cc:290] T 172b3dd13109415a955b71ac0e9d2234 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:04:09.058521 19761 raft_consensus.cc:515] T 0cdf56e38bbc453d9438d359e5a69955 P 0473d2b2d01f4459b1e90fd12cc7840e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:09.068802 19761 leader_election.cc:290] T 0cdf56e38bbc453d9438d359e5a69955 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 1 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:04:09.070938 19600 tablet_bootstrap.cc:654] T 4af19371ea874c09a0a2147040835cbb P e61c3a8f61bb48f8a963c9480e53c168: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:09.071448 19760 leader_election.cc:290] T 3e1f505cb0f1427bbd698ac889d80821 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 1 election: Requested vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:04:09.072747 19604 tablet_bootstrap.cc:654] T 1a61655d99124a29b486ba4a5b37faea P e5256d91808b47c195bc9b4dbd7f2b87: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:09.073158 19559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e1f505cb0f1427bbd698ac889d80821" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:04:09.073338 19411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "172b3dd13109415a955b71ac0e9d2234" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:04:09.073760 19559 raft_consensus.cc:3060] T 3e1f505cb0f1427bbd698ac889d80821 P e61c3a8f61bb48f8a963c9480e53c168 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:04:09.074868 19523 leader_election.cc:343] T 172b3dd13109415a955b71ac0e9d2234 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:09.077222 19600 tablet_bootstrap.cc:492] T 4af19371ea874c09a0a2147040835cbb P e61c3a8f61bb48f8a963c9480e53c168: No bootstrap required, opened a new log
I20260709 13:04:09.077728 19600 ts_tablet_manager.cc:1403] T 4af19371ea874c09a0a2147040835cbb P e61c3a8f61bb48f8a963c9480e53c168: Time spent bootstrapping tablet: real 0.098s	user 0.007s	sys 0.004s
I20260709 13:04:09.080919 19600 raft_consensus.cc:359] T 4af19371ea874c09a0a2147040835cbb P e61c3a8f61bb48f8a963c9480e53c168 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:09.081888 19600 raft_consensus.cc:385] T 4af19371ea874c09a0a2147040835cbb P e61c3a8f61bb48f8a963c9480e53c168 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:09.082266 19600 raft_consensus.cc:740] T 4af19371ea874c09a0a2147040835cbb P e61c3a8f61bb48f8a963c9480e53c168 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e61c3a8f61bb48f8a963c9480e53c168, State: Initialized, Role: FOLLOWER
I20260709 13:04:09.083866 19559 raft_consensus.cc:2468] T 3e1f505cb0f1427bbd698ac889d80821 P e61c3a8f61bb48f8a963c9480e53c168 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 1.
I20260709 13:04:09.085219 19375 leader_election.cc:304] T 3e1f505cb0f1427bbd698ac889d80821 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:04:09.086232 19685 raft_consensus.cc:2804] T 3e1f505cb0f1427bbd698ac889d80821 P e5256d91808b47c195bc9b4dbd7f2b87 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:09.086768 19685 raft_consensus.cc:697] T 3e1f505cb0f1427bbd698ac889d80821 P e5256d91808b47c195bc9b4dbd7f2b87 [term 1 LEADER]: Becoming Leader. State: Replica: e5256d91808b47c195bc9b4dbd7f2b87, State: Running, Role: LEADER
I20260709 13:04:09.087641 19685 consensus_queue.cc:237] T 3e1f505cb0f1427bbd698ac889d80821 P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:09.084661 19600 consensus_queue.cc:260] T 4af19371ea874c09a0a2147040835cbb P e61c3a8f61bb48f8a963c9480e53c168 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:09.088589 19601 raft_consensus.cc:359] T 3e1f505cb0f1427bbd698ac889d80821 P 0473d2b2d01f4459b1e90fd12cc7840e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:09.089352 19601 raft_consensus.cc:385] T 3e1f505cb0f1427bbd698ac889d80821 P 0473d2b2d01f4459b1e90fd12cc7840e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:09.089592 19601 raft_consensus.cc:740] T 3e1f505cb0f1427bbd698ac889d80821 P 0473d2b2d01f4459b1e90fd12cc7840e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0473d2b2d01f4459b1e90fd12cc7840e, State: Initialized, Role: FOLLOWER
I20260709 13:04:09.090068 19601 consensus_queue.cc:260] T 3e1f505cb0f1427bbd698ac889d80821 P 0473d2b2d01f4459b1e90fd12cc7840e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:09.091547 19485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "172b3dd13109415a955b71ac0e9d2234" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
W20260709 13:04:09.090947 19450 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.3:36891, user_credentials={real_user=slave}} blocked reactor thread for 74844.6us
I20260709 13:04:09.093261 19411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cdf56e38bbc453d9438d359e5a69955" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
W20260709 13:04:09.093859 19526 leader_election.cc:343] T 172b3dd13109415a955b71ac0e9d2234 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:09.094331 19526 leader_election.cc:304] T 172b3dd13109415a955b71ac0e9d2234 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e61c3a8f61bb48f8a963c9480e53c168; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87
W20260709 13:04:09.095530 19449 leader_election.cc:343] T 0cdf56e38bbc453d9438d359e5a69955 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:09.097060 19601 ts_tablet_manager.cc:1434] T 3e1f505cb0f1427bbd698ac889d80821 P 0473d2b2d01f4459b1e90fd12cc7840e: Time spent starting tablet: real 0.032s	user 0.003s	sys 0.002s
I20260709 13:04:09.097942 19601 tablet_bootstrap.cc:492] T b9f0d59553ad444883fcf5b5909f9798 P 0473d2b2d01f4459b1e90fd12cc7840e: Bootstrap starting.
I20260709 13:04:09.098196 19630 raft_consensus.cc:2749] T 172b3dd13109415a955b71ac0e9d2234 P e61c3a8f61bb48f8a963c9480e53c168 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:04:09.098580 19604 tablet_bootstrap.cc:492] T 1a61655d99124a29b486ba4a5b37faea P e5256d91808b47c195bc9b4dbd7f2b87: No bootstrap required, opened a new log
I20260709 13:04:09.099085 19604 ts_tablet_manager.cc:1403] T 1a61655d99124a29b486ba4a5b37faea P e5256d91808b47c195bc9b4dbd7f2b87: Time spent bootstrapping tablet: real 0.141s	user 0.006s	sys 0.013s
I20260709 13:04:09.100281 19600 ts_tablet_manager.cc:1434] T 4af19371ea874c09a0a2147040835cbb P e61c3a8f61bb48f8a963c9480e53c168: Time spent starting tablet: real 0.022s	user 0.010s	sys 0.001s
I20260709 13:04:09.101361 19600 tablet_bootstrap.cc:492] T a08760e15aac4630a629431f56024dc8 P e61c3a8f61bb48f8a963c9480e53c168: Bootstrap starting.
I20260709 13:04:09.105118 19484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e1f505cb0f1427bbd698ac889d80821" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:04:09.105726 19484 raft_consensus.cc:3060] T 3e1f505cb0f1427bbd698ac889d80821 P 0473d2b2d01f4459b1e90fd12cc7840e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:09.108970 19559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cdf56e38bbc453d9438d359e5a69955" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:04:09.109462 19601 tablet_bootstrap.cc:654] T b9f0d59553ad444883fcf5b5909f9798 P 0473d2b2d01f4459b1e90fd12cc7840e: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:09.109560 19559 raft_consensus.cc:3060] T 0cdf56e38bbc453d9438d359e5a69955 P e61c3a8f61bb48f8a963c9480e53c168 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:09.118286 19484 raft_consensus.cc:2468] T 3e1f505cb0f1427bbd698ac889d80821 P 0473d2b2d01f4459b1e90fd12cc7840e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 1.
I20260709 13:04:09.123916 19411 raft_consensus.cc:3060] T d1e5873a19244c5ebbcd38e126796ee7 P e5256d91808b47c195bc9b4dbd7f2b87 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:09.121935 19604 raft_consensus.cc:359] T 1a61655d99124a29b486ba4a5b37faea P e5256d91808b47c195bc9b4dbd7f2b87 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:09.126675 19604 raft_consensus.cc:385] T 1a61655d99124a29b486ba4a5b37faea P e5256d91808b47c195bc9b4dbd7f2b87 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:09.127033 19604 raft_consensus.cc:740] T 1a61655d99124a29b486ba4a5b37faea P e5256d91808b47c195bc9b4dbd7f2b87 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e5256d91808b47c195bc9b4dbd7f2b87, State: Initialized, Role: FOLLOWER
I20260709 13:04:09.127733 19604 consensus_queue.cc:260] T 1a61655d99124a29b486ba4a5b37faea P e5256d91808b47c195bc9b4dbd7f2b87 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:09.131779 19604 ts_tablet_manager.cc:1434] T 1a61655d99124a29b486ba4a5b37faea P e5256d91808b47c195bc9b4dbd7f2b87: Time spent starting tablet: real 0.032s	user 0.007s	sys 0.000s
I20260709 13:04:09.132987 19604 tablet_bootstrap.cc:492] T 0cdf56e38bbc453d9438d359e5a69955 P e5256d91808b47c195bc9b4dbd7f2b87: Bootstrap starting.
I20260709 13:04:09.129984 19633 raft_consensus.cc:493] T 86a6797bdfe94fa496c050ceae4bd0d9 P e5256d91808b47c195bc9b4dbd7f2b87 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:09.134662 19633 raft_consensus.cc:515] T 86a6797bdfe94fa496c050ceae4bd0d9 P e5256d91808b47c195bc9b4dbd7f2b87 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:09.136828 19633 leader_election.cc:290] T 86a6797bdfe94fa496c050ceae4bd0d9 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:04:09.138613 19560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86a6797bdfe94fa496c050ceae4bd0d9" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:04:09.139308 19560 raft_consensus.cc:2468] T 86a6797bdfe94fa496c050ceae4bd0d9 P e61c3a8f61bb48f8a963c9480e53c168 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 0.
I20260709 13:04:09.140673 19375 leader_election.cc:304] T 86a6797bdfe94fa496c050ceae4bd0d9 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:04:09.142890 19760 raft_consensus.cc:2804] T 86a6797bdfe94fa496c050ceae4bd0d9 P e5256d91808b47c195bc9b4dbd7f2b87 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:09.143240 19760 raft_consensus.cc:493] T 86a6797bdfe94fa496c050ceae4bd0d9 P e5256d91808b47c195bc9b4dbd7f2b87 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:09.143571 19760 raft_consensus.cc:3060] T 86a6797bdfe94fa496c050ceae4bd0d9 P e5256d91808b47c195bc9b4dbd7f2b87 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:09.144032 19484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86a6797bdfe94fa496c050ceae4bd0d9" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
W20260709 13:04:09.145221 19377 leader_election.cc:343] T 86a6797bdfe94fa496c050ceae4bd0d9 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:09.152431 19308 catalog_manager.cc:5697] T 22196caba61445d3bec98a0aab3c337d P e61c3a8f61bb48f8a963c9480e53c168 reported cstate change: term changed from 0 to 1, leader changed from <none> to e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3). New cstate: current_term: 1 leader_uuid: "e61c3a8f61bb48f8a963c9480e53c168" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } health_report { overall_health: HEALTHY } } }
I20260709 13:04:09.156946 19760 raft_consensus.cc:515] T 86a6797bdfe94fa496c050ceae4bd0d9 P e5256d91808b47c195bc9b4dbd7f2b87 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:09.161586 19600 tablet_bootstrap.cc:654] T a08760e15aac4630a629431f56024dc8 P e61c3a8f61bb48f8a963c9480e53c168: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:09.173136 19485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86a6797bdfe94fa496c050ceae4bd0d9" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
W20260709 13:04:09.174431 19377 leader_election.cc:343] T 86a6797bdfe94fa496c050ceae4bd0d9 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:09.178593 19760 leader_election.cc:290] T 86a6797bdfe94fa496c050ceae4bd0d9 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 1 election: Requested vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:04:09.180356 19558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86a6797bdfe94fa496c050ceae4bd0d9" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:04:09.181107 19558 raft_consensus.cc:3060] T 86a6797bdfe94fa496c050ceae4bd0d9 P e61c3a8f61bb48f8a963c9480e53c168 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:09.183434 19559 raft_consensus.cc:2468] T 0cdf56e38bbc453d9438d359e5a69955 P e61c3a8f61bb48f8a963c9480e53c168 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 1.
W20260709 13:04:09.184720 19507 debug-util.cc:398] Leaking SignalData structure 0x7b0800061cc0 after lost signal to thread 18303
W20260709 13:04:09.185673 19507 debug-util.cc:398] Leaking SignalData structure 0x7b08000ed980 after lost signal to thread 19343
W20260709 13:04:09.186764 19507 debug-util.cc:398] Leaking SignalData structure 0x7b0800049de0 after lost signal to thread 19435
I20260709 13:04:09.187095 19601 tablet_bootstrap.cc:492] T b9f0d59553ad444883fcf5b5909f9798 P 0473d2b2d01f4459b1e90fd12cc7840e: No bootstrap required, opened a new log
I20260709 13:04:09.187595 19601 ts_tablet_manager.cc:1403] T b9f0d59553ad444883fcf5b5909f9798 P 0473d2b2d01f4459b1e90fd12cc7840e: Time spent bootstrapping tablet: real 0.090s	user 0.009s	sys 0.004s
W20260709 13:04:09.187685 19507 debug-util.cc:398] Leaking SignalData structure 0x7b08002303e0 after lost signal to thread 19510
I20260709 13:04:09.186936 19450 leader_election.cc:304] T 0cdf56e38bbc453d9438d359e5a69955 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168; no voters: e5256d91808b47c195bc9b4dbd7f2b87
W20260709 13:04:09.189007 19507 debug-util.cc:398] Leaking SignalData structure 0x7b0800157980 after lost signal to thread 19584
I20260709 13:04:09.188982 19769 raft_consensus.cc:2804] T 0cdf56e38bbc453d9438d359e5a69955 P 0473d2b2d01f4459b1e90fd12cc7840e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:09.195086 19769 raft_consensus.cc:697] T 0cdf56e38bbc453d9438d359e5a69955 P 0473d2b2d01f4459b1e90fd12cc7840e [term 1 LEADER]: Becoming Leader. State: Replica: 0473d2b2d01f4459b1e90fd12cc7840e, State: Running, Role: LEADER
I20260709 13:04:09.195940 19769 consensus_queue.cc:237] T 0cdf56e38bbc453d9438d359e5a69955 P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:09.198551 19601 raft_consensus.cc:359] T b9f0d59553ad444883fcf5b5909f9798 P 0473d2b2d01f4459b1e90fd12cc7840e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:09.199296 19601 raft_consensus.cc:385] T b9f0d59553ad444883fcf5b5909f9798 P 0473d2b2d01f4459b1e90fd12cc7840e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:09.199549 19601 raft_consensus.cc:740] T b9f0d59553ad444883fcf5b5909f9798 P 0473d2b2d01f4459b1e90fd12cc7840e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0473d2b2d01f4459b1e90fd12cc7840e, State: Initialized, Role: FOLLOWER
I20260709 13:04:09.199702 19604 tablet_bootstrap.cc:654] T 0cdf56e38bbc453d9438d359e5a69955 P e5256d91808b47c195bc9b4dbd7f2b87: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:09.200178 19601 consensus_queue.cc:260] T b9f0d59553ad444883fcf5b5909f9798 P 0473d2b2d01f4459b1e90fd12cc7840e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:09.204454 19307 catalog_manager.cc:5697] T 96efeaaf1057492490e9a621f37e1a2d P 0473d2b2d01f4459b1e90fd12cc7840e reported cstate change: term changed from 0 to 1, leader changed from <none> to 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2). New cstate: current_term: 1 leader_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:09.211949 19630 consensus_queue.cc:1048] T 22196caba61445d3bec98a0aab3c337d P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:04:09.220497 19558 raft_consensus.cc:2468] T 86a6797bdfe94fa496c050ceae4bd0d9 P e61c3a8f61bb48f8a963c9480e53c168 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 1.
I20260709 13:04:09.221781 19375 leader_election.cc:304] T 86a6797bdfe94fa496c050ceae4bd0d9 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168; no voters: 0473d2b2d01f4459b1e90fd12cc7840e
I20260709 13:04:09.222877 19633 raft_consensus.cc:2804] T 86a6797bdfe94fa496c050ceae4bd0d9 P e5256d91808b47c195bc9b4dbd7f2b87 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:09.223505 19633 raft_consensus.cc:697] T 86a6797bdfe94fa496c050ceae4bd0d9 P e5256d91808b47c195bc9b4dbd7f2b87 [term 1 LEADER]: Becoming Leader. State: Replica: e5256d91808b47c195bc9b4dbd7f2b87, State: Running, Role: LEADER
I20260709 13:04:09.224557 19633 consensus_queue.cc:237] T 86a6797bdfe94fa496c050ceae4bd0d9 P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:09.231052 19601 ts_tablet_manager.cc:1434] T b9f0d59553ad444883fcf5b5909f9798 P 0473d2b2d01f4459b1e90fd12cc7840e: Time spent starting tablet: real 0.043s	user 0.008s	sys 0.000s
I20260709 13:04:09.232342 19601 tablet_bootstrap.cc:492] T b08304a0a02b42d7840c4e8ee9a6bd1a P 0473d2b2d01f4459b1e90fd12cc7840e: Bootstrap starting.
I20260709 13:04:09.248706 19600 tablet_bootstrap.cc:492] T a08760e15aac4630a629431f56024dc8 P e61c3a8f61bb48f8a963c9480e53c168: No bootstrap required, opened a new log
I20260709 13:04:09.249178 19600 ts_tablet_manager.cc:1403] T a08760e15aac4630a629431f56024dc8 P e61c3a8f61bb48f8a963c9480e53c168: Time spent bootstrapping tablet: real 0.148s	user 0.013s	sys 0.018s
I20260709 13:04:09.251820 19600 raft_consensus.cc:359] T a08760e15aac4630a629431f56024dc8 P e61c3a8f61bb48f8a963c9480e53c168 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:09.252532 19600 raft_consensus.cc:385] T a08760e15aac4630a629431f56024dc8 P e61c3a8f61bb48f8a963c9480e53c168 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:09.252810 19600 raft_consensus.cc:740] T a08760e15aac4630a629431f56024dc8 P e61c3a8f61bb48f8a963c9480e53c168 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e61c3a8f61bb48f8a963c9480e53c168, State: Initialized, Role: FOLLOWER
I20260709 13:04:09.253474 19600 consensus_queue.cc:260] T a08760e15aac4630a629431f56024dc8 P e61c3a8f61bb48f8a963c9480e53c168 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:09.257632 19600 ts_tablet_manager.cc:1434] T a08760e15aac4630a629431f56024dc8 P e61c3a8f61bb48f8a963c9480e53c168: Time spent starting tablet: real 0.008s	user 0.004s	sys 0.004s
I20260709 13:04:09.258767 19600 tablet_bootstrap.cc:492] T df751f992649444090e27965eb1af85d P e61c3a8f61bb48f8a963c9480e53c168: Bootstrap starting.
I20260709 13:04:09.266500 19604 tablet_bootstrap.cc:492] T 0cdf56e38bbc453d9438d359e5a69955 P e5256d91808b47c195bc9b4dbd7f2b87: No bootstrap required, opened a new log
I20260709 13:04:09.266999 19604 ts_tablet_manager.cc:1403] T 0cdf56e38bbc453d9438d359e5a69955 P e5256d91808b47c195bc9b4dbd7f2b87: Time spent bootstrapping tablet: real 0.134s	user 0.010s	sys 0.003s
I20260709 13:04:09.271513 19604 raft_consensus.cc:359] T 0cdf56e38bbc453d9438d359e5a69955 P e5256d91808b47c195bc9b4dbd7f2b87 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:09.272297 19604 raft_consensus.cc:385] T 0cdf56e38bbc453d9438d359e5a69955 P e5256d91808b47c195bc9b4dbd7f2b87 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:09.272565 19604 raft_consensus.cc:740] T 0cdf56e38bbc453d9438d359e5a69955 P e5256d91808b47c195bc9b4dbd7f2b87 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e5256d91808b47c195bc9b4dbd7f2b87, State: Initialized, Role: FOLLOWER
I20260709 13:04:09.273198 19604 consensus_queue.cc:260] T 0cdf56e38bbc453d9438d359e5a69955 P e5256d91808b47c195bc9b4dbd7f2b87 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:09.276590 19601 tablet_bootstrap.cc:654] T b08304a0a02b42d7840c4e8ee9a6bd1a P 0473d2b2d01f4459b1e90fd12cc7840e: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:09.274634 19604 ts_tablet_manager.cc:1434] T 0cdf56e38bbc453d9438d359e5a69955 P e5256d91808b47c195bc9b4dbd7f2b87: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 13:04:09.278483 19604 tablet_bootstrap.cc:492] T a08760e15aac4630a629431f56024dc8 P e5256d91808b47c195bc9b4dbd7f2b87: Bootstrap starting.
I20260709 13:04:09.278133 19307 catalog_manager.cc:5697] T 0cdf56e38bbc453d9438d359e5a69955 P 0473d2b2d01f4459b1e90fd12cc7840e reported cstate change: term changed from 0 to 1, leader changed from <none> to 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2). New cstate: current_term: 1 leader_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:09.294991 19601 tablet_bootstrap.cc:492] T b08304a0a02b42d7840c4e8ee9a6bd1a P 0473d2b2d01f4459b1e90fd12cc7840e: No bootstrap required, opened a new log
I20260709 13:04:09.295600 19601 ts_tablet_manager.cc:1403] T b08304a0a02b42d7840c4e8ee9a6bd1a P 0473d2b2d01f4459b1e90fd12cc7840e: Time spent bootstrapping tablet: real 0.064s	user 0.016s	sys 0.004s
I20260709 13:04:09.295857 19684 consensus_queue.cc:1048] T 22196caba61445d3bec98a0aab3c337d P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:09.298398 19601 raft_consensus.cc:359] T b08304a0a02b42d7840c4e8ee9a6bd1a P 0473d2b2d01f4459b1e90fd12cc7840e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:09.299163 19601 raft_consensus.cc:385] T b08304a0a02b42d7840c4e8ee9a6bd1a P 0473d2b2d01f4459b1e90fd12cc7840e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:09.299499 19601 raft_consensus.cc:740] T b08304a0a02b42d7840c4e8ee9a6bd1a P 0473d2b2d01f4459b1e90fd12cc7840e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0473d2b2d01f4459b1e90fd12cc7840e, State: Initialized, Role: FOLLOWER
I20260709 13:04:09.300208 19601 consensus_queue.cc:260] T b08304a0a02b42d7840c4e8ee9a6bd1a P 0473d2b2d01f4459b1e90fd12cc7840e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:09.302598 19601 ts_tablet_manager.cc:1434] T b08304a0a02b42d7840c4e8ee9a6bd1a P 0473d2b2d01f4459b1e90fd12cc7840e: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 13:04:09.305429 19601 tablet_bootstrap.cc:492] T 7f575b143b844aa096b50997dad3516a P 0473d2b2d01f4459b1e90fd12cc7840e: Bootstrap starting.
I20260709 13:04:09.308554 19630 raft_consensus.cc:493] T 4af19371ea874c09a0a2147040835cbb P e61c3a8f61bb48f8a963c9480e53c168 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:09.309581 19306 catalog_manager.cc:5697] T 3e1f505cb0f1427bbd698ac889d80821 P e5256d91808b47c195bc9b4dbd7f2b87 reported cstate change: term changed from 0 to 1, leader changed from <none> to e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1). New cstate: current_term: 1 leader_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:09.312286 19306 catalog_manager.cc:5697] T 86a6797bdfe94fa496c050ceae4bd0d9 P e5256d91808b47c195bc9b4dbd7f2b87 reported cstate change: term changed from 0 to 1, leader changed from <none> to e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1). New cstate: current_term: 1 leader_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:09.310352 19630 raft_consensus.cc:515] T 4af19371ea874c09a0a2147040835cbb P e61c3a8f61bb48f8a963c9480e53c168 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:09.317144 19630 leader_election.cc:290] T 4af19371ea874c09a0a2147040835cbb P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:04:09.318427 19604 tablet_bootstrap.cc:654] T a08760e15aac4630a629431f56024dc8 P e5256d91808b47c195bc9b4dbd7f2b87: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:09.317291 19407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4af19371ea874c09a0a2147040835cbb" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:04:09.318751 19485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4af19371ea874c09a0a2147040835cbb" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
W20260709 13:04:09.331840 19526 leader_election.cc:343] T 4af19371ea874c09a0a2147040835cbb P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:09.335610 19600 tablet_bootstrap.cc:654] T df751f992649444090e27965eb1af85d P e61c3a8f61bb48f8a963c9480e53c168: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:09.341116 19633 raft_consensus.cc:493] T 1a61655d99124a29b486ba4a5b37faea P e5256d91808b47c195bc9b4dbd7f2b87 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:04:09.343012 19523 leader_election.cc:343] T 4af19371ea874c09a0a2147040835cbb P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:09.346190 19523 leader_election.cc:304] T 4af19371ea874c09a0a2147040835cbb P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e61c3a8f61bb48f8a963c9480e53c168; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:04:09.347220 19630 raft_consensus.cc:2749] T 4af19371ea874c09a0a2147040835cbb P e61c3a8f61bb48f8a963c9480e53c168 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:04:09.343073 19633 raft_consensus.cc:515] T 1a61655d99124a29b486ba4a5b37faea P e5256d91808b47c195bc9b4dbd7f2b87 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:09.355022 19559 raft_consensus.cc:1275] T 46c5bfeecc314717bffe987e6844b6d0 P e61c3a8f61bb48f8a963c9480e53c168 [term 2 FOLLOWER]: Refusing update from remote peer 0473d2b2d01f4459b1e90fd12cc7840e: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 13:04:09.357666 19604 tablet_bootstrap.cc:492] T a08760e15aac4630a629431f56024dc8 P e5256d91808b47c195bc9b4dbd7f2b87: No bootstrap required, opened a new log
I20260709 13:04:09.358111 19604 ts_tablet_manager.cc:1403] T a08760e15aac4630a629431f56024dc8 P e5256d91808b47c195bc9b4dbd7f2b87: Time spent bootstrapping tablet: real 0.080s	user 0.009s	sys 0.004s
I20260709 13:04:09.358753 19757 consensus_queue.cc:1048] T 46c5bfeecc314717bffe987e6844b6d0 P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:04:09.377985 19601 tablet_bootstrap.cc:654] T 7f575b143b844aa096b50997dad3516a P 0473d2b2d01f4459b1e90fd12cc7840e: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:09.381557 19633 leader_election.cc:290] T 1a61655d99124a29b486ba4a5b37faea P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:04:09.382936 19558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a61655d99124a29b486ba4a5b37faea" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:04:09.383284 19604 raft_consensus.cc:359] T a08760e15aac4630a629431f56024dc8 P e5256d91808b47c195bc9b4dbd7f2b87 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:09.383955 19484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a61655d99124a29b486ba4a5b37faea" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:04:09.385510 19377 leader_election.cc:304] T 1a61655d99124a29b486ba4a5b37faea P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:04:09.386264 19633 raft_consensus.cc:2749] T 1a61655d99124a29b486ba4a5b37faea P e5256d91808b47c195bc9b4dbd7f2b87 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:04:09.383960 19604 raft_consensus.cc:385] T a08760e15aac4630a629431f56024dc8 P e5256d91808b47c195bc9b4dbd7f2b87 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:09.396042 19604 raft_consensus.cc:740] T a08760e15aac4630a629431f56024dc8 P e5256d91808b47c195bc9b4dbd7f2b87 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e5256d91808b47c195bc9b4dbd7f2b87, State: Initialized, Role: FOLLOWER
I20260709 13:04:09.399530 19630 raft_consensus.cc:493] T a08760e15aac4630a629431f56024dc8 P e61c3a8f61bb48f8a963c9480e53c168 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:09.400028 19630 raft_consensus.cc:515] T a08760e15aac4630a629431f56024dc8 P e61c3a8f61bb48f8a963c9480e53c168 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:09.400499 19604 consensus_queue.cc:260] T a08760e15aac4630a629431f56024dc8 P e5256d91808b47c195bc9b4dbd7f2b87 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:09.402034 19630 leader_election.cc:290] T a08760e15aac4630a629431f56024dc8 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:04:09.403317 19604 ts_tablet_manager.cc:1434] T a08760e15aac4630a629431f56024dc8 P e5256d91808b47c195bc9b4dbd7f2b87: Time spent starting tablet: real 0.045s	user 0.003s	sys 0.004s
I20260709 13:04:09.404245 19604 tablet_bootstrap.cc:492] T 6c5eebf646ad445a9d1b1adc319d7b16 P e5256d91808b47c195bc9b4dbd7f2b87: Bootstrap starting.
I20260709 13:04:09.404284 19484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a08760e15aac4630a629431f56024dc8" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:04:09.404937 19484 raft_consensus.cc:2468] T a08760e15aac4630a629431f56024dc8 P 0473d2b2d01f4459b1e90fd12cc7840e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 0.
I20260709 13:04:09.405895 19407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a08760e15aac4630a629431f56024dc8" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:04:09.407951 19411 raft_consensus.cc:1275] T 46c5bfeecc314717bffe987e6844b6d0 P e5256d91808b47c195bc9b4dbd7f2b87 [term 2 FOLLOWER]: Refusing update from remote peer 0473d2b2d01f4459b1e90fd12cc7840e: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 13:04:09.410439 19604 tablet_bootstrap.cc:654] T 6c5eebf646ad445a9d1b1adc319d7b16 P e5256d91808b47c195bc9b4dbd7f2b87: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:09.412195 19526 leader_election.cc:304] T a08760e15aac4630a629431f56024dc8 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:04:09.412775 19757 consensus_queue.cc:1048] T 46c5bfeecc314717bffe987e6844b6d0 P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:09.433033 19630 raft_consensus.cc:2804] T a08760e15aac4630a629431f56024dc8 P e61c3a8f61bb48f8a963c9480e53c168 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:09.433462 19630 raft_consensus.cc:493] T a08760e15aac4630a629431f56024dc8 P e61c3a8f61bb48f8a963c9480e53c168 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:09.433787 19630 raft_consensus.cc:3060] T a08760e15aac4630a629431f56024dc8 P e61c3a8f61bb48f8a963c9480e53c168 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:09.433897 19601 tablet_bootstrap.cc:492] T 7f575b143b844aa096b50997dad3516a P 0473d2b2d01f4459b1e90fd12cc7840e: No bootstrap required, opened a new log
I20260709 13:04:09.434423 19601 ts_tablet_manager.cc:1403] T 7f575b143b844aa096b50997dad3516a P 0473d2b2d01f4459b1e90fd12cc7840e: Time spent bootstrapping tablet: real 0.131s	user 0.004s	sys 0.009s
I20260709 13:04:09.406492 19407 raft_consensus.cc:2468] T a08760e15aac4630a629431f56024dc8 P e5256d91808b47c195bc9b4dbd7f2b87 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 0.
W20260709 13:04:09.418166 19449 consensus_peers.cc:597] T 96efeaaf1057492490e9a621f37e1a2d P 0473d2b2d01f4459b1e90fd12cc7840e -> Peer e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321): Couldn't send request to peer e5256d91808b47c195bc9b4dbd7f2b87. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:09.421361 19769 consensus_queue.cc:1048] T 96efeaaf1057492490e9a621f37e1a2d P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:09.438524 19601 raft_consensus.cc:359] T 7f575b143b844aa096b50997dad3516a P 0473d2b2d01f4459b1e90fd12cc7840e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:09.439249 19601 raft_consensus.cc:385] T 7f575b143b844aa096b50997dad3516a P 0473d2b2d01f4459b1e90fd12cc7840e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:09.439508 19601 raft_consensus.cc:740] T 7f575b143b844aa096b50997dad3516a P 0473d2b2d01f4459b1e90fd12cc7840e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0473d2b2d01f4459b1e90fd12cc7840e, State: Initialized, Role: FOLLOWER
I20260709 13:04:09.440117 19601 consensus_queue.cc:260] T 7f575b143b844aa096b50997dad3516a P 0473d2b2d01f4459b1e90fd12cc7840e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:09.424991 19600 tablet_bootstrap.cc:492] T df751f992649444090e27965eb1af85d P e61c3a8f61bb48f8a963c9480e53c168: No bootstrap required, opened a new log
W20260709 13:04:09.431278 19357 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:04:09.441198 19600 ts_tablet_manager.cc:1403] T df751f992649444090e27965eb1af85d P e61c3a8f61bb48f8a963c9480e53c168: Time spent bootstrapping tablet: real 0.183s	user 0.046s	sys 0.031s
I20260709 13:04:09.445725 19633 raft_consensus.cc:493] T 0cdf56e38bbc453d9438d359e5a69955 P e5256d91808b47c195bc9b4dbd7f2b87 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:09.446197 19633 raft_consensus.cc:515] T 0cdf56e38bbc453d9438d359e5a69955 P e5256d91808b47c195bc9b4dbd7f2b87 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:09.448226 19633 leader_election.cc:290] T 0cdf56e38bbc453d9438d359e5a69955 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:04:09.449868 19601 ts_tablet_manager.cc:1434] T 7f575b143b844aa096b50997dad3516a P 0473d2b2d01f4459b1e90fd12cc7840e: Time spent starting tablet: real 0.015s	user 0.005s	sys 0.000s
I20260709 13:04:09.450194 19558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cdf56e38bbc453d9438d359e5a69955" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:04:09.450548 19484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cdf56e38bbc453d9438d359e5a69955" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:04:09.450980 19558 raft_consensus.cc:2393] T 0cdf56e38bbc453d9438d359e5a69955 P e61c3a8f61bb48f8a963c9480e53c168 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e5256d91808b47c195bc9b4dbd7f2b87 in current term 1: Already voted for candidate 0473d2b2d01f4459b1e90fd12cc7840e in this term.
I20260709 13:04:09.450793 19600 raft_consensus.cc:359] T df751f992649444090e27965eb1af85d P e61c3a8f61bb48f8a963c9480e53c168 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:09.451743 19600 raft_consensus.cc:385] T df751f992649444090e27965eb1af85d P e61c3a8f61bb48f8a963c9480e53c168 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:09.452091 19600 raft_consensus.cc:740] T df751f992649444090e27965eb1af85d P e61c3a8f61bb48f8a963c9480e53c168 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e61c3a8f61bb48f8a963c9480e53c168, State: Initialized, Role: FOLLOWER
I20260709 13:04:09.452775 19377 leader_election.cc:304] T 0cdf56e38bbc453d9438d359e5a69955 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:04:09.453745 19601 tablet_bootstrap.cc:492] T 86a6797bdfe94fa496c050ceae4bd0d9 P 0473d2b2d01f4459b1e90fd12cc7840e: Bootstrap starting.
I20260709 13:04:09.458359 19633 raft_consensus.cc:3060] T 0cdf56e38bbc453d9438d359e5a69955 P e5256d91808b47c195bc9b4dbd7f2b87 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:09.452749 19600 consensus_queue.cc:260] T df751f992649444090e27965eb1af85d P e61c3a8f61bb48f8a963c9480e53c168 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:09.471161 19600 ts_tablet_manager.cc:1434] T df751f992649444090e27965eb1af85d P e61c3a8f61bb48f8a963c9480e53c168: Time spent starting tablet: real 0.030s	user 0.007s	sys 0.002s
I20260709 13:04:09.470983 19630 raft_consensus.cc:515] T a08760e15aac4630a629431f56024dc8 P e61c3a8f61bb48f8a963c9480e53c168 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:09.472218 19600 tablet_bootstrap.cc:492] T edd7d470b5014c9489be7f41f64355c9 P e61c3a8f61bb48f8a963c9480e53c168: Bootstrap starting.
I20260709 13:04:09.474325 19630 leader_election.cc:290] T a08760e15aac4630a629431f56024dc8 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 1 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:04:09.476560 19411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a08760e15aac4630a629431f56024dc8" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
I20260709 13:04:09.477391 19601 tablet_bootstrap.cc:654] T 86a6797bdfe94fa496c050ceae4bd0d9 P 0473d2b2d01f4459b1e90fd12cc7840e: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:09.477320 19411 raft_consensus.cc:3060] T a08760e15aac4630a629431f56024dc8 P e5256d91808b47c195bc9b4dbd7f2b87 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:09.478116 19484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a08760e15aac4630a629431f56024dc8" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:04:09.481097 19484 raft_consensus.cc:3060] T a08760e15aac4630a629431f56024dc8 P 0473d2b2d01f4459b1e90fd12cc7840e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:09.485150 19411 raft_consensus.cc:2468] T a08760e15aac4630a629431f56024dc8 P e5256d91808b47c195bc9b4dbd7f2b87 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 1.
I20260709 13:04:09.486604 19523 leader_election.cc:304] T a08760e15aac4630a629431f56024dc8 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:04:09.487632 19687 raft_consensus.cc:2804] T a08760e15aac4630a629431f56024dc8 P e61c3a8f61bb48f8a963c9480e53c168 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:09.488185 19687 raft_consensus.cc:697] T a08760e15aac4630a629431f56024dc8 P e61c3a8f61bb48f8a963c9480e53c168 [term 1 LEADER]: Becoming Leader. State: Replica: e61c3a8f61bb48f8a963c9480e53c168, State: Running, Role: LEADER
I20260709 13:04:09.489048 19687 consensus_queue.cc:237] T a08760e15aac4630a629431f56024dc8 P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:09.491475 19600 tablet_bootstrap.cc:654] T edd7d470b5014c9489be7f41f64355c9 P e61c3a8f61bb48f8a963c9480e53c168: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:09.508708 19604 tablet_bootstrap.cc:492] T 6c5eebf646ad445a9d1b1adc319d7b16 P e5256d91808b47c195bc9b4dbd7f2b87: No bootstrap required, opened a new log
I20260709 13:04:09.509272 19604 ts_tablet_manager.cc:1403] T 6c5eebf646ad445a9d1b1adc319d7b16 P e5256d91808b47c195bc9b4dbd7f2b87: Time spent bootstrapping tablet: real 0.105s	user 0.018s	sys 0.019s
I20260709 13:04:09.515640 19604 raft_consensus.cc:359] T 6c5eebf646ad445a9d1b1adc319d7b16 P e5256d91808b47c195bc9b4dbd7f2b87 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:09.516495 19604 raft_consensus.cc:385] T 6c5eebf646ad445a9d1b1adc319d7b16 P e5256d91808b47c195bc9b4dbd7f2b87 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:09.516798 19604 raft_consensus.cc:740] T 6c5eebf646ad445a9d1b1adc319d7b16 P e5256d91808b47c195bc9b4dbd7f2b87 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e5256d91808b47c195bc9b4dbd7f2b87, State: Initialized, Role: FOLLOWER
I20260709 13:04:09.517537 19604 consensus_queue.cc:260] T 6c5eebf646ad445a9d1b1adc319d7b16 P e5256d91808b47c195bc9b4dbd7f2b87 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:09.520975 19484 raft_consensus.cc:2468] T a08760e15aac4630a629431f56024dc8 P 0473d2b2d01f4459b1e90fd12cc7840e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 1.
I20260709 13:04:09.525893 19604 ts_tablet_manager.cc:1434] T 6c5eebf646ad445a9d1b1adc319d7b16 P e5256d91808b47c195bc9b4dbd7f2b87: Time spent starting tablet: real 0.016s	user 0.008s	sys 0.000s
I20260709 13:04:09.527730 19604 tablet_bootstrap.cc:492] T ff75a1d4cb1f493db8f71ddc136ba9ab P e5256d91808b47c195bc9b4dbd7f2b87: Bootstrap starting.
I20260709 13:04:09.539714 19685 consensus_queue.cc:1048] T 3e1f505cb0f1427bbd698ac889d80821 P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 13:04:09.543182 19633 raft_consensus.cc:2749] T 0cdf56e38bbc453d9438d359e5a69955 P e5256d91808b47c195bc9b4dbd7f2b87 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:04:09.555387 19760 raft_consensus.cc:493] T 6c5eebf646ad445a9d1b1adc319d7b16 P e5256d91808b47c195bc9b4dbd7f2b87 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:09.555881 19760 raft_consensus.cc:515] T 6c5eebf646ad445a9d1b1adc319d7b16 P e5256d91808b47c195bc9b4dbd7f2b87 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:09.557859 19760 leader_election.cc:290] T 6c5eebf646ad445a9d1b1adc319d7b16 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:04:09.561578 19560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c5eebf646ad445a9d1b1adc319d7b16" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:04:09.566725 19485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c5eebf646ad445a9d1b1adc319d7b16" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:04:09.570912 19687 raft_consensus.cc:493] T df751f992649444090e27965eb1af85d P e61c3a8f61bb48f8a963c9480e53c168 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:04:09.572781 19377 leader_election.cc:343] T 6c5eebf646ad445a9d1b1adc319d7b16 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:09.575637 19687 raft_consensus.cc:515] T df751f992649444090e27965eb1af85d P e61c3a8f61bb48f8a963c9480e53c168 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
W20260709 13:04:09.577297 19375 leader_election.cc:343] T 6c5eebf646ad445a9d1b1adc319d7b16 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:09.580751 19601 tablet_bootstrap.cc:492] T 86a6797bdfe94fa496c050ceae4bd0d9 P 0473d2b2d01f4459b1e90fd12cc7840e: No bootstrap required, opened a new log
I20260709 13:04:09.581200 19601 ts_tablet_manager.cc:1403] T 86a6797bdfe94fa496c050ceae4bd0d9 P 0473d2b2d01f4459b1e90fd12cc7840e: Time spent bootstrapping tablet: real 0.128s	user 0.018s	sys 0.013s
I20260709 13:04:09.581598 19687 leader_election.cc:290] T df751f992649444090e27965eb1af85d P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:04:09.585088 19600 tablet_bootstrap.cc:492] T edd7d470b5014c9489be7f41f64355c9 P e61c3a8f61bb48f8a963c9480e53c168: No bootstrap required, opened a new log
I20260709 13:04:09.584620 19601 raft_consensus.cc:359] T 86a6797bdfe94fa496c050ceae4bd0d9 P 0473d2b2d01f4459b1e90fd12cc7840e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:09.585474 19601 raft_consensus.cc:385] T 86a6797bdfe94fa496c050ceae4bd0d9 P 0473d2b2d01f4459b1e90fd12cc7840e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:09.585566 19600 ts_tablet_manager.cc:1403] T edd7d470b5014c9489be7f41f64355c9 P e61c3a8f61bb48f8a963c9480e53c168: Time spent bootstrapping tablet: real 0.114s	user 0.018s	sys 0.021s
I20260709 13:04:09.585805 19601 raft_consensus.cc:740] T 86a6797bdfe94fa496c050ceae4bd0d9 P 0473d2b2d01f4459b1e90fd12cc7840e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0473d2b2d01f4459b1e90fd12cc7840e, State: Initialized, Role: FOLLOWER
I20260709 13:04:09.584961 19485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df751f992649444090e27965eb1af85d" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:04:09.586514 19601 consensus_queue.cc:260] T 86a6797bdfe94fa496c050ceae4bd0d9 P 0473d2b2d01f4459b1e90fd12cc7840e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:09.591773 19601 ts_tablet_manager.cc:1434] T 86a6797bdfe94fa496c050ceae4bd0d9 P 0473d2b2d01f4459b1e90fd12cc7840e: Time spent starting tablet: real 0.010s	user 0.008s	sys 0.000s
I20260709 13:04:09.592711 19600 raft_consensus.cc:359] T edd7d470b5014c9489be7f41f64355c9 P e61c3a8f61bb48f8a963c9480e53c168 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:09.593233 19600 raft_consensus.cc:385] T edd7d470b5014c9489be7f41f64355c9 P e61c3a8f61bb48f8a963c9480e53c168 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:09.593448 19600 raft_consensus.cc:740] T edd7d470b5014c9489be7f41f64355c9 P e61c3a8f61bb48f8a963c9480e53c168 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e61c3a8f61bb48f8a963c9480e53c168, State: Initialized, Role: FOLLOWER
I20260709 13:04:09.593927 19600 consensus_queue.cc:260] T edd7d470b5014c9489be7f41f64355c9 P e61c3a8f61bb48f8a963c9480e53c168 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:09.594848 19601 tablet_bootstrap.cc:492] T edd7d470b5014c9489be7f41f64355c9 P 0473d2b2d01f4459b1e90fd12cc7840e: Bootstrap starting.
I20260709 13:04:09.597429 19600 ts_tablet_manager.cc:1434] T edd7d470b5014c9489be7f41f64355c9 P e61c3a8f61bb48f8a963c9480e53c168: Time spent starting tablet: real 0.011s	user 0.002s	sys 0.003s
I20260709 13:04:09.597956 19604 tablet_bootstrap.cc:654] T ff75a1d4cb1f493db8f71ddc136ba9ab P e5256d91808b47c195bc9b4dbd7f2b87: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:09.599058 19600 tablet_bootstrap.cc:492] T 62c6c134d3d24a1ab144dd9ee6bc3f64 P e61c3a8f61bb48f8a963c9480e53c168: Bootstrap starting.
W20260709 13:04:09.597923 19526 leader_election.cc:343] T df751f992649444090e27965eb1af85d P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:09.600471 19769 raft_consensus.cc:493] T 86a6797bdfe94fa496c050ceae4bd0d9 P 0473d2b2d01f4459b1e90fd12cc7840e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:09.596928 19647 raft_consensus.cc:493] T b9f0d59553ad444883fcf5b5909f9798 P 0473d2b2d01f4459b1e90fd12cc7840e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:09.597568 19407 raft_consensus.cc:3060] T 1a61655d99124a29b486ba4a5b37faea P e5256d91808b47c195bc9b4dbd7f2b87 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:09.601157 19375 leader_election.cc:304] T 6c5eebf646ad445a9d1b1adc319d7b16 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:04:09.605489 19685 raft_consensus.cc:2749] T 6c5eebf646ad445a9d1b1adc319d7b16 P e5256d91808b47c195bc9b4dbd7f2b87 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:04:09.606884 19409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df751f992649444090e27965eb1af85d" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:04:09.600935 19769 raft_consensus.cc:515] T 86a6797bdfe94fa496c050ceae4bd0d9 P 0473d2b2d01f4459b1e90fd12cc7840e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:09.609334 19769 leader_election.cc:290] T 86a6797bdfe94fa496c050ceae4bd0d9 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:04:09.611367 19558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86a6797bdfe94fa496c050ceae4bd0d9" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:04:09.612082 19558 raft_consensus.cc:2393] T 86a6797bdfe94fa496c050ceae4bd0d9 P e61c3a8f61bb48f8a963c9480e53c168 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0473d2b2d01f4459b1e90fd12cc7840e in current term 1: Already voted for candidate e5256d91808b47c195bc9b4dbd7f2b87 in this term.
I20260709 13:04:09.612851 19409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86a6797bdfe94fa496c050ceae4bd0d9" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:04:09.606195 19647 raft_consensus.cc:515] T b9f0d59553ad444883fcf5b5909f9798 P 0473d2b2d01f4459b1e90fd12cc7840e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:09.614439 19449 leader_election.cc:304] T 86a6797bdfe94fa496c050ceae4bd0d9 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e; no voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:04:09.614355 19307 catalog_manager.cc:5697] T a08760e15aac4630a629431f56024dc8 P e61c3a8f61bb48f8a963c9480e53c168 reported cstate change: term changed from 0 to 1, leader changed from <none> to e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3). New cstate: current_term: 1 leader_uuid: "e61c3a8f61bb48f8a963c9480e53c168" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } health_report { overall_health: HEALTHY } } }
W20260709 13:04:09.615352 19523 leader_election.cc:343] T df751f992649444090e27965eb1af85d P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:09.615885 19523 leader_election.cc:304] T df751f992649444090e27965eb1af85d P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e61c3a8f61bb48f8a963c9480e53c168; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:04:09.637669 19687 raft_consensus.cc:2749] T df751f992649444090e27965eb1af85d P e61c3a8f61bb48f8a963c9480e53c168 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:04:09.622745 19757 consensus_queue.cc:1048] T 0cdf56e38bbc453d9438d359e5a69955 P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.016s
I20260709 13:04:09.618299 19647 leader_election.cc:290] T b9f0d59553ad444883fcf5b5909f9798 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:04:09.650472 19601 tablet_bootstrap.cc:654] T edd7d470b5014c9489be7f41f64355c9 P 0473d2b2d01f4459b1e90fd12cc7840e: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:09.615692 19769 raft_consensus.cc:3060] T 86a6797bdfe94fa496c050ceae4bd0d9 P 0473d2b2d01f4459b1e90fd12cc7840e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:09.623126 19558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9f0d59553ad444883fcf5b5909f9798" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:04:09.667389 19409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9f0d59553ad444883fcf5b5909f9798" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:04:09.660280 19558 raft_consensus.cc:2468] T b9f0d59553ad444883fcf5b5909f9798 P e61c3a8f61bb48f8a963c9480e53c168 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 0.
I20260709 13:04:09.688515 19600 tablet_bootstrap.cc:654] T 62c6c134d3d24a1ab144dd9ee6bc3f64 P e61c3a8f61bb48f8a963c9480e53c168: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:09.700346 19604 tablet_bootstrap.cc:492] T ff75a1d4cb1f493db8f71ddc136ba9ab P e5256d91808b47c195bc9b4dbd7f2b87: No bootstrap required, opened a new log
I20260709 13:04:09.700832 19604 ts_tablet_manager.cc:1403] T ff75a1d4cb1f493db8f71ddc136ba9ab P e5256d91808b47c195bc9b4dbd7f2b87: Time spent bootstrapping tablet: real 0.173s	user 0.021s	sys 0.008s
I20260709 13:04:09.720460 19769 raft_consensus.cc:2749] T 86a6797bdfe94fa496c050ceae4bd0d9 P 0473d2b2d01f4459b1e90fd12cc7840e [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:04:09.710904 19449 leader_election.cc:343] T b9f0d59553ad444883fcf5b5909f9798 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:09.735231 19450 leader_election.cc:304] T b9f0d59553ad444883fcf5b5909f9798 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168; no voters: e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:04:09.737793 19611 raft_consensus.cc:2804] T b9f0d59553ad444883fcf5b5909f9798 P 0473d2b2d01f4459b1e90fd12cc7840e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:09.738272 19611 raft_consensus.cc:493] T b9f0d59553ad444883fcf5b5909f9798 P 0473d2b2d01f4459b1e90fd12cc7840e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:09.738682 19611 raft_consensus.cc:3060] T b9f0d59553ad444883fcf5b5909f9798 P 0473d2b2d01f4459b1e90fd12cc7840e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:09.750445 19813 raft_consensus.cc:493] T b08304a0a02b42d7840c4e8ee9a6bd1a P 0473d2b2d01f4459b1e90fd12cc7840e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:09.754129 19760 consensus_queue.cc:1048] T 3e1f505cb0f1427bbd698ac889d80821 P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:09.755203 19601 tablet_bootstrap.cc:492] T edd7d470b5014c9489be7f41f64355c9 P 0473d2b2d01f4459b1e90fd12cc7840e: No bootstrap required, opened a new log
I20260709 13:04:09.755649 19601 ts_tablet_manager.cc:1403] T edd7d470b5014c9489be7f41f64355c9 P 0473d2b2d01f4459b1e90fd12cc7840e: Time spent bootstrapping tablet: real 0.163s	user 0.022s	sys 0.000s
I20260709 13:04:09.758136 19687 raft_consensus.cc:493] T edd7d470b5014c9489be7f41f64355c9 P e61c3a8f61bb48f8a963c9480e53c168 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:09.758256 19601 raft_consensus.cc:359] T edd7d470b5014c9489be7f41f64355c9 P 0473d2b2d01f4459b1e90fd12cc7840e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:09.759013 19601 raft_consensus.cc:385] T edd7d470b5014c9489be7f41f64355c9 P 0473d2b2d01f4459b1e90fd12cc7840e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:09.759310 19601 raft_consensus.cc:740] T edd7d470b5014c9489be7f41f64355c9 P 0473d2b2d01f4459b1e90fd12cc7840e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0473d2b2d01f4459b1e90fd12cc7840e, State: Initialized, Role: FOLLOWER
I20260709 13:04:09.758662 19687 raft_consensus.cc:515] T edd7d470b5014c9489be7f41f64355c9 P e61c3a8f61bb48f8a963c9480e53c168 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:09.759922 19601 consensus_queue.cc:260] T edd7d470b5014c9489be7f41f64355c9 P 0473d2b2d01f4459b1e90fd12cc7840e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:09.761610 19687 leader_election.cc:290] T edd7d470b5014c9489be7f41f64355c9 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:04:09.761945 19601 ts_tablet_manager.cc:1434] T edd7d470b5014c9489be7f41f64355c9 P 0473d2b2d01f4459b1e90fd12cc7840e: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
I20260709 13:04:09.761801 19604 raft_consensus.cc:359] T ff75a1d4cb1f493db8f71ddc136ba9ab P e5256d91808b47c195bc9b4dbd7f2b87 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:09.762480 19604 raft_consensus.cc:385] T ff75a1d4cb1f493db8f71ddc136ba9ab P e5256d91808b47c195bc9b4dbd7f2b87 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:09.762768 19604 raft_consensus.cc:740] T ff75a1d4cb1f493db8f71ddc136ba9ab P e5256d91808b47c195bc9b4dbd7f2b87 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e5256d91808b47c195bc9b4dbd7f2b87, State: Initialized, Role: FOLLOWER
I20260709 13:04:09.763427 19604 consensus_queue.cc:260] T ff75a1d4cb1f493db8f71ddc136ba9ab P e5256d91808b47c195bc9b4dbd7f2b87 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:09.764001 19484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edd7d470b5014c9489be7f41f64355c9" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:04:09.764207 19820 consensus_queue.cc:1048] T 0cdf56e38bbc453d9438d359e5a69955 P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:09.764588 19484 raft_consensus.cc:2468] T edd7d470b5014c9489be7f41f64355c9 P 0473d2b2d01f4459b1e90fd12cc7840e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 0.
I20260709 13:04:09.765604 19601 tablet_bootstrap.cc:492] T 172b3dd13109415a955b71ac0e9d2234 P 0473d2b2d01f4459b1e90fd12cc7840e: Bootstrap starting.
I20260709 13:04:09.760368 19813 raft_consensus.cc:515] T b08304a0a02b42d7840c4e8ee9a6bd1a P 0473d2b2d01f4459b1e90fd12cc7840e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:09.770572 19813 leader_election.cc:290] T b08304a0a02b42d7840c4e8ee9a6bd1a P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:04:09.768746 19526 leader_election.cc:304] T edd7d470b5014c9489be7f41f64355c9 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:04:09.774937 19560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b08304a0a02b42d7840c4e8ee9a6bd1a" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:04:09.775609 19560 raft_consensus.cc:2468] T b08304a0a02b42d7840c4e8ee9a6bd1a P e61c3a8f61bb48f8a963c9480e53c168 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 0.
I20260709 13:04:09.773901 19687 raft_consensus.cc:2804] T edd7d470b5014c9489be7f41f64355c9 P e61c3a8f61bb48f8a963c9480e53c168 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:09.776551 19687 raft_consensus.cc:493] T edd7d470b5014c9489be7f41f64355c9 P e61c3a8f61bb48f8a963c9480e53c168 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:09.776913 19687 raft_consensus.cc:3060] T edd7d470b5014c9489be7f41f64355c9 P e61c3a8f61bb48f8a963c9480e53c168 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:09.776719 19611 raft_consensus.cc:515] T b9f0d59553ad444883fcf5b5909f9798 P 0473d2b2d01f4459b1e90fd12cc7840e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:09.777377 19411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b08304a0a02b42d7840c4e8ee9a6bd1a" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:04:09.779821 19769 raft_consensus.cc:493] T 7f575b143b844aa096b50997dad3516a P 0473d2b2d01f4459b1e90fd12cc7840e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:09.780277 19769 raft_consensus.cc:515] T 7f575b143b844aa096b50997dad3516a P 0473d2b2d01f4459b1e90fd12cc7840e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:09.781049 19604 ts_tablet_manager.cc:1434] T ff75a1d4cb1f493db8f71ddc136ba9ab P e5256d91808b47c195bc9b4dbd7f2b87: Time spent starting tablet: real 0.080s	user 0.007s	sys 0.002s
I20260709 13:04:09.784129 19600 tablet_bootstrap.cc:492] T 62c6c134d3d24a1ab144dd9ee6bc3f64 P e61c3a8f61bb48f8a963c9480e53c168: No bootstrap required, opened a new log
I20260709 13:04:09.784567 19600 ts_tablet_manager.cc:1403] T 62c6c134d3d24a1ab144dd9ee6bc3f64 P e61c3a8f61bb48f8a963c9480e53c168: Time spent bootstrapping tablet: real 0.186s	user 0.011s	sys 0.006s
I20260709 13:04:09.786129 19769 leader_election.cc:290] T 7f575b143b844aa096b50997dad3516a P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:04:09.788205 19604 tablet_bootstrap.cc:492] T f93ee515a9c14139bf566522ed8232f3 P e5256d91808b47c195bc9b4dbd7f2b87: Bootstrap starting.
I20260709 13:04:09.795174 19600 raft_consensus.cc:359] T 62c6c134d3d24a1ab144dd9ee6bc3f64 P e61c3a8f61bb48f8a963c9480e53c168 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:09.795974 19600 raft_consensus.cc:385] T 62c6c134d3d24a1ab144dd9ee6bc3f64 P e61c3a8f61bb48f8a963c9480e53c168 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:09.796732 19411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edd7d470b5014c9489be7f41f64355c9" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:04:09.797286 19410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9f0d59553ad444883fcf5b5909f9798" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
I20260709 13:04:09.797663 19684 raft_consensus.cc:493] T 7f575b143b844aa096b50997dad3516a P e61c3a8f61bb48f8a963c9480e53c168 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:09.798128 19684 raft_consensus.cc:515] T 7f575b143b844aa096b50997dad3516a P e61c3a8f61bb48f8a963c9480e53c168 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:09.799127 19410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f575b143b844aa096b50997dad3516a" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
W20260709 13:04:09.799763 19523 leader_election.cc:343] T edd7d470b5014c9489be7f41f64355c9 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:09.800503 19684 leader_election.cc:290] T 7f575b143b844aa096b50997dad3516a P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:04:09.786293 19687 raft_consensus.cc:515] T edd7d470b5014c9489be7f41f64355c9 P e61c3a8f61bb48f8a963c9480e53c168 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:09.802177 19410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f575b143b844aa096b50997dad3516a" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:04:09.803318 19557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f575b143b844aa096b50997dad3516a" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:04:09.803905 19557 raft_consensus.cc:2468] T 7f575b143b844aa096b50997dad3516a P e61c3a8f61bb48f8a963c9480e53c168 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 0.
W20260709 13:04:09.804086 19523 leader_election.cc:343] T 7f575b143b844aa096b50997dad3516a P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:09.804677 19685 consensus_queue.cc:1048] T 86a6797bdfe94fa496c050ceae4bd0d9 P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:04:09.796249 19600 raft_consensus.cc:740] T 62c6c134d3d24a1ab144dd9ee6bc3f64 P e61c3a8f61bb48f8a963c9480e53c168 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e61c3a8f61bb48f8a963c9480e53c168, State: Initialized, Role: FOLLOWER
I20260709 13:04:09.808470 19600 consensus_queue.cc:260] T 62c6c134d3d24a1ab144dd9ee6bc3f64 P e61c3a8f61bb48f8a963c9480e53c168 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:09.814379 19600 ts_tablet_manager.cc:1434] T 62c6c134d3d24a1ab144dd9ee6bc3f64 P e61c3a8f61bb48f8a963c9480e53c168: Time spent starting tablet: real 0.030s	user 0.006s	sys 0.003s
I20260709 13:04:09.815723 19600 tablet_bootstrap.cc:492] T bc225c93219c45538b53a1bd3d387e4d P e61c3a8f61bb48f8a963c9480e53c168: Bootstrap starting.
W20260709 13:04:09.796732 19449 leader_election.cc:343] T b08304a0a02b42d7840c4e8ee9a6bd1a P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:04:09.834079 19449 leader_election.cc:343] T b9f0d59553ad444883fcf5b5909f9798 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:09.834755 19483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f575b143b844aa096b50997dad3516a" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:04:09.834991 19410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edd7d470b5014c9489be7f41f64355c9" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
I20260709 13:04:09.835410 19483 raft_consensus.cc:2468] T 7f575b143b844aa096b50997dad3516a P 0473d2b2d01f4459b1e90fd12cc7840e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 0.
I20260709 13:04:09.836392 19486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edd7d470b5014c9489be7f41f64355c9" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:04:09.837013 19486 raft_consensus.cc:3060] T edd7d470b5014c9489be7f41f64355c9 P 0473d2b2d01f4459b1e90fd12cc7840e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:09.831415 19611 leader_election.cc:290] T b9f0d59553ad444883fcf5b5909f9798 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 1 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:04:09.824958 19687 leader_election.cc:290] T edd7d470b5014c9489be7f41f64355c9 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 1 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
W20260709 13:04:09.846101 19449 leader_election.cc:343] T 7f575b143b844aa096b50997dad3516a P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:09.861850 19526 leader_election.cc:304] T 7f575b143b844aa096b50997dad3516a P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168; no voters: e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:04:09.864177 19687 raft_consensus.cc:2804] T 7f575b143b844aa096b50997dad3516a P e61c3a8f61bb48f8a963c9480e53c168 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:09.864801 19687 raft_consensus.cc:493] T 7f575b143b844aa096b50997dad3516a P e61c3a8f61bb48f8a963c9480e53c168 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:09.865552 19687 raft_consensus.cc:3060] T 7f575b143b844aa096b50997dad3516a P e61c3a8f61bb48f8a963c9480e53c168 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:09.867051 19560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9f0d59553ad444883fcf5b5909f9798" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:04:09.868479 19560 raft_consensus.cc:3060] T b9f0d59553ad444883fcf5b5909f9798 P e61c3a8f61bb48f8a963c9480e53c168 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:09.873610 19486 raft_consensus.cc:2468] T edd7d470b5014c9489be7f41f64355c9 P 0473d2b2d01f4459b1e90fd12cc7840e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 1.
W20260709 13:04:09.865950 19523 leader_election.cc:343] T edd7d470b5014c9489be7f41f64355c9 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:09.876011 19526 leader_election.cc:304] T edd7d470b5014c9489be7f41f64355c9 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168; no voters: e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:04:09.877161 19684 raft_consensus.cc:2804] T edd7d470b5014c9489be7f41f64355c9 P e61c3a8f61bb48f8a963c9480e53c168 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:09.879194 19684 raft_consensus.cc:697] T edd7d470b5014c9489be7f41f64355c9 P e61c3a8f61bb48f8a963c9480e53c168 [term 1 LEADER]: Becoming Leader. State: Replica: e61c3a8f61bb48f8a963c9480e53c168, State: Running, Role: LEADER
I20260709 13:04:09.883363 19684 consensus_queue.cc:237] T edd7d470b5014c9489be7f41f64355c9 P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:09.886876 19600 tablet_bootstrap.cc:654] T bc225c93219c45538b53a1bd3d387e4d P e61c3a8f61bb48f8a963c9480e53c168: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:09.883339 19687 raft_consensus.cc:515] T 7f575b143b844aa096b50997dad3516a P e61c3a8f61bb48f8a963c9480e53c168 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:09.891112 19604 tablet_bootstrap.cc:654] T f93ee515a9c14139bf566522ed8232f3 P e5256d91808b47c195bc9b4dbd7f2b87: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:09.894066 19687 leader_election.cc:290] T 7f575b143b844aa096b50997dad3516a P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 1 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:04:09.895380 19485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f575b143b844aa096b50997dad3516a" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:04:09.895985 19485 raft_consensus.cc:3060] T 7f575b143b844aa096b50997dad3516a P 0473d2b2d01f4459b1e90fd12cc7840e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:09.896328 19808 raft_consensus.cc:493] T 62c6c134d3d24a1ab144dd9ee6bc3f64 P e61c3a8f61bb48f8a963c9480e53c168 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:09.894483 19407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f575b143b844aa096b50997dad3516a" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
I20260709 13:04:09.896747 19808 raft_consensus.cc:515] T 62c6c134d3d24a1ab144dd9ee6bc3f64 P e61c3a8f61bb48f8a963c9480e53c168 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
W20260709 13:04:09.897884 19523 leader_election.cc:343] T 7f575b143b844aa096b50997dad3516a P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:09.899128 19808 leader_election.cc:290] T 62c6c134d3d24a1ab144dd9ee6bc3f64 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:04:09.902887 19450 leader_election.cc:304] T b08304a0a02b42d7840c4e8ee9a6bd1a P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168; no voters: e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:04:09.903923 19820 raft_consensus.cc:2804] T b08304a0a02b42d7840c4e8ee9a6bd1a P 0473d2b2d01f4459b1e90fd12cc7840e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:09.904147 19450 leader_election.cc:304] T 7f575b143b844aa096b50997dad3516a P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168; no voters: e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:04:09.904299 19820 raft_consensus.cc:493] T b08304a0a02b42d7840c4e8ee9a6bd1a P 0473d2b2d01f4459b1e90fd12cc7840e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:09.905853 19820 raft_consensus.cc:3060] T b08304a0a02b42d7840c4e8ee9a6bd1a P 0473d2b2d01f4459b1e90fd12cc7840e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:09.910781 19407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62c6c134d3d24a1ab144dd9ee6bc3f64" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
W20260709 13:04:09.912379 19523 leader_election.cc:343] T 62c6c134d3d24a1ab144dd9ee6bc3f64 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:09.906147 19633 consensus_queue.cc:1048] T 86a6797bdfe94fa496c050ceae4bd0d9 P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 13:04:09.914659 19485 raft_consensus.cc:2468] T 7f575b143b844aa096b50997dad3516a P 0473d2b2d01f4459b1e90fd12cc7840e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 1.
I20260709 13:04:09.915184 19813 raft_consensus.cc:2764] T 7f575b143b844aa096b50997dad3516a P 0473d2b2d01f4459b1e90fd12cc7840e [term 1 FOLLOWER]: Leader pre-election decision vote started in defunct term 0: won
I20260709 13:04:09.924136 19601 tablet_bootstrap.cc:654] T 172b3dd13109415a955b71ac0e9d2234 P 0473d2b2d01f4459b1e90fd12cc7840e: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:09.906661 19560 raft_consensus.cc:2468] T b9f0d59553ad444883fcf5b5909f9798 P e61c3a8f61bb48f8a963c9480e53c168 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 1.
I20260709 13:04:09.925427 19483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62c6c134d3d24a1ab144dd9ee6bc3f64" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:04:09.928920 19820 raft_consensus.cc:515] T b08304a0a02b42d7840c4e8ee9a6bd1a P 0473d2b2d01f4459b1e90fd12cc7840e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:09.938237 19600 tablet_bootstrap.cc:492] T bc225c93219c45538b53a1bd3d387e4d P e61c3a8f61bb48f8a963c9480e53c168: No bootstrap required, opened a new log
I20260709 13:04:09.939131 19526 leader_election.cc:304] T 7f575b143b844aa096b50997dad3516a P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168; no voters: e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:04:09.941208 19600 ts_tablet_manager.cc:1403] T bc225c93219c45538b53a1bd3d387e4d P e61c3a8f61bb48f8a963c9480e53c168: Time spent bootstrapping tablet: real 0.126s	user 0.013s	sys 0.011s
I20260709 13:04:09.941556 19309 catalog_manager.cc:5697] T edd7d470b5014c9489be7f41f64355c9 P e61c3a8f61bb48f8a963c9480e53c168 reported cstate change: term changed from 0 to 1, leader changed from <none> to e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3). New cstate: current_term: 1 leader_uuid: "e61c3a8f61bb48f8a963c9480e53c168" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } health_report { overall_health: HEALTHY } } }
I20260709 13:04:09.943799 19450 leader_election.cc:304] T b9f0d59553ad444883fcf5b5909f9798 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168; no voters: e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:04:09.947554 19813 raft_consensus.cc:2804] T b9f0d59553ad444883fcf5b5909f9798 P 0473d2b2d01f4459b1e90fd12cc7840e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:09.955905 19813 raft_consensus.cc:697] T b9f0d59553ad444883fcf5b5909f9798 P 0473d2b2d01f4459b1e90fd12cc7840e [term 1 LEADER]: Becoming Leader. State: Replica: 0473d2b2d01f4459b1e90fd12cc7840e, State: Running, Role: LEADER
I20260709 13:04:09.956758 19813 consensus_queue.cc:237] T b9f0d59553ad444883fcf5b5909f9798 P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:09.958361 19600 raft_consensus.cc:359] T bc225c93219c45538b53a1bd3d387e4d P e61c3a8f61bb48f8a963c9480e53c168 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:09.959082 19600 raft_consensus.cc:385] T bc225c93219c45538b53a1bd3d387e4d P e61c3a8f61bb48f8a963c9480e53c168 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:09.959332 19600 raft_consensus.cc:740] T bc225c93219c45538b53a1bd3d387e4d P e61c3a8f61bb48f8a963c9480e53c168 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e61c3a8f61bb48f8a963c9480e53c168, State: Initialized, Role: FOLLOWER
I20260709 13:04:09.959987 19600 consensus_queue.cc:260] T bc225c93219c45538b53a1bd3d387e4d P e61c3a8f61bb48f8a963c9480e53c168 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:09.964984 19820 leader_election.cc:290] T b08304a0a02b42d7840c4e8ee9a6bd1a P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 1 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
W20260709 13:04:09.965235 19526 leader_election.cc:343] T 62c6c134d3d24a1ab144dd9ee6bc3f64 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:09.965763 19526 leader_election.cc:304] T 62c6c134d3d24a1ab144dd9ee6bc3f64 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e61c3a8f61bb48f8a963c9480e53c168; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:04:09.968482 19630 raft_consensus.cc:2749] T 62c6c134d3d24a1ab144dd9ee6bc3f64 P e61c3a8f61bb48f8a963c9480e53c168 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:04:09.972895 19557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b08304a0a02b42d7840c4e8ee9a6bd1a" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:04:09.977277 19557 raft_consensus.cc:3060] T b08304a0a02b42d7840c4e8ee9a6bd1a P e61c3a8f61bb48f8a963c9480e53c168 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:09.948704 19684 raft_consensus.cc:2804] T 7f575b143b844aa096b50997dad3516a P e61c3a8f61bb48f8a963c9480e53c168 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:10.023733 19820 raft_consensus.cc:493] T ff75a1d4cb1f493db8f71ddc136ba9ab P 0473d2b2d01f4459b1e90fd12cc7840e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:10.033034 19600 ts_tablet_manager.cc:1434] T bc225c93219c45538b53a1bd3d387e4d P e61c3a8f61bb48f8a963c9480e53c168: Time spent starting tablet: real 0.091s	user 0.005s	sys 0.000s
I20260709 13:04:10.037009 19600 tablet_bootstrap.cc:492] T 9962423cb4e54fcfa5de01daf68a86e7 P e61c3a8f61bb48f8a963c9480e53c168: Bootstrap starting.
I20260709 13:04:09.998525 19557 raft_consensus.cc:2468] T b08304a0a02b42d7840c4e8ee9a6bd1a P e61c3a8f61bb48f8a963c9480e53c168 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 1.
I20260709 13:04:10.036823 19820 raft_consensus.cc:515] T ff75a1d4cb1f493db8f71ddc136ba9ab P 0473d2b2d01f4459b1e90fd12cc7840e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:10.042798 19450 leader_election.cc:304] T b08304a0a02b42d7840c4e8ee9a6bd1a P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:04:10.043584 19817 raft_consensus.cc:2804] T b08304a0a02b42d7840c4e8ee9a6bd1a P 0473d2b2d01f4459b1e90fd12cc7840e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:10.044060 19817 raft_consensus.cc:697] T b08304a0a02b42d7840c4e8ee9a6bd1a P 0473d2b2d01f4459b1e90fd12cc7840e [term 1 LEADER]: Becoming Leader. State: Replica: 0473d2b2d01f4459b1e90fd12cc7840e, State: Running, Role: LEADER
I20260709 13:04:10.045248 19820 leader_election.cc:290] T ff75a1d4cb1f493db8f71ddc136ba9ab P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:04:10.036878 19684 raft_consensus.cc:697] T 7f575b143b844aa096b50997dad3516a P e61c3a8f61bb48f8a963c9480e53c168 [term 1 LEADER]: Becoming Leader. State: Replica: e61c3a8f61bb48f8a963c9480e53c168, State: Running, Role: LEADER
I20260709 13:04:10.046274 19684 consensus_queue.cc:237] T 7f575b143b844aa096b50997dad3516a P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:10.046499 19808 consensus_queue.cc:1048] T a08760e15aac4630a629431f56024dc8 P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:04:10.048930 19817 consensus_queue.cc:237] T b08304a0a02b42d7840c4e8ee9a6bd1a P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:10.038586 19407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b08304a0a02b42d7840c4e8ee9a6bd1a" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
I20260709 13:04:10.053570 19604 tablet_bootstrap.cc:492] T f93ee515a9c14139bf566522ed8232f3 P e5256d91808b47c195bc9b4dbd7f2b87: No bootstrap required, opened a new log
I20260709 13:04:10.054200 19604 ts_tablet_manager.cc:1403] T f93ee515a9c14139bf566522ed8232f3 P e5256d91808b47c195bc9b4dbd7f2b87: Time spent bootstrapping tablet: real 0.266s	user 0.014s	sys 0.013s
I20260709 13:04:10.068936 19604 raft_consensus.cc:359] T f93ee515a9c14139bf566522ed8232f3 P e5256d91808b47c195bc9b4dbd7f2b87 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:10.069257 19557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff75a1d4cb1f493db8f71ddc136ba9ab" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:04:10.069697 19604 raft_consensus.cc:385] T f93ee515a9c14139bf566522ed8232f3 P e5256d91808b47c195bc9b4dbd7f2b87 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:10.073364 19604 raft_consensus.cc:740] T f93ee515a9c14139bf566522ed8232f3 P e5256d91808b47c195bc9b4dbd7f2b87 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e5256d91808b47c195bc9b4dbd7f2b87, State: Initialized, Role: FOLLOWER
W20260709 13:04:10.072005 19450 leader_election.cc:343] T ff75a1d4cb1f493db8f71ddc136ba9ab P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:10.072536 19306 catalog_manager.cc:5697] T b9f0d59553ad444883fcf5b5909f9798 P 0473d2b2d01f4459b1e90fd12cc7840e reported cstate change: term changed from 0 to 1, leader changed from <none> to 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2). New cstate: current_term: 1 leader_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:10.079826 19604 consensus_queue.cc:260] T f93ee515a9c14139bf566522ed8232f3 P e5256d91808b47c195bc9b4dbd7f2b87 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:10.085924 19604 ts_tablet_manager.cc:1434] T f93ee515a9c14139bf566522ed8232f3 P e5256d91808b47c195bc9b4dbd7f2b87: Time spent starting tablet: real 0.031s	user 0.007s	sys 0.002s
I20260709 13:04:10.090445 19604 tablet_bootstrap.cc:492] T 7f575b143b844aa096b50997dad3516a P e5256d91808b47c195bc9b4dbd7f2b87: Bootstrap starting.
I20260709 13:04:10.074919 19630 consensus_queue.cc:1048] T a08760e15aac4630a629431f56024dc8 P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.021s
W20260709 13:04:10.096099 19449 leader_election.cc:343] T b08304a0a02b42d7840c4e8ee9a6bd1a P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:10.098098 19601 tablet_bootstrap.cc:492] T 172b3dd13109415a955b71ac0e9d2234 P 0473d2b2d01f4459b1e90fd12cc7840e: No bootstrap required, opened a new log
I20260709 13:04:10.098593 19601 ts_tablet_manager.cc:1403] T 172b3dd13109415a955b71ac0e9d2234 P 0473d2b2d01f4459b1e90fd12cc7840e: Time spent bootstrapping tablet: real 0.336s	user 0.012s	sys 0.021s
I20260709 13:04:10.105366 19604 tablet_bootstrap.cc:654] T 7f575b143b844aa096b50997dad3516a P e5256d91808b47c195bc9b4dbd7f2b87: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:10.109313 19601 raft_consensus.cc:359] T 172b3dd13109415a955b71ac0e9d2234 P 0473d2b2d01f4459b1e90fd12cc7840e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:10.119470 19601 raft_consensus.cc:385] T 172b3dd13109415a955b71ac0e9d2234 P 0473d2b2d01f4459b1e90fd12cc7840e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:10.119937 19601 raft_consensus.cc:740] T 172b3dd13109415a955b71ac0e9d2234 P 0473d2b2d01f4459b1e90fd12cc7840e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0473d2b2d01f4459b1e90fd12cc7840e, State: Initialized, Role: FOLLOWER
I20260709 13:04:10.120873 19410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff75a1d4cb1f493db8f71ddc136ba9ab" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:04:10.120566 19306 catalog_manager.cc:5697] T b08304a0a02b42d7840c4e8ee9a6bd1a P 0473d2b2d01f4459b1e90fd12cc7840e reported cstate change: term changed from 0 to 1, leader changed from <none> to 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2). New cstate: current_term: 1 leader_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:10.121482 19410 raft_consensus.cc:2468] T ff75a1d4cb1f493db8f71ddc136ba9ab P e5256d91808b47c195bc9b4dbd7f2b87 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 0.
I20260709 13:04:10.122547 19601 consensus_queue.cc:260] T 172b3dd13109415a955b71ac0e9d2234 P 0473d2b2d01f4459b1e90fd12cc7840e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:10.124614 19601 ts_tablet_manager.cc:1434] T 172b3dd13109415a955b71ac0e9d2234 P 0473d2b2d01f4459b1e90fd12cc7840e: Time spent starting tablet: real 0.026s	user 0.006s	sys 0.000s
I20260709 13:04:10.125522 19601 tablet_bootstrap.cc:492] T f93ee515a9c14139bf566522ed8232f3 P 0473d2b2d01f4459b1e90fd12cc7840e: Bootstrap starting.
W20260709 13:04:10.119084 19828 log.cc:927] Time spent T 86a6797bdfe94fa496c050ceae4bd0d9 P 0473d2b2d01f4459b1e90fd12cc7840e: Append to log took a long time: real 0.083s	user 0.000s	sys 0.001s
I20260709 13:04:10.134821 19307 catalog_manager.cc:5697] T 7f575b143b844aa096b50997dad3516a P e61c3a8f61bb48f8a963c9480e53c168 reported cstate change: term changed from 0 to 1, leader changed from <none> to e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3). New cstate: current_term: 1 leader_uuid: "e61c3a8f61bb48f8a963c9480e53c168" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } health_report { overall_health: HEALTHY } } }
I20260709 13:04:10.140672 19600 tablet_bootstrap.cc:654] T 9962423cb4e54fcfa5de01daf68a86e7 P e61c3a8f61bb48f8a963c9480e53c168: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:10.141919 19449 leader_election.cc:304] T ff75a1d4cb1f493db8f71ddc136ba9ab P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87; no voters: e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:04:10.145254 19817 raft_consensus.cc:2804] T ff75a1d4cb1f493db8f71ddc136ba9ab P 0473d2b2d01f4459b1e90fd12cc7840e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:10.145639 19817 raft_consensus.cc:493] T ff75a1d4cb1f493db8f71ddc136ba9ab P 0473d2b2d01f4459b1e90fd12cc7840e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:10.146011 19817 raft_consensus.cc:3060] T ff75a1d4cb1f493db8f71ddc136ba9ab P 0473d2b2d01f4459b1e90fd12cc7840e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:10.157279 19601 tablet_bootstrap.cc:654] T f93ee515a9c14139bf566522ed8232f3 P 0473d2b2d01f4459b1e90fd12cc7840e: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:10.162802 19817 raft_consensus.cc:515] T ff75a1d4cb1f493db8f71ddc136ba9ab P 0473d2b2d01f4459b1e90fd12cc7840e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:10.167089 19410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff75a1d4cb1f493db8f71ddc136ba9ab" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
I20260709 13:04:10.167855 19410 raft_consensus.cc:3060] T ff75a1d4cb1f493db8f71ddc136ba9ab P e5256d91808b47c195bc9b4dbd7f2b87 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:10.171598 19604 tablet_bootstrap.cc:492] T 7f575b143b844aa096b50997dad3516a P e5256d91808b47c195bc9b4dbd7f2b87: No bootstrap required, opened a new log
I20260709 13:04:10.172144 19604 ts_tablet_manager.cc:1403] T 7f575b143b844aa096b50997dad3516a P e5256d91808b47c195bc9b4dbd7f2b87: Time spent bootstrapping tablet: real 0.082s	user 0.015s	sys 0.002s
I20260709 13:04:10.189306 19817 leader_election.cc:290] T ff75a1d4cb1f493db8f71ddc136ba9ab P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 1 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:04:10.194903 19557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff75a1d4cb1f493db8f71ddc136ba9ab" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:04:10.202749 19410 raft_consensus.cc:2468] T ff75a1d4cb1f493db8f71ddc136ba9ab P e5256d91808b47c195bc9b4dbd7f2b87 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 1.
W20260709 13:04:10.209308 19450 leader_election.cc:343] T ff75a1d4cb1f493db8f71ddc136ba9ab P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:10.222911 19604 raft_consensus.cc:359] T 7f575b143b844aa096b50997dad3516a P e5256d91808b47c195bc9b4dbd7f2b87 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:10.223721 19604 raft_consensus.cc:385] T 7f575b143b844aa096b50997dad3516a P e5256d91808b47c195bc9b4dbd7f2b87 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:10.224061 19604 raft_consensus.cc:740] T 7f575b143b844aa096b50997dad3516a P e5256d91808b47c195bc9b4dbd7f2b87 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e5256d91808b47c195bc9b4dbd7f2b87, State: Initialized, Role: FOLLOWER
I20260709 13:04:10.224889 19604 consensus_queue.cc:260] T 7f575b143b844aa096b50997dad3516a P e5256d91808b47c195bc9b4dbd7f2b87 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:10.226356 19600 tablet_bootstrap.cc:492] T 9962423cb4e54fcfa5de01daf68a86e7 P e61c3a8f61bb48f8a963c9480e53c168: No bootstrap required, opened a new log
I20260709 13:04:10.226811 19600 ts_tablet_manager.cc:1403] T 9962423cb4e54fcfa5de01daf68a86e7 P e61c3a8f61bb48f8a963c9480e53c168: Time spent bootstrapping tablet: real 0.190s	user 0.011s	sys 0.003s
I20260709 13:04:10.226972 19604 ts_tablet_manager.cc:1434] T 7f575b143b844aa096b50997dad3516a P e5256d91808b47c195bc9b4dbd7f2b87: Time spent starting tablet: real 0.055s	user 0.010s	sys 0.000s
I20260709 13:04:10.227933 19604 tablet_bootstrap.cc:492] T b08304a0a02b42d7840c4e8ee9a6bd1a P e5256d91808b47c195bc9b4dbd7f2b87: Bootstrap starting.
I20260709 13:04:10.232753 19600 raft_consensus.cc:359] T 9962423cb4e54fcfa5de01daf68a86e7 P e61c3a8f61bb48f8a963c9480e53c168 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:10.233573 19600 raft_consensus.cc:385] T 9962423cb4e54fcfa5de01daf68a86e7 P e61c3a8f61bb48f8a963c9480e53c168 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:10.233888 19600 raft_consensus.cc:740] T 9962423cb4e54fcfa5de01daf68a86e7 P e61c3a8f61bb48f8a963c9480e53c168 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e61c3a8f61bb48f8a963c9480e53c168, State: Initialized, Role: FOLLOWER
I20260709 13:04:10.234571 19600 consensus_queue.cc:260] T 9962423cb4e54fcfa5de01daf68a86e7 P e61c3a8f61bb48f8a963c9480e53c168 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:10.236624 19600 ts_tablet_manager.cc:1434] T 9962423cb4e54fcfa5de01daf68a86e7 P e61c3a8f61bb48f8a963c9480e53c168: Time spent starting tablet: real 0.010s	user 0.005s	sys 0.000s
I20260709 13:04:10.237532 19600 tablet_bootstrap.cc:492] T f93ee515a9c14139bf566522ed8232f3 P e61c3a8f61bb48f8a963c9480e53c168: Bootstrap starting.
I20260709 13:04:10.244478 19449 leader_election.cc:304] T ff75a1d4cb1f493db8f71ddc136ba9ab P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87; no voters: e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:04:10.244630 19817 raft_consensus.cc:493] T 172b3dd13109415a955b71ac0e9d2234 P 0473d2b2d01f4459b1e90fd12cc7840e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:10.250061 19817 raft_consensus.cc:515] T 172b3dd13109415a955b71ac0e9d2234 P 0473d2b2d01f4459b1e90fd12cc7840e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:10.252020 19600 tablet_bootstrap.cc:654] T f93ee515a9c14139bf566522ed8232f3 P e61c3a8f61bb48f8a963c9480e53c168: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:10.252102 19817 leader_election.cc:290] T 172b3dd13109415a955b71ac0e9d2234 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:04:10.253471 19601 tablet_bootstrap.cc:492] T f93ee515a9c14139bf566522ed8232f3 P 0473d2b2d01f4459b1e90fd12cc7840e: No bootstrap required, opened a new log
I20260709 13:04:10.253960 19601 ts_tablet_manager.cc:1403] T f93ee515a9c14139bf566522ed8232f3 P 0473d2b2d01f4459b1e90fd12cc7840e: Time spent bootstrapping tablet: real 0.129s	user 0.042s	sys 0.049s
I20260709 13:04:10.257216 19557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "172b3dd13109415a955b71ac0e9d2234" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:04:10.257835 19557 raft_consensus.cc:2468] T 172b3dd13109415a955b71ac0e9d2234 P e61c3a8f61bb48f8a963c9480e53c168 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 0.
I20260709 13:04:10.258386 19817 raft_consensus.cc:2804] T ff75a1d4cb1f493db8f71ddc136ba9ab P 0473d2b2d01f4459b1e90fd12cc7840e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:10.258940 19817 raft_consensus.cc:697] T ff75a1d4cb1f493db8f71ddc136ba9ab P 0473d2b2d01f4459b1e90fd12cc7840e [term 1 LEADER]: Becoming Leader. State: Replica: 0473d2b2d01f4459b1e90fd12cc7840e, State: Running, Role: LEADER
I20260709 13:04:10.259011 19450 leader_election.cc:304] T 172b3dd13109415a955b71ac0e9d2234 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:04:10.260398 19611 raft_consensus.cc:2804] T 172b3dd13109415a955b71ac0e9d2234 P 0473d2b2d01f4459b1e90fd12cc7840e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:10.260403 19601 raft_consensus.cc:359] T f93ee515a9c14139bf566522ed8232f3 P 0473d2b2d01f4459b1e90fd12cc7840e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:10.260433 19817 consensus_queue.cc:237] T ff75a1d4cb1f493db8f71ddc136ba9ab P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:10.261193 19611 raft_consensus.cc:493] T 172b3dd13109415a955b71ac0e9d2234 P 0473d2b2d01f4459b1e90fd12cc7840e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:10.261994 19611 raft_consensus.cc:3060] T 172b3dd13109415a955b71ac0e9d2234 P 0473d2b2d01f4459b1e90fd12cc7840e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:10.263329 19601 raft_consensus.cc:385] T f93ee515a9c14139bf566522ed8232f3 P 0473d2b2d01f4459b1e90fd12cc7840e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:10.263692 19601 raft_consensus.cc:740] T f93ee515a9c14139bf566522ed8232f3 P 0473d2b2d01f4459b1e90fd12cc7840e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0473d2b2d01f4459b1e90fd12cc7840e, State: Initialized, Role: FOLLOWER
I20260709 13:04:10.265079 19407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "172b3dd13109415a955b71ac0e9d2234" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:04:10.264662 19601 consensus_queue.cc:260] T f93ee515a9c14139bf566522ed8232f3 P 0473d2b2d01f4459b1e90fd12cc7840e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
W20260709 13:04:10.268802 19449 leader_election.cc:343] T 172b3dd13109415a955b71ac0e9d2234 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:10.269213 19604 tablet_bootstrap.cc:654] T b08304a0a02b42d7840c4e8ee9a6bd1a P e5256d91808b47c195bc9b4dbd7f2b87: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:10.271971 19611 raft_consensus.cc:515] T 172b3dd13109415a955b71ac0e9d2234 P 0473d2b2d01f4459b1e90fd12cc7840e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:10.287933 19309 catalog_manager.cc:5697] T ff75a1d4cb1f493db8f71ddc136ba9ab P 0473d2b2d01f4459b1e90fd12cc7840e reported cstate change: term changed from 0 to 1, leader changed from <none> to 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2). New cstate: current_term: 1 leader_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:10.283864 19808 raft_consensus.cc:493] T bc225c93219c45538b53a1bd3d387e4d P e61c3a8f61bb48f8a963c9480e53c168 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:10.291061 19557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "172b3dd13109415a955b71ac0e9d2234" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:04:10.291009 19808 raft_consensus.cc:515] T bc225c93219c45538b53a1bd3d387e4d P e61c3a8f61bb48f8a963c9480e53c168 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:10.291653 19557 raft_consensus.cc:3060] T 172b3dd13109415a955b71ac0e9d2234 P e61c3a8f61bb48f8a963c9480e53c168 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:10.276227 19601 ts_tablet_manager.cc:1434] T f93ee515a9c14139bf566522ed8232f3 P 0473d2b2d01f4459b1e90fd12cc7840e: Time spent starting tablet: real 0.022s	user 0.005s	sys 0.001s
I20260709 13:04:10.293071 19808 leader_election.cc:290] T bc225c93219c45538b53a1bd3d387e4d P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:04:10.294142 19601 tablet_bootstrap.cc:492] T 9962423cb4e54fcfa5de01daf68a86e7 P 0473d2b2d01f4459b1e90fd12cc7840e: Bootstrap starting.
I20260709 13:04:10.295990 19410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "172b3dd13109415a955b71ac0e9d2234" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
I20260709 13:04:10.300405 19483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc225c93219c45538b53a1bd3d387e4d" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
W20260709 13:04:10.301745 19449 leader_election.cc:343] T 172b3dd13109415a955b71ac0e9d2234 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:04:10.303289 19526 leader_election.cc:343] T bc225c93219c45538b53a1bd3d387e4d P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:10.304983 19407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc225c93219c45538b53a1bd3d387e4d" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
W20260709 13:04:10.306291 19523 leader_election.cc:343] T bc225c93219c45538b53a1bd3d387e4d P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:10.306738 19523 leader_election.cc:304] T bc225c93219c45538b53a1bd3d387e4d P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e61c3a8f61bb48f8a963c9480e53c168; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:04:10.307749 19808 raft_consensus.cc:2749] T bc225c93219c45538b53a1bd3d387e4d P e61c3a8f61bb48f8a963c9480e53c168 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:04:10.310657 19557 raft_consensus.cc:2468] T 172b3dd13109415a955b71ac0e9d2234 P e61c3a8f61bb48f8a963c9480e53c168 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 1.
I20260709 13:04:10.312213 19450 leader_election.cc:304] T 172b3dd13109415a955b71ac0e9d2234 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168; no voters: e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:04:10.312956 19814 raft_consensus.cc:2804] T 172b3dd13109415a955b71ac0e9d2234 P 0473d2b2d01f4459b1e90fd12cc7840e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:10.313455 19814 raft_consensus.cc:697] T 172b3dd13109415a955b71ac0e9d2234 P 0473d2b2d01f4459b1e90fd12cc7840e [term 1 LEADER]: Becoming Leader. State: Replica: 0473d2b2d01f4459b1e90fd12cc7840e, State: Running, Role: LEADER
I20260709 13:04:10.314314 19814 consensus_queue.cc:237] T 172b3dd13109415a955b71ac0e9d2234 P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:10.315002 19611 leader_election.cc:290] T 172b3dd13109415a955b71ac0e9d2234 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 1 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:04:10.317167 19601 tablet_bootstrap.cc:654] T 9962423cb4e54fcfa5de01daf68a86e7 P 0473d2b2d01f4459b1e90fd12cc7840e: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:10.322134 19604 tablet_bootstrap.cc:492] T b08304a0a02b42d7840c4e8ee9a6bd1a P e5256d91808b47c195bc9b4dbd7f2b87: No bootstrap required, opened a new log
I20260709 13:04:10.322749 19604 ts_tablet_manager.cc:1403] T b08304a0a02b42d7840c4e8ee9a6bd1a P e5256d91808b47c195bc9b4dbd7f2b87: Time spent bootstrapping tablet: real 0.095s	user 0.017s	sys 0.014s
I20260709 13:04:10.325748 19604 raft_consensus.cc:359] T b08304a0a02b42d7840c4e8ee9a6bd1a P e5256d91808b47c195bc9b4dbd7f2b87 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:10.326479 19604 raft_consensus.cc:385] T b08304a0a02b42d7840c4e8ee9a6bd1a P e5256d91808b47c195bc9b4dbd7f2b87 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:10.326776 19604 raft_consensus.cc:740] T b08304a0a02b42d7840c4e8ee9a6bd1a P e5256d91808b47c195bc9b4dbd7f2b87 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e5256d91808b47c195bc9b4dbd7f2b87, State: Initialized, Role: FOLLOWER
I20260709 13:04:10.327618 19600 tablet_bootstrap.cc:492] T f93ee515a9c14139bf566522ed8232f3 P e61c3a8f61bb48f8a963c9480e53c168: No bootstrap required, opened a new log
I20260709 13:04:10.327448 19604 consensus_queue.cc:260] T b08304a0a02b42d7840c4e8ee9a6bd1a P e5256d91808b47c195bc9b4dbd7f2b87 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:10.328241 19600 ts_tablet_manager.cc:1403] T f93ee515a9c14139bf566522ed8232f3 P e61c3a8f61bb48f8a963c9480e53c168: Time spent bootstrapping tablet: real 0.091s	user 0.016s	sys 0.007s
I20260709 13:04:10.331534 19600 raft_consensus.cc:359] T f93ee515a9c14139bf566522ed8232f3 P e61c3a8f61bb48f8a963c9480e53c168 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:10.334847 19600 raft_consensus.cc:385] T f93ee515a9c14139bf566522ed8232f3 P e61c3a8f61bb48f8a963c9480e53c168 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:10.335125 19600 raft_consensus.cc:740] T f93ee515a9c14139bf566522ed8232f3 P e61c3a8f61bb48f8a963c9480e53c168 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e61c3a8f61bb48f8a963c9480e53c168, State: Initialized, Role: FOLLOWER
I20260709 13:04:10.334429 19307 catalog_manager.cc:5697] T 172b3dd13109415a955b71ac0e9d2234 P 0473d2b2d01f4459b1e90fd12cc7840e reported cstate change: term changed from 0 to 1, leader changed from <none> to 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2). New cstate: current_term: 1 leader_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:10.337368 19601 tablet_bootstrap.cc:492] T 9962423cb4e54fcfa5de01daf68a86e7 P 0473d2b2d01f4459b1e90fd12cc7840e: No bootstrap required, opened a new log
I20260709 13:04:10.337855 19601 ts_tablet_manager.cc:1403] T 9962423cb4e54fcfa5de01daf68a86e7 P 0473d2b2d01f4459b1e90fd12cc7840e: Time spent bootstrapping tablet: real 0.044s	user 0.010s	sys 0.000s
I20260709 13:04:10.339022 19604 ts_tablet_manager.cc:1434] T b08304a0a02b42d7840c4e8ee9a6bd1a P e5256d91808b47c195bc9b4dbd7f2b87: Time spent starting tablet: real 0.016s	user 0.006s	sys 0.000s
I20260709 13:04:10.340556 19601 raft_consensus.cc:359] T 9962423cb4e54fcfa5de01daf68a86e7 P 0473d2b2d01f4459b1e90fd12cc7840e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:10.341190 19601 raft_consensus.cc:385] T 9962423cb4e54fcfa5de01daf68a86e7 P 0473d2b2d01f4459b1e90fd12cc7840e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:10.341451 19601 raft_consensus.cc:740] T 9962423cb4e54fcfa5de01daf68a86e7 P 0473d2b2d01f4459b1e90fd12cc7840e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0473d2b2d01f4459b1e90fd12cc7840e, State: Initialized, Role: FOLLOWER
I20260709 13:04:10.342555 19760 raft_consensus.cc:493] T f93ee515a9c14139bf566522ed8232f3 P e5256d91808b47c195bc9b4dbd7f2b87 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:10.342306 19600 consensus_queue.cc:260] T f93ee515a9c14139bf566522ed8232f3 P e61c3a8f61bb48f8a963c9480e53c168 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:10.343423 19760 raft_consensus.cc:515] T f93ee515a9c14139bf566522ed8232f3 P e5256d91808b47c195bc9b4dbd7f2b87 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:10.345043 19600 ts_tablet_manager.cc:1434] T f93ee515a9c14139bf566522ed8232f3 P e61c3a8f61bb48f8a963c9480e53c168: Time spent starting tablet: real 0.016s	user 0.002s	sys 0.002s
I20260709 13:04:10.345852 19600 tablet_bootstrap.cc:492] T ff75a1d4cb1f493db8f71ddc136ba9ab P e61c3a8f61bb48f8a963c9480e53c168: Bootstrap starting.
I20260709 13:04:10.346616 19760 leader_election.cc:290] T f93ee515a9c14139bf566522ed8232f3 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:04:10.346954 19557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f93ee515a9c14139bf566522ed8232f3" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:04:10.347543 19557 raft_consensus.cc:2468] T f93ee515a9c14139bf566522ed8232f3 P e61c3a8f61bb48f8a963c9480e53c168 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 0.
I20260709 13:04:10.348994 19482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f93ee515a9c14139bf566522ed8232f3" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:04:10.349156 19601 consensus_queue.cc:260] T 9962423cb4e54fcfa5de01daf68a86e7 P 0473d2b2d01f4459b1e90fd12cc7840e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:10.349596 19482 raft_consensus.cc:2468] T f93ee515a9c14139bf566522ed8232f3 P 0473d2b2d01f4459b1e90fd12cc7840e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 0.
I20260709 13:04:10.351536 19601 ts_tablet_manager.cc:1434] T 9962423cb4e54fcfa5de01daf68a86e7 P 0473d2b2d01f4459b1e90fd12cc7840e: Time spent starting tablet: real 0.013s	user 0.003s	sys 0.004s
I20260709 13:04:10.352421 19601 tablet_bootstrap.cc:492] T 0e1085d23e8347fbbd5bce7542f4b1f4 P 0473d2b2d01f4459b1e90fd12cc7840e: Bootstrap starting.
I20260709 13:04:10.353332 19604 tablet_bootstrap.cc:492] T 96efeaaf1057492490e9a621f37e1a2d P e5256d91808b47c195bc9b4dbd7f2b87: Bootstrap starting.
I20260709 13:04:10.354374 19375 leader_election.cc:304] T f93ee515a9c14139bf566522ed8232f3 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
W20260709 13:04:10.356894 19523 consensus_peers.cc:597] T edd7d470b5014c9489be7f41f64355c9 P e61c3a8f61bb48f8a963c9480e53c168 -> Peer e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321): Couldn't send request to peer e5256d91808b47c195bc9b4dbd7f2b87. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:10.357532 19760 raft_consensus.cc:2804] T f93ee515a9c14139bf566522ed8232f3 P e5256d91808b47c195bc9b4dbd7f2b87 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:10.357894 19760 raft_consensus.cc:493] T f93ee515a9c14139bf566522ed8232f3 P e5256d91808b47c195bc9b4dbd7f2b87 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:10.358212 19760 raft_consensus.cc:3060] T f93ee515a9c14139bf566522ed8232f3 P e5256d91808b47c195bc9b4dbd7f2b87 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:10.358963 19600 tablet_bootstrap.cc:654] T ff75a1d4cb1f493db8f71ddc136ba9ab P e61c3a8f61bb48f8a963c9480e53c168: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:10.365237 19601 tablet_bootstrap.cc:654] T 0e1085d23e8347fbbd5bce7542f4b1f4 P 0473d2b2d01f4459b1e90fd12cc7840e: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:10.373924 19604 tablet_bootstrap.cc:654] T 96efeaaf1057492490e9a621f37e1a2d P e5256d91808b47c195bc9b4dbd7f2b87: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:10.380167 19601 tablet_bootstrap.cc:492] T 0e1085d23e8347fbbd5bce7542f4b1f4 P 0473d2b2d01f4459b1e90fd12cc7840e: No bootstrap required, opened a new log
I20260709 13:04:10.380668 19601 ts_tablet_manager.cc:1403] T 0e1085d23e8347fbbd5bce7542f4b1f4 P 0473d2b2d01f4459b1e90fd12cc7840e: Time spent bootstrapping tablet: real 0.028s	user 0.010s	sys 0.003s
I20260709 13:04:10.388257 19604 tablet_bootstrap.cc:492] T 96efeaaf1057492490e9a621f37e1a2d P e5256d91808b47c195bc9b4dbd7f2b87: No bootstrap required, opened a new log
I20260709 13:04:10.388720 19604 ts_tablet_manager.cc:1403] T 96efeaaf1057492490e9a621f37e1a2d P e5256d91808b47c195bc9b4dbd7f2b87: Time spent bootstrapping tablet: real 0.036s	user 0.013s	sys 0.000s
I20260709 13:04:10.391747 19604 raft_consensus.cc:359] T 96efeaaf1057492490e9a621f37e1a2d P e5256d91808b47c195bc9b4dbd7f2b87 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:10.392432 19604 raft_consensus.cc:385] T 96efeaaf1057492490e9a621f37e1a2d P e5256d91808b47c195bc9b4dbd7f2b87 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:10.392696 19604 raft_consensus.cc:740] T 96efeaaf1057492490e9a621f37e1a2d P e5256d91808b47c195bc9b4dbd7f2b87 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e5256d91808b47c195bc9b4dbd7f2b87, State: Initialized, Role: FOLLOWER
I20260709 13:04:10.393339 19604 consensus_queue.cc:260] T 96efeaaf1057492490e9a621f37e1a2d P e5256d91808b47c195bc9b4dbd7f2b87 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:10.394917 19604 ts_tablet_manager.cc:1434] T 96efeaaf1057492490e9a621f37e1a2d P e5256d91808b47c195bc9b4dbd7f2b87: Time spent starting tablet: real 0.006s	user 0.008s	sys 0.000s
I20260709 13:04:10.395773 19601 raft_consensus.cc:359] T 0e1085d23e8347fbbd5bce7542f4b1f4 P 0473d2b2d01f4459b1e90fd12cc7840e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:10.396512 19601 raft_consensus.cc:385] T 0e1085d23e8347fbbd5bce7542f4b1f4 P 0473d2b2d01f4459b1e90fd12cc7840e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:10.396785 19601 raft_consensus.cc:740] T 0e1085d23e8347fbbd5bce7542f4b1f4 P 0473d2b2d01f4459b1e90fd12cc7840e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0473d2b2d01f4459b1e90fd12cc7840e, State: Initialized, Role: FOLLOWER
I20260709 13:04:10.397454 19601 consensus_queue.cc:260] T 0e1085d23e8347fbbd5bce7542f4b1f4 P 0473d2b2d01f4459b1e90fd12cc7840e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:10.399753 19601 ts_tablet_manager.cc:1434] T 0e1085d23e8347fbbd5bce7542f4b1f4 P 0473d2b2d01f4459b1e90fd12cc7840e: Time spent starting tablet: real 0.019s	user 0.007s	sys 0.000s
I20260709 13:04:10.400745 19601 tablet_bootstrap.cc:492] T 6c5eebf646ad445a9d1b1adc319d7b16 P 0473d2b2d01f4459b1e90fd12cc7840e: Bootstrap starting.
I20260709 13:04:10.407462 19604 tablet_bootstrap.cc:492] T 172b3dd13109415a955b71ac0e9d2234 P e5256d91808b47c195bc9b4dbd7f2b87: Bootstrap starting.
I20260709 13:04:10.414251 19604 tablet_bootstrap.cc:654] T 172b3dd13109415a955b71ac0e9d2234 P e5256d91808b47c195bc9b4dbd7f2b87: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:10.416457 19601 tablet_bootstrap.cc:654] T 6c5eebf646ad445a9d1b1adc319d7b16 P 0473d2b2d01f4459b1e90fd12cc7840e: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:10.419060 19685 raft_consensus.cc:493] T 96efeaaf1057492490e9a621f37e1a2d P e5256d91808b47c195bc9b4dbd7f2b87 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:10.419720 19685 raft_consensus.cc:515] T 96efeaaf1057492490e9a621f37e1a2d P e5256d91808b47c195bc9b4dbd7f2b87 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:10.423918 19483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96efeaaf1057492490e9a621f37e1a2d" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:04:10.425189 19557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96efeaaf1057492490e9a621f37e1a2d" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:04:10.422511 19685 leader_election.cc:290] T 96efeaaf1057492490e9a621f37e1a2d P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:04:10.433529 19808 consensus_queue.cc:1048] T edd7d470b5014c9489be7f41f64355c9 P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:10.441735 19601 tablet_bootstrap.cc:492] T 6c5eebf646ad445a9d1b1adc319d7b16 P 0473d2b2d01f4459b1e90fd12cc7840e: No bootstrap required, opened a new log
I20260709 13:04:10.442221 19601 ts_tablet_manager.cc:1403] T 6c5eebf646ad445a9d1b1adc319d7b16 P 0473d2b2d01f4459b1e90fd12cc7840e: Time spent bootstrapping tablet: real 0.042s	user 0.017s	sys 0.003s
I20260709 13:04:10.432082 19760 raft_consensus.cc:515] T f93ee515a9c14139bf566522ed8232f3 P e5256d91808b47c195bc9b4dbd7f2b87 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:10.442054 19375 leader_election.cc:304] T 96efeaaf1057492490e9a621f37e1a2d P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:04:10.453300 19685 raft_consensus.cc:2749] T 96efeaaf1057492490e9a621f37e1a2d P e5256d91808b47c195bc9b4dbd7f2b87 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:04:10.454304 19817 raft_consensus.cc:493] T 9962423cb4e54fcfa5de01daf68a86e7 P 0473d2b2d01f4459b1e90fd12cc7840e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:10.454981 19817 raft_consensus.cc:515] T 9962423cb4e54fcfa5de01daf68a86e7 P 0473d2b2d01f4459b1e90fd12cc7840e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:10.456670 19760 leader_election.cc:290] T f93ee515a9c14139bf566522ed8232f3 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 1 election: Requested vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:04:10.457203 19817 leader_election.cc:290] T 9962423cb4e54fcfa5de01daf68a86e7 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:04:10.458989 19407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9962423cb4e54fcfa5de01daf68a86e7" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:04:10.460263 19814 consensus_queue.cc:1048] T b08304a0a02b42d7840c4e8ee9a6bd1a P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 13:04:10.460901 19449 leader_election.cc:343] T 9962423cb4e54fcfa5de01daf68a86e7 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:10.461651 19601 raft_consensus.cc:359] T 6c5eebf646ad445a9d1b1adc319d7b16 P 0473d2b2d01f4459b1e90fd12cc7840e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:10.462402 19601 raft_consensus.cc:385] T 6c5eebf646ad445a9d1b1adc319d7b16 P 0473d2b2d01f4459b1e90fd12cc7840e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:10.462777 19601 raft_consensus.cc:740] T 6c5eebf646ad445a9d1b1adc319d7b16 P 0473d2b2d01f4459b1e90fd12cc7840e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0473d2b2d01f4459b1e90fd12cc7840e, State: Initialized, Role: FOLLOWER
I20260709 13:04:10.463558 19601 consensus_queue.cc:260] T 6c5eebf646ad445a9d1b1adc319d7b16 P 0473d2b2d01f4459b1e90fd12cc7840e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:10.461692 19557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9962423cb4e54fcfa5de01daf68a86e7" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:04:10.468359 19557 raft_consensus.cc:2468] T 9962423cb4e54fcfa5de01daf68a86e7 P e61c3a8f61bb48f8a963c9480e53c168 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 0.
I20260709 13:04:10.468456 19760 raft_consensus.cc:493] T 7f575b143b844aa096b50997dad3516a P e5256d91808b47c195bc9b4dbd7f2b87 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:10.468966 19760 raft_consensus.cc:515] T 7f575b143b844aa096b50997dad3516a P e5256d91808b47c195bc9b4dbd7f2b87 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:10.471758 19600 tablet_bootstrap.cc:492] T ff75a1d4cb1f493db8f71ddc136ba9ab P e61c3a8f61bb48f8a963c9480e53c168: No bootstrap required, opened a new log
I20260709 13:04:10.461691 19485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f93ee515a9c14139bf566522ed8232f3" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:04:10.472213 19600 ts_tablet_manager.cc:1403] T ff75a1d4cb1f493db8f71ddc136ba9ab P e61c3a8f61bb48f8a963c9480e53c168: Time spent bootstrapping tablet: real 0.127s	user 0.026s	sys 0.035s
I20260709 13:04:10.472994 19604 tablet_bootstrap.cc:492] T 172b3dd13109415a955b71ac0e9d2234 P e5256d91808b47c195bc9b4dbd7f2b87: No bootstrap required, opened a new log
I20260709 13:04:10.473420 19604 ts_tablet_manager.cc:1403] T 172b3dd13109415a955b71ac0e9d2234 P e5256d91808b47c195bc9b4dbd7f2b87: Time spent bootstrapping tablet: real 0.066s	user 0.009s	sys 0.018s
I20260709 13:04:10.472496 19760 leader_election.cc:290] T 7f575b143b844aa096b50997dad3516a P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:04:10.474658 19601 ts_tablet_manager.cc:1434] T 6c5eebf646ad445a9d1b1adc319d7b16 P 0473d2b2d01f4459b1e90fd12cc7840e: Time spent starting tablet: real 0.032s	user 0.006s	sys 0.002s
I20260709 13:04:10.475572 19601 tablet_bootstrap.cc:492] T 4af19371ea874c09a0a2147040835cbb P 0473d2b2d01f4459b1e90fd12cc7840e: Bootstrap starting.
I20260709 13:04:10.472579 19485 raft_consensus.cc:3060] T f93ee515a9c14139bf566522ed8232f3 P 0473d2b2d01f4459b1e90fd12cc7840e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:10.479593 19450 leader_election.cc:304] T 9962423cb4e54fcfa5de01daf68a86e7 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168; no voters: e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:04:10.481678 19482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f575b143b844aa096b50997dad3516a" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:04:10.482471 19482 raft_consensus.cc:2393] T 7f575b143b844aa096b50997dad3516a P 0473d2b2d01f4459b1e90fd12cc7840e [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e5256d91808b47c195bc9b4dbd7f2b87 in current term 1: Already voted for candidate e61c3a8f61bb48f8a963c9480e53c168 in this term.
I20260709 13:04:10.486737 19560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f575b143b844aa096b50997dad3516a" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:04:10.484388 19611 raft_consensus.cc:2804] T 9962423cb4e54fcfa5de01daf68a86e7 P 0473d2b2d01f4459b1e90fd12cc7840e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:10.488344 19611 raft_consensus.cc:493] T 9962423cb4e54fcfa5de01daf68a86e7 P 0473d2b2d01f4459b1e90fd12cc7840e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:10.488739 19611 raft_consensus.cc:3060] T 9962423cb4e54fcfa5de01daf68a86e7 P 0473d2b2d01f4459b1e90fd12cc7840e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:10.490994 19557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f93ee515a9c14139bf566522ed8232f3" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:04:10.491595 19557 raft_consensus.cc:3060] T f93ee515a9c14139bf566522ed8232f3 P e61c3a8f61bb48f8a963c9480e53c168 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:10.491990 19375 leader_election.cc:304] T 7f575b143b844aa096b50997dad3516a P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:04:10.496325 19600 raft_consensus.cc:359] T ff75a1d4cb1f493db8f71ddc136ba9ab P e61c3a8f61bb48f8a963c9480e53c168 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:10.496989 19600 raft_consensus.cc:385] T ff75a1d4cb1f493db8f71ddc136ba9ab P e61c3a8f61bb48f8a963c9480e53c168 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:10.497255 19600 raft_consensus.cc:740] T ff75a1d4cb1f493db8f71ddc136ba9ab P e61c3a8f61bb48f8a963c9480e53c168 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e61c3a8f61bb48f8a963c9480e53c168, State: Initialized, Role: FOLLOWER
I20260709 13:04:10.497888 19600 consensus_queue.cc:260] T ff75a1d4cb1f493db8f71ddc136ba9ab P e61c3a8f61bb48f8a963c9480e53c168 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:10.498915 19685 raft_consensus.cc:3060] T 7f575b143b844aa096b50997dad3516a P e5256d91808b47c195bc9b4dbd7f2b87 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:10.500033 19600 ts_tablet_manager.cc:1434] T ff75a1d4cb1f493db8f71ddc136ba9ab P e61c3a8f61bb48f8a963c9480e53c168: Time spent starting tablet: real 0.027s	user 0.005s	sys 0.000s
I20260709 13:04:10.500933 19600 tablet_bootstrap.cc:492] T 6c5eebf646ad445a9d1b1adc319d7b16 P e61c3a8f61bb48f8a963c9480e53c168: Bootstrap starting.
I20260709 13:04:10.501828 19485 raft_consensus.cc:2468] T f93ee515a9c14139bf566522ed8232f3 P 0473d2b2d01f4459b1e90fd12cc7840e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 1.
W20260709 13:04:10.505707 19449 consensus_peers.cc:597] T b9f0d59553ad444883fcf5b5909f9798 P 0473d2b2d01f4459b1e90fd12cc7840e -> Peer e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321): Couldn't send request to peer e5256d91808b47c195bc9b4dbd7f2b87. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:10.511739 19407 raft_consensus.cc:3060] T 96efeaaf1057492490e9a621f37e1a2d P e5256d91808b47c195bc9b4dbd7f2b87 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:10.520453 19813 raft_consensus.cc:493] T 0e1085d23e8347fbbd5bce7542f4b1f4 P 0473d2b2d01f4459b1e90fd12cc7840e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:10.520947 19813 raft_consensus.cc:515] T 0e1085d23e8347fbbd5bce7542f4b1f4 P 0473d2b2d01f4459b1e90fd12cc7840e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:10.521857 19557 raft_consensus.cc:2468] T f93ee515a9c14139bf566522ed8232f3 P e61c3a8f61bb48f8a963c9480e53c168 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 1.
I20260709 13:04:10.523160 19375 leader_election.cc:304] T f93ee515a9c14139bf566522ed8232f3 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:04:10.524150 19687 raft_consensus.cc:493] T ff75a1d4cb1f493db8f71ddc136ba9ab P e61c3a8f61bb48f8a963c9480e53c168 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:10.524612 19687 raft_consensus.cc:515] T ff75a1d4cb1f493db8f71ddc136ba9ab P e61c3a8f61bb48f8a963c9480e53c168 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:10.525233 19813 leader_election.cc:290] T 0e1085d23e8347fbbd5bce7542f4b1f4 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:04:10.525642 19410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e1085d23e8347fbbd5bce7542f4b1f4" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:04:10.518832 19604 raft_consensus.cc:359] T 172b3dd13109415a955b71ac0e9d2234 P e5256d91808b47c195bc9b4dbd7f2b87 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:10.527034 19604 raft_consensus.cc:385] T 172b3dd13109415a955b71ac0e9d2234 P e5256d91808b47c195bc9b4dbd7f2b87 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260709 13:04:10.526983 19449 leader_election.cc:343] T 0e1085d23e8347fbbd5bce7542f4b1f4 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:10.527168 19409 raft_consensus.cc:3060] T b08304a0a02b42d7840c4e8ee9a6bd1a P e5256d91808b47c195bc9b4dbd7f2b87 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:10.527438 19604 raft_consensus.cc:740] T 172b3dd13109415a955b71ac0e9d2234 P e5256d91808b47c195bc9b4dbd7f2b87 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e5256d91808b47c195bc9b4dbd7f2b87, State: Initialized, Role: FOLLOWER
I20260709 13:04:10.528249 19604 consensus_queue.cc:260] T 172b3dd13109415a955b71ac0e9d2234 P e5256d91808b47c195bc9b4dbd7f2b87 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:10.531194 19601 tablet_bootstrap.cc:654] T 4af19371ea874c09a0a2147040835cbb P 0473d2b2d01f4459b1e90fd12cc7840e: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:10.526590 19687 leader_election.cc:290] T ff75a1d4cb1f493db8f71ddc136ba9ab P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:04:10.526621 19560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e1085d23e8347fbbd5bce7542f4b1f4" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:04:10.533471 19410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff75a1d4cb1f493db8f71ddc136ba9ab" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:04:10.534245 19410 raft_consensus.cc:2393] T ff75a1d4cb1f493db8f71ddc136ba9ab P e5256d91808b47c195bc9b4dbd7f2b87 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e61c3a8f61bb48f8a963c9480e53c168 in current term 1: Already voted for candidate 0473d2b2d01f4459b1e90fd12cc7840e in this term.
I20260709 13:04:10.535374 19600 tablet_bootstrap.cc:654] T 6c5eebf646ad445a9d1b1adc319d7b16 P e61c3a8f61bb48f8a963c9480e53c168: Neither blocks nor log segments found. Creating new log.
W20260709 13:04:10.536679 19450 leader_election.cc:343] T 0e1085d23e8347fbbd5bce7542f4b1f4 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:10.537190 19450 leader_election.cc:304] T 0e1085d23e8347fbbd5bce7542f4b1f4 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e; no voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:04:10.538990 19813 raft_consensus.cc:2749] T 0e1085d23e8347fbbd5bce7542f4b1f4 P 0473d2b2d01f4459b1e90fd12cc7840e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:04:10.529928 19611 raft_consensus.cc:515] T 9962423cb4e54fcfa5de01daf68a86e7 P 0473d2b2d01f4459b1e90fd12cc7840e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
W20260709 13:04:10.554055 19377 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.2:46257, user_credentials={real_user=slave}} blocked reactor thread for 47873.9us
I20260709 13:04:10.555594 19604 ts_tablet_manager.cc:1434] T 172b3dd13109415a955b71ac0e9d2234 P e5256d91808b47c195bc9b4dbd7f2b87: Time spent starting tablet: real 0.082s	user 0.003s	sys 0.011s
I20260709 13:04:10.556568 19604 tablet_bootstrap.cc:492] T b9f0d59553ad444883fcf5b5909f9798 P e5256d91808b47c195bc9b4dbd7f2b87: Bootstrap starting.
I20260709 13:04:10.555908 19855 raft_consensus.cc:2804] T f93ee515a9c14139bf566522ed8232f3 P e5256d91808b47c195bc9b4dbd7f2b87 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:10.563001 19604 tablet_bootstrap.cc:654] T b9f0d59553ad444883fcf5b5909f9798 P e5256d91808b47c195bc9b4dbd7f2b87: Neither blocks nor log segments found. Creating new log.
W20260709 13:04:10.552196 19357 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:04:10.550269 19813 consensus_queue.cc:1048] T b9f0d59553ad444883fcf5b5909f9798 P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.016s
I20260709 13:04:10.548943 19485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff75a1d4cb1f493db8f71ddc136ba9ab" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:04:10.587278 19611 leader_election.cc:290] T 9962423cb4e54fcfa5de01daf68a86e7 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 1 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:04:10.598201 19560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9962423cb4e54fcfa5de01daf68a86e7" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:04:10.601779 19411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9962423cb4e54fcfa5de01daf68a86e7" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
I20260709 13:04:10.602190 19526 leader_election.cc:304] T ff75a1d4cb1f493db8f71ddc136ba9ab P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e61c3a8f61bb48f8a963c9480e53c168; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:04:10.603762 19630 raft_consensus.cc:3060] T ff75a1d4cb1f493db8f71ddc136ba9ab P e61c3a8f61bb48f8a963c9480e53c168 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:10.609910 19560 raft_consensus.cc:3060] T 9962423cb4e54fcfa5de01daf68a86e7 P e61c3a8f61bb48f8a963c9480e53c168 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:10.610249 19630 raft_consensus.cc:2749] T ff75a1d4cb1f493db8f71ddc136ba9ab P e61c3a8f61bb48f8a963c9480e53c168 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:04:10.616207 19449 leader_election.cc:343] T 9962423cb4e54fcfa5de01daf68a86e7 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:10.576687 19855 raft_consensus.cc:697] T f93ee515a9c14139bf566522ed8232f3 P e5256d91808b47c195bc9b4dbd7f2b87 [term 1 LEADER]: Becoming Leader. State: Replica: e5256d91808b47c195bc9b4dbd7f2b87, State: Running, Role: LEADER
I20260709 13:04:10.626253 19813 consensus_queue.cc:1048] T b08304a0a02b42d7840c4e8ee9a6bd1a P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:04:10.624425 19630 consensus_queue.cc:1048] T 7f575b143b844aa096b50997dad3516a P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.003s
I20260709 13:04:10.630616 19560 raft_consensus.cc:2468] T 9962423cb4e54fcfa5de01daf68a86e7 P e61c3a8f61bb48f8a963c9480e53c168 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 1.
I20260709 13:04:10.633950 19450 leader_election.cc:304] T 9962423cb4e54fcfa5de01daf68a86e7 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168; no voters: e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:04:10.635002 19813 raft_consensus.cc:2804] T 9962423cb4e54fcfa5de01daf68a86e7 P 0473d2b2d01f4459b1e90fd12cc7840e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:10.635469 19813 raft_consensus.cc:697] T 9962423cb4e54fcfa5de01daf68a86e7 P 0473d2b2d01f4459b1e90fd12cc7840e [term 1 LEADER]: Becoming Leader. State: Replica: 0473d2b2d01f4459b1e90fd12cc7840e, State: Running, Role: LEADER
I20260709 13:04:10.636267 19813 consensus_queue.cc:237] T 9962423cb4e54fcfa5de01daf68a86e7 P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:10.651691 19685 raft_consensus.cc:2749] T 7f575b143b844aa096b50997dad3516a P e5256d91808b47c195bc9b4dbd7f2b87 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:04:10.664465 19858 raft_consensus.cc:493] T 172b3dd13109415a955b71ac0e9d2234 P e5256d91808b47c195bc9b4dbd7f2b87 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:10.663467 19855 consensus_queue.cc:237] T f93ee515a9c14139bf566522ed8232f3 P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:10.677179 19858 raft_consensus.cc:515] T 172b3dd13109415a955b71ac0e9d2234 P e5256d91808b47c195bc9b4dbd7f2b87 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:10.712790 19411 raft_consensus.cc:3060] T 172b3dd13109415a955b71ac0e9d2234 P e5256d91808b47c195bc9b4dbd7f2b87 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:10.719229 19630 consensus_queue.cc:1048] T 7f575b143b844aa096b50997dad3516a P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:10.722563 19820 consensus_queue.cc:1048] T ff75a1d4cb1f493db8f71ddc136ba9ab P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:10.718533 19604 tablet_bootstrap.cc:492] T b9f0d59553ad444883fcf5b5909f9798 P e5256d91808b47c195bc9b4dbd7f2b87: No bootstrap required, opened a new log
I20260709 13:04:10.726321 19604 ts_tablet_manager.cc:1403] T b9f0d59553ad444883fcf5b5909f9798 P e5256d91808b47c195bc9b4dbd7f2b87: Time spent bootstrapping tablet: real 0.170s	user 0.013s	sys 0.045s
I20260709 13:04:10.740537 19858 leader_election.cc:290] T 172b3dd13109415a955b71ac0e9d2234 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:04:10.746418 19601 tablet_bootstrap.cc:492] T 4af19371ea874c09a0a2147040835cbb P 0473d2b2d01f4459b1e90fd12cc7840e: No bootstrap required, opened a new log
I20260709 13:04:10.746881 19601 ts_tablet_manager.cc:1403] T 4af19371ea874c09a0a2147040835cbb P 0473d2b2d01f4459b1e90fd12cc7840e: Time spent bootstrapping tablet: real 0.271s	user 0.017s	sys 0.021s
I20260709 13:04:10.749326 19307 catalog_manager.cc:5697] T 9962423cb4e54fcfa5de01daf68a86e7 P 0473d2b2d01f4459b1e90fd12cc7840e reported cstate change: term changed from 0 to 1, leader changed from <none> to 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2). New cstate: current_term: 1 leader_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:10.754451 19769 raft_consensus.cc:493] T 6c5eebf646ad445a9d1b1adc319d7b16 P 0473d2b2d01f4459b1e90fd12cc7840e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:10.754967 19769 raft_consensus.cc:515] T 6c5eebf646ad445a9d1b1adc319d7b16 P 0473d2b2d01f4459b1e90fd12cc7840e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:10.751325 19560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "172b3dd13109415a955b71ac0e9d2234" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:04:10.763478 19560 raft_consensus.cc:2393] T 172b3dd13109415a955b71ac0e9d2234 P e61c3a8f61bb48f8a963c9480e53c168 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e5256d91808b47c195bc9b4dbd7f2b87 in current term 1: Already voted for candidate 0473d2b2d01f4459b1e90fd12cc7840e in this term.
I20260709 13:04:10.765652 19814 consensus_queue.cc:1048] T 172b3dd13109415a955b71ac0e9d2234 P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:04:10.776255 19309 catalog_manager.cc:5697] T f93ee515a9c14139bf566522ed8232f3 P e5256d91808b47c195bc9b4dbd7f2b87 reported cstate change: term changed from 0 to 1, leader changed from <none> to e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1). New cstate: current_term: 1 leader_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:10.815299 19600 tablet_bootstrap.cc:492] T 6c5eebf646ad445a9d1b1adc319d7b16 P e61c3a8f61bb48f8a963c9480e53c168: No bootstrap required, opened a new log
I20260709 13:04:10.815979 19600 ts_tablet_manager.cc:1403] T 6c5eebf646ad445a9d1b1adc319d7b16 P e61c3a8f61bb48f8a963c9480e53c168: Time spent bootstrapping tablet: real 0.315s	user 0.017s	sys 0.038s
I20260709 13:04:10.816896 19769 leader_election.cc:290] T 6c5eebf646ad445a9d1b1adc319d7b16 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:04:10.831326 19408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c5eebf646ad445a9d1b1adc319d7b16" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:04:10.838245 19408 raft_consensus.cc:2468] T 6c5eebf646ad445a9d1b1adc319d7b16 P e5256d91808b47c195bc9b4dbd7f2b87 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 0.
I20260709 13:04:10.838713 19601 raft_consensus.cc:359] T 4af19371ea874c09a0a2147040835cbb P 0473d2b2d01f4459b1e90fd12cc7840e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:10.839593 19601 raft_consensus.cc:385] T 4af19371ea874c09a0a2147040835cbb P 0473d2b2d01f4459b1e90fd12cc7840e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:10.839901 19601 raft_consensus.cc:740] T 4af19371ea874c09a0a2147040835cbb P 0473d2b2d01f4459b1e90fd12cc7840e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0473d2b2d01f4459b1e90fd12cc7840e, State: Initialized, Role: FOLLOWER
I20260709 13:04:10.840528 19601 consensus_queue.cc:260] T 4af19371ea874c09a0a2147040835cbb P 0473d2b2d01f4459b1e90fd12cc7840e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:10.842552 19601 ts_tablet_manager.cc:1434] T 4af19371ea874c09a0a2147040835cbb P 0473d2b2d01f4459b1e90fd12cc7840e: Time spent starting tablet: real 0.095s	user 0.013s	sys 0.005s
I20260709 13:04:10.842494 19449 leader_election.cc:304] T 6c5eebf646ad445a9d1b1adc319d7b16 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87; no voters: 
I20260709 13:04:10.837605 19483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "172b3dd13109415a955b71ac0e9d2234" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:04:10.843657 19600 raft_consensus.cc:359] T 6c5eebf646ad445a9d1b1adc319d7b16 P e61c3a8f61bb48f8a963c9480e53c168 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:10.851263 19601 tablet_bootstrap.cc:492] T df751f992649444090e27965eb1af85d P 0473d2b2d01f4459b1e90fd12cc7840e: Bootstrap starting.
I20260709 13:04:10.838713 19604 raft_consensus.cc:359] T b9f0d59553ad444883fcf5b5909f9798 P e5256d91808b47c195bc9b4dbd7f2b87 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:10.853904 19600 raft_consensus.cc:385] T 6c5eebf646ad445a9d1b1adc319d7b16 P e61c3a8f61bb48f8a963c9480e53c168 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:10.854135 19604 raft_consensus.cc:385] T b9f0d59553ad444883fcf5b5909f9798 P e5256d91808b47c195bc9b4dbd7f2b87 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:10.854219 19600 raft_consensus.cc:740] T 6c5eebf646ad445a9d1b1adc319d7b16 P e61c3a8f61bb48f8a963c9480e53c168 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e61c3a8f61bb48f8a963c9480e53c168, State: Initialized, Role: FOLLOWER
I20260709 13:04:10.855360 19604 raft_consensus.cc:740] T b9f0d59553ad444883fcf5b5909f9798 P e5256d91808b47c195bc9b4dbd7f2b87 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e5256d91808b47c195bc9b4dbd7f2b87, State: Initialized, Role: FOLLOWER
W20260709 13:04:10.859993 19866 log.cc:927] Time spent T 9962423cb4e54fcfa5de01daf68a86e7 P 0473d2b2d01f4459b1e90fd12cc7840e: Append to log took a long time: real 0.122s	user 0.001s	sys 0.000s
I20260709 13:04:10.862617 19560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c5eebf646ad445a9d1b1adc319d7b16" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:04:10.862183 19600 consensus_queue.cc:260] T 6c5eebf646ad445a9d1b1adc319d7b16 P e61c3a8f61bb48f8a963c9480e53c168 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:10.855154 19817 raft_consensus.cc:2804] T 6c5eebf646ad445a9d1b1adc319d7b16 P 0473d2b2d01f4459b1e90fd12cc7840e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:10.864421 19817 raft_consensus.cc:493] T 6c5eebf646ad445a9d1b1adc319d7b16 P 0473d2b2d01f4459b1e90fd12cc7840e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:10.864801 19817 raft_consensus.cc:3060] T 6c5eebf646ad445a9d1b1adc319d7b16 P 0473d2b2d01f4459b1e90fd12cc7840e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:10.866364 19600 ts_tablet_manager.cc:1434] T 6c5eebf646ad445a9d1b1adc319d7b16 P e61c3a8f61bb48f8a963c9480e53c168: Time spent starting tablet: real 0.050s	user 0.007s	sys 0.000s
I20260709 13:04:10.868093 19600 tablet_bootstrap.cc:492] T 0e1085d23e8347fbbd5bce7542f4b1f4 P e61c3a8f61bb48f8a963c9480e53c168: Bootstrap starting.
I20260709 13:04:10.868178 19769 consensus_queue.cc:1048] T ff75a1d4cb1f493db8f71ddc136ba9ab P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:10.870049 19377 leader_election.cc:304] T 172b3dd13109415a955b71ac0e9d2234 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:04:10.872991 19832 raft_consensus.cc:493] T 4af19371ea874c09a0a2147040835cbb P e61c3a8f61bb48f8a963c9480e53c168 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:10.870057 19820 consensus_queue.cc:1048] T 172b3dd13109415a955b71ac0e9d2234 P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.003s
I20260709 13:04:10.873499 19832 raft_consensus.cc:515] T 4af19371ea874c09a0a2147040835cbb P e61c3a8f61bb48f8a963c9480e53c168 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:10.878918 19604 consensus_queue.cc:260] T b9f0d59553ad444883fcf5b5909f9798 P e5256d91808b47c195bc9b4dbd7f2b87 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:10.866377 19560 raft_consensus.cc:2468] T 6c5eebf646ad445a9d1b1adc319d7b16 P e61c3a8f61bb48f8a963c9480e53c168 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 0.
I20260709 13:04:10.887566 19411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4af19371ea874c09a0a2147040835cbb" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:04:10.885942 19858 raft_consensus.cc:2749] T 172b3dd13109415a955b71ac0e9d2234 P e5256d91808b47c195bc9b4dbd7f2b87 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:04:10.888882 19523 leader_election.cc:343] T 4af19371ea874c09a0a2147040835cbb P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:10.878332 19832 leader_election.cc:290] T 4af19371ea874c09a0a2147040835cbb P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:04:10.889854 19483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4af19371ea874c09a0a2147040835cbb" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:04:10.893986 19604 ts_tablet_manager.cc:1434] T b9f0d59553ad444883fcf5b5909f9798 P e5256d91808b47c195bc9b4dbd7f2b87: Time spent starting tablet: real 0.167s	user 0.013s	sys 0.001s
I20260709 13:04:10.943826 19604 tablet_bootstrap.cc:492] T 9962423cb4e54fcfa5de01daf68a86e7 P e5256d91808b47c195bc9b4dbd7f2b87: Bootstrap starting.
I20260709 13:04:10.894229 19483 raft_consensus.cc:2468] T 4af19371ea874c09a0a2147040835cbb P 0473d2b2d01f4459b1e90fd12cc7840e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 0.
I20260709 13:04:10.921092 19817 raft_consensus.cc:515] T 6c5eebf646ad445a9d1b1adc319d7b16 P 0473d2b2d01f4459b1e90fd12cc7840e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
W20260709 13:04:10.959820 19871 log.cc:927] Time spent T 172b3dd13109415a955b71ac0e9d2234 P e5256d91808b47c195bc9b4dbd7f2b87: Append to log took a long time: real 0.061s	user 0.001s	sys 0.000s
I20260709 13:04:10.965459 19817 leader_election.cc:290] T 6c5eebf646ad445a9d1b1adc319d7b16 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 1 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:04:10.966264 19600 tablet_bootstrap.cc:654] T 0e1085d23e8347fbbd5bce7542f4b1f4 P e61c3a8f61bb48f8a963c9480e53c168: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:11.016336 19559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c5eebf646ad445a9d1b1adc319d7b16" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:04:11.018165 19559 raft_consensus.cc:3060] T 6c5eebf646ad445a9d1b1adc319d7b16 P e61c3a8f61bb48f8a963c9480e53c168 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:11.027359 19409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c5eebf646ad445a9d1b1adc319d7b16" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
I20260709 13:04:11.028177 19409 raft_consensus.cc:3060] T 6c5eebf646ad445a9d1b1adc319d7b16 P e5256d91808b47c195bc9b4dbd7f2b87 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:11.037833 19526 leader_election.cc:304] T 4af19371ea874c09a0a2147040835cbb P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168; no voters: e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:04:11.044932 19630 raft_consensus.cc:2804] T 4af19371ea874c09a0a2147040835cbb P e61c3a8f61bb48f8a963c9480e53c168 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:11.045581 19630 raft_consensus.cc:493] T 4af19371ea874c09a0a2147040835cbb P e61c3a8f61bb48f8a963c9480e53c168 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:11.046204 19630 raft_consensus.cc:3060] T 4af19371ea874c09a0a2147040835cbb P e61c3a8f61bb48f8a963c9480e53c168 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:11.049127 19604 tablet_bootstrap.cc:654] T 9962423cb4e54fcfa5de01daf68a86e7 P e5256d91808b47c195bc9b4dbd7f2b87: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:11.052763 19601 tablet_bootstrap.cc:654] T df751f992649444090e27965eb1af85d P 0473d2b2d01f4459b1e90fd12cc7840e: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:11.060304 19559 raft_consensus.cc:2468] T 6c5eebf646ad445a9d1b1adc319d7b16 P e61c3a8f61bb48f8a963c9480e53c168 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 1.
I20260709 13:04:11.064769 19685 raft_consensus.cc:493] T b9f0d59553ad444883fcf5b5909f9798 P e5256d91808b47c195bc9b4dbd7f2b87 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:11.065470 19685 raft_consensus.cc:515] T b9f0d59553ad444883fcf5b5909f9798 P e5256d91808b47c195bc9b4dbd7f2b87 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:11.068608 19685 leader_election.cc:290] T b9f0d59553ad444883fcf5b5909f9798 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:04:11.073769 19604 tablet_bootstrap.cc:492] T 9962423cb4e54fcfa5de01daf68a86e7 P e5256d91808b47c195bc9b4dbd7f2b87: No bootstrap required, opened a new log
I20260709 13:04:11.074429 19604 ts_tablet_manager.cc:1403] T 9962423cb4e54fcfa5de01daf68a86e7 P e5256d91808b47c195bc9b4dbd7f2b87: Time spent bootstrapping tablet: real 0.131s	user 0.005s	sys 0.008s
I20260709 13:04:11.084372 19559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9f0d59553ad444883fcf5b5909f9798" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:04:11.087335 19409 raft_consensus.cc:2468] T 6c5eebf646ad445a9d1b1adc319d7b16 P e5256d91808b47c195bc9b4dbd7f2b87 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 1.
I20260709 13:04:11.104842 19604 raft_consensus.cc:359] T 9962423cb4e54fcfa5de01daf68a86e7 P e5256d91808b47c195bc9b4dbd7f2b87 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:11.105792 19604 raft_consensus.cc:385] T 9962423cb4e54fcfa5de01daf68a86e7 P e5256d91808b47c195bc9b4dbd7f2b87 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:11.106084 19604 raft_consensus.cc:740] T 9962423cb4e54fcfa5de01daf68a86e7 P e5256d91808b47c195bc9b4dbd7f2b87 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e5256d91808b47c195bc9b4dbd7f2b87, State: Initialized, Role: FOLLOWER
I20260709 13:04:11.110157 19604 consensus_queue.cc:260] T 9962423cb4e54fcfa5de01daf68a86e7 P e5256d91808b47c195bc9b4dbd7f2b87 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:11.111166 19601 tablet_bootstrap.cc:492] T df751f992649444090e27965eb1af85d P 0473d2b2d01f4459b1e90fd12cc7840e: No bootstrap required, opened a new log
I20260709 13:04:11.112303 19483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9f0d59553ad444883fcf5b5909f9798" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:04:11.117198 19604 ts_tablet_manager.cc:1434] T 9962423cb4e54fcfa5de01daf68a86e7 P e5256d91808b47c195bc9b4dbd7f2b87: Time spent starting tablet: real 0.042s	user 0.009s	sys 0.000s
I20260709 13:04:11.128994 19600 tablet_bootstrap.cc:492] T 0e1085d23e8347fbbd5bce7542f4b1f4 P e61c3a8f61bb48f8a963c9480e53c168: No bootstrap required, opened a new log
I20260709 13:04:11.129688 19600 ts_tablet_manager.cc:1403] T 0e1085d23e8347fbbd5bce7542f4b1f4 P e61c3a8f61bb48f8a963c9480e53c168: Time spent bootstrapping tablet: real 0.262s	user 0.010s	sys 0.002s
I20260709 13:04:11.133248 19600 raft_consensus.cc:359] T 0e1085d23e8347fbbd5bce7542f4b1f4 P e61c3a8f61bb48f8a963c9480e53c168 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:11.134071 19600 raft_consensus.cc:385] T 0e1085d23e8347fbbd5bce7542f4b1f4 P e61c3a8f61bb48f8a963c9480e53c168 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:11.135879 19601 ts_tablet_manager.cc:1403] T df751f992649444090e27965eb1af85d P 0473d2b2d01f4459b1e90fd12cc7840e: Time spent bootstrapping tablet: real 0.285s	user 0.018s	sys 0.007s
I20260709 13:04:11.140556 19630 raft_consensus.cc:515] T 4af19371ea874c09a0a2147040835cbb P e61c3a8f61bb48f8a963c9480e53c168 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:11.134486 19600 raft_consensus.cc:740] T 0e1085d23e8347fbbd5bce7542f4b1f4 P e61c3a8f61bb48f8a963c9480e53c168 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e61c3a8f61bb48f8a963c9480e53c168, State: Initialized, Role: FOLLOWER
I20260709 13:04:11.143966 19411 raft_consensus.cc:3060] T b9f0d59553ad444883fcf5b5909f9798 P e5256d91808b47c195bc9b4dbd7f2b87 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:11.151563 19600 consensus_queue.cc:260] T 0e1085d23e8347fbbd5bce7542f4b1f4 P e61c3a8f61bb48f8a963c9480e53c168 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:11.158023 19449 leader_election.cc:304] T 6c5eebf646ad445a9d1b1adc319d7b16 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87; no voters: 
I20260709 13:04:11.159098 19814 raft_consensus.cc:2804] T 6c5eebf646ad445a9d1b1adc319d7b16 P 0473d2b2d01f4459b1e90fd12cc7840e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:11.159592 19814 raft_consensus.cc:697] T 6c5eebf646ad445a9d1b1adc319d7b16 P 0473d2b2d01f4459b1e90fd12cc7840e [term 1 LEADER]: Becoming Leader. State: Replica: 0473d2b2d01f4459b1e90fd12cc7840e, State: Running, Role: LEADER
I20260709 13:04:11.160624 19814 consensus_queue.cc:237] T 6c5eebf646ad445a9d1b1adc319d7b16 P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:11.162832 19600 ts_tablet_manager.cc:1434] T 0e1085d23e8347fbbd5bce7542f4b1f4 P e61c3a8f61bb48f8a963c9480e53c168: Time spent starting tablet: real 0.033s	user 0.008s	sys 0.000s
I20260709 13:04:11.164225 19600 tablet_bootstrap.cc:492] T 1efebf73c86e432baa55533136b6e12c P e61c3a8f61bb48f8a963c9480e53c168: Bootstrap starting.
I20260709 13:04:11.168932 19601 raft_consensus.cc:359] T df751f992649444090e27965eb1af85d P 0473d2b2d01f4459b1e90fd12cc7840e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:11.169643 19601 raft_consensus.cc:385] T df751f992649444090e27965eb1af85d P 0473d2b2d01f4459b1e90fd12cc7840e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:11.169958 19601 raft_consensus.cc:740] T df751f992649444090e27965eb1af85d P 0473d2b2d01f4459b1e90fd12cc7840e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0473d2b2d01f4459b1e90fd12cc7840e, State: Initialized, Role: FOLLOWER
I20260709 13:04:11.180627 19630 leader_election.cc:290] T 4af19371ea874c09a0a2147040835cbb P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 1 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:04:11.181023 19485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4af19371ea874c09a0a2147040835cbb" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:04:11.182204 19485 raft_consensus.cc:3060] T 4af19371ea874c09a0a2147040835cbb P 0473d2b2d01f4459b1e90fd12cc7840e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:11.185248 19406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4af19371ea874c09a0a2147040835cbb" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
W20260709 13:04:11.187323 19523 leader_election.cc:343] T 4af19371ea874c09a0a2147040835cbb P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:11.177500 19601 consensus_queue.cc:260] T df751f992649444090e27965eb1af85d P 0473d2b2d01f4459b1e90fd12cc7840e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:11.191980 19377 leader_election.cc:304] T b9f0d59553ad444883fcf5b5909f9798 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:04:11.193974 19601 ts_tablet_manager.cc:1434] T df751f992649444090e27965eb1af85d P 0473d2b2d01f4459b1e90fd12cc7840e: Time spent starting tablet: real 0.057s	user 0.004s	sys 0.002s
I20260709 13:04:11.195209 19601 tablet_bootstrap.cc:492] T 62c6c134d3d24a1ab144dd9ee6bc3f64 P 0473d2b2d01f4459b1e90fd12cc7840e: Bootstrap starting.
I20260709 13:04:11.196601 19604 tablet_bootstrap.cc:492] T bc225c93219c45538b53a1bd3d387e4d P e5256d91808b47c195bc9b4dbd7f2b87: Bootstrap starting.
I20260709 13:04:11.210371 19485 raft_consensus.cc:2468] T 4af19371ea874c09a0a2147040835cbb P 0473d2b2d01f4459b1e90fd12cc7840e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 1.
I20260709 13:04:11.219668 19859 consensus_queue.cc:1048] T f93ee515a9c14139bf566522ed8232f3 P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:04:11.221443 19526 leader_election.cc:304] T 4af19371ea874c09a0a2147040835cbb P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168; no voters: e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:04:11.223178 19832 raft_consensus.cc:2804] T 4af19371ea874c09a0a2147040835cbb P e61c3a8f61bb48f8a963c9480e53c168 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:11.223677 19832 raft_consensus.cc:697] T 4af19371ea874c09a0a2147040835cbb P e61c3a8f61bb48f8a963c9480e53c168 [term 1 LEADER]: Becoming Leader. State: Replica: e61c3a8f61bb48f8a963c9480e53c168, State: Running, Role: LEADER
I20260709 13:04:11.224823 19832 consensus_queue.cc:237] T 4af19371ea874c09a0a2147040835cbb P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:11.239356 19309 catalog_manager.cc:5697] T 6c5eebf646ad445a9d1b1adc319d7b16 P 0473d2b2d01f4459b1e90fd12cc7840e reported cstate change: term changed from 0 to 1, leader changed from <none> to 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2). New cstate: current_term: 1 leader_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:11.274327 19408 raft_consensus.cc:3060] T 9962423cb4e54fcfa5de01daf68a86e7 P e5256d91808b47c195bc9b4dbd7f2b87 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:11.292341 19601 tablet_bootstrap.cc:654] T 62c6c134d3d24a1ab144dd9ee6bc3f64 P 0473d2b2d01f4459b1e90fd12cc7840e: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:11.299566 19600 tablet_bootstrap.cc:654] T 1efebf73c86e432baa55533136b6e12c P e61c3a8f61bb48f8a963c9480e53c168: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:11.307497 19832 raft_consensus.cc:493] T 0e1085d23e8347fbbd5bce7542f4b1f4 P e61c3a8f61bb48f8a963c9480e53c168 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:11.308045 19832 raft_consensus.cc:515] T 0e1085d23e8347fbbd5bce7542f4b1f4 P e61c3a8f61bb48f8a963c9480e53c168 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:11.310308 19832 leader_election.cc:290] T 0e1085d23e8347fbbd5bce7542f4b1f4 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:04:11.313635 19881 consensus_queue.cc:1048] T 9962423cb4e54fcfa5de01daf68a86e7 P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:04:11.315821 19604 tablet_bootstrap.cc:654] T bc225c93219c45538b53a1bd3d387e4d P e5256d91808b47c195bc9b4dbd7f2b87: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:11.317605 19483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e1085d23e8347fbbd5bce7542f4b1f4" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:04:11.318317 19483 raft_consensus.cc:2468] T 0e1085d23e8347fbbd5bce7542f4b1f4 P 0473d2b2d01f4459b1e90fd12cc7840e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 0.
I20260709 13:04:11.322295 19309 catalog_manager.cc:5697] T 4af19371ea874c09a0a2147040835cbb P e61c3a8f61bb48f8a963c9480e53c168 reported cstate change: term changed from 0 to 1, leader changed from <none> to e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3). New cstate: current_term: 1 leader_uuid: "e61c3a8f61bb48f8a963c9480e53c168" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } health_report { overall_health: HEALTHY } } }
I20260709 13:04:11.323251 19526 leader_election.cc:304] T 0e1085d23e8347fbbd5bce7542f4b1f4 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:04:11.324671 19630 raft_consensus.cc:2804] T 0e1085d23e8347fbbd5bce7542f4b1f4 P e61c3a8f61bb48f8a963c9480e53c168 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:11.325042 19630 raft_consensus.cc:493] T 0e1085d23e8347fbbd5bce7542f4b1f4 P e61c3a8f61bb48f8a963c9480e53c168 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:11.325366 19630 raft_consensus.cc:3060] T 0e1085d23e8347fbbd5bce7542f4b1f4 P e61c3a8f61bb48f8a963c9480e53c168 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:11.326438 19600 tablet_bootstrap.cc:492] T 1efebf73c86e432baa55533136b6e12c P e61c3a8f61bb48f8a963c9480e53c168: No bootstrap required, opened a new log
I20260709 13:04:11.326638 19409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e1085d23e8347fbbd5bce7542f4b1f4" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:04:11.327370 19600 ts_tablet_manager.cc:1403] T 1efebf73c86e432baa55533136b6e12c P e61c3a8f61bb48f8a963c9480e53c168: Time spent bootstrapping tablet: real 0.163s	user 0.014s	sys 0.000s
I20260709 13:04:11.331362 19685 raft_consensus.cc:2749] T b9f0d59553ad444883fcf5b5909f9798 P e5256d91808b47c195bc9b4dbd7f2b87 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:04:11.331588 19523 leader_election.cc:343] T 0e1085d23e8347fbbd5bce7542f4b1f4 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:11.332396 19630 raft_consensus.cc:515] T 0e1085d23e8347fbbd5bce7542f4b1f4 P e61c3a8f61bb48f8a963c9480e53c168 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:11.334414 19859 consensus_queue.cc:1048] T f93ee515a9c14139bf566522ed8232f3 P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:04:11.334882 19409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e1085d23e8347fbbd5bce7542f4b1f4" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
W20260709 13:04:11.336236 19523 leader_election.cc:343] T 0e1085d23e8347fbbd5bce7542f4b1f4 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:11.344112 19630 leader_election.cc:290] T 0e1085d23e8347fbbd5bce7542f4b1f4 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 1 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:04:11.347229 19483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e1085d23e8347fbbd5bce7542f4b1f4" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:04:11.347851 19483 raft_consensus.cc:3060] T 0e1085d23e8347fbbd5bce7542f4b1f4 P 0473d2b2d01f4459b1e90fd12cc7840e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:11.349758 19601 tablet_bootstrap.cc:492] T 62c6c134d3d24a1ab144dd9ee6bc3f64 P 0473d2b2d01f4459b1e90fd12cc7840e: No bootstrap required, opened a new log
I20260709 13:04:11.350164 19601 ts_tablet_manager.cc:1403] T 62c6c134d3d24a1ab144dd9ee6bc3f64 P 0473d2b2d01f4459b1e90fd12cc7840e: Time spent bootstrapping tablet: real 0.155s	user 0.008s	sys 0.005s
I20260709 13:04:11.357120 19600 raft_consensus.cc:359] T 1efebf73c86e432baa55533136b6e12c P e61c3a8f61bb48f8a963c9480e53c168 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:11.357856 19600 raft_consensus.cc:385] T 1efebf73c86e432baa55533136b6e12c P e61c3a8f61bb48f8a963c9480e53c168 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:11.358129 19600 raft_consensus.cc:740] T 1efebf73c86e432baa55533136b6e12c P e61c3a8f61bb48f8a963c9480e53c168 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e61c3a8f61bb48f8a963c9480e53c168, State: Initialized, Role: FOLLOWER
I20260709 13:04:11.359349 19600 consensus_queue.cc:260] T 1efebf73c86e432baa55533136b6e12c P e61c3a8f61bb48f8a963c9480e53c168 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:11.361773 19600 ts_tablet_manager.cc:1434] T 1efebf73c86e432baa55533136b6e12c P e61c3a8f61bb48f8a963c9480e53c168: Time spent starting tablet: real 0.034s	user 0.007s	sys 0.000s
I20260709 13:04:11.363826 19483 raft_consensus.cc:2468] T 0e1085d23e8347fbbd5bce7542f4b1f4 P 0473d2b2d01f4459b1e90fd12cc7840e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 1.
I20260709 13:04:11.366915 19856 raft_consensus.cc:493] T 9962423cb4e54fcfa5de01daf68a86e7 P e5256d91808b47c195bc9b4dbd7f2b87 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:11.367396 19856 raft_consensus.cc:515] T 9962423cb4e54fcfa5de01daf68a86e7 P e5256d91808b47c195bc9b4dbd7f2b87 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:11.367707 19526 leader_election.cc:304] T 0e1085d23e8347fbbd5bce7542f4b1f4 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168; no voters: e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:04:11.371299 19630 raft_consensus.cc:2804] T 0e1085d23e8347fbbd5bce7542f4b1f4 P e61c3a8f61bb48f8a963c9480e53c168 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:11.362824 19600 tablet_bootstrap.cc:492] T 179fd671030940b4b4a4e24bcc4aba0a P e61c3a8f61bb48f8a963c9480e53c168: Bootstrap starting.
I20260709 13:04:11.371807 19630 raft_consensus.cc:697] T 0e1085d23e8347fbbd5bce7542f4b1f4 P e61c3a8f61bb48f8a963c9480e53c168 [term 1 LEADER]: Becoming Leader. State: Replica: e61c3a8f61bb48f8a963c9480e53c168, State: Running, Role: LEADER
I20260709 13:04:11.375459 19856 leader_election.cc:290] T 9962423cb4e54fcfa5de01daf68a86e7 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:04:11.377012 19485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9962423cb4e54fcfa5de01daf68a86e7" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:04:11.378544 19558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9962423cb4e54fcfa5de01daf68a86e7" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:04:11.379381 19601 raft_consensus.cc:359] T 62c6c134d3d24a1ab144dd9ee6bc3f64 P 0473d2b2d01f4459b1e90fd12cc7840e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:11.380211 19601 raft_consensus.cc:385] T 62c6c134d3d24a1ab144dd9ee6bc3f64 P 0473d2b2d01f4459b1e90fd12cc7840e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:11.380558 19601 raft_consensus.cc:740] T 62c6c134d3d24a1ab144dd9ee6bc3f64 P 0473d2b2d01f4459b1e90fd12cc7840e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0473d2b2d01f4459b1e90fd12cc7840e, State: Initialized, Role: FOLLOWER
I20260709 13:04:11.381902 19604 tablet_bootstrap.cc:492] T bc225c93219c45538b53a1bd3d387e4d P e5256d91808b47c195bc9b4dbd7f2b87: No bootstrap required, opened a new log
I20260709 13:04:11.382336 19604 ts_tablet_manager.cc:1403] T bc225c93219c45538b53a1bd3d387e4d P e5256d91808b47c195bc9b4dbd7f2b87: Time spent bootstrapping tablet: real 0.186s	user 0.014s	sys 0.001s
I20260709 13:04:11.382398 19876 consensus_queue.cc:1048] T 9962423cb4e54fcfa5de01daf68a86e7 P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.012s
I20260709 13:04:11.384608 19375 leader_election.cc:304] T 9962423cb4e54fcfa5de01daf68a86e7 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:04:11.385743 19856 raft_consensus.cc:2749] T 9962423cb4e54fcfa5de01daf68a86e7 P e5256d91808b47c195bc9b4dbd7f2b87 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:04:11.386657 19604 raft_consensus.cc:359] T bc225c93219c45538b53a1bd3d387e4d P e5256d91808b47c195bc9b4dbd7f2b87 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:11.387481 19604 raft_consensus.cc:385] T bc225c93219c45538b53a1bd3d387e4d P e5256d91808b47c195bc9b4dbd7f2b87 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:11.387876 19604 raft_consensus.cc:740] T bc225c93219c45538b53a1bd3d387e4d P e5256d91808b47c195bc9b4dbd7f2b87 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e5256d91808b47c195bc9b4dbd7f2b87, State: Initialized, Role: FOLLOWER
I20260709 13:04:11.387970 19630 consensus_queue.cc:237] T 0e1085d23e8347fbbd5bce7542f4b1f4 P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:11.388684 19604 consensus_queue.cc:260] T bc225c93219c45538b53a1bd3d387e4d P e5256d91808b47c195bc9b4dbd7f2b87 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:11.392112 19604 ts_tablet_manager.cc:1434] T bc225c93219c45538b53a1bd3d387e4d P e5256d91808b47c195bc9b4dbd7f2b87: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.001s
I20260709 13:04:11.393246 19604 tablet_bootstrap.cc:492] T df751f992649444090e27965eb1af85d P e5256d91808b47c195bc9b4dbd7f2b87: Bootstrap starting.
I20260709 13:04:11.389272 19601 consensus_queue.cc:260] T 62c6c134d3d24a1ab144dd9ee6bc3f64 P 0473d2b2d01f4459b1e90fd12cc7840e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:11.398313 19601 ts_tablet_manager.cc:1434] T 62c6c134d3d24a1ab144dd9ee6bc3f64 P 0473d2b2d01f4459b1e90fd12cc7840e: Time spent starting tablet: real 0.048s	user 0.006s	sys 0.001s
I20260709 13:04:11.399406 19601 tablet_bootstrap.cc:492] T 1efebf73c86e432baa55533136b6e12c P 0473d2b2d01f4459b1e90fd12cc7840e: Bootstrap starting.
I20260709 13:04:11.423534 19857 raft_consensus.cc:493] T bc225c93219c45538b53a1bd3d387e4d P e5256d91808b47c195bc9b4dbd7f2b87 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:11.424044 19857 raft_consensus.cc:515] T bc225c93219c45538b53a1bd3d387e4d P e5256d91808b47c195bc9b4dbd7f2b87 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:11.427703 19857 leader_election.cc:290] T bc225c93219c45538b53a1bd3d387e4d P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:04:11.429004 19560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc225c93219c45538b53a1bd3d387e4d" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:04:11.429762 19560 raft_consensus.cc:2468] T bc225c93219c45538b53a1bd3d387e4d P e61c3a8f61bb48f8a963c9480e53c168 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 0.
I20260709 13:04:11.430995 19483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc225c93219c45538b53a1bd3d387e4d" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:04:11.431609 19375 leader_election.cc:304] T bc225c93219c45538b53a1bd3d387e4d P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
W20260709 13:04:11.432344 19377 leader_election.cc:343] T bc225c93219c45538b53a1bd3d387e4d P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:11.432533 19855 raft_consensus.cc:2804] T bc225c93219c45538b53a1bd3d387e4d P e5256d91808b47c195bc9b4dbd7f2b87 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:11.432934 19855 raft_consensus.cc:493] T bc225c93219c45538b53a1bd3d387e4d P e5256d91808b47c195bc9b4dbd7f2b87 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:11.433239 19855 raft_consensus.cc:3060] T bc225c93219c45538b53a1bd3d387e4d P e5256d91808b47c195bc9b4dbd7f2b87 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:11.448999 19307 catalog_manager.cc:5697] T 0e1085d23e8347fbbd5bce7542f4b1f4 P e61c3a8f61bb48f8a963c9480e53c168 reported cstate change: term changed from 0 to 1, leader changed from <none> to e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3). New cstate: current_term: 1 leader_uuid: "e61c3a8f61bb48f8a963c9480e53c168" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } health_report { overall_health: HEALTHY } } }
I20260709 13:04:11.454984 19601 tablet_bootstrap.cc:654] T 1efebf73c86e432baa55533136b6e12c P 0473d2b2d01f4459b1e90fd12cc7840e: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:11.461779 19600 tablet_bootstrap.cc:654] T 179fd671030940b4b4a4e24bcc4aba0a P e61c3a8f61bb48f8a963c9480e53c168: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:11.462440 19604 tablet_bootstrap.cc:654] T df751f992649444090e27965eb1af85d P e5256d91808b47c195bc9b4dbd7f2b87: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:11.468595 19855 raft_consensus.cc:515] T bc225c93219c45538b53a1bd3d387e4d P e5256d91808b47c195bc9b4dbd7f2b87 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:11.473084 19604 tablet_bootstrap.cc:492] T df751f992649444090e27965eb1af85d P e5256d91808b47c195bc9b4dbd7f2b87: No bootstrap required, opened a new log
I20260709 13:04:11.477681 19604 ts_tablet_manager.cc:1403] T df751f992649444090e27965eb1af85d P e5256d91808b47c195bc9b4dbd7f2b87: Time spent bootstrapping tablet: real 0.085s	user 0.007s	sys 0.006s
I20260709 13:04:11.474033 19600 tablet_bootstrap.cc:492] T 179fd671030940b4b4a4e24bcc4aba0a P e61c3a8f61bb48f8a963c9480e53c168: No bootstrap required, opened a new log
I20260709 13:04:11.478624 19600 ts_tablet_manager.cc:1403] T 179fd671030940b4b4a4e24bcc4aba0a P e61c3a8f61bb48f8a963c9480e53c168: Time spent bootstrapping tablet: real 0.116s	user 0.012s	sys 0.000s
I20260709 13:04:11.480181 19483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc225c93219c45538b53a1bd3d387e4d" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:04:11.480355 19604 raft_consensus.cc:359] T df751f992649444090e27965eb1af85d P e5256d91808b47c195bc9b4dbd7f2b87 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:11.480986 19604 raft_consensus.cc:385] T df751f992649444090e27965eb1af85d P e5256d91808b47c195bc9b4dbd7f2b87 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:11.481272 19604 raft_consensus.cc:740] T df751f992649444090e27965eb1af85d P e5256d91808b47c195bc9b4dbd7f2b87 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e5256d91808b47c195bc9b4dbd7f2b87, State: Initialized, Role: FOLLOWER
I20260709 13:04:11.481148 19600 raft_consensus.cc:359] T 179fd671030940b4b4a4e24bcc4aba0a P e61c3a8f61bb48f8a963c9480e53c168 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:11.476764 19601 tablet_bootstrap.cc:492] T 1efebf73c86e432baa55533136b6e12c P 0473d2b2d01f4459b1e90fd12cc7840e: No bootstrap required, opened a new log
W20260709 13:04:11.481640 19377 leader_election.cc:343] T bc225c93219c45538b53a1bd3d387e4d P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:11.481993 19604 consensus_queue.cc:260] T df751f992649444090e27965eb1af85d P e5256d91808b47c195bc9b4dbd7f2b87 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:11.482131 19601 ts_tablet_manager.cc:1403] T 1efebf73c86e432baa55533136b6e12c P 0473d2b2d01f4459b1e90fd12cc7840e: Time spent bootstrapping tablet: real 0.083s	user 0.001s	sys 0.012s
I20260709 13:04:11.484491 19604 ts_tablet_manager.cc:1434] T df751f992649444090e27965eb1af85d P e5256d91808b47c195bc9b4dbd7f2b87: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:04:11.485158 19560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc225c93219c45538b53a1bd3d387e4d" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:04:11.485455 19855 leader_election.cc:290] T bc225c93219c45538b53a1bd3d387e4d P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 1 election: Requested vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:04:11.485841 19560 raft_consensus.cc:3060] T bc225c93219c45538b53a1bd3d387e4d P e61c3a8f61bb48f8a963c9480e53c168 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:11.481858 19600 raft_consensus.cc:385] T 179fd671030940b4b4a4e24bcc4aba0a P e61c3a8f61bb48f8a963c9480e53c168 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:11.486888 19600 raft_consensus.cc:740] T 179fd671030940b4b4a4e24bcc4aba0a P e61c3a8f61bb48f8a963c9480e53c168 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e61c3a8f61bb48f8a963c9480e53c168, State: Initialized, Role: FOLLOWER
I20260709 13:04:11.487802 19600 consensus_queue.cc:260] T 179fd671030940b4b4a4e24bcc4aba0a P e61c3a8f61bb48f8a963c9480e53c168 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:11.497011 19600 ts_tablet_manager.cc:1434] T 179fd671030940b4b4a4e24bcc4aba0a P e61c3a8f61bb48f8a963c9480e53c168: Time spent starting tablet: real 0.018s	user 0.005s	sys 0.000s
I20260709 13:04:11.490626 19601 raft_consensus.cc:359] T 1efebf73c86e432baa55533136b6e12c P 0473d2b2d01f4459b1e90fd12cc7840e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:11.492277 19832 raft_consensus.cc:493] T df751f992649444090e27965eb1af85d P e61c3a8f61bb48f8a963c9480e53c168 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:11.497591 19601 raft_consensus.cc:385] T 1efebf73c86e432baa55533136b6e12c P 0473d2b2d01f4459b1e90fd12cc7840e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:11.497943 19601 raft_consensus.cc:740] T 1efebf73c86e432baa55533136b6e12c P 0473d2b2d01f4459b1e90fd12cc7840e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0473d2b2d01f4459b1e90fd12cc7840e, State: Initialized, Role: FOLLOWER
I20260709 13:04:11.497732 19832 raft_consensus.cc:515] T df751f992649444090e27965eb1af85d P e61c3a8f61bb48f8a963c9480e53c168 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:11.499887 19832 leader_election.cc:290] T df751f992649444090e27965eb1af85d P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:04:11.498737 19601 consensus_queue.cc:260] T 1efebf73c86e432baa55533136b6e12c P 0473d2b2d01f4459b1e90fd12cc7840e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:11.504434 19601 ts_tablet_manager.cc:1434] T 1efebf73c86e432baa55533136b6e12c P 0473d2b2d01f4459b1e90fd12cc7840e: Time spent starting tablet: real 0.021s	user 0.002s	sys 0.003s
I20260709 13:04:11.505460 19601 tablet_bootstrap.cc:492] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P 0473d2b2d01f4459b1e90fd12cc7840e: Bootstrap starting.
I20260709 13:04:11.503142 19411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df751f992649444090e27965eb1af85d" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:04:11.506913 19411 raft_consensus.cc:2468] T df751f992649444090e27965eb1af85d P e5256d91808b47c195bc9b4dbd7f2b87 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 0.
I20260709 13:04:11.492487 19604 tablet_bootstrap.cc:492] T 62c6c134d3d24a1ab144dd9ee6bc3f64 P e5256d91808b47c195bc9b4dbd7f2b87: Bootstrap starting.
I20260709 13:04:11.508249 19523 leader_election.cc:304] T df751f992649444090e27965eb1af85d P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:04:11.505368 19483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df751f992649444090e27965eb1af85d" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:04:11.509215 19483 raft_consensus.cc:2468] T df751f992649444090e27965eb1af85d P 0473d2b2d01f4459b1e90fd12cc7840e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 0.
I20260709 13:04:11.509958 19630 raft_consensus.cc:493] T 179fd671030940b4b4a4e24bcc4aba0a P e61c3a8f61bb48f8a963c9480e53c168 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:11.510398 19630 raft_consensus.cc:515] T 179fd671030940b4b4a4e24bcc4aba0a P e61c3a8f61bb48f8a963c9480e53c168 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:11.514460 19600 tablet_bootstrap.cc:492] T 775c229504194560ba9589bc2199b089 P e61c3a8f61bb48f8a963c9480e53c168: Bootstrap starting.
I20260709 13:04:11.515246 19411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "179fd671030940b4b4a4e24bcc4aba0a" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:04:11.517041 19687 raft_consensus.cc:2804] T df751f992649444090e27965eb1af85d P e61c3a8f61bb48f8a963c9480e53c168 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:11.517470 19687 raft_consensus.cc:493] T df751f992649444090e27965eb1af85d P e61c3a8f61bb48f8a963c9480e53c168 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:11.517573 19604 tablet_bootstrap.cc:654] T 62c6c134d3d24a1ab144dd9ee6bc3f64 P e5256d91808b47c195bc9b4dbd7f2b87: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:11.517827 19687 raft_consensus.cc:3060] T df751f992649444090e27965eb1af85d P e61c3a8f61bb48f8a963c9480e53c168 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:11.523036 19483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "179fd671030940b4b4a4e24bcc4aba0a" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
W20260709 13:04:11.524722 19526 leader_election.cc:343] T 179fd671030940b4b4a4e24bcc4aba0a P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:04:11.525552 19523 leader_election.cc:343] T 179fd671030940b4b4a4e24bcc4aba0a P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:11.526086 19523 leader_election.cc:304] T 179fd671030940b4b4a4e24bcc4aba0a P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e61c3a8f61bb48f8a963c9480e53c168; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:04:11.526927 19600 tablet_bootstrap.cc:654] T 775c229504194560ba9589bc2199b089 P e61c3a8f61bb48f8a963c9480e53c168: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:11.528311 19808 raft_consensus.cc:2749] T 179fd671030940b4b4a4e24bcc4aba0a P e61c3a8f61bb48f8a963c9480e53c168 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:04:11.526824 19630 leader_election.cc:290] T 179fd671030940b4b4a4e24bcc4aba0a P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:04:11.534155 19604 tablet_bootstrap.cc:492] T 62c6c134d3d24a1ab144dd9ee6bc3f64 P e5256d91808b47c195bc9b4dbd7f2b87: No bootstrap required, opened a new log
I20260709 13:04:11.534613 19604 ts_tablet_manager.cc:1403] T 62c6c134d3d24a1ab144dd9ee6bc3f64 P e5256d91808b47c195bc9b4dbd7f2b87: Time spent bootstrapping tablet: real 0.042s	user 0.004s	sys 0.012s
I20260709 13:04:11.535140 19601 tablet_bootstrap.cc:654] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P 0473d2b2d01f4459b1e90fd12cc7840e: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:11.494468 19560 raft_consensus.cc:2468] T bc225c93219c45538b53a1bd3d387e4d P e61c3a8f61bb48f8a963c9480e53c168 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 1.
I20260709 13:04:11.537086 19375 leader_election.cc:304] T bc225c93219c45538b53a1bd3d387e4d P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168; no voters: 0473d2b2d01f4459b1e90fd12cc7840e
I20260709 13:04:11.539521 19855 raft_consensus.cc:2804] T bc225c93219c45538b53a1bd3d387e4d P e5256d91808b47c195bc9b4dbd7f2b87 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:11.537508 19604 raft_consensus.cc:359] T 62c6c134d3d24a1ab144dd9ee6bc3f64 P e5256d91808b47c195bc9b4dbd7f2b87 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:11.556171 19604 raft_consensus.cc:385] T 62c6c134d3d24a1ab144dd9ee6bc3f64 P e5256d91808b47c195bc9b4dbd7f2b87 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:11.556437 19604 raft_consensus.cc:740] T 62c6c134d3d24a1ab144dd9ee6bc3f64 P e5256d91808b47c195bc9b4dbd7f2b87 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e5256d91808b47c195bc9b4dbd7f2b87, State: Initialized, Role: FOLLOWER
I20260709 13:04:11.557723 19604 consensus_queue.cc:260] T 62c6c134d3d24a1ab144dd9ee6bc3f64 P e5256d91808b47c195bc9b4dbd7f2b87 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:11.555558 19687 raft_consensus.cc:515] T df751f992649444090e27965eb1af85d P e61c3a8f61bb48f8a963c9480e53c168 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:11.566383 19411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df751f992649444090e27965eb1af85d" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
I20260709 13:04:11.567021 19411 raft_consensus.cc:3060] T df751f992649444090e27965eb1af85d P e5256d91808b47c195bc9b4dbd7f2b87 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:11.567567 19604 ts_tablet_manager.cc:1434] T 62c6c134d3d24a1ab144dd9ee6bc3f64 P e5256d91808b47c195bc9b4dbd7f2b87: Time spent starting tablet: real 0.033s	user 0.005s	sys 0.001s
I20260709 13:04:11.568215 19855 raft_consensus.cc:697] T bc225c93219c45538b53a1bd3d387e4d P e5256d91808b47c195bc9b4dbd7f2b87 [term 1 LEADER]: Becoming Leader. State: Replica: e5256d91808b47c195bc9b4dbd7f2b87, State: Running, Role: LEADER
I20260709 13:04:11.569064 19855 consensus_queue.cc:237] T bc225c93219c45538b53a1bd3d387e4d P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:11.570266 19600 tablet_bootstrap.cc:492] T 775c229504194560ba9589bc2199b089 P e61c3a8f61bb48f8a963c9480e53c168: No bootstrap required, opened a new log
I20260709 13:04:11.570721 19600 ts_tablet_manager.cc:1403] T 775c229504194560ba9589bc2199b089 P e61c3a8f61bb48f8a963c9480e53c168: Time spent bootstrapping tablet: real 0.056s	user 0.012s	sys 0.007s
I20260709 13:04:11.581182 19604 tablet_bootstrap.cc:492] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P e5256d91808b47c195bc9b4dbd7f2b87: Bootstrap starting.
I20260709 13:04:11.590193 19485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df751f992649444090e27965eb1af85d" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:04:11.590843 19485 raft_consensus.cc:3060] T df751f992649444090e27965eb1af85d P 0473d2b2d01f4459b1e90fd12cc7840e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:11.585913 19687 leader_election.cc:290] T df751f992649444090e27965eb1af85d P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 1 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:04:11.591178 19600 raft_consensus.cc:359] T 775c229504194560ba9589bc2199b089 P e61c3a8f61bb48f8a963c9480e53c168 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:11.591996 19600 raft_consensus.cc:385] T 775c229504194560ba9589bc2199b089 P e61c3a8f61bb48f8a963c9480e53c168 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:11.592278 19600 raft_consensus.cc:740] T 775c229504194560ba9589bc2199b089 P e61c3a8f61bb48f8a963c9480e53c168 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e61c3a8f61bb48f8a963c9480e53c168, State: Initialized, Role: FOLLOWER
I20260709 13:04:11.592926 19600 consensus_queue.cc:260] T 775c229504194560ba9589bc2199b089 P e61c3a8f61bb48f8a963c9480e53c168 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:11.596521 19411 raft_consensus.cc:2468] T df751f992649444090e27965eb1af85d P e5256d91808b47c195bc9b4dbd7f2b87 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 1.
I20260709 13:04:11.598100 19485 raft_consensus.cc:2468] T df751f992649444090e27965eb1af85d P 0473d2b2d01f4459b1e90fd12cc7840e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 1.
I20260709 13:04:11.600339 19601 tablet_bootstrap.cc:492] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P 0473d2b2d01f4459b1e90fd12cc7840e: No bootstrap required, opened a new log
I20260709 13:04:11.600404 19526 leader_election.cc:304] T df751f992649444090e27965eb1af85d P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:04:11.600876 19601 ts_tablet_manager.cc:1403] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P 0473d2b2d01f4459b1e90fd12cc7840e: Time spent bootstrapping tablet: real 0.096s	user 0.011s	sys 0.010s
I20260709 13:04:11.601526 19630 raft_consensus.cc:2804] T df751f992649444090e27965eb1af85d P e61c3a8f61bb48f8a963c9480e53c168 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:11.601987 19630 raft_consensus.cc:697] T df751f992649444090e27965eb1af85d P e61c3a8f61bb48f8a963c9480e53c168 [term 1 LEADER]: Becoming Leader. State: Replica: e61c3a8f61bb48f8a963c9480e53c168, State: Running, Role: LEADER
I20260709 13:04:11.602921 19630 consensus_queue.cc:237] T df751f992649444090e27965eb1af85d P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:11.608425 19600 ts_tablet_manager.cc:1434] T 775c229504194560ba9589bc2199b089 P e61c3a8f61bb48f8a963c9480e53c168: Time spent starting tablet: real 0.037s	user 0.006s	sys 0.000s
I20260709 13:04:11.611768 19601 raft_consensus.cc:359] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P 0473d2b2d01f4459b1e90fd12cc7840e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:11.612504 19601 raft_consensus.cc:385] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P 0473d2b2d01f4459b1e90fd12cc7840e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:11.612816 19601 raft_consensus.cc:740] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P 0473d2b2d01f4459b1e90fd12cc7840e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0473d2b2d01f4459b1e90fd12cc7840e, State: Initialized, Role: FOLLOWER
I20260709 13:04:11.613481 19601 consensus_queue.cc:260] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P 0473d2b2d01f4459b1e90fd12cc7840e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:11.615777 19601 ts_tablet_manager.cc:1434] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P 0473d2b2d01f4459b1e90fd12cc7840e: Time spent starting tablet: real 0.015s	user 0.008s	sys 0.000s
I20260709 13:04:11.618903 19600 tablet_bootstrap.cc:492] T 21e14947d70440f19044d8f75c31e1f9 P e61c3a8f61bb48f8a963c9480e53c168: Bootstrap starting.
I20260709 13:04:11.622409 19604 tablet_bootstrap.cc:654] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P e5256d91808b47c195bc9b4dbd7f2b87: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:11.629304 19876 raft_consensus.cc:493] T 62c6c134d3d24a1ab144dd9ee6bc3f64 P 0473d2b2d01f4459b1e90fd12cc7840e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:11.629925 19876 raft_consensus.cc:515] T 62c6c134d3d24a1ab144dd9ee6bc3f64 P 0473d2b2d01f4459b1e90fd12cc7840e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:11.630040 19307 catalog_manager.cc:5697] T bc225c93219c45538b53a1bd3d387e4d P e5256d91808b47c195bc9b4dbd7f2b87 reported cstate change: term changed from 0 to 1, leader changed from <none> to e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1). New cstate: current_term: 1 leader_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:11.631460 19601 tablet_bootstrap.cc:492] T 21e14947d70440f19044d8f75c31e1f9 P 0473d2b2d01f4459b1e90fd12cc7840e: Bootstrap starting.
I20260709 13:04:11.635507 19560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62c6c134d3d24a1ab144dd9ee6bc3f64" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:04:11.636162 19560 raft_consensus.cc:2468] T 62c6c134d3d24a1ab144dd9ee6bc3f64 P e61c3a8f61bb48f8a963c9480e53c168 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 0.
I20260709 13:04:11.637538 19601 tablet_bootstrap.cc:654] T 21e14947d70440f19044d8f75c31e1f9 P 0473d2b2d01f4459b1e90fd12cc7840e: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:11.637547 19450 leader_election.cc:304] T 62c6c134d3d24a1ab144dd9ee6bc3f64 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:04:11.639561 19408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62c6c134d3d24a1ab144dd9ee6bc3f64" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:04:11.640198 19408 raft_consensus.cc:2468] T 62c6c134d3d24a1ab144dd9ee6bc3f64 P e5256d91808b47c195bc9b4dbd7f2b87 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 0.
I20260709 13:04:11.641147 19881 raft_consensus.cc:2804] T 62c6c134d3d24a1ab144dd9ee6bc3f64 P 0473d2b2d01f4459b1e90fd12cc7840e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:11.642128 19881 raft_consensus.cc:493] T 62c6c134d3d24a1ab144dd9ee6bc3f64 P 0473d2b2d01f4459b1e90fd12cc7840e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:11.647687 19881 raft_consensus.cc:3060] T 62c6c134d3d24a1ab144dd9ee6bc3f64 P 0473d2b2d01f4459b1e90fd12cc7840e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:11.653437 19601 tablet_bootstrap.cc:492] T 21e14947d70440f19044d8f75c31e1f9 P 0473d2b2d01f4459b1e90fd12cc7840e: No bootstrap required, opened a new log
I20260709 13:04:11.653884 19601 ts_tablet_manager.cc:1403] T 21e14947d70440f19044d8f75c31e1f9 P 0473d2b2d01f4459b1e90fd12cc7840e: Time spent bootstrapping tablet: real 0.023s	user 0.008s	sys 0.004s
I20260709 13:04:11.656457 19604 tablet_bootstrap.cc:492] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P e5256d91808b47c195bc9b4dbd7f2b87: No bootstrap required, opened a new log
I20260709 13:04:11.656334 19601 raft_consensus.cc:359] T 21e14947d70440f19044d8f75c31e1f9 P 0473d2b2d01f4459b1e90fd12cc7840e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:11.656929 19604 ts_tablet_manager.cc:1403] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P e5256d91808b47c195bc9b4dbd7f2b87: Time spent bootstrapping tablet: real 0.076s	user 0.006s	sys 0.005s
I20260709 13:04:11.656996 19601 raft_consensus.cc:385] T 21e14947d70440f19044d8f75c31e1f9 P 0473d2b2d01f4459b1e90fd12cc7840e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:11.657366 19601 raft_consensus.cc:740] T 21e14947d70440f19044d8f75c31e1f9 P 0473d2b2d01f4459b1e90fd12cc7840e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0473d2b2d01f4459b1e90fd12cc7840e, State: Initialized, Role: FOLLOWER
I20260709 13:04:11.658730 19876 leader_election.cc:290] T 62c6c134d3d24a1ab144dd9ee6bc3f64 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:04:11.658339 19309 catalog_manager.cc:5697] T df751f992649444090e27965eb1af85d P e61c3a8f61bb48f8a963c9480e53c168 reported cstate change: term changed from 0 to 1, leader changed from <none> to e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3). New cstate: current_term: 1 leader_uuid: "e61c3a8f61bb48f8a963c9480e53c168" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } health_report { overall_health: HEALTHY } } }
I20260709 13:04:11.660341 19604 raft_consensus.cc:359] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P e5256d91808b47c195bc9b4dbd7f2b87 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:11.661449 19604 raft_consensus.cc:385] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P e5256d91808b47c195bc9b4dbd7f2b87 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:11.661706 19604 raft_consensus.cc:740] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P e5256d91808b47c195bc9b4dbd7f2b87 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e5256d91808b47c195bc9b4dbd7f2b87, State: Initialized, Role: FOLLOWER
I20260709 13:04:11.662279 19604 consensus_queue.cc:260] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P e5256d91808b47c195bc9b4dbd7f2b87 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:11.667959 19881 raft_consensus.cc:515] T 62c6c134d3d24a1ab144dd9ee6bc3f64 P 0473d2b2d01f4459b1e90fd12cc7840e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:11.670895 19408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62c6c134d3d24a1ab144dd9ee6bc3f64" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
I20260709 13:04:11.670926 19601 consensus_queue.cc:260] T 21e14947d70440f19044d8f75c31e1f9 P 0473d2b2d01f4459b1e90fd12cc7840e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:11.671583 19408 raft_consensus.cc:3060] T 62c6c134d3d24a1ab144dd9ee6bc3f64 P e5256d91808b47c195bc9b4dbd7f2b87 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:11.673089 19601 ts_tablet_manager.cc:1434] T 21e14947d70440f19044d8f75c31e1f9 P 0473d2b2d01f4459b1e90fd12cc7840e: Time spent starting tablet: real 0.019s	user 0.005s	sys 0.001s
I20260709 13:04:11.674021 19601 tablet_bootstrap.cc:492] T bc225c93219c45538b53a1bd3d387e4d P 0473d2b2d01f4459b1e90fd12cc7840e: Bootstrap starting.
I20260709 13:04:11.679244 19560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62c6c134d3d24a1ab144dd9ee6bc3f64" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:04:11.679869 19560 raft_consensus.cc:3060] T 62c6c134d3d24a1ab144dd9ee6bc3f64 P e61c3a8f61bb48f8a963c9480e53c168 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:11.680650 19601 tablet_bootstrap.cc:654] T bc225c93219c45538b53a1bd3d387e4d P 0473d2b2d01f4459b1e90fd12cc7840e: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:11.645984 19600 tablet_bootstrap.cc:654] T 21e14947d70440f19044d8f75c31e1f9 P e61c3a8f61bb48f8a963c9480e53c168: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:11.683167 19604 ts_tablet_manager.cc:1434] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P e5256d91808b47c195bc9b4dbd7f2b87: Time spent starting tablet: real 0.026s	user 0.008s	sys 0.000s
I20260709 13:04:11.684245 19604 tablet_bootstrap.cc:492] T 1efebf73c86e432baa55533136b6e12c P e5256d91808b47c195bc9b4dbd7f2b87: Bootstrap starting.
I20260709 13:04:11.687026 19560 raft_consensus.cc:2468] T 62c6c134d3d24a1ab144dd9ee6bc3f64 P e61c3a8f61bb48f8a963c9480e53c168 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 1.
I20260709 13:04:11.688308 19832 consensus_queue.cc:1048] T 4af19371ea874c09a0a2147040835cbb P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:11.688949 19450 leader_election.cc:304] T 62c6c134d3d24a1ab144dd9ee6bc3f64 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:04:11.689654 19876 raft_consensus.cc:2804] T 62c6c134d3d24a1ab144dd9ee6bc3f64 P 0473d2b2d01f4459b1e90fd12cc7840e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:11.690119 19876 raft_consensus.cc:697] T 62c6c134d3d24a1ab144dd9ee6bc3f64 P 0473d2b2d01f4459b1e90fd12cc7840e [term 1 LEADER]: Becoming Leader. State: Replica: 0473d2b2d01f4459b1e90fd12cc7840e, State: Running, Role: LEADER
I20260709 13:04:11.690549 19408 raft_consensus.cc:2468] T 62c6c134d3d24a1ab144dd9ee6bc3f64 P e5256d91808b47c195bc9b4dbd7f2b87 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 1.
I20260709 13:04:11.690968 19876 consensus_queue.cc:237] T 62c6c134d3d24a1ab144dd9ee6bc3f64 P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:11.691715 19881 leader_election.cc:290] T 62c6c134d3d24a1ab144dd9ee6bc3f64 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 1 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:04:11.713043 19879 raft_consensus.cc:493] T 21e14947d70440f19044d8f75c31e1f9 P 0473d2b2d01f4459b1e90fd12cc7840e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:11.713644 19879 raft_consensus.cc:515] T 21e14947d70440f19044d8f75c31e1f9 P 0473d2b2d01f4459b1e90fd12cc7840e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:11.736431 19556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21e14947d70440f19044d8f75c31e1f9" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:04:11.737252 19409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21e14947d70440f19044d8f75c31e1f9" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
W20260709 13:04:11.738029 19450 leader_election.cc:343] T 21e14947d70440f19044d8f75c31e1f9 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:04:11.738555 19449 leader_election.cc:343] T 21e14947d70440f19044d8f75c31e1f9 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:11.739019 19449 leader_election.cc:304] T 21e14947d70440f19044d8f75c31e1f9 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e; no voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:04:11.738583 19879 leader_election.cc:290] T 21e14947d70440f19044d8f75c31e1f9 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:04:11.739773 19814 raft_consensus.cc:2749] T 21e14947d70440f19044d8f75c31e1f9 P 0473d2b2d01f4459b1e90fd12cc7840e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:04:11.739266 19604 tablet_bootstrap.cc:654] T 1efebf73c86e432baa55533136b6e12c P e5256d91808b47c195bc9b4dbd7f2b87: Neither blocks nor log segments found. Creating new log.
W20260709 13:04:11.740813 19523 consensus_peers.cc:597] T 4af19371ea874c09a0a2147040835cbb P e61c3a8f61bb48f8a963c9480e53c168 -> Peer e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321): Couldn't send request to peer e5256d91808b47c195bc9b4dbd7f2b87. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:11.740883 19808 raft_consensus.cc:493] T 1efebf73c86e432baa55533136b6e12c P e61c3a8f61bb48f8a963c9480e53c168 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:11.741477 19808 raft_consensus.cc:515] T 1efebf73c86e432baa55533136b6e12c P e61c3a8f61bb48f8a963c9480e53c168 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:11.744061 19808 leader_election.cc:290] T 1efebf73c86e432baa55533136b6e12c P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:04:11.745611 19409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1efebf73c86e432baa55533136b6e12c" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:04:11.746927 19482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1efebf73c86e432baa55533136b6e12c" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:04:11.747691 19482 raft_consensus.cc:2468] T 1efebf73c86e432baa55533136b6e12c P 0473d2b2d01f4459b1e90fd12cc7840e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 0.
W20260709 13:04:11.749779 19523 leader_election.cc:343] T 1efebf73c86e432baa55533136b6e12c P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:11.751935 19526 leader_election.cc:304] T 1efebf73c86e432baa55533136b6e12c P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168; no voters: e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:04:11.752731 19832 raft_consensus.cc:2804] T 1efebf73c86e432baa55533136b6e12c P e61c3a8f61bb48f8a963c9480e53c168 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:11.753119 19832 raft_consensus.cc:493] T 1efebf73c86e432baa55533136b6e12c P e61c3a8f61bb48f8a963c9480e53c168 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:11.753494 19832 raft_consensus.cc:3060] T 1efebf73c86e432baa55533136b6e12c P e61c3a8f61bb48f8a963c9480e53c168 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:11.754496 19879 consensus_queue.cc:1048] T 6c5eebf646ad445a9d1b1adc319d7b16 P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:11.762281 19832 raft_consensus.cc:515] T 1efebf73c86e432baa55533136b6e12c P e61c3a8f61bb48f8a963c9480e53c168 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:11.764779 19832 leader_election.cc:290] T 1efebf73c86e432baa55533136b6e12c P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 1 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:04:11.765475 19409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1efebf73c86e432baa55533136b6e12c" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
I20260709 13:04:11.765552 19814 consensus_queue.cc:1048] T 6c5eebf646ad445a9d1b1adc319d7b16 P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260709 13:04:11.767212 19523 leader_election.cc:343] T 1efebf73c86e432baa55533136b6e12c P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:11.773211 19482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1efebf73c86e432baa55533136b6e12c" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:04:11.781213 19482 raft_consensus.cc:3060] T 1efebf73c86e432baa55533136b6e12c P 0473d2b2d01f4459b1e90fd12cc7840e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:11.805326 19604 tablet_bootstrap.cc:492] T 1efebf73c86e432baa55533136b6e12c P e5256d91808b47c195bc9b4dbd7f2b87: No bootstrap required, opened a new log
I20260709 13:04:11.805874 19604 ts_tablet_manager.cc:1403] T 1efebf73c86e432baa55533136b6e12c P e5256d91808b47c195bc9b4dbd7f2b87: Time spent bootstrapping tablet: real 0.122s	user 0.018s	sys 0.005s
I20260709 13:04:11.808580 19604 raft_consensus.cc:359] T 1efebf73c86e432baa55533136b6e12c P e5256d91808b47c195bc9b4dbd7f2b87 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:11.809284 19604 raft_consensus.cc:385] T 1efebf73c86e432baa55533136b6e12c P e5256d91808b47c195bc9b4dbd7f2b87 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:11.809547 19604 raft_consensus.cc:740] T 1efebf73c86e432baa55533136b6e12c P e5256d91808b47c195bc9b4dbd7f2b87 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e5256d91808b47c195bc9b4dbd7f2b87, State: Initialized, Role: FOLLOWER
I20260709 13:04:11.810740 19604 consensus_queue.cc:260] T 1efebf73c86e432baa55533136b6e12c P e5256d91808b47c195bc9b4dbd7f2b87 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:11.813030 19604 ts_tablet_manager.cc:1434] T 1efebf73c86e432baa55533136b6e12c P e5256d91808b47c195bc9b4dbd7f2b87: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 13:04:11.814947 19600 tablet_bootstrap.cc:492] T 21e14947d70440f19044d8f75c31e1f9 P e61c3a8f61bb48f8a963c9480e53c168: No bootstrap required, opened a new log
I20260709 13:04:11.815349 19600 ts_tablet_manager.cc:1403] T 21e14947d70440f19044d8f75c31e1f9 P e61c3a8f61bb48f8a963c9480e53c168: Time spent bootstrapping tablet: real 0.197s	user 0.039s	sys 0.026s
I20260709 13:04:11.818125 19482 raft_consensus.cc:2468] T 1efebf73c86e432baa55533136b6e12c P 0473d2b2d01f4459b1e90fd12cc7840e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 1.
I20260709 13:04:11.825255 19601 tablet_bootstrap.cc:492] T bc225c93219c45538b53a1bd3d387e4d P 0473d2b2d01f4459b1e90fd12cc7840e: No bootstrap required, opened a new log
I20260709 13:04:11.818763 19600 raft_consensus.cc:359] T 21e14947d70440f19044d8f75c31e1f9 P e61c3a8f61bb48f8a963c9480e53c168 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:11.825783 19601 ts_tablet_manager.cc:1403] T bc225c93219c45538b53a1bd3d387e4d P 0473d2b2d01f4459b1e90fd12cc7840e: Time spent bootstrapping tablet: real 0.152s	user 0.009s	sys 0.006s
I20260709 13:04:11.825847 19600 raft_consensus.cc:385] T 21e14947d70440f19044d8f75c31e1f9 P e61c3a8f61bb48f8a963c9480e53c168 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:11.826247 19600 raft_consensus.cc:740] T 21e14947d70440f19044d8f75c31e1f9 P e61c3a8f61bb48f8a963c9480e53c168 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e61c3a8f61bb48f8a963c9480e53c168, State: Initialized, Role: FOLLOWER
I20260709 13:04:11.831517 19307 catalog_manager.cc:5697] T 62c6c134d3d24a1ab144dd9ee6bc3f64 P 0473d2b2d01f4459b1e90fd12cc7840e reported cstate change: term changed from 0 to 1, leader changed from <none> to 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2). New cstate: current_term: 1 leader_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:11.834084 19600 consensus_queue.cc:260] T 21e14947d70440f19044d8f75c31e1f9 P e61c3a8f61bb48f8a963c9480e53c168 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:11.835893 19601 raft_consensus.cc:359] T bc225c93219c45538b53a1bd3d387e4d P 0473d2b2d01f4459b1e90fd12cc7840e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:11.836431 19600 ts_tablet_manager.cc:1434] T 21e14947d70440f19044d8f75c31e1f9 P e61c3a8f61bb48f8a963c9480e53c168: Time spent starting tablet: real 0.021s	user 0.006s	sys 0.010s
I20260709 13:04:11.839375 19600 tablet_bootstrap.cc:492] T 4509b76741dc428e9201c70c1658da13 P e61c3a8f61bb48f8a963c9480e53c168: Bootstrap starting.
I20260709 13:04:11.836701 19601 raft_consensus.cc:385] T bc225c93219c45538b53a1bd3d387e4d P 0473d2b2d01f4459b1e90fd12cc7840e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:11.842402 19601 raft_consensus.cc:740] T bc225c93219c45538b53a1bd3d387e4d P 0473d2b2d01f4459b1e90fd12cc7840e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0473d2b2d01f4459b1e90fd12cc7840e, State: Initialized, Role: FOLLOWER
I20260709 13:04:11.843464 19526 leader_election.cc:304] T 1efebf73c86e432baa55533136b6e12c P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168; no voters: e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:04:11.843560 19601 consensus_queue.cc:260] T bc225c93219c45538b53a1bd3d387e4d P 0473d2b2d01f4459b1e90fd12cc7840e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:11.844980 19832 raft_consensus.cc:2804] T 1efebf73c86e432baa55533136b6e12c P e61c3a8f61bb48f8a963c9480e53c168 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:11.845512 19832 raft_consensus.cc:697] T 1efebf73c86e432baa55533136b6e12c P e61c3a8f61bb48f8a963c9480e53c168 [term 1 LEADER]: Becoming Leader. State: Replica: e61c3a8f61bb48f8a963c9480e53c168, State: Running, Role: LEADER
I20260709 13:04:11.845681 19601 ts_tablet_manager.cc:1434] T bc225c93219c45538b53a1bd3d387e4d P 0473d2b2d01f4459b1e90fd12cc7840e: Time spent starting tablet: real 0.020s	user 0.004s	sys 0.000s
I20260709 13:04:11.846377 19832 consensus_queue.cc:237] T 1efebf73c86e432baa55533136b6e12c P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:11.851032 19604 tablet_bootstrap.cc:492] T edd7d470b5014c9489be7f41f64355c9 P e5256d91808b47c195bc9b4dbd7f2b87: Bootstrap starting.
I20260709 13:04:11.854740 19600 tablet_bootstrap.cc:654] T 4509b76741dc428e9201c70c1658da13 P e61c3a8f61bb48f8a963c9480e53c168: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:11.862923 19601 tablet_bootstrap.cc:492] T 65d8cb8d6ec64f459d5a47cefab10acf P 0473d2b2d01f4459b1e90fd12cc7840e: Bootstrap starting.
W20260709 13:04:11.885352 19357 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:04:11.887913 19604 tablet_bootstrap.cc:654] T edd7d470b5014c9489be7f41f64355c9 P e5256d91808b47c195bc9b4dbd7f2b87: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:11.889569 19600 tablet_bootstrap.cc:492] T 4509b76741dc428e9201c70c1658da13 P e61c3a8f61bb48f8a963c9480e53c168: No bootstrap required, opened a new log
I20260709 13:04:11.890097 19600 ts_tablet_manager.cc:1403] T 4509b76741dc428e9201c70c1658da13 P e61c3a8f61bb48f8a963c9480e53c168: Time spent bootstrapping tablet: real 0.053s	user 0.009s	sys 0.009s
I20260709 13:04:11.895165 19600 raft_consensus.cc:359] T 4509b76741dc428e9201c70c1658da13 P e61c3a8f61bb48f8a963c9480e53c168 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:11.895963 19600 raft_consensus.cc:385] T 4509b76741dc428e9201c70c1658da13 P e61c3a8f61bb48f8a963c9480e53c168 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:11.896255 19600 raft_consensus.cc:740] T 4509b76741dc428e9201c70c1658da13 P e61c3a8f61bb48f8a963c9480e53c168 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e61c3a8f61bb48f8a963c9480e53c168, State: Initialized, Role: FOLLOWER
I20260709 13:04:11.896953 19600 consensus_queue.cc:260] T 4509b76741dc428e9201c70c1658da13 P e61c3a8f61bb48f8a963c9480e53c168 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:11.897883 19601 tablet_bootstrap.cc:654] T 65d8cb8d6ec64f459d5a47cefab10acf P 0473d2b2d01f4459b1e90fd12cc7840e: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:11.899451 19600 ts_tablet_manager.cc:1434] T 4509b76741dc428e9201c70c1658da13 P e61c3a8f61bb48f8a963c9480e53c168: Time spent starting tablet: real 0.009s	user 0.005s	sys 0.002s
I20260709 13:04:11.900542 19600 tablet_bootstrap.cc:492] T 85c494af21f9457a85da47b9bc70c1fd P e61c3a8f61bb48f8a963c9480e53c168: Bootstrap starting.
I20260709 13:04:11.907518 19600 tablet_bootstrap.cc:654] T 85c494af21f9457a85da47b9bc70c1fd P e61c3a8f61bb48f8a963c9480e53c168: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:11.893108 19307 catalog_manager.cc:5697] T 1efebf73c86e432baa55533136b6e12c P e61c3a8f61bb48f8a963c9480e53c168 reported cstate change: term changed from 0 to 1, leader changed from <none> to e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3). New cstate: current_term: 1 leader_uuid: "e61c3a8f61bb48f8a963c9480e53c168" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } health_report { overall_health: HEALTHY } } }
I20260709 13:04:11.915773 19604 tablet_bootstrap.cc:492] T edd7d470b5014c9489be7f41f64355c9 P e5256d91808b47c195bc9b4dbd7f2b87: No bootstrap required, opened a new log
I20260709 13:04:11.916422 19604 ts_tablet_manager.cc:1403] T edd7d470b5014c9489be7f41f64355c9 P e5256d91808b47c195bc9b4dbd7f2b87: Time spent bootstrapping tablet: real 0.096s	user 0.012s	sys 0.015s
I20260709 13:04:11.917346 19601 tablet_bootstrap.cc:492] T 65d8cb8d6ec64f459d5a47cefab10acf P 0473d2b2d01f4459b1e90fd12cc7840e: No bootstrap required, opened a new log
I20260709 13:04:11.917804 19601 ts_tablet_manager.cc:1403] T 65d8cb8d6ec64f459d5a47cefab10acf P 0473d2b2d01f4459b1e90fd12cc7840e: Time spent bootstrapping tablet: real 0.066s	user 0.009s	sys 0.005s
I20260709 13:04:11.919567 19604 raft_consensus.cc:359] T edd7d470b5014c9489be7f41f64355c9 P e5256d91808b47c195bc9b4dbd7f2b87 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:11.920385 19601 raft_consensus.cc:359] T 65d8cb8d6ec64f459d5a47cefab10acf P 0473d2b2d01f4459b1e90fd12cc7840e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:11.920797 19604 raft_consensus.cc:385] T edd7d470b5014c9489be7f41f64355c9 P e5256d91808b47c195bc9b4dbd7f2b87 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:11.921003 19601 raft_consensus.cc:385] T 65d8cb8d6ec64f459d5a47cefab10acf P 0473d2b2d01f4459b1e90fd12cc7840e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:11.921206 19604 raft_consensus.cc:740] T edd7d470b5014c9489be7f41f64355c9 P e5256d91808b47c195bc9b4dbd7f2b87 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e5256d91808b47c195bc9b4dbd7f2b87, State: Initialized, Role: FOLLOWER
I20260709 13:04:11.922106 19604 consensus_queue.cc:260] T edd7d470b5014c9489be7f41f64355c9 P e5256d91808b47c195bc9b4dbd7f2b87 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:11.921289 19601 raft_consensus.cc:740] T 65d8cb8d6ec64f459d5a47cefab10acf P 0473d2b2d01f4459b1e90fd12cc7840e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0473d2b2d01f4459b1e90fd12cc7840e, State: Initialized, Role: FOLLOWER
I20260709 13:04:11.923602 19601 consensus_queue.cc:260] T 65d8cb8d6ec64f459d5a47cefab10acf P 0473d2b2d01f4459b1e90fd12cc7840e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:11.930213 19881 raft_consensus.cc:493] T bc225c93219c45538b53a1bd3d387e4d P 0473d2b2d01f4459b1e90fd12cc7840e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:11.930727 19881 raft_consensus.cc:515] T bc225c93219c45538b53a1bd3d387e4d P 0473d2b2d01f4459b1e90fd12cc7840e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
W20260709 13:04:11.934100 19523 consensus_peers.cc:597] T 0e1085d23e8347fbbd5bce7542f4b1f4 P e61c3a8f61bb48f8a963c9480e53c168 -> Peer e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321): Couldn't send request to peer e5256d91808b47c195bc9b4dbd7f2b87. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:11.934638 19556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc225c93219c45538b53a1bd3d387e4d" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:04:11.935626 19556 raft_consensus.cc:2393] T bc225c93219c45538b53a1bd3d387e4d P e61c3a8f61bb48f8a963c9480e53c168 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0473d2b2d01f4459b1e90fd12cc7840e in current term 1: Already voted for candidate e5256d91808b47c195bc9b4dbd7f2b87 in this term.
I20260709 13:04:11.936923 19881 leader_election.cc:290] T bc225c93219c45538b53a1bd3d387e4d P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:04:11.937630 19600 tablet_bootstrap.cc:492] T 85c494af21f9457a85da47b9bc70c1fd P e61c3a8f61bb48f8a963c9480e53c168: No bootstrap required, opened a new log
I20260709 13:04:11.938122 19600 ts_tablet_manager.cc:1403] T 85c494af21f9457a85da47b9bc70c1fd P e61c3a8f61bb48f8a963c9480e53c168: Time spent bootstrapping tablet: real 0.038s	user 0.035s	sys 0.000s
I20260709 13:04:11.938721 19409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc225c93219c45538b53a1bd3d387e4d" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:04:11.940510 19449 leader_election.cc:304] T bc225c93219c45538b53a1bd3d387e4d P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e; no voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:04:11.941903 19876 raft_consensus.cc:3060] T bc225c93219c45538b53a1bd3d387e4d P 0473d2b2d01f4459b1e90fd12cc7840e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:11.944936 19600 raft_consensus.cc:359] T 85c494af21f9457a85da47b9bc70c1fd P e61c3a8f61bb48f8a963c9480e53c168 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:11.945924 19600 raft_consensus.cc:385] T 85c494af21f9457a85da47b9bc70c1fd P e61c3a8f61bb48f8a963c9480e53c168 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:11.946205 19600 raft_consensus.cc:740] T 85c494af21f9457a85da47b9bc70c1fd P e61c3a8f61bb48f8a963c9480e53c168 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e61c3a8f61bb48f8a963c9480e53c168, State: Initialized, Role: FOLLOWER
I20260709 13:04:11.946887 19600 consensus_queue.cc:260] T 85c494af21f9457a85da47b9bc70c1fd P e61c3a8f61bb48f8a963c9480e53c168 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:11.949132 19604 ts_tablet_manager.cc:1434] T edd7d470b5014c9489be7f41f64355c9 P e5256d91808b47c195bc9b4dbd7f2b87: Time spent starting tablet: real 0.032s	user 0.006s	sys 0.000s
I20260709 13:04:11.949831 19601 ts_tablet_manager.cc:1434] T 65d8cb8d6ec64f459d5a47cefab10acf P 0473d2b2d01f4459b1e90fd12cc7840e: Time spent starting tablet: real 0.032s	user 0.006s	sys 0.002s
I20260709 13:04:11.951582 19601 tablet_bootstrap.cc:492] T 85c494af21f9457a85da47b9bc70c1fd P 0473d2b2d01f4459b1e90fd12cc7840e: Bootstrap starting.
I20260709 13:04:11.952304 19630 raft_consensus.cc:493] T 775c229504194560ba9589bc2199b089 P e61c3a8f61bb48f8a963c9480e53c168 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:11.952800 19630 raft_consensus.cc:515] T 775c229504194560ba9589bc2199b089 P e61c3a8f61bb48f8a963c9480e53c168 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:11.954813 19630 leader_election.cc:290] T 775c229504194560ba9589bc2199b089 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:04:11.951826 19600 ts_tablet_manager.cc:1434] T 85c494af21f9457a85da47b9bc70c1fd P e61c3a8f61bb48f8a963c9480e53c168: Time spent starting tablet: real 0.013s	user 0.005s	sys 0.002s
I20260709 13:04:11.958958 19600 tablet_bootstrap.cc:492] T ece3db938bc649d4a40a51522ed5259c P e61c3a8f61bb48f8a963c9480e53c168: Bootstrap starting.
I20260709 13:04:11.965274 19409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "775c229504194560ba9589bc2199b089" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:04:11.966406 19483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "775c229504194560ba9589bc2199b089" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
W20260709 13:04:11.966869 19523 leader_election.cc:343] T 775c229504194560ba9589bc2199b089 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:04:11.968832 19526 leader_election.cc:343] T 775c229504194560ba9589bc2199b089 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:11.969292 19526 leader_election.cc:304] T 775c229504194560ba9589bc2199b089 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e61c3a8f61bb48f8a963c9480e53c168; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:04:11.969414 19855 raft_consensus.cc:493] T 1efebf73c86e432baa55533136b6e12c P e5256d91808b47c195bc9b4dbd7f2b87 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:11.970028 19855 raft_consensus.cc:515] T 1efebf73c86e432baa55533136b6e12c P e5256d91808b47c195bc9b4dbd7f2b87 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:11.952039 19604 tablet_bootstrap.cc:492] T 4af19371ea874c09a0a2147040835cbb P e5256d91808b47c195bc9b4dbd7f2b87: Bootstrap starting.
I20260709 13:04:11.975419 19808 consensus_queue.cc:1048] T 0e1085d23e8347fbbd5bce7542f4b1f4 P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:11.975917 19483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1efebf73c86e432baa55533136b6e12c" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:04:11.973515 19832 raft_consensus.cc:2749] T 775c229504194560ba9589bc2199b089 P e61c3a8f61bb48f8a963c9480e53c168 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:04:11.978969 19600 tablet_bootstrap.cc:654] T ece3db938bc649d4a40a51522ed5259c P e61c3a8f61bb48f8a963c9480e53c168: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:11.976670 19483 raft_consensus.cc:2393] T 1efebf73c86e432baa55533136b6e12c P 0473d2b2d01f4459b1e90fd12cc7840e [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e5256d91808b47c195bc9b4dbd7f2b87 in current term 1: Already voted for candidate e61c3a8f61bb48f8a963c9480e53c168 in this term.
I20260709 13:04:11.988726 19855 leader_election.cc:290] T 1efebf73c86e432baa55533136b6e12c P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:04:11.989961 19556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1efebf73c86e432baa55533136b6e12c" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:04:11.994817 19855 consensus_queue.cc:1048] T bc225c93219c45538b53a1bd3d387e4d P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:12.003669 19377 leader_election.cc:304] T 1efebf73c86e432baa55533136b6e12c P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:04:12.004453 19856 raft_consensus.cc:3060] T 1efebf73c86e432baa55533136b6e12c P e5256d91808b47c195bc9b4dbd7f2b87 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:12.014562 19876 raft_consensus.cc:2749] T bc225c93219c45538b53a1bd3d387e4d P 0473d2b2d01f4459b1e90fd12cc7840e [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:04:12.014919 19808 consensus_queue.cc:1048] T df751f992649444090e27965eb1af85d P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:04:12.016629 19856 raft_consensus.cc:2749] T 1efebf73c86e432baa55533136b6e12c P e5256d91808b47c195bc9b4dbd7f2b87 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:04:12.014976 19832 raft_consensus.cc:493] T 21e14947d70440f19044d8f75c31e1f9 P e61c3a8f61bb48f8a963c9480e53c168 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:12.017670 19832 raft_consensus.cc:515] T 21e14947d70440f19044d8f75c31e1f9 P e61c3a8f61bb48f8a963c9480e53c168 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:12.026503 19411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21e14947d70440f19044d8f75c31e1f9" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
W20260709 13:04:12.031787 19523 leader_election.cc:343] T 21e14947d70440f19044d8f75c31e1f9 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:12.034513 19483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21e14947d70440f19044d8f75c31e1f9" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:04:12.035244 19483 raft_consensus.cc:2468] T 21e14947d70440f19044d8f75c31e1f9 P 0473d2b2d01f4459b1e90fd12cc7840e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 0.
I20260709 13:04:12.033416 19832 leader_election.cc:290] T 21e14947d70440f19044d8f75c31e1f9 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:04:12.043447 19526 leader_election.cc:304] T 21e14947d70440f19044d8f75c31e1f9 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168; no voters: e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:04:12.045411 19808 raft_consensus.cc:2804] T 21e14947d70440f19044d8f75c31e1f9 P e61c3a8f61bb48f8a963c9480e53c168 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:12.045943 19808 raft_consensus.cc:493] T 21e14947d70440f19044d8f75c31e1f9 P e61c3a8f61bb48f8a963c9480e53c168 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:12.046368 19808 raft_consensus.cc:3060] T 21e14947d70440f19044d8f75c31e1f9 P e61c3a8f61bb48f8a963c9480e53c168 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:12.052907 19604 tablet_bootstrap.cc:654] T 4af19371ea874c09a0a2147040835cbb P e5256d91808b47c195bc9b4dbd7f2b87: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:12.067315 19856 raft_consensus.cc:493] T edd7d470b5014c9489be7f41f64355c9 P e5256d91808b47c195bc9b4dbd7f2b87 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:12.067945 19856 raft_consensus.cc:515] T edd7d470b5014c9489be7f41f64355c9 P e5256d91808b47c195bc9b4dbd7f2b87 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:12.077423 19876 raft_consensus.cc:493] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P 0473d2b2d01f4459b1e90fd12cc7840e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:12.077747 19820 raft_consensus.cc:493] T 65d8cb8d6ec64f459d5a47cefab10acf P 0473d2b2d01f4459b1e90fd12cc7840e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:12.078007 19876 raft_consensus.cc:515] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P 0473d2b2d01f4459b1e90fd12cc7840e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:12.078176 19820 raft_consensus.cc:515] T 65d8cb8d6ec64f459d5a47cefab10acf P 0473d2b2d01f4459b1e90fd12cc7840e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:12.087435 19601 tablet_bootstrap.cc:654] T 85c494af21f9457a85da47b9bc70c1fd P 0473d2b2d01f4459b1e90fd12cc7840e: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:12.085971 19808 raft_consensus.cc:515] T 21e14947d70440f19044d8f75c31e1f9 P e61c3a8f61bb48f8a963c9480e53c168 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:12.093719 19560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edd7d470b5014c9489be7f41f64355c9" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:04:12.095714 19485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edd7d470b5014c9489be7f41f64355c9" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:04:12.097990 19820 leader_election.cc:290] T 65d8cb8d6ec64f459d5a47cefab10acf P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:04:12.101374 19406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65d8cb8d6ec64f459d5a47cefab10acf" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:04:12.101764 19876 leader_election.cc:290] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:04:12.102792 19560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65d8cb8d6ec64f459d5a47cefab10acf" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:04:12.091626 19856 leader_election.cc:290] T edd7d470b5014c9489be7f41f64355c9 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:04:12.103765 19687 consensus_queue.cc:1048] T df751f992649444090e27965eb1af85d P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.003s
W20260709 13:04:12.104324 19449 leader_election.cc:343] T 65d8cb8d6ec64f459d5a47cefab10acf P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:12.110076 19556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36f6ba92b9ba46babe4ebd6c02e5fbd9" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
W20260709 13:04:12.112417 19450 leader_election.cc:343] T 65d8cb8d6ec64f459d5a47cefab10acf P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:12.112844 19450 leader_election.cc:304] T 65d8cb8d6ec64f459d5a47cefab10acf P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e; no voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168
W20260709 13:04:12.113993 19450 leader_election.cc:343] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:12.115274 19600 tablet_bootstrap.cc:492] T ece3db938bc649d4a40a51522ed5259c P e61c3a8f61bb48f8a963c9480e53c168: No bootstrap required, opened a new log
I20260709 13:04:12.115679 19600 ts_tablet_manager.cc:1403] T ece3db938bc649d4a40a51522ed5259c P e61c3a8f61bb48f8a963c9480e53c168: Time spent bootstrapping tablet: real 0.157s	user 0.025s	sys 0.015s
I20260709 13:04:12.116935 19876 raft_consensus.cc:2749] T 65d8cb8d6ec64f459d5a47cefab10acf P 0473d2b2d01f4459b1e90fd12cc7840e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:04:12.121073 19411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36f6ba92b9ba46babe4ebd6c02e5fbd9" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:04:12.121672 19411 raft_consensus.cc:2468] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P e5256d91808b47c195bc9b4dbd7f2b87 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 0.
I20260709 13:04:12.129166 19449 leader_election.cc:304] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87; no voters: e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:04:12.130697 19881 raft_consensus.cc:2804] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P 0473d2b2d01f4459b1e90fd12cc7840e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:12.131054 19881 raft_consensus.cc:493] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P 0473d2b2d01f4459b1e90fd12cc7840e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:12.131345 19881 raft_consensus.cc:3060] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P 0473d2b2d01f4459b1e90fd12cc7840e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:12.132869 19808 leader_election.cc:290] T 21e14947d70440f19044d8f75c31e1f9 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 1 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:04:12.133211 19408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21e14947d70440f19044d8f75c31e1f9" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
I20260709 13:04:12.137667 19485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21e14947d70440f19044d8f75c31e1f9" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:04:12.138554 19485 raft_consensus.cc:3060] T 21e14947d70440f19044d8f75c31e1f9 P 0473d2b2d01f4459b1e90fd12cc7840e [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:04:12.146150 19523 leader_election.cc:343] T 21e14947d70440f19044d8f75c31e1f9 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:12.148258 19408 raft_consensus.cc:3060] T edd7d470b5014c9489be7f41f64355c9 P e5256d91808b47c195bc9b4dbd7f2b87 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:12.153100 19600 raft_consensus.cc:359] T ece3db938bc649d4a40a51522ed5259c P e61c3a8f61bb48f8a963c9480e53c168 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:12.153811 19600 raft_consensus.cc:385] T ece3db938bc649d4a40a51522ed5259c P e61c3a8f61bb48f8a963c9480e53c168 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:12.154079 19600 raft_consensus.cc:740] T ece3db938bc649d4a40a51522ed5259c P e61c3a8f61bb48f8a963c9480e53c168 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e61c3a8f61bb48f8a963c9480e53c168, State: Initialized, Role: FOLLOWER
I20260709 13:04:12.159094 19600 consensus_queue.cc:260] T ece3db938bc649d4a40a51522ed5259c P e61c3a8f61bb48f8a963c9480e53c168 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:12.161701 19600 ts_tablet_manager.cc:1434] T ece3db938bc649d4a40a51522ed5259c P e61c3a8f61bb48f8a963c9480e53c168: Time spent starting tablet: real 0.046s	user 0.006s	sys 0.002s
I20260709 13:04:12.158968 19377 leader_election.cc:304] T edd7d470b5014c9489be7f41f64355c9 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:04:12.162467 19604 tablet_bootstrap.cc:492] T 4af19371ea874c09a0a2147040835cbb P e5256d91808b47c195bc9b4dbd7f2b87: No bootstrap required, opened a new log
I20260709 13:04:12.163231 19604 ts_tablet_manager.cc:1403] T 4af19371ea874c09a0a2147040835cbb P e5256d91808b47c195bc9b4dbd7f2b87: Time spent bootstrapping tablet: real 0.213s	user 0.018s	sys 0.007s
I20260709 13:04:12.163713 19881 raft_consensus.cc:515] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P 0473d2b2d01f4459b1e90fd12cc7840e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:12.168583 19820 consensus_queue.cc:1048] T 62c6c134d3d24a1ab144dd9ee6bc3f64 P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:12.174088 19601 tablet_bootstrap.cc:492] T 85c494af21f9457a85da47b9bc70c1fd P 0473d2b2d01f4459b1e90fd12cc7840e: No bootstrap required, opened a new log
I20260709 13:04:12.175453 19881 leader_election.cc:290] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 1 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:04:12.177412 19485 raft_consensus.cc:2468] T 21e14947d70440f19044d8f75c31e1f9 P 0473d2b2d01f4459b1e90fd12cc7840e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 1.
I20260709 13:04:12.177827 19601 ts_tablet_manager.cc:1403] T 85c494af21f9457a85da47b9bc70c1fd P 0473d2b2d01f4459b1e90fd12cc7840e: Time spent bootstrapping tablet: real 0.226s	user 0.007s	sys 0.013s
I20260709 13:04:12.178769 19526 leader_election.cc:304] T 21e14947d70440f19044d8f75c31e1f9 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168; no voters: e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:04:12.179883 19406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36f6ba92b9ba46babe4ebd6c02e5fbd9" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
I20260709 13:04:12.180264 19808 raft_consensus.cc:2804] T 21e14947d70440f19044d8f75c31e1f9 P e61c3a8f61bb48f8a963c9480e53c168 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:12.180895 19406 raft_consensus.cc:3060] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P e5256d91808b47c195bc9b4dbd7f2b87 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:12.180918 19808 raft_consensus.cc:697] T 21e14947d70440f19044d8f75c31e1f9 P e61c3a8f61bb48f8a963c9480e53c168 [term 1 LEADER]: Becoming Leader. State: Replica: e61c3a8f61bb48f8a963c9480e53c168, State: Running, Role: LEADER
I20260709 13:04:12.179318 19920 consensus_queue.cc:1048] T bc225c93219c45538b53a1bd3d387e4d P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:04:12.181944 19808 consensus_queue.cc:237] T 21e14947d70440f19044d8f75c31e1f9 P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:12.191857 19600 tablet_bootstrap.cc:492] T 65d8cb8d6ec64f459d5a47cefab10acf P e61c3a8f61bb48f8a963c9480e53c168: Bootstrap starting.
I20260709 13:04:12.195595 19855 raft_consensus.cc:2749] T edd7d470b5014c9489be7f41f64355c9 P e5256d91808b47c195bc9b4dbd7f2b87 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:04:12.198609 19556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36f6ba92b9ba46babe4ebd6c02e5fbd9" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:04:12.200862 19881 consensus_queue.cc:1048] T 62c6c134d3d24a1ab144dd9ee6bc3f64 P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:12.198447 19406 raft_consensus.cc:2468] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P e5256d91808b47c195bc9b4dbd7f2b87 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 1.
I20260709 13:04:12.210137 19449 leader_election.cc:304] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87; no voters: 
W20260709 13:04:12.210707 19450 leader_election.cc:343] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:12.211167 19630 raft_consensus.cc:493] T 4509b76741dc428e9201c70c1658da13 P e61c3a8f61bb48f8a963c9480e53c168 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:12.211259 19881 raft_consensus.cc:2804] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P 0473d2b2d01f4459b1e90fd12cc7840e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:12.211659 19630 raft_consensus.cc:515] T 4509b76741dc428e9201c70c1658da13 P e61c3a8f61bb48f8a963c9480e53c168 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:12.211935 19881 raft_consensus.cc:697] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P 0473d2b2d01f4459b1e90fd12cc7840e [term 1 LEADER]: Becoming Leader. State: Replica: 0473d2b2d01f4459b1e90fd12cc7840e, State: Running, Role: LEADER
I20260709 13:04:12.213524 19630 leader_election.cc:290] T 4509b76741dc428e9201c70c1658da13 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:04:12.213588 19881 consensus_queue.cc:237] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:12.201787 19604 raft_consensus.cc:359] T 4af19371ea874c09a0a2147040835cbb P e5256d91808b47c195bc9b4dbd7f2b87 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:12.214766 19604 raft_consensus.cc:385] T 4af19371ea874c09a0a2147040835cbb P e5256d91808b47c195bc9b4dbd7f2b87 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:12.215066 19406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4509b76741dc428e9201c70c1658da13" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
W20260709 13:04:12.216387 19523 leader_election.cc:343] T 4509b76741dc428e9201c70c1658da13 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:12.217072 19485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4509b76741dc428e9201c70c1658da13" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:04:12.216992 19601 raft_consensus.cc:359] T 85c494af21f9457a85da47b9bc70c1fd P 0473d2b2d01f4459b1e90fd12cc7840e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:12.217721 19601 raft_consensus.cc:385] T 85c494af21f9457a85da47b9bc70c1fd P 0473d2b2d01f4459b1e90fd12cc7840e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:12.217998 19601 raft_consensus.cc:740] T 85c494af21f9457a85da47b9bc70c1fd P 0473d2b2d01f4459b1e90fd12cc7840e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0473d2b2d01f4459b1e90fd12cc7840e, State: Initialized, Role: FOLLOWER
I20260709 13:04:12.215070 19604 raft_consensus.cc:740] T 4af19371ea874c09a0a2147040835cbb P e5256d91808b47c195bc9b4dbd7f2b87 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e5256d91808b47c195bc9b4dbd7f2b87, State: Initialized, Role: FOLLOWER
I20260709 13:04:12.219324 19604 consensus_queue.cc:260] T 4af19371ea874c09a0a2147040835cbb P e5256d91808b47c195bc9b4dbd7f2b87 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
W20260709 13:04:12.224161 19526 leader_election.cc:343] T 4509b76741dc428e9201c70c1658da13 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:12.224648 19526 leader_election.cc:304] T 4509b76741dc428e9201c70c1658da13 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e61c3a8f61bb48f8a963c9480e53c168; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:04:12.225397 19923 raft_consensus.cc:2749] T 4509b76741dc428e9201c70c1658da13 P e61c3a8f61bb48f8a963c9480e53c168 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:04:12.248242 19630 consensus_queue.cc:1048] T 1efebf73c86e432baa55533136b6e12c P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:12.255549 19600 tablet_bootstrap.cc:654] T 65d8cb8d6ec64f459d5a47cefab10acf P e61c3a8f61bb48f8a963c9480e53c168: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:12.263484 19920 raft_consensus.cc:493] T 4af19371ea874c09a0a2147040835cbb P e5256d91808b47c195bc9b4dbd7f2b87 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:12.263988 19920 raft_consensus.cc:515] T 4af19371ea874c09a0a2147040835cbb P e5256d91808b47c195bc9b4dbd7f2b87 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:12.265959 19920 leader_election.cc:290] T 4af19371ea874c09a0a2147040835cbb P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:04:12.267599 19483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4af19371ea874c09a0a2147040835cbb" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:04:12.268117 19630 consensus_queue.cc:1048] T 1efebf73c86e432baa55533136b6e12c P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:12.268172 19556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4af19371ea874c09a0a2147040835cbb" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:04:12.269647 19375 leader_election.cc:304] T 4af19371ea874c09a0a2147040835cbb P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:04:12.270362 19920 raft_consensus.cc:2749] T 4af19371ea874c09a0a2147040835cbb P e5256d91808b47c195bc9b4dbd7f2b87 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:04:12.278849 19308 catalog_manager.cc:5697] T 21e14947d70440f19044d8f75c31e1f9 P e61c3a8f61bb48f8a963c9480e53c168 reported cstate change: term changed from 0 to 1, leader changed from <none> to e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3). New cstate: current_term: 1 leader_uuid: "e61c3a8f61bb48f8a963c9480e53c168" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } health_report { overall_health: HEALTHY } } }
I20260709 13:04:12.283354 19604 ts_tablet_manager.cc:1434] T 4af19371ea874c09a0a2147040835cbb P e5256d91808b47c195bc9b4dbd7f2b87: Time spent starting tablet: real 0.120s	user 0.007s	sys 0.000s
I20260709 13:04:12.285559 19604 tablet_bootstrap.cc:492] T 76cb037fc9064d13b59a8969d897ce8c P e5256d91808b47c195bc9b4dbd7f2b87: Bootstrap starting.
I20260709 13:04:12.289903 19630 raft_consensus.cc:493] T 85c494af21f9457a85da47b9bc70c1fd P e61c3a8f61bb48f8a963c9480e53c168 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:12.290421 19630 raft_consensus.cc:515] T 85c494af21f9457a85da47b9bc70c1fd P e61c3a8f61bb48f8a963c9480e53c168 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:12.293696 19483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85c494af21f9457a85da47b9bc70c1fd" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:04:12.295485 19630 leader_election.cc:290] T 85c494af21f9457a85da47b9bc70c1fd P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:04:12.296736 19409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85c494af21f9457a85da47b9bc70c1fd" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
W20260709 13:04:12.298223 19523 leader_election.cc:343] T 85c494af21f9457a85da47b9bc70c1fd P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:12.307019 19601 consensus_queue.cc:260] T 85c494af21f9457a85da47b9bc70c1fd P 0473d2b2d01f4459b1e90fd12cc7840e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:12.308111 19483 raft_consensus.cc:2468] T 85c494af21f9457a85da47b9bc70c1fd P 0473d2b2d01f4459b1e90fd12cc7840e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 0.
I20260709 13:04:12.310973 19526 leader_election.cc:304] T 85c494af21f9457a85da47b9bc70c1fd P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168; no voters: e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:04:12.315145 19630 raft_consensus.cc:2804] T 85c494af21f9457a85da47b9bc70c1fd P e61c3a8f61bb48f8a963c9480e53c168 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:12.315506 19630 raft_consensus.cc:493] T 85c494af21f9457a85da47b9bc70c1fd P e61c3a8f61bb48f8a963c9480e53c168 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:12.315670 19600 tablet_bootstrap.cc:492] T 65d8cb8d6ec64f459d5a47cefab10acf P e61c3a8f61bb48f8a963c9480e53c168: No bootstrap required, opened a new log
I20260709 13:04:12.315831 19630 raft_consensus.cc:3060] T 85c494af21f9457a85da47b9bc70c1fd P e61c3a8f61bb48f8a963c9480e53c168 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:12.316146 19600 ts_tablet_manager.cc:1403] T 65d8cb8d6ec64f459d5a47cefab10acf P e61c3a8f61bb48f8a963c9480e53c168: Time spent bootstrapping tablet: real 0.125s	user 0.016s	sys 0.025s
I20260709 13:04:12.316762 19604 tablet_bootstrap.cc:654] T 76cb037fc9064d13b59a8969d897ce8c P e5256d91808b47c195bc9b4dbd7f2b87: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:12.318944 19600 raft_consensus.cc:359] T 65d8cb8d6ec64f459d5a47cefab10acf P e61c3a8f61bb48f8a963c9480e53c168 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:12.319607 19600 raft_consensus.cc:385] T 65d8cb8d6ec64f459d5a47cefab10acf P e61c3a8f61bb48f8a963c9480e53c168 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:12.319875 19600 raft_consensus.cc:740] T 65d8cb8d6ec64f459d5a47cefab10acf P e61c3a8f61bb48f8a963c9480e53c168 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e61c3a8f61bb48f8a963c9480e53c168, State: Initialized, Role: FOLLOWER
I20260709 13:04:12.320590 19600 consensus_queue.cc:260] T 65d8cb8d6ec64f459d5a47cefab10acf P e61c3a8f61bb48f8a963c9480e53c168 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:12.323515 19600 ts_tablet_manager.cc:1434] T 65d8cb8d6ec64f459d5a47cefab10acf P e61c3a8f61bb48f8a963c9480e53c168: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.003s
I20260709 13:04:12.324502 19600 tablet_bootstrap.cc:492] T 1dc5b3532fe54f74876d02beffa2c230 P e61c3a8f61bb48f8a963c9480e53c168: Bootstrap starting.
I20260709 13:04:12.332490 19630 raft_consensus.cc:515] T 85c494af21f9457a85da47b9bc70c1fd P e61c3a8f61bb48f8a963c9480e53c168 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:12.335105 19409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85c494af21f9457a85da47b9bc70c1fd" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
I20260709 13:04:12.336179 19483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85c494af21f9457a85da47b9bc70c1fd" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
W20260709 13:04:12.336690 19523 leader_election.cc:343] T 85c494af21f9457a85da47b9bc70c1fd P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:12.342537 19600 tablet_bootstrap.cc:654] T 1dc5b3532fe54f74876d02beffa2c230 P e61c3a8f61bb48f8a963c9480e53c168: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:12.336817 19483 raft_consensus.cc:3060] T 85c494af21f9457a85da47b9bc70c1fd P 0473d2b2d01f4459b1e90fd12cc7840e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:12.356072 19600 tablet_bootstrap.cc:492] T 1dc5b3532fe54f74876d02beffa2c230 P e61c3a8f61bb48f8a963c9480e53c168: No bootstrap required, opened a new log
I20260709 13:04:12.356536 19600 ts_tablet_manager.cc:1403] T 1dc5b3532fe54f74876d02beffa2c230 P e61c3a8f61bb48f8a963c9480e53c168: Time spent bootstrapping tablet: real 0.032s	user 0.008s	sys 0.008s
I20260709 13:04:12.359117 19600 raft_consensus.cc:359] T 1dc5b3532fe54f74876d02beffa2c230 P e61c3a8f61bb48f8a963c9480e53c168 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:12.366968 19600 raft_consensus.cc:385] T 1dc5b3532fe54f74876d02beffa2c230 P e61c3a8f61bb48f8a963c9480e53c168 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:12.367259 19600 raft_consensus.cc:740] T 1dc5b3532fe54f74876d02beffa2c230 P e61c3a8f61bb48f8a963c9480e53c168 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e61c3a8f61bb48f8a963c9480e53c168, State: Initialized, Role: FOLLOWER
I20260709 13:04:12.358790 19630 leader_election.cc:290] T 85c494af21f9457a85da47b9bc70c1fd P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 1 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:04:12.368038 19600 consensus_queue.cc:260] T 1dc5b3532fe54f74876d02beffa2c230 P e61c3a8f61bb48f8a963c9480e53c168 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:12.369499 19600 ts_tablet_manager.cc:1434] T 1dc5b3532fe54f74876d02beffa2c230 P e61c3a8f61bb48f8a963c9480e53c168: Time spent starting tablet: real 0.013s	user 0.003s	sys 0.008s
I20260709 13:04:12.370360 19600 tablet_bootstrap.cc:492] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P e61c3a8f61bb48f8a963c9480e53c168: Bootstrap starting.
I20260709 13:04:12.368369 19483 raft_consensus.cc:2468] T 85c494af21f9457a85da47b9bc70c1fd P 0473d2b2d01f4459b1e90fd12cc7840e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 1.
I20260709 13:04:12.372153 19526 leader_election.cc:304] T 85c494af21f9457a85da47b9bc70c1fd P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168; no voters: e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:04:12.375168 19630 raft_consensus.cc:2804] T 85c494af21f9457a85da47b9bc70c1fd P e61c3a8f61bb48f8a963c9480e53c168 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:12.375582 19630 raft_consensus.cc:697] T 85c494af21f9457a85da47b9bc70c1fd P e61c3a8f61bb48f8a963c9480e53c168 [term 1 LEADER]: Becoming Leader. State: Replica: e61c3a8f61bb48f8a963c9480e53c168, State: Running, Role: LEADER
I20260709 13:04:12.376044 19600 tablet_bootstrap.cc:654] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P e61c3a8f61bb48f8a963c9480e53c168: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:12.376286 19630 consensus_queue.cc:237] T 85c494af21f9457a85da47b9bc70c1fd P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:12.378618 19601 ts_tablet_manager.cc:1434] T 85c494af21f9457a85da47b9bc70c1fd P 0473d2b2d01f4459b1e90fd12cc7840e: Time spent starting tablet: real 0.198s	user 0.006s	sys 0.002s
I20260709 13:04:12.380143 19601 tablet_bootstrap.cc:492] T 1dc5b3532fe54f74876d02beffa2c230 P 0473d2b2d01f4459b1e90fd12cc7840e: Bootstrap starting.
I20260709 13:04:12.383800 19309 catalog_manager.cc:5697] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P 0473d2b2d01f4459b1e90fd12cc7840e reported cstate change: term changed from 0 to 1, leader changed from <none> to 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2). New cstate: current_term: 1 leader_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:12.402976 19604 tablet_bootstrap.cc:492] T 76cb037fc9064d13b59a8969d897ce8c P e5256d91808b47c195bc9b4dbd7f2b87: No bootstrap required, opened a new log
I20260709 13:04:12.403592 19604 ts_tablet_manager.cc:1403] T 76cb037fc9064d13b59a8969d897ce8c P e5256d91808b47c195bc9b4dbd7f2b87: Time spent bootstrapping tablet: real 0.119s	user 0.052s	sys 0.038s
I20260709 13:04:12.405133 19808 raft_consensus.cc:493] T 1dc5b3532fe54f74876d02beffa2c230 P e61c3a8f61bb48f8a963c9480e53c168 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:12.405654 19808 raft_consensus.cc:515] T 1dc5b3532fe54f74876d02beffa2c230 P e61c3a8f61bb48f8a963c9480e53c168 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:12.409133 19808 leader_election.cc:290] T 1dc5b3532fe54f74876d02beffa2c230 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:04:12.409967 19409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dc5b3532fe54f74876d02beffa2c230" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
W20260709 13:04:12.411784 19523 leader_election.cc:343] T 1dc5b3532fe54f74876d02beffa2c230 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:12.413666 19604 raft_consensus.cc:359] T 76cb037fc9064d13b59a8969d897ce8c P e5256d91808b47c195bc9b4dbd7f2b87 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:12.414997 19604 raft_consensus.cc:385] T 76cb037fc9064d13b59a8969d897ce8c P e5256d91808b47c195bc9b4dbd7f2b87 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:12.415349 19604 raft_consensus.cc:740] T 76cb037fc9064d13b59a8969d897ce8c P e5256d91808b47c195bc9b4dbd7f2b87 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e5256d91808b47c195bc9b4dbd7f2b87, State: Initialized, Role: FOLLOWER
I20260709 13:04:12.416112 19604 consensus_queue.cc:260] T 76cb037fc9064d13b59a8969d897ce8c P e5256d91808b47c195bc9b4dbd7f2b87 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:12.418412 19604 ts_tablet_manager.cc:1434] T 76cb037fc9064d13b59a8969d897ce8c P e5256d91808b47c195bc9b4dbd7f2b87: Time spent starting tablet: real 0.014s	user 0.005s	sys 0.000s
I20260709 13:04:12.419499 19808 raft_consensus.cc:493] T 65d8cb8d6ec64f459d5a47cefab10acf P e61c3a8f61bb48f8a963c9480e53c168 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:12.420125 19808 raft_consensus.cc:515] T 65d8cb8d6ec64f459d5a47cefab10acf P e61c3a8f61bb48f8a963c9480e53c168 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:12.423314 19409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65d8cb8d6ec64f459d5a47cefab10acf" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:04:12.425532 19485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65d8cb8d6ec64f459d5a47cefab10acf" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:04:12.426190 19485 raft_consensus.cc:2468] T 65d8cb8d6ec64f459d5a47cefab10acf P 0473d2b2d01f4459b1e90fd12cc7840e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 0.
I20260709 13:04:12.427323 19526 leader_election.cc:304] T 65d8cb8d6ec64f459d5a47cefab10acf P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:04:12.425590 19483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dc5b3532fe54f74876d02beffa2c230" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:04:12.422513 19808 leader_election.cc:290] T 65d8cb8d6ec64f459d5a47cefab10acf P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
W20260709 13:04:12.428114 19523 leader_election.cc:343] T 65d8cb8d6ec64f459d5a47cefab10acf P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:12.428299 19808 raft_consensus.cc:2804] T 65d8cb8d6ec64f459d5a47cefab10acf P e61c3a8f61bb48f8a963c9480e53c168 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:12.428668 19808 raft_consensus.cc:493] T 65d8cb8d6ec64f459d5a47cefab10acf P e61c3a8f61bb48f8a963c9480e53c168 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:12.429059 19808 raft_consensus.cc:3060] T 65d8cb8d6ec64f459d5a47cefab10acf P e61c3a8f61bb48f8a963c9480e53c168 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:12.431700 19604 tablet_bootstrap.cc:492] T ece3db938bc649d4a40a51522ed5259c P e5256d91808b47c195bc9b4dbd7f2b87: Bootstrap starting.
W20260709 13:04:12.436841 19526 leader_election.cc:343] T 1dc5b3532fe54f74876d02beffa2c230 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:12.437497 19526 leader_election.cc:304] T 1dc5b3532fe54f74876d02beffa2c230 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e61c3a8f61bb48f8a963c9480e53c168; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:04:12.439332 19604 tablet_bootstrap.cc:654] T ece3db938bc649d4a40a51522ed5259c P e5256d91808b47c195bc9b4dbd7f2b87: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:12.441025 19832 raft_consensus.cc:2749] T 1dc5b3532fe54f74876d02beffa2c230 P e61c3a8f61bb48f8a963c9480e53c168 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:04:12.446791 19832 raft_consensus.cc:493] T ece3db938bc649d4a40a51522ed5259c P e61c3a8f61bb48f8a963c9480e53c168 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:12.447343 19832 raft_consensus.cc:515] T ece3db938bc649d4a40a51522ed5259c P e61c3a8f61bb48f8a963c9480e53c168 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:12.449781 19832 leader_election.cc:290] T ece3db938bc649d4a40a51522ed5259c P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:04:12.450440 19409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ece3db938bc649d4a40a51522ed5259c" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:04:12.451330 19483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ece3db938bc649d4a40a51522ed5259c" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
W20260709 13:04:12.452236 19523 leader_election.cc:343] T ece3db938bc649d4a40a51522ed5259c P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:04:12.452787 19526 leader_election.cc:343] T ece3db938bc649d4a40a51522ed5259c P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:12.453162 19526 leader_election.cc:304] T ece3db938bc649d4a40a51522ed5259c P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e61c3a8f61bb48f8a963c9480e53c168; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:04:12.461325 19832 raft_consensus.cc:2749] T ece3db938bc649d4a40a51522ed5259c P e61c3a8f61bb48f8a963c9480e53c168 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:04:12.461721 19604 tablet_bootstrap.cc:492] T ece3db938bc649d4a40a51522ed5259c P e5256d91808b47c195bc9b4dbd7f2b87: No bootstrap required, opened a new log
I20260709 13:04:12.462268 19604 ts_tablet_manager.cc:1403] T ece3db938bc649d4a40a51522ed5259c P e5256d91808b47c195bc9b4dbd7f2b87: Time spent bootstrapping tablet: real 0.031s	user 0.021s	sys 0.004s
I20260709 13:04:12.464300 19600 tablet_bootstrap.cc:492] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P e61c3a8f61bb48f8a963c9480e53c168: No bootstrap required, opened a new log
I20260709 13:04:12.464948 19604 raft_consensus.cc:359] T ece3db938bc649d4a40a51522ed5259c P e5256d91808b47c195bc9b4dbd7f2b87 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:12.465690 19604 raft_consensus.cc:385] T ece3db938bc649d4a40a51522ed5259c P e5256d91808b47c195bc9b4dbd7f2b87 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:12.466887 19601 tablet_bootstrap.cc:654] T 1dc5b3532fe54f74876d02beffa2c230 P 0473d2b2d01f4459b1e90fd12cc7840e: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:12.472739 19604 raft_consensus.cc:740] T ece3db938bc649d4a40a51522ed5259c P e5256d91808b47c195bc9b4dbd7f2b87 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e5256d91808b47c195bc9b4dbd7f2b87, State: Initialized, Role: FOLLOWER
I20260709 13:04:12.473584 19604 consensus_queue.cc:260] T ece3db938bc649d4a40a51522ed5259c P e5256d91808b47c195bc9b4dbd7f2b87 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:12.467471 19600 ts_tablet_manager.cc:1403] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P e61c3a8f61bb48f8a963c9480e53c168: Time spent bootstrapping tablet: real 0.097s	user 0.041s	sys 0.023s
I20260709 13:04:12.468869 19808 raft_consensus.cc:515] T 65d8cb8d6ec64f459d5a47cefab10acf P e61c3a8f61bb48f8a963c9480e53c168 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:12.476861 19600 raft_consensus.cc:359] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P e61c3a8f61bb48f8a963c9480e53c168 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:12.477483 19600 raft_consensus.cc:385] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P e61c3a8f61bb48f8a963c9480e53c168 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:12.477727 19600 raft_consensus.cc:740] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P e61c3a8f61bb48f8a963c9480e53c168 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e61c3a8f61bb48f8a963c9480e53c168, State: Initialized, Role: FOLLOWER
I20260709 13:04:12.478485 19604 ts_tablet_manager.cc:1434] T ece3db938bc649d4a40a51522ed5259c P e5256d91808b47c195bc9b4dbd7f2b87: Time spent starting tablet: real 0.016s	user 0.005s	sys 0.001s
I20260709 13:04:12.478341 19600 consensus_queue.cc:260] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P e61c3a8f61bb48f8a963c9480e53c168 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:12.479617 19604 tablet_bootstrap.cc:492] T 775c229504194560ba9589bc2199b089 P e5256d91808b47c195bc9b4dbd7f2b87: Bootstrap starting.
I20260709 13:04:12.480336 19600 ts_tablet_manager.cc:1434] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P e61c3a8f61bb48f8a963c9480e53c168: Time spent starting tablet: real 0.006s	user 0.002s	sys 0.003s
I20260709 13:04:12.481199 19600 tablet_bootstrap.cc:492] T 28af091831594f9d8e96482078cc7625 P e61c3a8f61bb48f8a963c9480e53c168: Bootstrap starting.
I20260709 13:04:12.486475 19600 tablet_bootstrap.cc:654] T 28af091831594f9d8e96482078cc7625 P e61c3a8f61bb48f8a963c9480e53c168: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:12.486547 19604 tablet_bootstrap.cc:654] T 775c229504194560ba9589bc2199b089 P e5256d91808b47c195bc9b4dbd7f2b87: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:12.500412 19604 tablet_bootstrap.cc:492] T 775c229504194560ba9589bc2199b089 P e5256d91808b47c195bc9b4dbd7f2b87: No bootstrap required, opened a new log
I20260709 13:04:12.501001 19604 ts_tablet_manager.cc:1403] T 775c229504194560ba9589bc2199b089 P e5256d91808b47c195bc9b4dbd7f2b87: Time spent bootstrapping tablet: real 0.022s	user 0.015s	sys 0.002s
I20260709 13:04:12.507225 19409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65d8cb8d6ec64f459d5a47cefab10acf" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
W20260709 13:04:12.508553 19523 leader_election.cc:343] T 65d8cb8d6ec64f459d5a47cefab10acf P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:12.506911 19604 raft_consensus.cc:359] T 775c229504194560ba9589bc2199b089 P e5256d91808b47c195bc9b4dbd7f2b87 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:12.509801 19604 raft_consensus.cc:385] T 775c229504194560ba9589bc2199b089 P e5256d91808b47c195bc9b4dbd7f2b87 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:12.510129 19604 raft_consensus.cc:740] T 775c229504194560ba9589bc2199b089 P e5256d91808b47c195bc9b4dbd7f2b87 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e5256d91808b47c195bc9b4dbd7f2b87, State: Initialized, Role: FOLLOWER
I20260709 13:04:12.510442 19808 leader_election.cc:290] T 65d8cb8d6ec64f459d5a47cefab10acf P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 1 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:04:12.499063 19309 catalog_manager.cc:5697] T 85c494af21f9457a85da47b9bc70c1fd P e61c3a8f61bb48f8a963c9480e53c168 reported cstate change: term changed from 0 to 1, leader changed from <none> to e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3). New cstate: current_term: 1 leader_uuid: "e61c3a8f61bb48f8a963c9480e53c168" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } health_report { overall_health: HEALTHY } } }
I20260709 13:04:12.511030 19604 consensus_queue.cc:260] T 775c229504194560ba9589bc2199b089 P e5256d91808b47c195bc9b4dbd7f2b87 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:12.511396 19485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65d8cb8d6ec64f459d5a47cefab10acf" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:04:12.512051 19485 raft_consensus.cc:3060] T 65d8cb8d6ec64f459d5a47cefab10acf P 0473d2b2d01f4459b1e90fd12cc7840e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:12.519037 19485 raft_consensus.cc:2468] T 65d8cb8d6ec64f459d5a47cefab10acf P 0473d2b2d01f4459b1e90fd12cc7840e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 1.
I20260709 13:04:12.520186 19526 leader_election.cc:304] T 65d8cb8d6ec64f459d5a47cefab10acf P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168; no voters: e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:04:12.521679 19832 raft_consensus.cc:2804] T 65d8cb8d6ec64f459d5a47cefab10acf P e61c3a8f61bb48f8a963c9480e53c168 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:12.522179 19832 raft_consensus.cc:697] T 65d8cb8d6ec64f459d5a47cefab10acf P e61c3a8f61bb48f8a963c9480e53c168 [term 1 LEADER]: Becoming Leader. State: Replica: e61c3a8f61bb48f8a963c9480e53c168, State: Running, Role: LEADER
I20260709 13:04:12.523200 19832 consensus_queue.cc:237] T 65d8cb8d6ec64f459d5a47cefab10acf P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:12.531447 19604 ts_tablet_manager.cc:1434] T 775c229504194560ba9589bc2199b089 P e5256d91808b47c195bc9b4dbd7f2b87: Time spent starting tablet: real 0.030s	user 0.005s	sys 0.000s
I20260709 13:04:12.532603 19604 tablet_bootstrap.cc:492] T 21e14947d70440f19044d8f75c31e1f9 P e5256d91808b47c195bc9b4dbd7f2b87: Bootstrap starting.
I20260709 13:04:12.538534 19604 tablet_bootstrap.cc:654] T 21e14947d70440f19044d8f75c31e1f9 P e5256d91808b47c195bc9b4dbd7f2b87: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:12.552183 19604 tablet_bootstrap.cc:492] T 21e14947d70440f19044d8f75c31e1f9 P e5256d91808b47c195bc9b4dbd7f2b87: No bootstrap required, opened a new log
I20260709 13:04:12.552632 19604 ts_tablet_manager.cc:1403] T 21e14947d70440f19044d8f75c31e1f9 P e5256d91808b47c195bc9b4dbd7f2b87: Time spent bootstrapping tablet: real 0.020s	user 0.007s	sys 0.003s
I20260709 13:04:12.555194 19604 raft_consensus.cc:359] T 21e14947d70440f19044d8f75c31e1f9 P e5256d91808b47c195bc9b4dbd7f2b87 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:12.555907 19604 raft_consensus.cc:385] T 21e14947d70440f19044d8f75c31e1f9 P e5256d91808b47c195bc9b4dbd7f2b87 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:12.556250 19604 raft_consensus.cc:740] T 21e14947d70440f19044d8f75c31e1f9 P e5256d91808b47c195bc9b4dbd7f2b87 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e5256d91808b47c195bc9b4dbd7f2b87, State: Initialized, Role: FOLLOWER
I20260709 13:04:12.562469 19601 tablet_bootstrap.cc:492] T 1dc5b3532fe54f74876d02beffa2c230 P 0473d2b2d01f4459b1e90fd12cc7840e: No bootstrap required, opened a new log
I20260709 13:04:12.563135 19601 ts_tablet_manager.cc:1403] T 1dc5b3532fe54f74876d02beffa2c230 P 0473d2b2d01f4459b1e90fd12cc7840e: Time spent bootstrapping tablet: real 0.183s	user 0.014s	sys 0.001s
I20260709 13:04:12.567036 19604 consensus_queue.cc:260] T 21e14947d70440f19044d8f75c31e1f9 P e5256d91808b47c195bc9b4dbd7f2b87 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:12.569733 19604 ts_tablet_manager.cc:1434] T 21e14947d70440f19044d8f75c31e1f9 P e5256d91808b47c195bc9b4dbd7f2b87: Time spent starting tablet: real 0.017s	user 0.008s	sys 0.000s
I20260709 13:04:12.570655 19604 tablet_bootstrap.cc:492] T 65d8cb8d6ec64f459d5a47cefab10acf P e5256d91808b47c195bc9b4dbd7f2b87: Bootstrap starting.
I20260709 13:04:12.571306 19601 raft_consensus.cc:359] T 1dc5b3532fe54f74876d02beffa2c230 P 0473d2b2d01f4459b1e90fd12cc7840e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:12.572259 19601 raft_consensus.cc:385] T 1dc5b3532fe54f74876d02beffa2c230 P 0473d2b2d01f4459b1e90fd12cc7840e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:12.572604 19601 raft_consensus.cc:740] T 1dc5b3532fe54f74876d02beffa2c230 P 0473d2b2d01f4459b1e90fd12cc7840e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0473d2b2d01f4459b1e90fd12cc7840e, State: Initialized, Role: FOLLOWER
I20260709 13:04:12.573410 19601 consensus_queue.cc:260] T 1dc5b3532fe54f74876d02beffa2c230 P 0473d2b2d01f4459b1e90fd12cc7840e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:12.578192 19600 tablet_bootstrap.cc:492] T 28af091831594f9d8e96482078cc7625 P e61c3a8f61bb48f8a963c9480e53c168: No bootstrap required, opened a new log
I20260709 13:04:12.578706 19600 ts_tablet_manager.cc:1403] T 28af091831594f9d8e96482078cc7625 P e61c3a8f61bb48f8a963c9480e53c168: Time spent bootstrapping tablet: real 0.098s	user 0.035s	sys 0.030s
I20260709 13:04:12.581533 19600 raft_consensus.cc:359] T 28af091831594f9d8e96482078cc7625 P e61c3a8f61bb48f8a963c9480e53c168 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:12.582218 19600 raft_consensus.cc:385] T 28af091831594f9d8e96482078cc7625 P e61c3a8f61bb48f8a963c9480e53c168 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:12.582512 19600 raft_consensus.cc:740] T 28af091831594f9d8e96482078cc7625 P e61c3a8f61bb48f8a963c9480e53c168 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e61c3a8f61bb48f8a963c9480e53c168, State: Initialized, Role: FOLLOWER
I20260709 13:04:12.583214 19600 consensus_queue.cc:260] T 28af091831594f9d8e96482078cc7625 P e61c3a8f61bb48f8a963c9480e53c168 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:12.585350 19600 ts_tablet_manager.cc:1434] T 28af091831594f9d8e96482078cc7625 P e61c3a8f61bb48f8a963c9480e53c168: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 13:04:12.586382 19600 tablet_bootstrap.cc:492] T 76cb037fc9064d13b59a8969d897ce8c P e61c3a8f61bb48f8a963c9480e53c168: Bootstrap starting.
I20260709 13:04:12.578251 19604 tablet_bootstrap.cc:654] T 65d8cb8d6ec64f459d5a47cefab10acf P e5256d91808b47c195bc9b4dbd7f2b87: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:12.590433 19409 raft_consensus.cc:3060] T 4af19371ea874c09a0a2147040835cbb P e5256d91808b47c195bc9b4dbd7f2b87 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:12.593621 19601 ts_tablet_manager.cc:1434] T 1dc5b3532fe54f74876d02beffa2c230 P 0473d2b2d01f4459b1e90fd12cc7840e: Time spent starting tablet: real 0.030s	user 0.008s	sys 0.000s
I20260709 13:04:12.594614 19601 tablet_bootstrap.cc:492] T ab43d85f64114d4ebf618930e43d9ed0 P 0473d2b2d01f4459b1e90fd12cc7840e: Bootstrap starting.
I20260709 13:04:12.602636 19600 tablet_bootstrap.cc:654] T 76cb037fc9064d13b59a8969d897ce8c P e61c3a8f61bb48f8a963c9480e53c168: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:12.604478 19601 tablet_bootstrap.cc:654] T ab43d85f64114d4ebf618930e43d9ed0 P 0473d2b2d01f4459b1e90fd12cc7840e: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:12.616850 19601 tablet_bootstrap.cc:492] T ab43d85f64114d4ebf618930e43d9ed0 P 0473d2b2d01f4459b1e90fd12cc7840e: No bootstrap required, opened a new log
I20260709 13:04:12.617520 19601 ts_tablet_manager.cc:1403] T ab43d85f64114d4ebf618930e43d9ed0 P 0473d2b2d01f4459b1e90fd12cc7840e: Time spent bootstrapping tablet: real 0.023s	user 0.011s	sys 0.003s
I20260709 13:04:12.620245 19601 raft_consensus.cc:359] T ab43d85f64114d4ebf618930e43d9ed0 P 0473d2b2d01f4459b1e90fd12cc7840e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:12.620918 19601 raft_consensus.cc:385] T ab43d85f64114d4ebf618930e43d9ed0 P 0473d2b2d01f4459b1e90fd12cc7840e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:12.621232 19601 raft_consensus.cc:740] T ab43d85f64114d4ebf618930e43d9ed0 P 0473d2b2d01f4459b1e90fd12cc7840e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0473d2b2d01f4459b1e90fd12cc7840e, State: Initialized, Role: FOLLOWER
I20260709 13:04:12.621559 19600 tablet_bootstrap.cc:492] T 76cb037fc9064d13b59a8969d897ce8c P e61c3a8f61bb48f8a963c9480e53c168: No bootstrap required, opened a new log
I20260709 13:04:12.622195 19600 ts_tablet_manager.cc:1403] T 76cb037fc9064d13b59a8969d897ce8c P e61c3a8f61bb48f8a963c9480e53c168: Time spent bootstrapping tablet: real 0.036s	user 0.015s	sys 0.003s
I20260709 13:04:12.621982 19601 consensus_queue.cc:260] T ab43d85f64114d4ebf618930e43d9ed0 P 0473d2b2d01f4459b1e90fd12cc7840e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:12.629907 19630 raft_consensus.cc:493] T 28af091831594f9d8e96482078cc7625 P e61c3a8f61bb48f8a963c9480e53c168 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:12.630509 19630 raft_consensus.cc:515] T 28af091831594f9d8e96482078cc7625 P e61c3a8f61bb48f8a963c9480e53c168 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:12.632863 19630 leader_election.cc:290] T 28af091831594f9d8e96482078cc7625 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:04:12.635092 19601 ts_tablet_manager.cc:1434] T ab43d85f64114d4ebf618930e43d9ed0 P 0473d2b2d01f4459b1e90fd12cc7840e: Time spent starting tablet: real 0.017s	user 0.008s	sys 0.000s
I20260709 13:04:12.635536 19600 raft_consensus.cc:359] T 76cb037fc9064d13b59a8969d897ce8c P e61c3a8f61bb48f8a963c9480e53c168 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:12.639845 19600 raft_consensus.cc:385] T 76cb037fc9064d13b59a8969d897ce8c P e61c3a8f61bb48f8a963c9480e53c168 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:12.640112 19600 raft_consensus.cc:740] T 76cb037fc9064d13b59a8969d897ce8c P e61c3a8f61bb48f8a963c9480e53c168 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e61c3a8f61bb48f8a963c9480e53c168, State: Initialized, Role: FOLLOWER
I20260709 13:04:12.640281 19485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28af091831594f9d8e96482078cc7625" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:04:12.640807 19600 consensus_queue.cc:260] T 76cb037fc9064d13b59a8969d897ce8c P e61c3a8f61bb48f8a963c9480e53c168 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:12.642443 19600 ts_tablet_manager.cc:1434] T 76cb037fc9064d13b59a8969d897ce8c P e61c3a8f61bb48f8a963c9480e53c168: Time spent starting tablet: real 0.020s	user 0.001s	sys 0.002s
I20260709 13:04:12.643278 19820 raft_consensus.cc:493] T ab43d85f64114d4ebf618930e43d9ed0 P 0473d2b2d01f4459b1e90fd12cc7840e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:12.643731 19820 raft_consensus.cc:515] T ab43d85f64114d4ebf618930e43d9ed0 P 0473d2b2d01f4459b1e90fd12cc7840e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
W20260709 13:04:12.644871 19526 leader_election.cc:343] T 28af091831594f9d8e96482078cc7625 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:12.645537 19820 leader_election.cc:290] T ab43d85f64114d4ebf618930e43d9ed0 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:04:12.646474 19820 raft_consensus.cc:493] T 1dc5b3532fe54f74876d02beffa2c230 P 0473d2b2d01f4459b1e90fd12cc7840e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:12.646842 19820 raft_consensus.cc:515] T 1dc5b3532fe54f74876d02beffa2c230 P 0473d2b2d01f4459b1e90fd12cc7840e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:12.646260 19600 tablet_bootstrap.cc:492] T 833a2f0775ed407a94b8924ce50adb63 P e61c3a8f61bb48f8a963c9480e53c168: Bootstrap starting.
I20260709 13:04:12.648216 19560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab43d85f64114d4ebf618930e43d9ed0" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:04:12.648257 19820 leader_election.cc:290] T 1dc5b3532fe54f74876d02beffa2c230 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:04:12.644256 19406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28af091831594f9d8e96482078cc7625" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:04:12.636363 19601 tablet_bootstrap.cc:492] T e381f1d6b8184797ad142de49be225a8 P 0473d2b2d01f4459b1e90fd12cc7840e: Bootstrap starting.
W20260709 13:04:12.651146 19523 leader_election.cc:343] T 28af091831594f9d8e96482078cc7625 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:12.651546 19523 leader_election.cc:304] T 28af091831594f9d8e96482078cc7625 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e61c3a8f61bb48f8a963c9480e53c168; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:04:12.653365 19808 raft_consensus.cc:2749] T 28af091831594f9d8e96482078cc7625 P e61c3a8f61bb48f8a963c9480e53c168 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:04:12.653690 19600 tablet_bootstrap.cc:654] T 833a2f0775ed407a94b8924ce50adb63 P e61c3a8f61bb48f8a963c9480e53c168: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:12.655587 19408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab43d85f64114d4ebf618930e43d9ed0" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
W20260709 13:04:12.655898 19450 leader_election.cc:343] T ab43d85f64114d4ebf618930e43d9ed0 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:04:12.657550 19449 leader_election.cc:343] T ab43d85f64114d4ebf618930e43d9ed0 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:12.657640 19408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dc5b3532fe54f74876d02beffa2c230" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:04:12.658115 19449 leader_election.cc:304] T ab43d85f64114d4ebf618930e43d9ed0 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e; no voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:04:12.659195 19879 raft_consensus.cc:2749] T ab43d85f64114d4ebf618930e43d9ed0 P 0473d2b2d01f4459b1e90fd12cc7840e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:04:12.660324 19449 leader_election.cc:343] T 1dc5b3532fe54f74876d02beffa2c230 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:12.661278 19560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dc5b3532fe54f74876d02beffa2c230" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:04:12.663416 19560 raft_consensus.cc:2468] T 1dc5b3532fe54f74876d02beffa2c230 P e61c3a8f61bb48f8a963c9480e53c168 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 0.
I20260709 13:04:12.662887 19408 raft_consensus.cc:3060] T 21e14947d70440f19044d8f75c31e1f9 P e5256d91808b47c195bc9b4dbd7f2b87 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:12.660454 19601 tablet_bootstrap.cc:654] T e381f1d6b8184797ad142de49be225a8 P 0473d2b2d01f4459b1e90fd12cc7840e: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:12.684054 19600 tablet_bootstrap.cc:492] T 833a2f0775ed407a94b8924ce50adb63 P e61c3a8f61bb48f8a963c9480e53c168: No bootstrap required, opened a new log
I20260709 13:04:12.684551 19600 ts_tablet_manager.cc:1403] T 833a2f0775ed407a94b8924ce50adb63 P e61c3a8f61bb48f8a963c9480e53c168: Time spent bootstrapping tablet: real 0.039s	user 0.006s	sys 0.009s
I20260709 13:04:12.684774 19604 tablet_bootstrap.cc:492] T 65d8cb8d6ec64f459d5a47cefab10acf P e5256d91808b47c195bc9b4dbd7f2b87: No bootstrap required, opened a new log
I20260709 13:04:12.685242 19604 ts_tablet_manager.cc:1403] T 65d8cb8d6ec64f459d5a47cefab10acf P e5256d91808b47c195bc9b4dbd7f2b87: Time spent bootstrapping tablet: real 0.115s	user 0.035s	sys 0.017s
I20260709 13:04:12.687191 19600 raft_consensus.cc:359] T 833a2f0775ed407a94b8924ce50adb63 P e61c3a8f61bb48f8a963c9480e53c168 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:12.687920 19600 raft_consensus.cc:385] T 833a2f0775ed407a94b8924ce50adb63 P e61c3a8f61bb48f8a963c9480e53c168 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:12.688184 19600 raft_consensus.cc:740] T 833a2f0775ed407a94b8924ce50adb63 P e61c3a8f61bb48f8a963c9480e53c168 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e61c3a8f61bb48f8a963c9480e53c168, State: Initialized, Role: FOLLOWER
I20260709 13:04:12.688120 19604 raft_consensus.cc:359] T 65d8cb8d6ec64f459d5a47cefab10acf P e5256d91808b47c195bc9b4dbd7f2b87 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:12.688921 19604 raft_consensus.cc:385] T 65d8cb8d6ec64f459d5a47cefab10acf P e5256d91808b47c195bc9b4dbd7f2b87 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:12.689205 19604 raft_consensus.cc:740] T 65d8cb8d6ec64f459d5a47cefab10acf P e5256d91808b47c195bc9b4dbd7f2b87 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e5256d91808b47c195bc9b4dbd7f2b87, State: Initialized, Role: FOLLOWER
I20260709 13:04:12.689694 19450 leader_election.cc:304] T 1dc5b3532fe54f74876d02beffa2c230 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168; no voters: e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:04:12.689885 19604 consensus_queue.cc:260] T 65d8cb8d6ec64f459d5a47cefab10acf P e5256d91808b47c195bc9b4dbd7f2b87 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:12.690397 19820 raft_consensus.cc:2804] T 1dc5b3532fe54f74876d02beffa2c230 P 0473d2b2d01f4459b1e90fd12cc7840e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:12.692065 19604 ts_tablet_manager.cc:1434] T 65d8cb8d6ec64f459d5a47cefab10acf P e5256d91808b47c195bc9b4dbd7f2b87: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 13:04:12.691947 19920 raft_consensus.cc:493] T 76cb037fc9064d13b59a8969d897ce8c P e5256d91808b47c195bc9b4dbd7f2b87 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:12.692552 19920 raft_consensus.cc:515] T 76cb037fc9064d13b59a8969d897ce8c P e5256d91808b47c195bc9b4dbd7f2b87 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:12.693130 19604 tablet_bootstrap.cc:492] T 833a2f0775ed407a94b8924ce50adb63 P e5256d91808b47c195bc9b4dbd7f2b87: Bootstrap starting.
I20260709 13:04:12.681686 19308 catalog_manager.cc:5697] T 65d8cb8d6ec64f459d5a47cefab10acf P e61c3a8f61bb48f8a963c9480e53c168 reported cstate change: term changed from 0 to 1, leader changed from <none> to e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3). New cstate: current_term: 1 leader_uuid: "e61c3a8f61bb48f8a963c9480e53c168" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } health_report { overall_health: HEALTHY } } }
I20260709 13:04:12.696312 19485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76cb037fc9064d13b59a8969d897ce8c" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:04:12.689188 19600 consensus_queue.cc:260] T 833a2f0775ed407a94b8924ce50adb63 P e61c3a8f61bb48f8a963c9480e53c168 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
W20260709 13:04:12.702505 19377 leader_election.cc:343] T 76cb037fc9064d13b59a8969d897ce8c P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:12.703810 19920 leader_election.cc:290] T 76cb037fc9064d13b59a8969d897ce8c P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:04:12.709698 19604 tablet_bootstrap.cc:654] T 833a2f0775ed407a94b8924ce50adb63 P e5256d91808b47c195bc9b4dbd7f2b87: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:12.717558 19808 consensus_queue.cc:1048] T 21e14947d70440f19044d8f75c31e1f9 P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:12.724494 19808 consensus_queue.cc:1048] T 21e14947d70440f19044d8f75c31e1f9 P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:12.698745 19601 tablet_bootstrap.cc:492] T e381f1d6b8184797ad142de49be225a8 P 0473d2b2d01f4459b1e90fd12cc7840e: No bootstrap required, opened a new log
I20260709 13:04:12.703891 19600 ts_tablet_manager.cc:1434] T 833a2f0775ed407a94b8924ce50adb63 P e61c3a8f61bb48f8a963c9480e53c168: Time spent starting tablet: real 0.019s	user 0.008s	sys 0.000s
I20260709 13:04:12.739584 19604 tablet_bootstrap.cc:492] T 833a2f0775ed407a94b8924ce50adb63 P e5256d91808b47c195bc9b4dbd7f2b87: No bootstrap required, opened a new log
I20260709 13:04:12.705925 19556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76cb037fc9064d13b59a8969d897ce8c" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:04:12.745292 19556 raft_consensus.cc:2468] T 76cb037fc9064d13b59a8969d897ce8c P e61c3a8f61bb48f8a963c9480e53c168 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 0.
I20260709 13:04:12.696988 19560 raft_consensus.cc:3060] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P e61c3a8f61bb48f8a963c9480e53c168 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:12.704190 19820 raft_consensus.cc:493] T 1dc5b3532fe54f74876d02beffa2c230 P 0473d2b2d01f4459b1e90fd12cc7840e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:12.749706 19820 raft_consensus.cc:3060] T 1dc5b3532fe54f74876d02beffa2c230 P 0473d2b2d01f4459b1e90fd12cc7840e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:12.740463 19600 tablet_bootstrap.cc:492] T 48824d5acfbc485ebf8c2d944e7202de P e61c3a8f61bb48f8a963c9480e53c168: Bootstrap starting.
I20260709 13:04:12.753346 19604 ts_tablet_manager.cc:1403] T 833a2f0775ed407a94b8924ce50adb63 P e5256d91808b47c195bc9b4dbd7f2b87: Time spent bootstrapping tablet: real 0.060s	user 0.013s	sys 0.004s
I20260709 13:04:12.753886 19375 leader_election.cc:304] T 76cb037fc9064d13b59a8969d897ce8c P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168; no voters: 0473d2b2d01f4459b1e90fd12cc7840e
I20260709 13:04:12.755829 19855 raft_consensus.cc:2804] T 76cb037fc9064d13b59a8969d897ce8c P e5256d91808b47c195bc9b4dbd7f2b87 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:12.755897 19604 raft_consensus.cc:359] T 833a2f0775ed407a94b8924ce50adb63 P e5256d91808b47c195bc9b4dbd7f2b87 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:12.756587 19604 raft_consensus.cc:385] T 833a2f0775ed407a94b8924ce50adb63 P e5256d91808b47c195bc9b4dbd7f2b87 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:12.756247 19855 raft_consensus.cc:493] T 76cb037fc9064d13b59a8969d897ce8c P e5256d91808b47c195bc9b4dbd7f2b87 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:12.756848 19604 raft_consensus.cc:740] T 833a2f0775ed407a94b8924ce50adb63 P e5256d91808b47c195bc9b4dbd7f2b87 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e5256d91808b47c195bc9b4dbd7f2b87, State: Initialized, Role: FOLLOWER
I20260709 13:04:12.757090 19855 raft_consensus.cc:3060] T 76cb037fc9064d13b59a8969d897ce8c P e5256d91808b47c195bc9b4dbd7f2b87 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:12.757166 19600 tablet_bootstrap.cc:654] T 48824d5acfbc485ebf8c2d944e7202de P e61c3a8f61bb48f8a963c9480e53c168: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:12.757510 19604 consensus_queue.cc:260] T 833a2f0775ed407a94b8924ce50adb63 P e5256d91808b47c195bc9b4dbd7f2b87 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:12.760641 19604 ts_tablet_manager.cc:1434] T 833a2f0775ed407a94b8924ce50adb63 P e5256d91808b47c195bc9b4dbd7f2b87: Time spent starting tablet: real 0.007s	user 0.003s	sys 0.002s
I20260709 13:04:12.761690 19604 tablet_bootstrap.cc:492] T 85c494af21f9457a85da47b9bc70c1fd P e5256d91808b47c195bc9b4dbd7f2b87: Bootstrap starting.
I20260709 13:04:12.762769 19857 raft_consensus.cc:493] T ece3db938bc649d4a40a51522ed5259c P e5256d91808b47c195bc9b4dbd7f2b87 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:12.763201 19857 raft_consensus.cc:515] T ece3db938bc649d4a40a51522ed5259c P e5256d91808b47c195bc9b4dbd7f2b87 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:12.741057 19601 ts_tablet_manager.cc:1403] T e381f1d6b8184797ad142de49be225a8 P 0473d2b2d01f4459b1e90fd12cc7840e: Time spent bootstrapping tablet: real 0.105s	user 0.012s	sys 0.000s
I20260709 13:04:12.765146 19857 leader_election.cc:290] T ece3db938bc649d4a40a51522ed5259c P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:04:12.768589 19560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ece3db938bc649d4a40a51522ed5259c" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:04:12.769181 19560 raft_consensus.cc:2468] T ece3db938bc649d4a40a51522ed5259c P e61c3a8f61bb48f8a963c9480e53c168 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 0.
I20260709 13:04:12.770253 19601 raft_consensus.cc:359] T e381f1d6b8184797ad142de49be225a8 P 0473d2b2d01f4459b1e90fd12cc7840e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:12.770972 19601 raft_consensus.cc:385] T e381f1d6b8184797ad142de49be225a8 P 0473d2b2d01f4459b1e90fd12cc7840e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:12.771230 19601 raft_consensus.cc:740] T e381f1d6b8184797ad142de49be225a8 P 0473d2b2d01f4459b1e90fd12cc7840e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0473d2b2d01f4459b1e90fd12cc7840e, State: Initialized, Role: FOLLOWER
I20260709 13:04:12.771647 19483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ece3db938bc649d4a40a51522ed5259c" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:04:12.771907 19375 leader_election.cc:304] T ece3db938bc649d4a40a51522ed5259c P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:04:12.773087 19919 raft_consensus.cc:2804] T ece3db938bc649d4a40a51522ed5259c P e5256d91808b47c195bc9b4dbd7f2b87 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:12.773438 19919 raft_consensus.cc:493] T ece3db938bc649d4a40a51522ed5259c P e5256d91808b47c195bc9b4dbd7f2b87 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:12.773747 19919 raft_consensus.cc:3060] T ece3db938bc649d4a40a51522ed5259c P e5256d91808b47c195bc9b4dbd7f2b87 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:04:12.773936 19377 leader_election.cc:343] T ece3db938bc649d4a40a51522ed5259c P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:12.776129 19600 tablet_bootstrap.cc:492] T 48824d5acfbc485ebf8c2d944e7202de P e61c3a8f61bb48f8a963c9480e53c168: No bootstrap required, opened a new log
I20260709 13:04:12.776549 19600 ts_tablet_manager.cc:1403] T 48824d5acfbc485ebf8c2d944e7202de P e61c3a8f61bb48f8a963c9480e53c168: Time spent bootstrapping tablet: real 0.036s	user 0.007s	sys 0.002s
I20260709 13:04:12.776914 19601 consensus_queue.cc:260] T e381f1d6b8184797ad142de49be225a8 P 0473d2b2d01f4459b1e90fd12cc7840e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:12.779304 19601 ts_tablet_manager.cc:1434] T e381f1d6b8184797ad142de49be225a8 P 0473d2b2d01f4459b1e90fd12cc7840e: Time spent starting tablet: real 0.015s	user 0.006s	sys 0.000s
I20260709 13:04:12.780169 19919 raft_consensus.cc:515] T ece3db938bc649d4a40a51522ed5259c P e5256d91808b47c195bc9b4dbd7f2b87 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:12.781102 19601 tablet_bootstrap.cc:492] T 833a2f0775ed407a94b8924ce50adb63 P 0473d2b2d01f4459b1e90fd12cc7840e: Bootstrap starting.
I20260709 13:04:12.778941 19600 raft_consensus.cc:359] T 48824d5acfbc485ebf8c2d944e7202de P e61c3a8f61bb48f8a963c9480e53c168 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:12.784585 19600 raft_consensus.cc:385] T 48824d5acfbc485ebf8c2d944e7202de P e61c3a8f61bb48f8a963c9480e53c168 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:12.784881 19600 raft_consensus.cc:740] T 48824d5acfbc485ebf8c2d944e7202de P e61c3a8f61bb48f8a963c9480e53c168 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e61c3a8f61bb48f8a963c9480e53c168, State: Initialized, Role: FOLLOWER
I20260709 13:04:12.785562 19600 consensus_queue.cc:260] T 48824d5acfbc485ebf8c2d944e7202de P e61c3a8f61bb48f8a963c9480e53c168 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:12.787686 19604 tablet_bootstrap.cc:654] T 85c494af21f9457a85da47b9bc70c1fd P e5256d91808b47c195bc9b4dbd7f2b87: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:12.790380 19879 consensus_queue.cc:1048] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:12.792130 19485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ece3db938bc649d4a40a51522ed5259c" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
W20260709 13:04:12.793187 19377 leader_election.cc:343] T ece3db938bc649d4a40a51522ed5259c P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:12.794340 19601 tablet_bootstrap.cc:654] T 833a2f0775ed407a94b8924ce50adb63 P 0473d2b2d01f4459b1e90fd12cc7840e: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:12.795701 19556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ece3db938bc649d4a40a51522ed5259c" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:04:12.796273 19556 raft_consensus.cc:3060] T ece3db938bc649d4a40a51522ed5259c P e61c3a8f61bb48f8a963c9480e53c168 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:12.803300 19600 ts_tablet_manager.cc:1434] T 48824d5acfbc485ebf8c2d944e7202de P e61c3a8f61bb48f8a963c9480e53c168: Time spent starting tablet: real 0.026s	user 0.007s	sys 0.001s
I20260709 13:04:12.804358 19600 tablet_bootstrap.cc:492] T e381f1d6b8184797ad142de49be225a8 P e61c3a8f61bb48f8a963c9480e53c168: Bootstrap starting.
I20260709 13:04:12.805337 19556 raft_consensus.cc:2468] T ece3db938bc649d4a40a51522ed5259c P e61c3a8f61bb48f8a963c9480e53c168 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 1.
I20260709 13:04:12.805868 19919 leader_election.cc:290] T ece3db938bc649d4a40a51522ed5259c P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 1 election: Requested vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:04:12.806646 19820 raft_consensus.cc:515] T 1dc5b3532fe54f74876d02beffa2c230 P 0473d2b2d01f4459b1e90fd12cc7840e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:12.810000 19600 tablet_bootstrap.cc:654] T e381f1d6b8184797ad142de49be225a8 P e61c3a8f61bb48f8a963c9480e53c168: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:12.805639 19855 raft_consensus.cc:515] T 76cb037fc9064d13b59a8969d897ce8c P e5256d91808b47c195bc9b4dbd7f2b87 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:12.810463 19375 leader_election.cc:304] T ece3db938bc649d4a40a51522ed5259c P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168; no voters: 0473d2b2d01f4459b1e90fd12cc7840e
I20260709 13:04:12.811625 19919 raft_consensus.cc:2804] T ece3db938bc649d4a40a51522ed5259c P e5256d91808b47c195bc9b4dbd7f2b87 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:12.812067 19919 raft_consensus.cc:697] T ece3db938bc649d4a40a51522ed5259c P e5256d91808b47c195bc9b4dbd7f2b87 [term 1 LEADER]: Becoming Leader. State: Replica: e5256d91808b47c195bc9b4dbd7f2b87, State: Running, Role: LEADER
I20260709 13:04:12.812846 19919 consensus_queue.cc:237] T ece3db938bc649d4a40a51522ed5259c P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:12.826514 19604 tablet_bootstrap.cc:492] T 85c494af21f9457a85da47b9bc70c1fd P e5256d91808b47c195bc9b4dbd7f2b87: No bootstrap required, opened a new log
I20260709 13:04:12.827903 19604 ts_tablet_manager.cc:1403] T 85c494af21f9457a85da47b9bc70c1fd P e5256d91808b47c195bc9b4dbd7f2b87: Time spent bootstrapping tablet: real 0.066s	user 0.010s	sys 0.001s
I20260709 13:04:12.833745 19560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dc5b3532fe54f74876d02beffa2c230" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:04:12.834345 19560 raft_consensus.cc:3060] T 1dc5b3532fe54f74876d02beffa2c230 P e61c3a8f61bb48f8a963c9480e53c168 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:04:12.835757 19449 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.1:40321, user_credentials={real_user=slave}} blocked reactor thread for 67469.8us
I20260709 13:04:12.847594 19601 tablet_bootstrap.cc:492] T 833a2f0775ed407a94b8924ce50adb63 P 0473d2b2d01f4459b1e90fd12cc7840e: No bootstrap required, opened a new log
I20260709 13:04:12.850453 19560 raft_consensus.cc:2468] T 1dc5b3532fe54f74876d02beffa2c230 P e61c3a8f61bb48f8a963c9480e53c168 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 1.
I20260709 13:04:12.850850 19601 ts_tablet_manager.cc:1403] T 833a2f0775ed407a94b8924ce50adb63 P 0473d2b2d01f4459b1e90fd12cc7840e: Time spent bootstrapping tablet: real 0.070s	user 0.011s	sys 0.000s
I20260709 13:04:12.833320 19820 leader_election.cc:290] T 1dc5b3532fe54f74876d02beffa2c230 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 1 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:04:12.866748 19560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76cb037fc9064d13b59a8969d897ce8c" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:04:12.910394 19560 raft_consensus.cc:3060] T 76cb037fc9064d13b59a8969d897ce8c P e61c3a8f61bb48f8a963c9480e53c168 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:04:12.901150 19450 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.3:36891, user_credentials={real_user=slave}} blocked reactor thread for 67083.9us
I20260709 13:04:12.912428 19450 leader_election.cc:304] T 1dc5b3532fe54f74876d02beffa2c230 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:04:12.917384 19604 raft_consensus.cc:359] T 85c494af21f9457a85da47b9bc70c1fd P e5256d91808b47c195bc9b4dbd7f2b87 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:12.918087 19604 raft_consensus.cc:385] T 85c494af21f9457a85da47b9bc70c1fd P e5256d91808b47c195bc9b4dbd7f2b87 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:12.918346 19604 raft_consensus.cc:740] T 85c494af21f9457a85da47b9bc70c1fd P e5256d91808b47c195bc9b4dbd7f2b87 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e5256d91808b47c195bc9b4dbd7f2b87, State: Initialized, Role: FOLLOWER
I20260709 13:04:12.919039 19604 consensus_queue.cc:260] T 85c494af21f9457a85da47b9bc70c1fd P e5256d91808b47c195bc9b4dbd7f2b87 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:12.921957 19604 ts_tablet_manager.cc:1434] T 85c494af21f9457a85da47b9bc70c1fd P e5256d91808b47c195bc9b4dbd7f2b87: Time spent starting tablet: real 0.093s	user 0.005s	sys 0.000s
I20260709 13:04:12.859241 19855 leader_election.cc:290] T 76cb037fc9064d13b59a8969d897ce8c P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 1 election: Requested vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
W20260709 13:04:12.926640 19449 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.1:40321, user_credentials={real_user=slave}} blocked reactor thread for 73208us
I20260709 13:04:12.928642 19485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76cb037fc9064d13b59a8969d897ce8c" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:04:12.883173 19814 consensus_queue.cc:1048] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.047s
I20260709 13:04:12.931221 19601 raft_consensus.cc:359] T 833a2f0775ed407a94b8924ce50adb63 P 0473d2b2d01f4459b1e90fd12cc7840e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:12.931892 19601 raft_consensus.cc:385] T 833a2f0775ed407a94b8924ce50adb63 P 0473d2b2d01f4459b1e90fd12cc7840e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:12.932242 19601 raft_consensus.cc:740] T 833a2f0775ed407a94b8924ce50adb63 P 0473d2b2d01f4459b1e90fd12cc7840e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0473d2b2d01f4459b1e90fd12cc7840e, State: Initialized, Role: FOLLOWER
I20260709 13:04:12.932796 19954 raft_consensus.cc:2804] T 1dc5b3532fe54f74876d02beffa2c230 P 0473d2b2d01f4459b1e90fd12cc7840e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:12.937862 19560 raft_consensus.cc:2468] T 76cb037fc9064d13b59a8969d897ce8c P e61c3a8f61bb48f8a963c9480e53c168 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 1.
I20260709 13:04:12.935966 19954 raft_consensus.cc:697] T 1dc5b3532fe54f74876d02beffa2c230 P 0473d2b2d01f4459b1e90fd12cc7840e [term 1 LEADER]: Becoming Leader. State: Replica: 0473d2b2d01f4459b1e90fd12cc7840e, State: Running, Role: LEADER
I20260709 13:04:12.943470 19954 consensus_queue.cc:237] T 1dc5b3532fe54f74876d02beffa2c230 P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
W20260709 13:04:12.945092 19377 leader_election.cc:343] T 76cb037fc9064d13b59a8969d897ce8c P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:12.930112 19406 raft_consensus.cc:3060] T 85c494af21f9457a85da47b9bc70c1fd P e5256d91808b47c195bc9b4dbd7f2b87 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:12.946872 19808 raft_consensus.cc:493] T 48824d5acfbc485ebf8c2d944e7202de P e61c3a8f61bb48f8a963c9480e53c168 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:12.949782 19411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dc5b3532fe54f74876d02beffa2c230" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
I20260709 13:04:12.949870 19808 raft_consensus.cc:515] T 48824d5acfbc485ebf8c2d944e7202de P e61c3a8f61bb48f8a963c9480e53c168 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:12.950217 19375 leader_election.cc:304] T 76cb037fc9064d13b59a8969d897ce8c P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168; no voters: 0473d2b2d01f4459b1e90fd12cc7840e
I20260709 13:04:12.951460 19920 raft_consensus.cc:2804] T 76cb037fc9064d13b59a8969d897ce8c P e5256d91808b47c195bc9b4dbd7f2b87 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:12.951975 19808 leader_election.cc:290] T 48824d5acfbc485ebf8c2d944e7202de P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:04:12.956085 19600 tablet_bootstrap.cc:492] T e381f1d6b8184797ad142de49be225a8 P e61c3a8f61bb48f8a963c9480e53c168: No bootstrap required, opened a new log
I20260709 13:04:12.956562 19600 ts_tablet_manager.cc:1403] T e381f1d6b8184797ad142de49be225a8 P e61c3a8f61bb48f8a963c9480e53c168: Time spent bootstrapping tablet: real 0.152s	user 0.021s	sys 0.004s
I20260709 13:04:12.959318 19600 raft_consensus.cc:359] T e381f1d6b8184797ad142de49be225a8 P e61c3a8f61bb48f8a963c9480e53c168 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:12.959995 19600 raft_consensus.cc:385] T e381f1d6b8184797ad142de49be225a8 P e61c3a8f61bb48f8a963c9480e53c168 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:12.960264 19600 raft_consensus.cc:740] T e381f1d6b8184797ad142de49be225a8 P e61c3a8f61bb48f8a963c9480e53c168 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e61c3a8f61bb48f8a963c9480e53c168, State: Initialized, Role: FOLLOWER
I20260709 13:04:12.961524 19600 consensus_queue.cc:260] T e381f1d6b8184797ad142de49be225a8 P e61c3a8f61bb48f8a963c9480e53c168 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:12.978118 19600 ts_tablet_manager.cc:1434] T e381f1d6b8184797ad142de49be225a8 P e61c3a8f61bb48f8a963c9480e53c168: Time spent starting tablet: real 0.021s	user 0.004s	sys 0.004s
I20260709 13:04:12.977876 19601 consensus_queue.cc:260] T 833a2f0775ed407a94b8924ce50adb63 P 0473d2b2d01f4459b1e90fd12cc7840e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
W20260709 13:04:12.982446 19357 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:04:12.984536 19601 ts_tablet_manager.cc:1434] T 833a2f0775ed407a94b8924ce50adb63 P 0473d2b2d01f4459b1e90fd12cc7840e: Time spent starting tablet: real 0.133s	user 0.009s	sys 0.000s
I20260709 13:04:12.985677 19601 tablet_bootstrap.cc:492] T 179fd671030940b4b4a4e24bcc4aba0a P 0473d2b2d01f4459b1e90fd12cc7840e: Bootstrap starting.
I20260709 13:04:12.985630 19962 raft_consensus.cc:493] T e381f1d6b8184797ad142de49be225a8 P 0473d2b2d01f4459b1e90fd12cc7840e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:12.988663 19832 raft_consensus.cc:493] T 833a2f0775ed407a94b8924ce50adb63 P e61c3a8f61bb48f8a963c9480e53c168 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:12.989162 19832 raft_consensus.cc:515] T 833a2f0775ed407a94b8924ce50adb63 P e61c3a8f61bb48f8a963c9480e53c168 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:13.001685 19630 consensus_queue.cc:1048] T 85c494af21f9457a85da47b9bc70c1fd P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:04:12.986198 19962 raft_consensus.cc:515] T e381f1d6b8184797ad142de49be225a8 P 0473d2b2d01f4459b1e90fd12cc7840e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:13.007936 19604 tablet_bootstrap.cc:492] T fa731b585f684a7fb2d106c50f143b83 P e5256d91808b47c195bc9b4dbd7f2b87: Bootstrap starting.
I20260709 13:04:13.008746 19600 tablet_bootstrap.cc:492] T fa731b585f684a7fb2d106c50f143b83 P e61c3a8f61bb48f8a963c9480e53c168: Bootstrap starting.
I20260709 13:04:13.023470 19306 catalog_manager.cc:5697] T ece3db938bc649d4a40a51522ed5259c P e5256d91808b47c195bc9b4dbd7f2b87 reported cstate change: term changed from 0 to 1, leader changed from <none> to e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1). New cstate: current_term: 1 leader_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:13.012275 19920 raft_consensus.cc:697] T 76cb037fc9064d13b59a8969d897ce8c P e5256d91808b47c195bc9b4dbd7f2b87 [term 1 LEADER]: Becoming Leader. State: Replica: e5256d91808b47c195bc9b4dbd7f2b87, State: Running, Role: LEADER
I20260709 13:04:13.022541 19832 leader_election.cc:290] T 833a2f0775ed407a94b8924ce50adb63 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:04:13.021095 19483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48824d5acfbc485ebf8c2d944e7202de" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:04:13.030592 19857 raft_consensus.cc:493] T 775c229504194560ba9589bc2199b089 P e5256d91808b47c195bc9b4dbd7f2b87 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:13.041769 19962 leader_election.cc:290] T e381f1d6b8184797ad142de49be225a8 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:04:13.042562 19410 raft_consensus.cc:3060] T 65d8cb8d6ec64f459d5a47cefab10acf P e5256d91808b47c195bc9b4dbd7f2b87 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:13.043401 19405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "833a2f0775ed407a94b8924ce50adb63" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:04:13.042788 19920 consensus_queue.cc:237] T 76cb037fc9064d13b59a8969d897ce8c P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:13.044075 19405 raft_consensus.cc:2468] T 833a2f0775ed407a94b8924ce50adb63 P e5256d91808b47c195bc9b4dbd7f2b87 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 0.
I20260709 13:04:13.045907 19409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48824d5acfbc485ebf8c2d944e7202de" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:04:13.054044 19604 tablet_bootstrap.cc:654] T fa731b585f684a7fb2d106c50f143b83 P e5256d91808b47c195bc9b4dbd7f2b87: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:13.057293 19523 leader_election.cc:304] T 833a2f0775ed407a94b8924ce50adb63 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
W20260709 13:04:13.059857 19449 leader_election.cc:343] T 1dc5b3532fe54f74876d02beffa2c230 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:04:13.058627 19523 leader_election.cc:343] T 48824d5acfbc485ebf8c2d944e7202de P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:04:13.068827 19526 leader_election.cc:343] T 48824d5acfbc485ebf8c2d944e7202de P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:13.069388 19630 consensus_queue.cc:1048] T 65d8cb8d6ec64f459d5a47cefab10acf P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:13.077464 19409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e381f1d6b8184797ad142de49be225a8" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:04:13.068539 19808 raft_consensus.cc:2804] T 833a2f0775ed407a94b8924ce50adb63 P e61c3a8f61bb48f8a963c9480e53c168 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:13.083297 19808 raft_consensus.cc:493] T 833a2f0775ed407a94b8924ce50adb63 P e61c3a8f61bb48f8a963c9480e53c168 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:13.045142 19857 raft_consensus.cc:515] T 775c229504194560ba9589bc2199b089 P e5256d91808b47c195bc9b4dbd7f2b87 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:13.089030 19559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e381f1d6b8184797ad142de49be225a8" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:04:13.089650 19559 raft_consensus.cc:2468] T e381f1d6b8184797ad142de49be225a8 P e61c3a8f61bb48f8a963c9480e53c168 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 0.
I20260709 13:04:13.092671 19486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "833a2f0775ed407a94b8924ce50adb63" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:04:13.097105 19486 raft_consensus.cc:2468] T 833a2f0775ed407a94b8924ce50adb63 P 0473d2b2d01f4459b1e90fd12cc7840e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 0.
I20260709 13:04:13.087930 19808 raft_consensus.cc:3060] T 833a2f0775ed407a94b8924ce50adb63 P e61c3a8f61bb48f8a963c9480e53c168 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:13.098579 19600 tablet_bootstrap.cc:654] T fa731b585f684a7fb2d106c50f143b83 P e61c3a8f61bb48f8a963c9480e53c168: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:13.104677 19450 leader_election.cc:304] T e381f1d6b8184797ad142de49be225a8 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
W20260709 13:04:13.106213 19449 leader_election.cc:343] T e381f1d6b8184797ad142de49be225a8 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:13.118744 19879 raft_consensus.cc:2804] T e381f1d6b8184797ad142de49be225a8 P 0473d2b2d01f4459b1e90fd12cc7840e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:13.119180 19879 raft_consensus.cc:493] T e381f1d6b8184797ad142de49be225a8 P 0473d2b2d01f4459b1e90fd12cc7840e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:13.119552 19879 raft_consensus.cc:3060] T e381f1d6b8184797ad142de49be225a8 P 0473d2b2d01f4459b1e90fd12cc7840e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:13.131392 19857 leader_election.cc:290] T 775c229504194560ba9589bc2199b089 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:04:13.165158 19832 consensus_queue.cc:1048] T 85c494af21f9457a85da47b9bc70c1fd P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:13.183584 19879 raft_consensus.cc:515] T e381f1d6b8184797ad142de49be225a8 P 0473d2b2d01f4459b1e90fd12cc7840e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:13.185185 19601 tablet_bootstrap.cc:654] T 179fd671030940b4b4a4e24bcc4aba0a P 0473d2b2d01f4459b1e90fd12cc7840e: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:13.186786 19808 raft_consensus.cc:515] T 833a2f0775ed407a94b8924ce50adb63 P e61c3a8f61bb48f8a963c9480e53c168 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:13.191179 19808 leader_election.cc:290] T 833a2f0775ed407a94b8924ce50adb63 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 1 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:04:13.192039 19879 leader_election.cc:290] T e381f1d6b8184797ad142de49be225a8 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 1 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:04:13.192236 19559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "775c229504194560ba9589bc2199b089" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:04:13.192790 19559 raft_consensus.cc:2468] T 775c229504194560ba9589bc2199b089 P e61c3a8f61bb48f8a963c9480e53c168 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 0.
I20260709 13:04:13.205109 19408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "833a2f0775ed407a94b8924ce50adb63" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
I20260709 13:04:13.205767 19408 raft_consensus.cc:3060] T 833a2f0775ed407a94b8924ce50adb63 P e5256d91808b47c195bc9b4dbd7f2b87 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:13.208690 19604 tablet_bootstrap.cc:492] T fa731b585f684a7fb2d106c50f143b83 P e5256d91808b47c195bc9b4dbd7f2b87: No bootstrap required, opened a new log
I20260709 13:04:13.209208 19604 ts_tablet_manager.cc:1403] T fa731b585f684a7fb2d106c50f143b83 P e5256d91808b47c195bc9b4dbd7f2b87: Time spent bootstrapping tablet: real 0.231s	user 0.011s	sys 0.015s
I20260709 13:04:13.209477 19309 catalog_manager.cc:5697] T 1dc5b3532fe54f74876d02beffa2c230 P 0473d2b2d01f4459b1e90fd12cc7840e reported cstate change: term changed from 0 to 1, leader changed from <none> to 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2). New cstate: current_term: 1 leader_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:13.210268 19408 raft_consensus.cc:2468] T 833a2f0775ed407a94b8924ce50adb63 P e5256d91808b47c195bc9b4dbd7f2b87 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 1.
I20260709 13:04:13.211548 19375 leader_election.cc:304] T 775c229504194560ba9589bc2199b089 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:04:13.211637 19604 raft_consensus.cc:359] T fa731b585f684a7fb2d106c50f143b83 P e5256d91808b47c195bc9b4dbd7f2b87 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:13.212159 19855 raft_consensus.cc:2804] T 775c229504194560ba9589bc2199b089 P e5256d91808b47c195bc9b4dbd7f2b87 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:13.212317 19604 raft_consensus.cc:385] T fa731b585f684a7fb2d106c50f143b83 P e5256d91808b47c195bc9b4dbd7f2b87 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:13.212556 19855 raft_consensus.cc:493] T 775c229504194560ba9589bc2199b089 P e5256d91808b47c195bc9b4dbd7f2b87 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:13.212643 19604 raft_consensus.cc:740] T fa731b585f684a7fb2d106c50f143b83 P e5256d91808b47c195bc9b4dbd7f2b87 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e5256d91808b47c195bc9b4dbd7f2b87, State: Initialized, Role: FOLLOWER
I20260709 13:04:13.212998 19855 raft_consensus.cc:3060] T 775c229504194560ba9589bc2199b089 P e5256d91808b47c195bc9b4dbd7f2b87 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:13.213347 19604 consensus_queue.cc:260] T fa731b585f684a7fb2d106c50f143b83 P e5256d91808b47c195bc9b4dbd7f2b87 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:13.220793 19855 raft_consensus.cc:515] T 775c229504194560ba9589bc2199b089 P e5256d91808b47c195bc9b4dbd7f2b87 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:13.221256 19523 leader_election.cc:304] T 833a2f0775ed407a94b8924ce50adb63 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:04:13.221823 19604 ts_tablet_manager.cc:1434] T fa731b585f684a7fb2d106c50f143b83 P e5256d91808b47c195bc9b4dbd7f2b87: Time spent starting tablet: real 0.012s	user 0.007s	sys 0.000s
I20260709 13:04:13.222059 19970 raft_consensus.cc:2804] T 833a2f0775ed407a94b8924ce50adb63 P e61c3a8f61bb48f8a963c9480e53c168 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:13.223820 19970 raft_consensus.cc:697] T 833a2f0775ed407a94b8924ce50adb63 P e61c3a8f61bb48f8a963c9480e53c168 [term 1 LEADER]: Becoming Leader. State: Replica: e61c3a8f61bb48f8a963c9480e53c168, State: Running, Role: LEADER
I20260709 13:04:13.224581 19970 consensus_queue.cc:237] T 833a2f0775ed407a94b8924ce50adb63 P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:13.230386 19306 catalog_manager.cc:5697] T 76cb037fc9064d13b59a8969d897ce8c P e5256d91808b47c195bc9b4dbd7f2b87 reported cstate change: term changed from 0 to 1, leader changed from <none> to e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1). New cstate: current_term: 1 leader_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:13.235839 19526 leader_election.cc:304] T 48824d5acfbc485ebf8c2d944e7202de P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e61c3a8f61bb48f8a963c9480e53c168; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:04:13.237003 19971 raft_consensus.cc:2749] T 48824d5acfbc485ebf8c2d944e7202de P e61c3a8f61bb48f8a963c9480e53c168 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:04:13.238054 19526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.2:46257, user_credentials={real_user=slave}} blocked reactor thread for 170538us
I20260709 13:04:13.240494 19482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "775c229504194560ba9589bc2199b089" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:04:13.245040 19559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "775c229504194560ba9589bc2199b089" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:04:13.245604 19559 raft_consensus.cc:3060] T 775c229504194560ba9589bc2199b089 P e61c3a8f61bb48f8a963c9480e53c168 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:13.255786 19409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e381f1d6b8184797ad142de49be225a8" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
I20260709 13:04:13.258405 19559 raft_consensus.cc:2468] T 775c229504194560ba9589bc2199b089 P e61c3a8f61bb48f8a963c9480e53c168 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 1.
I20260709 13:04:13.222848 19604 tablet_bootstrap.cc:492] T 0e1085d23e8347fbbd5bce7542f4b1f4 P e5256d91808b47c195bc9b4dbd7f2b87: Bootstrap starting.
I20260709 13:04:13.223194 19855 leader_election.cc:290] T 775c229504194560ba9589bc2199b089 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 1 election: Requested vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:04:13.267724 19604 tablet_bootstrap.cc:654] T 0e1085d23e8347fbbd5bce7542f4b1f4 P e5256d91808b47c195bc9b4dbd7f2b87: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:13.267992 19600 tablet_bootstrap.cc:492] T fa731b585f684a7fb2d106c50f143b83 P e61c3a8f61bb48f8a963c9480e53c168: No bootstrap required, opened a new log
I20260709 13:04:13.273299 19600 ts_tablet_manager.cc:1403] T fa731b585f684a7fb2d106c50f143b83 P e61c3a8f61bb48f8a963c9480e53c168: Time spent bootstrapping tablet: real 0.281s	user 0.037s	sys 0.023s
W20260709 13:04:13.274890 19377 leader_election.cc:343] T 775c229504194560ba9589bc2199b089 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:13.274796 19375 leader_election.cc:304] T 775c229504194560ba9589bc2199b089 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:04:13.275693 19855 raft_consensus.cc:2804] T 775c229504194560ba9589bc2199b089 P e5256d91808b47c195bc9b4dbd7f2b87 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:13.277266 19600 raft_consensus.cc:359] T fa731b585f684a7fb2d106c50f143b83 P e61c3a8f61bb48f8a963c9480e53c168 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:13.278055 19600 raft_consensus.cc:385] T fa731b585f684a7fb2d106c50f143b83 P e61c3a8f61bb48f8a963c9480e53c168 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:13.278357 19600 raft_consensus.cc:740] T fa731b585f684a7fb2d106c50f143b83 P e61c3a8f61bb48f8a963c9480e53c168 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e61c3a8f61bb48f8a963c9480e53c168, State: Initialized, Role: FOLLOWER
I20260709 13:04:13.278995 19601 tablet_bootstrap.cc:492] T 179fd671030940b4b4a4e24bcc4aba0a P 0473d2b2d01f4459b1e90fd12cc7840e: No bootstrap required, opened a new log
I20260709 13:04:13.279461 19601 ts_tablet_manager.cc:1403] T 179fd671030940b4b4a4e24bcc4aba0a P 0473d2b2d01f4459b1e90fd12cc7840e: Time spent bootstrapping tablet: real 0.294s	user 0.014s	sys 0.012s
I20260709 13:04:13.279176 19600 consensus_queue.cc:260] T fa731b585f684a7fb2d106c50f143b83 P e61c3a8f61bb48f8a963c9480e53c168 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:13.282315 19601 raft_consensus.cc:359] T 179fd671030940b4b4a4e24bcc4aba0a P 0473d2b2d01f4459b1e90fd12cc7840e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:13.283004 19601 raft_consensus.cc:385] T 179fd671030940b4b4a4e24bcc4aba0a P 0473d2b2d01f4459b1e90fd12cc7840e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:13.283258 19601 raft_consensus.cc:740] T 179fd671030940b4b4a4e24bcc4aba0a P 0473d2b2d01f4459b1e90fd12cc7840e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0473d2b2d01f4459b1e90fd12cc7840e, State: Initialized, Role: FOLLOWER
I20260709 13:04:13.285406 19855 raft_consensus.cc:697] T 775c229504194560ba9589bc2199b089 P e5256d91808b47c195bc9b4dbd7f2b87 [term 1 LEADER]: Becoming Leader. State: Replica: e5256d91808b47c195bc9b4dbd7f2b87, State: Running, Role: LEADER
I20260709 13:04:13.286298 19855 consensus_queue.cc:237] T 775c229504194560ba9589bc2199b089 P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:13.294561 19482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "833a2f0775ed407a94b8924ce50adb63" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:04:13.295154 19482 raft_consensus.cc:3060] T 833a2f0775ed407a94b8924ce50adb63 P 0473d2b2d01f4459b1e90fd12cc7840e [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:04:13.295333 19449 leader_election.cc:343] T e381f1d6b8184797ad142de49be225a8 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:13.297492 19832 raft_consensus.cc:493] T 179fd671030940b4b4a4e24bcc4aba0a P e61c3a8f61bb48f8a963c9480e53c168 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:13.297995 19832 raft_consensus.cc:515] T 179fd671030940b4b4a4e24bcc4aba0a P e61c3a8f61bb48f8a963c9480e53c168 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:13.299081 19479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "775c229504194560ba9589bc2199b089" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:04:13.300036 19832 leader_election.cc:290] T 179fd671030940b4b4a4e24bcc4aba0a P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:04:13.301132 19411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "179fd671030940b4b4a4e24bcc4aba0a" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
W20260709 13:04:13.302455 19523 leader_election.cc:343] T 179fd671030940b4b4a4e24bcc4aba0a P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:04:13.305817 19377 leader_election.cc:343] T 775c229504194560ba9589bc2199b089 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:13.306546 19559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e381f1d6b8184797ad142de49be225a8" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:04:13.308254 19559 raft_consensus.cc:3060] T e381f1d6b8184797ad142de49be225a8 P e61c3a8f61bb48f8a963c9480e53c168 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:13.312249 19482 raft_consensus.cc:2468] T 833a2f0775ed407a94b8924ce50adb63 P 0473d2b2d01f4459b1e90fd12cc7840e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 1.
I20260709 13:04:13.322932 19600 ts_tablet_manager.cc:1434] T fa731b585f684a7fb2d106c50f143b83 P e61c3a8f61bb48f8a963c9480e53c168: Time spent starting tablet: real 0.049s	user 0.014s	sys 0.000s
I20260709 13:04:13.326126 19559 raft_consensus.cc:2468] T e381f1d6b8184797ad142de49be225a8 P e61c3a8f61bb48f8a963c9480e53c168 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 1.
I20260709 13:04:13.327234 19600 tablet_bootstrap.cc:492] T 2b74109013a140ada21feeef92d6f563 P e61c3a8f61bb48f8a963c9480e53c168: Bootstrap starting.
I20260709 13:04:13.326126 19309 catalog_manager.cc:5697] T 833a2f0775ed407a94b8924ce50adb63 P e61c3a8f61bb48f8a963c9480e53c168 reported cstate change: term changed from 0 to 1, leader changed from <none> to e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3). New cstate: current_term: 1 leader_uuid: "e61c3a8f61bb48f8a963c9480e53c168" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } health_report { overall_health: HEALTHY } } }
I20260709 13:04:13.330416 19601 consensus_queue.cc:260] T 179fd671030940b4b4a4e24bcc4aba0a P 0473d2b2d01f4459b1e90fd12cc7840e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:13.331921 19954 raft_consensus.cc:493] T 179fd671030940b4b4a4e24bcc4aba0a P 0473d2b2d01f4459b1e90fd12cc7840e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:13.332351 19954 raft_consensus.cc:515] T 179fd671030940b4b4a4e24bcc4aba0a P 0473d2b2d01f4459b1e90fd12cc7840e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:13.334208 19954 leader_election.cc:290] T 179fd671030940b4b4a4e24bcc4aba0a P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:04:13.334779 19600 tablet_bootstrap.cc:654] T 2b74109013a140ada21feeef92d6f563 P e61c3a8f61bb48f8a963c9480e53c168: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:13.338374 19855 consensus_queue.cc:1048] T ece3db938bc649d4a40a51522ed5259c P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:04:13.339948 19450 leader_election.cc:304] T e381f1d6b8184797ad142de49be225a8 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168; no voters: e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:04:13.342067 19879 raft_consensus.cc:2804] T e381f1d6b8184797ad142de49be225a8 P 0473d2b2d01f4459b1e90fd12cc7840e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:13.342553 19879 raft_consensus.cc:697] T e381f1d6b8184797ad142de49be225a8 P 0473d2b2d01f4459b1e90fd12cc7840e [term 1 LEADER]: Becoming Leader. State: Replica: 0473d2b2d01f4459b1e90fd12cc7840e, State: Running, Role: LEADER
I20260709 13:04:13.342778 19984 raft_consensus.cc:493] T fa731b585f684a7fb2d106c50f143b83 P e61c3a8f61bb48f8a963c9480e53c168 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:13.343237 19984 raft_consensus.cc:515] T fa731b585f684a7fb2d106c50f143b83 P e61c3a8f61bb48f8a963c9480e53c168 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:13.343371 19879 consensus_queue.cc:237] T e381f1d6b8184797ad142de49be225a8 P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:13.344813 19556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "179fd671030940b4b4a4e24bcc4aba0a" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:04:13.345376 19984 leader_election.cc:290] T fa731b585f684a7fb2d106c50f143b83 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:04:13.345440 19556 raft_consensus.cc:2468] T 179fd671030940b4b4a4e24bcc4aba0a P e61c3a8f61bb48f8a963c9480e53c168 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 0.
I20260709 13:04:13.346295 19832 consensus_queue.cc:1048] T 65d8cb8d6ec64f459d5a47cefab10acf P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:13.347855 19411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa731b585f684a7fb2d106c50f143b83" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:04:13.348459 19411 raft_consensus.cc:2468] T fa731b585f684a7fb2d106c50f143b83 P e5256d91808b47c195bc9b4dbd7f2b87 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 0.
I20260709 13:04:13.349783 19523 leader_election.cc:304] T fa731b585f684a7fb2d106c50f143b83 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:04:13.351605 19411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "179fd671030940b4b4a4e24bcc4aba0a" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:04:13.351722 19450 leader_election.cc:304] T 179fd671030940b4b4a4e24bcc4aba0a P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:04:13.351967 19832 raft_consensus.cc:2804] T fa731b585f684a7fb2d106c50f143b83 P e61c3a8f61bb48f8a963c9480e53c168 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:13.352460 19954 raft_consensus.cc:2804] T 179fd671030940b4b4a4e24bcc4aba0a P 0473d2b2d01f4459b1e90fd12cc7840e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:13.352823 19954 raft_consensus.cc:493] T 179fd671030940b4b4a4e24bcc4aba0a P 0473d2b2d01f4459b1e90fd12cc7840e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:13.353195 19954 raft_consensus.cc:3060] T 179fd671030940b4b4a4e24bcc4aba0a P 0473d2b2d01f4459b1e90fd12cc7840e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:13.353700 19482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "179fd671030940b4b4a4e24bcc4aba0a" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:04:13.352480 19832 raft_consensus.cc:493] T fa731b585f684a7fb2d106c50f143b83 P e61c3a8f61bb48f8a963c9480e53c168 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:13.357093 19832 raft_consensus.cc:3060] T fa731b585f684a7fb2d106c50f143b83 P e61c3a8f61bb48f8a963c9480e53c168 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:13.364192 19832 raft_consensus.cc:515] T fa731b585f684a7fb2d106c50f143b83 P e61c3a8f61bb48f8a963c9480e53c168 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:13.366818 19411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa731b585f684a7fb2d106c50f143b83" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
I20260709 13:04:13.367372 19411 raft_consensus.cc:3060] T fa731b585f684a7fb2d106c50f143b83 P e5256d91808b47c195bc9b4dbd7f2b87 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:04:13.369067 19449 leader_election.cc:343] T 179fd671030940b4b4a4e24bcc4aba0a P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:13.370482 19306 catalog_manager.cc:5697] T 775c229504194560ba9589bc2199b089 P e5256d91808b47c195bc9b4dbd7f2b87 reported cstate change: term changed from 0 to 1, leader changed from <none> to e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1). New cstate: current_term: 1 leader_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:13.391700 19600 tablet_bootstrap.cc:492] T 2b74109013a140ada21feeef92d6f563 P e61c3a8f61bb48f8a963c9480e53c168: No bootstrap required, opened a new log
I20260709 13:04:13.396121 19600 ts_tablet_manager.cc:1403] T 2b74109013a140ada21feeef92d6f563 P e61c3a8f61bb48f8a963c9480e53c168: Time spent bootstrapping tablet: real 0.069s	user 0.011s	sys 0.017s
I20260709 13:04:13.396649 19954 raft_consensus.cc:515] T 179fd671030940b4b4a4e24bcc4aba0a P 0473d2b2d01f4459b1e90fd12cc7840e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:13.397805 19482 raft_consensus.cc:2393] T 179fd671030940b4b4a4e24bcc4aba0a P 0473d2b2d01f4459b1e90fd12cc7840e [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e61c3a8f61bb48f8a963c9480e53c168 in current term 1: Already voted for candidate 0473d2b2d01f4459b1e90fd12cc7840e in this term.
I20260709 13:04:13.398512 19600 raft_consensus.cc:359] T 2b74109013a140ada21feeef92d6f563 P e61c3a8f61bb48f8a963c9480e53c168 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:13.399232 19600 raft_consensus.cc:385] T 2b74109013a140ada21feeef92d6f563 P e61c3a8f61bb48f8a963c9480e53c168 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:13.399488 19600 raft_consensus.cc:740] T 2b74109013a140ada21feeef92d6f563 P e61c3a8f61bb48f8a963c9480e53c168 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e61c3a8f61bb48f8a963c9480e53c168, State: Initialized, Role: FOLLOWER
I20260709 13:04:13.399601 19558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "179fd671030940b4b4a4e24bcc4aba0a" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:04:13.400193 19558 raft_consensus.cc:3060] T 179fd671030940b4b4a4e24bcc4aba0a P e61c3a8f61bb48f8a963c9480e53c168 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:13.400153 19600 consensus_queue.cc:260] T 2b74109013a140ada21feeef92d6f563 P e61c3a8f61bb48f8a963c9480e53c168 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:13.402202 19600 ts_tablet_manager.cc:1434] T 2b74109013a140ada21feeef92d6f563 P e61c3a8f61bb48f8a963c9480e53c168: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 13:04:13.403018 19600 tablet_bootstrap.cc:492] T ff9b0eddd810459b82d91c60777c10eb P e61c3a8f61bb48f8a963c9480e53c168: Bootstrap starting.
I20260709 13:04:13.406867 19558 raft_consensus.cc:2468] T 179fd671030940b4b4a4e24bcc4aba0a P e61c3a8f61bb48f8a963c9480e53c168 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 1.
I20260709 13:04:13.392261 19601 ts_tablet_manager.cc:1434] T 179fd671030940b4b4a4e24bcc4aba0a P 0473d2b2d01f4459b1e90fd12cc7840e: Time spent starting tablet: real 0.112s	user 0.007s	sys 0.000s
I20260709 13:04:13.407122 19600 tablet_bootstrap.cc:654] T ff9b0eddd810459b82d91c60777c10eb P e61c3a8f61bb48f8a963c9480e53c168: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:13.410802 19954 leader_election.cc:290] T 179fd671030940b4b4a4e24bcc4aba0a P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 1 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:04:13.411023 19832 leader_election.cc:290] T fa731b585f684a7fb2d106c50f143b83 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 1 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:04:13.413552 19601 tablet_bootstrap.cc:492] T 4509b76741dc428e9201c70c1658da13 P 0473d2b2d01f4459b1e90fd12cc7840e: Bootstrap starting.
I20260709 13:04:13.408736 19450 leader_election.cc:304] T 179fd671030940b4b4a4e24bcc4aba0a P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:04:13.393821 19411 raft_consensus.cc:2468] T fa731b585f684a7fb2d106c50f143b83 P e5256d91808b47c195bc9b4dbd7f2b87 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 1.
W20260709 13:04:13.395174 19377 consensus_peers.cc:597] T ece3db938bc649d4a40a51522ed5259c P e5256d91808b47c195bc9b4dbd7f2b87 -> Peer 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257): Couldn't send request to peer 0473d2b2d01f4459b1e90fd12cc7840e. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:13.394791 19604 tablet_bootstrap.cc:492] T 0e1085d23e8347fbbd5bce7542f4b1f4 P e5256d91808b47c195bc9b4dbd7f2b87: No bootstrap required, opened a new log
I20260709 13:04:13.415936 19604 ts_tablet_manager.cc:1403] T 0e1085d23e8347fbbd5bce7542f4b1f4 P e5256d91808b47c195bc9b4dbd7f2b87: Time spent bootstrapping tablet: real 0.193s	user 0.010s	sys 0.001s
I20260709 13:04:13.417599 19814 raft_consensus.cc:2804] T 179fd671030940b4b4a4e24bcc4aba0a P 0473d2b2d01f4459b1e90fd12cc7840e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:13.417645 19523 leader_election.cc:304] T fa731b585f684a7fb2d106c50f143b83 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:04:13.418211 19814 raft_consensus.cc:697] T 179fd671030940b4b4a4e24bcc4aba0a P 0473d2b2d01f4459b1e90fd12cc7840e [term 1 LEADER]: Becoming Leader. State: Replica: 0473d2b2d01f4459b1e90fd12cc7840e, State: Running, Role: LEADER
I20260709 13:04:13.433827 19954 consensus_queue.cc:1048] T 1dc5b3532fe54f74876d02beffa2c230 P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.024s
I20260709 13:04:13.419117 19814 consensus_queue.cc:237] T 179fd671030940b4b4a4e24bcc4aba0a P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:13.424957 19604 raft_consensus.cc:359] T 0e1085d23e8347fbbd5bce7542f4b1f4 P e5256d91808b47c195bc9b4dbd7f2b87 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:13.458632 19604 raft_consensus.cc:385] T 0e1085d23e8347fbbd5bce7542f4b1f4 P e5256d91808b47c195bc9b4dbd7f2b87 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:13.458977 19604 raft_consensus.cc:740] T 0e1085d23e8347fbbd5bce7542f4b1f4 P e5256d91808b47c195bc9b4dbd7f2b87 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e5256d91808b47c195bc9b4dbd7f2b87, State: Initialized, Role: FOLLOWER
I20260709 13:04:13.418542 19480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa731b585f684a7fb2d106c50f143b83" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:04:13.460861 19481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa731b585f684a7fb2d106c50f143b83" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:04:13.460716 19604 consensus_queue.cc:260] T 0e1085d23e8347fbbd5bce7542f4b1f4 P e5256d91808b47c195bc9b4dbd7f2b87 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:13.463276 19526 leader_election.cc:304] T 179fd671030940b4b4a4e24bcc4aba0a P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e61c3a8f61bb48f8a963c9480e53c168; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:04:13.464080 19984 raft_consensus.cc:2749] T 179fd671030940b4b4a4e24bcc4aba0a P e61c3a8f61bb48f8a963c9480e53c168 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:04:13.464721 19410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "179fd671030940b4b4a4e24bcc4aba0a" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
I20260709 13:04:13.419090 19687 raft_consensus.cc:2804] T fa731b585f684a7fb2d106c50f143b83 P e61c3a8f61bb48f8a963c9480e53c168 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:13.467432 19687 raft_consensus.cc:697] T fa731b585f684a7fb2d106c50f143b83 P e61c3a8f61bb48f8a963c9480e53c168 [term 1 LEADER]: Becoming Leader. State: Replica: e61c3a8f61bb48f8a963c9480e53c168, State: Running, Role: LEADER
I20260709 13:04:13.468505 19604 ts_tablet_manager.cc:1434] T 0e1085d23e8347fbbd5bce7542f4b1f4 P e5256d91808b47c195bc9b4dbd7f2b87: Time spent starting tablet: real 0.052s	user 0.014s	sys 0.009s
I20260709 13:04:13.468443 19687 consensus_queue.cc:237] T fa731b585f684a7fb2d106c50f143b83 P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:13.470324 19604 tablet_bootstrap.cc:492] T 4509b76741dc428e9201c70c1658da13 P e5256d91808b47c195bc9b4dbd7f2b87: Bootstrap starting.
I20260709 13:04:13.482376 19604 tablet_bootstrap.cc:654] T 4509b76741dc428e9201c70c1658da13 P e5256d91808b47c195bc9b4dbd7f2b87: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:13.486040 19308 catalog_manager.cc:5697] T e381f1d6b8184797ad142de49be225a8 P 0473d2b2d01f4459b1e90fd12cc7840e reported cstate change: term changed from 0 to 1, leader changed from <none> to 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2). New cstate: current_term: 1 leader_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } health_report { overall_health: UNKNOWN } } }
W20260709 13:04:13.492203 19512 tablet.cc:2406] T 179fd671030940b4b4a4e24bcc4aba0a P 0473d2b2d01f4459b1e90fd12cc7840e: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260709 13:04:13.516419 19526 leader_election.cc:343] T fa731b585f684a7fb2d106c50f143b83 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:04:13.517740 19526 leader_election.cc:343] T fa731b585f684a7fb2d106c50f143b83 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:13.529390 19601 tablet_bootstrap.cc:654] T 4509b76741dc428e9201c70c1658da13 P 0473d2b2d01f4459b1e90fd12cc7840e: Neither blocks nor log segments found. Creating new log.
W20260709 13:04:13.536912 19449 leader_election.cc:343] T 179fd671030940b4b4a4e24bcc4aba0a P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:13.543162 19600 tablet_bootstrap.cc:492] T ff9b0eddd810459b82d91c60777c10eb P e61c3a8f61bb48f8a963c9480e53c168: No bootstrap required, opened a new log
I20260709 13:04:13.546083 19600 ts_tablet_manager.cc:1403] T ff9b0eddd810459b82d91c60777c10eb P e61c3a8f61bb48f8a963c9480e53c168: Time spent bootstrapping tablet: real 0.143s	user 0.017s	sys 0.028s
I20260709 13:04:13.548410 19309 catalog_manager.cc:5697] T 179fd671030940b4b4a4e24bcc4aba0a P 0473d2b2d01f4459b1e90fd12cc7840e reported cstate change: term changed from 0 to 1, leader changed from <none> to 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2). New cstate: current_term: 1 leader_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:13.549386 19600 raft_consensus.cc:359] T ff9b0eddd810459b82d91c60777c10eb P e61c3a8f61bb48f8a963c9480e53c168 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:13.550056 19600 raft_consensus.cc:385] T ff9b0eddd810459b82d91c60777c10eb P e61c3a8f61bb48f8a963c9480e53c168 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:13.550307 19600 raft_consensus.cc:740] T ff9b0eddd810459b82d91c60777c10eb P e61c3a8f61bb48f8a963c9480e53c168 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e61c3a8f61bb48f8a963c9480e53c168, State: Initialized, Role: FOLLOWER
W20260709 13:04:13.550964 19449 consensus_peers.cc:597] T 1dc5b3532fe54f74876d02beffa2c230 P 0473d2b2d01f4459b1e90fd12cc7840e -> Peer e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321): Couldn't send request to peer e5256d91808b47c195bc9b4dbd7f2b87. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:13.553020 19604 tablet_bootstrap.cc:492] T 4509b76741dc428e9201c70c1658da13 P e5256d91808b47c195bc9b4dbd7f2b87: No bootstrap required, opened a new log
I20260709 13:04:13.553481 19604 ts_tablet_manager.cc:1403] T 4509b76741dc428e9201c70c1658da13 P e5256d91808b47c195bc9b4dbd7f2b87: Time spent bootstrapping tablet: real 0.083s	user 0.005s	sys 0.011s
I20260709 13:04:13.553934 19600 consensus_queue.cc:260] T ff9b0eddd810459b82d91c60777c10eb P e61c3a8f61bb48f8a963c9480e53c168 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:13.556041 19600 ts_tablet_manager.cc:1434] T ff9b0eddd810459b82d91c60777c10eb P e61c3a8f61bb48f8a963c9480e53c168: Time spent starting tablet: real 0.010s	user 0.005s	sys 0.000s
I20260709 13:04:13.556423 19604 raft_consensus.cc:359] T 4509b76741dc428e9201c70c1658da13 P e5256d91808b47c195bc9b4dbd7f2b87 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:13.557018 19600 tablet_bootstrap.cc:492] T 5ec1c4ce15e04c7e8c283a62179f2a64 P e61c3a8f61bb48f8a963c9480e53c168: Bootstrap starting.
I20260709 13:04:13.557291 19604 raft_consensus.cc:385] T 4509b76741dc428e9201c70c1658da13 P e5256d91808b47c195bc9b4dbd7f2b87 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:13.557652 19604 raft_consensus.cc:740] T 4509b76741dc428e9201c70c1658da13 P e5256d91808b47c195bc9b4dbd7f2b87 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e5256d91808b47c195bc9b4dbd7f2b87, State: Initialized, Role: FOLLOWER
I20260709 13:04:13.550771 19308 catalog_manager.cc:5697] T fa731b585f684a7fb2d106c50f143b83 P e61c3a8f61bb48f8a963c9480e53c168 reported cstate change: term changed from 0 to 1, leader changed from <none> to e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3). New cstate: current_term: 1 leader_uuid: "e61c3a8f61bb48f8a963c9480e53c168" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } health_report { overall_health: HEALTHY } } }
I20260709 13:04:13.558420 19604 consensus_queue.cc:260] T 4509b76741dc428e9201c70c1658da13 P e5256d91808b47c195bc9b4dbd7f2b87 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:13.563824 19600 tablet_bootstrap.cc:654] T 5ec1c4ce15e04c7e8c283a62179f2a64 P e61c3a8f61bb48f8a963c9480e53c168: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:13.585103 19600 tablet_bootstrap.cc:492] T 5ec1c4ce15e04c7e8c283a62179f2a64 P e61c3a8f61bb48f8a963c9480e53c168: No bootstrap required, opened a new log
I20260709 13:04:13.585551 19600 ts_tablet_manager.cc:1403] T 5ec1c4ce15e04c7e8c283a62179f2a64 P e61c3a8f61bb48f8a963c9480e53c168: Time spent bootstrapping tablet: real 0.029s	user 0.010s	sys 0.006s
I20260709 13:04:13.590363 19855 consensus_queue.cc:1048] T 76cb037fc9064d13b59a8969d897ce8c P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:04:13.592314 19600 raft_consensus.cc:359] T 5ec1c4ce15e04c7e8c283a62179f2a64 P e61c3a8f61bb48f8a963c9480e53c168 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:13.593084 19600 raft_consensus.cc:385] T 5ec1c4ce15e04c7e8c283a62179f2a64 P e61c3a8f61bb48f8a963c9480e53c168 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:13.593361 19600 raft_consensus.cc:740] T 5ec1c4ce15e04c7e8c283a62179f2a64 P e61c3a8f61bb48f8a963c9480e53c168 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e61c3a8f61bb48f8a963c9480e53c168, State: Initialized, Role: FOLLOWER
I20260709 13:04:13.594246 19600 consensus_queue.cc:260] T 5ec1c4ce15e04c7e8c283a62179f2a64 P e61c3a8f61bb48f8a963c9480e53c168 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:13.597007 19600 ts_tablet_manager.cc:1434] T 5ec1c4ce15e04c7e8c283a62179f2a64 P e61c3a8f61bb48f8a963c9480e53c168: Time spent starting tablet: real 0.011s	user 0.005s	sys 0.002s
I20260709 13:04:13.598057 19600 tablet_bootstrap.cc:492] T ab43d85f64114d4ebf618930e43d9ed0 P e61c3a8f61bb48f8a963c9480e53c168: Bootstrap starting.
I20260709 13:04:13.604492 19600 tablet_bootstrap.cc:654] T ab43d85f64114d4ebf618930e43d9ed0 P e61c3a8f61bb48f8a963c9480e53c168: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:13.609197 19604 ts_tablet_manager.cc:1434] T 4509b76741dc428e9201c70c1658da13 P e5256d91808b47c195bc9b4dbd7f2b87: Time spent starting tablet: real 0.055s	user 0.008s	sys 0.000s
I20260709 13:04:13.610397 19604 tablet_bootstrap.cc:492] T ab43d85f64114d4ebf618930e43d9ed0 P e5256d91808b47c195bc9b4dbd7f2b87: Bootstrap starting.
I20260709 13:04:13.618810 19600 tablet_bootstrap.cc:492] T ab43d85f64114d4ebf618930e43d9ed0 P e61c3a8f61bb48f8a963c9480e53c168: No bootstrap required, opened a new log
I20260709 13:04:13.619302 19600 ts_tablet_manager.cc:1403] T ab43d85f64114d4ebf618930e43d9ed0 P e61c3a8f61bb48f8a963c9480e53c168: Time spent bootstrapping tablet: real 0.021s	user 0.018s	sys 0.000s
I20260709 13:04:13.626487 19600 raft_consensus.cc:359] T ab43d85f64114d4ebf618930e43d9ed0 P e61c3a8f61bb48f8a963c9480e53c168 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:13.627197 19600 raft_consensus.cc:385] T ab43d85f64114d4ebf618930e43d9ed0 P e61c3a8f61bb48f8a963c9480e53c168 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:13.627777 19604 tablet_bootstrap.cc:654] T ab43d85f64114d4ebf618930e43d9ed0 P e5256d91808b47c195bc9b4dbd7f2b87: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:13.629017 19600 raft_consensus.cc:740] T ab43d85f64114d4ebf618930e43d9ed0 P e61c3a8f61bb48f8a963c9480e53c168 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e61c3a8f61bb48f8a963c9480e53c168, State: Initialized, Role: FOLLOWER
I20260709 13:04:13.629792 19600 consensus_queue.cc:260] T ab43d85f64114d4ebf618930e43d9ed0 P e61c3a8f61bb48f8a963c9480e53c168 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:13.631059 19406 raft_consensus.cc:3060] T 0e1085d23e8347fbbd5bce7542f4b1f4 P e5256d91808b47c195bc9b4dbd7f2b87 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:13.631671 19600 ts_tablet_manager.cc:1434] T ab43d85f64114d4ebf618930e43d9ed0 P e61c3a8f61bb48f8a963c9480e53c168: Time spent starting tablet: real 0.012s	user 0.006s	sys 0.000s
I20260709 13:04:13.643776 19601 tablet_bootstrap.cc:492] T 4509b76741dc428e9201c70c1658da13 P 0473d2b2d01f4459b1e90fd12cc7840e: No bootstrap required, opened a new log
I20260709 13:04:13.644258 19601 ts_tablet_manager.cc:1403] T 4509b76741dc428e9201c70c1658da13 P 0473d2b2d01f4459b1e90fd12cc7840e: Time spent bootstrapping tablet: real 0.231s	user 0.026s	sys 0.043s
I20260709 13:04:13.647107 19601 raft_consensus.cc:359] T 4509b76741dc428e9201c70c1658da13 P 0473d2b2d01f4459b1e90fd12cc7840e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:13.647801 19601 raft_consensus.cc:385] T 4509b76741dc428e9201c70c1658da13 P 0473d2b2d01f4459b1e90fd12cc7840e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:13.648138 19601 raft_consensus.cc:740] T 4509b76741dc428e9201c70c1658da13 P 0473d2b2d01f4459b1e90fd12cc7840e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0473d2b2d01f4459b1e90fd12cc7840e, State: Initialized, Role: FOLLOWER
I20260709 13:04:13.648772 19601 consensus_queue.cc:260] T 4509b76741dc428e9201c70c1658da13 P 0473d2b2d01f4459b1e90fd12cc7840e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:13.650852 19601 ts_tablet_manager.cc:1434] T 4509b76741dc428e9201c70c1658da13 P 0473d2b2d01f4459b1e90fd12cc7840e: Time spent starting tablet: real 0.006s	user 0.008s	sys 0.000s
I20260709 13:04:13.653915 19601 tablet_bootstrap.cc:492] T 76cb037fc9064d13b59a8969d897ce8c P 0473d2b2d01f4459b1e90fd12cc7840e: Bootstrap starting.
I20260709 13:04:13.658928 19983 consensus_queue.cc:1048] T 833a2f0775ed407a94b8924ce50adb63 P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:13.660422 19983 raft_consensus.cc:493] T ab43d85f64114d4ebf618930e43d9ed0 P e61c3a8f61bb48f8a963c9480e53c168 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:13.660863 19983 raft_consensus.cc:515] T ab43d85f64114d4ebf618930e43d9ed0 P e61c3a8f61bb48f8a963c9480e53c168 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:13.663767 19410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab43d85f64114d4ebf618930e43d9ed0" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
W20260709 13:04:13.665450 19523 leader_election.cc:343] T ab43d85f64114d4ebf618930e43d9ed0 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:13.666882 19601 tablet_bootstrap.cc:654] T 76cb037fc9064d13b59a8969d897ce8c P 0473d2b2d01f4459b1e90fd12cc7840e: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:13.668368 19482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab43d85f64114d4ebf618930e43d9ed0" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:04:13.668546 19983 leader_election.cc:290] T ab43d85f64114d4ebf618930e43d9ed0 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:04:13.669019 19482 raft_consensus.cc:2468] T ab43d85f64114d4ebf618930e43d9ed0 P 0473d2b2d01f4459b1e90fd12cc7840e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 0.
I20260709 13:04:13.671336 19526 leader_election.cc:304] T ab43d85f64114d4ebf618930e43d9ed0 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168; no voters: e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:04:13.672796 19983 raft_consensus.cc:2804] T ab43d85f64114d4ebf618930e43d9ed0 P e61c3a8f61bb48f8a963c9480e53c168 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:13.673323 19983 raft_consensus.cc:493] T ab43d85f64114d4ebf618930e43d9ed0 P e61c3a8f61bb48f8a963c9480e53c168 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:13.673808 19983 raft_consensus.cc:3060] T ab43d85f64114d4ebf618930e43d9ed0 P e61c3a8f61bb48f8a963c9480e53c168 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:04:13.682636 19377 consensus_peers.cc:597] T 76cb037fc9064d13b59a8969d897ce8c P e5256d91808b47c195bc9b4dbd7f2b87 -> Peer 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257): Couldn't send request to peer 0473d2b2d01f4459b1e90fd12cc7840e. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:13.696059 19983 raft_consensus.cc:515] T ab43d85f64114d4ebf618930e43d9ed0 P e61c3a8f61bb48f8a963c9480e53c168 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:13.699155 19410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab43d85f64114d4ebf618930e43d9ed0" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
W20260709 13:04:13.700521 19523 leader_election.cc:343] T ab43d85f64114d4ebf618930e43d9ed0 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:13.702327 19481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab43d85f64114d4ebf618930e43d9ed0" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:04:13.702893 19481 raft_consensus.cc:3060] T ab43d85f64114d4ebf618930e43d9ed0 P 0473d2b2d01f4459b1e90fd12cc7840e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:13.714250 19630 raft_consensus.cc:493] T 5ec1c4ce15e04c7e8c283a62179f2a64 P e61c3a8f61bb48f8a963c9480e53c168 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:13.714826 19630 raft_consensus.cc:515] T 5ec1c4ce15e04c7e8c283a62179f2a64 P e61c3a8f61bb48f8a963c9480e53c168 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:13.713726 19855 raft_consensus.cc:493] T 4509b76741dc428e9201c70c1658da13 P e5256d91808b47c195bc9b4dbd7f2b87 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:13.718510 19855 raft_consensus.cc:515] T 4509b76741dc428e9201c70c1658da13 P e5256d91808b47c195bc9b4dbd7f2b87 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:13.720443 19855 leader_election.cc:290] T 4509b76741dc428e9201c70c1658da13 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:04:13.722839 19480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4509b76741dc428e9201c70c1658da13" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:04:13.723940 19559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4509b76741dc428e9201c70c1658da13" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:04:13.724879 19559 raft_consensus.cc:2468] T 4509b76741dc428e9201c70c1658da13 P e61c3a8f61bb48f8a963c9480e53c168 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 0.
I20260709 13:04:13.730176 19604 tablet_bootstrap.cc:492] T ab43d85f64114d4ebf618930e43d9ed0 P e5256d91808b47c195bc9b4dbd7f2b87: No bootstrap required, opened a new log
I20260709 13:04:13.730845 19375 leader_election.cc:304] T 4509b76741dc428e9201c70c1658da13 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:04:13.731272 19604 ts_tablet_manager.cc:1403] T ab43d85f64114d4ebf618930e43d9ed0 P e5256d91808b47c195bc9b4dbd7f2b87: Time spent bootstrapping tablet: real 0.121s	user 0.014s	sys 0.005s
I20260709 13:04:13.731760 19920 raft_consensus.cc:2804] T 4509b76741dc428e9201c70c1658da13 P e5256d91808b47c195bc9b4dbd7f2b87 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:13.732137 19920 raft_consensus.cc:493] T 4509b76741dc428e9201c70c1658da13 P e5256d91808b47c195bc9b4dbd7f2b87 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:13.732455 19920 raft_consensus.cc:3060] T 4509b76741dc428e9201c70c1658da13 P e5256d91808b47c195bc9b4dbd7f2b87 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:13.735005 19630 leader_election.cc:290] T 5ec1c4ce15e04c7e8c283a62179f2a64 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:04:13.735852 19480 raft_consensus.cc:2468] T 4509b76741dc428e9201c70c1658da13 P 0473d2b2d01f4459b1e90fd12cc7840e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 0.
I20260709 13:04:13.734194 19604 raft_consensus.cc:359] T ab43d85f64114d4ebf618930e43d9ed0 P e5256d91808b47c195bc9b4dbd7f2b87 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:13.737079 19604 raft_consensus.cc:385] T ab43d85f64114d4ebf618930e43d9ed0 P e5256d91808b47c195bc9b4dbd7f2b87 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:13.737349 19604 raft_consensus.cc:740] T ab43d85f64114d4ebf618930e43d9ed0 P e5256d91808b47c195bc9b4dbd7f2b87 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e5256d91808b47c195bc9b4dbd7f2b87, State: Initialized, Role: FOLLOWER
I20260709 13:04:13.711592 19983 leader_election.cc:290] T ab43d85f64114d4ebf618930e43d9ed0 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 1 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:04:13.738811 19408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ec1c4ce15e04c7e8c283a62179f2a64" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:04:13.730213 19481 raft_consensus.cc:2468] T ab43d85f64114d4ebf618930e43d9ed0 P 0473d2b2d01f4459b1e90fd12cc7840e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 1.
I20260709 13:04:13.740082 19814 consensus_queue.cc:1048] T e381f1d6b8184797ad142de49be225a8 P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:13.740411 19526 leader_election.cc:304] T ab43d85f64114d4ebf618930e43d9ed0 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168; no voters: e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:04:13.741257 19808 raft_consensus.cc:2804] T ab43d85f64114d4ebf618930e43d9ed0 P e61c3a8f61bb48f8a963c9480e53c168 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:13.741737 19808 raft_consensus.cc:697] T ab43d85f64114d4ebf618930e43d9ed0 P e61c3a8f61bb48f8a963c9480e53c168 [term 1 LEADER]: Becoming Leader. State: Replica: e61c3a8f61bb48f8a963c9480e53c168, State: Running, Role: LEADER
I20260709 13:04:13.742551 19808 consensus_queue.cc:237] T ab43d85f64114d4ebf618930e43d9ed0 P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
W20260709 13:04:13.744179 19523 leader_election.cc:343] T 5ec1c4ce15e04c7e8c283a62179f2a64 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:13.740983 19481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ec1c4ce15e04c7e8c283a62179f2a64" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:04:13.745234 19832 consensus_queue.cc:1048] T 833a2f0775ed407a94b8924ce50adb63 P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:13.740123 19604 consensus_queue.cc:260] T ab43d85f64114d4ebf618930e43d9ed0 P e5256d91808b47c195bc9b4dbd7f2b87 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
W20260709 13:04:13.746209 19526 leader_election.cc:343] T 5ec1c4ce15e04c7e8c283a62179f2a64 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:13.746613 19526 leader_election.cc:304] T 5ec1c4ce15e04c7e8c283a62179f2a64 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e61c3a8f61bb48f8a963c9480e53c168; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:04:13.747485 19630 raft_consensus.cc:2749] T 5ec1c4ce15e04c7e8c283a62179f2a64 P e61c3a8f61bb48f8a963c9480e53c168 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:04:13.756717 19604 ts_tablet_manager.cc:1434] T ab43d85f64114d4ebf618930e43d9ed0 P e5256d91808b47c195bc9b4dbd7f2b87: Time spent starting tablet: real 0.025s	user 0.006s	sys 0.000s
I20260709 13:04:13.760567 19601 tablet_bootstrap.cc:492] T 76cb037fc9064d13b59a8969d897ce8c P 0473d2b2d01f4459b1e90fd12cc7840e: No bootstrap required, opened a new log
I20260709 13:04:13.760996 19601 ts_tablet_manager.cc:1403] T 76cb037fc9064d13b59a8969d897ce8c P 0473d2b2d01f4459b1e90fd12cc7840e: Time spent bootstrapping tablet: real 0.107s	user 0.027s	sys 0.019s
I20260709 13:04:13.768499 19604 tablet_bootstrap.cc:492] T 1dc5b3532fe54f74876d02beffa2c230 P e5256d91808b47c195bc9b4dbd7f2b87: Bootstrap starting.
I20260709 13:04:13.781330 19308 catalog_manager.cc:5697] T ab43d85f64114d4ebf618930e43d9ed0 P e61c3a8f61bb48f8a963c9480e53c168 reported cstate change: term changed from 0 to 1, leader changed from <none> to e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3). New cstate: current_term: 1 leader_uuid: "e61c3a8f61bb48f8a963c9480e53c168" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } health_report { overall_health: HEALTHY } } }
I20260709 13:04:13.777356 19920 raft_consensus.cc:515] T 4509b76741dc428e9201c70c1658da13 P e5256d91808b47c195bc9b4dbd7f2b87 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:13.788678 19482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4509b76741dc428e9201c70c1658da13" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:04:13.789263 19482 raft_consensus.cc:3060] T 4509b76741dc428e9201c70c1658da13 P 0473d2b2d01f4459b1e90fd12cc7840e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:13.800911 19482 raft_consensus.cc:2468] T 4509b76741dc428e9201c70c1658da13 P 0473d2b2d01f4459b1e90fd12cc7840e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 1.
I20260709 13:04:13.801175 19920 leader_election.cc:290] T 4509b76741dc428e9201c70c1658da13 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 1 election: Requested vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:04:13.801970 19377 leader_election.cc:304] T 4509b76741dc428e9201c70c1658da13 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87; no voters: 
I20260709 13:04:13.803687 19967 raft_consensus.cc:2804] T 4509b76741dc428e9201c70c1658da13 P e5256d91808b47c195bc9b4dbd7f2b87 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:13.803604 19556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4509b76741dc428e9201c70c1658da13" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:04:13.804234 19967 raft_consensus.cc:697] T 4509b76741dc428e9201c70c1658da13 P e5256d91808b47c195bc9b4dbd7f2b87 [term 1 LEADER]: Becoming Leader. State: Replica: e5256d91808b47c195bc9b4dbd7f2b87, State: Running, Role: LEADER
I20260709 13:04:13.804265 19556 raft_consensus.cc:3060] T 4509b76741dc428e9201c70c1658da13 P e61c3a8f61bb48f8a963c9480e53c168 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:13.823609 19832 raft_consensus.cc:493] T ff9b0eddd810459b82d91c60777c10eb P e61c3a8f61bb48f8a963c9480e53c168 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:13.824137 19832 raft_consensus.cc:515] T ff9b0eddd810459b82d91c60777c10eb P e61c3a8f61bb48f8a963c9480e53c168 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:13.826421 19832 leader_election.cc:290] T ff9b0eddd810459b82d91c60777c10eb P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:04:13.826066 19601 raft_consensus.cc:359] T 76cb037fc9064d13b59a8969d897ce8c P 0473d2b2d01f4459b1e90fd12cc7840e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
W20260709 13:04:13.822539 19377 consensus_peers.cc:597] T 775c229504194560ba9589bc2199b089 P e5256d91808b47c195bc9b4dbd7f2b87 -> Peer 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257): Couldn't send request to peer 0473d2b2d01f4459b1e90fd12cc7840e. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:13.827230 19601 raft_consensus.cc:385] T 76cb037fc9064d13b59a8969d897ce8c P 0473d2b2d01f4459b1e90fd12cc7840e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:13.827524 19601 raft_consensus.cc:740] T 76cb037fc9064d13b59a8969d897ce8c P 0473d2b2d01f4459b1e90fd12cc7840e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0473d2b2d01f4459b1e90fd12cc7840e, State: Initialized, Role: FOLLOWER
I20260709 13:04:13.828087 19601 consensus_queue.cc:260] T 76cb037fc9064d13b59a8969d897ce8c P 0473d2b2d01f4459b1e90fd12cc7840e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:13.829980 19411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff9b0eddd810459b82d91c60777c10eb" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
W20260709 13:04:13.830914 19449 consensus_peers.cc:597] T e381f1d6b8184797ad142de49be225a8 P 0473d2b2d01f4459b1e90fd12cc7840e -> Peer e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321): Couldn't send request to peer e5256d91808b47c195bc9b4dbd7f2b87. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:04:13.832667 19523 leader_election.cc:343] T ff9b0eddd810459b82d91c60777c10eb P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:13.834476 19482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff9b0eddd810459b82d91c60777c10eb" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:04:13.835573 19556 raft_consensus.cc:2468] T 4509b76741dc428e9201c70c1658da13 P e61c3a8f61bb48f8a963c9480e53c168 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 1.
I20260709 13:04:13.835803 19967 consensus_queue.cc:237] T 4509b76741dc428e9201c70c1658da13 P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
W20260709 13:04:13.838780 19526 leader_election.cc:343] T ff9b0eddd810459b82d91c60777c10eb P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:13.839159 19526 leader_election.cc:304] T ff9b0eddd810459b82d91c60777c10eb P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e61c3a8f61bb48f8a963c9480e53c168; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:04:13.840058 19808 raft_consensus.cc:2749] T ff9b0eddd810459b82d91c60777c10eb P e61c3a8f61bb48f8a963c9480e53c168 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:04:13.841323 19604 tablet_bootstrap.cc:654] T 1dc5b3532fe54f74876d02beffa2c230 P e5256d91808b47c195bc9b4dbd7f2b87: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:13.842586 19601 ts_tablet_manager.cc:1434] T 76cb037fc9064d13b59a8969d897ce8c P 0473d2b2d01f4459b1e90fd12cc7840e: Time spent starting tablet: real 0.081s	user 0.005s	sys 0.002s
I20260709 13:04:13.847982 19601 tablet_bootstrap.cc:492] T ece3db938bc649d4a40a51522ed5259c P 0473d2b2d01f4459b1e90fd12cc7840e: Bootstrap starting.
I20260709 13:04:13.855295 19601 tablet_bootstrap.cc:654] T ece3db938bc649d4a40a51522ed5259c P 0473d2b2d01f4459b1e90fd12cc7840e: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:13.857203 19604 tablet_bootstrap.cc:492] T 1dc5b3532fe54f74876d02beffa2c230 P e5256d91808b47c195bc9b4dbd7f2b87: No bootstrap required, opened a new log
I20260709 13:04:13.857724 19604 ts_tablet_manager.cc:1403] T 1dc5b3532fe54f74876d02beffa2c230 P e5256d91808b47c195bc9b4dbd7f2b87: Time spent bootstrapping tablet: real 0.091s	user 0.008s	sys 0.007s
I20260709 13:04:13.860198 19601 tablet_bootstrap.cc:492] T ece3db938bc649d4a40a51522ed5259c P 0473d2b2d01f4459b1e90fd12cc7840e: No bootstrap required, opened a new log
I20260709 13:04:13.861084 19601 ts_tablet_manager.cc:1403] T ece3db938bc649d4a40a51522ed5259c P 0473d2b2d01f4459b1e90fd12cc7840e: Time spent bootstrapping tablet: real 0.013s	user 0.009s	sys 0.000s
I20260709 13:04:13.860656 19604 raft_consensus.cc:359] T 1dc5b3532fe54f74876d02beffa2c230 P e5256d91808b47c195bc9b4dbd7f2b87 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:13.861524 19604 raft_consensus.cc:385] T 1dc5b3532fe54f74876d02beffa2c230 P e5256d91808b47c195bc9b4dbd7f2b87 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:13.861868 19604 raft_consensus.cc:740] T 1dc5b3532fe54f74876d02beffa2c230 P e5256d91808b47c195bc9b4dbd7f2b87 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e5256d91808b47c195bc9b4dbd7f2b87, State: Initialized, Role: FOLLOWER
I20260709 13:04:13.862263 19808 raft_consensus.cc:493] T 2b74109013a140ada21feeef92d6f563 P e61c3a8f61bb48f8a963c9480e53c168 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:13.862731 19808 raft_consensus.cc:515] T 2b74109013a140ada21feeef92d6f563 P e61c3a8f61bb48f8a963c9480e53c168 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:13.862629 19604 consensus_queue.cc:260] T 1dc5b3532fe54f74876d02beffa2c230 P e5256d91808b47c195bc9b4dbd7f2b87 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:13.863775 19601 raft_consensus.cc:359] T ece3db938bc649d4a40a51522ed5259c P 0473d2b2d01f4459b1e90fd12cc7840e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:13.864418 19601 raft_consensus.cc:385] T ece3db938bc649d4a40a51522ed5259c P 0473d2b2d01f4459b1e90fd12cc7840e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:13.864671 19601 raft_consensus.cc:740] T ece3db938bc649d4a40a51522ed5259c P 0473d2b2d01f4459b1e90fd12cc7840e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0473d2b2d01f4459b1e90fd12cc7840e, State: Initialized, Role: FOLLOWER
I20260709 13:04:13.864898 19808 leader_election.cc:290] T 2b74109013a140ada21feeef92d6f563 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:04:13.865653 19604 ts_tablet_manager.cc:1434] T 1dc5b3532fe54f74876d02beffa2c230 P e5256d91808b47c195bc9b4dbd7f2b87: Time spent starting tablet: real 0.008s	user 0.003s	sys 0.003s
I20260709 13:04:13.866335 19408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b74109013a140ada21feeef92d6f563" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:04:13.865387 19601 consensus_queue.cc:260] T ece3db938bc649d4a40a51522ed5259c P 0473d2b2d01f4459b1e90fd12cc7840e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
W20260709 13:04:13.867486 19523 leader_election.cc:343] T 2b74109013a140ada21feeef92d6f563 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:13.867703 19481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b74109013a140ada21feeef92d6f563" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:04:13.867991 19604 tablet_bootstrap.cc:492] T 2b74109013a140ada21feeef92d6f563 P e5256d91808b47c195bc9b4dbd7f2b87: Bootstrap starting.
W20260709 13:04:13.873451 19526 leader_election.cc:343] T 2b74109013a140ada21feeef92d6f563 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:13.873884 19526 leader_election.cc:304] T 2b74109013a140ada21feeef92d6f563 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e61c3a8f61bb48f8a963c9480e53c168; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:04:13.868969 19601 ts_tablet_manager.cc:1434] T ece3db938bc649d4a40a51522ed5259c P 0473d2b2d01f4459b1e90fd12cc7840e: Time spent starting tablet: real 0.008s	user 0.004s	sys 0.004s
I20260709 13:04:13.875232 19601 tablet_bootstrap.cc:492] T fa731b585f684a7fb2d106c50f143b83 P 0473d2b2d01f4459b1e90fd12cc7840e: Bootstrap starting.
I20260709 13:04:13.880852 19832 raft_consensus.cc:2749] T 2b74109013a140ada21feeef92d6f563 P e61c3a8f61bb48f8a963c9480e53c168 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:04:13.883215 19601 tablet_bootstrap.cc:654] T fa731b585f684a7fb2d106c50f143b83 P 0473d2b2d01f4459b1e90fd12cc7840e: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:13.885990 19306 catalog_manager.cc:5697] T 4509b76741dc428e9201c70c1658da13 P e5256d91808b47c195bc9b4dbd7f2b87 reported cstate change: term changed from 0 to 1, leader changed from <none> to e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1). New cstate: current_term: 1 leader_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:13.887492 19604 tablet_bootstrap.cc:654] T 2b74109013a140ada21feeef92d6f563 P e5256d91808b47c195bc9b4dbd7f2b87: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:13.894654 19967 consensus_queue.cc:1048] T 775c229504194560ba9589bc2199b089 P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:13.895663 19601 tablet_bootstrap.cc:492] T fa731b585f684a7fb2d106c50f143b83 P 0473d2b2d01f4459b1e90fd12cc7840e: No bootstrap required, opened a new log
I20260709 13:04:13.896082 19601 ts_tablet_manager.cc:1403] T fa731b585f684a7fb2d106c50f143b83 P 0473d2b2d01f4459b1e90fd12cc7840e: Time spent bootstrapping tablet: real 0.021s	user 0.007s	sys 0.008s
I20260709 13:04:13.898547 19601 raft_consensus.cc:359] T fa731b585f684a7fb2d106c50f143b83 P 0473d2b2d01f4459b1e90fd12cc7840e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:13.899160 19601 raft_consensus.cc:385] T fa731b585f684a7fb2d106c50f143b83 P 0473d2b2d01f4459b1e90fd12cc7840e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:13.899422 19601 raft_consensus.cc:740] T fa731b585f684a7fb2d106c50f143b83 P 0473d2b2d01f4459b1e90fd12cc7840e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0473d2b2d01f4459b1e90fd12cc7840e, State: Initialized, Role: FOLLOWER
I20260709 13:04:13.901814 19601 consensus_queue.cc:260] T fa731b585f684a7fb2d106c50f143b83 P 0473d2b2d01f4459b1e90fd12cc7840e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:13.909133 19601 ts_tablet_manager.cc:1434] T fa731b585f684a7fb2d106c50f143b83 P 0473d2b2d01f4459b1e90fd12cc7840e: Time spent starting tablet: real 0.013s	user 0.006s	sys 0.000s
I20260709 13:04:13.910200 19601 tablet_bootstrap.cc:492] T 28af091831594f9d8e96482078cc7625 P 0473d2b2d01f4459b1e90fd12cc7840e: Bootstrap starting.
I20260709 13:04:13.915701 19604 tablet_bootstrap.cc:492] T 2b74109013a140ada21feeef92d6f563 P e5256d91808b47c195bc9b4dbd7f2b87: No bootstrap required, opened a new log
I20260709 13:04:13.916083 19601 tablet_bootstrap.cc:654] T 28af091831594f9d8e96482078cc7625 P 0473d2b2d01f4459b1e90fd12cc7840e: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:13.916261 19604 ts_tablet_manager.cc:1403] T 2b74109013a140ada21feeef92d6f563 P e5256d91808b47c195bc9b4dbd7f2b87: Time spent bootstrapping tablet: real 0.050s	user 0.010s	sys 0.004s
I20260709 13:04:13.919210 19604 raft_consensus.cc:359] T 2b74109013a140ada21feeef92d6f563 P e5256d91808b47c195bc9b4dbd7f2b87 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:13.920049 19604 raft_consensus.cc:385] T 2b74109013a140ada21feeef92d6f563 P e5256d91808b47c195bc9b4dbd7f2b87 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:13.920379 19604 raft_consensus.cc:740] T 2b74109013a140ada21feeef92d6f563 P e5256d91808b47c195bc9b4dbd7f2b87 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e5256d91808b47c195bc9b4dbd7f2b87, State: Initialized, Role: FOLLOWER
I20260709 13:04:13.921159 19604 consensus_queue.cc:260] T 2b74109013a140ada21feeef92d6f563 P e5256d91808b47c195bc9b4dbd7f2b87 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:13.923671 19604 ts_tablet_manager.cc:1434] T 2b74109013a140ada21feeef92d6f563 P e5256d91808b47c195bc9b4dbd7f2b87: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:04:13.924732 19604 tablet_bootstrap.cc:492] T 48824d5acfbc485ebf8c2d944e7202de P e5256d91808b47c195bc9b4dbd7f2b87: Bootstrap starting.
I20260709 13:04:13.938030 19604 tablet_bootstrap.cc:654] T 48824d5acfbc485ebf8c2d944e7202de P e5256d91808b47c195bc9b4dbd7f2b87: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:13.939895 19481 raft_consensus.cc:3060] T fa731b585f684a7fb2d106c50f143b83 P 0473d2b2d01f4459b1e90fd12cc7840e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:13.945107 19601 tablet_bootstrap.cc:492] T 28af091831594f9d8e96482078cc7625 P 0473d2b2d01f4459b1e90fd12cc7840e: No bootstrap required, opened a new log
I20260709 13:04:13.945590 19601 ts_tablet_manager.cc:1403] T 28af091831594f9d8e96482078cc7625 P 0473d2b2d01f4459b1e90fd12cc7840e: Time spent bootstrapping tablet: real 0.036s	user 0.015s	sys 0.010s
I20260709 13:04:13.948204 19601 raft_consensus.cc:359] T 28af091831594f9d8e96482078cc7625 P 0473d2b2d01f4459b1e90fd12cc7840e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:13.948848 19601 raft_consensus.cc:385] T 28af091831594f9d8e96482078cc7625 P 0473d2b2d01f4459b1e90fd12cc7840e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:13.949123 19601 raft_consensus.cc:740] T 28af091831594f9d8e96482078cc7625 P 0473d2b2d01f4459b1e90fd12cc7840e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0473d2b2d01f4459b1e90fd12cc7840e, State: Initialized, Role: FOLLOWER
I20260709 13:04:13.949851 19601 consensus_queue.cc:260] T 28af091831594f9d8e96482078cc7625 P 0473d2b2d01f4459b1e90fd12cc7840e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:13.951195 19832 consensus_queue.cc:1048] T fa731b585f684a7fb2d106c50f143b83 P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:13.952225 19601 ts_tablet_manager.cc:1434] T 28af091831594f9d8e96482078cc7625 P 0473d2b2d01f4459b1e90fd12cc7840e: Time spent starting tablet: real 0.006s	user 0.003s	sys 0.004s
I20260709 13:04:13.949525 19879 consensus_queue.cc:1048] T 179fd671030940b4b4a4e24bcc4aba0a P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:13.953220 19601 tablet_bootstrap.cc:492] T 2b74109013a140ada21feeef92d6f563 P 0473d2b2d01f4459b1e90fd12cc7840e: Bootstrap starting.
I20260709 13:04:13.968133 19967 raft_consensus.cc:493] T ab43d85f64114d4ebf618930e43d9ed0 P e5256d91808b47c195bc9b4dbd7f2b87 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:13.968621 19967 raft_consensus.cc:515] T ab43d85f64114d4ebf618930e43d9ed0 P e5256d91808b47c195bc9b4dbd7f2b87 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:13.971122 19967 leader_election.cc:290] T ab43d85f64114d4ebf618930e43d9ed0 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:04:13.971197 19482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab43d85f64114d4ebf618930e43d9ed0" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:04:13.972252 19482 raft_consensus.cc:2393] T ab43d85f64114d4ebf618930e43d9ed0 P 0473d2b2d01f4459b1e90fd12cc7840e [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e5256d91808b47c195bc9b4dbd7f2b87 in current term 1: Already voted for candidate e61c3a8f61bb48f8a963c9480e53c168 in this term.
I20260709 13:04:13.978389 19604 tablet_bootstrap.cc:492] T 48824d5acfbc485ebf8c2d944e7202de P e5256d91808b47c195bc9b4dbd7f2b87: No bootstrap required, opened a new log
I20260709 13:04:13.978976 19604 ts_tablet_manager.cc:1403] T 48824d5acfbc485ebf8c2d944e7202de P e5256d91808b47c195bc9b4dbd7f2b87: Time spent bootstrapping tablet: real 0.054s	user 0.009s	sys 0.002s
I20260709 13:04:13.979176 19559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab43d85f64114d4ebf618930e43d9ed0" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:04:13.981460 19604 raft_consensus.cc:359] T 48824d5acfbc485ebf8c2d944e7202de P e5256d91808b47c195bc9b4dbd7f2b87 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:13.982127 19604 raft_consensus.cc:385] T 48824d5acfbc485ebf8c2d944e7202de P e5256d91808b47c195bc9b4dbd7f2b87 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:13.982400 19604 raft_consensus.cc:740] T 48824d5acfbc485ebf8c2d944e7202de P e5256d91808b47c195bc9b4dbd7f2b87 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e5256d91808b47c195bc9b4dbd7f2b87, State: Initialized, Role: FOLLOWER
I20260709 13:04:13.983475 19601 tablet_bootstrap.cc:654] T 2b74109013a140ada21feeef92d6f563 P 0473d2b2d01f4459b1e90fd12cc7840e: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:13.983144 19604 consensus_queue.cc:260] T 48824d5acfbc485ebf8c2d944e7202de P e5256d91808b47c195bc9b4dbd7f2b87 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:13.984603 19604 ts_tablet_manager.cc:1434] T 48824d5acfbc485ebf8c2d944e7202de P e5256d91808b47c195bc9b4dbd7f2b87: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.001s
I20260709 13:04:13.985450 19604 tablet_bootstrap.cc:492] T ff9b0eddd810459b82d91c60777c10eb P e5256d91808b47c195bc9b4dbd7f2b87: Bootstrap starting.
I20260709 13:04:13.985209 19375 leader_election.cc:304] T ab43d85f64114d4ebf618930e43d9ed0 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:04:13.987115 19855 raft_consensus.cc:3060] T ab43d85f64114d4ebf618930e43d9ed0 P e5256d91808b47c195bc9b4dbd7f2b87 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:13.999524 19604 tablet_bootstrap.cc:654] T ff9b0eddd810459b82d91c60777c10eb P e5256d91808b47c195bc9b4dbd7f2b87: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:14.000792 19855 raft_consensus.cc:2749] T ab43d85f64114d4ebf618930e43d9ed0 P e5256d91808b47c195bc9b4dbd7f2b87 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:04:14.018548 19964 raft_consensus.cc:493] T 76cb037fc9064d13b59a8969d897ce8c P 0473d2b2d01f4459b1e90fd12cc7840e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:14.019086 19964 raft_consensus.cc:515] T 76cb037fc9064d13b59a8969d897ce8c P 0473d2b2d01f4459b1e90fd12cc7840e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:14.025228 19964 leader_election.cc:290] T 76cb037fc9064d13b59a8969d897ce8c P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:04:14.027640 19559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76cb037fc9064d13b59a8969d897ce8c" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:04:14.030164 19601 tablet_bootstrap.cc:492] T 2b74109013a140ada21feeef92d6f563 P 0473d2b2d01f4459b1e90fd12cc7840e: No bootstrap required, opened a new log
I20260709 13:04:14.030611 19601 ts_tablet_manager.cc:1403] T 2b74109013a140ada21feeef92d6f563 P 0473d2b2d01f4459b1e90fd12cc7840e: Time spent bootstrapping tablet: real 0.078s	user 0.009s	sys 0.009s
I20260709 13:04:14.032315 19408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76cb037fc9064d13b59a8969d897ce8c" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
W20260709 13:04:14.034360 19449 consensus_peers.cc:597] T 179fd671030940b4b4a4e24bcc4aba0a P 0473d2b2d01f4459b1e90fd12cc7840e -> Peer e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321): Couldn't send request to peer e5256d91808b47c195bc9b4dbd7f2b87. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:14.035037 19449 leader_election.cc:304] T 76cb037fc9064d13b59a8969d897ce8c P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e; no voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:04:14.035804 19966 raft_consensus.cc:2749] T 76cb037fc9064d13b59a8969d897ce8c P 0473d2b2d01f4459b1e90fd12cc7840e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:04:14.040957 19408 raft_consensus.cc:3060] T 1dc5b3532fe54f74876d02beffa2c230 P e5256d91808b47c195bc9b4dbd7f2b87 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:14.056658 19604 tablet_bootstrap.cc:492] T ff9b0eddd810459b82d91c60777c10eb P e5256d91808b47c195bc9b4dbd7f2b87: No bootstrap required, opened a new log
W20260709 13:04:14.056819 19357 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:04:14.057197 19604 ts_tablet_manager.cc:1403] T ff9b0eddd810459b82d91c60777c10eb P e5256d91808b47c195bc9b4dbd7f2b87: Time spent bootstrapping tablet: real 0.072s	user 0.011s	sys 0.003s
I20260709 13:04:14.063148 19601 raft_consensus.cc:359] T 2b74109013a140ada21feeef92d6f563 P 0473d2b2d01f4459b1e90fd12cc7840e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:14.063827 19601 raft_consensus.cc:385] T 2b74109013a140ada21feeef92d6f563 P 0473d2b2d01f4459b1e90fd12cc7840e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:14.064044 19601 raft_consensus.cc:740] T 2b74109013a140ada21feeef92d6f563 P 0473d2b2d01f4459b1e90fd12cc7840e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0473d2b2d01f4459b1e90fd12cc7840e, State: Initialized, Role: FOLLOWER
I20260709 13:04:14.071144 19601 consensus_queue.cc:260] T 2b74109013a140ada21feeef92d6f563 P 0473d2b2d01f4459b1e90fd12cc7840e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:14.073309 19601 ts_tablet_manager.cc:1434] T 2b74109013a140ada21feeef92d6f563 P 0473d2b2d01f4459b1e90fd12cc7840e: Time spent starting tablet: real 0.042s	user 0.003s	sys 0.001s
I20260709 13:04:14.074266 19601 tablet_bootstrap.cc:492] T 775c229504194560ba9589bc2199b089 P 0473d2b2d01f4459b1e90fd12cc7840e: Bootstrap starting.
I20260709 13:04:14.066988 19604 raft_consensus.cc:359] T ff9b0eddd810459b82d91c60777c10eb P e5256d91808b47c195bc9b4dbd7f2b87 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:14.079591 19604 raft_consensus.cc:385] T ff9b0eddd810459b82d91c60777c10eb P e5256d91808b47c195bc9b4dbd7f2b87 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:14.079887 19604 raft_consensus.cc:740] T ff9b0eddd810459b82d91c60777c10eb P e5256d91808b47c195bc9b4dbd7f2b87 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e5256d91808b47c195bc9b4dbd7f2b87, State: Initialized, Role: FOLLOWER
I20260709 13:04:14.084976 19604 consensus_queue.cc:260] T ff9b0eddd810459b82d91c60777c10eb P e5256d91808b47c195bc9b4dbd7f2b87 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:14.090636 19604 ts_tablet_manager.cc:1434] T ff9b0eddd810459b82d91c60777c10eb P e5256d91808b47c195bc9b4dbd7f2b87: Time spent starting tablet: real 0.033s	user 0.007s	sys 0.001s
I20260709 13:04:14.098095 19604 tablet_bootstrap.cc:492] T 28af091831594f9d8e96482078cc7625 P e5256d91808b47c195bc9b4dbd7f2b87: Bootstrap starting.
I20260709 13:04:14.103507 19604 tablet_bootstrap.cc:654] T 28af091831594f9d8e96482078cc7625 P e5256d91808b47c195bc9b4dbd7f2b87: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:14.107229 19832 consensus_queue.cc:1048] T fa731b585f684a7fb2d106c50f143b83 P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:14.108356 19601 tablet_bootstrap.cc:654] T 775c229504194560ba9589bc2199b089 P 0473d2b2d01f4459b1e90fd12cc7840e: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:14.120849 19601 tablet_bootstrap.cc:492] T 775c229504194560ba9589bc2199b089 P 0473d2b2d01f4459b1e90fd12cc7840e: No bootstrap required, opened a new log
I20260709 13:04:14.121978 19601 ts_tablet_manager.cc:1403] T 775c229504194560ba9589bc2199b089 P 0473d2b2d01f4459b1e90fd12cc7840e: Time spent bootstrapping tablet: real 0.048s	user 0.005s	sys 0.005s
I20260709 13:04:14.127770 19601 raft_consensus.cc:359] T 775c229504194560ba9589bc2199b089 P 0473d2b2d01f4459b1e90fd12cc7840e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:14.128324 19601 raft_consensus.cc:385] T 775c229504194560ba9589bc2199b089 P 0473d2b2d01f4459b1e90fd12cc7840e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:14.128547 19601 raft_consensus.cc:740] T 775c229504194560ba9589bc2199b089 P 0473d2b2d01f4459b1e90fd12cc7840e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0473d2b2d01f4459b1e90fd12cc7840e, State: Initialized, Role: FOLLOWER
I20260709 13:04:14.133276 19601 consensus_queue.cc:260] T 775c229504194560ba9589bc2199b089 P 0473d2b2d01f4459b1e90fd12cc7840e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:14.137512 19601 ts_tablet_manager.cc:1434] T 775c229504194560ba9589bc2199b089 P 0473d2b2d01f4459b1e90fd12cc7840e: Time spent starting tablet: real 0.015s	user 0.005s	sys 0.001s
I20260709 13:04:14.142012 19601 tablet_bootstrap.cc:492] T 48824d5acfbc485ebf8c2d944e7202de P 0473d2b2d01f4459b1e90fd12cc7840e: Bootstrap starting.
I20260709 13:04:14.148120 19604 tablet_bootstrap.cc:492] T 28af091831594f9d8e96482078cc7625 P e5256d91808b47c195bc9b4dbd7f2b87: No bootstrap required, opened a new log
I20260709 13:04:14.148631 19604 ts_tablet_manager.cc:1403] T 28af091831594f9d8e96482078cc7625 P e5256d91808b47c195bc9b4dbd7f2b87: Time spent bootstrapping tablet: real 0.051s	user 0.011s	sys 0.001s
I20260709 13:04:14.151752 19604 raft_consensus.cc:359] T 28af091831594f9d8e96482078cc7625 P e5256d91808b47c195bc9b4dbd7f2b87 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:14.152472 19604 raft_consensus.cc:385] T 28af091831594f9d8e96482078cc7625 P e5256d91808b47c195bc9b4dbd7f2b87 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:14.152966 19604 raft_consensus.cc:740] T 28af091831594f9d8e96482078cc7625 P e5256d91808b47c195bc9b4dbd7f2b87 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e5256d91808b47c195bc9b4dbd7f2b87, State: Initialized, Role: FOLLOWER
I20260709 13:04:14.153755 19604 consensus_queue.cc:260] T 28af091831594f9d8e96482078cc7625 P e5256d91808b47c195bc9b4dbd7f2b87 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:14.155126 19855 raft_consensus.cc:493] T 28af091831594f9d8e96482078cc7625 P e5256d91808b47c195bc9b4dbd7f2b87 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:14.155544 19855 raft_consensus.cc:515] T 28af091831594f9d8e96482078cc7625 P e5256d91808b47c195bc9b4dbd7f2b87 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:14.159556 19604 ts_tablet_manager.cc:1434] T 28af091831594f9d8e96482078cc7625 P e5256d91808b47c195bc9b4dbd7f2b87: Time spent starting tablet: real 0.011s	user 0.009s	sys 0.000s
I20260709 13:04:14.160729 19604 tablet_bootstrap.cc:492] T 179fd671030940b4b4a4e24bcc4aba0a P e5256d91808b47c195bc9b4dbd7f2b87: Bootstrap starting.
I20260709 13:04:14.161664 19855 leader_election.cc:290] T 28af091831594f9d8e96482078cc7625 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:04:14.163933 19481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28af091831594f9d8e96482078cc7625" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:04:14.164682 19481 raft_consensus.cc:2468] T 28af091831594f9d8e96482078cc7625 P 0473d2b2d01f4459b1e90fd12cc7840e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 0.
I20260709 13:04:14.167434 19604 tablet_bootstrap.cc:654] T 179fd671030940b4b4a4e24bcc4aba0a P e5256d91808b47c195bc9b4dbd7f2b87: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:14.168977 19377 leader_election.cc:304] T 28af091831594f9d8e96482078cc7625 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87; no voters: 
I20260709 13:04:14.170113 19559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28af091831594f9d8e96482078cc7625" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:04:14.170778 19559 raft_consensus.cc:2468] T 28af091831594f9d8e96482078cc7625 P e61c3a8f61bb48f8a963c9480e53c168 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 0.
I20260709 13:04:14.172017 19967 raft_consensus.cc:2804] T 28af091831594f9d8e96482078cc7625 P e5256d91808b47c195bc9b4dbd7f2b87 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:14.172416 19967 raft_consensus.cc:493] T 28af091831594f9d8e96482078cc7625 P e5256d91808b47c195bc9b4dbd7f2b87 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:14.172773 19967 raft_consensus.cc:3060] T 28af091831594f9d8e96482078cc7625 P e5256d91808b47c195bc9b4dbd7f2b87 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:14.179692 19967 raft_consensus.cc:515] T 28af091831594f9d8e96482078cc7625 P e5256d91808b47c195bc9b4dbd7f2b87 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:14.182650 19481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28af091831594f9d8e96482078cc7625" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:04:14.183339 19481 raft_consensus.cc:3060] T 28af091831594f9d8e96482078cc7625 P 0473d2b2d01f4459b1e90fd12cc7840e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:14.194096 19601 tablet_bootstrap.cc:654] T 48824d5acfbc485ebf8c2d944e7202de P 0473d2b2d01f4459b1e90fd12cc7840e: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:14.203339 19604 tablet_bootstrap.cc:492] T 179fd671030940b4b4a4e24bcc4aba0a P e5256d91808b47c195bc9b4dbd7f2b87: No bootstrap required, opened a new log
I20260709 13:04:14.203904 19604 ts_tablet_manager.cc:1403] T 179fd671030940b4b4a4e24bcc4aba0a P e5256d91808b47c195bc9b4dbd7f2b87: Time spent bootstrapping tablet: real 0.043s	user 0.016s	sys 0.014s
I20260709 13:04:14.204373 19559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28af091831594f9d8e96482078cc7625" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:04:14.205016 19559 raft_consensus.cc:3060] T 28af091831594f9d8e96482078cc7625 P e61c3a8f61bb48f8a963c9480e53c168 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:14.205974 19967 leader_election.cc:290] T 28af091831594f9d8e96482078cc7625 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 1 election: Requested vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:04:14.206328 19604 raft_consensus.cc:359] T 179fd671030940b4b4a4e24bcc4aba0a P e5256d91808b47c195bc9b4dbd7f2b87 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:14.207041 19604 raft_consensus.cc:385] T 179fd671030940b4b4a4e24bcc4aba0a P e5256d91808b47c195bc9b4dbd7f2b87 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:14.207278 19604 raft_consensus.cc:740] T 179fd671030940b4b4a4e24bcc4aba0a P e5256d91808b47c195bc9b4dbd7f2b87 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e5256d91808b47c195bc9b4dbd7f2b87, State: Initialized, Role: FOLLOWER
I20260709 13:04:14.209156 19604 consensus_queue.cc:260] T 179fd671030940b4b4a4e24bcc4aba0a P e5256d91808b47c195bc9b4dbd7f2b87 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:14.210003 19855 raft_consensus.cc:493] T ff9b0eddd810459b82d91c60777c10eb P e5256d91808b47c195bc9b4dbd7f2b87 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:14.210503 19855 raft_consensus.cc:515] T ff9b0eddd810459b82d91c60777c10eb P e5256d91808b47c195bc9b4dbd7f2b87 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:14.212381 19604 ts_tablet_manager.cc:1434] T 179fd671030940b4b4a4e24bcc4aba0a P e5256d91808b47c195bc9b4dbd7f2b87: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 13:04:14.213078 19559 raft_consensus.cc:2468] T 28af091831594f9d8e96482078cc7625 P e61c3a8f61bb48f8a963c9480e53c168 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 1.
I20260709 13:04:14.213315 19604 tablet_bootstrap.cc:492] T e381f1d6b8184797ad142de49be225a8 P e5256d91808b47c195bc9b4dbd7f2b87: Bootstrap starting.
I20260709 13:04:14.213418 19480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff9b0eddd810459b82d91c60777c10eb" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:04:14.213770 19855 leader_election.cc:290] T ff9b0eddd810459b82d91c60777c10eb P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:04:14.214234 19375 leader_election.cc:304] T 28af091831594f9d8e96482078cc7625 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:04:14.214620 19556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff9b0eddd810459b82d91c60777c10eb" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
W20260709 13:04:14.214915 19377 leader_election.cc:343] T ff9b0eddd810459b82d91c60777c10eb P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:14.215215 19556 raft_consensus.cc:2468] T ff9b0eddd810459b82d91c60777c10eb P e61c3a8f61bb48f8a963c9480e53c168 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 0.
I20260709 13:04:14.217784 19375 leader_election.cc:304] T ff9b0eddd810459b82d91c60777c10eb P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168; no voters: 0473d2b2d01f4459b1e90fd12cc7840e
I20260709 13:04:14.220702 19604 tablet_bootstrap.cc:654] T e381f1d6b8184797ad142de49be225a8 P e5256d91808b47c195bc9b4dbd7f2b87: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:14.221447 19855 raft_consensus.cc:2804] T ff9b0eddd810459b82d91c60777c10eb P e5256d91808b47c195bc9b4dbd7f2b87 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:14.221854 19855 raft_consensus.cc:493] T ff9b0eddd810459b82d91c60777c10eb P e5256d91808b47c195bc9b4dbd7f2b87 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:14.222429 19855 raft_consensus.cc:3060] T ff9b0eddd810459b82d91c60777c10eb P e5256d91808b47c195bc9b4dbd7f2b87 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:14.224181 19480 raft_consensus.cc:3060] T 76cb037fc9064d13b59a8969d897ce8c P 0473d2b2d01f4459b1e90fd12cc7840e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:14.217800 19967 raft_consensus.cc:2804] T 28af091831594f9d8e96482078cc7625 P e5256d91808b47c195bc9b4dbd7f2b87 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:14.237342 19601 tablet_bootstrap.cc:492] T 48824d5acfbc485ebf8c2d944e7202de P 0473d2b2d01f4459b1e90fd12cc7840e: No bootstrap required, opened a new log
I20260709 13:04:14.237951 19601 ts_tablet_manager.cc:1403] T 48824d5acfbc485ebf8c2d944e7202de P 0473d2b2d01f4459b1e90fd12cc7840e: Time spent bootstrapping tablet: real 0.099s	user 0.011s	sys 0.005s
I20260709 13:04:14.201116 19481 raft_consensus.cc:2468] T 28af091831594f9d8e96482078cc7625 P 0473d2b2d01f4459b1e90fd12cc7840e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 1.
I20260709 13:04:14.227325 19967 raft_consensus.cc:697] T 28af091831594f9d8e96482078cc7625 P e5256d91808b47c195bc9b4dbd7f2b87 [term 1 LEADER]: Becoming Leader. State: Replica: e5256d91808b47c195bc9b4dbd7f2b87, State: Running, Role: LEADER
I20260709 13:04:14.244344 19967 consensus_queue.cc:237] T 28af091831594f9d8e96482078cc7625 P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:14.303118 19601 raft_consensus.cc:359] T 48824d5acfbc485ebf8c2d944e7202de P 0473d2b2d01f4459b1e90fd12cc7840e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:14.302763 19984 consensus_queue.cc:1048] T ab43d85f64114d4ebf618930e43d9ed0 P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 13:04:14.329109 19601 raft_consensus.cc:385] T 48824d5acfbc485ebf8c2d944e7202de P 0473d2b2d01f4459b1e90fd12cc7840e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:14.329425 19601 raft_consensus.cc:740] T 48824d5acfbc485ebf8c2d944e7202de P 0473d2b2d01f4459b1e90fd12cc7840e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0473d2b2d01f4459b1e90fd12cc7840e, State: Initialized, Role: FOLLOWER
I20260709 13:04:14.305886 20005 raft_consensus.cc:493] T 2b74109013a140ada21feeef92d6f563 P e5256d91808b47c195bc9b4dbd7f2b87 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:14.329845 19920 consensus_queue.cc:1048] T 4509b76741dc428e9201c70c1658da13 P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:14.308630 20026 raft_consensus.cc:493] T ece3db938bc649d4a40a51522ed5259c P 0473d2b2d01f4459b1e90fd12cc7840e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:14.330282 20005 raft_consensus.cc:515] T 2b74109013a140ada21feeef92d6f563 P e5256d91808b47c195bc9b4dbd7f2b87 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:14.330899 20026 raft_consensus.cc:515] T ece3db938bc649d4a40a51522ed5259c P 0473d2b2d01f4459b1e90fd12cc7840e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:14.332038 19479 raft_consensus.cc:3060] T ece3db938bc649d4a40a51522ed5259c P 0473d2b2d01f4459b1e90fd12cc7840e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:14.332589 20005 leader_election.cc:290] T 2b74109013a140ada21feeef92d6f563 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:04:14.333760 19406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ece3db938bc649d4a40a51522ed5259c" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:04:14.334117 19558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b74109013a140ada21feeef92d6f563" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:04:14.334728 19558 raft_consensus.cc:2468] T 2b74109013a140ada21feeef92d6f563 P e61c3a8f61bb48f8a963c9480e53c168 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 0.
I20260709 13:04:14.326628 19855 raft_consensus.cc:515] T ff9b0eddd810459b82d91c60777c10eb P e5256d91808b47c195bc9b4dbd7f2b87 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:14.335825 19375 leader_election.cc:304] T 2b74109013a140ada21feeef92d6f563 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:04:14.336508 19630 consensus_queue.cc:1048] T ab43d85f64114d4ebf618930e43d9ed0 P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:14.336964 19920 raft_consensus.cc:2804] T 2b74109013a140ada21feeef92d6f563 P e5256d91808b47c195bc9b4dbd7f2b87 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:14.337378 19920 raft_consensus.cc:493] T 2b74109013a140ada21feeef92d6f563 P e5256d91808b47c195bc9b4dbd7f2b87 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:14.337750 19920 raft_consensus.cc:3060] T 2b74109013a140ada21feeef92d6f563 P e5256d91808b47c195bc9b4dbd7f2b87 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:14.340721 19558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ece3db938bc649d4a40a51522ed5259c" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:04:14.328778 19604 tablet_bootstrap.cc:492] T e381f1d6b8184797ad142de49be225a8 P e5256d91808b47c195bc9b4dbd7f2b87: No bootstrap required, opened a new log
I20260709 13:04:14.342774 19450 leader_election.cc:304] T ece3db938bc649d4a40a51522ed5259c P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e; no voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:04:14.343327 19604 ts_tablet_manager.cc:1403] T e381f1d6b8184797ad142de49be225a8 P e5256d91808b47c195bc9b4dbd7f2b87: Time spent bootstrapping tablet: real 0.130s	user 0.020s	sys 0.016s
I20260709 13:04:14.337809 19855 leader_election.cc:290] T ff9b0eddd810459b82d91c60777c10eb P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 1 election: Requested vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:04:14.344413 19558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff9b0eddd810459b82d91c60777c10eb" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:04:14.344732 20026 leader_election.cc:290] T ece3db938bc649d4a40a51522ed5259c P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:04:14.345916 19604 raft_consensus.cc:359] T e381f1d6b8184797ad142de49be225a8 P e5256d91808b47c195bc9b4dbd7f2b87 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:14.344971 19558 raft_consensus.cc:3060] T ff9b0eddd810459b82d91c60777c10eb P e61c3a8f61bb48f8a963c9480e53c168 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:14.330063 19601 consensus_queue.cc:260] T 48824d5acfbc485ebf8c2d944e7202de P 0473d2b2d01f4459b1e90fd12cc7840e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:14.349345 19962 raft_consensus.cc:493] T 48824d5acfbc485ebf8c2d944e7202de P 0473d2b2d01f4459b1e90fd12cc7840e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:14.349877 19962 raft_consensus.cc:515] T 48824d5acfbc485ebf8c2d944e7202de P 0473d2b2d01f4459b1e90fd12cc7840e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:14.351109 19920 raft_consensus.cc:515] T 2b74109013a140ada21feeef92d6f563 P e5256d91808b47c195bc9b4dbd7f2b87 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:14.352245 19485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b74109013a140ada21feeef92d6f563" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:04:14.352837 19485 raft_consensus.cc:2468] T 2b74109013a140ada21feeef92d6f563 P 0473d2b2d01f4459b1e90fd12cc7840e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 0.
I20260709 13:04:14.353062 19483 raft_consensus.cc:3060] T 775c229504194560ba9589bc2199b089 P 0473d2b2d01f4459b1e90fd12cc7840e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:14.354382 19482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff9b0eddd810459b82d91c60777c10eb" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:04:14.355223 19962 leader_election.cc:290] T 48824d5acfbc485ebf8c2d944e7202de P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:04:14.357122 19601 ts_tablet_manager.cc:1434] T 48824d5acfbc485ebf8c2d944e7202de P 0473d2b2d01f4459b1e90fd12cc7840e: Time spent starting tablet: real 0.119s	user 0.002s	sys 0.005s
I20260709 13:04:14.357522 19558 raft_consensus.cc:2468] T ff9b0eddd810459b82d91c60777c10eb P e61c3a8f61bb48f8a963c9480e53c168 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 1.
I20260709 13:04:14.358599 19375 leader_election.cc:304] T ff9b0eddd810459b82d91c60777c10eb P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:04:14.359961 19406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48824d5acfbc485ebf8c2d944e7202de" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:04:14.360675 19406 raft_consensus.cc:2468] T 48824d5acfbc485ebf8c2d944e7202de P e5256d91808b47c195bc9b4dbd7f2b87 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 0.
I20260709 13:04:14.362881 19449 leader_election.cc:304] T 48824d5acfbc485ebf8c2d944e7202de P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87; no voters: 
I20260709 13:04:14.364845 19964 raft_consensus.cc:2804] T 48824d5acfbc485ebf8c2d944e7202de P 0473d2b2d01f4459b1e90fd12cc7840e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:14.365216 19964 raft_consensus.cc:493] T 48824d5acfbc485ebf8c2d944e7202de P 0473d2b2d01f4459b1e90fd12cc7840e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:14.365558 19964 raft_consensus.cc:3060] T 48824d5acfbc485ebf8c2d944e7202de P 0473d2b2d01f4459b1e90fd12cc7840e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:14.366870 19309 catalog_manager.cc:5697] T 28af091831594f9d8e96482078cc7625 P e5256d91808b47c195bc9b4dbd7f2b87 reported cstate change: term changed from 0 to 1, leader changed from <none> to e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1). New cstate: current_term: 1 leader_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:14.370560 19855 raft_consensus.cc:2804] T ff9b0eddd810459b82d91c60777c10eb P e5256d91808b47c195bc9b4dbd7f2b87 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:14.371114 19855 raft_consensus.cc:697] T ff9b0eddd810459b82d91c60777c10eb P e5256d91808b47c195bc9b4dbd7f2b87 [term 1 LEADER]: Becoming Leader. State: Replica: e5256d91808b47c195bc9b4dbd7f2b87, State: Running, Role: LEADER
I20260709 13:04:14.372385 19855 consensus_queue.cc:237] T ff9b0eddd810459b82d91c60777c10eb P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:14.373013 19964 raft_consensus.cc:515] T 48824d5acfbc485ebf8c2d944e7202de P 0473d2b2d01f4459b1e90fd12cc7840e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
W20260709 13:04:14.377286 19377 leader_election.cc:343] T ff9b0eddd810459b82d91c60777c10eb P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:14.377817 19557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48824d5acfbc485ebf8c2d944e7202de" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:04:14.378473 19557 raft_consensus.cc:2468] T 48824d5acfbc485ebf8c2d944e7202de P e61c3a8f61bb48f8a963c9480e53c168 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 0.
I20260709 13:04:14.358762 19920 leader_election.cc:290] T 2b74109013a140ada21feeef92d6f563 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 1 election: Requested vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:04:14.358095 19601 tablet_bootstrap.cc:492] T ff9b0eddd810459b82d91c60777c10eb P 0473d2b2d01f4459b1e90fd12cc7840e: Bootstrap starting.
I20260709 13:04:14.380389 19558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b74109013a140ada21feeef92d6f563" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:04:14.346560 19604 raft_consensus.cc:385] T e381f1d6b8184797ad142de49be225a8 P e5256d91808b47c195bc9b4dbd7f2b87 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:14.380954 19558 raft_consensus.cc:3060] T 2b74109013a140ada21feeef92d6f563 P e61c3a8f61bb48f8a963c9480e53c168 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:04:14.381593 19526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.2:46257, user_credentials={real_user=slave}} blocked reactor thread for 53628.8us
I20260709 13:04:14.389750 19604 raft_consensus.cc:740] T e381f1d6b8184797ad142de49be225a8 P e5256d91808b47c195bc9b4dbd7f2b87 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e5256d91808b47c195bc9b4dbd7f2b87, State: Initialized, Role: FOLLOWER
I20260709 13:04:14.390771 19558 raft_consensus.cc:2468] T 2b74109013a140ada21feeef92d6f563 P e61c3a8f61bb48f8a963c9480e53c168 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 1.
I20260709 13:04:14.408183 19375 leader_election.cc:304] T 2b74109013a140ada21feeef92d6f563 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:04:14.392220 19604 consensus_queue.cc:260] T e381f1d6b8184797ad142de49be225a8 P e5256d91808b47c195bc9b4dbd7f2b87 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:14.419832 19964 leader_election.cc:290] T 48824d5acfbc485ebf8c2d944e7202de P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 1 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:04:14.415874 19920 raft_consensus.cc:2804] T 2b74109013a140ada21feeef92d6f563 P e5256d91808b47c195bc9b4dbd7f2b87 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:14.430950 19482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b74109013a140ada21feeef92d6f563" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:04:14.448031 19482 raft_consensus.cc:3060] T 2b74109013a140ada21feeef92d6f563 P 0473d2b2d01f4459b1e90fd12cc7840e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:14.446496 19920 raft_consensus.cc:697] T 2b74109013a140ada21feeef92d6f563 P e5256d91808b47c195bc9b4dbd7f2b87 [term 1 LEADER]: Becoming Leader. State: Replica: e5256d91808b47c195bc9b4dbd7f2b87, State: Running, Role: LEADER
I20260709 13:04:14.455145 19920 consensus_queue.cc:237] T 2b74109013a140ada21feeef92d6f563 P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:14.487680 19411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48824d5acfbc485ebf8c2d944e7202de" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
I20260709 13:04:14.478171 19601 tablet_bootstrap.cc:654] T ff9b0eddd810459b82d91c60777c10eb P 0473d2b2d01f4459b1e90fd12cc7840e: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:14.496498 19411 raft_consensus.cc:3060] T 48824d5acfbc485ebf8c2d944e7202de P e5256d91808b47c195bc9b4dbd7f2b87 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:14.458485 19604 ts_tablet_manager.cc:1434] T e381f1d6b8184797ad142de49be225a8 P e5256d91808b47c195bc9b4dbd7f2b87: Time spent starting tablet: real 0.115s	user 0.016s	sys 0.008s
I20260709 13:04:14.485668 19407 raft_consensus.cc:3060] T 179fd671030940b4b4a4e24bcc4aba0a P e5256d91808b47c195bc9b4dbd7f2b87 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:14.476084 20026 raft_consensus.cc:2749] T ece3db938bc649d4a40a51522ed5259c P 0473d2b2d01f4459b1e90fd12cc7840e [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:04:14.513643 19604 tablet_bootstrap.cc:492] T 5ec1c4ce15e04c7e8c283a62179f2a64 P e5256d91808b47c195bc9b4dbd7f2b87: Bootstrap starting.
I20260709 13:04:14.514498 19558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48824d5acfbc485ebf8c2d944e7202de" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:04:14.514982 19558 raft_consensus.cc:3060] T 48824d5acfbc485ebf8c2d944e7202de P e61c3a8f61bb48f8a963c9480e53c168 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:14.460892 20005 consensus_queue.cc:1048] T 4509b76741dc428e9201c70c1658da13 P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.047s
I20260709 13:04:14.564373 19411 raft_consensus.cc:2468] T 48824d5acfbc485ebf8c2d944e7202de P e5256d91808b47c195bc9b4dbd7f2b87 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 1.
I20260709 13:04:14.571380 19558 raft_consensus.cc:2468] T 48824d5acfbc485ebf8c2d944e7202de P e61c3a8f61bb48f8a963c9480e53c168 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 1.
I20260709 13:04:14.584568 19601 tablet_bootstrap.cc:492] T ff9b0eddd810459b82d91c60777c10eb P 0473d2b2d01f4459b1e90fd12cc7840e: No bootstrap required, opened a new log
I20260709 13:04:14.586814 19601 ts_tablet_manager.cc:1403] T ff9b0eddd810459b82d91c60777c10eb P 0473d2b2d01f4459b1e90fd12cc7840e: Time spent bootstrapping tablet: real 0.229s	user 0.012s	sys 0.015s
I20260709 13:04:14.589241 19450 leader_election.cc:304] T 48824d5acfbc485ebf8c2d944e7202de P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
W20260709 13:04:14.601110 19377 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.2:46257, user_credentials={real_user=slave}} blocked reactor thread for 74496.1us
I20260709 13:04:14.596465 19966 raft_consensus.cc:2804] T 48824d5acfbc485ebf8c2d944e7202de P 0473d2b2d01f4459b1e90fd12cc7840e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:14.604151 19966 raft_consensus.cc:697] T 48824d5acfbc485ebf8c2d944e7202de P 0473d2b2d01f4459b1e90fd12cc7840e [term 1 LEADER]: Becoming Leader. State: Replica: 0473d2b2d01f4459b1e90fd12cc7840e, State: Running, Role: LEADER
I20260709 13:04:14.604970 19966 consensus_queue.cc:237] T 48824d5acfbc485ebf8c2d944e7202de P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:14.607507 19601 raft_consensus.cc:359] T ff9b0eddd810459b82d91c60777c10eb P 0473d2b2d01f4459b1e90fd12cc7840e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:14.619215 19601 raft_consensus.cc:385] T ff9b0eddd810459b82d91c60777c10eb P 0473d2b2d01f4459b1e90fd12cc7840e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:14.619637 19601 raft_consensus.cc:740] T ff9b0eddd810459b82d91c60777c10eb P 0473d2b2d01f4459b1e90fd12cc7840e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0473d2b2d01f4459b1e90fd12cc7840e, State: Initialized, Role: FOLLOWER
I20260709 13:04:14.620482 19601 consensus_queue.cc:260] T ff9b0eddd810459b82d91c60777c10eb P 0473d2b2d01f4459b1e90fd12cc7840e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:14.633059 19482 raft_consensus.cc:2468] T 2b74109013a140ada21feeef92d6f563 P 0473d2b2d01f4459b1e90fd12cc7840e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 1.
I20260709 13:04:14.659132 19604 tablet_bootstrap.cc:654] T 5ec1c4ce15e04c7e8c283a62179f2a64 P e5256d91808b47c195bc9b4dbd7f2b87: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:14.671092 19855 raft_consensus.cc:493] T 179fd671030940b4b4a4e24bcc4aba0a P e5256d91808b47c195bc9b4dbd7f2b87 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0473d2b2d01f4459b1e90fd12cc7840e)
I20260709 13:04:14.671648 19855 raft_consensus.cc:515] T 179fd671030940b4b4a4e24bcc4aba0a P e5256d91808b47c195bc9b4dbd7f2b87 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:14.679292 19855 leader_election.cc:290] T 179fd671030940b4b4a4e24bcc4aba0a P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:04:14.680289 19556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "179fd671030940b4b4a4e24bcc4aba0a" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:04:14.700453 19482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "179fd671030940b4b4a4e24bcc4aba0a" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:04:14.705768 19377 leader_election.cc:304] T 179fd671030940b4b4a4e24bcc4aba0a P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:04:14.707938 19855 raft_consensus.cc:2749] T 179fd671030940b4b4a4e24bcc4aba0a P e5256d91808b47c195bc9b4dbd7f2b87 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:04:14.733611 19604 tablet_bootstrap.cc:492] T 5ec1c4ce15e04c7e8c283a62179f2a64 P e5256d91808b47c195bc9b4dbd7f2b87: No bootstrap required, opened a new log
I20260709 13:04:14.737519 19604 ts_tablet_manager.cc:1403] T 5ec1c4ce15e04c7e8c283a62179f2a64 P e5256d91808b47c195bc9b4dbd7f2b87: Time spent bootstrapping tablet: real 0.239s	user 0.024s	sys 0.010s
I20260709 13:04:14.741626 19604 raft_consensus.cc:359] T 5ec1c4ce15e04c7e8c283a62179f2a64 P e5256d91808b47c195bc9b4dbd7f2b87 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
W20260709 13:04:14.743005 19449 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.1:40321, user_credentials={real_user=slave}} blocked reactor thread for 68052us
I20260709 13:04:14.742329 19604 raft_consensus.cc:385] T 5ec1c4ce15e04c7e8c283a62179f2a64 P e5256d91808b47c195bc9b4dbd7f2b87 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:14.744094 19604 raft_consensus.cc:740] T 5ec1c4ce15e04c7e8c283a62179f2a64 P e5256d91808b47c195bc9b4dbd7f2b87 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e5256d91808b47c195bc9b4dbd7f2b87, State: Initialized, Role: FOLLOWER
I20260709 13:04:14.744709 19604 consensus_queue.cc:260] T 5ec1c4ce15e04c7e8c283a62179f2a64 P e5256d91808b47c195bc9b4dbd7f2b87 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:14.746932 19604 ts_tablet_manager.cc:1434] T 5ec1c4ce15e04c7e8c283a62179f2a64 P e5256d91808b47c195bc9b4dbd7f2b87: Time spent starting tablet: real 0.008s	user 0.004s	sys 0.002s
I20260709 13:04:14.749254 19601 ts_tablet_manager.cc:1434] T ff9b0eddd810459b82d91c60777c10eb P 0473d2b2d01f4459b1e90fd12cc7840e: Time spent starting tablet: real 0.161s	user 0.008s	sys 0.008s
I20260709 13:04:14.750305 19601 tablet_bootstrap.cc:492] T 5ec1c4ce15e04c7e8c283a62179f2a64 P 0473d2b2d01f4459b1e90fd12cc7840e: Bootstrap starting.
I20260709 13:04:14.735713 19307 catalog_manager.cc:5697] T ff9b0eddd810459b82d91c60777c10eb P e5256d91808b47c195bc9b4dbd7f2b87 reported cstate change: term changed from 0 to 1, leader changed from <none> to e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1). New cstate: current_term: 1 leader_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:14.757202 19601 tablet_bootstrap.cc:654] T 5ec1c4ce15e04c7e8c283a62179f2a64 P 0473d2b2d01f4459b1e90fd12cc7840e: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:14.758047 19307 catalog_manager.cc:5697] T 2b74109013a140ada21feeef92d6f563 P e5256d91808b47c195bc9b4dbd7f2b87 reported cstate change: term changed from 0 to 1, leader changed from <none> to e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1). New cstate: current_term: 1 leader_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:14.764807 20030 consensus_queue.cc:1048] T 28af091831594f9d8e96482078cc7625 P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:14.771596 19411 raft_consensus.cc:3060] T e381f1d6b8184797ad142de49be225a8 P e5256d91808b47c195bc9b4dbd7f2b87 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:14.773149 19855 consensus_queue.cc:1048] T 28af091831594f9d8e96482078cc7625 P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:14.788913 20050 raft_consensus.cc:493] T ff9b0eddd810459b82d91c60777c10eb P 0473d2b2d01f4459b1e90fd12cc7840e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:14.792119 19601 tablet_bootstrap.cc:492] T 5ec1c4ce15e04c7e8c283a62179f2a64 P 0473d2b2d01f4459b1e90fd12cc7840e: No bootstrap required, opened a new log
I20260709 13:04:14.792626 19601 ts_tablet_manager.cc:1403] T 5ec1c4ce15e04c7e8c283a62179f2a64 P 0473d2b2d01f4459b1e90fd12cc7840e: Time spent bootstrapping tablet: real 0.043s	user 0.011s	sys 0.011s
I20260709 13:04:14.789528 20050 raft_consensus.cc:515] T ff9b0eddd810459b82d91c60777c10eb P 0473d2b2d01f4459b1e90fd12cc7840e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:14.842250 20050 leader_election.cc:290] T ff9b0eddd810459b82d91c60777c10eb P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:04:14.850124 19558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff9b0eddd810459b82d91c60777c10eb" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:04:14.851202 19558 raft_consensus.cc:2393] T ff9b0eddd810459b82d91c60777c10eb P e61c3a8f61bb48f8a963c9480e53c168 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0473d2b2d01f4459b1e90fd12cc7840e in current term 1: Already voted for candidate e5256d91808b47c195bc9b4dbd7f2b87 in this term.
I20260709 13:04:14.851949 19408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff9b0eddd810459b82d91c60777c10eb" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:04:14.854921 19449 leader_election.cc:304] T ff9b0eddd810459b82d91c60777c10eb P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e; no voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:04:14.859171 19483 raft_consensus.cc:3060] T ff9b0eddd810459b82d91c60777c10eb P 0473d2b2d01f4459b1e90fd12cc7840e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:14.880954 19306 catalog_manager.cc:5697] T 48824d5acfbc485ebf8c2d944e7202de P 0473d2b2d01f4459b1e90fd12cc7840e reported cstate change: term changed from 0 to 1, leader changed from <none> to 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2). New cstate: current_term: 1 leader_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:14.881680 19601 raft_consensus.cc:359] T 5ec1c4ce15e04c7e8c283a62179f2a64 P 0473d2b2d01f4459b1e90fd12cc7840e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:14.882354 19601 raft_consensus.cc:385] T 5ec1c4ce15e04c7e8c283a62179f2a64 P 0473d2b2d01f4459b1e90fd12cc7840e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:14.882616 19601 raft_consensus.cc:740] T 5ec1c4ce15e04c7e8c283a62179f2a64 P 0473d2b2d01f4459b1e90fd12cc7840e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0473d2b2d01f4459b1e90fd12cc7840e, State: Initialized, Role: FOLLOWER
I20260709 13:04:14.883199 19601 consensus_queue.cc:260] T 5ec1c4ce15e04c7e8c283a62179f2a64 P 0473d2b2d01f4459b1e90fd12cc7840e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:14.884204 19855 consensus_queue.cc:1048] T ff9b0eddd810459b82d91c60777c10eb P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:14.886921 20048 raft_consensus.cc:2749] T ff9b0eddd810459b82d91c60777c10eb P 0473d2b2d01f4459b1e90fd12cc7840e [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:04:14.889979 19601 ts_tablet_manager.cc:1434] T 5ec1c4ce15e04c7e8c283a62179f2a64 P 0473d2b2d01f4459b1e90fd12cc7840e: Time spent starting tablet: real 0.097s	user 0.011s	sys 0.002s
I20260709 13:04:14.899151 20042 consensus_queue.cc:1048] T 2b74109013a140ada21feeef92d6f563 P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:04:14.906989 20042 consensus_queue.cc:1048] T ff9b0eddd810459b82d91c60777c10eb P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:14.942801 20042 raft_consensus.cc:493] T 5ec1c4ce15e04c7e8c283a62179f2a64 P e5256d91808b47c195bc9b4dbd7f2b87 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:14.943454 20042 raft_consensus.cc:515] T 5ec1c4ce15e04c7e8c283a62179f2a64 P e5256d91808b47c195bc9b4dbd7f2b87 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:14.945614 20042 leader_election.cc:290] T 5ec1c4ce15e04c7e8c283a62179f2a64 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:04:14.947444 19558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ec1c4ce15e04c7e8c283a62179f2a64" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:04:14.948099 19558 raft_consensus.cc:2468] T 5ec1c4ce15e04c7e8c283a62179f2a64 P e61c3a8f61bb48f8a963c9480e53c168 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 0.
I20260709 13:04:14.948711 19483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ec1c4ce15e04c7e8c283a62179f2a64" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:04:14.949335 19483 raft_consensus.cc:2468] T 5ec1c4ce15e04c7e8c283a62179f2a64 P 0473d2b2d01f4459b1e90fd12cc7840e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 0.
I20260709 13:04:14.949649 19375 leader_election.cc:304] T 5ec1c4ce15e04c7e8c283a62179f2a64 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:04:14.950405 20042 raft_consensus.cc:2804] T 5ec1c4ce15e04c7e8c283a62179f2a64 P e5256d91808b47c195bc9b4dbd7f2b87 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:14.950765 20042 raft_consensus.cc:493] T 5ec1c4ce15e04c7e8c283a62179f2a64 P e5256d91808b47c195bc9b4dbd7f2b87 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:14.951107 20042 raft_consensus.cc:3060] T 5ec1c4ce15e04c7e8c283a62179f2a64 P e5256d91808b47c195bc9b4dbd7f2b87 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:14.965830 20042 raft_consensus.cc:515] T 5ec1c4ce15e04c7e8c283a62179f2a64 P e5256d91808b47c195bc9b4dbd7f2b87 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:14.967140 19855 consensus_queue.cc:1048] T 2b74109013a140ada21feeef92d6f563 P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:14.970202 19478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ec1c4ce15e04c7e8c283a62179f2a64" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:04:14.970801 19478 raft_consensus.cc:3060] T 5ec1c4ce15e04c7e8c283a62179f2a64 P 0473d2b2d01f4459b1e90fd12cc7840e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:14.978955 19558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ec1c4ce15e04c7e8c283a62179f2a64" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:04:14.979735 19558 raft_consensus.cc:3060] T 5ec1c4ce15e04c7e8c283a62179f2a64 P e61c3a8f61bb48f8a963c9480e53c168 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:14.998281 19478 raft_consensus.cc:2468] T 5ec1c4ce15e04c7e8c283a62179f2a64 P 0473d2b2d01f4459b1e90fd12cc7840e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 1.
I20260709 13:04:14.968185 20042 leader_election.cc:290] T 5ec1c4ce15e04c7e8c283a62179f2a64 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 1 election: Requested vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:04:15.016670 19377 leader_election.cc:304] T 5ec1c4ce15e04c7e8c283a62179f2a64 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87; no voters: 
I20260709 13:04:15.024326 19855 raft_consensus.cc:2804] T 5ec1c4ce15e04c7e8c283a62179f2a64 P e5256d91808b47c195bc9b4dbd7f2b87 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:15.024268 19558 raft_consensus.cc:2468] T 5ec1c4ce15e04c7e8c283a62179f2a64 P e61c3a8f61bb48f8a963c9480e53c168 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 1.
I20260709 13:04:15.024156 19879 consensus_queue.cc:1048] T 48824d5acfbc485ebf8c2d944e7202de P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.004s
I20260709 13:04:15.032039 19855 raft_consensus.cc:697] T 5ec1c4ce15e04c7e8c283a62179f2a64 P e5256d91808b47c195bc9b4dbd7f2b87 [term 1 LEADER]: Becoming Leader. State: Replica: e5256d91808b47c195bc9b4dbd7f2b87, State: Running, Role: LEADER
I20260709 13:04:15.032882 19855 consensus_queue.cc:237] T 5ec1c4ce15e04c7e8c283a62179f2a64 P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:15.064005 19308 catalog_manager.cc:5697] T 5ec1c4ce15e04c7e8c283a62179f2a64 P e5256d91808b47c195bc9b4dbd7f2b87 reported cstate change: term changed from 0 to 1, leader changed from <none> to e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1). New cstate: current_term: 1 leader_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:15.070958 20048 consensus_queue.cc:1048] T 48824d5acfbc485ebf8c2d944e7202de P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:15.465420 19855 consensus_queue.cc:1048] T 5ec1c4ce15e04c7e8c283a62179f2a64 P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:15.489924 19855 consensus_queue.cc:1048] T 5ec1c4ce15e04c7e8c283a62179f2a64 P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:16.721022 18300 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:04:16.750083 20066 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:04:16.751036 20067 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:04:16.763408 20069 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:04:16.763581 18300 server_base.cc:1061] running on GCE node
I20260709 13:04:16.765420 18300 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:04:16.765719 18300 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:04:16.765937 18300 hybrid_clock.cc:648] HybridClock initialized: now 1783602256765916 us; error 0 us; skew 500 ppm
I20260709 13:04:16.766530 18300 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:04:16.788442 18300 webserver.cc:533] Webserver started at http://127.17.223.4:40439/ using document root <none> and password file <none>
I20260709 13:04:16.789155 18300 fs_manager.cc:362] Metadata directory not provided
I20260709 13:04:16.789429 18300 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:04:16.789840 18300 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:04:16.791576 18300 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskKd2k48/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602220613947-18300-0/minicluster-data/ts-3-root/instance:
uuid: "127766fc592545a4997f7790f50f6076"
format_stamp: "Formatted at 2026-07-09 13:04:16 on dist-test-slave-vl1s"
I20260709 13:04:16.802731 18300 fs_manager.cc:696] Time spent creating directory manager: real 0.010s	user 0.002s	sys 0.009s
I20260709 13:04:16.808092 20074 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:04:16.809017 18300 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.004s	sys 0.000s
I20260709 13:04:16.809531 18300 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskKd2k48/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602220613947-18300-0/minicluster-data/ts-3-root
uuid: "127766fc592545a4997f7790f50f6076"
format_stamp: "Formatted at 2026-07-09 13:04:16 on dist-test-slave-vl1s"
I20260709 13:04:16.809839 18300 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskKd2k48/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602220613947-18300-0/minicluster-data/ts-3-root
metadata directory: /tmp/dist-test-taskKd2k48/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602220613947-18300-0/minicluster-data/ts-3-root
1 data directories: /tmp/dist-test-taskKd2k48/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602220613947-18300-0/minicluster-data/ts-3-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:04:16.836488 18300 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:04:16.838371 18300 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:04:16.840649 18300 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:04:16.844296 18300 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:04:16.844606 18300 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:04:16.844944 18300 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:04:16.845196 18300 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:04:16.949304 18300 rpc_server.cc:307] RPC server started. Bound to: 127.17.223.4:43121
I20260709 13:04:16.949379 20136 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.17.223.4:43121 every 8 connection(s)
I20260709 13:04:16.963274 18300 auto_leader_rebalancer-test.cc:384] add a tserver: 127766fc592545a4997f7790f50f6076
I20260709 13:04:16.974159 20137 heartbeater.cc:344] Connected to a master server at 127.17.223.62:36283
I20260709 13:04:16.974596 20137 heartbeater.cc:461] Registering TS with master...
I20260709 13:04:16.975382 20137 heartbeater.cc:507] Master 127.17.223.62:36283 requested a full tablet report, sending...
I20260709 13:04:16.977341 19309 ts_manager.cc:194] Registered new tserver with Master: 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:04:16.978871 19309 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:51954
I20260709 13:04:17.366165 19556 consensus_queue.cc:237] T 65d8cb8d6ec64f459d5a47cefab10acf P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } attrs { replace: true } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: NON_VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: true } }
I20260709 13:04:17.373858 19482 raft_consensus.cc:1275] T 65d8cb8d6ec64f459d5a47cefab10acf P 0473d2b2d01f4459b1e90fd12cc7840e [term 1 FOLLOWER]: Refusing update from remote peer e61c3a8f61bb48f8a963c9480e53c168: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:04:17.375751 20141 consensus_queue.cc:1048] T 65d8cb8d6ec64f459d5a47cefab10acf P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:04:17.383122 19407 raft_consensus.cc:1275] T 65d8cb8d6ec64f459d5a47cefab10acf P e5256d91808b47c195bc9b4dbd7f2b87 [term 1 FOLLOWER]: Refusing update from remote peer e61c3a8f61bb48f8a963c9480e53c168: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:04:17.384631 20141 consensus_queue.cc:1048] T 65d8cb8d6ec64f459d5a47cefab10acf P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:04:17.420223 20065 raft_consensus.cc:2955] T 65d8cb8d6ec64f459d5a47cefab10acf P e61c3a8f61bb48f8a963c9480e53c168 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 127766fc592545a4997f7790f50f6076 (127.17.223.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } attrs { replace: true } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: NON_VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: true } } }
I20260709 13:04:17.420930 19478 raft_consensus.cc:2955] T 65d8cb8d6ec64f459d5a47cefab10acf P 0473d2b2d01f4459b1e90fd12cc7840e [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 127766fc592545a4997f7790f50f6076 (127.17.223.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } attrs { replace: true } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: NON_VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: true } } }
I20260709 13:04:17.426105 19411 raft_consensus.cc:2955] T 65d8cb8d6ec64f459d5a47cefab10acf P e5256d91808b47c195bc9b4dbd7f2b87 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 127766fc592545a4997f7790f50f6076 (127.17.223.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } attrs { replace: true } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: NON_VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: true } } }
I20260709 13:04:17.444605 19309 catalog_manager.cc:5697] T 65d8cb8d6ec64f459d5a47cefab10acf P e5256d91808b47c195bc9b4dbd7f2b87 reported cstate change: config changed from index -1 to 2, NON_VOTER 127766fc592545a4997f7790f50f6076 (127.17.223.4) added. New cstate: current_term: 1 leader_uuid: "e61c3a8f61bb48f8a963c9480e53c168" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } attrs { replace: true } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: NON_VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: true } } }
W20260709 13:04:17.462960 19523 consensus_peers.cc:597] T 65d8cb8d6ec64f459d5a47cefab10acf P e61c3a8f61bb48f8a963c9480e53c168 -> Peer 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121): Couldn't send request to peer 127766fc592545a4997f7790f50f6076. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 65d8cb8d6ec64f459d5a47cefab10acf. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:17.526294 19482 consensus_queue.cc:237] T 48824d5acfbc485ebf8c2d944e7202de P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } attrs { replace: true } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: NON_VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: true } }
I20260709 13:04:17.536633 19556 raft_consensus.cc:1275] T 48824d5acfbc485ebf8c2d944e7202de P e61c3a8f61bb48f8a963c9480e53c168 [term 1 FOLLOWER]: Refusing update from remote peer 0473d2b2d01f4459b1e90fd12cc7840e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:04:17.538252 20155 consensus_queue.cc:1048] T 48824d5acfbc485ebf8c2d944e7202de P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:04:17.540226 19411 raft_consensus.cc:1275] T 48824d5acfbc485ebf8c2d944e7202de P e5256d91808b47c195bc9b4dbd7f2b87 [term 1 FOLLOWER]: Refusing update from remote peer 0473d2b2d01f4459b1e90fd12cc7840e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:04:17.541986 20155 consensus_queue.cc:1048] T 48824d5acfbc485ebf8c2d944e7202de P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:04:17.556502 20048 raft_consensus.cc:2955] T 48824d5acfbc485ebf8c2d944e7202de P 0473d2b2d01f4459b1e90fd12cc7840e [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 127766fc592545a4997f7790f50f6076 (127.17.223.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } attrs { replace: true } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: NON_VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: true } } }
I20260709 13:04:17.559850 19556 raft_consensus.cc:2955] T 48824d5acfbc485ebf8c2d944e7202de P e61c3a8f61bb48f8a963c9480e53c168 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 127766fc592545a4997f7790f50f6076 (127.17.223.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } attrs { replace: true } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: NON_VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: true } } }
W20260709 13:04:17.560933 19449 consensus_peers.cc:597] T 48824d5acfbc485ebf8c2d944e7202de P 0473d2b2d01f4459b1e90fd12cc7840e -> Peer 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121): Couldn't send request to peer 127766fc592545a4997f7790f50f6076. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 48824d5acfbc485ebf8c2d944e7202de. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:17.575667 19307 catalog_manager.cc:5697] T 48824d5acfbc485ebf8c2d944e7202de P e61c3a8f61bb48f8a963c9480e53c168 reported cstate change: config changed from index -1 to 2, NON_VOTER 127766fc592545a4997f7790f50f6076 (127.17.223.4) added. New cstate: current_term: 1 leader_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } attrs { replace: true } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: NON_VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: true } } }
I20260709 13:04:17.584074 19478 consensus_queue.cc:237] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } attrs { replace: true } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: NON_VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: true } }
I20260709 13:04:17.591629 19411 raft_consensus.cc:2955] T 48824d5acfbc485ebf8c2d944e7202de P e5256d91808b47c195bc9b4dbd7f2b87 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 127766fc592545a4997f7790f50f6076 (127.17.223.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } attrs { replace: true } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: NON_VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: true } } }
I20260709 13:04:17.614740 19556 raft_consensus.cc:1275] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P e61c3a8f61bb48f8a963c9480e53c168 [term 1 FOLLOWER]: Refusing update from remote peer 0473d2b2d01f4459b1e90fd12cc7840e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:04:17.616254 19954 consensus_queue.cc:1048] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:04:17.620700 19408 raft_consensus.cc:1275] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P e5256d91808b47c195bc9b4dbd7f2b87 [term 1 FOLLOWER]: Refusing update from remote peer 0473d2b2d01f4459b1e90fd12cc7840e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 13:04:17.620867 19449 consensus_peers.cc:597] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P 0473d2b2d01f4459b1e90fd12cc7840e -> Peer 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121): Couldn't send request to peer 127766fc592545a4997f7790f50f6076. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 36f6ba92b9ba46babe4ebd6c02e5fbd9. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:17.623386 20048 consensus_queue.cc:1048] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:04:17.635746 20155 raft_consensus.cc:2955] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P 0473d2b2d01f4459b1e90fd12cc7840e [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 127766fc592545a4997f7790f50f6076 (127.17.223.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } attrs { replace: true } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: NON_VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: true } } }
I20260709 13:04:17.655383 19556 consensus_queue.cc:237] T 833a2f0775ed407a94b8924ce50adb63 P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } attrs { replace: true } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: NON_VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: true } }
I20260709 13:04:17.660614 19558 raft_consensus.cc:2955] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P e61c3a8f61bb48f8a963c9480e53c168 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 127766fc592545a4997f7790f50f6076 (127.17.223.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } attrs { replace: true } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: NON_VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: true } } }
I20260709 13:04:17.659600 19307 catalog_manager.cc:5697] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P 0473d2b2d01f4459b1e90fd12cc7840e reported cstate change: config changed from index -1 to 2, NON_VOTER 127766fc592545a4997f7790f50f6076 (127.17.223.4) added. New cstate: current_term: 1 leader_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: NON_VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:17.662457 19408 raft_consensus.cc:2955] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P e5256d91808b47c195bc9b4dbd7f2b87 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 127766fc592545a4997f7790f50f6076 (127.17.223.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } attrs { replace: true } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: NON_VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: true } } }
W20260709 13:04:17.706889 19523 consensus_peers.cc:597] T 833a2f0775ed407a94b8924ce50adb63 P e61c3a8f61bb48f8a963c9480e53c168 -> Peer 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121): Couldn't send request to peer 127766fc592545a4997f7790f50f6076. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 833a2f0775ed407a94b8924ce50adb63. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:17.707383 19478 raft_consensus.cc:1275] T 833a2f0775ed407a94b8924ce50adb63 P 0473d2b2d01f4459b1e90fd12cc7840e [term 1 FOLLOWER]: Refusing update from remote peer e61c3a8f61bb48f8a963c9480e53c168: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:04:17.708539 19408 raft_consensus.cc:1275] T 833a2f0775ed407a94b8924ce50adb63 P e5256d91808b47c195bc9b4dbd7f2b87 [term 1 FOLLOWER]: Refusing update from remote peer e61c3a8f61bb48f8a963c9480e53c168: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:04:17.708985 20065 consensus_queue.cc:1048] T 833a2f0775ed407a94b8924ce50adb63 P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:04:17.710348 20141 consensus_queue.cc:1048] T 833a2f0775ed407a94b8924ce50adb63 P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:04:17.736965 20065 raft_consensus.cc:2955] T 833a2f0775ed407a94b8924ce50adb63 P e61c3a8f61bb48f8a963c9480e53c168 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 127766fc592545a4997f7790f50f6076 (127.17.223.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } attrs { replace: true } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: NON_VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: true } } }
I20260709 13:04:17.740200 19408 raft_consensus.cc:2955] T 833a2f0775ed407a94b8924ce50adb63 P e5256d91808b47c195bc9b4dbd7f2b87 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 127766fc592545a4997f7790f50f6076 (127.17.223.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } attrs { replace: true } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: NON_VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: true } } }
I20260709 13:04:17.742695 19478 raft_consensus.cc:2955] T 833a2f0775ed407a94b8924ce50adb63 P 0473d2b2d01f4459b1e90fd12cc7840e [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 127766fc592545a4997f7790f50f6076 (127.17.223.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } attrs { replace: true } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: NON_VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: true } } }
I20260709 13:04:17.757165 19308 catalog_manager.cc:5697] T 833a2f0775ed407a94b8924ce50adb63 P e5256d91808b47c195bc9b4dbd7f2b87 reported cstate change: config changed from index -1 to 2, NON_VOTER 127766fc592545a4997f7790f50f6076 (127.17.223.4) added. New cstate: current_term: 1 leader_uuid: "e61c3a8f61bb48f8a963c9480e53c168" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } attrs { replace: true } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: NON_VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: true } } }
I20260709 13:04:17.960134 20167 ts_tablet_manager.cc:933] T 65d8cb8d6ec64f459d5a47cefab10acf P 127766fc592545a4997f7790f50f6076: Initiating tablet copy from peer e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:04:17.977396 20167 tablet_copy_client.cc:323] T 65d8cb8d6ec64f459d5a47cefab10acf P 127766fc592545a4997f7790f50f6076: tablet copy: Beginning tablet copy session from remote peer at address 127.17.223.3:36891
I20260709 13:04:17.986274 20137 heartbeater.cc:499] Master 127.17.223.62:36283 was elected leader, sending a full tablet report...
I20260709 13:04:18.019886 20171 ts_tablet_manager.cc:933] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P 127766fc592545a4997f7790f50f6076: Initiating tablet copy from peer 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:04:18.032636 20171 tablet_copy_client.cc:323] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P 127766fc592545a4997f7790f50f6076: tablet copy: Beginning tablet copy session from remote peer at address 127.17.223.2:46257
I20260709 13:04:18.064189 19570 tablet_copy_service.cc:140] P e61c3a8f61bb48f8a963c9480e53c168: Received BeginTabletCopySession request for tablet 65d8cb8d6ec64f459d5a47cefab10acf from peer 127766fc592545a4997f7790f50f6076 ({username='slave'} at 127.0.0.1:41504)
I20260709 13:04:18.064812 19570 tablet_copy_service.cc:161] P e61c3a8f61bb48f8a963c9480e53c168: Beginning new tablet copy session on tablet 65d8cb8d6ec64f459d5a47cefab10acf from peer 127766fc592545a4997f7790f50f6076 at {username='slave'} at 127.0.0.1:41504: session id = 127766fc592545a4997f7790f50f6076-65d8cb8d6ec64f459d5a47cefab10acf
I20260709 13:04:18.084323 19496 tablet_copy_service.cc:140] P 0473d2b2d01f4459b1e90fd12cc7840e: Received BeginTabletCopySession request for tablet 36f6ba92b9ba46babe4ebd6c02e5fbd9 from peer 127766fc592545a4997f7790f50f6076 ({username='slave'} at 127.0.0.1:39478)
I20260709 13:04:18.084959 19496 tablet_copy_service.cc:161] P 0473d2b2d01f4459b1e90fd12cc7840e: Beginning new tablet copy session on tablet 36f6ba92b9ba46babe4ebd6c02e5fbd9 from peer 127766fc592545a4997f7790f50f6076 at {username='slave'} at 127.0.0.1:39478: session id = 127766fc592545a4997f7790f50f6076-36f6ba92b9ba46babe4ebd6c02e5fbd9
I20260709 13:04:18.088749 19570 tablet_copy_source_session.cc:215] T 65d8cb8d6ec64f459d5a47cefab10acf P e61c3a8f61bb48f8a963c9480e53c168: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:04:18.094468 20167 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 65d8cb8d6ec64f459d5a47cefab10acf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:18.109383 19496 tablet_copy_source_session.cc:215] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P 0473d2b2d01f4459b1e90fd12cc7840e: Tablet Copy: opened 0 blocks and 1 log segments
W20260709 13:04:18.110534 19375 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.3:36891, user_credentials={real_user=slave}} blocked reactor thread for 49631.4us
I20260709 13:04:18.118932 20171 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 36f6ba92b9ba46babe4ebd6c02e5fbd9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:18.134164 20171 tablet_copy_client.cc:806] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P 127766fc592545a4997f7790f50f6076: tablet copy: Starting download of 0 data blocks...
I20260709 13:04:18.141330 20176 ts_tablet_manager.cc:933] T 48824d5acfbc485ebf8c2d944e7202de P 127766fc592545a4997f7790f50f6076: Initiating tablet copy from peer 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:04:18.126060 20167 tablet_copy_client.cc:806] T 65d8cb8d6ec64f459d5a47cefab10acf P 127766fc592545a4997f7790f50f6076: tablet copy: Starting download of 0 data blocks...
I20260709 13:04:18.145679 20167 tablet_copy_client.cc:670] T 65d8cb8d6ec64f459d5a47cefab10acf P 127766fc592545a4997f7790f50f6076: tablet copy: Starting download of 1 WAL segments...
I20260709 13:04:18.140661 20171 tablet_copy_client.cc:670] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P 127766fc592545a4997f7790f50f6076: tablet copy: Starting download of 1 WAL segments...
I20260709 13:04:18.154070 20167 tablet_copy_client.cc:538] T 65d8cb8d6ec64f459d5a47cefab10acf P 127766fc592545a4997f7790f50f6076: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:04:18.154563 20171 tablet_copy_client.cc:538] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P 127766fc592545a4997f7790f50f6076: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:04:18.161648 20176 tablet_copy_client.cc:323] T 48824d5acfbc485ebf8c2d944e7202de P 127766fc592545a4997f7790f50f6076: tablet copy: Beginning tablet copy session from remote peer at address 127.17.223.2:46257
I20260709 13:04:18.167212 19496 tablet_copy_service.cc:140] P 0473d2b2d01f4459b1e90fd12cc7840e: Received BeginTabletCopySession request for tablet 48824d5acfbc485ebf8c2d944e7202de from peer 127766fc592545a4997f7790f50f6076 ({username='slave'} at 127.0.0.1:39478)
I20260709 13:04:18.167719 19496 tablet_copy_service.cc:161] P 0473d2b2d01f4459b1e90fd12cc7840e: Beginning new tablet copy session on tablet 48824d5acfbc485ebf8c2d944e7202de from peer 127766fc592545a4997f7790f50f6076 at {username='slave'} at 127.0.0.1:39478: session id = 127766fc592545a4997f7790f50f6076-48824d5acfbc485ebf8c2d944e7202de
I20260709 13:04:18.174263 19496 tablet_copy_source_session.cc:215] T 48824d5acfbc485ebf8c2d944e7202de P 0473d2b2d01f4459b1e90fd12cc7840e: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:04:18.175354 20171 tablet_bootstrap.cc:492] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P 127766fc592545a4997f7790f50f6076: Bootstrap starting.
I20260709 13:04:18.184839 20176 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 48824d5acfbc485ebf8c2d944e7202de. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:18.188479 20167 tablet_bootstrap.cc:492] T 65d8cb8d6ec64f459d5a47cefab10acf P 127766fc592545a4997f7790f50f6076: Bootstrap starting.
I20260709 13:04:18.206012 20171 tablet_bootstrap.cc:492] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P 127766fc592545a4997f7790f50f6076: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:04:18.207197 20171 tablet_bootstrap.cc:492] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P 127766fc592545a4997f7790f50f6076: Bootstrap complete.
I20260709 13:04:18.207944 20171 ts_tablet_manager.cc:1403] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P 127766fc592545a4997f7790f50f6076: Time spent bootstrapping tablet: real 0.033s	user 0.027s	sys 0.003s
I20260709 13:04:18.211959 20171 raft_consensus.cc:359] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P 127766fc592545a4997f7790f50f6076 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } attrs { replace: true } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: NON_VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: true } }
I20260709 13:04:18.212847 20171 raft_consensus.cc:740] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P 127766fc592545a4997f7790f50f6076 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 127766fc592545a4997f7790f50f6076, State: Initialized, Role: LEARNER
I20260709 13:04:18.213573 20171 consensus_queue.cc:260] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P 127766fc592545a4997f7790f50f6076 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } attrs { replace: true } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: NON_VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: true } }
I20260709 13:04:18.223336 20171 ts_tablet_manager.cc:1434] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P 127766fc592545a4997f7790f50f6076: Time spent starting tablet: real 0.015s	user 0.005s	sys 0.007s
I20260709 13:04:18.227798 19496 tablet_copy_service.cc:342] P 0473d2b2d01f4459b1e90fd12cc7840e: Request end of tablet copy session 127766fc592545a4997f7790f50f6076-36f6ba92b9ba46babe4ebd6c02e5fbd9 received from {username='slave'} at 127.0.0.1:39478
I20260709 13:04:18.228291 19496 tablet_copy_service.cc:434] P 0473d2b2d01f4459b1e90fd12cc7840e: ending tablet copy session 127766fc592545a4997f7790f50f6076-36f6ba92b9ba46babe4ebd6c02e5fbd9 on tablet 36f6ba92b9ba46babe4ebd6c02e5fbd9 with peer 127766fc592545a4997f7790f50f6076
I20260709 13:04:18.234745 20171 ts_tablet_manager.cc:933] T 833a2f0775ed407a94b8924ce50adb63 P 127766fc592545a4997f7790f50f6076: Initiating tablet copy from peer e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:04:18.247507 20171 tablet_copy_client.cc:323] T 833a2f0775ed407a94b8924ce50adb63 P 127766fc592545a4997f7790f50f6076: tablet copy: Beginning tablet copy session from remote peer at address 127.17.223.3:36891
I20260709 13:04:18.249380 19570 tablet_copy_service.cc:140] P e61c3a8f61bb48f8a963c9480e53c168: Received BeginTabletCopySession request for tablet 833a2f0775ed407a94b8924ce50adb63 from peer 127766fc592545a4997f7790f50f6076 ({username='slave'} at 127.0.0.1:41504)
I20260709 13:04:18.249887 19570 tablet_copy_service.cc:161] P e61c3a8f61bb48f8a963c9480e53c168: Beginning new tablet copy session on tablet 833a2f0775ed407a94b8924ce50adb63 from peer 127766fc592545a4997f7790f50f6076 at {username='slave'} at 127.0.0.1:41504: session id = 127766fc592545a4997f7790f50f6076-833a2f0775ed407a94b8924ce50adb63
I20260709 13:04:18.251361 20167 tablet_bootstrap.cc:492] T 65d8cb8d6ec64f459d5a47cefab10acf P 127766fc592545a4997f7790f50f6076: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:04:18.252262 20167 tablet_bootstrap.cc:492] T 65d8cb8d6ec64f459d5a47cefab10acf P 127766fc592545a4997f7790f50f6076: Bootstrap complete.
I20260709 13:04:18.252962 20167 ts_tablet_manager.cc:1403] T 65d8cb8d6ec64f459d5a47cefab10acf P 127766fc592545a4997f7790f50f6076: Time spent bootstrapping tablet: real 0.065s	user 0.017s	sys 0.012s
I20260709 13:04:18.258136 19570 tablet_copy_source_session.cc:215] T 833a2f0775ed407a94b8924ce50adb63 P e61c3a8f61bb48f8a963c9480e53c168: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:04:18.258937 20176 tablet_copy_client.cc:806] T 48824d5acfbc485ebf8c2d944e7202de P 127766fc592545a4997f7790f50f6076: tablet copy: Starting download of 0 data blocks...
I20260709 13:04:18.261394 20171 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 833a2f0775ed407a94b8924ce50adb63. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:18.259528 20176 tablet_copy_client.cc:670] T 48824d5acfbc485ebf8c2d944e7202de P 127766fc592545a4997f7790f50f6076: tablet copy: Starting download of 1 WAL segments...
I20260709 13:04:18.265511 20176 tablet_copy_client.cc:538] T 48824d5acfbc485ebf8c2d944e7202de P 127766fc592545a4997f7790f50f6076: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:04:18.269765 20167 raft_consensus.cc:359] T 65d8cb8d6ec64f459d5a47cefab10acf P 127766fc592545a4997f7790f50f6076 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } attrs { replace: true } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: NON_VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: true } }
I20260709 13:04:18.270645 20167 raft_consensus.cc:740] T 65d8cb8d6ec64f459d5a47cefab10acf P 127766fc592545a4997f7790f50f6076 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 127766fc592545a4997f7790f50f6076, State: Initialized, Role: LEARNER
I20260709 13:04:18.271318 20167 consensus_queue.cc:260] T 65d8cb8d6ec64f459d5a47cefab10acf P 127766fc592545a4997f7790f50f6076 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } attrs { replace: true } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: NON_VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: true } }
I20260709 13:04:18.273792 20167 ts_tablet_manager.cc:1434] T 65d8cb8d6ec64f459d5a47cefab10acf P 127766fc592545a4997f7790f50f6076: Time spent starting tablet: real 0.021s	user 0.003s	sys 0.005s
I20260709 13:04:18.285071 20171 tablet_copy_client.cc:806] T 833a2f0775ed407a94b8924ce50adb63 P 127766fc592545a4997f7790f50f6076: tablet copy: Starting download of 0 data blocks...
I20260709 13:04:18.285125 19570 tablet_copy_service.cc:342] P e61c3a8f61bb48f8a963c9480e53c168: Request end of tablet copy session 127766fc592545a4997f7790f50f6076-65d8cb8d6ec64f459d5a47cefab10acf received from {username='slave'} at 127.0.0.1:41504
I20260709 13:04:18.285724 19570 tablet_copy_service.cc:434] P e61c3a8f61bb48f8a963c9480e53c168: ending tablet copy session 127766fc592545a4997f7790f50f6076-65d8cb8d6ec64f459d5a47cefab10acf on tablet 65d8cb8d6ec64f459d5a47cefab10acf with peer 127766fc592545a4997f7790f50f6076
I20260709 13:04:18.285805 20171 tablet_copy_client.cc:670] T 833a2f0775ed407a94b8924ce50adb63 P 127766fc592545a4997f7790f50f6076: tablet copy: Starting download of 1 WAL segments...
I20260709 13:04:18.290640 20171 tablet_copy_client.cc:538] T 833a2f0775ed407a94b8924ce50adb63 P 127766fc592545a4997f7790f50f6076: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:04:18.299094 20171 tablet_bootstrap.cc:492] T 833a2f0775ed407a94b8924ce50adb63 P 127766fc592545a4997f7790f50f6076: Bootstrap starting.
I20260709 13:04:18.301368 20176 tablet_bootstrap.cc:492] T 48824d5acfbc485ebf8c2d944e7202de P 127766fc592545a4997f7790f50f6076: Bootstrap starting.
I20260709 13:04:18.331751 20171 tablet_bootstrap.cc:492] T 833a2f0775ed407a94b8924ce50adb63 P 127766fc592545a4997f7790f50f6076: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:04:18.332718 20171 tablet_bootstrap.cc:492] T 833a2f0775ed407a94b8924ce50adb63 P 127766fc592545a4997f7790f50f6076: Bootstrap complete.
I20260709 13:04:18.333490 20171 ts_tablet_manager.cc:1403] T 833a2f0775ed407a94b8924ce50adb63 P 127766fc592545a4997f7790f50f6076: Time spent bootstrapping tablet: real 0.035s	user 0.016s	sys 0.016s
I20260709 13:04:18.336591 20171 raft_consensus.cc:359] T 833a2f0775ed407a94b8924ce50adb63 P 127766fc592545a4997f7790f50f6076 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } attrs { replace: true } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: NON_VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: true } }
I20260709 13:04:18.337445 20171 raft_consensus.cc:740] T 833a2f0775ed407a94b8924ce50adb63 P 127766fc592545a4997f7790f50f6076 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 127766fc592545a4997f7790f50f6076, State: Initialized, Role: LEARNER
I20260709 13:04:18.338410 20176 tablet_bootstrap.cc:492] T 48824d5acfbc485ebf8c2d944e7202de P 127766fc592545a4997f7790f50f6076: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:04:18.338110 20171 consensus_queue.cc:260] T 833a2f0775ed407a94b8924ce50adb63 P 127766fc592545a4997f7790f50f6076 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } attrs { replace: true } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: NON_VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: true } }
I20260709 13:04:18.340787 20171 ts_tablet_manager.cc:1434] T 833a2f0775ed407a94b8924ce50adb63 P 127766fc592545a4997f7790f50f6076: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 13:04:18.342926 20176 tablet_bootstrap.cc:492] T 48824d5acfbc485ebf8c2d944e7202de P 127766fc592545a4997f7790f50f6076: Bootstrap complete.
I20260709 13:04:18.343637 20176 ts_tablet_manager.cc:1403] T 48824d5acfbc485ebf8c2d944e7202de P 127766fc592545a4997f7790f50f6076: Time spent bootstrapping tablet: real 0.042s	user 0.019s	sys 0.009s
I20260709 13:04:18.346495 20176 raft_consensus.cc:359] T 48824d5acfbc485ebf8c2d944e7202de P 127766fc592545a4997f7790f50f6076 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } attrs { replace: true } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: NON_VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: true } }
I20260709 13:04:18.347388 20176 raft_consensus.cc:740] T 48824d5acfbc485ebf8c2d944e7202de P 127766fc592545a4997f7790f50f6076 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 127766fc592545a4997f7790f50f6076, State: Initialized, Role: LEARNER
I20260709 13:04:18.348057 20176 consensus_queue.cc:260] T 48824d5acfbc485ebf8c2d944e7202de P 127766fc592545a4997f7790f50f6076 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } attrs { replace: true } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: NON_VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: true } }
I20260709 13:04:18.349290 19570 tablet_copy_service.cc:342] P e61c3a8f61bb48f8a963c9480e53c168: Request end of tablet copy session 127766fc592545a4997f7790f50f6076-833a2f0775ed407a94b8924ce50adb63 received from {username='slave'} at 127.0.0.1:41504
I20260709 13:04:18.349926 19570 tablet_copy_service.cc:434] P e61c3a8f61bb48f8a963c9480e53c168: ending tablet copy session 127766fc592545a4997f7790f50f6076-833a2f0775ed407a94b8924ce50adb63 on tablet 833a2f0775ed407a94b8924ce50adb63 with peer 127766fc592545a4997f7790f50f6076
I20260709 13:04:18.350509 20176 ts_tablet_manager.cc:1434] T 48824d5acfbc485ebf8c2d944e7202de P 127766fc592545a4997f7790f50f6076: Time spent starting tablet: real 0.007s	user 0.001s	sys 0.004s
I20260709 13:04:18.352069 19496 tablet_copy_service.cc:342] P 0473d2b2d01f4459b1e90fd12cc7840e: Request end of tablet copy session 127766fc592545a4997f7790f50f6076-48824d5acfbc485ebf8c2d944e7202de received from {username='slave'} at 127.0.0.1:39478
I20260709 13:04:18.352571 19496 tablet_copy_service.cc:434] P 0473d2b2d01f4459b1e90fd12cc7840e: ending tablet copy session 127766fc592545a4997f7790f50f6076-48824d5acfbc485ebf8c2d944e7202de on tablet 48824d5acfbc485ebf8c2d944e7202de with peer 127766fc592545a4997f7790f50f6076
I20260709 13:04:18.413163 20112 raft_consensus.cc:1217] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P 127766fc592545a4997f7790f50f6076 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:04:18.505741 20112 raft_consensus.cc:1217] T 65d8cb8d6ec64f459d5a47cefab10acf P 127766fc592545a4997f7790f50f6076 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:04:18.544175 20112 raft_consensus.cc:1217] T 48824d5acfbc485ebf8c2d944e7202de P 127766fc592545a4997f7790f50f6076 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:04:18.752429 20112 raft_consensus.cc:1217] T 833a2f0775ed407a94b8924ce50adb63 P 127766fc592545a4997f7790f50f6076 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:04:18.983965 20155 raft_consensus.cc:1064] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P 0473d2b2d01f4459b1e90fd12cc7840e: attempting to promote NON_VOTER 127766fc592545a4997f7790f50f6076 to VOTER
I20260709 13:04:18.986687 20155 consensus_queue.cc:237] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } attrs { replace: true } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:04:18.993773 20112 raft_consensus.cc:1275] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P 127766fc592545a4997f7790f50f6076 [term 1 LEARNER]: Refusing update from remote peer 0473d2b2d01f4459b1e90fd12cc7840e: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:04:18.993935 19558 raft_consensus.cc:1275] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P e61c3a8f61bb48f8a963c9480e53c168 [term 1 FOLLOWER]: Refusing update from remote peer 0473d2b2d01f4459b1e90fd12cc7840e: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:04:18.993935 19408 raft_consensus.cc:1275] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P e5256d91808b47c195bc9b4dbd7f2b87 [term 1 FOLLOWER]: Refusing update from remote peer 0473d2b2d01f4459b1e90fd12cc7840e: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:04:18.995476 20162 consensus_queue.cc:1048] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:04:18.996649 20155 consensus_queue.cc:1048] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Connected to new peer: Peer: permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:04:18.997444 19954 consensus_queue.cc:1048] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:04:19.003621 20162 raft_consensus.cc:1064] T 48824d5acfbc485ebf8c2d944e7202de P 0473d2b2d01f4459b1e90fd12cc7840e: attempting to promote NON_VOTER 127766fc592545a4997f7790f50f6076 to VOTER
I20260709 13:04:19.009285 20162 consensus_queue.cc:237] T 48824d5acfbc485ebf8c2d944e7202de P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } attrs { replace: true } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:04:19.027878 20111 raft_consensus.cc:1275] T 48824d5acfbc485ebf8c2d944e7202de P 127766fc592545a4997f7790f50f6076 [term 1 LEARNER]: Refusing update from remote peer 0473d2b2d01f4459b1e90fd12cc7840e: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:04:19.031481 19954 consensus_queue.cc:1048] T 48824d5acfbc485ebf8c2d944e7202de P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Connected to new peer: Peer: permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:04:19.035478 19559 raft_consensus.cc:1275] T 48824d5acfbc485ebf8c2d944e7202de P e61c3a8f61bb48f8a963c9480e53c168 [term 1 FOLLOWER]: Refusing update from remote peer 0473d2b2d01f4459b1e90fd12cc7840e: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:04:19.058723 19954 consensus_queue.cc:1048] T 48824d5acfbc485ebf8c2d944e7202de P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.004s
I20260709 13:04:19.125820 20151 raft_consensus.cc:1064] T 65d8cb8d6ec64f459d5a47cefab10acf P e61c3a8f61bb48f8a963c9480e53c168: attempting to promote NON_VOTER 127766fc592545a4997f7790f50f6076 to VOTER
I20260709 13:04:19.128110 20151 consensus_queue.cc:237] T 65d8cb8d6ec64f459d5a47cefab10acf P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } attrs { replace: true } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:04:19.127451 20194 raft_consensus.cc:2955] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P 0473d2b2d01f4459b1e90fd12cc7840e [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 127766fc592545a4997f7790f50f6076 (127.17.223.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } attrs { replace: true } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } } }
I20260709 13:04:19.145200 20111 raft_consensus.cc:1275] T 65d8cb8d6ec64f459d5a47cefab10acf P 127766fc592545a4997f7790f50f6076 [term 1 LEARNER]: Refusing update from remote peer e61c3a8f61bb48f8a963c9480e53c168: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:04:19.146739 20183 consensus_queue.cc:1048] T 65d8cb8d6ec64f459d5a47cefab10acf P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Connected to new peer: Peer: permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:04:19.155807 19408 raft_consensus.cc:1275] T 65d8cb8d6ec64f459d5a47cefab10acf P e5256d91808b47c195bc9b4dbd7f2b87 [term 1 FOLLOWER]: Refusing update from remote peer e61c3a8f61bb48f8a963c9480e53c168: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:04:19.158034 20183 consensus_queue.cc:1048] T 65d8cb8d6ec64f459d5a47cefab10acf P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
W20260709 13:04:19.175120 19526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.2:46257, user_credentials={real_user=slave}} blocked reactor thread for 71393.4us
W20260709 13:04:19.176640 19449 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.1:40321, user_credentials={real_user=slave}} blocked reactor thread for 60317.8us
I20260709 13:04:19.183072 19411 raft_consensus.cc:1275] T 48824d5acfbc485ebf8c2d944e7202de P e5256d91808b47c195bc9b4dbd7f2b87 [term 1 FOLLOWER]: Refusing update from remote peer 0473d2b2d01f4459b1e90fd12cc7840e: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:04:19.196501 19484 raft_consensus.cc:1275] T 65d8cb8d6ec64f459d5a47cefab10acf P 0473d2b2d01f4459b1e90fd12cc7840e [term 1 FOLLOWER]: Refusing update from remote peer e61c3a8f61bb48f8a963c9480e53c168: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:04:19.197690 20155 raft_consensus.cc:2955] T 48824d5acfbc485ebf8c2d944e7202de P 0473d2b2d01f4459b1e90fd12cc7840e [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 127766fc592545a4997f7790f50f6076 (127.17.223.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } attrs { replace: true } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } } }
I20260709 13:04:19.201556 20151 raft_consensus.cc:2955] T 65d8cb8d6ec64f459d5a47cefab10acf P e61c3a8f61bb48f8a963c9480e53c168 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 127766fc592545a4997f7790f50f6076 (127.17.223.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } attrs { replace: true } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } } }
I20260709 13:04:19.208012 19408 raft_consensus.cc:2955] T 65d8cb8d6ec64f459d5a47cefab10acf P e5256d91808b47c195bc9b4dbd7f2b87 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 127766fc592545a4997f7790f50f6076 (127.17.223.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } attrs { replace: true } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } } }
I20260709 13:04:19.211086 20198 consensus_queue.cc:1048] T 48824d5acfbc485ebf8c2d944e7202de P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:04:19.217927 19558 raft_consensus.cc:2955] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P e61c3a8f61bb48f8a963c9480e53c168 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 127766fc592545a4997f7790f50f6076 (127.17.223.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } attrs { replace: true } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } } }
I20260709 13:04:19.226044 19407 raft_consensus.cc:2955] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P e5256d91808b47c195bc9b4dbd7f2b87 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 127766fc592545a4997f7790f50f6076 (127.17.223.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } attrs { replace: true } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } } }
I20260709 13:04:19.230718 20112 raft_consensus.cc:2955] T 65d8cb8d6ec64f459d5a47cefab10acf P 127766fc592545a4997f7790f50f6076 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 127766fc592545a4997f7790f50f6076 (127.17.223.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } attrs { replace: true } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } } }
I20260709 13:04:19.246500 19308 catalog_manager.cc:5697] T 65d8cb8d6ec64f459d5a47cefab10acf P 127766fc592545a4997f7790f50f6076 reported cstate change: config changed from index 2 to 3, 127766fc592545a4997f7790f50f6076 (127.17.223.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "e61c3a8f61bb48f8a963c9480e53c168" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } attrs { replace: true } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } } }
I20260709 13:04:19.254554 20197 raft_consensus.cc:1064] T 833a2f0775ed407a94b8924ce50adb63 P e61c3a8f61bb48f8a963c9480e53c168: attempting to promote NON_VOTER 127766fc592545a4997f7790f50f6076 to VOTER
I20260709 13:04:19.257192 20197 consensus_queue.cc:237] T 833a2f0775ed407a94b8924ce50adb63 P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } attrs { replace: true } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:04:19.263612 20112 raft_consensus.cc:2955] T 48824d5acfbc485ebf8c2d944e7202de P 127766fc592545a4997f7790f50f6076 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 127766fc592545a4997f7790f50f6076 (127.17.223.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } attrs { replace: true } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } } }
I20260709 13:04:19.264777 20183 consensus_queue.cc:1048] T 65d8cb8d6ec64f459d5a47cefab10acf P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:04:19.303246 19558 raft_consensus.cc:2955] T 48824d5acfbc485ebf8c2d944e7202de P e61c3a8f61bb48f8a963c9480e53c168 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 127766fc592545a4997f7790f50f6076 (127.17.223.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } attrs { replace: true } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } } }
I20260709 13:04:19.306354 19306 catalog_manager.cc:5697] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P 0473d2b2d01f4459b1e90fd12cc7840e reported cstate change: config changed from index 2 to 3, 127766fc592545a4997f7790f50f6076 (127.17.223.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:04:19.310009 20111 raft_consensus.cc:2955] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P 127766fc592545a4997f7790f50f6076 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 127766fc592545a4997f7790f50f6076 (127.17.223.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } attrs { replace: true } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } } }
I20260709 13:04:19.329075 19484 raft_consensus.cc:2955] T 65d8cb8d6ec64f459d5a47cefab10acf P 0473d2b2d01f4459b1e90fd12cc7840e [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 127766fc592545a4997f7790f50f6076 (127.17.223.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } attrs { replace: true } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } } }
I20260709 13:04:19.346961 19408 raft_consensus.cc:1275] T 833a2f0775ed407a94b8924ce50adb63 P e5256d91808b47c195bc9b4dbd7f2b87 [term 1 FOLLOWER]: Refusing update from remote peer e61c3a8f61bb48f8a963c9480e53c168: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:04:19.346978 20112 raft_consensus.cc:1275] T 833a2f0775ed407a94b8924ce50adb63 P 127766fc592545a4997f7790f50f6076 [term 1 LEARNER]: Refusing update from remote peer e61c3a8f61bb48f8a963c9480e53c168: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:04:19.347261 19407 raft_consensus.cc:2955] T 48824d5acfbc485ebf8c2d944e7202de P e5256d91808b47c195bc9b4dbd7f2b87 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 127766fc592545a4997f7790f50f6076 (127.17.223.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } attrs { replace: true } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } } }
I20260709 13:04:19.348287 20151 consensus_queue.cc:1048] T 833a2f0775ed407a94b8924ce50adb63 P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:04:19.353155 19484 raft_consensus.cc:1275] T 833a2f0775ed407a94b8924ce50adb63 P 0473d2b2d01f4459b1e90fd12cc7840e [term 1 FOLLOWER]: Refusing update from remote peer e61c3a8f61bb48f8a963c9480e53c168: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:04:19.355120 20151 consensus_queue.cc:1048] T 833a2f0775ed407a94b8924ce50adb63 P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:04:19.365911 19483 consensus_queue.cc:237] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:04:19.375788 19558 consensus_queue.cc:237] T 65d8cb8d6ec64f459d5a47cefab10acf P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:04:19.376727 19306 catalog_manager.cc:5697] T 48824d5acfbc485ebf8c2d944e7202de P 127766fc592545a4997f7790f50f6076 reported cstate change: config changed from index 2 to 3, 127766fc592545a4997f7790f50f6076 (127.17.223.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } attrs { replace: true } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } } }
I20260709 13:04:19.380482 20111 raft_consensus.cc:1275] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P 127766fc592545a4997f7790f50f6076 [term 1 FOLLOWER]: Refusing update from remote peer 0473d2b2d01f4459b1e90fd12cc7840e: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:04:19.382000 20198 consensus_queue.cc:1048] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Connected to new peer: Peer: permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:04:19.388728 20111 raft_consensus.cc:1275] T 65d8cb8d6ec64f459d5a47cefab10acf P 127766fc592545a4997f7790f50f6076 [term 1 FOLLOWER]: Refusing update from remote peer e61c3a8f61bb48f8a963c9480e53c168: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:04:19.393184 20197 consensus_queue.cc:1048] T 65d8cb8d6ec64f459d5a47cefab10acf P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Connected to new peer: Peer: permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:04:19.394469 19407 raft_consensus.cc:1275] T 65d8cb8d6ec64f459d5a47cefab10acf P e5256d91808b47c195bc9b4dbd7f2b87 [term 1 FOLLOWER]: Refusing update from remote peer e61c3a8f61bb48f8a963c9480e53c168: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:04:19.400444 20151 consensus_queue.cc:1048] T 65d8cb8d6ec64f459d5a47cefab10acf P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:04:19.406929 20196 consensus_queue.cc:1048] T 833a2f0775ed407a94b8924ce50adb63 P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Connected to new peer: Peer: permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:04:19.410410 19406 raft_consensus.cc:1275] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P e5256d91808b47c195bc9b4dbd7f2b87 [term 1 FOLLOWER]: Refusing update from remote peer 0473d2b2d01f4459b1e90fd12cc7840e: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:04:19.414693 20112 raft_consensus.cc:2955] T 65d8cb8d6ec64f459d5a47cefab10acf P 127766fc592545a4997f7790f50f6076 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } } }
I20260709 13:04:19.408814 20151 raft_consensus.cc:2955] T 65d8cb8d6ec64f459d5a47cefab10acf P e61c3a8f61bb48f8a963c9480e53c168 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } } }
I20260709 13:04:19.423519 19407 raft_consensus.cc:2955] T 65d8cb8d6ec64f459d5a47cefab10acf P e5256d91808b47c195bc9b4dbd7f2b87 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } } }
I20260709 13:04:19.428480 19954 raft_consensus.cc:2955] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P 0473d2b2d01f4459b1e90fd12cc7840e [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } } }
I20260709 13:04:19.437559 19482 consensus_queue.cc:237] T 48824d5acfbc485ebf8c2d944e7202de P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:04:19.438017 20198 consensus_queue.cc:1048] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:04:19.440986 20111 raft_consensus.cc:2955] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P 127766fc592545a4997f7790f50f6076 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } } }
I20260709 13:04:19.446101 19558 raft_consensus.cc:1275] T 48824d5acfbc485ebf8c2d944e7202de P e61c3a8f61bb48f8a963c9480e53c168 [term 1 FOLLOWER]: Refusing update from remote peer 0473d2b2d01f4459b1e90fd12cc7840e: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:04:19.447649 20198 consensus_queue.cc:1048] T 48824d5acfbc485ebf8c2d944e7202de P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:04:19.449170 20110 raft_consensus.cc:1275] T 48824d5acfbc485ebf8c2d944e7202de P 127766fc592545a4997f7790f50f6076 [term 1 FOLLOWER]: Refusing update from remote peer 0473d2b2d01f4459b1e90fd12cc7840e: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:04:19.450929 19296 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 36f6ba92b9ba46babe4ebd6c02e5fbd9 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:04:19.459290 20192 consensus_queue.cc:1048] T 48824d5acfbc485ebf8c2d944e7202de P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Connected to new peer: Peer: permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:04:19.462600 19294 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 65d8cb8d6ec64f459d5a47cefab10acf with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:04:19.463192 19556 raft_consensus.cc:2955] T 48824d5acfbc485ebf8c2d944e7202de P e61c3a8f61bb48f8a963c9480e53c168 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } } }
I20260709 13:04:19.464079 19407 raft_consensus.cc:2955] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P e5256d91808b47c195bc9b4dbd7f2b87 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } } }
I20260709 13:04:19.478221 19309 catalog_manager.cc:5697] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P 0473d2b2d01f4459b1e90fd12cc7840e reported cstate change: config changed from index 3 to 4, VOTER e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3) evicted. New cstate: current_term: 1 leader_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:04:19.461606 20198 raft_consensus.cc:2955] T 48824d5acfbc485ebf8c2d944e7202de P 0473d2b2d01f4459b1e90fd12cc7840e [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } } }
I20260709 13:04:19.474426 19306 catalog_manager.cc:5697] T 65d8cb8d6ec64f459d5a47cefab10acf P 127766fc592545a4997f7790f50f6076 reported cstate change: config changed from index 3 to 4, VOTER 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2) evicted. New cstate: current_term: 1 leader_uuid: "e61c3a8f61bb48f8a963c9480e53c168" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } } }
I20260709 13:04:19.501859 19547 tablet_service.cc:1558] Processing DeleteTablet for tablet 36f6ba92b9ba46babe4ebd6c02e5fbd9 with delete_type TABLET_DATA_TOMBSTONED (TS e61c3a8f61bb48f8a963c9480e53c168 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:40412
I20260709 13:04:19.524623 19296 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 48824d5acfbc485ebf8c2d944e7202de with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:04:19.529528 19468 tablet_service.cc:1558] Processing DeleteTablet for tablet 65d8cb8d6ec64f459d5a47cefab10acf with delete_type TABLET_DATA_TOMBSTONED (TS 0473d2b2d01f4459b1e90fd12cc7840e not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:58272
I20260709 13:04:19.538017 19309 catalog_manager.cc:5697] T 48824d5acfbc485ebf8c2d944e7202de P 0473d2b2d01f4459b1e90fd12cc7840e reported cstate change: config changed from index 3 to 4, VOTER e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1) evicted. New cstate: current_term: 1 leader_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:19.544476 20065 raft_consensus.cc:2955] T 833a2f0775ed407a94b8924ce50adb63 P e61c3a8f61bb48f8a963c9480e53c168 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 127766fc592545a4997f7790f50f6076 (127.17.223.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } attrs { replace: true } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } } }
I20260709 13:04:19.555590 19484 raft_consensus.cc:2955] T 833a2f0775ed407a94b8924ce50adb63 P 0473d2b2d01f4459b1e90fd12cc7840e [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 127766fc592545a4997f7790f50f6076 (127.17.223.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } attrs { replace: true } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } } }
I20260709 13:04:19.571628 19401 tablet_service.cc:1558] Processing DeleteTablet for tablet 48824d5acfbc485ebf8c2d944e7202de with delete_type TABLET_DATA_TOMBSTONED (TS e5256d91808b47c195bc9b4dbd7f2b87 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:52318
I20260709 13:04:19.578037 19408 raft_consensus.cc:2955] T 833a2f0775ed407a94b8924ce50adb63 P e5256d91808b47c195bc9b4dbd7f2b87 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 127766fc592545a4997f7790f50f6076 (127.17.223.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } attrs { replace: true } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } } }
I20260709 13:04:19.571800 20112 raft_consensus.cc:2955] T 48824d5acfbc485ebf8c2d944e7202de P 127766fc592545a4997f7790f50f6076 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } } }
I20260709 13:04:19.601159 20217 tablet_replica.cc:333] T 65d8cb8d6ec64f459d5a47cefab10acf P 0473d2b2d01f4459b1e90fd12cc7840e: stopping tablet replica
I20260709 13:04:19.600277 19309 catalog_manager.cc:5697] T 833a2f0775ed407a94b8924ce50adb63 P 0473d2b2d01f4459b1e90fd12cc7840e reported cstate change: config changed from index 2 to 3, 127766fc592545a4997f7790f50f6076 (127.17.223.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "e61c3a8f61bb48f8a963c9480e53c168" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } attrs { replace: true } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } } }
I20260709 13:04:19.603866 20216 tablet_replica.cc:333] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P e61c3a8f61bb48f8a963c9480e53c168: stopping tablet replica
I20260709 13:04:19.610611 20111 raft_consensus.cc:2955] T 833a2f0775ed407a94b8924ce50adb63 P 127766fc592545a4997f7790f50f6076 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 127766fc592545a4997f7790f50f6076 (127.17.223.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } attrs { replace: true } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } } }
I20260709 13:04:19.617795 20216 raft_consensus.cc:2243] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P e61c3a8f61bb48f8a963c9480e53c168 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:19.618535 20216 raft_consensus.cc:2272] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P e61c3a8f61bb48f8a963c9480e53c168 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:19.620011 20217 raft_consensus.cc:2243] T 65d8cb8d6ec64f459d5a47cefab10acf P 0473d2b2d01f4459b1e90fd12cc7840e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:19.629280 20216 ts_tablet_manager.cc:1916] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P e61c3a8f61bb48f8a963c9480e53c168: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:04:19.628262 20217 raft_consensus.cc:2272] T 65d8cb8d6ec64f459d5a47cefab10acf P 0473d2b2d01f4459b1e90fd12cc7840e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:19.633044 20218 tablet_replica.cc:333] T 48824d5acfbc485ebf8c2d944e7202de P e5256d91808b47c195bc9b4dbd7f2b87: stopping tablet replica
I20260709 13:04:19.643784 20218 raft_consensus.cc:2243] T 48824d5acfbc485ebf8c2d944e7202de P e5256d91808b47c195bc9b4dbd7f2b87 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:19.654548 20218 raft_consensus.cc:2272] T 48824d5acfbc485ebf8c2d944e7202de P e5256d91808b47c195bc9b4dbd7f2b87 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:19.652393 20216 ts_tablet_manager.cc:1929] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P e61c3a8f61bb48f8a963c9480e53c168: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:04:19.662358 20216 log.cc:1199] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P e61c3a8f61bb48f8a963c9480e53c168: Deleting WAL directory at /tmp/dist-test-taskKd2k48/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602220613947-18300-0/minicluster-data/ts-2-root/wals/36f6ba92b9ba46babe4ebd6c02e5fbd9
I20260709 13:04:19.649322 20217 ts_tablet_manager.cc:1916] T 65d8cb8d6ec64f459d5a47cefab10acf P 0473d2b2d01f4459b1e90fd12cc7840e: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:04:19.664220 19294 catalog_manager.cc:5028] TS e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891): tablet 36f6ba92b9ba46babe4ebd6c02e5fbd9 (table test-workload [id=ce1025c73cf04c4baf25820ae7ff0a53]) successfully deleted
I20260709 13:04:19.671584 19556 consensus_queue.cc:237] T 833a2f0775ed407a94b8924ce50adb63 P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:04:19.674551 20218 ts_tablet_manager.cc:1916] T 48824d5acfbc485ebf8c2d944e7202de P e5256d91808b47c195bc9b4dbd7f2b87: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:04:19.677341 20217 ts_tablet_manager.cc:1929] T 65d8cb8d6ec64f459d5a47cefab10acf P 0473d2b2d01f4459b1e90fd12cc7840e: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:04:19.677857 20217 log.cc:1199] T 65d8cb8d6ec64f459d5a47cefab10acf P 0473d2b2d01f4459b1e90fd12cc7840e: Deleting WAL directory at /tmp/dist-test-taskKd2k48/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602220613947-18300-0/minicluster-data/ts-1-root/wals/65d8cb8d6ec64f459d5a47cefab10acf
I20260709 13:04:19.679625 19296 catalog_manager.cc:5028] TS 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257): tablet 65d8cb8d6ec64f459d5a47cefab10acf (table test-workload [id=ce1025c73cf04c4baf25820ae7ff0a53]) successfully deleted
I20260709 13:04:19.681696 20112 raft_consensus.cc:1275] T 833a2f0775ed407a94b8924ce50adb63 P 127766fc592545a4997f7790f50f6076 [term 1 FOLLOWER]: Refusing update from remote peer e61c3a8f61bb48f8a963c9480e53c168: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:04:19.682544 19407 raft_consensus.cc:1275] T 833a2f0775ed407a94b8924ce50adb63 P e5256d91808b47c195bc9b4dbd7f2b87 [term 1 FOLLOWER]: Refusing update from remote peer e61c3a8f61bb48f8a963c9480e53c168: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:04:19.683343 20065 consensus_queue.cc:1048] T 833a2f0775ed407a94b8924ce50adb63 P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Connected to new peer: Peer: permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:04:19.684147 20197 consensus_queue.cc:1048] T 833a2f0775ed407a94b8924ce50adb63 P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:04:19.691654 20218 ts_tablet_manager.cc:1929] T 48824d5acfbc485ebf8c2d944e7202de P e5256d91808b47c195bc9b4dbd7f2b87: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:04:19.692154 20218 log.cc:1199] T 48824d5acfbc485ebf8c2d944e7202de P e5256d91808b47c195bc9b4dbd7f2b87: Deleting WAL directory at /tmp/dist-test-taskKd2k48/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602220613947-18300-0/minicluster-data/ts-0-root/wals/48824d5acfbc485ebf8c2d944e7202de
I20260709 13:04:19.694137 19293 catalog_manager.cc:5028] TS e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321): tablet 48824d5acfbc485ebf8c2d944e7202de (table test-workload [id=ce1025c73cf04c4baf25820ae7ff0a53]) successfully deleted
I20260709 13:04:19.697876 20197 raft_consensus.cc:2955] T 833a2f0775ed407a94b8924ce50adb63 P e61c3a8f61bb48f8a963c9480e53c168 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } } }
I20260709 13:04:19.701205 19407 raft_consensus.cc:2955] T 833a2f0775ed407a94b8924ce50adb63 P e5256d91808b47c195bc9b4dbd7f2b87 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } } }
I20260709 13:04:19.703831 20112 raft_consensus.cc:2955] T 833a2f0775ed407a94b8924ce50adb63 P 127766fc592545a4997f7790f50f6076 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } } }
I20260709 13:04:19.721524 19309 catalog_manager.cc:5697] T 833a2f0775ed407a94b8924ce50adb63 P e5256d91808b47c195bc9b4dbd7f2b87 reported cstate change: config changed from index 3 to 4, VOTER 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2) evicted. New cstate: current_term: 1 leader_uuid: "e61c3a8f61bb48f8a963c9480e53c168" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } } }
I20260709 13:04:19.727777 19294 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 833a2f0775ed407a94b8924ce50adb63 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:04:19.738633 19468 tablet_service.cc:1558] Processing DeleteTablet for tablet 833a2f0775ed407a94b8924ce50adb63 with delete_type TABLET_DATA_TOMBSTONED (TS 0473d2b2d01f4459b1e90fd12cc7840e not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:58272
I20260709 13:04:19.739586 20217 tablet_replica.cc:333] T 833a2f0775ed407a94b8924ce50adb63 P 0473d2b2d01f4459b1e90fd12cc7840e: stopping tablet replica
I20260709 13:04:19.740540 20217 raft_consensus.cc:2243] T 833a2f0775ed407a94b8924ce50adb63 P 0473d2b2d01f4459b1e90fd12cc7840e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:19.741160 20217 raft_consensus.cc:2272] T 833a2f0775ed407a94b8924ce50adb63 P 0473d2b2d01f4459b1e90fd12cc7840e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:19.743885 20217 ts_tablet_manager.cc:1916] T 833a2f0775ed407a94b8924ce50adb63 P 0473d2b2d01f4459b1e90fd12cc7840e: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:04:19.754894 20217 ts_tablet_manager.cc:1929] T 833a2f0775ed407a94b8924ce50adb63 P 0473d2b2d01f4459b1e90fd12cc7840e: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:04:19.755259 20217 log.cc:1199] T 833a2f0775ed407a94b8924ce50adb63 P 0473d2b2d01f4459b1e90fd12cc7840e: Deleting WAL directory at /tmp/dist-test-taskKd2k48/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602220613947-18300-0/minicluster-data/ts-1-root/wals/833a2f0775ed407a94b8924ce50adb63
I20260709 13:04:19.757050 19296 catalog_manager.cc:5028] TS 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257): tablet 833a2f0775ed407a94b8924ce50adb63 (table test-workload [id=ce1025c73cf04c4baf25820ae7ff0a53]) successfully deleted
I20260709 13:04:20.797888 19558 consensus_queue.cc:237] T 0e1085d23e8347fbbd5bce7542f4b1f4 P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } attrs { replace: true } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: NON_VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: true } }
I20260709 13:04:20.804733 19407 raft_consensus.cc:1275] T 0e1085d23e8347fbbd5bce7542f4b1f4 P e5256d91808b47c195bc9b4dbd7f2b87 [term 1 FOLLOWER]: Refusing update from remote peer e61c3a8f61bb48f8a963c9480e53c168: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:04:20.804746 19484 raft_consensus.cc:1275] T 0e1085d23e8347fbbd5bce7542f4b1f4 P 0473d2b2d01f4459b1e90fd12cc7840e [term 1 FOLLOWER]: Refusing update from remote peer e61c3a8f61bb48f8a963c9480e53c168: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 13:04:20.804988 19523 consensus_peers.cc:597] T 0e1085d23e8347fbbd5bce7542f4b1f4 P e61c3a8f61bb48f8a963c9480e53c168 -> Peer 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121): Couldn't send request to peer 127766fc592545a4997f7790f50f6076. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 0e1085d23e8347fbbd5bce7542f4b1f4. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:20.806138 20221 consensus_queue.cc:1048] T 0e1085d23e8347fbbd5bce7542f4b1f4 P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:04:20.806960 20183 consensus_queue.cc:1048] T 0e1085d23e8347fbbd5bce7542f4b1f4 P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:04:20.814374 20221 raft_consensus.cc:2955] T 0e1085d23e8347fbbd5bce7542f4b1f4 P e61c3a8f61bb48f8a963c9480e53c168 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 127766fc592545a4997f7790f50f6076 (127.17.223.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } attrs { replace: true } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: NON_VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: true } } }
I20260709 13:04:20.816068 19484 raft_consensus.cc:2955] T 0e1085d23e8347fbbd5bce7542f4b1f4 P 0473d2b2d01f4459b1e90fd12cc7840e [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 127766fc592545a4997f7790f50f6076 (127.17.223.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } attrs { replace: true } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: NON_VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: true } } }
I20260709 13:04:20.817950 19406 raft_consensus.cc:2955] T 0e1085d23e8347fbbd5bce7542f4b1f4 P e5256d91808b47c195bc9b4dbd7f2b87 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 127766fc592545a4997f7790f50f6076 (127.17.223.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } attrs { replace: true } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: NON_VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: true } } }
I20260709 13:04:20.829583 19482 consensus_queue.cc:237] T 9962423cb4e54fcfa5de01daf68a86e7 P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } attrs { replace: true } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: NON_VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: true } }
I20260709 13:04:20.836455 19306 catalog_manager.cc:5697] T 0e1085d23e8347fbbd5bce7542f4b1f4 P e61c3a8f61bb48f8a963c9480e53c168 reported cstate change: config changed from index -1 to 2, NON_VOTER 127766fc592545a4997f7790f50f6076 (127.17.223.4) added. New cstate: current_term: 1 leader_uuid: "e61c3a8f61bb48f8a963c9480e53c168" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: NON_VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:20.839329 19558 raft_consensus.cc:1275] T 9962423cb4e54fcfa5de01daf68a86e7 P e61c3a8f61bb48f8a963c9480e53c168 [term 1 FOLLOWER]: Refusing update from remote peer 0473d2b2d01f4459b1e90fd12cc7840e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:04:20.842878 19407 raft_consensus.cc:1275] T 9962423cb4e54fcfa5de01daf68a86e7 P e5256d91808b47c195bc9b4dbd7f2b87 [term 1 FOLLOWER]: Refusing update from remote peer 0473d2b2d01f4459b1e90fd12cc7840e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:04:20.843837 20155 consensus_queue.cc:1048] T 9962423cb4e54fcfa5de01daf68a86e7 P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:04:20.845217 19449 consensus_peers.cc:597] T 9962423cb4e54fcfa5de01daf68a86e7 P 0473d2b2d01f4459b1e90fd12cc7840e -> Peer 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121): Couldn't send request to peer 127766fc592545a4997f7790f50f6076. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 9962423cb4e54fcfa5de01daf68a86e7. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:20.845410 20155 consensus_queue.cc:1048] T 9962423cb4e54fcfa5de01daf68a86e7 P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:04:20.854969 19954 raft_consensus.cc:2955] T 9962423cb4e54fcfa5de01daf68a86e7 P 0473d2b2d01f4459b1e90fd12cc7840e [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 127766fc592545a4997f7790f50f6076 (127.17.223.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } attrs { replace: true } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: NON_VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: true } } }
I20260709 13:04:20.856448 19407 raft_consensus.cc:2955] T 9962423cb4e54fcfa5de01daf68a86e7 P e5256d91808b47c195bc9b4dbd7f2b87 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 127766fc592545a4997f7790f50f6076 (127.17.223.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } attrs { replace: true } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: NON_VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: true } } }
I20260709 13:04:20.872841 19558 raft_consensus.cc:2955] T 9962423cb4e54fcfa5de01daf68a86e7 P e61c3a8f61bb48f8a963c9480e53c168 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 127766fc592545a4997f7790f50f6076 (127.17.223.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } attrs { replace: true } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: NON_VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: true } } }
I20260709 13:04:20.893334 19558 consensus_queue.cc:237] T 85c494af21f9457a85da47b9bc70c1fd P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } attrs { replace: true } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: NON_VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: true } }
W20260709 13:04:20.916886 19523 consensus_peers.cc:597] T 85c494af21f9457a85da47b9bc70c1fd P e61c3a8f61bb48f8a963c9480e53c168 -> Peer 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121): Couldn't send request to peer 127766fc592545a4997f7790f50f6076. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 85c494af21f9457a85da47b9bc70c1fd. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:20.917083 19407 raft_consensus.cc:1275] T 85c494af21f9457a85da47b9bc70c1fd P e5256d91808b47c195bc9b4dbd7f2b87 [term 1 FOLLOWER]: Refusing update from remote peer e61c3a8f61bb48f8a963c9480e53c168: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:04:20.918337 20221 consensus_queue.cc:1048] T 85c494af21f9457a85da47b9bc70c1fd P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:04:20.924817 19482 raft_consensus.cc:1275] T 85c494af21f9457a85da47b9bc70c1fd P 0473d2b2d01f4459b1e90fd12cc7840e [term 1 FOLLOWER]: Refusing update from remote peer e61c3a8f61bb48f8a963c9480e53c168: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:04:20.926945 20224 consensus_queue.cc:1048] T 85c494af21f9457a85da47b9bc70c1fd P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:04:20.936048 19306 catalog_manager.cc:5697] T 9962423cb4e54fcfa5de01daf68a86e7 P e5256d91808b47c195bc9b4dbd7f2b87 reported cstate change: config changed from index -1 to 2, NON_VOTER 127766fc592545a4997f7790f50f6076 (127.17.223.4) added. New cstate: current_term: 1 leader_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } attrs { replace: true } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: NON_VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: true } } }
I20260709 13:04:20.945073 20183 raft_consensus.cc:2955] T 85c494af21f9457a85da47b9bc70c1fd P e61c3a8f61bb48f8a963c9480e53c168 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 127766fc592545a4997f7790f50f6076 (127.17.223.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } attrs { replace: true } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: NON_VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: true } } }
I20260709 13:04:20.946514 19407 raft_consensus.cc:2955] T 85c494af21f9457a85da47b9bc70c1fd P e5256d91808b47c195bc9b4dbd7f2b87 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 127766fc592545a4997f7790f50f6076 (127.17.223.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } attrs { replace: true } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: NON_VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: true } } }
I20260709 13:04:20.962430 19483 raft_consensus.cc:2955] T 85c494af21f9457a85da47b9bc70c1fd P 0473d2b2d01f4459b1e90fd12cc7840e [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 127766fc592545a4997f7790f50f6076 (127.17.223.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } attrs { replace: true } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: NON_VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: true } } }
I20260709 13:04:20.966296 19484 consensus_queue.cc:237] T 62c6c134d3d24a1ab144dd9ee6bc3f64 P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } attrs { replace: true } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: NON_VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: true } }
I20260709 13:04:20.976207 19558 raft_consensus.cc:1275] T 62c6c134d3d24a1ab144dd9ee6bc3f64 P e61c3a8f61bb48f8a963c9480e53c168 [term 1 FOLLOWER]: Refusing update from remote peer 0473d2b2d01f4459b1e90fd12cc7840e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 13:04:20.977612 19449 consensus_peers.cc:597] T 62c6c134d3d24a1ab144dd9ee6bc3f64 P 0473d2b2d01f4459b1e90fd12cc7840e -> Peer 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121): Couldn't send request to peer 127766fc592545a4997f7790f50f6076. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 62c6c134d3d24a1ab144dd9ee6bc3f64. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:20.977875 20233 consensus_queue.cc:1048] T 62c6c134d3d24a1ab144dd9ee6bc3f64 P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:04:20.979409 19407 raft_consensus.cc:1275] T 62c6c134d3d24a1ab144dd9ee6bc3f64 P e5256d91808b47c195bc9b4dbd7f2b87 [term 1 FOLLOWER]: Refusing update from remote peer 0473d2b2d01f4459b1e90fd12cc7840e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:04:20.978583 19308 catalog_manager.cc:5697] T 85c494af21f9457a85da47b9bc70c1fd P e61c3a8f61bb48f8a963c9480e53c168 reported cstate change: config changed from index -1 to 2, NON_VOTER 127766fc592545a4997f7790f50f6076 (127.17.223.4) added. New cstate: current_term: 1 leader_uuid: "e61c3a8f61bb48f8a963c9480e53c168" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: NON_VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:20.980640 20234 consensus_queue.cc:1048] T 62c6c134d3d24a1ab144dd9ee6bc3f64 P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:04:21.006704 20235 raft_consensus.cc:2955] T 62c6c134d3d24a1ab144dd9ee6bc3f64 P 0473d2b2d01f4459b1e90fd12cc7840e [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 127766fc592545a4997f7790f50f6076 (127.17.223.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } attrs { replace: true } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: NON_VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: true } } }
I20260709 13:04:21.009425 19406 raft_consensus.cc:2955] T 62c6c134d3d24a1ab144dd9ee6bc3f64 P e5256d91808b47c195bc9b4dbd7f2b87 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 127766fc592545a4997f7790f50f6076 (127.17.223.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } attrs { replace: true } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: NON_VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: true } } }
I20260709 13:04:21.011566 19558 raft_consensus.cc:2955] T 62c6c134d3d24a1ab144dd9ee6bc3f64 P e61c3a8f61bb48f8a963c9480e53c168 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 127766fc592545a4997f7790f50f6076 (127.17.223.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } attrs { replace: true } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: NON_VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: true } } }
I20260709 13:04:21.033808 19309 catalog_manager.cc:5697] T 62c6c134d3d24a1ab144dd9ee6bc3f64 P 0473d2b2d01f4459b1e90fd12cc7840e reported cstate change: config changed from index -1 to 2, NON_VOTER 127766fc592545a4997f7790f50f6076 (127.17.223.4) added. New cstate: current_term: 1 leader_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: NON_VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:21.381438 20246 ts_tablet_manager.cc:933] T 9962423cb4e54fcfa5de01daf68a86e7 P 127766fc592545a4997f7790f50f6076: Initiating tablet copy from peer 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:04:21.391665 20246 tablet_copy_client.cc:323] T 9962423cb4e54fcfa5de01daf68a86e7 P 127766fc592545a4997f7790f50f6076: tablet copy: Beginning tablet copy session from remote peer at address 127.17.223.2:46257
I20260709 13:04:21.396974 19496 tablet_copy_service.cc:140] P 0473d2b2d01f4459b1e90fd12cc7840e: Received BeginTabletCopySession request for tablet 9962423cb4e54fcfa5de01daf68a86e7 from peer 127766fc592545a4997f7790f50f6076 ({username='slave'} at 127.0.0.1:39478)
I20260709 13:04:21.397728 19496 tablet_copy_service.cc:161] P 0473d2b2d01f4459b1e90fd12cc7840e: Beginning new tablet copy session on tablet 9962423cb4e54fcfa5de01daf68a86e7 from peer 127766fc592545a4997f7790f50f6076 at {username='slave'} at 127.0.0.1:39478: session id = 127766fc592545a4997f7790f50f6076-9962423cb4e54fcfa5de01daf68a86e7
I20260709 13:04:21.411794 20248 ts_tablet_manager.cc:933] T 0e1085d23e8347fbbd5bce7542f4b1f4 P 127766fc592545a4997f7790f50f6076: Initiating tablet copy from peer e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:04:21.420513 19496 tablet_copy_source_session.cc:215] T 9962423cb4e54fcfa5de01daf68a86e7 P 0473d2b2d01f4459b1e90fd12cc7840e: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:04:21.435081 20248 tablet_copy_client.cc:323] T 0e1085d23e8347fbbd5bce7542f4b1f4 P 127766fc592545a4997f7790f50f6076: tablet copy: Beginning tablet copy session from remote peer at address 127.17.223.3:36891
I20260709 13:04:21.437201 20246 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9962423cb4e54fcfa5de01daf68a86e7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:21.439754 19570 tablet_copy_service.cc:140] P e61c3a8f61bb48f8a963c9480e53c168: Received BeginTabletCopySession request for tablet 0e1085d23e8347fbbd5bce7542f4b1f4 from peer 127766fc592545a4997f7790f50f6076 ({username='slave'} at 127.0.0.1:41504)
I20260709 13:04:21.440361 19570 tablet_copy_service.cc:161] P e61c3a8f61bb48f8a963c9480e53c168: Beginning new tablet copy session on tablet 0e1085d23e8347fbbd5bce7542f4b1f4 from peer 127766fc592545a4997f7790f50f6076 at {username='slave'} at 127.0.0.1:41504: session id = 127766fc592545a4997f7790f50f6076-0e1085d23e8347fbbd5bce7542f4b1f4
I20260709 13:04:21.451992 19570 tablet_copy_source_session.cc:215] T 0e1085d23e8347fbbd5bce7542f4b1f4 P e61c3a8f61bb48f8a963c9480e53c168: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:04:21.458737 20248 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0e1085d23e8347fbbd5bce7542f4b1f4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:21.459246 20246 tablet_copy_client.cc:806] T 9962423cb4e54fcfa5de01daf68a86e7 P 127766fc592545a4997f7790f50f6076: tablet copy: Starting download of 0 data blocks...
I20260709 13:04:21.464093 20246 tablet_copy_client.cc:670] T 9962423cb4e54fcfa5de01daf68a86e7 P 127766fc592545a4997f7790f50f6076: tablet copy: Starting download of 1 WAL segments...
I20260709 13:04:21.469929 20246 tablet_copy_client.cc:538] T 9962423cb4e54fcfa5de01daf68a86e7 P 127766fc592545a4997f7790f50f6076: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:04:21.477031 20246 tablet_bootstrap.cc:492] T 9962423cb4e54fcfa5de01daf68a86e7 P 127766fc592545a4997f7790f50f6076: Bootstrap starting.
I20260709 13:04:21.482297 20248 tablet_copy_client.cc:806] T 0e1085d23e8347fbbd5bce7542f4b1f4 P 127766fc592545a4997f7790f50f6076: tablet copy: Starting download of 0 data blocks...
I20260709 13:04:21.482975 20248 tablet_copy_client.cc:670] T 0e1085d23e8347fbbd5bce7542f4b1f4 P 127766fc592545a4997f7790f50f6076: tablet copy: Starting download of 1 WAL segments...
I20260709 13:04:21.491487 20248 tablet_copy_client.cc:538] T 0e1085d23e8347fbbd5bce7542f4b1f4 P 127766fc592545a4997f7790f50f6076: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:04:21.498956 20246 tablet_bootstrap.cc:492] T 9962423cb4e54fcfa5de01daf68a86e7 P 127766fc592545a4997f7790f50f6076: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:04:21.500083 20246 tablet_bootstrap.cc:492] T 9962423cb4e54fcfa5de01daf68a86e7 P 127766fc592545a4997f7790f50f6076: Bootstrap complete.
I20260709 13:04:21.500551 20248 tablet_bootstrap.cc:492] T 0e1085d23e8347fbbd5bce7542f4b1f4 P 127766fc592545a4997f7790f50f6076: Bootstrap starting.
I20260709 13:04:21.500874 20246 ts_tablet_manager.cc:1403] T 9962423cb4e54fcfa5de01daf68a86e7 P 127766fc592545a4997f7790f50f6076: Time spent bootstrapping tablet: real 0.024s	user 0.024s	sys 0.001s
I20260709 13:04:21.505398 20246 raft_consensus.cc:359] T 9962423cb4e54fcfa5de01daf68a86e7 P 127766fc592545a4997f7790f50f6076 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } attrs { replace: true } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: NON_VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: true } }
I20260709 13:04:21.507222 20246 raft_consensus.cc:740] T 9962423cb4e54fcfa5de01daf68a86e7 P 127766fc592545a4997f7790f50f6076 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 127766fc592545a4997f7790f50f6076, State: Initialized, Role: LEARNER
I20260709 13:04:21.508072 20246 consensus_queue.cc:260] T 9962423cb4e54fcfa5de01daf68a86e7 P 127766fc592545a4997f7790f50f6076 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } attrs { replace: true } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: NON_VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: true } }
I20260709 13:04:21.512756 20251 ts_tablet_manager.cc:933] T 85c494af21f9457a85da47b9bc70c1fd P 127766fc592545a4997f7790f50f6076: Initiating tablet copy from peer e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:04:21.522866 20251 tablet_copy_client.cc:323] T 85c494af21f9457a85da47b9bc70c1fd P 127766fc592545a4997f7790f50f6076: tablet copy: Beginning tablet copy session from remote peer at address 127.17.223.3:36891
I20260709 13:04:21.524610 19570 tablet_copy_service.cc:140] P e61c3a8f61bb48f8a963c9480e53c168: Received BeginTabletCopySession request for tablet 85c494af21f9457a85da47b9bc70c1fd from peer 127766fc592545a4997f7790f50f6076 ({username='slave'} at 127.0.0.1:41504)
I20260709 13:04:21.525151 19570 tablet_copy_service.cc:161] P e61c3a8f61bb48f8a963c9480e53c168: Beginning new tablet copy session on tablet 85c494af21f9457a85da47b9bc70c1fd from peer 127766fc592545a4997f7790f50f6076 at {username='slave'} at 127.0.0.1:41504: session id = 127766fc592545a4997f7790f50f6076-85c494af21f9457a85da47b9bc70c1fd
I20260709 13:04:21.537135 19570 tablet_copy_source_session.cc:215] T 85c494af21f9457a85da47b9bc70c1fd P e61c3a8f61bb48f8a963c9480e53c168: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:04:21.540635 20251 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 85c494af21f9457a85da47b9bc70c1fd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:21.555327 20255 ts_tablet_manager.cc:933] T 62c6c134d3d24a1ab144dd9ee6bc3f64 P 127766fc592545a4997f7790f50f6076: Initiating tablet copy from peer 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:04:21.556597 20246 ts_tablet_manager.cc:1434] T 9962423cb4e54fcfa5de01daf68a86e7 P 127766fc592545a4997f7790f50f6076: Time spent starting tablet: real 0.055s	user 0.014s	sys 0.014s
I20260709 13:04:21.564188 20248 tablet_bootstrap.cc:492] T 0e1085d23e8347fbbd5bce7542f4b1f4 P 127766fc592545a4997f7790f50f6076: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:04:21.565292 20248 tablet_bootstrap.cc:492] T 0e1085d23e8347fbbd5bce7542f4b1f4 P 127766fc592545a4997f7790f50f6076: Bootstrap complete.
I20260709 13:04:21.566048 20248 ts_tablet_manager.cc:1403] T 0e1085d23e8347fbbd5bce7542f4b1f4 P 127766fc592545a4997f7790f50f6076: Time spent bootstrapping tablet: real 0.066s	user 0.014s	sys 0.011s
I20260709 13:04:21.566587 19496 tablet_copy_service.cc:342] P 0473d2b2d01f4459b1e90fd12cc7840e: Request end of tablet copy session 127766fc592545a4997f7790f50f6076-9962423cb4e54fcfa5de01daf68a86e7 received from {username='slave'} at 127.0.0.1:39478
I20260709 13:04:21.567940 19496 tablet_copy_service.cc:434] P 0473d2b2d01f4459b1e90fd12cc7840e: ending tablet copy session 127766fc592545a4997f7790f50f6076-9962423cb4e54fcfa5de01daf68a86e7 on tablet 9962423cb4e54fcfa5de01daf68a86e7 with peer 127766fc592545a4997f7790f50f6076
I20260709 13:04:21.575729 20248 raft_consensus.cc:359] T 0e1085d23e8347fbbd5bce7542f4b1f4 P 127766fc592545a4997f7790f50f6076 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } attrs { replace: true } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: NON_VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: true } }
I20260709 13:04:21.576625 20248 raft_consensus.cc:740] T 0e1085d23e8347fbbd5bce7542f4b1f4 P 127766fc592545a4997f7790f50f6076 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 127766fc592545a4997f7790f50f6076, State: Initialized, Role: LEARNER
I20260709 13:04:21.577245 20248 consensus_queue.cc:260] T 0e1085d23e8347fbbd5bce7542f4b1f4 P 127766fc592545a4997f7790f50f6076 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } attrs { replace: true } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: NON_VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: true } }
I20260709 13:04:21.583173 20251 tablet_copy_client.cc:806] T 85c494af21f9457a85da47b9bc70c1fd P 127766fc592545a4997f7790f50f6076: tablet copy: Starting download of 0 data blocks...
I20260709 13:04:21.583727 20251 tablet_copy_client.cc:670] T 85c494af21f9457a85da47b9bc70c1fd P 127766fc592545a4997f7790f50f6076: tablet copy: Starting download of 1 WAL segments...
I20260709 13:04:21.584414 20255 tablet_copy_client.cc:323] T 62c6c134d3d24a1ab144dd9ee6bc3f64 P 127766fc592545a4997f7790f50f6076: tablet copy: Beginning tablet copy session from remote peer at address 127.17.223.2:46257
I20260709 13:04:21.586093 20248 ts_tablet_manager.cc:1434] T 0e1085d23e8347fbbd5bce7542f4b1f4 P 127766fc592545a4997f7790f50f6076: Time spent starting tablet: real 0.019s	user 0.000s	sys 0.006s
I20260709 13:04:21.586189 19496 tablet_copy_service.cc:140] P 0473d2b2d01f4459b1e90fd12cc7840e: Received BeginTabletCopySession request for tablet 62c6c134d3d24a1ab144dd9ee6bc3f64 from peer 127766fc592545a4997f7790f50f6076 ({username='slave'} at 127.0.0.1:39478)
I20260709 13:04:21.586839 19496 tablet_copy_service.cc:161] P 0473d2b2d01f4459b1e90fd12cc7840e: Beginning new tablet copy session on tablet 62c6c134d3d24a1ab144dd9ee6bc3f64 from peer 127766fc592545a4997f7790f50f6076 at {username='slave'} at 127.0.0.1:39478: session id = 127766fc592545a4997f7790f50f6076-62c6c134d3d24a1ab144dd9ee6bc3f64
I20260709 13:04:21.587997 19570 tablet_copy_service.cc:342] P e61c3a8f61bb48f8a963c9480e53c168: Request end of tablet copy session 127766fc592545a4997f7790f50f6076-0e1085d23e8347fbbd5bce7542f4b1f4 received from {username='slave'} at 127.0.0.1:41504
I20260709 13:04:21.588454 19570 tablet_copy_service.cc:434] P e61c3a8f61bb48f8a963c9480e53c168: ending tablet copy session 127766fc592545a4997f7790f50f6076-0e1085d23e8347fbbd5bce7542f4b1f4 on tablet 0e1085d23e8347fbbd5bce7542f4b1f4 with peer 127766fc592545a4997f7790f50f6076
I20260709 13:04:21.589577 20251 tablet_copy_client.cc:538] T 85c494af21f9457a85da47b9bc70c1fd P 127766fc592545a4997f7790f50f6076: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:04:21.598326 20251 tablet_bootstrap.cc:492] T 85c494af21f9457a85da47b9bc70c1fd P 127766fc592545a4997f7790f50f6076: Bootstrap starting.
I20260709 13:04:21.602840 19496 tablet_copy_source_session.cc:215] T 62c6c134d3d24a1ab144dd9ee6bc3f64 P 0473d2b2d01f4459b1e90fd12cc7840e: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:04:21.606088 20255 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 62c6c134d3d24a1ab144dd9ee6bc3f64. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:21.622380 20255 tablet_copy_client.cc:806] T 62c6c134d3d24a1ab144dd9ee6bc3f64 P 127766fc592545a4997f7790f50f6076: tablet copy: Starting download of 0 data blocks...
I20260709 13:04:21.622862 20255 tablet_copy_client.cc:670] T 62c6c134d3d24a1ab144dd9ee6bc3f64 P 127766fc592545a4997f7790f50f6076: tablet copy: Starting download of 1 WAL segments...
I20260709 13:04:21.626003 20255 tablet_copy_client.cc:538] T 62c6c134d3d24a1ab144dd9ee6bc3f64 P 127766fc592545a4997f7790f50f6076: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:04:21.626011 20251 tablet_bootstrap.cc:492] T 85c494af21f9457a85da47b9bc70c1fd P 127766fc592545a4997f7790f50f6076: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:04:21.627038 20251 tablet_bootstrap.cc:492] T 85c494af21f9457a85da47b9bc70c1fd P 127766fc592545a4997f7790f50f6076: Bootstrap complete.
I20260709 13:04:21.627702 20251 ts_tablet_manager.cc:1403] T 85c494af21f9457a85da47b9bc70c1fd P 127766fc592545a4997f7790f50f6076: Time spent bootstrapping tablet: real 0.030s	user 0.018s	sys 0.008s
I20260709 13:04:21.630703 20251 raft_consensus.cc:359] T 85c494af21f9457a85da47b9bc70c1fd P 127766fc592545a4997f7790f50f6076 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } attrs { replace: true } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: NON_VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: true } }
I20260709 13:04:21.631524 20251 raft_consensus.cc:740] T 85c494af21f9457a85da47b9bc70c1fd P 127766fc592545a4997f7790f50f6076 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 127766fc592545a4997f7790f50f6076, State: Initialized, Role: LEARNER
I20260709 13:04:21.632391 20255 tablet_bootstrap.cc:492] T 62c6c134d3d24a1ab144dd9ee6bc3f64 P 127766fc592545a4997f7790f50f6076: Bootstrap starting.
I20260709 13:04:21.632207 20251 consensus_queue.cc:260] T 85c494af21f9457a85da47b9bc70c1fd P 127766fc592545a4997f7790f50f6076 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } attrs { replace: true } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: NON_VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: true } }
I20260709 13:04:21.634855 20251 ts_tablet_manager.cc:1434] T 85c494af21f9457a85da47b9bc70c1fd P 127766fc592545a4997f7790f50f6076: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.001s
I20260709 13:04:21.636991 19570 tablet_copy_service.cc:342] P e61c3a8f61bb48f8a963c9480e53c168: Request end of tablet copy session 127766fc592545a4997f7790f50f6076-85c494af21f9457a85da47b9bc70c1fd received from {username='slave'} at 127.0.0.1:41504
I20260709 13:04:21.637400 19570 tablet_copy_service.cc:434] P e61c3a8f61bb48f8a963c9480e53c168: ending tablet copy session 127766fc592545a4997f7790f50f6076-85c494af21f9457a85da47b9bc70c1fd on tablet 85c494af21f9457a85da47b9bc70c1fd with peer 127766fc592545a4997f7790f50f6076
I20260709 13:04:21.657264 20255 tablet_bootstrap.cc:492] T 62c6c134d3d24a1ab144dd9ee6bc3f64 P 127766fc592545a4997f7790f50f6076: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:04:21.657974 20255 tablet_bootstrap.cc:492] T 62c6c134d3d24a1ab144dd9ee6bc3f64 P 127766fc592545a4997f7790f50f6076: Bootstrap complete.
I20260709 13:04:21.658578 20255 ts_tablet_manager.cc:1403] T 62c6c134d3d24a1ab144dd9ee6bc3f64 P 127766fc592545a4997f7790f50f6076: Time spent bootstrapping tablet: real 0.026s	user 0.013s	sys 0.007s
I20260709 13:04:21.661455 20255 raft_consensus.cc:359] T 62c6c134d3d24a1ab144dd9ee6bc3f64 P 127766fc592545a4997f7790f50f6076 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } attrs { replace: true } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: NON_VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: true } }
I20260709 13:04:21.662073 20255 raft_consensus.cc:740] T 62c6c134d3d24a1ab144dd9ee6bc3f64 P 127766fc592545a4997f7790f50f6076 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 127766fc592545a4997f7790f50f6076, State: Initialized, Role: LEARNER
I20260709 13:04:21.662847 20255 consensus_queue.cc:260] T 62c6c134d3d24a1ab144dd9ee6bc3f64 P 127766fc592545a4997f7790f50f6076 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } attrs { replace: true } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: NON_VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: true } }
I20260709 13:04:21.665201 20255 ts_tablet_manager.cc:1434] T 62c6c134d3d24a1ab144dd9ee6bc3f64 P 127766fc592545a4997f7790f50f6076: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 13:04:21.666812 19496 tablet_copy_service.cc:342] P 0473d2b2d01f4459b1e90fd12cc7840e: Request end of tablet copy session 127766fc592545a4997f7790f50f6076-62c6c134d3d24a1ab144dd9ee6bc3f64 received from {username='slave'} at 127.0.0.1:39478
I20260709 13:04:21.667235 19496 tablet_copy_service.cc:434] P 0473d2b2d01f4459b1e90fd12cc7840e: ending tablet copy session 127766fc592545a4997f7790f50f6076-62c6c134d3d24a1ab144dd9ee6bc3f64 on tablet 62c6c134d3d24a1ab144dd9ee6bc3f64 with peer 127766fc592545a4997f7790f50f6076
I20260709 13:04:21.892323 20112 raft_consensus.cc:1217] T 0e1085d23e8347fbbd5bce7542f4b1f4 P 127766fc592545a4997f7790f50f6076 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:04:22.005012 20112 raft_consensus.cc:1217] T 9962423cb4e54fcfa5de01daf68a86e7 P 127766fc592545a4997f7790f50f6076 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:04:22.106602 20112 raft_consensus.cc:1217] T 85c494af21f9457a85da47b9bc70c1fd P 127766fc592545a4997f7790f50f6076 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:04:22.125658 20112 raft_consensus.cc:1217] T 62c6c134d3d24a1ab144dd9ee6bc3f64 P 127766fc592545a4997f7790f50f6076 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:04:22.482163 20183 raft_consensus.cc:1064] T 0e1085d23e8347fbbd5bce7542f4b1f4 P e61c3a8f61bb48f8a963c9480e53c168: attempting to promote NON_VOTER 127766fc592545a4997f7790f50f6076 to VOTER
I20260709 13:04:22.484381 20183 consensus_queue.cc:237] T 0e1085d23e8347fbbd5bce7542f4b1f4 P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } attrs { replace: true } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:04:22.490207 19484 raft_consensus.cc:1275] T 0e1085d23e8347fbbd5bce7542f4b1f4 P 0473d2b2d01f4459b1e90fd12cc7840e [term 1 FOLLOWER]: Refusing update from remote peer e61c3a8f61bb48f8a963c9480e53c168: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:04:22.490365 20112 raft_consensus.cc:1275] T 0e1085d23e8347fbbd5bce7542f4b1f4 P 127766fc592545a4997f7790f50f6076 [term 1 LEARNER]: Refusing update from remote peer e61c3a8f61bb48f8a963c9480e53c168: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:04:22.491814 20183 consensus_queue.cc:1048] T 0e1085d23e8347fbbd5bce7542f4b1f4 P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Connected to new peer: Peer: permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:04:22.492326 19406 raft_consensus.cc:1275] T 0e1085d23e8347fbbd5bce7542f4b1f4 P e5256d91808b47c195bc9b4dbd7f2b87 [term 1 FOLLOWER]: Refusing update from remote peer e61c3a8f61bb48f8a963c9480e53c168: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:04:22.493227 20224 consensus_queue.cc:1048] T 0e1085d23e8347fbbd5bce7542f4b1f4 P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:04:22.494117 20183 consensus_queue.cc:1048] T 0e1085d23e8347fbbd5bce7542f4b1f4 P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:04:22.521900 20183 raft_consensus.cc:2955] T 0e1085d23e8347fbbd5bce7542f4b1f4 P e61c3a8f61bb48f8a963c9480e53c168 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 127766fc592545a4997f7790f50f6076 (127.17.223.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } attrs { replace: true } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } } }
I20260709 13:04:22.523681 19484 raft_consensus.cc:2955] T 0e1085d23e8347fbbd5bce7542f4b1f4 P 0473d2b2d01f4459b1e90fd12cc7840e [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 127766fc592545a4997f7790f50f6076 (127.17.223.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } attrs { replace: true } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } } }
I20260709 13:04:22.525128 19406 raft_consensus.cc:2955] T 0e1085d23e8347fbbd5bce7542f4b1f4 P e5256d91808b47c195bc9b4dbd7f2b87 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 127766fc592545a4997f7790f50f6076 (127.17.223.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } attrs { replace: true } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } } }
I20260709 13:04:22.535887 20111 raft_consensus.cc:2955] T 0e1085d23e8347fbbd5bce7542f4b1f4 P 127766fc592545a4997f7790f50f6076 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 127766fc592545a4997f7790f50f6076 (127.17.223.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } attrs { replace: true } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } } }
I20260709 13:04:22.537158 20234 raft_consensus.cc:1064] T 9962423cb4e54fcfa5de01daf68a86e7 P 0473d2b2d01f4459b1e90fd12cc7840e: attempting to promote NON_VOTER 127766fc592545a4997f7790f50f6076 to VOTER
I20260709 13:04:22.539526 20234 consensus_queue.cc:237] T 9962423cb4e54fcfa5de01daf68a86e7 P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } attrs { replace: true } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:04:22.549646 19309 catalog_manager.cc:5697] T 0e1085d23e8347fbbd5bce7542f4b1f4 P 0473d2b2d01f4459b1e90fd12cc7840e reported cstate change: config changed from index 2 to 3, 127766fc592545a4997f7790f50f6076 (127.17.223.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "e61c3a8f61bb48f8a963c9480e53c168" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } attrs { replace: true } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } } }
I20260709 13:04:22.574483 19559 raft_consensus.cc:1275] T 9962423cb4e54fcfa5de01daf68a86e7 P e61c3a8f61bb48f8a963c9480e53c168 [term 1 FOLLOWER]: Refusing update from remote peer 0473d2b2d01f4459b1e90fd12cc7840e: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:04:22.580953 20259 consensus_queue.cc:1048] T 9962423cb4e54fcfa5de01daf68a86e7 P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:04:22.591907 19408 raft_consensus.cc:1275] T 9962423cb4e54fcfa5de01daf68a86e7 P e5256d91808b47c195bc9b4dbd7f2b87 [term 1 FOLLOWER]: Refusing update from remote peer 0473d2b2d01f4459b1e90fd12cc7840e: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:04:22.593607 19954 consensus_queue.cc:1048] T 9962423cb4e54fcfa5de01daf68a86e7 P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:04:22.594120 20111 raft_consensus.cc:1275] T 9962423cb4e54fcfa5de01daf68a86e7 P 127766fc592545a4997f7790f50f6076 [term 1 LEARNER]: Refusing update from remote peer 0473d2b2d01f4459b1e90fd12cc7840e: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:04:22.596189 20259 consensus_queue.cc:1048] T 9962423cb4e54fcfa5de01daf68a86e7 P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Connected to new peer: Peer: permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:04:22.605580 20224 raft_consensus.cc:1064] T 85c494af21f9457a85da47b9bc70c1fd P e61c3a8f61bb48f8a963c9480e53c168: attempting to promote NON_VOTER 127766fc592545a4997f7790f50f6076 to VOTER
I20260709 13:04:22.609678 20224 consensus_queue.cc:237] T 85c494af21f9457a85da47b9bc70c1fd P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } attrs { replace: true } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:04:22.618554 19954 raft_consensus.cc:2955] T 9962423cb4e54fcfa5de01daf68a86e7 P 0473d2b2d01f4459b1e90fd12cc7840e [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 127766fc592545a4997f7790f50f6076 (127.17.223.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } attrs { replace: true } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } } }
I20260709 13:04:22.621361 19407 raft_consensus.cc:2955] T 9962423cb4e54fcfa5de01daf68a86e7 P e5256d91808b47c195bc9b4dbd7f2b87 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 127766fc592545a4997f7790f50f6076 (127.17.223.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } attrs { replace: true } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } } }
I20260709 13:04:22.624594 19484 raft_consensus.cc:1275] T 85c494af21f9457a85da47b9bc70c1fd P 0473d2b2d01f4459b1e90fd12cc7840e [term 1 FOLLOWER]: Refusing update from remote peer e61c3a8f61bb48f8a963c9480e53c168: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:04:22.626896 20183 consensus_queue.cc:1048] T 85c494af21f9457a85da47b9bc70c1fd P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:04:22.627609 20111 raft_consensus.cc:1275] T 85c494af21f9457a85da47b9bc70c1fd P 127766fc592545a4997f7790f50f6076 [term 1 LEARNER]: Refusing update from remote peer e61c3a8f61bb48f8a963c9480e53c168: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:04:22.630021 20183 consensus_queue.cc:1048] T 85c494af21f9457a85da47b9bc70c1fd P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Connected to new peer: Peer: permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:04:22.634400 19406 raft_consensus.cc:1275] T 85c494af21f9457a85da47b9bc70c1fd P e5256d91808b47c195bc9b4dbd7f2b87 [term 1 FOLLOWER]: Refusing update from remote peer e61c3a8f61bb48f8a963c9480e53c168: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:04:22.637248 20224 consensus_queue.cc:1048] T 85c494af21f9457a85da47b9bc70c1fd P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:04:22.649412 20112 raft_consensus.cc:2955] T 9962423cb4e54fcfa5de01daf68a86e7 P 127766fc592545a4997f7790f50f6076 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 127766fc592545a4997f7790f50f6076 (127.17.223.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } attrs { replace: true } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } } }
I20260709 13:04:22.687481 20221 raft_consensus.cc:2955] T 85c494af21f9457a85da47b9bc70c1fd P e61c3a8f61bb48f8a963c9480e53c168 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 127766fc592545a4997f7790f50f6076 (127.17.223.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } attrs { replace: true } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } } }
I20260709 13:04:22.695560 20111 raft_consensus.cc:2955] T 85c494af21f9457a85da47b9bc70c1fd P 127766fc592545a4997f7790f50f6076 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 127766fc592545a4997f7790f50f6076 (127.17.223.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } attrs { replace: true } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } } }
I20260709 13:04:22.692736 19559 raft_consensus.cc:2955] T 9962423cb4e54fcfa5de01daf68a86e7 P e61c3a8f61bb48f8a963c9480e53c168 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 127766fc592545a4997f7790f50f6076 (127.17.223.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } attrs { replace: true } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } } }
W20260709 13:04:22.759423 19450 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.3:36891, user_credentials={real_user=slave}} blocked reactor thread for 47597.2us
I20260709 13:04:22.785661 20277 raft_consensus.cc:1064] T 62c6c134d3d24a1ab144dd9ee6bc3f64 P 0473d2b2d01f4459b1e90fd12cc7840e: attempting to promote NON_VOTER 127766fc592545a4997f7790f50f6076 to VOTER
I20260709 13:04:22.788549 20277 consensus_queue.cc:237] T 62c6c134d3d24a1ab144dd9ee6bc3f64 P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } attrs { replace: true } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:04:22.815119 19407 raft_consensus.cc:2955] T 85c494af21f9457a85da47b9bc70c1fd P e5256d91808b47c195bc9b4dbd7f2b87 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 127766fc592545a4997f7790f50f6076 (127.17.223.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } attrs { replace: true } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } } }
I20260709 13:04:22.844645 19559 raft_consensus.cc:1275] T 62c6c134d3d24a1ab144dd9ee6bc3f64 P e61c3a8f61bb48f8a963c9480e53c168 [term 1 FOLLOWER]: Refusing update from remote peer 0473d2b2d01f4459b1e90fd12cc7840e: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:04:22.851660 19305 catalog_manager.cc:5697] T 9962423cb4e54fcfa5de01daf68a86e7 P 0473d2b2d01f4459b1e90fd12cc7840e reported cstate change: config changed from index 2 to 3, 127766fc592545a4997f7790f50f6076 (127.17.223.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:04:22.854108 20276 consensus_queue.cc:1048] T 62c6c134d3d24a1ab144dd9ee6bc3f64 P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:04:22.867720 19484 consensus_queue.cc:237] T 9962423cb4e54fcfa5de01daf68a86e7 P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:04:22.869325 19304 catalog_manager.cc:5697] T 85c494af21f9457a85da47b9bc70c1fd P 127766fc592545a4997f7790f50f6076 reported cstate change: config changed from index 2 to 3, 127766fc592545a4997f7790f50f6076 (127.17.223.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "e61c3a8f61bb48f8a963c9480e53c168" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } attrs { replace: true } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } } }
I20260709 13:04:22.872017 19557 consensus_queue.cc:237] T 0e1085d23e8347fbbd5bce7542f4b1f4 P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:04:22.881464 20111 raft_consensus.cc:1275] T 0e1085d23e8347fbbd5bce7542f4b1f4 P 127766fc592545a4997f7790f50f6076 [term 1 FOLLOWER]: Refusing update from remote peer e61c3a8f61bb48f8a963c9480e53c168: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:04:22.884922 20183 consensus_queue.cc:1048] T 0e1085d23e8347fbbd5bce7542f4b1f4 P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Connected to new peer: Peer: permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:04:22.890755 20112 raft_consensus.cc:1275] T 62c6c134d3d24a1ab144dd9ee6bc3f64 P 127766fc592545a4997f7790f50f6076 [term 1 LEARNER]: Refusing update from remote peer 0473d2b2d01f4459b1e90fd12cc7840e: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:04:22.893720 20110 raft_consensus.cc:1275] T 9962423cb4e54fcfa5de01daf68a86e7 P 127766fc592545a4997f7790f50f6076 [term 1 FOLLOWER]: Refusing update from remote peer 0473d2b2d01f4459b1e90fd12cc7840e: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:04:22.898299 19483 raft_consensus.cc:2955] T 85c494af21f9457a85da47b9bc70c1fd P 0473d2b2d01f4459b1e90fd12cc7840e [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 127766fc592545a4997f7790f50f6076 (127.17.223.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } attrs { replace: true } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } } }
I20260709 13:04:22.899689 19485 raft_consensus.cc:1275] T 0e1085d23e8347fbbd5bce7542f4b1f4 P 0473d2b2d01f4459b1e90fd12cc7840e [term 1 FOLLOWER]: Refusing update from remote peer e61c3a8f61bb48f8a963c9480e53c168: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:04:22.902607 20232 consensus_queue.cc:1048] T 62c6c134d3d24a1ab144dd9ee6bc3f64 P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Connected to new peer: Peer: permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:04:22.906810 20276 consensus_queue.cc:1048] T 9962423cb4e54fcfa5de01daf68a86e7 P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Connected to new peer: Peer: permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:04:22.911418 20221 consensus_queue.cc:1048] T 0e1085d23e8347fbbd5bce7542f4b1f4 P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:04:22.914732 19408 raft_consensus.cc:1275] T 62c6c134d3d24a1ab144dd9ee6bc3f64 P e5256d91808b47c195bc9b4dbd7f2b87 [term 1 FOLLOWER]: Refusing update from remote peer 0473d2b2d01f4459b1e90fd12cc7840e: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:04:22.927246 20221 raft_consensus.cc:2955] T 0e1085d23e8347fbbd5bce7542f4b1f4 P e61c3a8f61bb48f8a963c9480e53c168 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } } }
I20260709 13:04:22.928838 20232 consensus_queue.cc:1048] T 62c6c134d3d24a1ab144dd9ee6bc3f64 P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:04:22.936141 19406 raft_consensus.cc:1275] T 9962423cb4e54fcfa5de01daf68a86e7 P e5256d91808b47c195bc9b4dbd7f2b87 [term 1 FOLLOWER]: Refusing update from remote peer 0473d2b2d01f4459b1e90fd12cc7840e: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:04:22.939621 20111 raft_consensus.cc:2955] T 0e1085d23e8347fbbd5bce7542f4b1f4 P 127766fc592545a4997f7790f50f6076 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } } }
I20260709 13:04:22.942061 20232 raft_consensus.cc:2955] T 9962423cb4e54fcfa5de01daf68a86e7 P 0473d2b2d01f4459b1e90fd12cc7840e [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } } }
I20260709 13:04:22.954133 20234 consensus_queue.cc:1048] T 9962423cb4e54fcfa5de01daf68a86e7 P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:04:22.953598 19483 raft_consensus.cc:2955] T 0e1085d23e8347fbbd5bce7542f4b1f4 P 0473d2b2d01f4459b1e90fd12cc7840e [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } } }
I20260709 13:04:22.959479 19296 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 9962423cb4e54fcfa5de01daf68a86e7 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:04:22.960539 19309 catalog_manager.cc:5697] T 0e1085d23e8347fbbd5bce7542f4b1f4 P 127766fc592545a4997f7790f50f6076 reported cstate change: config changed from index 3 to 4, VOTER e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1) evicted. New cstate: current_term: 1 leader_uuid: "e61c3a8f61bb48f8a963c9480e53c168" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } } }
I20260709 13:04:22.954075 19557 consensus_queue.cc:237] T 85c494af21f9457a85da47b9bc70c1fd P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:04:22.973526 19406 raft_consensus.cc:2955] T 9962423cb4e54fcfa5de01daf68a86e7 P e5256d91808b47c195bc9b4dbd7f2b87 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } } }
I20260709 13:04:22.976759 19294 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 0e1085d23e8347fbbd5bce7542f4b1f4 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:04:22.979254 19305 catalog_manager.cc:5697] T 9962423cb4e54fcfa5de01daf68a86e7 P 0473d2b2d01f4459b1e90fd12cc7840e reported cstate change: config changed from index 3 to 4, VOTER e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3) evicted. New cstate: current_term: 1 leader_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:04:22.980500 20110 raft_consensus.cc:2955] T 9962423cb4e54fcfa5de01daf68a86e7 P 127766fc592545a4997f7790f50f6076 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } } }
I20260709 13:04:22.986879 20112 raft_consensus.cc:1275] T 85c494af21f9457a85da47b9bc70c1fd P 127766fc592545a4997f7790f50f6076 [term 1 FOLLOWER]: Refusing update from remote peer e61c3a8f61bb48f8a963c9480e53c168: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:04:22.989169 20278 consensus_queue.cc:1048] T 85c494af21f9457a85da47b9bc70c1fd P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Connected to new peer: Peer: permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:04:22.990358 19408 raft_consensus.cc:1275] T 85c494af21f9457a85da47b9bc70c1fd P e5256d91808b47c195bc9b4dbd7f2b87 [term 1 FOLLOWER]: Refusing update from remote peer e61c3a8f61bb48f8a963c9480e53c168: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:04:22.999049 20221 consensus_queue.cc:1048] T 85c494af21f9457a85da47b9bc70c1fd P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:04:23.000274 19547 tablet_service.cc:1558] Processing DeleteTablet for tablet 9962423cb4e54fcfa5de01daf68a86e7 with delete_type TABLET_DATA_TOMBSTONED (TS e61c3a8f61bb48f8a963c9480e53c168 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:40412
I20260709 13:04:23.002758 19401 tablet_service.cc:1558] Processing DeleteTablet for tablet 0e1085d23e8347fbbd5bce7542f4b1f4 with delete_type TABLET_DATA_TOMBSTONED (TS e5256d91808b47c195bc9b4dbd7f2b87 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:52318
I20260709 13:04:23.030577 19408 raft_consensus.cc:2955] T 85c494af21f9457a85da47b9bc70c1fd P e5256d91808b47c195bc9b4dbd7f2b87 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } } }
I20260709 13:04:23.047067 20232 raft_consensus.cc:2955] T 62c6c134d3d24a1ab144dd9ee6bc3f64 P 0473d2b2d01f4459b1e90fd12cc7840e [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 127766fc592545a4997f7790f50f6076 (127.17.223.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } attrs { replace: true } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } } }
I20260709 13:04:23.049571 19309 catalog_manager.cc:5697] T 85c494af21f9457a85da47b9bc70c1fd P e5256d91808b47c195bc9b4dbd7f2b87 reported cstate change: config changed from index 3 to 4, VOTER 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2) evicted. New cstate: current_term: 1 leader_uuid: "e61c3a8f61bb48f8a963c9480e53c168" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } } }
I20260709 13:04:23.053740 20279 raft_consensus.cc:2955] T 85c494af21f9457a85da47b9bc70c1fd P e61c3a8f61bb48f8a963c9480e53c168 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } } }
I20260709 13:04:23.064008 19468 tablet_service.cc:1558] Processing DeleteTablet for tablet 85c494af21f9457a85da47b9bc70c1fd with delete_type TABLET_DATA_TOMBSTONED (TS 0473d2b2d01f4459b1e90fd12cc7840e not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:58272
I20260709 13:04:23.091588 20285 tablet_replica.cc:333] T 9962423cb4e54fcfa5de01daf68a86e7 P e61c3a8f61bb48f8a963c9480e53c168: stopping tablet replica
I20260709 13:04:23.093914 19559 raft_consensus.cc:2955] T 62c6c134d3d24a1ab144dd9ee6bc3f64 P e61c3a8f61bb48f8a963c9480e53c168 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 127766fc592545a4997f7790f50f6076 (127.17.223.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } attrs { replace: true } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } } }
I20260709 13:04:23.098276 19408 raft_consensus.cc:2955] T 62c6c134d3d24a1ab144dd9ee6bc3f64 P e5256d91808b47c195bc9b4dbd7f2b87 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 127766fc592545a4997f7790f50f6076 (127.17.223.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } attrs { replace: true } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } } }
I20260709 13:04:23.103856 20286 tablet_replica.cc:333] T 0e1085d23e8347fbbd5bce7542f4b1f4 P e5256d91808b47c195bc9b4dbd7f2b87: stopping tablet replica
I20260709 13:04:23.107791 20110 raft_consensus.cc:2955] T 85c494af21f9457a85da47b9bc70c1fd P 127766fc592545a4997f7790f50f6076 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } } }
I20260709 13:04:23.111202 20112 raft_consensus.cc:2955] T 62c6c134d3d24a1ab144dd9ee6bc3f64 P 127766fc592545a4997f7790f50f6076 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 127766fc592545a4997f7790f50f6076 (127.17.223.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } attrs { replace: true } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } } }
I20260709 13:04:23.139144 19294 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 85c494af21f9457a85da47b9bc70c1fd with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:04:23.148793 20285 raft_consensus.cc:2243] T 9962423cb4e54fcfa5de01daf68a86e7 P e61c3a8f61bb48f8a963c9480e53c168 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:23.149912 20285 raft_consensus.cc:2272] T 9962423cb4e54fcfa5de01daf68a86e7 P e61c3a8f61bb48f8a963c9480e53c168 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:23.175434 20285 ts_tablet_manager.cc:1916] T 9962423cb4e54fcfa5de01daf68a86e7 P e61c3a8f61bb48f8a963c9480e53c168: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:04:23.187410 20286 raft_consensus.cc:2243] T 0e1085d23e8347fbbd5bce7542f4b1f4 P e5256d91808b47c195bc9b4dbd7f2b87 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:23.187399 19305 catalog_manager.cc:5697] T 62c6c134d3d24a1ab144dd9ee6bc3f64 P 0473d2b2d01f4459b1e90fd12cc7840e reported cstate change: config changed from index 2 to 3, 127766fc592545a4997f7790f50f6076 (127.17.223.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:04:23.191676 20286 raft_consensus.cc:2272] T 0e1085d23e8347fbbd5bce7542f4b1f4 P e5256d91808b47c195bc9b4dbd7f2b87 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:23.195286 20286 ts_tablet_manager.cc:1916] T 0e1085d23e8347fbbd5bce7542f4b1f4 P e5256d91808b47c195bc9b4dbd7f2b87: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:04:23.195745 20289 tablet_replica.cc:333] T 85c494af21f9457a85da47b9bc70c1fd P 0473d2b2d01f4459b1e90fd12cc7840e: stopping tablet replica
I20260709 13:04:23.204782 20289 raft_consensus.cc:2243] T 85c494af21f9457a85da47b9bc70c1fd P 0473d2b2d01f4459b1e90fd12cc7840e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:23.208293 20289 raft_consensus.cc:2272] T 85c494af21f9457a85da47b9bc70c1fd P 0473d2b2d01f4459b1e90fd12cc7840e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:23.211730 20289 ts_tablet_manager.cc:1916] T 85c494af21f9457a85da47b9bc70c1fd P 0473d2b2d01f4459b1e90fd12cc7840e: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
W20260709 13:04:23.214186 19526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.2:46257, user_credentials={real_user=slave}} blocked reactor thread for 87943.4us
I20260709 13:04:23.216775 20285 ts_tablet_manager.cc:1929] T 9962423cb4e54fcfa5de01daf68a86e7 P e61c3a8f61bb48f8a963c9480e53c168: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:04:23.217322 20285 log.cc:1199] T 9962423cb4e54fcfa5de01daf68a86e7 P e61c3a8f61bb48f8a963c9480e53c168: Deleting WAL directory at /tmp/dist-test-taskKd2k48/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602220613947-18300-0/minicluster-data/ts-2-root/wals/9962423cb4e54fcfa5de01daf68a86e7
I20260709 13:04:23.219954 19294 catalog_manager.cc:5028] TS e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891): tablet 9962423cb4e54fcfa5de01daf68a86e7 (table test-workload [id=ce1025c73cf04c4baf25820ae7ff0a53]) successfully deleted
I20260709 13:04:23.230475 20289 ts_tablet_manager.cc:1929] T 85c494af21f9457a85da47b9bc70c1fd P 0473d2b2d01f4459b1e90fd12cc7840e: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:04:23.231078 20289 log.cc:1199] T 85c494af21f9457a85da47b9bc70c1fd P 0473d2b2d01f4459b1e90fd12cc7840e: Deleting WAL directory at /tmp/dist-test-taskKd2k48/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602220613947-18300-0/minicluster-data/ts-1-root/wals/85c494af21f9457a85da47b9bc70c1fd
I20260709 13:04:23.233264 19296 catalog_manager.cc:5028] TS 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257): tablet 85c494af21f9457a85da47b9bc70c1fd (table test-workload [id=ce1025c73cf04c4baf25820ae7ff0a53]) successfully deleted
I20260709 13:04:23.242537 20286 ts_tablet_manager.cc:1929] T 0e1085d23e8347fbbd5bce7542f4b1f4 P e5256d91808b47c195bc9b4dbd7f2b87: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:04:23.243086 20286 log.cc:1199] T 0e1085d23e8347fbbd5bce7542f4b1f4 P e5256d91808b47c195bc9b4dbd7f2b87: Deleting WAL directory at /tmp/dist-test-taskKd2k48/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602220613947-18300-0/minicluster-data/ts-0-root/wals/0e1085d23e8347fbbd5bce7542f4b1f4
I20260709 13:04:23.250927 19293 catalog_manager.cc:5028] TS e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321): tablet 0e1085d23e8347fbbd5bce7542f4b1f4 (table test-workload [id=ce1025c73cf04c4baf25820ae7ff0a53]) successfully deleted
I20260709 13:04:23.254547 19483 consensus_queue.cc:237] T 62c6c134d3d24a1ab144dd9ee6bc3f64 P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:04:23.279412 20110 raft_consensus.cc:1275] T 62c6c134d3d24a1ab144dd9ee6bc3f64 P 127766fc592545a4997f7790f50f6076 [term 1 FOLLOWER]: Refusing update from remote peer 0473d2b2d01f4459b1e90fd12cc7840e: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:04:23.280124 19558 raft_consensus.cc:1275] T 62c6c134d3d24a1ab144dd9ee6bc3f64 P e61c3a8f61bb48f8a963c9480e53c168 [term 1 FOLLOWER]: Refusing update from remote peer 0473d2b2d01f4459b1e90fd12cc7840e: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:04:23.281335 20277 consensus_queue.cc:1048] T 62c6c134d3d24a1ab144dd9ee6bc3f64 P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Connected to new peer: Peer: permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:04:23.285981 20266 consensus_queue.cc:1048] T 62c6c134d3d24a1ab144dd9ee6bc3f64 P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:04:23.288640 20232 raft_consensus.cc:2955] T 62c6c134d3d24a1ab144dd9ee6bc3f64 P 0473d2b2d01f4459b1e90fd12cc7840e [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } } }
I20260709 13:04:23.292764 20110 raft_consensus.cc:2955] T 62c6c134d3d24a1ab144dd9ee6bc3f64 P 127766fc592545a4997f7790f50f6076 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } } }
I20260709 13:04:23.302958 19296 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 62c6c134d3d24a1ab144dd9ee6bc3f64 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:04:23.306151 19559 raft_consensus.cc:2955] T 62c6c134d3d24a1ab144dd9ee6bc3f64 P e61c3a8f61bb48f8a963c9480e53c168 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } } }
I20260709 13:04:23.307866 19306 catalog_manager.cc:5697] T 62c6c134d3d24a1ab144dd9ee6bc3f64 P 0473d2b2d01f4459b1e90fd12cc7840e reported cstate change: config changed from index 3 to 4, VOTER e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1) evicted. New cstate: current_term: 1 leader_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:04:23.325964 19401 tablet_service.cc:1558] Processing DeleteTablet for tablet 62c6c134d3d24a1ab144dd9ee6bc3f64 with delete_type TABLET_DATA_TOMBSTONED (TS e5256d91808b47c195bc9b4dbd7f2b87 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:52318
I20260709 13:04:23.327490 20286 tablet_replica.cc:333] T 62c6c134d3d24a1ab144dd9ee6bc3f64 P e5256d91808b47c195bc9b4dbd7f2b87: stopping tablet replica
I20260709 13:04:23.328651 20286 raft_consensus.cc:2243] T 62c6c134d3d24a1ab144dd9ee6bc3f64 P e5256d91808b47c195bc9b4dbd7f2b87 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:23.329257 20286 raft_consensus.cc:2272] T 62c6c134d3d24a1ab144dd9ee6bc3f64 P e5256d91808b47c195bc9b4dbd7f2b87 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:23.333329 20286 ts_tablet_manager.cc:1916] T 62c6c134d3d24a1ab144dd9ee6bc3f64 P e5256d91808b47c195bc9b4dbd7f2b87: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:04:23.354581 20286 ts_tablet_manager.cc:1929] T 62c6c134d3d24a1ab144dd9ee6bc3f64 P e5256d91808b47c195bc9b4dbd7f2b87: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:04:23.355125 20286 log.cc:1199] T 62c6c134d3d24a1ab144dd9ee6bc3f64 P e5256d91808b47c195bc9b4dbd7f2b87: Deleting WAL directory at /tmp/dist-test-taskKd2k48/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602220613947-18300-0/minicluster-data/ts-0-root/wals/62c6c134d3d24a1ab144dd9ee6bc3f64
I20260709 13:04:23.356491 19293 catalog_manager.cc:5028] TS e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321): tablet 62c6c134d3d24a1ab144dd9ee6bc3f64 (table test-workload [id=ce1025c73cf04c4baf25820ae7ff0a53]) successfully deleted
I20260709 13:04:24.418391 19406 consensus_queue.cc:237] T 775c229504194560ba9589bc2199b089 P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } attrs { replace: true } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: NON_VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: true } }
I20260709 13:04:24.426321 19483 raft_consensus.cc:1275] T 775c229504194560ba9589bc2199b089 P 0473d2b2d01f4459b1e90fd12cc7840e [term 1 FOLLOWER]: Refusing update from remote peer e5256d91808b47c195bc9b4dbd7f2b87: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:04:24.428637 20291 consensus_queue.cc:1048] T 775c229504194560ba9589bc2199b089 P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:04:24.434513 19558 raft_consensus.cc:1275] T 775c229504194560ba9589bc2199b089 P e61c3a8f61bb48f8a963c9480e53c168 [term 1 FOLLOWER]: Refusing update from remote peer e5256d91808b47c195bc9b4dbd7f2b87: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:04:24.435981 20291 consensus_queue.cc:1048] T 775c229504194560ba9589bc2199b089 P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:04:24.438112 20295 raft_consensus.cc:2955] T 775c229504194560ba9589bc2199b089 P e5256d91808b47c195bc9b4dbd7f2b87 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 127766fc592545a4997f7790f50f6076 (127.17.223.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } attrs { replace: true } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: NON_VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: true } } }
I20260709 13:04:24.439965 19478 raft_consensus.cc:2955] T 775c229504194560ba9589bc2199b089 P 0473d2b2d01f4459b1e90fd12cc7840e [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 127766fc592545a4997f7790f50f6076 (127.17.223.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } attrs { replace: true } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: NON_VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: true } } }
W20260709 13:04:24.443565 19374 consensus_peers.cc:597] T 775c229504194560ba9589bc2199b089 P e5256d91808b47c195bc9b4dbd7f2b87 -> Peer 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121): Couldn't send request to peer 127766fc592545a4997f7790f50f6076. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 775c229504194560ba9589bc2199b089. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:24.455416 19557 consensus_queue.cc:237] T 0afb57ae58a24a01850491d69f0213dd P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } attrs { replace: true } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: NON_VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: true } }
I20260709 13:04:24.462003 19556 raft_consensus.cc:2955] T 775c229504194560ba9589bc2199b089 P e61c3a8f61bb48f8a963c9480e53c168 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 127766fc592545a4997f7790f50f6076 (127.17.223.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } attrs { replace: true } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: NON_VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: true } } }
I20260709 13:04:24.463066 19306 catalog_manager.cc:5697] T 775c229504194560ba9589bc2199b089 P e5256d91808b47c195bc9b4dbd7f2b87 reported cstate change: config changed from index -1 to 2, NON_VOTER 127766fc592545a4997f7790f50f6076 (127.17.223.4) added. New cstate: current_term: 1 leader_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: NON_VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:24.480078 19406 raft_consensus.cc:1275] T 0afb57ae58a24a01850491d69f0213dd P e5256d91808b47c195bc9b4dbd7f2b87 [term 1 FOLLOWER]: Refusing update from remote peer e61c3a8f61bb48f8a963c9480e53c168: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 13:04:24.480501 19523 consensus_peers.cc:597] T 0afb57ae58a24a01850491d69f0213dd P e61c3a8f61bb48f8a963c9480e53c168 -> Peer 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121): Couldn't send request to peer 127766fc592545a4997f7790f50f6076. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 0afb57ae58a24a01850491d69f0213dd. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:24.482132 19478 raft_consensus.cc:1275] T 0afb57ae58a24a01850491d69f0213dd P 0473d2b2d01f4459b1e90fd12cc7840e [term 1 FOLLOWER]: Refusing update from remote peer e61c3a8f61bb48f8a963c9480e53c168: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:04:24.482184 20224 consensus_queue.cc:1048] T 0afb57ae58a24a01850491d69f0213dd P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:04:24.484010 20302 consensus_queue.cc:1048] T 0afb57ae58a24a01850491d69f0213dd P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:04:24.495934 20302 raft_consensus.cc:2955] T 0afb57ae58a24a01850491d69f0213dd P e61c3a8f61bb48f8a963c9480e53c168 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 127766fc592545a4997f7790f50f6076 (127.17.223.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } attrs { replace: true } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: NON_VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: true } } }
I20260709 13:04:24.498366 19483 raft_consensus.cc:2955] T 0afb57ae58a24a01850491d69f0213dd P 0473d2b2d01f4459b1e90fd12cc7840e [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 127766fc592545a4997f7790f50f6076 (127.17.223.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } attrs { replace: true } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: NON_VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: true } } }
I20260709 13:04:24.500211 19406 raft_consensus.cc:2955] T 0afb57ae58a24a01850491d69f0213dd P e5256d91808b47c195bc9b4dbd7f2b87 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 127766fc592545a4997f7790f50f6076 (127.17.223.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } attrs { replace: true } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: NON_VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: true } } }
I20260709 13:04:24.519690 19407 consensus_queue.cc:237] T ece3db938bc649d4a40a51522ed5259c P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } attrs { replace: true } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: NON_VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: true } }
I20260709 13:04:24.519838 19304 catalog_manager.cc:5697] T 0afb57ae58a24a01850491d69f0213dd P 0473d2b2d01f4459b1e90fd12cc7840e reported cstate change: config changed from index -1 to 2, NON_VOTER 127766fc592545a4997f7790f50f6076 (127.17.223.4) added. New cstate: current_term: 1 leader_uuid: "e61c3a8f61bb48f8a963c9480e53c168" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } attrs { replace: true } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: NON_VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: true } } }
W20260709 13:04:24.544502 19374 consensus_peers.cc:597] T ece3db938bc649d4a40a51522ed5259c P e5256d91808b47c195bc9b4dbd7f2b87 -> Peer 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121): Couldn't send request to peer 127766fc592545a4997f7790f50f6076. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: ece3db938bc649d4a40a51522ed5259c. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:24.545651 19483 raft_consensus.cc:1275] T ece3db938bc649d4a40a51522ed5259c P 0473d2b2d01f4459b1e90fd12cc7840e [term 1 FOLLOWER]: Refusing update from remote peer e5256d91808b47c195bc9b4dbd7f2b87: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:04:24.545715 19557 raft_consensus.cc:1275] T ece3db938bc649d4a40a51522ed5259c P e61c3a8f61bb48f8a963c9480e53c168 [term 1 FOLLOWER]: Refusing update from remote peer e5256d91808b47c195bc9b4dbd7f2b87: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:04:24.547609 20291 consensus_queue.cc:1048] T ece3db938bc649d4a40a51522ed5259c P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:04:24.550066 20288 consensus_queue.cc:1048] T ece3db938bc649d4a40a51522ed5259c P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:04:24.559827 20295 raft_consensus.cc:2955] T ece3db938bc649d4a40a51522ed5259c P e5256d91808b47c195bc9b4dbd7f2b87 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 127766fc592545a4997f7790f50f6076 (127.17.223.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } attrs { replace: true } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: NON_VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: true } } }
I20260709 13:04:24.562716 19557 raft_consensus.cc:2955] T ece3db938bc649d4a40a51522ed5259c P e61c3a8f61bb48f8a963c9480e53c168 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 127766fc592545a4997f7790f50f6076 (127.17.223.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } attrs { replace: true } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: NON_VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: true } } }
I20260709 13:04:24.566445 19483 raft_consensus.cc:2955] T ece3db938bc649d4a40a51522ed5259c P 0473d2b2d01f4459b1e90fd12cc7840e [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 127766fc592545a4997f7790f50f6076 (127.17.223.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } attrs { replace: true } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: NON_VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: true } } }
I20260709 13:04:24.577174 19479 consensus_queue.cc:237] T 1f85fc4b527a48848e5faa083b604e36 P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } attrs { replace: true } } peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: NON_VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: true } }
I20260709 13:04:24.594240 19304 catalog_manager.cc:5697] T ece3db938bc649d4a40a51522ed5259c P e61c3a8f61bb48f8a963c9480e53c168 reported cstate change: config changed from index -1 to 2, NON_VOTER 127766fc592545a4997f7790f50f6076 (127.17.223.4) added. New cstate: current_term: 1 leader_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } attrs { replace: true } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: NON_VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: true } } }
I20260709 13:04:24.600099 19406 raft_consensus.cc:1275] T 1f85fc4b527a48848e5faa083b604e36 P e5256d91808b47c195bc9b4dbd7f2b87 [term 1 FOLLOWER]: Refusing update from remote peer 0473d2b2d01f4459b1e90fd12cc7840e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:04:24.601078 19557 raft_consensus.cc:1275] T 1f85fc4b527a48848e5faa083b604e36 P e61c3a8f61bb48f8a963c9480e53c168 [term 1 FOLLOWER]: Refusing update from remote peer 0473d2b2d01f4459b1e90fd12cc7840e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:04:24.601748 20232 consensus_queue.cc:1048] T 1f85fc4b527a48848e5faa083b604e36 P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:04:24.603399 19449 consensus_peers.cc:597] T 1f85fc4b527a48848e5faa083b604e36 P 0473d2b2d01f4459b1e90fd12cc7840e -> Peer 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121): Couldn't send request to peer 127766fc592545a4997f7790f50f6076. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 1f85fc4b527a48848e5faa083b604e36. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:24.604115 20232 consensus_queue.cc:1048] T 1f85fc4b527a48848e5faa083b604e36 P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:04:24.632552 20276 raft_consensus.cc:2955] T 1f85fc4b527a48848e5faa083b604e36 P 0473d2b2d01f4459b1e90fd12cc7840e [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 127766fc592545a4997f7790f50f6076 (127.17.223.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } attrs { replace: true } } peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: NON_VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: true } } }
I20260709 13:04:24.634076 19557 raft_consensus.cc:2955] T 1f85fc4b527a48848e5faa083b604e36 P e61c3a8f61bb48f8a963c9480e53c168 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 127766fc592545a4997f7790f50f6076 (127.17.223.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } attrs { replace: true } } peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: NON_VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: true } } }
I20260709 13:04:24.637797 19406 raft_consensus.cc:2955] T 1f85fc4b527a48848e5faa083b604e36 P e5256d91808b47c195bc9b4dbd7f2b87 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 127766fc592545a4997f7790f50f6076 (127.17.223.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } attrs { replace: true } } peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: NON_VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: true } } }
I20260709 13:04:24.651521 19304 catalog_manager.cc:5697] T 1f85fc4b527a48848e5faa083b604e36 P 0473d2b2d01f4459b1e90fd12cc7840e reported cstate change: config changed from index -1 to 2, NON_VOTER 127766fc592545a4997f7790f50f6076 (127.17.223.4) added. New cstate: current_term: 1 leader_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: NON_VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:24.835737 20315 ts_tablet_manager.cc:933] T 775c229504194560ba9589bc2199b089 P 127766fc592545a4997f7790f50f6076: Initiating tablet copy from peer e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321)
I20260709 13:04:24.840729 20315 tablet_copy_client.cc:323] T 775c229504194560ba9589bc2199b089 P 127766fc592545a4997f7790f50f6076: tablet copy: Beginning tablet copy session from remote peer at address 127.17.223.1:40321
I20260709 13:04:24.856141 19421 tablet_copy_service.cc:140] P e5256d91808b47c195bc9b4dbd7f2b87: Received BeginTabletCopySession request for tablet 775c229504194560ba9589bc2199b089 from peer 127766fc592545a4997f7790f50f6076 ({username='slave'} at 127.0.0.1:49050)
I20260709 13:04:24.856657 19421 tablet_copy_service.cc:161] P e5256d91808b47c195bc9b4dbd7f2b87: Beginning new tablet copy session on tablet 775c229504194560ba9589bc2199b089 from peer 127766fc592545a4997f7790f50f6076 at {username='slave'} at 127.0.0.1:49050: session id = 127766fc592545a4997f7790f50f6076-775c229504194560ba9589bc2199b089
I20260709 13:04:24.864495 19421 tablet_copy_source_session.cc:215] T 775c229504194560ba9589bc2199b089 P e5256d91808b47c195bc9b4dbd7f2b87: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:04:24.867344 20315 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 775c229504194560ba9589bc2199b089. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:24.881371 20315 tablet_copy_client.cc:806] T 775c229504194560ba9589bc2199b089 P 127766fc592545a4997f7790f50f6076: tablet copy: Starting download of 0 data blocks...
I20260709 13:04:24.881989 20315 tablet_copy_client.cc:670] T 775c229504194560ba9589bc2199b089 P 127766fc592545a4997f7790f50f6076: tablet copy: Starting download of 1 WAL segments...
I20260709 13:04:24.885823 20315 tablet_copy_client.cc:538] T 775c229504194560ba9589bc2199b089 P 127766fc592545a4997f7790f50f6076: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:04:24.893153 20315 tablet_bootstrap.cc:492] T 775c229504194560ba9589bc2199b089 P 127766fc592545a4997f7790f50f6076: Bootstrap starting.
I20260709 13:04:24.912005 20315 tablet_bootstrap.cc:492] T 775c229504194560ba9589bc2199b089 P 127766fc592545a4997f7790f50f6076: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:04:24.912802 20315 tablet_bootstrap.cc:492] T 775c229504194560ba9589bc2199b089 P 127766fc592545a4997f7790f50f6076: Bootstrap complete.
I20260709 13:04:24.913421 20315 ts_tablet_manager.cc:1403] T 775c229504194560ba9589bc2199b089 P 127766fc592545a4997f7790f50f6076: Time spent bootstrapping tablet: real 0.020s	user 0.015s	sys 0.005s
I20260709 13:04:24.916292 20315 raft_consensus.cc:359] T 775c229504194560ba9589bc2199b089 P 127766fc592545a4997f7790f50f6076 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } attrs { replace: true } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: NON_VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: true } }
I20260709 13:04:24.917102 20315 raft_consensus.cc:740] T 775c229504194560ba9589bc2199b089 P 127766fc592545a4997f7790f50f6076 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 127766fc592545a4997f7790f50f6076, State: Initialized, Role: LEARNER
I20260709 13:04:24.917727 20315 consensus_queue.cc:260] T 775c229504194560ba9589bc2199b089 P 127766fc592545a4997f7790f50f6076 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } attrs { replace: true } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: NON_VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: true } }
I20260709 13:04:24.922189 20315 ts_tablet_manager.cc:1434] T 775c229504194560ba9589bc2199b089 P 127766fc592545a4997f7790f50f6076: Time spent starting tablet: real 0.008s	user 0.004s	sys 0.004s
I20260709 13:04:24.928272 20320 ts_tablet_manager.cc:933] T 0afb57ae58a24a01850491d69f0213dd P 127766fc592545a4997f7790f50f6076: Initiating tablet copy from peer e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:04:24.932370 19421 tablet_copy_service.cc:342] P e5256d91808b47c195bc9b4dbd7f2b87: Request end of tablet copy session 127766fc592545a4997f7790f50f6076-775c229504194560ba9589bc2199b089 received from {username='slave'} at 127.0.0.1:49050
I20260709 13:04:24.932866 19421 tablet_copy_service.cc:434] P e5256d91808b47c195bc9b4dbd7f2b87: ending tablet copy session 127766fc592545a4997f7790f50f6076-775c229504194560ba9589bc2199b089 on tablet 775c229504194560ba9589bc2199b089 with peer 127766fc592545a4997f7790f50f6076
I20260709 13:04:24.946630 20320 tablet_copy_client.cc:323] T 0afb57ae58a24a01850491d69f0213dd P 127766fc592545a4997f7790f50f6076: tablet copy: Beginning tablet copy session from remote peer at address 127.17.223.3:36891
I20260709 13:04:24.991238 19570 tablet_copy_service.cc:140] P e61c3a8f61bb48f8a963c9480e53c168: Received BeginTabletCopySession request for tablet 0afb57ae58a24a01850491d69f0213dd from peer 127766fc592545a4997f7790f50f6076 ({username='slave'} at 127.0.0.1:41504)
I20260709 13:04:24.991814 19570 tablet_copy_service.cc:161] P e61c3a8f61bb48f8a963c9480e53c168: Beginning new tablet copy session on tablet 0afb57ae58a24a01850491d69f0213dd from peer 127766fc592545a4997f7790f50f6076 at {username='slave'} at 127.0.0.1:41504: session id = 127766fc592545a4997f7790f50f6076-0afb57ae58a24a01850491d69f0213dd
I20260709 13:04:25.009647 19570 tablet_copy_source_session.cc:215] T 0afb57ae58a24a01850491d69f0213dd P e61c3a8f61bb48f8a963c9480e53c168: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:04:25.013130 20320 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0afb57ae58a24a01850491d69f0213dd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:25.029129 20320 tablet_copy_client.cc:806] T 0afb57ae58a24a01850491d69f0213dd P 127766fc592545a4997f7790f50f6076: tablet copy: Starting download of 0 data blocks...
I20260709 13:04:25.029744 20320 tablet_copy_client.cc:670] T 0afb57ae58a24a01850491d69f0213dd P 127766fc592545a4997f7790f50f6076: tablet copy: Starting download of 1 WAL segments...
I20260709 13:04:25.033607 20320 tablet_copy_client.cc:538] T 0afb57ae58a24a01850491d69f0213dd P 127766fc592545a4997f7790f50f6076: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:04:25.046404 20320 tablet_bootstrap.cc:492] T 0afb57ae58a24a01850491d69f0213dd P 127766fc592545a4997f7790f50f6076: Bootstrap starting.
I20260709 13:04:25.076335 20320 tablet_bootstrap.cc:492] T 0afb57ae58a24a01850491d69f0213dd P 127766fc592545a4997f7790f50f6076: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:04:25.077401 20320 tablet_bootstrap.cc:492] T 0afb57ae58a24a01850491d69f0213dd P 127766fc592545a4997f7790f50f6076: Bootstrap complete.
I20260709 13:04:25.078171 20320 ts_tablet_manager.cc:1403] T 0afb57ae58a24a01850491d69f0213dd P 127766fc592545a4997f7790f50f6076: Time spent bootstrapping tablet: real 0.032s	user 0.015s	sys 0.015s
I20260709 13:04:25.081409 20320 raft_consensus.cc:359] T 0afb57ae58a24a01850491d69f0213dd P 127766fc592545a4997f7790f50f6076 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } attrs { replace: true } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: NON_VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: true } }
I20260709 13:04:25.082284 20320 raft_consensus.cc:740] T 0afb57ae58a24a01850491d69f0213dd P 127766fc592545a4997f7790f50f6076 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 127766fc592545a4997f7790f50f6076, State: Initialized, Role: LEARNER
I20260709 13:04:25.083007 20320 consensus_queue.cc:260] T 0afb57ae58a24a01850491d69f0213dd P 127766fc592545a4997f7790f50f6076 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } attrs { replace: true } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: NON_VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: true } }
I20260709 13:04:25.085546 20320 ts_tablet_manager.cc:1434] T 0afb57ae58a24a01850491d69f0213dd P 127766fc592545a4997f7790f50f6076: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 13:04:25.089565 19570 tablet_copy_service.cc:342] P e61c3a8f61bb48f8a963c9480e53c168: Request end of tablet copy session 127766fc592545a4997f7790f50f6076-0afb57ae58a24a01850491d69f0213dd received from {username='slave'} at 127.0.0.1:41504
I20260709 13:04:25.090044 19570 tablet_copy_service.cc:434] P e61c3a8f61bb48f8a963c9480e53c168: ending tablet copy session 127766fc592545a4997f7790f50f6076-0afb57ae58a24a01850491d69f0213dd on tablet 0afb57ae58a24a01850491d69f0213dd with peer 127766fc592545a4997f7790f50f6076
I20260709 13:04:25.091296 20315 ts_tablet_manager.cc:933] T ece3db938bc649d4a40a51522ed5259c P 127766fc592545a4997f7790f50f6076: Initiating tablet copy from peer e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321)
I20260709 13:04:25.096822 20315 tablet_copy_client.cc:323] T ece3db938bc649d4a40a51522ed5259c P 127766fc592545a4997f7790f50f6076: tablet copy: Beginning tablet copy session from remote peer at address 127.17.223.1:40321
I20260709 13:04:25.100304 19421 tablet_copy_service.cc:140] P e5256d91808b47c195bc9b4dbd7f2b87: Received BeginTabletCopySession request for tablet ece3db938bc649d4a40a51522ed5259c from peer 127766fc592545a4997f7790f50f6076 ({username='slave'} at 127.0.0.1:49050)
I20260709 13:04:25.100922 19421 tablet_copy_service.cc:161] P e5256d91808b47c195bc9b4dbd7f2b87: Beginning new tablet copy session on tablet ece3db938bc649d4a40a51522ed5259c from peer 127766fc592545a4997f7790f50f6076 at {username='slave'} at 127.0.0.1:49050: session id = 127766fc592545a4997f7790f50f6076-ece3db938bc649d4a40a51522ed5259c
I20260709 13:04:25.106253 19421 tablet_copy_source_session.cc:215] T ece3db938bc649d4a40a51522ed5259c P e5256d91808b47c195bc9b4dbd7f2b87: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:04:25.108875 20315 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ece3db938bc649d4a40a51522ed5259c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:25.119493 20315 tablet_copy_client.cc:806] T ece3db938bc649d4a40a51522ed5259c P 127766fc592545a4997f7790f50f6076: tablet copy: Starting download of 0 data blocks...
I20260709 13:04:25.120074 20315 tablet_copy_client.cc:670] T ece3db938bc649d4a40a51522ed5259c P 127766fc592545a4997f7790f50f6076: tablet copy: Starting download of 1 WAL segments...
I20260709 13:04:25.123433 20315 tablet_copy_client.cc:538] T ece3db938bc649d4a40a51522ed5259c P 127766fc592545a4997f7790f50f6076: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:04:25.131614 20315 tablet_bootstrap.cc:492] T ece3db938bc649d4a40a51522ed5259c P 127766fc592545a4997f7790f50f6076: Bootstrap starting.
I20260709 13:04:25.146826 20320 ts_tablet_manager.cc:933] T 1f85fc4b527a48848e5faa083b604e36 P 127766fc592545a4997f7790f50f6076: Initiating tablet copy from peer 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:04:25.150182 20315 tablet_bootstrap.cc:492] T ece3db938bc649d4a40a51522ed5259c P 127766fc592545a4997f7790f50f6076: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:04:25.151188 20315 tablet_bootstrap.cc:492] T ece3db938bc649d4a40a51522ed5259c P 127766fc592545a4997f7790f50f6076: Bootstrap complete.
I20260709 13:04:25.151886 20315 ts_tablet_manager.cc:1403] T ece3db938bc649d4a40a51522ed5259c P 127766fc592545a4997f7790f50f6076: Time spent bootstrapping tablet: real 0.020s	user 0.015s	sys 0.005s
I20260709 13:04:25.154587 20320 tablet_copy_client.cc:323] T 1f85fc4b527a48848e5faa083b604e36 P 127766fc592545a4997f7790f50f6076: tablet copy: Beginning tablet copy session from remote peer at address 127.17.223.2:46257
I20260709 13:04:25.154942 20315 raft_consensus.cc:359] T ece3db938bc649d4a40a51522ed5259c P 127766fc592545a4997f7790f50f6076 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } attrs { replace: true } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: NON_VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: true } }
I20260709 13:04:25.155614 20315 raft_consensus.cc:740] T ece3db938bc649d4a40a51522ed5259c P 127766fc592545a4997f7790f50f6076 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 127766fc592545a4997f7790f50f6076, State: Initialized, Role: LEARNER
I20260709 13:04:25.156296 20315 consensus_queue.cc:260] T ece3db938bc649d4a40a51522ed5259c P 127766fc592545a4997f7790f50f6076 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } attrs { replace: true } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: NON_VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: true } }
I20260709 13:04:25.156733 19496 tablet_copy_service.cc:140] P 0473d2b2d01f4459b1e90fd12cc7840e: Received BeginTabletCopySession request for tablet 1f85fc4b527a48848e5faa083b604e36 from peer 127766fc592545a4997f7790f50f6076 ({username='slave'} at 127.0.0.1:39478)
I20260709 13:04:25.157358 19496 tablet_copy_service.cc:161] P 0473d2b2d01f4459b1e90fd12cc7840e: Beginning new tablet copy session on tablet 1f85fc4b527a48848e5faa083b604e36 from peer 127766fc592545a4997f7790f50f6076 at {username='slave'} at 127.0.0.1:39478: session id = 127766fc592545a4997f7790f50f6076-1f85fc4b527a48848e5faa083b604e36
I20260709 13:04:25.159014 20315 ts_tablet_manager.cc:1434] T ece3db938bc649d4a40a51522ed5259c P 127766fc592545a4997f7790f50f6076: Time spent starting tablet: real 0.007s	user 0.003s	sys 0.004s
I20260709 13:04:25.161134 19421 tablet_copy_service.cc:342] P e5256d91808b47c195bc9b4dbd7f2b87: Request end of tablet copy session 127766fc592545a4997f7790f50f6076-ece3db938bc649d4a40a51522ed5259c received from {username='slave'} at 127.0.0.1:49050
I20260709 13:04:25.161536 19421 tablet_copy_service.cc:434] P e5256d91808b47c195bc9b4dbd7f2b87: ending tablet copy session 127766fc592545a4997f7790f50f6076-ece3db938bc649d4a40a51522ed5259c on tablet ece3db938bc649d4a40a51522ed5259c with peer 127766fc592545a4997f7790f50f6076
I20260709 13:04:25.164849 19496 tablet_copy_source_session.cc:215] T 1f85fc4b527a48848e5faa083b604e36 P 0473d2b2d01f4459b1e90fd12cc7840e: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:04:25.170488 20320 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1f85fc4b527a48848e5faa083b604e36. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:25.187546 20320 tablet_copy_client.cc:806] T 1f85fc4b527a48848e5faa083b604e36 P 127766fc592545a4997f7790f50f6076: tablet copy: Starting download of 0 data blocks...
I20260709 13:04:25.188414 20320 tablet_copy_client.cc:670] T 1f85fc4b527a48848e5faa083b604e36 P 127766fc592545a4997f7790f50f6076: tablet copy: Starting download of 1 WAL segments...
I20260709 13:04:25.192070 20320 tablet_copy_client.cc:538] T 1f85fc4b527a48848e5faa083b604e36 P 127766fc592545a4997f7790f50f6076: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:04:25.200642 20320 tablet_bootstrap.cc:492] T 1f85fc4b527a48848e5faa083b604e36 P 127766fc592545a4997f7790f50f6076: Bootstrap starting.
I20260709 13:04:25.219625 20320 tablet_bootstrap.cc:492] T 1f85fc4b527a48848e5faa083b604e36 P 127766fc592545a4997f7790f50f6076: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:04:25.220404 20320 tablet_bootstrap.cc:492] T 1f85fc4b527a48848e5faa083b604e36 P 127766fc592545a4997f7790f50f6076: Bootstrap complete.
I20260709 13:04:25.220923 20320 ts_tablet_manager.cc:1403] T 1f85fc4b527a48848e5faa083b604e36 P 127766fc592545a4997f7790f50f6076: Time spent bootstrapping tablet: real 0.020s	user 0.014s	sys 0.006s
I20260709 13:04:25.223460 20320 raft_consensus.cc:359] T 1f85fc4b527a48848e5faa083b604e36 P 127766fc592545a4997f7790f50f6076 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } attrs { replace: true } } peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: NON_VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: true } }
I20260709 13:04:25.224207 20320 raft_consensus.cc:740] T 1f85fc4b527a48848e5faa083b604e36 P 127766fc592545a4997f7790f50f6076 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 127766fc592545a4997f7790f50f6076, State: Initialized, Role: LEARNER
I20260709 13:04:25.224720 20320 consensus_queue.cc:260] T 1f85fc4b527a48848e5faa083b604e36 P 127766fc592545a4997f7790f50f6076 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } attrs { replace: true } } peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: NON_VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: true } }
I20260709 13:04:25.227423 20320 ts_tablet_manager.cc:1434] T 1f85fc4b527a48848e5faa083b604e36 P 127766fc592545a4997f7790f50f6076: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.002s
I20260709 13:04:25.228076 20112 raft_consensus.cc:1217] T 775c229504194560ba9589bc2199b089 P 127766fc592545a4997f7790f50f6076 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:04:25.233594 19496 tablet_copy_service.cc:342] P 0473d2b2d01f4459b1e90fd12cc7840e: Request end of tablet copy session 127766fc592545a4997f7790f50f6076-1f85fc4b527a48848e5faa083b604e36 received from {username='slave'} at 127.0.0.1:39478
I20260709 13:04:25.234025 19496 tablet_copy_service.cc:434] P 0473d2b2d01f4459b1e90fd12cc7840e: ending tablet copy session 127766fc592545a4997f7790f50f6076-1f85fc4b527a48848e5faa083b604e36 on tablet 1f85fc4b527a48848e5faa083b604e36 with peer 127766fc592545a4997f7790f50f6076
I20260709 13:04:25.497495 20112 raft_consensus.cc:1217] T 0afb57ae58a24a01850491d69f0213dd P 127766fc592545a4997f7790f50f6076 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:04:25.509042 20112 raft_consensus.cc:1217] T ece3db938bc649d4a40a51522ed5259c P 127766fc592545a4997f7790f50f6076 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:04:25.665335 20295 raft_consensus.cc:1064] T 775c229504194560ba9589bc2199b089 P e5256d91808b47c195bc9b4dbd7f2b87: attempting to promote NON_VOTER 127766fc592545a4997f7790f50f6076 to VOTER
I20260709 13:04:25.667445 20295 consensus_queue.cc:237] T 775c229504194560ba9589bc2199b089 P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } attrs { replace: true } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:04:25.674422 20112 raft_consensus.cc:1275] T 775c229504194560ba9589bc2199b089 P 127766fc592545a4997f7790f50f6076 [term 1 LEARNER]: Refusing update from remote peer e5256d91808b47c195bc9b4dbd7f2b87: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:04:25.675463 19557 raft_consensus.cc:1275] T 775c229504194560ba9589bc2199b089 P e61c3a8f61bb48f8a963c9480e53c168 [term 1 FOLLOWER]: Refusing update from remote peer e5256d91808b47c195bc9b4dbd7f2b87: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:04:25.677587 19478 raft_consensus.cc:1275] T 775c229504194560ba9589bc2199b089 P 0473d2b2d01f4459b1e90fd12cc7840e [term 1 FOLLOWER]: Refusing update from remote peer e5256d91808b47c195bc9b4dbd7f2b87: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:04:25.676012 20295 consensus_queue.cc:1048] T 775c229504194560ba9589bc2199b089 P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Connected to new peer: Peer: permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.002s
I20260709 13:04:25.679222 20288 consensus_queue.cc:1048] T 775c229504194560ba9589bc2199b089 P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:04:25.682178 20311 consensus_queue.cc:1048] T 775c229504194560ba9589bc2199b089 P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:04:25.702797 20311 raft_consensus.cc:2955] T 775c229504194560ba9589bc2199b089 P e5256d91808b47c195bc9b4dbd7f2b87 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 127766fc592545a4997f7790f50f6076 (127.17.223.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } attrs { replace: true } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } } }
I20260709 13:04:25.705468 19478 raft_consensus.cc:2955] T 775c229504194560ba9589bc2199b089 P 0473d2b2d01f4459b1e90fd12cc7840e [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 127766fc592545a4997f7790f50f6076 (127.17.223.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } attrs { replace: true } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } } }
I20260709 13:04:25.707770 19556 raft_consensus.cc:2955] T 775c229504194560ba9589bc2199b089 P e61c3a8f61bb48f8a963c9480e53c168 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 127766fc592545a4997f7790f50f6076 (127.17.223.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } attrs { replace: true } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } } }
I20260709 13:04:25.715818 20112 raft_consensus.cc:2955] T 775c229504194560ba9589bc2199b089 P 127766fc592545a4997f7790f50f6076 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 127766fc592545a4997f7790f50f6076 (127.17.223.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } attrs { replace: true } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } } }
I20260709 13:04:25.732548 19306 catalog_manager.cc:5697] T 775c229504194560ba9589bc2199b089 P 0473d2b2d01f4459b1e90fd12cc7840e reported cstate change: config changed from index 2 to 3, 127766fc592545a4997f7790f50f6076 (127.17.223.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } attrs { replace: true } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } } }
I20260709 13:04:25.750074 20112 raft_consensus.cc:1217] T 1f85fc4b527a48848e5faa083b604e36 P 127766fc592545a4997f7790f50f6076 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:04:25.769531 19406 consensus_queue.cc:237] T 775c229504194560ba9589bc2199b089 P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:04:25.775363 20112 raft_consensus.cc:1275] T 775c229504194560ba9589bc2199b089 P 127766fc592545a4997f7790f50f6076 [term 1 FOLLOWER]: Refusing update from remote peer e5256d91808b47c195bc9b4dbd7f2b87: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:04:25.777050 20332 consensus_queue.cc:1048] T 775c229504194560ba9589bc2199b089 P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Connected to new peer: Peer: permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:04:25.778469 19483 raft_consensus.cc:1275] T 775c229504194560ba9589bc2199b089 P 0473d2b2d01f4459b1e90fd12cc7840e [term 1 FOLLOWER]: Refusing update from remote peer e5256d91808b47c195bc9b4dbd7f2b87: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:04:25.785027 20332 consensus_queue.cc:1048] T 775c229504194560ba9589bc2199b089 P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:04:25.795305 19483 raft_consensus.cc:2955] T 775c229504194560ba9589bc2199b089 P 0473d2b2d01f4459b1e90fd12cc7840e [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } } }
I20260709 13:04:25.798362 20112 raft_consensus.cc:2955] T 775c229504194560ba9589bc2199b089 P 127766fc592545a4997f7790f50f6076 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } } }
I20260709 13:04:25.791877 20332 raft_consensus.cc:2955] T 775c229504194560ba9589bc2199b089 P e5256d91808b47c195bc9b4dbd7f2b87 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } } }
I20260709 13:04:25.822453 19293 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 775c229504194560ba9589bc2199b089 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:04:25.823307 19305 catalog_manager.cc:5697] T 775c229504194560ba9589bc2199b089 P 127766fc592545a4997f7790f50f6076 reported cstate change: config changed from index 3 to 4, VOTER e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3) evicted. New cstate: current_term: 1 leader_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } } }
I20260709 13:04:25.845144 19547 tablet_service.cc:1558] Processing DeleteTablet for tablet 775c229504194560ba9589bc2199b089 with delete_type TABLET_DATA_TOMBSTONED (TS e61c3a8f61bb48f8a963c9480e53c168 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:40412
I20260709 13:04:25.851672 20337 tablet_replica.cc:333] T 775c229504194560ba9589bc2199b089 P e61c3a8f61bb48f8a963c9480e53c168: stopping tablet replica
I20260709 13:04:25.853127 20337 raft_consensus.cc:2243] T 775c229504194560ba9589bc2199b089 P e61c3a8f61bb48f8a963c9480e53c168 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:25.853760 20337 raft_consensus.cc:2272] T 775c229504194560ba9589bc2199b089 P e61c3a8f61bb48f8a963c9480e53c168 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:25.856715 20337 ts_tablet_manager.cc:1916] T 775c229504194560ba9589bc2199b089 P e61c3a8f61bb48f8a963c9480e53c168: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:04:25.872071 20337 ts_tablet_manager.cc:1929] T 775c229504194560ba9589bc2199b089 P e61c3a8f61bb48f8a963c9480e53c168: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:04:25.872572 20337 log.cc:1199] T 775c229504194560ba9589bc2199b089 P e61c3a8f61bb48f8a963c9480e53c168: Deleting WAL directory at /tmp/dist-test-taskKd2k48/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602220613947-18300-0/minicluster-data/ts-2-root/wals/775c229504194560ba9589bc2199b089
I20260709 13:04:25.874159 19294 catalog_manager.cc:5028] TS e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891): tablet 775c229504194560ba9589bc2199b089 (table test-workload [id=ce1025c73cf04c4baf25820ae7ff0a53]) successfully deleted
I20260709 13:04:26.096371 20332 raft_consensus.cc:1064] T ece3db938bc649d4a40a51522ed5259c P e5256d91808b47c195bc9b4dbd7f2b87: attempting to promote NON_VOTER 127766fc592545a4997f7790f50f6076 to VOTER
I20260709 13:04:26.097780 20327 raft_consensus.cc:1064] T 0afb57ae58a24a01850491d69f0213dd P e61c3a8f61bb48f8a963c9480e53c168: attempting to promote NON_VOTER 127766fc592545a4997f7790f50f6076 to VOTER
I20260709 13:04:26.099292 20332 consensus_queue.cc:237] T ece3db938bc649d4a40a51522ed5259c P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } attrs { replace: true } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:04:26.100188 20327 consensus_queue.cc:237] T 0afb57ae58a24a01850491d69f0213dd P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } attrs { replace: true } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:04:26.110049 20112 raft_consensus.cc:1275] T 0afb57ae58a24a01850491d69f0213dd P 127766fc592545a4997f7790f50f6076 [term 1 LEARNER]: Refusing update from remote peer e61c3a8f61bb48f8a963c9480e53c168: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:04:26.112962 20327 consensus_queue.cc:1048] T 0afb57ae58a24a01850491d69f0213dd P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Connected to new peer: Peer: permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.004s
I20260709 13:04:26.118484 19483 raft_consensus.cc:1275] T 0afb57ae58a24a01850491d69f0213dd P 0473d2b2d01f4459b1e90fd12cc7840e [term 1 FOLLOWER]: Refusing update from remote peer e61c3a8f61bb48f8a963c9480e53c168: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:04:26.123751 20340 consensus_queue.cc:1048] T 0afb57ae58a24a01850491d69f0213dd P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:04:26.126506 19406 raft_consensus.cc:1275] T 0afb57ae58a24a01850491d69f0213dd P e5256d91808b47c195bc9b4dbd7f2b87 [term 1 FOLLOWER]: Refusing update from remote peer e61c3a8f61bb48f8a963c9480e53c168: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:04:26.128815 20340 consensus_queue.cc:1048] T 0afb57ae58a24a01850491d69f0213dd P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:04:26.136494 20112 raft_consensus.cc:1275] T ece3db938bc649d4a40a51522ed5259c P 127766fc592545a4997f7790f50f6076 [term 1 LEARNER]: Refusing update from remote peer e5256d91808b47c195bc9b4dbd7f2b87: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:04:26.138039 20295 consensus_queue.cc:1048] T ece3db938bc649d4a40a51522ed5259c P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Connected to new peer: Peer: permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:04:26.156338 19556 raft_consensus.cc:1275] T ece3db938bc649d4a40a51522ed5259c P e61c3a8f61bb48f8a963c9480e53c168 [term 1 FOLLOWER]: Refusing update from remote peer e5256d91808b47c195bc9b4dbd7f2b87: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:04:26.159802 20327 raft_consensus.cc:2955] T 0afb57ae58a24a01850491d69f0213dd P e61c3a8f61bb48f8a963c9480e53c168 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 127766fc592545a4997f7790f50f6076 (127.17.223.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } attrs { replace: true } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } } }
I20260709 13:04:26.166157 20295 consensus_queue.cc:1048] T ece3db938bc649d4a40a51522ed5259c P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:04:26.174012 19483 raft_consensus.cc:1275] T ece3db938bc649d4a40a51522ed5259c P 0473d2b2d01f4459b1e90fd12cc7840e [term 1 FOLLOWER]: Refusing update from remote peer e5256d91808b47c195bc9b4dbd7f2b87: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:04:26.174548 19479 raft_consensus.cc:2955] T 0afb57ae58a24a01850491d69f0213dd P 0473d2b2d01f4459b1e90fd12cc7840e [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 127766fc592545a4997f7790f50f6076 (127.17.223.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } attrs { replace: true } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } } }
I20260709 13:04:26.180197 20295 consensus_queue.cc:1048] T ece3db938bc649d4a40a51522ed5259c P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:04:26.205289 19309 catalog_manager.cc:5697] T 0afb57ae58a24a01850491d69f0213dd P 0473d2b2d01f4459b1e90fd12cc7840e reported cstate change: config changed from index 2 to 3, 127766fc592545a4997f7790f50f6076 (127.17.223.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "e61c3a8f61bb48f8a963c9480e53c168" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } attrs { replace: true } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } } }
I20260709 13:04:26.207687 20112 raft_consensus.cc:2955] T 0afb57ae58a24a01850491d69f0213dd P 127766fc592545a4997f7790f50f6076 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 127766fc592545a4997f7790f50f6076 (127.17.223.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } attrs { replace: true } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } } }
I20260709 13:04:26.230290 19556 consensus_queue.cc:237] T 0afb57ae58a24a01850491d69f0213dd P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:04:26.230584 19407 raft_consensus.cc:2955] T 0afb57ae58a24a01850491d69f0213dd P e5256d91808b47c195bc9b4dbd7f2b87 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 127766fc592545a4997f7790f50f6076 (127.17.223.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } attrs { replace: true } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } } }
I20260709 13:04:26.238111 19479 raft_consensus.cc:2955] T ece3db938bc649d4a40a51522ed5259c P 0473d2b2d01f4459b1e90fd12cc7840e [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 127766fc592545a4997f7790f50f6076 (127.17.223.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } attrs { replace: true } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } } }
I20260709 13:04:26.239940 20288 raft_consensus.cc:2955] T ece3db938bc649d4a40a51522ed5259c P e5256d91808b47c195bc9b4dbd7f2b87 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 127766fc592545a4997f7790f50f6076 (127.17.223.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } attrs { replace: true } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } } }
I20260709 13:04:26.245657 19478 raft_consensus.cc:1275] T 0afb57ae58a24a01850491d69f0213dd P 0473d2b2d01f4459b1e90fd12cc7840e [term 1 FOLLOWER]: Refusing update from remote peer e61c3a8f61bb48f8a963c9480e53c168: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:04:26.247463 20327 consensus_queue.cc:1048] T 0afb57ae58a24a01850491d69f0213dd P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:04:26.251430 20110 raft_consensus.cc:1275] T 0afb57ae58a24a01850491d69f0213dd P 127766fc592545a4997f7790f50f6076 [term 1 FOLLOWER]: Refusing update from remote peer e61c3a8f61bb48f8a963c9480e53c168: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:04:26.255993 20302 consensus_queue.cc:1048] T 0afb57ae58a24a01850491d69f0213dd P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Connected to new peer: Peer: permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:04:26.263501 20111 raft_consensus.cc:2955] T ece3db938bc649d4a40a51522ed5259c P 127766fc592545a4997f7790f50f6076 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 127766fc592545a4997f7790f50f6076 (127.17.223.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } attrs { replace: true } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } } }
I20260709 13:04:26.264271 19556 raft_consensus.cc:2955] T ece3db938bc649d4a40a51522ed5259c P e61c3a8f61bb48f8a963c9480e53c168 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 127766fc592545a4997f7790f50f6076 (127.17.223.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } attrs { replace: true } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } } }
I20260709 13:04:26.257606 20302 raft_consensus.cc:2955] T 0afb57ae58a24a01850491d69f0213dd P e61c3a8f61bb48f8a963c9480e53c168 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } } }
I20260709 13:04:26.285185 19304 catalog_manager.cc:5697] T ece3db938bc649d4a40a51522ed5259c P 0473d2b2d01f4459b1e90fd12cc7840e reported cstate change: config changed from index 2 to 3, 127766fc592545a4997f7790f50f6076 (127.17.223.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } attrs { replace: true } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } } }
I20260709 13:04:26.286932 20110 raft_consensus.cc:2955] T 0afb57ae58a24a01850491d69f0213dd P 127766fc592545a4997f7790f50f6076 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } } }
I20260709 13:04:26.314221 19294 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 0afb57ae58a24a01850491d69f0213dd with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:04:26.316496 19478 raft_consensus.cc:2955] T 0afb57ae58a24a01850491d69f0213dd P 0473d2b2d01f4459b1e90fd12cc7840e [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } } }
I20260709 13:04:26.323251 19305 catalog_manager.cc:5697] T 0afb57ae58a24a01850491d69f0213dd P 127766fc592545a4997f7790f50f6076 reported cstate change: config changed from index 3 to 4, VOTER e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1) evicted. New cstate: current_term: 1 leader_uuid: "e61c3a8f61bb48f8a963c9480e53c168" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } } }
I20260709 13:04:26.327566 20266 raft_consensus.cc:1064] T 1f85fc4b527a48848e5faa083b604e36 P 0473d2b2d01f4459b1e90fd12cc7840e: attempting to promote NON_VOTER 127766fc592545a4997f7790f50f6076 to VOTER
I20260709 13:04:26.333047 20266 consensus_queue.cc:237] T 1f85fc4b527a48848e5faa083b604e36 P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } attrs { replace: true } } peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:04:26.350334 19407 raft_consensus.cc:1275] T 1f85fc4b527a48848e5faa083b604e36 P e5256d91808b47c195bc9b4dbd7f2b87 [term 1 FOLLOWER]: Refusing update from remote peer 0473d2b2d01f4459b1e90fd12cc7840e: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:04:26.350826 20110 raft_consensus.cc:1275] T 1f85fc4b527a48848e5faa083b604e36 P 127766fc592545a4997f7790f50f6076 [term 1 LEARNER]: Refusing update from remote peer 0473d2b2d01f4459b1e90fd12cc7840e: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:04:26.352617 20266 consensus_queue.cc:1048] T 1f85fc4b527a48848e5faa083b604e36 P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Connected to new peer: Peer: permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:04:26.352646 19556 raft_consensus.cc:1275] T 1f85fc4b527a48848e5faa083b604e36 P e61c3a8f61bb48f8a963c9480e53c168 [term 1 FOLLOWER]: Refusing update from remote peer 0473d2b2d01f4459b1e90fd12cc7840e: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:04:26.353536 20276 consensus_queue.cc:1048] T 1f85fc4b527a48848e5faa083b604e36 P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.002s
I20260709 13:04:26.356081 20344 consensus_queue.cc:1048] T 1f85fc4b527a48848e5faa083b604e36 P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:04:26.356406 19401 tablet_service.cc:1558] Processing DeleteTablet for tablet 0afb57ae58a24a01850491d69f0213dd with delete_type TABLET_DATA_TOMBSTONED (TS e5256d91808b47c195bc9b4dbd7f2b87 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:52318
I20260709 13:04:26.359253 20350 tablet_replica.cc:333] T 0afb57ae58a24a01850491d69f0213dd P e5256d91808b47c195bc9b4dbd7f2b87: stopping tablet replica
I20260709 13:04:26.360359 20350 raft_consensus.cc:2243] T 0afb57ae58a24a01850491d69f0213dd P e5256d91808b47c195bc9b4dbd7f2b87 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:26.365418 19407 consensus_queue.cc:237] T ece3db938bc649d4a40a51522ed5259c P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:04:26.373829 20111 raft_consensus.cc:1275] T ece3db938bc649d4a40a51522ed5259c P 127766fc592545a4997f7790f50f6076 [term 1 FOLLOWER]: Refusing update from remote peer e5256d91808b47c195bc9b4dbd7f2b87: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:04:26.375463 19557 raft_consensus.cc:1275] T ece3db938bc649d4a40a51522ed5259c P e61c3a8f61bb48f8a963c9480e53c168 [term 1 FOLLOWER]: Refusing update from remote peer e5256d91808b47c195bc9b4dbd7f2b87: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:04:26.379138 20295 consensus_queue.cc:1048] T ece3db938bc649d4a40a51522ed5259c P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:04:26.385871 20311 consensus_queue.cc:1048] T ece3db938bc649d4a40a51522ed5259c P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Connected to new peer: Peer: permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:04:26.400676 20295 raft_consensus.cc:2955] T ece3db938bc649d4a40a51522ed5259c P e5256d91808b47c195bc9b4dbd7f2b87 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } } }
I20260709 13:04:26.427125 20111 raft_consensus.cc:2955] T ece3db938bc649d4a40a51522ed5259c P 127766fc592545a4997f7790f50f6076 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } } }
I20260709 13:04:26.441902 19557 raft_consensus.cc:2955] T ece3db938bc649d4a40a51522ed5259c P e61c3a8f61bb48f8a963c9480e53c168 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } } }
I20260709 13:04:26.465075 20350 raft_consensus.cc:2272] T 0afb57ae58a24a01850491d69f0213dd P e5256d91808b47c195bc9b4dbd7f2b87 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:26.654721 20350 ts_tablet_manager.cc:1916] T 0afb57ae58a24a01850491d69f0213dd P e5256d91808b47c195bc9b4dbd7f2b87: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:04:26.678910 19293 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet ece3db938bc649d4a40a51522ed5259c with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:04:26.677513 19304 catalog_manager.cc:5697] T ece3db938bc649d4a40a51522ed5259c P 127766fc592545a4997f7790f50f6076 reported cstate change: config changed from index 3 to 4, VOTER 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2) evicted. New cstate: current_term: 1 leader_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } } }
I20260709 13:04:26.699610 20232 raft_consensus.cc:2955] T 1f85fc4b527a48848e5faa083b604e36 P 0473d2b2d01f4459b1e90fd12cc7840e [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 127766fc592545a4997f7790f50f6076 (127.17.223.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } attrs { replace: true } } peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } } }
I20260709 13:04:26.721030 20110 raft_consensus.cc:2955] T 1f85fc4b527a48848e5faa083b604e36 P 127766fc592545a4997f7790f50f6076 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 127766fc592545a4997f7790f50f6076 (127.17.223.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } attrs { replace: true } } peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } } }
I20260709 13:04:26.732513 19555 raft_consensus.cc:2955] T 1f85fc4b527a48848e5faa083b604e36 P e61c3a8f61bb48f8a963c9480e53c168 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 127766fc592545a4997f7790f50f6076 (127.17.223.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } attrs { replace: true } } peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } } }
I20260709 13:04:26.744956 19309 catalog_manager.cc:5697] T 1f85fc4b527a48848e5faa083b604e36 P 0473d2b2d01f4459b1e90fd12cc7840e reported cstate change: config changed from index 2 to 3, 127766fc592545a4997f7790f50f6076 (127.17.223.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:04:26.753628 19468 tablet_service.cc:1558] Processing DeleteTablet for tablet ece3db938bc649d4a40a51522ed5259c with delete_type TABLET_DATA_TOMBSTONED (TS 0473d2b2d01f4459b1e90fd12cc7840e not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:58272
I20260709 13:04:26.765444 19405 raft_consensus.cc:2955] T 1f85fc4b527a48848e5faa083b604e36 P e5256d91808b47c195bc9b4dbd7f2b87 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 127766fc592545a4997f7790f50f6076 (127.17.223.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } attrs { replace: true } } peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } } }
I20260709 13:04:26.774366 20350 ts_tablet_manager.cc:1929] T 0afb57ae58a24a01850491d69f0213dd P e5256d91808b47c195bc9b4dbd7f2b87: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:04:26.774130 19483 consensus_queue.cc:237] T 1f85fc4b527a48848e5faa083b604e36 P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:04:26.774919 20350 log.cc:1199] T 0afb57ae58a24a01850491d69f0213dd P e5256d91808b47c195bc9b4dbd7f2b87: Deleting WAL directory at /tmp/dist-test-taskKd2k48/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602220613947-18300-0/minicluster-data/ts-0-root/wals/0afb57ae58a24a01850491d69f0213dd
I20260709 13:04:26.776542 19293 catalog_manager.cc:5028] TS e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321): tablet 0afb57ae58a24a01850491d69f0213dd (table test-workload [id=ce1025c73cf04c4baf25820ae7ff0a53]) successfully deleted
I20260709 13:04:26.783906 20356 tablet_replica.cc:333] T ece3db938bc649d4a40a51522ed5259c P 0473d2b2d01f4459b1e90fd12cc7840e: stopping tablet replica
I20260709 13:04:26.785893 20356 raft_consensus.cc:2243] T ece3db938bc649d4a40a51522ed5259c P 0473d2b2d01f4459b1e90fd12cc7840e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:26.786691 20356 raft_consensus.cc:2272] T ece3db938bc649d4a40a51522ed5259c P 0473d2b2d01f4459b1e90fd12cc7840e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:26.792196 20356 ts_tablet_manager.cc:1916] T ece3db938bc649d4a40a51522ed5259c P 0473d2b2d01f4459b1e90fd12cc7840e: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:04:26.796416 19405 raft_consensus.cc:1275] T 1f85fc4b527a48848e5faa083b604e36 P e5256d91808b47c195bc9b4dbd7f2b87 [term 1 FOLLOWER]: Refusing update from remote peer 0473d2b2d01f4459b1e90fd12cc7840e: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:04:26.796695 20111 raft_consensus.cc:1275] T 1f85fc4b527a48848e5faa083b604e36 P 127766fc592545a4997f7790f50f6076 [term 1 FOLLOWER]: Refusing update from remote peer 0473d2b2d01f4459b1e90fd12cc7840e: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:04:26.804513 20354 consensus_queue.cc:1048] T 1f85fc4b527a48848e5faa083b604e36 P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:04:26.805877 20355 consensus_queue.cc:1048] T 1f85fc4b527a48848e5faa083b604e36 P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Connected to new peer: Peer: permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:04:26.812583 20266 raft_consensus.cc:2955] T 1f85fc4b527a48848e5faa083b604e36 P 0473d2b2d01f4459b1e90fd12cc7840e [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } } }
I20260709 13:04:26.815742 19405 raft_consensus.cc:2955] T 1f85fc4b527a48848e5faa083b604e36 P e5256d91808b47c195bc9b4dbd7f2b87 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } } }
I20260709 13:04:26.817625 20356 ts_tablet_manager.cc:1929] T ece3db938bc649d4a40a51522ed5259c P 0473d2b2d01f4459b1e90fd12cc7840e: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:04:26.818122 20356 log.cc:1199] T ece3db938bc649d4a40a51522ed5259c P 0473d2b2d01f4459b1e90fd12cc7840e: Deleting WAL directory at /tmp/dist-test-taskKd2k48/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602220613947-18300-0/minicluster-data/ts-1-root/wals/ece3db938bc649d4a40a51522ed5259c
I20260709 13:04:26.822772 19296 catalog_manager.cc:5028] TS 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257): tablet ece3db938bc649d4a40a51522ed5259c (table test-workload [id=ce1025c73cf04c4baf25820ae7ff0a53]) successfully deleted
I20260709 13:04:26.823449 19296 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 1f85fc4b527a48848e5faa083b604e36 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:04:26.823283 20111 raft_consensus.cc:2955] T 1f85fc4b527a48848e5faa083b604e36 P 127766fc592545a4997f7790f50f6076 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } } }
I20260709 13:04:26.829993 19306 catalog_manager.cc:5697] T 1f85fc4b527a48848e5faa083b604e36 P 0473d2b2d01f4459b1e90fd12cc7840e reported cstate change: config changed from index 3 to 4, VOTER e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3) evicted. New cstate: current_term: 1 leader_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:04:26.842521 19547 tablet_service.cc:1558] Processing DeleteTablet for tablet 1f85fc4b527a48848e5faa083b604e36 with delete_type TABLET_DATA_TOMBSTONED (TS e61c3a8f61bb48f8a963c9480e53c168 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:40412
I20260709 13:04:26.844581 20357 tablet_replica.cc:333] T 1f85fc4b527a48848e5faa083b604e36 P e61c3a8f61bb48f8a963c9480e53c168: stopping tablet replica
I20260709 13:04:26.845700 20357 raft_consensus.cc:2243] T 1f85fc4b527a48848e5faa083b604e36 P e61c3a8f61bb48f8a963c9480e53c168 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:26.846807 20357 raft_consensus.cc:2272] T 1f85fc4b527a48848e5faa083b604e36 P e61c3a8f61bb48f8a963c9480e53c168 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:26.851054 20357 ts_tablet_manager.cc:1916] T 1f85fc4b527a48848e5faa083b604e36 P e61c3a8f61bb48f8a963c9480e53c168: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:04:26.862123 20357 ts_tablet_manager.cc:1929] T 1f85fc4b527a48848e5faa083b604e36 P e61c3a8f61bb48f8a963c9480e53c168: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:04:26.862457 20357 log.cc:1199] T 1f85fc4b527a48848e5faa083b604e36 P e61c3a8f61bb48f8a963c9480e53c168: Deleting WAL directory at /tmp/dist-test-taskKd2k48/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602220613947-18300-0/minicluster-data/ts-2-root/wals/1f85fc4b527a48848e5faa083b604e36
I20260709 13:04:26.863646 19294 catalog_manager.cc:5028] TS e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891): tablet 1f85fc4b527a48848e5faa083b604e36 (table test-workload [id=ce1025c73cf04c4baf25820ae7ff0a53]) successfully deleted
I20260709 13:04:27.914965 19555 consensus_queue.cc:237] T 1efebf73c86e432baa55533136b6e12c P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } attrs { replace: true } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: NON_VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: true } }
I20260709 13:04:27.921171 19479 raft_consensus.cc:1275] T 1efebf73c86e432baa55533136b6e12c P 0473d2b2d01f4459b1e90fd12cc7840e [term 1 FOLLOWER]: Refusing update from remote peer e61c3a8f61bb48f8a963c9480e53c168: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 13:04:27.921633 19523 consensus_peers.cc:597] T 1efebf73c86e432baa55533136b6e12c P e61c3a8f61bb48f8a963c9480e53c168 -> Peer 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121): Couldn't send request to peer 127766fc592545a4997f7790f50f6076. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 1efebf73c86e432baa55533136b6e12c. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:27.922533 20302 consensus_queue.cc:1048] T 1efebf73c86e432baa55533136b6e12c P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:04:27.923251 19407 raft_consensus.cc:1275] T 1efebf73c86e432baa55533136b6e12c P e5256d91808b47c195bc9b4dbd7f2b87 [term 1 FOLLOWER]: Refusing update from remote peer e61c3a8f61bb48f8a963c9480e53c168: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:04:27.924505 20327 consensus_queue.cc:1048] T 1efebf73c86e432baa55533136b6e12c P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:04:27.929875 20302 raft_consensus.cc:2955] T 1efebf73c86e432baa55533136b6e12c P e61c3a8f61bb48f8a963c9480e53c168 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 127766fc592545a4997f7790f50f6076 (127.17.223.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } attrs { replace: true } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: NON_VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: true } } }
I20260709 13:04:27.931888 19479 raft_consensus.cc:2955] T 1efebf73c86e432baa55533136b6e12c P 0473d2b2d01f4459b1e90fd12cc7840e [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 127766fc592545a4997f7790f50f6076 (127.17.223.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } attrs { replace: true } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: NON_VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: true } } }
I20260709 13:04:27.933133 19407 raft_consensus.cc:2955] T 1efebf73c86e432baa55533136b6e12c P e5256d91808b47c195bc9b4dbd7f2b87 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 127766fc592545a4997f7790f50f6076 (127.17.223.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } attrs { replace: true } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: NON_VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: true } } }
I20260709 13:04:27.945600 19407 consensus_queue.cc:237] T ff9b0eddd810459b82d91c60777c10eb P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } attrs { replace: true } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: NON_VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: true } }
I20260709 13:04:27.950742 19304 catalog_manager.cc:5697] T 1efebf73c86e432baa55533136b6e12c P e5256d91808b47c195bc9b4dbd7f2b87 reported cstate change: config changed from index -1 to 2, NON_VOTER 127766fc592545a4997f7790f50f6076 (127.17.223.4) added. New cstate: current_term: 1 leader_uuid: "e61c3a8f61bb48f8a963c9480e53c168" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } attrs { replace: true } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: NON_VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: true } } }
I20260709 13:04:27.961964 19557 raft_consensus.cc:1275] T ff9b0eddd810459b82d91c60777c10eb P e61c3a8f61bb48f8a963c9480e53c168 [term 1 FOLLOWER]: Refusing update from remote peer e5256d91808b47c195bc9b4dbd7f2b87: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:04:27.963305 19479 raft_consensus.cc:1275] T ff9b0eddd810459b82d91c60777c10eb P 0473d2b2d01f4459b1e90fd12cc7840e [term 1 FOLLOWER]: Refusing update from remote peer e5256d91808b47c195bc9b4dbd7f2b87: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 13:04:27.964000 19374 consensus_peers.cc:597] T ff9b0eddd810459b82d91c60777c10eb P e5256d91808b47c195bc9b4dbd7f2b87 -> Peer 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121): Couldn't send request to peer 127766fc592545a4997f7790f50f6076. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: ff9b0eddd810459b82d91c60777c10eb. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:27.964987 20295 consensus_queue.cc:1048] T ff9b0eddd810459b82d91c60777c10eb P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:04:27.966544 20295 consensus_queue.cc:1048] T ff9b0eddd810459b82d91c60777c10eb P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:04:27.975677 20363 raft_consensus.cc:2955] T ff9b0eddd810459b82d91c60777c10eb P e5256d91808b47c195bc9b4dbd7f2b87 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 127766fc592545a4997f7790f50f6076 (127.17.223.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } attrs { replace: true } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: NON_VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: true } } }
I20260709 13:04:27.977622 19557 raft_consensus.cc:2955] T ff9b0eddd810459b82d91c60777c10eb P e61c3a8f61bb48f8a963c9480e53c168 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 127766fc592545a4997f7790f50f6076 (127.17.223.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } attrs { replace: true } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: NON_VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: true } } }
I20260709 13:04:27.978395 19479 raft_consensus.cc:2955] T ff9b0eddd810459b82d91c60777c10eb P 0473d2b2d01f4459b1e90fd12cc7840e [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 127766fc592545a4997f7790f50f6076 (127.17.223.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } attrs { replace: true } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: NON_VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: true } } }
I20260709 13:04:28.008664 19306 catalog_manager.cc:5697] T ff9b0eddd810459b82d91c60777c10eb P e5256d91808b47c195bc9b4dbd7f2b87 reported cstate change: config changed from index -1 to 2, NON_VOTER 127766fc592545a4997f7790f50f6076 (127.17.223.4) added. New cstate: current_term: 1 leader_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: NON_VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:28.015928 19555 consensus_queue.cc:237] T fa731b585f684a7fb2d106c50f143b83 P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } attrs { replace: true } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: NON_VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: true } }
I20260709 13:04:28.022908 19479 raft_consensus.cc:1275] T fa731b585f684a7fb2d106c50f143b83 P 0473d2b2d01f4459b1e90fd12cc7840e [term 1 FOLLOWER]: Refusing update from remote peer e61c3a8f61bb48f8a963c9480e53c168: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:04:28.024971 20327 consensus_queue.cc:1048] T fa731b585f684a7fb2d106c50f143b83 P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:04:28.027707 19523 consensus_peers.cc:597] T fa731b585f684a7fb2d106c50f143b83 P e61c3a8f61bb48f8a963c9480e53c168 -> Peer 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121): Couldn't send request to peer 127766fc592545a4997f7790f50f6076. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: fa731b585f684a7fb2d106c50f143b83. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:28.029264 19407 raft_consensus.cc:1275] T fa731b585f684a7fb2d106c50f143b83 P e5256d91808b47c195bc9b4dbd7f2b87 [term 1 FOLLOWER]: Refusing update from remote peer e61c3a8f61bb48f8a963c9480e53c168: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:04:28.031170 20302 consensus_queue.cc:1048] T fa731b585f684a7fb2d106c50f143b83 P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:04:28.034267 20370 raft_consensus.cc:2955] T fa731b585f684a7fb2d106c50f143b83 P e61c3a8f61bb48f8a963c9480e53c168 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 127766fc592545a4997f7790f50f6076 (127.17.223.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } attrs { replace: true } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: NON_VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: true } } }
I20260709 13:04:28.037144 19479 raft_consensus.cc:2955] T fa731b585f684a7fb2d106c50f143b83 P 0473d2b2d01f4459b1e90fd12cc7840e [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 127766fc592545a4997f7790f50f6076 (127.17.223.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } attrs { replace: true } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: NON_VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: true } } }
I20260709 13:04:28.047874 19407 raft_consensus.cc:2955] T fa731b585f684a7fb2d106c50f143b83 P e5256d91808b47c195bc9b4dbd7f2b87 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 127766fc592545a4997f7790f50f6076 (127.17.223.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } attrs { replace: true } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: NON_VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: true } } }
I20260709 13:04:28.052219 19555 consensus_queue.cc:237] T ed7fdbcb96d14d418db9ca90a792588a P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } attrs { replace: true } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: NON_VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: true } }
I20260709 13:04:28.052001 19309 catalog_manager.cc:5697] T fa731b585f684a7fb2d106c50f143b83 P e61c3a8f61bb48f8a963c9480e53c168 reported cstate change: config changed from index -1 to 2, NON_VOTER 127766fc592545a4997f7790f50f6076 (127.17.223.4) added. New cstate: current_term: 1 leader_uuid: "e61c3a8f61bb48f8a963c9480e53c168" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: NON_VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
W20260709 13:04:28.067217 19523 consensus_peers.cc:597] T ed7fdbcb96d14d418db9ca90a792588a P e61c3a8f61bb48f8a963c9480e53c168 -> Peer 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121): Couldn't send request to peer 127766fc592545a4997f7790f50f6076. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: ed7fdbcb96d14d418db9ca90a792588a. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:28.069658 19407 raft_consensus.cc:1275] T ed7fdbcb96d14d418db9ca90a792588a P e5256d91808b47c195bc9b4dbd7f2b87 [term 1 FOLLOWER]: Refusing update from remote peer e61c3a8f61bb48f8a963c9480e53c168: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:04:28.071403 20370 consensus_queue.cc:1048] T ed7fdbcb96d14d418db9ca90a792588a P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:04:28.080960 20302 raft_consensus.cc:2955] T ed7fdbcb96d14d418db9ca90a792588a P e61c3a8f61bb48f8a963c9480e53c168 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 127766fc592545a4997f7790f50f6076 (127.17.223.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } attrs { replace: true } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: NON_VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: true } } }
I20260709 13:04:28.082875 19407 raft_consensus.cc:2955] T ed7fdbcb96d14d418db9ca90a792588a P e5256d91808b47c195bc9b4dbd7f2b87 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 127766fc592545a4997f7790f50f6076 (127.17.223.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } attrs { replace: true } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: NON_VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: true } } }
I20260709 13:04:28.081616 19479 raft_consensus.cc:1275] T ed7fdbcb96d14d418db9ca90a792588a P 0473d2b2d01f4459b1e90fd12cc7840e [term 1 FOLLOWER]: Refusing update from remote peer e61c3a8f61bb48f8a963c9480e53c168: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:04:28.087047 20370 consensus_queue.cc:1048] T ed7fdbcb96d14d418db9ca90a792588a P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:04:28.095670 19483 raft_consensus.cc:2955] T ed7fdbcb96d14d418db9ca90a792588a P 0473d2b2d01f4459b1e90fd12cc7840e [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 127766fc592545a4997f7790f50f6076 (127.17.223.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } attrs { replace: true } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: NON_VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: true } } }
I20260709 13:04:28.105852 19306 catalog_manager.cc:5697] T ed7fdbcb96d14d418db9ca90a792588a P e61c3a8f61bb48f8a963c9480e53c168 reported cstate change: config changed from index -1 to 2, NON_VOTER 127766fc592545a4997f7790f50f6076 (127.17.223.4) added. New cstate: current_term: 1 leader_uuid: "e61c3a8f61bb48f8a963c9480e53c168" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: NON_VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:28.457451 20376 ts_tablet_manager.cc:933] T 1efebf73c86e432baa55533136b6e12c P 127766fc592545a4997f7790f50f6076: Initiating tablet copy from peer e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:04:28.459754 20376 tablet_copy_client.cc:323] T 1efebf73c86e432baa55533136b6e12c P 127766fc592545a4997f7790f50f6076: tablet copy: Beginning tablet copy session from remote peer at address 127.17.223.3:36891
I20260709 13:04:28.461472 19570 tablet_copy_service.cc:140] P e61c3a8f61bb48f8a963c9480e53c168: Received BeginTabletCopySession request for tablet 1efebf73c86e432baa55533136b6e12c from peer 127766fc592545a4997f7790f50f6076 ({username='slave'} at 127.0.0.1:41504)
I20260709 13:04:28.461989 19570 tablet_copy_service.cc:161] P e61c3a8f61bb48f8a963c9480e53c168: Beginning new tablet copy session on tablet 1efebf73c86e432baa55533136b6e12c from peer 127766fc592545a4997f7790f50f6076 at {username='slave'} at 127.0.0.1:41504: session id = 127766fc592545a4997f7790f50f6076-1efebf73c86e432baa55533136b6e12c
I20260709 13:04:28.470906 19570 tablet_copy_source_session.cc:215] T 1efebf73c86e432baa55533136b6e12c P e61c3a8f61bb48f8a963c9480e53c168: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:04:28.473731 20376 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1efebf73c86e432baa55533136b6e12c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:28.488776 20376 tablet_copy_client.cc:806] T 1efebf73c86e432baa55533136b6e12c P 127766fc592545a4997f7790f50f6076: tablet copy: Starting download of 0 data blocks...
I20260709 13:04:28.489373 20376 tablet_copy_client.cc:670] T 1efebf73c86e432baa55533136b6e12c P 127766fc592545a4997f7790f50f6076: tablet copy: Starting download of 1 WAL segments...
I20260709 13:04:28.496770 20376 tablet_copy_client.cc:538] T 1efebf73c86e432baa55533136b6e12c P 127766fc592545a4997f7790f50f6076: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:04:28.503314 20378 ts_tablet_manager.cc:933] T ff9b0eddd810459b82d91c60777c10eb P 127766fc592545a4997f7790f50f6076: Initiating tablet copy from peer e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321)
I20260709 13:04:28.508059 20376 tablet_bootstrap.cc:492] T 1efebf73c86e432baa55533136b6e12c P 127766fc592545a4997f7790f50f6076: Bootstrap starting.
I20260709 13:04:28.521660 20379 ts_tablet_manager.cc:933] T fa731b585f684a7fb2d106c50f143b83 P 127766fc592545a4997f7790f50f6076: Initiating tablet copy from peer e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:04:28.524438 20378 tablet_copy_client.cc:323] T ff9b0eddd810459b82d91c60777c10eb P 127766fc592545a4997f7790f50f6076: tablet copy: Beginning tablet copy session from remote peer at address 127.17.223.1:40321
I20260709 13:04:28.526780 19421 tablet_copy_service.cc:140] P e5256d91808b47c195bc9b4dbd7f2b87: Received BeginTabletCopySession request for tablet ff9b0eddd810459b82d91c60777c10eb from peer 127766fc592545a4997f7790f50f6076 ({username='slave'} at 127.0.0.1:49050)
I20260709 13:04:28.527274 19421 tablet_copy_service.cc:161] P e5256d91808b47c195bc9b4dbd7f2b87: Beginning new tablet copy session on tablet ff9b0eddd810459b82d91c60777c10eb from peer 127766fc592545a4997f7790f50f6076 at {username='slave'} at 127.0.0.1:49050: session id = 127766fc592545a4997f7790f50f6076-ff9b0eddd810459b82d91c60777c10eb
I20260709 13:04:28.559000 19421 tablet_copy_source_session.cc:215] T ff9b0eddd810459b82d91c60777c10eb P e5256d91808b47c195bc9b4dbd7f2b87: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:04:28.561599 20379 tablet_copy_client.cc:323] T fa731b585f684a7fb2d106c50f143b83 P 127766fc592545a4997f7790f50f6076: tablet copy: Beginning tablet copy session from remote peer at address 127.17.223.3:36891
I20260709 13:04:28.562129 20378 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ff9b0eddd810459b82d91c60777c10eb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:28.563452 19570 tablet_copy_service.cc:140] P e61c3a8f61bb48f8a963c9480e53c168: Received BeginTabletCopySession request for tablet fa731b585f684a7fb2d106c50f143b83 from peer 127766fc592545a4997f7790f50f6076 ({username='slave'} at 127.0.0.1:41504)
I20260709 13:04:28.564024 19570 tablet_copy_service.cc:161] P e61c3a8f61bb48f8a963c9480e53c168: Beginning new tablet copy session on tablet fa731b585f684a7fb2d106c50f143b83 from peer 127766fc592545a4997f7790f50f6076 at {username='slave'} at 127.0.0.1:41504: session id = 127766fc592545a4997f7790f50f6076-fa731b585f684a7fb2d106c50f143b83
I20260709 13:04:28.571185 20376 tablet_bootstrap.cc:492] T 1efebf73c86e432baa55533136b6e12c P 127766fc592545a4997f7790f50f6076: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:04:28.571456 19570 tablet_copy_source_session.cc:215] T fa731b585f684a7fb2d106c50f143b83 P e61c3a8f61bb48f8a963c9480e53c168: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:04:28.572213 20376 tablet_bootstrap.cc:492] T 1efebf73c86e432baa55533136b6e12c P 127766fc592545a4997f7790f50f6076: Bootstrap complete.
I20260709 13:04:28.572954 20376 ts_tablet_manager.cc:1403] T 1efebf73c86e432baa55533136b6e12c P 127766fc592545a4997f7790f50f6076: Time spent bootstrapping tablet: real 0.065s	user 0.015s	sys 0.009s
I20260709 13:04:28.576548 20379 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fa731b585f684a7fb2d106c50f143b83. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:28.576653 20376 raft_consensus.cc:359] T 1efebf73c86e432baa55533136b6e12c P 127766fc592545a4997f7790f50f6076 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } attrs { replace: true } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: NON_VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: true } }
I20260709 13:04:28.581812 20376 raft_consensus.cc:740] T 1efebf73c86e432baa55533136b6e12c P 127766fc592545a4997f7790f50f6076 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 127766fc592545a4997f7790f50f6076, State: Initialized, Role: LEARNER
I20260709 13:04:28.593990 20378 tablet_copy_client.cc:806] T ff9b0eddd810459b82d91c60777c10eb P 127766fc592545a4997f7790f50f6076: tablet copy: Starting download of 0 data blocks...
I20260709 13:04:28.582862 20376 consensus_queue.cc:260] T 1efebf73c86e432baa55533136b6e12c P 127766fc592545a4997f7790f50f6076 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } attrs { replace: true } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: NON_VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: true } }
I20260709 13:04:28.599856 20379 tablet_copy_client.cc:806] T fa731b585f684a7fb2d106c50f143b83 P 127766fc592545a4997f7790f50f6076: tablet copy: Starting download of 0 data blocks...
I20260709 13:04:28.600366 20378 tablet_copy_client.cc:670] T ff9b0eddd810459b82d91c60777c10eb P 127766fc592545a4997f7790f50f6076: tablet copy: Starting download of 1 WAL segments...
I20260709 13:04:28.600544 20379 tablet_copy_client.cc:670] T fa731b585f684a7fb2d106c50f143b83 P 127766fc592545a4997f7790f50f6076: tablet copy: Starting download of 1 WAL segments...
I20260709 13:04:28.605340 20376 ts_tablet_manager.cc:1434] T 1efebf73c86e432baa55533136b6e12c P 127766fc592545a4997f7790f50f6076: Time spent starting tablet: real 0.032s	user 0.006s	sys 0.002s
I20260709 13:04:28.606032 20378 tablet_copy_client.cc:538] T ff9b0eddd810459b82d91c60777c10eb P 127766fc592545a4997f7790f50f6076: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:04:28.607137 19570 tablet_copy_service.cc:342] P e61c3a8f61bb48f8a963c9480e53c168: Request end of tablet copy session 127766fc592545a4997f7790f50f6076-1efebf73c86e432baa55533136b6e12c received from {username='slave'} at 127.0.0.1:41504
I20260709 13:04:28.607594 19570 tablet_copy_service.cc:434] P e61c3a8f61bb48f8a963c9480e53c168: ending tablet copy session 127766fc592545a4997f7790f50f6076-1efebf73c86e432baa55533136b6e12c on tablet 1efebf73c86e432baa55533136b6e12c with peer 127766fc592545a4997f7790f50f6076
I20260709 13:04:28.607157 20379 tablet_copy_client.cc:538] T fa731b585f684a7fb2d106c50f143b83 P 127766fc592545a4997f7790f50f6076: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:04:28.620277 20379 tablet_bootstrap.cc:492] T fa731b585f684a7fb2d106c50f143b83 P 127766fc592545a4997f7790f50f6076: Bootstrap starting.
I20260709 13:04:28.626443 20378 tablet_bootstrap.cc:492] T ff9b0eddd810459b82d91c60777c10eb P 127766fc592545a4997f7790f50f6076: Bootstrap starting.
I20260709 13:04:28.655160 20379 tablet_bootstrap.cc:492] T fa731b585f684a7fb2d106c50f143b83 P 127766fc592545a4997f7790f50f6076: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:04:28.655828 20378 tablet_bootstrap.cc:492] T ff9b0eddd810459b82d91c60777c10eb P 127766fc592545a4997f7790f50f6076: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:04:28.655952 20379 tablet_bootstrap.cc:492] T fa731b585f684a7fb2d106c50f143b83 P 127766fc592545a4997f7790f50f6076: Bootstrap complete.
I20260709 13:04:28.656639 20379 ts_tablet_manager.cc:1403] T fa731b585f684a7fb2d106c50f143b83 P 127766fc592545a4997f7790f50f6076: Time spent bootstrapping tablet: real 0.038s	user 0.024s	sys 0.010s
I20260709 13:04:28.656795 20378 tablet_bootstrap.cc:492] T ff9b0eddd810459b82d91c60777c10eb P 127766fc592545a4997f7790f50f6076: Bootstrap complete.
I20260709 13:04:28.657469 20378 ts_tablet_manager.cc:1403] T ff9b0eddd810459b82d91c60777c10eb P 127766fc592545a4997f7790f50f6076: Time spent bootstrapping tablet: real 0.031s	user 0.019s	sys 0.003s
I20260709 13:04:28.659062 20379 raft_consensus.cc:359] T fa731b585f684a7fb2d106c50f143b83 P 127766fc592545a4997f7790f50f6076 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } attrs { replace: true } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: NON_VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: true } }
I20260709 13:04:28.659725 20379 raft_consensus.cc:740] T fa731b585f684a7fb2d106c50f143b83 P 127766fc592545a4997f7790f50f6076 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 127766fc592545a4997f7790f50f6076, State: Initialized, Role: LEARNER
I20260709 13:04:28.660228 20379 consensus_queue.cc:260] T fa731b585f684a7fb2d106c50f143b83 P 127766fc592545a4997f7790f50f6076 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } attrs { replace: true } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: NON_VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: true } }
I20260709 13:04:28.660315 20378 raft_consensus.cc:359] T ff9b0eddd810459b82d91c60777c10eb P 127766fc592545a4997f7790f50f6076 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } attrs { replace: true } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: NON_VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: true } }
I20260709 13:04:28.661515 20378 raft_consensus.cc:740] T ff9b0eddd810459b82d91c60777c10eb P 127766fc592545a4997f7790f50f6076 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 127766fc592545a4997f7790f50f6076, State: Initialized, Role: LEARNER
I20260709 13:04:28.662184 20378 consensus_queue.cc:260] T ff9b0eddd810459b82d91c60777c10eb P 127766fc592545a4997f7790f50f6076 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } attrs { replace: true } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: NON_VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: true } }
I20260709 13:04:28.662846 20379 ts_tablet_manager.cc:1434] T fa731b585f684a7fb2d106c50f143b83 P 127766fc592545a4997f7790f50f6076: Time spent starting tablet: real 0.006s	user 0.008s	sys 0.000s
I20260709 13:04:28.668732 20378 ts_tablet_manager.cc:1434] T ff9b0eddd810459b82d91c60777c10eb P 127766fc592545a4997f7790f50f6076: Time spent starting tablet: real 0.011s	user 0.007s	sys 0.000s
I20260709 13:04:28.669166 19570 tablet_copy_service.cc:342] P e61c3a8f61bb48f8a963c9480e53c168: Request end of tablet copy session 127766fc592545a4997f7790f50f6076-fa731b585f684a7fb2d106c50f143b83 received from {username='slave'} at 127.0.0.1:41504
I20260709 13:04:28.669587 19570 tablet_copy_service.cc:434] P e61c3a8f61bb48f8a963c9480e53c168: ending tablet copy session 127766fc592545a4997f7790f50f6076-fa731b585f684a7fb2d106c50f143b83 on tablet fa731b585f684a7fb2d106c50f143b83 with peer 127766fc592545a4997f7790f50f6076
I20260709 13:04:28.670349 19421 tablet_copy_service.cc:342] P e5256d91808b47c195bc9b4dbd7f2b87: Request end of tablet copy session 127766fc592545a4997f7790f50f6076-ff9b0eddd810459b82d91c60777c10eb received from {username='slave'} at 127.0.0.1:49050
I20260709 13:04:28.670809 19421 tablet_copy_service.cc:434] P e5256d91808b47c195bc9b4dbd7f2b87: ending tablet copy session 127766fc592545a4997f7790f50f6076-ff9b0eddd810459b82d91c60777c10eb on tablet ff9b0eddd810459b82d91c60777c10eb with peer 127766fc592545a4997f7790f50f6076
I20260709 13:04:28.706097 20378 ts_tablet_manager.cc:933] T ed7fdbcb96d14d418db9ca90a792588a P 127766fc592545a4997f7790f50f6076: Initiating tablet copy from peer e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:04:28.712543 20378 tablet_copy_client.cc:323] T ed7fdbcb96d14d418db9ca90a792588a P 127766fc592545a4997f7790f50f6076: tablet copy: Beginning tablet copy session from remote peer at address 127.17.223.3:36891
I20260709 13:04:28.714144 19570 tablet_copy_service.cc:140] P e61c3a8f61bb48f8a963c9480e53c168: Received BeginTabletCopySession request for tablet ed7fdbcb96d14d418db9ca90a792588a from peer 127766fc592545a4997f7790f50f6076 ({username='slave'} at 127.0.0.1:41504)
I20260709 13:04:28.714643 19570 tablet_copy_service.cc:161] P e61c3a8f61bb48f8a963c9480e53c168: Beginning new tablet copy session on tablet ed7fdbcb96d14d418db9ca90a792588a from peer 127766fc592545a4997f7790f50f6076 at {username='slave'} at 127.0.0.1:41504: session id = 127766fc592545a4997f7790f50f6076-ed7fdbcb96d14d418db9ca90a792588a
I20260709 13:04:28.721521 19570 tablet_copy_source_session.cc:215] T ed7fdbcb96d14d418db9ca90a792588a P e61c3a8f61bb48f8a963c9480e53c168: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:04:28.724193 20378 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ed7fdbcb96d14d418db9ca90a792588a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:28.742002 20378 tablet_copy_client.cc:806] T ed7fdbcb96d14d418db9ca90a792588a P 127766fc592545a4997f7790f50f6076: tablet copy: Starting download of 0 data blocks...
I20260709 13:04:28.742630 20378 tablet_copy_client.cc:670] T ed7fdbcb96d14d418db9ca90a792588a P 127766fc592545a4997f7790f50f6076: tablet copy: Starting download of 1 WAL segments...
I20260709 13:04:28.748181 20378 tablet_copy_client.cc:538] T ed7fdbcb96d14d418db9ca90a792588a P 127766fc592545a4997f7790f50f6076: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:04:28.756997 20378 tablet_bootstrap.cc:492] T ed7fdbcb96d14d418db9ca90a792588a P 127766fc592545a4997f7790f50f6076: Bootstrap starting.
I20260709 13:04:28.777007 20378 tablet_bootstrap.cc:492] T ed7fdbcb96d14d418db9ca90a792588a P 127766fc592545a4997f7790f50f6076: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:04:28.777894 20378 tablet_bootstrap.cc:492] T ed7fdbcb96d14d418db9ca90a792588a P 127766fc592545a4997f7790f50f6076: Bootstrap complete.
I20260709 13:04:28.778542 20378 ts_tablet_manager.cc:1403] T ed7fdbcb96d14d418db9ca90a792588a P 127766fc592545a4997f7790f50f6076: Time spent bootstrapping tablet: real 0.022s	user 0.019s	sys 0.001s
I20260709 13:04:28.781368 20378 raft_consensus.cc:359] T ed7fdbcb96d14d418db9ca90a792588a P 127766fc592545a4997f7790f50f6076 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } attrs { replace: true } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: NON_VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: true } }
I20260709 13:04:28.782191 20378 raft_consensus.cc:740] T ed7fdbcb96d14d418db9ca90a792588a P 127766fc592545a4997f7790f50f6076 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 127766fc592545a4997f7790f50f6076, State: Initialized, Role: LEARNER
I20260709 13:04:28.782843 20378 consensus_queue.cc:260] T ed7fdbcb96d14d418db9ca90a792588a P 127766fc592545a4997f7790f50f6076 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } attrs { replace: true } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: NON_VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: true } }
I20260709 13:04:28.786194 20378 ts_tablet_manager.cc:1434] T ed7fdbcb96d14d418db9ca90a792588a P 127766fc592545a4997f7790f50f6076: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 13:04:28.787719 19570 tablet_copy_service.cc:342] P e61c3a8f61bb48f8a963c9480e53c168: Request end of tablet copy session 127766fc592545a4997f7790f50f6076-ed7fdbcb96d14d418db9ca90a792588a received from {username='slave'} at 127.0.0.1:41504
I20260709 13:04:28.788075 19570 tablet_copy_service.cc:434] P e61c3a8f61bb48f8a963c9480e53c168: ending tablet copy session 127766fc592545a4997f7790f50f6076-ed7fdbcb96d14d418db9ca90a792588a on tablet ed7fdbcb96d14d418db9ca90a792588a with peer 127766fc592545a4997f7790f50f6076
I20260709 13:04:29.003857 20111 raft_consensus.cc:1217] T fa731b585f684a7fb2d106c50f143b83 P 127766fc592545a4997f7790f50f6076 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:04:29.053023 20111 raft_consensus.cc:1217] T 1efebf73c86e432baa55533136b6e12c P 127766fc592545a4997f7790f50f6076 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:04:29.085393 20111 raft_consensus.cc:1217] T ff9b0eddd810459b82d91c60777c10eb P 127766fc592545a4997f7790f50f6076 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:04:29.153278 20111 raft_consensus.cc:1217] T ed7fdbcb96d14d418db9ca90a792588a P 127766fc592545a4997f7790f50f6076 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:04:29.455772 20388 raft_consensus.cc:1064] T fa731b585f684a7fb2d106c50f143b83 P e61c3a8f61bb48f8a963c9480e53c168: attempting to promote NON_VOTER 127766fc592545a4997f7790f50f6076 to VOTER
I20260709 13:04:29.458424 20388 consensus_queue.cc:237] T fa731b585f684a7fb2d106c50f143b83 P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } attrs { replace: true } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:04:29.465808 19483 raft_consensus.cc:1275] T fa731b585f684a7fb2d106c50f143b83 P 0473d2b2d01f4459b1e90fd12cc7840e [term 1 FOLLOWER]: Refusing update from remote peer e61c3a8f61bb48f8a963c9480e53c168: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:04:29.466028 20112 raft_consensus.cc:1275] T fa731b585f684a7fb2d106c50f143b83 P 127766fc592545a4997f7790f50f6076 [term 1 LEARNER]: Refusing update from remote peer e61c3a8f61bb48f8a963c9480e53c168: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:04:29.467389 20388 consensus_queue.cc:1048] T fa731b585f684a7fb2d106c50f143b83 P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:04:29.468586 20302 consensus_queue.cc:1048] T fa731b585f684a7fb2d106c50f143b83 P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Connected to new peer: Peer: permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:04:29.469223 19405 raft_consensus.cc:1275] T fa731b585f684a7fb2d106c50f143b83 P e5256d91808b47c195bc9b4dbd7f2b87 [term 1 FOLLOWER]: Refusing update from remote peer e61c3a8f61bb48f8a963c9480e53c168: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:04:29.472842 20387 consensus_queue.cc:1048] T fa731b585f684a7fb2d106c50f143b83 P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:04:29.490808 20388 raft_consensus.cc:1064] T 1efebf73c86e432baa55533136b6e12c P e61c3a8f61bb48f8a963c9480e53c168: attempting to promote NON_VOTER 127766fc592545a4997f7790f50f6076 to VOTER
I20260709 13:04:29.493274 20388 consensus_queue.cc:237] T 1efebf73c86e432baa55533136b6e12c P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } attrs { replace: true } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:04:29.492915 20387 raft_consensus.cc:2955] T fa731b585f684a7fb2d106c50f143b83 P e61c3a8f61bb48f8a963c9480e53c168 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 127766fc592545a4997f7790f50f6076 (127.17.223.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } attrs { replace: true } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } } }
I20260709 13:04:29.495828 19483 raft_consensus.cc:2955] T fa731b585f684a7fb2d106c50f143b83 P 0473d2b2d01f4459b1e90fd12cc7840e [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 127766fc592545a4997f7790f50f6076 (127.17.223.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } attrs { replace: true } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } } }
I20260709 13:04:29.495942 19408 raft_consensus.cc:2955] T fa731b585f684a7fb2d106c50f143b83 P e5256d91808b47c195bc9b4dbd7f2b87 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 127766fc592545a4997f7790f50f6076 (127.17.223.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } attrs { replace: true } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } } }
I20260709 13:04:29.509439 20111 raft_consensus.cc:1275] T 1efebf73c86e432baa55533136b6e12c P 127766fc592545a4997f7790f50f6076 [term 1 LEARNER]: Refusing update from remote peer e61c3a8f61bb48f8a963c9480e53c168: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:04:29.510902 20302 consensus_queue.cc:1048] T 1efebf73c86e432baa55533136b6e12c P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Connected to new peer: Peer: permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:04:29.513790 19479 raft_consensus.cc:1275] T 1efebf73c86e432baa55533136b6e12c P 0473d2b2d01f4459b1e90fd12cc7840e [term 1 FOLLOWER]: Refusing update from remote peer e61c3a8f61bb48f8a963c9480e53c168: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:04:29.524230 19408 raft_consensus.cc:1275] T 1efebf73c86e432baa55533136b6e12c P e5256d91808b47c195bc9b4dbd7f2b87 [term 1 FOLLOWER]: Refusing update from remote peer e61c3a8f61bb48f8a963c9480e53c168: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:04:29.526836 20386 consensus_queue.cc:1048] T 1efebf73c86e432baa55533136b6e12c P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:04:29.527500 19306 catalog_manager.cc:5697] T fa731b585f684a7fb2d106c50f143b83 P e5256d91808b47c195bc9b4dbd7f2b87 reported cstate change: config changed from index 2 to 3, 127766fc592545a4997f7790f50f6076 (127.17.223.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "e61c3a8f61bb48f8a963c9480e53c168" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } attrs { replace: true } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } } }
I20260709 13:04:29.531695 20111 raft_consensus.cc:2955] T fa731b585f684a7fb2d106c50f143b83 P 127766fc592545a4997f7790f50f6076 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 127766fc592545a4997f7790f50f6076 (127.17.223.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } attrs { replace: true } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } } }
I20260709 13:04:29.531924 20386 consensus_queue.cc:1048] T 1efebf73c86e432baa55533136b6e12c P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:04:29.562119 20386 raft_consensus.cc:2955] T 1efebf73c86e432baa55533136b6e12c P e61c3a8f61bb48f8a963c9480e53c168 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 127766fc592545a4997f7790f50f6076 (127.17.223.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } attrs { replace: true } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } } }
I20260709 13:04:29.567934 19408 raft_consensus.cc:2955] T 1efebf73c86e432baa55533136b6e12c P e5256d91808b47c195bc9b4dbd7f2b87 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 127766fc592545a4997f7790f50f6076 (127.17.223.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } attrs { replace: true } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } } }
I20260709 13:04:29.578274 19483 raft_consensus.cc:2955] T 1efebf73c86e432baa55533136b6e12c P 0473d2b2d01f4459b1e90fd12cc7840e [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 127766fc592545a4997f7790f50f6076 (127.17.223.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } attrs { replace: true } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } } }
I20260709 13:04:29.578804 20111 raft_consensus.cc:2955] T 1efebf73c86e432baa55533136b6e12c P 127766fc592545a4997f7790f50f6076 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 127766fc592545a4997f7790f50f6076 (127.17.223.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } attrs { replace: true } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } } }
I20260709 13:04:29.616040 19557 consensus_queue.cc:237] T fa731b585f684a7fb2d106c50f143b83 P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:04:29.638082 20363 raft_consensus.cc:1064] T ff9b0eddd810459b82d91c60777c10eb P e5256d91808b47c195bc9b4dbd7f2b87: attempting to promote NON_VOTER 127766fc592545a4997f7790f50f6076 to VOTER
I20260709 13:04:29.638167 19304 catalog_manager.cc:5697] T 1efebf73c86e432baa55533136b6e12c P 127766fc592545a4997f7790f50f6076 reported cstate change: config changed from index 2 to 3, 127766fc592545a4997f7790f50f6076 (127.17.223.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "e61c3a8f61bb48f8a963c9480e53c168" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } attrs { replace: true } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } } }
I20260709 13:04:29.641831 20112 raft_consensus.cc:1275] T fa731b585f684a7fb2d106c50f143b83 P 127766fc592545a4997f7790f50f6076 [term 1 FOLLOWER]: Refusing update from remote peer e61c3a8f61bb48f8a963c9480e53c168: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:04:29.641145 20363 consensus_queue.cc:237] T ff9b0eddd810459b82d91c60777c10eb P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } attrs { replace: true } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:04:29.652541 20302 consensus_queue.cc:1048] T fa731b585f684a7fb2d106c50f143b83 P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Connected to new peer: Peer: permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:04:29.661463 19407 raft_consensus.cc:1275] T fa731b585f684a7fb2d106c50f143b83 P e5256d91808b47c195bc9b4dbd7f2b87 [term 1 FOLLOWER]: Refusing update from remote peer e61c3a8f61bb48f8a963c9480e53c168: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:04:29.664841 20386 raft_consensus.cc:2955] T fa731b585f684a7fb2d106c50f143b83 P e61c3a8f61bb48f8a963c9480e53c168 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } } }
I20260709 13:04:29.677229 20112 raft_consensus.cc:1275] T ff9b0eddd810459b82d91c60777c10eb P 127766fc592545a4997f7790f50f6076 [term 1 LEARNER]: Refusing update from remote peer e5256d91808b47c195bc9b4dbd7f2b87: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:04:29.681231 20407 consensus_queue.cc:1048] T ff9b0eddd810459b82d91c60777c10eb P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Connected to new peer: Peer: permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:04:29.683847 20387 consensus_queue.cc:1048] T fa731b585f684a7fb2d106c50f143b83 P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:04:29.684312 19557 raft_consensus.cc:1275] T ff9b0eddd810459b82d91c60777c10eb P e61c3a8f61bb48f8a963c9480e53c168 [term 1 FOLLOWER]: Refusing update from remote peer e5256d91808b47c195bc9b4dbd7f2b87: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:04:29.687376 20112 raft_consensus.cc:2955] T fa731b585f684a7fb2d106c50f143b83 P 127766fc592545a4997f7790f50f6076 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } } }
I20260709 13:04:29.696909 19479 raft_consensus.cc:1275] T ff9b0eddd810459b82d91c60777c10eb P 0473d2b2d01f4459b1e90fd12cc7840e [term 1 FOLLOWER]: Refusing update from remote peer e5256d91808b47c195bc9b4dbd7f2b87: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:04:29.696759 19407 raft_consensus.cc:2955] T fa731b585f684a7fb2d106c50f143b83 P e5256d91808b47c195bc9b4dbd7f2b87 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } } }
I20260709 13:04:29.700814 19555 consensus_queue.cc:237] T 1efebf73c86e432baa55533136b6e12c P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:04:29.706637 20408 consensus_queue.cc:1048] T ff9b0eddd810459b82d91c60777c10eb P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:04:29.708798 20110 raft_consensus.cc:1275] T 1efebf73c86e432baa55533136b6e12c P 127766fc592545a4997f7790f50f6076 [term 1 FOLLOWER]: Refusing update from remote peer e61c3a8f61bb48f8a963c9480e53c168: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:04:29.710700 20388 consensus_queue.cc:1048] T 1efebf73c86e432baa55533136b6e12c P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Connected to new peer: Peer: permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:04:29.718171 20387 raft_consensus.cc:2955] T 1efebf73c86e432baa55533136b6e12c P e61c3a8f61bb48f8a963c9480e53c168 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } } }
I20260709 13:04:29.719450 20110 raft_consensus.cc:2955] T 1efebf73c86e432baa55533136b6e12c P 127766fc592545a4997f7790f50f6076 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } } }
I20260709 13:04:29.734356 20363 consensus_queue.cc:1048] T ff9b0eddd810459b82d91c60777c10eb P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
W20260709 13:04:29.736294 19449 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.1:40321, user_credentials={real_user=slave}} blocked reactor thread for 135159us
I20260709 13:04:29.745536 19305 catalog_manager.cc:5697] T fa731b585f684a7fb2d106c50f143b83 P e5256d91808b47c195bc9b4dbd7f2b87 reported cstate change: config changed from index 3 to 4, VOTER 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2) evicted. New cstate: current_term: 1 leader_uuid: "e61c3a8f61bb48f8a963c9480e53c168" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } } }
I20260709 13:04:29.770845 19306 catalog_manager.cc:5697] T 1efebf73c86e432baa55533136b6e12c P 127766fc592545a4997f7790f50f6076 reported cstate change: config changed from index 3 to 4, VOTER e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1) evicted. New cstate: current_term: 1 leader_uuid: "e61c3a8f61bb48f8a963c9480e53c168" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } } }
W20260709 13:04:29.802486 19523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.4:43121, user_credentials={real_user=slave}} blocked reactor thread for 62161.5us
I20260709 13:04:29.807153 19294 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet fa731b585f684a7fb2d106c50f143b83 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:04:29.809067 19483 raft_consensus.cc:1275] T 1efebf73c86e432baa55533136b6e12c P 0473d2b2d01f4459b1e90fd12cc7840e [term 1 FOLLOWER]: Refusing update from remote peer e61c3a8f61bb48f8a963c9480e53c168: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:04:29.812090 19294 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 1efebf73c86e432baa55533136b6e12c with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:04:29.813246 20386 raft_consensus.cc:1064] T ed7fdbcb96d14d418db9ca90a792588a P e61c3a8f61bb48f8a963c9480e53c168: attempting to promote NON_VOTER 127766fc592545a4997f7790f50f6076 to VOTER
I20260709 13:04:29.815568 19468 tablet_service.cc:1558] Processing DeleteTablet for tablet fa731b585f684a7fb2d106c50f143b83 with delete_type TABLET_DATA_TOMBSTONED (TS 0473d2b2d01f4459b1e90fd12cc7840e not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:58272
I20260709 13:04:29.839381 20386 consensus_queue.cc:237] T ed7fdbcb96d14d418db9ca90a792588a P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } attrs { replace: true } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:04:29.845335 20388 consensus_queue.cc:1048] T 1efebf73c86e432baa55533136b6e12c P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:04:29.848853 20363 raft_consensus.cc:2955] T ff9b0eddd810459b82d91c60777c10eb P e5256d91808b47c195bc9b4dbd7f2b87 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 127766fc592545a4997f7790f50f6076 (127.17.223.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } attrs { replace: true } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } } }
I20260709 13:04:29.850404 19555 raft_consensus.cc:2955] T ff9b0eddd810459b82d91c60777c10eb P e61c3a8f61bb48f8a963c9480e53c168 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 127766fc592545a4997f7790f50f6076 (127.17.223.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } attrs { replace: true } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } } }
I20260709 13:04:29.862663 19401 tablet_service.cc:1558] Processing DeleteTablet for tablet 1efebf73c86e432baa55533136b6e12c with delete_type TABLET_DATA_TOMBSTONED (TS e5256d91808b47c195bc9b4dbd7f2b87 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:52318
I20260709 13:04:29.865427 20416 tablet_replica.cc:333] T fa731b585f684a7fb2d106c50f143b83 P 0473d2b2d01f4459b1e90fd12cc7840e: stopping tablet replica
I20260709 13:04:29.867574 20112 raft_consensus.cc:2955] T ff9b0eddd810459b82d91c60777c10eb P 127766fc592545a4997f7790f50f6076 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 127766fc592545a4997f7790f50f6076 (127.17.223.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } attrs { replace: true } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } } }
I20260709 13:04:29.876394 19479 raft_consensus.cc:2955] T ff9b0eddd810459b82d91c60777c10eb P 0473d2b2d01f4459b1e90fd12cc7840e [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 127766fc592545a4997f7790f50f6076 (127.17.223.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } attrs { replace: true } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } } }
I20260709 13:04:29.883033 19483 raft_consensus.cc:2955] T 1efebf73c86e432baa55533136b6e12c P 0473d2b2d01f4459b1e90fd12cc7840e [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } } }
I20260709 13:04:29.893735 19306 catalog_manager.cc:5697] T ff9b0eddd810459b82d91c60777c10eb P 127766fc592545a4997f7790f50f6076 reported cstate change: config changed from index 2 to 3, 127766fc592545a4997f7790f50f6076 (127.17.223.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } attrs { replace: true } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } } }
I20260709 13:04:29.904676 20416 raft_consensus.cc:2243] T fa731b585f684a7fb2d106c50f143b83 P 0473d2b2d01f4459b1e90fd12cc7840e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:29.909822 20416 raft_consensus.cc:2272] T fa731b585f684a7fb2d106c50f143b83 P 0473d2b2d01f4459b1e90fd12cc7840e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:29.913404 20416 ts_tablet_manager.cc:1916] T fa731b585f684a7fb2d106c50f143b83 P 0473d2b2d01f4459b1e90fd12cc7840e: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:04:29.921828 19485 raft_consensus.cc:1275] T ed7fdbcb96d14d418db9ca90a792588a P 0473d2b2d01f4459b1e90fd12cc7840e [term 1 FOLLOWER]: Refusing update from remote peer e61c3a8f61bb48f8a963c9480e53c168: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:04:29.936817 19405 raft_consensus.cc:1275] T ed7fdbcb96d14d418db9ca90a792588a P e5256d91808b47c195bc9b4dbd7f2b87 [term 1 FOLLOWER]: Refusing update from remote peer e61c3a8f61bb48f8a963c9480e53c168: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:04:29.944396 20112 raft_consensus.cc:1275] T ed7fdbcb96d14d418db9ca90a792588a P 127766fc592545a4997f7790f50f6076 [term 1 LEARNER]: Refusing update from remote peer e61c3a8f61bb48f8a963c9480e53c168: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
W20260709 13:04:29.952970 19377 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.2:46257, user_credentials={real_user=slave}} blocked reactor thread for 70002.6us
I20260709 13:04:29.958097 19405 consensus_queue.cc:237] T ff9b0eddd810459b82d91c60777c10eb P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:04:29.949246 20388 consensus_queue.cc:1048] T ed7fdbcb96d14d418db9ca90a792588a P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.016s
I20260709 13:04:29.965257 19479 raft_consensus.cc:1275] T ff9b0eddd810459b82d91c60777c10eb P 0473d2b2d01f4459b1e90fd12cc7840e [term 1 FOLLOWER]: Refusing update from remote peer e5256d91808b47c195bc9b4dbd7f2b87: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:04:29.966742 20112 raft_consensus.cc:1275] T ff9b0eddd810459b82d91c60777c10eb P 127766fc592545a4997f7790f50f6076 [term 1 FOLLOWER]: Refusing update from remote peer e5256d91808b47c195bc9b4dbd7f2b87: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:04:29.966840 20413 consensus_queue.cc:1048] T ed7fdbcb96d14d418db9ca90a792588a P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Connected to new peer: Peer: permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.002s
I20260709 13:04:29.968657 20419 consensus_queue.cc:1048] T ff9b0eddd810459b82d91c60777c10eb P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:04:29.969682 20421 consensus_queue.cc:1048] T ff9b0eddd810459b82d91c60777c10eb P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Connected to new peer: Peer: permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:04:29.970072 20387 consensus_queue.cc:1048] T ed7fdbcb96d14d418db9ca90a792588a P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:04:29.972774 20418 tablet_replica.cc:333] T 1efebf73c86e432baa55533136b6e12c P e5256d91808b47c195bc9b4dbd7f2b87: stopping tablet replica
I20260709 13:04:29.974016 20418 raft_consensus.cc:2243] T 1efebf73c86e432baa55533136b6e12c P e5256d91808b47c195bc9b4dbd7f2b87 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:29.974838 20418 raft_consensus.cc:2272] T 1efebf73c86e432baa55533136b6e12c P e5256d91808b47c195bc9b4dbd7f2b87 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:30.009980 20418 ts_tablet_manager.cc:1916] T 1efebf73c86e432baa55533136b6e12c P e5256d91808b47c195bc9b4dbd7f2b87: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:04:30.016674 20407 raft_consensus.cc:2955] T ff9b0eddd810459b82d91c60777c10eb P e5256d91808b47c195bc9b4dbd7f2b87 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } } }
I20260709 13:04:30.020908 20112 raft_consensus.cc:2955] T ff9b0eddd810459b82d91c60777c10eb P 127766fc592545a4997f7790f50f6076 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } } }
I20260709 13:04:30.031333 20416 ts_tablet_manager.cc:1929] T fa731b585f684a7fb2d106c50f143b83 P 0473d2b2d01f4459b1e90fd12cc7840e: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:04:30.036039 20416 log.cc:1199] T fa731b585f684a7fb2d106c50f143b83 P 0473d2b2d01f4459b1e90fd12cc7840e: Deleting WAL directory at /tmp/dist-test-taskKd2k48/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602220613947-18300-0/minicluster-data/ts-1-root/wals/fa731b585f684a7fb2d106c50f143b83
I20260709 13:04:30.037835 19296 catalog_manager.cc:5028] TS 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257): tablet fa731b585f684a7fb2d106c50f143b83 (table test-workload [id=ce1025c73cf04c4baf25820ae7ff0a53]) successfully deleted
I20260709 13:04:30.063374 19485 raft_consensus.cc:2955] T ff9b0eddd810459b82d91c60777c10eb P 0473d2b2d01f4459b1e90fd12cc7840e [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } } }
I20260709 13:04:30.086107 19293 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet ff9b0eddd810459b82d91c60777c10eb with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:04:30.085954 19304 catalog_manager.cc:5697] T ff9b0eddd810459b82d91c60777c10eb P 127766fc592545a4997f7790f50f6076 reported cstate change: config changed from index 3 to 4, VOTER e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3) evicted. New cstate: current_term: 1 leader_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } } }
I20260709 13:04:30.091579 20413 raft_consensus.cc:2955] T ed7fdbcb96d14d418db9ca90a792588a P e61c3a8f61bb48f8a963c9480e53c168 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 127766fc592545a4997f7790f50f6076 (127.17.223.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } attrs { replace: true } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } } }
I20260709 13:04:30.099886 20418 ts_tablet_manager.cc:1929] T 1efebf73c86e432baa55533136b6e12c P e5256d91808b47c195bc9b4dbd7f2b87: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:04:30.112671 20418 log.cc:1199] T 1efebf73c86e432baa55533136b6e12c P e5256d91808b47c195bc9b4dbd7f2b87: Deleting WAL directory at /tmp/dist-test-taskKd2k48/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602220613947-18300-0/minicluster-data/ts-0-root/wals/1efebf73c86e432baa55533136b6e12c
I20260709 13:04:30.114702 19293 catalog_manager.cc:5028] TS e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321): tablet 1efebf73c86e432baa55533136b6e12c (table test-workload [id=ce1025c73cf04c4baf25820ae7ff0a53]) successfully deleted
I20260709 13:04:30.122321 19547 tablet_service.cc:1558] Processing DeleteTablet for tablet ff9b0eddd810459b82d91c60777c10eb with delete_type TABLET_DATA_TOMBSTONED (TS e61c3a8f61bb48f8a963c9480e53c168 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:40412
I20260709 13:04:30.124799 20112 raft_consensus.cc:2955] T ed7fdbcb96d14d418db9ca90a792588a P 127766fc592545a4997f7790f50f6076 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 127766fc592545a4997f7790f50f6076 (127.17.223.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } attrs { replace: true } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } } }
I20260709 13:04:30.126545 19483 raft_consensus.cc:2955] T ed7fdbcb96d14d418db9ca90a792588a P 0473d2b2d01f4459b1e90fd12cc7840e [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 127766fc592545a4997f7790f50f6076 (127.17.223.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } attrs { replace: true } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } } }
I20260709 13:04:30.136783 19304 catalog_manager.cc:5697] T ed7fdbcb96d14d418db9ca90a792588a P e61c3a8f61bb48f8a963c9480e53c168 reported cstate change: config changed from index 2 to 3, 127766fc592545a4997f7790f50f6076 (127.17.223.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "e61c3a8f61bb48f8a963c9480e53c168" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:04:30.149394 20425 tablet_replica.cc:333] T ff9b0eddd810459b82d91c60777c10eb P e61c3a8f61bb48f8a963c9480e53c168: stopping tablet replica
I20260709 13:04:30.150727 20425 raft_consensus.cc:2243] T ff9b0eddd810459b82d91c60777c10eb P e61c3a8f61bb48f8a963c9480e53c168 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:30.152318 19405 raft_consensus.cc:2955] T ed7fdbcb96d14d418db9ca90a792588a P e5256d91808b47c195bc9b4dbd7f2b87 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 127766fc592545a4997f7790f50f6076 (127.17.223.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } attrs { replace: true } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } } }
I20260709 13:04:30.156592 19558 consensus_queue.cc:237] T ed7fdbcb96d14d418db9ca90a792588a P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:04:30.175699 20110 raft_consensus.cc:1275] T ed7fdbcb96d14d418db9ca90a792588a P 127766fc592545a4997f7790f50f6076 [term 1 FOLLOWER]: Refusing update from remote peer e61c3a8f61bb48f8a963c9480e53c168: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:04:30.177238 20413 consensus_queue.cc:1048] T ed7fdbcb96d14d418db9ca90a792588a P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Connected to new peer: Peer: permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:04:30.162755 20425 raft_consensus.cc:2272] T ff9b0eddd810459b82d91c60777c10eb P e61c3a8f61bb48f8a963c9480e53c168 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:30.185168 20386 raft_consensus.cc:2955] T ed7fdbcb96d14d418db9ca90a792588a P e61c3a8f61bb48f8a963c9480e53c168 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } } }
I20260709 13:04:30.191205 20110 raft_consensus.cc:2955] T ed7fdbcb96d14d418db9ca90a792588a P 127766fc592545a4997f7790f50f6076 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } } }
I20260709 13:04:30.195307 19483 raft_consensus.cc:1275] T ed7fdbcb96d14d418db9ca90a792588a P 0473d2b2d01f4459b1e90fd12cc7840e [term 1 FOLLOWER]: Refusing update from remote peer e61c3a8f61bb48f8a963c9480e53c168: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:04:30.196759 20413 consensus_queue.cc:1048] T ed7fdbcb96d14d418db9ca90a792588a P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:04:30.200644 19294 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet ed7fdbcb96d14d418db9ca90a792588a with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:04:30.216459 19483 raft_consensus.cc:2955] T ed7fdbcb96d14d418db9ca90a792588a P 0473d2b2d01f4459b1e90fd12cc7840e [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } } }
I20260709 13:04:30.228257 19305 catalog_manager.cc:5697] T ed7fdbcb96d14d418db9ca90a792588a P e61c3a8f61bb48f8a963c9480e53c168 reported cstate change: config changed from index 3 to 4, VOTER e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1) evicted. New cstate: current_term: 1 leader_uuid: "e61c3a8f61bb48f8a963c9480e53c168" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:04:30.232421 20425 ts_tablet_manager.cc:1916] T ff9b0eddd810459b82d91c60777c10eb P e61c3a8f61bb48f8a963c9480e53c168: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:04:30.242901 19401 tablet_service.cc:1558] Processing DeleteTablet for tablet ed7fdbcb96d14d418db9ca90a792588a with delete_type TABLET_DATA_TOMBSTONED (TS e5256d91808b47c195bc9b4dbd7f2b87 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:52318
I20260709 13:04:30.244242 20418 tablet_replica.cc:333] T ed7fdbcb96d14d418db9ca90a792588a P e5256d91808b47c195bc9b4dbd7f2b87: stopping tablet replica
I20260709 13:04:30.245321 20418 raft_consensus.cc:2243] T ed7fdbcb96d14d418db9ca90a792588a P e5256d91808b47c195bc9b4dbd7f2b87 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:30.246081 20418 raft_consensus.cc:2272] T ed7fdbcb96d14d418db9ca90a792588a P e5256d91808b47c195bc9b4dbd7f2b87 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:30.252846 20418 ts_tablet_manager.cc:1916] T ed7fdbcb96d14d418db9ca90a792588a P e5256d91808b47c195bc9b4dbd7f2b87: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:04:30.255861 20425 ts_tablet_manager.cc:1929] T ff9b0eddd810459b82d91c60777c10eb P e61c3a8f61bb48f8a963c9480e53c168: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:04:30.270113 20425 log.cc:1199] T ff9b0eddd810459b82d91c60777c10eb P e61c3a8f61bb48f8a963c9480e53c168: Deleting WAL directory at /tmp/dist-test-taskKd2k48/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602220613947-18300-0/minicluster-data/ts-2-root/wals/ff9b0eddd810459b82d91c60777c10eb
I20260709 13:04:30.271767 19294 catalog_manager.cc:5028] TS e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891): tablet ff9b0eddd810459b82d91c60777c10eb (table test-workload [id=ce1025c73cf04c4baf25820ae7ff0a53]) successfully deleted
I20260709 13:04:30.283480 20418 ts_tablet_manager.cc:1929] T ed7fdbcb96d14d418db9ca90a792588a P e5256d91808b47c195bc9b4dbd7f2b87: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:04:30.284063 20418 log.cc:1199] T ed7fdbcb96d14d418db9ca90a792588a P e5256d91808b47c195bc9b4dbd7f2b87: Deleting WAL directory at /tmp/dist-test-taskKd2k48/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602220613947-18300-0/minicluster-data/ts-0-root/wals/ed7fdbcb96d14d418db9ca90a792588a
I20260709 13:04:30.285583 19293 catalog_manager.cc:5028] TS e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321): tablet ed7fdbcb96d14d418db9ca90a792588a (table test-workload [id=ce1025c73cf04c4baf25820ae7ff0a53]) successfully deleted
W20260709 13:04:31.371145 19523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.4:43121, user_credentials={real_user=slave}} blocked reactor thread for 51970.1us
I20260709 13:04:31.421972 19408 consensus_queue.cc:237] T 14efcc79969f41babe5529c22d59156d P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } attrs { replace: true } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: NON_VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: true } }
W20260709 13:04:31.430974 19374 consensus_peers.cc:597] T 14efcc79969f41babe5529c22d59156d P e5256d91808b47c195bc9b4dbd7f2b87 -> Peer 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121): Couldn't send request to peer 127766fc592545a4997f7790f50f6076. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 14efcc79969f41babe5529c22d59156d. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:31.433540 19557 raft_consensus.cc:1275] T 14efcc79969f41babe5529c22d59156d P e61c3a8f61bb48f8a963c9480e53c168 [term 1 FOLLOWER]: Refusing update from remote peer e5256d91808b47c195bc9b4dbd7f2b87: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:04:31.435364 19483 raft_consensus.cc:1275] T 14efcc79969f41babe5529c22d59156d P 0473d2b2d01f4459b1e90fd12cc7840e [term 1 FOLLOWER]: Refusing update from remote peer e5256d91808b47c195bc9b4dbd7f2b87: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:04:31.435505 20428 consensus_queue.cc:1048] T 14efcc79969f41babe5529c22d59156d P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:04:31.437039 20419 consensus_queue.cc:1048] T 14efcc79969f41babe5529c22d59156d P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:04:31.445139 20428 raft_consensus.cc:2955] T 14efcc79969f41babe5529c22d59156d P e5256d91808b47c195bc9b4dbd7f2b87 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 127766fc592545a4997f7790f50f6076 (127.17.223.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } attrs { replace: true } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: NON_VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: true } } }
I20260709 13:04:31.446871 19558 raft_consensus.cc:2955] T 14efcc79969f41babe5529c22d59156d P e61c3a8f61bb48f8a963c9480e53c168 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 127766fc592545a4997f7790f50f6076 (127.17.223.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } attrs { replace: true } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: NON_VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: true } } }
I20260709 13:04:31.449112 19483 raft_consensus.cc:2955] T 14efcc79969f41babe5529c22d59156d P 0473d2b2d01f4459b1e90fd12cc7840e [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 127766fc592545a4997f7790f50f6076 (127.17.223.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } attrs { replace: true } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: NON_VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: true } } }
I20260709 13:04:31.463009 19558 consensus_queue.cc:237] T 4af19371ea874c09a0a2147040835cbb P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } attrs { replace: true } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: NON_VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: true } }
I20260709 13:04:31.465796 19305 catalog_manager.cc:5697] T 14efcc79969f41babe5529c22d59156d P e61c3a8f61bb48f8a963c9480e53c168 reported cstate change: config changed from index -1 to 2, NON_VOTER 127766fc592545a4997f7790f50f6076 (127.17.223.4) added. New cstate: current_term: 1 leader_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } attrs { replace: true } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: NON_VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: true } } }
I20260709 13:04:31.484189 19408 raft_consensus.cc:1275] T 4af19371ea874c09a0a2147040835cbb P e5256d91808b47c195bc9b4dbd7f2b87 [term 1 FOLLOWER]: Refusing update from remote peer e61c3a8f61bb48f8a963c9480e53c168: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:04:31.486450 20412 consensus_queue.cc:1048] T 4af19371ea874c09a0a2147040835cbb P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
W20260709 13:04:31.488958 19523 consensus_peers.cc:597] T 4af19371ea874c09a0a2147040835cbb P e61c3a8f61bb48f8a963c9480e53c168 -> Peer 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121): Couldn't send request to peer 127766fc592545a4997f7790f50f6076. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 4af19371ea874c09a0a2147040835cbb. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:31.492925 19483 raft_consensus.cc:1275] T 4af19371ea874c09a0a2147040835cbb P 0473d2b2d01f4459b1e90fd12cc7840e [term 1 FOLLOWER]: Refusing update from remote peer e61c3a8f61bb48f8a963c9480e53c168: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:04:31.494622 20386 consensus_queue.cc:1048] T 4af19371ea874c09a0a2147040835cbb P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:04:31.498642 20431 raft_consensus.cc:2955] T 4af19371ea874c09a0a2147040835cbb P e61c3a8f61bb48f8a963c9480e53c168 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 127766fc592545a4997f7790f50f6076 (127.17.223.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } attrs { replace: true } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: NON_VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: true } } }
I20260709 13:04:31.500653 19405 raft_consensus.cc:2955] T 4af19371ea874c09a0a2147040835cbb P e5256d91808b47c195bc9b4dbd7f2b87 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 127766fc592545a4997f7790f50f6076 (127.17.223.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } attrs { replace: true } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: NON_VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: true } } }
I20260709 13:04:31.523104 19483 raft_consensus.cc:2955] T 4af19371ea874c09a0a2147040835cbb P 0473d2b2d01f4459b1e90fd12cc7840e [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 127766fc592545a4997f7790f50f6076 (127.17.223.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } attrs { replace: true } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: NON_VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: true } } }
I20260709 13:04:31.527571 19408 consensus_queue.cc:237] T 70797e5783b5454ab0d0eea663e791e3 P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } attrs { replace: true } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: NON_VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: true } }
I20260709 13:04:31.528842 19304 catalog_manager.cc:5697] T 4af19371ea874c09a0a2147040835cbb P e61c3a8f61bb48f8a963c9480e53c168 reported cstate change: config changed from index -1 to 2, NON_VOTER 127766fc592545a4997f7790f50f6076 (127.17.223.4) added. New cstate: current_term: 1 leader_uuid: "e61c3a8f61bb48f8a963c9480e53c168" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: NON_VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:31.545344 19483 raft_consensus.cc:1275] T 70797e5783b5454ab0d0eea663e791e3 P 0473d2b2d01f4459b1e90fd12cc7840e [term 1 FOLLOWER]: Refusing update from remote peer e5256d91808b47c195bc9b4dbd7f2b87: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:04:31.569000 20426 consensus_queue.cc:1048] T 70797e5783b5454ab0d0eea663e791e3 P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
W20260709 13:04:31.566951 19374 consensus_peers.cc:597] T 70797e5783b5454ab0d0eea663e791e3 P e5256d91808b47c195bc9b4dbd7f2b87 -> Peer 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121): Couldn't send request to peer 127766fc592545a4997f7790f50f6076. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 70797e5783b5454ab0d0eea663e791e3. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:31.567432 19558 raft_consensus.cc:1275] T 70797e5783b5454ab0d0eea663e791e3 P e61c3a8f61bb48f8a963c9480e53c168 [term 1 FOLLOWER]: Refusing update from remote peer e5256d91808b47c195bc9b4dbd7f2b87: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:04:31.577343 20426 consensus_queue.cc:1048] T 70797e5783b5454ab0d0eea663e791e3 P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:04:31.594798 20419 raft_consensus.cc:2955] T 70797e5783b5454ab0d0eea663e791e3 P e5256d91808b47c195bc9b4dbd7f2b87 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 127766fc592545a4997f7790f50f6076 (127.17.223.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } attrs { replace: true } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: NON_VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: true } } }
I20260709 13:04:31.598929 19485 raft_consensus.cc:2955] T 70797e5783b5454ab0d0eea663e791e3 P 0473d2b2d01f4459b1e90fd12cc7840e [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 127766fc592545a4997f7790f50f6076 (127.17.223.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } attrs { replace: true } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: NON_VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: true } } }
I20260709 13:04:31.600023 19555 raft_consensus.cc:2955] T 70797e5783b5454ab0d0eea663e791e3 P e61c3a8f61bb48f8a963c9480e53c168 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 127766fc592545a4997f7790f50f6076 (127.17.223.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } attrs { replace: true } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: NON_VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: true } } }
I20260709 13:04:31.613272 19405 consensus_queue.cc:237] T 5ec1c4ce15e04c7e8c283a62179f2a64 P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } attrs { replace: true } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: NON_VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: true } }
W20260709 13:04:31.623297 19374 consensus_peers.cc:597] T 5ec1c4ce15e04c7e8c283a62179f2a64 P e5256d91808b47c195bc9b4dbd7f2b87 -> Peer 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121): Couldn't send request to peer 127766fc592545a4997f7790f50f6076. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 5ec1c4ce15e04c7e8c283a62179f2a64. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:31.622889 19305 catalog_manager.cc:5697] T 70797e5783b5454ab0d0eea663e791e3 P e5256d91808b47c195bc9b4dbd7f2b87 reported cstate change: config changed from index -1 to 2, NON_VOTER 127766fc592545a4997f7790f50f6076 (127.17.223.4) added. New cstate: current_term: 1 leader_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: NON_VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:31.636409 19558 raft_consensus.cc:1275] T 5ec1c4ce15e04c7e8c283a62179f2a64 P e61c3a8f61bb48f8a963c9480e53c168 [term 1 FOLLOWER]: Refusing update from remote peer e5256d91808b47c195bc9b4dbd7f2b87: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:04:31.637878 19485 raft_consensus.cc:1275] T 5ec1c4ce15e04c7e8c283a62179f2a64 P 0473d2b2d01f4459b1e90fd12cc7840e [term 1 FOLLOWER]: Refusing update from remote peer e5256d91808b47c195bc9b4dbd7f2b87: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:04:31.639030 20428 consensus_queue.cc:1048] T 5ec1c4ce15e04c7e8c283a62179f2a64 P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:04:31.639899 20448 consensus_queue.cc:1048] T 5ec1c4ce15e04c7e8c283a62179f2a64 P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:04:31.649137 20447 raft_consensus.cc:2955] T 5ec1c4ce15e04c7e8c283a62179f2a64 P e5256d91808b47c195bc9b4dbd7f2b87 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 127766fc592545a4997f7790f50f6076 (127.17.223.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } attrs { replace: true } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: NON_VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: true } } }
I20260709 13:04:31.650857 19558 raft_consensus.cc:2955] T 5ec1c4ce15e04c7e8c283a62179f2a64 P e61c3a8f61bb48f8a963c9480e53c168 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 127766fc592545a4997f7790f50f6076 (127.17.223.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } attrs { replace: true } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: NON_VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: true } } }
I20260709 13:04:31.655576 19485 raft_consensus.cc:2955] T 5ec1c4ce15e04c7e8c283a62179f2a64 P 0473d2b2d01f4459b1e90fd12cc7840e [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 127766fc592545a4997f7790f50f6076 (127.17.223.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } attrs { replace: true } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: NON_VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: true } } }
I20260709 13:04:31.703159 19306 catalog_manager.cc:5697] T 5ec1c4ce15e04c7e8c283a62179f2a64 P 0473d2b2d01f4459b1e90fd12cc7840e reported cstate change: config changed from index -1 to 2, NON_VOTER 127766fc592545a4997f7790f50f6076 (127.17.223.4) added. New cstate: current_term: 1 leader_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } attrs { replace: true } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: NON_VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: true } } }
I20260709 13:04:31.989717 20453 ts_tablet_manager.cc:933] T 4af19371ea874c09a0a2147040835cbb P 127766fc592545a4997f7790f50f6076: Initiating tablet copy from peer e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:04:31.993765 20453 tablet_copy_client.cc:323] T 4af19371ea874c09a0a2147040835cbb P 127766fc592545a4997f7790f50f6076: tablet copy: Beginning tablet copy session from remote peer at address 127.17.223.3:36891
I20260709 13:04:31.995780 19570 tablet_copy_service.cc:140] P e61c3a8f61bb48f8a963c9480e53c168: Received BeginTabletCopySession request for tablet 4af19371ea874c09a0a2147040835cbb from peer 127766fc592545a4997f7790f50f6076 ({username='slave'} at 127.0.0.1:41504)
I20260709 13:04:31.996408 19570 tablet_copy_service.cc:161] P e61c3a8f61bb48f8a963c9480e53c168: Beginning new tablet copy session on tablet 4af19371ea874c09a0a2147040835cbb from peer 127766fc592545a4997f7790f50f6076 at {username='slave'} at 127.0.0.1:41504: session id = 127766fc592545a4997f7790f50f6076-4af19371ea874c09a0a2147040835cbb
I20260709 13:04:32.004562 19570 tablet_copy_source_session.cc:215] T 4af19371ea874c09a0a2147040835cbb P e61c3a8f61bb48f8a963c9480e53c168: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:04:32.007704 20453 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4af19371ea874c09a0a2147040835cbb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:32.021178 20455 ts_tablet_manager.cc:933] T 14efcc79969f41babe5529c22d59156d P 127766fc592545a4997f7790f50f6076: Initiating tablet copy from peer e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321)
I20260709 13:04:32.022174 20453 tablet_copy_client.cc:806] T 4af19371ea874c09a0a2147040835cbb P 127766fc592545a4997f7790f50f6076: tablet copy: Starting download of 0 data blocks...
I20260709 13:04:32.023001 20453 tablet_copy_client.cc:670] T 4af19371ea874c09a0a2147040835cbb P 127766fc592545a4997f7790f50f6076: tablet copy: Starting download of 1 WAL segments...
I20260709 13:04:32.023424 20455 tablet_copy_client.cc:323] T 14efcc79969f41babe5529c22d59156d P 127766fc592545a4997f7790f50f6076: tablet copy: Beginning tablet copy session from remote peer at address 127.17.223.1:40321
I20260709 13:04:32.025452 19421 tablet_copy_service.cc:140] P e5256d91808b47c195bc9b4dbd7f2b87: Received BeginTabletCopySession request for tablet 14efcc79969f41babe5529c22d59156d from peer 127766fc592545a4997f7790f50f6076 ({username='slave'} at 127.0.0.1:49050)
I20260709 13:04:32.025971 19421 tablet_copy_service.cc:161] P e5256d91808b47c195bc9b4dbd7f2b87: Beginning new tablet copy session on tablet 14efcc79969f41babe5529c22d59156d from peer 127766fc592545a4997f7790f50f6076 at {username='slave'} at 127.0.0.1:49050: session id = 127766fc592545a4997f7790f50f6076-14efcc79969f41babe5529c22d59156d
I20260709 13:04:32.031214 20453 tablet_copy_client.cc:538] T 4af19371ea874c09a0a2147040835cbb P 127766fc592545a4997f7790f50f6076: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:04:32.034309 19421 tablet_copy_source_session.cc:215] T 14efcc79969f41babe5529c22d59156d P e5256d91808b47c195bc9b4dbd7f2b87: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:04:32.038074 20455 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 14efcc79969f41babe5529c22d59156d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:32.040927 20453 tablet_bootstrap.cc:492] T 4af19371ea874c09a0a2147040835cbb P 127766fc592545a4997f7790f50f6076: Bootstrap starting.
I20260709 13:04:32.063221 20455 tablet_copy_client.cc:806] T 14efcc79969f41babe5529c22d59156d P 127766fc592545a4997f7790f50f6076: tablet copy: Starting download of 0 data blocks...
I20260709 13:04:32.063894 20455 tablet_copy_client.cc:670] T 14efcc79969f41babe5529c22d59156d P 127766fc592545a4997f7790f50f6076: tablet copy: Starting download of 1 WAL segments...
I20260709 13:04:32.065274 20457 ts_tablet_manager.cc:933] T 5ec1c4ce15e04c7e8c283a62179f2a64 P 127766fc592545a4997f7790f50f6076: Initiating tablet copy from peer e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321)
I20260709 13:04:32.069892 20455 tablet_copy_client.cc:538] T 14efcc79969f41babe5529c22d59156d P 127766fc592545a4997f7790f50f6076: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:04:32.071241 20453 tablet_bootstrap.cc:492] T 4af19371ea874c09a0a2147040835cbb P 127766fc592545a4997f7790f50f6076: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:04:32.072517 20453 tablet_bootstrap.cc:492] T 4af19371ea874c09a0a2147040835cbb P 127766fc592545a4997f7790f50f6076: Bootstrap complete.
I20260709 13:04:32.073661 20453 ts_tablet_manager.cc:1403] T 4af19371ea874c09a0a2147040835cbb P 127766fc592545a4997f7790f50f6076: Time spent bootstrapping tablet: real 0.033s	user 0.013s	sys 0.018s
I20260709 13:04:32.076915 20453 raft_consensus.cc:359] T 4af19371ea874c09a0a2147040835cbb P 127766fc592545a4997f7790f50f6076 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } attrs { replace: true } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: NON_VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: true } }
I20260709 13:04:32.077756 20453 raft_consensus.cc:740] T 4af19371ea874c09a0a2147040835cbb P 127766fc592545a4997f7790f50f6076 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 127766fc592545a4997f7790f50f6076, State: Initialized, Role: LEARNER
I20260709 13:04:32.078485 20453 consensus_queue.cc:260] T 4af19371ea874c09a0a2147040835cbb P 127766fc592545a4997f7790f50f6076 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } attrs { replace: true } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: NON_VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: true } }
I20260709 13:04:32.081738 20455 tablet_bootstrap.cc:492] T 14efcc79969f41babe5529c22d59156d P 127766fc592545a4997f7790f50f6076: Bootstrap starting.
I20260709 13:04:32.103062 20463 ts_tablet_manager.cc:933] T 70797e5783b5454ab0d0eea663e791e3 P 127766fc592545a4997f7790f50f6076: Initiating tablet copy from peer e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321)
I20260709 13:04:32.114586 20455 tablet_bootstrap.cc:492] T 14efcc79969f41babe5529c22d59156d P 127766fc592545a4997f7790f50f6076: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:04:32.116592 20455 tablet_bootstrap.cc:492] T 14efcc79969f41babe5529c22d59156d P 127766fc592545a4997f7790f50f6076: Bootstrap complete.
I20260709 13:04:32.117324 20455 ts_tablet_manager.cc:1403] T 14efcc79969f41babe5529c22d59156d P 127766fc592545a4997f7790f50f6076: Time spent bootstrapping tablet: real 0.036s	user 0.033s	sys 0.001s
I20260709 13:04:32.114555 20463 tablet_copy_client.cc:323] T 70797e5783b5454ab0d0eea663e791e3 P 127766fc592545a4997f7790f50f6076: tablet copy: Beginning tablet copy session from remote peer at address 127.17.223.1:40321
I20260709 13:04:32.121342 19421 tablet_copy_service.cc:140] P e5256d91808b47c195bc9b4dbd7f2b87: Received BeginTabletCopySession request for tablet 70797e5783b5454ab0d0eea663e791e3 from peer 127766fc592545a4997f7790f50f6076 ({username='slave'} at 127.0.0.1:49050)
I20260709 13:04:32.121316 20455 raft_consensus.cc:359] T 14efcc79969f41babe5529c22d59156d P 127766fc592545a4997f7790f50f6076 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } attrs { replace: true } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: NON_VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: true } }
I20260709 13:04:32.122092 19421 tablet_copy_service.cc:161] P e5256d91808b47c195bc9b4dbd7f2b87: Beginning new tablet copy session on tablet 70797e5783b5454ab0d0eea663e791e3 from peer 127766fc592545a4997f7790f50f6076 at {username='slave'} at 127.0.0.1:49050: session id = 127766fc592545a4997f7790f50f6076-70797e5783b5454ab0d0eea663e791e3
I20260709 13:04:32.122469 20455 raft_consensus.cc:740] T 14efcc79969f41babe5529c22d59156d P 127766fc592545a4997f7790f50f6076 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 127766fc592545a4997f7790f50f6076, State: Initialized, Role: LEARNER
I20260709 13:04:32.123127 20455 consensus_queue.cc:260] T 14efcc79969f41babe5529c22d59156d P 127766fc592545a4997f7790f50f6076 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } attrs { replace: true } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: NON_VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: true } }
I20260709 13:04:32.134274 19421 tablet_copy_source_session.cc:215] T 70797e5783b5454ab0d0eea663e791e3 P e5256d91808b47c195bc9b4dbd7f2b87: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:04:32.139642 20463 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 70797e5783b5454ab0d0eea663e791e3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:32.145118 20457 tablet_copy_client.cc:323] T 5ec1c4ce15e04c7e8c283a62179f2a64 P 127766fc592545a4997f7790f50f6076: tablet copy: Beginning tablet copy session from remote peer at address 127.17.223.1:40321
I20260709 13:04:32.151253 19421 tablet_copy_service.cc:140] P e5256d91808b47c195bc9b4dbd7f2b87: Received BeginTabletCopySession request for tablet 5ec1c4ce15e04c7e8c283a62179f2a64 from peer 127766fc592545a4997f7790f50f6076 ({username='slave'} at 127.0.0.1:49050)
I20260709 13:04:32.151831 19421 tablet_copy_service.cc:161] P e5256d91808b47c195bc9b4dbd7f2b87: Beginning new tablet copy session on tablet 5ec1c4ce15e04c7e8c283a62179f2a64 from peer 127766fc592545a4997f7790f50f6076 at {username='slave'} at 127.0.0.1:49050: session id = 127766fc592545a4997f7790f50f6076-5ec1c4ce15e04c7e8c283a62179f2a64
I20260709 13:04:32.154299 20455 ts_tablet_manager.cc:1434] T 14efcc79969f41babe5529c22d59156d P 127766fc592545a4997f7790f50f6076: Time spent starting tablet: real 0.036s	user 0.015s	sys 0.007s
I20260709 13:04:32.160221 20453 ts_tablet_manager.cc:1434] T 4af19371ea874c09a0a2147040835cbb P 127766fc592545a4997f7790f50f6076: Time spent starting tablet: real 0.086s	user 0.025s	sys 0.022s
I20260709 13:04:32.160532 19420 tablet_copy_service.cc:342] P e5256d91808b47c195bc9b4dbd7f2b87: Request end of tablet copy session 127766fc592545a4997f7790f50f6076-14efcc79969f41babe5529c22d59156d received from {username='slave'} at 127.0.0.1:49050
I20260709 13:04:32.161046 19420 tablet_copy_service.cc:434] P e5256d91808b47c195bc9b4dbd7f2b87: ending tablet copy session 127766fc592545a4997f7790f50f6076-14efcc79969f41babe5529c22d59156d on tablet 14efcc79969f41babe5529c22d59156d with peer 127766fc592545a4997f7790f50f6076
I20260709 13:04:32.162811 19570 tablet_copy_service.cc:342] P e61c3a8f61bb48f8a963c9480e53c168: Request end of tablet copy session 127766fc592545a4997f7790f50f6076-4af19371ea874c09a0a2147040835cbb received from {username='slave'} at 127.0.0.1:41504
I20260709 13:04:32.163257 19570 tablet_copy_service.cc:434] P e61c3a8f61bb48f8a963c9480e53c168: ending tablet copy session 127766fc592545a4997f7790f50f6076-4af19371ea874c09a0a2147040835cbb on tablet 4af19371ea874c09a0a2147040835cbb with peer 127766fc592545a4997f7790f50f6076
I20260709 13:04:32.174790 19421 tablet_copy_source_session.cc:215] T 5ec1c4ce15e04c7e8c283a62179f2a64 P e5256d91808b47c195bc9b4dbd7f2b87: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:04:32.175097 20463 tablet_copy_client.cc:806] T 70797e5783b5454ab0d0eea663e791e3 P 127766fc592545a4997f7790f50f6076: tablet copy: Starting download of 0 data blocks...
I20260709 13:04:32.175868 20463 tablet_copy_client.cc:670] T 70797e5783b5454ab0d0eea663e791e3 P 127766fc592545a4997f7790f50f6076: tablet copy: Starting download of 1 WAL segments...
I20260709 13:04:32.177995 20457 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5ec1c4ce15e04c7e8c283a62179f2a64. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:32.179721 20463 tablet_copy_client.cc:538] T 70797e5783b5454ab0d0eea663e791e3 P 127766fc592545a4997f7790f50f6076: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:04:32.186434 20463 tablet_bootstrap.cc:492] T 70797e5783b5454ab0d0eea663e791e3 P 127766fc592545a4997f7790f50f6076: Bootstrap starting.
I20260709 13:04:32.195981 20457 tablet_copy_client.cc:806] T 5ec1c4ce15e04c7e8c283a62179f2a64 P 127766fc592545a4997f7790f50f6076: tablet copy: Starting download of 0 data blocks...
I20260709 13:04:32.196623 20457 tablet_copy_client.cc:670] T 5ec1c4ce15e04c7e8c283a62179f2a64 P 127766fc592545a4997f7790f50f6076: tablet copy: Starting download of 1 WAL segments...
I20260709 13:04:32.200434 20457 tablet_copy_client.cc:538] T 5ec1c4ce15e04c7e8c283a62179f2a64 P 127766fc592545a4997f7790f50f6076: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:04:32.213546 20463 tablet_bootstrap.cc:492] T 70797e5783b5454ab0d0eea663e791e3 P 127766fc592545a4997f7790f50f6076: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:04:32.214555 20463 tablet_bootstrap.cc:492] T 70797e5783b5454ab0d0eea663e791e3 P 127766fc592545a4997f7790f50f6076: Bootstrap complete.
I20260709 13:04:32.215255 20463 ts_tablet_manager.cc:1403] T 70797e5783b5454ab0d0eea663e791e3 P 127766fc592545a4997f7790f50f6076: Time spent bootstrapping tablet: real 0.029s	user 0.024s	sys 0.004s
I20260709 13:04:32.242822 20457 tablet_bootstrap.cc:492] T 5ec1c4ce15e04c7e8c283a62179f2a64 P 127766fc592545a4997f7790f50f6076: Bootstrap starting.
I20260709 13:04:32.248241 20463 raft_consensus.cc:359] T 70797e5783b5454ab0d0eea663e791e3 P 127766fc592545a4997f7790f50f6076 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } attrs { replace: true } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: NON_VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: true } }
I20260709 13:04:32.256580 20463 raft_consensus.cc:740] T 70797e5783b5454ab0d0eea663e791e3 P 127766fc592545a4997f7790f50f6076 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 127766fc592545a4997f7790f50f6076, State: Initialized, Role: LEARNER
I20260709 13:04:32.257375 20463 consensus_queue.cc:260] T 70797e5783b5454ab0d0eea663e791e3 P 127766fc592545a4997f7790f50f6076 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } attrs { replace: true } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: NON_VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: true } }
I20260709 13:04:32.261667 20463 ts_tablet_manager.cc:1434] T 70797e5783b5454ab0d0eea663e791e3 P 127766fc592545a4997f7790f50f6076: Time spent starting tablet: real 0.046s	user 0.007s	sys 0.000s
I20260709 13:04:32.263616 19421 tablet_copy_service.cc:342] P e5256d91808b47c195bc9b4dbd7f2b87: Request end of tablet copy session 127766fc592545a4997f7790f50f6076-70797e5783b5454ab0d0eea663e791e3 received from {username='slave'} at 127.0.0.1:49050
I20260709 13:04:32.263996 19421 tablet_copy_service.cc:434] P e5256d91808b47c195bc9b4dbd7f2b87: ending tablet copy session 127766fc592545a4997f7790f50f6076-70797e5783b5454ab0d0eea663e791e3 on tablet 70797e5783b5454ab0d0eea663e791e3 with peer 127766fc592545a4997f7790f50f6076
I20260709 13:04:32.289852 20457 tablet_bootstrap.cc:492] T 5ec1c4ce15e04c7e8c283a62179f2a64 P 127766fc592545a4997f7790f50f6076: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:04:32.290879 20457 tablet_bootstrap.cc:492] T 5ec1c4ce15e04c7e8c283a62179f2a64 P 127766fc592545a4997f7790f50f6076: Bootstrap complete.
I20260709 13:04:32.291589 20457 ts_tablet_manager.cc:1403] T 5ec1c4ce15e04c7e8c283a62179f2a64 P 127766fc592545a4997f7790f50f6076: Time spent bootstrapping tablet: real 0.049s	user 0.022s	sys 0.008s
I20260709 13:04:32.293744 20457 raft_consensus.cc:359] T 5ec1c4ce15e04c7e8c283a62179f2a64 P 127766fc592545a4997f7790f50f6076 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } attrs { replace: true } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: NON_VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: true } }
I20260709 13:04:32.294309 20457 raft_consensus.cc:740] T 5ec1c4ce15e04c7e8c283a62179f2a64 P 127766fc592545a4997f7790f50f6076 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 127766fc592545a4997f7790f50f6076, State: Initialized, Role: LEARNER
I20260709 13:04:32.294857 20457 consensus_queue.cc:260] T 5ec1c4ce15e04c7e8c283a62179f2a64 P 127766fc592545a4997f7790f50f6076 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } attrs { replace: true } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: NON_VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: true } }
I20260709 13:04:32.296903 20457 ts_tablet_manager.cc:1434] T 5ec1c4ce15e04c7e8c283a62179f2a64 P 127766fc592545a4997f7790f50f6076: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 13:04:32.298816 19421 tablet_copy_service.cc:342] P e5256d91808b47c195bc9b4dbd7f2b87: Request end of tablet copy session 127766fc592545a4997f7790f50f6076-5ec1c4ce15e04c7e8c283a62179f2a64 received from {username='slave'} at 127.0.0.1:49050
I20260709 13:04:32.299160 19421 tablet_copy_service.cc:434] P e5256d91808b47c195bc9b4dbd7f2b87: ending tablet copy session 127766fc592545a4997f7790f50f6076-5ec1c4ce15e04c7e8c283a62179f2a64 on tablet 5ec1c4ce15e04c7e8c283a62179f2a64 with peer 127766fc592545a4997f7790f50f6076
I20260709 13:04:32.445111 20112 raft_consensus.cc:1217] T 4af19371ea874c09a0a2147040835cbb P 127766fc592545a4997f7790f50f6076 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:04:32.456404 20112 raft_consensus.cc:1217] T 5ec1c4ce15e04c7e8c283a62179f2a64 P 127766fc592545a4997f7790f50f6076 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:04:32.465423 20112 raft_consensus.cc:1217] T 14efcc79969f41babe5529c22d59156d P 127766fc592545a4997f7790f50f6076 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:04:32.595331 20111 raft_consensus.cc:1217] T 70797e5783b5454ab0d0eea663e791e3 P 127766fc592545a4997f7790f50f6076 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:04:32.825726 20432 raft_consensus.cc:1064] T 4af19371ea874c09a0a2147040835cbb P e61c3a8f61bb48f8a963c9480e53c168: attempting to promote NON_VOTER 127766fc592545a4997f7790f50f6076 to VOTER
I20260709 13:04:32.828508 20432 consensus_queue.cc:237] T 4af19371ea874c09a0a2147040835cbb P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } attrs { replace: true } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:04:32.836315 19485 raft_consensus.cc:1275] T 4af19371ea874c09a0a2147040835cbb P 0473d2b2d01f4459b1e90fd12cc7840e [term 1 FOLLOWER]: Refusing update from remote peer e61c3a8f61bb48f8a963c9480e53c168: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:04:32.836504 20111 raft_consensus.cc:1275] T 4af19371ea874c09a0a2147040835cbb P 127766fc592545a4997f7790f50f6076 [term 1 LEARNER]: Refusing update from remote peer e61c3a8f61bb48f8a963c9480e53c168: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:04:32.837908 19407 raft_consensus.cc:1275] T 4af19371ea874c09a0a2147040835cbb P e5256d91808b47c195bc9b4dbd7f2b87 [term 1 FOLLOWER]: Refusing update from remote peer e61c3a8f61bb48f8a963c9480e53c168: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:04:32.837877 20472 consensus_queue.cc:1048] T 4af19371ea874c09a0a2147040835cbb P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:04:32.839499 20461 consensus_queue.cc:1048] T 4af19371ea874c09a0a2147040835cbb P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Connected to new peer: Peer: permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:04:32.840358 20431 consensus_queue.cc:1048] T 4af19371ea874c09a0a2147040835cbb P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:04:32.865566 20472 raft_consensus.cc:2955] T 4af19371ea874c09a0a2147040835cbb P e61c3a8f61bb48f8a963c9480e53c168 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 127766fc592545a4997f7790f50f6076 (127.17.223.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } attrs { replace: true } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } } }
I20260709 13:04:32.869165 20447 raft_consensus.cc:1064] T 5ec1c4ce15e04c7e8c283a62179f2a64 P e5256d91808b47c195bc9b4dbd7f2b87: attempting to promote NON_VOTER 127766fc592545a4997f7790f50f6076 to VOTER
I20260709 13:04:32.868367 19478 raft_consensus.cc:2955] T 4af19371ea874c09a0a2147040835cbb P 0473d2b2d01f4459b1e90fd12cc7840e [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 127766fc592545a4997f7790f50f6076 (127.17.223.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } attrs { replace: true } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } } }
I20260709 13:04:32.871723 20447 consensus_queue.cc:237] T 5ec1c4ce15e04c7e8c283a62179f2a64 P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } attrs { replace: true } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:04:32.878343 19407 raft_consensus.cc:2955] T 4af19371ea874c09a0a2147040835cbb P e5256d91808b47c195bc9b4dbd7f2b87 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 127766fc592545a4997f7790f50f6076 (127.17.223.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } attrs { replace: true } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } } }
I20260709 13:04:32.885998 19306 catalog_manager.cc:5697] T 4af19371ea874c09a0a2147040835cbb P 0473d2b2d01f4459b1e90fd12cc7840e reported cstate change: config changed from index 2 to 3, 127766fc592545a4997f7790f50f6076 (127.17.223.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "e61c3a8f61bb48f8a963c9480e53c168" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } attrs { replace: true } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } } }
I20260709 13:04:32.913347 20111 raft_consensus.cc:2955] T 4af19371ea874c09a0a2147040835cbb P 127766fc592545a4997f7790f50f6076 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 127766fc592545a4997f7790f50f6076 (127.17.223.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } attrs { replace: true } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } } }
I20260709 13:04:32.957386 20111 raft_consensus.cc:1275] T 5ec1c4ce15e04c7e8c283a62179f2a64 P 127766fc592545a4997f7790f50f6076 [term 1 LEARNER]: Refusing update from remote peer e5256d91808b47c195bc9b4dbd7f2b87: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:04:32.958076 19558 raft_consensus.cc:1275] T 5ec1c4ce15e04c7e8c283a62179f2a64 P e61c3a8f61bb48f8a963c9480e53c168 [term 1 FOLLOWER]: Refusing update from remote peer e5256d91808b47c195bc9b4dbd7f2b87: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:04:32.959031 20419 consensus_queue.cc:1048] T 5ec1c4ce15e04c7e8c283a62179f2a64 P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Connected to new peer: Peer: permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:04:32.960124 20468 consensus_queue.cc:1048] T 5ec1c4ce15e04c7e8c283a62179f2a64 P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:04:32.960951 19478 raft_consensus.cc:1275] T 5ec1c4ce15e04c7e8c283a62179f2a64 P 0473d2b2d01f4459b1e90fd12cc7840e [term 1 FOLLOWER]: Refusing update from remote peer e5256d91808b47c195bc9b4dbd7f2b87: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:04:32.967458 20468 consensus_queue.cc:1048] T 5ec1c4ce15e04c7e8c283a62179f2a64 P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:04:32.980410 19557 consensus_queue.cc:237] T 4af19371ea874c09a0a2147040835cbb P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:04:32.988193 20112 raft_consensus.cc:1275] T 4af19371ea874c09a0a2147040835cbb P 127766fc592545a4997f7790f50f6076 [term 1 FOLLOWER]: Refusing update from remote peer e61c3a8f61bb48f8a963c9480e53c168: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:04:32.990057 20431 consensus_queue.cc:1048] T 4af19371ea874c09a0a2147040835cbb P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Connected to new peer: Peer: permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:04:32.991916 19405 raft_consensus.cc:1275] T 4af19371ea874c09a0a2147040835cbb P e5256d91808b47c195bc9b4dbd7f2b87 [term 1 FOLLOWER]: Refusing update from remote peer e61c3a8f61bb48f8a963c9480e53c168: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:04:32.998615 20431 consensus_queue.cc:1048] T 4af19371ea874c09a0a2147040835cbb P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:04:32.997933 20419 raft_consensus.cc:2955] T 5ec1c4ce15e04c7e8c283a62179f2a64 P e5256d91808b47c195bc9b4dbd7f2b87 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 127766fc592545a4997f7790f50f6076 (127.17.223.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } attrs { replace: true } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } } }
I20260709 13:04:33.002457 20431 raft_consensus.cc:2955] T 4af19371ea874c09a0a2147040835cbb P e61c3a8f61bb48f8a963c9480e53c168 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } } }
I20260709 13:04:33.004894 20112 raft_consensus.cc:2955] T 4af19371ea874c09a0a2147040835cbb P 127766fc592545a4997f7790f50f6076 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } } }
I20260709 13:04:33.011040 20111 raft_consensus.cc:2955] T 5ec1c4ce15e04c7e8c283a62179f2a64 P 127766fc592545a4997f7790f50f6076 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 127766fc592545a4997f7790f50f6076 (127.17.223.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } attrs { replace: true } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } } }
I20260709 13:04:33.014998 19294 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 4af19371ea874c09a0a2147040835cbb with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:04:33.018708 19478 raft_consensus.cc:2955] T 5ec1c4ce15e04c7e8c283a62179f2a64 P 0473d2b2d01f4459b1e90fd12cc7840e [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 127766fc592545a4997f7790f50f6076 (127.17.223.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } attrs { replace: true } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } } }
I20260709 13:04:33.023229 19304 catalog_manager.cc:5697] T 4af19371ea874c09a0a2147040835cbb P 127766fc592545a4997f7790f50f6076 reported cstate change: config changed from index 3 to 4, VOTER 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2) evicted. New cstate: current_term: 1 leader_uuid: "e61c3a8f61bb48f8a963c9480e53c168" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } } }
I20260709 13:04:33.026386 19407 raft_consensus.cc:2955] T 4af19371ea874c09a0a2147040835cbb P e5256d91808b47c195bc9b4dbd7f2b87 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } } }
I20260709 13:04:33.034137 19557 raft_consensus.cc:2955] T 5ec1c4ce15e04c7e8c283a62179f2a64 P e61c3a8f61bb48f8a963c9480e53c168 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 127766fc592545a4997f7790f50f6076 (127.17.223.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } attrs { replace: true } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } } }
I20260709 13:04:33.041631 19309 catalog_manager.cc:5697] T 5ec1c4ce15e04c7e8c283a62179f2a64 P 0473d2b2d01f4459b1e90fd12cc7840e reported cstate change: config changed from index 2 to 3, 127766fc592545a4997f7790f50f6076 (127.17.223.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } attrs { replace: true } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } } }
I20260709 13:04:33.057358 19468 tablet_service.cc:1558] Processing DeleteTablet for tablet 4af19371ea874c09a0a2147040835cbb with delete_type TABLET_DATA_TOMBSTONED (TS 0473d2b2d01f4459b1e90fd12cc7840e not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:58272
I20260709 13:04:33.062803 20447 raft_consensus.cc:1064] T 14efcc79969f41babe5529c22d59156d P e5256d91808b47c195bc9b4dbd7f2b87: attempting to promote NON_VOTER 127766fc592545a4997f7790f50f6076 to VOTER
I20260709 13:04:33.071354 20447 consensus_queue.cc:237] T 14efcc79969f41babe5529c22d59156d P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } attrs { replace: true } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:04:33.076016 19407 consensus_queue.cc:237] T 5ec1c4ce15e04c7e8c283a62179f2a64 P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:04:33.078210 20468 raft_consensus.cc:1064] T 70797e5783b5454ab0d0eea663e791e3 P e5256d91808b47c195bc9b4dbd7f2b87: attempting to promote NON_VOTER 127766fc592545a4997f7790f50f6076 to VOTER
I20260709 13:04:33.133625 20468 consensus_queue.cc:237] T 70797e5783b5454ab0d0eea663e791e3 P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } attrs { replace: true } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:04:33.142024 20486 tablet_replica.cc:333] T 4af19371ea874c09a0a2147040835cbb P 0473d2b2d01f4459b1e90fd12cc7840e: stopping tablet replica
I20260709 13:04:33.146844 19557 raft_consensus.cc:1275] T 70797e5783b5454ab0d0eea663e791e3 P e61c3a8f61bb48f8a963c9480e53c168 [term 1 FOLLOWER]: Refusing update from remote peer e5256d91808b47c195bc9b4dbd7f2b87: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:04:33.148372 20469 consensus_queue.cc:1048] T 70797e5783b5454ab0d0eea663e791e3 P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:04:33.149163 20111 raft_consensus.cc:1275] T 70797e5783b5454ab0d0eea663e791e3 P 127766fc592545a4997f7790f50f6076 [term 1 LEARNER]: Refusing update from remote peer e5256d91808b47c195bc9b4dbd7f2b87: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:04:33.151321 20112 raft_consensus.cc:1275] T 5ec1c4ce15e04c7e8c283a62179f2a64 P 127766fc592545a4997f7790f50f6076 [term 1 FOLLOWER]: Refusing update from remote peer e5256d91808b47c195bc9b4dbd7f2b87: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:04:33.152892 20469 consensus_queue.cc:1048] T 70797e5783b5454ab0d0eea663e791e3 P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Connected to new peer: Peer: permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:04:33.154711 20469 consensus_queue.cc:1048] T 5ec1c4ce15e04c7e8c283a62179f2a64 P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Connected to new peer: Peer: permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:04:33.160621 19558 raft_consensus.cc:1275] T 14efcc79969f41babe5529c22d59156d P e61c3a8f61bb48f8a963c9480e53c168 [term 1 FOLLOWER]: Refusing update from remote peer e5256d91808b47c195bc9b4dbd7f2b87: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:04:33.165794 20468 consensus_queue.cc:1048] T 14efcc79969f41babe5529c22d59156d P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
W20260709 13:04:33.129940 19377 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.2:46257, user_credentials={real_user=slave}} blocked reactor thread for 44921.9us
I20260709 13:04:33.173599 19485 raft_consensus.cc:1275] T 70797e5783b5454ab0d0eea663e791e3 P 0473d2b2d01f4459b1e90fd12cc7840e [term 1 FOLLOWER]: Refusing update from remote peer e5256d91808b47c195bc9b4dbd7f2b87: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:04:33.173919 19483 raft_consensus.cc:1275] T 5ec1c4ce15e04c7e8c283a62179f2a64 P 0473d2b2d01f4459b1e90fd12cc7840e [term 1 FOLLOWER]: Refusing update from remote peer e5256d91808b47c195bc9b4dbd7f2b87: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:04:33.175239 19478 raft_consensus.cc:1275] T 14efcc79969f41babe5529c22d59156d P 0473d2b2d01f4459b1e90fd12cc7840e [term 1 FOLLOWER]: Refusing update from remote peer e5256d91808b47c195bc9b4dbd7f2b87: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:04:33.176544 20486 raft_consensus.cc:2243] T 4af19371ea874c09a0a2147040835cbb P 0473d2b2d01f4459b1e90fd12cc7840e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:33.177917 20486 raft_consensus.cc:2272] T 4af19371ea874c09a0a2147040835cbb P 0473d2b2d01f4459b1e90fd12cc7840e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:33.189536 20111 raft_consensus.cc:1275] T 14efcc79969f41babe5529c22d59156d P 127766fc592545a4997f7790f50f6076 [term 1 LEARNER]: Refusing update from remote peer e5256d91808b47c195bc9b4dbd7f2b87: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:04:33.195941 20491 consensus_queue.cc:1048] T 70797e5783b5454ab0d0eea663e791e3 P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.004s
I20260709 13:04:33.199553 20486 ts_tablet_manager.cc:1916] T 4af19371ea874c09a0a2147040835cbb P 0473d2b2d01f4459b1e90fd12cc7840e: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:04:33.199357 20469 consensus_queue.cc:1048] T 14efcc79969f41babe5529c22d59156d P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:04:33.199340 20468 consensus_queue.cc:1048] T 5ec1c4ce15e04c7e8c283a62179f2a64 P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.002s
I20260709 13:04:33.214660 20447 consensus_queue.cc:1048] T 14efcc79969f41babe5529c22d59156d P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Connected to new peer: Peer: permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.004s
I20260709 13:04:33.228168 20111 raft_consensus.cc:2955] T 5ec1c4ce15e04c7e8c283a62179f2a64 P 127766fc592545a4997f7790f50f6076 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } } }
I20260709 13:04:33.217736 20469 raft_consensus.cc:2955] T 70797e5783b5454ab0d0eea663e791e3 P e5256d91808b47c195bc9b4dbd7f2b87 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 127766fc592545a4997f7790f50f6076 (127.17.223.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } attrs { replace: true } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } } }
I20260709 13:04:33.246623 20447 raft_consensus.cc:2955] T 5ec1c4ce15e04c7e8c283a62179f2a64 P e5256d91808b47c195bc9b4dbd7f2b87 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } } }
I20260709 13:04:33.255402 19305 catalog_manager.cc:5697] T 5ec1c4ce15e04c7e8c283a62179f2a64 P 127766fc592545a4997f7790f50f6076 reported cstate change: config changed from index 3 to 4, VOTER e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3) evicted. New cstate: current_term: 1 leader_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } } }
I20260709 13:04:33.273669 19547 tablet_service.cc:1558] Processing DeleteTablet for tablet 5ec1c4ce15e04c7e8c283a62179f2a64 with delete_type TABLET_DATA_TOMBSTONED (TS e61c3a8f61bb48f8a963c9480e53c168 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:40412
W20260709 13:04:33.279855 19377 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.2:46257, user_credentials={real_user=slave}} blocked reactor thread for 52531.7us
I20260709 13:04:33.283257 20501 tablet_replica.cc:333] T 5ec1c4ce15e04c7e8c283a62179f2a64 P e61c3a8f61bb48f8a963c9480e53c168: stopping tablet replica
I20260709 13:04:33.284837 20111 raft_consensus.cc:2955] T 70797e5783b5454ab0d0eea663e791e3 P 127766fc592545a4997f7790f50f6076 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 127766fc592545a4997f7790f50f6076 (127.17.223.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } attrs { replace: true } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } } }
I20260709 13:04:33.286897 20501 raft_consensus.cc:2243] T 5ec1c4ce15e04c7e8c283a62179f2a64 P e61c3a8f61bb48f8a963c9480e53c168 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:33.284886 19478 raft_consensus.cc:2955] T 5ec1c4ce15e04c7e8c283a62179f2a64 P 0473d2b2d01f4459b1e90fd12cc7840e [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } } }
I20260709 13:04:33.299019 20468 raft_consensus.cc:2955] T 14efcc79969f41babe5529c22d59156d P e5256d91808b47c195bc9b4dbd7f2b87 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 127766fc592545a4997f7790f50f6076 (127.17.223.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } attrs { replace: true } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } } }
I20260709 13:04:33.304339 20112 raft_consensus.cc:2955] T 14efcc79969f41babe5529c22d59156d P 127766fc592545a4997f7790f50f6076 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 127766fc592545a4997f7790f50f6076 (127.17.223.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } attrs { replace: true } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } } }
I20260709 13:04:33.311230 19478 raft_consensus.cc:2955] T 70797e5783b5454ab0d0eea663e791e3 P 0473d2b2d01f4459b1e90fd12cc7840e [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 127766fc592545a4997f7790f50f6076 (127.17.223.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } attrs { replace: true } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } } }
I20260709 13:04:33.313839 19305 catalog_manager.cc:5697] T 70797e5783b5454ab0d0eea663e791e3 P e5256d91808b47c195bc9b4dbd7f2b87 reported cstate change: config changed from index 2 to 3, 127766fc592545a4997f7790f50f6076 (127.17.223.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:04:33.324401 20486 ts_tablet_manager.cc:1929] T 4af19371ea874c09a0a2147040835cbb P 0473d2b2d01f4459b1e90fd12cc7840e: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:04:33.324973 20486 log.cc:1199] T 4af19371ea874c09a0a2147040835cbb P 0473d2b2d01f4459b1e90fd12cc7840e: Deleting WAL directory at /tmp/dist-test-taskKd2k48/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602220613947-18300-0/minicluster-data/ts-1-root/wals/4af19371ea874c09a0a2147040835cbb
W20260709 13:04:33.326872 19375 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.3:36891, user_credentials={real_user=slave}} blocked reactor thread for 110759us
I20260709 13:04:33.329118 19558 raft_consensus.cc:2955] T 70797e5783b5454ab0d0eea663e791e3 P e61c3a8f61bb48f8a963c9480e53c168 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 127766fc592545a4997f7790f50f6076 (127.17.223.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } attrs { replace: true } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } } }
I20260709 13:04:33.332726 19557 raft_consensus.cc:2955] T 14efcc79969f41babe5529c22d59156d P e61c3a8f61bb48f8a963c9480e53c168 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 127766fc592545a4997f7790f50f6076 (127.17.223.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } attrs { replace: true } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } } }
I20260709 13:04:33.330376 19293 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 5ec1c4ce15e04c7e8c283a62179f2a64 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:04:33.339704 19296 catalog_manager.cc:5028] TS 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257): tablet 4af19371ea874c09a0a2147040835cbb (table test-workload [id=ce1025c73cf04c4baf25820ae7ff0a53]) successfully deleted
I20260709 13:04:33.353762 19305 catalog_manager.cc:5697] T 14efcc79969f41babe5529c22d59156d P e5256d91808b47c195bc9b4dbd7f2b87 reported cstate change: config changed from index 2 to 3, 127766fc592545a4997f7790f50f6076 (127.17.223.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:04:33.358783 19478 raft_consensus.cc:2955] T 14efcc79969f41babe5529c22d59156d P 0473d2b2d01f4459b1e90fd12cc7840e [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 127766fc592545a4997f7790f50f6076 (127.17.223.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } attrs { replace: true } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } } }
I20260709 13:04:33.354157 20501 raft_consensus.cc:2272] T 5ec1c4ce15e04c7e8c283a62179f2a64 P e61c3a8f61bb48f8a963c9480e53c168 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:33.379060 19405 consensus_queue.cc:237] T 70797e5783b5454ab0d0eea663e791e3 P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:04:33.379946 20501 ts_tablet_manager.cc:1916] T 5ec1c4ce15e04c7e8c283a62179f2a64 P e61c3a8f61bb48f8a963c9480e53c168: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:04:33.390585 20111 raft_consensus.cc:1275] T 70797e5783b5454ab0d0eea663e791e3 P 127766fc592545a4997f7790f50f6076 [term 1 FOLLOWER]: Refusing update from remote peer e5256d91808b47c195bc9b4dbd7f2b87: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:04:33.392155 20447 consensus_queue.cc:1048] T 70797e5783b5454ab0d0eea663e791e3 P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Connected to new peer: Peer: permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:04:33.399924 20494 raft_consensus.cc:2955] T 70797e5783b5454ab0d0eea663e791e3 P e5256d91808b47c195bc9b4dbd7f2b87 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } } }
I20260709 13:04:33.410599 20501 ts_tablet_manager.cc:1929] T 5ec1c4ce15e04c7e8c283a62179f2a64 P e61c3a8f61bb48f8a963c9480e53c168: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:04:33.411113 20501 log.cc:1199] T 5ec1c4ce15e04c7e8c283a62179f2a64 P e61c3a8f61bb48f8a963c9480e53c168: Deleting WAL directory at /tmp/dist-test-taskKd2k48/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602220613947-18300-0/minicluster-data/ts-2-root/wals/5ec1c4ce15e04c7e8c283a62179f2a64
I20260709 13:04:33.412953 19557 raft_consensus.cc:1275] T 70797e5783b5454ab0d0eea663e791e3 P e61c3a8f61bb48f8a963c9480e53c168 [term 1 FOLLOWER]: Refusing update from remote peer e5256d91808b47c195bc9b4dbd7f2b87: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:04:33.412971 19294 catalog_manager.cc:5028] TS e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891): tablet 5ec1c4ce15e04c7e8c283a62179f2a64 (table test-workload [id=ce1025c73cf04c4baf25820ae7ff0a53]) successfully deleted
I20260709 13:04:33.414832 20111 raft_consensus.cc:2955] T 70797e5783b5454ab0d0eea663e791e3 P 127766fc592545a4997f7790f50f6076 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } } }
I20260709 13:04:33.429472 19407 consensus_queue.cc:237] T 14efcc79969f41babe5529c22d59156d P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:04:33.433928 20111 raft_consensus.cc:1275] T 14efcc79969f41babe5529c22d59156d P 127766fc592545a4997f7790f50f6076 [term 1 FOLLOWER]: Refusing update from remote peer e5256d91808b47c195bc9b4dbd7f2b87: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:04:33.435086 19478 raft_consensus.cc:1275] T 14efcc79969f41babe5529c22d59156d P 0473d2b2d01f4459b1e90fd12cc7840e [term 1 FOLLOWER]: Refusing update from remote peer e5256d91808b47c195bc9b4dbd7f2b87: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:04:33.435194 20498 consensus_queue.cc:1048] T 70797e5783b5454ab0d0eea663e791e3 P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:04:33.435310 20468 consensus_queue.cc:1048] T 14efcc79969f41babe5529c22d59156d P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Connected to new peer: Peer: permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:04:33.436708 20447 consensus_queue.cc:1048] T 14efcc79969f41babe5529c22d59156d P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:04:33.443738 20495 raft_consensus.cc:2955] T 14efcc79969f41babe5529c22d59156d P e5256d91808b47c195bc9b4dbd7f2b87 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } } }
I20260709 13:04:33.445801 19306 catalog_manager.cc:5697] T 70797e5783b5454ab0d0eea663e791e3 P 127766fc592545a4997f7790f50f6076 reported cstate change: config changed from index 3 to 4, VOTER 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2) evicted. New cstate: current_term: 1 leader_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } } }
I20260709 13:04:33.450621 20111 raft_consensus.cc:2955] T 14efcc79969f41babe5529c22d59156d P 127766fc592545a4997f7790f50f6076 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } } }
I20260709 13:04:33.461694 19468 tablet_service.cc:1558] Processing DeleteTablet for tablet 70797e5783b5454ab0d0eea663e791e3 with delete_type TABLET_DATA_TOMBSTONED (TS 0473d2b2d01f4459b1e90fd12cc7840e not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:58272
I20260709 13:04:33.462601 20486 tablet_replica.cc:333] T 70797e5783b5454ab0d0eea663e791e3 P 0473d2b2d01f4459b1e90fd12cc7840e: stopping tablet replica
I20260709 13:04:33.463631 20486 raft_consensus.cc:2243] T 70797e5783b5454ab0d0eea663e791e3 P 0473d2b2d01f4459b1e90fd12cc7840e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:33.464361 20486 raft_consensus.cc:2272] T 70797e5783b5454ab0d0eea663e791e3 P 0473d2b2d01f4459b1e90fd12cc7840e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:33.465641 19293 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 70797e5783b5454ab0d0eea663e791e3 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:04:33.466334 19293 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 14efcc79969f41babe5529c22d59156d with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:04:33.465938 19478 raft_consensus.cc:2955] T 14efcc79969f41babe5529c22d59156d P 0473d2b2d01f4459b1e90fd12cc7840e [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } } }
I20260709 13:04:33.467680 20486 ts_tablet_manager.cc:1916] T 70797e5783b5454ab0d0eea663e791e3 P 0473d2b2d01f4459b1e90fd12cc7840e: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:04:33.486753 19304 catalog_manager.cc:5697] T 14efcc79969f41babe5529c22d59156d P 0473d2b2d01f4459b1e90fd12cc7840e reported cstate change: config changed from index 3 to 4, VOTER e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3) evicted. New cstate: current_term: 1 leader_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } } }
I20260709 13:04:33.488241 20486 ts_tablet_manager.cc:1929] T 70797e5783b5454ab0d0eea663e791e3 P 0473d2b2d01f4459b1e90fd12cc7840e: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:04:33.488612 20486 log.cc:1199] T 70797e5783b5454ab0d0eea663e791e3 P 0473d2b2d01f4459b1e90fd12cc7840e: Deleting WAL directory at /tmp/dist-test-taskKd2k48/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602220613947-18300-0/minicluster-data/ts-1-root/wals/70797e5783b5454ab0d0eea663e791e3
I20260709 13:04:33.492934 19296 catalog_manager.cc:5028] TS 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257): tablet 70797e5783b5454ab0d0eea663e791e3 (table test-workload [id=ce1025c73cf04c4baf25820ae7ff0a53]) successfully deleted
I20260709 13:04:33.491741 19558 raft_consensus.cc:2955] T 70797e5783b5454ab0d0eea663e791e3 P e61c3a8f61bb48f8a963c9480e53c168 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } } }
I20260709 13:04:33.506158 19547 tablet_service.cc:1558] Processing DeleteTablet for tablet 14efcc79969f41babe5529c22d59156d with delete_type TABLET_DATA_TOMBSTONED (TS e61c3a8f61bb48f8a963c9480e53c168 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:40412
I20260709 13:04:33.507144 20501 tablet_replica.cc:333] T 14efcc79969f41babe5529c22d59156d P e61c3a8f61bb48f8a963c9480e53c168: stopping tablet replica
I20260709 13:04:33.508260 20501 raft_consensus.cc:2243] T 14efcc79969f41babe5529c22d59156d P e61c3a8f61bb48f8a963c9480e53c168 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:33.509001 20501 raft_consensus.cc:2272] T 14efcc79969f41babe5529c22d59156d P e61c3a8f61bb48f8a963c9480e53c168 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:33.512920 20501 ts_tablet_manager.cc:1916] T 14efcc79969f41babe5529c22d59156d P e61c3a8f61bb48f8a963c9480e53c168: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:04:33.524648 20501 ts_tablet_manager.cc:1929] T 14efcc79969f41babe5529c22d59156d P e61c3a8f61bb48f8a963c9480e53c168: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:04:33.524978 20501 log.cc:1199] T 14efcc79969f41babe5529c22d59156d P e61c3a8f61bb48f8a963c9480e53c168: Deleting WAL directory at /tmp/dist-test-taskKd2k48/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602220613947-18300-0/minicluster-data/ts-2-root/wals/14efcc79969f41babe5529c22d59156d
I20260709 13:04:33.526396 19294 catalog_manager.cc:5028] TS e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891): tablet 14efcc79969f41babe5529c22d59156d (table test-workload [id=ce1025c73cf04c4baf25820ae7ff0a53]) successfully deleted
I20260709 13:04:34.572167 19478 consensus_queue.cc:237] T 96efeaaf1057492490e9a621f37e1a2d P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } attrs { replace: true } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: NON_VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: true } }
I20260709 13:04:34.578971 19558 raft_consensus.cc:1275] T 96efeaaf1057492490e9a621f37e1a2d P e61c3a8f61bb48f8a963c9480e53c168 [term 1 FOLLOWER]: Refusing update from remote peer 0473d2b2d01f4459b1e90fd12cc7840e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 13:04:34.580207 19449 consensus_peers.cc:597] T 96efeaaf1057492490e9a621f37e1a2d P 0473d2b2d01f4459b1e90fd12cc7840e -> Peer 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121): Couldn't send request to peer 127766fc592545a4997f7790f50f6076. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 96efeaaf1057492490e9a621f37e1a2d. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:34.580282 19408 raft_consensus.cc:1275] T 96efeaaf1057492490e9a621f37e1a2d P e5256d91808b47c195bc9b4dbd7f2b87 [term 1 FOLLOWER]: Refusing update from remote peer 0473d2b2d01f4459b1e90fd12cc7840e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:04:34.581528 20467 consensus_queue.cc:1048] T 96efeaaf1057492490e9a621f37e1a2d P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:04:34.582508 20504 consensus_queue.cc:1048] T 96efeaaf1057492490e9a621f37e1a2d P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:04:34.590715 20467 raft_consensus.cc:2955] T 96efeaaf1057492490e9a621f37e1a2d P 0473d2b2d01f4459b1e90fd12cc7840e [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 127766fc592545a4997f7790f50f6076 (127.17.223.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } attrs { replace: true } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: NON_VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: true } } }
I20260709 13:04:34.592068 19408 raft_consensus.cc:2955] T 96efeaaf1057492490e9a621f37e1a2d P e5256d91808b47c195bc9b4dbd7f2b87 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 127766fc592545a4997f7790f50f6076 (127.17.223.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } attrs { replace: true } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: NON_VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: true } } }
I20260709 13:04:34.594594 19558 raft_consensus.cc:2955] T 96efeaaf1057492490e9a621f37e1a2d P e61c3a8f61bb48f8a963c9480e53c168 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 127766fc592545a4997f7790f50f6076 (127.17.223.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } attrs { replace: true } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: NON_VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: true } } }
I20260709 13:04:34.607139 19304 catalog_manager.cc:5697] T 96efeaaf1057492490e9a621f37e1a2d P 0473d2b2d01f4459b1e90fd12cc7840e reported cstate change: config changed from index -1 to 2, NON_VOTER 127766fc592545a4997f7790f50f6076 (127.17.223.4) added. New cstate: current_term: 1 leader_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: NON_VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:34.607966 19478 consensus_queue.cc:237] T 172b3dd13109415a955b71ac0e9d2234 P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } attrs { replace: true } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: NON_VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: true } }
I20260709 13:04:34.618755 19408 raft_consensus.cc:1275] T 172b3dd13109415a955b71ac0e9d2234 P e5256d91808b47c195bc9b4dbd7f2b87 [term 1 FOLLOWER]: Refusing update from remote peer 0473d2b2d01f4459b1e90fd12cc7840e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:04:34.620855 20504 consensus_queue.cc:1048] T 172b3dd13109415a955b71ac0e9d2234 P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:04:34.621682 19558 raft_consensus.cc:1275] T 172b3dd13109415a955b71ac0e9d2234 P e61c3a8f61bb48f8a963c9480e53c168 [term 1 FOLLOWER]: Refusing update from remote peer 0473d2b2d01f4459b1e90fd12cc7840e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 13:04:34.623517 19449 consensus_peers.cc:597] T 172b3dd13109415a955b71ac0e9d2234 P 0473d2b2d01f4459b1e90fd12cc7840e -> Peer 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121): Couldn't send request to peer 127766fc592545a4997f7790f50f6076. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 172b3dd13109415a955b71ac0e9d2234. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:34.623574 20504 consensus_queue.cc:1048] T 172b3dd13109415a955b71ac0e9d2234 P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:04:34.637905 20504 raft_consensus.cc:2955] T 172b3dd13109415a955b71ac0e9d2234 P 0473d2b2d01f4459b1e90fd12cc7840e [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 127766fc592545a4997f7790f50f6076 (127.17.223.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } attrs { replace: true } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: NON_VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: true } } }
I20260709 13:04:34.639928 19408 raft_consensus.cc:2955] T 172b3dd13109415a955b71ac0e9d2234 P e5256d91808b47c195bc9b4dbd7f2b87 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 127766fc592545a4997f7790f50f6076 (127.17.223.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } attrs { replace: true } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: NON_VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: true } } }
I20260709 13:04:34.649430 19559 raft_consensus.cc:2955] T 172b3dd13109415a955b71ac0e9d2234 P e61c3a8f61bb48f8a963c9480e53c168 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 127766fc592545a4997f7790f50f6076 (127.17.223.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } attrs { replace: true } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: NON_VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: true } } }
I20260709 13:04:34.656250 19485 consensus_queue.cc:237] T 6c5eebf646ad445a9d1b1adc319d7b16 P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } attrs { replace: true } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: NON_VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: true } }
I20260709 13:04:34.676909 19559 raft_consensus.cc:1275] T 6c5eebf646ad445a9d1b1adc319d7b16 P e61c3a8f61bb48f8a963c9480e53c168 [term 1 FOLLOWER]: Refusing update from remote peer 0473d2b2d01f4459b1e90fd12cc7840e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:04:34.678584 20488 consensus_queue.cc:1048] T 6c5eebf646ad445a9d1b1adc319d7b16 P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:04:34.680619 19449 consensus_peers.cc:597] T 6c5eebf646ad445a9d1b1adc319d7b16 P 0473d2b2d01f4459b1e90fd12cc7840e -> Peer 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121): Couldn't send request to peer 127766fc592545a4997f7790f50f6076. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 6c5eebf646ad445a9d1b1adc319d7b16. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:34.688282 19408 raft_consensus.cc:1275] T 6c5eebf646ad445a9d1b1adc319d7b16 P e5256d91808b47c195bc9b4dbd7f2b87 [term 1 FOLLOWER]: Refusing update from remote peer 0473d2b2d01f4459b1e90fd12cc7840e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:04:34.689649 20504 consensus_queue.cc:1048] T 6c5eebf646ad445a9d1b1adc319d7b16 P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:04:34.694589 19305 catalog_manager.cc:5697] T 172b3dd13109415a955b71ac0e9d2234 P e61c3a8f61bb48f8a963c9480e53c168 reported cstate change: config changed from index -1 to 2, NON_VOTER 127766fc592545a4997f7790f50f6076 (127.17.223.4) added. New cstate: current_term: 1 leader_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } attrs { replace: true } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: NON_VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: true } } }
I20260709 13:04:34.712814 20504 raft_consensus.cc:2955] T 6c5eebf646ad445a9d1b1adc319d7b16 P 0473d2b2d01f4459b1e90fd12cc7840e [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 127766fc592545a4997f7790f50f6076 (127.17.223.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } attrs { replace: true } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: NON_VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: true } } }
I20260709 13:04:34.714768 19405 raft_consensus.cc:2955] T 6c5eebf646ad445a9d1b1adc319d7b16 P e5256d91808b47c195bc9b4dbd7f2b87 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 127766fc592545a4997f7790f50f6076 (127.17.223.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } attrs { replace: true } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: NON_VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: true } } }
I20260709 13:04:34.724583 19557 raft_consensus.cc:2955] T 6c5eebf646ad445a9d1b1adc319d7b16 P e61c3a8f61bb48f8a963c9480e53c168 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 127766fc592545a4997f7790f50f6076 (127.17.223.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } attrs { replace: true } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: NON_VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: true } } }
I20260709 13:04:34.752465 19305 catalog_manager.cc:5697] T 6c5eebf646ad445a9d1b1adc319d7b16 P e61c3a8f61bb48f8a963c9480e53c168 reported cstate change: config changed from index -1 to 2, NON_VOTER 127766fc592545a4997f7790f50f6076 (127.17.223.4) added. New cstate: current_term: 1 leader_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } attrs { replace: true } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: NON_VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: true } } }
I20260709 13:04:34.752852 19408 consensus_queue.cc:237] T 2a16f7501e2444fb86d4e2778e734e02 P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } attrs { replace: true } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: NON_VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: true } }
W20260709 13:04:34.768442 19374 consensus_peers.cc:597] T 2a16f7501e2444fb86d4e2778e734e02 P e5256d91808b47c195bc9b4dbd7f2b87 -> Peer 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121): Couldn't send request to peer 127766fc592545a4997f7790f50f6076. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 2a16f7501e2444fb86d4e2778e734e02. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:34.769505 19557 raft_consensus.cc:1275] T 2a16f7501e2444fb86d4e2778e734e02 P e61c3a8f61bb48f8a963c9480e53c168 [term 2 FOLLOWER]: Refusing update from remote peer e5256d91808b47c195bc9b4dbd7f2b87: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:34.770777 20516 consensus_queue.cc:1048] T 2a16f7501e2444fb86d4e2778e734e02 P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:04:34.772740 19485 raft_consensus.cc:1275] T 2a16f7501e2444fb86d4e2778e734e02 P 0473d2b2d01f4459b1e90fd12cc7840e [term 2 FOLLOWER]: Refusing update from remote peer e5256d91808b47c195bc9b4dbd7f2b87: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:34.774763 20516 consensus_queue.cc:1048] T 2a16f7501e2444fb86d4e2778e734e02 P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:04:34.781011 20495 raft_consensus.cc:2955] T 2a16f7501e2444fb86d4e2778e734e02 P e5256d91808b47c195bc9b4dbd7f2b87 [term 2 LEADER]: Committing config change with OpId 2.2: config changed from index -1 to 2, NON_VOTER 127766fc592545a4997f7790f50f6076 (127.17.223.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } attrs { replace: true } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: NON_VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: true } } }
I20260709 13:04:34.782944 19557 raft_consensus.cc:2955] T 2a16f7501e2444fb86d4e2778e734e02 P e61c3a8f61bb48f8a963c9480e53c168 [term 2 FOLLOWER]: Committing config change with OpId 2.2: config changed from index -1 to 2, NON_VOTER 127766fc592545a4997f7790f50f6076 (127.17.223.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } attrs { replace: true } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: NON_VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: true } } }
I20260709 13:04:34.784662 19485 raft_consensus.cc:2955] T 2a16f7501e2444fb86d4e2778e734e02 P 0473d2b2d01f4459b1e90fd12cc7840e [term 2 FOLLOWER]: Committing config change with OpId 2.2: config changed from index -1 to 2, NON_VOTER 127766fc592545a4997f7790f50f6076 (127.17.223.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } attrs { replace: true } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: NON_VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: true } } }
I20260709 13:04:34.798715 19304 catalog_manager.cc:5697] T 2a16f7501e2444fb86d4e2778e734e02 P e5256d91808b47c195bc9b4dbd7f2b87 reported cstate change: config changed from index -1 to 2, NON_VOTER 127766fc592545a4997f7790f50f6076 (127.17.223.4) added. New cstate: current_term: 2 leader_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: NON_VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:34.987468 20522 ts_tablet_manager.cc:933] T 96efeaaf1057492490e9a621f37e1a2d P 127766fc592545a4997f7790f50f6076: Initiating tablet copy from peer 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:04:34.989476 20522 tablet_copy_client.cc:323] T 96efeaaf1057492490e9a621f37e1a2d P 127766fc592545a4997f7790f50f6076: tablet copy: Beginning tablet copy session from remote peer at address 127.17.223.2:46257
I20260709 13:04:34.991233 19496 tablet_copy_service.cc:140] P 0473d2b2d01f4459b1e90fd12cc7840e: Received BeginTabletCopySession request for tablet 96efeaaf1057492490e9a621f37e1a2d from peer 127766fc592545a4997f7790f50f6076 ({username='slave'} at 127.0.0.1:39478)
I20260709 13:04:34.991671 19496 tablet_copy_service.cc:161] P 0473d2b2d01f4459b1e90fd12cc7840e: Beginning new tablet copy session on tablet 96efeaaf1057492490e9a621f37e1a2d from peer 127766fc592545a4997f7790f50f6076 at {username='slave'} at 127.0.0.1:39478: session id = 127766fc592545a4997f7790f50f6076-96efeaaf1057492490e9a621f37e1a2d
I20260709 13:04:34.998061 19496 tablet_copy_source_session.cc:215] T 96efeaaf1057492490e9a621f37e1a2d P 0473d2b2d01f4459b1e90fd12cc7840e: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:04:35.001660 20522 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 96efeaaf1057492490e9a621f37e1a2d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:35.016817 20522 tablet_copy_client.cc:806] T 96efeaaf1057492490e9a621f37e1a2d P 127766fc592545a4997f7790f50f6076: tablet copy: Starting download of 0 data blocks...
I20260709 13:04:35.017438 20522 tablet_copy_client.cc:670] T 96efeaaf1057492490e9a621f37e1a2d P 127766fc592545a4997f7790f50f6076: tablet copy: Starting download of 1 WAL segments...
I20260709 13:04:35.024403 20522 tablet_copy_client.cc:538] T 96efeaaf1057492490e9a621f37e1a2d P 127766fc592545a4997f7790f50f6076: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:04:35.031286 20522 tablet_bootstrap.cc:492] T 96efeaaf1057492490e9a621f37e1a2d P 127766fc592545a4997f7790f50f6076: Bootstrap starting.
I20260709 13:04:35.048615 20522 tablet_bootstrap.cc:492] T 96efeaaf1057492490e9a621f37e1a2d P 127766fc592545a4997f7790f50f6076: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:04:35.049469 20522 tablet_bootstrap.cc:492] T 96efeaaf1057492490e9a621f37e1a2d P 127766fc592545a4997f7790f50f6076: Bootstrap complete.
I20260709 13:04:35.050135 20522 ts_tablet_manager.cc:1403] T 96efeaaf1057492490e9a621f37e1a2d P 127766fc592545a4997f7790f50f6076: Time spent bootstrapping tablet: real 0.019s	user 0.006s	sys 0.012s
I20260709 13:04:35.052889 20522 raft_consensus.cc:359] T 96efeaaf1057492490e9a621f37e1a2d P 127766fc592545a4997f7790f50f6076 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } attrs { replace: true } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: NON_VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: true } }
I20260709 13:04:35.053664 20522 raft_consensus.cc:740] T 96efeaaf1057492490e9a621f37e1a2d P 127766fc592545a4997f7790f50f6076 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 127766fc592545a4997f7790f50f6076, State: Initialized, Role: LEARNER
I20260709 13:04:35.054391 20522 consensus_queue.cc:260] T 96efeaaf1057492490e9a621f37e1a2d P 127766fc592545a4997f7790f50f6076 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } attrs { replace: true } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: NON_VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: true } }
I20260709 13:04:35.058840 20522 ts_tablet_manager.cc:1434] T 96efeaaf1057492490e9a621f37e1a2d P 127766fc592545a4997f7790f50f6076: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.004s
I20260709 13:04:35.063612 19496 tablet_copy_service.cc:342] P 0473d2b2d01f4459b1e90fd12cc7840e: Request end of tablet copy session 127766fc592545a4997f7790f50f6076-96efeaaf1057492490e9a621f37e1a2d received from {username='slave'} at 127.0.0.1:39478
I20260709 13:04:35.064064 19496 tablet_copy_service.cc:434] P 0473d2b2d01f4459b1e90fd12cc7840e: ending tablet copy session 127766fc592545a4997f7790f50f6076-96efeaaf1057492490e9a621f37e1a2d on tablet 96efeaaf1057492490e9a621f37e1a2d with peer 127766fc592545a4997f7790f50f6076
I20260709 13:04:35.094139 20522 ts_tablet_manager.cc:933] T 172b3dd13109415a955b71ac0e9d2234 P 127766fc592545a4997f7790f50f6076: Initiating tablet copy from peer 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:04:35.097486 20522 tablet_copy_client.cc:323] T 172b3dd13109415a955b71ac0e9d2234 P 127766fc592545a4997f7790f50f6076: tablet copy: Beginning tablet copy session from remote peer at address 127.17.223.2:46257
I20260709 13:04:35.099175 19496 tablet_copy_service.cc:140] P 0473d2b2d01f4459b1e90fd12cc7840e: Received BeginTabletCopySession request for tablet 172b3dd13109415a955b71ac0e9d2234 from peer 127766fc592545a4997f7790f50f6076 ({username='slave'} at 127.0.0.1:39478)
I20260709 13:04:35.099678 19496 tablet_copy_service.cc:161] P 0473d2b2d01f4459b1e90fd12cc7840e: Beginning new tablet copy session on tablet 172b3dd13109415a955b71ac0e9d2234 from peer 127766fc592545a4997f7790f50f6076 at {username='slave'} at 127.0.0.1:39478: session id = 127766fc592545a4997f7790f50f6076-172b3dd13109415a955b71ac0e9d2234
I20260709 13:04:35.106969 19496 tablet_copy_source_session.cc:215] T 172b3dd13109415a955b71ac0e9d2234 P 0473d2b2d01f4459b1e90fd12cc7840e: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:04:35.109849 20522 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 172b3dd13109415a955b71ac0e9d2234. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:35.123426 20522 tablet_copy_client.cc:806] T 172b3dd13109415a955b71ac0e9d2234 P 127766fc592545a4997f7790f50f6076: tablet copy: Starting download of 0 data blocks...
I20260709 13:04:35.124104 20522 tablet_copy_client.cc:670] T 172b3dd13109415a955b71ac0e9d2234 P 127766fc592545a4997f7790f50f6076: tablet copy: Starting download of 1 WAL segments...
I20260709 13:04:35.128566 20522 tablet_copy_client.cc:538] T 172b3dd13109415a955b71ac0e9d2234 P 127766fc592545a4997f7790f50f6076: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:04:35.136785 20522 tablet_bootstrap.cc:492] T 172b3dd13109415a955b71ac0e9d2234 P 127766fc592545a4997f7790f50f6076: Bootstrap starting.
I20260709 13:04:35.155205 20522 tablet_bootstrap.cc:492] T 172b3dd13109415a955b71ac0e9d2234 P 127766fc592545a4997f7790f50f6076: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:04:35.156193 20522 tablet_bootstrap.cc:492] T 172b3dd13109415a955b71ac0e9d2234 P 127766fc592545a4997f7790f50f6076: Bootstrap complete.
I20260709 13:04:35.156872 20522 ts_tablet_manager.cc:1403] T 172b3dd13109415a955b71ac0e9d2234 P 127766fc592545a4997f7790f50f6076: Time spent bootstrapping tablet: real 0.020s	user 0.017s	sys 0.000s
I20260709 13:04:35.159492 20522 raft_consensus.cc:359] T 172b3dd13109415a955b71ac0e9d2234 P 127766fc592545a4997f7790f50f6076 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } attrs { replace: true } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: NON_VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: true } }
I20260709 13:04:35.160092 20522 raft_consensus.cc:740] T 172b3dd13109415a955b71ac0e9d2234 P 127766fc592545a4997f7790f50f6076 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 127766fc592545a4997f7790f50f6076, State: Initialized, Role: LEARNER
I20260709 13:04:35.160691 20522 consensus_queue.cc:260] T 172b3dd13109415a955b71ac0e9d2234 P 127766fc592545a4997f7790f50f6076 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } attrs { replace: true } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: NON_VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: true } }
I20260709 13:04:35.163187 20522 ts_tablet_manager.cc:1434] T 172b3dd13109415a955b71ac0e9d2234 P 127766fc592545a4997f7790f50f6076: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
I20260709 13:04:35.165658 19496 tablet_copy_service.cc:342] P 0473d2b2d01f4459b1e90fd12cc7840e: Request end of tablet copy session 127766fc592545a4997f7790f50f6076-172b3dd13109415a955b71ac0e9d2234 received from {username='slave'} at 127.0.0.1:39478
I20260709 13:04:35.166059 19496 tablet_copy_service.cc:434] P 0473d2b2d01f4459b1e90fd12cc7840e: ending tablet copy session 127766fc592545a4997f7790f50f6076-172b3dd13109415a955b71ac0e9d2234 on tablet 172b3dd13109415a955b71ac0e9d2234 with peer 127766fc592545a4997f7790f50f6076
I20260709 13:04:35.248574 20522 ts_tablet_manager.cc:933] T 2a16f7501e2444fb86d4e2778e734e02 P 127766fc592545a4997f7790f50f6076: Initiating tablet copy from peer e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321)
I20260709 13:04:35.250142 20522 tablet_copy_client.cc:323] T 2a16f7501e2444fb86d4e2778e734e02 P 127766fc592545a4997f7790f50f6076: tablet copy: Beginning tablet copy session from remote peer at address 127.17.223.1:40321
I20260709 13:04:35.251587 19421 tablet_copy_service.cc:140] P e5256d91808b47c195bc9b4dbd7f2b87: Received BeginTabletCopySession request for tablet 2a16f7501e2444fb86d4e2778e734e02 from peer 127766fc592545a4997f7790f50f6076 ({username='slave'} at 127.0.0.1:49050)
I20260709 13:04:35.252015 19421 tablet_copy_service.cc:161] P e5256d91808b47c195bc9b4dbd7f2b87: Beginning new tablet copy session on tablet 2a16f7501e2444fb86d4e2778e734e02 from peer 127766fc592545a4997f7790f50f6076 at {username='slave'} at 127.0.0.1:49050: session id = 127766fc592545a4997f7790f50f6076-2a16f7501e2444fb86d4e2778e734e02
I20260709 13:04:35.257135 19421 tablet_copy_source_session.cc:215] T 2a16f7501e2444fb86d4e2778e734e02 P e5256d91808b47c195bc9b4dbd7f2b87: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:04:35.260030 20522 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2a16f7501e2444fb86d4e2778e734e02. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:35.278322 20522 tablet_copy_client.cc:806] T 2a16f7501e2444fb86d4e2778e734e02 P 127766fc592545a4997f7790f50f6076: tablet copy: Starting download of 0 data blocks...
I20260709 13:04:35.278964 20522 tablet_copy_client.cc:670] T 2a16f7501e2444fb86d4e2778e734e02 P 127766fc592545a4997f7790f50f6076: tablet copy: Starting download of 1 WAL segments...
I20260709 13:04:35.299865 20522 tablet_copy_client.cc:538] T 2a16f7501e2444fb86d4e2778e734e02 P 127766fc592545a4997f7790f50f6076: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:04:35.303479 20529 ts_tablet_manager.cc:933] T 6c5eebf646ad445a9d1b1adc319d7b16 P 127766fc592545a4997f7790f50f6076: Initiating tablet copy from peer 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:04:35.317888 20522 tablet_bootstrap.cc:492] T 2a16f7501e2444fb86d4e2778e734e02 P 127766fc592545a4997f7790f50f6076: Bootstrap starting.
I20260709 13:04:35.319031 20529 tablet_copy_client.cc:323] T 6c5eebf646ad445a9d1b1adc319d7b16 P 127766fc592545a4997f7790f50f6076: tablet copy: Beginning tablet copy session from remote peer at address 127.17.223.2:46257
I20260709 13:04:35.320744 19496 tablet_copy_service.cc:140] P 0473d2b2d01f4459b1e90fd12cc7840e: Received BeginTabletCopySession request for tablet 6c5eebf646ad445a9d1b1adc319d7b16 from peer 127766fc592545a4997f7790f50f6076 ({username='slave'} at 127.0.0.1:39478)
I20260709 13:04:35.321321 19496 tablet_copy_service.cc:161] P 0473d2b2d01f4459b1e90fd12cc7840e: Beginning new tablet copy session on tablet 6c5eebf646ad445a9d1b1adc319d7b16 from peer 127766fc592545a4997f7790f50f6076 at {username='slave'} at 127.0.0.1:39478: session id = 127766fc592545a4997f7790f50f6076-6c5eebf646ad445a9d1b1adc319d7b16
I20260709 13:04:35.332777 19496 tablet_copy_source_session.cc:215] T 6c5eebf646ad445a9d1b1adc319d7b16 P 0473d2b2d01f4459b1e90fd12cc7840e: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:04:35.337570 20529 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6c5eebf646ad445a9d1b1adc319d7b16. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:35.341290 20522 tablet_bootstrap.cc:492] T 2a16f7501e2444fb86d4e2778e734e02 P 127766fc592545a4997f7790f50f6076: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:04:35.342008 20522 tablet_bootstrap.cc:492] T 2a16f7501e2444fb86d4e2778e734e02 P 127766fc592545a4997f7790f50f6076: Bootstrap complete.
I20260709 13:04:35.342610 20522 ts_tablet_manager.cc:1403] T 2a16f7501e2444fb86d4e2778e734e02 P 127766fc592545a4997f7790f50f6076: Time spent bootstrapping tablet: real 0.025s	user 0.016s	sys 0.001s
I20260709 13:04:35.345194 20522 raft_consensus.cc:359] T 2a16f7501e2444fb86d4e2778e734e02 P 127766fc592545a4997f7790f50f6076 [term 2 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } attrs { replace: true } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: NON_VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: true } }
I20260709 13:04:35.345934 20522 raft_consensus.cc:740] T 2a16f7501e2444fb86d4e2778e734e02 P 127766fc592545a4997f7790f50f6076 [term 2 LEARNER]: Becoming Follower/Learner. State: Replica: 127766fc592545a4997f7790f50f6076, State: Initialized, Role: LEARNER
I20260709 13:04:35.346530 20522 consensus_queue.cc:260] T 2a16f7501e2444fb86d4e2778e734e02 P 127766fc592545a4997f7790f50f6076 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } attrs { replace: true } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: NON_VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: true } }
I20260709 13:04:35.348177 20522 ts_tablet_manager.cc:1434] T 2a16f7501e2444fb86d4e2778e734e02 P 127766fc592545a4997f7790f50f6076: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 13:04:35.350884 19421 tablet_copy_service.cc:342] P e5256d91808b47c195bc9b4dbd7f2b87: Request end of tablet copy session 127766fc592545a4997f7790f50f6076-2a16f7501e2444fb86d4e2778e734e02 received from {username='slave'} at 127.0.0.1:49050
I20260709 13:04:35.351312 19421 tablet_copy_service.cc:434] P e5256d91808b47c195bc9b4dbd7f2b87: ending tablet copy session 127766fc592545a4997f7790f50f6076-2a16f7501e2444fb86d4e2778e734e02 on tablet 2a16f7501e2444fb86d4e2778e734e02 with peer 127766fc592545a4997f7790f50f6076
I20260709 13:04:35.355165 20529 tablet_copy_client.cc:806] T 6c5eebf646ad445a9d1b1adc319d7b16 P 127766fc592545a4997f7790f50f6076: tablet copy: Starting download of 0 data blocks...
I20260709 13:04:35.355774 20529 tablet_copy_client.cc:670] T 6c5eebf646ad445a9d1b1adc319d7b16 P 127766fc592545a4997f7790f50f6076: tablet copy: Starting download of 1 WAL segments...
I20260709 13:04:35.359431 20529 tablet_copy_client.cc:538] T 6c5eebf646ad445a9d1b1adc319d7b16 P 127766fc592545a4997f7790f50f6076: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:04:35.367888 20529 tablet_bootstrap.cc:492] T 6c5eebf646ad445a9d1b1adc319d7b16 P 127766fc592545a4997f7790f50f6076: Bootstrap starting.
I20260709 13:04:35.393102 20529 tablet_bootstrap.cc:492] T 6c5eebf646ad445a9d1b1adc319d7b16 P 127766fc592545a4997f7790f50f6076: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:04:35.393958 20529 tablet_bootstrap.cc:492] T 6c5eebf646ad445a9d1b1adc319d7b16 P 127766fc592545a4997f7790f50f6076: Bootstrap complete.
I20260709 13:04:35.394598 20529 ts_tablet_manager.cc:1403] T 6c5eebf646ad445a9d1b1adc319d7b16 P 127766fc592545a4997f7790f50f6076: Time spent bootstrapping tablet: real 0.027s	user 0.012s	sys 0.009s
I20260709 13:04:35.396888 20529 raft_consensus.cc:359] T 6c5eebf646ad445a9d1b1adc319d7b16 P 127766fc592545a4997f7790f50f6076 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } attrs { replace: true } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: NON_VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: true } }
I20260709 13:04:35.397490 20529 raft_consensus.cc:740] T 6c5eebf646ad445a9d1b1adc319d7b16 P 127766fc592545a4997f7790f50f6076 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 127766fc592545a4997f7790f50f6076, State: Initialized, Role: LEARNER
I20260709 13:04:35.397984 20529 consensus_queue.cc:260] T 6c5eebf646ad445a9d1b1adc319d7b16 P 127766fc592545a4997f7790f50f6076 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } attrs { replace: true } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: NON_VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: true } }
I20260709 13:04:35.400107 20529 ts_tablet_manager.cc:1434] T 6c5eebf646ad445a9d1b1adc319d7b16 P 127766fc592545a4997f7790f50f6076: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 13:04:35.402056 19496 tablet_copy_service.cc:342] P 0473d2b2d01f4459b1e90fd12cc7840e: Request end of tablet copy session 127766fc592545a4997f7790f50f6076-6c5eebf646ad445a9d1b1adc319d7b16 received from {username='slave'} at 127.0.0.1:39478
I20260709 13:04:35.402529 19496 tablet_copy_service.cc:434] P 0473d2b2d01f4459b1e90fd12cc7840e: ending tablet copy session 127766fc592545a4997f7790f50f6076-6c5eebf646ad445a9d1b1adc319d7b16 on tablet 6c5eebf646ad445a9d1b1adc319d7b16 with peer 127766fc592545a4997f7790f50f6076
I20260709 13:04:35.471745 20112 raft_consensus.cc:1217] T 96efeaaf1057492490e9a621f37e1a2d P 127766fc592545a4997f7790f50f6076 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:04:35.613675 20112 raft_consensus.cc:1217] T 172b3dd13109415a955b71ac0e9d2234 P 127766fc592545a4997f7790f50f6076 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:04:35.768574 20112 raft_consensus.cc:1217] T 2a16f7501e2444fb86d4e2778e734e02 P 127766fc592545a4997f7790f50f6076 [term 2 LEARNER]: Deduplicated request from leader. Original: 2.1->[2.2-2.2]   Dedup: 2.2->[]
I20260709 13:04:35.805349 20112 raft_consensus.cc:1217] T 6c5eebf646ad445a9d1b1adc319d7b16 P 127766fc592545a4997f7790f50f6076 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:04:35.871274 20467 raft_consensus.cc:1064] T 96efeaaf1057492490e9a621f37e1a2d P 0473d2b2d01f4459b1e90fd12cc7840e: attempting to promote NON_VOTER 127766fc592545a4997f7790f50f6076 to VOTER
I20260709 13:04:35.872960 20467 consensus_queue.cc:237] T 96efeaaf1057492490e9a621f37e1a2d P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } attrs { replace: true } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:04:35.880651 19559 raft_consensus.cc:1275] T 96efeaaf1057492490e9a621f37e1a2d P e61c3a8f61bb48f8a963c9480e53c168 [term 1 FOLLOWER]: Refusing update from remote peer 0473d2b2d01f4459b1e90fd12cc7840e: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:04:35.881424 20112 raft_consensus.cc:1275] T 96efeaaf1057492490e9a621f37e1a2d P 127766fc592545a4997f7790f50f6076 [term 1 LEARNER]: Refusing update from remote peer 0473d2b2d01f4459b1e90fd12cc7840e: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:04:35.881789 19405 raft_consensus.cc:1275] T 96efeaaf1057492490e9a621f37e1a2d P e5256d91808b47c195bc9b4dbd7f2b87 [term 1 FOLLOWER]: Refusing update from remote peer 0473d2b2d01f4459b1e90fd12cc7840e: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:04:35.882336 20467 consensus_queue.cc:1048] T 96efeaaf1057492490e9a621f37e1a2d P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:04:35.883423 20533 consensus_queue.cc:1048] T 96efeaaf1057492490e9a621f37e1a2d P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Connected to new peer: Peer: permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:04:35.884160 20488 consensus_queue.cc:1048] T 96efeaaf1057492490e9a621f37e1a2d P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:04:35.913858 20488 raft_consensus.cc:2955] T 96efeaaf1057492490e9a621f37e1a2d P 0473d2b2d01f4459b1e90fd12cc7840e [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 127766fc592545a4997f7790f50f6076 (127.17.223.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } attrs { replace: true } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } } }
I20260709 13:04:35.915697 20112 raft_consensus.cc:2955] T 96efeaaf1057492490e9a621f37e1a2d P 127766fc592545a4997f7790f50f6076 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 127766fc592545a4997f7790f50f6076 (127.17.223.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } attrs { replace: true } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } } }
I20260709 13:04:35.917341 19405 raft_consensus.cc:2955] T 96efeaaf1057492490e9a621f37e1a2d P e5256d91808b47c195bc9b4dbd7f2b87 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 127766fc592545a4997f7790f50f6076 (127.17.223.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } attrs { replace: true } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } } }
I20260709 13:04:35.928435 19559 raft_consensus.cc:2955] T 96efeaaf1057492490e9a621f37e1a2d P e61c3a8f61bb48f8a963c9480e53c168 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 127766fc592545a4997f7790f50f6076 (127.17.223.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } attrs { replace: true } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } } }
I20260709 13:04:35.937511 19305 catalog_manager.cc:5697] T 96efeaaf1057492490e9a621f37e1a2d P 127766fc592545a4997f7790f50f6076 reported cstate change: config changed from index 2 to 3, 127766fc592545a4997f7790f50f6076 (127.17.223.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } attrs { replace: true } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } } }
I20260709 13:04:36.008481 19485 consensus_queue.cc:237] T 96efeaaf1057492490e9a621f37e1a2d P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:04:36.017447 20112 raft_consensus.cc:1275] T 96efeaaf1057492490e9a621f37e1a2d P 127766fc592545a4997f7790f50f6076 [term 1 FOLLOWER]: Refusing update from remote peer 0473d2b2d01f4459b1e90fd12cc7840e: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:04:36.017596 19559 raft_consensus.cc:1275] T 96efeaaf1057492490e9a621f37e1a2d P e61c3a8f61bb48f8a963c9480e53c168 [term 1 FOLLOWER]: Refusing update from remote peer 0473d2b2d01f4459b1e90fd12cc7840e: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:04:36.019196 20540 consensus_queue.cc:1048] T 96efeaaf1057492490e9a621f37e1a2d P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Connected to new peer: Peer: permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:04:36.020110 20488 consensus_queue.cc:1048] T 96efeaaf1057492490e9a621f37e1a2d P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:04:36.030185 20467 raft_consensus.cc:2955] T 96efeaaf1057492490e9a621f37e1a2d P 0473d2b2d01f4459b1e90fd12cc7840e [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } } }
I20260709 13:04:36.034727 19559 raft_consensus.cc:2955] T 96efeaaf1057492490e9a621f37e1a2d P e61c3a8f61bb48f8a963c9480e53c168 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } } }
I20260709 13:04:36.036314 20112 raft_consensus.cc:2955] T 96efeaaf1057492490e9a621f37e1a2d P 127766fc592545a4997f7790f50f6076 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } } }
I20260709 13:04:36.055522 19296 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 96efeaaf1057492490e9a621f37e1a2d with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:04:36.064584 19306 catalog_manager.cc:5697] T 96efeaaf1057492490e9a621f37e1a2d P e61c3a8f61bb48f8a963c9480e53c168 reported cstate change: config changed from index 3 to 4, VOTER e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1) evicted. New cstate: current_term: 1 leader_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } } }
I20260709 13:04:36.076611 19401 tablet_service.cc:1558] Processing DeleteTablet for tablet 96efeaaf1057492490e9a621f37e1a2d with delete_type TABLET_DATA_TOMBSTONED (TS e5256d91808b47c195bc9b4dbd7f2b87 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:52318
I20260709 13:04:36.102739 20547 tablet_replica.cc:333] T 96efeaaf1057492490e9a621f37e1a2d P e5256d91808b47c195bc9b4dbd7f2b87: stopping tablet replica
I20260709 13:04:36.104401 20547 raft_consensus.cc:2243] T 96efeaaf1057492490e9a621f37e1a2d P e5256d91808b47c195bc9b4dbd7f2b87 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:36.105301 20547 raft_consensus.cc:2272] T 96efeaaf1057492490e9a621f37e1a2d P e5256d91808b47c195bc9b4dbd7f2b87 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:36.109108 20547 ts_tablet_manager.cc:1916] T 96efeaaf1057492490e9a621f37e1a2d P e5256d91808b47c195bc9b4dbd7f2b87: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:04:36.114617 20540 raft_consensus.cc:1064] T 172b3dd13109415a955b71ac0e9d2234 P 0473d2b2d01f4459b1e90fd12cc7840e: attempting to promote NON_VOTER 127766fc592545a4997f7790f50f6076 to VOTER
I20260709 13:04:36.117288 20540 consensus_queue.cc:237] T 172b3dd13109415a955b71ac0e9d2234 P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } attrs { replace: true } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:04:36.123593 19557 raft_consensus.cc:1275] T 172b3dd13109415a955b71ac0e9d2234 P e61c3a8f61bb48f8a963c9480e53c168 [term 1 FOLLOWER]: Refusing update from remote peer 0473d2b2d01f4459b1e90fd12cc7840e: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:04:36.125221 20111 raft_consensus.cc:1275] T 172b3dd13109415a955b71ac0e9d2234 P 127766fc592545a4997f7790f50f6076 [term 1 LEARNER]: Refusing update from remote peer 0473d2b2d01f4459b1e90fd12cc7840e: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:04:36.126726 20488 consensus_queue.cc:1048] T 172b3dd13109415a955b71ac0e9d2234 P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:04:36.127036 20547 ts_tablet_manager.cc:1929] T 96efeaaf1057492490e9a621f37e1a2d P e5256d91808b47c195bc9b4dbd7f2b87: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:04:36.127478 20547 log.cc:1199] T 96efeaaf1057492490e9a621f37e1a2d P e5256d91808b47c195bc9b4dbd7f2b87: Deleting WAL directory at /tmp/dist-test-taskKd2k48/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602220613947-18300-0/minicluster-data/ts-0-root/wals/96efeaaf1057492490e9a621f37e1a2d
I20260709 13:04:36.127548 20467 consensus_queue.cc:1048] T 172b3dd13109415a955b71ac0e9d2234 P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Connected to new peer: Peer: permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:04:36.130040 19293 catalog_manager.cc:5028] TS e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321): tablet 96efeaaf1057492490e9a621f37e1a2d (table test-workload [id=ce1025c73cf04c4baf25820ae7ff0a53]) successfully deleted
I20260709 13:04:36.131116 19408 raft_consensus.cc:1275] T 172b3dd13109415a955b71ac0e9d2234 P e5256d91808b47c195bc9b4dbd7f2b87 [term 1 FOLLOWER]: Refusing update from remote peer 0473d2b2d01f4459b1e90fd12cc7840e: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:04:36.132936 20488 consensus_queue.cc:1048] T 172b3dd13109415a955b71ac0e9d2234 P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:04:36.146697 20467 raft_consensus.cc:2955] T 172b3dd13109415a955b71ac0e9d2234 P 0473d2b2d01f4459b1e90fd12cc7840e [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 127766fc592545a4997f7790f50f6076 (127.17.223.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } attrs { replace: true } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } } }
I20260709 13:04:36.150389 19556 raft_consensus.cc:2955] T 172b3dd13109415a955b71ac0e9d2234 P e61c3a8f61bb48f8a963c9480e53c168 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 127766fc592545a4997f7790f50f6076 (127.17.223.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } attrs { replace: true } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } } }
I20260709 13:04:36.151366 20111 raft_consensus.cc:2955] T 172b3dd13109415a955b71ac0e9d2234 P 127766fc592545a4997f7790f50f6076 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 127766fc592545a4997f7790f50f6076 (127.17.223.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } attrs { replace: true } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } } }
I20260709 13:04:36.166901 19304 catalog_manager.cc:5697] T 172b3dd13109415a955b71ac0e9d2234 P 127766fc592545a4997f7790f50f6076 reported cstate change: config changed from index 2 to 3, 127766fc592545a4997f7790f50f6076 (127.17.223.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } attrs { replace: true } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } } }
I20260709 13:04:36.173081 19408 raft_consensus.cc:2955] T 172b3dd13109415a955b71ac0e9d2234 P e5256d91808b47c195bc9b4dbd7f2b87 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 127766fc592545a4997f7790f50f6076 (127.17.223.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } attrs { replace: true } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } } }
I20260709 13:04:36.181524 19485 consensus_queue.cc:237] T 172b3dd13109415a955b71ac0e9d2234 P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:04:36.187453 19405 raft_consensus.cc:1275] T 172b3dd13109415a955b71ac0e9d2234 P e5256d91808b47c195bc9b4dbd7f2b87 [term 1 FOLLOWER]: Refusing update from remote peer 0473d2b2d01f4459b1e90fd12cc7840e: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:04:36.188789 20540 consensus_queue.cc:1048] T 172b3dd13109415a955b71ac0e9d2234 P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:04:36.189968 20111 raft_consensus.cc:1275] T 172b3dd13109415a955b71ac0e9d2234 P 127766fc592545a4997f7790f50f6076 [term 1 FOLLOWER]: Refusing update from remote peer 0473d2b2d01f4459b1e90fd12cc7840e: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:04:36.193922 20540 consensus_queue.cc:1048] T 172b3dd13109415a955b71ac0e9d2234 P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Connected to new peer: Peer: permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:04:36.196242 20539 raft_consensus.cc:2955] T 172b3dd13109415a955b71ac0e9d2234 P 0473d2b2d01f4459b1e90fd12cc7840e [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } } }
I20260709 13:04:36.204658 19296 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 172b3dd13109415a955b71ac0e9d2234 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:04:36.209649 19405 raft_consensus.cc:2955] T 172b3dd13109415a955b71ac0e9d2234 P e5256d91808b47c195bc9b4dbd7f2b87 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } } }
I20260709 13:04:36.217742 20111 raft_consensus.cc:2955] T 172b3dd13109415a955b71ac0e9d2234 P 127766fc592545a4997f7790f50f6076 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } } }
I20260709 13:04:36.226867 19304 catalog_manager.cc:5697] T 172b3dd13109415a955b71ac0e9d2234 P e5256d91808b47c195bc9b4dbd7f2b87 reported cstate change: config changed from index 3 to 4, VOTER e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3) evicted. New cstate: current_term: 1 leader_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } } }
I20260709 13:04:36.237315 19547 tablet_service.cc:1558] Processing DeleteTablet for tablet 172b3dd13109415a955b71ac0e9d2234 with delete_type TABLET_DATA_TOMBSTONED (TS e61c3a8f61bb48f8a963c9480e53c168 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:40412
I20260709 13:04:36.261852 20552 tablet_replica.cc:333] T 172b3dd13109415a955b71ac0e9d2234 P e61c3a8f61bb48f8a963c9480e53c168: stopping tablet replica
I20260709 13:04:36.262949 20552 raft_consensus.cc:2243] T 172b3dd13109415a955b71ac0e9d2234 P e61c3a8f61bb48f8a963c9480e53c168 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:36.263648 20552 raft_consensus.cc:2272] T 172b3dd13109415a955b71ac0e9d2234 P e61c3a8f61bb48f8a963c9480e53c168 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:36.269848 20552 ts_tablet_manager.cc:1916] T 172b3dd13109415a955b71ac0e9d2234 P e61c3a8f61bb48f8a963c9480e53c168: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:04:36.285239 20552 ts_tablet_manager.cc:1929] T 172b3dd13109415a955b71ac0e9d2234 P e61c3a8f61bb48f8a963c9480e53c168: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:04:36.285629 20552 log.cc:1199] T 172b3dd13109415a955b71ac0e9d2234 P e61c3a8f61bb48f8a963c9480e53c168: Deleting WAL directory at /tmp/dist-test-taskKd2k48/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602220613947-18300-0/minicluster-data/ts-2-root/wals/172b3dd13109415a955b71ac0e9d2234
I20260709 13:04:36.287241 19294 catalog_manager.cc:5028] TS e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891): tablet 172b3dd13109415a955b71ac0e9d2234 (table test-workload [id=ce1025c73cf04c4baf25820ae7ff0a53]) successfully deleted
I20260709 13:04:36.366365 20540 raft_consensus.cc:1064] T 6c5eebf646ad445a9d1b1adc319d7b16 P 0473d2b2d01f4459b1e90fd12cc7840e: attempting to promote NON_VOTER 127766fc592545a4997f7790f50f6076 to VOTER
I20260709 13:04:36.368883 20540 consensus_queue.cc:237] T 6c5eebf646ad445a9d1b1adc319d7b16 P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } attrs { replace: true } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:04:36.385210 19556 raft_consensus.cc:1275] T 6c5eebf646ad445a9d1b1adc319d7b16 P e61c3a8f61bb48f8a963c9480e53c168 [term 1 FOLLOWER]: Refusing update from remote peer 0473d2b2d01f4459b1e90fd12cc7840e: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:04:36.387805 20488 consensus_queue.cc:1048] T 6c5eebf646ad445a9d1b1adc319d7b16 P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:04:36.391359 20499 raft_consensus.cc:1064] T 2a16f7501e2444fb86d4e2778e734e02 P e5256d91808b47c195bc9b4dbd7f2b87: attempting to promote NON_VOTER 127766fc592545a4997f7790f50f6076 to VOTER
I20260709 13:04:36.393453 20111 raft_consensus.cc:1275] T 6c5eebf646ad445a9d1b1adc319d7b16 P 127766fc592545a4997f7790f50f6076 [term 1 LEARNER]: Refusing update from remote peer 0473d2b2d01f4459b1e90fd12cc7840e: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:04:36.393864 20499 consensus_queue.cc:237] T 2a16f7501e2444fb86d4e2778e734e02 P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 0, Current term: 2, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } attrs { replace: true } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:04:36.400846 19408 raft_consensus.cc:1275] T 6c5eebf646ad445a9d1b1adc319d7b16 P e5256d91808b47c195bc9b4dbd7f2b87 [term 1 FOLLOWER]: Refusing update from remote peer 0473d2b2d01f4459b1e90fd12cc7840e: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:04:36.407677 20540 consensus_queue.cc:1048] T 6c5eebf646ad445a9d1b1adc319d7b16 P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Connected to new peer: Peer: permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:04:36.413405 20111 raft_consensus.cc:1275] T 2a16f7501e2444fb86d4e2778e734e02 P 127766fc592545a4997f7790f50f6076 [term 2 LEARNER]: Refusing update from remote peer e5256d91808b47c195bc9b4dbd7f2b87: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 13:04:36.415819 19485 raft_consensus.cc:1275] T 2a16f7501e2444fb86d4e2778e734e02 P 0473d2b2d01f4459b1e90fd12cc7840e [term 2 FOLLOWER]: Refusing update from remote peer e5256d91808b47c195bc9b4dbd7f2b87: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 13:04:36.416249 19556 raft_consensus.cc:1275] T 2a16f7501e2444fb86d4e2778e734e02 P e61c3a8f61bb48f8a963c9480e53c168 [term 2 FOLLOWER]: Refusing update from remote peer e5256d91808b47c195bc9b4dbd7f2b87: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 13:04:36.417316 20516 consensus_queue.cc:1048] T 2a16f7501e2444fb86d4e2778e734e02 P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Connected to new peer: Peer: permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:04:36.422752 20540 consensus_queue.cc:1048] T 6c5eebf646ad445a9d1b1adc319d7b16 P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:04:36.419521 20516 consensus_queue.cc:1048] T 2a16f7501e2444fb86d4e2778e734e02 P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.005s
I20260709 13:04:36.440510 20516 consensus_queue.cc:1048] T 2a16f7501e2444fb86d4e2778e734e02 P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:04:36.510404 20488 raft_consensus.cc:2955] T 6c5eebf646ad445a9d1b1adc319d7b16 P 0473d2b2d01f4459b1e90fd12cc7840e [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 127766fc592545a4997f7790f50f6076 (127.17.223.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } attrs { replace: true } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } } }
I20260709 13:04:36.513396 20516 raft_consensus.cc:2955] T 2a16f7501e2444fb86d4e2778e734e02 P e5256d91808b47c195bc9b4dbd7f2b87 [term 2 LEADER]: Committing config change with OpId 2.3: config changed from index 2 to 3, 127766fc592545a4997f7790f50f6076 (127.17.223.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } attrs { replace: true } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } } }
I20260709 13:04:36.522756 20111 raft_consensus.cc:2955] T 2a16f7501e2444fb86d4e2778e734e02 P 127766fc592545a4997f7790f50f6076 [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index 2 to 3, 127766fc592545a4997f7790f50f6076 (127.17.223.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } attrs { replace: true } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } } }
I20260709 13:04:36.523484 19557 raft_consensus.cc:2955] T 6c5eebf646ad445a9d1b1adc319d7b16 P e61c3a8f61bb48f8a963c9480e53c168 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 127766fc592545a4997f7790f50f6076 (127.17.223.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } attrs { replace: true } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } } }
I20260709 13:04:36.540496 19304 catalog_manager.cc:5697] T 6c5eebf646ad445a9d1b1adc319d7b16 P e61c3a8f61bb48f8a963c9480e53c168 reported cstate change: config changed from index 2 to 3, 127766fc592545a4997f7790f50f6076 (127.17.223.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } attrs { replace: true } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } } }
I20260709 13:04:36.547549 19558 raft_consensus.cc:2955] T 2a16f7501e2444fb86d4e2778e734e02 P e61c3a8f61bb48f8a963c9480e53c168 [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index 2 to 3, 127766fc592545a4997f7790f50f6076 (127.17.223.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } attrs { replace: true } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } } }
I20260709 13:04:36.567968 19309 catalog_manager.cc:5697] T 2a16f7501e2444fb86d4e2778e734e02 P 127766fc592545a4997f7790f50f6076 reported cstate change: config changed from index 2 to 3, 127766fc592545a4997f7790f50f6076 (127.17.223.4) changed from NON_VOTER to VOTER. New cstate: current_term: 2 leader_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } attrs { replace: true } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } } }
W20260709 13:04:36.571198 19449 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.4:43121, user_credentials={real_user=slave}} blocked reactor thread for 62022.3us
I20260709 13:04:36.579851 19485 raft_consensus.cc:2955] T 2a16f7501e2444fb86d4e2778e734e02 P 0473d2b2d01f4459b1e90fd12cc7840e [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index 2 to 3, 127766fc592545a4997f7790f50f6076 (127.17.223.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } attrs { replace: true } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } } }
I20260709 13:04:36.585094 19405 consensus_queue.cc:237] T 2a16f7501e2444fb86d4e2778e734e02 P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:04:36.590782 20111 raft_consensus.cc:2955] T 6c5eebf646ad445a9d1b1adc319d7b16 P 127766fc592545a4997f7790f50f6076 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 127766fc592545a4997f7790f50f6076 (127.17.223.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } attrs { replace: true } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } } }
I20260709 13:04:36.603251 19407 raft_consensus.cc:2955] T 6c5eebf646ad445a9d1b1adc319d7b16 P e5256d91808b47c195bc9b4dbd7f2b87 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 127766fc592545a4997f7790f50f6076 (127.17.223.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } attrs { replace: true } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } } }
I20260709 13:04:36.605427 19485 consensus_queue.cc:237] T 6c5eebf646ad445a9d1b1adc319d7b16 P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:04:36.607810 20109 raft_consensus.cc:1275] T 2a16f7501e2444fb86d4e2778e734e02 P 127766fc592545a4997f7790f50f6076 [term 2 FOLLOWER]: Refusing update from remote peer e5256d91808b47c195bc9b4dbd7f2b87: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 13:04:36.612914 19557 raft_consensus.cc:1275] T 2a16f7501e2444fb86d4e2778e734e02 P e61c3a8f61bb48f8a963c9480e53c168 [term 2 FOLLOWER]: Refusing update from remote peer e5256d91808b47c195bc9b4dbd7f2b87: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 13:04:36.613922 20534 consensus_queue.cc:1048] T 2a16f7501e2444fb86d4e2778e734e02 P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Connected to new peer: Peer: permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:04:36.614595 19557 raft_consensus.cc:1275] T 6c5eebf646ad445a9d1b1adc319d7b16 P e61c3a8f61bb48f8a963c9480e53c168 [term 1 FOLLOWER]: Refusing update from remote peer 0473d2b2d01f4459b1e90fd12cc7840e: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:04:36.616623 20541 consensus_queue.cc:1048] T 6c5eebf646ad445a9d1b1adc319d7b16 P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:04:36.622792 20564 consensus_queue.cc:1048] T 2a16f7501e2444fb86d4e2778e734e02 P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:04:36.627362 20539 raft_consensus.cc:2955] T 6c5eebf646ad445a9d1b1adc319d7b16 P 0473d2b2d01f4459b1e90fd12cc7840e [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } } }
I20260709 13:04:36.627807 20516 raft_consensus.cc:2955] T 2a16f7501e2444fb86d4e2778e734e02 P e5256d91808b47c195bc9b4dbd7f2b87 [term 2 LEADER]: Committing config change with OpId 2.4: config changed from index 3 to 4, VOTER 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } } }
I20260709 13:04:36.632014 19558 raft_consensus.cc:2955] T 2a16f7501e2444fb86d4e2778e734e02 P e61c3a8f61bb48f8a963c9480e53c168 [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, VOTER 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } } }
I20260709 13:04:36.631945 20112 raft_consensus.cc:2955] T 2a16f7501e2444fb86d4e2778e734e02 P 127766fc592545a4997f7790f50f6076 [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, VOTER 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } } }
I20260709 13:04:36.640499 19293 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 2a16f7501e2444fb86d4e2778e734e02 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:04:36.655400 19309 catalog_manager.cc:5697] T 2a16f7501e2444fb86d4e2778e734e02 P 127766fc592545a4997f7790f50f6076 reported cstate change: config changed from index 3 to 4, VOTER 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2) evicted. New cstate: current_term: 2 leader_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } } }
I20260709 13:04:36.632375 19557 raft_consensus.cc:2955] T 6c5eebf646ad445a9d1b1adc319d7b16 P e61c3a8f61bb48f8a963c9480e53c168 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } } }
I20260709 13:04:36.665766 20109 raft_consensus.cc:1275] T 6c5eebf646ad445a9d1b1adc319d7b16 P 127766fc592545a4997f7790f50f6076 [term 1 FOLLOWER]: Refusing update from remote peer 0473d2b2d01f4459b1e90fd12cc7840e: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:04:36.666069 19296 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 6c5eebf646ad445a9d1b1adc319d7b16 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:04:36.669322 20541 consensus_queue.cc:1048] T 6c5eebf646ad445a9d1b1adc319d7b16 P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Connected to new peer: Peer: permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:04:36.679467 20109 raft_consensus.cc:2955] T 6c5eebf646ad445a9d1b1adc319d7b16 P 127766fc592545a4997f7790f50f6076 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } } }
I20260709 13:04:36.681887 19468 tablet_service.cc:1558] Processing DeleteTablet for tablet 2a16f7501e2444fb86d4e2778e734e02 with delete_type TABLET_DATA_TOMBSTONED (TS 0473d2b2d01f4459b1e90fd12cc7840e not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:58272
I20260709 13:04:36.681795 19306 catalog_manager.cc:5697] T 6c5eebf646ad445a9d1b1adc319d7b16 P 0473d2b2d01f4459b1e90fd12cc7840e reported cstate change: config changed from index 3 to 4, VOTER e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1) evicted. New cstate: current_term: 1 leader_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:36.696352 19401 tablet_service.cc:1558] Processing DeleteTablet for tablet 6c5eebf646ad445a9d1b1adc319d7b16 with delete_type TABLET_DATA_TOMBSTONED (TS e5256d91808b47c195bc9b4dbd7f2b87 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:52318
I20260709 13:04:36.698237 20566 tablet_replica.cc:333] T 6c5eebf646ad445a9d1b1adc319d7b16 P e5256d91808b47c195bc9b4dbd7f2b87: stopping tablet replica
I20260709 13:04:36.699118 20566 raft_consensus.cc:2243] T 6c5eebf646ad445a9d1b1adc319d7b16 P e5256d91808b47c195bc9b4dbd7f2b87 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:36.700203 20566 raft_consensus.cc:2272] T 6c5eebf646ad445a9d1b1adc319d7b16 P e5256d91808b47c195bc9b4dbd7f2b87 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:36.704385 20566 ts_tablet_manager.cc:1916] T 6c5eebf646ad445a9d1b1adc319d7b16 P e5256d91808b47c195bc9b4dbd7f2b87: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:04:36.704267 20565 tablet_replica.cc:333] T 2a16f7501e2444fb86d4e2778e734e02 P 0473d2b2d01f4459b1e90fd12cc7840e: stopping tablet replica
I20260709 13:04:36.705857 20565 raft_consensus.cc:2243] T 2a16f7501e2444fb86d4e2778e734e02 P 0473d2b2d01f4459b1e90fd12cc7840e [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:36.706553 20565 raft_consensus.cc:2272] T 2a16f7501e2444fb86d4e2778e734e02 P 0473d2b2d01f4459b1e90fd12cc7840e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:36.711946 20565 ts_tablet_manager.cc:1916] T 2a16f7501e2444fb86d4e2778e734e02 P 0473d2b2d01f4459b1e90fd12cc7840e: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:04:36.718393 20566 ts_tablet_manager.cc:1929] T 6c5eebf646ad445a9d1b1adc319d7b16 P e5256d91808b47c195bc9b4dbd7f2b87: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:04:36.718811 20566 log.cc:1199] T 6c5eebf646ad445a9d1b1adc319d7b16 P e5256d91808b47c195bc9b4dbd7f2b87: Deleting WAL directory at /tmp/dist-test-taskKd2k48/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602220613947-18300-0/minicluster-data/ts-0-root/wals/6c5eebf646ad445a9d1b1adc319d7b16
I20260709 13:04:36.719985 19293 catalog_manager.cc:5028] TS e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321): tablet 6c5eebf646ad445a9d1b1adc319d7b16 (table test-workload [id=ce1025c73cf04c4baf25820ae7ff0a53]) successfully deleted
I20260709 13:04:36.725898 20565 ts_tablet_manager.cc:1929] T 2a16f7501e2444fb86d4e2778e734e02 P 0473d2b2d01f4459b1e90fd12cc7840e: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 2.3
I20260709 13:04:36.726311 20565 log.cc:1199] T 2a16f7501e2444fb86d4e2778e734e02 P 0473d2b2d01f4459b1e90fd12cc7840e: Deleting WAL directory at /tmp/dist-test-taskKd2k48/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602220613947-18300-0/minicluster-data/ts-1-root/wals/2a16f7501e2444fb86d4e2778e734e02
I20260709 13:04:36.727833 19296 catalog_manager.cc:5028] TS 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257): tablet 2a16f7501e2444fb86d4e2778e734e02 (table test-workload [id=ce1025c73cf04c4baf25820ae7ff0a53]) successfully deleted
I20260709 13:04:36.964797 18300 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:04:37.013938 19407 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "14efcc79969f41babe5529c22d59156d"
dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
mode: GRACEFUL
new_leader_uuid: "127766fc592545a4997f7790f50f6076"
 from {username='slave'} at 127.0.0.1:37312
I20260709 13:04:37.014469 19407 raft_consensus.cc:606] T 14efcc79969f41babe5529c22d59156d P e5256d91808b47c195bc9b4dbd7f2b87 [term 1 LEADER]: Received request to transfer leadership to TS 127766fc592545a4997f7790f50f6076
I20260709 13:04:37.031343 19478 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "309c3ca0ca4b4f3ba129752ea2cb293b"
dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
mode: GRACEFUL
new_leader_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
 from {username='slave'} at 127.0.0.1:48168
I20260709 13:04:37.031807 19478 raft_consensus.cc:606] T 309c3ca0ca4b4f3ba129752ea2cb293b P 0473d2b2d01f4459b1e90fd12cc7840e [term 1 LEADER]: Received request to transfer leadership to TS e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:04:37.034237 19478 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "36f6ba92b9ba46babe4ebd6c02e5fbd9"
dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
mode: GRACEFUL
new_leader_uuid: "127766fc592545a4997f7790f50f6076"
 from {username='slave'} at 127.0.0.1:48168
I20260709 13:04:37.034649 19478 raft_consensus.cc:606] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P 0473d2b2d01f4459b1e90fd12cc7840e [term 1 LEADER]: Received request to transfer leadership to TS 127766fc592545a4997f7790f50f6076
I20260709 13:04:37.036783 19478 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "40e1e16737a842ee936002830f36882e"
dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
mode: GRACEFUL
new_leader_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
 from {username='slave'} at 127.0.0.1:48168
I20260709 13:04:37.037184 19478 raft_consensus.cc:606] T 40e1e16737a842ee936002830f36882e P 0473d2b2d01f4459b1e90fd12cc7840e [term 1 LEADER]: Received request to transfer leadership to TS e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:04:37.050099 19558 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4af19371ea874c09a0a2147040835cbb"
dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
mode: GRACEFUL
new_leader_uuid: "127766fc592545a4997f7790f50f6076"
 from {username='slave'} at 127.0.0.1:51880
I20260709 13:04:37.050614 19558 raft_consensus.cc:606] T 4af19371ea874c09a0a2147040835cbb P e61c3a8f61bb48f8a963c9480e53c168 [term 1 LEADER]: Received request to transfer leadership to TS 127766fc592545a4997f7790f50f6076
I20260709 13:04:37.052850 19478 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6c5eebf646ad445a9d1b1adc319d7b16"
dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
mode: GRACEFUL
new_leader_uuid: "127766fc592545a4997f7790f50f6076"
 from {username='slave'} at 127.0.0.1:48168
I20260709 13:04:37.053290 19478 raft_consensus.cc:606] T 6c5eebf646ad445a9d1b1adc319d7b16 P 0473d2b2d01f4459b1e90fd12cc7840e [term 1 LEADER]: Received request to transfer leadership to TS 127766fc592545a4997f7790f50f6076
I20260709 13:04:37.055466 19485 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d1e5873a19244c5ebbcd38e126796ee7"
dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
mode: GRACEFUL
new_leader_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
 from {username='slave'} at 127.0.0.1:48168
I20260709 13:04:37.055832 19485 raft_consensus.cc:606] T d1e5873a19244c5ebbcd38e126796ee7 P 0473d2b2d01f4459b1e90fd12cc7840e [term 1 LEADER]: Received request to transfer leadership to TS e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:04:37.056954 18300 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 7
I20260709 13:04:37.058219 18300 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:04:37.190956 20488 raft_consensus.cc:993] T 40e1e16737a842ee936002830f36882e P 0473d2b2d01f4459b1e90fd12cc7840e: : Instructing follower e61c3a8f61bb48f8a963c9480e53c168 to start an election
I20260709 13:04:37.191660 20541 raft_consensus.cc:1081] T 40e1e16737a842ee936002830f36882e P 0473d2b2d01f4459b1e90fd12cc7840e [term 1 LEADER]: Signalling peer e61c3a8f61bb48f8a963c9480e53c168 to start an election
I20260709 13:04:37.193120 19558 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "40e1e16737a842ee936002830f36882e"
dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
 from {username='slave'} at 127.0.0.1:40428
I20260709 13:04:37.193672 19558 raft_consensus.cc:493] T 40e1e16737a842ee936002830f36882e P e61c3a8f61bb48f8a963c9480e53c168 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:04:37.193997 19558 raft_consensus.cc:3060] T 40e1e16737a842ee936002830f36882e P e61c3a8f61bb48f8a963c9480e53c168 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:37.198266 19558 raft_consensus.cc:515] T 40e1e16737a842ee936002830f36882e P e61c3a8f61bb48f8a963c9480e53c168 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:37.200378 19558 leader_election.cc:290] T 40e1e16737a842ee936002830f36882e P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 2 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:04:37.202486 19407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40e1e16737a842ee936002830f36882e" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
I20260709 13:04:37.202669 19485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40e1e16737a842ee936002830f36882e" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:04:37.203156 19407 raft_consensus.cc:3060] T 40e1e16737a842ee936002830f36882e P e5256d91808b47c195bc9b4dbd7f2b87 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:37.203209 19485 raft_consensus.cc:3055] T 40e1e16737a842ee936002830f36882e P 0473d2b2d01f4459b1e90fd12cc7840e [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:04:37.203639 19485 raft_consensus.cc:740] T 40e1e16737a842ee936002830f36882e P 0473d2b2d01f4459b1e90fd12cc7840e [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0473d2b2d01f4459b1e90fd12cc7840e, State: Running, Role: LEADER
I20260709 13:04:37.204475 19485 consensus_queue.cc:260] T 40e1e16737a842ee936002830f36882e P 0473d2b2d01f4459b1e90fd12cc7840e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:37.205725 19485 raft_consensus.cc:3060] T 40e1e16737a842ee936002830f36882e P 0473d2b2d01f4459b1e90fd12cc7840e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:37.211298 19407 raft_consensus.cc:2468] T 40e1e16737a842ee936002830f36882e P e5256d91808b47c195bc9b4dbd7f2b87 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 2.
I20260709 13:04:37.215536 19485 raft_consensus.cc:2468] T 40e1e16737a842ee936002830f36882e P 0473d2b2d01f4459b1e90fd12cc7840e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 2.
I20260709 13:04:37.215665 19523 leader_election.cc:304] T 40e1e16737a842ee936002830f36882e P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:04:37.216688 20503 raft_consensus.cc:2804] T 40e1e16737a842ee936002830f36882e P e61c3a8f61bb48f8a963c9480e53c168 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:04:37.217164 20503 raft_consensus.cc:697] T 40e1e16737a842ee936002830f36882e P e61c3a8f61bb48f8a963c9480e53c168 [term 2 LEADER]: Becoming Leader. State: Replica: e61c3a8f61bb48f8a963c9480e53c168, State: Running, Role: LEADER
I20260709 13:04:37.217923 20503 consensus_queue.cc:237] T 40e1e16737a842ee936002830f36882e P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:37.219373 20541 raft_consensus.cc:993] T 6c5eebf646ad445a9d1b1adc319d7b16 P 0473d2b2d01f4459b1e90fd12cc7840e: : Instructing follower 127766fc592545a4997f7790f50f6076 to start an election
I20260709 13:04:37.220584 20541 raft_consensus.cc:1081] T 6c5eebf646ad445a9d1b1adc319d7b16 P 0473d2b2d01f4459b1e90fd12cc7840e [term 1 LEADER]: Signalling peer 127766fc592545a4997f7790f50f6076 to start an election
I20260709 13:04:37.228166 20109 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "6c5eebf646ad445a9d1b1adc319d7b16"
dest_uuid: "127766fc592545a4997f7790f50f6076"
 from {username='slave'} at 127.0.0.1:46436
I20260709 13:04:37.229017 20109 raft_consensus.cc:493] T 6c5eebf646ad445a9d1b1adc319d7b16 P 127766fc592545a4997f7790f50f6076 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:04:37.229532 20109 raft_consensus.cc:3060] T 6c5eebf646ad445a9d1b1adc319d7b16 P 127766fc592545a4997f7790f50f6076 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:37.622258 20109 raft_consensus.cc:515] T 6c5eebf646ad445a9d1b1adc319d7b16 P 127766fc592545a4997f7790f50f6076 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:04:37.898468 20109 leader_election.cc:290] T 6c5eebf646ad445a9d1b1adc319d7b16 P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 2 election: Requested vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
W20260709 13:04:37.901118 20503 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.632s	user 0.007s	sys 0.000s
W20260709 13:04:37.901559 20503 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.632s	user 0.008s	sys 0.000s
W20260709 13:04:37.915035 19523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.1:40321, user_credentials={real_user=slave}} blocked reactor thread for 699395us
I20260709 13:04:37.939260 19557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c5eebf646ad445a9d1b1adc319d7b16" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:04:37.940055 19557 raft_consensus.cc:3060] T 6c5eebf646ad445a9d1b1adc319d7b16 P e61c3a8f61bb48f8a963c9480e53c168 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:37.947263 19557 raft_consensus.cc:2468] T 6c5eebf646ad445a9d1b1adc319d7b16 P e61c3a8f61bb48f8a963c9480e53c168 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 127766fc592545a4997f7790f50f6076 in term 2.
I20260709 13:04:37.985915 20577 raft_consensus.cc:993] T 14efcc79969f41babe5529c22d59156d P e5256d91808b47c195bc9b4dbd7f2b87: : Instructing follower 127766fc592545a4997f7790f50f6076 to start an election
I20260709 13:04:37.986549 20577 raft_consensus.cc:1081] T 14efcc79969f41babe5529c22d59156d P e5256d91808b47c195bc9b4dbd7f2b87 [term 1 LEADER]: Signalling peer 127766fc592545a4997f7790f50f6076 to start an election
I20260709 13:04:37.986966 20076 leader_election.cc:304] T 6c5eebf646ad445a9d1b1adc319d7b16 P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 127766fc592545a4997f7790f50f6076, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:04:37.989741 20112 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "14efcc79969f41babe5529c22d59156d"
dest_uuid: "127766fc592545a4997f7790f50f6076"
 from {username='slave'} at 127.0.0.1:35874
I20260709 13:04:37.990269 20112 raft_consensus.cc:493] T 14efcc79969f41babe5529c22d59156d P 127766fc592545a4997f7790f50f6076 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:04:37.990587 20112 raft_consensus.cc:3060] T 14efcc79969f41babe5529c22d59156d P 127766fc592545a4997f7790f50f6076 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:37.998070 20112 raft_consensus.cc:515] T 14efcc79969f41babe5529c22d59156d P 127766fc592545a4997f7790f50f6076 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:04:38.005663 20112 leader_election.cc:290] T 14efcc79969f41babe5529c22d59156d P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 2 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:04:38.005924 19485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c5eebf646ad445a9d1b1adc319d7b16" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:04:38.009370 19485 raft_consensus.cc:3055] T 6c5eebf646ad445a9d1b1adc319d7b16 P 0473d2b2d01f4459b1e90fd12cc7840e [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:04:38.009725 19485 raft_consensus.cc:740] T 6c5eebf646ad445a9d1b1adc319d7b16 P 0473d2b2d01f4459b1e90fd12cc7840e [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0473d2b2d01f4459b1e90fd12cc7840e, State: Running, Role: LEADER
I20260709 13:04:38.010344 19485 consensus_queue.cc:260] T 6c5eebf646ad445a9d1b1adc319d7b16 P 0473d2b2d01f4459b1e90fd12cc7840e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:04:38.011180 19485 raft_consensus.cc:3060] T 6c5eebf646ad445a9d1b1adc319d7b16 P 0473d2b2d01f4459b1e90fd12cc7840e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:38.006820 19479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14efcc79969f41babe5529c22d59156d" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:04:38.047139 19479 raft_consensus.cc:3060] T 14efcc79969f41babe5529c22d59156d P 0473d2b2d01f4459b1e90fd12cc7840e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:38.056902 19406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14efcc79969f41babe5529c22d59156d" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
I20260709 13:04:38.057641 19406 raft_consensus.cc:3055] T 14efcc79969f41babe5529c22d59156d P e5256d91808b47c195bc9b4dbd7f2b87 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:04:38.057962 19406 raft_consensus.cc:740] T 14efcc79969f41babe5529c22d59156d P e5256d91808b47c195bc9b4dbd7f2b87 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e5256d91808b47c195bc9b4dbd7f2b87, State: Running, Role: LEADER
I20260709 13:04:38.059017 19406 consensus_queue.cc:260] T 14efcc79969f41babe5529c22d59156d P e5256d91808b47c195bc9b4dbd7f2b87 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:04:38.060214 19406 raft_consensus.cc:3060] T 14efcc79969f41babe5529c22d59156d P e5256d91808b47c195bc9b4dbd7f2b87 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:38.086692 19479 raft_consensus.cc:2468] T 14efcc79969f41babe5529c22d59156d P 0473d2b2d01f4459b1e90fd12cc7840e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 127766fc592545a4997f7790f50f6076 in term 2.
I20260709 13:04:38.072394 18300 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:04:38.089071 20078 leader_election.cc:304] T 14efcc79969f41babe5529c22d59156d P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, 127766fc592545a4997f7790f50f6076; no voters: 
I20260709 13:04:38.095260 19406 raft_consensus.cc:2468] T 14efcc79969f41babe5529c22d59156d P e5256d91808b47c195bc9b4dbd7f2b87 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 127766fc592545a4997f7790f50f6076 in term 2.
I20260709 13:04:38.091894 19306 catalog_manager.cc:5697] T 40e1e16737a842ee936002830f36882e P e61c3a8f61bb48f8a963c9480e53c168 reported cstate change: term changed from 1 to 2, leader changed from 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2) to e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3). New cstate: current_term: 2 leader_uuid: "e61c3a8f61bb48f8a963c9480e53c168" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } health_report { overall_health: HEALTHY } } }
W20260709 13:04:38.123131 19523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.1:40321, user_credentials={real_user=slave}} blocked reactor thread for 114071us
I20260709 13:04:38.128062 19405 raft_consensus.cc:1275] T 40e1e16737a842ee936002830f36882e P e5256d91808b47c195bc9b4dbd7f2b87 [term 2 FOLLOWER]: Refusing update from remote peer e61c3a8f61bb48f8a963c9480e53c168: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:38.135879 20583 consensus_queue.cc:1048] T 40e1e16737a842ee936002830f36882e P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.004s
I20260709 13:04:38.141912 19485 raft_consensus.cc:2468] T 6c5eebf646ad445a9d1b1adc319d7b16 P 0473d2b2d01f4459b1e90fd12cc7840e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 127766fc592545a4997f7790f50f6076 in term 2.
W20260709 13:04:38.136368 20078 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.2:46257, user_credentials={real_user=slave}} blocked reactor thread for 47373.2us
I20260709 13:04:38.141789 20583 raft_consensus.cc:993] T 4af19371ea874c09a0a2147040835cbb P e61c3a8f61bb48f8a963c9480e53c168: : Instructing follower 127766fc592545a4997f7790f50f6076 to start an election
I20260709 13:04:38.150728 20584 raft_consensus.cc:1081] T 4af19371ea874c09a0a2147040835cbb P e61c3a8f61bb48f8a963c9480e53c168 [term 1 LEADER]: Signalling peer 127766fc592545a4997f7790f50f6076 to start an election
W20260709 13:04:38.151613 20076 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.3:36891, user_credentials={real_user=slave}} blocked reactor thread for 164749us
I20260709 13:04:38.153716 20590 raft_consensus.cc:2804] T 14efcc79969f41babe5529c22d59156d P 127766fc592545a4997f7790f50f6076 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:04:38.157183 20109 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "4af19371ea874c09a0a2147040835cbb"
dest_uuid: "127766fc592545a4997f7790f50f6076"
 from {username='slave'} at 127.0.0.1:46422
I20260709 13:04:38.158422 20109 raft_consensus.cc:493] T 4af19371ea874c09a0a2147040835cbb P 127766fc592545a4997f7790f50f6076 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:04:38.158902 20109 raft_consensus.cc:3060] T 4af19371ea874c09a0a2147040835cbb P 127766fc592545a4997f7790f50f6076 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:38.164716 20595 raft_consensus.cc:2804] T 6c5eebf646ad445a9d1b1adc319d7b16 P 127766fc592545a4997f7790f50f6076 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:04:38.178583 20488 raft_consensus.cc:493] T 0e1085d23e8347fbbd5bce7542f4b1f4 P 0473d2b2d01f4459b1e90fd12cc7840e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e61c3a8f61bb48f8a963c9480e53c168)
I20260709 13:04:38.180487 20488 raft_consensus.cc:515] T 0e1085d23e8347fbbd5bce7542f4b1f4 P 0473d2b2d01f4459b1e90fd12cc7840e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:04:38.185359 19559 raft_consensus.cc:1240] T 6c5eebf646ad445a9d1b1adc319d7b16 P e61c3a8f61bb48f8a963c9480e53c168 [term 2 FOLLOWER]: Rejecting Update request from peer 0473d2b2d01f4459b1e90fd12cc7840e for earlier term 1. Current term is 2. Ops: []
I20260709 13:04:38.185631 20488 leader_election.cc:290] T 0e1085d23e8347fbbd5bce7542f4b1f4 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:04:38.183686 20576 raft_consensus.cc:993] T 309c3ca0ca4b4f3ba129752ea2cb293b P 0473d2b2d01f4459b1e90fd12cc7840e: : Instructing follower e5256d91808b47c195bc9b4dbd7f2b87 to start an election
I20260709 13:04:38.201382 20109 raft_consensus.cc:515] T 4af19371ea874c09a0a2147040835cbb P 127766fc592545a4997f7790f50f6076 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:04:38.218401 20576 raft_consensus.cc:1081] T 309c3ca0ca4b4f3ba129752ea2cb293b P 0473d2b2d01f4459b1e90fd12cc7840e [term 1 LEADER]: Signalling peer e5256d91808b47c195bc9b4dbd7f2b87 to start an election
I20260709 13:04:38.227253 19406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4af19371ea874c09a0a2147040835cbb" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
I20260709 13:04:38.229444 19406 raft_consensus.cc:3060] T 4af19371ea874c09a0a2147040835cbb P e5256d91808b47c195bc9b4dbd7f2b87 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:38.178274 20590 raft_consensus.cc:697] T 14efcc79969f41babe5529c22d59156d P 127766fc592545a4997f7790f50f6076 [term 2 LEADER]: Becoming Leader. State: Replica: 127766fc592545a4997f7790f50f6076, State: Running, Role: LEADER
I20260709 13:04:38.234000 20109 leader_election.cc:290] T 4af19371ea874c09a0a2147040835cbb P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 2 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:04:38.239068 19407 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "309c3ca0ca4b4f3ba129752ea2cb293b"
dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
 from {username='slave'} at 127.0.0.1:52342
I20260709 13:04:38.239742 20574 raft_consensus.cc:993] T d1e5873a19244c5ebbcd38e126796ee7 P 0473d2b2d01f4459b1e90fd12cc7840e: : Instructing follower e5256d91808b47c195bc9b4dbd7f2b87 to start an election
I20260709 13:04:38.239813 19407 raft_consensus.cc:493] T 309c3ca0ca4b4f3ba129752ea2cb293b P e5256d91808b47c195bc9b4dbd7f2b87 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:04:38.240440 19407 raft_consensus.cc:3060] T 309c3ca0ca4b4f3ba129752ea2cb293b P e5256d91808b47c195bc9b4dbd7f2b87 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:38.241608 20108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e1085d23e8347fbbd5bce7542f4b1f4" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:04:38.244148 19556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4af19371ea874c09a0a2147040835cbb" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:04:38.244678 19556 raft_consensus.cc:3055] T 4af19371ea874c09a0a2147040835cbb P e61c3a8f61bb48f8a963c9480e53c168 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:04:38.244944 19556 raft_consensus.cc:740] T 4af19371ea874c09a0a2147040835cbb P e61c3a8f61bb48f8a963c9480e53c168 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e61c3a8f61bb48f8a963c9480e53c168, State: Running, Role: LEADER
I20260709 13:04:38.246646 20574 raft_consensus.cc:1081] T d1e5873a19244c5ebbcd38e126796ee7 P 0473d2b2d01f4459b1e90fd12cc7840e [term 1 LEADER]: Signalling peer e5256d91808b47c195bc9b4dbd7f2b87 to start an election
I20260709 13:04:38.251760 19557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e1085d23e8347fbbd5bce7542f4b1f4" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:04:38.245752 19556 consensus_queue.cc:260] T 4af19371ea874c09a0a2147040835cbb P e61c3a8f61bb48f8a963c9480e53c168 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:04:38.259524 19556 raft_consensus.cc:3060] T 4af19371ea874c09a0a2147040835cbb P e61c3a8f61bb48f8a963c9480e53c168 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:38.261335 20590 consensus_queue.cc:237] T 14efcc79969f41babe5529c22d59156d P 127766fc592545a4997f7790f50f6076 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:04:38.264168 19407 raft_consensus.cc:515] T 309c3ca0ca4b4f3ba129752ea2cb293b P e5256d91808b47c195bc9b4dbd7f2b87 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:38.271155 19557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "309c3ca0ca4b4f3ba129752ea2cb293b" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:04:38.271870 19557 raft_consensus.cc:3060] T 309c3ca0ca4b4f3ba129752ea2cb293b P e61c3a8f61bb48f8a963c9480e53c168 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:38.271963 19407 leader_election.cc:290] T 309c3ca0ca4b4f3ba129752ea2cb293b P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 2 election: Requested vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:04:38.288996 20602 raft_consensus.cc:993] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P 0473d2b2d01f4459b1e90fd12cc7840e: : Instructing follower 127766fc592545a4997f7790f50f6076 to start an election
I20260709 13:04:38.290230 19556 raft_consensus.cc:2468] T 4af19371ea874c09a0a2147040835cbb P e61c3a8f61bb48f8a963c9480e53c168 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 127766fc592545a4997f7790f50f6076 in term 2.
I20260709 13:04:38.291765 20076 leader_election.cc:304] T 4af19371ea874c09a0a2147040835cbb P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 127766fc592545a4997f7790f50f6076, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:04:38.292739 20599 raft_consensus.cc:2804] T 4af19371ea874c09a0a2147040835cbb P 127766fc592545a4997f7790f50f6076 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:04:38.293207 20599 raft_consensus.cc:697] T 4af19371ea874c09a0a2147040835cbb P 127766fc592545a4997f7790f50f6076 [term 2 LEADER]: Becoming Leader. State: Replica: 127766fc592545a4997f7790f50f6076, State: Running, Role: LEADER
I20260709 13:04:38.294239 20599 consensus_queue.cc:237] T 4af19371ea874c09a0a2147040835cbb P 127766fc592545a4997f7790f50f6076 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:04:38.303469 20576 raft_consensus.cc:1081] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P 0473d2b2d01f4459b1e90fd12cc7840e [term 1 LEADER]: Signalling peer 127766fc592545a4997f7790f50f6076 to start an election
I20260709 13:04:38.307098 19406 raft_consensus.cc:2468] T 4af19371ea874c09a0a2147040835cbb P e5256d91808b47c195bc9b4dbd7f2b87 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 127766fc592545a4997f7790f50f6076 in term 2.
I20260709 13:04:38.315737 19557 raft_consensus.cc:2468] T 309c3ca0ca4b4f3ba129752ea2cb293b P e61c3a8f61bb48f8a963c9480e53c168 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 2.
I20260709 13:04:38.318200 19375 leader_election.cc:304] T 309c3ca0ca4b4f3ba129752ea2cb293b P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:04:38.319509 20592 raft_consensus.cc:2804] T 309c3ca0ca4b4f3ba129752ea2cb293b P e5256d91808b47c195bc9b4dbd7f2b87 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:04:38.320048 20592 raft_consensus.cc:697] T 309c3ca0ca4b4f3ba129752ea2cb293b P e5256d91808b47c195bc9b4dbd7f2b87 [term 2 LEADER]: Becoming Leader. State: Replica: e5256d91808b47c195bc9b4dbd7f2b87, State: Running, Role: LEADER
I20260709 13:04:38.320978 20592 consensus_queue.cc:237] T 309c3ca0ca4b4f3ba129752ea2cb293b P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:38.322508 19478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "309c3ca0ca4b4f3ba129752ea2cb293b" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:04:38.323099 19478 raft_consensus.cc:3055] T 309c3ca0ca4b4f3ba129752ea2cb293b P 0473d2b2d01f4459b1e90fd12cc7840e [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:04:38.323371 19478 raft_consensus.cc:740] T 309c3ca0ca4b4f3ba129752ea2cb293b P 0473d2b2d01f4459b1e90fd12cc7840e [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0473d2b2d01f4459b1e90fd12cc7840e, State: Running, Role: LEADER
I20260709 13:04:38.324965 19449 leader_election.cc:304] T 0e1085d23e8347fbbd5bce7542f4b1f4 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e; no voters: 127766fc592545a4997f7790f50f6076, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:04:38.327016 20109 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "36f6ba92b9ba46babe4ebd6c02e5fbd9"
dest_uuid: "127766fc592545a4997f7790f50f6076"
 from {username='slave'} at 127.0.0.1:46436
I20260709 13:04:38.327600 20109 raft_consensus.cc:493] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P 127766fc592545a4997f7790f50f6076 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:04:38.327936 20109 raft_consensus.cc:3060] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P 127766fc592545a4997f7790f50f6076 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:38.330327 18300 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:04:38.332211 19478 consensus_queue.cc:260] T 309c3ca0ca4b4f3ba129752ea2cb293b P 0473d2b2d01f4459b1e90fd12cc7840e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:38.377832 19406 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d1e5873a19244c5ebbcd38e126796ee7"
dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
 from {username='slave'} at 127.0.0.1:52342
I20260709 13:04:38.378818 19406 raft_consensus.cc:493] T d1e5873a19244c5ebbcd38e126796ee7 P e5256d91808b47c195bc9b4dbd7f2b87 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:04:38.379271 19478 raft_consensus.cc:3060] T 309c3ca0ca4b4f3ba129752ea2cb293b P 0473d2b2d01f4459b1e90fd12cc7840e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:38.379396 19406 raft_consensus.cc:3060] T d1e5873a19244c5ebbcd38e126796ee7 P e5256d91808b47c195bc9b4dbd7f2b87 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:38.360812 20602 raft_consensus.cc:2749] T 0e1085d23e8347fbbd5bce7542f4b1f4 P 0473d2b2d01f4459b1e90fd12cc7840e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:04:38.384233 19450 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:38.385896 19557 consensus_queue.cc:237] T ab43d85f64114d4ebf618930e43d9ed0 P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } attrs { replace: true } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: NON_VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: true } }
I20260709 13:04:38.396418 19406 raft_consensus.cc:515] T d1e5873a19244c5ebbcd38e126796ee7 P e5256d91808b47c195bc9b4dbd7f2b87 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:38.403682 20109 raft_consensus.cc:515] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P 127766fc592545a4997f7790f50f6076 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:04:38.418264 19478 raft_consensus.cc:2468] T 309c3ca0ca4b4f3ba129752ea2cb293b P 0473d2b2d01f4459b1e90fd12cc7840e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 2.
I20260709 13:04:38.421200 19406 leader_election.cc:290] T d1e5873a19244c5ebbcd38e126796ee7 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 2 election: Requested vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:04:38.422596 19483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e5873a19244c5ebbcd38e126796ee7" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:04:38.423372 19483 raft_consensus.cc:3055] T d1e5873a19244c5ebbcd38e126796ee7 P 0473d2b2d01f4459b1e90fd12cc7840e [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:04:38.423722 19483 raft_consensus.cc:740] T d1e5873a19244c5ebbcd38e126796ee7 P 0473d2b2d01f4459b1e90fd12cc7840e [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0473d2b2d01f4459b1e90fd12cc7840e, State: Running, Role: LEADER
I20260709 13:04:38.447055 19559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e5873a19244c5ebbcd38e126796ee7" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:04:38.421347 20595 raft_consensus.cc:697] T 6c5eebf646ad445a9d1b1adc319d7b16 P 127766fc592545a4997f7790f50f6076 [term 2 LEADER]: Becoming Leader. State: Replica: 127766fc592545a4997f7790f50f6076, State: Running, Role: LEADER
I20260709 13:04:38.447165 19483 consensus_queue.cc:260] T d1e5873a19244c5ebbcd38e126796ee7 P 0473d2b2d01f4459b1e90fd12cc7840e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:38.447795 19559 raft_consensus.cc:3060] T d1e5873a19244c5ebbcd38e126796ee7 P e61c3a8f61bb48f8a963c9480e53c168 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:38.448439 20595 consensus_queue.cc:237] T 6c5eebf646ad445a9d1b1adc319d7b16 P 127766fc592545a4997f7790f50f6076 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:04:38.448508 19483 raft_consensus.cc:3060] T d1e5873a19244c5ebbcd38e126796ee7 P 0473d2b2d01f4459b1e90fd12cc7840e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:38.455233 19559 raft_consensus.cc:2468] T d1e5873a19244c5ebbcd38e126796ee7 P e61c3a8f61bb48f8a963c9480e53c168 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 2.
I20260709 13:04:38.458847 19478 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0cdf56e38bbc453d9438d359e5a69955"
dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
mode: GRACEFUL
new_leader_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
 from {username='slave'} at 127.0.0.1:48168
I20260709 13:04:38.459471 19478 raft_consensus.cc:606] T 0cdf56e38bbc453d9438d359e5a69955 P 0473d2b2d01f4459b1e90fd12cc7840e [term 1 LEADER]: Received request to transfer leadership to TS e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:04:38.467244 19483 raft_consensus.cc:2468] T d1e5873a19244c5ebbcd38e126796ee7 P 0473d2b2d01f4459b1e90fd12cc7840e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 2.
I20260709 13:04:38.469198 19377 leader_election.cc:304] T d1e5873a19244c5ebbcd38e126796ee7 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87; no voters: 
I20260709 13:04:38.480168 19483 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "179fd671030940b4b4a4e24bcc4aba0a"
dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
mode: GRACEFUL
new_leader_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
 from {username='slave'} at 127.0.0.1:48168
I20260709 13:04:38.480813 19483 raft_consensus.cc:606] T 179fd671030940b4b4a4e24bcc4aba0a P 0473d2b2d01f4459b1e90fd12cc7840e [term 1 LEADER]: Received request to transfer leadership to TS e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:04:38.482321 20577 raft_consensus.cc:2804] T d1e5873a19244c5ebbcd38e126796ee7 P e5256d91808b47c195bc9b4dbd7f2b87 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:04:38.483577 20577 raft_consensus.cc:697] T d1e5873a19244c5ebbcd38e126796ee7 P e5256d91808b47c195bc9b4dbd7f2b87 [term 2 LEADER]: Becoming Leader. State: Replica: e5256d91808b47c195bc9b4dbd7f2b87, State: Running, Role: LEADER
I20260709 13:04:38.484422 20109 leader_election.cc:290] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 2 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:04:38.484460 20577 consensus_queue.cc:237] T d1e5873a19244c5ebbcd38e126796ee7 P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
W20260709 13:04:38.554270 19375 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.3:36891, user_credentials={real_user=slave}} blocked reactor thread for 84588.8us
I20260709 13:04:38.564409 19305 catalog_manager.cc:5697] T 309c3ca0ca4b4f3ba129752ea2cb293b P e5256d91808b47c195bc9b4dbd7f2b87 reported cstate change: term changed from 1 to 2, leader changed from 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2) to e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1). New cstate: current_term: 2 leader_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:38.567549 19483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36f6ba92b9ba46babe4ebd6c02e5fbd9" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:04:38.568262 19483 raft_consensus.cc:3055] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P 0473d2b2d01f4459b1e90fd12cc7840e [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:04:38.568310 19478 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "48824d5acfbc485ebf8c2d944e7202de"
dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
mode: GRACEFUL
new_leader_uuid: "127766fc592545a4997f7790f50f6076"
 from {username='slave'} at 127.0.0.1:48168
I20260709 13:04:38.568676 19483 raft_consensus.cc:740] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P 0473d2b2d01f4459b1e90fd12cc7840e [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0473d2b2d01f4459b1e90fd12cc7840e, State: Running, Role: LEADER
I20260709 13:04:38.568868 19478 raft_consensus.cc:606] T 48824d5acfbc485ebf8c2d944e7202de P 0473d2b2d01f4459b1e90fd12cc7840e [term 1 LEADER]: Received request to transfer leadership to TS 127766fc592545a4997f7790f50f6076
I20260709 13:04:38.573896 19478 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "96efeaaf1057492490e9a621f37e1a2d"
dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
mode: GRACEFUL
new_leader_uuid: "127766fc592545a4997f7790f50f6076"
 from {username='slave'} at 127.0.0.1:48168
I20260709 13:04:38.574375 19478 raft_consensus.cc:606] T 96efeaaf1057492490e9a621f37e1a2d P 0473d2b2d01f4459b1e90fd12cc7840e [term 1 LEADER]: Received request to transfer leadership to TS 127766fc592545a4997f7790f50f6076
I20260709 13:04:38.581990 19478 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e381f1d6b8184797ad142de49be225a8"
dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
mode: GRACEFUL
new_leader_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
 from {username='slave'} at 127.0.0.1:48168
I20260709 13:04:38.582626 19478 raft_consensus.cc:606] T e381f1d6b8184797ad142de49be225a8 P 0473d2b2d01f4459b1e90fd12cc7840e [term 1 LEADER]: Received request to transfer leadership to TS e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:04:38.590544 19483 consensus_queue.cc:260] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P 0473d2b2d01f4459b1e90fd12cc7840e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:04:38.602268 19483 raft_consensus.cc:3060] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P 0473d2b2d01f4459b1e90fd12cc7840e [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:04:38.604704 20576 consensus_queue.cc:1175] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P 0473d2b2d01f4459b1e90fd12cc7840e [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" responder_term: 1 status { last_received { term: 1 index: 4 } last_committed_idx: 4 last_received_current_leader { term: 1 index: 4 } }
I20260709 13:04:38.621556 19483 raft_consensus.cc:2468] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P 0473d2b2d01f4459b1e90fd12cc7840e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 127766fc592545a4997f7790f50f6076 in term 2.
I20260709 13:04:38.654690 19408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36f6ba92b9ba46babe4ebd6c02e5fbd9" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
I20260709 13:04:38.655480 19408 raft_consensus.cc:3060] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P e5256d91808b47c195bc9b4dbd7f2b87 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:38.665652 19411 raft_consensus.cc:1275] T ab43d85f64114d4ebf618930e43d9ed0 P e5256d91808b47c195bc9b4dbd7f2b87 [term 1 FOLLOWER]: Refusing update from remote peer e61c3a8f61bb48f8a963c9480e53c168: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 13:04:38.667253 19523 consensus_peers.cc:597] T ab43d85f64114d4ebf618930e43d9ed0 P e61c3a8f61bb48f8a963c9480e53c168 -> Peer 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121): Couldn't send request to peer 127766fc592545a4997f7790f50f6076. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: ab43d85f64114d4ebf618930e43d9ed0. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:38.671087 20582 consensus_queue.cc:1048] T ab43d85f64114d4ebf618930e43d9ed0 P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.002s
I20260709 13:04:38.679711 19557 raft_consensus.cc:1275] T 4af19371ea874c09a0a2147040835cbb P e61c3a8f61bb48f8a963c9480e53c168 [term 2 FOLLOWER]: Refusing update from remote peer 127766fc592545a4997f7790f50f6076: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:04:38.690423 20606 consensus_queue.cc:1048] T 4af19371ea874c09a0a2147040835cbb P 127766fc592545a4997f7790f50f6076 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.002s
I20260709 13:04:38.699885 19305 catalog_manager.cc:5697] T d1e5873a19244c5ebbcd38e126796ee7 P e5256d91808b47c195bc9b4dbd7f2b87 reported cstate change: term changed from 1 to 2, leader changed from 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2) to e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1). New cstate: current_term: 2 leader_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } health_report { overall_health: UNKNOWN } } }
W20260709 13:04:38.706524 19450 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.3:36891, user_credentials={real_user=slave}} blocked reactor thread for 99541.7us
I20260709 13:04:38.709232 20078 leader_election.cc:304] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, 127766fc592545a4997f7790f50f6076; no voters: 
I20260709 13:04:38.710637 19408 raft_consensus.cc:2468] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P e5256d91808b47c195bc9b4dbd7f2b87 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 127766fc592545a4997f7790f50f6076 in term 2.
I20260709 13:04:38.719004 20606 raft_consensus.cc:2804] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P 127766fc592545a4997f7790f50f6076 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:04:38.719559 20606 raft_consensus.cc:697] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P 127766fc592545a4997f7790f50f6076 [term 2 LEADER]: Becoming Leader. State: Replica: 127766fc592545a4997f7790f50f6076, State: Running, Role: LEADER
I20260709 13:04:38.720372 20606 consensus_queue.cc:237] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P 127766fc592545a4997f7790f50f6076 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
W20260709 13:04:38.727412 19377 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.2:46257, user_credentials={real_user=slave}} blocked reactor thread for 258300us
I20260709 13:04:38.732911 20619 raft_consensus.cc:493] T 1dc5b3532fe54f74876d02beffa2c230 P e5256d91808b47c195bc9b4dbd7f2b87 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0473d2b2d01f4459b1e90fd12cc7840e)
I20260709 13:04:38.733726 20619 raft_consensus.cc:515] T 1dc5b3532fe54f74876d02beffa2c230 P e5256d91808b47c195bc9b4dbd7f2b87 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:38.740901 20619 leader_election.cc:290] T 1dc5b3532fe54f74876d02beffa2c230 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:04:38.744606 19556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dc5b3532fe54f74876d02beffa2c230" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:04:38.747607 19408 raft_consensus.cc:1275] T 4af19371ea874c09a0a2147040835cbb P e5256d91808b47c195bc9b4dbd7f2b87 [term 2 FOLLOWER]: Refusing update from remote peer 127766fc592545a4997f7790f50f6076: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:04:38.752449 20599 consensus_queue.cc:1048] T 4af19371ea874c09a0a2147040835cbb P 127766fc592545a4997f7790f50f6076 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:04:38.757839 20112 raft_consensus.cc:1240] T 6c5eebf646ad445a9d1b1adc319d7b16 P 127766fc592545a4997f7790f50f6076 [term 2 LEADER]: Rejecting Update request from peer 0473d2b2d01f4459b1e90fd12cc7840e for earlier term 1. Current term is 2. Ops: []
I20260709 13:04:38.766736 19478 raft_consensus.cc:1275] T ab43d85f64114d4ebf618930e43d9ed0 P 0473d2b2d01f4459b1e90fd12cc7840e [term 1 FOLLOWER]: Refusing update from remote peer e61c3a8f61bb48f8a963c9480e53c168: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:04:38.771195 19485 raft_consensus.cc:1275] T 40e1e16737a842ee936002830f36882e P 0473d2b2d01f4459b1e90fd12cc7840e [term 2 FOLLOWER]: Refusing update from remote peer e61c3a8f61bb48f8a963c9480e53c168: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:38.770182 19411 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f1b10566f45d4a7d9029858330e02d5b"
dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
mode: GRACEFUL
new_leader_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
 from {username='slave'} at 127.0.0.1:37312
I20260709 13:04:38.774471 19479 raft_consensus.cc:1275] T 309c3ca0ca4b4f3ba129752ea2cb293b P 0473d2b2d01f4459b1e90fd12cc7840e [term 2 FOLLOWER]: Refusing update from remote peer e5256d91808b47c195bc9b4dbd7f2b87: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:38.774042 19305 catalog_manager.cc:5697] T 4af19371ea874c09a0a2147040835cbb P e61c3a8f61bb48f8a963c9480e53c168 reported cstate change: term changed from 1 to 2, leader changed from e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3) to 127766fc592545a4997f7790f50f6076 (127.17.223.4). New cstate: current_term: 2 leader_uuid: "127766fc592545a4997f7790f50f6076" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } } }
I20260709 13:04:38.782495 20622 raft_consensus.cc:993] T 48824d5acfbc485ebf8c2d944e7202de P 0473d2b2d01f4459b1e90fd12cc7840e: : Instructing follower 127766fc592545a4997f7790f50f6076 to start an election
I20260709 13:04:38.775338 19405 raft_consensus.cc:2955] T ab43d85f64114d4ebf618930e43d9ed0 P e5256d91808b47c195bc9b4dbd7f2b87 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 127766fc592545a4997f7790f50f6076 (127.17.223.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } attrs { replace: true } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: NON_VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: true } } }
I20260709 13:04:38.802819 19411 raft_consensus.cc:606] T f1b10566f45d4a7d9029858330e02d5b P e5256d91808b47c195bc9b4dbd7f2b87 [term 1 LEADER]: Received request to transfer leadership to TS 0473d2b2d01f4459b1e90fd12cc7840e
I20260709 13:04:38.773288 20582 raft_consensus.cc:2955] T ab43d85f64114d4ebf618930e43d9ed0 P e61c3a8f61bb48f8a963c9480e53c168 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 127766fc592545a4997f7790f50f6076 (127.17.223.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } attrs { replace: true } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: NON_VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: true } } }
I20260709 13:04:38.813930 19306 catalog_manager.cc:5697] T 14efcc79969f41babe5529c22d59156d P 127766fc592545a4997f7790f50f6076 reported cstate change: term changed from 1 to 2, leader changed from e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1) to 127766fc592545a4997f7790f50f6076 (127.17.223.4). New cstate: current_term: 2 leader_uuid: "127766fc592545a4997f7790f50f6076" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:04:38.815909 19306 catalog_manager.cc:5697] T 6c5eebf646ad445a9d1b1adc319d7b16 P 127766fc592545a4997f7790f50f6076 reported cstate change: term changed from 1 to 2, leader changed from 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2) to 127766fc592545a4997f7790f50f6076 (127.17.223.4). New cstate: current_term: 2 leader_uuid: "127766fc592545a4997f7790f50f6076" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:04:38.817180 20584 consensus_queue.cc:1048] T ab43d85f64114d4ebf618930e43d9ed0 P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:04:38.814601 20592 raft_consensus.cc:993] T f1b10566f45d4a7d9029858330e02d5b P e5256d91808b47c195bc9b4dbd7f2b87: : Instructing follower 0473d2b2d01f4459b1e90fd12cc7840e to start an election
I20260709 13:04:38.818804 19306 catalog_manager.cc:5697] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P 127766fc592545a4997f7790f50f6076 reported cstate change: term changed from 1 to 2, leader changed from 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2) to 127766fc592545a4997f7790f50f6076 (127.17.223.4). New cstate: current_term: 2 leader_uuid: "127766fc592545a4997f7790f50f6076" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:04:38.817461 19477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dc5b3532fe54f74876d02beffa2c230" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:04:38.823971 20579 raft_consensus.cc:1081] T f1b10566f45d4a7d9029858330e02d5b P e5256d91808b47c195bc9b4dbd7f2b87 [term 1 LEADER]: Signalling peer 0473d2b2d01f4459b1e90fd12cc7840e to start an election
I20260709 13:04:38.823889 19377 leader_election.cc:304] T 1dc5b3532fe54f74876d02beffa2c230 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:04:38.823916 20592 consensus_queue.cc:1048] T 309c3ca0ca4b4f3ba129752ea2cb293b P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:04:38.825028 20577 raft_consensus.cc:2749] T 1dc5b3532fe54f74876d02beffa2c230 P e5256d91808b47c195bc9b4dbd7f2b87 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:04:38.827553 19558 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "fa731b585f684a7fb2d106c50f143b83"
dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
mode: GRACEFUL
new_leader_uuid: "127766fc592545a4997f7790f50f6076"
 from {username='slave'} at 127.0.0.1:51880
I20260709 13:04:38.828059 19558 raft_consensus.cc:606] T fa731b585f684a7fb2d106c50f143b83 P e61c3a8f61bb48f8a963c9480e53c168 [term 1 LEADER]: Received request to transfer leadership to TS 127766fc592545a4997f7790f50f6076
I20260709 13:04:38.831806 18300 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 7
I20260709 13:04:38.833292 18300 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:04:38.836988 19477 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f1b10566f45d4a7d9029858330e02d5b"
dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
 from {username='slave'} at 127.0.0.1:58294
I20260709 13:04:38.837582 19477 raft_consensus.cc:493] T f1b10566f45d4a7d9029858330e02d5b P 0473d2b2d01f4459b1e90fd12cc7840e [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:04:38.837953 19477 raft_consensus.cc:3060] T f1b10566f45d4a7d9029858330e02d5b P 0473d2b2d01f4459b1e90fd12cc7840e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:38.812861 20622 raft_consensus.cc:1081] T 48824d5acfbc485ebf8c2d944e7202de P 0473d2b2d01f4459b1e90fd12cc7840e [term 1 LEADER]: Signalling peer 127766fc592545a4997f7790f50f6076 to start an election
I20260709 13:04:38.842108 20574 raft_consensus.cc:993] T 179fd671030940b4b4a4e24bcc4aba0a P 0473d2b2d01f4459b1e90fd12cc7840e: : Instructing follower e5256d91808b47c195bc9b4dbd7f2b87 to start an election
I20260709 13:04:38.846947 20575 raft_consensus.cc:1081] T 179fd671030940b4b4a4e24bcc4aba0a P 0473d2b2d01f4459b1e90fd12cc7840e [term 1 LEADER]: Signalling peer e5256d91808b47c195bc9b4dbd7f2b87 to start an election
I20260709 13:04:38.861894 20593 raft_consensus.cc:993] T 0cdf56e38bbc453d9438d359e5a69955 P 0473d2b2d01f4459b1e90fd12cc7840e: : Instructing follower e61c3a8f61bb48f8a963c9480e53c168 to start an election
I20260709 13:04:38.862164 20584 consensus_queue.cc:1048] T 40e1e16737a842ee936002830f36882e P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.002s
I20260709 13:04:38.865924 19306 catalog_manager.cc:5697] T ab43d85f64114d4ebf618930e43d9ed0 P e5256d91808b47c195bc9b4dbd7f2b87 reported cstate change: config changed from index -1 to 2, NON_VOTER 127766fc592545a4997f7790f50f6076 (127.17.223.4) added. New cstate: current_term: 1 leader_uuid: "e61c3a8f61bb48f8a963c9480e53c168" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } attrs { replace: true } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: NON_VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: true } } }
I20260709 13:04:38.867336 19478 raft_consensus.cc:1275] T 6c5eebf646ad445a9d1b1adc319d7b16 P 0473d2b2d01f4459b1e90fd12cc7840e [term 2 FOLLOWER]: Refusing update from remote peer 127766fc592545a4997f7790f50f6076: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:04:38.872241 19405 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "179fd671030940b4b4a4e24bcc4aba0a"
dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
 from {username='slave'} at 127.0.0.1:52342
I20260709 13:04:38.872869 19405 raft_consensus.cc:493] T 179fd671030940b4b4a4e24bcc4aba0a P e5256d91808b47c195bc9b4dbd7f2b87 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:04:38.873239 19405 raft_consensus.cc:3060] T 179fd671030940b4b4a4e24bcc4aba0a P e5256d91808b47c195bc9b4dbd7f2b87 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:38.872429 20593 raft_consensus.cc:1081] T 0cdf56e38bbc453d9438d359e5a69955 P 0473d2b2d01f4459b1e90fd12cc7840e [term 1 LEADER]: Signalling peer e61c3a8f61bb48f8a963c9480e53c168 to start an election
I20260709 13:04:38.877153 19557 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "0cdf56e38bbc453d9438d359e5a69955"
dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
 from {username='slave'} at 127.0.0.1:40428
I20260709 13:04:38.877709 19557 raft_consensus.cc:493] T 0cdf56e38bbc453d9438d359e5a69955 P e61c3a8f61bb48f8a963c9480e53c168 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:04:38.878074 19557 raft_consensus.cc:3060] T 0cdf56e38bbc453d9438d359e5a69955 P e61c3a8f61bb48f8a963c9480e53c168 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:38.882481 19405 raft_consensus.cc:515] T 179fd671030940b4b4a4e24bcc4aba0a P e5256d91808b47c195bc9b4dbd7f2b87 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:38.886233 19405 leader_election.cc:290] T 179fd671030940b4b4a4e24bcc4aba0a P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 2 election: Requested vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:04:38.887383 19556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "179fd671030940b4b4a4e24bcc4aba0a" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:04:38.887914 19556 raft_consensus.cc:3060] T 179fd671030940b4b4a4e24bcc4aba0a P e61c3a8f61bb48f8a963c9480e53c168 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:38.887815 19478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "179fd671030940b4b4a4e24bcc4aba0a" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:04:38.888487 19478 raft_consensus.cc:3055] T 179fd671030940b4b4a4e24bcc4aba0a P 0473d2b2d01f4459b1e90fd12cc7840e [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:04:38.888849 19478 raft_consensus.cc:740] T 179fd671030940b4b4a4e24bcc4aba0a P 0473d2b2d01f4459b1e90fd12cc7840e [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0473d2b2d01f4459b1e90fd12cc7840e, State: Running, Role: LEADER
I20260709 13:04:38.890262 20593 raft_consensus.cc:993] T 96efeaaf1057492490e9a621f37e1a2d P 0473d2b2d01f4459b1e90fd12cc7840e: : Instructing follower 127766fc592545a4997f7790f50f6076 to start an election
I20260709 13:04:38.890831 20593 raft_consensus.cc:1081] T 96efeaaf1057492490e9a621f37e1a2d P 0473d2b2d01f4459b1e90fd12cc7840e [term 1 LEADER]: Signalling peer 127766fc592545a4997f7790f50f6076 to start an election
I20260709 13:04:38.894079 19557 raft_consensus.cc:515] T 0cdf56e38bbc453d9438d359e5a69955 P e61c3a8f61bb48f8a963c9480e53c168 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:38.897838 19557 leader_election.cc:290] T 0cdf56e38bbc453d9438d359e5a69955 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 2 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:04:38.897835 19478 consensus_queue.cc:260] T 179fd671030940b4b4a4e24bcc4aba0a P 0473d2b2d01f4459b1e90fd12cc7840e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:38.899053 19478 raft_consensus.cc:3060] T 179fd671030940b4b4a4e24bcc4aba0a P 0473d2b2d01f4459b1e90fd12cc7840e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:38.899574 19407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cdf56e38bbc453d9438d359e5a69955" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
I20260709 13:04:38.896006 19556 raft_consensus.cc:2468] T 179fd671030940b4b4a4e24bcc4aba0a P e61c3a8f61bb48f8a963c9480e53c168 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 2.
I20260709 13:04:38.901157 19375 leader_election.cc:304] T 179fd671030940b4b4a4e24bcc4aba0a P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:04:38.900415 19407 raft_consensus.cc:3060] T 0cdf56e38bbc453d9438d359e5a69955 P e5256d91808b47c195bc9b4dbd7f2b87 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:38.907251 20576 raft_consensus.cc:993] T e381f1d6b8184797ad142de49be225a8 P 0473d2b2d01f4459b1e90fd12cc7840e: : Instructing follower e5256d91808b47c195bc9b4dbd7f2b87 to start an election
I20260709 13:04:38.907778 20576 raft_consensus.cc:1081] T e381f1d6b8184797ad142de49be225a8 P 0473d2b2d01f4459b1e90fd12cc7840e [term 1 LEADER]: Signalling peer e5256d91808b47c195bc9b4dbd7f2b87 to start an election
I20260709 13:04:38.902182 20579 raft_consensus.cc:2804] T 179fd671030940b4b4a4e24bcc4aba0a P e5256d91808b47c195bc9b4dbd7f2b87 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:04:38.908720 20579 raft_consensus.cc:697] T 179fd671030940b4b4a4e24bcc4aba0a P e5256d91808b47c195bc9b4dbd7f2b87 [term 2 LEADER]: Becoming Leader. State: Replica: e5256d91808b47c195bc9b4dbd7f2b87, State: Running, Role: LEADER
I20260709 13:04:38.909008 19408 raft_consensus.cc:1275] T 14efcc79969f41babe5529c22d59156d P e5256d91808b47c195bc9b4dbd7f2b87 [term 2 FOLLOWER]: Refusing update from remote peer 127766fc592545a4997f7790f50f6076: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:04:38.909525 20579 consensus_queue.cc:237] T 179fd671030940b4b4a4e24bcc4aba0a P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:38.916350 19478 raft_consensus.cc:2468] T 179fd671030940b4b4a4e24bcc4aba0a P 0473d2b2d01f4459b1e90fd12cc7840e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 2.
I20260709 13:04:38.884209 19477 raft_consensus.cc:515] T f1b10566f45d4a7d9029858330e02d5b P 0473d2b2d01f4459b1e90fd12cc7840e [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:38.923036 19485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cdf56e38bbc453d9438d359e5a69955" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:04:38.924459 19485 raft_consensus.cc:3055] T 0cdf56e38bbc453d9438d359e5a69955 P 0473d2b2d01f4459b1e90fd12cc7840e [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:04:38.924794 19485 raft_consensus.cc:740] T 0cdf56e38bbc453d9438d359e5a69955 P 0473d2b2d01f4459b1e90fd12cc7840e [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0473d2b2d01f4459b1e90fd12cc7840e, State: Running, Role: LEADER
I20260709 13:04:38.925634 19485 consensus_queue.cc:260] T 0cdf56e38bbc453d9438d359e5a69955 P 0473d2b2d01f4459b1e90fd12cc7840e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:38.923616 19408 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e381f1d6b8184797ad142de49be225a8"
dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
 from {username='slave'} at 127.0.0.1:52342
I20260709 13:04:38.927311 19408 raft_consensus.cc:493] T e381f1d6b8184797ad142de49be225a8 P e5256d91808b47c195bc9b4dbd7f2b87 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:04:38.927691 19408 raft_consensus.cc:3060] T e381f1d6b8184797ad142de49be225a8 P e5256d91808b47c195bc9b4dbd7f2b87 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:38.936385 19485 raft_consensus.cc:3060] T 0cdf56e38bbc453d9438d359e5a69955 P 0473d2b2d01f4459b1e90fd12cc7840e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:38.903671 20606 consensus_queue.cc:1048] T 6c5eebf646ad445a9d1b1adc319d7b16 P 127766fc592545a4997f7790f50f6076 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.036s
I20260709 13:04:38.957087 20599 consensus_queue.cc:1048] T 14efcc79969f41babe5529c22d59156d P 127766fc592545a4997f7790f50f6076 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.004s
I20260709 13:04:38.986429 19556 raft_consensus.cc:1275] T 309c3ca0ca4b4f3ba129752ea2cb293b P e61c3a8f61bb48f8a963c9480e53c168 [term 2 FOLLOWER]: Refusing update from remote peer e5256d91808b47c195bc9b4dbd7f2b87: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:38.993609 19406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1b10566f45d4a7d9029858330e02d5b" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
I20260709 13:04:38.994170 19406 raft_consensus.cc:3055] T f1b10566f45d4a7d9029858330e02d5b P e5256d91808b47c195bc9b4dbd7f2b87 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:04:38.994457 19406 raft_consensus.cc:740] T f1b10566f45d4a7d9029858330e02d5b P e5256d91808b47c195bc9b4dbd7f2b87 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e5256d91808b47c195bc9b4dbd7f2b87, State: Running, Role: LEADER
I20260709 13:04:39.000810 20611 consensus_queue.cc:1048] T 309c3ca0ca4b4f3ba129752ea2cb293b P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.008s
I20260709 13:04:39.004393 19406 consensus_queue.cc:260] T f1b10566f45d4a7d9029858330e02d5b P e5256d91808b47c195bc9b4dbd7f2b87 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:39.005507 19406 raft_consensus.cc:3060] T f1b10566f45d4a7d9029858330e02d5b P e5256d91808b47c195bc9b4dbd7f2b87 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:39.020808 19408 raft_consensus.cc:515] T e381f1d6b8184797ad142de49be225a8 P e5256d91808b47c195bc9b4dbd7f2b87 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:39.035197 19407 raft_consensus.cc:2468] T 0cdf56e38bbc453d9438d359e5a69955 P e5256d91808b47c195bc9b4dbd7f2b87 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 2.
I20260709 13:04:39.043169 19485 raft_consensus.cc:2468] T 0cdf56e38bbc453d9438d359e5a69955 P 0473d2b2d01f4459b1e90fd12cc7840e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 2.
I20260709 13:04:39.056895 19406 raft_consensus.cc:2468] T f1b10566f45d4a7d9029858330e02d5b P e5256d91808b47c195bc9b4dbd7f2b87 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 2.
I20260709 13:04:39.060580 19449 leader_election.cc:304] T f1b10566f45d4a7d9029858330e02d5b P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87; no voters: 
I20260709 13:04:39.067464 20488 raft_consensus.cc:2804] T f1b10566f45d4a7d9029858330e02d5b P 0473d2b2d01f4459b1e90fd12cc7840e [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:04:39.069235 20488 raft_consensus.cc:697] T f1b10566f45d4a7d9029858330e02d5b P 0473d2b2d01f4459b1e90fd12cc7840e [term 2 LEADER]: Becoming Leader. State: Replica: 0473d2b2d01f4459b1e90fd12cc7840e, State: Running, Role: LEADER
I20260709 13:04:39.070251 20488 consensus_queue.cc:237] T f1b10566f45d4a7d9029858330e02d5b P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
W20260709 13:04:39.077903 19581 debug-util.cc:398] Leaking SignalData structure 0x7b08001814a0 after lost signal to thread 18303
I20260709 13:04:39.079357 19405 consensus_queue.cc:237] T 309c3ca0ca4b4f3ba129752ea2cb293b P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } attrs { replace: true } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: NON_VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: true } }
I20260709 13:04:39.088160 19556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1b10566f45d4a7d9029858330e02d5b" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:04:39.088929 19556 raft_consensus.cc:3060] T f1b10566f45d4a7d9029858330e02d5b P e61c3a8f61bb48f8a963c9480e53c168 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:04:39.085453 19581 debug-util.cc:398] Leaking SignalData structure 0x7b08000d31e0 after lost signal to thread 19343
I20260709 13:04:39.091835 19408 leader_election.cc:290] T e381f1d6b8184797ad142de49be225a8 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 2 election: Requested vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:04:39.083917 19477 leader_election.cc:290] T f1b10566f45d4a7d9029858330e02d5b P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 2 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:04:39.117435 19526 leader_election.cc:304] T 0cdf56e38bbc453d9438d359e5a69955 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:04:39.116703 19556 raft_consensus.cc:2468] T f1b10566f45d4a7d9029858330e02d5b P e61c3a8f61bb48f8a963c9480e53c168 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 2.
W20260709 13:04:39.142264 19526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.2:46257, user_credentials={real_user=slave}} blocked reactor thread for 93718us
W20260709 13:04:39.144588 19581 debug-util.cc:398] Leaking SignalData structure 0x7b0800343e60 after lost signal to thread 19435
I20260709 13:04:39.148401 20585 raft_consensus.cc:2804] T 0cdf56e38bbc453d9438d359e5a69955 P e61c3a8f61bb48f8a963c9480e53c168 [term 2 FOLLOWER]: Leader election won for term 2
W20260709 13:04:39.201556 19375 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.3:36891, user_credentials={real_user=slave}} blocked reactor thread for 163107us
I20260709 13:04:39.213933 19410 raft_consensus.cc:1275] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P e5256d91808b47c195bc9b4dbd7f2b87 [term 2 FOLLOWER]: Refusing update from remote peer 127766fc592545a4997f7790f50f6076: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
W20260709 13:04:39.217641 19377 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:39.228767 20112 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "96efeaaf1057492490e9a621f37e1a2d"
dest_uuid: "127766fc592545a4997f7790f50f6076"
 from {username='slave'} at 127.0.0.1:46436
I20260709 13:04:39.228881 19477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e381f1d6b8184797ad142de49be225a8" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:04:39.229421 20112 raft_consensus.cc:493] T 96efeaaf1057492490e9a621f37e1a2d P 127766fc592545a4997f7790f50f6076 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:04:39.219691 20109 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "48824d5acfbc485ebf8c2d944e7202de"
dest_uuid: "127766fc592545a4997f7790f50f6076"
 from {username='slave'} at 127.0.0.1:46436
I20260709 13:04:39.229841 20112 raft_consensus.cc:3060] T 96efeaaf1057492490e9a621f37e1a2d P 127766fc592545a4997f7790f50f6076 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:39.230158 20109 raft_consensus.cc:493] T 48824d5acfbc485ebf8c2d944e7202de P 127766fc592545a4997f7790f50f6076 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:04:39.230515 20109 raft_consensus.cc:3060] T 48824d5acfbc485ebf8c2d944e7202de P 127766fc592545a4997f7790f50f6076 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:39.230788 19482 raft_consensus.cc:2955] T ab43d85f64114d4ebf618930e43d9ed0 P 0473d2b2d01f4459b1e90fd12cc7840e [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 127766fc592545a4997f7790f50f6076 (127.17.223.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } attrs { replace: true } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: NON_VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: true } } }
I20260709 13:04:39.230551 19478 raft_consensus.cc:1275] T 14efcc79969f41babe5529c22d59156d P 0473d2b2d01f4459b1e90fd12cc7840e [term 2 FOLLOWER]: Refusing update from remote peer 127766fc592545a4997f7790f50f6076: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:04:39.229594 19477 raft_consensus.cc:3055] T e381f1d6b8184797ad142de49be225a8 P 0473d2b2d01f4459b1e90fd12cc7840e [term 1 LEADER]: Stepping down as leader of term 1
W20260709 13:04:39.220347 19581 debug-util.cc:398] Leaking SignalData structure 0x7b08002f9540 after lost signal to thread 19510
I20260709 13:04:39.243278 20595 consensus_queue.cc:1048] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P 127766fc592545a4997f7790f50f6076 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
W20260709 13:04:39.243960 20636 log.cc:927] Time spent T 179fd671030940b4b4a4e24bcc4aba0a P e5256d91808b47c195bc9b4dbd7f2b87: Append to log took a long time: real 0.056s	user 0.000s	sys 0.001s
I20260709 13:04:39.234788 19477 raft_consensus.cc:740] T e381f1d6b8184797ad142de49be225a8 P 0473d2b2d01f4459b1e90fd12cc7840e [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0473d2b2d01f4459b1e90fd12cc7840e, State: Running, Role: LEADER
I20260709 13:04:39.240532 20599 consensus_queue.cc:1048] T 14efcc79969f41babe5529c22d59156d P 127766fc592545a4997f7790f50f6076 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.005s
I20260709 13:04:39.245716 19477 consensus_queue.cc:260] T e381f1d6b8184797ad142de49be225a8 P 0473d2b2d01f4459b1e90fd12cc7840e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:39.246894 19477 raft_consensus.cc:3060] T e381f1d6b8184797ad142de49be225a8 P 0473d2b2d01f4459b1e90fd12cc7840e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:39.248385 19556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e381f1d6b8184797ad142de49be225a8" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:04:39.248946 19556 raft_consensus.cc:3060] T e381f1d6b8184797ad142de49be225a8 P e61c3a8f61bb48f8a963c9480e53c168 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:04:39.253677 19452 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:04:39.264991 19581 debug-util.cc:398] Leaking SignalData structure 0x7b0800274ee0 after lost signal to thread 19584
W20260709 13:04:39.296685 19374 consensus_peers.cc:597] T 309c3ca0ca4b4f3ba129752ea2cb293b P e5256d91808b47c195bc9b4dbd7f2b87 -> Peer 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121): Couldn't send request to peer 127766fc592545a4997f7790f50f6076. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 309c3ca0ca4b4f3ba129752ea2cb293b. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:39.302305 19305 catalog_manager.cc:5697] T 179fd671030940b4b4a4e24bcc4aba0a P e5256d91808b47c195bc9b4dbd7f2b87 reported cstate change: term changed from 1 to 2, leader changed from 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2) to e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1). New cstate: current_term: 2 leader_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:39.312417 19556 raft_consensus.cc:2468] T e381f1d6b8184797ad142de49be225a8 P e61c3a8f61bb48f8a963c9480e53c168 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 2.
W20260709 13:04:39.326835 19581 debug-util.cc:398] Leaking SignalData structure 0x7b0800325280 after lost signal to thread 20136
I20260709 13:04:39.360695 20112 raft_consensus.cc:515] T 96efeaaf1057492490e9a621f37e1a2d P 127766fc592545a4997f7790f50f6076 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:04:39.372575 20112 leader_election.cc:290] T 96efeaaf1057492490e9a621f37e1a2d P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 2 election: Requested vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:04:39.373701 19485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96efeaaf1057492490e9a621f37e1a2d" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:04:39.374424 19485 raft_consensus.cc:3055] T 96efeaaf1057492490e9a621f37e1a2d P 0473d2b2d01f4459b1e90fd12cc7840e [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:04:39.374852 19485 raft_consensus.cc:740] T 96efeaaf1057492490e9a621f37e1a2d P 0473d2b2d01f4459b1e90fd12cc7840e [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0473d2b2d01f4459b1e90fd12cc7840e, State: Running, Role: LEADER
I20260709 13:04:39.375689 19485 consensus_queue.cc:260] T 96efeaaf1057492490e9a621f37e1a2d P 0473d2b2d01f4459b1e90fd12cc7840e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:04:39.376947 19485 raft_consensus.cc:3060] T 96efeaaf1057492490e9a621f37e1a2d P 0473d2b2d01f4459b1e90fd12cc7840e [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:04:39.418200 20637 log.cc:927] Time spent T 309c3ca0ca4b4f3ba129752ea2cb293b P e61c3a8f61bb48f8a963c9480e53c168: Append to log took a long time: real 0.084s	user 0.001s	sys 0.000s
I20260709 13:04:39.372017 20109 raft_consensus.cc:515] T 48824d5acfbc485ebf8c2d944e7202de P 127766fc592545a4997f7790f50f6076 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:04:39.439432 19483 raft_consensus.cc:1275] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P 0473d2b2d01f4459b1e90fd12cc7840e [term 2 FOLLOWER]: Refusing update from remote peer 127766fc592545a4997f7790f50f6076: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:04:39.439746 20109 leader_election.cc:290] T 48824d5acfbc485ebf8c2d944e7202de P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 2 election: Requested vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:04:39.443987 20631 consensus_queue.cc:1048] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P 127766fc592545a4997f7790f50f6076 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.002s
I20260709 13:04:39.444458 19481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48824d5acfbc485ebf8c2d944e7202de" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:04:39.445106 19481 raft_consensus.cc:3055] T 48824d5acfbc485ebf8c2d944e7202de P 0473d2b2d01f4459b1e90fd12cc7840e [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:04:39.445444 19481 raft_consensus.cc:740] T 48824d5acfbc485ebf8c2d944e7202de P 0473d2b2d01f4459b1e90fd12cc7840e [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0473d2b2d01f4459b1e90fd12cc7840e, State: Running, Role: LEADER
I20260709 13:04:39.445739 19477 raft_consensus.cc:2468] T e381f1d6b8184797ad142de49be225a8 P 0473d2b2d01f4459b1e90fd12cc7840e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 2.
I20260709 13:04:39.446270 19481 consensus_queue.cc:260] T 48824d5acfbc485ebf8c2d944e7202de P 0473d2b2d01f4459b1e90fd12cc7840e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:04:39.448874 19481 raft_consensus.cc:3060] T 48824d5acfbc485ebf8c2d944e7202de P 0473d2b2d01f4459b1e90fd12cc7840e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:39.457356 19481 raft_consensus.cc:2468] T 48824d5acfbc485ebf8c2d944e7202de P 0473d2b2d01f4459b1e90fd12cc7840e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 127766fc592545a4997f7790f50f6076 in term 2.
I20260709 13:04:39.480921 20078 leader_election.cc:304] T 48824d5acfbc485ebf8c2d944e7202de P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, 127766fc592545a4997f7790f50f6076; no voters: 
I20260709 13:04:39.481786 20631 raft_consensus.cc:2804] T 48824d5acfbc485ebf8c2d944e7202de P 127766fc592545a4997f7790f50f6076 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:04:39.482265 20631 raft_consensus.cc:697] T 48824d5acfbc485ebf8c2d944e7202de P 127766fc592545a4997f7790f50f6076 [term 2 LEADER]: Becoming Leader. State: Replica: 127766fc592545a4997f7790f50f6076, State: Running, Role: LEADER
I20260709 13:04:39.483152 20631 consensus_queue.cc:237] T 48824d5acfbc485ebf8c2d944e7202de P 127766fc592545a4997f7790f50f6076 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
W20260709 13:04:39.495713 19449 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.1:40321, user_credentials={real_user=slave}} blocked reactor thread for 322726us
I20260709 13:04:39.472711 19485 raft_consensus.cc:2468] T 96efeaaf1057492490e9a621f37e1a2d P 0473d2b2d01f4459b1e90fd12cc7840e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 127766fc592545a4997f7790f50f6076 in term 2.
I20260709 13:04:39.498744 20078 leader_election.cc:304] T 96efeaaf1057492490e9a621f37e1a2d P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, 127766fc592545a4997f7790f50f6076; no voters: 
W20260709 13:04:39.507231 19523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.1:40321, user_credentials={real_user=slave}} blocked reactor thread for 302879us
W20260709 13:04:39.529331 19449 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:39.518407 20585 raft_consensus.cc:697] T 0cdf56e38bbc453d9438d359e5a69955 P e61c3a8f61bb48f8a963c9480e53c168 [term 2 LEADER]: Becoming Leader. State: Replica: e61c3a8f61bb48f8a963c9480e53c168, State: Running, Role: LEADER
I20260709 13:04:39.514988 20599 raft_consensus.cc:2804] T 96efeaaf1057492490e9a621f37e1a2d P 127766fc592545a4997f7790f50f6076 [term 2 FOLLOWER]: Leader election won for term 2
W20260709 13:04:39.534981 19375 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.3:36891, user_credentials={real_user=slave}} blocked reactor thread for 265436us
I20260709 13:04:39.548890 19375 leader_election.cc:304] T e381f1d6b8184797ad142de49be225a8 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
W20260709 13:04:39.655681 19449 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.1:40321, user_credentials={real_user=slave}} blocked reactor thread for 100916us
I20260709 13:04:39.547282 20599 raft_consensus.cc:697] T 96efeaaf1057492490e9a621f37e1a2d P 127766fc592545a4997f7790f50f6076 [term 2 LEADER]: Becoming Leader. State: Replica: 127766fc592545a4997f7790f50f6076, State: Running, Role: LEADER
I20260709 13:04:39.652307 20619 raft_consensus.cc:2804] T e381f1d6b8184797ad142de49be225a8 P e5256d91808b47c195bc9b4dbd7f2b87 [term 2 FOLLOWER]: Leader election won for term 2
W20260709 13:04:39.727285 19449 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.1:40321, user_credentials={real_user=slave}} blocked reactor thread for 63320.2us
W20260709 13:04:39.755451 19377 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.2:46257, user_credentials={real_user=slave}} blocked reactor thread for 487745us
I20260709 13:04:39.765206 19556 raft_consensus.cc:1275] T 309c3ca0ca4b4f3ba129752ea2cb293b P e61c3a8f61bb48f8a963c9480e53c168 [term 2 FOLLOWER]: Refusing update from remote peer e5256d91808b47c195bc9b4dbd7f2b87: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 13:04:39.765426 19557 raft_consensus.cc:1275] T d1e5873a19244c5ebbcd38e126796ee7 P e61c3a8f61bb48f8a963c9480e53c168 [term 2 FOLLOWER]: Refusing update from remote peer e5256d91808b47c195bc9b4dbd7f2b87: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:39.767866 20599 consensus_queue.cc:237] T 96efeaaf1057492490e9a621f37e1a2d P 127766fc592545a4997f7790f50f6076 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
W20260709 13:04:39.770342 19409 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.568s	user 0.008s	sys 0.038s
W20260709 13:04:39.770697 19409 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.709s	user 0.008s	sys 0.038s
I20260709 13:04:39.772893 19478 raft_consensus.cc:1275] T 179fd671030940b4b4a4e24bcc4aba0a P 0473d2b2d01f4459b1e90fd12cc7840e [term 2 FOLLOWER]: Refusing update from remote peer e5256d91808b47c195bc9b4dbd7f2b87: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:39.782162 20618 raft_consensus.cc:493] T 6c5eebf646ad445a9d1b1adc319d7b16 P e61c3a8f61bb48f8a963c9480e53c168 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:39.799778 19558 raft_consensus.cc:1275] T 179fd671030940b4b4a4e24bcc4aba0a P e61c3a8f61bb48f8a963c9480e53c168 [term 2 FOLLOWER]: Refusing update from remote peer e5256d91808b47c195bc9b4dbd7f2b87: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 13:04:39.800616 20078 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.2:46257, user_credentials={real_user=slave}} blocked reactor thread for 71173us
I20260709 13:04:39.765136 20619 raft_consensus.cc:697] T e381f1d6b8184797ad142de49be225a8 P e5256d91808b47c195bc9b4dbd7f2b87 [term 2 LEADER]: Becoming Leader. State: Replica: e5256d91808b47c195bc9b4dbd7f2b87, State: Running, Role: LEADER
I20260709 13:04:39.809551 19478 raft_consensus.cc:1275] T 309c3ca0ca4b4f3ba129752ea2cb293b P 0473d2b2d01f4459b1e90fd12cc7840e [term 2 FOLLOWER]: Refusing update from remote peer e5256d91808b47c195bc9b4dbd7f2b87: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 13:04:39.783906 20618 raft_consensus.cc:515] T 6c5eebf646ad445a9d1b1adc319d7b16 P e61c3a8f61bb48f8a963c9480e53c168 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:04:39.839217 18300 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:04:39.848994 19479 raft_consensus.cc:1275] T d1e5873a19244c5ebbcd38e126796ee7 P 0473d2b2d01f4459b1e90fd12cc7840e [term 2 FOLLOWER]: Refusing update from remote peer e5256d91808b47c195bc9b4dbd7f2b87: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:39.855845 20647 ts_tablet_manager.cc:933] T ab43d85f64114d4ebf618930e43d9ed0 P 127766fc592545a4997f7790f50f6076: Initiating tablet copy from peer e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:04:39.757757 20585 consensus_queue.cc:237] T 0cdf56e38bbc453d9438d359e5a69955 P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:39.835238 20655 consensus_queue.cc:1048] T d1e5873a19244c5ebbcd38e126796ee7 P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.031s
I20260709 13:04:39.837800 20577 consensus_queue.cc:1048] T 309c3ca0ca4b4f3ba129752ea2cb293b P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.032s
I20260709 13:04:39.849268 20579 consensus_queue.cc:1048] T 179fd671030940b4b4a4e24bcc4aba0a P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.056s
I20260709 13:04:39.917486 20618 leader_election.cc:290] T 6c5eebf646ad445a9d1b1adc319d7b16 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:04:39.918076 20619 consensus_queue.cc:237] T e381f1d6b8184797ad142de49be225a8 P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:39.929304 19477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c5eebf646ad445a9d1b1adc319d7b16" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
W20260709 13:04:39.992355 19374 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.4:43121, user_credentials={real_user=slave}} blocked reactor thread for 63205.5us
I20260709 13:04:40.044155 19558 raft_consensus.cc:1275] T 6c5eebf646ad445a9d1b1adc319d7b16 P e61c3a8f61bb48f8a963c9480e53c168 [term 2 FOLLOWER]: Refusing update from remote peer 127766fc592545a4997f7790f50f6076: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:04:40.045997 19557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96efeaaf1057492490e9a621f37e1a2d" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:04:40.046602 19557 raft_consensus.cc:3060] T 96efeaaf1057492490e9a621f37e1a2d P e61c3a8f61bb48f8a963c9480e53c168 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:40.051671 19558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48824d5acfbc485ebf8c2d944e7202de" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:04:40.059957 19558 raft_consensus.cc:3060] T 48824d5acfbc485ebf8c2d944e7202de P e61c3a8f61bb48f8a963c9480e53c168 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:40.120569 19558 raft_consensus.cc:2468] T 48824d5acfbc485ebf8c2d944e7202de P e61c3a8f61bb48f8a963c9480e53c168 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 127766fc592545a4997f7790f50f6076 in term 2.
I20260709 13:04:40.121673 19555 raft_consensus.cc:1275] T 48824d5acfbc485ebf8c2d944e7202de P e61c3a8f61bb48f8a963c9480e53c168 [term 2 FOLLOWER]: Refusing update from remote peer 127766fc592545a4997f7790f50f6076: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:04:40.130260 20106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c5eebf646ad445a9d1b1adc319d7b16" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:04:40.145599 19557 raft_consensus.cc:2468] T 96efeaaf1057492490e9a621f37e1a2d P e61c3a8f61bb48f8a963c9480e53c168 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 127766fc592545a4997f7790f50f6076 in term 2.
W20260709 13:04:40.136554 20637 log.cc:927] Time spent T 309c3ca0ca4b4f3ba129752ea2cb293b P e61c3a8f61bb48f8a963c9480e53c168: Append to log took a long time: real 0.068s	user 0.001s	sys 0.000s
I20260709 13:04:40.132092 20647 tablet_copy_client.cc:323] T ab43d85f64114d4ebf618930e43d9ed0 P 127766fc592545a4997f7790f50f6076: tablet copy: Beginning tablet copy session from remote peer at address 127.17.223.3:36891
W20260709 13:04:40.177376 19450 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.3:36891, user_credentials={real_user=slave}} blocked reactor thread for 320539us
I20260709 13:04:40.171406 20599 consensus_queue.cc:1048] T 6c5eebf646ad445a9d1b1adc319d7b16 P 127766fc592545a4997f7790f50f6076 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.060s
I20260709 13:04:40.229043 20593 raft_consensus.cc:493] T d1e5873a19244c5ebbcd38e126796ee7 P 0473d2b2d01f4459b1e90fd12cc7840e [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:40.243734 20648 raft_consensus.cc:493] T b08304a0a02b42d7840c4e8ee9a6bd1a P e61c3a8f61bb48f8a963c9480e53c168 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0473d2b2d01f4459b1e90fd12cc7840e)
I20260709 13:04:40.244437 20648 raft_consensus.cc:515] T b08304a0a02b42d7840c4e8ee9a6bd1a P e61c3a8f61bb48f8a963c9480e53c168 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
W20260709 13:04:40.255671 20666 log.cc:927] Time spent T 96efeaaf1057492490e9a621f37e1a2d P 127766fc592545a4997f7790f50f6076: Append to log took a long time: real 0.099s	user 0.000s	sys 0.000s
W20260709 13:04:40.255931 20597 log.cc:927] Time spent T 00000000000000000000000000000000 P 97750b77d35444acb7791ebf26cc2685: Append to log took a long time: real 0.054s	user 0.000s	sys 0.000s
I20260709 13:04:40.274844 19305 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:44676 (request call id 217) took 1051 ms. Trace:
I20260709 13:04:40.282433 19304 catalog_manager.cc:5697] T 48824d5acfbc485ebf8c2d944e7202de P 127766fc592545a4997f7790f50f6076 reported cstate change: term changed from 1 to 2, leader changed from 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2) to 127766fc592545a4997f7790f50f6076 (127.17.223.4). New cstate: current_term: 2 leader_uuid: "127766fc592545a4997f7790f50f6076" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:04:40.245532 20593 raft_consensus.cc:515] T d1e5873a19244c5ebbcd38e126796ee7 P 0473d2b2d01f4459b1e90fd12cc7840e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:40.322166 20593 leader_election.cc:290] T d1e5873a19244c5ebbcd38e126796ee7 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:04:40.333647 20648 leader_election.cc:290] T b08304a0a02b42d7840c4e8ee9a6bd1a P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:04:40.275482 19305 rpcz_store.cc:276] 0709 13:04:39.223934 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:39.224786 (+   852us) service_pool.cc:224] Handling call
0709 13:04:40.274730 (+1049944us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:04:39.324252 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:04:39.329339 (+  5087us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:04:39.329374 (+    35us) write_op.cc:435] Acquired schema lock
0709 13:04:39.329396 (+    22us) tablet.cc:662] Decoding operations
0709 13:04:39.329765 (+   369us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:04:39.329822 (+    57us) write_op.cc:641] Partition lock acquired for write op
0709 13:04:39.329857 (+    35us) tablet.cc:685] Acquiring locks for 1 operations
0709 13:04:39.330052 (+   195us) tablet.cc:701] Row locks acquired
0709 13:04:39.330071 (+    19us) write_op.cc:260] PREPARE: finished
0709 13:04:39.330228 (+   157us) write_op.cc:270] Start()
0709 13:04:39.330336 (+   108us) write_op.cc:276] Timestamp: P: 1783602279330167 usec, L: 0
0709 13:04:39.330358 (+    22us) op_driver.cc:348] REPLICATION: starting
0709 13:04:39.331019 (+   661us) log.cc:844] Serialized 538 byte log entry
0709 13:04:39.968813 (+637794us) op_driver.cc:464] REPLICATION: finished
0709 13:04:40.110631 (+141818us) write_op.cc:301] APPLY: starting
0709 13:04:40.112614 (+  1983us) tablet.cc:1367] starting BulkCheckPresence
0709 13:04:40.112721 (+   107us) tablet.cc:1370] finished BulkCheckPresence
0709 13:04:40.129990 (+ 17269us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:04:40.130247 (+   257us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:04:40.136830 (+  6583us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0709 13:04:40.141416 (+  4586us) write_op.cc:312] APPLY: finished
0709 13:04:40.168208 (+ 26792us) log.cc:844] Serialized 23 byte log entry
0709 13:04:40.176581 (+  8373us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:04:40.181934 (+  5353us) write_op.cc:454] Released schema lock
0709 13:04:40.188433 (+  6499us) write_op.cc:341] FINISH: Updating metrics
0709 13:04:40.241703 (+ 53270us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:04:40.243184 (+  1481us) write_op.cc:454] Released schema lock
Metrics: {"reported_tablets":1,"child_traces":[["op",{"apply.queue_time_us":100030,"apply.run_cpu_time_us":2144,"apply.run_wall_time_us":158249,"num_ops":1,"prepare.queue_time_us":405,"prepare.run_cpu_time_us":2619,"prepare.run_wall_time_us":7070,"replication_time_us":572523,"thread_start_us":32755,"threads_started":1}]]}
I20260709 13:04:40.379667 20604 raft_consensus.cc:493] T 7be9efa6559648dbb5a0f7684c4542d1 P 0473d2b2d01f4459b1e90fd12cc7840e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e5256d91808b47c195bc9b4dbd7f2b87)
I20260709 13:04:40.413808 20621 raft_consensus.cc:493] T 5ec1c4ce15e04c7e8c283a62179f2a64 P 0473d2b2d01f4459b1e90fd12cc7840e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e5256d91808b47c195bc9b4dbd7f2b87)
I20260709 13:04:40.414398 20621 raft_consensus.cc:515] T 5ec1c4ce15e04c7e8c283a62179f2a64 P 0473d2b2d01f4459b1e90fd12cc7840e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:04:40.383849 20604 raft_consensus.cc:515] T 7be9efa6559648dbb5a0f7684c4542d1 P 0473d2b2d01f4459b1e90fd12cc7840e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:40.440649 19306 catalog_manager.cc:5697] T 0cdf56e38bbc453d9438d359e5a69955 P e61c3a8f61bb48f8a963c9480e53c168 reported cstate change: term changed from 1 to 2, leader changed from 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2) to e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3). New cstate: current_term: 2 leader_uuid: "e61c3a8f61bb48f8a963c9480e53c168" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } health_report { overall_health: HEALTHY } } }
I20260709 13:04:40.421761 20621 leader_election.cc:290] T 5ec1c4ce15e04c7e8c283a62179f2a64 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:04:40.450035 20604 leader_election.cc:290] T 7be9efa6559648dbb5a0f7684c4542d1 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:04:40.423754 20670 raft_consensus.cc:2955] T 309c3ca0ca4b4f3ba129752ea2cb293b P e5256d91808b47c195bc9b4dbd7f2b87 [term 2 LEADER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER 127766fc592545a4997f7790f50f6076 (127.17.223.4) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } attrs { replace: true } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: NON_VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: true } } }
I20260709 13:04:40.480077 18300 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:04:40.526144 20674 raft_consensus.cc:493] T 2b74109013a140ada21feeef92d6f563 P 0473d2b2d01f4459b1e90fd12cc7840e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e5256d91808b47c195bc9b4dbd7f2b87)
I20260709 13:04:40.529109 20674 raft_consensus.cc:515] T 2b74109013a140ada21feeef92d6f563 P 0473d2b2d01f4459b1e90fd12cc7840e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:40.549742 20674 leader_election.cc:290] T 2b74109013a140ada21feeef92d6f563 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:04:40.580999 20578 raft_consensus.cc:493] T 4af19371ea874c09a0a2147040835cbb P e61c3a8f61bb48f8a963c9480e53c168 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 127766fc592545a4997f7790f50f6076)
I20260709 13:04:40.581769 20578 raft_consensus.cc:515] T 4af19371ea874c09a0a2147040835cbb P e61c3a8f61bb48f8a963c9480e53c168 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:04:40.585089 20578 leader_election.cc:290] T 4af19371ea874c09a0a2147040835cbb P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
W20260709 13:04:40.602118 19375 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.3:36891, user_credentials={real_user=slave}} blocked reactor thread for 165786us
I20260709 13:04:40.608644 19558 raft_consensus.cc:2955] T 309c3ca0ca4b4f3ba129752ea2cb293b P e61c3a8f61bb48f8a963c9480e53c168 [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER 127766fc592545a4997f7790f50f6076 (127.17.223.4) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } attrs { replace: true } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: NON_VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: true } } }
I20260709 13:04:40.596778 20578 raft_consensus.cc:493] T ff75a1d4cb1f493db8f71ddc136ba9ab P e61c3a8f61bb48f8a963c9480e53c168 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0473d2b2d01f4459b1e90fd12cc7840e)
W20260709 13:04:40.643705 19523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.1:40321, user_credentials={real_user=slave}} blocked reactor thread for 444001us
I20260709 13:04:40.623112 20578 raft_consensus.cc:515] T ff75a1d4cb1f493db8f71ddc136ba9ab P e61c3a8f61bb48f8a963c9480e53c168 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:40.661664 19411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b08304a0a02b42d7840c4e8ee9a6bd1a" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:04:40.640735 20655 raft_consensus.cc:493] T 1f85fc4b527a48848e5faa083b604e36 P e5256d91808b47c195bc9b4dbd7f2b87 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0473d2b2d01f4459b1e90fd12cc7840e)
I20260709 13:04:40.655002 20661 raft_consensus.cc:493] T 1dc5b3532fe54f74876d02beffa2c230 P e61c3a8f61bb48f8a963c9480e53c168 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0473d2b2d01f4459b1e90fd12cc7840e)
W20260709 13:04:40.675418 19450 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.3:36891, user_credentials={real_user=slave}} blocked reactor thread for 432947us
I20260709 13:04:40.679975 19405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4af19371ea874c09a0a2147040835cbb" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:04:40.682050 19559 raft_consensus.cc:1275] T e381f1d6b8184797ad142de49be225a8 P e61c3a8f61bb48f8a963c9480e53c168 [term 2 FOLLOWER]: Refusing update from remote peer e5256d91808b47c195bc9b4dbd7f2b87: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:40.689702 19555 raft_consensus.cc:1275] T f1b10566f45d4a7d9029858330e02d5b P e61c3a8f61bb48f8a963c9480e53c168 [term 2 FOLLOWER]: Refusing update from remote peer 0473d2b2d01f4459b1e90fd12cc7840e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:40.655241 20674 raft_consensus.cc:493] T 0e1085d23e8347fbbd5bce7542f4b1f4 P 0473d2b2d01f4459b1e90fd12cc7840e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e61c3a8f61bb48f8a963c9480e53c168)
I20260709 13:04:40.696756 19406 raft_consensus.cc:1275] T 0cdf56e38bbc453d9438d359e5a69955 P e5256d91808b47c195bc9b4dbd7f2b87 [term 2 FOLLOWER]: Refusing update from remote peer e61c3a8f61bb48f8a963c9480e53c168: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:40.709803 20617 consensus_queue.cc:1048] T 179fd671030940b4b4a4e24bcc4aba0a P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.007s
W20260709 13:04:40.712177 19449 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.503s	user 0.018s	sys 0.045s
W20260709 13:04:40.712540 19449 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.503s	user 0.018s	sys 0.045s
I20260709 13:04:40.717846 19409 raft_consensus.cc:1275] T f1b10566f45d4a7d9029858330e02d5b P e5256d91808b47c195bc9b4dbd7f2b87 [term 2 FOLLOWER]: Refusing update from remote peer 0473d2b2d01f4459b1e90fd12cc7840e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:40.724337 19477 raft_consensus.cc:1275] T 96efeaaf1057492490e9a621f37e1a2d P 0473d2b2d01f4459b1e90fd12cc7840e [term 2 FOLLOWER]: Refusing update from remote peer 127766fc592545a4997f7790f50f6076: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:04:40.724555 19479 raft_consensus.cc:1275] T 48824d5acfbc485ebf8c2d944e7202de P 0473d2b2d01f4459b1e90fd12cc7840e [term 2 FOLLOWER]: Refusing update from remote peer 127766fc592545a4997f7790f50f6076: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:04:40.726981 20593 raft_consensus.cc:493] T 3e1f505cb0f1427bbd698ac889d80821 P 0473d2b2d01f4459b1e90fd12cc7840e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e5256d91808b47c195bc9b4dbd7f2b87)
I20260709 13:04:40.727630 20593 raft_consensus.cc:515] T 3e1f505cb0f1427bbd698ac889d80821 P 0473d2b2d01f4459b1e90fd12cc7840e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:40.730017 20593 leader_election.cc:290] T 3e1f505cb0f1427bbd698ac889d80821 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:04:40.730559 20593 raft_consensus.cc:493] T 775c229504194560ba9589bc2199b089 P 0473d2b2d01f4459b1e90fd12cc7840e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e5256d91808b47c195bc9b4dbd7f2b87)
I20260709 13:04:40.731568 20593 raft_consensus.cc:515] T 775c229504194560ba9589bc2199b089 P 0473d2b2d01f4459b1e90fd12cc7840e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:04:40.734189 20593 leader_election.cc:290] T 775c229504194560ba9589bc2199b089 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:04:40.740824 19553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e5873a19244c5ebbcd38e126796ee7" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:04:40.679664 20655 raft_consensus.cc:515] T 1f85fc4b527a48848e5faa083b604e36 P e5256d91808b47c195bc9b4dbd7f2b87 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:04:40.735590 20622 raft_consensus.cc:493] T 217b5fae677b4971b3bbd2f357a1f7ff P 0473d2b2d01f4459b1e90fd12cc7840e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e5256d91808b47c195bc9b4dbd7f2b87)
I20260709 13:04:40.811440 20488 raft_consensus.cc:493] T ab43d85f64114d4ebf618930e43d9ed0 P 0473d2b2d01f4459b1e90fd12cc7840e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e61c3a8f61bb48f8a963c9480e53c168)
I20260709 13:04:40.711598 20674 raft_consensus.cc:515] T 0e1085d23e8347fbbd5bce7542f4b1f4 P 0473d2b2d01f4459b1e90fd12cc7840e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:04:40.816402 20488 raft_consensus.cc:515] T ab43d85f64114d4ebf618930e43d9ed0 P 0473d2b2d01f4459b1e90fd12cc7840e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } attrs { replace: true } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: NON_VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: true } }
I20260709 13:04:40.680027 20661 raft_consensus.cc:515] T 1dc5b3532fe54f74876d02beffa2c230 P e61c3a8f61bb48f8a963c9480e53c168 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:40.843065 19555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b74109013a140ada21feeef92d6f563" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:04:40.747043 20588 raft_consensus.cc:493] T 7f575b143b844aa096b50997dad3516a P e5256d91808b47c195bc9b4dbd7f2b87 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e61c3a8f61bb48f8a963c9480e53c168)
W20260709 13:04:40.851508 19377 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.2:46257, user_credentials={real_user=slave}} blocked reactor thread for 157277us
I20260709 13:04:40.853461 20488 leader_election.cc:290] T ab43d85f64114d4ebf618930e43d9ed0 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:04:40.842733 20110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4af19371ea874c09a0a2147040835cbb" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:04:40.842200 20105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ec1c4ce15e04c7e8c283a62179f2a64" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:04:40.935797 19483 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "172b3dd13109415a955b71ac0e9d2234"
dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
mode: GRACEFUL
new_leader_uuid: "127766fc592545a4997f7790f50f6076"
 from {username='slave'} at 127.0.0.1:48168
I20260709 13:04:41.003772 19483 raft_consensus.cc:606] T 172b3dd13109415a955b71ac0e9d2234 P 0473d2b2d01f4459b1e90fd12cc7840e [term 1 LEADER]: Received request to transfer leadership to TS 127766fc592545a4997f7790f50f6076
I20260709 13:04:41.004799 19405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e5873a19244c5ebbcd38e126796ee7" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:04:40.977151 20645 raft_consensus.cc:493] T 309c3ca0ca4b4f3ba129752ea2cb293b P 0473d2b2d01f4459b1e90fd12cc7840e [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e5256d91808b47c195bc9b4dbd7f2b87)
I20260709 13:04:41.006376 20645 raft_consensus.cc:515] T 309c3ca0ca4b4f3ba129752ea2cb293b P 0473d2b2d01f4459b1e90fd12cc7840e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:40.916383 20581 consensus_queue.cc:1048] T 309c3ca0ca4b4f3ba129752ea2cb293b P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.097s
I20260709 13:04:41.006515 19407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ec1c4ce15e04c7e8c283a62179f2a64" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:04:40.989939 20682 ts_tablet_manager.cc:933] T 309c3ca0ca4b4f3ba129752ea2cb293b P 127766fc592545a4997f7790f50f6076: Initiating tablet copy from peer e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321)
I20260709 13:04:41.032051 20655 leader_election.cc:290] T 1f85fc4b527a48848e5faa083b604e36 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
W20260709 13:04:41.008147 20681 log.cc:927] Time spent T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P 127766fc592545a4997f7790f50f6076: Append to log took a long time: real 0.331s	user 0.000s	sys 0.001s
I20260709 13:04:40.853870 20575 raft_consensus.cc:493] T 179fd671030940b4b4a4e24bcc4aba0a P 0473d2b2d01f4459b1e90fd12cc7840e [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:40.842617 19486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b08304a0a02b42d7840c4e8ee9a6bd1a" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
W20260709 13:04:41.030158 20679 log.cc:927] Time spent T d1e5873a19244c5ebbcd38e126796ee7 P e61c3a8f61bb48f8a963c9480e53c168: Append to log took a long time: real 0.185s	user 0.004s	sys 0.024s
I20260709 13:04:40.905843 20588 raft_consensus.cc:515] T 7f575b143b844aa096b50997dad3516a P e5256d91808b47c195bc9b4dbd7f2b87 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:41.083037 20621 raft_consensus.cc:493] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P 0473d2b2d01f4459b1e90fd12cc7840e [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 127766fc592545a4997f7790f50f6076)
I20260709 13:04:41.104511 20595 raft_consensus.cc:493] T 0afb57ae58a24a01850491d69f0213dd P 127766fc592545a4997f7790f50f6076 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e61c3a8f61bb48f8a963c9480e53c168)
I20260709 13:04:41.105098 20595 raft_consensus.cc:515] T 0afb57ae58a24a01850491d69f0213dd P 127766fc592545a4997f7790f50f6076 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:04:41.084388 20575 raft_consensus.cc:515] T 179fd671030940b4b4a4e24bcc4aba0a P 0473d2b2d01f4459b1e90fd12cc7840e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:40.853842 20622 raft_consensus.cc:515] T 217b5fae677b4971b3bbd2f357a1f7ff P 0473d2b2d01f4459b1e90fd12cc7840e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:41.084221 20641 consensus_queue.cc:1048] T e381f1d6b8184797ad142de49be225a8 P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.390s
I20260709 13:04:41.111138 20622 leader_election.cc:290] T 217b5fae677b4971b3bbd2f357a1f7ff P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:04:41.121574 19409 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2a16f7501e2444fb86d4e2778e734e02"
dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
mode: GRACEFUL
new_leader_uuid: "127766fc592545a4997f7790f50f6076"
 from {username='slave'} at 127.0.0.1:37312
I20260709 13:04:41.122311 19409 raft_consensus.cc:606] T 2a16f7501e2444fb86d4e2778e734e02 P e5256d91808b47c195bc9b4dbd7f2b87 [term 2 LEADER]: Received request to transfer leadership to TS 127766fc592545a4997f7790f50f6076
I20260709 13:04:40.935144 20589 consensus_queue.cc:1048] T d1e5873a19244c5ebbcd38e126796ee7 P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.194s
W20260709 13:04:41.119205 20680 log.cc:927] Time spent T 179fd671030940b4b4a4e24bcc4aba0a P e61c3a8f61bb48f8a963c9480e53c168: Append to log took a long time: real 0.177s	user 0.001s	sys 0.012s
I20260709 13:04:41.116262 20595 leader_election.cc:290] T 0afb57ae58a24a01850491d69f0213dd P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:04:41.118423 20578 leader_election.cc:290] T ff75a1d4cb1f493db8f71ddc136ba9ab P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:04:41.103756 20621 raft_consensus.cc:515] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P 0473d2b2d01f4459b1e90fd12cc7840e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:04:41.108453 20575 leader_election.cc:290] T 179fd671030940b4b4a4e24bcc4aba0a P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
W20260709 13:04:41.130852 20686 log.cc:927] Time spent T e381f1d6b8184797ad142de49be225a8 P e5256d91808b47c195bc9b4dbd7f2b87: Append to log took a long time: real 0.154s	user 0.000s	sys 0.000s
I20260709 13:04:41.131572 20645 leader_election.cc:290] T 309c3ca0ca4b4f3ba129752ea2cb293b P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
W20260709 13:04:41.134379 20692 log.cc:927] Time spent T 14efcc79969f41babe5529c22d59156d P 127766fc592545a4997f7790f50f6076: Append to log took a long time: real 0.266s	user 0.000s	sys 0.001s
I20260709 13:04:41.117033 19404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7be9efa6559648dbb5a0f7684c4542d1" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:04:41.170423 20644 raft_consensus.cc:493] T f1b10566f45d4a7d9029858330e02d5b P e61c3a8f61bb48f8a963c9480e53c168 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:41.137390 20674 leader_election.cc:290] T 0e1085d23e8347fbbd5bce7542f4b1f4 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
W20260709 13:04:41.228776 20706 log.cc:927] Time spent T 6c5eebf646ad445a9d1b1adc319d7b16 P 0473d2b2d01f4459b1e90fd12cc7840e: Append to log took a long time: real 0.057s	user 0.001s	sys 0.000s
W20260709 13:04:41.247228 20700 log.cc:927] Time spent T d1e5873a19244c5ebbcd38e126796ee7 P e5256d91808b47c195bc9b4dbd7f2b87: Append to log took a long time: real 0.102s	user 0.000s	sys 0.000s
I20260709 13:04:41.247246 20595 consensus_queue.cc:1048] T 48824d5acfbc485ebf8c2d944e7202de P 127766fc592545a4997f7790f50f6076 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:04:41.264578 20661 leader_election.cc:290] T 1dc5b3532fe54f74876d02beffa2c230 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:04:41.264943 20621 leader_election.cc:290] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
W20260709 13:04:41.237218 20076 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.3:36891, user_credentials={real_user=slave}} blocked reactor thread for 59420.3us
I20260709 13:04:41.173907 20644 raft_consensus.cc:515] T f1b10566f45d4a7d9029858330e02d5b P e61c3a8f61bb48f8a963c9480e53c168 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:41.262564 20588 leader_election.cc:290] T 7f575b143b844aa096b50997dad3516a P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:04:41.318166 20621 raft_consensus.cc:493] T 76cb037fc9064d13b59a8969d897ce8c P 0473d2b2d01f4459b1e90fd12cc7840e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e5256d91808b47c195bc9b4dbd7f2b87)
I20260709 13:04:41.332101 20621 raft_consensus.cc:515] T 76cb037fc9064d13b59a8969d897ce8c P 0473d2b2d01f4459b1e90fd12cc7840e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:41.334571 20621 leader_election.cc:290] T 76cb037fc9064d13b59a8969d897ce8c P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:04:41.340996 20644 leader_election.cc:290] T f1b10566f45d4a7d9029858330e02d5b P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:04:41.351157 20682 tablet_copy_client.cc:323] T 309c3ca0ca4b4f3ba129752ea2cb293b P 127766fc592545a4997f7790f50f6076: tablet copy: Beginning tablet copy session from remote peer at address 127.17.223.1:40321
I20260709 13:04:41.352171 20579 raft_consensus.cc:493] T fa8650e71aa14778b3d73721fc50d9fc P e5256d91808b47c195bc9b4dbd7f2b87 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0473d2b2d01f4459b1e90fd12cc7840e)
I20260709 13:04:41.353502 20579 raft_consensus.cc:515] T fa8650e71aa14778b3d73721fc50d9fc P e5256d91808b47c195bc9b4dbd7f2b87 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:41.356050 20579 leader_election.cc:290] T fa8650e71aa14778b3d73721fc50d9fc P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:04:41.358523 20621 raft_consensus.cc:493] T 86a6797bdfe94fa496c050ceae4bd0d9 P 0473d2b2d01f4459b1e90fd12cc7840e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e5256d91808b47c195bc9b4dbd7f2b87)
I20260709 13:04:41.359285 20621 raft_consensus.cc:515] T 86a6797bdfe94fa496c050ceae4bd0d9 P 0473d2b2d01f4459b1e90fd12cc7840e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:41.361765 20621 leader_election.cc:290] T 86a6797bdfe94fa496c050ceae4bd0d9 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:04:41.569137 20621 raft_consensus.cc:493] T df751f992649444090e27965eb1af85d P 0473d2b2d01f4459b1e90fd12cc7840e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e61c3a8f61bb48f8a963c9480e53c168)
I20260709 13:04:41.569137 20645 raft_consensus.cc:493] T 22196caba61445d3bec98a0aab3c337d P 0473d2b2d01f4459b1e90fd12cc7840e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e61c3a8f61bb48f8a963c9480e53c168)
I20260709 13:04:41.576961 20674 raft_consensus.cc:493] T 40e1e16737a842ee936002830f36882e P 0473d2b2d01f4459b1e90fd12cc7840e [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e61c3a8f61bb48f8a963c9480e53c168)
I20260709 13:04:41.577942 20674 raft_consensus.cc:515] T 40e1e16737a842ee936002830f36882e P 0473d2b2d01f4459b1e90fd12cc7840e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:41.581872 20674 leader_election.cc:290] T 40e1e16737a842ee936002830f36882e P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:04:41.574427 20621 raft_consensus.cc:515] T df751f992649444090e27965eb1af85d P 0473d2b2d01f4459b1e90fd12cc7840e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:41.569415 20611 raft_consensus.cc:493] T ef32ce6fdd0e40d382c79974f30295c6 P e5256d91808b47c195bc9b4dbd7f2b87 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0473d2b2d01f4459b1e90fd12cc7840e)
I20260709 13:04:41.589411 19478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f85fc4b527a48848e5faa083b604e36" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:04:41.598713 20644 raft_consensus.cc:493] T bc225c93219c45538b53a1bd3d387e4d P e61c3a8f61bb48f8a963c9480e53c168 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e5256d91808b47c195bc9b4dbd7f2b87)
I20260709 13:04:41.599618 20644 raft_consensus.cc:515] T bc225c93219c45538b53a1bd3d387e4d P e61c3a8f61bb48f8a963c9480e53c168 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:41.571813 20645 raft_consensus.cc:515] T 22196caba61445d3bec98a0aab3c337d P 0473d2b2d01f4459b1e90fd12cc7840e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:41.611208 20595 raft_consensus.cc:493] T 2a16f7501e2444fb86d4e2778e734e02 P 127766fc592545a4997f7790f50f6076 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e5256d91808b47c195bc9b4dbd7f2b87)
I20260709 13:04:41.612237 20595 raft_consensus.cc:515] T 2a16f7501e2444fb86d4e2778e734e02 P 127766fc592545a4997f7790f50f6076 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:04:41.613396 20644 leader_election.cc:290] T bc225c93219c45538b53a1bd3d387e4d P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:04:41.617811 19485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f575b143b844aa096b50997dad3516a" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:04:41.622048 20579 raft_consensus.cc:493] T edd7d470b5014c9489be7f41f64355c9 P e5256d91808b47c195bc9b4dbd7f2b87 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e61c3a8f61bb48f8a963c9480e53c168)
I20260709 13:04:41.633760 20579 raft_consensus.cc:515] T edd7d470b5014c9489be7f41f64355c9 P e5256d91808b47c195bc9b4dbd7f2b87 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:41.634763 20654 raft_consensus.cc:493] T 65d8cb8d6ec64f459d5a47cefab10acf P e5256d91808b47c195bc9b4dbd7f2b87 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e61c3a8f61bb48f8a963c9480e53c168)
I20260709 13:04:41.635752 20654 raft_consensus.cc:515] T 65d8cb8d6ec64f459d5a47cefab10acf P e5256d91808b47c195bc9b4dbd7f2b87 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:04:41.637177 20579 leader_election.cc:290] T edd7d470b5014c9489be7f41f64355c9 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:04:41.638373 19485 raft_consensus.cc:2468] T 7f575b143b844aa096b50997dad3516a P 0473d2b2d01f4459b1e90fd12cc7840e [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 1.
I20260709 13:04:41.615070 20611 raft_consensus.cc:515] T ef32ce6fdd0e40d382c79974f30295c6 P e5256d91808b47c195bc9b4dbd7f2b87 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:41.638520 20654 leader_election.cc:290] T 65d8cb8d6ec64f459d5a47cefab10acf P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:04:41.658241 20595 leader_election.cc:290] T 2a16f7501e2444fb86d4e2778e734e02 P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:04:41.658758 20645 leader_election.cc:290] T 22196caba61445d3bec98a0aab3c337d P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:04:41.681347 20654 raft_consensus.cc:493] T 172b3dd13109415a955b71ac0e9d2234 P e5256d91808b47c195bc9b4dbd7f2b87 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0473d2b2d01f4459b1e90fd12cc7840e)
I20260709 13:04:41.682408 20654 raft_consensus.cc:515] T 172b3dd13109415a955b71ac0e9d2234 P e5256d91808b47c195bc9b4dbd7f2b87 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:04:41.684064 20112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f85fc4b527a48848e5faa083b604e36" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:04:41.685161 20112 raft_consensus.cc:2468] T 1f85fc4b527a48848e5faa083b604e36 P 127766fc592545a4997f7790f50f6076 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 1.
I20260709 13:04:41.685315 20654 leader_election.cc:290] T 172b3dd13109415a955b71ac0e9d2234 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:04:41.697827 20674 consensus_queue.cc:1048] T f1b10566f45d4a7d9029858330e02d5b P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:04:41.698920 19484 raft_consensus.cc:1275] T 0cdf56e38bbc453d9438d359e5a69955 P 0473d2b2d01f4459b1e90fd12cc7840e [term 2 FOLLOWER]: Refusing update from remote peer e61c3a8f61bb48f8a963c9480e53c168: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:41.702603 19523 leader_election.cc:304] T 6c5eebf646ad445a9d1b1adc319d7b16 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e61c3a8f61bb48f8a963c9480e53c168; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, 127766fc592545a4997f7790f50f6076
I20260709 13:04:41.705469 19485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dc5b3532fe54f74876d02beffa2c230" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:04:41.705713 19407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b74109013a140ada21feeef92d6f563" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:04:41.707077 19482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff75a1d4cb1f493db8f71ddc136ba9ab" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:04:41.708251 20661 raft_consensus.cc:2749] T 6c5eebf646ad445a9d1b1adc319d7b16 P e61c3a8f61bb48f8a963c9480e53c168 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:04:41.716056 19480 raft_consensus.cc:2955] T 309c3ca0ca4b4f3ba129752ea2cb293b P 0473d2b2d01f4459b1e90fd12cc7840e [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER 127766fc592545a4997f7790f50f6076 (127.17.223.4) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } attrs { replace: true } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: NON_VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: true } } }
I20260709 13:04:41.718353 20589 raft_consensus.cc:493] T 833a2f0775ed407a94b8924ce50adb63 P e5256d91808b47c195bc9b4dbd7f2b87 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e61c3a8f61bb48f8a963c9480e53c168)
I20260709 13:04:41.719360 20589 raft_consensus.cc:515] T 833a2f0775ed407a94b8924ce50adb63 P e5256d91808b47c195bc9b4dbd7f2b87 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:04:41.721413 20581 raft_consensus.cc:493] T f1b10566f45d4a7d9029858330e02d5b P e5256d91808b47c195bc9b4dbd7f2b87 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:41.722191 20589 leader_election.cc:290] T 833a2f0775ed407a94b8924ce50adb63 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
W20260709 13:04:41.726353 19450 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.3:36891, user_credentials={real_user=slave}} blocked reactor thread for 59420.8us
I20260709 13:04:41.732523 20611 leader_election.cc:290] T ef32ce6fdd0e40d382c79974f30295c6 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:04:41.733886 19481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0afb57ae58a24a01850491d69f0213dd" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:04:41.734727 19377 leader_election.cc:304] T 7f575b143b844aa096b50997dad3516a P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87; no voters: 
I20260709 13:04:41.736454 19421 tablet_copy_service.cc:140] P e5256d91808b47c195bc9b4dbd7f2b87: Received BeginTabletCopySession request for tablet 309c3ca0ca4b4f3ba129752ea2cb293b from peer 127766fc592545a4997f7790f50f6076 ({username='slave'} at 127.0.0.1:49050)
I20260709 13:04:41.737254 19421 tablet_copy_service.cc:161] P e5256d91808b47c195bc9b4dbd7f2b87: Beginning new tablet copy session on tablet 309c3ca0ca4b4f3ba129752ea2cb293b from peer 127766fc592545a4997f7790f50f6076 at {username='slave'} at 127.0.0.1:49050: session id = 127766fc592545a4997f7790f50f6076-309c3ca0ca4b4f3ba129752ea2cb293b
I20260709 13:04:41.722289 20581 raft_consensus.cc:515] T f1b10566f45d4a7d9029858330e02d5b P e5256d91808b47c195bc9b4dbd7f2b87 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:41.740985 20581 leader_election.cc:290] T f1b10566f45d4a7d9029858330e02d5b P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:04:41.741629 20665 raft_consensus.cc:493] T df751f992649444090e27965eb1af85d P e5256d91808b47c195bc9b4dbd7f2b87 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e61c3a8f61bb48f8a963c9480e53c168)
I20260709 13:04:41.741827 20112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65d8cb8d6ec64f459d5a47cefab10acf" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:04:41.742368 20665 raft_consensus.cc:515] T df751f992649444090e27965eb1af85d P e5256d91808b47c195bc9b4dbd7f2b87 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:41.744781 20665 leader_election.cc:290] T df751f992649444090e27965eb1af85d P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:04:41.725196 20621 leader_election.cc:290] T df751f992649444090e27965eb1af85d P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:04:41.746709 20654 raft_consensus.cc:2804] T 7f575b143b844aa096b50997dad3516a P e5256d91808b47c195bc9b4dbd7f2b87 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:04:41.747169 20654 raft_consensus.cc:493] T 7f575b143b844aa096b50997dad3516a P e5256d91808b47c195bc9b4dbd7f2b87 [term 1 FOLLOWER]: Starting leader election (detected failure of leader e61c3a8f61bb48f8a963c9480e53c168)
I20260709 13:04:41.747635 20654 raft_consensus.cc:3060] T 7f575b143b844aa096b50997dad3516a P e5256d91808b47c195bc9b4dbd7f2b87 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:41.747675 20110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "172b3dd13109415a955b71ac0e9d2234" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:04:41.753700 19482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1b10566f45d4a7d9029858330e02d5b" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:04:41.751276 20105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "833a2f0775ed407a94b8924ce50adb63" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:04:41.756202 20105 raft_consensus.cc:2468] T 833a2f0775ed407a94b8924ce50adb63 P 127766fc592545a4997f7790f50f6076 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 1.
I20260709 13:04:41.756484 19481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc225c93219c45538b53a1bd3d387e4d" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:04:41.762624 19374 leader_election.cc:304] T 1f85fc4b527a48848e5faa083b604e36 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 127766fc592545a4997f7790f50f6076, e5256d91808b47c195bc9b4dbd7f2b87; no voters: 0473d2b2d01f4459b1e90fd12cc7840e
I20260709 13:04:41.766498 20642 raft_consensus.cc:2804] T 1f85fc4b527a48848e5faa083b604e36 P e5256d91808b47c195bc9b4dbd7f2b87 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:04:41.766959 20642 raft_consensus.cc:493] T 1f85fc4b527a48848e5faa083b604e36 P e5256d91808b47c195bc9b4dbd7f2b87 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 0473d2b2d01f4459b1e90fd12cc7840e)
I20260709 13:04:41.767416 20642 raft_consensus.cc:3060] T 1f85fc4b527a48848e5faa083b604e36 P e5256d91808b47c195bc9b4dbd7f2b87 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:41.771189 19570 tablet_copy_service.cc:140] P e61c3a8f61bb48f8a963c9480e53c168: Received BeginTabletCopySession request for tablet ab43d85f64114d4ebf618930e43d9ed0 from peer 127766fc592545a4997f7790f50f6076 ({username='slave'} at 127.0.0.1:41504)
I20260709 13:04:41.771981 19570 tablet_copy_service.cc:161] P e61c3a8f61bb48f8a963c9480e53c168: Beginning new tablet copy session on tablet ab43d85f64114d4ebf618930e43d9ed0 from peer 127766fc592545a4997f7790f50f6076 at {username='slave'} at 127.0.0.1:41504: session id = 127766fc592545a4997f7790f50f6076-ab43d85f64114d4ebf618930e43d9ed0
I20260709 13:04:41.775818 19556 raft_consensus.cc:1275] T 96efeaaf1057492490e9a621f37e1a2d P e61c3a8f61bb48f8a963c9480e53c168 [term 2 FOLLOWER]: Refusing update from remote peer 127766fc592545a4997f7790f50f6076: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
W20260709 13:04:41.776890 20705 log.cc:927] Time spent T 179fd671030940b4b4a4e24bcc4aba0a P e5256d91808b47c195bc9b4dbd7f2b87: Append to log took a long time: real 0.599s	user 0.002s	sys 0.016s
I20260709 13:04:41.776892 19558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0afb57ae58a24a01850491d69f0213dd" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:04:41.781795 20590 raft_consensus.cc:493] T 9962423cb4e54fcfa5de01daf68a86e7 P 127766fc592545a4997f7790f50f6076 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0473d2b2d01f4459b1e90fd12cc7840e)
I20260709 13:04:41.782562 20590 raft_consensus.cc:515] T 9962423cb4e54fcfa5de01daf68a86e7 P 127766fc592545a4997f7790f50f6076 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:04:41.788932 19374 leader_election.cc:304] T 833a2f0775ed407a94b8924ce50adb63 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 127766fc592545a4997f7790f50f6076, e5256d91808b47c195bc9b4dbd7f2b87; no voters: 
I20260709 13:04:41.791968 20601 consensus_queue.cc:1048] T f1b10566f45d4a7d9029858330e02d5b P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
W20260709 13:04:41.861603 20713 log.cc:927] Time spent T 309c3ca0ca4b4f3ba129752ea2cb293b P 0473d2b2d01f4459b1e90fd12cc7840e: Append to log took a long time: real 0.057s	user 0.000s	sys 0.000s
I20260709 13:04:42.039615 20590 leader_election.cc:290] T 9962423cb4e54fcfa5de01daf68a86e7 P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:04:42.041936 20661 raft_consensus.cc:493] T 46c5bfeecc314717bffe987e6844b6d0 P e61c3a8f61bb48f8a963c9480e53c168 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 0473d2b2d01f4459b1e90fd12cc7840e)
I20260709 13:04:41.798130 20665 raft_consensus.cc:2804] T 833a2f0775ed407a94b8924ce50adb63 P e5256d91808b47c195bc9b4dbd7f2b87 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:04:42.042974 20665 raft_consensus.cc:493] T 833a2f0775ed407a94b8924ce50adb63 P e5256d91808b47c195bc9b4dbd7f2b87 [term 1 FOLLOWER]: Starting leader election (detected failure of leader e61c3a8f61bb48f8a963c9480e53c168)
I20260709 13:04:42.042833 20661 raft_consensus.cc:515] T 46c5bfeecc314717bffe987e6844b6d0 P e61c3a8f61bb48f8a963c9480e53c168 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:42.043376 20665 raft_consensus.cc:3060] T 833a2f0775ed407a94b8924ce50adb63 P e5256d91808b47c195bc9b4dbd7f2b87 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:42.044720 20684 raft_consensus.cc:493] T 96efeaaf1057492490e9a621f37e1a2d P e61c3a8f61bb48f8a963c9480e53c168 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:42.045241 20684 raft_consensus.cc:515] T 96efeaaf1057492490e9a621f37e1a2d P e61c3a8f61bb48f8a963c9480e53c168 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:04:42.071194 19556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a16f7501e2444fb86d4e2778e734e02" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
W20260709 13:04:42.384824 20642 consensus_meta.cc:287] T 1f85fc4b527a48848e5faa083b604e36 P e5256d91808b47c195bc9b4dbd7f2b87: Time spent flushing consensus metadata: real 0.617s	user 0.010s	sys 0.002s
I20260709 13:04:42.396550 20590 raft_consensus.cc:493] T 1efebf73c86e432baa55533136b6e12c P 127766fc592545a4997f7790f50f6076 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e61c3a8f61bb48f8a963c9480e53c168)
I20260709 13:04:42.397269 20590 raft_consensus.cc:515] T 1efebf73c86e432baa55533136b6e12c P 127766fc592545a4997f7790f50f6076 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:04:42.403326 20590 leader_election.cc:290] T 1efebf73c86e432baa55533136b6e12c P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:04:42.405028 20590 raft_consensus.cc:493] T 0e1085d23e8347fbbd5bce7542f4b1f4 P 127766fc592545a4997f7790f50f6076 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e61c3a8f61bb48f8a963c9480e53c168)
I20260709 13:04:42.405707 20590 raft_consensus.cc:515] T 0e1085d23e8347fbbd5bce7542f4b1f4 P 127766fc592545a4997f7790f50f6076 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:04:42.404251 20661 leader_election.cc:290] T 46c5bfeecc314717bffe987e6844b6d0 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:04:42.394172 20595 raft_consensus.cc:493] T ece3db938bc649d4a40a51522ed5259c P 127766fc592545a4997f7790f50f6076 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e5256d91808b47c195bc9b4dbd7f2b87)
I20260709 13:04:42.407097 20595 raft_consensus.cc:515] T ece3db938bc649d4a40a51522ed5259c P 127766fc592545a4997f7790f50f6076 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:04:42.403451 19570 tablet_copy_source_session.cc:215] T ab43d85f64114d4ebf618930e43d9ed0 P e61c3a8f61bb48f8a963c9480e53c168: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:04:43.064793 19570 rpcz_store.cc:275] Call kudu.tserver.TabletCopyService.BeginTabletCopySession from 127.0.0.1:41504 (request call id 37) took 1355 ms. Trace:
I20260709 13:04:43.065188 19570 rpcz_store.cc:276] 0709 13:04:41.764423 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:41.770843 (+  6420us) service_pool.cc:224] Handling call
0709 13:04:43.064684 (+1293841us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:04:42.423204 20590 leader_election.cc:290] T 0e1085d23e8347fbbd5bce7542f4b1f4 P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:04:42.409466 20595 leader_election.cc:290] T ece3db938bc649d4a40a51522ed5259c P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:04:42.399109 20642 raft_consensus.cc:515] T 1f85fc4b527a48848e5faa083b604e36 P e5256d91808b47c195bc9b4dbd7f2b87 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:04:43.382386 19403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1b10566f45d4a7d9029858330e02d5b" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:04:43.383103 19403 raft_consensus.cc:2468] T f1b10566f45d4a7d9029858330e02d5b P e5256d91808b47c195bc9b4dbd7f2b87 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 2.
I20260709 13:04:43.383903 19402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dc5b3532fe54f74876d02beffa2c230" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:04:42.114169 20643 raft_consensus.cc:493] T 7be9efa6559648dbb5a0f7684c4542d1 P e61c3a8f61bb48f8a963c9480e53c168 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e5256d91808b47c195bc9b4dbd7f2b87)
W20260709 13:04:42.420694 20654 consensus_meta.cc:287] T 7f575b143b844aa096b50997dad3516a P e5256d91808b47c195bc9b4dbd7f2b87: Time spent flushing consensus metadata: real 0.672s	user 0.009s	sys 0.001s
I20260709 13:04:43.388432 20654 raft_consensus.cc:515] T 7f575b143b844aa096b50997dad3516a P e5256d91808b47c195bc9b4dbd7f2b87 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
W20260709 13:04:42.441991 20670 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.729s	user 0.015s	sys 0.014s
W20260709 13:04:43.392900 20670 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 2.685s	user 0.016s	sys 0.015s
I20260709 13:04:43.393544 20670 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.BulkChangeConfig from 127.0.0.1:49038 (request call id 7) took 4494 ms. Trace:
I20260709 13:04:43.393959 20772 raft_consensus.cc:493] T 21e14947d70440f19044d8f75c31e1f9 P e5256d91808b47c195bc9b4dbd7f2b87 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e61c3a8f61bb48f8a963c9480e53c168)
I20260709 13:04:43.394726 20772 raft_consensus.cc:515] T 21e14947d70440f19044d8f75c31e1f9 P e5256d91808b47c195bc9b4dbd7f2b87 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:42.416734 20684 leader_election.cc:290] T 96efeaaf1057492490e9a621f37e1a2d P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:04:42.397696 20665 raft_consensus.cc:515] T 833a2f0775ed407a94b8924ce50adb63 P e5256d91808b47c195bc9b4dbd7f2b87 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:04:43.021278 20721 raft_consensus.cc:493] T 2b74109013a140ada21feeef92d6f563 P e61c3a8f61bb48f8a963c9480e53c168 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e5256d91808b47c195bc9b4dbd7f2b87)
I20260709 13:04:43.023653 19560 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40428 (request call id 1354) took 2336 ms. Trace:
I20260709 13:04:43.024935 20723 raft_consensus.cc:493] T 76cb037fc9064d13b59a8969d897ce8c P e61c3a8f61bb48f8a963c9480e53c168 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e5256d91808b47c195bc9b4dbd7f2b87)
I20260709 13:04:43.026201 20724 raft_consensus.cc:493] T ece3db938bc649d4a40a51522ed5259c P e61c3a8f61bb48f8a963c9480e53c168 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e5256d91808b47c195bc9b4dbd7f2b87)
I20260709 13:04:43.029014 20725 raft_consensus.cc:493] T 14935b3ddf914369822e4a0547aaa355 P e61c3a8f61bb48f8a963c9480e53c168 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0473d2b2d01f4459b1e90fd12cc7840e)
I20260709 13:04:43.037642 20726 raft_consensus.cc:493] T f93ee515a9c14139bf566522ed8232f3 P e61c3a8f61bb48f8a963c9480e53c168 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e5256d91808b47c195bc9b4dbd7f2b87)
I20260709 13:04:43.040095 20728 raft_consensus.cc:493] T e381f1d6b8184797ad142de49be225a8 P e61c3a8f61bb48f8a963c9480e53c168 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:43.046749 19480 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58294 (request call id 1096) took 1450 ms. Trace:
I20260709 13:04:43.047750 20729 raft_consensus.cc:493] T d1e5873a19244c5ebbcd38e126796ee7 P e61c3a8f61bb48f8a963c9480e53c168 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e5256d91808b47c195bc9b4dbd7f2b87)
I20260709 13:04:43.050894 20730 raft_consensus.cc:493] T 85c494af21f9457a85da47b9bc70c1fd P 127766fc592545a4997f7790f50f6076 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e61c3a8f61bb48f8a963c9480e53c168)
I20260709 13:04:43.052572 19523 leader_election.cc:304] T 4af19371ea874c09a0a2147040835cbb P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e61c3a8f61bb48f8a963c9480e53c168; no voters: 127766fc592545a4997f7790f50f6076, e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:04:43.053488 19556 raft_consensus.cc:2468] T 2a16f7501e2444fb86d4e2778e734e02 P e61c3a8f61bb48f8a963c9480e53c168 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 127766fc592545a4997f7790f50f6076 in term 2.
W20260709 13:04:43.057601 19526 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.17.223.2:46257 timed out after 1.529s (SENT) [suppressed 1 similar messages]
I20260709 13:04:43.094841 20731 raft_consensus.cc:493] T b9f0d59553ad444883fcf5b5909f9798 P e61c3a8f61bb48f8a963c9480e53c168 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0473d2b2d01f4459b1e90fd12cc7840e)
I20260709 13:04:43.104053 20733 raft_consensus.cc:493] T ef32ce6fdd0e40d382c79974f30295c6 P e61c3a8f61bb48f8a963c9480e53c168 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0473d2b2d01f4459b1e90fd12cc7840e)
I20260709 13:04:43.104774 20732 raft_consensus.cc:493] T 1a61655d99124a29b486ba4a5b37faea P e61c3a8f61bb48f8a963c9480e53c168 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0473d2b2d01f4459b1e90fd12cc7840e)
I20260709 13:04:43.111692 19409 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.LeaderStepDown from 127.0.0.1:37312 (request call id 2) took 1990 ms. Trace:
I20260709 13:04:43.116676 20735 raft_consensus.cc:493] T 28af091831594f9d8e96482078cc7625 P e61c3a8f61bb48f8a963c9480e53c168 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e5256d91808b47c195bc9b4dbd7f2b87)
I20260709 13:04:43.117300 19555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e1f505cb0f1427bbd698ac889d80821" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:04:43.120503 19554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab43d85f64114d4ebf618930e43d9ed0" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:04:43.126928 19306 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:44698 (request call id 226) took 2829 ms. Trace:
I20260709 13:04:43.127758 19304 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:51954 (request call id 124) took 3159 ms. Trace:
I20260709 13:04:43.134580 20736 raft_consensus.cc:493] T 9962423cb4e54fcfa5de01daf68a86e7 P e5256d91808b47c195bc9b4dbd7f2b87 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0473d2b2d01f4459b1e90fd12cc7840e)
I20260709 13:04:43.137948 20737 consensus_queue.cc:1048] T 96efeaaf1057492490e9a621f37e1a2d P 127766fc592545a4997f7790f50f6076 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
W20260709 13:04:43.138708 19559 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40428 (request call id 1361) took 2401 ms (client timeout 1939 ms). Trace:
I20260709 13:04:43.137964 20734 consensus_queue.cc:1048] T 48824d5acfbc485ebf8c2d944e7202de P 127766fc592545a4997f7790f50f6076 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.002s
I20260709 13:04:43.144789 20716 raft_consensus.cc:493] T 48824d5acfbc485ebf8c2d944e7202de P 0473d2b2d01f4459b1e90fd12cc7840e [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:43.145466 20714 raft_consensus.cc:493] T 28af091831594f9d8e96482078cc7625 P 0473d2b2d01f4459b1e90fd12cc7840e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e5256d91808b47c195bc9b4dbd7f2b87)
I20260709 13:04:43.146011 20645 raft_consensus.cc:493] T bc225c93219c45538b53a1bd3d387e4d P 0473d2b2d01f4459b1e90fd12cc7840e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e5256d91808b47c195bc9b4dbd7f2b87)
I20260709 13:04:43.146340 20715 raft_consensus.cc:493] T ff9b0eddd810459b82d91c60777c10eb P 0473d2b2d01f4459b1e90fd12cc7840e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e5256d91808b47c195bc9b4dbd7f2b87)
I20260709 13:04:43.146920 20619 raft_consensus.cc:493] T ff75a1d4cb1f493db8f71ddc136ba9ab P e5256d91808b47c195bc9b4dbd7f2b87 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0473d2b2d01f4459b1e90fd12cc7840e)
I20260709 13:04:43.148324 19481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1efebf73c86e432baa55533136b6e12c" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:04:43.149287 20601 raft_consensus.cc:493] T f93ee515a9c14139bf566522ed8232f3 P 0473d2b2d01f4459b1e90fd12cc7840e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e5256d91808b47c195bc9b4dbd7f2b87)
W20260709 13:04:43.154256 20077 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.758s	user 0.001s	sys 0.016s
I20260709 13:04:43.156173 19558 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41504 (request call id 41) took 1377 ms. Trace:
W20260709 13:04:43.187214 20078 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.2:46257, user_credentials={real_user=slave}} blocked reactor thread for 48952.7us
I20260709 13:04:43.191677 20742 raft_consensus.cc:493] T ed7fdbcb96d14d418db9ca90a792588a P 0473d2b2d01f4459b1e90fd12cc7840e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e61c3a8f61bb48f8a963c9480e53c168)
I20260709 13:04:43.195793 20744 raft_consensus.cc:493] T 179fd671030940b4b4a4e24bcc4aba0a P e61c3a8f61bb48f8a963c9480e53c168 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e5256d91808b47c195bc9b4dbd7f2b87)
I20260709 13:04:43.196203 20739 raft_consensus.cc:493] T 775c229504194560ba9589bc2199b089 P 127766fc592545a4997f7790f50f6076 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e5256d91808b47c195bc9b4dbd7f2b87)
I20260709 13:04:43.198840 20751 raft_consensus.cc:493] T 309c3ca0ca4b4f3ba129752ea2cb293b P e61c3a8f61bb48f8a963c9480e53c168 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e5256d91808b47c195bc9b4dbd7f2b87)
I20260709 13:04:43.199015 19553 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41504 (request call id 38) took 1432 ms. Trace:
I20260709 13:04:43.216665 19449 leader_election.cc:304] T d1e5873a19244c5ebbcd38e126796ee7 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e; no voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:04:43.228415 20740 raft_consensus.cc:493] T 0afb57ae58a24a01850491d69f0213dd P 0473d2b2d01f4459b1e90fd12cc7840e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e61c3a8f61bb48f8a963c9480e53c168)
I20260709 13:04:43.202732 20746 raft_consensus.cc:493] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P e5256d91808b47c195bc9b4dbd7f2b87 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 127766fc592545a4997f7790f50f6076)
I20260709 13:04:43.232355 20758 raft_consensus.cc:493] T 217b5fae677b4971b3bbd2f357a1f7ff P e61c3a8f61bb48f8a963c9480e53c168 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e5256d91808b47c195bc9b4dbd7f2b87)
I20260709 13:04:43.233671 20759 raft_consensus.cc:493] T 62c6c134d3d24a1ab144dd9ee6bc3f64 P 127766fc592545a4997f7790f50f6076 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0473d2b2d01f4459b1e90fd12cc7840e)
I20260709 13:04:43.236862 20748 raft_consensus.cc:493] T ed7fdbcb96d14d418db9ca90a792588a P 127766fc592545a4997f7790f50f6076 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e61c3a8f61bb48f8a963c9480e53c168)
I20260709 13:04:43.253764 19483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "172b3dd13109415a955b71ac0e9d2234" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:04:43.255336 19485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa8650e71aa14778b3d73721fc50d9fc" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:04:43.256253 19484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edd7d470b5014c9489be7f41f64355c9" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:04:43.260509 19486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1b10566f45d4a7d9029858330e02d5b" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:04:43.262264 20752 raft_consensus.cc:493] T 2e36a9d6e29c4a7c860cf267efbd4c74 P 0473d2b2d01f4459b1e90fd12cc7840e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e61c3a8f61bb48f8a963c9480e53c168)
I20260709 13:04:43.266280 20661 raft_consensus.cc:493] T 86a6797bdfe94fa496c050ceae4bd0d9 P e61c3a8f61bb48f8a963c9480e53c168 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e5256d91808b47c195bc9b4dbd7f2b87)
I20260709 13:04:43.271194 20588 raft_consensus.cc:493] T 1dc5b3532fe54f74876d02beffa2c230 P e5256d91808b47c195bc9b4dbd7f2b87 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0473d2b2d01f4459b1e90fd12cc7840e)
I20260709 13:04:43.279309 19482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e1085d23e8347fbbd5bce7542f4b1f4" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:04:43.287899 20590 raft_consensus.cc:493] T fa731b585f684a7fb2d106c50f143b83 P 127766fc592545a4997f7790f50f6076 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e61c3a8f61bb48f8a963c9480e53c168)
I20260709 13:04:43.289708 19309 catalog_manager.cc:5697] T f1b10566f45d4a7d9029858330e02d5b P 0473d2b2d01f4459b1e90fd12cc7840e reported cstate change: term changed from 1 to 2, leader changed from e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1) to 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2). New cstate: current_term: 2 leader_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:43.299830 20763 raft_consensus.cc:493] T 70797e5783b5454ab0d0eea663e791e3 P 127766fc592545a4997f7790f50f6076 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e5256d91808b47c195bc9b4dbd7f2b87)
I20260709 13:04:43.311076 20753 raft_consensus.cc:493] T b9f0d59553ad444883fcf5b5909f9798 P e5256d91808b47c195bc9b4dbd7f2b87 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0473d2b2d01f4459b1e90fd12cc7840e)
I20260709 13:04:43.311991 20760 raft_consensus.cc:493] T 4509b76741dc428e9201c70c1658da13 P e61c3a8f61bb48f8a963c9480e53c168 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e5256d91808b47c195bc9b4dbd7f2b87)
I20260709 13:04:43.312727 20755 raft_consensus.cc:493] T b08304a0a02b42d7840c4e8ee9a6bd1a P e5256d91808b47c195bc9b4dbd7f2b87 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0473d2b2d01f4459b1e90fd12cc7840e)
I20260709 13:04:43.313303 20756 raft_consensus.cc:493] T ab43d85f64114d4ebf618930e43d9ed0 P e5256d91808b47c195bc9b4dbd7f2b87 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e61c3a8f61bb48f8a963c9480e53c168)
I20260709 13:04:43.314595 20754 raft_consensus.cc:493] T a08760e15aac4630a629431f56024dc8 P e5256d91808b47c195bc9b4dbd7f2b87 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e61c3a8f61bb48f8a963c9480e53c168)
I20260709 13:04:43.329430 20738 raft_consensus.cc:493] T 85c494af21f9457a85da47b9bc70c1fd P e5256d91808b47c195bc9b4dbd7f2b87 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e61c3a8f61bb48f8a963c9480e53c168)
I20260709 13:04:43.329805 20655 raft_consensus.cc:493] T 22196caba61445d3bec98a0aab3c337d P e5256d91808b47c195bc9b4dbd7f2b87 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e61c3a8f61bb48f8a963c9480e53c168)
I20260709 13:04:43.329820 20762 raft_consensus.cc:493] T 3e1f505cb0f1427bbd698ac889d80821 P e61c3a8f61bb48f8a963c9480e53c168 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e5256d91808b47c195bc9b4dbd7f2b87)
I20260709 13:04:43.337385 19407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a16f7501e2444fb86d4e2778e734e02" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:04:43.337857 19411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9962423cb4e54fcfa5de01daf68a86e7" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:04:43.338538 20765 raft_consensus.cc:493] T 6c5eebf646ad445a9d1b1adc319d7b16 P e61c3a8f61bb48f8a963c9480e53c168 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 127766fc592545a4997f7790f50f6076)
I20260709 13:04:43.341606 20764 raft_consensus.cc:493] T ff9b0eddd810459b82d91c60777c10eb P 127766fc592545a4997f7790f50f6076 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e5256d91808b47c195bc9b4dbd7f2b87)
I20260709 13:04:43.343523 20766 raft_consensus.cc:493] T 62c6c134d3d24a1ab144dd9ee6bc3f64 P e61c3a8f61bb48f8a963c9480e53c168 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0473d2b2d01f4459b1e90fd12cc7840e)
I20260709 13:04:43.344359 19410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ece3db938bc649d4a40a51522ed5259c" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:04:43.355521 19557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "179fd671030940b4b4a4e24bcc4aba0a" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:04:43.355860 19479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df751f992649444090e27965eb1af85d" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:04:43.367959 19478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9962423cb4e54fcfa5de01daf68a86e7" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:04:43.379328 19406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff75a1d4cb1f493db8f71ddc136ba9ab" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:04:43.384239 19403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc225c93219c45538b53a1bd3d387e4d" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:04:43.494650 19479 raft_consensus.cc:2468] T df751f992649444090e27965eb1af85d P 0473d2b2d01f4459b1e90fd12cc7840e [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 1.
I20260709 13:04:43.495227 20743 raft_consensus.cc:2749] T d1e5873a19244c5ebbcd38e126796ee7 P 0473d2b2d01f4459b1e90fd12cc7840e [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:04:43.495993 19479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f85fc4b527a48848e5faa083b604e36" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:04:43.403008 20654 leader_election.cc:290] T 7f575b143b844aa096b50997dad3516a P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 2 election: Requested vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
W20260709 13:04:43.496760 19449 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.1:40321, user_credentials={real_user=slave}} blocked reactor thread for 308633us
I20260709 13:04:43.497092 19481 raft_consensus.cc:2468] T 1efebf73c86e432baa55533136b6e12c P 0473d2b2d01f4459b1e90fd12cc7840e [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 127766fc592545a4997f7790f50f6076 in term 1.
I20260709 13:04:43.403420 20642 leader_election.cc:290] T 1f85fc4b527a48848e5faa083b604e36 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 2 election: Requested vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:04:43.498034 20665 leader_election.cc:290] T 833a2f0775ed407a94b8924ce50adb63 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 2 election: Requested vote from peers e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:04:43.385932 20643 raft_consensus.cc:515] T 7be9efa6559648dbb5a0f7684c4542d1 P e61c3a8f61bb48f8a963c9480e53c168 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:43.498186 19481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21e14947d70440f19044d8f75c31e1f9" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:04:43.498953 19481 raft_consensus.cc:2468] T 21e14947d70440f19044d8f75c31e1f9 P 0473d2b2d01f4459b1e90fd12cc7840e [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 1.
I20260709 13:04:43.499449 20721 raft_consensus.cc:515] T 2b74109013a140ada21feeef92d6f563 P e61c3a8f61bb48f8a963c9480e53c168 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:43.499779 20771 raft_consensus.cc:493] T 2e36a9d6e29c4a7c860cf267efbd4c74 P e5256d91808b47c195bc9b4dbd7f2b87 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e61c3a8f61bb48f8a963c9480e53c168)
I20260709 13:04:43.500378 20643 leader_election.cc:290] T 7be9efa6559648dbb5a0f7684c4542d1 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:04:43.393929 20670 rpcz_store.cc:276] 0709 13:04:38.899492 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:38.900061 (+   569us) service_pool.cc:224] Handling call
0709 13:04:39.277894 (+377833us) spinlock_profiling.cc:243] Waited 3.4 ms on lock 0x7b2c00032ed8. stack: 00007f4a79de9343 00007f4a79de9240 00007f4a797781d4 00007f4a834b6304 00007f4a834b6299 00007f4a7b801a11 00007f4a7b810a0a 00007f4a7b810693 00007f4a7b810631 00007f4a7cf433f1 00007f4a7ce7c9fe 00007f4a7cf03749 00007f4a7cf0476a 00007f4a7cf0391b 00007f4a7cf0f03c 00007f4a7cf0e6b3
0709 13:04:39.280615 (+  2721us) log.cc:844] Serialized 499 byte log entry
0709 13:04:39.292816 (+ 12201us) spinlock_profiling.cc:243] Waited 177 ms on lock 0x7b5400182754. stack: 00007f4a79de9343 00007f4a79de9240 00007f4a797781d4 00007f4a834b6304 00007f4a834b6299 00007f4a7ce71571 00007f4a7cf0e735 00007f4a81eced29 00007f4a7b44d1d4 00007f4a7b44d162 00007f4a7b44d091 00007f4a7b44d00c 00007f4a7b44c2c2 00007f4a7b24348c 00007f4a7b2428c6 00007f4a7b24226f
0709 13:04:39.425137 (+132321us) spinlock_profiling.cc:243] Waited 26.6 ms on lock 0x7b4c003289c0. stack: 00007f4a79de9343 00007f4a79de9240 00007f4a797781d4 00007f4a834b6304 00007f4a834b6299 00007f4a7b1d4a20 00007f4a7b1e5a29 00007f4a7b1e613f 00007f4a7b1aa2ab 00007f4a7b1d7f3c 00007f4a7b1d83fe 00007f4a7b46550b 00007f4a7ce64381 00007f4a7ce6226b 00007f4a7ce68d53 00007f4a7ce68cd9
0709 13:04:43.393401 (+3968264us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":289,"raft.run_cpu_time_us":3437,"raft.run_wall_time_us":128975,"spinlock_wait_cycles":476408320}
I20260709 13:04:43.500952 20723 raft_consensus.cc:515] T 76cb037fc9064d13b59a8969d897ce8c P e61c3a8f61bb48f8a963c9480e53c168 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:43.501693 20721 leader_election.cc:290] T 2b74109013a140ada21feeef92d6f563 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:04:43.502439 20738 raft_consensus.cc:515] T 85c494af21f9457a85da47b9bc70c1fd P e5256d91808b47c195bc9b4dbd7f2b87 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:04:43.473431 20729 raft_consensus.cc:515] T d1e5873a19244c5ebbcd38e126796ee7 P e61c3a8f61bb48f8a963c9480e53c168 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:43.503520 20723 leader_election.cc:290] T 76cb037fc9064d13b59a8969d897ce8c P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:04:43.400980 20772 leader_election.cc:290] T 21e14947d70440f19044d8f75c31e1f9 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:04:43.405179 19404 raft_consensus.cc:1240] T 7f575b143b844aa096b50997dad3516a P e5256d91808b47c195bc9b4dbd7f2b87 [term 2 FOLLOWER]: Rejecting Update request from peer e61c3a8f61bb48f8a963c9480e53c168 for earlier term 1. Current term is 2. Ops: []
I20260709 13:04:43.495666 20724 raft_consensus.cc:515] T ece3db938bc649d4a40a51522ed5259c P e61c3a8f61bb48f8a963c9480e53c168 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:04:43.498688 20645 raft_consensus.cc:515] T bc225c93219c45538b53a1bd3d387e4d P 0473d2b2d01f4459b1e90fd12cc7840e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:43.599437 19556 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41504 (request call id 42) took 1431 ms. Trace:
I20260709 13:04:43.601810 19377 leader_election.cc:304] T df751f992649444090e27965eb1af85d P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87; no voters: 
I20260709 13:04:43.470378 19484 raft_consensus.cc:2468] T edd7d470b5014c9489be7f41f64355c9 P 0473d2b2d01f4459b1e90fd12cc7840e [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 1.
W20260709 13:04:43.471701 19559 rpcz_store.cc:269] 0709 13:04:40.737392 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:43.138362 (+2400970us) service_pool.cc:211] Skipping call since client already timed out
0709 13:04:43.138500 (+   138us) inbound_call.cc:177] Queueing failure response
Metrics: {}
I20260709 13:04:43.498615 19449 leader_election.cc:304] T 2b74109013a140ada21feeef92d6f563 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e; no voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168
W20260709 13:04:43.462733 19340 debug-util.cc:398] Leaking SignalData structure 0x7b0800177e20 after lost signal to thread 18300
I20260709 13:04:43.496228 20078 leader_election.cc:304] T 0afb57ae58a24a01850491d69f0213dd P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 127766fc592545a4997f7790f50f6076; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:04:43.610944 19377 leader_election.cc:304] T 21e14947d70440f19044d8f75c31e1f9 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87; no voters: 
I20260709 13:04:43.413853 20745 raft_consensus.cc:493] T 1a61655d99124a29b486ba4a5b37faea P e5256d91808b47c195bc9b4dbd7f2b87 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0473d2b2d01f4459b1e90fd12cc7840e)
W20260709 13:04:43.612522 20077 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.216s	user 0.008s	sys 0.021s
I20260709 13:04:43.612303 20727 consensus_queue.cc:1048] T 96efeaaf1057492490e9a621f37e1a2d P 127766fc592545a4997f7790f50f6076 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.014s
I20260709 13:04:43.612964 20670 raft_consensus.cc:2804] T df751f992649444090e27965eb1af85d P e5256d91808b47c195bc9b4dbd7f2b87 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:04:43.422519 20749 raft_consensus.cc:493] T 14935b3ddf914369822e4a0547aaa355 P e5256d91808b47c195bc9b4dbd7f2b87 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0473d2b2d01f4459b1e90fd12cc7840e)
I20260709 13:04:43.470880 19560 rpcz_store.cc:276] 0709 13:04:40.686954 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:40.687075 (+   121us) service_pool.cc:224] Handling call
0709 13:04:40.687316 (+   241us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:04:40.917284 (+229968us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:04:40.917326 (+    42us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:04:40.917378 (+    52us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:04:40.917420 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:43.023078 (+2105658us) spinlock_profiling.cc:243] Waited 230 ms on lock 0x7b5400342954. stack: 00007f4a79de9343 00007f4a79de9240 00007f4a797781d4 00007f4a834b6304 00007f4a834b6299 00007f4a7ce71571 00007f4a7cf08e01 00007f4a7cf0783e 00007f4a81ecc419 00007f4a7b443bd4 00007f4a7b443b62 00007f4a7b443a91 00007f4a7b443a0c 00007f4a7b442cc2 00007f4a7b24348c 00007f4a7b2428c6
0709 13:04:43.023180 (+   102us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:43.023454 (+   274us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":528451456}
I20260709 13:04:43.611351 19556 rpcz_store.cc:276] 0709 13:04:42.039073 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:42.070783 (+ 31710us) service_pool.cc:224] Handling call
0709 13:04:43.469892 (+1399109us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:04:43.614880 19482 raft_consensus.cc:2468] T 0e1085d23e8347fbbd5bce7542f4b1f4 P 0473d2b2d01f4459b1e90fd12cc7840e [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 127766fc592545a4997f7790f50f6076 in term 1.
I20260709 13:04:43.625118 20670 raft_consensus.cc:493] T df751f992649444090e27965eb1af85d P e5256d91808b47c195bc9b4dbd7f2b87 [term 1 FOLLOWER]: Starting leader election (detected failure of leader e61c3a8f61bb48f8a963c9480e53c168)
I20260709 13:04:43.496244 20770 raft_consensus.cc:493] T 0cdf56e38bbc453d9438d359e5a69955 P e5256d91808b47c195bc9b4dbd7f2b87 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:43.599179 19481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef32ce6fdd0e40d382c79974f30295c6" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
W20260709 13:04:43.651886 19523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.1:40321, user_credentials={real_user=slave}} blocked reactor thread for 599362us
W20260709 13:04:43.654027 20078 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.2:46257, user_credentials={real_user=slave}} blocked reactor thread for 157858us
W20260709 13:04:43.624792 19526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.2:46257, user_credentials={real_user=slave}} blocked reactor thread for 567324us
I20260709 13:04:43.625125 19479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f575b143b844aa096b50997dad3516a" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
W20260709 13:04:43.735985 19377 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.2:46257, user_credentials={real_user=slave}} blocked reactor thread for 125092us
I20260709 13:04:43.619268 20665 raft_consensus.cc:493] T 14efcc79969f41babe5529c22d59156d P e5256d91808b47c195bc9b4dbd7f2b87 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 127766fc592545a4997f7790f50f6076)
W20260709 13:04:43.734160 19450 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.3:36891, user_credentials={real_user=slave}} blocked reactor thread for 79859.9us
I20260709 13:04:43.604712 19409 rpcz_store.cc:276] 0709 13:04:41.121267 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:41.121419 (+   152us) service_pool.cc:224] Handling call
0709 13:04:43.110294 (+1988875us) spinlock_profiling.cc:243] Waited 9.73 ms on lock 0x7b54002ac4a0. stack: 00007f4a79de9343 00007f4a79de9240 00007f4a797781d4 00007f4a834b6304 00007f4a834b6299 00007f4a7ce71571 00007f4a7ce85520 00007f4a7cf02652 00007f4a81ed060a 00007f4a7b4567d4 00007f4a7b456762 00007f4a7b456691 00007f4a7b45660c 00007f4a7b4558c2 00007f4a7b24348c 00007f4a7b2428c6
0709 13:04:43.111449 (+  1155us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":22386432}
I20260709 13:04:43.600845 20643 raft_consensus.cc:2749] T 4af19371ea874c09a0a2147040835cbb P e61c3a8f61bb48f8a963c9480e53c168 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:04:43.738225 19479 raft_consensus.cc:3060] T 7f575b143b844aa096b50997dad3516a P 0473d2b2d01f4459b1e90fd12cc7840e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:43.504814 19558 rpcz_store.cc:276] 0709 13:04:41.778930 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:41.780058 (+  1128us) service_pool.cc:224] Handling call
0709 13:04:41.780418 (+   360us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:04:41.780966 (+   548us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:04:41.780998 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:04:41.781550 (+   552us) log.cc:844] Serialized 26 byte log entry
0709 13:04:41.804177 (+ 22627us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:04:41.804217 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:41.804309 (+    92us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:04:43.155910 (+1351601us) raft_consensus.cc:1685] finished
0709 13:04:43.155932 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:43.156090 (+   158us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":127,"raft.run_cpu_time_us":130,"raft.run_wall_time_us":130,"thread_start_us":22202,"threads_started":1,"wal-append.queue_time_us":630438,"wal-append.run_cpu_time_us":1903,"wal-append.run_wall_time_us":1001926}
W20260709 13:04:43.771351 19449 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.1:40321, user_credentials={real_user=slave}} blocked reactor thread for 272796us
I20260709 13:04:43.505084 20730 raft_consensus.cc:515] T 85c494af21f9457a85da47b9bc70c1fd P 127766fc592545a4997f7790f50f6076 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:04:43.619143 20661 raft_consensus.cc:515] T 86a6797bdfe94fa496c050ceae4bd0d9 P e61c3a8f61bb48f8a963c9480e53c168 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:43.613723 20755 raft_consensus.cc:515] T b08304a0a02b42d7840c4e8ee9a6bd1a P e5256d91808b47c195bc9b4dbd7f2b87 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:43.495282 20732 raft_consensus.cc:515] T 1a61655d99124a29b486ba4a5b37faea P e61c3a8f61bb48f8a963c9480e53c168 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:43.739727 20601 raft_consensus.cc:515] T f93ee515a9c14139bf566522ed8232f3 P 0473d2b2d01f4459b1e90fd12cc7840e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:43.614492 20752 raft_consensus.cc:515] T 2e36a9d6e29c4a7c860cf267efbd4c74 P 0473d2b2d01f4459b1e90fd12cc7840e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:43.621743 20760 raft_consensus.cc:515] T 4509b76741dc428e9201c70c1658da13 P e61c3a8f61bb48f8a963c9480e53c168 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:43.504576 20763 raft_consensus.cc:515] T 70797e5783b5454ab0d0eea663e791e3 P 127766fc592545a4997f7790f50f6076 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:04:43.504309 20753 raft_consensus.cc:515] T b9f0d59553ad444883fcf5b5909f9798 P e5256d91808b47c195bc9b4dbd7f2b87 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:43.610627 20739 raft_consensus.cc:515] T 775c229504194560ba9589bc2199b089 P 127766fc592545a4997f7790f50f6076 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:04:43.614650 20748 raft_consensus.cc:515] T ed7fdbcb96d14d418db9ca90a792588a P 127766fc592545a4997f7790f50f6076 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:04:43.625684 20759 raft_consensus.cc:515] T 62c6c134d3d24a1ab144dd9ee6bc3f64 P 127766fc592545a4997f7790f50f6076 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:04:43.650517 20749 raft_consensus.cc:515] T 14935b3ddf914369822e4a0547aaa355 P e5256d91808b47c195bc9b4dbd7f2b87 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:44.155843 20078 leader_election.cc:304] T 1efebf73c86e432baa55533136b6e12c P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, 127766fc592545a4997f7790f50f6076; no voters: 
W20260709 13:04:43.650765 19340 debug-util.cc:398] Leaking SignalData structure 0x7b0800177cc0 after lost signal to thread 18303
W20260709 13:04:43.819675 19526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.2:46257, user_credentials={real_user=slave}} blocked reactor thread for 81732.4us
W20260709 13:04:43.910562 19377 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.2:46257, user_credentials={real_user=slave}} blocked reactor thread for 91034.4us
I20260709 13:04:43.911170 19556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1b10566f45d4a7d9029858330e02d5b" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:04:43.500512 20771 raft_consensus.cc:515] T 2e36a9d6e29c4a7c860cf267efbd4c74 P e5256d91808b47c195bc9b4dbd7f2b87 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:44.165299 19405 raft_consensus.cc:1240] T 833a2f0775ed407a94b8924ce50adb63 P e5256d91808b47c195bc9b4dbd7f2b87 [term 2 FOLLOWER]: Rejecting Update request from peer e61c3a8f61bb48f8a963c9480e53c168 for earlier term 1. Current term is 2. Ops: []
W20260709 13:04:44.020828 19523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.1:40321, user_credentials={real_user=slave}} blocked reactor thread for 202144us
I20260709 13:04:43.614176 20733 raft_consensus.cc:515] T ef32ce6fdd0e40d382c79974f30295c6 P e61c3a8f61bb48f8a963c9480e53c168 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:43.655033 20735 raft_consensus.cc:515] T 28af091831594f9d8e96482078cc7625 P e61c3a8f61bb48f8a963c9480e53c168 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:44.132300 19409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46c5bfeecc314717bffe987e6844b6d0" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:04:43.496762 20715 raft_consensus.cc:515] T ff9b0eddd810459b82d91c60777c10eb P 0473d2b2d01f4459b1e90fd12cc7840e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:04:43.655097 20722 raft_consensus.cc:493] T 2a16f7501e2444fb86d4e2778e734e02 P e61c3a8f61bb48f8a963c9480e53c168 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e5256d91808b47c195bc9b4dbd7f2b87)
I20260709 13:04:43.655229 20588 raft_consensus.cc:515] T 1dc5b3532fe54f74876d02beffa2c230 P e5256d91808b47c195bc9b4dbd7f2b87 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:44.208570 19377 leader_election.cc:304] T 172b3dd13109415a955b71ac0e9d2234 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, 127766fc592545a4997f7790f50f6076
I20260709 13:04:43.914180 19560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86a6797bdfe94fa496c050ceae4bd0d9" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:04:43.767884 20670 raft_consensus.cc:3060] T df751f992649444090e27965eb1af85d P e5256d91808b47c195bc9b4dbd7f2b87 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:44.142396 20734 raft_consensus.cc:493] T 5ec1c4ce15e04c7e8c283a62179f2a64 P 127766fc592545a4997f7790f50f6076 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e5256d91808b47c195bc9b4dbd7f2b87)
I20260709 13:04:43.740875 20621 raft_consensus.cc:2749] T 2b74109013a140ada21feeef92d6f563 P 0473d2b2d01f4459b1e90fd12cc7840e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:04:44.212827 19558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df751f992649444090e27965eb1af85d" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:04:43.852057 19559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e1f505cb0f1427bbd698ac889d80821" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:04:44.184998 20729 leader_election.cc:290] T d1e5873a19244c5ebbcd38e126796ee7 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:04:44.222097 19556 raft_consensus.cc:2468] T f1b10566f45d4a7d9029858330e02d5b P e61c3a8f61bb48f8a963c9480e53c168 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 2.
I20260709 13:04:43.904168 20595 raft_consensus.cc:493] T 65d8cb8d6ec64f459d5a47cefab10acf P 127766fc592545a4997f7790f50f6076 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e61c3a8f61bb48f8a963c9480e53c168)
I20260709 13:04:44.143535 20776 raft_consensus.cc:2804] T 21e14947d70440f19044d8f75c31e1f9 P e5256d91808b47c195bc9b4dbd7f2b87 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:04:44.225596 20763 leader_election.cc:290] T 70797e5783b5454ab0d0eea663e791e3 P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:04:44.219309 19560 raft_consensus.cc:2468] T 86a6797bdfe94fa496c050ceae4bd0d9 P e61c3a8f61bb48f8a963c9480e53c168 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 1.
I20260709 13:04:44.142855 20767 raft_consensus.cc:2749] T 0afb57ae58a24a01850491d69f0213dd P 127766fc592545a4997f7790f50f6076 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:04:43.652868 20590 raft_consensus.cc:515] T fa731b585f684a7fb2d106c50f143b83 P 127766fc592545a4997f7790f50f6076 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
W20260709 13:04:44.103449 19351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.BulkChangeConfig -> {remote=127.17.223.1:40321, user_credentials={real_user=slave}} blocked reactor thread for 91672.3us
I20260709 13:04:43.736740 20740 raft_consensus.cc:515] T 0afb57ae58a24a01850491d69f0213dd P 0473d2b2d01f4459b1e90fd12cc7840e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:04:43.654906 20736 raft_consensus.cc:515] T 9962423cb4e54fcfa5de01daf68a86e7 P e5256d91808b47c195bc9b4dbd7f2b87 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:04:43.650642 20731 raft_consensus.cc:515] T b9f0d59553ad444883fcf5b5909f9798 P e61c3a8f61bb48f8a963c9480e53c168 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:44.104791 20665 raft_consensus.cc:515] T 14efcc79969f41babe5529c22d59156d P e5256d91808b47c195bc9b4dbd7f2b87 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:04:44.231618 19377 leader_election.cc:304] T edd7d470b5014c9489be7f41f64355c9 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87; no voters: 
I20260709 13:04:43.655912 20655 raft_consensus.cc:515] T 22196caba61445d3bec98a0aab3c337d P e5256d91808b47c195bc9b4dbd7f2b87 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:44.262017 19560 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40428 (request call id 1374) took 1129 ms. Trace:
I20260709 13:04:43.913378 20769 raft_consensus.cc:493] T 172b3dd13109415a955b71ac0e9d2234 P 127766fc592545a4997f7790f50f6076 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0473d2b2d01f4459b1e90fd12cc7840e)
I20260709 13:04:43.494863 19304 rpcz_store.cc:276] 0709 13:04:39.968110 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:39.968291 (+   181us) service_pool.cc:224] Handling call
0709 13:04:40.086111 (+117820us) spinlock_profiling.cc:243] Waited 106 ms on lock 0x7b54003fb6d4. stack: 00007f4a79de9343 00007f4a79de9240 00007f4a797781d4 00007f4a834b6304 00007f4a834b6299 00007f4a7ce72090 00007f4a7cf10f3a 00007f4a82cc71cc 00007f4a82dc537e 00007f4a812862a4 00007f4a81286232 00007f4a81286161 00007f4a812860dc 00007f4a81285392 00007f4a7b24348c 00007f4a7b2428c6
0709 13:04:43.127566 (+3041455us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:04:40.961874 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:04:40.980425 (+ 18551us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:04:40.980476 (+    51us) write_op.cc:435] Acquired schema lock
0709 13:04:40.980505 (+    29us) tablet.cc:662] Decoding operations
0709 13:04:40.980913 (+   408us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:04:40.980985 (+    72us) write_op.cc:641] Partition lock acquired for write op
0709 13:04:40.981025 (+    40us) tablet.cc:685] Acquiring locks for 1 operations
0709 13:04:40.981263 (+   238us) tablet.cc:701] Row locks acquired
0709 13:04:40.981282 (+    19us) write_op.cc:260] PREPARE: finished
0709 13:04:40.981458 (+   176us) write_op.cc:270] Start()
0709 13:04:40.981584 (+   126us) write_op.cc:276] Timestamp: P: 1783602280981401 usec, L: 0
0709 13:04:40.981612 (+    28us) op_driver.cc:348] REPLICATION: starting
0709 13:04:40.982450 (+   838us) log.cc:844] Serialized 529 byte log entry
0709 13:04:41.319701 (+337251us) op_driver.cc:464] REPLICATION: finished
0709 13:04:41.403571 (+ 83870us) write_op.cc:301] APPLY: starting
0709 13:04:41.403682 (+   111us) tablet.cc:1367] starting BulkCheckPresence
0709 13:04:41.403812 (+   130us) tablet.cc:1370] finished BulkCheckPresence
0709 13:04:41.403968 (+   156us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:04:41.404273 (+   305us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:04:41.405062 (+   789us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0709 13:04:41.405133 (+    71us) write_op.cc:312] APPLY: finished
0709 13:04:41.405436 (+   303us) log.cc:844] Serialized 23 byte log entry
0709 13:04:41.407200 (+  1764us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:04:41.407302 (+   102us) write_op.cc:454] Released schema lock
0709 13:04:41.407355 (+    53us) write_op.cc:341] FINISH: Updating metrics
0709 13:04:41.443981 (+ 36626us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:04:41.444026 (+    45us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":1357567,"reported_tablets":1,"spinlock_wait_cycles":243558656,"child_traces":[["op",{"apply.queue_time_us":80925,"apply.run_cpu_time_us":2845,"apply.run_wall_time_us":40321,"num_ops":1,"prepare.queue_time_us":530750,"prepare.run_cpu_time_us":3339,"prepare.run_wall_time_us":69213,"replication_time_us":284995,"thread_start_us":480685,"threads_started":2}]]}
I20260709 13:04:43.740268 20619 raft_consensus.cc:515] T ff75a1d4cb1f493db8f71ddc136ba9ab P e5256d91808b47c195bc9b4dbd7f2b87 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:43.472311 19306 rpcz_store.cc:276] 0709 13:04:40.297188 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:40.297363 (+   175us) service_pool.cc:224] Handling call
0709 13:04:43.126611 (+2829248us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:04:40.984755 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:04:40.998500 (+ 13745us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:04:41.015338 (+ 16838us) write_op.cc:435] Acquired schema lock
0709 13:04:41.027135 (+ 11797us) tablet.cc:662] Decoding operations
0709 13:04:41.103731 (+ 76596us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:04:41.107315 (+  3584us) write_op.cc:641] Partition lock acquired for write op
0709 13:04:41.108596 (+  1281us) tablet.cc:685] Acquiring locks for 1 operations
0709 13:04:41.121709 (+ 13113us) tablet.cc:701] Row locks acquired
0709 13:04:41.123298 (+  1589us) write_op.cc:260] PREPARE: finished
0709 13:04:41.129451 (+  6153us) write_op.cc:270] Start()
0709 13:04:41.133285 (+  3834us) write_op.cc:276] Timestamp: P: 1783602281128516 usec, L: 0
0709 13:04:41.134017 (+   732us) op_driver.cc:348] REPLICATION: starting
0709 13:04:41.257358 (+123341us) log.cc:844] Serialized 538 byte log entry
0709 13:04:41.604759 (+347401us) op_driver.cc:464] REPLICATION: finished
0709 13:04:41.609830 (+  5071us) write_op.cc:301] APPLY: starting
0709 13:04:41.610022 (+   192us) tablet.cc:1367] starting BulkCheckPresence
0709 13:04:41.611051 (+  1029us) tablet.cc:1370] finished BulkCheckPresence
0709 13:04:41.611228 (+   177us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:04:41.611616 (+   388us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:04:41.611938 (+   322us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0709 13:04:41.612069 (+   131us) write_op.cc:312] APPLY: finished
0709 13:04:41.612520 (+   451us) log.cc:844] Serialized 23 byte log entry
0709 13:04:41.612792 (+   272us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:04:41.612978 (+   186us) write_op.cc:454] Released schema lock
0709 13:04:41.613035 (+    57us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"reported_tablets":3,"child_traces":[["op",{"apply.queue_time_us":4623,"apply.run_cpu_time_us":3059,"apply.run_wall_time_us":3792,"num_ops":1,"prepare.queue_time_us":538840,"prepare.run_cpu_time_us":3931,"prepare.run_wall_time_us":277401,"replication_time_us":470352}]]}
I20260709 13:04:44.225383 20755 leader_election.cc:290] T b08304a0a02b42d7840c4e8ee9a6bd1a P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:04:44.269532 20739 leader_election.cc:290] T 775c229504194560ba9589bc2199b089 P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:04:44.271134 20715 leader_election.cc:290] T ff9b0eddd810459b82d91c60777c10eb P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:04:43.692322 20742 raft_consensus.cc:515] T ed7fdbcb96d14d418db9ca90a792588a P 0473d2b2d01f4459b1e90fd12cc7840e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:04:43.736462 20764 raft_consensus.cc:515] T ff9b0eddd810459b82d91c60777c10eb P 127766fc592545a4997f7790f50f6076 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:04:44.227541 20732 leader_election.cc:290] T 1a61655d99124a29b486ba4a5b37faea P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
W20260709 13:04:44.274464 20078 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.2:46257, user_credentials={real_user=slave}} blocked reactor thread for 118685us
I20260709 13:04:44.274065 20763 raft_consensus.cc:2804] T 1efebf73c86e432baa55533136b6e12c P 127766fc592545a4997f7790f50f6076 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:04:44.324625 19560 rpcz_store.cc:276] 0709 13:04:43.123057 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:43.772341 (+649284us) service_pool.cc:224] Handling call
0709 13:04:44.252396 (+480055us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:04:44.325958 19556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f575b143b844aa096b50997dad3516a" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
W20260709 13:04:44.298408 19523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.1:40321, user_credentials={real_user=slave}} blocked reactor thread for 83168.4us
I20260709 13:04:44.227909 20643 raft_consensus.cc:493] T fa8650e71aa14778b3d73721fc50d9fc P e61c3a8f61bb48f8a963c9480e53c168 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0473d2b2d01f4459b1e90fd12cc7840e)
I20260709 13:04:44.143998 20745 raft_consensus.cc:515] T 1a61655d99124a29b486ba4a5b37faea P e5256d91808b47c195bc9b4dbd7f2b87 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:44.322710 19409 raft_consensus.cc:2468] T 46c5bfeecc314717bffe987e6844b6d0 P e5256d91808b47c195bc9b4dbd7f2b87 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 2.
W20260709 13:04:44.324788 19377 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.2:46257, user_credentials={real_user=slave}} blocked reactor thread for 93249.1us
I20260709 13:04:44.256038 20772 raft_consensus.cc:2749] T 172b3dd13109415a955b71ac0e9d2234 P e5256d91808b47c195bc9b4dbd7f2b87 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:04:44.227567 20760 leader_election.cc:290] T 4509b76741dc428e9201c70c1658da13 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:04:43.739821 20754 raft_consensus.cc:515] T a08760e15aac4630a629431f56024dc8 P e5256d91808b47c195bc9b4dbd7f2b87 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:43.737037 20762 raft_consensus.cc:515] T 3e1f505cb0f1427bbd698ac889d80821 P e61c3a8f61bb48f8a963c9480e53c168 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:44.331014 19558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40e1e16737a842ee936002830f36882e" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:04:44.276257 19402 raft_consensus.cc:2468] T 1dc5b3532fe54f74876d02beffa2c230 P e5256d91808b47c195bc9b4dbd7f2b87 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 1.
W20260709 13:04:44.257292 19340 debug-util.cc:398] Leaking SignalData structure 0x7b080017b160 after lost signal to thread 19343
I20260709 13:04:44.267302 19421 tablet_copy_source_session.cc:215] T 309c3ca0ca4b4f3ba129752ea2cb293b P e5256d91808b47c195bc9b4dbd7f2b87: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:04:44.265372 20776 raft_consensus.cc:493] T 21e14947d70440f19044d8f75c31e1f9 P e5256d91808b47c195bc9b4dbd7f2b87 [term 1 FOLLOWER]: Starting leader election (detected failure of leader e61c3a8f61bb48f8a963c9480e53c168)
I20260709 13:04:44.373947 19560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76cb037fc9064d13b59a8969d897ce8c" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:04:44.275784 19486 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58294 (request call id 1115) took 1017 ms. Trace:
I20260709 13:04:43.623991 20744 raft_consensus.cc:515] T 179fd671030940b4b4a4e24bcc4aba0a P e61c3a8f61bb48f8a963c9480e53c168 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:44.338853 19411 raft_consensus.cc:2468] T 9962423cb4e54fcfa5de01daf68a86e7 P e5256d91808b47c195bc9b4dbd7f2b87 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 127766fc592545a4997f7790f50f6076 in term 1.
W20260709 13:04:44.331952 20768 log.cc:927] Time spent T e381f1d6b8184797ad142de49be225a8 P 0473d2b2d01f4459b1e90fd12cc7840e: Append to log took a long time: real 0.069s	user 0.000s	sys 0.000s
I20260709 13:04:44.350183 19559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "217b5fae677b4971b3bbd2f357a1f7ff" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:04:43.651371 20725 raft_consensus.cc:515] T 14935b3ddf914369822e4a0547aaa355 P e61c3a8f61bb48f8a963c9480e53c168 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:43.995627 20726 raft_consensus.cc:515] T f93ee515a9c14139bf566522ed8232f3 P e61c3a8f61bb48f8a963c9480e53c168 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:44.331079 20642 raft_consensus.cc:2804] T edd7d470b5014c9489be7f41f64355c9 P e5256d91808b47c195bc9b4dbd7f2b87 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:04:44.364387 19406 raft_consensus.cc:2468] T ff75a1d4cb1f493db8f71ddc136ba9ab P e5256d91808b47c195bc9b4dbd7f2b87 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 1.
I20260709 13:04:44.246078 20759 leader_election.cc:290] T 62c6c134d3d24a1ab144dd9ee6bc3f64 P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:04:43.818862 20751 raft_consensus.cc:515] T 309c3ca0ca4b4f3ba129752ea2cb293b P e61c3a8f61bb48f8a963c9480e53c168 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } attrs { replace: true } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: NON_VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: true } }
I20260709 13:04:43.652110 20765 raft_consensus.cc:515] T 6c5eebf646ad445a9d1b1adc319d7b16 P e61c3a8f61bb48f8a963c9480e53c168 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:04:43.771937 20746 raft_consensus.cc:515] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P e5256d91808b47c195bc9b4dbd7f2b87 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:04:44.373811 19558 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40428 (request call id 1375) took 1250 ms. Trace:
W20260709 13:04:44.323909 19526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.2:46257, user_credentials={real_user=slave}} blocked reactor thread for 59952.9us
I20260709 13:04:44.374531 19560 raft_consensus.cc:2468] T 76cb037fc9064d13b59a8969d897ce8c P e61c3a8f61bb48f8a963c9480e53c168 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 1.
I20260709 13:04:44.343266 20763 raft_consensus.cc:493] T 1efebf73c86e432baa55533136b6e12c P 127766fc592545a4997f7790f50f6076 [term 1 FOLLOWER]: Starting leader election (detected failure of leader e61c3a8f61bb48f8a963c9480e53c168)
I20260709 13:04:44.373680 19449 leader_election.cc:304] T 5ec1c4ce15e04c7e8c283a62179f2a64 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e; no voters: 127766fc592545a4997f7790f50f6076, e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:04:44.376978 19555 raft_consensus.cc:2468] T 3e1f505cb0f1427bbd698ac889d80821 P e61c3a8f61bb48f8a963c9480e53c168 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 1.
I20260709 13:04:43.650274 20766 raft_consensus.cc:515] T 62c6c134d3d24a1ab144dd9ee6bc3f64 P e61c3a8f61bb48f8a963c9480e53c168 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:04:44.365329 20732 raft_consensus.cc:493] T 70797e5783b5454ab0d0eea663e791e3 P e61c3a8f61bb48f8a963c9480e53c168 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e5256d91808b47c195bc9b4dbd7f2b87)
I20260709 13:04:44.265125 20734 raft_consensus.cc:515] T 5ec1c4ce15e04c7e8c283a62179f2a64 P 127766fc592545a4997f7790f50f6076 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:04:44.274632 20722 raft_consensus.cc:515] T 2a16f7501e2444fb86d4e2778e734e02 P e61c3a8f61bb48f8a963c9480e53c168 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:04:44.390558 20732 raft_consensus.cc:515] T 70797e5783b5454ab0d0eea663e791e3 P e61c3a8f61bb48f8a963c9480e53c168 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:04:43.739553 20714 raft_consensus.cc:515] T 28af091831594f9d8e96482078cc7625 P 0473d2b2d01f4459b1e90fd12cc7840e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:44.365986 20721 raft_consensus.cc:493] T 48824d5acfbc485ebf8c2d944e7202de P e61c3a8f61bb48f8a963c9480e53c168 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 127766fc592545a4997f7790f50f6076)
I20260709 13:04:43.914467 20728 raft_consensus.cc:515] T e381f1d6b8184797ad142de49be225a8 P e61c3a8f61bb48f8a963c9480e53c168 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:44.388127 19558 rpcz_store.cc:276] 0709 13:04:43.123311 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:44.282508 (+1159197us) service_pool.cc:224] Handling call
0709 13:04:44.373753 (+ 91245us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:04:43.766968 20716 raft_consensus.cc:515] T 48824d5acfbc485ebf8c2d944e7202de P 0473d2b2d01f4459b1e90fd12cc7840e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:04:43.819025 20758 raft_consensus.cc:515] T 217b5fae677b4971b3bbd2f357a1f7ff P e61c3a8f61bb48f8a963c9480e53c168 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:43.627758 20756 raft_consensus.cc:515] T ab43d85f64114d4ebf618930e43d9ed0 P e5256d91808b47c195bc9b4dbd7f2b87 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } attrs { replace: true } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: NON_VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: true } }
I20260709 13:04:44.261806 20595 raft_consensus.cc:515] T 65d8cb8d6ec64f459d5a47cefab10acf P 127766fc592545a4997f7790f50f6076 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:04:44.375200 20776 raft_consensus.cc:3060] T 21e14947d70440f19044d8f75c31e1f9 P e5256d91808b47c195bc9b4dbd7f2b87 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:44.377333 20724 leader_election.cc:290] T ece3db938bc649d4a40a51522ed5259c P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:04:44.372792 20643 raft_consensus.cc:515] T fa8650e71aa14778b3d73721fc50d9fc P e61c3a8f61bb48f8a963c9480e53c168 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:44.391556 19560 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40428 (request call id 1373) took 1265 ms. Trace:
I20260709 13:04:44.390902 19421 rpcz_store.cc:275] Call kudu.tserver.TabletCopyService.BeginTabletCopySession from 127.0.0.1:49050 (request call id 36) took 2655 ms. Trace:
I20260709 13:04:44.391958 20763 raft_consensus.cc:3060] T 1efebf73c86e432baa55533136b6e12c P 127766fc592545a4997f7790f50f6076 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:44.389981 19523 leader_election.cc:304] T f1b10566f45d4a7d9029858330e02d5b P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:04:44.379732 20645 leader_election.cc:290] T bc225c93219c45538b53a1bd3d387e4d P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:04:44.380441 20642 raft_consensus.cc:493] T edd7d470b5014c9489be7f41f64355c9 P e5256d91808b47c195bc9b4dbd7f2b87 [term 1 FOLLOWER]: Starting leader election (detected failure of leader e61c3a8f61bb48f8a963c9480e53c168)
I20260709 13:04:44.384083 19556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df751f992649444090e27965eb1af85d" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:04:44.395717 19483 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58294 (request call id 1113) took 1139 ms. Trace:
I20260709 13:04:44.427615 19483 rpcz_store.cc:276] 0709 13:04:43.256183 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:43.614185 (+358002us) service_pool.cc:224] Handling call
0709 13:04:43.619103 (+  4918us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:04:43.851639 (+232536us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:04:43.851686 (+    47us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:04:43.911460 (+ 59774us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:04:43.911510 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:44.395514 (+484004us) spinlock_profiling.cc:243] Waited 41 ms on lock 0x7b5400344254. stack: 00007f4a79de9343 00007f4a79de9240 00007f4a797781d4 00007f4a834b6304 00007f4a834b6299 00007f4a7ce71571 00007f4a7cf08e01 00007f4a7cf0783e 00007f4a81ecc419 00007f4a7b443bd4 00007f4a7b443b62 00007f4a7b443a91 00007f4a7b443a0c 00007f4a7b442cc2 00007f4a7b24348c 00007f4a7b2428c6
0709 13:04:44.395555 (+    41us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:44.395666 (+   111us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":94404480}
I20260709 13:04:43.470561 19480 rpcz_store.cc:276] 0709 13:04:41.594979 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:41.598866 (+  3887us) service_pool.cc:224] Handling call
0709 13:04:41.599902 (+  1036us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:04:41.600826 (+   924us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:04:41.600889 (+    63us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:04:41.621476 (+ 20587us) log.cc:844] Serialized 499 byte log entry
0709 13:04:41.714571 (+ 93095us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:04:41.790011 (+ 75440us) log.cc:844] Serialized 14 byte log entry
0709 13:04:43.044813 (+1254802us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:43.044904 (+    91us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:04:43.044952 (+    48us) raft_consensus.cc:1685] finished
0709 13:04:43.044967 (+    15us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:43.045114 (+   147us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1239751,"raft.run_cpu_time_us":162,"raft.run_wall_time_us":163,"spinlock_wait_cycles":101632,"thread_start_us":59803,"threads_started":1,"wal-append.queue_time_us":131716,"wal-append.run_cpu_time_us":3643,"wal-append.run_wall_time_us":1102765}
I20260709 13:04:44.192610 20770 raft_consensus.cc:515] T 0cdf56e38bbc453d9438d359e5a69955 P e5256d91808b47c195bc9b4dbd7f2b87 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:44.372804 20729 consensus_queue.cc:1048] T 0cdf56e38bbc453d9438d359e5a69955 P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.022s
I20260709 13:04:44.406788 19560 rpcz_store.cc:276] 0709 13:04:43.122773 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:44.363071 (+1240298us) service_pool.cc:224] Handling call
0709 13:04:44.388342 (+ 25271us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:04:44.392802 19557 raft_consensus.cc:2410] T 179fd671030940b4b4a4e24bcc4aba0a P e61c3a8f61bb48f8a963c9480e53c168 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0473d2b2d01f4459b1e90fd12cc7840e for term 3 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:04:43.470052 19553 rpcz_store.cc:276] 0709 13:04:41.766948 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:41.767114 (+   166us) service_pool.cc:224] Handling call
0709 13:04:41.767535 (+   421us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:04:41.767987 (+   452us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:04:41.768020 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:04:41.768611 (+   591us) log.cc:844] Serialized 26 byte log entry
0709 13:04:42.393001 (+624390us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:04:43.196860 (+803859us) log.cc:844] Serialized 14 byte log entry
0709 13:04:43.198495 (+  1635us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:43.198592 (+    97us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:04:43.198649 (+    57us) raft_consensus.cc:1685] finished
0709 13:04:43.198660 (+    11us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:43.198853 (+   193us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":802313,"prepare.run_cpu_time_us":47,"prepare.run_wall_time_us":48,"raft.queue_time_us":34979,"raft.run_cpu_time_us":298,"raft.run_wall_time_us":299,"thread_start_us":282225,"threads_started":3,"wal-append.queue_time_us":651231,"wal-append.run_cpu_time_us":3752,"wal-append.run_wall_time_us":1787855}
I20260709 13:04:44.431073 19556 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40428 (request call id 1377) took 1307 ms. Trace:
I20260709 13:04:44.431605 19559 raft_consensus.cc:2468] T 217b5fae677b4971b3bbd2f357a1f7ff P e61c3a8f61bb48f8a963c9480e53c168 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 1.
W20260709 13:04:44.433900 19449 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.4:43121, user_credentials={real_user=slave}} blocked reactor thread for 63006.2us
I20260709 13:04:44.409402 19558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7be9efa6559648dbb5a0f7684c4542d1" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:04:44.441560 19556 rpcz_store.cc:276] 0709 13:04:43.123843 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:44.375720 (+1251877us) service_pool.cc:224] Handling call
0709 13:04:44.431016 (+ 55296us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:04:44.442166 19558 raft_consensus.cc:2468] T 7be9efa6559648dbb5a0f7684c4542d1 P e61c3a8f61bb48f8a963c9480e53c168 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 1.
I20260709 13:04:44.442744 19558 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40428 (request call id 1381) took 1140 ms. Trace:
I20260709 13:04:44.430233 20642 raft_consensus.cc:3060] T edd7d470b5014c9489be7f41f64355c9 P e5256d91808b47c195bc9b4dbd7f2b87 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:44.443486 19558 rpcz_store.cc:276] 0709 13:04:43.302576 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:44.400113 (+1097537us) service_pool.cc:224] Handling call
0709 13:04:44.442673 (+ 42560us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:04:44.443711 19485 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58294 (request call id 1124) took 1029 ms. Trace:
I20260709 13:04:44.406189 20748 leader_election.cc:290] T ed7fdbcb96d14d418db9ca90a792588a P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:04:44.448297 19485 rpcz_store.cc:276] 0709 13:04:43.413998 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:44.409105 (+995107us) service_pool.cc:224] Handling call
0709 13:04:44.433063 (+ 23958us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:04:44.433289 (+   226us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:04:44.433322 (+    33us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:04:44.440102 (+  6780us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:04:44.443475 (+  3373us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:44.443549 (+    74us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:44.443663 (+   114us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:04:44.434893 20724 raft_consensus.cc:2804] T f1b10566f45d4a7d9029858330e02d5b P e61c3a8f61bb48f8a963c9480e53c168 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:04:44.439131 20661 leader_election.cc:290] T 86a6797bdfe94fa496c050ceae4bd0d9 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:04:44.408845 20721 raft_consensus.cc:515] T 48824d5acfbc485ebf8c2d944e7202de P e61c3a8f61bb48f8a963c9480e53c168 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:04:44.468040 19556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22196caba61445d3bec98a0aab3c337d" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:04:44.468257 19560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edd7d470b5014c9489be7f41f64355c9" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:04:44.439429 20683 raft_consensus.cc:2749] T 5ec1c4ce15e04c7e8c283a62179f2a64 P 0473d2b2d01f4459b1e90fd12cc7840e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:04:44.442723 20601 leader_election.cc:290] T f93ee515a9c14139bf566522ed8232f3 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:04:44.466516 19558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "309c3ca0ca4b4f3ba129752ea2cb293b" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:04:44.478339 19558 raft_consensus.cc:2410] T 309c3ca0ca4b4f3ba129752ea2cb293b P e61c3a8f61bb48f8a963c9480e53c168 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0473d2b2d01f4459b1e90fd12cc7840e for term 3 because replica has last-logged OpId of term: 2 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 13:04:44.478847 19558 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40428 (request call id 1372) took 1356 ms. Trace:
I20260709 13:04:44.479135 19558 rpcz_store.cc:276] 0709 13:04:43.122438 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:44.449868 (+1327430us) service_pool.cc:224] Handling call
0709 13:04:44.478774 (+ 28906us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:04:44.479349 20714 leader_election.cc:290] T 28af091831594f9d8e96482078cc7625 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:04:44.375260 19486 rpcz_store.cc:276] 0709 13:04:43.256804 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:43.910955 (+654151us) service_pool.cc:224] Handling call
0709 13:04:44.192007 (+281052us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:04:44.215253 (+ 23246us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:04:44.217367 (+  2114us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:04:44.229468 (+ 12101us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:04:44.231453 (+  1985us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:44.252565 (+ 21112us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:44.273916 (+ 21351us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:04:44.443442 20588 leader_election.cc:290] T 1dc5b3532fe54f74876d02beffa2c230 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:04:44.378296 20769 raft_consensus.cc:515] T 172b3dd13109415a955b71ac0e9d2234 P 127766fc592545a4997f7790f50f6076 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:04:44.447263 20590 leader_election.cc:290] T fa731b585f684a7fb2d106c50f143b83 P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
W20260709 13:04:44.449391 20076 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.3:36891, user_credentials={real_user=slave}} blocked reactor thread for 164734us
I20260709 13:04:44.486635 19556 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40428 (request call id 1376) took 1363 ms. Trace:
I20260709 13:04:44.463487 20724 raft_consensus.cc:493] T f1b10566f45d4a7d9029858330e02d5b P e61c3a8f61bb48f8a963c9480e53c168 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:44.498399 19410 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52328 (request call id 1072) took 1106 ms. Trace:
I20260709 13:04:44.544844 19558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "833a2f0775ed407a94b8924ce50adb63" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:04:44.498519 19405 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52328 (request call id 1063) took 1107 ms. Trace:
I20260709 13:04:44.523667 19411 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49050 (request call id 38) took 1186 ms. Trace:
I20260709 13:04:44.496166 20730 leader_election.cc:290] T 85c494af21f9457a85da47b9bc70c1fd P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:04:44.497581 20756 leader_election.cc:290] T ab43d85f64114d4ebf618930e43d9ed0 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:04:44.546788 20724 raft_consensus.cc:3060] T f1b10566f45d4a7d9029858330e02d5b P e61c3a8f61bb48f8a963c9480e53c168 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:04:44.546993 20758 leader_election.cc:290] T 217b5fae677b4971b3bbd2f357a1f7ff P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:04:44.524351 19478 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58294 (request call id 1111) took 1268 ms. Trace:
I20260709 13:04:44.407981 19421 rpcz_store.cc:276] 0709 13:04:41.735896 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:41.736170 (+   274us) service_pool.cc:224] Handling call
0709 13:04:44.168543 (+2432373us) spinlock_profiling.cc:243] Waited 371 ms on lock 0x7b5400182754. stack: 00007f4a79de9343 00007f4a79de9240 00007f4a797781d4 00007f4a834b6304 00007f4a834b6299 00007f4a7ce71571 00007f4a7cf123f7 00007f4a81ea8036 00007f4a81eb1a3e 00007f4a7977527b 00007f4a81eb19ba 00007f4a81eacacc 00007f4a81ea7c7b 00007f4a81e9c8d1 00007f4a80f504b4 00007f4a80f50442
0709 13:04:44.390803 (+222260us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":853068032}
I20260709 13:04:44.545571 19405 rpcz_store.cc:276] 0709 13:04:43.380388 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:43.382888 (+  2500us) service_pool.cc:224] Handling call
0709 13:04:43.383170 (+   282us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:04:44.207705 (+824535us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:44.487201 (+279496us) spinlock_profiling.cc:243] Waited 124 ms on lock 0x7b5400184554. stack: 00007f4a79de9343 00007f4a79de9240 00007f4a797781d4 00007f4a834b6304 00007f4a834b6299 00007f4a7ce71571 00007f4a7cf08e01 00007f4a7cf0783e 00007f4a81ecc419 00007f4a7b443bd4 00007f4a7b443b62 00007f4a7b443a91 00007f4a7b443a0c 00007f4a7b442cc2 00007f4a7b24348c 00007f4a7b2428c6
0709 13:04:44.487361 (+   160us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":285266304}
I20260709 13:04:44.506083 19560 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40438 (request call id 1099) took 1110 ms. Trace:
I20260709 13:04:44.494045 19479 raft_consensus.cc:2468] T 7f575b143b844aa096b50997dad3516a P 0473d2b2d01f4459b1e90fd12cc7840e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 2.
I20260709 13:04:44.546840 19558 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40438 (request call id 1102) took 1150 ms. Trace:
I20260709 13:04:44.547668 19556 rpcz_store.cc:276] 0709 13:04:43.123571 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:44.447297 (+1323726us) service_pool.cc:224] Handling call
0709 13:04:44.486571 (+ 39274us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:04:44.567724 19560 rpcz_store.cc:276] 0709 13:04:43.395888 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:44.441794 (+1045906us) service_pool.cc:224] Handling call
0709 13:04:44.506004 (+ 64210us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:04:44.567698 19558 rpcz_store.cc:276] 0709 13:04:43.396700 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:44.544570 (+1147870us) service_pool.cc:224] Handling call
0709 13:04:44.546765 (+  2195us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:04:44.510973 19553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e1085d23e8347fbbd5bce7542f4b1f4" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:04:44.548363 19478 rpcz_store.cc:276] 0709 13:04:43.255645 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:43.607421 (+351776us) service_pool.cc:224] Handling call
0709 13:04:43.621501 (+ 14080us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:04:44.215145 (+593644us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:04:44.215164 (+    19us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:04:44.215195 (+    31us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:04:44.215212 (+    17us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:44.524069 (+308857us) spinlock_profiling.cc:243] Waited 593 ms on lock 0x7b54000edb54. stack: 00007f4a79de9343 00007f4a79de9240 00007f4a797781d4 00007f4a834b6304 00007f4a834b6299 00007f4a7ce71571 00007f4a7cf08e01 00007f4a7cf0783e 00007f4a81ecc419 00007f4a7b443bd4 00007f4a7b443b62 00007f4a7b443a91 00007f4a7b443a0c 00007f4a7b442cc2 00007f4a7b24348c 00007f4a7b2428c6
0709 13:04:44.524126 (+    57us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:44.524284 (+   158us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1364895616}
I20260709 13:04:44.545794 19411 rpcz_store.cc:276] 0709 13:04:43.337313 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:43.337446 (+   133us) service_pool.cc:224] Handling call
0709 13:04:44.523483 (+1186037us) spinlock_profiling.cc:243] Waited 844 ms on lock 0x7b5400065254. stack: 00007f4a79de9343 00007f4a79de9240 00007f4a797781d4 00007f4a834b6304 00007f4a834b6299 00007f4a7ce71571 00007f4a7cf0c2fa 00007f4a81ecdb17 00007f4a7b4486d4 00007f4a7b448662 00007f4a7b448591 00007f4a7b44850c 00007f4a7b4477c2 00007f4a7b24348c 00007f4a7b2428c6 00007f4a7b24226f
0709 13:04:44.523581 (+    98us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1941211904}
W20260709 13:04:44.570317 20077 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.654s	user 0.012s	sys 0.029s
W20260709 13:04:44.571826 20077 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.655s	user 0.012s	sys 0.029s
I20260709 13:04:44.483170 20752 leader_election.cc:290] T 2e36a9d6e29c4a7c860cf267efbd4c74 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:04:44.574920 19404 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52328 (request call id 1062) took 1196 ms. Trace:
I20260709 13:04:44.576159 19556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa8650e71aa14778b3d73721fc50d9fc" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:04:44.577661 19556 raft_consensus.cc:2468] T fa8650e71aa14778b3d73721fc50d9fc P e61c3a8f61bb48f8a963c9480e53c168 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 1.
I20260709 13:04:44.575127 20765 leader_election.cc:290] T 6c5eebf646ad445a9d1b1adc319d7b16 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:04:44.575237 20770 leader_election.cc:290] T 0cdf56e38bbc453d9438d359e5a69955 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:04:44.574178 19479 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58294 (request call id 1119) took 1176 ms. Trace:
I20260709 13:04:44.537513 20754 leader_election.cc:290] T a08760e15aac4630a629431f56024dc8 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:04:44.531155 20595 leader_election.cc:290] T 65d8cb8d6ec64f459d5a47cefab10acf P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:04:44.548240 20742 leader_election.cc:290] T ed7fdbcb96d14d418db9ca90a792588a P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:04:44.562853 20740 leader_election.cc:290] T 0afb57ae58a24a01850491d69f0213dd P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:04:44.577426 19405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e1f505cb0f1427bbd698ac889d80821" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:04:44.547742 20726 leader_election.cc:290] T f93ee515a9c14139bf566522ed8232f3 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:04:44.509627 20107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "775c229504194560ba9589bc2199b089" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:04:44.525589 19486 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "48824d5acfbc485ebf8c2d944e7202de"
dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
mode: GRACEFUL
new_leader_uuid: "127766fc592545a4997f7790f50f6076"
 from {username='slave'} at 127.0.0.1:48168
I20260709 13:04:44.584354 19556 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40438 (request call id 1095) took 1187 ms. Trace:
I20260709 13:04:44.578593 19479 rpcz_store.cc:276] 0709 13:04:43.393666 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:43.502338 (+108672us) service_pool.cc:224] Handling call
0709 13:04:43.624994 (+122656us) spinlock_profiling.cc:243] Waited 5.45 ms on lock 0x7b58001b9998. stack: 00007f4a79de9343 00007f4a79de9240 00007f4a797781d4 00007f4a834b6304 00007f4a834b6299 00007f4a79ca3db1 00007f4a79de3b71 00007f4a79de3a22 00007f4a82cfcc09 00007f4a81e56ee0 00007f4a81f200ab 00007f4a81f20131 00007f4a81ece0a0 00007f4a81ecd984 00007f4a7b4486d4 00007f4a7b448662
0709 13:04:44.569578 (+944584us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":12540800}
W20260709 13:04:44.684083 19559 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40428 (request call id 1370) took 1562 ms (client timeout 2047 ms). Trace:
I20260709 13:04:44.691882 20107 raft_consensus.cc:2468] T 775c229504194560ba9589bc2199b089 P 127766fc592545a4997f7790f50f6076 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 1.
W20260709 13:04:44.686193 19340 debug-util.cc:398] Leaking SignalData structure 0x7b08002345e0 after lost signal to thread 19435
I20260709 13:04:44.693048 19558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21e14947d70440f19044d8f75c31e1f9" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
W20260709 13:04:44.693306 19340 debug-util.cc:398] Leaking SignalData structure 0x7b080033dbe0 after lost signal to thread 19510
W20260709 13:04:44.693621 19340 debug-util.cc:398] Leaking SignalData structure 0x7b08003273e0 after lost signal to thread 19511
I20260709 13:04:44.693843 19558 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40438 (request call id 1109) took 1072 ms. Trace:
I20260709 13:04:44.694156 19558 rpcz_store.cc:276] 0709 13:04:43.651831 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:44.578718 (+926887us) service_pool.cc:224] Handling call
0709 13:04:44.693791 (+115073us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:04:44.548607 20751 leader_election.cc:290] T 309c3ca0ca4b4f3ba129752ea2cb293b P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:04:44.691468 19556 rpcz_store.cc:276] 0709 13:04:43.390618 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:44.568241 (+1177623us) service_pool.cc:224] Handling call
0709 13:04:44.578047 (+  9806us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:04:44.695441 19558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef32ce6fdd0e40d382c79974f30295c6" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:04:44.683455 19408 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49050 (request call id 41) took 1334 ms. Trace:
I20260709 13:04:44.704362 19484 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58294 (request call id 1112) took 1448 ms. Trace:
I20260709 13:04:44.531409 20619 leader_election.cc:290] T ff75a1d4cb1f493db8f71ddc136ba9ab P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:04:44.567970 20764 leader_election.cc:290] T ff9b0eddd810459b82d91c60777c10eb P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:04:44.510581 20749 leader_election.cc:290] T 14935b3ddf914369822e4a0547aaa355 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:04:44.547678 20643 leader_election.cc:290] T fa8650e71aa14778b3d73721fc50d9fc P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:04:44.509835 20745 leader_election.cc:290] T 1a61655d99124a29b486ba4a5b37faea P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:04:44.659001 19553 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40428 (request call id 1371) took 1527 ms. Trace:
I20260709 13:04:44.712141 20769 leader_election.cc:290] T 172b3dd13109415a955b71ac0e9d2234 P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
W20260709 13:04:44.694622 19340 debug-util.cc:398] Leaking SignalData structure 0x7b0800374b00 after lost signal to thread 19584
I20260709 13:04:44.703689 19408 rpcz_store.cc:276] 0709 13:04:43.348942 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:43.349039 (+    97us) service_pool.cc:224] Handling call
0709 13:04:43.349344 (+   305us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:04:44.427295 (+1077951us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:04:44.427326 (+    31us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:04:44.431132 (+  3806us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:04:44.431170 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:44.683100 (+251930us) spinlock_profiling.cc:243] Waited 1.05 s on lock 0x7b54002ef254. stack: 00007f4a79de9343 00007f4a79de9240 00007f4a797781d4 00007f4a834b6304 00007f4a834b6299 00007f4a7ce71571 00007f4a7cf08e01 00007f4a7cf0783e 00007f4a81ecc419 00007f4a7b443bd4 00007f4a7b443b62 00007f4a7b443a91 00007f4a7b443a0c 00007f4a7b442cc2 00007f4a7b24348c 00007f4a7b2428c6
0709 13:04:44.683139 (+    39us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:44.683276 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2413411712}
I20260709 13:04:44.706818 19558 raft_consensus.cc:2468] T ef32ce6fdd0e40d382c79974f30295c6 P e61c3a8f61bb48f8a963c9480e53c168 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 1.
I20260709 13:04:44.576350 20736 leader_election.cc:290] T 9962423cb4e54fcfa5de01daf68a86e7 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:04:44.697252 20746 leader_election.cc:290] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:04:44.633464 20728 leader_election.cc:290] T e381f1d6b8184797ad142de49be225a8 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:04:44.589393 20721 leader_election.cc:290] T 48824d5acfbc485ebf8c2d944e7202de P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
W20260709 13:04:44.691653 19559 rpcz_store.cc:269] 0709 13:04:43.121815 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:44.273315 (+1151500us) service_pool.cc:224] Handling call
0709 13:04:44.683940 (+410625us) spinlock_profiling.cc:243] Waited 51.7 ms on lock 0x7b54000b8bd4. stack: 00007f4a79de9343 00007f4a79de9240 00007f4a797781d4 00007f4a834b6304 00007f4a834b6299 00007f4a7ce71571 00007f4a7cf0c2fa 00007f4a81ecdb17 00007f4a7b4486d4 00007f4a7b448662 00007f4a7b448591 00007f4a7b44850c 00007f4a7b4477c2 00007f4a7b24348c 00007f4a7b2428c6 00007f4a7b24226f
0709 13:04:44.684031 (+    91us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":118951808}
I20260709 13:04:44.711462 19405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "775c229504194560ba9589bc2199b089" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:04:44.711762 20733 leader_election.cc:290] T ef32ce6fdd0e40d382c79974f30295c6 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:04:44.633565 20731 leader_election.cc:290] T b9f0d59553ad444883fcf5b5909f9798 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:04:44.677790 20722 leader_election.cc:290] T 2a16f7501e2444fb86d4e2778e734e02 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:04:44.704715 19484 rpcz_store.cc:276] 0709 13:04:43.255911 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:43.608643 (+352732us) service_pool.cc:224] Handling call
0709 13:04:43.653936 (+ 45293us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:04:44.254873 (+600937us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:04:44.254917 (+    44us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:04:44.254975 (+    58us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:04:44.255019 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:44.704160 (+449141us) spinlock_profiling.cc:243] Waited 601 ms on lock 0x7b54003ea3d4. stack: 00007f4a79de9343 00007f4a79de9240 00007f4a797781d4 00007f4a834b6304 00007f4a834b6299 00007f4a7ce71571 00007f4a7cf08e01 00007f4a7cf0783e 00007f4a81ecc419 00007f4a7b443bd4 00007f4a7b443b62 00007f4a7b443a91 00007f4a7b443a0c 00007f4a7b442cc2 00007f4a7b24348c 00007f4a7b2428c6
0709 13:04:44.704198 (+    38us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:44.704312 (+   114us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1381442816}
I20260709 13:04:44.638793 20732 leader_election.cc:290] T 70797e5783b5454ab0d0eea663e791e3 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:04:44.713995 19558 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40438 (request call id 1104) took 1316 ms. Trace:
I20260709 13:04:44.714483 19408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab43d85f64114d4ebf618930e43d9ed0" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:04:44.708464 19486 raft_consensus.cc:606] T 48824d5acfbc485ebf8c2d944e7202de P 0473d2b2d01f4459b1e90fd12cc7840e [term 2 FOLLOWER]: Received request to transfer leadership to TS 127766fc592545a4997f7790f50f6076
I20260709 13:04:44.721725 19486 raft_consensus.cc:614] T 48824d5acfbc485ebf8c2d944e7202de P 0473d2b2d01f4459b1e90fd12cc7840e [term 2 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:04:44.722304 19405 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49050 (request call id 42) took 1315 ms. Trace:
W20260709 13:04:44.717653 19340 debug-util.cc:398] Leaking SignalData structure 0x7b0800374220 after lost signal to thread 20136
I20260709 13:04:44.577396 19404 rpcz_store.cc:276] 0709 13:04:43.378823 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:43.379456 (+   633us) service_pool.cc:224] Handling call
0709 13:04:43.379808 (+   352us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:04:43.600874 (+221066us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:44.574654 (+973780us) spinlock_profiling.cc:243] Waited 18.3 ms on lock 0x7b54000b36d4. stack: 00007f4a79de9343 00007f4a79de9240 00007f4a797781d4 00007f4a834b6304 00007f4a834b6299 00007f4a7ce71571 00007f4a7cf08e01 00007f4a7cf0783e 00007f4a81ecc419 00007f4a7b443bd4 00007f4a7b443b62 00007f4a7b443a91 00007f4a7b443a0c 00007f4a7b442cc2 00007f4a7b24348c 00007f4a7b2428c6
0709 13:04:44.574865 (+   211us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":41979648}
I20260709 13:04:44.720261 19558 rpcz_store.cc:276] 0709 13:04:43.397267 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:44.695200 (+1297933us) service_pool.cc:224] Handling call
0709 13:04:44.713939 (+ 18739us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:04:44.720512 19556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65d8cb8d6ec64f459d5a47cefab10acf" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:04:44.714584 20725 leader_election.cc:290] T 14935b3ddf914369822e4a0547aaa355 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:04:44.721275 20665 leader_election.cc:290] T 14efcc79969f41babe5529c22d59156d P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
W20260709 13:04:44.724591 19340 debug-util.cc:398] Leaking SignalData structure 0x7b08003741e0 after lost signal to thread 20137
I20260709 13:04:44.728377 19408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "179fd671030940b4b4a4e24bcc4aba0a" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:04:44.730724 20665 raft_consensus.cc:493] T 40e1e16737a842ee936002830f36882e P e5256d91808b47c195bc9b4dbd7f2b87 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e61c3a8f61bb48f8a963c9480e53c168)
I20260709 13:04:44.731335 20665 raft_consensus.cc:515] T 40e1e16737a842ee936002830f36882e P e5256d91808b47c195bc9b4dbd7f2b87 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:44.732077 20762 leader_election.cc:290] T 3e1f505cb0f1427bbd698ac889d80821 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:04:44.732676 19408 raft_consensus.cc:1240] T 1f85fc4b527a48848e5faa083b604e36 P e5256d91808b47c195bc9b4dbd7f2b87 [term 2 FOLLOWER]: Rejecting Update request from peer 0473d2b2d01f4459b1e90fd12cc7840e for earlier term 1. Current term is 2. Ops: []
I20260709 13:04:44.732487 20670 raft_consensus.cc:515] T df751f992649444090e27965eb1af85d P e5256d91808b47c195bc9b4dbd7f2b87 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:44.712229 19553 rpcz_store.cc:276] 0709 13:04:43.122129 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:44.451297 (+1329168us) service_pool.cc:224] Handling call
0709 13:04:44.649380 (+198083us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:04:44.722699 19405 rpcz_store.cc:276] 0709 13:04:43.407127 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:44.721520 (+1314393us) service_pool.cc:224] Handling call
0709 13:04:44.721786 (+   266us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:04:44.721955 (+   169us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:04:44.721977 (+    22us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:04:44.722011 (+    34us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:04:44.722077 (+    66us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:44.722129 (+    52us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:44.722248 (+   119us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:04:44.734814 19559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85c494af21f9457a85da47b9bc70c1fd" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:04:44.666837 20744 leader_election.cc:290] T 179fd671030940b4b4a4e24bcc4aba0a P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:04:44.714769 20716 leader_election.cc:290] T 48824d5acfbc485ebf8c2d944e7202de P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:04:44.725677 20111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96efeaaf1057492490e9a621f37e1a2d" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:04:44.725906 20106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f85fc4b527a48848e5faa083b604e36" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076"
I20260709 13:04:44.709738 20642 raft_consensus.cc:515] T edd7d470b5014c9489be7f41f64355c9 P e5256d91808b47c195bc9b4dbd7f2b87 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:44.734253 19407 raft_consensus.cc:1240] T df751f992649444090e27965eb1af85d P e5256d91808b47c195bc9b4dbd7f2b87 [term 2 FOLLOWER]: Rejecting Update request from peer e61c3a8f61bb48f8a963c9480e53c168 for earlier term 1. Current term is 2. Ops: []
I20260709 13:04:44.734176 19556 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40438 (request call id 1100) took 1338 ms. Trace:
I20260709 13:04:44.544909 19410 rpcz_store.cc:276] 0709 13:04:43.391858 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:44.497409 (+1105551us) service_pool.cc:224] Handling call
0709 13:04:44.497770 (+   361us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:04:44.497973 (+   203us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:04:44.498009 (+    36us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:04:44.498087 (+    78us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:04:44.498127 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:44.498210 (+    83us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:44.498338 (+   128us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:04:44.741569 19558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f575b143b844aa096b50997dad3516a" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:04:44.743250 19556 rpcz_store.cc:276] 0709 13:04:43.396161 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:44.710845 (+1314684us) service_pool.cc:224] Handling call
0709 13:04:44.734101 (+ 23256us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:04:44.733294 20665 leader_election.cc:290] T 40e1e16737a842ee936002830f36882e P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
W20260709 13:04:44.746912 20775 log.cc:927] Time spent T e381f1d6b8184797ad142de49be225a8 P e5256d91808b47c195bc9b4dbd7f2b87: Append to log took a long time: real 0.870s	user 0.001s	sys 0.006s
I20260709 13:04:44.740914 19554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1efebf73c86e432baa55533136b6e12c" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:04:44.747547 19559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed7fdbcb96d14d418db9ca90a792588a" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:04:44.751991 19554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65d8cb8d6ec64f459d5a47cefab10acf" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:04:44.752297 19559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa731b585f684a7fb2d106c50f143b83" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:04:44.745795 20746 raft_consensus.cc:493] T 2725d2c4cb054f18b0fc8f735c15f6c2 P e5256d91808b47c195bc9b4dbd7f2b87 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e61c3a8f61bb48f8a963c9480e53c168)
I20260709 13:04:44.749346 19551 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40428 (request call id 1368) took 1626 ms. Trace:
I20260709 13:04:44.749799 20736 raft_consensus.cc:493] T fa731b585f684a7fb2d106c50f143b83 P e5256d91808b47c195bc9b4dbd7f2b87 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e61c3a8f61bb48f8a963c9480e53c168)
I20260709 13:04:44.744484 20106 raft_consensus.cc:3060] T 1f85fc4b527a48848e5faa083b604e36 P 127766fc592545a4997f7790f50f6076 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:44.753320 19559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85c494af21f9457a85da47b9bc70c1fd" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
W20260709 13:04:44.745894 19340 debug-util.cc:398] Leaking SignalData structure 0x7b08002d4aa0 after lost signal to thread 20682
I20260709 13:04:44.742244 20104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ece3db938bc649d4a40a51522ed5259c" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:04:44.755833 19556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70797e5783b5454ab0d0eea663e791e3" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:04:44.754256 20736 raft_consensus.cc:515] T fa731b585f684a7fb2d106c50f143b83 P e5256d91808b47c195bc9b4dbd7f2b87 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:04:44.760908 19403 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52328 (request call id 1068) took 1378 ms. Trace:
I20260709 13:04:44.761742 20736 leader_election.cc:290] T fa731b585f684a7fb2d106c50f143b83 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:04:44.763049 19556 raft_consensus.cc:2468] T 70797e5783b5454ab0d0eea663e791e3 P e61c3a8f61bb48f8a963c9480e53c168 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 127766fc592545a4997f7790f50f6076 in term 1.
W20260709 13:04:44.762302 19555 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40428 (request call id 1364) took 1645 ms (client timeout 1579 ms). Trace:
I20260709 13:04:44.761304 19403 rpcz_store.cc:276] 0709 13:04:43.381993 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:44.191382 (+809389us) service_pool.cc:224] Handling call
0709 13:04:44.272436 (+ 81054us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:04:44.462583 (+190147us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:04:44.465168 (+  2585us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:04:44.477705 (+ 12537us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:04:44.484001 (+  6296us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:44.759202 (+275201us) spinlock_profiling.cc:243] Waited 162 ms on lock 0x7b5400184a54. stack: 00007f4a79de9343 00007f4a79de9240 00007f4a797781d4 00007f4a834b6304 00007f4a834b6299 00007f4a7ce71571 00007f4a7cf08e01 00007f4a7cf0783e 00007f4a81ecc419 00007f4a7b443bd4 00007f4a7b443b62 00007f4a7b443a91 00007f4a7b443a0c 00007f4a7b442cc2 00007f4a7b24348c 00007f4a7b2428c6
0709 13:04:44.759855 (+   653us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:44.760829 (+   974us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":372365568}
I20260709 13:04:44.763949 19553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e1085d23e8347fbbd5bce7542f4b1f4" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:04:44.753958 20746 raft_consensus.cc:515] T 2725d2c4cb054f18b0fc8f735c15f6c2 P e5256d91808b47c195bc9b4dbd7f2b87 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:44.765623 19477 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58294 (request call id 1105) took 1513 ms. Trace:
I20260709 13:04:44.766183 20746 leader_election.cc:290] T 2725d2c4cb054f18b0fc8f735c15f6c2 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:04:44.767798 19556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a16f7501e2444fb86d4e2778e734e02" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:04:44.753255 19554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62c6c134d3d24a1ab144dd9ee6bc3f64" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:04:44.768484 19556 raft_consensus.cc:2468] T 2a16f7501e2444fb86d4e2778e734e02 P e61c3a8f61bb48f8a963c9480e53c168 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 127766fc592545a4997f7790f50f6076 in term 2.
I20260709 13:04:44.768990 19558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "833a2f0775ed407a94b8924ce50adb63" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:04:44.767397 20738 leader_election.cc:290] T 85c494af21f9457a85da47b9bc70c1fd P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
W20260709 13:04:44.763810 19555 rpcz_store.cc:269] 0709 13:04:43.116687 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:43.116802 (+   115us) service_pool.cc:224] Handling call
0709 13:04:44.762129 (+1645327us) spinlock_profiling.cc:243] Waited 773 ms on lock 0x7b5400341f54. stack: 00007f4a79de9343 00007f4a79de9240 00007f4a797781d4 00007f4a834b6304 00007f4a834b6299 00007f4a7ce71571 00007f4a7cf0c2fa 00007f4a81ecdb17 00007f4a7b4486d4 00007f4a7b448662 00007f4a7b448591 00007f4a7b44850c 00007f4a7b4477c2 00007f4a7b24348c 00007f4a7b2428c6 00007f4a7b24226f
0709 13:04:44.762236 (+   107us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1778346240}
I20260709 13:04:44.774578 20111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48824d5acfbc485ebf8c2d944e7202de" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
W20260709 13:04:44.775079 19406 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52328 (request call id 1061) took 1396 ms (client timeout 1529 ms). Trace:
I20260709 13:04:44.775786 19403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "217b5fae677b4971b3bbd2f357a1f7ff" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:04:44.776017 20112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "833a2f0775ed407a94b8924ce50adb63" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076"
I20260709 13:04:44.777088 20078 leader_election.cc:304] T 0e1085d23e8347fbbd5bce7542f4b1f4 P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, 127766fc592545a4997f7790f50f6076; no voters: 
I20260709 13:04:44.753940 19551 rpcz_store.cc:276] 0709 13:04:43.121184 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:43.373753 (+252569us) service_pool.cc:224] Handling call
0709 13:04:43.374143 (+   390us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:04:44.252474 (+878331us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:04:44.256776 (+  4302us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:04:44.275193 (+ 18417us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:04:44.323865 (+ 48672us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:44.747474 (+423609us) spinlock_profiling.cc:243] Waited 843 ms on lock 0x7b540029bdd4. stack: 00007f4a79de9343 00007f4a79de9240 00007f4a797781d4 00007f4a834b6304 00007f4a834b6299 00007f4a7ce71571 00007f4a7cf08e01 00007f4a7cf0783e 00007f4a81ecc419 00007f4a7b443bd4 00007f4a7b443b62 00007f4a7b443a91 00007f4a7b443a0c 00007f4a7b442cc2 00007f4a7b24348c 00007f4a7b2428c6
0709 13:04:44.747512 (+    38us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:44.747632 (+   120us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1938580352}
I20260709 13:04:44.778260 19556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86a6797bdfe94fa496c050ceae4bd0d9" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:04:44.782990 19559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ece3db938bc649d4a40a51522ed5259c" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:04:44.781844 20753 leader_election.cc:290] T b9f0d59553ad444883fcf5b5909f9798 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:04:44.788167 20735 leader_election.cc:290] T 28af091831594f9d8e96482078cc7625 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:04:44.788691 20764 raft_consensus.cc:2804] T 0e1085d23e8347fbbd5bce7542f4b1f4 P 127766fc592545a4997f7790f50f6076 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:04:44.787390 19556 raft_consensus.cc:2468] T 86a6797bdfe94fa496c050ceae4bd0d9 P e61c3a8f61bb48f8a963c9480e53c168 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 1.
W20260709 13:04:44.780228 19406 rpcz_store.cc:269] 0709 13:04:43.378467 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:43.378843 (+   376us) service_pool.cc:224] Handling call
0709 13:04:44.774940 (+1396097us) spinlock_profiling.cc:243] Waited 869 ms on lock 0x7b540019ee54. stack: 00007f4a79de9343 00007f4a79de9240 00007f4a797781d4 00007f4a834b6304 00007f4a834b6299 00007f4a7ce71571 00007f4a7cf0c2fa 00007f4a81ecdb17 00007f4a7b4486d4 00007f4a7b448662 00007f4a7b448591 00007f4a7b44850c 00007f4a7b4477c2 00007f4a7b24348c 00007f4a7b2428c6 00007f4a7b24226f
0709 13:04:44.775025 (+    85us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1999475584}
I20260709 13:04:44.789965 19559 raft_consensus.cc:2468] T ece3db938bc649d4a40a51522ed5259c P e61c3a8f61bb48f8a963c9480e53c168 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 127766fc592545a4997f7790f50f6076 in term 1.
I20260709 13:04:44.791196 19558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc225c93219c45538b53a1bd3d387e4d" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:04:44.794488 19558 raft_consensus.cc:2468] T bc225c93219c45538b53a1bd3d387e4d P e61c3a8f61bb48f8a963c9480e53c168 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 1.
I20260709 13:04:44.789984 19523 leader_election.cc:304] T 46c5bfeecc314717bffe987e6844b6d0 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:04:44.794255 20764 raft_consensus.cc:493] T 0e1085d23e8347fbbd5bce7542f4b1f4 P 127766fc592545a4997f7790f50f6076 [term 1 FOLLOWER]: Starting leader election (detected failure of leader e61c3a8f61bb48f8a963c9480e53c168)
I20260709 13:04:44.796283 19555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f93ee515a9c14139bf566522ed8232f3" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:04:44.797987 19377 leader_election.cc:304] T 7f575b143b844aa096b50997dad3516a P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87; no voters: 
I20260709 13:04:44.799787 19559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed7fdbcb96d14d418db9ca90a792588a" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:04:44.765991 19477 rpcz_store.cc:276] 0709 13:04:43.252172 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:43.254328 (+  2156us) service_pool.cc:224] Handling call
0709 13:04:43.254713 (+   385us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:04:44.428723 (+1174010us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:04:44.428763 (+    40us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:04:44.428815 (+    52us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:04:44.428851 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:44.765307 (+336456us) spinlock_profiling.cc:243] Waited 1.16 s on lock 0x7b5400344754. stack: 00007f4a79de9343 00007f4a79de9240 00007f4a797781d4 00007f4a834b6304 00007f4a834b6299 00007f4a7ce71571 00007f4a7cf08e01 00007f4a7cf0783e 00007f4a81ecc419 00007f4a7b443bd4 00007f4a7b443b62 00007f4a7b443a91 00007f4a7b443a0c 00007f4a7b442cc2 00007f4a7b24348c 00007f4a7b2428c6
0709 13:04:44.765350 (+    43us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:44.765468 (+   118us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2657140480}
I20260709 13:04:44.802258 20764 raft_consensus.cc:3060] T 0e1085d23e8347fbbd5bce7542f4b1f4 P 127766fc592545a4997f7790f50f6076 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:44.801645 19555 raft_consensus.cc:2468] T f93ee515a9c14139bf566522ed8232f3 P e61c3a8f61bb48f8a963c9480e53c168 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 1.
I20260709 13:04:44.800189 20104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa731b585f684a7fb2d106c50f143b83" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:04:44.800429 19556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "179fd671030940b4b4a4e24bcc4aba0a" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:04:44.769627 20734 leader_election.cc:290] T 5ec1c4ce15e04c7e8c283a62179f2a64 P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:04:44.804239 19555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76cb037fc9064d13b59a8969d897ce8c" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:04:44.807529 19555 raft_consensus.cc:2468] T 76cb037fc9064d13b59a8969d897ce8c P e61c3a8f61bb48f8a963c9480e53c168 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 1.
I20260709 13:04:44.782544 19554 raft_consensus.cc:2468] T 62c6c134d3d24a1ab144dd9ee6bc3f64 P e61c3a8f61bb48f8a963c9480e53c168 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 127766fc592545a4997f7790f50f6076 in term 1.
I20260709 13:04:44.811033 19556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28af091831594f9d8e96482078cc7625" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:04:44.812316 19555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e36a9d6e29c4a7c860cf267efbd4c74" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:04:44.811678 19556 raft_consensus.cc:2468] T 28af091831594f9d8e96482078cc7625 P e61c3a8f61bb48f8a963c9480e53c168 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 1.
I20260709 13:04:44.813875 20103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a16f7501e2444fb86d4e2778e734e02" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:04:44.817035 20075 leader_election.cc:304] T 9962423cb4e54fcfa5de01daf68a86e7 P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 127766fc592545a4997f7790f50f6076, e5256d91808b47c195bc9b4dbd7f2b87; no voters: 0473d2b2d01f4459b1e90fd12cc7840e
I20260709 13:04:44.818460 19555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cdf56e38bbc453d9438d359e5a69955" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:04:44.821301 20734 raft_consensus.cc:2804] T 9962423cb4e54fcfa5de01daf68a86e7 P 127766fc592545a4997f7790f50f6076 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:04:44.821717 20734 raft_consensus.cc:493] T 9962423cb4e54fcfa5de01daf68a86e7 P 127766fc592545a4997f7790f50f6076 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 0473d2b2d01f4459b1e90fd12cc7840e)
I20260709 13:04:44.822100 20734 raft_consensus.cc:3060] T 9962423cb4e54fcfa5de01daf68a86e7 P 127766fc592545a4997f7790f50f6076 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:44.822466 20110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36f6ba92b9ba46babe4ebd6c02e5fbd9" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:04:44.822890 20647 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ab43d85f64114d4ebf618930e43d9ed0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:44.823033 19411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "775c229504194560ba9589bc2199b089" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:04:44.810127 20735 raft_consensus.cc:2804] T 46c5bfeecc314717bffe987e6844b6d0 P e61c3a8f61bb48f8a963c9480e53c168 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:04:44.825327 20110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e1085d23e8347fbbd5bce7542f4b1f4" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:04:44.823726 19483 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58294 (request call id 1125) took 1215 ms. Trace:
I20260709 13:04:44.826879 19556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dc5b3532fe54f74876d02beffa2c230" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:04:44.826884 19483 rpcz_store.cc:276] 0709 13:04:43.608005 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:44.428866 (+820861us) service_pool.cc:224] Handling call
0709 13:04:44.432231 (+  3365us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:04:44.510105 (+ 77874us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:04:44.510134 (+    29us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:04:44.551518 (+ 41384us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:04:44.551576 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:44.823511 (+271935us) spinlock_profiling.cc:243] Waited 66.5 ms on lock 0x7b5400111054. stack: 00007f4a79de9343 00007f4a79de9240 00007f4a797781d4 00007f4a834b6304 00007f4a834b6299 00007f4a7ce71571 00007f4a7cf08e01 00007f4a7cf0783e 00007f4a81ecc419 00007f4a7b443bd4 00007f4a7b443b62 00007f4a7b443a91 00007f4a7b443a0c 00007f4a7b442cc2 00007f4a7b24348c 00007f4a7b2428c6
0709 13:04:44.823555 (+    44us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:44.823679 (+   124us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":152858496}
I20260709 13:04:44.829932 19482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b08304a0a02b42d7840c4e8ee9a6bd1a" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:04:44.831671 19405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85c494af21f9457a85da47b9bc70c1fd" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:04:44.831825 20670 leader_election.cc:290] T df751f992649444090e27965eb1af85d P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 2 election: Requested vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:04:44.832669 19554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff75a1d4cb1f493db8f71ddc136ba9ab" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:04:44.832821 19405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65d8cb8d6ec64f459d5a47cefab10acf" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:04:44.833297 19554 raft_consensus.cc:2468] T ff75a1d4cb1f493db8f71ddc136ba9ab P e61c3a8f61bb48f8a963c9480e53c168 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 1.
I20260709 13:04:44.833909 19405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "172b3dd13109415a955b71ac0e9d2234" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:04:44.834270 19554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab43d85f64114d4ebf618930e43d9ed0" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:04:44.835259 19555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0afb57ae58a24a01850491d69f0213dd" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:04:44.819639 20103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14efcc79969f41babe5529c22d59156d" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:04:44.834233 20724 raft_consensus.cc:515] T f1b10566f45d4a7d9029858330e02d5b P e61c3a8f61bb48f8a963c9480e53c168 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:44.840157 19405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ec1c4ce15e04c7e8c283a62179f2a64" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:04:44.839380 19404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "309c3ca0ca4b4f3ba129752ea2cb293b" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:04:44.842178 19406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70797e5783b5454ab0d0eea663e791e3" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:04:44.814851 20106 raft_consensus.cc:2468] T 1f85fc4b527a48848e5faa083b604e36 P 127766fc592545a4997f7790f50f6076 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 2.
I20260709 13:04:44.838016 19556 raft_consensus.cc:2468] T 1dc5b3532fe54f74876d02beffa2c230 P e61c3a8f61bb48f8a963c9480e53c168 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 1.
I20260709 13:04:44.846318 19482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dc5b3532fe54f74876d02beffa2c230" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:04:44.846449 19556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48824d5acfbc485ebf8c2d944e7202de" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:04:44.847373 19556 raft_consensus.cc:2410] T 48824d5acfbc485ebf8c2d944e7202de P e61c3a8f61bb48f8a963c9480e53c168 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0473d2b2d01f4459b1e90fd12cc7840e for term 3 because replica has last-logged OpId of term: 2 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260709 13:04:44.847747 20076 leader_election.cc:304] T 70797e5783b5454ab0d0eea663e791e3 P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 127766fc592545a4997f7790f50f6076, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:04:44.848336 20766 leader_election.cc:290] T 62c6c134d3d24a1ab144dd9ee6bc3f64 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:04:44.848591 20769 raft_consensus.cc:2804] T 70797e5783b5454ab0d0eea663e791e3 P 127766fc592545a4997f7790f50f6076 [term 1 FOLLOWER]: Leader pre-election won for term 2
W20260709 13:04:44.849221 19557 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40428 (request call id 1369) took 1727 ms (client timeout 1926 ms). Trace:
I20260709 13:04:44.849164 20076 leader_election.cc:304] T 2a16f7501e2444fb86d4e2778e734e02 P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 127766fc592545a4997f7790f50f6076, e61c3a8f61bb48f8a963c9480e53c168; no voters: e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:04:44.818090 20665 raft_consensus.cc:2804] T 7f575b143b844aa096b50997dad3516a P e5256d91808b47c195bc9b4dbd7f2b87 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:04:44.850033 19560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a61655d99124a29b486ba4a5b37faea" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:04:44.850438 20665 raft_consensus.cc:697] T 7f575b143b844aa096b50997dad3516a P e5256d91808b47c195bc9b4dbd7f2b87 [term 2 LEADER]: Becoming Leader. State: Replica: e5256d91808b47c195bc9b4dbd7f2b87, State: Running, Role: LEADER
I20260709 13:04:44.850900 20076 leader_election.cc:304] T ece3db938bc649d4a40a51522ed5259c P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 127766fc592545a4997f7790f50f6076, e61c3a8f61bb48f8a963c9480e53c168; no voters: e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:04:44.851269 19560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a08760e15aac4630a629431f56024dc8" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:04:44.851743 20595 raft_consensus.cc:2804] T 2a16f7501e2444fb86d4e2778e734e02 P 127766fc592545a4997f7790f50f6076 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:04:44.851375 20665 consensus_queue.cc:237] T 7f575b143b844aa096b50997dad3516a P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:44.852273 19560 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "65d8cb8d6ec64f459d5a47cefab10acf"
dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
mode: GRACEFUL
new_leader_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
 from {username='slave'} at 127.0.0.1:51880
I20260709 13:04:44.853492 19408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa731b585f684a7fb2d106c50f143b83" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:04:44.859872 19408 raft_consensus.cc:2468] T fa731b585f684a7fb2d106c50f143b83 P e5256d91808b47c195bc9b4dbd7f2b87 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 127766fc592545a4997f7790f50f6076 in term 1.
I20260709 13:04:44.848639 19405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36f6ba92b9ba46babe4ebd6c02e5fbd9" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:04:44.849205 19556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14935b3ddf914369822e4a0547aaa355" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:04:44.869302 19483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9f0d59553ad444883fcf5b5909f9798" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:04:44.869675 20109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70797e5783b5454ab0d0eea663e791e3" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
W20260709 13:04:44.849794 19557 rpcz_store.cc:269] 0709 13:04:43.121491 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:43.355133 (+233642us) service_pool.cc:224] Handling call
0709 13:04:44.849052 (+1493919us) spinlock_profiling.cc:243] Waited 895 ms on lock 0x7b540012b954. stack: 00007f4a79de9343 00007f4a79de9240 00007f4a797781d4 00007f4a834b6304 00007f4a834b6299 00007f4a7ce71571 00007f4a7cf0c2fa 00007f4a81ecdb17 00007f4a7b4486d4 00007f4a7b448662 00007f4a7b448591 00007f4a7b44850c 00007f4a7b4477c2 00007f4a7b24348c 00007f4a7b2428c6 00007f4a7b24226f
0709 13:04:44.849175 (+   123us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2058929408}
I20260709 13:04:44.871286 19407 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52328 (request call id 1067) took 1489 ms. Trace:
I20260709 13:04:44.849123 20769 raft_consensus.cc:493] T 70797e5783b5454ab0d0eea663e791e3 P 127766fc592545a4997f7790f50f6076 [term 1 FOLLOWER]: Starting leader election (detected failure of leader e5256d91808b47c195bc9b4dbd7f2b87)
I20260709 13:04:44.826740 20735 raft_consensus.cc:493] T 46c5bfeecc314717bffe987e6844b6d0 P e61c3a8f61bb48f8a963c9480e53c168 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 0473d2b2d01f4459b1e90fd12cc7840e)
I20260709 13:04:44.859274 19560 raft_consensus.cc:606] T 65d8cb8d6ec64f459d5a47cefab10acf P e61c3a8f61bb48f8a963c9480e53c168 [term 1 LEADER]: Received request to transfer leadership to TS e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:04:44.872200 19559 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40428 (request call id 1379) took 1730 ms. Trace:
I20260709 13:04:44.880892 19559 rpcz_store.cc:276] 0709 13:04:43.124358 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:44.804829 (+1680471us) service_pool.cc:224] Handling call
0709 13:04:44.820099 (+ 15270us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:04:44.845570 (+ 25471us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:04:44.845588 (+    18us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:04:44.854734 (+  9146us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:04:44.854785 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:44.854870 (+    85us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:44.854997 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:04:44.873968 19411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff9b0eddd810459b82d91c60777c10eb" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:04:44.874527 20769 raft_consensus.cc:3060] T 70797e5783b5454ab0d0eea663e791e3 P 127766fc592545a4997f7790f50f6076 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:44.874840 20075 leader_election.cc:304] T 85c494af21f9457a85da47b9bc70c1fd P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 127766fc592545a4997f7790f50f6076; no voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:04:44.884588 19483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22196caba61445d3bec98a0aab3c337d" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:04:44.885165 19483 raft_consensus.cc:2468] T 22196caba61445d3bec98a0aab3c337d P 0473d2b2d01f4459b1e90fd12cc7840e [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 1.
I20260709 13:04:44.875710 19556 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40438 (request call id 1088) took 1486 ms. Trace:
I20260709 13:04:44.840003 19551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40e1e16737a842ee936002830f36882e" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:04:44.876310 19482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14935b3ddf914369822e4a0547aaa355" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:04:44.876874 19481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14efcc79969f41babe5529c22d59156d" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:04:44.886924 19481 raft_consensus.cc:2468] T 14efcc79969f41babe5529c22d59156d P 0473d2b2d01f4459b1e90fd12cc7840e [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 2.
I20260709 13:04:44.887946 19560 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40438 (request call id 1091) took 1498 ms. Trace:
I20260709 13:04:44.888734 19478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cdf56e38bbc453d9438d359e5a69955" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:04:44.889120 19484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9962423cb4e54fcfa5de01daf68a86e7" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:04:44.889353 19478 raft_consensus.cc:2468] T 0cdf56e38bbc453d9438d359e5a69955 P 0473d2b2d01f4459b1e90fd12cc7840e [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 2.
I20260709 13:04:44.890205 19484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df751f992649444090e27965eb1af85d" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:04:44.890908 20682 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 309c3ca0ca4b4f3ba129752ea2cb293b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:44.891033 19481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a08760e15aac4630a629431f56024dc8" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:04:44.891316 19485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36f6ba92b9ba46babe4ebd6c02e5fbd9" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:04:44.890287 19478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2725d2c4cb054f18b0fc8f735c15f6c2" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:04:44.892190 19478 raft_consensus.cc:2468] T 2725d2c4cb054f18b0fc8f735c15f6c2 P 0473d2b2d01f4459b1e90fd12cc7840e [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 1.
I20260709 13:04:44.877647 19554 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40438 (request call id 1090) took 1488 ms. Trace:
I20260709 13:04:44.878849 19553 raft_consensus.cc:1240] T f1b10566f45d4a7d9029858330e02d5b P e61c3a8f61bb48f8a963c9480e53c168 [term 3 FOLLOWER]: Rejecting Update request from peer 0473d2b2d01f4459b1e90fd12cc7840e for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 13:04:44.852157 20595 raft_consensus.cc:493] T 2a16f7501e2444fb86d4e2778e734e02 P 127766fc592545a4997f7790f50f6076 [term 2 FOLLOWER]: Starting leader election (detected failure of leader e5256d91808b47c195bc9b4dbd7f2b87)
I20260709 13:04:44.871711 19407 rpcz_store.cc:276] 0709 13:04:43.381707 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:43.915753 (+534046us) service_pool.cc:224] Handling call
0709 13:04:44.105396 (+189643us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:04:44.744149 (+638753us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:44.871072 (+126923us) spinlock_profiling.cc:243] Waited 628 ms on lock 0x7b54000e6ad4. stack: 00007f4a79de9343 00007f4a79de9240 00007f4a797781d4 00007f4a834b6304 00007f4a834b6299 00007f4a7ce71571 00007f4a7cf08e01 00007f4a7cf0783e 00007f4a81ecc419 00007f4a7b443bd4 00007f4a7b443b62 00007f4a7b443a91 00007f4a7b443a0c 00007f4a7b442cc2 00007f4a7b24348c 00007f4a7b2428c6
0709 13:04:44.871234 (+   162us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1444180224}
I20260709 13:04:44.882606 20110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36f6ba92b9ba46babe4ebd6c02e5fbd9" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:04:44.885732 19556 rpcz_store.cc:276] 0709 13:04:43.388911 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:44.874916 (+1486005us) service_pool.cc:224] Handling call
0709 13:04:44.875204 (+   288us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:04:44.875403 (+   199us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:04:44.875426 (+    23us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:04:44.875466 (+    40us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:04:44.875494 (+    28us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:44.875542 (+    48us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:44.875632 (+    90us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:04:44.837991 20762 consensus_queue.cc:1059] T 833a2f0775ed407a94b8924ce50adb63 P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.044s
I20260709 13:04:44.887885 19479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a61655d99124a29b486ba4a5b37faea" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:04:44.888458 19560 rpcz_store.cc:276] 0709 13:04:43.389637 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:44.887235 (+1497598us) service_pool.cc:224] Handling call
0709 13:04:44.887500 (+   265us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:04:44.887653 (+   153us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:04:44.887676 (+    23us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:04:44.887715 (+    39us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:04:44.887759 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:44.887810 (+    51us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:44.887897 (+    87us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:04:44.890763 19484 raft_consensus.cc:3060] T df751f992649444090e27965eb1af85d P 0473d2b2d01f4459b1e90fd12cc7840e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:44.835973 20763 raft_consensus.cc:515] T 1efebf73c86e432baa55533136b6e12c P 127766fc592545a4997f7790f50f6076 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:04:44.891912 19485 raft_consensus.cc:2468] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P 0473d2b2d01f4459b1e90fd12cc7840e [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 2.
I20260709 13:04:44.848351 20642 leader_election.cc:290] T edd7d470b5014c9489be7f41f64355c9 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 2 election: Requested vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:04:44.895499 19482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "775c229504194560ba9589bc2199b089" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:04:44.891741 19481 raft_consensus.cc:2468] T a08760e15aac4630a629431f56024dc8 P 0473d2b2d01f4459b1e90fd12cc7840e [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 1.
I20260709 13:04:44.871727 20785 raft_consensus.cc:2804] T ece3db938bc649d4a40a51522ed5259c P 127766fc592545a4997f7790f50f6076 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:04:44.906765 19479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff9b0eddd810459b82d91c60777c10eb" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:04:44.897502 19557 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40438 (request call id 1089) took 1505 ms. Trace:
I20260709 13:04:44.907401 19557 rpcz_store.cc:276] 0709 13:04:43.389167 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:44.875404 (+1486237us) service_pool.cc:224] Handling call
0709 13:04:44.875652 (+   248us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:04:44.884754 (+  9102us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:04:44.884796 (+    42us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:04:44.894488 (+  9692us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:04:44.894553 (+    65us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:44.894638 (+    85us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:44.894806 (+   168us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:04:44.883666 20735 raft_consensus.cc:3060] T 46c5bfeecc314717bffe987e6844b6d0 P e61c3a8f61bb48f8a963c9480e53c168 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:04:44.899586 19478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed7fdbcb96d14d418db9ca90a792588a" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:04:44.889148 19480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40e1e16737a842ee936002830f36882e" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:04:44.901496 20595 raft_consensus.cc:3060] T 2a16f7501e2444fb86d4e2778e734e02 P 127766fc592545a4997f7790f50f6076 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:04:44.917043 19560 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40438 (request call id 1096) took 1526 ms. Trace:
I20260709 13:04:44.922398 19479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ec1c4ce15e04c7e8c283a62179f2a64" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:04:44.922116 19560 rpcz_store.cc:276] 0709 13:04:43.394829 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:44.901421 (+1506592us) service_pool.cc:224] Handling call
0709 13:04:44.901670 (+   249us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:04:44.908475 (+  6805us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:04:44.908504 (+    29us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:04:44.908547 (+    43us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:04:44.916706 (+  8159us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:44.916809 (+   103us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:44.916970 (+   161us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:04:44.919268 19478 raft_consensus.cc:2468] T ed7fdbcb96d14d418db9ca90a792588a P 0473d2b2d01f4459b1e90fd12cc7840e [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 127766fc592545a4997f7790f50f6076 in term 1.
I20260709 13:04:44.896968 20776 raft_consensus.cc:515] T 21e14947d70440f19044d8f75c31e1f9 P e5256d91808b47c195bc9b4dbd7f2b87 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:44.920300 19556 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40438 (request call id 1094) took 1529 ms. Trace:
I20260709 13:04:44.902225 20737 raft_consensus.cc:2749] T 85c494af21f9457a85da47b9bc70c1fd P 127766fc592545a4997f7790f50f6076 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:04:44.929885 20776 leader_election.cc:290] T 21e14947d70440f19044d8f75c31e1f9 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 2 election: Requested vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:04:44.921106 19485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62c6c134d3d24a1ab144dd9ee6bc3f64" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:04:44.930511 19409 raft_consensus.cc:1240] T 21e14947d70440f19044d8f75c31e1f9 P e5256d91808b47c195bc9b4dbd7f2b87 [term 2 FOLLOWER]: Rejecting Update request from peer e61c3a8f61bb48f8a963c9480e53c168 for earlier term 1. Current term is 2. Ops: []
I20260709 13:04:44.923707 19556 rpcz_store.cc:276] 0709 13:04:43.390382 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:44.899273 (+1508891us) service_pool.cc:224] Handling call
0709 13:04:44.899553 (+   280us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:04:44.909538 (+  9985us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:04:44.909570 (+    32us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:04:44.920038 (+ 10468us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:04:44.920078 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:44.920146 (+    68us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:44.920252 (+   106us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:04:44.932406 19556 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40438 (request call id 1098) took 1536 ms. Trace:
I20260709 13:04:44.932734 19556 rpcz_store.cc:276] 0709 13:04:43.395505 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:44.931707 (+1536202us) service_pool.cc:224] Handling call
0709 13:04:44.931968 (+   261us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:04:44.932138 (+   170us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:04:44.932163 (+    25us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:04:44.932198 (+    35us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:04:44.932224 (+    26us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:44.932272 (+    48us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:44.932356 (+    84us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:04:44.934142 19556 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40438 (request call id 1101) took 1537 ms. Trace:
I20260709 13:04:44.934237 19411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76cb037fc9064d13b59a8969d897ce8c" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:04:44.935081 19481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "172b3dd13109415a955b71ac0e9d2234" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:04:44.935477 19406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86a6797bdfe94fa496c050ceae4bd0d9" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:04:44.925204 19482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edd7d470b5014c9489be7f41f64355c9" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:04:44.936800 19482 raft_consensus.cc:3060] T edd7d470b5014c9489be7f41f64355c9 P 0473d2b2d01f4459b1e90fd12cc7840e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:44.937023 20105 raft_consensus.cc:1240] T 1efebf73c86e432baa55533136b6e12c P 127766fc592545a4997f7790f50f6076 [term 2 FOLLOWER]: Rejecting Update request from peer e61c3a8f61bb48f8a963c9480e53c168 for earlier term 1. Current term is 2. Ops: []
I20260709 13:04:44.937697 19552 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40428 (request call id 1365) took 1819 ms. Trace:
I20260709 13:04:44.903435 20076 leader_election.cc:304] T 62c6c134d3d24a1ab144dd9ee6bc3f64 P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 127766fc592545a4997f7790f50f6076, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:04:44.927595 19407 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ece3db938bc649d4a40a51522ed5259c"
dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
mode: GRACEFUL
new_leader_uuid: "127766fc592545a4997f7790f50f6076"
 from {username='slave'} at 127.0.0.1:37312
I20260709 13:04:44.934432 19556 rpcz_store.cc:276] 0709 13:04:43.396414 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:44.933498 (+1537084us) service_pool.cc:224] Handling call
0709 13:04:44.933726 (+   228us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:04:44.933888 (+   162us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:04:44.933910 (+    22us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:04:44.933945 (+    35us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:04:44.933970 (+    25us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:44.934016 (+    46us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:44.934098 (+    82us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:04:44.899662 20103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62c6c134d3d24a1ab144dd9ee6bc3f64" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:04:44.894207 20734 raft_consensus.cc:515] T 9962423cb4e54fcfa5de01daf68a86e7 P 127766fc592545a4997f7790f50f6076 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:04:44.928174 20724 leader_election.cc:290] T f1b10566f45d4a7d9029858330e02d5b P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 3 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:04:44.909373 20075 leader_election.cc:304] T 65d8cb8d6ec64f459d5a47cefab10acf P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 127766fc592545a4997f7790f50f6076; no voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168
W20260709 13:04:44.907871 19402 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52328 (request call id 1065) took 1524 ms (client timeout 1628 ms). Trace:
I20260709 13:04:44.945156 19405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40e1e16737a842ee936002830f36882e" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:04:44.951064 20111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85c494af21f9457a85da47b9bc70c1fd" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:04:44.939805 19407 raft_consensus.cc:606] T ece3db938bc649d4a40a51522ed5259c P e5256d91808b47c195bc9b4dbd7f2b87 [term 1 LEADER]: Received request to transfer leadership to TS 127766fc592545a4997f7790f50f6076
I20260709 13:04:44.948773 19556 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40438 (request call id 1103) took 1551 ms. Trace:
I20260709 13:04:44.907197 20785 raft_consensus.cc:493] T ece3db938bc649d4a40a51522ed5259c P 127766fc592545a4997f7790f50f6076 [term 1 FOLLOWER]: Starting leader election (detected failure of leader e5256d91808b47c195bc9b4dbd7f2b87)
I20260709 13:04:44.951799 19556 rpcz_store.cc:276] 0709 13:04:43.397013 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:44.940354 (+1543341us) service_pool.cc:224] Handling call
0709 13:04:44.943878 (+  3524us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:04:44.948557 (+  4679us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:04:44.948575 (+    18us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:04:44.948603 (+    28us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:04:44.948621 (+    18us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:44.948663 (+    42us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:44.948734 (+    71us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:04:44.951356 19405 raft_consensus.cc:2468] T 40e1e16737a842ee936002830f36882e P e5256d91808b47c195bc9b4dbd7f2b87 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 2.
I20260709 13:04:45.000541 20110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff9b0eddd810459b82d91c60777c10eb" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
W20260709 13:04:44.999130 19526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.2:46257, user_credentials={real_user=slave}} blocked reactor thread for 48095.1us
I20260709 13:04:45.008179 19406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22196caba61445d3bec98a0aab3c337d" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:04:45.008611 19406 raft_consensus.cc:2468] T 22196caba61445d3bec98a0aab3c337d P e5256d91808b47c195bc9b4dbd7f2b87 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 1.
I20260709 13:04:44.938083 19552 rpcz_store.cc:276] 0709 13:04:43.118002 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:43.135941 (+ 17939us) service_pool.cc:224] Handling call
0709 13:04:43.136348 (+   407us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:04:44.371555 (+1235207us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:04:44.373289 (+  1734us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:04:44.376695 (+  3406us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:04:44.378408 (+  1713us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:44.937462 (+559054us) spinlock_profiling.cc:243] Waited 1.21 s on lock 0x7b5400125054. stack: 00007f4a79de9343 00007f4a79de9240 00007f4a797781d4 00007f4a834b6304 00007f4a834b6299 00007f4a7ce71571 00007f4a7cf08e01 00007f4a7cf0783e 00007f4a81ecc419 00007f4a7b443bd4 00007f4a7b443b62 00007f4a7b443a91 00007f4a7b443a0c 00007f4a7b442cc2 00007f4a7b24348c 00007f4a7b2428c6
0709 13:04:44.937510 (+    48us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:44.937631 (+   121us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2775484288}
I20260709 13:04:45.007156 19556 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40438 (request call id 1108) took 1537 ms. Trace:
I20260709 13:04:45.010286 19556 rpcz_store.cc:276] 0709 13:04:43.471239 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:44.961194 (+1489955us) service_pool.cc:224] Handling call
0709 13:04:44.961531 (+   337us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:04:45.006853 (+ 45322us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:04:45.006880 (+    27us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:04:45.006925 (+    45us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:04:45.006953 (+    28us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:45.007013 (+    60us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:45.007106 (+    93us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:04:44.940510 19480 raft_consensus.cc:2468] T 40e1e16737a842ee936002830f36882e P 0473d2b2d01f4459b1e90fd12cc7840e [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 2.
I20260709 13:04:44.895892 19554 rpcz_store.cc:276] 0709 13:04:43.389399 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:44.876860 (+1487461us) service_pool.cc:224] Handling call
0709 13:04:44.877130 (+   270us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:04:44.877329 (+   199us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:04:44.877356 (+    27us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:04:44.877407 (+    51us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:04:44.877443 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:44.877500 (+    57us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:44.877597 (+    97us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:04:45.020351 20075 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.1:40321, user_credentials={real_user=slave}} blocked reactor thread for 111111us
I20260709 13:04:45.009851 20730 raft_consensus.cc:2749] T 65d8cb8d6ec64f459d5a47cefab10acf P 127766fc592545a4997f7790f50f6076 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:04:45.020749 19478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46c5bfeecc314717bffe987e6844b6d0" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:04:45.021453 19408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df751f992649444090e27965eb1af85d" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:04:45.029768 19408 raft_consensus.cc:2393] T df751f992649444090e27965eb1af85d P e5256d91808b47c195bc9b4dbd7f2b87 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0473d2b2d01f4459b1e90fd12cc7840e in current term 2: Already voted for candidate e5256d91808b47c195bc9b4dbd7f2b87 in this term.
I20260709 13:04:45.023097 19557 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40438 (request call id 1097) took 1616 ms. Trace:
I20260709 13:04:45.027720 19482 raft_consensus.cc:2468] T edd7d470b5014c9489be7f41f64355c9 P 0473d2b2d01f4459b1e90fd12cc7840e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 2.
I20260709 13:04:44.950567 20771 leader_election.cc:290] T 2e36a9d6e29c4a7c860cf267efbd4c74 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:04:45.030089 19557 rpcz_store.cc:276] 0709 13:04:43.395206 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:44.924777 (+1529571us) service_pool.cc:224] Handling call
0709 13:04:44.951685 (+ 26908us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:04:45.011605 (+ 59920us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:04:45.011645 (+    40us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:04:45.011714 (+    69us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:04:45.011758 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:45.011835 (+    77us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:45.011958 (+   123us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:04:44.998963 20785 raft_consensus.cc:3060] T ece3db938bc649d4a40a51522ed5259c P 127766fc592545a4997f7790f50f6076 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:04:44.955513 20076 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.3:36891, user_credentials={real_user=slave}} blocked reactor thread for 53666.9us
I20260709 13:04:44.949745 20103 raft_consensus.cc:2468] T 62c6c134d3d24a1ab144dd9ee6bc3f64 P 127766fc592545a4997f7790f50f6076 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 1.
I20260709 13:04:45.005950 20655 leader_election.cc:290] T 22196caba61445d3bec98a0aab3c337d P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:04:45.043180 19556 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40438 (request call id 1111) took 1045 ms. Trace:
I20260709 13:04:45.046847 19482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b74109013a140ada21feeef92d6f563" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:04:44.951920 20764 raft_consensus.cc:515] T 0e1085d23e8347fbbd5bce7542f4b1f4 P 127766fc592545a4997f7790f50f6076 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:04:45.052969 19450 leader_election.cc:304] T 7be9efa6559648dbb5a0f7684c4542d1 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168; no voters: e5256d91808b47c195bc9b4dbd7f2b87
W20260709 13:04:44.951136 19402 rpcz_store.cc:269] 0709 13:04:43.381064 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:43.383487 (+  2423us) service_pool.cc:224] Handling call
0709 13:04:44.897256 (+1513769us) spinlock_profiling.cc:243] Waited 883 ms on lock 0x7b5400249d54. stack: 00007f4a79de9343 00007f4a79de9240 00007f4a797781d4 00007f4a834b6304 00007f4a834b6299 00007f4a7ce71571 00007f4a7cf0c2fa 00007f4a81ecdb17 00007f4a7b4486d4 00007f4a7b448662 00007f4a7b448591 00007f4a7b44850c 00007f4a7b4477c2 00007f4a7b24348c 00007f4a7b2428c6 00007f4a7b24226f
0709 13:04:44.905892 (+  8636us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2031000960}
I20260709 13:04:45.064345 19407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff9b0eddd810459b82d91c60777c10eb" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:04:45.054633 19478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7be9efa6559648dbb5a0f7684c4542d1" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:04:45.062918 19411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc225c93219c45538b53a1bd3d387e4d" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:04:45.063916 19408 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ff9b0eddd810459b82d91c60777c10eb"
dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
mode: GRACEFUL
new_leader_uuid: "127766fc592545a4997f7790f50f6076"
 from {username='slave'} at 127.0.0.1:37312
I20260709 13:04:45.048287 19556 rpcz_store.cc:276] 0709 13:04:44.012916 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:45.011245 (+998329us) service_pool.cc:224] Handling call
0709 13:04:45.011501 (+   256us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:04:45.029555 (+ 18054us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:04:45.029581 (+    26us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:04:45.039246 (+  9665us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:04:45.042721 (+  3475us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:45.042847 (+   126us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:45.043089 (+   242us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:04:45.054256 19480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e5873a19244c5ebbcd38e126796ee7" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:04:45.045327 20724 consensus_queue.cc:1048] T 0cdf56e38bbc453d9438d359e5a69955 P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.052s
I20260709 13:04:45.093901 19408 raft_consensus.cc:606] T ff9b0eddd810459b82d91c60777c10eb P e5256d91808b47c195bc9b4dbd7f2b87 [term 1 LEADER]: Received request to transfer leadership to TS 127766fc592545a4997f7790f50f6076
W20260709 13:04:45.090510 19374 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.4:43121, user_credentials={real_user=slave}} blocked reactor thread for 111542us
I20260709 13:04:45.075074 19405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f93ee515a9c14139bf566522ed8232f3" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:04:45.100194 19450 leader_election.cc:304] T 86a6797bdfe94fa496c050ceae4bd0d9 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:04:45.104651 18300 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 6
W20260709 13:04:45.105628 20790 log.cc:927] Time spent T 7f575b143b844aa096b50997dad3516a P e5256d91808b47c195bc9b4dbd7f2b87: Append to log took a long time: real 0.055s	user 0.000s	sys 0.000s
I20260709 13:04:45.107331 18300 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:04:45.048460 20737 raft_consensus.cc:2804] T 62c6c134d3d24a1ab144dd9ee6bc3f64 P 127766fc592545a4997f7790f50f6076 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:04:45.115206 20740 raft_consensus.cc:493] T d1e5873a19244c5ebbcd38e126796ee7 P 0473d2b2d01f4459b1e90fd12cc7840e [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e5256d91808b47c195bc9b4dbd7f2b87)
I20260709 13:04:45.117389 20740 raft_consensus.cc:515] T d1e5873a19244c5ebbcd38e126796ee7 P 0473d2b2d01f4459b1e90fd12cc7840e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:45.119946 20740 leader_election.cc:290] T d1e5873a19244c5ebbcd38e126796ee7 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:04:45.121711 20075 leader_election.cc:304] T fa731b585f684a7fb2d106c50f143b83 P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 127766fc592545a4997f7790f50f6076, e5256d91808b47c195bc9b4dbd7f2b87; no voters: e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:04:45.057264 19403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28af091831594f9d8e96482078cc7625" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:04:45.075472 19481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96efeaaf1057492490e9a621f37e1a2d" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:04:45.056740 19404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e36a9d6e29c4a7c860cf267efbd4c74" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:04:45.098141 20742 raft_consensus.cc:2804] T 7be9efa6559648dbb5a0f7684c4542d1 P 0473d2b2d01f4459b1e90fd12cc7840e [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:04:45.098116 19551 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40438 (request call id 1107) took 1628 ms. Trace:
I20260709 13:04:45.127235 19450 leader_election.cc:304] T bc225c93219c45538b53a1bd3d387e4d P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:04:45.134709 19450 leader_election.cc:304] T f93ee515a9c14139bf566522ed8232f3 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:04:45.123430 20715 raft_consensus.cc:2804] T 86a6797bdfe94fa496c050ceae4bd0d9 P 0473d2b2d01f4459b1e90fd12cc7840e [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:04:45.133777 19409 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52328 (request call id 1071) took 1742 ms. Trace:
I20260709 13:04:45.152547 19409 rpcz_store.cc:276] 0709 13:04:43.391530 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:44.391719 (+1000189us) service_pool.cc:224] Handling call
0709 13:04:44.399544 (+  7825us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:04:44.930938 (+531394us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:45.133451 (+202513us) spinlock_profiling.cc:243] Waited 531 ms on lock 0x7b5400196754. stack: 00007f4a79de9343 00007f4a79de9240 00007f4a797781d4 00007f4a834b6304 00007f4a834b6299 00007f4a7ce71571 00007f4a7cf08e01 00007f4a7cf0783e 00007f4a81ecc419 00007f4a7b443bd4 00007f4a7b443b62 00007f4a7b443a91 00007f4a7b443a0c 00007f4a7b442cc2 00007f4a7b24348c 00007f4a7b2428c6
0709 13:04:45.133699 (+   248us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1220775680}
I20260709 13:04:45.155921 19555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b08304a0a02b42d7840c4e8ee9a6bd1a" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:04:45.131479 20742 raft_consensus.cc:493] T 7be9efa6559648dbb5a0f7684c4542d1 P 0473d2b2d01f4459b1e90fd12cc7840e [term 1 FOLLOWER]: Starting leader election (detected failure of leader e5256d91808b47c195bc9b4dbd7f2b87)
I20260709 13:04:45.162966 20112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9962423cb4e54fcfa5de01daf68a86e7" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:04:45.168524 19555 raft_consensus.cc:2468] T b08304a0a02b42d7840c4e8ee9a6bd1a P e61c3a8f61bb48f8a963c9480e53c168 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 1.
I20260709 13:04:45.144722 20752 raft_consensus.cc:2804] T bc225c93219c45538b53a1bd3d387e4d P 0473d2b2d01f4459b1e90fd12cc7840e [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:04:45.171916 20112 raft_consensus.cc:2393] T 9962423cb4e54fcfa5de01daf68a86e7 P 127766fc592545a4997f7790f50f6076 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e5256d91808b47c195bc9b4dbd7f2b87 in current term 2: Already voted for candidate 127766fc592545a4997f7790f50f6076 in this term.
W20260709 13:04:45.173947 20075 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.1:40321, user_credentials={real_user=slave}} blocked reactor thread for 52361.8us
I20260709 13:04:45.175040 20797 raft_consensus.cc:2804] T fa731b585f684a7fb2d106c50f143b83 P 127766fc592545a4997f7790f50f6076 [term 1 FOLLOWER]: Leader pre-election won for term 2
W20260709 13:04:45.179391 19450 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.3:36891, user_credentials={real_user=slave}} blocked reactor thread for 44783.6us
I20260709 13:04:45.179675 20799 raft_consensus.cc:2804] T f93ee515a9c14139bf566522ed8232f3 P 0473d2b2d01f4459b1e90fd12cc7840e [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:04:45.155550 20715 raft_consensus.cc:493] T 86a6797bdfe94fa496c050ceae4bd0d9 P 0473d2b2d01f4459b1e90fd12cc7840e [term 1 FOLLOWER]: Starting leader election (detected failure of leader e5256d91808b47c195bc9b4dbd7f2b87)
I20260709 13:04:45.142308 19404 raft_consensus.cc:2468] T 2e36a9d6e29c4a7c860cf267efbd4c74 P e5256d91808b47c195bc9b4dbd7f2b87 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 1.
I20260709 13:04:45.172441 20742 raft_consensus.cc:3060] T 7be9efa6559648dbb5a0f7684c4542d1 P 0473d2b2d01f4459b1e90fd12cc7840e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:45.176285 20752 raft_consensus.cc:493] T bc225c93219c45538b53a1bd3d387e4d P 0473d2b2d01f4459b1e90fd12cc7840e [term 1 FOLLOWER]: Starting leader election (detected failure of leader e5256d91808b47c195bc9b4dbd7f2b87)
I20260709 13:04:45.181866 20763 leader_election.cc:290] T 1efebf73c86e432baa55533136b6e12c P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 2 election: Requested vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:04:45.202976 20734 leader_election.cc:290] T 9962423cb4e54fcfa5de01daf68a86e7 P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 2 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:04:45.195037 19450 leader_election.cc:304] T 76cb037fc9064d13b59a8969d897ce8c P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
W20260709 13:04:45.202593 20791 log.cc:927] Time spent T 48824d5acfbc485ebf8c2d944e7202de P 0473d2b2d01f4459b1e90fd12cc7840e: Append to log took a long time: real 0.065s	user 0.000s	sys 0.000s
I20260709 13:04:45.184312 20797 raft_consensus.cc:493] T fa731b585f684a7fb2d106c50f143b83 P 127766fc592545a4997f7790f50f6076 [term 1 FOLLOWER]: Starting leader election (detected failure of leader e61c3a8f61bb48f8a963c9480e53c168)
I20260709 13:04:45.192448 20715 raft_consensus.cc:3060] T 86a6797bdfe94fa496c050ceae4bd0d9 P 0473d2b2d01f4459b1e90fd12cc7840e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:45.190758 19552 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40438 (request call id 1112) took 1040 ms. Trace:
I20260709 13:04:45.191815 20799 raft_consensus.cc:493] T f93ee515a9c14139bf566522ed8232f3 P 0473d2b2d01f4459b1e90fd12cc7840e [term 1 FOLLOWER]: Starting leader election (detected failure of leader e5256d91808b47c195bc9b4dbd7f2b87)
I20260709 13:04:45.194139 19481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff75a1d4cb1f493db8f71ddc136ba9ab" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:04:45.133785 19551 rpcz_store.cc:276] 0709 13:04:43.461892 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:44.947635 (+1485743us) service_pool.cc:224] Handling call
0709 13:04:44.955396 (+  7761us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:04:45.028958 (+ 73562us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:04:45.037669 (+  8711us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:04:45.042406 (+  4737us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:04:45.045654 (+  3248us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:45.051157 (+  5503us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:45.088833 (+ 37676us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:04:45.215094 19450 leader_election.cc:304] T 28af091831594f9d8e96482078cc7625 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:04:45.205176 20752 raft_consensus.cc:3060] T bc225c93219c45538b53a1bd3d387e4d P 0473d2b2d01f4459b1e90fd12cc7840e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:45.220893 19404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9962423cb4e54fcfa5de01daf68a86e7" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
I20260709 13:04:45.221864 20103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f85fc4b527a48848e5faa083b604e36" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076"
I20260709 13:04:45.222554 19553 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40428 (request call id 1378) took 2098 ms. Trace:
I20260709 13:04:45.225958 19484 raft_consensus.cc:2468] T df751f992649444090e27965eb1af85d P 0473d2b2d01f4459b1e90fd12cc7840e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 2.
I20260709 13:04:45.242093 19484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1b10566f45d4a7d9029858330e02d5b" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:04:45.213313 20797 raft_consensus.cc:3060] T fa731b585f684a7fb2d106c50f143b83 P 127766fc592545a4997f7790f50f6076 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:45.232256 19480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86a6797bdfe94fa496c050ceae4bd0d9" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:04:45.218914 20740 raft_consensus.cc:2804] T 76cb037fc9064d13b59a8969d897ce8c P 0473d2b2d01f4459b1e90fd12cc7840e [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:04:45.214329 19554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1efebf73c86e432baa55533136b6e12c" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:04:45.247404 19484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc225c93219c45538b53a1bd3d387e4d" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:04:45.219551 20799 raft_consensus.cc:3060] T f93ee515a9c14139bf566522ed8232f3 P 0473d2b2d01f4459b1e90fd12cc7840e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:45.243188 19404 raft_consensus.cc:3060] T 9962423cb4e54fcfa5de01daf68a86e7 P e5256d91808b47c195bc9b4dbd7f2b87 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:04:45.254796 20800 log.cc:927] Time spent T f1b10566f45d4a7d9029858330e02d5b P e5256d91808b47c195bc9b4dbd7f2b87: Append to log took a long time: real 0.074s	user 0.000s	sys 0.002s
I20260709 13:04:45.248485 20740 raft_consensus.cc:493] T 76cb037fc9064d13b59a8969d897ce8c P 0473d2b2d01f4459b1e90fd12cc7840e [term 1 FOLLOWER]: Starting leader election (detected failure of leader e5256d91808b47c195bc9b4dbd7f2b87)
I20260709 13:04:45.253983 20595 raft_consensus.cc:515] T 2a16f7501e2444fb86d4e2778e734e02 P 127766fc592545a4997f7790f50f6076 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:04:45.261826 19481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dc5b3532fe54f74876d02beffa2c230" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
W20260709 13:04:45.264365 19450 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.3:36891, user_credentials={real_user=slave}} blocked reactor thread for 49343us
I20260709 13:04:45.257838 20735 raft_consensus.cc:515] T 46c5bfeecc314717bffe987e6844b6d0 P e61c3a8f61bb48f8a963c9480e53c168 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:45.268024 20769 raft_consensus.cc:515] T 70797e5783b5454ab0d0eea663e791e3 P 127766fc592545a4997f7790f50f6076 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:04:45.269062 20735 leader_election.cc:290] T 46c5bfeecc314717bffe987e6844b6d0 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 3 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:04:45.243076 20103 raft_consensus.cc:2376] T 1f85fc4b527a48848e5faa083b604e36 P 127766fc592545a4997f7790f50f6076 [term 2 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 2. Re-sending same reply.
I20260709 13:04:45.270499 19481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa8650e71aa14778b3d73721fc50d9fc" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:04:45.264945 19559 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40438 (request call id 1092) took 1875 ms. Trace:
I20260709 13:04:45.272109 20110 raft_consensus.cc:1240] T 2a16f7501e2444fb86d4e2778e734e02 P 127766fc592545a4997f7790f50f6076 [term 3 FOLLOWER]: Rejecting Update request from peer e5256d91808b47c195bc9b4dbd7f2b87 for earlier term 2. Current term is 3. Ops: []
I20260709 13:04:45.215631 19552 rpcz_store.cc:276] 0709 13:04:44.162608 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:45.048865 (+886257us) service_pool.cc:224] Handling call
0709 13:04:45.115839 (+ 66974us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:04:45.133584 (+ 17745us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:04:45.138741 (+  5157us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:04:45.159742 (+ 21001us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:04:45.167430 (+  7688us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:45.176618 (+  9188us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:45.187700 (+ 11082us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:04:45.271437 19559 rpcz_store.cc:276] 0709 13:04:43.389880 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:44.896566 (+1506686us) service_pool.cc:224] Handling call
0709 13:04:44.917651 (+ 21085us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:04:44.939621 (+ 21970us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:04:44.939668 (+    47us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:04:44.944969 (+  5301us) log.cc:844] Serialized 26 byte log entry
0709 13:04:45.130636 (+185667us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:04:45.130699 (+    63us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:45.130765 (+    66us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:04:45.264785 (+134020us) raft_consensus.cc:1685] finished
0709 13:04:45.264812 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:45.264902 (+    90us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":15095,"raft.queue_time_us":19652,"raft.run_cpu_time_us":337,"raft.run_wall_time_us":53182,"thread_start_us":110209,"threads_started":1,"wal-append.queue_time_us":187970}
I20260709 13:04:45.276654 20107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c5eebf646ad445a9d1b1adc319d7b16" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:04:45.280874 19485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4509b76741dc428e9201c70c1658da13" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:04:45.281991 19485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e381f1d6b8184797ad142de49be225a8" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:04:45.265817 20740 raft_consensus.cc:3060] T 76cb037fc9064d13b59a8969d897ce8c P 0473d2b2d01f4459b1e90fd12cc7840e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:45.284998 19485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c5eebf646ad445a9d1b1adc319d7b16" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:04:45.288026 19402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7be9efa6559648dbb5a0f7684c4542d1" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:04:45.278026 19481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f93ee515a9c14139bf566522ed8232f3" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:04:45.241348 19553 rpcz_store.cc:276] 0709 13:04:43.124096 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:44.798631 (+1674535us) service_pool.cc:224] Handling call
0709 13:04:44.798990 (+   359us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:04:44.901291 (+102301us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:45.222270 (+320979us) spinlock_profiling.cc:243] Waited 73.9 ms on lock 0x7b54003093d4. stack: 00007f4a79de9343 00007f4a79de9240 00007f4a797781d4 00007f4a834b6304 00007f4a834b6299 00007f4a7ce71571 00007f4a7cf08e01 00007f4a7cf0783e 00007f4a81ecc419 00007f4a7b443bd4 00007f4a7b443b62 00007f4a7b443a91 00007f4a7b443a0c 00007f4a7b442cc2 00007f4a7b24348c 00007f4a7b2428c6
0709 13:04:45.222472 (+   202us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":170054528}
I20260709 13:04:45.291370 19403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76cb037fc9064d13b59a8969d897ce8c" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:04:45.298554 19407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b74109013a140ada21feeef92d6f563" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:04:45.304113 19554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70797e5783b5454ab0d0eea663e791e3" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:04:45.305899 19405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e5873a19244c5ebbcd38e126796ee7" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:04:45.305873 19485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e1f505cb0f1427bbd698ac889d80821" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:04:45.309634 19485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9f0d59553ad444883fcf5b5909f9798" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:04:45.286377 20803 raft_consensus.cc:2804] T 28af091831594f9d8e96482078cc7625 P 0473d2b2d01f4459b1e90fd12cc7840e [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:04:45.315059 19478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "179fd671030940b4b4a4e24bcc4aba0a" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:04:45.313548 19558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "217b5fae677b4971b3bbd2f357a1f7ff" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:04:45.313925 19485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1b10566f45d4a7d9029858330e02d5b" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:04:45.319694 19405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4509b76741dc428e9201c70c1658da13" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:04:45.321015 19485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "309c3ca0ca4b4f3ba129752ea2cb293b" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:04:45.321867 19485 raft_consensus.cc:2468] T 309c3ca0ca4b4f3ba129752ea2cb293b P 0473d2b2d01f4459b1e90fd12cc7840e [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 2.
I20260709 13:04:45.326253 19485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef32ce6fdd0e40d382c79974f30295c6" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:04:45.328439 19478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28af091831594f9d8e96482078cc7625" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:04:45.334358 19485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a61655d99124a29b486ba4a5b37faea" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:04:45.318284 20803 raft_consensus.cc:493] T 28af091831594f9d8e96482078cc7625 P 0473d2b2d01f4459b1e90fd12cc7840e [term 1 FOLLOWER]: Starting leader election (detected failure of leader e5256d91808b47c195bc9b4dbd7f2b87)
I20260709 13:04:45.336458 19478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "217b5fae677b4971b3bbd2f357a1f7ff" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:04:45.339669 19411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ece3db938bc649d4a40a51522ed5259c" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
W20260709 13:04:45.341392 20794 log.cc:927] Time spent T 96efeaaf1057492490e9a621f37e1a2d P 0473d2b2d01f4459b1e90fd12cc7840e: Append to log took a long time: real 0.089s	user 0.000s	sys 0.001s
I20260709 13:04:45.341586 19481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48824d5acfbc485ebf8c2d944e7202de" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:04:45.342948 19481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b08304a0a02b42d7840c4e8ee9a6bd1a" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:04:45.327630 19551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a16f7501e2444fb86d4e2778e734e02" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:04:45.344380 19408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a61655d99124a29b486ba4a5b37faea" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:04:45.331784 20744 raft_consensus.cc:3055] T 833a2f0775ed407a94b8924ce50adb63 P e61c3a8f61bb48f8a963c9480e53c168 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:04:45.359069 19406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86a6797bdfe94fa496c050ceae4bd0d9" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:04:45.357517 19526 leader_election.cc:304] T 96efeaaf1057492490e9a621f37e1a2d P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e61c3a8f61bb48f8a963c9480e53c168; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, 127766fc592545a4997f7790f50f6076
I20260709 13:04:45.339457 20803 raft_consensus.cc:3060] T 28af091831594f9d8e96482078cc7625 P 0473d2b2d01f4459b1e90fd12cc7840e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:45.344046 19481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62c6c134d3d24a1ab144dd9ee6bc3f64" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
W20260709 13:04:45.365408 19450 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.3:36891, user_credentials={real_user=slave}} blocked reactor thread for 56577.2us
I20260709 13:04:45.361398 19556 consensus_queue.cc:237] T df751f992649444090e27965eb1af85d P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } attrs { replace: true } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: NON_VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: true } }
I20260709 13:04:45.367739 20105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed7fdbcb96d14d418db9ca90a792588a" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:04:45.367906 20104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0afb57ae58a24a01850491d69f0213dd" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:04:45.371014 19406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "179fd671030940b4b4a4e24bcc4aba0a" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:04:45.373039 20112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48824d5acfbc485ebf8c2d944e7202de" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:04:45.356228 20744 raft_consensus.cc:740] T 833a2f0775ed407a94b8924ce50adb63 P e61c3a8f61bb48f8a963c9480e53c168 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e61c3a8f61bb48f8a963c9480e53c168, State: Running, Role: LEADER
I20260709 13:04:45.376893 19410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f93ee515a9c14139bf566522ed8232f3" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:04:45.378456 19526 leader_election.cc:304] T 309c3ca0ca4b4f3ba129752ea2cb293b P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:04:45.383162 19410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "309c3ca0ca4b4f3ba129752ea2cb293b" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:04:45.381440 19406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa8650e71aa14778b3d73721fc50d9fc" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:04:45.385870 20103 raft_consensus.cc:1240] T 9962423cb4e54fcfa5de01daf68a86e7 P 127766fc592545a4997f7790f50f6076 [term 2 FOLLOWER]: Rejecting Update request from peer 0473d2b2d01f4459b1e90fd12cc7840e for earlier term 1. Current term is 2. Ops: []
I20260709 13:04:45.386574 19408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e1f505cb0f1427bbd698ac889d80821" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:04:45.390053 20744 consensus_queue.cc:260] T 833a2f0775ed407a94b8924ce50adb63 P e61c3a8f61bb48f8a963c9480e53c168 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:04:45.370447 20742 raft_consensus.cc:515] T 7be9efa6559648dbb5a0f7684c4542d1 P 0473d2b2d01f4459b1e90fd12cc7840e [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:45.394330 20643 raft_consensus.cc:2804] T 309c3ca0ca4b4f3ba129752ea2cb293b P e61c3a8f61bb48f8a963c9480e53c168 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:04:45.409193 19483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab43d85f64114d4ebf618930e43d9ed0" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:04:45.409790 19483 raft_consensus.cc:2468] T ab43d85f64114d4ebf618930e43d9ed0 P 0473d2b2d01f4459b1e90fd12cc7840e [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 1.
I20260709 13:04:45.414086 19406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "217b5fae677b4971b3bbd2f357a1f7ff" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:04:45.407100 20735 raft_consensus.cc:2749] T 96efeaaf1057492490e9a621f37e1a2d P e61c3a8f61bb48f8a963c9480e53c168 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:04:45.417552 20737 raft_consensus.cc:493] T 62c6c134d3d24a1ab144dd9ee6bc3f64 P 127766fc592545a4997f7790f50f6076 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 0473d2b2d01f4459b1e90fd12cc7840e)
I20260709 13:04:45.417689 19486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff75a1d4cb1f493db8f71ddc136ba9ab" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:04:45.418028 20737 raft_consensus.cc:3060] T 62c6c134d3d24a1ab144dd9ee6bc3f64 P 127766fc592545a4997f7790f50f6076 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:45.407882 20643 raft_consensus.cc:493] T 309c3ca0ca4b4f3ba129752ea2cb293b P e61c3a8f61bb48f8a963c9480e53c168 [term 2 FOLLOWER]: Starting leader election (detected failure of leader e5256d91808b47c195bc9b4dbd7f2b87)
I20260709 13:04:45.411711 20107 raft_consensus.cc:1240] T 1f85fc4b527a48848e5faa083b604e36 P 127766fc592545a4997f7790f50f6076 [term 2 FOLLOWER]: Rejecting Update request from peer 0473d2b2d01f4459b1e90fd12cc7840e for earlier term 1. Current term is 2. Ops: []
I20260709 13:04:45.428661 19406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70797e5783b5454ab0d0eea663e791e3" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:04:45.438030 20595 leader_election.cc:290] T 2a16f7501e2444fb86d4e2778e734e02 P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 3 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:04:45.444257 20807 consensus_queue.cc:1059] T f1b10566f45d4a7d9029858330e02d5b P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:04:45.429600 20643 raft_consensus.cc:3060] T 309c3ca0ca4b4f3ba129752ea2cb293b P e61c3a8f61bb48f8a963c9480e53c168 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:04:45.446815 19482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76cb037fc9064d13b59a8969d897ce8c" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:04:45.458050 20797 raft_consensus.cc:515] T fa731b585f684a7fb2d106c50f143b83 P 127766fc592545a4997f7790f50f6076 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:04:45.456677 19409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14935b3ddf914369822e4a0547aaa355" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
W20260709 13:04:45.474990 19450 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.3:36891, user_credentials={real_user=slave}} blocked reactor thread for 58000.2us
I20260709 13:04:45.479063 19406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9f0d59553ad444883fcf5b5909f9798" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:04:45.479777 19406 raft_consensus.cc:2468] T b9f0d59553ad444883fcf5b5909f9798 P e5256d91808b47c195bc9b4dbd7f2b87 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 1.
I20260709 13:04:45.485518 19555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab43d85f64114d4ebf618930e43d9ed0" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:04:45.486572 20785 raft_consensus.cc:515] T ece3db938bc649d4a40a51522ed5259c P 127766fc592545a4997f7790f50f6076 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:04:45.487164 19309 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:44688 (request call id 220) took 5143 ms. Trace:
I20260709 13:04:45.487757 19555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df751f992649444090e27965eb1af85d" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:04:45.488221 20752 raft_consensus.cc:515] T bc225c93219c45538b53a1bd3d387e4d P 0473d2b2d01f4459b1e90fd12cc7840e [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:45.489027 19559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e1085d23e8347fbbd5bce7542f4b1f4" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:04:45.489358 19484 raft_consensus.cc:2393] T bc225c93219c45538b53a1bd3d387e4d P 0473d2b2d01f4459b1e90fd12cc7840e [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e61c3a8f61bb48f8a963c9480e53c168 in current term 2: Already voted for candidate 0473d2b2d01f4459b1e90fd12cc7840e in this term.
I20260709 13:04:45.493153 20799 raft_consensus.cc:515] T f93ee515a9c14139bf566522ed8232f3 P 0473d2b2d01f4459b1e90fd12cc7840e [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:45.494516 19556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "309c3ca0ca4b4f3ba129752ea2cb293b" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:04:45.499729 20078 leader_election.cc:304] T ff9b0eddd810459b82d91c60777c10eb P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 127766fc592545a4997f7790f50f6076; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:04:45.500862 20595 raft_consensus.cc:2749] T ff9b0eddd810459b82d91c60777c10eb P 127766fc592545a4997f7790f50f6076 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:04:45.501688 19480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14935b3ddf914369822e4a0547aaa355" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:04:45.501555 20803 raft_consensus.cc:515] T 28af091831594f9d8e96482078cc7625 P 0473d2b2d01f4459b1e90fd12cc7840e [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:45.502264 19482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21e14947d70440f19044d8f75c31e1f9" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:04:45.502813 19482 raft_consensus.cc:3060] T 21e14947d70440f19044d8f75c31e1f9 P 0473d2b2d01f4459b1e90fd12cc7840e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:45.501827 19555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e5873a19244c5ebbcd38e126796ee7" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:04:45.505079 19477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e36a9d6e29c4a7c860cf267efbd4c74" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:04:45.508069 20769 leader_election.cc:290] T 70797e5783b5454ab0d0eea663e791e3 P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 2 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:04:45.509508 20766 consensus_queue.cc:1059] T 1efebf73c86e432baa55533136b6e12c P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:04:45.506605 19523 leader_election.cc:304] T 62c6c134d3d24a1ab144dd9ee6bc3f64 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 127766fc592545a4997f7790f50f6076, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:04:45.509322 19482 raft_consensus.cc:2468] T 21e14947d70440f19044d8f75c31e1f9 P 0473d2b2d01f4459b1e90fd12cc7840e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 2.
I20260709 13:04:45.510861 20766 raft_consensus.cc:3055] T 1efebf73c86e432baa55533136b6e12c P e61c3a8f61bb48f8a963c9480e53c168 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:04:45.515486 20766 raft_consensus.cc:740] T 1efebf73c86e432baa55533136b6e12c P e61c3a8f61bb48f8a963c9480e53c168 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e61c3a8f61bb48f8a963c9480e53c168, State: Running, Role: LEADER
I20260709 13:04:45.511875 20728 raft_consensus.cc:2804] T 62c6c134d3d24a1ab144dd9ee6bc3f64 P e61c3a8f61bb48f8a963c9480e53c168 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:04:45.512241 19523 leader_election.cc:304] T 6c5eebf646ad445a9d1b1adc319d7b16 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e61c3a8f61bb48f8a963c9480e53c168; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, 127766fc592545a4997f7790f50f6076
I20260709 13:04:45.512456 19483 raft_consensus.cc:1240] T 7be9efa6559648dbb5a0f7684c4542d1 P 0473d2b2d01f4459b1e90fd12cc7840e [term 2 FOLLOWER]: Rejecting Update request from peer e5256d91808b47c195bc9b4dbd7f2b87 for earlier term 1. Current term is 2. Ops: []
I20260709 13:04:45.514153 19484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1efebf73c86e432baa55533136b6e12c" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:04:45.518026 19377 leader_election.cc:304] T 22196caba61445d3bec98a0aab3c337d P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87; no voters: 
I20260709 13:04:45.518476 19409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e381f1d6b8184797ad142de49be225a8" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:04:45.500823 20078 leader_election.cc:304] T 775c229504194560ba9589bc2199b089 P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 127766fc592545a4997f7790f50f6076; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:04:45.523839 20078 leader_election.cc:304] T ed7fdbcb96d14d418db9ca90a792588a P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, 127766fc592545a4997f7790f50f6076; no voters: e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:04:45.525731 20078 leader_election.cc:304] T 172b3dd13109415a955b71ac0e9d2234 P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 127766fc592545a4997f7790f50f6076; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:04:45.511456 19477 raft_consensus.cc:1240] T bc225c93219c45538b53a1bd3d387e4d P 0473d2b2d01f4459b1e90fd12cc7840e [term 2 FOLLOWER]: Rejecting Update request from peer e5256d91808b47c195bc9b4dbd7f2b87 for earlier term 1. Current term is 2. Ops: []
I20260709 13:04:45.526830 20595 raft_consensus.cc:2804] T ed7fdbcb96d14d418db9ca90a792588a P 127766fc592545a4997f7790f50f6076 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:04:45.527199 20595 raft_consensus.cc:493] T ed7fdbcb96d14d418db9ca90a792588a P 127766fc592545a4997f7790f50f6076 [term 1 FOLLOWER]: Starting leader election (detected failure of leader e61c3a8f61bb48f8a963c9480e53c168)
I20260709 13:04:45.527552 20595 raft_consensus.cc:3060] T ed7fdbcb96d14d418db9ca90a792588a P 127766fc592545a4997f7790f50f6076 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:04:45.527698 19523 consensus_peers.cc:597] T df751f992649444090e27965eb1af85d P e61c3a8f61bb48f8a963c9480e53c168 -> Peer 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121): Couldn't send request to peer 127766fc592545a4997f7790f50f6076. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: df751f992649444090e27965eb1af85d. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:45.514217 19481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9962423cb4e54fcfa5de01daf68a86e7" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:04:45.513892 19486 raft_consensus.cc:1275] T 7f575b143b844aa096b50997dad3516a P 0473d2b2d01f4459b1e90fd12cc7840e [term 2 FOLLOWER]: Refusing update from remote peer e5256d91808b47c195bc9b4dbd7f2b87: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:45.513427 20785 leader_election.cc:290] T ece3db938bc649d4a40a51522ed5259c P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 2 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:04:45.530479 19410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a16f7501e2444fb86d4e2778e734e02" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:04:45.530869 19411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e5873a19244c5ebbcd38e126796ee7" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:04:45.487566 19309 rpcz_store.cc:276] 0709 13:04:40.343558 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:40.344211 (+   653us) service_pool.cc:224] Handling call
0709 13:04:45.487089 (+5142878us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:04:44.272180 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:04:44.465751 (+193571us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:04:44.483148 (+ 17397us) write_op.cc:435] Acquired schema lock
0709 13:04:44.485483 (+  2335us) tablet.cc:662] Decoding operations
0709 13:04:44.575805 (+ 90322us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:04:44.609172 (+ 33367us) write_op.cc:641] Partition lock acquired for write op
0709 13:04:44.633787 (+ 24615us) tablet.cc:685] Acquiring locks for 1 operations
0709 13:04:44.634205 (+   418us) tablet.cc:701] Row locks acquired
0709 13:04:44.634272 (+    67us) write_op.cc:260] PREPARE: finished
0709 13:04:44.634472 (+   200us) write_op.cc:270] Start()
0709 13:04:44.634656 (+   184us) write_op.cc:276] Timestamp: P: 1783602284634407 usec, L: 0
0709 13:04:44.640305 (+  5649us) op_driver.cc:348] REPLICATION: starting
0709 13:04:44.655345 (+ 15040us) log.cc:844] Serialized 538 byte log entry
0709 13:04:45.094699 (+439354us) op_driver.cc:464] REPLICATION: finished
0709 13:04:45.203661 (+108962us) write_op.cc:301] APPLY: starting
0709 13:04:45.203733 (+    72us) tablet.cc:1367] starting BulkCheckPresence
0709 13:04:45.203823 (+    90us) tablet.cc:1370] finished BulkCheckPresence
0709 13:04:45.206832 (+  3009us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:04:45.207103 (+   271us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:04:45.207252 (+   149us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0709 13:04:45.207304 (+    52us) write_op.cc:312] APPLY: finished
0709 13:04:45.209632 (+  2328us) log.cc:844] Serialized 23 byte log entry
0709 13:04:45.209817 (+   185us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:04:45.209898 (+    81us) write_op.cc:454] Released schema lock
0709 13:04:45.209951 (+    53us) write_op.cc:341] FINISH: Updating metrics
0709 13:04:45.210306 (+   355us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:04:45.210334 (+    28us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":177,"reported_tablets":8,"child_traces":[["op",{"apply.queue_time_us":108753,"apply.run_cpu_time_us":2189,"apply.run_wall_time_us":6611,"num_ops":1,"prepare.queue_time_us":760448,"prepare.run_cpu_time_us":21101,"prepare.run_wall_time_us":451459,"raft.queue_time_us":234238,"raft.run_cpu_time_us":38522,"raft.run_wall_time_us":129437,"replication_time_us":454223,"thread_start_us":552956,"threads_started":4,"wal-append.queue_time_us":131187}]]}
I20260709 13:04:45.532688 20751 raft_consensus.cc:2749] T 6c5eebf646ad445a9d1b1adc319d7b16 P e61c3a8f61bb48f8a963c9480e53c168 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:04:45.516420 20728 raft_consensus.cc:493] T 62c6c134d3d24a1ab144dd9ee6bc3f64 P e61c3a8f61bb48f8a963c9480e53c168 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 0473d2b2d01f4459b1e90fd12cc7840e)
I20260709 13:04:45.516423 20766 consensus_queue.cc:260] T 1efebf73c86e432baa55533136b6e12c P e61c3a8f61bb48f8a963c9480e53c168 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:04:45.539007 19377 leader_election.cc:304] T 14efcc79969f41babe5529c22d59156d P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87; no voters: 127766fc592545a4997f7790f50f6076
I20260709 13:04:45.539597 19559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22196caba61445d3bec98a0aab3c337d" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:04:45.541028 20078 leader_election.cc:304] T 5ec1c4ce15e04c7e8c283a62179f2a64 P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 127766fc592545a4997f7790f50f6076; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:04:45.546339 19377 leader_election.cc:304] T 0cdf56e38bbc453d9438d359e5a69955 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87; no voters: 
W20260709 13:04:45.548902 19526 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:45.497453 20797 leader_election.cc:290] T fa731b585f684a7fb2d106c50f143b83 P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 2 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:04:45.549557 19409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef32ce6fdd0e40d382c79974f30295c6" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:04:45.550168 19377 leader_election.cc:304] T 2725d2c4cb054f18b0fc8f735c15f6c2 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87; no voters: 
I20260709 13:04:45.553197 19377 leader_election.cc:304] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87; no voters: 127766fc592545a4997f7790f50f6076
I20260709 13:04:45.510037 20803 leader_election.cc:290] T 28af091831594f9d8e96482078cc7625 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 2 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:04:45.538138 20769 raft_consensus.cc:2749] T 775c229504194560ba9589bc2199b089 P 127766fc592545a4997f7790f50f6076 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:04:45.538717 20785 raft_consensus.cc:2749] T 172b3dd13109415a955b71ac0e9d2234 P 127766fc592545a4997f7790f50f6076 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:04:45.560593 20682 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.StartTabletCopy from 127.0.0.1:35874 (request call id 174) took 5427 ms. Trace:
I20260709 13:04:45.560716 20109 raft_consensus.cc:1240] T 0e1085d23e8347fbbd5bce7542f4b1f4 P 127766fc592545a4997f7790f50f6076 [term 2 FOLLOWER]: Rejecting Update request from peer e61c3a8f61bb48f8a963c9480e53c168 for earlier term 1. Current term is 2. Ops: []
I20260709 13:04:45.560974 20715 raft_consensus.cc:515] T 86a6797bdfe94fa496c050ceae4bd0d9 P 0473d2b2d01f4459b1e90fd12cc7840e [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:45.515959 20643 raft_consensus.cc:515] T 309c3ca0ca4b4f3ba129752ea2cb293b P e61c3a8f61bb48f8a963c9480e53c168 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } attrs { replace: true } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: NON_VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: true } }
I20260709 13:04:45.563355 20799 leader_election.cc:290] T f93ee515a9c14139bf566522ed8232f3 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 2 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:04:45.565277 20766 raft_consensus.cc:3060] T 1efebf73c86e432baa55533136b6e12c P e61c3a8f61bb48f8a963c9480e53c168 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:45.584870 19408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff75a1d4cb1f493db8f71ddc136ba9ab" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:04:45.567050 19405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ece3db938bc649d4a40a51522ed5259c" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
I20260709 13:04:45.538568 20728 raft_consensus.cc:3060] T 62c6c134d3d24a1ab144dd9ee6bc3f64 P e61c3a8f61bb48f8a963c9480e53c168 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:45.568476 19411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70797e5783b5454ab0d0eea663e791e3" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
I20260709 13:04:45.552742 20642 raft_consensus.cc:2804] T 2725d2c4cb054f18b0fc8f735c15f6c2 P e5256d91808b47c195bc9b4dbd7f2b87 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:04:45.560262 20595 raft_consensus.cc:515] T ed7fdbcb96d14d418db9ca90a792588a P 127766fc592545a4997f7790f50f6076 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:04:45.570777 20764 leader_election.cc:290] T 0e1085d23e8347fbbd5bce7542f4b1f4 P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 2 election: Requested vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:04:45.599877 19551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc225c93219c45538b53a1bd3d387e4d" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:04:45.600298 19375 leader_election.cc:304] T f1b10566f45d4a7d9029858330e02d5b P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168; no voters: 0473d2b2d01f4459b1e90fd12cc7840e
I20260709 13:04:45.601450 19551 raft_consensus.cc:1240] T 46c5bfeecc314717bffe987e6844b6d0 P e61c3a8f61bb48f8a963c9480e53c168 [term 3 FOLLOWER]: Rejecting Update request from peer 0473d2b2d01f4459b1e90fd12cc7840e for earlier term 2. Current term is 3. Ops: []
I20260709 13:04:45.589989 20642 raft_consensus.cc:493] T 2725d2c4cb054f18b0fc8f735c15f6c2 P e5256d91808b47c195bc9b4dbd7f2b87 [term 1 FOLLOWER]: Starting leader election (detected failure of leader e61c3a8f61bb48f8a963c9480e53c168)
I20260709 13:04:45.604386 20715 leader_election.cc:290] T 86a6797bdfe94fa496c050ceae4bd0d9 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 2 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:04:45.604560 20642 raft_consensus.cc:3060] T 2725d2c4cb054f18b0fc8f735c15f6c2 P e5256d91808b47c195bc9b4dbd7f2b87 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:45.571344 19410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa731b585f684a7fb2d106c50f143b83" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
I20260709 13:04:45.546692 20809 raft_consensus.cc:3055] T f1b10566f45d4a7d9029858330e02d5b P 0473d2b2d01f4459b1e90fd12cc7840e [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:04:45.572678 19407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc225c93219c45538b53a1bd3d387e4d" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:04:45.548166 20771 raft_consensus.cc:2804] T 22196caba61445d3bec98a0aab3c337d P e5256d91808b47c195bc9b4dbd7f2b87 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:04:45.566320 19404 raft_consensus.cc:2468] T 9962423cb4e54fcfa5de01daf68a86e7 P e5256d91808b47c195bc9b4dbd7f2b87 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 127766fc592545a4997f7790f50f6076 in term 2.
I20260709 13:04:45.550446 20738 raft_consensus.cc:2804] T 14efcc79969f41babe5529c22d59156d P e5256d91808b47c195bc9b4dbd7f2b87 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:04:45.577561 19403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28af091831594f9d8e96482078cc7625" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:04:45.579641 20106 raft_consensus.cc:1240] T ece3db938bc649d4a40a51522ed5259c P 127766fc592545a4997f7790f50f6076 [term 2 FOLLOWER]: Rejecting Update request from peer e5256d91808b47c195bc9b4dbd7f2b87 for earlier term 1. Current term is 2. Ops: []
I20260709 13:04:45.550058 20734 raft_consensus.cc:2749] T 5ec1c4ce15e04c7e8c283a62179f2a64 P 127766fc592545a4997f7790f50f6076 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:04:45.627143 20078 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.2:46257, user_credentials={real_user=slave}} blocked reactor thread for 79329us
I20260709 13:04:45.568987 19409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a16f7501e2444fb86d4e2778e734e02" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
I20260709 13:04:45.588299 19560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f93ee515a9c14139bf566522ed8232f3" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:04:45.627846 20078 leader_election.cc:304] T 1efebf73c86e432baa55533136b6e12c P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 127766fc592545a4997f7790f50f6076; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:04:45.590231 19555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28af091831594f9d8e96482078cc7625" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:04:45.586586 19377 leader_election.cc:304] T a08760e15aac4630a629431f56024dc8 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87; no voters: 
I20260709 13:04:45.593650 19553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7be9efa6559648dbb5a0f7684c4542d1" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:04:45.596304 20643 leader_election.cc:290] T 309c3ca0ca4b4f3ba129752ea2cb293b P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 3 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:04:45.574479 20682 rpcz_store.cc:276] 0709 13:04:40.132676 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:40.136537 (+  3861us) service_pool.cc:224] Handling call
0709 13:04:41.074532 (+937995us) ts_tablet_manager.cc:934] T 309c3ca0ca4b4f3ba129752ea2cb293b P 127766fc592545a4997f7790f50f6076: Initiating tablet copy from peer e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321)
0709 13:04:44.825047 (+3750515us) tablet_copy_client.cc:368] Tablet copy session begun
0709 13:04:45.293331 (+468284us) tablet_metadata.cc:665] Metadata flushed
0709 13:04:45.305100 (+ 11769us) tablet_copy_client.cc:497] Wrote new tablet metadata
0709 13:04:45.549518 (+244418us) tablet_copy_client.cc:418] Wrote new consensus metadata
0709 13:04:45.560081 (+ 10563us) tablet_replica.cc:206] Creating consensus instance
0709 13:04:45.560391 (+   310us) ts_tablet_manager.cc:989] Replica registered.
0709 13:04:45.560497 (+   106us) inbound_call.cc:177] Queueing success response
Metrics: {"dns_us":19418,"tablet-copy.queue_time_us":654973,"thread_start_us":589208,"threads_started":2}
I20260709 13:04:45.581127 20742 leader_election.cc:290] T 7be9efa6559648dbb5a0f7684c4542d1 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 2 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
W20260709 13:04:45.608284 19524 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:45.672596 19559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86a6797bdfe94fa496c050ceae4bd0d9" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:04:45.609091 19411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dc5b3532fe54f74876d02beffa2c230" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:04:45.609671 19557 raft_consensus.cc:1240] T f1b10566f45d4a7d9029858330e02d5b P e61c3a8f61bb48f8a963c9480e53c168 [term 3 FOLLOWER]: Rejecting Update request from peer 0473d2b2d01f4459b1e90fd12cc7840e for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 13:04:45.611533 19405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1b10566f45d4a7d9029858330e02d5b" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
I20260709 13:04:45.615267 19375 leader_election.cc:304] T fa8650e71aa14778b3d73721fc50d9fc P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168; no voters: 0473d2b2d01f4459b1e90fd12cc7840e
I20260709 13:04:45.585476 20665 raft_consensus.cc:2804] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P e5256d91808b47c195bc9b4dbd7f2b87 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:04:45.619297 19407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46c5bfeecc314717bffe987e6844b6d0" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
I20260709 13:04:45.619673 19449 leader_election.cc:304] T 775c229504194560ba9589bc2199b089 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, 127766fc592545a4997f7790f50f6076; no voters: 
I20260709 13:04:45.552670 20746 raft_consensus.cc:2804] T 0cdf56e38bbc453d9438d359e5a69955 P e5256d91808b47c195bc9b4dbd7f2b87 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:04:45.552565 20752 leader_election.cc:290] T bc225c93219c45538b53a1bd3d387e4d P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 2 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:04:45.616294 20754 raft_consensus.cc:2804] T f1b10566f45d4a7d9029858330e02d5b P e5256d91808b47c195bc9b4dbd7f2b87 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:04:45.620141 19410 raft_consensus.cc:3060] T fa731b585f684a7fb2d106c50f143b83 P e5256d91808b47c195bc9b4dbd7f2b87 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:45.616876 20809 raft_consensus.cc:740] T f1b10566f45d4a7d9029858330e02d5b P 0473d2b2d01f4459b1e90fd12cc7840e [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 0473d2b2d01f4459b1e90fd12cc7840e, State: Running, Role: LEADER
I20260709 13:04:45.632215 19479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e1085d23e8347fbbd5bce7542f4b1f4" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:04:45.677146 20746 raft_consensus.cc:493] T 0cdf56e38bbc453d9438d359e5a69955 P e5256d91808b47c195bc9b4dbd7f2b87 [term 2 FOLLOWER]: Starting leader election (detected failure of leader e61c3a8f61bb48f8a963c9480e53c168)
I20260709 13:04:45.683815 20746 raft_consensus.cc:3060] T 0cdf56e38bbc453d9438d359e5a69955 P e5256d91808b47c195bc9b4dbd7f2b87 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:04:45.686018 19479 raft_consensus.cc:3060] T 0e1085d23e8347fbbd5bce7542f4b1f4 P 0473d2b2d01f4459b1e90fd12cc7840e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:45.686830 19555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa731b585f684a7fb2d106c50f143b83" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:04:45.688473 19560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ece3db938bc649d4a40a51522ed5259c" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:04:45.691129 19481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed7fdbcb96d14d418db9ca90a792588a" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:04:45.618870 20771 raft_consensus.cc:493] T 22196caba61445d3bec98a0aab3c337d P e5256d91808b47c195bc9b4dbd7f2b87 [term 1 FOLLOWER]: Starting leader election (detected failure of leader e61c3a8f61bb48f8a963c9480e53c168)
I20260709 13:04:45.630100 20655 raft_consensus.cc:2804] T a08760e15aac4630a629431f56024dc8 P e5256d91808b47c195bc9b4dbd7f2b87 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:04:45.669974 19377 leader_election.cc:304] T edd7d470b5014c9489be7f41f64355c9 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87; no voters: 
I20260709 13:04:45.630513 20769 raft_consensus.cc:2749] T 1efebf73c86e432baa55533136b6e12c P 127766fc592545a4997f7790f50f6076 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:04:45.673797 19411 raft_consensus.cc:2468] T 1dc5b3532fe54f74876d02beffa2c230 P e5256d91808b47c195bc9b4dbd7f2b87 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 1.
I20260709 13:04:45.625767 20738 raft_consensus.cc:493] T 14efcc79969f41babe5529c22d59156d P e5256d91808b47c195bc9b4dbd7f2b87 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 127766fc592545a4997f7790f50f6076)
I20260709 13:04:45.675032 19408 raft_consensus.cc:1240] T edd7d470b5014c9489be7f41f64355c9 P e5256d91808b47c195bc9b4dbd7f2b87 [term 2 FOLLOWER]: Rejecting Update request from peer e61c3a8f61bb48f8a963c9480e53c168 for earlier term 1. Current term is 2. Ops: []
I20260709 13:04:45.675572 19407 raft_consensus.cc:3060] T 46c5bfeecc314717bffe987e6844b6d0 P e5256d91808b47c195bc9b4dbd7f2b87 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:04:45.676143 19409 raft_consensus.cc:1240] T df751f992649444090e27965eb1af85d P e5256d91808b47c195bc9b4dbd7f2b87 [term 2 FOLLOWER]: Rejecting Update request from peer e61c3a8f61bb48f8a963c9480e53c168 for earlier term 1. Current term is 2. Ops: []
W20260709 13:04:45.677476 19375 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.3:36891, user_credentials={real_user=slave}} blocked reactor thread for 66646.1us
I20260709 13:04:45.675367 20665 raft_consensus.cc:493] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P e5256d91808b47c195bc9b4dbd7f2b87 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 127766fc592545a4997f7790f50f6076)
W20260709 13:04:45.678745 19449 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.4:43121, user_credentials={real_user=slave}} blocked reactor thread for 86672.1us
I20260709 13:04:45.678198 20682 tablet_copy_client.cc:806] T 309c3ca0ca4b4f3ba129752ea2cb293b P 127766fc592545a4997f7790f50f6076: tablet copy: Starting download of 0 data blocks...
I20260709 13:04:45.679610 20595 leader_election.cc:290] T ed7fdbcb96d14d418db9ca90a792588a P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 2 election: Requested vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:04:45.682739 20754 raft_consensus.cc:493] T f1b10566f45d4a7d9029858330e02d5b P e5256d91808b47c195bc9b4dbd7f2b87 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 0473d2b2d01f4459b1e90fd12cc7840e)
I20260709 13:04:45.617274 20732 consensus_queue.cc:1059] T 0e1085d23e8347fbbd5bce7542f4b1f4 P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.018s
I20260709 13:04:45.691614 20752 consensus_queue.cc:1059] T f1b10566f45d4a7d9029858330e02d5b P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.004s
I20260709 13:04:45.696154 19481 raft_consensus.cc:3060] T ed7fdbcb96d14d418db9ca90a792588a P 0473d2b2d01f4459b1e90fd12cc7840e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:45.697134 19552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e1085d23e8347fbbd5bce7542f4b1f4" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:04:45.697733 20647 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.StartTabletCopy from 127.0.0.1:46422 (request call id 308) took 6500 ms. Trace:
I20260709 13:04:45.679638 19403 raft_consensus.cc:1240] T 833a2f0775ed407a94b8924ce50adb63 P e5256d91808b47c195bc9b4dbd7f2b87 [term 2 FOLLOWER]: Rejecting Update request from peer e61c3a8f61bb48f8a963c9480e53c168 for earlier term 1. Current term is 2. Ops: []
I20260709 13:04:45.697949 19556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed7fdbcb96d14d418db9ca90a792588a" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:04:45.624323 20808 consensus_queue.cc:1059] T 46c5bfeecc314717bffe987e6844b6d0 P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 }, Status: INVALID_TERM, Last received: 2.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.051s
I20260709 13:04:45.704569 19375 leader_election.cc:304] T ef32ce6fdd0e40d382c79974f30295c6 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168; no voters: 0473d2b2d01f4459b1e90fd12cc7840e
I20260709 13:04:45.707170 20776 raft_consensus.cc:2804] T fa8650e71aa14778b3d73721fc50d9fc P e5256d91808b47c195bc9b4dbd7f2b87 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:04:45.710888 19479 raft_consensus.cc:2468] T 0e1085d23e8347fbbd5bce7542f4b1f4 P 0473d2b2d01f4459b1e90fd12cc7840e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 127766fc592545a4997f7790f50f6076 in term 2.
I20260709 13:04:45.705356 20738 raft_consensus.cc:3060] T 14efcc79969f41babe5529c22d59156d P e5256d91808b47c195bc9b4dbd7f2b87 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:04:45.707474 20665 raft_consensus.cc:3060] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P e5256d91808b47c195bc9b4dbd7f2b87 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:04:45.698715 20744 raft_consensus.cc:3060] T 833a2f0775ed407a94b8924ce50adb63 P e61c3a8f61bb48f8a963c9480e53c168 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:45.698707 20740 raft_consensus.cc:515] T 76cb037fc9064d13b59a8969d897ce8c P 0473d2b2d01f4459b1e90fd12cc7840e [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:45.702318 20771 raft_consensus.cc:3060] T 22196caba61445d3bec98a0aab3c337d P e5256d91808b47c195bc9b4dbd7f2b87 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:45.712298 20754 raft_consensus.cc:3060] T f1b10566f45d4a7d9029858330e02d5b P e5256d91808b47c195bc9b4dbd7f2b87 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:04:45.718425 20732 raft_consensus.cc:3055] T 0e1085d23e8347fbbd5bce7542f4b1f4 P e61c3a8f61bb48f8a963c9480e53c168 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:04:45.703779 20655 raft_consensus.cc:493] T a08760e15aac4630a629431f56024dc8 P e5256d91808b47c195bc9b4dbd7f2b87 [term 1 FOLLOWER]: Starting leader election (detected failure of leader e61c3a8f61bb48f8a963c9480e53c168)
I20260709 13:04:45.723838 20078 leader_election.cc:304] T 0e1085d23e8347fbbd5bce7542f4b1f4 P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, 127766fc592545a4997f7790f50f6076; no voters: 
I20260709 13:04:45.725373 20821 raft_consensus.cc:2804] T edd7d470b5014c9489be7f41f64355c9 P e5256d91808b47c195bc9b4dbd7f2b87 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:04:45.712774 19449 leader_election.cc:304] T 0e1085d23e8347fbbd5bce7542f4b1f4 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e; no voters: 127766fc592545a4997f7790f50f6076, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:04:45.732270 19374 leader_election.cc:304] T 9962423cb4e54fcfa5de01daf68a86e7 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, 127766fc592545a4997f7790f50f6076
I20260709 13:04:45.701058 20642 raft_consensus.cc:515] T 2725d2c4cb054f18b0fc8f735c15f6c2 P e5256d91808b47c195bc9b4dbd7f2b87 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:45.724129 20776 raft_consensus.cc:493] T fa8650e71aa14778b3d73721fc50d9fc P e5256d91808b47c195bc9b4dbd7f2b87 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 0473d2b2d01f4459b1e90fd12cc7840e)
I20260709 13:04:45.738984 20776 raft_consensus.cc:3060] T fa8650e71aa14778b3d73721fc50d9fc P e5256d91808b47c195bc9b4dbd7f2b87 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:45.739729 20817 raft_consensus.cc:2804] T 0e1085d23e8347fbbd5bce7542f4b1f4 P 127766fc592545a4997f7790f50f6076 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:04:45.740272 20642 leader_election.cc:290] T 2725d2c4cb054f18b0fc8f735c15f6c2 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 2 election: Requested vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:04:45.733623 20732 raft_consensus.cc:740] T 0e1085d23e8347fbbd5bce7542f4b1f4 P e61c3a8f61bb48f8a963c9480e53c168 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e61c3a8f61bb48f8a963c9480e53c168, State: Running, Role: LEADER
I20260709 13:04:45.741485 19402 raft_consensus.cc:1240] T 2725d2c4cb054f18b0fc8f735c15f6c2 P e5256d91808b47c195bc9b4dbd7f2b87 [term 2 FOLLOWER]: Rejecting Update request from peer e61c3a8f61bb48f8a963c9480e53c168 for earlier term 1. Current term is 2. Ops: []
I20260709 13:04:45.744593 19449 leader_election.cc:304] T ed7fdbcb96d14d418db9ca90a792588a P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e; no voters: 127766fc592545a4997f7790f50f6076, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:04:45.746011 19449 leader_election.cc:304] T 0afb57ae58a24a01850491d69f0213dd P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e; no voters: 127766fc592545a4997f7790f50f6076, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:04:45.732415 20682 tablet_copy_client.cc:670] T 309c3ca0ca4b4f3ba129752ea2cb293b P 127766fc592545a4997f7790f50f6076: tablet copy: Starting download of 1 WAL segments...
I20260709 13:04:45.732034 20818 raft_consensus.cc:2804] T 775c229504194560ba9589bc2199b089 P 0473d2b2d01f4459b1e90fd12cc7840e [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:04:45.748579 19449 leader_election.cc:304] T 48824d5acfbc485ebf8c2d944e7202de P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e; no voters: 127766fc592545a4997f7790f50f6076, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:04:45.702869 20737 raft_consensus.cc:515] T 62c6c134d3d24a1ab144dd9ee6bc3f64 P 127766fc592545a4997f7790f50f6076 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:04:45.734226 20655 raft_consensus.cc:3060] T a08760e15aac4630a629431f56024dc8 P e5256d91808b47c195bc9b4dbd7f2b87 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:45.749491 20799 raft_consensus.cc:2749] T 0afb57ae58a24a01850491d69f0213dd P 0473d2b2d01f4459b1e90fd12cc7840e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:04:45.740273 20817 raft_consensus.cc:697] T 0e1085d23e8347fbbd5bce7542f4b1f4 P 127766fc592545a4997f7790f50f6076 [term 2 LEADER]: Becoming Leader. State: Replica: 127766fc592545a4997f7790f50f6076, State: Running, Role: LEADER
I20260709 13:04:45.755363 20818 raft_consensus.cc:493] T 775c229504194560ba9589bc2199b089 P 0473d2b2d01f4459b1e90fd12cc7840e [term 1 FOLLOWER]: Starting leader election (detected failure of leader e5256d91808b47c195bc9b4dbd7f2b87)
I20260709 13:04:45.741499 20732 consensus_queue.cc:260] T 0e1085d23e8347fbbd5bce7542f4b1f4 P e61c3a8f61bb48f8a963c9480e53c168 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:04:45.756381 20808 raft_consensus.cc:2749] T 0e1085d23e8347fbbd5bce7542f4b1f4 P 0473d2b2d01f4459b1e90fd12cc7840e [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:04:45.788909 19374 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.4:43121, user_credentials={real_user=slave}} blocked reactor thread for 56702us
I20260709 13:04:45.755959 20821 raft_consensus.cc:697] T edd7d470b5014c9489be7f41f64355c9 P e5256d91808b47c195bc9b4dbd7f2b87 [term 2 LEADER]: Becoming Leader. State: Replica: e5256d91808b47c195bc9b4dbd7f2b87, State: Running, Role: LEADER
W20260709 13:04:45.789769 19375 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.3:36891, user_credentials={real_user=slave}} blocked reactor thread for 85308.8us
I20260709 13:04:45.793099 19375 leader_election.cc:304] T 65d8cb8d6ec64f459d5a47cefab10acf P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87; no voters: 127766fc592545a4997f7790f50f6076, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:04:45.795852 19449 leader_election.cc:304] T 3e1f505cb0f1427bbd698ac889d80821 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e; no voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:04:45.787909 20812 raft_consensus.cc:2749] T 48824d5acfbc485ebf8c2d944e7202de P 0473d2b2d01f4459b1e90fd12cc7840e [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:04:45.788431 20818 raft_consensus.cc:3060] T 775c229504194560ba9589bc2199b089 P 0473d2b2d01f4459b1e90fd12cc7840e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:45.806802 19374 leader_election.cc:304] T 1f85fc4b527a48848e5faa083b604e36 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 127766fc592545a4997f7790f50f6076, e5256d91808b47c195bc9b4dbd7f2b87; no voters: 0473d2b2d01f4459b1e90fd12cc7840e
I20260709 13:04:45.800215 20822 raft_consensus.cc:2804] T ef32ce6fdd0e40d382c79974f30295c6 P e5256d91808b47c195bc9b4dbd7f2b87 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:04:45.808557 20825 raft_consensus.cc:2749] T 9962423cb4e54fcfa5de01daf68a86e7 P e5256d91808b47c195bc9b4dbd7f2b87 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:04:45.809170 19375 leader_election.cc:304] T 85c494af21f9457a85da47b9bc70c1fd P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87; no voters: 127766fc592545a4997f7790f50f6076, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:04:45.809208 20809 consensus_queue.cc:260] T f1b10566f45d4a7d9029858330e02d5b P 0473d2b2d01f4459b1e90fd12cc7840e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:45.790896 20803 consensus_queue.cc:1059] T 9962423cb4e54fcfa5de01daf68a86e7 P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.014s
I20260709 13:04:45.811569 19449 leader_election.cc:304] T ab43d85f64114d4ebf618930e43d9ed0 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e; no voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:04:45.802611 20805 consensus_queue.cc:1059] T 1f85fc4b527a48848e5faa083b604e36 P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.166s
I20260709 13:04:45.964655 19481 raft_consensus.cc:2468] T ed7fdbcb96d14d418db9ca90a792588a P 0473d2b2d01f4459b1e90fd12cc7840e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 127766fc592545a4997f7790f50f6076 in term 2.
I20260709 13:04:45.965274 20752 raft_consensus.cc:2749] T ed7fdbcb96d14d418db9ca90a792588a P 0473d2b2d01f4459b1e90fd12cc7840e [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:04:45.965536 20828 raft_consensus.cc:2749] T 85c494af21f9457a85da47b9bc70c1fd P e5256d91808b47c195bc9b4dbd7f2b87 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:04:45.966125 20799 raft_consensus.cc:3055] T 9962423cb4e54fcfa5de01daf68a86e7 P 0473d2b2d01f4459b1e90fd12cc7840e [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:04:45.966528 20799 raft_consensus.cc:740] T 9962423cb4e54fcfa5de01daf68a86e7 P 0473d2b2d01f4459b1e90fd12cc7840e [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0473d2b2d01f4459b1e90fd12cc7840e, State: Running, Role: LEADER
I20260709 13:04:45.967077 20809 raft_consensus.cc:3060] T f1b10566f45d4a7d9029858330e02d5b P 0473d2b2d01f4459b1e90fd12cc7840e [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:04:45.967427 19375 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.3:36891, user_credentials={real_user=slave}} blocked reactor thread for 158327us
W20260709 13:04:45.979244 19526 leader_election.cc:336] T bc225c93219c45538b53a1bd3d387e4d P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257): Timed out: RequestConsensusVote RPC to 127.17.223.2:46257 timed out after 1.579s (SENT)
W20260709 13:04:45.950791 19523 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:45.979736 19375 leader_election.cc:304] T 833a2f0775ed407a94b8924ce50adb63 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87; no voters: 127766fc592545a4997f7790f50f6076, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:04:45.981482 19375 leader_election.cc:304] T ff75a1d4cb1f493db8f71ddc136ba9ab P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:04:45.982164 20825 raft_consensus.cc:2749] T 833a2f0775ed407a94b8924ce50adb63 P e5256d91808b47c195bc9b4dbd7f2b87 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:04:45.982803 20825 raft_consensus.cc:2804] T ff75a1d4cb1f493db8f71ddc136ba9ab P e5256d91808b47c195bc9b4dbd7f2b87 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:04:45.983139 20825 raft_consensus.cc:493] T ff75a1d4cb1f493db8f71ddc136ba9ab P e5256d91808b47c195bc9b4dbd7f2b87 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 0473d2b2d01f4459b1e90fd12cc7840e)
I20260709 13:04:45.967680 20078 leader_election.cc:304] T ed7fdbcb96d14d418db9ca90a792588a P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, 127766fc592545a4997f7790f50f6076; no voters: e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:04:45.983475 20825 raft_consensus.cc:3060] T ff75a1d4cb1f493db8f71ddc136ba9ab P e5256d91808b47c195bc9b4dbd7f2b87 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:45.932947 19407 raft_consensus.cc:2468] T 46c5bfeecc314717bffe987e6844b6d0 P e5256d91808b47c195bc9b4dbd7f2b87 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 3.
I20260709 13:04:45.985375 19375 leader_election.cc:304] T 1dc5b3532fe54f74876d02beffa2c230 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168; no voters: 0473d2b2d01f4459b1e90fd12cc7840e
I20260709 13:04:45.986495 19375 leader_election.cc:304] T 1a61655d99124a29b486ba4a5b37faea P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168
W20260709 13:04:45.987670 19449 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.1:40321, user_credentials={real_user=slave}} blocked reactor thread for 176157us
I20260709 13:04:45.987970 19375 leader_election.cc:304] T 14935b3ddf914369822e4a0547aaa355 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:04:45.988379 19449 leader_election.cc:304] T 179fd671030940b4b4a4e24bcc4aba0a P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e; no voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:04:45.939045 20823 consensus_queue.cc:1059] T 2a16f7501e2444fb86d4e2778e734e02 P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false }, Status: INVALID_TERM, Last received: 2.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.088s
I20260709 13:04:45.859380 20728 raft_consensus.cc:515] T 62c6c134d3d24a1ab144dd9ee6bc3f64 P e61c3a8f61bb48f8a963c9480e53c168 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:04:45.803262 20732 raft_consensus.cc:3060] T 0e1085d23e8347fbbd5bce7542f4b1f4 P e61c3a8f61bb48f8a963c9480e53c168 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:45.865056 20642 raft_consensus.cc:2804] T 1f85fc4b527a48848e5faa083b604e36 P e5256d91808b47c195bc9b4dbd7f2b87 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:04:45.873610 19552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76cb037fc9064d13b59a8969d897ce8c" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:04:45.811092 20822 raft_consensus.cc:493] T ef32ce6fdd0e40d382c79974f30295c6 P e5256d91808b47c195bc9b4dbd7f2b87 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 0473d2b2d01f4459b1e90fd12cc7840e)
I20260709 13:04:46.007045 19309 catalog_manager.cc:5697] T 309c3ca0ca4b4f3ba129752ea2cb293b P e61c3a8f61bb48f8a963c9480e53c168 reported cstate change: config changed from index -1 to 3, NON_VOTER 127766fc592545a4997f7790f50f6076 (127.17.223.4) added. New cstate: current_term: 2 leader_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } attrs { replace: true } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: NON_VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: true } } }
I20260709 13:04:45.925236 20742 raft_consensus.cc:3055] T 46c5bfeecc314717bffe987e6844b6d0 P 0473d2b2d01f4459b1e90fd12cc7840e [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:04:45.871634 20665 raft_consensus.cc:515] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P e5256d91808b47c195bc9b4dbd7f2b87 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:04:45.872042 20826 consensus_queue.cc:1059] T ece3db938bc649d4a40a51522ed5259c P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.101s
I20260709 13:04:45.974123 20738 raft_consensus.cc:515] T 14efcc79969f41babe5529c22d59156d P e5256d91808b47c195bc9b4dbd7f2b87 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:04:45.954243 19480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62c6c134d3d24a1ab144dd9ee6bc3f64" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:04:45.717672 20647 rpcz_store.cc:276] 0709 13:04:39.197067 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:39.197191 (+   124us) service_pool.cc:224] Handling call
0709 13:04:39.856206 (+659015us) ts_tablet_manager.cc:934] T ab43d85f64114d4ebf618930e43d9ed0 P 127766fc592545a4997f7790f50f6076: Initiating tablet copy from peer e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
0709 13:04:44.742382 (+4886176us) tablet_copy_client.cc:368] Tablet copy session begun
0709 13:04:45.395545 (+653163us) tablet_metadata.cc:665] Metadata flushed
0709 13:04:45.408500 (+ 12955us) tablet_copy_client.cc:497] Wrote new tablet metadata
0709 13:04:45.696700 (+288200us) tablet_copy_client.cc:418] Wrote new consensus metadata
0709 13:04:45.696969 (+   269us) tablet_replica.cc:206] Creating consensus instance
0709 13:04:45.697593 (+   624us) ts_tablet_manager.cc:989] Replica registered.
0709 13:04:45.697679 (+    86us) inbound_call.cc:177] Queueing success response
Metrics: {"dns_us":85099,"tablet-copy.queue_time_us":465559,"thread_start_us":486109,"threads_started":2}
I20260709 13:04:45.802714 20716 raft_consensus.cc:2749] T 3e1f505cb0f1427bbd698ac889d80821 P 0473d2b2d01f4459b1e90fd12cc7840e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:04:45.973912 20746 raft_consensus.cc:515] T 0cdf56e38bbc453d9438d359e5a69955 P e5256d91808b47c195bc9b4dbd7f2b87 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:45.993126 19557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62c6c134d3d24a1ab144dd9ee6bc3f64" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:04:45.864936 20824 raft_consensus.cc:2749] T 65d8cb8d6ec64f459d5a47cefab10acf P e5256d91808b47c195bc9b4dbd7f2b87 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:04:46.026886 20647 tablet_copy_client.cc:806] T ab43d85f64114d4ebf618930e43d9ed0 P 127766fc592545a4997f7790f50f6076: tablet copy: Starting download of 0 data blocks...
I20260709 13:04:46.027266 20107 raft_consensus.cc:1240] T fa731b585f684a7fb2d106c50f143b83 P 127766fc592545a4997f7790f50f6076 [term 2 FOLLOWER]: Rejecting Update request from peer e61c3a8f61bb48f8a963c9480e53c168 for earlier term 1. Current term is 2. Ops: []
I20260709 13:04:46.027479 20647 tablet_copy_client.cc:670] T ab43d85f64114d4ebf618930e43d9ed0 P 127766fc592545a4997f7790f50f6076: tablet copy: Starting download of 1 WAL segments...
I20260709 13:04:45.994879 20752 raft_consensus.cc:2749] T 179fd671030940b4b4a4e24bcc4aba0a P 0473d2b2d01f4459b1e90fd12cc7840e [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:04:45.860113 20740 leader_election.cc:290] T 76cb037fc9064d13b59a8969d897ce8c P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 2 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:04:45.920469 20808 raft_consensus.cc:493] T 2b74109013a140ada21feeef92d6f563 P 0473d2b2d01f4459b1e90fd12cc7840e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e5256d91808b47c195bc9b4dbd7f2b87)
I20260709 13:04:45.922113 20737 leader_election.cc:290] T 62c6c134d3d24a1ab144dd9ee6bc3f64 P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 2 election: Requested vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:04:45.820215 19410 raft_consensus.cc:2468] T fa731b585f684a7fb2d106c50f143b83 P e5256d91808b47c195bc9b4dbd7f2b87 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 127766fc592545a4997f7790f50f6076 in term 2.
I20260709 13:04:45.992120 20828 raft_consensus.cc:2749] T 1a61655d99124a29b486ba4a5b37faea P e5256d91808b47c195bc9b4dbd7f2b87 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:04:46.002017 20819 raft_consensus.cc:2804] T 1dc5b3532fe54f74876d02beffa2c230 P e5256d91808b47c195bc9b4dbd7f2b87 [term 1 FOLLOWER]: Leader pre-election won for term 2
W20260709 13:04:46.002969 19377 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.2:46257, user_credentials={real_user=slave}} blocked reactor thread for 333085us
I20260709 13:04:46.039413 19377 leader_election.cc:304] T 40e1e16737a842ee936002830f36882e P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87; no voters: 
I20260709 13:04:45.965556 20805 raft_consensus.cc:3055] T 1f85fc4b527a48848e5faa083b604e36 P 0473d2b2d01f4459b1e90fd12cc7840e [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:04:45.811821 20817 consensus_queue.cc:237] T 0e1085d23e8347fbbd5bce7542f4b1f4 P 127766fc592545a4997f7790f50f6076 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:04:46.014757 20807 raft_consensus.cc:493] T 5ec1c4ce15e04c7e8c283a62179f2a64 P 0473d2b2d01f4459b1e90fd12cc7840e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e5256d91808b47c195bc9b4dbd7f2b87)
I20260709 13:04:46.015512 19560 raft_consensus.cc:1240] T 62c6c134d3d24a1ab144dd9ee6bc3f64 P e61c3a8f61bb48f8a963c9480e53c168 [term 2 FOLLOWER]: Rejecting Update request from peer 0473d2b2d01f4459b1e90fd12cc7840e for earlier term 1. Current term is 2. Ops: []
I20260709 13:04:45.993680 20785 raft_consensus.cc:2804] T ed7fdbcb96d14d418db9ca90a792588a P 127766fc592545a4997f7790f50f6076 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:04:45.927194 20754 raft_consensus.cc:515] T f1b10566f45d4a7d9029858330e02d5b P e5256d91808b47c195bc9b4dbd7f2b87 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
W20260709 13:04:46.018848 19374 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.4:43121, user_credentials={real_user=slave}} blocked reactor thread for 186910us
I20260709 13:04:45.967478 20799 consensus_queue.cc:260] T 9962423cb4e54fcfa5de01daf68a86e7 P 0473d2b2d01f4459b1e90fd12cc7840e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:04:45.994449 20803 raft_consensus.cc:2749] T ab43d85f64114d4ebf618930e43d9ed0 P 0473d2b2d01f4459b1e90fd12cc7840e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:04:46.014048 19449 leader_election.cc:304] T 217b5fae677b4971b3bbd2f357a1f7ff P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e; no voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:04:46.018805 20742 raft_consensus.cc:740] T 46c5bfeecc314717bffe987e6844b6d0 P 0473d2b2d01f4459b1e90fd12cc7840e [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 0473d2b2d01f4459b1e90fd12cc7840e, State: Running, Role: LEADER
I20260709 13:04:46.061260 20075 leader_election.cc:304] T ece3db938bc649d4a40a51522ed5259c P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 127766fc592545a4997f7790f50f6076; no voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:04:46.062242 19410 raft_consensus.cc:1240] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P e5256d91808b47c195bc9b4dbd7f2b87 [term 3 FOLLOWER]: Rejecting Update request from peer 127766fc592545a4997f7790f50f6076 for earlier term 2. Current term is 3. Ops: []
I20260709 13:04:46.062479 20075 leader_election.cc:304] T 70797e5783b5454ab0d0eea663e791e3 P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 127766fc592545a4997f7790f50f6076; no voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:04:46.013075 20822 raft_consensus.cc:3060] T ef32ce6fdd0e40d382c79974f30295c6 P e5256d91808b47c195bc9b4dbd7f2b87 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:46.063640 20075 leader_election.cc:304] T 9962423cb4e54fcfa5de01daf68a86e7 P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 127766fc592545a4997f7790f50f6076, e5256d91808b47c195bc9b4dbd7f2b87; no voters: 0473d2b2d01f4459b1e90fd12cc7840e
I20260709 13:04:46.034250 19406 raft_consensus.cc:1240] T 14efcc79969f41babe5529c22d59156d P e5256d91808b47c195bc9b4dbd7f2b87 [term 3 FOLLOWER]: Rejecting Update request from peer 127766fc592545a4997f7790f50f6076 for earlier term 2. Current term is 3. Ops: []
I20260709 13:04:45.843066 20821 consensus_queue.cc:237] T edd7d470b5014c9489be7f41f64355c9 P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:46.042083 20728 leader_election.cc:290] T 62c6c134d3d24a1ab144dd9ee6bc3f64 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 2 election: Requested vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:04:46.015690 20812 consensus_queue.cc:1059] T 1f85fc4b527a48848e5faa083b604e36 P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.025s
I20260709 13:04:46.036229 20824 raft_consensus.cc:2749] T 14935b3ddf914369822e4a0547aaa355 P e5256d91808b47c195bc9b4dbd7f2b87 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:04:46.044145 20808 raft_consensus.cc:515] T 2b74109013a140ada21feeef92d6f563 P 0473d2b2d01f4459b1e90fd12cc7840e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:46.067772 20740 raft_consensus.cc:2749] T 217b5fae677b4971b3bbd2f357a1f7ff P 0473d2b2d01f4459b1e90fd12cc7840e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:04:46.065229 20076 leader_election.cc:304] T 62c6c134d3d24a1ab144dd9ee6bc3f64 P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 127766fc592545a4997f7790f50f6076; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:04:46.068254 20825 raft_consensus.cc:515] T ff75a1d4cb1f493db8f71ddc136ba9ab P e5256d91808b47c195bc9b4dbd7f2b87 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:46.044334 20642 raft_consensus.cc:697] T 1f85fc4b527a48848e5faa083b604e36 P e5256d91808b47c195bc9b4dbd7f2b87 [term 2 LEADER]: Becoming Leader. State: Replica: e5256d91808b47c195bc9b4dbd7f2b87, State: Running, Role: LEADER
I20260709 13:04:46.051795 20107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62c6c134d3d24a1ab144dd9ee6bc3f64" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076"
I20260709 13:04:46.069716 20801 raft_consensus.cc:2749] T 62c6c134d3d24a1ab144dd9ee6bc3f64 P 127766fc592545a4997f7790f50f6076 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:04:46.070835 20107 raft_consensus.cc:2393] T 62c6c134d3d24a1ab144dd9ee6bc3f64 P 127766fc592545a4997f7790f50f6076 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate e61c3a8f61bb48f8a963c9480e53c168 in current term 2: Already voted for candidate 127766fc592545a4997f7790f50f6076 in this term.
I20260709 13:04:46.071276 20746 leader_election.cc:290] T 0cdf56e38bbc453d9438d359e5a69955 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 3 election: Requested vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:04:46.062590 20730 raft_consensus.cc:2749] T ece3db938bc649d4a40a51522ed5259c P 127766fc592545a4997f7790f50f6076 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:04:46.043078 20819 raft_consensus.cc:493] T 1dc5b3532fe54f74876d02beffa2c230 P e5256d91808b47c195bc9b4dbd7f2b87 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 0473d2b2d01f4459b1e90fd12cc7840e)
I20260709 13:04:46.072198 20819 raft_consensus.cc:3060] T 1dc5b3532fe54f74876d02beffa2c230 P e5256d91808b47c195bc9b4dbd7f2b87 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:46.059459 20110 raft_consensus.cc:1240] T 70797e5783b5454ab0d0eea663e791e3 P 127766fc592545a4997f7790f50f6076 [term 2 FOLLOWER]: Rejecting Update request from peer e5256d91808b47c195bc9b4dbd7f2b87 for earlier term 1. Current term is 2. Ops: []
I20260709 13:04:46.048650 19404 raft_consensus.cc:1240] T fa731b585f684a7fb2d106c50f143b83 P e5256d91808b47c195bc9b4dbd7f2b87 [term 2 FOLLOWER]: Rejecting Update request from peer e61c3a8f61bb48f8a963c9480e53c168 for earlier term 1. Current term is 2. Ops: []
I20260709 13:04:46.070329 20642 consensus_queue.cc:237] T 1f85fc4b527a48848e5faa083b604e36 P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:04:46.053040 20754 leader_election.cc:290] T f1b10566f45d4a7d9029858330e02d5b P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 3 election: Requested vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:04:46.042604 20805 raft_consensus.cc:740] T 1f85fc4b527a48848e5faa083b604e36 P 0473d2b2d01f4459b1e90fd12cc7840e [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0473d2b2d01f4459b1e90fd12cc7840e, State: Running, Role: LEADER
I20260709 13:04:46.024240 19309 catalog_manager.cc:5697] T e381f1d6b8184797ad142de49be225a8 P e61c3a8f61bb48f8a963c9480e53c168 reported cstate change: term changed from 1 to 2, leader changed from 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2) to e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1). New cstate: current_term: 2 leader_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } }
I20260709 13:04:46.070313 20825 leader_election.cc:290] T ff75a1d4cb1f493db8f71ddc136ba9ab P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 2 election: Requested vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
W20260709 13:04:46.066290 19449 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.1:40321, user_credentials={real_user=slave}} blocked reactor thread for 52394.8us
I20260709 13:04:46.077087 19449 leader_election.cc:304] T 309c3ca0ca4b4f3ba129752ea2cb293b P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e; no voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:04:46.042853 20766 consensus_queue.cc:1059] T fa731b585f684a7fb2d106c50f143b83 P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.032s
W20260709 13:04:46.080910 19451 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:46.059554 20785 raft_consensus.cc:697] T ed7fdbcb96d14d418db9ca90a792588a P 127766fc592545a4997f7790f50f6076 [term 2 LEADER]: Becoming Leader. State: Replica: 127766fc592545a4997f7790f50f6076, State: Running, Role: LEADER
I20260709 13:04:46.083268 19449 leader_election.cc:304] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e; no voters: 127766fc592545a4997f7790f50f6076, e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:04:46.085434 20752 raft_consensus.cc:2749] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P 0473d2b2d01f4459b1e90fd12cc7840e [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:04:46.081327 20829 raft_consensus.cc:2804] T 40e1e16737a842ee936002830f36882e P e5256d91808b47c195bc9b4dbd7f2b87 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:04:46.074134 20737 raft_consensus.cc:2804] T 9962423cb4e54fcfa5de01daf68a86e7 P 127766fc592545a4997f7790f50f6076 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:04:46.087203 19449 leader_election.cc:304] T 40e1e16737a842ee936002830f36882e P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87; no voters: e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:04:46.090476 19449 leader_election.cc:304] T 22196caba61445d3bec98a0aab3c337d P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87; no voters: e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:04:46.078861 20734 raft_consensus.cc:2749] T 70797e5783b5454ab0d0eea663e791e3 P 127766fc592545a4997f7790f50f6076 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:04:46.064874 20715 consensus_queue.cc:1059] T 62c6c134d3d24a1ab144dd9ee6bc3f64 P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.022s
I20260709 13:04:46.079133 20803 raft_consensus.cc:2749] T 309c3ca0ca4b4f3ba129752ea2cb293b P 0473d2b2d01f4459b1e90fd12cc7840e [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 13:04:46.094894 19377 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.2:46257, user_credentials={real_user=slave}} blocked reactor thread for 55590.4us
I20260709 13:04:46.092312 19449 leader_election.cc:304] T df751f992649444090e27965eb1af85d P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e; no voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:04:46.082345 20799 raft_consensus.cc:3060] T 9962423cb4e54fcfa5de01daf68a86e7 P 0473d2b2d01f4459b1e90fd12cc7840e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:46.048544 20807 raft_consensus.cc:515] T 5ec1c4ce15e04c7e8c283a62179f2a64 P 0473d2b2d01f4459b1e90fd12cc7840e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:04:46.101325 20810 raft_consensus.cc:3055] T 62c6c134d3d24a1ab144dd9ee6bc3f64 P 0473d2b2d01f4459b1e90fd12cc7840e [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:04:46.103092 19377 leader_election.cc:304] T df751f992649444090e27965eb1af85d P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87; no voters: 
I20260709 13:04:46.106256 19449 leader_election.cc:304] T ff9b0eddd810459b82d91c60777c10eb P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e; no voters: 127766fc592545a4997f7790f50f6076, e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:04:46.088411 20829 raft_consensus.cc:493] T 40e1e16737a842ee936002830f36882e P e5256d91808b47c195bc9b4dbd7f2b87 [term 2 FOLLOWER]: Starting leader election (detected failure of leader e61c3a8f61bb48f8a963c9480e53c168)
I20260709 13:04:46.092578 20752 raft_consensus.cc:2804] T 40e1e16737a842ee936002830f36882e P 0473d2b2d01f4459b1e90fd12cc7840e [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:04:46.107234 20829 raft_consensus.cc:3060] T 40e1e16737a842ee936002830f36882e P e5256d91808b47c195bc9b4dbd7f2b87 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:04:46.097450 20812 raft_consensus.cc:2804] T 22196caba61445d3bec98a0aab3c337d P 0473d2b2d01f4459b1e90fd12cc7840e [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:04:46.098253 20737 raft_consensus.cc:697] T 9962423cb4e54fcfa5de01daf68a86e7 P 127766fc592545a4997f7790f50f6076 [term 2 LEADER]: Becoming Leader. State: Replica: 127766fc592545a4997f7790f50f6076, State: Running, Role: LEADER
I20260709 13:04:46.106112 20715 raft_consensus.cc:2749] T df751f992649444090e27965eb1af85d P 0473d2b2d01f4459b1e90fd12cc7840e [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:04:46.102300 20771 raft_consensus.cc:515] T 22196caba61445d3bec98a0aab3c337d P e5256d91808b47c195bc9b4dbd7f2b87 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:46.105484 20810 raft_consensus.cc:740] T 62c6c134d3d24a1ab144dd9ee6bc3f64 P 0473d2b2d01f4459b1e90fd12cc7840e [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0473d2b2d01f4459b1e90fd12cc7840e, State: Running, Role: LEADER
I20260709 13:04:46.124020 18300 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:04:46.112099 20803 raft_consensus.cc:2749] T ff9b0eddd810459b82d91c60777c10eb P 0473d2b2d01f4459b1e90fd12cc7840e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:04:46.114986 20647 tablet_copy_client.cc:538] T ab43d85f64114d4ebf618930e43d9ed0 P 127766fc592545a4997f7790f50f6076: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:04:46.119515 19309 catalog_manager.cc:5697] T 96efeaaf1057492490e9a621f37e1a2d P e61c3a8f61bb48f8a963c9480e53c168 reported cstate change: term changed from 1 to 2, leader changed from 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2) to 127766fc592545a4997f7790f50f6076 (127.17.223.4). New cstate: current_term: 2 leader_uuid: "127766fc592545a4997f7790f50f6076" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } } }
I20260709 13:04:46.116726 20812 raft_consensus.cc:493] T 22196caba61445d3bec98a0aab3c337d P 0473d2b2d01f4459b1e90fd12cc7840e [term 1 FOLLOWER]: Starting leader election (detected failure of leader e61c3a8f61bb48f8a963c9480e53c168)
I20260709 13:04:46.109484 20752 raft_consensus.cc:493] T 40e1e16737a842ee936002830f36882e P 0473d2b2d01f4459b1e90fd12cc7840e [term 2 FOLLOWER]: Starting leader election (detected failure of leader e61c3a8f61bb48f8a963c9480e53c168)
I20260709 13:04:46.129236 20812 raft_consensus.cc:3060] T 22196caba61445d3bec98a0aab3c337d P 0473d2b2d01f4459b1e90fd12cc7840e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:46.131377 20752 raft_consensus.cc:3060] T 40e1e16737a842ee936002830f36882e P 0473d2b2d01f4459b1e90fd12cc7840e [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:04:46.103093 20075 leader_election.cc:304] T 2a16f7501e2444fb86d4e2778e734e02 P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 127766fc592545a4997f7790f50f6076; no voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:04:46.124430 20828 raft_consensus.cc:2804] T df751f992649444090e27965eb1af85d P e5256d91808b47c195bc9b4dbd7f2b87 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:04:46.137037 20810 consensus_queue.cc:260] T 62c6c134d3d24a1ab144dd9ee6bc3f64 P 0473d2b2d01f4459b1e90fd12cc7840e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
W20260709 13:04:46.142990 19526 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:46.144831 20737 consensus_queue.cc:237] T 9962423cb4e54fcfa5de01daf68a86e7 P 127766fc592545a4997f7790f50f6076 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
W20260709 13:04:46.153946 19524 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:04:46.154129 19374 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.4:43121, user_credentials={real_user=slave}} blocked reactor thread for 49727.4us
I20260709 13:04:46.126828 20665 leader_election.cc:290] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 3 election: Requested vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:04:46.130050 20827 raft_consensus.cc:3055] T 2a16f7501e2444fb86d4e2778e734e02 P e5256d91808b47c195bc9b4dbd7f2b87 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:04:46.161705 20110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14efcc79969f41babe5529c22d59156d" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076"
I20260709 13:04:46.149279 20807 leader_election.cc:290] T 5ec1c4ce15e04c7e8c283a62179f2a64 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:04:46.124037 20824 consensus_queue.cc:1059] T 70797e5783b5454ab0d0eea663e791e3 P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.028s
W20260709 13:04:46.172031 19377 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.2:46257, user_credentials={real_user=slave}} blocked reactor thread for 69005.8us
I20260709 13:04:46.125166 20776 raft_consensus.cc:515] T fa8650e71aa14778b3d73721fc50d9fc P e5256d91808b47c195bc9b4dbd7f2b87 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:46.173246 19377 leader_election.cc:304] T ab43d85f64114d4ebf618930e43d9ed0 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87; no voters: e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:04:46.138886 20738 leader_election.cc:290] T 14efcc79969f41babe5529c22d59156d P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 3 election: Requested vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:04:46.128036 20818 raft_consensus.cc:515] T 775c229504194560ba9589bc2199b089 P 0473d2b2d01f4459b1e90fd12cc7840e [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:04:46.179911 20109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36f6ba92b9ba46babe4ebd6c02e5fbd9" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076"
I20260709 13:04:46.162369 20769 raft_consensus.cc:2749] T 2a16f7501e2444fb86d4e2778e734e02 P 127766fc592545a4997f7790f50f6076 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:04:46.115471 20805 consensus_queue.cc:260] T 1f85fc4b527a48848e5faa083b604e36 P 0473d2b2d01f4459b1e90fd12cc7840e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:04:46.123804 20785 consensus_queue.cc:237] T ed7fdbcb96d14d418db9ca90a792588a P 127766fc592545a4997f7790f50f6076 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:04:46.166661 20827 raft_consensus.cc:740] T 2a16f7501e2444fb86d4e2778e734e02 P e5256d91808b47c195bc9b4dbd7f2b87 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: e5256d91808b47c195bc9b4dbd7f2b87, State: Running, Role: LEADER
I20260709 13:04:46.190231 20827 consensus_queue.cc:260] T 2a16f7501e2444fb86d4e2778e734e02 P e5256d91808b47c195bc9b4dbd7f2b87 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.4, Last appended by leader: 4, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:04:46.171451 20828 raft_consensus.cc:697] T df751f992649444090e27965eb1af85d P e5256d91808b47c195bc9b4dbd7f2b87 [term 2 LEADER]: Becoming Leader. State: Replica: e5256d91808b47c195bc9b4dbd7f2b87, State: Running, Role: LEADER
I20260709 13:04:46.199045 20805 raft_consensus.cc:3060] T 1f85fc4b527a48848e5faa083b604e36 P 0473d2b2d01f4459b1e90fd12cc7840e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:46.177600 20826 raft_consensus.cc:2804] T ab43d85f64114d4ebf618930e43d9ed0 P e5256d91808b47c195bc9b4dbd7f2b87 [term 1 FOLLOWER]: Leader pre-election won for term 2
W20260709 13:04:46.175420 20075 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.1:40321, user_credentials={real_user=slave}} blocked reactor thread for 83460.8us
I20260709 13:04:46.209344 20075 leader_election.cc:304] T fa731b585f684a7fb2d106c50f143b83 P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 127766fc592545a4997f7790f50f6076, e5256d91808b47c195bc9b4dbd7f2b87; no voters: e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:04:46.210316 19377 leader_election.cc:304] T 21e14947d70440f19044d8f75c31e1f9 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87; no voters: 
I20260709 13:04:46.212462 20764 raft_consensus.cc:2804] T fa731b585f684a7fb2d106c50f143b83 P 127766fc592545a4997f7790f50f6076 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:04:46.213055 20764 raft_consensus.cc:697] T fa731b585f684a7fb2d106c50f143b83 P 127766fc592545a4997f7790f50f6076 [term 2 LEADER]: Becoming Leader. State: Replica: 127766fc592545a4997f7790f50f6076, State: Running, Role: LEADER
I20260709 13:04:46.213852 20831 raft_consensus.cc:2804] T 21e14947d70440f19044d8f75c31e1f9 P e5256d91808b47c195bc9b4dbd7f2b87 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:04:46.214362 20831 raft_consensus.cc:697] T 21e14947d70440f19044d8f75c31e1f9 P e5256d91808b47c195bc9b4dbd7f2b87 [term 2 LEADER]: Becoming Leader. State: Replica: e5256d91808b47c195bc9b4dbd7f2b87, State: Running, Role: LEADER
W20260709 13:04:46.215751 19449 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.1:40321, user_credentials={real_user=slave}} blocked reactor thread for 109562us
W20260709 13:04:46.256270 19524 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:46.233623 19449 leader_election.cc:304] T 2e36a9d6e29c4a7c860cf267efbd4c74 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87; no voters: e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:04:46.197562 20810 raft_consensus.cc:3060] T 62c6c134d3d24a1ab144dd9ee6bc3f64 P 0473d2b2d01f4459b1e90fd12cc7840e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:46.212849 20818 leader_election.cc:290] T 775c229504194560ba9589bc2199b089 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 2 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:04:46.195183 20827 raft_consensus.cc:3060] T 2a16f7501e2444fb86d4e2778e734e02 P e5256d91808b47c195bc9b4dbd7f2b87 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:04:46.278219 19449 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.1:40321, user_credentials={real_user=slave}} blocked reactor thread for 44712.8us
I20260709 13:04:46.215302 20682 tablet_copy_client.cc:538] T 309c3ca0ca4b4f3ba129752ea2cb293b P 127766fc592545a4997f7790f50f6076: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:04:46.282548 19449 leader_election.cc:304] T d1e5873a19244c5ebbcd38e126796ee7 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e; no voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:04:46.214017 20764 consensus_queue.cc:237] T fa731b585f684a7fb2d106c50f143b83 P 127766fc592545a4997f7790f50f6076 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:04:46.218616 20823 raft_consensus.cc:3055] T 70797e5783b5454ab0d0eea663e791e3 P e5256d91808b47c195bc9b4dbd7f2b87 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:04:46.270349 20837 ts_tablet_manager.cc:933] T df751f992649444090e27965eb1af85d P 127766fc592545a4997f7790f50f6076: Initiating tablet copy from peer e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:04:46.202077 20826 raft_consensus.cc:493] T ab43d85f64114d4ebf618930e43d9ed0 P e5256d91808b47c195bc9b4dbd7f2b87 [term 1 FOLLOWER]: Starting leader election (detected failure of leader e61c3a8f61bb48f8a963c9480e53c168)
W20260709 13:04:46.289260 19377 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.2:46257, user_credentials={real_user=slave}} blocked reactor thread for 77496.5us
W20260709 13:04:46.289749 19523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.1:40321, user_credentials={real_user=slave}} blocked reactor thread for 187938us
I20260709 13:04:46.277271 20665 raft_consensus.cc:493] T 172b3dd13109415a955b71ac0e9d2234 P e5256d91808b47c195bc9b4dbd7f2b87 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0473d2b2d01f4459b1e90fd12cc7840e)
I20260709 13:04:46.283962 20803 raft_consensus.cc:2804] T 2e36a9d6e29c4a7c860cf267efbd4c74 P 0473d2b2d01f4459b1e90fd12cc7840e [term 1 FOLLOWER]: Leader pre-election won for term 2
W20260709 13:04:46.295169 19375 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.3:36891, user_credentials={real_user=slave}} blocked reactor thread for 200814us
I20260709 13:04:46.229076 20730 consensus_queue.cc:1059] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P 127766fc592545a4997f7790f50f6076 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.061s
I20260709 13:04:46.283406 20109 raft_consensus.cc:1240] T 2a16f7501e2444fb86d4e2778e734e02 P 127766fc592545a4997f7790f50f6076 [term 3 FOLLOWER]: Rejecting Update request from peer e5256d91808b47c195bc9b4dbd7f2b87 for earlier term 2. Current term is 3. Ops: []
I20260709 13:04:46.299134 19407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28af091831594f9d8e96482078cc7625" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
I20260709 13:04:46.288161 20818 raft_consensus.cc:2749] T d1e5873a19244c5ebbcd38e126796ee7 P 0473d2b2d01f4459b1e90fd12cc7840e [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:04:46.217849 20655 raft_consensus.cc:515] T a08760e15aac4630a629431f56024dc8 P e5256d91808b47c195bc9b4dbd7f2b87 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:46.302322 19411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86a6797bdfe94fa496c050ceae4bd0d9" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
I20260709 13:04:46.335734 19411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "775c229504194560ba9589bc2199b089" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
I20260709 13:04:46.305291 19485 raft_consensus.cc:1240] T 21e14947d70440f19044d8f75c31e1f9 P 0473d2b2d01f4459b1e90fd12cc7840e [term 2 FOLLOWER]: Rejecting Update request from peer e61c3a8f61bb48f8a963c9480e53c168 for earlier term 1. Current term is 2. Ops: []
I20260709 13:04:46.306291 19482 raft_consensus.cc:1240] T ed7fdbcb96d14d418db9ca90a792588a P 0473d2b2d01f4459b1e90fd12cc7840e [term 2 FOLLOWER]: Rejecting Update request from peer e61c3a8f61bb48f8a963c9480e53c168 for earlier term 1. Current term is 2. Ops: []
I20260709 13:04:46.303642 19405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76cb037fc9064d13b59a8969d897ce8c" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
I20260709 13:04:46.315758 19480 raft_consensus.cc:1240] T 0e1085d23e8347fbbd5bce7542f4b1f4 P 0473d2b2d01f4459b1e90fd12cc7840e [term 2 FOLLOWER]: Rejecting Update request from peer e61c3a8f61bb48f8a963c9480e53c168 for earlier term 1. Current term is 2. Ops: []
I20260709 13:04:46.316334 19402 raft_consensus.cc:1240] T 9962423cb4e54fcfa5de01daf68a86e7 P e5256d91808b47c195bc9b4dbd7f2b87 [term 2 FOLLOWER]: Rejecting Update request from peer 0473d2b2d01f4459b1e90fd12cc7840e for earlier term 1. Current term is 2. Ops: []
I20260709 13:04:46.316725 20771 leader_election.cc:290] T 22196caba61445d3bec98a0aab3c337d P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 2 election: Requested vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:04:46.317624 19481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62c6c134d3d24a1ab144dd9ee6bc3f64" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:04:46.295619 20803 raft_consensus.cc:493] T 2e36a9d6e29c4a7c860cf267efbd4c74 P 0473d2b2d01f4459b1e90fd12cc7840e [term 1 FOLLOWER]: Starting leader election (detected failure of leader e61c3a8f61bb48f8a963c9480e53c168)
I20260709 13:04:46.318326 19408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b74109013a140ada21feeef92d6f563" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:04:46.318745 19404 raft_consensus.cc:1240] T 46c5bfeecc314717bffe987e6844b6d0 P e5256d91808b47c195bc9b4dbd7f2b87 [term 3 FOLLOWER]: Rejecting Update request from peer 0473d2b2d01f4459b1e90fd12cc7840e for earlier term 2. Current term is 3. Ops: []
I20260709 13:04:46.319238 19486 raft_consensus.cc:1240] T 7f575b143b844aa096b50997dad3516a P 0473d2b2d01f4459b1e90fd12cc7840e [term 2 FOLLOWER]: Rejecting Update request from peer e61c3a8f61bb48f8a963c9480e53c168 for earlier term 1. Current term is 2. Ops: []
I20260709 13:04:46.319563 19406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7be9efa6559648dbb5a0f7684c4542d1" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
I20260709 13:04:46.319782 20104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "775c229504194560ba9589bc2199b089" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076"
I20260709 13:04:46.295753 19526 leader_election.cc:304] T 48824d5acfbc485ebf8c2d944e7202de P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e61c3a8f61bb48f8a963c9480e53c168; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, 127766fc592545a4997f7790f50f6076
W20260709 13:04:46.358161 19526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.2:46257, user_credentials={real_user=slave}} blocked reactor thread for 62510.2us
I20260709 13:04:46.323220 19407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ec1c4ce15e04c7e8c283a62179f2a64" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:04:46.230659 20801 consensus_queue.cc:1059] T 14efcc79969f41babe5529c22d59156d P 127766fc592545a4997f7790f50f6076 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.061s
I20260709 13:04:46.289711 20823 raft_consensus.cc:740] T 70797e5783b5454ab0d0eea663e791e3 P e5256d91808b47c195bc9b4dbd7f2b87 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e5256d91808b47c195bc9b4dbd7f2b87, State: Running, Role: LEADER
I20260709 13:04:46.335523 19375 leader_election.cc:304] T b08304a0a02b42d7840c4e8ee9a6bd1a P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168; no voters: 0473d2b2d01f4459b1e90fd12cc7840e
I20260709 13:04:46.315270 19410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f93ee515a9c14139bf566522ed8232f3" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
I20260709 13:04:46.320394 20103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ec1c4ce15e04c7e8c283a62179f2a64" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:04:46.320444 19477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46c5bfeecc314717bffe987e6844b6d0" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:04:46.339602 19478 raft_consensus.cc:1240] T df751f992649444090e27965eb1af85d P 0473d2b2d01f4459b1e90fd12cc7840e [term 2 FOLLOWER]: Rejecting Update request from peer e61c3a8f61bb48f8a963c9480e53c168 for earlier term 1. Current term is 2. Ops: []
I20260709 13:04:46.293931 20826 raft_consensus.cc:3060] T ab43d85f64114d4ebf618930e43d9ed0 P e5256d91808b47c195bc9b4dbd7f2b87 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:46.344441 20110 raft_consensus.cc:1240] T 62c6c134d3d24a1ab144dd9ee6bc3f64 P 127766fc592545a4997f7790f50f6076 [term 2 FOLLOWER]: Rejecting Update request from peer 0473d2b2d01f4459b1e90fd12cc7840e for earlier term 1. Current term is 2. Ops: []
I20260709 13:04:46.344594 19485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff75a1d4cb1f493db8f71ddc136ba9ab" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:04:46.299422 20665 raft_consensus.cc:515] T 172b3dd13109415a955b71ac0e9d2234 P e5256d91808b47c195bc9b4dbd7f2b87 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:04:46.359622 19526 leader_election.cc:304] T b08304a0a02b42d7840c4e8ee9a6bd1a P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e61c3a8f61bb48f8a963c9480e53c168; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:04:46.332114 20833 consensus_queue.cc:1059] T bc225c93219c45538b53a1bd3d387e4d P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.036s
I20260709 13:04:46.351389 19482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "309c3ca0ca4b4f3ba129752ea2cb293b" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:04:46.378631 19485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cdf56e38bbc453d9438d359e5a69955" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:04:46.379416 19482 raft_consensus.cc:3060] T 309c3ca0ca4b4f3ba129752ea2cb293b P 0473d2b2d01f4459b1e90fd12cc7840e [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:04:46.375324 19523 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:46.379964 19485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14efcc79969f41babe5529c22d59156d" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:04:46.353646 20803 raft_consensus.cc:3060] T 2e36a9d6e29c4a7c860cf267efbd4c74 P 0473d2b2d01f4459b1e90fd12cc7840e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:46.381404 19557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b74109013a140ada21feeef92d6f563" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:04:46.382128 20825 raft_consensus.cc:993] T ff9b0eddd810459b82d91c60777c10eb P e5256d91808b47c195bc9b4dbd7f2b87: : Instructing follower 127766fc592545a4997f7790f50f6076 to start an election
I20260709 13:04:46.289994 20831 consensus_queue.cc:237] T 21e14947d70440f19044d8f75c31e1f9 P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:46.342296 20746 consensus_queue.cc:1048] T 7f575b143b844aa096b50997dad3516a P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.022s
I20260709 13:04:46.383248 19483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36f6ba92b9ba46babe4ebd6c02e5fbd9" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:04:46.363058 20732 raft_consensus.cc:2749] T 48824d5acfbc485ebf8c2d944e7202de P e61c3a8f61bb48f8a963c9480e53c168 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:04:46.366904 20106 raft_consensus.cc:1240] T ed7fdbcb96d14d418db9ca90a792588a P 127766fc592545a4997f7790f50f6076 [term 2 LEADER]: Rejecting Update request from peer e61c3a8f61bb48f8a963c9480e53c168 for earlier term 1. Current term is 2. Ops: []
I20260709 13:04:46.386067 20766 raft_consensus.cc:2749] T b08304a0a02b42d7840c4e8ee9a6bd1a P e61c3a8f61bb48f8a963c9480e53c168 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:04:46.368315 20655 leader_election.cc:290] T a08760e15aac4630a629431f56024dc8 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 2 election: Requested vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:04:46.332834 20835 consensus_queue.cc:1059] T 7be9efa6559648dbb5a0f7684c4542d1 P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.033s
I20260709 13:04:46.399597 19482 raft_consensus.cc:2468] T 309c3ca0ca4b4f3ba129752ea2cb293b P 0473d2b2d01f4459b1e90fd12cc7840e [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 3.
I20260709 13:04:46.400774 19485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1b10566f45d4a7d9029858330e02d5b" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:04:46.402247 19480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2725d2c4cb054f18b0fc8f735c15f6c2" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:04:46.403882 19483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22196caba61445d3bec98a0aab3c337d" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:04:46.404399 20647 tablet_bootstrap.cc:492] T ab43d85f64114d4ebf618930e43d9ed0 P 127766fc592545a4997f7790f50f6076: Bootstrap starting.
I20260709 13:04:46.404171 20728 consensus_queue.cc:1059] T ed7fdbcb96d14d418db9ca90a792588a P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:04:46.342259 20828 consensus_queue.cc:237] T df751f992649444090e27965eb1af85d P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
W20260709 13:04:46.399005 19375 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.3:36891, user_credentials={real_user=slave}} blocked reactor thread for 59345.6us
I20260709 13:04:46.385834 20734 raft_consensus.cc:3055] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P 127766fc592545a4997f7790f50f6076 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:04:46.397639 20825 raft_consensus.cc:1081] T ff9b0eddd810459b82d91c60777c10eb P e5256d91808b47c195bc9b4dbd7f2b87 [term 1 LEADER]: Signalling peer 127766fc592545a4997f7790f50f6076 to start an election
I20260709 13:04:46.433643 19482 raft_consensus.cc:1240] T edd7d470b5014c9489be7f41f64355c9 P 0473d2b2d01f4459b1e90fd12cc7840e [term 2 FOLLOWER]: Rejecting Update request from peer e61c3a8f61bb48f8a963c9480e53c168 for earlier term 1. Current term is 2. Ops: []
I20260709 13:04:46.400920 20776 leader_election.cc:290] T fa8650e71aa14778b3d73721fc50d9fc P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 2 election: Requested vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:04:46.442935 19482 raft_consensus.cc:1240] T 775c229504194560ba9589bc2199b089 P 0473d2b2d01f4459b1e90fd12cc7840e [term 2 FOLLOWER]: Rejecting Update request from peer e5256d91808b47c195bc9b4dbd7f2b87 for earlier term 1. Current term is 2. Ops: []
I20260709 13:04:46.443888 19483 raft_consensus.cc:1240] T 76cb037fc9064d13b59a8969d897ce8c P 0473d2b2d01f4459b1e90fd12cc7840e [term 2 FOLLOWER]: Rejecting Update request from peer e5256d91808b47c195bc9b4dbd7f2b87 for earlier term 1. Current term is 2. Ops: []
I20260709 13:04:46.422447 20738 raft_consensus.cc:2804] T b08304a0a02b42d7840c4e8ee9a6bd1a P e5256d91808b47c195bc9b4dbd7f2b87 [term 1 FOLLOWER]: Leader pre-election won for term 2
W20260709 13:04:46.448282 19523 leader_election.cc:336] T ff75a1d4cb1f493db8f71ddc136ba9ab P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321): Timed out: RequestConsensusVote RPC to 127.17.223.1:40321 timed out after 1.529s (SENT)
I20260709 13:04:46.452980 19523 leader_election.cc:304] T ff75a1d4cb1f493db8f71ddc136ba9ab P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e61c3a8f61bb48f8a963c9480e53c168; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:04:46.454114 19377 leader_election.cc:304] T 14efcc79969f41babe5529c22d59156d P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, 127766fc592545a4997f7790f50f6076
I20260709 13:04:46.371325 20823 consensus_queue.cc:260] T 70797e5783b5454ab0d0eea663e791e3 P e5256d91808b47c195bc9b4dbd7f2b87 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:04:46.421023 20766 consensus_queue.cc:1059] T 21e14947d70440f19044d8f75c31e1f9 P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.033s
I20260709 13:04:46.435220 20734 raft_consensus.cc:740] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P 127766fc592545a4997f7790f50f6076 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 127766fc592545a4997f7790f50f6076, State: Running, Role: LEADER
I20260709 13:04:46.482136 19482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a08760e15aac4630a629431f56024dc8" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
W20260709 13:04:46.510190 19377 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.2:46257, user_credentials={real_user=slave}} blocked reactor thread for 56136.2us
I20260709 13:04:46.511230 19377 leader_election.cc:304] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, 127766fc592545a4997f7790f50f6076
W20260709 13:04:46.524995 19523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.1:40321, user_credentials={real_user=slave}} blocked reactor thread for 76755.2us
I20260709 13:04:46.453064 20738 raft_consensus.cc:493] T b08304a0a02b42d7840c4e8ee9a6bd1a P e5256d91808b47c195bc9b4dbd7f2b87 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 0473d2b2d01f4459b1e90fd12cc7840e)
W20260709 13:04:46.526665 19523 leader_election.cc:336] T bc225c93219c45538b53a1bd3d387e4d P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321): Timed out: RequestConsensusVote RPC to 127.17.223.1:40321 timed out after 1.579s (SENT)
I20260709 13:04:46.527220 19523 leader_election.cc:304] T bc225c93219c45538b53a1bd3d387e4d P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e61c3a8f61bb48f8a963c9480e53c168; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:04:46.421892 20742 consensus_queue.cc:260] T 46c5bfeecc314717bffe987e6844b6d0 P 0473d2b2d01f4459b1e90fd12cc7840e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
W20260709 13:04:46.534523 19375 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.3:36891, user_credentials={real_user=slave}} blocked reactor thread for 101586us
I20260709 13:04:46.516777 20776 raft_consensus.cc:2749] T 14efcc79969f41babe5529c22d59156d P e5256d91808b47c195bc9b4dbd7f2b87 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:04:46.498556 20807 raft_consensus.cc:493] T 4509b76741dc428e9201c70c1658da13 P 0473d2b2d01f4459b1e90fd12cc7840e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e5256d91808b47c195bc9b4dbd7f2b87)
I20260709 13:04:46.541061 20110 raft_consensus.cc:1240] T ece3db938bc649d4a40a51522ed5259c P 127766fc592545a4997f7790f50f6076 [term 2 FOLLOWER]: Rejecting Update request from peer e5256d91808b47c195bc9b4dbd7f2b87 for earlier term 1. Current term is 2. Ops: []
I20260709 13:04:46.530961 20738 raft_consensus.cc:3060] T b08304a0a02b42d7840c4e8ee9a6bd1a P e5256d91808b47c195bc9b4dbd7f2b87 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:46.555606 19482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa8650e71aa14778b3d73721fc50d9fc" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:04:46.538411 20746 raft_consensus.cc:2749] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P e5256d91808b47c195bc9b4dbd7f2b87 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:04:46.549082 20754 consensus_queue.cc:1059] T 76cb037fc9064d13b59a8969d897ce8c P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.012s
I20260709 13:04:46.538805 20823 raft_consensus.cc:3060] T 70797e5783b5454ab0d0eea663e791e3 P e5256d91808b47c195bc9b4dbd7f2b87 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:46.534389 20837 tablet_copy_client.cc:323] T df751f992649444090e27965eb1af85d P 127766fc592545a4997f7790f50f6076: tablet copy: Beginning tablet copy session from remote peer at address 127.17.223.3:36891
I20260709 13:04:46.539988 20733 raft_consensus.cc:2749] T ff75a1d4cb1f493db8f71ddc136ba9ab P e61c3a8f61bb48f8a963c9480e53c168 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:04:46.587632 20733 raft_consensus.cc:2749] T bc225c93219c45538b53a1bd3d387e4d P e61c3a8f61bb48f8a963c9480e53c168 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:04:46.587988 20785 raft_consensus.cc:3055] T 14efcc79969f41babe5529c22d59156d P 127766fc592545a4997f7790f50f6076 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:04:46.588373 20785 raft_consensus.cc:740] T 14efcc79969f41babe5529c22d59156d P 127766fc592545a4997f7790f50f6076 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 127766fc592545a4997f7790f50f6076, State: Running, Role: LEADER
I20260709 13:04:46.589211 20785 consensus_queue.cc:260] T 14efcc79969f41babe5529c22d59156d P 127766fc592545a4997f7790f50f6076 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:04:46.596832 19482 raft_consensus.cc:1240] T 28af091831594f9d8e96482078cc7625 P 0473d2b2d01f4459b1e90fd12cc7840e [term 2 FOLLOWER]: Rejecting Update request from peer e5256d91808b47c195bc9b4dbd7f2b87 for earlier term 1. Current term is 2. Ops: []
I20260709 13:04:46.533104 20812 raft_consensus.cc:515] T 22196caba61445d3bec98a0aab3c337d P 0473d2b2d01f4459b1e90fd12cc7840e [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:46.559252 19480 raft_consensus.cc:1240] T f93ee515a9c14139bf566522ed8232f3 P 0473d2b2d01f4459b1e90fd12cc7840e [term 2 FOLLOWER]: Rejecting Update request from peer e5256d91808b47c195bc9b4dbd7f2b87 for earlier term 1. Current term is 2. Ops: []
W20260709 13:04:46.667158 19449 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:04:46.688386 20845 log.cc:927] Time spent T edd7d470b5014c9489be7f41f64355c9 P e5256d91808b47c195bc9b4dbd7f2b87: Append to log took a long time: real 0.178s	user 0.000s	sys 0.000s
I20260709 13:04:46.690338 19482 raft_consensus.cc:1240] T 309c3ca0ca4b4f3ba129752ea2cb293b P 0473d2b2d01f4459b1e90fd12cc7840e [term 3 FOLLOWER]: Rejecting Update request from peer e5256d91808b47c195bc9b4dbd7f2b87 for earlier term 2. Current term is 3. Ops: []
W20260709 13:04:46.695399 20847 log.cc:927] Time spent T ed7fdbcb96d14d418db9ca90a792588a P 127766fc592545a4997f7790f50f6076: Append to log took a long time: real 0.259s	user 0.001s	sys 0.000s
I20260709 13:04:46.559473 20808 leader_election.cc:290] T 2b74109013a140ada21feeef92d6f563 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
W20260709 13:04:46.697510 19449 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:46.550465 20107 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ff9b0eddd810459b82d91c60777c10eb"
dest_uuid: "127766fc592545a4997f7790f50f6076"
 from {username='slave'} at 127.0.0.1:35874
I20260709 13:04:46.586367 20742 raft_consensus.cc:3060] T 46c5bfeecc314717bffe987e6844b6d0 P 0473d2b2d01f4459b1e90fd12cc7840e [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:04:46.701154 19523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.1:40321, user_credentials={real_user=slave}} blocked reactor thread for 174527us
I20260709 13:04:46.701824 19485 raft_consensus.cc:2468] T f1b10566f45d4a7d9029858330e02d5b P 0473d2b2d01f4459b1e90fd12cc7840e [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 3.
W20260709 13:04:46.724212 19449 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:46.724397 19484 raft_consensus.cc:1240] T 22196caba61445d3bec98a0aab3c337d P 0473d2b2d01f4459b1e90fd12cc7840e [term 2 FOLLOWER]: Rejecting Update request from peer e61c3a8f61bb48f8a963c9480e53c168 for earlier term 1. Current term is 2. Ops: []
I20260709 13:04:46.585223 20762 raft_consensus.cc:3055] T fa731b585f684a7fb2d106c50f143b83 P e61c3a8f61bb48f8a963c9480e53c168 [term 1 LEADER]: Stepping down as leader of term 1
W20260709 13:04:46.734112 19523 leader_election.cc:336] T 1dc5b3532fe54f74876d02beffa2c230 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321): Timed out: RequestConsensusVote RPC to 127.17.223.1:40321 timed out after 1.628s (SENT)
I20260709 13:04:46.734951 19523 leader_election.cc:304] T 1dc5b3532fe54f74876d02beffa2c230 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e61c3a8f61bb48f8a963c9480e53c168; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:04:46.736816 20735 raft_consensus.cc:2749] T 1dc5b3532fe54f74876d02beffa2c230 P e61c3a8f61bb48f8a963c9480e53c168 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:04:46.740928 19483 raft_consensus.cc:1240] T 86a6797bdfe94fa496c050ceae4bd0d9 P 0473d2b2d01f4459b1e90fd12cc7840e [term 2 FOLLOWER]: Rejecting Update request from peer e5256d91808b47c195bc9b4dbd7f2b87 for earlier term 1. Current term is 2. Ops: []
I20260709 13:04:46.548885 20834 consensus_queue.cc:1059] T 775c229504194560ba9589bc2199b089 P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.127s
I20260709 13:04:46.743301 20107 raft_consensus.cc:493] T ff9b0eddd810459b82d91c60777c10eb P 127766fc592545a4997f7790f50f6076 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:04:46.746340 20107 raft_consensus.cc:3060] T ff9b0eddd810459b82d91c60777c10eb P 127766fc592545a4997f7790f50f6076 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:46.582438 20807 raft_consensus.cc:515] T 4509b76741dc428e9201c70c1658da13 P 0473d2b2d01f4459b1e90fd12cc7840e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:46.590209 20836 consensus_queue.cc:1059] T ece3db938bc649d4a40a51522ed5259c P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.154s
W20260709 13:04:46.762432 19375 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.3:36891, user_credentials={real_user=slave}} blocked reactor thread for 216206us
I20260709 13:04:46.595778 20829 raft_consensus.cc:515] T 40e1e16737a842ee936002830f36882e P e5256d91808b47c195bc9b4dbd7f2b87 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:46.739574 20762 raft_consensus.cc:740] T fa731b585f684a7fb2d106c50f143b83 P e61c3a8f61bb48f8a963c9480e53c168 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e61c3a8f61bb48f8a963c9480e53c168, State: Running, Role: LEADER
W20260709 13:04:46.765787 19526 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:46.738580 20665 leader_election.cc:290] T 172b3dd13109415a955b71ac0e9d2234 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:04:46.561928 20734 consensus_queue.cc:260] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P 127766fc592545a4997f7790f50f6076 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:04:46.776165 19560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa731b585f684a7fb2d106c50f143b83" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:04:46.791911 19555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21e14947d70440f19044d8f75c31e1f9" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:04:46.797451 19558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e36a9d6e29c4a7c860cf267efbd4c74" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:04:46.801340 19560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff75a1d4cb1f493db8f71ddc136ba9ab" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:04:46.802479 19560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cdf56e38bbc453d9438d359e5a69955" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:04:46.802557 19555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2725d2c4cb054f18b0fc8f735c15f6c2" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:04:46.803212 19375 leader_election.cc:304] T fa731b585f684a7fb2d106c50f143b83 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87; no voters: 127766fc592545a4997f7790f50f6076, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:04:46.803503 19560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22196caba61445d3bec98a0aab3c337d" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:04:46.804790 19559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df751f992649444090e27965eb1af85d" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:04:46.805270 19556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edd7d470b5014c9489be7f41f64355c9" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:04:46.807713 19555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa8650e71aa14778b3d73721fc50d9fc" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:04:46.809199 19557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40e1e16737a842ee936002830f36882e" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:04:46.810638 19558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1b10566f45d4a7d9029858330e02d5b" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:04:46.811407 19558 raft_consensus.cc:2393] T f1b10566f45d4a7d9029858330e02d5b P e61c3a8f61bb48f8a963c9480e53c168 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate e5256d91808b47c195bc9b4dbd7f2b87 in current term 3: Already voted for candidate e61c3a8f61bb48f8a963c9480e53c168 in this term.
W20260709 13:04:46.801237 20822 consensus_meta.cc:287] T ef32ce6fdd0e40d382c79974f30295c6 P e5256d91808b47c195bc9b4dbd7f2b87: Time spent flushing consensus metadata: real 0.738s	user 0.010s	sys 0.000s
I20260709 13:04:46.804466 19552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2725d2c4cb054f18b0fc8f735c15f6c2" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:04:46.823760 19483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14935b3ddf914369822e4a0547aaa355" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:04:46.823521 20762 consensus_queue.cc:260] T fa731b585f684a7fb2d106c50f143b83 P e61c3a8f61bb48f8a963c9480e53c168 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:04:46.825531 20807 leader_election.cc:290] T 4509b76741dc428e9201c70c1658da13 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:04:46.827209 20829 leader_election.cc:290] T 40e1e16737a842ee936002830f36882e P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 3 election: Requested vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
W20260709 13:04:46.829192 20752 consensus_meta.cc:287] T 40e1e16737a842ee936002830f36882e P 0473d2b2d01f4459b1e90fd12cc7840e: Time spent flushing consensus metadata: real 0.691s	user 0.009s	sys 0.000s
I20260709 13:04:46.829445 19403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc225c93219c45538b53a1bd3d387e4d" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
I20260709 13:04:46.829617 20752 raft_consensus.cc:515] T 40e1e16737a842ee936002830f36882e P 0473d2b2d01f4459b1e90fd12cc7840e [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:46.830643 19479 raft_consensus.cc:1240] T 40e1e16737a842ee936002830f36882e P 0473d2b2d01f4459b1e90fd12cc7840e [term 3 FOLLOWER]: Rejecting Update request from peer e61c3a8f61bb48f8a963c9480e53c168 for earlier term 2. Current term is 3. Ops: []
W20260709 13:04:46.831230 20805 consensus_meta.cc:287] T 1f85fc4b527a48848e5faa083b604e36 P 0473d2b2d01f4459b1e90fd12cc7840e: Time spent flushing consensus metadata: real 0.631s	user 0.009s	sys 0.002s
I20260709 13:04:46.831835 20822 raft_consensus.cc:515] T ef32ce6fdd0e40d382c79974f30295c6 P e5256d91808b47c195bc9b4dbd7f2b87 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:46.833957 20822 leader_election.cc:290] T ef32ce6fdd0e40d382c79974f30295c6 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 2 election: Requested vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:04:46.804466 19402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b74109013a140ada21feeef92d6f563" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:04:46.835399 19559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a08760e15aac4630a629431f56024dc8" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:04:46.817884 19410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "309c3ca0ca4b4f3ba129752ea2cb293b" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
I20260709 13:04:46.811838 20682 tablet_bootstrap.cc:492] T 309c3ca0ca4b4f3ba129752ea2cb293b P 127766fc592545a4997f7790f50f6076: Bootstrap starting.
I20260709 13:04:46.841674 20844 raft_consensus.cc:2749] T fa731b585f684a7fb2d106c50f143b83 P e5256d91808b47c195bc9b4dbd7f2b87 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:04:46.846232 20752 leader_election.cc:290] T 40e1e16737a842ee936002830f36882e P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 3 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:04:46.849371 20826 raft_consensus.cc:515] T ab43d85f64114d4ebf618930e43d9ed0 P e5256d91808b47c195bc9b4dbd7f2b87 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } attrs { replace: true } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: NON_VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: true } }
I20260709 13:04:46.852053 20826 leader_election.cc:290] T ab43d85f64114d4ebf618930e43d9ed0 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 2 election: Requested vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
W20260709 13:04:46.847563 20810 consensus_meta.cc:287] T 62c6c134d3d24a1ab144dd9ee6bc3f64 P 0473d2b2d01f4459b1e90fd12cc7840e: Time spent flushing consensus metadata: real 0.560s	user 0.009s	sys 0.000s
I20260709 13:04:46.822619 19375 leader_election.cc:304] T 2e36a9d6e29c4a7c860cf267efbd4c74 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:04:46.859992 20826 raft_consensus.cc:2749] T 2e36a9d6e29c4a7c860cf267efbd4c74 P e5256d91808b47c195bc9b4dbd7f2b87 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:04:46.817297 19554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22196caba61445d3bec98a0aab3c337d" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
W20260709 13:04:46.867477 20819 consensus_meta.cc:287] T 1dc5b3532fe54f74876d02beffa2c230 P e5256d91808b47c195bc9b4dbd7f2b87: Time spent flushing consensus metadata: real 0.795s	user 0.007s	sys 0.005s
W20260709 13:04:46.869522 19375 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.3:36891, user_credentials={real_user=slave}} blocked reactor thread for 46954.7us
I20260709 13:04:46.869637 20107 raft_consensus.cc:515] T ff9b0eddd810459b82d91c60777c10eb P 127766fc592545a4997f7790f50f6076 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:04:46.800374 20733 consensus_queue.cc:1059] T 7f575b143b844aa096b50997dad3516a P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.055s
I20260709 13:04:46.876582 20744 consensus_queue.cc:1059] T df751f992649444090e27965eb1af85d P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } attrs { replace: true }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:04:46.855415 19553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9f0d59553ad444883fcf5b5909f9798" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:04:46.895999 19375 leader_election.cc:304] T ff75a1d4cb1f493db8f71ddc136ba9ab P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:04:46.898301 19449 leader_election.cc:304] T 28af091831594f9d8e96482078cc7625 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e; no voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:04:46.899799 19449 leader_election.cc:304] T 86a6797bdfe94fa496c050ceae4bd0d9 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e; no voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168
W20260709 13:04:46.910924 19523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.1:40321, user_credentials={real_user=slave}} blocked reactor thread for 63161.4us
I20260709 13:04:46.913007 19377 leader_election.cc:304] T f1b10566f45d4a7d9029858330e02d5b P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87; no voters: 
W20260709 13:04:46.907558 20803 consensus_meta.cc:287] T 2e36a9d6e29c4a7c860cf267efbd4c74 P 0473d2b2d01f4459b1e90fd12cc7840e: Time spent flushing consensus metadata: real 0.510s	user 0.007s	sys 0.002s
I20260709 13:04:46.911849 19449 leader_election.cc:304] T 76cb037fc9064d13b59a8969d897ce8c P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e; no voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:04:46.914397 19375 leader_election.cc:304] T 0cdf56e38bbc453d9438d359e5a69955 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:04:46.915938 20665 consensus_queue.cc:1059] T 309c3ca0ca4b4f3ba129752ea2cb293b P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 }, Status: INVALID_TERM, Last received: 2.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
W20260709 13:04:46.918583 19526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.2:46257, user_credentials={real_user=slave}} blocked reactor thread for 43850us
I20260709 13:04:46.908278 20839 raft_consensus.cc:2749] T 86a6797bdfe94fa496c050ceae4bd0d9 P 0473d2b2d01f4459b1e90fd12cc7840e [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:04:46.908877 20860 raft_consensus.cc:2749] T 28af091831594f9d8e96482078cc7625 P 0473d2b2d01f4459b1e90fd12cc7840e [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:04:46.894873 20819 raft_consensus.cc:515] T 1dc5b3532fe54f74876d02beffa2c230 P e5256d91808b47c195bc9b4dbd7f2b87 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:46.903043 20738 raft_consensus.cc:515] T b08304a0a02b42d7840c4e8ee9a6bd1a P e5256d91808b47c195bc9b4dbd7f2b87 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:46.910531 20742 raft_consensus.cc:493] T 1efebf73c86e432baa55533136b6e12c P 0473d2b2d01f4459b1e90fd12cc7840e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e61c3a8f61bb48f8a963c9480e53c168)
I20260709 13:04:46.918383 20836 raft_consensus.cc:2749] T ff75a1d4cb1f493db8f71ddc136ba9ab P e5256d91808b47c195bc9b4dbd7f2b87 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:04:46.901764 20826 consensus_queue.cc:1059] T 28af091831594f9d8e96482078cc7625 P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.018s
I20260709 13:04:46.930791 19523 leader_election.cc:304] T 217b5fae677b4971b3bbd2f357a1f7ff P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e61c3a8f61bb48f8a963c9480e53c168; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:04:46.954221 19483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "172b3dd13109415a955b71ac0e9d2234" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:04:46.920392 19449 leader_election.cc:304] T 7be9efa6559648dbb5a0f7684c4542d1 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e; no voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:04:46.913851 20812 leader_election.cc:290] T 22196caba61445d3bec98a0aab3c337d P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 2 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:04:46.959084 19485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab43d85f64114d4ebf618930e43d9ed0" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:04:46.958601 19483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef32ce6fdd0e40d382c79974f30295c6" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
W20260709 13:04:46.959540 19375 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.3:36891, user_credentials={real_user=slave}} blocked reactor thread for 46244.8us
I20260709 13:04:46.928129 20831 raft_consensus.cc:2804] T f1b10566f45d4a7d9029858330e02d5b P e5256d91808b47c195bc9b4dbd7f2b87 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:04:46.960994 19375 leader_election.cc:304] T 2725d2c4cb054f18b0fc8f735c15f6c2 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:04:46.963300 19485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40e1e16737a842ee936002830f36882e" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:04:46.931735 20810 raft_consensus.cc:2749] T 76cb037fc9064d13b59a8969d897ce8c P 0473d2b2d01f4459b1e90fd12cc7840e [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:04:46.965593 19409 raft_consensus.cc:1240] T 1dc5b3532fe54f74876d02beffa2c230 P e5256d91808b47c195bc9b4dbd7f2b87 [term 2 FOLLOWER]: Rejecting Update request from peer 0473d2b2d01f4459b1e90fd12cc7840e for earlier term 1. Current term is 2. Ops: []
W20260709 13:04:46.968348 20856 log.cc:927] Time spent T 9962423cb4e54fcfa5de01daf68a86e7 P 127766fc592545a4997f7790f50f6076: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
I20260709 13:04:46.971885 20738 leader_election.cc:290] T b08304a0a02b42d7840c4e8ee9a6bd1a P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 2 election: Requested vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:04:46.973109 20107 leader_election.cc:290] T ff9b0eddd810459b82d91c60777c10eb P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 2 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:04:46.976840 20836 raft_consensus.cc:3055] T 28af091831594f9d8e96482078cc7625 P e5256d91808b47c195bc9b4dbd7f2b87 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:04:46.977361 20830 raft_consensus.cc:3055] T ece3db938bc649d4a40a51522ed5259c P e5256d91808b47c195bc9b4dbd7f2b87 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:04:46.977378 20836 raft_consensus.cc:740] T 28af091831594f9d8e96482078cc7625 P e5256d91808b47c195bc9b4dbd7f2b87 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e5256d91808b47c195bc9b4dbd7f2b87, State: Running, Role: LEADER
I20260709 13:04:46.977957 20830 raft_consensus.cc:740] T ece3db938bc649d4a40a51522ed5259c P e5256d91808b47c195bc9b4dbd7f2b87 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e5256d91808b47c195bc9b4dbd7f2b87, State: Running, Role: LEADER
I20260709 13:04:46.978747 20836 consensus_queue.cc:260] T 28af091831594f9d8e96482078cc7625 P e5256d91808b47c195bc9b4dbd7f2b87 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:46.918507 20803 raft_consensus.cc:515] T 2e36a9d6e29c4a7c860cf267efbd4c74 P 0473d2b2d01f4459b1e90fd12cc7840e [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
W20260709 13:04:46.981544 19449 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.1:40321, user_credentials={real_user=slave}} blocked reactor thread for 61248us
I20260709 13:04:46.982257 19375 leader_election.cc:304] T fa8650e71aa14778b3d73721fc50d9fc P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:04:46.961491 20828 raft_consensus.cc:2749] T 0cdf56e38bbc453d9438d359e5a69955 P e5256d91808b47c195bc9b4dbd7f2b87 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:04:46.994048 19449 leader_election.cc:304] T f93ee515a9c14139bf566522ed8232f3 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e; no voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:04:46.998142 20752 raft_consensus.cc:2749] T 7be9efa6559648dbb5a0f7684c4542d1 P 0473d2b2d01f4459b1e90fd12cc7840e [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:04:47.001492 19449 leader_election.cc:304] T bc225c93219c45538b53a1bd3d387e4d P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e; no voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:04:47.002352 20810 raft_consensus.cc:2749] T bc225c93219c45538b53a1bd3d387e4d P 0473d2b2d01f4459b1e90fd12cc7840e [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:04:47.003150 20833 raft_consensus.cc:3055] T 76cb037fc9064d13b59a8969d897ce8c P e5256d91808b47c195bc9b4dbd7f2b87 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:04:47.003547 20833 raft_consensus.cc:740] T 76cb037fc9064d13b59a8969d897ce8c P e5256d91808b47c195bc9b4dbd7f2b87 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e5256d91808b47c195bc9b4dbd7f2b87, State: Running, Role: LEADER
I20260709 13:04:47.004343 20833 consensus_queue.cc:260] T 76cb037fc9064d13b59a8969d897ce8c P e5256d91808b47c195bc9b4dbd7f2b87 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:47.005551 20833 raft_consensus.cc:3060] T 76cb037fc9064d13b59a8969d897ce8c P e5256d91808b47c195bc9b4dbd7f2b87 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:47.005862 19481 raft_consensus.cc:2468] T 62c6c134d3d24a1ab144dd9ee6bc3f64 P 0473d2b2d01f4459b1e90fd12cc7840e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 2.
I20260709 13:04:47.008167 20107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "172b3dd13109415a955b71ac0e9d2234" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
W20260709 13:04:47.008652 19374 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:47.008965 20106 raft_consensus.cc:1240] T ece3db938bc649d4a40a51522ed5259c P 127766fc592545a4997f7790f50f6076 [term 2 FOLLOWER]: Rejecting Update request from peer e5256d91808b47c195bc9b4dbd7f2b87 for earlier term 1. Current term is 2. Ops: []
I20260709 13:04:47.010731 19402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff9b0eddd810459b82d91c60777c10eb" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
I20260709 13:04:47.010895 19410 raft_consensus.cc:1275] T fa731b585f684a7fb2d106c50f143b83 P e5256d91808b47c195bc9b4dbd7f2b87 [term 2 FOLLOWER]: Refusing update from remote peer 127766fc592545a4997f7790f50f6076: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:04:47.011304 19402 raft_consensus.cc:3055] T ff9b0eddd810459b82d91c60777c10eb P e5256d91808b47c195bc9b4dbd7f2b87 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:04:47.011646 19402 raft_consensus.cc:740] T ff9b0eddd810459b82d91c60777c10eb P e5256d91808b47c195bc9b4dbd7f2b87 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e5256d91808b47c195bc9b4dbd7f2b87, State: Running, Role: LEADER
I20260709 13:04:47.012430 19402 consensus_queue.cc:260] T ff9b0eddd810459b82d91c60777c10eb P e5256d91808b47c195bc9b4dbd7f2b87 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:04:47.013435 19402 raft_consensus.cc:3060] T ff9b0eddd810459b82d91c60777c10eb P e5256d91808b47c195bc9b4dbd7f2b87 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:47.014214 20810 raft_consensus.cc:493] T e381f1d6b8184797ad142de49be225a8 P 0473d2b2d01f4459b1e90fd12cc7840e [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e5256d91808b47c195bc9b4dbd7f2b87)
I20260709 13:04:47.014722 20810 raft_consensus.cc:515] T e381f1d6b8184797ad142de49be225a8 P 0473d2b2d01f4459b1e90fd12cc7840e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:46.980703 20836 raft_consensus.cc:3060] T 28af091831594f9d8e96482078cc7625 P e5256d91808b47c195bc9b4dbd7f2b87 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:47.024482 19482 raft_consensus.cc:1240] T 2e36a9d6e29c4a7c860cf267efbd4c74 P 0473d2b2d01f4459b1e90fd12cc7840e [term 2 FOLLOWER]: Rejecting Update request from peer e61c3a8f61bb48f8a963c9480e53c168 for earlier term 1. Current term is 2. Ops: []
I20260709 13:04:47.021348 19375 leader_election.cc:304] T 22196caba61445d3bec98a0aab3c337d P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:04:46.960167 20742 raft_consensus.cc:515] T 1efebf73c86e432baa55533136b6e12c P 0473d2b2d01f4459b1e90fd12cc7840e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:04:46.990355 20844 raft_consensus.cc:2749] T 2725d2c4cb054f18b0fc8f735c15f6c2 P e5256d91808b47c195bc9b4dbd7f2b87 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:04:47.000108 20855 raft_consensus.cc:2749] T fa8650e71aa14778b3d73721fc50d9fc P e5256d91808b47c195bc9b4dbd7f2b87 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:04:47.038198 19375 leader_election.cc:304] T a08760e15aac4630a629431f56024dc8 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168
W20260709 13:04:47.035780 19377 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.2:46257, user_credentials={real_user=slave}} blocked reactor thread for 116642us
I20260709 13:04:46.989936 20831 raft_consensus.cc:697] T f1b10566f45d4a7d9029858330e02d5b P e5256d91808b47c195bc9b4dbd7f2b87 [term 3 LEADER]: Becoming Leader. State: Replica: e5256d91808b47c195bc9b4dbd7f2b87, State: Running, Role: LEADER
I20260709 13:04:46.966455 20834 consensus_queue.cc:1059] T 86a6797bdfe94fa496c050ceae4bd0d9 P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.053s
I20260709 13:04:47.034098 19483 raft_consensus.cc:1275] T 1f85fc4b527a48848e5faa083b604e36 P 0473d2b2d01f4459b1e90fd12cc7840e [term 2 FOLLOWER]: Refusing update from remote peer e5256d91808b47c195bc9b4dbd7f2b87: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:04:47.053736 19408 raft_consensus.cc:1240] T b08304a0a02b42d7840c4e8ee9a6bd1a P e5256d91808b47c195bc9b4dbd7f2b87 [term 2 FOLLOWER]: Rejecting Update request from peer 0473d2b2d01f4459b1e90fd12cc7840e for earlier term 1. Current term is 2. Ops: []
I20260709 13:04:47.036650 20109 raft_consensus.cc:1240] T ff9b0eddd810459b82d91c60777c10eb P 127766fc592545a4997f7790f50f6076 [term 2 FOLLOWER]: Rejecting Update request from peer e5256d91808b47c195bc9b4dbd7f2b87 for earlier term 1. Current term is 2. Ops: []
I20260709 13:04:47.042646 20107 raft_consensus.cc:1275] T 1f85fc4b527a48848e5faa083b604e36 P 127766fc592545a4997f7790f50f6076 [term 2 FOLLOWER]: Refusing update from remote peer e5256d91808b47c195bc9b4dbd7f2b87: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:04:47.050407 19403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4509b76741dc428e9201c70c1658da13" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
W20260709 13:04:47.042999 20076 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:47.044726 19478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76cb037fc9064d13b59a8969d897ce8c" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:04:47.051456 19406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40e1e16737a842ee936002830f36882e" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
I20260709 13:04:47.052302 19410 raft_consensus.cc:1240] T ff75a1d4cb1f493db8f71ddc136ba9ab P e5256d91808b47c195bc9b4dbd7f2b87 [term 2 FOLLOWER]: Rejecting Update request from peer 0473d2b2d01f4459b1e90fd12cc7840e for earlier term 1. Current term is 2. Ops: []
I20260709 13:04:47.079098 20831 consensus_queue.cc:237] T f1b10566f45d4a7d9029858330e02d5b P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:47.052564 19407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22196caba61445d3bec98a0aab3c337d" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
I20260709 13:04:47.041014 20810 leader_election.cc:290] T e381f1d6b8184797ad142de49be225a8 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:04:47.017654 20812 raft_consensus.cc:2749] T f93ee515a9c14139bf566522ed8232f3 P 0473d2b2d01f4459b1e90fd12cc7840e [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:04:47.047386 19375 leader_election.cc:304] T b9f0d59553ad444883fcf5b5909f9798 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:04:47.055634 19408 raft_consensus.cc:1240] T ef32ce6fdd0e40d382c79974f30295c6 P e5256d91808b47c195bc9b4dbd7f2b87 [term 2 FOLLOWER]: Rejecting Update request from peer 0473d2b2d01f4459b1e90fd12cc7840e for earlier term 1. Current term is 2. Ops: []
I20260709 13:04:47.033252 20829 raft_consensus.cc:2749] T 22196caba61445d3bec98a0aab3c337d P e5256d91808b47c195bc9b4dbd7f2b87 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
W20260709 13:04:47.067492 19526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.2:46257, user_credentials={real_user=slave}} blocked reactor thread for 117652us
I20260709 13:04:46.997316 20863 consensus_queue.cc:1059] T 7f575b143b844aa096b50997dad3516a P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.066s
I20260709 13:04:47.070511 19405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e381f1d6b8184797ad142de49be225a8" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:04:47.018545 20830 consensus_queue.cc:260] T ece3db938bc649d4a40a51522ed5259c P e5256d91808b47c195bc9b4dbd7f2b87 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:04:47.072098 19478 raft_consensus.cc:2393] T 76cb037fc9064d13b59a8969d897ce8c P 0473d2b2d01f4459b1e90fd12cc7840e [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e61c3a8f61bb48f8a963c9480e53c168 in current term 2: Already voted for candidate 0473d2b2d01f4459b1e90fd12cc7840e in this term.
I20260709 13:04:47.072111 19406 raft_consensus.cc:2393] T 40e1e16737a842ee936002830f36882e P e5256d91808b47c195bc9b4dbd7f2b87 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 0473d2b2d01f4459b1e90fd12cc7840e in current term 3: Already voted for candidate e5256d91808b47c195bc9b4dbd7f2b87 in this term.
I20260709 13:04:47.077008 20803 leader_election.cc:290] T 2e36a9d6e29c4a7c860cf267efbd4c74 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 2 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:04:47.045296 20835 raft_consensus.cc:2749] T a08760e15aac4630a629431f56024dc8 P e5256d91808b47c195bc9b4dbd7f2b87 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:04:47.089751 19407 raft_consensus.cc:2393] T 22196caba61445d3bec98a0aab3c337d P e5256d91808b47c195bc9b4dbd7f2b87 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 0473d2b2d01f4459b1e90fd12cc7840e in current term 2: Already voted for candidate e5256d91808b47c195bc9b4dbd7f2b87 in this term.
I20260709 13:04:47.090631 19405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e36a9d6e29c4a7c860cf267efbd4c74" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
I20260709 13:04:47.085804 19526 leader_election.cc:304] T 309c3ca0ca4b4f3ba129752ea2cb293b P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:04:47.088979 20864 raft_consensus.cc:2749] T 217b5fae677b4971b3bbd2f357a1f7ff P e61c3a8f61bb48f8a963c9480e53c168 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:04:47.091233 19405 raft_consensus.cc:3060] T 2e36a9d6e29c4a7c860cf267efbd4c74 P e5256d91808b47c195bc9b4dbd7f2b87 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:47.092124 20752 consensus_queue.cc:1059] T ff75a1d4cb1f493db8f71ddc136ba9ab P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.005s
I20260709 13:04:47.095347 20742 leader_election.cc:290] T 1efebf73c86e432baa55533136b6e12c P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:04:47.064335 20801 consensus_queue.cc:1048] T fa731b585f684a7fb2d106c50f143b83 P 127766fc592545a4997f7790f50f6076 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.026s
W20260709 13:04:47.099900 19375 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.3:36891, user_credentials={real_user=slave}} blocked reactor thread for 52596.3us
I20260709 13:04:47.101444 20835 raft_consensus.cc:2749] T b9f0d59553ad444883fcf5b5909f9798 P e5256d91808b47c195bc9b4dbd7f2b87 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:04:47.099586 20834 consensus_queue.cc:1059] T f93ee515a9c14139bf566522ed8232f3 P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.005s
I20260709 13:04:47.101611 20871 consensus_queue.cc:1048] T 1f85fc4b527a48848e5faa083b604e36 P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Connected to new peer: Peer: permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.003s
I20260709 13:04:47.105171 20834 raft_consensus.cc:3055] T f93ee515a9c14139bf566522ed8232f3 P e5256d91808b47c195bc9b4dbd7f2b87 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:04:47.105660 20834 raft_consensus.cc:740] T f93ee515a9c14139bf566522ed8232f3 P e5256d91808b47c195bc9b4dbd7f2b87 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e5256d91808b47c195bc9b4dbd7f2b87, State: Running, Role: LEADER
I20260709 13:04:47.107291 19554 raft_consensus.cc:3055] T edd7d470b5014c9489be7f41f64355c9 P e61c3a8f61bb48f8a963c9480e53c168 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:04:47.107690 19554 raft_consensus.cc:740] T edd7d470b5014c9489be7f41f64355c9 P e61c3a8f61bb48f8a963c9480e53c168 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e61c3a8f61bb48f8a963c9480e53c168, State: Running, Role: LEADER
I20260709 13:04:47.091468 20828 consensus_queue.cc:1059] T ece3db938bc649d4a40a51522ed5259c P e5256d91808b47c195bc9b4dbd7f2b87 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.019s
I20260709 13:04:47.108429 19554 consensus_queue.cc:260] T edd7d470b5014c9489be7f41f64355c9 P e61c3a8f61bb48f8a963c9480e53c168 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:47.111639 19377 leader_election.cc:304] T 172b3dd13109415a955b71ac0e9d2234 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, 127766fc592545a4997f7790f50f6076
I20260709 13:04:47.088286 20812 consensus_queue.cc:1059] T b08304a0a02b42d7840c4e8ee9a6bd1a P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.025s
I20260709 13:04:47.114384 19557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b08304a0a02b42d7840c4e8ee9a6bd1a" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:04:47.114550 19559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab43d85f64114d4ebf618930e43d9ed0" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:04:47.114992 19557 raft_consensus.cc:3060] T b08304a0a02b42d7840c4e8ee9a6bd1a P e61c3a8f61bb48f8a963c9480e53c168 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:47.109448 19554 raft_consensus.cc:3060] T edd7d470b5014c9489be7f41f64355c9 P e61c3a8f61bb48f8a963c9480e53c168 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:47.140663 19556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef32ce6fdd0e40d382c79974f30295c6" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:04:47.141175 19557 raft_consensus.cc:2468] T b08304a0a02b42d7840c4e8ee9a6bd1a P e61c3a8f61bb48f8a963c9480e53c168 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 2.
I20260709 13:04:47.142709 20732 raft_consensus.cc:3055] T ed7fdbcb96d14d418db9ca90a792588a P e61c3a8f61bb48f8a963c9480e53c168 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:04:47.143121 20732 raft_consensus.cc:740] T ed7fdbcb96d14d418db9ca90a792588a P e61c3a8f61bb48f8a963c9480e53c168 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e61c3a8f61bb48f8a963c9480e53c168, State: Running, Role: LEADER
I20260709 13:04:47.143925 20732 consensus_queue.cc:260] T ed7fdbcb96d14d418db9ca90a792588a P e61c3a8f61bb48f8a963c9480e53c168 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:04:47.144867 20732 raft_consensus.cc:3060] T ed7fdbcb96d14d418db9ca90a792588a P e61c3a8f61bb48f8a963c9480e53c168 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:47.135644 20812 raft_consensus.cc:3055] T b08304a0a02b42d7840c4e8ee9a6bd1a P 0473d2b2d01f4459b1e90fd12cc7840e [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:04:47.096951 20869 raft_consensus.cc:3055] T 86a6797bdfe94fa496c050ceae4bd0d9 P e5256d91808b47c195bc9b4dbd7f2b87 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:04:47.140584 19555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dc5b3532fe54f74876d02beffa2c230" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:04:47.150125 19405 raft_consensus.cc:2468] T 2e36a9d6e29c4a7c860cf267efbd4c74 P e5256d91808b47c195bc9b4dbd7f2b87 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 2.
I20260709 13:04:47.111549 20864 raft_consensus.cc:2804] T 309c3ca0ca4b4f3ba129752ea2cb293b P e61c3a8f61bb48f8a963c9480e53c168 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:04:47.152832 19449 leader_election.cc:304] T 2e36a9d6e29c4a7c860cf267efbd4c74 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87; no voters: 
I20260709 13:04:47.110427 20834 consensus_queue.cc:260] T f93ee515a9c14139bf566522ed8232f3 P e5256d91808b47c195bc9b4dbd7f2b87 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:47.135946 19402 raft_consensus.cc:2468] T ff9b0eddd810459b82d91c60777c10eb P e5256d91808b47c195bc9b4dbd7f2b87 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 127766fc592545a4997f7790f50f6076 in term 2.
I20260709 13:04:47.149075 19375 leader_election.cc:304] T ab43d85f64114d4ebf618930e43d9ed0 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:04:47.168354 19483 raft_consensus.cc:1240] T 775c229504194560ba9589bc2199b089 P 0473d2b2d01f4459b1e90fd12cc7840e [term 2 FOLLOWER]: Rejecting Update request from peer e5256d91808b47c195bc9b4dbd7f2b87 for earlier term 1. Current term is 2. Ops: []
I20260709 13:04:47.168988 19478 raft_consensus.cc:1240] T bc225c93219c45538b53a1bd3d387e4d P 0473d2b2d01f4459b1e90fd12cc7840e [term 2 FOLLOWER]: Rejecting Update request from peer e5256d91808b47c195bc9b4dbd7f2b87 for earlier term 1. Current term is 2. Ops: []
I20260709 13:04:47.152619 20869 raft_consensus.cc:740] T 86a6797bdfe94fa496c050ceae4bd0d9 P e5256d91808b47c195bc9b4dbd7f2b87 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e5256d91808b47c195bc9b4dbd7f2b87, State: Running, Role: LEADER
I20260709 13:04:47.136142 20835 raft_consensus.cc:2749] T 172b3dd13109415a955b71ac0e9d2234 P e5256d91808b47c195bc9b4dbd7f2b87 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:04:47.162784 19553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40e1e16737a842ee936002830f36882e" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:04:47.091717 20839 consensus_queue.cc:1059] T ef32ce6fdd0e40d382c79974f30295c6 P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.057s
I20260709 13:04:47.180383 20839 raft_consensus.cc:3055] T ef32ce6fdd0e40d382c79974f30295c6 P 0473d2b2d01f4459b1e90fd12cc7840e [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:04:47.180513 20864 raft_consensus.cc:697] T 309c3ca0ca4b4f3ba129752ea2cb293b P e61c3a8f61bb48f8a963c9480e53c168 [term 3 LEADER]: Becoming Leader. State: Replica: e61c3a8f61bb48f8a963c9480e53c168, State: Running, Role: LEADER
I20260709 13:04:47.180763 20839 raft_consensus.cc:740] T ef32ce6fdd0e40d382c79974f30295c6 P 0473d2b2d01f4459b1e90fd12cc7840e [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0473d2b2d01f4459b1e90fd12cc7840e, State: Running, Role: LEADER
I20260709 13:04:47.181602 20839 consensus_queue.cc:260] T ef32ce6fdd0e40d382c79974f30295c6 P 0473d2b2d01f4459b1e90fd12cc7840e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:47.181507 20864 consensus_queue.cc:237] T 309c3ca0ca4b4f3ba129752ea2cb293b P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } attrs { replace: true } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: NON_VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: true } }
W20260709 13:04:47.163859 20827 consensus_meta.cc:287] T 2a16f7501e2444fb86d4e2778e734e02 P e5256d91808b47c195bc9b4dbd7f2b87: Time spent flushing consensus metadata: real 0.877s	user 0.007s	sys 0.004s
I20260709 13:04:47.210263 19478 raft_consensus.cc:1240] T 7be9efa6559648dbb5a0f7684c4542d1 P 0473d2b2d01f4459b1e90fd12cc7840e [term 2 FOLLOWER]: Rejecting Update request from peer e5256d91808b47c195bc9b4dbd7f2b87 for earlier term 1. Current term is 2. Ops: []
I20260709 13:04:47.212108 19478 raft_consensus.cc:1275] T edd7d470b5014c9489be7f41f64355c9 P 0473d2b2d01f4459b1e90fd12cc7840e [term 2 FOLLOWER]: Refusing update from remote peer e5256d91808b47c195bc9b4dbd7f2b87: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 13:04:47.213109 19375 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.3:36891, user_credentials={real_user=slave}} blocked reactor thread for 64153.8us
I20260709 13:04:47.217068 19483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dc5b3532fe54f74876d02beffa2c230" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:04:47.152817 20812 raft_consensus.cc:740] T b08304a0a02b42d7840c4e8ee9a6bd1a P 0473d2b2d01f4459b1e90fd12cc7840e [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0473d2b2d01f4459b1e90fd12cc7840e, State: Running, Role: LEADER
I20260709 13:04:47.221685 20863 consensus_queue.cc:1059] T 22196caba61445d3bec98a0aab3c337d P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:04:47.224557 20834 raft_consensus.cc:3060] T f93ee515a9c14139bf566522ed8232f3 P e5256d91808b47c195bc9b4dbd7f2b87 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:47.225013 19478 raft_consensus.cc:1275] T 21e14947d70440f19044d8f75c31e1f9 P 0473d2b2d01f4459b1e90fd12cc7840e [term 2 FOLLOWER]: Refusing update from remote peer e5256d91808b47c195bc9b4dbd7f2b87: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:47.170145 20843 raft_consensus.cc:3055] T bc225c93219c45538b53a1bd3d387e4d P e5256d91808b47c195bc9b4dbd7f2b87 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:04:47.177402 20752 raft_consensus.cc:2804] T 2e36a9d6e29c4a7c860cf267efbd4c74 P 0473d2b2d01f4459b1e90fd12cc7840e [term 2 FOLLOWER]: Leader election won for term 2
W20260709 13:04:47.230062 20850 log.cc:927] Time spent T 21e14947d70440f19044d8f75c31e1f9 P e5256d91808b47c195bc9b4dbd7f2b87: Append to log took a long time: real 0.647s	user 0.006s	sys 0.000s
I20260709 13:04:47.230301 19375 leader_election.cc:304] T b08304a0a02b42d7840c4e8ee9a6bd1a P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:04:47.231390 19375 leader_election.cc:304] T ef32ce6fdd0e40d382c79974f30295c6 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:04:47.231922 20821 raft_consensus.cc:3055] T 7be9efa6559648dbb5a0f7684c4542d1 P e5256d91808b47c195bc9b4dbd7f2b87 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:04:47.232372 20821 raft_consensus.cc:740] T 7be9efa6559648dbb5a0f7684c4542d1 P e5256d91808b47c195bc9b4dbd7f2b87 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e5256d91808b47c195bc9b4dbd7f2b87, State: Running, Role: LEADER
I20260709 13:04:47.232558 19375 leader_election.cc:304] T 40e1e16737a842ee936002830f36882e P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:04:47.218611 20833 raft_consensus.cc:2749] T ab43d85f64114d4ebf618930e43d9ed0 P e5256d91808b47c195bc9b4dbd7f2b87 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:04:47.219449 20839 raft_consensus.cc:3060] T ef32ce6fdd0e40d382c79974f30295c6 P 0473d2b2d01f4459b1e90fd12cc7840e [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:04:47.249251 19523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.1:40321, user_credentials={real_user=slave}} blocked reactor thread for 318529us
I20260709 13:04:47.237074 20843 raft_consensus.cc:740] T bc225c93219c45538b53a1bd3d387e4d P e5256d91808b47c195bc9b4dbd7f2b87 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e5256d91808b47c195bc9b4dbd7f2b87, State: Running, Role: LEADER
I20260709 13:04:47.236937 20752 raft_consensus.cc:697] T 2e36a9d6e29c4a7c860cf267efbd4c74 P 0473d2b2d01f4459b1e90fd12cc7840e [term 2 LEADER]: Becoming Leader. State: Replica: 0473d2b2d01f4459b1e90fd12cc7840e, State: Running, Role: LEADER
I20260709 13:04:47.237521 19480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b08304a0a02b42d7840c4e8ee9a6bd1a" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:04:47.252056 19523 leader_election.cc:304] T 2a16f7501e2444fb86d4e2778e734e02 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e61c3a8f61bb48f8a963c9480e53c168; no voters: 127766fc592545a4997f7790f50f6076, e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:04:47.253846 19450 leader_election.cc:304] T 2b74109013a140ada21feeef92d6f563 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e; no voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:04:47.265806 20742 raft_consensus.cc:2749] T 2b74109013a140ada21feeef92d6f563 P 0473d2b2d01f4459b1e90fd12cc7840e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:04:47.267494 19405 raft_consensus.cc:1240] T ff75a1d4cb1f493db8f71ddc136ba9ab P e5256d91808b47c195bc9b4dbd7f2b87 [term 2 FOLLOWER]: Rejecting Update request from peer 0473d2b2d01f4459b1e90fd12cc7840e for earlier term 1. Current term is 2. Ops: []
I20260709 13:04:47.244195 20829 raft_consensus.cc:2749] T ef32ce6fdd0e40d382c79974f30295c6 P e5256d91808b47c195bc9b4dbd7f2b87 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:04:47.254971 20869 consensus_queue.cc:260] T 86a6797bdfe94fa496c050ceae4bd0d9 P e5256d91808b47c195bc9b4dbd7f2b87 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
W20260709 13:04:47.257355 20075 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:04:47.254109 19524 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:04:47.280280 19449 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:47.244007 20665 raft_consensus.cc:2749] T 40e1e16737a842ee936002830f36882e P e5256d91808b47c195bc9b4dbd7f2b87 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:04:47.283680 20831 consensus_queue.cc:1059] T 775c229504194560ba9589bc2199b089 P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:04:47.284106 20866 raft_consensus.cc:2804] T b08304a0a02b42d7840c4e8ee9a6bd1a P e5256d91808b47c195bc9b4dbd7f2b87 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:04:47.233271 20821 consensus_queue.cc:260] T 7be9efa6559648dbb5a0f7684c4542d1 P e5256d91808b47c195bc9b4dbd7f2b87 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:47.258360 20812 consensus_queue.cc:260] T b08304a0a02b42d7840c4e8ee9a6bd1a P 0473d2b2d01f4459b1e90fd12cc7840e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:47.299952 20818 consensus_queue.cc:1059] T ff75a1d4cb1f493db8f71ddc136ba9ab P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.006s
I20260709 13:04:47.306028 20821 raft_consensus.cc:3060] T 7be9efa6559648dbb5a0f7684c4542d1 P e5256d91808b47c195bc9b4dbd7f2b87 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:47.306255 20812 raft_consensus.cc:3060] T b08304a0a02b42d7840c4e8ee9a6bd1a P 0473d2b2d01f4459b1e90fd12cc7840e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:47.299341 19558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4509b76741dc428e9201c70c1658da13" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:04:47.306591 19556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e381f1d6b8184797ad142de49be225a8" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:04:47.281338 20785 raft_consensus.cc:3060] T 14efcc79969f41babe5529c22d59156d P 127766fc592545a4997f7790f50f6076 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:04:47.311949 19556 raft_consensus.cc:2468] T e381f1d6b8184797ad142de49be225a8 P e61c3a8f61bb48f8a963c9480e53c168 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 2.
I20260709 13:04:47.307578 19557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40e1e16737a842ee936002830f36882e" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:04:47.313871 19560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22196caba61445d3bec98a0aab3c337d" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
W20260709 13:04:47.315059 19523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.1:40321, user_credentials={real_user=slave}} blocked reactor thread for 63107.5us
I20260709 13:04:47.317348 19558 raft_consensus.cc:1240] T b08304a0a02b42d7840c4e8ee9a6bd1a P e61c3a8f61bb48f8a963c9480e53c168 [term 2 FOLLOWER]: Rejecting Update request from peer 0473d2b2d01f4459b1e90fd12cc7840e for earlier term 1. Current term is 2. Ops: []
W20260709 13:04:47.309819 20823 consensus_meta.cc:287] T 70797e5783b5454ab0d0eea663e791e3 P e5256d91808b47c195bc9b4dbd7f2b87: Time spent flushing consensus metadata: real 0.719s	user 0.007s	sys 0.004s
I20260709 13:04:47.270078 20843 consensus_queue.cc:260] T bc225c93219c45538b53a1bd3d387e4d P e5256d91808b47c195bc9b4dbd7f2b87 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:47.322335 19560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e36a9d6e29c4a7c860cf267efbd4c74" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:04:47.326396 19450 leader_election.cc:304] T 4509b76741dc428e9201c70c1658da13 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e; no voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:04:47.327870 19450 leader_election.cc:304] T 40e1e16737a842ee936002830f36882e P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e; no voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:04:47.320060 19554 raft_consensus.cc:1275] T edd7d470b5014c9489be7f41f64355c9 P e61c3a8f61bb48f8a963c9480e53c168 [term 2 FOLLOWER]: Refusing update from remote peer e5256d91808b47c195bc9b4dbd7f2b87: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:47.287936 20833 consensus_queue.cc:1048] T 1f85fc4b527a48848e5faa083b604e36 P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.031s
I20260709 13:04:47.313432 20866 raft_consensus.cc:697] T b08304a0a02b42d7840c4e8ee9a6bd1a P e5256d91808b47c195bc9b4dbd7f2b87 [term 2 LEADER]: Becoming Leader. State: Replica: e5256d91808b47c195bc9b4dbd7f2b87, State: Running, Role: LEADER
I20260709 13:04:47.338788 19560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1efebf73c86e432baa55533136b6e12c" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:04:47.339690 19560 raft_consensus.cc:2468] T 1efebf73c86e432baa55533136b6e12c P e61c3a8f61bb48f8a963c9480e53c168 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 2.
I20260709 13:04:47.300319 20826 consensus_queue.cc:1048] T edd7d470b5014c9489be7f41f64355c9 P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.024s
W20260709 13:04:47.377745 19377 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.2:46257, user_credentials={real_user=slave}} blocked reactor thread for 93749us
I20260709 13:04:47.379034 19377 leader_election.cc:304] T 1dc5b3532fe54f74876d02beffa2c230 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:04:47.379863 20855 raft_consensus.cc:2749] T 1dc5b3532fe54f74876d02beffa2c230 P e5256d91808b47c195bc9b4dbd7f2b87 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:04:47.384578 20835 consensus_queue.cc:1048] T 21e14947d70440f19044d8f75c31e1f9 P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:04:47.389120 20882 raft_consensus.cc:2749] T 40e1e16737a842ee936002830f36882e P 0473d2b2d01f4459b1e90fd12cc7840e [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:04:47.390020 20882 raft_consensus.cc:493] T edd7d470b5014c9489be7f41f64355c9 P 0473d2b2d01f4459b1e90fd12cc7840e [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:47.390552 20882 raft_consensus.cc:515] T edd7d470b5014c9489be7f41f64355c9 P 0473d2b2d01f4459b1e90fd12cc7840e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:47.286573 20752 consensus_queue.cc:237] T 2e36a9d6e29c4a7c860cf267efbd4c74 P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:47.341825 20807 raft_consensus.cc:2749] T 4509b76741dc428e9201c70c1658da13 P 0473d2b2d01f4459b1e90fd12cc7840e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:04:47.337571 20873 raft_consensus.cc:2749] T 2a16f7501e2444fb86d4e2778e734e02 P e61c3a8f61bb48f8a963c9480e53c168 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 13:04:47.403970 19523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.1:40321, user_credentials={real_user=slave}} blocked reactor thread for 87073.5us
I20260709 13:04:47.376580 20754 consensus_queue.cc:1059] T bc225c93219c45538b53a1bd3d387e4d P e5256d91808b47c195bc9b4dbd7f2b87 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.061s
W20260709 13:04:47.405217 20870 log.cc:927] Time spent T 7f575b143b844aa096b50997dad3516a P 0473d2b2d01f4459b1e90fd12cc7840e: Append to log took a long time: real 0.094s	user 0.001s	sys 0.000s
I20260709 13:04:47.408766 20860 raft_consensus.cc:493] T 9962423cb4e54fcfa5de01daf68a86e7 P 0473d2b2d01f4459b1e90fd12cc7840e [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:47.420236 19523 leader_election.cc:304] T 46c5bfeecc314717bffe987e6844b6d0 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168; no voters: 0473d2b2d01f4459b1e90fd12cc7840e
I20260709 13:04:47.425525 20864 raft_consensus.cc:2804] T 46c5bfeecc314717bffe987e6844b6d0 P e61c3a8f61bb48f8a963c9480e53c168 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:04:47.426076 20864 raft_consensus.cc:697] T 46c5bfeecc314717bffe987e6844b6d0 P e61c3a8f61bb48f8a963c9480e53c168 [term 3 LEADER]: Becoming Leader. State: Replica: e61c3a8f61bb48f8a963c9480e53c168, State: Running, Role: LEADER
I20260709 13:04:47.426946 20882 leader_election.cc:290] T edd7d470b5014c9489be7f41f64355c9 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:04:47.413800 20682 tablet_bootstrap.cc:700] T 309c3ca0ca4b4f3ba129752ea2cb293b P 127766fc592545a4997f7790f50f6076: Time spent opening tablet: real 0.152s	user 0.001s	sys 0.001s
W20260709 13:04:47.429582 19377 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:47.435638 20825 raft_consensus.cc:3055] T 775c229504194560ba9589bc2199b089 P e5256d91808b47c195bc9b4dbd7f2b87 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:04:47.436087 20825 raft_consensus.cc:740] T 775c229504194560ba9589bc2199b089 P e5256d91808b47c195bc9b4dbd7f2b87 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e5256d91808b47c195bc9b4dbd7f2b87, State: Running, Role: LEADER
I20260709 13:04:47.436951 20825 consensus_queue.cc:260] T 775c229504194560ba9589bc2199b089 P e5256d91808b47c195bc9b4dbd7f2b87 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:04:47.438490 20825 raft_consensus.cc:3060] T 775c229504194560ba9589bc2199b089 P e5256d91808b47c195bc9b4dbd7f2b87 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:47.448966 19403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edd7d470b5014c9489be7f41f64355c9" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:04:47.450148 20812 raft_consensus.cc:493] T 0e1085d23e8347fbbd5bce7542f4b1f4 P 0473d2b2d01f4459b1e90fd12cc7840e [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:04:47.453671 19375 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.3:36891, user_credentials={real_user=slave}} blocked reactor thread for 167221us
I20260709 13:04:47.458554 20888 raft_consensus.cc:493] T 0e1085d23e8347fbbd5bce7542f4b1f4 P e61c3a8f61bb48f8a963c9480e53c168 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:47.418880 20863 consensus_queue.cc:1059] T df751f992649444090e27965eb1af85d P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.027s
W20260709 13:04:47.463614 19450 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.3:36891, user_credentials={real_user=slave}} blocked reactor thread for 135846us
I20260709 13:04:47.465582 19450 leader_election.cc:304] T e381f1d6b8184797ad142de49be225a8 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168; no voters: e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:04:47.445640 20882 raft_consensus.cc:493] T 21e14947d70440f19044d8f75c31e1f9 P 0473d2b2d01f4459b1e90fd12cc7840e [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:04:47.461751 20766 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.923s	user 0.010s	sys 0.032s
I20260709 13:04:47.447860 20807 raft_consensus.cc:493] T 1f85fc4b527a48848e5faa083b604e36 P 0473d2b2d01f4459b1e90fd12cc7840e [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:47.432569 20744 consensus_queue.cc:1059] T fa731b585f684a7fb2d106c50f143b83 P e61c3a8f61bb48f8a963c9480e53c168 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.031s
I20260709 13:04:47.424173 20873 consensus_queue.cc:1059] T 2725d2c4cb054f18b0fc8f735c15f6c2 P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.041s
W20260709 13:04:47.481218 19451 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:04:47.472002 20766 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.936s	user 0.010s	sys 0.034s
I20260709 13:04:47.467581 20734 raft_consensus.cc:3060] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P 127766fc592545a4997f7790f50f6076 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:04:47.509369 20881 raft_consensus.cc:2804] T e381f1d6b8184797ad142de49be225a8 P 0473d2b2d01f4459b1e90fd12cc7840e [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:04:47.512233 20881 raft_consensus.cc:493] T e381f1d6b8184797ad142de49be225a8 P 0473d2b2d01f4459b1e90fd12cc7840e [term 2 FOLLOWER]: Starting leader election (detected failure of leader e5256d91808b47c195bc9b4dbd7f2b87)
I20260709 13:04:47.512665 20881 raft_consensus.cc:3060] T e381f1d6b8184797ad142de49be225a8 P 0473d2b2d01f4459b1e90fd12cc7840e [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:04:47.463768 20888 raft_consensus.cc:515] T 0e1085d23e8347fbbd5bce7542f4b1f4 P e61c3a8f61bb48f8a963c9480e53c168 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:04:47.514179 19449 leader_election.cc:304] T 775c229504194560ba9589bc2199b089 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e; no voters: 127766fc592545a4997f7790f50f6076, e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:04:47.519682 19449 leader_election.cc:304] T 5ec1c4ce15e04c7e8c283a62179f2a64 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e; no voters: 127766fc592545a4997f7790f50f6076, e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:04:47.516113 19450 leader_election.cc:304] T 1efebf73c86e432baa55533136b6e12c P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:04:47.474339 20833 raft_consensus.cc:493] T 2a16f7501e2444fb86d4e2778e734e02 P e5256d91808b47c195bc9b4dbd7f2b87 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:47.462450 20812 raft_consensus.cc:515] T 0e1085d23e8347fbbd5bce7542f4b1f4 P 0473d2b2d01f4459b1e90fd12cc7840e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:04:47.446620 20860 raft_consensus.cc:515] T 9962423cb4e54fcfa5de01daf68a86e7 P 0473d2b2d01f4459b1e90fd12cc7840e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:04:47.473465 20882 raft_consensus.cc:515] T 21e14947d70440f19044d8f75c31e1f9 P 0473d2b2d01f4459b1e90fd12cc7840e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:47.531499 20883 raft_consensus.cc:2804] T 1efebf73c86e432baa55533136b6e12c P 0473d2b2d01f4459b1e90fd12cc7840e [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:04:47.531914 20883 raft_consensus.cc:493] T 1efebf73c86e432baa55533136b6e12c P 0473d2b2d01f4459b1e90fd12cc7840e [term 1 FOLLOWER]: Starting leader election (detected failure of leader e61c3a8f61bb48f8a963c9480e53c168)
I20260709 13:04:47.532267 20883 raft_consensus.cc:3060] T 1efebf73c86e432baa55533136b6e12c P 0473d2b2d01f4459b1e90fd12cc7840e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:47.421690 20866 consensus_queue.cc:237] T b08304a0a02b42d7840c4e8ee9a6bd1a P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:47.468722 20864 consensus_queue.cc:237] T 46c5bfeecc314717bffe987e6844b6d0 P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:47.523774 20808 raft_consensus.cc:2749] T 5ec1c4ce15e04c7e8c283a62179f2a64 P 0473d2b2d01f4459b1e90fd12cc7840e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:04:47.503055 20807 raft_consensus.cc:515] T 1f85fc4b527a48848e5faa083b604e36 P 0473d2b2d01f4459b1e90fd12cc7840e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
W20260709 13:04:47.546043 19376 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:04:47.546804 19523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.1:40321, user_credentials={real_user=slave}} blocked reactor thread for 125335us
I20260709 13:04:47.547617 19523 leader_election.cc:304] T 2b74109013a140ada21feeef92d6f563 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e61c3a8f61bb48f8a963c9480e53c168; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:04:47.551640 19411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa8650e71aa14778b3d73721fc50d9fc" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:04:47.554307 19411 raft_consensus.cc:2393] T fa8650e71aa14778b3d73721fc50d9fc P e5256d91808b47c195bc9b4dbd7f2b87 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e61c3a8f61bb48f8a963c9480e53c168 in current term 2: Already voted for candidate e5256d91808b47c195bc9b4dbd7f2b87 in this term.
I20260709 13:04:47.555181 19411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9962423cb4e54fcfa5de01daf68a86e7" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:04:47.555714 19411 raft_consensus.cc:2468] T 9962423cb4e54fcfa5de01daf68a86e7 P e5256d91808b47c195bc9b4dbd7f2b87 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 2.
W20260709 13:04:47.556113 19523 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:47.556481 19411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1b10566f45d4a7d9029858330e02d5b" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
I20260709 13:04:47.556702 19449 leader_election.cc:304] T 9962423cb4e54fcfa5de01daf68a86e7 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87; no voters: 
I20260709 13:04:47.504117 20855 consensus_queue.cc:1048] T edd7d470b5014c9489be7f41f64355c9 P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.067s
I20260709 13:04:47.559621 20879 raft_consensus.cc:2749] T 2b74109013a140ada21feeef92d6f563 P e61c3a8f61bb48f8a963c9480e53c168 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:04:47.559823 19411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28af091831594f9d8e96482078cc7625" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:04:47.562619 19411 raft_consensus.cc:2468] T 28af091831594f9d8e96482078cc7625 P e5256d91808b47c195bc9b4dbd7f2b87 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 2.
I20260709 13:04:47.541714 20882 leader_election.cc:290] T 21e14947d70440f19044d8f75c31e1f9 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:04:47.563576 19405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e5873a19244c5ebbcd38e126796ee7" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:04:47.544979 20737 raft_consensus.cc:493] T 1efebf73c86e432baa55533136b6e12c P 127766fc592545a4997f7790f50f6076 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:47.533970 20833 raft_consensus.cc:515] T 2a16f7501e2444fb86d4e2778e734e02 P e5256d91808b47c195bc9b4dbd7f2b87 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:04:47.565225 20112 raft_consensus.cc:1240] T fa731b585f684a7fb2d106c50f143b83 P 127766fc592545a4997f7790f50f6076 [term 2 LEADER]: Rejecting Update request from peer e61c3a8f61bb48f8a963c9480e53c168 for earlier term 1. Current term is 2. Ops: []
I20260709 13:04:47.560369 20808 raft_consensus.cc:2804] T 9962423cb4e54fcfa5de01daf68a86e7 P 0473d2b2d01f4459b1e90fd12cc7840e [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:04:47.565385 19406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e381f1d6b8184797ad142de49be225a8" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:04:47.543804 20860 leader_election.cc:290] T 9962423cb4e54fcfa5de01daf68a86e7 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:04:47.565562 19411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14935b3ddf914369822e4a0547aaa355" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:04:47.569344 20812 leader_election.cc:290] T 0e1085d23e8347fbbd5bce7542f4b1f4 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:04:47.569285 19404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7be9efa6559648dbb5a0f7684c4542d1" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:04:47.584872 20888 leader_election.cc:290] T 0e1085d23e8347fbbd5bce7542f4b1f4 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:04:47.540176 20854 consensus_queue.cc:1059] T 21e14947d70440f19044d8f75c31e1f9 P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.027s
I20260709 13:04:47.572645 20807 leader_election.cc:290] T 1f85fc4b527a48848e5faa083b604e36 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:04:47.572773 19410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70797e5783b5454ab0d0eea663e791e3" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:04:47.574386 19403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86a6797bdfe94fa496c050ceae4bd0d9" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:04:47.574916 19405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f93ee515a9c14139bf566522ed8232f3" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:04:47.575755 20855 raft_consensus.cc:493] T 70797e5783b5454ab0d0eea663e791e3 P e5256d91808b47c195bc9b4dbd7f2b87 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:47.579373 20737 raft_consensus.cc:515] T 1efebf73c86e432baa55533136b6e12c P 127766fc592545a4997f7790f50f6076 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:04:47.578986 20808 raft_consensus.cc:493] T 9962423cb4e54fcfa5de01daf68a86e7 P 0473d2b2d01f4459b1e90fd12cc7840e [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:47.580734 19406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "179fd671030940b4b4a4e24bcc4aba0a" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:04:47.568691 20884 raft_consensus.cc:2749] T 775c229504194560ba9589bc2199b089 P 0473d2b2d01f4459b1e90fd12cc7840e [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:04:47.586289 19411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e1f505cb0f1427bbd698ac889d80821" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:04:47.588904 19405 raft_consensus.cc:2468] T f93ee515a9c14139bf566522ed8232f3 P e5256d91808b47c195bc9b4dbd7f2b87 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 2.
I20260709 13:04:47.595319 19405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef32ce6fdd0e40d382c79974f30295c6" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:04:47.596102 19405 raft_consensus.cc:2393] T ef32ce6fdd0e40d382c79974f30295c6 P e5256d91808b47c195bc9b4dbd7f2b87 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e61c3a8f61bb48f8a963c9480e53c168 in current term 2: Already voted for candidate e5256d91808b47c195bc9b4dbd7f2b87 in this term.
I20260709 13:04:47.590536 20728 raft_consensus.cc:3055] T 7f575b143b844aa096b50997dad3516a P e61c3a8f61bb48f8a963c9480e53c168 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:04:47.567698 20882 raft_consensus.cc:493] T ed7fdbcb96d14d418db9ca90a792588a P 0473d2b2d01f4459b1e90fd12cc7840e [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:47.591106 20855 raft_consensus.cc:515] T 70797e5783b5454ab0d0eea663e791e3 P e5256d91808b47c195bc9b4dbd7f2b87 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
W20260709 13:04:47.592749 20838 log.cc:927] Time spent T 0e1085d23e8347fbbd5bce7542f4b1f4 P 127766fc592545a4997f7790f50f6076: Append to log took a long time: real 1.226s	user 0.023s	sys 0.000s
I20260709 13:04:47.592703 19406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9f0d59553ad444883fcf5b5909f9798" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:04:47.593356 20808 raft_consensus.cc:3060] T 9962423cb4e54fcfa5de01daf68a86e7 P 0473d2b2d01f4459b1e90fd12cc7840e [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:04:47.593779 20830 raft_consensus.cc:3060] T ece3db938bc649d4a40a51522ed5259c P e5256d91808b47c195bc9b4dbd7f2b87 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:04:47.596661 19377 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:47.598063 20728 raft_consensus.cc:740] T 7f575b143b844aa096b50997dad3516a P e61c3a8f61bb48f8a963c9480e53c168 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e61c3a8f61bb48f8a963c9480e53c168, State: Running, Role: LEADER
I20260709 13:04:47.599457 19405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21e14947d70440f19044d8f75c31e1f9" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:04:47.600385 19411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4509b76741dc428e9201c70c1658da13" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:04:47.601013 20833 leader_election.cc:290] T 2a16f7501e2444fb86d4e2778e734e02 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:04:47.601189 19479 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58286 (request call id 1072) took 1297 ms. Trace:
I20260709 13:04:47.614195 19479 rpcz_store.cc:276] 0709 13:04:46.303413 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:46.303528 (+   115us) service_pool.cc:224] Handling call
0709 13:04:46.334089 (+ 30561us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:04:46.831007 (+496918us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:47.600961 (+769954us) spinlock_profiling.cc:243] Waited 496 ms on lock 0x7b5400148554. stack: 00007f4a79de9343 00007f4a79de9240 00007f4a797781d4 00007f4a834b6304 00007f4a834b6299 00007f4a7ce71571 00007f4a7cf08e01 00007f4a7cf0783e 00007f4a81ecc419 00007f4a7b443bd4 00007f4a7b443b62 00007f4a7b443a91 00007f4a7b443a0c 00007f4a7b442cc2 00007f4a7b24348c 00007f4a7b2428c6
0709 13:04:47.601136 (+   175us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1141611776}
I20260709 13:04:47.596453 20737 leader_election.cc:290] T 1efebf73c86e432baa55533136b6e12c P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:04:47.615581 19411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ece3db938bc649d4a40a51522ed5259c" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:04:47.612885 19410 raft_consensus.cc:2468] T 70797e5783b5454ab0d0eea663e791e3 P e5256d91808b47c195bc9b4dbd7f2b87 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 2.
I20260709 13:04:47.611126 20855 leader_election.cc:290] T 70797e5783b5454ab0d0eea663e791e3 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:04:47.618736 20728 consensus_queue.cc:260] T 7f575b143b844aa096b50997dad3516a P e61c3a8f61bb48f8a963c9480e53c168 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:47.619743 20728 raft_consensus.cc:3060] T 7f575b143b844aa096b50997dad3516a P e61c3a8f61bb48f8a963c9480e53c168 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:47.620734 20647 tablet_bootstrap.cc:492] T ab43d85f64114d4ebf618930e43d9ed0 P 127766fc592545a4997f7790f50f6076: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:04:47.621663 20647 tablet_bootstrap.cc:492] T ab43d85f64114d4ebf618930e43d9ed0 P 127766fc592545a4997f7790f50f6076: Bootstrap complete.
I20260709 13:04:47.622371 20647 ts_tablet_manager.cc:1403] T ab43d85f64114d4ebf618930e43d9ed0 P 127766fc592545a4997f7790f50f6076: Time spent bootstrapping tablet: real 1.218s	user 0.044s	sys 0.048s
I20260709 13:04:47.625291 19406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76cb037fc9064d13b59a8969d897ce8c" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:04:47.625927 19406 raft_consensus.cc:2468] T 76cb037fc9064d13b59a8969d897ce8c P e5256d91808b47c195bc9b4dbd7f2b87 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 2.
I20260709 13:04:47.613088 20884 raft_consensus.cc:493] T 48824d5acfbc485ebf8c2d944e7202de P 0473d2b2d01f4459b1e90fd12cc7840e [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 127766fc592545a4997f7790f50f6076)
W20260709 13:04:47.634356 19526 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:04:47.635057 19526 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:47.640671 19406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a61655d99124a29b486ba4a5b37faea" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:04:47.641921 19480 raft_consensus.cc:2468] T b08304a0a02b42d7840c4e8ee9a6bd1a P 0473d2b2d01f4459b1e90fd12cc7840e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 2.
I20260709 13:04:47.642220 19406 raft_consensus.cc:1240] T fa8650e71aa14778b3d73721fc50d9fc P e5256d91808b47c195bc9b4dbd7f2b87 [term 2 FOLLOWER]: Rejecting Update request from peer 0473d2b2d01f4459b1e90fd12cc7840e for earlier term 1. Current term is 2. Ops: []
I20260709 13:04:47.642755 20732 raft_consensus.cc:493] T 833a2f0775ed407a94b8924ce50adb63 P e61c3a8f61bb48f8a963c9480e53c168 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:47.642903 19405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f85fc4b527a48848e5faa083b604e36" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:04:47.643260 20732 raft_consensus.cc:515] T 833a2f0775ed407a94b8924ce50adb63 P e61c3a8f61bb48f8a963c9480e53c168 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:04:47.609488 20882 raft_consensus.cc:515] T ed7fdbcb96d14d418db9ca90a792588a P 0473d2b2d01f4459b1e90fd12cc7840e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:04:47.644227 19405 raft_consensus.cc:1240] T 2e36a9d6e29c4a7c860cf267efbd4c74 P e5256d91808b47c195bc9b4dbd7f2b87 [term 2 FOLLOWER]: Rejecting Update request from peer e61c3a8f61bb48f8a963c9480e53c168 for earlier term 1. Current term is 2. Ops: []
I20260709 13:04:47.645464 19406 raft_consensus.cc:1240] T 40e1e16737a842ee936002830f36882e P e5256d91808b47c195bc9b4dbd7f2b87 [term 3 FOLLOWER]: Rejecting Update request from peer e61c3a8f61bb48f8a963c9480e53c168 for earlier term 2. Current term is 3. Ops: []
I20260709 13:04:47.646148 20732 leader_election.cc:290] T 833a2f0775ed407a94b8924ce50adb63 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:04:47.649114 20881 raft_consensus.cc:515] T e381f1d6b8184797ad142de49be225a8 P 0473d2b2d01f4459b1e90fd12cc7840e [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:47.654318 19406 raft_consensus.cc:1240] T 0cdf56e38bbc453d9438d359e5a69955 P e5256d91808b47c195bc9b4dbd7f2b87 [term 3 FOLLOWER]: Rejecting Update request from peer e61c3a8f61bb48f8a963c9480e53c168 for earlier term 2. Current term is 3. Ops: []
I20260709 13:04:47.655225 19405 raft_consensus.cc:1240] T 22196caba61445d3bec98a0aab3c337d P e5256d91808b47c195bc9b4dbd7f2b87 [term 2 FOLLOWER]: Rejecting Update request from peer e61c3a8f61bb48f8a963c9480e53c168 for earlier term 1. Current term is 2. Ops: []
I20260709 13:04:47.659031 19449 leader_election.cc:304] T 22196caba61445d3bec98a0aab3c337d P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e; no voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:04:47.659464 20112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a16f7501e2444fb86d4e2778e734e02" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:04:47.660254 20112 raft_consensus.cc:2468] T 2a16f7501e2444fb86d4e2778e734e02 P 127766fc592545a4997f7790f50f6076 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 3.
I20260709 13:04:47.662997 19406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e381f1d6b8184797ad142de49be225a8" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
I20260709 13:04:47.664402 20882 leader_election.cc:290] T ed7fdbcb96d14d418db9ca90a792588a P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:04:47.668053 19483 raft_consensus.cc:1240] T ed7fdbcb96d14d418db9ca90a792588a P 0473d2b2d01f4459b1e90fd12cc7840e [term 2 FOLLOWER]: Rejecting Update request from peer e61c3a8f61bb48f8a963c9480e53c168 for earlier term 1. Current term is 2. Ops: []
I20260709 13:04:47.650429 20884 raft_consensus.cc:515] T 48824d5acfbc485ebf8c2d944e7202de P 0473d2b2d01f4459b1e90fd12cc7840e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:04:47.670336 20803 raft_consensus.cc:3055] T ff75a1d4cb1f493db8f71ddc136ba9ab P 0473d2b2d01f4459b1e90fd12cc7840e [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:04:47.670629 19406 raft_consensus.cc:1275] T 9962423cb4e54fcfa5de01daf68a86e7 P e5256d91808b47c195bc9b4dbd7f2b87 [term 2 FOLLOWER]: Refusing update from remote peer 127766fc592545a4997f7790f50f6076: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:04:47.670749 20803 raft_consensus.cc:740] T ff75a1d4cb1f493db8f71ddc136ba9ab P 0473d2b2d01f4459b1e90fd12cc7840e [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0473d2b2d01f4459b1e90fd12cc7840e, State: Running, Role: LEADER
I20260709 13:04:47.673015 20112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70797e5783b5454ab0d0eea663e791e3" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:04:47.673774 20112 raft_consensus.cc:2468] T 70797e5783b5454ab0d0eea663e791e3 P 127766fc592545a4997f7790f50f6076 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 2.
W20260709 13:04:47.661185 20076 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:47.643348 20883 raft_consensus.cc:515] T 1efebf73c86e432baa55533136b6e12c P 0473d2b2d01f4459b1e90fd12cc7840e [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:04:47.668877 20860 raft_consensus.cc:2749] T 22196caba61445d3bec98a0aab3c337d P 0473d2b2d01f4459b1e90fd12cc7840e [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:04:47.690748 19484 raft_consensus.cc:1240] T 7f575b143b844aa096b50997dad3516a P 0473d2b2d01f4459b1e90fd12cc7840e [term 2 FOLLOWER]: Rejecting Update request from peer e61c3a8f61bb48f8a963c9480e53c168 for earlier term 1. Current term is 2. Ops: []
I20260709 13:04:47.693351 19479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e1085d23e8347fbbd5bce7542f4b1f4" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:04:47.694252 19479 raft_consensus.cc:2468] T 0e1085d23e8347fbbd5bce7542f4b1f4 P 0473d2b2d01f4459b1e90fd12cc7840e [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 2.
I20260709 13:04:47.675174 20885 raft_consensus.cc:3055] T 2725d2c4cb054f18b0fc8f735c15f6c2 P e61c3a8f61bb48f8a963c9480e53c168 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:04:47.675629 20881 leader_election.cc:290] T e381f1d6b8184797ad142de49be225a8 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 3 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:04:47.686836 19374 leader_election.cc:304] T 2a16f7501e2444fb86d4e2778e734e02 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 127766fc592545a4997f7790f50f6076, e5256d91808b47c195bc9b4dbd7f2b87; no voters: 
I20260709 13:04:47.667820 20807 consensus_queue.cc:1059] T fa8650e71aa14778b3d73721fc50d9fc P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.024s
I20260709 13:04:47.696807 20867 raft_consensus.cc:493] T 65d8cb8d6ec64f459d5a47cefab10acf P e5256d91808b47c195bc9b4dbd7f2b87 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e61c3a8f61bb48f8a963c9480e53c168)
I20260709 13:04:47.699359 20882 raft_consensus.cc:3055] T fa8650e71aa14778b3d73721fc50d9fc P 0473d2b2d01f4459b1e90fd12cc7840e [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:04:47.699879 20882 raft_consensus.cc:740] T fa8650e71aa14778b3d73721fc50d9fc P 0473d2b2d01f4459b1e90fd12cc7840e [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0473d2b2d01f4459b1e90fd12cc7840e, State: Running, Role: LEADER
I20260709 13:04:47.702544 20735 raft_consensus.cc:3055] T 22196caba61445d3bec98a0aab3c337d P e61c3a8f61bb48f8a963c9480e53c168 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:04:47.703190 19482 raft_consensus.cc:1240] T df751f992649444090e27965eb1af85d P 0473d2b2d01f4459b1e90fd12cc7840e [term 2 FOLLOWER]: Rejecting Update request from peer e61c3a8f61bb48f8a963c9480e53c168 for earlier term 1. Current term is 2. Ops: [1.2-1.2]
I20260709 13:04:47.702957 20882 consensus_queue.cc:260] T fa8650e71aa14778b3d73721fc50d9fc P 0473d2b2d01f4459b1e90fd12cc7840e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:47.703436 19409 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52342 (request call id 1418) took 1402 ms. Trace:
I20260709 13:04:47.703929 20882 raft_consensus.cc:3060] T fa8650e71aa14778b3d73721fc50d9fc P 0473d2b2d01f4459b1e90fd12cc7840e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:47.679509 20075 leader_election.cc:304] T ff9b0eddd810459b82d91c60777c10eb P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 127766fc592545a4997f7790f50f6076, e5256d91808b47c195bc9b4dbd7f2b87; no voters: 
I20260709 13:04:47.704447 20885 raft_consensus.cc:740] T 2725d2c4cb054f18b0fc8f735c15f6c2 P e61c3a8f61bb48f8a963c9480e53c168 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e61c3a8f61bb48f8a963c9480e53c168, State: Running, Role: LEADER
I20260709 13:04:47.703824 19409 rpcz_store.cc:276] 0709 13:04:46.300826 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:46.300972 (+   146us) service_pool.cc:224] Handling call
0709 13:04:46.301309 (+   337us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:04:46.967260 (+665951us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:47.703210 (+735950us) spinlock_profiling.cc:243] Waited 664 ms on lock 0x7b5400249d54. stack: 00007f4a79de9343 00007f4a79de9240 00007f4a797781d4 00007f4a834b6304 00007f4a834b6299 00007f4a7ce71571 00007f4a7cf08e01 00007f4a7cf0783e 00007f4a81ecc419 00007f4a7b443bd4 00007f4a7b443b62 00007f4a7b443a91 00007f4a7b443a0c 00007f4a7b442cc2 00007f4a7b24348c 00007f4a7b2428c6
0709 13:04:47.703376 (+   166us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1527301504}
I20260709 13:04:47.715222 19551 raft_consensus.cc:1275] T 7f575b143b844aa096b50997dad3516a P e61c3a8f61bb48f8a963c9480e53c168 [term 2 FOLLOWER]: Refusing update from remote peer e5256d91808b47c195bc9b4dbd7f2b87: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 13:04:47.715444 19377 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:47.701222 20855 raft_consensus.cc:2804] T 2a16f7501e2444fb86d4e2778e734e02 P e5256d91808b47c195bc9b4dbd7f2b87 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:04:47.676290 20803 consensus_queue.cc:260] T ff75a1d4cb1f493db8f71ddc136ba9ab P 0473d2b2d01f4459b1e90fd12cc7840e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:47.702991 20735 raft_consensus.cc:740] T 22196caba61445d3bec98a0aab3c337d P e61c3a8f61bb48f8a963c9480e53c168 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e61c3a8f61bb48f8a963c9480e53c168, State: Running, Role: LEADER
I20260709 13:04:47.720512 19526 leader_election.cc:304] T 62c6c134d3d24a1ab144dd9ee6bc3f64 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168; no voters: 127766fc592545a4997f7790f50f6076
I20260709 13:04:47.723484 20112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1efebf73c86e432baa55533136b6e12c" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:04:47.724215 20112 raft_consensus.cc:2393] T 1efebf73c86e432baa55533136b6e12c P 127766fc592545a4997f7790f50f6076 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0473d2b2d01f4459b1e90fd12cc7840e in current term 2: Already voted for candidate 127766fc592545a4997f7790f50f6076 in this term.
I20260709 13:04:47.724560 20106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f85fc4b527a48848e5faa083b604e36" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:04:47.725461 20110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed7fdbcb96d14d418db9ca90a792588a" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:04:47.725781 20876 consensus_queue.cc:1059] T 40e1e16737a842ee936002830f36882e P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:04:47.726768 20112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48824d5acfbc485ebf8c2d944e7202de" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:04:47.726866 20864 raft_consensus.cc:3055] T 40e1e16737a842ee936002830f36882e P e61c3a8f61bb48f8a963c9480e53c168 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:04:47.724237 20107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e1085d23e8347fbbd5bce7542f4b1f4" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:04:47.727396 20864 raft_consensus.cc:740] T 40e1e16737a842ee936002830f36882e P e61c3a8f61bb48f8a963c9480e53c168 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: e61c3a8f61bb48f8a963c9480e53c168, State: Running, Role: LEADER
I20260709 13:04:47.715850 20884 leader_election.cc:290] T 48824d5acfbc485ebf8c2d944e7202de P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:04:47.716390 20785 raft_consensus.cc:2804] T ff9b0eddd810459b82d91c60777c10eb P 127766fc592545a4997f7790f50f6076 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:04:47.730188 19449 leader_election.cc:304] T 1f85fc4b527a48848e5faa083b604e36 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e; no voters: 127766fc592545a4997f7790f50f6076, e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:04:47.731583 19526 leader_election.cc:304] T 0e1085d23e8347fbbd5bce7542f4b1f4 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:04:47.700497 19374 leader_election.cc:304] T 70797e5783b5454ab0d0eea663e791e3 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 127766fc592545a4997f7790f50f6076, e5256d91808b47c195bc9b4dbd7f2b87; no voters: 
I20260709 13:04:47.715906 20737 consensus_queue.cc:1048] T 9962423cb4e54fcfa5de01daf68a86e7 P 127766fc592545a4997f7790f50f6076 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.013s
I20260709 13:04:47.729899 20728 raft_consensus.cc:2804] T 62c6c134d3d24a1ab144dd9ee6bc3f64 P e61c3a8f61bb48f8a963c9480e53c168 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:04:47.719920 20732 raft_consensus.cc:493] T 96efeaaf1057492490e9a621f37e1a2d P e61c3a8f61bb48f8a963c9480e53c168 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 127766fc592545a4997f7790f50f6076)
I20260709 13:04:47.720294 20855 raft_consensus.cc:493] T 2a16f7501e2444fb86d4e2778e734e02 P e5256d91808b47c195bc9b4dbd7f2b87 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:47.699162 20867 raft_consensus.cc:515] T 65d8cb8d6ec64f459d5a47cefab10acf P e5256d91808b47c195bc9b4dbd7f2b87 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:04:47.722334 20869 raft_consensus.cc:3060] T 86a6797bdfe94fa496c050ceae4bd0d9 P e5256d91808b47c195bc9b4dbd7f2b87 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:47.748862 19411 raft_consensus.cc:2468] T ece3db938bc649d4a40a51522ed5259c P e5256d91808b47c195bc9b4dbd7f2b87 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 2.
W20260709 13:04:47.721895 19450 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.3:36891, user_credentials={real_user=slave}} blocked reactor thread for 206694us
I20260709 13:04:47.721372 20881 consensus_queue.cc:1059] T 1dc5b3532fe54f74876d02beffa2c230 P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.026s
I20260709 13:04:47.728307 20808 raft_consensus.cc:515] T 9962423cb4e54fcfa5de01daf68a86e7 P 0473d2b2d01f4459b1e90fd12cc7840e [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:04:47.742441 20833 raft_consensus.cc:2804] T 70797e5783b5454ab0d0eea663e791e3 P e5256d91808b47c195bc9b4dbd7f2b87 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:04:47.745476 20884 raft_consensus.cc:2749] T 1f85fc4b527a48848e5faa083b604e36 P 0473d2b2d01f4459b1e90fd12cc7840e [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:04:47.743837 20873 raft_consensus.cc:2804] T 0e1085d23e8347fbbd5bce7542f4b1f4 P e61c3a8f61bb48f8a963c9480e53c168 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:04:47.752431 20803 raft_consensus.cc:3060] T ff75a1d4cb1f493db8f71ddc136ba9ab P 0473d2b2d01f4459b1e90fd12cc7840e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:47.794407 20833 raft_consensus.cc:493] T 70797e5783b5454ab0d0eea663e791e3 P e5256d91808b47c195bc9b4dbd7f2b87 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:47.728233 20864 consensus_queue.cc:260] T 40e1e16737a842ee936002830f36882e P e61c3a8f61bb48f8a963c9480e53c168 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:47.752084 20817 raft_consensus.cc:493] T 833a2f0775ed407a94b8924ce50adb63 P 127766fc592545a4997f7790f50f6076 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e61c3a8f61bb48f8a963c9480e53c168)
I20260709 13:04:47.803716 20867 leader_election.cc:290] T 65d8cb8d6ec64f459d5a47cefab10acf P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:04:47.804385 20817 raft_consensus.cc:515] T 833a2f0775ed407a94b8924ce50adb63 P 127766fc592545a4997f7790f50f6076 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:04:47.801061 20833 raft_consensus.cc:3060] T 70797e5783b5454ab0d0eea663e791e3 P e5256d91808b47c195bc9b4dbd7f2b87 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:04:47.810426 19525 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:47.756172 20732 raft_consensus.cc:515] T 96efeaaf1057492490e9a621f37e1a2d P e61c3a8f61bb48f8a963c9480e53c168 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:04:47.757112 20104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9962423cb4e54fcfa5de01daf68a86e7" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:04:47.794970 20776 raft_consensus.cc:3055] T 309c3ca0ca4b4f3ba129752ea2cb293b P e5256d91808b47c195bc9b4dbd7f2b87 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:04:47.754161 20855 raft_consensus.cc:3060] T 2a16f7501e2444fb86d4e2778e734e02 P e5256d91808b47c195bc9b4dbd7f2b87 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:04:47.797659 20873 raft_consensus.cc:493] T 0e1085d23e8347fbbd5bce7542f4b1f4 P e61c3a8f61bb48f8a963c9480e53c168 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:47.824666 19485 raft_consensus.cc:1240] T e381f1d6b8184797ad142de49be225a8 P 0473d2b2d01f4459b1e90fd12cc7840e [term 3 FOLLOWER]: Rejecting Update request from peer e5256d91808b47c195bc9b4dbd7f2b87 for earlier term 2. Current term is 3. Ops: []
I20260709 13:04:47.826123 20873 raft_consensus.cc:3060] T 0e1085d23e8347fbbd5bce7542f4b1f4 P e61c3a8f61bb48f8a963c9480e53c168 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:04:47.827447 19482 raft_consensus.cc:1275] T df751f992649444090e27965eb1af85d P 0473d2b2d01f4459b1e90fd12cc7840e [term 2 FOLLOWER]: Refusing update from remote peer e5256d91808b47c195bc9b4dbd7f2b87: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:47.833289 20112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1efebf73c86e432baa55533136b6e12c" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076"
I20260709 13:04:47.817189 20864 raft_consensus.cc:3060] T 40e1e16737a842ee936002830f36882e P e61c3a8f61bb48f8a963c9480e53c168 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:04:47.836434 19478 raft_consensus.cc:1240] T 309c3ca0ca4b4f3ba129752ea2cb293b P 0473d2b2d01f4459b1e90fd12cc7840e [term 3 FOLLOWER]: Rejecting Update request from peer e5256d91808b47c195bc9b4dbd7f2b87 for earlier term 2. Current term is 3. Ops: []
I20260709 13:04:47.816605 20807 raft_consensus.cc:493] T 46c5bfeecc314717bffe987e6844b6d0 P 0473d2b2d01f4459b1e90fd12cc7840e [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:47.819105 20776 raft_consensus.cc:740] T 309c3ca0ca4b4f3ba129752ea2cb293b P e5256d91808b47c195bc9b4dbd7f2b87 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: e5256d91808b47c195bc9b4dbd7f2b87, State: Running, Role: LEADER
I20260709 13:04:47.813772 20817 leader_election.cc:290] T 833a2f0775ed407a94b8924ce50adb63 P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:04:47.834091 20112 raft_consensus.cc:2393] T 1efebf73c86e432baa55533136b6e12c P 127766fc592545a4997f7790f50f6076 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 0473d2b2d01f4459b1e90fd12cc7840e in current term 2: Already voted for candidate 127766fc592545a4997f7790f50f6076 in this term.
I20260709 13:04:47.747360 20863 consensus_queue.cc:1059] T df751f992649444090e27965eb1af85d P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } attrs { replace: true }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.051s
I20260709 13:04:47.839457 20807 raft_consensus.cc:515] T 46c5bfeecc314717bffe987e6844b6d0 P 0473d2b2d01f4459b1e90fd12cc7840e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:47.845507 20839 raft_consensus.cc:493] T a08760e15aac4630a629431f56024dc8 P 0473d2b2d01f4459b1e90fd12cc7840e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e61c3a8f61bb48f8a963c9480e53c168)
I20260709 13:04:47.850620 19482 raft_consensus.cc:1275] T f1b10566f45d4a7d9029858330e02d5b P 0473d2b2d01f4459b1e90fd12cc7840e [term 3 FOLLOWER]: Refusing update from remote peer e5256d91808b47c195bc9b4dbd7f2b87: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:04:47.855223 19482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff9b0eddd810459b82d91c60777c10eb" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:04:47.796568 20735 consensus_queue.cc:260] T 22196caba61445d3bec98a0aab3c337d P e61c3a8f61bb48f8a963c9480e53c168 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:47.855779 19482 raft_consensus.cc:3060] T ff9b0eddd810459b82d91c60777c10eb P 0473d2b2d01f4459b1e90fd12cc7840e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:47.834410 20883 leader_election.cc:290] T 1efebf73c86e432baa55533136b6e12c P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 2 election: Requested vote from peers e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:04:47.840206 20107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65d8cb8d6ec64f459d5a47cefab10acf" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:04:47.877187 19478 raft_consensus.cc:1275] T 0e1085d23e8347fbbd5bce7542f4b1f4 P 0473d2b2d01f4459b1e90fd12cc7840e [term 2 FOLLOWER]: Refusing update from remote peer 127766fc592545a4997f7790f50f6076: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:04:47.878911 20762 raft_consensus.cc:3060] T fa731b585f684a7fb2d106c50f143b83 P e61c3a8f61bb48f8a963c9480e53c168 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:47.850875 20752 raft_consensus.cc:493] T 14efcc79969f41babe5529c22d59156d P 0473d2b2d01f4459b1e90fd12cc7840e [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 127766fc592545a4997f7790f50f6076)
I20260709 13:04:47.868640 20785 raft_consensus.cc:697] T ff9b0eddd810459b82d91c60777c10eb P 127766fc592545a4997f7790f50f6076 [term 2 LEADER]: Becoming Leader. State: Replica: 127766fc592545a4997f7790f50f6076, State: Running, Role: LEADER
I20260709 13:04:47.873282 20776 consensus_queue.cc:260] T 309c3ca0ca4b4f3ba129752ea2cb293b P e5256d91808b47c195bc9b4dbd7f2b87 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } attrs { replace: true } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: NON_VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: true } }
I20260709 13:04:47.876143 20817 raft_consensus.cc:493] T ece3db938bc649d4a40a51522ed5259c P 127766fc592545a4997f7790f50f6076 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:47.874091 20892 raft_consensus.cc:493] T 96efeaaf1057492490e9a621f37e1a2d P 0473d2b2d01f4459b1e90fd12cc7840e [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 127766fc592545a4997f7790f50f6076)
I20260709 13:04:47.908500 20843 raft_consensus.cc:3060] T bc225c93219c45538b53a1bd3d387e4d P e5256d91808b47c195bc9b4dbd7f2b87 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:47.872057 20839 raft_consensus.cc:515] T a08760e15aac4630a629431f56024dc8 P 0473d2b2d01f4459b1e90fd12cc7840e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:47.899885 20735 raft_consensus.cc:3060] T 22196caba61445d3bec98a0aab3c337d P e61c3a8f61bb48f8a963c9480e53c168 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:47.914393 19478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1efebf73c86e432baa55533136b6e12c" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:04:47.917680 19478 raft_consensus.cc:2468] T 1efebf73c86e432baa55533136b6e12c P 0473d2b2d01f4459b1e90fd12cc7840e [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 127766fc592545a4997f7790f50f6076 in term 2.
I20260709 13:04:47.881410 20830 consensus_queue.cc:1048] T df751f992649444090e27965eb1af85d P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.029s
I20260709 13:04:47.881597 20866 consensus_queue.cc:1059] T e381f1d6b8184797ad142de49be225a8 P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.029s
I20260709 13:04:47.904978 20734 consensus_queue.cc:1048] T 0e1085d23e8347fbbd5bce7542f4b1f4 P 127766fc592545a4997f7790f50f6076 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.011s
I20260709 13:04:47.918358 19482 raft_consensus.cc:2468] T ff9b0eddd810459b82d91c60777c10eb P 0473d2b2d01f4459b1e90fd12cc7840e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 127766fc592545a4997f7790f50f6076 in term 2.
I20260709 13:04:47.848486 20887 consensus_queue.cc:1059] T 2e36a9d6e29c4a7c860cf267efbd4c74 P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.171s
I20260709 13:04:47.897770 20825 consensus_queue.cc:1048] T f1b10566f45d4a7d9029858330e02d5b P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.021s
I20260709 13:04:47.896624 20752 raft_consensus.cc:515] T 14efcc79969f41babe5529c22d59156d P 0473d2b2d01f4459b1e90fd12cc7840e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:04:47.928745 20078 leader_election.cc:304] T 1efebf73c86e432baa55533136b6e12c P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, 127766fc592545a4997f7790f50f6076; no voters: 
I20260709 13:04:47.934496 20891 raft_consensus.cc:2804] T 1efebf73c86e432baa55533136b6e12c P 127766fc592545a4997f7790f50f6076 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:04:47.934921 20891 raft_consensus.cc:493] T 1efebf73c86e432baa55533136b6e12c P 127766fc592545a4997f7790f50f6076 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:47.935237 20891 raft_consensus.cc:3060] T 1efebf73c86e432baa55533136b6e12c P 127766fc592545a4997f7790f50f6076 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:04:47.910951 20817 raft_consensus.cc:515] T ece3db938bc649d4a40a51522ed5259c P 127766fc592545a4997f7790f50f6076 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:04:47.905521 20844 consensus_queue.cc:1059] T 309c3ca0ca4b4f3ba129752ea2cb293b P e5256d91808b47c195bc9b4dbd7f2b87 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 }, Status: INVALID_TERM, Last received: 2.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.025s
W20260709 13:04:47.942878 19524 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:47.945732 19556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed7fdbcb96d14d418db9ca90a792588a" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:04:47.949785 19560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1efebf73c86e432baa55533136b6e12c" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:04:47.953641 19557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edd7d470b5014c9489be7f41f64355c9" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:04:47.954007 19558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e381f1d6b8184797ad142de49be225a8" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:04:47.954491 19557 raft_consensus.cc:2468] T edd7d470b5014c9489be7f41f64355c9 P e61c3a8f61bb48f8a963c9480e53c168 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 2.
I20260709 13:04:47.954734 19558 raft_consensus.cc:3060] T e381f1d6b8184797ad142de49be225a8 P e61c3a8f61bb48f8a963c9480e53c168 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:04:47.917532 20892 raft_consensus.cc:515] T 96efeaaf1057492490e9a621f37e1a2d P 0473d2b2d01f4459b1e90fd12cc7840e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:04:47.946309 19556 raft_consensus.cc:2468] T ed7fdbcb96d14d418db9ca90a792588a P e61c3a8f61bb48f8a963c9480e53c168 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 2.
I20260709 13:04:47.962092 19559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21e14947d70440f19044d8f75c31e1f9" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:04:47.969287 19478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96efeaaf1057492490e9a621f37e1a2d" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:04:47.947433 20877 raft_consensus.cc:493] T 4af19371ea874c09a0a2147040835cbb P e61c3a8f61bb48f8a963c9480e53c168 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 127766fc592545a4997f7790f50f6076)
I20260709 13:04:47.950569 19477 raft_consensus.cc:1240] T 9962423cb4e54fcfa5de01daf68a86e7 P 0473d2b2d01f4459b1e90fd12cc7840e [term 3 FOLLOWER]: Rejecting Update request from peer 127766fc592545a4997f7790f50f6076 for earlier term 2. Current term is 3. Ops: []
I20260709 13:04:47.979591 20860 raft_consensus.cc:3055] T 1dc5b3532fe54f74876d02beffa2c230 P 0473d2b2d01f4459b1e90fd12cc7840e [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:04:47.980039 20860 raft_consensus.cc:740] T 1dc5b3532fe54f74876d02beffa2c230 P 0473d2b2d01f4459b1e90fd12cc7840e [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0473d2b2d01f4459b1e90fd12cc7840e, State: Running, Role: LEADER
I20260709 13:04:47.938074 20647 raft_consensus.cc:359] T ab43d85f64114d4ebf618930e43d9ed0 P 127766fc592545a4997f7790f50f6076 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } attrs { replace: true } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: NON_VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: true } }
I20260709 13:04:47.983664 19450 leader_election.cc:304] T edd7d470b5014c9489be7f41f64355c9 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168; no voters: e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:04:47.983989 19478 raft_consensus.cc:2468] T 96efeaaf1057492490e9a621f37e1a2d P 0473d2b2d01f4459b1e90fd12cc7840e [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 2.
I20260709 13:04:47.980835 20860 consensus_queue.cc:260] T 1dc5b3532fe54f74876d02beffa2c230 P 0473d2b2d01f4459b1e90fd12cc7840e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:47.972177 20732 leader_election.cc:290] T 96efeaaf1057492490e9a621f37e1a2d P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:04:47.965196 20728 raft_consensus.cc:697] T 62c6c134d3d24a1ab144dd9ee6bc3f64 P e61c3a8f61bb48f8a963c9480e53c168 [term 2 LEADER]: Becoming Leader. State: Replica: e61c3a8f61bb48f8a963c9480e53c168, State: Running, Role: LEADER
I20260709 13:04:47.992498 20839 leader_election.cc:290] T a08760e15aac4630a629431f56024dc8 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:04:47.992849 19557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48824d5acfbc485ebf8c2d944e7202de" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:04:47.993129 20839 raft_consensus.cc:2804] T edd7d470b5014c9489be7f41f64355c9 P 0473d2b2d01f4459b1e90fd12cc7840e [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:04:47.993523 20839 raft_consensus.cc:493] T edd7d470b5014c9489be7f41f64355c9 P 0473d2b2d01f4459b1e90fd12cc7840e [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:47.993839 20839 raft_consensus.cc:3060] T edd7d470b5014c9489be7f41f64355c9 P 0473d2b2d01f4459b1e90fd12cc7840e [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:04:47.966447 19553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e1085d23e8347fbbd5bce7542f4b1f4" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:04:47.992489 19560 raft_consensus.cc:2468] T 1efebf73c86e432baa55533136b6e12c P e61c3a8f61bb48f8a963c9480e53c168 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 2.
I20260709 13:04:48.001200 20833 raft_consensus.cc:515] T 70797e5783b5454ab0d0eea663e791e3 P e5256d91808b47c195bc9b4dbd7f2b87 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:04:48.003036 19479 raft_consensus.cc:1240] T e381f1d6b8184797ad142de49be225a8 P 0473d2b2d01f4459b1e90fd12cc7840e [term 3 FOLLOWER]: Rejecting Update request from peer e5256d91808b47c195bc9b4dbd7f2b87 for earlier term 2. Current term is 3. Ops: []
I20260709 13:04:48.004510 20107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70797e5783b5454ab0d0eea663e791e3" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076"
I20260709 13:04:48.005378 20107 raft_consensus.cc:3060] T 70797e5783b5454ab0d0eea663e791e3 P 127766fc592545a4997f7790f50f6076 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:04:47.989629 20734 consensus_queue.cc:1059] T 9962423cb4e54fcfa5de01daf68a86e7 P 127766fc592545a4997f7790f50f6076 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.021s
I20260709 13:04:48.010123 19570 tablet_copy_service.cc:140] P e61c3a8f61bb48f8a963c9480e53c168: Received BeginTabletCopySession request for tablet df751f992649444090e27965eb1af85d from peer 127766fc592545a4997f7790f50f6076 ({username='slave'} at 127.0.0.1:41504)
I20260709 13:04:48.010839 19570 tablet_copy_service.cc:161] P e61c3a8f61bb48f8a963c9480e53c168: Beginning new tablet copy session on tablet df751f992649444090e27965eb1af85d from peer 127766fc592545a4997f7790f50f6076 at {username='slave'} at 127.0.0.1:41504: session id = 127766fc592545a4997f7790f50f6076-df751f992649444090e27965eb1af85d
I20260709 13:04:48.012372 20810 raft_consensus.cc:493] T 6c5eebf646ad445a9d1b1adc319d7b16 P 0473d2b2d01f4459b1e90fd12cc7840e [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 127766fc592545a4997f7790f50f6076)
I20260709 13:04:48.012869 20810 raft_consensus.cc:515] T 6c5eebf646ad445a9d1b1adc319d7b16 P 0473d2b2d01f4459b1e90fd12cc7840e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:04:48.014134 20752 leader_election.cc:290] T 14efcc79969f41babe5529c22d59156d P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:04:48.008864 20807 leader_election.cc:290] T 46c5bfeecc314717bffe987e6844b6d0 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:04:47.984643 20647 raft_consensus.cc:740] T ab43d85f64114d4ebf618930e43d9ed0 P 127766fc592545a4997f7790f50f6076 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 127766fc592545a4997f7790f50f6076, State: Initialized, Role: LEARNER
I20260709 13:04:47.946388 20785 consensus_queue.cc:237] T ff9b0eddd810459b82d91c60777c10eb P 127766fc592545a4997f7790f50f6076 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:04:48.025187 19558 raft_consensus.cc:2468] T e381f1d6b8184797ad142de49be225a8 P e61c3a8f61bb48f8a963c9480e53c168 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 3.
I20260709 13:04:48.028179 19558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1efebf73c86e432baa55533136b6e12c" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:04:48.029155 19558 raft_consensus.cc:2468] T 1efebf73c86e432baa55533136b6e12c P e61c3a8f61bb48f8a963c9480e53c168 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 127766fc592545a4997f7790f50f6076 in term 2.
I20260709 13:04:48.028203 20833 leader_election.cc:290] T 70797e5783b5454ab0d0eea663e791e3 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 3 election: Requested vote from peers e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:04:48.031524 19477 raft_consensus.cc:1240] T 21e14947d70440f19044d8f75c31e1f9 P 0473d2b2d01f4459b1e90fd12cc7840e [term 2 FOLLOWER]: Rejecting Update request from peer e61c3a8f61bb48f8a963c9480e53c168 for earlier term 1. Current term is 2. Ops: []
I20260709 13:04:47.996430 20877 raft_consensus.cc:515] T 4af19371ea874c09a0a2147040835cbb P e61c3a8f61bb48f8a963c9480e53c168 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:04:48.040443 20810 leader_election.cc:290] T 6c5eebf646ad445a9d1b1adc319d7b16 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
W20260709 13:04:48.093272 19526 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:48.098052 20730 raft_consensus.cc:493] T 62c6c134d3d24a1ab144dd9ee6bc3f64 P 127766fc592545a4997f7790f50f6076 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:48.100992 20112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "833a2f0775ed407a94b8924ce50adb63" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:04:48.105365 20106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96efeaaf1057492490e9a621f37e1a2d" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
W20260709 13:04:48.124210 19450 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.3:36891, user_credentials={real_user=slave}} blocked reactor thread for 140627us
I20260709 13:04:48.117539 20112 raft_consensus.cc:2468] T 833a2f0775ed407a94b8924ce50adb63 P 127766fc592545a4997f7790f50f6076 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 1.
I20260709 13:04:48.108858 20892 leader_election.cc:290] T 96efeaaf1057492490e9a621f37e1a2d P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
W20260709 13:04:48.109635 19525 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:48.049096 20897 raft_consensus.cc:3055] T 9962423cb4e54fcfa5de01daf68a86e7 P 127766fc592545a4997f7790f50f6076 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:04:48.113749 19557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "833a2f0775ed407a94b8924ce50adb63" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:04:48.118990 20819 leader_election.cc:290] T 1dc5b3532fe54f74876d02beffa2c230 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 2 election: Requested vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:04:48.062515 20734 raft_consensus.cc:493] T 65d8cb8d6ec64f459d5a47cefab10acf P 127766fc592545a4997f7790f50f6076 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e61c3a8f61bb48f8a963c9480e53c168)
I20260709 13:04:48.131563 19557 raft_consensus.cc:2468] T 833a2f0775ed407a94b8924ce50adb63 P e61c3a8f61bb48f8a963c9480e53c168 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 127766fc592545a4997f7790f50f6076 in term 2.
I20260709 13:04:48.139111 19484 raft_consensus.cc:1240] T 2e36a9d6e29c4a7c860cf267efbd4c74 P 0473d2b2d01f4459b1e90fd12cc7840e [term 2 LEADER]: Rejecting Update request from peer e61c3a8f61bb48f8a963c9480e53c168 for earlier term 1. Current term is 2. Ops: []
W20260709 13:04:48.146651 19377 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:48.148407 20817 leader_election.cc:290] T ece3db938bc649d4a40a51522ed5259c P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:04:48.152473 20827 consensus_queue.cc:1059] T e381f1d6b8184797ad142de49be225a8 P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:04:48.153091 20655 raft_consensus.cc:493] T 833a2f0775ed407a94b8924ce50adb63 P e5256d91808b47c195bc9b4dbd7f2b87 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:48.089334 20104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e1085d23e8347fbbd5bce7542f4b1f4" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:04:48.167848 19557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c5eebf646ad445a9d1b1adc319d7b16" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:04:48.160315 20734 raft_consensus.cc:515] T 65d8cb8d6ec64f459d5a47cefab10acf P 127766fc592545a4997f7790f50f6076 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:04:48.136215 20897 raft_consensus.cc:740] T 9962423cb4e54fcfa5de01daf68a86e7 P 127766fc592545a4997f7790f50f6076 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 127766fc592545a4997f7790f50f6076, State: Running, Role: LEADER
I20260709 13:04:48.173146 19557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96efeaaf1057492490e9a621f37e1a2d" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
W20260709 13:04:48.172693 19377 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:48.153761 20655 raft_consensus.cc:515] T 833a2f0775ed407a94b8924ce50adb63 P e5256d91808b47c195bc9b4dbd7f2b87 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:04:48.187083 19557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46c5bfeecc314717bffe987e6844b6d0" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 4 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:04:48.190333 20863 raft_consensus.cc:3055] T 2e36a9d6e29c4a7c860cf267efbd4c74 P e61c3a8f61bb48f8a963c9480e53c168 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:04:48.190893 20863 raft_consensus.cc:740] T 2e36a9d6e29c4a7c860cf267efbd4c74 P e61c3a8f61bb48f8a963c9480e53c168 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e61c3a8f61bb48f8a963c9480e53c168, State: Running, Role: LEADER
I20260709 13:04:48.054869 20647 consensus_queue.cc:260] T ab43d85f64114d4ebf618930e43d9ed0 P 127766fc592545a4997f7790f50f6076 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } attrs { replace: true } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: NON_VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: true } }
W20260709 13:04:47.311082 20824 consensus_queue.cc:1175] T 7be9efa6559648dbb5a0f7684c4542d1 P e5256d91808b47c195bc9b4dbd7f2b87 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" responder_term: 2 status { last_received { term: 1 index: 1 } last_committed_idx: 1 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer e5256d91808b47c195bc9b4dbd7f2b87 for earlier term 1. Current term is 2. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
W20260709 13:04:48.194363 19376 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:48.199014 20109 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35874 (request call id 221) took 1091 ms. Trace:
I20260709 13:04:48.198755 20855 raft_consensus.cc:515] T 2a16f7501e2444fb86d4e2778e734e02 P e5256d91808b47c195bc9b4dbd7f2b87 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:04:48.199481 20109 rpcz_store.cc:276] 0709 13:04:47.107964 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:47.108129 (+   165us) service_pool.cc:224] Handling call
0709 13:04:47.108453 (+   324us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:04:47.108823 (+   370us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:04:47.108857 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:04:47.109392 (+   535us) log.cc:844] Serialized 26 byte log entry
0709 13:04:47.975741 (+866349us) spinlock_profiling.cc:243] Waited 3.06 ms on lock 0x7b18002f0e60. stack: 00007f4a79de9343 00007f4a79de9240 00007f4a797781d4 00007f4a834b6304 00007f4a834b6299 00007f4a82ce3de1 00007f4a82cf05b1 00007f4a79dfde07 00007f4a82c58ab9 00007f4a79e1a69b 00007f4a79e1893f 00007f4a79e1ac02 00007f4a7caa220b 00007f4a7caa7d23 00007f4a7caa80d1 00007f4a7cec3a0f
0709 13:04:48.088953 (+113212us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:04:48.110910 (+ 21957us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:48.122712 (+ 11802us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:04:48.192454 (+ 69742us) raft_consensus.cc:1685] finished
0709 13:04:48.196586 (+  4132us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:48.198915 (+  2329us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":4314,"raft.run_cpu_time_us":123,"raft.run_wall_time_us":123,"spinlock_wait_cycles":7031680,"thread_start_us":79295,"threads_started":1,"wal-append.queue_time_us":1028520}
I20260709 13:04:48.201031 20855 leader_election.cc:290] T 2a16f7501e2444fb86d4e2778e734e02 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 4 election: Requested vote from peers e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:04:48.202157 19557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a08760e15aac4630a629431f56024dc8" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:04:48.089875 20728 consensus_queue.cc:237] T 62c6c134d3d24a1ab144dd9ee6bc3f64 P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:04:48.130254 20730 raft_consensus.cc:515] T 62c6c134d3d24a1ab144dd9ee6bc3f64 P 127766fc592545a4997f7790f50f6076 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:04:48.206759 20873 raft_consensus.cc:515] T 0e1085d23e8347fbbd5bce7542f4b1f4 P e61c3a8f61bb48f8a963c9480e53c168 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:04:48.208160 19555 raft_consensus.cc:3055] T 21e14947d70440f19044d8f75c31e1f9 P e61c3a8f61bb48f8a963c9480e53c168 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:04:48.207052 20897 consensus_queue.cc:260] T 9962423cb4e54fcfa5de01daf68a86e7 P 127766fc592545a4997f7790f50f6076 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:04:48.212752 20877 leader_election.cc:290] T 4af19371ea874c09a0a2147040835cbb P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:04:48.210592 19555 raft_consensus.cc:740] T 21e14947d70440f19044d8f75c31e1f9 P e61c3a8f61bb48f8a963c9480e53c168 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e61c3a8f61bb48f8a963c9480e53c168, State: Running, Role: LEADER
I20260709 13:04:48.215761 19403 raft_consensus.cc:2468] T 86a6797bdfe94fa496c050ceae4bd0d9 P e5256d91808b47c195bc9b4dbd7f2b87 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 2.
I20260709 13:04:48.216009 19555 consensus_queue.cc:260] T 21e14947d70440f19044d8f75c31e1f9 P e61c3a8f61bb48f8a963c9480e53c168 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:48.217445 19555 raft_consensus.cc:3060] T 21e14947d70440f19044d8f75c31e1f9 P e61c3a8f61bb48f8a963c9480e53c168 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:04:48.218878 19525 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:48.219270 20873 leader_election.cc:290] T 0e1085d23e8347fbbd5bce7542f4b1f4 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 3 election: Requested vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:04:48.212857 20897 raft_consensus.cc:3060] T 9962423cb4e54fcfa5de01daf68a86e7 P 127766fc592545a4997f7790f50f6076 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:04:48.220451 19551 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40438 (request call id 1134) took 1436 ms. Trace:
I20260709 13:04:48.227267 19553 raft_consensus.cc:2393] T 0e1085d23e8347fbbd5bce7542f4b1f4 P e61c3a8f61bb48f8a963c9480e53c168 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0473d2b2d01f4459b1e90fd12cc7840e in current term 3: Already voted for candidate e61c3a8f61bb48f8a963c9480e53c168 in this term.
I20260709 13:04:48.227496 19409 raft_consensus.cc:1240] T 1dc5b3532fe54f74876d02beffa2c230 P e5256d91808b47c195bc9b4dbd7f2b87 [term 2 FOLLOWER]: Rejecting Update request from peer 0473d2b2d01f4459b1e90fd12cc7840e for earlier term 1. Current term is 2. Ops: []
I20260709 13:04:48.228680 20647 ts_tablet_manager.cc:1434] T ab43d85f64114d4ebf618930e43d9ed0 P 127766fc592545a4997f7790f50f6076: Time spent starting tablet: real 0.606s	user 0.006s	sys 0.004s
I20260709 13:04:48.228859 19409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14efcc79969f41babe5529c22d59156d" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:04:48.229812 19409 raft_consensus.cc:2393] T 14efcc79969f41babe5529c22d59156d P e5256d91808b47c195bc9b4dbd7f2b87 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0473d2b2d01f4459b1e90fd12cc7840e in current term 3: Already voted for candidate e5256d91808b47c195bc9b4dbd7f2b87 in this term.
I20260709 13:04:48.226514 19408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9962423cb4e54fcfa5de01daf68a86e7" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
I20260709 13:04:48.234915 19408 raft_consensus.cc:3060] T 9962423cb4e54fcfa5de01daf68a86e7 P e5256d91808b47c195bc9b4dbd7f2b87 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:04:48.237243 19407 raft_consensus.cc:1275] T 2e36a9d6e29c4a7c860cf267efbd4c74 P e5256d91808b47c195bc9b4dbd7f2b87 [term 2 FOLLOWER]: Refusing update from remote peer 0473d2b2d01f4459b1e90fd12cc7840e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:48.241611 20109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14efcc79969f41babe5529c22d59156d" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:04:48.242398 20109 raft_consensus.cc:2468] T 14efcc79969f41babe5529c22d59156d P 127766fc592545a4997f7790f50f6076 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 3.
I20260709 13:04:48.241552 20112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c5eebf646ad445a9d1b1adc319d7b16" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:04:48.243714 20655 leader_election.cc:290] T 833a2f0775ed407a94b8924ce50adb63 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
W20260709 13:04:48.244656 20882 consensus_meta.cc:287] T fa8650e71aa14778b3d73721fc50d9fc P 0473d2b2d01f4459b1e90fd12cc7840e: Time spent flushing consensus metadata: real 0.540s	user 0.007s	sys 0.005s
I20260709 13:04:48.245463 19558 raft_consensus.cc:1275] T fa731b585f684a7fb2d106c50f143b83 P e61c3a8f61bb48f8a963c9480e53c168 [term 2 FOLLOWER]: Refusing update from remote peer 127766fc592545a4997f7790f50f6076: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:04:48.220845 19551 rpcz_store.cc:276] 0709 13:04:46.783789 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:46.791205 (+  7416us) service_pool.cc:224] Handling call
0709 13:04:47.608856 (+817651us) spinlock_profiling.cc:243] Waited 1.1 ms on lock 0x7b5800003998. stack: 00007f4a79de9343 00007f4a79de9240 00007f4a797781d4 00007f4a834b6304 00007f4a834b6299 00007f4a79ca3db1 00007f4a79de3b71 00007f4a79de3eee 0000000000375939 00007f4a81e571e0 00007f4a81f200c4 00007f4a81f20131 00007f4a81ee1fc0 00007f4a81ecc929 00007f4a81ecc3d2 00007f4a7b443bd4
0709 13:04:47.609047 (+   191us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:04:47.720001 (+110954us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:48.220210 (+500209us) spinlock_profiling.cc:243] Waited 101 ms on lock 0x7b540012aa54. stack: 00007f4a79de9343 00007f4a79de9240 00007f4a797781d4 00007f4a834b6304 00007f4a834b6299 00007f4a7ce71571 00007f4a7cf08e01 00007f4a7cf0783e 00007f4a81ecc419 00007f4a7b443bd4 00007f4a7b443b62 00007f4a7b443a91 00007f4a7b443a0c 00007f4a7b442cc2 00007f4a7b24348c 00007f4a7b2428c6
0709 13:04:48.220395 (+   185us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":234529408}
I20260709 13:04:48.191780 20863 consensus_queue.cc:260] T 2e36a9d6e29c4a7c860cf267efbd4c74 P e61c3a8f61bb48f8a963c9480e53c168 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:48.250636 20106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96efeaaf1057492490e9a621f37e1a2d" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:04:48.251024 19405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46c5bfeecc314717bffe987e6844b6d0" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 4 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:04:48.251650 19405 raft_consensus.cc:2468] T 46c5bfeecc314717bffe987e6844b6d0 P e5256d91808b47c195bc9b4dbd7f2b87 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 3.
I20260709 13:04:48.251190 20863 raft_consensus.cc:3060] T 2e36a9d6e29c4a7c860cf267efbd4c74 P e61c3a8f61bb48f8a963c9480e53c168 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:48.254585 19483 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58286 (request call id 1090) took 1034 ms. Trace:
W20260709 13:04:48.246537 20647 ts_tablet_manager.cc:1467] T ab43d85f64114d4ebf618930e43d9ed0 P 127766fc592545a4997f7790f50f6076: Tablet startup took 609ms
I20260709 13:04:48.251665 19406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a08760e15aac4630a629431f56024dc8" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:04:48.268815 19483 rpcz_store.cc:276] 0709 13:04:47.220264 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:47.220508 (+   244us) service_pool.cc:224] Handling call
0709 13:04:47.654001 (+433493us) spinlock_profiling.cc:243] Waited 3 ms on lock 0x7b58001b9998. stack: 00007f4a79de9343 00007f4a79de9240 00007f4a797781d4 00007f4a834b6304 00007f4a834b6299 00007f4a79ca3db1 00007f4a79de3b71 00007f4a79de3a22 00007f4a82cfcc09 00007f4a81e56ee0 00007f4a81f200ab 00007f4a81f20131 00007f4a81ee1fc0 00007f4a81ecc929 00007f4a81ecc3d2 00007f4a7b443bd4
0709 13:04:47.654157 (+   156us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:04:47.668507 (+ 14350us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:48.254286 (+585779us) spinlock_profiling.cc:243] Waited 13.7 ms on lock 0x7b54000a9954. stack: 00007f4a79de9343 00007f4a79de9240 00007f4a797781d4 00007f4a834b6304 00007f4a834b6299 00007f4a7ce71571 00007f4a7cf08e01 00007f4a7cf0783e 00007f4a81ecc419 00007f4a7b443bd4 00007f4a7b443b62 00007f4a7b443a91 00007f4a7b443a0c 00007f4a7b442cc2 00007f4a7b24348c 00007f4a7b2428c6
0709 13:04:48.254513 (+   227us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":38327808}
I20260709 13:04:48.271154 19406 raft_consensus.cc:2393] T a08760e15aac4630a629431f56024dc8 P e5256d91808b47c195bc9b4dbd7f2b87 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0473d2b2d01f4459b1e90fd12cc7840e in current term 2: Already voted for candidate e5256d91808b47c195bc9b4dbd7f2b87 in this term.
I20260709 13:04:48.253165 20734 leader_election.cc:290] T 65d8cb8d6ec64f459d5a47cefab10acf P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:04:48.260701 19481 raft_consensus.cc:1275] T ed7fdbcb96d14d418db9ca90a792588a P 0473d2b2d01f4459b1e90fd12cc7840e [term 2 FOLLOWER]: Refusing update from remote peer 127766fc592545a4997f7790f50f6076: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:04:48.248916 20908 consensus_queue.cc:1059] T 1dc5b3532fe54f74876d02beffa2c230 P 0473d2b2d01f4459b1e90fd12cc7840e [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.029s
I20260709 13:04:48.266081 20905 consensus_queue.cc:1048] T 2e36a9d6e29c4a7c860cf267efbd4c74 P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.033s
I20260709 13:04:48.289942 19551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70797e5783b5454ab0d0eea663e791e3" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:04:48.290635 19551 raft_consensus.cc:2468] T 70797e5783b5454ab0d0eea663e791e3 P e61c3a8f61bb48f8a963c9480e53c168 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 1.
I20260709 13:04:48.297243 19408 raft_consensus.cc:2468] T 9962423cb4e54fcfa5de01daf68a86e7 P e5256d91808b47c195bc9b4dbd7f2b87 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 3.
I20260709 13:04:48.307869 19555 raft_consensus.cc:1275] T 21e14947d70440f19044d8f75c31e1f9 P e61c3a8f61bb48f8a963c9480e53c168 [term 2 FOLLOWER]: Refusing update from remote peer e5256d91808b47c195bc9b4dbd7f2b87: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:48.309768 19555 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40438 (request call id 1156) took 1066 ms. Trace:
I20260709 13:04:48.310210 19555 rpcz_store.cc:276] 0709 13:04:47.243507 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:47.243631 (+   124us) service_pool.cc:224] Handling call
0709 13:04:47.243908 (+   277us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:04:48.208039 (+964131us) spinlock_profiling.cc:243] Waited 282 ms on lock 0x7b540019ec20. stack: 00007f4a79de9343 00007f4a79de9240 00007f4a797781d4 00007f4a834b6304 00007f4a834b6299 00007f4a7ce71571 00007f4a7ce7fdc0 00007f4a7cf0a1c0 00007f4a7cf0b231 00007f4a7cf07d8f 00007f4a7cf0783e 00007f4a81ecc419 00007f4a7b443bd4 00007f4a7b443b62 00007f4a7b443a91 00007f4a7b443a0c
0709 13:04:48.308993 (+100954us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:48.309697 (+   704us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":647891712}
I20260709 13:04:48.311669 19555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a16f7501e2444fb86d4e2778e734e02" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:04:48.312426 19555 raft_consensus.cc:3060] T 2a16f7501e2444fb86d4e2778e734e02 P e61c3a8f61bb48f8a963c9480e53c168 [term 2 FOLLOWER]: Advancing to term 4
I20260709 13:04:48.290016 19552 raft_consensus.cc:1240] T e381f1d6b8184797ad142de49be225a8 P e61c3a8f61bb48f8a963c9480e53c168 [term 3 FOLLOWER]: Rejecting Update request from peer e5256d91808b47c195bc9b4dbd7f2b87 for earlier term 2. Current term is 3. Ops: []
I20260709 13:04:48.314286 20730 leader_election.cc:290] T 62c6c134d3d24a1ab144dd9ee6bc3f64 P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:04:48.318830 19408 raft_consensus.cc:1240] T 7f575b143b844aa096b50997dad3516a P e5256d91808b47c195bc9b4dbd7f2b87 [term 2 LEADER]: Rejecting Update request from peer e61c3a8f61bb48f8a963c9480e53c168 for earlier term 1. Current term is 2. Ops: []
I20260709 13:04:48.314810 20655 raft_consensus.cc:493] T 85c494af21f9457a85da47b9bc70c1fd P e5256d91808b47c195bc9b4dbd7f2b87 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e61c3a8f61bb48f8a963c9480e53c168)
I20260709 13:04:48.321085 20655 raft_consensus.cc:515] T 85c494af21f9457a85da47b9bc70c1fd P e5256d91808b47c195bc9b4dbd7f2b87 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:04:48.322425 20839 raft_consensus.cc:515] T edd7d470b5014c9489be7f41f64355c9 P 0473d2b2d01f4459b1e90fd12cc7840e [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:48.323186 19405 raft_consensus.cc:1240] T 2725d2c4cb054f18b0fc8f735c15f6c2 P e5256d91808b47c195bc9b4dbd7f2b87 [term 2 FOLLOWER]: Rejecting Update request from peer e61c3a8f61bb48f8a963c9480e53c168 for earlier term 1. Current term is 2. Ops: []
I20260709 13:04:48.323431 19402 raft_consensus.cc:1240] T ab43d85f64114d4ebf618930e43d9ed0 P e5256d91808b47c195bc9b4dbd7f2b87 [term 2 FOLLOWER]: Rejecting Update request from peer e61c3a8f61bb48f8a963c9480e53c168 for earlier term 1. Current term is 2. Ops: []
I20260709 13:04:48.324601 20839 leader_election.cc:290] T edd7d470b5014c9489be7f41f64355c9 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 3 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:04:48.316624 19406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "833a2f0775ed407a94b8924ce50adb63" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:04:48.327052 19406 raft_consensus.cc:2468] T 833a2f0775ed407a94b8924ce50adb63 P e5256d91808b47c195bc9b4dbd7f2b87 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 2.
W20260709 13:04:48.278820 20076 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.3:36891, user_credentials={real_user=slave}} blocked reactor thread for 155599us
I20260709 13:04:48.314286 19552 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40438 (request call id 1148) took 1203 ms. Trace:
I20260709 13:04:48.305883 20869 raft_consensus.cc:493] T 14efcc79969f41babe5529c22d59156d P e5256d91808b47c195bc9b4dbd7f2b87 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:48.335899 20738 consensus_queue.cc:1048] T 7f575b143b844aa096b50997dad3516a P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.008s
I20260709 13:04:48.346758 19555 raft_consensus.cc:2468] T 2a16f7501e2444fb86d4e2778e734e02 P e61c3a8f61bb48f8a963c9480e53c168 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 4.
I20260709 13:04:48.336728 20107 raft_consensus.cc:2468] T 70797e5783b5454ab0d0eea663e791e3 P 127766fc592545a4997f7790f50f6076 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 3.
I20260709 13:04:48.347726 19555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70797e5783b5454ab0d0eea663e791e3" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:04:48.347245 20891 raft_consensus.cc:515] T 1efebf73c86e432baa55533136b6e12c P 127766fc592545a4997f7790f50f6076 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
W20260709 13:04:48.350839 20849 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 2 current term: 2 is higher.
I20260709 13:04:48.334550 19552 rpcz_store.cc:276] 0709 13:04:47.111357 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:47.118375 (+  7018us) service_pool.cc:224] Handling call
0709 13:04:48.285372 (+1166997us) spinlock_profiling.cc:243] Waited 1.22 ms on lock 0x7b5800003998. stack: 00007f4a79de9343 00007f4a79de9240 00007f4a797781d4 00007f4a834b6304 00007f4a834b6299 00007f4a79ca3db1 00007f4a79de3b71 00007f4a79de3a22 00007f4a82cfcc09 00007f4a81e56ee0 00007f4a81f200ab 00007f4a81f20131 00007f4a81ee1fc0 00007f4a81ecc929 00007f4a81ecc3d2 00007f4a7b443bd4
0709 13:04:48.289831 (+  4459us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:04:48.314025 (+ 24194us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:48.314224 (+   199us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2811648}
I20260709 13:04:48.353657 19554 raft_consensus.cc:3055] T df751f992649444090e27965eb1af85d P e61c3a8f61bb48f8a963c9480e53c168 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:04:48.357440 19555 raft_consensus.cc:3060] T 70797e5783b5454ab0d0eea663e791e3 P e61c3a8f61bb48f8a963c9480e53c168 [term 1 FOLLOWER]: Advancing to term 3
I20260709 13:04:48.357679 19482 raft_consensus.cc:1240] T df751f992649444090e27965eb1af85d P 0473d2b2d01f4459b1e90fd12cc7840e [term 2 FOLLOWER]: Rejecting Update request from peer e61c3a8f61bb48f8a963c9480e53c168 for earlier term 1. Current term is 2. Ops: [1.2-1.2]
I20260709 13:04:48.345688 19551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65d8cb8d6ec64f459d5a47cefab10acf" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:04:48.364467 20106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a16f7501e2444fb86d4e2778e734e02" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076"
I20260709 13:04:48.365126 20109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "833a2f0775ed407a94b8924ce50adb63" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:04:48.342393 20869 raft_consensus.cc:515] T 14efcc79969f41babe5529c22d59156d P e5256d91808b47c195bc9b4dbd7f2b87 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:04:48.361524 19554 raft_consensus.cc:740] T df751f992649444090e27965eb1af85d P e61c3a8f61bb48f8a963c9480e53c168 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e61c3a8f61bb48f8a963c9480e53c168, State: Running, Role: LEADER
I20260709 13:04:48.371162 19374 leader_election.cc:304] T 70797e5783b5454ab0d0eea663e791e3 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 127766fc592545a4997f7790f50f6076, e5256d91808b47c195bc9b4dbd7f2b87; no voters: 
I20260709 13:04:48.368774 20891 leader_election.cc:290] T 1efebf73c86e432baa55533136b6e12c P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 3 election: Requested vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:04:48.347736 19486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62c6c134d3d24a1ab144dd9ee6bc3f64" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:04:48.372889 20106 raft_consensus.cc:3060] T 2a16f7501e2444fb86d4e2778e734e02 P 127766fc592545a4997f7790f50f6076 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:04:48.361472 20897 raft_consensus.cc:493] T 85c494af21f9457a85da47b9bc70c1fd P 127766fc592545a4997f7790f50f6076 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e61c3a8f61bb48f8a963c9480e53c168)
I20260709 13:04:48.377272 20833 raft_consensus.cc:2804] T 70797e5783b5454ab0d0eea663e791e3 P e5256d91808b47c195bc9b4dbd7f2b87 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:04:48.374291 20109 raft_consensus.cc:2468] T 833a2f0775ed407a94b8924ce50adb63 P 127766fc592545a4997f7790f50f6076 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 1.
I20260709 13:04:48.378032 19554 consensus_queue.cc:260] T df751f992649444090e27965eb1af85d P e61c3a8f61bb48f8a963c9480e53c168 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.2, Last appended by leader: 2, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } attrs { replace: true } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: NON_VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: true } }
I20260709 13:04:48.381881 19551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edd7d470b5014c9489be7f41f64355c9" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:04:48.377302 19552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a16f7501e2444fb86d4e2778e734e02" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:04:48.385895 20879 raft_consensus.cc:493] T fa731b585f684a7fb2d106c50f143b83 P e61c3a8f61bb48f8a963c9480e53c168 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:48.368721 20885 consensus_queue.cc:260] T 2725d2c4cb054f18b0fc8f735c15f6c2 P e61c3a8f61bb48f8a963c9480e53c168 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:48.396380 19374 leader_election.cc:304] T 833a2f0775ed407a94b8924ce50adb63 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 127766fc592545a4997f7790f50f6076, e5256d91808b47c195bc9b4dbd7f2b87; no voters: 
I20260709 13:04:48.387933 19486 raft_consensus.cc:2468] T 62c6c134d3d24a1ab144dd9ee6bc3f64 P 0473d2b2d01f4459b1e90fd12cc7840e [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 127766fc592545a4997f7790f50f6076 in term 2.
I20260709 13:04:48.394265 19551 raft_consensus.cc:3060] T edd7d470b5014c9489be7f41f64355c9 P e61c3a8f61bb48f8a963c9480e53c168 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:04:48.398412 19552 raft_consensus.cc:2376] T 2a16f7501e2444fb86d4e2778e734e02 P e61c3a8f61bb48f8a963c9480e53c168 [term 4 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 4. Re-sending same reply.
I20260709 13:04:48.390626 20655 leader_election.cc:290] T 85c494af21f9457a85da47b9bc70c1fd P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:04:48.392377 20833 raft_consensus.cc:697] T 70797e5783b5454ab0d0eea663e791e3 P e5256d91808b47c195bc9b4dbd7f2b87 [term 3 LEADER]: Becoming Leader. State: Replica: e5256d91808b47c195bc9b4dbd7f2b87, State: Running, Role: LEADER
I20260709 13:04:48.410925 19555 raft_consensus.cc:2468] T 70797e5783b5454ab0d0eea663e791e3 P e61c3a8f61bb48f8a963c9480e53c168 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 3.
I20260709 13:04:48.388343 20897 raft_consensus.cc:515] T 85c494af21f9457a85da47b9bc70c1fd P 127766fc592545a4997f7790f50f6076 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:04:48.398083 19554 raft_consensus.cc:3060] T df751f992649444090e27965eb1af85d P e61c3a8f61bb48f8a963c9480e53c168 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:48.400286 20107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85c494af21f9457a85da47b9bc70c1fd" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:04:48.403515 20642 raft_consensus.cc:2804] T 833a2f0775ed407a94b8924ce50adb63 P e5256d91808b47c195bc9b4dbd7f2b87 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:04:48.404309 20885 raft_consensus.cc:3060] T 2725d2c4cb054f18b0fc8f735c15f6c2 P e61c3a8f61bb48f8a963c9480e53c168 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:48.504604 20897 leader_election.cc:290] T 85c494af21f9457a85da47b9bc70c1fd P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:04:48.505169 20682 tablet_bootstrap.cc:492] T 309c3ca0ca4b4f3ba129752ea2cb293b P 127766fc592545a4997f7790f50f6076: Bootstrap replayed 1/1 log segments. Stats: ops{read=3 overwritten=0 applied=3 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:04:48.505105 20106 raft_consensus.cc:2468] T 2a16f7501e2444fb86d4e2778e734e02 P 127766fc592545a4997f7790f50f6076 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 4.
W20260709 13:04:48.270948 20647 ts_tablet_manager.cc:1469] T ab43d85f64114d4ebf618930e43d9ed0 P 127766fc592545a4997f7790f50f6076: Trace:
0709 13:04:39.197067 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:39.197191 (+   124us) service_pool.cc:224] Handling call
0709 13:04:39.856206 (+659015us) ts_tablet_manager.cc:934] T ab43d85f64114d4ebf618930e43d9ed0 P 127766fc592545a4997f7790f50f6076: Initiating tablet copy from peer e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
0709 13:04:44.742382 (+4886176us) tablet_copy_client.cc:368] Tablet copy session begun
0709 13:04:45.395545 (+653163us) tablet_metadata.cc:665] Metadata flushed
0709 13:04:45.408500 (+ 12955us) tablet_copy_client.cc:497] Wrote new tablet metadata
0709 13:04:45.696700 (+288200us) tablet_copy_client.cc:418] Wrote new consensus metadata
0709 13:04:45.696969 (+   269us) tablet_replica.cc:206] Creating consensus instance
0709 13:04:45.697593 (+   624us) ts_tablet_manager.cc:989] Replica registered.
0709 13:04:45.697679 (+    86us) inbound_call.cc:177] Queueing success response
0709 13:04:46.404025 (+706346us) ts_tablet_manager.cc:1379] Bootstrapping tablet
0709 13:04:47.624287 (+1220262us) ts_tablet_manager.cc:1435] Starting tablet replica
0709 13:04:47.755174 (+130887us) tablet_replica.cc:261] Starting instrumentation
0709 13:04:47.755794 (+   620us) tablet_replica.cc:280] Starting consensus
Metrics: {"dns_us":85099,"mutex_wait_us":1578,"raft.queue_time_us":4874,"raft.run_cpu_time_us":227,"raft.run_wall_time_us":35916,"tablet-copy.queue_time_us":465559,"tablet-download-pool.queue_time_us":752,"tablet-download-pool.run_cpu_time_us":1281,"tablet-download-pool.run_wall_time_us":80816,"thread_start_us":486109,"threads_started":2}
I20260709 13:04:48.511611 19374 leader_election.cc:304] T 2a16f7501e2444fb86d4e2778e734e02 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 127766fc592545a4997f7790f50f6076, e5256d91808b47c195bc9b4dbd7f2b87; no voters: 
I20260709 13:04:48.509670 20078 leader_election.cc:304] T 62c6c134d3d24a1ab144dd9ee6bc3f64 P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, 127766fc592545a4997f7790f50f6076; no voters: 
I20260709 13:04:48.513386 19552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "833a2f0775ed407a94b8924ce50adb63" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
W20260709 13:04:48.513792 20916 log.cc:927] Time spent T 0e1085d23e8347fbbd5bce7542f4b1f4 P 0473d2b2d01f4459b1e90fd12cc7840e: Append to log took a long time: real 0.125s	user 0.000s	sys 0.000s
I20260709 13:04:48.514251 19552 raft_consensus.cc:2468] T 833a2f0775ed407a94b8924ce50adb63 P e61c3a8f61bb48f8a963c9480e53c168 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 2.
W20260709 13:04:48.515898 19526 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:48.516113 20869 leader_election.cc:290] T 14efcc79969f41babe5529c22d59156d P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
W20260709 13:04:48.516315 19526 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:48.481433 20891 raft_consensus.cc:493] T 0afb57ae58a24a01850491d69f0213dd P 127766fc592545a4997f7790f50f6076 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e61c3a8f61bb48f8a963c9480e53c168)
I20260709 13:04:48.505560 20642 raft_consensus.cc:493] T 833a2f0775ed407a94b8924ce50adb63 P e5256d91808b47c195bc9b4dbd7f2b87 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:48.521384 20682 tablet_bootstrap.cc:492] T 309c3ca0ca4b4f3ba129752ea2cb293b P 127766fc592545a4997f7790f50f6076: Bootstrap complete.
I20260709 13:04:48.520711 20855 raft_consensus.cc:2804] T 2a16f7501e2444fb86d4e2778e734e02 P e5256d91808b47c195bc9b4dbd7f2b87 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:04:48.511970 20107 raft_consensus.cc:2468] T 85c494af21f9457a85da47b9bc70c1fd P 127766fc592545a4997f7790f50f6076 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 1.
I20260709 13:04:48.525207 20897 raft_consensus.cc:2804] T 62c6c134d3d24a1ab144dd9ee6bc3f64 P 127766fc592545a4997f7790f50f6076 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:04:48.528680 20642 raft_consensus.cc:3060] T 833a2f0775ed407a94b8924ce50adb63 P e5256d91808b47c195bc9b4dbd7f2b87 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:04:48.539036 19480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14efcc79969f41babe5529c22d59156d" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:04:48.528867 19486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1efebf73c86e432baa55533136b6e12c" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:04:48.400333 20879 raft_consensus.cc:515] T fa731b585f684a7fb2d106c50f143b83 P e61c3a8f61bb48f8a963c9480e53c168 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:04:48.529796 20106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14efcc79969f41babe5529c22d59156d" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
W20260709 13:04:48.542295 20919 log.cc:927] Time spent T 62c6c134d3d24a1ab144dd9ee6bc3f64 P e61c3a8f61bb48f8a963c9480e53c168: Append to log took a long time: real 0.119s	user 0.001s	sys 0.000s
I20260709 13:04:48.526381 20891 raft_consensus.cc:515] T 0afb57ae58a24a01850491d69f0213dd P 127766fc592545a4997f7790f50f6076 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:04:48.535509 20897 raft_consensus.cc:493] T 62c6c134d3d24a1ab144dd9ee6bc3f64 P 127766fc592545a4997f7790f50f6076 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:48.548314 19374 leader_election.cc:304] T 85c494af21f9457a85da47b9bc70c1fd P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 127766fc592545a4997f7790f50f6076, e5256d91808b47c195bc9b4dbd7f2b87; no voters: 
I20260709 13:04:48.543871 20682 ts_tablet_manager.cc:1403] T 309c3ca0ca4b4f3ba129752ea2cb293b P 127766fc592545a4997f7790f50f6076: Time spent bootstrapping tablet: real 1.750s	user 0.068s	sys 0.084s
I20260709 13:04:48.549211 19557 raft_consensus.cc:1275] T 2e36a9d6e29c4a7c860cf267efbd4c74 P e61c3a8f61bb48f8a963c9480e53c168 [term 2 FOLLOWER]: Refusing update from remote peer 0473d2b2d01f4459b1e90fd12cc7840e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:48.541114 20855 raft_consensus.cc:697] T 2a16f7501e2444fb86d4e2778e734e02 P e5256d91808b47c195bc9b4dbd7f2b87 [term 4 LEADER]: Becoming Leader. State: Replica: e5256d91808b47c195bc9b4dbd7f2b87, State: Running, Role: LEADER
I20260709 13:04:48.568538 19411 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52328 (request call id 1120) took 1016 ms. Trace:
I20260709 13:04:48.568956 19411 rpcz_store.cc:276] 0709 13:04:47.551760 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:47.615311 (+ 63551us) service_pool.cc:224] Handling call
0709 13:04:48.568373 (+953062us) spinlock_profiling.cc:243] Waited 132 ms on lock 0x7b54000e6fd4. stack: 00007f4a79de9343 00007f4a79de9240 00007f4a797781d4 00007f4a834b6304 00007f4a834b6299 00007f4a7ce71571 00007f4a7cf0c2fa 00007f4a81ecdb17 00007f4a7b4486d4 00007f4a7b448662 00007f4a7b448591 00007f4a7b44850c 00007f4a7b4477c2 00007f4a7b24348c 00007f4a7b2428c6 00007f4a7b24226f
0709 13:04:48.568487 (+   114us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":303648640}
I20260709 13:04:48.568969 20855 consensus_queue.cc:237] T 2a16f7501e2444fb86d4e2778e734e02 P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.4, Last appended by leader: 4, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:04:48.571499 20860 raft_consensus.cc:3060] T 1dc5b3532fe54f74876d02beffa2c230 P 0473d2b2d01f4459b1e90fd12cc7840e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:48.555078 20891 leader_election.cc:290] T 0afb57ae58a24a01850491d69f0213dd P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:04:48.548990 20106 raft_consensus.cc:2468] T 14efcc79969f41babe5529c22d59156d P 127766fc592545a4997f7790f50f6076 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 3.
I20260709 13:04:48.559900 20829 raft_consensus.cc:2804] T 85c494af21f9457a85da47b9bc70c1fd P e5256d91808b47c195bc9b4dbd7f2b87 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:04:48.561105 19477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0afb57ae58a24a01850491d69f0213dd" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:04:48.545403 20910 raft_consensus.cc:493] T 775c229504194560ba9589bc2199b089 P 127766fc592545a4997f7790f50f6076 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e5256d91808b47c195bc9b4dbd7f2b87)
I20260709 13:04:48.583117 20910 raft_consensus.cc:515] T 775c229504194560ba9589bc2199b089 P 127766fc592545a4997f7790f50f6076 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:04:48.566663 20867 raft_consensus.cc:3055] T e381f1d6b8184797ad142de49be225a8 P e5256d91808b47c195bc9b4dbd7f2b87 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:04:48.581326 20829 raft_consensus.cc:493] T 85c494af21f9457a85da47b9bc70c1fd P e5256d91808b47c195bc9b4dbd7f2b87 [term 1 FOLLOWER]: Starting leader election (detected failure of leader e61c3a8f61bb48f8a963c9480e53c168)
I20260709 13:04:48.591642 20867 raft_consensus.cc:740] T e381f1d6b8184797ad142de49be225a8 P e5256d91808b47c195bc9b4dbd7f2b87 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: e5256d91808b47c195bc9b4dbd7f2b87, State: Running, Role: LEADER
I20260709 13:04:48.592082 20829 raft_consensus.cc:3060] T 85c494af21f9457a85da47b9bc70c1fd P e5256d91808b47c195bc9b4dbd7f2b87 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:48.592590 20867 consensus_queue.cc:260] T e381f1d6b8184797ad142de49be225a8 P e5256d91808b47c195bc9b4dbd7f2b87 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:48.593575 20867 raft_consensus.cc:3060] T e381f1d6b8184797ad142de49be225a8 P e5256d91808b47c195bc9b4dbd7f2b87 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:04:48.567065 20879 leader_election.cc:290] T fa731b585f684a7fb2d106c50f143b83 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:04:48.532053 20833 consensus_queue.cc:237] T 70797e5783b5454ab0d0eea663e791e3 P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:04:48.567579 19449 leader_election.cc:304] T 14efcc79969f41babe5529c22d59156d P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, 127766fc592545a4997f7790f50f6076; no voters: 
I20260709 13:04:48.598330 20818 raft_consensus.cc:2804] T 14efcc79969f41babe5529c22d59156d P 0473d2b2d01f4459b1e90fd12cc7840e [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:04:48.547322 19486 raft_consensus.cc:3060] T 1efebf73c86e432baa55533136b6e12c P 0473d2b2d01f4459b1e90fd12cc7840e [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:04:48.598714 20818 raft_consensus.cc:493] T 14efcc79969f41babe5529c22d59156d P 0473d2b2d01f4459b1e90fd12cc7840e [term 2 FOLLOWER]: Starting leader election (detected failure of leader 127766fc592545a4997f7790f50f6076)
I20260709 13:04:48.599182 20818 raft_consensus.cc:3060] T 14efcc79969f41babe5529c22d59156d P 0473d2b2d01f4459b1e90fd12cc7840e [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:04:48.600350 20776 raft_consensus.cc:3060] T 309c3ca0ca4b4f3ba129752ea2cb293b P e5256d91808b47c195bc9b4dbd7f2b87 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:04:48.602934 19402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ece3db938bc649d4a40a51522ed5259c" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:04:48.603255 19410 raft_consensus.cc:1240] T 9962423cb4e54fcfa5de01daf68a86e7 P e5256d91808b47c195bc9b4dbd7f2b87 [term 3 FOLLOWER]: Rejecting Update request from peer 127766fc592545a4997f7790f50f6076 for earlier term 2. Current term is 3. Ops: [2.5-2.5]
I20260709 13:04:48.603600 19402 raft_consensus.cc:2468] T ece3db938bc649d4a40a51522ed5259c P e5256d91808b47c195bc9b4dbd7f2b87 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 127766fc592545a4997f7790f50f6076 in term 2.
I20260709 13:04:48.607492 19406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edd7d470b5014c9489be7f41f64355c9" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
I20260709 13:04:48.609272 20109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9962423cb4e54fcfa5de01daf68a86e7" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076"
I20260709 13:04:48.610122 20109 raft_consensus.cc:2410] T 9962423cb4e54fcfa5de01daf68a86e7 P 127766fc592545a4997f7790f50f6076 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 0473d2b2d01f4459b1e90fd12cc7840e for term 3 because replica has last-logged OpId of term: 2 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260709 13:04:48.610473 19556 raft_consensus.cc:1240] T 309c3ca0ca4b4f3ba129752ea2cb293b P e61c3a8f61bb48f8a963c9480e53c168 [term 3 LEADER]: Rejecting Update request from peer e5256d91808b47c195bc9b4dbd7f2b87 for earlier term 2. Current term is 3. Ops: []
I20260709 13:04:48.610893 19449 leader_election.cc:304] T 46c5bfeecc314717bffe987e6844b6d0 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87; no voters: 
W20260709 13:04:48.578025 19523 consensus_peers.cc:597] T 309c3ca0ca4b4f3ba129752ea2cb293b P e61c3a8f61bb48f8a963c9480e53c168 -> Peer 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121): Couldn't send request to peer 127766fc592545a4997f7790f50f6076. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:04:48.611637 19523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.4:43121, user_credentials={real_user=slave}} blocked reactor thread for 496091us
I20260709 13:04:48.612926 19478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e1085d23e8347fbbd5bce7542f4b1f4" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
W20260709 13:04:48.614483 19526 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:48.578567 20771 raft_consensus.cc:493] T 0cdf56e38bbc453d9438d359e5a69955 P e5256d91808b47c195bc9b4dbd7f2b87 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:48.615234 19406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65d8cb8d6ec64f459d5a47cefab10acf" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:04:48.551762 20897 raft_consensus.cc:3060] T 62c6c134d3d24a1ab144dd9ee6bc3f64 P 127766fc592545a4997f7790f50f6076 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:04:48.582573 19555 raft_consensus.cc:1275] T f1b10566f45d4a7d9029858330e02d5b P e61c3a8f61bb48f8a963c9480e53c168 [term 3 FOLLOWER]: Refusing update from remote peer e5256d91808b47c195bc9b4dbd7f2b87: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:04:48.587424 20910 leader_election.cc:290] T 775c229504194560ba9589bc2199b089 P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:04:48.589330 19483 raft_consensus.cc:1240] T e381f1d6b8184797ad142de49be225a8 P 0473d2b2d01f4459b1e90fd12cc7840e [term 3 FOLLOWER]: Rejecting Update request from peer e5256d91808b47c195bc9b4dbd7f2b87 for earlier term 2. Current term is 3. Ops: []
I20260709 13:04:48.590164 20808 leader_election.cc:290] T 9962423cb4e54fcfa5de01daf68a86e7 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 3 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:04:48.619393 19407 raft_consensus.cc:1217] T df751f992649444090e27965eb1af85d P e5256d91808b47c195bc9b4dbd7f2b87 [term 2 LEADER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:04:48.619817 19480 raft_consensus.cc:1275] T b08304a0a02b42d7840c4e8ee9a6bd1a P 0473d2b2d01f4459b1e90fd12cc7840e [term 2 FOLLOWER]: Refusing update from remote peer e5256d91808b47c195bc9b4dbd7f2b87: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:48.620177 19554 raft_consensus.cc:1275] T df751f992649444090e27965eb1af85d P e61c3a8f61bb48f8a963c9480e53c168 [term 2 FOLLOWER]: Refusing update from remote peer e5256d91808b47c195bc9b4dbd7f2b87: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 2 index: 2. (term mismatch)
I20260709 13:04:48.620512 19408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4af19371ea874c09a0a2147040835cbb" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:04:48.621539 19410 raft_consensus.cc:1275] T 46c5bfeecc314717bffe987e6844b6d0 P e5256d91808b47c195bc9b4dbd7f2b87 [term 3 FOLLOWER]: Refusing update from remote peer e61c3a8f61bb48f8a963c9480e53c168: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:04:48.621636 19408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa731b585f684a7fb2d106c50f143b83" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:04:48.624802 20112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa731b585f684a7fb2d106c50f143b83" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:04:48.626003 19485 raft_consensus.cc:1240] T edd7d470b5014c9489be7f41f64355c9 P 0473d2b2d01f4459b1e90fd12cc7840e [term 3 FOLLOWER]: Rejecting Update request from peer e5256d91808b47c195bc9b4dbd7f2b87 for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 13:04:48.627794 19374 leader_election.cc:304] T 14efcc79969f41babe5529c22d59156d P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 127766fc592545a4997f7790f50f6076, e5256d91808b47c195bc9b4dbd7f2b87; no voters: 0473d2b2d01f4459b1e90fd12cc7840e
I20260709 13:04:48.627904 20818 raft_consensus.cc:515] T 14efcc79969f41babe5529c22d59156d P 0473d2b2d01f4459b1e90fd12cc7840e [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:04:48.620576 19554 pending_rounds.cc:85] T df751f992649444090e27965eb1af85d P e61c3a8f61bb48f8a963c9480e53c168: Aborting all ops after (but not including) 1
I20260709 13:04:48.630028 19554 pending_rounds.cc:107] T df751f992649444090e27965eb1af85d P e61c3a8f61bb48f8a963c9480e53c168: Aborting uncommitted CHANGE_CONFIG_OP operation due to leader change: 1.2
I20260709 13:04:48.630344 20818 leader_election.cc:290] T 14efcc79969f41babe5529c22d59156d P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 3 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:04:48.632233 20843 raft_consensus.cc:2804] T 14efcc79969f41babe5529c22d59156d P e5256d91808b47c195bc9b4dbd7f2b87 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:04:48.632647 20843 raft_consensus.cc:493] T 14efcc79969f41babe5529c22d59156d P e5256d91808b47c195bc9b4dbd7f2b87 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:48.632969 20843 raft_consensus.cc:3060] T 14efcc79969f41babe5529c22d59156d P e5256d91808b47c195bc9b4dbd7f2b87 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:04:48.635006 20106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e1085d23e8347fbbd5bce7542f4b1f4" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076"
I20260709 13:04:48.635836 20076 leader_election.cc:304] T 833a2f0775ed407a94b8924ce50adb63 P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 127766fc592545a4997f7790f50f6076, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:04:48.636289 20109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4af19371ea874c09a0a2147040835cbb" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:04:48.639089 20737 raft_consensus.cc:2804] T 833a2f0775ed407a94b8924ce50adb63 P 127766fc592545a4997f7790f50f6076 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:04:48.639453 19406 raft_consensus.cc:1275] T 309c3ca0ca4b4f3ba129752ea2cb293b P e5256d91808b47c195bc9b4dbd7f2b87 [term 3 FOLLOWER]: Refusing update from remote peer e61c3a8f61bb48f8a963c9480e53c168: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 13:04:48.642077 20682 raft_consensus.cc:359] T 309c3ca0ca4b4f3ba129752ea2cb293b P 127766fc592545a4997f7790f50f6076 [term 2 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } attrs { replace: true } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: NON_VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: true } }
I20260709 13:04:48.643051 20682 raft_consensus.cc:740] T 309c3ca0ca4b4f3ba129752ea2cb293b P 127766fc592545a4997f7790f50f6076 [term 2 LEARNER]: Becoming Follower/Learner. State: Replica: 127766fc592545a4997f7790f50f6076, State: Initialized, Role: LEARNER
W20260709 13:04:48.643198 20920 log.cc:927] Time spent T df751f992649444090e27965eb1af85d P e5256d91808b47c195bc9b4dbd7f2b87: Append to log took a long time: real 0.097s	user 0.000s	sys 0.000s
I20260709 13:04:48.643785 20682 consensus_queue.cc:260] T 309c3ca0ca4b4f3ba129752ea2cb293b P 127766fc592545a4997f7790f50f6076 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } attrs { replace: true } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: NON_VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: true } }
I20260709 13:04:48.644619 19551 raft_consensus.cc:2468] T edd7d470b5014c9489be7f41f64355c9 P e61c3a8f61bb48f8a963c9480e53c168 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 3.
I20260709 13:04:48.630488 20642 raft_consensus.cc:515] T 833a2f0775ed407a94b8924ce50adb63 P e5256d91808b47c195bc9b4dbd7f2b87 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:04:48.645409 19552 raft_consensus.cc:1240] T edd7d470b5014c9489be7f41f64355c9 P e61c3a8f61bb48f8a963c9480e53c168 [term 3 FOLLOWER]: Rejecting Update request from peer e5256d91808b47c195bc9b4dbd7f2b87 for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 13:04:48.645792 20682 ts_tablet_manager.cc:1434] T 309c3ca0ca4b4f3ba129752ea2cb293b P 127766fc592545a4997f7790f50f6076: Time spent starting tablet: real 0.070s	user 0.004s	sys 0.000s
I20260709 13:04:48.618348 20771 raft_consensus.cc:515] T 0cdf56e38bbc453d9438d359e5a69955 P e5256d91808b47c195bc9b4dbd7f2b87 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:48.619874 19407 raft_consensus.cc:1240] T df751f992649444090e27965eb1af85d P e5256d91808b47c195bc9b4dbd7f2b87 [term 2 LEADER]: Rejecting Update request from peer e61c3a8f61bb48f8a963c9480e53c168 for earlier term 1. Current term is 2. Ops: [1.2-1.2]
I20260709 13:04:48.580530 19403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "833a2f0775ed407a94b8924ce50adb63" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:04:48.639536 20737 raft_consensus.cc:493] T 833a2f0775ed407a94b8924ce50adb63 P 127766fc592545a4997f7790f50f6076 [term 1 FOLLOWER]: Starting leader election (detected failure of leader e61c3a8f61bb48f8a963c9480e53c168)
I20260709 13:04:48.639101 19410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85c494af21f9457a85da47b9bc70c1fd" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
W20260709 13:04:48.616302 19523 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:48.642318 19406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "775c229504194560ba9589bc2199b089" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
W20260709 13:04:48.662310 19525 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:48.665061 19557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ece3db938bc649d4a40a51522ed5259c" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
W20260709 13:04:48.666568 19525 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:48.667325 19558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65d8cb8d6ec64f459d5a47cefab10acf" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
W20260709 13:04:48.669802 19449 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.1:40321, user_credentials={real_user=slave}} blocked reactor thread for 58977.1us
W20260709 13:04:48.662942 20078 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:04:48.670552 19526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.2:46257, user_credentials={real_user=slave}} blocked reactor thread for 46918.6us
I20260709 13:04:48.671139 19558 raft_consensus.cc:1275] T b08304a0a02b42d7840c4e8ee9a6bd1a P e61c3a8f61bb48f8a963c9480e53c168 [term 2 FOLLOWER]: Refusing update from remote peer e5256d91808b47c195bc9b4dbd7f2b87: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:48.669752 19556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "833a2f0775ed407a94b8924ce50adb63" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:04:48.672320 19560 raft_consensus.cc:1240] T 0e1085d23e8347fbbd5bce7542f4b1f4 P e61c3a8f61bb48f8a963c9480e53c168 [term 3 FOLLOWER]: Rejecting Update request from peer 127766fc592545a4997f7790f50f6076 for earlier term 2. Current term is 3. Ops: []
I20260709 13:04:48.666493 19557 raft_consensus.cc:2468] T ece3db938bc649d4a40a51522ed5259c P e61c3a8f61bb48f8a963c9480e53c168 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 127766fc592545a4997f7790f50f6076 in term 1.
I20260709 13:04:48.678228 19556 raft_consensus.cc:3060] T 833a2f0775ed407a94b8924ce50adb63 P e61c3a8f61bb48f8a963c9480e53c168 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:04:48.662945 19406 raft_consensus.cc:2468] T 775c229504194560ba9589bc2199b089 P e5256d91808b47c195bc9b4dbd7f2b87 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 127766fc592545a4997f7790f50f6076 in term 2.
I20260709 13:04:48.673231 19375 leader_election.cc:304] T 65d8cb8d6ec64f459d5a47cefab10acf P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87; no voters: 127766fc592545a4997f7790f50f6076, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:04:48.679549 19558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85c494af21f9457a85da47b9bc70c1fd" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:04:48.675837 19479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "775c229504194560ba9589bc2199b089" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:04:48.680485 19479 raft_consensus.cc:2393] T 775c229504194560ba9589bc2199b089 P 0473d2b2d01f4459b1e90fd12cc7840e [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 127766fc592545a4997f7790f50f6076 in current term 2: Already voted for candidate 0473d2b2d01f4459b1e90fd12cc7840e in this term.
I20260709 13:04:48.679557 19557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62c6c134d3d24a1ab144dd9ee6bc3f64" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:04:48.680812 19558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cdf56e38bbc453d9438d359e5a69955" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:04:48.682914 19558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1efebf73c86e432baa55533136b6e12c" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:04:48.683526 19558 raft_consensus.cc:3060] T 1efebf73c86e432baa55533136b6e12c P e61c3a8f61bb48f8a963c9480e53c168 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:04:48.684917 20110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "833a2f0775ed407a94b8924ce50adb63" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076"
I20260709 13:04:48.654100 19403 raft_consensus.cc:2368] T 833a2f0775ed407a94b8924ce50adb63 P e5256d91808b47c195bc9b4dbd7f2b87 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 127766fc592545a4997f7790f50f6076 for earlier term 2. Current term is 3.
I20260709 13:04:48.674633 19450 leader_election.cc:304] T 21e14947d70440f19044d8f75c31e1f9 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e; no voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168
W20260709 13:04:48.688246 19525 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:48.664749 20910 raft_consensus.cc:493] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P 127766fc592545a4997f7790f50f6076 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:48.689126 19569 tablet_copy_service.cc:342] P e61c3a8f61bb48f8a963c9480e53c168: Request end of tablet copy session 127766fc592545a4997f7790f50f6076-ab43d85f64114d4ebf618930e43d9ed0 received from {username='slave'} at 127.0.0.1:41504
I20260709 13:04:48.689664 19569 tablet_copy_service.cc:434] P e61c3a8f61bb48f8a963c9480e53c168: ending tablet copy session 127766fc592545a4997f7790f50f6076-ab43d85f64114d4ebf618930e43d9ed0 on tablet ab43d85f64114d4ebf618930e43d9ed0 with peer 127766fc592545a4997f7790f50f6076
I20260709 13:04:48.689357 20910 raft_consensus.cc:515] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P 127766fc592545a4997f7790f50f6076 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:04:48.689801 19486 raft_consensus.cc:2468] T 1efebf73c86e432baa55533136b6e12c P 0473d2b2d01f4459b1e90fd12cc7840e [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 127766fc592545a4997f7790f50f6076 in term 3.
I20260709 13:04:48.691479 19551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0afb57ae58a24a01850491d69f0213dd" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:04:48.691766 20910 leader_election.cc:290] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:04:48.646637 20642 leader_election.cc:290] T 833a2f0775ed407a94b8924ce50adb63 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 3 election: Requested vote from peers e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:04:48.654280 20737 raft_consensus.cc:3060] T 833a2f0775ed407a94b8924ce50adb63 P 127766fc592545a4997f7790f50f6076 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:48.630364 19554 raft_consensus.cc:2917] T df751f992649444090e27965eb1af85d P e61c3a8f61bb48f8a963c9480e53c168 [term 2 FOLLOWER]: Aborting config change with OpId 1.2: Aborted: Op aborted by new leader
I20260709 13:04:48.676389 20805 raft_consensus.cc:2804] T 46c5bfeecc314717bffe987e6844b6d0 P 0473d2b2d01f4459b1e90fd12cc7840e [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:04:48.653801 20771 leader_election.cc:290] T 0cdf56e38bbc453d9438d359e5a69955 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:04:48.707330 19449 leader_election.cc:304] T 9962423cb4e54fcfa5de01daf68a86e7 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87; no voters: 
I20260709 13:04:48.652395 19404 raft_consensus.cc:2468] T 7be9efa6559648dbb5a0f7684c4542d1 P e5256d91808b47c195bc9b4dbd7f2b87 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 2.
I20260709 13:04:48.704939 19523 leader_election.cc:304] T fa8650e71aa14778b3d73721fc50d9fc P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e61c3a8f61bb48f8a963c9480e53c168; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:04:48.686586 20819 raft_consensus.cc:493] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P e5256d91808b47c195bc9b4dbd7f2b87 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:48.713033 19450 leader_election.cc:304] T ed7fdbcb96d14d418db9ca90a792588a P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168; no voters: 127766fc592545a4997f7790f50f6076
I20260709 13:04:48.655907 20835 consensus_queue.cc:1059] T edd7d470b5014c9489be7f41f64355c9 P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.049s
I20260709 13:04:48.717157 19523 leader_election.cc:304] T f1b10566f45d4a7d9029858330e02d5b P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e61c3a8f61bb48f8a963c9480e53c168; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:04:48.655761 20827 consensus_queue.cc:1048] T b08304a0a02b42d7840c4e8ee9a6bd1a P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.050s
I20260709 13:04:48.719610 19421 tablet_copy_service.cc:342] P e5256d91808b47c195bc9b4dbd7f2b87: Request end of tablet copy session 127766fc592545a4997f7790f50f6076-309c3ca0ca4b4f3ba129752ea2cb293b received from {username='slave'} at 127.0.0.1:49050
I20260709 13:04:48.716701 20819 raft_consensus.cc:515] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P e5256d91808b47c195bc9b4dbd7f2b87 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:04:48.720232 20864 raft_consensus.cc:3060] T fa8650e71aa14778b3d73721fc50d9fc P e61c3a8f61bb48f8a963c9480e53c168 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:48.686482 20913 consensus_queue.cc:1048] T ed7fdbcb96d14d418db9ca90a792588a P 127766fc592545a4997f7790f50f6076 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.030s
I20260709 13:04:48.725132 20843 raft_consensus.cc:515] T 14efcc79969f41babe5529c22d59156d P e5256d91808b47c195bc9b4dbd7f2b87 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:04:48.675474 20871 consensus_queue.cc:1048] T 21e14947d70440f19044d8f75c31e1f9 P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.038s
I20260709 13:04:48.701560 20869 raft_consensus.cc:2749] T 65d8cb8d6ec64f459d5a47cefab10acf P e5256d91808b47c195bc9b4dbd7f2b87 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:04:48.730647 19526 leader_election.cc:304] T 96efeaaf1057492490e9a621f37e1a2d P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:04:48.730801 19523 leader_election.cc:304] T 28af091831594f9d8e96482078cc7625 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168; no voters: 0473d2b2d01f4459b1e90fd12cc7840e
I20260709 13:04:48.718339 19554 raft_consensus.cc:2889] T df751f992649444090e27965eb1af85d P e61c3a8f61bb48f8a963c9480e53c168 [term 2 FOLLOWER]: CHANGE_CONFIG_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:04:48.710289 20642 raft_consensus.cc:493] T 2725d2c4cb054f18b0fc8f735c15f6c2 P e5256d91808b47c195bc9b4dbd7f2b87 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:48.710304 19402 raft_consensus.cc:1240] T a08760e15aac4630a629431f56024dc8 P e5256d91808b47c195bc9b4dbd7f2b87 [term 2 FOLLOWER]: Rejecting Update request from peer e61c3a8f61bb48f8a963c9480e53c168 for earlier term 1. Current term is 2. Ops: []
I20260709 13:04:48.745704 19450 leader_election.cc:304] T 48824d5acfbc485ebf8c2d944e7202de P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e; no voters: 127766fc592545a4997f7790f50f6076, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:04:48.734885 19309 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:44698 (request call id 227) took 3150 ms. Trace:
I20260709 13:04:48.748441 19450 leader_election.cc:304] T 1efebf73c86e432baa55533136b6e12c P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168; no voters: 127766fc592545a4997f7790f50f6076
I20260709 13:04:48.719072 20803 raft_consensus.cc:2749] T 21e14947d70440f19044d8f75c31e1f9 P 0473d2b2d01f4459b1e90fd12cc7840e [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:04:48.555289 18300 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:04:48.732857 20849 raft_consensus.cc:2749] T f1b10566f45d4a7d9029858330e02d5b P e61c3a8f61bb48f8a963c9480e53c168 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:04:48.739768 19523 leader_election.cc:304] T d1e5873a19244c5ebbcd38e126796ee7 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e61c3a8f61bb48f8a963c9480e53c168; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:04:48.710858 20805 raft_consensus.cc:493] T 46c5bfeecc314717bffe987e6844b6d0 P 0473d2b2d01f4459b1e90fd12cc7840e [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:48.701889 20829 raft_consensus.cc:515] T 85c494af21f9457a85da47b9bc70c1fd P e5256d91808b47c195bc9b4dbd7f2b87 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:04:48.740223 19421 tablet_copy_service.cc:434] P e5256d91808b47c195bc9b4dbd7f2b87: ending tablet copy session 127766fc592545a4997f7790f50f6076-309c3ca0ca4b4f3ba129752ea2cb293b on tablet 309c3ca0ca4b4f3ba129752ea2cb293b with peer 127766fc592545a4997f7790f50f6076
I20260709 13:04:48.727499 19404 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52328 (request call id 1115) took 1166 ms. Trace:
I20260709 13:04:48.710290 20844 raft_consensus.cc:493] T 7be9efa6559648dbb5a0f7684c4542d1 P e5256d91808b47c195bc9b4dbd7f2b87 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:48.718041 20808 raft_consensus.cc:2804] T 9962423cb4e54fcfa5de01daf68a86e7 P 0473d2b2d01f4459b1e90fd12cc7840e [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:04:48.749600 19450 leader_election.cc:304] T e381f1d6b8184797ad142de49be225a8 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168; no voters: e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:04:48.747736 20876 raft_consensus.cc:2804] T 28af091831594f9d8e96482078cc7625 P e61c3a8f61bb48f8a963c9480e53c168 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:04:48.748149 19309 rpcz_store.cc:276] 0709 13:04:45.584975 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:45.592292 (+  7317us) service_pool.cc:224] Handling call
0709 13:04:48.734803 (+3142511us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:04:46.270231 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:04:46.271024 (+   793us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:04:46.271079 (+    55us) write_op.cc:435] Acquired schema lock
0709 13:04:46.271112 (+    33us) tablet.cc:662] Decoding operations
0709 13:04:46.271948 (+   836us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:04:46.272080 (+   132us) write_op.cc:641] Partition lock acquired for write op
0709 13:04:46.272122 (+    42us) tablet.cc:685] Acquiring locks for 3 operations
0709 13:04:46.272625 (+   503us) tablet.cc:701] Row locks acquired
0709 13:04:46.272673 (+    48us) write_op.cc:260] PREPARE: finished
0709 13:04:46.272886 (+   213us) write_op.cc:270] Start()
0709 13:04:46.273049 (+   163us) write_op.cc:276] Timestamp: P: 1783602286272821 usec, L: 0
0709 13:04:46.273078 (+    29us) op_driver.cc:348] REPLICATION: starting
0709 13:04:46.273963 (+   885us) log.cc:844] Serialized 1360 byte log entry
0709 13:04:46.535591 (+261628us) op_driver.cc:464] REPLICATION: finished
0709 13:04:46.823053 (+287462us) write_op.cc:301] APPLY: starting
0709 13:04:46.823142 (+    89us) tablet.cc:1367] starting BulkCheckPresence
0709 13:04:46.823275 (+   133us) tablet.cc:1370] finished BulkCheckPresence
0709 13:04:46.829112 (+  5837us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:04:46.829685 (+   573us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:04:46.829846 (+   161us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=3
0709 13:04:46.829891 (+    45us) write_op.cc:312] APPLY: finished
0709 13:04:46.830091 (+   200us) log.cc:844] Serialized 35 byte log entry
0709 13:04:46.830257 (+   166us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:04:46.830340 (+    83us) write_op.cc:454] Released schema lock
0709 13:04:46.830377 (+    37us) write_op.cc:341] FINISH: Updating metrics
0709 13:04:46.830690 (+   313us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:04:46.830717 (+    27us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":1047,"reported_tablets":9,"child_traces":[["op",{"apply.queue_time_us":274703,"apply.run_cpu_time_us":1943,"apply.run_wall_time_us":7611,"num_ops":3,"prepare.queue_time_us":85425,"prepare.run_cpu_time_us":4102,"prepare.run_wall_time_us":4173,"raft.queue_time_us":120921,"raft.run_cpu_time_us":30820,"raft.run_wall_time_us":333044,"replication_time_us":189238,"thread_start_us":354184,"threads_started":3,"wal-append.queue_time_us":11015,"wal-append.run_cpu_time_us":27324,"wal-append.run_wall_time_us":1548084}]]}
I20260709 13:04:48.732764 19481 raft_consensus.cc:1275] T 309c3ca0ca4b4f3ba129752ea2cb293b P 0473d2b2d01f4459b1e90fd12cc7840e [term 3 FOLLOWER]: Refusing update from remote peer e61c3a8f61bb48f8a963c9480e53c168: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 13:04:48.757673 19523 leader_election.cc:304] T e381f1d6b8184797ad142de49be225a8 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e61c3a8f61bb48f8a963c9480e53c168; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:04:48.750371 20839 raft_consensus.cc:2764] T 1efebf73c86e432baa55533136b6e12c P 0473d2b2d01f4459b1e90fd12cc7840e [term 3 FOLLOWER]: Leader election decision vote started in defunct term 2: won
I20260709 13:04:48.740408 20746 consensus_queue.cc:1048] T b08304a0a02b42d7840c4e8ee9a6bd1a P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.024s
I20260709 13:04:48.757573 20885 raft_consensus.cc:2804] T 96efeaaf1057492490e9a621f37e1a2d P e61c3a8f61bb48f8a963c9480e53c168 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:04:48.737303 20886 consensus_queue.cc:1048] T f1b10566f45d4a7d9029858330e02d5b P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.031s
I20260709 13:04:48.769541 19450 leader_election.cc:304] T 6c5eebf646ad445a9d1b1adc319d7b16 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e; no voters: 127766fc592545a4997f7790f50f6076, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:04:48.748008 20109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14efcc79969f41babe5529c22d59156d" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076"
I20260709 13:04:48.750582 20860 raft_consensus.cc:2804] T ed7fdbcb96d14d418db9ca90a792588a P 0473d2b2d01f4459b1e90fd12cc7840e [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:04:48.735618 19306 catalog_manager.cc:5697] T 7f575b143b844aa096b50997dad3516a P e5256d91808b47c195bc9b4dbd7f2b87 reported cstate change: term changed from 1 to 2, leader changed from e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3) to e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1). New cstate: current_term: 2 leader_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:48.713933 20897 raft_consensus.cc:515] T 62c6c134d3d24a1ab144dd9ee6bc3f64 P 127766fc592545a4997f7790f50f6076 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:04:48.755967 20812 raft_consensus.cc:2749] T 48824d5acfbc485ebf8c2d944e7202de P 0473d2b2d01f4459b1e90fd12cc7840e [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:04:48.757253 20805 raft_consensus.cc:3060] T 46c5bfeecc314717bffe987e6844b6d0 P 0473d2b2d01f4459b1e90fd12cc7840e [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:04:48.771262 19523 leader_election.cc:304] T 14935b3ddf914369822e4a0547aaa355 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e61c3a8f61bb48f8a963c9480e53c168; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:04:48.774947 20884 raft_consensus.cc:2804] T e381f1d6b8184797ad142de49be225a8 P 0473d2b2d01f4459b1e90fd12cc7840e [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:04:48.775231 19403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14efcc79969f41babe5529c22d59156d" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
I20260709 13:04:48.771402 20844 raft_consensus.cc:515] T 7be9efa6559648dbb5a0f7684c4542d1 P e5256d91808b47c195bc9b4dbd7f2b87 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:48.776721 20819 leader_election.cc:290] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:04:48.768390 20075 leader_election.cc:304] T ece3db938bc649d4a40a51522ed5259c P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 127766fc592545a4997f7790f50f6076, e5256d91808b47c195bc9b4dbd7f2b87; no voters: 
I20260709 13:04:48.771076 20808 raft_consensus.cc:697] T 9962423cb4e54fcfa5de01daf68a86e7 P 0473d2b2d01f4459b1e90fd12cc7840e [term 3 LEADER]: Becoming Leader. State: Replica: 0473d2b2d01f4459b1e90fd12cc7840e, State: Running, Role: LEADER
I20260709 13:04:48.777915 19552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85c494af21f9457a85da47b9bc70c1fd" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:04:48.765368 19556 raft_consensus.cc:2468] T 833a2f0775ed407a94b8924ce50adb63 P e61c3a8f61bb48f8a963c9480e53c168 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 3.
I20260709 13:04:48.783360 20106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36f6ba92b9ba46babe4ebd6c02e5fbd9" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:04:48.760742 20830 raft_consensus.cc:493] T ff9b0eddd810459b82d91c60777c10eb P e5256d91808b47c195bc9b4dbd7f2b87 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:48.784936 19558 raft_consensus.cc:2468] T 1efebf73c86e432baa55533136b6e12c P e61c3a8f61bb48f8a963c9480e53c168 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 127766fc592545a4997f7790f50f6076 in term 3.
I20260709 13:04:48.762425 20728 raft_consensus.cc:2749] T d1e5873a19244c5ebbcd38e126796ee7 P e61c3a8f61bb48f8a963c9480e53c168 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:04:48.787482 19450 leader_election.cc:304] T 96efeaaf1057492490e9a621f37e1a2d P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e; no voters: 127766fc592545a4997f7790f50f6076, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:04:48.766266 19554 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.BulkChangeConfig from 127.0.0.1:41500 (request call id 10) took 3682 ms. Trace:
I20260709 13:04:48.779861 20873 raft_consensus.cc:2749] T e381f1d6b8184797ad142de49be225a8 P e61c3a8f61bb48f8a963c9480e53c168 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:04:48.756379 20642 raft_consensus.cc:515] T 2725d2c4cb054f18b0fc8f735c15f6c2 P e5256d91808b47c195bc9b4dbd7f2b87 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:48.779290 19553 raft_consensus.cc:1275] T ed7fdbcb96d14d418db9ca90a792588a P e61c3a8f61bb48f8a963c9480e53c168 [term 2 FOLLOWER]: Refusing update from remote peer 127766fc592545a4997f7790f50f6076: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:04:48.771543 20876 raft_consensus.cc:493] T 28af091831594f9d8e96482078cc7625 P e61c3a8f61bb48f8a963c9480e53c168 [term 1 FOLLOWER]: Starting leader election (detected failure of leader e5256d91808b47c195bc9b4dbd7f2b87)
I20260709 13:04:48.789575 20839 raft_consensus.cc:2749] T 6c5eebf646ad445a9d1b1adc319d7b16 P 0473d2b2d01f4459b1e90fd12cc7840e [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:04:48.796422 19523 leader_election.cc:304] T 179fd671030940b4b4a4e24bcc4aba0a P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e61c3a8f61bb48f8a963c9480e53c168; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:04:48.781415 20776 raft_consensus.cc:493] T ab43d85f64114d4ebf618930e43d9ed0 P e5256d91808b47c195bc9b4dbd7f2b87 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:04:48.839360 19450 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.3:36891, user_credentials={real_user=slave}} blocked reactor thread for 51966.3us
I20260709 13:04:48.790618 20860 raft_consensus.cc:493] T ed7fdbcb96d14d418db9ca90a792588a P 0473d2b2d01f4459b1e90fd12cc7840e [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:48.798135 20883 raft_consensus.cc:493] T 76cb037fc9064d13b59a8969d897ce8c P 0473d2b2d01f4459b1e90fd12cc7840e [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:48.860065 20855 raft_consensus.cc:493] T 22196caba61445d3bec98a0aab3c337d P e5256d91808b47c195bc9b4dbd7f2b87 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:48.860585 20855 raft_consensus.cc:515] T 22196caba61445d3bec98a0aab3c337d P e5256d91808b47c195bc9b4dbd7f2b87 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:48.854283 19403 raft_consensus.cc:2368] T 14efcc79969f41babe5529c22d59156d P e5256d91808b47c195bc9b4dbd7f2b87 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 0473d2b2d01f4459b1e90fd12cc7840e for earlier term 3. Current term is 4.
W20260709 13:04:48.847627 20075 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.1:40321, user_credentials={real_user=slave}} blocked reactor thread for 86770.9us
I20260709 13:04:48.827518 20884 raft_consensus.cc:697] T e381f1d6b8184797ad142de49be225a8 P 0473d2b2d01f4459b1e90fd12cc7840e [term 3 LEADER]: Becoming Leader. State: Replica: 0473d2b2d01f4459b1e90fd12cc7840e, State: Running, Role: LEADER
I20260709 13:04:48.839756 20812 raft_consensus.cc:2749] T 96efeaaf1057492490e9a621f37e1a2d P 0473d2b2d01f4459b1e90fd12cc7840e [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 13:04:48.853531 20924 log.cc:927] Time spent T fa731b585f684a7fb2d106c50f143b83 P e5256d91808b47c195bc9b4dbd7f2b87: Append to log took a long time: real 0.086s	user 0.001s	sys 0.000s
W20260709 13:04:48.856150 19525 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:48.801075 20852 raft_consensus.cc:2749] T 14935b3ddf914369822e4a0547aaa355 P e61c3a8f61bb48f8a963c9480e53c168 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:04:48.856410 19375 leader_election.cc:304] T 833a2f0775ed407a94b8924ce50adb63 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:04:48.766577 19404 rpcz_store.cc:276] 0709 13:04:47.550440 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:47.553502 (+  3062us) service_pool.cc:224] Handling call
0709 13:04:48.652233 (+1098731us) spinlock_profiling.cc:243] Waited 613 ms on lock 0x7b540013fc20. stack: 00007f4a79de9343 00007f4a79de9240 00007f4a797781d4 00007f4a834b6304 00007f4a834b6299 00007f4a7ce71571 00007f4a7ce7fdc0 00007f4a7cf0be18 00007f4a81ecdb17 00007f4a7b4486d4 00007f4a7b448662 00007f4a7b448591 00007f4a7b44850c 00007f4a7b4477c2 00007f4a7b24348c 00007f4a7b2428c6
0709 13:04:48.716897 (+ 64664us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1409340288}
I20260709 13:04:48.852363 19450 leader_election.cc:304] T a08760e15aac4630a629431f56024dc8 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e; no voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:04:48.871412 19449 leader_election.cc:400] T 14efcc79969f41babe5529c22d59156d P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 3 election: Vote denied by peer e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321) with higher term. Message: Invalid argument: T 14efcc79969f41babe5529c22d59156d P e5256d91808b47c195bc9b4dbd7f2b87 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 0473d2b2d01f4459b1e90fd12cc7840e for earlier term 3. Current term is 4.
I20260709 13:04:48.857429 20771 raft_consensus.cc:493] T 40e1e16737a842ee936002830f36882e P e5256d91808b47c195bc9b4dbd7f2b87 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:48.879869 19449 leader_election.cc:403] T 14efcc79969f41babe5529c22d59156d P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 3 election: Cancelling election due to peer responding with higher term
I20260709 13:04:48.855791 20913 raft_consensus.cc:2804] T ece3db938bc649d4a40a51522ed5259c P 127766fc592545a4997f7790f50f6076 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:04:48.839725 20863 consensus_queue.cc:1048] T 309c3ca0ca4b4f3ba129752ea2cb293b P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.029s
I20260709 13:04:48.848486 20876 raft_consensus.cc:3060] T 28af091831594f9d8e96482078cc7625 P e61c3a8f61bb48f8a963c9480e53c168 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:48.845691 20106 raft_consensus.cc:2468] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P 127766fc592545a4997f7790f50f6076 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 3.
I20260709 13:04:48.857753 20860 raft_consensus.cc:3060] T ed7fdbcb96d14d418db9ca90a792588a P 0473d2b2d01f4459b1e90fd12cc7840e [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:04:48.862596 20855 leader_election.cc:290] T 22196caba61445d3bec98a0aab3c337d P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:04:48.864388 20853 raft_consensus.cc:2749] T 179fd671030940b4b4a4e24bcc4aba0a P e61c3a8f61bb48f8a963c9480e53c168 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:04:48.908481 20642 leader_election.cc:290] T 2725d2c4cb054f18b0fc8f735c15f6c2 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:04:48.908877 20908 raft_consensus.cc:493] T 7be9efa6559648dbb5a0f7684c4542d1 P 0473d2b2d01f4459b1e90fd12cc7840e [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:48.844314 20830 raft_consensus.cc:515] T ff9b0eddd810459b82d91c60777c10eb P e5256d91808b47c195bc9b4dbd7f2b87 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:04:48.893741 19450 leader_election.cc:304] T edd7d470b5014c9489be7f41f64355c9 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168; no voters: e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:04:48.872206 20821 raft_consensus.cc:493] T bc225c93219c45538b53a1bd3d387e4d P e5256d91808b47c195bc9b4dbd7f2b87 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:48.893443 20655 raft_consensus.cc:2804] T 833a2f0775ed407a94b8924ce50adb63 P e5256d91808b47c195bc9b4dbd7f2b87 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:04:48.879635 20075 leader_election.cc:304] T 775c229504194560ba9589bc2199b089 P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 127766fc592545a4997f7790f50f6076, e5256d91808b47c195bc9b4dbd7f2b87; no voters: 
W20260709 13:04:48.903601 20923 log.cc:927] Time spent T 2a16f7501e2444fb86d4e2778e734e02 P e5256d91808b47c195bc9b4dbd7f2b87: Append to log took a long time: real 0.059s	user 0.000s	sys 0.000s
W20260709 13:04:48.918444 20075 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.1:40321, user_credentials={real_user=slave}} blocked reactor thread for 49255.6us
W20260709 13:04:48.904323 19524 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:48.887606 20771 raft_consensus.cc:515] T 40e1e16737a842ee936002830f36882e P e5256d91808b47c195bc9b4dbd7f2b87 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:48.919627 20075 leader_election.cc:400] T 833a2f0775ed407a94b8924ce50adb63 P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 2 pre-election: Vote denied by peer e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321) with higher term. Message: Invalid argument: T 833a2f0775ed407a94b8924ce50adb63 P e5256d91808b47c195bc9b4dbd7f2b87 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 127766fc592545a4997f7790f50f6076 for earlier term 2. Current term is 3.
I20260709 13:04:48.919576 20818 consensus_queue.cc:1048] T 2e36a9d6e29c4a7c860cf267efbd4c74 P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:04:48.918759 19450 leader_election.cc:304] T 0e1085d23e8347fbbd5bce7542f4b1f4 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e; no voters: 127766fc592545a4997f7790f50f6076, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:04:48.905548 20109 raft_consensus.cc:2468] T 14efcc79969f41babe5529c22d59156d P 127766fc592545a4997f7790f50f6076 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 3.
W20260709 13:04:48.906314 20925 log.cc:927] Time spent T 70797e5783b5454ab0d0eea663e791e3 P e5256d91808b47c195bc9b4dbd7f2b87: Append to log took a long time: real 0.078s	user 0.001s	sys 0.000s
I20260709 13:04:48.918905 20891 raft_consensus.cc:2804] T 775c229504194560ba9589bc2199b089 P 127766fc592545a4997f7790f50f6076 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:04:48.943004 20891 raft_consensus.cc:493] T 775c229504194560ba9589bc2199b089 P 127766fc592545a4997f7790f50f6076 [term 1 FOLLOWER]: Starting leader election (detected failure of leader e5256d91808b47c195bc9b4dbd7f2b87)
W20260709 13:04:48.943233 20926 log.cc:927] Time spent T 2e36a9d6e29c4a7c860cf267efbd4c74 P e5256d91808b47c195bc9b4dbd7f2b87: Append to log took a long time: real 0.060s	user 0.000s	sys 0.000s
I20260709 13:04:48.943463 20891 raft_consensus.cc:3060] T 775c229504194560ba9589bc2199b089 P 127766fc592545a4997f7790f50f6076 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:48.920944 20771 leader_election.cc:290] T 40e1e16737a842ee936002830f36882e P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:04:48.891567 20906 raft_consensus.cc:3060] T 14efcc79969f41babe5529c22d59156d P 0473d2b2d01f4459b1e90fd12cc7840e [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:04:48.887966 20913 raft_consensus.cc:493] T ece3db938bc649d4a40a51522ed5259c P 127766fc592545a4997f7790f50f6076 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:48.884855 20839 raft_consensus.cc:3060] T a08760e15aac4630a629431f56024dc8 P 0473d2b2d01f4459b1e90fd12cc7840e [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:04:48.939555 19526 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:48.939759 19481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cdf56e38bbc453d9438d359e5a69955" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:04:48.909420 20908 raft_consensus.cc:515] T 7be9efa6559648dbb5a0f7684c4542d1 P 0473d2b2d01f4459b1e90fd12cc7840e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:48.942021 20655 raft_consensus.cc:697] T 833a2f0775ed407a94b8924ce50adb63 P e5256d91808b47c195bc9b4dbd7f2b87 [term 3 LEADER]: Becoming Leader. State: Replica: e5256d91808b47c195bc9b4dbd7f2b87, State: Running, Role: LEADER
I20260709 13:04:48.925891 19478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22196caba61445d3bec98a0aab3c337d" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
W20260709 13:04:48.947115 19375 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.3:36891, user_credentials={real_user=slave}} blocked reactor thread for 90766.5us
W20260709 13:04:48.947273 19523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.1:40321, user_credentials={real_user=slave}} blocked reactor thread for 150931us
I20260709 13:04:48.928948 20078 leader_election.cc:304] T 1efebf73c86e432baa55533136b6e12c P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, 127766fc592545a4997f7790f50f6076; no voters: 
W20260709 13:04:48.991245 20078 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.2:46257, user_credentials={real_user=slave}} blocked reactor thread for 62393.1us
I20260709 13:04:48.923628 19479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36f6ba92b9ba46babe4ebd6c02e5fbd9" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:04:48.869496 20883 raft_consensus.cc:515] T 76cb037fc9064d13b59a8969d897ce8c P 0473d2b2d01f4459b1e90fd12cc7840e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:48.857748 20776 raft_consensus.cc:515] T ab43d85f64114d4ebf618930e43d9ed0 P e5256d91808b47c195bc9b4dbd7f2b87 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } attrs { replace: true } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: NON_VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: true } }
I20260709 13:04:48.909649 20812 raft_consensus.cc:493] T ef32ce6fdd0e40d382c79974f30295c6 P 0473d2b2d01f4459b1e90fd12cc7840e [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:48.991273 19523 leader_election.cc:304] T f93ee515a9c14139bf566522ed8232f3 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168; no voters: 0473d2b2d01f4459b1e90fd12cc7840e
I20260709 13:04:48.946380 20843 leader_election.cc:290] T 14efcc79969f41babe5529c22d59156d P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 4 election: Requested vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:04:48.990859 20829 leader_election.cc:290] T 85c494af21f9457a85da47b9bc70c1fd P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 2 election: Requested vote from peers e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:04:49.015700 19523 leader_election.cc:304] T 3e1f505cb0f1427bbd698ac889d80821 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e61c3a8f61bb48f8a963c9480e53c168; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:04:49.016855 19523 leader_election.cc:304] T ef32ce6fdd0e40d382c79974f30295c6 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e61c3a8f61bb48f8a963c9480e53c168; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:04:49.017861 19523 leader_election.cc:304] T 4509b76741dc428e9201c70c1658da13 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e61c3a8f61bb48f8a963c9480e53c168; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:04:48.989934 19478 raft_consensus.cc:2468] T 22196caba61445d3bec98a0aab3c337d P 0473d2b2d01f4459b1e90fd12cc7840e [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 2.
I20260709 13:04:49.019886 19523 leader_election.cc:304] T b9f0d59553ad444883fcf5b5909f9798 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e61c3a8f61bb48f8a963c9480e53c168; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:04:48.921377 20716 raft_consensus.cc:2804] T edd7d470b5014c9489be7f41f64355c9 P 0473d2b2d01f4459b1e90fd12cc7840e [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:04:48.953555 20803 raft_consensus.cc:3060] T 0e1085d23e8347fbbd5bce7542f4b1f4 P 0473d2b2d01f4459b1e90fd12cc7840e [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:04:48.988003 19483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14efcc79969f41babe5529c22d59156d" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:04:49.025759 20109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85c494af21f9457a85da47b9bc70c1fd" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076"
I20260709 13:04:49.026371 20109 raft_consensus.cc:3060] T 85c494af21f9457a85da47b9bc70c1fd P 127766fc592545a4997f7790f50f6076 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:49.034715 19557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40e1e16737a842ee936002830f36882e" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:04:49.035535 19557 raft_consensus.cc:2468] T 40e1e16737a842ee936002830f36882e P e61c3a8f61bb48f8a963c9480e53c168 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 3.
I20260709 13:04:49.036473 19557 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1efebf73c86e432baa55533136b6e12c"
dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
mode: GRACEFUL
new_leader_uuid: "127766fc592545a4997f7790f50f6076"
 from {username='slave'} at 127.0.0.1:51880
I20260709 13:04:49.037889 19559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2725d2c4cb054f18b0fc8f735c15f6c2" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:04:49.038507 19374 leader_election.cc:304] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 127766fc592545a4997f7790f50f6076, e5256d91808b47c195bc9b4dbd7f2b87; no voters: 
I20260709 13:04:49.038856 20109 raft_consensus.cc:2468] T 85c494af21f9457a85da47b9bc70c1fd P 127766fc592545a4997f7790f50f6076 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 2.
I20260709 13:04:49.038528 19559 raft_consensus.cc:2468] T 2725d2c4cb054f18b0fc8f735c15f6c2 P e61c3a8f61bb48f8a963c9480e53c168 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 2.
I20260709 13:04:49.037097 19557 raft_consensus.cc:606] T 1efebf73c86e432baa55533136b6e12c P e61c3a8f61bb48f8a963c9480e53c168 [term 3 FOLLOWER]: Received request to transfer leadership to TS 127766fc592545a4997f7790f50f6076
I20260709 13:04:49.040277 19557 raft_consensus.cc:614] T 1efebf73c86e432baa55533136b6e12c P e61c3a8f61bb48f8a963c9480e53c168 [term 3 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:04:48.925594 20821 raft_consensus.cc:515] T bc225c93219c45538b53a1bd3d387e4d P e5256d91808b47c195bc9b4dbd7f2b87 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:49.042455 19523 leader_election.cc:304] T 76cb037fc9064d13b59a8969d897ce8c P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168; no voters: 0473d2b2d01f4459b1e90fd12cc7840e
I20260709 13:04:49.043088 19375 leader_election.cc:304] T 40e1e16737a842ee936002830f36882e P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:04:49.043954 19375 leader_election.cc:304] T 2725d2c4cb054f18b0fc8f735c15f6c2 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:04:48.965691 20913 raft_consensus.cc:3060] T ece3db938bc649d4a40a51522ed5259c P 127766fc592545a4997f7790f50f6076 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:04:49.022236 20734 raft_consensus.cc:2804] T 1efebf73c86e432baa55533136b6e12c P 127766fc592545a4997f7790f50f6076 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:04:49.019790 19477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36f6ba92b9ba46babe4ebd6c02e5fbd9" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:04:49.046366 19523 leader_election.cc:304] T 1a61655d99124a29b486ba4a5b37faea P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e61c3a8f61bb48f8a963c9480e53c168; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:04:49.046940 19478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62c6c134d3d24a1ab144dd9ee6bc3f64" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:04:49.055060 19478 raft_consensus.cc:3060] T 62c6c134d3d24a1ab144dd9ee6bc3f64 P 0473d2b2d01f4459b1e90fd12cc7840e [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:04:49.048157 19374 leader_election.cc:304] T 85c494af21f9457a85da47b9bc70c1fd P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 127766fc592545a4997f7790f50f6076, e5256d91808b47c195bc9b4dbd7f2b87; no voters: 
I20260709 13:04:49.045783 19483 raft_consensus.cc:1275] T ff9b0eddd810459b82d91c60777c10eb P 0473d2b2d01f4459b1e90fd12cc7840e [term 2 FOLLOWER]: Refusing update from remote peer 127766fc592545a4997f7790f50f6076: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:04:49.032100 20728 raft_consensus.cc:2804] T f93ee515a9c14139bf566522ed8232f3 P e61c3a8f61bb48f8a963c9480e53c168 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:04:49.033277 20852 raft_consensus.cc:2749] T 3e1f505cb0f1427bbd698ac889d80821 P e61c3a8f61bb48f8a963c9480e53c168 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:04:49.059614 19559 raft_consensus.cc:1275] T 2a16f7501e2444fb86d4e2778e734e02 P e61c3a8f61bb48f8a963c9480e53c168 [term 4 FOLLOWER]: Refusing update from remote peer e5256d91808b47c195bc9b4dbd7f2b87: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
I20260709 13:04:49.045451 19560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85c494af21f9457a85da47b9bc70c1fd" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:04:48.891259 20808 consensus_queue.cc:237] T 9962423cb4e54fcfa5de01daf68a86e7 P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:04:49.041653 20853 raft_consensus.cc:3060] T ef32ce6fdd0e40d382c79974f30295c6 P e61c3a8f61bb48f8a963c9480e53c168 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:49.041585 20106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14efcc79969f41babe5529c22d59156d" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076"
I20260709 13:04:49.041706 20819 raft_consensus.cc:493] T ef32ce6fdd0e40d382c79974f30295c6 P e5256d91808b47c195bc9b4dbd7f2b87 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:04:49.073978 19525 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:49.055142 20855 raft_consensus.cc:2804] T 40e1e16737a842ee936002830f36882e P e5256d91808b47c195bc9b4dbd7f2b87 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:04:49.045522 20849 raft_consensus.cc:2749] T 4509b76741dc428e9201c70c1658da13 P e61c3a8f61bb48f8a963c9480e53c168 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:04:49.089854 19405 raft_consensus.cc:1275] T ff9b0eddd810459b82d91c60777c10eb P e5256d91808b47c195bc9b4dbd7f2b87 [term 2 FOLLOWER]: Refusing update from remote peer 127766fc592545a4997f7790f50f6076: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:04:49.049695 20873 raft_consensus.cc:2749] T b9f0d59553ad444883fcf5b5909f9798 P e61c3a8f61bb48f8a963c9480e53c168 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:04:49.054821 20829 raft_consensus.cc:2804] T 2725d2c4cb054f18b0fc8f735c15f6c2 P e5256d91808b47c195bc9b4dbd7f2b87 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:04:49.056401 19551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22196caba61445d3bec98a0aab3c337d" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:04:49.032245 20812 raft_consensus.cc:515] T ef32ce6fdd0e40d382c79974f30295c6 P 0473d2b2d01f4459b1e90fd12cc7840e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:49.054598 20863 raft_consensus.cc:2804] T 76cb037fc9064d13b59a8969d897ce8c P e61c3a8f61bb48f8a963c9480e53c168 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:04:49.013778 20884 consensus_queue.cc:237] T e381f1d6b8184797ad142de49be225a8 P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:49.054358 20897 leader_election.cc:290] T 62c6c134d3d24a1ab144dd9ee6bc3f64 P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 3 election: Requested vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:04:49.053733 20818 raft_consensus.cc:493] T f93ee515a9c14139bf566522ed8232f3 P 0473d2b2d01f4459b1e90fd12cc7840e [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:49.059731 20728 raft_consensus.cc:493] T f93ee515a9c14139bf566522ed8232f3 P e61c3a8f61bb48f8a963c9480e53c168 [term 1 FOLLOWER]: Starting leader election (detected failure of leader e5256d91808b47c195bc9b4dbd7f2b87)
I20260709 13:04:49.093650 20738 raft_consensus.cc:2804] T 85c494af21f9457a85da47b9bc70c1fd P e5256d91808b47c195bc9b4dbd7f2b87 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:04:49.071413 20930 raft_consensus.cc:2804] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P e5256d91808b47c195bc9b4dbd7f2b87 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:04:49.090191 20734 raft_consensus.cc:697] T 1efebf73c86e432baa55533136b6e12c P 127766fc592545a4997f7790f50f6076 [term 3 LEADER]: Becoming Leader. State: Replica: 127766fc592545a4997f7790f50f6076, State: Running, Role: LEADER
I20260709 13:04:49.097020 20855 raft_consensus.cc:493] T 40e1e16737a842ee936002830f36882e P e5256d91808b47c195bc9b4dbd7f2b87 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:49.116452 20109 raft_consensus.cc:1275] T 2a16f7501e2444fb86d4e2778e734e02 P 127766fc592545a4997f7790f50f6076 [term 4 FOLLOWER]: Refusing update from remote peer e5256d91808b47c195bc9b4dbd7f2b87: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
I20260709 13:04:49.105592 20863 raft_consensus.cc:493] T 76cb037fc9064d13b59a8969d897ce8c P e61c3a8f61bb48f8a963c9480e53c168 [term 1 FOLLOWER]: Starting leader election (detected failure of leader e5256d91808b47c195bc9b4dbd7f2b87)
I20260709 13:04:49.097693 19402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36f6ba92b9ba46babe4ebd6c02e5fbd9" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:04:49.072616 20911 consensus_queue.cc:1048] T ff9b0eddd810459b82d91c60777c10eb P 127766fc592545a4997f7790f50f6076 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.040s
I20260709 13:04:49.099138 20829 raft_consensus.cc:493] T 2725d2c4cb054f18b0fc8f735c15f6c2 P e5256d91808b47c195bc9b4dbd7f2b87 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:49.105463 20852 raft_consensus.cc:2749] T 1a61655d99124a29b486ba4a5b37faea P e61c3a8f61bb48f8a963c9480e53c168 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:04:49.112740 20728 raft_consensus.cc:3060] T f93ee515a9c14139bf566522ed8232f3 P e61c3a8f61bb48f8a963c9480e53c168 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:49.096899 20106 raft_consensus.cc:3060] T 14efcc79969f41babe5529c22d59156d P 127766fc592545a4997f7790f50f6076 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:04:49.108037 19551 raft_consensus.cc:2468] T 22196caba61445d3bec98a0aab3c337d P e61c3a8f61bb48f8a963c9480e53c168 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 2.
I20260709 13:04:49.097874 20843 consensus_queue.cc:1048] T 2a16f7501e2444fb86d4e2778e734e02 P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.019s
I20260709 13:04:49.098830 20819 raft_consensus.cc:515] T ef32ce6fdd0e40d382c79974f30295c6 P e5256d91808b47c195bc9b4dbd7f2b87 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:49.121693 20738 raft_consensus.cc:697] T 85c494af21f9457a85da47b9bc70c1fd P e5256d91808b47c195bc9b4dbd7f2b87 [term 2 LEADER]: Becoming Leader. State: Replica: e5256d91808b47c195bc9b4dbd7f2b87, State: Running, Role: LEADER
I20260709 13:04:49.116676 20932 raft_consensus.cc:493] T 86a6797bdfe94fa496c050ceae4bd0d9 P 0473d2b2d01f4459b1e90fd12cc7840e [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:49.114123 20930 raft_consensus.cc:493] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P e5256d91808b47c195bc9b4dbd7f2b87 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:48.839883 19554 rpcz_store.cc:276] 0709 13:04:45.091911 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:45.289997 (+198086us) service_pool.cc:224] Handling call
0709 13:04:45.377403 (+ 87406us) log.cc:844] Serialized 499 byte log entry
0709 13:04:45.490100 (+112697us) spinlock_profiling.cc:243] Waited 1.87 ms on lock 0x7b18003901c0. stack: 00007f4a79de9343 00007f4a79de9240 00007f4a797781d4 00007f4a834b6304 00007f4a834b6299 00007f4a82ce3de1 00007f4a82cf05b1 00007f4a79d95c0a 00007f4a834d5219 00007f4a79e1da40 00007f4a79e184e4 00007f4a79e18455 00007f4a7ce61b0b 00007f4a7cee6b63 00007f4a7cf0e752 00007f4a81eced29
0709 13:04:45.504161 (+ 14061us) spinlock_profiling.cc:243] Waited 2.27 ms on lock 0x7b18003901c0. stack: 00007f4a79de9343 00007f4a79de9240 00007f4a797781d4 00007f4a834b6304 00007f4a834b6299 00007f4a82ce3de1 00007f4a82cf05b1 00007f4a79e1b3f3 00007f4a79e1d7c1 00007f4a79e1d779 00007f4a79e1d709 00007f4a79e1d6d1 00007f4a79e1c9cd 000000000038f354 000000000038f199 00007f4a79dfe83a
0709 13:04:48.759082 (+3254921us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":13979,"raft.queue_time_us":76729,"raft.run_cpu_time_us":2252,"raft.run_wall_time_us":4326,"spinlock_wait_cycles":9516672,"thread_start_us":35945,"threads_started":1,"wal-append.queue_time_us":87893,"wal-append.run_cpu_time_us":1742,"wal-append.run_wall_time_us":1035982}
W20260709 13:04:49.125103 19375 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.3:36891, user_credentials={real_user=slave}} blocked reactor thread for 63513.3us
I20260709 13:04:49.120451 20855 raft_consensus.cc:3060] T 40e1e16737a842ee936002830f36882e P e5256d91808b47c195bc9b4dbd7f2b87 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:04:49.119498 20863 raft_consensus.cc:3060] T 76cb037fc9064d13b59a8969d897ce8c P e61c3a8f61bb48f8a963c9480e53c168 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:49.124646 20829 raft_consensus.cc:3060] T 2725d2c4cb054f18b0fc8f735c15f6c2 P e5256d91808b47c195bc9b4dbd7f2b87 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:04:49.138969 20932 raft_consensus.cc:515] T 86a6797bdfe94fa496c050ceae4bd0d9 P 0473d2b2d01f4459b1e90fd12cc7840e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:49.142872 20844 leader_election.cc:290] T 7be9efa6559648dbb5a0f7684c4542d1 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:04:49.143019 20883 leader_election.cc:290] T 76cb037fc9064d13b59a8969d897ce8c P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:04:49.143595 20883 raft_consensus.cc:493] T 28af091831594f9d8e96482078cc7625 P 0473d2b2d01f4459b1e90fd12cc7840e [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:49.144035 20883 raft_consensus.cc:515] T 28af091831594f9d8e96482078cc7625 P 0473d2b2d01f4459b1e90fd12cc7840e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:49.137246 20930 raft_consensus.cc:3060] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P e5256d91808b47c195bc9b4dbd7f2b87 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:04:49.153723 20828 raft_consensus.cc:493] T fa8650e71aa14778b3d73721fc50d9fc P e5256d91808b47c195bc9b4dbd7f2b87 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:49.154268 20828 raft_consensus.cc:515] T fa8650e71aa14778b3d73721fc50d9fc P e5256d91808b47c195bc9b4dbd7f2b87 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
W20260709 13:04:49.158361 20937 log.cc:927] Time spent T 00000000000000000000000000000000 P 97750b77d35444acb7791ebf26cc2685: Append to log took a long time: real 0.058s	user 0.000s	sys 0.000s
W20260709 13:04:49.170835 19357 auto_rebalancer.cc:629] Failed to schedule move for tablet df751f992649444090e27965eb1af85d: Aborted: Op aborted by new leader
I20260709 13:04:49.170590 20728 raft_consensus.cc:515] T f93ee515a9c14139bf566522ed8232f3 P e61c3a8f61bb48f8a963c9480e53c168 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:49.172703 20728 leader_election.cc:290] T f93ee515a9c14139bf566522ed8232f3 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 2 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:04:49.135532 20785 consensus_queue.cc:1048] T ff9b0eddd810459b82d91c60777c10eb P 127766fc592545a4997f7790f50f6076 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.024s
I20260709 13:04:49.175050 20839 raft_consensus.cc:2749] T a08760e15aac4630a629431f56024dc8 P 0473d2b2d01f4459b1e90fd12cc7840e [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:04:49.175808 19484 raft_consensus.cc:1240] T a08760e15aac4630a629431f56024dc8 P 0473d2b2d01f4459b1e90fd12cc7840e [term 2 FOLLOWER]: Rejecting Update request from peer e61c3a8f61bb48f8a963c9480e53c168 for earlier term 1. Current term is 2. Ops: []
I20260709 13:04:49.112917 20818 raft_consensus.cc:515] T f93ee515a9c14139bf566522ed8232f3 P 0473d2b2d01f4459b1e90fd12cc7840e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:49.177093 20855 raft_consensus.cc:515] T 40e1e16737a842ee936002830f36882e P e5256d91808b47c195bc9b4dbd7f2b87 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:49.177987 20891 raft_consensus.cc:515] T 775c229504194560ba9589bc2199b089 P 127766fc592545a4997f7790f50f6076 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:04:49.178681 20818 leader_election.cc:290] T f93ee515a9c14139bf566522ed8232f3 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:04:49.181104 20883 leader_election.cc:290] T 28af091831594f9d8e96482078cc7625 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:04:49.183825 20803 raft_consensus.cc:2749] T 0e1085d23e8347fbbd5bce7542f4b1f4 P 0473d2b2d01f4459b1e90fd12cc7840e [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:04:49.184626 20805 raft_consensus.cc:515] T 46c5bfeecc314717bffe987e6844b6d0 P 0473d2b2d01f4459b1e90fd12cc7840e [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:49.185614 19480 raft_consensus.cc:1240] T 46c5bfeecc314717bffe987e6844b6d0 P 0473d2b2d01f4459b1e90fd12cc7840e [term 4 FOLLOWER]: Rejecting Update request from peer e61c3a8f61bb48f8a963c9480e53c168 for earlier term 3. Current term is 4. Ops: []
I20260709 13:04:49.187908 20821 leader_election.cc:290] T bc225c93219c45538b53a1bd3d387e4d P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:04:49.188710 20776 leader_election.cc:290] T ab43d85f64114d4ebf618930e43d9ed0 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:04:49.108448 20655 consensus_queue.cc:237] T 833a2f0775ed407a94b8924ce50adb63 P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:04:49.158932 20734 consensus_queue.cc:237] T 1efebf73c86e432baa55533136b6e12c P 127766fc592545a4997f7790f50f6076 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:04:49.159999 20908 leader_election.cc:290] T 7be9efa6559648dbb5a0f7684c4542d1 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:04:49.161127 19554 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40438 (request call id 1159) took 1705 ms. Trace:
I20260709 13:04:49.164161 20864 raft_consensus.cc:2749] T fa8650e71aa14778b3d73721fc50d9fc P e61c3a8f61bb48f8a963c9480e53c168 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:04:49.164688 20733 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 2 current term: 2 is higher.
I20260709 13:04:49.168409 20106 raft_consensus.cc:2468] T 14efcc79969f41babe5529c22d59156d P 127766fc592545a4997f7790f50f6076 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 4.
I20260709 13:04:49.159410 20867 consensus_queue.cc:1048] T 2a16f7501e2444fb86d4e2778e734e02 P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Connected to new peer: Peer: permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.010s
I20260709 13:04:49.169874 20737 raft_consensus.cc:515] T 833a2f0775ed407a94b8924ce50adb63 P 127766fc592545a4997f7790f50f6076 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:04:49.204232 19405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76cb037fc9064d13b59a8969d897ce8c" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:04:49.204005 20819 leader_election.cc:290] T ef32ce6fdd0e40d382c79974f30295c6 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:04:49.204869 19405 raft_consensus.cc:2468] T 76cb037fc9064d13b59a8969d897ce8c P e5256d91808b47c195bc9b4dbd7f2b87 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 2.
I20260709 13:04:49.205416 20864 consensus_queue.cc:1059] T 46c5bfeecc314717bffe987e6844b6d0 P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:04:49.205888 20737 leader_election.cc:290] T 833a2f0775ed407a94b8924ce50adb63 P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 2 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:04:49.206228 20864 raft_consensus.cc:3055] T 46c5bfeecc314717bffe987e6844b6d0 P e61c3a8f61bb48f8a963c9480e53c168 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:04:49.206594 20864 raft_consensus.cc:740] T 46c5bfeecc314717bffe987e6844b6d0 P e61c3a8f61bb48f8a963c9480e53c168 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: e61c3a8f61bb48f8a963c9480e53c168, State: Running, Role: LEADER
I20260709 13:04:49.206614 19478 raft_consensus.cc:2468] T 62c6c134d3d24a1ab144dd9ee6bc3f64 P 0473d2b2d01f4459b1e90fd12cc7840e [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 127766fc592545a4997f7790f50f6076 in term 3.
I20260709 13:04:49.207456 20864 consensus_queue.cc:260] T 46c5bfeecc314717bffe987e6844b6d0 P e61c3a8f61bb48f8a963c9480e53c168 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:49.188072 20930 raft_consensus.cc:515] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P e5256d91808b47c195bc9b4dbd7f2b87 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:04:49.210690 20906 raft_consensus.cc:2749] T 14efcc79969f41babe5529c22d59156d P 0473d2b2d01f4459b1e90fd12cc7840e [term 4 FOLLOWER]: Leader election lost for term 3. Reason: Vote denied by peer e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321) with higher term. Message: Invalid argument: T 14efcc79969f41babe5529c22d59156d P e5256d91808b47c195bc9b4dbd7f2b87 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 0473d2b2d01f4459b1e90fd12cc7840e for earlier term 3. Current term is 4.
I20260709 13:04:49.211510 19402 raft_consensus.cc:2393] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P e5256d91808b47c195bc9b4dbd7f2b87 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 127766fc592545a4997f7790f50f6076 in current term 4: Already voted for candidate e5256d91808b47c195bc9b4dbd7f2b87 in this term.
I20260709 13:04:49.212029 20776 raft_consensus.cc:493] T ff75a1d4cb1f493db8f71ddc136ba9ab P e5256d91808b47c195bc9b4dbd7f2b87 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:49.159477 20738 consensus_queue.cc:237] T 85c494af21f9457a85da47b9bc70c1fd P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:04:49.213095 20110 raft_consensus.cc:3060] T 833a2f0775ed407a94b8924ce50adb63 P 127766fc592545a4997f7790f50f6076 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:04:49.145098 20860 raft_consensus.cc:515] T ed7fdbcb96d14d418db9ca90a792588a P 0473d2b2d01f4459b1e90fd12cc7840e [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:04:49.216570 19377 leader_election.cc:304] T 22196caba61445d3bec98a0aab3c337d P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87; no voters: 
I20260709 13:04:49.201434 20941 consensus_queue.cc:1059] T a08760e15aac4630a629431f56024dc8 P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:04:49.202406 19404 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2a16f7501e2444fb86d4e2778e734e02"
dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
mode: GRACEFUL
new_leader_uuid: "127766fc592545a4997f7790f50f6076"
 from {username='slave'} at 127.0.0.1:37312
I20260709 13:04:49.208719 20932 leader_election.cc:290] T 86a6797bdfe94fa496c050ceae4bd0d9 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:04:49.203083 20913 raft_consensus.cc:515] T ece3db938bc649d4a40a51522ed5259c P 127766fc592545a4997f7790f50f6076 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:04:49.209781 19480 raft_consensus.cc:1240] T 62c6c134d3d24a1ab144dd9ee6bc3f64 P 0473d2b2d01f4459b1e90fd12cc7840e [term 3 FOLLOWER]: Rejecting Update request from peer e61c3a8f61bb48f8a963c9480e53c168 for earlier term 2. Current term is 3. Ops: []
I20260709 13:04:49.199632 19484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f93ee515a9c14139bf566522ed8232f3" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:04:49.227231 19484 raft_consensus.cc:2393] T f93ee515a9c14139bf566522ed8232f3 P 0473d2b2d01f4459b1e90fd12cc7840e [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate e61c3a8f61bb48f8a963c9480e53c168 in current term 2: Already voted for candidate 0473d2b2d01f4459b1e90fd12cc7840e in this term.
I20260709 13:04:49.200587 20828 leader_election.cc:290] T fa8650e71aa14778b3d73721fc50d9fc P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:04:49.220395 19377 leader_election.cc:304] T 0cdf56e38bbc453d9438d359e5a69955 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:04:49.210701 20864 raft_consensus.cc:3060] T 46c5bfeecc314717bffe987e6844b6d0 P e61c3a8f61bb48f8a963c9480e53c168 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:04:49.239148 19485 raft_consensus.cc:1240] T ed7fdbcb96d14d418db9ca90a792588a P 0473d2b2d01f4459b1e90fd12cc7840e [term 3 FOLLOWER]: Rejecting Update request from peer 127766fc592545a4997f7790f50f6076 for earlier term 2. Current term is 3. Ops: [2.5-2.5]
I20260709 13:04:49.241089 19409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86a6797bdfe94fa496c050ceae4bd0d9" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:04:49.219328 20855 leader_election.cc:290] T 40e1e16737a842ee936002830f36882e P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 4 election: Requested vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:04:49.243621 19409 raft_consensus.cc:2468] T 86a6797bdfe94fa496c050ceae4bd0d9 P e5256d91808b47c195bc9b4dbd7f2b87 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 2.
I20260709 13:04:49.223840 20853 raft_consensus.cc:2749] T ef32ce6fdd0e40d382c79974f30295c6 P e61c3a8f61bb48f8a963c9480e53c168 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:04:49.198141 19554 rpcz_store.cc:276] 0709 13:04:47.455556 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:47.455692 (+   136us) service_pool.cc:224] Handling call
0709 13:04:47.455978 (+   286us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:04:48.353555 (+897577us) spinlock_profiling.cc:243] Waited 57.5 ms on lock 0x7b54003776a0. stack: 00007f4a79de9343 00007f4a79de9240 00007f4a797781d4 00007f4a834b6304 00007f4a834b6299 00007f4a7ce71571 00007f4a7ce7fdc0 00007f4a7cf0a1c0 00007f4a7cf0b231 00007f4a7cf07d8f 00007f4a7cf0783e 00007f4a81ecc419 00007f4a7b443bd4 00007f4a7b443b62 00007f4a7b443a91 00007f4a7b443a0c
0709 13:04:49.160845 (+807290us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:49.161067 (+   222us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":132279168}
I20260709 13:04:49.212509 20776 raft_consensus.cc:515] T ff75a1d4cb1f493db8f71ddc136ba9ab P e5256d91808b47c195bc9b4dbd7f2b87 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
W20260709 13:04:49.251574 19525 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:49.219511 20716 raft_consensus.cc:697] T edd7d470b5014c9489be7f41f64355c9 P 0473d2b2d01f4459b1e90fd12cc7840e [term 3 LEADER]: Becoming Leader. State: Replica: 0473d2b2d01f4459b1e90fd12cc7840e, State: Running, Role: LEADER
I20260709 13:04:49.257565 20716 consensus_queue.cc:237] T edd7d470b5014c9489be7f41f64355c9 P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:49.258097 19449 leader_election.cc:304] T 76cb037fc9064d13b59a8969d897ce8c P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87; no voters: 
I20260709 13:04:49.228051 19404 raft_consensus.cc:606] T 2a16f7501e2444fb86d4e2778e734e02 P e5256d91808b47c195bc9b4dbd7f2b87 [term 4 LEADER]: Received request to transfer leadership to TS 127766fc592545a4997f7790f50f6076
I20260709 13:04:49.255947 20863 raft_consensus.cc:515] T 76cb037fc9064d13b59a8969d897ce8c P e61c3a8f61bb48f8a963c9480e53c168 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:49.252194 20942 raft_consensus.cc:493] T a08760e15aac4630a629431f56024dc8 P e5256d91808b47c195bc9b4dbd7f2b87 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:04:49.253990 19525 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:49.236083 20833 raft_consensus.cc:2804] T 22196caba61445d3bec98a0aab3c337d P e5256d91808b47c195bc9b4dbd7f2b87 [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 13:04:49.267151 19377 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.2:46257, user_credentials={real_user=slave}} blocked reactor thread for 46848.7us
W20260709 13:04:49.267242 19523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.1:40321, user_credentials={real_user=slave}} blocked reactor thread for 220934us
I20260709 13:04:49.269528 19409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f93ee515a9c14139bf566522ed8232f3" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:04:49.276580 19409 raft_consensus.cc:2468] T f93ee515a9c14139bf566522ed8232f3 P e5256d91808b47c195bc9b4dbd7f2b87 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 2.
W20260709 13:04:49.276813 19450 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.3:36891, user_credentials={real_user=slave}} blocked reactor thread for 178411us
I20260709 13:04:49.243379 20828 raft_consensus.cc:493] T 1dc5b3532fe54f74876d02beffa2c230 P e5256d91808b47c195bc9b4dbd7f2b87 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:49.265652 19449 leader_election.cc:304] T 86a6797bdfe94fa496c050ceae4bd0d9 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87; no voters: 
W20260709 13:04:49.270427 20835 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.523s	user 0.005s	sys 0.021s
I20260709 13:04:49.288337 20078 leader_election.cc:304] T 62c6c134d3d24a1ab144dd9ee6bc3f64 P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, 127766fc592545a4997f7790f50f6076; no voters: 
I20260709 13:04:49.292838 19449 leader_election.cc:304] T f93ee515a9c14139bf566522ed8232f3 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87; no voters: 
I20260709 13:04:49.268111 19403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef32ce6fdd0e40d382c79974f30295c6" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:04:49.299058 20818 raft_consensus.cc:2804] T 86a6797bdfe94fa496c050ceae4bd0d9 P 0473d2b2d01f4459b1e90fd12cc7840e [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:04:49.316816 20818 raft_consensus.cc:493] T 86a6797bdfe94fa496c050ceae4bd0d9 P 0473d2b2d01f4459b1e90fd12cc7840e [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:49.317278 20818 raft_consensus.cc:3060] T 86a6797bdfe94fa496c050ceae4bd0d9 P 0473d2b2d01f4459b1e90fd12cc7840e [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:04:49.318230 20883 raft_consensus.cc:493] T fa8650e71aa14778b3d73721fc50d9fc P 0473d2b2d01f4459b1e90fd12cc7840e [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:49.318934 19403 raft_consensus.cc:2468] T ef32ce6fdd0e40d382c79974f30295c6 P e5256d91808b47c195bc9b4dbd7f2b87 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 2.
I20260709 13:04:49.318984 20883 raft_consensus.cc:515] T fa8650e71aa14778b3d73721fc50d9fc P 0473d2b2d01f4459b1e90fd12cc7840e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:49.321859 20883 leader_election.cc:290] T fa8650e71aa14778b3d73721fc50d9fc P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:04:49.323442 20860 leader_election.cc:290] T ed7fdbcb96d14d418db9ca90a792588a P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 3 election: Requested vote from peers e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:04:49.324590 20860 raft_consensus.cc:2804] T f93ee515a9c14139bf566522ed8232f3 P 0473d2b2d01f4459b1e90fd12cc7840e [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:04:49.324929 20860 raft_consensus.cc:493] T f93ee515a9c14139bf566522ed8232f3 P 0473d2b2d01f4459b1e90fd12cc7840e [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:49.325250 20860 raft_consensus.cc:3060] T f93ee515a9c14139bf566522ed8232f3 P 0473d2b2d01f4459b1e90fd12cc7840e [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:04:49.329183 19486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40e1e16737a842ee936002830f36882e" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:04:49.330061 19484 raft_consensus.cc:1240] T 0e1085d23e8347fbbd5bce7542f4b1f4 P 0473d2b2d01f4459b1e90fd12cc7840e [term 3 FOLLOWER]: Rejecting Update request from peer 127766fc592545a4997f7790f50f6076 for earlier term 2. Current term is 3. Ops: []
I20260709 13:04:49.319013 19409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46c5bfeecc314717bffe987e6844b6d0" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 4 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
I20260709 13:04:49.335381 19409 raft_consensus.cc:3060] T 46c5bfeecc314717bffe987e6844b6d0 P e5256d91808b47c195bc9b4dbd7f2b87 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:04:49.331158 19479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff9b0eddd810459b82d91c60777c10eb" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:04:49.299583 19523 leader_election.cc:304] T 86a6797bdfe94fa496c050ceae4bd0d9 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168; no voters: 0473d2b2d01f4459b1e90fd12cc7840e
I20260709 13:04:49.271380 20935 raft_consensus.cc:2804] T 76cb037fc9064d13b59a8969d897ce8c P 0473d2b2d01f4459b1e90fd12cc7840e [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:04:49.333541 19449 leader_election.cc:304] T ef32ce6fdd0e40d382c79974f30295c6 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87; no voters: 
I20260709 13:04:49.275647 20833 raft_consensus.cc:493] T 22196caba61445d3bec98a0aab3c337d P e5256d91808b47c195bc9b4dbd7f2b87 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:49.275087 20855 raft_consensus.cc:2749] T 0cdf56e38bbc453d9438d359e5a69955 P e5256d91808b47c195bc9b4dbd7f2b87 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:04:49.347019 19484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab43d85f64114d4ebf618930e43d9ed0" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
W20260709 13:04:49.337512 19525 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:49.337672 20110 raft_consensus.cc:2468] T 833a2f0775ed407a94b8924ce50adb63 P 127766fc592545a4997f7790f50f6076 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 3.
I20260709 13:04:49.328934 19485 consensus_queue.cc:237] T 14935b3ddf914369822e4a0547aaa355 P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } attrs { replace: true } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: NON_VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: true } }
I20260709 13:04:49.263219 20876 raft_consensus.cc:515] T 28af091831594f9d8e96482078cc7625 P e61c3a8f61bb48f8a963c9480e53c168 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:49.327652 20106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed7fdbcb96d14d418db9ca90a792588a" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076"
I20260709 13:04:49.357707 19374 leader_election.cc:304] T 14efcc79969f41babe5529c22d59156d P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 127766fc592545a4997f7790f50f6076, e5256d91808b47c195bc9b4dbd7f2b87; no voters: 0473d2b2d01f4459b1e90fd12cc7840e
W20260709 13:04:49.289906 20835 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.548s	user 0.005s	sys 0.022s
I20260709 13:04:49.346185 19405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7be9efa6559648dbb5a0f7684c4542d1" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:04:49.351496 19484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7be9efa6559648dbb5a0f7684c4542d1" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:04:49.359469 19484 raft_consensus.cc:2468] T 7be9efa6559648dbb5a0f7684c4542d1 P 0473d2b2d01f4459b1e90fd12cc7840e [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 2.
I20260709 13:04:49.330361 20785 raft_consensus.cc:2804] T 62c6c134d3d24a1ab144dd9ee6bc3f64 P 127766fc592545a4997f7790f50f6076 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:04:49.355373 19523 leader_election.cc:304] T 833a2f0775ed407a94b8924ce50adb63 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:04:49.393339 19523 leader_election.cc:304] T 70797e5783b5454ab0d0eea663e791e3 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168; no voters: 127766fc592545a4997f7790f50f6076
I20260709 13:04:49.394374 19523 leader_election.cc:304] T ece3db938bc649d4a40a51522ed5259c P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168; no voters: 127766fc592545a4997f7790f50f6076
I20260709 13:04:49.357059 19410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "833a2f0775ed407a94b8924ce50adb63" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
I20260709 13:04:49.299767 19552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7be9efa6559648dbb5a0f7684c4542d1" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:04:49.299983 20885 raft_consensus.cc:493] T 96efeaaf1057492490e9a621f37e1a2d P e61c3a8f61bb48f8a963c9480e53c168 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 127766fc592545a4997f7790f50f6076)
I20260709 13:04:49.285218 20873 consensus_queue.cc:1059] T 0cdf56e38bbc453d9438d359e5a69955 P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.069s
I20260709 13:04:49.322505 20883 raft_consensus.cc:493] T bc225c93219c45538b53a1bd3d387e4d P 0473d2b2d01f4459b1e90fd12cc7840e [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:49.290207 20828 raft_consensus.cc:515] T 1dc5b3532fe54f74876d02beffa2c230 P e5256d91808b47c195bc9b4dbd7f2b87 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:49.341779 20935 raft_consensus.cc:493] T 76cb037fc9064d13b59a8969d897ce8c P 0473d2b2d01f4459b1e90fd12cc7840e [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:49.352293 19486 raft_consensus.cc:2468] T 40e1e16737a842ee936002830f36882e P 0473d2b2d01f4459b1e90fd12cc7840e [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 3.
I20260709 13:04:49.335150 20808 raft_consensus.cc:493] T b08304a0a02b42d7840c4e8ee9a6bd1a P 0473d2b2d01f4459b1e90fd12cc7840e [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:49.352212 20833 raft_consensus.cc:3060] T 22196caba61445d3bec98a0aab3c337d P e5256d91808b47c195bc9b4dbd7f2b87 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:04:49.404064 19482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa8650e71aa14778b3d73721fc50d9fc" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:04:49.422272 19482 raft_consensus.cc:2468] T fa8650e71aa14778b3d73721fc50d9fc P 0473d2b2d01f4459b1e90fd12cc7840e [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 2.
I20260709 13:04:49.423273 19482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc225c93219c45538b53a1bd3d387e4d" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:04:49.330502 20897 consensus_queue.cc:1059] T ed7fdbcb96d14d418db9ca90a792588a P 127766fc592545a4997f7790f50f6076 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.055s
I20260709 13:04:49.359035 19405 raft_consensus.cc:2468] T 7be9efa6559648dbb5a0f7684c4542d1 P e5256d91808b47c195bc9b4dbd7f2b87 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 2.
I20260709 13:04:49.277020 20942 raft_consensus.cc:515] T a08760e15aac4630a629431f56024dc8 P e5256d91808b47c195bc9b4dbd7f2b87 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:49.361114 20940 raft_consensus.cc:2804] T ef32ce6fdd0e40d382c79974f30295c6 P 0473d2b2d01f4459b1e90fd12cc7840e [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:04:49.356240 20934 raft_consensus.cc:493] T 309c3ca0ca4b4f3ba129752ea2cb293b P 0473d2b2d01f4459b1e90fd12cc7840e [term 3 FOLLOWER]: Starting pre-election (detected failure of leader e61c3a8f61bb48f8a963c9480e53c168)
I20260709 13:04:49.343917 20853 raft_consensus.cc:2804] T 86a6797bdfe94fa496c050ceae4bd0d9 P e61c3a8f61bb48f8a963c9480e53c168 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:04:49.417941 20852 raft_consensus.cc:2764] T 70797e5783b5454ab0d0eea663e791e3 P e61c3a8f61bb48f8a963c9480e53c168 [term 3 FOLLOWER]: Leader pre-election decision vote started in defunct term 1: won
I20260709 13:04:49.359866 19403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa8650e71aa14778b3d73721fc50d9fc" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:04:49.399130 20824 raft_consensus.cc:2804] T 14efcc79969f41babe5529c22d59156d P e5256d91808b47c195bc9b4dbd7f2b87 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:04:49.343683 20746 consensus_queue.cc:1048] T df751f992649444090e27965eb1af85d P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.062s
I20260709 13:04:49.403240 20879 raft_consensus.cc:2764] T 833a2f0775ed407a94b8924ce50adb63 P e61c3a8f61bb48f8a963c9480e53c168 [term 3 FOLLOWER]: Leader pre-election decision vote started in defunct term 2: won
I20260709 13:04:49.407045 20805 leader_election.cc:290] T 46c5bfeecc314717bffe987e6844b6d0 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 4 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:04:49.449142 20853 raft_consensus.cc:493] T 86a6797bdfe94fa496c050ceae4bd0d9 P e61c3a8f61bb48f8a963c9480e53c168 [term 1 FOLLOWER]: Starting leader election (detected failure of leader e5256d91808b47c195bc9b4dbd7f2b87)
I20260709 13:04:49.402545 20754 consensus_queue.cc:1059] T edd7d470b5014c9489be7f41f64355c9 P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.022s
I20260709 13:04:49.424494 20808 raft_consensus.cc:515] T b08304a0a02b42d7840c4e8ee9a6bd1a P 0473d2b2d01f4459b1e90fd12cc7840e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:49.406767 20885 raft_consensus.cc:3060] T 96efeaaf1057492490e9a621f37e1a2d P e61c3a8f61bb48f8a963c9480e53c168 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:04:49.411036 19552 raft_consensus.cc:2468] T 7be9efa6559648dbb5a0f7684c4542d1 P e61c3a8f61bb48f8a963c9480e53c168 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 1.
I20260709 13:04:49.454348 19449 leader_election.cc:304] T 7be9efa6559648dbb5a0f7684c4542d1 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87; no voters: 
I20260709 13:04:49.415542 20785 raft_consensus.cc:697] T 62c6c134d3d24a1ab144dd9ee6bc3f64 P 127766fc592545a4997f7790f50f6076 [term 3 LEADER]: Becoming Leader. State: Replica: 127766fc592545a4997f7790f50f6076, State: Running, Role: LEADER
I20260709 13:04:49.465757 20943 raft_consensus.cc:493] T ff75a1d4cb1f493db8f71ddc136ba9ab P 0473d2b2d01f4459b1e90fd12cc7840e [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:49.425443 20819 raft_consensus.cc:493] T 28af091831594f9d8e96482078cc7625 P e5256d91808b47c195bc9b4dbd7f2b87 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:49.512290 20913 leader_election.cc:290] T ece3db938bc649d4a40a51522ed5259c P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 3 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:04:49.399552 20929 consensus_queue.cc:1059] T ab43d85f64114d4ebf618930e43d9ed0 P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } attrs { replace: true }, Status: INVALID_TERM, Last received: 1.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.032s
I20260709 13:04:49.500442 20824 raft_consensus.cc:697] T 14efcc79969f41babe5529c22d59156d P e5256d91808b47c195bc9b4dbd7f2b87 [term 4 LEADER]: Becoming Leader. State: Replica: e5256d91808b47c195bc9b4dbd7f2b87, State: Running, Role: LEADER
I20260709 13:04:49.425673 20940 raft_consensus.cc:493] T ef32ce6fdd0e40d382c79974f30295c6 P 0473d2b2d01f4459b1e90fd12cc7840e [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:49.452425 20737 raft_consensus.cc:3055] T ed7fdbcb96d14d418db9ca90a792588a P 127766fc592545a4997f7790f50f6076 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:04:49.416581 19555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc225c93219c45538b53a1bd3d387e4d" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:04:49.514472 20910 consensus_queue.cc:1059] T 0e1085d23e8347fbbd5bce7542f4b1f4 P 127766fc592545a4997f7790f50f6076 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.031s
W20260709 13:04:49.500938 19523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.1:40321, user_credentials={real_user=slave}} blocked reactor thread for 106613us
I20260709 13:04:49.538923 20805 raft_consensus.cc:2804] T 7be9efa6559648dbb5a0f7684c4542d1 P 0473d2b2d01f4459b1e90fd12cc7840e [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:04:49.417865 20935 raft_consensus.cc:3060] T 76cb037fc9064d13b59a8969d897ce8c P 0473d2b2d01f4459b1e90fd12cc7840e [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:04:49.420931 20930 leader_election.cc:290] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 4 election: Requested vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
W20260709 13:04:49.533565 19449 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.1:40321, user_credentials={real_user=slave}} blocked reactor thread for 79285us
I20260709 13:04:49.502085 19486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40e1e16737a842ee936002830f36882e" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:04:49.497521 20884 raft_consensus.cc:493] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P 0473d2b2d01f4459b1e90fd12cc7840e [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 127766fc592545a4997f7790f50f6076)
I20260709 13:04:49.498660 20944 raft_consensus.cc:2804] T ece3db938bc649d4a40a51522ed5259c P e61c3a8f61bb48f8a963c9480e53c168 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:04:49.592483 20828 leader_election.cc:290] T 1dc5b3532fe54f74876d02beffa2c230 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:04:49.592721 20944 raft_consensus.cc:493] T ece3db938bc649d4a40a51522ed5259c P e61c3a8f61bb48f8a963c9480e53c168 [term 1 FOLLOWER]: Starting leader election (detected failure of leader e5256d91808b47c195bc9b4dbd7f2b87)
I20260709 13:04:49.593135 20944 raft_consensus.cc:3060] T ece3db938bc649d4a40a51522ed5259c P e61c3a8f61bb48f8a963c9480e53c168 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:49.498916 20906 raft_consensus.cc:493] T 4509b76741dc428e9201c70c1658da13 P 0473d2b2d01f4459b1e90fd12cc7840e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e5256d91808b47c195bc9b4dbd7f2b87)
I20260709 13:04:49.424099 20891 leader_election.cc:290] T 775c229504194560ba9589bc2199b089 P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 2 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
W20260709 13:04:49.517681 20951 log.cc:927] Time spent T 833a2f0775ed407a94b8924ce50adb63 P e5256d91808b47c195bc9b4dbd7f2b87: Append to log took a long time: real 0.052s	user 0.000s	sys 0.001s
W20260709 13:04:49.517875 20952 log.cc:927] Time spent T f1b10566f45d4a7d9029858330e02d5b P e61c3a8f61bb48f8a963c9480e53c168: Append to log took a long time: real 0.112s	user 0.000s	sys 0.008s
I20260709 13:04:49.516396 20853 raft_consensus.cc:3060] T 86a6797bdfe94fa496c050ceae4bd0d9 P e61c3a8f61bb48f8a963c9480e53c168 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:49.415079 20883 raft_consensus.cc:515] T bc225c93219c45538b53a1bd3d387e4d P 0473d2b2d01f4459b1e90fd12cc7840e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:49.460589 20934 raft_consensus.cc:515] T 309c3ca0ca4b4f3ba129752ea2cb293b P 0473d2b2d01f4459b1e90fd12cc7840e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } attrs { replace: true } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: NON_VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: true } }
I20260709 13:04:49.517644 20776 leader_election.cc:290] T ff75a1d4cb1f493db8f71ddc136ba9ab P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:04:49.516664 19553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa8650e71aa14778b3d73721fc50d9fc" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:04:49.511402 19403 raft_consensus.cc:2468] T fa8650e71aa14778b3d73721fc50d9fc P e5256d91808b47c195bc9b4dbd7f2b87 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 2.
I20260709 13:04:49.534206 19477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36f6ba92b9ba46babe4ebd6c02e5fbd9" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:04:49.496049 20642 raft_consensus.cc:493] T 309c3ca0ca4b4f3ba129752ea2cb293b P e5256d91808b47c195bc9b4dbd7f2b87 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:49.550072 20879 raft_consensus.cc:3055] T ab43d85f64114d4ebf618930e43d9ed0 P e61c3a8f61bb48f8a963c9480e53c168 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:04:49.634634 20879 raft_consensus.cc:740] T ab43d85f64114d4ebf618930e43d9ed0 P e61c3a8f61bb48f8a963c9480e53c168 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e61c3a8f61bb48f8a963c9480e53c168, State: Running, Role: LEADER
I20260709 13:04:49.634809 19553 raft_consensus.cc:2468] T fa8650e71aa14778b3d73721fc50d9fc P e61c3a8f61bb48f8a963c9480e53c168 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 2.
W20260709 13:04:49.635174 20946 log.cc:927] Time spent T 9962423cb4e54fcfa5de01daf68a86e7 P 0473d2b2d01f4459b1e90fd12cc7840e: Append to log took a long time: real 0.117s	user 0.000s	sys 0.000s
I20260709 13:04:49.635944 19553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46c5bfeecc314717bffe987e6844b6d0" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 4 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:04:49.553290 20910 raft_consensus.cc:3055] T 0e1085d23e8347fbbd5bce7542f4b1f4 P 127766fc592545a4997f7790f50f6076 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:04:49.551299 19555 raft_consensus.cc:2468] T bc225c93219c45538b53a1bd3d387e4d P e61c3a8f61bb48f8a963c9480e53c168 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 1.
I20260709 13:04:49.544525 20863 leader_election.cc:290] T 76cb037fc9064d13b59a8969d897ce8c P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 2 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:04:49.585157 19552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28af091831594f9d8e96482078cc7625" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:04:49.585345 20785 consensus_queue.cc:237] T 62c6c134d3d24a1ab144dd9ee6bc3f64 P 127766fc592545a4997f7790f50f6076 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:04:49.585726 20876 leader_election.cc:290] T 28af091831594f9d8e96482078cc7625 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 2 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:04:49.587070 20942 leader_election.cc:290] T a08760e15aac4630a629431f56024dc8 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:04:49.615968 20818 raft_consensus.cc:515] T 86a6797bdfe94fa496c050ceae4bd0d9 P 0473d2b2d01f4459b1e90fd12cc7840e [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:49.542971 20943 raft_consensus.cc:515] T ff75a1d4cb1f493db8f71ddc136ba9ab P 0473d2b2d01f4459b1e90fd12cc7840e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:49.591305 19523 leader_election.cc:304] T 7be9efa6559648dbb5a0f7684c4542d1 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168; no voters: 0473d2b2d01f4459b1e90fd12cc7840e
W20260709 13:04:49.653244 19523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.1:40321, user_credentials={real_user=slave}} blocked reactor thread for 62051.3us
I20260709 13:04:49.591498 20939 consensus_queue.cc:1059] T a08760e15aac4630a629431f56024dc8 P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:04:49.550410 20737 raft_consensus.cc:740] T ed7fdbcb96d14d418db9ca90a792588a P 127766fc592545a4997f7790f50f6076 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 127766fc592545a4997f7790f50f6076, State: Running, Role: LEADER
I20260709 13:04:49.579399 20929 consensus_queue.cc:1048] T 309c3ca0ca4b4f3ba129752ea2cb293b P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.013s
I20260709 13:04:49.602314 19409 raft_consensus.cc:2468] T 46c5bfeecc314717bffe987e6844b6d0 P e5256d91808b47c195bc9b4dbd7f2b87 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 4.
I20260709 13:04:49.619055 20906 raft_consensus.cc:515] T 4509b76741dc428e9201c70c1658da13 P 0473d2b2d01f4459b1e90fd12cc7840e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:49.550343 20940 raft_consensus.cc:3060] T ef32ce6fdd0e40d382c79974f30295c6 P 0473d2b2d01f4459b1e90fd12cc7840e [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:04:49.554091 20805 raft_consensus.cc:493] T 7be9efa6559648dbb5a0f7684c4542d1 P 0473d2b2d01f4459b1e90fd12cc7840e [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:04:49.616592 20953 log.cc:927] Time spent T 309c3ca0ca4b4f3ba129752ea2cb293b P 0473d2b2d01f4459b1e90fd12cc7840e: Append to log took a long time: real 0.063s	user 0.000s	sys 0.001s
I20260709 13:04:49.598122 19486 raft_consensus.cc:3060] T 40e1e16737a842ee936002830f36882e P 0473d2b2d01f4459b1e90fd12cc7840e [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:04:49.544617 20819 raft_consensus.cc:515] T 28af091831594f9d8e96482078cc7625 P e5256d91808b47c195bc9b4dbd7f2b87 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:49.637451 19482 raft_consensus.cc:2468] T bc225c93219c45538b53a1bd3d387e4d P 0473d2b2d01f4459b1e90fd12cc7840e [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 2.
I20260709 13:04:49.635644 20879 consensus_queue.cc:260] T ab43d85f64114d4ebf618930e43d9ed0 P e61c3a8f61bb48f8a963c9480e53c168 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } attrs { replace: true } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: NON_VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: true } }
I20260709 13:04:49.586797 20884 raft_consensus.cc:515] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P 0473d2b2d01f4459b1e90fd12cc7840e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:04:49.648869 19555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86a6797bdfe94fa496c050ceae4bd0d9" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:04:49.616246 20829 raft_consensus.cc:515] T 2725d2c4cb054f18b0fc8f735c15f6c2 P e5256d91808b47c195bc9b4dbd7f2b87 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:49.660005 19523 leader_election.cc:304] T fa731b585f684a7fb2d106c50f143b83 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e61c3a8f61bb48f8a963c9480e53c168; no voters: 127766fc592545a4997f7790f50f6076, e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:04:49.640569 20910 raft_consensus.cc:740] T 0e1085d23e8347fbbd5bce7542f4b1f4 P 127766fc592545a4997f7790f50f6076 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 127766fc592545a4997f7790f50f6076, State: Running, Role: LEADER
I20260709 13:04:49.650707 19552 raft_consensus.cc:2468] T 28af091831594f9d8e96482078cc7625 P e61c3a8f61bb48f8a963c9480e53c168 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 2.
I20260709 13:04:49.673477 19411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28af091831594f9d8e96482078cc7625" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:04:49.661878 20733 raft_consensus.cc:2804] T 7be9efa6559648dbb5a0f7684c4542d1 P e61c3a8f61bb48f8a963c9480e53c168 [term 1 FOLLOWER]: Leader pre-election won for term 2
W20260709 13:04:49.674516 19524 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:49.664018 20805 raft_consensus.cc:3060] T 7be9efa6559648dbb5a0f7684c4542d1 P 0473d2b2d01f4459b1e90fd12cc7840e [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:04:49.677660 19411 raft_consensus.cc:2468] T 28af091831594f9d8e96482078cc7625 P e5256d91808b47c195bc9b4dbd7f2b87 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 2.
I20260709 13:04:49.676326 19523 leader_election.cc:304] T 0e1085d23e8347fbbd5bce7542f4b1f4 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e61c3a8f61bb48f8a963c9480e53c168; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, 127766fc592545a4997f7790f50f6076
I20260709 13:04:49.678867 19523 leader_election.cc:304] T 4af19371ea874c09a0a2147040835cbb P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e61c3a8f61bb48f8a963c9480e53c168; no voters: 127766fc592545a4997f7790f50f6076, e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:04:49.680161 19556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa8650e71aa14778b3d73721fc50d9fc" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:04:49.680776 19556 raft_consensus.cc:2468] T fa8650e71aa14778b3d73721fc50d9fc P e61c3a8f61bb48f8a963c9480e53c168 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 2.
I20260709 13:04:49.681730 19556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7be9efa6559648dbb5a0f7684c4542d1" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:04:49.681981 19450 leader_election.cc:304] T fa8650e71aa14778b3d73721fc50d9fc P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:04:49.643029 20642 raft_consensus.cc:515] T 309c3ca0ca4b4f3ba129752ea2cb293b P e5256d91808b47c195bc9b4dbd7f2b87 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } attrs { replace: true } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: NON_VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: true } }
I20260709 13:04:49.646286 20824 consensus_queue.cc:237] T 14efcc79969f41babe5529c22d59156d P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:04:49.688304 20109 raft_consensus.cc:1240] T 85c494af21f9457a85da47b9bc70c1fd P 127766fc592545a4997f7790f50f6076 [term 2 FOLLOWER]: Rejecting Update request from peer e61c3a8f61bb48f8a963c9480e53c168 for earlier term 1. Current term is 2. Ops: []
I20260709 13:04:49.694685 20112 raft_consensus.cc:1217] T ab43d85f64114d4ebf618930e43d9ed0 P 127766fc592545a4997f7790f50f6076 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:04:49.695832 19483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "775c229504194560ba9589bc2199b089" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:04:49.696622 19483 raft_consensus.cc:2393] T 775c229504194560ba9589bc2199b089 P 0473d2b2d01f4459b1e90fd12cc7840e [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 127766fc592545a4997f7790f50f6076 in current term 2: Already voted for candidate 0473d2b2d01f4459b1e90fd12cc7840e in this term.
I20260709 13:04:49.699312 19483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef32ce6fdd0e40d382c79974f30295c6" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:04:49.677860 20939 raft_consensus.cc:2749] T fa731b585f684a7fb2d106c50f143b83 P e61c3a8f61bb48f8a963c9480e53c168 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:04:49.697641 20962 raft_consensus.cc:493] T ff75a1d4cb1f493db8f71ddc136ba9ab P e61c3a8f61bb48f8a963c9480e53c168 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0473d2b2d01f4459b1e90fd12cc7840e)
I20260709 13:04:49.684540 20876 raft_consensus.cc:2749] T 0e1085d23e8347fbbd5bce7542f4b1f4 P e61c3a8f61bb48f8a963c9480e53c168 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:04:49.684700 19477 raft_consensus.cc:3060] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P 0473d2b2d01f4459b1e90fd12cc7840e [term 2 FOLLOWER]: Advancing to term 4
I20260709 13:04:49.677484 20733 raft_consensus.cc:493] T 7be9efa6559648dbb5a0f7684c4542d1 P e61c3a8f61bb48f8a963c9480e53c168 [term 1 FOLLOWER]: Starting leader election (detected failure of leader e5256d91808b47c195bc9b4dbd7f2b87)
I20260709 13:04:49.688069 20863 raft_consensus.cc:2749] T 4af19371ea874c09a0a2147040835cbb P e61c3a8f61bb48f8a963c9480e53c168 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:04:49.684047 20879 raft_consensus.cc:3060] T ab43d85f64114d4ebf618930e43d9ed0 P e61c3a8f61bb48f8a963c9480e53c168 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:49.709100 20076 leader_election.cc:304] T 65d8cb8d6ec64f459d5a47cefab10acf P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 127766fc592545a4997f7790f50f6076; no voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:04:49.700273 20107 raft_consensus.cc:3060] T 309c3ca0ca4b4f3ba129752ea2cb293b P 127766fc592545a4997f7790f50f6076 [term 2 LEARNER]: Advancing to term 3
I20260709 13:04:49.701259 20716 raft_consensus.cc:2804] T fa8650e71aa14778b3d73721fc50d9fc P 0473d2b2d01f4459b1e90fd12cc7840e [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 13:04:49.708156 20963 log.cc:927] Time spent T b08304a0a02b42d7840c4e8ee9a6bd1a P e61c3a8f61bb48f8a963c9480e53c168: Append to log took a long time: real 0.111s	user 0.002s	sys 0.000s
I20260709 13:04:49.702631 20808 leader_election.cc:290] T b08304a0a02b42d7840c4e8ee9a6bd1a P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
W20260709 13:04:49.722457 20954 log.cc:927] Time spent T edd7d470b5014c9489be7f41f64355c9 P 0473d2b2d01f4459b1e90fd12cc7840e: Append to log took a long time: real 0.092s	user 0.000s	sys 0.000s
W20260709 13:04:49.723791 20947 log.cc:927] Time spent T 7f575b143b844aa096b50997dad3516a P e61c3a8f61bb48f8a963c9480e53c168: Append to log took a long time: real 0.061s	user 0.000s	sys 0.001s
I20260709 13:04:49.710330 20910 consensus_queue.cc:260] T 0e1085d23e8347fbbd5bce7542f4b1f4 P 127766fc592545a4997f7790f50f6076 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:04:49.697836 20737 consensus_queue.cc:260] T ed7fdbcb96d14d418db9ca90a792588a P 127766fc592545a4997f7790f50f6076 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
W20260709 13:04:49.729048 19452 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:49.712188 19552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ece3db938bc649d4a40a51522ed5259c" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:04:49.714352 20911 consensus_queue.cc:1048] T fa731b585f684a7fb2d106c50f143b83 P 127766fc592545a4997f7790f50f6076 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.013s
I20260709 13:04:49.719748 20964 raft_consensus.cc:2749] T 65d8cb8d6ec64f459d5a47cefab10acf P 127766fc592545a4997f7790f50f6076 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:04:49.699290 20885 raft_consensus.cc:515] T 96efeaaf1057492490e9a621f37e1a2d P e61c3a8f61bb48f8a963c9480e53c168 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:04:49.705528 20962 raft_consensus.cc:515] T ff75a1d4cb1f493db8f71ddc136ba9ab P e61c3a8f61bb48f8a963c9480e53c168 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:49.711824 20733 raft_consensus.cc:3060] T 7be9efa6559648dbb5a0f7684c4542d1 P e61c3a8f61bb48f8a963c9480e53c168 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:04:49.746979 19450 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.3:36891, user_credentials={real_user=slave}} blocked reactor thread for 65059.1us
I20260709 13:04:49.701304 20873 consensus_queue.cc:1059] T 85c494af21f9457a85da47b9bc70c1fd P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.019s
I20260709 13:04:49.750598 20818 leader_election.cc:290] T 86a6797bdfe94fa496c050ceae4bd0d9 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 3 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:04:49.751375 20829 leader_election.cc:290] T 2725d2c4cb054f18b0fc8f735c15f6c2 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 3 election: Requested vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:04:49.720253 20716 raft_consensus.cc:493] T fa8650e71aa14778b3d73721fc50d9fc P 0473d2b2d01f4459b1e90fd12cc7840e [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:49.757565 19450 leader_election.cc:304] T 28af091831594f9d8e96482078cc7625 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:04:49.759905 20716 raft_consensus.cc:3060] T fa8650e71aa14778b3d73721fc50d9fc P 0473d2b2d01f4459b1e90fd12cc7840e [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:04:49.760676 20885 leader_election.cc:290] T 96efeaaf1057492490e9a621f37e1a2d P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 3 election: Requested vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:04:49.749831 20737 raft_consensus.cc:3060] T ed7fdbcb96d14d418db9ca90a792588a P 127766fc592545a4997f7790f50f6076 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:04:49.753575 20969 log.cc:927] Time spent T 85c494af21f9457a85da47b9bc70c1fd P e5256d91808b47c195bc9b4dbd7f2b87: Append to log took a long time: real 0.070s	user 0.001s	sys 0.000s
I20260709 13:04:49.765898 20112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96efeaaf1057492490e9a621f37e1a2d" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076"
I20260709 13:04:49.763832 19570 tablet_copy_source_session.cc:215] T df751f992649444090e27965eb1af85d P e61c3a8f61bb48f8a963c9480e53c168: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:04:49.768033 19570 rpcz_store.cc:275] Call kudu.tserver.TabletCopyService.BeginTabletCopySession from 127.0.0.1:41504 (request call id 75) took 1761 ms. Trace:
I20260709 13:04:49.768392 19570 rpcz_store.cc:276] 0709 13:04:48.007049 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:48.008254 (+  1205us) service_pool.cc:224] Handling call
0709 13:04:49.763465 (+1755211us) spinlock_profiling.cc:243] Waited 922 ms on lock 0x7b54002f12d4. stack: 00007f4a79de9343 00007f4a79de9240 00007f4a797781d4 00007f4a834b6304 00007f4a834b6299 00007f4a7ce71571 00007f4a7cf123f7 00007f4a81ea8036 00007f4a81eb1a3e 00007f4a7977527b 00007f4a81eb19ba 00007f4a81eacacc 00007f4a81ea7c7b 00007f4a81e9c8d1 00007f4a80f504b4 00007f4a80f50442
0709 13:04:49.767966 (+  4501us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2120043264}
I20260709 13:04:49.769408 20962 leader_election.cc:290] T ff75a1d4cb1f493db8f71ddc136ba9ab P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:04:49.769582 19558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b08304a0a02b42d7840c4e8ee9a6bd1a" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:04:49.756604 20910 raft_consensus.cc:3060] T 0e1085d23e8347fbbd5bce7542f4b1f4 P 127766fc592545a4997f7790f50f6076 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:04:49.771489 19558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "833a2f0775ed407a94b8924ce50adb63" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:04:49.772152 19558 raft_consensus.cc:2368] T 833a2f0775ed407a94b8924ce50adb63 P e61c3a8f61bb48f8a963c9480e53c168 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 127766fc592545a4997f7790f50f6076 for earlier term 2. Current term is 3.
I20260709 13:04:49.777416 19558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76cb037fc9064d13b59a8969d897ce8c" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:04:49.778261 20110 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35874 (request call id 235) took 1108 ms. Trace:
I20260709 13:04:49.778697 20110 rpcz_store.cc:276] 0709 13:04:48.663644 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:48.663810 (+   166us) service_pool.cc:224] Handling call
0709 13:04:49.771970 (+1108160us) spinlock_profiling.cc:243] Waited 527 ms on lock 0x7b54002468d4. stack: 00007f4a79de9343 00007f4a79de9240 00007f4a797781d4 00007f4a834b6304 00007f4a834b6299 00007f4a7ce71571 00007f4a7cf0c2fa 00007f4a81ecdb17 00007f4a7b4486d4 00007f4a7b448662 00007f4a7b448591 00007f4a7b44850c 00007f4a7b4477c2 00007f4a7b24348c 00007f4a7b2428c6 00007f4a7b24226f
0709 13:04:49.772060 (+    90us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1213230848}
I20260709 13:04:49.782853 20818 raft_consensus.cc:2804] T 28af091831594f9d8e96482078cc7625 P 0473d2b2d01f4459b1e90fd12cc7840e [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:04:49.786161 20943 leader_election.cc:290] T ff75a1d4cb1f493db8f71ddc136ba9ab P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:04:49.762599 20642 leader_election.cc:290] T 309c3ca0ca4b4f3ba129752ea2cb293b P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:04:49.789904 20818 raft_consensus.cc:493] T 28af091831594f9d8e96482078cc7625 P 0473d2b2d01f4459b1e90fd12cc7840e [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:49.790339 20818 raft_consensus.cc:3060] T 28af091831594f9d8e96482078cc7625 P 0473d2b2d01f4459b1e90fd12cc7840e [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:04:49.778497 19558 raft_consensus.cc:2468] T 76cb037fc9064d13b59a8969d897ce8c P e61c3a8f61bb48f8a963c9480e53c168 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 2.
I20260709 13:04:49.791659 20728 raft_consensus.cc:3055] T a08760e15aac4630a629431f56024dc8 P e61c3a8f61bb48f8a963c9480e53c168 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:04:49.792095 20728 raft_consensus.cc:740] T a08760e15aac4630a629431f56024dc8 P e61c3a8f61bb48f8a963c9480e53c168 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e61c3a8f61bb48f8a963c9480e53c168, State: Running, Role: LEADER
I20260709 13:04:49.791708 19558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff75a1d4cb1f493db8f71ddc136ba9ab" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:04:49.793056 19558 raft_consensus.cc:2468] T ff75a1d4cb1f493db8f71ddc136ba9ab P e61c3a8f61bb48f8a963c9480e53c168 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 1.
I20260709 13:04:49.792940 20728 consensus_queue.cc:260] T a08760e15aac4630a629431f56024dc8 P e61c3a8f61bb48f8a963c9480e53c168 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:49.794319 19450 leader_election.cc:304] T ff75a1d4cb1f493db8f71ddc136ba9ab P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:04:49.795751 19558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc225c93219c45538b53a1bd3d387e4d" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:04:49.796396 19558 raft_consensus.cc:2468] T bc225c93219c45538b53a1bd3d387e4d P e61c3a8f61bb48f8a963c9480e53c168 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 1.
I20260709 13:04:49.796449 20849 raft_consensus.cc:3055] T 0cdf56e38bbc453d9438d359e5a69955 P e61c3a8f61bb48f8a963c9480e53c168 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:04:49.797605 20849 raft_consensus.cc:740] T 0cdf56e38bbc453d9438d359e5a69955 P e61c3a8f61bb48f8a963c9480e53c168 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: e61c3a8f61bb48f8a963c9480e53c168, State: Running, Role: LEADER
I20260709 13:04:49.796900 20943 raft_consensus.cc:2804] T ff75a1d4cb1f493db8f71ddc136ba9ab P 0473d2b2d01f4459b1e90fd12cc7840e [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:04:49.798692 19481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2725d2c4cb054f18b0fc8f735c15f6c2" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:04:49.798445 20849 consensus_queue.cc:260] T 0cdf56e38bbc453d9438d359e5a69955 P e61c3a8f61bb48f8a963c9480e53c168 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:49.800102 20849 raft_consensus.cc:3060] T 0cdf56e38bbc453d9438d359e5a69955 P e61c3a8f61bb48f8a963c9480e53c168 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:04:49.800534 20812 leader_election.cc:290] T ef32ce6fdd0e40d382c79974f30295c6 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:04:49.802153 20906 leader_election.cc:290] T 4509b76741dc428e9201c70c1658da13 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:04:49.740612 20833 raft_consensus.cc:515] T 22196caba61445d3bec98a0aab3c337d P e5256d91808b47c195bc9b4dbd7f2b87 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:49.804008 19554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f93ee515a9c14139bf566522ed8232f3" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:04:49.804697 19554 raft_consensus.cc:2468] T f93ee515a9c14139bf566522ed8232f3 P e61c3a8f61bb48f8a963c9480e53c168 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 2.
I20260709 13:04:49.805691 19554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62c6c134d3d24a1ab144dd9ee6bc3f64" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:04:49.808130 19558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40e1e16737a842ee936002830f36882e" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:04:49.808647 19558 raft_consensus.cc:3060] T 40e1e16737a842ee936002830f36882e P e61c3a8f61bb48f8a963c9480e53c168 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:04:49.798873 20943 raft_consensus.cc:493] T ff75a1d4cb1f493db8f71ddc136ba9ab P 0473d2b2d01f4459b1e90fd12cc7840e [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:49.810552 19450 leader_election.cc:304] T bc225c93219c45538b53a1bd3d387e4d P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:04:49.810830 20943 raft_consensus.cc:3060] T ff75a1d4cb1f493db8f71ddc136ba9ab P 0473d2b2d01f4459b1e90fd12cc7840e [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:04:49.812273 19559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef32ce6fdd0e40d382c79974f30295c6" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:04:49.812569 20906 raft_consensus.cc:2804] T bc225c93219c45538b53a1bd3d387e4d P 0473d2b2d01f4459b1e90fd12cc7840e [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:04:49.812945 20906 raft_consensus.cc:493] T bc225c93219c45538b53a1bd3d387e4d P 0473d2b2d01f4459b1e90fd12cc7840e [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:49.804174 20833 leader_election.cc:290] T 22196caba61445d3bec98a0aab3c337d P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 3 election: Requested vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:04:49.813386 20906 raft_consensus.cc:3060] T bc225c93219c45538b53a1bd3d387e4d P 0473d2b2d01f4459b1e90fd12cc7840e [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:04:49.815729 19557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4509b76741dc428e9201c70c1658da13" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:04:49.818392 19557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab43d85f64114d4ebf618930e43d9ed0" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:04:49.764483 20839 raft_consensus.cc:493] T f1b10566f45d4a7d9029858330e02d5b P 0473d2b2d01f4459b1e90fd12cc7840e [term 3 FOLLOWER]: Starting pre-election (detected failure of leader e5256d91808b47c195bc9b4dbd7f2b87)
I20260709 13:04:49.818974 19557 raft_consensus.cc:2468] T ab43d85f64114d4ebf618930e43d9ed0 P e61c3a8f61bb48f8a963c9480e53c168 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 2.
I20260709 13:04:49.819018 20839 raft_consensus.cc:515] T f1b10566f45d4a7d9029858330e02d5b P 0473d2b2d01f4459b1e90fd12cc7840e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:49.819857 19557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed7fdbcb96d14d418db9ca90a792588a" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:04:49.820350 19557 raft_consensus.cc:3060] T ed7fdbcb96d14d418db9ca90a792588a P e61c3a8f61bb48f8a963c9480e53c168 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:04:49.821097 20839 leader_election.cc:290] T f1b10566f45d4a7d9029858330e02d5b P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:04:49.821823 20819 leader_election.cc:290] T 28af091831594f9d8e96482078cc7625 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:04:49.816092 20812 raft_consensus.cc:493] T 1dc5b3532fe54f74876d02beffa2c230 P 0473d2b2d01f4459b1e90fd12cc7840e [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:49.822930 20076 leader_election.cc:304] T 85c494af21f9457a85da47b9bc70c1fd P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 127766fc592545a4997f7790f50f6076; no voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:04:49.757611 20883 leader_election.cc:290] T bc225c93219c45538b53a1bd3d387e4d P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:04:49.816606 20860 raft_consensus.cc:515] T f93ee515a9c14139bf566522ed8232f3 P 0473d2b2d01f4459b1e90fd12cc7840e [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:49.823928 19554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86a6797bdfe94fa496c050ceae4bd0d9" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:04:49.825093 20860 leader_election.cc:290] T f93ee515a9c14139bf566522ed8232f3 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 3 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:04:49.825857 19477 raft_consensus.cc:2468] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P 0473d2b2d01f4459b1e90fd12cc7840e [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 4.
I20260709 13:04:49.812907 19559 raft_consensus.cc:2468] T ef32ce6fdd0e40d382c79974f30295c6 P e61c3a8f61bb48f8a963c9480e53c168 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 2.
I20260709 13:04:49.823061 20812 raft_consensus.cc:515] T 1dc5b3532fe54f74876d02beffa2c230 P 0473d2b2d01f4459b1e90fd12cc7840e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:49.828040 20812 leader_election.cc:290] T 1dc5b3532fe54f74876d02beffa2c230 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:04:49.828810 19559 raft_consensus.cc:1275] T 70797e5783b5454ab0d0eea663e791e3 P e61c3a8f61bb48f8a963c9480e53c168 [term 3 FOLLOWER]: Refusing update from remote peer e5256d91808b47c195bc9b4dbd7f2b87: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:04:49.815719 20884 leader_election.cc:290] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:04:49.831616 19377 leader_election.cc:304] T 7be9efa6559648dbb5a0f7684c4542d1 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87; no voters: 
I20260709 13:04:49.832446 19377 leader_election.cc:304] T fa8650e71aa14778b3d73721fc50d9fc P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87; no voters: 
I20260709 13:04:49.832926 20855 raft_consensus.cc:2804] T 7be9efa6559648dbb5a0f7684c4542d1 P e5256d91808b47c195bc9b4dbd7f2b87 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:04:49.834199 20855 raft_consensus.cc:493] T 7be9efa6559648dbb5a0f7684c4542d1 P e5256d91808b47c195bc9b4dbd7f2b87 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:49.834607 20855 raft_consensus.cc:3060] T 7be9efa6559648dbb5a0f7684c4542d1 P e5256d91808b47c195bc9b4dbd7f2b87 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:04:49.835210 20112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36f6ba92b9ba46babe4ebd6c02e5fbd9" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:04:49.835801 20112 raft_consensus.cc:2468] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P 127766fc592545a4997f7790f50f6076 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 3.
I20260709 13:04:49.825186 19554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef32ce6fdd0e40d382c79974f30295c6" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:04:49.825943 20860 raft_consensus.cc:493] T 775c229504194560ba9589bc2199b089 P 0473d2b2d01f4459b1e90fd12cc7840e [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:04:49.835860 20864 consensus_meta.cc:287] T 46c5bfeecc314717bffe987e6844b6d0 P e61c3a8f61bb48f8a963c9480e53c168: Time spent flushing consensus metadata: real 0.592s	user 0.007s	sys 0.002s
I20260709 13:04:49.833180 20716 raft_consensus.cc:515] T fa8650e71aa14778b3d73721fc50d9fc P 0473d2b2d01f4459b1e90fd12cc7840e [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:49.838439 19559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1b10566f45d4a7d9029858330e02d5b" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:04:49.840688 19557 raft_consensus.cc:2468] T ed7fdbcb96d14d418db9ca90a792588a P e61c3a8f61bb48f8a963c9480e53c168 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 3.
I20260709 13:04:49.844069 19559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f93ee515a9c14139bf566522ed8232f3" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:04:49.844857 19559 raft_consensus.cc:3060] T f93ee515a9c14139bf566522ed8232f3 P e61c3a8f61bb48f8a963c9480e53c168 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:04:49.853567 19406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f93ee515a9c14139bf566522ed8232f3" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
I20260709 13:04:49.866405 19306 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:44676 (request call id 218) took 4255 ms. Trace:
I20260709 13:04:49.868870 20109 raft_consensus.cc:1275] T 70797e5783b5454ab0d0eea663e791e3 P 127766fc592545a4997f7790f50f6076 [term 3 FOLLOWER]: Refusing update from remote peer e5256d91808b47c195bc9b4dbd7f2b87: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:04:49.836299 20935 raft_consensus.cc:515] T 76cb037fc9064d13b59a8969d897ce8c P 0473d2b2d01f4459b1e90fd12cc7840e [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:49.864059 20943 raft_consensus.cc:515] T ff75a1d4cb1f493db8f71ddc136ba9ab P 0473d2b2d01f4459b1e90fd12cc7840e [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:49.856341 19402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76cb037fc9064d13b59a8969d897ce8c" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
I20260709 13:04:49.857796 20867 raft_consensus.cc:2804] T fa8650e71aa14778b3d73721fc50d9fc P e5256d91808b47c195bc9b4dbd7f2b87 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:04:49.882541 20935 leader_election.cc:290] T 76cb037fc9064d13b59a8969d897ce8c P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 3 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:04:49.882756 20943 leader_election.cc:290] T ff75a1d4cb1f493db8f71ddc136ba9ab P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 3 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:04:49.859020 20830 leader_election.cc:290] T ff9b0eddd810459b82d91c60777c10eb P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:04:49.843791 20818 raft_consensus.cc:515] T 28af091831594f9d8e96482078cc7625 P 0473d2b2d01f4459b1e90fd12cc7840e [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:49.855245 19409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28af091831594f9d8e96482078cc7625" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
I20260709 13:04:49.886878 19449 leader_election.cc:304] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, 127766fc592545a4997f7790f50f6076; no voters: 
I20260709 13:04:49.880343 19306 rpcz_store.cc:276] 0709 13:04:45.616544 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:45.622847 (+  6303us) service_pool.cc:224] Handling call
0709 13:04:49.866327 (+4243480us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:04:48.940357 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:04:48.940954 (+   597us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:04:48.940992 (+    38us) write_op.cc:435] Acquired schema lock
0709 13:04:48.941013 (+    21us) tablet.cc:662] Decoding operations
0709 13:04:48.941376 (+   363us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:04:48.941447 (+    71us) write_op.cc:641] Partition lock acquired for write op
0709 13:04:48.941480 (+    33us) tablet.cc:685] Acquiring locks for 1 operations
0709 13:04:48.941657 (+   177us) tablet.cc:701] Row locks acquired
0709 13:04:48.941676 (+    19us) write_op.cc:260] PREPARE: finished
0709 13:04:48.941808 (+   132us) write_op.cc:270] Start()
0709 13:04:48.941912 (+   104us) write_op.cc:276] Timestamp: P: 1783602288941770 usec, L: 0
0709 13:04:48.941936 (+    24us) op_driver.cc:348] REPLICATION: starting
0709 13:04:48.942574 (+   638us) log.cc:844] Serialized 538 byte log entry
0709 13:04:49.400134 (+457560us) op_driver.cc:464] REPLICATION: finished
0709 13:04:49.550025 (+149891us) write_op.cc:301] APPLY: starting
0709 13:04:49.550126 (+   101us) tablet.cc:1367] starting BulkCheckPresence
0709 13:04:49.550249 (+   123us) tablet.cc:1370] finished BulkCheckPresence
0709 13:04:49.593054 (+ 42805us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:04:49.593296 (+   242us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:04:49.593451 (+   155us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0709 13:04:49.593504 (+    53us) write_op.cc:312] APPLY: finished
0709 13:04:49.593683 (+   179us) log.cc:844] Serialized 23 byte log entry
0709 13:04:49.593862 (+   179us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:04:49.593953 (+    91us) write_op.cc:454] Released schema lock
0709 13:04:49.593993 (+    40us) write_op.cc:341] FINISH: Updating metrics
0709 13:04:49.594333 (+   340us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:04:49.594360 (+    27us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":1716794,"reported_tablets":10,"child_traces":[["op",{"apply.queue_time_us":138817,"apply.run_cpu_time_us":1720,"apply.run_wall_time_us":45630,"num_ops":1,"prepare.queue_time_us":147593,"prepare.run_cpu_time_us":10808,"prepare.run_wall_time_us":84331,"raft.queue_time_us":129154,"raft.run_cpu_time_us":3746,"raft.run_wall_time_us":169644,"replication_time_us":410361,"thread_start_us":294452,"threads_started":4,"wal-append.queue_time_us":110788}]]}
I20260709 13:04:49.883011 20867 raft_consensus.cc:493] T fa8650e71aa14778b3d73721fc50d9fc P e5256d91808b47c195bc9b4dbd7f2b87 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:49.892303 19558 raft_consensus.cc:2468] T 40e1e16737a842ee936002830f36882e P e61c3a8f61bb48f8a963c9480e53c168 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 4.
I20260709 13:04:49.856613 19404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff75a1d4cb1f493db8f71ddc136ba9ab" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:04:49.869606 19553 raft_consensus.cc:2410] T 46c5bfeecc314717bffe987e6844b6d0 P e61c3a8f61bb48f8a963c9480e53c168 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 0473d2b2d01f4459b1e90fd12cc7840e for term 4 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 1.
I20260709 13:04:49.843142 20737 raft_consensus.cc:2749] T 85c494af21f9457a85da47b9bc70c1fd P 127766fc592545a4997f7790f50f6076 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:04:49.901283 19377 leader_election.cc:304] T bc225c93219c45538b53a1bd3d387e4d P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87; no voters: 
I20260709 13:04:49.903708 19478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dc5b3532fe54f74876d02beffa2c230" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:04:49.904301 19478 raft_consensus.cc:2468] T 1dc5b3532fe54f74876d02beffa2c230 P 0473d2b2d01f4459b1e90fd12cc7840e [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 2.
I20260709 13:04:49.905170 19478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28af091831594f9d8e96482078cc7625" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:04:49.894081 19558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dc5b3532fe54f74876d02beffa2c230" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:04:49.896123 20843 consensus_queue.cc:1048] T 70797e5783b5454ab0d0eea663e791e3 P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Connected to new peer: Peer: permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:04:49.907711 19478 raft_consensus.cc:2393] T 28af091831594f9d8e96482078cc7625 P 0473d2b2d01f4459b1e90fd12cc7840e [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e5256d91808b47c195bc9b4dbd7f2b87 in current term 3: Already voted for candidate 0473d2b2d01f4459b1e90fd12cc7840e in this term.
I20260709 13:04:49.912014 19450 leader_election.cc:304] T ed7fdbcb96d14d418db9ca90a792588a P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168; no voters: 127766fc592545a4997f7790f50f6076
I20260709 13:04:49.849380 19554 raft_consensus.cc:2468] T ef32ce6fdd0e40d382c79974f30295c6 P e61c3a8f61bb48f8a963c9480e53c168 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 2.
W20260709 13:04:49.880693 20076 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.3:36891, user_credentials={real_user=slave}} blocked reactor thread for 57862.9us
I20260709 13:04:49.915246 19558 raft_consensus.cc:1275] T e381f1d6b8184797ad142de49be225a8 P e61c3a8f61bb48f8a963c9480e53c168 [term 3 FOLLOWER]: Refusing update from remote peer 0473d2b2d01f4459b1e90fd12cc7840e: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:04:49.873931 19486 raft_consensus.cc:2468] T 40e1e16737a842ee936002830f36882e P 0473d2b2d01f4459b1e90fd12cc7840e [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 4.
I20260709 13:04:49.898571 20104 raft_consensus.cc:1240] T 62c6c134d3d24a1ab144dd9ee6bc3f64 P 127766fc592545a4997f7790f50f6076 [term 3 LEADER]: Rejecting Update request from peer e61c3a8f61bb48f8a963c9480e53c168 for earlier term 2. Current term is 3. Ops: []
I20260709 13:04:49.865386 20733 raft_consensus.cc:515] T 7be9efa6559648dbb5a0f7684c4542d1 P e61c3a8f61bb48f8a963c9480e53c168 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:49.907613 20642 raft_consensus.cc:2804] T bc225c93219c45538b53a1bd3d387e4d P e5256d91808b47c195bc9b4dbd7f2b87 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:04:49.919482 19558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff75a1d4cb1f493db8f71ddc136ba9ab" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:04:49.898977 20935 raft_consensus.cc:2764] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P 0473d2b2d01f4459b1e90fd12cc7840e [term 4 FOLLOWER]: Leader pre-election decision vote started in defunct term 2: won
I20260709 13:04:49.921731 19377 leader_election.cc:304] T 1dc5b3532fe54f74876d02beffa2c230 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87; no voters: 
I20260709 13:04:49.848620 20860 raft_consensus.cc:515] T 775c229504194560ba9589bc2199b089 P 0473d2b2d01f4459b1e90fd12cc7840e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:04:49.924490 19405 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2b74109013a140ada21feeef92d6f563"
dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
mode: GRACEFUL
new_leader_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
 from {username='slave'} at 127.0.0.1:37312
I20260709 13:04:49.880332 20940 raft_consensus.cc:515] T ef32ce6fdd0e40d382c79974f30295c6 P 0473d2b2d01f4459b1e90fd12cc7840e [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:49.856079 20944 raft_consensus.cc:515] T ece3db938bc649d4a40a51522ed5259c P e61c3a8f61bb48f8a963c9480e53c168 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:04:49.895036 20867 raft_consensus.cc:3060] T fa8650e71aa14778b3d73721fc50d9fc P e5256d91808b47c195bc9b4dbd7f2b87 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:04:49.937445 19405 raft_consensus.cc:606] T 2b74109013a140ada21feeef92d6f563 P e5256d91808b47c195bc9b4dbd7f2b87 [term 1 LEADER]: Received request to transfer leadership to TS 0473d2b2d01f4459b1e90fd12cc7840e
I20260709 13:04:49.935974 19558 raft_consensus.cc:3060] T ff75a1d4cb1f493db8f71ddc136ba9ab P e61c3a8f61bb48f8a963c9480e53c168 [term 1 FOLLOWER]: Advancing to term 3
I20260709 13:04:49.920989 20812 raft_consensus.cc:2804] T ed7fdbcb96d14d418db9ca90a792588a P 0473d2b2d01f4459b1e90fd12cc7840e [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:04:49.918912 20106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff9b0eddd810459b82d91c60777c10eb" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:04:49.932490 19404 raft_consensus.cc:2393] T ff75a1d4cb1f493db8f71ddc136ba9ab P e5256d91808b47c195bc9b4dbd7f2b87 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e61c3a8f61bb48f8a963c9480e53c168 in current term 2: Already voted for candidate e5256d91808b47c195bc9b4dbd7f2b87 in this term.
I20260709 13:04:49.951726 20110 raft_consensus.cc:1275] T 833a2f0775ed407a94b8924ce50adb63 P 127766fc592545a4997f7790f50f6076 [term 3 FOLLOWER]: Refusing update from remote peer e5256d91808b47c195bc9b4dbd7f2b87: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:04:49.953158 19377 leader_election.cc:304] T 40e1e16737a842ee936002830f36882e P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87; no voters: 
I20260709 13:04:49.956008 19556 raft_consensus.cc:2468] T 7be9efa6559648dbb5a0f7684c4542d1 P e61c3a8f61bb48f8a963c9480e53c168 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 2.
I20260709 13:04:49.912532 20853 raft_consensus.cc:515] T 86a6797bdfe94fa496c050ceae4bd0d9 P e61c3a8f61bb48f8a963c9480e53c168 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:49.957702 19406 raft_consensus.cc:2468] T f93ee515a9c14139bf566522ed8232f3 P e5256d91808b47c195bc9b4dbd7f2b87 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 2.
I20260709 13:04:49.925246 19481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff75a1d4cb1f493db8f71ddc136ba9ab" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:04:49.938367 20642 raft_consensus.cc:493] T bc225c93219c45538b53a1bd3d387e4d P e5256d91808b47c195bc9b4dbd7f2b87 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:49.962396 19483 raft_consensus.cc:2393] T ef32ce6fdd0e40d382c79974f30295c6 P 0473d2b2d01f4459b1e90fd12cc7840e [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e5256d91808b47c195bc9b4dbd7f2b87 in current term 3: Already voted for candidate 0473d2b2d01f4459b1e90fd12cc7840e in this term.
I20260709 13:04:49.967993 19558 raft_consensus.cc:2468] T ff75a1d4cb1f493db8f71ddc136ba9ab P e61c3a8f61bb48f8a963c9480e53c168 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 3.
I20260709 13:04:49.968358 19555 raft_consensus.cc:2468] T 86a6797bdfe94fa496c050ceae4bd0d9 P e61c3a8f61bb48f8a963c9480e53c168 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 2.
I20260709 13:04:49.958241 20871 raft_consensus.cc:2804] T 1dc5b3532fe54f74876d02beffa2c230 P e5256d91808b47c195bc9b4dbd7f2b87 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:04:49.960347 20821 raft_consensus.cc:2804] T 40e1e16737a842ee936002830f36882e P e5256d91808b47c195bc9b4dbd7f2b87 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:04:49.959775 20812 raft_consensus.cc:697] T ed7fdbcb96d14d418db9ca90a792588a P 0473d2b2d01f4459b1e90fd12cc7840e [term 3 LEADER]: Becoming Leader. State: Replica: 0473d2b2d01f4459b1e90fd12cc7840e, State: Running, Role: LEADER
W20260709 13:04:50.011245 20078 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:50.011663 19482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a08760e15aac4630a629431f56024dc8" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
W20260709 13:04:49.979313 19525 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:49.961346 19554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76cb037fc9064d13b59a8969d897ce8c" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:04:50.015447 19554 raft_consensus.cc:3060] T 76cb037fc9064d13b59a8969d897ce8c P e61c3a8f61bb48f8a963c9480e53c168 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:04:50.015882 20860 leader_election.cc:290] T 775c229504194560ba9589bc2199b089 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:04:50.017853 20940 leader_election.cc:290] T ef32ce6fdd0e40d382c79974f30295c6 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 3 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:04:50.018436 19481 raft_consensus.cc:2393] T ff75a1d4cb1f493db8f71ddc136ba9ab P 0473d2b2d01f4459b1e90fd12cc7840e [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e5256d91808b47c195bc9b4dbd7f2b87 in current term 3: Already voted for candidate 0473d2b2d01f4459b1e90fd12cc7840e in this term.
I20260709 13:04:50.005089 19450 leader_election.cc:304] T ff75a1d4cb1f493db8f71ddc136ba9ab P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:04:49.936866 20945 consensus_queue.cc:1048] T e381f1d6b8184797ad142de49be225a8 P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.028s
I20260709 13:04:49.964643 20642 raft_consensus.cc:3060] T bc225c93219c45538b53a1bd3d387e4d P e5256d91808b47c195bc9b4dbd7f2b87 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:04:50.024303 19481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "309c3ca0ca4b4f3ba129752ea2cb293b" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 4 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:04:50.025501 19481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22196caba61445d3bec98a0aab3c337d" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:04:50.025851 20944 leader_election.cc:290] T ece3db938bc649d4a40a51522ed5259c P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 2 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:04:50.026103 19481 raft_consensus.cc:3060] T 22196caba61445d3bec98a0aab3c337d P 0473d2b2d01f4459b1e90fd12cc7840e [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:04:50.026795 20940 raft_consensus.cc:2804] T ff75a1d4cb1f493db8f71ddc136ba9ab P 0473d2b2d01f4459b1e90fd12cc7840e [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:04:50.027586 20940 raft_consensus.cc:697] T ff75a1d4cb1f493db8f71ddc136ba9ab P 0473d2b2d01f4459b1e90fd12cc7840e [term 3 LEADER]: Becoming Leader. State: Replica: 0473d2b2d01f4459b1e90fd12cc7840e, State: Running, Role: LEADER
I20260709 13:04:50.028147 20821 raft_consensus.cc:697] T 40e1e16737a842ee936002830f36882e P e5256d91808b47c195bc9b4dbd7f2b87 [term 4 LEADER]: Becoming Leader. State: Replica: e5256d91808b47c195bc9b4dbd7f2b87, State: Running, Role: LEADER
I20260709 13:04:49.968683 19486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2725d2c4cb054f18b0fc8f735c15f6c2" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:04:50.007994 20871 raft_consensus.cc:493] T 1dc5b3532fe54f74876d02beffa2c230 P e5256d91808b47c195bc9b4dbd7f2b87 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:50.038918 20871 raft_consensus.cc:3060] T 1dc5b3532fe54f74876d02beffa2c230 P e5256d91808b47c195bc9b4dbd7f2b87 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:04:50.038973 20855 raft_consensus.cc:515] T 7be9efa6559648dbb5a0f7684c4542d1 P e5256d91808b47c195bc9b4dbd7f2b87 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:50.013922 20906 raft_consensus.cc:515] T bc225c93219c45538b53a1bd3d387e4d P 0473d2b2d01f4459b1e90fd12cc7840e [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:49.964313 20754 consensus_queue.cc:1048] T 833a2f0775ed407a94b8924ce50adb63 P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Connected to new peer: Peer: permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.059s
I20260709 13:04:49.966226 19552 raft_consensus.cc:3060] T ece3db938bc649d4a40a51522ed5259c P e61c3a8f61bb48f8a963c9480e53c168 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:04:49.956144 20805 raft_consensus.cc:515] T 7be9efa6559648dbb5a0f7684c4542d1 P 0473d2b2d01f4459b1e90fd12cc7840e [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:50.023412 19374 leader_election.cc:304] T ff9b0eddd810459b82d91c60777c10eb P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, 127766fc592545a4997f7790f50f6076
I20260709 13:04:50.012454 19482 raft_consensus.cc:2468] T a08760e15aac4630a629431f56024dc8 P 0473d2b2d01f4459b1e90fd12cc7840e [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 2.
I20260709 13:04:50.029073 20821 consensus_queue.cc:237] T 40e1e16737a842ee936002830f36882e P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:50.013790 20076 leader_election.cc:304] T 0afb57ae58a24a01850491d69f0213dd P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 127766fc592545a4997f7790f50f6076; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:04:50.043289 19375 leader_election.cc:304] T ab43d85f64114d4ebf618930e43d9ed0 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168; no voters: 0473d2b2d01f4459b1e90fd12cc7840e
I20260709 13:04:50.039762 20853 leader_election.cc:290] T 86a6797bdfe94fa496c050ceae4bd0d9 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 2 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:04:50.045885 19558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff75a1d4cb1f493db8f71ddc136ba9ab" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:04:50.046594 19557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a08760e15aac4630a629431f56024dc8" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:04:50.052152 19558 raft_consensus.cc:2393] T ff75a1d4cb1f493db8f71ddc136ba9ab P e61c3a8f61bb48f8a963c9480e53c168 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e5256d91808b47c195bc9b4dbd7f2b87 in current term 3: Already voted for candidate 0473d2b2d01f4459b1e90fd12cc7840e in this term.
I20260709 13:04:50.053045 19558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2725d2c4cb054f18b0fc8f735c15f6c2" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:04:50.053552 19558 raft_consensus.cc:3060] T 2725d2c4cb054f18b0fc8f735c15f6c2 P e61c3a8f61bb48f8a963c9480e53c168 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:04:50.054382 20110 raft_consensus.cc:1240] T 85c494af21f9457a85da47b9bc70c1fd P 127766fc592545a4997f7790f50f6076 [term 2 FOLLOWER]: Rejecting Update request from peer e61c3a8f61bb48f8a963c9480e53c168 for earlier term 1. Current term is 2. Ops: []
I20260709 13:04:50.057791 19558 raft_consensus.cc:2468] T 2725d2c4cb054f18b0fc8f735c15f6c2 P e61c3a8f61bb48f8a963c9480e53c168 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 3.
I20260709 13:04:50.058837 19558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "309c3ca0ca4b4f3ba129752ea2cb293b" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 4 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:04:50.060248 19558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22196caba61445d3bec98a0aab3c337d" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:04:50.060832 19558 raft_consensus.cc:3060] T 22196caba61445d3bec98a0aab3c337d P e61c3a8f61bb48f8a963c9480e53c168 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:04:50.062264 19375 leader_election.cc:304] T ef32ce6fdd0e40d382c79974f30295c6 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:04:50.063907 19482 raft_consensus.cc:1240] T edd7d470b5014c9489be7f41f64355c9 P 0473d2b2d01f4459b1e90fd12cc7840e [term 3 LEADER]: Rejecting Update request from peer e5256d91808b47c195bc9b4dbd7f2b87 for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 13:04:50.028527 20940 consensus_queue.cc:237] T ff75a1d4cb1f493db8f71ddc136ba9ab P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:50.067970 19410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7be9efa6559648dbb5a0f7684c4542d1" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
I20260709 13:04:50.099159 19410 raft_consensus.cc:2368] T 7be9efa6559648dbb5a0f7684c4542d1 P e5256d91808b47c195bc9b4dbd7f2b87 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate e61c3a8f61bb48f8a963c9480e53c168 for earlier term 2. Current term is 3.
I20260709 13:04:50.103488 19409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86a6797bdfe94fa496c050ceae4bd0d9" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
I20260709 13:04:50.104732 19559 raft_consensus.cc:2468] T f93ee515a9c14139bf566522ed8232f3 P e61c3a8f61bb48f8a963c9480e53c168 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 3.
I20260709 13:04:50.106060 19450 leader_election.cc:304] T f93ee515a9c14139bf566522ed8232f3 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:04:50.107326 19559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28af091831594f9d8e96482078cc7625" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:04:50.107682 20855 leader_election.cc:290] T 7be9efa6559648dbb5a0f7684c4542d1 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 3 election: Requested vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:04:50.108017 19559 raft_consensus.cc:2468] T 28af091831594f9d8e96482078cc7625 P e61c3a8f61bb48f8a963c9480e53c168 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 2.
I20260709 13:04:50.108099 20812 consensus_queue.cc:237] T ed7fdbcb96d14d418db9ca90a792588a P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:04:50.111820 20805 leader_election.cc:290] T 7be9efa6559648dbb5a0f7684c4542d1 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 3 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:04:50.111728 19559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dc5b3532fe54f74876d02beffa2c230" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:04:50.112530 20805 raft_consensus.cc:2804] T f93ee515a9c14139bf566522ed8232f3 P 0473d2b2d01f4459b1e90fd12cc7840e [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:04:50.112852 19559 raft_consensus.cc:2468] T 1dc5b3532fe54f74876d02beffa2c230 P e61c3a8f61bb48f8a963c9480e53c168 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 1.
I20260709 13:04:50.113088 20805 raft_consensus.cc:697] T f93ee515a9c14139bf566522ed8232f3 P 0473d2b2d01f4459b1e90fd12cc7840e [term 3 LEADER]: Becoming Leader. State: Replica: 0473d2b2d01f4459b1e90fd12cc7840e, State: Running, Role: LEADER
W20260709 13:04:50.113399 20979 log.cc:927] Time spent T 2a16f7501e2444fb86d4e2778e734e02 P 127766fc592545a4997f7790f50f6076: Append to log took a long time: real 0.086s	user 0.001s	sys 0.001s
I20260709 13:04:50.115338 19375 leader_election.cc:304] T 2725d2c4cb054f18b0fc8f735c15f6c2 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:04:50.116475 19375 leader_election.cc:304] T 28af091831594f9d8e96482078cc7625 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:04:50.119815 20906 leader_election.cc:290] T bc225c93219c45538b53a1bd3d387e4d P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 3 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:04:50.120208 20805 consensus_queue.cc:237] T f93ee515a9c14139bf566522ed8232f3 P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:50.121354 20835 raft_consensus.cc:2804] T 2725d2c4cb054f18b0fc8f735c15f6c2 P e5256d91808b47c195bc9b4dbd7f2b87 [term 3 FOLLOWER]: Leader election won for term 3
W20260709 13:04:50.130789 20077 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:50.127415 19409 raft_consensus.cc:2468] T 86a6797bdfe94fa496c050ceae4bd0d9 P e5256d91808b47c195bc9b4dbd7f2b87 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 2.
I20260709 13:04:50.122939 19559 raft_consensus.cc:1240] T edd7d470b5014c9489be7f41f64355c9 P e61c3a8f61bb48f8a963c9480e53c168 [term 3 FOLLOWER]: Rejecting Update request from peer e5256d91808b47c195bc9b4dbd7f2b87 for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 13:04:50.058866 20716 leader_election.cc:290] T fa8650e71aa14778b3d73721fc50d9fc P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 3 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:04:50.064546 20776 raft_consensus.cc:2804] T ab43d85f64114d4ebf618930e43d9ed0 P e5256d91808b47c195bc9b4dbd7f2b87 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:04:50.154554 20776 raft_consensus.cc:493] T ab43d85f64114d4ebf618930e43d9ed0 P e5256d91808b47c195bc9b4dbd7f2b87 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:50.154964 20776 raft_consensus.cc:3060] T ab43d85f64114d4ebf618930e43d9ed0 P e5256d91808b47c195bc9b4dbd7f2b87 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:04:50.156253 20642 raft_consensus.cc:515] T bc225c93219c45538b53a1bd3d387e4d P e5256d91808b47c195bc9b4dbd7f2b87 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:50.062834 20833 raft_consensus.cc:2749] T ff9b0eddd810459b82d91c60777c10eb P e5256d91808b47c195bc9b4dbd7f2b87 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:04:50.124518 19558 raft_consensus.cc:2468] T 22196caba61445d3bec98a0aab3c337d P e61c3a8f61bb48f8a963c9480e53c168 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 3.
I20260709 13:04:50.068328 20843 raft_consensus.cc:2804] T ef32ce6fdd0e40d382c79974f30295c6 P e5256d91808b47c195bc9b4dbd7f2b87 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:04:50.061636 20106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ece3db938bc649d4a40a51522ed5259c" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076"
W20260709 13:04:50.174288 19524 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:50.162822 19375 leader_election.cc:304] T 22196caba61445d3bec98a0aab3c337d P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
W20260709 13:04:50.128559 20974 log.cc:927] Time spent T b08304a0a02b42d7840c4e8ee9a6bd1a P 0473d2b2d01f4459b1e90fd12cc7840e: Append to log took a long time: real 0.292s	user 0.000s	sys 0.001s
I20260709 13:04:50.098802 20734 raft_consensus.cc:2749] T 0afb57ae58a24a01850491d69f0213dd P 127766fc592545a4997f7790f50f6076 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:04:50.064316 20827 consensus_queue.cc:1048] T 70797e5783b5454ab0d0eea663e791e3 P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.097s
I20260709 13:04:50.067405 20864 consensus_queue.cc:1059] T 85c494af21f9457a85da47b9bc70c1fd P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.102s
W20260709 13:04:50.151015 20076 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.3:36891, user_credentials={real_user=slave}} blocked reactor thread for 137322us
I20260709 13:04:50.158437 20642 leader_election.cc:290] T bc225c93219c45538b53a1bd3d387e4d P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 3 election: Requested vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:04:50.151944 20754 raft_consensus.cc:2804] T 28af091831594f9d8e96482078cc7625 P e5256d91808b47c195bc9b4dbd7f2b87 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:04:50.164928 20843 raft_consensus.cc:493] T ef32ce6fdd0e40d382c79974f30295c6 P e5256d91808b47c195bc9b4dbd7f2b87 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:50.162774 19404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ece3db938bc649d4a40a51522ed5259c" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
I20260709 13:04:50.175375 20733 leader_election.cc:290] T 7be9efa6559648dbb5a0f7684c4542d1 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 2 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:04:50.181044 20819 raft_consensus.cc:2804] T 22196caba61445d3bec98a0aab3c337d P e5256d91808b47c195bc9b4dbd7f2b87 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:04:50.163224 20855 consensus_queue.cc:1059] T edd7d470b5014c9489be7f41f64355c9 P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.025s
I20260709 13:04:50.190048 20106 raft_consensus.cc:2368] T ece3db938bc649d4a40a51522ed5259c P 127766fc592545a4997f7790f50f6076 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate e61c3a8f61bb48f8a963c9480e53c168 for earlier term 2. Current term is 3.
I20260709 13:04:50.186772 20754 raft_consensus.cc:493] T 28af091831594f9d8e96482078cc7625 P e5256d91808b47c195bc9b4dbd7f2b87 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:50.189285 20843 raft_consensus.cc:3060] T ef32ce6fdd0e40d382c79974f30295c6 P e5256d91808b47c195bc9b4dbd7f2b87 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:04:50.212846 19523 leader_election.cc:400] T ece3db938bc649d4a40a51522ed5259c P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 2 election: Vote denied by peer 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121) with higher term. Message: Invalid argument: T ece3db938bc649d4a40a51522ed5259c P 127766fc592545a4997f7790f50f6076 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate e61c3a8f61bb48f8a963c9480e53c168 for earlier term 2. Current term is 3.
I20260709 13:04:50.213357 19523 leader_election.cc:403] T ece3db938bc649d4a40a51522ed5259c P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 2 election: Cancelling election due to peer responding with higher term
I20260709 13:04:50.200075 20754 raft_consensus.cc:3060] T 28af091831594f9d8e96482078cc7625 P e5256d91808b47c195bc9b4dbd7f2b87 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:04:50.200212 20819 raft_consensus.cc:697] T 22196caba61445d3bec98a0aab3c337d P e5256d91808b47c195bc9b4dbd7f2b87 [term 3 LEADER]: Becoming Leader. State: Replica: e5256d91808b47c195bc9b4dbd7f2b87, State: Running, Role: LEADER
I20260709 13:04:50.208688 20864 raft_consensus.cc:493] T 48824d5acfbc485ebf8c2d944e7202de P e61c3a8f61bb48f8a963c9480e53c168 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 127766fc592545a4997f7790f50f6076)
I20260709 13:04:50.239073 20864 raft_consensus.cc:515] T 48824d5acfbc485ebf8c2d944e7202de P e61c3a8f61bb48f8a963c9480e53c168 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:04:50.239372 20819 consensus_queue.cc:237] T 22196caba61445d3bec98a0aab3c337d P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:50.241144 20864 leader_election.cc:290] T 48824d5acfbc485ebf8c2d944e7202de P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
W20260709 13:04:50.226054 20075 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:50.226948 19402 raft_consensus.cc:2468] T 76cb037fc9064d13b59a8969d897ce8c P e5256d91808b47c195bc9b4dbd7f2b87 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 2.
I20260709 13:04:50.220151 20776 raft_consensus.cc:515] T ab43d85f64114d4ebf618930e43d9ed0 P e5256d91808b47c195bc9b4dbd7f2b87 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } attrs { replace: true } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: NON_VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: true } }
I20260709 13:04:50.206760 20733 raft_consensus.cc:493] T 6c5eebf646ad445a9d1b1adc319d7b16 P e61c3a8f61bb48f8a963c9480e53c168 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 127766fc592545a4997f7790f50f6076)
I20260709 13:04:50.230268 19410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ece3db938bc649d4a40a51522ed5259c" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
I20260709 13:04:50.232898 20076 leader_election.cc:400] T 833a2f0775ed407a94b8924ce50adb63 P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 2 election: Vote denied by peer e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891) with higher term. Message: Invalid argument: T 833a2f0775ed407a94b8924ce50adb63 P e61c3a8f61bb48f8a963c9480e53c168 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 127766fc592545a4997f7790f50f6076 for earlier term 2. Current term is 3.
I20260709 13:04:50.233809 19552 raft_consensus.cc:2468] T ece3db938bc649d4a40a51522ed5259c P e61c3a8f61bb48f8a963c9480e53c168 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 127766fc592545a4997f7790f50f6076 in term 3.
W20260709 13:04:50.234804 20982 log.cc:927] Time spent T ff9b0eddd810459b82d91c60777c10eb P 127766fc592545a4997f7790f50f6076: Append to log took a long time: real 0.053s	user 0.000s	sys 0.001s
I20260709 13:04:50.235948 20837 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet df751f992649444090e27965eb1af85d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:50.237207 20728 raft_consensus.cc:3060] T a08760e15aac4630a629431f56024dc8 P e61c3a8f61bb48f8a963c9480e53c168 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:50.246083 19304 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:44688 (request call id 221) took 3437 ms. Trace:
I20260709 13:04:50.227779 19409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "775c229504194560ba9589bc2199b089" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
I20260709 13:04:50.267056 19304 rpcz_store.cc:276] 0709 13:04:46.809180 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:46.813371 (+  4191us) service_pool.cc:224] Handling call
0709 13:04:50.245998 (+3432627us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1754650,"reported_tablets":10}
I20260709 13:04:50.266543 20852 raft_consensus.cc:2749] T ece3db938bc649d4a40a51522ed5259c P e61c3a8f61bb48f8a963c9480e53c168 [term 3 FOLLOWER]: Leader election lost for term 2. Reason: Vote denied by peer 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121) with higher term. Message: Invalid argument: T ece3db938bc649d4a40a51522ed5259c P 127766fc592545a4997f7790f50f6076 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate e61c3a8f61bb48f8a963c9480e53c168 for earlier term 2. Current term is 3.
I20260709 13:04:50.265054 20076 leader_election.cc:403] T 833a2f0775ed407a94b8924ce50adb63 P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 2 election: Cancelling election due to peer responding with higher term
I20260709 13:04:50.275985 19409 raft_consensus.cc:2468] T 775c229504194560ba9589bc2199b089 P e5256d91808b47c195bc9b4dbd7f2b87 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 127766fc592545a4997f7790f50f6076 in term 2.
I20260709 13:04:50.270583 20835 raft_consensus.cc:697] T 2725d2c4cb054f18b0fc8f735c15f6c2 P e5256d91808b47c195bc9b4dbd7f2b87 [term 3 LEADER]: Becoming Leader. State: Replica: e5256d91808b47c195bc9b4dbd7f2b87, State: Running, Role: LEADER
I20260709 13:04:50.278486 20835 consensus_queue.cc:237] T 2725d2c4cb054f18b0fc8f735c15f6c2 P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:50.272073 20871 raft_consensus.cc:515] T 1dc5b3532fe54f74876d02beffa2c230 P e5256d91808b47c195bc9b4dbd7f2b87 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:50.285048 20871 leader_election.cc:290] T 1dc5b3532fe54f74876d02beffa2c230 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 3 election: Requested vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:04:50.285148 20825 raft_consensus.cc:3055] T edd7d470b5014c9489be7f41f64355c9 P e5256d91808b47c195bc9b4dbd7f2b87 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:04:50.285622 19404 raft_consensus.cc:2468] T ece3db938bc649d4a40a51522ed5259c P e5256d91808b47c195bc9b4dbd7f2b87 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 2.
I20260709 13:04:50.271330 20106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48824d5acfbc485ebf8c2d944e7202de" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:04:50.294764 19482 raft_consensus.cc:1240] T ed7fdbcb96d14d418db9ca90a792588a P 0473d2b2d01f4459b1e90fd12cc7840e [term 3 LEADER]: Rejecting Update request from peer 127766fc592545a4997f7790f50f6076 for earlier term 2. Current term is 3. Ops: [2.5-2.5]
I20260709 13:04:50.295214 19481 raft_consensus.cc:2468] T 22196caba61445d3bec98a0aab3c337d P 0473d2b2d01f4459b1e90fd12cc7840e [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 3.
I20260709 13:04:50.299945 20776 leader_election.cc:290] T ab43d85f64114d4ebf618930e43d9ed0 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 3 election: Requested vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
W20260709 13:04:50.306988 20076 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.3:36891, user_credentials={real_user=slave}} blocked reactor thread for 74236.6us
I20260709 13:04:50.310388 20910 raft_consensus.cc:493] T 9962423cb4e54fcfa5de01daf68a86e7 P 127766fc592545a4997f7790f50f6076 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:50.310940 20910 raft_consensus.cc:515] T 9962423cb4e54fcfa5de01daf68a86e7 P 127766fc592545a4997f7790f50f6076 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:04:50.312565 20934 leader_election.cc:290] T 309c3ca0ca4b4f3ba129752ea2cb293b P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:04:50.312863 20910 leader_election.cc:290] T 9962423cb4e54fcfa5de01daf68a86e7 P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:04:50.313269 20891 raft_consensus.cc:2749] T 833a2f0775ed407a94b8924ce50adb63 P 127766fc592545a4997f7790f50f6076 [term 3 FOLLOWER]: Leader election lost for term 2. Reason: Vote denied by peer e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891) with higher term. Message: Invalid argument: T 833a2f0775ed407a94b8924ce50adb63 P e61c3a8f61bb48f8a963c9480e53c168 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 127766fc592545a4997f7790f50f6076 for earlier term 2. Current term is 3.
I20260709 13:04:50.313990 19559 raft_consensus.cc:1275] T 1efebf73c86e432baa55533136b6e12c P e61c3a8f61bb48f8a963c9480e53c168 [term 3 FOLLOWER]: Refusing update from remote peer 127766fc592545a4997f7790f50f6076: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:04:50.266906 20733 raft_consensus.cc:515] T 6c5eebf646ad445a9d1b1adc319d7b16 P e61c3a8f61bb48f8a963c9480e53c168 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:04:50.314117 20754 raft_consensus.cc:515] T 28af091831594f9d8e96482078cc7625 P e5256d91808b47c195bc9b4dbd7f2b87 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:50.285655 20825 raft_consensus.cc:740] T edd7d470b5014c9489be7f41f64355c9 P e5256d91808b47c195bc9b4dbd7f2b87 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: e5256d91808b47c195bc9b4dbd7f2b87, State: Running, Role: LEADER
I20260709 13:04:50.298388 19554 raft_consensus.cc:2468] T 76cb037fc9064d13b59a8969d897ce8c P e61c3a8f61bb48f8a963c9480e53c168 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 3.
I20260709 13:04:50.337334 19485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9962423cb4e54fcfa5de01daf68a86e7" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:04:50.315833 20843 raft_consensus.cc:515] T ef32ce6fdd0e40d382c79974f30295c6 P e5256d91808b47c195bc9b4dbd7f2b87 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:50.292111 20867 raft_consensus.cc:515] T fa8650e71aa14778b3d73721fc50d9fc P e5256d91808b47c195bc9b4dbd7f2b87 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:50.343415 19450 leader_election.cc:304] T 76cb037fc9064d13b59a8969d897ce8c P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:04:50.319304 20075 leader_election.cc:304] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 127766fc592545a4997f7790f50f6076; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:04:50.371701 20754 leader_election.cc:290] T 28af091831594f9d8e96482078cc7625 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 3 election: Requested vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:04:50.373107 19481 raft_consensus.cc:1275] T 1efebf73c86e432baa55533136b6e12c P 0473d2b2d01f4459b1e90fd12cc7840e [term 3 FOLLOWER]: Refusing update from remote peer 127766fc592545a4997f7790f50f6076: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:04:50.378249 20734 raft_consensus.cc:3060] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P 127766fc592545a4997f7790f50f6076 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:04:50.364224 20825 consensus_queue.cc:260] T edd7d470b5014c9489be7f41f64355c9 P e5256d91808b47c195bc9b4dbd7f2b87 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:50.385601 20818 leader_election.cc:290] T 28af091831594f9d8e96482078cc7625 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 3 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
W20260709 13:04:50.386237 20075 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.1:40321, user_credentials={real_user=slave}} blocked reactor thread for 70721.7us
W20260709 13:04:50.387495 20978 log.cc:927] Time spent T 14efcc79969f41babe5529c22d59156d P e5256d91808b47c195bc9b4dbd7f2b87: Append to log took a long time: real 0.363s	user 0.002s	sys 0.000s
I20260709 13:04:50.388384 20867 leader_election.cc:290] T fa8650e71aa14778b3d73721fc50d9fc P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 3 election: Requested vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:04:50.389696 20843 leader_election.cc:290] T ef32ce6fdd0e40d382c79974f30295c6 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 3 election: Requested vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:04:50.393594 19557 raft_consensus.cc:2468] T a08760e15aac4630a629431f56024dc8 P e61c3a8f61bb48f8a963c9480e53c168 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 2.
I20260709 13:04:50.394110 20837 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.StartTabletCopy from 127.0.0.1:46422 (request call id 351) took 4305 ms. Trace:
I20260709 13:04:50.398057 20106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "775c229504194560ba9589bc2199b089" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:04:50.399215 20106 raft_consensus.cc:2468] T 775c229504194560ba9589bc2199b089 P 127766fc592545a4997f7790f50f6076 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 2.
I20260709 13:04:50.399948 20733 leader_election.cc:290] T 6c5eebf646ad445a9d1b1adc319d7b16 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:04:50.400170 20837 rpcz_store.cc:276] 0709 13:04:46.089229 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:46.090022 (+   793us) service_pool.cc:224] Handling call
0709 13:04:46.295151 (+205129us) ts_tablet_manager.cc:934] T df751f992649444090e27965eb1af85d P 127766fc592545a4997f7790f50f6076: Initiating tablet copy from peer e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
0709 13:04:50.234743 (+3939592us) tablet_copy_client.cc:368] Tablet copy session begun
0709 13:04:50.383662 (+148919us) tablet_metadata.cc:665] Metadata flushed
0709 13:04:50.383784 (+   122us) tablet_copy_client.cc:497] Wrote new tablet metadata
0709 13:04:50.393390 (+  9606us) tablet_copy_client.cc:418] Wrote new consensus metadata
0709 13:04:50.393686 (+   296us) tablet_replica.cc:206] Creating consensus instance
0709 13:04:50.393988 (+   302us) ts_tablet_manager.cc:989] Replica registered.
0709 13:04:50.394054 (+    66us) inbound_call.cc:177] Queueing success response
Metrics: {"dns_us":94385,"tablet-copy.queue_time_us":147264,"thread_start_us":105326,"threads_started":2}
I20260709 13:04:50.402093 20837 tablet_copy_client.cc:806] T df751f992649444090e27965eb1af85d P 127766fc592545a4997f7790f50f6076: tablet copy: Starting download of 0 data blocks...
I20260709 13:04:50.402859 20837 tablet_copy_client.cc:670] T df751f992649444090e27965eb1af85d P 127766fc592545a4997f7790f50f6076: tablet copy: Starting download of 1 WAL segments...
W20260709 13:04:50.406080 19449 consensus_peers.cc:597] T 14935b3ddf914369822e4a0547aaa355 P 0473d2b2d01f4459b1e90fd12cc7840e -> Peer 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121): Couldn't send request to peer 127766fc592545a4997f7790f50f6076. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 14935b3ddf914369822e4a0547aaa355. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:50.407037 19449 leader_election.cc:304] T 775c229504194560ba9589bc2199b089 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, 127766fc592545a4997f7790f50f6076; no voters: 
I20260709 13:04:50.409518 19405 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "76cb037fc9064d13b59a8969d897ce8c"
dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
mode: GRACEFUL
new_leader_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
 from {username='slave'} at 127.0.0.1:37312
I20260709 13:04:50.410104 19405 raft_consensus.cc:606] T 76cb037fc9064d13b59a8969d897ce8c P e5256d91808b47c195bc9b4dbd7f2b87 [term 2 FOLLOWER]: Received request to transfer leadership to TS 0473d2b2d01f4459b1e90fd12cc7840e
I20260709 13:04:50.410396 19405 raft_consensus.cc:614] T 76cb037fc9064d13b59a8969d897ce8c P e5256d91808b47c195bc9b4dbd7f2b87 [term 2 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:04:50.413182 19375 leader_election.cc:304] T a08760e15aac4630a629431f56024dc8 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:04:50.414608 19405 raft_consensus.cc:1240] T 85c494af21f9457a85da47b9bc70c1fd P e5256d91808b47c195bc9b4dbd7f2b87 [term 2 LEADER]: Rejecting Update request from peer e61c3a8f61bb48f8a963c9480e53c168 for earlier term 1. Current term is 2. Ops: []
I20260709 13:04:50.412083 20873 consensus_queue.cc:1059] T 62c6c134d3d24a1ab144dd9ee6bc3f64 P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.004s
I20260709 13:04:50.419900 20873 raft_consensus.cc:3055] T 62c6c134d3d24a1ab144dd9ee6bc3f64 P e61c3a8f61bb48f8a963c9480e53c168 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:04:50.420197 20885 raft_consensus.cc:3055] T 85c494af21f9457a85da47b9bc70c1fd P e61c3a8f61bb48f8a963c9480e53c168 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:04:50.420324 20873 raft_consensus.cc:740] T 62c6c134d3d24a1ab144dd9ee6bc3f64 P e61c3a8f61bb48f8a963c9480e53c168 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: e61c3a8f61bb48f8a963c9480e53c168, State: Running, Role: LEADER
I20260709 13:04:50.420735 20885 raft_consensus.cc:740] T 85c494af21f9457a85da47b9bc70c1fd P e61c3a8f61bb48f8a963c9480e53c168 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e61c3a8f61bb48f8a963c9480e53c168, State: Running, Role: LEADER
I20260709 13:04:50.421324 20873 consensus_queue.cc:260] T 62c6c134d3d24a1ab144dd9ee6bc3f64 P e61c3a8f61bb48f8a963c9480e53c168 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:04:50.421597 20885 consensus_queue.cc:260] T 85c494af21f9457a85da47b9bc70c1fd P e61c3a8f61bb48f8a963c9480e53c168 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:04:50.422531 19484 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58294 (request call id 1238) took 1061 ms. Trace:
I20260709 13:04:50.422498 20873 raft_consensus.cc:3060] T 62c6c134d3d24a1ab144dd9ee6bc3f64 P e61c3a8f61bb48f8a963c9480e53c168 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:04:50.429010 19551 raft_consensus.cc:1240] T 96efeaaf1057492490e9a621f37e1a2d P e61c3a8f61bb48f8a963c9480e53c168 [term 3 FOLLOWER]: Rejecting Update request from peer 127766fc592545a4997f7790f50f6076 for earlier term 2. Current term is 3. Ops: []
I20260709 13:04:50.427747 20885 raft_consensus.cc:3060] T 85c494af21f9457a85da47b9bc70c1fd P e61c3a8f61bb48f8a963c9480e53c168 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:50.417862 20819 raft_consensus.cc:2804] T a08760e15aac4630a629431f56024dc8 P e5256d91808b47c195bc9b4dbd7f2b87 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:04:50.427511 20734 raft_consensus.cc:2749] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P 127766fc592545a4997f7790f50f6076 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:04:50.432786 20819 raft_consensus.cc:493] T a08760e15aac4630a629431f56024dc8 P e5256d91808b47c195bc9b4dbd7f2b87 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:50.433234 20819 raft_consensus.cc:3060] T a08760e15aac4630a629431f56024dc8 P e5256d91808b47c195bc9b4dbd7f2b87 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:04:50.437098 20977 log.cc:927] Time spent T 309c3ca0ca4b4f3ba129752ea2cb293b P 127766fc592545a4997f7790f50f6076: Append to log took a long time: real 0.389s	user 0.000s	sys 0.003s
I20260709 13:04:50.439131 19556 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40428 (request call id 1458) took 1152 ms. Trace:
I20260709 13:04:50.439595 19556 rpcz_store.cc:276] 0709 13:04:49.287044 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:49.681469 (+394425us) service_pool.cc:224] Handling call
0709 13:04:50.438956 (+757487us) spinlock_profiling.cc:243] Waited 274 ms on lock 0x7b540002eed4. stack: 00007f4a79de9343 00007f4a79de9240 00007f4a797781d4 00007f4a834b6304 00007f4a834b6299 00007f4a7ce71571 00007f4a7cf0c2fa 00007f4a81ecdb17 00007f4a7b4486d4 00007f4a7b448662 00007f4a7b448591 00007f4a7b44850c 00007f4a7b4477c2 00007f4a7b24348c 00007f4a7b2428c6 00007f4a7b24226f
0709 13:04:50.439075 (+   119us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":629502208}
I20260709 13:04:50.422966 19484 rpcz_store.cc:276] 0709 13:04:49.361321 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:49.386306 (+ 24985us) service_pool.cc:224] Handling call
0709 13:04:49.386626 (+   320us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:04:49.547274 (+160648us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:04:49.547318 (+    44us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:04:49.547864 (+   546us) log.cc:844] Serialized 26 byte log entry
0709 13:04:49.758982 (+211118us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:04:49.759014 (+    32us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:50.422157 (+663143us) spinlock_profiling.cc:243] Waited 160 ms on lock 0x7b54001bf8d4. stack: 00007f4a79de9343 00007f4a79de9240 00007f4a797781d4 00007f4a834b6304 00007f4a834b6299 00007f4a7ce71571 00007f4a7cf08e01 00007f4a7cf0783e 00007f4a81ecc419 00007f4a7b443bd4 00007f4a7b443b62 00007f4a7b443a91 00007f4a7b443a0c 00007f4a7b442cc2 00007f4a7b24348c 00007f4a7b2428c6
0709 13:04:50.422203 (+    46us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:04:50.422249 (+    46us) raft_consensus.cc:1685] finished
0709 13:04:50.422262 (+    13us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:50.422466 (+   204us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":398,"raft.queue_time_us":2020,"raft.run_cpu_time_us":120,"raft.run_wall_time_us":120,"spinlock_wait_cycles":367511680,"thread_start_us":134393,"threads_started":1,"wal-append.queue_time_us":204087}
I20260709 13:04:50.423668 20075 leader_election.cc:304] T 775c229504194560ba9589bc2199b089 P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 127766fc592545a4997f7790f50f6076, e5256d91808b47c195bc9b4dbd7f2b87; no voters: 0473d2b2d01f4459b1e90fd12cc7840e
I20260709 13:04:50.427044 20733 raft_consensus.cc:493] T 1efebf73c86e432baa55533136b6e12c P e61c3a8f61bb48f8a963c9480e53c168 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:50.441428 19405 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d1e5873a19244c5ebbcd38e126796ee7"
dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
mode: GRACEFUL
new_leader_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
 from {username='slave'} at 127.0.0.1:37312
I20260709 13:04:50.429124 20737 consensus_queue.cc:1048] T 1efebf73c86e432baa55533136b6e12c P 127766fc592545a4997f7790f50f6076 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.013s
I20260709 13:04:50.445782 19405 raft_consensus.cc:606] T d1e5873a19244c5ebbcd38e126796ee7 P e5256d91808b47c195bc9b4dbd7f2b87 [term 2 LEADER]: Received request to transfer leadership to TS 0473d2b2d01f4459b1e90fd12cc7840e
I20260709 13:04:50.446228 19483 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58294 (request call id 1243) took 1020 ms. Trace:
I20260709 13:04:50.448848 19483 rpcz_store.cc:276] 0709 13:04:49.425656 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:49.699085 (+273429us) service_pool.cc:224] Handling call
0709 13:04:50.446069 (+746984us) spinlock_profiling.cc:243] Waited 262 ms on lock 0x7b54000a9454. stack: 00007f4a79de9343 00007f4a79de9240 00007f4a797781d4 00007f4a834b6304 00007f4a834b6299 00007f4a7ce71571 00007f4a7cf0c2fa 00007f4a81ecdb17 00007f4a7b4486d4 00007f4a7b448662 00007f4a7b448591 00007f4a7b44850c 00007f4a7b4477c2 00007f4a7b24348c 00007f4a7b2428c6 00007f4a7b24226f
0709 13:04:50.446181 (+   112us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":602423680}
I20260709 13:04:50.443269 20734 consensus_queue.cc:1059] T 96efeaaf1057492490e9a621f37e1a2d P 127766fc592545a4997f7790f50f6076 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.008s
I20260709 13:04:50.445060 20837 tablet_copy_client.cc:538] T df751f992649444090e27965eb1af85d P 127766fc592545a4997f7790f50f6076: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:04:50.452895 19405 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ece3db938bc649d4a40a51522ed5259c"
dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
mode: GRACEFUL
new_leader_uuid: "127766fc592545a4997f7790f50f6076"
 from {username='slave'} at 127.0.0.1:37312
I20260709 13:04:50.453450 19560 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40438 (request call id 1192) took 1175 ms. Trace:
I20260709 13:04:50.454016 20911 raft_consensus.cc:2804] T 775c229504194560ba9589bc2199b089 P 127766fc592545a4997f7790f50f6076 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:04:50.451610 20642 raft_consensus.cc:493] T e381f1d6b8184797ad142de49be225a8 P e5256d91808b47c195bc9b4dbd7f2b87 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:50.467427 20911 raft_consensus.cc:697] T 775c229504194560ba9589bc2199b089 P 127766fc592545a4997f7790f50f6076 [term 2 LEADER]: Becoming Leader. State: Replica: 127766fc592545a4997f7790f50f6076, State: Running, Role: LEADER
I20260709 13:04:50.451836 20733 raft_consensus.cc:515] T 1efebf73c86e432baa55533136b6e12c P e61c3a8f61bb48f8a963c9480e53c168 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:04:50.465385 19405 raft_consensus.cc:606] T ece3db938bc649d4a40a51522ed5259c P e5256d91808b47c195bc9b4dbd7f2b87 [term 2 FOLLOWER]: Received request to transfer leadership to TS 127766fc592545a4997f7790f50f6076
I20260709 13:04:50.469533 19405 raft_consensus.cc:614] T ece3db938bc649d4a40a51522ed5259c P e5256d91808b47c195bc9b4dbd7f2b87 [term 2 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:04:50.470805 18300 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 13:04:50.471159 20733 leader_election.cc:290] T 1efebf73c86e432baa55533136b6e12c P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:04:50.465364 19560 rpcz_store.cc:276] 0709 13:04:49.277674 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:49.277789 (+   115us) service_pool.cc:224] Handling call
0709 13:04:49.355224 (+ 77435us) spinlock_profiling.cc:243] Waited 35.5 ms on lock 0x7b5800003998. stack: 00007f4a79de9343 00007f4a79de9240 00007f4a797781d4 00007f4a834b6304 00007f4a834b6299 00007f4a79ca3db1 00007f4a79de3b71 00007f4a79de3a22 00007f4a82cfcc09 00007f4a81e56ee0 00007f4a81f200ab 00007f4a81f20131 00007f4a81ee1fc0 00007f4a81ecc929 00007f4a81ecc3d2 00007f4a7b443bd4
0709 13:04:49.355399 (+   175us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:04:49.387320 (+ 31921us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:04:49.387348 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:04:49.402366 (+ 15018us) log.cc:844] Serialized 26 byte log entry
0709 13:04:49.536069 (+133703us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:04:49.645515 (+109446us) log.cc:844] Serialized 14 byte log entry
0709 13:04:49.645795 (+   280us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:49.645865 (+    70us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:04:50.451091 (+805226us) spinlock_profiling.cc:243] Waited 6.11 ms on lock 0x7b240020d9f8. stack: 00007f4a79de9343 00007f4a79de9240 00007f4a797781d4 00007f4a834b6304 00007f4a834b6299 00007f4a79ca3db1 00007f4a79ca19c4 00007f4a79c9facb 00007f4a79e5adc9 00007f4a79e5aa55 00007f4a79e59fb0 00007f4a7cad0488 00007f4a7cad0be8 00007f4a7caa8398 00007f4a7caa376a 00007f4a7caa2bb6
0709 13:04:50.453220 (+  2129us) raft_consensus.cc:1685] finished
0709 13:04:50.453247 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:50.453393 (+   146us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":31526,"prepare.queue_time_us":14363,"prepare.run_cpu_time_us":60,"prepare.run_wall_time_us":685,"raft.queue_time_us":31723,"raft.run_cpu_time_us":354,"raft.run_wall_time_us":8244,"spinlock_wait_cycles":95786112,"thread_start_us":208857,"threads_started":2,"wal-append.queue_time_us":210290}
I20260709 13:04:50.467684 20642 raft_consensus.cc:515] T e381f1d6b8184797ad142de49be225a8 P e5256d91808b47c195bc9b4dbd7f2b87 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:50.468879 20911 consensus_queue.cc:237] T 775c229504194560ba9589bc2199b089 P 127766fc592545a4997f7790f50f6076 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:04:50.472019 18300 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:04:50.465997 19404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9962423cb4e54fcfa5de01daf68a86e7" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:04:50.476189 20107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c5eebf646ad445a9d1b1adc319d7b16" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:04:50.476567 19404 raft_consensus.cc:2468] T 9962423cb4e54fcfa5de01daf68a86e7 P e5256d91808b47c195bc9b4dbd7f2b87 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 127766fc592545a4997f7790f50f6076 in term 3.
I20260709 13:04:50.477272 20642 leader_election.cc:290] T e381f1d6b8184797ad142de49be225a8 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:04:50.479293 19477 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58294 (request call id 1245) took 1028 ms. Trace:
I20260709 13:04:50.479722 19477 rpcz_store.cc:276] 0709 13:04:49.450657 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:49.504118 (+ 53461us) service_pool.cc:224] Handling call
0709 13:04:50.479123 (+975005us) spinlock_profiling.cc:243] Waited 45.5 ms on lock 0x7b540029de54. stack: 00007f4a79de9343 00007f4a79de9240 00007f4a797781d4 00007f4a834b6304 00007f4a834b6299 00007f4a7ce71571 00007f4a7cf0c2fa 00007f4a81ecdb17 00007f4a7b4486d4 00007f4a7b448662 00007f4a7b448591 00007f4a7b44850c 00007f4a7b4477c2 00007f4a7b24348c 00007f4a7b2428c6 00007f4a7b24226f
0709 13:04:50.479236 (+   113us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":104707840}
W20260709 13:04:50.481312 19450 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.3:36891, user_credentials={real_user=slave}} blocked reactor thread for 138039us
I20260709 13:04:50.481503 20883 raft_consensus.cc:2804] T 76cb037fc9064d13b59a8969d897ce8c P 0473d2b2d01f4459b1e90fd12cc7840e [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:04:50.482093 20883 raft_consensus.cc:697] T 76cb037fc9064d13b59a8969d897ce8c P 0473d2b2d01f4459b1e90fd12cc7840e [term 3 LEADER]: Becoming Leader. State: Replica: 0473d2b2d01f4459b1e90fd12cc7840e, State: Running, Role: LEADER
I20260709 13:04:50.482889 19377 leader_election.cc:304] T ff75a1d4cb1f493db8f71ddc136ba9ab P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:04:50.482986 20883 consensus_queue.cc:237] T 76cb037fc9064d13b59a8969d897ce8c P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:50.484067 20642 raft_consensus.cc:3060] T ff75a1d4cb1f493db8f71ddc136ba9ab P e5256d91808b47c195bc9b4dbd7f2b87 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:04:50.485103 20112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36f6ba92b9ba46babe4ebd6c02e5fbd9" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076"
W20260709 13:04:50.490057 19449 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.4:43121, user_credentials={real_user=slave}} blocked reactor thread for 83128.3us
I20260709 13:04:50.490869 20936 raft_consensus.cc:2804] T 775c229504194560ba9589bc2199b089 P 0473d2b2d01f4459b1e90fd12cc7840e [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:04:50.491286 20936 raft_consensus.cc:493] T 775c229504194560ba9589bc2199b089 P 0473d2b2d01f4459b1e90fd12cc7840e [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:50.491585 19477 raft_consensus.cc:1240] T a08760e15aac4630a629431f56024dc8 P 0473d2b2d01f4459b1e90fd12cc7840e [term 2 FOLLOWER]: Rejecting Update request from peer e61c3a8f61bb48f8a963c9480e53c168 for earlier term 1. Current term is 2. Ops: []
I20260709 13:04:50.491902 19556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa8650e71aa14778b3d73721fc50d9fc" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:04:50.492118 19483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76cb037fc9064d13b59a8969d897ce8c" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:04:50.491624 20936 raft_consensus.cc:3060] T 775c229504194560ba9589bc2199b089 P 0473d2b2d01f4459b1e90fd12cc7840e [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:04:50.493312 19481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86a6797bdfe94fa496c050ceae4bd0d9" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:04:50.492506 19556 raft_consensus.cc:3060] T fa8650e71aa14778b3d73721fc50d9fc P e61c3a8f61bb48f8a963c9480e53c168 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:04:50.493716 19478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28af091831594f9d8e96482078cc7625" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:04:50.494081 19481 raft_consensus.cc:2368] T 86a6797bdfe94fa496c050ceae4bd0d9 P 0473d2b2d01f4459b1e90fd12cc7840e [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate e61c3a8f61bb48f8a963c9480e53c168 for earlier term 2. Current term is 3.
I20260709 13:04:50.494436 19478 raft_consensus.cc:2368] T 28af091831594f9d8e96482078cc7625 P 0473d2b2d01f4459b1e90fd12cc7840e [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate e61c3a8f61bb48f8a963c9480e53c168 for earlier term 2. Current term is 3.
I20260709 13:04:50.495354 19480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff75a1d4cb1f493db8f71ddc136ba9ab" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:04:50.496740 19486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c5eebf646ad445a9d1b1adc319d7b16" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:04:50.497797 19560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef32ce6fdd0e40d382c79974f30295c6" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:04:50.498417 19560 raft_consensus.cc:3060] T ef32ce6fdd0e40d382c79974f30295c6 P e61c3a8f61bb48f8a963c9480e53c168 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:04:50.499979 19551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc225c93219c45538b53a1bd3d387e4d" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:04:50.500344 20106 raft_consensus.cc:1275] T 9962423cb4e54fcfa5de01daf68a86e7 P 127766fc592545a4997f7790f50f6076 [term 3 FOLLOWER]: Refusing update from remote peer 0473d2b2d01f4459b1e90fd12cc7840e: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 5. (term mismatch)
I20260709 13:04:50.500200 20936 raft_consensus.cc:515] T 775c229504194560ba9589bc2199b089 P 0473d2b2d01f4459b1e90fd12cc7840e [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:04:50.501407 19377 leader_election.cc:304] T 309c3ca0ca4b4f3ba129752ea2cb293b P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:04:50.501781 20825 raft_consensus.cc:3060] T edd7d470b5014c9489be7f41f64355c9 P e5256d91808b47c195bc9b4dbd7f2b87 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:04:50.502055 20642 raft_consensus.cc:2749] T ff75a1d4cb1f493db8f71ddc136ba9ab P e5256d91808b47c195bc9b4dbd7f2b87 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:04:50.503319 19555 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40428 (request call id 1463) took 1214 ms. Trace:
I20260709 13:04:50.524055 19555 rpcz_store.cc:276] 0709 13:04:49.288745 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:49.641154 (+352409us) service_pool.cc:224] Handling call
0709 13:04:50.503172 (+862018us) spinlock_profiling.cc:243] Waited 300 ms on lock 0x7b54000dfa54. stack: 00007f4a79de9343 00007f4a79de9240 00007f4a797781d4 00007f4a834b6304 00007f4a834b6299 00007f4a7ce71571 00007f4a7cf0c2fa 00007f4a81ecdb17 00007f4a7b4486d4 00007f4a7b448662 00007f4a7b448591 00007f4a7b44850c 00007f4a7b4477c2 00007f4a7b24348c 00007f4a7b2428c6 00007f4a7b24226f
0709 13:04:50.503265 (+    93us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":690715520}
I20260709 13:04:50.504534 19483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48824d5acfbc485ebf8c2d944e7202de" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:04:50.524871 19485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dc5b3532fe54f74876d02beffa2c230" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:04:50.505136 19478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1efebf73c86e432baa55533136b6e12c" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:04:50.525395 19485 raft_consensus.cc:3060] T 1dc5b3532fe54f74876d02beffa2c230 P 0473d2b2d01f4459b1e90fd12cc7840e [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:04:50.525576 19478 raft_consensus.cc:2468] T 1efebf73c86e432baa55533136b6e12c P 0473d2b2d01f4459b1e90fd12cc7840e [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 3.
I20260709 13:04:50.526364 19478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28af091831594f9d8e96482078cc7625" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:04:50.505448 20112 raft_consensus.cc:2468] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P 127766fc592545a4997f7790f50f6076 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 4.
I20260709 13:04:50.526937 19478 raft_consensus.cc:2393] T 28af091831594f9d8e96482078cc7625 P 0473d2b2d01f4459b1e90fd12cc7840e [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate e5256d91808b47c195bc9b4dbd7f2b87 in current term 3: Already voted for candidate 0473d2b2d01f4459b1e90fd12cc7840e in this term.
I20260709 13:04:50.510131 19557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7be9efa6559648dbb5a0f7684c4542d1" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:04:50.527364 19557 raft_consensus.cc:3060] T 7be9efa6559648dbb5a0f7684c4542d1 P e61c3a8f61bb48f8a963c9480e53c168 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:04:50.511044 19553 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40428 (request call id 1466) took 1013 ms. Trace:
I20260709 13:04:50.514045 19526 leader_election.cc:400] T 86a6797bdfe94fa496c050ceae4bd0d9 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 2 election: Vote denied by peer 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257) with higher term. Message: Invalid argument: T 86a6797bdfe94fa496c050ceae4bd0d9 P 0473d2b2d01f4459b1e90fd12cc7840e [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate e61c3a8f61bb48f8a963c9480e53c168 for earlier term 2. Current term is 3.
I20260709 13:04:50.531075 19526 leader_election.cc:403] T 86a6797bdfe94fa496c050ceae4bd0d9 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 2 election: Cancelling election due to peer responding with higher term
W20260709 13:04:50.515030 19376 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:50.522938 20109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1efebf73c86e432baa55533136b6e12c" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:04:50.533429 19555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28af091831594f9d8e96482078cc7625" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:04:50.533977 19555 raft_consensus.cc:3060] T 28af091831594f9d8e96482078cc7625 P e61c3a8f61bb48f8a963c9480e53c168 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:04:50.535269 19478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e381f1d6b8184797ad142de49be225a8" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:04:50.536150 19478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef32ce6fdd0e40d382c79974f30295c6" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:04:50.536645 19478 raft_consensus.cc:2393] T ef32ce6fdd0e40d382c79974f30295c6 P 0473d2b2d01f4459b1e90fd12cc7840e [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate e5256d91808b47c195bc9b4dbd7f2b87 in current term 3: Already voted for candidate 0473d2b2d01f4459b1e90fd12cc7840e in this term.
I20260709 13:04:50.516613 19449 leader_election.cc:304] T 46c5bfeecc314717bffe987e6844b6d0 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87; no voters: 
I20260709 13:04:50.518635 20106 pending_rounds.cc:85] T 9962423cb4e54fcfa5de01daf68a86e7 P 127766fc592545a4997f7790f50f6076: Aborting all ops after (but not including) 4
I20260709 13:04:50.521377 19559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "309c3ca0ca4b4f3ba129752ea2cb293b" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:04:50.506496 19484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96efeaaf1057492490e9a621f37e1a2d" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:04:50.542526 19484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa8650e71aa14778b3d73721fc50d9fc" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:04:50.543174 19484 raft_consensus.cc:2393] T fa8650e71aa14778b3d73721fc50d9fc P 0473d2b2d01f4459b1e90fd12cc7840e [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate e5256d91808b47c195bc9b4dbd7f2b87 in current term 3: Already voted for candidate 0473d2b2d01f4459b1e90fd12cc7840e in this term.
I20260709 13:04:50.540220 19526 leader_election.cc:400] T 28af091831594f9d8e96482078cc7625 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 2 election: Vote denied by peer 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257) with higher term. Message: Invalid argument: T 28af091831594f9d8e96482078cc7625 P 0473d2b2d01f4459b1e90fd12cc7840e [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate e61c3a8f61bb48f8a963c9480e53c168 for earlier term 2. Current term is 3.
I20260709 13:04:50.543484 19526 leader_election.cc:403] T 28af091831594f9d8e96482078cc7625 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 2 election: Cancelling election due to peer responding with higher term
I20260709 13:04:50.518004 19556 raft_consensus.cc:2468] T fa8650e71aa14778b3d73721fc50d9fc P e61c3a8f61bb48f8a963c9480e53c168 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 3.
I20260709 13:04:50.544175 19483 raft_consensus.cc:1275] T 14efcc79969f41babe5529c22d59156d P 0473d2b2d01f4459b1e90fd12cc7840e [term 4 FOLLOWER]: Refusing update from remote peer e5256d91808b47c195bc9b4dbd7f2b87: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:04:50.546381 19405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b08304a0a02b42d7840c4e8ee9a6bd1a" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:04:50.547217 19410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc225c93219c45538b53a1bd3d387e4d" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:04:50.547932 19410 raft_consensus.cc:2393] T bc225c93219c45538b53a1bd3d387e4d P e5256d91808b47c195bc9b4dbd7f2b87 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0473d2b2d01f4459b1e90fd12cc7840e in current term 3: Already voted for candidate e5256d91808b47c195bc9b4dbd7f2b87 in this term.
I20260709 13:04:50.540735 20803 raft_consensus.cc:2804] T 46c5bfeecc314717bffe987e6844b6d0 P 0473d2b2d01f4459b1e90fd12cc7840e [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:04:50.540985 20864 raft_consensus.cc:493] T 46c5bfeecc314717bffe987e6844b6d0 P e61c3a8f61bb48f8a963c9480e53c168 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:50.550894 19409 raft_consensus.cc:1275] T 9962423cb4e54fcfa5de01daf68a86e7 P e5256d91808b47c195bc9b4dbd7f2b87 [term 3 FOLLOWER]: Refusing update from remote peer 0473d2b2d01f4459b1e90fd12cc7840e: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:04:50.550715 20864 raft_consensus.cc:515] T 46c5bfeecc314717bffe987e6844b6d0 P e61c3a8f61bb48f8a963c9480e53c168 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:50.551720 19404 raft_consensus.cc:1275] T e381f1d6b8184797ad142de49be225a8 P e5256d91808b47c195bc9b4dbd7f2b87 [term 3 FOLLOWER]: Refusing update from remote peer 0473d2b2d01f4459b1e90fd12cc7840e: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:04:50.530925 19553 rpcz_store.cc:276] 0709 13:04:49.497655 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:49.635670 (+138015us) service_pool.cc:224] Handling call
0709 13:04:50.510814 (+875144us) spinlock_profiling.cc:243] Waited 216 ms on lock 0x7b5400341a54. stack: 00007f4a79de9343 00007f4a79de9240 00007f4a797781d4 00007f4a834b6304 00007f4a834b6299 00007f4a7ce71571 00007f4a7cf0c2fa 00007f4a81ecdb17 00007f4a7b4486d4 00007f4a7b448662 00007f4a7b448591 00007f4a7b44850c 00007f4a7b4477c2 00007f4a7b24348c 00007f4a7b2428c6 00007f4a7b24226f
0709 13:04:50.510967 (+   153us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":496801664}
I20260709 13:04:50.553436 19481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc225c93219c45538b53a1bd3d387e4d" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:04:50.553668 20864 leader_election.cc:290] T 46c5bfeecc314717bffe987e6844b6d0 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:04:50.554171 19481 raft_consensus.cc:2393] T bc225c93219c45538b53a1bd3d387e4d P 0473d2b2d01f4459b1e90fd12cc7840e [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate e5256d91808b47c195bc9b4dbd7f2b87 in current term 3: Already voted for candidate 0473d2b2d01f4459b1e90fd12cc7840e in this term.
I20260709 13:04:50.554745 20106 pending_rounds.cc:107] T 9962423cb4e54fcfa5de01daf68a86e7 P 127766fc592545a4997f7790f50f6076: Aborting uncommitted NO_OP operation due to leader change: 2.5
I20260709 13:04:50.555085 20106 raft_consensus.cc:2889] T 9962423cb4e54fcfa5de01daf68a86e7 P 127766fc592545a4997f7790f50f6076 [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:04:50.541666 19477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7be9efa6559648dbb5a0f7684c4542d1" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:04:50.556237 19477 raft_consensus.cc:2368] T 7be9efa6559648dbb5a0f7684c4542d1 P 0473d2b2d01f4459b1e90fd12cc7840e [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate e61c3a8f61bb48f8a963c9480e53c168 for earlier term 2. Current term is 3.
I20260709 13:04:50.523422 20776 raft_consensus.cc:2749] T 309c3ca0ca4b4f3ba129752ea2cb293b P e5256d91808b47c195bc9b4dbd7f2b87 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:04:50.521031 19551 raft_consensus.cc:3060] T bc225c93219c45538b53a1bd3d387e4d P e61c3a8f61bb48f8a963c9480e53c168 [term 1 FOLLOWER]: Advancing to term 3
I20260709 13:04:50.559113 19404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46c5bfeecc314717bffe987e6844b6d0" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:04:50.559857 19404 raft_consensus.cc:2468] T 46c5bfeecc314717bffe987e6844b6d0 P e5256d91808b47c195bc9b4dbd7f2b87 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 4.
I20260709 13:04:50.560683 19526 leader_election.cc:304] T 1efebf73c86e432baa55533136b6e12c P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:04:50.565227 19408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff75a1d4cb1f493db8f71ddc136ba9ab" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
I20260709 13:04:50.567596 19411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f93ee515a9c14139bf566522ed8232f3" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
I20260709 13:04:50.564718 19407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dc5b3532fe54f74876d02beffa2c230" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:04:50.568172 19411 raft_consensus.cc:3060] T f93ee515a9c14139bf566522ed8232f3 P e5256d91808b47c195bc9b4dbd7f2b87 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:04:50.561728 19450 leader_election.cc:304] T fa8650e71aa14778b3d73721fc50d9fc P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:04:50.567031 19405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1b10566f45d4a7d9029858330e02d5b" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:04:50.566689 19409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4509b76741dc428e9201c70c1658da13" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:04:50.568851 19407 raft_consensus.cc:2393] T 1dc5b3532fe54f74876d02beffa2c230 P e5256d91808b47c195bc9b4dbd7f2b87 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0473d2b2d01f4459b1e90fd12cc7840e in current term 3: Already voted for candidate e5256d91808b47c195bc9b4dbd7f2b87 in this term.
I20260709 13:04:50.566447 19410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86a6797bdfe94fa496c050ceae4bd0d9" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
I20260709 13:04:50.569484 19410 raft_consensus.cc:3060] T 86a6797bdfe94fa496c050ceae4bd0d9 P e5256d91808b47c195bc9b4dbd7f2b87 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:04:50.569521 19409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa8650e71aa14778b3d73721fc50d9fc" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
I20260709 13:04:50.569648 19405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28af091831594f9d8e96482078cc7625" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
I20260709 13:04:50.570422 19409 raft_consensus.cc:2393] T fa8650e71aa14778b3d73721fc50d9fc P e5256d91808b47c195bc9b4dbd7f2b87 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 0473d2b2d01f4459b1e90fd12cc7840e in current term 3: Already voted for candidate e5256d91808b47c195bc9b4dbd7f2b87 in this term.
I20260709 13:04:50.570765 19485 raft_consensus.cc:2468] T 1dc5b3532fe54f74876d02beffa2c230 P 0473d2b2d01f4459b1e90fd12cc7840e [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 3.
I20260709 13:04:50.571833 19405 raft_consensus.cc:2393] T 28af091831594f9d8e96482078cc7625 P e5256d91808b47c195bc9b4dbd7f2b87 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 0473d2b2d01f4459b1e90fd12cc7840e in current term 3: Already voted for candidate e5256d91808b47c195bc9b4dbd7f2b87 in this term.
I20260709 13:04:50.572212 19407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "775c229504194560ba9589bc2199b089" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:04:50.572777 19407 raft_consensus.cc:2468] T 775c229504194560ba9589bc2199b089 P e5256d91808b47c195bc9b4dbd7f2b87 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 2.
W20260709 13:04:50.573043 19377 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.2:46257, user_credentials={real_user=slave}} blocked reactor thread for 45393.1us
I20260709 13:04:50.575074 20803 raft_consensus.cc:697] T 46c5bfeecc314717bffe987e6844b6d0 P 0473d2b2d01f4459b1e90fd12cc7840e [term 4 LEADER]: Becoming Leader. State: Replica: 0473d2b2d01f4459b1e90fd12cc7840e, State: Running, Role: LEADER
I20260709 13:04:50.575989 19402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36f6ba92b9ba46babe4ebd6c02e5fbd9" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:04:50.576072 20803 consensus_queue.cc:237] T 46c5bfeecc314717bffe987e6844b6d0 P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:50.577570 19407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef32ce6fdd0e40d382c79974f30295c6" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
I20260709 13:04:50.561916 20737 raft_consensus.cc:3055] T 96efeaaf1057492490e9a621f37e1a2d P 127766fc592545a4997f7790f50f6076 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:04:50.578891 20818 raft_consensus.cc:493] T 2725d2c4cb054f18b0fc8f735c15f6c2 P 0473d2b2d01f4459b1e90fd12cc7840e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e61c3a8f61bb48f8a963c9480e53c168)
I20260709 13:04:50.579124 20737 raft_consensus.cc:740] T 96efeaaf1057492490e9a621f37e1a2d P 127766fc592545a4997f7790f50f6076 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 127766fc592545a4997f7790f50f6076, State: Running, Role: LEADER
I20260709 13:04:50.579563 20818 raft_consensus.cc:515] T 2725d2c4cb054f18b0fc8f735c15f6c2 P 0473d2b2d01f4459b1e90fd12cc7840e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:50.580026 20737 consensus_queue.cc:260] T 96efeaaf1057492490e9a621f37e1a2d P 127766fc592545a4997f7790f50f6076 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:04:50.581279 20737 raft_consensus.cc:3060] T 96efeaaf1057492490e9a621f37e1a2d P 127766fc592545a4997f7790f50f6076 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:04:50.581758 20818 leader_election.cc:290] T 2725d2c4cb054f18b0fc8f735c15f6c2 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:04:50.582690 19407 raft_consensus.cc:2393] T ef32ce6fdd0e40d382c79974f30295c6 P e5256d91808b47c195bc9b4dbd7f2b87 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 0473d2b2d01f4459b1e90fd12cc7840e in current term 3: Already voted for candidate e5256d91808b47c195bc9b4dbd7f2b87 in this term.
I20260709 13:04:50.583408 20076 leader_election.cc:304] T ece3db938bc649d4a40a51522ed5259c P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 127766fc592545a4997f7790f50f6076, e61c3a8f61bb48f8a963c9480e53c168; no voters: e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:04:50.576867 19402 raft_consensus.cc:2368] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P e5256d91808b47c195bc9b4dbd7f2b87 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0473d2b2d01f4459b1e90fd12cc7840e for earlier term 3. Current term is 4.
I20260709 13:04:50.585109 19407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7be9efa6559648dbb5a0f7684c4542d1" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
I20260709 13:04:50.586064 19407 raft_consensus.cc:2393] T 7be9efa6559648dbb5a0f7684c4542d1 P e5256d91808b47c195bc9b4dbd7f2b87 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 0473d2b2d01f4459b1e90fd12cc7840e in current term 3: Already voted for candidate e5256d91808b47c195bc9b4dbd7f2b87 in this term.
I20260709 13:04:50.586158 19409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc225c93219c45538b53a1bd3d387e4d" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
I20260709 13:04:50.587239 19409 raft_consensus.cc:2393] T bc225c93219c45538b53a1bd3d387e4d P e5256d91808b47c195bc9b4dbd7f2b87 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 0473d2b2d01f4459b1e90fd12cc7840e in current term 3: Already voted for candidate e5256d91808b47c195bc9b4dbd7f2b87 in this term.
I20260709 13:04:50.585230 19405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "309c3ca0ca4b4f3ba129752ea2cb293b" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
W20260709 13:04:50.590145 20078 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.2:46257, user_credentials={real_user=slave}} blocked reactor thread for 68401.7us
I20260709 13:04:50.567760 20873 raft_consensus.cc:3060] T 86a6797bdfe94fa496c050ceae4bd0d9 P e61c3a8f61bb48f8a963c9480e53c168 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:04:50.603147 19526 leader_election.cc:304] T 96efeaaf1057492490e9a621f37e1a2d P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e61c3a8f61bb48f8a963c9480e53c168; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, 127766fc592545a4997f7790f50f6076
I20260709 13:04:50.620718 19526 leader_election.cc:304] T 48824d5acfbc485ebf8c2d944e7202de P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e61c3a8f61bb48f8a963c9480e53c168; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, 127766fc592545a4997f7790f50f6076
I20260709 13:04:50.621845 19526 leader_election.cc:400] T 7be9efa6559648dbb5a0f7684c4542d1 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 2 election: Vote denied by peer 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257) with higher term. Message: Invalid argument: T 7be9efa6559648dbb5a0f7684c4542d1 P 0473d2b2d01f4459b1e90fd12cc7840e [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate e61c3a8f61bb48f8a963c9480e53c168 for earlier term 2. Current term is 3.
I20260709 13:04:50.622130 19526 leader_election.cc:403] T 7be9efa6559648dbb5a0f7684c4542d1 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 2 election: Cancelling election due to peer responding with higher term
I20260709 13:04:50.608856 19408 raft_consensus.cc:2468] T ff75a1d4cb1f493db8f71ddc136ba9ab P e5256d91808b47c195bc9b4dbd7f2b87 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 3.
I20260709 13:04:50.608996 19411 raft_consensus.cc:2468] T f93ee515a9c14139bf566522ed8232f3 P e5256d91808b47c195bc9b4dbd7f2b87 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 3.
I20260709 13:04:50.608767 19560 raft_consensus.cc:2468] T ef32ce6fdd0e40d382c79974f30295c6 P e61c3a8f61bb48f8a963c9480e53c168 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 3.
I20260709 13:04:50.611183 19449 leader_election.cc:304] T b08304a0a02b42d7840c4e8ee9a6bd1a P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e; no voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:04:50.561918 20864 raft_consensus.cc:493] T 7f575b143b844aa096b50997dad3516a P e61c3a8f61bb48f8a963c9480e53c168 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e5256d91808b47c195bc9b4dbd7f2b87)
I20260709 13:04:50.615327 19523 leader_election.cc:304] T f93ee515a9c14139bf566522ed8232f3 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168; no voters: 0473d2b2d01f4459b1e90fd12cc7840e
I20260709 13:04:50.606392 20110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "775c229504194560ba9589bc2199b089" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076"
I20260709 13:04:50.617343 19556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7be9efa6559648dbb5a0f7684c4542d1" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:04:50.619294 20109 raft_consensus.cc:1275] T ed7fdbcb96d14d418db9ca90a792588a P 127766fc592545a4997f7790f50f6076 [term 3 FOLLOWER]: Refusing update from remote peer 0473d2b2d01f4459b1e90fd12cc7840e: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 5. (term mismatch)
I20260709 13:04:50.632295 20109 pending_rounds.cc:85] T ed7fdbcb96d14d418db9ca90a792588a P 127766fc592545a4997f7790f50f6076: Aborting all ops after (but not including) 4
I20260709 13:04:50.632628 20109 pending_rounds.cc:107] T ed7fdbcb96d14d418db9ca90a792588a P 127766fc592545a4997f7790f50f6076: Aborting uncommitted NO_OP operation due to leader change: 2.5
I20260709 13:04:50.632930 20109 raft_consensus.cc:2889] T ed7fdbcb96d14d418db9ca90a792588a P 127766fc592545a4997f7790f50f6076 [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:04:50.635679 19374 leader_election.cc:304] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 127766fc592545a4997f7790f50f6076, e5256d91808b47c195bc9b4dbd7f2b87; no voters: 
I20260709 13:04:50.606922 19409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "775c229504194560ba9589bc2199b089" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
I20260709 13:04:50.637208 19409 raft_consensus.cc:3060] T 775c229504194560ba9589bc2199b089 P e5256d91808b47c195bc9b4dbd7f2b87 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:04:50.576104 20936 leader_election.cc:290] T 775c229504194560ba9589bc2199b089 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 3 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:04:50.607303 19407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2725d2c4cb054f18b0fc8f735c15f6c2" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
W20260709 13:04:50.609723 19450 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.3:36891, user_credentials={real_user=slave}} blocked reactor thread for 48063.9us
I20260709 13:04:50.594388 19557 raft_consensus.cc:2468] T 7be9efa6559648dbb5a0f7684c4542d1 P e61c3a8f61bb48f8a963c9480e53c168 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 3.
I20260709 13:04:50.619134 19410 raft_consensus.cc:2468] T 86a6797bdfe94fa496c050ceae4bd0d9 P e5256d91808b47c195bc9b4dbd7f2b87 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 3.
I20260709 13:04:50.537496 20998 consensus_queue.cc:1048] T 1efebf73c86e432baa55533136b6e12c P 127766fc592545a4997f7790f50f6076 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.090s
I20260709 13:04:50.644990 19450 leader_election.cc:304] T ef32ce6fdd0e40d382c79974f30295c6 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:04:50.595444 20910 raft_consensus.cc:2804] T ece3db938bc649d4a40a51522ed5259c P 127766fc592545a4997f7790f50f6076 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:04:50.539078 20075 leader_election.cc:304] T 9962423cb4e54fcfa5de01daf68a86e7 P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 127766fc592545a4997f7790f50f6076, e5256d91808b47c195bc9b4dbd7f2b87; no voters: 0473d2b2d01f4459b1e90fd12cc7840e
I20260709 13:04:50.645887 19450 leader_election.cc:304] T 7be9efa6559648dbb5a0f7684c4542d1 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:04:50.629155 20941 raft_consensus.cc:2749] T 48824d5acfbc485ebf8c2d944e7202de P e61c3a8f61bb48f8a963c9480e53c168 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:04:50.647143 19560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc225c93219c45538b53a1bd3d387e4d" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:04:50.647276 19557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28af091831594f9d8e96482078cc7625" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:04:50.603623 20906 raft_consensus.cc:2804] T fa8650e71aa14778b3d73721fc50d9fc P 0473d2b2d01f4459b1e90fd12cc7840e [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:04:50.610414 20885 raft_consensus.cc:493] T 4509b76741dc428e9201c70c1658da13 P e61c3a8f61bb48f8a963c9480e53c168 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e5256d91808b47c195bc9b4dbd7f2b87)
I20260709 13:04:50.617923 19404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff75a1d4cb1f493db8f71ddc136ba9ab" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:04:50.657703 19555 raft_consensus.cc:2468] T 28af091831594f9d8e96482078cc7625 P e61c3a8f61bb48f8a963c9480e53c168 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 3.
I20260709 13:04:50.661532 19557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa8650e71aa14778b3d73721fc50d9fc" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:04:50.627267 20853 raft_consensus.cc:2749] T 96efeaaf1057492490e9a621f37e1a2d P e61c3a8f61bb48f8a963c9480e53c168 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:04:50.673118 19560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dc5b3532fe54f74876d02beffa2c230" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:04:50.673781 19560 raft_consensus.cc:3060] T 1dc5b3532fe54f74876d02beffa2c230 P e61c3a8f61bb48f8a963c9480e53c168 [term 1 FOLLOWER]: Advancing to term 3
I20260709 13:04:50.671450 19557 raft_consensus.cc:2393] T fa8650e71aa14778b3d73721fc50d9fc P e61c3a8f61bb48f8a963c9480e53c168 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate e5256d91808b47c195bc9b4dbd7f2b87 in current term 3: Already voted for candidate 0473d2b2d01f4459b1e90fd12cc7840e in this term.
I20260709 13:04:50.675598 19557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef32ce6fdd0e40d382c79974f30295c6" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:04:50.676307 19557 raft_consensus.cc:2393] T ef32ce6fdd0e40d382c79974f30295c6 P e61c3a8f61bb48f8a963c9480e53c168 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate e5256d91808b47c195bc9b4dbd7f2b87 in current term 3: Already voted for candidate 0473d2b2d01f4459b1e90fd12cc7840e in this term.
I20260709 13:04:50.676373 19449 leader_election.cc:304] T 4509b76741dc428e9201c70c1658da13 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e; no voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:04:50.640933 20883 raft_consensus.cc:2749] T b08304a0a02b42d7840c4e8ee9a6bd1a P 0473d2b2d01f4459b1e90fd12cc7840e [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:04:50.657357 20738 raft_consensus.cc:993] T 2a16f7501e2444fb86d4e2778e734e02 P e5256d91808b47c195bc9b4dbd7f2b87: : Instructing follower 127766fc592545a4997f7790f50f6076 to start an election
I20260709 13:04:50.653698 20824 raft_consensus.cc:2804] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P e5256d91808b47c195bc9b4dbd7f2b87 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:04:50.697824 19377 leader_election.cc:304] T 1dc5b3532fe54f74876d02beffa2c230 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87; no voters: 
I20260709 13:04:50.693640 19409 raft_consensus.cc:2468] T 775c229504194560ba9589bc2199b089 P e5256d91808b47c195bc9b4dbd7f2b87 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 3.
I20260709 13:04:50.695111 19557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2725d2c4cb054f18b0fc8f735c15f6c2" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:04:50.699357 19557 raft_consensus.cc:2368] T 2725d2c4cb054f18b0fc8f735c15f6c2 P e61c3a8f61bb48f8a963c9480e53c168 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0473d2b2d01f4459b1e90fd12cc7840e for earlier term 2. Current term is 3.
W20260709 13:04:50.694242 19523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.1:40321, user_credentials={real_user=slave}} blocked reactor thread for 79050.8us
I20260709 13:04:50.666536 20938 raft_consensus.cc:2804] T ef32ce6fdd0e40d382c79974f30295c6 P 0473d2b2d01f4459b1e90fd12cc7840e [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:04:50.640632 20864 raft_consensus.cc:515] T 7f575b143b844aa096b50997dad3516a P e61c3a8f61bb48f8a963c9480e53c168 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:50.673449 20733 raft_consensus.cc:2749] T 28af091831594f9d8e96482078cc7625 P e61c3a8f61bb48f8a963c9480e53c168 [term 3 FOLLOWER]: Leader election lost for term 2. Reason: Vote denied by peer 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257) with higher term. Message: Invalid argument: T 28af091831594f9d8e96482078cc7625 P 0473d2b2d01f4459b1e90fd12cc7840e [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate e61c3a8f61bb48f8a963c9480e53c168 for earlier term 2. Current term is 3.
I20260709 13:04:50.697022 20734 raft_consensus.cc:2804] T 9962423cb4e54fcfa5de01daf68a86e7 P 127766fc592545a4997f7790f50f6076 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:04:50.714489 19560 raft_consensus.cc:2468] T 1dc5b3532fe54f74876d02beffa2c230 P e61c3a8f61bb48f8a963c9480e53c168 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 3.
I20260709 13:04:50.674353 20910 raft_consensus.cc:697] T ece3db938bc649d4a40a51522ed5259c P 127766fc592545a4997f7790f50f6076 [term 3 LEADER]: Becoming Leader. State: Replica: 127766fc592545a4997f7790f50f6076, State: Running, Role: LEADER
I20260709 13:04:50.682583 20932 raft_consensus.cc:2804] T 7be9efa6559648dbb5a0f7684c4542d1 P 0473d2b2d01f4459b1e90fd12cc7840e [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:04:50.681057 20941 raft_consensus.cc:2749] T 7be9efa6559648dbb5a0f7684c4542d1 P e61c3a8f61bb48f8a963c9480e53c168 [term 3 FOLLOWER]: Leader election lost for term 2. Reason: Vote denied by peer 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257) with higher term. Message: Invalid argument: T 7be9efa6559648dbb5a0f7684c4542d1 P 0473d2b2d01f4459b1e90fd12cc7840e [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate e61c3a8f61bb48f8a963c9480e53c168 for earlier term 2. Current term is 3.
I20260709 13:04:50.681326 20906 raft_consensus.cc:697] T fa8650e71aa14778b3d73721fc50d9fc P 0473d2b2d01f4459b1e90fd12cc7840e [term 3 LEADER]: Becoming Leader. State: Replica: 0473d2b2d01f4459b1e90fd12cc7840e, State: Running, Role: LEADER
I20260709 13:04:50.681473 19404 raft_consensus.cc:2376] T ff75a1d4cb1f493db8f71ddc136ba9ab P e5256d91808b47c195bc9b4dbd7f2b87 [term 3 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 3. Re-sending same reply.
W20260709 13:04:50.719064 19526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.2:46257, user_credentials={real_user=slave}} blocked reactor thread for 97115.2us
I20260709 13:04:50.703768 20716 raft_consensus.cc:2749] T 4509b76741dc428e9201c70c1658da13 P 0473d2b2d01f4459b1e90fd12cc7840e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:04:50.694207 21011 raft_consensus.cc:2764] T f93ee515a9c14139bf566522ed8232f3 P e61c3a8f61bb48f8a963c9480e53c168 [term 3 FOLLOWER]: Leader election decision vote started in defunct term 2: won
I20260709 13:04:50.705503 19523 leader_election.cc:304] T 6c5eebf646ad445a9d1b1adc319d7b16 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e61c3a8f61bb48f8a963c9480e53c168; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, 127766fc592545a4997f7790f50f6076
I20260709 13:04:50.717212 19560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e381f1d6b8184797ad142de49be225a8" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:04:50.694475 20945 raft_consensus.cc:493] T ab43d85f64114d4ebf618930e43d9ed0 P 0473d2b2d01f4459b1e90fd12cc7840e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e61c3a8f61bb48f8a963c9480e53c168)
I20260709 13:04:50.708446 20105 raft_consensus.cc:1275] T 85c494af21f9457a85da47b9bc70c1fd P 127766fc592545a4997f7790f50f6076 [term 2 FOLLOWER]: Refusing update from remote peer e5256d91808b47c195bc9b4dbd7f2b87: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:04:50.674088 20885 raft_consensus.cc:515] T 4509b76741dc428e9201c70c1658da13 P e61c3a8f61bb48f8a963c9480e53c168 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:50.723668 20910 consensus_queue.cc:237] T ece3db938bc649d4a40a51522ed5259c P 127766fc592545a4997f7790f50f6076 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:04:50.724834 19478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab43d85f64114d4ebf618930e43d9ed0" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:04:50.705749 20738 consensus_queue.cc:1048] T 14efcc79969f41babe5529c22d59156d P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.007s
I20260709 13:04:50.675160 20908 consensus_queue.cc:1048] T 9962423cb4e54fcfa5de01daf68a86e7 P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.037s
I20260709 13:04:50.678409 20805 consensus_queue.cc:1048] T e381f1d6b8184797ad142de49be225a8 P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.034s
I20260709 13:04:50.718850 20824 raft_consensus.cc:697] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P e5256d91808b47c195bc9b4dbd7f2b87 [term 4 LEADER]: Becoming Leader. State: Replica: e5256d91808b47c195bc9b4dbd7f2b87, State: Running, Role: LEADER
W20260709 13:04:50.704599 20075 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.1:40321, user_credentials={real_user=slave}} blocked reactor thread for 184444us
I20260709 13:04:50.714937 20734 raft_consensus.cc:493] T 9962423cb4e54fcfa5de01daf68a86e7 P 127766fc592545a4997f7790f50f6076 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:50.715903 20996 raft_consensus.cc:1081] T 2a16f7501e2444fb86d4e2778e734e02 P e5256d91808b47c195bc9b4dbd7f2b87 [term 4 LEADER]: Signalling peer 127766fc592545a4997f7790f50f6076 to start an election
I20260709 13:04:50.716809 20938 raft_consensus.cc:697] T ef32ce6fdd0e40d382c79974f30295c6 P 0473d2b2d01f4459b1e90fd12cc7840e [term 3 LEADER]: Becoming Leader. State: Replica: 0473d2b2d01f4459b1e90fd12cc7840e, State: Running, Role: LEADER
W20260709 13:04:50.744933 19449 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.1:40321, user_credentials={real_user=slave}} blocked reactor thread for 68626.8us
I20260709 13:04:50.708932 20833 raft_consensus.cc:2804] T 1dc5b3532fe54f74876d02beffa2c230 P e5256d91808b47c195bc9b4dbd7f2b87 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:04:50.760293 19449 leader_election.cc:304] T f1b10566f45d4a7d9029858330e02d5b P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e; no voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:04:50.750535 19450 leader_election.cc:304] T 28af091831594f9d8e96482078cc7625 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:04:50.727295 20932 raft_consensus.cc:697] T 7be9efa6559648dbb5a0f7684c4542d1 P 0473d2b2d01f4459b1e90fd12cc7840e [term 3 LEADER]: Becoming Leader. State: Replica: 0473d2b2d01f4459b1e90fd12cc7840e, State: Running, Role: LEADER
I20260709 13:04:50.758352 20734 raft_consensus.cc:3060] T 9962423cb4e54fcfa5de01daf68a86e7 P 127766fc592545a4997f7790f50f6076 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:04:50.763706 20932 consensus_queue.cc:237] T 7be9efa6559648dbb5a0f7684c4542d1 P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:50.764375 20938 consensus_queue.cc:237] T ef32ce6fdd0e40d382c79974f30295c6 P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:50.756392 19480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7be9efa6559648dbb5a0f7684c4542d1" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:04:50.751709 19482 raft_consensus.cc:1275] T 62c6c134d3d24a1ab144dd9ee6bc3f64 P 0473d2b2d01f4459b1e90fd12cc7840e [term 3 FOLLOWER]: Refusing update from remote peer 127766fc592545a4997f7790f50f6076: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:04:50.756771 19555 raft_consensus.cc:1275] T edd7d470b5014c9489be7f41f64355c9 P e61c3a8f61bb48f8a963c9480e53c168 [term 3 FOLLOWER]: Refusing update from remote peer 0473d2b2d01f4459b1e90fd12cc7840e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:04:50.774125 19555 raft_consensus.cc:1275] T ed7fdbcb96d14d418db9ca90a792588a P e61c3a8f61bb48f8a963c9480e53c168 [term 3 FOLLOWER]: Refusing update from remote peer 0473d2b2d01f4459b1e90fd12cc7840e: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:04:50.776820 19450 leader_election.cc:400] T 2725d2c4cb054f18b0fc8f735c15f6c2 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 2 pre-election: Vote denied by peer e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891) with higher term. Message: Invalid argument: T 2725d2c4cb054f18b0fc8f735c15f6c2 P e61c3a8f61bb48f8a963c9480e53c168 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0473d2b2d01f4459b1e90fd12cc7840e for earlier term 2. Current term is 3.
I20260709 13:04:50.777185 19450 leader_election.cc:403] T 2725d2c4cb054f18b0fc8f735c15f6c2 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 2 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:04:50.778462 19555 raft_consensus.cc:1275] T 833a2f0775ed407a94b8924ce50adb63 P e61c3a8f61bb48f8a963c9480e53c168 [term 3 FOLLOWER]: Refusing update from remote peer e5256d91808b47c195bc9b4dbd7f2b87: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:04:50.723691 20906 consensus_queue.cc:237] T fa8650e71aa14778b3d73721fc50d9fc P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:50.761739 19403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76cb037fc9064d13b59a8969d897ce8c" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
I20260709 13:04:50.781548 19555 raft_consensus.cc:1275] T ff75a1d4cb1f493db8f71ddc136ba9ab P e61c3a8f61bb48f8a963c9480e53c168 [term 3 FOLLOWER]: Refusing update from remote peer 0473d2b2d01f4459b1e90fd12cc7840e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:04:50.780406 19449 leader_election.cc:304] T 1dc5b3532fe54f74876d02beffa2c230 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e; no voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:04:50.745009 20945 raft_consensus.cc:515] T ab43d85f64114d4ebf618930e43d9ed0 P 0473d2b2d01f4459b1e90fd12cc7840e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } attrs { replace: true } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: NON_VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: true } }
I20260709 13:04:50.770028 20833 raft_consensus.cc:697] T 1dc5b3532fe54f74876d02beffa2c230 P e5256d91808b47c195bc9b4dbd7f2b87 [term 3 LEADER]: Becoming Leader. State: Replica: e5256d91808b47c195bc9b4dbd7f2b87, State: Running, Role: LEADER
I20260709 13:04:50.784425 20883 raft_consensus.cc:2749] T f1b10566f45d4a7d9029858330e02d5b P 0473d2b2d01f4459b1e90fd12cc7840e [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:04:50.788734 21010 raft_consensus.cc:2749] T 6c5eebf646ad445a9d1b1adc319d7b16 P e61c3a8f61bb48f8a963c9480e53c168 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:04:50.813804 19478 raft_consensus.cc:3060] T ab43d85f64114d4ebf618930e43d9ed0 P 0473d2b2d01f4459b1e90fd12cc7840e [term 1 FOLLOWER]: Advancing to term 3
I20260709 13:04:50.780784 21013 raft_consensus.cc:2804] T 28af091831594f9d8e96482078cc7625 P 0473d2b2d01f4459b1e90fd12cc7840e [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:04:50.815292 21013 raft_consensus.cc:697] T 28af091831594f9d8e96482078cc7625 P 0473d2b2d01f4459b1e90fd12cc7840e [term 3 LEADER]: Becoming Leader. State: Replica: 0473d2b2d01f4459b1e90fd12cc7840e, State: Running, Role: LEADER
I20260709 13:04:50.816332 21013 consensus_queue.cc:237] T 28af091831594f9d8e96482078cc7625 P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:50.819741 20819 raft_consensus.cc:515] T a08760e15aac4630a629431f56024dc8 P e5256d91808b47c195bc9b4dbd7f2b87 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:50.822126 20819 leader_election.cc:290] T a08760e15aac4630a629431f56024dc8 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 3 election: Requested vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:04:50.789175 20808 consensus_queue.cc:1048] T edd7d470b5014c9489be7f41f64355c9 P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.034s
I20260709 13:04:50.804730 20824 consensus_queue.cc:237] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:04:50.823766 19375 leader_election.cc:304] T bc225c93219c45538b53a1bd3d387e4d P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:04:50.798939 20839 consensus_queue.cc:1048] T ed7fdbcb96d14d418db9ca90a792588a P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.026s
I20260709 13:04:50.813750 19403 raft_consensus.cc:3060] T 76cb037fc9064d13b59a8969d897ce8c P e5256d91808b47c195bc9b4dbd7f2b87 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:04:50.834017 19375 leader_election.cc:304] T 28af091831594f9d8e96482078cc7625 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:04:50.835135 20819 raft_consensus.cc:2749] T bc225c93219c45538b53a1bd3d387e4d P e5256d91808b47c195bc9b4dbd7f2b87 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:04:50.835479 20833 consensus_queue.cc:237] T 1dc5b3532fe54f74876d02beffa2c230 P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:50.838056 20936 consensus_queue.cc:1048] T ff75a1d4cb1f493db8f71ddc136ba9ab P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:04:50.838634 19450 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.3:36891, user_credentials={real_user=slave}} blocked reactor thread for 46856.8us
I20260709 13:04:50.839694 19556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab43d85f64114d4ebf618930e43d9ed0" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:04:50.857769 19556 raft_consensus.cc:3060] T ab43d85f64114d4ebf618930e43d9ed0 P e61c3a8f61bb48f8a963c9480e53c168 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:04:50.867058 19481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a08760e15aac4630a629431f56024dc8" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:04:50.867731 19481 raft_consensus.cc:3060] T a08760e15aac4630a629431f56024dc8 P 0473d2b2d01f4459b1e90fd12cc7840e [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:04:50.868255 19377 leader_election.cc:304] T 7be9efa6559648dbb5a0f7684c4542d1 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:04:50.871699 19375 leader_election.cc:304] T fa8650e71aa14778b3d73721fc50d9fc P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:04:50.873363 19484 raft_consensus.cc:1275] T 40e1e16737a842ee936002830f36882e P 0473d2b2d01f4459b1e90fd12cc7840e [term 4 FOLLOWER]: Refusing update from remote peer e5256d91808b47c195bc9b4dbd7f2b87: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
W20260709 13:04:50.849442 19449 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.1:40321, user_credentials={real_user=slave}} blocked reactor thread for 69149.3us
I20260709 13:04:50.854544 19555 raft_consensus.cc:1275] T 85c494af21f9457a85da47b9bc70c1fd P e61c3a8f61bb48f8a963c9480e53c168 [term 2 FOLLOWER]: Refusing update from remote peer e5256d91808b47c195bc9b4dbd7f2b87: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:04:50.876101 19555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a08760e15aac4630a629431f56024dc8" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:04:50.877245 19555 raft_consensus.cc:3060] T a08760e15aac4630a629431f56024dc8 P e61c3a8f61bb48f8a963c9480e53c168 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:04:50.799592 21007 log.cc:927] Time spent T 14935b3ddf914369822e4a0547aaa355 P e61c3a8f61bb48f8a963c9480e53c168: Append to log took a long time: real 0.059s	user 0.000s	sys 0.001s
I20260709 13:04:50.804376 20837 tablet_bootstrap.cc:492] T df751f992649444090e27965eb1af85d P 127766fc592545a4997f7790f50f6076: Bootstrap starting.
I20260709 13:04:50.788134 20716 raft_consensus.cc:3060] T 2725d2c4cb054f18b0fc8f735c15f6c2 P 0473d2b2d01f4459b1e90fd12cc7840e [term 1 FOLLOWER]: Advancing to term 3
W20260709 13:04:50.881889 19526 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:50.806176 20885 leader_election.cc:290] T 4509b76741dc428e9201c70c1658da13 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:04:50.912236 19375 leader_election.cc:304] T ef32ce6fdd0e40d382c79974f30295c6 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:04:50.880957 21010 raft_consensus.cc:493] T edd7d470b5014c9489be7f41f64355c9 P e61c3a8f61bb48f8a963c9480e53c168 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:50.894502 19481 raft_consensus.cc:2468] T a08760e15aac4630a629431f56024dc8 P 0473d2b2d01f4459b1e90fd12cc7840e [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 3.
I20260709 13:04:50.808557 20864 leader_election.cc:290] T 7f575b143b844aa096b50997dad3516a P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:04:50.812834 20945 leader_election.cc:290] T ab43d85f64114d4ebf618930e43d9ed0 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:04:50.920928 19559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab43d85f64114d4ebf618930e43d9ed0" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:04:50.880877 20839 raft_consensus.cc:2749] T 1dc5b3532fe54f74876d02beffa2c230 P 0473d2b2d01f4459b1e90fd12cc7840e [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:04:50.881271 20867 raft_consensus.cc:2749] T 28af091831594f9d8e96482078cc7625 P e5256d91808b47c195bc9b4dbd7f2b87 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:04:50.932703 19375 leader_election.cc:304] T e381f1d6b8184797ad142de49be225a8 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:04:50.892050 19478 raft_consensus.cc:2468] T ab43d85f64114d4ebf618930e43d9ed0 P 0473d2b2d01f4459b1e90fd12cc7840e [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 3.
I20260709 13:04:50.888535 20738 raft_consensus.cc:2749] T 7be9efa6559648dbb5a0f7684c4542d1 P e5256d91808b47c195bc9b4dbd7f2b87 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:04:50.891476 19556 raft_consensus.cc:2468] T ab43d85f64114d4ebf618930e43d9ed0 P e61c3a8f61bb48f8a963c9480e53c168 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 3.
I20260709 13:04:50.923875 20996 raft_consensus.cc:2749] T fa8650e71aa14778b3d73721fc50d9fc P e5256d91808b47c195bc9b4dbd7f2b87 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:04:50.950552 19555 raft_consensus.cc:2468] T a08760e15aac4630a629431f56024dc8 P e61c3a8f61bb48f8a963c9480e53c168 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 3.
I20260709 13:04:50.939638 20776 raft_consensus.cc:2749] T ef32ce6fdd0e40d382c79974f30295c6 P e5256d91808b47c195bc9b4dbd7f2b87 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:04:50.930119 20819 consensus_queue.cc:1048] T 40e1e16737a842ee936002830f36882e P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.039s
I20260709 13:04:50.944317 20867 raft_consensus.cc:2749] T e381f1d6b8184797ad142de49be225a8 P e5256d91808b47c195bc9b4dbd7f2b87 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 13:04:50.988868 19377 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.2:46257, user_credentials={real_user=slave}} blocked reactor thread for 72344.1us
I20260709 13:04:50.982424 19551 raft_consensus.cc:2468] T bc225c93219c45538b53a1bd3d387e4d P e61c3a8f61bb48f8a963c9480e53c168 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 3.
I20260709 13:04:50.988111 20728 raft_consensus.cc:2804] T 1efebf73c86e432baa55533136b6e12c P e61c3a8f61bb48f8a963c9480e53c168 [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 13:04:50.997689 19375 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.3:36891, user_credentials={real_user=slave}} blocked reactor thread for 65081.7us
I20260709 13:04:51.002514 20830 consensus_queue.cc:1048] T 833a2f0775ed407a94b8924ce50adb63 P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.002s
I20260709 13:04:51.004540 20873 raft_consensus.cc:2749] T 86a6797bdfe94fa496c050ceae4bd0d9 P e61c3a8f61bb48f8a963c9480e53c168 [term 3 FOLLOWER]: Leader election lost for term 2. Reason: Vote denied by peer 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257) with higher term. Message: Invalid argument: T 86a6797bdfe94fa496c050ceae4bd0d9 P 0473d2b2d01f4459b1e90fd12cc7840e [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate e61c3a8f61bb48f8a963c9480e53c168 for earlier term 2. Current term is 3.
I20260709 13:04:51.007200 20642 raft_consensus.cc:993] T 2b74109013a140ada21feeef92d6f563 P e5256d91808b47c195bc9b4dbd7f2b87: : Instructing follower 0473d2b2d01f4459b1e90fd12cc7840e to start an election
I20260709 13:04:51.007719 20642 consensus_queue.cc:1048] T 85c494af21f9457a85da47b9bc70c1fd P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:04:51.008249 19375 leader_election.cc:304] T ab43d85f64114d4ebf618930e43d9ed0 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:04:51.007978 20827 raft_consensus.cc:1081] T 2b74109013a140ada21feeef92d6f563 P e5256d91808b47c195bc9b4dbd7f2b87 [term 1 LEADER]: Signalling peer 0473d2b2d01f4459b1e90fd12cc7840e to start an election
I20260709 13:04:51.009500 19375 leader_election.cc:304] T a08760e15aac4630a629431f56024dc8 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:04:51.009037 20830 raft_consensus.cc:2804] T ab43d85f64114d4ebf618930e43d9ed0 P e5256d91808b47c195bc9b4dbd7f2b87 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:04:50.929888 21010 raft_consensus.cc:515] T edd7d470b5014c9489be7f41f64355c9 P e61c3a8f61bb48f8a963c9480e53c168 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
W20260709 13:04:51.025071 19450 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.3:36891, user_credentials={real_user=slave}} blocked reactor thread for 101329us
W20260709 13:04:51.051999 19449 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.1:40321, user_credentials={real_user=slave}} blocked reactor thread for 171802us
I20260709 13:04:51.053704 19449 leader_election.cc:304] T 309c3ca0ca4b4f3ba129752ea2cb293b P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e; no voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:04:51.054344 19450 leader_election.cc:304] T bc225c93219c45538b53a1bd3d387e4d P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168; no voters: e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:04:51.053164 19555 raft_consensus.cc:2955] T 14935b3ddf914369822e4a0547aaa355 P e61c3a8f61bb48f8a963c9480e53c168 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 127766fc592545a4997f7790f50f6076 (127.17.223.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } attrs { replace: true } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: NON_VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: true } } }
I20260709 13:04:51.058775 19449 leader_election.cc:400] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 3 pre-election: Vote denied by peer e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321) with higher term. Message: Invalid argument: T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P e5256d91808b47c195bc9b4dbd7f2b87 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0473d2b2d01f4459b1e90fd12cc7840e for earlier term 3. Current term is 4.
I20260709 13:04:51.061807 20996 raft_consensus.cc:2804] T a08760e15aac4630a629431f56024dc8 P e5256d91808b47c195bc9b4dbd7f2b87 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:04:51.062381 20996 raft_consensus.cc:697] T a08760e15aac4630a629431f56024dc8 P e5256d91808b47c195bc9b4dbd7f2b87 [term 3 LEADER]: Becoming Leader. State: Replica: e5256d91808b47c195bc9b4dbd7f2b87, State: Running, Role: LEADER
I20260709 13:04:51.062738 20860 raft_consensus.cc:2804] T bc225c93219c45538b53a1bd3d387e4d P 0473d2b2d01f4459b1e90fd12cc7840e [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:04:51.063349 20996 consensus_queue.cc:237] T a08760e15aac4630a629431f56024dc8 P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:51.060940 20936 raft_consensus.cc:2749] T 309c3ca0ca4b4f3ba129752ea2cb293b P 0473d2b2d01f4459b1e90fd12cc7840e [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:04:51.065532 19551 raft_consensus.cc:1275] T 76cb037fc9064d13b59a8969d897ce8c P e61c3a8f61bb48f8a963c9480e53c168 [term 3 FOLLOWER]: Refusing update from remote peer 0473d2b2d01f4459b1e90fd12cc7840e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:04:51.067018 20855 raft_consensus.cc:493] T fa731b585f684a7fb2d106c50f143b83 P e5256d91808b47c195bc9b4dbd7f2b87 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 127766fc592545a4997f7790f50f6076)
I20260709 13:04:51.067664 20855 raft_consensus.cc:515] T fa731b585f684a7fb2d106c50f143b83 P e5256d91808b47c195bc9b4dbd7f2b87 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:04:51.069789 20855 leader_election.cc:290] T fa731b585f684a7fb2d106c50f143b83 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:04:51.070248 20855 raft_consensus.cc:493] T 0cdf56e38bbc453d9438d359e5a69955 P e5256d91808b47c195bc9b4dbd7f2b87 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:51.006465 20734 raft_consensus.cc:515] T 9962423cb4e54fcfa5de01daf68a86e7 P 127766fc592545a4997f7790f50f6076 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:04:51.071342 20855 raft_consensus.cc:515] T 0cdf56e38bbc453d9438d359e5a69955 P e5256d91808b47c195bc9b4dbd7f2b87 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:51.073146 19449 leader_election.cc:304] T 86a6797bdfe94fa496c050ceae4bd0d9 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87; no voters: e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:04:51.067081 19551 raft_consensus.cc:1275] T 40e1e16737a842ee936002830f36882e P e61c3a8f61bb48f8a963c9480e53c168 [term 4 FOLLOWER]: Refusing update from remote peer e5256d91808b47c195bc9b4dbd7f2b87: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:04:51.072211 21010 leader_election.cc:290] T edd7d470b5014c9489be7f41f64355c9 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:04:51.072525 20830 raft_consensus.cc:697] T ab43d85f64114d4ebf618930e43d9ed0 P e5256d91808b47c195bc9b4dbd7f2b87 [term 3 LEADER]: Becoming Leader. State: Replica: e5256d91808b47c195bc9b4dbd7f2b87, State: Running, Role: LEADER
I20260709 13:04:51.077137 20883 consensus_queue.cc:1048] T 76cb037fc9064d13b59a8969d897ce8c P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:04:51.080595 19482 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "2b74109013a140ada21feeef92d6f563"
dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
 from {username='slave'} at 127.0.0.1:58294
I20260709 13:04:51.078825 20860 raft_consensus.cc:697] T bc225c93219c45538b53a1bd3d387e4d P 0473d2b2d01f4459b1e90fd12cc7840e [term 3 LEADER]: Becoming Leader. State: Replica: 0473d2b2d01f4459b1e90fd12cc7840e, State: Running, Role: LEADER
I20260709 13:04:51.082424 20938 raft_consensus.cc:2804] T 86a6797bdfe94fa496c050ceae4bd0d9 P 0473d2b2d01f4459b1e90fd12cc7840e [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:04:51.082851 19482 raft_consensus.cc:493] T 2b74109013a140ada21feeef92d6f563 P 0473d2b2d01f4459b1e90fd12cc7840e [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:04:51.083256 19482 raft_consensus.cc:3060] T 2b74109013a140ada21feeef92d6f563 P 0473d2b2d01f4459b1e90fd12cc7840e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:51.083417 20860 consensus_queue.cc:237] T bc225c93219c45538b53a1bd3d387e4d P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:51.082981 19449 leader_election.cc:304] T 775c229504194560ba9589bc2199b089 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87; no voters: 
I20260709 13:04:51.085924 20908 raft_consensus.cc:2804] T 775c229504194560ba9589bc2199b089 P 0473d2b2d01f4459b1e90fd12cc7840e [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:04:51.086403 20908 raft_consensus.cc:697] T 775c229504194560ba9589bc2199b089 P 0473d2b2d01f4459b1e90fd12cc7840e [term 3 LEADER]: Becoming Leader. State: Replica: 0473d2b2d01f4459b1e90fd12cc7840e, State: Running, Role: LEADER
I20260709 13:04:51.088469 19478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46c5bfeecc314717bffe987e6844b6d0" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:04:51.090205 19481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4509b76741dc428e9201c70c1658da13" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:04:51.091712 19478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f575b143b844aa096b50997dad3516a" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:04:51.092747 19485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edd7d470b5014c9489be7f41f64355c9" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:04:51.094661 19481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cdf56e38bbc453d9438d359e5a69955" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:04:51.095249 19481 raft_consensus.cc:2468] T 0cdf56e38bbc453d9438d359e5a69955 P 0473d2b2d01f4459b1e90fd12cc7840e [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 2.
I20260709 13:04:51.096464 19377 leader_election.cc:304] T 0cdf56e38bbc453d9438d359e5a69955 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87; no voters: 
I20260709 13:04:51.100720 19555 raft_consensus.cc:1275] T 22196caba61445d3bec98a0aab3c337d P e61c3a8f61bb48f8a963c9480e53c168 [term 3 FOLLOWER]: Refusing update from remote peer e5256d91808b47c195bc9b4dbd7f2b87: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:04:51.102285 19555 raft_consensus.cc:1275] T 2725d2c4cb054f18b0fc8f735c15f6c2 P e61c3a8f61bb48f8a963c9480e53c168 [term 3 FOLLOWER]: Refusing update from remote peer e5256d91808b47c195bc9b4dbd7f2b87: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:04:51.090948 19482 raft_consensus.cc:515] T 2b74109013a140ada21feeef92d6f563 P 0473d2b2d01f4459b1e90fd12cc7840e [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:51.106341 21025 consensus_queue.cc:1048] T 22196caba61445d3bec98a0aab3c337d P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:04:51.107030 20883 consensus_queue.cc:1048] T 9962423cb4e54fcfa5de01daf68a86e7 P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Connected to new peer: Peer: permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:04:51.107421 20830 consensus_queue.cc:237] T ab43d85f64114d4ebf618930e43d9ed0 P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } attrs { replace: true } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: NON_VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: true } }
I20260709 13:04:51.086493 20716 raft_consensus.cc:2749] T 2725d2c4cb054f18b0fc8f735c15f6c2 P 0473d2b2d01f4459b1e90fd12cc7840e [term 3 FOLLOWER]: Leader pre-election lost for term 2. Reason: Vote denied by peer e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891) with higher term. Message: Invalid argument: T 2725d2c4cb054f18b0fc8f735c15f6c2 P e61c3a8f61bb48f8a963c9480e53c168 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0473d2b2d01f4459b1e90fd12cc7840e for earlier term 2. Current term is 3.
I20260709 13:04:51.109683 19555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa731b585f684a7fb2d106c50f143b83" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:04:51.086325 20855 leader_election.cc:290] T 0cdf56e38bbc453d9438d359e5a69955 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:04:51.083221 20938 raft_consensus.cc:697] T 86a6797bdfe94fa496c050ceae4bd0d9 P 0473d2b2d01f4459b1e90fd12cc7840e [term 3 LEADER]: Becoming Leader. State: Replica: 0473d2b2d01f4459b1e90fd12cc7840e, State: Running, Role: LEADER
I20260709 13:04:51.111934 20938 consensus_queue.cc:237] T 86a6797bdfe94fa496c050ceae4bd0d9 P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:51.112855 19555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cdf56e38bbc453d9438d359e5a69955" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:04:51.113451 19555 raft_consensus.cc:2468] T 0cdf56e38bbc453d9438d359e5a69955 P e61c3a8f61bb48f8a963c9480e53c168 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 3.
I20260709 13:04:51.114553 21025 consensus_queue.cc:1048] T 2725d2c4cb054f18b0fc8f735c15f6c2 P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:04:51.072260 20734 leader_election.cc:290] T 9962423cb4e54fcfa5de01daf68a86e7 P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 4 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:04:51.116214 19477 raft_consensus.cc:1275] T 22196caba61445d3bec98a0aab3c337d P 0473d2b2d01f4459b1e90fd12cc7840e [term 3 FOLLOWER]: Refusing update from remote peer e5256d91808b47c195bc9b4dbd7f2b87: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:04:51.114890 20812 consensus_queue.cc:1048] T ed7fdbcb96d14d418db9ca90a792588a P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Connected to new peer: Peer: permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.005s
I20260709 13:04:51.122103 20825 consensus_queue.cc:1048] T 22196caba61445d3bec98a0aab3c337d P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:04:51.126772 20908 consensus_queue.cc:237] T 775c229504194560ba9589bc2199b089 P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:04:51.114763 20824 raft_consensus.cc:2804] T 0cdf56e38bbc453d9438d359e5a69955 P e5256d91808b47c195bc9b4dbd7f2b87 [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 13:04:51.141714 19523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.4:43121, user_credentials={real_user=slave}} blocked reactor thread for 393754us
I20260709 13:04:51.143216 19482 leader_election.cc:290] T 2b74109013a140ada21feeef92d6f563 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 2 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:04:51.141150 20824 raft_consensus.cc:493] T 0cdf56e38bbc453d9438d359e5a69955 P e5256d91808b47c195bc9b4dbd7f2b87 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:51.142720 19523 leader_election.cc:304] T ff75a1d4cb1f493db8f71ddc136ba9ab P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e61c3a8f61bb48f8a963c9480e53c168; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:04:51.026271 20945 raft_consensus.cc:2955] T 14935b3ddf914369822e4a0547aaa355 P 0473d2b2d01f4459b1e90fd12cc7840e [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 127766fc592545a4997f7790f50f6076 (127.17.223.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } attrs { replace: true } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: NON_VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: true } } }
I20260709 13:04:51.141137 20825 consensus_queue.cc:1048] T 40e1e16737a842ee936002830f36882e P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.024s
I20260709 13:04:51.178200 19523 leader_election.cc:400] T 7be9efa6559648dbb5a0f7684c4542d1 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 2 election: Vote denied by peer e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321) with higher term. Message: Invalid argument: T 7be9efa6559648dbb5a0f7684c4542d1 P e5256d91808b47c195bc9b4dbd7f2b87 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate e61c3a8f61bb48f8a963c9480e53c168 for earlier term 2. Current term is 3.
I20260709 13:04:51.158840 20824 raft_consensus.cc:3060] T 0cdf56e38bbc453d9438d359e5a69955 P e5256d91808b47c195bc9b4dbd7f2b87 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:04:51.163396 21010 raft_consensus.cc:2749] T ff75a1d4cb1f493db8f71ddc136ba9ab P e61c3a8f61bb48f8a963c9480e53c168 [term 3 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:04:51.167369 19403 raft_consensus.cc:2468] T 76cb037fc9064d13b59a8969d897ce8c P e5256d91808b47c195bc9b4dbd7f2b87 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 3.
I20260709 13:04:51.193037 19523 leader_election.cc:304] T 76cb037fc9064d13b59a8969d897ce8c P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168; no voters: 0473d2b2d01f4459b1e90fd12cc7840e
I20260709 13:04:51.192400 20825 consensus_queue.cc:1048] T 85c494af21f9457a85da47b9bc70c1fd P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Connected to new peer: Peer: permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.011s
I20260709 13:04:51.220168 20734 consensus_queue.cc:1048] T 62c6c134d3d24a1ab144dd9ee6bc3f64 P 127766fc592545a4997f7790f50f6076 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:04:51.228096 20105 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "2a16f7501e2444fb86d4e2778e734e02"
dest_uuid: "127766fc592545a4997f7790f50f6076"
 from {username='slave'} at 127.0.0.1:35874
I20260709 13:04:51.228749 20105 raft_consensus.cc:493] T 2a16f7501e2444fb86d4e2778e734e02 P 127766fc592545a4997f7790f50f6076 [term 4 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:04:51.229157 20105 raft_consensus.cc:3060] T 2a16f7501e2444fb86d4e2778e734e02 P 127766fc592545a4997f7790f50f6076 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:04:51.233155 21026 log.cc:927] Time spent T 28af091831594f9d8e96482078cc7625 P 0473d2b2d01f4459b1e90fd12cc7840e: Append to log took a long time: real 0.226s	user 0.000s	sys 0.003s
W20260709 13:04:51.235173 21027 log.cc:927] Time spent T 70797e5783b5454ab0d0eea663e791e3 P e61c3a8f61bb48f8a963c9480e53c168: Append to log took a long time: real 0.226s	user 0.001s	sys 0.000s
W20260709 13:04:51.212302 21030 log.cc:927] Time spent T ef32ce6fdd0e40d382c79974f30295c6 P 0473d2b2d01f4459b1e90fd12cc7840e: Append to log took a long time: real 0.195s	user 0.001s	sys 0.000s
I20260709 13:04:51.237443 19560 raft_consensus.cc:1275] T f93ee515a9c14139bf566522ed8232f3 P e61c3a8f61bb48f8a963c9480e53c168 [term 3 FOLLOWER]: Refusing update from remote peer 0473d2b2d01f4459b1e90fd12cc7840e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:04:51.239499 20112 raft_consensus.cc:1275] T 14efcc79969f41babe5529c22d59156d P 127766fc592545a4997f7790f50f6076 [term 4 FOLLOWER]: Refusing update from remote peer e5256d91808b47c195bc9b4dbd7f2b87: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:04:51.241755 19560 raft_consensus.cc:1275] T 46c5bfeecc314717bffe987e6844b6d0 P e61c3a8f61bb48f8a963c9480e53c168 [term 4 FOLLOWER]: Refusing update from remote peer 0473d2b2d01f4459b1e90fd12cc7840e: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 2. (term mismatch)
I20260709 13:04:51.242215 19560 pending_rounds.cc:85] T 46c5bfeecc314717bffe987e6844b6d0 P e61c3a8f61bb48f8a963c9480e53c168: Aborting all ops after (but not including) 1
I20260709 13:04:51.242484 19560 pending_rounds.cc:107] T 46c5bfeecc314717bffe987e6844b6d0 P e61c3a8f61bb48f8a963c9480e53c168: Aborting uncommitted NO_OP operation due to leader change: 3.2
I20260709 13:04:51.243212 19560 raft_consensus.cc:2889] T 46c5bfeecc314717bffe987e6844b6d0 P e61c3a8f61bb48f8a963c9480e53c168 [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:04:51.216740 19523 leader_election.cc:304] T 46c5bfeecc314717bffe987e6844b6d0 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168; no voters: 0473d2b2d01f4459b1e90fd12cc7840e
I20260709 13:04:51.224361 20109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa731b585f684a7fb2d106c50f143b83" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
W20260709 13:04:51.281378 19523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.1:40321, user_credentials={real_user=slave}} blocked reactor thread for 64769.8us
I20260709 13:04:51.294034 19374 leader_election.cc:304] T fa731b585f684a7fb2d106c50f143b83 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87; no voters: 127766fc592545a4997f7790f50f6076, e61c3a8f61bb48f8a963c9480e53c168
W20260709 13:04:51.313057 20078 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.2:46257, user_credentials={real_user=slave}} blocked reactor thread for 534873us
I20260709 13:04:51.326064 20112 raft_consensus.cc:1240] T 9962423cb4e54fcfa5de01daf68a86e7 P 127766fc592545a4997f7790f50f6076 [term 4 FOLLOWER]: Rejecting Update request from peer 0473d2b2d01f4459b1e90fd12cc7840e for earlier term 3. Current term is 4. Ops: [3.5-3.5]
I20260709 13:04:51.334077 20642 raft_consensus.cc:2749] T fa731b585f684a7fb2d106c50f143b83 P e5256d91808b47c195bc9b4dbd7f2b87 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 13:04:51.339112 21004 log.cc:927] Time spent T 775c229504194560ba9589bc2199b089 P 127766fc592545a4997f7790f50f6076: Append to log took a long time: real 0.629s	user 0.003s	sys 0.000s
I20260709 13:04:51.336153 20860 consensus_queue.cc:1059] T 9962423cb4e54fcfa5de01daf68a86e7 P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.003s
I20260709 13:04:51.340106 20860 raft_consensus.cc:3055] T 9962423cb4e54fcfa5de01daf68a86e7 P 0473d2b2d01f4459b1e90fd12cc7840e [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:04:51.340464 20860 raft_consensus.cc:740] T 9962423cb4e54fcfa5de01daf68a86e7 P 0473d2b2d01f4459b1e90fd12cc7840e [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 0473d2b2d01f4459b1e90fd12cc7840e, State: Running, Role: LEADER
I20260709 13:04:51.323854 20998 raft_consensus.cc:493] T 14efcc79969f41babe5529c22d59156d P 127766fc592545a4997f7790f50f6076 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:51.326958 20885 raft_consensus.cc:2804] T 46c5bfeecc314717bffe987e6844b6d0 P e61c3a8f61bb48f8a963c9480e53c168 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:04:51.280761 20855 consensus_queue.cc:1048] T 14efcc79969f41babe5529c22d59156d P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Connected to new peer: Peer: permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.061s
I20260709 13:04:51.373422 20105 raft_consensus.cc:515] T 2a16f7501e2444fb86d4e2778e734e02 P 127766fc592545a4997f7790f50f6076 [term 5 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:04:51.374235 20864 raft_consensus.cc:493] T 1a61655d99124a29b486ba4a5b37faea P e61c3a8f61bb48f8a963c9480e53c168 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0473d2b2d01f4459b1e90fd12cc7840e)
I20260709 13:04:51.374542 21039 raft_consensus.cc:493] T ed7fdbcb96d14d418db9ca90a792588a P 127766fc592545a4997f7790f50f6076 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:51.349573 20885 raft_consensus.cc:493] T 46c5bfeecc314717bffe987e6844b6d0 P e61c3a8f61bb48f8a963c9480e53c168 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:51.379558 20864 raft_consensus.cc:515] T 1a61655d99124a29b486ba4a5b37faea P e61c3a8f61bb48f8a963c9480e53c168 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:51.356374 20998 raft_consensus.cc:515] T 14efcc79969f41babe5529c22d59156d P 127766fc592545a4997f7790f50f6076 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:04:51.385035 20864 leader_election.cc:290] T 1a61655d99124a29b486ba4a5b37faea P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:04:51.385547 20998 leader_election.cc:290] T 14efcc79969f41babe5529c22d59156d P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:04:51.375854 20860 consensus_queue.cc:260] T 9962423cb4e54fcfa5de01daf68a86e7 P 0473d2b2d01f4459b1e90fd12cc7840e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:04:51.380573 21039 raft_consensus.cc:515] T ed7fdbcb96d14d418db9ca90a792588a P 127766fc592545a4997f7790f50f6076 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:04:51.388204 20860 raft_consensus.cc:3060] T 9962423cb4e54fcfa5de01daf68a86e7 P 0473d2b2d01f4459b1e90fd12cc7840e [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:04:51.389648 21039 leader_election.cc:290] T ed7fdbcb96d14d418db9ca90a792588a P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:04:51.383176 20885 raft_consensus.cc:3060] T 46c5bfeecc314717bffe987e6844b6d0 P e61c3a8f61bb48f8a963c9480e53c168 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:04:51.378319 20941 raft_consensus.cc:493] T 0e1085d23e8347fbbd5bce7542f4b1f4 P e61c3a8f61bb48f8a963c9480e53c168 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:51.379050 20105 leader_election.cc:290] T 2a16f7501e2444fb86d4e2778e734e02 P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 5 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:04:51.410152 19410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4509b76741dc428e9201c70c1658da13" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:04:51.414795 19410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edd7d470b5014c9489be7f41f64355c9" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:04:51.416100 19410 raft_consensus.cc:2410] T edd7d470b5014c9489be7f41f64355c9 P e5256d91808b47c195bc9b4dbd7f2b87 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e61c3a8f61bb48f8a963c9480e53c168 for term 4 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:04:51.408129 20941 raft_consensus.cc:515] T 0e1085d23e8347fbbd5bce7542f4b1f4 P e61c3a8f61bb48f8a963c9480e53c168 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:04:51.380000 20728 raft_consensus.cc:493] T 1efebf73c86e432baa55533136b6e12c P e61c3a8f61bb48f8a963c9480e53c168 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 127766fc592545a4997f7790f50f6076)
I20260709 13:04:51.417137 20852 raft_consensus.cc:493] T 4af19371ea874c09a0a2147040835cbb P e61c3a8f61bb48f8a963c9480e53c168 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 127766fc592545a4997f7790f50f6076)
I20260709 13:04:51.428838 19486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a61655d99124a29b486ba4a5b37faea" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:04:51.428889 20852 raft_consensus.cc:515] T 4af19371ea874c09a0a2147040835cbb P e61c3a8f61bb48f8a963c9480e53c168 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:04:51.418818 20873 raft_consensus.cc:2764] T 76cb037fc9064d13b59a8969d897ce8c P e61c3a8f61bb48f8a963c9480e53c168 [term 3 FOLLOWER]: Leader election decision vote started in defunct term 2: won
I20260709 13:04:51.425132 19403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f575b143b844aa096b50997dad3516a" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:04:51.431671 20852 leader_election.cc:290] T 4af19371ea874c09a0a2147040835cbb P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:04:51.433480 19404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a61655d99124a29b486ba4a5b37faea" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:04:51.434461 20105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4af19371ea874c09a0a2147040835cbb" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:04:51.437923 19309 catalog_manager.cc:5697] T 0e1085d23e8347fbbd5bce7542f4b1f4 P 127766fc592545a4997f7790f50f6076 reported cstate change: term changed from 1 to 2, leader changed from e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3) to 127766fc592545a4997f7790f50f6076 (127.17.223.4). New cstate: current_term: 2 leader_uuid: "127766fc592545a4997f7790f50f6076" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:04:51.450894 19309 catalog_manager.cc:5697] T fa731b585f684a7fb2d106c50f143b83 P 127766fc592545a4997f7790f50f6076 reported cstate change: term changed from 1 to 2, leader changed from e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3) to 127766fc592545a4997f7790f50f6076 (127.17.223.4). New cstate: current_term: 2 leader_uuid: "127766fc592545a4997f7790f50f6076" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:04:51.452400 19309 catalog_manager.cc:5697] T 1f85fc4b527a48848e5faa083b604e36 P 127766fc592545a4997f7790f50f6076 reported cstate change: term changed from 1 to 2, leader changed from 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2) to e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1). New cstate: current_term: 2 leader_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } } }
I20260709 13:04:51.453608 19309 catalog_manager.cc:5697] T ed7fdbcb96d14d418db9ca90a792588a P 127766fc592545a4997f7790f50f6076 reported cstate change: term changed from 1 to 2, leader changed from e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3) to 127766fc592545a4997f7790f50f6076 (127.17.223.4). New cstate: current_term: 2 leader_uuid: "127766fc592545a4997f7790f50f6076" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:04:51.456477 19523 leader_election.cc:304] T 4509b76741dc428e9201c70c1658da13 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e61c3a8f61bb48f8a963c9480e53c168; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:04:51.425079 20835 raft_consensus.cc:993] T d1e5873a19244c5ebbcd38e126796ee7 P e5256d91808b47c195bc9b4dbd7f2b87: : Instructing follower 0473d2b2d01f4459b1e90fd12cc7840e to start an election
I20260709 13:04:51.458941 19523 leader_election.cc:304] T edd7d470b5014c9489be7f41f64355c9 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e61c3a8f61bb48f8a963c9480e53c168; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:04:51.425669 20728 raft_consensus.cc:3060] T 1efebf73c86e432baa55533136b6e12c P e61c3a8f61bb48f8a963c9480e53c168 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:04:51.462965 19523 leader_election.cc:304] T 7f575b143b844aa096b50997dad3516a P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e61c3a8f61bb48f8a963c9480e53c168; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:04:51.480302 18300 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:04:51.482316 19523 leader_election.cc:304] T 1a61655d99124a29b486ba4a5b37faea P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e61c3a8f61bb48f8a963c9480e53c168; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:04:51.460889 20873 raft_consensus.cc:2749] T 4509b76741dc428e9201c70c1658da13 P e61c3a8f61bb48f8a963c9480e53c168 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:04:51.462643 20733 raft_consensus.cc:2749] T edd7d470b5014c9489be7f41f64355c9 P e61c3a8f61bb48f8a963c9480e53c168 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 13:04:51.461133 19374 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.4:43121, user_credentials={real_user=slave}} blocked reactor thread for 131854us
I20260709 13:04:51.479687 20852 raft_consensus.cc:2749] T 7f575b143b844aa096b50997dad3516a P e61c3a8f61bb48f8a963c9480e53c168 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:04:51.512728 21043 ts_tablet_manager.cc:933] T 14935b3ddf914369822e4a0547aaa355 P 127766fc592545a4997f7790f50f6076: Initiating tablet copy from peer 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:04:51.463663 21031 raft_consensus.cc:493] T 3e1f505cb0f1427bbd698ac889d80821 P e61c3a8f61bb48f8a963c9480e53c168 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e5256d91808b47c195bc9b4dbd7f2b87)
I20260709 13:04:51.481048 20835 raft_consensus.cc:1081] T d1e5873a19244c5ebbcd38e126796ee7 P e5256d91808b47c195bc9b4dbd7f2b87 [term 2 LEADER]: Signalling peer 0473d2b2d01f4459b1e90fd12cc7840e to start an election
I20260709 13:04:51.495532 20864 raft_consensus.cc:2749] T 1a61655d99124a29b486ba4a5b37faea P e61c3a8f61bb48f8a963c9480e53c168 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:04:51.515180 19404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4af19371ea874c09a0a2147040835cbb" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:04:51.526978 19486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e1085d23e8347fbbd5bce7542f4b1f4" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:04:51.527916 19486 raft_consensus.cc:2410] T 0e1085d23e8347fbbd5bce7542f4b1f4 P 0473d2b2d01f4459b1e90fd12cc7840e [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e61c3a8f61bb48f8a963c9480e53c168 for term 4 because replica has last-logged OpId of term: 2 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260709 13:04:51.522086 20989 raft_consensus.cc:493] T 2e36a9d6e29c4a7c860cf267efbd4c74 P e5256d91808b47c195bc9b4dbd7f2b87 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 0473d2b2d01f4459b1e90fd12cc7840e)
I20260709 13:04:51.552774 20941 leader_election.cc:290] T 0e1085d23e8347fbbd5bce7542f4b1f4 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:04:51.565099 19309 catalog_manager.cc:5697] T ff9b0eddd810459b82d91c60777c10eb P 127766fc592545a4997f7790f50f6076 reported cstate change: term changed from 1 to 2, leader changed from e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1) to 127766fc592545a4997f7790f50f6076 (127.17.223.4). New cstate: current_term: 2 leader_uuid: "127766fc592545a4997f7790f50f6076" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:04:51.593102 20934 raft_consensus.cc:493] T 62c6c134d3d24a1ab144dd9ee6bc3f64 P 0473d2b2d01f4459b1e90fd12cc7840e [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:51.593797 20934 raft_consensus.cc:515] T 62c6c134d3d24a1ab144dd9ee6bc3f64 P 0473d2b2d01f4459b1e90fd12cc7840e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:04:51.519258 21031 raft_consensus.cc:515] T 3e1f505cb0f1427bbd698ac889d80821 P e61c3a8f61bb48f8a963c9480e53c168 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:51.595844 20934 leader_election.cc:290] T 62c6c134d3d24a1ab144dd9ee6bc3f64 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:04:51.596436 21031 leader_election.cc:290] T 3e1f505cb0f1427bbd698ac889d80821 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:04:51.597112 20934 raft_consensus.cc:493] T 21e14947d70440f19044d8f75c31e1f9 P 0473d2b2d01f4459b1e90fd12cc7840e [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e5256d91808b47c195bc9b4dbd7f2b87)
I20260709 13:04:51.597378 20837 tablet_bootstrap.cc:492] T df751f992649444090e27965eb1af85d P 127766fc592545a4997f7790f50f6076: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 1 replicates
I20260709 13:04:51.597738 20934 raft_consensus.cc:515] T 21e14947d70440f19044d8f75c31e1f9 P 0473d2b2d01f4459b1e90fd12cc7840e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:51.598412 20837 tablet_bootstrap.cc:492] T df751f992649444090e27965eb1af85d P 127766fc592545a4997f7790f50f6076: Bootstrap complete.
I20260709 13:04:51.599777 20837 ts_tablet_manager.cc:1403] T df751f992649444090e27965eb1af85d P 127766fc592545a4997f7790f50f6076: Time spent bootstrapping tablet: real 0.796s	user 0.040s	sys 0.006s
I20260709 13:04:51.599872 20934 leader_election.cc:290] T 21e14947d70440f19044d8f75c31e1f9 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:04:51.658869 20839 raft_consensus.cc:493] T 96efeaaf1057492490e9a621f37e1a2d P 0473d2b2d01f4459b1e90fd12cc7840e [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 127766fc592545a4997f7790f50f6076)
I20260709 13:04:51.673288 20885 raft_consensus.cc:515] T 46c5bfeecc314717bffe987e6844b6d0 P e61c3a8f61bb48f8a963c9480e53c168 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:51.676514 20112 raft_consensus.cc:1240] T 2a16f7501e2444fb86d4e2778e734e02 P 127766fc592545a4997f7790f50f6076 [term 5 FOLLOWER]: Rejecting Update request from peer e5256d91808b47c195bc9b4dbd7f2b87 for earlier term 4. Current term is 5. Ops: []
I20260709 13:04:51.676390 20837 raft_consensus.cc:359] T df751f992649444090e27965eb1af85d P 127766fc592545a4997f7790f50f6076 [term 2 NON_PARTICIPANT]: Replica starting. Triggering 1 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
W20260709 13:04:51.652324 21027 log.cc:927] Time spent T 70797e5783b5454ab0d0eea663e791e3 P e61c3a8f61bb48f8a963c9480e53c168: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
I20260709 13:04:51.559727 20989 raft_consensus.cc:515] T 2e36a9d6e29c4a7c860cf267efbd4c74 P e5256d91808b47c195bc9b4dbd7f2b87 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:51.667142 20935 raft_consensus.cc:493] T d1e5873a19244c5ebbcd38e126796ee7 P 0473d2b2d01f4459b1e90fd12cc7840e [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e5256d91808b47c195bc9b4dbd7f2b87)
I20260709 13:04:51.686985 20935 raft_consensus.cc:515] T d1e5873a19244c5ebbcd38e126796ee7 P 0473d2b2d01f4459b1e90fd12cc7840e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:51.691675 20935 leader_election.cc:290] T d1e5873a19244c5ebbcd38e126796ee7 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:04:51.681000 20824 raft_consensus.cc:515] T 0cdf56e38bbc453d9438d359e5a69955 P e5256d91808b47c195bc9b4dbd7f2b87 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:51.678226 20839 raft_consensus.cc:515] T 96efeaaf1057492490e9a621f37e1a2d P 0473d2b2d01f4459b1e90fd12cc7840e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:04:51.688967 20829 consensus_queue.cc:1059] T 2a16f7501e2444fb86d4e2778e734e02 P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false }, Status: INVALID_TERM, Last received: 4.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.020s
W20260709 13:04:51.831859 19523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.1:40321, user_credentials={real_user=slave}} blocked reactor thread for 352725us
I20260709 13:04:51.771636 20837 raft_consensus.cc:740] T df751f992649444090e27965eb1af85d P 127766fc592545a4997f7790f50f6076 [term 2 LEARNER]: Becoming Follower/Learner. State: Replica: 127766fc592545a4997f7790f50f6076, State: Initialized, Role: LEARNER
W20260709 13:04:51.799867 20908 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.613s	user 0.048s	sys 0.113s
I20260709 13:04:51.817099 20853 raft_consensus.cc:493] T fa731b585f684a7fb2d106c50f143b83 P e61c3a8f61bb48f8a963c9480e53c168 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 127766fc592545a4997f7790f50f6076)
W20260709 13:04:51.878918 20908 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.692s	user 0.048s	sys 0.113s
I20260709 13:04:51.861395 20989 leader_election.cc:290] T 2e36a9d6e29c4a7c860cf267efbd4c74 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:04:51.894375 20824 leader_election.cc:290] T 0cdf56e38bbc453d9438d359e5a69955 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 4 election: Requested vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:04:51.896246 20837 consensus_queue.cc:260] T df751f992649444090e27965eb1af85d P 127766fc592545a4997f7790f50f6076 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } attrs { replace: true } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: NON_VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: true } }
W20260709 13:04:51.898207 21052 log.cc:927] Time spent T 1dc5b3532fe54f74876d02beffa2c230 P e5256d91808b47c195bc9b4dbd7f2b87: Append to log took a long time: real 0.125s	user 0.001s	sys 0.000s
I20260709 13:04:51.889323 20853 raft_consensus.cc:515] T fa731b585f684a7fb2d106c50f143b83 P e61c3a8f61bb48f8a963c9480e53c168 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:04:51.896021 20885 leader_election.cc:290] T 46c5bfeecc314717bffe987e6844b6d0 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 5 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
W20260709 13:04:51.876936 20996 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.668s	user 0.025s	sys 0.008s
I20260709 13:04:51.918227 21010 raft_consensus.cc:1064] T 309c3ca0ca4b4f3ba129752ea2cb293b P e61c3a8f61bb48f8a963c9480e53c168: attempting to promote NON_VOTER 127766fc592545a4997f7790f50f6076 to VOTER
W20260709 13:04:51.922240 21021 log.cc:927] Time spent T e381f1d6b8184797ad142de49be225a8 P e61c3a8f61bb48f8a963c9480e53c168: Append to log took a long time: real 0.913s	user 0.009s	sys 0.002s
I20260709 13:04:51.927944 21043 tablet_copy_client.cc:323] T 14935b3ddf914369822e4a0547aaa355 P 127766fc592545a4997f7790f50f6076: tablet copy: Beginning tablet copy session from remote peer at address 127.17.223.2:46257
W20260709 13:04:52.010072 19523 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:52.012692 19554 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40428 (request call id 1485) took 1493 ms. Trace:
I20260709 13:04:52.015609 19555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e36a9d6e29c4a7c860cf267efbd4c74" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:04:52.013301 19554 rpcz_store.cc:276] 0709 13:04:50.518827 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:50.520574 (+  1747us) service_pool.cc:224] Handling call
0709 13:04:50.553966 (+ 33392us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:04:50.554348 (+   382us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 13:04:50.595752 (+ 41404us) log.cc:844] Serialized 14 byte log entry
0709 13:04:50.802597 (+206845us) spinlock_profiling.cc:243] Waited 11.2 ms on lock 0x7b4400022b4c. stack: 00007f4a79de9343 00007f4a79de9240 00007f4a797781d4 00007f4a834b6304 00007f4a834b6299 00007f4a79ca3db1 00007f4a79d41c85 00007f4a79d426a2 00007f4a7cab41db 00007f4a7caafaaf 00007f4a79dfe0ac 00007f4a82c58ab9 00007f4a79e1a69b 00007f4a79e1893f 00007f4a79e1ac02 00007f4a7caa220b
0709 13:04:50.975897 (+173300us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:04:50.997122 (+ 21225us) log.cc:844] Serialized 26 byte log entry
0709 13:04:51.001094 (+  3972us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:04:51.001865 (+   771us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:51.016211 (+ 14346us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:04:51.763456 (+747245us) spinlock_profiling.cc:243] Waited 2.65 ms on lock 0x7b180048bb00. stack: 00007f4a79de9343 00007f4a79de9240 00007f4a797781d4 00007f4a834b6304 00007f4a834b6299 00007f4a82ce3de1 00007f4a82cf05b1 00007f4a79e1b522 00007f4a79e1d7c1 00007f4a79e1d779 00007f4a79e1d709 00007f4a79e1d6d1 00007f4a79e1c9cd 000000000038f354 000000000038f199 00007f4a79dfe83a
0709 13:04:51.921606 (+158150us) spinlock_profiling.cc:243] Waited 7.12 ms on lock 0x7b4400022b4c. stack: 00007f4a79de9343 00007f4a79de9240 00007f4a797781d4 00007f4a834b6304 00007f4a834b6299 00007f4a79ca3db1 00007f4a79d41c85 00007f4a79d426a2 00007f4a7cab41db 00007f4a7caafaaf 00007f4a7caa386e 00007f4a7caa2bb6 00007f4a7caa27d8 00007f4a7caac221 00007f4a7caac1d9 00007f4a7caac169
0709 13:04:52.011868 (+ 90262us) raft_consensus.cc:1685] finished
0709 13:04:52.011973 (+   105us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:52.012416 (+   443us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":22780,"prepare.queue_time_us":32406,"prepare.run_cpu_time_us":34,"prepare.run_wall_time_us":36,"raft.queue_time_us":3004,"raft.run_cpu_time_us":285,"raft.run_wall_time_us":8027,"spinlock_wait_cycles":48236288,"thread_start_us":320742,"threads_started":1,"wal-append.queue_time_us":393487}
I20260709 13:04:52.018564 19477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e1f505cb0f1427bbd698ac889d80821" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:04:52.019797 19477 raft_consensus.cc:2468] T 3e1f505cb0f1427bbd698ac889d80821 P 0473d2b2d01f4459b1e90fd12cc7840e [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 1.
I20260709 13:04:52.020428 19523 leader_election.cc:304] T 4af19371ea874c09a0a2147040835cbb P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e61c3a8f61bb48f8a963c9480e53c168; no voters: 127766fc592545a4997f7790f50f6076, e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:04:52.023339 19404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e1f505cb0f1427bbd698ac889d80821" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:04:52.026000 19403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46c5bfeecc314717bffe987e6844b6d0" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 5 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
I20260709 13:04:52.027000 19403 raft_consensus.cc:3060] T 46c5bfeecc314717bffe987e6844b6d0 P e5256d91808b47c195bc9b4dbd7f2b87 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:04:52.021858 19482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46c5bfeecc314717bffe987e6844b6d0" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 5 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
W20260709 13:04:52.047526 19557 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.554s	user 0.000s	sys 0.025s
W20260709 13:04:52.048089 19557 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.555s	user 0.000s	sys 0.025s
I20260709 13:04:52.051823 19559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cdf56e38bbc453d9438d359e5a69955" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:04:52.052788 19559 raft_consensus.cc:3060] T 0cdf56e38bbc453d9438d359e5a69955 P e61c3a8f61bb48f8a963c9480e53c168 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:04:51.824887 20075 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.563s	user 0.012s	sys 0.014s
W20260709 13:04:52.068209 20075 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.806s	user 0.012s	sys 0.014s
W20260709 13:04:52.068747 20075 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.1:40321, user_credentials={real_user=slave}} blocked reactor thread for 806798us
W20260709 13:04:52.070523 20076 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.716s	user 0.011s	sys 0.021s
W20260709 13:04:52.071077 20076 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.723s	user 0.012s	sys 0.022s
I20260709 13:04:52.075892 19553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed7fdbcb96d14d418db9ca90a792588a" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:04:52.079010 19560 raft_consensus.cc:1275] T 62c6c134d3d24a1ab144dd9ee6bc3f64 P e61c3a8f61bb48f8a963c9480e53c168 [term 3 FOLLOWER]: Refusing update from remote peer 127766fc592545a4997f7790f50f6076: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 5. (term mismatch)
I20260709 13:04:52.079432 19560 pending_rounds.cc:85] T 62c6c134d3d24a1ab144dd9ee6bc3f64 P e61c3a8f61bb48f8a963c9480e53c168: Aborting all ops after (but not including) 4
I20260709 13:04:52.079717 19560 pending_rounds.cc:107] T 62c6c134d3d24a1ab144dd9ee6bc3f64 P e61c3a8f61bb48f8a963c9480e53c168: Aborting uncommitted NO_OP operation due to leader change: 2.5
I20260709 13:04:52.080054 19560 raft_consensus.cc:2889] T 62c6c134d3d24a1ab144dd9ee6bc3f64 P e61c3a8f61bb48f8a963c9480e53c168 [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:04:52.082027 19557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a16f7501e2444fb86d4e2778e734e02" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: true dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:04:52.082661 20109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e1085d23e8347fbbd5bce7542f4b1f4" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:04:52.084039 20109 raft_consensus.cc:2410] T 0e1085d23e8347fbbd5bce7542f4b1f4 P 127766fc592545a4997f7790f50f6076 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e61c3a8f61bb48f8a963c9480e53c168 for term 4 because replica has last-logged OpId of term: 2 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260709 13:04:52.082966 19557 raft_consensus.cc:3060] T 2a16f7501e2444fb86d4e2778e734e02 P e61c3a8f61bb48f8a963c9480e53c168 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:04:52.100239 20733 raft_consensus.cc:2749] T 4af19371ea874c09a0a2147040835cbb P e61c3a8f61bb48f8a963c9480e53c168 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:04:52.102766 20733 raft_consensus.cc:493] T fa8650e71aa14778b3d73721fc50d9fc P e61c3a8f61bb48f8a963c9480e53c168 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:52.103658 20733 raft_consensus.cc:515] T fa8650e71aa14778b3d73721fc50d9fc P e61c3a8f61bb48f8a963c9480e53c168 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
W20260709 13:04:52.107952 20728 consensus_meta.cc:287] T 1efebf73c86e432baa55533136b6e12c P e61c3a8f61bb48f8a963c9480e53c168: Time spent flushing consensus metadata: real 0.642s	user 0.016s	sys 0.000s
I20260709 13:04:52.113708 20728 raft_consensus.cc:515] T 1efebf73c86e432baa55533136b6e12c P e61c3a8f61bb48f8a963c9480e53c168 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:04:52.114868 20733 leader_election.cc:290] T fa8650e71aa14778b3d73721fc50d9fc P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:04:52.115581 20754 raft_consensus.cc:493] T ff9b0eddd810459b82d91c60777c10eb P e5256d91808b47c195bc9b4dbd7f2b87 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 127766fc592545a4997f7790f50f6076)
I20260709 13:04:52.107993 19404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa8650e71aa14778b3d73721fc50d9fc" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:04:52.124312 19404 raft_consensus.cc:2468] T fa8650e71aa14778b3d73721fc50d9fc P e5256d91808b47c195bc9b4dbd7f2b87 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 3.
I20260709 13:04:52.118642 19559 raft_consensus.cc:2468] T 0cdf56e38bbc453d9438d359e5a69955 P e61c3a8f61bb48f8a963c9480e53c168 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 4.
I20260709 13:04:52.120036 20112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1efebf73c86e432baa55533136b6e12c" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076"
I20260709 13:04:52.125697 19523 leader_election.cc:304] T fa8650e71aa14778b3d73721fc50d9fc P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:04:52.120973 19482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1efebf73c86e432baa55533136b6e12c" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:04:52.116569 20754 raft_consensus.cc:515] T ff9b0eddd810459b82d91c60777c10eb P e5256d91808b47c195bc9b4dbd7f2b87 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:04:52.129114 20728 leader_election.cc:290] T 1efebf73c86e432baa55533136b6e12c P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 4 election: Requested vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:04:52.121984 19477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa8650e71aa14778b3d73721fc50d9fc" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:04:52.133932 20733 raft_consensus.cc:2804] T fa8650e71aa14778b3d73721fc50d9fc P e61c3a8f61bb48f8a963c9480e53c168 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:04:52.134477 20733 raft_consensus.cc:493] T fa8650e71aa14778b3d73721fc50d9fc P e61c3a8f61bb48f8a963c9480e53c168 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:52.129384 20754 leader_election.cc:290] T ff9b0eddd810459b82d91c60777c10eb P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:04:52.130396 19375 leader_election.cc:304] T 0cdf56e38bbc453d9438d359e5a69955 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:04:52.132691 20112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff9b0eddd810459b82d91c60777c10eb" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:04:52.123193 19557 raft_consensus.cc:2468] T 2a16f7501e2444fb86d4e2778e734e02 P e61c3a8f61bb48f8a963c9480e53c168 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 127766fc592545a4997f7790f50f6076 in term 5.
I20260709 13:04:52.121397 19403 raft_consensus.cc:2468] T 46c5bfeecc314717bffe987e6844b6d0 P e5256d91808b47c195bc9b4dbd7f2b87 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 5.
I20260709 13:04:52.159113 20824 raft_consensus.cc:493] T 172b3dd13109415a955b71ac0e9d2234 P e5256d91808b47c195bc9b4dbd7f2b87 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0473d2b2d01f4459b1e90fd12cc7840e)
W20260709 13:04:51.911805 20996 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.703s	user 0.026s	sys 0.008s
I20260709 13:04:52.146255 20733 raft_consensus.cc:3060] T fa8650e71aa14778b3d73721fc50d9fc P e61c3a8f61bb48f8a963c9480e53c168 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:04:52.186306 20853 leader_election.cc:290] T fa731b585f684a7fb2d106c50f143b83 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:04:52.160455 20839 leader_election.cc:290] T 96efeaaf1057492490e9a621f37e1a2d P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:04:52.163632 20837 ts_tablet_manager.cc:1434] T df751f992649444090e27965eb1af85d P 127766fc592545a4997f7790f50f6076: Time spent starting tablet: real 0.531s	user 0.006s	sys 0.004s
I20260709 13:04:52.168716 20911 raft_consensus.cc:493] T 0e1085d23e8347fbbd5bce7542f4b1f4 P 127766fc592545a4997f7790f50f6076 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:52.190889 20829 raft_consensus.cc:493] T 14935b3ddf914369822e4a0547aaa355 P e5256d91808b47c195bc9b4dbd7f2b87 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0473d2b2d01f4459b1e90fd12cc7840e)
W20260709 13:04:52.163906 20075 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.1:40321, user_credentials={real_user=slave}} blocked reactor thread for 93971.3us
I20260709 13:04:52.195859 20829 raft_consensus.cc:515] T 14935b3ddf914369822e4a0547aaa355 P e5256d91808b47c195bc9b4dbd7f2b87 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
W20260709 13:04:52.199625 20945 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.572s	user 0.012s	sys 0.023s
W20260709 13:04:52.200186 20945 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.600s	user 0.012s	sys 0.023s
I20260709 13:04:52.200476 20829 leader_election.cc:290] T 14935b3ddf914369822e4a0547aaa355 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:04:52.200316 20995 raft_consensus.cc:493] T b9f0d59553ad444883fcf5b5909f9798 P e5256d91808b47c195bc9b4dbd7f2b87 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0473d2b2d01f4459b1e90fd12cc7840e)
W20260709 13:04:52.194258 20833 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.635s	user 0.007s	sys 0.006s
I20260709 13:04:52.160161 20824 raft_consensus.cc:515] T 172b3dd13109415a955b71ac0e9d2234 P e5256d91808b47c195bc9b4dbd7f2b87 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:04:52.204452 20945 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.BulkChangeConfig from 127.0.0.1:39466 (request call id 8) took 2877 ms. Trace:
W20260709 13:04:52.194711 20837 ts_tablet_manager.cc:1467] T df751f992649444090e27965eb1af85d P 127766fc592545a4997f7790f50f6076: Tablet startup took 579ms
I20260709 13:04:52.218153 20112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa731b585f684a7fb2d106c50f143b83" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
W20260709 13:04:52.216166 20833 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.657s	user 0.008s	sys 0.006s
W20260709 13:04:52.225934 19375 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.3:36891, user_credentials={real_user=slave}} blocked reactor thread for 95934.3us
I20260709 13:04:52.204365 20995 raft_consensus.cc:515] T b9f0d59553ad444883fcf5b5909f9798 P e5256d91808b47c195bc9b4dbd7f2b87 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:52.227083 20942 raft_consensus.cc:2804] T 0cdf56e38bbc453d9438d359e5a69955 P e5256d91808b47c195bc9b4dbd7f2b87 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:04:52.227646 20942 raft_consensus.cc:697] T 0cdf56e38bbc453d9438d359e5a69955 P e5256d91808b47c195bc9b4dbd7f2b87 [term 4 LEADER]: Becoming Leader. State: Replica: e5256d91808b47c195bc9b4dbd7f2b87, State: Running, Role: LEADER
I20260709 13:04:52.208664 20839 raft_consensus.cc:493] T 6c5eebf646ad445a9d1b1adc319d7b16 P 0473d2b2d01f4459b1e90fd12cc7840e [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 127766fc592545a4997f7790f50f6076)
I20260709 13:04:52.231712 19560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14935b3ddf914369822e4a0547aaa355" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:04:52.234439 19404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa731b585f684a7fb2d106c50f143b83" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:04:52.231750 20839 raft_consensus.cc:515] T 6c5eebf646ad445a9d1b1adc319d7b16 P 0473d2b2d01f4459b1e90fd12cc7840e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:04:52.235461 19404 raft_consensus.cc:2468] T fa731b585f684a7fb2d106c50f143b83 P e5256d91808b47c195bc9b4dbd7f2b87 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 2.
I20260709 13:04:52.256498 19523 leader_election.cc:304] T 46c5bfeecc314717bffe987e6844b6d0 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:04:52.220094 20911 raft_consensus.cc:515] T 0e1085d23e8347fbbd5bce7542f4b1f4 P 127766fc592545a4997f7790f50f6076 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:04:52.273422 19523 leader_election.cc:304] T fa731b585f684a7fb2d106c50f143b83 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
W20260709 13:04:52.273049 19407 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.503s	user 0.007s	sys 0.018s
W20260709 13:04:52.279923 19407 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.572s	user 0.008s	sys 0.018s
I20260709 13:04:52.285935 20885 raft_consensus.cc:2804] T fa731b585f684a7fb2d106c50f143b83 P e61c3a8f61bb48f8a963c9480e53c168 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:04:52.287629 20853 raft_consensus.cc:2804] T 46c5bfeecc314717bffe987e6844b6d0 P e61c3a8f61bb48f8a963c9480e53c168 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:04:52.287701 20873 raft_consensus.cc:493] T df751f992649444090e27965eb1af85d P e61c3a8f61bb48f8a963c9480e53c168 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e5256d91808b47c195bc9b4dbd7f2b87)
I20260709 13:04:52.287622 20864 raft_consensus.cc:493] T 179fd671030940b4b4a4e24bcc4aba0a P e61c3a8f61bb48f8a963c9480e53c168 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e5256d91808b47c195bc9b4dbd7f2b87)
I20260709 13:04:52.288903 20873 raft_consensus.cc:515] T df751f992649444090e27965eb1af85d P e61c3a8f61bb48f8a963c9480e53c168 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:52.289414 20864 raft_consensus.cc:515] T 179fd671030940b4b4a4e24bcc4aba0a P e61c3a8f61bb48f8a963c9480e53c168 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:52.290338 21011 raft_consensus.cc:493] T b08304a0a02b42d7840c4e8ee9a6bd1a P e61c3a8f61bb48f8a963c9480e53c168 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e5256d91808b47c195bc9b4dbd7f2b87)
I20260709 13:04:52.288506 20853 raft_consensus.cc:697] T 46c5bfeecc314717bffe987e6844b6d0 P e61c3a8f61bb48f8a963c9480e53c168 [term 5 LEADER]: Becoming Leader. State: Replica: e61c3a8f61bb48f8a963c9480e53c168, State: Running, Role: LEADER
I20260709 13:04:52.292893 20885 raft_consensus.cc:493] T fa731b585f684a7fb2d106c50f143b83 P e61c3a8f61bb48f8a963c9480e53c168 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 127766fc592545a4997f7790f50f6076)
I20260709 13:04:52.298183 20995 leader_election.cc:290] T b9f0d59553ad444883fcf5b5909f9798 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:04:52.296725 20864 leader_election.cc:290] T 179fd671030940b4b4a4e24bcc4aba0a P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:04:52.298452 20728 raft_consensus.cc:493] T 217b5fae677b4971b3bbd2f357a1f7ff P e61c3a8f61bb48f8a963c9480e53c168 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e5256d91808b47c195bc9b4dbd7f2b87)
I20260709 13:04:52.299753 19477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "179fd671030940b4b4a4e24bcc4aba0a" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:04:52.305263 19555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b74109013a140ada21feeef92d6f563" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:04:52.296200 20839 leader_election.cc:290] T 6c5eebf646ad445a9d1b1adc319d7b16 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:04:52.313120 20853 consensus_queue.cc:237] T 46c5bfeecc314717bffe987e6844b6d0 P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:52.313431 19556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9f0d59553ad444883fcf5b5909f9798" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:04:52.313967 19404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "179fd671030940b4b4a4e24bcc4aba0a" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:04:52.316037 20728 raft_consensus.cc:515] T 217b5fae677b4971b3bbd2f357a1f7ff P e61c3a8f61bb48f8a963c9480e53c168 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:52.276716 20942 consensus_queue.cc:237] T 0cdf56e38bbc453d9438d359e5a69955 P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:52.322031 20824 leader_election.cc:290] T 172b3dd13109415a955b71ac0e9d2234 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:04:52.306986 20885 raft_consensus.cc:3060] T fa731b585f684a7fb2d106c50f143b83 P e61c3a8f61bb48f8a963c9480e53c168 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:04:52.213280 20945 rpcz_store.cc:276] 0709 13:04:49.326937 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:49.327085 (+   148us) service_pool.cc:224] Handling call
0709 13:04:50.115382 (+788297us) spinlock_profiling.cc:243] Waited 24.8 ms on lock 0x7b4c0031a480. stack: 00007f4a79de9343 00007f4a79de9240 00007f4a797781d4 00007f4a834b6304 00007f4a834b6299 00007f4a7b1d4a20 00007f4a7b1e5a29 00007f4a7b1ab644 00007f4a7b1d2f2d 00007f4a7b1d2b93 00007f4a7ce611af 00007f4a7ce60f3e 00007f4a7cee6888 00007f4a7cf0375c 00007f4a7cf0476a 00007f4a7cf0391b
0709 13:04:50.115961 (+   579us) log.cc:844] Serialized 499 byte log entry
0709 13:04:50.399954 (+283993us) spinlock_profiling.cc:243] Waited 16 ms on lock 0x7b58002309d0. stack: 00007f4a79de9343 00007f4a79de9240 00007f4a797781d4 00007f4a834b6304 00007f4a834b6299 00007f4a7ce72090 00007f4a7ce6243c 00007f4a7ce68d53 00007f4a7ce68cd9 00007f4a7ce68c69 00007f4a7ce68c31 00007f4a7ce67dfd 000000000038f354 000000000038f199 00007f4a79e1b475 00007f4a79e1d7c1
0709 13:04:50.468697 (+ 68743us) spinlock_profiling.cc:243] Waited 7.67 ms on lock 0x7b540003bea0. stack: 00007f4a79de9343 00007f4a79de9240 00007f4a797781d4 00007f4a834b6304 00007f4a834b6299 00007f4a7ce71571 00007f4a7ce81142 00007f4a7ce61eaa 00007f4a7ce68d53 00007f4a7ce68cd9 00007f4a7ce68c69 00007f4a7ce68c31 00007f4a7ce67dfd 000000000038f354 000000000038f199 00007f4a79e1b475
0709 13:04:52.204288 (+1735591us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":110974,"raft.queue_time_us":31767,"raft.run_cpu_time_us":4726,"raft.run_wall_time_us":462752,"spinlock_wait_cycles":111631360,"thread_start_us":84983,"threads_started":1,"wal-append.queue_time_us":111131,"wal-append.run_cpu_time_us":1533,"wal-append.run_wall_time_us":1001683}
I20260709 13:04:52.306713 21011 raft_consensus.cc:515] T b08304a0a02b42d7840c4e8ee9a6bd1a P e61c3a8f61bb48f8a963c9480e53c168 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:52.325649 20728 leader_election.cc:290] T 217b5fae677b4971b3bbd2f357a1f7ff P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:04:52.340688 20908 raft_consensus.cc:493] T df751f992649444090e27965eb1af85d P 0473d2b2d01f4459b1e90fd12cc7840e [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e5256d91808b47c195bc9b4dbd7f2b87)
I20260709 13:04:52.340587 20785 consensus_queue.cc:1048] T 62c6c134d3d24a1ab144dd9ee6bc3f64 P 127766fc592545a4997f7790f50f6076 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:04:52.341568 20908 raft_consensus.cc:515] T df751f992649444090e27965eb1af85d P 0473d2b2d01f4459b1e90fd12cc7840e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:52.343938 20908 leader_election.cc:290] T df751f992649444090e27965eb1af85d P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
W20260709 13:04:52.344957 19523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.4:43121, user_credentials={real_user=slave}} blocked reactor thread for 43832.4us
I20260709 13:04:52.354357 19477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "217b5fae677b4971b3bbd2f357a1f7ff" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:04:52.354782 21011 leader_election.cc:290] T b08304a0a02b42d7840c4e8ee9a6bd1a P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:04:52.369669 21010 consensus_queue.cc:237] T 309c3ca0ca4b4f3ba129752ea2cb293b P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.4, Last appended by leader: 3, Current term: 3, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } attrs { replace: true } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:04:52.371732 20871 raft_consensus.cc:3055] T 2a16f7501e2444fb86d4e2778e734e02 P e5256d91808b47c195bc9b4dbd7f2b87 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:04:52.372546 20908 raft_consensus.cc:493] T 179fd671030940b4b4a4e24bcc4aba0a P 0473d2b2d01f4459b1e90fd12cc7840e [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e5256d91808b47c195bc9b4dbd7f2b87)
I20260709 13:04:52.395543 20908 raft_consensus.cc:515] T 179fd671030940b4b4a4e24bcc4aba0a P 0473d2b2d01f4459b1e90fd12cc7840e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:52.397886 20908 leader_election.cc:290] T 179fd671030940b4b4a4e24bcc4aba0a P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:04:52.384236 20785 raft_consensus.cc:493] T 96efeaaf1057492490e9a621f37e1a2d P 127766fc592545a4997f7790f50f6076 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:52.361064 20076 leader_election.cc:304] T 2a16f7501e2444fb86d4e2778e734e02 P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 127766fc592545a4997f7790f50f6076, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:04:52.389837 19552 raft_consensus.cc:1275] T 28af091831594f9d8e96482078cc7625 P e61c3a8f61bb48f8a963c9480e53c168 [term 3 FOLLOWER]: Refusing update from remote peer 0473d2b2d01f4459b1e90fd12cc7840e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
W20260709 13:04:52.398921 20076 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.3:36891, user_credentials={real_user=slave}} blocked reactor thread for 59026.9us
I20260709 13:04:52.398721 20785 raft_consensus.cc:515] T 96efeaaf1057492490e9a621f37e1a2d P 127766fc592545a4997f7790f50f6076 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:04:52.399551 21006 raft_consensus.cc:2804] T 2a16f7501e2444fb86d4e2778e734e02 P 127766fc592545a4997f7790f50f6076 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:04:52.400066 21006 raft_consensus.cc:697] T 2a16f7501e2444fb86d4e2778e734e02 P 127766fc592545a4997f7790f50f6076 [term 5 LEADER]: Becoming Leader. State: Replica: 127766fc592545a4997f7790f50f6076, State: Running, Role: LEADER
W20260709 13:04:52.219178 20837 ts_tablet_manager.cc:1469] T df751f992649444090e27965eb1af85d P 127766fc592545a4997f7790f50f6076: Trace:
0709 13:04:46.089229 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:46.090022 (+   793us) service_pool.cc:224] Handling call
0709 13:04:46.295151 (+205129us) ts_tablet_manager.cc:934] T df751f992649444090e27965eb1af85d P 127766fc592545a4997f7790f50f6076: Initiating tablet copy from peer e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
0709 13:04:50.234743 (+3939592us) tablet_copy_client.cc:368] Tablet copy session begun
0709 13:04:50.383662 (+148919us) tablet_metadata.cc:665] Metadata flushed
0709 13:04:50.383784 (+   122us) tablet_copy_client.cc:497] Wrote new tablet metadata
0709 13:04:50.393390 (+  9606us) tablet_copy_client.cc:418] Wrote new consensus metadata
0709 13:04:50.393686 (+   296us) tablet_replica.cc:206] Creating consensus instance
0709 13:04:50.393988 (+   302us) ts_tablet_manager.cc:989] Replica registered.
0709 13:04:50.394054 (+    66us) inbound_call.cc:177] Queueing success response
0709 13:04:50.804000 (+409946us) ts_tablet_manager.cc:1379] Bootstrapping tablet
0709 13:04:51.632309 (+828309us) ts_tablet_manager.cc:1435] Starting tablet replica
0709 13:04:51.673708 (+ 41399us) tablet_replica.cc:261] Starting instrumentation
0709 13:04:51.674431 (+   723us) tablet_replica.cc:280] Starting consensus
Metrics: {"dns_us":94385,"raft.queue_time_us":256639,"raft.run_cpu_time_us":307,"raft.run_wall_time_us":305,"tablet-copy.queue_time_us":147264,"tablet-download-pool.queue_time_us":307,"tablet-download-pool.run_cpu_time_us":1565,"tablet-download-pool.run_wall_time_us":22521,"thread_start_us":105326,"threads_started":2}
I20260709 13:04:52.401228 20785 leader_election.cc:290] T 96efeaaf1057492490e9a621f37e1a2d P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:04:52.401175 21006 consensus_queue.cc:237] T 2a16f7501e2444fb86d4e2778e734e02 P 127766fc592545a4997f7790f50f6076 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:04:52.403205 19560 raft_consensus.cc:1275] T 86a6797bdfe94fa496c050ceae4bd0d9 P e61c3a8f61bb48f8a963c9480e53c168 [term 3 FOLLOWER]: Refusing update from remote peer 0473d2b2d01f4459b1e90fd12cc7840e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:04:52.403380 20733 raft_consensus.cc:515] T fa8650e71aa14778b3d73721fc50d9fc P e61c3a8f61bb48f8a963c9480e53c168 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:52.403800 19551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c5eebf646ad445a9d1b1adc319d7b16" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:04:52.404386 19555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e5873a19244c5ebbcd38e126796ee7" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:04:52.404587 19554 raft_consensus.cc:1240] T fa8650e71aa14778b3d73721fc50d9fc P e61c3a8f61bb48f8a963c9480e53c168 [term 4 FOLLOWER]: Rejecting Update request from peer 0473d2b2d01f4459b1e90fd12cc7840e for earlier term 3. Current term is 4. Ops: []
I20260709 13:04:52.406283 19557 raft_consensus.cc:1275] T bc225c93219c45538b53a1bd3d387e4d P e61c3a8f61bb48f8a963c9480e53c168 [term 3 FOLLOWER]: Refusing update from remote peer 0473d2b2d01f4459b1e90fd12cc7840e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:04:52.407286 20995 raft_consensus.cc:493] T f93ee515a9c14139bf566522ed8232f3 P e5256d91808b47c195bc9b4dbd7f2b87 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:52.407351 19556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96efeaaf1057492490e9a621f37e1a2d" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:04:52.408509 19556 raft_consensus.cc:2393] T 96efeaaf1057492490e9a621f37e1a2d P e61c3a8f61bb48f8a963c9480e53c168 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0473d2b2d01f4459b1e90fd12cc7840e in current term 3: Already voted for candidate e61c3a8f61bb48f8a963c9480e53c168 in this term.
I20260709 13:04:52.408177 20995 raft_consensus.cc:515] T f93ee515a9c14139bf566522ed8232f3 P e5256d91808b47c195bc9b4dbd7f2b87 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:52.413000 20873 leader_election.cc:290] T df751f992649444090e27965eb1af85d P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:04:52.413201 19558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21e14947d70440f19044d8f75c31e1f9" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:04:52.392113 20871 raft_consensus.cc:740] T 2a16f7501e2444fb86d4e2778e734e02 P e5256d91808b47c195bc9b4dbd7f2b87 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: e5256d91808b47c195bc9b4dbd7f2b87, State: Running, Role: LEADER
W20260709 13:04:52.412997 21075 log.cc:927] Time spent T 40e1e16737a842ee936002830f36882e P e5256d91808b47c195bc9b4dbd7f2b87: Append to log took a long time: real 0.075s	user 0.000s	sys 0.000s
I20260709 13:04:52.426191 20728 raft_consensus.cc:493] T f1b10566f45d4a7d9029858330e02d5b P e61c3a8f61bb48f8a963c9480e53c168 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader e5256d91808b47c195bc9b4dbd7f2b87)
I20260709 13:04:52.426975 19552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62c6c134d3d24a1ab144dd9ee6bc3f64" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:04:52.427649 19403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b08304a0a02b42d7840c4e8ee9a6bd1a" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:04:52.404592 19551 raft_consensus.cc:2468] T 6c5eebf646ad445a9d1b1adc319d7b16 P e61c3a8f61bb48f8a963c9480e53c168 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 2.
I20260709 13:04:52.417562 20754 raft_consensus.cc:493] T ff75a1d4cb1f493db8f71ddc136ba9ab P e5256d91808b47c195bc9b4dbd7f2b87 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:52.431372 19477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b08304a0a02b42d7840c4e8ee9a6bd1a" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:04:52.416471 20829 raft_consensus.cc:493] T bc225c93219c45538b53a1bd3d387e4d P e5256d91808b47c195bc9b4dbd7f2b87 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:52.433136 20107 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46436 (request call id 299) took 1101 ms. Trace:
I20260709 13:04:52.434428 19407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "217b5fae677b4971b3bbd2f357a1f7ff" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:04:52.417457 20873 raft_consensus.cc:493] T 96efeaaf1057492490e9a621f37e1a2d P e61c3a8f61bb48f8a963c9480e53c168 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:52.435784 20109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "172b3dd13109415a955b71ac0e9d2234" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
W20260709 13:04:52.438066 19523 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:52.464262 19410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df751f992649444090e27965eb1af85d" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:04:52.466378 21011 raft_consensus.cc:493] T ece3db938bc649d4a40a51522ed5259c P e61c3a8f61bb48f8a963c9480e53c168 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:52.467290 21011 raft_consensus.cc:515] T ece3db938bc649d4a40a51522ed5259c P e61c3a8f61bb48f8a963c9480e53c168 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:04:52.471006 19560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96efeaaf1057492490e9a621f37e1a2d" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:04:52.444943 20911 leader_election.cc:290] T 0e1085d23e8347fbbd5bce7542f4b1f4 P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:04:52.457463 19552 raft_consensus.cc:2468] T 62c6c134d3d24a1ab144dd9ee6bc3f64 P e61c3a8f61bb48f8a963c9480e53c168 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 3.
I20260709 13:04:52.483217 19557 raft_consensus.cc:1240] T 1efebf73c86e432baa55533136b6e12c P e61c3a8f61bb48f8a963c9480e53c168 [term 4 FOLLOWER]: Rejecting Update request from peer 127766fc592545a4997f7790f50f6076 for earlier term 3. Current term is 4. Ops: []
W20260709 13:04:52.490790 19450 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:52.491557 20908 raft_consensus.cc:493] T 48824d5acfbc485ebf8c2d944e7202de P 0473d2b2d01f4459b1e90fd12cc7840e [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 127766fc592545a4997f7790f50f6076)
I20260709 13:04:52.494144 20908 raft_consensus.cc:515] T 48824d5acfbc485ebf8c2d944e7202de P 0473d2b2d01f4459b1e90fd12cc7840e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
W20260709 13:04:52.495460 19449 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.17.223.1:40321 timed out after 2.493s (SENT) [suppressed 42 similar messages]
I20260709 13:04:52.496492 20908 leader_election.cc:290] T 48824d5acfbc485ebf8c2d944e7202de P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:04:52.497637 20908 raft_consensus.cc:493] T 0e1085d23e8347fbbd5bce7542f4b1f4 P 0473d2b2d01f4459b1e90fd12cc7840e [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:52.498193 20908 raft_consensus.cc:515] T 0e1085d23e8347fbbd5bce7542f4b1f4 P 0473d2b2d01f4459b1e90fd12cc7840e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:04:52.500499 20908 leader_election.cc:290] T 0e1085d23e8347fbbd5bce7542f4b1f4 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:04:52.521430 19477 raft_consensus.cc:2468] T b08304a0a02b42d7840c4e8ee9a6bd1a P 0473d2b2d01f4459b1e90fd12cc7840e [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 2.
I20260709 13:04:52.522804 20829 raft_consensus.cc:515] T bc225c93219c45538b53a1bd3d387e4d P e5256d91808b47c195bc9b4dbd7f2b87 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:52.525851 20829 leader_election.cc:290] T bc225c93219c45538b53a1bd3d387e4d P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:04:52.473935 20873 raft_consensus.cc:515] T 96efeaaf1057492490e9a621f37e1a2d P e61c3a8f61bb48f8a963c9480e53c168 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:04:52.529037 19560 raft_consensus.cc:2468] T 96efeaaf1057492490e9a621f37e1a2d P e61c3a8f61bb48f8a963c9480e53c168 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 127766fc592545a4997f7790f50f6076 in term 3.
I20260709 13:04:52.527261 19557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc225c93219c45538b53a1bd3d387e4d" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:04:52.530573 19557 raft_consensus.cc:2468] T bc225c93219c45538b53a1bd3d387e4d P e61c3a8f61bb48f8a963c9480e53c168 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 3.
I20260709 13:04:52.531399 20995 leader_election.cc:290] T f93ee515a9c14139bf566522ed8232f3 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
W20260709 13:04:52.532405 21076 log.cc:927] Time spent T 46c5bfeecc314717bffe987e6844b6d0 P e61c3a8f61bb48f8a963c9480e53c168: Append to log took a long time: real 0.098s	user 0.001s	sys 0.000s
I20260709 13:04:52.533707 19560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f93ee515a9c14139bf566522ed8232f3" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:04:52.532226 19375 leader_election.cc:304] T bc225c93219c45538b53a1bd3d387e4d P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:04:52.534936 19560 raft_consensus.cc:2468] T f93ee515a9c14139bf566522ed8232f3 P e61c3a8f61bb48f8a963c9480e53c168 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 3.
I20260709 13:04:52.535132 20995 raft_consensus.cc:2804] T bc225c93219c45538b53a1bd3d387e4d P e5256d91808b47c195bc9b4dbd7f2b87 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:04:52.535540 20995 raft_consensus.cc:493] T bc225c93219c45538b53a1bd3d387e4d P e5256d91808b47c195bc9b4dbd7f2b87 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:52.536412 19375 leader_election.cc:304] T f93ee515a9c14139bf566522ed8232f3 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:04:52.535880 20871 consensus_queue.cc:260] T 2a16f7501e2444fb86d4e2778e734e02 P e5256d91808b47c195bc9b4dbd7f2b87 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.5, Last appended by leader: 5, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:04:52.537336 20829 raft_consensus.cc:2804] T f93ee515a9c14139bf566522ed8232f3 P e5256d91808b47c195bc9b4dbd7f2b87 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:04:52.537760 20829 raft_consensus.cc:493] T f93ee515a9c14139bf566522ed8232f3 P e5256d91808b47c195bc9b4dbd7f2b87 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:52.538168 20829 raft_consensus.cc:3060] T f93ee515a9c14139bf566522ed8232f3 P e5256d91808b47c195bc9b4dbd7f2b87 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:04:52.530333 20873 leader_election.cc:290] T 96efeaaf1057492490e9a621f37e1a2d P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:04:52.509977 20754 raft_consensus.cc:515] T ff75a1d4cb1f493db8f71ddc136ba9ab P e5256d91808b47c195bc9b4dbd7f2b87 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:52.486081 20733 leader_election.cc:290] T fa8650e71aa14778b3d73721fc50d9fc P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 4 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:04:52.535897 20995 raft_consensus.cc:3060] T bc225c93219c45538b53a1bd3d387e4d P e5256d91808b47c195bc9b4dbd7f2b87 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:04:52.478370 20728 raft_consensus.cc:515] T f1b10566f45d4a7d9029858330e02d5b P e61c3a8f61bb48f8a963c9480e53c168 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:52.579145 19570 tablet_copy_service.cc:342] P e61c3a8f61bb48f8a963c9480e53c168: Request end of tablet copy session 127766fc592545a4997f7790f50f6076-df751f992649444090e27965eb1af85d received from {username='slave'} at 127.0.0.1:41504
I20260709 13:04:52.579770 21061 raft_consensus.cc:493] T 28af091831594f9d8e96482078cc7625 P e61c3a8f61bb48f8a963c9480e53c168 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:52.572726 20873 raft_consensus.cc:493] T 14935b3ddf914369822e4a0547aaa355 P e61c3a8f61bb48f8a963c9480e53c168 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0473d2b2d01f4459b1e90fd12cc7840e)
I20260709 13:04:52.580464 21061 raft_consensus.cc:515] T 28af091831594f9d8e96482078cc7625 P e61c3a8f61bb48f8a963c9480e53c168 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:52.580848 20873 raft_consensus.cc:515] T 14935b3ddf914369822e4a0547aaa355 P e61c3a8f61bb48f8a963c9480e53c168 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } attrs { replace: true } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: NON_VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: true } }
I20260709 13:04:52.582907 20873 leader_election.cc:290] T 14935b3ddf914369822e4a0547aaa355 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:04:52.579901 19570 tablet_copy_service.cc:434] P e61c3a8f61bb48f8a963c9480e53c168: ending tablet copy session 127766fc592545a4997f7790f50f6076-df751f992649444090e27965eb1af85d on tablet df751f992649444090e27965eb1af85d with peer 127766fc592545a4997f7790f50f6076
I20260709 13:04:52.579373 20754 leader_election.cc:290] T ff75a1d4cb1f493db8f71ddc136ba9ab P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:04:52.570392 20864 raft_consensus.cc:493] T 86a6797bdfe94fa496c050ceae4bd0d9 P e61c3a8f61bb48f8a963c9480e53c168 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:52.597724 19555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff75a1d4cb1f493db8f71ddc136ba9ab" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
W20260709 13:04:52.602480 19449 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.1:40321, user_credentials={real_user=slave}} blocked reactor thread for 140559us
I20260709 13:04:52.604995 19558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e1085d23e8347fbbd5bce7542f4b1f4" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:04:52.587255 21061 leader_election.cc:290] T 28af091831594f9d8e96482078cc7625 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:04:52.624969 20843 raft_consensus.cc:493] T ece3db938bc649d4a40a51522ed5259c P e5256d91808b47c195bc9b4dbd7f2b87 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:52.625766 20843 raft_consensus.cc:515] T ece3db938bc649d4a40a51522ed5259c P e5256d91808b47c195bc9b4dbd7f2b87 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:04:52.628300 21025 raft_consensus.cc:493] T edd7d470b5014c9489be7f41f64355c9 P e5256d91808b47c195bc9b4dbd7f2b87 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:52.629333 21025 raft_consensus.cc:515] T edd7d470b5014c9489be7f41f64355c9 P e5256d91808b47c195bc9b4dbd7f2b87 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:52.630923 20989 raft_consensus.cc:493] T 1a61655d99124a29b486ba4a5b37faea P e5256d91808b47c195bc9b4dbd7f2b87 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0473d2b2d01f4459b1e90fd12cc7840e)
I20260709 13:04:52.631609 20989 raft_consensus.cc:515] T 1a61655d99124a29b486ba4a5b37faea P e5256d91808b47c195bc9b4dbd7f2b87 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:52.631449 19304 catalog_manager.cc:5697] T 309c3ca0ca4b4f3ba129752ea2cb293b P e61c3a8f61bb48f8a963c9480e53c168 reported cstate change: term changed from 2 to 3, leader changed from e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1) to e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3). New cstate: current_term: 3 leader_uuid: "e61c3a8f61bb48f8a963c9480e53c168" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: NON_VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:52.633682 20989 leader_election.cc:290] T 1a61655d99124a29b486ba4a5b37faea P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:04:52.634177 20989 raft_consensus.cc:493] T e381f1d6b8184797ad142de49be225a8 P e5256d91808b47c195bc9b4dbd7f2b87 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:52.628494 20843 leader_election.cc:290] T ece3db938bc649d4a40a51522ed5259c P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:04:52.636168 20989 raft_consensus.cc:515] T e381f1d6b8184797ad142de49be225a8 P e5256d91808b47c195bc9b4dbd7f2b87 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:52.638936 20989 leader_election.cc:290] T e381f1d6b8184797ad142de49be225a8 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:04:52.645059 19309 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:51954 (request call id 125) took 3818 ms. Trace:
I20260709 13:04:52.646420 19304 catalog_manager.cc:5697] T 2e36a9d6e29c4a7c860cf267efbd4c74 P e61c3a8f61bb48f8a963c9480e53c168 reported cstate change: term changed from 1 to 2, leader changed from e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3) to 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2). New cstate: current_term: 2 leader_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } }
I20260709 13:04:52.649994 19403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa8650e71aa14778b3d73721fc50d9fc" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
I20260709 13:04:52.650424 20076 leader_election.cc:304] T 96efeaaf1057492490e9a621f37e1a2d P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 127766fc592545a4997f7790f50f6076, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:04:52.651013 20785 consensus_queue.cc:1059] T 1efebf73c86e432baa55533136b6e12c P 127766fc592545a4997f7790f50f6076 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:04:52.651296 20109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96efeaaf1057492490e9a621f37e1a2d" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:04:52.652248 21084 raft_consensus.cc:493] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P 0473d2b2d01f4459b1e90fd12cc7840e [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:52.652410 19407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ece3db938bc649d4a40a51522ed5259c" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:04:52.458326 20107 rpcz_store.cc:276] 0709 13:04:51.331622 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:51.333624 (+  2002us) service_pool.cc:224] Handling call
0709 13:04:51.360287 (+ 26663us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:04:51.421018 (+ 60731us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:04:51.422981 (+  1963us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:04:51.455273 (+ 32292us) log.cc:844] Serialized 26 byte log entry
0709 13:04:51.713005 (+257732us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:04:51.713087 (+    82us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:52.413742 (+700655us) spinlock_profiling.cc:243] Waited 23.7 ms on lock 0x7b54005082d4. stack: 00007f4a79de9343 00007f4a79de9240 00007f4a797781d4 00007f4a834b6304 00007f4a834b6299 00007f4a7ce71571 00007f4a7cf08e01 00007f4a7cf0783e 00007f4a81ecc419 00007f4a7b443bd4 00007f4a7b443b62 00007f4a7b443a91 00007f4a7b443a0c 00007f4a7b442cc2 00007f4a7b24348c 00007f4a7b2428c6
0709 13:04:52.413825 (+    83us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:04:52.421313 (+  7488us) raft_consensus.cc:1685] finished
0709 13:04:52.421335 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:52.432968 (+ 11633us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":20527,"raft.queue_time_us":29854,"raft.run_cpu_time_us":123,"raft.run_wall_time_us":3925,"spinlock_wait_cycles":54520192,"thread_start_us":242710,"threads_started":1,"wal-append.queue_time_us":422589}
I20260709 13:04:52.603070 21011 leader_election.cc:290] T ece3db938bc649d4a40a51522ed5259c P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:04:52.658704 20109 raft_consensus.cc:2468] T 96efeaaf1057492490e9a621f37e1a2d P 127766fc592545a4997f7790f50f6076 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 3.
I20260709 13:04:52.663185 19407 raft_consensus.cc:2468] T ece3db938bc649d4a40a51522ed5259c P e5256d91808b47c195bc9b4dbd7f2b87 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 2.
I20260709 13:04:52.659950 20853 raft_consensus.cc:1027] T 309c3ca0ca4b4f3ba129752ea2cb293b P e61c3a8f61bb48f8a963c9480e53c168 [term 3 LEADER]: attempt to promote peer 127766fc592545a4997f7790f50f6076: there is already a config change operation in progress. Unable to promote follower until it completes. Doing nothing.
I20260709 13:04:52.670003 19560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a61655d99124a29b486ba4a5b37faea" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:04:52.670250 20106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ece3db938bc649d4a40a51522ed5259c" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:04:52.670109 19304 catalog_manager.cc:5697] T 62c6c134d3d24a1ab144dd9ee6bc3f64 P e61c3a8f61bb48f8a963c9480e53c168 reported cstate change: term changed from 1 to 2, leader changed from 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2) to e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3). New cstate: current_term: 2 leader_uuid: "e61c3a8f61bb48f8a963c9480e53c168" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:52.672847 19555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ece3db938bc649d4a40a51522ed5259c" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:04:52.673846 19555 raft_consensus.cc:2393] T ece3db938bc649d4a40a51522ed5259c P e61c3a8f61bb48f8a963c9480e53c168 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e5256d91808b47c195bc9b4dbd7f2b87 in current term 3: Already voted for candidate 127766fc592545a4997f7790f50f6076 in this term.
I20260709 13:04:52.674876 20945 raft_consensus.cc:493] T 22196caba61445d3bec98a0aab3c337d P 0473d2b2d01f4459b1e90fd12cc7840e [term 3 FOLLOWER]: Starting pre-election (detected failure of leader e5256d91808b47c195bc9b4dbd7f2b87)
I20260709 13:04:52.675266 21084 raft_consensus.cc:515] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P 0473d2b2d01f4459b1e90fd12cc7840e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:04:52.675658 20945 raft_consensus.cc:515] T 22196caba61445d3bec98a0aab3c337d P 0473d2b2d01f4459b1e90fd12cc7840e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:52.678936 20785 raft_consensus.cc:2804] T 96efeaaf1057492490e9a621f37e1a2d P 127766fc592545a4997f7790f50f6076 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:04:52.679455 20785 raft_consensus.cc:493] T 96efeaaf1057492490e9a621f37e1a2d P 127766fc592545a4997f7790f50f6076 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:52.679840 20785 raft_consensus.cc:3060] T 96efeaaf1057492490e9a621f37e1a2d P 127766fc592545a4997f7790f50f6076 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:04:52.681293 19552 raft_consensus.cc:1275] T 1dc5b3532fe54f74876d02beffa2c230 P e61c3a8f61bb48f8a963c9480e53c168 [term 3 FOLLOWER]: Refusing update from remote peer e5256d91808b47c195bc9b4dbd7f2b87: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:04:52.601927 20864 raft_consensus.cc:515] T 86a6797bdfe94fa496c050ceae4bd0d9 P e61c3a8f61bb48f8a963c9480e53c168 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:52.678416 21084 leader_election.cc:290] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
W20260709 13:04:52.688366 19375 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:52.689050 19558 raft_consensus.cc:2468] T 0e1085d23e8347fbbd5bce7542f4b1f4 P e61c3a8f61bb48f8a963c9480e53c168 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 127766fc592545a4997f7790f50f6076 in term 3.
I20260709 13:04:52.690840 19404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28af091831594f9d8e96482078cc7625" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:04:52.691810 20108 raft_consensus.cc:1240] T 2a16f7501e2444fb86d4e2778e734e02 P 127766fc592545a4997f7790f50f6076 [term 5 LEADER]: Rejecting Update request from peer e5256d91808b47c195bc9b4dbd7f2b87 for earlier term 4. Current term is 5. Ops: []
I20260709 13:04:52.694211 20728 leader_election.cc:290] T f1b10566f45d4a7d9029858330e02d5b P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:04:52.695457 20871 raft_consensus.cc:3060] T 2a16f7501e2444fb86d4e2778e734e02 P e5256d91808b47c195bc9b4dbd7f2b87 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:04:52.696126 19477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df751f992649444090e27965eb1af85d" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:04:52.698786 20864 leader_election.cc:290] T 86a6797bdfe94fa496c050ceae4bd0d9 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:04:52.664331 19403 raft_consensus.cc:3060] T fa8650e71aa14778b3d73721fc50d9fc P e5256d91808b47c195bc9b4dbd7f2b87 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:04:52.699013 20829 raft_consensus.cc:515] T f93ee515a9c14139bf566522ed8232f3 P e5256d91808b47c195bc9b4dbd7f2b87 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:52.666535 20908 raft_consensus.cc:493] T ff9b0eddd810459b82d91c60777c10eb P 0473d2b2d01f4459b1e90fd12cc7840e [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 127766fc592545a4997f7790f50f6076)
I20260709 13:04:52.695465 19407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14935b3ddf914369822e4a0547aaa355" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:04:52.722895 19407 raft_consensus.cc:2468] T 14935b3ddf914369822e4a0547aaa355 P e5256d91808b47c195bc9b4dbd7f2b87 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 1.
I20260709 13:04:52.705047 19555 raft_consensus.cc:1240] T 2a16f7501e2444fb86d4e2778e734e02 P e61c3a8f61bb48f8a963c9480e53c168 [term 5 FOLLOWER]: Rejecting Update request from peer e5256d91808b47c195bc9b4dbd7f2b87 for earlier term 4. Current term is 5. Ops: []
I20260709 13:04:52.715083 19523 leader_election.cc:304] T ece3db938bc649d4a40a51522ed5259c P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:04:52.716015 19404 raft_consensus.cc:2468] T 28af091831594f9d8e96482078cc7625 P e5256d91808b47c195bc9b4dbd7f2b87 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 3.
I20260709 13:04:52.716315 19486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa8650e71aa14778b3d73721fc50d9fc" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:04:52.717464 21084 raft_consensus.cc:493] T 40e1e16737a842ee936002830f36882e P 0473d2b2d01f4459b1e90fd12cc7840e [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:52.685585 20989 raft_consensus.cc:493] T 4af19371ea874c09a0a2147040835cbb P e5256d91808b47c195bc9b4dbd7f2b87 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 127766fc592545a4997f7790f50f6076)
I20260709 13:04:52.727128 19410 raft_consensus.cc:1275] T edd7d470b5014c9489be7f41f64355c9 P e5256d91808b47c195bc9b4dbd7f2b87 [term 3 FOLLOWER]: Refusing update from remote peer 0473d2b2d01f4459b1e90fd12cc7840e: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 2. (term mismatch)
W20260709 13:04:52.727909 19374 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.4:43121, user_credentials={real_user=slave}} blocked reactor thread for 169668us
I20260709 13:04:52.726084 19523 leader_election.cc:304] T 96efeaaf1057492490e9a621f37e1a2d P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 127766fc592545a4997f7790f50f6076, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:04:52.730595 19482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9962423cb4e54fcfa5de01daf68a86e7" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:04:52.731117 19409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1b10566f45d4a7d9029858330e02d5b" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:04:52.731734 19482 raft_consensus.cc:2410] T 9962423cb4e54fcfa5de01daf68a86e7 P 0473d2b2d01f4459b1e90fd12cc7840e [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 127766fc592545a4997f7790f50f6076 for term 4 because replica has last-logged OpId of term: 3 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260709 13:04:52.728183 19410 pending_rounds.cc:85] T edd7d470b5014c9489be7f41f64355c9 P e5256d91808b47c195bc9b4dbd7f2b87: Aborting all ops after (but not including) 1
I20260709 13:04:52.732831 19410 pending_rounds.cc:107] T edd7d470b5014c9489be7f41f64355c9 P e5256d91808b47c195bc9b4dbd7f2b87: Aborting uncommitted NO_OP operation due to leader change: 2.2
I20260709 13:04:52.733093 19410 raft_consensus.cc:2889] T edd7d470b5014c9489be7f41f64355c9 P e5256d91808b47c195bc9b4dbd7f2b87 [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:04:52.736927 21084 raft_consensus.cc:515] T 40e1e16737a842ee936002830f36882e P 0473d2b2d01f4459b1e90fd12cc7840e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:52.737406 20076 leader_election.cc:304] T 0e1085d23e8347fbbd5bce7542f4b1f4 P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 127766fc592545a4997f7790f50f6076, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:04:52.738057 20829 leader_election.cc:290] T f93ee515a9c14139bf566522ed8232f3 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 4 election: Requested vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:04:52.732573 19552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e381f1d6b8184797ad142de49be225a8" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:04:52.738953 21006 raft_consensus.cc:2804] T 0e1085d23e8347fbbd5bce7542f4b1f4 P 127766fc592545a4997f7790f50f6076 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:04:52.739423 21006 raft_consensus.cc:493] T 0e1085d23e8347fbbd5bce7542f4b1f4 P 127766fc592545a4997f7790f50f6076 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:52.739813 21006 raft_consensus.cc:3060] T 0e1085d23e8347fbbd5bce7542f4b1f4 P 127766fc592545a4997f7790f50f6076 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:04:52.741707 21084 leader_election.cc:290] T 40e1e16737a842ee936002830f36882e P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:04:52.743156 19480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96efeaaf1057492490e9a621f37e1a2d" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:04:52.744057 19480 raft_consensus.cc:2468] T 96efeaaf1057492490e9a621f37e1a2d P 0473d2b2d01f4459b1e90fd12cc7840e [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 2.
I20260709 13:04:52.746479 19402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86a6797bdfe94fa496c050ceae4bd0d9" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:04:52.720407 20945 leader_election.cc:290] T 22196caba61445d3bec98a0aab3c337d P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
W20260709 13:04:52.750824 19523 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:52.727543 20864 raft_consensus.cc:2804] T ece3db938bc649d4a40a51522ed5259c P e61c3a8f61bb48f8a963c9480e53c168 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:04:52.752518 19552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f93ee515a9c14139bf566522ed8232f3" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:04:52.712725 20942 consensus_queue.cc:1048] T 1dc5b3532fe54f74876d02beffa2c230 P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.022s
I20260709 13:04:52.722733 19477 raft_consensus.cc:2468] T df751f992649444090e27965eb1af85d P 0473d2b2d01f4459b1e90fd12cc7840e [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 2.
I20260709 13:04:52.752915 18300 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:04:52.754763 19523 leader_election.cc:304] T 14935b3ddf914369822e4a0547aaa355 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:04:52.757875 19558 raft_consensus.cc:1240] T 1efebf73c86e432baa55533136b6e12c P e61c3a8f61bb48f8a963c9480e53c168 [term 4 FOLLOWER]: Rejecting Update request from peer 127766fc592545a4997f7790f50f6076 for earlier term 3. Current term is 4. Ops: []
I20260709 13:04:52.758507 19523 leader_election.cc:304] T 28af091831594f9d8e96482078cc7625 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:04:52.754657 19402 raft_consensus.cc:2468] T 86a6797bdfe94fa496c050ceae4bd0d9 P e5256d91808b47c195bc9b4dbd7f2b87 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 3.
I20260709 13:04:52.751144 20728 raft_consensus.cc:2804] T 96efeaaf1057492490e9a621f37e1a2d P e61c3a8f61bb48f8a963c9480e53c168 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:04:52.654054 19309 rpcz_store.cc:276] 0709 13:04:48.826369 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:48.842158 (+ 15789us) service_pool.cc:224] Handling call
0709 13:04:52.644764 (+3802606us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:04:51.993463 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:04:51.994425 (+   962us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:04:51.994476 (+    51us) write_op.cc:435] Acquired schema lock
0709 13:04:51.994512 (+    36us) tablet.cc:662] Decoding operations
0709 13:04:51.995621 (+  1109us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:04:51.995748 (+   127us) write_op.cc:641] Partition lock acquired for write op
0709 13:04:51.995806 (+    58us) tablet.cc:685] Acquiring locks for 5 operations
0709 13:04:51.996710 (+   904us) tablet.cc:701] Row locks acquired
0709 13:04:51.996768 (+    58us) write_op.cc:260] PREPARE: finished
0709 13:04:51.997018 (+   250us) write_op.cc:270] Start()
0709 13:04:51.997234 (+   216us) write_op.cc:276] Timestamp: P: 1783602291996936 usec, L: 0
0709 13:04:51.997281 (+    47us) op_driver.cc:348] REPLICATION: starting
0709 13:04:51.999050 (+  1769us) log.cc:844] Serialized 2050 byte log entry
0709 13:04:52.293334 (+294284us) op_driver.cc:464] REPLICATION: finished
0709 13:04:52.407133 (+113799us) write_op.cc:301] APPLY: starting
0709 13:04:52.407223 (+    90us) tablet.cc:1367] starting BulkCheckPresence
0709 13:04:52.409068 (+  1845us) tablet.cc:1370] finished BulkCheckPresence
0709 13:04:52.437684 (+ 28616us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:04:52.463132 (+ 25448us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:04:52.463559 (+   427us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=5
0709 13:04:52.463625 (+    66us) write_op.cc:312] APPLY: finished
0709 13:04:52.464053 (+   428us) log.cc:844] Serialized 47 byte log entry
0709 13:04:52.464279 (+   226us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:04:52.464376 (+    97us) write_op.cc:454] Released schema lock
0709 13:04:52.464433 (+    57us) write_op.cc:341] FINISH: Updating metrics
0709 13:04:52.464945 (+   512us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:04:52.464988 (+    43us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":3445,"reported_tablets":12,"child_traces":[["op",{"apply.queue_time_us":108724,"apply.run_cpu_time_us":3839,"apply.run_wall_time_us":57730,"num_ops":5,"prepare.queue_time_us":377691,"prepare.run_cpu_time_us":6916,"prepare.run_wall_time_us":17989,"raft.queue_time_us":269857,"raft.run_cpu_time_us":9709,"raft.run_wall_time_us":73434,"replication_time_us":284636,"spinlock_wait_cycles":1195776,"thread_start_us":667512,"threads_started":4,"wal-append.queue_time_us":4471}]]}
I20260709 13:04:52.732333 20908 raft_consensus.cc:515] T ff9b0eddd810459b82d91c60777c10eb P 0473d2b2d01f4459b1e90fd12cc7840e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:04:52.765038 19523 leader_election.cc:304] T 86a6797bdfe94fa496c050ceae4bd0d9 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:04:52.752995 20864 raft_consensus.cc:493] T ece3db938bc649d4a40a51522ed5259c P e61c3a8f61bb48f8a963c9480e53c168 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:52.768041 19485 raft_consensus.cc:1240] T 775c229504194560ba9589bc2199b089 P 0473d2b2d01f4459b1e90fd12cc7840e [term 3 LEADER]: Rejecting Update request from peer 127766fc592545a4997f7790f50f6076 for earlier term 2. Current term is 3. Ops: []
I20260709 13:04:52.757985 19552 raft_consensus.cc:3060] T f93ee515a9c14139bf566522ed8232f3 P e61c3a8f61bb48f8a963c9480e53c168 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:04:52.759879 19481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28af091831594f9d8e96482078cc7625" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:04:52.753504 20873 raft_consensus.cc:493] T 21e14947d70440f19044d8f75c31e1f9 P e61c3a8f61bb48f8a963c9480e53c168 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e5256d91808b47c195bc9b4dbd7f2b87)
I20260709 13:04:52.747010 20989 raft_consensus.cc:515] T 4af19371ea874c09a0a2147040835cbb P e5256d91808b47c195bc9b4dbd7f2b87 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:04:52.777310 21080 raft_consensus.cc:493] T b9f0d59553ad444883fcf5b5909f9798 P e61c3a8f61bb48f8a963c9480e53c168 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0473d2b2d01f4459b1e90fd12cc7840e)
I20260709 13:04:52.777904 21080 raft_consensus.cc:515] T b9f0d59553ad444883fcf5b5909f9798 P e61c3a8f61bb48f8a963c9480e53c168 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:52.780169 21080 leader_election.cc:290] T b9f0d59553ad444883fcf5b5909f9798 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:04:52.775825 20733 raft_consensus.cc:2804] T 86a6797bdfe94fa496c050ceae4bd0d9 P e61c3a8f61bb48f8a963c9480e53c168 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:04:52.782435 20733 raft_consensus.cc:493] T 86a6797bdfe94fa496c050ceae4bd0d9 P e61c3a8f61bb48f8a963c9480e53c168 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:52.782835 20733 raft_consensus.cc:3060] T 86a6797bdfe94fa496c050ceae4bd0d9 P e61c3a8f61bb48f8a963c9480e53c168 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:04:52.783267 20109 raft_consensus.cc:1275] T 309c3ca0ca4b4f3ba129752ea2cb293b P 127766fc592545a4997f7790f50f6076 [term 3 LEARNER]: Refusing update from remote peer e61c3a8f61bb48f8a963c9480e53c168: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:04:52.762523 20853 raft_consensus.cc:2804] T 14935b3ddf914369822e4a0547aaa355 P e61c3a8f61bb48f8a963c9480e53c168 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:04:52.763824 21010 raft_consensus.cc:2804] T 28af091831594f9d8e96482078cc7625 P e61c3a8f61bb48f8a963c9480e53c168 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:04:52.765952 20728 raft_consensus.cc:493] T 96efeaaf1057492490e9a621f37e1a2d P e61c3a8f61bb48f8a963c9480e53c168 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:52.770861 20864 raft_consensus.cc:3060] T ece3db938bc649d4a40a51522ed5259c P e61c3a8f61bb48f8a963c9480e53c168 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:04:52.805239 19409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab43d85f64114d4ebf618930e43d9ed0" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:04:52.803970 19485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14935b3ddf914369822e4a0547aaa355" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:04:52.793457 20853 raft_consensus.cc:493] T 14935b3ddf914369822e4a0547aaa355 P e61c3a8f61bb48f8a963c9480e53c168 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 0473d2b2d01f4459b1e90fd12cc7840e)
I20260709 13:04:52.799546 21010 raft_consensus.cc:493] T 28af091831594f9d8e96482078cc7625 P e61c3a8f61bb48f8a963c9480e53c168 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:52.814621 19481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14efcc79969f41babe5529c22d59156d" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:04:52.819082 19481 raft_consensus.cc:2410] T 14efcc79969f41babe5529c22d59156d P 0473d2b2d01f4459b1e90fd12cc7840e [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 127766fc592545a4997f7790f50f6076 for term 5 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 13:04:52.818854 19407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9962423cb4e54fcfa5de01daf68a86e7" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
I20260709 13:04:52.819558 19407 raft_consensus.cc:3060] T 9962423cb4e54fcfa5de01daf68a86e7 P e5256d91808b47c195bc9b4dbd7f2b87 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:04:52.819763 19405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9f0d59553ad444883fcf5b5909f9798" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:04:52.820453 19405 raft_consensus.cc:2468] T b9f0d59553ad444883fcf5b5909f9798 P e5256d91808b47c195bc9b4dbd7f2b87 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 1.
I20260709 13:04:52.822799 21051 raft_consensus.cc:493] T 85c494af21f9457a85da47b9bc70c1fd P 127766fc592545a4997f7790f50f6076 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e5256d91808b47c195bc9b4dbd7f2b87)
I20260709 13:04:52.823472 20998 raft_consensus.cc:3055] T 1efebf73c86e432baa55533136b6e12c P 127766fc592545a4997f7790f50f6076 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:04:52.823873 20998 raft_consensus.cc:740] T 1efebf73c86e432baa55533136b6e12c P 127766fc592545a4997f7790f50f6076 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 127766fc592545a4997f7790f50f6076, State: Running, Role: LEADER
I20260709 13:04:52.823666 21051 raft_consensus.cc:515] T 85c494af21f9457a85da47b9bc70c1fd P 127766fc592545a4997f7790f50f6076 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:04:52.809978 20873 raft_consensus.cc:515] T 21e14947d70440f19044d8f75c31e1f9 P e61c3a8f61bb48f8a963c9480e53c168 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:52.825053 20995 raft_consensus.cc:515] T bc225c93219c45538b53a1bd3d387e4d P e5256d91808b47c195bc9b4dbd7f2b87 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:52.825899 21051 leader_election.cc:290] T 85c494af21f9457a85da47b9bc70c1fd P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:04:52.826269 20873 leader_election.cc:290] T 21e14947d70440f19044d8f75c31e1f9 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:04:52.823884 20908 leader_election.cc:290] T ff9b0eddd810459b82d91c60777c10eb P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:04:52.827184 20995 leader_election.cc:290] T bc225c93219c45538b53a1bd3d387e4d P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 4 election: Requested vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:04:52.817907 20853 raft_consensus.cc:3060] T 14935b3ddf914369822e4a0547aaa355 P e61c3a8f61bb48f8a963c9480e53c168 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:52.813064 20911 consensus_queue.cc:1059] T 1efebf73c86e432baa55533136b6e12c P 127766fc592545a4997f7790f50f6076 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.006s
I20260709 13:04:52.828658 21010 raft_consensus.cc:3060] T 28af091831594f9d8e96482078cc7625 P e61c3a8f61bb48f8a963c9480e53c168 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:04:52.833107 20998 consensus_queue.cc:260] T 1efebf73c86e432baa55533136b6e12c P 127766fc592545a4997f7790f50f6076 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:04:52.833295 21006 raft_consensus.cc:515] T 0e1085d23e8347fbbd5bce7542f4b1f4 P 127766fc592545a4997f7790f50f6076 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:04:52.827912 19480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1b10566f45d4a7d9029858330e02d5b" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:04:52.839005 19482 raft_consensus.cc:1275] T 309c3ca0ca4b4f3ba129752ea2cb293b P 0473d2b2d01f4459b1e90fd12cc7840e [term 3 FOLLOWER]: Refusing update from remote peer e61c3a8f61bb48f8a963c9480e53c168: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:04:52.840047 19477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9f0d59553ad444883fcf5b5909f9798" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:04:52.801653 21080 consensus_queue.cc:1048] T 309c3ca0ca4b4f3ba129752ea2cb293b P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Connected to new peer: Peer: permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.017s
I20260709 13:04:52.840781 19526 leader_election.cc:304] T 0e1085d23e8347fbbd5bce7542f4b1f4 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e61c3a8f61bb48f8a963c9480e53c168; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, 127766fc592545a4997f7790f50f6076
I20260709 13:04:52.841240 19485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86a6797bdfe94fa496c050ceae4bd0d9" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:04:52.840821 19481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21e14947d70440f19044d8f75c31e1f9" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:04:52.844219 19551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc225c93219c45538b53a1bd3d387e4d" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:04:52.844616 21025 leader_election.cc:290] T edd7d470b5014c9489be7f41f64355c9 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:04:52.845295 20109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96efeaaf1057492490e9a621f37e1a2d" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:04:52.861135 19480 raft_consensus.cc:2468] T f1b10566f45d4a7d9029858330e02d5b P 0473d2b2d01f4459b1e90fd12cc7840e [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 3.
I20260709 13:04:52.845333 20108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62c6c134d3d24a1ab144dd9ee6bc3f64" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:04:52.861900 21011 raft_consensus.cc:2749] T 0e1085d23e8347fbbd5bce7542f4b1f4 P e61c3a8f61bb48f8a963c9480e53c168 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:04:52.847079 19553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edd7d470b5014c9489be7f41f64355c9" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:04:52.863302 19526 leader_election.cc:304] T 3e1f505cb0f1427bbd698ac889d80821 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168; no voters: e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:04:52.863541 19553 raft_consensus.cc:2410] T edd7d470b5014c9489be7f41f64355c9 P e61c3a8f61bb48f8a963c9480e53c168 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e5256d91808b47c195bc9b4dbd7f2b87 for term 4 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 13:04:52.864168 20873 raft_consensus.cc:2804] T 3e1f505cb0f1427bbd698ac889d80821 P e61c3a8f61bb48f8a963c9480e53c168 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:04:52.847644 19404 raft_consensus.cc:1275] T 76cb037fc9064d13b59a8969d897ce8c P e5256d91808b47c195bc9b4dbd7f2b87 [term 3 FOLLOWER]: Refusing update from remote peer 0473d2b2d01f4459b1e90fd12cc7840e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:04:52.849224 19408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21e14947d70440f19044d8f75c31e1f9" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:04:52.864531 20873 raft_consensus.cc:493] T 3e1f505cb0f1427bbd698ac889d80821 P e61c3a8f61bb48f8a963c9480e53c168 [term 1 FOLLOWER]: Starting leader election (detected failure of leader e5256d91808b47c195bc9b4dbd7f2b87)
I20260709 13:04:52.864941 20873 raft_consensus.cc:3060] T 3e1f505cb0f1427bbd698ac889d80821 P e61c3a8f61bb48f8a963c9480e53c168 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:52.865434 19408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b74109013a140ada21feeef92d6f563" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
I20260709 13:04:52.865460 19404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a16f7501e2444fb86d4e2778e734e02" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: true dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
I20260709 13:04:52.866169 19408 raft_consensus.cc:3055] T 2b74109013a140ada21feeef92d6f563 P e5256d91808b47c195bc9b4dbd7f2b87 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:04:52.866012 20864 raft_consensus.cc:515] T ece3db938bc649d4a40a51522ed5259c P e61c3a8f61bb48f8a963c9480e53c168 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:04:52.851643 19411 raft_consensus.cc:1275] T 309c3ca0ca4b4f3ba129752ea2cb293b P e5256d91808b47c195bc9b4dbd7f2b87 [term 3 FOLLOWER]: Refusing update from remote peer e61c3a8f61bb48f8a963c9480e53c168: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:04:52.853576 19406 raft_consensus.cc:1275] T ff75a1d4cb1f493db8f71ddc136ba9ab P e5256d91808b47c195bc9b4dbd7f2b87 [term 3 FOLLOWER]: Refusing update from remote peer 0473d2b2d01f4459b1e90fd12cc7840e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:04:52.855302 19410 raft_consensus.cc:1240] T f93ee515a9c14139bf566522ed8232f3 P e5256d91808b47c195bc9b4dbd7f2b87 [term 4 FOLLOWER]: Rejecting Update request from peer 0473d2b2d01f4459b1e90fd12cc7840e for earlier term 3. Current term is 4. Ops: []
W20260709 13:04:52.817477 19377 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.2:46257, user_credentials={real_user=slave}} blocked reactor thread for 103909us
I20260709 13:04:52.811775 20885 raft_consensus.cc:515] T fa731b585f684a7fb2d106c50f143b83 P e61c3a8f61bb48f8a963c9480e53c168 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:04:52.856088 20995 raft_consensus.cc:493] T 775c229504194560ba9589bc2199b089 P e5256d91808b47c195bc9b4dbd7f2b87 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:52.860918 19551 raft_consensus.cc:3060] T bc225c93219c45538b53a1bd3d387e4d P e61c3a8f61bb48f8a963c9480e53c168 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:04:52.889669 19411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14efcc79969f41babe5529c22d59156d" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:04:52.889974 20989 leader_election.cc:290] T 4af19371ea874c09a0a2147040835cbb P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:04:52.891062 19411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e5873a19244c5ebbcd38e126796ee7" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:04:52.892367 19411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85c494af21f9457a85da47b9bc70c1fd" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:04:52.845582 19523 leader_election.cc:304] T b9f0d59553ad444883fcf5b5909f9798 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
W20260709 13:04:52.894217 19523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.1:40321, user_credentials={real_user=slave}} blocked reactor thread for 48744.2us
I20260709 13:04:52.866499 19408 raft_consensus.cc:740] T 2b74109013a140ada21feeef92d6f563 P e5256d91808b47c195bc9b4dbd7f2b87 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e5256d91808b47c195bc9b4dbd7f2b87, State: Running, Role: LEADER
I20260709 13:04:52.897590 19559 raft_consensus.cc:1275] T 2a16f7501e2444fb86d4e2778e734e02 P e61c3a8f61bb48f8a963c9480e53c168 [term 5 FOLLOWER]: Refusing update from remote peer 127766fc592545a4997f7790f50f6076: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:04:52.868335 19526 leader_election.cc:304] T 1efebf73c86e432baa55533136b6e12c P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e61c3a8f61bb48f8a963c9480e53c168; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, 127766fc592545a4997f7790f50f6076
I20260709 13:04:52.872392 19481 raft_consensus.cc:2468] T 21e14947d70440f19044d8f75c31e1f9 P 0473d2b2d01f4459b1e90fd12cc7840e [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 2.
I20260709 13:04:52.804265 20728 raft_consensus.cc:3060] T 96efeaaf1057492490e9a621f37e1a2d P e61c3a8f61bb48f8a963c9480e53c168 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:04:52.874084 20908 raft_consensus.cc:493] T 5ec1c4ce15e04c7e8c283a62179f2a64 P 0473d2b2d01f4459b1e90fd12cc7840e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e5256d91808b47c195bc9b4dbd7f2b87)
I20260709 13:04:52.876192 19403 raft_consensus.cc:2468] T fa8650e71aa14778b3d73721fc50d9fc P e5256d91808b47c195bc9b4dbd7f2b87 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 4.
I20260709 13:04:52.877738 20998 raft_consensus.cc:3060] T 1efebf73c86e432baa55533136b6e12c P 127766fc592545a4997f7790f50f6076 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:04:52.880211 19407 raft_consensus.cc:2468] T 9962423cb4e54fcfa5de01daf68a86e7 P e5256d91808b47c195bc9b4dbd7f2b87 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 127766fc592545a4997f7790f50f6076 in term 4.
I20260709 13:04:52.884934 20108 raft_consensus.cc:1275] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P 127766fc592545a4997f7790f50f6076 [term 4 FOLLOWER]: Refusing update from remote peer e5256d91808b47c195bc9b4dbd7f2b87: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:04:52.884795 21010 raft_consensus.cc:515] T 28af091831594f9d8e96482078cc7625 P e61c3a8f61bb48f8a963c9480e53c168 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:52.888934 20107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ece3db938bc649d4a40a51522ed5259c" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:04:52.889097 19406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21e14947d70440f19044d8f75c31e1f9" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:04:52.927798 19485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed7fdbcb96d14d418db9ca90a792588a" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:04:52.893731 19411 raft_consensus.cc:1240] T 46c5bfeecc314717bffe987e6844b6d0 P e5256d91808b47c195bc9b4dbd7f2b87 [term 5 FOLLOWER]: Rejecting Update request from peer 0473d2b2d01f4459b1e90fd12cc7840e for earlier term 4. Current term is 5. Ops: []
I20260709 13:04:52.897253 19496 tablet_copy_service.cc:140] P 0473d2b2d01f4459b1e90fd12cc7840e: Received BeginTabletCopySession request for tablet 14935b3ddf914369822e4a0547aaa355 from peer 127766fc592545a4997f7790f50f6076 ({username='slave'} at 127.0.0.1:39478)
I20260709 13:04:52.921873 19407 raft_consensus.cc:1275] T ef32ce6fdd0e40d382c79974f30295c6 P e5256d91808b47c195bc9b4dbd7f2b87 [term 3 FOLLOWER]: Refusing update from remote peer 0473d2b2d01f4459b1e90fd12cc7840e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:04:52.922435 19409 raft_consensus.cc:1240] T 9962423cb4e54fcfa5de01daf68a86e7 P e5256d91808b47c195bc9b4dbd7f2b87 [term 4 FOLLOWER]: Rejecting Update request from peer 0473d2b2d01f4459b1e90fd12cc7840e for earlier term 3. Current term is 4. Ops: [3.5-3.5]
I20260709 13:04:52.886857 20733 raft_consensus.cc:515] T 86a6797bdfe94fa496c050ceae4bd0d9 P e61c3a8f61bb48f8a963c9480e53c168 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:52.922797 19555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85c494af21f9457a85da47b9bc70c1fd" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:04:52.923825 19556 raft_consensus.cc:1240] T fa731b585f684a7fb2d106c50f143b83 P e61c3a8f61bb48f8a963c9480e53c168 [term 3 FOLLOWER]: Rejecting Update request from peer 127766fc592545a4997f7790f50f6076 for earlier term 2. Current term is 3. Ops: []
I20260709 13:04:52.946175 21079 raft_consensus.cc:2804] T b9f0d59553ad444883fcf5b5909f9798 P e61c3a8f61bb48f8a963c9480e53c168 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:04:52.946835 21079 raft_consensus.cc:493] T b9f0d59553ad444883fcf5b5909f9798 P e61c3a8f61bb48f8a963c9480e53c168 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 0473d2b2d01f4459b1e90fd12cc7840e)
I20260709 13:04:52.947835 19481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e1085d23e8347fbbd5bce7542f4b1f4" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:04:52.946295 19410 raft_consensus.cc:1275] T 7be9efa6559648dbb5a0f7684c4542d1 P e5256d91808b47c195bc9b4dbd7f2b87 [term 3 FOLLOWER]: Refusing update from remote peer 0473d2b2d01f4459b1e90fd12cc7840e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:04:52.919539 19408 consensus_queue.cc:260] T 2b74109013a140ada21feeef92d6f563 P e5256d91808b47c195bc9b4dbd7f2b87 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:52.948582 19481 raft_consensus.cc:2468] T 0e1085d23e8347fbbd5bce7542f4b1f4 P 0473d2b2d01f4459b1e90fd12cc7840e [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 127766fc592545a4997f7790f50f6076 in term 3.
I20260709 13:04:52.947263 21079 raft_consensus.cc:3060] T b9f0d59553ad444883fcf5b5909f9798 P e61c3a8f61bb48f8a963c9480e53c168 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:52.889722 20995 raft_consensus.cc:515] T 775c229504194560ba9589bc2199b089 P e5256d91808b47c195bc9b4dbd7f2b87 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:04:52.918335 21080 consensus_queue.cc:1048] T 309c3ca0ca4b4f3ba129752ea2cb293b P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.033s
I20260709 13:04:53.023782 20873 raft_consensus.cc:515] T 3e1f505cb0f1427bbd698ac889d80821 P e61c3a8f61bb48f8a963c9480e53c168 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:53.025555 20945 raft_consensus.cc:493] T 2b74109013a140ada21feeef92d6f563 P 0473d2b2d01f4459b1e90fd12cc7840e [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:53.026022 20104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c5eebf646ad445a9d1b1adc319d7b16" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:04:53.027022 19403 raft_consensus.cc:1240] T bc225c93219c45538b53a1bd3d387e4d P e5256d91808b47c195bc9b4dbd7f2b87 [term 4 FOLLOWER]: Rejecting Update request from peer 0473d2b2d01f4459b1e90fd12cc7840e for earlier term 3. Current term is 4. Ops: []
I20260709 13:04:53.026638 20908 raft_consensus.cc:515] T 5ec1c4ce15e04c7e8c283a62179f2a64 P 0473d2b2d01f4459b1e90fd12cc7840e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:04:53.028472 19408 raft_consensus.cc:3060] T 2b74109013a140ada21feeef92d6f563 P e5256d91808b47c195bc9b4dbd7f2b87 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:53.029727 21084 raft_consensus.cc:493] T 9962423cb4e54fcfa5de01daf68a86e7 P 0473d2b2d01f4459b1e90fd12cc7840e [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:53.030730 21088 raft_consensus.cc:493] T 7f575b143b844aa096b50997dad3516a P 0473d2b2d01f4459b1e90fd12cc7840e [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e5256d91808b47c195bc9b4dbd7f2b87)
I20260709 13:04:53.030906 20910 consensus_queue.cc:1048] T 2a16f7501e2444fb86d4e2778e734e02 P 127766fc592545a4997f7790f50f6076 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.101s
I20260709 13:04:52.947921 19552 raft_consensus.cc:2468] T f93ee515a9c14139bf566522ed8232f3 P e61c3a8f61bb48f8a963c9480e53c168 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 4.
I20260709 13:04:53.020866 21011 raft_consensus.cc:2749] T 1efebf73c86e432baa55533136b6e12c P e61c3a8f61bb48f8a963c9480e53c168 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:04:53.061023 19407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "179fd671030940b4b4a4e24bcc4aba0a" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:04:53.035420 19554 raft_consensus.cc:1240] T ece3db938bc649d4a40a51522ed5259c P e61c3a8f61bb48f8a963c9480e53c168 [term 4 FOLLOWER]: Rejecting Update request from peer 127766fc592545a4997f7790f50f6076 for earlier term 3. Current term is 4. Ops: []
I20260709 13:04:53.076321 19481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96efeaaf1057492490e9a621f37e1a2d" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:04:53.077425 19411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df751f992649444090e27965eb1af85d" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:04:53.092445 19481 raft_consensus.cc:2468] T 96efeaaf1057492490e9a621f37e1a2d P 0473d2b2d01f4459b1e90fd12cc7840e [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 127766fc592545a4997f7790f50f6076 in term 2.
I20260709 13:04:53.008345 19496 tablet_copy_service.cc:161] P 0473d2b2d01f4459b1e90fd12cc7840e: Beginning new tablet copy session on tablet 14935b3ddf914369822e4a0547aaa355 from peer 127766fc592545a4997f7790f50f6076 at {username='slave'} at 127.0.0.1:39478: session id = 127766fc592545a4997f7790f50f6076-14935b3ddf914369822e4a0547aaa355
I20260709 13:04:53.050591 21061 raft_consensus.cc:493] T e381f1d6b8184797ad142de49be225a8 P e61c3a8f61bb48f8a963c9480e53c168 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 0473d2b2d01f4459b1e90fd12cc7840e)
I20260709 13:04:53.031592 19405 raft_consensus.cc:2955] T 14935b3ddf914369822e4a0547aaa355 P e5256d91808b47c195bc9b4dbd7f2b87 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 127766fc592545a4997f7790f50f6076 (127.17.223.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } attrs { replace: true } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: NON_VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: true } } }
I20260709 13:04:53.004141 20853 raft_consensus.cc:515] T 14935b3ddf914369822e4a0547aaa355 P e61c3a8f61bb48f8a963c9480e53c168 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } attrs { replace: true } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: NON_VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: true } }
I20260709 13:04:53.112445 19407 raft_consensus.cc:1240] T fa8650e71aa14778b3d73721fc50d9fc P e5256d91808b47c195bc9b4dbd7f2b87 [term 4 FOLLOWER]: Rejecting Update request from peer 0473d2b2d01f4459b1e90fd12cc7840e for earlier term 3. Current term is 4. Ops: []
I20260709 13:04:53.112542 19411 raft_consensus.cc:1275] T 28af091831594f9d8e96482078cc7625 P e5256d91808b47c195bc9b4dbd7f2b87 [term 3 FOLLOWER]: Refusing update from remote peer 0473d2b2d01f4459b1e90fd12cc7840e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:04:53.120880 19411 raft_consensus.cc:1275] T 86a6797bdfe94fa496c050ceae4bd0d9 P e5256d91808b47c195bc9b4dbd7f2b87 [term 3 FOLLOWER]: Refusing update from remote peer 0473d2b2d01f4459b1e90fd12cc7840e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
W20260709 13:04:53.121404 19375 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:53.122634 19406 raft_consensus.cc:3060] T ece3db938bc649d4a40a51522ed5259c P e5256d91808b47c195bc9b4dbd7f2b87 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:04:53.125917 20103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48824d5acfbc485ebf8c2d944e7202de" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:04:53.127071 19403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36f6ba92b9ba46babe4ebd6c02e5fbd9" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:04:53.130780 21044 raft_consensus.cc:493] T 309c3ca0ca4b4f3ba129752ea2cb293b P e5256d91808b47c195bc9b4dbd7f2b87 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader e61c3a8f61bb48f8a963c9480e53c168)
I20260709 13:04:53.134238 19407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22196caba61445d3bec98a0aab3c337d" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:04:53.057843 21084 raft_consensus.cc:515] T 9962423cb4e54fcfa5de01daf68a86e7 P 0473d2b2d01f4459b1e90fd12cc7840e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
W20260709 13:04:53.124682 20075 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.1:40321, user_credentials={real_user=slave}} blocked reactor thread for 195354us
I20260709 13:04:53.110383 21011 raft_consensus.cc:493] T ff75a1d4cb1f493db8f71ddc136ba9ab P e61c3a8f61bb48f8a963c9480e53c168 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 0473d2b2d01f4459b1e90fd12cc7840e)
I20260709 13:04:53.126187 20945 raft_consensus.cc:515] T 2b74109013a140ada21feeef92d6f563 P 0473d2b2d01f4459b1e90fd12cc7840e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:53.114717 20785 raft_consensus.cc:515] T 96efeaaf1057492490e9a621f37e1a2d P 127766fc592545a4997f7790f50f6076 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
W20260709 13:04:53.181567 19450 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.3:36891, user_credentials={real_user=slave}} blocked reactor thread for 148266us
I20260709 13:04:53.170397 20108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36f6ba92b9ba46babe4ebd6c02e5fbd9" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:04:53.178190 19407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76cb037fc9064d13b59a8969d897ce8c" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
I20260709 13:04:53.184923 19409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40e1e16737a842ee936002830f36882e" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:04:53.186712 19407 raft_consensus.cc:2376] T 76cb037fc9064d13b59a8969d897ce8c P e5256d91808b47c195bc9b4dbd7f2b87 [term 3 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 3. Re-sending same reply.
I20260709 13:04:53.207170 20109 raft_consensus.cc:2368] T 96efeaaf1057492490e9a621f37e1a2d P 127766fc592545a4997f7790f50f6076 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0473d2b2d01f4459b1e90fd12cc7840e for earlier term 3. Current term is 4.
I20260709 13:04:53.136471 21088 raft_consensus.cc:515] T 7f575b143b844aa096b50997dad3516a P 0473d2b2d01f4459b1e90fd12cc7840e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:53.162523 21061 raft_consensus.cc:515] T e381f1d6b8184797ad142de49be225a8 P e61c3a8f61bb48f8a963c9480e53c168 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:53.180641 21010 leader_election.cc:290] T 28af091831594f9d8e96482078cc7625 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 4 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:04:53.187848 20103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff9b0eddd810459b82d91c60777c10eb" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:04:53.215291 19409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff9b0eddd810459b82d91c60777c10eb" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:04:53.187302 20885 leader_election.cc:290] T fa731b585f684a7fb2d106c50f143b83 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 3 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:04:53.186278 20108 raft_consensus.cc:2468] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P 127766fc592545a4997f7790f50f6076 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 4.
I20260709 13:04:53.203045 21006 leader_election.cc:290] T 0e1085d23e8347fbbd5bce7542f4b1f4 P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 4 election: Requested vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
W20260709 13:04:53.225991 19449 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.4:43121, user_credentials={real_user=slave}} blocked reactor thread for 194508us
I20260709 13:04:53.168267 21044 raft_consensus.cc:515] T 309c3ca0ca4b4f3ba129752ea2cb293b P e5256d91808b47c195bc9b4dbd7f2b87 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } attrs { replace: true } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: NON_VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: true } }
I20260709 13:04:53.188119 21011 raft_consensus.cc:515] T ff75a1d4cb1f493db8f71ddc136ba9ab P e61c3a8f61bb48f8a963c9480e53c168 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:53.220714 20733 leader_election.cc:290] T 86a6797bdfe94fa496c050ceae4bd0d9 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 4 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:04:53.227242 20110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e1085d23e8347fbbd5bce7542f4b1f4" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:04:53.252787 20995 leader_election.cc:290] T 775c229504194560ba9589bc2199b089 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:04:53.257948 19375 leader_election.cc:304] T f93ee515a9c14139bf566522ed8232f3 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:04:53.259990 20989 raft_consensus.cc:2804] T f93ee515a9c14139bf566522ed8232f3 P e5256d91808b47c195bc9b4dbd7f2b87 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:04:53.260087 21088 leader_election.cc:290] T 7f575b143b844aa096b50997dad3516a P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:04:53.260533 20989 raft_consensus.cc:697] T f93ee515a9c14139bf566522ed8232f3 P e5256d91808b47c195bc9b4dbd7f2b87 [term 4 LEADER]: Becoming Leader. State: Replica: e5256d91808b47c195bc9b4dbd7f2b87, State: Running, Role: LEADER
I20260709 13:04:53.260695 21088 consensus_queue.cc:1048] T f93ee515a9c14139bf566522ed8232f3 P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:04:53.261505 20989 consensus_queue.cc:237] T f93ee515a9c14139bf566522ed8232f3 P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:53.262223 21088 raft_consensus.cc:493] T 2725d2c4cb054f18b0fc8f735c15f6c2 P 0473d2b2d01f4459b1e90fd12cc7840e [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:53.263003 20853 leader_election.cc:290] T 14935b3ddf914369822e4a0547aaa355 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 2 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
W20260709 13:04:53.267366 21100 log.cc:927] Time spent T 62c6c134d3d24a1ab144dd9ee6bc3f64 P 0473d2b2d01f4459b1e90fd12cc7840e: Append to log took a long time: real 0.063s	user 0.000s	sys 0.000s
I20260709 13:04:53.268024 21061 leader_election.cc:290] T e381f1d6b8184797ad142de49be225a8 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:04:53.269292 21084 leader_election.cc:290] T 9962423cb4e54fcfa5de01daf68a86e7 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:04:53.269582 20785 leader_election.cc:290] T 96efeaaf1057492490e9a621f37e1a2d P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 4 election: Requested vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:04:53.270265 19409 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2b74109013a140ada21feeef92d6f563"
dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
mode: GRACEFUL
new_leader_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
 from {username='slave'} at 127.0.0.1:37312
I20260709 13:04:53.271924 20945 leader_election.cc:290] T 2b74109013a140ada21feeef92d6f563 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:04:53.274933 20110 raft_consensus.cc:2393] T 0e1085d23e8347fbbd5bce7542f4b1f4 P 127766fc592545a4997f7790f50f6076 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0473d2b2d01f4459b1e90fd12cc7840e in current term 4: Already voted for candidate 127766fc592545a4997f7790f50f6076 in this term.
I20260709 13:04:53.291075 19408 raft_consensus.cc:2468] T 2b74109013a140ada21feeef92d6f563 P e5256d91808b47c195bc9b4dbd7f2b87 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 2.
I20260709 13:04:53.291966 19409 raft_consensus.cc:606] T 2b74109013a140ada21feeef92d6f563 P e5256d91808b47c195bc9b4dbd7f2b87 [term 2 FOLLOWER]: Received request to transfer leadership to TS 0473d2b2d01f4459b1e90fd12cc7840e
I20260709 13:04:53.292429 19409 raft_consensus.cc:614] T 2b74109013a140ada21feeef92d6f563 P e5256d91808b47c195bc9b4dbd7f2b87 [term 2 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:04:53.245167 20873 leader_election.cc:290] T 3e1f505cb0f1427bbd698ac889d80821 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 2 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:04:53.295238 19406 raft_consensus.cc:1275] T ece3db938bc649d4a40a51522ed5259c P e5256d91808b47c195bc9b4dbd7f2b87 [term 3 FOLLOWER]: Refusing update from remote peer 127766fc592545a4997f7790f50f6076: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:04:53.314953 21088 raft_consensus.cc:515] T 2725d2c4cb054f18b0fc8f735c15f6c2 P 0473d2b2d01f4459b1e90fd12cc7840e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
W20260709 13:04:53.318856 20078 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.2:46257, user_credentials={real_user=slave}} blocked reactor thread for 88089.1us
I20260709 13:04:53.324546 20873 raft_consensus.cc:493] T 22196caba61445d3bec98a0aab3c337d P e61c3a8f61bb48f8a963c9480e53c168 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader e5256d91808b47c195bc9b4dbd7f2b87)
I20260709 13:04:53.325317 20873 raft_consensus.cc:515] T 22196caba61445d3bec98a0aab3c337d P e61c3a8f61bb48f8a963c9480e53c168 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:53.328055 20873 leader_election.cc:290] T 22196caba61445d3bec98a0aab3c337d P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:04:53.328734 20873 raft_consensus.cc:493] T ef32ce6fdd0e40d382c79974f30295c6 P e61c3a8f61bb48f8a963c9480e53c168 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:53.311580 20908 leader_election.cc:290] T 5ec1c4ce15e04c7e8c283a62179f2a64 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:04:53.336655 19408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa731b585f684a7fb2d106c50f143b83" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
I20260709 13:04:53.329320 20873 raft_consensus.cc:515] T ef32ce6fdd0e40d382c79974f30295c6 P e61c3a8f61bb48f8a963c9480e53c168 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:53.342846 19408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86a6797bdfe94fa496c050ceae4bd0d9" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
I20260709 13:04:53.343600 19408 raft_consensus.cc:3060] T 86a6797bdfe94fa496c050ceae4bd0d9 P e5256d91808b47c195bc9b4dbd7f2b87 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:04:53.348685 19406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ece3db938bc649d4a40a51522ed5259c" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
I20260709 13:04:53.349440 19406 raft_consensus.cc:3060] T ece3db938bc649d4a40a51522ed5259c P e5256d91808b47c195bc9b4dbd7f2b87 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:04:53.353609 19407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e1f505cb0f1427bbd698ac889d80821" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
I20260709 13:04:53.354017 19523 leader_election.cc:304] T fa8650e71aa14778b3d73721fc50d9fc P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:04:53.332186 21025 raft_consensus.cc:493] T 76cb037fc9064d13b59a8969d897ce8c P e5256d91808b47c195bc9b4dbd7f2b87 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:53.377085 21025 raft_consensus.cc:515] T 76cb037fc9064d13b59a8969d897ce8c P e5256d91808b47c195bc9b4dbd7f2b87 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:53.379215 21025 leader_election.cc:290] T 76cb037fc9064d13b59a8969d897ce8c P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:04:53.380980 19374 leader_election.cc:304] T ece3db938bc649d4a40a51522ed5259c P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87; no voters: 127766fc592545a4997f7790f50f6076, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:04:53.381793 20819 consensus_queue.cc:1048] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Connected to new peer: Peer: permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:04:53.355279 21105 consensus_queue.cc:1048] T edd7d470b5014c9489be7f41f64355c9 P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.021s
I20260709 13:04:53.382447 20110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ece3db938bc649d4a40a51522ed5259c" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076"
I20260709 13:04:53.362757 20075 leader_election.cc:304] T 9962423cb4e54fcfa5de01daf68a86e7 P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 127766fc592545a4997f7790f50f6076, e5256d91808b47c195bc9b4dbd7f2b87; no voters: 
I20260709 13:04:53.383517 21044 leader_election.cc:290] T 309c3ca0ca4b4f3ba129752ea2cb293b P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
W20260709 13:04:53.384020 20075 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.1:40321, user_credentials={real_user=slave}} blocked reactor thread for 60997.4us
I20260709 13:04:53.385941 20998 raft_consensus.cc:2804] T 9962423cb4e54fcfa5de01daf68a86e7 P 127766fc592545a4997f7790f50f6076 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:04:53.387168 21110 consensus_queue.cc:1048] T ece3db938bc649d4a40a51522ed5259c P 127766fc592545a4997f7790f50f6076 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:04:53.348126 20733 raft_consensus.cc:493] T 7be9efa6559648dbb5a0f7684c4542d1 P e61c3a8f61bb48f8a963c9480e53c168 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:04:53.367836 21107 log.cc:927] Time spent T 14efcc79969f41babe5529c22d59156d P 127766fc592545a4997f7790f50f6076: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
I20260709 13:04:53.357200 19449 leader_election.cc:304] T ab43d85f64114d4ebf618930e43d9ed0 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e; no voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:04:53.368376 19556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e1085d23e8347fbbd5bce7542f4b1f4" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
W20260709 13:04:53.390108 19450 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.3:36891, user_credentials={real_user=slave}} blocked reactor thread for 183009us
I20260709 13:04:53.390419 19556 raft_consensus.cc:3060] T 0e1085d23e8347fbbd5bce7542f4b1f4 P e61c3a8f61bb48f8a963c9480e53c168 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:04:53.357736 21080 raft_consensus.cc:493] T 76cb037fc9064d13b59a8969d897ce8c P e61c3a8f61bb48f8a963c9480e53c168 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 0473d2b2d01f4459b1e90fd12cc7840e)
W20260709 13:04:53.369300 21096 log.cc:927] Time spent T 1dc5b3532fe54f74876d02beffa2c230 P e61c3a8f61bb48f8a963c9480e53c168: Append to log took a long time: real 0.095s	user 0.000s	sys 0.001s
I20260709 13:04:53.358153 19405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28af091831594f9d8e96482078cc7625" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
W20260709 13:04:53.369915 20076 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:53.357600 21061 raft_consensus.cc:493] T ab43d85f64114d4ebf618930e43d9ed0 P e61c3a8f61bb48f8a963c9480e53c168 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:53.370389 19559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96efeaaf1057492490e9a621f37e1a2d" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:04:53.357975 20853 raft_consensus.cc:2804] T fa8650e71aa14778b3d73721fc50d9fc P e61c3a8f61bb48f8a963c9480e53c168 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:04:53.372027 21088 leader_election.cc:290] T 2725d2c4cb054f18b0fc8f735c15f6c2 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:04:53.374639 19404 raft_consensus.cc:2468] T 2a16f7501e2444fb86d4e2778e734e02 P e5256d91808b47c195bc9b4dbd7f2b87 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 127766fc592545a4997f7790f50f6076 in term 5.
I20260709 13:04:53.376332 19410 raft_consensus.cc:1240] T 775c229504194560ba9589bc2199b089 P e5256d91808b47c195bc9b4dbd7f2b87 [term 3 FOLLOWER]: Rejecting Update request from peer 127766fc592545a4997f7790f50f6076 for earlier term 2. Current term is 3. Ops: []
I20260709 13:04:53.376056 19551 raft_consensus.cc:2468] T bc225c93219c45538b53a1bd3d387e4d P e61c3a8f61bb48f8a963c9480e53c168 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 4.
I20260709 13:04:53.376551 21011 leader_election.cc:290] T ff75a1d4cb1f493db8f71ddc136ba9ab P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:04:53.386447 20998 raft_consensus.cc:697] T 9962423cb4e54fcfa5de01daf68a86e7 P 127766fc592545a4997f7790f50f6076 [term 4 LEADER]: Becoming Leader. State: Replica: 127766fc592545a4997f7790f50f6076, State: Running, Role: LEADER
I20260709 13:04:53.391978 19411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e381f1d6b8184797ad142de49be225a8" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:04:53.393272 19405 raft_consensus.cc:3060] T 28af091831594f9d8e96482078cc7625 P e5256d91808b47c195bc9b4dbd7f2b87 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:04:53.376171 20873 leader_election.cc:290] T ef32ce6fdd0e40d382c79974f30295c6 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:04:53.397485 19406 raft_consensus.cc:2468] T ece3db938bc649d4a40a51522ed5259c P e5256d91808b47c195bc9b4dbd7f2b87 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 4.
I20260709 13:04:53.413942 20109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa731b585f684a7fb2d106c50f143b83" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076"
I20260709 13:04:53.431128 19410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff75a1d4cb1f493db8f71ddc136ba9ab" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:04:53.434599 19410 raft_consensus.cc:2468] T ff75a1d4cb1f493db8f71ddc136ba9ab P e5256d91808b47c195bc9b4dbd7f2b87 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 3.
I20260709 13:04:53.433615 20110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4af19371ea874c09a0a2147040835cbb" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:04:53.429150 19403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14935b3ddf914369822e4a0547aaa355" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
I20260709 13:04:53.456363 19411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef32ce6fdd0e40d382c79974f30295c6" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:04:53.457378 19411 raft_consensus.cc:2468] T ef32ce6fdd0e40d382c79974f30295c6 P e5256d91808b47c195bc9b4dbd7f2b87 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 3.
I20260709 13:04:53.417032 20819 raft_consensus.cc:2749] T ece3db938bc649d4a40a51522ed5259c P e5256d91808b47c195bc9b4dbd7f2b87 [term 4 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:04:53.462980 19408 raft_consensus.cc:2468] T 86a6797bdfe94fa496c050ceae4bd0d9 P e5256d91808b47c195bc9b4dbd7f2b87 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 4.
I20260709 13:04:53.392957 20733 raft_consensus.cc:515] T 7be9efa6559648dbb5a0f7684c4542d1 P e61c3a8f61bb48f8a963c9480e53c168 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:53.465384 19406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22196caba61445d3bec98a0aab3c337d" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:04:53.431046 21105 raft_consensus.cc:2749] T ab43d85f64114d4ebf618930e43d9ed0 P 0473d2b2d01f4459b1e90fd12cc7840e [term 3 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:04:53.429505 20853 raft_consensus.cc:697] T fa8650e71aa14778b3d73721fc50d9fc P e61c3a8f61bb48f8a963c9480e53c168 [term 4 LEADER]: Becoming Leader. State: Replica: e61c3a8f61bb48f8a963c9480e53c168, State: Running, Role: LEADER
W20260709 13:04:53.472194 19449 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.1:40321, user_credentials={real_user=slave}} blocked reactor thread for 134775us
I20260709 13:04:53.410912 21080 raft_consensus.cc:515] T 76cb037fc9064d13b59a8969d897ce8c P e61c3a8f61bb48f8a963c9480e53c168 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:53.411748 21061 raft_consensus.cc:515] T ab43d85f64114d4ebf618930e43d9ed0 P e61c3a8f61bb48f8a963c9480e53c168 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } attrs { replace: true } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: NON_VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: true } }
W20260709 13:04:53.484301 19450 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.3:36891, user_credentials={real_user=slave}} blocked reactor thread for 70365.2us
I20260709 13:04:53.486523 19523 leader_election.cc:304] T ece3db938bc649d4a40a51522ed5259c P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:04:53.491611 19375 leader_election.cc:304] T bc225c93219c45538b53a1bd3d387e4d P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:04:53.490273 19523 leader_election.cc:304] T ff75a1d4cb1f493db8f71ddc136ba9ab P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:04:53.495949 20109 raft_consensus.cc:3060] T ab43d85f64114d4ebf618930e43d9ed0 P 127766fc592545a4997f7790f50f6076 [term 1 LEARNER]: Advancing to term 3
I20260709 13:04:53.496194 19523 leader_election.cc:304] T ef32ce6fdd0e40d382c79974f30295c6 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:04:53.511860 19553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4af19371ea874c09a0a2147040835cbb" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:04:53.512876 21061 leader_election.cc:290] T ab43d85f64114d4ebf618930e43d9ed0 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:04:53.513513 21111 raft_consensus.cc:2804] T ef32ce6fdd0e40d382c79974f30295c6 P e61c3a8f61bb48f8a963c9480e53c168 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:04:53.513947 21111 raft_consensus.cc:493] T ef32ce6fdd0e40d382c79974f30295c6 P e61c3a8f61bb48f8a963c9480e53c168 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:53.514302 21111 raft_consensus.cc:3060] T ef32ce6fdd0e40d382c79974f30295c6 P e61c3a8f61bb48f8a963c9480e53c168 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:04:53.515724 20853 consensus_queue.cc:237] T fa8650e71aa14778b3d73721fc50d9fc P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:53.519088 20733 leader_election.cc:290] T 7be9efa6559648dbb5a0f7684c4542d1 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:04:53.521934 21079 raft_consensus.cc:515] T b9f0d59553ad444883fcf5b5909f9798 P e61c3a8f61bb48f8a963c9480e53c168 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:53.525383 21079 leader_election.cc:290] T b9f0d59553ad444883fcf5b5909f9798 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 2 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:04:53.525638 21080 leader_election.cc:290] T 76cb037fc9064d13b59a8969d897ce8c P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:04:53.495227 20942 raft_consensus.cc:2804] T bc225c93219c45538b53a1bd3d387e4d P e5256d91808b47c195bc9b4dbd7f2b87 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:04:53.537186 19523 leader_election.cc:304] T 86a6797bdfe94fa496c050ceae4bd0d9 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:04:53.528601 19405 raft_consensus.cc:2468] T 28af091831594f9d8e96482078cc7625 P e5256d91808b47c195bc9b4dbd7f2b87 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 4.
I20260709 13:04:53.543812 20908 consensus_queue.cc:1048] T 7be9efa6559648dbb5a0f7684c4542d1 P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:04:53.544160 20106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "775c229504194560ba9589bc2199b089" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:04:53.544639 21104 consensus_queue.cc:1059] T f93ee515a9c14139bf566522ed8232f3 P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:04:53.545104 21105 consensus_queue.cc:1048] T ff75a1d4cb1f493db8f71ddc136ba9ab P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:04:53.550585 21080 raft_consensus.cc:2804] T 86a6797bdfe94fa496c050ceae4bd0d9 P e61c3a8f61bb48f8a963c9480e53c168 [term 4 FOLLOWER]: Leader election won for term 4
W20260709 13:04:53.550165 19523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.1:40321, user_credentials={real_user=slave}} blocked reactor thread for 48762us
I20260709 13:04:53.497781 21115 raft_consensus.cc:2804] T ff75a1d4cb1f493db8f71ddc136ba9ab P e61c3a8f61bb48f8a963c9480e53c168 [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 13:04:53.536716 20728 consensus_meta.cc:287] T 96efeaaf1057492490e9a621f37e1a2d P e61c3a8f61bb48f8a963c9480e53c168: Time spent flushing consensus metadata: real 0.601s	user 0.010s	sys 0.000s
I20260709 13:04:53.491952 21088 consensus_queue.cc:1048] T 46c5bfeecc314717bffe987e6844b6d0 P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.055s
I20260709 13:04:53.489650 21011 raft_consensus.cc:2804] T ece3db938bc649d4a40a51522ed5259c P e61c3a8f61bb48f8a963c9480e53c168 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:04:53.556118 19560 raft_consensus.cc:1275] T 0cdf56e38bbc453d9438d359e5a69955 P e61c3a8f61bb48f8a963c9480e53c168 [term 4 FOLLOWER]: Refusing update from remote peer e5256d91808b47c195bc9b4dbd7f2b87: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:04:53.565069 19523 leader_election.cc:304] T 28af091831594f9d8e96482078cc7625 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:04:53.490317 20998 consensus_queue.cc:237] T 9962423cb4e54fcfa5de01daf68a86e7 P 127766fc592545a4997f7790f50f6076 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:04:53.576223 19408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9f0d59553ad444883fcf5b5909f9798" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
I20260709 13:04:53.576153 19411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76cb037fc9064d13b59a8969d897ce8c" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:04:53.577059 19411 raft_consensus.cc:2468] T 76cb037fc9064d13b59a8969d897ce8c P e5256d91808b47c195bc9b4dbd7f2b87 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 3.
I20260709 13:04:53.565405 21080 raft_consensus.cc:697] T 86a6797bdfe94fa496c050ceae4bd0d9 P e61c3a8f61bb48f8a963c9480e53c168 [term 4 LEADER]: Becoming Leader. State: Replica: e61c3a8f61bb48f8a963c9480e53c168, State: Running, Role: LEADER
I20260709 13:04:53.556818 20942 raft_consensus.cc:697] T bc225c93219c45538b53a1bd3d387e4d P e5256d91808b47c195bc9b4dbd7f2b87 [term 4 LEADER]: Becoming Leader. State: Replica: e5256d91808b47c195bc9b4dbd7f2b87, State: Running, Role: LEADER
I20260709 13:04:53.583410 19406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7be9efa6559648dbb5a0f7684c4542d1" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
W20260709 13:04:53.581161 19449 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.1:40321, user_credentials={real_user=slave}} blocked reactor thread for 57853.2us
I20260709 13:04:53.579312 19523 leader_election.cc:304] T fa731b585f684a7fb2d106c50f143b83 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e61c3a8f61bb48f8a963c9480e53c168; no voters: 127766fc592545a4997f7790f50f6076, e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:04:53.548516 20911 consensus_queue.cc:1059] T fa731b585f684a7fb2d106c50f143b83 P 127766fc592545a4997f7790f50f6076 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.023s
I20260709 13:04:53.586113 19523 leader_election.cc:304] T 76cb037fc9064d13b59a8969d897ce8c P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:04:53.586375 19405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab43d85f64114d4ebf618930e43d9ed0" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 4 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
W20260709 13:04:53.584936 19450 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.3:36891, user_credentials={real_user=slave}} blocked reactor thread for 58160.6us
I20260709 13:04:53.562561 21115 raft_consensus.cc:493] T ff75a1d4cb1f493db8f71ddc136ba9ab P e61c3a8f61bb48f8a963c9480e53c168 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 0473d2b2d01f4459b1e90fd12cc7840e)
I20260709 13:04:53.576941 20945 consensus_queue.cc:1048] T ef32ce6fdd0e40d382c79974f30295c6 P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.016s
I20260709 13:04:53.570724 19496 tablet_copy_source_session.cc:215] T 14935b3ddf914369822e4a0547aaa355 P 0473d2b2d01f4459b1e90fd12cc7840e: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:04:53.568961 21025 raft_consensus.cc:493] T 7be9efa6559648dbb5a0f7684c4542d1 P e5256d91808b47c195bc9b4dbd7f2b87 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:53.599831 19558 raft_consensus.cc:1240] T 3e1f505cb0f1427bbd698ac889d80821 P e61c3a8f61bb48f8a963c9480e53c168 [term 2 FOLLOWER]: Rejecting Update request from peer e5256d91808b47c195bc9b4dbd7f2b87 for earlier term 1. Current term is 2. Ops: []
I20260709 13:04:53.603268 19560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "309c3ca0ca4b4f3ba129752ea2cb293b" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:04:53.583920 20853 raft_consensus.cc:2804] T 28af091831594f9d8e96482078cc7625 P e61c3a8f61bb48f8a963c9480e53c168 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:04:53.580826 21011 raft_consensus.cc:697] T ece3db938bc649d4a40a51522ed5259c P e61c3a8f61bb48f8a963c9480e53c168 [term 4 LEADER]: Becoming Leader. State: Replica: e61c3a8f61bb48f8a963c9480e53c168, State: Running, Role: LEADER
I20260709 13:04:53.602802 21115 raft_consensus.cc:3060] T ff75a1d4cb1f493db8f71ddc136ba9ab P e61c3a8f61bb48f8a963c9480e53c168 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:04:53.593084 20733 raft_consensus.cc:2749] T fa731b585f684a7fb2d106c50f143b83 P e61c3a8f61bb48f8a963c9480e53c168 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:04:53.572156 20728 raft_consensus.cc:515] T 96efeaaf1057492490e9a621f37e1a2d P e61c3a8f61bb48f8a963c9480e53c168 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:04:53.588502 20908 raft_consensus.cc:493] T 0afb57ae58a24a01850491d69f0213dd P 0473d2b2d01f4459b1e90fd12cc7840e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e61c3a8f61bb48f8a963c9480e53c168)
I20260709 13:04:53.603204 21061 raft_consensus.cc:2804] T 76cb037fc9064d13b59a8969d897ce8c P e61c3a8f61bb48f8a963c9480e53c168 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:04:53.611858 20853 raft_consensus.cc:697] T 28af091831594f9d8e96482078cc7625 P e61c3a8f61bb48f8a963c9480e53c168 [term 4 LEADER]: Becoming Leader. State: Replica: e61c3a8f61bb48f8a963c9480e53c168, State: Running, Role: LEADER
W20260709 13:04:53.615341 21118 log.cc:927] Time spent T 62c6c134d3d24a1ab144dd9ee6bc3f64 P 127766fc592545a4997f7790f50f6076: Append to log took a long time: real 0.060s	user 0.000s	sys 0.000s
I20260709 13:04:53.619354 19375 leader_election.cc:304] T 4af19371ea874c09a0a2147040835cbb P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87; no voters: 127766fc592545a4997f7790f50f6076, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:04:53.572665 20076 leader_election.cc:304] T 85c494af21f9457a85da47b9bc70c1fd P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 127766fc592545a4997f7790f50f6076; no voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:04:53.625839 20109 raft_consensus.cc:1275] T ab43d85f64114d4ebf618930e43d9ed0 P 127766fc592545a4997f7790f50f6076 [term 3 LEARNER]: Refusing update from remote peer e5256d91808b47c195bc9b4dbd7f2b87: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:04:53.626642 19556 raft_consensus.cc:2468] T 0e1085d23e8347fbbd5bce7542f4b1f4 P e61c3a8f61bb48f8a963c9480e53c168 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 127766fc592545a4997f7790f50f6076 in term 4.
I20260709 13:04:53.610769 21104 raft_consensus.cc:3055] T f93ee515a9c14139bf566522ed8232f3 P 0473d2b2d01f4459b1e90fd12cc7840e [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:04:53.633056 19559 raft_consensus.cc:2393] T 96efeaaf1057492490e9a621f37e1a2d P e61c3a8f61bb48f8a963c9480e53c168 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 127766fc592545a4997f7790f50f6076 in current term 4: Already voted for candidate e61c3a8f61bb48f8a963c9480e53c168 in this term.
I20260709 13:04:53.635223 21104 raft_consensus.cc:740] T f93ee515a9c14139bf566522ed8232f3 P 0473d2b2d01f4459b1e90fd12cc7840e [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 0473d2b2d01f4459b1e90fd12cc7840e, State: Running, Role: LEADER
I20260709 13:04:53.635766 21080 consensus_queue.cc:237] T 86a6797bdfe94fa496c050ceae4bd0d9 P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:53.636508 20864 leader_election.cc:290] T ece3db938bc649d4a40a51522ed5259c P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 4 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:04:53.636555 21108 consensus_queue.cc:1059] T 46c5bfeecc314717bffe987e6844b6d0 P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.027s
W20260709 13:04:53.640421 19449 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.1:40321, user_credentials={real_user=slave}} blocked reactor thread for 53292.8us
I20260709 13:04:53.636296 21104 consensus_queue.cc:260] T f93ee515a9c14139bf566522ed8232f3 P 0473d2b2d01f4459b1e90fd12cc7840e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:53.647107 20853 consensus_queue.cc:237] T 28af091831594f9d8e96482078cc7625 P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:53.647413 21101 raft_consensus.cc:2749] T 85c494af21f9457a85da47b9bc70c1fd P 127766fc592545a4997f7790f50f6076 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:04:53.628852 21061 raft_consensus.cc:493] T 76cb037fc9064d13b59a8969d897ce8c P e61c3a8f61bb48f8a963c9480e53c168 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 0473d2b2d01f4459b1e90fd12cc7840e)
W20260709 13:04:53.667634 21129 log.cc:927] Time spent T 1dc5b3532fe54f74876d02beffa2c230 P e5256d91808b47c195bc9b4dbd7f2b87: Append to log took a long time: real 0.060s	user 0.000s	sys 0.000s
I20260709 13:04:53.638247 21044 raft_consensus.cc:2749] T 4af19371ea874c09a0a2147040835cbb P e5256d91808b47c195bc9b4dbd7f2b87 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:04:53.610700 21025 raft_consensus.cc:515] T 7be9efa6559648dbb5a0f7684c4542d1 P e5256d91808b47c195bc9b4dbd7f2b87 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:53.668424 20996 consensus_queue.cc:1048] T 0cdf56e38bbc453d9438d359e5a69955 P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.007s
I20260709 13:04:53.627908 20908 raft_consensus.cc:515] T 0afb57ae58a24a01850491d69f0213dd P 0473d2b2d01f4459b1e90fd12cc7840e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:04:53.662781 20942 consensus_queue.cc:237] T bc225c93219c45538b53a1bd3d387e4d P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:53.684217 20776 consensus_queue.cc:1059] T 3e1f505cb0f1427bbd698ac889d80821 P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.009s
I20260709 13:04:53.685537 19409 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3e1f505cb0f1427bbd698ac889d80821"
dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
mode: GRACEFUL
new_leader_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
 from {username='slave'} at 127.0.0.1:37312
I20260709 13:04:53.686134 19409 raft_consensus.cc:606] T 3e1f505cb0f1427bbd698ac889d80821 P e5256d91808b47c195bc9b4dbd7f2b87 [term 1 LEADER]: Received request to transfer leadership to TS e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:04:53.686769 21011 consensus_queue.cc:237] T ece3db938bc649d4a40a51522ed5259c P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:04:53.687238 21112 consensus_queue.cc:1048] T 76cb037fc9064d13b59a8969d897ce8c P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.048s
I20260709 13:04:53.688311 20776 raft_consensus.cc:3055] T 3e1f505cb0f1427bbd698ac889d80821 P e5256d91808b47c195bc9b4dbd7f2b87 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:04:53.689013 20864 raft_consensus.cc:493] T edd7d470b5014c9489be7f41f64355c9 P e61c3a8f61bb48f8a963c9480e53c168 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 0473d2b2d01f4459b1e90fd12cc7840e)
I20260709 13:04:53.673288 21061 raft_consensus.cc:3060] T 76cb037fc9064d13b59a8969d897ce8c P e61c3a8f61bb48f8a963c9480e53c168 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:04:53.708212 19406 raft_consensus.cc:2468] T 7be9efa6559648dbb5a0f7684c4542d1 P e5256d91808b47c195bc9b4dbd7f2b87 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 3.
W20260709 13:04:53.674013 20076 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.3:36891, user_credentials={real_user=slave}} blocked reactor thread for 116108us
I20260709 13:04:53.689687 20864 raft_consensus.cc:515] T edd7d470b5014c9489be7f41f64355c9 P e61c3a8f61bb48f8a963c9480e53c168 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:53.688774 20776 raft_consensus.cc:740] T 3e1f505cb0f1427bbd698ac889d80821 P e5256d91808b47c195bc9b4dbd7f2b87 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e5256d91808b47c195bc9b4dbd7f2b87, State: Running, Role: LEADER
I20260709 13:04:53.725178 21104 raft_consensus.cc:3060] T f93ee515a9c14139bf566522ed8232f3 P 0473d2b2d01f4459b1e90fd12cc7840e [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:04:53.727101 19449 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.1:40321, user_credentials={real_user=slave}} blocked reactor thread for 64396.3us
I20260709 13:04:53.731317 20776 consensus_queue.cc:260] T 3e1f505cb0f1427bbd698ac889d80821 P e5256d91808b47c195bc9b4dbd7f2b87 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:53.732815 21125 raft_consensus.cc:3055] T 46c5bfeecc314717bffe987e6844b6d0 P 0473d2b2d01f4459b1e90fd12cc7840e [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:04:53.733250 21125 raft_consensus.cc:740] T 46c5bfeecc314717bffe987e6844b6d0 P 0473d2b2d01f4459b1e90fd12cc7840e [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 0473d2b2d01f4459b1e90fd12cc7840e, State: Running, Role: LEADER
I20260709 13:04:53.734167 21125 consensus_queue.cc:260] T 46c5bfeecc314717bffe987e6844b6d0 P 0473d2b2d01f4459b1e90fd12cc7840e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 4.2, Last appended by leader: 2, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:53.733268 20776 raft_consensus.cc:3060] T 3e1f505cb0f1427bbd698ac889d80821 P e5256d91808b47c195bc9b4dbd7f2b87 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:53.739102 21132 consensus_queue.cc:1048] T 28af091831594f9d8e96482078cc7625 P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:04:53.739727 21105 consensus_queue.cc:1059] T bc225c93219c45538b53a1bd3d387e4d P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:04:53.740653 21132 raft_consensus.cc:3055] T bc225c93219c45538b53a1bd3d387e4d P 0473d2b2d01f4459b1e90fd12cc7840e [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:04:53.741032 21132 raft_consensus.cc:740] T bc225c93219c45538b53a1bd3d387e4d P 0473d2b2d01f4459b1e90fd12cc7840e [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 0473d2b2d01f4459b1e90fd12cc7840e, State: Running, Role: LEADER
I20260709 13:04:53.740532 21105 consensus_queue.cc:1048] T 86a6797bdfe94fa496c050ceae4bd0d9 P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:04:53.751979 19409 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5ec1c4ce15e04c7e8c283a62179f2a64"
dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
mode: GRACEFUL
new_leader_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
 from {username='slave'} at 127.0.0.1:37312
I20260709 13:04:53.752707 19409 raft_consensus.cc:606] T 5ec1c4ce15e04c7e8c283a62179f2a64 P e5256d91808b47c195bc9b4dbd7f2b87 [term 1 LEADER]: Received request to transfer leadership to TS 0473d2b2d01f4459b1e90fd12cc7840e
I20260709 13:04:53.742118 21132 consensus_queue.cc:260] T bc225c93219c45538b53a1bd3d387e4d P 0473d2b2d01f4459b1e90fd12cc7840e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:53.753723 21132 raft_consensus.cc:3060] T bc225c93219c45538b53a1bd3d387e4d P 0473d2b2d01f4459b1e90fd12cc7840e [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:04:53.760850 20998 consensus_queue.cc:1059] T ece3db938bc649d4a40a51522ed5259c P 127766fc592545a4997f7790f50f6076 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:04:53.761909 20998 raft_consensus.cc:3055] T ece3db938bc649d4a40a51522ed5259c P 127766fc592545a4997f7790f50f6076 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:04:53.762305 20998 raft_consensus.cc:740] T ece3db938bc649d4a40a51522ed5259c P 127766fc592545a4997f7790f50f6076 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 127766fc592545a4997f7790f50f6076, State: Running, Role: LEADER
I20260709 13:04:53.763213 20998 consensus_queue.cc:260] T ece3db938bc649d4a40a51522ed5259c P 127766fc592545a4997f7790f50f6076 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:04:53.763783 19304 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:44698 (request call id 228) took 3356 ms. Trace:
I20260709 13:04:53.764503 20998 raft_consensus.cc:3060] T ece3db938bc649d4a40a51522ed5259c P 127766fc592545a4997f7790f50f6076 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:04:53.766799 21124 log.cc:927] Time spent T fa8650e71aa14778b3d73721fc50d9fc P e61c3a8f61bb48f8a963c9480e53c168: Append to log took a long time: real 0.096s	user 0.003s	sys 0.003s
I20260709 13:04:53.764189 19304 rpcz_store.cc:276] 0709 13:04:50.407535 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:50.407687 (+   152us) service_pool.cc:224] Handling call
0709 13:04:53.763721 (+3356034us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:04:52.886422 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:04:52.891263 (+  4841us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:04:52.891296 (+    33us) write_op.cc:435] Acquired schema lock
0709 13:04:52.891316 (+    20us) tablet.cc:662] Decoding operations
0709 13:04:52.891839 (+   523us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:04:52.891912 (+    73us) write_op.cc:641] Partition lock acquired for write op
0709 13:04:52.891949 (+    37us) tablet.cc:685] Acquiring locks for 3 operations
0709 13:04:52.892251 (+   302us) tablet.cc:701] Row locks acquired
0709 13:04:52.892268 (+    17us) write_op.cc:260] PREPARE: finished
0709 13:04:52.892544 (+   276us) write_op.cc:270] Start()
0709 13:04:52.892657 (+   113us) write_op.cc:276] Timestamp: P: 1783602292892494 usec, L: 0
0709 13:04:52.892678 (+    21us) op_driver.cc:348] REPLICATION: starting
0709 13:04:52.893334 (+   656us) log.cc:844] Serialized 1360 byte log entry
0709 13:04:53.207791 (+314457us) op_driver.cc:464] REPLICATION: finished
0709 13:04:53.466483 (+258692us) write_op.cc:301] APPLY: starting
0709 13:04:53.474946 (+  8463us) tablet.cc:1367] starting BulkCheckPresence
0709 13:04:53.486341 (+ 11395us) tablet.cc:1370] finished BulkCheckPresence
0709 13:04:53.492344 (+  6003us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:04:53.526126 (+ 33782us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:04:53.526286 (+   160us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=3
0709 13:04:53.526328 (+    42us) write_op.cc:312] APPLY: finished
0709 13:04:53.526530 (+   202us) log.cc:844] Serialized 35 byte log entry
0709 13:04:53.526709 (+   179us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:04:53.526798 (+    89us) write_op.cc:454] Released schema lock
0709 13:04:53.526844 (+    46us) write_op.cc:341] FINISH: Updating metrics
0709 13:04:53.555240 (+ 28396us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:04:53.561316 (+  6076us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":138125,"reported_tablets":7,"child_traces":[["op",{"apply.queue_time_us":220516,"apply.run_cpu_time_us":2286,"apply.run_wall_time_us":75830,"num_ops":3,"prepare.queue_time_us":135959,"prepare.run_cpu_time_us":3165,"prepare.run_wall_time_us":7200,"replication_time_us":294998,"thread_start_us":151680,"threads_started":2}]]}
W20260709 13:04:53.776100 19375 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.3:36891, user_credentials={real_user=slave}} blocked reactor thread for 100520us
W20260709 13:04:53.785647 19450 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.3:36891, user_credentials={real_user=slave}} blocked reactor thread for 197348us
W20260709 13:04:53.796685 19449 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.1:40321, user_credentials={real_user=slave}} blocked reactor thread for 67151.2us
I20260709 13:04:53.805085 21025 leader_election.cc:290] T 7be9efa6559648dbb5a0f7684c4542d1 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:04:53.807793 19555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76cb037fc9064d13b59a8969d897ce8c" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:04:53.809209 19553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7be9efa6559648dbb5a0f7684c4542d1" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:04:53.809350 20728 leader_election.cc:290] T 96efeaaf1057492490e9a621f37e1a2d P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 4 election: Requested vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:04:53.809885 19553 raft_consensus.cc:2468] T 7be9efa6559648dbb5a0f7684c4542d1 P e61c3a8f61bb48f8a963c9480e53c168 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 3.
W20260709 13:04:53.811102 19375 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:53.811492 20908 leader_election.cc:290] T 0afb57ae58a24a01850491d69f0213dd P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:04:53.813889 20109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96efeaaf1057492490e9a621f37e1a2d" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076"
I20260709 13:04:53.814750 20109 raft_consensus.cc:2393] T 96efeaaf1057492490e9a621f37e1a2d P 127766fc592545a4997f7790f50f6076 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate e61c3a8f61bb48f8a963c9480e53c168 in current term 4: Already voted for candidate 127766fc592545a4997f7790f50f6076 in this term.
W20260709 13:04:53.815264 20075 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:53.815608 21127 consensus_queue.cc:1048] T 28af091831594f9d8e96482078cc7625 P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:04:53.818145 20864 leader_election.cc:290] T edd7d470b5014c9489be7f41f64355c9 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:04:53.818778 19449 leader_election.cc:304] T 2b74109013a140ada21feeef92d6f563 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87; no voters: e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:04:53.820153 19557 raft_consensus.cc:1275] T ab43d85f64114d4ebf618930e43d9ed0 P e61c3a8f61bb48f8a963c9480e53c168 [term 3 FOLLOWER]: Refusing update from remote peer e5256d91808b47c195bc9b4dbd7f2b87: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:04:53.821524 20076 leader_election.cc:304] T 0e1085d23e8347fbbd5bce7542f4b1f4 P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 127766fc592545a4997f7790f50f6076, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:04:53.823110 19402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f575b143b844aa096b50997dad3516a" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:04:53.824371 21112 raft_consensus.cc:2804] T 2b74109013a140ada21feeef92d6f563 P 0473d2b2d01f4459b1e90fd12cc7840e [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:04:53.824553 20911 raft_consensus.cc:2804] T 0e1085d23e8347fbbd5bce7542f4b1f4 P 127766fc592545a4997f7790f50f6076 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:04:53.824982 21112 raft_consensus.cc:697] T 2b74109013a140ada21feeef92d6f563 P 0473d2b2d01f4459b1e90fd12cc7840e [term 2 LEADER]: Becoming Leader. State: Replica: 0473d2b2d01f4459b1e90fd12cc7840e, State: Running, Role: LEADER
I20260709 13:04:53.825687 19402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9962423cb4e54fcfa5de01daf68a86e7" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:04:53.829666 19408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2725d2c4cb054f18b0fc8f735c15f6c2" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:04:53.832443 19408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edd7d470b5014c9489be7f41f64355c9" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:04:53.829614 19523 leader_election.cc:304] T 7be9efa6559648dbb5a0f7684c4542d1 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:04:53.836637 19409 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "76cb037fc9064d13b59a8969d897ce8c"
dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
mode: GRACEFUL
new_leader_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
 from {username='slave'} at 127.0.0.1:37312
I20260709 13:04:53.837373 19409 raft_consensus.cc:606] T 76cb037fc9064d13b59a8969d897ce8c P e5256d91808b47c195bc9b4dbd7f2b87 [term 3 FOLLOWER]: Received request to transfer leadership to TS 0473d2b2d01f4459b1e90fd12cc7840e
I20260709 13:04:53.837700 19409 raft_consensus.cc:614] T 76cb037fc9064d13b59a8969d897ce8c P e5256d91808b47c195bc9b4dbd7f2b87 [term 3 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:04:53.840880 19410 raft_consensus.cc:1240] T 28af091831594f9d8e96482078cc7625 P e5256d91808b47c195bc9b4dbd7f2b87 [term 4 FOLLOWER]: Rejecting Update request from peer 0473d2b2d01f4459b1e90fd12cc7840e for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260709 13:04:53.842206 20109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9962423cb4e54fcfa5de01daf68a86e7" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:04:53.847868 19406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ec1c4ce15e04c7e8c283a62179f2a64" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:04:53.847783 19450 leader_election.cc:304] T d1e5873a19244c5ebbcd38e126796ee7 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e; no voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:04:53.851361 19405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b74109013a140ada21feeef92d6f563" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:04:53.852312 19405 raft_consensus.cc:2468] T 2b74109013a140ada21feeef92d6f563 P e5256d91808b47c195bc9b4dbd7f2b87 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 2.
I20260709 13:04:53.800740 21104 consensus_queue.cc:1059] T fa8650e71aa14778b3d73721fc50d9fc P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.040s
I20260709 13:04:53.826481 19402 raft_consensus.cc:2468] T 9962423cb4e54fcfa5de01daf68a86e7 P e5256d91808b47c195bc9b4dbd7f2b87 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 4.
W20260709 13:04:53.876780 19449 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:04:53.879891 19449 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:53.826653 21112 consensus_queue.cc:237] T 2b74109013a140ada21feeef92d6f563 P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:53.885465 19402 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f93ee515a9c14139bf566522ed8232f3"
dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
mode: GRACEFUL
new_leader_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
 from {username='slave'} at 127.0.0.1:37312
I20260709 13:04:53.885790 21104 raft_consensus.cc:3055] T fa8650e71aa14778b3d73721fc50d9fc P 0473d2b2d01f4459b1e90fd12cc7840e [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:04:53.886121 19402 raft_consensus.cc:606] T f93ee515a9c14139bf566522ed8232f3 P e5256d91808b47c195bc9b4dbd7f2b87 [term 4 LEADER]: Received request to transfer leadership to TS 0473d2b2d01f4459b1e90fd12cc7840e
I20260709 13:04:53.886271 21104 raft_consensus.cc:740] T fa8650e71aa14778b3d73721fc50d9fc P 0473d2b2d01f4459b1e90fd12cc7840e [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 0473d2b2d01f4459b1e90fd12cc7840e, State: Running, Role: LEADER
I20260709 13:04:53.888343 21104 consensus_queue.cc:260] T fa8650e71aa14778b3d73721fc50d9fc P 0473d2b2d01f4459b1e90fd12cc7840e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:53.839092 20864 raft_consensus.cc:2804] T 7be9efa6559648dbb5a0f7684c4542d1 P e61c3a8f61bb48f8a963c9480e53c168 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:04:53.890894 20864 raft_consensus.cc:493] T 7be9efa6559648dbb5a0f7684c4542d1 P e61c3a8f61bb48f8a963c9480e53c168 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:04:53.891263 19450 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.3:36891, user_credentials={real_user=slave}} blocked reactor thread for 43564.7us
I20260709 13:04:53.839066 20853 raft_consensus.cc:493] T ed7fdbcb96d14d418db9ca90a792588a P e61c3a8f61bb48f8a963c9480e53c168 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 0473d2b2d01f4459b1e90fd12cc7840e)
I20260709 13:04:53.892336 21140 raft_consensus.cc:2749] T d1e5873a19244c5ebbcd38e126796ee7 P 0473d2b2d01f4459b1e90fd12cc7840e [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:04:53.892220 20853 raft_consensus.cc:515] T ed7fdbcb96d14d418db9ca90a792588a P e61c3a8f61bb48f8a963c9480e53c168 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
W20260709 13:04:53.895151 21134 log.cc:927] Time spent T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P 127766fc592545a4997f7790f50f6076: Append to log took a long time: real 0.115s	user 0.000s	sys 0.001s
I20260709 13:04:53.847364 21084 consensus_queue.cc:1048] T 86a6797bdfe94fa496c050ceae4bd0d9 P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.050s
I20260709 13:04:53.891402 20864 raft_consensus.cc:3060] T 7be9efa6559648dbb5a0f7684c4542d1 P e61c3a8f61bb48f8a963c9480e53c168 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:04:53.927671 20075 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.1:40321, user_credentials={real_user=slave}} blocked reactor thread for 51357.3us
I20260709 13:04:53.928225 21110 consensus_queue.cc:1059] T 775c229504194560ba9589bc2199b089 P 127766fc592545a4997f7790f50f6076 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:04:53.881909 20945 raft_consensus.cc:493] T 14efcc79969f41babe5529c22d59156d P 0473d2b2d01f4459b1e90fd12cc7840e [term 4 FOLLOWER]: Starting pre-election (detected failure of leader e5256d91808b47c195bc9b4dbd7f2b87)
I20260709 13:04:53.929454 21110 raft_consensus.cc:3055] T 775c229504194560ba9589bc2199b089 P 127766fc592545a4997f7790f50f6076 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:04:53.929951 21110 raft_consensus.cc:740] T 775c229504194560ba9589bc2199b089 P 127766fc592545a4997f7790f50f6076 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 127766fc592545a4997f7790f50f6076, State: Running, Role: LEADER
I20260709 13:04:53.929621 20945 raft_consensus.cc:515] T 14efcc79969f41babe5529c22d59156d P 0473d2b2d01f4459b1e90fd12cc7840e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:04:53.897190 21061 raft_consensus.cc:515] T 76cb037fc9064d13b59a8969d897ce8c P e61c3a8f61bb48f8a963c9480e53c168 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:53.965649 21140 raft_consensus.cc:493] T 1f85fc4b527a48848e5faa083b604e36 P 0473d2b2d01f4459b1e90fd12cc7840e [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e5256d91808b47c195bc9b4dbd7f2b87)
I20260709 13:04:53.966511 21131 raft_consensus.cc:493] T 217b5fae677b4971b3bbd2f357a1f7ff P 0473d2b2d01f4459b1e90fd12cc7840e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e5256d91808b47c195bc9b4dbd7f2b87)
I20260709 13:04:53.966334 21140 raft_consensus.cc:515] T 1f85fc4b527a48848e5faa083b604e36 P 0473d2b2d01f4459b1e90fd12cc7840e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:04:53.966845 20908 raft_consensus.cc:493] T 0cdf56e38bbc453d9438d359e5a69955 P 0473d2b2d01f4459b1e90fd12cc7840e [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e61c3a8f61bb48f8a963c9480e53c168)
I20260709 13:04:53.967190 21131 raft_consensus.cc:515] T 217b5fae677b4971b3bbd2f357a1f7ff P 0473d2b2d01f4459b1e90fd12cc7840e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:53.967497 20908 raft_consensus.cc:515] T 0cdf56e38bbc453d9438d359e5a69955 P 0473d2b2d01f4459b1e90fd12cc7840e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:53.969322 19449 leader_election.cc:304] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, 127766fc592545a4997f7790f50f6076; no voters: e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:04:53.969530 21131 leader_election.cc:290] T 217b5fae677b4971b3bbd2f357a1f7ff P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:04:53.970134 21131 raft_consensus.cc:2804] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P 0473d2b2d01f4459b1e90fd12cc7840e [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 13:04:53.965726 19451 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:53.970487 21131 raft_consensus.cc:493] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P 0473d2b2d01f4459b1e90fd12cc7840e [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:53.970570 19449 leader_election.cc:304] T ff9b0eddd810459b82d91c60777c10eb P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e; no voters: 127766fc592545a4997f7790f50f6076, e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:04:53.970880 21131 raft_consensus.cc:3060] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P 0473d2b2d01f4459b1e90fd12cc7840e [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:04:53.971743 19555 raft_consensus.cc:2393] T 76cb037fc9064d13b59a8969d897ce8c P e61c3a8f61bb48f8a963c9480e53c168 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e5256d91808b47c195bc9b4dbd7f2b87 in current term 4: Already voted for candidate e61c3a8f61bb48f8a963c9480e53c168 in this term.
I20260709 13:04:53.972349 19449 leader_election.cc:400] T 96efeaaf1057492490e9a621f37e1a2d P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 3 pre-election: Vote denied by peer 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121) with higher term. Message: Invalid argument: T 96efeaaf1057492490e9a621f37e1a2d P 127766fc592545a4997f7790f50f6076 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0473d2b2d01f4459b1e90fd12cc7840e for earlier term 3. Current term is 4.
I20260709 13:04:53.972673 19449 leader_election.cc:403] T 96efeaaf1057492490e9a621f37e1a2d P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 3 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:04:53.972759 21127 raft_consensus.cc:2749] T ff9b0eddd810459b82d91c60777c10eb P 0473d2b2d01f4459b1e90fd12cc7840e [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:04:53.973500 21127 raft_consensus.cc:3060] T 96efeaaf1057492490e9a621f37e1a2d P 0473d2b2d01f4459b1e90fd12cc7840e [term 2 FOLLOWER]: Advancing to term 4
I20260709 13:04:53.974182 20908 leader_election.cc:290] T 0cdf56e38bbc453d9438d359e5a69955 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:04:53.976056 21140 leader_election.cc:290] T 1f85fc4b527a48848e5faa083b604e36 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:04:53.984898 20945 leader_election.cc:290] T 14efcc79969f41babe5529c22d59156d P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:04:53.904747 21111 raft_consensus.cc:515] T ef32ce6fdd0e40d382c79974f30295c6 P e61c3a8f61bb48f8a963c9480e53c168 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:53.987174 21111 leader_election.cc:290] T ef32ce6fdd0e40d382c79974f30295c6 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 4 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:04:53.993763 19410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f85fc4b527a48848e5faa083b604e36" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:04:53.974814 21104 raft_consensus.cc:3060] T fa8650e71aa14778b3d73721fc50d9fc P 0473d2b2d01f4459b1e90fd12cc7840e [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:04:54.000257 20106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ec1c4ce15e04c7e8c283a62179f2a64" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:04:53.996536 18300 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:04:54.008553 19410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "217b5fae677b4971b3bbd2f357a1f7ff" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:04:54.004174 20109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0afb57ae58a24a01850491d69f0213dd" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:04:54.010161 19450 leader_election.cc:304] T 21e14947d70440f19044d8f75c31e1f9 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e; no voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:04:54.009440 18300 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:04:54.003039 20945 raft_consensus.cc:493] T 309c3ca0ca4b4f3ba129752ea2cb293b P 0473d2b2d01f4459b1e90fd12cc7840e [term 3 FOLLOWER]: Starting pre-election (detected failure of leader e61c3a8f61bb48f8a963c9480e53c168)
I20260709 13:04:54.011039 21140 consensus_queue.cc:1059] T 28af091831594f9d8e96482078cc7625 P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:04:54.013511 19449 leader_election.cc:304] T 2b74109013a140ada21feeef92d6f563 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87; no voters: 
I20260709 13:04:54.021126 19559 raft_consensus.cc:1240] T fa731b585f684a7fb2d106c50f143b83 P e61c3a8f61bb48f8a963c9480e53c168 [term 3 FOLLOWER]: Rejecting Update request from peer 127766fc592545a4997f7790f50f6076 for earlier term 2. Current term is 3. Ops: []
I20260709 13:04:54.021879 19449 leader_election.cc:304] T 9962423cb4e54fcfa5de01daf68a86e7 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87; no voters: 
I20260709 13:04:54.011436 20945 raft_consensus.cc:515] T 309c3ca0ca4b4f3ba129752ea2cb293b P 0473d2b2d01f4459b1e90fd12cc7840e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } attrs { replace: true } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: NON_VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: true } }
I20260709 13:04:54.024202 21106 raft_consensus.cc:3055] T fa731b585f684a7fb2d106c50f143b83 P 127766fc592545a4997f7790f50f6076 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:04:54.024977 20945 leader_election.cc:290] T 309c3ca0ca4b4f3ba129752ea2cb293b P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:04:54.002900 20911 raft_consensus.cc:697] T 0e1085d23e8347fbbd5bce7542f4b1f4 P 127766fc592545a4997f7790f50f6076 [term 4 LEADER]: Becoming Leader. State: Replica: 127766fc592545a4997f7790f50f6076, State: Running, Role: LEADER
I20260709 13:04:54.024642 21106 raft_consensus.cc:740] T fa731b585f684a7fb2d106c50f143b83 P 127766fc592545a4997f7790f50f6076 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 127766fc592545a4997f7790f50f6076, State: Running, Role: LEADER
I20260709 13:04:54.027082 19402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef32ce6fdd0e40d382c79974f30295c6" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
W20260709 13:04:54.033720 20076 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:54.031066 20853 leader_election.cc:290] T ed7fdbcb96d14d418db9ca90a792588a P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:04:54.046680 21140 raft_consensus.cc:2804] T 9962423cb4e54fcfa5de01daf68a86e7 P 0473d2b2d01f4459b1e90fd12cc7840e [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:04:54.052178 21140 raft_consensus.cc:493] T 9962423cb4e54fcfa5de01daf68a86e7 P 0473d2b2d01f4459b1e90fd12cc7840e [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:54.052529 21140 raft_consensus.cc:3060] T 9962423cb4e54fcfa5de01daf68a86e7 P 0473d2b2d01f4459b1e90fd12cc7840e [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:04:54.046725 20945 raft_consensus.cc:3055] T 28af091831594f9d8e96482078cc7625 P 0473d2b2d01f4459b1e90fd12cc7840e [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:04:54.054971 20945 raft_consensus.cc:740] T 28af091831594f9d8e96482078cc7625 P 0473d2b2d01f4459b1e90fd12cc7840e [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 0473d2b2d01f4459b1e90fd12cc7840e, State: Running, Role: LEADER
W20260709 13:04:54.055915 21143 log.cc:927] Time spent T ece3db938bc649d4a40a51522ed5259c P e61c3a8f61bb48f8a963c9480e53c168: Append to log took a long time: real 0.055s	user 0.001s	sys 0.001s
I20260709 13:04:54.055863 20945 consensus_queue.cc:260] T 28af091831594f9d8e96482078cc7625 P 0473d2b2d01f4459b1e90fd12cc7840e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:54.057116 20945 raft_consensus.cc:3060] T 28af091831594f9d8e96482078cc7625 P 0473d2b2d01f4459b1e90fd12cc7840e [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:04:54.071909 19449 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.1:40321, user_credentials={real_user=slave}} blocked reactor thread for 50095.9us
I20260709 13:04:54.028716 21115 raft_consensus.cc:515] T ff75a1d4cb1f493db8f71ddc136ba9ab P e61c3a8f61bb48f8a963c9480e53c168 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:54.078217 19411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cdf56e38bbc453d9438d359e5a69955" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
W20260709 13:04:54.082508 19526 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.148s	user 0.011s	sys 0.003s
W20260709 13:04:54.082841 19526 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.148s	user 0.011s	sys 0.003s
I20260709 13:04:54.084836 20110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed7fdbcb96d14d418db9ca90a792588a" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
W20260709 13:04:54.086527 19526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.2:46257, user_credentials={real_user=slave}} blocked reactor thread for 1.21817e+06us
I20260709 13:04:54.087284 19411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "309c3ca0ca4b4f3ba129752ea2cb293b" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:04:54.087546 19526 leader_election.cc:304] T 179fd671030940b4b4a4e24bcc4aba0a P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e61c3a8f61bb48f8a963c9480e53c168; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:04:54.071138 21108 raft_consensus.cc:2749] T 21e14947d70440f19044d8f75c31e1f9 P 0473d2b2d01f4459b1e90fd12cc7840e [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:04:54.088863 19526 leader_election.cc:304] T 217b5fae677b4971b3bbd2f357a1f7ff P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e61c3a8f61bb48f8a963c9480e53c168; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:04:54.090821 20106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f85fc4b527a48848e5faa083b604e36" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:04:54.028501 21110 consensus_queue.cc:260] T 775c229504194560ba9589bc2199b089 P 127766fc592545a4997f7790f50f6076 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:04:54.071235 21138 raft_consensus.cc:493] T 4509b76741dc428e9201c70c1658da13 P 0473d2b2d01f4459b1e90fd12cc7840e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e5256d91808b47c195bc9b4dbd7f2b87)
I20260709 13:04:54.117846 19407 raft_consensus.cc:1275] T 2a16f7501e2444fb86d4e2778e734e02 P e5256d91808b47c195bc9b4dbd7f2b87 [term 5 FOLLOWER]: Refusing update from remote peer 127766fc592545a4997f7790f50f6076: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:04:54.092478 19526 leader_election.cc:304] T b08304a0a02b42d7840c4e8ee9a6bd1a P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168; no voters: e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:04:54.126796 21080 raft_consensus.cc:2804] T b08304a0a02b42d7840c4e8ee9a6bd1a P e61c3a8f61bb48f8a963c9480e53c168 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:04:54.097621 21111 raft_consensus.cc:2749] T 217b5fae677b4971b3bbd2f357a1f7ff P e61c3a8f61bb48f8a963c9480e53c168 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:04:54.127233 21080 raft_consensus.cc:493] T b08304a0a02b42d7840c4e8ee9a6bd1a P e61c3a8f61bb48f8a963c9480e53c168 [term 2 FOLLOWER]: Starting leader election (detected failure of leader e5256d91808b47c195bc9b4dbd7f2b87)
I20260709 13:04:54.080283 21127 raft_consensus.cc:2749] T 96efeaaf1057492490e9a621f37e1a2d P 0473d2b2d01f4459b1e90fd12cc7840e [term 4 FOLLOWER]: Leader pre-election lost for term 3. Reason: Vote denied by peer 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121) with higher term. Message: Invalid argument: T 96efeaaf1057492490e9a621f37e1a2d P 127766fc592545a4997f7790f50f6076 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0473d2b2d01f4459b1e90fd12cc7840e for earlier term 3. Current term is 4.
I20260709 13:04:54.127702 21080 raft_consensus.cc:3060] T b08304a0a02b42d7840c4e8ee9a6bd1a P e61c3a8f61bb48f8a963c9480e53c168 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:04:54.097939 19410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14efcc79969f41babe5529c22d59156d" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:04:54.126351 21138 raft_consensus.cc:515] T 4509b76741dc428e9201c70c1658da13 P 0473d2b2d01f4459b1e90fd12cc7840e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
W20260709 13:04:54.104321 19374 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:54.131538 19526 leader_election.cc:304] T df751f992649444090e27965eb1af85d P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168; no voters: e5256d91808b47c195bc9b4dbd7f2b87
W20260709 13:04:54.185281 19526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.2:46257, user_credentials={real_user=slave}} blocked reactor thread for 53835.7us
I20260709 13:04:54.187894 19526 leader_election.cc:304] T f1b10566f45d4a7d9029858330e02d5b P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168; no voters: e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:04:54.091895 20853 raft_consensus.cc:2749] T 179fd671030940b4b4a4e24bcc4aba0a P e61c3a8f61bb48f8a963c9480e53c168 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:04:54.127733 19375 leader_election.cc:304] T 7be9efa6559648dbb5a0f7684c4542d1 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:04:54.112488 21125 raft_consensus.cc:3060] T 46c5bfeecc314717bffe987e6844b6d0 P 0473d2b2d01f4459b1e90fd12cc7840e [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:04:54.193114 19449 leader_election.cc:304] T 5ec1c4ce15e04c7e8c283a62179f2a64 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e; no voters: 127766fc592545a4997f7790f50f6076, e5256d91808b47c195bc9b4dbd7f2b87
W20260709 13:04:54.099367 21146 log.cc:927] Time spent T e381f1d6b8184797ad142de49be225a8 P 0473d2b2d01f4459b1e90fd12cc7840e: Append to log took a long time: real 0.069s	user 0.000s	sys 0.000s
I20260709 13:04:54.097610 20104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14efcc79969f41babe5529c22d59156d" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:04:54.108548 20998 raft_consensus.cc:493] T 65d8cb8d6ec64f459d5a47cefab10acf P 127766fc592545a4997f7790f50f6076 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e61c3a8f61bb48f8a963c9480e53c168)
I20260709 13:04:54.208623 19526 leader_election.cc:304] T 21e14947d70440f19044d8f75c31e1f9 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168; no voters: e5256d91808b47c195bc9b4dbd7f2b87
W20260709 13:04:54.232344 19375 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.3:36891, user_credentials={real_user=slave}} blocked reactor thread for 104682us
W20260709 13:04:54.117444 19404 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49050 (request call id 93) took 1261 ms (client timeout 1593 ms). Trace:
I20260709 13:04:54.209211 19449 leader_election.cc:304] T 1f85fc4b527a48848e5faa083b604e36 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e; no voters: 127766fc592545a4997f7790f50f6076, e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:04:54.235489 20867 raft_consensus.cc:2804] T 7be9efa6559648dbb5a0f7684c4542d1 P e5256d91808b47c195bc9b4dbd7f2b87 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:04:54.236088 21155 raft_consensus.cc:2749] T 1f85fc4b527a48848e5faa083b604e36 P 0473d2b2d01f4459b1e90fd12cc7840e [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:04:54.236697 20728 raft_consensus.cc:2804] T 21e14947d70440f19044d8f75c31e1f9 P e61c3a8f61bb48f8a963c9480e53c168 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:04:54.237160 20728 raft_consensus.cc:493] T 21e14947d70440f19044d8f75c31e1f9 P e61c3a8f61bb48f8a963c9480e53c168 [term 2 FOLLOWER]: Starting leader election (detected failure of leader e5256d91808b47c195bc9b4dbd7f2b87)
I20260709 13:04:54.237639 20728 raft_consensus.cc:3060] T 21e14947d70440f19044d8f75c31e1f9 P e61c3a8f61bb48f8a963c9480e53c168 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:04:54.236014 20867 raft_consensus.cc:493] T 7be9efa6559648dbb5a0f7684c4542d1 P e5256d91808b47c195bc9b4dbd7f2b87 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 0473d2b2d01f4459b1e90fd12cc7840e)
W20260709 13:04:54.202576 20076 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:54.123226 21115 leader_election.cc:290] T ff75a1d4cb1f493db8f71ddc136ba9ab P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 4 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:04:54.191913 20785 raft_consensus.cc:493] T 833a2f0775ed407a94b8924ce50adb63 P 127766fc592545a4997f7790f50f6076 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader e5256d91808b47c195bc9b4dbd7f2b87)
I20260709 13:04:54.121714 20864 raft_consensus.cc:515] T 7be9efa6559648dbb5a0f7684c4542d1 P e61c3a8f61bb48f8a963c9480e53c168 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:54.252350 21148 raft_consensus.cc:493] T 1efebf73c86e432baa55533136b6e12c P 127766fc592545a4997f7790f50f6076 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:54.202721 21079 consensus_queue.cc:1048] T 309c3ca0ca4b4f3ba129752ea2cb293b P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.047s
I20260709 13:04:54.252876 21148 raft_consensus.cc:515] T 1efebf73c86e432baa55533136b6e12c P 127766fc592545a4997f7790f50f6076 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:04:54.253546 20864 leader_election.cc:290] T 7be9efa6559648dbb5a0f7684c4542d1 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 4 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:04:54.234095 21127 raft_consensus.cc:2749] T 5ec1c4ce15e04c7e8c283a62179f2a64 P 0473d2b2d01f4459b1e90fd12cc7840e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:04:54.242173 20867 raft_consensus.cc:3060] T 7be9efa6559648dbb5a0f7684c4542d1 P e5256d91808b47c195bc9b4dbd7f2b87 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:04:54.231707 20873 raft_consensus.cc:2804] T f1b10566f45d4a7d9029858330e02d5b P e61c3a8f61bb48f8a963c9480e53c168 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:04:54.192662 21111 raft_consensus.cc:2804] T df751f992649444090e27965eb1af85d P e61c3a8f61bb48f8a963c9480e53c168 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:04:54.233912 21110 raft_consensus.cc:3060] T 775c229504194560ba9589bc2199b089 P 127766fc592545a4997f7790f50f6076 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:04:54.125378 21131 raft_consensus.cc:515] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P 0473d2b2d01f4459b1e90fd12cc7840e [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:04:54.085582 20911 consensus_queue.cc:237] T 0e1085d23e8347fbbd5bce7542f4b1f4 P 127766fc592545a4997f7790f50f6076 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:04:54.235894 21156 raft_consensus.cc:493] T a08760e15aac4630a629431f56024dc8 P 0473d2b2d01f4459b1e90fd12cc7840e [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:54.271916 19482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14935b3ddf914369822e4a0547aaa355" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:04:54.272706 19486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e381f1d6b8184797ad142de49be225a8" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:04:54.272969 19478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22196caba61445d3bec98a0aab3c337d" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
W20260709 13:04:54.273491 19450 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.3:36891, user_credentials={real_user=slave}} blocked reactor thread for 263396us
I20260709 13:04:54.273438 19484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff75a1d4cb1f493db8f71ddc136ba9ab" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
W20260709 13:04:54.277205 19377 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.2:46257, user_credentials={real_user=slave}} blocked reactor thread for 120680us
I20260709 13:04:54.280551 19450 leader_election.cc:304] T 6c5eebf646ad445a9d1b1adc319d7b16 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168; no voters: 127766fc592545a4997f7790f50f6076
I20260709 13:04:54.282810 19481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86a6797bdfe94fa496c050ceae4bd0d9" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:04:54.281543 19485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e1f505cb0f1427bbd698ac889d80821" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:04:54.279726 19478 raft_consensus.cc:2468] T 22196caba61445d3bec98a0aab3c337d P 0473d2b2d01f4459b1e90fd12cc7840e [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 3.
I20260709 13:04:54.286240 19485 raft_consensus.cc:3060] T 3e1f505cb0f1427bbd698ac889d80821 P 0473d2b2d01f4459b1e90fd12cc7840e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:54.235217 20998 raft_consensus.cc:515] T 65d8cb8d6ec64f459d5a47cefab10acf P 127766fc592545a4997f7790f50f6076 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:04:54.268579 20873 raft_consensus.cc:493] T f1b10566f45d4a7d9029858330e02d5b P e61c3a8f61bb48f8a963c9480e53c168 [term 3 FOLLOWER]: Starting leader election (detected failure of leader e5256d91808b47c195bc9b4dbd7f2b87)
I20260709 13:04:54.269699 21111 raft_consensus.cc:493] T df751f992649444090e27965eb1af85d P e61c3a8f61bb48f8a963c9480e53c168 [term 2 FOLLOWER]: Starting leader election (detected failure of leader e5256d91808b47c195bc9b4dbd7f2b87)
I20260709 13:04:54.274173 21105 raft_consensus.cc:493] T b08304a0a02b42d7840c4e8ee9a6bd1a P 0473d2b2d01f4459b1e90fd12cc7840e [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e5256d91808b47c195bc9b4dbd7f2b87)
I20260709 13:04:54.087889 21106 consensus_queue.cc:260] T fa731b585f684a7fb2d106c50f143b83 P 127766fc592545a4997f7790f50f6076 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:04:54.311028 19481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7be9efa6559648dbb5a0f7684c4542d1" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:04:54.290117 19450 leader_election.cc:304] T 62c6c134d3d24a1ab144dd9ee6bc3f64 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168; no voters: 127766fc592545a4997f7790f50f6076
I20260709 13:04:54.275033 21148 leader_election.cc:290] T 1efebf73c86e432baa55533136b6e12c P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:04:54.288447 20910 consensus_queue.cc:1048] T 2a16f7501e2444fb86d4e2778e734e02 P 127766fc592545a4997f7790f50f6076 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.012s
W20260709 13:04:54.304368 20075 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:54.300899 21136 consensus_queue.cc:1048] T ab43d85f64114d4ebf618930e43d9ed0 P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.047s
I20260709 13:04:54.319523 19558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1efebf73c86e432baa55533136b6e12c" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:04:54.320243 19558 raft_consensus.cc:2468] T 1efebf73c86e432baa55533136b6e12c P e61c3a8f61bb48f8a963c9480e53c168 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 127766fc592545a4997f7790f50f6076 in term 4.
I20260709 13:04:54.295190 21127 raft_consensus.cc:2804] T 6c5eebf646ad445a9d1b1adc319d7b16 P 0473d2b2d01f4459b1e90fd12cc7840e [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:04:54.295337 21156 raft_consensus.cc:515] T a08760e15aac4630a629431f56024dc8 P 0473d2b2d01f4459b1e90fd12cc7840e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:54.306085 19483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab43d85f64114d4ebf618930e43d9ed0" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 4 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:04:54.269333 20785 raft_consensus.cc:515] T 833a2f0775ed407a94b8924ce50adb63 P 127766fc592545a4997f7790f50f6076 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:04:54.296100 20873 raft_consensus.cc:3060] T f1b10566f45d4a7d9029858330e02d5b P e61c3a8f61bb48f8a963c9480e53c168 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:04:54.239622 19404 rpcz_store.cc:269] 0709 13:04:52.855571 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:52.865123 (+  9552us) service_pool.cc:224] Handling call
0709 13:04:54.117204 (+1252081us) spinlock_profiling.cc:243] Waited 32.8 ms on lock 0x7b5400249354. stack: 00007f4a79de9343 00007f4a79de9240 00007f4a797781d4 00007f4a834b6304 00007f4a834b6299 00007f4a7ce71571 00007f4a7cf0c2fa 00007f4a81ecdb17 00007f4a7b4486d4 00007f4a7b448662 00007f4a7b448591 00007f4a7b44850c 00007f4a7b4477c2 00007f4a7b24348c 00007f4a7b2428c6 00007f4a7b24226f
0709 13:04:54.117345 (+   141us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":75524736}
I20260709 13:04:54.297466 21111 raft_consensus.cc:3060] T df751f992649444090e27965eb1af85d P e61c3a8f61bb48f8a963c9480e53c168 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:04:54.321559 19484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9f0d59553ad444883fcf5b5909f9798" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
W20260709 13:04:54.323038 19375 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.3:36891, user_credentials={real_user=slave}} blocked reactor thread for 78012.3us
W20260709 13:04:54.350416 19375 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:54.293956 19480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28af091831594f9d8e96482078cc7625" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:04:54.328037 19478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76cb037fc9064d13b59a8969d897ce8c" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:04:54.345892 19483 raft_consensus.cc:2468] T ab43d85f64114d4ebf618930e43d9ed0 P 0473d2b2d01f4459b1e90fd12cc7840e [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 3.
I20260709 13:04:54.322283 21112 raft_consensus.cc:2804] T 62c6c134d3d24a1ab144dd9ee6bc3f64 P 0473d2b2d01f4459b1e90fd12cc7840e [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:04:54.326889 19479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef32ce6fdd0e40d382c79974f30295c6" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:04:54.356485 19481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96efeaaf1057492490e9a621f37e1a2d" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:04:54.355142 19482 raft_consensus.cc:1275] T 2725d2c4cb054f18b0fc8f735c15f6c2 P 0473d2b2d01f4459b1e90fd12cc7840e [term 3 FOLLOWER]: Refusing update from remote peer e5256d91808b47c195bc9b4dbd7f2b87: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:04:54.355489 21138 leader_election.cc:290] T 4509b76741dc428e9201c70c1658da13 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:04:54.327543 21106 raft_consensus.cc:3060] T fa731b585f684a7fb2d106c50f143b83 P 127766fc592545a4997f7790f50f6076 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:04:54.324641 21127 raft_consensus.cc:493] T 6c5eebf646ad445a9d1b1adc319d7b16 P 0473d2b2d01f4459b1e90fd12cc7840e [term 2 FOLLOWER]: Starting leader election (detected failure of leader 127766fc592545a4997f7790f50f6076)
I20260709 13:04:54.360591 21112 raft_consensus.cc:493] T 62c6c134d3d24a1ab144dd9ee6bc3f64 P 0473d2b2d01f4459b1e90fd12cc7840e [term 3 FOLLOWER]: Starting leader election (detected failure of leader 127766fc592545a4997f7790f50f6076)
W20260709 13:04:54.365600 21154 log.cc:927] Time spent T ff75a1d4cb1f493db8f71ddc136ba9ab P e5256d91808b47c195bc9b4dbd7f2b87: Append to log took a long time: real 0.280s	user 0.001s	sys 0.000s
I20260709 13:04:54.375192 19406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff75a1d4cb1f493db8f71ddc136ba9ab" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
I20260709 13:04:54.375274 19410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7be9efa6559648dbb5a0f7684c4542d1" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
I20260709 13:04:54.376610 19407 raft_consensus.cc:1275] T 46c5bfeecc314717bffe987e6844b6d0 P e5256d91808b47c195bc9b4dbd7f2b87 [term 5 FOLLOWER]: Refusing update from remote peer e61c3a8f61bb48f8a963c9480e53c168: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 5 index: 2. (index mismatch)
I20260709 13:04:54.378173 19403 raft_consensus.cc:2955] T 309c3ca0ca4b4f3ba129752ea2cb293b P e5256d91808b47c195bc9b4dbd7f2b87 [term 3 FOLLOWER]: Committing config change with OpId 3.5: config changed from index 3 to 5, 127766fc592545a4997f7790f50f6076 (127.17.223.4) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } attrs { replace: true } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } } }
W20260709 13:04:54.381181 19452 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:54.314842 21105 raft_consensus.cc:515] T b08304a0a02b42d7840c4e8ee9a6bd1a P 0473d2b2d01f4459b1e90fd12cc7840e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:54.401968 19411 raft_consensus.cc:1240] T 86a6797bdfe94fa496c050ceae4bd0d9 P e5256d91808b47c195bc9b4dbd7f2b87 [term 4 FOLLOWER]: Rejecting Update request from peer 0473d2b2d01f4459b1e90fd12cc7840e for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260709 13:04:54.390379 19484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edd7d470b5014c9489be7f41f64355c9" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:04:54.397171 19481 raft_consensus.cc:2468] T 96efeaaf1057492490e9a621f37e1a2d P 0473d2b2d01f4459b1e90fd12cc7840e [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 4.
I20260709 13:04:54.398391 19478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed7fdbcb96d14d418db9ca90a792588a" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:04:54.383873 19485 raft_consensus.cc:2468] T 3e1f505cb0f1427bbd698ac889d80821 P 0473d2b2d01f4459b1e90fd12cc7840e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 2.
I20260709 13:04:54.389494 21127 raft_consensus.cc:3060] T 6c5eebf646ad445a9d1b1adc319d7b16 P 0473d2b2d01f4459b1e90fd12cc7840e [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:04:54.398530 20754 raft_consensus.cc:493] T 46c5bfeecc314717bffe987e6844b6d0 P e5256d91808b47c195bc9b4dbd7f2b87 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:54.410836 19480 raft_consensus.cc:2410] T 28af091831594f9d8e96482078cc7625 P 0473d2b2d01f4459b1e90fd12cc7840e [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate e61c3a8f61bb48f8a963c9480e53c168 for term 4 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:04:54.411206 19404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76cb037fc9064d13b59a8969d897ce8c" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
I20260709 13:04:54.412904 21080 raft_consensus.cc:515] T b08304a0a02b42d7840c4e8ee9a6bd1a P e61c3a8f61bb48f8a963c9480e53c168 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:54.456257 21080 leader_election.cc:290] T b08304a0a02b42d7840c4e8ee9a6bd1a P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 3 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:04:54.457298 19482 raft_consensus.cc:1240] T 2b74109013a140ada21feeef92d6f563 P 0473d2b2d01f4459b1e90fd12cc7840e [term 2 LEADER]: Rejecting Update request from peer e5256d91808b47c195bc9b4dbd7f2b87 for earlier term 1. Current term is 2. Ops: []
I20260709 13:04:54.414171 20910 raft_consensus.cc:493] T 0afb57ae58a24a01850491d69f0213dd P 127766fc592545a4997f7790f50f6076 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e61c3a8f61bb48f8a963c9480e53c168)
I20260709 13:04:54.457885 20910 raft_consensus.cc:515] T 0afb57ae58a24a01850491d69f0213dd P 127766fc592545a4997f7790f50f6076 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:04:54.416338 19410 raft_consensus.cc:1275] T fa8650e71aa14778b3d73721fc50d9fc P e5256d91808b47c195bc9b4dbd7f2b87 [term 4 FOLLOWER]: Refusing update from remote peer e61c3a8f61bb48f8a963c9480e53c168: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 2. (index mismatch)
I20260709 13:04:54.416733 21156 leader_election.cc:290] T a08760e15aac4630a629431f56024dc8 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:04:54.391791 21112 raft_consensus.cc:3060] T 62c6c134d3d24a1ab144dd9ee6bc3f64 P 0473d2b2d01f4459b1e90fd12cc7840e [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:04:54.461162 21011 raft_consensus.cc:493] T 2e36a9d6e29c4a7c860cf267efbd4c74 P e61c3a8f61bb48f8a963c9480e53c168 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 0473d2b2d01f4459b1e90fd12cc7840e)
I20260709 13:04:54.461704 21011 raft_consensus.cc:515] T 2e36a9d6e29c4a7c860cf267efbd4c74 P e61c3a8f61bb48f8a963c9480e53c168 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:54.461405 20104 raft_consensus.cc:2955] T 309c3ca0ca4b4f3ba129752ea2cb293b P 127766fc592545a4997f7790f50f6076 [term 3 FOLLOWER]: Committing config change with OpId 3.5: config changed from index 3 to 5, 127766fc592545a4997f7790f50f6076 (127.17.223.4) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } attrs { replace: true } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } } }
I20260709 13:04:54.422749 19483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef32ce6fdd0e40d382c79974f30295c6" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:04:54.432156 20076 leader_election.cc:304] T 1efebf73c86e432baa55533136b6e12c P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 127766fc592545a4997f7790f50f6076, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:04:54.435110 20998 leader_election.cc:290] T 65d8cb8d6ec64f459d5a47cefab10acf P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:04:54.441977 19477 raft_consensus.cc:1275] T 46c5bfeecc314717bffe987e6844b6d0 P 0473d2b2d01f4459b1e90fd12cc7840e [term 5 FOLLOWER]: Refusing update from remote peer e61c3a8f61bb48f8a963c9480e53c168: Log matching property violated. Preceding OpId in replica: term: 4 index: 2. Preceding OpId from leader: term: 5 index: 2. (term mismatch)
I20260709 13:04:54.443724 20785 leader_election.cc:290] T 833a2f0775ed407a94b8924ce50adb63 P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:04:54.446166 19485 raft_consensus.cc:1240] T 3e1f505cb0f1427bbd698ac889d80821 P 0473d2b2d01f4459b1e90fd12cc7840e [term 2 FOLLOWER]: Rejecting Update request from peer e5256d91808b47c195bc9b4dbd7f2b87 for earlier term 1. Current term is 2. Ops: []
I20260709 13:04:54.431559 20754 raft_consensus.cc:515] T 46c5bfeecc314717bffe987e6844b6d0 P e5256d91808b47c195bc9b4dbd7f2b87 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:54.447813 21140 raft_consensus.cc:515] T 9962423cb4e54fcfa5de01daf68a86e7 P 0473d2b2d01f4459b1e90fd12cc7840e [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:04:54.450269 21105 leader_election.cc:290] T b08304a0a02b42d7840c4e8ee9a6bd1a P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:04:54.460623 21115 raft_consensus.cc:493] T 2b74109013a140ada21feeef92d6f563 P e61c3a8f61bb48f8a963c9480e53c168 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e5256d91808b47c195bc9b4dbd7f2b87)
I20260709 13:04:54.460855 20910 leader_election.cc:290] T 0afb57ae58a24a01850491d69f0213dd P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:04:54.461032 20864 raft_consensus.cc:493] T 1a61655d99124a29b486ba4a5b37faea P e61c3a8f61bb48f8a963c9480e53c168 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0473d2b2d01f4459b1e90fd12cc7840e)
I20260709 13:04:54.479337 21011 leader_election.cc:290] T 2e36a9d6e29c4a7c860cf267efbd4c74 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:04:54.479557 20864 raft_consensus.cc:515] T 1a61655d99124a29b486ba4a5b37faea P e61c3a8f61bb48f8a963c9480e53c168 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:54.481588 20864 leader_election.cc:290] T 1a61655d99124a29b486ba4a5b37faea P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:04:54.470584 19477 pending_rounds.cc:85] T 46c5bfeecc314717bffe987e6844b6d0 P 0473d2b2d01f4459b1e90fd12cc7840e: Aborting all ops after (but not including) 1
I20260709 13:04:54.482270 19477 pending_rounds.cc:107] T 46c5bfeecc314717bffe987e6844b6d0 P 0473d2b2d01f4459b1e90fd12cc7840e: Aborting uncommitted NO_OP operation due to leader change: 4.2
I20260709 13:04:54.482563 19477 raft_consensus.cc:2889] T 46c5bfeecc314717bffe987e6844b6d0 P 0473d2b2d01f4459b1e90fd12cc7840e [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:04:54.478127 19484 raft_consensus.cc:1240] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P 0473d2b2d01f4459b1e90fd12cc7840e [term 5 FOLLOWER]: Rejecting Update request from peer e5256d91808b47c195bc9b4dbd7f2b87 for earlier term 4. Current term is 5. Ops: []
I20260709 13:04:54.478722 21115 raft_consensus.cc:515] T 2b74109013a140ada21feeef92d6f563 P e61c3a8f61bb48f8a963c9480e53c168 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:54.484603 19408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a61655d99124a29b486ba4a5b37faea" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:04:54.485047 21115 leader_election.cc:290] T 2b74109013a140ada21feeef92d6f563 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:04:54.484844 21111 raft_consensus.cc:515] T df751f992649444090e27965eb1af85d P e61c3a8f61bb48f8a963c9480e53c168 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:54.481505 19410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e36a9d6e29c4a7c860cf267efbd4c74" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:04:54.465055 19404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b08304a0a02b42d7840c4e8ee9a6bd1a" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
I20260709 13:04:54.474830 19481 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d1e5873a19244c5ebbcd38e126796ee7"
dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
 from {username='slave'} at 127.0.0.1:58294
I20260709 13:04:54.488974 19481 raft_consensus.cc:493] T d1e5873a19244c5ebbcd38e126796ee7 P 0473d2b2d01f4459b1e90fd12cc7840e [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:04:54.489332 19481 raft_consensus.cc:3060] T d1e5873a19244c5ebbcd38e126796ee7 P 0473d2b2d01f4459b1e90fd12cc7840e [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:04:54.489470 19411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a16f7501e2444fb86d4e2778e734e02" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: true dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
I20260709 13:04:54.490041 19411 raft_consensus.cc:2376] T 2a16f7501e2444fb86d4e2778e734e02 P e5256d91808b47c195bc9b4dbd7f2b87 [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 127766fc592545a4997f7790f50f6076 in term 5. Re-sending same reply.
W20260709 13:04:54.477475 20076 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.3:36891, user_credentials={real_user=slave}} blocked reactor thread for 59434.1us
I20260709 13:04:54.495293 19410 raft_consensus.cc:1240] T ece3db938bc649d4a40a51522ed5259c P e5256d91808b47c195bc9b4dbd7f2b87 [term 4 FOLLOWER]: Rejecting Update request from peer 127766fc592545a4997f7790f50f6076 for earlier term 3. Current term is 4. Ops: [3.5-3.5]
I20260709 13:04:54.498045 20853 raft_consensus.cc:2955] T 309c3ca0ca4b4f3ba129752ea2cb293b P e61c3a8f61bb48f8a963c9480e53c168 [term 3 LEADER]: Committing config change with OpId 3.5: config changed from index 3 to 5, 127766fc592545a4997f7790f50f6076 (127.17.223.4) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } attrs { replace: true } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } } }
I20260709 13:04:54.476939 20776 consensus_queue.cc:1048] T ab43d85f64114d4ebf618930e43d9ed0 P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Connected to new peer: Peer: permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: NON_VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.014s
I20260709 13:04:54.523303 19555 raft_consensus.cc:1240] T 7be9efa6559648dbb5a0f7684c4542d1 P e61c3a8f61bb48f8a963c9480e53c168 [term 4 FOLLOWER]: Rejecting Update request from peer 0473d2b2d01f4459b1e90fd12cc7840e for earlier term 3. Current term is 4. Ops: []
I20260709 13:04:54.487071 21131 leader_election.cc:290] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 5 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:04:54.510062 19486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff9b0eddd810459b82d91c60777c10eb" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:04:54.510663 19558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0afb57ae58a24a01850491d69f0213dd" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:04:54.525067 19479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff75a1d4cb1f493db8f71ddc136ba9ab" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:04:54.508111 21140 leader_election.cc:290] T 9962423cb4e54fcfa5de01daf68a86e7 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 5 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:04:54.526242 20867 raft_consensus.cc:515] T 7be9efa6559648dbb5a0f7684c4542d1 P e5256d91808b47c195bc9b4dbd7f2b87 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:54.527833 19558 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "309c3ca0ca4b4f3ba129752ea2cb293b"
dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:40412
I20260709 13:04:54.528472 20867 leader_election.cc:290] T 7be9efa6559648dbb5a0f7684c4542d1 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 4 election: Requested vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:04:54.501827 21112 raft_consensus.cc:515] T 62c6c134d3d24a1ab144dd9ee6bc3f64 P 0473d2b2d01f4459b1e90fd12cc7840e [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:04:54.529587 19480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7be9efa6559648dbb5a0f7684c4542d1" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:04:54.476257 20728 raft_consensus.cc:515] T 21e14947d70440f19044d8f75c31e1f9 P e61c3a8f61bb48f8a963c9480e53c168 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
W20260709 13:04:54.513031 20077 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:54.508307 19485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9f0d59553ad444883fcf5b5909f9798" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:04:54.513178 19403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df751f992649444090e27965eb1af85d" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
I20260709 13:04:54.506242 19559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "833a2f0775ed407a94b8924ce50adb63" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:04:54.507433 19551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65d8cb8d6ec64f459d5a47cefab10acf" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:04:54.487212 20785 raft_consensus.cc:2804] T 1efebf73c86e432baa55533136b6e12c P 127766fc592545a4997f7790f50f6076 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:04:54.515476 21061 leader_election.cc:290] T 76cb037fc9064d13b59a8969d897ce8c P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 4 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:04:54.541594 19478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a61655d99124a29b486ba4a5b37faea" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:04:54.501716 20873 raft_consensus.cc:515] T f1b10566f45d4a7d9029858330e02d5b P e61c3a8f61bb48f8a963c9480e53c168 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:54.519735 19560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df751f992649444090e27965eb1af85d" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:04:54.519527 19481 raft_consensus.cc:515] T d1e5873a19244c5ebbcd38e126796ee7 P 0473d2b2d01f4459b1e90fd12cc7840e [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:54.542307 19556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e1085d23e8347fbbd5bce7542f4b1f4" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:04:54.543089 19556 raft_consensus.cc:2393] T 0e1085d23e8347fbbd5bce7542f4b1f4 P e61c3a8f61bb48f8a963c9480e53c168 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0473d2b2d01f4459b1e90fd12cc7840e in current term 4: Already voted for candidate 127766fc592545a4997f7790f50f6076 in this term.
I20260709 13:04:54.521422 19552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "179fd671030940b4b4a4e24bcc4aba0a" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:04:54.502734 19405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b74109013a140ada21feeef92d6f563" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:04:54.529925 19484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cdf56e38bbc453d9438d359e5a69955" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:04:54.544005 19484 raft_consensus.cc:3060] T 0cdf56e38bbc453d9438d359e5a69955 P 0473d2b2d01f4459b1e90fd12cc7840e [term 2 FOLLOWER]: Advancing to term 4
I20260709 13:04:54.544131 19405 raft_consensus.cc:2393] T 2b74109013a140ada21feeef92d6f563 P e5256d91808b47c195bc9b4dbd7f2b87 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e61c3a8f61bb48f8a963c9480e53c168 in current term 2: Already voted for candidate 0473d2b2d01f4459b1e90fd12cc7840e in this term.
I20260709 13:04:54.530963 21112 leader_election.cc:290] T 62c6c134d3d24a1ab144dd9ee6bc3f64 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 4 election: Requested vote from peers e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:04:54.511049 19483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14935b3ddf914369822e4a0547aaa355" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:04:54.545614 19478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff75a1d4cb1f493db8f71ddc136ba9ab" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:04:54.500597 21127 raft_consensus.cc:515] T 6c5eebf646ad445a9d1b1adc319d7b16 P 0473d2b2d01f4459b1e90fd12cc7840e [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:04:54.526543 19479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "309c3ca0ca4b4f3ba129752ea2cb293b" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:04:54.546532 19479 raft_consensus.cc:2468] T 309c3ca0ca4b4f3ba129752ea2cb293b P 0473d2b2d01f4459b1e90fd12cc7840e [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 3.
I20260709 13:04:54.536527 19555 raft_consensus.cc:1240] T ef32ce6fdd0e40d382c79974f30295c6 P e61c3a8f61bb48f8a963c9480e53c168 [term 4 FOLLOWER]: Rejecting Update request from peer 0473d2b2d01f4459b1e90fd12cc7840e for earlier term 3. Current term is 4. Ops: []
I20260709 13:04:54.537948 19485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f93ee515a9c14139bf566522ed8232f3" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:04:54.540297 19559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f575b143b844aa096b50997dad3516a" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:04:54.516984 19411 raft_consensus.cc:1275] T 86a6797bdfe94fa496c050ceae4bd0d9 P e5256d91808b47c195bc9b4dbd7f2b87 [term 4 FOLLOWER]: Refusing update from remote peer e61c3a8f61bb48f8a963c9480e53c168: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 2. (index mismatch)
I20260709 13:04:54.547688 19485 raft_consensus.cc:2410] T f93ee515a9c14139bf566522ed8232f3 P 0473d2b2d01f4459b1e90fd12cc7840e [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e5256d91808b47c195bc9b4dbd7f2b87 for term 4 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:04:54.534428 21111 leader_election.cc:290] T df751f992649444090e27965eb1af85d P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 3 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:04:54.548442 19411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65d8cb8d6ec64f459d5a47cefab10acf" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:04:54.539188 20785 raft_consensus.cc:493] T 1efebf73c86e432baa55533136b6e12c P 127766fc592545a4997f7790f50f6076 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:54.549844 19554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22196caba61445d3bec98a0aab3c337d" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:04:54.550112 20785 raft_consensus.cc:3060] T 1efebf73c86e432baa55533136b6e12c P 127766fc592545a4997f7790f50f6076 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:04:54.520499 21044 raft_consensus.cc:493] T 14935b3ddf914369822e4a0547aaa355 P e5256d91808b47c195bc9b4dbd7f2b87 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0473d2b2d01f4459b1e90fd12cc7840e)
I20260709 13:04:54.525101 19486 raft_consensus.cc:2468] T ff9b0eddd810459b82d91c60777c10eb P 0473d2b2d01f4459b1e90fd12cc7840e [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 2.
I20260709 13:04:54.530586 19482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e36a9d6e29c4a7c860cf267efbd4c74" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:04:54.554404 19407 raft_consensus.cc:1240] T 775c229504194560ba9589bc2199b089 P e5256d91808b47c195bc9b4dbd7f2b87 [term 3 FOLLOWER]: Rejecting Update request from peer 127766fc592545a4997f7790f50f6076 for earlier term 2. Current term is 3. Ops: [2.5-2.5]
I20260709 13:04:54.550945 21044 raft_consensus.cc:515] T 14935b3ddf914369822e4a0547aaa355 P e5256d91808b47c195bc9b4dbd7f2b87 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } attrs { replace: true } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: NON_VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: true } }
I20260709 13:04:54.556756 19409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "833a2f0775ed407a94b8924ce50adb63" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:04:54.566488 19479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "172b3dd13109415a955b71ac0e9d2234" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:04:54.566636 19481 leader_election.cc:290] T d1e5873a19244c5ebbcd38e126796ee7 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 3 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:04:54.569883 19483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "172b3dd13109415a955b71ac0e9d2234" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:04:54.565330 19480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "775c229504194560ba9589bc2199b089" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:04:54.585517 19482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f93ee515a9c14139bf566522ed8232f3" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:04:54.572896 19479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc225c93219c45538b53a1bd3d387e4d" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:04:54.586841 19482 raft_consensus.cc:2410] T f93ee515a9c14139bf566522ed8232f3 P 0473d2b2d01f4459b1e90fd12cc7840e [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate e5256d91808b47c195bc9b4dbd7f2b87 for term 4 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:04:54.578966 19556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40e1e16737a842ee936002830f36882e" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:04:54.583003 19486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc225c93219c45538b53a1bd3d387e4d" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:04:54.590806 19556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0afb57ae58a24a01850491d69f0213dd" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:04:54.592025 20728 leader_election.cc:290] T 21e14947d70440f19044d8f75c31e1f9 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 3 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:04:54.592748 19554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b74109013a140ada21feeef92d6f563" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:04:54.592839 19556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "217b5fae677b4971b3bbd2f357a1f7ff" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:04:54.593607 19554 raft_consensus.cc:2468] T 2b74109013a140ada21feeef92d6f563 P e61c3a8f61bb48f8a963c9480e53c168 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 1.
I20260709 13:04:54.594564 19556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2725d2c4cb054f18b0fc8f735c15f6c2" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:04:54.595198 19479 raft_consensus.cc:2410] T bc225c93219c45538b53a1bd3d387e4d P 0473d2b2d01f4459b1e90fd12cc7840e [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e5256d91808b47c195bc9b4dbd7f2b87 for term 4 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:04:54.583974 19481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e381f1d6b8184797ad142de49be225a8" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:04:54.596068 21127 leader_election.cc:290] T 6c5eebf646ad445a9d1b1adc319d7b16 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 3 election: Requested vote from peers e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
W20260709 13:04:54.597178 20076 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:54.585961 19480 raft_consensus.cc:1240] T d1e5873a19244c5ebbcd38e126796ee7 P 0473d2b2d01f4459b1e90fd12cc7840e [term 3 FOLLOWER]: Rejecting Update request from peer e5256d91808b47c195bc9b4dbd7f2b87 for earlier term 2. Current term is 3. Ops: []
I20260709 13:04:54.606357 19556 raft_consensus.cc:1240] T 14935b3ddf914369822e4a0547aaa355 P e61c3a8f61bb48f8a963c9480e53c168 [term 2 FOLLOWER]: Rejecting Update request from peer 0473d2b2d01f4459b1e90fd12cc7840e for earlier term 1. Current term is 2. Ops: []
I20260709 13:04:54.556494 19404 raft_consensus.cc:1275] T 9962423cb4e54fcfa5de01daf68a86e7 P e5256d91808b47c195bc9b4dbd7f2b87 [term 4 FOLLOWER]: Refusing update from remote peer 127766fc592545a4997f7790f50f6076: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
I20260709 13:04:54.609086 19552 raft_consensus.cc:1240] T f93ee515a9c14139bf566522ed8232f3 P e61c3a8f61bb48f8a963c9480e53c168 [term 4 FOLLOWER]: Rejecting Update request from peer 0473d2b2d01f4459b1e90fd12cc7840e for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260709 13:04:54.564321 21173 consensus_queue.cc:1048] T 2725d2c4cb054f18b0fc8f735c15f6c2 P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.051s
I20260709 13:04:54.583868 19478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edd7d470b5014c9489be7f41f64355c9" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
W20260709 13:04:54.617929 19377 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.2:46257, user_credentials={real_user=slave}} blocked reactor thread for 49524.4us
W20260709 13:04:54.642628 20078 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.2:46257, user_credentials={real_user=slave}} blocked reactor thread for 120418us
I20260709 13:04:54.567600 19553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48824d5acfbc485ebf8c2d944e7202de" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:04:54.594655 19554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cdf56e38bbc453d9438d359e5a69955" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:04:54.666985 19483 raft_consensus.cc:1275] T f93ee515a9c14139bf566522ed8232f3 P 0473d2b2d01f4459b1e90fd12cc7840e [term 4 FOLLOWER]: Refusing update from remote peer e5256d91808b47c195bc9b4dbd7f2b87: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 2. (term mismatch)
I20260709 13:04:54.667678 19486 raft_consensus.cc:1275] T 1dc5b3532fe54f74876d02beffa2c230 P 0473d2b2d01f4459b1e90fd12cc7840e [term 3 FOLLOWER]: Refusing update from remote peer e5256d91808b47c195bc9b4dbd7f2b87: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:04:54.667424 19483 pending_rounds.cc:85] T f93ee515a9c14139bf566522ed8232f3 P 0473d2b2d01f4459b1e90fd12cc7840e: Aborting all ops after (but not including) 1
I20260709 13:04:54.687425 19483 pending_rounds.cc:107] T f93ee515a9c14139bf566522ed8232f3 P 0473d2b2d01f4459b1e90fd12cc7840e: Aborting uncommitted NO_OP operation due to leader change: 3.2
I20260709 13:04:54.687716 19483 raft_consensus.cc:2889] T f93ee515a9c14139bf566522ed8232f3 P 0473d2b2d01f4459b1e90fd12cc7840e [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:04:54.688933 19486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e1085d23e8347fbbd5bce7542f4b1f4" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:04:54.689741 19486 raft_consensus.cc:3060] T 0e1085d23e8347fbbd5bce7542f4b1f4 P 0473d2b2d01f4459b1e90fd12cc7840e [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:04:54.644187 20785 raft_consensus.cc:515] T 1efebf73c86e432baa55533136b6e12c P 127766fc592545a4997f7790f50f6076 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:04:54.697505 20785 leader_election.cc:290] T 1efebf73c86e432baa55533136b6e12c P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 5 election: Requested vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:04:54.661947 20106 raft_consensus.cc:1275] T ece3db938bc649d4a40a51522ed5259c P 127766fc592545a4997f7790f50f6076 [term 4 FOLLOWER]: Refusing update from remote peer e61c3a8f61bb48f8a963c9480e53c168: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 5. (term mismatch)
I20260709 13:04:54.702083 20873 leader_election.cc:290] T f1b10566f45d4a7d9029858330e02d5b P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 4 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:04:54.702875 19551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "309c3ca0ca4b4f3ba129752ea2cb293b" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:04:54.704176 21044 leader_election.cc:290] T 14935b3ddf914369822e4a0547aaa355 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:04:54.704210 19551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1efebf73c86e432baa55533136b6e12c" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:04:54.707055 19551 raft_consensus.cc:3060] T 1efebf73c86e432baa55533136b6e12c P e61c3a8f61bb48f8a963c9480e53c168 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:04:54.707836 19553 raft_consensus.cc:1240] T 28af091831594f9d8e96482078cc7625 P e61c3a8f61bb48f8a963c9480e53c168 [term 4 LEADER]: Rejecting Update request from peer 0473d2b2d01f4459b1e90fd12cc7840e for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260709 13:04:54.708886 20106 pending_rounds.cc:85] T ece3db938bc649d4a40a51522ed5259c P 127766fc592545a4997f7790f50f6076: Aborting all ops after (but not including) 4
I20260709 13:04:54.718999 19484 raft_consensus.cc:2468] T 0cdf56e38bbc453d9438d359e5a69955 P 0473d2b2d01f4459b1e90fd12cc7840e [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 4.
I20260709 13:04:54.728907 19483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1efebf73c86e432baa55533136b6e12c" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:04:54.729538 19483 raft_consensus.cc:2468] T 1efebf73c86e432baa55533136b6e12c P 0473d2b2d01f4459b1e90fd12cc7840e [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 127766fc592545a4997f7790f50f6076 in term 3.
I20260709 13:04:54.730280 19483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9962423cb4e54fcfa5de01daf68a86e7" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:04:54.730904 19483 raft_consensus.cc:2368] T 9962423cb4e54fcfa5de01daf68a86e7 P 0473d2b2d01f4459b1e90fd12cc7840e [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 127766fc592545a4997f7790f50f6076 for earlier term 4. Current term is 5.
I20260709 13:04:54.734200 19558 raft_consensus.cc:606] T 309c3ca0ca4b4f3ba129752ea2cb293b P e61c3a8f61bb48f8a963c9480e53c168 [term 3 LEADER]: Received request to transfer leadership
I20260709 13:04:54.735153 19483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14efcc79969f41babe5529c22d59156d" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:04:54.738941 21043 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 14935b3ddf914369822e4a0547aaa355. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:54.699982 19554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4509b76741dc428e9201c70c1658da13" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:04:54.741966 19483 raft_consensus.cc:2410] T 14efcc79969f41babe5529c22d59156d P 0473d2b2d01f4459b1e90fd12cc7840e [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 127766fc592545a4997f7790f50f6076 for term 5 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 13:04:54.738780 20873 consensus_queue.cc:1048] T fa8650e71aa14778b3d73721fc50d9fc P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:04:54.726205 20106 pending_rounds.cc:107] T ece3db938bc649d4a40a51522ed5259c P 127766fc592545a4997f7790f50f6076: Aborting uncommitted NO_OP operation due to leader change: 3.5
I20260709 13:04:54.751679 20078 leader_election.cc:400] T 9962423cb4e54fcfa5de01daf68a86e7 P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 4 election: Vote denied by peer 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257) with higher term. Message: Invalid argument: T 9962423cb4e54fcfa5de01daf68a86e7 P 0473d2b2d01f4459b1e90fd12cc7840e [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 127766fc592545a4997f7790f50f6076 for earlier term 4. Current term is 5.
I20260709 13:04:54.752890 20078 leader_election.cc:304] T 14efcc79969f41babe5529c22d59156d P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 127766fc592545a4997f7790f50f6076; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:04:54.747669 19377 leader_election.cc:304] T 1a61655d99124a29b486ba4a5b37faea P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:04:54.756531 19377 leader_election.cc:304] T 309c3ca0ca4b4f3ba129752ea2cb293b P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87; no voters: e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:04:54.757566 19483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0afb57ae58a24a01850491d69f0213dd" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:04:54.758309 19483 raft_consensus.cc:2468] T 0afb57ae58a24a01850491d69f0213dd P 0473d2b2d01f4459b1e90fd12cc7840e [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 127766fc592545a4997f7790f50f6076 in term 1.
I20260709 13:04:54.759125 19483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1efebf73c86e432baa55533136b6e12c" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:04:54.759588 19483 raft_consensus.cc:3060] T 1efebf73c86e432baa55533136b6e12c P 0473d2b2d01f4459b1e90fd12cc7840e [term 3 FOLLOWER]: Advancing to term 5
I20260709 13:04:54.762207 19377 leader_election.cc:304] T 14935b3ddf914369822e4a0547aaa355 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:04:54.728485 21137 consensus_queue.cc:1059] T 7be9efa6559648dbb5a0f7684c4542d1 P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.028s
I20260709 13:04:54.746622 20106 raft_consensus.cc:2889] T ece3db938bc649d4a40a51522ed5259c P 127766fc592545a4997f7790f50f6076 [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:04:54.770591 19377 leader_election.cc:304] T ff75a1d4cb1f493db8f71ddc136ba9ab P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:04:54.739768 20728 consensus_queue.cc:1048] T 46c5bfeecc314717bffe987e6844b6d0 P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.029s
I20260709 13:04:54.773509 20819 raft_consensus.cc:2749] T 14935b3ddf914369822e4a0547aaa355 P e5256d91808b47c195bc9b4dbd7f2b87 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:04:54.773969 19554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e5873a19244c5ebbcd38e126796ee7" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:04:54.778031 20078 leader_election.cc:304] T 0afb57ae58a24a01850491d69f0213dd P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, 127766fc592545a4997f7790f50f6076; no voters: 
I20260709 13:04:54.780682 19483 raft_consensus.cc:2468] T 1efebf73c86e432baa55533136b6e12c P 0473d2b2d01f4459b1e90fd12cc7840e [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 127766fc592545a4997f7790f50f6076 in term 5.
W20260709 13:04:54.781289 21126 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.507s	user 0.004s	sys 0.023s
I20260709 13:04:54.764638 20867 raft_consensus.cc:2749] T 1a61655d99124a29b486ba4a5b37faea P e5256d91808b47c195bc9b4dbd7f2b87 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:04:54.744225 21136 consensus_queue.cc:1059] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.027s
I20260709 13:04:54.750830 21061 consensus_queue.cc:1048] T 86a6797bdfe94fa496c050ceae4bd0d9 P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.032s
I20260709 13:04:54.765720 21165 raft_consensus.cc:2804] T 309c3ca0ca4b4f3ba129752ea2cb293b P e5256d91808b47c195bc9b4dbd7f2b87 [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 13:04:54.832732 19377 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RunLeaderElection -> {remote=127.17.223.2:46257, user_credentials={real_user=slave}} blocked reactor thread for 51580.2us
I20260709 13:04:54.763103 20910 raft_consensus.cc:2749] T 14efcc79969f41babe5529c22d59156d P 127766fc592545a4997f7790f50f6076 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:04:54.781951 19450 leader_election.cc:304] T 0e1085d23e8347fbbd5bce7542f4b1f4 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e; no voters: 127766fc592545a4997f7790f50f6076, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:04:54.936547 19555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62c6c134d3d24a1ab144dd9ee6bc3f64" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:04:54.946691 19480 raft_consensus.cc:1275] T 0cdf56e38bbc453d9438d359e5a69955 P 0473d2b2d01f4459b1e90fd12cc7840e [term 4 FOLLOWER]: Refusing update from remote peer e5256d91808b47c195bc9b4dbd7f2b87: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:04:54.948722 19558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c5eebf646ad445a9d1b1adc319d7b16" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:04:54.953496 19483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff9b0eddd810459b82d91c60777c10eb" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:04:54.958339 19483 raft_consensus.cc:2468] T ff9b0eddd810459b82d91c60777c10eb P 0473d2b2d01f4459b1e90fd12cc7840e [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 2.
I20260709 13:04:54.955400 19377 leader_election.cc:304] T 775c229504194560ba9589bc2199b089 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, 127766fc592545a4997f7790f50f6076
I20260709 13:04:54.781951 21085 raft_consensus.cc:2749] T ff75a1d4cb1f493db8f71ddc136ba9ab P e5256d91808b47c195bc9b4dbd7f2b87 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 13:04:54.960551 20077 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:04:54.961230 20078 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.2:46257, user_credentials={real_user=slave}} blocked reactor thread for 183270us
I20260709 13:04:54.964267 19483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7be9efa6559648dbb5a0f7684c4542d1" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:04:54.879271 19553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b08304a0a02b42d7840c4e8ee9a6bd1a" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:04:54.965991 21140 raft_consensus.cc:3055] T 7be9efa6559648dbb5a0f7684c4542d1 P 0473d2b2d01f4459b1e90fd12cc7840e [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:04:54.966403 21140 raft_consensus.cc:740] T 7be9efa6559648dbb5a0f7684c4542d1 P 0473d2b2d01f4459b1e90fd12cc7840e [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 0473d2b2d01f4459b1e90fd12cc7840e, State: Running, Role: LEADER
W20260709 13:04:54.953042 21178 log.cc:927] Time spent T 2a16f7501e2444fb86d4e2778e734e02 P e5256d91808b47c195bc9b4dbd7f2b87: Append to log took a long time: real 0.113s	user 0.000s	sys 0.006s
I20260709 13:04:54.941901 19554 raft_consensus.cc:3060] T d1e5873a19244c5ebbcd38e126796ee7 P e61c3a8f61bb48f8a963c9480e53c168 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:04:54.978610 19483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e36a9d6e29c4a7c860cf267efbd4c74" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:04:54.983116 19483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9f0d59553ad444883fcf5b5909f9798" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:04:54.984370 19483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96efeaaf1057492490e9a621f37e1a2d" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:04:54.985270 19483 raft_consensus.cc:2393] T 96efeaaf1057492490e9a621f37e1a2d P 0473d2b2d01f4459b1e90fd12cc7840e [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 127766fc592545a4997f7790f50f6076 in current term 4: Already voted for candidate e61c3a8f61bb48f8a963c9480e53c168 in this term.
I20260709 13:04:54.986307 19556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14935b3ddf914369822e4a0547aaa355" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:04:54.988574 19556 raft_consensus.cc:2393] T 14935b3ddf914369822e4a0547aaa355 P e61c3a8f61bb48f8a963c9480e53c168 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e5256d91808b47c195bc9b4dbd7f2b87 in current term 2: Already voted for candidate e61c3a8f61bb48f8a963c9480e53c168 in this term.
I20260709 13:04:54.989550 19482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed7fdbcb96d14d418db9ca90a792588a" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
W20260709 13:04:54.990046 19452 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:54.956830 21165 raft_consensus.cc:493] T 309c3ca0ca4b4f3ba129752ea2cb293b P e5256d91808b47c195bc9b4dbd7f2b87 [term 3 FOLLOWER]: Starting leader election (detected failure of leader e61c3a8f61bb48f8a963c9480e53c168)
I20260709 13:04:54.991748 19483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96efeaaf1057492490e9a621f37e1a2d" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:04:54.992703 19483 raft_consensus.cc:2393] T 96efeaaf1057492490e9a621f37e1a2d P 0473d2b2d01f4459b1e90fd12cc7840e [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 127766fc592545a4997f7790f50f6076 in current term 4: Already voted for candidate e61c3a8f61bb48f8a963c9480e53c168 in this term.
I20260709 13:04:54.993685 19483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e1085d23e8347fbbd5bce7542f4b1f4" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:04:55.003558 19556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a08760e15aac4630a629431f56024dc8" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:04:55.005143 19556 raft_consensus.cc:2410] T a08760e15aac4630a629431f56024dc8 P e61c3a8f61bb48f8a963c9480e53c168 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0473d2b2d01f4459b1e90fd12cc7840e for term 4 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
W20260709 13:04:55.005280 19450 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.3:36891, user_credentials={real_user=slave}} blocked reactor thread for 223439us
I20260709 13:04:55.006100 19450 leader_election.cc:304] T 7f575b143b844aa096b50997dad3516a P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e; no voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:04:54.980836 20998 raft_consensus.cc:2804] T 0afb57ae58a24a01850491d69f0213dd P 127766fc592545a4997f7790f50f6076 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:04:55.007539 19450 leader_election.cc:304] T df751f992649444090e27965eb1af85d P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e; no voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:04:54.991160 21174 raft_consensus.cc:493] T f93ee515a9c14139bf566522ed8232f3 P e61c3a8f61bb48f8a963c9480e53c168 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:55.009172 19556 raft_consensus.cc:1240] T ff75a1d4cb1f493db8f71ddc136ba9ab P e61c3a8f61bb48f8a963c9480e53c168 [term 4 FOLLOWER]: Rejecting Update request from peer 0473d2b2d01f4459b1e90fd12cc7840e for earlier term 3. Current term is 4. Ops: []
I20260709 13:04:55.028543 19483 raft_consensus.cc:1275] T fa8650e71aa14778b3d73721fc50d9fc P 0473d2b2d01f4459b1e90fd12cc7840e [term 4 FOLLOWER]: Refusing update from remote peer e61c3a8f61bb48f8a963c9480e53c168: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 2. (term mismatch)
I20260709 13:04:55.049863 19483 pending_rounds.cc:85] T fa8650e71aa14778b3d73721fc50d9fc P 0473d2b2d01f4459b1e90fd12cc7840e: Aborting all ops after (but not including) 1
I20260709 13:04:55.050235 19483 pending_rounds.cc:107] T fa8650e71aa14778b3d73721fc50d9fc P 0473d2b2d01f4459b1e90fd12cc7840e: Aborting uncommitted NO_OP operation due to leader change: 3.2
I20260709 13:04:55.050748 19483 raft_consensus.cc:2889] T fa8650e71aa14778b3d73721fc50d9fc P 0473d2b2d01f4459b1e90fd12cc7840e [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:04:55.058858 19556 raft_consensus.cc:1240] T 86a6797bdfe94fa496c050ceae4bd0d9 P e61c3a8f61bb48f8a963c9480e53c168 [term 4 LEADER]: Rejecting Update request from peer 0473d2b2d01f4459b1e90fd12cc7840e for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260709 13:04:55.060109 19483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7be9efa6559648dbb5a0f7684c4542d1" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:04:55.062731 19556 raft_consensus.cc:1240] T 46c5bfeecc314717bffe987e6844b6d0 P e61c3a8f61bb48f8a963c9480e53c168 [term 5 LEADER]: Rejecting Update request from peer 0473d2b2d01f4459b1e90fd12cc7840e for earlier term 4. Current term is 5. Ops: [4.2-4.2]
I20260709 13:04:55.064389 19556 raft_consensus.cc:1240] T 76cb037fc9064d13b59a8969d897ce8c P e61c3a8f61bb48f8a963c9480e53c168 [term 4 FOLLOWER]: Rejecting Update request from peer 0473d2b2d01f4459b1e90fd12cc7840e for earlier term 3. Current term is 4. Ops: []
I20260709 13:04:55.065156 20754 leader_election.cc:290] T 46c5bfeecc314717bffe987e6844b6d0 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
W20260709 13:04:55.047652 21181 log.cc:927] Time spent T 309c3ca0ca4b4f3ba129752ea2cb293b P e61c3a8f61bb48f8a963c9480e53c168: Append to log took a long time: real 0.095s	user 0.000s	sys 0.001s
I20260709 13:04:55.066962 20853 raft_consensus.cc:993] T 309c3ca0ca4b4f3ba129752ea2cb293b P e61c3a8f61bb48f8a963c9480e53c168: : Instructing follower e5256d91808b47c195bc9b4dbd7f2b87 to start an election
I20260709 13:04:54.996040 21165 raft_consensus.cc:3060] T 309c3ca0ca4b4f3ba129752ea2cb293b P e5256d91808b47c195bc9b4dbd7f2b87 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:04:55.002647 19486 raft_consensus.cc:2468] T 0e1085d23e8347fbbd5bce7542f4b1f4 P 0473d2b2d01f4459b1e90fd12cc7840e [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 127766fc592545a4997f7790f50f6076 in term 4.
I20260709 13:04:55.030375 21088 raft_consensus.cc:2749] T 7f575b143b844aa096b50997dad3516a P 0473d2b2d01f4459b1e90fd12cc7840e [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:04:55.025313 21079 raft_consensus.cc:493] T 2725d2c4cb054f18b0fc8f735c15f6c2 P e61c3a8f61bb48f8a963c9480e53c168 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader e5256d91808b47c195bc9b4dbd7f2b87)
I20260709 13:04:55.031387 20785 raft_consensus.cc:493] T 70797e5783b5454ab0d0eea663e791e3 P 127766fc592545a4997f7790f50f6076 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader e5256d91808b47c195bc9b4dbd7f2b87)
I20260709 13:04:55.083498 18300 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:04:54.995707 21125 raft_consensus.cc:493] T f93ee515a9c14139bf566522ed8232f3 P 0473d2b2d01f4459b1e90fd12cc7840e [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:55.095242 19486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e36a9d6e29c4a7c860cf267efbd4c74" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:04:54.991462 20945 raft_consensus.cc:493] T 46c5bfeecc314717bffe987e6844b6d0 P 0473d2b2d01f4459b1e90fd12cc7840e [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:55.111840 19486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76cb037fc9064d13b59a8969d897ce8c" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:04:55.113236 19486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b08304a0a02b42d7840c4e8ee9a6bd1a" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:04:55.006371 20819 raft_consensus.cc:3055] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P e5256d91808b47c195bc9b4dbd7f2b87 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:04:55.012814 20867 raft_consensus.cc:2749] T 775c229504194560ba9589bc2199b089 P e5256d91808b47c195bc9b4dbd7f2b87 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:04:55.039016 20728 consensus_queue.cc:1048] T ece3db938bc649d4a40a51522ed5259c P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Connected to new peer: Peer: permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.055s
W20260709 13:04:55.075268 21184 log.cc:927] Time spent T 309c3ca0ca4b4f3ba129752ea2cb293b P 127766fc592545a4997f7790f50f6076: Append to log took a long time: real 0.086s	user 0.000s	sys 0.001s
I20260709 13:04:55.039515 21132 consensus_queue.cc:1059] T ef32ce6fdd0e40d382c79974f30295c6 P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.055s
I20260709 13:04:55.115065 19486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1b10566f45d4a7d9029858330e02d5b" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:04:55.090503 19480 raft_consensus.cc:1240] T 9962423cb4e54fcfa5de01daf68a86e7 P 0473d2b2d01f4459b1e90fd12cc7840e [term 5 FOLLOWER]: Rejecting Update request from peer 127766fc592545a4997f7790f50f6076 for earlier term 4. Current term is 5. Ops: []
I20260709 13:04:55.093804 20998 raft_consensus.cc:493] T 0afb57ae58a24a01850491d69f0213dd P 127766fc592545a4997f7790f50f6076 [term 1 FOLLOWER]: Starting leader election (detected failure of leader e61c3a8f61bb48f8a963c9480e53c168)
I20260709 13:04:55.079706 20853 raft_consensus.cc:1081] T 309c3ca0ca4b4f3ba129752ea2cb293b P e61c3a8f61bb48f8a963c9480e53c168 [term 3 LEADER]: Signalling peer e5256d91808b47c195bc9b4dbd7f2b87 to start an election
I20260709 13:04:55.099385 21126 raft_consensus.cc:2749] T 0e1085d23e8347fbbd5bce7542f4b1f4 P 0473d2b2d01f4459b1e90fd12cc7840e [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:04:55.070520 19552 raft_consensus.cc:1240] T df751f992649444090e27965eb1af85d P e61c3a8f61bb48f8a963c9480e53c168 [term 3 FOLLOWER]: Rejecting Update request from peer e5256d91808b47c195bc9b4dbd7f2b87 for earlier term 2. Current term is 3. Ops: []
I20260709 13:04:55.072861 19551 raft_consensus.cc:2468] T 1efebf73c86e432baa55533136b6e12c P e61c3a8f61bb48f8a963c9480e53c168 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 127766fc592545a4997f7790f50f6076 in term 5.
I20260709 13:04:55.128283 20076 leader_election.cc:304] T 65d8cb8d6ec64f459d5a47cefab10acf P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 127766fc592545a4997f7790f50f6076; no voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:04:55.131563 19484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df751f992649444090e27965eb1af85d" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:04:55.114180 21011 raft_consensus.cc:493] T 40e1e16737a842ee936002830f36882e P e61c3a8f61bb48f8a963c9480e53c168 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader e5256d91808b47c195bc9b4dbd7f2b87)
I20260709 13:04:55.133507 19486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21e14947d70440f19044d8f75c31e1f9" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:04:55.117897 20819 raft_consensus.cc:740] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P e5256d91808b47c195bc9b4dbd7f2b87 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: e5256d91808b47c195bc9b4dbd7f2b87, State: Running, Role: LEADER
I20260709 13:04:55.141997 19410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21e14947d70440f19044d8f75c31e1f9" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
I20260709 13:04:55.099850 21174 raft_consensus.cc:515] T f93ee515a9c14139bf566522ed8232f3 P e61c3a8f61bb48f8a963c9480e53c168 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:55.119305 20945 raft_consensus.cc:515] T 46c5bfeecc314717bffe987e6844b6d0 P 0473d2b2d01f4459b1e90fd12cc7840e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:55.143101 19409 raft_consensus.cc:1275] T ece3db938bc649d4a40a51522ed5259c P e5256d91808b47c195bc9b4dbd7f2b87 [term 4 FOLLOWER]: Refusing update from remote peer e61c3a8f61bb48f8a963c9480e53c168: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
I20260709 13:04:55.151324 19484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a61655d99124a29b486ba4a5b37faea" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:04:55.134429 20998 raft_consensus.cc:3060] T 0afb57ae58a24a01850491d69f0213dd P 127766fc592545a4997f7790f50f6076 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:55.154435 19484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b74109013a140ada21feeef92d6f563" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:04:55.127764 21111 raft_consensus.cc:493] T 85c494af21f9457a85da47b9bc70c1fd P e61c3a8f61bb48f8a963c9480e53c168 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e5256d91808b47c195bc9b4dbd7f2b87)
I20260709 13:04:55.116611 21079 raft_consensus.cc:515] T 2725d2c4cb054f18b0fc8f735c15f6c2 P e61c3a8f61bb48f8a963c9480e53c168 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:55.114534 20785 raft_consensus.cc:515] T 70797e5783b5454ab0d0eea663e791e3 P 127766fc592545a4997f7790f50f6076 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:04:55.118173 21125 raft_consensus.cc:515] T f93ee515a9c14139bf566522ed8232f3 P 0473d2b2d01f4459b1e90fd12cc7840e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:55.152386 20076 leader_election.cc:304] T 1efebf73c86e432baa55533136b6e12c P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 127766fc592545a4997f7790f50f6076, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:04:55.150096 21137 consensus_queue.cc:1059] T 86a6797bdfe94fa496c050ceae4bd0d9 P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.048s
I20260709 13:04:55.214103 21125 leader_election.cc:290] T f93ee515a9c14139bf566522ed8232f3 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:04:55.202702 19559 raft_consensus.cc:1240] T b9f0d59553ad444883fcf5b5909f9798 P e61c3a8f61bb48f8a963c9480e53c168 [term 2 FOLLOWER]: Rejecting Update request from peer 0473d2b2d01f4459b1e90fd12cc7840e for earlier term 1. Current term is 2. Ops: []
I20260709 13:04:55.191231 19560 raft_consensus.cc:1240] T f1b10566f45d4a7d9029858330e02d5b P e61c3a8f61bb48f8a963c9480e53c168 [term 4 FOLLOWER]: Rejecting Update request from peer e5256d91808b47c195bc9b4dbd7f2b87 for earlier term 3. Current term is 4. Ops: []
I20260709 13:04:55.217007 19560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46c5bfeecc314717bffe987e6844b6d0" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 6 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:04:55.218818 19479 raft_consensus.cc:1275] T 28af091831594f9d8e96482078cc7625 P 0473d2b2d01f4459b1e90fd12cc7840e [term 4 FOLLOWER]: Refusing update from remote peer e61c3a8f61bb48f8a963c9480e53c168: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 2. (term mismatch)
I20260709 13:04:55.219231 19479 pending_rounds.cc:85] T 28af091831594f9d8e96482078cc7625 P 0473d2b2d01f4459b1e90fd12cc7840e: Aborting all ops after (but not including) 1
I20260709 13:04:55.219631 19479 pending_rounds.cc:107] T 28af091831594f9d8e96482078cc7625 P 0473d2b2d01f4459b1e90fd12cc7840e: Aborting uncommitted NO_OP operation due to leader change: 3.2
I20260709 13:04:55.219484 19407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2725d2c4cb054f18b0fc8f735c15f6c2" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:04:55.219890 19479 raft_consensus.cc:2889] T 28af091831594f9d8e96482078cc7625 P 0473d2b2d01f4459b1e90fd12cc7840e [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:04:55.220245 19559 raft_consensus.cc:1240] T b08304a0a02b42d7840c4e8ee9a6bd1a P e61c3a8f61bb48f8a963c9480e53c168 [term 3 FOLLOWER]: Rejecting Update request from peer e5256d91808b47c195bc9b4dbd7f2b87 for earlier term 2. Current term is 3. Ops: []
W20260709 13:04:55.183404 21186 log.cc:927] Time spent T 22196caba61445d3bec98a0aab3c337d P 0473d2b2d01f4459b1e90fd12cc7840e: Append to log took a long time: real 0.050s	user 0.000s	sys 0.000s
I20260709 13:04:55.230931 19485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76cb037fc9064d13b59a8969d897ce8c" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:04:55.156785 21084 raft_consensus.cc:2749] T df751f992649444090e27965eb1af85d P 0473d2b2d01f4459b1e90fd12cc7840e [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:04:55.182749 19402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1b10566f45d4a7d9029858330e02d5b" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
I20260709 13:04:55.199229 19404 raft_consensus.cc:1275] T 28af091831594f9d8e96482078cc7625 P e5256d91808b47c195bc9b4dbd7f2b87 [term 4 FOLLOWER]: Refusing update from remote peer e61c3a8f61bb48f8a963c9480e53c168: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 2. (index mismatch)
I20260709 13:04:55.229913 20754 consensus_queue.cc:1059] T f1b10566f45d4a7d9029858330e02d5b P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.005s
I20260709 13:04:55.211802 20853 raft_consensus.cc:493] T a08760e15aac4630a629431f56024dc8 P e61c3a8f61bb48f8a963c9480e53c168 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader e5256d91808b47c195bc9b4dbd7f2b87)
I20260709 13:04:55.235733 19484 raft_consensus.cc:3055] T 86a6797bdfe94fa496c050ceae4bd0d9 P 0473d2b2d01f4459b1e90fd12cc7840e [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:04:55.179560 20728 raft_consensus.cc:493] T 7f575b143b844aa096b50997dad3516a P e61c3a8f61bb48f8a963c9480e53c168 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e5256d91808b47c195bc9b4dbd7f2b87)
I20260709 13:04:55.236372 20996 consensus_queue.cc:1059] T b08304a0a02b42d7840c4e8ee9a6bd1a P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:04:55.147178 21011 raft_consensus.cc:515] T 40e1e16737a842ee936002830f36882e P e61c3a8f61bb48f8a963c9480e53c168 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:55.193027 21061 raft_consensus.cc:493] T 1dc5b3532fe54f74876d02beffa2c230 P e61c3a8f61bb48f8a963c9480e53c168 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader e5256d91808b47c195bc9b4dbd7f2b87)
I20260709 13:04:55.244088 20853 raft_consensus.cc:515] T a08760e15aac4630a629431f56024dc8 P e61c3a8f61bb48f8a963c9480e53c168 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:55.183179 21111 raft_consensus.cc:515] T 85c494af21f9457a85da47b9bc70c1fd P e61c3a8f61bb48f8a963c9480e53c168 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:04:55.262423 19556 raft_consensus.cc:3060] T 2b74109013a140ada21feeef92d6f563 P e61c3a8f61bb48f8a963c9480e53c168 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:55.240839 19484 raft_consensus.cc:740] T 86a6797bdfe94fa496c050ceae4bd0d9 P 0473d2b2d01f4459b1e90fd12cc7840e [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 0473d2b2d01f4459b1e90fd12cc7840e, State: Running, Role: LEADER
I20260709 13:04:55.178826 20910 raft_consensus.cc:2749] T 65d8cb8d6ec64f459d5a47cefab10acf P 127766fc592545a4997f7790f50f6076 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:04:55.240911 20076 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.3:36891, user_credentials={real_user=slave}} blocked reactor thread for 88625.8us
I20260709 13:04:55.185281 21079 leader_election.cc:290] T 2725d2c4cb054f18b0fc8f735c15f6c2 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:04:55.245404 21110 raft_consensus.cc:2804] T 1efebf73c86e432baa55533136b6e12c P 127766fc592545a4997f7790f50f6076 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:04:55.206157 21140 consensus_queue.cc:260] T 7be9efa6559648dbb5a0f7684c4542d1 P 0473d2b2d01f4459b1e90fd12cc7840e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:55.279428 19484 consensus_queue.cc:260] T 86a6797bdfe94fa496c050ceae4bd0d9 P 0473d2b2d01f4459b1e90fd12cc7840e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:55.280040 21174 leader_election.cc:290] T f93ee515a9c14139bf566522ed8232f3 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:04:55.280233 19554 raft_consensus.cc:2468] T d1e5873a19244c5ebbcd38e126796ee7 P e61c3a8f61bb48f8a963c9480e53c168 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 3.
I20260709 13:04:55.281217 19558 raft_consensus.cc:1240] T d1e5873a19244c5ebbcd38e126796ee7 P e61c3a8f61bb48f8a963c9480e53c168 [term 3 FOLLOWER]: Rejecting Update request from peer e5256d91808b47c195bc9b4dbd7f2b87 for earlier term 2. Current term is 3. Ops: []
I20260709 13:04:55.264405 20853 leader_election.cc:290] T a08760e15aac4630a629431f56024dc8 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:04:55.283262 19552 raft_consensus.cc:1275] T f93ee515a9c14139bf566522ed8232f3 P e61c3a8f61bb48f8a963c9480e53c168 [term 4 FOLLOWER]: Refusing update from remote peer e5256d91808b47c195bc9b4dbd7f2b87: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 2. (index mismatch)
I20260709 13:04:55.288466 21111 leader_election.cc:290] T 85c494af21f9457a85da47b9bc70c1fd P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:04:55.290570 20945 leader_election.cc:290] T 46c5bfeecc314717bffe987e6844b6d0 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:04:55.291934 19482 raft_consensus.cc:1240] T 62c6c134d3d24a1ab144dd9ee6bc3f64 P 0473d2b2d01f4459b1e90fd12cc7840e [term 4 FOLLOWER]: Rejecting Update request from peer 127766fc592545a4997f7790f50f6076 for earlier term 3. Current term is 4. Ops: []
W20260709 13:04:55.259232 19377 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.2:46257, user_credentials={real_user=slave}} blocked reactor thread for 303889us
W20260709 13:04:55.237619 19374 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.4:43121, user_credentials={real_user=slave}} blocked reactor thread for 271974us
I20260709 13:04:55.254714 20996 raft_consensus.cc:3055] T b08304a0a02b42d7840c4e8ee9a6bd1a P e5256d91808b47c195bc9b4dbd7f2b87 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:04:55.210642 21044 consensus_queue.cc:1059] T df751f992649444090e27965eb1af85d P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.034s
I20260709 13:04:55.260345 21191 raft_consensus.cc:493] T fa731b585f684a7fb2d106c50f143b83 P 127766fc592545a4997f7790f50f6076 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:55.303855 21191 raft_consensus.cc:515] T fa731b585f684a7fb2d106c50f143b83 P 127766fc592545a4997f7790f50f6076 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:04:55.305986 21191 leader_election.cc:290] T fa731b585f684a7fb2d106c50f143b83 P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:04:55.307230 21167 raft_consensus.cc:3055] T df751f992649444090e27965eb1af85d P e5256d91808b47c195bc9b4dbd7f2b87 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:04:55.307610 21167 raft_consensus.cc:740] T df751f992649444090e27965eb1af85d P e5256d91808b47c195bc9b4dbd7f2b87 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: e5256d91808b47c195bc9b4dbd7f2b87, State: Running, Role: LEADER
I20260709 13:04:55.307739 21132 raft_consensus.cc:3055] T ef32ce6fdd0e40d382c79974f30295c6 P 0473d2b2d01f4459b1e90fd12cc7840e [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:04:55.307999 20075 leader_election.cc:304] T 833a2f0775ed407a94b8924ce50adb63 P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 127766fc592545a4997f7790f50f6076; no voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:04:55.308311 21132 raft_consensus.cc:740] T ef32ce6fdd0e40d382c79974f30295c6 P 0473d2b2d01f4459b1e90fd12cc7840e [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 0473d2b2d01f4459b1e90fd12cc7840e, State: Running, Role: LEADER
I20260709 13:04:55.309432 20754 raft_consensus.cc:1064] T ab43d85f64114d4ebf618930e43d9ed0 P e5256d91808b47c195bc9b4dbd7f2b87: attempting to promote NON_VOTER 127766fc592545a4997f7790f50f6076 to VOTER
W20260709 13:04:55.309859 20754 raft_consensus.cc:1068] T ab43d85f64114d4ebf618930e43d9ed0 P e5256d91808b47c195bc9b4dbd7f2b87: Unable to promote non-voter 127766fc592545a4997f7790f50f6076: Illegal state: Leader has not yet committed an operation in its own term
I20260709 13:04:55.309556 21132 consensus_queue.cc:260] T ef32ce6fdd0e40d382c79974f30295c6 P 0473d2b2d01f4459b1e90fd12cc7840e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:55.308425 21167 consensus_queue.cc:260] T df751f992649444090e27965eb1af85d P e5256d91808b47c195bc9b4dbd7f2b87 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:55.312083 21167 raft_consensus.cc:3060] T df751f992649444090e27965eb1af85d P e5256d91808b47c195bc9b4dbd7f2b87 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:04:55.313900 21043 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.StartTabletCopy from 127.0.0.1:46436 (request call id 298) took 3986 ms. Trace:
I20260709 13:04:55.316052 21011 leader_election.cc:290] T 40e1e16737a842ee936002830f36882e P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:04:55.299356 20996 raft_consensus.cc:740] T b08304a0a02b42d7840c4e8ee9a6bd1a P e5256d91808b47c195bc9b4dbd7f2b87 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: e5256d91808b47c195bc9b4dbd7f2b87, State: Running, Role: LEADER
I20260709 13:04:55.317955 21190 raft_consensus.cc:2749] T 833a2f0775ed407a94b8924ce50adb63 P 127766fc592545a4997f7790f50f6076 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:04:55.317687 20996 consensus_queue.cc:260] T b08304a0a02b42d7840c4e8ee9a6bd1a P e5256d91808b47c195bc9b4dbd7f2b87 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:55.306571 19557 raft_consensus.cc:1275] T bc225c93219c45538b53a1bd3d387e4d P e61c3a8f61bb48f8a963c9480e53c168 [term 4 FOLLOWER]: Refusing update from remote peer e5256d91808b47c195bc9b4dbd7f2b87: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 2. (index mismatch)
I20260709 13:04:55.318925 21190 consensus_queue.cc:1048] T 9962423cb4e54fcfa5de01daf68a86e7 P 127766fc592545a4997f7790f50f6076 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.008s
I20260709 13:04:55.244982 20728 raft_consensus.cc:515] T 7f575b143b844aa096b50997dad3516a P e61c3a8f61bb48f8a963c9480e53c168 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:55.319548 19483 raft_consensus.cc:2955] T 309c3ca0ca4b4f3ba129752ea2cb293b P 0473d2b2d01f4459b1e90fd12cc7840e [term 3 FOLLOWER]: Committing config change with OpId 3.5: config changed from index 3 to 5, 127766fc592545a4997f7790f50f6076 (127.17.223.4) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } attrs { replace: true } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } } }
I20260709 13:04:55.251029 21061 raft_consensus.cc:515] T 1dc5b3532fe54f74876d02beffa2c230 P e61c3a8f61bb48f8a963c9480e53c168 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:55.303443 19556 raft_consensus.cc:1275] T 2b74109013a140ada21feeef92d6f563 P e61c3a8f61bb48f8a963c9480e53c168 [term 2 FOLLOWER]: Refusing update from remote peer 0473d2b2d01f4459b1e90fd12cc7840e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:55.332279 19407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa731b585f684a7fb2d106c50f143b83" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
W20260709 13:04:55.329607 19449 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.1:40321, user_credentials={real_user=slave}} blocked reactor thread for 240042us
I20260709 13:04:55.278362 21079 raft_consensus.cc:493] T 833a2f0775ed407a94b8924ce50adb63 P e61c3a8f61bb48f8a963c9480e53c168 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader e5256d91808b47c195bc9b4dbd7f2b87)
I20260709 13:04:55.318938 20996 raft_consensus.cc:3060] T b08304a0a02b42d7840c4e8ee9a6bd1a P e5256d91808b47c195bc9b4dbd7f2b87 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:04:55.338549 19409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70797e5783b5454ab0d0eea663e791e3" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
W20260709 13:04:55.338904 19450 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.3:36891, user_credentials={real_user=slave}} blocked reactor thread for 331417us
I20260709 13:04:55.342258 19450 leader_election.cc:304] T 22196caba61445d3bec98a0aab3c337d P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e; no voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:04:55.343696 19450 leader_election.cc:304] T 40e1e16737a842ee936002830f36882e P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e; no voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:04:55.333091 21140 raft_consensus.cc:3060] T 7be9efa6559648dbb5a0f7684c4542d1 P 0473d2b2d01f4459b1e90fd12cc7840e [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:04:55.356813 19523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.4:43121, user_credentials={real_user=slave}} blocked reactor thread for 153896us
I20260709 13:04:55.360970 19450 leader_election.cc:304] T 0afb57ae58a24a01850491d69f0213dd P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e; no voters: 127766fc592545a4997f7790f50f6076, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:04:55.362174 19450 leader_election.cc:304] T 217b5fae677b4971b3bbd2f357a1f7ff P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e; no voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:04:55.345252 21105 raft_consensus.cc:2749] T 22196caba61445d3bec98a0aab3c337d P 0473d2b2d01f4459b1e90fd12cc7840e [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:04:55.351022 21191 raft_consensus.cc:493] T ece3db938bc649d4a40a51522ed5259c P 127766fc592545a4997f7790f50f6076 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:55.375993 19556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa731b585f684a7fb2d106c50f143b83" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:04:55.378525 19556 raft_consensus.cc:2468] T fa731b585f684a7fb2d106c50f143b83 P e61c3a8f61bb48f8a963c9480e53c168 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 127766fc592545a4997f7790f50f6076 in term 3.
I20260709 13:04:55.356271 21192 raft_consensus.cc:493] T 3e1f505cb0f1427bbd698ac889d80821 P e5256d91808b47c195bc9b4dbd7f2b87 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:55.376965 20109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85c494af21f9457a85da47b9bc70c1fd" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:04:55.329181 21194 consensus_queue.cc:1048] T f93ee515a9c14139bf566522ed8232f3 P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.056s
I20260709 13:04:55.359552 21132 raft_consensus.cc:3060] T ef32ce6fdd0e40d382c79974f30295c6 P 0473d2b2d01f4459b1e90fd12cc7840e [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:04:55.385660 21191 raft_consensus.cc:515] T ece3db938bc649d4a40a51522ed5259c P 127766fc592545a4997f7790f50f6076 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:04:55.377460 21201 raft_consensus.cc:2749] T 40e1e16737a842ee936002830f36882e P 0473d2b2d01f4459b1e90fd12cc7840e [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:04:55.386993 21088 raft_consensus.cc:2749] T 217b5fae677b4971b3bbd2f357a1f7ff P 0473d2b2d01f4459b1e90fd12cc7840e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:04:55.387660 19450 leader_election.cc:304] T 2725d2c4cb054f18b0fc8f735c15f6c2 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e; no voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:04:55.416239 21206 consensus_queue.cc:1048] T 28af091831594f9d8e96482078cc7625 P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:04:55.417218 19450 leader_election.cc:304] T 179fd671030940b4b4a4e24bcc4aba0a P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e; no voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:04:55.417948 21105 raft_consensus.cc:2749] T 2725d2c4cb054f18b0fc8f735c15f6c2 P 0473d2b2d01f4459b1e90fd12cc7840e [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:04:55.418648 21105 raft_consensus.cc:2749] T 179fd671030940b4b4a4e24bcc4aba0a P 0473d2b2d01f4459b1e90fd12cc7840e [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:04:55.419129 19450 leader_election.cc:304] T 0cdf56e38bbc453d9438d359e5a69955 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e; no voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:04:55.419239 21105 consensus_queue.cc:1059] T 14935b3ddf914369822e4a0547aaa355 P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 }, Status: INVALID_TERM, Last received: 1.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:04:55.420070 21105 raft_consensus.cc:2749] T 0cdf56e38bbc453d9438d359e5a69955 P 0473d2b2d01f4459b1e90fd12cc7840e [term 4 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:04:55.420246 19450 leader_election.cc:304] T 309c3ca0ca4b4f3ba129752ea2cb293b P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e; no voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:04:55.420644 21105 raft_consensus.cc:3055] T 14935b3ddf914369822e4a0547aaa355 P 0473d2b2d01f4459b1e90fd12cc7840e [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:04:55.420984 21105 raft_consensus.cc:740] T 14935b3ddf914369822e4a0547aaa355 P 0473d2b2d01f4459b1e90fd12cc7840e [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0473d2b2d01f4459b1e90fd12cc7840e, State: Running, Role: LEADER
I20260709 13:04:55.421150 21137 raft_consensus.cc:2749] T 309c3ca0ca4b4f3ba129752ea2cb293b P 0473d2b2d01f4459b1e90fd12cc7840e [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:04:55.422253 19450 leader_election.cc:304] T 48824d5acfbc485ebf8c2d944e7202de P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e; no voters: 127766fc592545a4997f7790f50f6076, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:04:55.423014 21200 raft_consensus.cc:2749] T 48824d5acfbc485ebf8c2d944e7202de P 0473d2b2d01f4459b1e90fd12cc7840e [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:04:55.380553 21084 raft_consensus.cc:2749] T 0afb57ae58a24a01850491d69f0213dd P 0473d2b2d01f4459b1e90fd12cc7840e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:04:55.387844 19553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7be9efa6559648dbb5a0f7684c4542d1" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:04:55.388585 21111 consensus_queue.cc:1048] T ece3db938bc649d4a40a51522ed5259c P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:04:55.394366 19526 leader_election.cc:304] T 14935b3ddf914369822e4a0547aaa355 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e61c3a8f61bb48f8a963c9480e53c168; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:04:55.359063 21079 raft_consensus.cc:515] T 833a2f0775ed407a94b8924ce50adb63 P e61c3a8f61bb48f8a963c9480e53c168 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:04:55.384294 19557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70797e5783b5454ab0d0eea663e791e3" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:04:55.397679 21202 raft_consensus.cc:493] T fa731b585f684a7fb2d106c50f143b83 P e61c3a8f61bb48f8a963c9480e53c168 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:55.399451 19409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4509b76741dc428e9201c70c1658da13" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:04:55.399906 20776 raft_consensus.cc:3055] T f1b10566f45d4a7d9029858330e02d5b P e5256d91808b47c195bc9b4dbd7f2b87 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:04:55.314297 21043 rpcz_store.cc:276] 0709 13:04:51.327951 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:51.328086 (+   135us) service_pool.cc:224] Handling call
0709 13:04:51.513034 (+184948us) ts_tablet_manager.cc:934] T 14935b3ddf914369822e4a0547aaa355 P 127766fc592545a4997f7790f50f6076: Initiating tablet copy from peer 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
0709 13:04:54.737025 (+3223991us) tablet_copy_client.cc:368] Tablet copy session begun
0709 13:04:55.233823 (+496798us) tablet_metadata.cc:665] Metadata flushed
0709 13:04:55.237964 (+  4141us) tablet_copy_client.cc:497] Wrote new tablet metadata
0709 13:04:55.313099 (+ 75135us) tablet_copy_client.cc:418] Wrote new consensus metadata
0709 13:04:55.313372 (+   273us) tablet_replica.cc:206] Creating consensus instance
0709 13:04:55.313678 (+   306us) ts_tablet_manager.cc:989] Replica registered.
0709 13:04:55.313790 (+   112us) inbound_call.cc:177] Queueing success response
Metrics: {"dns_us":932,"tablet-copy.queue_time_us":184106,"thread_start_us":504868,"threads_started":2}
I20260709 13:04:55.401674 19404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a08760e15aac4630a629431f56024dc8" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:04:55.447458 20776 raft_consensus.cc:740] T f1b10566f45d4a7d9029858330e02d5b P e5256d91808b47c195bc9b4dbd7f2b87 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: e5256d91808b47c195bc9b4dbd7f2b87, State: Running, Role: LEADER
I20260709 13:04:55.450623 19409 raft_consensus.cc:1240] T 7be9efa6559648dbb5a0f7684c4542d1 P e5256d91808b47c195bc9b4dbd7f2b87 [term 4 FOLLOWER]: Rejecting Update request from peer 0473d2b2d01f4459b1e90fd12cc7840e for earlier term 3. Current term is 4. Ops: []
I20260709 13:04:55.451107 21043 tablet_copy_client.cc:806] T 14935b3ddf914369822e4a0547aaa355 P 127766fc592545a4997f7790f50f6076: tablet copy: Starting download of 0 data blocks...
I20260709 13:04:55.455513 21043 tablet_copy_client.cc:670] T 14935b3ddf914369822e4a0547aaa355 P 127766fc592545a4997f7790f50f6076: tablet copy: Starting download of 1 WAL segments...
I20260709 13:04:55.439018 21137 consensus_queue.cc:1059] T 76cb037fc9064d13b59a8969d897ce8c P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.017s
I20260709 13:04:55.457702 21202 raft_consensus.cc:515] T fa731b585f684a7fb2d106c50f143b83 P e61c3a8f61bb48f8a963c9480e53c168 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:04:55.453595 20776 consensus_queue.cc:260] T f1b10566f45d4a7d9029858330e02d5b P e5256d91808b47c195bc9b4dbd7f2b87 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:55.459741 20776 raft_consensus.cc:3060] T f1b10566f45d4a7d9029858330e02d5b P e5256d91808b47c195bc9b4dbd7f2b87 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:04:55.460695 21202 leader_election.cc:290] T fa731b585f684a7fb2d106c50f143b83 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:04:55.438884 21200 consensus_queue.cc:1059] T ff75a1d4cb1f493db8f71ddc136ba9ab P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.023s
I20260709 13:04:55.402901 19484 raft_consensus.cc:3060] T 86a6797bdfe94fa496c050ceae4bd0d9 P 0473d2b2d01f4459b1e90fd12cc7840e [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:04:55.402987 21165 raft_consensus.cc:515] T 309c3ca0ca4b4f3ba129752ea2cb293b P e5256d91808b47c195bc9b4dbd7f2b87 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } attrs { replace: true } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:04:55.462888 21200 raft_consensus.cc:3055] T ff75a1d4cb1f493db8f71ddc136ba9ab P 0473d2b2d01f4459b1e90fd12cc7840e [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:04:55.463236 21200 raft_consensus.cc:740] T ff75a1d4cb1f493db8f71ddc136ba9ab P 0473d2b2d01f4459b1e90fd12cc7840e [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 0473d2b2d01f4459b1e90fd12cc7840e, State: Running, Role: LEADER
I20260709 13:04:55.464078 21200 consensus_queue.cc:260] T ff75a1d4cb1f493db8f71ddc136ba9ab P 0473d2b2d01f4459b1e90fd12cc7840e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:55.465036 21165 leader_election.cc:290] T 309c3ca0ca4b4f3ba129752ea2cb293b P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 4 election: Requested vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:04:55.465250 21200 raft_consensus.cc:3060] T ff75a1d4cb1f493db8f71ddc136ba9ab P 0473d2b2d01f4459b1e90fd12cc7840e [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:04:55.404580 19410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36f6ba92b9ba46babe4ebd6c02e5fbd9" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
I20260709 13:04:55.404734 21061 leader_election.cc:290] T 1dc5b3532fe54f74876d02beffa2c230 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:04:55.443518 21115 raft_consensus.cc:2749] T 14935b3ddf914369822e4a0547aaa355 P e61c3a8f61bb48f8a963c9480e53c168 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:04:55.468034 19553 raft_consensus.cc:2393] T 7be9efa6559648dbb5a0f7684c4542d1 P e61c3a8f61bb48f8a963c9480e53c168 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate e5256d91808b47c195bc9b4dbd7f2b87 in current term 4: Already voted for candidate e61c3a8f61bb48f8a963c9480e53c168 in this term.
I20260709 13:04:55.469964 21191 leader_election.cc:290] T ece3db938bc649d4a40a51522ed5259c P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:04:55.469635 19306 catalog_manager.cc:5697] T e381f1d6b8184797ad142de49be225a8 P 0473d2b2d01f4459b1e90fd12cc7840e reported cstate change: term changed from 2 to 3, leader changed from e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1) to 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2). New cstate: current_term: 3 leader_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:55.472087 19306 catalog_manager.cc:5697] T 21e14947d70440f19044d8f75c31e1f9 P 0473d2b2d01f4459b1e90fd12cc7840e reported cstate change: term changed from 1 to 2, leader changed from e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3) to e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1). New cstate: current_term: 2 leader_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } }
I20260709 13:04:55.411896 19407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b08304a0a02b42d7840c4e8ee9a6bd1a" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:04:55.413461 19405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9962423cb4e54fcfa5de01daf68a86e7" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
I20260709 13:04:55.415567 19408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e5873a19244c5ebbcd38e126796ee7" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
I20260709 13:04:55.475386 19405 raft_consensus.cc:3060] T 9962423cb4e54fcfa5de01daf68a86e7 P e5256d91808b47c195bc9b4dbd7f2b87 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:04:55.475651 19408 raft_consensus.cc:3055] T d1e5873a19244c5ebbcd38e126796ee7 P e5256d91808b47c195bc9b4dbd7f2b87 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:04:55.476055 19408 raft_consensus.cc:740] T d1e5873a19244c5ebbcd38e126796ee7 P e5256d91808b47c195bc9b4dbd7f2b87 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: e5256d91808b47c195bc9b4dbd7f2b87, State: Running, Role: LEADER
I20260709 13:04:55.476944 20728 leader_election.cc:290] T 7f575b143b844aa096b50997dad3516a P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:04:55.476790 19408 consensus_queue.cc:260] T d1e5873a19244c5ebbcd38e126796ee7 P e5256d91808b47c195bc9b4dbd7f2b87 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:55.477667 19408 raft_consensus.cc:3060] T d1e5873a19244c5ebbcd38e126796ee7 P e5256d91808b47c195bc9b4dbd7f2b87 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:04:55.477849 21131 consensus_queue.cc:1059] T b9f0d59553ad444883fcf5b5909f9798 P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:04:55.380687 19451 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:55.479507 21137 raft_consensus.cc:3055] T b9f0d59553ad444883fcf5b5909f9798 P 0473d2b2d01f4459b1e90fd12cc7840e [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:04:55.479969 21137 raft_consensus.cc:740] T b9f0d59553ad444883fcf5b5909f9798 P 0473d2b2d01f4459b1e90fd12cc7840e [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0473d2b2d01f4459b1e90fd12cc7840e, State: Running, Role: LEADER
I20260709 13:04:55.480836 21137 consensus_queue.cc:260] T b9f0d59553ad444883fcf5b5909f9798 P 0473d2b2d01f4459b1e90fd12cc7840e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:55.482831 21201 raft_consensus.cc:3055] T 76cb037fc9064d13b59a8969d897ce8c P 0473d2b2d01f4459b1e90fd12cc7840e [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:04:55.483125 21193 raft_consensus.cc:493] T ef32ce6fdd0e40d382c79974f30295c6 P e5256d91808b47c195bc9b4dbd7f2b87 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 0473d2b2d01f4459b1e90fd12cc7840e)
I20260709 13:04:55.483213 21201 raft_consensus.cc:740] T 76cb037fc9064d13b59a8969d897ce8c P 0473d2b2d01f4459b1e90fd12cc7840e [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 0473d2b2d01f4459b1e90fd12cc7840e, State: Running, Role: LEADER
I20260709 13:04:55.483747 21193 raft_consensus.cc:515] T ef32ce6fdd0e40d382c79974f30295c6 P e5256d91808b47c195bc9b4dbd7f2b87 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:55.484153 21201 consensus_queue.cc:260] T 76cb037fc9064d13b59a8969d897ce8c P 0473d2b2d01f4459b1e90fd12cc7840e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:55.484822 19408 raft_consensus.cc:2468] T d1e5873a19244c5ebbcd38e126796ee7 P e5256d91808b47c195bc9b4dbd7f2b87 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 3.
W20260709 13:04:55.441979 19526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.2:46257, user_credentials={real_user=slave}} blocked reactor thread for 47702.8us
I20260709 13:04:55.486002 21193 leader_election.cc:290] T ef32ce6fdd0e40d382c79974f30295c6 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:04:55.486233 19526 leader_election.cc:304] T 22196caba61445d3bec98a0aab3c337d P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168; no voters: e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:04:55.486893 19484 raft_consensus.cc:1275] T 86a6797bdfe94fa496c050ceae4bd0d9 P 0473d2b2d01f4459b1e90fd12cc7840e [term 4 FOLLOWER]: Refusing update from remote peer e61c3a8f61bb48f8a963c9480e53c168: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 2. (term mismatch)
I20260709 13:04:55.394923 20867 consensus_queue.cc:1048] T bc225c93219c45538b53a1bd3d387e4d P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.047s
I20260709 13:04:55.434749 21169 raft_consensus.cc:493] T 775c229504194560ba9589bc2199b089 P 127766fc592545a4997f7790f50f6076 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:55.494153 21169 raft_consensus.cc:515] T 775c229504194560ba9589bc2199b089 P 127766fc592545a4997f7790f50f6076 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:04:55.421599 20998 raft_consensus.cc:515] T 0afb57ae58a24a01850491d69f0213dd P 127766fc592545a4997f7790f50f6076 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:04:55.497232 21169 leader_election.cc:290] T 775c229504194560ba9589bc2199b089 P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:04:55.497394 20998 leader_election.cc:290] T 0afb57ae58a24a01850491d69f0213dd P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 2 election: Requested vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:04:55.409192 20819 consensus_queue.cc:260] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P e5256d91808b47c195bc9b4dbd7f2b87 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:04:55.498147 20104 raft_consensus.cc:1240] T 0afb57ae58a24a01850491d69f0213dd P 127766fc592545a4997f7790f50f6076 [term 2 FOLLOWER]: Rejecting Update request from peer e61c3a8f61bb48f8a963c9480e53c168 for earlier term 1. Current term is 2. Ops: []
I20260709 13:04:55.498584 20819 raft_consensus.cc:3060] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P e5256d91808b47c195bc9b4dbd7f2b87 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:04:55.500141 19407 raft_consensus.cc:2468] T b08304a0a02b42d7840c4e8ee9a6bd1a P e5256d91808b47c195bc9b4dbd7f2b87 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 3.
I20260709 13:04:55.500866 21105 consensus_queue.cc:260] T 14935b3ddf914369822e4a0547aaa355 P 0473d2b2d01f4459b1e90fd12cc7840e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } attrs { replace: true } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: NON_VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: true } }
I20260709 13:04:55.362190 20785 leader_election.cc:290] T 70797e5783b5454ab0d0eea663e791e3 P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:04:55.398955 21192 raft_consensus.cc:515] T 3e1f505cb0f1427bbd698ac889d80821 P e5256d91808b47c195bc9b4dbd7f2b87 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:55.502775 21105 raft_consensus.cc:3060] T 14935b3ddf914369822e4a0547aaa355 P 0473d2b2d01f4459b1e90fd12cc7840e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:55.504331 21192 leader_election.cc:290] T 3e1f505cb0f1427bbd698ac889d80821 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:04:55.396567 19556 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "309c3ca0ca4b4f3ba129752ea2cb293b"
dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:40412
I20260709 13:04:55.505084 19556 raft_consensus.cc:606] T 309c3ca0ca4b4f3ba129752ea2cb293b P e61c3a8f61bb48f8a963c9480e53c168 [term 3 LEADER]: Received request to transfer leadership
I20260709 13:04:55.488716 19526 leader_election.cc:304] T e381f1d6b8184797ad142de49be225a8 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e61c3a8f61bb48f8a963c9480e53c168; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:04:55.507505 19526 leader_election.cc:304] T ab43d85f64114d4ebf618930e43d9ed0 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168; no voters: e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:04:55.508884 19526 leader_election.cc:304] T b9f0d59553ad444883fcf5b5909f9798 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e61c3a8f61bb48f8a963c9480e53c168; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:04:55.511081 19526 leader_election.cc:304] T 96efeaaf1057492490e9a621f37e1a2d P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168; no voters: 127766fc592545a4997f7790f50f6076
I20260709 13:04:55.491192 20728 raft_consensus.cc:2804] T 22196caba61445d3bec98a0aab3c337d P e61c3a8f61bb48f8a963c9480e53c168 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:04:55.479758 19306 catalog_manager.cc:5697] T df751f992649444090e27965eb1af85d P 0473d2b2d01f4459b1e90fd12cc7840e reported cstate change: term changed from 1 to 2, leader changed from e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3) to e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1). New cstate: current_term: 2 leader_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } }
I20260709 13:04:55.492391 21079 leader_election.cc:290] T 833a2f0775ed407a94b8924ce50adb63 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:04:55.492650 19405 raft_consensus.cc:2468] T 9962423cb4e54fcfa5de01daf68a86e7 P e5256d91808b47c195bc9b4dbd7f2b87 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 5.
I20260709 13:04:55.490651 21201 raft_consensus.cc:3060] T 76cb037fc9064d13b59a8969d897ce8c P 0473d2b2d01f4459b1e90fd12cc7840e [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:04:55.556236 19374 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.4:43121, user_credentials={real_user=slave}} blocked reactor thread for 223771us
I20260709 13:04:55.513054 19484 pending_rounds.cc:85] T 86a6797bdfe94fa496c050ceae4bd0d9 P 0473d2b2d01f4459b1e90fd12cc7840e: Aborting all ops after (but not including) 1
I20260709 13:04:55.561287 19484 pending_rounds.cc:107] T 86a6797bdfe94fa496c050ceae4bd0d9 P 0473d2b2d01f4459b1e90fd12cc7840e: Aborting uncommitted NO_OP operation due to leader change: 3.2
I20260709 13:04:55.561642 19484 raft_consensus.cc:2889] T 86a6797bdfe94fa496c050ceae4bd0d9 P 0473d2b2d01f4459b1e90fd12cc7840e [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:04:55.513161 19375 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.3:36891, user_credentials={real_user=slave}} blocked reactor thread for 174541us
I20260709 13:04:55.542578 19407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f93ee515a9c14139bf566522ed8232f3" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:04:55.542081 19408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46c5bfeecc314717bffe987e6844b6d0" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 6 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:04:55.521724 21061 raft_consensus.cc:2749] T b9f0d59553ad444883fcf5b5909f9798 P e61c3a8f61bb48f8a963c9480e53c168 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
W20260709 13:04:55.551018 19451 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:04:55.570374 19375 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:55.507218 21115 raft_consensus.cc:2749] T e381f1d6b8184797ad142de49be225a8 P e61c3a8f61bb48f8a963c9480e53c168 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:04:55.512413 19526 leader_election.cc:304] T ed7fdbcb96d14d418db9ca90a792588a P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e61c3a8f61bb48f8a963c9480e53c168; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, 127766fc592545a4997f7790f50f6076
I20260709 13:04:55.545202 21202 raft_consensus.cc:2804] T 96efeaaf1057492490e9a621f37e1a2d P e61c3a8f61bb48f8a963c9480e53c168 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:04:55.575472 19408 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "309c3ca0ca4b4f3ba129752ea2cb293b"
dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
 from {username='slave'} at 127.0.0.1:52328
I20260709 13:04:55.576047 19408 raft_consensus.cc:493] T 309c3ca0ca4b4f3ba129752ea2cb293b P e5256d91808b47c195bc9b4dbd7f2b87 [term 4 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:04:55.576429 19408 raft_consensus.cc:3060] T 309c3ca0ca4b4f3ba129752ea2cb293b P e5256d91808b47c195bc9b4dbd7f2b87 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:04:55.580905 19407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a08760e15aac4630a629431f56024dc8" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:04:55.583546 19407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f93ee515a9c14139bf566522ed8232f3" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
W20260709 13:04:55.558539 20078 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.2:46257, user_credentials={real_user=slave}} blocked reactor thread for 331086us
I20260709 13:04:55.568506 19555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "309c3ca0ca4b4f3ba129752ea2cb293b" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:04:55.558954 21079 raft_consensus.cc:493] T bc225c93219c45538b53a1bd3d387e4d P e61c3a8f61bb48f8a963c9480e53c168 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:04:55.541638 19449 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:55.522138 21111 raft_consensus.cc:2804] T ab43d85f64114d4ebf618930e43d9ed0 P e61c3a8f61bb48f8a963c9480e53c168 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:04:55.554822 20728 raft_consensus.cc:493] T 22196caba61445d3bec98a0aab3c337d P e61c3a8f61bb48f8a963c9480e53c168 [term 3 FOLLOWER]: Starting leader election (detected failure of leader e5256d91808b47c195bc9b4dbd7f2b87)
I20260709 13:04:55.585481 19306 catalog_manager.cc:5697] T 9962423cb4e54fcfa5de01daf68a86e7 P 0473d2b2d01f4459b1e90fd12cc7840e reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:55.591712 19449 leader_election.cc:304] T 14efcc79969f41babe5529c22d59156d P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e; no voters: 127766fc592545a4997f7790f50f6076, e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:04:55.593704 19407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85c494af21f9457a85da47b9bc70c1fd" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
W20260709 13:04:55.594434 19526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.2:46257, user_credentials={real_user=slave}} blocked reactor thread for 82101us
I20260709 13:04:55.604194 19526 leader_election.cc:304] T 3e1f505cb0f1427bbd698ac889d80821 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168; no voters: e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:04:55.605758 19526 leader_election.cc:304] T edd7d470b5014c9489be7f41f64355c9 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e61c3a8f61bb48f8a963c9480e53c168; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87
W20260709 13:04:55.573431 21125 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 4 current term: 4 is higher.
I20260709 13:04:55.594990 19405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40e1e16737a842ee936002830f36882e" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:04:55.608359 19526 leader_election.cc:304] T ef32ce6fdd0e40d382c79974f30295c6 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e61c3a8f61bb48f8a963c9480e53c168; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:04:55.584904 19552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef32ce6fdd0e40d382c79974f30295c6" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:04:55.612171 20105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "833a2f0775ed407a94b8924ce50adb63" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:04:55.612376 19553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e1f505cb0f1427bbd698ac889d80821" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:04:55.612735 19552 raft_consensus.cc:2393] T ef32ce6fdd0e40d382c79974f30295c6 P e61c3a8f61bb48f8a963c9480e53c168 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e5256d91808b47c195bc9b4dbd7f2b87 in current term 4: Already voted for candidate e61c3a8f61bb48f8a963c9480e53c168 in this term.
I20260709 13:04:55.602648 19408 raft_consensus.cc:515] T 309c3ca0ca4b4f3ba129752ea2cb293b P e5256d91808b47c195bc9b4dbd7f2b87 [term 5 FOLLOWER]: Starting forced leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } attrs { replace: true } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:04:55.545039 21206 consensus_queue.cc:1059] T 0afb57ae58a24a01850491d69f0213dd P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.041s
I20260709 13:04:55.619514 19405 raft_consensus.cc:1240] T 9962423cb4e54fcfa5de01daf68a86e7 P e5256d91808b47c195bc9b4dbd7f2b87 [term 5 FOLLOWER]: Rejecting Update request from peer 127766fc592545a4997f7790f50f6076 for earlier term 4. Current term is 5. Ops: [4.5-4.5]
I20260709 13:04:55.587864 20104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa731b585f684a7fb2d106c50f143b83" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:04:55.573161 21110 raft_consensus.cc:697] T 1efebf73c86e432baa55533136b6e12c P 127766fc592545a4997f7790f50f6076 [term 5 LEADER]: Becoming Leader. State: Replica: 127766fc592545a4997f7790f50f6076, State: Running, Role: LEADER
I20260709 13:04:55.627007 19306 catalog_manager.cc:5697] T edd7d470b5014c9489be7f41f64355c9 P 0473d2b2d01f4459b1e90fd12cc7840e reported cstate change: term changed from 1 to 3, leader changed from e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3) to 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2). New cstate: current_term: 3 leader_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } health_report { overall_health: UNKNOWN } } }
W20260709 13:04:55.648902 19377 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.2:46257, user_credentials={real_user=slave}} blocked reactor thread for 353422us
I20260709 13:04:55.611678 20728 raft_consensus.cc:3060] T 22196caba61445d3bec98a0aab3c337d P e61c3a8f61bb48f8a963c9480e53c168 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:04:55.592674 21111 raft_consensus.cc:493] T ab43d85f64114d4ebf618930e43d9ed0 P e61c3a8f61bb48f8a963c9480e53c168 [term 3 FOLLOWER]: Starting leader election (detected failure of leader e5256d91808b47c195bc9b4dbd7f2b87)
I20260709 13:04:55.592284 21202 raft_consensus.cc:697] T 96efeaaf1057492490e9a621f37e1a2d P e61c3a8f61bb48f8a963c9480e53c168 [term 4 LEADER]: Becoming Leader. State: Replica: e61c3a8f61bb48f8a963c9480e53c168, State: Running, Role: LEADER
I20260709 13:04:55.595539 20853 raft_consensus.cc:2749] T ed7fdbcb96d14d418db9ca90a792588a P e61c3a8f61bb48f8a963c9480e53c168 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:04:55.616437 21203 raft_consensus.cc:2749] T edd7d470b5014c9489be7f41f64355c9 P e61c3a8f61bb48f8a963c9480e53c168 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:04:55.613654 21209 raft_consensus.cc:493] T ece3db938bc649d4a40a51522ed5259c P e5256d91808b47c195bc9b4dbd7f2b87 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:55.650839 19377 leader_election.cc:304] T e381f1d6b8184797ad142de49be225a8 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:04:55.659200 20107 raft_consensus.cc:1275] T 775c229504194560ba9589bc2199b089 P 127766fc592545a4997f7790f50f6076 [term 3 FOLLOWER]: Refusing update from remote peer 0473d2b2d01f4459b1e90fd12cc7840e: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 5. (term mismatch)
I20260709 13:04:55.651180 19483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a08760e15aac4630a629431f56024dc8" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:04:55.652170 21140 raft_consensus.cc:2749] T 14efcc79969f41babe5529c22d59156d P 0473d2b2d01f4459b1e90fd12cc7840e [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:04:55.654462 21169 consensus_queue.cc:1059] T 9962423cb4e54fcfa5de01daf68a86e7 P 127766fc592545a4997f7790f50f6076 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.011s
I20260709 13:04:55.609755 21079 raft_consensus.cc:515] T bc225c93219c45538b53a1bd3d387e4d P e61c3a8f61bb48f8a963c9480e53c168 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:55.669417 20104 raft_consensus.cc:2468] T fa731b585f684a7fb2d106c50f143b83 P 127766fc592545a4997f7790f50f6076 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 3.
I20260709 13:04:55.655046 20109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9962423cb4e54fcfa5de01daf68a86e7" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076"
I20260709 13:04:55.659940 19482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f93ee515a9c14139bf566522ed8232f3" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:04:55.672415 19407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dc5b3532fe54f74876d02beffa2c230" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:04:55.661170 19408 leader_election.cc:290] T 309c3ca0ca4b4f3ba129752ea2cb293b P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 5 election: Requested vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:04:55.673601 19484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2725d2c4cb054f18b0fc8f735c15f6c2" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:04:55.659710 19478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40e1e16737a842ee936002830f36882e" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:04:55.616573 21174 raft_consensus.cc:2804] T 3e1f505cb0f1427bbd698ac889d80821 P e61c3a8f61bb48f8a963c9480e53c168 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:04:55.676836 19449 leader_election.cc:304] T 4509b76741dc428e9201c70c1658da13 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e; no voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:04:55.659181 20111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c5eebf646ad445a9d1b1adc319d7b16" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076"
I20260709 13:04:55.678795 20112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "309c3ca0ca4b4f3ba129752ea2cb293b" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: true dest_uuid: "127766fc592545a4997f7790f50f6076"
I20260709 13:04:55.703717 20112 raft_consensus.cc:3060] T 309c3ca0ca4b4f3ba129752ea2cb293b P 127766fc592545a4997f7790f50f6076 [term 3 FOLLOWER]: Advancing to term 5
W20260709 13:04:55.679484 19450 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.3:36891, user_credentials={real_user=slave}} blocked reactor thread for 238573us
W20260709 13:04:55.683879 20076 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.3:36891, user_credentials={real_user=slave}} blocked reactor thread for 309957us
I20260709 13:04:55.704118 19449 leader_election.cc:304] T a08760e15aac4630a629431f56024dc8 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e; no voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:04:55.684067 19306 catalog_manager.cc:5697] T ed7fdbcb96d14d418db9ca90a792588a P 0473d2b2d01f4459b1e90fd12cc7840e reported cstate change: term changed from 2 to 3, leader changed from 127766fc592545a4997f7790f50f6076 (127.17.223.4) to 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2). New cstate: current_term: 3 leader_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 13:04:55.686571 19526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.2:46257, user_credentials={real_user=slave}} blocked reactor thread for 78366.2us
I20260709 13:04:55.705097 19450 leader_election.cc:304] T d1e5873a19244c5ebbcd38e126796ee7 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:04:55.705466 19526 leader_election.cc:304] T ff75a1d4cb1f493db8f71ddc136ba9ab P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e61c3a8f61bb48f8a963c9480e53c168; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:04:55.651118 21127 raft_consensus.cc:493] T bc225c93219c45538b53a1bd3d387e4d P 0473d2b2d01f4459b1e90fd12cc7840e [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:55.694021 19406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ece3db938bc649d4a40a51522ed5259c" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:04:55.672104 19402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "775c229504194560ba9589bc2199b089" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:04:55.693251 20107 pending_rounds.cc:85] T 775c229504194560ba9589bc2199b089 P 127766fc592545a4997f7790f50f6076: Aborting all ops after (but not including) 4
I20260709 13:04:55.708954 19377 leader_election.cc:304] T edd7d470b5014c9489be7f41f64355c9 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:04:55.717252 19377 leader_election.cc:304] T 172b3dd13109415a955b71ac0e9d2234 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, 127766fc592545a4997f7790f50f6076
I20260709 13:04:55.687381 21111 raft_consensus.cc:3060] T ab43d85f64114d4ebf618930e43d9ed0 P e61c3a8f61bb48f8a963c9480e53c168 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:04:55.706588 18300 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:04:55.701138 19482 raft_consensus.cc:2468] T f93ee515a9c14139bf566522ed8232f3 P 0473d2b2d01f4459b1e90fd12cc7840e [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 4.
I20260709 13:04:55.687402 20108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "309c3ca0ca4b4f3ba129752ea2cb293b" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076"
I20260709 13:04:55.722653 19449 leader_election.cc:304] T b08304a0a02b42d7840c4e8ee9a6bd1a P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87; no voters: e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:04:55.735841 20076 leader_election.cc:304] T fa731b585f684a7fb2d106c50f143b83 P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 127766fc592545a4997f7790f50f6076, e61c3a8f61bb48f8a963c9480e53c168; no voters: e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:04:55.736125 19407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f575b143b844aa096b50997dad3516a" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:04:55.724208 19306 catalog_manager.cc:5697] T f1b10566f45d4a7d9029858330e02d5b P 0473d2b2d01f4459b1e90fd12cc7840e reported cstate change: term changed from 2 to 3, leader changed from 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2) to e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1). New cstate: current_term: 3 leader_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } }
I20260709 13:04:55.696352 20754 raft_consensus.cc:2749] T e381f1d6b8184797ad142de49be225a8 P e5256d91808b47c195bc9b4dbd7f2b87 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:04:55.737051 20076 leader_election.cc:304] T 70797e5783b5454ab0d0eea663e791e3 P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 127766fc592545a4997f7790f50f6076; no voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:04:55.748354 20078 leader_election.cc:304] T 96efeaaf1057492490e9a621f37e1a2d P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 127766fc592545a4997f7790f50f6076; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:04:55.750753 19552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f93ee515a9c14139bf566522ed8232f3" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:04:55.754755 19555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46c5bfeecc314717bffe987e6844b6d0" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 6 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:04:55.756029 19449 leader_election.cc:304] T 9962423cb4e54fcfa5de01daf68a86e7 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87; no voters: 
I20260709 13:04:55.708278 20103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62c6c134d3d24a1ab144dd9ee6bc3f64" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076"
I20260709 13:04:55.764173 19408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa731b585f684a7fb2d106c50f143b83" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:04:55.656869 21110 consensus_queue.cc:237] T 1efebf73c86e432baa55533136b6e12c P 127766fc592545a4997f7790f50f6076 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:04:55.761799 19407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "833a2f0775ed407a94b8924ce50adb63" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:04:55.723663 20107 pending_rounds.cc:107] T 775c229504194560ba9589bc2199b089 P 127766fc592545a4997f7790f50f6076: Aborting uncommitted NO_OP operation due to leader change: 2.5
W20260709 13:04:55.759243 19523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.4:43121, user_credentials={real_user=slave}} blocked reactor thread for 88578.6us
I20260709 13:04:55.766036 19526 leader_election.cc:304] T 7be9efa6559648dbb5a0f7684c4542d1 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e61c3a8f61bb48f8a963c9480e53c168; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:04:55.716471 21088 raft_consensus.cc:2749] T 4509b76741dc428e9201c70c1658da13 P 0473d2b2d01f4459b1e90fd12cc7840e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:04:55.722888 21194 raft_consensus.cc:2749] T edd7d470b5014c9489be7f41f64355c9 P e5256d91808b47c195bc9b4dbd7f2b87 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:04:55.769402 20078 leader_election.cc:304] T ed7fdbcb96d14d418db9ca90a792588a P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 127766fc592545a4997f7790f50f6076; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:04:55.735394 21126 raft_consensus.cc:2749] T a08760e15aac4630a629431f56024dc8 P 0473d2b2d01f4459b1e90fd12cc7840e [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 13:04:55.769865 19377 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.2:46257, user_credentials={real_user=slave}} blocked reactor thread for 51192us
I20260709 13:04:55.770918 19306 catalog_manager.cc:5697] T b08304a0a02b42d7840c4e8ee9a6bd1a P 0473d2b2d01f4459b1e90fd12cc7840e reported cstate change: term changed from 1 to 2, leader changed from 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2) to e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1). New cstate: current_term: 2 leader_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } }
I20260709 13:04:55.756393 20945 raft_consensus.cc:2804] T d1e5873a19244c5ebbcd38e126796ee7 P 0473d2b2d01f4459b1e90fd12cc7840e [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:04:55.736541 21193 raft_consensus.cc:2749] T 172b3dd13109415a955b71ac0e9d2234 P e5256d91808b47c195bc9b4dbd7f2b87 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:04:55.755935 20998 raft_consensus.cc:3055] T 9962423cb4e54fcfa5de01daf68a86e7 P 127766fc592545a4997f7790f50f6076 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:04:55.783876 21084 raft_consensus.cc:2804] T b08304a0a02b42d7840c4e8ee9a6bd1a P 0473d2b2d01f4459b1e90fd12cc7840e [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:04:55.785719 21215 raft_consensus.cc:493] T fa8650e71aa14778b3d73721fc50d9fc P 0473d2b2d01f4459b1e90fd12cc7840e [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:55.769094 21169 raft_consensus.cc:2749] T 70797e5783b5454ab0d0eea663e791e3 P 127766fc592545a4997f7790f50f6076 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:04:55.768832 21106 raft_consensus.cc:2804] T fa731b585f684a7fb2d106c50f143b83 P 127766fc592545a4997f7790f50f6076 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:04:55.789235 19306 catalog_manager.cc:5697] T f93ee515a9c14139bf566522ed8232f3 P 0473d2b2d01f4459b1e90fd12cc7840e reported cstate change: term changed from 1 to 3, leader changed from e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1) to 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2). New cstate: current_term: 3 leader_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:55.722555 21127 raft_consensus.cc:515] T bc225c93219c45538b53a1bd3d387e4d P 0473d2b2d01f4459b1e90fd12cc7840e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:55.799218 19374 leader_election.cc:304] T 309c3ca0ca4b4f3ba129752ea2cb293b P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87; no voters: 127766fc592545a4997f7790f50f6076, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:04:55.819872 20873 consensus_queue.cc:1048] T fa8650e71aa14778b3d73721fc50d9fc P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
W20260709 13:04:55.820546 19294 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.LeaderStepDown -> {remote=127.17.223.3:36891, user_credentials={real_user=slave}} blocked reactor thread for 149849us
I20260709 13:04:55.770080 20107 raft_consensus.cc:2889] T 775c229504194560ba9589bc2199b089 P 127766fc592545a4997f7790f50f6076 [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:04:55.817871 21206 raft_consensus.cc:2749] T ff75a1d4cb1f493db8f71ddc136ba9ab P e61c3a8f61bb48f8a963c9480e53c168 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:04:55.697695 21209 raft_consensus.cc:515] T ece3db938bc649d4a40a51522ed5259c P e5256d91808b47c195bc9b4dbd7f2b87 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
W20260709 13:04:55.859951 19374 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.4:43121, user_credentials={real_user=slave}} blocked reactor thread for 60861.7us
I20260709 13:04:55.777500 21219 raft_consensus.cc:2749] T ef32ce6fdd0e40d382c79974f30295c6 P e61c3a8f61bb48f8a963c9480e53c168 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:04:55.796819 20945 raft_consensus.cc:697] T d1e5873a19244c5ebbcd38e126796ee7 P 0473d2b2d01f4459b1e90fd12cc7840e [term 3 LEADER]: Becoming Leader. State: Replica: 0473d2b2d01f4459b1e90fd12cc7840e, State: Running, Role: LEADER
I20260709 13:04:55.765305 21197 consensus_queue.cc:1048] T 2b74109013a140ada21feeef92d6f563 P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.062s
I20260709 13:04:55.795183 21084 raft_consensus.cc:493] T b08304a0a02b42d7840c4e8ee9a6bd1a P 0473d2b2d01f4459b1e90fd12cc7840e [term 2 FOLLOWER]: Starting leader election (detected failure of leader e5256d91808b47c195bc9b4dbd7f2b87)
I20260709 13:04:55.781203 21165 consensus_queue.cc:1048] T 1dc5b3532fe54f74876d02beffa2c230 P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.073s
I20260709 13:04:55.829576 21106 raft_consensus.cc:493] T fa731b585f684a7fb2d106c50f143b83 P 127766fc592545a4997f7790f50f6076 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:55.865480 21044 raft_consensus.cc:2749] T 309c3ca0ca4b4f3ba129752ea2cb293b P e5256d91808b47c195bc9b4dbd7f2b87 [term 5 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:04:55.865706 20754 consensus_queue.cc:1048] T f93ee515a9c14139bf566522ed8232f3 P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.005s
I20260709 13:04:55.903795 21209 leader_election.cc:290] T ece3db938bc649d4a40a51522ed5259c P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:04:55.900622 21084 raft_consensus.cc:3060] T b08304a0a02b42d7840c4e8ee9a6bd1a P 0473d2b2d01f4459b1e90fd12cc7840e [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:04:55.905093 20945 consensus_queue.cc:237] T d1e5873a19244c5ebbcd38e126796ee7 P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:55.875020 20785 raft_consensus.cc:2749] T ed7fdbcb96d14d418db9ca90a792588a P 127766fc592545a4997f7790f50f6076 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:04:55.909420 21211 raft_consensus.cc:2749] T 96efeaaf1057492490e9a621f37e1a2d P 127766fc592545a4997f7790f50f6076 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:04:55.910974 21079 leader_election.cc:290] T bc225c93219c45538b53a1bd3d387e4d P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:04:55.876610 21127 leader_election.cc:290] T bc225c93219c45538b53a1bd3d387e4d P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:04:55.879892 20728 raft_consensus.cc:515] T 22196caba61445d3bec98a0aab3c337d P e61c3a8f61bb48f8a963c9480e53c168 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:55.913120 20728 leader_election.cc:290] T 22196caba61445d3bec98a0aab3c337d P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 4 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:04:55.793090 20998 raft_consensus.cc:740] T 9962423cb4e54fcfa5de01daf68a86e7 P 127766fc592545a4997f7790f50f6076 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 127766fc592545a4997f7790f50f6076, State: Running, Role: LEADER
I20260709 13:04:55.914427 20998 consensus_queue.cc:260] T 9962423cb4e54fcfa5de01daf68a86e7 P 127766fc592545a4997f7790f50f6076 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.5, Last appended by leader: 5, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
W20260709 13:04:55.861261 19377 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.2:46257, user_credentials={real_user=slave}} blocked reactor thread for 78944us
I20260709 13:04:55.886705 21206 raft_consensus.cc:2749] T 7be9efa6559648dbb5a0f7684c4542d1 P e61c3a8f61bb48f8a963c9480e53c168 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:04:55.917940 19377 leader_election.cc:304] T ff9b0eddd810459b82d91c60777c10eb P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87; no voters: 127766fc592545a4997f7790f50f6076
I20260709 13:04:55.918427 20112 raft_consensus.cc:2468] T 309c3ca0ca4b4f3ba129752ea2cb293b P 127766fc592545a4997f7790f50f6076 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 5.
I20260709 13:04:55.918823 20776 raft_consensus.cc:2804] T ff9b0eddd810459b82d91c60777c10eb P e5256d91808b47c195bc9b4dbd7f2b87 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:04:55.919239 20776 raft_consensus.cc:493] T ff9b0eddd810459b82d91c60777c10eb P e5256d91808b47c195bc9b4dbd7f2b87 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 127766fc592545a4997f7790f50f6076)
I20260709 13:04:55.919708 20776 raft_consensus.cc:3060] T ff9b0eddd810459b82d91c60777c10eb P e5256d91808b47c195bc9b4dbd7f2b87 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:04:55.860674 21202 consensus_queue.cc:237] T 96efeaaf1057492490e9a621f37e1a2d P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:04:55.923656 19377 leader_election.cc:304] T 7be9efa6559648dbb5a0f7684c4542d1 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:04:55.925143 19377 leader_election.cc:304] T 2e36a9d6e29c4a7c860cf267efbd4c74 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:04:55.789682 21125 raft_consensus.cc:2804] T 9962423cb4e54fcfa5de01daf68a86e7 P 0473d2b2d01f4459b1e90fd12cc7840e [term 5 FOLLOWER]: Leader election won for term 5
W20260709 13:04:55.897071 19451 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:55.897629 19406 raft_consensus.cc:2468] T ece3db938bc649d4a40a51522ed5259c P e5256d91808b47c195bc9b4dbd7f2b87 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 127766fc592545a4997f7790f50f6076 in term 4.
I20260709 13:04:55.856957 19551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "309c3ca0ca4b4f3ba129752ea2cb293b" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: true dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:04:55.902311 21106 raft_consensus.cc:3060] T fa731b585f684a7fb2d106c50f143b83 P 127766fc592545a4997f7790f50f6076 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:04:55.866182 21088 raft_consensus.cc:493] T 28af091831594f9d8e96482078cc7625 P 0473d2b2d01f4459b1e90fd12cc7840e [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:55.932190 19551 raft_consensus.cc:3055] T 309c3ca0ca4b4f3ba129752ea2cb293b P e61c3a8f61bb48f8a963c9480e53c168 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:04:55.932605 19551 raft_consensus.cc:740] T 309c3ca0ca4b4f3ba129752ea2cb293b P e61c3a8f61bb48f8a963c9480e53c168 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: e61c3a8f61bb48f8a963c9480e53c168, State: Running, Role: LEADER
I20260709 13:04:55.932289 21088 raft_consensus.cc:515] T 28af091831594f9d8e96482078cc7625 P 0473d2b2d01f4459b1e90fd12cc7840e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:55.933408 19551 consensus_queue.cc:260] T 309c3ca0ca4b4f3ba129752ea2cb293b P e61c3a8f61bb48f8a963c9480e53c168 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } attrs { replace: true } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:04:55.934365 21088 leader_election.cc:290] T 28af091831594f9d8e96482078cc7625 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:04:55.855062 19306 catalog_manager.cc:5697] T ff75a1d4cb1f493db8f71ddc136ba9ab P 0473d2b2d01f4459b1e90fd12cc7840e reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:55.939767 20776 raft_consensus.cc:515] T ff9b0eddd810459b82d91c60777c10eb P e5256d91808b47c195bc9b4dbd7f2b87 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:04:55.941870 20776 leader_election.cc:290] T ff9b0eddd810459b82d91c60777c10eb P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 3 election: Requested vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:04:55.935204 21125 raft_consensus.cc:697] T 9962423cb4e54fcfa5de01daf68a86e7 P 0473d2b2d01f4459b1e90fd12cc7840e [term 5 LEADER]: Becoming Leader. State: Replica: 0473d2b2d01f4459b1e90fd12cc7840e, State: Running, Role: LEADER
I20260709 13:04:55.935577 19551 raft_consensus.cc:3060] T 309c3ca0ca4b4f3ba129752ea2cb293b P e61c3a8f61bb48f8a963c9480e53c168 [term 3 FOLLOWER]: Advancing to term 5
I20260709 13:04:55.936199 21025 raft_consensus.cc:2749] T 2e36a9d6e29c4a7c860cf267efbd4c74 P e5256d91808b47c195bc9b4dbd7f2b87 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:04:55.937104 19377 leader_election.cc:304] T b9f0d59553ad444883fcf5b5909f9798 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:04:55.928203 21111 raft_consensus.cc:515] T ab43d85f64114d4ebf618930e43d9ed0 P e61c3a8f61bb48f8a963c9480e53c168 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } attrs { replace: true } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: NON_VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: true } }
I20260709 13:04:55.963274 20103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ece3db938bc649d4a40a51522ed5259c" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:04:55.854466 21215 raft_consensus.cc:515] T fa8650e71aa14778b3d73721fc50d9fc P 0473d2b2d01f4459b1e90fd12cc7840e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:55.985486 20112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff9b0eddd810459b82d91c60777c10eb" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076"
I20260709 13:04:55.926581 21167 raft_consensus.cc:2749] T 7be9efa6559648dbb5a0f7684c4542d1 P e5256d91808b47c195bc9b4dbd7f2b87 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:04:55.965557 21137 raft_consensus.cc:3060] T b9f0d59553ad444883fcf5b5909f9798 P 0473d2b2d01f4459b1e90fd12cc7840e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:55.968930 21115 raft_consensus.cc:3055] T 0afb57ae58a24a01850491d69f0213dd P e61c3a8f61bb48f8a963c9480e53c168 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:04:55.970082 19410 raft_consensus.cc:2410] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P e5256d91808b47c195bc9b4dbd7f2b87 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 0473d2b2d01f4459b1e90fd12cc7840e for term 5 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
W20260709 13:04:55.990415 19523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.1:40321, user_credentials={real_user=slave}} blocked reactor thread for 220675us
I20260709 13:04:55.991232 19377 leader_election.cc:304] T 76cb037fc9064d13b59a8969d897ce8c P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:04:55.996989 19411 raft_consensus.cc:1240] T ff9b0eddd810459b82d91c60777c10eb P e5256d91808b47c195bc9b4dbd7f2b87 [term 3 FOLLOWER]: Rejecting Update request from peer 127766fc592545a4997f7790f50f6076 for earlier term 2. Current term is 3. Ops: []
I20260709 13:04:55.998392 19411 raft_consensus.cc:1240] T 9962423cb4e54fcfa5de01daf68a86e7 P e5256d91808b47c195bc9b4dbd7f2b87 [term 5 FOLLOWER]: Rejecting Update request from peer 127766fc592545a4997f7790f50f6076 for earlier term 4. Current term is 5. Ops: [4.5-4.5]
W20260709 13:04:55.991912 19526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.2:46257, user_credentials={real_user=slave}} blocked reactor thread for 225932us
I20260709 13:04:55.999455 19526 leader_election.cc:304] T 2e36a9d6e29c4a7c860cf267efbd4c74 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e61c3a8f61bb48f8a963c9480e53c168; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:04:56.009384 19523 leader_election.cc:304] T 85c494af21f9457a85da47b9bc70c1fd P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e61c3a8f61bb48f8a963c9480e53c168; no voters: 127766fc592545a4997f7790f50f6076, e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:04:56.008702 21174 raft_consensus.cc:697] T 3e1f505cb0f1427bbd698ac889d80821 P e61c3a8f61bb48f8a963c9480e53c168 [term 2 LEADER]: Becoming Leader. State: Replica: e61c3a8f61bb48f8a963c9480e53c168, State: Running, Role: LEADER
I20260709 13:04:55.985563 21111 leader_election.cc:290] T ab43d85f64114d4ebf618930e43d9ed0 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 4 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:04:55.986214 21194 raft_consensus.cc:2749] T b9f0d59553ad444883fcf5b5909f9798 P e5256d91808b47c195bc9b4dbd7f2b87 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:04:55.989523 21115 raft_consensus.cc:740] T 0afb57ae58a24a01850491d69f0213dd P e61c3a8f61bb48f8a963c9480e53c168 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e61c3a8f61bb48f8a963c9480e53c168, State: Running, Role: LEADER
I20260709 13:04:56.018620 19556 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0afb57ae58a24a01850491d69f0213dd"
dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
mode: GRACEFUL
new_leader_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
 from {username='slave'} at 127.0.0.1:51880
I20260709 13:04:56.024573 19526 leader_election.cc:304] T 76cb037fc9064d13b59a8969d897ce8c P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e61c3a8f61bb48f8a963c9480e53c168; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87
W20260709 13:04:56.017614 20078 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.2:46257, user_credentials={real_user=slave}} blocked reactor thread for 248279us
I20260709 13:04:56.030125 21190 consensus_queue.cc:1059] T 62c6c134d3d24a1ab144dd9ee6bc3f64 P 127766fc592545a4997f7790f50f6076 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:04:56.030409 21235 raft_consensus.cc:2749] T 85c494af21f9457a85da47b9bc70c1fd P e61c3a8f61bb48f8a963c9480e53c168 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:04:56.031095 21235 raft_consensus.cc:2749] T 2e36a9d6e29c4a7c860cf267efbd4c74 P e61c3a8f61bb48f8a963c9480e53c168 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:04:56.031164 21190 raft_consensus.cc:3055] T 62c6c134d3d24a1ab144dd9ee6bc3f64 P 127766fc592545a4997f7790f50f6076 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:04:56.031596 21190 raft_consensus.cc:740] T 62c6c134d3d24a1ab144dd9ee6bc3f64 P 127766fc592545a4997f7790f50f6076 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 127766fc592545a4997f7790f50f6076, State: Running, Role: LEADER
I20260709 13:04:56.031800 21215 leader_election.cc:290] T fa8650e71aa14778b3d73721fc50d9fc P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:04:56.032433 21190 consensus_queue.cc:260] T 62c6c134d3d24a1ab144dd9ee6bc3f64 P 127766fc592545a4997f7790f50f6076 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:04:56.033567 21190 raft_consensus.cc:3060] T 62c6c134d3d24a1ab144dd9ee6bc3f64 P 127766fc592545a4997f7790f50f6076 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:04:56.033713 21231 consensus_queue.cc:1059] T ff9b0eddd810459b82d91c60777c10eb P 127766fc592545a4997f7790f50f6076 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.013s
I20260709 13:04:56.034842 21231 raft_consensus.cc:3055] T ff9b0eddd810459b82d91c60777c10eb P 127766fc592545a4997f7790f50f6076 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:04:56.035135 21231 raft_consensus.cc:740] T ff9b0eddd810459b82d91c60777c10eb P 127766fc592545a4997f7790f50f6076 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 127766fc592545a4997f7790f50f6076, State: Running, Role: LEADER
I20260709 13:04:56.035916 21231 consensus_queue.cc:260] T ff9b0eddd810459b82d91c60777c10eb P 127766fc592545a4997f7790f50f6076 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:04:56.037396 21231 raft_consensus.cc:3060] T ff9b0eddd810459b82d91c60777c10eb P 127766fc592545a4997f7790f50f6076 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:04:56.015196 21167 raft_consensus.cc:3060] T 76cb037fc9064d13b59a8969d897ce8c P e5256d91808b47c195bc9b4dbd7f2b87 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:04:56.046983 20776 raft_consensus.cc:493] T fa731b585f684a7fb2d106c50f143b83 P e5256d91808b47c195bc9b4dbd7f2b87 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 127766fc592545a4997f7790f50f6076)
I20260709 13:04:56.047664 20776 raft_consensus.cc:515] T fa731b585f684a7fb2d106c50f143b83 P e5256d91808b47c195bc9b4dbd7f2b87 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:04:56.050170 20776 leader_election.cc:290] T fa731b585f684a7fb2d106c50f143b83 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:04:56.055464 20110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa731b585f684a7fb2d106c50f143b83" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:04:56.057032 21125 consensus_queue.cc:237] T 9962423cb4e54fcfa5de01daf68a86e7 P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:04:56.058936 19554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0afb57ae58a24a01850491d69f0213dd" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:04:56.060364 19526 leader_election.cc:304] T b08304a0a02b42d7840c4e8ee9a6bd1a P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e61c3a8f61bb48f8a963c9480e53c168; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:04:56.060734 19557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ece3db938bc649d4a40a51522ed5259c" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:04:56.061452 19526 leader_election.cc:304] T f1b10566f45d4a7d9029858330e02d5b P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e61c3a8f61bb48f8a963c9480e53c168; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:04:56.062134 21206 raft_consensus.cc:2749] T 76cb037fc9064d13b59a8969d897ce8c P e61c3a8f61bb48f8a963c9480e53c168 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:04:56.062744 21206 raft_consensus.cc:2749] T b08304a0a02b42d7840c4e8ee9a6bd1a P e61c3a8f61bb48f8a963c9480e53c168 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:04:56.063344 21206 raft_consensus.cc:2749] T f1b10566f45d4a7d9029858330e02d5b P e61c3a8f61bb48f8a963c9480e53c168 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:04:56.067396 19552 raft_consensus.cc:1275] T 0e1085d23e8347fbbd5bce7542f4b1f4 P e61c3a8f61bb48f8a963c9480e53c168 [term 4 FOLLOWER]: Refusing update from remote peer 127766fc592545a4997f7790f50f6076: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:04:56.071709 21106 raft_consensus.cc:515] T fa731b585f684a7fb2d106c50f143b83 P 127766fc592545a4997f7790f50f6076 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:04:55.989655 21085 consensus_queue.cc:1048] T 0cdf56e38bbc453d9438d359e5a69955 P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.038s
I20260709 13:04:56.075471 20075 leader_election.cc:304] T ece3db938bc649d4a40a51522ed5259c P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 127766fc592545a4997f7790f50f6076, e5256d91808b47c195bc9b4dbd7f2b87; no voters: 
I20260709 13:04:56.087479 19526 leader_election.cc:304] T df751f992649444090e27965eb1af85d P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e61c3a8f61bb48f8a963c9480e53c168; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:04:55.988140 21084 raft_consensus.cc:515] T b08304a0a02b42d7840c4e8ee9a6bd1a P 0473d2b2d01f4459b1e90fd12cc7840e [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:56.094004 19558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa731b585f684a7fb2d106c50f143b83" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:04:56.095147 19555 raft_consensus.cc:1240] T 22196caba61445d3bec98a0aab3c337d P e61c3a8f61bb48f8a963c9480e53c168 [term 4 FOLLOWER]: Rejecting Update request from peer e5256d91808b47c195bc9b4dbd7f2b87 for earlier term 3. Current term is 4. Ops: []
W20260709 13:04:56.096232 19375 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:56.098532 19558 raft_consensus.cc:2393] T fa731b585f684a7fb2d106c50f143b83 P e61c3a8f61bb48f8a963c9480e53c168 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e5256d91808b47c195bc9b4dbd7f2b87 in current term 3: Already voted for candidate e61c3a8f61bb48f8a963c9480e53c168 in this term.
W20260709 13:04:56.102582 20075 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:56.104306 20110 raft_consensus.cc:2368] T fa731b585f684a7fb2d106c50f143b83 P 127766fc592545a4997f7790f50f6076 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e5256d91808b47c195bc9b4dbd7f2b87 for earlier term 3. Current term is 4.
I20260709 13:04:56.107995 19555 raft_consensus.cc:1240] T 21e14947d70440f19044d8f75c31e1f9 P e61c3a8f61bb48f8a963c9480e53c168 [term 3 FOLLOWER]: Rejecting Update request from peer e5256d91808b47c195bc9b4dbd7f2b87 for earlier term 2. Current term is 3. Ops: []
I20260709 13:04:56.074636 21085 raft_consensus.cc:493] T 28af091831594f9d8e96482078cc7625 P e5256d91808b47c195bc9b4dbd7f2b87 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:56.116503 19526 leader_election.cc:304] T 1a61655d99124a29b486ba4a5b37faea P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e61c3a8f61bb48f8a963c9480e53c168; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:04:56.066664 19551 raft_consensus.cc:2468] T 309c3ca0ca4b4f3ba129752ea2cb293b P e61c3a8f61bb48f8a963c9480e53c168 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 5.
I20260709 13:04:56.102452 21136 raft_consensus.cc:493] T 2b74109013a140ada21feeef92d6f563 P e5256d91808b47c195bc9b4dbd7f2b87 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:56.136324 19526 leader_election.cc:304] T 2b74109013a140ada21feeef92d6f563 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e61c3a8f61bb48f8a963c9480e53c168; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:04:56.129321 19523 leader_election.cc:304] T fa731b585f684a7fb2d106c50f143b83 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 127766fc592545a4997f7790f50f6076, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:04:56.097491 21112 raft_consensus.cc:493] T 1f85fc4b527a48848e5faa083b604e36 P 0473d2b2d01f4459b1e90fd12cc7840e [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e5256d91808b47c195bc9b4dbd7f2b87)
I20260709 13:04:56.101828 20785 raft_consensus.cc:493] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P 127766fc592545a4997f7790f50f6076 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader e5256d91808b47c195bc9b4dbd7f2b87)
I20260709 13:04:56.140552 19483 raft_consensus.cc:1275] T 0e1085d23e8347fbbd5bce7542f4b1f4 P 0473d2b2d01f4459b1e90fd12cc7840e [term 4 FOLLOWER]: Refusing update from remote peer 127766fc592545a4997f7790f50f6076: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:04:56.112288 20105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36f6ba92b9ba46babe4ebd6c02e5fbd9" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076"
I20260709 13:04:56.152262 19449 leader_election.cc:304] T 6c5eebf646ad445a9d1b1adc319d7b16 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e; no voters: 127766fc592545a4997f7790f50f6076, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:04:56.159812 19479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "775c229504194560ba9589bc2199b089" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:04:56.164572 19483 raft_consensus.cc:1240] T b08304a0a02b42d7840c4e8ee9a6bd1a P 0473d2b2d01f4459b1e90fd12cc7840e [term 3 FOLLOWER]: Rejecting Update request from peer e5256d91808b47c195bc9b4dbd7f2b87 for earlier term 2. Current term is 3. Ops: []
I20260709 13:04:56.165187 19479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46c5bfeecc314717bffe987e6844b6d0" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 6 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:04:56.165859 19479 raft_consensus.cc:2468] T 46c5bfeecc314717bffe987e6844b6d0 P 0473d2b2d01f4459b1e90fd12cc7840e [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 5.
I20260709 13:04:56.166869 19557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc225c93219c45538b53a1bd3d387e4d" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:04:56.168287 19485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0afb57ae58a24a01850491d69f0213dd" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:04:56.168756 19449 leader_election.cc:304] T 62c6c134d3d24a1ab144dd9ee6bc3f64 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e; no voters: 127766fc592545a4997f7790f50f6076, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:04:56.158560 19484 raft_consensus.cc:1240] T 6c5eebf646ad445a9d1b1adc319d7b16 P 0473d2b2d01f4459b1e90fd12cc7840e [term 3 FOLLOWER]: Rejecting Update request from peer 127766fc592545a4997f7790f50f6076 for earlier term 2. Current term is 3. Ops: []
I20260709 13:04:56.171523 19486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef32ce6fdd0e40d382c79974f30295c6" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:04:56.172250 19486 raft_consensus.cc:2468] T ef32ce6fdd0e40d382c79974f30295c6 P 0473d2b2d01f4459b1e90fd12cc7840e [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 4.
I20260709 13:04:56.167570 19526 leader_election.cc:304] T 21e14947d70440f19044d8f75c31e1f9 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e61c3a8f61bb48f8a963c9480e53c168; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:04:56.169090 19523 leader_election.cc:304] T 833a2f0775ed407a94b8924ce50adb63 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e61c3a8f61bb48f8a963c9480e53c168; no voters: 127766fc592545a4997f7790f50f6076, e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:04:56.182607 19485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "309c3ca0ca4b4f3ba129752ea2cb293b" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: true dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:04:56.183382 19485 raft_consensus.cc:3060] T 309c3ca0ca4b4f3ba129752ea2cb293b P 0473d2b2d01f4459b1e90fd12cc7840e [term 3 FOLLOWER]: Advancing to term 5
I20260709 13:04:56.191015 21126 consensus_queue.cc:1048] T 775c229504194560ba9589bc2199b089 P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Connected to new peer: Peer: permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:04:56.191468 19407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc225c93219c45538b53a1bd3d387e4d" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:04:56.192778 19406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28af091831594f9d8e96482078cc7625" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:04:56.138738 21201 raft_consensus.cc:493] T 1dc5b3532fe54f74876d02beffa2c230 P 0473d2b2d01f4459b1e90fd12cc7840e [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:56.197250 19478 raft_consensus.cc:1275] T bc225c93219c45538b53a1bd3d387e4d P 0473d2b2d01f4459b1e90fd12cc7840e [term 4 FOLLOWER]: Refusing update from remote peer e5256d91808b47c195bc9b4dbd7f2b87: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 2. (term mismatch)
I20260709 13:04:56.217505 19478 pending_rounds.cc:85] T bc225c93219c45538b53a1bd3d387e4d P 0473d2b2d01f4459b1e90fd12cc7840e: Aborting all ops after (but not including) 1
I20260709 13:04:56.217976 19478 pending_rounds.cc:107] T bc225c93219c45538b53a1bd3d387e4d P 0473d2b2d01f4459b1e90fd12cc7840e: Aborting uncommitted NO_OP operation due to leader change: 3.2
I20260709 13:04:56.218276 19478 raft_consensus.cc:2889] T bc225c93219c45538b53a1bd3d387e4d P 0473d2b2d01f4459b1e90fd12cc7840e [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:04:56.219841 19478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff9b0eddd810459b82d91c60777c10eb" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:04:56.150631 21191 consensus_queue.cc:1048] T 0e1085d23e8347fbbd5bce7542f4b1f4 P 127766fc592545a4997f7790f50f6076 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.065s
I20260709 13:04:56.178172 21061 raft_consensus.cc:2749] T 2b74109013a140ada21feeef92d6f563 P e61c3a8f61bb48f8a963c9480e53c168 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:04:56.185134 21235 raft_consensus.cc:2749] T 21e14947d70440f19044d8f75c31e1f9 P e61c3a8f61bb48f8a963c9480e53c168 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:04:56.204543 19482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14935b3ddf914369822e4a0547aaa355" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:04:56.207597 19557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa8650e71aa14778b3d73721fc50d9fc" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:04:56.211208 19477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e1085d23e8347fbbd5bce7542f4b1f4" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:04:56.192266 21194 consensus_queue.cc:1059] T 21e14947d70440f19044d8f75c31e1f9 P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.023s
I20260709 13:04:56.143568 21202 raft_consensus.cc:2749] T 1a61655d99124a29b486ba4a5b37faea P e61c3a8f61bb48f8a963c9480e53c168 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:04:56.259501 19526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.2:46257, user_credentials={real_user=slave}} blocked reactor thread for 79051.1us
I20260709 13:04:56.208784 21230 raft_consensus.cc:2804] T ece3db938bc649d4a40a51522ed5259c P 127766fc592545a4997f7790f50f6076 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:04:56.120085 21115 consensus_queue.cc:260] T 0afb57ae58a24a01850491d69f0213dd P e61c3a8f61bb48f8a963c9480e53c168 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
W20260709 13:04:56.215435 19523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.1:40321, user_credentials={real_user=slave}} blocked reactor thread for 46409us
I20260709 13:04:56.210752 21227 raft_consensus.cc:2749] T df751f992649444090e27965eb1af85d P e61c3a8f61bb48f8a963c9480e53c168 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:04:56.209934 21208 consensus_queue.cc:1059] T 22196caba61445d3bec98a0aab3c337d P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.088s
I20260709 13:04:56.275705 21208 raft_consensus.cc:3055] T 22196caba61445d3bec98a0aab3c337d P e5256d91808b47c195bc9b4dbd7f2b87 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:04:56.276117 21208 raft_consensus.cc:740] T 22196caba61445d3bec98a0aab3c337d P e5256d91808b47c195bc9b4dbd7f2b87 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: e5256d91808b47c195bc9b4dbd7f2b87, State: Running, Role: LEADER
I20260709 13:04:56.276875 21208 consensus_queue.cc:260] T 22196caba61445d3bec98a0aab3c337d P e5256d91808b47c195bc9b4dbd7f2b87 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:56.167217 21197 raft_consensus.cc:493] T ab43d85f64114d4ebf618930e43d9ed0 P 0473d2b2d01f4459b1e90fd12cc7840e [term 3 FOLLOWER]: Starting pre-election (detected failure of leader e5256d91808b47c195bc9b4dbd7f2b87)
I20260709 13:04:56.211349 21220 consensus_queue.cc:1048] T 46c5bfeecc314717bffe987e6844b6d0 P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.020s
I20260709 13:04:56.188802 21137 raft_consensus.cc:2749] T 6c5eebf646ad445a9d1b1adc319d7b16 P 0473d2b2d01f4459b1e90fd12cc7840e [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:04:56.185474 21132 raft_consensus.cc:2749] T 62c6c134d3d24a1ab144dd9ee6bc3f64 P 0473d2b2d01f4459b1e90fd12cc7840e [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:04:56.184731 20853 raft_consensus.cc:2804] T fa731b585f684a7fb2d106c50f143b83 P e61c3a8f61bb48f8a963c9480e53c168 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:04:56.278177 21197 raft_consensus.cc:515] T ab43d85f64114d4ebf618930e43d9ed0 P 0473d2b2d01f4459b1e90fd12cc7840e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } attrs { replace: true } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: NON_VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: true } }
I20260709 13:04:56.278927 20853 raft_consensus.cc:493] T fa731b585f684a7fb2d106c50f143b83 P e61c3a8f61bb48f8a963c9480e53c168 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:56.279299 20853 raft_consensus.cc:3060] T fa731b585f684a7fb2d106c50f143b83 P e61c3a8f61bb48f8a963c9480e53c168 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:04:56.280431 21197 leader_election.cc:290] T ab43d85f64114d4ebf618930e43d9ed0 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:04:56.224670 21174 consensus_queue.cc:237] T 3e1f505cb0f1427bbd698ac889d80821 P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
W20260709 13:04:56.198410 19449 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:56.238199 19403 raft_consensus.cc:1240] T 309c3ca0ca4b4f3ba129752ea2cb293b P e5256d91808b47c195bc9b4dbd7f2b87 [term 5 FOLLOWER]: Rejecting Update request from peer e61c3a8f61bb48f8a963c9480e53c168 for earlier term 3. Current term is 5. Ops: []
I20260709 13:04:56.238312 19555 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "309c3ca0ca4b4f3ba129752ea2cb293b"
dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:40412
W20260709 13:04:56.283264 19449 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:56.227541 19482 raft_consensus.cc:2468] T 14935b3ddf914369822e4a0547aaa355 P 0473d2b2d01f4459b1e90fd12cc7840e [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 2.
I20260709 13:04:56.283665 19555 raft_consensus.cc:606] T 309c3ca0ca4b4f3ba129752ea2cb293b P e61c3a8f61bb48f8a963c9480e53c168 [term 5 FOLLOWER]: Received request to transfer leadership
I20260709 13:04:56.284024 19555 raft_consensus.cc:614] T 309c3ca0ca4b4f3ba129752ea2cb293b P e61c3a8f61bb48f8a963c9480e53c168 [term 5 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:04:56.285646 21215 raft_consensus.cc:493] T 21e14947d70440f19044d8f75c31e1f9 P 0473d2b2d01f4459b1e90fd12cc7840e [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e5256d91808b47c195bc9b4dbd7f2b87)
I20260709 13:04:56.220885 21111 raft_consensus.cc:2749] T 833a2f0775ed407a94b8924ce50adb63 P e61c3a8f61bb48f8a963c9480e53c168 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:04:56.209383 21210 raft_consensus.cc:493] T 2a16f7501e2444fb86d4e2778e734e02 P e5256d91808b47c195bc9b4dbd7f2b87 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 127766fc592545a4997f7790f50f6076)
I20260709 13:04:56.153131 21112 raft_consensus.cc:515] T 1f85fc4b527a48848e5faa083b604e36 P 0473d2b2d01f4459b1e90fd12cc7840e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:04:56.212855 19402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa8650e71aa14778b3d73721fc50d9fc" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:04:56.286193 21215 raft_consensus.cc:515] T 21e14947d70440f19044d8f75c31e1f9 P 0473d2b2d01f4459b1e90fd12cc7840e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:56.153497 21136 raft_consensus.cc:515] T 2b74109013a140ada21feeef92d6f563 P e5256d91808b47c195bc9b4dbd7f2b87 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:56.267961 19485 raft_consensus.cc:2468] T 309c3ca0ca4b4f3ba129752ea2cb293b P 0473d2b2d01f4459b1e90fd12cc7840e [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 5.
I20260709 13:04:56.131351 21085 raft_consensus.cc:515] T 28af091831594f9d8e96482078cc7625 P e5256d91808b47c195bc9b4dbd7f2b87 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:56.168098 20785 raft_consensus.cc:515] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P 127766fc592545a4997f7790f50f6076 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:04:56.263885 19477 raft_consensus.cc:2376] T 0e1085d23e8347fbbd5bce7542f4b1f4 P 0473d2b2d01f4459b1e90fd12cc7840e [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 127766fc592545a4997f7790f50f6076 in term 4. Re-sending same reply.
I20260709 13:04:56.272920 19450 leader_election.cc:304] T 46c5bfeecc314717bffe987e6844b6d0 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e; no voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:04:56.227907 21201 raft_consensus.cc:515] T 1dc5b3532fe54f74876d02beffa2c230 P 0473d2b2d01f4459b1e90fd12cc7840e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:56.273703 21193 raft_consensus.cc:3055] T 21e14947d70440f19044d8f75c31e1f9 P e5256d91808b47c195bc9b4dbd7f2b87 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:04:56.288412 19526 leader_election.cc:304] T a08760e15aac4630a629431f56024dc8 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e61c3a8f61bb48f8a963c9480e53c168; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:04:56.270470 21230 raft_consensus.cc:493] T ece3db938bc649d4a40a51522ed5259c P 127766fc592545a4997f7790f50f6076 [term 4 FOLLOWER]: Starting leader election (detected failure of leader e61c3a8f61bb48f8a963c9480e53c168)
W20260709 13:04:56.306998 19375 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.3:36891, user_credentials={real_user=slave}} blocked reactor thread for 141776us
I20260709 13:04:56.290334 21126 raft_consensus.cc:493] T f1b10566f45d4a7d9029858330e02d5b P 0473d2b2d01f4459b1e90fd12cc7840e [term 3 FOLLOWER]: Starting pre-election (detected failure of leader e5256d91808b47c195bc9b4dbd7f2b87)
I20260709 13:04:56.290777 19551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28af091831594f9d8e96482078cc7625" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
W20260709 13:04:56.326787 19374 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:04:56.320768 19375 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:56.307771 19450 leader_election.cc:304] T f93ee515a9c14139bf566522ed8232f3 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e; no voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:04:56.325289 19406 raft_consensus.cc:2468] T 28af091831594f9d8e96482078cc7625 P e5256d91808b47c195bc9b4dbd7f2b87 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 4.
I20260709 13:04:56.315824 19526 leader_election.cc:304] T 2725d2c4cb054f18b0fc8f735c15f6c2 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e61c3a8f61bb48f8a963c9480e53c168; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:04:56.329538 19375 leader_election.cc:304] T 309c3ca0ca4b4f3ba129752ea2cb293b P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 127766fc592545a4997f7790f50f6076, e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:04:56.331053 21192 raft_consensus.cc:2804] T 309c3ca0ca4b4f3ba129752ea2cb293b P e5256d91808b47c195bc9b4dbd7f2b87 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:04:56.331619 21192 raft_consensus.cc:697] T 309c3ca0ca4b4f3ba129752ea2cb293b P e5256d91808b47c195bc9b4dbd7f2b87 [term 5 LEADER]: Becoming Leader. State: Replica: e5256d91808b47c195bc9b4dbd7f2b87, State: Running, Role: LEADER
I20260709 13:04:56.332686 21192 consensus_queue.cc:237] T 309c3ca0ca4b4f3ba129752ea2cb293b P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 5, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } attrs { replace: true } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:04:56.338995 19403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa731b585f684a7fb2d106c50f143b83" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
I20260709 13:04:56.341396 19409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22196caba61445d3bec98a0aab3c337d" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
I20260709 13:04:56.341553 19403 raft_consensus.cc:3060] T fa731b585f684a7fb2d106c50f143b83 P e5256d91808b47c195bc9b4dbd7f2b87 [term 2 FOLLOWER]: Advancing to term 4
I20260709 13:04:56.306288 21115 raft_consensus.cc:3060] T 0afb57ae58a24a01850491d69f0213dd P e61c3a8f61bb48f8a963c9480e53c168 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:56.344378 19526 leader_election.cc:304] T 40e1e16737a842ee936002830f36882e P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e61c3a8f61bb48f8a963c9480e53c168; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:04:56.293814 21206 consensus_queue.cc:1048] T 86a6797bdfe94fa496c050ceae4bd0d9 P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.030s
I20260709 13:04:56.346978 19526 leader_election.cc:304] T f93ee515a9c14139bf566522ed8232f3 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168; no voters: e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:04:56.347651 20078 leader_election.cc:304] T 775c229504194560ba9589bc2199b089 P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 127766fc592545a4997f7790f50f6076; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:04:56.317473 21197 raft_consensus.cc:2749] T 46c5bfeecc314717bffe987e6844b6d0 P 0473d2b2d01f4459b1e90fd12cc7840e [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 13:04:56.354897 19526 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:56.314851 21193 raft_consensus.cc:740] T 21e14947d70440f19044d8f75c31e1f9 P e5256d91808b47c195bc9b4dbd7f2b87 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: e5256d91808b47c195bc9b4dbd7f2b87, State: Running, Role: LEADER
I20260709 13:04:56.323917 21230 raft_consensus.cc:3060] T ece3db938bc649d4a40a51522ed5259c P 127766fc592545a4997f7790f50f6076 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:04:56.323570 21202 raft_consensus.cc:2749] T a08760e15aac4630a629431f56024dc8 P e61c3a8f61bb48f8a963c9480e53c168 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:04:56.287521 21235 consensus_queue.cc:1048] T 28af091831594f9d8e96482078cc7625 P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.073s
I20260709 13:04:56.362506 19377 leader_election.cc:304] T 46c5bfeecc314717bffe987e6844b6d0 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87; no voters: e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:04:56.401973 19377 leader_election.cc:304] T ef32ce6fdd0e40d382c79974f30295c6 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87; no voters: e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:04:56.353325 21227 raft_consensus.cc:2749] T 2725d2c4cb054f18b0fc8f735c15f6c2 P e61c3a8f61bb48f8a963c9480e53c168 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:04:56.360409 21226 raft_consensus.cc:2749] T 40e1e16737a842ee936002830f36882e P e61c3a8f61bb48f8a963c9480e53c168 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:04:56.384084 20078 leader_election.cc:304] T 0afb57ae58a24a01850491d69f0213dd P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 127766fc592545a4997f7790f50f6076; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:04:56.343212 20105 raft_consensus.cc:3060] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P 127766fc592545a4997f7790f50f6076 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:04:56.286945 21210 raft_consensus.cc:515] T 2a16f7501e2444fb86d4e2778e734e02 P e5256d91808b47c195bc9b4dbd7f2b87 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:04:56.346531 21106 leader_election.cc:290] T fa731b585f684a7fb2d106c50f143b83 P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 4 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:04:56.365546 20785 leader_election.cc:290] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:04:56.411362 20776 consensus_queue.cc:1048] T bc225c93219c45538b53a1bd3d387e4d P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
W20260709 13:04:56.364058 21238 log.cc:927] Time spent T d1e5873a19244c5ebbcd38e126796ee7 P 0473d2b2d01f4459b1e90fd12cc7840e: Append to log took a long time: real 0.124s	user 0.000s	sys 0.000s
I20260709 13:04:56.367697 21085 leader_election.cc:290] T 28af091831594f9d8e96482078cc7625 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:04:56.408772 19377 leader_election.cc:304] T 14935b3ddf914369822e4a0547aaa355 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87; no voters: e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:04:56.410097 21209 raft_consensus.cc:2804] T ef32ce6fdd0e40d382c79974f30295c6 P e5256d91808b47c195bc9b4dbd7f2b87 [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 13:04:56.436993 19449 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.1:40321, user_credentials={real_user=slave}} blocked reactor thread for 150647us
I20260709 13:04:56.382751 21084 leader_election.cc:290] T b08304a0a02b42d7840c4e8ee9a6bd1a P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 3 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:04:56.384713 21110 raft_consensus.cc:2749] T 775c229504194560ba9589bc2199b089 P 127766fc592545a4997f7790f50f6076 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:04:56.424190 21191 raft_consensus.cc:2749] T 0afb57ae58a24a01850491d69f0213dd P 127766fc592545a4997f7790f50f6076 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:04:56.414729 21194 raft_consensus.cc:2804] T 46c5bfeecc314717bffe987e6844b6d0 P e5256d91808b47c195bc9b4dbd7f2b87 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:04:56.340338 21126 raft_consensus.cc:515] T f1b10566f45d4a7d9029858330e02d5b P 0473d2b2d01f4459b1e90fd12cc7840e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:56.496268 19481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36f6ba92b9ba46babe4ebd6c02e5fbd9" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:04:56.505307 19481 raft_consensus.cc:2393] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P 0473d2b2d01f4459b1e90fd12cc7840e [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 127766fc592545a4997f7790f50f6076 in current term 5: Already voted for candidate 0473d2b2d01f4459b1e90fd12cc7840e in this term.
I20260709 13:04:56.496850 19405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36f6ba92b9ba46babe4ebd6c02e5fbd9" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:04:56.506524 19405 raft_consensus.cc:2468] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P e5256d91808b47c195bc9b4dbd7f2b87 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 127766fc592545a4997f7790f50f6076 in term 5.
I20260709 13:04:56.430843 19402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab43d85f64114d4ebf618930e43d9ed0" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
I20260709 13:04:56.480104 21043 tablet_copy_client.cc:538] T 14935b3ddf914369822e4a0547aaa355 P 127766fc592545a4997f7790f50f6076: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:04:56.437034 21209 raft_consensus.cc:493] T ef32ce6fdd0e40d382c79974f30295c6 P e5256d91808b47c195bc9b4dbd7f2b87 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 0473d2b2d01f4459b1e90fd12cc7840e)
I20260709 13:04:56.519304 19481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dc5b3532fe54f74876d02beffa2c230" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:04:56.525491 21136 leader_election.cc:290] T 2b74109013a140ada21feeef92d6f563 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:04:56.516273 21127 raft_consensus.cc:493] T 3e1f505cb0f1427bbd698ac889d80821 P 0473d2b2d01f4459b1e90fd12cc7840e [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:56.526304 21127 raft_consensus.cc:515] T 3e1f505cb0f1427bbd698ac889d80821 P 0473d2b2d01f4459b1e90fd12cc7840e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:56.529528 19526 leader_election.cc:304] T 1dc5b3532fe54f74876d02beffa2c230 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e61c3a8f61bb48f8a963c9480e53c168; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:04:56.499001 21131 raft_consensus.cc:493] T 7be9efa6559648dbb5a0f7684c4542d1 P 0473d2b2d01f4459b1e90fd12cc7840e [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:56.498514 21194 raft_consensus.cc:493] T 46c5bfeecc314717bffe987e6844b6d0 P e5256d91808b47c195bc9b4dbd7f2b87 [term 5 FOLLOWER]: Starting leader election (detected failure of leader e61c3a8f61bb48f8a963c9480e53c168)
I20260709 13:04:56.531693 20110 raft_consensus.cc:1275] T 96efeaaf1057492490e9a621f37e1a2d P 127766fc592545a4997f7790f50f6076 [term 4 FOLLOWER]: Refusing update from remote peer e61c3a8f61bb48f8a963c9480e53c168: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:04:56.532701 19481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22196caba61445d3bec98a0aab3c337d" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:04:56.536007 19481 raft_consensus.cc:3060] T 22196caba61445d3bec98a0aab3c337d P 0473d2b2d01f4459b1e90fd12cc7840e [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:04:56.503592 21111 raft_consensus.cc:2804] T f93ee515a9c14139bf566522ed8232f3 P e61c3a8f61bb48f8a963c9480e53c168 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:04:56.502454 20819 raft_consensus.cc:2804] T 14935b3ddf914369822e4a0547aaa355 P e5256d91808b47c195bc9b4dbd7f2b87 [term 1 FOLLOWER]: Leader pre-election won for term 2
W20260709 13:04:56.537829 19357 auto_rebalancer.cc:893] Removing replace marker failed: Replica e61c3a8f61bb48f8a963c9480e53c168 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 5 committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } attrs { replace: true } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } } }
I20260709 13:04:56.512060 19551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28af091831594f9d8e96482078cc7625" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:04:56.366575 21240 raft_consensus.cc:2749] T f93ee515a9c14139bf566522ed8232f3 P 0473d2b2d01f4459b1e90fd12cc7840e [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 13:04:56.541255 19357 auto_rebalancer.cc:901] Could not move replica: Illegal state: not currently leader
I20260709 13:04:56.528892 21209 raft_consensus.cc:3060] T ef32ce6fdd0e40d382c79974f30295c6 P e5256d91808b47c195bc9b4dbd7f2b87 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:04:56.554207 19357 auto_rebalancer.cc:330] scheduled replica move failed to complete: Illegal state: not currently leader
I20260709 13:04:56.555979 21232 consensus_queue.cc:1059] T 6c5eebf646ad445a9d1b1adc319d7b16 P 127766fc592545a4997f7790f50f6076 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.150s
W20260709 13:04:56.557266 21204 log.cc:927] Time spent T fa8650e71aa14778b3d73721fc50d9fc P e5256d91808b47c195bc9b4dbd7f2b87: Append to log took a long time: real 0.067s	user 0.000s	sys 0.000s
I20260709 13:04:56.557518 21232 raft_consensus.cc:3055] T 6c5eebf646ad445a9d1b1adc319d7b16 P 127766fc592545a4997f7790f50f6076 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:04:56.558161 21232 raft_consensus.cc:740] T 6c5eebf646ad445a9d1b1adc319d7b16 P 127766fc592545a4997f7790f50f6076 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 127766fc592545a4997f7790f50f6076, State: Running, Role: LEADER
I20260709 13:04:56.558993 21237 consensus_queue.cc:1048] T 0e1085d23e8347fbbd5bce7542f4b1f4 P 127766fc592545a4997f7790f50f6076 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.162s
W20260709 13:04:56.561259 21236 log.cc:927] Time spent T ff75a1d4cb1f493db8f71ddc136ba9ab P e5256d91808b47c195bc9b4dbd7f2b87: Append to log took a long time: real 0.201s	user 0.000s	sys 0.001s
W20260709 13:04:56.562650 21243 log.cc:927] Time spent T ece3db938bc649d4a40a51522ed5259c P e5256d91808b47c195bc9b4dbd7f2b87: Append to log took a long time: real 0.134s	user 0.000s	sys 0.000s
W20260709 13:04:56.564685 21246 log.cc:927] Time spent T bc225c93219c45538b53a1bd3d387e4d P e61c3a8f61bb48f8a963c9480e53c168: Append to log took a long time: real 0.053s	user 0.000s	sys 0.000s
I20260709 13:04:56.575148 19481 raft_consensus.cc:2468] T 22196caba61445d3bec98a0aab3c337d P 0473d2b2d01f4459b1e90fd12cc7840e [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 4.
I20260709 13:04:56.576609 19481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f575b143b844aa096b50997dad3516a" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:04:56.535346 21061 raft_consensus.cc:2749] T 1dc5b3532fe54f74876d02beffa2c230 P e61c3a8f61bb48f8a963c9480e53c168 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:04:56.578154 19481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab43d85f64114d4ebf618930e43d9ed0" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:04:56.539960 21194 raft_consensus.cc:3060] T 46c5bfeecc314717bffe987e6844b6d0 P e5256d91808b47c195bc9b4dbd7f2b87 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:04:56.609813 19483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e1f505cb0f1427bbd698ac889d80821" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
W20260709 13:04:56.610301 21167 consensus_meta.cc:287] T 76cb037fc9064d13b59a8969d897ce8c P e5256d91808b47c195bc9b4dbd7f2b87: Time spent flushing consensus metadata: real 0.568s	user 0.008s	sys 0.000s
W20260709 13:04:56.612154 20076 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:56.614383 21210 leader_election.cc:290] T 2a16f7501e2444fb86d4e2778e734e02 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:04:56.615556 20945 raft_consensus.cc:493] T 1efebf73c86e432baa55533136b6e12c P 0473d2b2d01f4459b1e90fd12cc7840e [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:56.616045 20945 raft_consensus.cc:515] T 1efebf73c86e432baa55533136b6e12c P 0473d2b2d01f4459b1e90fd12cc7840e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:04:56.616525 19526 leader_election.cc:304] T 22196caba61445d3bec98a0aab3c337d P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:04:56.616744 19558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b74109013a140ada21feeef92d6f563" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:04:56.591219 19477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc225c93219c45538b53a1bd3d387e4d" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:04:56.618026 19477 raft_consensus.cc:2468] T bc225c93219c45538b53a1bd3d387e4d P 0473d2b2d01f4459b1e90fd12cc7840e [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 4.
I20260709 13:04:56.618362 21223 raft_consensus.cc:2804] T 22196caba61445d3bec98a0aab3c337d P e61c3a8f61bb48f8a963c9480e53c168 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:04:56.618897 21223 raft_consensus.cc:697] T 22196caba61445d3bec98a0aab3c337d P e61c3a8f61bb48f8a963c9480e53c168 [term 4 LEADER]: Becoming Leader. State: Replica: e61c3a8f61bb48f8a963c9480e53c168, State: Running, Role: LEADER
I20260709 13:04:56.542366 20819 raft_consensus.cc:493] T 14935b3ddf914369822e4a0547aaa355 P e5256d91808b47c195bc9b4dbd7f2b87 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 0473d2b2d01f4459b1e90fd12cc7840e)
I20260709 13:04:56.619736 20819 raft_consensus.cc:3060] T 14935b3ddf914369822e4a0547aaa355 P e5256d91808b47c195bc9b4dbd7f2b87 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:56.619892 21223 consensus_queue.cc:237] T 22196caba61445d3bec98a0aab3c337d P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
W20260709 13:04:56.622332 21242 log.cc:927] Time spent T 1efebf73c86e432baa55533136b6e12c P 127766fc592545a4997f7790f50f6076: Append to log took a long time: real 0.259s	user 0.000s	sys 0.000s
I20260709 13:04:56.618046 20945 leader_election.cc:290] T 1efebf73c86e432baa55533136b6e12c P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:04:56.614404 20075 leader_election.cc:304] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 127766fc592545a4997f7790f50f6076, e5256d91808b47c195bc9b4dbd7f2b87; no voters: 0473d2b2d01f4459b1e90fd12cc7840e
I20260709 13:04:56.440986 21193 consensus_queue.cc:260] T 21e14947d70440f19044d8f75c31e1f9 P e5256d91808b47c195bc9b4dbd7f2b87 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:56.599749 21215 leader_election.cc:290] T 21e14947d70440f19044d8f75c31e1f9 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:04:56.538882 21131 raft_consensus.cc:515] T 7be9efa6559648dbb5a0f7684c4542d1 P 0473d2b2d01f4459b1e90fd12cc7840e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:56.606483 21112 leader_election.cc:290] T 1f85fc4b527a48848e5faa083b604e36 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:04:56.607348 21232 consensus_queue.cc:260] T 6c5eebf646ad445a9d1b1adc319d7b16 P 127766fc592545a4997f7790f50f6076 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:04:56.617395 19526 leader_election.cc:304] T 7f575b143b844aa096b50997dad3516a P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e61c3a8f61bb48f8a963c9480e53c168; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:04:56.618975 21253 raft_consensus.cc:493] T 86a6797bdfe94fa496c050ceae4bd0d9 P 0473d2b2d01f4459b1e90fd12cc7840e [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:56.650987 21253 raft_consensus.cc:515] T 86a6797bdfe94fa496c050ceae4bd0d9 P 0473d2b2d01f4459b1e90fd12cc7840e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:56.653626 21253 leader_election.cc:290] T 86a6797bdfe94fa496c050ceae4bd0d9 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:04:56.598817 21201 leader_election.cc:290] T 1dc5b3532fe54f74876d02beffa2c230 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:04:56.626106 20110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f85fc4b527a48848e5faa083b604e36" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:04:56.654810 20853 raft_consensus.cc:515] T fa731b585f684a7fb2d106c50f143b83 P e61c3a8f61bb48f8a963c9480e53c168 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:04:56.657215 20853 leader_election.cc:290] T fa731b585f684a7fb2d106c50f143b83 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 4 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
W20260709 13:04:56.626575 19375 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:56.610443 19483 raft_consensus.cc:2468] T 3e1f505cb0f1427bbd698ac889d80821 P 0473d2b2d01f4459b1e90fd12cc7840e [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 2.
I20260709 13:04:56.596556 19554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ece3db938bc649d4a40a51522ed5259c" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:04:56.632884 19560 raft_consensus.cc:1240] T ab43d85f64114d4ebf618930e43d9ed0 P e61c3a8f61bb48f8a963c9480e53c168 [term 4 FOLLOWER]: Rejecting Update request from peer e5256d91808b47c195bc9b4dbd7f2b87 for earlier term 3. Current term is 4. Ops: []
W20260709 13:04:56.635947 19377 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.2:46257, user_credentials={real_user=slave}} blocked reactor thread for 138381us
I20260709 13:04:56.647189 20111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a16f7501e2444fb86d4e2778e734e02" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:04:56.646293 19557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a16f7501e2444fb86d4e2778e734e02" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:04:56.672123 19526 leader_election.cc:304] T bc225c93219c45538b53a1bd3d387e4d P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:04:56.670687 20110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa731b585f684a7fb2d106c50f143b83" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076"
I20260709 13:04:56.632871 21167 raft_consensus.cc:2749] T 76cb037fc9064d13b59a8969d897ce8c P e5256d91808b47c195bc9b4dbd7f2b87 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:04:56.698448 20110 raft_consensus.cc:2393] T fa731b585f684a7fb2d106c50f143b83 P 127766fc592545a4997f7790f50f6076 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate e61c3a8f61bb48f8a963c9480e53c168 in current term 4: Already voted for candidate 127766fc592545a4997f7790f50f6076 in this term.
I20260709 13:04:56.670183 21206 raft_consensus.cc:2749] T 7f575b143b844aa096b50997dad3516a P e61c3a8f61bb48f8a963c9480e53c168 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:04:56.671461 20104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1efebf73c86e432baa55533136b6e12c" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:04:56.705390 19403 raft_consensus.cc:2468] T fa731b585f684a7fb2d106c50f143b83 P e5256d91808b47c195bc9b4dbd7f2b87 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 127766fc592545a4997f7790f50f6076 in term 4.
I20260709 13:04:56.707566 19479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "309c3ca0ca4b4f3ba129752ea2cb293b" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:04:56.708245 19479 raft_consensus.cc:2368] T 309c3ca0ca4b4f3ba129752ea2cb293b P 0473d2b2d01f4459b1e90fd12cc7840e [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate e5256d91808b47c195bc9b4dbd7f2b87 for earlier term 4. Current term is 5.
I20260709 13:04:56.710094 21230 raft_consensus.cc:515] T ece3db938bc649d4a40a51522ed5259c P 127766fc592545a4997f7790f50f6076 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:04:56.717319 21193 raft_consensus.cc:3060] T 21e14947d70440f19044d8f75c31e1f9 P e5256d91808b47c195bc9b4dbd7f2b87 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:04:56.718466 21230 leader_election.cc:290] T ece3db938bc649d4a40a51522ed5259c P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 5 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:04:56.698455 20853 raft_consensus.cc:2804] T bc225c93219c45538b53a1bd3d387e4d P e61c3a8f61bb48f8a963c9480e53c168 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:04:56.720577 20853 raft_consensus.cc:493] T bc225c93219c45538b53a1bd3d387e4d P e61c3a8f61bb48f8a963c9480e53c168 [term 4 FOLLOWER]: Starting leader election (detected failure of leader e5256d91808b47c195bc9b4dbd7f2b87)
I20260709 13:04:56.720964 20853 raft_consensus.cc:3060] T bc225c93219c45538b53a1bd3d387e4d P e61c3a8f61bb48f8a963c9480e53c168 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:04:56.721673 19551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa731b585f684a7fb2d106c50f143b83" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:04:56.678869 21260 raft_consensus.cc:493] T 86a6797bdfe94fa496c050ceae4bd0d9 P e5256d91808b47c195bc9b4dbd7f2b87 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader e61c3a8f61bb48f8a963c9480e53c168)
I20260709 13:04:56.723182 21260 raft_consensus.cc:515] T 86a6797bdfe94fa496c050ceae4bd0d9 P e5256d91808b47c195bc9b4dbd7f2b87 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:56.725170 21260 leader_election.cc:290] T 86a6797bdfe94fa496c050ceae4bd0d9 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
W20260709 13:04:56.698244 21231 consensus_meta.cc:287] T ff9b0eddd810459b82d91c60777c10eb P 127766fc592545a4997f7790f50f6076: Time spent flushing consensus metadata: real 0.660s	user 0.011s	sys 0.000s
I20260709 13:04:56.727597 19411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc225c93219c45538b53a1bd3d387e4d" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:04:56.728232 21011 consensus_queue.cc:1048] T 96efeaaf1057492490e9a621f37e1a2d P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Connected to new peer: Peer: permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:04:56.696045 21215 raft_consensus.cc:493] T 5ec1c4ce15e04c7e8c283a62179f2a64 P 0473d2b2d01f4459b1e90fd12cc7840e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e5256d91808b47c195bc9b4dbd7f2b87)
I20260709 13:04:56.729296 20998 raft_consensus.cc:3060] T 9962423cb4e54fcfa5de01daf68a86e7 P 127766fc592545a4997f7790f50f6076 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:04:56.729132 21215 raft_consensus.cc:515] T 5ec1c4ce15e04c7e8c283a62179f2a64 P 0473d2b2d01f4459b1e90fd12cc7840e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:04:56.730464 20108 raft_consensus.cc:1240] T ece3db938bc649d4a40a51522ed5259c P 127766fc592545a4997f7790f50f6076 [term 5 FOLLOWER]: Rejecting Update request from peer e61c3a8f61bb48f8a963c9480e53c168 for earlier term 4. Current term is 5. Ops: []
I20260709 13:04:56.731176 21215 leader_election.cc:290] T 5ec1c4ce15e04c7e8c283a62179f2a64 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
W20260709 13:04:56.731644 21245 log.cc:927] Time spent T f93ee515a9c14139bf566522ed8232f3 P e5256d91808b47c195bc9b4dbd7f2b87: Append to log took a long time: real 0.369s	user 0.000s	sys 0.001s
I20260709 13:04:56.721942 21131 leader_election.cc:290] T 7be9efa6559648dbb5a0f7684c4542d1 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:04:56.698490 19402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa731b585f684a7fb2d106c50f143b83" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
I20260709 13:04:56.749284 19556 raft_consensus.cc:606] T 0afb57ae58a24a01850491d69f0213dd P e61c3a8f61bb48f8a963c9480e53c168 [term 2 FOLLOWER]: Received request to transfer leadership to TS 0473d2b2d01f4459b1e90fd12cc7840e
I20260709 13:04:56.749805 19556 raft_consensus.cc:614] T 0afb57ae58a24a01850491d69f0213dd P e61c3a8f61bb48f8a963c9480e53c168 [term 2 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:04:56.756927 19402 raft_consensus.cc:2393] T fa731b585f684a7fb2d106c50f143b83 P e5256d91808b47c195bc9b4dbd7f2b87 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate e61c3a8f61bb48f8a963c9480e53c168 in current term 4: Already voted for candidate 127766fc592545a4997f7790f50f6076 in this term.
I20260709 13:04:56.758380 20105 raft_consensus.cc:2410] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P 127766fc592545a4997f7790f50f6076 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 0473d2b2d01f4459b1e90fd12cc7840e for term 5 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 13:04:56.759678 19554 raft_consensus.cc:1275] T 1efebf73c86e432baa55533136b6e12c P e61c3a8f61bb48f8a963c9480e53c168 [term 5 FOLLOWER]: Refusing update from remote peer 127766fc592545a4997f7790f50f6076: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:04:56.765506 21208 raft_consensus.cc:3060] T 22196caba61445d3bec98a0aab3c337d P e5256d91808b47c195bc9b4dbd7f2b87 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:04:56.776252 21237 raft_consensus.cc:2764] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P 127766fc592545a4997f7790f50f6076 [term 5 FOLLOWER]: Leader pre-election decision vote started in defunct term 4: won
I20260709 13:04:56.777920 21111 raft_consensus.cc:493] T f93ee515a9c14139bf566522ed8232f3 P e61c3a8f61bb48f8a963c9480e53c168 [term 4 FOLLOWER]: Starting leader election (detected failure of leader e5256d91808b47c195bc9b4dbd7f2b87)
I20260709 13:04:56.778462 21111 raft_consensus.cc:3060] T f93ee515a9c14139bf566522ed8232f3 P e61c3a8f61bb48f8a963c9480e53c168 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:04:56.787890 20112 raft_consensus.cc:1275] T 9962423cb4e54fcfa5de01daf68a86e7 P 127766fc592545a4997f7790f50f6076 [term 5 FOLLOWER]: Refusing update from remote peer 0473d2b2d01f4459b1e90fd12cc7840e: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:04:56.746775 19551 raft_consensus.cc:2393] T fa731b585f684a7fb2d106c50f143b83 P e61c3a8f61bb48f8a963c9480e53c168 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 127766fc592545a4997f7790f50f6076 in current term 4: Already voted for candidate e61c3a8f61bb48f8a963c9480e53c168 in this term.
I20260709 13:04:56.793664 19411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b08304a0a02b42d7840c4e8ee9a6bd1a" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
I20260709 13:04:56.805266 19482 raft_consensus.cc:1275] T 96efeaaf1057492490e9a621f37e1a2d P 0473d2b2d01f4459b1e90fd12cc7840e [term 4 FOLLOWER]: Refusing update from remote peer e61c3a8f61bb48f8a963c9480e53c168: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:04:56.805585 19405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab43d85f64114d4ebf618930e43d9ed0" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 4 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:04:56.814743 19408 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52328 (request call id 1233) took 1156 ms. Trace:
I20260709 13:04:56.816524 19405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21e14947d70440f19044d8f75c31e1f9" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
W20260709 13:04:56.818369 21252 log.cc:927] Time spent T 3e1f505cb0f1427bbd698ac889d80821 P e61c3a8f61bb48f8a963c9480e53c168: Append to log took a long time: real 0.079s	user 0.000s	sys 0.000s
I20260709 13:04:56.820585 21043 tablet_bootstrap.cc:492] T 14935b3ddf914369822e4a0547aaa355 P 127766fc592545a4997f7790f50f6076: Bootstrap starting.
I20260709 13:04:56.815277 19408 rpcz_store.cc:276] 0709 13:04:55.657976 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:55.778593 (+120617us) service_pool.cc:224] Handling call
0709 13:04:56.058285 (+279692us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:04:56.064177 (+  5892us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:04:56.064209 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:04:56.064710 (+   501us) log.cc:844] Serialized 26 byte log entry
0709 13:04:56.228944 (+164234us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:04:56.228997 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:56.229083 (+    86us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:04:56.563769 (+334686us) raft_consensus.cc:1685] finished
0709 13:04:56.563794 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:56.809291 (+245497us) spinlock_profiling.cc:243] Waited 279 ms on lock 0x7b54000e6fd0. stack: 00007f4a79de9343 00007f4a79de9240 00007f4a797781d4 00007f4a834b6304 00007f4a834b6299 00007f4a7ce71571 00007f4a7cf078ad 00007f4a81ecc419 00007f4a7b443bd4 00007f4a7b443b62 00007f4a7b443a91 00007f4a7b443a0c 00007f4a7b442cc2 00007f4a7b24348c 00007f4a7b2428c6 00007f4a7b24226f
0709 13:04:56.814639 (+  5348us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":5459,"raft.queue_time_us":7742,"raft.run_cpu_time_us":101,"raft.run_wall_time_us":101,"spinlock_wait_cycles":642275712,"thread_start_us":163789,"threads_started":1,"wal-append.queue_time_us":278907}
W20260709 13:04:56.825130 19375 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.3:36891, user_credentials={real_user=slave}} blocked reactor thread for 141479us
I20260709 13:04:56.743625 21206 consensus_queue.cc:1059] T ece3db938bc649d4a40a51522ed5259c P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false }, Status: INVALID_TERM, Last received: 4.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.070s
I20260709 13:04:56.860177 19408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dc5b3532fe54f74876d02beffa2c230" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:04:56.851428 19375 leader_election.cc:304] T ece3db938bc649d4a40a51522ed5259c P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87; no voters: 127766fc592545a4997f7790f50f6076, e61c3a8f61bb48f8a963c9480e53c168
W20260709 13:04:56.869748 19377 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.2:46257, user_credentials={real_user=slave}} blocked reactor thread for 188946us
I20260709 13:04:56.743762 20819 raft_consensus.cc:515] T 14935b3ddf914369822e4a0547aaa355 P e5256d91808b47c195bc9b4dbd7f2b87 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } attrs { replace: true } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: NON_VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: true } }
I20260709 13:04:56.871150 19484 raft_consensus.cc:1275] T 3e1f505cb0f1427bbd698ac889d80821 P 0473d2b2d01f4459b1e90fd12cc7840e [term 2 FOLLOWER]: Refusing update from remote peer e61c3a8f61bb48f8a963c9480e53c168: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:56.873672 19410 raft_consensus.cc:1275] T 2b74109013a140ada21feeef92d6f563 P e5256d91808b47c195bc9b4dbd7f2b87 [term 2 FOLLOWER]: Refusing update from remote peer 0473d2b2d01f4459b1e90fd12cc7840e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:56.798702 21230 consensus_queue.cc:1048] T 1efebf73c86e432baa55533136b6e12c P 127766fc592545a4997f7790f50f6076 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.063s
I20260709 13:04:56.877420 19556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86a6797bdfe94fa496c050ceae4bd0d9" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:04:56.897156 19377 leader_election.cc:304] T 3e1f505cb0f1427bbd698ac889d80821 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87; no voters: 
I20260709 13:04:56.869354 21115 raft_consensus.cc:493] T d1e5873a19244c5ebbcd38e126796ee7 P e61c3a8f61bb48f8a963c9480e53c168 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:56.856842 21173 consensus_queue.cc:1059] T ab43d85f64114d4ebf618930e43d9ed0 P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.039s
I20260709 13:04:56.887248 19402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f85fc4b527a48848e5faa083b604e36" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:04:56.888151 21025 raft_consensus.cc:2749] T ece3db938bc649d4a40a51522ed5259c P e5256d91808b47c195bc9b4dbd7f2b87 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:04:56.883651 21215 raft_consensus.cc:493] T ff75a1d4cb1f493db8f71ddc136ba9ab P 0473d2b2d01f4459b1e90fd12cc7840e [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:56.896972 21209 raft_consensus.cc:515] T ef32ce6fdd0e40d382c79974f30295c6 P e5256d91808b47c195bc9b4dbd7f2b87 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
W20260709 13:04:56.966230 21264 log.cc:927] Time spent T 1dc5b3532fe54f74876d02beffa2c230 P 0473d2b2d01f4459b1e90fd12cc7840e: Append to log took a long time: real 0.099s	user 0.001s	sys 0.000s
I20260709 13:04:56.949137 21215 raft_consensus.cc:515] T ff75a1d4cb1f493db8f71ddc136ba9ab P 0473d2b2d01f4459b1e90fd12cc7840e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:56.901189 21115 raft_consensus.cc:515] T d1e5873a19244c5ebbcd38e126796ee7 P e61c3a8f61bb48f8a963c9480e53c168 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:56.980827 19411 raft_consensus.cc:2468] T b08304a0a02b42d7840c4e8ee9a6bd1a P e5256d91808b47c195bc9b4dbd7f2b87 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 3.
W20260709 13:04:56.982935 19377 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.2:46257, user_credentials={real_user=slave}} blocked reactor thread for 85989us
I20260709 13:04:56.993453 19377 leader_election.cc:400] T 309c3ca0ca4b4f3ba129752ea2cb293b P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 4 election: Vote denied by peer 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257) with higher term. Message: Invalid argument: T 309c3ca0ca4b4f3ba129752ea2cb293b P 0473d2b2d01f4459b1e90fd12cc7840e [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate e5256d91808b47c195bc9b4dbd7f2b87 for earlier term 4. Current term is 5.
W20260709 13:04:56.982843 19375 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.3:36891, user_credentials={real_user=slave}} blocked reactor thread for 85393.3us
W20260709 13:04:56.998735 21267 log.cc:927] Time spent T 0e1085d23e8347fbbd5bce7542f4b1f4 P e61c3a8f61bb48f8a963c9480e53c168: Append to log took a long time: real 0.054s	user 0.000s	sys 0.001s
W20260709 13:04:56.999677 21266 log.cc:927] Time spent T 00000000000000000000000000000000 P 97750b77d35444acb7791ebf26cc2685: Append to log took a long time: real 0.064s	user 0.000s	sys 0.000s
W20260709 13:04:56.983718 21261 log.cc:927] Time spent T 0cdf56e38bbc453d9438d359e5a69955 P 0473d2b2d01f4459b1e90fd12cc7840e: Append to log took a long time: real 0.082s	user 0.001s	sys 0.000s
I20260709 13:04:56.958345 21194 raft_consensus.cc:515] T 46c5bfeecc314717bffe987e6844b6d0 P e5256d91808b47c195bc9b4dbd7f2b87 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:56.994513 21215 leader_election.cc:290] T ff75a1d4cb1f493db8f71ddc136ba9ab P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:04:57.005987 21111 raft_consensus.cc:515] T f93ee515a9c14139bf566522ed8232f3 P e61c3a8f61bb48f8a963c9480e53c168 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:57.015254 19407 raft_consensus.cc:1240] T 46c5bfeecc314717bffe987e6844b6d0 P e5256d91808b47c195bc9b4dbd7f2b87 [term 6 FOLLOWER]: Rejecting Update request from peer e61c3a8f61bb48f8a963c9480e53c168 for earlier term 5. Current term is 6. Ops: []
I20260709 13:04:57.020839 21270 raft_consensus.cc:2804] T 3e1f505cb0f1427bbd698ac889d80821 P e5256d91808b47c195bc9b4dbd7f2b87 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:04:57.021391 19479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28af091831594f9d8e96482078cc7625" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:04:57.021497 20853 raft_consensus.cc:515] T bc225c93219c45538b53a1bd3d387e4d P e61c3a8f61bb48f8a963c9480e53c168 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:57.023600 19554 raft_consensus.cc:1240] T bc225c93219c45538b53a1bd3d387e4d P e61c3a8f61bb48f8a963c9480e53c168 [term 5 FOLLOWER]: Rejecting Update request from peer e5256d91808b47c195bc9b4dbd7f2b87 for earlier term 4. Current term is 5. Ops: []
I20260709 13:04:57.025652 19485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b74109013a140ada21feeef92d6f563" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:04:57.026010 21115 leader_election.cc:290] T d1e5873a19244c5ebbcd38e126796ee7 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:04:57.025928 19483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86a6797bdfe94fa496c050ceae4bd0d9" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:04:57.027163 20819 leader_election.cc:290] T 14935b3ddf914369822e4a0547aaa355 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 2 election: Requested vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:04:57.027493 19484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e5873a19244c5ebbcd38e126796ee7" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:04:57.027217 19479 raft_consensus.cc:1240] T 22196caba61445d3bec98a0aab3c337d P 0473d2b2d01f4459b1e90fd12cc7840e [term 4 FOLLOWER]: Rejecting Update request from peer e5256d91808b47c195bc9b4dbd7f2b87 for earlier term 3. Current term is 4. Ops: []
I20260709 13:04:57.028407 20867 raft_consensus.cc:3055] T ab43d85f64114d4ebf618930e43d9ed0 P e5256d91808b47c195bc9b4dbd7f2b87 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:04:57.028875 20867 raft_consensus.cc:740] T ab43d85f64114d4ebf618930e43d9ed0 P e5256d91808b47c195bc9b4dbd7f2b87 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: e5256d91808b47c195bc9b4dbd7f2b87, State: Running, Role: LEADER
I20260709 13:04:57.031576 19481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14935b3ddf914369822e4a0547aaa355" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
W20260709 13:04:57.034045 19377 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:57.017076 21215 raft_consensus.cc:493] T 76cb037fc9064d13b59a8969d897ce8c P 0473d2b2d01f4459b1e90fd12cc7840e [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:57.040103 19411 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "179fd671030940b4b4a4e24bcc4aba0a"
dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
mode: GRACEFUL
new_leader_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
 from {username='slave'} at 127.0.0.1:37312
I20260709 13:04:57.040509 19409 raft_consensus.cc:2468] T 22196caba61445d3bec98a0aab3c337d P e5256d91808b47c195bc9b4dbd7f2b87 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 4.
I20260709 13:04:57.040936 19411 raft_consensus.cc:606] T 179fd671030940b4b4a4e24bcc4aba0a P e5256d91808b47c195bc9b4dbd7f2b87 [term 2 LEADER]: Received request to transfer leadership to TS 0473d2b2d01f4459b1e90fd12cc7840e
I20260709 13:04:57.047151 19551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14935b3ddf914369822e4a0547aaa355" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:04:57.048060 19551 raft_consensus.cc:2393] T 14935b3ddf914369822e4a0547aaa355 P e61c3a8f61bb48f8a963c9480e53c168 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate e5256d91808b47c195bc9b4dbd7f2b87 in current term 2: Already voted for candidate e61c3a8f61bb48f8a963c9480e53c168 in this term.
I20260709 13:04:57.021497 21270 raft_consensus.cc:493] T 3e1f505cb0f1427bbd698ac889d80821 P e5256d91808b47c195bc9b4dbd7f2b87 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:57.049005 21270 raft_consensus.cc:3060] T 3e1f505cb0f1427bbd698ac889d80821 P e5256d91808b47c195bc9b4dbd7f2b87 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:04:57.051903 19377 leader_election.cc:304] T 28af091831594f9d8e96482078cc7625 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:04:57.053854 19481 raft_consensus.cc:2468] T 14935b3ddf914369822e4a0547aaa355 P 0473d2b2d01f4459b1e90fd12cc7840e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 2.
I20260709 13:04:57.054898 21193 raft_consensus.cc:2749] T 28af091831594f9d8e96482078cc7625 P e5256d91808b47c195bc9b4dbd7f2b87 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:04:57.055014 21194 leader_election.cc:290] T 46c5bfeecc314717bffe987e6844b6d0 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 6 election: Requested vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:04:57.029629 20867 consensus_queue.cc:260] T ab43d85f64114d4ebf618930e43d9ed0 P e5256d91808b47c195bc9b4dbd7f2b87 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } attrs { replace: true } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: NON_VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: true } }
I20260709 13:04:57.056221 19377 leader_election.cc:304] T 86a6797bdfe94fa496c050ceae4bd0d9 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:04:57.056341 21127 leader_election.cc:290] T 3e1f505cb0f1427bbd698ac889d80821 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:04:57.057605 19377 leader_election.cc:304] T 2b74109013a140ada21feeef92d6f563 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:04:57.059681 21260 raft_consensus.cc:2749] T 86a6797bdfe94fa496c050ceae4bd0d9 P e5256d91808b47c195bc9b4dbd7f2b87 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:04:57.060277 21260 raft_consensus.cc:2749] T 2b74109013a140ada21feeef92d6f563 P e5256d91808b47c195bc9b4dbd7f2b87 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:04:57.060693 19408 raft_consensus.cc:1275] T d1e5873a19244c5ebbcd38e126796ee7 P e5256d91808b47c195bc9b4dbd7f2b87 [term 3 FOLLOWER]: Refusing update from remote peer 0473d2b2d01f4459b1e90fd12cc7840e: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:04:57.061777 19408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ec1c4ce15e04c7e8c283a62179f2a64" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:04:57.062382 19402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7be9efa6559648dbb5a0f7684c4542d1" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:04:57.063035 19402 raft_consensus.cc:2468] T 7be9efa6559648dbb5a0f7684c4542d1 P e5256d91808b47c195bc9b4dbd7f2b87 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 4.
I20260709 13:04:57.063814 19377 leader_election.cc:304] T 14935b3ddf914369822e4a0547aaa355 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87; no voters: 
I20260709 13:04:57.064657 19526 leader_election.cc:304] T ab43d85f64114d4ebf618930e43d9ed0 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e61c3a8f61bb48f8a963c9480e53c168; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:04:57.066251 21206 consensus_queue.cc:1048] T 96efeaaf1057492490e9a621f37e1a2d P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:04:57.067019 19403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1b10566f45d4a7d9029858330e02d5b" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:04:57.067322 19410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86a6797bdfe94fa496c050ceae4bd0d9" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:04:57.067648 19403 raft_consensus.cc:2468] T f1b10566f45d4a7d9029858330e02d5b P e5256d91808b47c195bc9b4dbd7f2b87 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 4.
I20260709 13:04:57.068745 19410 raft_consensus.cc:1275] T 9962423cb4e54fcfa5de01daf68a86e7 P e5256d91808b47c195bc9b4dbd7f2b87 [term 5 FOLLOWER]: Refusing update from remote peer 0473d2b2d01f4459b1e90fd12cc7840e: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:04:57.052198 19405 raft_consensus.cc:2468] T 21e14947d70440f19044d8f75c31e1f9 P e5256d91808b47c195bc9b4dbd7f2b87 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 3.
I20260709 13:04:57.070658 20853 leader_election.cc:290] T bc225c93219c45538b53a1bd3d387e4d P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 5 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:04:57.072238 21111 leader_election.cc:290] T f93ee515a9c14139bf566522ed8232f3 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 5 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:04:57.073379 21209 leader_election.cc:290] T ef32ce6fdd0e40d382c79974f30295c6 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 4 election: Requested vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:04:57.067622 21115 raft_consensus.cc:2749] T ab43d85f64114d4ebf618930e43d9ed0 P e61c3a8f61bb48f8a963c9480e53c168 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:04:57.065699 21215 raft_consensus.cc:515] T 76cb037fc9064d13b59a8969d897ce8c P 0473d2b2d01f4459b1e90fd12cc7840e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:57.076172 21260 raft_consensus.cc:2804] T 14935b3ddf914369822e4a0547aaa355 P e5256d91808b47c195bc9b4dbd7f2b87 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:04:57.076666 21260 raft_consensus.cc:697] T 14935b3ddf914369822e4a0547aaa355 P e5256d91808b47c195bc9b4dbd7f2b87 [term 2 LEADER]: Becoming Leader. State: Replica: e5256d91808b47c195bc9b4dbd7f2b87, State: Running, Role: LEADER
I20260709 13:04:57.077085 21215 leader_election.cc:290] T 76cb037fc9064d13b59a8969d897ce8c P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:04:57.078290 19411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e1f505cb0f1427bbd698ac889d80821" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
W20260709 13:04:57.078892 20076 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:57.077518 21260 consensus_queue.cc:237] T 14935b3ddf914369822e4a0547aaa355 P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } attrs { replace: true } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: NON_VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: true } }
I20260709 13:04:57.085667 19483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef32ce6fdd0e40d382c79974f30295c6" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:04:57.086565 19481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46c5bfeecc314717bffe987e6844b6d0" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 6 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:04:57.086887 19408 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "217b5fae677b4971b3bbd2f357a1f7ff"
dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
mode: GRACEFUL
new_leader_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
 from {username='slave'} at 127.0.0.1:37312
I20260709 13:04:57.087476 19408 raft_consensus.cc:606] T 217b5fae677b4971b3bbd2f357a1f7ff P e5256d91808b47c195bc9b4dbd7f2b87 [term 1 LEADER]: Received request to transfer leadership to TS 0473d2b2d01f4459b1e90fd12cc7840e
I20260709 13:04:57.089860 21111 consensus_queue.cc:1048] T 3e1f505cb0f1427bbd698ac889d80821 P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:04:57.092886 19410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff75a1d4cb1f493db8f71ddc136ba9ab" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:04:57.096642 21270 raft_consensus.cc:515] T 3e1f505cb0f1427bbd698ac889d80821 P e5256d91808b47c195bc9b4dbd7f2b87 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:57.097771 19411 raft_consensus.cc:2393] T 3e1f505cb0f1427bbd698ac889d80821 P e5256d91808b47c195bc9b4dbd7f2b87 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0473d2b2d01f4459b1e90fd12cc7840e in current term 3: Already voted for candidate e5256d91808b47c195bc9b4dbd7f2b87 in this term.
I20260709 13:04:57.098834 21230 raft_consensus.cc:493] T 9962423cb4e54fcfa5de01daf68a86e7 P 127766fc592545a4997f7790f50f6076 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:57.099310 21230 raft_consensus.cc:515] T 9962423cb4e54fcfa5de01daf68a86e7 P 127766fc592545a4997f7790f50f6076 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:04:57.101269 21230 leader_election.cc:290] T 9962423cb4e54fcfa5de01daf68a86e7 P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:04:57.102751 20075 leader_election.cc:304] T fa731b585f684a7fb2d106c50f143b83 P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 127766fc592545a4997f7790f50f6076, e5256d91808b47c195bc9b4dbd7f2b87; no voters: 
W20260709 13:04:57.104223 20078 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:57.104372 19479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f93ee515a9c14139bf566522ed8232f3" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
W20260709 13:04:57.105285 21275 log.cc:927] Time spent T bc225c93219c45538b53a1bd3d387e4d P e5256d91808b47c195bc9b4dbd7f2b87: Append to log took a long time: real 0.143s	user 0.000s	sys 0.003s
I20260709 13:04:57.106596 21230 raft_consensus.cc:2804] T fa731b585f684a7fb2d106c50f143b83 P 127766fc592545a4997f7790f50f6076 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:04:57.106738 19479 raft_consensus.cc:1275] T 1efebf73c86e432baa55533136b6e12c P 0473d2b2d01f4459b1e90fd12cc7840e [term 5 FOLLOWER]: Refusing update from remote peer 127766fc592545a4997f7790f50f6076: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
W20260709 13:04:57.107168 20105 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46436 (request call id 315) took 1477 ms (client timeout 1735 ms). Trace:
I20260709 13:04:57.107334 19482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9962423cb4e54fcfa5de01daf68a86e7" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
W20260709 13:04:57.107576 20105 rpcz_store.cc:269] 0709 13:04:55.629836 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:55.647059 (+ 17223us) service_pool.cc:224] Handling call
0709 13:04:56.102037 (+454978us) spinlock_profiling.cc:243] Waited 3.31 ms on lock 0x7b5800010b98. stack: 00007f4a79de9343 00007f4a79de9240 00007f4a797781d4 00007f4a834b6304 00007f4a834b6299 00007f4a79ca3db1 00007f4a79de3b71 00007f4a79de3a22 00007f4a82cfcc09 00007f4a81e56ee0 00007f4a81f200ab 00007f4a81f20131 00007f4a81ece0a0 00007f4a81ecd984 00007f4a7b4486d4 00007f4a7b448662
0709 13:04:57.106948 (+1004911us) spinlock_profiling.cc:243] Waited 158 ms on lock 0x7b5400245c54. stack: 00007f4a79de9343 00007f4a79de9240 00007f4a797781d4 00007f4a834b6304 00007f4a834b6299 00007f4a7ce71571 00007f4a7cf0c2fa 00007f4a81ecdb17 00007f4a7b4486d4 00007f4a7b448662 00007f4a7b448591 00007f4a7b44850c 00007f4a7b4477c2 00007f4a7b24348c 00007f4a7b2428c6 00007f4a7b24226f
0709 13:04:57.107090 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":370216064}
I20260709 13:04:57.108562 21127 consensus_queue.cc:1048] T 9962423cb4e54fcfa5de01daf68a86e7 P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Connected to new peer: Peer: permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:04:57.109530 21127 consensus_queue.cc:1243] T 9962423cb4e54fcfa5de01daf68a86e7 P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Peer 127766fc592545a4997f7790f50f6076 log is divergent from this leader: its last log entry 4.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 13:04:57.111639 20112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ec1c4ce15e04c7e8c283a62179f2a64" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:04:57.112026 21230 raft_consensus.cc:697] T fa731b585f684a7fb2d106c50f143b83 P 127766fc592545a4997f7790f50f6076 [term 4 LEADER]: Becoming Leader. State: Replica: 127766fc592545a4997f7790f50f6076, State: Running, Role: LEADER
I20260709 13:04:57.110452 19410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76cb037fc9064d13b59a8969d897ce8c" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:04:57.103700 19481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc225c93219c45538b53a1bd3d387e4d" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:04:57.120998 21230 consensus_queue.cc:237] T fa731b585f684a7fb2d106c50f143b83 P 127766fc592545a4997f7790f50f6076 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:04:57.122205 19374 leader_election.cc:304] T ff9b0eddd810459b82d91c60777c10eb P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, 127766fc592545a4997f7790f50f6076
I20260709 13:04:57.124017 19374 leader_election.cc:400] T fa731b585f684a7fb2d106c50f143b83 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 3 pre-election: Vote denied by peer 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121) with higher term. Message: Invalid argument: T fa731b585f684a7fb2d106c50f143b83 P 127766fc592545a4997f7790f50f6076 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e5256d91808b47c195bc9b4dbd7f2b87 for earlier term 3. Current term is 4.
I20260709 13:04:57.124855 21126 leader_election.cc:290] T f1b10566f45d4a7d9029858330e02d5b P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:04:57.127631 19374 leader_election.cc:403] T fa731b585f684a7fb2d106c50f143b83 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 3 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:04:57.128671 21262 raft_consensus.cc:2749] T fa731b585f684a7fb2d106c50f143b83 P e5256d91808b47c195bc9b4dbd7f2b87 [term 4 FOLLOWER]: Leader pre-election lost for term 3. Reason: Vote denied by peer 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121) with higher term. Message: Invalid argument: T fa731b585f684a7fb2d106c50f143b83 P 127766fc592545a4997f7790f50f6076 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e5256d91808b47c195bc9b4dbd7f2b87 for earlier term 3. Current term is 4.
I20260709 13:04:57.129184 19374 leader_election.cc:304] T 2a16f7501e2444fb86d4e2778e734e02 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87; no voters: 127766fc592545a4997f7790f50f6076, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:04:57.129801 21203 raft_consensus.cc:3055] T ece3db938bc649d4a40a51522ed5259c P e61c3a8f61bb48f8a963c9480e53c168 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:04:57.130074 21262 raft_consensus.cc:2749] T 2a16f7501e2444fb86d4e2778e734e02 P e5256d91808b47c195bc9b4dbd7f2b87 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:04:57.130183 21203 raft_consensus.cc:740] T ece3db938bc649d4a40a51522ed5259c P e61c3a8f61bb48f8a963c9480e53c168 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: e61c3a8f61bb48f8a963c9480e53c168, State: Running, Role: LEADER
I20260709 13:04:57.131107 21203 consensus_queue.cc:260] T ece3db938bc649d4a40a51522ed5259c P e61c3a8f61bb48f8a963c9480e53c168 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.5, Last appended by leader: 5, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:04:57.126392 21209 raft_consensus.cc:2749] T ff9b0eddd810459b82d91c60777c10eb P e5256d91808b47c195bc9b4dbd7f2b87 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:04:57.132257 21203 raft_consensus.cc:3060] T ece3db938bc649d4a40a51522ed5259c P e61c3a8f61bb48f8a963c9480e53c168 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:04:57.135584 21231 consensus_queue.cc:1048] T 1efebf73c86e432baa55533136b6e12c P 127766fc592545a4997f7790f50f6076 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:04:57.135064 19483 raft_consensus.cc:2468] T ef32ce6fdd0e40d382c79974f30295c6 P 0473d2b2d01f4459b1e90fd12cc7840e [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 4.
I20260709 13:04:57.140275 19410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9962423cb4e54fcfa5de01daf68a86e7" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:04:57.140861 19410 raft_consensus.cc:2468] T 9962423cb4e54fcfa5de01daf68a86e7 P e5256d91808b47c195bc9b4dbd7f2b87 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 127766fc592545a4997f7790f50f6076 in term 5.
I20260709 13:04:57.142091 19407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ece3db938bc649d4a40a51522ed5259c" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
I20260709 13:04:57.143257 20075 leader_election.cc:304] T 9962423cb4e54fcfa5de01daf68a86e7 P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 127766fc592545a4997f7790f50f6076, e5256d91808b47c195bc9b4dbd7f2b87; no voters: 
I20260709 13:04:57.144146 21190 raft_consensus.cc:2804] T 9962423cb4e54fcfa5de01daf68a86e7 P 127766fc592545a4997f7790f50f6076 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:04:57.144492 21190 raft_consensus.cc:493] T 9962423cb4e54fcfa5de01daf68a86e7 P 127766fc592545a4997f7790f50f6076 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:57.144795 21190 raft_consensus.cc:3060] T 9962423cb4e54fcfa5de01daf68a86e7 P 127766fc592545a4997f7790f50f6076 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:04:57.150581 19553 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40438 (request call id 1349) took 1580 ms (client timeout 1905 ms). Trace:
W20260709 13:04:57.151187 19553 rpcz_store.cc:269] 0709 13:04:55.570907 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:55.573039 (+  2132us) service_pool.cc:224] Handling call
0709 13:04:57.150314 (+1577275us) spinlock_profiling.cc:243] Waited 891 ms on lock 0x7b5400341f54. stack: 00007f4a79de9343 00007f4a79de9240 00007f4a797781d4 00007f4a834b6304 00007f4a834b6299 00007f4a7ce71571 00007f4a7cf0c2fa 00007f4a81ecdb17 00007f4a7b4486d4 00007f4a7b448662 00007f4a7b448591 00007f4a7b44850c 00007f4a7b4477c2 00007f4a7b24348c 00007f4a7b2428c6 00007f4a7b24226f
0709 13:04:57.150483 (+   169us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2049119104}
I20260709 13:04:57.151665 21190 raft_consensus.cc:515] T 9962423cb4e54fcfa5de01daf68a86e7 P 127766fc592545a4997f7790f50f6076 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:04:57.157666 21190 leader_election.cc:290] T 9962423cb4e54fcfa5de01daf68a86e7 P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 6 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
W20260709 13:04:57.161291 19375 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.3:36891, user_credentials={real_user=slave}} blocked reactor thread for 97238.3us
I20260709 13:04:57.162971 19552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab43d85f64114d4ebf618930e43d9ed0" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 4 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:04:57.163455 21232 raft_consensus.cc:3060] T 6c5eebf646ad445a9d1b1adc319d7b16 P 127766fc592545a4997f7790f50f6076 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:04:57.163769 19552 raft_consensus.cc:2393] T ab43d85f64114d4ebf618930e43d9ed0 P e61c3a8f61bb48f8a963c9480e53c168 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0473d2b2d01f4459b1e90fd12cc7840e in current term 4: Already voted for candidate e61c3a8f61bb48f8a963c9480e53c168 in this term.
I20260709 13:04:57.164676 19556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46c5bfeecc314717bffe987e6844b6d0" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 6 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:04:57.171361 19404 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52328 (request call id 1230) took 1516 ms. Trace:
I20260709 13:04:57.172017 19404 rpcz_store.cc:276] 0709 13:04:55.654741 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:55.656547 (+  1806us) service_pool.cc:224] Handling call
0709 13:04:56.266633 (+610086us) spinlock_profiling.cc:243] Waited 16.2 ms on lock 0x7b5800183c98. stack: 00007f4a79de9343 00007f4a79de9240 00007f4a797781d4 00007f4a834b6304 00007f4a834b6299 00007f4a79ca3db1 00007f4a79de3b71 00007f4a79de3a22 00007f4a82cfcc09 00007f4a81e56ee0 00007f4a81f200ab 00007f4a81f20131 00007f4a81ee1fc0 00007f4a81ecc929 00007f4a81ecc3d2 00007f4a7b443bd4
0709 13:04:57.112170 (+845537us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:04:57.112535 (+   365us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:04:57.112574 (+    39us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:04:57.113020 (+   446us) log.cc:844] Serialized 26 byte log entry
0709 13:04:57.164501 (+ 51481us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:04:57.164543 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:57.164615 (+    72us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:04:57.169600 (+  4985us) raft_consensus.cc:1685] finished
0709 13:04:57.169622 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:57.171181 (+  1559us) spinlock_profiling.cc:243] Waited 816 ms on lock 0x7b54000e74d0. stack: 00007f4a79de9343 00007f4a79de9240 00007f4a797781d4 00007f4a834b6304 00007f4a834b6299 00007f4a7ce71571 00007f4a7cf078ad 00007f4a81ecc419 00007f4a7b443bd4 00007f4a7b443b62 00007f4a7b443a91 00007f4a7b443a0c 00007f4a7b442cc2 00007f4a7b24348c 00007f4a7b2428c6 00007f4a7b24226f
0709 13:04:57.171284 (+   103us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":242,"raft.run_cpu_time_us":125,"raft.run_wall_time_us":124,"spinlock_wait_cycles":1914334464,"thread_start_us":51084,"threads_started":1,"wal-append.queue_time_us":53186}
I20260709 13:04:57.173463 19405 raft_consensus.cc:1240] T 3e1f505cb0f1427bbd698ac889d80821 P e5256d91808b47c195bc9b4dbd7f2b87 [term 3 FOLLOWER]: Rejecting Update request from peer e61c3a8f61bb48f8a963c9480e53c168 for earlier term 2. Current term is 3. Ops: []
I20260709 13:04:57.174127 19555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff75a1d4cb1f493db8f71ddc136ba9ab" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:04:57.174728 19555 raft_consensus.cc:2468] T ff75a1d4cb1f493db8f71ddc136ba9ab P e61c3a8f61bb48f8a963c9480e53c168 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 4.
I20260709 13:04:57.174944 19557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21e14947d70440f19044d8f75c31e1f9" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:04:57.174996 19405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e5873a19244c5ebbcd38e126796ee7" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:04:57.175761 19557 raft_consensus.cc:2393] T 21e14947d70440f19044d8f75c31e1f9 P e61c3a8f61bb48f8a963c9480e53c168 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0473d2b2d01f4459b1e90fd12cc7840e in current term 3: Already voted for candidate e61c3a8f61bb48f8a963c9480e53c168 in this term.
I20260709 13:04:57.175891 19405 raft_consensus.cc:2468] T d1e5873a19244c5ebbcd38e126796ee7 P e5256d91808b47c195bc9b4dbd7f2b87 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 3.
I20260709 13:04:57.176169 19560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1efebf73c86e432baa55533136b6e12c" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:04:57.176512 19557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86a6797bdfe94fa496c050ceae4bd0d9" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:04:57.177192 19560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e1f505cb0f1427bbd698ac889d80821" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:04:57.177448 19557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76cb037fc9064d13b59a8969d897ce8c" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:04:57.177702 19404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc225c93219c45538b53a1bd3d387e4d" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
I20260709 13:04:57.177986 19557 raft_consensus.cc:2468] T 76cb037fc9064d13b59a8969d897ce8c P e61c3a8f61bb48f8a963c9480e53c168 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 4.
I20260709 13:04:57.178174 19560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1b10566f45d4a7d9029858330e02d5b" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:04:57.179004 19559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b08304a0a02b42d7840c4e8ee9a6bd1a" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:04:57.157899 20867 raft_consensus.cc:3060] T ab43d85f64114d4ebf618930e43d9ed0 P e5256d91808b47c195bc9b4dbd7f2b87 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:04:57.179706 19559 raft_consensus.cc:2393] T b08304a0a02b42d7840c4e8ee9a6bd1a P e61c3a8f61bb48f8a963c9480e53c168 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 0473d2b2d01f4459b1e90fd12cc7840e in current term 3: Already voted for candidate e61c3a8f61bb48f8a963c9480e53c168 in this term.
I20260709 13:04:57.160478 19409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9962423cb4e54fcfa5de01daf68a86e7" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
I20260709 13:04:57.180136 19409 raft_consensus.cc:3060] T 9962423cb4e54fcfa5de01daf68a86e7 P e5256d91808b47c195bc9b4dbd7f2b87 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:04:57.158566 19558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ece3db938bc649d4a40a51522ed5259c" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:04:57.183182 19450 leader_election.cc:304] T bc225c93219c45538b53a1bd3d387e4d P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e; no voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:04:57.184732 19450 leader_election.cc:304] T fa8650e71aa14778b3d73721fc50d9fc P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e; no voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:04:57.184906 21197 raft_consensus.cc:2749] T bc225c93219c45538b53a1bd3d387e4d P 0473d2b2d01f4459b1e90fd12cc7840e [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:04:57.185649 21126 raft_consensus.cc:2749] T fa8650e71aa14778b3d73721fc50d9fc P 0473d2b2d01f4459b1e90fd12cc7840e [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:04:57.184880 19556 raft_consensus.cc:1275] T d1e5873a19244c5ebbcd38e126796ee7 P e61c3a8f61bb48f8a963c9480e53c168 [term 3 FOLLOWER]: Refusing update from remote peer 0473d2b2d01f4459b1e90fd12cc7840e: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:04:57.179121 21208 consensus_queue.cc:1059] T bc225c93219c45538b53a1bd3d387e4d P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 }, Status: INVALID_TERM, Last received: 4.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:04:57.179232 19552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dc5b3532fe54f74876d02beffa2c230" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:04:57.189471 19557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7be9efa6559648dbb5a0f7684c4542d1" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:04:57.189630 21208 raft_consensus.cc:3055] T bc225c93219c45538b53a1bd3d387e4d P e5256d91808b47c195bc9b4dbd7f2b87 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:04:57.190085 21208 raft_consensus.cc:740] T bc225c93219c45538b53a1bd3d387e4d P e5256d91808b47c195bc9b4dbd7f2b87 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: e5256d91808b47c195bc9b4dbd7f2b87, State: Running, Role: LEADER
I20260709 13:04:57.191000 21208 consensus_queue.cc:260] T bc225c93219c45538b53a1bd3d387e4d P e5256d91808b47c195bc9b4dbd7f2b87 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.2, Last appended by leader: 2, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:57.192203 21208 raft_consensus.cc:3060] T bc225c93219c45538b53a1bd3d387e4d P e5256d91808b47c195bc9b4dbd7f2b87 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:04:57.193615 19551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef32ce6fdd0e40d382c79974f30295c6" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:04:57.194651 19551 raft_consensus.cc:2393] T ef32ce6fdd0e40d382c79974f30295c6 P e61c3a8f61bb48f8a963c9480e53c168 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate e5256d91808b47c195bc9b4dbd7f2b87 in current term 4: Already voted for candidate e61c3a8f61bb48f8a963c9480e53c168 in this term.
I20260709 13:04:57.190090 19557 raft_consensus.cc:2468] T 7be9efa6559648dbb5a0f7684c4542d1 P e61c3a8f61bb48f8a963c9480e53c168 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 4.
I20260709 13:04:57.201853 21197 consensus_queue.cc:1048] T 2b74109013a140ada21feeef92d6f563 P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:04:57.203722 19411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f93ee515a9c14139bf566522ed8232f3" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
I20260709 13:04:57.203740 19450 leader_election.cc:304] T ab43d85f64114d4ebf618930e43d9ed0 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e; no voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:04:57.204988 19560 raft_consensus.cc:2393] T f1b10566f45d4a7d9029858330e02d5b P e61c3a8f61bb48f8a963c9480e53c168 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0473d2b2d01f4459b1e90fd12cc7840e in current term 4: Already voted for candidate e61c3a8f61bb48f8a963c9480e53c168 in this term.
I20260709 13:04:57.205564 21253 raft_consensus.cc:3060] T ab43d85f64114d4ebf618930e43d9ed0 P 0473d2b2d01f4459b1e90fd12cc7840e [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:04:57.208077 19409 raft_consensus.cc:2468] T 9962423cb4e54fcfa5de01daf68a86e7 P e5256d91808b47c195bc9b4dbd7f2b87 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 127766fc592545a4997f7790f50f6076 in term 6.
I20260709 13:04:57.209901 19450 leader_election.cc:304] T 1efebf73c86e432baa55533136b6e12c P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e; no voters: 127766fc592545a4997f7790f50f6076, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:04:57.225464 20075 leader_election.cc:304] T 9962423cb4e54fcfa5de01daf68a86e7 P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 127766fc592545a4997f7790f50f6076, e5256d91808b47c195bc9b4dbd7f2b87; no voters: 
I20260709 13:04:57.225889 19450 leader_election.cc:304] T 76cb037fc9064d13b59a8969d897ce8c P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:04:57.226204 21232 raft_consensus.cc:2804] T 9962423cb4e54fcfa5de01daf68a86e7 P 127766fc592545a4997f7790f50f6076 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:04:57.215888 19523 leader_election.cc:304] T fa731b585f684a7fb2d106c50f143b83 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e61c3a8f61bb48f8a963c9480e53c168; no voters: 127766fc592545a4997f7790f50f6076, e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:04:57.226742 21232 raft_consensus.cc:697] T 9962423cb4e54fcfa5de01daf68a86e7 P 127766fc592545a4997f7790f50f6076 [term 6 LEADER]: Becoming Leader. State: Replica: 127766fc592545a4997f7790f50f6076, State: Running, Role: LEADER
I20260709 13:04:57.227310 19450 leader_election.cc:304] T 1dc5b3532fe54f74876d02beffa2c230 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e; no voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:04:57.227447 21111 raft_consensus.cc:2749] T fa731b585f684a7fb2d106c50f143b83 P e61c3a8f61bb48f8a963c9480e53c168 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:04:57.227612 21232 consensus_queue.cc:237] T 9962423cb4e54fcfa5de01daf68a86e7 P 127766fc592545a4997f7790f50f6076 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.5, Last appended by leader: 5, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:04:57.228394 19450 leader_election.cc:304] T 7be9efa6559648dbb5a0f7684c4542d1 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:04:57.229081 21088 consensus_queue.cc:1048] T d1e5873a19244c5ebbcd38e126796ee7 P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:04:57.229447 21105 raft_consensus.cc:2749] T 1dc5b3532fe54f74876d02beffa2c230 P 0473d2b2d01f4459b1e90fd12cc7840e [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:04:57.230319 21127 raft_consensus.cc:2804] T 7be9efa6559648dbb5a0f7684c4542d1 P 0473d2b2d01f4459b1e90fd12cc7840e [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:04:57.230376 19450 leader_election.cc:304] T ff75a1d4cb1f493db8f71ddc136ba9ab P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:04:57.230858 21127 raft_consensus.cc:493] T 7be9efa6559648dbb5a0f7684c4542d1 P 0473d2b2d01f4459b1e90fd12cc7840e [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:57.231261 21215 raft_consensus.cc:2804] T ff75a1d4cb1f493db8f71ddc136ba9ab P 0473d2b2d01f4459b1e90fd12cc7840e [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:04:57.228073 21140 raft_consensus.cc:2804] T 76cb037fc9064d13b59a8969d897ce8c P 0473d2b2d01f4459b1e90fd12cc7840e [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:04:57.231781 21215 raft_consensus.cc:493] T ff75a1d4cb1f493db8f71ddc136ba9ab P 0473d2b2d01f4459b1e90fd12cc7840e [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:57.231874 21140 raft_consensus.cc:493] T 76cb037fc9064d13b59a8969d897ce8c P 0473d2b2d01f4459b1e90fd12cc7840e [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:57.232221 21215 raft_consensus.cc:3060] T ff75a1d4cb1f493db8f71ddc136ba9ab P 0473d2b2d01f4459b1e90fd12cc7840e [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:04:57.232349 21140 raft_consensus.cc:3060] T 76cb037fc9064d13b59a8969d897ce8c P 0473d2b2d01f4459b1e90fd12cc7840e [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:04:57.234107 21240 raft_consensus.cc:493] T b9f0d59553ad444883fcf5b5909f9798 P 0473d2b2d01f4459b1e90fd12cc7840e [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:57.231330 21127 raft_consensus.cc:3060] T 7be9efa6559648dbb5a0f7684c4542d1 P 0473d2b2d01f4459b1e90fd12cc7840e [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:04:57.234563 21240 raft_consensus.cc:515] T b9f0d59553ad444883fcf5b5909f9798 P 0473d2b2d01f4459b1e90fd12cc7840e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:57.236579 21240 leader_election.cc:290] T b9f0d59553ad444883fcf5b5909f9798 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:04:57.239059 21115 consensus_queue.cc:1059] T 46c5bfeecc314717bffe987e6844b6d0 P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 }, Status: INVALID_TERM, Last received: 5.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:04:57.240337 21115 raft_consensus.cc:3055] T 46c5bfeecc314717bffe987e6844b6d0 P e61c3a8f61bb48f8a963c9480e53c168 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:04:57.240674 21115 raft_consensus.cc:740] T 46c5bfeecc314717bffe987e6844b6d0 P e61c3a8f61bb48f8a963c9480e53c168 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: e61c3a8f61bb48f8a963c9480e53c168, State: Running, Role: LEADER
I20260709 13:04:57.241472 21115 consensus_queue.cc:260] T 46c5bfeecc314717bffe987e6844b6d0 P e61c3a8f61bb48f8a963c9480e53c168 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 5.2, Last appended by leader: 2, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:57.241647 21127 raft_consensus.cc:515] T 7be9efa6559648dbb5a0f7684c4542d1 P 0473d2b2d01f4459b1e90fd12cc7840e [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:57.242604 21115 raft_consensus.cc:3060] T 46c5bfeecc314717bffe987e6844b6d0 P e61c3a8f61bb48f8a963c9480e53c168 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:04:57.246845 21140 raft_consensus.cc:515] T 76cb037fc9064d13b59a8969d897ce8c P 0473d2b2d01f4459b1e90fd12cc7840e [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:57.226755 21197 raft_consensus.cc:2749] T 1efebf73c86e432baa55533136b6e12c P 0473d2b2d01f4459b1e90fd12cc7840e [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 13:04:57.248528 20078 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.2:46257, user_credentials={real_user=slave}} blocked reactor thread for 113504us
I20260709 13:04:57.255949 19486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9962423cb4e54fcfa5de01daf68a86e7" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:04:57.256492 21111 consensus_queue.cc:1059] T 3e1f505cb0f1427bbd698ac889d80821 P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:04:57.257439 21061 raft_consensus.cc:3055] T 3e1f505cb0f1427bbd698ac889d80821 P e61c3a8f61bb48f8a963c9480e53c168 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:04:57.256174 21140 leader_election.cc:290] T 76cb037fc9064d13b59a8969d897ce8c P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 5 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:04:57.257799 21061 raft_consensus.cc:740] T 3e1f505cb0f1427bbd698ac889d80821 P e61c3a8f61bb48f8a963c9480e53c168 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: e61c3a8f61bb48f8a963c9480e53c168, State: Running, Role: LEADER
I20260709 13:04:57.258545 19523 leader_election.cc:304] T d1e5873a19244c5ebbcd38e126796ee7 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168; no voters: 0473d2b2d01f4459b1e90fd12cc7840e
I20260709 13:04:57.258898 21061 consensus_queue.cc:260] T 3e1f505cb0f1427bbd698ac889d80821 P e61c3a8f61bb48f8a963c9480e53c168 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:57.260121 21061 raft_consensus.cc:3060] T 3e1f505cb0f1427bbd698ac889d80821 P e61c3a8f61bb48f8a963c9480e53c168 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:04:57.261698 21206 raft_consensus.cc:2804] T d1e5873a19244c5ebbcd38e126796ee7 P e61c3a8f61bb48f8a963c9480e53c168 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:04:57.262151 21206 raft_consensus.cc:493] T d1e5873a19244c5ebbcd38e126796ee7 P e61c3a8f61bb48f8a963c9480e53c168 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:57.262494 21206 raft_consensus.cc:3060] T d1e5873a19244c5ebbcd38e126796ee7 P e61c3a8f61bb48f8a963c9480e53c168 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:04:57.269773 21206 raft_consensus.cc:515] T d1e5873a19244c5ebbcd38e126796ee7 P e61c3a8f61bb48f8a963c9480e53c168 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:57.272976 20112 raft_consensus.cc:1240] T 9962423cb4e54fcfa5de01daf68a86e7 P 127766fc592545a4997f7790f50f6076 [term 6 LEADER]: Rejecting Update request from peer 0473d2b2d01f4459b1e90fd12cc7840e for earlier term 5. Current term is 6. Ops: [3.5-5.6]
I20260709 13:04:57.274854 21206 leader_election.cc:290] T d1e5873a19244c5ebbcd38e126796ee7 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 4 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:04:57.276262 19551 raft_consensus.cc:1240] T f93ee515a9c14139bf566522ed8232f3 P e61c3a8f61bb48f8a963c9480e53c168 [term 5 FOLLOWER]: Rejecting Update request from peer e5256d91808b47c195bc9b4dbd7f2b87 for earlier term 4. Current term is 5. Ops: []
I20260709 13:04:57.285112 20867 consensus_queue.cc:1059] T f93ee515a9c14139bf566522ed8232f3 P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 }, Status: INVALID_TERM, Last received: 4.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:04:57.285676 21127 leader_election.cc:290] T 7be9efa6559648dbb5a0f7684c4542d1 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 5 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:04:57.286127 20867 raft_consensus.cc:3055] T f93ee515a9c14139bf566522ed8232f3 P e5256d91808b47c195bc9b4dbd7f2b87 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:04:57.286646 20867 raft_consensus.cc:740] T f93ee515a9c14139bf566522ed8232f3 P e5256d91808b47c195bc9b4dbd7f2b87 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: e5256d91808b47c195bc9b4dbd7f2b87, State: Running, Role: LEADER
I20260709 13:04:57.287441 20867 consensus_queue.cc:260] T f93ee515a9c14139bf566522ed8232f3 P e5256d91808b47c195bc9b4dbd7f2b87 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.2, Last appended by leader: 2, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:57.288689 20867 raft_consensus.cc:3060] T f93ee515a9c14139bf566522ed8232f3 P e5256d91808b47c195bc9b4dbd7f2b87 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:04:57.288386 19557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7be9efa6559648dbb5a0f7684c4542d1" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:04:57.290968 19555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76cb037fc9064d13b59a8969d897ce8c" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:04:57.291507 19555 raft_consensus.cc:3060] T 76cb037fc9064d13b59a8969d897ce8c P e61c3a8f61bb48f8a963c9480e53c168 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:04:57.292649 19560 raft_consensus.cc:1240] T d1e5873a19244c5ebbcd38e126796ee7 P e61c3a8f61bb48f8a963c9480e53c168 [term 4 FOLLOWER]: Rejecting Update request from peer 0473d2b2d01f4459b1e90fd12cc7840e for earlier term 3. Current term is 4. Ops: [3.3-3.3]
I20260709 13:04:57.290956 19557 raft_consensus.cc:3060] T 7be9efa6559648dbb5a0f7684c4542d1 P e61c3a8f61bb48f8a963c9480e53c168 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:04:57.303134 19551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9f0d59553ad444883fcf5b5909f9798" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:04:57.303498 19555 raft_consensus.cc:2468] T 76cb037fc9064d13b59a8969d897ce8c P e61c3a8f61bb48f8a963c9480e53c168 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 5.
I20260709 13:04:57.303965 19551 raft_consensus.cc:2468] T b9f0d59553ad444883fcf5b5909f9798 P e61c3a8f61bb48f8a963c9480e53c168 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 2.
I20260709 13:04:57.277172 19523 leader_election.cc:304] T bc225c93219c45538b53a1bd3d387e4d P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e61c3a8f61bb48f8a963c9480e53c168; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:04:57.305122 21111 raft_consensus.cc:2749] T bc225c93219c45538b53a1bd3d387e4d P e61c3a8f61bb48f8a963c9480e53c168 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:04:57.248970 21253 raft_consensus.cc:2749] T ab43d85f64114d4ebf618930e43d9ed0 P 0473d2b2d01f4459b1e90fd12cc7840e [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:04:57.280498 21260 raft_consensus.cc:493] T df751f992649444090e27965eb1af85d P e5256d91808b47c195bc9b4dbd7f2b87 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:57.306062 21260 raft_consensus.cc:515] T df751f992649444090e27965eb1af85d P e5256d91808b47c195bc9b4dbd7f2b87 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:57.308048 21260 leader_election.cc:290] T df751f992649444090e27965eb1af85d P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:04:57.201938 19449 leader_election.cc:304] T 1f85fc4b527a48848e5faa083b604e36 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e; no voters: 127766fc592545a4997f7790f50f6076, e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:04:57.308972 21127 raft_consensus.cc:2749] T 1f85fc4b527a48848e5faa083b604e36 P 0473d2b2d01f4459b1e90fd12cc7840e [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:04:57.309989 19551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df751f992649444090e27965eb1af85d" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:04:57.310729 19551 raft_consensus.cc:2468] T df751f992649444090e27965eb1af85d P e61c3a8f61bb48f8a963c9480e53c168 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 3.
I20260709 13:04:57.311921 19375 leader_election.cc:304] T df751f992649444090e27965eb1af85d P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:04:57.312858 21260 raft_consensus.cc:2804] T df751f992649444090e27965eb1af85d P e5256d91808b47c195bc9b4dbd7f2b87 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:04:57.313242 21260 raft_consensus.cc:493] T df751f992649444090e27965eb1af85d P e5256d91808b47c195bc9b4dbd7f2b87 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:57.313627 21260 raft_consensus.cc:3060] T df751f992649444090e27965eb1af85d P e5256d91808b47c195bc9b4dbd7f2b87 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:04:57.314321 19523 leader_election.cc:304] T f93ee515a9c14139bf566522ed8232f3 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e61c3a8f61bb48f8a963c9480e53c168; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:04:57.315127 21111 raft_consensus.cc:2749] T f93ee515a9c14139bf566522ed8232f3 P e61c3a8f61bb48f8a963c9480e53c168 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:04:57.318461 19409 raft_consensus.cc:1275] T 22196caba61445d3bec98a0aab3c337d P e5256d91808b47c195bc9b4dbd7f2b87 [term 4 FOLLOWER]: Refusing update from remote peer e61c3a8f61bb48f8a963c9480e53c168: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:04:57.318768 21270 leader_election.cc:290] T 3e1f505cb0f1427bbd698ac889d80821 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 3 election: Requested vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:04:57.321506 21260 raft_consensus.cc:515] T df751f992649444090e27965eb1af85d P e5256d91808b47c195bc9b4dbd7f2b87 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:57.329020 19409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e5873a19244c5ebbcd38e126796ee7" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
I20260709 13:04:57.329758 19409 raft_consensus.cc:3060] T d1e5873a19244c5ebbcd38e126796ee7 P e5256d91808b47c195bc9b4dbd7f2b87 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:04:57.332953 19525 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:57.337056 19409 raft_consensus.cc:2468] T d1e5873a19244c5ebbcd38e126796ee7 P e5256d91808b47c195bc9b4dbd7f2b87 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 4.
I20260709 13:04:57.355211 19558 raft_consensus.cc:2468] T ece3db938bc649d4a40a51522ed5259c P e61c3a8f61bb48f8a963c9480e53c168 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 127766fc592545a4997f7790f50f6076 in term 5.
I20260709 13:04:57.355401 19523 leader_election.cc:304] T d1e5873a19244c5ebbcd38e126796ee7 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
W20260709 13:04:57.309957 19449 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.1:40321, user_credentials={real_user=slave}} blocked reactor thread for 108129us
I20260709 13:04:57.351244 19304 catalog_manager.cc:5697] T 62c6c134d3d24a1ab144dd9ee6bc3f64 P 127766fc592545a4997f7790f50f6076 reported cstate change: term changed from 2 to 3, leader changed from e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3) to 127766fc592545a4997f7790f50f6076 (127.17.223.4). New cstate: current_term: 3 leader_uuid: "127766fc592545a4997f7790f50f6076" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:04:57.356830 19449 leader_election.cc:304] T b08304a0a02b42d7840c4e8ee9a6bd1a P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87; no voters: e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:04:57.357128 19304 catalog_manager.cc:5697] T 2a16f7501e2444fb86d4e2778e734e02 P 127766fc592545a4997f7790f50f6076 reported cstate change: term changed from 2 to 5, leader changed from e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1) to 127766fc592545a4997f7790f50f6076 (127.17.223.4). New cstate: current_term: 5 leader_uuid: "127766fc592545a4997f7790f50f6076" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:04:57.357925 21206 raft_consensus.cc:2804] T d1e5873a19244c5ebbcd38e126796ee7 P e61c3a8f61bb48f8a963c9480e53c168 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:04:57.358748 19304 catalog_manager.cc:5697] T 14efcc79969f41babe5529c22d59156d P 127766fc592545a4997f7790f50f6076 reported cstate change: term changed from 2 to 4, leader changed from 127766fc592545a4997f7790f50f6076 (127.17.223.4) to e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1). New cstate: current_term: 4 leader_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } } }
I20260709 13:04:57.359524 21206 raft_consensus.cc:697] T d1e5873a19244c5ebbcd38e126796ee7 P e61c3a8f61bb48f8a963c9480e53c168 [term 4 LEADER]: Becoming Leader. State: Replica: e61c3a8f61bb48f8a963c9480e53c168, State: Running, Role: LEADER
I20260709 13:04:57.352330 21111 consensus_queue.cc:1048] T 22196caba61445d3bec98a0aab3c337d P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:04:57.360664 21206 consensus_queue.cc:237] T d1e5873a19244c5ebbcd38e126796ee7 P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:57.361099 19304 catalog_manager.cc:5697] T ab43d85f64114d4ebf618930e43d9ed0 P 127766fc592545a4997f7790f50f6076 reported cstate change: term changed from 1 to 3, leader changed from e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3) to e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1). New cstate: current_term: 3 leader_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } attrs { replace: true } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: NON_VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: true } } }
I20260709 13:04:57.362078 21215 raft_consensus.cc:515] T ff75a1d4cb1f493db8f71ddc136ba9ab P 0473d2b2d01f4459b1e90fd12cc7840e [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:57.362814 19304 catalog_manager.cc:5697] T 833a2f0775ed407a94b8924ce50adb63 P 127766fc592545a4997f7790f50f6076 reported cstate change: term changed from 1 to 3, leader changed from e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3) to e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1). New cstate: current_term: 3 leader_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } } }
I20260709 13:04:57.364096 20076 leader_election.cc:304] T ece3db938bc649d4a40a51522ed5259c P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 127766fc592545a4997f7790f50f6076, e61c3a8f61bb48f8a963c9480e53c168; no voters: e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:04:57.364471 21215 leader_election.cc:290] T ff75a1d4cb1f493db8f71ddc136ba9ab P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 5 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:04:57.365224 21110 raft_consensus.cc:2804] T ece3db938bc649d4a40a51522ed5259c P 127766fc592545a4997f7790f50f6076 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:04:57.365581 19555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e1f505cb0f1427bbd698ac889d80821" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:04:57.365701 21110 raft_consensus.cc:697] T ece3db938bc649d4a40a51522ed5259c P 127766fc592545a4997f7790f50f6076 [term 5 LEADER]: Becoming Leader. State: Replica: 127766fc592545a4997f7790f50f6076, State: Running, Role: LEADER
I20260709 13:04:57.366353 19555 raft_consensus.cc:2410] T 3e1f505cb0f1427bbd698ac889d80821 P e61c3a8f61bb48f8a963c9480e53c168 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate e5256d91808b47c195bc9b4dbd7f2b87 for term 3 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:04:57.366511 21110 consensus_queue.cc:237] T ece3db938bc649d4a40a51522ed5259c P 127766fc592545a4997f7790f50f6076 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:04:57.364127 19304 catalog_manager.cc:5697] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P 127766fc592545a4997f7790f50f6076 reported cstate change: term changed from 2 to 4, leader changed from 127766fc592545a4997f7790f50f6076 (127.17.223.4) to e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1). New cstate: current_term: 4 leader_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } } }
I20260709 13:04:57.368366 19306 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:44688 (request call id 222) took 6528 ms. Trace:
I20260709 13:04:57.369113 19304 catalog_manager.cc:5697] T 0e1085d23e8347fbbd5bce7542f4b1f4 P 127766fc592545a4997f7790f50f6076 reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "127766fc592545a4997f7790f50f6076" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:04:57.370607 19304 catalog_manager.cc:5697] T 9962423cb4e54fcfa5de01daf68a86e7 P 127766fc592545a4997f7790f50f6076 reported cstate change: term changed from 3 to 4, leader changed from 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2) to 127766fc592545a4997f7790f50f6076 (127.17.223.4). New cstate: current_term: 4 leader_uuid: "127766fc592545a4997f7790f50f6076" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:04:57.368826 19306 rpcz_store.cc:276] 0709 13:04:50.840477 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:50.840628 (+   151us) service_pool.cc:224] Handling call
0709 13:04:57.368292 (+6527664us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:04:56.430609 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:04:56.579419 (+148810us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:04:56.579469 (+    50us) write_op.cc:435] Acquired schema lock
0709 13:04:56.579494 (+    25us) tablet.cc:662] Decoding operations
0709 13:04:56.600156 (+ 20662us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:04:56.600219 (+    63us) write_op.cc:641] Partition lock acquired for write op
0709 13:04:56.600247 (+    28us) tablet.cc:685] Acquiring locks for 10 operations
0709 13:04:56.601111 (+   864us) tablet.cc:701] Row locks acquired
0709 13:04:56.601128 (+    17us) write_op.cc:260] PREPARE: finished
0709 13:04:56.601279 (+   151us) write_op.cc:270] Start()
0709 13:04:56.601419 (+   140us) write_op.cc:276] Timestamp: P: 1783602296601234 usec, L: 0
0709 13:04:56.601441 (+    22us) op_driver.cc:348] REPLICATION: starting
0709 13:04:56.602109 (+   668us) log.cc:844] Serialized 3994 byte log entry
0709 13:04:57.019931 (+417822us) op_driver.cc:464] REPLICATION: finished
0709 13:04:57.042305 (+ 22374us) write_op.cc:301] APPLY: starting
0709 13:04:57.042383 (+    78us) tablet.cc:1367] starting BulkCheckPresence
0709 13:04:57.042583 (+   200us) tablet.cc:1370] finished BulkCheckPresence
0709 13:04:57.042701 (+   118us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:04:57.102994 (+ 60293us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:04:57.331241 (+228247us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=10
0709 13:04:57.331287 (+    46us) write_op.cc:312] APPLY: finished
0709 13:04:57.331553 (+   266us) log.cc:844] Serialized 77 byte log entry
0709 13:04:57.331727 (+   174us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:04:57.331842 (+   115us) write_op.cc:454] Released schema lock
0709 13:04:57.331887 (+    45us) write_op.cc:341] FINISH: Updating metrics
0709 13:04:57.333555 (+  1668us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:04:57.333592 (+    37us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":199,"reported_tablets":17,"child_traces":[["op",{"apply.queue_time_us":10517,"apply.run_cpu_time_us":2904,"apply.run_wall_time_us":291147,"num_ops":10,"prepare.queue_time_us":414427,"prepare.run_cpu_time_us":21176,"prepare.run_wall_time_us":371606,"raft.queue_time_us":15093,"raft.run_cpu_time_us":7064,"raft.run_wall_time_us":26402,"replication_time_us":414536,"spinlock_wait_cycles":15232,"thread_start_us":480653,"threads_started":4,"wal-append.queue_time_us":277047}]]}
I20260709 13:04:57.375731 19304 catalog_manager.cc:5697] T 309c3ca0ca4b4f3ba129752ea2cb293b P 127766fc592545a4997f7790f50f6076 reported cstate change: config changed from index 3 to 5, 127766fc592545a4997f7790f50f6076 (127.17.223.4) changed from NON_VOTER to VOTER. New cstate: current_term: 3 leader_uuid: "e61c3a8f61bb48f8a963c9480e53c168" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } attrs { replace: true } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } } }
I20260709 13:04:57.379208 19304 catalog_manager.cc:5697] T 70797e5783b5454ab0d0eea663e791e3 P 127766fc592545a4997f7790f50f6076 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } } }
I20260709 13:04:57.388842 19304 catalog_manager.cc:5697] T 85c494af21f9457a85da47b9bc70c1fd P 127766fc592545a4997f7790f50f6076 reported cstate change: term changed from 1 to 2, leader changed from e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3) to e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1). New cstate: current_term: 2 leader_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } } }
I20260709 13:04:57.390560 21127 raft_consensus.cc:2804] T b08304a0a02b42d7840c4e8ee9a6bd1a P 0473d2b2d01f4459b1e90fd12cc7840e [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:04:57.391227 21127 raft_consensus.cc:697] T b08304a0a02b42d7840c4e8ee9a6bd1a P 0473d2b2d01f4459b1e90fd12cc7840e [term 3 LEADER]: Becoming Leader. State: Replica: 0473d2b2d01f4459b1e90fd12cc7840e, State: Running, Role: LEADER
I20260709 13:04:57.391817 19450 leader_election.cc:304] T 76cb037fc9064d13b59a8969d897ce8c P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:04:57.392027 21140 consensus_queue.cc:1059] T d1e5873a19244c5ebbcd38e126796ee7 P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:04:57.392673 19450 leader_election.cc:304] T b9f0d59553ad444883fcf5b5909f9798 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:04:57.392061 21127 consensus_queue.cc:237] T b08304a0a02b42d7840c4e8ee9a6bd1a P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:57.393365 21253 raft_consensus.cc:3055] T d1e5873a19244c5ebbcd38e126796ee7 P 0473d2b2d01f4459b1e90fd12cc7840e [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:04:57.393505 21126 raft_consensus.cc:2804] T b9f0d59553ad444883fcf5b5909f9798 P 0473d2b2d01f4459b1e90fd12cc7840e [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:04:57.393767 21253 raft_consensus.cc:740] T d1e5873a19244c5ebbcd38e126796ee7 P 0473d2b2d01f4459b1e90fd12cc7840e [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 0473d2b2d01f4459b1e90fd12cc7840e, State: Running, Role: LEADER
I20260709 13:04:57.393921 21126 raft_consensus.cc:493] T b9f0d59553ad444883fcf5b5909f9798 P 0473d2b2d01f4459b1e90fd12cc7840e [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:57.394270 21126 raft_consensus.cc:3060] T b9f0d59553ad444883fcf5b5909f9798 P 0473d2b2d01f4459b1e90fd12cc7840e [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:04:57.394641 21253 consensus_queue.cc:260] T d1e5873a19244c5ebbcd38e126796ee7 P 0473d2b2d01f4459b1e90fd12cc7840e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:57.395823 21253 raft_consensus.cc:3060] T d1e5873a19244c5ebbcd38e126796ee7 P 0473d2b2d01f4459b1e90fd12cc7840e [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:04:57.392946 21140 raft_consensus.cc:2804] T 76cb037fc9064d13b59a8969d897ce8c P 0473d2b2d01f4459b1e90fd12cc7840e [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:04:57.399169 21140 raft_consensus.cc:697] T 76cb037fc9064d13b59a8969d897ce8c P 0473d2b2d01f4459b1e90fd12cc7840e [term 5 LEADER]: Becoming Leader. State: Replica: 0473d2b2d01f4459b1e90fd12cc7840e, State: Running, Role: LEADER
I20260709 13:04:57.400067 21140 consensus_queue.cc:237] T 76cb037fc9064d13b59a8969d897ce8c P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
W20260709 13:04:57.401788 19449 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.1:40321, user_credentials={real_user=slave}} blocked reactor thread for 45068.4us
I20260709 13:04:57.282191 19377 leader_election.cc:304] T 46c5bfeecc314717bffe987e6844b6d0 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168
W20260709 13:04:57.409266 19377 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.2:46257, user_credentials={real_user=slave}} blocked reactor thread for 127143us
I20260709 13:04:57.415061 19557 raft_consensus.cc:2468] T 7be9efa6559648dbb5a0f7684c4542d1 P e61c3a8f61bb48f8a963c9480e53c168 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 5.
I20260709 13:04:57.415984 19558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff75a1d4cb1f493db8f71ddc136ba9ab" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:04:57.422695 19558 raft_consensus.cc:3060] T ff75a1d4cb1f493db8f71ddc136ba9ab P e61c3a8f61bb48f8a963c9480e53c168 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:04:57.426645 19450 leader_election.cc:304] T 7be9efa6559648dbb5a0f7684c4542d1 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:04:57.427542 21105 raft_consensus.cc:2804] T 7be9efa6559648dbb5a0f7684c4542d1 P 0473d2b2d01f4459b1e90fd12cc7840e [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:04:57.428138 21105 raft_consensus.cc:697] T 7be9efa6559648dbb5a0f7684c4542d1 P 0473d2b2d01f4459b1e90fd12cc7840e [term 5 LEADER]: Becoming Leader. State: Replica: 0473d2b2d01f4459b1e90fd12cc7840e, State: Running, Role: LEADER
I20260709 13:04:57.429152 21105 consensus_queue.cc:237] T 7be9efa6559648dbb5a0f7684c4542d1 P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:57.444103 19377 leader_election.cc:304] T ef32ce6fdd0e40d382c79974f30295c6 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87; no voters: e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:04:57.409384 19449 leader_election.cc:304] T 86a6797bdfe94fa496c050ceae4bd0d9 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e; no voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:04:57.450645 19449 leader_election.cc:304] T f1b10566f45d4a7d9029858330e02d5b P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87; no voters: e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:04:57.422001 20867 raft_consensus.cc:2749] T 46c5bfeecc314717bffe987e6844b6d0 P e5256d91808b47c195bc9b4dbd7f2b87 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:04:57.468747 21260 leader_election.cc:290] T df751f992649444090e27965eb1af85d P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 4 election: Requested vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:04:57.468917 21110 raft_consensus.cc:493] T 5ec1c4ce15e04c7e8c283a62179f2a64 P 127766fc592545a4997f7790f50f6076 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e5256d91808b47c195bc9b4dbd7f2b87)
I20260709 13:04:57.469172 21248 raft_consensus.cc:993] T 179fd671030940b4b4a4e24bcc4aba0a P e5256d91808b47c195bc9b4dbd7f2b87: : Instructing follower 0473d2b2d01f4459b1e90fd12cc7840e to start an election
I20260709 13:04:57.469655 21248 raft_consensus.cc:1081] T 179fd671030940b4b4a4e24bcc4aba0a P e5256d91808b47c195bc9b4dbd7f2b87 [term 2 LEADER]: Signalling peer 0473d2b2d01f4459b1e90fd12cc7840e to start an election
I20260709 13:04:57.469501 21110 raft_consensus.cc:515] T 5ec1c4ce15e04c7e8c283a62179f2a64 P 127766fc592545a4997f7790f50f6076 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:04:57.471709 21110 leader_election.cc:290] T 5ec1c4ce15e04c7e8c283a62179f2a64 P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:04:57.472958 19484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e1f505cb0f1427bbd698ac889d80821" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:04:57.475381 19409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ec1c4ce15e04c7e8c283a62179f2a64" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:04:57.474331 19483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df751f992649444090e27965eb1af85d" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:04:57.477963 19483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ec1c4ce15e04c7e8c283a62179f2a64" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:04:57.477763 19557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df751f992649444090e27965eb1af85d" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:04:57.478658 19557 raft_consensus.cc:3060] T df751f992649444090e27965eb1af85d P e61c3a8f61bb48f8a963c9480e53c168 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:04:57.465103 21088 raft_consensus.cc:2804] T f1b10566f45d4a7d9029858330e02d5b P 0473d2b2d01f4459b1e90fd12cc7840e [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:04:57.454155 21105 raft_consensus.cc:2749] T 86a6797bdfe94fa496c050ceae4bd0d9 P 0473d2b2d01f4459b1e90fd12cc7840e [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:04:57.459715 21192 raft_consensus.cc:2804] T ef32ce6fdd0e40d382c79974f30295c6 P e5256d91808b47c195bc9b4dbd7f2b87 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:04:57.486972 20078 leader_election.cc:304] T 5ec1c4ce15e04c7e8c283a62179f2a64 P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 127766fc592545a4997f7790f50f6076; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:04:57.487900 19483 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "179fd671030940b4b4a4e24bcc4aba0a"
dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
 from {username='slave'} at 127.0.0.1:58294
I20260709 13:04:57.493503 19483 raft_consensus.cc:493] T 179fd671030940b4b4a4e24bcc4aba0a P 0473d2b2d01f4459b1e90fd12cc7840e [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:04:57.493865 19483 raft_consensus.cc:3060] T 179fd671030940b4b4a4e24bcc4aba0a P 0473d2b2d01f4459b1e90fd12cc7840e [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:04:57.487910 19409 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "775c229504194560ba9589bc2199b089"
dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
mode: GRACEFUL
new_leader_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
 from {username='slave'} at 127.0.0.1:37312
I20260709 13:04:57.494583 19409 raft_consensus.cc:606] T 775c229504194560ba9589bc2199b089 P e5256d91808b47c195bc9b4dbd7f2b87 [term 3 FOLLOWER]: Received request to transfer leadership to TS 0473d2b2d01f4459b1e90fd12cc7840e
I20260709 13:04:57.494925 19409 raft_consensus.cc:614] T 775c229504194560ba9589bc2199b089 P e5256d91808b47c195bc9b4dbd7f2b87 [term 3 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:04:57.488366 19377 leader_election.cc:304] T 3e1f505cb0f1427bbd698ac889d80821 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:04:57.497572 19557 raft_consensus.cc:2468] T df751f992649444090e27965eb1af85d P e61c3a8f61bb48f8a963c9480e53c168 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 4.
I20260709 13:04:57.498965 19375 leader_election.cc:304] T df751f992649444090e27965eb1af85d P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168; no voters: 0473d2b2d01f4459b1e90fd12cc7840e
I20260709 13:04:57.499377 19485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df751f992649444090e27965eb1af85d" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:04:57.485617 21088 raft_consensus.cc:493] T f1b10566f45d4a7d9029858330e02d5b P 0473d2b2d01f4459b1e90fd12cc7840e [term 3 FOLLOWER]: Starting leader election (detected failure of leader e5256d91808b47c195bc9b4dbd7f2b87)
I20260709 13:04:57.491755 21061 raft_consensus.cc:493] T 0afb57ae58a24a01850491d69f0213dd P e61c3a8f61bb48f8a963c9480e53c168 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:57.557587 21061 raft_consensus.cc:515] T 0afb57ae58a24a01850491d69f0213dd P e61c3a8f61bb48f8a963c9480e53c168 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:04:57.563997 21061 leader_election.cc:290] T 0afb57ae58a24a01850491d69f0213dd P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:04:57.549326 19558 raft_consensus.cc:2468] T ff75a1d4cb1f493db8f71ddc136ba9ab P e61c3a8f61bb48f8a963c9480e53c168 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 5.
I20260709 13:04:57.550602 19483 raft_consensus.cc:515] T 179fd671030940b4b4a4e24bcc4aba0a P 0473d2b2d01f4459b1e90fd12cc7840e [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
W20260709 13:04:57.551442 19449 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.1:40321, user_credentials={real_user=slave}} blocked reactor thread for 60902us
I20260709 13:04:57.501055 21230 raft_consensus.cc:2749] T 5ec1c4ce15e04c7e8c283a62179f2a64 P 127766fc592545a4997f7790f50f6076 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:04:57.546957 21194 raft_consensus.cc:2804] T df751f992649444090e27965eb1af85d P e5256d91808b47c195bc9b4dbd7f2b87 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:04:57.549984 21088 raft_consensus.cc:3060] T f1b10566f45d4a7d9029858330e02d5b P 0473d2b2d01f4459b1e90fd12cc7840e [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:04:57.553143 21203 raft_consensus.cc:493] T 62c6c134d3d24a1ab144dd9ee6bc3f64 P e61c3a8f61bb48f8a963c9480e53c168 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 127766fc592545a4997f7790f50f6076)
I20260709 13:04:57.574306 20108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0afb57ae58a24a01850491d69f0213dd" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:04:57.574733 21203 raft_consensus.cc:515] T 62c6c134d3d24a1ab144dd9ee6bc3f64 P e61c3a8f61bb48f8a963c9480e53c168 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:04:57.575099 20108 raft_consensus.cc:2468] T 0afb57ae58a24a01850491d69f0213dd P 127766fc592545a4997f7790f50f6076 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 2.
I20260709 13:04:57.577008 21203 leader_election.cc:290] T 62c6c134d3d24a1ab144dd9ee6bc3f64 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:04:57.492668 21197 consensus_queue.cc:1048] T 9962423cb4e54fcfa5de01daf68a86e7 P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.062s
I20260709 13:04:57.554203 21192 raft_consensus.cc:697] T ef32ce6fdd0e40d382c79974f30295c6 P e5256d91808b47c195bc9b4dbd7f2b87 [term 4 LEADER]: Becoming Leader. State: Replica: e5256d91808b47c195bc9b4dbd7f2b87, State: Running, Role: LEADER
I20260709 13:04:57.491567 20853 raft_consensus.cc:493] T 14935b3ddf914369822e4a0547aaa355 P e61c3a8f61bb48f8a963c9480e53c168 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:57.499236 21260 raft_consensus.cc:2749] T 3e1f505cb0f1427bbd698ac889d80821 P e5256d91808b47c195bc9b4dbd7f2b87 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:04:57.568239 19450 leader_election.cc:304] T ff75a1d4cb1f493db8f71ddc136ba9ab P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:04:57.500994 21248 raft_consensus.cc:493] T ff75a1d4cb1f493db8f71ddc136ba9ab P e5256d91808b47c195bc9b4dbd7f2b87 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 0473d2b2d01f4459b1e90fd12cc7840e)
I20260709 13:04:57.585211 21248 raft_consensus.cc:515] T ff75a1d4cb1f493db8f71ddc136ba9ab P e5256d91808b47c195bc9b4dbd7f2b87 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:57.571784 19409 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "bc225c93219c45538b53a1bd3d387e4d"
dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
mode: GRACEFUL
new_leader_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
 from {username='slave'} at 127.0.0.1:37312
I20260709 13:04:57.586921 19409 raft_consensus.cc:606] T bc225c93219c45538b53a1bd3d387e4d P e5256d91808b47c195bc9b4dbd7f2b87 [term 5 FOLLOWER]: Received request to transfer leadership to TS 0473d2b2d01f4459b1e90fd12cc7840e
I20260709 13:04:57.587251 19409 raft_consensus.cc:614] T bc225c93219c45538b53a1bd3d387e4d P e5256d91808b47c195bc9b4dbd7f2b87 [term 5 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:04:57.583771 20853 raft_consensus.cc:515] T 14935b3ddf914369822e4a0547aaa355 P e61c3a8f61bb48f8a963c9480e53c168 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } attrs { replace: true } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: NON_VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: true } }
I20260709 13:04:57.589340 21194 raft_consensus.cc:697] T df751f992649444090e27965eb1af85d P e5256d91808b47c195bc9b4dbd7f2b87 [term 4 LEADER]: Becoming Leader. State: Replica: e5256d91808b47c195bc9b4dbd7f2b87, State: Running, Role: LEADER
I20260709 13:04:57.587270 21248 leader_election.cc:290] T ff75a1d4cb1f493db8f71ddc136ba9ab P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:04:57.590507 20853 leader_election.cc:290] T 14935b3ddf914369822e4a0547aaa355 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:04:57.590255 21194 consensus_queue.cc:237] T df751f992649444090e27965eb1af85d P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:57.592229 19523 leader_election.cc:304] T 0afb57ae58a24a01850491d69f0213dd P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 127766fc592545a4997f7790f50f6076, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:04:57.593899 21197 raft_consensus.cc:2804] T ff75a1d4cb1f493db8f71ddc136ba9ab P 0473d2b2d01f4459b1e90fd12cc7840e [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:04:57.594385 21197 raft_consensus.cc:697] T ff75a1d4cb1f493db8f71ddc136ba9ab P 0473d2b2d01f4459b1e90fd12cc7840e [term 5 LEADER]: Becoming Leader. State: Replica: 0473d2b2d01f4459b1e90fd12cc7840e, State: Running, Role: LEADER
I20260709 13:04:57.595258 21197 consensus_queue.cc:237] T ff75a1d4cb1f493db8f71ddc136ba9ab P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:57.594256 21061 raft_consensus.cc:2804] T 0afb57ae58a24a01850491d69f0213dd P e61c3a8f61bb48f8a963c9480e53c168 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:04:57.601891 21061 raft_consensus.cc:493] T 0afb57ae58a24a01850491d69f0213dd P e61c3a8f61bb48f8a963c9480e53c168 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:57.602293 21061 raft_consensus.cc:3060] T 0afb57ae58a24a01850491d69f0213dd P e61c3a8f61bb48f8a963c9480e53c168 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:04:57.601622 21192 consensus_queue.cc:237] T ef32ce6fdd0e40d382c79974f30295c6 P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:57.624636 19409 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ece3db938bc649d4a40a51522ed5259c"
dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
mode: GRACEFUL
new_leader_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
 from {username='slave'} at 127.0.0.1:37312
I20260709 13:04:57.625229 19409 raft_consensus.cc:606] T ece3db938bc649d4a40a51522ed5259c P e5256d91808b47c195bc9b4dbd7f2b87 [term 4 FOLLOWER]: Received request to transfer leadership to TS e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:04:57.625558 19409 raft_consensus.cc:614] T ece3db938bc649d4a40a51522ed5259c P e5256d91808b47c195bc9b4dbd7f2b87 [term 4 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:04:57.626130 20112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62c6c134d3d24a1ab144dd9ee6bc3f64" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:04:57.626847 20112 raft_consensus.cc:2468] T 62c6c134d3d24a1ab144dd9ee6bc3f64 P 127766fc592545a4997f7790f50f6076 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 4.
I20260709 13:04:57.627269 19555 raft_consensus.cc:1275] T 309c3ca0ca4b4f3ba129752ea2cb293b P e61c3a8f61bb48f8a963c9480e53c168 [term 5 FOLLOWER]: Refusing update from remote peer e5256d91808b47c195bc9b4dbd7f2b87: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:04:57.628499 18300 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 13:04:57.629592 19477 raft_consensus.cc:1275] T 14935b3ddf914369822e4a0547aaa355 P 0473d2b2d01f4459b1e90fd12cc7840e [term 2 FOLLOWER]: Refusing update from remote peer e5256d91808b47c195bc9b4dbd7f2b87: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 13:04:57.630158 18300 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:04:57.631163 19477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff75a1d4cb1f493db8f71ddc136ba9ab" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:04:57.631693 21088 raft_consensus.cc:515] T f1b10566f45d4a7d9029858330e02d5b P 0473d2b2d01f4459b1e90fd12cc7840e [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:57.632570 19404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14935b3ddf914369822e4a0547aaa355" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:04:57.659948 21061 raft_consensus.cc:515] T 0afb57ae58a24a01850491d69f0213dd P e61c3a8f61bb48f8a963c9480e53c168 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:04:57.632658 19523 leader_election.cc:304] T 62c6c134d3d24a1ab144dd9ee6bc3f64 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 127766fc592545a4997f7790f50f6076, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:04:57.634658 19477 raft_consensus.cc:1240] T 179fd671030940b4b4a4e24bcc4aba0a P 0473d2b2d01f4459b1e90fd12cc7840e [term 3 FOLLOWER]: Rejecting Update request from peer e5256d91808b47c195bc9b4dbd7f2b87 for earlier term 2. Current term is 3. Ops: []
I20260709 13:04:57.638526 19551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff75a1d4cb1f493db8f71ddc136ba9ab" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:04:57.647977 20112 raft_consensus.cc:1275] T 309c3ca0ca4b4f3ba129752ea2cb293b P 127766fc592545a4997f7790f50f6076 [term 5 FOLLOWER]: Refusing update from remote peer e5256d91808b47c195bc9b4dbd7f2b87: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:04:57.663067 19551 raft_consensus.cc:2368] T ff75a1d4cb1f493db8f71ddc136ba9ab P e61c3a8f61bb48f8a963c9480e53c168 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e5256d91808b47c195bc9b4dbd7f2b87 for earlier term 4. Current term is 5.
I20260709 13:04:57.663396 20853 raft_consensus.cc:2804] T 62c6c134d3d24a1ab144dd9ee6bc3f64 P e61c3a8f61bb48f8a963c9480e53c168 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:04:57.663779 20853 raft_consensus.cc:493] T 62c6c134d3d24a1ab144dd9ee6bc3f64 P e61c3a8f61bb48f8a963c9480e53c168 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 127766fc592545a4997f7790f50f6076)
I20260709 13:04:57.664144 20853 raft_consensus.cc:3060] T 62c6c134d3d24a1ab144dd9ee6bc3f64 P e61c3a8f61bb48f8a963c9480e53c168 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:04:57.665585 19375 leader_election.cc:400] T ff75a1d4cb1f493db8f71ddc136ba9ab P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 4 pre-election: Vote denied by peer e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891) with higher term. Message: Invalid argument: T ff75a1d4cb1f493db8f71ddc136ba9ab P e61c3a8f61bb48f8a963c9480e53c168 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e5256d91808b47c195bc9b4dbd7f2b87 for earlier term 4. Current term is 5.
I20260709 13:04:57.665877 19375 leader_election.cc:403] T ff75a1d4cb1f493db8f71ddc136ba9ab P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 4 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:04:57.666093 21061 leader_election.cc:290] T 0afb57ae58a24a01850491d69f0213dd P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 3 election: Requested vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:04:57.668509 21208 consensus_queue.cc:1048] T 14935b3ddf914369822e4a0547aaa355 P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:04:57.668399 20867 raft_consensus.cc:3060] T ff75a1d4cb1f493db8f71ddc136ba9ab P e5256d91808b47c195bc9b4dbd7f2b87 [term 3 FOLLOWER]: Advancing to term 5
I20260709 13:04:57.673162 21230 raft_consensus.cc:493] T ff9b0eddd810459b82d91c60777c10eb P 127766fc592545a4997f7790f50f6076 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:57.673645 21230 raft_consensus.cc:515] T ff9b0eddd810459b82d91c60777c10eb P 127766fc592545a4997f7790f50f6076 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:04:57.673691 20853 raft_consensus.cc:515] T 62c6c134d3d24a1ab144dd9ee6bc3f64 P e61c3a8f61bb48f8a963c9480e53c168 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:04:57.675833 21230 leader_election.cc:290] T ff9b0eddd810459b82d91c60777c10eb P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:04:57.676286 21088 leader_election.cc:290] T f1b10566f45d4a7d9029858330e02d5b P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 4 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:04:57.581528 19449 leader_election.cc:304] T 28af091831594f9d8e96482078cc7625 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87; no voters: e61c3a8f61bb48f8a963c9480e53c168
W20260709 13:04:57.657267 19374 consensus_peers.cc:597] T 14935b3ddf914369822e4a0547aaa355 P e5256d91808b47c195bc9b4dbd7f2b87 -> Peer 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121): Couldn't send request to peer 127766fc592545a4997f7790f50f6076. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:57.659662 21126 raft_consensus.cc:515] T b9f0d59553ad444883fcf5b5909f9798 P 0473d2b2d01f4459b1e90fd12cc7840e [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:57.676810 20867 raft_consensus.cc:2749] T ff75a1d4cb1f493db8f71ddc136ba9ab P e5256d91808b47c195bc9b4dbd7f2b87 [term 5 FOLLOWER]: Leader pre-election lost for term 4. Reason: Vote denied by peer e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891) with higher term. Message: Invalid argument: T ff75a1d4cb1f493db8f71ddc136ba9ab P e61c3a8f61bb48f8a963c9480e53c168 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e5256d91808b47c195bc9b4dbd7f2b87 for earlier term 4. Current term is 5.
I20260709 13:04:57.678359 19404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff9b0eddd810459b82d91c60777c10eb" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:04:57.679142 19404 raft_consensus.cc:2468] T ff9b0eddd810459b82d91c60777c10eb P e5256d91808b47c195bc9b4dbd7f2b87 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 127766fc592545a4997f7790f50f6076 in term 3.
I20260709 13:04:57.660754 21043 tablet_bootstrap.cc:492] T 14935b3ddf914369822e4a0547aaa355 P 127766fc592545a4997f7790f50f6076: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
W20260709 13:04:57.680289 19449 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.1:40321, user_credentials={real_user=slave}} blocked reactor thread for 98835.8us
I20260709 13:04:57.680768 21043 tablet_bootstrap.cc:492] T 14935b3ddf914369822e4a0547aaa355 P 127766fc592545a4997f7790f50f6076: Bootstrap complete.
I20260709 13:04:57.681190 21127 raft_consensus.cc:2804] T 28af091831594f9d8e96482078cc7625 P 0473d2b2d01f4459b1e90fd12cc7840e [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:04:57.681293 20075 leader_election.cc:304] T ff9b0eddd810459b82d91c60777c10eb P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 127766fc592545a4997f7790f50f6076, e5256d91808b47c195bc9b4dbd7f2b87; no voters: 
I20260709 13:04:57.681669 21127 raft_consensus.cc:493] T 28af091831594f9d8e96482078cc7625 P 0473d2b2d01f4459b1e90fd12cc7840e [term 4 FOLLOWER]: Starting leader election (detected failure of leader e61c3a8f61bb48f8a963c9480e53c168)
I20260709 13:04:57.682101 21127 raft_consensus.cc:3060] T 28af091831594f9d8e96482078cc7625 P 0473d2b2d01f4459b1e90fd12cc7840e [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:04:57.682441 21191 raft_consensus.cc:2804] T ff9b0eddd810459b82d91c60777c10eb P 127766fc592545a4997f7790f50f6076 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:04:57.682895 21191 raft_consensus.cc:493] T ff9b0eddd810459b82d91c60777c10eb P 127766fc592545a4997f7790f50f6076 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:57.683236 21191 raft_consensus.cc:3060] T ff9b0eddd810459b82d91c60777c10eb P 127766fc592545a4997f7790f50f6076 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:04:57.683673 21126 leader_election.cc:290] T b9f0d59553ad444883fcf5b5909f9798 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 3 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:04:57.681540 21043 ts_tablet_manager.cc:1403] T 14935b3ddf914369822e4a0547aaa355 P 127766fc592545a4997f7790f50f6076: Time spent bootstrapping tablet: real 0.884s	user 0.027s	sys 0.000s
I20260709 13:04:57.654645 21260 consensus_queue.cc:1048] T 309c3ca0ca4b4f3ba129752ea2cb293b P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:04:57.687737 21043 raft_consensus.cc:359] T 14935b3ddf914369822e4a0547aaa355 P 127766fc592545a4997f7790f50f6076 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } attrs { replace: true } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: NON_VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: true } }
I20260709 13:04:57.694209 21194 consensus_queue.cc:1059] T 179fd671030940b4b4a4e24bcc4aba0a P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:04:57.694573 21253 raft_consensus.cc:493] T df751f992649444090e27965eb1af85d P 0473d2b2d01f4459b1e90fd12cc7840e [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e5256d91808b47c195bc9b4dbd7f2b87)
I20260709 13:04:57.694916 19560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9f0d59553ad444883fcf5b5909f9798" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:04:57.695288 21194 raft_consensus.cc:3055] T 179fd671030940b4b4a4e24bcc4aba0a P e5256d91808b47c195bc9b4dbd7f2b87 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:04:57.695104 21253 raft_consensus.cc:515] T df751f992649444090e27965eb1af85d P 0473d2b2d01f4459b1e90fd12cc7840e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:57.695653 19560 raft_consensus.cc:3060] T b9f0d59553ad444883fcf5b5909f9798 P e61c3a8f61bb48f8a963c9480e53c168 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:04:57.697467 21253 leader_election.cc:290] T df751f992649444090e27965eb1af85d P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:04:57.697986 19551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1b10566f45d4a7d9029858330e02d5b" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:04:57.689090 21127 raft_consensus.cc:515] T 28af091831594f9d8e96482078cc7625 P 0473d2b2d01f4459b1e90fd12cc7840e [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
W20260709 13:04:57.691694 19523 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:57.650353 19483 leader_election.cc:290] T 179fd671030940b4b4a4e24bcc4aba0a P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 3 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:04:57.698997 19485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff9b0eddd810459b82d91c60777c10eb" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:04:57.695668 21194 raft_consensus.cc:740] T 179fd671030940b4b4a4e24bcc4aba0a P e5256d91808b47c195bc9b4dbd7f2b87 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: e5256d91808b47c195bc9b4dbd7f2b87, State: Running, Role: LEADER
I20260709 13:04:57.699626 19485 raft_consensus.cc:2468] T ff9b0eddd810459b82d91c60777c10eb P 0473d2b2d01f4459b1e90fd12cc7840e [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 127766fc592545a4997f7790f50f6076 in term 2.
I20260709 13:04:57.700173 21194 consensus_queue.cc:260] T 179fd671030940b4b4a4e24bcc4aba0a P e5256d91808b47c195bc9b4dbd7f2b87 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:57.700991 21127 leader_election.cc:290] T 28af091831594f9d8e96482078cc7625 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 5 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:04:57.701654 21194 raft_consensus.cc:3060] T 179fd671030940b4b4a4e24bcc4aba0a P e5256d91808b47c195bc9b4dbd7f2b87 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:04:57.704628 19560 raft_consensus.cc:2468] T b9f0d59553ad444883fcf5b5909f9798 P e61c3a8f61bb48f8a963c9480e53c168 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 3.
I20260709 13:04:57.704864 19404 raft_consensus.cc:1275] T fa731b585f684a7fb2d106c50f143b83 P e5256d91808b47c195bc9b4dbd7f2b87 [term 4 FOLLOWER]: Refusing update from remote peer 127766fc592545a4997f7790f50f6076: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:04:57.705988 19557 raft_consensus.cc:1275] T 14935b3ddf914369822e4a0547aaa355 P e61c3a8f61bb48f8a963c9480e53c168 [term 2 FOLLOWER]: Refusing update from remote peer e5256d91808b47c195bc9b4dbd7f2b87: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 13:04:57.707837 19558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "179fd671030940b4b4a4e24bcc4aba0a" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:04:57.707780 21260 consensus_queue.cc:1048] T 14935b3ddf914369822e4a0547aaa355 P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:04:57.708424 19558 raft_consensus.cc:3060] T 179fd671030940b4b4a4e24bcc4aba0a P e61c3a8f61bb48f8a963c9480e53c168 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:04:57.707898 21230 consensus_queue.cc:1048] T fa731b585f684a7fb2d106c50f143b83 P 127766fc592545a4997f7790f50f6076 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.003s
I20260709 13:04:57.711256 19551 raft_consensus.cc:2393] T f1b10566f45d4a7d9029858330e02d5b P e61c3a8f61bb48f8a963c9480e53c168 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 0473d2b2d01f4459b1e90fd12cc7840e in current term 4: Already voted for candidate e61c3a8f61bb48f8a963c9480e53c168 in this term.
I20260709 13:04:57.690490 19449 leader_election.cc:304] T 3e1f505cb0f1427bbd698ac889d80821 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e; no voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:04:57.721712 19449 leader_election.cc:304] T 21e14947d70440f19044d8f75c31e1f9 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87; no voters: e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:04:57.721882 21191 raft_consensus.cc:515] T ff9b0eddd810459b82d91c60777c10eb P 127766fc592545a4997f7790f50f6076 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:04:57.744558 19404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff9b0eddd810459b82d91c60777c10eb" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
I20260709 13:04:57.745318 19404 raft_consensus.cc:3060] T ff9b0eddd810459b82d91c60777c10eb P e5256d91808b47c195bc9b4dbd7f2b87 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:04:57.754638 21191 leader_election.cc:290] T ff9b0eddd810459b82d91c60777c10eb P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 4 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:04:57.724097 21088 raft_consensus.cc:3060] T 3e1f505cb0f1427bbd698ac889d80821 P 0473d2b2d01f4459b1e90fd12cc7840e [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:04:57.760602 19404 raft_consensus.cc:2468] T ff9b0eddd810459b82d91c60777c10eb P e5256d91808b47c195bc9b4dbd7f2b87 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 127766fc592545a4997f7790f50f6076 in term 4.
I20260709 13:04:57.725116 21126 raft_consensus.cc:2804] T 21e14947d70440f19044d8f75c31e1f9 P 0473d2b2d01f4459b1e90fd12cc7840e [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:04:57.726903 21231 raft_consensus.cc:493] T 85c494af21f9457a85da47b9bc70c1fd P 127766fc592545a4997f7790f50f6076 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e5256d91808b47c195bc9b4dbd7f2b87)
I20260709 13:04:57.761875 20075 leader_election.cc:304] T ff9b0eddd810459b82d91c60777c10eb P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 127766fc592545a4997f7790f50f6076, e5256d91808b47c195bc9b4dbd7f2b87; no voters: 
I20260709 13:04:57.761860 21231 raft_consensus.cc:515] T 85c494af21f9457a85da47b9bc70c1fd P 127766fc592545a4997f7790f50f6076 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:04:57.763643 21191 raft_consensus.cc:2804] T ff9b0eddd810459b82d91c60777c10eb P 127766fc592545a4997f7790f50f6076 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:04:57.764115 21231 leader_election.cc:290] T 85c494af21f9457a85da47b9bc70c1fd P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:04:57.728217 19551 raft_consensus.cc:1275] T fa731b585f684a7fb2d106c50f143b83 P e61c3a8f61bb48f8a963c9480e53c168 [term 4 FOLLOWER]: Refusing update from remote peer 127766fc592545a4997f7790f50f6076: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:04:57.728850 21260 consensus_queue.cc:1048] T 309c3ca0ca4b4f3ba129752ea2cb293b P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Connected to new peer: Peer: permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:04:57.764351 21191 raft_consensus.cc:697] T ff9b0eddd810459b82d91c60777c10eb P 127766fc592545a4997f7790f50f6076 [term 4 LEADER]: Becoming Leader. State: Replica: 127766fc592545a4997f7790f50f6076, State: Running, Role: LEADER
I20260709 13:04:57.734627 21194 raft_consensus.cc:993] T 217b5fae677b4971b3bbd2f357a1f7ff P e5256d91808b47c195bc9b4dbd7f2b87: : Instructing follower 0473d2b2d01f4459b1e90fd12cc7840e to start an election
I20260709 13:04:57.765177 20105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0afb57ae58a24a01850491d69f0213dd" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076"
I20260709 13:04:57.765373 21191 consensus_queue.cc:237] T ff9b0eddd810459b82d91c60777c10eb P 127766fc592545a4997f7790f50f6076 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:04:57.765730 21194 raft_consensus.cc:1081] T 217b5fae677b4971b3bbd2f357a1f7ff P e5256d91808b47c195bc9b4dbd7f2b87 [term 1 LEADER]: Signalling peer 0473d2b2d01f4459b1e90fd12cc7840e to start an election
I20260709 13:04:57.737761 19553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28af091831594f9d8e96482078cc7625" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:04:57.735364 19560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df751f992649444090e27965eb1af85d" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:04:57.765774 20105 raft_consensus.cc:3060] T 0afb57ae58a24a01850491d69f0213dd P 127766fc592545a4997f7790f50f6076 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:04:57.767026 19560 raft_consensus.cc:2368] T df751f992649444090e27965eb1af85d P e61c3a8f61bb48f8a963c9480e53c168 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0473d2b2d01f4459b1e90fd12cc7840e for earlier term 3. Current term is 4.
I20260709 13:04:57.767331 21231 consensus_queue.cc:1048] T fa731b585f684a7fb2d106c50f143b83 P 127766fc592545a4997f7790f50f6076 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:04:57.766482 19551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85c494af21f9457a85da47b9bc70c1fd" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:04:57.742165 19450 leader_election.cc:304] T b9f0d59553ad444883fcf5b5909f9798 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:04:57.769485 21126 raft_consensus.cc:493] T 21e14947d70440f19044d8f75c31e1f9 P 0473d2b2d01f4459b1e90fd12cc7840e [term 2 FOLLOWER]: Starting leader election (detected failure of leader e5256d91808b47c195bc9b4dbd7f2b87)
I20260709 13:04:57.769914 21126 raft_consensus.cc:3060] T 21e14947d70440f19044d8f75c31e1f9 P 0473d2b2d01f4459b1e90fd12cc7840e [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:04:57.770493 19484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff9b0eddd810459b82d91c60777c10eb" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:04:57.772105 19484 raft_consensus.cc:3060] T ff9b0eddd810459b82d91c60777c10eb P 0473d2b2d01f4459b1e90fd12cc7840e [term 2 FOLLOWER]: Advancing to term 4
I20260709 13:04:57.771296 21197 raft_consensus.cc:2804] T b9f0d59553ad444883fcf5b5909f9798 P 0473d2b2d01f4459b1e90fd12cc7840e [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:04:57.775234 21197 raft_consensus.cc:697] T b9f0d59553ad444883fcf5b5909f9798 P 0473d2b2d01f4459b1e90fd12cc7840e [term 3 LEADER]: Becoming Leader. State: Replica: 0473d2b2d01f4459b1e90fd12cc7840e, State: Running, Role: LEADER
I20260709 13:04:57.776104 21197 consensus_queue.cc:237] T b9f0d59553ad444883fcf5b5909f9798 P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:57.777714 20105 raft_consensus.cc:2468] T 0afb57ae58a24a01850491d69f0213dd P 127766fc592545a4997f7790f50f6076 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 3.
I20260709 13:04:57.694227 21043 raft_consensus.cc:740] T 14935b3ddf914369822e4a0547aaa355 P 127766fc592545a4997f7790f50f6076 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 127766fc592545a4997f7790f50f6076, State: Initialized, Role: LEARNER
I20260709 13:04:57.779073 19484 raft_consensus.cc:2468] T ff9b0eddd810459b82d91c60777c10eb P 0473d2b2d01f4459b1e90fd12cc7840e [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 127766fc592545a4997f7790f50f6076 in term 4.
I20260709 13:04:57.779196 19483 raft_consensus.cc:3055] T 9962423cb4e54fcfa5de01daf68a86e7 P 0473d2b2d01f4459b1e90fd12cc7840e [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:04:57.779667 19483 raft_consensus.cc:740] T 9962423cb4e54fcfa5de01daf68a86e7 P 0473d2b2d01f4459b1e90fd12cc7840e [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 0473d2b2d01f4459b1e90fd12cc7840e, State: Running, Role: LEADER
I20260709 13:04:57.779412 21043 consensus_queue.cc:260] T 14935b3ddf914369822e4a0547aaa355 P 127766fc592545a4997f7790f50f6076 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } attrs { replace: true } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: NON_VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: true } }
I20260709 13:04:57.780844 19483 consensus_queue.cc:260] T 9962423cb4e54fcfa5de01daf68a86e7 P 0473d2b2d01f4459b1e90fd12cc7840e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:04:57.781482 21043 ts_tablet_manager.cc:1434] T 14935b3ddf914369822e4a0547aaa355 P 127766fc592545a4997f7790f50f6076: Time spent starting tablet: real 0.097s	user 0.005s	sys 0.001s
I20260709 13:04:57.782063 19479 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "217b5fae677b4971b3bbd2f357a1f7ff"
dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
 from {username='slave'} at 127.0.0.1:58294
I20260709 13:04:57.782644 19479 raft_consensus.cc:493] T 217b5fae677b4971b3bbd2f357a1f7ff P 0473d2b2d01f4459b1e90fd12cc7840e [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:04:57.783031 19479 raft_consensus.cc:3060] T 217b5fae677b4971b3bbd2f357a1f7ff P 0473d2b2d01f4459b1e90fd12cc7840e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:57.793582 19479 raft_consensus.cc:515] T 217b5fae677b4971b3bbd2f357a1f7ff P 0473d2b2d01f4459b1e90fd12cc7840e [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:57.795915 19450 leader_election.cc:400] T df751f992649444090e27965eb1af85d P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 3 pre-election: Vote denied by peer e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891) with higher term. Message: Invalid argument: T df751f992649444090e27965eb1af85d P e61c3a8f61bb48f8a963c9480e53c168 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0473d2b2d01f4459b1e90fd12cc7840e for earlier term 3. Current term is 4.
I20260709 13:04:57.823879 19450 leader_election.cc:403] T df751f992649444090e27965eb1af85d P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 3 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:04:57.824884 19479 leader_election.cc:290] T 217b5fae677b4971b3bbd2f357a1f7ff P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 2 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:04:57.782080 19483 raft_consensus.cc:3060] T 9962423cb4e54fcfa5de01daf68a86e7 P 0473d2b2d01f4459b1e90fd12cc7840e [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:04:57.826239 21127 raft_consensus.cc:3060] T df751f992649444090e27965eb1af85d P 0473d2b2d01f4459b1e90fd12cc7840e [term 2 FOLLOWER]: Advancing to term 4
I20260709 13:04:57.826833 19553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "217b5fae677b4971b3bbd2f357a1f7ff" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:04:57.827625 19553 raft_consensus.cc:3060] T 217b5fae677b4971b3bbd2f357a1f7ff P e61c3a8f61bb48f8a963c9480e53c168 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:04:57.797101 21308 log.cc:927] Time spent T ff75a1d4cb1f493db8f71ddc136ba9ab P 0473d2b2d01f4459b1e90fd12cc7840e: Append to log took a long time: real 0.068s	user 0.000s	sys 0.000s
I20260709 13:04:57.830166 19560 raft_consensus.cc:1275] T b08304a0a02b42d7840c4e8ee9a6bd1a P e61c3a8f61bb48f8a963c9480e53c168 [term 3 FOLLOWER]: Refusing update from remote peer 0473d2b2d01f4459b1e90fd12cc7840e: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:04:57.799839 21088 raft_consensus.cc:2749] T 3e1f505cb0f1427bbd698ac889d80821 P 0473d2b2d01f4459b1e90fd12cc7840e [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:04:57.800230 19404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85c494af21f9457a85da47b9bc70c1fd" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:04:57.833472 19404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1b10566f45d4a7d9029858330e02d5b" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
I20260709 13:04:57.837109 20075 leader_election.cc:304] T 85c494af21f9457a85da47b9bc70c1fd P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 127766fc592545a4997f7790f50f6076; no voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:04:57.803268 19409 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ab43d85f64114d4ebf618930e43d9ed0"
dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:52318
I20260709 13:04:57.838765 21231 raft_consensus.cc:2749] T 85c494af21f9457a85da47b9bc70c1fd P 127766fc592545a4997f7790f50f6076 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:04:57.838917 19409 raft_consensus.cc:606] T ab43d85f64114d4ebf618930e43d9ed0 P e5256d91808b47c195bc9b4dbd7f2b87 [term 4 FOLLOWER]: Received request to transfer leadership
I20260709 13:04:57.839363 19409 raft_consensus.cc:614] T ab43d85f64114d4ebf618930e43d9ed0 P e5256d91808b47c195bc9b4dbd7f2b87 [term 4 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:04:57.840119 19409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9f0d59553ad444883fcf5b5909f9798" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
I20260709 13:04:57.840601 19409 raft_consensus.cc:3060] T b9f0d59553ad444883fcf5b5909f9798 P e5256d91808b47c195bc9b4dbd7f2b87 [term 1 FOLLOWER]: Advancing to term 3
I20260709 13:04:57.804437 19523 leader_election.cc:304] T 0afb57ae58a24a01850491d69f0213dd P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 127766fc592545a4997f7790f50f6076, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:04:57.805723 19411 raft_consensus.cc:1275] T 9962423cb4e54fcfa5de01daf68a86e7 P e5256d91808b47c195bc9b4dbd7f2b87 [term 6 FOLLOWER]: Refusing update from remote peer 127766fc592545a4997f7790f50f6076: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 6 index: 6. (index mismatch)
I20260709 13:04:57.809580 19304 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:51954 (request call id 126) took 2597 ms. Trace:
I20260709 13:04:57.810289 19309 catalog_manager.cc:5697] T 2725d2c4cb054f18b0fc8f735c15f6c2 P e5256d91808b47c195bc9b4dbd7f2b87 reported cstate change: term changed from 1 to 3, leader changed from e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3) to e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1). New cstate: current_term: 3 leader_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } health_report { overall_health: HEALTHY } } }
I20260709 13:04:57.844554 20108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62c6c134d3d24a1ab144dd9ee6bc3f64" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076"
I20260709 13:04:57.845655 19309 catalog_manager.cc:5697] T 22196caba61445d3bec98a0aab3c337d P e5256d91808b47c195bc9b4dbd7f2b87 reported cstate change: term changed from 1 to 3, leader changed from e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3) to e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1). New cstate: current_term: 3 leader_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } health_report { overall_health: HEALTHY } } }
I20260709 13:04:57.843506 19304 rpcz_store.cc:276] 0709 13:04:55.212139 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:55.212281 (+   142us) service_pool.cc:224] Handling call
0709 13:04:57.809518 (+2597237us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:04:57.643015 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:04:57.643664 (+   649us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:04:57.643701 (+    37us) write_op.cc:435] Acquired schema lock
0709 13:04:57.643721 (+    20us) tablet.cc:662] Decoding operations
0709 13:04:57.644906 (+  1185us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:04:57.644961 (+    55us) write_op.cc:641] Partition lock acquired for write op
0709 13:04:57.644990 (+    29us) tablet.cc:685] Acquiring locks for 11 operations
0709 13:04:57.646032 (+  1042us) tablet.cc:701] Row locks acquired
0709 13:04:57.646046 (+    14us) write_op.cc:260] PREPARE: finished
0709 13:04:57.646178 (+   132us) write_op.cc:270] Start()
0709 13:04:57.646277 (+    99us) write_op.cc:276] Timestamp: P: 1783602297646138 usec, L: 0
0709 13:04:57.646294 (+    17us) op_driver.cc:348] REPLICATION: starting
0709 13:04:57.691261 (+ 44967us) log.cc:844] Serialized 4458 byte log entry
0709 13:04:57.786832 (+ 95571us) op_driver.cc:464] REPLICATION: finished
0709 13:04:57.787169 (+   337us) write_op.cc:301] APPLY: starting
0709 13:04:57.787252 (+    83us) tablet.cc:1367] starting BulkCheckPresence
0709 13:04:57.787462 (+   210us) tablet.cc:1370] finished BulkCheckPresence
0709 13:04:57.787550 (+    88us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:04:57.788698 (+  1148us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:04:57.788903 (+   205us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=11
0709 13:04:57.788953 (+    50us) write_op.cc:312] APPLY: finished
0709 13:04:57.789222 (+   269us) log.cc:844] Serialized 83 byte log entry
0709 13:04:57.789392 (+   170us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:04:57.789549 (+   157us) write_op.cc:454] Released schema lock
0709 13:04:57.789594 (+    45us) write_op.cc:341] FINISH: Updating metrics
0709 13:04:57.789908 (+   314us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:04:57.789933 (+    25us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":6268,"reported_tablets":19,"child_traces":[["op",{"apply.queue_time_us":111,"apply.run_cpu_time_us":2701,"apply.run_wall_time_us":2701,"num_ops":11,"prepare.queue_time_us":179813,"prepare.run_cpu_time_us":4366,"prepare.run_wall_time_us":58889,"replication_time_us":109707,"thread_start_us":83269,"threads_started":1}]]}
I20260709 13:04:57.813603 19410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76cb037fc9064d13b59a8969d897ce8c" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
I20260709 13:04:57.847061 21061 raft_consensus.cc:2804] T 0afb57ae58a24a01850491d69f0213dd P e61c3a8f61bb48f8a963c9480e53c168 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:04:57.847295 19410 raft_consensus.cc:3060] T 76cb037fc9064d13b59a8969d897ce8c P e5256d91808b47c195bc9b4dbd7f2b87 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:04:57.814378 19408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7be9efa6559648dbb5a0f7684c4542d1" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
I20260709 13:04:57.848063 19408 raft_consensus.cc:3060] T 7be9efa6559648dbb5a0f7684c4542d1 P e5256d91808b47c195bc9b4dbd7f2b87 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:04:57.847353 19309 catalog_manager.cc:5697] T 40e1e16737a842ee936002830f36882e P e5256d91808b47c195bc9b4dbd7f2b87 reported cstate change: term changed from 2 to 4, leader changed from e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3) to e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1). New cstate: current_term: 4 leader_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } health_report { overall_health: HEALTHY } } }
I20260709 13:04:57.815213 19406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff75a1d4cb1f493db8f71ddc136ba9ab" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
I20260709 13:04:57.812906 19407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9f0d59553ad444883fcf5b5909f9798" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:04:57.844142 19411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28af091831594f9d8e96482078cc7625" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
I20260709 13:04:57.796095 19558 raft_consensus.cc:2468] T 179fd671030940b4b4a4e24bcc4aba0a P e61c3a8f61bb48f8a963c9480e53c168 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 3.
I20260709 13:04:57.821031 19402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "179fd671030940b4b4a4e24bcc4aba0a" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
I20260709 13:04:57.823311 20853 leader_election.cc:290] T 62c6c134d3d24a1ab144dd9ee6bc3f64 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 4 election: Requested vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:04:57.827708 19496 tablet_copy_service.cc:342] P 0473d2b2d01f4459b1e90fd12cc7840e: Request end of tablet copy session 127766fc592545a4997f7790f50f6076-14935b3ddf914369822e4a0547aaa355 received from {username='slave'} at 127.0.0.1:39478
I20260709 13:04:57.842253 21126 raft_consensus.cc:515] T 21e14947d70440f19044d8f75c31e1f9 P 0473d2b2d01f4459b1e90fd12cc7840e [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:57.816497 20112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36f6ba92b9ba46babe4ebd6c02e5fbd9" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076"
I20260709 13:04:57.881119 20112 raft_consensus.cc:2410] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P 127766fc592545a4997f7790f50f6076 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 0473d2b2d01f4459b1e90fd12cc7840e for term 5 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 13:04:57.881803 19407 raft_consensus.cc:3060] T ece3db938bc649d4a40a51522ed5259c P e5256d91808b47c195bc9b4dbd7f2b87 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:04:57.849669 19309 catalog_manager.cc:5697] T 0cdf56e38bbc453d9438d359e5a69955 P e5256d91808b47c195bc9b4dbd7f2b87 reported cstate change: term changed from 2 to 4, leader changed from e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3) to e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1). New cstate: current_term: 4 leader_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:57.854861 19409 raft_consensus.cc:2468] T b9f0d59553ad444883fcf5b5909f9798 P e5256d91808b47c195bc9b4dbd7f2b87 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 3.
I20260709 13:04:57.857143 19483 raft_consensus.cc:1275] T 9962423cb4e54fcfa5de01daf68a86e7 P 0473d2b2d01f4459b1e90fd12cc7840e [term 6 FOLLOWER]: Refusing update from remote peer 127766fc592545a4997f7790f50f6076: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 6 index: 6. (term mismatch)
I20260709 13:04:57.882618 19483 pending_rounds.cc:85] T 9962423cb4e54fcfa5de01daf68a86e7 P 0473d2b2d01f4459b1e90fd12cc7840e: Aborting all ops after (but not including) 5
I20260709 13:04:57.882970 19483 pending_rounds.cc:107] T 9962423cb4e54fcfa5de01daf68a86e7 P 0473d2b2d01f4459b1e90fd12cc7840e: Aborting uncommitted NO_OP operation due to leader change: 5.6
I20260709 13:04:57.883291 19483 raft_consensus.cc:2889] T 9962423cb4e54fcfa5de01daf68a86e7 P 0473d2b2d01f4459b1e90fd12cc7840e [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:04:57.883131 19309 catalog_manager.cc:5697] T a08760e15aac4630a629431f56024dc8 P e5256d91808b47c195bc9b4dbd7f2b87 reported cstate change: term changed from 1 to 3, leader changed from e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3) to e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1). New cstate: current_term: 3 leader_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } health_report { overall_health: HEALTHY } } }
I20260709 13:04:57.885344 19309 catalog_manager.cc:5697] T 1dc5b3532fe54f74876d02beffa2c230 P e5256d91808b47c195bc9b4dbd7f2b87 reported cstate change: term changed from 1 to 3, leader changed from 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2) to e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1). New cstate: current_term: 3 leader_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } health_report { overall_health: UNKNOWN } } }
W20260709 13:04:57.818454 19449 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:57.869421 19411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df751f992649444090e27965eb1af85d" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:04:57.888206 19483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e5873a19244c5ebbcd38e126796ee7" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:04:57.889240 19483 raft_consensus.cc:2410] T d1e5873a19244c5ebbcd38e126796ee7 P 0473d2b2d01f4459b1e90fd12cc7840e [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate e61c3a8f61bb48f8a963c9480e53c168 for term 4 because replica has last-logged OpId of term: 3 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 13:04:57.890977 19481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0afb57ae58a24a01850491d69f0213dd" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:04:57.891522 19481 raft_consensus.cc:3060] T 0afb57ae58a24a01850491d69f0213dd P 0473d2b2d01f4459b1e90fd12cc7840e [term 1 FOLLOWER]: Advancing to term 3
I20260709 13:04:57.892439 19486 raft_consensus.cc:1240] T 28af091831594f9d8e96482078cc7625 P 0473d2b2d01f4459b1e90fd12cc7840e [term 5 FOLLOWER]: Rejecting Update request from peer e61c3a8f61bb48f8a963c9480e53c168 for earlier term 4. Current term is 5. Ops: []
I20260709 13:04:57.895185 19484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0afb57ae58a24a01850491d69f0213dd" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:04:57.869113 19450 leader_election.cc:304] T 179fd671030940b4b4a4e24bcc4aba0a P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:04:57.896907 19408 raft_consensus.cc:2468] T 7be9efa6559648dbb5a0f7684c4542d1 P e5256d91808b47c195bc9b4dbd7f2b87 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 5.
I20260709 13:04:57.898168 19485 raft_consensus.cc:1275] T 22196caba61445d3bec98a0aab3c337d P 0473d2b2d01f4459b1e90fd12cc7840e [term 4 FOLLOWER]: Refusing update from remote peer e61c3a8f61bb48f8a963c9480e53c168: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:04:57.902849 19407 raft_consensus.cc:1275] T ece3db938bc649d4a40a51522ed5259c P e5256d91808b47c195bc9b4dbd7f2b87 [term 5 FOLLOWER]: Refusing update from remote peer 127766fc592545a4997f7790f50f6076: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:04:57.906000 19479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62c6c134d3d24a1ab144dd9ee6bc3f64" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:04:57.907092 19479 raft_consensus.cc:2393] T 62c6c134d3d24a1ab144dd9ee6bc3f64 P 0473d2b2d01f4459b1e90fd12cc7840e [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e61c3a8f61bb48f8a963c9480e53c168 in current term 4: Already voted for candidate 0473d2b2d01f4459b1e90fd12cc7840e in this term.
I20260709 13:04:57.906919 19478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62c6c134d3d24a1ab144dd9ee6bc3f64" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:04:57.879492 21223 raft_consensus.cc:493] T b08304a0a02b42d7840c4e8ee9a6bd1a P e61c3a8f61bb48f8a963c9480e53c168 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:57.897876 19496 tablet_copy_service.cc:434] P 0473d2b2d01f4459b1e90fd12cc7840e: ending tablet copy session 127766fc592545a4997f7790f50f6076-14935b3ddf914369822e4a0547aaa355 on tablet 14935b3ddf914369822e4a0547aaa355 with peer 127766fc592545a4997f7790f50f6076
I20260709 13:04:57.861958 21231 consensus_queue.cc:1048] T 9962423cb4e54fcfa5de01daf68a86e7 P 127766fc592545a4997f7790f50f6076 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.047s
I20260709 13:04:57.879655 21253 consensus_queue.cc:1048] T b08304a0a02b42d7840c4e8ee9a6bd1a P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.033s
I20260709 13:04:57.904191 21140 raft_consensus.cc:2804] T 179fd671030940b4b4a4e24bcc4aba0a P 0473d2b2d01f4459b1e90fd12cc7840e [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:04:57.905706 19403 raft_consensus.cc:1240] T 9962423cb4e54fcfa5de01daf68a86e7 P e5256d91808b47c195bc9b4dbd7f2b87 [term 6 FOLLOWER]: Rejecting Update request from peer 0473d2b2d01f4459b1e90fd12cc7840e for earlier term 5. Current term is 6. Ops: [3.5-5.6]
I20260709 13:04:57.920600 19481 raft_consensus.cc:2468] T 0afb57ae58a24a01850491d69f0213dd P 0473d2b2d01f4459b1e90fd12cc7840e [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 3.
I20260709 13:04:57.926383 19406 raft_consensus.cc:2468] T ff75a1d4cb1f493db8f71ddc136ba9ab P e5256d91808b47c195bc9b4dbd7f2b87 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 5.
I20260709 13:04:57.935463 21126 leader_election.cc:290] T 21e14947d70440f19044d8f75c31e1f9 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 3 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:04:57.937062 21191 consensus_queue.cc:1048] T 9962423cb4e54fcfa5de01daf68a86e7 P 127766fc592545a4997f7790f50f6076 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:04:57.938167 19404 raft_consensus.cc:2468] T f1b10566f45d4a7d9029858330e02d5b P e5256d91808b47c195bc9b4dbd7f2b87 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 4.
I20260709 13:04:57.908730 21230 consensus_queue.cc:1048] T ece3db938bc649d4a40a51522ed5259c P 127766fc592545a4997f7790f50f6076 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.020s
I20260709 13:04:57.927597 19477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14935b3ddf914369822e4a0547aaa355" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:04:57.926586 21201 raft_consensus.cc:493] T 0afb57ae58a24a01850491d69f0213dd P 0473d2b2d01f4459b1e90fd12cc7840e [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:57.950541 21191 consensus_queue.cc:1243] T 9962423cb4e54fcfa5de01daf68a86e7 P 127766fc592545a4997f7790f50f6076 [LEADER]: Peer 0473d2b2d01f4459b1e90fd12cc7840e log is divergent from this leader: its last log entry 3.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 13:04:57.950444 21201 raft_consensus.cc:515] T 0afb57ae58a24a01850491d69f0213dd P 0473d2b2d01f4459b1e90fd12cc7840e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:04:57.916770 21223 raft_consensus.cc:515] T b08304a0a02b42d7840c4e8ee9a6bd1a P e61c3a8f61bb48f8a963c9480e53c168 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:57.951599 21140 raft_consensus.cc:697] T 179fd671030940b4b4a4e24bcc4aba0a P 0473d2b2d01f4459b1e90fd12cc7840e [term 3 LEADER]: Becoming Leader. State: Replica: 0473d2b2d01f4459b1e90fd12cc7840e, State: Running, Role: LEADER
I20260709 13:04:57.952567 21140 consensus_queue.cc:237] T 179fd671030940b4b4a4e24bcc4aba0a P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:57.953223 21223 leader_election.cc:290] T b08304a0a02b42d7840c4e8ee9a6bd1a P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:04:57.962193 19558 raft_consensus.cc:1275] T ece3db938bc649d4a40a51522ed5259c P e61c3a8f61bb48f8a963c9480e53c168 [term 5 FOLLOWER]: Refusing update from remote peer 127766fc592545a4997f7790f50f6076: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
W20260709 13:04:57.962525 21319 log.cc:927] Time spent T 2b74109013a140ada21feeef92d6f563 P e5256d91808b47c195bc9b4dbd7f2b87: Append to log took a long time: real 0.092s	user 0.002s	sys 0.006s
I20260709 13:04:57.964192 21231 consensus_queue.cc:1048] T ece3db938bc649d4a40a51522ed5259c P 127766fc592545a4997f7790f50f6076 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:04:57.965416 19553 raft_consensus.cc:2468] T 217b5fae677b4971b3bbd2f357a1f7ff P e61c3a8f61bb48f8a963c9480e53c168 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 2.
I20260709 13:04:57.966775 19410 raft_consensus.cc:2468] T 76cb037fc9064d13b59a8969d897ce8c P e5256d91808b47c195bc9b4dbd7f2b87 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 5.
I20260709 13:04:57.967046 19407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b08304a0a02b42d7840c4e8ee9a6bd1a" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:04:57.967671 19407 raft_consensus.cc:2468] T b08304a0a02b42d7840c4e8ee9a6bd1a P e5256d91808b47c195bc9b4dbd7f2b87 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 3.
I20260709 13:04:57.969635 19406 raft_consensus.cc:1275] T d1e5873a19244c5ebbcd38e126796ee7 P e5256d91808b47c195bc9b4dbd7f2b87 [term 4 FOLLOWER]: Refusing update from remote peer e61c3a8f61bb48f8a963c9480e53c168: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:04:57.973044 19523 leader_election.cc:304] T b08304a0a02b42d7840c4e8ee9a6bd1a P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:04:57.976874 19558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21e14947d70440f19044d8f75c31e1f9" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:04:57.977767 19558 raft_consensus.cc:2393] T 21e14947d70440f19044d8f75c31e1f9 P e61c3a8f61bb48f8a963c9480e53c168 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 0473d2b2d01f4459b1e90fd12cc7840e in current term 3: Already voted for candidate e61c3a8f61bb48f8a963c9480e53c168 in this term.
I20260709 13:04:57.978601 19560 raft_consensus.cc:1275] T 7be9efa6559648dbb5a0f7684c4542d1 P e61c3a8f61bb48f8a963c9480e53c168 [term 5 FOLLOWER]: Refusing update from remote peer 0473d2b2d01f4459b1e90fd12cc7840e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:04:57.923159 21061 raft_consensus.cc:697] T 0afb57ae58a24a01850491d69f0213dd P e61c3a8f61bb48f8a963c9480e53c168 [term 3 LEADER]: Becoming Leader. State: Replica: e61c3a8f61bb48f8a963c9480e53c168, State: Running, Role: LEADER
I20260709 13:04:57.967100 21201 leader_election.cc:290] T 0afb57ae58a24a01850491d69f0213dd P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:04:57.988656 21061 consensus_queue.cc:237] T 0afb57ae58a24a01850491d69f0213dd P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:04:57.979696 21111 raft_consensus.cc:2804] T b08304a0a02b42d7840c4e8ee9a6bd1a P e61c3a8f61bb48f8a963c9480e53c168 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:04:57.976938 21127 raft_consensus.cc:2749] T df751f992649444090e27965eb1af85d P 0473d2b2d01f4459b1e90fd12cc7840e [term 4 FOLLOWER]: Leader pre-election lost for term 3. Reason: Vote denied by peer e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891) with higher term. Message: Invalid argument: T df751f992649444090e27965eb1af85d P e61c3a8f61bb48f8a963c9480e53c168 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0473d2b2d01f4459b1e90fd12cc7840e for earlier term 3. Current term is 4.
I20260709 13:04:58.000142 19560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0afb57ae58a24a01850491d69f0213dd" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:04:58.000164 19450 leader_election.cc:304] T 217b5fae677b4971b3bbd2f357a1f7ff P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:04:57.980090 21223 consensus_queue.cc:1048] T d1e5873a19244c5ebbcd38e126796ee7 P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.018s
W20260709 13:04:58.007776 19357 auto_rebalancer.cc:893] Removing replace marker failed: Replica e5256d91808b47c195bc9b4dbd7f2b87 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 4 committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } attrs { replace: true } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: NON_VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: true } } }
I20260709 13:04:58.011444 19560 raft_consensus.cc:1240] T 217b5fae677b4971b3bbd2f357a1f7ff P e61c3a8f61bb48f8a963c9480e53c168 [term 2 FOLLOWER]: Rejecting Update request from peer e5256d91808b47c195bc9b4dbd7f2b87 for earlier term 1. Current term is 2. Ops: []
I20260709 13:04:58.006326 20108 raft_consensus.cc:2468] T 62c6c134d3d24a1ab144dd9ee6bc3f64 P 127766fc592545a4997f7790f50f6076 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 4.
W20260709 13:04:58.014652 19357 auto_rebalancer.cc:901] Could not move replica: Illegal state: not currently leader
W20260709 13:04:58.015448 19357 auto_rebalancer.cc:330] scheduled replica move failed to complete: Illegal state: not currently leader
I20260709 13:04:57.996183 21111 raft_consensus.cc:493] T b08304a0a02b42d7840c4e8ee9a6bd1a P e61c3a8f61bb48f8a963c9480e53c168 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:58.009503 19402 raft_consensus.cc:2468] T 179fd671030940b4b4a4e24bcc4aba0a P e5256d91808b47c195bc9b4dbd7f2b87 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 3.
I20260709 13:04:58.022626 21115 raft_consensus.cc:493] T 21e14947d70440f19044d8f75c31e1f9 P e61c3a8f61bb48f8a963c9480e53c168 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:58.028770 21115 raft_consensus.cc:515] T 21e14947d70440f19044d8f75c31e1f9 P e61c3a8f61bb48f8a963c9480e53c168 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:58.009325 21215 consensus_queue.cc:1048] T 7be9efa6559648dbb5a0f7684c4542d1 P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.021s
I20260709 13:04:58.026257 21192 consensus_queue.cc:1059] T 217b5fae677b4971b3bbd2f357a1f7ff P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:04:58.004755 21201 raft_consensus.cc:2804] T 217b5fae677b4971b3bbd2f357a1f7ff P 0473d2b2d01f4459b1e90fd12cc7840e [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:04:58.033445 21201 raft_consensus.cc:697] T 217b5fae677b4971b3bbd2f357a1f7ff P 0473d2b2d01f4459b1e90fd12cc7840e [term 2 LEADER]: Becoming Leader. State: Replica: 0473d2b2d01f4459b1e90fd12cc7840e, State: Running, Role: LEADER
I20260709 13:04:58.034430 21201 consensus_queue.cc:237] T 217b5fae677b4971b3bbd2f357a1f7ff P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:58.035902 19551 raft_consensus.cc:1275] T ef32ce6fdd0e40d382c79974f30295c6 P e61c3a8f61bb48f8a963c9480e53c168 [term 4 FOLLOWER]: Refusing update from remote peer e5256d91808b47c195bc9b4dbd7f2b87: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:04:58.039489 21111 raft_consensus.cc:3060] T b08304a0a02b42d7840c4e8ee9a6bd1a P e61c3a8f61bb48f8a963c9480e53c168 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:04:58.046066 21192 raft_consensus.cc:3055] T 217b5fae677b4971b3bbd2f357a1f7ff P e5256d91808b47c195bc9b4dbd7f2b87 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:04:58.046499 21192 raft_consensus.cc:740] T 217b5fae677b4971b3bbd2f357a1f7ff P e5256d91808b47c195bc9b4dbd7f2b87 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e5256d91808b47c195bc9b4dbd7f2b87, State: Running, Role: LEADER
I20260709 13:04:58.047344 21192 consensus_queue.cc:260] T 217b5fae677b4971b3bbd2f357a1f7ff P e5256d91808b47c195bc9b4dbd7f2b87 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:58.048996 21192 raft_consensus.cc:3060] T 217b5fae677b4971b3bbd2f357a1f7ff P e5256d91808b47c195bc9b4dbd7f2b87 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:58.052901 20867 consensus_queue.cc:1048] T ef32ce6fdd0e40d382c79974f30295c6 P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:04:58.065738 19523 leader_election.cc:304] T 62c6c134d3d24a1ab144dd9ee6bc3f64 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 127766fc592545a4997f7790f50f6076, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:04:58.067552 19405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21e14947d70440f19044d8f75c31e1f9" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:04:58.068271 19405 raft_consensus.cc:2468] T 21e14947d70440f19044d8f75c31e1f9 P e5256d91808b47c195bc9b4dbd7f2b87 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 3.
I20260709 13:04:58.069805 19477 pending_rounds.cc:85] T 9962423cb4e54fcfa5de01daf68a86e7 P 0473d2b2d01f4459b1e90fd12cc7840e: Aborting all ops after (but not including) 4
I20260709 13:04:58.070151 19477 pending_rounds.cc:107] T 9962423cb4e54fcfa5de01daf68a86e7 P 0473d2b2d01f4459b1e90fd12cc7840e: Aborting uncommitted NO_OP operation due to leader change: 3.5
I20260709 13:04:58.070423 19477 raft_consensus.cc:2889] T 9962423cb4e54fcfa5de01daf68a86e7 P 0473d2b2d01f4459b1e90fd12cc7840e [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:04:58.073237 21115 leader_election.cc:290] T 21e14947d70440f19044d8f75c31e1f9 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:04:58.074479 19523 leader_election.cc:304] T 21e14947d70440f19044d8f75c31e1f9 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:04:58.075413 21223 raft_consensus.cc:2804] T 62c6c134d3d24a1ab144dd9ee6bc3f64 P e61c3a8f61bb48f8a963c9480e53c168 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:04:58.075870 21223 raft_consensus.cc:697] T 62c6c134d3d24a1ab144dd9ee6bc3f64 P e61c3a8f61bb48f8a963c9480e53c168 [term 4 LEADER]: Becoming Leader. State: Replica: e61c3a8f61bb48f8a963c9480e53c168, State: Running, Role: LEADER
W20260709 13:04:58.096300 19449 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.4:43121, user_credentials={real_user=slave}} blocked reactor thread for 195493us
I20260709 13:04:58.097230 19449 leader_election.cc:304] T 5ec1c4ce15e04c7e8c283a62179f2a64 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e; no voters: 127766fc592545a4997f7790f50f6076, e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:04:58.099068 21127 raft_consensus.cc:2749] T 5ec1c4ce15e04c7e8c283a62179f2a64 P 0473d2b2d01f4459b1e90fd12cc7840e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:04:58.094959 21253 raft_consensus.cc:493] T 62c6c134d3d24a1ab144dd9ee6bc3f64 P 0473d2b2d01f4459b1e90fd12cc7840e [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:58.102579 19555 raft_consensus.cc:1275] T ff75a1d4cb1f493db8f71ddc136ba9ab P e61c3a8f61bb48f8a963c9480e53c168 [term 5 FOLLOWER]: Refusing update from remote peer 0473d2b2d01f4459b1e90fd12cc7840e: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:04:58.101436 19449 leader_election.cc:304] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e; no voters: 127766fc592545a4997f7790f50f6076, e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:04:58.100703 21253 raft_consensus.cc:515] T 62c6c134d3d24a1ab144dd9ee6bc3f64 P 0473d2b2d01f4459b1e90fd12cc7840e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:04:58.111388 19403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "217b5fae677b4971b3bbd2f357a1f7ff" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
I20260709 13:04:58.112124 19404 raft_consensus.cc:1275] T 76cb037fc9064d13b59a8969d897ce8c P e5256d91808b47c195bc9b4dbd7f2b87 [term 5 FOLLOWER]: Refusing update from remote peer 0473d2b2d01f4459b1e90fd12cc7840e: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:04:58.115492 19410 raft_consensus.cc:1275] T 7be9efa6559648dbb5a0f7684c4542d1 P e5256d91808b47c195bc9b4dbd7f2b87 [term 5 FOLLOWER]: Refusing update from remote peer 0473d2b2d01f4459b1e90fd12cc7840e: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:04:58.118634 20105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0afb57ae58a24a01850491d69f0213dd" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:04:58.096174 21321 raft_consensus.cc:2804] T 21e14947d70440f19044d8f75c31e1f9 P e61c3a8f61bb48f8a963c9480e53c168 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:04:58.119298 21321 raft_consensus.cc:493] T 21e14947d70440f19044d8f75c31e1f9 P e61c3a8f61bb48f8a963c9480e53c168 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:58.122162 19526 leader_election.cc:304] T 14935b3ddf914369822e4a0547aaa355 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e61c3a8f61bb48f8a963c9480e53c168; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:04:58.119333 20105 raft_consensus.cc:2468] T 0afb57ae58a24a01850491d69f0213dd P 127766fc592545a4997f7790f50f6076 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 3.
I20260709 13:04:58.188319 19449 leader_election.cc:304] T 28af091831594f9d8e96482078cc7625 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e; no voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:04:58.179164 21321 raft_consensus.cc:3060] T 21e14947d70440f19044d8f75c31e1f9 P e61c3a8f61bb48f8a963c9480e53c168 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:04:58.177651 19405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21e14947d70440f19044d8f75c31e1f9" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
I20260709 13:04:58.124580 19407 raft_consensus.cc:1275] T b08304a0a02b42d7840c4e8ee9a6bd1a P e5256d91808b47c195bc9b4dbd7f2b87 [term 3 FOLLOWER]: Refusing update from remote peer 0473d2b2d01f4459b1e90fd12cc7840e: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:04:58.109969 21197 raft_consensus.cc:2749] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P 0473d2b2d01f4459b1e90fd12cc7840e [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:04:58.178536 21203 consensus_queue.cc:1059] T 28af091831594f9d8e96482078cc7625 P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 }, Status: INVALID_TERM, Last received: 4.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.056s
I20260709 13:04:58.177995 20853 consensus_queue.cc:1048] T 22196caba61445d3bec98a0aab3c337d P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.024s
I20260709 13:04:58.193337 21206 raft_consensus.cc:493] T f1b10566f45d4a7d9029858330e02d5b P e61c3a8f61bb48f8a963c9480e53c168 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:58.213524 19449 leader_election.cc:304] T f1b10566f45d4a7d9029858330e02d5b P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87; no voters: e61c3a8f61bb48f8a963c9480e53c168
W20260709 13:04:58.206274 19526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.2:46257, user_credentials={real_user=slave}} blocked reactor thread for 84161.3us
I20260709 13:04:58.108635 21201 consensus_queue.cc:1048] T ff75a1d4cb1f493db8f71ddc136ba9ab P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.094s
I20260709 13:04:58.210952 21126 raft_consensus.cc:2749] T 28af091831594f9d8e96482078cc7625 P 0473d2b2d01f4459b1e90fd12cc7840e [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:04:58.223846 21140 raft_consensus.cc:2804] T f1b10566f45d4a7d9029858330e02d5b P 0473d2b2d01f4459b1e90fd12cc7840e [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:04:58.227188 21088 consensus_queue.cc:1048] T 7be9efa6559648dbb5a0f7684c4542d1 P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.040s
W20260709 13:04:58.270144 21331 log.cc:927] Time spent T ef32ce6fdd0e40d382c79974f30295c6 P e61c3a8f61bb48f8a963c9480e53c168: Append to log took a long time: real 0.059s	user 0.000s	sys 0.000s
I20260709 13:04:58.225625 21306 consensus_queue.cc:1048] T 76cb037fc9064d13b59a8969d897ce8c P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:04:58.194741 21223 consensus_queue.cc:237] T 62c6c134d3d24a1ab144dd9ee6bc3f64 P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:04:58.231137 19558 raft_consensus.cc:1275] T 76cb037fc9064d13b59a8969d897ce8c P e61c3a8f61bb48f8a963c9480e53c168 [term 5 FOLLOWER]: Refusing update from remote peer 0473d2b2d01f4459b1e90fd12cc7840e: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:04:58.233914 19405 raft_consensus.cc:2468] T 21e14947d70440f19044d8f75c31e1f9 P e5256d91808b47c195bc9b4dbd7f2b87 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 3.
I20260709 13:04:58.227830 21115 raft_consensus.cc:493] T 6c5eebf646ad445a9d1b1adc319d7b16 P e61c3a8f61bb48f8a963c9480e53c168 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 127766fc592545a4997f7790f50f6076)
I20260709 13:04:58.289686 21111 raft_consensus.cc:515] T b08304a0a02b42d7840c4e8ee9a6bd1a P e61c3a8f61bb48f8a963c9480e53c168 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:58.315384 19478 raft_consensus.cc:1275] T df751f992649444090e27965eb1af85d P 0473d2b2d01f4459b1e90fd12cc7840e [term 4 FOLLOWER]: Refusing update from remote peer e5256d91808b47c195bc9b4dbd7f2b87: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:04:58.285808 21140 raft_consensus.cc:697] T f1b10566f45d4a7d9029858330e02d5b P 0473d2b2d01f4459b1e90fd12cc7840e [term 4 LEADER]: Becoming Leader. State: Replica: 0473d2b2d01f4459b1e90fd12cc7840e, State: Running, Role: LEADER
I20260709 13:04:58.245220 21206 raft_consensus.cc:515] T f1b10566f45d4a7d9029858330e02d5b P e61c3a8f61bb48f8a963c9480e53c168 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:58.339840 21322 raft_consensus.cc:2749] T 14935b3ddf914369822e4a0547aaa355 P e61c3a8f61bb48f8a963c9480e53c168 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:04:58.311062 21115 raft_consensus.cc:515] T 6c5eebf646ad445a9d1b1adc319d7b16 P e61c3a8f61bb48f8a963c9480e53c168 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:04:58.346418 21126 consensus_queue.cc:1048] T 76cb037fc9064d13b59a8969d897ce8c P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.022s
I20260709 13:04:58.394033 21140 consensus_queue.cc:237] T f1b10566f45d4a7d9029858330e02d5b P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:58.395242 21253 leader_election.cc:290] T 62c6c134d3d24a1ab144dd9ee6bc3f64 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:04:58.366089 19554 raft_consensus.cc:1240] T b08304a0a02b42d7840c4e8ee9a6bd1a P e61c3a8f61bb48f8a963c9480e53c168 [term 4 FOLLOWER]: Rejecting Update request from peer 0473d2b2d01f4459b1e90fd12cc7840e for earlier term 3. Current term is 4. Ops: [3.3-3.3]
I20260709 13:04:58.348587 21194 consensus_queue.cc:1048] T df751f992649444090e27965eb1af85d P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.021s
I20260709 13:04:58.399971 19560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62c6c134d3d24a1ab144dd9ee6bc3f64" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:04:58.406798 19480 raft_consensus.cc:1275] T ff9b0eddd810459b82d91c60777c10eb P 0473d2b2d01f4459b1e90fd12cc7840e [term 4 FOLLOWER]: Refusing update from remote peer 127766fc592545a4997f7790f50f6076: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
W20260709 13:04:58.413347 19449 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.1:40321, user_credentials={real_user=slave}} blocked reactor thread for 187139us
I20260709 13:04:58.417419 19478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b08304a0a02b42d7840c4e8ee9a6bd1a" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:04:58.418906 19485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21e14947d70440f19044d8f75c31e1f9" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:04:58.419765 19485 raft_consensus.cc:2468] T 21e14947d70440f19044d8f75c31e1f9 P 0473d2b2d01f4459b1e90fd12cc7840e [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 3.
I20260709 13:04:58.423482 19449 leader_election.cc:304] T 0afb57ae58a24a01850491d69f0213dd P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, 127766fc592545a4997f7790f50f6076; no voters: e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:04:58.431655 19407 raft_consensus.cc:1275] T ff75a1d4cb1f493db8f71ddc136ba9ab P e5256d91808b47c195bc9b4dbd7f2b87 [term 5 FOLLOWER]: Refusing update from remote peer 0473d2b2d01f4459b1e90fd12cc7840e: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:04:58.435339 19560 raft_consensus.cc:1275] T df751f992649444090e27965eb1af85d P e61c3a8f61bb48f8a963c9480e53c168 [term 4 FOLLOWER]: Refusing update from remote peer e5256d91808b47c195bc9b4dbd7f2b87: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:04:58.441102 19449 leader_election.cc:304] T 21e14947d70440f19044d8f75c31e1f9 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87; no voters: e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:04:58.435467 21335 raft_consensus.cc:493] T ab43d85f64114d4ebf618930e43d9ed0 P e5256d91808b47c195bc9b4dbd7f2b87 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:58.438939 21215 raft_consensus.cc:2804] T 0afb57ae58a24a01850491d69f0213dd P 0473d2b2d01f4459b1e90fd12cc7840e [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:04:58.432452 21321 raft_consensus.cc:515] T 21e14947d70440f19044d8f75c31e1f9 P e61c3a8f61bb48f8a963c9480e53c168 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:58.459678 21201 consensus_queue.cc:1048] T ff75a1d4cb1f493db8f71ddc136ba9ab P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:04:58.461619 21321 leader_election.cc:290] T 21e14947d70440f19044d8f75c31e1f9 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 4 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:04:58.464519 19478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21e14947d70440f19044d8f75c31e1f9" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:04:58.465293 19480 raft_consensus.cc:1275] T d1e5873a19244c5ebbcd38e126796ee7 P 0473d2b2d01f4459b1e90fd12cc7840e [term 4 FOLLOWER]: Refusing update from remote peer e61c3a8f61bb48f8a963c9480e53c168: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 3. (term mismatch)
I20260709 13:04:58.465703 19480 pending_rounds.cc:85] T d1e5873a19244c5ebbcd38e126796ee7 P 0473d2b2d01f4459b1e90fd12cc7840e: Aborting all ops after (but not including) 2
I20260709 13:04:58.465929 19480 pending_rounds.cc:107] T d1e5873a19244c5ebbcd38e126796ee7 P 0473d2b2d01f4459b1e90fd12cc7840e: Aborting uncommitted NO_OP operation due to leader change: 3.3
I20260709 13:04:58.466169 19480 raft_consensus.cc:2889] T d1e5873a19244c5ebbcd38e126796ee7 P 0473d2b2d01f4459b1e90fd12cc7840e [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:04:58.447091 21088 consensus_queue.cc:1048] T b08304a0a02b42d7840c4e8ee9a6bd1a P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.023s
I20260709 13:04:58.467824 21321 consensus_queue.cc:1048] T d1e5873a19244c5ebbcd38e126796ee7 P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:04:58.468607 21105 consensus_queue.cc:1059] T b08304a0a02b42d7840c4e8ee9a6bd1a P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:04:58.469408 21201 raft_consensus.cc:493] T 6c5eebf646ad445a9d1b1adc319d7b16 P 0473d2b2d01f4459b1e90fd12cc7840e [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:58.469653 21088 raft_consensus.cc:3055] T b08304a0a02b42d7840c4e8ee9a6bd1a P 0473d2b2d01f4459b1e90fd12cc7840e [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:04:58.470037 21088 raft_consensus.cc:740] T b08304a0a02b42d7840c4e8ee9a6bd1a P 0473d2b2d01f4459b1e90fd12cc7840e [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 0473d2b2d01f4459b1e90fd12cc7840e, State: Running, Role: LEADER
I20260709 13:04:58.469897 21201 raft_consensus.cc:515] T 6c5eebf646ad445a9d1b1adc319d7b16 P 0473d2b2d01f4459b1e90fd12cc7840e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:04:58.470870 21088 consensus_queue.cc:260] T b08304a0a02b42d7840c4e8ee9a6bd1a P 0473d2b2d01f4459b1e90fd12cc7840e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:58.471307 19479 raft_consensus.cc:1275] T ef32ce6fdd0e40d382c79974f30295c6 P 0473d2b2d01f4459b1e90fd12cc7840e [term 4 FOLLOWER]: Refusing update from remote peer e5256d91808b47c195bc9b4dbd7f2b87: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:04:58.471832 21088 raft_consensus.cc:3060] T b08304a0a02b42d7840c4e8ee9a6bd1a P 0473d2b2d01f4459b1e90fd12cc7840e [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:04:58.472114 21201 leader_election.cc:290] T 6c5eebf646ad445a9d1b1adc319d7b16 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:04:58.474154 21339 consensus_queue.cc:1048] T ff9b0eddd810459b82d91c60777c10eb P 127766fc592545a4997f7790f50f6076 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:04:58.478235 19555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c5eebf646ad445a9d1b1adc319d7b16" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:04:58.480939 19555 raft_consensus.cc:2468] T 6c5eebf646ad445a9d1b1adc319d7b16 P e61c3a8f61bb48f8a963c9480e53c168 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 2.
I20260709 13:04:58.484176 19450 leader_election.cc:304] T 6c5eebf646ad445a9d1b1adc319d7b16 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:04:58.457986 21215 raft_consensus.cc:493] T 0afb57ae58a24a01850491d69f0213dd P 0473d2b2d01f4459b1e90fd12cc7840e [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:58.476056 21197 raft_consensus.cc:2804] T 21e14947d70440f19044d8f75c31e1f9 P 0473d2b2d01f4459b1e90fd12cc7840e [term 3 FOLLOWER]: Leader election won for term 3
W20260709 13:04:58.533650 20078 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.2:46257, user_credentials={real_user=slave}} blocked reactor thread for 103848us
I20260709 13:04:58.518709 21215 raft_consensus.cc:3060] T 0afb57ae58a24a01850491d69f0213dd P 0473d2b2d01f4459b1e90fd12cc7840e [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:04:58.524592 19403 raft_consensus.cc:2468] T 217b5fae677b4971b3bbd2f357a1f7ff P e5256d91808b47c195bc9b4dbd7f2b87 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 2.
I20260709 13:04:58.552037 21115 leader_election.cc:290] T 6c5eebf646ad445a9d1b1adc319d7b16 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:04:58.571892 21338 raft_consensus.cc:493] T f93ee515a9c14139bf566522ed8232f3 P 0473d2b2d01f4459b1e90fd12cc7840e [term 4 FOLLOWER]: Starting pre-election (detected failure of leader e5256d91808b47c195bc9b4dbd7f2b87)
I20260709 13:04:58.572701 21338 raft_consensus.cc:515] T f93ee515a9c14139bf566522ed8232f3 P 0473d2b2d01f4459b1e90fd12cc7840e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:58.477087 21335 raft_consensus.cc:515] T ab43d85f64114d4ebf618930e43d9ed0 P e5256d91808b47c195bc9b4dbd7f2b87 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } attrs { replace: true } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: NON_VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: true } }
I20260709 13:04:58.536520 21253 raft_consensus.cc:2804] T 6c5eebf646ad445a9d1b1adc319d7b16 P 0473d2b2d01f4459b1e90fd12cc7840e [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:04:58.535514 21197 raft_consensus.cc:697] T 21e14947d70440f19044d8f75c31e1f9 P 0473d2b2d01f4459b1e90fd12cc7840e [term 3 LEADER]: Becoming Leader. State: Replica: 0473d2b2d01f4459b1e90fd12cc7840e, State: Running, Role: LEADER
I20260709 13:04:58.588423 20112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62c6c134d3d24a1ab144dd9ee6bc3f64" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:04:58.589308 20112 raft_consensus.cc:2468] T 62c6c134d3d24a1ab144dd9ee6bc3f64 P 127766fc592545a4997f7790f50f6076 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 4.
W20260709 13:04:58.612066 19377 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.2:46257, user_credentials={real_user=slave}} blocked reactor thread for 153660us
I20260709 13:04:58.584542 21253 raft_consensus.cc:493] T 6c5eebf646ad445a9d1b1adc319d7b16 P 0473d2b2d01f4459b1e90fd12cc7840e [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:58.631198 21346 raft_consensus.cc:493] T f93ee515a9c14139bf566522ed8232f3 P e5256d91808b47c195bc9b4dbd7f2b87 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:58.631263 21194 consensus_queue.cc:1048] T ef32ce6fdd0e40d382c79974f30295c6 P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:04:58.631891 21346 raft_consensus.cc:515] T f93ee515a9c14139bf566522ed8232f3 P e5256d91808b47c195bc9b4dbd7f2b87 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:58.634285 21346 leader_election.cc:290] T f93ee515a9c14139bf566522ed8232f3 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:04:58.621325 21253 raft_consensus.cc:3060] T 6c5eebf646ad445a9d1b1adc319d7b16 P 0473d2b2d01f4459b1e90fd12cc7840e [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:04:58.625221 20107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c5eebf646ad445a9d1b1adc319d7b16" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
W20260709 13:04:58.668421 19450 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.3:36891, user_credentials={real_user=slave}} blocked reactor thread for 184191us
W20260709 13:04:58.671401 19450 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:58.672385 19557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f93ee515a9c14139bf566522ed8232f3" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:04:58.673290 19557 raft_consensus.cc:2393] T f93ee515a9c14139bf566522ed8232f3 P e61c3a8f61bb48f8a963c9480e53c168 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0473d2b2d01f4459b1e90fd12cc7840e in current term 5: Already voted for candidate e61c3a8f61bb48f8a963c9480e53c168 in this term.
I20260709 13:04:58.640259 21115 raft_consensus.cc:493] T 46c5bfeecc314717bffe987e6844b6d0 P e61c3a8f61bb48f8a963c9480e53c168 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:58.665426 21338 leader_election.cc:290] T f93ee515a9c14139bf566522ed8232f3 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:04:58.704231 21321 raft_consensus.cc:493] T 3e1f505cb0f1427bbd698ac889d80821 P e61c3a8f61bb48f8a963c9480e53c168 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:04:58.751171 19375 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.3:36891, user_credentials={real_user=slave}} blocked reactor thread for 302902us
I20260709 13:04:58.738483 19410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f93ee515a9c14139bf566522ed8232f3" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:04:58.698609 20107 raft_consensus.cc:2468] T 6c5eebf646ad445a9d1b1adc319d7b16 P 127766fc592545a4997f7790f50f6076 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 3.
I20260709 13:04:58.772359 21362 raft_consensus.cc:493] T bc225c93219c45538b53a1bd3d387e4d P 0473d2b2d01f4459b1e90fd12cc7840e [term 4 FOLLOWER]: Starting pre-election (detected failure of leader e5256d91808b47c195bc9b4dbd7f2b87)
I20260709 13:04:58.764369 19410 raft_consensus.cc:2468] T f93ee515a9c14139bf566522ed8232f3 P e5256d91808b47c195bc9b4dbd7f2b87 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 5.
I20260709 13:04:58.737849 19449 leader_election.cc:304] T 62c6c134d3d24a1ab144dd9ee6bc3f64 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, 127766fc592545a4997f7790f50f6076; no voters: e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:04:58.778542 21206 leader_election.cc:290] T f1b10566f45d4a7d9029858330e02d5b P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
W20260709 13:04:58.809172 19449 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.4:43121, user_credentials={real_user=slave}} blocked reactor thread for 71411.8us
I20260709 13:04:58.720055 20105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c5eebf646ad445a9d1b1adc319d7b16" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:04:58.813544 19484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c5eebf646ad445a9d1b1adc319d7b16" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:04:58.821033 19449 leader_election.cc:304] T f93ee515a9c14139bf566522ed8232f3 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87; no voters: 
I20260709 13:04:58.715463 21115 raft_consensus.cc:515] T 46c5bfeecc314717bffe987e6844b6d0 P e61c3a8f61bb48f8a963c9480e53c168 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:58.833441 19479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1b10566f45d4a7d9029858330e02d5b" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:04:58.831646 19486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f93ee515a9c14139bf566522ed8232f3" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:04:58.838557 19486 raft_consensus.cc:2468] T f93ee515a9c14139bf566522ed8232f3 P 0473d2b2d01f4459b1e90fd12cc7840e [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 4.
I20260709 13:04:58.806802 21352 raft_consensus.cc:493] T 6c5eebf646ad445a9d1b1adc319d7b16 P 127766fc592545a4997f7790f50f6076 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:58.705505 21197 consensus_queue.cc:237] T 21e14947d70440f19044d8f75c31e1f9 P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:58.814857 21240 raft_consensus.cc:2804] T 62c6c134d3d24a1ab144dd9ee6bc3f64 P 0473d2b2d01f4459b1e90fd12cc7840e [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:04:58.856011 21352 raft_consensus.cc:515] T 6c5eebf646ad445a9d1b1adc319d7b16 P 127766fc592545a4997f7790f50f6076 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:04:58.862182 21336 raft_consensus.cc:3055] T 28af091831594f9d8e96482078cc7625 P e61c3a8f61bb48f8a963c9480e53c168 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:04:58.864885 21338 raft_consensus.cc:493] T 46c5bfeecc314717bffe987e6844b6d0 P 0473d2b2d01f4459b1e90fd12cc7840e [term 5 FOLLOWER]: Starting pre-election (detected failure of leader e61c3a8f61bb48f8a963c9480e53c168)
I20260709 13:04:58.862604 21336 raft_consensus.cc:740] T 28af091831594f9d8e96482078cc7625 P e61c3a8f61bb48f8a963c9480e53c168 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: e61c3a8f61bb48f8a963c9480e53c168, State: Running, Role: LEADER
I20260709 13:04:58.760672 21321 raft_consensus.cc:515] T 3e1f505cb0f1427bbd698ac889d80821 P e61c3a8f61bb48f8a963c9480e53c168 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:58.866283 21336 consensus_queue.cc:260] T 28af091831594f9d8e96482078cc7625 P e61c3a8f61bb48f8a963c9480e53c168 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.2, Last appended by leader: 2, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:58.865417 21338 raft_consensus.cc:515] T 46c5bfeecc314717bffe987e6844b6d0 P 0473d2b2d01f4459b1e90fd12cc7840e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:58.867686 21105 raft_consensus.cc:2804] T f93ee515a9c14139bf566522ed8232f3 P 0473d2b2d01f4459b1e90fd12cc7840e [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:04:58.868144 21105 raft_consensus.cc:493] T f93ee515a9c14139bf566522ed8232f3 P 0473d2b2d01f4459b1e90fd12cc7840e [term 4 FOLLOWER]: Starting leader election (detected failure of leader e5256d91808b47c195bc9b4dbd7f2b87)
I20260709 13:04:58.868376 21321 leader_election.cc:290] T 3e1f505cb0f1427bbd698ac889d80821 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:04:58.868512 21105 raft_consensus.cc:3060] T f93ee515a9c14139bf566522ed8232f3 P 0473d2b2d01f4459b1e90fd12cc7840e [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:04:58.869212 21352 leader_election.cc:290] T 6c5eebf646ad445a9d1b1adc319d7b16 P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
W20260709 13:04:58.870251 21359 log.cc:927] Time spent T 76cb037fc9064d13b59a8969d897ce8c P e5256d91808b47c195bc9b4dbd7f2b87: Append to log took a long time: real 0.149s	user 0.000s	sys 0.000s
I20260709 13:04:58.841317 21248 consensus_queue.cc:1048] T df751f992649444090e27965eb1af85d P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.038s
I20260709 13:04:58.879104 21335 leader_election.cc:290] T ab43d85f64114d4ebf618930e43d9ed0 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:04:58.818215 19554 raft_consensus.cc:1275] T b9f0d59553ad444883fcf5b5909f9798 P e61c3a8f61bb48f8a963c9480e53c168 [term 3 FOLLOWER]: Refusing update from remote peer 0473d2b2d01f4459b1e90fd12cc7840e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:04:58.878000 21215 raft_consensus.cc:515] T 0afb57ae58a24a01850491d69f0213dd P 0473d2b2d01f4459b1e90fd12cc7840e [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:04:58.837764 21111 leader_election.cc:290] T b08304a0a02b42d7840c4e8ee9a6bd1a P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 4 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
W20260709 13:04:58.901832 21361 log.cc:927] Time spent T d1e5873a19244c5ebbcd38e126796ee7 P 0473d2b2d01f4459b1e90fd12cc7840e: Append to log took a long time: real 0.060s	user 0.002s	sys 0.000s
I20260709 13:04:58.880966 21240 raft_consensus.cc:493] T 62c6c134d3d24a1ab144dd9ee6bc3f64 P 0473d2b2d01f4459b1e90fd12cc7840e [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:58.904877 21240 raft_consensus.cc:3060] T 62c6c134d3d24a1ab144dd9ee6bc3f64 P 0473d2b2d01f4459b1e90fd12cc7840e [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:04:58.907055 20107 raft_consensus.cc:1275] T 0afb57ae58a24a01850491d69f0213dd P 127766fc592545a4997f7790f50f6076 [term 3 FOLLOWER]: Refusing update from remote peer e61c3a8f61bb48f8a963c9480e53c168: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:04:58.884711 19402 raft_consensus.cc:1275] T 179fd671030940b4b4a4e24bcc4aba0a P e5256d91808b47c195bc9b4dbd7f2b87 [term 3 FOLLOWER]: Refusing update from remote peer 0473d2b2d01f4459b1e90fd12cc7840e: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
W20260709 13:04:58.921361 19375 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.3:36891, user_credentials={real_user=slave}} blocked reactor thread for 158523us
I20260709 13:04:58.925450 19558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c5eebf646ad445a9d1b1adc319d7b16" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:04:58.815701 21362 raft_consensus.cc:515] T bc225c93219c45538b53a1bd3d387e4d P 0473d2b2d01f4459b1e90fd12cc7840e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:58.930384 19558 raft_consensus.cc:2468] T 6c5eebf646ad445a9d1b1adc319d7b16 P e61c3a8f61bb48f8a963c9480e53c168 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 127766fc592545a4997f7790f50f6076 in term 2.
I20260709 13:04:58.887792 20105 raft_consensus.cc:2468] T 6c5eebf646ad445a9d1b1adc319d7b16 P 127766fc592545a4997f7790f50f6076 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 3.
I20260709 13:04:58.959280 19560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f93ee515a9c14139bf566522ed8232f3" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:04:58.955432 20076 leader_election.cc:304] T 6c5eebf646ad445a9d1b1adc319d7b16 P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 127766fc592545a4997f7790f50f6076, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:04:58.959955 19560 raft_consensus.cc:2468] T f93ee515a9c14139bf566522ed8232f3 P e61c3a8f61bb48f8a963c9480e53c168 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 5.
I20260709 13:04:59.011833 19560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab43d85f64114d4ebf618930e43d9ed0" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:04:59.019789 21115 leader_election.cc:290] T 46c5bfeecc314717bffe987e6844b6d0 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:04:59.020328 20867 raft_consensus.cc:493] T bc225c93219c45538b53a1bd3d387e4d P e5256d91808b47c195bc9b4dbd7f2b87 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:59.020875 20867 raft_consensus.cc:515] T bc225c93219c45538b53a1bd3d387e4d P e5256d91808b47c195bc9b4dbd7f2b87 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:59.021929 21215 leader_election.cc:290] T 0afb57ae58a24a01850491d69f0213dd P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 4 election: Requested vote from peers e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:04:58.930433 20853 consensus_queue.cc:1048] T 0afb57ae58a24a01850491d69f0213dd P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Connected to new peer: Peer: permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.082s
I20260709 13:04:58.963213 21352 raft_consensus.cc:493] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P 127766fc592545a4997f7790f50f6076 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:58.969738 21231 raft_consensus.cc:2804] T 6c5eebf646ad445a9d1b1adc319d7b16 P 127766fc592545a4997f7790f50f6076 [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 13:04:59.031769 21360 log.cc:927] Time spent T ff75a1d4cb1f493db8f71ddc136ba9ab P e5256d91808b47c195bc9b4dbd7f2b87: Append to log took a long time: real 0.077s	user 0.000s	sys 0.001s
I20260709 13:04:59.015697 19560 raft_consensus.cc:2468] T ab43d85f64114d4ebf618930e43d9ed0 P e61c3a8f61bb48f8a963c9480e53c168 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 4.
I20260709 13:04:59.038374 21231 raft_consensus.cc:493] T 6c5eebf646ad445a9d1b1adc319d7b16 P 127766fc592545a4997f7790f50f6076 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:59.053037 21338 leader_election.cc:290] T 46c5bfeecc314717bffe987e6844b6d0 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:04:59.042985 21105 raft_consensus.cc:515] T f93ee515a9c14139bf566522ed8232f3 P 0473d2b2d01f4459b1e90fd12cc7840e [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:59.057965 20867 leader_election.cc:290] T bc225c93219c45538b53a1bd3d387e4d P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:04:59.058394 21362 leader_election.cc:290] T bc225c93219c45538b53a1bd3d387e4d P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:04:59.055655 21231 raft_consensus.cc:3060] T 6c5eebf646ad445a9d1b1adc319d7b16 P 127766fc592545a4997f7790f50f6076 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:04:59.038719 21352 raft_consensus.cc:515] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P 127766fc592545a4997f7790f50f6076 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:04:59.065467 21352 leader_election.cc:290] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:04:59.069075 21336 raft_consensus.cc:3060] T 28af091831594f9d8e96482078cc7625 P e61c3a8f61bb48f8a963c9480e53c168 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:04:59.048211 21203 raft_consensus.cc:493] T ab43d85f64114d4ebf618930e43d9ed0 P e61c3a8f61bb48f8a963c9480e53c168 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:59.071161 21203 raft_consensus.cc:515] T ab43d85f64114d4ebf618930e43d9ed0 P e61c3a8f61bb48f8a963c9480e53c168 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } attrs { replace: true } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: NON_VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: true } }
I20260709 13:04:59.073957 21203 leader_election.cc:290] T ab43d85f64114d4ebf618930e43d9ed0 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:04:59.074651 21253 raft_consensus.cc:515] T 6c5eebf646ad445a9d1b1adc319d7b16 P 0473d2b2d01f4459b1e90fd12cc7840e [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:04:59.075930 19484 raft_consensus.cc:2368] T 6c5eebf646ad445a9d1b1adc319d7b16 P 0473d2b2d01f4459b1e90fd12cc7840e [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e61c3a8f61bb48f8a963c9480e53c168 for earlier term 3. Current term is 4.
I20260709 13:04:59.076900 21253 leader_election.cc:290] T 6c5eebf646ad445a9d1b1adc319d7b16 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 4 election: Requested vote from peers e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:04:58.802402 18300 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:04:59.082607 19304 catalog_manager.cc:5697] T 9962423cb4e54fcfa5de01daf68a86e7 P 127766fc592545a4997f7790f50f6076 reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "127766fc592545a4997f7790f50f6076" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:04:59.083834 21105 leader_election.cc:290] T f93ee515a9c14139bf566522ed8232f3 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 5 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:04:59.084715 19304 catalog_manager.cc:5697] T fa731b585f684a7fb2d106c50f143b83 P 127766fc592545a4997f7790f50f6076 reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "127766fc592545a4997f7790f50f6076" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:04:59.096529 21231 raft_consensus.cc:515] T 6c5eebf646ad445a9d1b1adc319d7b16 P 127766fc592545a4997f7790f50f6076 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
W20260709 13:04:59.124377 19449 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.1:40321, user_credentials={real_user=slave}} blocked reactor thread for 303405us
I20260709 13:04:59.110898 19304 catalog_manager.cc:5697] T 1efebf73c86e432baa55533136b6e12c P 127766fc592545a4997f7790f50f6076 reported cstate change: term changed from 1 to 5, leader changed from e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3) to 127766fc592545a4997f7790f50f6076 (127.17.223.4). New cstate: current_term: 5 leader_uuid: "127766fc592545a4997f7790f50f6076" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:04:59.127660 20112 raft_consensus.cc:1275] T 62c6c134d3d24a1ab144dd9ee6bc3f64 P 127766fc592545a4997f7790f50f6076 [term 4 FOLLOWER]: Refusing update from remote peer e61c3a8f61bb48f8a963c9480e53c168: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:04:59.144553 19406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46c5bfeecc314717bffe987e6844b6d0" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 6 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:04:59.147220 19410 raft_consensus.cc:1275] T 217b5fae677b4971b3bbd2f357a1f7ff P e5256d91808b47c195bc9b4dbd7f2b87 [term 2 FOLLOWER]: Refusing update from remote peer 0473d2b2d01f4459b1e90fd12cc7840e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:59.148622 19407 raft_consensus.cc:1275] T b9f0d59553ad444883fcf5b5909f9798 P e5256d91808b47c195bc9b4dbd7f2b87 [term 3 FOLLOWER]: Refusing update from remote peer 0473d2b2d01f4459b1e90fd12cc7840e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:04:59.151724 19406 raft_consensus.cc:2393] T 46c5bfeecc314717bffe987e6844b6d0 P e5256d91808b47c195bc9b4dbd7f2b87 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0473d2b2d01f4459b1e90fd12cc7840e in current term 6: Already voted for candidate e5256d91808b47c195bc9b4dbd7f2b87 in this term.
I20260709 13:04:59.153224 20112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0afb57ae58a24a01850491d69f0213dd" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076"
I20260709 13:04:59.156052 19406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc225c93219c45538b53a1bd3d387e4d" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:04:59.156693 19406 raft_consensus.cc:2468] T bc225c93219c45538b53a1bd3d387e4d P e5256d91808b47c195bc9b4dbd7f2b87 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 5.
I20260709 13:04:59.166109 20112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c5eebf646ad445a9d1b1adc319d7b16" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076"
I20260709 13:04:59.166960 19406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f93ee515a9c14139bf566522ed8232f3" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
I20260709 13:04:59.205459 19557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c5eebf646ad445a9d1b1adc319d7b16" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:04:59.206064 19557 raft_consensus.cc:3060] T 6c5eebf646ad445a9d1b1adc319d7b16 P e61c3a8f61bb48f8a963c9480e53c168 [term 2 FOLLOWER]: Advancing to term 4
I20260709 13:04:59.213006 19406 raft_consensus.cc:2468] T f93ee515a9c14139bf566522ed8232f3 P e5256d91808b47c195bc9b4dbd7f2b87 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 5.
I20260709 13:04:59.219376 21240 raft_consensus.cc:515] T 62c6c134d3d24a1ab144dd9ee6bc3f64 P 0473d2b2d01f4459b1e90fd12cc7840e [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:04:59.221695 21240 leader_election.cc:290] T 62c6c134d3d24a1ab144dd9ee6bc3f64 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 5 election: Requested vote from peers e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:04:59.130805 21322 consensus_queue.cc:1048] T 62c6c134d3d24a1ab144dd9ee6bc3f64 P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Connected to new peer: Peer: permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.073s
I20260709 13:04:59.203665 21111 raft_consensus.cc:493] T 4509b76741dc428e9201c70c1658da13 P e61c3a8f61bb48f8a963c9480e53c168 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e5256d91808b47c195bc9b4dbd7f2b87)
I20260709 13:04:59.227409 21111 raft_consensus.cc:515] T 4509b76741dc428e9201c70c1658da13 P e61c3a8f61bb48f8a963c9480e53c168 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:59.229625 21111 leader_election.cc:290] T 4509b76741dc428e9201c70c1658da13 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:04:59.233739 21203 raft_consensus.cc:493] T bc225c93219c45538b53a1bd3d387e4d P e61c3a8f61bb48f8a963c9480e53c168 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:59.234256 21203 raft_consensus.cc:515] T bc225c93219c45538b53a1bd3d387e4d P e61c3a8f61bb48f8a963c9480e53c168 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:59.237638 21203 leader_election.cc:290] T bc225c93219c45538b53a1bd3d387e4d P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:04:59.191150 21352 raft_consensus.cc:493] T 70797e5783b5454ab0d0eea663e791e3 P 127766fc592545a4997f7790f50f6076 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader e5256d91808b47c195bc9b4dbd7f2b87)
I20260709 13:04:59.241905 21352 raft_consensus.cc:515] T 70797e5783b5454ab0d0eea663e791e3 P 127766fc592545a4997f7790f50f6076 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:04:59.248095 21342 raft_consensus.cc:493] T 46c5bfeecc314717bffe987e6844b6d0 P e5256d91808b47c195bc9b4dbd7f2b87 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:59.248662 21342 raft_consensus.cc:515] T 46c5bfeecc314717bffe987e6844b6d0 P e5256d91808b47c195bc9b4dbd7f2b87 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:59.252722 19555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70797e5783b5454ab0d0eea663e791e3" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:04:59.255543 21105 raft_consensus.cc:493] T ab43d85f64114d4ebf618930e43d9ed0 P 0473d2b2d01f4459b1e90fd12cc7840e [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:59.256127 21105 raft_consensus.cc:515] T ab43d85f64114d4ebf618930e43d9ed0 P 0473d2b2d01f4459b1e90fd12cc7840e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } attrs { replace: true } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: NON_VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: true } }
I20260709 13:04:59.263935 19477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e1f505cb0f1427bbd698ac889d80821" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:04:59.264288 21232 raft_consensus.cc:493] T 1f85fc4b527a48848e5faa083b604e36 P 127766fc592545a4997f7790f50f6076 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e5256d91808b47c195bc9b4dbd7f2b87)
I20260709 13:04:59.265609 19482 raft_consensus.cc:1240] T 0afb57ae58a24a01850491d69f0213dd P 0473d2b2d01f4459b1e90fd12cc7840e [term 4 FOLLOWER]: Rejecting Update request from peer e61c3a8f61bb48f8a963c9480e53c168 for earlier term 3. Current term is 4. Ops: []
I20260709 13:04:59.258378 21105 leader_election.cc:290] T ab43d85f64114d4ebf618930e43d9ed0 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:04:59.266628 19482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46c5bfeecc314717bffe987e6844b6d0" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 7 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:04:59.264750 19477 raft_consensus.cc:2468] T 3e1f505cb0f1427bbd698ac889d80821 P 0473d2b2d01f4459b1e90fd12cc7840e [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 3.
I20260709 13:04:59.265672 21232 raft_consensus.cc:515] T 1f85fc4b527a48848e5faa083b604e36 P 127766fc592545a4997f7790f50f6076 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:04:59.267244 19482 raft_consensus.cc:2468] T 46c5bfeecc314717bffe987e6844b6d0 P 0473d2b2d01f4459b1e90fd12cc7840e [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 5.
I20260709 13:04:59.267745 19477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc225c93219c45538b53a1bd3d387e4d" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:04:59.268083 19482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4509b76741dc428e9201c70c1658da13" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:04:59.268379 19477 raft_consensus.cc:2468] T bc225c93219c45538b53a1bd3d387e4d P 0473d2b2d01f4459b1e90fd12cc7840e [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 4.
I20260709 13:04:59.270404 19477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab43d85f64114d4ebf618930e43d9ed0" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:04:59.270627 21232 leader_election.cc:290] T 1f85fc4b527a48848e5faa083b604e36 P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321)
I20260709 13:04:59.271204 19477 raft_consensus.cc:2468] T ab43d85f64114d4ebf618930e43d9ed0 P 0473d2b2d01f4459b1e90fd12cc7840e [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 4.
I20260709 13:04:59.271481 19480 raft_consensus.cc:1240] T 62c6c134d3d24a1ab144dd9ee6bc3f64 P 0473d2b2d01f4459b1e90fd12cc7840e [term 5 FOLLOWER]: Rejecting Update request from peer e61c3a8f61bb48f8a963c9480e53c168 for earlier term 4. Current term is 5. Ops: []
I20260709 13:04:59.274180 19485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b08304a0a02b42d7840c4e8ee9a6bd1a" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:04:59.275079 19485 raft_consensus.cc:2410] T b08304a0a02b42d7840c4e8ee9a6bd1a P 0473d2b2d01f4459b1e90fd12cc7840e [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate e61c3a8f61bb48f8a963c9480e53c168 for term 4 because replica has last-logged OpId of term: 3 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
W20260709 13:04:59.279862 19525 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:59.272746 19477 raft_consensus.cc:1240] T 28af091831594f9d8e96482078cc7625 P 0473d2b2d01f4459b1e90fd12cc7840e [term 5 FOLLOWER]: Rejecting Update request from peer e61c3a8f61bb48f8a963c9480e53c168 for earlier term 4. Current term is 5. Ops: []
I20260709 13:04:59.211979 21231 leader_election.cc:290] T 6c5eebf646ad445a9d1b1adc319d7b16 P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 4 election: Requested vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
W20260709 13:04:59.318230 19450 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.3:36891, user_credentials={real_user=slave}} blocked reactor thread for 483028us
I20260709 13:04:59.291294 21352 leader_election.cc:290] T 70797e5783b5454ab0d0eea663e791e3 P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:04:59.347538 19557 raft_consensus.cc:2468] T 6c5eebf646ad445a9d1b1adc319d7b16 P e61c3a8f61bb48f8a963c9480e53c168 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 127766fc592545a4997f7790f50f6076 in term 4.
I20260709 13:04:59.349562 20076 leader_election.cc:304] T 6c5eebf646ad445a9d1b1adc319d7b16 P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 127766fc592545a4997f7790f50f6076, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:04:59.312621 21192 raft_consensus.cc:493] T 2b74109013a140ada21feeef92d6f563 P e5256d91808b47c195bc9b4dbd7f2b87 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 0473d2b2d01f4459b1e90fd12cc7840e)
W20260709 13:04:59.351402 19449 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.1:40321, user_credentials={real_user=slave}} blocked reactor thread for 47428.9us
I20260709 13:04:59.305958 21215 consensus_queue.cc:1048] T 179fd671030940b4b4a4e24bcc4aba0a P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.037s
W20260709 13:04:59.412541 19449 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.1:40321, user_credentials={real_user=slave}} blocked reactor thread for 56651.3us
W20260709 13:04:59.392035 19450 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.3:36891, user_credentials={real_user=slave}} blocked reactor thread for 63168.3us
I20260709 13:04:59.379187 19408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b08304a0a02b42d7840c4e8ee9a6bd1a" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
I20260709 13:04:59.415370 19449 leader_election.cc:304] T bc225c93219c45538b53a1bd3d387e4d P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87; no voters: 
I20260709 13:04:59.377596 21336 raft_consensus.cc:493] T b9f0d59553ad444883fcf5b5909f9798 P e61c3a8f61bb48f8a963c9480e53c168 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:59.390916 21194 raft_consensus.cc:493] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P e5256d91808b47c195bc9b4dbd7f2b87 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:59.391747 21203 raft_consensus.cc:493] T 309c3ca0ca4b4f3ba129752ea2cb293b P e61c3a8f61bb48f8a963c9480e53c168 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader e5256d91808b47c195bc9b4dbd7f2b87)
I20260709 13:04:59.354351 21127 consensus_queue.cc:1048] T 217b5fae677b4971b3bbd2f357a1f7ff P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.065s
I20260709 13:04:59.412258 21335 raft_consensus.cc:493] T 86a6797bdfe94fa496c050ceae4bd0d9 P e5256d91808b47c195bc9b4dbd7f2b87 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader e61c3a8f61bb48f8a963c9480e53c168)
I20260709 13:04:59.433691 19405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21e14947d70440f19044d8f75c31e1f9" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
I20260709 13:04:59.434192 19407 raft_consensus.cc:1275] T ff9b0eddd810459b82d91c60777c10eb P e5256d91808b47c195bc9b4dbd7f2b87 [term 4 FOLLOWER]: Refusing update from remote peer 127766fc592545a4997f7790f50f6076: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:04:59.434342 19405 raft_consensus.cc:3060] T 21e14947d70440f19044d8f75c31e1f9 P e5256d91808b47c195bc9b4dbd7f2b87 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:04:59.416249 21197 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.514s	user 0.003s	sys 0.043s
I20260709 13:04:59.440730 19557 raft_consensus.cc:1275] T 179fd671030940b4b4a4e24bcc4aba0a P e61c3a8f61bb48f8a963c9480e53c168 [term 3 FOLLOWER]: Refusing update from remote peer 0473d2b2d01f4459b1e90fd12cc7840e: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:04:59.442988 19377 leader_election.cc:304] T f93ee515a9c14139bf566522ed8232f3 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87; no voters: 
I20260709 13:04:59.445600 19411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36f6ba92b9ba46babe4ebd6c02e5fbd9" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:04:59.445991 19554 raft_consensus.cc:1275] T 217b5fae677b4971b3bbd2f357a1f7ff P e61c3a8f61bb48f8a963c9480e53c168 [term 2 FOLLOWER]: Refusing update from remote peer 0473d2b2d01f4459b1e90fd12cc7840e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:59.438254 21203 raft_consensus.cc:515] T 309c3ca0ca4b4f3ba129752ea2cb293b P e61c3a8f61bb48f8a963c9480e53c168 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } attrs { replace: true } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:04:59.460151 19405 raft_consensus.cc:2468] T 21e14947d70440f19044d8f75c31e1f9 P e5256d91808b47c195bc9b4dbd7f2b87 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 4.
I20260709 13:04:59.448006 19560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0afb57ae58a24a01850491d69f0213dd" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:04:59.461218 19405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f85fc4b527a48848e5faa083b604e36" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:04:59.425159 21111 raft_consensus.cc:493] T df751f992649444090e27965eb1af85d P e61c3a8f61bb48f8a963c9480e53c168 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:59.467758 21111 raft_consensus.cc:515] T df751f992649444090e27965eb1af85d P e61c3a8f61bb48f8a963c9480e53c168 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:59.428184 21336 raft_consensus.cc:515] T b9f0d59553ad444883fcf5b5909f9798 P e61c3a8f61bb48f8a963c9480e53c168 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:59.468918 19552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc225c93219c45538b53a1bd3d387e4d" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:04:59.469964 19552 raft_consensus.cc:2393] T bc225c93219c45538b53a1bd3d387e4d P e61c3a8f61bb48f8a963c9480e53c168 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0473d2b2d01f4459b1e90fd12cc7840e in current term 5: Already voted for candidate e61c3a8f61bb48f8a963c9480e53c168 in this term.
I20260709 13:04:59.458904 19449 leader_election.cc:304] T f93ee515a9c14139bf566522ed8232f3 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87; no voters: 
I20260709 13:04:59.462294 19405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70797e5783b5454ab0d0eea663e791e3" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:04:59.465075 20104 raft_consensus.cc:3060] T 14935b3ddf914369822e4a0547aaa355 P 127766fc592545a4997f7790f50f6076 [term 1 LEARNER]: Advancing to term 2
I20260709 13:04:59.427831 21136 raft_consensus.cc:493] T fa8650e71aa14778b3d73721fc50d9fc P e5256d91808b47c195bc9b4dbd7f2b87 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader e61c3a8f61bb48f8a963c9480e53c168)
I20260709 13:04:59.469902 21111 leader_election.cc:290] T df751f992649444090e27965eb1af85d P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:04:59.348980 21342 leader_election.cc:290] T 46c5bfeecc314717bffe987e6844b6d0 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:04:59.375537 21352 raft_consensus.cc:2804] T 6c5eebf646ad445a9d1b1adc319d7b16 P 127766fc592545a4997f7790f50f6076 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:04:59.476014 19557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f93ee515a9c14139bf566522ed8232f3" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
W20260709 13:04:59.448668 21197 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.547s	user 0.003s	sys 0.043s
I20260709 13:04:59.430475 19402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1b10566f45d4a7d9029858330e02d5b" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:04:59.433676 21201 raft_consensus.cc:2804] T bc225c93219c45538b53a1bd3d387e4d P 0473d2b2d01f4459b1e90fd12cc7840e [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:04:59.376269 21192 raft_consensus.cc:515] T 2b74109013a140ada21feeef92d6f563 P e5256d91808b47c195bc9b4dbd7f2b87 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:59.431083 21194 raft_consensus.cc:515] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P e5256d91808b47c195bc9b4dbd7f2b87 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:04:59.438100 21335 raft_consensus.cc:515] T 86a6797bdfe94fa496c050ceae4bd0d9 P e5256d91808b47c195bc9b4dbd7f2b87 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:59.456359 21338 consensus_queue.cc:1048] T b9f0d59553ad444883fcf5b5909f9798 P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.044s
I20260709 13:04:59.471091 21232 consensus_queue.cc:1048] T ff9b0eddd810459b82d91c60777c10eb P 127766fc592545a4997f7790f50f6076 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.041s
I20260709 13:04:59.491561 19405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e1f505cb0f1427bbd698ac889d80821" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:04:59.470060 21336 leader_election.cc:290] T b9f0d59553ad444883fcf5b5909f9798 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
W20260709 13:04:59.503796 19449 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.1:40321, user_credentials={real_user=slave}} blocked reactor thread for 44962.2us
I20260709 13:04:59.477101 21344 raft_consensus.cc:493] T 179fd671030940b4b4a4e24bcc4aba0a P e61c3a8f61bb48f8a963c9480e53c168 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:59.525616 19556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc225c93219c45538b53a1bd3d387e4d" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:04:59.463073 21337 raft_consensus.cc:2804] T f93ee515a9c14139bf566522ed8232f3 P e5256d91808b47c195bc9b4dbd7f2b87 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:04:59.642835 19556 raft_consensus.cc:2468] T bc225c93219c45538b53a1bd3d387e4d P e61c3a8f61bb48f8a963c9480e53c168 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 5.
I20260709 13:04:59.499811 19560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62c6c134d3d24a1ab144dd9ee6bc3f64" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:04:59.627501 19557 raft_consensus.cc:2393] T f93ee515a9c14139bf566522ed8232f3 P e61c3a8f61bb48f8a963c9480e53c168 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 0473d2b2d01f4459b1e90fd12cc7840e in current term 5: Already voted for candidate e61c3a8f61bb48f8a963c9480e53c168 in this term.
I20260709 13:04:59.599567 19481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c5eebf646ad445a9d1b1adc319d7b16" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:04:59.572324 19484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46c5bfeecc314717bffe987e6844b6d0" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 7 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:04:59.644526 19484 raft_consensus.cc:2468] T 46c5bfeecc314717bffe987e6844b6d0 P 0473d2b2d01f4459b1e90fd12cc7840e [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 5.
I20260709 13:04:59.645526 19484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f85fc4b527a48848e5faa083b604e36" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:04:59.527258 19555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46c5bfeecc314717bffe987e6844b6d0" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 7 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:04:59.524748 19523 leader_election.cc:304] T 21e14947d70440f19044d8f75c31e1f9 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:04:59.528055 19375 leader_election.cc:304] T ab43d85f64114d4ebf618930e43d9ed0 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:04:59.631773 19405 raft_consensus.cc:2468] T 3e1f505cb0f1427bbd698ac889d80821 P e5256d91808b47c195bc9b4dbd7f2b87 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 3.
W20260709 13:04:59.573406 19374 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.4:43121, user_credentials={real_user=slave}} blocked reactor thread for 117136us
I20260709 13:04:59.646975 19555 raft_consensus.cc:2468] T 46c5bfeecc314717bffe987e6844b6d0 P e61c3a8f61bb48f8a963c9480e53c168 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 6.
I20260709 13:04:59.640260 19486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c5eebf646ad445a9d1b1adc319d7b16" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
W20260709 13:04:59.600203 21386 log.cc:927] Time spent T ff9b0eddd810459b82d91c60777c10eb P 0473d2b2d01f4459b1e90fd12cc7840e: Append to log took a long time: real 0.096s	user 0.000s	sys 0.001s
W20260709 13:04:59.650607 19523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.1:40321, user_credentials={real_user=slave}} blocked reactor thread for 125917us
I20260709 13:04:59.651068 19481 raft_consensus.cc:2393] T 6c5eebf646ad445a9d1b1adc319d7b16 P 0473d2b2d01f4459b1e90fd12cc7840e [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 127766fc592545a4997f7790f50f6076 in current term 4: Already voted for candidate 0473d2b2d01f4459b1e90fd12cc7840e in this term.
W20260709 13:04:59.591387 21391 log.cc:927] Time spent T 62c6c134d3d24a1ab144dd9ee6bc3f64 P 127766fc592545a4997f7790f50f6076: Append to log took a long time: real 0.063s	user 0.000s	sys 0.000s
I20260709 13:04:59.652997 19526 leader_election.cc:400] T 6c5eebf646ad445a9d1b1adc319d7b16 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 3 pre-election: Vote denied by peer 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257) with higher term. Message: Invalid argument: T 6c5eebf646ad445a9d1b1adc319d7b16 P 0473d2b2d01f4459b1e90fd12cc7840e [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e61c3a8f61bb48f8a963c9480e53c168 for earlier term 3. Current term is 4.
I20260709 13:04:59.492311 19551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46c5bfeecc314717bffe987e6844b6d0" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 6 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:04:59.607563 21203 leader_election.cc:290] T 309c3ca0ca4b4f3ba129752ea2cb293b P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:04:59.700273 19526 leader_election.cc:403] T 6c5eebf646ad445a9d1b1adc319d7b16 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 3 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:04:59.655745 19411 raft_consensus.cc:2468] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P e5256d91808b47c195bc9b4dbd7f2b87 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 127766fc592545a4997f7790f50f6076 in term 5.
W20260709 13:04:59.704046 19526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.2:46257, user_credentials={real_user=slave}} blocked reactor thread for 53271.6us
I20260709 13:04:59.600570 21357 raft_consensus.cc:493] T 85c494af21f9457a85da47b9bc70c1fd P 127766fc592545a4997f7790f50f6076 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e5256d91808b47c195bc9b4dbd7f2b87)
I20260709 13:04:59.520413 19480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc225c93219c45538b53a1bd3d387e4d" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:04:59.691064 19405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46c5bfeecc314717bffe987e6844b6d0" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 7 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:04:59.696843 20075 leader_election.cc:304] T 70797e5783b5454ab0d0eea663e791e3 P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 127766fc592545a4997f7790f50f6076; no voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168
W20260709 13:04:59.653002 19375 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.3:36891, user_credentials={real_user=slave}} blocked reactor thread for 125014us
I20260709 13:04:59.484602 21136 raft_consensus.cc:515] T fa8650e71aa14778b3d73721fc50d9fc P e5256d91808b47c195bc9b4dbd7f2b87 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:59.651399 21337 raft_consensus.cc:493] T f93ee515a9c14139bf566522ed8232f3 P e5256d91808b47c195bc9b4dbd7f2b87 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:59.579125 21387 raft_consensus.cc:493] T 4af19371ea874c09a0a2147040835cbb P e5256d91808b47c195bc9b4dbd7f2b87 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 127766fc592545a4997f7790f50f6076)
I20260709 13:04:59.702800 20867 raft_consensus.cc:2804] T ab43d85f64114d4ebf618930e43d9ed0 P e5256d91808b47c195bc9b4dbd7f2b87 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:04:59.706166 20108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "309c3ca0ca4b4f3ba129752ea2cb293b" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:04:59.527849 21111 raft_consensus.cc:493] T 85c494af21f9457a85da47b9bc70c1fd P e61c3a8f61bb48f8a963c9480e53c168 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e5256d91808b47c195bc9b4dbd7f2b87)
I20260709 13:04:59.626969 21201 raft_consensus.cc:493] T bc225c93219c45538b53a1bd3d387e4d P 0473d2b2d01f4459b1e90fd12cc7840e [term 4 FOLLOWER]: Starting leader election (detected failure of leader e5256d91808b47c195bc9b4dbd7f2b87)
I20260709 13:04:59.642975 21352 raft_consensus.cc:697] T 6c5eebf646ad445a9d1b1adc319d7b16 P 127766fc592545a4997f7790f50f6076 [term 4 LEADER]: Becoming Leader. State: Replica: 127766fc592545a4997f7790f50f6076, State: Running, Role: LEADER
I20260709 13:04:59.639035 19477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab43d85f64114d4ebf618930e43d9ed0" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:04:59.721339 19405 raft_consensus.cc:2468] T 46c5bfeecc314717bffe987e6844b6d0 P e5256d91808b47c195bc9b4dbd7f2b87 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 6.
I20260709 13:04:59.506662 21372 raft_consensus.cc:2804] T f93ee515a9c14139bf566522ed8232f3 P 0473d2b2d01f4459b1e90fd12cc7840e [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:04:59.642223 19402 raft_consensus.cc:2468] T f1b10566f45d4a7d9029858330e02d5b P e5256d91808b47c195bc9b4dbd7f2b87 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 4.
I20260709 13:04:59.728914 21372 raft_consensus.cc:697] T f93ee515a9c14139bf566522ed8232f3 P 0473d2b2d01f4459b1e90fd12cc7840e [term 5 LEADER]: Becoming Leader. State: Replica: 0473d2b2d01f4459b1e90fd12cc7840e, State: Running, Role: LEADER
I20260709 13:04:59.701563 21343 raft_consensus.cc:2804] T 21e14947d70440f19044d8f75c31e1f9 P e61c3a8f61bb48f8a963c9480e53c168 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:04:59.738390 19405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc225c93219c45538b53a1bd3d387e4d" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:04:59.739815 19405 raft_consensus.cc:2468] T bc225c93219c45538b53a1bd3d387e4d P e5256d91808b47c195bc9b4dbd7f2b87 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 5.
I20260709 13:04:59.728737 21111 raft_consensus.cc:515] T 85c494af21f9457a85da47b9bc70c1fd P e61c3a8f61bb48f8a963c9480e53c168 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:04:59.719916 20107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62c6c134d3d24a1ab144dd9ee6bc3f64" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076"
I20260709 13:04:59.723045 21337 raft_consensus.cc:3060] T f93ee515a9c14139bf566522ed8232f3 P e5256d91808b47c195bc9b4dbd7f2b87 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:04:59.654088 21344 raft_consensus.cc:515] T 179fd671030940b4b4a4e24bcc4aba0a P e61c3a8f61bb48f8a963c9480e53c168 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:59.724858 20867 raft_consensus.cc:493] T ab43d85f64114d4ebf618930e43d9ed0 P e5256d91808b47c195bc9b4dbd7f2b87 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:59.740638 19405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9f0d59553ad444883fcf5b5909f9798" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:04:59.750787 19407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4509b76741dc428e9201c70c1658da13" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:04:59.707499 21347 raft_consensus.cc:2749] T 6c5eebf646ad445a9d1b1adc319d7b16 P e61c3a8f61bb48f8a963c9480e53c168 [term 4 FOLLOWER]: Leader pre-election lost for term 3. Reason: Vote denied by peer 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257) with higher term. Message: Invalid argument: T 6c5eebf646ad445a9d1b1adc319d7b16 P 0473d2b2d01f4459b1e90fd12cc7840e [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e61c3a8f61bb48f8a963c9480e53c168 for earlier term 3. Current term is 4.
I20260709 13:04:59.720293 19551 raft_consensus.cc:2468] T 46c5bfeecc314717bffe987e6844b6d0 P e61c3a8f61bb48f8a963c9480e53c168 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 6.
I20260709 13:04:59.707007 21306 consensus_queue.cc:1048] T b9f0d59553ad444883fcf5b5909f9798 P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.037s
I20260709 13:04:59.749852 19405 raft_consensus.cc:2468] T b9f0d59553ad444883fcf5b5909f9798 P e5256d91808b47c195bc9b4dbd7f2b87 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 3.
I20260709 13:04:59.756559 19481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df751f992649444090e27965eb1af85d" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:04:59.757754 19484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "309c3ca0ca4b4f3ba129752ea2cb293b" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:04:59.734443 21203 consensus_queue.cc:1059] T 0afb57ae58a24a01850491d69f0213dd P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.031s
I20260709 13:04:59.727546 21201 raft_consensus.cc:3060] T bc225c93219c45538b53a1bd3d387e4d P 0473d2b2d01f4459b1e90fd12cc7840e [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:04:59.764742 21344 leader_election.cc:290] T 179fd671030940b4b4a4e24bcc4aba0a P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:04:59.781891 19479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9f0d59553ad444883fcf5b5909f9798" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:04:59.750351 21343 raft_consensus.cc:697] T 21e14947d70440f19044d8f75c31e1f9 P e61c3a8f61bb48f8a963c9480e53c168 [term 4 LEADER]: Becoming Leader. State: Replica: e61c3a8f61bb48f8a963c9480e53c168, State: Running, Role: LEADER
I20260709 13:04:59.738718 19477 raft_consensus.cc:2468] T ab43d85f64114d4ebf618930e43d9ed0 P 0473d2b2d01f4459b1e90fd12cc7840e [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 4.
I20260709 13:04:59.726219 21357 raft_consensus.cc:515] T 85c494af21f9457a85da47b9bc70c1fd P 127766fc592545a4997f7790f50f6076 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:04:59.764930 19407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab43d85f64114d4ebf618930e43d9ed0" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:04:59.754060 21140 raft_consensus.cc:493] T a08760e15aac4630a629431f56024dc8 P 0473d2b2d01f4459b1e90fd12cc7840e [term 3 FOLLOWER]: Starting pre-election (detected failure of leader e5256d91808b47c195bc9b4dbd7f2b87)
I20260709 13:04:59.767990 21253 raft_consensus.cc:493] T 0cdf56e38bbc453d9438d359e5a69955 P 0473d2b2d01f4459b1e90fd12cc7840e [term 4 FOLLOWER]: Starting pre-election (detected failure of leader e5256d91808b47c195bc9b4dbd7f2b87)
W20260709 13:04:59.785676 19526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.2:46257, user_credentials={real_user=slave}} blocked reactor thread for 79293.4us
I20260709 13:04:59.766270 19402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab43d85f64114d4ebf618930e43d9ed0" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:04:59.791131 19526 leader_election.cc:304] T 3e1f505cb0f1427bbd698ac889d80821 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:04:59.784650 19405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df751f992649444090e27965eb1af85d" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:04:59.750551 20867 raft_consensus.cc:3060] T ab43d85f64114d4ebf618930e43d9ed0 P e5256d91808b47c195bc9b4dbd7f2b87 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:04:59.727157 21387 raft_consensus.cc:515] T 4af19371ea874c09a0a2147040835cbb P e5256d91808b47c195bc9b4dbd7f2b87 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:04:59.788750 21372 consensus_queue.cc:237] T f93ee515a9c14139bf566522ed8232f3 P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:59.798480 19526 leader_election.cc:304] T 46c5bfeecc314717bffe987e6844b6d0 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:04:59.798974 21192 leader_election.cc:290] T 2b74109013a140ada21feeef92d6f563 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:04:59.799324 19526 leader_election.cc:304] T bc225c93219c45538b53a1bd3d387e4d P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:04:59.799556 21347 raft_consensus.cc:2804] T 46c5bfeecc314717bffe987e6844b6d0 P e61c3a8f61bb48f8a963c9480e53c168 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:04:59.799997 21347 raft_consensus.cc:493] T 46c5bfeecc314717bffe987e6844b6d0 P e61c3a8f61bb48f8a963c9480e53c168 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:59.800356 19526 leader_election.cc:304] T ab43d85f64114d4ebf618930e43d9ed0 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:04:59.800685 21344 raft_consensus.cc:2804] T bc225c93219c45538b53a1bd3d387e4d P e61c3a8f61bb48f8a963c9480e53c168 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:04:59.801121 21344 raft_consensus.cc:493] T bc225c93219c45538b53a1bd3d387e4d P e61c3a8f61bb48f8a963c9480e53c168 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:04:59.801553 20075 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.1:40321, user_credentials={real_user=slave}} blocked reactor thread for 104768us
I20260709 13:04:59.803978 21335 leader_election.cc:290] T 86a6797bdfe94fa496c050ceae4bd0d9 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:04:59.791476 21140 raft_consensus.cc:515] T a08760e15aac4630a629431f56024dc8 P 0473d2b2d01f4459b1e90fd12cc7840e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:59.811334 21140 leader_election.cc:290] T a08760e15aac4630a629431f56024dc8 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:04:59.792162 21343 consensus_queue.cc:237] T 21e14947d70440f19044d8f75c31e1f9 P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:59.792765 21253 raft_consensus.cc:515] T 0cdf56e38bbc453d9438d359e5a69955 P 0473d2b2d01f4459b1e90fd12cc7840e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:59.816689 21253 leader_election.cc:290] T 0cdf56e38bbc453d9438d359e5a69955 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:04:59.817149 21373 raft_consensus.cc:493] T ef32ce6fdd0e40d382c79974f30295c6 P 0473d2b2d01f4459b1e90fd12cc7840e [term 4 FOLLOWER]: Starting pre-election (detected failure of leader e5256d91808b47c195bc9b4dbd7f2b87)
I20260709 13:04:59.793126 21357 leader_election.cc:290] T 85c494af21f9457a85da47b9bc70c1fd P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:04:59.767578 21340 raft_consensus.cc:2749] T 70797e5783b5454ab0d0eea663e791e3 P 127766fc592545a4997f7790f50f6076 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:04:59.800321 21347 raft_consensus.cc:3060] T 46c5bfeecc314717bffe987e6844b6d0 P e61c3a8f61bb48f8a963c9480e53c168 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:04:59.801569 21344 raft_consensus.cc:3060] T bc225c93219c45538b53a1bd3d387e4d P e61c3a8f61bb48f8a963c9480e53c168 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:04:59.821574 21336 raft_consensus.cc:2804] T 3e1f505cb0f1427bbd698ac889d80821 P e61c3a8f61bb48f8a963c9480e53c168 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:04:59.817739 21373 raft_consensus.cc:515] T ef32ce6fdd0e40d382c79974f30295c6 P 0473d2b2d01f4459b1e90fd12cc7840e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:59.840665 19551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85c494af21f9457a85da47b9bc70c1fd" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:04:59.796501 21352 consensus_queue.cc:237] T 6c5eebf646ad445a9d1b1adc319d7b16 P 127766fc592545a4997f7790f50f6076 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:04:59.860005 21400 raft_consensus.cc:2804] T ab43d85f64114d4ebf618930e43d9ed0 P e61c3a8f61bb48f8a963c9480e53c168 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:04:59.897480 21400 raft_consensus.cc:493] T ab43d85f64114d4ebf618930e43d9ed0 P e61c3a8f61bb48f8a963c9480e53c168 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:59.897892 21400 raft_consensus.cc:3060] T ab43d85f64114d4ebf618930e43d9ed0 P e61c3a8f61bb48f8a963c9480e53c168 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:04:59.899075 21387 leader_election.cc:290] T 4af19371ea874c09a0a2147040835cbb P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:04:59.852022 21336 raft_consensus.cc:493] T 3e1f505cb0f1427bbd698ac889d80821 P e61c3a8f61bb48f8a963c9480e53c168 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:59.902312 21336 raft_consensus.cc:3060] T 3e1f505cb0f1427bbd698ac889d80821 P e61c3a8f61bb48f8a963c9480e53c168 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:04:59.906819 19478 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58286 (request call id 1224) took 1442 ms (client timeout 1846 ms). Trace:
W20260709 13:04:59.907248 19478 rpcz_store.cc:269] 0709 13:04:58.463948 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:58.464263 (+   315us) service_pool.cc:224] Handling call
0709 13:04:59.906578 (+1442315us) spinlock_profiling.cc:243] Waited 1.17 s on lock 0x7b540035d9d4. stack: 00007f4a79de9343 00007f4a79de9240 00007f4a797781d4 00007f4a834b6304 00007f4a834b6299 00007f4a7ce71571 00007f4a7cf0c2fa 00007f4a81ecdb17 00007f4a7b4486d4 00007f4a7b448662 00007f4a7b448591 00007f4a7b44850c 00007f4a7b4477c2 00007f4a7b24348c 00007f4a7b2428c6 00007f4a7b24226f
0709 13:04:59.906728 (+   150us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2701914368}
I20260709 13:04:59.861061 21385 raft_consensus.cc:493] T b08304a0a02b42d7840c4e8ee9a6bd1a P 0473d2b2d01f4459b1e90fd12cc7840e [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:59.868721 19410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cdf56e38bbc453d9438d359e5a69955" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:04:59.908103 21385 raft_consensus.cc:515] T b08304a0a02b42d7840c4e8ee9a6bd1a P 0473d2b2d01f4459b1e90fd12cc7840e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:59.881724 19483 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58294 (request call id 1418) took 1055 ms. Trace:
W20260709 13:04:59.910094 21377 log.cc:927] Time spent T 9962423cb4e54fcfa5de01daf68a86e7 P 127766fc592545a4997f7790f50f6076: Append to log took a long time: real 0.876s	user 0.007s	sys 0.003s
I20260709 13:04:59.908941 19483 rpcz_store.cc:276] 0709 13:04:58.826492 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:58.828637 (+  2145us) service_pool.cc:224] Handling call
0709 13:04:58.828959 (+   322us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:04:59.044778 (+215819us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 13:04:59.070779 (+ 26001us) log.cc:844] Serialized 14 byte log entry
0709 13:04:59.354487 (+283708us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:04:59.815782 (+461295us) spinlock_profiling.cc:243] Waited 37.4 ms on lock 0x7b2c000010a8. stack: 00007f4a79de9343 00007f4a79de9240 00007f4a797781d4 00007f4a834b6304 00007f4a834b6299 00007f4a7b801a11 00007f4a7b811372 00007f4a7cf43a01 00007f4a7cf0843a 00007f4a7cf0783e 00007f4a81ecc419 00007f4a7b443bd4 00007f4a7b443b62 00007f4a7b443a91 00007f4a7b443a0c 00007f4a7b442cc2
0709 13:04:59.816291 (+   509us) log.cc:844] Serialized 26 byte log entry
0709 13:04:59.816475 (+   184us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:04:59.816742 (+   267us) log.cc:844] Serialized 14 byte log entry
0709 13:04:59.816994 (+   252us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:59.817093 (+    99us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:04:59.881476 (+ 64383us) raft_consensus.cc:1685] finished
0709 13:04:59.881499 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:59.881642 (+   143us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":17663,"prepare.run_cpu_time_us":87,"prepare.run_wall_time_us":1588,"raft.queue_time_us":47655,"raft.run_cpu_time_us":168,"raft.run_wall_time_us":170,"spinlock_wait_cycles":85927808,"thread_start_us":498770,"threads_started":2,"wal-append.queue_time_us":451612}
I20260709 13:04:59.882982 19402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a08760e15aac4630a629431f56024dc8" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
W20260709 13:04:59.912683 21398 log.cc:927] Time spent T d1e5873a19244c5ebbcd38e126796ee7 P e5256d91808b47c195bc9b4dbd7f2b87: Append to log took a long time: real 0.110s	user 0.001s	sys 0.000s
W20260709 13:04:59.914814 19526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.2:46257, user_credentials={real_user=slave}} blocked reactor thread for 114514us
I20260709 13:04:59.883605 21136 leader_election.cc:290] T fa8650e71aa14778b3d73721fc50d9fc P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:04:59.884397 21111 leader_election.cc:290] T 85c494af21f9457a85da47b9bc70c1fd P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:04:59.917349 19410 raft_consensus.cc:1240] T 21e14947d70440f19044d8f75c31e1f9 P e5256d91808b47c195bc9b4dbd7f2b87 [term 4 FOLLOWER]: Rejecting Update request from peer 0473d2b2d01f4459b1e90fd12cc7840e for earlier term 3. Current term is 4. Ops: []
I20260709 13:04:59.917740 21111 consensus_queue.cc:1059] T 62c6c134d3d24a1ab144dd9ee6bc3f64 P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:04:59.925506 21111 raft_consensus.cc:3055] T 62c6c134d3d24a1ab144dd9ee6bc3f64 P e61c3a8f61bb48f8a963c9480e53c168 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:04:59.925884 21111 raft_consensus.cc:740] T 62c6c134d3d24a1ab144dd9ee6bc3f64 P e61c3a8f61bb48f8a963c9480e53c168 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: e61c3a8f61bb48f8a963c9480e53c168, State: Running, Role: LEADER
I20260709 13:04:59.926462 19411 raft_consensus.cc:1275] T f1b10566f45d4a7d9029858330e02d5b P e5256d91808b47c195bc9b4dbd7f2b87 [term 4 FOLLOWER]: Refusing update from remote peer 0473d2b2d01f4459b1e90fd12cc7840e: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:04:59.926651 21111 consensus_queue.cc:260] T 62c6c134d3d24a1ab144dd9ee6bc3f64 P e61c3a8f61bb48f8a963c9480e53c168 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:04:59.927937 21111 raft_consensus.cc:3060] T 62c6c134d3d24a1ab144dd9ee6bc3f64 P e61c3a8f61bb48f8a963c9480e53c168 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:04:59.910581 21385 leader_election.cc:290] T b08304a0a02b42d7840c4e8ee9a6bd1a P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:04:59.931236 21385 raft_consensus.cc:493] T 48824d5acfbc485ebf8c2d944e7202de P 0473d2b2d01f4459b1e90fd12cc7840e [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 127766fc592545a4997f7790f50f6076)
I20260709 13:04:59.931710 21385 raft_consensus.cc:515] T 48824d5acfbc485ebf8c2d944e7202de P 0473d2b2d01f4459b1e90fd12cc7840e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:04:59.933704 21385 leader_election.cc:290] T 48824d5acfbc485ebf8c2d944e7202de P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:04:59.934279 21395 raft_consensus.cc:493] T fa731b585f684a7fb2d106c50f143b83 P e5256d91808b47c195bc9b4dbd7f2b87 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 127766fc592545a4997f7790f50f6076)
I20260709 13:04:59.920347 19526 leader_election.cc:304] T b08304a0a02b42d7840c4e8ee9a6bd1a P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e61c3a8f61bb48f8a963c9480e53c168; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:04:59.934767 20112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48824d5acfbc485ebf8c2d944e7202de" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
W20260709 13:04:59.934809 19375 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.3:36891, user_credentials={real_user=slave}} blocked reactor thread for 212771us
I20260709 13:04:59.941205 20112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4af19371ea874c09a0a2147040835cbb" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:04:59.924679 20105 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46422 (request call id 426) took 1244 ms. Trace:
I20260709 13:04:59.945820 21406 raft_consensus.cc:2749] T b08304a0a02b42d7840c4e8ee9a6bd1a P e61c3a8f61bb48f8a963c9480e53c168 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:04:59.937335 20075 leader_election.cc:304] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 127766fc592545a4997f7790f50f6076, e5256d91808b47c195bc9b4dbd7f2b87; no voters: 
I20260709 13:04:59.952612 19411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b08304a0a02b42d7840c4e8ee9a6bd1a" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:04:59.954111 19482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "179fd671030940b4b4a4e24bcc4aba0a" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:04:59.954861 21402 raft_consensus.cc:2804] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P 127766fc592545a4997f7790f50f6076 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:04:59.955264 21402 raft_consensus.cc:493] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P 127766fc592545a4997f7790f50f6076 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:59.968497 20112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85c494af21f9457a85da47b9bc70c1fd" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:04:59.970446 19523 leader_election.cc:304] T 309c3ca0ca4b4f3ba129752ea2cb293b P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: e61c3a8f61bb48f8a963c9480e53c168; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, 127766fc592545a4997f7790f50f6076
I20260709 13:04:59.949120 21400 raft_consensus.cc:515] T ab43d85f64114d4ebf618930e43d9ed0 P e61c3a8f61bb48f8a963c9480e53c168 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } attrs { replace: true } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: NON_VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: true } }
I20260709 13:04:59.987011 20078 leader_election.cc:304] T 1f85fc4b527a48848e5faa083b604e36 P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 127766fc592545a4997f7790f50f6076; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:04:59.958427 21406 raft_consensus.cc:493] T ff75a1d4cb1f493db8f71ddc136ba9ab P e61c3a8f61bb48f8a963c9480e53c168 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 0473d2b2d01f4459b1e90fd12cc7840e)
I20260709 13:04:59.958268 21402 raft_consensus.cc:3060] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P 127766fc592545a4997f7790f50f6076 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:04:59.948350 20105 rpcz_store.cc:276] 0709 13:04:58.680453 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:58.697462 (+ 17009us) service_pool.cc:224] Handling call
0709 13:04:59.924498 (+1227036us) spinlock_profiling.cc:243] Waited 66 ms on lock 0x7b5400661054. stack: 00007f4a79de9343 00007f4a79de9240 00007f4a797781d4 00007f4a834b6304 00007f4a834b6299 00007f4a7ce71571 00007f4a7cf0c2fa 00007f4a81ecdb17 00007f4a7b4486d4 00007f4a7b448662 00007f4a7b448591 00007f4a7b44850c 00007f4a7b4477c2 00007f4a7b24348c 00007f4a7b2428c6 00007f4a7b24226f
0709 13:04:59.924616 (+   118us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":151883520}
I20260709 13:04:59.946928 21395 raft_consensus.cc:515] T fa731b585f684a7fb2d106c50f143b83 P e5256d91808b47c195bc9b4dbd7f2b87 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:04:59.996443 21337 raft_consensus.cc:515] T f93ee515a9c14139bf566522ed8232f3 P e5256d91808b47c195bc9b4dbd7f2b87 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:04:59.996500 19559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a08760e15aac4630a629431f56024dc8" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:04:59.999372 19555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48824d5acfbc485ebf8c2d944e7202de" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:04:59.958372 21140 consensus_queue.cc:1059] T 21e14947d70440f19044d8f75c31e1f9 P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.026s
I20260709 13:04:59.958583 21253 consensus_queue.cc:1048] T f1b10566f45d4a7d9029858330e02d5b P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.031s
I20260709 13:04:59.981396 20853 raft_consensus.cc:2749] T 309c3ca0ca4b4f3ba129752ea2cb293b P e61c3a8f61bb48f8a963c9480e53c168 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:04:59.959978 21201 raft_consensus.cc:515] T bc225c93219c45538b53a1bd3d387e4d P 0473d2b2d01f4459b1e90fd12cc7840e [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:00.022734 19560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b08304a0a02b42d7840c4e8ee9a6bd1a" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:05:00.026849 19560 raft_consensus.cc:2468] T b08304a0a02b42d7840c4e8ee9a6bd1a P e61c3a8f61bb48f8a963c9480e53c168 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 4.
I20260709 13:04:59.993743 21197 raft_consensus.cc:493] T 28af091831594f9d8e96482078cc7625 P 0473d2b2d01f4459b1e90fd12cc7840e [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:00.025621 19523 leader_election.cc:304] T f1b10566f45d4a7d9029858330e02d5b P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168; no voters: 0473d2b2d01f4459b1e90fd12cc7840e
I20260709 13:05:00.032214 21322 raft_consensus.cc:2804] T f1b10566f45d4a7d9029858330e02d5b P e61c3a8f61bb48f8a963c9480e53c168 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:05:00.032617 21322 raft_consensus.cc:493] T f1b10566f45d4a7d9029858330e02d5b P e61c3a8f61bb48f8a963c9480e53c168 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:00.032960 21322 raft_consensus.cc:3060] T f1b10566f45d4a7d9029858330e02d5b P e61c3a8f61bb48f8a963c9480e53c168 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:05:00.035848 19523 leader_election.cc:304] T 4509b76741dc428e9201c70c1658da13 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e61c3a8f61bb48f8a963c9480e53c168; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:04:59.989488 21401 raft_consensus.cc:2749] T 1f85fc4b527a48848e5faa083b604e36 P 127766fc592545a4997f7790f50f6076 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:05:00.040050 19408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85c494af21f9457a85da47b9bc70c1fd" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:05:00.042435 19523 leader_election.cc:304] T b9f0d59553ad444883fcf5b5909f9798 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168; no voters: 0473d2b2d01f4459b1e90fd12cc7840e
I20260709 13:05:00.045794 19409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "309c3ca0ca4b4f3ba129752ea2cb293b" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:05:00.047482 19410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "179fd671030940b4b4a4e24bcc4aba0a" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:05:00.049602 21407 raft_consensus.cc:2749] T 4509b76741dc428e9201c70c1658da13 P e61c3a8f61bb48f8a963c9480e53c168 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:05:00.051033 21362 consensus_queue.cc:1048] T 179fd671030940b4b4a4e24bcc4aba0a P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:05:00.052784 21362 consensus_queue.cc:1048] T 217b5fae677b4971b3bbd2f357a1f7ff P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:05:00.041862 19450 leader_election.cc:304] T 0afb57ae58a24a01850491d69f0213dd P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e; no voters: 127766fc592545a4997f7790f50f6076, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:05:00.056059 19408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85c494af21f9457a85da47b9bc70c1fd" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:04:59.998376 21406 raft_consensus.cc:515] T ff75a1d4cb1f493db8f71ddc136ba9ab P e61c3a8f61bb48f8a963c9480e53c168 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:00.058732 20075 leader_election.cc:304] T 85c494af21f9457a85da47b9bc70c1fd P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 127766fc592545a4997f7790f50f6076; no voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:05:00.060087 21401 raft_consensus.cc:2749] T 85c494af21f9457a85da47b9bc70c1fd P 127766fc592545a4997f7790f50f6076 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:05:00.060523 21406 leader_election.cc:290] T ff75a1d4cb1f493db8f71ddc136ba9ab P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:05:00.040087 21370 raft_consensus.cc:493] T 179fd671030940b4b4a4e24bcc4aba0a P e5256d91808b47c195bc9b4dbd7f2b87 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 0473d2b2d01f4459b1e90fd12cc7840e)
I20260709 13:05:00.061339 21370 raft_consensus.cc:515] T 179fd671030940b4b4a4e24bcc4aba0a P e5256d91808b47c195bc9b4dbd7f2b87 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:00.063977 21140 raft_consensus.cc:3055] T 21e14947d70440f19044d8f75c31e1f9 P 0473d2b2d01f4459b1e90fd12cc7840e [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:05:00.064397 21400 leader_election.cc:290] T ab43d85f64114d4ebf618930e43d9ed0 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 5 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:05:00.064502 21140 raft_consensus.cc:740] T 21e14947d70440f19044d8f75c31e1f9 P 0473d2b2d01f4459b1e90fd12cc7840e [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 0473d2b2d01f4459b1e90fd12cc7840e, State: Running, Role: LEADER
I20260709 13:05:00.065541 21328 raft_consensus.cc:493] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P 0473d2b2d01f4459b1e90fd12cc7840e [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:00.066069 21328 raft_consensus.cc:515] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P 0473d2b2d01f4459b1e90fd12cc7840e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:05:00.069896 19482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff75a1d4cb1f493db8f71ddc136ba9ab" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:05:00.070752 19554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c5eebf646ad445a9d1b1adc319d7b16" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:05:00.070972 19483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab43d85f64114d4ebf618930e43d9ed0" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:05:00.071445 19483 raft_consensus.cc:3060] T ab43d85f64114d4ebf618930e43d9ed0 P 0473d2b2d01f4459b1e90fd12cc7840e [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:05:00.071542 19554 raft_consensus.cc:2393] T 6c5eebf646ad445a9d1b1adc319d7b16 P e61c3a8f61bb48f8a963c9480e53c168 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 0473d2b2d01f4459b1e90fd12cc7840e in current term 4: Already voted for candidate 127766fc592545a4997f7790f50f6076 in this term.
I20260709 13:05:00.071889 19450 leader_election.cc:304] T 62c6c134d3d24a1ab144dd9ee6bc3f64 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e; no voters: 127766fc592545a4997f7790f50f6076, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:05:00.072435 19411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36f6ba92b9ba46babe4ebd6c02e5fbd9" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:05:00.073189 19411 raft_consensus.cc:2410] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P e5256d91808b47c195bc9b4dbd7f2b87 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0473d2b2d01f4459b1e90fd12cc7840e for term 6 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 13:05:00.073410 19450 leader_election.cc:304] T 46c5bfeecc314717bffe987e6844b6d0 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168; no voters: e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:05:00.073808 19480 raft_consensus.cc:2468] T bc225c93219c45538b53a1bd3d387e4d P 0473d2b2d01f4459b1e90fd12cc7840e [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 5.
I20260709 13:05:00.080257 19523 leader_election.cc:304] T df751f992649444090e27965eb1af85d P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e61c3a8f61bb48f8a963c9480e53c168; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:05:00.068275 21328 leader_election.cc:290] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:05:00.026403 19552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cdf56e38bbc453d9438d359e5a69955" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:05:00.090250 19560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86a6797bdfe94fa496c050ceae4bd0d9" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:05:00.090780 19555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa8650e71aa14778b3d73721fc50d9fc" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
W20260709 13:05:00.088636 19377 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.2:46257, user_credentials={real_user=slave}} blocked reactor thread for 86385.2us
I20260709 13:05:00.098863 21111 raft_consensus.cc:2749] T df751f992649444090e27965eb1af85d P e61c3a8f61bb48f8a963c9480e53c168 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:05:00.098167 19523 leader_election.cc:304] T 179fd671030940b4b4a4e24bcc4aba0a P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e61c3a8f61bb48f8a963c9480e53c168; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:05:00.107110 19483 raft_consensus.cc:2468] T ab43d85f64114d4ebf618930e43d9ed0 P 0473d2b2d01f4459b1e90fd12cc7840e [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 5.
I20260709 13:05:00.065789 21140 consensus_queue.cc:260] T 21e14947d70440f19044d8f75c31e1f9 P 0473d2b2d01f4459b1e90fd12cc7840e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:00.000728 20867 raft_consensus.cc:515] T ab43d85f64114d4ebf618930e43d9ed0 P e5256d91808b47c195bc9b4dbd7f2b87 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } attrs { replace: true } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: NON_VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: true } }
I20260709 13:05:00.116281 19526 leader_election.cc:304] T ab43d85f64114d4ebf618930e43d9ed0 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:05:00.125870 19523 leader_election.cc:304] T 85c494af21f9457a85da47b9bc70c1fd P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e61c3a8f61bb48f8a963c9480e53c168; no voters: 127766fc592545a4997f7790f50f6076, e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:05:00.100697 19554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b74109013a140ada21feeef92d6f563" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:05:00.091686 21385 raft_consensus.cc:2749] T 62c6c134d3d24a1ab144dd9ee6bc3f64 P 0473d2b2d01f4459b1e90fd12cc7840e [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:05:00.101432 21338 raft_consensus.cc:2804] T 46c5bfeecc314717bffe987e6844b6d0 P 0473d2b2d01f4459b1e90fd12cc7840e [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:05:00.046499 21197 raft_consensus.cc:515] T 28af091831594f9d8e96482078cc7625 P 0473d2b2d01f4459b1e90fd12cc7840e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:00.101183 21406 raft_consensus.cc:2804] T b9f0d59553ad444883fcf5b5909f9798 P e61c3a8f61bb48f8a963c9480e53c168 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:05:00.135144 19450 leader_election.cc:304] T a08760e15aac4630a629431f56024dc8 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e; no voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:05:00.121302 20105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36f6ba92b9ba46babe4ebd6c02e5fbd9" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:05:00.087997 21240 raft_consensus.cc:2749] T 0afb57ae58a24a01850491d69f0213dd P 0473d2b2d01f4459b1e90fd12cc7840e [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:05:00.140954 19407 raft_consensus.cc:2393] T ab43d85f64114d4ebf618930e43d9ed0 P e5256d91808b47c195bc9b4dbd7f2b87 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0473d2b2d01f4459b1e90fd12cc7840e in current term 5: Already voted for candidate e5256d91808b47c195bc9b4dbd7f2b87 in this term.
I20260709 13:05:00.095510 21395 leader_election.cc:290] T fa731b585f684a7fb2d106c50f143b83 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:05:00.126216 19553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4af19371ea874c09a0a2147040835cbb" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:05:00.148504 19450 leader_election.cc:304] T 48824d5acfbc485ebf8c2d944e7202de P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e; no voters: 127766fc592545a4997f7790f50f6076, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:05:00.123462 20853 raft_consensus.cc:2749] T 179fd671030940b4b4a4e24bcc4aba0a P e61c3a8f61bb48f8a963c9480e53c168 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:05:00.126715 21357 raft_consensus.cc:493] T 5ec1c4ce15e04c7e8c283a62179f2a64 P 127766fc592545a4997f7790f50f6076 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e5256d91808b47c195bc9b4dbd7f2b87)
I20260709 13:05:00.151726 19450 leader_election.cc:304] T b08304a0a02b42d7840c4e8ee9a6bd1a P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168; no voters: e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:05:00.134428 21237 raft_consensus.cc:493] T 14efcc79969f41babe5529c22d59156d P 127766fc592545a4997f7790f50f6076 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader e5256d91808b47c195bc9b4dbd7f2b87)
I20260709 13:05:00.140165 21338 raft_consensus.cc:493] T 46c5bfeecc314717bffe987e6844b6d0 P 0473d2b2d01f4459b1e90fd12cc7840e [term 5 FOLLOWER]: Starting leader election (detected failure of leader e61c3a8f61bb48f8a963c9480e53c168)
I20260709 13:05:00.163110 19450 leader_election.cc:304] T 6c5eebf646ad445a9d1b1adc319d7b16 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e; no voters: 127766fc592545a4997f7790f50f6076, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:05:00.137140 21111 raft_consensus.cc:2804] T ab43d85f64114d4ebf618930e43d9ed0 P e61c3a8f61bb48f8a963c9480e53c168 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:05:00.142539 21406 raft_consensus.cc:493] T b9f0d59553ad444883fcf5b5909f9798 P e61c3a8f61bb48f8a963c9480e53c168 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:00.165102 19450 leader_election.cc:304] T 0cdf56e38bbc453d9438d359e5a69955 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e; no voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:05:00.142488 21352 raft_consensus.cc:493] T 833a2f0775ed407a94b8924ce50adb63 P 127766fc592545a4997f7790f50f6076 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader e5256d91808b47c195bc9b4dbd7f2b87)
I20260709 13:05:00.145325 21140 raft_consensus.cc:3060] T 21e14947d70440f19044d8f75c31e1f9 P 0473d2b2d01f4459b1e90fd12cc7840e [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:05:00.169492 21240 raft_consensus.cc:2749] T 6c5eebf646ad445a9d1b1adc319d7b16 P 0473d2b2d01f4459b1e90fd12cc7840e [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:05:00.166576 21338 raft_consensus.cc:3060] T 46c5bfeecc314717bffe987e6844b6d0 P 0473d2b2d01f4459b1e90fd12cc7840e [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:05:00.170151 20867 leader_election.cc:290] T ab43d85f64114d4ebf618930e43d9ed0 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 5 election: Requested vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:05:00.173689 21322 raft_consensus.cc:515] T f1b10566f45d4a7d9029858330e02d5b P e61c3a8f61bb48f8a963c9480e53c168 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:00.166373 21365 raft_consensus.cc:2804] T b08304a0a02b42d7840c4e8ee9a6bd1a P 0473d2b2d01f4459b1e90fd12cc7840e [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:05:00.175223 21365 raft_consensus.cc:493] T b08304a0a02b42d7840c4e8ee9a6bd1a P 0473d2b2d01f4459b1e90fd12cc7840e [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:00.175666 21365 raft_consensus.cc:3060] T b08304a0a02b42d7840c4e8ee9a6bd1a P 0473d2b2d01f4459b1e90fd12cc7840e [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:05:00.175848 21105 raft_consensus.cc:2749] T 0cdf56e38bbc453d9438d359e5a69955 P 0473d2b2d01f4459b1e90fd12cc7840e [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:05:00.177094 21352 raft_consensus.cc:515] T 833a2f0775ed407a94b8924ce50adb63 P 127766fc592545a4997f7790f50f6076 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:05:00.149641 21362 raft_consensus.cc:2749] T a08760e15aac4630a629431f56024dc8 P 0473d2b2d01f4459b1e90fd12cc7840e [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:05:00.122757 21344 raft_consensus.cc:515] T bc225c93219c45538b53a1bd3d387e4d P e61c3a8f61bb48f8a963c9480e53c168 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:00.150913 21372 raft_consensus.cc:2749] T 48824d5acfbc485ebf8c2d944e7202de P 0473d2b2d01f4459b1e90fd12cc7840e [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:05:00.149984 21412 raft_consensus.cc:2749] T 85c494af21f9457a85da47b9bc70c1fd P e61c3a8f61bb48f8a963c9480e53c168 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:05:00.213009 19559 raft_consensus.cc:1240] T f1b10566f45d4a7d9029858330e02d5b P e61c3a8f61bb48f8a963c9480e53c168 [term 5 FOLLOWER]: Rejecting Update request from peer 0473d2b2d01f4459b1e90fd12cc7840e for earlier term 4. Current term is 5. Ops: []
I20260709 13:05:00.213542 19405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "833a2f0775ed407a94b8924ce50adb63" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:05:00.211512 19483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b74109013a140ada21feeef92d6f563" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:05:00.184525 21406 raft_consensus.cc:3060] T b9f0d59553ad444883fcf5b5909f9798 P e61c3a8f61bb48f8a963c9480e53c168 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:05:00.232515 19375 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.3:36891, user_credentials={real_user=slave}} blocked reactor thread for 153946us
W20260709 13:05:00.220134 21408 log.cc:927] Time spent T 21e14947d70440f19044d8f75c31e1f9 P e61c3a8f61bb48f8a963c9480e53c168: Append to log took a long time: real 0.059s	user 0.000s	sys 0.000s
I20260709 13:05:00.222252 19482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86a6797bdfe94fa496c050ceae4bd0d9" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:05:00.183746 21343 raft_consensus.cc:493] T 217b5fae677b4971b3bbd2f357a1f7ff P e61c3a8f61bb48f8a963c9480e53c168 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:05:00.219166 21410 log.cc:927] Time spent T 76cb037fc9064d13b59a8969d897ce8c P e5256d91808b47c195bc9b4dbd7f2b87: Append to log took a long time: real 0.054s	user 0.000s	sys 0.000s
W20260709 13:05:00.236402 19377 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.2:46257, user_credentials={real_user=slave}} blocked reactor thread for 142177us
I20260709 13:05:00.206524 21111 raft_consensus.cc:697] T ab43d85f64114d4ebf618930e43d9ed0 P e61c3a8f61bb48f8a963c9480e53c168 [term 5 LEADER]: Becoming Leader. State: Replica: e61c3a8f61bb48f8a963c9480e53c168, State: Running, Role: LEADER
I20260709 13:05:00.164601 21357 raft_consensus.cc:515] T 5ec1c4ce15e04c7e8c283a62179f2a64 P 127766fc592545a4997f7790f50f6076 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:05:00.248950 19406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc225c93219c45538b53a1bd3d387e4d" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
I20260709 13:05:00.250185 20853 raft_consensus.cc:493] T 1a61655d99124a29b486ba4a5b37faea P e61c3a8f61bb48f8a963c9480e53c168 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0473d2b2d01f4459b1e90fd12cc7840e)
I20260709 13:05:00.250835 20853 raft_consensus.cc:515] T 1a61655d99124a29b486ba4a5b37faea P e61c3a8f61bb48f8a963c9480e53c168 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:00.168471 21237 raft_consensus.cc:515] T 14efcc79969f41babe5529c22d59156d P 127766fc592545a4997f7790f50f6076 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:05:00.232419 21337 leader_election.cc:290] T f93ee515a9c14139bf566522ed8232f3 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 6 election: Requested vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:05:00.253433 19375 leader_election.cc:304] T bc225c93219c45538b53a1bd3d387e4d P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:05:00.261272 21370 leader_election.cc:290] T 179fd671030940b4b4a4e24bcc4aba0a P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:05:00.263542 19406 raft_consensus.cc:2468] T bc225c93219c45538b53a1bd3d387e4d P e5256d91808b47c195bc9b4dbd7f2b87 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 5.
I20260709 13:05:00.263965 21357 leader_election.cc:290] T 5ec1c4ce15e04c7e8c283a62179f2a64 P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:05:00.264061 21388 raft_consensus.cc:2804] T bc225c93219c45538b53a1bd3d387e4d P e5256d91808b47c195bc9b4dbd7f2b87 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:05:00.264891 21111 consensus_queue.cc:237] T ab43d85f64114d4ebf618930e43d9ed0 P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } attrs { replace: true } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: NON_VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: true } }
I20260709 13:05:00.270886 19482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ec1c4ce15e04c7e8c283a62179f2a64" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:05:00.271211 19449 leader_election.cc:304] T bc225c93219c45538b53a1bd3d387e4d P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87; no voters: 
I20260709 13:05:00.271505 19406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ec1c4ce15e04c7e8c283a62179f2a64" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:05:00.249902 19377 leader_election.cc:304] T 46c5bfeecc314717bffe987e6844b6d0 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87; no voters: 
I20260709 13:05:00.275954 20075 leader_election.cc:304] T 5ec1c4ce15e04c7e8c283a62179f2a64 P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 127766fc592545a4997f7790f50f6076; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:05:00.255641 21115 raft_consensus.cc:3055] T 0afb57ae58a24a01850491d69f0213dd P e61c3a8f61bb48f8a963c9480e53c168 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:05:00.272414 21352 leader_election.cc:290] T 833a2f0775ed407a94b8924ce50adb63 P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:05:00.277655 21336 raft_consensus.cc:515] T 3e1f505cb0f1427bbd698ac889d80821 P e61c3a8f61bb48f8a963c9480e53c168 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:00.283586 21338 raft_consensus.cc:515] T 46c5bfeecc314717bffe987e6844b6d0 P 0473d2b2d01f4459b1e90fd12cc7840e [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:00.284241 21237 leader_election.cc:290] T 14efcc79969f41babe5529c22d59156d P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:05:00.268829 21201 leader_election.cc:290] T bc225c93219c45538b53a1bd3d387e4d P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 5 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:05:00.242223 21343 raft_consensus.cc:515] T 217b5fae677b4971b3bbd2f357a1f7ff P e61c3a8f61bb48f8a963c9480e53c168 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:00.293411 21337 raft_consensus.cc:2804] T 46c5bfeecc314717bffe987e6844b6d0 P e5256d91808b47c195bc9b4dbd7f2b87 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:05:00.281392 21105 raft_consensus.cc:2804] T bc225c93219c45538b53a1bd3d387e4d P 0473d2b2d01f4459b1e90fd12cc7840e [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:05:00.295433 19477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14efcc79969f41babe5529c22d59156d" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:05:00.288220 21402 raft_consensus.cc:515] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P 127766fc592545a4997f7790f50f6076 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:05:00.276787 21115 raft_consensus.cc:740] T 0afb57ae58a24a01850491d69f0213dd P e61c3a8f61bb48f8a963c9480e53c168 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: e61c3a8f61bb48f8a963c9480e53c168, State: Running, Role: LEADER
I20260709 13:05:00.281906 21230 raft_consensus.cc:2749] T 5ec1c4ce15e04c7e8c283a62179f2a64 P 127766fc592545a4997f7790f50f6076 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:05:00.390741 19523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.4:43121, user_credentials={real_user=slave}} blocked reactor thread for 76797.6us
I20260709 13:05:00.315192 19405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14efcc79969f41babe5529c22d59156d" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:05:00.292495 21338 leader_election.cc:290] T 46c5bfeecc314717bffe987e6844b6d0 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 6 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:05:00.272598 21347 raft_consensus.cc:515] T 46c5bfeecc314717bffe987e6844b6d0 P e61c3a8f61bb48f8a963c9480e53c168 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:00.312881 21337 raft_consensus.cc:493] T 46c5bfeecc314717bffe987e6844b6d0 P e5256d91808b47c195bc9b4dbd7f2b87 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:00.396368 21127 raft_consensus.cc:493] T 1f85fc4b527a48848e5faa083b604e36 P 0473d2b2d01f4459b1e90fd12cc7840e [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e5256d91808b47c195bc9b4dbd7f2b87)
I20260709 13:05:00.388388 21328 raft_consensus.cc:493] T 40e1e16737a842ee936002830f36882e P 0473d2b2d01f4459b1e90fd12cc7840e [term 4 FOLLOWER]: Starting pre-election (detected failure of leader e5256d91808b47c195bc9b4dbd7f2b87)
I20260709 13:05:00.395715 21379 raft_consensus.cc:493] T 5ec1c4ce15e04c7e8c283a62179f2a64 P 0473d2b2d01f4459b1e90fd12cc7840e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e5256d91808b47c195bc9b4dbd7f2b87)
I20260709 13:05:00.399355 21105 raft_consensus.cc:697] T bc225c93219c45538b53a1bd3d387e4d P 0473d2b2d01f4459b1e90fd12cc7840e [term 5 LEADER]: Becoming Leader. State: Replica: 0473d2b2d01f4459b1e90fd12cc7840e, State: Running, Role: LEADER
I20260709 13:05:00.404692 20853 leader_election.cc:290] T 1a61655d99124a29b486ba4a5b37faea P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:05:00.412650 21337 raft_consensus.cc:3060] T 46c5bfeecc314717bffe987e6844b6d0 P e5256d91808b47c195bc9b4dbd7f2b87 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:05:00.555747 20105 raft_consensus.cc:2393] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P 127766fc592545a4997f7790f50f6076 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0473d2b2d01f4459b1e90fd12cc7840e in current term 6: Already voted for candidate 127766fc592545a4997f7790f50f6076 in this term.
W20260709 13:05:00.653102 19377 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.17.223.2:46257 timed out after 1.609s (SENT) [suppressed 13 similar messages]
I20260709 13:05:00.666361 19558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab43d85f64114d4ebf618930e43d9ed0" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:05:00.667366 19558 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40428 (request call id 1630) took 1185 ms. Trace:
I20260709 13:05:00.429185 21328 raft_consensus.cc:515] T 40e1e16737a842ee936002830f36882e P 0473d2b2d01f4459b1e90fd12cc7840e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:00.424075 21127 raft_consensus.cc:515] T 1f85fc4b527a48848e5faa083b604e36 P 0473d2b2d01f4459b1e90fd12cc7840e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:05:00.667742 19558 rpcz_store.cc:276] 0709 13:04:59.481666 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:59.482856 (+  1190us) service_pool.cc:224] Handling call
0709 13:05:00.666209 (+1183353us) spinlock_profiling.cc:243] Waited 4.15 ms on lock 0x7b5800003998. stack: 00007f4a79de9343 00007f4a79de9240 00007f4a797781d4 00007f4a834b6304 00007f4a834b6299 00007f4a79ca3db1 00007f4a79de3b71 00007f4a79de3a22 00007f4a82cfcc09 00007f4a81e56ee0 00007f4a81f200ab 00007f4a81f20131 00007f4a81ece0a0 00007f4a81ecd984 00007f4a7b4486d4 00007f4a7b448662
0709 13:05:00.667304 (+  1095us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":9541888}
I20260709 13:05:00.478197 21365 raft_consensus.cc:515] T b08304a0a02b42d7840c4e8ee9a6bd1a P 0473d2b2d01f4459b1e90fd12cc7840e [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:00.476449 21379 raft_consensus.cc:515] T 5ec1c4ce15e04c7e8c283a62179f2a64 P 0473d2b2d01f4459b1e90fd12cc7840e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:05:00.846625 21347 leader_election.cc:290] T 46c5bfeecc314717bffe987e6844b6d0 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 7 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
W20260709 13:05:00.847524 21433 log.cc:927] Time spent T 179fd671030940b4b4a4e24bcc4aba0a P 0473d2b2d01f4459b1e90fd12cc7840e: Append to log took a long time: real 0.197s	user 0.000s	sys 0.000s
W20260709 13:05:00.848601 21427 log.cc:927] Time spent T 0afb57ae58a24a01850491d69f0213dd P e61c3a8f61bb48f8a963c9480e53c168: Append to log took a long time: real 0.293s	user 0.000s	sys 0.000s
W20260709 13:05:00.849684 21426 log.cc:927] Time spent T 76cb037fc9064d13b59a8969d897ce8c P e61c3a8f61bb48f8a963c9480e53c168: Append to log took a long time: real 0.219s	user 0.000s	sys 0.000s
I20260709 13:05:00.855650 21402 leader_election.cc:290] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 6 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
W20260709 13:05:00.857359 21435 log.cc:927] Time spent T ab43d85f64114d4ebf618930e43d9ed0 P e61c3a8f61bb48f8a963c9480e53c168: Append to log took a long time: real 0.093s	user 0.001s	sys 0.000s
I20260709 13:05:00.631328 21115 consensus_queue.cc:260] T 0afb57ae58a24a01850491d69f0213dd P e61c3a8f61bb48f8a963c9480e53c168 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:05:00.864789 21344 leader_election.cc:290] T bc225c93219c45538b53a1bd3d387e4d P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 6 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:05:00.865097 19555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa731b585f684a7fb2d106c50f143b83" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:05:00.758376 21105 consensus_queue.cc:237] T bc225c93219c45538b53a1bd3d387e4d P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 4.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:00.866596 21322 leader_election.cc:290] T f1b10566f45d4a7d9029858330e02d5b P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 5 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:05:00.868824 19304 catalog_manager.cc:5697] T ff9b0eddd810459b82d91c60777c10eb P 127766fc592545a4997f7790f50f6076 reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "127766fc592545a4997f7790f50f6076" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:05:00.870342 19304 catalog_manager.cc:5697] T 309c3ca0ca4b4f3ba129752ea2cb293b P 127766fc592545a4997f7790f50f6076 reported cstate change: term changed from 3 to 5, leader changed from e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3) to e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1). New cstate: current_term: 5 leader_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } attrs { replace: true } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } } }
I20260709 13:05:00.761390 21088 raft_consensus.cc:493] T df751f992649444090e27965eb1af85d P 0473d2b2d01f4459b1e90fd12cc7840e [term 4 FOLLOWER]: Starting pre-election (detected failure of leader e5256d91808b47c195bc9b4dbd7f2b87)
I20260709 13:05:00.871837 19304 catalog_manager.cc:5697] T 775c229504194560ba9589bc2199b089 P 127766fc592545a4997f7790f50f6076 reported cstate change: term changed from 1 to 3, leader changed from e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1) to 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2). New cstate: current_term: 3 leader_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } } }
I20260709 13:05:00.873028 19558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc225c93219c45538b53a1bd3d387e4d" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:05:00.876222 19558 raft_consensus.cc:2368] T bc225c93219c45538b53a1bd3d387e4d P e61c3a8f61bb48f8a963c9480e53c168 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 0473d2b2d01f4459b1e90fd12cc7840e for earlier term 5. Current term is 6.
I20260709 13:05:00.876737 19559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46c5bfeecc314717bffe987e6844b6d0" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 6 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:05:00.877737 19559 raft_consensus.cc:2368] T 46c5bfeecc314717bffe987e6844b6d0 P e61c3a8f61bb48f8a963c9480e53c168 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 0473d2b2d01f4459b1e90fd12cc7840e for earlier term 6. Current term is 7.
I20260709 13:05:00.844390 21412 raft_consensus.cc:493] T ef32ce6fdd0e40d382c79974f30295c6 P e61c3a8f61bb48f8a963c9480e53c168 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader e5256d91808b47c195bc9b4dbd7f2b87)
I20260709 13:05:00.880035 21306 raft_consensus.cc:493] T d1e5873a19244c5ebbcd38e126796ee7 P 0473d2b2d01f4459b1e90fd12cc7840e [term 4 FOLLOWER]: Starting pre-election (detected failure of leader e61c3a8f61bb48f8a963c9480e53c168)
I20260709 13:05:00.917044 21365 leader_election.cc:290] T b08304a0a02b42d7840c4e8ee9a6bd1a P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 5 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
W20260709 13:05:00.918176 21438 log.cc:927] Time spent T 217b5fae677b4971b3bbd2f357a1f7ff P 0473d2b2d01f4459b1e90fd12cc7840e: Append to log took a long time: real 0.073s	user 0.000s	sys 0.000s
I20260709 13:05:00.888541 21347 raft_consensus.cc:493] T 40e1e16737a842ee936002830f36882e P e61c3a8f61bb48f8a963c9480e53c168 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader e5256d91808b47c195bc9b4dbd7f2b87)
I20260709 13:05:00.933331 21347 raft_consensus.cc:515] T 40e1e16737a842ee936002830f36882e P e61c3a8f61bb48f8a963c9480e53c168 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:00.895519 21343 leader_election.cc:290] T 217b5fae677b4971b3bbd2f357a1f7ff P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:05:00.896119 21412 raft_consensus.cc:515] T ef32ce6fdd0e40d382c79974f30295c6 P e61c3a8f61bb48f8a963c9480e53c168 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:00.936209 21328 leader_election.cc:290] T 40e1e16737a842ee936002830f36882e P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:05:00.936873 21412 leader_election.cc:290] T ef32ce6fdd0e40d382c79974f30295c6 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:05:00.936965 21328 consensus_queue.cc:1059] T f1b10566f45d4a7d9029858330e02d5b P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:05:00.940047 21347 leader_election.cc:290] T 40e1e16737a842ee936002830f36882e P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:05:00.890326 21344 raft_consensus.cc:493] T 28af091831594f9d8e96482078cc7625 P e61c3a8f61bb48f8a963c9480e53c168 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:00.885776 21088 raft_consensus.cc:515] T df751f992649444090e27965eb1af85d P 0473d2b2d01f4459b1e90fd12cc7840e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:00.941529 21344 raft_consensus.cc:515] T 28af091831594f9d8e96482078cc7625 P e61c3a8f61bb48f8a963c9480e53c168 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:00.943996 21127 leader_election.cc:290] T 1f85fc4b527a48848e5faa083b604e36 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:05:00.944590 21127 raft_consensus.cc:3055] T f1b10566f45d4a7d9029858330e02d5b P 0473d2b2d01f4459b1e90fd12cc7840e [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:05:00.944948 21127 raft_consensus.cc:740] T f1b10566f45d4a7d9029858330e02d5b P 0473d2b2d01f4459b1e90fd12cc7840e [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 0473d2b2d01f4459b1e90fd12cc7840e, State: Running, Role: LEADER
I20260709 13:05:00.945791 21088 leader_election.cc:290] T df751f992649444090e27965eb1af85d P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:05:00.945750 21127 consensus_queue.cc:260] T f1b10566f45d4a7d9029858330e02d5b P 0473d2b2d01f4459b1e90fd12cc7840e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:00.947921 21127 raft_consensus.cc:3060] T f1b10566f45d4a7d9029858330e02d5b P 0473d2b2d01f4459b1e90fd12cc7840e [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:05:00.893030 21440 raft_consensus.cc:493] T 833a2f0775ed407a94b8924ce50adb63 P e61c3a8f61bb48f8a963c9480e53c168 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader e5256d91808b47c195bc9b4dbd7f2b87)
I20260709 13:05:00.951864 21440 raft_consensus.cc:515] T 833a2f0775ed407a94b8924ce50adb63 P e61c3a8f61bb48f8a963c9480e53c168 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
W20260709 13:05:00.953433 21140 consensus_meta.cc:287] T 21e14947d70440f19044d8f75c31e1f9 P 0473d2b2d01f4459b1e90fd12cc7840e: Time spent flushing consensus metadata: real 0.751s	user 0.008s	sys 0.000s
I20260709 13:05:00.954178 21440 leader_election.cc:290] T 833a2f0775ed407a94b8924ce50adb63 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
W20260709 13:05:00.955514 21406 consensus_meta.cc:287] T b9f0d59553ad444883fcf5b5909f9798 P e61c3a8f61bb48f8a963c9480e53c168: Time spent flushing consensus metadata: real 0.715s	user 0.008s	sys 0.000s
I20260709 13:05:00.956053 21406 raft_consensus.cc:515] T b9f0d59553ad444883fcf5b5909f9798 P e61c3a8f61bb48f8a963c9480e53c168 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:00.957124 19554 raft_consensus.cc:1240] T b9f0d59553ad444883fcf5b5909f9798 P e61c3a8f61bb48f8a963c9480e53c168 [term 4 FOLLOWER]: Rejecting Update request from peer 0473d2b2d01f4459b1e90fd12cc7840e for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260709 13:05:00.958398 20107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa731b585f684a7fb2d106c50f143b83" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:05:00.958911 21406 leader_election.cc:290] T b9f0d59553ad444883fcf5b5909f9798 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 4 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:05:00.946869 21344 leader_election.cc:290] T 28af091831594f9d8e96482078cc7625 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
W20260709 13:05:00.966697 19449 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.564s	user 0.000s	sys 0.011s
W20260709 13:05:00.973237 19449 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.571s	user 0.000s	sys 0.012s
W20260709 13:05:00.973717 19449 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.1:40321, user_credentials={real_user=slave}} blocked reactor thread for 571634us
W20260709 13:05:00.974606 19377 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.2:46257, user_credentials={real_user=slave}} blocked reactor thread for 321519us
I20260709 13:05:00.982338 19477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a61655d99124a29b486ba4a5b37faea" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:05:00.997020 19485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36f6ba92b9ba46babe4ebd6c02e5fbd9" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:05:00.997921 19485 raft_consensus.cc:2468] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P 0473d2b2d01f4459b1e90fd12cc7840e [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 127766fc592545a4997f7790f50f6076 in term 5.
W20260709 13:05:00.998526 19485 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39478 (request call id 165) took 1365 ms (client timeout 1757 ms). Trace:
W20260709 13:05:00.998974 19485 rpcz_store.cc:269] 0709 13:04:59.633155 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:59.633280 (+   125us) service_pool.cc:224] Handling call
0709 13:05:00.996849 (+1363569us) spinlock_profiling.cc:243] Waited 5.7 ms on lock 0x7b58001b9998. stack: 00007f4a79de9343 00007f4a79de9240 00007f4a797781d4 00007f4a834b6304 00007f4a834b6299 00007f4a79ca3db1 00007f4a79de3b71 00007f4a79de3a22 00007f4a82cfcc09 00007f4a81e56ee0 00007f4a81f200ab 00007f4a81f20131 00007f4a81ece0a0 00007f4a81ecd984 00007f4a7b4486d4 00007f4a7b448662
0709 13:05:00.998443 (+  1594us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":13120896}
I20260709 13:05:01.008062 19483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc225c93219c45538b53a1bd3d387e4d" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:05:01.009213 19486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef32ce6fdd0e40d382c79974f30295c6" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:05:01.009668 19483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40e1e16737a842ee936002830f36882e" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:05:01.010470 19485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46c5bfeecc314717bffe987e6844b6d0" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 7 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:05:01.011171 19485 raft_consensus.cc:3060] T 46c5bfeecc314717bffe987e6844b6d0 P 0473d2b2d01f4459b1e90fd12cc7840e [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:05:01.011454 19481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "217b5fae677b4971b3bbd2f357a1f7ff" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:05:00.951881 21379 leader_election.cc:290] T 5ec1c4ce15e04c7e8c283a62179f2a64 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:05:01.012887 19481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28af091831594f9d8e96482078cc7625" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:05:01.010515 19483 raft_consensus.cc:2468] T 40e1e16737a842ee936002830f36882e P 0473d2b2d01f4459b1e90fd12cc7840e [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 4.
I20260709 13:05:01.009864 19486 raft_consensus.cc:2468] T ef32ce6fdd0e40d382c79974f30295c6 P 0473d2b2d01f4459b1e90fd12cc7840e [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 4.
I20260709 13:05:01.014842 19483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9f0d59553ad444883fcf5b5909f9798" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:05:01.014070 19481 raft_consensus.cc:2468] T 28af091831594f9d8e96482078cc7625 P 0473d2b2d01f4459b1e90fd12cc7840e [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 5.
I20260709 13:05:00.959803 21306 raft_consensus.cc:515] T d1e5873a19244c5ebbcd38e126796ee7 P 0473d2b2d01f4459b1e90fd12cc7840e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:01.012761 21358 raft_consensus.cc:493] T d1e5873a19244c5ebbcd38e126796ee7 P e5256d91808b47c195bc9b4dbd7f2b87 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader e61c3a8f61bb48f8a963c9480e53c168)
W20260709 13:05:01.025950 20078 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.2:46257, user_credentials={real_user=slave}} blocked reactor thread for 152679us
I20260709 13:05:01.023136 21337 raft_consensus.cc:515] T 46c5bfeecc314717bffe987e6844b6d0 P e5256d91808b47c195bc9b4dbd7f2b87 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
W20260709 13:05:01.071329 19450 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.3:36891, user_credentials={real_user=slave}} blocked reactor thread for 202096us
W20260709 13:05:01.053170 19375 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.3:36891, user_credentials={real_user=slave}} blocked reactor thread for 793042us
I20260709 13:05:01.067440 21306 leader_election.cc:290] T d1e5873a19244c5ebbcd38e126796ee7 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:05:01.057121 21373 leader_election.cc:290] T ef32ce6fdd0e40d382c79974f30295c6 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:05:01.040653 21442 raft_consensus.cc:493] T 2725d2c4cb054f18b0fc8f735c15f6c2 P e61c3a8f61bb48f8a963c9480e53c168 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader e5256d91808b47c195bc9b4dbd7f2b87)
I20260709 13:05:01.027446 21358 raft_consensus.cc:515] T d1e5873a19244c5ebbcd38e126796ee7 P e5256d91808b47c195bc9b4dbd7f2b87 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:01.023527 21346 raft_consensus.cc:493] T 1a61655d99124a29b486ba4a5b37faea P e5256d91808b47c195bc9b4dbd7f2b87 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0473d2b2d01f4459b1e90fd12cc7840e)
I20260709 13:05:01.027736 19485 raft_consensus.cc:2468] T 46c5bfeecc314717bffe987e6844b6d0 P 0473d2b2d01f4459b1e90fd12cc7840e [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 7.
W20260709 13:05:01.056893 19523 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.652s	user 0.000s	sys 0.026s
I20260709 13:05:01.044413 19486 raft_consensus.cc:1275] T ab43d85f64114d4ebf618930e43d9ed0 P 0473d2b2d01f4459b1e90fd12cc7840e [term 5 FOLLOWER]: Refusing update from remote peer e61c3a8f61bb48f8a963c9480e53c168: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
W20260709 13:05:01.087630 19523 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.683s	user 0.000s	sys 0.028s
I20260709 13:05:01.081043 21372 raft_consensus.cc:493] T 2725d2c4cb054f18b0fc8f735c15f6c2 P 0473d2b2d01f4459b1e90fd12cc7840e [term 3 FOLLOWER]: Starting pre-election (detected failure of leader e5256d91808b47c195bc9b4dbd7f2b87)
I20260709 13:05:01.084836 19375 leader_election.cc:304] T 86a6797bdfe94fa496c050ceae4bd0d9 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:05:01.072595 19450 leader_election.cc:304] T ab43d85f64114d4ebf618930e43d9ed0 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e; no voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:05:01.040803 21443 raft_consensus.cc:493] T 1dc5b3532fe54f74876d02beffa2c230 P 0473d2b2d01f4459b1e90fd12cc7840e [term 3 FOLLOWER]: Starting pre-election (detected failure of leader e5256d91808b47c195bc9b4dbd7f2b87)
I20260709 13:05:01.026772 21335 raft_consensus.cc:493] T 28af091831594f9d8e96482078cc7625 P e5256d91808b47c195bc9b4dbd7f2b87 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader e61c3a8f61bb48f8a963c9480e53c168)
I20260709 13:05:01.090080 19450 leader_election.cc:400] T bc225c93219c45538b53a1bd3d387e4d P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 5 election: Vote denied by peer e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891) with higher term. Message: Invalid argument: T bc225c93219c45538b53a1bd3d387e4d P e61c3a8f61bb48f8a963c9480e53c168 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 0473d2b2d01f4459b1e90fd12cc7840e for earlier term 5. Current term is 6.
I20260709 13:05:01.092777 19450 leader_election.cc:400] T 46c5bfeecc314717bffe987e6844b6d0 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 6 election: Vote denied by peer e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891) with higher term. Message: Invalid argument: T 46c5bfeecc314717bffe987e6844b6d0 P e61c3a8f61bb48f8a963c9480e53c168 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 0473d2b2d01f4459b1e90fd12cc7840e for earlier term 6. Current term is 7.
I20260709 13:05:01.093153 19450 leader_election.cc:403] T 46c5bfeecc314717bffe987e6844b6d0 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 6 election: Cancelling election due to peer responding with higher term
I20260709 13:05:01.027962 21376 raft_consensus.cc:493] T ece3db938bc649d4a40a51522ed5259c P e5256d91808b47c195bc9b4dbd7f2b87 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 127766fc592545a4997f7790f50f6076)
I20260709 13:05:01.096719 19375 leader_election.cc:304] T 2b74109013a140ada21feeef92d6f563 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:05:01.100576 19375 leader_election.cc:304] T 4af19371ea874c09a0a2147040835cbb P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87; no voters: 127766fc592545a4997f7790f50f6076, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:05:01.100816 19405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36f6ba92b9ba46babe4ebd6c02e5fbd9" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
I20260709 13:05:01.101421 19405 raft_consensus.cc:3060] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P e5256d91808b47c195bc9b4dbd7f2b87 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:05:01.101668 19375 leader_election.cc:304] T fa731b585f684a7fb2d106c50f143b83 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87; no voters: 127766fc592545a4997f7790f50f6076, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:05:01.083499 21253 raft_consensus.cc:493] T 7f575b143b844aa096b50997dad3516a P 0473d2b2d01f4459b1e90fd12cc7840e [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e5256d91808b47c195bc9b4dbd7f2b87)
I20260709 13:05:01.087003 21306 raft_consensus.cc:493] T 14935b3ddf914369822e4a0547aaa355 P 0473d2b2d01f4459b1e90fd12cc7840e [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e5256d91808b47c195bc9b4dbd7f2b87)
I20260709 13:05:01.089672 21237 raft_consensus.cc:493] T 62c6c134d3d24a1ab144dd9ee6bc3f64 P 127766fc592545a4997f7790f50f6076 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader e61c3a8f61bb48f8a963c9480e53c168)
I20260709 13:05:01.088222 21372 raft_consensus.cc:515] T 2725d2c4cb054f18b0fc8f735c15f6c2 P 0473d2b2d01f4459b1e90fd12cc7840e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:01.098392 21451 raft_consensus.cc:493] T 14efcc79969f41babe5529c22d59156d P 0473d2b2d01f4459b1e90fd12cc7840e [term 4 FOLLOWER]: Starting pre-election (detected failure of leader e5256d91808b47c195bc9b4dbd7f2b87)
I20260709 13:05:01.103212 20867 raft_consensus.cc:2749] T 86a6797bdfe94fa496c050ceae4bd0d9 P e5256d91808b47c195bc9b4dbd7f2b87 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:05:01.130882 19485 raft_consensus.cc:1275] T 6c5eebf646ad445a9d1b1adc319d7b16 P 0473d2b2d01f4459b1e90fd12cc7840e [term 4 FOLLOWER]: Refusing update from remote peer 127766fc592545a4997f7790f50f6076: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:05:01.103813 21421 raft_consensus.cc:2749] T 4af19371ea874c09a0a2147040835cbb P e5256d91808b47c195bc9b4dbd7f2b87 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:05:01.102191 21248 raft_consensus.cc:2749] T 2b74109013a140ada21feeef92d6f563 P e5256d91808b47c195bc9b4dbd7f2b87 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:05:01.123646 19477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36f6ba92b9ba46babe4ebd6c02e5fbd9" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:05:01.119367 19552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab43d85f64114d4ebf618930e43d9ed0" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:05:01.158026 19477 raft_consensus.cc:3060] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P 0473d2b2d01f4459b1e90fd12cc7840e [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:05:01.158941 21450 raft_consensus.cc:493] T b08304a0a02b42d7840c4e8ee9a6bd1a P e5256d91808b47c195bc9b4dbd7f2b87 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 0473d2b2d01f4459b1e90fd12cc7840e)
I20260709 13:05:01.103932 21379 raft_consensus.cc:2749] T 46c5bfeecc314717bffe987e6844b6d0 P 0473d2b2d01f4459b1e90fd12cc7840e [term 7 FOLLOWER]: Leader election lost for term 6. Reason: Vote denied by peer e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891) with higher term. Message: Invalid argument: T 46c5bfeecc314717bffe987e6844b6d0 P e61c3a8f61bb48f8a963c9480e53c168 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 0473d2b2d01f4459b1e90fd12cc7840e for earlier term 6. Current term is 7.
I20260709 13:05:01.120102 21440 raft_consensus.cc:493] T 70797e5783b5454ab0d0eea663e791e3 P e61c3a8f61bb48f8a963c9480e53c168 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader e5256d91808b47c195bc9b4dbd7f2b87)
I20260709 13:05:01.088428 21445 raft_consensus.cc:493] T 0cdf56e38bbc453d9438d359e5a69955 P e61c3a8f61bb48f8a963c9480e53c168 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader e5256d91808b47c195bc9b4dbd7f2b87)
I20260709 13:05:01.125101 19478 raft_consensus.cc:1275] T 21e14947d70440f19044d8f75c31e1f9 P 0473d2b2d01f4459b1e90fd12cc7840e [term 4 FOLLOWER]: Refusing update from remote peer e61c3a8f61bb48f8a963c9480e53c168: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 3. (term mismatch)
I20260709 13:05:01.124086 21419 raft_consensus.cc:2749] T fa731b585f684a7fb2d106c50f143b83 P e5256d91808b47c195bc9b4dbd7f2b87 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:05:01.099279 21436 raft_consensus.cc:493] T 14935b3ddf914369822e4a0547aaa355 P e61c3a8f61bb48f8a963c9480e53c168 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e5256d91808b47c195bc9b4dbd7f2b87)
I20260709 13:05:01.166323 19402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab43d85f64114d4ebf618930e43d9ed0" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
I20260709 13:05:01.099615 21443 raft_consensus.cc:515] T 1dc5b3532fe54f74876d02beffa2c230 P 0473d2b2d01f4459b1e90fd12cc7840e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:01.106997 21376 raft_consensus.cc:515] T ece3db938bc649d4a40a51522ed5259c P e5256d91808b47c195bc9b4dbd7f2b87 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:05:01.119957 19557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f93ee515a9c14139bf566522ed8232f3" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:05:01.103343 21335 raft_consensus.cc:515] T 28af091831594f9d8e96482078cc7625 P e5256d91808b47c195bc9b4dbd7f2b87 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:01.111053 19559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "179fd671030940b4b4a4e24bcc4aba0a" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
W20260709 13:05:01.132169 21416 log.cc:927] Time spent T f93ee515a9c14139bf566522ed8232f3 P 0473d2b2d01f4459b1e90fd12cc7840e: Append to log took a long time: real 0.991s	user 0.011s	sys 0.017s
I20260709 13:05:01.154434 19405 raft_consensus.cc:2468] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P e5256d91808b47c195bc9b4dbd7f2b87 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 127766fc592545a4997f7790f50f6076 in term 6.
I20260709 13:05:01.098042 21373 raft_consensus.cc:493] T 309c3ca0ca4b4f3ba129752ea2cb293b P 0473d2b2d01f4459b1e90fd12cc7840e [term 5 FOLLOWER]: Starting pre-election (detected failure of leader e5256d91808b47c195bc9b4dbd7f2b87)
I20260709 13:05:01.130470 20105 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46436 (request call id 347) took 1055 ms. Trace:
I20260709 13:05:01.098639 20107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "833a2f0775ed407a94b8924ce50adb63" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:05:01.127414 21358 leader_election.cc:290] T d1e5873a19244c5ebbcd38e126796ee7 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:05:01.147431 21237 raft_consensus.cc:515] T 62c6c134d3d24a1ab144dd9ee6bc3f64 P 127766fc592545a4997f7790f50f6076 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:05:01.092314 21105 raft_consensus.cc:2749] T ab43d85f64114d4ebf618930e43d9ed0 P 0473d2b2d01f4459b1e90fd12cc7840e [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:05:01.159482 21450 raft_consensus.cc:515] T b08304a0a02b42d7840c4e8ee9a6bd1a P e5256d91808b47c195bc9b4dbd7f2b87 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:01.164276 19478 pending_rounds.cc:85] T 21e14947d70440f19044d8f75c31e1f9 P 0473d2b2d01f4459b1e90fd12cc7840e: Aborting all ops after (but not including) 2
I20260709 13:05:01.144390 21344 raft_consensus.cc:493] T e381f1d6b8184797ad142de49be225a8 P e61c3a8f61bb48f8a963c9480e53c168 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 0473d2b2d01f4459b1e90fd12cc7840e)
I20260709 13:05:01.144618 21406 raft_consensus.cc:493] T 1dc5b3532fe54f74876d02beffa2c230 P e61c3a8f61bb48f8a963c9480e53c168 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader e5256d91808b47c195bc9b4dbd7f2b87)
I20260709 13:05:01.088349 21442 raft_consensus.cc:515] T 2725d2c4cb054f18b0fc8f735c15f6c2 P e61c3a8f61bb48f8a963c9480e53c168 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:01.167899 19408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc225c93219c45538b53a1bd3d387e4d" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
I20260709 13:05:01.169543 19409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1b10566f45d4a7d9029858330e02d5b" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
I20260709 13:05:01.170137 19411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a61655d99124a29b486ba4a5b37faea" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:05:01.123440 19486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36f6ba92b9ba46babe4ebd6c02e5fbd9" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:05:01.144829 21126 consensus_queue.cc:1059] T b9f0d59553ad444883fcf5b5909f9798 P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.020s
I20260709 13:05:01.143080 21253 raft_consensus.cc:515] T 7f575b143b844aa096b50997dad3516a P 0473d2b2d01f4459b1e90fd12cc7840e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:01.090750 21346 raft_consensus.cc:515] T 1a61655d99124a29b486ba4a5b37faea P e5256d91808b47c195bc9b4dbd7f2b87 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:01.166455 21436 raft_consensus.cc:515] T 14935b3ddf914369822e4a0547aaa355 P e61c3a8f61bb48f8a963c9480e53c168 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } attrs { replace: true } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: NON_VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: true } }
I20260709 13:05:01.147758 21306 raft_consensus.cc:515] T 14935b3ddf914369822e4a0547aaa355 P 0473d2b2d01f4459b1e90fd12cc7840e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } attrs { replace: true } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: NON_VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: true } }
I20260709 13:05:01.167228 19402 raft_consensus.cc:2393] T ab43d85f64114d4ebf618930e43d9ed0 P e5256d91808b47c195bc9b4dbd7f2b87 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate e61c3a8f61bb48f8a963c9480e53c168 in current term 5: Already voted for candidate e5256d91808b47c195bc9b4dbd7f2b87 in this term.
I20260709 13:05:01.286921 19478 pending_rounds.cc:107] T 21e14947d70440f19044d8f75c31e1f9 P 0473d2b2d01f4459b1e90fd12cc7840e: Aborting uncommitted NO_OP operation due to leader change: 3.3
W20260709 13:05:01.240661 19374 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.4:43121, user_credentials={real_user=slave}} blocked reactor thread for 68327.8us
I20260709 13:05:01.155145 21451 raft_consensus.cc:515] T 14efcc79969f41babe5529c22d59156d P 0473d2b2d01f4459b1e90fd12cc7840e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:05:01.288391 19408 raft_consensus.cc:3060] T bc225c93219c45538b53a1bd3d387e4d P e5256d91808b47c195bc9b4dbd7f2b87 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:05:01.289535 19405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28af091831594f9d8e96482078cc7625" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:05:01.173123 20108 raft_consensus.cc:3060] T ab43d85f64114d4ebf618930e43d9ed0 P 127766fc592545a4997f7790f50f6076 [term 3 LEARNER]: Advancing to term 5
I20260709 13:05:01.296826 19526 leader_election.cc:304] T 40e1e16737a842ee936002830f36882e P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
W20260709 13:05:01.343521 19526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.2:46257, user_credentials={real_user=slave}} blocked reactor thread for 46772.3us
I20260709 13:05:01.344238 19526 leader_election.cc:304] T ef32ce6fdd0e40d382c79974f30295c6 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:05:01.345240 19526 leader_election.cc:304] T 28af091831594f9d8e96482078cc7625 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:05:01.287844 19409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46c5bfeecc314717bffe987e6844b6d0" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 7 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
I20260709 13:05:01.332614 20075 leader_election.cc:304] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 127766fc592545a4997f7790f50f6076, e5256d91808b47c195bc9b4dbd7f2b87; no voters: 
I20260709 13:05:01.300886 19478 raft_consensus.cc:2889] T 21e14947d70440f19044d8f75c31e1f9 P 0473d2b2d01f4459b1e90fd12cc7840e [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:05:01.185259 19403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e1f505cb0f1427bbd698ac889d80821" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
I20260709 13:05:01.174700 19557 raft_consensus.cc:3060] T f93ee515a9c14139bf566522ed8232f3 P e61c3a8f61bb48f8a963c9480e53c168 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:05:01.340319 19559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e5873a19244c5ebbcd38e126796ee7" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:05:01.250573 21448 raft_consensus.cc:493] T 1efebf73c86e432baa55533136b6e12c P e61c3a8f61bb48f8a963c9480e53c168 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 127766fc592545a4997f7790f50f6076)
I20260709 13:05:01.336910 19405 raft_consensus.cc:2468] T 28af091831594f9d8e96482078cc7625 P e5256d91808b47c195bc9b4dbd7f2b87 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 4.
I20260709 13:05:01.359092 19405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df751f992649444090e27965eb1af85d" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:05:01.359375 20112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ec1c4ce15e04c7e8c283a62179f2a64" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:05:01.238874 21379 raft_consensus.cc:493] T 4509b76741dc428e9201c70c1658da13 P 0473d2b2d01f4459b1e90fd12cc7840e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e5256d91808b47c195bc9b4dbd7f2b87)
I20260709 13:05:01.348104 20109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f85fc4b527a48848e5faa083b604e36" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:05:01.348688 19411 raft_consensus.cc:2468] T 1a61655d99124a29b486ba4a5b37faea P e5256d91808b47c195bc9b4dbd7f2b87 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 1.
I20260709 13:05:01.355337 19409 raft_consensus.cc:2393] T 46c5bfeecc314717bffe987e6844b6d0 P e5256d91808b47c195bc9b4dbd7f2b87 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate e61c3a8f61bb48f8a963c9480e53c168 in current term 7: Already voted for candidate e5256d91808b47c195bc9b4dbd7f2b87 in this term.
I20260709 13:05:01.184679 21376 leader_election.cc:290] T ece3db938bc649d4a40a51522ed5259c P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:05:01.256628 21419 raft_consensus.cc:493] T 3e1f505cb0f1427bbd698ac889d80821 P e5256d91808b47c195bc9b4dbd7f2b87 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:01.359638 19408 raft_consensus.cc:2468] T bc225c93219c45538b53a1bd3d387e4d P e5256d91808b47c195bc9b4dbd7f2b87 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 6.
I20260709 13:05:01.254592 19404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff75a1d4cb1f493db8f71ddc136ba9ab" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:05:01.360114 19405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9f0d59553ad444883fcf5b5909f9798" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
I20260709 13:05:01.371775 19405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40e1e16737a842ee936002830f36882e" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:05:01.369818 19408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46c5bfeecc314717bffe987e6844b6d0" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 6 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
I20260709 13:05:01.354959 21347 raft_consensus.cc:2804] T 40e1e16737a842ee936002830f36882e P e61c3a8f61bb48f8a963c9480e53c168 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:05:01.265182 21400 raft_consensus.cc:493] T 4af19371ea874c09a0a2147040835cbb P e61c3a8f61bb48f8a963c9480e53c168 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 127766fc592545a4997f7790f50f6076)
I20260709 13:05:01.365391 19409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef32ce6fdd0e40d382c79974f30295c6" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:05:01.334887 19402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "833a2f0775ed407a94b8924ce50adb63" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:05:01.372973 19405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b08304a0a02b42d7840c4e8ee9a6bd1a" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
I20260709 13:05:01.377909 19405 raft_consensus.cc:3060] T b08304a0a02b42d7840c4e8ee9a6bd1a P e5256d91808b47c195bc9b4dbd7f2b87 [term 3 FOLLOWER]: Advancing to term 5
I20260709 13:05:01.374527 19408 raft_consensus.cc:2368] T 46c5bfeecc314717bffe987e6844b6d0 P e5256d91808b47c195bc9b4dbd7f2b87 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 0473d2b2d01f4459b1e90fd12cc7840e for earlier term 6. Current term is 7.
I20260709 13:05:01.346565 20104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ece3db938bc649d4a40a51522ed5259c" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:05:01.379935 19409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28af091831594f9d8e96482078cc7625" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:05:01.380474 19409 raft_consensus.cc:2468] T 28af091831594f9d8e96482078cc7625 P e5256d91808b47c195bc9b4dbd7f2b87 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 4.
I20260709 13:05:01.381153 19409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "217b5fae677b4971b3bbd2f357a1f7ff" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:05:01.381878 19409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ec1c4ce15e04c7e8c283a62179f2a64" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:05:01.363396 21231 raft_consensus.cc:2804] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P 127766fc592545a4997f7790f50f6076 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:05:01.300549 21406 raft_consensus.cc:515] T 1dc5b3532fe54f74876d02beffa2c230 P e61c3a8f61bb48f8a963c9480e53c168 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:01.359108 21343 raft_consensus.cc:2804] T 28af091831594f9d8e96482078cc7625 P e61c3a8f61bb48f8a963c9480e53c168 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:05:01.296284 21344 raft_consensus.cc:515] T e381f1d6b8184797ad142de49be225a8 P e61c3a8f61bb48f8a963c9480e53c168 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:01.368257 21380 raft_consensus.cc:493] T 21e14947d70440f19044d8f75c31e1f9 P 0473d2b2d01f4459b1e90fd12cc7840e [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:01.386158 19409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f85fc4b527a48848e5faa083b604e36" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:05:01.403352 19409 raft_consensus.cc:1275] T 21e14947d70440f19044d8f75c31e1f9 P e5256d91808b47c195bc9b4dbd7f2b87 [term 4 FOLLOWER]: Refusing update from remote peer e61c3a8f61bb48f8a963c9480e53c168: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:05:01.368264 21431 raft_consensus.cc:2804] T ef32ce6fdd0e40d382c79974f30295c6 P e61c3a8f61bb48f8a963c9480e53c168 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:05:01.412228 19409 raft_consensus.cc:1275] T ab43d85f64114d4ebf618930e43d9ed0 P e5256d91808b47c195bc9b4dbd7f2b87 [term 5 FOLLOWER]: Refusing update from remote peer e61c3a8f61bb48f8a963c9480e53c168: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:05:01.288964 20105 rpcz_store.cc:276] 0709 13:05:00.075612 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:00.079480 (+  3868us) service_pool.cc:224] Handling call
0709 13:05:01.130276 (+1050796us) spinlock_profiling.cc:243] Waited 263 ms on lock 0x7b5400245c54. stack: 00007f4a79de9343 00007f4a79de9240 00007f4a797781d4 00007f4a834b6304 00007f4a834b6299 00007f4a7ce71571 00007f4a7cf0c2fa 00007f4a81ecdb17 00007f4a7b4486d4 00007f4a7b448662 00007f4a7b448591 00007f4a7b44850c 00007f4a7b4477c2 00007f4a7b24348c 00007f4a7b2428c6 00007f4a7b24226f
0709 13:05:01.130412 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":604532992}
I20260709 13:05:01.368000 21437 raft_consensus.cc:493] T 62c6c134d3d24a1ab144dd9ee6bc3f64 P e61c3a8f61bb48f8a963c9480e53c168 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:01.165380 21440 raft_consensus.cc:515] T 70797e5783b5454ab0d0eea663e791e3 P e61c3a8f61bb48f8a963c9480e53c168 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
W20260709 13:05:01.436823 19375 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.3:36891, user_credentials={real_user=slave}} blocked reactor thread for 73195.7us
I20260709 13:05:01.439628 19478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36f6ba92b9ba46babe4ebd6c02e5fbd9" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:05:01.441315 19523 leader_election.cc:304] T bc225c93219c45538b53a1bd3d387e4d P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168; no voters: 0473d2b2d01f4459b1e90fd12cc7840e
I20260709 13:05:01.444098 19478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa8650e71aa14778b3d73721fc50d9fc" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:05:01.446746 19523 leader_election.cc:304] T b9f0d59553ad444883fcf5b5909f9798 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e61c3a8f61bb48f8a963c9480e53c168; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:05:01.447104 19449 leader_election.cc:304] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e; no voters: 127766fc592545a4997f7790f50f6076, e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:05:01.411005 19405 raft_consensus.cc:2468] T b08304a0a02b42d7840c4e8ee9a6bd1a P e5256d91808b47c195bc9b4dbd7f2b87 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 5.
I20260709 13:05:01.400883 19557 raft_consensus.cc:2468] T f93ee515a9c14139bf566522ed8232f3 P e61c3a8f61bb48f8a963c9480e53c168 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 6.
I20260709 13:05:01.296175 21373 raft_consensus.cc:515] T 309c3ca0ca4b4f3ba129752ea2cb293b P 0473d2b2d01f4459b1e90fd12cc7840e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } attrs { replace: true } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:05:01.451849 19557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46c5bfeecc314717bffe987e6844b6d0" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 7 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:05:01.370383 21379 raft_consensus.cc:515] T 4509b76741dc428e9201c70c1658da13 P 0473d2b2d01f4459b1e90fd12cc7840e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:01.408439 21343 raft_consensus.cc:493] T 28af091831594f9d8e96482078cc7625 P e61c3a8f61bb48f8a963c9480e53c168 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:01.452612 19557 raft_consensus.cc:2393] T 46c5bfeecc314717bffe987e6844b6d0 P e61c3a8f61bb48f8a963c9480e53c168 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate e5256d91808b47c195bc9b4dbd7f2b87 in current term 7: Already voted for candidate e61c3a8f61bb48f8a963c9480e53c168 in this term.
I20260709 13:05:01.456056 19375 leader_election.cc:304] T f93ee515a9c14139bf566522ed8232f3 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:05:01.457193 21343 raft_consensus.cc:3060] T 28af091831594f9d8e96482078cc7625 P e61c3a8f61bb48f8a963c9480e53c168 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:05:01.412192 21431 raft_consensus.cc:493] T ef32ce6fdd0e40d382c79974f30295c6 P e61c3a8f61bb48f8a963c9480e53c168 [term 4 FOLLOWER]: Starting leader election (detected failure of leader e5256d91808b47c195bc9b4dbd7f2b87)
I20260709 13:05:01.373292 21337 leader_election.cc:290] T 46c5bfeecc314717bffe987e6844b6d0 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 7 election: Requested vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:05:01.173746 21445 raft_consensus.cc:515] T 0cdf56e38bbc453d9438d359e5a69955 P e61c3a8f61bb48f8a963c9480e53c168 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:01.376104 19552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ece3db938bc649d4a40a51522ed5259c" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:05:01.378398 21347 raft_consensus.cc:493] T 40e1e16737a842ee936002830f36882e P e61c3a8f61bb48f8a963c9480e53c168 [term 4 FOLLOWER]: Starting leader election (detected failure of leader e5256d91808b47c195bc9b4dbd7f2b87)
W20260709 13:05:01.368628 21375 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.556s	user 0.010s	sys 0.019s
I20260709 13:05:01.369097 21448 raft_consensus.cc:515] T 1efebf73c86e432baa55533136b6e12c P e61c3a8f61bb48f8a963c9480e53c168 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:05:01.461851 19523 leader_election.cc:304] T 217b5fae677b4971b3bbd2f357a1f7ff P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e61c3a8f61bb48f8a963c9480e53c168; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87
W20260709 13:05:01.481043 19526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.2:46257, user_credentials={real_user=slave}} blocked reactor thread for 109614us
I20260709 13:05:01.482568 19526 leader_election.cc:304] T 46c5bfeecc314717bffe987e6844b6d0 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168; no voters: e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:05:01.462821 21194 leader_election.cc:290] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:05:01.430565 21231 raft_consensus.cc:697] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P 127766fc592545a4997f7790f50f6076 [term 6 LEADER]: Becoming Leader. State: Replica: 127766fc592545a4997f7790f50f6076, State: Running, Role: LEADER
I20260709 13:05:01.373040 21419 raft_consensus.cc:515] T 3e1f505cb0f1427bbd698ac889d80821 P e5256d91808b47c195bc9b4dbd7f2b87 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:01.467548 19478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f93ee515a9c14139bf566522ed8232f3" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:05:01.468858 21431 raft_consensus.cc:3060] T ef32ce6fdd0e40d382c79974f30295c6 P e61c3a8f61bb48f8a963c9480e53c168 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:05:01.474802 19486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab43d85f64114d4ebf618930e43d9ed0" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:05:01.413097 21400 raft_consensus.cc:515] T 4af19371ea874c09a0a2147040835cbb P e61c3a8f61bb48f8a963c9480e53c168 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:05:01.471242 21203 raft_consensus.cc:2804] T bc225c93219c45538b53a1bd3d387e4d P e61c3a8f61bb48f8a963c9480e53c168 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:05:01.434862 21356 raft_consensus.cc:493] T 2e36a9d6e29c4a7c860cf267efbd4c74 P e5256d91808b47c195bc9b4dbd7f2b87 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 0473d2b2d01f4459b1e90fd12cc7840e)
I20260709 13:05:01.417729 21380 raft_consensus.cc:515] T 21e14947d70440f19044d8f75c31e1f9 P 0473d2b2d01f4459b1e90fd12cc7840e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:01.490361 19486 raft_consensus.cc:2393] T ab43d85f64114d4ebf618930e43d9ed0 P 0473d2b2d01f4459b1e90fd12cc7840e [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate e5256d91808b47c195bc9b4dbd7f2b87 in current term 5: Already voted for candidate e61c3a8f61bb48f8a963c9480e53c168 in this term.
I20260709 13:05:01.488389 19485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "179fd671030940b4b4a4e24bcc4aba0a" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:05:01.493376 21469 raft_consensus.cc:2749] T 217b5fae677b4971b3bbd2f357a1f7ff P e61c3a8f61bb48f8a963c9480e53c168 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:05:01.456729 21088 raft_consensus.cc:3055] T b9f0d59553ad444883fcf5b5909f9798 P 0473d2b2d01f4459b1e90fd12cc7840e [term 3 LEADER]: Stepping down as leader of term 3
W20260709 13:05:01.480679 21375 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.670s	user 0.011s	sys 0.019s
I20260709 13:05:01.496845 21465 raft_consensus.cc:2804] T 46c5bfeecc314717bffe987e6844b6d0 P e61c3a8f61bb48f8a963c9480e53c168 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:05:01.489403 20105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36f6ba92b9ba46babe4ebd6c02e5fbd9" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:05:01.503633 21231 consensus_queue.cc:237] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P 127766fc592545a4997f7790f50f6076 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:05:01.487265 21462 raft_consensus.cc:2749] T b9f0d59553ad444883fcf5b5909f9798 P e61c3a8f61bb48f8a963c9480e53c168 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:05:01.468165 21372 leader_election.cc:290] T 2725d2c4cb054f18b0fc8f735c15f6c2 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:05:01.479909 21387 raft_consensus.cc:2804] T f93ee515a9c14139bf566522ed8232f3 P e5256d91808b47c195bc9b4dbd7f2b87 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:05:01.479161 19404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e5873a19244c5ebbcd38e126796ee7" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:05:01.481019 21347 raft_consensus.cc:3060] T 40e1e16737a842ee936002830f36882e P e61c3a8f61bb48f8a963c9480e53c168 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:05:01.487401 19402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef32ce6fdd0e40d382c79974f30295c6" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:05:01.439100 21437 raft_consensus.cc:515] T 62c6c134d3d24a1ab144dd9ee6bc3f64 P e61c3a8f61bb48f8a963c9480e53c168 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:05:01.502982 21464 raft_consensus.cc:493] T 0afb57ae58a24a01850491d69f0213dd P 127766fc592545a4997f7790f50f6076 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader e61c3a8f61bb48f8a963c9480e53c168)
I20260709 13:05:01.517202 21088 raft_consensus.cc:740] T b9f0d59553ad444883fcf5b5909f9798 P 0473d2b2d01f4459b1e90fd12cc7840e [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 0473d2b2d01f4459b1e90fd12cc7840e, State: Running, Role: LEADER
I20260709 13:05:01.534871 21088 consensus_queue.cc:260] T b9f0d59553ad444883fcf5b5909f9798 P 0473d2b2d01f4459b1e90fd12cc7840e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:01.535794 21088 raft_consensus.cc:3060] T b9f0d59553ad444883fcf5b5909f9798 P 0473d2b2d01f4459b1e90fd12cc7840e [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:05:01.536254 19481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc225c93219c45538b53a1bd3d387e4d" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:05:01.536532 19486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b08304a0a02b42d7840c4e8ee9a6bd1a" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:05:01.537220 19486 raft_consensus.cc:2368] T b08304a0a02b42d7840c4e8ee9a6bd1a P 0473d2b2d01f4459b1e90fd12cc7840e [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e5256d91808b47c195bc9b4dbd7f2b87 for earlier term 4. Current term is 5.
I20260709 13:05:01.537307 19481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46c5bfeecc314717bffe987e6844b6d0" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 7 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:05:01.538015 19481 raft_consensus.cc:2393] T 46c5bfeecc314717bffe987e6844b6d0 P 0473d2b2d01f4459b1e90fd12cc7840e [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate e5256d91808b47c195bc9b4dbd7f2b87 in current term 7: Already voted for candidate e61c3a8f61bb48f8a963c9480e53c168 in this term.
W20260709 13:05:01.538283 19526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.2:46257, user_credentials={real_user=slave}} blocked reactor thread for 56218.9us
I20260709 13:05:01.538820 19483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e5873a19244c5ebbcd38e126796ee7" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:05:01.539510 21440 leader_election.cc:290] T 70797e5783b5454ab0d0eea663e791e3 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:05:01.545208 21440 raft_consensus.cc:493] T 2e36a9d6e29c4a7c860cf267efbd4c74 P e61c3a8f61bb48f8a963c9480e53c168 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 0473d2b2d01f4459b1e90fd12cc7840e)
I20260709 13:05:01.545650 21448 leader_election.cc:290] T 1efebf73c86e432baa55533136b6e12c P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:05:01.545710 21440 raft_consensus.cc:515] T 2e36a9d6e29c4a7c860cf267efbd4c74 P e61c3a8f61bb48f8a963c9480e53c168 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:01.521672 19403 raft_consensus.cc:3060] T 3e1f505cb0f1427bbd698ac889d80821 P e5256d91808b47c195bc9b4dbd7f2b87 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:05:01.514202 21443 leader_election.cc:290] T 1dc5b3532fe54f74876d02beffa2c230 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:05:01.553856 19485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14935b3ddf914369822e4a0547aaa355" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:05:01.554543 19485 raft_consensus.cc:2468] T 14935b3ddf914369822e4a0547aaa355 P 0473d2b2d01f4459b1e90fd12cc7840e [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 2.
I20260709 13:05:01.526104 21346 leader_election.cc:290] T 1a61655d99124a29b486ba4a5b37faea P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:05:01.554540 19483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1efebf73c86e432baa55533136b6e12c" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
W20260709 13:05:01.556325 19523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.1:40321, user_credentials={real_user=slave}} blocked reactor thread for 70537.5us
I20260709 13:05:01.558607 19526 leader_election.cc:304] T 14935b3ddf914369822e4a0547aaa355 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:05:01.533303 21387 raft_consensus.cc:697] T f93ee515a9c14139bf566522ed8232f3 P e5256d91808b47c195bc9b4dbd7f2b87 [term 6 LEADER]: Becoming Leader. State: Replica: e5256d91808b47c195bc9b4dbd7f2b87, State: Running, Role: LEADER
I20260709 13:05:01.558931 19523 leader_election.cc:304] T ff75a1d4cb1f493db8f71ddc136ba9ab P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e61c3a8f61bb48f8a963c9480e53c168; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:05:01.544648 21469 raft_consensus.cc:493] T 2a16f7501e2444fb86d4e2778e734e02 P e61c3a8f61bb48f8a963c9480e53c168 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 127766fc592545a4997f7790f50f6076)
I20260709 13:05:01.542852 20104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14efcc79969f41babe5529c22d59156d" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:05:01.532480 19404 raft_consensus.cc:2468] T d1e5873a19244c5ebbcd38e126796ee7 P e5256d91808b47c195bc9b4dbd7f2b87 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 4.
I20260709 13:05:01.544131 21194 raft_consensus.cc:493] T 217b5fae677b4971b3bbd2f357a1f7ff P e5256d91808b47c195bc9b4dbd7f2b87 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 0473d2b2d01f4459b1e90fd12cc7840e)
I20260709 13:05:01.548543 21253 leader_election.cc:290] T 7f575b143b844aa096b50997dad3516a P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:05:01.542410 21451 leader_election.cc:290] T 14efcc79969f41babe5529c22d59156d P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:05:01.563812 19523 leader_election.cc:304] T 833a2f0775ed407a94b8924ce50adb63 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e61c3a8f61bb48f8a963c9480e53c168; no voters: 127766fc592545a4997f7790f50f6076, e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:05:01.538313 19477 raft_consensus.cc:2468] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P 0473d2b2d01f4459b1e90fd12cc7840e [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 127766fc592545a4997f7790f50f6076 in term 6.
I20260709 13:05:01.544651 21436 leader_election.cc:290] T 14935b3ddf914369822e4a0547aaa355 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:05:01.571470 21240 raft_consensus.cc:2749] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P 0473d2b2d01f4459b1e90fd12cc7840e [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:05:01.572867 21403 raft_consensus.cc:493] T 70797e5783b5454ab0d0eea663e791e3 P 127766fc592545a4997f7790f50f6076 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader e5256d91808b47c195bc9b4dbd7f2b87)
I20260709 13:05:01.515298 21356 raft_consensus.cc:515] T 2e36a9d6e29c4a7c860cf267efbd4c74 P e5256d91808b47c195bc9b4dbd7f2b87 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:01.573380 21403 raft_consensus.cc:515] T 70797e5783b5454ab0d0eea663e791e3 P 127766fc592545a4997f7790f50f6076 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:05:01.567353 19483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e381f1d6b8184797ad142de49be225a8" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:05:01.553997 21448 consensus_queue.cc:1048] T ab43d85f64114d4ebf618930e43d9ed0 P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.013s
W20260709 13:05:01.570763 19480 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58294 (request call id 1423) took 2050 ms (client timeout 1609 ms). Trace:
I20260709 13:05:01.551051 21462 consensus_queue.cc:1048] T 21e14947d70440f19044d8f75c31e1f9 P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.019s
I20260709 13:05:01.570241 21194 raft_consensus.cc:515] T 217b5fae677b4971b3bbd2f357a1f7ff P e5256d91808b47c195bc9b4dbd7f2b87 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:01.590354 19483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62c6c134d3d24a1ab144dd9ee6bc3f64" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:05:01.581666 21356 leader_election.cc:290] T 2e36a9d6e29c4a7c860cf267efbd4c74 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:05:01.565656 21344 leader_election.cc:290] T e381f1d6b8184797ad142de49be225a8 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
W20260709 13:05:01.582530 19480 rpcz_store.cc:269] 0709 13:04:59.520063 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:59.520161 (+    98us) service_pool.cc:224] Handling call
0709 13:05:01.570582 (+2050421us) spinlock_profiling.cc:243] Waited 350 ms on lock 0x7b5400344254. stack: 00007f4a79de9343 00007f4a79de9240 00007f4a797781d4 00007f4a834b6304 00007f4a834b6299 00007f4a7ce71571 00007f4a7cf0c2fa 00007f4a81ecdb17 00007f4a7b4486d4 00007f4a7b448662 00007f4a7b448591 00007f4a7b44850c 00007f4a7b4477c2 00007f4a7b24348c 00007f4a7b2428c6 00007f4a7b24226f
0709 13:05:01.570682 (+   100us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":804130176}
I20260709 13:05:01.583365 19553 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40428 (request call id 1641) took 1395 ms. Trace:
I20260709 13:05:01.584111 21437 leader_election.cc:290] T 62c6c134d3d24a1ab144dd9ee6bc3f64 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:05:01.585888 21468 raft_consensus.cc:2804] T 14935b3ddf914369822e4a0547aaa355 P e61c3a8f61bb48f8a963c9480e53c168 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:05:01.588110 20103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1efebf73c86e432baa55533136b6e12c" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:05:01.605954 21194 leader_election.cc:290] T 217b5fae677b4971b3bbd2f357a1f7ff P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:05:01.606724 21344 raft_consensus.cc:2749] T ff75a1d4cb1f493db8f71ddc136ba9ab P e61c3a8f61bb48f8a963c9480e53c168 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:05:01.569259 21400 leader_election.cc:290] T 4af19371ea874c09a0a2147040835cbb P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:05:01.588821 20105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4af19371ea874c09a0a2147040835cbb" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:05:01.595074 19404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14935b3ddf914369822e4a0547aaa355" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
W20260709 13:05:01.599277 21466 log.cc:927] Time spent T df751f992649444090e27965eb1af85d P e61c3a8f61bb48f8a963c9480e53c168: Append to log took a long time: real 0.068s	user 0.000s	sys 0.000s
I20260709 13:05:01.579985 21379 leader_election.cc:290] T 4509b76741dc428e9201c70c1658da13 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:05:01.603500 21375 raft_consensus.cc:493] T 0e1085d23e8347fbbd5bce7542f4b1f4 P 0473d2b2d01f4459b1e90fd12cc7840e [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 127766fc592545a4997f7790f50f6076)
I20260709 13:05:01.609131 21344 raft_consensus.cc:2749] T 833a2f0775ed407a94b8924ce50adb63 P e61c3a8f61bb48f8a963c9480e53c168 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:05:01.609575 20104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70797e5783b5454ab0d0eea663e791e3" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:05:01.550535 21464 raft_consensus.cc:515] T 0afb57ae58a24a01850491d69f0213dd P 127766fc592545a4997f7790f50f6076 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:05:01.607288 21387 consensus_queue.cc:237] T f93ee515a9c14139bf566522ed8232f3 P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.2, Last appended by leader: 2, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:01.610570 21373 leader_election.cc:290] T 309c3ca0ca4b4f3ba129752ea2cb293b P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:05:01.617416 21203 raft_consensus.cc:697] T bc225c93219c45538b53a1bd3d387e4d P e61c3a8f61bb48f8a963c9480e53c168 [term 6 LEADER]: Becoming Leader. State: Replica: e61c3a8f61bb48f8a963c9480e53c168, State: Running, Role: LEADER
I20260709 13:05:01.619460 21450 leader_election.cc:290] T b08304a0a02b42d7840c4e8ee9a6bd1a P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:05:01.619822 19480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cdf56e38bbc453d9438d359e5a69955" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:05:01.619509 21440 leader_election.cc:290] T 2e36a9d6e29c4a7c860cf267efbd4c74 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:05:01.605998 21468 raft_consensus.cc:493] T 14935b3ddf914369822e4a0547aaa355 P e61c3a8f61bb48f8a963c9480e53c168 [term 2 FOLLOWER]: Starting leader election (detected failure of leader e5256d91808b47c195bc9b4dbd7f2b87)
I20260709 13:05:01.590417 21436 consensus_queue.cc:1048] T ab43d85f64114d4ebf618930e43d9ed0 P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.042s
I20260709 13:05:01.566213 21469 raft_consensus.cc:515] T 2a16f7501e2444fb86d4e2778e734e02 P e61c3a8f61bb48f8a963c9480e53c168 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:05:01.600780 19553 rpcz_store.cc:276] 0709 13:05:00.188399 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:00.203341 (+ 14942us) service_pool.cc:224] Handling call
0709 13:05:01.573341 (+1370000us) spinlock_profiling.cc:243] Waited 15 ms on lock 0x7b5800003998. stack: 00007f4a79de9343 00007f4a79de9240 00007f4a797781d4 00007f4a834b6304 00007f4a834b6299 00007f4a79ca3db1 00007f4a79de3b71 00007f4a79de3eee 0000000000375939 00007f4a81e571e0 00007f4a81f200c4 00007f4a81f20131 00007f4a81ee1fc0 00007f4a81ecc929 00007f4a81ecc3d2 00007f4a7b443bd4
0709 13:05:01.573510 (+   169us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:01.573702 (+   192us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:05:01.573734 (+    32us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:05:01.573782 (+    48us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:05:01.573824 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:01.573905 (+    81us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:01.582355 (+  8450us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":34588544}
I20260709 13:05:01.690883 19483 raft_consensus.cc:2468] T 62c6c134d3d24a1ab144dd9ee6bc3f64 P 0473d2b2d01f4459b1e90fd12cc7840e [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 5.
W20260709 13:05:01.655589 19449 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:01.701244 19485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e36a9d6e29c4a7c860cf267efbd4c74" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:05:01.611900 21437 raft_consensus.cc:493] T 76cb037fc9064d13b59a8969d897ce8c P e61c3a8f61bb48f8a963c9480e53c168 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 0473d2b2d01f4459b1e90fd12cc7840e)
I20260709 13:05:01.708020 21468 raft_consensus.cc:3060] T 14935b3ddf914369822e4a0547aaa355 P e61c3a8f61bb48f8a963c9480e53c168 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:01.736824 19485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28af091831594f9d8e96482078cc7625" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:05:01.629711 21400 raft_consensus.cc:493] T 7be9efa6559648dbb5a0f7684c4542d1 P e61c3a8f61bb48f8a963c9480e53c168 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 0473d2b2d01f4459b1e90fd12cc7840e)
I20260709 13:05:01.616860 21445 leader_election.cc:290] T 0cdf56e38bbc453d9438d359e5a69955 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:05:01.701234 21335 leader_election.cc:290] T 28af091831594f9d8e96482078cc7625 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:05:01.742501 19485 raft_consensus.cc:2393] T 28af091831594f9d8e96482078cc7625 P 0473d2b2d01f4459b1e90fd12cc7840e [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e5256d91808b47c195bc9b4dbd7f2b87 in current term 5: Already voted for candidate 0473d2b2d01f4459b1e90fd12cc7840e in this term.
I20260709 13:05:01.691879 20103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "309c3ca0ca4b4f3ba129752ea2cb293b" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:05:01.736471 21373 raft_consensus.cc:493] T 9962423cb4e54fcfa5de01daf68a86e7 P 0473d2b2d01f4459b1e90fd12cc7840e [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 127766fc592545a4997f7790f50f6076)
I20260709 13:05:01.747659 21403 leader_election.cc:290] T 70797e5783b5454ab0d0eea663e791e3 P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:05:01.742342 21253 raft_consensus.cc:493] T 48824d5acfbc485ebf8c2d944e7202de P 0473d2b2d01f4459b1e90fd12cc7840e [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 127766fc592545a4997f7790f50f6076)
I20260709 13:05:01.749054 21253 raft_consensus.cc:515] T 48824d5acfbc485ebf8c2d944e7202de P 0473d2b2d01f4459b1e90fd12cc7840e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:05:01.747437 21373 raft_consensus.cc:515] T 9962423cb4e54fcfa5de01daf68a86e7 P 0473d2b2d01f4459b1e90fd12cc7840e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:05:01.702806 21465 raft_consensus.cc:697] T 46c5bfeecc314717bffe987e6844b6d0 P e61c3a8f61bb48f8a963c9480e53c168 [term 7 LEADER]: Becoming Leader. State: Replica: e61c3a8f61bb48f8a963c9480e53c168, State: Running, Role: LEADER
I20260709 13:05:01.738113 20107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62c6c134d3d24a1ab144dd9ee6bc3f64" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:05:01.766772 20107 raft_consensus.cc:2468] T 62c6c134d3d24a1ab144dd9ee6bc3f64 P 127766fc592545a4997f7790f50f6076 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 4.
I20260709 13:05:01.752471 21194 raft_consensus.cc:493] T 7be9efa6559648dbb5a0f7684c4542d1 P e5256d91808b47c195bc9b4dbd7f2b87 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 0473d2b2d01f4459b1e90fd12cc7840e)
I20260709 13:05:01.767831 19402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dc5b3532fe54f74876d02beffa2c230" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:05:01.739051 21437 raft_consensus.cc:515] T 76cb037fc9064d13b59a8969d897ce8c P e61c3a8f61bb48f8a963c9480e53c168 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:01.708920 21343 raft_consensus.cc:515] T 28af091831594f9d8e96482078cc7625 P e61c3a8f61bb48f8a963c9480e53c168 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:01.744689 21445 raft_consensus.cc:493] T fa731b585f684a7fb2d106c50f143b83 P e61c3a8f61bb48f8a963c9480e53c168 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 127766fc592545a4997f7790f50f6076)
I20260709 13:05:01.743556 21400 raft_consensus.cc:515] T 7be9efa6559648dbb5a0f7684c4542d1 P e61c3a8f61bb48f8a963c9480e53c168 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:01.756275 19403 raft_consensus.cc:2468] T 3e1f505cb0f1427bbd698ac889d80821 P e5256d91808b47c195bc9b4dbd7f2b87 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 4.
I20260709 13:05:01.757663 19552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a61655d99124a29b486ba4a5b37faea" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:05:01.759850 20108 raft_consensus.cc:1275] T ab43d85f64114d4ebf618930e43d9ed0 P 127766fc592545a4997f7790f50f6076 [term 5 LEARNER]: Refusing update from remote peer e61c3a8f61bb48f8a963c9480e53c168: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:05:01.761411 21373 leader_election.cc:290] T 9962423cb4e54fcfa5de01daf68a86e7 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:05:01.738067 21451 raft_consensus.cc:493] T a08760e15aac4630a629431f56024dc8 P 0473d2b2d01f4459b1e90fd12cc7840e [term 3 FOLLOWER]: Starting pre-election (detected failure of leader e5256d91808b47c195bc9b4dbd7f2b87)
I20260709 13:05:01.756603 19409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70797e5783b5454ab0d0eea663e791e3" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:05:01.750445 21431 raft_consensus.cc:515] T ef32ce6fdd0e40d382c79974f30295c6 P e61c3a8f61bb48f8a963c9480e53c168 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:01.768893 19411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2725d2c4cb054f18b0fc8f735c15f6c2" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:05:01.788008 19411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14efcc79969f41babe5529c22d59156d" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:05:01.771565 21445 raft_consensus.cc:515] T fa731b585f684a7fb2d106c50f143b83 P e61c3a8f61bb48f8a963c9480e53c168 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:05:01.769347 21194 raft_consensus.cc:515] T 7be9efa6559648dbb5a0f7684c4542d1 P e5256d91808b47c195bc9b4dbd7f2b87 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:01.770905 21388 raft_consensus.cc:493] T bc225c93219c45538b53a1bd3d387e4d P e5256d91808b47c195bc9b4dbd7f2b87 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:01.776405 19449 leader_election.cc:400] T 46c5bfeecc314717bffe987e6844b6d0 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 6 election: Vote denied by peer e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321) with higher term. Message: Invalid argument: T 46c5bfeecc314717bffe987e6844b6d0 P e5256d91808b47c195bc9b4dbd7f2b87 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 0473d2b2d01f4459b1e90fd12cc7840e for earlier term 6. Current term is 7.
I20260709 13:05:01.818691 19449 leader_election.cc:304] T 28af091831594f9d8e96482078cc7625 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87; no voters: 
I20260709 13:05:01.819785 19449 leader_election.cc:304] T 5ec1c4ce15e04c7e8c283a62179f2a64 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e; no voters: 127766fc592545a4997f7790f50f6076, e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:05:01.821120 19449 leader_election.cc:304] T 1f85fc4b527a48848e5faa083b604e36 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e; no voters: 127766fc592545a4997f7790f50f6076, e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:05:01.691234 21467 consensus_queue.cc:1048] T 21e14947d70440f19044d8f75c31e1f9 P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.155s
I20260709 13:05:01.774660 21358 raft_consensus.cc:493] T 9962423cb4e54fcfa5de01daf68a86e7 P e5256d91808b47c195bc9b4dbd7f2b87 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 127766fc592545a4997f7790f50f6076)
I20260709 13:05:01.825817 21358 raft_consensus.cc:515] T 9962423cb4e54fcfa5de01daf68a86e7 P e5256d91808b47c195bc9b4dbd7f2b87 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:05:01.786737 21253 leader_election.cc:290] T 48824d5acfbc485ebf8c2d944e7202de P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:05:01.828575 21358 leader_election.cc:290] T 9962423cb4e54fcfa5de01daf68a86e7 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:05:01.784556 19402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f575b143b844aa096b50997dad3516a" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:05:01.784932 21464 leader_election.cc:290] T 0afb57ae58a24a01850491d69f0213dd P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:05:01.830983 21379 raft_consensus.cc:2749] T 5ec1c4ce15e04c7e8c283a62179f2a64 P 0473d2b2d01f4459b1e90fd12cc7840e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:05:01.830883 21347 raft_consensus.cc:515] T 40e1e16737a842ee936002830f36882e P e61c3a8f61bb48f8a963c9480e53c168 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:01.823835 21388 raft_consensus.cc:3060] T bc225c93219c45538b53a1bd3d387e4d P e5256d91808b47c195bc9b4dbd7f2b87 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:05:01.785442 21477 raft_consensus.cc:493] T 48824d5acfbc485ebf8c2d944e7202de P e61c3a8f61bb48f8a963c9480e53c168 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 127766fc592545a4997f7790f50f6076)
I20260709 13:05:01.786211 19409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "309c3ca0ca4b4f3ba129752ea2cb293b" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:05:01.709506 20104 raft_consensus.cc:2468] T 70797e5783b5454ab0d0eea663e791e3 P 127766fc592545a4997f7790f50f6076 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 3.
I20260709 13:05:01.770545 21478 raft_consensus.cc:493] T a08760e15aac4630a629431f56024dc8 P e61c3a8f61bb48f8a963c9480e53c168 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader e5256d91808b47c195bc9b4dbd7f2b87)
I20260709 13:05:01.789497 19411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4509b76741dc428e9201c70c1658da13" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:05:01.792174 19485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a61655d99124a29b486ba4a5b37faea" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:05:01.794257 21469 leader_election.cc:290] T 2a16f7501e2444fb86d4e2778e734e02 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:05:01.794657 21346 raft_consensus.cc:493] T 2a16f7501e2444fb86d4e2778e734e02 P e5256d91808b47c195bc9b4dbd7f2b87 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 127766fc592545a4997f7790f50f6076)
I20260709 13:05:01.800084 19408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40e1e16737a842ee936002830f36882e" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:05:01.802640 19552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b08304a0a02b42d7840c4e8ee9a6bd1a" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:05:01.804296 21387 raft_consensus.cc:493] T 76cb037fc9064d13b59a8969d897ce8c P e5256d91808b47c195bc9b4dbd7f2b87 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 0473d2b2d01f4459b1e90fd12cc7840e)
I20260709 13:05:01.805086 19481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e36a9d6e29c4a7c860cf267efbd4c74" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:05:01.802995 19560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "217b5fae677b4971b3bbd2f357a1f7ff" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:05:01.805673 21372 raft_consensus.cc:493] T 1efebf73c86e432baa55533136b6e12c P 0473d2b2d01f4459b1e90fd12cc7840e [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 127766fc592545a4997f7790f50f6076)
I20260709 13:05:01.805785 19553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e36a9d6e29c4a7c860cf267efbd4c74" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:05:01.803268 19557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28af091831594f9d8e96482078cc7625" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:05:01.843329 19557 raft_consensus.cc:2368] T 28af091831594f9d8e96482078cc7625 P e61c3a8f61bb48f8a963c9480e53c168 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e5256d91808b47c195bc9b4dbd7f2b87 for earlier term 5. Current term is 6.
I20260709 13:05:01.833578 21338 raft_consensus.cc:2749] T 1f85fc4b527a48848e5faa083b604e36 P 0473d2b2d01f4459b1e90fd12cc7840e [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:05:01.803586 19559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e1f505cb0f1427bbd698ac889d80821" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:05:01.807087 19486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e1f505cb0f1427bbd698ac889d80821" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:05:01.808344 19375 leader_election.cc:304] T ece3db938bc649d4a40a51522ed5259c P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87; no voters: 127766fc592545a4997f7790f50f6076, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:05:01.788221 21451 raft_consensus.cc:515] T a08760e15aac4630a629431f56024dc8 P 0473d2b2d01f4459b1e90fd12cc7840e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:01.810957 21380 leader_election.cc:290] T 21e14947d70440f19044d8f75c31e1f9 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:05:01.838243 21347 leader_election.cc:290] T 40e1e16737a842ee936002830f36882e P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 5 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:05:01.837452 21477 raft_consensus.cc:515] T 48824d5acfbc485ebf8c2d944e7202de P e61c3a8f61bb48f8a963c9480e53c168 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:05:01.822422 19449 leader_election.cc:304] T b08304a0a02b42d7840c4e8ee9a6bd1a P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87; no voters: 
I20260709 13:05:01.816241 21445 leader_election.cc:290] T fa731b585f684a7fb2d106c50f143b83 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:05:01.824421 21373 raft_consensus.cc:2804] T 28af091831594f9d8e96482078cc7625 P 0473d2b2d01f4459b1e90fd12cc7840e [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:05:01.790724 21203 consensus_queue.cc:237] T bc225c93219c45538b53a1bd3d387e4d P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 4.2, Last appended by leader: 2, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:01.830567 21194 leader_election.cc:290] T 7be9efa6559648dbb5a0f7684c4542d1 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:05:01.785339 19403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14935b3ddf914369822e4a0547aaa355" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
W20260709 13:05:01.941670 19525 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:01.983211 21373 raft_consensus.cc:493] T 28af091831594f9d8e96482078cc7625 P 0473d2b2d01f4459b1e90fd12cc7840e [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:01.983536 19486 raft_consensus.cc:2410] T 3e1f505cb0f1427bbd698ac889d80821 P 0473d2b2d01f4459b1e90fd12cc7840e [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e5256d91808b47c195bc9b4dbd7f2b87 for term 4 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:05:01.983747 21373 raft_consensus.cc:3060] T 28af091831594f9d8e96482078cc7625 P 0473d2b2d01f4459b1e90fd12cc7840e [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:05:01.863354 19559 raft_consensus.cc:2393] T 3e1f505cb0f1427bbd698ac889d80821 P e61c3a8f61bb48f8a963c9480e53c168 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e5256d91808b47c195bc9b4dbd7f2b87 in current term 4: Already voted for candidate e61c3a8f61bb48f8a963c9480e53c168 in this term.
I20260709 13:05:01.883463 20103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9962423cb4e54fcfa5de01daf68a86e7" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:05:01.987176 19481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9962423cb4e54fcfa5de01daf68a86e7" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:05:01.784970 21088 raft_consensus.cc:493] T fa8650e71aa14778b3d73721fc50d9fc P 0473d2b2d01f4459b1e90fd12cc7840e [term 4 FOLLOWER]: Starting pre-election (detected failure of leader e61c3a8f61bb48f8a963c9480e53c168)
I20260709 13:05:01.987828 19481 raft_consensus.cc:2468] T 9962423cb4e54fcfa5de01daf68a86e7 P 0473d2b2d01f4459b1e90fd12cc7840e [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 6.
I20260709 13:05:01.988229 21088 raft_consensus.cc:515] T fa8650e71aa14778b3d73721fc50d9fc P 0473d2b2d01f4459b1e90fd12cc7840e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:01.989334 19481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7be9efa6559648dbb5a0f7684c4542d1" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:05:01.864441 19553 raft_consensus.cc:2468] T 2e36a9d6e29c4a7c860cf267efbd4c74 P e61c3a8f61bb48f8a963c9480e53c168 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 2.
I20260709 13:05:01.991307 21088 leader_election.cc:290] T fa8650e71aa14778b3d73721fc50d9fc P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:05:01.864571 21372 raft_consensus.cc:515] T 1efebf73c86e432baa55533136b6e12c P 0473d2b2d01f4459b1e90fd12cc7840e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:05:01.993256 21372 leader_election.cc:290] T 1efebf73c86e432baa55533136b6e12c P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:05:01.916350 21468 raft_consensus.cc:515] T 14935b3ddf914369822e4a0547aaa355 P e61c3a8f61bb48f8a963c9480e53c168 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } attrs { replace: true } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: NON_VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: true } }
I20260709 13:05:01.997624 21306 leader_election.cc:290] T 14935b3ddf914369822e4a0547aaa355 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:05:01.999028 21442 leader_election.cc:290] T 2725d2c4cb054f18b0fc8f735c15f6c2 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:05:01.999303 21477 leader_election.cc:290] T 48824d5acfbc485ebf8c2d944e7202de P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:05:01.999603 21442 raft_consensus.cc:493] T 0e1085d23e8347fbbd5bce7542f4b1f4 P e61c3a8f61bb48f8a963c9480e53c168 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 127766fc592545a4997f7790f50f6076)
I20260709 13:05:02.000259 21442 raft_consensus.cc:515] T 0e1085d23e8347fbbd5bce7542f4b1f4 P e61c3a8f61bb48f8a963c9480e53c168 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:05:02.001340 21237 leader_election.cc:290] T 62c6c134d3d24a1ab144dd9ee6bc3f64 P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:05:01.838182 19523 leader_election.cc:304] T 1efebf73c86e432baa55533136b6e12c P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e61c3a8f61bb48f8a963c9480e53c168; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, 127766fc592545a4997f7790f50f6076
I20260709 13:05:01.662739 21375 raft_consensus.cc:515] T 0e1085d23e8347fbbd5bce7542f4b1f4 P 0473d2b2d01f4459b1e90fd12cc7840e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:05:02.002282 21442 leader_election.cc:290] T 0e1085d23e8347fbbd5bce7542f4b1f4 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:05:02.002854 21442 raft_consensus.cc:2749] T 1efebf73c86e432baa55533136b6e12c P e61c3a8f61bb48f8a963c9480e53c168 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 13:05:02.002892 19523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.4:43121, user_credentials={real_user=slave}} blocked reactor thread for 164811us
I20260709 13:05:02.003930 19523 leader_election.cc:304] T 62c6c134d3d24a1ab144dd9ee6bc3f64 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 127766fc592545a4997f7790f50f6076, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:05:02.003983 21375 leader_election.cc:290] T 0e1085d23e8347fbbd5bce7542f4b1f4 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:05:02.004837 21375 raft_consensus.cc:2804] T b08304a0a02b42d7840c4e8ee9a6bd1a P 0473d2b2d01f4459b1e90fd12cc7840e [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:05:02.005326 21375 raft_consensus.cc:697] T b08304a0a02b42d7840c4e8ee9a6bd1a P 0473d2b2d01f4459b1e90fd12cc7840e [term 5 LEADER]: Becoming Leader. State: Replica: 0473d2b2d01f4459b1e90fd12cc7840e, State: Running, Role: LEADER
I20260709 13:05:01.806125 19480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "217b5fae677b4971b3bbd2f357a1f7ff" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:05:01.911170 21464 raft_consensus.cc:493] T 775c229504194560ba9589bc2199b089 P 127766fc592545a4997f7790f50f6076 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 0473d2b2d01f4459b1e90fd12cc7840e)
I20260709 13:05:02.006166 21375 consensus_queue.cc:237] T b08304a0a02b42d7840c4e8ee9a6bd1a P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:02.006770 21400 leader_election.cc:290] T 7be9efa6559648dbb5a0f7684c4542d1 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:05:02.008172 21208 raft_consensus.cc:2749] T ece3db938bc649d4a40a51522ed5259c P e5256d91808b47c195bc9b4dbd7f2b87 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:05:02.008628 21431 leader_election.cc:290] T ef32ce6fdd0e40d382c79974f30295c6 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 5 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:05:02.008985 19479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1b10566f45d4a7d9029858330e02d5b" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
W20260709 13:05:02.009302 19375 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.3:36891, user_credentials={real_user=slave}} blocked reactor thread for 201015us
I20260709 13:05:02.009959 19479 raft_consensus.cc:2410] T f1b10566f45d4a7d9029858330e02d5b P 0473d2b2d01f4459b1e90fd12cc7840e [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate e61c3a8f61bb48f8a963c9480e53c168 for term 5 because replica has last-logged OpId of term: 4 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 3.
I20260709 13:05:02.010433 19479 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58286 (request call id 1255) took 1002 ms. Trace:
I20260709 13:05:02.006340 21464 raft_consensus.cc:515] T 775c229504194560ba9589bc2199b089 P 127766fc592545a4997f7790f50f6076 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:05:01.924580 19552 raft_consensus.cc:2393] T b08304a0a02b42d7840c4e8ee9a6bd1a P e61c3a8f61bb48f8a963c9480e53c168 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e5256d91808b47c195bc9b4dbd7f2b87 in current term 4: Already voted for candidate e61c3a8f61bb48f8a963c9480e53c168 in this term.
W20260709 13:05:02.011837 19449 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.1:40321, user_credentials={real_user=slave}} blocked reactor thread for 189503us
I20260709 13:05:01.848609 21387 raft_consensus.cc:515] T 76cb037fc9064d13b59a8969d897ce8c P e5256d91808b47c195bc9b4dbd7f2b87 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:01.848275 21478 raft_consensus.cc:515] T a08760e15aac4630a629431f56024dc8 P e61c3a8f61bb48f8a963c9480e53c168 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:02.014027 19523 leader_election.cc:304] T 70797e5783b5454ab0d0eea663e791e3 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 127766fc592545a4997f7790f50f6076, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:05:02.014870 19482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62c6c134d3d24a1ab144dd9ee6bc3f64" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:05:02.014814 19479 rpcz_store.cc:276] 0709 13:05:01.007918 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:01.008036 (+   118us) service_pool.cc:224] Handling call
0709 13:05:02.008837 (+1000801us) spinlock_profiling.cc:243] Waited 1.35 ms on lock 0x7b58001b9998. stack: 00007f4a79de9343 00007f4a79de9240 00007f4a797781d4 00007f4a834b6304 00007f4a834b6299 00007f4a79ca3db1 00007f4a79de3b71 00007f4a79de3a22 00007f4a82cfcc09 00007f4a81e56ee0 00007f4a81f200ab 00007f4a81f20131 00007f4a81ece0a0 00007f4a81ecd984 00007f4a7b4486d4 00007f4a7b448662
0709 13:05:02.010377 (+  1540us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3111680}
I20260709 13:05:02.020283 19449 leader_election.cc:304] T d1e5873a19244c5ebbcd38e126796ee7 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87; no voters: 
I20260709 13:05:02.027552 19479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0afb57ae58a24a01850491d69f0213dd" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:05:02.028329 19479 raft_consensus.cc:2393] T 0afb57ae58a24a01850491d69f0213dd P 0473d2b2d01f4459b1e90fd12cc7840e [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 127766fc592545a4997f7790f50f6076 in current term 4: Already voted for candidate 0473d2b2d01f4459b1e90fd12cc7840e in this term.
I20260709 13:05:02.031147 19377 leader_election.cc:304] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, 127766fc592545a4997f7790f50f6076
I20260709 13:05:02.030385 19559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df751f992649444090e27965eb1af85d" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:05:02.034446 19377 leader_election.cc:304] T fa8650e71aa14778b3d73721fc50d9fc P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:05:02.034750 19557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef32ce6fdd0e40d382c79974f30295c6" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:05:02.035501 19557 raft_consensus.cc:2393] T ef32ce6fdd0e40d382c79974f30295c6 P e61c3a8f61bb48f8a963c9480e53c168 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0473d2b2d01f4459b1e90fd12cc7840e in current term 5: Already voted for candidate e61c3a8f61bb48f8a963c9480e53c168 in this term.
I20260709 13:05:02.035554 20109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e1085d23e8347fbbd5bce7542f4b1f4" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:05:02.032819 19555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b08304a0a02b42d7840c4e8ee9a6bd1a" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:05:02.042100 19560 raft_consensus.cc:1275] T 6c5eebf646ad445a9d1b1adc319d7b16 P e61c3a8f61bb48f8a963c9480e53c168 [term 4 FOLLOWER]: Refusing update from remote peer 127766fc592545a4997f7790f50f6076: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:05:02.044081 19559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e5873a19244c5ebbcd38e126796ee7" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:05:02.044373 19377 leader_election.cc:304] T ab43d85f64114d4ebf618930e43d9ed0 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:05:02.045452 19377 leader_election.cc:304] T 179fd671030940b4b4a4e24bcc4aba0a P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:05:02.039978 19557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "833a2f0775ed407a94b8924ce50adb63" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
W20260709 13:05:02.046319 19551 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.535s	user 0.000s	sys 0.032s
W20260709 13:05:02.046936 19551 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.542s	user 0.000s	sys 0.032s
I20260709 13:05:02.025183 21445 raft_consensus.cc:2804] T 62c6c134d3d24a1ab144dd9ee6bc3f64 P e61c3a8f61bb48f8a963c9480e53c168 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:05:02.036972 21462 raft_consensus.cc:2804] T 70797e5783b5454ab0d0eea663e791e3 P e61c3a8f61bb48f8a963c9480e53c168 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:05:02.091648 19555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28af091831594f9d8e96482078cc7625" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:05:02.037138 21306 raft_consensus.cc:2804] T d1e5873a19244c5ebbcd38e126796ee7 P 0473d2b2d01f4459b1e90fd12cc7840e [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:05:02.093994 19555 raft_consensus.cc:2393] T 28af091831594f9d8e96482078cc7625 P e61c3a8f61bb48f8a963c9480e53c168 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0473d2b2d01f4459b1e90fd12cc7840e in current term 6: Already voted for candidate e61c3a8f61bb48f8a963c9480e53c168 in this term.
I20260709 13:05:01.845773 21346 raft_consensus.cc:515] T 2a16f7501e2444fb86d4e2778e734e02 P e5256d91808b47c195bc9b4dbd7f2b87 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:05:02.046837 21335 raft_consensus.cc:2749] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P e5256d91808b47c195bc9b4dbd7f2b87 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:05:02.047027 21208 raft_consensus.cc:2749] T fa8650e71aa14778b3d73721fc50d9fc P e5256d91808b47c195bc9b4dbd7f2b87 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:05:02.025367 21477 consensus_queue.cc:1048] T ab43d85f64114d4ebf618930e43d9ed0 P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Connected to new peer: Peer: permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: NON_VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.067s
I20260709 13:05:02.079948 20867 raft_consensus.cc:2749] T ab43d85f64114d4ebf618930e43d9ed0 P e5256d91808b47c195bc9b4dbd7f2b87 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
W20260709 13:05:02.134833 20078 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.2:46257, user_credentials={real_user=slave}} blocked reactor thread for 115923us
I20260709 13:05:02.049132 21468 leader_election.cc:290] T 14935b3ddf914369822e4a0547aaa355 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 3 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:05:02.145594 19560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dc5b3532fe54f74876d02beffa2c230" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:05:02.092806 21482 raft_consensus.cc:2749] T 179fd671030940b4b4a4e24bcc4aba0a P e5256d91808b47c195bc9b4dbd7f2b87 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:05:02.089912 21445 raft_consensus.cc:493] T 62c6c134d3d24a1ab144dd9ee6bc3f64 P e61c3a8f61bb48f8a963c9480e53c168 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:02.139809 19555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70797e5783b5454ab0d0eea663e791e3" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:05:02.093441 21462 raft_consensus.cc:493] T 70797e5783b5454ab0d0eea663e791e3 P e61c3a8f61bb48f8a963c9480e53c168 [term 3 FOLLOWER]: Starting leader election (detected failure of leader e5256d91808b47c195bc9b4dbd7f2b87)
W20260709 13:05:02.146749 19377 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.2:46257, user_credentials={real_user=slave}} blocked reactor thread for 64712.4us
I20260709 13:05:02.112147 21306 raft_consensus.cc:493] T d1e5873a19244c5ebbcd38e126796ee7 P 0473d2b2d01f4459b1e90fd12cc7840e [term 4 FOLLOWER]: Starting leader election (detected failure of leader e61c3a8f61bb48f8a963c9480e53c168)
I20260709 13:05:02.130980 19553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40e1e16737a842ee936002830f36882e" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:05:01.849922 21465 consensus_queue.cc:237] T 46c5bfeecc314717bffe987e6844b6d0 P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 5.2, Last appended by leader: 2, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:02.156745 19377 leader_election.cc:400] T b08304a0a02b42d7840c4e8ee9a6bd1a P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 4 pre-election: Vote denied by peer 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257) with higher term. Message: Invalid argument: T b08304a0a02b42d7840c4e8ee9a6bd1a P 0473d2b2d01f4459b1e90fd12cc7840e [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e5256d91808b47c195bc9b4dbd7f2b87 for earlier term 4. Current term is 5.
I20260709 13:05:02.159531 19377 leader_election.cc:403] T b08304a0a02b42d7840c4e8ee9a6bd1a P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 4 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:05:02.156749 19556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f575b143b844aa096b50997dad3516a" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
W20260709 13:05:02.144843 21429 log.cc:927] Time spent T f1b10566f45d4a7d9029858330e02d5b P e5256d91808b47c195bc9b4dbd7f2b87: Append to log took a long time: real 1.310s	user 0.002s	sys 0.005s
I20260709 13:05:02.163645 19523 leader_election.cc:304] T 1a61655d99124a29b486ba4a5b37faea P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168; no voters: 0473d2b2d01f4459b1e90fd12cc7840e
I20260709 13:05:02.164999 19556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4509b76741dc428e9201c70c1658da13" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:05:02.168282 19556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "309c3ca0ca4b4f3ba129752ea2cb293b" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:05:02.169322 21203 raft_consensus.cc:2804] T 1a61655d99124a29b486ba4a5b37faea P e61c3a8f61bb48f8a963c9480e53c168 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:05:02.169767 21203 raft_consensus.cc:493] T 1a61655d99124a29b486ba4a5b37faea P e61c3a8f61bb48f8a963c9480e53c168 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 0473d2b2d01f4459b1e90fd12cc7840e)
I20260709 13:05:02.170164 21203 raft_consensus.cc:3060] T 1a61655d99124a29b486ba4a5b37faea P e61c3a8f61bb48f8a963c9480e53c168 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:02.171205 21478 leader_election.cc:290] T a08760e15aac4630a629431f56024dc8 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:05:02.172741 19523 leader_election.cc:304] T 3e1f505cb0f1427bbd698ac889d80821 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:05:02.149200 21445 raft_consensus.cc:3060] T 62c6c134d3d24a1ab144dd9ee6bc3f64 P e61c3a8f61bb48f8a963c9480e53c168 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:05:02.155028 21462 raft_consensus.cc:3060] T 70797e5783b5454ab0d0eea663e791e3 P e61c3a8f61bb48f8a963c9480e53c168 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:05:02.148736 19560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0afb57ae58a24a01850491d69f0213dd" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
W20260709 13:05:02.175027 19449 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.1:40321, user_credentials={real_user=slave}} blocked reactor thread for 83321.6us
I20260709 13:05:02.158742 21306 raft_consensus.cc:3060] T d1e5873a19244c5ebbcd38e126796ee7 P 0473d2b2d01f4459b1e90fd12cc7840e [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:05:02.136010 21406 leader_election.cc:290] T 1dc5b3532fe54f74876d02beffa2c230 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:05:02.183168 19377 leader_election.cc:304] T 46c5bfeecc314717bffe987e6844b6d0 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:05:02.191426 19450 leader_election.cc:304] T ef32ce6fdd0e40d382c79974f30295c6 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e; no voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:05:02.198535 21486 raft_consensus.cc:3060] T ef32ce6fdd0e40d382c79974f30295c6 P 0473d2b2d01f4459b1e90fd12cc7840e [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:05:02.196936 19377 leader_election.cc:304] T d1e5873a19244c5ebbcd38e126796ee7 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:05:02.199844 21489 raft_consensus.cc:2749] T d1e5873a19244c5ebbcd38e126796ee7 P e5256d91808b47c195bc9b4dbd7f2b87 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:05:02.169773 21343 leader_election.cc:290] T 28af091831594f9d8e96482078cc7625 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 6 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:05:02.211033 19377 leader_election.cc:304] T 1a61655d99124a29b486ba4a5b37faea P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:05:02.178874 19552 raft_consensus.cc:1240] T b9f0d59553ad444883fcf5b5909f9798 P e61c3a8f61bb48f8a963c9480e53c168 [term 4 FOLLOWER]: Rejecting Update request from peer 0473d2b2d01f4459b1e90fd12cc7840e for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260709 13:05:02.183373 21478 raft_consensus.cc:2804] T 3e1f505cb0f1427bbd698ac889d80821 P e61c3a8f61bb48f8a963c9480e53c168 [term 4 FOLLOWER]: Leader election won for term 4
W20260709 13:05:02.227939 20078 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.2:46257, user_credentials={real_user=slave}} blocked reactor thread for 85773.4us
I20260709 13:05:02.193710 21338 raft_consensus.cc:493] T 3e1f505cb0f1427bbd698ac889d80821 P 0473d2b2d01f4459b1e90fd12cc7840e [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:02.242779 19410 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52342 (request call id 1651) took 2159 ms. Trace:
I20260709 13:05:02.185300 19449 leader_election.cc:304] T 14efcc79969f41babe5529c22d59156d P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e; no voters: 127766fc592545a4997f7790f50f6076, e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:05:02.245893 21493 raft_consensus.cc:2749] T 14efcc79969f41babe5529c22d59156d P 0473d2b2d01f4459b1e90fd12cc7840e [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 13:05:02.246091 19449 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.4:43121, user_credentials={real_user=slave}} blocked reactor thread for 60859.6us
I20260709 13:05:02.247653 19449 leader_election.cc:304] T 309c3ca0ca4b4f3ba129752ea2cb293b P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e; no voters: 127766fc592545a4997f7790f50f6076, e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:05:02.248435 21493 raft_consensus.cc:2749] T 309c3ca0ca4b4f3ba129752ea2cb293b P 0473d2b2d01f4459b1e90fd12cc7840e [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:05:02.250324 19404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9962423cb4e54fcfa5de01daf68a86e7" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:05:02.250998 19403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21e14947d70440f19044d8f75c31e1f9" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
W20260709 13:05:02.240319 19450 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.3:36891, user_credentials={real_user=slave}} blocked reactor thread for 48958.3us
I20260709 13:05:02.192122 19554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62c6c134d3d24a1ab144dd9ee6bc3f64" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:05:02.196759 21474 raft_consensus.cc:493] T b08304a0a02b42d7840c4e8ee9a6bd1a P e61c3a8f61bb48f8a963c9480e53c168 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:02.251036 19404 raft_consensus.cc:2468] T 9962423cb4e54fcfa5de01daf68a86e7 P e5256d91808b47c195bc9b4dbd7f2b87 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 6.
I20260709 13:05:02.251773 19403 raft_consensus.cc:2468] T 21e14947d70440f19044d8f75c31e1f9 P e5256d91808b47c195bc9b4dbd7f2b87 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 4.
I20260709 13:05:02.222334 19377 leader_election.cc:304] T 9962423cb4e54fcfa5de01daf68a86e7 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87; no voters: 127766fc592545a4997f7790f50f6076
I20260709 13:05:02.252008 21474 raft_consensus.cc:515] T b08304a0a02b42d7840c4e8ee9a6bd1a P e61c3a8f61bb48f8a963c9480e53c168 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:02.253364 19450 leader_election.cc:304] T df751f992649444090e27965eb1af85d P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e; no voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:05:02.253892 21489 raft_consensus.cc:2804] T 9962423cb4e54fcfa5de01daf68a86e7 P e5256d91808b47c195bc9b4dbd7f2b87 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:05:02.254299 21489 raft_consensus.cc:493] T 9962423cb4e54fcfa5de01daf68a86e7 P e5256d91808b47c195bc9b4dbd7f2b87 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 127766fc592545a4997f7790f50f6076)
I20260709 13:05:02.254691 21489 raft_consensus.cc:3060] T 9962423cb4e54fcfa5de01daf68a86e7 P e5256d91808b47c195bc9b4dbd7f2b87 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:05:02.255896 21492 consensus_queue.cc:1048] T 6c5eebf646ad445a9d1b1adc319d7b16 P 127766fc592545a4997f7790f50f6076 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:05:02.258863 19450 leader_election.cc:304] T 1dc5b3532fe54f74876d02beffa2c230 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e; no voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:05:02.243343 19410 rpcz_store.cc:276] 0709 13:05:00.068178 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:00.071500 (+  3322us) service_pool.cc:224] Handling call
0709 13:05:00.071773 (+   273us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:05:00.141172 (+ 69399us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:05:00.141203 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:05:00.143232 (+  2029us) log.cc:844] Serialized 26 byte log entry
0709 13:05:00.278924 (+135692us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:05:00.278961 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:00.279028 (+    67us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:05:02.013257 (+1734229us) spinlock_profiling.cc:243] Waited 4.58 ms on lock 0x7b4400022b4c. stack: 00007f4a79de9343 00007f4a79de9240 00007f4a797781d4 00007f4a834b6304 00007f4a834b6299 00007f4a79ca3db1 00007f4a79d41c85 00007f4a79d426a2 00007f4a7cab41db 00007f4a7caafaaf 00007f4a7caa386e 00007f4a7caa2bb6 00007f4a7caa27d8 00007f4a7caac221 00007f4a7caac1d9 00007f4a7caac169
0709 13:05:02.227280 (+214023us) raft_consensus.cc:1685] finished
0709 13:05:02.227304 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:02.227656 (+   352us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":48802,"raft.run_cpu_time_us":114,"raft.run_wall_time_us":6738,"spinlock_wait_cycles":10542336,"thread_start_us":142336,"threads_started":2,"wal-append.queue_time_us":392888}
I20260709 13:05:02.210451 21358 raft_consensus.cc:2749] T 46c5bfeecc314717bffe987e6844b6d0 P e5256d91808b47c195bc9b4dbd7f2b87 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:05:02.194155 21194 raft_consensus.cc:2749] T b08304a0a02b42d7840c4e8ee9a6bd1a P e5256d91808b47c195bc9b4dbd7f2b87 [term 5 FOLLOWER]: Leader pre-election lost for term 4. Reason: Vote denied by peer 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257) with higher term. Message: Invalid argument: T b08304a0a02b42d7840c4e8ee9a6bd1a P 0473d2b2d01f4459b1e90fd12cc7840e [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e5256d91808b47c195bc9b4dbd7f2b87 for earlier term 4. Current term is 5.
I20260709 13:05:02.262737 19450 leader_election.cc:304] T 7f575b143b844aa096b50997dad3516a P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e; no voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:05:02.297188 19450 leader_election.cc:304] T 4509b76741dc428e9201c70c1658da13 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e; no voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168
W20260709 13:05:02.299047 20078 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.2:46257, user_credentials={real_user=slave}} blocked reactor thread for 58416.3us
I20260709 13:05:02.299639 21126 raft_consensus.cc:2749] T 7f575b143b844aa096b50997dad3516a P 0473d2b2d01f4459b1e90fd12cc7840e [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:05:02.271937 19407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a08760e15aac4630a629431f56024dc8" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:05:02.306912 20109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9962423cb4e54fcfa5de01daf68a86e7" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:05:02.272493 19404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "775c229504194560ba9589bc2199b089" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:05:02.273610 19449 leader_election.cc:304] T 9962423cb4e54fcfa5de01daf68a86e7 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87; no voters: 
I20260709 13:05:02.311569 19449 leader_election.cc:304] T 21e14947d70440f19044d8f75c31e1f9 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87; no voters: 
I20260709 13:05:02.275734 19403 raft_consensus.cc:1240] T f93ee515a9c14139bf566522ed8232f3 P e5256d91808b47c195bc9b4dbd7f2b87 [term 6 LEADER]: Rejecting Update request from peer 0473d2b2d01f4459b1e90fd12cc7840e for earlier term 5. Current term is 6. Ops: []
I20260709 13:05:02.315490 20109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1efebf73c86e432baa55533136b6e12c" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:05:02.296057 21478 raft_consensus.cc:697] T 3e1f505cb0f1427bbd698ac889d80821 P e61c3a8f61bb48f8a963c9480e53c168 [term 4 LEADER]: Becoming Leader. State: Replica: e61c3a8f61bb48f8a963c9480e53c168, State: Running, Role: LEADER
I20260709 13:05:02.285080 21486 raft_consensus.cc:2749] T ef32ce6fdd0e40d382c79974f30295c6 P 0473d2b2d01f4459b1e90fd12cc7840e [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:05:02.294019 20076 leader_election.cc:304] T 833a2f0775ed407a94b8924ce50adb63 P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 127766fc592545a4997f7790f50f6076; no voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:05:02.223501 21482 raft_consensus.cc:2749] T 1a61655d99124a29b486ba4a5b37faea P e5256d91808b47c195bc9b4dbd7f2b87 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:05:02.298138 21372 raft_consensus.cc:2749] T 4509b76741dc428e9201c70c1658da13 P 0473d2b2d01f4459b1e90fd12cc7840e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:05:02.264009 19410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa8650e71aa14778b3d73721fc50d9fc" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:05:02.258368 19553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1efebf73c86e432baa55533136b6e12c" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:05:02.356156 20112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e1085d23e8347fbbd5bce7542f4b1f4" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:05:02.354266 19410 raft_consensus.cc:2468] T fa8650e71aa14778b3d73721fc50d9fc P e5256d91808b47c195bc9b4dbd7f2b87 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 4.
W20260709 13:05:02.305469 19375 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.3:36891, user_credentials={real_user=slave}} blocked reactor thread for 269025us
I20260709 13:05:02.308409 21197 leader_election.cc:290] T 28af091831594f9d8e96482078cc7625 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
W20260709 13:05:02.309190 21484 log.cc:927] Time spent T b08304a0a02b42d7840c4e8ee9a6bd1a P 0473d2b2d01f4459b1e90fd12cc7840e: Append to log took a long time: real 0.085s	user 0.001s	sys 0.000s
I20260709 13:05:02.264464 21375 raft_consensus.cc:2749] T 1dc5b3532fe54f74876d02beffa2c230 P 0473d2b2d01f4459b1e90fd12cc7840e [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:05:02.223511 21373 raft_consensus.cc:515] T 28af091831594f9d8e96482078cc7625 P 0473d2b2d01f4459b1e90fd12cc7840e [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:02.328992 21346 leader_election.cc:290] T 2a16f7501e2444fb86d4e2778e734e02 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:05:02.335106 21474 leader_election.cc:290] T b08304a0a02b42d7840c4e8ee9a6bd1a P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:05:02.336262 21419 leader_election.cc:290] T 3e1f505cb0f1427bbd698ac889d80821 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:05:02.337278 21478 consensus_queue.cc:237] T 3e1f505cb0f1427bbd698ac889d80821 P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:02.355332 20105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48824d5acfbc485ebf8c2d944e7202de" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:05:02.367229 19553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e1085d23e8347fbbd5bce7542f4b1f4" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:05:02.368484 19553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21e14947d70440f19044d8f75c31e1f9" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:05:02.339574 20104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48824d5acfbc485ebf8c2d944e7202de" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:05:02.261729 21338 raft_consensus.cc:515] T 3e1f505cb0f1427bbd698ac889d80821 P 0473d2b2d01f4459b1e90fd12cc7840e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:02.346554 21464 leader_election.cc:290] T 775c229504194560ba9589bc2199b089 P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:05:02.317675 21471 raft_consensus.cc:2804] T 9962423cb4e54fcfa5de01daf68a86e7 P 0473d2b2d01f4459b1e90fd12cc7840e [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:05:02.348264 19556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48824d5acfbc485ebf8c2d944e7202de" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:05:02.378549 21373 leader_election.cc:290] T 28af091831594f9d8e96482078cc7625 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 6 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:05:02.380280 19553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa8650e71aa14778b3d73721fc50d9fc" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:05:02.382965 20107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa731b585f684a7fb2d106c50f143b83" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:05:02.380296 19556 raft_consensus.cc:2468] T 48824d5acfbc485ebf8c2d944e7202de P e61c3a8f61bb48f8a963c9480e53c168 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 2.
I20260709 13:05:02.393569 21437 leader_election.cc:290] T 76cb037fc9064d13b59a8969d897ce8c P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
W20260709 13:05:02.373570 21388 consensus_meta.cc:287] T bc225c93219c45538b53a1bd3d387e4d P e5256d91808b47c195bc9b4dbd7f2b87: Time spent flushing consensus metadata: real 0.541s	user 0.010s	sys 0.002s
I20260709 13:05:02.319082 21088 raft_consensus.cc:2804] T 21e14947d70440f19044d8f75c31e1f9 P 0473d2b2d01f4459b1e90fd12cc7840e [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 13:05:02.350245 20076 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.3:36891, user_credentials={real_user=slave}} blocked reactor thread for 56360.2us
I20260709 13:05:02.353189 21355 raft_consensus.cc:2749] T 833a2f0775ed407a94b8924ce50adb63 P 127766fc592545a4997f7790f50f6076 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:05:02.310950 21231 consensus_queue.cc:1048] T 6c5eebf646ad445a9d1b1adc319d7b16 P 127766fc592545a4997f7790f50f6076 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.049s
I20260709 13:05:02.360132 21376 raft_consensus.cc:1064] T 14935b3ddf914369822e4a0547aaa355 P e5256d91808b47c195bc9b4dbd7f2b87: attempting to promote NON_VOTER 127766fc592545a4997f7790f50f6076 to VOTER
I20260709 13:05:02.349227 19552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14935b3ddf914369822e4a0547aaa355" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:05:02.380095 21471 raft_consensus.cc:493] T 9962423cb4e54fcfa5de01daf68a86e7 P 0473d2b2d01f4459b1e90fd12cc7840e [term 6 FOLLOWER]: Starting leader election (detected failure of leader 127766fc592545a4997f7790f50f6076)
I20260709 13:05:02.348867 20109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a16f7501e2444fb86d4e2778e734e02" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:05:02.349438 21462 raft_consensus.cc:515] T 70797e5783b5454ab0d0eea663e791e3 P e61c3a8f61bb48f8a963c9480e53c168 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:05:02.376919 21336 leader_election.cc:290] T 3e1f505cb0f1427bbd698ac889d80821 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 4 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:05:02.404958 21088 raft_consensus.cc:493] T 21e14947d70440f19044d8f75c31e1f9 P 0473d2b2d01f4459b1e90fd12cc7840e [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:02.406852 21388 raft_consensus.cc:515] T bc225c93219c45538b53a1bd3d387e4d P e5256d91808b47c195bc9b4dbd7f2b87 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:02.427052 21388 leader_election.cc:290] T bc225c93219c45538b53a1bd3d387e4d P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 7 election: Requested vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:05:02.426884 21376 consensus_queue.cc:237] T 14935b3ddf914369822e4a0547aaa355 P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 2, Current term: 2, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } attrs { replace: true } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:05:02.427613 20108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a16f7501e2444fb86d4e2778e734e02" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:05:02.429493 21338 leader_election.cc:290] T 3e1f505cb0f1427bbd698ac889d80821 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:05:02.378305 21445 raft_consensus.cc:515] T 62c6c134d3d24a1ab144dd9ee6bc3f64 P e61c3a8f61bb48f8a963c9480e53c168 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:05:02.422235 21088 raft_consensus.cc:3060] T 21e14947d70440f19044d8f75c31e1f9 P 0473d2b2d01f4459b1e90fd12cc7840e [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:05:02.413102 21471 raft_consensus.cc:3060] T 9962423cb4e54fcfa5de01daf68a86e7 P 0473d2b2d01f4459b1e90fd12cc7840e [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:05:02.431533 21445 leader_election.cc:290] T 62c6c134d3d24a1ab144dd9ee6bc3f64 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 6 election: Requested vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:05:02.441201 21462 leader_election.cc:290] T 70797e5783b5454ab0d0eea663e791e3 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 4 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:05:02.447440 21451 leader_election.cc:290] T a08760e15aac4630a629431f56024dc8 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:05:02.447819 21387 leader_election.cc:290] T 76cb037fc9064d13b59a8969d897ce8c P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:05:02.455240 21489 raft_consensus.cc:515] T 9962423cb4e54fcfa5de01daf68a86e7 P e5256d91808b47c195bc9b4dbd7f2b87 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:05:02.455415 21306 raft_consensus.cc:515] T d1e5873a19244c5ebbcd38e126796ee7 P 0473d2b2d01f4459b1e90fd12cc7840e [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:02.457199 21489 leader_election.cc:290] T 9962423cb4e54fcfa5de01daf68a86e7 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 7 election: Requested vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:05:02.457751 21306 leader_election.cc:290] T d1e5873a19244c5ebbcd38e126796ee7 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 5 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:05:02.458621 21471 raft_consensus.cc:515] T 9962423cb4e54fcfa5de01daf68a86e7 P 0473d2b2d01f4459b1e90fd12cc7840e [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:05:02.460968 21471 leader_election.cc:290] T 9962423cb4e54fcfa5de01daf68a86e7 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 7 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:05:00.961841 18300 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:05:02.491730 19304 catalog_manager.cc:5697] T ece3db938bc649d4a40a51522ed5259c P 127766fc592545a4997f7790f50f6076 reported cstate change: term changed from 1 to 5, leader changed from e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1) to 127766fc592545a4997f7790f50f6076 (127.17.223.4). New cstate: current_term: 5 leader_uuid: "127766fc592545a4997f7790f50f6076" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:05:02.359369 19375 leader_election.cc:400] T 28af091831594f9d8e96482078cc7625 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 5 pre-election: Vote denied by peer e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891) with higher term. Message: Invalid argument: T 28af091831594f9d8e96482078cc7625 P e61c3a8f61bb48f8a963c9480e53c168 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e5256d91808b47c195bc9b4dbd7f2b87 for earlier term 5. Current term is 6.
I20260709 13:05:02.495034 19375 leader_election.cc:403] T 28af091831594f9d8e96482078cc7625 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 5 pre-election: Cancelling election due to peer responding with higher term
W20260709 13:05:02.497339 19375 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.3:36891, user_credentials={real_user=slave}} blocked reactor thread for 138111us
W20260709 13:05:02.500082 19525 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:02.500418 19375 leader_election.cc:304] T 217b5fae677b4971b3bbd2f357a1f7ff P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:05:02.357970 19449 leader_election.cc:304] T fa8650e71aa14778b3d73721fc50d9fc P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87; no voters: 
W20260709 13:05:02.502918 19449 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.1:40321, user_credentials={real_user=slave}} blocked reactor thread for 144923us
I20260709 13:05:02.504966 19552 raft_consensus.cc:2393] T 14935b3ddf914369822e4a0547aaa355 P e61c3a8f61bb48f8a963c9480e53c168 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0473d2b2d01f4459b1e90fd12cc7840e in current term 3: Already voted for candidate e61c3a8f61bb48f8a963c9480e53c168 in this term.
I20260709 13:05:02.506606 19557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2725d2c4cb054f18b0fc8f735c15f6c2" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:05:02.507728 19554 raft_consensus.cc:2368] T 62c6c134d3d24a1ab144dd9ee6bc3f64 P e61c3a8f61bb48f8a963c9480e53c168 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 127766fc592545a4997f7790f50f6076 for earlier term 5. Current term is 6.
W20260709 13:05:02.508741 19450 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.3:36891, user_credentials={real_user=slave}} blocked reactor thread for 211471us
I20260709 13:05:02.512042 19555 raft_consensus.cc:2393] T 70797e5783b5454ab0d0eea663e791e3 P e61c3a8f61bb48f8a963c9480e53c168 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 127766fc592545a4997f7790f50f6076 in current term 4: Already voted for candidate e61c3a8f61bb48f8a963c9480e53c168 in this term.
I20260709 13:05:02.514410 20108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9962423cb4e54fcfa5de01daf68a86e7" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076"
I20260709 13:05:02.516296 20103 raft_consensus.cc:1275] T 14935b3ddf914369822e4a0547aaa355 P 127766fc592545a4997f7790f50f6076 [term 2 LEARNER]: Refusing update from remote peer e5256d91808b47c195bc9b4dbd7f2b87: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 13:05:02.508574 19304 catalog_manager.cc:5697] T 14935b3ddf914369822e4a0547aaa355 P 127766fc592545a4997f7790f50f6076 reported cstate change: config changed from index -1 to 2, NON_VOTER 127766fc592545a4997f7790f50f6076 (127.17.223.4) added. New cstate: current_term: 1 leader_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } attrs { replace: true } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: NON_VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: true } } }
I20260709 13:05:02.519971 19304 catalog_manager.cc:5697] T 96efeaaf1057492490e9a621f37e1a2d P 127766fc592545a4997f7790f50f6076 reported cstate change: term changed from 2 to 4, leader changed from 127766fc592545a4997f7790f50f6076 (127.17.223.4) to e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3). New cstate: current_term: 4 leader_uuid: "e61c3a8f61bb48f8a963c9480e53c168" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } } }
I20260709 13:05:02.523928 19406 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49050 (request call id 162) took 1404 ms. Trace:
I20260709 13:05:02.524550 19406 rpcz_store.cc:276] 0709 13:05:01.136707 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:01.136839 (+   132us) service_pool.cc:224] Handling call
0709 13:05:01.137133 (+   294us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:01.160734 (+ 23601us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:05:01.160763 (+    29us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:05:01.160804 (+    41us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:05:01.160830 (+    26us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:02.523370 (+1362540us) spinlock_profiling.cc:243] Waited 23.4 ms on lock 0x7b540019f354. stack: 00007f4a79de9343 00007f4a79de9240 00007f4a797781d4 00007f4a834b6304 00007f4a834b6299 00007f4a7ce71571 00007f4a7cf08e01 00007f4a7cf0783e 00007f4a81ecc419 00007f4a7b443bd4 00007f4a7b443b62 00007f4a7b443a91 00007f4a7b443a0c 00007f4a7b442cc2 00007f4a7b24348c 00007f4a7b2428c6
0709 13:05:02.523445 (+    75us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:02.523697 (+   252us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":53837056}
I20260709 13:05:02.526638 19558 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40438 (request call id 1457) took 1417 ms. Trace:
I20260709 13:05:02.527238 19558 rpcz_store.cc:276] 0709 13:05:01.109235 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:01.111267 (+  2032us) service_pool.cc:224] Handling call
0709 13:05:01.111628 (+   361us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:01.342698 (+231070us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:05:01.342740 (+    42us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:05:01.342794 (+    54us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:05:01.342837 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:02.525960 (+1183123us) spinlock_profiling.cc:243] Waited 231 ms on lock 0x7b5400124b54. stack: 00007f4a79de9343 00007f4a79de9240 00007f4a797781d4 00007f4a834b6304 00007f4a834b6299 00007f4a7ce71571 00007f4a7cf08e01 00007f4a7cf0783e 00007f4a81ecc419 00007f4a7b443bd4 00007f4a7b443b62 00007f4a7b443a91 00007f4a7b443a0c 00007f4a7b442cc2 00007f4a7b24348c 00007f4a7b2428c6
0709 13:05:02.526048 (+    88us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:02.526402 (+   354us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":530879232}
I20260709 13:05:02.533164 20105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9962423cb4e54fcfa5de01daf68a86e7" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076"
I20260709 13:05:02.537006 19403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e5873a19244c5ebbcd38e126796ee7" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
I20260709 13:05:02.537397 19410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9962423cb4e54fcfa5de01daf68a86e7" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
I20260709 13:05:02.538650 19410 raft_consensus.cc:2393] T 9962423cb4e54fcfa5de01daf68a86e7 P e5256d91808b47c195bc9b4dbd7f2b87 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 0473d2b2d01f4459b1e90fd12cc7840e in current term 7: Already voted for candidate e5256d91808b47c195bc9b4dbd7f2b87 in this term.
I20260709 13:05:02.543085 19402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e1f505cb0f1427bbd698ac889d80821" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:05:02.544282 19402 raft_consensus.cc:2393] T 3e1f505cb0f1427bbd698ac889d80821 P e5256d91808b47c195bc9b4dbd7f2b87 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0473d2b2d01f4459b1e90fd12cc7840e in current term 4: Already voted for candidate e61c3a8f61bb48f8a963c9480e53c168 in this term.
I20260709 13:05:02.554733 21115 raft_consensus.cc:3060] T 0afb57ae58a24a01850491d69f0213dd P e61c3a8f61bb48f8a963c9480e53c168 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:05:02.544056 19406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28af091831594f9d8e96482078cc7625" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
I20260709 13:05:02.555884 19406 raft_consensus.cc:3060] T 28af091831594f9d8e96482078cc7625 P e5256d91808b47c195bc9b4dbd7f2b87 [term 4 FOLLOWER]: Advancing to term 6
I20260709 13:05:02.561522 21336 raft_consensus.cc:493] T 85c494af21f9457a85da47b9bc70c1fd P e61c3a8f61bb48f8a963c9480e53c168 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e5256d91808b47c195bc9b4dbd7f2b87)
I20260709 13:05:02.575553 19557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e1f505cb0f1427bbd698ac889d80821" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:05:02.575894 21471 raft_consensus.cc:2804] T fa8650e71aa14778b3d73721fc50d9fc P 0473d2b2d01f4459b1e90fd12cc7840e [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:05:02.576591 21471 raft_consensus.cc:493] T fa8650e71aa14778b3d73721fc50d9fc P 0473d2b2d01f4459b1e90fd12cc7840e [term 4 FOLLOWER]: Starting leader election (detected failure of leader e61c3a8f61bb48f8a963c9480e53c168)
I20260709 13:05:02.577081 21493 raft_consensus.cc:2749] T df751f992649444090e27965eb1af85d P 0473d2b2d01f4459b1e90fd12cc7840e [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:05:02.575515 19410 raft_consensus.cc:1240] T 9962423cb4e54fcfa5de01daf68a86e7 P e5256d91808b47c195bc9b4dbd7f2b87 [term 7 FOLLOWER]: Rejecting Update request from peer 127766fc592545a4997f7790f50f6076 for earlier term 6. Current term is 7. Ops: []
I20260709 13:05:02.577119 21471 raft_consensus.cc:3060] T fa8650e71aa14778b3d73721fc50d9fc P 0473d2b2d01f4459b1e90fd12cc7840e [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:05:02.563292 21347 raft_consensus.cc:493] T edd7d470b5014c9489be7f41f64355c9 P e61c3a8f61bb48f8a963c9480e53c168 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 0473d2b2d01f4459b1e90fd12cc7840e)
I20260709 13:05:02.583364 21347 raft_consensus.cc:515] T edd7d470b5014c9489be7f41f64355c9 P e61c3a8f61bb48f8a963c9480e53c168 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:02.586241 21347 leader_election.cc:290] T edd7d470b5014c9489be7f41f64355c9 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:05:02.591272 19555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28af091831594f9d8e96482078cc7625" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:05:02.594254 19555 raft_consensus.cc:2393] T 28af091831594f9d8e96482078cc7625 P e61c3a8f61bb48f8a963c9480e53c168 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 0473d2b2d01f4459b1e90fd12cc7840e in current term 6: Already voted for candidate e61c3a8f61bb48f8a963c9480e53c168 in this term.
I20260709 13:05:02.564956 21415 consensus_queue.cc:1048] T 14935b3ddf914369822e4a0547aaa355 P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Connected to new peer: Peer: permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.033s
W20260709 13:05:02.603600 19375 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.3:36891, user_credentials={real_user=slave}} blocked reactor thread for 103506us
I20260709 13:05:02.604561 19375 leader_election.cc:304] T 3e1f505cb0f1427bbd698ac889d80821 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:05:02.607203 20105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70797e5783b5454ab0d0eea663e791e3" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076"
I20260709 13:05:02.608443 21488 raft_consensus.cc:2749] T 3e1f505cb0f1427bbd698ac889d80821 P e5256d91808b47c195bc9b4dbd7f2b87 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:05:02.602469 20076 leader_election.cc:304] T 70797e5783b5454ab0d0eea663e791e3 P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 127766fc592545a4997f7790f50f6076; no voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:05:02.611534 21478 raft_consensus.cc:493] T 0afb57ae58a24a01850491d69f0213dd P e61c3a8f61bb48f8a963c9480e53c168 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:02.611812 21232 raft_consensus.cc:3060] T 70797e5783b5454ab0d0eea663e791e3 P 127766fc592545a4997f7790f50f6076 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:05:02.612248 21478 raft_consensus.cc:515] T 0afb57ae58a24a01850491d69f0213dd P e61c3a8f61bb48f8a963c9480e53c168 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:05:02.613751 19560 raft_consensus.cc:2468] T 0afb57ae58a24a01850491d69f0213dd P e61c3a8f61bb48f8a963c9480e53c168 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 127766fc592545a4997f7790f50f6076 in term 4.
I20260709 13:05:02.606426 19375 leader_election.cc:304] T 2e36a9d6e29c4a7c860cf267efbd4c74 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168; no voters: 0473d2b2d01f4459b1e90fd12cc7840e
I20260709 13:05:02.614601 20076 leader_election.cc:400] T 62c6c134d3d24a1ab144dd9ee6bc3f64 P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 5 pre-election: Vote denied by peer e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891) with higher term. Message: Invalid argument: T 62c6c134d3d24a1ab144dd9ee6bc3f64 P e61c3a8f61bb48f8a963c9480e53c168 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 127766fc592545a4997f7790f50f6076 for earlier term 5. Current term is 6.
I20260709 13:05:02.615020 20076 leader_election.cc:403] T 62c6c134d3d24a1ab144dd9ee6bc3f64 P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 5 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:05:02.615545 21342 raft_consensus.cc:2804] T 2e36a9d6e29c4a7c860cf267efbd4c74 P e5256d91808b47c195bc9b4dbd7f2b87 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:05:02.616115 21342 raft_consensus.cc:493] T 2e36a9d6e29c4a7c860cf267efbd4c74 P e5256d91808b47c195bc9b4dbd7f2b87 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 0473d2b2d01f4459b1e90fd12cc7840e)
I20260709 13:05:02.616254 19557 raft_consensus.cc:1240] T f93ee515a9c14139bf566522ed8232f3 P e61c3a8f61bb48f8a963c9480e53c168 [term 6 FOLLOWER]: Rejecting Update request from peer 0473d2b2d01f4459b1e90fd12cc7840e for earlier term 5. Current term is 6. Ops: []
I20260709 13:05:02.616673 21342 raft_consensus.cc:3060] T 2e36a9d6e29c4a7c860cf267efbd4c74 P e5256d91808b47c195bc9b4dbd7f2b87 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:02.564837 21203 raft_consensus.cc:515] T 1a61655d99124a29b486ba4a5b37faea P e61c3a8f61bb48f8a963c9480e53c168 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:02.619827 21430 raft_consensus.cc:493] T 22196caba61445d3bec98a0aab3c337d P 0473d2b2d01f4459b1e90fd12cc7840e [term 4 FOLLOWER]: Starting pre-election (detected failure of leader e61c3a8f61bb48f8a963c9480e53c168)
I20260709 13:05:02.620601 21430 raft_consensus.cc:515] T 22196caba61445d3bec98a0aab3c337d P 0473d2b2d01f4459b1e90fd12cc7840e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:02.624492 21444 raft_consensus.cc:493] T f1b10566f45d4a7d9029858330e02d5b P 0473d2b2d01f4459b1e90fd12cc7840e [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:02.620949 21203 leader_election.cc:290] T 1a61655d99124a29b486ba4a5b37faea P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 2 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:05:02.628866 21191 raft_consensus.cc:3060] T 62c6c134d3d24a1ab144dd9ee6bc3f64 P 127766fc592545a4997f7790f50f6076 [term 4 FOLLOWER]: Advancing to term 6
I20260709 13:05:02.562647 21336 raft_consensus.cc:515] T 85c494af21f9457a85da47b9bc70c1fd P e61c3a8f61bb48f8a963c9480e53c168 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:05:02.625181 21444 raft_consensus.cc:515] T f1b10566f45d4a7d9029858330e02d5b P 0473d2b2d01f4459b1e90fd12cc7840e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:02.642526 19406 raft_consensus.cc:2468] T 28af091831594f9d8e96482078cc7625 P e5256d91808b47c195bc9b4dbd7f2b87 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 6.
I20260709 13:05:02.640458 20108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62c6c134d3d24a1ab144dd9ee6bc3f64" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076"
I20260709 13:05:02.664863 19309 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:44676 (request call id 219) took 8918 ms. Trace:
I20260709 13:05:02.665335 19309 rpcz_store.cc:276] 0709 13:04:53.744809 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:53.747975 (+  3166us) service_pool.cc:224] Handling call
0709 13:05:02.658526 (+8910551us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:04:57.927200 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:04:58.058801 (+131601us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:04:58.060531 (+  1730us) write_op.cc:435] Acquired schema lock
0709 13:04:58.062234 (+  1703us) tablet.cc:662] Decoding operations
0709 13:04:58.114568 (+ 52334us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:04:58.114624 (+    56us) write_op.cc:641] Partition lock acquired for write op
0709 13:04:58.114649 (+    25us) tablet.cc:685] Acquiring locks for 6 operations
0709 13:04:58.115176 (+   527us) tablet.cc:701] Row locks acquired
0709 13:04:58.115195 (+    19us) write_op.cc:260] PREPARE: finished
0709 13:04:58.115322 (+   127us) write_op.cc:270] Start()
0709 13:04:58.115436 (+   114us) write_op.cc:276] Timestamp: P: 1783602298115287 usec, L: 0
0709 13:04:58.115460 (+    24us) op_driver.cc:348] REPLICATION: starting
0709 13:04:58.116052 (+   592us) log.cc:844] Serialized 2464 byte log entry
0709 13:04:58.118049 (+  1997us) op_driver.cc:464] REPLICATION: finished
0709 13:04:58.119584 (+  1535us) write_op.cc:301] APPLY: starting
0709 13:04:58.142137 (+ 22553us) tablet.cc:1367] starting BulkCheckPresence
0709 13:04:58.194895 (+ 52758us) tablet.cc:1370] finished BulkCheckPresence
0709 13:04:58.203821 (+  8926us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:04:58.363399 (+159578us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:04:58.402604 (+ 39205us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=6
0709 13:04:58.413571 (+ 10967us) write_op.cc:312] APPLY: finished
0709 13:04:58.448647 (+ 35076us) log.cc:844] Serialized 53 byte log entry
0709 13:04:58.477924 (+ 29277us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:04:58.482557 (+  4633us) write_op.cc:454] Released schema lock
0709 13:04:58.502875 (+ 20318us) write_op.cc:341] FINISH: Updating metrics
0709 13:04:58.522153 (+ 19278us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:04:58.527319 (+  5166us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":339794,"reported_tablets":25,"child_traces":[["op",{"apply.queue_time_us":1308,"apply.run_cpu_time_us":4191,"apply.run_wall_time_us":397531,"num_ops":6,"prepare.queue_time_us":4397,"prepare.run_cpu_time_us":4239,"prepare.run_wall_time_us":201204,"replication_time_us":2465}]]}
I20260709 13:05:02.649995 21491 consensus_queue.cc:1059] T 9962423cb4e54fcfa5de01daf68a86e7 P 127766fc592545a4997f7790f50f6076 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 }, Status: INVALID_TERM, Last received: 6.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.009s
I20260709 13:05:02.671764 21491 raft_consensus.cc:3055] T 9962423cb4e54fcfa5de01daf68a86e7 P 127766fc592545a4997f7790f50f6076 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:05:02.672254 21491 raft_consensus.cc:740] T 9962423cb4e54fcfa5de01daf68a86e7 P 127766fc592545a4997f7790f50f6076 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 127766fc592545a4997f7790f50f6076, State: Running, Role: LEADER
I20260709 13:05:02.672641 21336 leader_election.cc:290] T 85c494af21f9457a85da47b9bc70c1fd P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:05:02.673669 21491 consensus_queue.cc:260] T 9962423cb4e54fcfa5de01daf68a86e7 P 127766fc592545a4997f7790f50f6076 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.6, Last appended by leader: 6, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:05:02.652212 21430 leader_election.cc:290] T 22196caba61445d3bec98a0aab3c337d P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:05:02.653764 19552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a08760e15aac4630a629431f56024dc8" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:05:02.616689 21088 raft_consensus.cc:515] T 21e14947d70440f19044d8f75c31e1f9 P 0473d2b2d01f4459b1e90fd12cc7840e [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
W20260709 13:05:02.676523 19375 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.3:36891, user_credentials={real_user=slave}} blocked reactor thread for 70253.5us
I20260709 13:05:02.679178 21208 raft_consensus.cc:2749] T 28af091831594f9d8e96482078cc7625 P e5256d91808b47c195bc9b4dbd7f2b87 [term 6 FOLLOWER]: Leader pre-election lost for term 5. Reason: Vote denied by peer e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891) with higher term. Message: Invalid argument: T 28af091831594f9d8e96482078cc7625 P e61c3a8f61bb48f8a963c9480e53c168 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e5256d91808b47c195bc9b4dbd7f2b87 for earlier term 5. Current term is 6.
I20260709 13:05:02.663564 19554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e5873a19244c5ebbcd38e126796ee7" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:05:02.688606 21444 leader_election.cc:290] T f1b10566f45d4a7d9029858330e02d5b P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:05:02.701826 21478 leader_election.cc:290] T 0afb57ae58a24a01850491d69f0213dd P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
W20260709 13:05:02.708628 20076 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.3:36891, user_credentials={real_user=slave}} blocked reactor thread for 94341us
I20260709 13:05:02.709475 19403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e381f1d6b8184797ad142de49be225a8" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:05:02.711372 19552 raft_consensus.cc:2468] T a08760e15aac4630a629431f56024dc8 P e61c3a8f61bb48f8a963c9480e53c168 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 3.
I20260709 13:05:02.712451 20076 leader_election.cc:304] T 0afb57ae58a24a01850491d69f0213dd P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 127766fc592545a4997f7790f50f6076, e61c3a8f61bb48f8a963c9480e53c168; no voters: 0473d2b2d01f4459b1e90fd12cc7840e
I20260709 13:05:02.709112 19402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70797e5783b5454ab0d0eea663e791e3" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:05:02.713742 19410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4af19371ea874c09a0a2147040835cbb" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:05:02.714541 19410 raft_consensus.cc:2468] T 4af19371ea874c09a0a2147040835cbb P e5256d91808b47c195bc9b4dbd7f2b87 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 2.
I20260709 13:05:02.715981 21355 raft_consensus.cc:2804] T 0afb57ae58a24a01850491d69f0213dd P 127766fc592545a4997f7790f50f6076 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:05:02.716591 21355 raft_consensus.cc:493] T 0afb57ae58a24a01850491d69f0213dd P 127766fc592545a4997f7790f50f6076 [term 3 FOLLOWER]: Starting leader election (detected failure of leader e61c3a8f61bb48f8a963c9480e53c168)
I20260709 13:05:02.716687 21191 raft_consensus.cc:2749] T 62c6c134d3d24a1ab144dd9ee6bc3f64 P 127766fc592545a4997f7790f50f6076 [term 6 FOLLOWER]: Leader pre-election lost for term 5. Reason: Vote denied by peer e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891) with higher term. Message: Invalid argument: T 62c6c134d3d24a1ab144dd9ee6bc3f64 P e61c3a8f61bb48f8a963c9480e53c168 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 127766fc592545a4997f7790f50f6076 for earlier term 5. Current term is 6.
I20260709 13:05:02.717061 21355 raft_consensus.cc:3060] T 0afb57ae58a24a01850491d69f0213dd P 127766fc592545a4997f7790f50f6076 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:05:02.720867 19478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14efcc79969f41babe5529c22d59156d" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:05:02.723244 19486 raft_consensus.cc:1240] T 9962423cb4e54fcfa5de01daf68a86e7 P 0473d2b2d01f4459b1e90fd12cc7840e [term 7 FOLLOWER]: Rejecting Update request from peer 127766fc592545a4997f7790f50f6076 for earlier term 6. Current term is 7. Ops: []
I20260709 13:05:02.724677 19482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "775c229504194560ba9589bc2199b089" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:05:02.727485 19479 raft_consensus.cc:1275] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P 0473d2b2d01f4459b1e90fd12cc7840e [term 6 FOLLOWER]: Refusing update from remote peer 127766fc592545a4997f7790f50f6076: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:05:02.710848 21491 raft_consensus.cc:3060] T 9962423cb4e54fcfa5de01daf68a86e7 P 127766fc592545a4997f7790f50f6076 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:05:02.737382 21444 consensus_queue.cc:1059] T f93ee515a9c14139bf566522ed8232f3 P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:05:02.738718 21444 consensus_queue.cc:1243] T f93ee515a9c14139bf566522ed8232f3 P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Peer e5256d91808b47c195bc9b4dbd7f2b87 log is divergent from this leader: its last log entry 6.3 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 2
I20260709 13:05:02.739398 21201 raft_consensus.cc:3055] T f93ee515a9c14139bf566522ed8232f3 P 0473d2b2d01f4459b1e90fd12cc7840e [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:05:02.739840 21201 raft_consensus.cc:740] T f93ee515a9c14139bf566522ed8232f3 P 0473d2b2d01f4459b1e90fd12cc7840e [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 0473d2b2d01f4459b1e90fd12cc7840e, State: Running, Role: LEADER
I20260709 13:05:02.741225 21201 consensus_queue.cc:260] T f93ee515a9c14139bf566522ed8232f3 P 0473d2b2d01f4459b1e90fd12cc7840e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:02.742806 21201 raft_consensus.cc:3060] T f93ee515a9c14139bf566522ed8232f3 P 0473d2b2d01f4459b1e90fd12cc7840e [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:05:02.754412 20107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85c494af21f9457a85da47b9bc70c1fd" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:05:02.756796 20107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0afb57ae58a24a01850491d69f0213dd" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:05:02.760773 21088 leader_election.cc:290] T 21e14947d70440f19044d8f75c31e1f9 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 5 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
W20260709 13:05:02.761070 19377 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.2:46257, user_credentials={real_user=slave}} blocked reactor thread for 80582us
I20260709 13:05:02.762964 19410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e36a9d6e29c4a7c860cf267efbd4c74" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:05:02.737066 19449 leader_election.cc:304] T 9962423cb4e54fcfa5de01daf68a86e7 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e; no voters: 127766fc592545a4997f7790f50f6076, e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:05:02.786468 19406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2725d2c4cb054f18b0fc8f735c15f6c2" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
W20260709 13:05:02.800870 19449 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.1:40321, user_credentials={real_user=slave}} blocked reactor thread for 63940.1us
I20260709 13:05:02.791452 21444 raft_consensus.cc:2749] T 9962423cb4e54fcfa5de01daf68a86e7 P 0473d2b2d01f4459b1e90fd12cc7840e [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
W20260709 13:05:02.809705 19377 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:02.808380 21471 raft_consensus.cc:515] T fa8650e71aa14778b3d73721fc50d9fc P 0473d2b2d01f4459b1e90fd12cc7840e [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:02.810911 19410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76cb037fc9064d13b59a8969d897ce8c" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:05:02.815451 21336 raft_consensus.cc:1064] T ab43d85f64114d4ebf618930e43d9ed0 P e61c3a8f61bb48f8a963c9480e53c168: attempting to promote NON_VOTER 127766fc592545a4997f7790f50f6076 to VOTER
W20260709 13:05:02.815966 21336 raft_consensus.cc:1068] T ab43d85f64114d4ebf618930e43d9ed0 P e61c3a8f61bb48f8a963c9480e53c168: Unable to promote non-voter 127766fc592545a4997f7790f50f6076: Illegal state: Leader has not yet committed an operation in its own term
I20260709 13:05:02.818783 19484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc225c93219c45538b53a1bd3d387e4d" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 7 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:05:02.819808 19481 raft_consensus.cc:1240] T ef32ce6fdd0e40d382c79974f30295c6 P 0473d2b2d01f4459b1e90fd12cc7840e [term 5 FOLLOWER]: Rejecting Update request from peer e5256d91808b47c195bc9b4dbd7f2b87 for earlier term 4. Current term is 5. Ops: []
I20260709 13:05:02.814385 19479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76cb037fc9064d13b59a8969d897ce8c" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:05:02.822063 21387 raft_consensus.cc:493] T 65d8cb8d6ec64f459d5a47cefab10acf P e5256d91808b47c195bc9b4dbd7f2b87 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e61c3a8f61bb48f8a963c9480e53c168)
I20260709 13:05:02.822890 21387 raft_consensus.cc:515] T 65d8cb8d6ec64f459d5a47cefab10acf P e5256d91808b47c195bc9b4dbd7f2b87 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:05:02.823200 21355 raft_consensus.cc:515] T 0afb57ae58a24a01850491d69f0213dd P 127766fc592545a4997f7790f50f6076 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:05:02.825574 21355 leader_election.cc:290] T 0afb57ae58a24a01850491d69f0213dd P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 4 election: Requested vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:05:02.826898 19407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cdf56e38bbc453d9438d359e5a69955" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:05:02.806109 21415 raft_consensus.cc:2749] T 217b5fae677b4971b3bbd2f357a1f7ff P e5256d91808b47c195bc9b4dbd7f2b87 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:05:02.839113 19526 leader_election.cc:304] T f1b10566f45d4a7d9029858330e02d5b P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e61c3a8f61bb48f8a963c9480e53c168; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:05:02.840797 21203 raft_consensus.cc:2749] T f1b10566f45d4a7d9029858330e02d5b P e61c3a8f61bb48f8a963c9480e53c168 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:05:02.842777 19552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0afb57ae58a24a01850491d69f0213dd" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:05:02.843384 21342 raft_consensus.cc:515] T 2e36a9d6e29c4a7c860cf267efbd4c74 P e5256d91808b47c195bc9b4dbd7f2b87 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:02.834913 20107 raft_consensus.cc:2468] T 0afb57ae58a24a01850491d69f0213dd P 127766fc592545a4997f7790f50f6076 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 4.
I20260709 13:05:02.858387 19449 leader_election.cc:304] T 28af091831594f9d8e96482078cc7625 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87; no voters: 
I20260709 13:05:02.860103 19407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28af091831594f9d8e96482078cc7625" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
I20260709 13:05:02.860936 19407 raft_consensus.cc:2393] T 28af091831594f9d8e96482078cc7625 P e5256d91808b47c195bc9b4dbd7f2b87 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate e61c3a8f61bb48f8a963c9480e53c168 in current term 6: Already voted for candidate 0473d2b2d01f4459b1e90fd12cc7840e in this term.
I20260709 13:05:02.869134 21372 raft_consensus.cc:2804] T 28af091831594f9d8e96482078cc7625 P 0473d2b2d01f4459b1e90fd12cc7840e [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:05:02.869809 21372 raft_consensus.cc:697] T 28af091831594f9d8e96482078cc7625 P 0473d2b2d01f4459b1e90fd12cc7840e [term 6 LEADER]: Becoming Leader. State: Replica: 0473d2b2d01f4459b1e90fd12cc7840e, State: Running, Role: LEADER
I20260709 13:05:02.870893 21372 consensus_queue.cc:237] T 28af091831594f9d8e96482078cc7625 P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.2, Last appended by leader: 2, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:02.884539 19485 raft_consensus.cc:1275] T 14935b3ddf914369822e4a0547aaa355 P 0473d2b2d01f4459b1e90fd12cc7840e [term 2 FOLLOWER]: Refusing update from remote peer e5256d91808b47c195bc9b4dbd7f2b87: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 13:05:02.888717 19406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7be9efa6559648dbb5a0f7684c4542d1" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:05:02.866290 21471 leader_election.cc:290] T fa8650e71aa14778b3d73721fc50d9fc P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 5 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:05:02.882889 21342 leader_election.cc:290] T 2e36a9d6e29c4a7c860cf267efbd4c74 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 3 election: Requested vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:05:02.882784 21232 raft_consensus.cc:2749] T 70797e5783b5454ab0d0eea663e791e3 P 127766fc592545a4997f7790f50f6076 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:05:02.895007 19407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a16f7501e2444fb86d4e2778e734e02" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:05:02.896036 19405 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52342 (request call id 1664) took 1521 ms. Trace:
I20260709 13:05:02.911988 19407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa731b585f684a7fb2d106c50f143b83" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:05:02.916103 21406 raft_consensus.cc:493] T df751f992649444090e27965eb1af85d P e61c3a8f61bb48f8a963c9480e53c168 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader e5256d91808b47c195bc9b4dbd7f2b87)
I20260709 13:05:02.916837 21406 raft_consensus.cc:515] T df751f992649444090e27965eb1af85d P e61c3a8f61bb48f8a963c9480e53c168 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:02.918939 19402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21e14947d70440f19044d8f75c31e1f9" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
I20260709 13:05:02.919627 19402 raft_consensus.cc:3060] T 21e14947d70440f19044d8f75c31e1f9 P e5256d91808b47c195bc9b4dbd7f2b87 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:05:02.922996 19410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22196caba61445d3bec98a0aab3c337d" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:05:02.924576 19406 raft_consensus.cc:1240] T 2e36a9d6e29c4a7c860cf267efbd4c74 P e5256d91808b47c195bc9b4dbd7f2b87 [term 3 FOLLOWER]: Rejecting Update request from peer 0473d2b2d01f4459b1e90fd12cc7840e for earlier term 2. Current term is 3. Ops: []
W20260709 13:05:02.928419 19449 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:02.925176 21387 leader_election.cc:290] T 65d8cb8d6ec64f459d5a47cefab10acf P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:05:02.937032 19406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa8650e71aa14778b3d73721fc50d9fc" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
I20260709 13:05:02.927595 20105 raft_consensus.cc:1240] T 70797e5783b5454ab0d0eea663e791e3 P 127766fc592545a4997f7790f50f6076 [term 4 FOLLOWER]: Rejecting Update request from peer e5256d91808b47c195bc9b4dbd7f2b87 for earlier term 3. Current term is 4. Ops: []
I20260709 13:05:02.926606 19411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1b10566f45d4a7d9029858330e02d5b" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:05:02.926002 19404 raft_consensus.cc:1275] T b08304a0a02b42d7840c4e8ee9a6bd1a P e5256d91808b47c195bc9b4dbd7f2b87 [term 5 FOLLOWER]: Refusing update from remote peer 0473d2b2d01f4459b1e90fd12cc7840e: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:05:02.942426 20112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65d8cb8d6ec64f459d5a47cefab10acf" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:05:02.897296 19405 rpcz_store.cc:276] 0709 13:05:01.284848 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:02.500743 (+1215895us) service_pool.cc:224] Handling call
0709 13:05:02.501515 (+   772us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:02.539731 (+ 38216us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 13:05:02.595057 (+ 55326us) log.cc:844] Serialized 14 byte log entry
0709 13:05:02.803813 (+208756us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:05:02.803862 (+    49us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:05:02.805860 (+  1998us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:02.805927 (+    67us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:02.806037 (+   110us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":4111,"prepare.queue_time_us":140420,"prepare.run_cpu_time_us":55,"prepare.run_wall_time_us":1015,"raft.queue_time_us":5191,"raft.run_cpu_time_us":184,"raft.run_wall_time_us":7069,"thread_start_us":196656,"threads_started":2,"wal-append.queue_time_us":229896}
I20260709 13:05:02.950977 21338 raft_consensus.cc:493] T 96efeaaf1057492490e9a621f37e1a2d P 0473d2b2d01f4459b1e90fd12cc7840e [term 4 FOLLOWER]: Starting pre-election (detected failure of leader e61c3a8f61bb48f8a963c9480e53c168)
I20260709 13:05:02.951635 21338 raft_consensus.cc:515] T 96efeaaf1057492490e9a621f37e1a2d P 0473d2b2d01f4459b1e90fd12cc7840e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:05:02.966444 19485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e36a9d6e29c4a7c860cf267efbd4c74" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:05:02.953962 21338 leader_election.cc:290] T 96efeaaf1057492490e9a621f37e1a2d P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:05:02.973068 19410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40e1e16737a842ee936002830f36882e" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
I20260709 13:05:02.969336 19483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9962423cb4e54fcfa5de01daf68a86e7" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:05:02.973770 21406 leader_election.cc:290] T df751f992649444090e27965eb1af85d P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
W20260709 13:05:02.983896 19451 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:02.989975 19406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dc5b3532fe54f74876d02beffa2c230" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:05:02.992841 19483 raft_consensus.cc:1240] T fa8650e71aa14778b3d73721fc50d9fc P 0473d2b2d01f4459b1e90fd12cc7840e [term 5 FOLLOWER]: Rejecting Update request from peer e61c3a8f61bb48f8a963c9480e53c168 for earlier term 4. Current term is 5. Ops: []
I20260709 13:05:02.985289 21203 raft_consensus.cc:493] T f93ee515a9c14139bf566522ed8232f3 P e61c3a8f61bb48f8a963c9480e53c168 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:02.995250 19523 leader_election.cc:304] T 0afb57ae58a24a01850491d69f0213dd P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 127766fc592545a4997f7790f50f6076, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
W20260709 13:05:02.998993 19523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.4:43121, user_credentials={real_user=slave}} blocked reactor thread for 62929us
I20260709 13:05:03.006152 19483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40e1e16737a842ee936002830f36882e" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:05:03.007380 19409 raft_consensus.cc:1240] T bc225c93219c45538b53a1bd3d387e4d P e5256d91808b47c195bc9b4dbd7f2b87 [term 7 FOLLOWER]: Rejecting Update request from peer 0473d2b2d01f4459b1e90fd12cc7840e for earlier term 5. Current term is 7. Ops: []
I20260709 13:05:03.007088 19405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14935b3ddf914369822e4a0547aaa355" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
W20260709 13:05:03.007550 21506 log.cc:927] Time spent T 6c5eebf646ad445a9d1b1adc319d7b16 P e61c3a8f61bb48f8a963c9480e53c168: Append to log took a long time: real 0.180s	user 0.002s	sys 0.004s
I20260709 13:05:03.005604 19450 leader_election.cc:304] T 40e1e16737a842ee936002830f36882e P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e; no voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:05:03.002542 21203 raft_consensus.cc:515] T f93ee515a9c14139bf566522ed8232f3 P e61c3a8f61bb48f8a963c9480e53c168 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:03.010239 19409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef32ce6fdd0e40d382c79974f30295c6" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
I20260709 13:05:03.020371 20108 raft_consensus.cc:2468] T 62c6c134d3d24a1ab144dd9ee6bc3f64 P 127766fc592545a4997f7790f50f6076 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 6.
I20260709 13:05:03.021046 21444 raft_consensus.cc:2749] T 40e1e16737a842ee936002830f36882e P 0473d2b2d01f4459b1e90fd12cc7840e [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:05:03.022509 19479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48824d5acfbc485ebf8c2d944e7202de" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:05:03.024933 19477 raft_consensus.cc:1275] T f93ee515a9c14139bf566522ed8232f3 P 0473d2b2d01f4459b1e90fd12cc7840e [term 6 FOLLOWER]: Refusing update from remote peer e5256d91808b47c195bc9b4dbd7f2b87: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 3. (term mismatch)
I20260709 13:05:03.025398 19477 pending_rounds.cc:85] T f93ee515a9c14139bf566522ed8232f3 P 0473d2b2d01f4459b1e90fd12cc7840e: Aborting all ops after (but not including) 2
I20260709 13:05:03.025678 19477 pending_rounds.cc:107] T f93ee515a9c14139bf566522ed8232f3 P 0473d2b2d01f4459b1e90fd12cc7840e: Aborting uncommitted NO_OP operation due to leader change: 5.3
I20260709 13:05:03.025979 19477 raft_consensus.cc:2889] T f93ee515a9c14139bf566522ed8232f3 P 0473d2b2d01f4459b1e90fd12cc7840e [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:05:03.029793 19450 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.3:36891, user_credentials={real_user=slave}} blocked reactor thread for 48272.1us
I20260709 13:05:03.032480 19450 leader_election.cc:304] T 1efebf73c86e432baa55533136b6e12c P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e; no voters: 127766fc592545a4997f7790f50f6076, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:05:03.033209 19479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2725d2c4cb054f18b0fc8f735c15f6c2" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:05:03.033947 19410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70797e5783b5454ab0d0eea663e791e3" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
I20260709 13:05:03.036486 19479 raft_consensus.cc:2468] T 2725d2c4cb054f18b0fc8f735c15f6c2 P 0473d2b2d01f4459b1e90fd12cc7840e [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 3.
I20260709 13:05:03.037654 19406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b08304a0a02b42d7840c4e8ee9a6bd1a" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:05:03.038264 19405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a08760e15aac4630a629431f56024dc8" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:05:03.045135 19406 raft_consensus.cc:2393] T b08304a0a02b42d7840c4e8ee9a6bd1a P e5256d91808b47c195bc9b4dbd7f2b87 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e61c3a8f61bb48f8a963c9480e53c168 in current term 5: Already voted for candidate 0473d2b2d01f4459b1e90fd12cc7840e in this term.
I20260709 13:05:03.032986 21203 leader_election.cc:290] T f93ee515a9c14139bf566522ed8232f3 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:05:03.048585 21372 raft_consensus.cc:2749] T 1efebf73c86e432baa55533136b6e12c P 0473d2b2d01f4459b1e90fd12cc7840e [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:05:03.064405 19405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edd7d470b5014c9489be7f41f64355c9" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
W20260709 13:05:03.079761 19450 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.3:36891, user_credentials={real_user=slave}} blocked reactor thread for 47376.3us
I20260709 13:05:03.084021 19450 leader_election.cc:304] T 0e1085d23e8347fbbd5bce7542f4b1f4 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e; no voters: 127766fc592545a4997f7790f50f6076, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:05:03.080605 19479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7be9efa6559648dbb5a0f7684c4542d1" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:05:03.081043 19477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e1085d23e8347fbbd5bce7542f4b1f4" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:05:03.082142 21346 consensus_queue.cc:1059] T 70797e5783b5454ab0d0eea663e791e3 P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.013s
I20260709 13:05:03.069095 19402 raft_consensus.cc:2468] T 21e14947d70440f19044d8f75c31e1f9 P e5256d91808b47c195bc9b4dbd7f2b87 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 5.
I20260709 13:05:03.080137 19483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef32ce6fdd0e40d382c79974f30295c6" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:05:03.092919 21415 raft_consensus.cc:3055] T 70797e5783b5454ab0d0eea663e791e3 P e5256d91808b47c195bc9b4dbd7f2b87 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:05:03.096964 19409 raft_consensus.cc:1240] T 21e14947d70440f19044d8f75c31e1f9 P e5256d91808b47c195bc9b4dbd7f2b87 [term 5 FOLLOWER]: Rejecting Update request from peer e61c3a8f61bb48f8a963c9480e53c168 for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 13:05:03.103221 19523 leader_election.cc:304] T 62c6c134d3d24a1ab144dd9ee6bc3f64 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 127766fc592545a4997f7790f50f6076, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:05:03.107578 21411 raft_consensus.cc:493] T 172b3dd13109415a955b71ac0e9d2234 P e5256d91808b47c195bc9b4dbd7f2b87 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0473d2b2d01f4459b1e90fd12cc7840e)
I20260709 13:05:03.108327 21411 raft_consensus.cc:515] T 172b3dd13109415a955b71ac0e9d2234 P e5256d91808b47c195bc9b4dbd7f2b87 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:05:03.109294 19482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a08760e15aac4630a629431f56024dc8" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
W20260709 13:05:03.107776 21511 log.cc:927] Time spent T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P e5256d91808b47c195bc9b4dbd7f2b87: Append to log took a long time: real 0.111s	user 0.001s	sys 0.000s
I20260709 13:05:03.111539 19405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a61655d99124a29b486ba4a5b37faea" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
I20260709 13:05:03.111657 19479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14935b3ddf914369822e4a0547aaa355" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:05:03.097103 21415 raft_consensus.cc:740] T 70797e5783b5454ab0d0eea663e791e3 P e5256d91808b47c195bc9b4dbd7f2b87 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: e5256d91808b47c195bc9b4dbd7f2b87, State: Running, Role: LEADER
I20260709 13:05:03.115456 19477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dc5b3532fe54f74876d02beffa2c230" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:05:03.116943 19480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28af091831594f9d8e96482078cc7625" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:05:03.106391 21372 raft_consensus.cc:2749] T 0e1085d23e8347fbbd5bce7542f4b1f4 P 0473d2b2d01f4459b1e90fd12cc7840e [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:05:03.119378 21465 raft_consensus.cc:2804] T 62c6c134d3d24a1ab144dd9ee6bc3f64 P e61c3a8f61bb48f8a963c9480e53c168 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:05:03.132423 19409 raft_consensus.cc:1275] T 46c5bfeecc314717bffe987e6844b6d0 P e5256d91808b47c195bc9b4dbd7f2b87 [term 7 FOLLOWER]: Refusing update from remote peer e61c3a8f61bb48f8a963c9480e53c168: Log matching property violated. Preceding OpId in replica: term: 5 index: 2. Preceding OpId from leader: term: 7 index: 3. (index mismatch)
I20260709 13:05:03.134815 19477 raft_consensus.cc:1240] T 21e14947d70440f19044d8f75c31e1f9 P 0473d2b2d01f4459b1e90fd12cc7840e [term 5 FOLLOWER]: Rejecting Update request from peer e61c3a8f61bb48f8a963c9480e53c168 for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 13:05:03.136193 19552 raft_consensus.cc:2468] T 0afb57ae58a24a01850491d69f0213dd P e61c3a8f61bb48f8a963c9480e53c168 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 127766fc592545a4997f7790f50f6076 in term 4.
I20260709 13:05:03.136790 21336 raft_consensus.cc:2804] T 0afb57ae58a24a01850491d69f0213dd P e61c3a8f61bb48f8a963c9480e53c168 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:05:03.137249 21415 consensus_queue.cc:260] T 70797e5783b5454ab0d0eea663e791e3 P e5256d91808b47c195bc9b4dbd7f2b87 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:05:03.138604 21415 raft_consensus.cc:3060] T 70797e5783b5454ab0d0eea663e791e3 P e5256d91808b47c195bc9b4dbd7f2b87 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:05:03.144253 21411 leader_election.cc:290] T 172b3dd13109415a955b71ac0e9d2234 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:05:03.147369 20076 leader_election.cc:304] T 0afb57ae58a24a01850491d69f0213dd P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 127766fc592545a4997f7790f50f6076, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
W20260709 13:05:03.153615 19377 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:03.153723 19483 raft_consensus.cc:2468] T ef32ce6fdd0e40d382c79974f30295c6 P 0473d2b2d01f4459b1e90fd12cc7840e [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 5.
I20260709 13:05:03.122443 21465 raft_consensus.cc:697] T 62c6c134d3d24a1ab144dd9ee6bc3f64 P e61c3a8f61bb48f8a963c9480e53c168 [term 6 LEADER]: Becoming Leader. State: Replica: e61c3a8f61bb48f8a963c9480e53c168, State: Running, Role: LEADER
I20260709 13:05:03.156629 19480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b08304a0a02b42d7840c4e8ee9a6bd1a" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:05:03.157801 19483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e1f505cb0f1427bbd698ac889d80821" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:05:03.171067 19483 raft_consensus.cc:3060] T 3e1f505cb0f1427bbd698ac889d80821 P 0473d2b2d01f4459b1e90fd12cc7840e [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:05:03.155169 21191 raft_consensus.cc:2804] T 0afb57ae58a24a01850491d69f0213dd P 127766fc592545a4997f7790f50f6076 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:05:03.154997 19402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85c494af21f9457a85da47b9bc70c1fd" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:05:03.180886 21191 raft_consensus.cc:697] T 0afb57ae58a24a01850491d69f0213dd P 127766fc592545a4997f7790f50f6076 [term 4 LEADER]: Becoming Leader. State: Replica: 127766fc592545a4997f7790f50f6076, State: Running, Role: LEADER
I20260709 13:05:03.188868 21191 consensus_queue.cc:237] T 0afb57ae58a24a01850491d69f0213dd P 127766fc592545a4997f7790f50f6076 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:05:03.191069 21336 raft_consensus.cc:493] T 0afb57ae58a24a01850491d69f0213dd P e61c3a8f61bb48f8a963c9480e53c168 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:03.191588 21336 raft_consensus.cc:3060] T 0afb57ae58a24a01850491d69f0213dd P e61c3a8f61bb48f8a963c9480e53c168 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:05:03.195431 19477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62c6c134d3d24a1ab144dd9ee6bc3f64" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:05:03.196059 19479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edd7d470b5014c9489be7f41f64355c9" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:05:03.196344 19481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a61655d99124a29b486ba4a5b37faea" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:05:03.196679 19480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76cb037fc9064d13b59a8969d897ce8c" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:05:03.197067 19482 raft_consensus.cc:3055] T bc225c93219c45538b53a1bd3d387e4d P 0473d2b2d01f4459b1e90fd12cc7840e [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:05:03.197372 19482 raft_consensus.cc:740] T bc225c93219c45538b53a1bd3d387e4d P 0473d2b2d01f4459b1e90fd12cc7840e [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 0473d2b2d01f4459b1e90fd12cc7840e, State: Running, Role: LEADER
I20260709 13:05:03.197919 19478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0afb57ae58a24a01850491d69f0213dd" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:05:03.198167 19482 consensus_queue.cc:260] T bc225c93219c45538b53a1bd3d387e4d P 0473d2b2d01f4459b1e90fd12cc7840e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:03.198603 19478 raft_consensus.cc:2468] T 0afb57ae58a24a01850491d69f0213dd P 0473d2b2d01f4459b1e90fd12cc7840e [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 4.
I20260709 13:05:03.199115 19482 raft_consensus.cc:3060] T bc225c93219c45538b53a1bd3d387e4d P 0473d2b2d01f4459b1e90fd12cc7840e [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:05:03.196130 19477 raft_consensus.cc:3060] T 62c6c134d3d24a1ab144dd9ee6bc3f64 P 0473d2b2d01f4459b1e90fd12cc7840e [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:05:03.204049 19480 raft_consensus.cc:1275] T 46c5bfeecc314717bffe987e6844b6d0 P 0473d2b2d01f4459b1e90fd12cc7840e [term 7 FOLLOWER]: Refusing update from remote peer e61c3a8f61bb48f8a963c9480e53c168: Log matching property violated. Preceding OpId in replica: term: 5 index: 2. Preceding OpId from leader: term: 7 index: 3. (index mismatch)
I20260709 13:05:03.205750 19481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f93ee515a9c14139bf566522ed8232f3" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 7 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:05:03.206359 19481 raft_consensus.cc:2468] T f93ee515a9c14139bf566522ed8232f3 P 0473d2b2d01f4459b1e90fd12cc7840e [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 6.
I20260709 13:05:03.206799 20108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96efeaaf1057492490e9a621f37e1a2d" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:05:03.228211 19526 leader_election.cc:304] T 48824d5acfbc485ebf8c2d944e7202de P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e61c3a8f61bb48f8a963c9480e53c168; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, 127766fc592545a4997f7790f50f6076
I20260709 13:05:03.231716 21478 consensus_queue.cc:1059] T fa8650e71aa14778b3d73721fc50d9fc P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 }, Status: INVALID_TERM, Last received: 4.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:05:03.234275 21203 raft_consensus.cc:2749] T 48824d5acfbc485ebf8c2d944e7202de P e61c3a8f61bb48f8a963c9480e53c168 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:05:03.235687 19403 raft_consensus.cc:1240] T bc225c93219c45538b53a1bd3d387e4d P e5256d91808b47c195bc9b4dbd7f2b87 [term 7 FOLLOWER]: Rejecting Update request from peer e61c3a8f61bb48f8a963c9480e53c168 for earlier term 6. Current term is 7. Ops: []
I20260709 13:05:03.230057 19526 leader_election.cc:304] T 2725d2c4cb054f18b0fc8f735c15f6c2 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:05:03.237106 19408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df751f992649444090e27965eb1af85d" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:05:03.238854 19405 raft_consensus.cc:1275] T 3e1f505cb0f1427bbd698ac889d80821 P e5256d91808b47c195bc9b4dbd7f2b87 [term 4 FOLLOWER]: Refusing update from remote peer e61c3a8f61bb48f8a963c9480e53c168: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:05:03.238977 19558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7be9efa6559648dbb5a0f7684c4542d1" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:05:03.239697 19560 raft_consensus.cc:1240] T ef32ce6fdd0e40d382c79974f30295c6 P e61c3a8f61bb48f8a963c9480e53c168 [term 5 FOLLOWER]: Rejecting Update request from peer e5256d91808b47c195bc9b4dbd7f2b87 for earlier term 4. Current term is 5. Ops: []
I20260709 13:05:03.239965 19406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f93ee515a9c14139bf566522ed8232f3" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 7 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:05:03.235803 21115 raft_consensus.cc:1064] T ab43d85f64114d4ebf618930e43d9ed0 P e61c3a8f61bb48f8a963c9480e53c168: attempting to promote NON_VOTER 127766fc592545a4997f7790f50f6076 to VOTER
W20260709 13:05:03.241096 21115 raft_consensus.cc:1068] T ab43d85f64114d4ebf618930e43d9ed0 P e61c3a8f61bb48f8a963c9480e53c168: Unable to promote non-voter 127766fc592545a4997f7790f50f6076: Illegal state: Leader has not yet committed an operation in its own term
I20260709 13:05:03.241529 21406 raft_consensus.cc:2804] T 2725d2c4cb054f18b0fc8f735c15f6c2 P e61c3a8f61bb48f8a963c9480e53c168 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:05:03.241873 19403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40e1e16737a842ee936002830f36882e" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:05:03.241920 21406 raft_consensus.cc:493] T 2725d2c4cb054f18b0fc8f735c15f6c2 P e61c3a8f61bb48f8a963c9480e53c168 [term 3 FOLLOWER]: Starting leader election (detected failure of leader e5256d91808b47c195bc9b4dbd7f2b87)
I20260709 13:05:03.242556 21406 raft_consensus.cc:3060] T 2725d2c4cb054f18b0fc8f735c15f6c2 P e61c3a8f61bb48f8a963c9480e53c168 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:05:03.252393 19554 raft_consensus.cc:1240] T 14935b3ddf914369822e4a0547aaa355 P e61c3a8f61bb48f8a963c9480e53c168 [term 3 FOLLOWER]: Rejecting Update request from peer e5256d91808b47c195bc9b4dbd7f2b87 for earlier term 2. Current term is 3. Ops: []
I20260709 13:05:03.253103 19559 raft_consensus.cc:1240] T 70797e5783b5454ab0d0eea663e791e3 P e61c3a8f61bb48f8a963c9480e53c168 [term 4 FOLLOWER]: Rejecting Update request from peer e5256d91808b47c195bc9b4dbd7f2b87 for earlier term 3. Current term is 4. Ops: []
I20260709 13:05:03.255618 19560 raft_consensus.cc:1240] T 40e1e16737a842ee936002830f36882e P e61c3a8f61bb48f8a963c9480e53c168 [term 5 FOLLOWER]: Rejecting Update request from peer e5256d91808b47c195bc9b4dbd7f2b87 for earlier term 4. Current term is 5. Ops: []
I20260709 13:05:03.257499 19477 raft_consensus.cc:2468] T 62c6c134d3d24a1ab144dd9ee6bc3f64 P 0473d2b2d01f4459b1e90fd12cc7840e [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 6.
I20260709 13:05:03.259534 19480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df751f992649444090e27965eb1af85d" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:05:03.264017 19559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a16f7501e2444fb86d4e2778e734e02" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:05:03.266252 19483 raft_consensus.cc:2468] T 3e1f505cb0f1427bbd698ac889d80821 P 0473d2b2d01f4459b1e90fd12cc7840e [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 4.
W20260709 13:05:03.266423 19450 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.3:36891, user_credentials={real_user=slave}} blocked reactor thread for 43840.4us
I20260709 13:05:03.173956 21465 consensus_queue.cc:237] T 62c6c134d3d24a1ab144dd9ee6bc3f64 P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:05:03.268435 19478 raft_consensus.cc:1275] T 3e1f505cb0f1427bbd698ac889d80821 P 0473d2b2d01f4459b1e90fd12cc7840e [term 4 FOLLOWER]: Refusing update from remote peer e61c3a8f61bb48f8a963c9480e53c168: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
W20260709 13:05:03.268935 20077 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:03.270897 19526 leader_election.cc:304] T 0e1085d23e8347fbbd5bce7542f4b1f4 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e61c3a8f61bb48f8a963c9480e53c168; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, 127766fc592545a4997f7790f50f6076
W20260709 13:05:03.274531 19377 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:03.273635 19480 raft_consensus.cc:2468] T df751f992649444090e27965eb1af85d P 0473d2b2d01f4459b1e90fd12cc7840e [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 4.
I20260709 13:05:03.276924 19479 raft_consensus.cc:1240] T d1e5873a19244c5ebbcd38e126796ee7 P 0473d2b2d01f4459b1e90fd12cc7840e [term 5 FOLLOWER]: Rejecting Update request from peer e61c3a8f61bb48f8a963c9480e53c168 for earlier term 4. Current term is 5. Ops: []
I20260709 13:05:03.279008 19559 raft_consensus.cc:1240] T 14935b3ddf914369822e4a0547aaa355 P e61c3a8f61bb48f8a963c9480e53c168 [term 3 FOLLOWER]: Rejecting Update request from peer e5256d91808b47c195bc9b4dbd7f2b87 for earlier term 2. Current term is 3. Ops: []
I20260709 13:05:03.270529 21346 raft_consensus.cc:493] T b9f0d59553ad444883fcf5b5909f9798 P e5256d91808b47c195bc9b4dbd7f2b87 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 0473d2b2d01f4459b1e90fd12cc7840e)
I20260709 13:05:03.282111 19560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc225c93219c45538b53a1bd3d387e4d" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 7 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:05:03.281085 19450 leader_election.cc:304] T 48824d5acfbc485ebf8c2d944e7202de P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168; no voters: 127766fc592545a4997f7790f50f6076
I20260709 13:05:03.287016 21346 raft_consensus.cc:515] T b9f0d59553ad444883fcf5b5909f9798 P e5256d91808b47c195bc9b4dbd7f2b87 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:03.287987 21523 raft_consensus.cc:2749] T 0e1085d23e8347fbbd5bce7542f4b1f4 P e61c3a8f61bb48f8a963c9480e53c168 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:05:03.289203 21346 leader_election.cc:290] T b9f0d59553ad444883fcf5b5909f9798 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:05:03.292080 21523 consensus_queue.cc:1059] T 21e14947d70440f19044d8f75c31e1f9 P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:05:03.293025 19482 raft_consensus.cc:1275] T bc225c93219c45538b53a1bd3d387e4d P 0473d2b2d01f4459b1e90fd12cc7840e [term 6 FOLLOWER]: Refusing update from remote peer e61c3a8f61bb48f8a963c9480e53c168: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 3. (term mismatch)
I20260709 13:05:03.293413 21115 raft_consensus.cc:3055] T 21e14947d70440f19044d8f75c31e1f9 P e61c3a8f61bb48f8a963c9480e53c168 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:05:03.288687 21336 raft_consensus.cc:515] T 0afb57ae58a24a01850491d69f0213dd P e61c3a8f61bb48f8a963c9480e53c168 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:05:03.293455 19482 pending_rounds.cc:85] T bc225c93219c45538b53a1bd3d387e4d P 0473d2b2d01f4459b1e90fd12cc7840e: Aborting all ops after (but not including) 2
I20260709 13:05:03.296257 19559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76cb037fc9064d13b59a8969d897ce8c" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:05:03.297668 19482 pending_rounds.cc:107] T bc225c93219c45538b53a1bd3d387e4d P 0473d2b2d01f4459b1e90fd12cc7840e: Aborting uncommitted NO_OP operation due to leader change: 5.3
I20260709 13:05:03.297999 19482 raft_consensus.cc:2889] T bc225c93219c45538b53a1bd3d387e4d P 0473d2b2d01f4459b1e90fd12cc7840e [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:05:03.296787 19526 leader_election.cc:304] T ef32ce6fdd0e40d382c79974f30295c6 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:05:03.304143 21430 raft_consensus.cc:2804] T 48824d5acfbc485ebf8c2d944e7202de P 0473d2b2d01f4459b1e90fd12cc7840e [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:05:03.304441 19449 leader_election.cc:304] T 21e14947d70440f19044d8f75c31e1f9 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87; no voters: 
I20260709 13:05:03.304605 21430 raft_consensus.cc:493] T 48824d5acfbc485ebf8c2d944e7202de P 0473d2b2d01f4459b1e90fd12cc7840e [term 2 FOLLOWER]: Starting leader election (detected failure of leader 127766fc592545a4997f7790f50f6076)
I20260709 13:05:03.305068 21430 raft_consensus.cc:3060] T 48824d5acfbc485ebf8c2d944e7202de P 0473d2b2d01f4459b1e90fd12cc7840e [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:03.306730 21523 raft_consensus.cc:2804] T ef32ce6fdd0e40d382c79974f30295c6 P e61c3a8f61bb48f8a963c9480e53c168 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:05:03.307219 21523 raft_consensus.cc:697] T ef32ce6fdd0e40d382c79974f30295c6 P e61c3a8f61bb48f8a963c9480e53c168 [term 5 LEADER]: Becoming Leader. State: Replica: e61c3a8f61bb48f8a963c9480e53c168, State: Running, Role: LEADER
I20260709 13:05:03.307773 21444 raft_consensus.cc:2804] T 21e14947d70440f19044d8f75c31e1f9 P 0473d2b2d01f4459b1e90fd12cc7840e [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:05:03.308257 21523 consensus_queue.cc:237] T ef32ce6fdd0e40d382c79974f30295c6 P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:03.308934 19554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65d8cb8d6ec64f459d5a47cefab10acf" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:05:03.307034 21088 consensus_queue.cc:1048] T b08304a0a02b42d7840c4e8ee9a6bd1a P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:05:03.279929 21338 consensus_queue.cc:1059] T 2e36a9d6e29c4a7c860cf267efbd4c74 P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.020s
I20260709 13:05:03.296046 21115 raft_consensus.cc:740] T 21e14947d70440f19044d8f75c31e1f9 P e61c3a8f61bb48f8a963c9480e53c168 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: e61c3a8f61bb48f8a963c9480e53c168, State: Running, Role: LEADER
I20260709 13:05:03.319478 19523 leader_election.cc:304] T e381f1d6b8184797ad142de49be225a8 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e61c3a8f61bb48f8a963c9480e53c168; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87
W20260709 13:05:03.325073 20075 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.1:40321, user_credentials={real_user=slave}} blocked reactor thread for 95262.4us
I20260709 13:05:03.325858 21338 raft_consensus.cc:3055] T 2e36a9d6e29c4a7c860cf267efbd4c74 P 0473d2b2d01f4459b1e90fd12cc7840e [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:05:03.326267 21338 raft_consensus.cc:740] T 2e36a9d6e29c4a7c860cf267efbd4c74 P 0473d2b2d01f4459b1e90fd12cc7840e [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 0473d2b2d01f4459b1e90fd12cc7840e, State: Running, Role: LEADER
I20260709 13:05:03.327184 21338 consensus_queue.cc:260] T 2e36a9d6e29c4a7c860cf267efbd4c74 P 0473d2b2d01f4459b1e90fd12cc7840e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:03.328107 19551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e36a9d6e29c4a7c860cf267efbd4c74" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:05:03.328611 21338 raft_consensus.cc:3060] T 2e36a9d6e29c4a7c860cf267efbd4c74 P 0473d2b2d01f4459b1e90fd12cc7840e [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:03.301033 20108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "172b3dd13109415a955b71ac0e9d2234" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:05:03.335631 21346 raft_consensus.cc:493] T f1b10566f45d4a7d9029858330e02d5b P e5256d91808b47c195bc9b4dbd7f2b87 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 0473d2b2d01f4459b1e90fd12cc7840e)
I20260709 13:05:03.331351 21115 consensus_queue.cc:260] T 21e14947d70440f19044d8f75c31e1f9 P e61c3a8f61bb48f8a963c9480e53c168 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
W20260709 13:05:03.342056 19450 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.3:36891, user_credentials={real_user=slave}} blocked reactor thread for 69167.1us
W20260709 13:05:03.349881 19526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.2:46257, user_credentials={real_user=slave}} blocked reactor thread for 47931.6us
I20260709 13:05:03.336508 21346 raft_consensus.cc:515] T f1b10566f45d4a7d9029858330e02d5b P e5256d91808b47c195bc9b4dbd7f2b87 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:03.383095 19450 leader_election.cc:304] T 14935b3ddf914369822e4a0547aaa355 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e; no voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:05:03.384087 21115 raft_consensus.cc:3060] T 21e14947d70440f19044d8f75c31e1f9 P e61c3a8f61bb48f8a963c9480e53c168 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:05:03.390249 19450 leader_election.cc:304] T 2725d2c4cb054f18b0fc8f735c15f6c2 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e; no voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:05:03.391074 19560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9f0d59553ad444883fcf5b5909f9798" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
W20260709 13:05:03.392271 19449 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.1:40321, user_credentials={real_user=slave}} blocked reactor thread for 86974.1us
I20260709 13:05:03.392509 19560 raft_consensus.cc:2393] T b9f0d59553ad444883fcf5b5909f9798 P e61c3a8f61bb48f8a963c9480e53c168 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e5256d91808b47c195bc9b4dbd7f2b87 in current term 4: Already voted for candidate e61c3a8f61bb48f8a963c9480e53c168 in this term.
W20260709 13:05:03.395372 19451 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:03.403105 21471 raft_consensus.cc:2749] T 2725d2c4cb054f18b0fc8f735c15f6c2 P 0473d2b2d01f4459b1e90fd12cc7840e [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:05:03.459787 21336 leader_election.cc:290] T 0afb57ae58a24a01850491d69f0213dd P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 5 election: Requested vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:05:03.452741 21346 leader_election.cc:290] T f1b10566f45d4a7d9029858330e02d5b P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:05:03.455518 21203 raft_consensus.cc:3055] T fa8650e71aa14778b3d73721fc50d9fc P e61c3a8f61bb48f8a963c9480e53c168 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:05:03.462044 19375 leader_election.cc:304] T 7be9efa6559648dbb5a0f7684c4542d1 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:05:03.396126 21524 raft_consensus.cc:2749] T e381f1d6b8184797ad142de49be225a8 P e61c3a8f61bb48f8a963c9480e53c168 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:05:03.373466 21444 raft_consensus.cc:697] T 21e14947d70440f19044d8f75c31e1f9 P 0473d2b2d01f4459b1e90fd12cc7840e [term 5 LEADER]: Becoming Leader. State: Replica: 0473d2b2d01f4459b1e90fd12cc7840e, State: Running, Role: LEADER
I20260709 13:05:03.469017 21444 consensus_queue.cc:237] T 21e14947d70440f19044d8f75c31e1f9 P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
W20260709 13:05:03.448531 19449 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.1:40321, user_credentials={real_user=slave}} blocked reactor thread for 52565.1us
W20260709 13:05:03.460877 19523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.1:40321, user_credentials={real_user=slave}} blocked reactor thread for 161543us
W20260709 13:05:03.464072 19450 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.3:36891, user_credentials={real_user=slave}} blocked reactor thread for 73914.4us
I20260709 13:05:03.475965 19450 leader_election.cc:304] T 3e1f505cb0f1427bbd698ac889d80821 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e; no voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:05:03.462527 21406 raft_consensus.cc:515] T 2725d2c4cb054f18b0fc8f735c15f6c2 P e61c3a8f61bb48f8a963c9480e53c168 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:03.476836 21471 raft_consensus.cc:2749] T 3e1f505cb0f1427bbd698ac889d80821 P 0473d2b2d01f4459b1e90fd12cc7840e [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:05:03.393409 21088 raft_consensus.cc:3060] T 14935b3ddf914369822e4a0547aaa355 P 0473d2b2d01f4459b1e90fd12cc7840e [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:03.467134 21203 raft_consensus.cc:740] T fa8650e71aa14778b3d73721fc50d9fc P e61c3a8f61bb48f8a963c9480e53c168 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: e61c3a8f61bb48f8a963c9480e53c168, State: Running, Role: LEADER
I20260709 13:05:03.464438 21201 raft_consensus.cc:493] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P 0473d2b2d01f4459b1e90fd12cc7840e [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:03.478848 21203 consensus_queue.cc:260] T fa8650e71aa14778b3d73721fc50d9fc P e61c3a8f61bb48f8a963c9480e53c168 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.2, Last appended by leader: 2, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:03.480055 21203 raft_consensus.cc:3060] T fa8650e71aa14778b3d73721fc50d9fc P e61c3a8f61bb48f8a963c9480e53c168 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:05:03.474220 19523 leader_election.cc:304] T 4af19371ea874c09a0a2147040835cbb P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168; no voters: 127766fc592545a4997f7790f50f6076
I20260709 13:05:03.484086 19558 raft_consensus.cc:1240] T 2725d2c4cb054f18b0fc8f735c15f6c2 P e61c3a8f61bb48f8a963c9480e53c168 [term 4 FOLLOWER]: Rejecting Update request from peer e5256d91808b47c195bc9b4dbd7f2b87 for earlier term 3. Current term is 4. Ops: []
I20260709 13:05:03.484582 21336 raft_consensus.cc:2804] T 4af19371ea874c09a0a2147040835cbb P e61c3a8f61bb48f8a963c9480e53c168 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:05:03.485044 21336 raft_consensus.cc:493] T 4af19371ea874c09a0a2147040835cbb P e61c3a8f61bb48f8a963c9480e53c168 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 127766fc592545a4997f7790f50f6076)
I20260709 13:05:03.485508 21336 raft_consensus.cc:3060] T 4af19371ea874c09a0a2147040835cbb P e61c3a8f61bb48f8a963c9480e53c168 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:03.498951 19523 leader_election.cc:304] T 2e36a9d6e29c4a7c860cf267efbd4c74 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e61c3a8f61bb48f8a963c9480e53c168; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:05:03.457930 21430 raft_consensus.cc:515] T 48824d5acfbc485ebf8c2d944e7202de P 0473d2b2d01f4459b1e90fd12cc7840e [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:05:03.509670 21415 raft_consensus.cc:2749] T 7be9efa6559648dbb5a0f7684c4542d1 P e5256d91808b47c195bc9b4dbd7f2b87 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 13:05:03.511034 19375 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.3:36891, user_credentials={real_user=slave}} blocked reactor thread for 114579us
I20260709 13:05:03.513044 21342 consensus_queue.cc:1059] T ef32ce6fdd0e40d382c79974f30295c6 P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:05:03.513311 19375 leader_election.cc:304] T 2a16f7501e2444fb86d4e2778e734e02 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87; no voters: 127766fc592545a4997f7790f50f6076, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:05:03.513041 21430 leader_election.cc:290] T 48824d5acfbc485ebf8c2d944e7202de P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 3 election: Requested vote from peers e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:05:03.533702 19523 leader_election.cc:304] T 76cb037fc9064d13b59a8969d897ce8c P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e61c3a8f61bb48f8a963c9480e53c168; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:05:03.536252 21430 raft_consensus.cc:493] T b9f0d59553ad444883fcf5b5909f9798 P 0473d2b2d01f4459b1e90fd12cc7840e [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:05:03.547873 19526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.2:46257, user_credentials={real_user=slave}} blocked reactor thread for 167052us
I20260709 13:05:03.555619 19526 leader_election.cc:304] T f93ee515a9c14139bf566522ed8232f3 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:05:03.514405 21201 raft_consensus.cc:515] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P 0473d2b2d01f4459b1e90fd12cc7840e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:05:03.533560 21529 raft_consensus.cc:2749] T 2e36a9d6e29c4a7c860cf267efbd4c74 P e61c3a8f61bb48f8a963c9480e53c168 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:05:03.536898 21430 raft_consensus.cc:515] T b9f0d59553ad444883fcf5b5909f9798 P 0473d2b2d01f4459b1e90fd12cc7840e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:03.558553 21478 raft_consensus.cc:2804] T f93ee515a9c14139bf566522ed8232f3 P e61c3a8f61bb48f8a963c9480e53c168 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:05:03.559938 21088 raft_consensus.cc:2749] T 14935b3ddf914369822e4a0547aaa355 P 0473d2b2d01f4459b1e90fd12cc7840e [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:05:03.560031 21524 raft_consensus.cc:2749] T 76cb037fc9064d13b59a8969d897ce8c P e61c3a8f61bb48f8a963c9480e53c168 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:05:03.560222 19526 leader_election.cc:304] T df751f992649444090e27965eb1af85d P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:05:03.558372 21406 leader_election.cc:290] T 2725d2c4cb054f18b0fc8f735c15f6c2 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 4 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:05:03.557467 19450 leader_election.cc:304] T d1e5873a19244c5ebbcd38e126796ee7 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e; no voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:05:03.533865 21415 consensus_queue.cc:1059] T 40e1e16737a842ee936002830f36882e P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.024s
I20260709 13:05:03.564836 19523 leader_election.cc:304] T 0cdf56e38bbc453d9438d359e5a69955 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e61c3a8f61bb48f8a963c9480e53c168; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:05:03.556089 21411 raft_consensus.cc:2749] T 2a16f7501e2444fb86d4e2778e734e02 P e5256d91808b47c195bc9b4dbd7f2b87 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:05:03.566480 21201 leader_election.cc:290] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:05:03.576606 21203 raft_consensus.cc:2804] T df751f992649444090e27965eb1af85d P e61c3a8f61bb48f8a963c9480e53c168 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:05:03.568192 20105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36f6ba92b9ba46babe4ebd6c02e5fbd9" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 7 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:05:03.577039 21203 raft_consensus.cc:493] T df751f992649444090e27965eb1af85d P e61c3a8f61bb48f8a963c9480e53c168 [term 4 FOLLOWER]: Starting leader election (detected failure of leader e5256d91808b47c195bc9b4dbd7f2b87)
I20260709 13:05:03.577476 21203 raft_consensus.cc:3060] T df751f992649444090e27965eb1af85d P e61c3a8f61bb48f8a963c9480e53c168 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:05:03.569681 21430 leader_election.cc:290] T b9f0d59553ad444883fcf5b5909f9798 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:05:03.569979 19406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36f6ba92b9ba46babe4ebd6c02e5fbd9" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 7 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:05:03.571038 19402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9f0d59553ad444883fcf5b5909f9798" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:05:03.578941 19402 raft_consensus.cc:2468] T b9f0d59553ad444883fcf5b5909f9798 P e5256d91808b47c195bc9b4dbd7f2b87 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 3.
I20260709 13:05:03.555564 21465 raft_consensus.cc:493] T 217b5fae677b4971b3bbd2f357a1f7ff P e61c3a8f61bb48f8a963c9480e53c168 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 0473d2b2d01f4459b1e90fd12cc7840e)
I20260709 13:05:03.579879 21465 raft_consensus.cc:515] T 217b5fae677b4971b3bbd2f357a1f7ff P e61c3a8f61bb48f8a963c9480e53c168 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:03.581869 21465 leader_election.cc:290] T 217b5fae677b4971b3bbd2f357a1f7ff P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:05:03.583376 19450 leader_election.cc:304] T a08760e15aac4630a629431f56024dc8 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168; no voters: e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:05:03.583807 19406 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0cdf56e38bbc453d9438d359e5a69955"
dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
mode: GRACEFUL
new_leader_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
 from {username='slave'} at 127.0.0.1:37312
I20260709 13:05:03.584107 21201 raft_consensus.cc:2749] T d1e5873a19244c5ebbcd38e126796ee7 P 0473d2b2d01f4459b1e90fd12cc7840e [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:05:03.584607 19406 raft_consensus.cc:606] T 0cdf56e38bbc453d9438d359e5a69955 P e5256d91808b47c195bc9b4dbd7f2b87 [term 4 LEADER]: Received request to transfer leadership to TS e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:05:03.584934 21201 raft_consensus.cc:2804] T a08760e15aac4630a629431f56024dc8 P 0473d2b2d01f4459b1e90fd12cc7840e [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:05:03.585345 21201 raft_consensus.cc:493] T a08760e15aac4630a629431f56024dc8 P 0473d2b2d01f4459b1e90fd12cc7840e [term 3 FOLLOWER]: Starting leader election (detected failure of leader e5256d91808b47c195bc9b4dbd7f2b87)
I20260709 13:05:03.585700 21201 raft_consensus.cc:3060] T a08760e15aac4630a629431f56024dc8 P 0473d2b2d01f4459b1e90fd12cc7840e [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:05:03.587349 19560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22196caba61445d3bec98a0aab3c337d" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:05:03.587608 21415 raft_consensus.cc:3055] T 40e1e16737a842ee936002830f36882e P e5256d91808b47c195bc9b4dbd7f2b87 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:05:03.588006 21415 raft_consensus.cc:740] T 40e1e16737a842ee936002830f36882e P e5256d91808b47c195bc9b4dbd7f2b87 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: e5256d91808b47c195bc9b4dbd7f2b87, State: Running, Role: LEADER
I20260709 13:05:03.588730 19551 raft_consensus.cc:3060] T b08304a0a02b42d7840c4e8ee9a6bd1a P e61c3a8f61bb48f8a963c9480e53c168 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:05:03.589417 21336 raft_consensus.cc:515] T 4af19371ea874c09a0a2147040835cbb P e61c3a8f61bb48f8a963c9480e53c168 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:05:03.591457 21336 leader_election.cc:290] T 4af19371ea874c09a0a2147040835cbb P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 3 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:05:03.593020 20078 leader_election.cc:304] T 14efcc79969f41babe5529c22d59156d P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 127766fc592545a4997f7790f50f6076; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:05:03.593760 19405 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "21e14947d70440f19044d8f75c31e1f9"
dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
mode: GRACEFUL
new_leader_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
 from {username='slave'} at 127.0.0.1:37312
I20260709 13:05:03.594311 19405 raft_consensus.cc:606] T 21e14947d70440f19044d8f75c31e1f9 P e5256d91808b47c195bc9b4dbd7f2b87 [term 5 FOLLOWER]: Received request to transfer leadership to TS e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:05:03.594619 19405 raft_consensus.cc:614] T 21e14947d70440f19044d8f75c31e1f9 P e5256d91808b47c195bc9b4dbd7f2b87 [term 5 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:05:03.594682 21520 raft_consensus.cc:2749] T 14efcc79969f41babe5529c22d59156d P 127766fc592545a4997f7790f50f6076 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:05:03.595023 19559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1b10566f45d4a7d9029858330e02d5b" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:05:03.562911 20108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48824d5acfbc485ebf8c2d944e7202de" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076"
I20260709 13:05:03.595661 19559 raft_consensus.cc:2468] T f1b10566f45d4a7d9029858330e02d5b P e61c3a8f61bb48f8a963c9480e53c168 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 5.
I20260709 13:05:03.563797 21478 raft_consensus.cc:493] T f93ee515a9c14139bf566522ed8232f3 P e61c3a8f61bb48f8a963c9480e53c168 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:03.596748 21478 raft_consensus.cc:3060] T f93ee515a9c14139bf566522ed8232f3 P e61c3a8f61bb48f8a963c9480e53c168 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:05:03.597461 19449 leader_election.cc:304] T b9f0d59553ad444883fcf5b5909f9798 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87; no voters: 
I20260709 13:05:03.598027 19557 raft_consensus.cc:1240] T bc225c93219c45538b53a1bd3d387e4d P e61c3a8f61bb48f8a963c9480e53c168 [term 6 LEADER]: Rejecting Update request from peer 0473d2b2d01f4459b1e90fd12cc7840e for earlier term 5. Current term is 6. Ops: []
I20260709 13:05:03.588758 21415 consensus_queue.cc:260] T 40e1e16737a842ee936002830f36882e P e5256d91808b47c195bc9b4dbd7f2b87 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:03.599452 21372 raft_consensus.cc:2804] T b9f0d59553ad444883fcf5b5909f9798 P 0473d2b2d01f4459b1e90fd12cc7840e [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:05:03.599874 21372 raft_consensus.cc:493] T b9f0d59553ad444883fcf5b5909f9798 P 0473d2b2d01f4459b1e90fd12cc7840e [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:03.600288 21415 raft_consensus.cc:3060] T 40e1e16737a842ee936002830f36882e P e5256d91808b47c195bc9b4dbd7f2b87 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:05:03.601465 19402 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "28af091831594f9d8e96482078cc7625"
dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
mode: GRACEFUL
new_leader_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
 from {username='slave'} at 127.0.0.1:37312
I20260709 13:05:03.602039 19402 raft_consensus.cc:606] T 28af091831594f9d8e96482078cc7625 P e5256d91808b47c195bc9b4dbd7f2b87 [term 6 FOLLOWER]: Received request to transfer leadership to TS e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:05:03.602381 19402 raft_consensus.cc:614] T 28af091831594f9d8e96482078cc7625 P e5256d91808b47c195bc9b4dbd7f2b87 [term 6 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:05:03.604791 19523 leader_election.cc:304] T 28af091831594f9d8e96482078cc7625 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e61c3a8f61bb48f8a963c9480e53c168; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:05:03.600214 21372 raft_consensus.cc:3060] T b9f0d59553ad444883fcf5b5909f9798 P 0473d2b2d01f4459b1e90fd12cc7840e [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:05:03.598387 19449 leader_election.cc:304] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e; no voters: 127766fc592545a4997f7790f50f6076, e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:05:03.606220 19551 raft_consensus.cc:1275] T b08304a0a02b42d7840c4e8ee9a6bd1a P e61c3a8f61bb48f8a963c9480e53c168 [term 5 FOLLOWER]: Refusing update from remote peer 0473d2b2d01f4459b1e90fd12cc7840e: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:05:03.615468 19552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21e14947d70440f19044d8f75c31e1f9" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:05:03.616411 19552 raft_consensus.cc:2410] T 21e14947d70440f19044d8f75c31e1f9 P e61c3a8f61bb48f8a963c9480e53c168 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 0473d2b2d01f4459b1e90fd12cc7840e for term 5 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 13:05:03.616467 19523 leader_election.cc:304] T 7be9efa6559648dbb5a0f7684c4542d1 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e61c3a8f61bb48f8a963c9480e53c168; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:05:03.617102 21115 raft_consensus.cc:2749] T 0cdf56e38bbc453d9438d359e5a69955 P e61c3a8f61bb48f8a963c9480e53c168 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:05:03.617465 19304 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:51954 (request call id 127) took 5593 ms. Trace:
I20260709 13:05:03.617830 21115 raft_consensus.cc:2749] T 28af091831594f9d8e96482078cc7625 P e61c3a8f61bb48f8a963c9480e53c168 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:05:03.618822 21088 raft_consensus.cc:2749] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P 0473d2b2d01f4459b1e90fd12cc7840e [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:05:03.619092 19559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96efeaaf1057492490e9a621f37e1a2d" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:05:03.619976 21358 raft_consensus.cc:3055] T ef32ce6fdd0e40d382c79974f30295c6 P e5256d91808b47c195bc9b4dbd7f2b87 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:05:03.620344 21358 raft_consensus.cc:740] T ef32ce6fdd0e40d382c79974f30295c6 P e5256d91808b47c195bc9b4dbd7f2b87 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: e5256d91808b47c195bc9b4dbd7f2b87, State: Running, Role: LEADER
I20260709 13:05:03.620573 19551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa8650e71aa14778b3d73721fc50d9fc" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:05:03.621439 21524 raft_consensus.cc:2749] T 7be9efa6559648dbb5a0f7684c4542d1 P e61c3a8f61bb48f8a963c9480e53c168 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:05:03.621206 21358 consensus_queue.cc:260] T ef32ce6fdd0e40d382c79974f30295c6 P e5256d91808b47c195bc9b4dbd7f2b87 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:03.620344 19560 raft_consensus.cc:1240] T 1a61655d99124a29b486ba4a5b37faea P e61c3a8f61bb48f8a963c9480e53c168 [term 2 FOLLOWER]: Rejecting Update request from peer 0473d2b2d01f4459b1e90fd12cc7840e for earlier term 1. Current term is 2. Ops: []
I20260709 13:05:03.618429 19555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48824d5acfbc485ebf8c2d944e7202de" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
W20260709 13:05:03.626785 19375 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.3:36891, user_credentials={real_user=slave}} blocked reactor thread for 113542us
I20260709 13:05:03.627334 19551 raft_consensus.cc:2468] T fa8650e71aa14778b3d73721fc50d9fc P e61c3a8f61bb48f8a963c9480e53c168 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 5.
W20260709 13:05:03.629583 19526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.2:46257, user_credentials={real_user=slave}} blocked reactor thread for 54007.9us
I20260709 13:05:03.622452 21358 raft_consensus.cc:3060] T ef32ce6fdd0e40d382c79974f30295c6 P e5256d91808b47c195bc9b4dbd7f2b87 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:05:03.624804 19556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9f0d59553ad444883fcf5b5909f9798" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:05:03.633705 21406 consensus_queue.cc:1059] T d1e5873a19244c5ebbcd38e126796ee7 P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.005s
I20260709 13:05:03.639901 21336 raft_consensus.cc:3055] T d1e5873a19244c5ebbcd38e126796ee7 P e61c3a8f61bb48f8a963c9480e53c168 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:05:03.637179 19556 raft_consensus.cc:2468] T b9f0d59553ad444883fcf5b5909f9798 P e61c3a8f61bb48f8a963c9480e53c168 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 4.
I20260709 13:05:03.640278 21336 raft_consensus.cc:740] T d1e5873a19244c5ebbcd38e126796ee7 P e61c3a8f61bb48f8a963c9480e53c168 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: e61c3a8f61bb48f8a963c9480e53c168, State: Running, Role: LEADER
I20260709 13:05:03.641230 21336 consensus_queue.cc:260] T d1e5873a19244c5ebbcd38e126796ee7 P e61c3a8f61bb48f8a963c9480e53c168 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:03.642406 21336 raft_consensus.cc:3060] T d1e5873a19244c5ebbcd38e126796ee7 P e61c3a8f61bb48f8a963c9480e53c168 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:05:03.645172 21411 consensus_queue.cc:1059] T 14935b3ddf914369822e4a0547aaa355 P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:05:03.646438 21537 raft_consensus.cc:3055] T 14935b3ddf914369822e4a0547aaa355 P e5256d91808b47c195bc9b4dbd7f2b87 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:05:03.646852 21537 raft_consensus.cc:740] T 14935b3ddf914369822e4a0547aaa355 P e5256d91808b47c195bc9b4dbd7f2b87 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: e5256d91808b47c195bc9b4dbd7f2b87, State: Running, Role: LEADER
I20260709 13:05:03.647650 21537 consensus_queue.cc:260] T 14935b3ddf914369822e4a0547aaa355 P e5256d91808b47c195bc9b4dbd7f2b87 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.4, Last appended by leader: 4, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } attrs { replace: true } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:05:03.649138 21537 raft_consensus.cc:3060] T 14935b3ddf914369822e4a0547aaa355 P e5256d91808b47c195bc9b4dbd7f2b87 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:03.651491 21533 consensus_queue.cc:1048] T 46c5bfeecc314717bffe987e6844b6d0 P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.091s
I20260709 13:05:03.617835 19304 rpcz_store.cc:276] 0709 13:04:58.024197 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:58.024373 (+   176us) service_pool.cc:224] Handling call
0709 13:05:03.617375 (+5593002us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:05:02.859315 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:05:02.949073 (+ 89758us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:05:02.958962 (+  9889us) write_op.cc:435] Acquired schema lock
0709 13:05:02.960737 (+  1775us) tablet.cc:662] Decoding operations
0709 13:05:03.022487 (+ 61750us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:05:03.034558 (+ 12071us) write_op.cc:641] Partition lock acquired for write op
0709 13:05:03.035933 (+  1375us) tablet.cc:685] Acquiring locks for 9 operations
0709 13:05:03.045180 (+  9247us) tablet.cc:701] Row locks acquired
0709 13:05:03.058851 (+ 13671us) write_op.cc:260] PREPARE: finished
0709 13:05:03.059011 (+   160us) write_op.cc:270] Start()
0709 13:05:03.059161 (+   150us) write_op.cc:276] Timestamp: P: 1783602303058948 usec, L: 0
0709 13:05:03.059194 (+    33us) op_driver.cc:348] REPLICATION: starting
0709 13:05:03.059947 (+   753us) log.cc:844] Serialized 3698 byte log entry
0709 13:05:03.319100 (+259153us) op_driver.cc:464] REPLICATION: finished
0709 13:05:03.401358 (+ 82258us) write_op.cc:301] APPLY: starting
0709 13:05:03.450503 (+ 49145us) tablet.cc:1367] starting BulkCheckPresence
0709 13:05:03.450759 (+   256us) tablet.cc:1370] finished BulkCheckPresence
0709 13:05:03.450900 (+   141us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:05:03.452124 (+  1224us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:05:03.452397 (+   273us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=9
0709 13:05:03.452458 (+    61us) write_op.cc:312] APPLY: finished
0709 13:05:03.452783 (+   325us) log.cc:844] Serialized 71 byte log entry
0709 13:05:03.453599 (+   816us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:05:03.453724 (+   125us) write_op.cc:454] Released schema lock
0709 13:05:03.453782 (+    58us) write_op.cc:341] FINISH: Updating metrics
0709 13:05:03.461521 (+  7739us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:05:03.461550 (+    29us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":3534067,"reported_tablets":12,"child_traces":[["op",{"apply.queue_time_us":67306,"apply.run_cpu_time_us":11614,"apply.run_wall_time_us":69655,"num_ops":9,"prepare.queue_time_us":126622,"prepare.run_cpu_time_us":30609,"prepare.run_wall_time_us":302667,"raft.queue_time_us":113151,"raft.run_cpu_time_us":12195,"raft.run_wall_time_us":75023,"replication_time_us":243826,"thread_start_us":273315,"threads_started":4,"wal-append.queue_time_us":110665}]]}
I20260709 13:05:03.655081 19375 leader_election.cc:304] T 65d8cb8d6ec64f459d5a47cefab10acf P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87; no voters: 127766fc592545a4997f7790f50f6076, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:05:03.655797 21535 raft_consensus.cc:2749] T 65d8cb8d6ec64f459d5a47cefab10acf P e5256d91808b47c195bc9b4dbd7f2b87 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:05:03.656076 21478 raft_consensus.cc:515] T f93ee515a9c14139bf566522ed8232f3 P e61c3a8f61bb48f8a963c9480e53c168 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:03.658413 21478 leader_election.cc:290] T f93ee515a9c14139bf566522ed8232f3 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 7 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:05:03.659039 21346 raft_consensus.cc:993] T 0cdf56e38bbc453d9438d359e5a69955 P e5256d91808b47c195bc9b4dbd7f2b87: : Instructing follower e61c3a8f61bb48f8a963c9480e53c168 to start an election
I20260709 13:05:03.661600 21537 raft_consensus.cc:1081] T 0cdf56e38bbc453d9438d359e5a69955 P e5256d91808b47c195bc9b4dbd7f2b87 [term 4 LEADER]: Signalling peer e61c3a8f61bb48f8a963c9480e53c168 to start an election
I20260709 13:05:03.660575 21203 raft_consensus.cc:515] T df751f992649444090e27965eb1af85d P e61c3a8f61bb48f8a963c9480e53c168 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:03.663594 21203 leader_election.cc:290] T df751f992649444090e27965eb1af85d P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 5 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:05:03.664603 19556 raft_consensus.cc:1240] T f93ee515a9c14139bf566522ed8232f3 P e61c3a8f61bb48f8a963c9480e53c168 [term 7 FOLLOWER]: Rejecting Update request from peer e5256d91808b47c195bc9b4dbd7f2b87 for earlier term 6. Current term is 7. Ops: []
I20260709 13:05:03.664690 19482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0afb57ae58a24a01850491d69f0213dd" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:05:03.670701 19485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9f0d59553ad444883fcf5b5909f9798" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:05:03.671159 19482 raft_consensus.cc:2393] T 0afb57ae58a24a01850491d69f0213dd P 0473d2b2d01f4459b1e90fd12cc7840e [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 127766fc592545a4997f7790f50f6076 in current term 4: Already voted for candidate 0473d2b2d01f4459b1e90fd12cc7840e in this term.
I20260709 13:05:03.671027 19483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "217b5fae677b4971b3bbd2f357a1f7ff" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:05:03.665005 19551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1b10566f45d4a7d9029858330e02d5b" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:05:03.671940 19551 raft_consensus.cc:2393] T f1b10566f45d4a7d9029858330e02d5b P e61c3a8f61bb48f8a963c9480e53c168 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e5256d91808b47c195bc9b4dbd7f2b87 in current term 5: Already voted for candidate e61c3a8f61bb48f8a963c9480e53c168 in this term.
I20260709 13:05:03.665663 19478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "172b3dd13109415a955b71ac0e9d2234" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:05:03.666018 19377 leader_election.cc:304] T bc225c93219c45538b53a1bd3d387e4d P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:05:03.666250 21444 raft_consensus.cc:493] T 46c5bfeecc314717bffe987e6844b6d0 P 0473d2b2d01f4459b1e90fd12cc7840e [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:03.674861 19551 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "0cdf56e38bbc453d9438d359e5a69955"
dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
 from {username='slave'} at 127.0.0.1:40438
I20260709 13:05:03.675010 21444 raft_consensus.cc:515] T 46c5bfeecc314717bffe987e6844b6d0 P 0473d2b2d01f4459b1e90fd12cc7840e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:03.666970 21415 consensus_queue.cc:1059] T 2725d2c4cb054f18b0fc8f735c15f6c2 P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:05:03.668687 19479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0afb57ae58a24a01850491d69f0213dd" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:05:03.668828 21533 consensus_queue.cc:1048] T 3e1f505cb0f1427bbd698ac889d80821 P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:03.669601 19480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2725d2c4cb054f18b0fc8f735c15f6c2" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:05:03.680491 21372 raft_consensus.cc:515] T b9f0d59553ad444883fcf5b5909f9798 P 0473d2b2d01f4459b1e90fd12cc7840e [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:03.673245 19481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1b10566f45d4a7d9029858330e02d5b" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:05:03.681464 19481 raft_consensus.cc:2468] T f1b10566f45d4a7d9029858330e02d5b P 0473d2b2d01f4459b1e90fd12cc7840e [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 5.
I20260709 13:05:03.681540 21444 leader_election.cc:290] T 46c5bfeecc314717bffe987e6844b6d0 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:05:03.673679 19482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f93ee515a9c14139bf566522ed8232f3" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 7 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:05:03.682271 19482 raft_consensus.cc:3060] T f93ee515a9c14139bf566522ed8232f3 P 0473d2b2d01f4459b1e90fd12cc7840e [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:05:03.683825 19403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46c5bfeecc314717bffe987e6844b6d0" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 8 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:05:03.684631 19403 raft_consensus.cc:2468] T 46c5bfeecc314717bffe987e6844b6d0 P e5256d91808b47c195bc9b4dbd7f2b87 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 7.
I20260709 13:05:03.686291 19449 leader_election.cc:304] T 46c5bfeecc314717bffe987e6844b6d0 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87; no voters: 
I20260709 13:05:03.664263 19306 catalog_manager.cc:5697] T 46c5bfeecc314717bffe987e6844b6d0 P 0473d2b2d01f4459b1e90fd12cc7840e reported cstate change: term changed from 2 to 5, leader changed from 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2) to e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3). New cstate: current_term: 5 leader_uuid: "e61c3a8f61bb48f8a963c9480e53c168" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } }
I20260709 13:05:03.675489 19551 raft_consensus.cc:493] T 0cdf56e38bbc453d9438d359e5a69955 P e61c3a8f61bb48f8a963c9480e53c168 [term 4 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:03.687719 19551 raft_consensus.cc:3060] T 0cdf56e38bbc453d9438d359e5a69955 P e61c3a8f61bb48f8a963c9480e53c168 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:05:03.687428 19306 catalog_manager.cc:5697] T 7be9efa6559648dbb5a0f7684c4542d1 P 0473d2b2d01f4459b1e90fd12cc7840e reported cstate change: term changed from 1 to 5, leader changed from e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1) to 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2). New cstate: current_term: 5 leader_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:03.689281 19306 catalog_manager.cc:5697] T 76cb037fc9064d13b59a8969d897ce8c P 0473d2b2d01f4459b1e90fd12cc7840e reported cstate change: term changed from 1 to 5, leader changed from e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1) to 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2). New cstate: current_term: 5 leader_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:03.676080 19479 raft_consensus.cc:3060] T 0afb57ae58a24a01850491d69f0213dd P 0473d2b2d01f4459b1e90fd12cc7840e [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:05:03.636052 20078 leader_election.cc:304] T 775c229504194560ba9589bc2199b089 P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 127766fc592545a4997f7790f50f6076; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87
W20260709 13:05:03.691753 20078 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.2:46257, user_credentials={real_user=slave}} blocked reactor thread for 55784.2us
I20260709 13:05:03.692230 21355 raft_consensus.cc:2749] T 775c229504194560ba9589bc2199b089 P 127766fc592545a4997f7790f50f6076 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:05:03.693121 21520 consensus_queue.cc:1048] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P 127766fc592545a4997f7790f50f6076 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:05:03.694152 21415 raft_consensus.cc:3055] T 2725d2c4cb054f18b0fc8f735c15f6c2 P e5256d91808b47c195bc9b4dbd7f2b87 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:05:03.694547 21415 raft_consensus.cc:740] T 2725d2c4cb054f18b0fc8f735c15f6c2 P e5256d91808b47c195bc9b4dbd7f2b87 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: e5256d91808b47c195bc9b4dbd7f2b87, State: Running, Role: LEADER
I20260709 13:05:03.695305 21415 consensus_queue.cc:260] T 2725d2c4cb054f18b0fc8f735c15f6c2 P e5256d91808b47c195bc9b4dbd7f2b87 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:03.696417 21415 raft_consensus.cc:3060] T 2725d2c4cb054f18b0fc8f735c15f6c2 P e5256d91808b47c195bc9b4dbd7f2b87 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:05:03.697590 19551 raft_consensus.cc:515] T 0cdf56e38bbc453d9438d359e5a69955 P e61c3a8f61bb48f8a963c9480e53c168 [term 5 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:03.699915 19551 leader_election.cc:290] T 0cdf56e38bbc453d9438d359e5a69955 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 5 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:05:03.678403 21342 raft_consensus.cc:2749] T bc225c93219c45538b53a1bd3d387e4d P e5256d91808b47c195bc9b4dbd7f2b87 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:05:03.680913 19480 raft_consensus.cc:3060] T 2725d2c4cb054f18b0fc8f735c15f6c2 P 0473d2b2d01f4459b1e90fd12cc7840e [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:05:03.676656 19523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.1:40321, user_credentials={real_user=slave}} blocked reactor thread for 60279.1us
I20260709 13:05:03.673918 19478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df751f992649444090e27965eb1af85d" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:05:03.669850 21115 consensus_queue.cc:1048] T bc225c93219c45538b53a1bd3d387e4d P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:03.701232 19377 leader_election.cc:304] T 76cb037fc9064d13b59a8969d897ce8c P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:05:03.700932 21535 consensus_queue.cc:1059] T f93ee515a9c14139bf566522ed8232f3 P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:05:03.706964 21535 raft_consensus.cc:3055] T f93ee515a9c14139bf566522ed8232f3 P e5256d91808b47c195bc9b4dbd7f2b87 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:05:03.707403 21535 raft_consensus.cc:740] T f93ee515a9c14139bf566522ed8232f3 P e5256d91808b47c195bc9b4dbd7f2b87 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: e5256d91808b47c195bc9b4dbd7f2b87, State: Running, Role: LEADER
I20260709 13:05:03.707978 21537 raft_consensus.cc:2749] T 76cb037fc9064d13b59a8969d897ce8c P e5256d91808b47c195bc9b4dbd7f2b87 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:05:03.708316 21535 consensus_queue.cc:260] T f93ee515a9c14139bf566522ed8232f3 P e5256d91808b47c195bc9b4dbd7f2b87 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 6.3, Last appended by leader: 3, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:03.709620 21535 raft_consensus.cc:3060] T f93ee515a9c14139bf566522ed8232f3 P e5256d91808b47c195bc9b4dbd7f2b87 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:05:03.713502 19377 leader_election.cc:304] T 2e36a9d6e29c4a7c860cf267efbd4c74 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:05:03.710321 19523 leader_election.cc:304] T 2a16f7501e2444fb86d4e2778e734e02 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e61c3a8f61bb48f8a963c9480e53c168; no voters: 127766fc592545a4997f7790f50f6076, e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:05:03.715178 19478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cdf56e38bbc453d9438d359e5a69955" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: true dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:05:03.715756 19478 raft_consensus.cc:3060] T 0cdf56e38bbc453d9438d359e5a69955 P 0473d2b2d01f4459b1e90fd12cc7840e [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:05:03.717366 19523 leader_election.cc:304] T fa731b585f684a7fb2d106c50f143b83 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e61c3a8f61bb48f8a963c9480e53c168; no voters: 127766fc592545a4997f7790f50f6076, e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:05:03.718152 21115 raft_consensus.cc:2749] T fa731b585f684a7fb2d106c50f143b83 P e61c3a8f61bb48f8a963c9480e53c168 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:05:03.718834 21537 raft_consensus.cc:2749] T 2e36a9d6e29c4a7c860cf267efbd4c74 P e5256d91808b47c195bc9b4dbd7f2b87 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:05:03.720016 19377 leader_election.cc:304] T 9962423cb4e54fcfa5de01daf68a86e7 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, 127766fc592545a4997f7790f50f6076
I20260709 13:05:03.721025 19450 leader_election.cc:304] T 22196caba61445d3bec98a0aab3c337d P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e; no voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:05:03.721570 21537 raft_consensus.cc:2749] T 9962423cb4e54fcfa5de01daf68a86e7 P e5256d91808b47c195bc9b4dbd7f2b87 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:05:03.722469 21444 raft_consensus.cc:2749] T 22196caba61445d3bec98a0aab3c337d P 0473d2b2d01f4459b1e90fd12cc7840e [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:05:03.728229 21471 raft_consensus.cc:2804] T 46c5bfeecc314717bffe987e6844b6d0 P 0473d2b2d01f4459b1e90fd12cc7840e [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:05:03.728389 19556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46c5bfeecc314717bffe987e6844b6d0" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 8 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:05:03.719151 19523 leader_election.cc:304] T 40e1e16737a842ee936002830f36882e P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e61c3a8f61bb48f8a963c9480e53c168; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:05:03.716384 21539 raft_consensus.cc:2749] T 2a16f7501e2444fb86d4e2778e734e02 P e61c3a8f61bb48f8a963c9480e53c168 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:05:03.732797 19377 leader_election.cc:304] T 172b3dd13109415a955b71ac0e9d2234 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, 127766fc592545a4997f7790f50f6076
I20260709 13:05:03.737457 19478 raft_consensus.cc:2468] T 0cdf56e38bbc453d9438d359e5a69955 P 0473d2b2d01f4459b1e90fd12cc7840e [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 5.
I20260709 13:05:03.738190 19377 leader_election.cc:304] T f1b10566f45d4a7d9029858330e02d5b P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87; no voters: e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:05:03.739713 19482 raft_consensus.cc:2468] T f93ee515a9c14139bf566522ed8232f3 P 0473d2b2d01f4459b1e90fd12cc7840e [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 7.
I20260709 13:05:03.741335 19526 leader_election.cc:304] T 0cdf56e38bbc453d9438d359e5a69955 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:05:03.743546 19526 leader_election.cc:304] T f93ee515a9c14139bf566522ed8232f3 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:05:03.748338 19523 leader_election.cc:304] T 1dc5b3532fe54f74876d02beffa2c230 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e61c3a8f61bb48f8a963c9480e53c168; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87
W20260709 13:05:03.752132 19451 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:03.752652 19485 raft_consensus.cc:2368] T b9f0d59553ad444883fcf5b5909f9798 P 0473d2b2d01f4459b1e90fd12cc7840e [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e5256d91808b47c195bc9b4dbd7f2b87 for earlier term 4. Current term is 5.
I20260709 13:05:03.753036 21471 raft_consensus.cc:493] T 46c5bfeecc314717bffe987e6844b6d0 P 0473d2b2d01f4459b1e90fd12cc7840e [term 7 FOLLOWER]: Starting leader election (detected failure of leader e61c3a8f61bb48f8a963c9480e53c168)
I20260709 13:05:03.753520 21471 raft_consensus.cc:3060] T 46c5bfeecc314717bffe987e6844b6d0 P 0473d2b2d01f4459b1e90fd12cc7840e [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:05:03.753607 19306 catalog_manager.cc:5697] T 2b74109013a140ada21feeef92d6f563 P 0473d2b2d01f4459b1e90fd12cc7840e reported cstate change: term changed from 1 to 2, leader changed from e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1) to 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2). New cstate: current_term: 2 leader_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } health_report { overall_health: HEALTHY } } }
I20260709 13:05:03.755424 19306 catalog_manager.cc:5697] T b08304a0a02b42d7840c4e8ee9a6bd1a P 0473d2b2d01f4459b1e90fd12cc7840e reported cstate change: term changed from 2 to 3, leader changed from e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1) to 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2). New cstate: current_term: 3 leader_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:03.747293 21406 raft_consensus.cc:2804] T 0cdf56e38bbc453d9438d359e5a69955 P e61c3a8f61bb48f8a963c9480e53c168 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:05:03.758765 21406 raft_consensus.cc:697] T 0cdf56e38bbc453d9438d359e5a69955 P e61c3a8f61bb48f8a963c9480e53c168 [term 5 LEADER]: Becoming Leader. State: Replica: e61c3a8f61bb48f8a963c9480e53c168, State: Running, Role: LEADER
I20260709 13:05:03.759742 21406 consensus_queue.cc:237] T 0cdf56e38bbc453d9438d359e5a69955 P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:03.763701 19306 catalog_manager.cc:5697] T ff75a1d4cb1f493db8f71ddc136ba9ab P 0473d2b2d01f4459b1e90fd12cc7840e reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:03.765178 19306 catalog_manager.cc:5697] T f93ee515a9c14139bf566522ed8232f3 P 0473d2b2d01f4459b1e90fd12cc7840e reported cstate change: term changed from 3 to 4, leader changed from 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2) to e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1). New cstate: current_term: 4 leader_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } }
I20260709 13:05:03.767182 21539 raft_consensus.cc:2749] T 1dc5b3532fe54f74876d02beffa2c230 P e61c3a8f61bb48f8a963c9480e53c168 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:05:03.762746 19479 raft_consensus.cc:2468] T 0afb57ae58a24a01850491d69f0213dd P 0473d2b2d01f4459b1e90fd12cc7840e [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 5.
I20260709 13:05:03.748173 21115 raft_consensus.cc:2804] T f93ee515a9c14139bf566522ed8232f3 P e61c3a8f61bb48f8a963c9480e53c168 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:05:03.768265 19523 leader_election.cc:304] T 14935b3ddf914369822e4a0547aaa355 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e61c3a8f61bb48f8a963c9480e53c168; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:05:03.772337 19480 raft_consensus.cc:2468] T 2725d2c4cb054f18b0fc8f735c15f6c2 P 0473d2b2d01f4459b1e90fd12cc7840e [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 4.
I20260709 13:05:03.745476 21415 raft_consensus.cc:2804] T f1b10566f45d4a7d9029858330e02d5b P e5256d91808b47c195bc9b4dbd7f2b87 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:05:03.743000 21342 raft_consensus.cc:2749] T 172b3dd13109415a955b71ac0e9d2234 P e5256d91808b47c195bc9b4dbd7f2b87 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:05:03.745189 21336 raft_consensus.cc:2749] T 40e1e16737a842ee936002830f36882e P e61c3a8f61bb48f8a963c9480e53c168 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:05:03.734103 21201 raft_consensus.cc:515] T a08760e15aac4630a629431f56024dc8 P 0473d2b2d01f4459b1e90fd12cc7840e [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
W20260709 13:05:03.777541 19450 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.3:36891, user_credentials={real_user=slave}} blocked reactor thread for 56594.3us
I20260709 13:05:03.779109 19450 leader_election.cc:304] T f1b10566f45d4a7d9029858330e02d5b P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168; no voters: e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:05:03.780174 21115 raft_consensus.cc:697] T f93ee515a9c14139bf566522ed8232f3 P e61c3a8f61bb48f8a963c9480e53c168 [term 7 LEADER]: Becoming Leader. State: Replica: e61c3a8f61bb48f8a963c9480e53c168, State: Running, Role: LEADER
I20260709 13:05:03.785573 21115 consensus_queue.cc:237] T f93ee515a9c14139bf566522ed8232f3 P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.2, Last appended by leader: 2, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:03.786062 21201 leader_election.cc:290] T a08760e15aac4630a629431f56024dc8 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 4 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:05:03.787613 21372 leader_election.cc:290] T b9f0d59553ad444883fcf5b5909f9798 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 5 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:05:03.787739 19523 leader_election.cc:304] T 70797e5783b5454ab0d0eea663e791e3 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e61c3a8f61bb48f8a963c9480e53c168; no voters: 127766fc592545a4997f7790f50f6076, e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:05:03.798231 19306 catalog_manager.cc:5697] T 86a6797bdfe94fa496c050ceae4bd0d9 P 0473d2b2d01f4459b1e90fd12cc7840e reported cstate change: term changed from 1 to 4, leader changed from e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1) to e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3). New cstate: current_term: 4 leader_uuid: "e61c3a8f61bb48f8a963c9480e53c168" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } }
I20260709 13:05:03.775656 21415 raft_consensus.cc:493] T f1b10566f45d4a7d9029858330e02d5b P e5256d91808b47c195bc9b4dbd7f2b87 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 0473d2b2d01f4459b1e90fd12cc7840e)
I20260709 13:05:03.807233 19406 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5ec1c4ce15e04c7e8c283a62179f2a64"
dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
mode: GRACEFUL
new_leader_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
 from {username='slave'} at 127.0.0.1:37312
I20260709 13:05:03.832518 19405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a08760e15aac4630a629431f56024dc8" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
I20260709 13:05:03.801532 21430 raft_consensus.cc:2804] T f1b10566f45d4a7d9029858330e02d5b P 0473d2b2d01f4459b1e90fd12cc7840e [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:05:03.851753 19403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9f0d59553ad444883fcf5b5909f9798" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
I20260709 13:05:03.885543 21430 raft_consensus.cc:493] T f1b10566f45d4a7d9029858330e02d5b P 0473d2b2d01f4459b1e90fd12cc7840e [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:03.885850 19403 raft_consensus.cc:3060] T b9f0d59553ad444883fcf5b5909f9798 P e5256d91808b47c195bc9b4dbd7f2b87 [term 3 FOLLOWER]: Advancing to term 5
I20260709 13:05:03.885937 21430 raft_consensus.cc:3060] T f1b10566f45d4a7d9029858330e02d5b P 0473d2b2d01f4459b1e90fd12cc7840e [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:05:03.810727 21372 consensus_queue.cc:1048] T b08304a0a02b42d7840c4e8ee9a6bd1a P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.044s
I20260709 13:05:03.797286 21533 raft_consensus.cc:2749] T 14935b3ddf914369822e4a0547aaa355 P e61c3a8f61bb48f8a963c9480e53c168 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:05:03.883034 19406 raft_consensus.cc:606] T 5ec1c4ce15e04c7e8c283a62179f2a64 P e5256d91808b47c195bc9b4dbd7f2b87 [term 1 LEADER]: Received request to transfer leadership to TS 0473d2b2d01f4459b1e90fd12cc7840e
I20260709 13:05:03.811823 19526 leader_election.cc:304] T 0afb57ae58a24a01850491d69f0213dd P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:05:03.892088 19523 leader_election.cc:304] T a08760e15aac4630a629431f56024dc8 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e61c3a8f61bb48f8a963c9480e53c168; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:05:03.805615 21524 raft_consensus.cc:2749] T 70797e5783b5454ab0d0eea663e791e3 P e61c3a8f61bb48f8a963c9480e53c168 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
W20260709 13:05:03.893339 19526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.2:46257, user_credentials={real_user=slave}} blocked reactor thread for 81592.3us
I20260709 13:05:03.883682 19306 catalog_manager.cc:5697] T bc225c93219c45538b53a1bd3d387e4d P 0473d2b2d01f4459b1e90fd12cc7840e reported cstate change: term changed from 1 to 4. New cstate: current_term: 4 leader_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } }
I20260709 13:05:03.805846 21415 raft_consensus.cc:3060] T f1b10566f45d4a7d9029858330e02d5b P e5256d91808b47c195bc9b4dbd7f2b87 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:05:03.883170 21336 raft_consensus.cc:493] T 179fd671030940b4b4a4e24bcc4aba0a P e61c3a8f61bb48f8a963c9480e53c168 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 0473d2b2d01f4459b1e90fd12cc7840e)
I20260709 13:05:03.894044 19526 leader_election.cc:304] T 2725d2c4cb054f18b0fc8f735c15f6c2 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:05:03.902751 19551 raft_consensus.cc:1240] T df751f992649444090e27965eb1af85d P e61c3a8f61bb48f8a963c9480e53c168 [term 5 FOLLOWER]: Rejecting Update request from peer e5256d91808b47c195bc9b4dbd7f2b87 for earlier term 4. Current term is 5. Ops: []
I20260709 13:05:03.900871 19306 catalog_manager.cc:5697] T 14935b3ddf914369822e4a0547aaa355 P 0473d2b2d01f4459b1e90fd12cc7840e reported cstate change: term changed from 1 to 2, leader changed from 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2) to e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1). New cstate: current_term: 2 leader_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } attrs { replace: true } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: NON_VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: true } } }
I20260709 13:05:03.896512 21406 raft_consensus.cc:2804] T 0afb57ae58a24a01850491d69f0213dd P e61c3a8f61bb48f8a963c9480e53c168 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:05:03.899976 21203 raft_consensus.cc:2749] T a08760e15aac4630a629431f56024dc8 P e61c3a8f61bb48f8a963c9480e53c168 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:05:03.910543 19523 leader_election.cc:304] T b08304a0a02b42d7840c4e8ee9a6bd1a P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e61c3a8f61bb48f8a963c9480e53c168; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:05:03.910789 19306 catalog_manager.cc:5697] T fa8650e71aa14778b3d73721fc50d9fc P 0473d2b2d01f4459b1e90fd12cc7840e reported cstate change: term changed from 1 to 4, leader changed from 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2) to e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3). New cstate: current_term: 4 leader_uuid: "e61c3a8f61bb48f8a963c9480e53c168" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } }
W20260709 13:05:03.910471 19450 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.3:36891, user_credentials={real_user=slave}} blocked reactor thread for 103526us
I20260709 13:05:03.916137 19481 raft_consensus.cc:1275] T ef32ce6fdd0e40d382c79974f30295c6 P 0473d2b2d01f4459b1e90fd12cc7840e [term 5 FOLLOWER]: Refusing update from remote peer e61c3a8f61bb48f8a963c9480e53c168: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:05:03.916036 21536 consensus_queue.cc:1059] T df751f992649444090e27965eb1af85d P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:05:03.909912 21524 raft_consensus.cc:2804] T 2725d2c4cb054f18b0fc8f735c15f6c2 P e61c3a8f61bb48f8a963c9480e53c168 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:05:03.922020 19523 leader_election.cc:304] T edd7d470b5014c9489be7f41f64355c9 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e61c3a8f61bb48f8a963c9480e53c168; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:05:03.925014 21465 consensus_queue.cc:1048] T ef32ce6fdd0e40d382c79974f30295c6 P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:05:03.927598 21203 raft_consensus.cc:2749] T edd7d470b5014c9489be7f41f64355c9 P e61c3a8f61bb48f8a963c9480e53c168 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:05:03.928395 21430 raft_consensus.cc:515] T f1b10566f45d4a7d9029858330e02d5b P 0473d2b2d01f4459b1e90fd12cc7840e [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:03.929272 19523 leader_election.cc:304] T 1a61655d99124a29b486ba4a5b37faea P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e61c3a8f61bb48f8a963c9480e53c168; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:05:03.917654 21406 raft_consensus.cc:697] T 0afb57ae58a24a01850491d69f0213dd P e61c3a8f61bb48f8a963c9480e53c168 [term 5 LEADER]: Becoming Leader. State: Replica: e61c3a8f61bb48f8a963c9480e53c168, State: Running, Role: LEADER
I20260709 13:05:03.930011 21523 raft_consensus.cc:2749] T 1a61655d99124a29b486ba4a5b37faea P e61c3a8f61bb48f8a963c9480e53c168 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:05:03.930845 21406 consensus_queue.cc:237] T 0afb57ae58a24a01850491d69f0213dd P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:05:03.931303 19406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1b10566f45d4a7d9029858330e02d5b" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
I20260709 13:05:03.932662 21430 leader_election.cc:290] T f1b10566f45d4a7d9029858330e02d5b P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 6 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:05:03.934867 21539 consensus_queue.cc:1048] T 46c5bfeecc314717bffe987e6844b6d0 P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.004s
I20260709 13:05:03.934128 19402 raft_consensus.cc:1275] T 21e14947d70440f19044d8f75c31e1f9 P e5256d91808b47c195bc9b4dbd7f2b87 [term 5 FOLLOWER]: Refusing update from remote peer 0473d2b2d01f4459b1e90fd12cc7840e: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:05:03.949782 19450 leader_election.cc:304] T 96efeaaf1057492490e9a621f37e1a2d P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e; no voters: 127766fc592545a4997f7790f50f6076, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:05:03.917424 21336 raft_consensus.cc:515] T 179fd671030940b4b4a4e24bcc4aba0a P e61c3a8f61bb48f8a963c9480e53c168 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:03.930385 19403 raft_consensus.cc:2468] T b9f0d59553ad444883fcf5b5909f9798 P e5256d91808b47c195bc9b4dbd7f2b87 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 5.
I20260709 13:05:03.951529 19449 leader_election.cc:304] T b9f0d59553ad444883fcf5b5909f9798 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87; no voters: 
I20260709 13:05:03.952044 21336 leader_election.cc:290] T 179fd671030940b4b4a4e24bcc4aba0a P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:05:03.952472 21336 consensus_queue.cc:1048] T 3e1f505cb0f1427bbd698ac889d80821 P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:03.953119 21338 raft_consensus.cc:2804] T b9f0d59553ad444883fcf5b5909f9798 P 0473d2b2d01f4459b1e90fd12cc7840e [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:05:03.953594 21338 raft_consensus.cc:697] T b9f0d59553ad444883fcf5b5909f9798 P 0473d2b2d01f4459b1e90fd12cc7840e [term 5 LEADER]: Becoming Leader. State: Replica: 0473d2b2d01f4459b1e90fd12cc7840e, State: Running, Role: LEADER
I20260709 13:05:03.954317 21338 consensus_queue.cc:237] T b9f0d59553ad444883fcf5b5909f9798 P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:03.920241 21478 raft_consensus.cc:2749] T b08304a0a02b42d7840c4e8ee9a6bd1a P e61c3a8f61bb48f8a963c9480e53c168 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:05:03.913333 21471 raft_consensus.cc:515] T 46c5bfeecc314717bffe987e6844b6d0 P 0473d2b2d01f4459b1e90fd12cc7840e [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:03.944010 21524 raft_consensus.cc:697] T 2725d2c4cb054f18b0fc8f735c15f6c2 P e61c3a8f61bb48f8a963c9480e53c168 [term 4 LEADER]: Becoming Leader. State: Replica: e61c3a8f61bb48f8a963c9480e53c168, State: Running, Role: LEADER
I20260709 13:05:03.961213 19479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "179fd671030940b4b4a4e24bcc4aba0a" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:05:03.964061 19480 raft_consensus.cc:1240] T 46c5bfeecc314717bffe987e6844b6d0 P 0473d2b2d01f4459b1e90fd12cc7840e [term 8 FOLLOWER]: Rejecting Update request from peer e61c3a8f61bb48f8a963c9480e53c168 for earlier term 7. Current term is 8. Ops: []
I20260709 13:05:03.964378 19450 leader_election.cc:304] T 48824d5acfbc485ebf8c2d944e7202de P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e; no voters: 127766fc592545a4997f7790f50f6076, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:05:03.971863 19450 leader_election.cc:304] T fa8650e71aa14778b3d73721fc50d9fc P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168; no voters: e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:05:03.957366 21546 raft_consensus.cc:2749] T 96efeaaf1057492490e9a621f37e1a2d P 0473d2b2d01f4459b1e90fd12cc7840e [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:05:03.978739 19377 leader_election.cc:400] T b9f0d59553ad444883fcf5b5909f9798 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 4 pre-election: Vote denied by peer 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257) with higher term. Message: Invalid argument: T b9f0d59553ad444883fcf5b5909f9798 P 0473d2b2d01f4459b1e90fd12cc7840e [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e5256d91808b47c195bc9b4dbd7f2b87 for earlier term 4. Current term is 5.
I20260709 13:05:03.982647 19377 leader_election.cc:403] T b9f0d59553ad444883fcf5b5909f9798 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 4 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:05:03.980888 19551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9f0d59553ad444883fcf5b5909f9798" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:05:03.984721 19551 raft_consensus.cc:3060] T b9f0d59553ad444883fcf5b5909f9798 P e61c3a8f61bb48f8a963c9480e53c168 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:05:03.986222 19556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a08760e15aac4630a629431f56024dc8" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:05:03.947652 21529 consensus_queue.cc:1059] T bc225c93219c45538b53a1bd3d387e4d P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.027s
I20260709 13:05:03.997525 19405 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b08304a0a02b42d7840c4e8ee9a6bd1a"
dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
mode: GRACEFUL
new_leader_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
 from {username='slave'} at 127.0.0.1:37312
I20260709 13:05:03.998358 19405 raft_consensus.cc:606] T b08304a0a02b42d7840c4e8ee9a6bd1a P e5256d91808b47c195bc9b4dbd7f2b87 [term 5 FOLLOWER]: Received request to transfer leadership to TS e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:05:03.999241 19405 raft_consensus.cc:614] T b08304a0a02b42d7840c4e8ee9a6bd1a P e5256d91808b47c195bc9b4dbd7f2b87 [term 5 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:05:04.005605 19551 raft_consensus.cc:2468] T b9f0d59553ad444883fcf5b5909f9798 P e61c3a8f61bb48f8a963c9480e53c168 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 5.
I20260709 13:05:04.011611 19477 raft_consensus.cc:1240] T 0afb57ae58a24a01850491d69f0213dd P 0473d2b2d01f4459b1e90fd12cc7840e [term 5 FOLLOWER]: Rejecting Update request from peer 127766fc592545a4997f7790f50f6076 for earlier term 4. Current term is 5. Ops: []
I20260709 13:05:04.014683 19556 raft_consensus.cc:1275] T 21e14947d70440f19044d8f75c31e1f9 P e61c3a8f61bb48f8a963c9480e53c168 [term 5 FOLLOWER]: Refusing update from remote peer 0473d2b2d01f4459b1e90fd12cc7840e: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 3. (term mismatch)
I20260709 13:05:04.015380 19558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1b10566f45d4a7d9029858330e02d5b" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:05:04.036253 19558 raft_consensus.cc:3060] T f1b10566f45d4a7d9029858330e02d5b P e61c3a8f61bb48f8a963c9480e53c168 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:05:03.975703 21525 raft_consensus.cc:2749] T 48824d5acfbc485ebf8c2d944e7202de P 0473d2b2d01f4459b1e90fd12cc7840e [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:05:03.982383 21430 raft_consensus.cc:2804] T fa8650e71aa14778b3d73721fc50d9fc P 0473d2b2d01f4459b1e90fd12cc7840e [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:05:04.020144 19560 raft_consensus.cc:1275] T 28af091831594f9d8e96482078cc7625 P e61c3a8f61bb48f8a963c9480e53c168 [term 6 FOLLOWER]: Refusing update from remote peer 0473d2b2d01f4459b1e90fd12cc7840e: Log matching property violated. Preceding OpId in replica: term: 4 index: 2. Preceding OpId from leader: term: 6 index: 3. (index mismatch)
I20260709 13:05:03.971112 21550 consensus_queue.cc:1059] T 1a61655d99124a29b486ba4a5b37faea P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.051s
W20260709 13:05:04.031046 19523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.1:40321, user_credentials={real_user=slave}} blocked reactor thread for 89344.7us
I20260709 13:05:04.035693 19556 pending_rounds.cc:85] T 21e14947d70440f19044d8f75c31e1f9 P e61c3a8f61bb48f8a963c9480e53c168: Aborting all ops after (but not including) 2
I20260709 13:05:04.043219 19556 pending_rounds.cc:107] T 21e14947d70440f19044d8f75c31e1f9 P e61c3a8f61bb48f8a963c9480e53c168: Aborting uncommitted NO_OP operation due to leader change: 4.3
I20260709 13:05:04.043438 19556 raft_consensus.cc:2889] T 21e14947d70440f19044d8f75c31e1f9 P e61c3a8f61bb48f8a963c9480e53c168 [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:05:04.041488 21547 raft_consensus.cc:2749] T b9f0d59553ad444883fcf5b5909f9798 P e5256d91808b47c195bc9b4dbd7f2b87 [term 5 FOLLOWER]: Leader pre-election lost for term 4. Reason: Vote denied by peer 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257) with higher term. Message: Invalid argument: T b9f0d59553ad444883fcf5b5909f9798 P 0473d2b2d01f4459b1e90fd12cc7840e [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e5256d91808b47c195bc9b4dbd7f2b87 for earlier term 4. Current term is 5.
I20260709 13:05:04.040146 21520 raft_consensus.cc:493] T 9962423cb4e54fcfa5de01daf68a86e7 P 127766fc592545a4997f7790f50f6076 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:04.045746 21430 raft_consensus.cc:697] T fa8650e71aa14778b3d73721fc50d9fc P 0473d2b2d01f4459b1e90fd12cc7840e [term 5 LEADER]: Becoming Leader. State: Replica: 0473d2b2d01f4459b1e90fd12cc7840e, State: Running, Role: LEADER
I20260709 13:05:04.074347 21358 raft_consensus.cc:3055] T df751f992649444090e27965eb1af85d P e5256d91808b47c195bc9b4dbd7f2b87 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:05:04.075007 21358 raft_consensus.cc:740] T df751f992649444090e27965eb1af85d P e5256d91808b47c195bc9b4dbd7f2b87 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: e5256d91808b47c195bc9b4dbd7f2b87, State: Running, Role: LEADER
I20260709 13:05:04.079775 19523 leader_election.cc:304] T 85c494af21f9457a85da47b9bc70c1fd P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e61c3a8f61bb48f8a963c9480e53c168; no voters: 127766fc592545a4997f7790f50f6076, e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:05:04.086346 19402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2725d2c4cb054f18b0fc8f735c15f6c2" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:05:04.087138 19402 raft_consensus.cc:2468] T 2725d2c4cb054f18b0fc8f735c15f6c2 P e5256d91808b47c195bc9b4dbd7f2b87 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 4.
I20260709 13:05:04.076115 21358 consensus_queue.cc:260] T df751f992649444090e27965eb1af85d P e5256d91808b47c195bc9b4dbd7f2b87 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:04.102850 19403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4af19371ea874c09a0a2147040835cbb" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
I20260709 13:05:04.104815 19403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cdf56e38bbc453d9438d359e5a69955" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: true dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
I20260709 13:05:04.105528 19403 raft_consensus.cc:3055] T 0cdf56e38bbc453d9438d359e5a69955 P e5256d91808b47c195bc9b4dbd7f2b87 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:05:04.105809 19403 raft_consensus.cc:740] T 0cdf56e38bbc453d9438d359e5a69955 P e5256d91808b47c195bc9b4dbd7f2b87 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: e5256d91808b47c195bc9b4dbd7f2b87, State: Running, Role: LEADER
I20260709 13:05:04.111294 19410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df751f992649444090e27965eb1af85d" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
I20260709 13:05:04.106482 19403 consensus_queue.cc:260] T 0cdf56e38bbc453d9438d359e5a69955 P e5256d91808b47c195bc9b4dbd7f2b87 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:04.115573 19409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "217b5fae677b4971b3bbd2f357a1f7ff" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:05:04.116811 19407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f93ee515a9c14139bf566522ed8232f3" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 7 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
I20260709 13:05:04.117897 19407 raft_consensus.cc:2410] T f93ee515a9c14139bf566522ed8232f3 P e5256d91808b47c195bc9b4dbd7f2b87 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate e61c3a8f61bb48f8a963c9480e53c168 for term 7 because replica has last-logged OpId of term: 6 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 2.
I20260709 13:05:04.118520 19411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "179fd671030940b4b4a4e24bcc4aba0a" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:05:04.119675 19403 raft_consensus.cc:3060] T 0cdf56e38bbc453d9438d359e5a69955 P e5256d91808b47c195bc9b4dbd7f2b87 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:05:04.120224 21358 raft_consensus.cc:3060] T df751f992649444090e27965eb1af85d P e5256d91808b47c195bc9b4dbd7f2b87 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:05:04.122869 21559 raft_consensus.cc:2749] T 85c494af21f9457a85da47b9bc70c1fd P e61c3a8f61bb48f8a963c9480e53c168 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:05:04.123174 20107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4af19371ea874c09a0a2147040835cbb" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076"
I20260709 13:05:04.119707 20105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0afb57ae58a24a01850491d69f0213dd" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076"
I20260709 13:05:04.128417 19403 raft_consensus.cc:2468] T 0cdf56e38bbc453d9438d359e5a69955 P e5256d91808b47c195bc9b4dbd7f2b87 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 5.
I20260709 13:05:04.053043 21524 consensus_queue.cc:237] T 2725d2c4cb054f18b0fc8f735c15f6c2 P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:04.132290 21430 consensus_queue.cc:237] T fa8650e71aa14778b3d73721fc50d9fc P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:04.134241 21415 raft_consensus.cc:515] T f1b10566f45d4a7d9029858330e02d5b P e5256d91808b47c195bc9b4dbd7f2b87 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:04.054491 21520 raft_consensus.cc:515] T 9962423cb4e54fcfa5de01daf68a86e7 P 127766fc592545a4997f7790f50f6076 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:05:04.140828 21520 leader_election.cc:290] T 9962423cb4e54fcfa5de01daf68a86e7 P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:05:04.141026 20108 raft_consensus.cc:1275] T 62c6c134d3d24a1ab144dd9ee6bc3f64 P 127766fc592545a4997f7790f50f6076 [term 6 FOLLOWER]: Refusing update from remote peer e61c3a8f61bb48f8a963c9480e53c168: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:05:04.145294 19406 raft_consensus.cc:3060] T f1b10566f45d4a7d9029858330e02d5b P e5256d91808b47c195bc9b4dbd7f2b87 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:05:04.112572 21533 raft_consensus.cc:3055] T bc225c93219c45538b53a1bd3d387e4d P e61c3a8f61bb48f8a963c9480e53c168 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:05:04.179838 19406 raft_consensus.cc:2468] T f1b10566f45d4a7d9029858330e02d5b P e5256d91808b47c195bc9b4dbd7f2b87 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 6.
I20260709 13:05:04.182170 19558 raft_consensus.cc:2468] T f1b10566f45d4a7d9029858330e02d5b P e61c3a8f61bb48f8a963c9480e53c168 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 6.
I20260709 13:05:04.187733 19409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9962423cb4e54fcfa5de01daf68a86e7" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:05:04.188517 19409 raft_consensus.cc:2468] T 9962423cb4e54fcfa5de01daf68a86e7 P e5256d91808b47c195bc9b4dbd7f2b87 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 127766fc592545a4997f7790f50f6076 in term 7.
I20260709 13:05:04.179286 19402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2725d2c4cb054f18b0fc8f735c15f6c2" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
I20260709 13:05:04.179031 21533 raft_consensus.cc:740] T bc225c93219c45538b53a1bd3d387e4d P e61c3a8f61bb48f8a963c9480e53c168 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: e61c3a8f61bb48f8a963c9480e53c168, State: Running, Role: LEADER
I20260709 13:05:04.198886 19558 raft_consensus.cc:1240] T 4af19371ea874c09a0a2147040835cbb P e61c3a8f61bb48f8a963c9480e53c168 [term 3 FOLLOWER]: Rejecting Update request from peer 127766fc592545a4997f7790f50f6076 for earlier term 2. Current term is 3. Ops: []
I20260709 13:05:04.201347 20075 leader_election.cc:304] T 9962423cb4e54fcfa5de01daf68a86e7 P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 127766fc592545a4997f7790f50f6076, e5256d91808b47c195bc9b4dbd7f2b87; no voters: 
W20260709 13:05:04.224174 21567 log.cc:927] Time spent T bc225c93219c45538b53a1bd3d387e4d P e61c3a8f61bb48f8a963c9480e53c168: Append to log took a long time: real 0.066s	user 0.000s	sys 0.000s
I20260709 13:05:04.225672 21415 leader_election.cc:290] T f1b10566f45d4a7d9029858330e02d5b P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 5 election: Requested vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:05:04.226276 21553 raft_consensus.cc:2804] T 9962423cb4e54fcfa5de01daf68a86e7 P 127766fc592545a4997f7790f50f6076 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:05:04.226784 21553 raft_consensus.cc:493] T 9962423cb4e54fcfa5de01daf68a86e7 P 127766fc592545a4997f7790f50f6076 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:04.227180 21553 raft_consensus.cc:3060] T 9962423cb4e54fcfa5de01daf68a86e7 P 127766fc592545a4997f7790f50f6076 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:05:04.239827 19556 raft_consensus.cc:1240] T 0cdf56e38bbc453d9438d359e5a69955 P e61c3a8f61bb48f8a963c9480e53c168 [term 5 LEADER]: Rejecting Update request from peer e5256d91808b47c195bc9b4dbd7f2b87 for earlier term 4. Current term is 5. Ops: []
I20260709 13:05:04.211542 21551 consensus_queue.cc:1059] T 0afb57ae58a24a01850491d69f0213dd P 127766fc592545a4997f7790f50f6076 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.040s
I20260709 13:05:04.251101 21471 leader_election.cc:290] T 46c5bfeecc314717bffe987e6844b6d0 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 8 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:05:04.251639 21551 raft_consensus.cc:3055] T 0afb57ae58a24a01850491d69f0213dd P 127766fc592545a4997f7790f50f6076 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:05:04.259603 19555 raft_consensus.cc:1240] T 0afb57ae58a24a01850491d69f0213dd P e61c3a8f61bb48f8a963c9480e53c168 [term 5 LEADER]: Rejecting Update request from peer 127766fc592545a4997f7790f50f6076 for earlier term 4. Current term is 5. Ops: []
I20260709 13:05:04.260241 21533 consensus_queue.cc:260] T bc225c93219c45538b53a1bd3d387e4d P e61c3a8f61bb48f8a963c9480e53c168 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.3, Last appended by leader: 3, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:04.261477 21533 raft_consensus.cc:3060] T bc225c93219c45538b53a1bd3d387e4d P e61c3a8f61bb48f8a963c9480e53c168 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:05:04.262190 19406 raft_consensus.cc:1240] T bc225c93219c45538b53a1bd3d387e4d P e5256d91808b47c195bc9b4dbd7f2b87 [term 7 FOLLOWER]: Rejecting Update request from peer e61c3a8f61bb48f8a963c9480e53c168 for earlier term 6. Current term is 7. Ops: [6.3-6.3]
I20260709 13:05:04.252978 21551 raft_consensus.cc:740] T 0afb57ae58a24a01850491d69f0213dd P 127766fc592545a4997f7790f50f6076 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 127766fc592545a4997f7790f50f6076, State: Running, Role: LEADER
I20260709 13:05:04.273730 21551 consensus_queue.cc:260] T 0afb57ae58a24a01850491d69f0213dd P 127766fc592545a4997f7790f50f6076 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:05:04.274978 21551 raft_consensus.cc:3060] T 0afb57ae58a24a01850491d69f0213dd P 127766fc592545a4997f7790f50f6076 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:05:04.279110 21520 consensus_queue.cc:1059] T 4af19371ea874c09a0a2147040835cbb P 127766fc592545a4997f7790f50f6076 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:05:04.279927 18300 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:05:04.280331 21520 raft_consensus.cc:3055] T 4af19371ea874c09a0a2147040835cbb P 127766fc592545a4997f7790f50f6076 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:05:04.280791 21520 raft_consensus.cc:740] T 4af19371ea874c09a0a2147040835cbb P 127766fc592545a4997f7790f50f6076 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 127766fc592545a4997f7790f50f6076, State: Running, Role: LEADER
I20260709 13:05:04.281360 19523 leader_election.cc:304] T 4af19371ea874c09a0a2147040835cbb P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e61c3a8f61bb48f8a963c9480e53c168; no voters: 127766fc592545a4997f7790f50f6076, e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:05:04.281864 18300 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:05:04.282712 19523 leader_election.cc:304] T 217b5fae677b4971b3bbd2f357a1f7ff P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e61c3a8f61bb48f8a963c9480e53c168; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:05:04.281805 21520 consensus_queue.cc:260] T 4af19371ea874c09a0a2147040835cbb P 127766fc592545a4997f7790f50f6076 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:05:04.283689 21520 raft_consensus.cc:3060] T 4af19371ea874c09a0a2147040835cbb P 127766fc592545a4997f7790f50f6076 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:04.282724 21406 consensus_queue.cc:1048] T 62c6c134d3d24a1ab144dd9ee6bc3f64 P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Connected to new peer: Peer: permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.002s
I20260709 13:05:04.286032 21406 raft_consensus.cc:2749] T 4af19371ea874c09a0a2147040835cbb P e61c3a8f61bb48f8a963c9480e53c168 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:05:04.286660 21406 raft_consensus.cc:2749] T 217b5fae677b4971b3bbd2f357a1f7ff P e61c3a8f61bb48f8a963c9480e53c168 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:05:04.292124 21525 raft_consensus.cc:3055] T 1a61655d99124a29b486ba4a5b37faea P 0473d2b2d01f4459b1e90fd12cc7840e [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:05:04.292542 21525 raft_consensus.cc:740] T 1a61655d99124a29b486ba4a5b37faea P 0473d2b2d01f4459b1e90fd12cc7840e [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0473d2b2d01f4459b1e90fd12cc7840e, State: Running, Role: LEADER
I20260709 13:05:04.300225 19410 raft_consensus.cc:2468] T df751f992649444090e27965eb1af85d P e5256d91808b47c195bc9b4dbd7f2b87 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 5.
I20260709 13:05:04.305800 19481 raft_consensus.cc:1275] T 0cdf56e38bbc453d9438d359e5a69955 P 0473d2b2d01f4459b1e90fd12cc7840e [term 5 FOLLOWER]: Refusing update from remote peer e61c3a8f61bb48f8a963c9480e53c168: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:05:04.309716 19526 leader_election.cc:304] T 179fd671030940b4b4a4e24bcc4aba0a P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e61c3a8f61bb48f8a963c9480e53c168; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:05:04.310853 19485 raft_consensus.cc:1275] T f93ee515a9c14139bf566522ed8232f3 P 0473d2b2d01f4459b1e90fd12cc7840e [term 7 FOLLOWER]: Refusing update from remote peer e61c3a8f61bb48f8a963c9480e53c168: Log matching property violated. Preceding OpId in replica: term: 4 index: 2. Preceding OpId from leader: term: 7 index: 3. (index mismatch)
W20260709 13:05:04.311546 20075 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.1:40321, user_credentials={real_user=slave}} blocked reactor thread for 113224us
I20260709 13:05:04.321543 19407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46c5bfeecc314717bffe987e6844b6d0" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 8 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
I20260709 13:05:04.325594 19449 leader_election.cc:304] T f1b10566f45d4a7d9029858330e02d5b P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87; no voters: 
I20260709 13:05:04.326395 19450 leader_election.cc:304] T a08760e15aac4630a629431f56024dc8 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e; no voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:05:04.327937 19555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1b10566f45d4a7d9029858330e02d5b" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:05:04.332239 19406 raft_consensus.cc:1275] T 28af091831594f9d8e96482078cc7625 P e5256d91808b47c195bc9b4dbd7f2b87 [term 6 FOLLOWER]: Refusing update from remote peer 0473d2b2d01f4459b1e90fd12cc7840e: Log matching property violated. Preceding OpId in replica: term: 4 index: 2. Preceding OpId from leader: term: 6 index: 3. (index mismatch)
I20260709 13:05:04.351198 19477 raft_consensus.cc:1240] T 48824d5acfbc485ebf8c2d944e7202de P 0473d2b2d01f4459b1e90fd12cc7840e [term 3 FOLLOWER]: Rejecting Update request from peer 127766fc592545a4997f7790f50f6076 for earlier term 2. Current term is 3. Ops: []
I20260709 13:05:04.339210 19555 raft_consensus.cc:2368] T f1b10566f45d4a7d9029858330e02d5b P e61c3a8f61bb48f8a963c9480e53c168 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate e5256d91808b47c195bc9b4dbd7f2b87 for earlier term 5. Current term is 6.
I20260709 13:05:04.356850 19483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9962423cb4e54fcfa5de01daf68a86e7" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:05:04.357501 19483 raft_consensus.cc:2468] T 9962423cb4e54fcfa5de01daf68a86e7 P 0473d2b2d01f4459b1e90fd12cc7840e [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 127766fc592545a4997f7790f50f6076 in term 7.
I20260709 13:05:04.338546 21561 raft_consensus.cc:2749] T 179fd671030940b4b4a4e24bcc4aba0a P e61c3a8f61bb48f8a963c9480e53c168 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:05:04.364790 21569 raft_consensus.cc:2749] T a08760e15aac4630a629431f56024dc8 P 0473d2b2d01f4459b1e90fd12cc7840e [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:05:04.338507 21471 raft_consensus.cc:2804] T f1b10566f45d4a7d9029858330e02d5b P 0473d2b2d01f4459b1e90fd12cc7840e [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:05:04.370954 19375 leader_election.cc:400] T f1b10566f45d4a7d9029858330e02d5b P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 5 election: Vote denied by peer e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891) with higher term. Message: Invalid argument: T f1b10566f45d4a7d9029858330e02d5b P e61c3a8f61bb48f8a963c9480e53c168 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate e5256d91808b47c195bc9b4dbd7f2b87 for earlier term 5. Current term is 6.
I20260709 13:05:04.371291 19375 leader_election.cc:403] T f1b10566f45d4a7d9029858330e02d5b P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 5 election: Cancelling election due to peer responding with higher term
I20260709 13:05:04.350811 21338 raft_consensus.cc:493] T ff9b0eddd810459b82d91c60777c10eb P 0473d2b2d01f4459b1e90fd12cc7840e [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 127766fc592545a4997f7790f50f6076)
I20260709 13:05:04.379050 21338 raft_consensus.cc:515] T ff9b0eddd810459b82d91c60777c10eb P 0473d2b2d01f4459b1e90fd12cc7840e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:05:04.381587 21338 leader_election.cc:290] T ff9b0eddd810459b82d91c60777c10eb P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:05:04.384907 21536 raft_consensus.cc:2749] T f1b10566f45d4a7d9029858330e02d5b P e5256d91808b47c195bc9b4dbd7f2b87 [term 6 FOLLOWER]: Leader election lost for term 5. Reason: Vote denied by peer e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891) with higher term. Message: Invalid argument: T f1b10566f45d4a7d9029858330e02d5b P e61c3a8f61bb48f8a963c9480e53c168 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate e5256d91808b47c195bc9b4dbd7f2b87 for earlier term 5. Current term is 6.
I20260709 13:05:04.388890 21471 raft_consensus.cc:697] T f1b10566f45d4a7d9029858330e02d5b P 0473d2b2d01f4459b1e90fd12cc7840e [term 6 LEADER]: Becoming Leader. State: Replica: 0473d2b2d01f4459b1e90fd12cc7840e, State: Running, Role: LEADER
I20260709 13:05:04.390230 21471 consensus_queue.cc:237] T f1b10566f45d4a7d9029858330e02d5b P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:04.295739 21525 consensus_queue.cc:260] T 1a61655d99124a29b486ba4a5b37faea P 0473d2b2d01f4459b1e90fd12cc7840e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:04.395042 21525 raft_consensus.cc:3060] T 1a61655d99124a29b486ba4a5b37faea P 0473d2b2d01f4459b1e90fd12cc7840e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:04.404719 19523 leader_election.cc:304] T df751f992649444090e27965eb1af85d P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168; no voters: 0473d2b2d01f4459b1e90fd12cc7840e
I20260709 13:05:04.357306 21558 consensus_queue.cc:1048] T 0cdf56e38bbc453d9438d359e5a69955 P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.049s
I20260709 13:05:04.406515 19406 raft_consensus.cc:1275] T ef32ce6fdd0e40d382c79974f30295c6 P e5256d91808b47c195bc9b4dbd7f2b87 [term 5 FOLLOWER]: Refusing update from remote peer e61c3a8f61bb48f8a963c9480e53c168: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:05:04.406895 21558 raft_consensus.cc:2804] T df751f992649444090e27965eb1af85d P e61c3a8f61bb48f8a963c9480e53c168 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:05:04.407408 21558 raft_consensus.cc:697] T df751f992649444090e27965eb1af85d P e61c3a8f61bb48f8a963c9480e53c168 [term 5 LEADER]: Becoming Leader. State: Replica: e61c3a8f61bb48f8a963c9480e53c168, State: Running, Role: LEADER
I20260709 13:05:04.408210 21558 consensus_queue.cc:237] T df751f992649444090e27965eb1af85d P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:04.409366 21523 raft_consensus.cc:1064] T ab43d85f64114d4ebf618930e43d9ed0 P e61c3a8f61bb48f8a963c9480e53c168: attempting to promote NON_VOTER 127766fc592545a4997f7790f50f6076 to VOTER
I20260709 13:05:04.366333 21568 raft_consensus.cc:493] T 1f85fc4b527a48848e5faa083b604e36 P 0473d2b2d01f4459b1e90fd12cc7840e [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e5256d91808b47c195bc9b4dbd7f2b87)
I20260709 13:05:04.413064 21568 raft_consensus.cc:515] T 1f85fc4b527a48848e5faa083b604e36 P 0473d2b2d01f4459b1e90fd12cc7840e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:05:04.416033 21568 leader_election.cc:290] T 1f85fc4b527a48848e5faa083b604e36 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:05:04.369386 21115 consensus_queue.cc:1048] T f93ee515a9c14139bf566522ed8232f3 P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.047s
I20260709 13:05:04.422394 19410 raft_consensus.cc:1275] T f93ee515a9c14139bf566522ed8232f3 P e5256d91808b47c195bc9b4dbd7f2b87 [term 7 FOLLOWER]: Refusing update from remote peer e61c3a8f61bb48f8a963c9480e53c168: Log matching property violated. Preceding OpId in replica: term: 6 index: 3. Preceding OpId from leader: term: 7 index: 3. (term mismatch)
I20260709 13:05:04.423019 19410 pending_rounds.cc:85] T f93ee515a9c14139bf566522ed8232f3 P e5256d91808b47c195bc9b4dbd7f2b87: Aborting all ops after (but not including) 2
I20260709 13:05:04.412956 21523 consensus_queue.cc:237] T ab43d85f64114d4ebf618930e43d9ed0 P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 3, Current term: 5, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } attrs { replace: true } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:05:04.423257 19410 pending_rounds.cc:107] T f93ee515a9c14139bf566522ed8232f3 P e5256d91808b47c195bc9b4dbd7f2b87: Aborting uncommitted NO_OP operation due to leader change: 6.3
I20260709 13:05:04.423661 19410 raft_consensus.cc:2889] T f93ee515a9c14139bf566522ed8232f3 P e5256d91808b47c195bc9b4dbd7f2b87 [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:05:04.379134 21562 consensus_queue.cc:1048] T 28af091831594f9d8e96482078cc7625 P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.057s
I20260709 13:05:04.422389 19406 raft_consensus.cc:1275] T 0cdf56e38bbc453d9438d359e5a69955 P e5256d91808b47c195bc9b4dbd7f2b87 [term 5 FOLLOWER]: Refusing update from remote peer e61c3a8f61bb48f8a963c9480e53c168: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:05:04.426972 21561 consensus_queue.cc:1048] T 0cdf56e38bbc453d9438d359e5a69955 P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:05:04.351958 21336 consensus_queue.cc:1059] T 46c5bfeecc314717bffe987e6844b6d0 P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 }, Status: INVALID_TERM, Last received: 7.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.026s
I20260709 13:05:04.331421 21201 consensus_queue.cc:1048] T 21e14947d70440f19044d8f75c31e1f9 P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.047s
I20260709 13:05:04.373451 21537 raft_consensus.cc:493] T fa8650e71aa14778b3d73721fc50d9fc P e5256d91808b47c195bc9b4dbd7f2b87 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader e61c3a8f61bb48f8a963c9480e53c168)
W20260709 13:05:04.436686 19450 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.3:36891, user_credentials={real_user=slave}} blocked reactor thread for 88488.5us
I20260709 13:05:04.439183 20112 raft_consensus.cc:1275] T 0afb57ae58a24a01850491d69f0213dd P 127766fc592545a4997f7790f50f6076 [term 5 FOLLOWER]: Refusing update from remote peer e61c3a8f61bb48f8a963c9480e53c168: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 6. (term mismatch)
W20260709 13:05:04.441008 20076 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.3:36891, user_credentials={real_user=slave}} blocked reactor thread for 178380us
I20260709 13:05:04.441326 20112 pending_rounds.cc:85] T 0afb57ae58a24a01850491d69f0213dd P 127766fc592545a4997f7790f50f6076: Aborting all ops after (but not including) 5
I20260709 13:05:04.442512 20112 pending_rounds.cc:107] T 0afb57ae58a24a01850491d69f0213dd P 127766fc592545a4997f7790f50f6076: Aborting uncommitted NO_OP operation due to leader change: 4.6
I20260709 13:05:04.444686 20112 raft_consensus.cc:2889] T 0afb57ae58a24a01850491d69f0213dd P 127766fc592545a4997f7790f50f6076 [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:05:04.451037 20075 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.1:40321, user_credentials={real_user=slave}} blocked reactor thread for 93475.7us
I20260709 13:05:04.361143 21553 raft_consensus.cc:515] T 9962423cb4e54fcfa5de01daf68a86e7 P 127766fc592545a4997f7790f50f6076 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:05:04.431732 21539 consensus_queue.cc:1048] T ef32ce6fdd0e40d382c79974f30295c6 P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.004s
I20260709 13:05:04.455101 19483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1b10566f45d4a7d9029858330e02d5b" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
W20260709 13:05:04.453383 19449 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.1:40321, user_credentials={real_user=slave}} blocked reactor thread for 98023.8us
I20260709 13:05:04.442947 21561 raft_consensus.cc:3055] T 46c5bfeecc314717bffe987e6844b6d0 P e61c3a8f61bb48f8a963c9480e53c168 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:05:04.461071 19479 raft_consensus.cc:1240] T a08760e15aac4630a629431f56024dc8 P 0473d2b2d01f4459b1e90fd12cc7840e [term 4 FOLLOWER]: Rejecting Update request from peer e5256d91808b47c195bc9b4dbd7f2b87 for earlier term 3. Current term is 4. Ops: []
I20260709 13:05:04.426756 21524 consensus_queue.cc:1048] T f93ee515a9c14139bf566522ed8232f3 P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.028s
I20260709 13:05:04.473285 19551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46c5bfeecc314717bffe987e6844b6d0" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 8 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:05:04.472718 21561 raft_consensus.cc:740] T 46c5bfeecc314717bffe987e6844b6d0 P e61c3a8f61bb48f8a963c9480e53c168 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: e61c3a8f61bb48f8a963c9480e53c168, State: Running, Role: LEADER
I20260709 13:05:04.449566 21537 raft_consensus.cc:515] T fa8650e71aa14778b3d73721fc50d9fc P e5256d91808b47c195bc9b4dbd7f2b87 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:04.492551 21535 consensus_queue.cc:1059] T a08760e15aac4630a629431f56024dc8 P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.005s
I20260709 13:05:04.493682 21411 raft_consensus.cc:3055] T a08760e15aac4630a629431f56024dc8 P e5256d91808b47c195bc9b4dbd7f2b87 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:05:04.494170 21411 raft_consensus.cc:740] T a08760e15aac4630a629431f56024dc8 P e5256d91808b47c195bc9b4dbd7f2b87 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: e5256d91808b47c195bc9b4dbd7f2b87, State: Running, Role: LEADER
I20260709 13:05:04.454473 21546 consensus_queue.cc:1048] T 21e14947d70440f19044d8f75c31e1f9 P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.030s
I20260709 13:05:04.455022 21336 consensus_queue.cc:1048] T 0afb57ae58a24a01850491d69f0213dd P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Connected to new peer: Peer: permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.030s
I20260709 13:05:04.493726 21342 raft_consensus.cc:993] T 5ec1c4ce15e04c7e8c283a62179f2a64 P e5256d91808b47c195bc9b4dbd7f2b87: : Instructing follower 0473d2b2d01f4459b1e90fd12cc7840e to start an election
I20260709 13:05:04.503495 21561 consensus_queue.cc:260] T 46c5bfeecc314717bffe987e6844b6d0 P e61c3a8f61bb48f8a963c9480e53c168 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 7.3, Last appended by leader: 3, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:04.504757 21562 consensus_queue.cc:1048] T 28af091831594f9d8e96482078cc7625 P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:05:04.507294 19450 leader_election.cc:304] T 46c5bfeecc314717bffe987e6844b6d0 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e; no voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:05:04.529501 19409 raft_consensus.cc:1275] T b9f0d59553ad444883fcf5b5909f9798 P e5256d91808b47c195bc9b4dbd7f2b87 [term 5 FOLLOWER]: Refusing update from remote peer 0473d2b2d01f4459b1e90fd12cc7840e: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:05:04.507791 19402 raft_consensus.cc:2468] T 2725d2c4cb054f18b0fc8f735c15f6c2 P e5256d91808b47c195bc9b4dbd7f2b87 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 4.
I20260709 13:05:04.518450 19407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff9b0eddd810459b82d91c60777c10eb" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:05:04.540251 19480 raft_consensus.cc:1275] T 62c6c134d3d24a1ab144dd9ee6bc3f64 P 0473d2b2d01f4459b1e90fd12cc7840e [term 6 FOLLOWER]: Refusing update from remote peer e61c3a8f61bb48f8a963c9480e53c168: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:05:04.542726 21524 consensus_queue.cc:1048] T 62c6c134d3d24a1ab144dd9ee6bc3f64 P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:05:04.543798 21444 consensus_queue.cc:1048] T b9f0d59553ad444883fcf5b5909f9798 P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:05:04.545348 19403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f85fc4b527a48848e5faa083b604e36" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:05:04.495065 21411 consensus_queue.cc:260] T a08760e15aac4630a629431f56024dc8 P e5256d91808b47c195bc9b4dbd7f2b87 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
W20260709 13:05:04.568295 20078 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.2:46257, user_credentials={real_user=slave}} blocked reactor thread for 120010us
I20260709 13:05:04.527307 21554 raft_consensus.cc:493] T 28af091831594f9d8e96482078cc7625 P e5256d91808b47c195bc9b4dbd7f2b87 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:04.545034 21568 raft_consensus.cc:2749] T 46c5bfeecc314717bffe987e6844b6d0 P 0473d2b2d01f4459b1e90fd12cc7840e [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:05:04.549096 21358 raft_consensus.cc:1081] T 5ec1c4ce15e04c7e8c283a62179f2a64 P e5256d91808b47c195bc9b4dbd7f2b87 [term 1 LEADER]: Signalling peer 0473d2b2d01f4459b1e90fd12cc7840e to start an election
I20260709 13:05:04.561856 21561 raft_consensus.cc:3060] T 46c5bfeecc314717bffe987e6844b6d0 P e61c3a8f61bb48f8a963c9480e53c168 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:05:04.629411 19407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9962423cb4e54fcfa5de01daf68a86e7" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
I20260709 13:05:04.630272 19407 raft_consensus.cc:3060] T 9962423cb4e54fcfa5de01daf68a86e7 P e5256d91808b47c195bc9b4dbd7f2b87 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:05:04.631927 20108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff9b0eddd810459b82d91c60777c10eb" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:05:04.643864 19407 raft_consensus.cc:2468] T 9962423cb4e54fcfa5de01daf68a86e7 P e5256d91808b47c195bc9b4dbd7f2b87 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 127766fc592545a4997f7790f50f6076 in term 8.
W20260709 13:05:04.653934 20076 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.3:36891, user_credentials={real_user=slave}} blocked reactor thread for 195560us
I20260709 13:05:04.655930 19449 leader_election.cc:304] T ff9b0eddd810459b82d91c60777c10eb P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e; no voters: 127766fc592545a4997f7790f50f6076, e5256d91808b47c195bc9b4dbd7f2b87
W20260709 13:05:04.657335 19374 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:04.658499 21430 raft_consensus.cc:2749] T ff9b0eddd810459b82d91c60777c10eb P 0473d2b2d01f4459b1e90fd12cc7840e [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:05:04.637179 20108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f85fc4b527a48848e5faa083b604e36" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:05:04.720909 19479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9962423cb4e54fcfa5de01daf68a86e7" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:05:04.575824 21554 raft_consensus.cc:515] T 28af091831594f9d8e96482078cc7625 P e5256d91808b47c195bc9b4dbd7f2b87 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:04.713133 21553 leader_election.cc:290] T 9962423cb4e54fcfa5de01daf68a86e7 P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 8 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
W20260709 13:05:04.806691 20076 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.3:36891, user_credentials={real_user=slave}} blocked reactor thread for 144172us
I20260709 13:05:05.013708 19479 raft_consensus.cc:3060] T 9962423cb4e54fcfa5de01daf68a86e7 P 0473d2b2d01f4459b1e90fd12cc7840e [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:05:04.665589 21576 consensus_queue.cc:1059] T 48824d5acfbc485ebf8c2d944e7202de P 127766fc592545a4997f7790f50f6076 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.111s
I20260709 13:05:05.015579 21554 leader_election.cc:290] T 28af091831594f9d8e96482078cc7625 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
W20260709 13:05:05.083324 19377 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.600s	user 0.006s	sys 0.007s
W20260709 13:05:05.082769 19408 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.616s	user 0.007s	sys 0.005s
W20260709 13:05:05.087044 19525 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:05:05.070513 21525 consensus_meta.cc:287] T 1a61655d99124a29b486ba4a5b37faea P 0473d2b2d01f4459b1e90fd12cc7840e: Time spent flushing consensus metadata: real 0.675s	user 0.005s	sys 0.016s
W20260709 13:05:05.089708 19377 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.606s	user 0.006s	sys 0.007s
W20260709 13:05:05.090904 19408 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.624s	user 0.007s	sys 0.005s
I20260709 13:05:05.030577 21599 raft_consensus.cc:493] T 70797e5783b5454ab0d0eea663e791e3 P 127766fc592545a4997f7790f50f6076 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:05:05.094475 19377 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.2:46257, user_credentials={real_user=slave}} blocked reactor thread for 611154us
W20260709 13:05:05.101647 20076 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.3:36891, user_credentials={real_user=slave}} blocked reactor thread for 58528.9us
I20260709 13:05:05.141832 19479 raft_consensus.cc:2468] T 9962423cb4e54fcfa5de01daf68a86e7 P 0473d2b2d01f4459b1e90fd12cc7840e [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 127766fc592545a4997f7790f50f6076 in term 8.
I20260709 13:05:05.089987 21338 raft_consensus.cc:493] T 40e1e16737a842ee936002830f36882e P 0473d2b2d01f4459b1e90fd12cc7840e [term 4 FOLLOWER]: Starting pre-election (detected failure of leader e5256d91808b47c195bc9b4dbd7f2b87)
I20260709 13:05:05.161995 21576 raft_consensus.cc:3055] T 48824d5acfbc485ebf8c2d944e7202de P 127766fc592545a4997f7790f50f6076 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:05:05.143177 21599 raft_consensus.cc:515] T 70797e5783b5454ab0d0eea663e791e3 P 127766fc592545a4997f7790f50f6076 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:05:05.163000 21338 raft_consensus.cc:515] T 40e1e16737a842ee936002830f36882e P 0473d2b2d01f4459b1e90fd12cc7840e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:05.180068 21576 raft_consensus.cc:740] T 48824d5acfbc485ebf8c2d944e7202de P 127766fc592545a4997f7790f50f6076 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 127766fc592545a4997f7790f50f6076, State: Running, Role: LEADER
W20260709 13:05:05.210429 21590 log.cc:927] Time spent T 3e1f505cb0f1427bbd698ac889d80821 P e5256d91808b47c195bc9b4dbd7f2b87: Append to log took a long time: real 0.364s	user 0.001s	sys 0.013s
I20260709 13:05:05.215977 21358 raft_consensus.cc:493] T 14935b3ddf914369822e4a0547aaa355 P e5256d91808b47c195bc9b4dbd7f2b87 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:05.216574 21358 raft_consensus.cc:515] T 14935b3ddf914369822e4a0547aaa355 P e5256d91808b47c195bc9b4dbd7f2b87 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } attrs { replace: true } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
W20260709 13:05:05.217303 21520 consensus_meta.cc:287] T 4af19371ea874c09a0a2147040835cbb P 127766fc592545a4997f7790f50f6076: Time spent flushing consensus metadata: real 0.933s	user 0.014s	sys 0.009s
I20260709 13:05:05.220395 19409 raft_consensus.cc:1275] T 2725d2c4cb054f18b0fc8f735c15f6c2 P e5256d91808b47c195bc9b4dbd7f2b87 [term 4 FOLLOWER]: Refusing update from remote peer e61c3a8f61bb48f8a963c9480e53c168: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:05:05.194293 21559 raft_consensus.cc:493] T 2e36a9d6e29c4a7c860cf267efbd4c74 P e61c3a8f61bb48f8a963c9480e53c168 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 0473d2b2d01f4459b1e90fd12cc7840e)
I20260709 13:05:05.232414 21613 raft_consensus.cc:493] T 21e14947d70440f19044d8f75c31e1f9 P e61c3a8f61bb48f8a963c9480e53c168 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:05.233029 21600 raft_consensus.cc:493] T 14935b3ddf914369822e4a0547aaa355 P 127766fc592545a4997f7790f50f6076 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e5256d91808b47c195bc9b4dbd7f2b87)
I20260709 13:05:05.249152 21600 raft_consensus.cc:515] T 14935b3ddf914369822e4a0547aaa355 P 127766fc592545a4997f7790f50f6076 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } attrs { replace: true } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:05:05.256732 21411 raft_consensus.cc:3060] T a08760e15aac4630a629431f56024dc8 P e5256d91808b47c195bc9b4dbd7f2b87 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:05:05.233636 21595 log.cc:927] Time spent T df751f992649444090e27965eb1af85d P e61c3a8f61bb48f8a963c9480e53c168: Append to log took a long time: real 0.063s	user 0.000s	sys 0.000s
W20260709 13:05:05.234176 21598 log.cc:927] Time spent T 28af091831594f9d8e96482078cc7625 P e61c3a8f61bb48f8a963c9480e53c168: Append to log took a long time: real 0.076s	user 0.000s	sys 0.001s
I20260709 13:05:05.235141 21608 raft_consensus.cc:493] T d1e5873a19244c5ebbcd38e126796ee7 P e5256d91808b47c195bc9b4dbd7f2b87 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader e61c3a8f61bb48f8a963c9480e53c168)
I20260709 13:05:05.234190 19402 raft_consensus.cc:1275] T df751f992649444090e27965eb1af85d P e5256d91808b47c195bc9b4dbd7f2b87 [term 5 FOLLOWER]: Refusing update from remote peer e61c3a8f61bb48f8a963c9480e53c168: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
W20260709 13:05:05.237924 21588 log.cc:927] Time spent T ab43d85f64114d4ebf618930e43d9ed0 P e5256d91808b47c195bc9b4dbd7f2b87: Append to log took a long time: real 0.144s	user 0.002s	sys 0.001s
I20260709 13:05:05.238449 19555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28af091831594f9d8e96482078cc7625" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 7 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
W20260709 13:05:05.244797 21561 consensus_meta.cc:287] T 46c5bfeecc314717bffe987e6844b6d0 P e61c3a8f61bb48f8a963c9480e53c168: Time spent flushing consensus metadata: real 0.625s	user 0.015s	sys 0.000s
I20260709 13:05:05.260929 20112 raft_consensus.cc:1275] T ab43d85f64114d4ebf618930e43d9ed0 P 127766fc592545a4997f7790f50f6076 [term 5 LEARNER]: Refusing update from remote peer e61c3a8f61bb48f8a963c9480e53c168: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 13:05:05.258134 19406 raft_consensus.cc:1275] T ab43d85f64114d4ebf618930e43d9ed0 P e5256d91808b47c195bc9b4dbd7f2b87 [term 5 FOLLOWER]: Refusing update from remote peer e61c3a8f61bb48f8a963c9480e53c168: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 13:05:05.238344 21576 consensus_queue.cc:260] T 48824d5acfbc485ebf8c2d944e7202de P 127766fc592545a4997f7790f50f6076 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
W20260709 13:05:05.332659 21594 log.cc:927] Time spent T 0cdf56e38bbc453d9438d359e5a69955 P 0473d2b2d01f4459b1e90fd12cc7840e: Append to log took a long time: real 0.239s	user 0.000s	sys 0.000s
I20260709 13:05:05.336592 21338 leader_election.cc:290] T 40e1e16737a842ee936002830f36882e P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
W20260709 13:05:05.339167 19523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.1:40321, user_credentials={real_user=slave}} blocked reactor thread for 66115.9us
I20260709 13:05:05.339659 19406 raft_consensus.cc:3060] T fa8650e71aa14778b3d73721fc50d9fc P e5256d91808b47c195bc9b4dbd7f2b87 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:05:05.341828 21336 consensus_queue.cc:1048] T 2725d2c4cb054f18b0fc8f735c15f6c2 P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:05:05.349097 19406 raft_consensus.cc:1275] T fa8650e71aa14778b3d73721fc50d9fc P e5256d91808b47c195bc9b4dbd7f2b87 [term 5 FOLLOWER]: Refusing update from remote peer 0473d2b2d01f4459b1e90fd12cc7840e: Log matching property violated. Preceding OpId in replica: term: 4 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:05:05.343274 21336 consensus_queue.cc:1048] T ab43d85f64114d4ebf618930e43d9ed0 P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Connected to new peer: Peer: permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.015s
I20260709 13:05:05.270864 21613 raft_consensus.cc:515] T 21e14947d70440f19044d8f75c31e1f9 P e61c3a8f61bb48f8a963c9480e53c168 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:05.383975 19555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14935b3ddf914369822e4a0547aaa355" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:05:05.388646 19555 raft_consensus.cc:2393] T 14935b3ddf914369822e4a0547aaa355 P e61c3a8f61bb48f8a963c9480e53c168 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 127766fc592545a4997f7790f50f6076 in current term 3: Already voted for candidate e61c3a8f61bb48f8a963c9480e53c168 in this term.
I20260709 13:05:05.258773 21559 raft_consensus.cc:515] T 2e36a9d6e29c4a7c860cf267efbd4c74 P e61c3a8f61bb48f8a963c9480e53c168 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:05.392598 19481 raft_consensus.cc:3060] T df751f992649444090e27965eb1af85d P 0473d2b2d01f4459b1e90fd12cc7840e [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:05:05.394061 19479 raft_consensus.cc:1275] T ab43d85f64114d4ebf618930e43d9ed0 P 0473d2b2d01f4459b1e90fd12cc7840e [term 5 FOLLOWER]: Refusing update from remote peer e61c3a8f61bb48f8a963c9480e53c168: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 13:05:05.394065 19483 raft_consensus.cc:1275] T 0afb57ae58a24a01850491d69f0213dd P 0473d2b2d01f4459b1e90fd12cc7840e [term 5 FOLLOWER]: Refusing update from remote peer e61c3a8f61bb48f8a963c9480e53c168: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:05:05.392962 19449 leader_election.cc:304] T 1f85fc4b527a48848e5faa083b604e36 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e; no voters: 127766fc592545a4997f7790f50f6076, e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:05:05.375588 21600 leader_election.cc:290] T 14935b3ddf914369822e4a0547aaa355 P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:05:05.344336 21608 raft_consensus.cc:515] T d1e5873a19244c5ebbcd38e126796ee7 P e5256d91808b47c195bc9b4dbd7f2b87 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:05.413735 19480 raft_consensus.cc:1275] T 2725d2c4cb054f18b0fc8f735c15f6c2 P 0473d2b2d01f4459b1e90fd12cc7840e [term 4 FOLLOWER]: Refusing update from remote peer e61c3a8f61bb48f8a963c9480e53c168: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:05:05.446513 19486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14935b3ddf914369822e4a0547aaa355" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:05:05.452907 19486 raft_consensus.cc:2468] T 14935b3ddf914369822e4a0547aaa355 P 0473d2b2d01f4459b1e90fd12cc7840e [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 127766fc592545a4997f7790f50f6076 in term 3.
I20260709 13:05:05.440426 21547 raft_consensus.cc:493] T 40e1e16737a842ee936002830f36882e P e5256d91808b47c195bc9b4dbd7f2b87 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:05.508817 19408 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52328 (request call id 1351) took 1398 ms. Trace:
I20260709 13:05:05.518572 20078 leader_election.cc:304] T 9962423cb4e54fcfa5de01daf68a86e7 P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, 127766fc592545a4997f7790f50f6076; no voters: 
I20260709 13:05:05.524528 19478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa8650e71aa14778b3d73721fc50d9fc" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:05:05.441941 21203 consensus_queue.cc:1048] T 0afb57ae58a24a01850491d69f0213dd P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.066s
W20260709 13:05:05.527791 19526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.2:46257, user_credentials={real_user=slave}} blocked reactor thread for 96828.9us
I20260709 13:05:05.530555 19478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28af091831594f9d8e96482078cc7625" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 7 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:05:05.509254 19408 rpcz_store.cc:276] 0709 13:05:04.110259 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:04.241547 (+131288us) service_pool.cc:224] Handling call
0709 13:05:04.241841 (+   294us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:05:04.251636 (+  9795us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 13:05:04.355142 (+103506us) log.cc:844] Serialized 14 byte log entry
0709 13:05:05.231127 (+875985us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:05:05.246287 (+ 15160us) log.cc:844] Serialized 26 byte log entry
0709 13:05:05.246487 (+   200us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:05:05.406383 (+159896us) log.cc:844] Serialized 14 byte log entry
0709 13:05:05.508525 (+102142us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:05.508595 (+    70us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:05:05.508634 (+    39us) raft_consensus.cc:1685] finished
0709 13:05:05.508645 (+    11us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:05.508760 (+   115us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":135210,"prepare.queue_time_us":113932,"prepare.run_cpu_time_us":34,"prepare.run_wall_time_us":35,"raft.queue_time_us":195244,"raft.run_cpu_time_us":164,"raft.run_wall_time_us":1143,"thread_start_us":982349,"threads_started":4,"wal-append.queue_time_us":732117}
I20260709 13:05:05.552256 19480 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "5ec1c4ce15e04c7e8c283a62179f2a64"
dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
 from {username='slave'} at 127.0.0.1:58294
I20260709 13:05:05.557729 19480 raft_consensus.cc:493] T 5ec1c4ce15e04c7e8c283a62179f2a64 P 0473d2b2d01f4459b1e90fd12cc7840e [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:05.558351 19480 raft_consensus.cc:3060] T 5ec1c4ce15e04c7e8c283a62179f2a64 P 0473d2b2d01f4459b1e90fd12cc7840e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:05.560043 21203 consensus_queue.cc:1048] T 2725d2c4cb054f18b0fc8f735c15f6c2 P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:05:05.513885 21599 leader_election.cc:290] T 70797e5783b5454ab0d0eea663e791e3 P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:05:05.566479 19551 raft_consensus.cc:1275] T fa8650e71aa14778b3d73721fc50d9fc P e61c3a8f61bb48f8a963c9480e53c168 [term 5 FOLLOWER]: Refusing update from remote peer 0473d2b2d01f4459b1e90fd12cc7840e: Log matching property violated. Preceding OpId in replica: term: 4 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
W20260709 13:05:05.566862 21585 log.cc:927] Time spent T 62c6c134d3d24a1ab144dd9ee6bc3f64 P 127766fc592545a4997f7790f50f6076: Append to log took a long time: real 0.063s	user 0.000s	sys 0.000s
I20260709 13:05:05.542959 21600 raft_consensus.cc:2804] T 9962423cb4e54fcfa5de01daf68a86e7 P 127766fc592545a4997f7790f50f6076 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:05:05.536747 21561 raft_consensus.cc:493] T ff75a1d4cb1f493db8f71ddc136ba9ab P e61c3a8f61bb48f8a963c9480e53c168 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 0473d2b2d01f4459b1e90fd12cc7840e)
I20260709 13:05:05.553755 21358 leader_election.cc:290] T 14935b3ddf914369822e4a0547aaa355 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:05:05.563262 21582 raft_consensus.cc:493] T 2e36a9d6e29c4a7c860cf267efbd4c74 P 0473d2b2d01f4459b1e90fd12cc7840e [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:05.554000 21524 raft_consensus.cc:493] T b08304a0a02b42d7840c4e8ee9a6bd1a P e61c3a8f61bb48f8a963c9480e53c168 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 0473d2b2d01f4459b1e90fd12cc7840e)
I20260709 13:05:05.516812 21547 raft_consensus.cc:515] T 40e1e16737a842ee936002830f36882e P e5256d91808b47c195bc9b4dbd7f2b87 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:05.580089 19377 leader_election.cc:304] T 28af091831594f9d8e96482078cc7625 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:05:05.583328 19551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40e1e16737a842ee936002830f36882e" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
W20260709 13:05:05.575994 21625 log.cc:927] Time spent T 0afb57ae58a24a01850491d69f0213dd P 127766fc592545a4997f7790f50f6076: Append to log took a long time: real 0.060s	user 0.000s	sys 0.000s
I20260709 13:05:05.584800 19551 raft_consensus.cc:2393] T 40e1e16737a842ee936002830f36882e P e61c3a8f61bb48f8a963c9480e53c168 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0473d2b2d01f4459b1e90fd12cc7840e in current term 5: Already voted for candidate e61c3a8f61bb48f8a963c9480e53c168 in this term.
I20260709 13:05:05.591131 19477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14935b3ddf914369822e4a0547aaa355" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:05:05.591864 19477 raft_consensus.cc:2468] T 14935b3ddf914369822e4a0547aaa355 P 0473d2b2d01f4459b1e90fd12cc7840e [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 3.
W20260709 13:05:05.594199 19526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.2:46257, user_credentials={real_user=slave}} blocked reactor thread for 60014.4us
I20260709 13:05:05.594926 21615 consensus_queue.cc:1048] T ab43d85f64114d4ebf618930e43d9ed0 P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.158s
I20260709 13:05:05.584554 21358 raft_consensus.cc:493] T 2e36a9d6e29c4a7c860cf267efbd4c74 P e5256d91808b47c195bc9b4dbd7f2b87 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:05:05.598824 21605 log.cc:927] Time spent T 0cdf56e38bbc453d9438d359e5a69955 P e5256d91808b47c195bc9b4dbd7f2b87: Append to log took a long time: real 0.069s	user 0.000s	sys 0.000s
I20260709 13:05:05.598716 21358 raft_consensus.cc:515] T 2e36a9d6e29c4a7c860cf267efbd4c74 P e5256d91808b47c195bc9b4dbd7f2b87 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
W20260709 13:05:05.600185 21626 log.cc:927] Time spent T 28af091831594f9d8e96482078cc7625 P e5256d91808b47c195bc9b4dbd7f2b87: Append to log took a long time: real 0.087s	user 0.000s	sys 0.000s
I20260709 13:05:05.601454 21358 leader_election.cc:290] T 2e36a9d6e29c4a7c860cf267efbd4c74 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:05:05.597602 21622 raft_consensus.cc:493] T bc225c93219c45538b53a1bd3d387e4d P 0473d2b2d01f4459b1e90fd12cc7840e [term 6 FOLLOWER]: Starting pre-election (detected failure of leader e61c3a8f61bb48f8a963c9480e53c168)
I20260709 13:05:05.606508 21622 raft_consensus.cc:515] T bc225c93219c45538b53a1bd3d387e4d P 0473d2b2d01f4459b1e90fd12cc7840e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
W20260709 13:05:05.614944 19525 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:05.570333 21612 raft_consensus.cc:2749] T 1f85fc4b527a48848e5faa083b604e36 P 0473d2b2d01f4459b1e90fd12cc7840e [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:05:05.569793 21571 consensus_queue.cc:1048] T fa8650e71aa14778b3d73721fc50d9fc P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.178s
I20260709 13:05:05.602550 21636 raft_consensus.cc:2749] T 28af091831594f9d8e96482078cc7625 P e5256d91808b47c195bc9b4dbd7f2b87 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:05:05.602097 19481 raft_consensus.cc:1275] T df751f992649444090e27965eb1af85d P 0473d2b2d01f4459b1e90fd12cc7840e [term 5 FOLLOWER]: Refusing update from remote peer e61c3a8f61bb48f8a963c9480e53c168: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:05:05.583815 21600 raft_consensus.cc:697] T 9962423cb4e54fcfa5de01daf68a86e7 P 127766fc592545a4997f7790f50f6076 [term 8 LEADER]: Becoming Leader. State: Replica: 127766fc592545a4997f7790f50f6076, State: Running, Role: LEADER
I20260709 13:05:05.590546 21478 raft_consensus.cc:493] T d1e5873a19244c5ebbcd38e126796ee7 P e61c3a8f61bb48f8a963c9480e53c168 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:05.577685 21561 raft_consensus.cc:515] T ff75a1d4cb1f493db8f71ddc136ba9ab P e61c3a8f61bb48f8a963c9480e53c168 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:05.624943 21633 raft_consensus.cc:493] T bc225c93219c45538b53a1bd3d387e4d P e5256d91808b47c195bc9b4dbd7f2b87 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:05.585351 21582 raft_consensus.cc:515] T 2e36a9d6e29c4a7c860cf267efbd4c74 P 0473d2b2d01f4459b1e90fd12cc7840e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:05.636541 21634 raft_consensus.cc:493] T ece3db938bc649d4a40a51522ed5259c P e61c3a8f61bb48f8a963c9480e53c168 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 127766fc592545a4997f7790f50f6076)
I20260709 13:05:05.637327 21634 raft_consensus.cc:515] T ece3db938bc649d4a40a51522ed5259c P e61c3a8f61bb48f8a963c9480e53c168 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:05:05.638870 21613 leader_election.cc:290] T 21e14947d70440f19044d8f75c31e1f9 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:05:05.639889 21633 raft_consensus.cc:515] T bc225c93219c45538b53a1bd3d387e4d P e5256d91808b47c195bc9b4dbd7f2b87 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:05.640259 21617 consensus_queue.cc:1048] T df751f992649444090e27965eb1af85d P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:05:05.631157 19480 raft_consensus.cc:515] T 5ec1c4ce15e04c7e8c283a62179f2a64 P 0473d2b2d01f4459b1e90fd12cc7840e [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:05:05.642210 19478 raft_consensus.cc:1240] T 5ec1c4ce15e04c7e8c283a62179f2a64 P 0473d2b2d01f4459b1e90fd12cc7840e [term 2 FOLLOWER]: Rejecting Update request from peer e5256d91808b47c195bc9b4dbd7f2b87 for earlier term 1. Current term is 2. Ops: []
I20260709 13:05:05.642280 21616 raft_consensus.cc:493] T 14efcc79969f41babe5529c22d59156d P 127766fc592545a4997f7790f50f6076 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader e5256d91808b47c195bc9b4dbd7f2b87)
I20260709 13:05:05.642827 21616 raft_consensus.cc:515] T 14efcc79969f41babe5529c22d59156d P 127766fc592545a4997f7790f50f6076 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:05:05.586961 21524 raft_consensus.cc:515] T b08304a0a02b42d7840c4e8ee9a6bd1a P e61c3a8f61bb48f8a963c9480e53c168 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:05.646227 19556 raft_consensus.cc:1275] T b9f0d59553ad444883fcf5b5909f9798 P e61c3a8f61bb48f8a963c9480e53c168 [term 5 FOLLOWER]: Refusing update from remote peer 0473d2b2d01f4459b1e90fd12cc7840e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:05:05.631713 21478 raft_consensus.cc:515] T d1e5873a19244c5ebbcd38e126796ee7 P e61c3a8f61bb48f8a963c9480e53c168 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:05.644917 21616 leader_election.cc:290] T 14efcc79969f41babe5529c22d59156d P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:05:05.656248 21478 leader_election.cc:290] T d1e5873a19244c5ebbcd38e126796ee7 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:05:05.651429 21471 raft_consensus.cc:493] T 1a61655d99124a29b486ba4a5b37faea P 0473d2b2d01f4459b1e90fd12cc7840e [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:05.657110 21471 raft_consensus.cc:515] T 1a61655d99124a29b486ba4a5b37faea P 0473d2b2d01f4459b1e90fd12cc7840e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:05.658468 21550 raft_consensus.cc:493] T d1e5873a19244c5ebbcd38e126796ee7 P 0473d2b2d01f4459b1e90fd12cc7840e [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:05.659152 21550 raft_consensus.cc:515] T d1e5873a19244c5ebbcd38e126796ee7 P 0473d2b2d01f4459b1e90fd12cc7840e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:05.661186 21547 leader_election.cc:290] T 40e1e16737a842ee936002830f36882e P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:05:05.625630 21559 leader_election.cc:290] T 2e36a9d6e29c4a7c860cf267efbd4c74 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:05:05.661725 19479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e36a9d6e29c4a7c860cf267efbd4c74" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:05:05.662410 21550 leader_election.cc:290] T d1e5873a19244c5ebbcd38e126796ee7 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:05:05.662294 21600 consensus_queue.cc:237] T 9962423cb4e54fcfa5de01daf68a86e7 P 127766fc592545a4997f7790f50f6076 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.6, Last appended by leader: 6, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:05:05.663589 19483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14efcc79969f41babe5529c22d59156d" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:05:05.667490 21524 leader_election.cc:290] T b08304a0a02b42d7840c4e8ee9a6bd1a P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:05:05.662335 19479 raft_consensus.cc:2468] T 2e36a9d6e29c4a7c860cf267efbd4c74 P 0473d2b2d01f4459b1e90fd12cc7840e [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 3.
I20260709 13:05:05.676328 19556 raft_consensus.cc:1275] T f1b10566f45d4a7d9029858330e02d5b P e61c3a8f61bb48f8a963c9480e53c168 [term 6 FOLLOWER]: Refusing update from remote peer 0473d2b2d01f4459b1e90fd12cc7840e: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 13:05:05.651857 21608 leader_election.cc:290] T d1e5873a19244c5ebbcd38e126796ee7 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:05:05.689738 21550 consensus_queue.cc:1048] T fa8650e71aa14778b3d73721fc50d9fc P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:05:05.690858 21559 raft_consensus.cc:493] T 70797e5783b5454ab0d0eea663e791e3 P e61c3a8f61bb48f8a963c9480e53c168 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:05.691202 21582 leader_election.cc:290] T 2e36a9d6e29c4a7c860cf267efbd4c74 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:05:05.691376 21559 raft_consensus.cc:515] T 70797e5783b5454ab0d0eea663e791e3 P e61c3a8f61bb48f8a963c9480e53c168 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:05:05.691718 21562 consensus_queue.cc:1048] T b9f0d59553ad444883fcf5b5909f9798 P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:05.693564 21559 leader_election.cc:290] T 70797e5783b5454ab0d0eea663e791e3 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:05:05.695762 21622 leader_election.cc:290] T bc225c93219c45538b53a1bd3d387e4d P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:05:05.696374 21561 leader_election.cc:290] T ff75a1d4cb1f493db8f71ddc136ba9ab P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:05:05.698393 19556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc225c93219c45538b53a1bd3d387e4d" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:05:05.699148 19556 raft_consensus.cc:2468] T bc225c93219c45538b53a1bd3d387e4d P e61c3a8f61bb48f8a963c9480e53c168 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 7.
I20260709 13:05:05.702435 19560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e5873a19244c5ebbcd38e126796ee7" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:05:05.703207 19560 raft_consensus.cc:2468] T d1e5873a19244c5ebbcd38e126796ee7 P e61c3a8f61bb48f8a963c9480e53c168 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 5.
I20260709 13:05:05.720722 21616 raft_consensus.cc:493] T 4af19371ea874c09a0a2147040835cbb P 127766fc592545a4997f7790f50f6076 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:05.721721 19403 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "14935b3ddf914369822e4a0547aaa355"
dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:52318
I20260709 13:05:05.722082 19479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21e14947d70440f19044d8f75c31e1f9" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:05:05.722404 19403 raft_consensus.cc:606] T 14935b3ddf914369822e4a0547aaa355 P e5256d91808b47c195bc9b4dbd7f2b87 [term 3 FOLLOWER]: Received request to transfer leadership
I20260709 13:05:05.722872 19403 raft_consensus.cc:614] T 14935b3ddf914369822e4a0547aaa355 P e5256d91808b47c195bc9b4dbd7f2b87 [term 3 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:05:05.725010 19560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e36a9d6e29c4a7c860cf267efbd4c74" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:05:05.725826 19560 raft_consensus.cc:2468] T 2e36a9d6e29c4a7c860cf267efbd4c74 P e61c3a8f61bb48f8a963c9480e53c168 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 2.
I20260709 13:05:05.726246 19479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff75a1d4cb1f493db8f71ddc136ba9ab" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:05:05.727624 19479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b08304a0a02b42d7840c4e8ee9a6bd1a" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:05:05.651985 21633 leader_election.cc:290] T bc225c93219c45538b53a1bd3d387e4d P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:05:05.727790 19450 leader_election.cc:304] T bc225c93219c45538b53a1bd3d387e4d P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:05:05.742779 19450 leader_election.cc:304] T d1e5873a19244c5ebbcd38e126796ee7 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:05:05.743629 21527 raft_consensus.cc:2804] T bc225c93219c45538b53a1bd3d387e4d P 0473d2b2d01f4459b1e90fd12cc7840e [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:05:05.743897 19450 leader_election.cc:304] T 2e36a9d6e29c4a7c860cf267efbd4c74 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:05:05.744035 21527 raft_consensus.cc:493] T bc225c93219c45538b53a1bd3d387e4d P 0473d2b2d01f4459b1e90fd12cc7840e [term 6 FOLLOWER]: Starting leader election (detected failure of leader e61c3a8f61bb48f8a963c9480e53c168)
I20260709 13:05:05.721350 21616 raft_consensus.cc:515] T 4af19371ea874c09a0a2147040835cbb P 127766fc592545a4997f7790f50f6076 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:05:05.744421 21527 raft_consensus.cc:3060] T bc225c93219c45538b53a1bd3d387e4d P 0473d2b2d01f4459b1e90fd12cc7840e [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:05:05.746078 21616 leader_election.cc:290] T 4af19371ea874c09a0a2147040835cbb P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:05:05.725303 21622 consensus_queue.cc:1048] T f1b10566f45d4a7d9029858330e02d5b P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.004s
I20260709 13:05:05.740919 21088 raft_consensus.cc:493] T 309c3ca0ca4b4f3ba129752ea2cb293b P 0473d2b2d01f4459b1e90fd12cc7840e [term 5 FOLLOWER]: Starting pre-election (detected failure of leader e5256d91808b47c195bc9b4dbd7f2b87)
I20260709 13:05:05.747326 21088 raft_consensus.cc:515] T 309c3ca0ca4b4f3ba129752ea2cb293b P 0473d2b2d01f4459b1e90fd12cc7840e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } attrs { replace: true } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:05:05.748095 21562 raft_consensus.cc:2804] T d1e5873a19244c5ebbcd38e126796ee7 P 0473d2b2d01f4459b1e90fd12cc7840e [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:05:05.748468 21562 raft_consensus.cc:493] T d1e5873a19244c5ebbcd38e126796ee7 P 0473d2b2d01f4459b1e90fd12cc7840e [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:05.748801 21562 raft_consensus.cc:3060] T d1e5873a19244c5ebbcd38e126796ee7 P 0473d2b2d01f4459b1e90fd12cc7840e [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:05:05.749737 19403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40e1e16737a842ee936002830f36882e" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:05:05.751073 21338 raft_consensus.cc:2804] T 2e36a9d6e29c4a7c860cf267efbd4c74 P 0473d2b2d01f4459b1e90fd12cc7840e [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:05:05.751657 21338 raft_consensus.cc:493] T 2e36a9d6e29c4a7c860cf267efbd4c74 P 0473d2b2d01f4459b1e90fd12cc7840e [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:05.751984 21338 raft_consensus.cc:3060] T 2e36a9d6e29c4a7c860cf267efbd4c74 P 0473d2b2d01f4459b1e90fd12cc7840e [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:05:05.752085 19408 raft_consensus.cc:1275] T f1b10566f45d4a7d9029858330e02d5b P e5256d91808b47c195bc9b4dbd7f2b87 [term 6 FOLLOWER]: Refusing update from remote peer 0473d2b2d01f4459b1e90fd12cc7840e: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 13:05:05.753763 19479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e5873a19244c5ebbcd38e126796ee7" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:05:05.751118 21537 leader_election.cc:290] T fa8650e71aa14778b3d73721fc50d9fc P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:05:05.759881 19411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc225c93219c45538b53a1bd3d387e4d" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:05:05.721027 21634 leader_election.cc:290] T ece3db938bc649d4a40a51522ed5259c P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:05:05.783741 19403 raft_consensus.cc:2468] T 40e1e16737a842ee936002830f36882e P e5256d91808b47c195bc9b4dbd7f2b87 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 5.
I20260709 13:05:05.790508 19411 raft_consensus.cc:2393] T bc225c93219c45538b53a1bd3d387e4d P e5256d91808b47c195bc9b4dbd7f2b87 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0473d2b2d01f4459b1e90fd12cc7840e in current term 7: Already voted for candidate e5256d91808b47c195bc9b4dbd7f2b87 in this term.
W20260709 13:05:05.788945 21591 log.cc:927] Time spent T f1b10566f45d4a7d9029858330e02d5b P 0473d2b2d01f4459b1e90fd12cc7840e: Append to log took a long time: real 0.719s	user 0.003s	sys 0.007s
I20260709 13:05:05.809413 21524 raft_consensus.cc:493] T 85c494af21f9457a85da47b9bc70c1fd P e61c3a8f61bb48f8a963c9480e53c168 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e5256d91808b47c195bc9b4dbd7f2b87)
I20260709 13:05:05.809945 21524 raft_consensus.cc:515] T 85c494af21f9457a85da47b9bc70c1fd P e61c3a8f61bb48f8a963c9480e53c168 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:05:05.810352 19407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14efcc79969f41babe5529c22d59156d" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:05:05.811694 21630 raft_consensus.cc:493] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P e5256d91808b47c195bc9b4dbd7f2b87 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 127766fc592545a4997f7790f50f6076)
I20260709 13:05:05.811846 19408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70797e5783b5454ab0d0eea663e791e3" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:05:05.812192 21630 raft_consensus.cc:515] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P e5256d91808b47c195bc9b4dbd7f2b87 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:05:05.814369 21630 leader_election.cc:290] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:05:05.814868 21623 raft_consensus.cc:493] T fa731b585f684a7fb2d106c50f143b83 P e5256d91808b47c195bc9b4dbd7f2b87 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 127766fc592545a4997f7790f50f6076)
I20260709 13:05:05.810587 21411 raft_consensus.cc:493] T 70797e5783b5454ab0d0eea663e791e3 P e5256d91808b47c195bc9b4dbd7f2b87 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:05.815918 19403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14935b3ddf914369822e4a0547aaa355" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:05:05.818157 19411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e5873a19244c5ebbcd38e126796ee7" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:05:05.825351 19411 raft_consensus.cc:2468] T d1e5873a19244c5ebbcd38e126796ee7 P e5256d91808b47c195bc9b4dbd7f2b87 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 4.
I20260709 13:05:05.821959 19556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "309c3ca0ca4b4f3ba129752ea2cb293b" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:05:05.824513 19403 raft_consensus.cc:2468] T 14935b3ddf914369822e4a0547aaa355 P e5256d91808b47c195bc9b4dbd7f2b87 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 127766fc592545a4997f7790f50f6076 in term 3.
I20260709 13:05:05.839380 19410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4af19371ea874c09a0a2147040835cbb" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:05:05.840044 19410 raft_consensus.cc:2468] T 4af19371ea874c09a0a2147040835cbb P e5256d91808b47c195bc9b4dbd7f2b87 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 127766fc592545a4997f7790f50f6076 in term 2.
I20260709 13:05:05.866488 20075 leader_election.cc:304] T 14efcc79969f41babe5529c22d59156d P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 127766fc592545a4997f7790f50f6076; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:05:05.872550 20075 leader_election.cc:304] T 14935b3ddf914369822e4a0547aaa355 P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, 127766fc592545a4997f7790f50f6076, e5256d91808b47c195bc9b4dbd7f2b87; no voters: 
I20260709 13:05:05.873667 20075 leader_election.cc:304] T 4af19371ea874c09a0a2147040835cbb P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 127766fc592545a4997f7790f50f6076, e5256d91808b47c195bc9b4dbd7f2b87; no voters: 
I20260709 13:05:05.878790 21596 raft_consensus.cc:493] T 833a2f0775ed407a94b8924ce50adb63 P 127766fc592545a4997f7790f50f6076 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader e5256d91808b47c195bc9b4dbd7f2b87)
I20260709 13:05:05.879077 20109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36f6ba92b9ba46babe4ebd6c02e5fbd9" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:05:05.879451 21596 raft_consensus.cc:515] T 833a2f0775ed407a94b8924ce50adb63 P 127766fc592545a4997f7790f50f6076 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:05:05.838804 21633 raft_consensus.cc:493] T 2a16f7501e2444fb86d4e2778e734e02 P e5256d91808b47c195bc9b4dbd7f2b87 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 127766fc592545a4997f7790f50f6076)
W20260709 13:05:05.895922 19377 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.2:46257, user_credentials={real_user=slave}} blocked reactor thread for 302085us
I20260709 13:05:05.838905 21411 raft_consensus.cc:515] T 70797e5783b5454ab0d0eea663e791e3 P e5256d91808b47c195bc9b4dbd7f2b87 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:05:05.881727 21088 leader_election.cc:290] T 309c3ca0ca4b4f3ba129752ea2cb293b P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:05:05.828744 21623 raft_consensus.cc:515] T fa731b585f684a7fb2d106c50f143b83 P e5256d91808b47c195bc9b4dbd7f2b87 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:05:05.894557 21201 consensus_queue.cc:1048] T f1b10566f45d4a7d9029858330e02d5b P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.027s
I20260709 13:05:05.917722 19408 raft_consensus.cc:2468] T 70797e5783b5454ab0d0eea663e791e3 P e5256d91808b47c195bc9b4dbd7f2b87 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 127766fc592545a4997f7790f50f6076 in term 4.
I20260709 13:05:05.918509 19404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "833a2f0775ed407a94b8924ce50adb63" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:05:05.909322 21616 raft_consensus.cc:2749] T 14efcc79969f41babe5529c22d59156d P 127766fc592545a4997f7790f50f6076 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:05:05.900596 21633 raft_consensus.cc:515] T 2a16f7501e2444fb86d4e2778e734e02 P e5256d91808b47c195bc9b4dbd7f2b87 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:05:05.919294 21539 raft_consensus.cc:493] T 4509b76741dc428e9201c70c1658da13 P e61c3a8f61bb48f8a963c9480e53c168 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e5256d91808b47c195bc9b4dbd7f2b87)
I20260709 13:05:05.923481 21554 raft_consensus.cc:493] T 3e1f505cb0f1427bbd698ac889d80821 P e5256d91808b47c195bc9b4dbd7f2b87 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader e61c3a8f61bb48f8a963c9480e53c168)
I20260709 13:05:05.920938 21547 raft_consensus.cc:493] T 65d8cb8d6ec64f459d5a47cefab10acf P e5256d91808b47c195bc9b4dbd7f2b87 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e61c3a8f61bb48f8a963c9480e53c168)
I20260709 13:05:05.926175 21641 raft_consensus.cc:493] T 7f575b143b844aa096b50997dad3516a P e61c3a8f61bb48f8a963c9480e53c168 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e5256d91808b47c195bc9b4dbd7f2b87)
I20260709 13:05:05.927932 21527 raft_consensus.cc:515] T bc225c93219c45538b53a1bd3d387e4d P 0473d2b2d01f4459b1e90fd12cc7840e [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:05.929342 21586 raft_consensus.cc:2804] T 14935b3ddf914369822e4a0547aaa355 P 127766fc592545a4997f7790f50f6076 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:05:05.930220 21596 leader_election.cc:290] T 833a2f0775ed407a94b8924ce50adb63 P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
W20260709 13:05:05.959733 19449 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.1:40321, user_credentials={real_user=slave}} blocked reactor thread for 143495us
I20260709 13:05:05.949716 21586 raft_consensus.cc:493] T 14935b3ddf914369822e4a0547aaa355 P 127766fc592545a4997f7790f50f6076 [term 2 FOLLOWER]: Starting leader election (detected failure of leader e5256d91808b47c195bc9b4dbd7f2b87)
I20260709 13:05:05.973706 19480 leader_election.cc:290] T 5ec1c4ce15e04c7e8c283a62179f2a64 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 2 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:05:05.934404 21562 raft_consensus.cc:515] T d1e5873a19244c5ebbcd38e126796ee7 P 0473d2b2d01f4459b1e90fd12cc7840e [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:05.973629 21403 raft_consensus.cc:2804] T 4af19371ea874c09a0a2147040835cbb P 127766fc592545a4997f7790f50f6076 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:05:05.977383 19556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14935b3ddf914369822e4a0547aaa355" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:05:05.994210 19449 leader_election.cc:304] T 40e1e16737a842ee936002830f36882e P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87; no voters: e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:05:05.994513 19556 raft_consensus.cc:2468] T 14935b3ddf914369822e4a0547aaa355 P e61c3a8f61bb48f8a963c9480e53c168 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 3.
I20260709 13:05:05.979118 19554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40e1e16737a842ee936002830f36882e" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:05:05.995182 19554 raft_consensus.cc:2468] T 40e1e16737a842ee936002830f36882e P e61c3a8f61bb48f8a963c9480e53c168 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 5.
I20260709 13:05:05.979966 19551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc225c93219c45538b53a1bd3d387e4d" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 8 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:05:05.996011 19551 raft_consensus.cc:2410] T bc225c93219c45538b53a1bd3d387e4d P e61c3a8f61bb48f8a963c9480e53c168 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e5256d91808b47c195bc9b4dbd7f2b87 for term 8 because replica has last-logged OpId of term: 6 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 2.
I20260709 13:05:05.980685 19552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e36a9d6e29c4a7c860cf267efbd4c74" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:05:05.981606 19553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e5873a19244c5ebbcd38e126796ee7" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:05:05.982362 19557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa8650e71aa14778b3d73721fc50d9fc" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:05:05.974789 21576 raft_consensus.cc:3060] T 48824d5acfbc485ebf8c2d944e7202de P 127766fc592545a4997f7790f50f6076 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:05.943297 21554 raft_consensus.cc:515] T 3e1f505cb0f1427bbd698ac889d80821 P e5256d91808b47c195bc9b4dbd7f2b87 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:05.998126 19375 leader_election.cc:304] T 14935b3ddf914369822e4a0547aaa355 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:05:05.944178 21539 raft_consensus.cc:515] T 4509b76741dc428e9201c70c1658da13 P e61c3a8f61bb48f8a963c9480e53c168 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:05.949190 21547 raft_consensus.cc:515] T 65d8cb8d6ec64f459d5a47cefab10acf P e5256d91808b47c195bc9b4dbd7f2b87 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
W20260709 13:05:06.005908 19450 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.3:36891, user_credentials={real_user=slave}} blocked reactor thread for 174038us
I20260709 13:05:05.964548 21558 raft_consensus.cc:493] T 179fd671030940b4b4a4e24bcc4aba0a P e61c3a8f61bb48f8a963c9480e53c168 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 0473d2b2d01f4459b1e90fd12cc7840e)
I20260709 13:05:06.011567 19479 raft_consensus.cc:2393] T d1e5873a19244c5ebbcd38e126796ee7 P 0473d2b2d01f4459b1e90fd12cc7840e [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e61c3a8f61bb48f8a963c9480e53c168 in current term 6: Already voted for candidate 0473d2b2d01f4459b1e90fd12cc7840e in this term.
I20260709 13:05:05.993122 21586 raft_consensus.cc:3060] T 14935b3ddf914369822e4a0547aaa355 P 127766fc592545a4997f7790f50f6076 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:05.992189 21524 leader_election.cc:290] T 85c494af21f9457a85da47b9bc70c1fd P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:05:06.014190 19407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b08304a0a02b42d7840c4e8ee9a6bd1a" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:05:05.994243 21403 raft_consensus.cc:493] T 4af19371ea874c09a0a2147040835cbb P 127766fc592545a4997f7790f50f6076 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:06.005995 19552 raft_consensus.cc:2468] T 2e36a9d6e29c4a7c860cf267efbd4c74 P e61c3a8f61bb48f8a963c9480e53c168 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 2.
I20260709 13:05:06.024343 20109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70797e5783b5454ab0d0eea663e791e3" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:05:06.019061 19409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70797e5783b5454ab0d0eea663e791e3" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:05:06.020042 19407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ece3db938bc649d4a40a51522ed5259c" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:05:06.025053 20109 raft_consensus.cc:2468] T 70797e5783b5454ab0d0eea663e791e3 P 127766fc592545a4997f7790f50f6076 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 4.
I20260709 13:05:06.030725 19407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85c494af21f9457a85da47b9bc70c1fd" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:05:06.010983 19553 raft_consensus.cc:2468] T d1e5873a19244c5ebbcd38e126796ee7 P e61c3a8f61bb48f8a963c9480e53c168 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 5.
I20260709 13:05:06.018380 20107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ece3db938bc649d4a40a51522ed5259c" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:05:06.032568 20103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85c494af21f9457a85da47b9bc70c1fd" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:05:06.036609 21554 leader_election.cc:290] T 3e1f505cb0f1427bbd698ac889d80821 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:05:06.022769 19410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e36a9d6e29c4a7c860cf267efbd4c74" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:05:06.037490 19410 raft_consensus.cc:2393] T 2e36a9d6e29c4a7c860cf267efbd4c74 P e5256d91808b47c195bc9b4dbd7f2b87 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e61c3a8f61bb48f8a963c9480e53c168 in current term 3: Already voted for candidate e5256d91808b47c195bc9b4dbd7f2b87 in this term.
I20260709 13:05:06.037894 21633 leader_election.cc:290] T 2a16f7501e2444fb86d4e2778e734e02 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:05:05.953327 21641 raft_consensus.cc:515] T 7f575b143b844aa096b50997dad3516a P e61c3a8f61bb48f8a963c9480e53c168 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:06.040253 21641 leader_election.cc:290] T 7f575b143b844aa096b50997dad3516a P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:05:06.033221 19553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70797e5783b5454ab0d0eea663e791e3" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:05:06.024374 21617 raft_consensus.cc:493] T 1a61655d99124a29b486ba4a5b37faea P e61c3a8f61bb48f8a963c9480e53c168 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:06.024773 21644 raft_consensus.cc:2804] T 14935b3ddf914369822e4a0547aaa355 P e5256d91808b47c195bc9b4dbd7f2b87 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:05:06.051065 21203 consensus_queue.cc:1048] T ab43d85f64114d4ebf618930e43d9ed0 P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:05:06.052803 21539 leader_election.cc:290] T 4509b76741dc428e9201c70c1658da13 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:05:06.053771 21539 consensus_queue.cc:1048] T df751f992649444090e27965eb1af85d P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:05:06.055002 20107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a16f7501e2444fb86d4e2778e734e02" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:05:06.055810 21547 leader_election.cc:290] T 65d8cb8d6ec64f459d5a47cefab10acf P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:05:06.057281 21562 leader_election.cc:290] T d1e5873a19244c5ebbcd38e126796ee7 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 6 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:05:06.027906 21524 raft_consensus.cc:493] T a08760e15aac4630a629431f56024dc8 P e61c3a8f61bb48f8a963c9480e53c168 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader e5256d91808b47c195bc9b4dbd7f2b87)
I20260709 13:05:06.057914 21603 raft_consensus.cc:493] T 309c3ca0ca4b4f3ba129752ea2cb293b P 127766fc592545a4997f7790f50f6076 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader e5256d91808b47c195bc9b4dbd7f2b87)
I20260709 13:05:06.018878 21558 raft_consensus.cc:515] T 179fd671030940b4b4a4e24bcc4aba0a P e61c3a8f61bb48f8a963c9480e53c168 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:06.058486 21603 raft_consensus.cc:515] T 309c3ca0ca4b4f3ba129752ea2cb293b P 127766fc592545a4997f7790f50f6076 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } attrs { replace: true } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:05:06.022351 21559 raft_consensus.cc:493] T 48824d5acfbc485ebf8c2d944e7202de P e61c3a8f61bb48f8a963c9480e53c168 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 127766fc592545a4997f7790f50f6076)
I20260709 13:05:06.024988 21403 raft_consensus.cc:3060] T 4af19371ea874c09a0a2147040835cbb P 127766fc592545a4997f7790f50f6076 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:05:06.035535 21623 leader_election.cc:290] T fa731b585f684a7fb2d106c50f143b83 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:05:06.024227 19411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e5873a19244c5ebbcd38e126796ee7" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:05:06.020190 19375 leader_election.cc:304] T 40e1e16737a842ee936002830f36882e P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:05:06.033370 21582 raft_consensus.cc:2804] T 40e1e16737a842ee936002830f36882e P 0473d2b2d01f4459b1e90fd12cc7840e [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:05:06.045951 20103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa731b585f684a7fb2d106c50f143b83" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:05:06.046644 19402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff75a1d4cb1f493db8f71ddc136ba9ab" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:05:06.024627 21638 raft_consensus.cc:493] T 46c5bfeecc314717bffe987e6844b6d0 P e61c3a8f61bb48f8a963c9480e53c168 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:05:06.049273 19525 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:06.051180 19553 raft_consensus.cc:2468] T 70797e5783b5454ab0d0eea663e791e3 P e61c3a8f61bb48f8a963c9480e53c168 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 4.
I20260709 13:05:06.032984 19404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21e14947d70440f19044d8f75c31e1f9" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:05:06.071194 19411 raft_consensus.cc:2468] T d1e5873a19244c5ebbcd38e126796ee7 P e5256d91808b47c195bc9b4dbd7f2b87 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 4.
W20260709 13:05:06.071520 19375 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.3:36891, user_credentials={real_user=slave}} blocked reactor thread for 51388.5us
I20260709 13:05:06.069041 19558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "833a2f0775ed407a94b8924ce50adb63" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:05:06.081643 20075 leader_election.cc:304] T 70797e5783b5454ab0d0eea663e791e3 P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 127766fc592545a4997f7790f50f6076, e5256d91808b47c195bc9b4dbd7f2b87; no voters: 
I20260709 13:05:06.099466 19375 leader_election.cc:304] T fa8650e71aa14778b3d73721fc50d9fc P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:05:06.082842 19408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "309c3ca0ca4b4f3ba129752ea2cb293b" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:05:06.084477 20108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65d8cb8d6ec64f459d5a47cefab10acf" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:05:06.086823 21403 raft_consensus.cc:515] T 4af19371ea874c09a0a2147040835cbb P 127766fc592545a4997f7790f50f6076 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:05:06.014887 21536 consensus_queue.cc:1059] T 5ec1c4ce15e04c7e8c283a62179f2a64 P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.061s
I20260709 13:05:06.041091 21372 raft_consensus.cc:493] T 86a6797bdfe94fa496c050ceae4bd0d9 P 0473d2b2d01f4459b1e90fd12cc7840e [term 4 FOLLOWER]: Starting pre-election (detected failure of leader e61c3a8f61bb48f8a963c9480e53c168)
I20260709 13:05:06.045966 21411 leader_election.cc:290] T 70797e5783b5454ab0d0eea663e791e3 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
W20260709 13:05:06.140343 20075 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.1:40321, user_credentials={real_user=slave}} blocked reactor thread for 58775us
I20260709 13:05:06.141844 19553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70797e5783b5454ab0d0eea663e791e3" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:05:06.059897 21558 leader_election.cc:290] T 179fd671030940b4b4a4e24bcc4aba0a P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
W20260709 13:05:06.162226 19375 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.3:36891, user_credentials={real_user=slave}} blocked reactor thread for 62815.9us
I20260709 13:05:06.195196 19375 leader_election.cc:304] T d1e5873a19244c5ebbcd38e126796ee7 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
W20260709 13:05:06.161128 19449 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.1:40321, user_credentials={real_user=slave}} blocked reactor thread for 145481us
I20260709 13:05:06.091738 21623 raft_consensus.cc:2804] T 40e1e16737a842ee936002830f36882e P e5256d91808b47c195bc9b4dbd7f2b87 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:05:06.080564 21582 raft_consensus.cc:493] T 40e1e16737a842ee936002830f36882e P 0473d2b2d01f4459b1e90fd12cc7840e [term 4 FOLLOWER]: Starting leader election (detected failure of leader e5256d91808b47c195bc9b4dbd7f2b87)
I20260709 13:05:06.207067 21623 raft_consensus.cc:493] T 40e1e16737a842ee936002830f36882e P e5256d91808b47c195bc9b4dbd7f2b87 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:06.207392 21582 raft_consensus.cc:3060] T 40e1e16737a842ee936002830f36882e P 0473d2b2d01f4459b1e90fd12cc7840e [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:05:06.167165 20076 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:06.196285 19375 leader_election.cc:304] T 2e36a9d6e29c4a7c860cf267efbd4c74 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:05:06.207942 21403 leader_election.cc:290] T 4af19371ea874c09a0a2147040835cbb P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 4 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:05:06.163980 21355 raft_consensus.cc:2804] T 70797e5783b5454ab0d0eea663e791e3 P 127766fc592545a4997f7790f50f6076 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:05:06.072675 20105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14935b3ddf914369822e4a0547aaa355" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:05:06.210773 21355 raft_consensus.cc:493] T 70797e5783b5454ab0d0eea663e791e3 P 127766fc592545a4997f7790f50f6076 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:06.212467 21355 raft_consensus.cc:3060] T 70797e5783b5454ab0d0eea663e791e3 P 127766fc592545a4997f7790f50f6076 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:05:05.379053 18300 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:05:06.051219 21617 raft_consensus.cc:515] T 1a61655d99124a29b486ba4a5b37faea P e61c3a8f61bb48f8a963c9480e53c168 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:06.057948 21524 raft_consensus.cc:515] T a08760e15aac4630a629431f56024dc8 P e61c3a8f61bb48f8a963c9480e53c168 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:06.203758 21603 leader_election.cc:290] T 309c3ca0ca4b4f3ba129752ea2cb293b P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:05:06.203642 19553 raft_consensus.cc:2468] T 70797e5783b5454ab0d0eea663e791e3 P e61c3a8f61bb48f8a963c9480e53c168 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 127766fc592545a4997f7790f50f6076 in term 4.
I20260709 13:05:06.165035 21633 raft_consensus.cc:2749] T fa8650e71aa14778b3d73721fc50d9fc P e5256d91808b47c195bc9b4dbd7f2b87 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:05:06.140395 21338 raft_consensus.cc:515] T 2e36a9d6e29c4a7c860cf267efbd4c74 P 0473d2b2d01f4459b1e90fd12cc7840e [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
W20260709 13:05:06.204988 21645 log.cc:927] Time spent T 2725d2c4cb054f18b0fc8f735c15f6c2 P 0473d2b2d01f4459b1e90fd12cc7840e: Append to log took a long time: real 0.211s	user 0.000s	sys 0.000s
I20260709 13:05:06.207525 21623 raft_consensus.cc:3060] T 40e1e16737a842ee936002830f36882e P e5256d91808b47c195bc9b4dbd7f2b87 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:05:06.196619 19523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.4:43121, user_credentials={real_user=slave}} blocked reactor thread for 113001us
I20260709 13:05:06.104317 21638 raft_consensus.cc:515] T 46c5bfeecc314717bffe987e6844b6d0 P e61c3a8f61bb48f8a963c9480e53c168 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:06.199067 19551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4af19371ea874c09a0a2147040835cbb" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:05:06.060396 21559 raft_consensus.cc:515] T 48824d5acfbc485ebf8c2d944e7202de P e61c3a8f61bb48f8a963c9480e53c168 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:05:06.261037 19551 raft_consensus.cc:2468] T 4af19371ea874c09a0a2147040835cbb P e61c3a8f61bb48f8a963c9480e53c168 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 127766fc592545a4997f7790f50f6076 in term 3.
I20260709 13:05:06.263880 19526 leader_election.cc:304] T 2e36a9d6e29c4a7c860cf267efbd4c74 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:05:06.222647 21471 leader_election.cc:290] T 1a61655d99124a29b486ba4a5b37faea P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:05:06.241370 19408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4af19371ea874c09a0a2147040835cbb" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
I20260709 13:05:06.242448 20112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "309c3ca0ca4b4f3ba129752ea2cb293b" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:05:06.267752 19523 leader_election.cc:304] T 70797e5783b5454ab0d0eea663e791e3 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 127766fc592545a4997f7790f50f6076, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:05:06.268244 19408 raft_consensus.cc:3060] T 4af19371ea874c09a0a2147040835cbb P e5256d91808b47c195bc9b4dbd7f2b87 [term 2 FOLLOWER]: Advancing to term 4
I20260709 13:05:06.244082 19406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e36a9d6e29c4a7c860cf267efbd4c74" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:05:06.244608 19405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "309c3ca0ca4b4f3ba129752ea2cb293b" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:05:06.204807 21644 raft_consensus.cc:493] T 14935b3ddf914369822e4a0547aaa355 P e5256d91808b47c195bc9b4dbd7f2b87 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:06.246953 21547 raft_consensus.cc:2804] T 2e36a9d6e29c4a7c860cf267efbd4c74 P e5256d91808b47c195bc9b4dbd7f2b87 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:05:06.248872 19411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ec1c4ce15e04c7e8c283a62179f2a64" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
I20260709 13:05:06.273345 19411 raft_consensus.cc:3055] T 5ec1c4ce15e04c7e8c283a62179f2a64 P e5256d91808b47c195bc9b4dbd7f2b87 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:05:06.238976 21571 raft_consensus.cc:493] T 14efcc79969f41babe5529c22d59156d P 0473d2b2d01f4459b1e90fd12cc7840e [term 4 FOLLOWER]: Starting pre-election (detected failure of leader e5256d91808b47c195bc9b4dbd7f2b87)
I20260709 13:05:06.250499 19404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a61655d99124a29b486ba4a5b37faea" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:05:06.275470 19404 raft_consensus.cc:2468] T 1a61655d99124a29b486ba4a5b37faea P e5256d91808b47c195bc9b4dbd7f2b87 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 1.
I20260709 13:05:06.235759 21630 raft_consensus.cc:2804] T d1e5873a19244c5ebbcd38e126796ee7 P e5256d91808b47c195bc9b4dbd7f2b87 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:05:06.191391 20107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70797e5783b5454ab0d0eea663e791e3" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:05:06.164160 21554 raft_consensus.cc:493] T ef32ce6fdd0e40d382c79974f30295c6 P e5256d91808b47c195bc9b4dbd7f2b87 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader e61c3a8f61bb48f8a963c9480e53c168)
I20260709 13:05:06.281236 19479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e36a9d6e29c4a7c860cf267efbd4c74" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:05:06.281414 19478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e5873a19244c5ebbcd38e126796ee7" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:05:06.281847 19485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40e1e16737a842ee936002830f36882e" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:05:06.282179 19478 raft_consensus.cc:2368] T d1e5873a19244c5ebbcd38e126796ee7 P 0473d2b2d01f4459b1e90fd12cc7840e [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e5256d91808b47c195bc9b4dbd7f2b87 for earlier term 5. Current term is 6.
I20260709 13:05:06.197341 21372 raft_consensus.cc:515] T 86a6797bdfe94fa496c050ceae4bd0d9 P 0473d2b2d01f4459b1e90fd12cc7840e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:06.270200 19405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e5873a19244c5ebbcd38e126796ee7" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
I20260709 13:05:06.273782 19411 raft_consensus.cc:740] T 5ec1c4ce15e04c7e8c283a62179f2a64 P e5256d91808b47c195bc9b4dbd7f2b87 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e5256d91808b47c195bc9b4dbd7f2b87, State: Running, Role: LEADER
I20260709 13:05:06.257045 21535 raft_consensus.cc:493] T ab43d85f64114d4ebf618930e43d9ed0 P e5256d91808b47c195bc9b4dbd7f2b87 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader e61c3a8f61bb48f8a963c9480e53c168)
I20260709 13:05:06.282035 19479 raft_consensus.cc:2393] T 2e36a9d6e29c4a7c860cf267efbd4c74 P 0473d2b2d01f4459b1e90fd12cc7840e [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e5256d91808b47c195bc9b4dbd7f2b87 in current term 4: Already voted for candidate 0473d2b2d01f4459b1e90fd12cc7840e in this term.
I20260709 13:05:06.282896 19410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc225c93219c45538b53a1bd3d387e4d" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
I20260709 13:05:06.256837 21536 raft_consensus.cc:493] T 179fd671030940b4b4a4e24bcc4aba0a P e5256d91808b47c195bc9b4dbd7f2b87 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 0473d2b2d01f4459b1e90fd12cc7840e)
I20260709 13:05:06.224788 21617 leader_election.cc:290] T 1a61655d99124a29b486ba4a5b37faea P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:05:06.267132 21537 raft_consensus.cc:493] T a08760e15aac4630a629431f56024dc8 P e5256d91808b47c195bc9b4dbd7f2b87 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:06.262785 21636 raft_consensus.cc:493] T 46c5bfeecc314717bffe987e6844b6d0 P e5256d91808b47c195bc9b4dbd7f2b87 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader e61c3a8f61bb48f8a963c9480e53c168)
I20260709 13:05:06.286975 19484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36f6ba92b9ba46babe4ebd6c02e5fbd9" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:05:06.277204 21478 raft_consensus.cc:2804] T 70797e5783b5454ab0d0eea663e791e3 P e61c3a8f61bb48f8a963c9480e53c168 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:05:06.291692 19483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e1f505cb0f1427bbd698ac889d80821" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:05:06.318945 20076 leader_election.cc:304] T 833a2f0775ed407a94b8924ce50adb63 P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 127766fc592545a4997f7790f50f6076; no voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:05:06.325240 19486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4509b76741dc428e9201c70c1658da13" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:05:06.292490 19410 raft_consensus.cc:2393] T bc225c93219c45538b53a1bd3d387e4d P e5256d91808b47c195bc9b4dbd7f2b87 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 0473d2b2d01f4459b1e90fd12cc7840e in current term 7: Already voted for candidate e5256d91808b47c195bc9b4dbd7f2b87 in this term.
I20260709 13:05:06.274142 21203 raft_consensus.cc:2804] T 2e36a9d6e29c4a7c860cf267efbd4c74 P e61c3a8f61bb48f8a963c9480e53c168 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:05:06.273118 21547 raft_consensus.cc:493] T 2e36a9d6e29c4a7c860cf267efbd4c74 P e5256d91808b47c195bc9b4dbd7f2b87 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:06.296448 19480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc225c93219c45538b53a1bd3d387e4d" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 8 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:05:06.327687 19480 raft_consensus.cc:2410] T bc225c93219c45538b53a1bd3d387e4d P 0473d2b2d01f4459b1e90fd12cc7840e [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e5256d91808b47c195bc9b4dbd7f2b87 for term 8 because replica has last-logged OpId of term: 6 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 2.
I20260709 13:05:06.274271 21644 raft_consensus.cc:3060] T 14935b3ddf914369822e4a0547aaa355 P e5256d91808b47c195bc9b4dbd7f2b87 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:05:06.302836 19357 auto_rebalancer.cc:893] Removing replace marker failed: Replica e5256d91808b47c195bc9b4dbd7f2b87 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 3 committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } attrs { replace: true } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: NON_VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: true } } } pending_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } attrs { replace: true } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } } }
W20260709 13:05:06.333195 19357 auto_rebalancer.cc:901] Could not move replica: Illegal state: not currently leader
W20260709 13:05:06.303565 21659 log.cc:927] Time spent T fa8650e71aa14778b3d73721fc50d9fc P e61c3a8f61bb48f8a963c9480e53c168: Append to log took a long time: real 0.139s	user 0.000s	sys 0.001s
W20260709 13:05:06.304266 21647 log.cc:927] Time spent T 0afb57ae58a24a01850491d69f0213dd P 0473d2b2d01f4459b1e90fd12cc7840e: Append to log took a long time: real 0.053s	user 0.000s	sys 0.000s
W20260709 13:05:06.304885 21660 log.cc:927] Time spent T b9f0d59553ad444883fcf5b5909f9798 P 0473d2b2d01f4459b1e90fd12cc7840e: Append to log took a long time: real 0.066s	user 0.000s	sys 0.000s
I20260709 13:05:06.279320 21571 raft_consensus.cc:515] T 14efcc79969f41babe5529c22d59156d P 0473d2b2d01f4459b1e90fd12cc7840e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:05:06.310226 21338 leader_election.cc:290] T 2e36a9d6e29c4a7c860cf267efbd4c74 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 4 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:05:06.310654 21537 raft_consensus.cc:515] T a08760e15aac4630a629431f56024dc8 P e5256d91808b47c195bc9b4dbd7f2b87 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:06.312541 21582 raft_consensus.cc:515] T 40e1e16737a842ee936002830f36882e P 0473d2b2d01f4459b1e90fd12cc7840e [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:06.312455 21636 raft_consensus.cc:515] T 46c5bfeecc314717bffe987e6844b6d0 P e5256d91808b47c195bc9b4dbd7f2b87 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:06.298971 19479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "309c3ca0ca4b4f3ba129752ea2cb293b" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:05:06.315657 19402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f575b143b844aa096b50997dad3516a" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:05:06.316179 20103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ec1c4ce15e04c7e8c283a62179f2a64" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "127766fc592545a4997f7790f50f6076"
I20260709 13:05:06.291527 21554 raft_consensus.cc:515] T ef32ce6fdd0e40d382c79974f30295c6 P e5256d91808b47c195bc9b4dbd7f2b87 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:06.277019 21630 raft_consensus.cc:493] T d1e5873a19244c5ebbcd38e126796ee7 P e5256d91808b47c195bc9b4dbd7f2b87 [term 4 FOLLOWER]: Starting leader election (detected failure of leader e61c3a8f61bb48f8a963c9480e53c168)
I20260709 13:05:06.329993 19523 leader_election.cc:304] T b08304a0a02b42d7840c4e8ee9a6bd1a P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e61c3a8f61bb48f8a963c9480e53c168; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:05:06.298249 19411 consensus_queue.cc:260] T 5ec1c4ce15e04c7e8c283a62179f2a64 P e5256d91808b47c195bc9b4dbd7f2b87 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:05:06.335533 19483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "179fd671030940b4b4a4e24bcc4aba0a" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:05:06.336138 19556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e1f505cb0f1427bbd698ac889d80821" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:05:06.295179 21536 raft_consensus.cc:515] T 179fd671030940b4b4a4e24bcc4aba0a P e5256d91808b47c195bc9b4dbd7f2b87 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:06.343201 19375 leader_election.cc:304] T 70797e5783b5454ab0d0eea663e791e3 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
W20260709 13:05:06.341774 19357 auto_rebalancer.cc:330] scheduled replica move failed to complete: Illegal state: not currently leader
I20260709 13:05:06.329278 21478 raft_consensus.cc:493] T 70797e5783b5454ab0d0eea663e791e3 P e61c3a8f61bb48f8a963c9480e53c168 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:06.327160 21203 raft_consensus.cc:493] T 2e36a9d6e29c4a7c860cf267efbd4c74 P e61c3a8f61bb48f8a963c9480e53c168 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 0473d2b2d01f4459b1e90fd12cc7840e)
I20260709 13:05:06.336771 19554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa731b585f684a7fb2d106c50f143b83" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:05:06.296979 21535 raft_consensus.cc:515] T ab43d85f64114d4ebf618930e43d9ed0 P e5256d91808b47c195bc9b4dbd7f2b87 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } attrs { replace: true } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: NON_VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: true } }
I20260709 13:05:06.390636 19486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a61655d99124a29b486ba4a5b37faea" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:05:06.391330 19410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4509b76741dc428e9201c70c1658da13" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:05:06.430467 19409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86a6797bdfe94fa496c050ceae4bd0d9" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:05:06.395319 19480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f575b143b844aa096b50997dad3516a" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:05:06.443105 19482 raft_consensus.cc:1275] T 9962423cb4e54fcfa5de01daf68a86e7 P 0473d2b2d01f4459b1e90fd12cc7840e [term 8 FOLLOWER]: Refusing update from remote peer 127766fc592545a4997f7790f50f6076: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260709 13:05:06.491869 19486 raft_consensus.cc:2468] T 1a61655d99124a29b486ba4a5b37faea P 0473d2b2d01f4459b1e90fd12cc7840e [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 2.
I20260709 13:05:06.332563 21547 raft_consensus.cc:3060] T 2e36a9d6e29c4a7c860cf267efbd4c74 P e5256d91808b47c195bc9b4dbd7f2b87 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:05:06.332296 21553 raft_consensus.cc:2749] T 833a2f0775ed407a94b8924ce50adb63 P 127766fc592545a4997f7790f50f6076 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 13:05:06.496356 19375 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.3:36891, user_credentials={real_user=slave}} blocked reactor thread for 153263us
I20260709 13:05:06.497258 19409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a08760e15aac4630a629431f56024dc8" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:05:06.344746 21558 raft_consensus.cc:493] T 0e1085d23e8347fbbd5bce7542f4b1f4 P e61c3a8f61bb48f8a963c9480e53c168 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 127766fc592545a4997f7790f50f6076)
W20260709 13:05:06.455435 20076 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.3:36891, user_credentials={real_user=slave}} blocked reactor thread for 72428.9us
I20260709 13:05:06.511876 19551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65d8cb8d6ec64f459d5a47cefab10acf" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:05:06.532900 21571 leader_election.cc:290] T 14efcc79969f41babe5529c22d59156d P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:05:06.537197 19449 leader_election.cc:304] T 309c3ca0ca4b4f3ba129752ea2cb293b P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e; no voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:05:06.538053 19409 raft_consensus.cc:2468] T a08760e15aac4630a629431f56024dc8 P e5256d91808b47c195bc9b4dbd7f2b87 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 4.
I20260709 13:05:06.533041 21415 raft_consensus.cc:2804] T 70797e5783b5454ab0d0eea663e791e3 P e5256d91808b47c195bc9b4dbd7f2b87 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:05:06.542882 19551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e5873a19244c5ebbcd38e126796ee7" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:05:06.393538 21661 raft_consensus.cc:493] T 48824d5acfbc485ebf8c2d944e7202de P 0473d2b2d01f4459b1e90fd12cc7840e [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:06.537395 19485 raft_consensus.cc:2468] T 40e1e16737a842ee936002830f36882e P 0473d2b2d01f4459b1e90fd12cc7840e [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 5.
I20260709 13:05:06.543701 19551 raft_consensus.cc:3060] T d1e5873a19244c5ebbcd38e126796ee7 P e61c3a8f61bb48f8a963c9480e53c168 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:05:06.388650 21524 leader_election.cc:290] T a08760e15aac4630a629431f56024dc8 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:05:06.557057 19410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "179fd671030940b4b4a4e24bcc4aba0a" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:05:06.558641 19410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e36a9d6e29c4a7c860cf267efbd4c74" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
I20260709 13:05:06.497792 21203 raft_consensus.cc:3060] T 2e36a9d6e29c4a7c860cf267efbd4c74 P e61c3a8f61bb48f8a963c9480e53c168 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:06.406396 21372 leader_election.cc:290] T 86a6797bdfe94fa496c050ceae4bd0d9 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:05:06.512704 21630 raft_consensus.cc:3060] T d1e5873a19244c5ebbcd38e126796ee7 P e5256d91808b47c195bc9b4dbd7f2b87 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:05:06.512475 21478 raft_consensus.cc:3060] T 70797e5783b5454ab0d0eea663e791e3 P e61c3a8f61bb48f8a963c9480e53c168 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:05:06.496075 21562 raft_consensus.cc:493] T ab43d85f64114d4ebf618930e43d9ed0 P 0473d2b2d01f4459b1e90fd12cc7840e [term 5 FOLLOWER]: Starting pre-election (detected failure of leader e61c3a8f61bb48f8a963c9480e53c168)
I20260709 13:05:06.554330 20078 leader_election.cc:304] T 309c3ca0ca4b4f3ba129752ea2cb293b P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 127766fc592545a4997f7790f50f6076; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:05:06.517666 20103 raft_consensus.cc:3060] T 5ec1c4ce15e04c7e8c283a62179f2a64 P 127766fc592545a4997f7790f50f6076 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:06.568301 19556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e36a9d6e29c4a7c860cf267efbd4c74" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:05:06.571378 19410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a61655d99124a29b486ba4a5b37faea" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:05:06.543371 21415 raft_consensus.cc:493] T 70797e5783b5454ab0d0eea663e791e3 P e5256d91808b47c195bc9b4dbd7f2b87 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:06.541971 19553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a16f7501e2444fb86d4e2778e734e02" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:05:06.586292 19410 raft_consensus.cc:2468] T 1a61655d99124a29b486ba4a5b37faea P e5256d91808b47c195bc9b4dbd7f2b87 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 1.
I20260709 13:05:06.576056 19449 leader_election.cc:304] T 1a61655d99124a29b486ba4a5b37faea P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87; no voters: 
I20260709 13:05:06.598481 21355 raft_consensus.cc:515] T 70797e5783b5454ab0d0eea663e791e3 P 127766fc592545a4997f7790f50f6076 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
W20260709 13:05:06.606268 19450 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.3:36891, user_credentials={real_user=slave}} blocked reactor thread for 57985.8us
I20260709 13:05:06.537714 21558 raft_consensus.cc:515] T 0e1085d23e8347fbbd5bce7542f4b1f4 P e61c3a8f61bb48f8a963c9480e53c168 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:05:06.586885 21603 raft_consensus.cc:2749] T 309c3ca0ca4b4f3ba129752ea2cb293b P 127766fc592545a4997f7790f50f6076 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:05:06.593298 21415 raft_consensus.cc:3060] T 70797e5783b5454ab0d0eea663e791e3 P e5256d91808b47c195bc9b4dbd7f2b87 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:05:06.563830 21596 consensus_queue.cc:1048] T 9962423cb4e54fcfa5de01daf68a86e7 P 127766fc592545a4997f7790f50f6076 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.041s
I20260709 13:05:06.591607 21667 raft_consensus.cc:2749] T b08304a0a02b42d7840c4e8ee9a6bd1a P e61c3a8f61bb48f8a963c9480e53c168 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:05:06.590919 21546 raft_consensus.cc:2749] T 309c3ca0ca4b4f3ba129752ea2cb293b P 0473d2b2d01f4459b1e90fd12cc7840e [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:05:06.622681 19477 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58286 (request call id 1342) took 1025 ms. Trace:
I20260709 13:05:06.601919 21088 raft_consensus.cc:493] T a08760e15aac4630a629431f56024dc8 P 0473d2b2d01f4459b1e90fd12cc7840e [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:06.603526 21559 leader_election.cc:290] T 48824d5acfbc485ebf8c2d944e7202de P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:05:06.638463 19551 raft_consensus.cc:2468] T d1e5873a19244c5ebbcd38e126796ee7 P e61c3a8f61bb48f8a963c9480e53c168 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 6.
I20260709 13:05:06.561090 21661 raft_consensus.cc:515] T 48824d5acfbc485ebf8c2d944e7202de P 0473d2b2d01f4459b1e90fd12cc7840e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:05:06.629128 19477 rpcz_store.cc:276] 0709 13:05:05.597280 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:05.623944 (+ 26664us) service_pool.cc:224] Handling call
0709 13:05:05.624234 (+   290us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:05:05.645817 (+ 21583us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:05:05.645846 (+    29us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:05:05.669915 (+ 24069us) log.cc:844] Serialized 52 byte log entry
0709 13:05:06.000261 (+330346us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:05:06.014297 (+ 14036us) log.cc:844] Serialized 14 byte log entry
0709 13:05:06.099763 (+ 85466us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:06.099964 (+   201us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:05:06.622381 (+522417us) raft_consensus.cc:1685] finished
0709 13:05:06.622415 (+    34us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:06.622592 (+   177us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":68098,"prepare.queue_time_us":13013,"prepare.run_cpu_time_us":42,"prepare.run_wall_time_us":43,"raft.queue_time_us":33514,"raft.run_cpu_time_us":222,"raft.run_wall_time_us":222,"spinlock_wait_cycles":1350656,"thread_start_us":382177,"threads_started":2,"wal-append.queue_time_us":542920}
I20260709 13:05:06.651952 19408 raft_consensus.cc:2468] T 4af19371ea874c09a0a2147040835cbb P e5256d91808b47c195bc9b4dbd7f2b87 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 127766fc592545a4997f7790f50f6076 in term 4.
W20260709 13:05:06.652693 19375 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.3:36891, user_credentials={real_user=slave}} blocked reactor thread for 136937us
I20260709 13:05:06.656028 20075 leader_election.cc:304] T 4af19371ea874c09a0a2147040835cbb P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 127766fc592545a4997f7790f50f6076, e5256d91808b47c195bc9b4dbd7f2b87; no voters: 
I20260709 13:05:06.667948 21355 leader_election.cc:290] T 70797e5783b5454ab0d0eea663e791e3 P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 5 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:05:06.595817 21562 raft_consensus.cc:515] T ab43d85f64114d4ebf618930e43d9ed0 P 0473d2b2d01f4459b1e90fd12cc7840e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } attrs { replace: true } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:05:06.653936 21088 raft_consensus.cc:515] T a08760e15aac4630a629431f56024dc8 P 0473d2b2d01f4459b1e90fd12cc7840e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:06.674105 21203 raft_consensus.cc:515] T 2e36a9d6e29c4a7c860cf267efbd4c74 P e61c3a8f61bb48f8a963c9480e53c168 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:06.678224 21203 leader_election.cc:290] T 2e36a9d6e29c4a7c860cf267efbd4c74 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 3 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:05:06.679124 19559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc225c93219c45538b53a1bd3d387e4d" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
W20260709 13:05:06.682101 21586 consensus_meta.cc:287] T 14935b3ddf914369822e4a0547aaa355 P 127766fc592545a4997f7790f50f6076: Time spent flushing consensus metadata: real 0.654s	user 0.004s	sys 0.004s
I20260709 13:05:06.631582 21430 raft_consensus.cc:2804] T 1a61655d99124a29b486ba4a5b37faea P 0473d2b2d01f4459b1e90fd12cc7840e [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:05:06.682618 21554 leader_election.cc:290] T ef32ce6fdd0e40d382c79974f30295c6 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:05:06.682925 21430 raft_consensus.cc:493] T 1a61655d99124a29b486ba4a5b37faea P 0473d2b2d01f4459b1e90fd12cc7840e [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:06.683830 21636 leader_election.cc:290] T 46c5bfeecc314717bffe987e6844b6d0 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:05:06.684558 21558 leader_election.cc:290] T 0e1085d23e8347fbbd5bce7542f4b1f4 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:05:06.685294 21537 leader_election.cc:290] T a08760e15aac4630a629431f56024dc8 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:05:06.718318 19559 raft_consensus.cc:2468] T bc225c93219c45538b53a1bd3d387e4d P e61c3a8f61bb48f8a963c9480e53c168 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 7.
W20260709 13:05:06.685590 21649 log.cc:927] Time spent T 21e14947d70440f19044d8f75c31e1f9 P e61c3a8f61bb48f8a963c9480e53c168: Append to log took a long time: real 0.457s	user 0.000s	sys 0.004s
I20260709 13:05:06.688755 20107 raft_consensus.cc:2393] T 70797e5783b5454ab0d0eea663e791e3 P 127766fc592545a4997f7790f50f6076 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e5256d91808b47c195bc9b4dbd7f2b87 in current term 5: Already voted for candidate 127766fc592545a4997f7790f50f6076 in this term.
W20260709 13:05:06.691655 21664 log.cc:927] Time spent T ab43d85f64114d4ebf618930e43d9ed0 P 127766fc592545a4997f7790f50f6076: Append to log took a long time: real 0.234s	user 0.000s	sys 0.001s
W20260709 13:05:06.693142 21665 log.cc:927] Time spent T 28af091831594f9d8e96482078cc7625 P 0473d2b2d01f4459b1e90fd12cc7840e: Append to log took a long time: real 0.148s	user 0.000s	sys 0.001s
I20260709 13:05:06.694779 21603 raft_consensus.cc:2804] T 4af19371ea874c09a0a2147040835cbb P 127766fc592545a4997f7790f50f6076 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:05:06.714044 21430 raft_consensus.cc:3060] T 1a61655d99124a29b486ba4a5b37faea P 0473d2b2d01f4459b1e90fd12cc7840e [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:06.696014 19556 raft_consensus.cc:3060] T 2e36a9d6e29c4a7c860cf267efbd4c74 P e61c3a8f61bb48f8a963c9480e53c168 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:05:06.712652 19408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70797e5783b5454ab0d0eea663e791e3" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
W20260709 13:05:06.720350 19526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.2:46257, user_credentials={real_user=slave}} blocked reactor thread for 88836.2us
I20260709 13:05:06.674564 21536 leader_election.cc:290] T 179fd671030940b4b4a4e24bcc4aba0a P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:05:06.684587 21535 leader_election.cc:290] T ab43d85f64114d4ebf618930e43d9ed0 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:05:06.695245 20108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14efcc79969f41babe5529c22d59156d" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:05:06.682458 21586 raft_consensus.cc:515] T 14935b3ddf914369822e4a0547aaa355 P 127766fc592545a4997f7790f50f6076 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } attrs { replace: true } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:05:06.721763 21587 raft_consensus.cc:493] T 62c6c134d3d24a1ab144dd9ee6bc3f64 P 127766fc592545a4997f7790f50f6076 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader e61c3a8f61bb48f8a963c9480e53c168)
I20260709 13:05:06.739534 21593 raft_consensus.cc:493] T 0afb57ae58a24a01850491d69f0213dd P 127766fc592545a4997f7790f50f6076 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader e61c3a8f61bb48f8a963c9480e53c168)
I20260709 13:05:06.743590 21593 raft_consensus.cc:515] T 0afb57ae58a24a01850491d69f0213dd P 127766fc592545a4997f7790f50f6076 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:05:06.745088 21623 raft_consensus.cc:515] T 40e1e16737a842ee936002830f36882e P e5256d91808b47c195bc9b4dbd7f2b87 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:06.745689 21593 leader_election.cc:290] T 0afb57ae58a24a01850491d69f0213dd P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:05:06.746860 21535 raft_consensus.cc:493] T f1b10566f45d4a7d9029858330e02d5b P e5256d91808b47c195bc9b4dbd7f2b87 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:06.747205 21623 leader_election.cc:290] T 40e1e16737a842ee936002830f36882e P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 6 election: Requested vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:05:06.737932 21603 raft_consensus.cc:697] T 4af19371ea874c09a0a2147040835cbb P 127766fc592545a4997f7790f50f6076 [term 4 LEADER]: Becoming Leader. State: Replica: 127766fc592545a4997f7790f50f6076, State: Running, Role: LEADER
I20260709 13:05:06.747313 21547 raft_consensus.cc:515] T 2e36a9d6e29c4a7c860cf267efbd4c74 P e5256d91808b47c195bc9b4dbd7f2b87 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:06.748485 19477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0afb57ae58a24a01850491d69f0213dd" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:05:06.750031 21547 leader_election.cc:290] T 2e36a9d6e29c4a7c860cf267efbd4c74 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 4 election: Requested vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:05:06.750993 19406 raft_consensus.cc:2393] T 2e36a9d6e29c4a7c860cf267efbd4c74 P e5256d91808b47c195bc9b4dbd7f2b87 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0473d2b2d01f4459b1e90fd12cc7840e in current term 4: Already voted for candidate e5256d91808b47c195bc9b4dbd7f2b87 in this term.
I20260709 13:05:06.747318 21535 raft_consensus.cc:515] T f1b10566f45d4a7d9029858330e02d5b P e5256d91808b47c195bc9b4dbd7f2b87 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:06.751760 21587 raft_consensus.cc:515] T 62c6c134d3d24a1ab144dd9ee6bc3f64 P 127766fc592545a4997f7790f50f6076 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:05:06.753448 21535 leader_election.cc:290] T f1b10566f45d4a7d9029858330e02d5b P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:05:06.754129 21587 leader_election.cc:290] T 62c6c134d3d24a1ab144dd9ee6bc3f64 P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:05:06.729025 19553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86a6797bdfe94fa496c050ceae4bd0d9" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:05:06.755347 19485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62c6c134d3d24a1ab144dd9ee6bc3f64" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:05:06.755308 21415 raft_consensus.cc:515] T 70797e5783b5454ab0d0eea663e791e3 P e5256d91808b47c195bc9b4dbd7f2b87 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:05:06.759953 21415 leader_election.cc:290] T 70797e5783b5454ab0d0eea663e791e3 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 5 election: Requested vote from peers e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:05:06.760269 20104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70797e5783b5454ab0d0eea663e791e3" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076"
I20260709 13:05:06.761711 19408 raft_consensus.cc:2393] T 70797e5783b5454ab0d0eea663e791e3 P e5256d91808b47c195bc9b4dbd7f2b87 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 127766fc592545a4997f7790f50f6076 in current term 5: Already voted for candidate e5256d91808b47c195bc9b4dbd7f2b87 in this term.
I20260709 13:05:06.766199 20105 raft_consensus.cc:2468] T 14935b3ddf914369822e4a0547aaa355 P 127766fc592545a4997f7790f50f6076 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 3.
I20260709 13:05:06.748512 21603 consensus_queue.cc:237] T 4af19371ea874c09a0a2147040835cbb P 127766fc592545a4997f7790f50f6076 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:05:06.770073 19555 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40428 (request call id 1719) took 1251 ms. Trace:
I20260709 13:05:06.775835 19526 leader_election.cc:304] T 1a61655d99124a29b486ba4a5b37faea P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:05:06.778535 19556 raft_consensus.cc:2468] T 2e36a9d6e29c4a7c860cf267efbd4c74 P e61c3a8f61bb48f8a963c9480e53c168 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 4.
I20260709 13:05:06.770460 19555 rpcz_store.cc:276] 0709 13:05:05.518548 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:05.519341 (+   793us) service_pool.cc:224] Handling call
0709 13:05:05.532137 (+ 12796us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:05:05.670381 (+138244us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:05:05.670424 (+    43us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:05:05.671331 (+   907us) log.cc:844] Serialized 26 byte log entry
0709 13:05:05.991258 (+319927us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:05:05.992300 (+  1042us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:05.992418 (+   118us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:05:06.685006 (+692588us) spinlock_profiling.cc:243] Waited 1.46 ms on lock 0x7b4400022b4c. stack: 00007f4a79de9343 00007f4a79de9240 00007f4a797781d4 00007f4a834b6304 00007f4a834b6299 00007f4a79ca3db1 00007f4a79d41c85 00007f4a79d426a2 00007f4a7cab41db 00007f4a7caafaaf 00007f4a7caa386e 00007f4a7caa2bb6 00007f4a7caa27d8 00007f4a7caac221 00007f4a7caac1d9 00007f4a7caac169
0709 13:05:06.768798 (+ 83792us) raft_consensus.cc:1685] finished
0709 13:05:06.768819 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:06.770008 (+  1189us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1584,"raft.queue_time_us":29361,"raft.run_cpu_time_us":103,"raft.run_wall_time_us":103,"spinlock_wait_cycles":3366784,"thread_start_us":430434,"threads_started":2,"wal-append.queue_time_us":331674}
I20260709 13:05:06.764114 20103 raft_consensus.cc:2468] T 5ec1c4ce15e04c7e8c283a62179f2a64 P 127766fc592545a4997f7790f50f6076 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 2.
W20260709 13:05:06.799391 19523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.1:40321, user_credentials={real_user=slave}} blocked reactor thread for 469469us
I20260709 13:05:06.800387 19523 leader_election.cc:304] T ece3db938bc649d4a40a51522ed5259c P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e61c3a8f61bb48f8a963c9480e53c168; no voters: 127766fc592545a4997f7790f50f6076, e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:05:06.803146 19484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14935b3ddf914369822e4a0547aaa355" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:05:06.805823 21527 leader_election.cc:290] T bc225c93219c45538b53a1bd3d387e4d P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 7 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:05:06.807668 20105 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35874 (request call id 397) took 1005 ms. Trace:
I20260709 13:05:06.790016 21478 raft_consensus.cc:515] T 70797e5783b5454ab0d0eea663e791e3 P e61c3a8f61bb48f8a963c9480e53c168 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:05:06.808112 20105 rpcz_store.cc:276] 0709 13:05:05.802200 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:05.803929 (+  1729us) service_pool.cc:224] Handling call
0709 13:05:06.072523 (+268594us) spinlock_profiling.cc:243] Waited 4.5 ms on lock 0x7b5800010b98. stack: 00007f4a79de9343 00007f4a79de9240 00007f4a797781d4 00007f4a834b6304 00007f4a834b6299 00007f4a79ca3db1 00007f4a79de3b71 00007f4a79de3a22 00007f4a82cfcc09 00007f4a81e56ee0 00007f4a81f200ab 00007f4a81f20131 00007f4a81ece0a0 00007f4a81ecd984 00007f4a7b4486d4 00007f4a7b448662
0709 13:05:06.807448 (+734925us) spinlock_profiling.cc:243] Waited 554 ms on lock 0x7b54004169d4. stack: 00007f4a79de9343 00007f4a79de9240 00007f4a797781d4 00007f4a834b6304 00007f4a834b6299 00007f4a7ce71571 00007f4a7cf0c2fa 00007f4a81ecdb17 00007f4a7b4486d4 00007f4a7b448662 00007f4a7b448591 00007f4a7b44850c 00007f4a7b4477c2 00007f4a7b24348c 00007f4a7b2428c6 00007f4a7b24226f
0709 13:05:06.807574 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1284305024}
I20260709 13:05:06.809852 21614 raft_consensus.cc:2804] T 1a61655d99124a29b486ba4a5b37faea P e61c3a8f61bb48f8a963c9480e53c168 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:05:06.810021 21478 leader_election.cc:290] T 70797e5783b5454ab0d0eea663e791e3 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 5 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:05:06.797602 21644 raft_consensus.cc:515] T 14935b3ddf914369822e4a0547aaa355 P e5256d91808b47c195bc9b4dbd7f2b87 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } attrs { replace: true } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:05:06.831723 19523 leader_election.cc:304] T 85c494af21f9457a85da47b9bc70c1fd P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e61c3a8f61bb48f8a963c9480e53c168; no voters: 127766fc592545a4997f7790f50f6076, e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:05:06.789165 21630 raft_consensus.cc:515] T d1e5873a19244c5ebbcd38e126796ee7 P e5256d91808b47c195bc9b4dbd7f2b87 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:06.833411 19523 leader_election.cc:304] T 21e14947d70440f19044d8f75c31e1f9 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e61c3a8f61bb48f8a963c9480e53c168; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:05:06.833460 19403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14efcc79969f41babe5529c22d59156d" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:05:06.799196 21622 raft_consensus.cc:493] T 46c5bfeecc314717bffe987e6844b6d0 P 0473d2b2d01f4459b1e90fd12cc7840e [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:06.836477 19523 leader_election.cc:304] T d1e5873a19244c5ebbcd38e126796ee7 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168; no voters: 0473d2b2d01f4459b1e90fd12cc7840e
I20260709 13:05:06.839102 19523 leader_election.cc:304] T ff75a1d4cb1f493db8f71ddc136ba9ab P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e61c3a8f61bb48f8a963c9480e53c168; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:05:06.839608 19403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14935b3ddf914369822e4a0547aaa355" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
I20260709 13:05:06.840344 19523 leader_election.cc:304] T 4509b76741dc428e9201c70c1658da13 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e61c3a8f61bb48f8a963c9480e53c168; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:05:06.841565 19523 leader_election.cc:304] T 179fd671030940b4b4a4e24bcc4aba0a P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e61c3a8f61bb48f8a963c9480e53c168; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:05:06.828543 21614 raft_consensus.cc:493] T 1a61655d99124a29b486ba4a5b37faea P e61c3a8f61bb48f8a963c9480e53c168 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:06.843997 19403 raft_consensus.cc:2368] T 14935b3ddf914369822e4a0547aaa355 P e5256d91808b47c195bc9b4dbd7f2b87 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 127766fc592545a4997f7790f50f6076 for earlier term 3. Current term is 4.
I20260709 13:05:06.810636 21617 raft_consensus.cc:2749] T ece3db938bc649d4a40a51522ed5259c P e61c3a8f61bb48f8a963c9480e53c168 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:05:06.845129 19523 leader_election.cc:304] T 7f575b143b844aa096b50997dad3516a P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e61c3a8f61bb48f8a963c9480e53c168; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:05:06.845594 19405 raft_consensus.cc:3060] T d1e5873a19244c5ebbcd38e126796ee7 P e5256d91808b47c195bc9b4dbd7f2b87 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:05:06.837709 21478 raft_consensus.cc:2749] T 21e14947d70440f19044d8f75c31e1f9 P e61c3a8f61bb48f8a963c9480e53c168 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:05:06.845702 21614 raft_consensus.cc:3060] T 1a61655d99124a29b486ba4a5b37faea P e61c3a8f61bb48f8a963c9480e53c168 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:06.834986 21677 raft_consensus.cc:2749] T 85c494af21f9457a85da47b9bc70c1fd P e61c3a8f61bb48f8a963c9480e53c168 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:05:06.843442 21634 raft_consensus.cc:2749] T ff75a1d4cb1f493db8f71ddc136ba9ab P e61c3a8f61bb48f8a963c9480e53c168 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:05:06.846917 21465 raft_consensus.cc:2749] T 7f575b143b844aa096b50997dad3516a P e61c3a8f61bb48f8a963c9480e53c168 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:05:06.856187 19377 leader_election.cc:400] T d1e5873a19244c5ebbcd38e126796ee7 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 5 pre-election: Vote denied by peer 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257) with higher term. Message: Invalid argument: T d1e5873a19244c5ebbcd38e126796ee7 P 0473d2b2d01f4459b1e90fd12cc7840e [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e5256d91808b47c195bc9b4dbd7f2b87 for earlier term 5. Current term is 6.
I20260709 13:05:06.841313 21559 raft_consensus.cc:2764] T d1e5873a19244c5ebbcd38e126796ee7 P e61c3a8f61bb48f8a963c9480e53c168 [term 6 FOLLOWER]: Leader pre-election decision vote started in defunct term 5: won
I20260709 13:05:06.849303 21674 raft_consensus.cc:2749] T 179fd671030940b4b4a4e24bcc4aba0a P e61c3a8f61bb48f8a963c9480e53c168 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:05:06.851485 21666 raft_consensus.cc:493] T f93ee515a9c14139bf566522ed8232f3 P e5256d91808b47c195bc9b4dbd7f2b87 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader e61c3a8f61bb48f8a963c9480e53c168)
I20260709 13:05:06.887830 21666 raft_consensus.cc:515] T f93ee515a9c14139bf566522ed8232f3 P e5256d91808b47c195bc9b4dbd7f2b87 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:06.888630 21430 raft_consensus.cc:515] T 1a61655d99124a29b486ba4a5b37faea P 0473d2b2d01f4459b1e90fd12cc7840e [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:06.889055 19377 leader_election.cc:304] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, 127766fc592545a4997f7790f50f6076
I20260709 13:05:06.885094 21586 leader_election.cc:290] T 14935b3ddf914369822e4a0547aaa355 P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 3 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:05:06.889816 21415 raft_consensus.cc:2749] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P e5256d91808b47c195bc9b4dbd7f2b87 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:05:06.890302 21603 raft_consensus.cc:493] T 65d8cb8d6ec64f459d5a47cefab10acf P 127766fc592545a4997f7790f50f6076 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e61c3a8f61bb48f8a963c9480e53c168)
I20260709 13:05:06.890867 21603 raft_consensus.cc:515] T 65d8cb8d6ec64f459d5a47cefab10acf P 127766fc592545a4997f7790f50f6076 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:05:06.891244 19377 leader_election.cc:304] T bc225c93219c45538b53a1bd3d387e4d P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:05:06.892354 21415 raft_consensus.cc:2749] T bc225c93219c45538b53a1bd3d387e4d P e5256d91808b47c195bc9b4dbd7f2b87 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:05:06.893018 21603 leader_election.cc:290] T 65d8cb8d6ec64f459d5a47cefab10acf P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:05:06.856225 19478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab43d85f64114d4ebf618930e43d9ed0" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
W20260709 13:05:06.894687 19523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.1:40321, user_credentials={real_user=slave}} blocked reactor thread for 44841.3us
I20260709 13:05:06.877642 19484 raft_consensus.cc:2468] T 14935b3ddf914369822e4a0547aaa355 P 0473d2b2d01f4459b1e90fd12cc7840e [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 127766fc592545a4997f7790f50f6076 in term 3.
I20260709 13:05:06.844174 21529 raft_consensus.cc:2749] T 4509b76741dc428e9201c70c1658da13 P e61c3a8f61bb48f8a963c9480e53c168 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:05:06.850890 21661 leader_election.cc:290] T 48824d5acfbc485ebf8c2d944e7202de P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:05:06.879431 19481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "179fd671030940b4b4a4e24bcc4aba0a" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:05:06.880064 19479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef32ce6fdd0e40d382c79974f30295c6" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:05:06.880393 19483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a08760e15aac4630a629431f56024dc8" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:05:06.880725 19482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46c5bfeecc314717bffe987e6844b6d0" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 8 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:05:06.880903 19486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40e1e16737a842ee936002830f36882e" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:05:06.903370 19486 raft_consensus.cc:3060] T 40e1e16737a842ee936002830f36882e P 0473d2b2d01f4459b1e90fd12cc7840e [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:05:06.881260 19480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1b10566f45d4a7d9029858330e02d5b" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:05:06.881642 19477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e36a9d6e29c4a7c860cf267efbd4c74" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:05:06.884966 19405 raft_consensus.cc:2468] T d1e5873a19244c5ebbcd38e126796ee7 P e5256d91808b47c195bc9b4dbd7f2b87 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 6.
I20260709 13:05:06.889556 21562 leader_election.cc:290] T ab43d85f64114d4ebf618930e43d9ed0 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:05:06.896596 19557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62c6c134d3d24a1ab144dd9ee6bc3f64" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:05:06.896486 19559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0afb57ae58a24a01850491d69f0213dd" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:05:06.913384 19406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65d8cb8d6ec64f459d5a47cefab10acf" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:05:06.914731 19481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f93ee515a9c14139bf566522ed8232f3" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 8 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:05:06.920907 19486 raft_consensus.cc:2468] T 40e1e16737a842ee936002830f36882e P 0473d2b2d01f4459b1e90fd12cc7840e [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 6.
I20260709 13:05:06.921154 19407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e36a9d6e29c4a7c860cf267efbd4c74" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
I20260709 13:05:06.921986 19407 raft_consensus.cc:2368] T 2e36a9d6e29c4a7c860cf267efbd4c74 P e5256d91808b47c195bc9b4dbd7f2b87 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate e61c3a8f61bb48f8a963c9480e53c168 for earlier term 3. Current term is 4.
I20260709 13:05:06.923924 21638 leader_election.cc:290] T 46c5bfeecc314717bffe987e6844b6d0 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:05:06.924770 19557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65d8cb8d6ec64f459d5a47cefab10acf" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:05:06.855881 19485 raft_consensus.cc:1240] T 5ec1c4ce15e04c7e8c283a62179f2a64 P 0473d2b2d01f4459b1e90fd12cc7840e [term 2 FOLLOWER]: Rejecting Update request from peer e5256d91808b47c195bc9b4dbd7f2b87 for earlier term 1. Current term is 2. Ops: []
I20260709 13:05:06.927852 21535 raft_consensus.cc:493] T 2b74109013a140ada21feeef92d6f563 P e5256d91808b47c195bc9b4dbd7f2b87 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 0473d2b2d01f4459b1e90fd12cc7840e)
I20260709 13:05:06.928541 21535 raft_consensus.cc:515] T 2b74109013a140ada21feeef92d6f563 P e5256d91808b47c195bc9b4dbd7f2b87 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:06.908224 21430 leader_election.cc:290] T 1a61655d99124a29b486ba4a5b37faea P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 3 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:05:06.931986 21630 leader_election.cc:290] T d1e5873a19244c5ebbcd38e126796ee7 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 5 election: Requested vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:05:06.933983 19558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14935b3ddf914369822e4a0547aaa355" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:05:06.847108 21622 raft_consensus.cc:515] T 46c5bfeecc314717bffe987e6844b6d0 P 0473d2b2d01f4459b1e90fd12cc7840e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:06.900210 19553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4af19371ea874c09a0a2147040835cbb" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:05:06.900910 20104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48824d5acfbc485ebf8c2d944e7202de" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:05:06.901312 21666 leader_election.cc:290] T f93ee515a9c14139bf566522ed8232f3 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:05:06.902704 19483 raft_consensus.cc:2468] T a08760e15aac4630a629431f56024dc8 P 0473d2b2d01f4459b1e90fd12cc7840e [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 4.
I20260709 13:05:06.908831 19555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "309c3ca0ca4b4f3ba129752ea2cb293b" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:05:06.908950 21415 raft_consensus.cc:493] T 2725d2c4cb054f18b0fc8f735c15f6c2 P e5256d91808b47c195bc9b4dbd7f2b87 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader e61c3a8f61bb48f8a963c9480e53c168)
I20260709 13:05:06.909422 19477 raft_consensus.cc:2393] T 2e36a9d6e29c4a7c860cf267efbd4c74 P 0473d2b2d01f4459b1e90fd12cc7840e [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate e5256d91808b47c195bc9b4dbd7f2b87 in current term 4: Already voted for candidate 0473d2b2d01f4459b1e90fd12cc7840e in this term.
I20260709 13:05:06.910712 20108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e1085d23e8347fbbd5bce7542f4b1f4" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:05:06.973129 21415 raft_consensus.cc:515] T 2725d2c4cb054f18b0fc8f735c15f6c2 P e5256d91808b47c195bc9b4dbd7f2b87 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:06.903066 19552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70797e5783b5454ab0d0eea663e791e3" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:05:06.974409 19553 raft_consensus.cc:3060] T 4af19371ea874c09a0a2147040835cbb P e61c3a8f61bb48f8a963c9480e53c168 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:05:06.974613 19552 raft_consensus.cc:2393] T 70797e5783b5454ab0d0eea663e791e3 P e61c3a8f61bb48f8a963c9480e53c168 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 127766fc592545a4997f7790f50f6076 in current term 5: Already voted for candidate e61c3a8f61bb48f8a963c9480e53c168 in this term.
W20260709 13:05:06.903333 21576 consensus_meta.cc:287] T 48824d5acfbc485ebf8c2d944e7202de P 127766fc592545a4997f7790f50f6076: Time spent flushing consensus metadata: real 0.892s	user 0.011s	sys 0.001s
I20260709 13:05:06.911180 20109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70797e5783b5454ab0d0eea663e791e3" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076"
I20260709 13:05:06.976419 20104 raft_consensus.cc:2468] T 48824d5acfbc485ebf8c2d944e7202de P 127766fc592545a4997f7790f50f6076 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 3.
I20260709 13:05:06.938874 19407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70797e5783b5454ab0d0eea663e791e3" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
I20260709 13:05:06.978072 19407 raft_consensus.cc:2393] T 70797e5783b5454ab0d0eea663e791e3 P e5256d91808b47c195bc9b4dbd7f2b87 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate e61c3a8f61bb48f8a963c9480e53c168 in current term 5: Already voted for candidate e5256d91808b47c195bc9b4dbd7f2b87 in this term.
I20260709 13:05:06.941790 19558 raft_consensus.cc:2393] T 14935b3ddf914369822e4a0547aaa355 P e61c3a8f61bb48f8a963c9480e53c168 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 127766fc592545a4997f7790f50f6076 in current term 3: Already voted for candidate e61c3a8f61bb48f8a963c9480e53c168 in this term.
I20260709 13:05:06.975950 21415 leader_election.cc:290] T 2725d2c4cb054f18b0fc8f735c15f6c2 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:05:06.981000 19407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46c5bfeecc314717bffe987e6844b6d0" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 9 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:05:06.981762 19407 raft_consensus.cc:2468] T 46c5bfeecc314717bffe987e6844b6d0 P e5256d91808b47c195bc9b4dbd7f2b87 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 7.
I20260709 13:05:06.987848 21535 leader_election.cc:290] T 2b74109013a140ada21feeef92d6f563 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:05:06.990820 19404 raft_consensus.cc:1275] T 9962423cb4e54fcfa5de01daf68a86e7 P e5256d91808b47c195bc9b4dbd7f2b87 [term 8 FOLLOWER]: Refusing update from remote peer 127766fc592545a4997f7790f50f6076: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260709 13:05:06.949787 19523 leader_election.cc:400] T 2e36a9d6e29c4a7c860cf267efbd4c74 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 3 election: Vote denied by peer e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321) with higher term. Message: Invalid argument: T 2e36a9d6e29c4a7c860cf267efbd4c74 P e5256d91808b47c195bc9b4dbd7f2b87 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate e61c3a8f61bb48f8a963c9480e53c168 for earlier term 3. Current term is 4.
W20260709 13:05:06.952781 21681 log.cc:927] Time spent T ab43d85f64114d4ebf618930e43d9ed0 P e5256d91808b47c195bc9b4dbd7f2b87: Append to log took a long time: real 0.103s	user 0.000s	sys 0.000s
I20260709 13:05:06.955178 21644 leader_election.cc:290] T 14935b3ddf914369822e4a0547aaa355 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 4 election: Requested vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:05:06.959555 19482 raft_consensus.cc:2393] T 46c5bfeecc314717bffe987e6844b6d0 P 0473d2b2d01f4459b1e90fd12cc7840e [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e5256d91808b47c195bc9b4dbd7f2b87 in current term 8: Already voted for candidate 0473d2b2d01f4459b1e90fd12cc7840e in this term.
I20260709 13:05:07.086505 21088 leader_election.cc:290] T a08760e15aac4630a629431f56024dc8 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:05:07.083010 21630 raft_consensus.cc:493] T 0cdf56e38bbc453d9438d359e5a69955 P e5256d91808b47c195bc9b4dbd7f2b87 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader e61c3a8f61bb48f8a963c9480e53c168)
I20260709 13:05:07.093111 21630 raft_consensus.cc:515] T 0cdf56e38bbc453d9438d359e5a69955 P e5256d91808b47c195bc9b4dbd7f2b87 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:07.094830 21536 raft_consensus.cc:493] T e381f1d6b8184797ad142de49be225a8 P e5256d91808b47c195bc9b4dbd7f2b87 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 0473d2b2d01f4459b1e90fd12cc7840e)
I20260709 13:05:07.095527 21536 raft_consensus.cc:515] T e381f1d6b8184797ad142de49be225a8 P e5256d91808b47c195bc9b4dbd7f2b87 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:07.097707 21088 raft_consensus.cc:493] T 0cdf56e38bbc453d9438d359e5a69955 P 0473d2b2d01f4459b1e90fd12cc7840e [term 5 FOLLOWER]: Starting pre-election (detected failure of leader e61c3a8f61bb48f8a963c9480e53c168)
I20260709 13:05:07.098441 21088 raft_consensus.cc:515] T 0cdf56e38bbc453d9438d359e5a69955 P 0473d2b2d01f4459b1e90fd12cc7840e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:07.101032 21088 leader_election.cc:290] T 0cdf56e38bbc453d9438d359e5a69955 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:05:07.103029 19477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e5873a19244c5ebbcd38e126796ee7" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:05:07.103966 19477 raft_consensus.cc:2368] T d1e5873a19244c5ebbcd38e126796ee7 P 0473d2b2d01f4459b1e90fd12cc7840e [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate e5256d91808b47c195bc9b4dbd7f2b87 for earlier term 5. Current term is 6.
I20260709 13:05:06.960753 21622 leader_election.cc:290] T 46c5bfeecc314717bffe987e6844b6d0 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:05:06.963219 20103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14935b3ddf914369822e4a0547aaa355" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076"
I20260709 13:05:07.104938 21536 leader_election.cc:290] T e381f1d6b8184797ad142de49be225a8 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:05:07.032008 19523 leader_election.cc:403] T 2e36a9d6e29c4a7c860cf267efbd4c74 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 3 election: Cancelling election due to peer responding with higher term
I20260709 13:05:07.105000 20103 raft_consensus.cc:3060] T 14935b3ddf914369822e4a0547aaa355 P 127766fc592545a4997f7790f50f6076 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:05:07.105377 19374 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.4:43121, user_credentials={real_user=slave}} blocked reactor thread for 148143us
I20260709 13:05:06.944931 19485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b74109013a140ada21feeef92d6f563" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
W20260709 13:05:07.106036 19523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.1:40321, user_credentials={real_user=slave}} blocked reactor thread for 166172us
W20260709 13:05:07.106287 19374 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:07.108408 19523 leader_election.cc:304] T 70797e5783b5454ab0d0eea663e791e3 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e61c3a8f61bb48f8a963c9480e53c168; no voters: 127766fc592545a4997f7790f50f6076, e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:05:07.110144 20076 leader_election.cc:304] T 70797e5783b5454ab0d0eea663e791e3 P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 127766fc592545a4997f7790f50f6076; no voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:05:07.113809 19523 leader_election.cc:304] T 46c5bfeecc314717bffe987e6844b6d0 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:05:07.117640 19485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14935b3ddf914369822e4a0547aaa355" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:05:07.118216 19485 raft_consensus.cc:3060] T 14935b3ddf914369822e4a0547aaa355 P 0473d2b2d01f4459b1e90fd12cc7840e [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:05:07.115178 21638 raft_consensus.cc:2749] T 2e36a9d6e29c4a7c860cf267efbd4c74 P e61c3a8f61bb48f8a963c9480e53c168 [term 4 FOLLOWER]: Leader election lost for term 3. Reason: Vote denied by peer e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321) with higher term. Message: Invalid argument: T 2e36a9d6e29c4a7c860cf267efbd4c74 P e5256d91808b47c195bc9b4dbd7f2b87 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate e61c3a8f61bb48f8a963c9480e53c168 for earlier term 3. Current term is 4.
I20260709 13:05:07.120839 21622 raft_consensus.cc:493] T f93ee515a9c14139bf566522ed8232f3 P 0473d2b2d01f4459b1e90fd12cc7840e [term 7 FOLLOWER]: Starting pre-election (detected failure of leader e61c3a8f61bb48f8a963c9480e53c168)
I20260709 13:05:07.121340 21622 raft_consensus.cc:515] T f93ee515a9c14139bf566522ed8232f3 P 0473d2b2d01f4459b1e90fd12cc7840e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
W20260709 13:05:07.121877 21676 log.cc:927] Time spent T df751f992649444090e27965eb1af85d P e5256d91808b47c195bc9b4dbd7f2b87: Append to log took a long time: real 0.354s	user 0.003s	sys 0.012s
I20260709 13:05:07.122449 20103 raft_consensus.cc:2468] T 14935b3ddf914369822e4a0547aaa355 P 127766fc592545a4997f7790f50f6076 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 4.
I20260709 13:05:07.123366 21622 leader_election.cc:290] T f93ee515a9c14139bf566522ed8232f3 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:05:07.115337 21600 raft_consensus.cc:2749] T 70797e5783b5454ab0d0eea663e791e3 P 127766fc592545a4997f7790f50f6076 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:05:07.136013 21478 raft_consensus.cc:2955] T ab43d85f64114d4ebf618930e43d9ed0 P e61c3a8f61bb48f8a963c9480e53c168 [term 5 LEADER]: Committing config change with OpId 5.5: config changed from index 2 to 5, 127766fc592545a4997f7790f50f6076 (127.17.223.4) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } attrs { replace: true } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } } }
I20260709 13:05:07.141350 21630 leader_election.cc:290] T 0cdf56e38bbc453d9438d359e5a69955 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:05:07.125813 21615 raft_consensus.cc:2804] T 46c5bfeecc314717bffe987e6844b6d0 P e61c3a8f61bb48f8a963c9480e53c168 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:05:07.143174 21582 leader_election.cc:290] T 40e1e16737a842ee936002830f36882e P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 5 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:05:07.150918 19477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2725d2c4cb054f18b0fc8f735c15f6c2" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:05:07.116601 21614 raft_consensus.cc:515] T 1a61655d99124a29b486ba4a5b37faea P e61c3a8f61bb48f8a963c9480e53c168 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:07.151618 19477 raft_consensus.cc:2468] T 2725d2c4cb054f18b0fc8f735c15f6c2 P 0473d2b2d01f4459b1e90fd12cc7840e [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 4.
I20260709 13:05:07.154004 19523 leader_election.cc:304] T a08760e15aac4630a629431f56024dc8 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:05:07.156335 19403 raft_consensus.cc:2955] T ab43d85f64114d4ebf618930e43d9ed0 P e5256d91808b47c195bc9b4dbd7f2b87 [term 5 FOLLOWER]: Committing config change with OpId 5.5: config changed from index 2 to 5, 127766fc592545a4997f7790f50f6076 (127.17.223.4) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } attrs { replace: true } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } } }
I20260709 13:05:07.119066 21672 raft_consensus.cc:2749] T 70797e5783b5454ab0d0eea663e791e3 P e61c3a8f61bb48f8a963c9480e53c168 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:05:07.168027 20078 leader_election.cc:304] T 0afb57ae58a24a01850491d69f0213dd P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 127766fc592545a4997f7790f50f6076; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:05:07.207937 19485 raft_consensus.cc:2468] T 14935b3ddf914369822e4a0547aaa355 P 0473d2b2d01f4459b1e90fd12cc7840e [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 4.
I20260709 13:05:07.208250 20078 leader_election.cc:304] T 62c6c134d3d24a1ab144dd9ee6bc3f64 P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 127766fc592545a4997f7790f50f6076; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:05:07.175424 19377 leader_election.cc:304] T 40e1e16737a842ee936002830f36882e P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87; no voters: 
I20260709 13:05:07.182000 19483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cdf56e38bbc453d9438d359e5a69955" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:05:07.209589 19483 raft_consensus.cc:2468] T 0cdf56e38bbc453d9438d359e5a69955 P 0473d2b2d01f4459b1e90fd12cc7840e [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 5.
I20260709 13:05:07.210692 20075 leader_election.cc:304] T 65d8cb8d6ec64f459d5a47cefab10acf P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 127766fc592545a4997f7790f50f6076; no voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:05:07.224911 19482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e381f1d6b8184797ad142de49be225a8" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:05:07.225016 19377 leader_election.cc:304] T a08760e15aac4630a629431f56024dc8 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87; no voters: 
I20260709 13:05:07.229804 19482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a08760e15aac4630a629431f56024dc8" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:05:07.230878 19482 raft_consensus.cc:2393] T a08760e15aac4630a629431f56024dc8 P 0473d2b2d01f4459b1e90fd12cc7840e [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e61c3a8f61bb48f8a963c9480e53c168 in current term 4: Already voted for candidate 0473d2b2d01f4459b1e90fd12cc7840e in this term.
I20260709 13:05:07.232741 19482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48824d5acfbc485ebf8c2d944e7202de" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:05:07.233732 19482 raft_consensus.cc:2393] T 48824d5acfbc485ebf8c2d944e7202de P 0473d2b2d01f4459b1e90fd12cc7840e [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e61c3a8f61bb48f8a963c9480e53c168 in current term 3: Already voted for candidate 0473d2b2d01f4459b1e90fd12cc7840e in this term.
I20260709 13:05:07.237581 19486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e1085d23e8347fbbd5bce7542f4b1f4" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:05:07.237624 19482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e36a9d6e29c4a7c860cf267efbd4c74" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:05:07.143198 21615 raft_consensus.cc:493] T 46c5bfeecc314717bffe987e6844b6d0 P e61c3a8f61bb48f8a963c9480e53c168 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:07.246762 19377 leader_election.cc:400] T d1e5873a19244c5ebbcd38e126796ee7 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 5 election: Vote denied by peer 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257) with higher term. Message: Invalid argument: T d1e5873a19244c5ebbcd38e126796ee7 P 0473d2b2d01f4459b1e90fd12cc7840e [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate e5256d91808b47c195bc9b4dbd7f2b87 for earlier term 5. Current term is 6.
I20260709 13:05:07.249720 19377 leader_election.cc:403] T d1e5873a19244c5ebbcd38e126796ee7 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 5 election: Cancelling election due to peer responding with higher term
I20260709 13:05:07.253374 19482 raft_consensus.cc:2368] T 2e36a9d6e29c4a7c860cf267efbd4c74 P 0473d2b2d01f4459b1e90fd12cc7840e [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate e61c3a8f61bb48f8a963c9480e53c168 for earlier term 3. Current term is 4.
I20260709 13:05:07.168956 21582 raft_consensus.cc:493] T ef32ce6fdd0e40d382c79974f30295c6 P 0473d2b2d01f4459b1e90fd12cc7840e [term 5 FOLLOWER]: Starting pre-election (detected failure of leader e61c3a8f61bb48f8a963c9480e53c168)
I20260709 13:05:07.254773 19477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46c5bfeecc314717bffe987e6844b6d0" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 9 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:05:07.255637 19477 raft_consensus.cc:2468] T 46c5bfeecc314717bffe987e6844b6d0 P 0473d2b2d01f4459b1e90fd12cc7840e [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 8.
I20260709 13:05:07.263944 19408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a08760e15aac4630a629431f56024dc8" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:05:07.260463 19403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40e1e16737a842ee936002830f36882e" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
I20260709 13:05:07.274955 19554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a61655d99124a29b486ba4a5b37faea" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:05:07.276001 19554 raft_consensus.cc:2393] T 1a61655d99124a29b486ba4a5b37faea P e61c3a8f61bb48f8a963c9480e53c168 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0473d2b2d01f4459b1e90fd12cc7840e in current term 3: Already voted for candidate e61c3a8f61bb48f8a963c9480e53c168 in this term.
I20260709 13:05:07.262977 20112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48824d5acfbc485ebf8c2d944e7202de" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:05:07.244684 21633 raft_consensus.cc:493] T 9962423cb4e54fcfa5de01daf68a86e7 P e5256d91808b47c195bc9b4dbd7f2b87 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:07.244483 21636 raft_consensus.cc:2804] T 40e1e16737a842ee936002830f36882e P e5256d91808b47c195bc9b4dbd7f2b87 [term 6 FOLLOWER]: Leader election won for term 6
W20260709 13:05:07.321125 19374 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.4:43121, user_credentials={real_user=slave}} blocked reactor thread for 63253.7us
I20260709 13:05:07.320895 19450 leader_election.cc:304] T d1e5873a19244c5ebbcd38e126796ee7 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:05:07.248015 21553 raft_consensus.cc:2749] T 62c6c134d3d24a1ab144dd9ee6bc3f64 P 127766fc592545a4997f7790f50f6076 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:05:07.254804 21615 raft_consensus.cc:3060] T 46c5bfeecc314717bffe987e6844b6d0 P e61c3a8f61bb48f8a963c9480e53c168 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:05:07.331624 19377 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.2:46257, user_credentials={real_user=slave}} blocked reactor thread for 85012.4us
I20260709 13:05:07.335935 19377 leader_election.cc:304] T 2725d2c4cb054f18b0fc8f735c15f6c2 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87; no voters: 
I20260709 13:05:07.255244 21600 raft_consensus.cc:2749] T 65d8cb8d6ec64f459d5a47cefab10acf P 127766fc592545a4997f7790f50f6076 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:05:07.256259 21644 raft_consensus.cc:2804] T a08760e15aac4630a629431f56024dc8 P e5256d91808b47c195bc9b4dbd7f2b87 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:05:07.336841 19405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a61655d99124a29b486ba4a5b37faea" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
I20260709 13:05:07.334779 19402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab43d85f64114d4ebf618930e43d9ed0" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:05:07.337599 19375 leader_election.cc:304] T fa731b585f684a7fb2d106c50f143b83 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87; no voters: 127766fc592545a4997f7790f50f6076, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:05:07.344966 19377 leader_election.cc:304] T 14935b3ddf914369822e4a0547aaa355 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, 127766fc592545a4997f7790f50f6076, e5256d91808b47c195bc9b4dbd7f2b87; no voters: 
I20260709 13:05:07.346712 19558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46c5bfeecc314717bffe987e6844b6d0" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 8 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:05:07.248442 21536 consensus_queue.cc:1059] T 5ec1c4ce15e04c7e8c283a62179f2a64 P e5256d91808b47c195bc9b4dbd7f2b87 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.087s
I20260709 13:05:07.360653 19405 raft_consensus.cc:3060] T 1a61655d99124a29b486ba4a5b37faea P e5256d91808b47c195bc9b4dbd7f2b87 [term 1 FOLLOWER]: Advancing to term 3
I20260709 13:05:07.362594 19557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1b10566f45d4a7d9029858330e02d5b" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
W20260709 13:05:07.329067 21681 log.cc:927] Time spent T ab43d85f64114d4ebf618930e43d9ed0 P e5256d91808b47c195bc9b4dbd7f2b87: Append to log took a long time: real 0.073s	user 0.000s	sys 0.000s
I20260709 13:05:07.362957 19560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef32ce6fdd0e40d382c79974f30295c6" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:05:07.459265 19404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46c5bfeecc314717bffe987e6844b6d0" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 9 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:05:07.486204 19404 raft_consensus.cc:2468] T 46c5bfeecc314717bffe987e6844b6d0 P e5256d91808b47c195bc9b4dbd7f2b87 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 7.
W20260709 13:05:07.459679 19375 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.3:36891, user_credentials={real_user=slave}} blocked reactor thread for 122148us
I20260709 13:05:07.487330 19375 leader_election.cc:304] T 65d8cb8d6ec64f459d5a47cefab10acf P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87; no voters: 127766fc592545a4997f7790f50f6076, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:05:07.432761 20112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab43d85f64114d4ebf618930e43d9ed0" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:05:07.360556 19554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "179fd671030940b4b4a4e24bcc4aba0a" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:05:07.469090 19555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40e1e16737a842ee936002830f36882e" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:05:07.362391 19556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e36a9d6e29c4a7c860cf267efbd4c74" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:05:07.367538 19402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cdf56e38bbc453d9438d359e5a69955" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:05:07.320881 21554 raft_consensus.cc:493] T ff75a1d4cb1f493db8f71ddc136ba9ab P e5256d91808b47c195bc9b4dbd7f2b87 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 0473d2b2d01f4459b1e90fd12cc7840e)
I20260709 13:05:07.343514 21115 raft_consensus.cc:493] T b9f0d59553ad444883fcf5b5909f9798 P e61c3a8f61bb48f8a963c9480e53c168 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 0473d2b2d01f4459b1e90fd12cc7840e)
I20260709 13:05:07.281999 21582 raft_consensus.cc:515] T ef32ce6fdd0e40d382c79974f30295c6 P 0473d2b2d01f4459b1e90fd12cc7840e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:07.510417 19375 leader_election.cc:304] T 3e1f505cb0f1427bbd698ac889d80821 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:05:07.509316 19551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab43d85f64114d4ebf618930e43d9ed0" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:05:07.506789 19404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f93ee515a9c14139bf566522ed8232f3" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 8 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:05:07.337437 21444 raft_consensus.cc:2804] T d1e5873a19244c5ebbcd38e126796ee7 P 0473d2b2d01f4459b1e90fd12cc7840e [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:05:07.489039 19555 raft_consensus.cc:3060] T 40e1e16737a842ee936002830f36882e P e61c3a8f61bb48f8a963c9480e53c168 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:05:07.519784 19556 raft_consensus.cc:2393] T 2e36a9d6e29c4a7c860cf267efbd4c74 P e61c3a8f61bb48f8a963c9480e53c168 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate e5256d91808b47c195bc9b4dbd7f2b87 in current term 4: Already voted for candidate 0473d2b2d01f4459b1e90fd12cc7840e in this term.
I20260709 13:05:07.344130 21465 raft_consensus.cc:493] T f1b10566f45d4a7d9029858330e02d5b P e61c3a8f61bb48f8a963c9480e53c168 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 0473d2b2d01f4459b1e90fd12cc7840e)
I20260709 13:05:07.351931 21644 raft_consensus.cc:493] T a08760e15aac4630a629431f56024dc8 P e5256d91808b47c195bc9b4dbd7f2b87 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:07.366488 20107 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35874 (request call id 405) took 1257 ms. Trace:
I20260709 13:05:07.336995 21666 raft_consensus.cc:2749] T d1e5873a19244c5ebbcd38e126796ee7 P e5256d91808b47c195bc9b4dbd7f2b87 [term 6 FOLLOWER]: Leader election lost for term 5. Reason: Vote denied by peer 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257) with higher term. Message: Invalid argument: T d1e5873a19244c5ebbcd38e126796ee7 P 0473d2b2d01f4459b1e90fd12cc7840e [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate e5256d91808b47c195bc9b4dbd7f2b87 for earlier term 5. Current term is 6.
I20260709 13:05:07.506084 19552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a08760e15aac4630a629431f56024dc8" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:05:07.556877 19551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70797e5783b5454ab0d0eea663e791e3" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:05:07.367491 21603 consensus_queue.cc:1048] T 9962423cb4e54fcfa5de01daf68a86e7 P 127766fc592545a4997f7790f50f6076 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.185s
I20260709 13:05:07.333894 21633 raft_consensus.cc:515] T 9962423cb4e54fcfa5de01daf68a86e7 P e5256d91808b47c195bc9b4dbd7f2b87 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:05:07.509951 21529 raft_consensus.cc:493] T fa8650e71aa14778b3d73721fc50d9fc P e61c3a8f61bb48f8a963c9480e53c168 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 0473d2b2d01f4459b1e90fd12cc7840e)
I20260709 13:05:07.545327 21644 raft_consensus.cc:3060] T a08760e15aac4630a629431f56024dc8 P e5256d91808b47c195bc9b4dbd7f2b87 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:05:07.569573 21684 raft_consensus.cc:2804] T a08760e15aac4630a629431f56024dc8 P e61c3a8f61bb48f8a963c9480e53c168 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:05:07.588220 19405 raft_consensus.cc:2468] T 1a61655d99124a29b486ba4a5b37faea P e5256d91808b47c195bc9b4dbd7f2b87 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 3.
I20260709 13:05:07.568044 19551 raft_consensus.cc:2393] T 70797e5783b5454ab0d0eea663e791e3 P e61c3a8f61bb48f8a963c9480e53c168 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate e5256d91808b47c195bc9b4dbd7f2b87 in current term 5: Already voted for candidate e61c3a8f61bb48f8a963c9480e53c168 in this term.
W20260709 13:05:07.582774 19374 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:07.533315 21600 raft_consensus.cc:493] T ab43d85f64114d4ebf618930e43d9ed0 P 127766fc592545a4997f7790f50f6076 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader e61c3a8f61bb48f8a963c9480e53c168)
I20260709 13:05:07.528214 21559 raft_consensus.cc:493] T 309c3ca0ca4b4f3ba129752ea2cb293b P e61c3a8f61bb48f8a963c9480e53c168 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader e5256d91808b47c195bc9b4dbd7f2b87)
I20260709 13:05:07.550078 21536 raft_consensus.cc:2804] T 14935b3ddf914369822e4a0547aaa355 P e5256d91808b47c195bc9b4dbd7f2b87 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:05:07.546622 21547 raft_consensus.cc:2749] T 65d8cb8d6ec64f459d5a47cefab10acf P e5256d91808b47c195bc9b4dbd7f2b87 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:05:07.541632 21444 raft_consensus.cc:697] T d1e5873a19244c5ebbcd38e126796ee7 P 0473d2b2d01f4459b1e90fd12cc7840e [term 6 LEADER]: Becoming Leader. State: Replica: 0473d2b2d01f4459b1e90fd12cc7840e, State: Running, Role: LEADER
I20260709 13:05:07.523659 21115 raft_consensus.cc:515] T b9f0d59553ad444883fcf5b5909f9798 P e61c3a8f61bb48f8a963c9480e53c168 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:07.523965 21554 raft_consensus.cc:515] T ff75a1d4cb1f493db8f71ddc136ba9ab P e5256d91808b47c195bc9b4dbd7f2b87 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:07.586486 21675 raft_consensus.cc:2749] T 3e1f505cb0f1427bbd698ac889d80821 P e5256d91808b47c195bc9b4dbd7f2b87 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:05:07.588374 21684 raft_consensus.cc:493] T a08760e15aac4630a629431f56024dc8 P e61c3a8f61bb48f8a963c9480e53c168 [term 3 FOLLOWER]: Starting leader election (detected failure of leader e5256d91808b47c195bc9b4dbd7f2b87)
I20260709 13:05:07.549642 21465 raft_consensus.cc:515] T f1b10566f45d4a7d9029858330e02d5b P e61c3a8f61bb48f8a963c9480e53c168 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:07.640762 21684 raft_consensus.cc:3060] T a08760e15aac4630a629431f56024dc8 P e61c3a8f61bb48f8a963c9480e53c168 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:05:07.545012 20107 rpcz_store.cc:276] 0709 13:05:06.079600 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:06.095969 (+ 16369us) service_pool.cc:224] Handling call
0709 13:05:07.314442 (+1218473us) spinlock_profiling.cc:243] Waited 356 ms on lock 0x7b54006ee454. stack: 00007f4a79de9343 00007f4a79de9240 00007f4a797781d4 00007f4a834b6304 00007f4a834b6299 00007f4a7ce71571 00007f4a7cf0c2fa 00007f4a81ecdb17 00007f4a7b4486d4 00007f4a7b448662 00007f4a7b448591 00007f4a7b44850c 00007f4a7b4477c2 00007f4a7b24348c 00007f4a7b2428c6 00007f4a7b24226f
0709 13:05:07.331452 (+ 17010us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":819714432}
I20260709 13:05:07.652709 19555 raft_consensus.cc:2468] T 40e1e16737a842ee936002830f36882e P e61c3a8f61bb48f8a963c9480e53c168 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 6.
I20260709 13:05:07.653610 19551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f93ee515a9c14139bf566522ed8232f3" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 8 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:05:07.631007 21536 raft_consensus.cc:697] T 14935b3ddf914369822e4a0547aaa355 P e5256d91808b47c195bc9b4dbd7f2b87 [term 4 LEADER]: Becoming Leader. State: Replica: e5256d91808b47c195bc9b4dbd7f2b87, State: Running, Role: LEADER
I20260709 13:05:07.670136 19557 raft_consensus.cc:2410] T f1b10566f45d4a7d9029858330e02d5b P e61c3a8f61bb48f8a963c9480e53c168 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e5256d91808b47c195bc9b4dbd7f2b87 for term 7 because replica has last-logged OpId of term: 6 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 4.
I20260709 13:05:07.590287 21529 raft_consensus.cc:515] T fa8650e71aa14778b3d73721fc50d9fc P e61c3a8f61bb48f8a963c9480e53c168 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:07.677614 19551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e5873a19244c5ebbcd38e126796ee7" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:05:07.678465 19551 raft_consensus.cc:2368] T d1e5873a19244c5ebbcd38e126796ee7 P e61c3a8f61bb48f8a963c9480e53c168 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate e5256d91808b47c195bc9b4dbd7f2b87 for earlier term 5. Current term is 6.
I20260709 13:05:07.688983 19554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e381f1d6b8184797ad142de49be225a8" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:05:07.690229 19554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cdf56e38bbc453d9438d359e5a69955" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:05:07.691247 19560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b74109013a140ada21feeef92d6f563" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:05:07.692868 19551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14935b3ddf914369822e4a0547aaa355" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:05:07.693452 19551 raft_consensus.cc:3060] T 14935b3ddf914369822e4a0547aaa355 P e61c3a8f61bb48f8a963c9480e53c168 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:05:07.697021 19555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2725d2c4cb054f18b0fc8f735c15f6c2" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:05:07.657584 21614 leader_election.cc:290] T 1a61655d99124a29b486ba4a5b37faea P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 3 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:05:07.618525 21600 raft_consensus.cc:515] T ab43d85f64114d4ebf618930e43d9ed0 P 127766fc592545a4997f7790f50f6076 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } attrs { replace: true } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:05:07.623766 21559 raft_consensus.cc:515] T 309c3ca0ca4b4f3ba129752ea2cb293b P e61c3a8f61bb48f8a963c9480e53c168 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } attrs { replace: true } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:05:07.699554 21641 raft_consensus.cc:493] T 217b5fae677b4971b3bbd2f357a1f7ff P e61c3a8f61bb48f8a963c9480e53c168 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 0473d2b2d01f4459b1e90fd12cc7840e)
I20260709 13:05:07.709686 21555 raft_consensus.cc:2749] T fa731b585f684a7fb2d106c50f143b83 P e5256d91808b47c195bc9b4dbd7f2b87 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:05:07.710750 21444 consensus_queue.cc:237] T d1e5873a19244c5ebbcd38e126796ee7 P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:07.728108 19551 raft_consensus.cc:2468] T 14935b3ddf914369822e4a0547aaa355 P e61c3a8f61bb48f8a963c9480e53c168 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 4.
I20260709 13:05:07.736340 21576 raft_consensus.cc:2749] T 0afb57ae58a24a01850491d69f0213dd P 127766fc592545a4997f7790f50f6076 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:05:07.793215 21415 raft_consensus.cc:2804] T 2725d2c4cb054f18b0fc8f735c15f6c2 P e5256d91808b47c195bc9b4dbd7f2b87 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:05:07.727735 21641 raft_consensus.cc:515] T 217b5fae677b4971b3bbd2f357a1f7ff P e61c3a8f61bb48f8a963c9480e53c168 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:07.799397 21675 raft_consensus.cc:493] T fa8650e71aa14778b3d73721fc50d9fc P e5256d91808b47c195bc9b4dbd7f2b87 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 0473d2b2d01f4459b1e90fd12cc7840e)
W20260709 13:05:07.829537 21690 log.cc:927] Time spent T f1b10566f45d4a7d9029858330e02d5b P e5256d91808b47c195bc9b4dbd7f2b87: Append to log took a long time: real 0.118s	user 0.000s	sys 0.000s
I20260709 13:05:07.838896 21584 raft_consensus.cc:493] T 22196caba61445d3bec98a0aab3c337d P 0473d2b2d01f4459b1e90fd12cc7840e [term 4 FOLLOWER]: Starting pre-election (detected failure of leader e61c3a8f61bb48f8a963c9480e53c168)
I20260709 13:05:07.756162 21582 leader_election.cc:290] T ef32ce6fdd0e40d382c79974f30295c6 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:05:07.853178 20105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9962423cb4e54fcfa5de01daf68a86e7" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
W20260709 13:05:07.856267 21689 log.cc:927] Time spent T 21e14947d70440f19044d8f75c31e1f9 P e5256d91808b47c195bc9b4dbd7f2b87: Append to log took a long time: real 0.188s	user 0.001s	sys 0.000s
I20260709 13:05:07.717870 21536 consensus_queue.cc:237] T 14935b3ddf914369822e4a0547aaa355 P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.4, Last appended by leader: 4, Current term: 4, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } attrs { replace: true } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
W20260709 13:05:07.873063 19375 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.3:36891, user_credentials={real_user=slave}} blocked reactor thread for 362719us
I20260709 13:05:07.799944 21525 raft_consensus.cc:493] T 7f575b143b844aa096b50997dad3516a P 0473d2b2d01f4459b1e90fd12cc7840e [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e5256d91808b47c195bc9b4dbd7f2b87)
I20260709 13:05:07.819533 21622 raft_consensus.cc:493] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P 0473d2b2d01f4459b1e90fd12cc7840e [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 127766fc592545a4997f7790f50f6076)
W20260709 13:05:07.845029 19553 consensus_meta.cc:287] T 4af19371ea874c09a0a2147040835cbb P e61c3a8f61bb48f8a963c9480e53c168: Time spent flushing consensus metadata: real 0.851s	user 0.011s	sys 0.000s
W20260709 13:05:07.883155 19377 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.2:46257, user_credentials={real_user=slave}} blocked reactor thread for 538236us
I20260709 13:05:07.799770 21596 raft_consensus.cc:493] T ed7fdbcb96d14d418db9ca90a792588a P 127766fc592545a4997f7790f50f6076 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 0473d2b2d01f4459b1e90fd12cc7840e)
W20260709 13:05:07.861151 19449 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.1:40321, user_credentials={real_user=slave}} blocked reactor thread for 413325us
I20260709 13:05:07.875385 19523 leader_election.cc:304] T 48824d5acfbc485ebf8c2d944e7202de P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 127766fc592545a4997f7790f50f6076, e61c3a8f61bb48f8a963c9480e53c168; no voters: 0473d2b2d01f4459b1e90fd12cc7840e
I20260709 13:05:07.876078 19375 leader_election.cc:304] T 2a16f7501e2444fb86d4e2778e734e02 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87; no voters: 127766fc592545a4997f7790f50f6076, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:05:07.881883 19411 raft_consensus.cc:3060] T 5ec1c4ce15e04c7e8c283a62179f2a64 P e5256d91808b47c195bc9b4dbd7f2b87 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:05:07.869920 20075 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.612s	user 0.026s	sys 0.049s
W20260709 13:05:07.889051 20075 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.631s	user 0.026s	sys 0.049s
W20260709 13:05:07.889343 20075 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.1:40321, user_credentials={real_user=slave}} blocked reactor thread for 631860us
I20260709 13:05:07.849283 21529 leader_election.cc:290] T fa8650e71aa14778b3d73721fc50d9fc P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:05:07.848579 21633 leader_election.cc:290] T 9962423cb4e54fcfa5de01daf68a86e7 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:05:07.891489 19375 leader_election.cc:304] T 179fd671030940b4b4a4e24bcc4aba0a P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:05:07.887313 19377 leader_election.cc:304] T 0cdf56e38bbc453d9438d359e5a69955 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87; no voters: 
I20260709 13:05:07.897264 19375 leader_election.cc:304] T ef32ce6fdd0e40d382c79974f30295c6 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168
W20260709 13:05:07.899184 19450 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.3:36891, user_credentials={real_user=slave}} blocked reactor thread for 447667us
I20260709 13:05:07.899760 19450 leader_election.cc:304] T bc225c93219c45538b53a1bd3d387e4d P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168; no voters: e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:05:07.919236 19375 leader_election.cc:304] T ab43d85f64114d4ebf618930e43d9ed0 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:05:07.881026 21115 leader_election.cc:290] T b9f0d59553ad444883fcf5b5909f9798 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:05:07.861574 21675 raft_consensus.cc:515] T fa8650e71aa14778b3d73721fc50d9fc P e5256d91808b47c195bc9b4dbd7f2b87 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:07.923255 19410 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52342 (request call id 1788) took 1268 ms. Trace:
I20260709 13:05:07.928709 19410 rpcz_store.cc:276] 0709 13:05:06.654663 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:07.123474 (+468811us) service_pool.cc:224] Handling call
0709 13:05:07.123824 (+   350us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:05:07.124239 (+   415us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 13:05:07.124281 (+    42us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:05:07.126403 (+  2122us) log.cc:844] Serialized 26 byte log entry
0709 13:05:07.223852 (+ 97449us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:05:07.223909 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:07.224001 (+    92us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:05:07.922992 (+698991us) raft_consensus.cc:1685] finished
0709 13:05:07.923020 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:07.923183 (+   163us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":2038,"raft.run_cpu_time_us":102,"raft.run_wall_time_us":1513,"thread_start_us":92218,"threads_started":1,"wal-append.queue_time_us":530479}
W20260709 13:05:07.930154 19526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.2:46257, user_credentials={real_user=slave}} blocked reactor thread for 441531us
I20260709 13:05:07.889765 21465 leader_election.cc:290] T f1b10566f45d4a7d9029858330e02d5b P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:05:07.883293 19553 raft_consensus.cc:2468] T 4af19371ea874c09a0a2147040835cbb P e61c3a8f61bb48f8a963c9480e53c168 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 127766fc592545a4997f7790f50f6076 in term 4.
I20260709 13:05:07.871405 21584 raft_consensus.cc:515] T 22196caba61445d3bec98a0aab3c337d P 0473d2b2d01f4459b1e90fd12cc7840e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:07.894393 21630 raft_consensus.cc:2749] T 2a16f7501e2444fb86d4e2778e734e02 P e5256d91808b47c195bc9b4dbd7f2b87 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:05:07.931535 19526 leader_election.cc:304] T 0e1085d23e8347fbbd5bce7542f4b1f4 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e61c3a8f61bb48f8a963c9480e53c168; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, 127766fc592545a4997f7790f50f6076
I20260709 13:05:07.915102 21554 leader_election.cc:290] T ff75a1d4cb1f493db8f71ddc136ba9ab P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:05:07.914129 21614 raft_consensus.cc:2804] T 48824d5acfbc485ebf8c2d944e7202de P e61c3a8f61bb48f8a963c9480e53c168 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:05:07.914491 21633 raft_consensus.cc:2749] T 179fd671030940b4b4a4e24bcc4aba0a P e5256d91808b47c195bc9b4dbd7f2b87 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:05:07.936081 19551 raft_consensus.cc:1275] T 4af19371ea874c09a0a2147040835cbb P e61c3a8f61bb48f8a963c9480e53c168 [term 4 FOLLOWER]: Refusing update from remote peer 127766fc592545a4997f7790f50f6076: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:05:07.883065 21525 raft_consensus.cc:515] T 7f575b143b844aa096b50997dad3516a P 0473d2b2d01f4459b1e90fd12cc7840e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:07.926993 21555 raft_consensus.cc:2804] T 0cdf56e38bbc453d9438d359e5a69955 P e5256d91808b47c195bc9b4dbd7f2b87 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:05:07.886102 21622 raft_consensus.cc:515] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P 0473d2b2d01f4459b1e90fd12cc7840e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:05:07.894348 21596 raft_consensus.cc:515] T ed7fdbcb96d14d418db9ca90a792588a P 127766fc592545a4997f7790f50f6076 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:05:07.961362 19526 leader_election.cc:400] T 2e36a9d6e29c4a7c860cf267efbd4c74 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 3 election: Vote denied by peer 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257) with higher term. Message: Invalid argument: T 2e36a9d6e29c4a7c860cf267efbd4c74 P 0473d2b2d01f4459b1e90fd12cc7840e [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate e61c3a8f61bb48f8a963c9480e53c168 for earlier term 3. Current term is 4.
I20260709 13:05:07.940517 19553 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41504 (request call id 253) took 1045 ms. Trace:
W20260709 13:05:07.990458 19449 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.1:40321, user_credentials={real_user=slave}} blocked reactor thread for 78801.7us
I20260709 13:05:07.990527 19554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a08760e15aac4630a629431f56024dc8" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:05:07.946144 21614 raft_consensus.cc:493] T 48824d5acfbc485ebf8c2d944e7202de P e61c3a8f61bb48f8a963c9480e53c168 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 127766fc592545a4997f7790f50f6076)
W20260709 13:05:07.997738 20075 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.1:40321, user_credentials={real_user=slave}} blocked reactor thread for 107374us
I20260709 13:05:07.959565 21555 raft_consensus.cc:493] T 0cdf56e38bbc453d9438d359e5a69955 P e5256d91808b47c195bc9b4dbd7f2b87 [term 5 FOLLOWER]: Starting leader election (detected failure of leader e61c3a8f61bb48f8a963c9480e53c168)
I20260709 13:05:08.006083 20075 leader_election.cc:400] T 14935b3ddf914369822e4a0547aaa355 P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 3 election: Vote denied by peer e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321) with higher term. Message: Invalid argument: T 14935b3ddf914369822e4a0547aaa355 P e5256d91808b47c195bc9b4dbd7f2b87 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 127766fc592545a4997f7790f50f6076 for earlier term 3. Current term is 4.
I20260709 13:05:08.001336 19555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40e1e16737a842ee936002830f36882e" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:05:08.006991 20075 leader_election.cc:403] T 14935b3ddf914369822e4a0547aaa355 P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 3 election: Cancelling election due to peer responding with higher term
I20260709 13:05:08.007535 19555 raft_consensus.cc:2368] T 40e1e16737a842ee936002830f36882e P e61c3a8f61bb48f8a963c9480e53c168 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 0473d2b2d01f4459b1e90fd12cc7840e for earlier term 5. Current term is 6.
I20260709 13:05:08.004843 19554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cdf56e38bbc453d9438d359e5a69955" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:05:07.949842 21704 raft_consensus.cc:2749] T 0e1085d23e8347fbbd5bce7542f4b1f4 P e61c3a8f61bb48f8a963c9480e53c168 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 13:05:08.021023 19375 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.3:36891, user_credentials={real_user=slave}} blocked reactor thread for 101857us
I20260709 13:05:07.988938 21115 raft_consensus.cc:493] T 1dc5b3532fe54f74876d02beffa2c230 P e61c3a8f61bb48f8a963c9480e53c168 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader e5256d91808b47c195bc9b4dbd7f2b87)
I20260709 13:05:07.995316 21633 raft_consensus.cc:2749] T ef32ce6fdd0e40d382c79974f30295c6 P e5256d91808b47c195bc9b4dbd7f2b87 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:05:08.057106 21586 raft_consensus.cc:2749] T 14935b3ddf914369822e4a0547aaa355 P 127766fc592545a4997f7790f50f6076 [term 4 FOLLOWER]: Leader election lost for term 3. Reason: Vote denied by peer e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321) with higher term. Message: Invalid argument: T 14935b3ddf914369822e4a0547aaa355 P e5256d91808b47c195bc9b4dbd7f2b87 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 127766fc592545a4997f7790f50f6076 for earlier term 3. Current term is 4.
W20260709 13:05:08.049649 19450 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.3:36891, user_credentials={real_user=slave}} blocked reactor thread for 149934us
I20260709 13:05:08.050547 19375 leader_election.cc:304] T 2e36a9d6e29c4a7c860cf267efbd4c74 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:05:08.051419 21600 leader_election.cc:290] T ab43d85f64114d4ebf618930e43d9ed0 P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:05:08.051167 21115 raft_consensus.cc:515] T 1dc5b3532fe54f74876d02beffa2c230 P e61c3a8f61bb48f8a963c9480e53c168 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:08.058935 21633 raft_consensus.cc:2749] T 2e36a9d6e29c4a7c860cf267efbd4c74 P e5256d91808b47c195bc9b4dbd7f2b87 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
W20260709 13:05:08.059494 21694 log.cc:927] Time spent T f1b10566f45d4a7d9029858330e02d5b P 0473d2b2d01f4459b1e90fd12cc7840e: Append to log took a long time: real 0.210s	user 0.001s	sys 0.000s
I20260709 13:05:08.060034 19375 leader_election.cc:304] T 70797e5783b5454ab0d0eea663e791e3 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87; no voters: 127766fc592545a4997f7790f50f6076, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:05:08.060400 21115 leader_election.cc:290] T 1dc5b3532fe54f74876d02beffa2c230 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:05:08.052155 19555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f93ee515a9c14139bf566522ed8232f3" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 8 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:05:08.060838 21633 raft_consensus.cc:2749] T 70797e5783b5454ab0d0eea663e791e3 P e5256d91808b47c195bc9b4dbd7f2b87 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:05:07.990103 19553 rpcz_store.cc:276] 0709 13:05:06.895581 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:06.899930 (+  4349us) service_pool.cc:224] Handling call
0709 13:05:07.938344 (+1038414us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:05:08.062007 19555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a61655d99124a29b486ba4a5b37faea" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:05:08.062770 19555 raft_consensus.cc:2393] T 1a61655d99124a29b486ba4a5b37faea P e61c3a8f61bb48f8a963c9480e53c168 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 0473d2b2d01f4459b1e90fd12cc7840e in current term 3: Already voted for candidate e61c3a8f61bb48f8a963c9480e53c168 in this term.
I20260709 13:05:08.011623 21555 raft_consensus.cc:3060] T 0cdf56e38bbc453d9438d359e5a69955 P e5256d91808b47c195bc9b4dbd7f2b87 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:05:07.999917 21614 raft_consensus.cc:3060] T 48824d5acfbc485ebf8c2d944e7202de P e61c3a8f61bb48f8a963c9480e53c168 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:08.069041 21596 leader_election.cc:290] T ed7fdbcb96d14d418db9ca90a792588a P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:05:08.069425 21699 raft_consensus.cc:2804] T bc225c93219c45538b53a1bd3d387e4d P 0473d2b2d01f4459b1e90fd12cc7840e [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:05:08.069962 21699 raft_consensus.cc:697] T bc225c93219c45538b53a1bd3d387e4d P 0473d2b2d01f4459b1e90fd12cc7840e [term 7 LEADER]: Becoming Leader. State: Replica: 0473d2b2d01f4459b1e90fd12cc7840e, State: Running, Role: LEADER
W20260709 13:05:08.055989 21696 log.cc:927] Time spent T df751f992649444090e27965eb1af85d P 0473d2b2d01f4459b1e90fd12cc7840e: Append to log took a long time: real 0.050s	user 0.000s	sys 0.000s
I20260709 13:05:08.070879 21699 consensus_queue.cc:237] T bc225c93219c45538b53a1bd3d387e4d P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:08.055977 21584 leader_election.cc:290] T 22196caba61445d3bec98a0aab3c337d P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:05:08.062026 19553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab43d85f64114d4ebf618930e43d9ed0" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
W20260709 13:05:08.072890 21695 log.cc:927] Time spent T 0afb57ae58a24a01850491d69f0213dd P 127766fc592545a4997f7790f50f6076: Append to log took a long time: real 0.079s	user 0.000s	sys 0.000s
I20260709 13:05:08.073184 19553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46c5bfeecc314717bffe987e6844b6d0" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 9 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:05:08.074599 21555 raft_consensus.cc:515] T 0cdf56e38bbc453d9438d359e5a69955 P e5256d91808b47c195bc9b4dbd7f2b87 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:08.079152 21555 leader_election.cc:290] T 0cdf56e38bbc453d9438d359e5a69955 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 6 election: Requested vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:05:08.079704 21622 leader_election.cc:290] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:05:08.064217 19375 leader_election.cc:304] T f93ee515a9c14139bf566522ed8232f3 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:05:08.081040 21525 leader_election.cc:290] T 7f575b143b844aa096b50997dad3516a P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
W20260709 13:05:08.082465 21615 consensus_meta.cc:287] T 46c5bfeecc314717bffe987e6844b6d0 P e61c3a8f61bb48f8a963c9480e53c168: Time spent flushing consensus metadata: real 0.703s	user 0.009s	sys 0.001s
W20260709 13:05:08.091147 20075 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.1:40321, user_credentials={real_user=slave}} blocked reactor thread for 91284.1us
I20260709 13:05:08.090998 19450 leader_election.cc:304] T 86a6797bdfe94fa496c050ceae4bd0d9 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e; no voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:05:08.074383 19553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48824d5acfbc485ebf8c2d944e7202de" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
W20260709 13:05:07.998488 21636 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.516s	user 0.008s	sys 0.011s
I20260709 13:05:08.080358 19411 raft_consensus.cc:2468] T 5ec1c4ce15e04c7e8c283a62179f2a64 P e5256d91808b47c195bc9b4dbd7f2b87 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 2.
I20260709 13:05:08.022294 21630 raft_consensus.cc:2749] T ab43d85f64114d4ebf618930e43d9ed0 P e5256d91808b47c195bc9b4dbd7f2b87 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:05:08.082435 21675 leader_election.cc:290] T fa8650e71aa14778b3d73721fc50d9fc P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:05:08.109514 19555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab43d85f64114d4ebf618930e43d9ed0" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:05:08.114249 19555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed7fdbcb96d14d418db9ca90a792588a" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:05:08.100374 21555 raft_consensus.cc:2749] T f93ee515a9c14139bf566522ed8232f3 P e5256d91808b47c195bc9b4dbd7f2b87 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:05:08.102015 19375 leader_election.cc:400] T d1e5873a19244c5ebbcd38e126796ee7 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 5 election: Vote denied by peer e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891) with higher term. Message: Invalid argument: T d1e5873a19244c5ebbcd38e126796ee7 P e61c3a8f61bb48f8a963c9480e53c168 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate e5256d91808b47c195bc9b4dbd7f2b87 for earlier term 5. Current term is 6.
I20260709 13:05:08.103140 21430 raft_consensus.cc:2749] T 86a6797bdfe94fa496c050ceae4bd0d9 P 0473d2b2d01f4459b1e90fd12cc7840e [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:05:08.103740 21716 raft_consensus.cc:493] T 0afb57ae58a24a01850491d69f0213dd P 0473d2b2d01f4459b1e90fd12cc7840e [term 5 FOLLOWER]: Starting pre-election (detected failure of leader e61c3a8f61bb48f8a963c9480e53c168)
I20260709 13:05:08.116084 19375 leader_election.cc:304] T e381f1d6b8184797ad142de49be225a8 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:05:08.116353 21716 raft_consensus.cc:515] T 0afb57ae58a24a01850491d69f0213dd P 0473d2b2d01f4459b1e90fd12cc7840e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
W20260709 13:05:08.113001 19411 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52342 (request call id 1769) took 1864 ms (client timeout 1900 ms). Trace:
W20260709 13:05:08.121583 19411 rpcz_store.cc:269] 0709 13:05:06.241661 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:06.243256 (+  1595us) service_pool.cc:224] Handling call
0709 13:05:07.270566 (+1027310us) spinlock_profiling.cc:243] Waited 350 ms on lock 0x7b58001352d0. stack: 00007f4a79de9343 00007f4a79de9240 00007f4a797781d4 00007f4a834b6304 00007f4a834b6299 00007f4a7ce71571 00007f4a7ce640aa 00007f4a7cee6447 00007f4a7cefefe7 00007f4a7cf007de 00007f4a7cf0c27c 00007f4a81ecdb17 00007f4a7b4486d4 00007f4a7b448662 00007f4a7b448591 00007f4a7b44850c
0709 13:05:07.863007 (+592441us) spinlock_profiling.cc:243] Waited 258 ms on lock 0x7b54000bb6a0. stack: 00007f4a79de9343 00007f4a79de9240 00007f4a797781d4 00007f4a834b6304 00007f4a834b6299 00007f4a7ce71571 00007f4a7ce7da1d 00007f4a7ce641a4 00007f4a7cee6447 00007f4a7cefefe7 00007f4a7cf007de 00007f4a7cf0c27c 00007f4a81ecdb17 00007f4a7b4486d4 00007f4a7b448662 00007f4a7b448591
0709 13:05:08.106084 (+243077us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1399286400}
I20260709 13:05:08.124064 19375 leader_election.cc:304] T 2b74109013a140ada21feeef92d6f563 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168
W20260709 13:05:08.118963 21411 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 2 current term: 2 is higher.
I20260709 13:05:08.106294 19450 leader_election.cc:304] T 2e36a9d6e29c4a7c860cf267efbd4c74 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168; no voters: e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:05:08.129242 21430 raft_consensus.cc:2804] T 2e36a9d6e29c4a7c860cf267efbd4c74 P 0473d2b2d01f4459b1e90fd12cc7840e [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:05:08.129766 21430 raft_consensus.cc:697] T 2e36a9d6e29c4a7c860cf267efbd4c74 P 0473d2b2d01f4459b1e90fd12cc7840e [term 4 LEADER]: Becoming Leader. State: Replica: 0473d2b2d01f4459b1e90fd12cc7840e, State: Running, Role: LEADER
I20260709 13:05:08.130713 21630 raft_consensus.cc:2749] T 2b74109013a140ada21feeef92d6f563 P e5256d91808b47c195bc9b4dbd7f2b87 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:05:08.130609 21430 consensus_queue.cc:237] T 2e36a9d6e29c4a7c860cf267efbd4c74 P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:08.121627 21675 raft_consensus.cc:2749] T e381f1d6b8184797ad142de49be225a8 P e5256d91808b47c195bc9b4dbd7f2b87 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:05:08.139648 21415 raft_consensus.cc:493] T 2725d2c4cb054f18b0fc8f735c15f6c2 P e5256d91808b47c195bc9b4dbd7f2b87 [term 4 FOLLOWER]: Starting leader election (detected failure of leader e61c3a8f61bb48f8a963c9480e53c168)
I20260709 13:05:08.140174 21415 raft_consensus.cc:3060] T 2725d2c4cb054f18b0fc8f735c15f6c2 P e5256d91808b47c195bc9b4dbd7f2b87 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:05:08.140435 21684 raft_consensus.cc:515] T a08760e15aac4630a629431f56024dc8 P e61c3a8f61bb48f8a963c9480e53c168 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:08.141848 19552 raft_consensus.cc:2468] T a08760e15aac4630a629431f56024dc8 P e61c3a8f61bb48f8a963c9480e53c168 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 4.
I20260709 13:05:08.105933 21636 raft_consensus.cc:697] T 40e1e16737a842ee936002830f36882e P e5256d91808b47c195bc9b4dbd7f2b87 [term 6 LEADER]: Becoming Leader. State: Replica: e5256d91808b47c195bc9b4dbd7f2b87, State: Running, Role: LEADER
I20260709 13:05:08.137382 21614 raft_consensus.cc:515] T 48824d5acfbc485ebf8c2d944e7202de P e61c3a8f61bb48f8a963c9480e53c168 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:05:08.145488 19553 raft_consensus.cc:2468] T 48824d5acfbc485ebf8c2d944e7202de P e61c3a8f61bb48f8a963c9480e53c168 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 3.
I20260709 13:05:08.122815 21559 leader_election.cc:290] T 309c3ca0ca4b4f3ba129752ea2cb293b P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:05:08.098630 21615 raft_consensus.cc:515] T 46c5bfeecc314717bffe987e6844b6d0 P e61c3a8f61bb48f8a963c9480e53c168 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:08.155864 19558 raft_consensus.cc:2368] T 46c5bfeecc314717bffe987e6844b6d0 P e61c3a8f61bb48f8a963c9480e53c168 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e5256d91808b47c195bc9b4dbd7f2b87 for earlier term 8. Current term is 9.
I20260709 13:05:08.156329 21684 leader_election.cc:290] T a08760e15aac4630a629431f56024dc8 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 4 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:05:08.120705 21716 leader_election.cc:290] T 0afb57ae58a24a01850491d69f0213dd P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:05:08.158016 21615 leader_election.cc:290] T 46c5bfeecc314717bffe987e6844b6d0 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 9 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:05:08.165100 19450 leader_election.cc:400] T 40e1e16737a842ee936002830f36882e P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 5 election: Vote denied by peer e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891) with higher term. Message: Invalid argument: T 40e1e16737a842ee936002830f36882e P e61c3a8f61bb48f8a963c9480e53c168 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 0473d2b2d01f4459b1e90fd12cc7840e for earlier term 5. Current term is 6.
I20260709 13:05:08.167250 21636 consensus_queue.cc:237] T 40e1e16737a842ee936002830f36882e P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:08.167829 19450 leader_election.cc:403] T 40e1e16737a842ee936002830f36882e P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 5 election: Cancelling election due to peer responding with higher term
W20260709 13:05:08.179198 19449 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.1:40321, user_credentials={real_user=slave}} blocked reactor thread for 187910us
I20260709 13:05:08.185428 20112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48824d5acfbc485ebf8c2d944e7202de" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076"
I20260709 13:05:08.190773 19406 raft_consensus.cc:1275] T 4af19371ea874c09a0a2147040835cbb P e5256d91808b47c195bc9b4dbd7f2b87 [term 4 FOLLOWER]: Refusing update from remote peer 127766fc592545a4997f7790f50f6076: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:05:08.191915 19449 leader_election.cc:304] T ab43d85f64114d4ebf618930e43d9ed0 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e; no voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:05:08.193646 19375 leader_election.cc:304] T f1b10566f45d4a7d9029858330e02d5b P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:05:08.199694 19551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff75a1d4cb1f493db8f71ddc136ba9ab" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:05:08.200906 19551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef32ce6fdd0e40d382c79974f30295c6" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:05:08.201515 19406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab43d85f64114d4ebf618930e43d9ed0" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:05:08.201632 19555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22196caba61445d3bec98a0aab3c337d" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:05:08.203672 19555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cdf56e38bbc453d9438d359e5a69955" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:05:08.205513 21615 raft_consensus.cc:493] T 1efebf73c86e432baa55533136b6e12c P e61c3a8f61bb48f8a963c9480e53c168 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 127766fc592545a4997f7790f50f6076)
I20260709 13:05:08.205943 21630 raft_consensus.cc:2749] T f1b10566f45d4a7d9029858330e02d5b P e5256d91808b47c195bc9b4dbd7f2b87 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:05:08.206066 21615 raft_consensus.cc:515] T 1efebf73c86e432baa55533136b6e12c P e61c3a8f61bb48f8a963c9480e53c168 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:05:08.208379 21539 raft_consensus.cc:493] T 28af091831594f9d8e96482078cc7625 P e61c3a8f61bb48f8a963c9480e53c168 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 0473d2b2d01f4459b1e90fd12cc7840e)
I20260709 13:05:08.208899 21539 raft_consensus.cc:515] T 28af091831594f9d8e96482078cc7625 P e61c3a8f61bb48f8a963c9480e53c168 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:08.208796 20105 raft_consensus.cc:2955] T ab43d85f64114d4ebf618930e43d9ed0 P 127766fc592545a4997f7790f50f6076 [term 5 FOLLOWER]: Committing config change with OpId 5.5: config changed from index 2 to 5, 127766fc592545a4997f7790f50f6076 (127.17.223.4) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } attrs { replace: true } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } } }
I20260709 13:05:08.195485 21403 raft_consensus.cc:493] T 172b3dd13109415a955b71ac0e9d2234 P 127766fc592545a4997f7790f50f6076 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0473d2b2d01f4459b1e90fd12cc7840e)
I20260709 13:05:08.211601 19405 raft_consensus.cc:1240] T 0cdf56e38bbc453d9438d359e5a69955 P e5256d91808b47c195bc9b4dbd7f2b87 [term 6 FOLLOWER]: Rejecting Update request from peer e61c3a8f61bb48f8a963c9480e53c168 for earlier term 5. Current term is 6. Ops: []
I20260709 13:05:08.211501 21403 raft_consensus.cc:515] T 172b3dd13109415a955b71ac0e9d2234 P 127766fc592545a4997f7790f50f6076 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:05:08.212002 19410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "309c3ca0ca4b4f3ba129752ea2cb293b" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:05:08.212550 19405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "217b5fae677b4971b3bbd2f357a1f7ff" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:05:08.213570 21403 leader_election.cc:290] T 172b3dd13109415a955b71ac0e9d2234 P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:05:08.214442 19407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9f0d59553ad444883fcf5b5909f9798" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:05:08.215571 19402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1b10566f45d4a7d9029858330e02d5b" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:05:08.215728 21415 raft_consensus.cc:515] T 2725d2c4cb054f18b0fc8f735c15f6c2 P e5256d91808b47c195bc9b4dbd7f2b87 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:08.216571 21088 raft_consensus.cc:2749] T ab43d85f64114d4ebf618930e43d9ed0 P 0473d2b2d01f4459b1e90fd12cc7840e [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:05:08.217298 21411 raft_consensus.cc:493] T 86a6797bdfe94fa496c050ceae4bd0d9 P e5256d91808b47c195bc9b4dbd7f2b87 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader e61c3a8f61bb48f8a963c9480e53c168)
I20260709 13:05:08.217382 19449 leader_election.cc:304] T 46c5bfeecc314717bffe987e6844b6d0 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87; no voters: e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:05:08.217823 21411 raft_consensus.cc:515] T 86a6797bdfe94fa496c050ceae4bd0d9 P e5256d91808b47c195bc9b4dbd7f2b87 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:08.218209 21415 leader_election.cc:290] T 2725d2c4cb054f18b0fc8f735c15f6c2 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 5 election: Requested vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:05:08.219856 21411 leader_election.cc:290] T 86a6797bdfe94fa496c050ceae4bd0d9 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:05:08.220295 21088 raft_consensus.cc:2804] T 46c5bfeecc314717bffe987e6844b6d0 P 0473d2b2d01f4459b1e90fd12cc7840e [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:05:08.220672 21088 raft_consensus.cc:493] T 46c5bfeecc314717bffe987e6844b6d0 P 0473d2b2d01f4459b1e90fd12cc7840e [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:08.220985 21088 raft_consensus.cc:3060] T 46c5bfeecc314717bffe987e6844b6d0 P 0473d2b2d01f4459b1e90fd12cc7840e [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:05:08.222026 19411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a61655d99124a29b486ba4a5b37faea" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
I20260709 13:05:08.222767 19411 raft_consensus.cc:2393] T 1a61655d99124a29b486ba4a5b37faea P e5256d91808b47c195bc9b4dbd7f2b87 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate e61c3a8f61bb48f8a963c9480e53c168 in current term 3: Already voted for candidate 0473d2b2d01f4459b1e90fd12cc7840e in this term.
I20260709 13:05:08.223029 19551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa8650e71aa14778b3d73721fc50d9fc" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:05:08.224182 19411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dc5b3532fe54f74876d02beffa2c230" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:05:08.224495 20104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "309c3ca0ca4b4f3ba129752ea2cb293b" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:05:08.224932 19409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa8650e71aa14778b3d73721fc50d9fc" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:05:08.225570 19409 raft_consensus.cc:2468] T fa8650e71aa14778b3d73721fc50d9fc P e5256d91808b47c195bc9b4dbd7f2b87 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 5.
I20260709 13:05:08.189689 21721 consensus_queue.cc:1048] T 4af19371ea874c09a0a2147040835cbb P 127766fc592545a4997f7790f50f6076 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.038s
I20260709 13:05:08.228266 21088 raft_consensus.cc:515] T 46c5bfeecc314717bffe987e6844b6d0 P 0473d2b2d01f4459b1e90fd12cc7840e [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:08.229278 19409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46c5bfeecc314717bffe987e6844b6d0" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 9 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
I20260709 13:05:08.229831 19409 raft_consensus.cc:3060] T 46c5bfeecc314717bffe987e6844b6d0 P e5256d91808b47c195bc9b4dbd7f2b87 [term 7 FOLLOWER]: Advancing to term 9
W20260709 13:05:08.230240 21644 consensus_meta.cc:287] T a08760e15aac4630a629431f56024dc8 P e5256d91808b47c195bc9b4dbd7f2b87: Time spent flushing consensus metadata: real 0.623s	user 0.010s	sys 0.000s
I20260709 13:05:08.230752 21644 raft_consensus.cc:515] T a08760e15aac4630a629431f56024dc8 P e5256d91808b47c195bc9b4dbd7f2b87 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:08.231323 19449 leader_election.cc:304] T 0cdf56e38bbc453d9438d359e5a69955 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e; no voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:05:08.232164 19408 raft_consensus.cc:2393] T a08760e15aac4630a629431f56024dc8 P e5256d91808b47c195bc9b4dbd7f2b87 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0473d2b2d01f4459b1e90fd12cc7840e in current term 5: Already voted for candidate e5256d91808b47c195bc9b4dbd7f2b87 in this term.
I20260709 13:05:08.233043 21644 leader_election.cc:290] T a08760e15aac4630a629431f56024dc8 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 5 election: Requested vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:05:08.190104 21525 raft_consensus.cc:2749] T 40e1e16737a842ee936002830f36882e P 0473d2b2d01f4459b1e90fd12cc7840e [term 6 FOLLOWER]: Leader election lost for term 5. Reason: Vote denied by peer e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891) with higher term. Message: Invalid argument: T 40e1e16737a842ee936002830f36882e P e61c3a8f61bb48f8a963c9480e53c168 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 0473d2b2d01f4459b1e90fd12cc7840e for earlier term 5. Current term is 6.
I20260709 13:05:08.235041 19551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f575b143b844aa096b50997dad3516a" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:05:08.235786 19407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28af091831594f9d8e96482078cc7625" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:05:08.227052 19402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a08760e15aac4630a629431f56024dc8" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
I20260709 13:05:08.246399 20112 raft_consensus.cc:2468] T 48824d5acfbc485ebf8c2d944e7202de P 127766fc592545a4997f7790f50f6076 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 3.
I20260709 13:05:08.260790 19449 leader_election.cc:304] T f93ee515a9c14139bf566522ed8232f3 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e; no voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:05:08.262432 19409 raft_consensus.cc:2468] T 46c5bfeecc314717bffe987e6844b6d0 P e5256d91808b47c195bc9b4dbd7f2b87 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 9.
I20260709 13:05:08.262820 19557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2725d2c4cb054f18b0fc8f735c15f6c2" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:05:08.264165 19555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86a6797bdfe94fa496c050ceae4bd0d9" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:05:08.266484 19557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a08760e15aac4630a629431f56024dc8" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:05:08.267370 19557 raft_consensus.cc:3060] T a08760e15aac4630a629431f56024dc8 P e61c3a8f61bb48f8a963c9480e53c168 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:05:08.230379 21088 leader_election.cc:290] T 46c5bfeecc314717bffe987e6844b6d0 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 9 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:05:08.273542 19559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0afb57ae58a24a01850491d69f0213dd" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:05:08.273218 21704 raft_consensus.cc:493] T e381f1d6b8184797ad142de49be225a8 P e61c3a8f61bb48f8a963c9480e53c168 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 0473d2b2d01f4459b1e90fd12cc7840e)
I20260709 13:05:08.278569 21704 raft_consensus.cc:515] T e381f1d6b8184797ad142de49be225a8 P e61c3a8f61bb48f8a963c9480e53c168 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:08.280936 21704 leader_election.cc:290] T e381f1d6b8184797ad142de49be225a8 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:05:08.281441 21444 raft_consensus.cc:493] T ff9b0eddd810459b82d91c60777c10eb P 0473d2b2d01f4459b1e90fd12cc7840e [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 127766fc592545a4997f7790f50f6076)
I20260709 13:05:08.282021 21444 raft_consensus.cc:515] T ff9b0eddd810459b82d91c60777c10eb P 0473d2b2d01f4459b1e90fd12cc7840e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:05:08.284184 21444 leader_election.cc:290] T ff9b0eddd810459b82d91c60777c10eb P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:05:08.285738 19523 leader_election.cc:304] T fa8650e71aa14778b3d73721fc50d9fc P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:05:08.291368 19557 raft_consensus.cc:2468] T a08760e15aac4630a629431f56024dc8 P e61c3a8f61bb48f8a963c9480e53c168 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 5.
I20260709 13:05:08.293819 19375 leader_election.cc:304] T a08760e15aac4630a629431f56024dc8 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:05:08.261989 21716 raft_consensus.cc:2749] T 0cdf56e38bbc453d9438d359e5a69955 P 0473d2b2d01f4459b1e90fd12cc7840e [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:05:08.266165 21638 consensus_queue.cc:1059] T 0cdf56e38bbc453d9438d359e5a69955 P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.039s
I20260709 13:05:08.305138 19449 leader_election.cc:304] T 1a61655d99124a29b486ba4a5b37faea P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87; no voters: e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:05:08.306516 19523 leader_election.cc:304] T 46c5bfeecc314717bffe987e6844b6d0 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:05:08.313863 21524 raft_consensus.cc:2804] T 46c5bfeecc314717bffe987e6844b6d0 P e61c3a8f61bb48f8a963c9480e53c168 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:05:08.314742 21524 raft_consensus.cc:697] T 46c5bfeecc314717bffe987e6844b6d0 P e61c3a8f61bb48f8a963c9480e53c168 [term 9 LEADER]: Becoming Leader. State: Replica: e61c3a8f61bb48f8a963c9480e53c168, State: Running, Role: LEADER
I20260709 13:05:08.295410 21584 raft_consensus.cc:493] T 1efebf73c86e432baa55533136b6e12c P 0473d2b2d01f4459b1e90fd12cc7840e [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 127766fc592545a4997f7790f50f6076)
I20260709 13:05:08.297634 21415 raft_consensus.cc:2804] T a08760e15aac4630a629431f56024dc8 P e5256d91808b47c195bc9b4dbd7f2b87 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:05:08.295217 21712 raft_consensus.cc:493] T 9962423cb4e54fcfa5de01daf68a86e7 P 0473d2b2d01f4459b1e90fd12cc7840e [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 127766fc592545a4997f7790f50f6076)
I20260709 13:05:08.346211 19402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "172b3dd13109415a955b71ac0e9d2234" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:05:08.331430 21684 raft_consensus.cc:493] T edd7d470b5014c9489be7f41f64355c9 P e61c3a8f61bb48f8a963c9480e53c168 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 0473d2b2d01f4459b1e90fd12cc7840e)
I20260709 13:05:08.351509 21684 raft_consensus.cc:515] T edd7d470b5014c9489be7f41f64355c9 P e61c3a8f61bb48f8a963c9480e53c168 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:08.353704 21684 leader_election.cc:290] T edd7d470b5014c9489be7f41f64355c9 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:05:08.342971 21415 raft_consensus.cc:697] T a08760e15aac4630a629431f56024dc8 P e5256d91808b47c195bc9b4dbd7f2b87 [term 5 LEADER]: Becoming Leader. State: Replica: e5256d91808b47c195bc9b4dbd7f2b87, State: Running, Role: LEADER
I20260709 13:05:08.315815 21524 consensus_queue.cc:237] T 46c5bfeecc314717bffe987e6844b6d0 P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 7.3, Last appended by leader: 3, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:08.338946 21712 raft_consensus.cc:515] T 9962423cb4e54fcfa5de01daf68a86e7 P 0473d2b2d01f4459b1e90fd12cc7840e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:05:08.360810 21712 leader_election.cc:290] T 9962423cb4e54fcfa5de01daf68a86e7 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:05:08.362109 21587 consensus_queue.cc:1048] T 4af19371ea874c09a0a2147040835cbb P 127766fc592545a4997f7790f50f6076 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:05:08.367257 21716 raft_consensus.cc:493] T 0e1085d23e8347fbbd5bce7542f4b1f4 P 0473d2b2d01f4459b1e90fd12cc7840e [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 127766fc592545a4997f7790f50f6076)
I20260709 13:05:08.367955 21716 raft_consensus.cc:515] T 0e1085d23e8347fbbd5bce7542f4b1f4 P 0473d2b2d01f4459b1e90fd12cc7840e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:05:08.332213 21721 raft_consensus.cc:493] T 5ec1c4ce15e04c7e8c283a62179f2a64 P 127766fc592545a4997f7790f50f6076 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:08.375429 21721 raft_consensus.cc:515] T 5ec1c4ce15e04c7e8c283a62179f2a64 P 127766fc592545a4997f7790f50f6076 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:05:08.378014 21721 leader_election.cc:290] T 5ec1c4ce15e04c7e8c283a62179f2a64 P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:05:08.323324 21718 raft_consensus.cc:2749] T f93ee515a9c14139bf566522ed8232f3 P 0473d2b2d01f4459b1e90fd12cc7840e [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:05:08.331743 21584 raft_consensus.cc:515] T 1efebf73c86e432baa55533136b6e12c P 0473d2b2d01f4459b1e90fd12cc7840e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:05:08.388751 21584 leader_election.cc:290] T 1efebf73c86e432baa55533136b6e12c P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:05:08.390022 21621 raft_consensus.cc:2804] T 1a61655d99124a29b486ba4a5b37faea P 0473d2b2d01f4459b1e90fd12cc7840e [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:05:08.390761 21621 raft_consensus.cc:697] T 1a61655d99124a29b486ba4a5b37faea P 0473d2b2d01f4459b1e90fd12cc7840e [term 3 LEADER]: Becoming Leader. State: Replica: 0473d2b2d01f4459b1e90fd12cc7840e, State: Running, Role: LEADER
I20260709 13:05:08.391213 19408 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52342 (request call id 1792) took 1131 ms. Trace:
I20260709 13:05:08.391752 19408 rpcz_store.cc:276] 0709 13:05:07.259691 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:07.261783 (+  2092us) service_pool.cc:224] Handling call
0709 13:05:08.390950 (+1129167us) spinlock_profiling.cc:243] Waited 959 ms on lock 0x7b5400183654. stack: 00007f4a79de9343 00007f4a79de9240 00007f4a797781d4 00007f4a834b6304 00007f4a834b6299 00007f4a7ce71571 00007f4a7cf0c2fa 00007f4a81ecdb17 00007f4a7b4486d4 00007f4a7b448662 00007f4a7b448591 00007f4a7b44850c 00007f4a7b4477c2 00007f4a7b24348c 00007f4a7b2428c6 00007f4a7b24226f
0709 13:05:08.391136 (+   186us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2204559232}
I20260709 13:05:08.363920 21415 consensus_queue.cc:237] T a08760e15aac4630a629431f56024dc8 P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:08.393010 21716 leader_election.cc:290] T 0e1085d23e8347fbbd5bce7542f4b1f4 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:05:08.338804 21644 raft_consensus.cc:493] T 4af19371ea874c09a0a2147040835cbb P e5256d91808b47c195bc9b4dbd7f2b87 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:08.394065 21644 raft_consensus.cc:515] T 4af19371ea874c09a0a2147040835cbb P e5256d91808b47c195bc9b4dbd7f2b87 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:05:08.396817 21644 leader_election.cc:290] T 4af19371ea874c09a0a2147040835cbb P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:05:08.397436 21644 raft_consensus.cc:493] T 76cb037fc9064d13b59a8969d897ce8c P e5256d91808b47c195bc9b4dbd7f2b87 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 0473d2b2d01f4459b1e90fd12cc7840e)
I20260709 13:05:08.401825 19557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4af19371ea874c09a0a2147040835cbb" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:05:08.403301 19523 leader_election.cc:304] T 309c3ca0ca4b4f3ba129752ea2cb293b P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: e61c3a8f61bb48f8a963c9480e53c168; no voters: 127766fc592545a4997f7790f50f6076, e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:05:08.404196 19523 leader_election.cc:304] T 48824d5acfbc485ebf8c2d944e7202de P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 127766fc592545a4997f7790f50f6076, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:05:08.405531 21684 raft_consensus.cc:2749] T 309c3ca0ca4b4f3ba129752ea2cb293b P e61c3a8f61bb48f8a963c9480e53c168 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:05:08.405578 20109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4af19371ea874c09a0a2147040835cbb" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:05:08.405961 21641 leader_election.cc:290] T 217b5fae677b4971b3bbd2f357a1f7ff P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:05:08.406247 21684 raft_consensus.cc:2804] T 48824d5acfbc485ebf8c2d944e7202de P e61c3a8f61bb48f8a963c9480e53c168 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:05:08.362444 20075 leader_election.cc:304] T ab43d85f64114d4ebf618930e43d9ed0 P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 127766fc592545a4997f7790f50f6076; no voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:05:08.407486 21720 raft_consensus.cc:493] T 21e14947d70440f19044d8f75c31e1f9 P e5256d91808b47c195bc9b4dbd7f2b87 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 0473d2b2d01f4459b1e90fd12cc7840e)
W20260709 13:05:08.407748 20075 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.1:40321, user_credentials={real_user=slave}} blocked reactor thread for 45388.4us
I20260709 13:05:08.408157 21720 raft_consensus.cc:515] T 21e14947d70440f19044d8f75c31e1f9 P e5256d91808b47c195bc9b4dbd7f2b87 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:08.412415 19558 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40438 (request call id 1540) took 1066 ms. Trace:
I20260709 13:05:08.412483 19374 leader_election.cc:304] T 4af19371ea874c09a0a2147040835cbb P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87; no voters: 127766fc592545a4997f7790f50f6076, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:05:08.391830 21621 consensus_queue.cc:237] T 1a61655d99124a29b486ba4a5b37faea P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:08.412914 19558 rpcz_store.cc:276] 0709 13:05:07.346358 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:07.346478 (+   120us) service_pool.cc:224] Handling call
0709 13:05:08.412212 (+1065734us) spinlock_profiling.cc:243] Waited 695 ms on lock 0x7b5400341a54. stack: 00007f4a79de9343 00007f4a79de9240 00007f4a797781d4 00007f4a834b6304 00007f4a834b6299 00007f4a7ce71571 00007f4a7cf0c2fa 00007f4a81ecdb17 00007f4a7b4486d4 00007f4a7b448662 00007f4a7b448591 00007f4a7b44850c 00007f4a7b4477c2 00007f4a7b24348c 00007f4a7b2428c6 00007f4a7b24226f
0709 13:05:08.412330 (+   118us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1597529344}
I20260709 13:05:08.414641 21358 raft_consensus.cc:493] T b08304a0a02b42d7840c4e8ee9a6bd1a P e5256d91808b47c195bc9b4dbd7f2b87 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 0473d2b2d01f4459b1e90fd12cc7840e)
I20260709 13:05:08.420624 19402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ec1c4ce15e04c7e8c283a62179f2a64" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:05:08.423151 19375 leader_election.cc:400] T 46c5bfeecc314717bffe987e6844b6d0 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 8 pre-election: Vote denied by peer e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891) with higher term. Message: Invalid argument: T 46c5bfeecc314717bffe987e6844b6d0 P e61c3a8f61bb48f8a963c9480e53c168 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e5256d91808b47c195bc9b4dbd7f2b87 for earlier term 8. Current term is 9.
I20260709 13:05:08.423590 19375 leader_election.cc:403] T 46c5bfeecc314717bffe987e6844b6d0 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 8 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:05:08.421489 19402 raft_consensus.cc:2468] T 5ec1c4ce15e04c7e8c283a62179f2a64 P e5256d91808b47c195bc9b4dbd7f2b87 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 127766fc592545a4997f7790f50f6076 in term 2.
I20260709 13:05:08.431107 20075 leader_election.cc:304] T 5ec1c4ce15e04c7e8c283a62179f2a64 P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 127766fc592545a4997f7790f50f6076, e5256d91808b47c195bc9b4dbd7f2b87; no voters: 
I20260709 13:05:08.397971 21644 raft_consensus.cc:515] T 76cb037fc9064d13b59a8969d897ce8c P e5256d91808b47c195bc9b4dbd7f2b87 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
W20260709 13:05:08.440536 19449 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.1:40321, user_credentials={real_user=slave}} blocked reactor thread for 133835us
I20260709 13:05:08.440750 21731 raft_consensus.cc:493] T 6c5eebf646ad445a9d1b1adc319d7b16 P 0473d2b2d01f4459b1e90fd12cc7840e [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 127766fc592545a4997f7790f50f6076)
I20260709 13:05:08.441332 19449 leader_election.cc:304] T 5ec1c4ce15e04c7e8c283a62179f2a64 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87; no voters: 
I20260709 13:05:08.441417 21731 raft_consensus.cc:515] T 6c5eebf646ad445a9d1b1adc319d7b16 P 0473d2b2d01f4459b1e90fd12cc7840e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:05:08.442551 21562 raft_consensus.cc:2804] T 5ec1c4ce15e04c7e8c283a62179f2a64 P 0473d2b2d01f4459b1e90fd12cc7840e [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:05:08.443182 21562 raft_consensus.cc:697] T 5ec1c4ce15e04c7e8c283a62179f2a64 P 0473d2b2d01f4459b1e90fd12cc7840e [term 2 LEADER]: Becoming Leader. State: Replica: 0473d2b2d01f4459b1e90fd12cc7840e, State: Running, Role: LEADER
I20260709 13:05:08.444319 21731 leader_election.cc:290] T 6c5eebf646ad445a9d1b1adc319d7b16 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:05:08.445802 19449 leader_election.cc:304] T a08760e15aac4630a629431f56024dc8 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e; no voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:05:08.447556 19449 leader_election.cc:304] T 14efcc79969f41babe5529c22d59156d P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e; no voters: 127766fc592545a4997f7790f50f6076, e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:05:08.389283 21523 raft_consensus.cc:3055] T 0cdf56e38bbc453d9438d359e5a69955 P e61c3a8f61bb48f8a963c9480e53c168 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:05:08.426357 21535 raft_consensus.cc:2749] T 4af19371ea874c09a0a2147040835cbb P e5256d91808b47c195bc9b4dbd7f2b87 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:05:08.415323 21358 raft_consensus.cc:515] T b08304a0a02b42d7840c4e8ee9a6bd1a P e5256d91808b47c195bc9b4dbd7f2b87 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:08.459926 19554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21e14947d70440f19044d8f75c31e1f9" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:05:08.433058 21720 leader_election.cc:290] T 21e14947d70440f19044d8f75c31e1f9 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:05:08.445240 21721 raft_consensus.cc:2804] T 5ec1c4ce15e04c7e8c283a62179f2a64 P 127766fc592545a4997f7790f50f6076 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:05:08.435889 21684 raft_consensus.cc:697] T 48824d5acfbc485ebf8c2d944e7202de P e61c3a8f61bb48f8a963c9480e53c168 [term 3 LEADER]: Becoming Leader. State: Replica: e61c3a8f61bb48f8a963c9480e53c168, State: Running, Role: LEADER
I20260709 13:05:08.477059 19481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa8650e71aa14778b3d73721fc50d9fc" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:05:08.435463 21715 raft_consensus.cc:493] T 7be9efa6559648dbb5a0f7684c4542d1 P e5256d91808b47c195bc9b4dbd7f2b87 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 0473d2b2d01f4459b1e90fd12cc7840e)
I20260709 13:05:08.493084 19477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff75a1d4cb1f493db8f71ddc136ba9ab" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:05:08.456959 21525 raft_consensus.cc:3060] T a08760e15aac4630a629431f56024dc8 P 0473d2b2d01f4459b1e90fd12cc7840e [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:05:08.485984 19485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2725d2c4cb054f18b0fc8f735c15f6c2" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
W20260709 13:05:08.500425 19449 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.4:43121, user_credentials={real_user=slave}} blocked reactor thread for 52959.3us
I20260709 13:05:08.490038 19484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a08760e15aac4630a629431f56024dc8" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:05:08.490350 19482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86a6797bdfe94fa496c050ceae4bd0d9" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:05:08.491765 19478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21e14947d70440f19044d8f75c31e1f9" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:05:08.503480 19485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab43d85f64114d4ebf618930e43d9ed0" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:05:08.505501 19485 raft_consensus.cc:2468] T ab43d85f64114d4ebf618930e43d9ed0 P 0473d2b2d01f4459b1e90fd12cc7840e [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 127766fc592545a4997f7790f50f6076 in term 5.
I20260709 13:05:08.456374 21411 raft_consensus.cc:2749] T 46c5bfeecc314717bffe987e6844b6d0 P e5256d91808b47c195bc9b4dbd7f2b87 [term 9 FOLLOWER]: Leader pre-election lost for term 8. Reason: Vote denied by peer e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891) with higher term. Message: Invalid argument: T 46c5bfeecc314717bffe987e6844b6d0 P e61c3a8f61bb48f8a963c9480e53c168 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e5256d91808b47c195bc9b4dbd7f2b87 for earlier term 8. Current term is 9.
I20260709 13:05:08.494361 19480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9962423cb4e54fcfa5de01daf68a86e7" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:05:08.498472 19486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cdf56e38bbc453d9438d359e5a69955" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:05:08.507030 19480 raft_consensus.cc:2410] T 9962423cb4e54fcfa5de01daf68a86e7 P 0473d2b2d01f4459b1e90fd12cc7840e [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e5256d91808b47c195bc9b4dbd7f2b87 for term 9 because replica has last-logged OpId of term: 8 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 6.
I20260709 13:05:08.473953 21704 raft_consensus.cc:2804] T fa8650e71aa14778b3d73721fc50d9fc P e61c3a8f61bb48f8a963c9480e53c168 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:05:08.469507 21523 raft_consensus.cc:740] T 0cdf56e38bbc453d9438d359e5a69955 P e61c3a8f61bb48f8a963c9480e53c168 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: e61c3a8f61bb48f8a963c9480e53c168, State: Running, Role: LEADER
I20260709 13:05:08.511053 19485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed7fdbcb96d14d418db9ca90a792588a" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:05:08.477164 21731 raft_consensus.cc:493] T 1dc5b3532fe54f74876d02beffa2c230 P 0473d2b2d01f4459b1e90fd12cc7840e [term 3 FOLLOWER]: Starting pre-election (detected failure of leader e5256d91808b47c195bc9b4dbd7f2b87)
I20260709 13:05:08.518998 19402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef32ce6fdd0e40d382c79974f30295c6" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:05:08.520013 19406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22196caba61445d3bec98a0aab3c337d" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:05:08.520138 19407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36f6ba92b9ba46babe4ebd6c02e5fbd9" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:05:08.521780 19404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f575b143b844aa096b50997dad3516a" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:05:08.522775 19405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46c5bfeecc314717bffe987e6844b6d0" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 9 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
I20260709 13:05:08.488217 21721 raft_consensus.cc:493] T 5ec1c4ce15e04c7e8c283a62179f2a64 P 127766fc592545a4997f7790f50f6076 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:08.525576 19402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff9b0eddd810459b82d91c60777c10eb" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:05:08.444370 21562 consensus_queue.cc:237] T 5ec1c4ce15e04c7e8c283a62179f2a64 P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:05:08.497824 21638 raft_consensus.cc:493] T 76cb037fc9064d13b59a8969d897ce8c P e61c3a8f61bb48f8a963c9480e53c168 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 0473d2b2d01f4459b1e90fd12cc7840e)
I20260709 13:05:08.539593 19405 raft_consensus.cc:2393] T 46c5bfeecc314717bffe987e6844b6d0 P e5256d91808b47c195bc9b4dbd7f2b87 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 0473d2b2d01f4459b1e90fd12cc7840e in current term 9: Already voted for candidate e61c3a8f61bb48f8a963c9480e53c168 in this term.
I20260709 13:05:08.511885 21624 raft_consensus.cc:2749] T ab43d85f64114d4ebf618930e43d9ed0 P 127766fc592545a4997f7790f50f6076 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:05:08.532446 19406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9962423cb4e54fcfa5de01daf68a86e7" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:05:08.534970 19407 raft_consensus.cc:1275] T d1e5873a19244c5ebbcd38e126796ee7 P e5256d91808b47c195bc9b4dbd7f2b87 [term 6 FOLLOWER]: Refusing update from remote peer 0473d2b2d01f4459b1e90fd12cc7840e: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:05:08.510691 21584 raft_consensus.cc:2749] T 14efcc79969f41babe5529c22d59156d P 0473d2b2d01f4459b1e90fd12cc7840e [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:05:08.546770 19482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a61655d99124a29b486ba4a5b37faea" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:05:08.547729 19486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa8650e71aa14778b3d73721fc50d9fc" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:05:08.549048 19482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "309c3ca0ca4b4f3ba129752ea2cb293b" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:05:08.522660 21415 raft_consensus.cc:493] T 172b3dd13109415a955b71ac0e9d2234 P e5256d91808b47c195bc9b4dbd7f2b87 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0473d2b2d01f4459b1e90fd12cc7840e)
I20260709 13:05:08.589514 20112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1efebf73c86e432baa55533136b6e12c" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:05:08.551959 20105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0afb57ae58a24a01850491d69f0213dd" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:05:08.552268 19486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "217b5fae677b4971b3bbd2f357a1f7ff" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:05:08.597329 19485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1b10566f45d4a7d9029858330e02d5b" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:05:08.597558 21415 raft_consensus.cc:515] T 172b3dd13109415a955b71ac0e9d2234 P e5256d91808b47c195bc9b4dbd7f2b87 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:05:08.530341 21721 raft_consensus.cc:3060] T 5ec1c4ce15e04c7e8c283a62179f2a64 P 127766fc592545a4997f7790f50f6076 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:08.608983 19482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9f0d59553ad444883fcf5b5909f9798" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:05:08.600298 19477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "172b3dd13109415a955b71ac0e9d2234" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:05:08.598513 19486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a08760e15aac4630a629431f56024dc8" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:05:08.603521 19485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46c5bfeecc314717bffe987e6844b6d0" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 9 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:05:08.614972 19482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e381f1d6b8184797ad142de49be225a8" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:05:08.548768 21729 raft_consensus.cc:493] T 3e1f505cb0f1427bbd698ac889d80821 P 0473d2b2d01f4459b1e90fd12cc7840e [term 4 FOLLOWER]: Starting pre-election (detected failure of leader e61c3a8f61bb48f8a963c9480e53c168)
I20260709 13:05:08.618077 19485 raft_consensus.cc:2393] T 46c5bfeecc314717bffe987e6844b6d0 P 0473d2b2d01f4459b1e90fd12cc7840e [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate e61c3a8f61bb48f8a963c9480e53c168 in current term 9: Already voted for candidate 0473d2b2d01f4459b1e90fd12cc7840e in this term.
I20260709 13:05:08.619282 19486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edd7d470b5014c9489be7f41f64355c9" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:05:08.526283 21731 raft_consensus.cc:515] T 1dc5b3532fe54f74876d02beffa2c230 P 0473d2b2d01f4459b1e90fd12cc7840e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:08.626775 19482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48824d5acfbc485ebf8c2d944e7202de" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:05:08.633761 20111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c5eebf646ad445a9d1b1adc319d7b16" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:05:08.633991 21358 leader_election.cc:290] T b08304a0a02b42d7840c4e8ee9a6bd1a P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:05:08.634991 20108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e1085d23e8347fbbd5bce7542f4b1f4" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:05:08.627586 20078 leader_election.cc:304] T ed7fdbcb96d14d418db9ca90a792588a P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 127766fc592545a4997f7790f50f6076; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:05:08.628525 21703 raft_consensus.cc:493] T bc225c93219c45538b53a1bd3d387e4d P e61c3a8f61bb48f8a963c9480e53c168 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:08.639678 19485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dc5b3532fe54f74876d02beffa2c230" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:05:08.630154 19486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ec1c4ce15e04c7e8c283a62179f2a64" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:05:08.510254 21715 raft_consensus.cc:515] T 7be9efa6559648dbb5a0f7684c4542d1 P e5256d91808b47c195bc9b4dbd7f2b87 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:08.639375 19482 raft_consensus.cc:2393] T 48824d5acfbc485ebf8c2d944e7202de P 0473d2b2d01f4459b1e90fd12cc7840e [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate e61c3a8f61bb48f8a963c9480e53c168 in current term 3: Already voted for candidate 0473d2b2d01f4459b1e90fd12cc7840e in this term.
I20260709 13:05:08.543463 20107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36f6ba92b9ba46babe4ebd6c02e5fbd9" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:05:08.626159 19450 leader_election.cc:304] T ef32ce6fdd0e40d382c79974f30295c6 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e; no voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:05:08.552655 21621 raft_consensus.cc:493] T 96efeaaf1057492490e9a621f37e1a2d P 0473d2b2d01f4459b1e90fd12cc7840e [term 4 FOLLOWER]: Starting pre-election (detected failure of leader e61c3a8f61bb48f8a963c9480e53c168)
I20260709 13:05:08.615974 20104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9962423cb4e54fcfa5de01daf68a86e7" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:05:08.659312 19485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1efebf73c86e432baa55533136b6e12c" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:05:08.651659 19482 raft_consensus.cc:2955] T ab43d85f64114d4ebf618930e43d9ed0 P 0473d2b2d01f4459b1e90fd12cc7840e [term 5 FOLLOWER]: Committing config change with OpId 5.5: config changed from index 2 to 5, 127766fc592545a4997f7790f50f6076 (127.17.223.4) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } attrs { replace: true } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } } }
W20260709 13:05:08.670068 19450 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.3:36891, user_credentials={real_user=slave}} blocked reactor thread for 44009.6us
I20260709 13:05:08.543980 21638 raft_consensus.cc:515] T 76cb037fc9064d13b59a8969d897ce8c P e61c3a8f61bb48f8a963c9480e53c168 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:08.652616 21603 raft_consensus.cc:2749] T ed7fdbcb96d14d418db9ca90a792588a P 127766fc592545a4997f7790f50f6076 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:05:08.652278 21614 leader_election.cc:290] T 48824d5acfbc485ebf8c2d944e7202de P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 3 election: Requested vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:05:08.683141 19450 leader_election.cc:304] T 22196caba61445d3bec98a0aab3c337d P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e; no voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:05:08.638355 21729 raft_consensus.cc:515] T 3e1f505cb0f1427bbd698ac889d80821 P 0473d2b2d01f4459b1e90fd12cc7840e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:08.686079 19403 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52342 (request call id 1793) took 1426 ms. Trace:
I20260709 13:05:08.692577 19559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c5eebf646ad445a9d1b1adc319d7b16" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:05:08.697974 19557 raft_consensus.cc:1275] T d1e5873a19244c5ebbcd38e126796ee7 P e61c3a8f61bb48f8a963c9480e53c168 [term 6 FOLLOWER]: Refusing update from remote peer 0473d2b2d01f4459b1e90fd12cc7840e: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:05:08.649968 21716 consensus_queue.cc:1048] T d1e5873a19244c5ebbcd38e126796ee7 P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.032s
I20260709 13:05:08.676141 21728 raft_consensus.cc:2749] T ef32ce6fdd0e40d382c79974f30295c6 P 0473d2b2d01f4459b1e90fd12cc7840e [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:05:08.709379 19526 leader_election.cc:304] T 1a61655d99124a29b486ba4a5b37faea P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e61c3a8f61bb48f8a963c9480e53c168; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:05:08.688149 19403 rpcz_store.cc:276] 0709 13:05:07.260022 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:07.260157 (+   135us) service_pool.cc:224] Handling call
0709 13:05:08.685935 (+1425778us) spinlock_profiling.cc:243] Waited 1.18 s on lock 0x7b54000b31d4. stack: 00007f4a79de9343 00007f4a79de9240 00007f4a797781d4 00007f4a834b6304 00007f4a834b6299 00007f4a7ce71571 00007f4a7cf0c2fa 00007f4a81ecdb17 00007f4a7b4486d4 00007f4a7b448662 00007f4a7b448591 00007f4a7b44850c 00007f4a7b4477c2 00007f4a7b24348c 00007f4a7b2428c6 00007f4a7b24226f
0709 13:05:08.686034 (+    99us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2710109568}
I20260709 13:05:08.614795 21523 consensus_queue.cc:260] T 0cdf56e38bbc453d9438d359e5a69955 P e61c3a8f61bb48f8a963c9480e53c168 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:08.713306 19552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1efebf73c86e432baa55533136b6e12c" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:05:08.713575 19554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46c5bfeecc314717bffe987e6844b6d0" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 9 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:05:08.713997 19560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e1085d23e8347fbbd5bce7542f4b1f4" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:05:08.720274 20109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff9b0eddd810459b82d91c60777c10eb" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:05:08.686602 21699 raft_consensus.cc:2749] T 22196caba61445d3bec98a0aab3c337d P 0473d2b2d01f4459b1e90fd12cc7840e [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:05:08.685009 21644 leader_election.cc:290] T 76cb037fc9064d13b59a8969d897ce8c P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:05:08.660883 21703 raft_consensus.cc:515] T bc225c93219c45538b53a1bd3d387e4d P e61c3a8f61bb48f8a963c9480e53c168 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:08.669365 21621 raft_consensus.cc:515] T 96efeaaf1057492490e9a621f37e1a2d P 0473d2b2d01f4459b1e90fd12cc7840e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:05:08.651216 21684 consensus_queue.cc:237] T 48824d5acfbc485ebf8c2d944e7202de P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
W20260709 13:05:08.743330 19450 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.3:36891, user_credentials={real_user=slave}} blocked reactor thread for 45897.4us
I20260709 13:05:08.744098 19450 leader_election.cc:304] T 7f575b143b844aa096b50997dad3516a P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e; no voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168
W20260709 13:05:08.748868 21726 log.cc:927] Time spent T fa8650e71aa14778b3d73721fc50d9fc P e61c3a8f61bb48f8a963c9480e53c168: Append to log took a long time: real 0.148s	user 0.001s	sys 0.000s
I20260709 13:05:08.749882 21415 leader_election.cc:290] T 172b3dd13109415a955b71ac0e9d2234 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:05:08.751797 21621 leader_election.cc:290] T 96efeaaf1057492490e9a621f37e1a2d P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:05:08.753386 21742 raft_consensus.cc:493] T 179fd671030940b4b4a4e24bcc4aba0a P e61c3a8f61bb48f8a963c9480e53c168 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 0473d2b2d01f4459b1e90fd12cc7840e)
I20260709 13:05:08.753953 21742 raft_consensus.cc:515] T 179fd671030940b4b4a4e24bcc4aba0a P e61c3a8f61bb48f8a963c9480e53c168 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:08.756101 21742 leader_election.cc:290] T 179fd671030940b4b4a4e24bcc4aba0a P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
W20260709 13:05:08.757544 21734 log.cc:927] Time spent T 9962423cb4e54fcfa5de01daf68a86e7 P e5256d91808b47c195bc9b4dbd7f2b87: Append to log took a long time: real 0.108s	user 0.001s	sys 0.000s
W20260709 13:05:08.748854 21745 log.cc:927] Time spent T 4af19371ea874c09a0a2147040835cbb P e5256d91808b47c195bc9b4dbd7f2b87: Append to log took a long time: real 0.051s	user 0.001s	sys 0.000s
I20260709 13:05:08.771721 21539 leader_election.cc:290] T 28af091831594f9d8e96482078cc7625 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:05:08.772707 19526 leader_election.cc:304] T 217b5fae677b4971b3bbd2f357a1f7ff P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e61c3a8f61bb48f8a963c9480e53c168; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:05:08.773910 19526 leader_election.cc:304] T f1b10566f45d4a7d9029858330e02d5b P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e61c3a8f61bb48f8a963c9480e53c168; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:05:08.775245 19526 leader_election.cc:304] T a08760e15aac4630a629431f56024dc8 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e61c3a8f61bb48f8a963c9480e53c168; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:05:08.776556 19526 leader_election.cc:304] T b9f0d59553ad444883fcf5b5909f9798 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e61c3a8f61bb48f8a963c9480e53c168; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:05:08.784581 19449 leader_election.cc:304] T 0afb57ae58a24a01850491d69f0213dd P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e; no voters: 127766fc592545a4997f7790f50f6076, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:05:08.786415 19526 leader_election.cc:304] T 1dc5b3532fe54f74876d02beffa2c230 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e61c3a8f61bb48f8a963c9480e53c168; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87
W20260709 13:05:08.796263 21739 log.cc:927] Time spent T f1b10566f45d4a7d9029858330e02d5b P e61c3a8f61bb48f8a963c9480e53c168: Append to log took a long time: real 0.125s	user 0.000s	sys 0.001s
I20260709 13:05:08.775715 21444 raft_consensus.cc:2749] T 7f575b143b844aa096b50997dad3516a P 0473d2b2d01f4459b1e90fd12cc7840e [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:05:08.795110 19554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96efeaaf1057492490e9a621f37e1a2d" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:05:08.787501 21634 raft_consensus.cc:2749] T f1b10566f45d4a7d9029858330e02d5b P e61c3a8f61bb48f8a963c9480e53c168 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 13:05:08.800880 21738 log.cc:927] Time spent T 1a61655d99124a29b486ba4a5b37faea P 0473d2b2d01f4459b1e90fd12cc7840e: Append to log took a long time: real 0.201s	user 0.001s	sys 0.000s
I20260709 13:05:08.791287 21707 raft_consensus.cc:2749] T b9f0d59553ad444883fcf5b5909f9798 P e61c3a8f61bb48f8a963c9480e53c168 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:05:08.787875 21539 raft_consensus.cc:2749] T a08760e15aac4630a629431f56024dc8 P e61c3a8f61bb48f8a963c9480e53c168 [term 5 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:05:08.806185 21638 leader_election.cc:290] T 76cb037fc9064d13b59a8969d897ce8c P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:05:08.783625 21529 raft_consensus.cc:2749] T 217b5fae677b4971b3bbd2f357a1f7ff P e61c3a8f61bb48f8a963c9480e53c168 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:05:08.776068 21743 raft_consensus.cc:2749] T 1a61655d99124a29b486ba4a5b37faea P e61c3a8f61bb48f8a963c9480e53c168 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
W20260709 13:05:08.807317 21732 log.cc:927] Time spent T 4af19371ea874c09a0a2147040835cbb P e61c3a8f61bb48f8a963c9480e53c168: Append to log took a long time: real 0.265s	user 0.001s	sys 0.000s
I20260709 13:05:08.814913 19450 leader_election.cc:304] T 1efebf73c86e432baa55533136b6e12c P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e; no voters: 127766fc592545a4997f7790f50f6076, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:05:08.791577 21747 raft_consensus.cc:2749] T 1dc5b3532fe54f74876d02beffa2c230 P e61c3a8f61bb48f8a963c9480e53c168 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:05:08.792258 21525 raft_consensus.cc:2749] T a08760e15aac4630a629431f56024dc8 P 0473d2b2d01f4459b1e90fd12cc7840e [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:05:08.815114 21728 consensus_queue.cc:1048] T d1e5873a19244c5ebbcd38e126796ee7 P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:05:08.822017 21713 raft_consensus.cc:2749] T 1efebf73c86e432baa55533136b6e12c P 0473d2b2d01f4459b1e90fd12cc7840e [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:05:08.822751 21703 leader_election.cc:290] T bc225c93219c45538b53a1bd3d387e4d P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:05:08.819432 19482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "179fd671030940b4b4a4e24bcc4aba0a" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:05:08.824151 21729 leader_election.cc:290] T 3e1f505cb0f1427bbd698ac889d80821 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:05:08.824977 21715 leader_election.cc:290] T 7be9efa6559648dbb5a0f7684c4542d1 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:05:08.834065 21615 leader_election.cc:290] T 1efebf73c86e432baa55533136b6e12c P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:05:08.834530 21603 raft_consensus.cc:493] T 775c229504194560ba9589bc2199b089 P 127766fc592545a4997f7790f50f6076 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 0473d2b2d01f4459b1e90fd12cc7840e)
I20260709 13:05:08.841513 21603 raft_consensus.cc:515] T 775c229504194560ba9589bc2199b089 P 127766fc592545a4997f7790f50f6076 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:05:08.843509 21603 leader_election.cc:290] T 775c229504194560ba9589bc2199b089 P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
W20260709 13:05:08.844542 19524 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:08.845667 19484 raft_consensus.cc:2468] T a08760e15aac4630a629431f56024dc8 P 0473d2b2d01f4459b1e90fd12cc7840e [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 5.
I20260709 13:05:08.847446 19480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76cb037fc9064d13b59a8969d897ce8c" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
W20260709 13:05:08.836004 20078 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.2:46257, user_credentials={real_user=slave}} blocked reactor thread for 193536us
I20260709 13:05:08.840196 19482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28af091831594f9d8e96482078cc7625" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:05:08.830201 19554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e1f505cb0f1427bbd698ac889d80821" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:05:08.848845 19478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc225c93219c45538b53a1bd3d387e4d" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:05:08.806969 21753 raft_consensus.cc:2749] T 0afb57ae58a24a01850491d69f0213dd P 0473d2b2d01f4459b1e90fd12cc7840e [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:05:08.857111 20078 leader_election.cc:304] T 172b3dd13109415a955b71ac0e9d2234 P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 127766fc592545a4997f7790f50f6076; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:05:08.847931 20107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1efebf73c86e432baa55533136b6e12c" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:05:08.860965 19526 leader_election.cc:304] T 28af091831594f9d8e96482078cc7625 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e61c3a8f61bb48f8a963c9480e53c168; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:05:08.862983 21553 raft_consensus.cc:2749] T 172b3dd13109415a955b71ac0e9d2234 P 127766fc592545a4997f7790f50f6076 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:05:08.854472 21622 raft_consensus.cc:493] T 62c6c134d3d24a1ab144dd9ee6bc3f64 P 0473d2b2d01f4459b1e90fd12cc7840e [term 6 FOLLOWER]: Starting pre-election (detected failure of leader e61c3a8f61bb48f8a963c9480e53c168)
I20260709 13:05:08.871990 21622 raft_consensus.cc:515] T 62c6c134d3d24a1ab144dd9ee6bc3f64 P 0473d2b2d01f4459b1e90fd12cc7840e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:05:08.873260 19449 leader_election.cc:304] T 6c5eebf646ad445a9d1b1adc319d7b16 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e; no voters: 127766fc592545a4997f7790f50f6076, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:05:08.874970 19449 leader_election.cc:304] T 0e1085d23e8347fbbd5bce7542f4b1f4 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e; no voters: 127766fc592545a4997f7790f50f6076, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:05:08.876396 20109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96efeaaf1057492490e9a621f37e1a2d" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:05:08.877899 21525 raft_consensus.cc:2749] T 0e1085d23e8347fbbd5bce7542f4b1f4 P 0473d2b2d01f4459b1e90fd12cc7840e [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:05:08.878113 19449 leader_election.cc:304] T ff9b0eddd810459b82d91c60777c10eb P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e; no voters: 127766fc592545a4997f7790f50f6076, e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:05:08.879000 21525 raft_consensus.cc:2749] T ff9b0eddd810459b82d91c60777c10eb P 0473d2b2d01f4459b1e90fd12cc7840e [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:05:08.876101 21753 raft_consensus.cc:2749] T 6c5eebf646ad445a9d1b1adc319d7b16 P 0473d2b2d01f4459b1e90fd12cc7840e [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:05:08.880146 19523 leader_election.cc:304] T 1efebf73c86e432baa55533136b6e12c P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e61c3a8f61bb48f8a963c9480e53c168; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, 127766fc592545a4997f7790f50f6076
I20260709 13:05:08.878545 19481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "775c229504194560ba9589bc2199b089" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:05:08.883220 19449 leader_election.cc:304] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e; no voters: 127766fc592545a4997f7790f50f6076, e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:05:08.883901 21525 raft_consensus.cc:2749] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P 0473d2b2d01f4459b1e90fd12cc7840e [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:05:08.885001 19449 leader_election.cc:304] T 96efeaaf1057492490e9a621f37e1a2d P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e; no voters: 127766fc592545a4997f7790f50f6076, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:05:08.885782 19450 leader_election.cc:304] T 48824d5acfbc485ebf8c2d944e7202de P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168; no voters: 127766fc592545a4997f7790f50f6076
I20260709 13:05:08.895601 21622 leader_election.cc:290] T 62c6c134d3d24a1ab144dd9ee6bc3f64 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:05:08.885793 21525 raft_consensus.cc:2749] T 96efeaaf1057492490e9a621f37e1a2d P 0473d2b2d01f4459b1e90fd12cc7840e [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:05:08.899405 20107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62c6c134d3d24a1ab144dd9ee6bc3f64" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:05:08.899538 19480 raft_consensus.cc:1275] T 46c5bfeecc314717bffe987e6844b6d0 P 0473d2b2d01f4459b1e90fd12cc7840e [term 9 FOLLOWER]: Refusing update from remote peer e61c3a8f61bb48f8a963c9480e53c168: Log matching property violated. Preceding OpId in replica: term: 7 index: 3. Preceding OpId from leader: term: 9 index: 4. (index mismatch)
I20260709 13:05:08.900892 21638 consensus_queue.cc:1048] T 46c5bfeecc314717bffe987e6844b6d0 P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:05:08.889545 21529 raft_consensus.cc:2749] T 28af091831594f9d8e96482078cc7625 P e61c3a8f61bb48f8a963c9480e53c168 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:05:08.889766 21729 raft_consensus.cc:2804] T 48824d5acfbc485ebf8c2d944e7202de P 0473d2b2d01f4459b1e90fd12cc7840e [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:05:08.907236 21729 raft_consensus.cc:493] T 48824d5acfbc485ebf8c2d944e7202de P 0473d2b2d01f4459b1e90fd12cc7840e [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:08.907678 21729 raft_consensus.cc:3060] T 48824d5acfbc485ebf8c2d944e7202de P 0473d2b2d01f4459b1e90fd12cc7840e [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:05:08.891903 21465 raft_consensus.cc:2749] T 1efebf73c86e432baa55533136b6e12c P e61c3a8f61bb48f8a963c9480e53c168 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:05:08.892571 21721 raft_consensus.cc:515] T 5ec1c4ce15e04c7e8c283a62179f2a64 P 127766fc592545a4997f7790f50f6076 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:05:08.913900 21721 leader_election.cc:290] T 5ec1c4ce15e04c7e8c283a62179f2a64 P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 3 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:05:08.914569 21729 raft_consensus.cc:515] T 48824d5acfbc485ebf8c2d944e7202de P 0473d2b2d01f4459b1e90fd12cc7840e [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:05:08.916381 19478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ec1c4ce15e04c7e8c283a62179f2a64" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:05:08.916642 21729 leader_election.cc:290] T 48824d5acfbc485ebf8c2d944e7202de P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 4 election: Requested vote from peers e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:05:08.919924 20107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48824d5acfbc485ebf8c2d944e7202de" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076"
I20260709 13:05:08.920691 20107 raft_consensus.cc:3060] T 48824d5acfbc485ebf8c2d944e7202de P 127766fc592545a4997f7790f50f6076 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:05:08.929391 21529 raft_consensus.cc:493] T 85c494af21f9457a85da47b9bc70c1fd P e61c3a8f61bb48f8a963c9480e53c168 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e5256d91808b47c195bc9b4dbd7f2b87)
I20260709 13:05:08.930006 21529 raft_consensus.cc:515] T 85c494af21f9457a85da47b9bc70c1fd P e61c3a8f61bb48f8a963c9480e53c168 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:05:08.932144 21529 leader_election.cc:290] T 85c494af21f9457a85da47b9bc70c1fd P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:05:08.934298 20112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85c494af21f9457a85da47b9bc70c1fd" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
W20260709 13:05:08.939250 21758 log.cc:927] Time spent T 48824d5acfbc485ebf8c2d944e7202de P e61c3a8f61bb48f8a963c9480e53c168: Append to log took a long time: real 0.066s	user 0.000s	sys 0.000s
I20260709 13:05:08.942951 20107 raft_consensus.cc:2468] T 48824d5acfbc485ebf8c2d944e7202de P 127766fc592545a4997f7790f50f6076 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 4.
I20260709 13:05:08.944052 19449 leader_election.cc:304] T 48824d5acfbc485ebf8c2d944e7202de P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, 127766fc592545a4997f7790f50f6076; no voters: 
I20260709 13:05:08.944921 21733 raft_consensus.cc:2804] T 48824d5acfbc485ebf8c2d944e7202de P 0473d2b2d01f4459b1e90fd12cc7840e [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:05:08.945453 21733 raft_consensus.cc:697] T 48824d5acfbc485ebf8c2d944e7202de P 0473d2b2d01f4459b1e90fd12cc7840e [term 4 LEADER]: Becoming Leader. State: Replica: 0473d2b2d01f4459b1e90fd12cc7840e, State: Running, Role: LEADER
I20260709 13:05:08.946368 21733 consensus_queue.cc:237] T 48824d5acfbc485ebf8c2d944e7202de P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:05:08.956274 19306 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:44688 (request call id 223) took 10852 ms. Trace:
I20260709 13:05:07.658885 18300 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:05:08.988323 19478 raft_consensus.cc:1275] T 14935b3ddf914369822e4a0547aaa355 P 0473d2b2d01f4459b1e90fd12cc7840e [term 4 FOLLOWER]: Refusing update from remote peer e5256d91808b47c195bc9b4dbd7f2b87: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
I20260709 13:05:08.988463 19477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b08304a0a02b42d7840c4e8ee9a6bd1a" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:05:08.989732 19483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "172b3dd13109415a955b71ac0e9d2234" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:05:08.990823 19486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7be9efa6559648dbb5a0f7684c4542d1" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:05:08.993057 21554 raft_consensus.cc:493] T df751f992649444090e27965eb1af85d P e5256d91808b47c195bc9b4dbd7f2b87 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader e61c3a8f61bb48f8a963c9480e53c168)
I20260709 13:05:08.993798 21636 raft_consensus.cc:493] T edd7d470b5014c9489be7f41f64355c9 P e5256d91808b47c195bc9b4dbd7f2b87 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 0473d2b2d01f4459b1e90fd12cc7840e)
I20260709 13:05:08.994282 21636 raft_consensus.cc:515] T edd7d470b5014c9489be7f41f64355c9 P e5256d91808b47c195bc9b4dbd7f2b87 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:08.995887 21701 raft_consensus.cc:493] T b9f0d59553ad444883fcf5b5909f9798 P e5256d91808b47c195bc9b4dbd7f2b87 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 0473d2b2d01f4459b1e90fd12cc7840e)
I20260709 13:05:08.996285 21636 leader_election.cc:290] T edd7d470b5014c9489be7f41f64355c9 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:05:08.996385 21701 raft_consensus.cc:515] T b9f0d59553ad444883fcf5b5909f9798 P e5256d91808b47c195bc9b4dbd7f2b87 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:09.001904 19552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b08304a0a02b42d7840c4e8ee9a6bd1a" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:05:09.002173 19556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7be9efa6559648dbb5a0f7684c4542d1" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:05:08.993553 21554 raft_consensus.cc:515] T df751f992649444090e27965eb1af85d P e5256d91808b47c195bc9b4dbd7f2b87 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:09.007531 21523 raft_consensus.cc:3060] T 0cdf56e38bbc453d9438d359e5a69955 P e61c3a8f61bb48f8a963c9480e53c168 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:05:09.008846 21554 leader_election.cc:290] T df751f992649444090e27965eb1af85d P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:05:09.014117 19553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76cb037fc9064d13b59a8969d897ce8c" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:05:09.014886 19553 raft_consensus.cc:2468] T 76cb037fc9064d13b59a8969d897ce8c P e61c3a8f61bb48f8a963c9480e53c168 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 5.
I20260709 13:05:08.998497 21701 leader_election.cc:290] T b9f0d59553ad444883fcf5b5909f9798 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:05:09.016332 19449 leader_election.cc:304] T 46c5bfeecc314717bffe987e6844b6d0 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e; no voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:05:09.017376 19554 raft_consensus.cc:1275] T 40e1e16737a842ee936002830f36882e P e61c3a8f61bb48f8a963c9480e53c168 [term 6 FOLLOWER]: Refusing update from remote peer e5256d91808b47c195bc9b4dbd7f2b87: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:05:09.018467 19479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76cb037fc9064d13b59a8969d897ce8c" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:05:08.956787 19306 rpcz_store.cc:276] 0709 13:04:58.103660 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:58.103809 (+   149us) service_pool.cc:224] Handling call
0709 13:05:08.956198 (+10852389us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:05:04.229348 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:05:04.230032 (+   684us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:05:04.230068 (+    36us) write_op.cc:435] Acquired schema lock
0709 13:05:04.230088 (+    20us) tablet.cc:662] Decoding operations
0709 13:05:04.231369 (+  1281us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:05:04.231451 (+    82us) write_op.cc:641] Partition lock acquired for write op
0709 13:05:04.231480 (+    29us) tablet.cc:685] Acquiring locks for 11 operations
0709 13:05:04.232570 (+  1090us) tablet.cc:701] Row locks acquired
0709 13:05:04.232603 (+    33us) write_op.cc:260] PREPARE: finished
0709 13:05:04.232750 (+   147us) write_op.cc:270] Start()
0709 13:05:04.232860 (+   110us) write_op.cc:276] Timestamp: P: 1783602304232701 usec, L: 0
0709 13:05:04.232884 (+    24us) op_driver.cc:348] REPLICATION: starting
0709 13:05:04.233600 (+   716us) log.cc:844] Serialized 4446 byte log entry
0709 13:05:04.512450 (+278850us) op_driver.cc:464] REPLICATION: finished
0709 13:05:05.188114 (+675664us) write_op.cc:301] APPLY: starting
0709 13:05:05.188202 (+    88us) tablet.cc:1367] starting BulkCheckPresence
0709 13:05:05.238551 (+ 50349us) tablet.cc:1370] finished BulkCheckPresence
0709 13:05:05.255133 (+ 16582us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:05:05.256645 (+  1512us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:05:05.256993 (+   348us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=11
0709 13:05:05.257060 (+    67us) write_op.cc:312] APPLY: finished
0709 13:05:05.333951 (+ 76891us) log.cc:844] Serialized 83 byte log entry
0709 13:05:05.334146 (+   195us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:05:05.334286 (+   140us) write_op.cc:454] Released schema lock
0709 13:05:05.334339 (+    53us) write_op.cc:341] FINISH: Updating metrics
0709 13:05:05.348139 (+ 13800us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:05:05.348178 (+    39us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":81918,"reported_tablets":34,"child_traces":[["op",{"apply.queue_time_us":668573,"apply.run_cpu_time_us":4389,"apply.run_wall_time_us":146630,"num_ops":11,"prepare.queue_time_us":142786,"prepare.run_cpu_time_us":4655,"prepare.run_wall_time_us":22048,"replication_time_us":255783,"thread_start_us":441899,"threads_started":2}]]}
I20260709 13:05:09.021885 19449 leader_election.cc:304] T 9962423cb4e54fcfa5de01daf68a86e7 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e; no voters: 127766fc592545a4997f7790f50f6076, e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:05:09.026458 19406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edd7d470b5014c9489be7f41f64355c9" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:05:09.029973 19402 raft_consensus.cc:1240] T 2725d2c4cb054f18b0fc8f735c15f6c2 P e5256d91808b47c195bc9b4dbd7f2b87 [term 5 FOLLOWER]: Rejecting Update request from peer e61c3a8f61bb48f8a963c9480e53c168 for earlier term 4. Current term is 5. Ops: []
I20260709 13:05:09.030254 19406 raft_consensus.cc:2468] T edd7d470b5014c9489be7f41f64355c9 P e5256d91808b47c195bc9b4dbd7f2b87 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 3.
I20260709 13:05:09.027087 21582 raft_consensus.cc:2749] T 46c5bfeecc314717bffe987e6844b6d0 P 0473d2b2d01f4459b1e90fd12cc7840e [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:05:09.032501 20105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "172b3dd13109415a955b71ac0e9d2234" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:05:09.033155 20105 raft_consensus.cc:2468] T 172b3dd13109415a955b71ac0e9d2234 P 127766fc592545a4997f7790f50f6076 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 1.
I20260709 13:05:09.027968 21731 leader_election.cc:290] T 1dc5b3532fe54f74876d02beffa2c230 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:05:09.036151 21704 raft_consensus.cc:493] T fa8650e71aa14778b3d73721fc50d9fc P e61c3a8f61bb48f8a963c9480e53c168 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 0473d2b2d01f4459b1e90fd12cc7840e)
I20260709 13:05:09.036778 21704 raft_consensus.cc:3060] T fa8650e71aa14778b3d73721fc50d9fc P e61c3a8f61bb48f8a963c9480e53c168 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:05:09.024932 21584 raft_consensus.cc:2749] T 9962423cb4e54fcfa5de01daf68a86e7 P 0473d2b2d01f4459b1e90fd12cc7840e [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:05:09.036301 20103 raft_consensus.cc:1275] T 14935b3ddf914369822e4a0547aaa355 P 127766fc592545a4997f7790f50f6076 [term 4 FOLLOWER]: Refusing update from remote peer e5256d91808b47c195bc9b4dbd7f2b87: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
I20260709 13:05:09.042328 19407 raft_consensus.cc:1275] T 46c5bfeecc314717bffe987e6844b6d0 P e5256d91808b47c195bc9b4dbd7f2b87 [term 9 FOLLOWER]: Refusing update from remote peer e61c3a8f61bb48f8a963c9480e53c168: Log matching property violated. Preceding OpId in replica: term: 7 index: 3. Preceding OpId from leader: term: 9 index: 4. (index mismatch)
I20260709 13:05:09.043952 19408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e1f505cb0f1427bbd698ac889d80821" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:05:09.046187 19405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dc5b3532fe54f74876d02beffa2c230" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:05:09.049059 19557 raft_consensus.cc:1275] T 1a61655d99124a29b486ba4a5b37faea P e61c3a8f61bb48f8a963c9480e53c168 [term 3 FOLLOWER]: Refusing update from remote peer 0473d2b2d01f4459b1e90fd12cc7840e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:05:09.051942 19552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48824d5acfbc485ebf8c2d944e7202de" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:05:09.054857 19409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "179fd671030940b4b4a4e24bcc4aba0a" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:05:09.055480 19411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e381f1d6b8184797ad142de49be225a8" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:05:09.056192 19411 raft_consensus.cc:2468] T e381f1d6b8184797ad142de49be225a8 P e5256d91808b47c195bc9b4dbd7f2b87 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 3.
I20260709 13:05:09.055542 19409 raft_consensus.cc:2468] T 179fd671030940b4b4a4e24bcc4aba0a P e5256d91808b47c195bc9b4dbd7f2b87 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 3.
I20260709 13:05:09.064591 19560 raft_consensus.cc:1275] T bc225c93219c45538b53a1bd3d387e4d P e61c3a8f61bb48f8a963c9480e53c168 [term 7 FOLLOWER]: Refusing update from remote peer 0473d2b2d01f4459b1e90fd12cc7840e: Log matching property violated. Preceding OpId in replica: term: 6 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
W20260709 13:05:09.068751 19377 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.2:46257, user_credentials={real_user=slave}} blocked reactor thread for 57581us
I20260709 13:05:09.069585 19377 leader_election.cc:304] T fa8650e71aa14778b3d73721fc50d9fc P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:05:09.070474 19407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76cb037fc9064d13b59a8969d897ce8c" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:05:09.088439 19553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62c6c134d3d24a1ab144dd9ee6bc3f64" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:05:09.095223 19411 raft_consensus.cc:1275] T bc225c93219c45538b53a1bd3d387e4d P e5256d91808b47c195bc9b4dbd7f2b87 [term 7 FOLLOWER]: Refusing update from remote peer 0473d2b2d01f4459b1e90fd12cc7840e: Log matching property violated. Preceding OpId in replica: term: 4 index: 2. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:05:09.095211 19449 leader_election.cc:304] T 3e1f505cb0f1427bbd698ac889d80821 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e; no voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168
W20260709 13:05:09.111132 19375 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.3:36891, user_credentials={real_user=slave}} blocked reactor thread for 53388.5us
I20260709 13:05:09.075366 21718 raft_consensus.cc:493] T df751f992649444090e27965eb1af85d P 0473d2b2d01f4459b1e90fd12cc7840e [term 5 FOLLOWER]: Starting pre-election (detected failure of leader e61c3a8f61bb48f8a963c9480e53c168)
I20260709 13:05:09.114573 19375 leader_election.cc:304] T 76cb037fc9064d13b59a8969d897ce8c P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:05:09.125442 19408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc225c93219c45538b53a1bd3d387e4d" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:05:09.125873 19403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85c494af21f9457a85da47b9bc70c1fd" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:05:09.126109 19408 raft_consensus.cc:2468] T bc225c93219c45538b53a1bd3d387e4d P e5256d91808b47c195bc9b4dbd7f2b87 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 7.
I20260709 13:05:09.126633 19407 raft_consensus.cc:1275] T 1a61655d99124a29b486ba4a5b37faea P e5256d91808b47c195bc9b4dbd7f2b87 [term 3 FOLLOWER]: Refusing update from remote peer 0473d2b2d01f4459b1e90fd12cc7840e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
W20260709 13:05:09.127696 19377 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.2:46257, user_credentials={real_user=slave}} blocked reactor thread for 58187.6us
I20260709 13:05:09.128472 19377 leader_election.cc:304] T ff75a1d4cb1f493db8f71ddc136ba9ab P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:05:09.124442 21717 raft_consensus.cc:493] T 2725d2c4cb054f18b0fc8f735c15f6c2 P 0473d2b2d01f4459b1e90fd12cc7840e [term 4 FOLLOWER]: Starting pre-election (detected failure of leader e61c3a8f61bb48f8a963c9480e53c168)
I20260709 13:05:09.133138 21717 raft_consensus.cc:515] T 2725d2c4cb054f18b0fc8f735c15f6c2 P 0473d2b2d01f4459b1e90fd12cc7840e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:09.143911 19406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2725d2c4cb054f18b0fc8f735c15f6c2" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:05:09.144709 19406 raft_consensus.cc:2393] T 2725d2c4cb054f18b0fc8f735c15f6c2 P e5256d91808b47c195bc9b4dbd7f2b87 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0473d2b2d01f4459b1e90fd12cc7840e in current term 5: Already voted for candidate e5256d91808b47c195bc9b4dbd7f2b87 in this term.
I20260709 13:05:09.149772 19551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edd7d470b5014c9489be7f41f64355c9" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:05:09.151093 19558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9f0d59553ad444883fcf5b5909f9798" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:05:09.155181 19377 leader_election.cc:304] T 2725d2c4cb054f18b0fc8f735c15f6c2 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:05:09.106609 21525 raft_consensus.cc:2749] T 3e1f505cb0f1427bbd698ac889d80821 P 0473d2b2d01f4459b1e90fd12cc7840e [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:05:09.165103 19409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "775c229504194560ba9589bc2199b089" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:05:09.170480 19523 leader_election.cc:304] T edd7d470b5014c9489be7f41f64355c9 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168; no voters: 0473d2b2d01f4459b1e90fd12cc7840e
I20260709 13:05:09.170974 19407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ec1c4ce15e04c7e8c283a62179f2a64" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
I20260709 13:05:09.171582 19407 raft_consensus.cc:3060] T 5ec1c4ce15e04c7e8c283a62179f2a64 P e5256d91808b47c195bc9b4dbd7f2b87 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:09.171813 19552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dc5b3532fe54f74876d02beffa2c230" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:05:09.175736 19551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df751f992649444090e27965eb1af85d" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:05:09.176635 19374 leader_election.cc:304] T 172b3dd13109415a955b71ac0e9d2234 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 127766fc592545a4997f7790f50f6076, e5256d91808b47c195bc9b4dbd7f2b87; no voters: 
I20260709 13:05:09.177419 20075 leader_election.cc:304] T 775c229504194560ba9589bc2199b089 P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 127766fc592545a4997f7790f50f6076; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:05:09.180491 19553 raft_consensus.cc:1275] T a08760e15aac4630a629431f56024dc8 P e61c3a8f61bb48f8a963c9480e53c168 [term 5 FOLLOWER]: Refusing update from remote peer e5256d91808b47c195bc9b4dbd7f2b87: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:05:09.180662 19377 leader_election.cc:304] T 21e14947d70440f19044d8f75c31e1f9 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:05:09.137480 21701 raft_consensus.cc:2749] T ff75a1d4cb1f493db8f71ddc136ba9ab P e5256d91808b47c195bc9b4dbd7f2b87 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:05:09.131784 21636 raft_consensus.cc:2749] T fa8650e71aa14778b3d73721fc50d9fc P e5256d91808b47c195bc9b4dbd7f2b87 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:05:09.184551 19558 raft_consensus.cc:1275] T 14935b3ddf914369822e4a0547aaa355 P e61c3a8f61bb48f8a963c9480e53c168 [term 4 FOLLOWER]: Refusing update from remote peer e5256d91808b47c195bc9b4dbd7f2b87: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
I20260709 13:05:09.192446 19305 catalog_manager.cc:5697] T 28af091831594f9d8e96482078cc7625 P e61c3a8f61bb48f8a963c9480e53c168 reported cstate change: term changed from 1 to 4, leader changed from e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1) to e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3). New cstate: current_term: 4 leader_uuid: "e61c3a8f61bb48f8a963c9480e53c168" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } health_report { overall_health: HEALTHY } } }
I20260709 13:05:09.198100 21747 consensus_queue.cc:1059] T 2725d2c4cb054f18b0fc8f735c15f6c2 P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:05:09.187114 21115 raft_consensus.cc:2804] T edd7d470b5014c9489be7f41f64355c9 P e61c3a8f61bb48f8a963c9480e53c168 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:05:09.200057 21115 raft_consensus.cc:493] T edd7d470b5014c9489be7f41f64355c9 P e61c3a8f61bb48f8a963c9480e53c168 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 0473d2b2d01f4459b1e90fd12cc7840e)
I20260709 13:05:09.200443 21115 raft_consensus.cc:3060] T edd7d470b5014c9489be7f41f64355c9 P e61c3a8f61bb48f8a963c9480e53c168 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:05:09.202741 21733 consensus_queue.cc:1048] T 1a61655d99124a29b486ba4a5b37faea P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:09.207943 19523 leader_election.cc:304] T e381f1d6b8184797ad142de49be225a8 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168; no voters: 0473d2b2d01f4459b1e90fd12cc7840e
I20260709 13:05:09.214432 21523 consensus_queue.cc:1048] T 46c5bfeecc314717bffe987e6844b6d0 P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:05:09.186642 21720 raft_consensus.cc:2749] T 21e14947d70440f19044d8f75c31e1f9 P e5256d91808b47c195bc9b4dbd7f2b87 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:05:09.186480 21536 raft_consensus.cc:2749] T 2725d2c4cb054f18b0fc8f735c15f6c2 P e5256d91808b47c195bc9b4dbd7f2b87 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:05:09.124789 21718 raft_consensus.cc:515] T df751f992649444090e27965eb1af85d P 0473d2b2d01f4459b1e90fd12cc7840e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:09.222554 21718 leader_election.cc:290] T df751f992649444090e27965eb1af85d P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:05:09.168468 21630 consensus_queue.cc:1048] T 40e1e16737a842ee936002830f36882e P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.048s
I20260709 13:05:09.186510 21705 raft_consensus.cc:2804] T 172b3dd13109415a955b71ac0e9d2234 P e5256d91808b47c195bc9b4dbd7f2b87 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:05:09.224658 21705 raft_consensus.cc:493] T 172b3dd13109415a955b71ac0e9d2234 P e5256d91808b47c195bc9b4dbd7f2b87 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 0473d2b2d01f4459b1e90fd12cc7840e)
I20260709 13:05:09.225059 21705 raft_consensus.cc:3060] T 172b3dd13109415a955b71ac0e9d2234 P e5256d91808b47c195bc9b4dbd7f2b87 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:05:09.190356 21760 log.cc:927] Time spent T d1e5873a19244c5ebbcd38e126796ee7 P e61c3a8f61bb48f8a963c9480e53c168: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
W20260709 13:05:09.163268 21761 log.cc:927] Time spent T 46c5bfeecc314717bffe987e6844b6d0 P 0473d2b2d01f4459b1e90fd12cc7840e: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
I20260709 13:05:09.158880 21554 raft_consensus.cc:2804] T 76cb037fc9064d13b59a8969d897ce8c P e5256d91808b47c195bc9b4dbd7f2b87 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:05:09.227682 21554 raft_consensus.cc:493] T 76cb037fc9064d13b59a8969d897ce8c P e5256d91808b47c195bc9b4dbd7f2b87 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 0473d2b2d01f4459b1e90fd12cc7840e)
I20260709 13:05:09.228094 21554 raft_consensus.cc:3060] T 76cb037fc9064d13b59a8969d897ce8c P e5256d91808b47c195bc9b4dbd7f2b87 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:05:09.228750 21747 raft_consensus.cc:3055] T 2725d2c4cb054f18b0fc8f735c15f6c2 P e61c3a8f61bb48f8a963c9480e53c168 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:05:09.229130 21747 raft_consensus.cc:740] T 2725d2c4cb054f18b0fc8f735c15f6c2 P e61c3a8f61bb48f8a963c9480e53c168 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: e61c3a8f61bb48f8a963c9480e53c168, State: Running, Role: LEADER
I20260709 13:05:09.229882 21747 consensus_queue.cc:260] T 2725d2c4cb054f18b0fc8f735c15f6c2 P e61c3a8f61bb48f8a963c9480e53c168 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:09.207875 21715 consensus_queue.cc:1048] T 14935b3ddf914369822e4a0547aaa355 P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Connected to new peer: Peer: permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.019s
I20260709 13:05:09.230868 21559 raft_consensus.cc:2804] T e381f1d6b8184797ad142de49be225a8 P e61c3a8f61bb48f8a963c9480e53c168 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:05:09.185032 21717 leader_election.cc:290] T 2725d2c4cb054f18b0fc8f735c15f6c2 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:05:09.184265 21672 raft_consensus.cc:493] T 833a2f0775ed407a94b8924ce50adb63 P e61c3a8f61bb48f8a963c9480e53c168 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader e5256d91808b47c195bc9b4dbd7f2b87)
I20260709 13:05:09.185925 19377 leader_election.cc:304] T 0cdf56e38bbc453d9438d359e5a69955 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:05:09.260900 19407 raft_consensus.cc:2468] T 5ec1c4ce15e04c7e8c283a62179f2a64 P e5256d91808b47c195bc9b4dbd7f2b87 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 127766fc592545a4997f7790f50f6076 in term 3.
I20260709 13:05:09.268791 19523 leader_election.cc:304] T 179fd671030940b4b4a4e24bcc4aba0a P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168; no voters: 0473d2b2d01f4459b1e90fd12cc7840e
W20260709 13:05:09.269799 19377 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.2:46257, user_credentials={real_user=slave}} blocked reactor thread for 83961.1us
I20260709 13:05:09.270826 19377 leader_election.cc:304] T 86a6797bdfe94fa496c050ceae4bd0d9 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:05:09.272295 19377 leader_election.cc:304] T 9962423cb4e54fcfa5de01daf68a86e7 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, 127766fc592545a4997f7790f50f6076
I20260709 13:05:09.208832 21751 raft_consensus.cc:2749] T 775c229504194560ba9589bc2199b089 P 127766fc592545a4997f7790f50f6076 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:05:09.173462 21753 consensus_queue.cc:1048] T bc225c93219c45538b53a1bd3d387e4d P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.079s
I20260709 13:05:09.284821 19523 leader_election.cc:304] T 76cb037fc9064d13b59a8969d897ce8c P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e61c3a8f61bb48f8a963c9480e53c168; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:05:09.251931 21559 raft_consensus.cc:493] T e381f1d6b8184797ad142de49be225a8 P e61c3a8f61bb48f8a963c9480e53c168 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 0473d2b2d01f4459b1e90fd12cc7840e)
I20260709 13:05:09.280997 21672 raft_consensus.cc:515] T 833a2f0775ed407a94b8924ce50adb63 P e61c3a8f61bb48f8a963c9480e53c168 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:05:09.287724 19523 leader_election.cc:304] T 85c494af21f9457a85da47b9bc70c1fd P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e61c3a8f61bb48f8a963c9480e53c168; no voters: 127766fc592545a4997f7790f50f6076, e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:05:09.285944 19377 leader_election.cc:304] T b08304a0a02b42d7840c4e8ee9a6bd1a P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:05:09.275024 21536 raft_consensus.cc:2749] T 9962423cb4e54fcfa5de01daf68a86e7 P e5256d91808b47c195bc9b4dbd7f2b87 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:05:09.274871 21701 raft_consensus.cc:2749] T 0cdf56e38bbc453d9438d359e5a69955 P e5256d91808b47c195bc9b4dbd7f2b87 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:05:09.280270 21630 raft_consensus.cc:2749] T 86a6797bdfe94fa496c050ceae4bd0d9 P e5256d91808b47c195bc9b4dbd7f2b87 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:05:09.290060 21720 consensus_queue.cc:1048] T 14935b3ddf914369822e4a0547aaa355 P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.020s
I20260709 13:05:09.302565 21710 raft_consensus.cc:2749] T b08304a0a02b42d7840c4e8ee9a6bd1a P e5256d91808b47c195bc9b4dbd7f2b87 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:05:09.312026 21636 consensus_queue.cc:1048] T 14935b3ddf914369822e4a0547aaa355 P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:05:09.287964 21559 raft_consensus.cc:3060] T e381f1d6b8184797ad142de49be225a8 P e61c3a8f61bb48f8a963c9480e53c168 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:05:09.303649 21535 consensus_queue.cc:1048] T a08760e15aac4630a629431f56024dc8 P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.011s
I20260709 13:05:09.321197 21115 raft_consensus.cc:515] T edd7d470b5014c9489be7f41f64355c9 P e61c3a8f61bb48f8a963c9480e53c168 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:09.323580 21115 leader_election.cc:290] T edd7d470b5014c9489be7f41f64355c9 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 4 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:05:09.306847 21707 raft_consensus.cc:2749] T 85c494af21f9457a85da47b9bc70c1fd P e61c3a8f61bb48f8a963c9480e53c168 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:05:09.332340 21704 raft_consensus.cc:515] T fa8650e71aa14778b3d73721fc50d9fc P e61c3a8f61bb48f8a963c9480e53c168 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:09.333449 19560 raft_consensus.cc:1240] T fa8650e71aa14778b3d73721fc50d9fc P e61c3a8f61bb48f8a963c9480e53c168 [term 6 FOLLOWER]: Rejecting Update request from peer 0473d2b2d01f4459b1e90fd12cc7840e for earlier term 5. Current term is 6. Ops: []
I20260709 13:05:09.333338 21705 raft_consensus.cc:515] T 172b3dd13109415a955b71ac0e9d2234 P e5256d91808b47c195bc9b4dbd7f2b87 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:05:09.305750 19523 leader_election.cc:304] T bc225c93219c45538b53a1bd3d387e4d P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168; no voters: 0473d2b2d01f4459b1e90fd12cc7840e
I20260709 13:05:09.287285 21524 raft_consensus.cc:2749] T 76cb037fc9064d13b59a8969d897ce8c P e61c3a8f61bb48f8a963c9480e53c168 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:05:09.285329 21747 raft_consensus.cc:3060] T 2725d2c4cb054f18b0fc8f735c15f6c2 P e61c3a8f61bb48f8a963c9480e53c168 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:05:09.362847 19449 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.1:40321, user_credentials={real_user=slave}} blocked reactor thread for 189805us
I20260709 13:05:09.363711 21621 consensus_queue.cc:1048] T 1a61655d99124a29b486ba4a5b37faea P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:09.286124 21523 raft_consensus.cc:2804] T 179fd671030940b4b4a4e24bcc4aba0a P e61c3a8f61bb48f8a963c9480e53c168 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:05:09.308954 21672 leader_election.cc:290] T 833a2f0775ed407a94b8924ce50adb63 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:05:09.364758 21523 raft_consensus.cc:493] T 179fd671030940b4b4a4e24bcc4aba0a P e61c3a8f61bb48f8a963c9480e53c168 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 0473d2b2d01f4459b1e90fd12cc7840e)
I20260709 13:05:09.365159 21523 raft_consensus.cc:3060] T 179fd671030940b4b4a4e24bcc4aba0a P e61c3a8f61bb48f8a963c9480e53c168 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:05:09.341485 21704 leader_election.cc:290] T fa8650e71aa14778b3d73721fc50d9fc P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 6 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
W20260709 13:05:09.303385 19450 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.3:36891, user_credentials={real_user=slave}} blocked reactor thread for 118855us
W20260709 13:05:09.360231 19523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.1:40321, user_credentials={real_user=slave}} blocked reactor thread for 54556.6us
I20260709 13:05:09.369086 21672 raft_consensus.cc:493] T 2e36a9d6e29c4a7c860cf267efbd4c74 P e61c3a8f61bb48f8a963c9480e53c168 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:09.369539 21672 raft_consensus.cc:515] T 2e36a9d6e29c4a7c860cf267efbd4c74 P e61c3a8f61bb48f8a963c9480e53c168 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:09.371443 21672 leader_election.cc:290] T 2e36a9d6e29c4a7c860cf267efbd4c74 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:05:09.371989 20107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "833a2f0775ed407a94b8924ce50adb63" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:05:09.372964 19409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df751f992649444090e27965eb1af85d" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:05:09.373103 21707 raft_consensus.cc:2804] T bc225c93219c45538b53a1bd3d387e4d P e61c3a8f61bb48f8a963c9480e53c168 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:05:09.373528 21707 raft_consensus.cc:493] T bc225c93219c45538b53a1bd3d387e4d P e61c3a8f61bb48f8a963c9480e53c168 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:09.373857 21707 raft_consensus.cc:3060] T bc225c93219c45538b53a1bd3d387e4d P e61c3a8f61bb48f8a963c9480e53c168 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:05:09.375346 19409 raft_consensus.cc:1240] T 5ec1c4ce15e04c7e8c283a62179f2a64 P e5256d91808b47c195bc9b4dbd7f2b87 [term 3 FOLLOWER]: Rejecting Update request from peer 0473d2b2d01f4459b1e90fd12cc7840e for earlier term 2. Current term is 3. Ops: []
I20260709 13:05:09.382488 19407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "833a2f0775ed407a94b8924ce50adb63" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:05:09.387108 19480 raft_consensus.cc:1240] T 48824d5acfbc485ebf8c2d944e7202de P 0473d2b2d01f4459b1e90fd12cc7840e [term 4 LEADER]: Rejecting Update request from peer e61c3a8f61bb48f8a963c9480e53c168 for earlier term 3. Current term is 4. Ops: []
I20260709 13:05:09.388594 19480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edd7d470b5014c9489be7f41f64355c9" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:05:09.389058 19408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e36a9d6e29c4a7c860cf267efbd4c74" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:05:09.389501 19523 leader_election.cc:304] T 833a2f0775ed407a94b8924ce50adb63 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e61c3a8f61bb48f8a963c9480e53c168; no voters: 127766fc592545a4997f7790f50f6076, e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:05:09.389868 19480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa8650e71aa14778b3d73721fc50d9fc" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:05:09.391319 19480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e36a9d6e29c4a7c860cf267efbd4c74" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:05:09.393863 19410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edd7d470b5014c9489be7f41f64355c9" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
I20260709 13:05:09.398483 19450 leader_election.cc:304] T 62c6c134d3d24a1ab144dd9ee6bc3f64 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e; no voters: 127766fc592545a4997f7790f50f6076, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:05:09.400141 19407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa8650e71aa14778b3d73721fc50d9fc" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
I20260709 13:05:09.401129 21731 consensus_queue.cc:1048] T bc225c93219c45538b53a1bd3d387e4d P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:05:09.403626 21672 raft_consensus.cc:2749] T 833a2f0775ed407a94b8924ce50adb63 P e61c3a8f61bb48f8a963c9480e53c168 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:05:09.405910 20103 raft_consensus.cc:1240] T 48824d5acfbc485ebf8c2d944e7202de P 127766fc592545a4997f7790f50f6076 [term 4 FOLLOWER]: Rejecting Update request from peer e61c3a8f61bb48f8a963c9480e53c168 for earlier term 3. Current term is 4. Ops: []
I20260709 13:05:09.419067 19377 leader_election.cc:304] T 7be9efa6559648dbb5a0f7684c4542d1 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:05:09.436408 21554 raft_consensus.cc:515] T 76cb037fc9064d13b59a8969d897ce8c P e5256d91808b47c195bc9b4dbd7f2b87 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:09.438660 21554 leader_election.cc:290] T 76cb037fc9064d13b59a8969d897ce8c P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 6 election: Requested vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:05:09.439739 19526 leader_election.cc:304] T edd7d470b5014c9489be7f41f64355c9 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e61c3a8f61bb48f8a963c9480e53c168; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:05:09.441094 19526 leader_election.cc:304] T fa8650e71aa14778b3d73721fc50d9fc P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e61c3a8f61bb48f8a963c9480e53c168; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:05:09.439811 19450 leader_election.cc:304] T 1dc5b3532fe54f74876d02beffa2c230 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e; no voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:05:09.443176 21088 raft_consensus.cc:2749] T 1dc5b3532fe54f74876d02beffa2c230 P 0473d2b2d01f4459b1e90fd12cc7840e [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:05:09.445530 19554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2725d2c4cb054f18b0fc8f735c15f6c2" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:05:09.446259 19554 raft_consensus.cc:2468] T 2725d2c4cb054f18b0fc8f735c15f6c2 P e61c3a8f61bb48f8a963c9480e53c168 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 5.
I20260709 13:05:09.448786 19555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df751f992649444090e27965eb1af85d" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:05:09.417898 21444 raft_consensus.cc:2749] T 62c6c134d3d24a1ab144dd9ee6bc3f64 P 0473d2b2d01f4459b1e90fd12cc7840e [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:05:09.462523 19558 raft_consensus.cc:1240] T edd7d470b5014c9489be7f41f64355c9 P e61c3a8f61bb48f8a963c9480e53c168 [term 4 FOLLOWER]: Rejecting Update request from peer 0473d2b2d01f4459b1e90fd12cc7840e for earlier term 3. Current term is 4. Ops: []
I20260709 13:05:09.454717 19526 leader_election.cc:304] T 2e36a9d6e29c4a7c860cf267efbd4c74 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e61c3a8f61bb48f8a963c9480e53c168; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:05:09.459118 19408 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0cdf56e38bbc453d9438d359e5a69955"
dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
mode: GRACEFUL
new_leader_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
 from {username='slave'} at 127.0.0.1:37312
I20260709 13:05:09.427292 21707 raft_consensus.cc:515] T bc225c93219c45538b53a1bd3d387e4d P e61c3a8f61bb48f8a963c9480e53c168 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:09.464190 19408 raft_consensus.cc:606] T 0cdf56e38bbc453d9438d359e5a69955 P e5256d91808b47c195bc9b4dbd7f2b87 [term 6 FOLLOWER]: Received request to transfer leadership to TS e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:05:09.464653 19408 raft_consensus.cc:614] T 0cdf56e38bbc453d9438d359e5a69955 P e5256d91808b47c195bc9b4dbd7f2b87 [term 6 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:05:09.469005 19480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edd7d470b5014c9489be7f41f64355c9" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:05:09.470709 19484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9f0d59553ad444883fcf5b5909f9798" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:05:09.471005 19482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df751f992649444090e27965eb1af85d" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:05:09.472486 19481 raft_consensus.cc:1275] T 40e1e16737a842ee936002830f36882e P 0473d2b2d01f4459b1e90fd12cc7840e [term 6 FOLLOWER]: Refusing update from remote peer e5256d91808b47c195bc9b4dbd7f2b87: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:05:09.473955 19482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "172b3dd13109415a955b71ac0e9d2234" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:05:09.474489 19484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76cb037fc9064d13b59a8969d897ce8c" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:05:09.478657 19408 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "179fd671030940b4b4a4e24bcc4aba0a"
dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
mode: GRACEFUL
new_leader_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
 from {username='slave'} at 127.0.0.1:37312
I20260709 13:05:09.479308 19408 raft_consensus.cc:606] T 179fd671030940b4b4a4e24bcc4aba0a P e5256d91808b47c195bc9b4dbd7f2b87 [term 3 FOLLOWER]: Received request to transfer leadership to TS e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:05:09.479616 19408 raft_consensus.cc:614] T 179fd671030940b4b4a4e24bcc4aba0a P e5256d91808b47c195bc9b4dbd7f2b87 [term 3 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:05:09.479931 19479 raft_consensus.cc:1275] T a08760e15aac4630a629431f56024dc8 P 0473d2b2d01f4459b1e90fd12cc7840e [term 5 FOLLOWER]: Refusing update from remote peer e5256d91808b47c195bc9b4dbd7f2b87: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:05:09.480055 21523 raft_consensus.cc:515] T 179fd671030940b4b4a4e24bcc4aba0a P e61c3a8f61bb48f8a963c9480e53c168 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:09.482137 19408 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "21e14947d70440f19044d8f75c31e1f9"
dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
mode: GRACEFUL
new_leader_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
 from {username='slave'} at 127.0.0.1:37312
I20260709 13:05:09.482312 21523 leader_election.cc:290] T 179fd671030940b4b4a4e24bcc4aba0a P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 4 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:05:09.482748 19408 raft_consensus.cc:606] T 21e14947d70440f19044d8f75c31e1f9 P e5256d91808b47c195bc9b4dbd7f2b87 [term 5 FOLLOWER]: Received request to transfer leadership to TS e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:05:09.483278 19408 raft_consensus.cc:614] T 21e14947d70440f19044d8f75c31e1f9 P e5256d91808b47c195bc9b4dbd7f2b87 [term 5 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:05:09.485882 19408 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "40e1e16737a842ee936002830f36882e"
dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
mode: GRACEFUL
new_leader_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
 from {username='slave'} at 127.0.0.1:37312
I20260709 13:05:09.486395 19408 raft_consensus.cc:606] T 40e1e16737a842ee936002830f36882e P e5256d91808b47c195bc9b4dbd7f2b87 [term 6 LEADER]: Received request to transfer leadership to TS e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:05:09.488754 21559 raft_consensus.cc:515] T e381f1d6b8184797ad142de49be225a8 P e61c3a8f61bb48f8a963c9480e53c168 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:09.489404 19408 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "bc225c93219c45538b53a1bd3d387e4d"
dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
mode: GRACEFUL
new_leader_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
 from {username='slave'} at 127.0.0.1:37312
I20260709 13:05:09.489987 21767 consensus_queue.cc:1059] T 5ec1c4ce15e04c7e8c283a62179f2a64 P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.017s
I20260709 13:05:09.490967 21767 raft_consensus.cc:3055] T 5ec1c4ce15e04c7e8c283a62179f2a64 P 0473d2b2d01f4459b1e90fd12cc7840e [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:05:09.461678 21525 consensus_queue.cc:1059] T fa8650e71aa14778b3d73721fc50d9fc P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.030s
I20260709 13:05:09.491359 21767 raft_consensus.cc:740] T 5ec1c4ce15e04c7e8c283a62179f2a64 P 0473d2b2d01f4459b1e90fd12cc7840e [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 0473d2b2d01f4459b1e90fd12cc7840e, State: Running, Role: LEADER
I20260709 13:05:09.492630 20107 raft_consensus.cc:1275] T 48824d5acfbc485ebf8c2d944e7202de P 127766fc592545a4997f7790f50f6076 [term 4 FOLLOWER]: Refusing update from remote peer 0473d2b2d01f4459b1e90fd12cc7840e: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:05:09.492354 21767 consensus_queue.cc:260] T 5ec1c4ce15e04c7e8c283a62179f2a64 P 0473d2b2d01f4459b1e90fd12cc7840e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:05:09.468904 21641 raft_consensus.cc:2749] T fa8650e71aa14778b3d73721fc50d9fc P e61c3a8f61bb48f8a963c9480e53c168 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:05:09.501379 19556 raft_consensus.cc:1240] T 179fd671030940b4b4a4e24bcc4aba0a P e61c3a8f61bb48f8a963c9480e53c168 [term 4 FOLLOWER]: Rejecting Update request from peer 0473d2b2d01f4459b1e90fd12cc7840e for earlier term 3. Current term is 4. Ops: []
I20260709 13:05:09.506368 19377 leader_election.cc:304] T b9f0d59553ad444883fcf5b5909f9798 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:05:09.508128 19555 raft_consensus.cc:1240] T e381f1d6b8184797ad142de49be225a8 P e61c3a8f61bb48f8a963c9480e53c168 [term 4 FOLLOWER]: Rejecting Update request from peer 0473d2b2d01f4459b1e90fd12cc7840e for earlier term 3. Current term is 4. Ops: []
I20260709 13:05:09.439280 21636 raft_consensus.cc:2749] T 7be9efa6559648dbb5a0f7684c4542d1 P e5256d91808b47c195bc9b4dbd7f2b87 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:05:09.511485 19405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "179fd671030940b4b4a4e24bcc4aba0a" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
I20260709 13:05:09.505862 19558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76cb037fc9064d13b59a8969d897ce8c" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:05:09.519254 19377 leader_election.cc:304] T df751f992649444090e27965eb1af85d P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168
W20260709 13:05:09.520957 19526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.2:46257, user_credentials={real_user=slave}} blocked reactor thread for 66357us
I20260709 13:05:09.521694 19450 leader_election.cc:304] T 2725d2c4cb054f18b0fc8f735c15f6c2 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168; no voters: e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:05:09.522047 19377 leader_election.cc:304] T 76cb037fc9064d13b59a8969d897ce8c P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:05:09.523669 19377 leader_election.cc:304] T edd7d470b5014c9489be7f41f64355c9 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:05:09.524111 19557 raft_consensus.cc:1240] T bc225c93219c45538b53a1bd3d387e4d P e61c3a8f61bb48f8a963c9480e53c168 [term 8 FOLLOWER]: Rejecting Update request from peer 0473d2b2d01f4459b1e90fd12cc7840e for earlier term 7. Current term is 8. Ops: [7.4-7.4]
W20260709 13:05:09.526585 19374 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.4:43121, user_credentials={real_user=slave}} blocked reactor thread for 341138us
I20260709 13:05:09.527556 19407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e381f1d6b8184797ad142de49be225a8" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
I20260709 13:05:09.431428 21704 consensus_queue.cc:1059] T 48824d5acfbc485ebf8c2d944e7202de P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.082s
I20260709 13:05:09.463376 21705 leader_election.cc:290] T 172b3dd13109415a955b71ac0e9d2234 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 2 election: Requested vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:05:09.472764 21561 raft_consensus.cc:2749] T edd7d470b5014c9489be7f41f64355c9 P e61c3a8f61bb48f8a963c9480e53c168 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
W20260709 13:05:09.579326 19374 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.4:43121, user_credentials={real_user=slave}} blocked reactor thread for 51744.5us
I20260709 13:05:09.523483 21411 raft_consensus.cc:2749] T df751f992649444090e27965eb1af85d P e5256d91808b47c195bc9b4dbd7f2b87 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 13:05:09.586978 19450 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.3:36891, user_credentials={real_user=slave}} blocked reactor thread for 65254.2us
I20260709 13:05:09.590308 19408 raft_consensus.cc:606] T bc225c93219c45538b53a1bd3d387e4d P e5256d91808b47c195bc9b4dbd7f2b87 [term 7 FOLLOWER]: Received request to transfer leadership to TS e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:05:09.590911 19408 raft_consensus.cc:614] T bc225c93219c45538b53a1bd3d387e4d P e5256d91808b47c195bc9b4dbd7f2b87 [term 7 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:05:09.522866 21535 raft_consensus.cc:2749] T b9f0d59553ad444883fcf5b5909f9798 P e5256d91808b47c195bc9b4dbd7f2b87 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:05:09.530948 21666 raft_consensus.cc:2749] T 76cb037fc9064d13b59a8969d897ce8c P e5256d91808b47c195bc9b4dbd7f2b87 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:05:09.530189 21529 raft_consensus.cc:2749] T 2e36a9d6e29c4a7c860cf267efbd4c74 P e61c3a8f61bb48f8a963c9480e53c168 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:05:09.569545 21547 raft_consensus.cc:2749] T edd7d470b5014c9489be7f41f64355c9 P e5256d91808b47c195bc9b4dbd7f2b87 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:05:09.607129 20075 leader_election.cc:304] T 5ec1c4ce15e04c7e8c283a62179f2a64 P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 127766fc592545a4997f7790f50f6076, e5256d91808b47c195bc9b4dbd7f2b87; no voters: 0473d2b2d01f4459b1e90fd12cc7840e
I20260709 13:05:09.609342 19450 leader_election.cc:304] T df751f992649444090e27965eb1af85d P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e; no voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:05:09.516852 21731 consensus_queue.cc:1048] T 48824d5acfbc485ebf8c2d944e7202de P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Connected to new peer: Peer: permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.078s
I20260709 13:05:09.575591 21554 consensus_queue.cc:1048] T a08760e15aac4630a629431f56024dc8 P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.037s
I20260709 13:05:09.622579 20103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "172b3dd13109415a955b71ac0e9d2234" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076"
I20260709 13:05:09.615053 21403 raft_consensus.cc:2804] T 5ec1c4ce15e04c7e8c283a62179f2a64 P 127766fc592545a4997f7790f50f6076 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:05:09.623510 21403 raft_consensus.cc:697] T 5ec1c4ce15e04c7e8c283a62179f2a64 P 127766fc592545a4997f7790f50f6076 [term 3 LEADER]: Becoming Leader. State: Replica: 127766fc592545a4997f7790f50f6076, State: Running, Role: LEADER
I20260709 13:05:09.624437 21403 consensus_queue.cc:237] T 5ec1c4ce15e04c7e8c283a62179f2a64 P 127766fc592545a4997f7790f50f6076 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:05:09.632035 18300 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:05:09.604032 21559 leader_election.cc:290] T e381f1d6b8184797ad142de49be225a8 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 4 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:05:09.606168 21717 raft_consensus.cc:2804] T 2725d2c4cb054f18b0fc8f735c15f6c2 P 0473d2b2d01f4459b1e90fd12cc7840e [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:05:09.633639 18300 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:05:09.634157 19374 leader_election.cc:304] T 172b3dd13109415a955b71ac0e9d2234 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, 127766fc592545a4997f7790f50f6076
I20260709 13:05:09.656980 21707 leader_election.cc:290] T bc225c93219c45538b53a1bd3d387e4d P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 8 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:05:09.632700 21524 consensus_queue.cc:1059] T 48824d5acfbc485ebf8c2d944e7202de P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.038s
I20260709 13:05:09.661931 19407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc225c93219c45538b53a1bd3d387e4d" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
I20260709 13:05:09.662708 21088 consensus_queue.cc:1059] T edd7d470b5014c9489be7f41f64355c9 P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:05:09.679180 21524 consensus_queue.cc:1243] T 48824d5acfbc485ebf8c2d944e7202de P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Peer 0473d2b2d01f4459b1e90fd12cc7840e log is divergent from this leader: its last log entry 4.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 13:05:09.621300 21729 raft_consensus.cc:2749] T df751f992649444090e27965eb1af85d P 0473d2b2d01f4459b1e90fd12cc7840e [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:05:09.682442 21088 raft_consensus.cc:3055] T edd7d470b5014c9489be7f41f64355c9 P 0473d2b2d01f4459b1e90fd12cc7840e [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:05:09.683022 21088 raft_consensus.cc:740] T edd7d470b5014c9489be7f41f64355c9 P 0473d2b2d01f4459b1e90fd12cc7840e [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 0473d2b2d01f4459b1e90fd12cc7840e, State: Running, Role: LEADER
I20260709 13:05:09.683962 21088 consensus_queue.cc:260] T edd7d470b5014c9489be7f41f64355c9 P 0473d2b2d01f4459b1e90fd12cc7840e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:09.685492 21088 raft_consensus.cc:3060] T edd7d470b5014c9489be7f41f64355c9 P 0473d2b2d01f4459b1e90fd12cc7840e [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:05:09.686815 21554 raft_consensus.cc:2749] T 172b3dd13109415a955b71ac0e9d2234 P e5256d91808b47c195bc9b4dbd7f2b87 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:05:09.689677 21523 raft_consensus.cc:3055] T 48824d5acfbc485ebf8c2d944e7202de P e61c3a8f61bb48f8a963c9480e53c168 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:05:09.690259 21523 raft_consensus.cc:740] T 48824d5acfbc485ebf8c2d944e7202de P e61c3a8f61bb48f8a963c9480e53c168 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: e61c3a8f61bb48f8a963c9480e53c168, State: Running, Role: LEADER
I20260709 13:05:09.691185 21523 consensus_queue.cc:260] T 48824d5acfbc485ebf8c2d944e7202de P e61c3a8f61bb48f8a963c9480e53c168 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
W20260709 13:05:09.735021 19450 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.3:36891, user_credentials={real_user=slave}} blocked reactor thread for 46459.3us
I20260709 13:05:09.736202 21733 consensus_queue.cc:1059] T e381f1d6b8184797ad142de49be225a8 P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:05:09.737849 21444 consensus_queue.cc:1059] T 179fd671030940b4b4a4e24bcc4aba0a P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.003s
I20260709 13:05:09.741408 21430 raft_consensus.cc:3055] T e381f1d6b8184797ad142de49be225a8 P 0473d2b2d01f4459b1e90fd12cc7840e [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:05:09.741818 21430 raft_consensus.cc:740] T e381f1d6b8184797ad142de49be225a8 P 0473d2b2d01f4459b1e90fd12cc7840e [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 0473d2b2d01f4459b1e90fd12cc7840e, State: Running, Role: LEADER
I20260709 13:05:09.741931 21444 raft_consensus.cc:3055] T 179fd671030940b4b4a4e24bcc4aba0a P 0473d2b2d01f4459b1e90fd12cc7840e [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:05:09.742398 21444 raft_consensus.cc:740] T 179fd671030940b4b4a4e24bcc4aba0a P 0473d2b2d01f4459b1e90fd12cc7840e [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 0473d2b2d01f4459b1e90fd12cc7840e, State: Running, Role: LEADER
I20260709 13:05:09.742640 21430 consensus_queue.cc:260] T e381f1d6b8184797ad142de49be225a8 P 0473d2b2d01f4459b1e90fd12cc7840e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:09.743875 21430 raft_consensus.cc:3060] T e381f1d6b8184797ad142de49be225a8 P 0473d2b2d01f4459b1e90fd12cc7840e [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:05:09.743294 21444 consensus_queue.cc:260] T 179fd671030940b4b4a4e24bcc4aba0a P 0473d2b2d01f4459b1e90fd12cc7840e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:09.668967 21717 raft_consensus.cc:493] T 2725d2c4cb054f18b0fc8f735c15f6c2 P 0473d2b2d01f4459b1e90fd12cc7840e [term 4 FOLLOWER]: Starting leader election (detected failure of leader e61c3a8f61bb48f8a963c9480e53c168)
I20260709 13:05:09.757524 19552 raft_consensus.cc:1240] T fa8650e71aa14778b3d73721fc50d9fc P e61c3a8f61bb48f8a963c9480e53c168 [term 6 FOLLOWER]: Rejecting Update request from peer 0473d2b2d01f4459b1e90fd12cc7840e for earlier term 5. Current term is 6. Ops: []
W20260709 13:05:09.763705 21776 log.cc:927] Time spent T bc225c93219c45538b53a1bd3d387e4d P e5256d91808b47c195bc9b4dbd7f2b87: Append to log took a long time: real 0.091s	user 0.000s	sys 0.000s
W20260709 13:05:09.764051 21774 log.cc:927] Time spent T 2e36a9d6e29c4a7c860cf267efbd4c74 P e5256d91808b47c195bc9b4dbd7f2b87: Append to log took a long time: real 0.339s	user 0.004s	sys 0.000s
I20260709 13:05:09.764385 21444 raft_consensus.cc:3060] T 179fd671030940b4b4a4e24bcc4aba0a P 0473d2b2d01f4459b1e90fd12cc7840e [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:05:09.755059 21523 raft_consensus.cc:3060] T 48824d5acfbc485ebf8c2d944e7202de P e61c3a8f61bb48f8a963c9480e53c168 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:05:09.776093 19481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "179fd671030940b4b4a4e24bcc4aba0a" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:05:09.776997 19483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e381f1d6b8184797ad142de49be225a8" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:05:09.777920 19477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc225c93219c45538b53a1bd3d387e4d" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:05:09.759442 21710 consensus_queue.cc:1048] T 40e1e16737a842ee936002830f36882e P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.025s
I20260709 13:05:09.757071 21717 raft_consensus.cc:3060] T 2725d2c4cb054f18b0fc8f735c15f6c2 P 0473d2b2d01f4459b1e90fd12cc7840e [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:05:09.794035 19407 raft_consensus.cc:1240] T 76cb037fc9064d13b59a8969d897ce8c P e5256d91808b47c195bc9b4dbd7f2b87 [term 6 FOLLOWER]: Rejecting Update request from peer 0473d2b2d01f4459b1e90fd12cc7840e for earlier term 5. Current term is 6. Ops: []
I20260709 13:05:09.797464 19480 raft_consensus.cc:2955] T 14935b3ddf914369822e4a0547aaa355 P 0473d2b2d01f4459b1e90fd12cc7840e [term 4 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 2 to 4, 127766fc592545a4997f7790f50f6076 (127.17.223.4) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } attrs { replace: true } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } } }
I20260709 13:05:09.819957 19409 raft_consensus.cc:1240] T 172b3dd13109415a955b71ac0e9d2234 P e5256d91808b47c195bc9b4dbd7f2b87 [term 2 FOLLOWER]: Rejecting Update request from peer 0473d2b2d01f4459b1e90fd12cc7840e for earlier term 1. Current term is 2. Ops: []
I20260709 13:05:09.842116 19483 raft_consensus.cc:2468] T e381f1d6b8184797ad142de49be225a8 P 0473d2b2d01f4459b1e90fd12cc7840e [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 4.
W20260709 13:05:09.845264 19525 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:05:09.843951 19526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.2:46257, user_credentials={real_user=slave}} blocked reactor thread for 51006.4us
I20260709 13:05:09.839275 21554 raft_consensus.cc:493] T 70797e5783b5454ab0d0eea663e791e3 P e5256d91808b47c195bc9b4dbd7f2b87 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:09.872139 19552 raft_consensus.cc:1275] T 48824d5acfbc485ebf8c2d944e7202de P e61c3a8f61bb48f8a963c9480e53c168 [term 4 FOLLOWER]: Refusing update from remote peer 0473d2b2d01f4459b1e90fd12cc7840e: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 6. (term mismatch)
I20260709 13:05:09.882961 19552 pending_rounds.cc:85] T 48824d5acfbc485ebf8c2d944e7202de P e61c3a8f61bb48f8a963c9480e53c168: Aborting all ops after (but not including) 5
I20260709 13:05:09.883200 19552 pending_rounds.cc:107] T 48824d5acfbc485ebf8c2d944e7202de P e61c3a8f61bb48f8a963c9480e53c168: Aborting uncommitted NO_OP operation due to leader change: 3.6
I20260709 13:05:09.883420 19552 raft_consensus.cc:2889] T 48824d5acfbc485ebf8c2d944e7202de P e61c3a8f61bb48f8a963c9480e53c168 [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:05:09.861613 21733 consensus_queue.cc:1059] T fa8650e71aa14778b3d73721fc50d9fc P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.018s
I20260709 13:05:09.858958 21525 consensus_queue.cc:1059] T 172b3dd13109415a955b71ac0e9d2234 P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.022s
I20260709 13:05:09.888576 19526 leader_election.cc:304] T bc225c93219c45538b53a1bd3d387e4d P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e61c3a8f61bb48f8a963c9480e53c168; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:05:09.809738 21415 raft_consensus.cc:2955] T 14935b3ddf914369822e4a0547aaa355 P e5256d91808b47c195bc9b4dbd7f2b87 [term 4 LEADER]: Committing config change with OpId 2.4: config changed from index 2 to 4, 127766fc592545a4997f7790f50f6076 (127.17.223.4) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } attrs { replace: true } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } } }
I20260709 13:05:09.896914 21523 raft_consensus.cc:2749] T bc225c93219c45538b53a1bd3d387e4d P e61c3a8f61bb48f8a963c9480e53c168 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:05:09.888720 21554 raft_consensus.cc:515] T 70797e5783b5454ab0d0eea663e791e3 P e5256d91808b47c195bc9b4dbd7f2b87 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:05:09.906806 19560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70797e5783b5454ab0d0eea663e791e3" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:05:09.907595 19560 raft_consensus.cc:2468] T 70797e5783b5454ab0d0eea663e791e3 P e61c3a8f61bb48f8a963c9480e53c168 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 5.
I20260709 13:05:09.909034 19375 leader_election.cc:304] T 70797e5783b5454ab0d0eea663e791e3 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:05:09.915141 21710 raft_consensus.cc:2804] T 70797e5783b5454ab0d0eea663e791e3 P e5256d91808b47c195bc9b4dbd7f2b87 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:05:09.915580 21710 raft_consensus.cc:493] T 70797e5783b5454ab0d0eea663e791e3 P e5256d91808b47c195bc9b4dbd7f2b87 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:09.915899 21710 raft_consensus.cc:3060] T 70797e5783b5454ab0d0eea663e791e3 P e5256d91808b47c195bc9b4dbd7f2b87 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:05:09.919920 21717 raft_consensus.cc:515] T 2725d2c4cb054f18b0fc8f735c15f6c2 P 0473d2b2d01f4459b1e90fd12cc7840e [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:09.922333 21554 leader_election.cc:290] T 70797e5783b5454ab0d0eea663e791e3 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:05:09.925158 21525 raft_consensus.cc:3055] T 172b3dd13109415a955b71ac0e9d2234 P 0473d2b2d01f4459b1e90fd12cc7840e [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:05:09.925559 21525 raft_consensus.cc:740] T 172b3dd13109415a955b71ac0e9d2234 P 0473d2b2d01f4459b1e90fd12cc7840e [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0473d2b2d01f4459b1e90fd12cc7840e, State: Running, Role: LEADER
I20260709 13:05:09.882474 21716 consensus_queue.cc:1059] T 76cb037fc9064d13b59a8969d897ce8c P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.061s
I20260709 13:05:09.926592 19481 raft_consensus.cc:2468] T 179fd671030940b4b4a4e24bcc4aba0a P 0473d2b2d01f4459b1e90fd12cc7840e [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 4.
I20260709 13:05:09.931092 21731 raft_consensus.cc:3055] T 76cb037fc9064d13b59a8969d897ce8c P 0473d2b2d01f4459b1e90fd12cc7840e [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:05:09.932466 21731 raft_consensus.cc:740] T 76cb037fc9064d13b59a8969d897ce8c P 0473d2b2d01f4459b1e90fd12cc7840e [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 0473d2b2d01f4459b1e90fd12cc7840e, State: Running, Role: LEADER
I20260709 13:05:09.933547 21731 consensus_queue.cc:260] T 76cb037fc9064d13b59a8969d897ce8c P 0473d2b2d01f4459b1e90fd12cc7840e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:09.908708 19479 consensus_queue.cc:237] T 7be9efa6559648dbb5a0f7684c4542d1 P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } attrs { replace: true } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: NON_VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: true } }
I20260709 13:05:09.926316 21525 consensus_queue.cc:260] T 172b3dd13109415a955b71ac0e9d2234 P 0473d2b2d01f4459b1e90fd12cc7840e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
W20260709 13:05:09.957480 19450 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.3:36891, user_credentials={real_user=slave}} blocked reactor thread for 65908.4us
I20260709 13:05:09.934949 19560 raft_consensus.cc:2955] T 14935b3ddf914369822e4a0547aaa355 P e61c3a8f61bb48f8a963c9480e53c168 [term 4 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 2 to 4, 127766fc592545a4997f7790f50f6076 (127.17.223.4) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } attrs { replace: true } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } } }
W20260709 13:05:10.445055 21710 consensus_meta.cc:287] T 70797e5783b5454ab0d0eea663e791e3 P e5256d91808b47c195bc9b4dbd7f2b87: Time spent flushing consensus metadata: real 0.529s	user 0.010s	sys 0.000s
I20260709 13:05:10.445634 21710 raft_consensus.cc:515] T 70797e5783b5454ab0d0eea663e791e3 P e5256d91808b47c195bc9b4dbd7f2b87 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
W20260709 13:05:10.435225 21779 log.cc:927] Time spent T 14935b3ddf914369822e4a0547aaa355 P 0473d2b2d01f4459b1e90fd12cc7840e: Append to log took a long time: real 0.132s	user 0.006s	sys 0.006s
I20260709 13:05:10.133100 20112 raft_consensus.cc:1240] T 5ec1c4ce15e04c7e8c283a62179f2a64 P 127766fc592545a4997f7790f50f6076 [term 3 LEADER]: Rejecting Update request from peer 0473d2b2d01f4459b1e90fd12cc7840e for earlier term 2. Current term is 3. Ops: []
W20260709 13:05:10.046991 21773 log.cc:927] Time spent T 40e1e16737a842ee936002830f36882e P e61c3a8f61bb48f8a963c9480e53c168: Append to log took a long time: real 0.565s	user 0.004s	sys 0.000s
I20260709 13:05:10.448197 21710 leader_election.cc:290] T 70797e5783b5454ab0d0eea663e791e3 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 6 election: Requested vote from peers e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:05:10.449149 19553 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40438 (request call id 1584) took 1152 ms. Trace:
W20260709 13:05:10.317952 19375 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.3:36891, user_credentials={real_user=slave}} blocked reactor thread for 157802us
I20260709 13:05:10.449676 19553 rpcz_store.cc:276] 0709 13:05:09.296462 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:09.298638 (+  2176us) service_pool.cc:224] Handling call
0709 13:05:09.302364 (+  3726us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:05:09.302700 (+   336us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:05:09.302729 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:05:09.303132 (+   403us) log.cc:844] Serialized 26 byte log entry
0709 13:05:09.410320 (+107188us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:05:09.410362 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:09.410427 (+    65us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:05:10.046626 (+636199us) spinlock_profiling.cc:243] Waited 21.4 ms on lock 0x7b240020d8d8. stack: 00007f4a79de9343 00007f4a79de9240 00007f4a797781d4 00007f4a834b6304 00007f4a834b6299 00007f4a79ca3db1 00007f4a79ca19c4 00007f4a79c9facb 00007f4a79e5adc9 00007f4a79e5aa55 00007f4a79e5a09d 00007f4a7ca8c10e 00007f4a7caa388c 00007f4a7caa2bb6 00007f4a7caa27d8 00007f4a7caac221
0709 13:05:10.448757 (+402131us) raft_consensus.cc:1685] finished
0709 13:05:10.448788 (+    31us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:10.449069 (+   281us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":65,"raft.run_cpu_time_us":103,"raft.run_wall_time_us":3845,"spinlock_wait_cycles":49164032,"thread_start_us":85613,"threads_started":1,"wal-append.queue_time_us":157208}
W20260709 13:05:10.452661 19525 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:10.453689 21525 raft_consensus.cc:3060] T 172b3dd13109415a955b71ac0e9d2234 P 0473d2b2d01f4459b1e90fd12cc7840e [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:05:10.454298 21584 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.567s	user 0.017s	sys 0.021s
W20260709 13:05:10.454713 21584 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.570s	user 0.018s	sys 0.021s
I20260709 13:05:10.456419 21717 leader_election.cc:290] T 2725d2c4cb054f18b0fc8f735c15f6c2 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 5 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
W20260709 13:05:10.190059 19449 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.1:40321, user_credentials={real_user=slave}} blocked reactor thread for 338235us
I20260709 13:05:10.498201 19407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2725d2c4cb054f18b0fc8f735c15f6c2" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
I20260709 13:05:10.499063 19407 raft_consensus.cc:2393] T 2725d2c4cb054f18b0fc8f735c15f6c2 P e5256d91808b47c195bc9b4dbd7f2b87 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 0473d2b2d01f4459b1e90fd12cc7840e in current term 5: Already voted for candidate e5256d91808b47c195bc9b4dbd7f2b87 in this term.
W20260709 13:05:10.504392 19450 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:10.505095 19551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70797e5783b5454ab0d0eea663e791e3" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:05:10.505832 19551 raft_consensus.cc:3060] T 70797e5783b5454ab0d0eea663e791e3 P e61c3a8f61bb48f8a963c9480e53c168 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:05:10.521073 19449 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:05:10.535272 19451 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:05:10.569072 19375 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.3:36891, user_credentials={real_user=slave}} blocked reactor thread for 46039.5us
W20260709 13:05:10.653647 20078 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.2:46257, user_credentials={real_user=slave}} blocked reactor thread for 170451us
I20260709 13:05:10.670234 18300 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:05:10.702564 19551 raft_consensus.cc:2468] T 70797e5783b5454ab0d0eea663e791e3 P e61c3a8f61bb48f8a963c9480e53c168 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 6.
I20260709 13:05:10.649057 21710 raft_consensus.cc:493] T 3e1f505cb0f1427bbd698ac889d80821 P e5256d91808b47c195bc9b4dbd7f2b87 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader e61c3a8f61bb48f8a963c9480e53c168)
I20260709 13:05:10.671597 21731 raft_consensus.cc:3060] T 76cb037fc9064d13b59a8969d897ce8c P 0473d2b2d01f4459b1e90fd12cc7840e [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:05:10.682469 21636 raft_consensus.cc:493] T ab43d85f64114d4ebf618930e43d9ed0 P e5256d91808b47c195bc9b4dbd7f2b87 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader e61c3a8f61bb48f8a963c9480e53c168)
I20260709 13:05:10.724074 21700 raft_consensus.cc:3055] T fa8650e71aa14778b3d73721fc50d9fc P 0473d2b2d01f4459b1e90fd12cc7840e [term 5 LEADER]: Stepping down as leader of term 5
W20260709 13:05:10.742188 21415 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.722s	user 0.001s	sys 0.010s
I20260709 13:05:10.709543 21790 raft_consensus.cc:493] T 7f575b143b844aa096b50997dad3516a P 0473d2b2d01f4459b1e90fd12cc7840e [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e5256d91808b47c195bc9b4dbd7f2b87)
W20260709 13:05:10.771944 19375 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.3:36891, user_credentials={real_user=slave}} blocked reactor thread for 130651us
I20260709 13:05:10.773201 21790 raft_consensus.cc:515] T 7f575b143b844aa096b50997dad3516a P 0473d2b2d01f4459b1e90fd12cc7840e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:10.776186 21790 leader_election.cc:290] T 7f575b143b844aa096b50997dad3516a P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
W20260709 13:05:10.743834 21778 log.cc:927] Time spent T 14935b3ddf914369822e4a0547aaa355 P e61c3a8f61bb48f8a963c9480e53c168: Append to log took a long time: real 0.073s	user 0.001s	sys 0.000s
W20260709 13:05:10.777504 21415 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.765s	user 0.002s	sys 0.010s
W20260709 13:05:10.788973 19451 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:10.796460 19409 raft_consensus.cc:1275] T 5ec1c4ce15e04c7e8c283a62179f2a64 P e5256d91808b47c195bc9b4dbd7f2b87 [term 3 FOLLOWER]: Refusing update from remote peer 127766fc592545a4997f7790f50f6076: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:05:10.812508 21411 raft_consensus.cc:993] T 40e1e16737a842ee936002830f36882e P e5256d91808b47c195bc9b4dbd7f2b87: : Instructing follower e61c3a8f61bb48f8a963c9480e53c168 to start an election
I20260709 13:05:10.740298 21701 raft_consensus.cc:493] T ff9b0eddd810459b82d91c60777c10eb P e5256d91808b47c195bc9b4dbd7f2b87 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 127766fc592545a4997f7790f50f6076)
W20260709 13:05:10.763195 21775 log.cc:927] Time spent T 1a61655d99124a29b486ba4a5b37faea P e5256d91808b47c195bc9b4dbd7f2b87: Append to log took a long time: real 0.055s	user 0.000s	sys 0.001s
I20260709 13:05:10.826810 21701 raft_consensus.cc:515] T ff9b0eddd810459b82d91c60777c10eb P e5256d91808b47c195bc9b4dbd7f2b87 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:05:10.841936 21701 leader_election.cc:290] T ff9b0eddd810459b82d91c60777c10eb P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:05:10.772151 21700 raft_consensus.cc:740] T fa8650e71aa14778b3d73721fc50d9fc P 0473d2b2d01f4459b1e90fd12cc7840e [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 0473d2b2d01f4459b1e90fd12cc7840e, State: Running, Role: LEADER
I20260709 13:05:10.810514 21767 raft_consensus.cc:3060] T 5ec1c4ce15e04c7e8c283a62179f2a64 P 0473d2b2d01f4459b1e90fd12cc7840e [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:10.852228 21827 raft_consensus.cc:493] T 0cdf56e38bbc453d9438d359e5a69955 P e61c3a8f61bb48f8a963c9480e53c168 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:10.852803 21827 raft_consensus.cc:515] T 0cdf56e38bbc453d9438d359e5a69955 P e61c3a8f61bb48f8a963c9480e53c168 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:10.853178 21835 raft_consensus.cc:493] T 1f85fc4b527a48848e5faa083b604e36 P 0473d2b2d01f4459b1e90fd12cc7840e [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e5256d91808b47c195bc9b4dbd7f2b87)
I20260709 13:05:10.853752 21835 raft_consensus.cc:515] T 1f85fc4b527a48848e5faa083b604e36 P 0473d2b2d01f4459b1e90fd12cc7840e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:05:10.855114 21827 leader_election.cc:290] T 0cdf56e38bbc453d9438d359e5a69955 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:05:10.855837 21835 leader_election.cc:290] T 1f85fc4b527a48848e5faa083b604e36 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:05:10.856312 21835 raft_consensus.cc:493] T 309c3ca0ca4b4f3ba129752ea2cb293b P 0473d2b2d01f4459b1e90fd12cc7840e [term 5 FOLLOWER]: Starting pre-election (detected failure of leader e5256d91808b47c195bc9b4dbd7f2b87)
I20260709 13:05:10.856777 21835 raft_consensus.cc:515] T 309c3ca0ca4b4f3ba129752ea2cb293b P 0473d2b2d01f4459b1e90fd12cc7840e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } attrs { replace: true } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:05:10.859346 21790 raft_consensus.cc:493] T 0cdf56e38bbc453d9438d359e5a69955 P 0473d2b2d01f4459b1e90fd12cc7840e [term 5 FOLLOWER]: Starting pre-election (detected failure of leader e61c3a8f61bb48f8a963c9480e53c168)
I20260709 13:05:10.859705 21559 raft_consensus.cc:493] T ff75a1d4cb1f493db8f71ddc136ba9ab P e61c3a8f61bb48f8a963c9480e53c168 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 0473d2b2d01f4459b1e90fd12cc7840e)
I20260709 13:05:10.860273 21559 raft_consensus.cc:515] T ff75a1d4cb1f493db8f71ddc136ba9ab P e61c3a8f61bb48f8a963c9480e53c168 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:10.859882 21790 raft_consensus.cc:515] T 0cdf56e38bbc453d9438d359e5a69955 P 0473d2b2d01f4459b1e90fd12cc7840e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:10.862502 21790 leader_election.cc:290] T 0cdf56e38bbc453d9438d359e5a69955 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:05:10.859759 21835 leader_election.cc:290] T 309c3ca0ca4b4f3ba129752ea2cb293b P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
W20260709 13:05:10.867201 20078 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.2:46257, user_credentials={real_user=slave}} blocked reactor thread for 212458us
I20260709 13:05:10.868636 21536 raft_consensus.cc:493] T f93ee515a9c14139bf566522ed8232f3 P e5256d91808b47c195bc9b4dbd7f2b87 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader e61c3a8f61bb48f8a963c9480e53c168)
I20260709 13:05:10.869396 21810 raft_consensus.cc:493] T 85c494af21f9457a85da47b9bc70c1fd P 127766fc592545a4997f7790f50f6076 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e5256d91808b47c195bc9b4dbd7f2b87)
I20260709 13:05:10.869199 21536 raft_consensus.cc:515] T f93ee515a9c14139bf566522ed8232f3 P e5256d91808b47c195bc9b4dbd7f2b87 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:10.869894 21810 raft_consensus.cc:515] T 85c494af21f9457a85da47b9bc70c1fd P 127766fc592545a4997f7790f50f6076 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:05:10.871340 21536 leader_election.cc:290] T f93ee515a9c14139bf566522ed8232f3 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:05:10.872157 21808 raft_consensus.cc:493] T 309c3ca0ca4b4f3ba129752ea2cb293b P 127766fc592545a4997f7790f50f6076 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader e5256d91808b47c195bc9b4dbd7f2b87)
I20260709 13:05:10.872606 21554 raft_consensus.cc:493] T 2725d2c4cb054f18b0fc8f735c15f6c2 P e5256d91808b47c195bc9b4dbd7f2b87 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:10.872797 19557 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40428 (request call id 1816) took 1426 ms. Trace:
I20260709 13:05:10.872715 21808 raft_consensus.cc:515] T 309c3ca0ca4b4f3ba129752ea2cb293b P 127766fc592545a4997f7790f50f6076 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } attrs { replace: true } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:05:10.873126 21554 raft_consensus.cc:515] T 2725d2c4cb054f18b0fc8f735c15f6c2 P e5256d91808b47c195bc9b4dbd7f2b87 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:10.873418 19557 rpcz_store.cc:276] 0709 13:05:09.452907 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:09.460476 (+  7569us) service_pool.cc:224] Handling call
0709 13:05:09.460863 (+   387us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:05:09.524525 (+ 63662us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:10.872565 (+1348040us) spinlock_profiling.cc:243] Waited 63 ms on lock 0x7b5400342454. stack: 00007f4a79de9343 00007f4a79de9240 00007f4a797781d4 00007f4a834b6304 00007f4a834b6299 00007f4a7ce71571 00007f4a7cf08e01 00007f4a7cf0783e 00007f4a81ecc419 00007f4a7b443bd4 00007f4a7b443b62 00007f4a7b443a91 00007f4a7b443a0c 00007f4a7b442cc2 00007f4a7b24348c 00007f4a7b2428c6
0709 13:05:10.872735 (+   170us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":144848128}
I20260709 13:05:10.875149 21535 raft_consensus.cc:493] T ece3db938bc649d4a40a51522ed5259c P e5256d91808b47c195bc9b4dbd7f2b87 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 127766fc592545a4997f7790f50f6076)
I20260709 13:05:10.875715 21535 raft_consensus.cc:515] T ece3db938bc649d4a40a51522ed5259c P e5256d91808b47c195bc9b4dbd7f2b87 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:05:10.876287 21411 raft_consensus.cc:1081] T 40e1e16737a842ee936002830f36882e P e5256d91808b47c195bc9b4dbd7f2b87 [term 6 LEADER]: Signalling peer e61c3a8f61bb48f8a963c9480e53c168 to start an election
I20260709 13:05:10.877754 21535 leader_election.cc:290] T ece3db938bc649d4a40a51522ed5259c P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:05:10.879491 19481 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58286 (request call id 1416) took 1103 ms. Trace:
I20260709 13:05:10.862370 21559 leader_election.cc:290] T ff75a1d4cb1f493db8f71ddc136ba9ab P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:05:10.755832 21710 raft_consensus.cc:515] T 3e1f505cb0f1427bbd698ac889d80821 P e5256d91808b47c195bc9b4dbd7f2b87 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:10.879901 19481 rpcz_store.cc:276] 0709 13:05:09.775721 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:09.775854 (+   133us) service_pool.cc:224] Handling call
0709 13:05:10.879348 (+1103494us) spinlock_profiling.cc:243] Waited 143 ms on lock 0x7b5400310954. stack: 00007f4a79de9343 00007f4a79de9240 00007f4a797781d4 00007f4a834b6304 00007f4a834b6299 00007f4a7ce71571 00007f4a7cf0c2fa 00007f4a81ecdb17 00007f4a7b4486d4 00007f4a7b448662 00007f4a7b448591 00007f4a7b44850c 00007f4a7b4477c2 00007f4a7b24348c 00007f4a7b2428c6 00007f4a7b24226f
0709 13:05:10.879438 (+    90us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":329898880}
I20260709 13:05:10.900205 19480 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58294 (request call id 1559) took 1104 ms. Trace:
I20260709 13:05:10.900745 19480 rpcz_store.cc:276] 0709 13:05:09.795976 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:09.796670 (+   694us) service_pool.cc:224] Handling call
0709 13:05:09.797024 (+   354us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:09.797290 (+   266us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:05:09.885059 (+ 87769us) log.cc:844] Serialized 14 byte log entry
0709 13:05:10.265306 (+380247us) log.cc:844] Serialized 14 byte log entry
0709 13:05:10.899646 (+634340us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:05:10.899701 (+    55us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:05:10.899754 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:10.900002 (+   248us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:10.900144 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":499052,"prepare.queue_time_us":512819,"prepare.run_cpu_time_us":35,"prepare.run_wall_time_us":34,"raft.queue_time_us":619884,"raft.run_cpu_time_us":298,"raft.run_wall_time_us":28400,"thread_start_us":453153,"threads_started":2}
I20260709 13:05:10.844535 21644 raft_consensus.cc:493] T 4af19371ea874c09a0a2147040835cbb P e5256d91808b47c195bc9b4dbd7f2b87 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 127766fc592545a4997f7790f50f6076)
I20260709 13:05:10.881754 21536 raft_consensus.cc:493] T 65d8cb8d6ec64f459d5a47cefab10acf P e5256d91808b47c195bc9b4dbd7f2b87 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e61c3a8f61bb48f8a963c9480e53c168)
I20260709 13:05:10.788163 21636 raft_consensus.cc:515] T ab43d85f64114d4ebf618930e43d9ed0 P e5256d91808b47c195bc9b4dbd7f2b87 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } attrs { replace: true } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:05:10.944487 19557 raft_consensus.cc:1275] T 2e36a9d6e29c4a7c860cf267efbd4c74 P e61c3a8f61bb48f8a963c9480e53c168 [term 4 FOLLOWER]: Refusing update from remote peer 0473d2b2d01f4459b1e90fd12cc7840e: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:05:10.944965 21816 raft_consensus.cc:493] T d1e5873a19244c5ebbcd38e126796ee7 P e5256d91808b47c195bc9b4dbd7f2b87 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 0473d2b2d01f4459b1e90fd12cc7840e)
I20260709 13:05:10.945092 21828 raft_consensus.cc:493] T 46c5bfeecc314717bffe987e6844b6d0 P e5256d91808b47c195bc9b4dbd7f2b87 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader e61c3a8f61bb48f8a963c9480e53c168)
I20260709 13:05:10.945243 21836 raft_consensus.cc:493] T f1b10566f45d4a7d9029858330e02d5b P e5256d91808b47c195bc9b4dbd7f2b87 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 0473d2b2d01f4459b1e90fd12cc7840e)
I20260709 13:05:10.946146 21836 raft_consensus.cc:515] T f1b10566f45d4a7d9029858330e02d5b P e5256d91808b47c195bc9b4dbd7f2b87 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:10.937805 21559 raft_consensus.cc:493] T 1efebf73c86e432baa55533136b6e12c P e61c3a8f61bb48f8a963c9480e53c168 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 127766fc592545a4997f7790f50f6076)
I20260709 13:05:10.950534 21559 raft_consensus.cc:515] T 1efebf73c86e432baa55533136b6e12c P e61c3a8f61bb48f8a963c9480e53c168 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
W20260709 13:05:10.953518 19375 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.3:36891, user_credentials={real_user=slave}} blocked reactor thread for 158754us
I20260709 13:05:10.954487 19375 leader_election.cc:304] T 70797e5783b5454ab0d0eea663e791e3 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
W20260709 13:05:10.935485 21778 log.cc:927] Time spent T 14935b3ddf914369822e4a0547aaa355 P e61c3a8f61bb48f8a963c9480e53c168: Append to log took a long time: real 0.052s	user 0.001s	sys 0.000s
I20260709 13:05:10.898286 21622 raft_consensus.cc:493] T ab43d85f64114d4ebf618930e43d9ed0 P 0473d2b2d01f4459b1e90fd12cc7840e [term 5 FOLLOWER]: Starting pre-election (detected failure of leader e61c3a8f61bb48f8a963c9480e53c168)
I20260709 13:05:10.908360 21835 raft_consensus.cc:493] T ef32ce6fdd0e40d382c79974f30295c6 P 0473d2b2d01f4459b1e90fd12cc7840e [term 5 FOLLOWER]: Starting pre-election (detected failure of leader e61c3a8f61bb48f8a963c9480e53c168)
I20260709 13:05:10.945508 21816 raft_consensus.cc:515] T d1e5873a19244c5ebbcd38e126796ee7 P e5256d91808b47c195bc9b4dbd7f2b87 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:10.945127 21720 raft_consensus.cc:493] T bc225c93219c45538b53a1bd3d387e4d P e5256d91808b47c195bc9b4dbd7f2b87 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 0473d2b2d01f4459b1e90fd12cc7840e)
I20260709 13:05:10.937724 21742 raft_consensus.cc:493] T 2b74109013a140ada21feeef92d6f563 P e61c3a8f61bb48f8a963c9480e53c168 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 0473d2b2d01f4459b1e90fd12cc7840e)
I20260709 13:05:10.937902 21829 raft_consensus.cc:493] T ef32ce6fdd0e40d382c79974f30295c6 P e5256d91808b47c195bc9b4dbd7f2b87 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader e61c3a8f61bb48f8a963c9480e53c168)
I20260709 13:05:11.045872 21684 raft_consensus.cc:493] T d1e5873a19244c5ebbcd38e126796ee7 P e61c3a8f61bb48f8a963c9480e53c168 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 0473d2b2d01f4459b1e90fd12cc7840e)
I20260709 13:05:11.046450 21834 raft_consensus.cc:493] T 70797e5783b5454ab0d0eea663e791e3 P 127766fc592545a4997f7790f50f6076 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:11.018512 21411 raft_consensus.cc:2804] T 70797e5783b5454ab0d0eea663e791e3 P e5256d91808b47c195bc9b4dbd7f2b87 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:05:11.049885 21710 leader_election.cc:290] T 3e1f505cb0f1427bbd698ac889d80821 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:05:10.939889 21644 raft_consensus.cc:515] T 4af19371ea874c09a0a2147040835cbb P e5256d91808b47c195bc9b4dbd7f2b87 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:05:10.946624 21536 raft_consensus.cc:515] T 65d8cb8d6ec64f459d5a47cefab10acf P e5256d91808b47c195bc9b4dbd7f2b87 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:05:10.945762 21828 raft_consensus.cc:515] T 46c5bfeecc314717bffe987e6844b6d0 P e5256d91808b47c195bc9b4dbd7f2b87 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:11.124374 18300 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 13:05:11.759093 19449 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.4:43121, user_credentials={real_user=slave}} blocked reactor thread for 868912us
I20260709 13:05:11.773307 19483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cdf56e38bbc453d9438d359e5a69955" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:05:11.774120 19483 raft_consensus.cc:2468] T 0cdf56e38bbc453d9438d359e5a69955 P 0473d2b2d01f4459b1e90fd12cc7840e [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 5.
I20260709 13:05:11.775122 21842 raft_consensus.cc:493] T 775c229504194560ba9589bc2199b089 P 127766fc592545a4997f7790f50f6076 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 0473d2b2d01f4459b1e90fd12cc7840e)
I20260709 13:05:11.775835 21842 raft_consensus.cc:515] T 775c229504194560ba9589bc2199b089 P 127766fc592545a4997f7790f50f6076 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:05:11.759714 20112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70797e5783b5454ab0d0eea663e791e3" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
W20260709 13:05:11.467738 19526 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.17.223.2:46257 timed out after 1.512s (SENT) [suppressed 4 similar messages]
I20260709 13:05:10.951934 21836 leader_election.cc:290] T f1b10566f45d4a7d9029858330e02d5b P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:05:10.974805 21700 consensus_queue.cc:260] T fa8650e71aa14778b3d73721fc50d9fc P 0473d2b2d01f4459b1e90fd12cc7840e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:10.982563 21554 leader_election.cc:290] T 2725d2c4cb054f18b0fc8f735c15f6c2 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
W20260709 13:05:11.754197 21800 log.cc:927] Time spent T bc225c93219c45538b53a1bd3d387e4d P 0473d2b2d01f4459b1e90fd12cc7840e: Append to log took a long time: real 0.203s	user 0.000s	sys 0.000s
I20260709 13:05:11.862567 19479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff75a1d4cb1f493db8f71ddc136ba9ab" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
W20260709 13:05:11.596953 21525 consensus_meta.cc:287] T 172b3dd13109415a955b71ac0e9d2234 P 0473d2b2d01f4459b1e90fd12cc7840e: Time spent flushing consensus metadata: real 1.143s	user 0.011s	sys 0.000s
I20260709 13:05:11.819820 19555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "309c3ca0ca4b4f3ba129752ea2cb293b" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:05:11.051134 21733 raft_consensus.cc:493] T 5ec1c4ce15e04c7e8c283a62179f2a64 P 0473d2b2d01f4459b1e90fd12cc7840e [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:11.811597 20111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ece3db938bc649d4a40a51522ed5259c" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:05:11.054961 21720 raft_consensus.cc:515] T bc225c93219c45538b53a1bd3d387e4d P e5256d91808b47c195bc9b4dbd7f2b87 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:11.872392 21720 leader_election.cc:290] T bc225c93219c45538b53a1bd3d387e4d P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:05:11.814175 21832 raft_consensus.cc:493] T ff75a1d4cb1f493db8f71ddc136ba9ab P e5256d91808b47c195bc9b4dbd7f2b87 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 0473d2b2d01f4459b1e90fd12cc7840e)
I20260709 13:05:11.873746 21559 leader_election.cc:290] T 1efebf73c86e432baa55533136b6e12c P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:05:11.874570 21833 raft_consensus.cc:493] T 6c5eebf646ad445a9d1b1adc319d7b16 P e61c3a8f61bb48f8a963c9480e53c168 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 127766fc592545a4997f7790f50f6076)
I20260709 13:05:11.873842 21842 leader_election.cc:290] T 775c229504194560ba9589bc2199b089 P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:05:11.875118 21833 raft_consensus.cc:515] T 6c5eebf646ad445a9d1b1adc319d7b16 P e61c3a8f61bb48f8a963c9480e53c168 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:05:11.876015 21559 raft_consensus.cc:493] T bc225c93219c45538b53a1bd3d387e4d P e61c3a8f61bb48f8a963c9480e53c168 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:11.876462 21810 leader_election.cc:290] T 85c494af21f9457a85da47b9bc70c1fd P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:05:11.876977 21810 raft_consensus.cc:493] T 62c6c134d3d24a1ab144dd9ee6bc3f64 P 127766fc592545a4997f7790f50f6076 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader e61c3a8f61bb48f8a963c9480e53c168)
I20260709 13:05:11.868175 21793 raft_consensus.cc:493] T 86a6797bdfe94fa496c050ceae4bd0d9 P 0473d2b2d01f4459b1e90fd12cc7840e [term 4 FOLLOWER]: Starting pre-election (detected failure of leader e61c3a8f61bb48f8a963c9480e53c168)
I20260709 13:05:11.877624 21833 leader_election.cc:290] T 6c5eebf646ad445a9d1b1adc319d7b16 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:05:11.087070 21801 raft_consensus.cc:493] T 2725d2c4cb054f18b0fc8f735c15f6c2 P e61c3a8f61bb48f8a963c9480e53c168 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:11.874271 21832 raft_consensus.cc:515] T ff75a1d4cb1f493db8f71ddc136ba9ab P e5256d91808b47c195bc9b4dbd7f2b87 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:11.877527 21810 raft_consensus.cc:515] T 62c6c134d3d24a1ab144dd9ee6bc3f64 P 127766fc592545a4997f7790f50f6076 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
W20260709 13:05:11.812745 21731 consensus_meta.cc:287] T 76cb037fc9064d13b59a8969d897ce8c P 0473d2b2d01f4459b1e90fd12cc7840e: Time spent flushing consensus metadata: real 1.057s	user 0.009s	sys 0.000s
I20260709 13:05:11.565699 21830 raft_consensus.cc:493] T 0afb57ae58a24a01850491d69f0213dd P 127766fc592545a4997f7790f50f6076 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader e61c3a8f61bb48f8a963c9480e53c168)
W20260709 13:05:11.892951 19375 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.3:36891, user_credentials={real_user=slave}} blocked reactor thread for 881421us
I20260709 13:05:11.084331 21803 raft_consensus.cc:493] T 65d8cb8d6ec64f459d5a47cefab10acf P 127766fc592545a4997f7790f50f6076 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e61c3a8f61bb48f8a963c9480e53c168)
I20260709 13:05:11.792502 21834 raft_consensus.cc:515] T 70797e5783b5454ab0d0eea663e791e3 P 127766fc592545a4997f7790f50f6076 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:05:11.895684 20112 raft_consensus.cc:2468] T 70797e5783b5454ab0d0eea663e791e3 P 127766fc592545a4997f7790f50f6076 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 5.
I20260709 13:05:11.217072 21802 raft_consensus.cc:493] T 14935b3ddf914369822e4a0547aaa355 P 127766fc592545a4997f7790f50f6076 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader e5256d91808b47c195bc9b4dbd7f2b87)
I20260709 13:05:11.466634 20104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70797e5783b5454ab0d0eea663e791e3" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076"
W20260709 13:05:11.887867 20075 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.1:40321, user_credentials={real_user=slave}} blocked reactor thread for 123828us
I20260709 13:05:11.896927 21834 leader_election.cc:290] T 70797e5783b5454ab0d0eea663e791e3 P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:05:11.889911 21554 raft_consensus.cc:493] T 2b74109013a140ada21feeef92d6f563 P e5256d91808b47c195bc9b4dbd7f2b87 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 0473d2b2d01f4459b1e90fd12cc7840e)
I20260709 13:05:11.897486 21834 consensus_queue.cc:1048] T 5ec1c4ce15e04c7e8c283a62179f2a64 P 127766fc592545a4997f7790f50f6076 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:05:11.805586 21816 leader_election.cc:290] T d1e5873a19244c5ebbcd38e126796ee7 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:05:10.993584 21835 raft_consensus.cc:515] T ef32ce6fdd0e40d382c79974f30295c6 P 0473d2b2d01f4459b1e90fd12cc7840e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:11.717409 21636 leader_election.cc:290] T ab43d85f64114d4ebf618930e43d9ed0 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:05:11.896497 21802 raft_consensus.cc:515] T 14935b3ddf914369822e4a0547aaa355 P 127766fc592545a4997f7790f50f6076 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } attrs { replace: true } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:05:11.890704 21813 raft_consensus.cc:493] T 0cdf56e38bbc453d9438d359e5a69955 P e5256d91808b47c195bc9b4dbd7f2b87 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:11.862731 21644 leader_election.cc:290] T 4af19371ea874c09a0a2147040835cbb P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:05:11.797250 21823 raft_consensus.cc:493] T 179fd671030940b4b4a4e24bcc4aba0a P e5256d91808b47c195bc9b4dbd7f2b87 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 0473d2b2d01f4459b1e90fd12cc7840e)
I20260709 13:05:11.815068 21411 raft_consensus.cc:697] T 70797e5783b5454ab0d0eea663e791e3 P e5256d91808b47c195bc9b4dbd7f2b87 [term 6 LEADER]: Becoming Leader. State: Replica: e5256d91808b47c195bc9b4dbd7f2b87, State: Running, Role: LEADER
I20260709 13:05:11.797341 21701 raft_consensus.cc:493] T 28af091831594f9d8e96482078cc7625 P e5256d91808b47c195bc9b4dbd7f2b87 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 0473d2b2d01f4459b1e90fd12cc7840e)
I20260709 13:05:11.463555 20106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff9b0eddd810459b82d91c60777c10eb" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:05:11.877591 21825 raft_consensus.cc:493] T 76cb037fc9064d13b59a8969d897ce8c P e61c3a8f61bb48f8a963c9480e53c168 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 0473d2b2d01f4459b1e90fd12cc7840e)
I20260709 13:05:11.797555 21710 raft_consensus.cc:493] T b08304a0a02b42d7840c4e8ee9a6bd1a P e5256d91808b47c195bc9b4dbd7f2b87 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 0473d2b2d01f4459b1e90fd12cc7840e)
W20260709 13:05:11.867041 21415 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.875s	user 0.011s	sys 0.010s
I20260709 13:05:11.891698 21836 raft_consensus.cc:493] T edd7d470b5014c9489be7f41f64355c9 P e5256d91808b47c195bc9b4dbd7f2b87 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 0473d2b2d01f4459b1e90fd12cc7840e)
I20260709 13:05:11.817891 21828 leader_election.cc:290] T 46c5bfeecc314717bffe987e6844b6d0 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:05:11.813024 21839 raft_consensus.cc:493] T 86a6797bdfe94fa496c050ceae4bd0d9 P e5256d91808b47c195bc9b4dbd7f2b87 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader e61c3a8f61bb48f8a963c9480e53c168)
I20260709 13:05:11.887840 21700 raft_consensus.cc:3060] T fa8650e71aa14778b3d73721fc50d9fc P 0473d2b2d01f4459b1e90fd12cc7840e [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:05:10.993330 21622 raft_consensus.cc:515] T ab43d85f64114d4ebf618930e43d9ed0 P 0473d2b2d01f4459b1e90fd12cc7840e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } attrs { replace: true } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:05:11.053066 21742 raft_consensus.cc:515] T 2b74109013a140ada21feeef92d6f563 P e61c3a8f61bb48f8a963c9480e53c168 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:11.884783 21705 raft_consensus.cc:493] T 2a16f7501e2444fb86d4e2778e734e02 P e5256d91808b47c195bc9b4dbd7f2b87 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 127766fc592545a4997f7790f50f6076)
W20260709 13:05:11.921727 21415 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.930s	user 0.011s	sys 0.010s
I20260709 13:05:11.909390 21838 raft_consensus.cc:493] T 85c494af21f9457a85da47b9bc70c1fd P e61c3a8f61bb48f8a963c9480e53c168 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e5256d91808b47c195bc9b4dbd7f2b87)
I20260709 13:05:11.792990 21684 raft_consensus.cc:515] T d1e5873a19244c5ebbcd38e126796ee7 P e61c3a8f61bb48f8a963c9480e53c168 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:11.897693 21554 raft_consensus.cc:515] T 2b74109013a140ada21feeef92d6f563 P e5256d91808b47c195bc9b4dbd7f2b87 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:11.914114 19404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70797e5783b5454ab0d0eea663e791e3" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:05:11.878067 21793 raft_consensus.cc:515] T 86a6797bdfe94fa496c050ceae4bd0d9 P 0473d2b2d01f4459b1e90fd12cc7840e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:11.913043 19406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "309c3ca0ca4b4f3ba129752ea2cb293b" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:05:11.917342 19407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85c494af21f9457a85da47b9bc70c1fd" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:05:11.898779 21812 raft_consensus.cc:493] T ece3db938bc649d4a40a51522ed5259c P e61c3a8f61bb48f8a963c9480e53c168 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 127766fc592545a4997f7790f50f6076)
I20260709 13:05:11.876799 21559 raft_consensus.cc:515] T bc225c93219c45538b53a1bd3d387e4d P e61c3a8f61bb48f8a963c9480e53c168 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
W20260709 13:05:11.918160 19526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.2:46257, user_credentials={real_user=slave}} blocked reactor thread for 450442us
I20260709 13:05:11.901991 21803 raft_consensus.cc:515] T 65d8cb8d6ec64f459d5a47cefab10acf P 127766fc592545a4997f7790f50f6076 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:05:11.921541 19409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "775c229504194560ba9589bc2199b089" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:05:11.887491 21733 raft_consensus.cc:515] T 5ec1c4ce15e04c7e8c283a62179f2a64 P 0473d2b2d01f4459b1e90fd12cc7840e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:05:11.906661 21826 raft_consensus.cc:493] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P 0473d2b2d01f4459b1e90fd12cc7840e [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 127766fc592545a4997f7790f50f6076)
I20260709 13:05:11.792829 21829 raft_consensus.cc:515] T ef32ce6fdd0e40d382c79974f30295c6 P e5256d91808b47c195bc9b4dbd7f2b87 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:11.878589 21801 raft_consensus.cc:515] T 2725d2c4cb054f18b0fc8f735c15f6c2 P e61c3a8f61bb48f8a963c9480e53c168 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
W20260709 13:05:12.006083 19451 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:11.944571 21828 raft_consensus.cc:493] T 76cb037fc9064d13b59a8969d897ce8c P e5256d91808b47c195bc9b4dbd7f2b87 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:11.925225 21644 raft_consensus.cc:493] T 217b5fae677b4971b3bbd2f357a1f7ff P e5256d91808b47c195bc9b4dbd7f2b87 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 0473d2b2d01f4459b1e90fd12cc7840e)
I20260709 13:05:11.942806 21584 raft_consensus.cc:493] T 1dc5b3532fe54f74876d02beffa2c230 P 0473d2b2d01f4459b1e90fd12cc7840e [term 3 FOLLOWER]: Starting pre-election (detected failure of leader e5256d91808b47c195bc9b4dbd7f2b87)
I20260709 13:05:12.024592 20110 raft_consensus.cc:2955] T 14935b3ddf914369822e4a0547aaa355 P 127766fc592545a4997f7790f50f6076 [term 4 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 2 to 4, 127766fc592545a4997f7790f50f6076 (127.17.223.4) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } attrs { replace: true } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } } }
I20260709 13:05:11.996235 21705 raft_consensus.cc:515] T 2a16f7501e2444fb86d4e2778e734e02 P e5256d91808b47c195bc9b4dbd7f2b87 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:05:11.920382 21823 raft_consensus.cc:515] T 179fd671030940b4b4a4e24bcc4aba0a P e5256d91808b47c195bc9b4dbd7f2b87 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:11.931751 21846 raft_consensus.cc:493] T e381f1d6b8184797ad142de49be225a8 P e5256d91808b47c195bc9b4dbd7f2b87 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 0473d2b2d01f4459b1e90fd12cc7840e)
I20260709 13:05:12.039499 21742 leader_election.cc:290] T 2b74109013a140ada21feeef92d6f563 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
W20260709 13:05:11.921217 19450 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:12.041991 21622 leader_election.cc:290] T ab43d85f64114d4ebf618930e43d9ed0 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:05:12.045033 19409 raft_consensus.cc:2468] T 775c229504194560ba9589bc2199b089 P e5256d91808b47c195bc9b4dbd7f2b87 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 127766fc592545a4997f7790f50f6076 in term 3.
I20260709 13:05:11.923254 21825 raft_consensus.cc:515] T 76cb037fc9064d13b59a8969d897ce8c P e61c3a8f61bb48f8a963c9480e53c168 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:11.920768 21701 raft_consensus.cc:515] T 28af091831594f9d8e96482078cc7625 P e5256d91808b47c195bc9b4dbd7f2b87 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:11.998236 21767 raft_consensus.cc:493] T 172b3dd13109415a955b71ac0e9d2234 P 0473d2b2d01f4459b1e90fd12cc7840e [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:11.959854 21731 raft_consensus.cc:493] T 0afb57ae58a24a01850491d69f0213dd P 0473d2b2d01f4459b1e90fd12cc7840e [term 5 FOLLOWER]: Starting pre-election (detected failure of leader e61c3a8f61bb48f8a963c9480e53c168)
I20260709 13:05:12.095613 21817 raft_consensus.cc:493] T 46c5bfeecc314717bffe987e6844b6d0 P 0473d2b2d01f4459b1e90fd12cc7840e [term 9 FOLLOWER]: Starting pre-election (detected failure of leader e61c3a8f61bb48f8a963c9480e53c168)
I20260709 13:05:11.918144 21813 raft_consensus.cc:515] T 0cdf56e38bbc453d9438d359e5a69955 P e5256d91808b47c195bc9b4dbd7f2b87 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:12.150441 20075 leader_election.cc:304] T 775c229504194560ba9589bc2199b089 P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 127766fc592545a4997f7790f50f6076, e5256d91808b47c195bc9b4dbd7f2b87; no voters: 
I20260709 13:05:12.163832 19486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f93ee515a9c14139bf566522ed8232f3" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 8 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:05:11.932009 21836 raft_consensus.cc:515] T edd7d470b5014c9489be7f41f64355c9 P e5256d91808b47c195bc9b4dbd7f2b87 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:12.016098 21816 raft_consensus.cc:493] T df751f992649444090e27965eb1af85d P e5256d91808b47c195bc9b4dbd7f2b87 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader e61c3a8f61bb48f8a963c9480e53c168)
I20260709 13:05:12.032913 21636 raft_consensus.cc:493] T 172b3dd13109415a955b71ac0e9d2234 P e5256d91808b47c195bc9b4dbd7f2b87 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:12.039458 21529 raft_consensus.cc:493] T fa8650e71aa14778b3d73721fc50d9fc P e61c3a8f61bb48f8a963c9480e53c168 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:12.026435 21832 leader_election.cc:290] T ff75a1d4cb1f493db8f71ddc136ba9ab P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:05:12.041741 21835 leader_election.cc:290] T ef32ce6fdd0e40d382c79974f30295c6 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:05:12.040618 21536 leader_election.cc:290] T 65d8cb8d6ec64f459d5a47cefab10acf P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:05:12.038408 21525 raft_consensus.cc:493] T 76cb037fc9064d13b59a8969d897ce8c P 0473d2b2d01f4459b1e90fd12cc7840e [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:12.039990 21720 raft_consensus.cc:493] T 7be9efa6559648dbb5a0f7684c4542d1 P e5256d91808b47c195bc9b4dbd7f2b87 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 0473d2b2d01f4459b1e90fd12cc7840e)
I20260709 13:05:11.901125 21830 raft_consensus.cc:515] T 0afb57ae58a24a01850491d69f0213dd P 127766fc592545a4997f7790f50f6076 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
W20260709 13:05:12.093971 21785 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.256s	user 0.016s	sys 0.012s
W20260709 13:05:12.039960 19452 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:12.119776 19485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff9b0eddd810459b82d91c60777c10eb" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:05:11.923249 21710 raft_consensus.cc:515] T b08304a0a02b42d7840c4e8ee9a6bd1a P e5256d91808b47c195bc9b4dbd7f2b87 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:12.024673 21411 consensus_queue.cc:237] T 70797e5783b5454ab0d0eea663e791e3 P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:05:12.136601 21829 leader_election.cc:290] T ef32ce6fdd0e40d382c79974f30295c6 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:05:12.026712 21790 raft_consensus.cc:493] T 14efcc79969f41babe5529c22d59156d P 0473d2b2d01f4459b1e90fd12cc7840e [term 4 FOLLOWER]: Starting pre-election (detected failure of leader e5256d91808b47c195bc9b4dbd7f2b87)
W20260709 13:05:12.160091 19523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.4:43121, user_credentials={real_user=slave}} blocked reactor thread for 332169us
I20260709 13:05:12.095741 21699 raft_consensus.cc:493] T 14935b3ddf914369822e4a0547aaa355 P 0473d2b2d01f4459b1e90fd12cc7840e [term 4 FOLLOWER]: Starting pre-election (detected failure of leader e5256d91808b47c195bc9b4dbd7f2b87)
I20260709 13:05:12.094003 21826 raft_consensus.cc:515] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P 0473d2b2d01f4459b1e90fd12cc7840e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:05:12.182137 19477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1b10566f45d4a7d9029858330e02d5b" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:05:12.164587 19486 raft_consensus.cc:2468] T f93ee515a9c14139bf566522ed8232f3 P 0473d2b2d01f4459b1e90fd12cc7840e [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 7.
I20260709 13:05:12.115437 21834 raft_consensus.cc:493] T 48824d5acfbc485ebf8c2d944e7202de P 127766fc592545a4997f7790f50f6076 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 0473d2b2d01f4459b1e90fd12cc7840e)
I20260709 13:05:12.138367 21845 raft_consensus.cc:493] T 2e36a9d6e29c4a7c860cf267efbd4c74 P e5256d91808b47c195bc9b4dbd7f2b87 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 0473d2b2d01f4459b1e90fd12cc7840e)
I20260709 13:05:12.101747 21828 raft_consensus.cc:515] T 76cb037fc9064d13b59a8969d897ce8c P e5256d91808b47c195bc9b4dbd7f2b87 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:11.943847 21839 raft_consensus.cc:515] T 86a6797bdfe94fa496c050ceae4bd0d9 P e5256d91808b47c195bc9b4dbd7f2b87 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:12.027158 21812 raft_consensus.cc:515] T ece3db938bc649d4a40a51522ed5259c P e61c3a8f61bb48f8a963c9480e53c168 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:05:12.354540 21828 leader_election.cc:290] T 76cb037fc9064d13b59a8969d897ce8c P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:05:12.356590 21812 leader_election.cc:290] T ece3db938bc649d4a40a51522ed5259c P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:05:12.357402 21812 raft_consensus.cc:493] T edd7d470b5014c9489be7f41f64355c9 P e61c3a8f61bb48f8a963c9480e53c168 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:12.358345 21823 leader_election.cc:290] T 179fd671030940b4b4a4e24bcc4aba0a P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:05:12.104709 21644 raft_consensus.cc:515] T 217b5fae677b4971b3bbd2f357a1f7ff P e5256d91808b47c195bc9b4dbd7f2b87 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:11.999720 21838 raft_consensus.cc:515] T 85c494af21f9457a85da47b9bc70c1fd P e61c3a8f61bb48f8a963c9480e53c168 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:05:12.360431 21644 leader_election.cc:290] T 217b5fae677b4971b3bbd2f357a1f7ff P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:05:12.125960 21847 raft_consensus.cc:493] T 172b3dd13109415a955b71ac0e9d2234 P 127766fc592545a4997f7790f50f6076 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0473d2b2d01f4459b1e90fd12cc7840e)
I20260709 13:05:12.360965 21838 leader_election.cc:290] T 85c494af21f9457a85da47b9bc70c1fd P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:05:12.361120 21847 raft_consensus.cc:515] T 172b3dd13109415a955b71ac0e9d2234 P 127766fc592545a4997f7790f50f6076 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
W20260709 13:05:12.322736 19452 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:12.113492 21584 raft_consensus.cc:515] T 1dc5b3532fe54f74876d02beffa2c230 P 0473d2b2d01f4459b1e90fd12cc7840e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
W20260709 13:05:12.298517 21844 log.cc:927] Time spent T 00000000000000000000000000000000 P 97750b77d35444acb7791ebf26cc2685: Append to log took a long time: real 0.224s	user 0.001s	sys 0.000s
I20260709 13:05:12.357950 21812 raft_consensus.cc:515] T edd7d470b5014c9489be7f41f64355c9 P e61c3a8f61bb48f8a963c9480e53c168 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:12.152187 21742 raft_consensus.cc:493] T b9f0d59553ad444883fcf5b5909f9798 P e61c3a8f61bb48f8a963c9480e53c168 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 0473d2b2d01f4459b1e90fd12cc7840e)
W20260709 13:05:12.383527 20076 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.3:36891, user_credentials={real_user=slave}} blocked reactor thread for 55792.7us
I20260709 13:05:12.323107 19486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff75a1d4cb1f493db8f71ddc136ba9ab" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:05:12.334589 19477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc225c93219c45538b53a1bd3d387e4d" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:05:12.224177 21820 raft_consensus.cc:493] T 179fd671030940b4b4a4e24bcc4aba0a P 0473d2b2d01f4459b1e90fd12cc7840e [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:12.387077 19406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14935b3ddf914369822e4a0547aaa355" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:05:12.185894 21810 leader_election.cc:290] T 62c6c134d3d24a1ab144dd9ee6bc3f64 P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:05:12.184605 21849 raft_consensus.cc:493] T 1a61655d99124a29b486ba4a5b37faea P e5256d91808b47c195bc9b4dbd7f2b87 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 0473d2b2d01f4459b1e90fd12cc7840e)
I20260709 13:05:12.340242 19409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65d8cb8d6ec64f459d5a47cefab10acf" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:05:12.399641 19409 raft_consensus.cc:2468] T 65d8cb8d6ec64f459d5a47cefab10acf P e5256d91808b47c195bc9b4dbd7f2b87 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 127766fc592545a4997f7790f50f6076 in term 1.
I20260709 13:05:12.340476 21559 leader_election.cc:290] T bc225c93219c45538b53a1bd3d387e4d P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:05:12.287643 21717 raft_consensus.cc:493] T 4509b76741dc428e9201c70c1658da13 P 0473d2b2d01f4459b1e90fd12cc7840e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e5256d91808b47c195bc9b4dbd7f2b87)
I20260709 13:05:12.178942 21767 raft_consensus.cc:515] T 172b3dd13109415a955b71ac0e9d2234 P 0473d2b2d01f4459b1e90fd12cc7840e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:05:12.344126 21826 leader_election.cc:290] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:05:12.299746 21701 leader_election.cc:290] T 28af091831594f9d8e96482078cc7625 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:05:12.300851 21803 leader_election.cc:290] T 65d8cb8d6ec64f459d5a47cefab10acf P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:05:12.344748 21859 raft_consensus.cc:2804] T 775c229504194560ba9589bc2199b089 P 127766fc592545a4997f7790f50f6076 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:05:12.336031 21699 raft_consensus.cc:515] T 14935b3ddf914369822e4a0547aaa355 P 0473d2b2d01f4459b1e90fd12cc7840e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } attrs { replace: true } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
W20260709 13:05:12.331171 21785 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.537s	user 0.018s	sys 0.013s
I20260709 13:05:12.346457 21802 leader_election.cc:290] T 14935b3ddf914369822e4a0547aaa355 P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:05:12.346931 21834 raft_consensus.cc:515] T 48824d5acfbc485ebf8c2d944e7202de P 127766fc592545a4997f7790f50f6076 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:05:12.352043 21836 leader_election.cc:290] T edd7d470b5014c9489be7f41f64355c9 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:05:12.356624 21825 leader_election.cc:290] T 76cb037fc9064d13b59a8969d897ce8c P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:05:12.323267 19485 raft_consensus.cc:2468] T ff9b0eddd810459b82d91c60777c10eb P 0473d2b2d01f4459b1e90fd12cc7840e [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 4.
I20260709 13:05:12.365307 21835 raft_consensus.cc:493] T 9962423cb4e54fcfa5de01daf68a86e7 P 0473d2b2d01f4459b1e90fd12cc7840e [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 127766fc592545a4997f7790f50f6076)
I20260709 13:05:12.338361 21525 raft_consensus.cc:515] T 76cb037fc9064d13b59a8969d897ce8c P 0473d2b2d01f4459b1e90fd12cc7840e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:12.188133 21703 raft_consensus.cc:493] T f1b10566f45d4a7d9029858330e02d5b P e61c3a8f61bb48f8a963c9480e53c168 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 0473d2b2d01f4459b1e90fd12cc7840e)
I20260709 13:05:12.371470 19555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ece3db938bc649d4a40a51522ed5259c" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:05:12.371942 19559 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "40e1e16737a842ee936002830f36882e"
dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
 from {username='slave'} at 127.0.0.1:40438
I20260709 13:05:12.365446 21845 raft_consensus.cc:515] T 2e36a9d6e29c4a7c860cf267efbd4c74 P e5256d91808b47c195bc9b4dbd7f2b87 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
W20260709 13:05:12.375254 19585 heartbeater.cc:646] Failed to heartbeat to 127.17.223.62:36283 (0 consecutive failures): Timed out: Failed to send heartbeat to master: TSHeartbeat RPC to 127.17.223.62:36283 timed out after 15.000s (SENT)
I20260709 13:05:12.375921 19557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f93ee515a9c14139bf566522ed8232f3" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 8 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:05:12.378080 19481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e1f505cb0f1427bbd698ac889d80821" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:05:12.378830 21850 raft_consensus.cc:493] T fa8650e71aa14778b3d73721fc50d9fc P e5256d91808b47c195bc9b4dbd7f2b87 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 0473d2b2d01f4459b1e90fd12cc7840e)
I20260709 13:05:12.382391 21684 leader_election.cc:290] T d1e5873a19244c5ebbcd38e126796ee7 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:05:12.338917 21720 raft_consensus.cc:515] T 7be9efa6559648dbb5a0f7684c4542d1 P e5256d91808b47c195bc9b4dbd7f2b87 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:12.339428 21863 raft_consensus.cc:493] T 4509b76741dc428e9201c70c1658da13 P e61c3a8f61bb48f8a963c9480e53c168 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e5256d91808b47c195bc9b4dbd7f2b87)
I20260709 13:05:12.390424 19486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef32ce6fdd0e40d382c79974f30295c6" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:05:12.255784 21856 raft_consensus.cc:493] T 22196caba61445d3bec98a0aab3c337d P e5256d91808b47c195bc9b4dbd7f2b87 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader e61c3a8f61bb48f8a963c9480e53c168)
I20260709 13:05:12.262785 21622 raft_consensus.cc:493] T e381f1d6b8184797ad142de49be225a8 P 0473d2b2d01f4459b1e90fd12cc7840e [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:12.366343 21839 leader_election.cc:290] T 86a6797bdfe94fa496c050ceae4bd0d9 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:05:12.397578 21858 consensus_queue.cc:1048] T 48824d5acfbc485ebf8c2d944e7202de P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.008s
I20260709 13:05:12.386941 21718 raft_consensus.cc:493] T 0e1085d23e8347fbbd5bce7542f4b1f4 P 0473d2b2d01f4459b1e90fd12cc7840e [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 127766fc592545a4997f7790f50f6076)
I20260709 13:05:12.405301 21860 raft_consensus.cc:493] T edd7d470b5014c9489be7f41f64355c9 P 0473d2b2d01f4459b1e90fd12cc7840e [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:12.137893 21846 raft_consensus.cc:515] T e381f1d6b8184797ad142de49be225a8 P e5256d91808b47c195bc9b4dbd7f2b87 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:12.406036 19404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f575b143b844aa096b50997dad3516a" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:05:12.406119 19558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1b10566f45d4a7d9029858330e02d5b" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:05:12.406777 20075 leader_election.cc:304] T 65d8cb8d6ec64f459d5a47cefab10acf P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 127766fc592545a4997f7790f50f6076, e5256d91808b47c195bc9b4dbd7f2b87; no voters: 
I20260709 13:05:12.341708 21705 leader_election.cc:290] T 2a16f7501e2444fb86d4e2778e734e02 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:05:12.409243 19477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46c5bfeecc314717bffe987e6844b6d0" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 10 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:05:12.410632 19554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2725d2c4cb054f18b0fc8f735c15f6c2" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:05:12.419828 21854 raft_consensus.cc:493] T 48824d5acfbc485ebf8c2d944e7202de P e61c3a8f61bb48f8a963c9480e53c168 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:12.364784 21832 raft_consensus.cc:493] T b9f0d59553ad444883fcf5b5909f9798 P e5256d91808b47c195bc9b4dbd7f2b87 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 0473d2b2d01f4459b1e90fd12cc7840e)
I20260709 13:05:12.179176 21731 raft_consensus.cc:515] T 0afb57ae58a24a01850491d69f0213dd P 0473d2b2d01f4459b1e90fd12cc7840e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:05:12.198776 21816 raft_consensus.cc:515] T df751f992649444090e27965eb1af85d P e5256d91808b47c195bc9b4dbd7f2b87 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:12.225224 21636 raft_consensus.cc:515] T 172b3dd13109415a955b71ac0e9d2234 P e5256d91808b47c195bc9b4dbd7f2b87 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:05:12.366883 21790 raft_consensus.cc:515] T 14efcc79969f41babe5529c22d59156d P 0473d2b2d01f4459b1e90fd12cc7840e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:05:12.241387 21529 raft_consensus.cc:515] T fa8650e71aa14778b3d73721fc50d9fc P e61c3a8f61bb48f8a963c9480e53c168 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
W20260709 13:05:12.541782 19377 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.2:46257, user_credentials={real_user=slave}} blocked reactor thread for 342327us
I20260709 13:05:12.546610 19405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cdf56e38bbc453d9438d359e5a69955" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
W20260709 13:05:12.563076 19450 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.3:36891, user_credentials={real_user=slave}} blocked reactor thread for 140889us
I20260709 13:05:12.183734 21817 raft_consensus.cc:515] T 46c5bfeecc314717bffe987e6844b6d0 P 0473d2b2d01f4459b1e90fd12cc7840e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:12.398443 21742 raft_consensus.cc:515] T b9f0d59553ad444883fcf5b5909f9798 P e61c3a8f61bb48f8a963c9480e53c168 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
W20260709 13:05:12.575488 20076 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.3:36891, user_credentials={real_user=slave}} blocked reactor thread for 122612us
I20260709 13:05:12.494863 21801 leader_election.cc:290] T 2725d2c4cb054f18b0fc8f735c15f6c2 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:05:12.483078 21859 raft_consensus.cc:493] T 775c229504194560ba9589bc2199b089 P 127766fc592545a4997f7790f50f6076 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 0473d2b2d01f4459b1e90fd12cc7840e)
I20260709 13:05:12.453346 21562 consensus_queue.cc:1059] T bc225c93219c45538b53a1bd3d387e4d P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 }, Status: INVALID_TERM, Last received: 6.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.098s
I20260709 13:05:12.407457 21820 raft_consensus.cc:515] T 179fd671030940b4b4a4e24bcc4aba0a P 0473d2b2d01f4459b1e90fd12cc7840e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:12.464064 21717 raft_consensus.cc:515] T 4509b76741dc428e9201c70c1658da13 P 0473d2b2d01f4459b1e90fd12cc7840e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:12.482405 21826 consensus_queue.cc:1048] T 2e36a9d6e29c4a7c860cf267efbd4c74 P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.142s
I20260709 13:05:12.421072 21849 raft_consensus.cc:515] T 1a61655d99124a29b486ba4a5b37faea P e5256d91808b47c195bc9b4dbd7f2b87 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:12.876806 19411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b74109013a140ada21feeef92d6f563" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:05:12.895004 19484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2725d2c4cb054f18b0fc8f735c15f6c2" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:05:12.905714 19403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "309c3ca0ca4b4f3ba129752ea2cb293b" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:05:13.051170 19484 raft_consensus.cc:2468] T 2725d2c4cb054f18b0fc8f735c15f6c2 P 0473d2b2d01f4459b1e90fd12cc7840e [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 5.
I20260709 13:05:12.875278 19485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab43d85f64114d4ebf618930e43d9ed0" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:05:13.047950 19554 raft_consensus.cc:2468] T 2725d2c4cb054f18b0fc8f735c15f6c2 P e61c3a8f61bb48f8a963c9480e53c168 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 5.
I20260709 13:05:13.053702 19554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28af091831594f9d8e96482078cc7625" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:05:12.875412 19402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff75a1d4cb1f493db8f71ddc136ba9ab" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:05:12.692163 19481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e5873a19244c5ebbcd38e126796ee7" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:05:12.876847 19410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cdf56e38bbc453d9438d359e5a69955" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:05:12.692607 19557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "309c3ca0ca4b4f3ba129752ea2cb293b" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
W20260709 13:05:13.045176 19551 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.538s	user 0.002s	sys 0.000s
I20260709 13:05:13.055891 19557 raft_consensus.cc:2468] T 309c3ca0ca4b4f3ba129752ea2cb293b P e61c3a8f61bb48f8a963c9480e53c168 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 5.
W20260709 13:05:13.056219 19551 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.549s	user 0.002s	sys 0.000s
I20260709 13:05:13.052663 19405 raft_consensus.cc:2393] T 0cdf56e38bbc453d9438d359e5a69955 P e5256d91808b47c195bc9b4dbd7f2b87 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0473d2b2d01f4459b1e90fd12cc7840e in current term 6: Already voted for candidate e5256d91808b47c195bc9b4dbd7f2b87 in this term.
I20260709 13:05:12.875576 19409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f85fc4b527a48848e5faa083b604e36" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
W20260709 13:05:13.048251 19478 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.567s	user 0.022s	sys 0.002s
W20260709 13:05:13.057742 19478 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.599s	user 0.022s	sys 0.006s
I20260709 13:05:12.576398 19555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e1f505cb0f1427bbd698ac889d80821" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:05:13.061372 19557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff75a1d4cb1f493db8f71ddc136ba9ab" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:05:13.025278 19556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab43d85f64114d4ebf618930e43d9ed0" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
W20260709 13:05:13.062175 20075 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.1:40321, user_credentials={real_user=slave}} blocked reactor thread for 655454us
I20260709 13:05:12.496642 21838 raft_consensus.cc:493] T 1a61655d99124a29b486ba4a5b37faea P e61c3a8f61bb48f8a963c9480e53c168 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 0473d2b2d01f4459b1e90fd12cc7840e)
I20260709 13:05:13.044639 20076 leader_election.cc:304] T 309c3ca0ca4b4f3ba129752ea2cb293b P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 127766fc592545a4997f7790f50f6076; no voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:05:13.048810 19486 raft_consensus.cc:2468] T ef32ce6fdd0e40d382c79974f30295c6 P 0473d2b2d01f4459b1e90fd12cc7840e [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 5.
I20260709 13:05:13.101013 19556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65d8cb8d6ec64f459d5a47cefab10acf" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:05:13.124089 19477 raft_consensus.cc:2468] T 46c5bfeecc314717bffe987e6844b6d0 P 0473d2b2d01f4459b1e90fd12cc7840e [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 9.
I20260709 13:05:13.012020 21710 leader_election.cc:290] T b08304a0a02b42d7840c4e8ee9a6bd1a P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:05:13.099689 19554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a16f7501e2444fb86d4e2778e734e02" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:05:12.774587 21847 leader_election.cc:290] T 172b3dd13109415a955b71ac0e9d2234 P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:05:13.050266 21644 raft_consensus.cc:493] T 21e14947d70440f19044d8f75c31e1f9 P e5256d91808b47c195bc9b4dbd7f2b87 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 0473d2b2d01f4459b1e90fd12cc7840e)
I20260709 13:05:12.874521 21830 leader_election.cc:290] T 0afb57ae58a24a01850491d69f0213dd P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:05:13.098984 19555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4af19371ea874c09a0a2147040835cbb" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:05:12.802008 21857 raft_consensus.cc:493] T 1dc5b3532fe54f74876d02beffa2c230 P e61c3a8f61bb48f8a963c9480e53c168 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader e5256d91808b47c195bc9b4dbd7f2b87)
I20260709 13:05:12.615270 21554 leader_election.cc:290] T 2b74109013a140ada21feeef92d6f563 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:05:12.872350 21867 raft_consensus.cc:493] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P e5256d91808b47c195bc9b4dbd7f2b87 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 127766fc592545a4997f7790f50f6076)
I20260709 13:05:13.129858 19554 raft_consensus.cc:2468] T 2a16f7501e2444fb86d4e2778e734e02 P e61c3a8f61bb48f8a963c9480e53c168 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 5.
I20260709 13:05:12.899744 21559 raft_consensus.cc:493] T 14935b3ddf914369822e4a0547aaa355 P e61c3a8f61bb48f8a963c9480e53c168 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader e5256d91808b47c195bc9b4dbd7f2b87)
W20260709 13:05:13.130571 19523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.1:40321, user_credentials={real_user=slave}} blocked reactor thread for 406839us
I20260709 13:05:12.897217 21881 raft_consensus.cc:493] T 217b5fae677b4971b3bbd2f357a1f7ff P e61c3a8f61bb48f8a963c9480e53c168 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 0473d2b2d01f4459b1e90fd12cc7840e)
I20260709 13:05:13.090922 21863 raft_consensus.cc:515] T 4509b76741dc428e9201c70c1658da13 P e61c3a8f61bb48f8a963c9480e53c168 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:12.556347 21835 raft_consensus.cc:515] T 9962423cb4e54fcfa5de01daf68a86e7 P 0473d2b2d01f4459b1e90fd12cc7840e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:05:12.676765 21813 leader_election.cc:290] T 0cdf56e38bbc453d9438d359e5a69955 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:05:12.752704 21785 raft_consensus.cc:493] T b08304a0a02b42d7840c4e8ee9a6bd1a P e61c3a8f61bb48f8a963c9480e53c168 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 0473d2b2d01f4459b1e90fd12cc7840e)
I20260709 13:05:12.646047 21850 raft_consensus.cc:515] T fa8650e71aa14778b3d73721fc50d9fc P e5256d91808b47c195bc9b4dbd7f2b87 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
W20260709 13:05:13.134168 19526 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.669s	user 0.018s	sys 0.026s
I20260709 13:05:13.067238 21860 raft_consensus.cc:515] T edd7d470b5014c9489be7f41f64355c9 P 0473d2b2d01f4459b1e90fd12cc7840e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:13.135051 19556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab43d85f64114d4ebf618930e43d9ed0" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:05:13.066804 21859 raft_consensus.cc:3060] T 775c229504194560ba9589bc2199b089 P 127766fc592545a4997f7790f50f6076 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:05:12.707397 21793 leader_election.cc:290] T 86a6797bdfe94fa496c050ceae4bd0d9 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:05:12.574138 21703 raft_consensus.cc:515] T f1b10566f45d4a7d9029858330e02d5b P e61c3a8f61bb48f8a963c9480e53c168 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:13.135828 21808 leader_election.cc:290] T 309c3ca0ca4b4f3ba129752ea2cb293b P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:05:13.119900 21584 leader_election.cc:290] T 1dc5b3532fe54f74876d02beffa2c230 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:05:13.167229 21834 leader_election.cc:290] T 48824d5acfbc485ebf8c2d944e7202de P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:05:13.167994 21525 leader_election.cc:290] T 76cb037fc9064d13b59a8969d897ce8c P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
W20260709 13:05:13.134331 21700 consensus_meta.cc:287] T fa8650e71aa14778b3d73721fc50d9fc P 0473d2b2d01f4459b1e90fd12cc7840e: Time spent flushing consensus metadata: real 1.187s	user 0.011s	sys 0.000s
I20260709 13:05:13.097178 21865 raft_consensus.cc:493] T 21e14947d70440f19044d8f75c31e1f9 P e61c3a8f61bb48f8a963c9480e53c168 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 0473d2b2d01f4459b1e90fd12cc7840e)
I20260709 13:05:13.086716 21718 raft_consensus.cc:515] T 0e1085d23e8347fbbd5bce7542f4b1f4 P 0473d2b2d01f4459b1e90fd12cc7840e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:05:13.139405 21812 leader_election.cc:290] T edd7d470b5014c9489be7f41f64355c9 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:05:13.176905 21699 leader_election.cc:290] T 14935b3ddf914369822e4a0547aaa355 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:05:13.170384 21559 raft_consensus.cc:515] T 14935b3ddf914369822e4a0547aaa355 P e61c3a8f61bb48f8a963c9480e53c168 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } attrs { replace: true } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:05:13.179260 21850 leader_election.cc:290] T fa8650e71aa14778b3d73721fc50d9fc P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:05:13.116573 21767 leader_election.cc:290] T 172b3dd13109415a955b71ac0e9d2234 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:05:13.130168 21838 raft_consensus.cc:515] T 1a61655d99124a29b486ba4a5b37faea P e61c3a8f61bb48f8a963c9480e53c168 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:13.074793 21832 raft_consensus.cc:515] T b9f0d59553ad444883fcf5b5909f9798 P e5256d91808b47c195bc9b4dbd7f2b87 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:13.166858 21852 raft_consensus.cc:2749] T 309c3ca0ca4b4f3ba129752ea2cb293b P 127766fc592545a4997f7790f50f6076 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:05:13.165583 21881 raft_consensus.cc:515] T 217b5fae677b4971b3bbd2f357a1f7ff P e61c3a8f61bb48f8a963c9480e53c168 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:13.116320 21803 raft_consensus.cc:2804] T 65d8cb8d6ec64f459d5a47cefab10acf P 127766fc592545a4997f7790f50f6076 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:05:13.062563 21856 raft_consensus.cc:515] T 22196caba61445d3bec98a0aab3c337d P e5256d91808b47c195bc9b4dbd7f2b87 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:13.192680 21742 leader_election.cc:290] T b9f0d59553ad444883fcf5b5909f9798 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:05:13.149667 21644 raft_consensus.cc:515] T 21e14947d70440f19044d8f75c31e1f9 P e5256d91808b47c195bc9b4dbd7f2b87 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
W20260709 13:05:13.308427 19377 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.2:46257, user_credentials={real_user=slave}} blocked reactor thread for 259287us
I20260709 13:05:13.334239 19482 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58294 (request call id 1566) took 1216 ms. Trace:
I20260709 13:05:13.402227 19560 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40428 (request call id 1832) took 2416 ms. Trace:
I20260709 13:05:13.337373 19477 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58294 (request call id 1574) took 1149 ms. Trace:
I20260709 13:05:13.340374 19479 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58294 (request call id 1560) took 1225 ms. Trace:
I20260709 13:05:13.341732 19553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2725d2c4cb054f18b0fc8f735c15f6c2" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:05:13.168530 19554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e5873a19244c5ebbcd38e126796ee7" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:05:13.164919 19555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cdf56e38bbc453d9438d359e5a69955" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:05:13.411718 19555 raft_consensus.cc:2468] T 0cdf56e38bbc453d9438d359e5a69955 P e61c3a8f61bb48f8a963c9480e53c168 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 6.
I20260709 13:05:13.413614 19555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef32ce6fdd0e40d382c79974f30295c6" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:05:13.342211 19483 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58286 (request call id 1430) took 1484 ms. Trace:
I20260709 13:05:13.415576 19555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef32ce6fdd0e40d382c79974f30295c6" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:05:13.415444 19483 rpcz_store.cc:276] 0709 13:05:11.857844 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:11.863315 (+  5471us) service_pool.cc:224] Handling call
0709 13:05:11.863633 (+   318us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:12.078980 (+215347us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:05:12.079022 (+    42us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:05:12.079079 (+    57us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:05:12.079123 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:13.341669 (+1262546us) spinlock_profiling.cc:243] Waited 215 ms on lock 0x7b5400148a54. stack: 00007f4a79de9343 00007f4a79de9240 00007f4a797781d4 00007f4a834b6304 00007f4a834b6299 00007f4a7ce71571 00007f4a7cf08e01 00007f4a7cf0783e 00007f4a81ecc419 00007f4a7b443bd4 00007f4a7b443b62 00007f4a7b443a91 00007f4a7b443a0c 00007f4a7b442cc2 00007f4a7b24348c 00007f4a7b2428c6
0709 13:05:13.341749 (+    80us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:13.341982 (+   233us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":494673792}
I20260709 13:05:13.182202 19556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "217b5fae677b4971b3bbd2f357a1f7ff" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:05:13.132539 19557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc225c93219c45538b53a1bd3d387e4d" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:05:13.455271 19557 raft_consensus.cc:2393] T bc225c93219c45538b53a1bd3d387e4d P e61c3a8f61bb48f8a963c9480e53c168 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e5256d91808b47c195bc9b4dbd7f2b87 in current term 8: Already voted for candidate e61c3a8f61bb48f8a963c9480e53c168 in this term.
I20260709 13:05:13.456900 19557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46c5bfeecc314717bffe987e6844b6d0" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 10 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:05:13.343290 19558 raft_consensus.cc:2468] T f1b10566f45d4a7d9029858330e02d5b P e61c3a8f61bb48f8a963c9480e53c168 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 6.
W20260709 13:05:13.173954 19526 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.709s	user 0.018s	sys 0.026s
I20260709 13:05:13.097465 21622 raft_consensus.cc:515] T e381f1d6b8184797ad142de49be225a8 P 0473d2b2d01f4459b1e90fd12cc7840e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
W20260709 13:05:13.459431 19526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.2:46257, user_credentials={real_user=slave}} blocked reactor thread for 994283us
I20260709 13:05:13.461755 19526 leader_election.cc:304] T 0cdf56e38bbc453d9438d359e5a69955 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:05:13.235682 21703 leader_election.cc:290] T f1b10566f45d4a7d9029858330e02d5b P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:05:13.213150 21717 leader_election.cc:290] T 4509b76741dc428e9201c70c1658da13 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:05:13.195886 21731 leader_election.cc:290] T 0afb57ae58a24a01850491d69f0213dd P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:05:13.229264 21733 leader_election.cc:290] T 5ec1c4ce15e04c7e8c283a62179f2a64 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:05:13.483003 21767 raft_consensus.cc:493] T 22196caba61445d3bec98a0aab3c337d P 0473d2b2d01f4459b1e90fd12cc7840e [term 4 FOLLOWER]: Starting pre-election (detected failure of leader e61c3a8f61bb48f8a963c9480e53c168)
I20260709 13:05:13.483193 19554 raft_consensus.cc:2468] T d1e5873a19244c5ebbcd38e126796ee7 P e61c3a8f61bb48f8a963c9480e53c168 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 6.
I20260709 13:05:13.172461 21785 raft_consensus.cc:515] T b08304a0a02b42d7840c4e8ee9a6bd1a P e61c3a8f61bb48f8a963c9480e53c168 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:13.483955 21767 raft_consensus.cc:515] T 22196caba61445d3bec98a0aab3c337d P 0473d2b2d01f4459b1e90fd12cc7840e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:13.485271 19554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14935b3ddf914369822e4a0547aaa355" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:05:13.238741 21803 raft_consensus.cc:493] T 65d8cb8d6ec64f459d5a47cefab10acf P 127766fc592545a4997f7790f50f6076 [term 1 FOLLOWER]: Starting leader election (detected failure of leader e61c3a8f61bb48f8a963c9480e53c168)
W20260709 13:05:13.489071 19374 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.594s	user 0.002s	sys 0.038s
I20260709 13:05:13.489171 21803 raft_consensus.cc:3060] T 65d8cb8d6ec64f459d5a47cefab10acf P 127766fc592545a4997f7790f50f6076 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:05:13.489549 19374 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.678s	user 0.003s	sys 0.038s
I20260709 13:05:13.489967 21644 leader_election.cc:290] T 21e14947d70440f19044d8f75c31e1f9 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:05:13.254055 21816 leader_election.cc:290] T df751f992649444090e27965eb1af85d P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:05:13.279367 21820 leader_election.cc:290] T 179fd671030940b4b4a4e24bcc4aba0a P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:05:13.274245 21832 leader_election.cc:290] T b9f0d59553ad444883fcf5b5909f9798 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:05:13.276173 21835 leader_election.cc:290] T 9962423cb4e54fcfa5de01daf68a86e7 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:05:13.486578 21785 leader_election.cc:290] T b08304a0a02b42d7840c4e8ee9a6bd1a P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:05:13.272258 21838 leader_election.cc:290] T 1a61655d99124a29b486ba4a5b37faea P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:05:13.183689 21845 leader_election.cc:290] T 2e36a9d6e29c4a7c860cf267efbd4c74 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:05:13.222093 21846 leader_election.cc:290] T e381f1d6b8184797ad142de49be225a8 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
W20260709 13:05:13.496668 20078 connection.cc:256] RPC call timeout handler was delayed by -1.1627683789998855s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1519s for a response
I20260709 13:05:13.499085 21893 raft_consensus.cc:493] T ab43d85f64114d4ebf618930e43d9ed0 P 127766fc592545a4997f7790f50f6076 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader e61c3a8f61bb48f8a963c9480e53c168)
I20260709 13:05:13.120054 21854 raft_consensus.cc:515] T 48824d5acfbc485ebf8c2d944e7202de P e61c3a8f61bb48f8a963c9480e53c168 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:05:13.500113 21893 raft_consensus.cc:515] T ab43d85f64114d4ebf618930e43d9ed0 P 127766fc592545a4997f7790f50f6076 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } attrs { replace: true } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:05:13.280376 21856 leader_election.cc:290] T 22196caba61445d3bec98a0aab3c337d P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:05:13.170725 21857 raft_consensus.cc:515] T 1dc5b3532fe54f74876d02beffa2c230 P e61c3a8f61bb48f8a963c9480e53c168 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:13.229140 21859 raft_consensus.cc:515] T 775c229504194560ba9589bc2199b089 P 127766fc592545a4997f7790f50f6076 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:05:13.516674 20106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f85fc4b527a48848e5faa083b604e36" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:05:13.272640 21860 leader_election.cc:290] T edd7d470b5014c9489be7f41f64355c9 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:05:13.268190 21863 leader_election.cc:290] T 4509b76741dc428e9201c70c1658da13 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:05:13.192730 21865 raft_consensus.cc:515] T 21e14947d70440f19044d8f75c31e1f9 P e61c3a8f61bb48f8a963c9480e53c168 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:13.521785 20104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "309c3ca0ca4b4f3ba129752ea2cb293b" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:05:13.174856 21867 raft_consensus.cc:515] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P e5256d91808b47c195bc9b4dbd7f2b87 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
W20260709 13:05:13.270112 21871 log.cc:927] Time spent T 14935b3ddf914369822e4a0547aaa355 P e5256d91808b47c195bc9b4dbd7f2b87: Append to log took a long time: real 0.098s	user 0.000s	sys 0.001s
W20260709 13:05:13.258152 21874 log.cc:927] Time spent T bc225c93219c45538b53a1bd3d387e4d P e5256d91808b47c195bc9b4dbd7f2b87: Append to log took a long time: real 0.090s	user 0.000s	sys 0.000s
I20260709 13:05:13.534840 21863 raft_consensus.cc:2804] T 0cdf56e38bbc453d9438d359e5a69955 P e61c3a8f61bb48f8a963c9480e53c168 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:05:13.530849 21559 leader_election.cc:290] T 14935b3ddf914369822e4a0547aaa355 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:05:13.256155 21881 leader_election.cc:290] T 217b5fae677b4971b3bbd2f357a1f7ff P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:05:13.399554 21790 leader_election.cc:290] T 14efcc79969f41babe5529c22d59156d P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:05:13.406910 19479 rpcz_store.cc:276] 0709 13:05:12.115304 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:12.117865 (+  2561us) service_pool.cc:224] Handling call
0709 13:05:12.118222 (+   357us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:12.421006 (+302784us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:05:12.421039 (+    33us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:05:12.421078 (+    39us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:05:12.421106 (+    28us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:13.339748 (+918642us) spinlock_profiling.cc:243] Waited 303 ms on lock 0x7b5400224554. stack: 00007f4a79de9343 00007f4a79de9240 00007f4a797781d4 00007f4a834b6304 00007f4a834b6299 00007f4a7ce71571 00007f4a7cf08e01 00007f4a7cf0783e 00007f4a81ecc419 00007f4a7b443bd4 00007f4a7b443b62 00007f4a7b443a91 00007f4a7b443a0c 00007f4a7b442cc2 00007f4a7b24348c 00007f4a7b2428c6
0709 13:05:13.339846 (+    98us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:13.340165 (+   319us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":695877504}
W20260709 13:05:13.526989 19526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.2:46257, user_credentials={real_user=slave}} blocked reactor thread for 65485.2us
I20260709 13:05:13.417464 19555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b74109013a140ada21feeef92d6f563" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
W20260709 13:05:13.436622 19450 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.3:36891, user_credentials={real_user=slave}} blocked reactor thread for 389088us
I20260709 13:05:13.438385 19478 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58294 (request call id 1565) took 1321 ms. Trace:
W20260709 13:05:13.438915 19452 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.562s	user 0.026s	sys 0.027s
I20260709 13:05:13.406250 19482 rpcz_store.cc:276] 0709 13:05:12.117233 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:12.117371 (+   138us) service_pool.cc:224] Handling call
0709 13:05:12.117697 (+   326us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:13.120666 (+1002969us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:05:13.120695 (+    29us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:05:13.120734 (+    39us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:05:13.120771 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:13.333516 (+212745us) spinlock_profiling.cc:243] Waited 1 s on lock 0x7b540035cad4. stack: 00007f4a79de9343 00007f4a79de9240 00007f4a797781d4 00007f4a834b6304 00007f4a834b6299 00007f4a7ce71571 00007f4a7cf08e01 00007f4a7cf0783e 00007f4a81ecc419 00007f4a7b443bd4 00007f4a7b443b62 00007f4a7b443a91 00007f4a7b443a0c 00007f4a7b442cc2 00007f4a7b24348c 00007f4a7b2428c6
0709 13:05:13.333621 (+   105us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:13.333968 (+   347us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2306204032}
I20260709 13:05:13.406481 19560 rpcz_store.cc:276] 0709 13:05:10.984048 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:10.984182 (+   134us) service_pool.cc:224] Handling call
0709 13:05:10.984568 (+   386us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:12.031842 (+1047274us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:05:12.031885 (+    43us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:05:12.032005 (+   120us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:05:12.032051 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:13.399536 (+1367485us) spinlock_profiling.cc:243] Waited 1.05 s on lock 0x7b540014a854. stack: 00007f4a79de9343 00007f4a79de9240 00007f4a797781d4 00007f4a834b6304 00007f4a834b6299 00007f4a7ce71571 00007f4a7cf08e01 00007f4a7cf0783e 00007f4a81ecc419 00007f4a7b443bd4 00007f4a7b443b62 00007f4a7b443a91 00007f4a7b443a0c 00007f4a7b442cc2 00007f4a7b24348c 00007f4a7b2428c6
0709 13:05:13.399607 (+    71us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:13.399973 (+   366us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2408000256}
I20260709 13:05:13.407519 19477 rpcz_store.cc:276] 0709 13:05:12.187353 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:12.401850 (+214497us) service_pool.cc:224] Handling call
0709 13:05:13.336845 (+934995us) spinlock_profiling.cc:243] Waited 71.1 ms on lock 0x7b5400353c54. stack: 00007f4a79de9343 00007f4a79de9240 00007f4a797781d4 00007f4a834b6304 00007f4a834b6299 00007f4a7ce71571 00007f4a7cf0c2fa 00007f4a81ecdb17 00007f4a7b4486d4 00007f4a7b448662 00007f4a7b448591 00007f4a7b44850c 00007f4a7b4477c2 00007f4a7b24348c 00007f4a7b2428c6 00007f4a7b24226f
0709 13:05:13.337093 (+   248us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":163607424}
I20260709 13:05:13.449236 21823 raft_consensus.cc:493] T 5ec1c4ce15e04c7e8c283a62179f2a64 P e5256d91808b47c195bc9b4dbd7f2b87 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 127766fc592545a4997f7790f50f6076)
I20260709 13:05:13.185904 21636 leader_election.cc:290] T 172b3dd13109415a955b71ac0e9d2234 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
W20260709 13:05:13.546814 19452 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.670s	user 0.026s	sys 0.027s
I20260709 13:05:13.547775 19555 raft_consensus.cc:2468] T 2b74109013a140ada21feeef92d6f563 P e61c3a8f61bb48f8a963c9480e53c168 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 2.
I20260709 13:05:13.549170 19555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "179fd671030940b4b4a4e24bcc4aba0a" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:05:13.550326 19555 raft_consensus.cc:2393] T 179fd671030940b4b4a4e24bcc4aba0a P e61c3a8f61bb48f8a963c9480e53c168 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e5256d91808b47c195bc9b4dbd7f2b87 in current term 4: Already voted for candidate e61c3a8f61bb48f8a963c9480e53c168 in this term.
I20260709 13:05:13.262375 21817 leader_election.cc:290] T 46c5bfeecc314717bffe987e6844b6d0 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:05:13.550634 19480 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58286 (request call id 1424) took 1780 ms. Trace:
I20260709 13:05:13.486470 19554 raft_consensus.cc:2468] T 14935b3ddf914369822e4a0547aaa355 P e61c3a8f61bb48f8a963c9480e53c168 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 127766fc592545a4997f7790f50f6076 in term 4.
I20260709 13:05:13.495268 21529 leader_election.cc:290] T fa8650e71aa14778b3d73721fc50d9fc P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:05:13.551079 20104 raft_consensus.cc:2468] T 309c3ca0ca4b4f3ba129752ea2cb293b P 127766fc592545a4997f7790f50f6076 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 5.
I20260709 13:05:13.551203 19480 rpcz_store.cc:276] 0709 13:05:11.770397 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:11.770510 (+   113us) service_pool.cc:224] Handling call
0709 13:05:11.770814 (+   304us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:12.027567 (+256753us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:05:12.027607 (+    40us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:05:12.027657 (+    50us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:05:12.027690 (+    33us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:13.550111 (+1522421us) spinlock_profiling.cc:243] Waited 257 ms on lock 0x7b5400224a54. stack: 00007f4a79de9343 00007f4a79de9240 00007f4a797781d4 00007f4a834b6304 00007f4a834b6299 00007f4a7ce71571 00007f4a7cf08e01 00007f4a7cf0783e 00007f4a81ecc419 00007f4a7b443bd4 00007f4a7b443b62 00007f4a7b443a91 00007f4a7b443a0c 00007f4a7b442cc2 00007f4a7b24348c 00007f4a7b2428c6
0709 13:05:13.550187 (+    76us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:13.550420 (+   233us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":590001024}
I20260709 13:05:13.552366 19554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65d8cb8d6ec64f459d5a47cefab10acf" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:05:13.554040 19554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f575b143b844aa096b50997dad3516a" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:05:13.554857 19552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62c6c134d3d24a1ab144dd9ee6bc3f64" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:05:13.556465 19558 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40438 (request call id 1608) took 1154 ms. Trace:
I20260709 13:05:13.556970 19558 rpcz_store.cc:276] 0709 13:05:12.402218 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:12.402376 (+   158us) service_pool.cc:224] Handling call
0709 13:05:13.556114 (+1153738us) spinlock_profiling.cc:243] Waited 296 ms on lock 0x7b54003093d4. stack: 00007f4a79de9343 00007f4a79de9240 00007f4a797781d4 00007f4a834b6304 00007f4a834b6299 00007f4a7ce71571 00007f4a7cf0c2fa 00007f4a81ecdb17 00007f4a7b4486d4 00007f4a7b448662 00007f4a7b448591 00007f4a7b44850c 00007f4a7b4477c2 00007f4a7b24348c 00007f4a7b2428c6 00007f4a7b24226f
0709 13:05:13.556355 (+   241us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":680846720}
I20260709 13:05:13.558857 21720 leader_election.cc:290] T 7be9efa6559648dbb5a0f7684c4542d1 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:05:13.251718 21849 leader_election.cc:290] T 1a61655d99124a29b486ba4a5b37faea P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:05:13.472429 19557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85c494af21f9457a85da47b9bc70c1fd" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
W20260709 13:05:13.511041 19524 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.903s	user 0.015s	sys 0.021s
W20260709 13:05:13.564471 19524 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.956s	user 0.016s	sys 0.022s
I20260709 13:05:13.523011 19556 raft_consensus.cc:2468] T 217b5fae677b4971b3bbd2f357a1f7ff P e61c3a8f61bb48f8a963c9480e53c168 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 2.
I20260709 13:05:13.534943 21622 leader_election.cc:290] T e381f1d6b8184797ad142de49be225a8 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:05:13.541905 20106 raft_consensus.cc:2468] T 1f85fc4b527a48848e5faa083b604e36 P 127766fc592545a4997f7790f50f6076 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 2.
I20260709 13:05:13.546262 21718 leader_election.cc:290] T 0e1085d23e8347fbbd5bce7542f4b1f4 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:05:13.542812 19478 rpcz_store.cc:276] 0709 13:05:12.116930 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:12.118712 (+  1782us) service_pool.cc:224] Handling call
0709 13:05:12.119028 (+   316us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:12.119269 (+   241us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 13:05:12.458969 (+339700us) log.cc:844] Serialized 14 byte log entry
0709 13:05:13.269976 (+811007us) spinlock_profiling.cc:243] Waited 2.57 ms on lock 0x7b18003e9440. stack: 00007f4a79de9343 00007f4a79de9240 00007f4a797781d4 00007f4a834b6304 00007f4a834b6299 00007f4a82ce3de1 00007f4a82cf05b1 00007f4a79e1b3f3 00007f4a79e1d7c1 00007f4a79e1d779 00007f4a79e1d709 00007f4a79e1d6d1 00007f4a79e1c9cd 000000000038f354 000000000038f199 00007f4a79dfe83a
0709 13:05:13.437561 (+167585us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:05:13.437697 (+   136us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:05:13.437823 (+   126us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:13.437942 (+   119us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:13.438202 (+   260us) inbound_call.cc:177] Queueing success response
0709 13:05:13.481410 (+ 43208us) spinlock_profiling.cc:243] Waited 1.37 ms on lock 0x7b18003e9440. stack: 00007f4a79de9343 00007f4a79de9240 00007f4a797781d4 00007f4a834b6304 00007f4a834b6299 00007f4a82ce3de1 00007f4a82cf05b1 00007f4a79d95c0a 00007f4a834d5219 00007f4a80ddc58f 00007f4a79e1b571 00007f4a79e1d7c1 00007f4a79e1d779 00007f4a79e1d709 00007f4a79e1d6d1 00007f4a79e1c9cd
Metrics: {"mutex_wait_us":43138,"prepare.queue_time_us":451653,"prepare.run_cpu_time_us":45,"prepare.run_wall_time_us":46,"raft.queue_time_us":137362,"raft.run_cpu_time_us":139,"raft.run_wall_time_us":5799,"spinlock_wait_cycles":9058304,"thread_start_us":1231967,"threads_started":3,"wal-append.queue_time_us":737176}
I20260709 13:05:13.546057 21823 raft_consensus.cc:515] T 5ec1c4ce15e04c7e8c283a62179f2a64 P e5256d91808b47c195bc9b4dbd7f2b87 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
W20260709 13:05:13.547996 19452 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:13.564252 19557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76cb037fc9064d13b59a8969d897ce8c" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
W20260709 13:05:13.270785 21880 log.cc:927] Time spent T 40e1e16737a842ee936002830f36882e P e61c3a8f61bb48f8a963c9480e53c168: Append to log took a long time: real 0.066s	user 0.000s	sys 0.000s
I20260709 13:05:13.596923 21877 raft_consensus.cc:493] T 96efeaaf1057492490e9a621f37e1a2d P 127766fc592545a4997f7790f50f6076 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader e61c3a8f61bb48f8a963c9480e53c168)
I20260709 13:05:13.535506 21863 raft_consensus.cc:493] T 0cdf56e38bbc453d9438d359e5a69955 P e61c3a8f61bb48f8a963c9480e53c168 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:13.598336 21863 raft_consensus.cc:3060] T 0cdf56e38bbc453d9438d359e5a69955 P e61c3a8f61bb48f8a963c9480e53c168 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:05:13.600493 19554 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40428 (request call id 1839) took 1036 ms. Trace:
W20260709 13:05:13.490104 19374 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.4:43121, user_credentials={real_user=slave}} blocked reactor thread for 792947us
I20260709 13:05:13.556618 19552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edd7d470b5014c9489be7f41f64355c9" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:05:13.589912 19559 raft_consensus.cc:493] T 40e1e16737a842ee936002830f36882e P e61c3a8f61bb48f8a963c9480e53c168 [term 6 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:13.590035 19557 raft_consensus.cc:2468] T 76cb037fc9064d13b59a8969d897ce8c P e61c3a8f61bb48f8a963c9480e53c168 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 5.
I20260709 13:05:13.607566 21529 raft_consensus.cc:493] T 833a2f0775ed407a94b8924ce50adb63 P e61c3a8f61bb48f8a963c9480e53c168 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader e5256d91808b47c195bc9b4dbd7f2b87)
I20260709 13:05:13.608489 21529 raft_consensus.cc:515] T 833a2f0775ed407a94b8924ce50adb63 P e61c3a8f61bb48f8a963c9480e53c168 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:05:13.609390 19559 raft_consensus.cc:3060] T 40e1e16737a842ee936002830f36882e P e61c3a8f61bb48f8a963c9480e53c168 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:05:13.611039 20076 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.3:36891, user_credentials={real_user=slave}} blocked reactor thread for 491080us
I20260709 13:05:13.612491 21857 leader_election.cc:290] T 1dc5b3532fe54f74876d02beffa2c230 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:05:13.611138 21854 leader_election.cc:290] T 48824d5acfbc485ebf8c2d944e7202de P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:05:13.615658 21584 raft_consensus.cc:3055] T bc225c93219c45538b53a1bd3d387e4d P 0473d2b2d01f4459b1e90fd12cc7840e [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:05:13.616076 21584 raft_consensus.cc:740] T bc225c93219c45538b53a1bd3d387e4d P 0473d2b2d01f4459b1e90fd12cc7840e [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 0473d2b2d01f4459b1e90fd12cc7840e, State: Running, Role: LEADER
I20260709 13:05:13.601084 19554 rpcz_store.cc:276] 0709 13:05:12.552765 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:13.553627 (+1000862us) service_pool.cc:224] Handling call
0709 13:05:13.588807 (+ 35180us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:05:13.632552 19551 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40438 (request call id 1604) took 1262 ms. Trace:
I20260709 13:05:13.634953 21817 raft_consensus.cc:493] T 3e1f505cb0f1427bbd698ac889d80821 P 0473d2b2d01f4459b1e90fd12cc7840e [term 4 FOLLOWER]: Starting pre-election (detected failure of leader e61c3a8f61bb48f8a963c9480e53c168)
I20260709 13:05:13.635782 21817 raft_consensus.cc:515] T 3e1f505cb0f1427bbd698ac889d80821 P 0473d2b2d01f4459b1e90fd12cc7840e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:13.597994 21877 raft_consensus.cc:515] T 96efeaaf1057492490e9a621f37e1a2d P 127766fc592545a4997f7790f50f6076 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:05:13.637351 21893 leader_election.cc:290] T ab43d85f64114d4ebf618930e43d9ed0 P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:05:13.633172 19551 rpcz_store.cc:276] 0709 13:05:12.370044 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:12.370140 (+    96us) service_pool.cc:224] Handling call
0709 13:05:12.370384 (+   244us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:12.370641 (+   257us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 13:05:12.506760 (+136119us) log.cc:844] Serialized 14 byte log entry
0709 13:05:13.517822 (+1011062us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:05:13.524735 (+  6913us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:05:13.587057 (+ 62322us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:13.587174 (+   117us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:13.632312 (+ 45138us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":753631,"prepare.run_cpu_time_us":39,"prepare.run_wall_time_us":40,"raft.queue_time_us":179339,"raft.run_cpu_time_us":79,"raft.run_wall_time_us":80,"thread_start_us":1068339,"threads_started":3,"wal-append.queue_time_us":527353}
I20260709 13:05:13.954905 21672 raft_consensus.cc:493] T 2e36a9d6e29c4a7c860cf267efbd4c74 P e61c3a8f61bb48f8a963c9480e53c168 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:13.961251 19551 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40428 (request call id 1840) took 1408 ms. Trace:
I20260709 13:05:13.630725 19558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86a6797bdfe94fa496c050ceae4bd0d9" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:05:13.962324 19558 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40438 (request call id 1630) took 1064 ms. Trace:
I20260709 13:05:13.617118 21584 consensus_queue.cc:260] T bc225c93219c45538b53a1bd3d387e4d P 0473d2b2d01f4459b1e90fd12cc7840e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:13.714414 19559 raft_consensus.cc:515] T 40e1e16737a842ee936002830f36882e P e61c3a8f61bb48f8a963c9480e53c168 [term 7 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
W20260709 13:05:13.755978 21728 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 2.726s	user 0.032s	sys 0.030s
I20260709 13:05:13.963006 19558 rpcz_store.cc:276] 0709 13:05:12.897622 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:13.558447 (+660825us) service_pool.cc:224] Handling call
0709 13:05:13.962250 (+403803us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:05:13.970559 19554 raft_consensus.cc:1240] T fa8650e71aa14778b3d73721fc50d9fc P e61c3a8f61bb48f8a963c9480e53c168 [term 6 FOLLOWER]: Rejecting Update request from peer 0473d2b2d01f4459b1e90fd12cc7840e for earlier term 5. Current term is 6. Ops: []
I20260709 13:05:13.638705 19555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70797e5783b5454ab0d0eea663e791e3" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:05:13.640904 19552 raft_consensus.cc:2393] T edd7d470b5014c9489be7f41f64355c9 P e61c3a8f61bb48f8a963c9480e53c168 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e5256d91808b47c195bc9b4dbd7f2b87 in current term 4: Already voted for candidate e61c3a8f61bb48f8a963c9480e53c168 in this term.
I20260709 13:05:13.971686 19552 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40438 (request call id 1626) took 1075 ms. Trace:
I20260709 13:05:13.638886 21790 raft_consensus.cc:493] T 62c6c134d3d24a1ab144dd9ee6bc3f64 P 0473d2b2d01f4459b1e90fd12cc7840e [term 6 FOLLOWER]: Starting pre-election (detected failure of leader e61c3a8f61bb48f8a963c9480e53c168)
I20260709 13:05:13.947412 21859 leader_election.cc:290] T 775c229504194560ba9589bc2199b089 P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 4 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:05:13.947325 19407 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49050 (request call id 255) took 1819 ms. Trace:
I20260709 13:05:13.948944 19557 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40438 (request call id 1611) took 1484 ms. Trace:
I20260709 13:05:13.966146 21877 leader_election.cc:290] T 96efeaaf1057492490e9a621f37e1a2d P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:05:13.949226 21854 raft_consensus.cc:493] T ed7fdbcb96d14d418db9ca90a792588a P e61c3a8f61bb48f8a963c9480e53c168 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 0473d2b2d01f4459b1e90fd12cc7840e)
I20260709 13:05:13.974619 19557 rpcz_store.cc:276] 0709 13:05:12.464952 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:13.629258 (+1164306us) service_pool.cc:224] Handling call
0709 13:05:13.948085 (+318827us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:13.948502 (+   417us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:05:13.948529 (+    27us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:05:13.948576 (+    47us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:05:13.948632 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:13.948711 (+    79us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:13.948848 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:05:13.749063 21803 raft_consensus.cc:515] T 65d8cb8d6ec64f459d5a47cefab10acf P 127766fc592545a4997f7790f50f6076 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
W20260709 13:05:13.967926 20078 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.2:46257, user_credentials={real_user=slave}} blocked reactor thread for 330296us
I20260709 13:05:13.961804 19551 rpcz_store.cc:276] 0709 13:05:12.553044 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:13.960022 (+1406978us) service_pool.cc:224] Handling call
0709 13:05:13.960521 (+   499us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:13.960863 (+   342us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:05:13.960890 (+    27us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:05:13.960959 (+    69us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:05:13.960995 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:13.961053 (+    58us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:13.961181 (+   128us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:05:13.972271 19552 rpcz_store.cc:276] 0709 13:05:12.896513 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:13.556151 (+659638us) service_pool.cc:224] Handling call
0709 13:05:13.971629 (+415478us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:05:13.970109 19408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "172b3dd13109415a955b71ac0e9d2234" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:05:13.973819 19554 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40428 (request call id 1838) took 1421 ms. Trace:
I20260709 13:05:13.961534 21672 raft_consensus.cc:515] T 2e36a9d6e29c4a7c860cf267efbd4c74 P e61c3a8f61bb48f8a963c9480e53c168 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:13.984319 19559 leader_election.cc:290] T 40e1e16737a842ee936002830f36882e P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 7 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
W20260709 13:05:13.971426 21728 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 3.173s	user 0.037s	sys 0.031s
I20260709 13:05:13.987851 19554 rpcz_store.cc:276] 0709 13:05:12.552480 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:13.644788 (+1092308us) service_pool.cc:224] Handling call
0709 13:05:13.970179 (+325391us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:13.973624 (+  3445us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:13.973775 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:05:13.998579 21817 leader_election.cc:290] T 3e1f505cb0f1427bbd698ac889d80821 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:05:13.999635 19408 raft_consensus.cc:2393] T 172b3dd13109415a955b71ac0e9d2234 P e5256d91808b47c195bc9b4dbd7f2b87 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 127766fc592545a4997f7790f50f6076 in current term 2: Already voted for candidate e5256d91808b47c195bc9b4dbd7f2b87 in this term.
I20260709 13:05:13.999269 21854 raft_consensus.cc:515] T ed7fdbcb96d14d418db9ca90a792588a P e61c3a8f61bb48f8a963c9480e53c168 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:05:14.000748 21767 leader_election.cc:290] T 22196caba61445d3bec98a0aab3c337d P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:05:13.991504 19555 raft_consensus.cc:2393] T 70797e5783b5454ab0d0eea663e791e3 P e61c3a8f61bb48f8a963c9480e53c168 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 127766fc592545a4997f7790f50f6076 in current term 6: Already voted for candidate e5256d91808b47c195bc9b4dbd7f2b87 in this term.
I20260709 13:05:14.001866 19554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0afb57ae58a24a01850491d69f0213dd" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:05:13.991555 19557 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40428 (request call id 1844) took 1437 ms. Trace:
W20260709 13:05:13.996299 19450 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.3:36891, user_credentials={real_user=slave}} blocked reactor thread for 49799.7us
I20260709 13:05:13.978543 19556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cdf56e38bbc453d9438d359e5a69955" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:05:13.993609 21672 leader_election.cc:290] T 2e36a9d6e29c4a7c860cf267efbd4c74 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
W20260709 13:05:13.997387 19449 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.1:40321, user_credentials={real_user=slave}} blocked reactor thread for 72119.6us
I20260709 13:05:13.953387 21867 leader_election.cc:290] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:05:14.002988 19557 rpcz_store.cc:276] 0709 13:05:12.554105 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:13.988671 (+1434566us) service_pool.cc:224] Handling call
0709 13:05:13.990756 (+  2085us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:13.991084 (+   328us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:05:13.991118 (+    34us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:05:13.991205 (+    87us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:05:13.991289 (+    84us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:13.991350 (+    61us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:13.991467 (+   117us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:05:13.955775 21529 leader_election.cc:290] T 833a2f0775ed407a94b8924ce50adb63 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
W20260709 13:05:14.008448 19553 consensus_meta.cc:287] T 2725d2c4cb054f18b0fc8f735c15f6c2 P e61c3a8f61bb48f8a963c9480e53c168: Time spent flushing consensus metadata: real 0.535s	user 0.004s	sys 0.012s
W20260709 13:05:14.010982 19377 connection.cc:256] RPC call timeout handler was delayed by -1.0228430339999477s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16000000000000003s for a response
I20260709 13:05:14.011323 19553 raft_consensus.cc:2468] T 2725d2c4cb054f18b0fc8f735c15f6c2 P e61c3a8f61bb48f8a963c9480e53c168 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 5.
I20260709 13:05:14.012121 21747 raft_consensus.cc:493] T fa731b585f684a7fb2d106c50f143b83 P e61c3a8f61bb48f8a963c9480e53c168 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 127766fc592545a4997f7790f50f6076)
I20260709 13:05:14.013055 21747 raft_consensus.cc:515] T fa731b585f684a7fb2d106c50f143b83 P e61c3a8f61bb48f8a963c9480e53c168 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:05:14.015605 19482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "309c3ca0ca4b4f3ba129752ea2cb293b" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:05:14.016235 19558 raft_consensus.cc:1275] T 7be9efa6559648dbb5a0f7684c4542d1 P e61c3a8f61bb48f8a963c9480e53c168 [term 5 FOLLOWER]: Refusing update from remote peer 0473d2b2d01f4459b1e90fd12cc7840e: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:05:14.016920 19558 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40428 (request call id 1843) took 1463 ms. Trace:
I20260709 13:05:14.017009 19483 raft_consensus.cc:1275] T 5ec1c4ce15e04c7e8c283a62179f2a64 P 0473d2b2d01f4459b1e90fd12cc7840e [term 3 FOLLOWER]: Refusing update from remote peer 127766fc592545a4997f7790f50f6076: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 5. (term mismatch)
I20260709 13:05:14.017442 19483 pending_rounds.cc:85] T 5ec1c4ce15e04c7e8c283a62179f2a64 P 0473d2b2d01f4459b1e90fd12cc7840e: Aborting all ops after (but not including) 4
I20260709 13:05:14.017654 19560 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40438 (request call id 1620) took 1123 ms. Trace:
I20260709 13:05:14.017747 19559 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RunLeaderElection from 127.0.0.1:40438 (request call id 1607) took 1631 ms. Trace:
I20260709 13:05:14.017280 19558 rpcz_store.cc:276] 0709 13:05:12.553839 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:13.971240 (+1417401us) service_pool.cc:224] Handling call
0709 13:05:14.015859 (+ 44619us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:14.016610 (+   751us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:14.016847 (+   237us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:05:13.974496 19407 rpcz_store.cc:276] 0709 13:05:12.127969 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:12.128155 (+   186us) service_pool.cc:224] Handling call
0709 13:05:12.133457 (+  5302us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:05:13.328212 (+1194755us) spinlock_profiling.cc:243] Waited 7.57 ms on lock 0x7b18003807a0. stack: 00007f4a79de9343 00007f4a79de9240 00007f4a797781d4 00007f4a834b6304 00007f4a834b6299 00007f4a82ce3de1 00007f4a82cf05b1 00007f4a7cab04bc 00007f4a79dfe48b 00007f4a82c58ab9 00007f4a79e1a69b 00007f4a79e1893f 00007f4a79e18455 00007f4a7cf00060 00007f4a7cf00bfb 00007f4a7cf0b64b
0709 13:05:13.328525 (+   313us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:05:13.328585 (+    60us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:05:13.329644 (+  1059us) log.cc:844] Serialized 26 byte log entry
0709 13:05:13.443864 (+114220us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:05:13.443916 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:13.449025 (+  5109us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:05:13.946699 (+497674us) raft_consensus.cc:1685] finished
0709 13:05:13.946728 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:13.947056 (+   328us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":14225,"raft.queue_time_us":230149,"raft.run_cpu_time_us":157,"raft.run_wall_time_us":20933,"spinlock_wait_cycles":17406208,"thread_start_us":380649,"threads_started":2,"wal-append.queue_time_us":220474}
I20260709 13:05:14.018257 19560 rpcz_store.cc:276] 0709 13:05:12.894716 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:14.016663 (+1121947us) service_pool.cc:224] Handling call
0709 13:05:14.017052 (+   389us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:14.017333 (+   281us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:05:14.017359 (+    26us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:05:14.017413 (+    54us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:05:14.017442 (+    29us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:14.017499 (+    57us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:14.017584 (+    85us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:05:14.001890 21854 leader_election.cc:290] T ed7fdbcb96d14d418db9ca90a792588a P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:05:14.022874 19553 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40428 (request call id 1837) took 1460 ms. Trace:
I20260709 13:05:14.021564 19555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48824d5acfbc485ebf8c2d944e7202de" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:05:14.018404 19559 rpcz_store.cc:276] 0709 13:05:12.371697 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:12.371818 (+   121us) service_pool.cc:224] Handling call
0709 13:05:13.982735 (+1610917us) spinlock_profiling.cc:243] Waited 1.04 s on lock 0x7b54000df554. stack: 00007f4a79de9343 00007f4a79de9240 00007f4a797781d4 00007f4a834b6304 00007f4a834b6299 00007f4a7ce71571 00007f4a7ceffa3d 00007f4a81ecfcd0 00007f4a7b454254 00007f4a7b4541e2 00007f4a7b454111 00007f4a7b45408c 00007f4a7b453342 00007f4a7b24348c 00007f4a7b2428c6 00007f4a7b24226f
0709 13:05:14.002727 (+ 19992us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2386370944}
W20260709 13:05:14.019932 20112 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35874 (request call id 436) took 2668 ms (client timeout 2773 ms). Trace:
I20260709 13:05:14.024829 19553 rpcz_store.cc:276] 0709 13:05:12.552141 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:13.340804 (+788663us) service_pool.cc:224] Handling call
0709 13:05:14.011813 (+671009us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:05:14.025959 20112 rpcz_store.cc:269] 0709 13:05:11.350952 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:11.351126 (+   174us) service_pool.cc:224] Handling call
0709 13:05:14.019579 (+2668453us) spinlock_profiling.cc:243] Waited 112 ms on lock 0x7b54006ee454. stack: 00007f4a79de9343 00007f4a79de9240 00007f4a797781d4 00007f4a834b6304 00007f4a834b6299 00007f4a7ce71571 00007f4a7cf0c2fa 00007f4a81ecdb17 00007f4a7b4486d4 00007f4a7b448662 00007f4a7b448591 00007f4a7b44850c 00007f4a7b4477c2 00007f4a7b24348c 00007f4a7b2428c6 00007f4a7b24226f
0709 13:05:14.019745 (+   166us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":257830784}
I20260709 13:05:14.032068 19485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14935b3ddf914369822e4a0547aaa355" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:05:14.031934 21790 raft_consensus.cc:515] T 62c6c134d3d24a1ab144dd9ee6bc3f64 P 0473d2b2d01f4459b1e90fd12cc7840e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:05:14.032850 19485 raft_consensus.cc:2468] T 14935b3ddf914369822e4a0547aaa355 P 0473d2b2d01f4459b1e90fd12cc7840e [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 127766fc592545a4997f7790f50f6076 in term 4.
I20260709 13:05:14.033047 21747 leader_election.cc:290] T fa731b585f684a7fb2d106c50f143b83 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:05:14.007489 21877 raft_consensus.cc:493] T 833a2f0775ed407a94b8924ce50adb63 P 127766fc592545a4997f7790f50f6076 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader e5256d91808b47c195bc9b4dbd7f2b87)
I20260709 13:05:14.022040 19483 pending_rounds.cc:107] T 5ec1c4ce15e04c7e8c283a62179f2a64 P 0473d2b2d01f4459b1e90fd12cc7840e: Aborting uncommitted NO_OP operation due to leader change: 2.5
I20260709 13:05:14.035266 19483 raft_consensus.cc:2889] T 5ec1c4ce15e04c7e8c283a62179f2a64 P 0473d2b2d01f4459b1e90fd12cc7840e [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:05:14.038329 19555 raft_consensus.cc:2468] T 48824d5acfbc485ebf8c2d944e7202de P e61c3a8f61bb48f8a963c9480e53c168 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 127766fc592545a4997f7790f50f6076 in term 4.
I20260709 13:05:14.029028 21529 raft_consensus.cc:493] T 7f575b143b844aa096b50997dad3516a P e61c3a8f61bb48f8a963c9480e53c168 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e5256d91808b47c195bc9b4dbd7f2b87)
I20260709 13:05:14.039333 19477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "775c229504194560ba9589bc2199b089" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:05:14.034834 19479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62c6c134d3d24a1ab144dd9ee6bc3f64" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:05:14.042068 19479 raft_consensus.cc:2468] T 62c6c134d3d24a1ab144dd9ee6bc3f64 P 0473d2b2d01f4459b1e90fd12cc7840e [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 127766fc592545a4997f7790f50f6076 in term 6.
I20260709 13:05:14.045034 19408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "775c229504194560ba9589bc2199b089" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
I20260709 13:05:14.033954 21854 raft_consensus.cc:493] T 7be9efa6559648dbb5a0f7684c4542d1 P e61c3a8f61bb48f8a963c9480e53c168 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 0473d2b2d01f4459b1e90fd12cc7840e)
I20260709 13:05:14.045608 19552 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40438 (request call id 1615) took 1171 ms. Trace:
I20260709 13:05:14.045686 19557 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40438 (request call id 1618) took 1171 ms. Trace:
I20260709 13:05:14.048333 19552 rpcz_store.cc:276] 0709 13:05:12.873855 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:13.997363 (+1123508us) service_pool.cc:224] Handling call
0709 13:05:14.024359 (+ 26996us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:14.042229 (+ 17870us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:05:14.042256 (+    27us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:05:14.045342 (+  3086us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:05:14.045384 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:14.045446 (+    62us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:14.045554 (+   108us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:05:14.054607 19452 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:14.046595 19482 raft_consensus.cc:2468] T 309c3ca0ca4b4f3ba129752ea2cb293b P 0473d2b2d01f4459b1e90fd12cc7840e [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 127766fc592545a4997f7790f50f6076 in term 5.
I20260709 13:05:14.048786 19557 rpcz_store.cc:276] 0709 13:05:12.874707 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:14.011711 (+1137004us) service_pool.cc:224] Handling call
0709 13:05:14.037193 (+ 25482us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:14.045370 (+  8177us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:05:14.045401 (+    31us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:05:14.045444 (+    43us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:05:14.045500 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:14.045560 (+    60us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:14.045646 (+    86us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:05:14.056794 19485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "172b3dd13109415a955b71ac0e9d2234" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:05:14.030413 21863 raft_consensus.cc:515] T 0cdf56e38bbc453d9438d359e5a69955 P e61c3a8f61bb48f8a963c9480e53c168 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:14.046012 21865 leader_election.cc:290] T 21e14947d70440f19044d8f75c31e1f9 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:05:14.064847 19485 raft_consensus.cc:2468] T 172b3dd13109415a955b71ac0e9d2234 P 0473d2b2d01f4459b1e90fd12cc7840e [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 127766fc592545a4997f7790f50f6076 in term 2.
I20260709 13:05:14.062351 19551 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40428 (request call id 1847) took 1470 ms. Trace:
I20260709 13:05:14.067459 19551 rpcz_store.cc:276] 0709 13:05:12.589406 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:13.989027 (+1399621us) service_pool.cc:224] Handling call
0709 13:05:14.029416 (+ 40389us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:14.055972 (+ 26556us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:05:14.056001 (+    29us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:05:14.059235 (+  3234us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:05:14.059263 (+    28us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:14.059303 (+    40us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:14.059380 (+    77us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:05:14.068878 19558 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40438 (request call id 1623) took 1173 ms. Trace:
I20260709 13:05:14.074595 19408 raft_consensus.cc:3060] T 775c229504194560ba9589bc2199b089 P e5256d91808b47c195bc9b4dbd7f2b87 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:05:14.071691 19558 rpcz_store.cc:276] 0709 13:05:12.895616 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:14.020862 (+1125246us) service_pool.cc:224] Handling call
0709 13:05:14.039399 (+ 18537us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:14.065482 (+ 26083us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:05:14.065500 (+    18us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:05:14.068690 (+  3190us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:05:14.068729 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:14.068770 (+    41us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:14.068840 (+    70us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:05:14.070569 20106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1efebf73c86e432baa55533136b6e12c" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:05:14.066473 20104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c5eebf646ad445a9d1b1adc319d7b16" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:05:14.067328 21559 raft_consensus.cc:493] T 0e1085d23e8347fbbd5bce7542f4b1f4 P e61c3a8f61bb48f8a963c9480e53c168 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 127766fc592545a4997f7790f50f6076)
I20260709 13:05:14.079115 19556 raft_consensus.cc:2393] T 0cdf56e38bbc453d9438d359e5a69955 P e61c3a8f61bb48f8a963c9480e53c168 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e5256d91808b47c195bc9b4dbd7f2b87 in current term 7: Already voted for candidate e61c3a8f61bb48f8a963c9480e53c168 in this term.
I20260709 13:05:14.078799 19482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0afb57ae58a24a01850491d69f0213dd" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:05:14.057384 21529 raft_consensus.cc:515] T 7f575b143b844aa096b50997dad3516a P e61c3a8f61bb48f8a963c9480e53c168 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:14.058637 21854 raft_consensus.cc:515] T 7be9efa6559648dbb5a0f7684c4542d1 P e61c3a8f61bb48f8a963c9480e53c168 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:14.078398 21559 raft_consensus.cc:515] T 0e1085d23e8347fbbd5bce7542f4b1f4 P e61c3a8f61bb48f8a963c9480e53c168 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:05:14.081538 20103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ece3db938bc649d4a40a51522ed5259c" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:05:14.085898 19485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48824d5acfbc485ebf8c2d944e7202de" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:05:14.063773 21877 raft_consensus.cc:515] T 833a2f0775ed407a94b8924ce50adb63 P 127766fc592545a4997f7790f50f6076 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:05:14.086695 19482 raft_consensus.cc:2468] T 0afb57ae58a24a01850491d69f0213dd P 0473d2b2d01f4459b1e90fd12cc7840e [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 127766fc592545a4997f7790f50f6076 in term 5.
I20260709 13:05:14.085685 21584 raft_consensus.cc:3060] T bc225c93219c45538b53a1bd3d387e4d P 0473d2b2d01f4459b1e90fd12cc7840e [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:05:14.084982 21790 leader_election.cc:290] T 62c6c134d3d24a1ab144dd9ee6bc3f64 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:05:14.097977 19482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab43d85f64114d4ebf618930e43d9ed0" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:05:14.098513 21803 leader_election.cc:290] T 65d8cb8d6ec64f459d5a47cefab10acf P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 2 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:05:14.107638 19485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "775c229504194560ba9589bc2199b089" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:05:14.105728 20104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85c494af21f9457a85da47b9bc70c1fd" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:05:14.110232 20104 raft_consensus.cc:2468] T 85c494af21f9457a85da47b9bc70c1fd P 127766fc592545a4997f7790f50f6076 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 2.
I20260709 13:05:14.109197 19482 raft_consensus.cc:2468] T ab43d85f64114d4ebf618930e43d9ed0 P 0473d2b2d01f4459b1e90fd12cc7840e [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 127766fc592545a4997f7790f50f6076 in term 5.
I20260709 13:05:14.116035 19483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96efeaaf1057492490e9a621f37e1a2d" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:05:14.112627 21854 leader_election.cc:290] T 7be9efa6559648dbb5a0f7684c4542d1 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:05:14.117909 20106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14935b3ddf914369822e4a0547aaa355" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:05:14.118713 19483 raft_consensus.cc:2468] T 96efeaaf1057492490e9a621f37e1a2d P 0473d2b2d01f4459b1e90fd12cc7840e [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 127766fc592545a4997f7790f50f6076 in term 4.
I20260709 13:05:14.122851 20111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "833a2f0775ed407a94b8924ce50adb63" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:05:14.123548 20111 raft_consensus.cc:2468] T 833a2f0775ed407a94b8924ce50adb63 P 127766fc592545a4997f7790f50f6076 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 3.
I20260709 13:05:14.124540 20104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48824d5acfbc485ebf8c2d944e7202de" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:05:14.125607 20104 raft_consensus.cc:2410] T 48824d5acfbc485ebf8c2d944e7202de P 127766fc592545a4997f7790f50f6076 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e61c3a8f61bb48f8a963c9480e53c168 for term 5 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 13:05:14.126540 19560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b08304a0a02b42d7840c4e8ee9a6bd1a" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:05:14.127226 19560 raft_consensus.cc:2468] T b08304a0a02b42d7840c4e8ee9a6bd1a P e61c3a8f61bb48f8a963c9480e53c168 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 5.
I20260709 13:05:14.127966 21877 leader_election.cc:290] T 833a2f0775ed407a94b8924ce50adb63 P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:05:14.130054 19408 raft_consensus.cc:2468] T 775c229504194560ba9589bc2199b089 P e5256d91808b47c195bc9b4dbd7f2b87 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 127766fc592545a4997f7790f50f6076 in term 4.
I20260709 13:05:14.132047 20106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65d8cb8d6ec64f459d5a47cefab10acf" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:05:14.132383 20103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a16f7501e2444fb86d4e2778e734e02" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:05:14.132907 20106 raft_consensus.cc:2393] T 65d8cb8d6ec64f459d5a47cefab10acf P 127766fc592545a4997f7790f50f6076 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e5256d91808b47c195bc9b4dbd7f2b87 in current term 2: Already voted for candidate 127766fc592545a4997f7790f50f6076 in this term.
I20260709 13:05:14.122273 19482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "309c3ca0ca4b4f3ba129752ea2cb293b" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:05:14.134034 19482 raft_consensus.cc:2468] T 309c3ca0ca4b4f3ba129752ea2cb293b P 0473d2b2d01f4459b1e90fd12cc7840e [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 127766fc592545a4997f7790f50f6076 in term 5.
I20260709 13:05:14.134861 20109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "172b3dd13109415a955b71ac0e9d2234" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:05:14.119009 21863 leader_election.cc:290] T 0cdf56e38bbc453d9438d359e5a69955 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 7 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:05:14.136328 20111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4af19371ea874c09a0a2147040835cbb" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:05:14.137306 20109 raft_consensus.cc:2468] T 172b3dd13109415a955b71ac0e9d2234 P 127766fc592545a4997f7790f50f6076 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 1.
I20260709 13:05:14.135056 20104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab43d85f64114d4ebf618930e43d9ed0" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:05:14.138120 21529 leader_election.cc:290] T 7f575b143b844aa096b50997dad3516a P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:05:14.143321 19556 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40438 (request call id 1632) took 1116 ms. Trace:
I20260709 13:05:14.144124 19556 rpcz_store.cc:276] 0709 13:05:13.027072 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:13.566928 (+539856us) service_pool.cc:224] Handling call
0709 13:05:14.143175 (+576247us) spinlock_profiling.cc:243] Waited 73.8 ms on lock 0x7b540012af54. stack: 00007f4a79de9343 00007f4a79de9240 00007f4a797781d4 00007f4a834b6304 00007f4a834b6299 00007f4a7ce71571 00007f4a7cf0c2fa 00007f4a81ecdb17 00007f4a7b4486d4 00007f4a7b448662 00007f4a7b448591 00007f4a7b44850c 00007f4a7b4477c2 00007f4a7b24348c 00007f4a7b2428c6 00007f4a7b24226f
0709 13:05:14.143276 (+   101us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":169812736}
I20260709 13:05:14.144605 20103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70797e5783b5454ab0d0eea663e791e3" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:05:14.154338 19408 raft_consensus.cc:1275] T 7be9efa6559648dbb5a0f7684c4542d1 P e5256d91808b47c195bc9b4dbd7f2b87 [term 5 FOLLOWER]: Refusing update from remote peer 0473d2b2d01f4459b1e90fd12cc7840e: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:05:14.155903 19556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa8650e71aa14778b3d73721fc50d9fc" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:05:14.156747 19556 raft_consensus.cc:2393] T fa8650e71aa14778b3d73721fc50d9fc P e61c3a8f61bb48f8a963c9480e53c168 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e5256d91808b47c195bc9b4dbd7f2b87 in current term 6: Already voted for candidate e61c3a8f61bb48f8a963c9480e53c168 in this term.
I20260709 13:05:14.156651 19560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e36a9d6e29c4a7c860cf267efbd4c74" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:05:14.157328 19560 raft_consensus.cc:2468] T 2e36a9d6e29c4a7c860cf267efbd4c74 P e61c3a8f61bb48f8a963c9480e53c168 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 4.
I20260709 13:05:14.160565 19556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e381f1d6b8184797ad142de49be225a8" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:05:14.161564 19556 raft_consensus.cc:2393] T e381f1d6b8184797ad142de49be225a8 P e61c3a8f61bb48f8a963c9480e53c168 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e5256d91808b47c195bc9b4dbd7f2b87 in current term 4: Already voted for candidate e61c3a8f61bb48f8a963c9480e53c168 in this term.
I20260709 13:05:14.161672 21823 leader_election.cc:290] T 5ec1c4ce15e04c7e8c283a62179f2a64 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:05:14.162549 20112 raft_consensus.cc:1240] T 65d8cb8d6ec64f459d5a47cefab10acf P 127766fc592545a4997f7790f50f6076 [term 2 FOLLOWER]: Rejecting Update request from peer e61c3a8f61bb48f8a963c9480e53c168 for earlier term 1. Current term is 2. Ops: []
I20260709 13:05:14.160588 19551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df751f992649444090e27965eb1af85d" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:05:14.164794 19560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a61655d99124a29b486ba4a5b37faea" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
W20260709 13:05:14.167342 19526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.2:46257, user_credentials={real_user=slave}} blocked reactor thread for 110300us
I20260709 13:05:14.168504 20103 raft_consensus.cc:2468] T 70797e5783b5454ab0d0eea663e791e3 P 127766fc592545a4997f7790f50f6076 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 5.
I20260709 13:05:14.168779 21877 raft_consensus.cc:493] T ed7fdbcb96d14d418db9ca90a792588a P 127766fc592545a4997f7790f50f6076 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 0473d2b2d01f4459b1e90fd12cc7840e)
I20260709 13:05:14.171626 21877 raft_consensus.cc:515] T ed7fdbcb96d14d418db9ca90a792588a P 127766fc592545a4997f7790f50f6076 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
W20260709 13:05:14.173977 19452 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:14.174499 21877 leader_election.cc:290] T ed7fdbcb96d14d418db9ca90a792588a P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:05:14.179399 19308 catalog_manager.cc:5697] T ab43d85f64114d4ebf618930e43d9ed0 P 127766fc592545a4997f7790f50f6076 reported cstate change: term changed from 3 to 5, leader changed from e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1) to e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3). New cstate: current_term: 5 leader_uuid: "e61c3a8f61bb48f8a963c9480e53c168" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } attrs { replace: true } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: NON_VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: true } } }
I20260709 13:05:14.181430 19308 catalog_manager.cc:5697] T 0afb57ae58a24a01850491d69f0213dd P 127766fc592545a4997f7790f50f6076 reported cstate change: term changed from 1 to 4, leader changed from e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3) to 127766fc592545a4997f7790f50f6076 (127.17.223.4). New cstate: current_term: 4 leader_uuid: "127766fc592545a4997f7790f50f6076" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:05:14.183403 19408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab43d85f64114d4ebf618930e43d9ed0" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:05:14.186620 19408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef32ce6fdd0e40d382c79974f30295c6" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:05:14.187009 19556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9f0d59553ad444883fcf5b5909f9798" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:05:14.191459 19408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86a6797bdfe94fa496c050ceae4bd0d9" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:05:14.192392 19402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dc5b3532fe54f74876d02beffa2c230" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:05:14.192900 19408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "172b3dd13109415a955b71ac0e9d2234" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:05:14.193516 19408 raft_consensus.cc:2468] T 172b3dd13109415a955b71ac0e9d2234 P e5256d91808b47c195bc9b4dbd7f2b87 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 2.
I20260709 13:05:14.193804 19402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76cb037fc9064d13b59a8969d897ce8c" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:05:14.194200 21559 leader_election.cc:290] T 0e1085d23e8347fbbd5bce7542f4b1f4 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:05:14.194470 19402 raft_consensus.cc:2468] T 76cb037fc9064d13b59a8969d897ce8c P e5256d91808b47c195bc9b4dbd7f2b87 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 6.
I20260709 13:05:14.195271 19408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14935b3ddf914369822e4a0547aaa355" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:05:14.196477 19406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4509b76741dc428e9201c70c1658da13" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:05:14.197463 20112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36f6ba92b9ba46babe4ebd6c02e5fbd9" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:05:14.198109 20111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14935b3ddf914369822e4a0547aaa355" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:05:14.198185 20103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "172b3dd13109415a955b71ac0e9d2234" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:05:14.198727 19404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14efcc79969f41babe5529c22d59156d" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:05:14.199961 20105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0afb57ae58a24a01850491d69f0213dd" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:05:14.203691 20105 raft_consensus.cc:2468] T 0afb57ae58a24a01850491d69f0213dd P 127766fc592545a4997f7790f50f6076 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 5.
I20260709 13:05:14.201045 19411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36f6ba92b9ba46babe4ebd6c02e5fbd9" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:05:14.204793 19404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46c5bfeecc314717bffe987e6844b6d0" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 10 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:05:14.204872 19411 raft_consensus.cc:2468] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P e5256d91808b47c195bc9b4dbd7f2b87 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 6.
I20260709 13:05:14.204106 20103 raft_consensus.cc:2468] T 172b3dd13109415a955b71ac0e9d2234 P 127766fc592545a4997f7790f50f6076 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 1.
I20260709 13:05:14.205533 19404 raft_consensus.cc:2468] T 46c5bfeecc314717bffe987e6844b6d0 P e5256d91808b47c195bc9b4dbd7f2b87 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 9.
I20260709 13:05:14.205495 19408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ec1c4ce15e04c7e8c283a62179f2a64" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:05:14.206241 20105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ec1c4ce15e04c7e8c283a62179f2a64" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:05:14.206789 20104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab43d85f64114d4ebf618930e43d9ed0" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:05:14.208014 19404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edd7d470b5014c9489be7f41f64355c9" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:05:14.209323 19406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9962423cb4e54fcfa5de01daf68a86e7" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:05:14.210075 20105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9962423cb4e54fcfa5de01daf68a86e7" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:05:14.210127 19406 raft_consensus.cc:2468] T 9962423cb4e54fcfa5de01daf68a86e7 P e5256d91808b47c195bc9b4dbd7f2b87 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 8.
I20260709 13:05:14.211023 19411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "179fd671030940b4b4a4e24bcc4aba0a" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:05:14.211694 19411 raft_consensus.cc:2468] T 179fd671030940b4b4a4e24bcc4aba0a P e5256d91808b47c195bc9b4dbd7f2b87 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 3.
I20260709 13:05:14.213061 19551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22196caba61445d3bec98a0aab3c337d" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:05:14.213021 19558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7be9efa6559648dbb5a0f7684c4542d1" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:05:14.213940 19558 raft_consensus.cc:2468] T 7be9efa6559648dbb5a0f7684c4542d1 P e61c3a8f61bb48f8a963c9480e53c168 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 5.
I20260709 13:05:14.214541 19403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85c494af21f9457a85da47b9bc70c1fd" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:05:14.216223 20104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14efcc79969f41babe5529c22d59156d" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:05:14.217052 20104 raft_consensus.cc:2468] T 14efcc79969f41babe5529c22d59156d P 127766fc592545a4997f7790f50f6076 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 4.
I20260709 13:05:14.217819 19410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "833a2f0775ed407a94b8924ce50adb63" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:05:14.218945 19403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65d8cb8d6ec64f459d5a47cefab10acf" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
I20260709 13:05:14.219082 19405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab43d85f64114d4ebf618930e43d9ed0" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:05:14.219719 20110 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35874 (request call id 443) took 2770 ms. Trace:
I20260709 13:05:14.220268 19410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e381f1d6b8184797ad142de49be225a8" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:05:14.221037 19410 raft_consensus.cc:2468] T e381f1d6b8184797ad142de49be225a8 P e5256d91808b47c195bc9b4dbd7f2b87 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 3.
I20260709 13:05:14.221309 19409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e5873a19244c5ebbcd38e126796ee7" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:05:14.221935 19409 raft_consensus.cc:2468] T d1e5873a19244c5ebbcd38e126796ee7 P e5256d91808b47c195bc9b4dbd7f2b87 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 6.
I20260709 13:05:14.220089 20110 rpcz_store.cc:276] 0709 13:05:11.449583 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:11.450380 (+   797us) service_pool.cc:224] Handling call
0709 13:05:11.450631 (+   251us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:11.923092 (+472461us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:05:12.362517 (+439425us) log.cc:844] Serialized 14 byte log entry
0709 13:05:13.126513 (+763996us) log.cc:844] Serialized 14 byte log entry
0709 13:05:13.273623 (+147110us) spinlock_profiling.cc:243] Waited 1.93 ms on lock 0x7b18003cfb20. stack: 00007f4a79de9343 00007f4a79de9240 00007f4a797781d4 00007f4a834b6304 00007f4a834b6299 00007f4a82ce3de1 00007f4a82cf05b1 00007f4a79e1b522 00007f4a79e1d7c1 00007f4a79e1d779 00007f4a79e1d709 00007f4a79e1d6d1 00007f4a79e1c9cd 000000000038f354 000000000038f199 00007f4a79dfe83a
0709 13:05:13.802685 (+529062us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:05:13.845390 (+ 42705us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:05:13.954122 (+108732us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:14.219360 (+265238us) spinlock_profiling.cc:243] Waited 471 ms on lock 0x7b54004169d4. stack: 00007f4a79de9343 00007f4a79de9240 00007f4a797781d4 00007f4a834b6304 00007f4a834b6299 00007f4a7ce71571 00007f4a7cf08e01 00007f4a7cf0783e 00007f4a81ecc419 00007f4a7b443bd4 00007f4a7b443b62 00007f4a7b443a91 00007f4a7b443a0c 00007f4a7b442cc2 00007f4a7b24348c 00007f4a7b2428c6
0709 13:05:14.219413 (+    53us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:14.219559 (+   146us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":872,"prepare.queue_time_us":676111,"prepare.run_cpu_time_us":102,"prepare.run_wall_time_us":111,"raft.queue_time_us":44615,"raft.run_cpu_time_us":338,"raft.run_wall_time_us":33662,"spinlock_wait_cycles":1087884032,"thread_start_us":1062389,"threads_started":3,"wal-append.queue_time_us":821089}
I20260709 13:05:14.223218 19402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76cb037fc9064d13b59a8969d897ce8c" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:05:14.224856 19410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22196caba61445d3bec98a0aab3c337d" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:05:14.225948 19410 raft_consensus.cc:2468] T 22196caba61445d3bec98a0aab3c337d P e5256d91808b47c195bc9b4dbd7f2b87 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 4.
I20260709 13:05:14.228567 20111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62c6c134d3d24a1ab144dd9ee6bc3f64" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:05:14.229198 20111 raft_consensus.cc:2468] T 62c6c134d3d24a1ab144dd9ee6bc3f64 P 127766fc592545a4997f7790f50f6076 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 6.
I20260709 13:05:14.225116 19402 raft_consensus.cc:2393] T 76cb037fc9064d13b59a8969d897ce8c P e5256d91808b47c195bc9b4dbd7f2b87 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e61c3a8f61bb48f8a963c9480e53c168 in current term 6: Already voted for candidate e5256d91808b47c195bc9b4dbd7f2b87 in this term.
I20260709 13:05:14.229825 19407 raft_consensus.cc:1240] T 775c229504194560ba9589bc2199b089 P e5256d91808b47c195bc9b4dbd7f2b87 [term 4 FOLLOWER]: Rejecting Update request from peer 0473d2b2d01f4459b1e90fd12cc7840e for earlier term 3. Current term is 4. Ops: []
I20260709 13:05:14.231174 20105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36f6ba92b9ba46babe4ebd6c02e5fbd9" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:05:14.231429 20075 leader_election.cc:304] T 775c229504194560ba9589bc2199b089 P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 127766fc592545a4997f7790f50f6076, e5256d91808b47c195bc9b4dbd7f2b87; no voters: 
I20260709 13:05:14.225140 19560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21e14947d70440f19044d8f75c31e1f9" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:05:14.232615 19560 raft_consensus.cc:2468] T 21e14947d70440f19044d8f75c31e1f9 P e61c3a8f61bb48f8a963c9480e53c168 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 5.
I20260709 13:05:14.223788 20103 raft_consensus.cc:1240] T 775c229504194560ba9589bc2199b089 P 127766fc592545a4997f7790f50f6076 [term 4 FOLLOWER]: Rejecting Update request from peer 0473d2b2d01f4459b1e90fd12cc7840e for earlier term 3. Current term is 4. Ops: []
I20260709 13:05:14.234786 21403 raft_consensus.cc:2804] T 775c229504194560ba9589bc2199b089 P 127766fc592545a4997f7790f50f6076 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:05:14.235433 21403 raft_consensus.cc:697] T 775c229504194560ba9589bc2199b089 P 127766fc592545a4997f7790f50f6076 [term 4 LEADER]: Becoming Leader. State: Replica: 127766fc592545a4997f7790f50f6076, State: Running, Role: LEADER
I20260709 13:05:14.236701 21403 consensus_queue.cc:237] T 775c229504194560ba9589bc2199b089 P 127766fc592545a4997f7790f50f6076 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:05:14.240641 20103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ec1c4ce15e04c7e8c283a62179f2a64" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:05:14.241781 19556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86a6797bdfe94fa496c050ceae4bd0d9" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:05:14.208794 19404 raft_consensus.cc:2468] T edd7d470b5014c9489be7f41f64355c9 P e5256d91808b47c195bc9b4dbd7f2b87 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 3.
I20260709 13:05:14.227823 19405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e1f505cb0f1427bbd698ac889d80821" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:05:14.225962 20110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e1085d23e8347fbbd5bce7542f4b1f4" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:05:14.225348 19406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc225c93219c45538b53a1bd3d387e4d" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 9 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:05:14.244428 19406 raft_consensus.cc:2410] T bc225c93219c45538b53a1bd3d387e4d P e5256d91808b47c195bc9b4dbd7f2b87 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e61c3a8f61bb48f8a963c9480e53c168 for term 9 because replica has last-logged OpId of term: 7 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 3.
I20260709 13:05:14.247068 19558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0afb57ae58a24a01850491d69f0213dd" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:05:14.248013 19554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edd7d470b5014c9489be7f41f64355c9" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:05:14.254873 19558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e381f1d6b8184797ad142de49be225a8" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:05:14.254863 19554 raft_consensus.cc:2468] T edd7d470b5014c9489be7f41f64355c9 P e61c3a8f61bb48f8a963c9480e53c168 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 4.
I20260709 13:05:14.255723 19558 raft_consensus.cc:2468] T e381f1d6b8184797ad142de49be225a8 P e61c3a8f61bb48f8a963c9480e53c168 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 4.
I20260709 13:05:14.249128 19557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14935b3ddf914369822e4a0547aaa355" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:05:14.256716 19554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "179fd671030940b4b4a4e24bcc4aba0a" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:05:14.257561 19554 raft_consensus.cc:2468] T 179fd671030940b4b4a4e24bcc4aba0a P e61c3a8f61bb48f8a963c9480e53c168 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 4.
I20260709 13:05:14.247494 19559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46c5bfeecc314717bffe987e6844b6d0" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 10 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:05:14.258991 19556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dc5b3532fe54f74876d02beffa2c230" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:05:14.260609 19409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2725d2c4cb054f18b0fc8f735c15f6c2" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:05:14.260968 19377 leader_election.cc:304] T 2725d2c4cb054f18b0fc8f735c15f6c2 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87; no voters: 
I20260709 13:05:14.262954 19405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edd7d470b5014c9489be7f41f64355c9" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:05:14.263689 19404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9f0d59553ad444883fcf5b5909f9798" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:05:14.264377 19410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1b10566f45d4a7d9029858330e02d5b" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:05:14.245464 19555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4509b76741dc428e9201c70c1658da13" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:05:14.264526 19403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a61655d99124a29b486ba4a5b37faea" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:05:14.265121 19408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "217b5fae677b4971b3bbd2f357a1f7ff" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:05:14.265699 19407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14935b3ddf914369822e4a0547aaa355" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:05:14.265822 19402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4509b76741dc428e9201c70c1658da13" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:05:14.265699 19557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22196caba61445d3bec98a0aab3c337d" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:05:14.266474 19558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e1085d23e8347fbbd5bce7542f4b1f4" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:05:14.266613 19406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa8650e71aa14778b3d73721fc50d9fc" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:05:14.268492 19560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76cb037fc9064d13b59a8969d897ce8c" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:05:14.244979 19411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ece3db938bc649d4a40a51522ed5259c" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:05:14.276537 19560 raft_consensus.cc:2468] T 76cb037fc9064d13b59a8969d897ce8c P e61c3a8f61bb48f8a963c9480e53c168 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 5.
I20260709 13:05:14.277006 19404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21e14947d70440f19044d8f75c31e1f9" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:05:14.280269 19402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b08304a0a02b42d7840c4e8ee9a6bd1a" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:05:14.280412 19406 raft_consensus.cc:2468] T fa8650e71aa14778b3d73721fc50d9fc P e5256d91808b47c195bc9b4dbd7f2b87 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 5.
I20260709 13:05:14.281198 19402 raft_consensus.cc:2468] T b08304a0a02b42d7840c4e8ee9a6bd1a P e5256d91808b47c195bc9b4dbd7f2b87 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 5.
I20260709 13:05:14.282286 19405 raft_consensus.cc:2468] T edd7d470b5014c9489be7f41f64355c9 P e5256d91808b47c195bc9b4dbd7f2b87 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 3.
I20260709 13:05:14.280248 19409 raft_consensus.cc:2468] T 2725d2c4cb054f18b0fc8f735c15f6c2 P e5256d91808b47c195bc9b4dbd7f2b87 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 5.
I20260709 13:05:14.284323 21837 raft_consensus.cc:493] T a08760e15aac4630a629431f56024dc8 P 0473d2b2d01f4459b1e90fd12cc7840e [term 5 FOLLOWER]: Starting pre-election (detected failure of leader e5256d91808b47c195bc9b4dbd7f2b87)
I20260709 13:05:14.284291 19308 catalog_manager.cc:5697] T 6c5eebf646ad445a9d1b1adc319d7b16 P 127766fc592545a4997f7790f50f6076 reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "127766fc592545a4997f7790f50f6076" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:05:14.285070 21837 raft_consensus.cc:515] T a08760e15aac4630a629431f56024dc8 P 0473d2b2d01f4459b1e90fd12cc7840e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:14.286077 19308 catalog_manager.cc:5697] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P 127766fc592545a4997f7790f50f6076 reported cstate change: term changed from 4 to 6, leader changed from e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1) to 127766fc592545a4997f7790f50f6076 (127.17.223.4). New cstate: current_term: 6 leader_uuid: "127766fc592545a4997f7790f50f6076" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:05:14.295467 21867 raft_consensus.cc:2804] T 2725d2c4cb054f18b0fc8f735c15f6c2 P e5256d91808b47c195bc9b4dbd7f2b87 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:05:14.295696 21837 leader_election.cc:290] T a08760e15aac4630a629431f56024dc8 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:05:14.295992 21867 raft_consensus.cc:493] T 2725d2c4cb054f18b0fc8f735c15f6c2 P e5256d91808b47c195bc9b4dbd7f2b87 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:14.296517 21867 raft_consensus.cc:3060] T 2725d2c4cb054f18b0fc8f735c15f6c2 P e5256d91808b47c195bc9b4dbd7f2b87 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:05:14.297482 19449 leader_election.cc:304] T 1f85fc4b527a48848e5faa083b604e36 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, 127766fc592545a4997f7790f50f6076; no voters: e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:05:14.297901 20104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff9b0eddd810459b82d91c60777c10eb" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:05:14.299132 21767 raft_consensus.cc:2804] T 1f85fc4b527a48848e5faa083b604e36 P 0473d2b2d01f4459b1e90fd12cc7840e [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:05:14.299541 21767 raft_consensus.cc:493] T 1f85fc4b527a48848e5faa083b604e36 P 0473d2b2d01f4459b1e90fd12cc7840e [term 2 FOLLOWER]: Starting leader election (detected failure of leader e5256d91808b47c195bc9b4dbd7f2b87)
I20260709 13:05:14.299911 21767 raft_consensus.cc:3060] T 1f85fc4b527a48848e5faa083b604e36 P 0473d2b2d01f4459b1e90fd12cc7840e [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:05:14.301484 19449 consensus_peers.cc:597] T 7be9efa6559648dbb5a0f7684c4542d1 P 0473d2b2d01f4459b1e90fd12cc7840e -> Peer 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121): Couldn't send request to peer 127766fc592545a4997f7790f50f6076. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 7be9efa6559648dbb5a0f7684c4542d1. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:05:14.303035 19449 leader_election.cc:304] T 0afb57ae58a24a01850491d69f0213dd P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, 127766fc592545a4997f7790f50f6076; no voters: 
I20260709 13:05:14.304922 21867 raft_consensus.cc:515] T 2725d2c4cb054f18b0fc8f735c15f6c2 P e5256d91808b47c195bc9b4dbd7f2b87 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:14.334488 21867 leader_election.cc:290] T 2725d2c4cb054f18b0fc8f735c15f6c2 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 6 election: Requested vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:05:14.336020 19554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65d8cb8d6ec64f459d5a47cefab10acf" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:05:14.336331 19449 leader_election.cc:304] T 172b3dd13109415a955b71ac0e9d2234 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, 127766fc592545a4997f7790f50f6076; no voters: 
I20260709 13:05:14.340834 21837 raft_consensus.cc:2804] T 0afb57ae58a24a01850491d69f0213dd P 0473d2b2d01f4459b1e90fd12cc7840e [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:05:14.341073 21700 raft_consensus.cc:2804] T 172b3dd13109415a955b71ac0e9d2234 P 0473d2b2d01f4459b1e90fd12cc7840e [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:05:14.341313 21837 raft_consensus.cc:493] T 0afb57ae58a24a01850491d69f0213dd P 0473d2b2d01f4459b1e90fd12cc7840e [term 5 FOLLOWER]: Starting leader election (detected failure of leader e61c3a8f61bb48f8a963c9480e53c168)
I20260709 13:05:14.341701 21700 raft_consensus.cc:493] T 172b3dd13109415a955b71ac0e9d2234 P 0473d2b2d01f4459b1e90fd12cc7840e [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:14.312870 19405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dc5b3532fe54f74876d02beffa2c230" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:05:14.313690 19409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "833a2f0775ed407a94b8924ce50adb63" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:05:14.315845 19553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab43d85f64114d4ebf618930e43d9ed0" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:05:14.317371 19556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e1f505cb0f1427bbd698ac889d80821" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:05:14.340445 19554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "833a2f0775ed407a94b8924ce50adb63" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:05:14.342373 21700 raft_consensus.cc:3060] T 172b3dd13109415a955b71ac0e9d2234 P 0473d2b2d01f4459b1e90fd12cc7840e [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:14.352042 19554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62c6c134d3d24a1ab144dd9ee6bc3f64" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:05:14.352926 19449 leader_election.cc:304] T 14efcc79969f41babe5529c22d59156d P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, 127766fc592545a4997f7790f50f6076; no voters: 
W20260709 13:05:14.357143 19305 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:44698 (request call id 229) took 17425 ms (client timeout 15000 ms). Trace:
I20260709 13:05:14.323434 20078 leader_election.cc:304] T 14935b3ddf914369822e4a0547aaa355 P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, 127766fc592545a4997f7790f50f6076, e61c3a8f61bb48f8a963c9480e53c168; no voters: e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:05:14.332185 19402 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "179fd671030940b4b4a4e24bcc4aba0a"
dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
mode: GRACEFUL
new_leader_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
 from {username='slave'} at 127.0.0.1:37312
I20260709 13:05:14.341823 21837 raft_consensus.cc:3060] T 0afb57ae58a24a01850491d69f0213dd P 0473d2b2d01f4459b1e90fd12cc7840e [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:05:14.368875 20078 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.2:46257, user_credentials={real_user=slave}} blocked reactor thread for 45561.7us
I20260709 13:05:14.369047 19374 leader_election.cc:304] T 172b3dd13109415a955b71ac0e9d2234 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 127766fc592545a4997f7790f50f6076, e5256d91808b47c195bc9b4dbd7f2b87; no voters: 
I20260709 13:05:14.369695 20078 leader_election.cc:304] T 62c6c134d3d24a1ab144dd9ee6bc3f64 P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, 127766fc592545a4997f7790f50f6076; no voters: e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:05:14.369935 21867 raft_consensus.cc:2804] T 172b3dd13109415a955b71ac0e9d2234 P e5256d91808b47c195bc9b4dbd7f2b87 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:05:14.370311 21867 raft_consensus.cc:493] T 172b3dd13109415a955b71ac0e9d2234 P e5256d91808b47c195bc9b4dbd7f2b87 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:14.370697 21867 raft_consensus.cc:3060] T 172b3dd13109415a955b71ac0e9d2234 P e5256d91808b47c195bc9b4dbd7f2b87 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:14.371001 21894 raft_consensus.cc:2804] T 14935b3ddf914369822e4a0547aaa355 P 127766fc592545a4997f7790f50f6076 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:05:14.371379 21894 raft_consensus.cc:493] T 14935b3ddf914369822e4a0547aaa355 P 127766fc592545a4997f7790f50f6076 [term 4 FOLLOWER]: Starting leader election (detected failure of leader e5256d91808b47c195bc9b4dbd7f2b87)
I20260709 13:05:14.371760 21894 raft_consensus.cc:3060] T 14935b3ddf914369822e4a0547aaa355 P 127766fc592545a4997f7790f50f6076 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:05:14.373888 21892 raft_consensus.cc:2804] T 62c6c134d3d24a1ab144dd9ee6bc3f64 P 127766fc592545a4997f7790f50f6076 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:05:14.373909 20104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65d8cb8d6ec64f459d5a47cefab10acf" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:05:14.321324 19560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96efeaaf1057492490e9a621f37e1a2d" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:05:14.374989 20104 raft_consensus.cc:2393] T 65d8cb8d6ec64f459d5a47cefab10acf P 127766fc592545a4997f7790f50f6076 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e5256d91808b47c195bc9b4dbd7f2b87 in current term 2: Already voted for candidate 127766fc592545a4997f7790f50f6076 in this term.
I20260709 13:05:14.309681 21767 raft_consensus.cc:515] T 1f85fc4b527a48848e5faa083b604e36 P 0473d2b2d01f4459b1e90fd12cc7840e [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:05:14.363241 19449 leader_election.cc:304] T 62c6c134d3d24a1ab144dd9ee6bc3f64 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, 127766fc592545a4997f7790f50f6076; no voters: 
I20260709 13:05:14.365741 19402 raft_consensus.cc:606] T 179fd671030940b4b4a4e24bcc4aba0a P e5256d91808b47c195bc9b4dbd7f2b87 [term 3 FOLLOWER]: Received request to transfer leadership to TS e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:05:14.376667 19402 raft_consensus.cc:614] T 179fd671030940b4b4a4e24bcc4aba0a P e5256d91808b47c195bc9b4dbd7f2b87 [term 3 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:05:14.368417 21858 raft_consensus.cc:2804] T 14efcc79969f41babe5529c22d59156d P 0473d2b2d01f4459b1e90fd12cc7840e [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:05:14.374495 21892 raft_consensus.cc:493] T 62c6c134d3d24a1ab144dd9ee6bc3f64 P 127766fc592545a4997f7790f50f6076 [term 6 FOLLOWER]: Starting leader election (detected failure of leader e61c3a8f61bb48f8a963c9480e53c168)
I20260709 13:05:14.377688 21858 raft_consensus.cc:493] T 14efcc79969f41babe5529c22d59156d P 0473d2b2d01f4459b1e90fd12cc7840e [term 4 FOLLOWER]: Starting leader election (detected failure of leader e5256d91808b47c195bc9b4dbd7f2b87)
I20260709 13:05:14.377995 21892 raft_consensus.cc:3060] T 62c6c134d3d24a1ab144dd9ee6bc3f64 P 127766fc592545a4997f7790f50f6076 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:05:14.378182 21858 raft_consensus.cc:3060] T 14efcc79969f41babe5529c22d59156d P 0473d2b2d01f4459b1e90fd12cc7840e [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:05:14.393644 19558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85c494af21f9457a85da47b9bc70c1fd" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:05:14.397013 19558 raft_consensus.cc:2468] T 85c494af21f9457a85da47b9bc70c1fd P e61c3a8f61bb48f8a963c9480e53c168 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 127766fc592545a4997f7790f50f6076 in term 2.
I20260709 13:05:14.399751 19560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed7fdbcb96d14d418db9ca90a792588a" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:05:14.402415 20110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ece3db938bc649d4a40a51522ed5259c" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:05:14.404179 19374 leader_election.cc:304] T 65d8cb8d6ec64f459d5a47cefab10acf P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87; no voters: 127766fc592545a4997f7790f50f6076, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:05:14.405725 20105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70797e5783b5454ab0d0eea663e791e3" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076"
I20260709 13:05:14.406306 20105 raft_consensus.cc:3060] T 70797e5783b5454ab0d0eea663e791e3 P 127766fc592545a4997f7790f50f6076 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:05:14.414810 19485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "179fd671030940b4b4a4e24bcc4aba0a" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:05:14.420152 19481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b08304a0a02b42d7840c4e8ee9a6bd1a" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:05:14.421469 20111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa731b585f684a7fb2d106c50f143b83" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:05:14.424135 19482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76cb037fc9064d13b59a8969d897ce8c" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
W20260709 13:05:14.366315 19305 rpcz_store.cc:269] 0709 13:04:56.931281 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:56.932329 (+  1048us) service_pool.cc:224] Handling call
0709 13:05:14.356896 (+17424567us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:05:09.478716 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:05:09.479444 (+   728us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:05:09.479479 (+    35us) write_op.cc:435] Acquired schema lock
0709 13:05:09.479499 (+    20us) tablet.cc:662] Decoding operations
0709 13:05:09.479830 (+   331us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:05:09.479902 (+    72us) write_op.cc:641] Partition lock acquired for write op
0709 13:05:09.479937 (+    35us) tablet.cc:685] Acquiring locks for 1 operations
0709 13:05:09.480118 (+   181us) tablet.cc:701] Row locks acquired
0709 13:05:09.480135 (+    17us) write_op.cc:260] PREPARE: finished
0709 13:05:09.480263 (+   128us) write_op.cc:270] Start()
0709 13:05:09.480379 (+   116us) write_op.cc:276] Timestamp: P: 1783602309480223 usec, L: 0
0709 13:05:09.480401 (+    22us) op_driver.cc:348] REPLICATION: starting
0709 13:05:09.481046 (+   645us) log.cc:844] Serialized 538 byte log entry
0709 13:05:09.836092 (+355046us) op_driver.cc:464] REPLICATION: finished
0709 13:05:11.486181 (+1650089us) write_op.cc:301] APPLY: starting
0709 13:05:11.540784 (+ 54603us) tablet.cc:1367] starting BulkCheckPresence
0709 13:05:11.581769 (+ 40985us) tablet.cc:1370] finished BulkCheckPresence
0709 13:05:11.638809 (+ 57040us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:05:11.649582 (+ 10773us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:05:11.737285 (+ 87703us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0709 13:05:11.737360 (+    75us) write_op.cc:312] APPLY: finished
0709 13:05:11.746618 (+  9258us) log.cc:844] Serialized 23 byte log entry
0709 13:05:11.880250 (+133632us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:05:11.887626 (+  7376us) write_op.cc:454] Released schema lock
0709 13:05:11.893023 (+  5397us) write_op.cc:341] FINISH: Updating metrics
0709 13:05:11.920332 (+ 27309us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:05:11.921815 (+  1483us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":45817,"reported_tablets":32,"child_traces":[["op",{"apply.queue_time_us":1306786,"apply.run_cpu_time_us":11972,"apply.run_wall_time_us":502971,"num_ops":1,"prepare.queue_time_us":229993,"prepare.run_cpu_time_us":14790,"prepare.run_wall_time_us":146798,"raft.queue_time_us":96854,"raft.run_cpu_time_us":15828,"raft.run_wall_time_us":486582,"replication_time_us":326551,"thread_start_us":590251,"threads_started":5,"wal-append.queue_time_us":385603,"wal-append.run_cpu_time_us":67760,"wal-append.run_wall_time_us":2604394}]]}
I20260709 13:05:14.425299 20112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e1085d23e8347fbbd5bce7542f4b1f4" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:05:14.426199 21372 raft_consensus.cc:493] T fa8650e71aa14778b3d73721fc50d9fc P 0473d2b2d01f4459b1e90fd12cc7840e [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:14.426472 19483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86a6797bdfe94fa496c050ceae4bd0d9" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:05:14.426774 21372 raft_consensus.cc:515] T fa8650e71aa14778b3d73721fc50d9fc P 0473d2b2d01f4459b1e90fd12cc7840e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:14.427584 19375 leader_election.cc:304] T 2a16f7501e2444fb86d4e2778e734e02 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168; no voters: 127766fc592545a4997f7790f50f6076
I20260709 13:05:14.427809 19409 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "309c3ca0ca4b4f3ba129752ea2cb293b"
dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
mode: GRACEFUL
new_leader_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
 from {username='slave'} at 127.0.0.1:37312
I20260709 13:05:14.428357 19409 raft_consensus.cc:606] T 309c3ca0ca4b4f3ba129752ea2cb293b P e5256d91808b47c195bc9b4dbd7f2b87 [term 5 LEADER]: Received request to transfer leadership to TS e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:05:14.428728 19486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cdf56e38bbc453d9438d359e5a69955" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:05:14.428922 21372 leader_election.cc:290] T fa8650e71aa14778b3d73721fc50d9fc P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:05:14.429339 19486 raft_consensus.cc:2468] T 0cdf56e38bbc453d9438d359e5a69955 P 0473d2b2d01f4459b1e90fd12cc7840e [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 5.
I20260709 13:05:14.417394 21790 consensus_queue.cc:1059] T 775c229504194560ba9589bc2199b089 P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.012s
I20260709 13:05:14.430311 19486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e381f1d6b8184797ad142de49be225a8" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:05:14.426870 19485 raft_consensus.cc:2393] T 179fd671030940b4b4a4e24bcc4aba0a P 0473d2b2d01f4459b1e90fd12cc7840e [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e5256d91808b47c195bc9b4dbd7f2b87 in current term 4: Already voted for candidate e61c3a8f61bb48f8a963c9480e53c168 in this term.
I20260709 13:05:14.430590 21790 raft_consensus.cc:3055] T 775c229504194560ba9589bc2199b089 P 0473d2b2d01f4459b1e90fd12cc7840e [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:05:14.445029 21790 raft_consensus.cc:740] T 775c229504194560ba9589bc2199b089 P 0473d2b2d01f4459b1e90fd12cc7840e [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 0473d2b2d01f4459b1e90fd12cc7840e, State: Running, Role: LEADER
I20260709 13:05:14.445284 19479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b74109013a140ada21feeef92d6f563" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:05:14.426806 21731 raft_consensus.cc:2804] T 62c6c134d3d24a1ab144dd9ee6bc3f64 P 0473d2b2d01f4459b1e90fd12cc7840e [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:05:14.445895 21731 raft_consensus.cc:493] T 62c6c134d3d24a1ab144dd9ee6bc3f64 P 0473d2b2d01f4459b1e90fd12cc7840e [term 6 FOLLOWER]: Starting leader election (detected failure of leader e61c3a8f61bb48f8a963c9480e53c168)
I20260709 13:05:14.446231 21731 raft_consensus.cc:3060] T 62c6c134d3d24a1ab144dd9ee6bc3f64 P 0473d2b2d01f4459b1e90fd12cc7840e [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:05:14.446501 19479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "172b3dd13109415a955b71ac0e9d2234" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:05:14.446132 21790 consensus_queue.cc:260] T 775c229504194560ba9589bc2199b089 P 0473d2b2d01f4459b1e90fd12cc7840e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:05:14.447587 21790 raft_consensus.cc:3060] T 775c229504194560ba9589bc2199b089 P 0473d2b2d01f4459b1e90fd12cc7840e [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:05:14.449352 21700 raft_consensus.cc:515] T 172b3dd13109415a955b71ac0e9d2234 P 0473d2b2d01f4459b1e90fd12cc7840e [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:05:14.427160 19478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edd7d470b5014c9489be7f41f64355c9" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:05:14.424770 19482 raft_consensus.cc:2468] T 76cb037fc9064d13b59a8969d897ce8c P 0473d2b2d01f4459b1e90fd12cc7840e [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 6.
I20260709 13:05:14.439203 19484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e36a9d6e29c4a7c860cf267efbd4c74" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:05:14.440165 19485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e381f1d6b8184797ad142de49be225a8" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:05:14.442914 19480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28af091831594f9d8e96482078cc7625" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:05:14.451057 19478 raft_consensus.cc:2468] T edd7d470b5014c9489be7f41f64355c9 P 0473d2b2d01f4459b1e90fd12cc7840e [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 4.
I20260709 13:05:14.432412 19483 raft_consensus.cc:2468] T 86a6797bdfe94fa496c050ceae4bd0d9 P 0473d2b2d01f4459b1e90fd12cc7840e [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 4.
W20260709 13:05:14.445048 20078 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.2:46257, user_credentials={real_user=slave}} blocked reactor thread for 69201.8us
I20260709 13:05:14.443184 21837 raft_consensus.cc:515] T 0afb57ae58a24a01850491d69f0213dd P 0473d2b2d01f4459b1e90fd12cc7840e [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:05:14.443507 19477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "217b5fae677b4971b3bbd2f357a1f7ff" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:05:14.443972 20103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed7fdbcb96d14d418db9ca90a792588a" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:05:14.444108 21858 raft_consensus.cc:515] T 14efcc79969f41babe5529c22d59156d P 0473d2b2d01f4459b1e90fd12cc7840e [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
W20260709 13:05:14.453140 19374 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.4:43121, user_credentials={real_user=slave}} blocked reactor thread for 49066.5us
I20260709 13:05:14.454655 20078 leader_election.cc:304] T 172b3dd13109415a955b71ac0e9d2234 P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, 127766fc592545a4997f7790f50f6076; no voters: e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:05:14.454871 21893 consensus_queue.cc:1048] T 5ec1c4ce15e04c7e8c283a62179f2a64 P 127766fc592545a4997f7790f50f6076 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:05:14.462553 19483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9f0d59553ad444883fcf5b5909f9798" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
W20260709 13:05:14.491402 19375 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.3:36891, user_credentials={real_user=slave}} blocked reactor thread for 93772.5us
I20260709 13:05:14.491499 19483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff75a1d4cb1f493db8f71ddc136ba9ab" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:05:14.492411 19375 leader_election.cc:304] T ab43d85f64114d4ebf618930e43d9ed0 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87; no voters: 127766fc592545a4997f7790f50f6076, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:05:14.493045 19483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e5873a19244c5ebbcd38e126796ee7" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:05:14.493546 21411 raft_consensus.cc:2749] T ab43d85f64114d4ebf618930e43d9ed0 P e5256d91808b47c195bc9b4dbd7f2b87 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:05:14.494208 19375 leader_election.cc:304] T d1e5873a19244c5ebbcd38e126796ee7 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:05:14.463994 19477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a61655d99124a29b486ba4a5b37faea" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:05:14.495690 19478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21e14947d70440f19044d8f75c31e1f9" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:05:14.495884 19477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc225c93219c45538b53a1bd3d387e4d" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 9 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:05:14.496758 19478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2725d2c4cb054f18b0fc8f735c15f6c2" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:05:14.497025 19477 raft_consensus.cc:2410] T bc225c93219c45538b53a1bd3d387e4d P 0473d2b2d01f4459b1e90fd12cc7840e [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e61c3a8f61bb48f8a963c9480e53c168 for term 9 because replica has last-logged OpId of term: 7 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 3.
I20260709 13:05:14.497344 19478 raft_consensus.cc:2468] T 2725d2c4cb054f18b0fc8f735c15f6c2 P 0473d2b2d01f4459b1e90fd12cc7840e [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 5.
I20260709 13:05:14.498144 21825 raft_consensus.cc:493] T 28af091831594f9d8e96482078cc7625 P e61c3a8f61bb48f8a963c9480e53c168 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 0473d2b2d01f4459b1e90fd12cc7840e)
I20260709 13:05:14.499032 21825 raft_consensus.cc:515] T 28af091831594f9d8e96482078cc7625 P e61c3a8f61bb48f8a963c9480e53c168 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:14.468056 19481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1efebf73c86e432baa55533136b6e12c" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:05:14.460888 19374 leader_election.cc:304] T ece3db938bc649d4a40a51522ed5259c P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87; no voters: 127766fc592545a4997f7790f50f6076, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:05:14.503582 19481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dc5b3532fe54f74876d02beffa2c230" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:05:14.418401 20104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4af19371ea874c09a0a2147040835cbb" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
W20260709 13:05:14.504400 19374 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.4:43121, user_credentials={real_user=slave}} blocked reactor thread for 43619.6us
I20260709 13:05:14.503870 19523 leader_election.cc:304] T 85c494af21f9457a85da47b9bc70c1fd P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 127766fc592545a4997f7790f50f6076, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:05:14.506070 21825 leader_election.cc:290] T 28af091831594f9d8e96482078cc7625 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:05:14.507046 21825 raft_consensus.cc:2804] T 85c494af21f9457a85da47b9bc70c1fd P e61c3a8f61bb48f8a963c9480e53c168 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:05:14.480824 19485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76cb037fc9064d13b59a8969d897ce8c" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:05:14.507258 19523 leader_election.cc:304] T 833a2f0775ed407a94b8924ce50adb63 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 127766fc592545a4997f7790f50f6076, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:05:14.507913 19485 raft_consensus.cc:2468] T 76cb037fc9064d13b59a8969d897ce8c P 0473d2b2d01f4459b1e90fd12cc7840e [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 6.
I20260709 13:05:14.509064 19485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa8650e71aa14778b3d73721fc50d9fc" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:05:14.509362 21853 raft_consensus.cc:2804] T 833a2f0775ed407a94b8924ce50adb63 P e61c3a8f61bb48f8a963c9480e53c168 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:05:14.509877 21853 raft_consensus.cc:493] T 833a2f0775ed407a94b8924ce50adb63 P e61c3a8f61bb48f8a963c9480e53c168 [term 3 FOLLOWER]: Starting leader election (detected failure of leader e5256d91808b47c195bc9b4dbd7f2b87)
I20260709 13:05:14.510385 21853 raft_consensus.cc:3060] T 833a2f0775ed407a94b8924ce50adb63 P e61c3a8f61bb48f8a963c9480e53c168 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:05:14.483079 19482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7be9efa6559648dbb5a0f7684c4542d1" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:05:14.482215 19484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1b10566f45d4a7d9029858330e02d5b" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:05:14.513911 19482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9f0d59553ad444883fcf5b5909f9798" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:05:14.515028 19482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36f6ba92b9ba46babe4ebd6c02e5fbd9" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:05:14.486545 21823 raft_consensus.cc:2804] T 2a16f7501e2444fb86d4e2778e734e02 P e5256d91808b47c195bc9b4dbd7f2b87 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:05:14.515682 21823 raft_consensus.cc:493] T 2a16f7501e2444fb86d4e2778e734e02 P e5256d91808b47c195bc9b4dbd7f2b87 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 127766fc592545a4997f7790f50f6076)
I20260709 13:05:14.487142 21849 raft_consensus.cc:3060] T 65d8cb8d6ec64f459d5a47cefab10acf P e5256d91808b47c195bc9b4dbd7f2b87 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:14.516212 19482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b08304a0a02b42d7840c4e8ee9a6bd1a" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:05:14.488682 21767 leader_election.cc:290] T 1f85fc4b527a48848e5faa083b604e36 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 3 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:05:14.504186 21411 raft_consensus.cc:2749] T ece3db938bc649d4a40a51522ed5259c P e5256d91808b47c195bc9b4dbd7f2b87 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:05:14.517282 19482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef32ce6fdd0e40d382c79974f30295c6" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:05:14.517820 19482 raft_consensus.cc:2468] T ef32ce6fdd0e40d382c79974f30295c6 P 0473d2b2d01f4459b1e90fd12cc7840e [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 5.
I20260709 13:05:14.479714 19480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e1f505cb0f1427bbd698ac889d80821" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:05:14.494535 19483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc225c93219c45538b53a1bd3d387e4d" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:05:14.485406 21837 leader_election.cc:290] T 0afb57ae58a24a01850491d69f0213dd P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 6 election: Requested vote from peers e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:05:14.520128 19483 raft_consensus.cc:2468] T bc225c93219c45538b53a1bd3d387e4d P 0473d2b2d01f4459b1e90fd12cc7840e [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 8.
I20260709 13:05:14.519351 19479 raft_consensus.cc:2393] T 172b3dd13109415a955b71ac0e9d2234 P 0473d2b2d01f4459b1e90fd12cc7840e [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e5256d91808b47c195bc9b4dbd7f2b87 in current term 3: Already voted for candidate 0473d2b2d01f4459b1e90fd12cc7840e in this term.
I20260709 13:05:14.514838 19484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c5eebf646ad445a9d1b1adc319d7b16" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:05:14.539626 19484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "217b5fae677b4971b3bbd2f357a1f7ff" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:05:14.540614 19484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df751f992649444090e27965eb1af85d" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:05:14.541163 19484 raft_consensus.cc:2468] T df751f992649444090e27965eb1af85d P 0473d2b2d01f4459b1e90fd12cc7840e [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 5.
I20260709 13:05:14.541913 19484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff9b0eddd810459b82d91c60777c10eb" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:05:14.474150 19450 leader_election.cc:304] T 309c3ca0ca4b4f3ba129752ea2cb293b P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, 127766fc592545a4997f7790f50f6076, e61c3a8f61bb48f8a963c9480e53c168; no voters: e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:05:14.509753 19485 raft_consensus.cc:2468] T fa8650e71aa14778b3d73721fc50d9fc P 0473d2b2d01f4459b1e90fd12cc7840e [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 6.
I20260709 13:05:14.498219 19478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b74109013a140ada21feeef92d6f563" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:05:14.516239 21823 raft_consensus.cc:3060] T 2a16f7501e2444fb86d4e2778e734e02 P e5256d91808b47c195bc9b4dbd7f2b87 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:05:14.516256 21858 leader_election.cc:290] T 14efcc79969f41babe5529c22d59156d P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 5 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:05:14.531312 19482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14935b3ddf914369822e4a0547aaa355" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:05:14.553427 19482 raft_consensus.cc:2468] T 14935b3ddf914369822e4a0547aaa355 P 0473d2b2d01f4459b1e90fd12cc7840e [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 4.
I20260709 13:05:14.532711 21833 consensus_queue.cc:1059] T 65d8cb8d6ec64f459d5a47cefab10acf P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:05:14.518623 19480 raft_consensus.cc:2468] T 3e1f505cb0f1427bbd698ac889d80821 P 0473d2b2d01f4459b1e90fd12cc7840e [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 4.
I20260709 13:05:14.519662 19486 raft_consensus.cc:2376] T e381f1d6b8184797ad142de49be225a8 P 0473d2b2d01f4459b1e90fd12cc7840e [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 4. Re-sending same reply.
I20260709 13:05:14.534591 21825 raft_consensus.cc:493] T 85c494af21f9457a85da47b9bc70c1fd P e61c3a8f61bb48f8a963c9480e53c168 [term 2 FOLLOWER]: Starting leader election (detected failure of leader e5256d91808b47c195bc9b4dbd7f2b87)
I20260709 13:05:14.535530 19374 leader_election.cc:304] T 4af19371ea874c09a0a2147040835cbb P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87; no voters: 127766fc592545a4997f7790f50f6076, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:05:14.504431 19481 raft_consensus.cc:2468] T 1dc5b3532fe54f74876d02beffa2c230 P 0473d2b2d01f4459b1e90fd12cc7840e [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 3.
I20260709 13:05:14.536474 19477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22196caba61445d3bec98a0aab3c337d" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
W20260709 13:05:14.556229 19375 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.3:36891, user_credentials={real_user=slave}} blocked reactor thread for 62142.4us
I20260709 13:05:14.556362 19477 raft_consensus.cc:2468] T 22196caba61445d3bec98a0aab3c337d P 0473d2b2d01f4459b1e90fd12cc7840e [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 4.
I20260709 13:05:14.538249 19483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21e14947d70440f19044d8f75c31e1f9" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:05:14.558276 19484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f93ee515a9c14139bf566522ed8232f3" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 8 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:05:14.553946 19485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48824d5acfbc485ebf8c2d944e7202de" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:05:14.558187 19479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ec1c4ce15e04c7e8c283a62179f2a64" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:05:14.559226 19479 raft_consensus.cc:2468] T 5ec1c4ce15e04c7e8c283a62179f2a64 P 0473d2b2d01f4459b1e90fd12cc7840e [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 3.
I20260709 13:05:14.560043 19479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a61655d99124a29b486ba4a5b37faea" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:05:14.560849 19479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2725d2c4cb054f18b0fc8f735c15f6c2" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:05:14.561237 19479 raft_consensus.cc:3060] T 2725d2c4cb054f18b0fc8f735c15f6c2 P 0473d2b2d01f4459b1e90fd12cc7840e [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:05:14.552153 20105 raft_consensus.cc:2468] T 70797e5783b5454ab0d0eea663e791e3 P 127766fc592545a4997f7790f50f6076 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 6.
I20260709 13:05:14.564788 19477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e5873a19244c5ebbcd38e126796ee7" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:05:14.565996 19482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46c5bfeecc314717bffe987e6844b6d0" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 10 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:05:14.566607 19482 raft_consensus.cc:2468] T 46c5bfeecc314717bffe987e6844b6d0 P 0473d2b2d01f4459b1e90fd12cc7840e [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 9.
I20260709 13:05:14.566864 19478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1b10566f45d4a7d9029858330e02d5b" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
W20260709 13:05:14.567129 20078 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.2:46257, user_credentials={real_user=slave}} blocked reactor thread for 112537us
I20260709 13:05:14.561787 21894 raft_consensus.cc:515] T 14935b3ddf914369822e4a0547aaa355 P 127766fc592545a4997f7790f50f6076 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } attrs { replace: true } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:05:14.566102 19483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edd7d470b5014c9489be7f41f64355c9" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:05:14.572011 19483 raft_consensus.cc:2468] T edd7d470b5014c9489be7f41f64355c9 P 0473d2b2d01f4459b1e90fd12cc7840e [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 4.
I20260709 13:05:14.568295 19484 raft_consensus.cc:2468] T f93ee515a9c14139bf566522ed8232f3 P 0473d2b2d01f4459b1e90fd12cc7840e [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 7.
I20260709 13:05:14.573730 19481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab43d85f64114d4ebf618930e43d9ed0" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:05:14.574354 19481 raft_consensus.cc:2468] T ab43d85f64114d4ebf618930e43d9ed0 P 0473d2b2d01f4459b1e90fd12cc7840e [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 5.
I20260709 13:05:14.570897 19375 leader_election.cc:304] T 2b74109013a140ada21feeef92d6f563 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:05:14.575508 19480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "179fd671030940b4b4a4e24bcc4aba0a" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:05:14.576781 19405 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5ec1c4ce15e04c7e8c283a62179f2a64"
dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
mode: GRACEFUL
new_leader_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
 from {username='slave'} at 127.0.0.1:37312
I20260709 13:05:14.554777 21859 raft_consensus.cc:2804] T 172b3dd13109415a955b71ac0e9d2234 P 127766fc592545a4997f7790f50f6076 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:05:14.577212 19482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa8650e71aa14778b3d73721fc50d9fc" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:05:14.578023 19482 raft_consensus.cc:2468] T fa8650e71aa14778b3d73721fc50d9fc P 0473d2b2d01f4459b1e90fd12cc7840e [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 6.
I20260709 13:05:14.563117 21825 raft_consensus.cc:3060] T 85c494af21f9457a85da47b9bc70c1fd P e61c3a8f61bb48f8a963c9480e53c168 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:14.563323 21411 raft_consensus.cc:2804] T d1e5873a19244c5ebbcd38e126796ee7 P e5256d91808b47c195bc9b4dbd7f2b87 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:05:14.580603 19486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4509b76741dc428e9201c70c1658da13" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
W20260709 13:05:14.580090 19450 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.3:36891, user_credentials={real_user=slave}} blocked reactor thread for 106071us
I20260709 13:05:14.577534 20078 leader_election.cc:304] T 0afb57ae58a24a01850491d69f0213dd P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, 127766fc592545a4997f7790f50f6076; no voters: 
I20260709 13:05:14.582767 20076 leader_election.cc:304] T 70797e5783b5454ab0d0eea663e791e3 P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 127766fc592545a4997f7790f50f6076; no voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:05:14.573413 21858 raft_consensus.cc:2804] T 309c3ca0ca4b4f3ba129752ea2cb293b P 0473d2b2d01f4459b1e90fd12cc7840e [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:05:14.580907 19480 raft_consensus.cc:2376] T 179fd671030940b4b4a4e24bcc4aba0a P 0473d2b2d01f4459b1e90fd12cc7840e [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 4. Re-sending same reply.
I20260709 13:05:14.586740 19481 raft_consensus.cc:1240] T 1f85fc4b527a48848e5faa083b604e36 P 0473d2b2d01f4459b1e90fd12cc7840e [term 3 FOLLOWER]: Rejecting Update request from peer e5256d91808b47c195bc9b4dbd7f2b87 for earlier term 2. Current term is 3. Ops: []
I20260709 13:05:14.587741 19477 raft_consensus.cc:1240] T 0afb57ae58a24a01850491d69f0213dd P 0473d2b2d01f4459b1e90fd12cc7840e [term 6 FOLLOWER]: Rejecting Update request from peer e61c3a8f61bb48f8a963c9480e53c168 for earlier term 5. Current term is 6. Ops: []
I20260709 13:05:14.598045 19486 raft_consensus.cc:2468] T 4509b76741dc428e9201c70c1658da13 P 0473d2b2d01f4459b1e90fd12cc7840e [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 1.
I20260709 13:05:14.580193 21859 raft_consensus.cc:493] T 172b3dd13109415a955b71ac0e9d2234 P 127766fc592545a4997f7790f50f6076 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 0473d2b2d01f4459b1e90fd12cc7840e)
I20260709 13:05:14.604138 19450 leader_election.cc:304] T ab43d85f64114d4ebf618930e43d9ed0 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e; no voters: 127766fc592545a4997f7790f50f6076, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:05:14.584573 21411 raft_consensus.cc:493] T d1e5873a19244c5ebbcd38e126796ee7 P e5256d91808b47c195bc9b4dbd7f2b87 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 0473d2b2d01f4459b1e90fd12cc7840e)
W20260709 13:05:14.610545 19452 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:14.612576 20078 leader_election.cc:304] T 96efeaaf1057492490e9a621f37e1a2d P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, 127766fc592545a4997f7790f50f6076; no voters: 
I20260709 13:05:14.595825 21858 raft_consensus.cc:493] T 309c3ca0ca4b4f3ba129752ea2cb293b P 0473d2b2d01f4459b1e90fd12cc7840e [term 5 FOLLOWER]: Starting leader election (detected failure of leader e5256d91808b47c195bc9b4dbd7f2b87)
I20260709 13:05:14.619712 19450 leader_election.cc:304] T 0cdf56e38bbc453d9438d359e5a69955 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168; no voters: e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:05:14.621300 21894 leader_election.cc:290] T 14935b3ddf914369822e4a0547aaa355 P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 5 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:05:14.604944 21877 raft_consensus.cc:2804] T 0afb57ae58a24a01850491d69f0213dd P 127766fc592545a4997f7790f50f6076 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:05:14.625491 19482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40e1e16737a842ee936002830f36882e" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: true dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:05:14.607877 21859 raft_consensus.cc:3060] T 172b3dd13109415a955b71ac0e9d2234 P 127766fc592545a4997f7790f50f6076 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:14.621686 21767 raft_consensus.cc:2749] T ab43d85f64114d4ebf618930e43d9ed0 P 0473d2b2d01f4459b1e90fd12cc7840e [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:05:14.618606 21411 raft_consensus.cc:3060] T d1e5873a19244c5ebbcd38e126796ee7 P e5256d91808b47c195bc9b4dbd7f2b87 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:05:14.624840 21858 raft_consensus.cc:3060] T 309c3ca0ca4b4f3ba129752ea2cb293b P 0473d2b2d01f4459b1e90fd12cc7840e [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:05:14.621901 21700 leader_election.cc:290] T 172b3dd13109415a955b71ac0e9d2234 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 3 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:05:14.627740 21894 raft_consensus.cc:2749] T 70797e5783b5454ab0d0eea663e791e3 P 127766fc592545a4997f7790f50f6076 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:05:14.635075 21837 raft_consensus.cc:2804] T 0cdf56e38bbc453d9438d359e5a69955 P 0473d2b2d01f4459b1e90fd12cc7840e [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:05:14.629597 21877 raft_consensus.cc:493] T 0afb57ae58a24a01850491d69f0213dd P 127766fc592545a4997f7790f50f6076 [term 5 FOLLOWER]: Starting leader election (detected failure of leader e61c3a8f61bb48f8a963c9480e53c168)
I20260709 13:05:14.650368 19482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e36a9d6e29c4a7c860cf267efbd4c74" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:05:14.637424 21893 raft_consensus.cc:2804] T 96efeaaf1057492490e9a621f37e1a2d P 127766fc592545a4997f7790f50f6076 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:05:14.666534 19480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed7fdbcb96d14d418db9ca90a792588a" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:05:14.655673 21867 raft_consensus.cc:515] T 172b3dd13109415a955b71ac0e9d2234 P e5256d91808b47c195bc9b4dbd7f2b87 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:05:14.675400 19450 leader_election.cc:304] T 7f575b143b844aa096b50997dad3516a P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e; no voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:05:14.677656 21867 leader_election.cc:290] T 172b3dd13109415a955b71ac0e9d2234 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 3 election: Requested vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:05:14.678360 21867 raft_consensus.cc:2749] T 4af19371ea874c09a0a2147040835cbb P e5256d91808b47c195bc9b4dbd7f2b87 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:05:14.679345 21887 raft_consensus.cc:3055] T 65d8cb8d6ec64f459d5a47cefab10acf P e61c3a8f61bb48f8a963c9480e53c168 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:05:14.679745 21887 raft_consensus.cc:740] T 65d8cb8d6ec64f459d5a47cefab10acf P e61c3a8f61bb48f8a963c9480e53c168 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e61c3a8f61bb48f8a963c9480e53c168, State: Running, Role: LEADER
I20260709 13:05:14.680091 21867 raft_consensus.cc:2804] T 2b74109013a140ada21feeef92d6f563 P e5256d91808b47c195bc9b4dbd7f2b87 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:05:14.680491 21867 raft_consensus.cc:493] T 2b74109013a140ada21feeef92d6f563 P e5256d91808b47c195bc9b4dbd7f2b87 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 0473d2b2d01f4459b1e90fd12cc7840e)
I20260709 13:05:14.680902 21867 raft_consensus.cc:3060] T 2b74109013a140ada21feeef92d6f563 P e5256d91808b47c195bc9b4dbd7f2b87 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:14.680637 21887 consensus_queue.cc:260] T 65d8cb8d6ec64f459d5a47cefab10acf P e61c3a8f61bb48f8a963c9480e53c168 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:05:14.682215 21887 raft_consensus.cc:3060] T 65d8cb8d6ec64f459d5a47cefab10acf P e61c3a8f61bb48f8a963c9480e53c168 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:14.683876 21892 raft_consensus.cc:515] T 62c6c134d3d24a1ab144dd9ee6bc3f64 P 127766fc592545a4997f7790f50f6076 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:05:14.685158 20107 raft_consensus.cc:1240] T 62c6c134d3d24a1ab144dd9ee6bc3f64 P 127766fc592545a4997f7790f50f6076 [term 7 FOLLOWER]: Rejecting Update request from peer e61c3a8f61bb48f8a963c9480e53c168 for earlier term 6. Current term is 7. Ops: []
I20260709 13:05:14.686102 21892 leader_election.cc:290] T 62c6c134d3d24a1ab144dd9ee6bc3f64 P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 7 election: Requested vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:05:14.689349 21559 consensus_queue.cc:1059] T 62c6c134d3d24a1ab144dd9ee6bc3f64 P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:05:14.690440 21559 raft_consensus.cc:3055] T 62c6c134d3d24a1ab144dd9ee6bc3f64 P e61c3a8f61bb48f8a963c9480e53c168 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:05:14.656170 21877 raft_consensus.cc:3060] T 0afb57ae58a24a01850491d69f0213dd P 127766fc592545a4997f7790f50f6076 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:05:14.690815 21559 raft_consensus.cc:740] T 62c6c134d3d24a1ab144dd9ee6bc3f64 P e61c3a8f61bb48f8a963c9480e53c168 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: e61c3a8f61bb48f8a963c9480e53c168, State: Running, Role: LEADER
I20260709 13:05:14.691762 21559 consensus_queue.cc:260] T 62c6c134d3d24a1ab144dd9ee6bc3f64 P e61c3a8f61bb48f8a963c9480e53c168 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:05:14.692979 21559 raft_consensus.cc:3060] T 62c6c134d3d24a1ab144dd9ee6bc3f64 P e61c3a8f61bb48f8a963c9480e53c168 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:05:14.653517 21837 raft_consensus.cc:493] T 0cdf56e38bbc453d9438d359e5a69955 P 0473d2b2d01f4459b1e90fd12cc7840e [term 5 FOLLOWER]: Starting leader election (detected failure of leader e61c3a8f61bb48f8a963c9480e53c168)
W20260709 13:05:14.695525 19375 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.3:36891, user_credentials={real_user=slave}} blocked reactor thread for 138793us
I20260709 13:05:14.654956 21849 raft_consensus.cc:2749] T 65d8cb8d6ec64f459d5a47cefab10acf P e5256d91808b47c195bc9b4dbd7f2b87 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:05:14.655558 21893 raft_consensus.cc:493] T 96efeaaf1057492490e9a621f37e1a2d P 127766fc592545a4997f7790f50f6076 [term 4 FOLLOWER]: Starting leader election (detected failure of leader e61c3a8f61bb48f8a963c9480e53c168)
W20260709 13:05:14.705494 19374 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.4:43121, user_credentials={real_user=slave}} blocked reactor thread for 170053us
I20260709 13:05:14.709573 19479 raft_consensus.cc:2468] T 2725d2c4cb054f18b0fc8f735c15f6c2 P 0473d2b2d01f4459b1e90fd12cc7840e [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 6.
I20260709 13:05:14.712205 20107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "172b3dd13109415a955b71ac0e9d2234" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076"
I20260709 13:05:14.700342 21837 raft_consensus.cc:3060] T 0cdf56e38bbc453d9438d359e5a69955 P 0473d2b2d01f4459b1e90fd12cc7840e [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:05:14.714946 21411 raft_consensus.cc:515] T d1e5873a19244c5ebbcd38e126796ee7 P e5256d91808b47c195bc9b4dbd7f2b87 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:14.717170 21411 leader_election.cc:290] T d1e5873a19244c5ebbcd38e126796ee7 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 7 election: Requested vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:05:14.719996 19480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7be9efa6559648dbb5a0f7684c4542d1" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:05:14.706864 21893 raft_consensus.cc:3060] T 96efeaaf1057492490e9a621f37e1a2d P 127766fc592545a4997f7790f50f6076 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:05:14.724170 19375 leader_election.cc:304] T f1b10566f45d4a7d9029858330e02d5b P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:05:14.704475 21700 raft_consensus.cc:2749] T 7f575b143b844aa096b50997dad3516a P 0473d2b2d01f4459b1e90fd12cc7840e [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 13:05:14.728416 20076 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.3:36891, user_credentials={real_user=slave}} blocked reactor thread for 163445us
I20260709 13:05:14.731755 19375 leader_election.cc:304] T 217b5fae677b4971b3bbd2f357a1f7ff P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
W20260709 13:05:14.733052 20078 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.2:46257, user_credentials={real_user=slave}} blocked reactor thread for 120573us
I20260709 13:05:14.733754 19479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cdf56e38bbc453d9438d359e5a69955" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:05:14.740869 20076 leader_election.cc:304] T 48824d5acfbc485ebf8c2d944e7202de P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 127766fc592545a4997f7790f50f6076, e61c3a8f61bb48f8a963c9480e53c168; no voters: 0473d2b2d01f4459b1e90fd12cc7840e
I20260709 13:05:14.741748 19480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f575b143b844aa096b50997dad3516a" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:05:14.745649 21919 raft_consensus.cc:2804] T 48824d5acfbc485ebf8c2d944e7202de P 127766fc592545a4997f7790f50f6076 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:05:14.746253 21919 raft_consensus.cc:493] T 48824d5acfbc485ebf8c2d944e7202de P 127766fc592545a4997f7790f50f6076 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 0473d2b2d01f4459b1e90fd12cc7840e)
I20260709 13:05:14.746711 21919 raft_consensus.cc:3060] T 48824d5acfbc485ebf8c2d944e7202de P 127766fc592545a4997f7790f50f6076 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:05:14.745729 19484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e1085d23e8347fbbd5bce7542f4b1f4" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:05:14.763304 19450 leader_election.cc:304] T 2725d2c4cb054f18b0fc8f735c15f6c2 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168; no voters: e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:05:14.766927 19375 leader_election.cc:304] T 76cb037fc9064d13b59a8969d897ce8c P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:05:14.768409 20076 leader_election.cc:304] T 65d8cb8d6ec64f459d5a47cefab10acf P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 127766fc592545a4997f7790f50f6076; no voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:05:14.769480 21892 raft_consensus.cc:2749] T 65d8cb8d6ec64f459d5a47cefab10acf P 127766fc592545a4997f7790f50f6076 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:05:14.770375 21372 raft_consensus.cc:2764] T 2725d2c4cb054f18b0fc8f735c15f6c2 P 0473d2b2d01f4459b1e90fd12cc7840e [term 6 FOLLOWER]: Leader election decision vote started in defunct term 5: won
I20260709 13:05:14.735260 21853 raft_consensus.cc:515] T 833a2f0775ed407a94b8924ce50adb63 P e61c3a8f61bb48f8a963c9480e53c168 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:05:14.778937 21411 raft_consensus.cc:2804] T f1b10566f45d4a7d9029858330e02d5b P e5256d91808b47c195bc9b4dbd7f2b87 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:05:14.779922 21411 raft_consensus.cc:493] T f1b10566f45d4a7d9029858330e02d5b P e5256d91808b47c195bc9b4dbd7f2b87 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 0473d2b2d01f4459b1e90fd12cc7840e)
I20260709 13:05:14.780316 21411 raft_consensus.cc:3060] T f1b10566f45d4a7d9029858330e02d5b P e5256d91808b47c195bc9b4dbd7f2b87 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:05:14.780462 21849 raft_consensus.cc:2804] T 217b5fae677b4971b3bbd2f357a1f7ff P e5256d91808b47c195bc9b4dbd7f2b87 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:05:14.780958 21849 raft_consensus.cc:493] T 217b5fae677b4971b3bbd2f357a1f7ff P e5256d91808b47c195bc9b4dbd7f2b87 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 0473d2b2d01f4459b1e90fd12cc7840e)
I20260709 13:05:14.781255 21853 leader_election.cc:290] T 833a2f0775ed407a94b8924ce50adb63 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 4 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:05:14.781339 21849 raft_consensus.cc:3060] T 217b5fae677b4971b3bbd2f357a1f7ff P e5256d91808b47c195bc9b4dbd7f2b87 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:14.785272 21859 raft_consensus.cc:515] T 172b3dd13109415a955b71ac0e9d2234 P 127766fc592545a4997f7790f50f6076 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:05:14.762624 21767 consensus_queue.cc:1048] T 7be9efa6559648dbb5a0f7684c4542d1 P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.024s
I20260709 13:05:14.787218 20107 raft_consensus.cc:3060] T 172b3dd13109415a955b71ac0e9d2234 P 127766fc592545a4997f7790f50f6076 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:14.787806 19477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28af091831594f9d8e96482078cc7625" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:05:14.788950 19482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1efebf73c86e432baa55533136b6e12c" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:05:14.790966 21849 raft_consensus.cc:515] T 217b5fae677b4971b3bbd2f357a1f7ff P e5256d91808b47c195bc9b4dbd7f2b87 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
W20260709 13:05:14.792840 21915 log.cc:927] Time spent T 48824d5acfbc485ebf8c2d944e7202de P 127766fc592545a4997f7790f50f6076: Append to log took a long time: real 0.061s	user 0.000s	sys 0.001s
I20260709 13:05:14.795832 19450 leader_election.cc:304] T edd7d470b5014c9489be7f41f64355c9 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:05:14.798048 19450 leader_election.cc:304] T e381f1d6b8184797ad142de49be225a8 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:05:14.799494 19404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa8650e71aa14778b3d73721fc50d9fc" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:05:14.799690 21700 raft_consensus.cc:2804] T edd7d470b5014c9489be7f41f64355c9 P 0473d2b2d01f4459b1e90fd12cc7840e [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:05:14.800153 19404 raft_consensus.cc:2468] T fa8650e71aa14778b3d73721fc50d9fc P e5256d91808b47c195bc9b4dbd7f2b87 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 5.
I20260709 13:05:14.800210 21700 raft_consensus.cc:493] T edd7d470b5014c9489be7f41f64355c9 P 0473d2b2d01f4459b1e90fd12cc7840e [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:14.800354 20105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "833a2f0775ed407a94b8924ce50adb63" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076"
I20260709 13:05:14.800751 21700 raft_consensus.cc:3060] T edd7d470b5014c9489be7f41f64355c9 P 0473d2b2d01f4459b1e90fd12cc7840e [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:05:14.801512 19407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f85fc4b527a48848e5faa083b604e36" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
I20260709 13:05:14.809258 20076 leader_election.cc:304] T ab43d85f64114d4ebf618930e43d9ed0 P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, 127766fc592545a4997f7790f50f6076; no voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:05:14.781185 21918 raft_consensus.cc:2804] T 76cb037fc9064d13b59a8969d897ce8c P e5256d91808b47c195bc9b4dbd7f2b87 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:05:14.813655 19403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a08760e15aac4630a629431f56024dc8" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:05:14.812515 19480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c5eebf646ad445a9d1b1adc319d7b16" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:05:14.813535 21918 raft_consensus.cc:493] T 76cb037fc9064d13b59a8969d897ce8c P e5256d91808b47c195bc9b4dbd7f2b87 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:14.814936 20076 leader_election.cc:304] T 833a2f0775ed407a94b8924ce50adb63 P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 127766fc592545a4997f7790f50f6076; no voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:05:14.817024 19450 leader_election.cc:304] T 14935b3ddf914369822e4a0547aaa355 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e; no voters: 127766fc592545a4997f7790f50f6076, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:05:14.784716 21837 raft_consensus.cc:515] T 0cdf56e38bbc453d9438d359e5a69955 P 0473d2b2d01f4459b1e90fd12cc7840e [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:14.817842 19526 leader_election.cc:304] T 2725d2c4cb054f18b0fc8f735c15f6c2 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
W20260709 13:05:14.818039 20078 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.2:46257, user_credentials={real_user=slave}} blocked reactor thread for 84205.3us
I20260709 13:05:14.816941 19484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff75a1d4cb1f493db8f71ddc136ba9ab" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:05:14.823112 20076 leader_election.cc:304] T 85c494af21f9457a85da47b9bc70c1fd P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 127766fc592545a4997f7790f50f6076, e61c3a8f61bb48f8a963c9480e53c168; no voters: e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:05:14.824339 19405 raft_consensus.cc:606] T 5ec1c4ce15e04c7e8c283a62179f2a64 P e5256d91808b47c195bc9b4dbd7f2b87 [term 3 FOLLOWER]: Received request to transfer leadership to TS 0473d2b2d01f4459b1e90fd12cc7840e
I20260709 13:05:14.824715 19405 raft_consensus.cc:614] T 5ec1c4ce15e04c7e8c283a62179f2a64 P e5256d91808b47c195bc9b4dbd7f2b87 [term 3 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:05:14.824867 21790 raft_consensus.cc:2749] T 14935b3ddf914369822e4a0547aaa355 P 0473d2b2d01f4459b1e90fd12cc7840e [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:05:14.825455 19526 leader_election.cc:304] T 76cb037fc9064d13b59a8969d897ce8c P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:05:14.826846 21529 raft_consensus.cc:2804] T 2725d2c4cb054f18b0fc8f735c15f6c2 P e61c3a8f61bb48f8a963c9480e53c168 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:05:14.827211 21529 raft_consensus.cc:493] T 2725d2c4cb054f18b0fc8f735c15f6c2 P e61c3a8f61bb48f8a963c9480e53c168 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:14.827584 21529 raft_consensus.cc:3060] T 2725d2c4cb054f18b0fc8f735c15f6c2 P e61c3a8f61bb48f8a963c9480e53c168 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:05:14.828224 21887 raft_consensus.cc:2804] T 76cb037fc9064d13b59a8969d897ce8c P e61c3a8f61bb48f8a963c9480e53c168 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:05:14.828624 21887 raft_consensus.cc:493] T 76cb037fc9064d13b59a8969d897ce8c P e61c3a8f61bb48f8a963c9480e53c168 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 0473d2b2d01f4459b1e90fd12cc7840e)
I20260709 13:05:14.828991 21887 raft_consensus.cc:3060] T 76cb037fc9064d13b59a8969d897ce8c P e61c3a8f61bb48f8a963c9480e53c168 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:05:14.815670 21892 raft_consensus.cc:2749] T ab43d85f64114d4ebf618930e43d9ed0 P 127766fc592545a4997f7790f50f6076 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:05:14.830042 21700 raft_consensus.cc:515] T edd7d470b5014c9489be7f41f64355c9 P 0473d2b2d01f4459b1e90fd12cc7840e [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:14.817921 21767 raft_consensus.cc:2804] T e381f1d6b8184797ad142de49be225a8 P 0473d2b2d01f4459b1e90fd12cc7840e [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:05:14.857278 21767 raft_consensus.cc:493] T e381f1d6b8184797ad142de49be225a8 P 0473d2b2d01f4459b1e90fd12cc7840e [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:14.857715 21767 raft_consensus.cc:3060] T e381f1d6b8184797ad142de49be225a8 P 0473d2b2d01f4459b1e90fd12cc7840e [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:05:14.830974 19407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14efcc79969f41babe5529c22d59156d" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
I20260709 13:05:14.833024 21823 raft_consensus.cc:515] T 2a16f7501e2444fb86d4e2778e734e02 P e5256d91808b47c195bc9b4dbd7f2b87 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:05:14.834084 21893 raft_consensus.cc:515] T 96efeaaf1057492490e9a621f37e1a2d P 127766fc592545a4997f7790f50f6076 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:05:14.834862 21403 raft_consensus.cc:2749] T 833a2f0775ed407a94b8924ce50adb63 P 127766fc592545a4997f7790f50f6076 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:05:14.835078 21849 leader_election.cc:290] T 217b5fae677b4971b3bbd2f357a1f7ff P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 3 election: Requested vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:05:14.836437 21919 raft_consensus.cc:515] T 48824d5acfbc485ebf8c2d944e7202de P 127766fc592545a4997f7790f50f6076 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:05:14.818041 21918 raft_consensus.cc:3060] T 76cb037fc9064d13b59a8969d897ce8c P e5256d91808b47c195bc9b4dbd7f2b87 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:05:14.856036 19526 leader_election.cc:304] T e381f1d6b8184797ad142de49be225a8 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168; no voters: e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:05:14.844605 20105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0afb57ae58a24a01850491d69f0213dd" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076"
I20260709 13:05:14.843071 20103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14efcc79969f41babe5529c22d59156d" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076"
I20260709 13:05:14.846400 20104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f85fc4b527a48848e5faa083b604e36" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076"
I20260709 13:05:14.875138 20109 raft_consensus.cc:1240] T 96efeaaf1057492490e9a621f37e1a2d P 127766fc592545a4997f7790f50f6076 [term 5 FOLLOWER]: Rejecting Update request from peer e61c3a8f61bb48f8a963c9480e53c168 for earlier term 4. Current term is 5. Ops: []
I20260709 13:05:14.846570 19403 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "85c494af21f9457a85da47b9bc70c1fd"
dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
mode: GRACEFUL
new_leader_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
 from {username='slave'} at 127.0.0.1:37312
I20260709 13:05:14.792832 21858 raft_consensus.cc:515] T 309c3ca0ca4b4f3ba129752ea2cb293b P 0473d2b2d01f4459b1e90fd12cc7840e [term 6 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } attrs { replace: true } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:05:14.821875 19450 leader_election.cc:304] T 179fd671030940b4b4a4e24bcc4aba0a P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:05:14.866969 19479 raft_consensus.cc:3060] T 0cdf56e38bbc453d9438d359e5a69955 P 0473d2b2d01f4459b1e90fd12cc7840e [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:05:14.791570 21877 raft_consensus.cc:515] T 0afb57ae58a24a01850491d69f0213dd P 127766fc592545a4997f7790f50f6076 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:05:14.895574 21823 leader_election.cc:290] T 2a16f7501e2444fb86d4e2778e734e02 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 6 election: Requested vote from peers e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:05:14.899638 19409 raft_consensus.cc:1240] T 2a16f7501e2444fb86d4e2778e734e02 P e5256d91808b47c195bc9b4dbd7f2b87 [term 6 FOLLOWER]: Rejecting Update request from peer 127766fc592545a4997f7790f50f6076 for earlier term 5. Current term is 6. Ops: []
I20260709 13:05:14.891616 19403 raft_consensus.cc:606] T 85c494af21f9457a85da47b9bc70c1fd P e5256d91808b47c195bc9b4dbd7f2b87 [term 2 LEADER]: Received request to transfer leadership to TS e61c3a8f61bb48f8a963c9480e53c168
W20260709 13:05:14.900848 19375 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.3:36891, user_credentials={real_user=slave}} blocked reactor thread for 133015us
I20260709 13:05:14.902034 20105 raft_consensus.cc:2393] T 0afb57ae58a24a01850491d69f0213dd P 127766fc592545a4997f7790f50f6076 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 0473d2b2d01f4459b1e90fd12cc7840e in current term 6: Already voted for candidate 127766fc592545a4997f7790f50f6076 in this term.
I20260709 13:05:14.898584 20107 raft_consensus.cc:2468] T 172b3dd13109415a955b71ac0e9d2234 P 127766fc592545a4997f7790f50f6076 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 3.
I20260709 13:05:14.907505 21700 leader_election.cc:290] T edd7d470b5014c9489be7f41f64355c9 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 5 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
W20260709 13:05:14.908115 19450 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.3:36891, user_credentials={real_user=slave}} blocked reactor thread for 86303.8us
I20260709 13:05:14.874182 21919 leader_election.cc:290] T 48824d5acfbc485ebf8c2d944e7202de P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 5 election: Requested vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:05:14.967921 19479 raft_consensus.cc:2468] T 0cdf56e38bbc453d9438d359e5a69955 P 0473d2b2d01f4459b1e90fd12cc7840e [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 7.
I20260709 13:05:14.874179 21803 raft_consensus.cc:2804] T 85c494af21f9457a85da47b9bc70c1fd P 127766fc592545a4997f7790f50f6076 [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 13:05:14.996668 19375 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.3:36891, user_credentials={real_user=slave}} blocked reactor thread for 53999.8us
W20260709 13:05:14.917865 19523 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:14.872750 19405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "172b3dd13109415a955b71ac0e9d2234" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
W20260709 13:05:15.031433 19526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.2:46257, user_credentials={real_user=slave}} blocked reactor thread for 175478us
I20260709 13:05:15.032349 19526 leader_election.cc:304] T 1dc5b3532fe54f74876d02beffa2c230 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:05:15.031414 19405 raft_consensus.cc:2393] T 172b3dd13109415a955b71ac0e9d2234 P e5256d91808b47c195bc9b4dbd7f2b87 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 0473d2b2d01f4459b1e90fd12cc7840e in current term 3: Already voted for candidate e5256d91808b47c195bc9b4dbd7f2b87 in this term.
W20260709 13:05:15.039312 19450 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.3:36891, user_credentials={real_user=slave}} blocked reactor thread for 128079us
I20260709 13:05:14.941852 19483 raft_consensus.cc:1240] T 309c3ca0ca4b4f3ba129752ea2cb293b P 0473d2b2d01f4459b1e90fd12cc7840e [term 6 FOLLOWER]: Rejecting Update request from peer e5256d91808b47c195bc9b4dbd7f2b87 for earlier term 5. Current term is 6. Ops: []
I20260709 13:05:14.874004 21893 leader_election.cc:290] T 96efeaaf1057492490e9a621f37e1a2d P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 5 election: Requested vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:05:15.049710 19409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14935b3ddf914369822e4a0547aaa355" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
I20260709 13:05:14.899719 20104 raft_consensus.cc:3060] T 1f85fc4b527a48848e5faa083b604e36 P 127766fc592545a4997f7790f50f6076 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:05:15.024708 21731 consensus_meta.cc:287] T 62c6c134d3d24a1ab144dd9ee6bc3f64 P 0473d2b2d01f4459b1e90fd12cc7840e: Time spent flushing consensus metadata: real 0.516s	user 0.007s	sys 0.007s
I20260709 13:05:15.048861 20105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "172b3dd13109415a955b71ac0e9d2234" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076"
I20260709 13:05:15.055460 20105 raft_consensus.cc:2393] T 172b3dd13109415a955b71ac0e9d2234 P 127766fc592545a4997f7790f50f6076 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 0473d2b2d01f4459b1e90fd12cc7840e in current term 3: Already voted for candidate e5256d91808b47c195bc9b4dbd7f2b87 in this term.
I20260709 13:05:15.049170 19450 leader_election.cc:304] T 0e1085d23e8347fbbd5bce7542f4b1f4 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e; no voters: 127766fc592545a4997f7790f50f6076, e61c3a8f61bb48f8a963c9480e53c168
W20260709 13:05:15.044845 20076 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.3:36891, user_credentials={real_user=slave}} blocked reactor thread for 221847us
I20260709 13:05:14.875025 21867 raft_consensus.cc:515] T 2b74109013a140ada21feeef92d6f563 P e5256d91808b47c195bc9b4dbd7f2b87 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:15.058362 19411 raft_consensus.cc:1240] T 217b5fae677b4971b3bbd2f357a1f7ff P e5256d91808b47c195bc9b4dbd7f2b87 [term 3 FOLLOWER]: Rejecting Update request from peer 0473d2b2d01f4459b1e90fd12cc7840e for earlier term 2. Current term is 3. Ops: []
I20260709 13:05:14.910481 21700 raft_consensus.cc:2804] T 179fd671030940b4b4a4e24bcc4aba0a P 0473d2b2d01f4459b1e90fd12cc7840e [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:05:15.066869 21700 raft_consensus.cc:493] T 179fd671030940b4b4a4e24bcc4aba0a P 0473d2b2d01f4459b1e90fd12cc7840e [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:15.067344 21700 raft_consensus.cc:3060] T 179fd671030940b4b4a4e24bcc4aba0a P 0473d2b2d01f4459b1e90fd12cc7840e [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:05:15.067792 21858 leader_election.cc:290] T 309c3ca0ca4b4f3ba129752ea2cb293b P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 6 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:05:15.037971 21803 raft_consensus.cc:493] T 85c494af21f9457a85da47b9bc70c1fd P 127766fc592545a4997f7790f50f6076 [term 2 FOLLOWER]: Starting leader election (detected failure of leader e5256d91808b47c195bc9b4dbd7f2b87)
I20260709 13:05:14.941277 21833 raft_consensus.cc:2804] T e381f1d6b8184797ad142de49be225a8 P e61c3a8f61bb48f8a963c9480e53c168 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:05:15.085448 21803 raft_consensus.cc:3060] T 85c494af21f9457a85da47b9bc70c1fd P 127766fc592545a4997f7790f50f6076 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:15.091282 19375 leader_election.cc:304] T b08304a0a02b42d7840c4e8ee9a6bd1a P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:05:15.092371 21823 raft_consensus.cc:2804] T b08304a0a02b42d7840c4e8ee9a6bd1a P e5256d91808b47c195bc9b4dbd7f2b87 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:05:15.092283 21700 raft_consensus.cc:515] T 179fd671030940b4b4a4e24bcc4aba0a P 0473d2b2d01f4459b1e90fd12cc7840e [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:15.051129 21559 raft_consensus.cc:493] T 70797e5783b5454ab0d0eea663e791e3 P e61c3a8f61bb48f8a963c9480e53c168 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:15.057713 21731 raft_consensus.cc:515] T 62c6c134d3d24a1ab144dd9ee6bc3f64 P 0473d2b2d01f4459b1e90fd12cc7840e [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:05:15.061237 21684 raft_consensus.cc:2804] T 1dc5b3532fe54f74876d02beffa2c230 P e61c3a8f61bb48f8a963c9480e53c168 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:05:15.062393 19526 leader_election.cc:304] T 48824d5acfbc485ebf8c2d944e7202de P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e61c3a8f61bb48f8a963c9480e53c168; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, 127766fc592545a4997f7790f50f6076
I20260709 13:05:15.066506 19408 raft_consensus.cc:1275] T 775c229504194560ba9589bc2199b089 P e5256d91808b47c195bc9b4dbd7f2b87 [term 4 FOLLOWER]: Refusing update from remote peer 127766fc592545a4997f7790f50f6076: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:05:14.996064 21918 raft_consensus.cc:515] T 76cb037fc9064d13b59a8969d897ce8c P e5256d91808b47c195bc9b4dbd7f2b87 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:14.907675 21877 leader_election.cc:290] T 0afb57ae58a24a01850491d69f0213dd P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 6 election: Requested vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:05:15.066924 21853 consensus_queue.cc:1059] T 96efeaaf1057492490e9a621f37e1a2d P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.008s
I20260709 13:05:15.075228 21790 raft_consensus.cc:2749] T 0e1085d23e8347fbbd5bce7542f4b1f4 P 0473d2b2d01f4459b1e90fd12cc7840e [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:05:15.076102 21837 leader_election.cc:290] T 0cdf56e38bbc453d9438d359e5a69955 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 6 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:05:15.079263 19407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "172b3dd13109415a955b71ac0e9d2234" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
I20260709 13:05:15.116226 19407 raft_consensus.cc:2368] T 172b3dd13109415a955b71ac0e9d2234 P e5256d91808b47c195bc9b4dbd7f2b87 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 127766fc592545a4997f7790f50f6076 for earlier term 2. Current term is 3.
W20260709 13:05:15.084239 19308 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:51954 (request call id 128) took 11326 ms (client timeout 15000 ms). Trace:
I20260709 13:05:14.870844 21825 raft_consensus.cc:515] T 85c494af21f9457a85da47b9bc70c1fd P e61c3a8f61bb48f8a963c9480e53c168 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:05:14.898582 21767 raft_consensus.cc:515] T e381f1d6b8184797ad142de49be225a8 P 0473d2b2d01f4459b1e90fd12cc7840e [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:14.899199 21859 leader_election.cc:290] T 172b3dd13109415a955b71ac0e9d2234 P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 2 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:05:15.092976 19375 leader_election.cc:304] T 2e36a9d6e29c4a7c860cf267efbd4c74 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:05:15.092983 21823 raft_consensus.cc:493] T b08304a0a02b42d7840c4e8ee9a6bd1a P e5256d91808b47c195bc9b4dbd7f2b87 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 0473d2b2d01f4459b1e90fd12cc7840e)
I20260709 13:05:15.093756 19374 leader_election.cc:304] T 172b3dd13109415a955b71ac0e9d2234 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 127766fc592545a4997f7790f50f6076, e5256d91808b47c195bc9b4dbd7f2b87; no voters: 
I20260709 13:05:15.094069 21929 raft_consensus.cc:993] T 309c3ca0ca4b4f3ba129752ea2cb293b P e5256d91808b47c195bc9b4dbd7f2b87: : Instructing follower e61c3a8f61bb48f8a963c9480e53c168 to start an election
I20260709 13:05:15.104262 19410 raft_consensus.cc:1240] T 2b74109013a140ada21feeef92d6f563 P e5256d91808b47c195bc9b4dbd7f2b87 [term 3 FOLLOWER]: Rejecting Update request from peer 0473d2b2d01f4459b1e90fd12cc7840e for earlier term 2. Current term is 3. Ops: []
I20260709 13:05:15.052569 20109 raft_consensus.cc:1240] T 0afb57ae58a24a01850491d69f0213dd P 127766fc592545a4997f7790f50f6076 [term 6 FOLLOWER]: Rejecting Update request from peer e61c3a8f61bb48f8a963c9480e53c168 for earlier term 5. Current term is 6. Ops: []
I20260709 13:05:15.105310 21403 raft_consensus.cc:493] T 309c3ca0ca4b4f3ba129752ea2cb293b P 127766fc592545a4997f7790f50f6076 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader e5256d91808b47c195bc9b4dbd7f2b87)
I20260709 13:05:15.112442 19486 raft_consensus.cc:1240] T 62c6c134d3d24a1ab144dd9ee6bc3f64 P 0473d2b2d01f4459b1e90fd12cc7840e [term 7 FOLLOWER]: Rejecting Update request from peer e61c3a8f61bb48f8a963c9480e53c168 for earlier term 6. Current term is 7. Ops: []
W20260709 13:05:15.114022 19523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.4:43121, user_credentials={real_user=slave}} blocked reactor thread for 66632.2us
W20260709 13:05:15.125121 19452 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:15.133383 21867 leader_election.cc:290] T 2b74109013a140ada21feeef92d6f563 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 3 election: Requested vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
W20260709 13:05:15.116820 19308 rpcz_store.cc:269] 0709 13:05:03.758094 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:03.758332 (+   238us) service_pool.cc:224] Handling call
0709 13:05:15.084136 (+11325804us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:05:14.377505 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:05:14.378767 (+  1262us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:05:14.378826 (+    59us) write_op.cc:435] Acquired schema lock
0709 13:05:14.378861 (+    35us) tablet.cc:662] Decoding operations
0709 13:05:14.379597 (+   736us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:05:14.379689 (+    92us) write_op.cc:641] Partition lock acquired for write op
0709 13:05:14.379712 (+    23us) tablet.cc:685] Acquiring locks for 4 operations
0709 13:05:14.380298 (+   586us) tablet.cc:701] Row locks acquired
0709 13:05:14.380348 (+    50us) write_op.cc:260] PREPARE: finished
0709 13:05:14.380515 (+   167us) write_op.cc:270] Start()
0709 13:05:14.380656 (+   141us) write_op.cc:276] Timestamp: P: 1783602314380448 usec, L: 0
0709 13:05:14.380678 (+    22us) op_driver.cc:348] REPLICATION: starting
0709 13:05:14.381396 (+   718us) log.cc:844] Serialized 1736 byte log entry
0709 13:05:14.791961 (+410565us) op_driver.cc:464] REPLICATION: finished
0709 13:05:14.858362 (+ 66401us) spinlock_profiling.cc:243] Waited 21.5 ms on lock 0x7b18001dd400. stack: 00007f4a79de9343 00007f4a79de9240 00007f4a797781d4 00007f4a834b6304 00007f4a834b6299 00007f4a82ce3de1 00007f4a82cf05b1 00007f4a79e1b3f3 00007f4a79e1d7c1 00007f4a79e1d779 00007f4a79e1d709 00007f4a79e1d6d1 00007f4a79e1c9cd 000000000038f354 000000000038f199 00007f4a79dfe83a
0709 13:05:14.858569 (+   207us) write_op.cc:301] APPLY: starting
0709 13:05:14.858709 (+   140us) tablet.cc:1367] starting BulkCheckPresence
0709 13:05:14.858926 (+   217us) tablet.cc:1370] finished BulkCheckPresence
0709 13:05:14.858974 (+    48us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:05:14.898832 (+ 39858us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:05:14.899140 (+   308us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=4
0709 13:05:14.899187 (+    47us) write_op.cc:312] APPLY: finished
0709 13:05:14.939741 (+ 40554us) log.cc:844] Serialized 41 byte log entry
0709 13:05:14.939953 (+   212us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:05:14.940050 (+    97us) write_op.cc:454] Released schema lock
0709 13:05:14.940111 (+    61us) write_op.cc:341] FINISH: Updating metrics
0709 13:05:14.940534 (+   423us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:05:14.940562 (+    28us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":956920,"reported_tablets":12,"child_traces":[["op",{"apply.queue_time_us":32966,"apply.run_cpu_time_us":3542,"apply.run_wall_time_us":81935,"num_ops":4,"prepare.queue_time_us":53850,"prepare.run_cpu_time_us":58658,"prepare.run_wall_time_us":197630,"raft.queue_time_us":144866,"raft.run_cpu_time_us":7503,"raft.run_wall_time_us":38966,"replication_time_us":411132,"spinlock_wait_cycles":49460608,"thread_start_us":365118,"threads_started":4,"wal-append.queue_time_us":211945}]]}
I20260709 13:05:15.106477 21684 raft_consensus.cc:493] T 1dc5b3532fe54f74876d02beffa2c230 P e61c3a8f61bb48f8a963c9480e53c168 [term 3 FOLLOWER]: Starting leader election (detected failure of leader e5256d91808b47c195bc9b4dbd7f2b87)
W20260709 13:05:15.139894 19526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.2:46257, user_credentials={real_user=slave}} blocked reactor thread for 77577.3us
I20260709 13:05:15.141604 21924 raft_consensus.cc:2804] T 172b3dd13109415a955b71ac0e9d2234 P e5256d91808b47c195bc9b4dbd7f2b87 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:05:15.141834 20103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a16f7501e2444fb86d4e2778e734e02" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076"
I20260709 13:05:15.142231 21924 raft_consensus.cc:697] T 172b3dd13109415a955b71ac0e9d2234 P e5256d91808b47c195bc9b4dbd7f2b87 [term 3 LEADER]: Becoming Leader. State: Replica: e5256d91808b47c195bc9b4dbd7f2b87, State: Running, Role: LEADER
I20260709 13:05:15.142695 21529 raft_consensus.cc:515] T 2725d2c4cb054f18b0fc8f735c15f6c2 P e61c3a8f61bb48f8a963c9480e53c168 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:15.142910 21403 raft_consensus.cc:515] T 309c3ca0ca4b4f3ba129752ea2cb293b P 127766fc592545a4997f7790f50f6076 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } attrs { replace: true } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:05:15.144932 21529 leader_election.cc:290] T 2725d2c4cb054f18b0fc8f735c15f6c2 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 6 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:05:15.145898 21403 leader_election.cc:290] T 309c3ca0ca4b4f3ba129752ea2cb293b P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:05:15.148612 21924 consensus_queue.cc:237] T 172b3dd13109415a955b71ac0e9d2234 P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:05:15.151541 21919 consensus_queue.cc:1059] T 2a16f7501e2444fb86d4e2778e734e02 P 127766fc592545a4997f7790f50f6076 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
W20260709 13:05:15.154265 19377 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.2:46257, user_credentials={real_user=slave}} blocked reactor thread for 109994us
W20260709 13:05:15.158135 19375 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.3:36891, user_credentials={real_user=slave}} blocked reactor thread for 65240.7us
W20260709 13:05:15.158407 19450 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.3:36891, user_credentials={real_user=slave}} blocked reactor thread for 109329us
I20260709 13:05:15.106863 21559 raft_consensus.cc:515] T 70797e5783b5454ab0d0eea663e791e3 P e61c3a8f61bb48f8a963c9480e53c168 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:05:15.125826 21823 raft_consensus.cc:3060] T b08304a0a02b42d7840c4e8ee9a6bd1a P e5256d91808b47c195bc9b4dbd7f2b87 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:05:15.168520 19450 leader_election.cc:304] T 76cb037fc9064d13b59a8969d897ce8c P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:05:15.169539 19526 leader_election.cc:304] T edd7d470b5014c9489be7f41f64355c9 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:05:15.138737 21917 raft_consensus.cc:1081] T 309c3ca0ca4b4f3ba129752ea2cb293b P e5256d91808b47c195bc9b4dbd7f2b87 [term 5 LEADER]: Signalling peer e61c3a8f61bb48f8a963c9480e53c168 to start an election
I20260709 13:05:15.138558 21684 raft_consensus.cc:3060] T 1dc5b3532fe54f74876d02beffa2c230 P e61c3a8f61bb48f8a963c9480e53c168 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:05:15.173345 19449 leader_election.cc:304] T ef32ce6fdd0e40d382c79974f30295c6 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e; no voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:05:15.174489 19407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "309c3ca0ca4b4f3ba129752ea2cb293b" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:05:15.177105 21911 raft_consensus.cc:3055] T 2a16f7501e2444fb86d4e2778e734e02 P 127766fc592545a4997f7790f50f6076 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:05:15.177239 21825 leader_election.cc:290] T 85c494af21f9457a85da47b9bc70c1fd P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 3 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:05:15.177541 21911 raft_consensus.cc:740] T 2a16f7501e2444fb86d4e2778e734e02 P 127766fc592545a4997f7790f50f6076 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 127766fc592545a4997f7790f50f6076, State: Running, Role: LEADER
I20260709 13:05:15.168684 21790 consensus_queue.cc:1048] T 7be9efa6559648dbb5a0f7684c4542d1 P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.011s
I20260709 13:05:15.180825 21918 leader_election.cc:290] T 76cb037fc9064d13b59a8969d897ce8c P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 7 election: Requested vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:05:15.180858 21731 leader_election.cc:290] T 62c6c134d3d24a1ab144dd9ee6bc3f64 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 7 election: Requested vote from peers e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:05:15.181950 21767 leader_election.cc:290] T e381f1d6b8184797ad142de49be225a8 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 5 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:05:15.183033 20104 raft_consensus.cc:2468] T 1f85fc4b527a48848e5faa083b604e36 P 127766fc592545a4997f7790f50f6076 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 3.
I20260709 13:05:15.184513 21803 raft_consensus.cc:515] T 85c494af21f9457a85da47b9bc70c1fd P 127766fc592545a4997f7790f50f6076 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:05:15.185808 21700 leader_election.cc:290] T 179fd671030940b4b4a4e24bcc4aba0a P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 5 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:05:15.168514 21929 raft_consensus.cc:2804] T 2e36a9d6e29c4a7c860cf267efbd4c74 P e5256d91808b47c195bc9b4dbd7f2b87 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:05:15.180728 21887 raft_consensus.cc:515] T 76cb037fc9064d13b59a8969d897ce8c P e61c3a8f61bb48f8a963c9480e53c168 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:15.187476 21929 raft_consensus.cc:493] T 2e36a9d6e29c4a7c860cf267efbd4c74 P e5256d91808b47c195bc9b4dbd7f2b87 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 0473d2b2d01f4459b1e90fd12cc7840e)
I20260709 13:05:15.187927 21929 raft_consensus.cc:3060] T 2e36a9d6e29c4a7c860cf267efbd4c74 P e5256d91808b47c195bc9b4dbd7f2b87 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:05:15.188321 20075 leader_election.cc:400] T 172b3dd13109415a955b71ac0e9d2234 P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 2 election: Vote denied by peer e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321) with higher term. Message: Invalid argument: T 172b3dd13109415a955b71ac0e9d2234 P e5256d91808b47c195bc9b4dbd7f2b87 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 127766fc592545a4997f7790f50f6076 for earlier term 2. Current term is 3.
I20260709 13:05:15.188781 20075 leader_election.cc:403] T 172b3dd13109415a955b71ac0e9d2234 P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 2 election: Cancelling election due to peer responding with higher term
I20260709 13:05:15.188371 21411 raft_consensus.cc:515] T f1b10566f45d4a7d9029858330e02d5b P e5256d91808b47c195bc9b4dbd7f2b87 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:15.188990 21887 leader_election.cc:290] T 76cb037fc9064d13b59a8969d897ce8c P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 6 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:05:15.189942 21920 consensus_queue.cc:1048] T 775c229504194560ba9589bc2199b089 P 127766fc592545a4997f7790f50f6076 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:05:15.190768 20105 raft_consensus.cc:1240] T 1f85fc4b527a48848e5faa083b604e36 P 127766fc592545a4997f7790f50f6076 [term 3 FOLLOWER]: Rejecting Update request from peer e5256d91808b47c195bc9b4dbd7f2b87 for earlier term 2. Current term is 3. Ops: []
I20260709 13:05:15.190833 21919 raft_consensus.cc:2749] T 172b3dd13109415a955b71ac0e9d2234 P 127766fc592545a4997f7790f50f6076 [term 3 FOLLOWER]: Leader election lost for term 2. Reason: Vote denied by peer e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321) with higher term. Message: Invalid argument: T 172b3dd13109415a955b71ac0e9d2234 P e5256d91808b47c195bc9b4dbd7f2b87 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 127766fc592545a4997f7790f50f6076 for earlier term 2. Current term is 3.
I20260709 13:05:15.177140 19408 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a08760e15aac4630a629431f56024dc8"
dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
mode: GRACEFUL
new_leader_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
 from {username='slave'} at 127.0.0.1:37312
I20260709 13:05:15.192245 19408 raft_consensus.cc:606] T a08760e15aac4630a629431f56024dc8 P e5256d91808b47c195bc9b4dbd7f2b87 [term 5 LEADER]: Received request to transfer leadership to TS e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:05:15.192905 20107 raft_consensus.cc:1240] T 85c494af21f9457a85da47b9bc70c1fd P 127766fc592545a4997f7790f50f6076 [term 3 FOLLOWER]: Rejecting Update request from peer e5256d91808b47c195bc9b4dbd7f2b87 for earlier term 2. Current term is 3. Ops: []
I20260709 13:05:15.192996 19410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85c494af21f9457a85da47b9bc70c1fd" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
I20260709 13:05:15.170246 21833 raft_consensus.cc:697] T e381f1d6b8184797ad142de49be225a8 P e61c3a8f61bb48f8a963c9480e53c168 [term 4 LEADER]: Becoming Leader. State: Replica: e61c3a8f61bb48f8a963c9480e53c168, State: Running, Role: LEADER
I20260709 13:05:15.195573 21411 leader_election.cc:290] T f1b10566f45d4a7d9029858330e02d5b P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 7 election: Requested vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:05:15.196013 21858 raft_consensus.cc:2749] T ef32ce6fdd0e40d382c79974f30295c6 P 0473d2b2d01f4459b1e90fd12cc7840e [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:05:15.208841 21833 consensus_queue.cc:237] T e381f1d6b8184797ad142de49be225a8 P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:15.196214 19375 leader_election.cc:304] T 7be9efa6559648dbb5a0f7684c4542d1 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:05:15.178455 21911 consensus_queue.cc:260] T 2a16f7501e2444fb86d4e2778e734e02 P 127766fc592545a4997f7790f50f6076 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:05:15.200294 21559 leader_election.cc:290] T 70797e5783b5454ab0d0eea663e791e3 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:05:15.186618 21803 leader_election.cc:290] T 85c494af21f9457a85da47b9bc70c1fd P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 3 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
W20260709 13:05:15.203064 19526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.2:46257, user_credentials={real_user=slave}} blocked reactor thread for 50154us
I20260709 13:05:15.203173 21825 raft_consensus.cc:2749] T 48824d5acfbc485ebf8c2d944e7202de P e61c3a8f61bb48f8a963c9480e53c168 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:05:15.204030 21529 raft_consensus.cc:2804] T edd7d470b5014c9489be7f41f64355c9 P e61c3a8f61bb48f8a963c9480e53c168 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:05:15.226361 19551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62c6c134d3d24a1ab144dd9ee6bc3f64" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:05:15.226449 19558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96efeaaf1057492490e9a621f37e1a2d" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:05:15.226655 19554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48824d5acfbc485ebf8c2d944e7202de" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:05:15.228051 19554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85c494af21f9457a85da47b9bc70c1fd" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:05:15.228751 19554 raft_consensus.cc:2393] T 85c494af21f9457a85da47b9bc70c1fd P e61c3a8f61bb48f8a963c9480e53c168 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 127766fc592545a4997f7790f50f6076 in current term 3: Already voted for candidate e61c3a8f61bb48f8a963c9480e53c168 in this term.
I20260709 13:05:15.230556 19559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "309c3ca0ca4b4f3ba129752ea2cb293b" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:05:15.231619 21411 raft_consensus.cc:2804] T 7be9efa6559648dbb5a0f7684c4542d1 P e5256d91808b47c195bc9b4dbd7f2b87 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:05:15.232000 21411 raft_consensus.cc:493] T 7be9efa6559648dbb5a0f7684c4542d1 P e5256d91808b47c195bc9b4dbd7f2b87 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 0473d2b2d01f4459b1e90fd12cc7840e)
I20260709 13:05:15.232415 21411 raft_consensus.cc:3060] T 7be9efa6559648dbb5a0f7684c4542d1 P e5256d91808b47c195bc9b4dbd7f2b87 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:05:15.206928 21932 raft_consensus.cc:2804] T 76cb037fc9064d13b59a8969d897ce8c P 0473d2b2d01f4459b1e90fd12cc7840e [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:05:15.234229 21684 raft_consensus.cc:515] T 1dc5b3532fe54f74876d02beffa2c230 P e61c3a8f61bb48f8a963c9480e53c168 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:15.234869 21932 raft_consensus.cc:493] T 76cb037fc9064d13b59a8969d897ce8c P 0473d2b2d01f4459b1e90fd12cc7840e [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:15.235278 21932 raft_consensus.cc:3060] T 76cb037fc9064d13b59a8969d897ce8c P 0473d2b2d01f4459b1e90fd12cc7840e [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:05:15.236846 21684 leader_election.cc:290] T 1dc5b3532fe54f74876d02beffa2c230 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 4 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:05:15.221175 19560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14935b3ddf914369822e4a0547aaa355" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
W20260709 13:05:15.221552 19449 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.1:40321, user_credentials={real_user=slave}} blocked reactor thread for 48286.9us
I20260709 13:05:15.222069 19526 leader_election.cc:304] T fa8650e71aa14778b3d73721fc50d9fc P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:05:15.223294 19556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0afb57ae58a24a01850491d69f0213dd" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:05:15.244127 19551 raft_consensus.cc:2468] T 62c6c134d3d24a1ab144dd9ee6bc3f64 P e61c3a8f61bb48f8a963c9480e53c168 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 127766fc592545a4997f7790f50f6076 in term 7.
I20260709 13:05:15.226697 21529 raft_consensus.cc:493] T edd7d470b5014c9489be7f41f64355c9 P e61c3a8f61bb48f8a963c9480e53c168 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:05:15.207283 19450 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.3:36891, user_credentials={real_user=slave}} blocked reactor thread for 46612.9us
I20260709 13:05:15.244468 19449 leader_election.cc:304] T 86a6797bdfe94fa496c050ceae4bd0d9 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e; no voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:05:15.238394 21823 raft_consensus.cc:515] T b08304a0a02b42d7840c4e8ee9a6bd1a P e5256d91808b47c195bc9b4dbd7f2b87 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:15.205039 19309 catalog_manager.cc:5697] T 217b5fae677b4971b3bbd2f357a1f7ff P e5256d91808b47c195bc9b4dbd7f2b87 reported cstate change: term changed from 1 to 2, leader changed from e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1) to 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2). New cstate: current_term: 2 leader_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } }
I20260709 13:05:15.244887 21529 raft_consensus.cc:3060] T edd7d470b5014c9489be7f41f64355c9 P e61c3a8f61bb48f8a963c9480e53c168 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:05:15.246842 21559 raft_consensus.cc:2804] T fa8650e71aa14778b3d73721fc50d9fc P e61c3a8f61bb48f8a963c9480e53c168 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:05:15.246950 19526 leader_election.cc:304] T 179fd671030940b4b4a4e24bcc4aba0a P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168; no voters: e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:05:15.247367 21559 raft_consensus.cc:493] T fa8650e71aa14778b3d73721fc50d9fc P e61c3a8f61bb48f8a963c9480e53c168 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:15.247833 21559 raft_consensus.cc:3060] T fa8650e71aa14778b3d73721fc50d9fc P e61c3a8f61bb48f8a963c9480e53c168 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:05:15.248587 19526 leader_election.cc:304] T 4509b76741dc428e9201c70c1658da13 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:05:15.249679 21887 raft_consensus.cc:2804] T 179fd671030940b4b4a4e24bcc4aba0a P e61c3a8f61bb48f8a963c9480e53c168 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:05:15.250227 21887 raft_consensus.cc:697] T 179fd671030940b4b4a4e24bcc4aba0a P e61c3a8f61bb48f8a963c9480e53c168 [term 4 LEADER]: Becoming Leader. State: Replica: e61c3a8f61bb48f8a963c9480e53c168, State: Running, Role: LEADER
I20260709 13:05:15.247174 18300 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:05:15.251165 21887 consensus_queue.cc:237] T 179fd671030940b4b4a4e24bcc4aba0a P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:15.254083 18300 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:05:15.255002 19375 leader_election.cc:304] T 21e14947d70440f19044d8f75c31e1f9 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:05:15.256557 21917 raft_consensus.cc:2804] T 21e14947d70440f19044d8f75c31e1f9 P e5256d91808b47c195bc9b4dbd7f2b87 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:05:15.256908 21917 raft_consensus.cc:493] T 21e14947d70440f19044d8f75c31e1f9 P e5256d91808b47c195bc9b4dbd7f2b87 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 0473d2b2d01f4459b1e90fd12cc7840e)
I20260709 13:05:15.258417 19560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a08760e15aac4630a629431f56024dc8" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:05:15.246037 21929 raft_consensus.cc:515] T 2e36a9d6e29c4a7c860cf267efbd4c74 P e5256d91808b47c195bc9b4dbd7f2b87 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:15.257272 21917 raft_consensus.cc:3060] T 21e14947d70440f19044d8f75c31e1f9 P e5256d91808b47c195bc9b4dbd7f2b87 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:05:15.270208 20107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85c494af21f9457a85da47b9bc70c1fd" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076"
I20260709 13:05:15.268371 19552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2725d2c4cb054f18b0fc8f735c15f6c2" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:05:15.272109 19560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a16f7501e2444fb86d4e2778e734e02" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:05:15.272750 19552 raft_consensus.cc:2393] T 2725d2c4cb054f18b0fc8f735c15f6c2 P e61c3a8f61bb48f8a963c9480e53c168 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate e5256d91808b47c195bc9b4dbd7f2b87 in current term 6: Already voted for candidate e61c3a8f61bb48f8a963c9480e53c168 in this term.
I20260709 13:05:15.274116 20105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70797e5783b5454ab0d0eea663e791e3" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 7 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:05:15.274338 20076 leader_election.cc:304] T 85c494af21f9457a85da47b9bc70c1fd P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 127766fc592545a4997f7790f50f6076; no voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:05:15.274731 20105 raft_consensus.cc:2468] T 70797e5783b5454ab0d0eea663e791e3 P 127766fc592545a4997f7790f50f6076 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 6.
I20260709 13:05:15.277896 19555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e5873a19244c5ebbcd38e126796ee7" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:05:15.280087 20076 leader_election.cc:304] T 309c3ca0ca4b4f3ba129752ea2cb293b P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 127766fc592545a4997f7790f50f6076; no voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:05:15.280325 19560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1b10566f45d4a7d9029858330e02d5b" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:05:15.282817 19309 catalog_manager.cc:5697] T 22196caba61445d3bec98a0aab3c337d P e5256d91808b47c195bc9b4dbd7f2b87 reported cstate change: term changed from 3 to 4, leader changed from e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1) to e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3). New cstate: current_term: 4 leader_uuid: "e61c3a8f61bb48f8a963c9480e53c168" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } }
I20260709 13:05:15.283658 19559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b74109013a140ada21feeef92d6f563" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:05:15.284252 19559 raft_consensus.cc:3060] T 2b74109013a140ada21feeef92d6f563 P e61c3a8f61bb48f8a963c9480e53c168 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:15.284739 19309 catalog_manager.cc:5697] T b9f0d59553ad444883fcf5b5909f9798 P e5256d91808b47c195bc9b4dbd7f2b87 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } }
I20260709 13:05:15.285841 21529 raft_consensus.cc:515] T edd7d470b5014c9489be7f41f64355c9 P e61c3a8f61bb48f8a963c9480e53c168 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:15.271435 19377 leader_election.cc:304] T 0cdf56e38bbc453d9438d359e5a69955 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87; no voters: e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:05:15.287231 19554 raft_consensus.cc:1240] T 85c494af21f9457a85da47b9bc70c1fd P e61c3a8f61bb48f8a963c9480e53c168 [term 3 FOLLOWER]: Rejecting Update request from peer e5256d91808b47c195bc9b4dbd7f2b87 for earlier term 2. Current term is 3. Ops: []
I20260709 13:05:15.286211 19309 catalog_manager.cc:5697] T d1e5873a19244c5ebbcd38e126796ee7 P e5256d91808b47c195bc9b4dbd7f2b87 reported cstate change: term changed from 2 to 4, leader changed from e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1) to e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3). New cstate: current_term: 4 leader_uuid: "e61c3a8f61bb48f8a963c9480e53c168" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } }
I20260709 13:05:15.282733 19558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa8650e71aa14778b3d73721fc50d9fc" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:05:15.300662 19556 raft_consensus.cc:1240] T 833a2f0775ed407a94b8924ce50adb63 P e61c3a8f61bb48f8a963c9480e53c168 [term 4 FOLLOWER]: Rejecting Update request from peer e5256d91808b47c195bc9b4dbd7f2b87 for earlier term 3. Current term is 4. Ops: []
I20260709 13:05:15.299703 19553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "217b5fae677b4971b3bbd2f357a1f7ff" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:05:15.305663 20076 leader_election.cc:304] T 14935b3ddf914369822e4a0547aaa355 P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 127766fc592545a4997f7790f50f6076; no voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:05:15.307300 19485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14935b3ddf914369822e4a0547aaa355" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:05:15.288581 19551 raft_consensus.cc:1275] T 70797e5783b5454ab0d0eea663e791e3 P e61c3a8f61bb48f8a963c9480e53c168 [term 6 FOLLOWER]: Refusing update from remote peer e5256d91808b47c195bc9b4dbd7f2b87: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 6 index: 6. (index mismatch)
W20260709 13:05:15.316974 19449 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.1:40321, user_credentials={real_user=slave}} blocked reactor thread for 72579.6us
I20260709 13:05:15.318099 19449 leader_election.cc:304] T 1dc5b3532fe54f74876d02beffa2c230 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e; no voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:05:15.319530 20076 leader_election.cc:304] T 62c6c134d3d24a1ab144dd9ee6bc3f64 P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 127766fc592545a4997f7790f50f6076, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:05:15.320856 19478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62c6c134d3d24a1ab144dd9ee6bc3f64" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:05:15.328022 19485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e5873a19244c5ebbcd38e126796ee7" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:05:15.320484 19559 raft_consensus.cc:2468] T 2b74109013a140ada21feeef92d6f563 P e61c3a8f61bb48f8a963c9480e53c168 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 3.
I20260709 13:05:15.335460 19309 catalog_manager.cc:5697] T f1b10566f45d4a7d9029858330e02d5b P e5256d91808b47c195bc9b4dbd7f2b87 reported cstate change: term changed from 3 to 4, leader changed from e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1) to 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2). New cstate: current_term: 4 leader_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } }
I20260709 13:05:15.336604 21916 consensus_queue.cc:1059] T 1f85fc4b527a48848e5faa083b604e36 P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.065s
I20260709 13:05:15.337668 19486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed7fdbcb96d14d418db9ca90a792588a" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:05:15.338124 21916 raft_consensus.cc:3055] T 1f85fc4b527a48848e5faa083b604e36 P e5256d91808b47c195bc9b4dbd7f2b87 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:05:15.287912 21934 consensus_queue.cc:1059] T 0afb57ae58a24a01850491d69f0213dd P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.057s
I20260709 13:05:15.338939 19486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "172b3dd13109415a955b71ac0e9d2234" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:05:15.339620 19486 raft_consensus.cc:2368] T 172b3dd13109415a955b71ac0e9d2234 P 0473d2b2d01f4459b1e90fd12cc7840e [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 127766fc592545a4997f7790f50f6076 for earlier term 2. Current term is 3.
I20260709 13:05:15.340319 19486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "309c3ca0ca4b4f3ba129752ea2cb293b" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:05:15.341015 19486 raft_consensus.cc:2393] T 309c3ca0ca4b4f3ba129752ea2cb293b P 0473d2b2d01f4459b1e90fd12cc7840e [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 127766fc592545a4997f7790f50f6076 in current term 6: Already voted for candidate 0473d2b2d01f4459b1e90fd12cc7840e in this term.
I20260709 13:05:15.342463 21894 raft_consensus.cc:2804] T 62c6c134d3d24a1ab144dd9ee6bc3f64 P 127766fc592545a4997f7790f50f6076 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:05:15.323638 19554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76cb037fc9064d13b59a8969d897ce8c" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:05:15.289237 21911 raft_consensus.cc:3060] T 2a16f7501e2444fb86d4e2778e734e02 P 127766fc592545a4997f7790f50f6076 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:05:15.289485 21919 raft_consensus.cc:2749] T 85c494af21f9457a85da47b9bc70c1fd P 127766fc592545a4997f7790f50f6076 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:05:15.343484 19554 raft_consensus.cc:3060] T 76cb037fc9064d13b59a8969d897ce8c P e61c3a8f61bb48f8a963c9480e53c168 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:05:15.343730 19477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96efeaaf1057492490e9a621f37e1a2d" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:05:15.344334 19482 raft_consensus.cc:1275] T 775c229504194560ba9589bc2199b089 P 0473d2b2d01f4459b1e90fd12cc7840e [term 4 FOLLOWER]: Refusing update from remote peer 127766fc592545a4997f7790f50f6076: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:05:15.329088 19552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0afb57ae58a24a01850491d69f0213dd" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:05:15.345125 19478 raft_consensus.cc:2393] T 62c6c134d3d24a1ab144dd9ee6bc3f64 P 0473d2b2d01f4459b1e90fd12cc7840e [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 127766fc592545a4997f7790f50f6076 in current term 7: Already voted for candidate 0473d2b2d01f4459b1e90fd12cc7840e in this term.
I20260709 13:05:15.340289 19480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0afb57ae58a24a01850491d69f0213dd" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:05:15.354704 19480 raft_consensus.cc:2393] T 0afb57ae58a24a01850491d69f0213dd P 0473d2b2d01f4459b1e90fd12cc7840e [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 127766fc592545a4997f7790f50f6076 in current term 6: Already voted for candidate 0473d2b2d01f4459b1e90fd12cc7840e in this term.
I20260709 13:05:15.338661 21916 raft_consensus.cc:740] T 1f85fc4b527a48848e5faa083b604e36 P e5256d91808b47c195bc9b4dbd7f2b87 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: e5256d91808b47c195bc9b4dbd7f2b87, State: Running, Role: LEADER
I20260709 13:05:15.346832 19485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "172b3dd13109415a955b71ac0e9d2234" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:05:15.345830 19483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48824d5acfbc485ebf8c2d944e7202de" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:05:15.288296 21858 raft_consensus.cc:2749] T 86a6797bdfe94fa496c050ceae4bd0d9 P 0473d2b2d01f4459b1e90fd12cc7840e [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:05:15.304040 21892 raft_consensus.cc:2749] T 309c3ca0ca4b4f3ba129752ea2cb293b P 127766fc592545a4997f7790f50f6076 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 13:05:15.349261 19377 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.2:46257, user_credentials={real_user=slave}} blocked reactor thread for 82694.1us
I20260709 13:05:15.328801 21859 raft_consensus.cc:2749] T 14935b3ddf914369822e4a0547aaa355 P 127766fc592545a4997f7790f50f6076 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:05:15.365649 19377 leader_election.cc:304] T 179fd671030940b4b4a4e24bcc4aba0a P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:05:15.321973 21929 leader_election.cc:290] T 2e36a9d6e29c4a7c860cf267efbd4c74 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 5 election: Requested vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:05:15.323999 21684 raft_consensus.cc:2804] T 4509b76741dc428e9201c70c1658da13 P e61c3a8f61bb48f8a963c9480e53c168 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:05:15.343374 21700 raft_consensus.cc:2749] T 1dc5b3532fe54f74876d02beffa2c230 P 0473d2b2d01f4459b1e90fd12cc7840e [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:05:15.326861 21823 leader_election.cc:290] T b08304a0a02b42d7840c4e8ee9a6bd1a P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 6 election: Requested vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:05:15.369686 19485 raft_consensus.cc:2393] T 172b3dd13109415a955b71ac0e9d2234 P 0473d2b2d01f4459b1e90fd12cc7840e [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate e5256d91808b47c195bc9b4dbd7f2b87 in current term 3: Already voted for candidate 0473d2b2d01f4459b1e90fd12cc7840e in this term.
W20260709 13:05:15.370131 19526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.2:46257, user_credentials={real_user=slave}} blocked reactor thread for 112943us
I20260709 13:05:15.351365 19309 catalog_manager.cc:5697] T f93ee515a9c14139bf566522ed8232f3 P e5256d91808b47c195bc9b4dbd7f2b87 reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:15.370982 19478 raft_consensus.cc:1240] T 14efcc79969f41babe5529c22d59156d P 0473d2b2d01f4459b1e90fd12cc7840e [term 5 FOLLOWER]: Rejecting Update request from peer e5256d91808b47c195bc9b4dbd7f2b87 for earlier term 4. Current term is 5. Ops: []
I20260709 13:05:15.372201 19483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "217b5fae677b4971b3bbd2f357a1f7ff" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:05:15.303351 21867 consensus_queue.cc:1059] T 85c494af21f9457a85da47b9bc70c1fd P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.060s
I20260709 13:05:15.388074 21867 raft_consensus.cc:3055] T 85c494af21f9457a85da47b9bc70c1fd P e5256d91808b47c195bc9b4dbd7f2b87 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:05:15.388545 21867 raft_consensus.cc:740] T 85c494af21f9457a85da47b9bc70c1fd P e5256d91808b47c195bc9b4dbd7f2b87 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: e5256d91808b47c195bc9b4dbd7f2b87, State: Running, Role: LEADER
I20260709 13:05:15.389264 19486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1b10566f45d4a7d9029858330e02d5b" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:05:15.389568 21867 consensus_queue.cc:260] T 85c494af21f9457a85da47b9bc70c1fd P e5256d91808b47c195bc9b4dbd7f2b87 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:05:15.350355 21935 raft_consensus.cc:493] T 40e1e16737a842ee936002830f36882e P e61c3a8f61bb48f8a963c9480e53c168 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:15.379012 21529 leader_election.cc:290] T edd7d470b5014c9489be7f41f64355c9 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 5 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:05:15.379760 21927 raft_consensus.cc:2804] T 0cdf56e38bbc453d9438d359e5a69955 P e5256d91808b47c195bc9b4dbd7f2b87 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:05:15.409739 19483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b74109013a140ada21feeef92d6f563" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:05:15.385294 21411 raft_consensus.cc:515] T 7be9efa6559648dbb5a0f7684c4542d1 P e5256d91808b47c195bc9b4dbd7f2b87 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:15.411103 19552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "309c3ca0ca4b4f3ba129752ea2cb293b" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:05:15.370800 21684 raft_consensus.cc:493] T 4509b76741dc428e9201c70c1658da13 P e61c3a8f61bb48f8a963c9480e53c168 [term 1 FOLLOWER]: Starting leader election (detected failure of leader e5256d91808b47c195bc9b4dbd7f2b87)
I20260709 13:05:15.416026 21684 raft_consensus.cc:3060] T 4509b76741dc428e9201c70c1658da13 P e61c3a8f61bb48f8a963c9480e53c168 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:15.390376 19486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a61655d99124a29b486ba4a5b37faea" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:05:15.420789 19486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b08304a0a02b42d7840c4e8ee9a6bd1a" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:05:15.391121 19481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28af091831594f9d8e96482078cc7625" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:05:15.391855 19484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7be9efa6559648dbb5a0f7684c4542d1" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:05:15.419378 19483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "217b5fae677b4971b3bbd2f357a1f7ff" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:05:15.392977 19477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e36a9d6e29c4a7c860cf267efbd4c74" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:05:15.393880 19482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9f0d59553ad444883fcf5b5909f9798" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:05:15.375058 19557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edd7d470b5014c9489be7f41f64355c9" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:05:15.395563 19478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76cb037fc9064d13b59a8969d897ce8c" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:05:15.397645 20078 leader_election.cc:304] T ed7fdbcb96d14d418db9ca90a792588a P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 127766fc592545a4997f7790f50f6076; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:05:15.424302 19557 raft_consensus.cc:2393] T edd7d470b5014c9489be7f41f64355c9 P e61c3a8f61bb48f8a963c9480e53c168 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 0473d2b2d01f4459b1e90fd12cc7840e in current term 5: Already voted for candidate e61c3a8f61bb48f8a963c9480e53c168 in this term.
I20260709 13:05:15.399246 19485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e381f1d6b8184797ad142de49be225a8" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:05:15.406865 19449 leader_election.cc:304] T 4509b76741dc428e9201c70c1658da13 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e; no voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168
W20260709 13:05:15.408444 19523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.1:40321, user_credentials={real_user=slave}} blocked reactor thread for 60000.4us
I20260709 13:05:15.410246 19559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cdf56e38bbc453d9438d359e5a69955" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:05:15.425802 19559 raft_consensus.cc:2368] T 0cdf56e38bbc453d9438d359e5a69955 P e61c3a8f61bb48f8a963c9480e53c168 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 0473d2b2d01f4459b1e90fd12cc7840e for earlier term 6. Current term is 7.
I20260709 13:05:15.367291 19551 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "309c3ca0ca4b4f3ba129752ea2cb293b"
dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
 from {username='slave'} at 127.0.0.1:40438
I20260709 13:05:15.411229 19377 leader_election.cc:304] T edd7d470b5014c9489be7f41f64355c9 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87; no voters: e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:05:15.415024 19309 catalog_manager.cc:5697] T 179fd671030940b4b4a4e24bcc4aba0a P e5256d91808b47c195bc9b4dbd7f2b87 reported cstate change: term changed from 2 to 3, leader changed from e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1) to 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2). New cstate: current_term: 3 leader_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } }
I20260709 13:05:15.426592 19551 raft_consensus.cc:493] T 309c3ca0ca4b4f3ba129752ea2cb293b P e61c3a8f61bb48f8a963c9480e53c168 [term 5 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:15.419667 19526 leader_election.cc:304] T ed7fdbcb96d14d418db9ca90a792588a P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e61c3a8f61bb48f8a963c9480e53c168; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, 127766fc592545a4997f7790f50f6076
I20260709 13:05:15.412138 19480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "172b3dd13109415a955b71ac0e9d2234" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:05:15.428177 19480 raft_consensus.cc:2393] T 172b3dd13109415a955b71ac0e9d2234 P 0473d2b2d01f4459b1e90fd12cc7840e [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e5256d91808b47c195bc9b4dbd7f2b87 in current term 3: Already voted for candidate 0473d2b2d01f4459b1e90fd12cc7840e in this term.
I20260709 13:05:15.428591 19526 leader_election.cc:304] T 0e1085d23e8347fbbd5bce7542f4b1f4 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e61c3a8f61bb48f8a963c9480e53c168; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, 127766fc592545a4997f7790f50f6076
I20260709 13:05:15.429181 20078 leader_election.cc:400] T 172b3dd13109415a955b71ac0e9d2234 P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 2 election: Vote denied by peer 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257) with higher term. Message: Invalid argument: T 172b3dd13109415a955b71ac0e9d2234 P 0473d2b2d01f4459b1e90fd12cc7840e [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 127766fc592545a4997f7790f50f6076 for earlier term 2. Current term is 3.
I20260709 13:05:15.427141 19551 raft_consensus.cc:3060] T 309c3ca0ca4b4f3ba129752ea2cb293b P e61c3a8f61bb48f8a963c9480e53c168 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:05:15.431484 19554 raft_consensus.cc:2468] T 76cb037fc9064d13b59a8969d897ce8c P e61c3a8f61bb48f8a963c9480e53c168 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 7.
I20260709 13:05:15.408695 21894 raft_consensus.cc:697] T 62c6c134d3d24a1ab144dd9ee6bc3f64 P 127766fc592545a4997f7790f50f6076 [term 7 LEADER]: Becoming Leader. State: Replica: 127766fc592545a4997f7790f50f6076, State: Running, Role: LEADER
I20260709 13:05:15.432260 21893 raft_consensus.cc:2749] T ed7fdbcb96d14d418db9ca90a792588a P 127766fc592545a4997f7790f50f6076 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:05:15.432420 19309 catalog_manager.cc:5697] T df751f992649444090e27965eb1af85d P e5256d91808b47c195bc9b4dbd7f2b87 reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } health_report { overall_health: HEALTHY } } }
I20260709 13:05:15.373745 21559 raft_consensus.cc:515] T fa8650e71aa14778b3d73721fc50d9fc P e61c3a8f61bb48f8a963c9480e53c168 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:15.434928 21559 leader_election.cc:290] T fa8650e71aa14778b3d73721fc50d9fc P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 7 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:05:15.434648 19309 catalog_manager.cc:5697] T ef32ce6fdd0e40d382c79974f30295c6 P e5256d91808b47c195bc9b4dbd7f2b87 reported cstate change: term changed from 1 to 4, leader changed from 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2) to e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1). New cstate: current_term: 4 leader_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } health_report { overall_health: HEALTHY } } }
I20260709 13:05:15.435904 19523 leader_election.cc:304] T 217b5fae677b4971b3bbd2f357a1f7ff P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e61c3a8f61bb48f8a963c9480e53c168; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:05:15.438961 19558 raft_consensus.cc:2393] T fa8650e71aa14778b3d73721fc50d9fc P e61c3a8f61bb48f8a963c9480e53c168 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0473d2b2d01f4459b1e90fd12cc7840e in current term 7: Already voted for candidate e61c3a8f61bb48f8a963c9480e53c168 in this term.
I20260709 13:05:15.422690 21916 consensus_queue.cc:260] T 1f85fc4b527a48848e5faa083b604e36 P e5256d91808b47c195bc9b4dbd7f2b87 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:05:15.441371 21916 raft_consensus.cc:3060] T 1f85fc4b527a48848e5faa083b604e36 P e5256d91808b47c195bc9b4dbd7f2b87 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:15.442408 20078 leader_election.cc:304] T 96efeaaf1057492490e9a621f37e1a2d P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 127766fc592545a4997f7790f50f6076; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:05:15.443143 21893 raft_consensus.cc:2749] T 96efeaaf1057492490e9a621f37e1a2d P 127766fc592545a4997f7790f50f6076 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:05:15.379804 21926 raft_consensus.cc:3060] T 179fd671030940b4b4a4e24bcc4aba0a P e5256d91808b47c195bc9b4dbd7f2b87 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:05:15.448714 20078 leader_election.cc:304] T 0afb57ae58a24a01850491d69f0213dd P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 127766fc592545a4997f7790f50f6076; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:05:15.451954 19485 raft_consensus.cc:2368] T e381f1d6b8184797ad142de49be225a8 P 0473d2b2d01f4459b1e90fd12cc7840e [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e5256d91808b47c195bc9b4dbd7f2b87 for earlier term 4. Current term is 5.
I20260709 13:05:15.438545 19551 raft_consensus.cc:515] T 309c3ca0ca4b4f3ba129752ea2cb293b P e61c3a8f61bb48f8a963c9480e53c168 [term 6 FOLLOWER]: Starting forced leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } attrs { replace: true } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:05:15.457782 20078 leader_election.cc:304] T 48824d5acfbc485ebf8c2d944e7202de P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 127766fc592545a4997f7790f50f6076; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:05:15.409770 21927 raft_consensus.cc:493] T 0cdf56e38bbc453d9438d359e5a69955 P e5256d91808b47c195bc9b4dbd7f2b87 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:05:15.463996 19449 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.1:40321, user_credentials={real_user=slave}} blocked reactor thread for 57303.1us
I20260709 13:05:15.456761 19377 leader_election.cc:304] T 86a6797bdfe94fa496c050ceae4bd0d9 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87; no voters: e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:05:15.469569 19523 leader_election.cc:304] T 14935b3ddf914369822e4a0547aaa355 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168; no voters: 127766fc592545a4997f7790f50f6076, e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:05:15.471454 19551 leader_election.cc:290] T 309c3ca0ca4b4f3ba129752ea2cb293b P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 6 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:05:15.453778 21700 raft_consensus.cc:2749] T 4509b76741dc428e9201c70c1658da13 P 0473d2b2d01f4459b1e90fd12cc7840e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:05:15.446403 21932 raft_consensus.cc:515] T 76cb037fc9064d13b59a8969d897ce8c P 0473d2b2d01f4459b1e90fd12cc7840e [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:15.458884 21849 raft_consensus.cc:2804] T edd7d470b5014c9489be7f41f64355c9 P e5256d91808b47c195bc9b4dbd7f2b87 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:05:15.462087 21867 raft_consensus.cc:3060] T 85c494af21f9457a85da47b9bc70c1fd P e5256d91808b47c195bc9b4dbd7f2b87 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:15.484827 19408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40e1e16737a842ee936002830f36882e" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: true dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
I20260709 13:05:15.501721 19402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28af091831594f9d8e96482078cc7625" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:05:15.502878 19402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85c494af21f9457a85da47b9bc70c1fd" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
I20260709 13:05:15.503609 19554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62c6c134d3d24a1ab144dd9ee6bc3f64" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:05:15.504040 21929 raft_consensus.cc:2804] T 86a6797bdfe94fa496c050ceae4bd0d9 P e5256d91808b47c195bc9b4dbd7f2b87 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:05:15.504504 19554 raft_consensus.cc:2393] T 62c6c134d3d24a1ab144dd9ee6bc3f64 P e61c3a8f61bb48f8a963c9480e53c168 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 0473d2b2d01f4459b1e90fd12cc7840e in current term 7: Already voted for candidate 127766fc592545a4997f7790f50f6076 in this term.
I20260709 13:05:15.504653 21929 raft_consensus.cc:493] T 86a6797bdfe94fa496c050ceae4bd0d9 P e5256d91808b47c195bc9b4dbd7f2b87 [term 4 FOLLOWER]: Starting leader election (detected failure of leader e61c3a8f61bb48f8a963c9480e53c168)
I20260709 13:05:15.486151 19405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cdf56e38bbc453d9438d359e5a69955" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
I20260709 13:05:15.486687 19403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7be9efa6559648dbb5a0f7684c4542d1" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:05:15.505245 21929 raft_consensus.cc:3060] T 86a6797bdfe94fa496c050ceae4bd0d9 P e5256d91808b47c195bc9b4dbd7f2b87 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:05:15.505740 19403 raft_consensus.cc:2393] T 7be9efa6559648dbb5a0f7684c4542d1 P e5256d91808b47c195bc9b4dbd7f2b87 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e61c3a8f61bb48f8a963c9480e53c168 in current term 6: Already voted for candidate e5256d91808b47c195bc9b4dbd7f2b87 in this term.
I20260709 13:05:15.505786 19409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dc5b3532fe54f74876d02beffa2c230" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
I20260709 13:05:15.506723 19403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2725d2c4cb054f18b0fc8f735c15f6c2" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
I20260709 13:05:15.507364 19403 raft_consensus.cc:2393] T 2725d2c4cb054f18b0fc8f735c15f6c2 P e5256d91808b47c195bc9b4dbd7f2b87 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate e61c3a8f61bb48f8a963c9480e53c168 in current term 6: Already voted for candidate e5256d91808b47c195bc9b4dbd7f2b87 in this term.
I20260709 13:05:15.507026 21894 consensus_queue.cc:237] T 62c6c134d3d24a1ab144dd9ee6bc3f64 P 127766fc592545a4997f7790f50f6076 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:05:15.487510 19404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b74109013a140ada21feeef92d6f563" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:05:15.487656 19406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f575b143b844aa096b50997dad3516a" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:05:15.460289 21529 raft_consensus.cc:2749] T ed7fdbcb96d14d418db9ca90a792588a P e61c3a8f61bb48f8a963c9480e53c168 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:05:15.460510 21892 raft_consensus.cc:2749] T 0afb57ae58a24a01850491d69f0213dd P 127766fc592545a4997f7790f50f6076 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:05:15.460786 21559 raft_consensus.cc:2749] T 0e1085d23e8347fbbd5bce7542f4b1f4 P e61c3a8f61bb48f8a963c9480e53c168 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:05:15.514026 19557 raft_consensus.cc:1240] T 2b74109013a140ada21feeef92d6f563 P e61c3a8f61bb48f8a963c9480e53c168 [term 3 FOLLOWER]: Rejecting Update request from peer 0473d2b2d01f4459b1e90fd12cc7840e for earlier term 2. Current term is 3. Ops: []
W20260709 13:05:15.514283 19377 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.2:46257, user_credentials={real_user=slave}} blocked reactor thread for 65891.8us
I20260709 13:05:15.467926 21927 raft_consensus.cc:3060] T 0cdf56e38bbc453d9438d359e5a69955 P e5256d91808b47c195bc9b4dbd7f2b87 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:05:15.503551 19375 leader_election.cc:304] T 2a16f7501e2444fb86d4e2778e734e02 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87; no voters: 127766fc592545a4997f7790f50f6076, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:05:15.485802 19407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e36a9d6e29c4a7c860cf267efbd4c74" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:05:15.508652 19409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "833a2f0775ed407a94b8924ce50adb63" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
I20260709 13:05:15.485641 19411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa731b585f684a7fb2d106c50f143b83" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:05:15.508140 19403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76cb037fc9064d13b59a8969d897ce8c" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
I20260709 13:05:15.523026 19403 raft_consensus.cc:2368] T 76cb037fc9064d13b59a8969d897ce8c P e5256d91808b47c195bc9b4dbd7f2b87 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate e61c3a8f61bb48f8a963c9480e53c168 for earlier term 6. Current term is 7.
I20260709 13:05:15.468909 21887 raft_consensus.cc:2749] T 217b5fae677b4971b3bbd2f357a1f7ff P e61c3a8f61bb48f8a963c9480e53c168 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:05:15.517359 19449 leader_election.cc:304] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87; no voters: 127766fc592545a4997f7790f50f6076
W20260709 13:05:15.518416 19523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.1:40321, user_credentials={real_user=slave}} blocked reactor thread for 48961us
I20260709 13:05:15.518769 19404 raft_consensus.cc:2393] T 2b74109013a140ada21feeef92d6f563 P e5256d91808b47c195bc9b4dbd7f2b87 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e61c3a8f61bb48f8a963c9480e53c168 in current term 3: Already voted for candidate e5256d91808b47c195bc9b4dbd7f2b87 in this term.
I20260709 13:05:15.460712 21893 consensus_queue.cc:1048] T 775c229504194560ba9589bc2199b089 P 127766fc592545a4997f7790f50f6076 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.033s
I20260709 13:05:15.524187 19478 raft_consensus.cc:2393] T 76cb037fc9064d13b59a8969d897ce8c P 0473d2b2d01f4459b1e90fd12cc7840e [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate e5256d91808b47c195bc9b4dbd7f2b87 in current term 7: Already voted for candidate 0473d2b2d01f4459b1e90fd12cc7840e in this term.
I20260709 13:05:15.411412 21935 raft_consensus.cc:515] T 40e1e16737a842ee936002830f36882e P e61c3a8f61bb48f8a963c9480e53c168 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:15.524832 19408 raft_consensus.cc:3055] T 40e1e16737a842ee936002830f36882e P e5256d91808b47c195bc9b4dbd7f2b87 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:05:15.525975 19523 leader_election.cc:304] T f1b10566f45d4a7d9029858330e02d5b P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e61c3a8f61bb48f8a963c9480e53c168; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:05:15.529565 19408 raft_consensus.cc:740] T 40e1e16737a842ee936002830f36882e P e5256d91808b47c195bc9b4dbd7f2b87 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: e5256d91808b47c195bc9b4dbd7f2b87, State: Running, Role: LEADER
I20260709 13:05:15.500495 21849 raft_consensus.cc:493] T edd7d470b5014c9489be7f41f64355c9 P e5256d91808b47c195bc9b4dbd7f2b87 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 0473d2b2d01f4459b1e90fd12cc7840e)
I20260709 13:05:15.532131 19406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70797e5783b5454ab0d0eea663e791e3" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 7 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:05:15.511377 21920 raft_consensus.cc:2749] T 48824d5acfbc485ebf8c2d944e7202de P 127766fc592545a4997f7790f50f6076 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:05:15.539597 21929 raft_consensus.cc:515] T 86a6797bdfe94fa496c050ceae4bd0d9 P e5256d91808b47c195bc9b4dbd7f2b87 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:15.540460 21941 raft_consensus.cc:2749] T 14935b3ddf914369822e4a0547aaa355 P e61c3a8f61bb48f8a963c9480e53c168 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 13:05:15.540668 21940 log.cc:927] Time spent T 5ec1c4ce15e04c7e8c283a62179f2a64 P 0473d2b2d01f4459b1e90fd12cc7840e: Append to log took a long time: real 0.178s	user 0.001s	sys 0.000s
I20260709 13:05:15.548252 19449 leader_election.cc:304] T 46c5bfeecc314717bffe987e6844b6d0 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87; no voters: e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:05:15.549016 21917 raft_consensus.cc:515] T 21e14947d70440f19044d8f75c31e1f9 P e5256d91808b47c195bc9b4dbd7f2b87 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:15.549366 21700 raft_consensus.cc:2804] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P 0473d2b2d01f4459b1e90fd12cc7840e [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:05:15.527383 21823 raft_consensus.cc:2749] T 2a16f7501e2444fb86d4e2778e734e02 P e5256d91808b47c195bc9b4dbd7f2b87 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
W20260709 13:05:15.609894 21942 log.cc:927] Time spent T 179fd671030940b4b4a4e24bcc4aba0a P e61c3a8f61bb48f8a963c9480e53c168: Append to log took a long time: real 0.090s	user 0.000s	sys 0.000s
I20260709 13:05:15.611510 19407 raft_consensus.cc:1240] T 86a6797bdfe94fa496c050ceae4bd0d9 P e5256d91808b47c195bc9b4dbd7f2b87 [term 5 FOLLOWER]: Rejecting Update request from peer e61c3a8f61bb48f8a963c9480e53c168 for earlier term 4. Current term is 5. Ops: []
I20260709 13:05:15.611756 21929 leader_election.cc:290] T 86a6797bdfe94fa496c050ceae4bd0d9 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 5 election: Requested vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:05:15.551071 21935 leader_election.cc:290] T 40e1e16737a842ee936002830f36882e P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:05:15.558169 21936 raft_consensus.cc:3055] T 0afb57ae58a24a01850491d69f0213dd P e61c3a8f61bb48f8a963c9480e53c168 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:05:15.613903 21936 raft_consensus.cc:740] T 0afb57ae58a24a01850491d69f0213dd P e61c3a8f61bb48f8a963c9480e53c168 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: e61c3a8f61bb48f8a963c9480e53c168, State: Running, Role: LEADER
I20260709 13:05:15.614919 21936 consensus_queue.cc:260] T 0afb57ae58a24a01850491d69f0213dd P e61c3a8f61bb48f8a963c9480e53c168 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:05:15.558549 21849 raft_consensus.cc:3060] T edd7d470b5014c9489be7f41f64355c9 P e5256d91808b47c195bc9b4dbd7f2b87 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:05:15.559093 19450 leader_election.cc:400] T 0cdf56e38bbc453d9438d359e5a69955 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 6 election: Vote denied by peer e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891) with higher term. Message: Invalid argument: T 0cdf56e38bbc453d9438d359e5a69955 P e61c3a8f61bb48f8a963c9480e53c168 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 0473d2b2d01f4459b1e90fd12cc7840e for earlier term 6. Current term is 7.
I20260709 13:05:15.618817 19450 leader_election.cc:403] T 0cdf56e38bbc453d9438d359e5a69955 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 6 election: Cancelling election due to peer responding with higher term
I20260709 13:05:15.618914 21837 raft_consensus.cc:2804] T 46c5bfeecc314717bffe987e6844b6d0 P 0473d2b2d01f4459b1e90fd12cc7840e [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 13:05:15.619056 19449 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.1:40321, user_credentials={real_user=slave}} blocked reactor thread for 70939.4us
W20260709 13:05:15.619445 19450 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.3:36891, user_credentials={real_user=slave}} blocked reactor thread for 60492.3us
I20260709 13:05:15.619954 19449 leader_election.cc:304] T 9962423cb4e54fcfa5de01daf68a86e7 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87; no voters: 127766fc592545a4997f7790f50f6076
I20260709 13:05:15.560823 21931 raft_consensus.cc:3055] T 96efeaaf1057492490e9a621f37e1a2d P e61c3a8f61bb48f8a963c9480e53c168 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:05:15.562076 20107 raft_consensus.cc:1240] T 14935b3ddf914369822e4a0547aaa355 P 127766fc592545a4997f7790f50f6076 [term 5 FOLLOWER]: Rejecting Update request from peer e5256d91808b47c195bc9b4dbd7f2b87 for earlier term 4. Current term is 5. Ops: []
I20260709 13:05:15.563695 21684 raft_consensus.cc:515] T 4509b76741dc428e9201c70c1658da13 P e61c3a8f61bb48f8a963c9480e53c168 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:15.568938 20105 raft_consensus.cc:1275] T 70797e5783b5454ab0d0eea663e791e3 P 127766fc592545a4997f7790f50f6076 [term 6 FOLLOWER]: Refusing update from remote peer e5256d91808b47c195bc9b4dbd7f2b87: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 6 index: 6. (index mismatch)
I20260709 13:05:15.575039 19560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "179fd671030940b4b4a4e24bcc4aba0a" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
W20260709 13:05:15.582892 19375 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.3:36891, user_credentials={real_user=slave}} blocked reactor thread for 55967us
I20260709 13:05:15.630187 21684 leader_election.cc:290] T 4509b76741dc428e9201c70c1658da13 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 2 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:05:15.619474 21837 raft_consensus.cc:493] T 46c5bfeecc314717bffe987e6844b6d0 P 0473d2b2d01f4459b1e90fd12cc7840e [term 9 FOLLOWER]: Starting leader election (detected failure of leader e61c3a8f61bb48f8a963c9480e53c168)
I20260709 13:05:15.630983 21837 raft_consensus.cc:3060] T 46c5bfeecc314717bffe987e6844b6d0 P 0473d2b2d01f4459b1e90fd12cc7840e [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:05:15.631311 21929 consensus_queue.cc:1059] T 14935b3ddf914369822e4a0547aaa355 P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false }, Status: INVALID_TERM, Last received: 4.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:05:15.632021 19375 leader_election.cc:304] T 2b74109013a140ada21feeef92d6f563 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:05:15.632321 21929 consensus_queue.cc:1048] T 70797e5783b5454ab0d0eea663e791e3 P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Connected to new peer: Peer: permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:05:15.533289 19557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e381f1d6b8184797ad142de49be225a8" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:05:15.534649 19377 leader_election.cc:304] T ff75a1d4cb1f493db8f71ddc136ba9ab P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:05:15.530648 19408 consensus_queue.cc:260] T 40e1e16737a842ee936002830f36882e P e5256d91808b47c195bc9b4dbd7f2b87 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:15.609318 21700 raft_consensus.cc:493] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P 0473d2b2d01f4459b1e90fd12cc7840e [term 6 FOLLOWER]: Starting leader election (detected failure of leader 127766fc592545a4997f7790f50f6076)
W20260709 13:05:15.621932 19523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.1:40321, user_credentials={real_user=slave}} blocked reactor thread for 96052.2us
I20260709 13:05:15.636209 19523 leader_election.cc:304] T 21e14947d70440f19044d8f75c31e1f9 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e61c3a8f61bb48f8a963c9480e53c168; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:05:15.627700 21790 raft_consensus.cc:2804] T 9962423cb4e54fcfa5de01daf68a86e7 P 0473d2b2d01f4459b1e90fd12cc7840e [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:05:15.628229 21933 consensus_queue.cc:1059] T 2b74109013a140ada21feeef92d6f563 P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:05:15.608064 21887 raft_consensus.cc:2749] T f1b10566f45d4a7d9029858330e02d5b P e61c3a8f61bb48f8a963c9480e53c168 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:05:15.650568 19523 leader_election.cc:304] T ece3db938bc649d4a40a51522ed5259c P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e61c3a8f61bb48f8a963c9480e53c168; no voters: 127766fc592545a4997f7790f50f6076, e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:05:15.654350 19560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e36a9d6e29c4a7c860cf267efbd4c74" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:05:15.624645 21931 raft_consensus.cc:740] T 96efeaaf1057492490e9a621f37e1a2d P e61c3a8f61bb48f8a963c9480e53c168 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: e61c3a8f61bb48f8a963c9480e53c168, State: Running, Role: LEADER
I20260709 13:05:15.638346 21700 raft_consensus.cc:3060] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P 0473d2b2d01f4459b1e90fd12cc7840e [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:05:15.638877 21790 raft_consensus.cc:493] T 9962423cb4e54fcfa5de01daf68a86e7 P 0473d2b2d01f4459b1e90fd12cc7840e [term 8 FOLLOWER]: Starting leader election (detected failure of leader 127766fc592545a4997f7790f50f6076)
I20260709 13:05:15.664744 19408 raft_consensus.cc:3060] T 40e1e16737a842ee936002830f36882e P e5256d91808b47c195bc9b4dbd7f2b87 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:05:15.667708 19558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b08304a0a02b42d7840c4e8ee9a6bd1a" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:05:15.667930 21946 raft_consensus.cc:3055] T 14935b3ddf914369822e4a0547aaa355 P e5256d91808b47c195bc9b4dbd7f2b87 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:05:15.668329 21946 raft_consensus.cc:740] T 14935b3ddf914369822e4a0547aaa355 P e5256d91808b47c195bc9b4dbd7f2b87 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: e5256d91808b47c195bc9b4dbd7f2b87, State: Running, Role: LEADER
I20260709 13:05:15.668525 21861 raft_consensus.cc:2749] T 0cdf56e38bbc453d9438d359e5a69955 P 0473d2b2d01f4459b1e90fd12cc7840e [term 7 FOLLOWER]: Leader election lost for term 6. Reason: Vote denied by peer e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891) with higher term. Message: Invalid argument: T 0cdf56e38bbc453d9438d359e5a69955 P e61c3a8f61bb48f8a963c9480e53c168 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 0473d2b2d01f4459b1e90fd12cc7840e for earlier term 6. Current term is 7.
I20260709 13:05:15.669485 21861 raft_consensus.cc:3055] T 2b74109013a140ada21feeef92d6f563 P 0473d2b2d01f4459b1e90fd12cc7840e [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:05:15.669962 21861 raft_consensus.cc:740] T 2b74109013a140ada21feeef92d6f563 P 0473d2b2d01f4459b1e90fd12cc7840e [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 0473d2b2d01f4459b1e90fd12cc7840e, State: Running, Role: LEADER
I20260709 13:05:15.657255 21823 consensus_queue.cc:1048] T 70797e5783b5454ab0d0eea663e791e3 P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.023s
I20260709 13:05:15.671705 21861 consensus_queue.cc:260] T 2b74109013a140ada21feeef92d6f563 P 0473d2b2d01f4459b1e90fd12cc7840e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:15.672868 21861 raft_consensus.cc:3060] T 2b74109013a140ada21feeef92d6f563 P 0473d2b2d01f4459b1e90fd12cc7840e [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:15.674777 21790 raft_consensus.cc:3060] T 9962423cb4e54fcfa5de01daf68a86e7 P 0473d2b2d01f4459b1e90fd12cc7840e [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:05:15.669232 21946 consensus_queue.cc:260] T 14935b3ddf914369822e4a0547aaa355 P e5256d91808b47c195bc9b4dbd7f2b87 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.5, Last appended by leader: 5, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } attrs { replace: true } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:05:15.642068 21684 raft_consensus.cc:493] T a08760e15aac4630a629431f56024dc8 P e61c3a8f61bb48f8a963c9480e53c168 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader e5256d91808b47c195bc9b4dbd7f2b87)
I20260709 13:05:15.688002 21946 raft_consensus.cc:3060] T 14935b3ddf914369822e4a0547aaa355 P e5256d91808b47c195bc9b4dbd7f2b87 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:05:15.661106 21926 raft_consensus.cc:2749] T 179fd671030940b4b4a4e24bcc4aba0a P e5256d91808b47c195bc9b4dbd7f2b87 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:05:15.687686 21684 raft_consensus.cc:515] T a08760e15aac4630a629431f56024dc8 P e61c3a8f61bb48f8a963c9480e53c168 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:15.648886 21918 raft_consensus.cc:2804] T 2b74109013a140ada21feeef92d6f563 P e5256d91808b47c195bc9b4dbd7f2b87 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:05:15.640131 21916 consensus_queue.cc:1059] T 833a2f0775ed407a94b8924ce50adb63 P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.040s
I20260709 13:05:15.658142 21935 raft_consensus.cc:2749] T 21e14947d70440f19044d8f75c31e1f9 P e61c3a8f61bb48f8a963c9480e53c168 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 13:05:15.702620 19450 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.3:36891, user_credentials={real_user=slave}} blocked reactor thread for 81118.9us
W20260709 13:05:15.702819 19377 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.2:46257, user_credentials={real_user=slave}} blocked reactor thread for 168263us
W20260709 13:05:15.707588 19523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.1:40321, user_credentials={real_user=slave}} blocked reactor thread for 57137.8us
I20260709 13:05:15.712014 19523 leader_election.cc:304] T 1a61655d99124a29b486ba4a5b37faea P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e61c3a8f61bb48f8a963c9480e53c168; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:05:15.712212 19377 leader_election.cc:304] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, 127766fc592545a4997f7790f50f6076
I20260709 13:05:15.715533 21935 raft_consensus.cc:2749] T 1a61655d99124a29b486ba4a5b37faea P e61c3a8f61bb48f8a963c9480e53c168 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:05:15.715544 19523 leader_election.cc:304] T b08304a0a02b42d7840c4e8ee9a6bd1a P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168; no voters: 0473d2b2d01f4459b1e90fd12cc7840e
I20260709 13:05:15.701471 21411 leader_election.cc:290] T 7be9efa6559648dbb5a0f7684c4542d1 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 6 election: Requested vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:05:15.716845 21931 consensus_queue.cc:260] T 96efeaaf1057492490e9a621f37e1a2d P e61c3a8f61bb48f8a963c9480e53c168 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:05:15.717615 21950 raft_consensus.cc:2804] T b08304a0a02b42d7840c4e8ee9a6bd1a P e61c3a8f61bb48f8a963c9480e53c168 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:05:15.717837 19408 raft_consensus.cc:2468] T 40e1e16737a842ee936002830f36882e P e5256d91808b47c195bc9b4dbd7f2b87 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 7.
I20260709 13:05:15.718111 21950 raft_consensus.cc:493] T b08304a0a02b42d7840c4e8ee9a6bd1a P e61c3a8f61bb48f8a963c9480e53c168 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 0473d2b2d01f4459b1e90fd12cc7840e)
I20260709 13:05:15.718643 21950 raft_consensus.cc:3060] T b08304a0a02b42d7840c4e8ee9a6bd1a P e61c3a8f61bb48f8a963c9480e53c168 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:05:15.719251 21932 leader_election.cc:290] T 76cb037fc9064d13b59a8969d897ce8c P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 7 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:05:15.718190 21931 raft_consensus.cc:3060] T 96efeaaf1057492490e9a621f37e1a2d P e61c3a8f61bb48f8a963c9480e53c168 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:05:15.722611 21917 leader_election.cc:290] T 21e14947d70440f19044d8f75c31e1f9 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 6 election: Requested vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:05:15.723680 21849 raft_consensus.cc:515] T edd7d470b5014c9489be7f41f64355c9 P e5256d91808b47c195bc9b4dbd7f2b87 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:15.725834 21849 leader_election.cc:290] T edd7d470b5014c9489be7f41f64355c9 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 4 election: Requested vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:05:15.729086 19523 leader_election.cc:304] T 70797e5783b5454ab0d0eea663e791e3 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 127766fc592545a4997f7790f50f6076, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:05:15.731879 21916 raft_consensus.cc:2749] T ff75a1d4cb1f493db8f71ddc136ba9ab P e5256d91808b47c195bc9b4dbd7f2b87 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 13:05:15.732983 21910 log.cc:927] Time spent T 00000000000000000000000000000000 P 97750b77d35444acb7791ebf26cc2685: Append to log took a long time: real 0.074s	user 0.001s	sys 0.000s
I20260709 13:05:15.731956 21767 raft_consensus.cc:2955] T 7be9efa6559648dbb5a0f7684c4542d1 P 0473d2b2d01f4459b1e90fd12cc7840e [term 5 LEADER]: Committing config change with OpId 5.4: config changed from index -1 to 4, NON_VOTER 127766fc592545a4997f7790f50f6076 (127.17.223.4) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } attrs { replace: true } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: NON_VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: true } } }
I20260709 13:05:15.734743 19402 raft_consensus.cc:2468] T 85c494af21f9457a85da47b9bc70c1fd P e5256d91808b47c195bc9b4dbd7f2b87 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 3.
I20260709 13:05:15.737365 20105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "309c3ca0ca4b4f3ba129752ea2cb293b" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: true dest_uuid: "127766fc592545a4997f7790f50f6076"
I20260709 13:05:15.738160 20105 raft_consensus.cc:3060] T 309c3ca0ca4b4f3ba129752ea2cb293b P 127766fc592545a4997f7790f50f6076 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:05:15.741472 20107 raft_consensus.cc:1240] T 96efeaaf1057492490e9a621f37e1a2d P 127766fc592545a4997f7790f50f6076 [term 5 FOLLOWER]: Rejecting Update request from peer e61c3a8f61bb48f8a963c9480e53c168 for earlier term 4. Current term is 5. Ops: []
W20260709 13:05:15.751211 19450 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:05:15.752180 19523 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:05:15.754107 19452 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:15.712535 21956 raft_consensus.cc:493] T 775c229504194560ba9589bc2199b089 P 0473d2b2d01f4459b1e90fd12cc7840e [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:15.727227 21887 raft_consensus.cc:2749] T ece3db938bc649d4a40a51522ed5259c P e61c3a8f61bb48f8a963c9480e53c168 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 13:05:15.774242 19377 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.2:46257, user_credentials={real_user=slave}} blocked reactor thread for 62092.3us
I20260709 13:05:15.747655 21935 raft_consensus.cc:2804] T 70797e5783b5454ab0d0eea663e791e3 P e61c3a8f61bb48f8a963c9480e53c168 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:05:15.775049 19377 leader_election.cc:304] T ef32ce6fdd0e40d382c79974f30295c6 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87; no voters: e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:05:15.774276 20105 raft_consensus.cc:2468] T 309c3ca0ca4b4f3ba129752ea2cb293b P 127766fc592545a4997f7790f50f6076 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 6.
W20260709 13:05:15.775717 19375 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.3:36891, user_credentials={real_user=slave}} blocked reactor thread for 142934us
W20260709 13:05:15.776412 19449 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.1:40321, user_credentials={real_user=slave}} blocked reactor thread for 154105us
I20260709 13:05:15.777962 19375 leader_election.cc:304] T 76cb037fc9064d13b59a8969d897ce8c P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:05:15.752297 21918 raft_consensus.cc:697] T 2b74109013a140ada21feeef92d6f563 P e5256d91808b47c195bc9b4dbd7f2b87 [term 3 LEADER]: Becoming Leader. State: Replica: e5256d91808b47c195bc9b4dbd7f2b87, State: Running, Role: LEADER
I20260709 13:05:15.779212 19449 leader_election.cc:304] T 22196caba61445d3bec98a0aab3c337d P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87; no voters: e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:05:15.777294 21935 raft_consensus.cc:493] T 70797e5783b5454ab0d0eea663e791e3 P e61c3a8f61bb48f8a963c9480e53c168 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:15.788405 21935 raft_consensus.cc:3060] T 70797e5783b5454ab0d0eea663e791e3 P e61c3a8f61bb48f8a963c9480e53c168 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:05:15.791203 21918 consensus_queue.cc:237] T 2b74109013a140ada21feeef92d6f563 P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:15.778319 21411 raft_consensus.cc:3055] T 833a2f0775ed407a94b8924ce50adb63 P e5256d91808b47c195bc9b4dbd7f2b87 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:05:15.778638 21924 raft_consensus.cc:2749] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P e5256d91808b47c195bc9b4dbd7f2b87 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:05:15.803800 19377 leader_election.cc:304] T bc225c93219c45538b53a1bd3d387e4d P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87; no voters: e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:05:15.802568 21411 raft_consensus.cc:740] T 833a2f0775ed407a94b8924ce50adb63 P e5256d91808b47c195bc9b4dbd7f2b87 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: e5256d91808b47c195bc9b4dbd7f2b87, State: Running, Role: LEADER
I20260709 13:05:15.816426 21962 raft_consensus.cc:2804] T ef32ce6fdd0e40d382c79974f30295c6 P e5256d91808b47c195bc9b4dbd7f2b87 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:05:15.816044 21411 consensus_queue.cc:260] T 833a2f0775ed407a94b8924ce50adb63 P e5256d91808b47c195bc9b4dbd7f2b87 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:05:15.816910 21962 raft_consensus.cc:493] T ef32ce6fdd0e40d382c79974f30295c6 P e5256d91808b47c195bc9b4dbd7f2b87 [term 5 FOLLOWER]: Starting leader election (detected failure of leader e61c3a8f61bb48f8a963c9480e53c168)
I20260709 13:05:15.817310 21962 raft_consensus.cc:3060] T ef32ce6fdd0e40d382c79974f30295c6 P e5256d91808b47c195bc9b4dbd7f2b87 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:05:15.817873 21411 raft_consensus.cc:3060] T 833a2f0775ed407a94b8924ce50adb63 P e5256d91808b47c195bc9b4dbd7f2b87 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:05:15.819581 21700 raft_consensus.cc:515] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P 0473d2b2d01f4459b1e90fd12cc7840e [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:05:15.823028 19479 raft_consensus.cc:1240] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P 0473d2b2d01f4459b1e90fd12cc7840e [term 7 FOLLOWER]: Rejecting Update request from peer 127766fc592545a4997f7790f50f6076 for earlier term 6. Current term is 7. Ops: []
I20260709 13:05:15.825320 21927 raft_consensus.cc:515] T 0cdf56e38bbc453d9438d359e5a69955 P e5256d91808b47c195bc9b4dbd7f2b87 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:15.776857 21956 raft_consensus.cc:515] T 775c229504194560ba9589bc2199b089 P 0473d2b2d01f4459b1e90fd12cc7840e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:05:15.826789 19405 raft_consensus.cc:2393] T 0cdf56e38bbc453d9438d359e5a69955 P e5256d91808b47c195bc9b4dbd7f2b87 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate e61c3a8f61bb48f8a963c9480e53c168 in current term 7: Already voted for candidate e5256d91808b47c195bc9b4dbd7f2b87 in this term.
I20260709 13:05:15.827247 21932 raft_consensus.cc:2804] T 22196caba61445d3bec98a0aab3c337d P 0473d2b2d01f4459b1e90fd12cc7840e [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:05:15.826789 21950 raft_consensus.cc:515] T b08304a0a02b42d7840c4e8ee9a6bd1a P e61c3a8f61bb48f8a963c9480e53c168 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:15.827703 21932 raft_consensus.cc:493] T 22196caba61445d3bec98a0aab3c337d P 0473d2b2d01f4459b1e90fd12cc7840e [term 4 FOLLOWER]: Starting leader election (detected failure of leader e61c3a8f61bb48f8a963c9480e53c168)
I20260709 13:05:15.828316 21932 raft_consensus.cc:3060] T 22196caba61445d3bec98a0aab3c337d P 0473d2b2d01f4459b1e90fd12cc7840e [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:05:15.830124 21950 leader_election.cc:290] T b08304a0a02b42d7840c4e8ee9a6bd1a P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 6 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:05:15.829767 21837 raft_consensus.cc:515] T 46c5bfeecc314717bffe987e6844b6d0 P 0473d2b2d01f4459b1e90fd12cc7840e [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:15.834172 19560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86a6797bdfe94fa496c050ceae4bd0d9" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:05:15.822342 21700 leader_election.cc:290] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 7 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:05:15.836356 19551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21e14947d70440f19044d8f75c31e1f9" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:05:15.836573 19560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7be9efa6559648dbb5a0f7684c4542d1" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:05:15.840366 19377 leader_election.cc:304] T df751f992649444090e27965eb1af85d P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87; no voters: e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:05:15.836558 19523 leader_election.cc:304] T 7be9efa6559648dbb5a0f7684c4542d1 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e61c3a8f61bb48f8a963c9480e53c168; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:05:15.842058 19559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edd7d470b5014c9489be7f41f64355c9" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:05:15.842861 19559 raft_consensus.cc:2368] T edd7d470b5014c9489be7f41f64355c9 P e61c3a8f61bb48f8a963c9480e53c168 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate e5256d91808b47c195bc9b4dbd7f2b87 for earlier term 4. Current term is 5.
I20260709 13:05:15.843125 19408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76cb037fc9064d13b59a8969d897ce8c" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:05:15.844712 19403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa8650e71aa14778b3d73721fc50d9fc" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
I20260709 13:05:15.845247 19403 raft_consensus.cc:3060] T fa8650e71aa14778b3d73721fc50d9fc P e5256d91808b47c195bc9b4dbd7f2b87 [term 5 FOLLOWER]: Advancing to term 7
I20260709 13:05:15.844129 19523 leader_election.cc:304] T 7f575b143b844aa096b50997dad3516a P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e61c3a8f61bb48f8a963c9480e53c168; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:05:15.846609 19523 leader_election.cc:304] T 2e36a9d6e29c4a7c860cf267efbd4c74 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e61c3a8f61bb48f8a963c9480e53c168; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:05:15.848289 19558 raft_consensus.cc:1240] T 4509b76741dc428e9201c70c1658da13 P e61c3a8f61bb48f8a963c9480e53c168 [term 2 FOLLOWER]: Rejecting Update request from peer e5256d91808b47c195bc9b4dbd7f2b87 for earlier term 1. Current term is 2. Ops: []
I20260709 13:05:15.844524 19409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edd7d470b5014c9489be7f41f64355c9" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
I20260709 13:05:15.849578 19523 leader_election.cc:304] T 833a2f0775ed407a94b8924ce50adb63 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e61c3a8f61bb48f8a963c9480e53c168; no voters: 127766fc592545a4997f7790f50f6076, e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:05:15.849893 19409 raft_consensus.cc:3060] T edd7d470b5014c9489be7f41f64355c9 P e5256d91808b47c195bc9b4dbd7f2b87 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:05:15.827544 21790 raft_consensus.cc:515] T 9962423cb4e54fcfa5de01daf68a86e7 P 0473d2b2d01f4459b1e90fd12cc7840e [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:05:15.856241 19375 leader_election.cc:400] T edd7d470b5014c9489be7f41f64355c9 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 4 election: Vote denied by peer e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891) with higher term. Message: Invalid argument: T edd7d470b5014c9489be7f41f64355c9 P e61c3a8f61bb48f8a963c9480e53c168 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate e5256d91808b47c195bc9b4dbd7f2b87 for earlier term 4. Current term is 5.
I20260709 13:05:15.856693 19375 leader_election.cc:403] T edd7d470b5014c9489be7f41f64355c9 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 4 election: Cancelling election due to peer responding with higher term
I20260709 13:05:15.853047 19523 leader_election.cc:304] T fa731b585f684a7fb2d106c50f143b83 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e61c3a8f61bb48f8a963c9480e53c168; no voters: 127766fc592545a4997f7790f50f6076, e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:05:15.867777 19407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e5873a19244c5ebbcd38e126796ee7" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:05:15.868428 19411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9f0d59553ad444883fcf5b5909f9798" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:05:15.868671 19523 leader_election.cc:304] T 2b74109013a140ada21feeef92d6f563 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e61c3a8f61bb48f8a963c9480e53c168; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87
W20260709 13:05:15.869344 19450 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.3:36891, user_credentials={real_user=slave}} blocked reactor thread for 115642us
I20260709 13:05:15.872408 19407 raft_consensus.cc:2393] T d1e5873a19244c5ebbcd38e126796ee7 P e5256d91808b47c195bc9b4dbd7f2b87 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e61c3a8f61bb48f8a963c9480e53c168 in current term 7: Already voted for candidate e5256d91808b47c195bc9b4dbd7f2b87 in this term.
I20260709 13:05:15.867225 21931 raft_consensus.cc:2749] T fa731b585f684a7fb2d106c50f143b83 P e61c3a8f61bb48f8a963c9480e53c168 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:05:15.872790 19377 leader_election.cc:304] T ff9b0eddd810459b82d91c60777c10eb P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, 127766fc592545a4997f7790f50f6076
I20260709 13:05:15.872931 19404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc225c93219c45538b53a1bd3d387e4d" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 9 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
W20260709 13:05:15.874079 19449 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.1:40321, user_credentials={real_user=slave}} blocked reactor thread for 96039.2us
I20260709 13:05:15.875331 19406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2725d2c4cb054f18b0fc8f735c15f6c2" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:05:15.877151 19411 raft_consensus.cc:2468] T b9f0d59553ad444883fcf5b5909f9798 P e5256d91808b47c195bc9b4dbd7f2b87 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 5.
I20260709 13:05:15.848883 21926 raft_consensus.cc:2804] T bc225c93219c45538b53a1bd3d387e4d P e5256d91808b47c195bc9b4dbd7f2b87 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:05:15.881246 19558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76cb037fc9064d13b59a8969d897ce8c" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:05:15.882026 19558 raft_consensus.cc:2393] T 76cb037fc9064d13b59a8969d897ce8c P e61c3a8f61bb48f8a963c9480e53c168 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 0473d2b2d01f4459b1e90fd12cc7840e in current term 7: Already voted for candidate e5256d91808b47c195bc9b4dbd7f2b87 in this term.
I20260709 13:05:15.882889 19406 raft_consensus.cc:2393] T 2725d2c4cb054f18b0fc8f735c15f6c2 P e5256d91808b47c195bc9b4dbd7f2b87 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e61c3a8f61bb48f8a963c9480e53c168 in current term 6: Already voted for candidate e5256d91808b47c195bc9b4dbd7f2b87 in this term.
I20260709 13:05:15.883229 19523 leader_election.cc:400] T 76cb037fc9064d13b59a8969d897ce8c P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 6 election: Vote denied by peer e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321) with higher term. Message: Invalid argument: T 76cb037fc9064d13b59a8969d897ce8c P e5256d91808b47c195bc9b4dbd7f2b87 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate e61c3a8f61bb48f8a963c9480e53c168 for earlier term 6. Current term is 7.
I20260709 13:05:15.883616 19523 leader_election.cc:403] T 76cb037fc9064d13b59a8969d897ce8c P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 6 election: Cancelling election due to peer responding with higher term
I20260709 13:05:15.851996 21934 raft_consensus.cc:3060] T 7be9efa6559648dbb5a0f7684c4542d1 P e61c3a8f61bb48f8a963c9480e53c168 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:05:15.886144 19377 leader_election.cc:304] T fa8650e71aa14778b3d73721fc50d9fc P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87; no voters: e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:05:15.854717 21950 raft_consensus.cc:2749] T 2e36a9d6e29c4a7c860cf267efbd4c74 P e61c3a8f61bb48f8a963c9480e53c168 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:05:15.867841 21887 raft_consensus.cc:2749] T 833a2f0775ed407a94b8924ce50adb63 P e61c3a8f61bb48f8a963c9480e53c168 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:05:15.891038 19484 raft_consensus.cc:1240] T 9962423cb4e54fcfa5de01daf68a86e7 P 0473d2b2d01f4459b1e90fd12cc7840e [term 9 FOLLOWER]: Rejecting Update request from peer 127766fc592545a4997f7790f50f6076 for earlier term 8. Current term is 9. Ops: []
I20260709 13:05:15.854193 21941 raft_consensus.cc:2749] T 7f575b143b844aa096b50997dad3516a P e61c3a8f61bb48f8a963c9480e53c168 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:05:15.874536 21924 raft_consensus.cc:2804] T df751f992649444090e27965eb1af85d P e5256d91808b47c195bc9b4dbd7f2b87 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:05:15.903996 19377 leader_election.cc:304] T 3e1f505cb0f1427bbd698ac889d80821 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87; no voters: e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:05:15.880336 21926 raft_consensus.cc:493] T bc225c93219c45538b53a1bd3d387e4d P e5256d91808b47c195bc9b4dbd7f2b87 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 0473d2b2d01f4459b1e90fd12cc7840e)
I20260709 13:05:15.883337 21559 raft_consensus.cc:2749] T 2b74109013a140ada21feeef92d6f563 P e61c3a8f61bb48f8a963c9480e53c168 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:05:15.907588 21959 raft_consensus.cc:2749] T ff9b0eddd810459b82d91c60777c10eb P e5256d91808b47c195bc9b4dbd7f2b87 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:05:15.908124 19411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4509b76741dc428e9201c70c1658da13" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
I20260709 13:05:15.909329 19411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "309c3ca0ca4b4f3ba129752ea2cb293b" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: true dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
I20260709 13:05:15.909449 21936 raft_consensus.cc:3060] T 0afb57ae58a24a01850491d69f0213dd P e61c3a8f61bb48f8a963c9480e53c168 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:05:15.909888 19411 raft_consensus.cc:3055] T 309c3ca0ca4b4f3ba129752ea2cb293b P e5256d91808b47c195bc9b4dbd7f2b87 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:05:15.910233 19411 raft_consensus.cc:740] T 309c3ca0ca4b4f3ba129752ea2cb293b P e5256d91808b47c195bc9b4dbd7f2b87 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: e5256d91808b47c195bc9b4dbd7f2b87, State: Running, Role: LEADER
I20260709 13:05:15.910915 21960 raft_consensus.cc:2804] T 76cb037fc9064d13b59a8969d897ce8c P e5256d91808b47c195bc9b4dbd7f2b87 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:05:15.911988 19407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b08304a0a02b42d7840c4e8ee9a6bd1a" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
I20260709 13:05:15.886010 21833 raft_consensus.cc:2749] T 76cb037fc9064d13b59a8969d897ce8c P e61c3a8f61bb48f8a963c9480e53c168 [term 7 FOLLOWER]: Leader election lost for term 6. Reason: Vote denied by peer e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321) with higher term. Message: Invalid argument: T 76cb037fc9064d13b59a8969d897ce8c P e5256d91808b47c195bc9b4dbd7f2b87 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate e61c3a8f61bb48f8a963c9480e53c168 for earlier term 6. Current term is 7.
I20260709 13:05:15.916141 19449 leader_election.cc:304] T 5ec1c4ce15e04c7e8c283a62179f2a64 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e; no voters: 127766fc592545a4997f7790f50f6076, e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:05:15.913980 19377 leader_election.cc:304] T 22196caba61445d3bec98a0aab3c337d P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87; no voters: e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:05:15.911346 21887 raft_consensus.cc:493] T 65d8cb8d6ec64f459d5a47cefab10acf P e61c3a8f61bb48f8a963c9480e53c168 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:15.917245 19403 raft_consensus.cc:2468] T fa8650e71aa14778b3d73721fc50d9fc P e5256d91808b47c195bc9b4dbd7f2b87 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 7.
I20260709 13:05:15.922544 21887 raft_consensus.cc:515] T 65d8cb8d6ec64f459d5a47cefab10acf P e61c3a8f61bb48f8a963c9480e53c168 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:05:15.923708 21969 raft_consensus.cc:2749] T 5ec1c4ce15e04c7e8c283a62179f2a64 P 0473d2b2d01f4459b1e90fd12cc7840e [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:05:15.924734 21887 leader_election.cc:290] T 65d8cb8d6ec64f459d5a47cefab10acf P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:05:15.917896 21916 raft_consensus.cc:2764] T fa8650e71aa14778b3d73721fc50d9fc P e5256d91808b47c195bc9b4dbd7f2b87 [term 7 FOLLOWER]: Leader pre-election decision vote started in defunct term 5: won
I20260709 13:05:15.926298 21790 leader_election.cc:290] T 9962423cb4e54fcfa5de01daf68a86e7 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 9 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:05:15.927239 19449 leader_election.cc:304] T 3e1f505cb0f1427bbd698ac889d80821 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e; no voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:05:15.927606 21684 leader_election.cc:290] T a08760e15aac4630a629431f56024dc8 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:05:15.929018 21968 raft_consensus.cc:2749] T 3e1f505cb0f1427bbd698ac889d80821 P 0473d2b2d01f4459b1e90fd12cc7840e [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:05:15.929392 21956 leader_election.cc:290] T 775c229504194560ba9589bc2199b089 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:05:15.920699 21894 consensus_queue.cc:1059] T 9962423cb4e54fcfa5de01daf68a86e7 P 127766fc592545a4997f7790f50f6076 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 }, Status: INVALID_TERM, Last received: 8.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.010s
I20260709 13:05:15.931079 19410 raft_consensus.cc:3060] T e381f1d6b8184797ad142de49be225a8 P e5256d91808b47c195bc9b4dbd7f2b87 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:05:15.931737 21894 raft_consensus.cc:3055] T 9962423cb4e54fcfa5de01daf68a86e7 P 127766fc592545a4997f7790f50f6076 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:05:15.932158 21894 raft_consensus.cc:740] T 9962423cb4e54fcfa5de01daf68a86e7 P 127766fc592545a4997f7790f50f6076 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 127766fc592545a4997f7790f50f6076, State: Running, Role: LEADER
I20260709 13:05:15.932345 19449 leader_election.cc:304] T fa8650e71aa14778b3d73721fc50d9fc P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87; no voters: e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:05:15.933095 21894 consensus_queue.cc:260] T 9962423cb4e54fcfa5de01daf68a86e7 P 127766fc592545a4997f7790f50f6076 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 7, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:05:15.933840 21968 raft_consensus.cc:2804] T fa8650e71aa14778b3d73721fc50d9fc P 0473d2b2d01f4459b1e90fd12cc7840e [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:05:15.934240 21968 raft_consensus.cc:493] T fa8650e71aa14778b3d73721fc50d9fc P 0473d2b2d01f4459b1e90fd12cc7840e [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:15.934556 21968 raft_consensus.cc:3060] T fa8650e71aa14778b3d73721fc50d9fc P 0473d2b2d01f4459b1e90fd12cc7840e [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:05:15.894946 21958 consensus_queue.cc:1059] T 4509b76741dc428e9201c70c1658da13 P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.052s
I20260709 13:05:15.935766 21927 leader_election.cc:290] T 0cdf56e38bbc453d9438d359e5a69955 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 7 election: Requested vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:05:15.936168 21837 leader_election.cc:290] T 46c5bfeecc314717bffe987e6844b6d0 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 10 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:05:15.943806 19551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46c5bfeecc314717bffe987e6844b6d0" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 10 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:05:15.946393 19449 leader_election.cc:304] T a08760e15aac4630a629431f56024dc8 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e; no voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:05:15.945030 19403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40e1e16737a842ee936002830f36882e" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:05:15.947889 19403 raft_consensus.cc:2468] T 40e1e16737a842ee936002830f36882e P e5256d91808b47c195bc9b4dbd7f2b87 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 7.
I20260709 13:05:15.957460 19410 raft_consensus.cc:1275] T e381f1d6b8184797ad142de49be225a8 P e5256d91808b47c195bc9b4dbd7f2b87 [term 4 FOLLOWER]: Refusing update from remote peer e61c3a8f61bb48f8a963c9480e53c168: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:05:15.967502 19407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a08760e15aac4630a629431f56024dc8" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:05:15.904713 21924 raft_consensus.cc:493] T df751f992649444090e27965eb1af85d P e5256d91808b47c195bc9b4dbd7f2b87 [term 5 FOLLOWER]: Starting leader election (detected failure of leader e61c3a8f61bb48f8a963c9480e53c168)
W20260709 13:05:15.971818 19377 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.2:46257, user_credentials={real_user=slave}} blocked reactor thread for 57877.7us
I20260709 13:05:15.975492 19377 leader_election.cc:304] T 5ec1c4ce15e04c7e8c283a62179f2a64 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87; no voters: 127766fc592545a4997f7790f50f6076
I20260709 13:05:15.934469 21894 raft_consensus.cc:3060] T 9962423cb4e54fcfa5de01daf68a86e7 P 127766fc592545a4997f7790f50f6076 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:05:16.005911 19449 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.1:40321, user_credentials={real_user=slave}} blocked reactor thread for 59602.6us
I20260709 13:05:15.912976 21926 raft_consensus.cc:3060] T bc225c93219c45538b53a1bd3d387e4d P e5256d91808b47c195bc9b4dbd7f2b87 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:05:16.009020 19551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cdf56e38bbc453d9438d359e5a69955" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:05:16.009843 19551 raft_consensus.cc:2393] T 0cdf56e38bbc453d9438d359e5a69955 P e61c3a8f61bb48f8a963c9480e53c168 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate e5256d91808b47c195bc9b4dbd7f2b87 in current term 7: Already voted for candidate e61c3a8f61bb48f8a963c9480e53c168 in this term.
I20260709 13:05:15.941202 21935 raft_consensus.cc:515] T 70797e5783b5454ab0d0eea663e791e3 P e61c3a8f61bb48f8a963c9480e53c168 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:05:15.922024 21959 raft_consensus.cc:2804] T 3e1f505cb0f1427bbd698ac889d80821 P e5256d91808b47c195bc9b4dbd7f2b87 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:05:16.009114 19403 raft_consensus.cc:1275] T 179fd671030940b4b4a4e24bcc4aba0a P e5256d91808b47c195bc9b4dbd7f2b87 [term 4 FOLLOWER]: Refusing update from remote peer e61c3a8f61bb48f8a963c9480e53c168: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:05:16.013121 19526 leader_election.cc:304] T 28af091831594f9d8e96482078cc7625 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e61c3a8f61bb48f8a963c9480e53c168; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:05:16.007716 21924 raft_consensus.cc:3060] T df751f992649444090e27965eb1af85d P e5256d91808b47c195bc9b4dbd7f2b87 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:05:15.968046 21849 raft_consensus.cc:2804] T 22196caba61445d3bec98a0aab3c337d P e5256d91808b47c195bc9b4dbd7f2b87 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:05:15.920756 19411 consensus_queue.cc:260] T 309c3ca0ca4b4f3ba129752ea2cb293b P e5256d91808b47c195bc9b4dbd7f2b87 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } attrs { replace: true } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:05:15.919032 21960 raft_consensus.cc:697] T 76cb037fc9064d13b59a8969d897ce8c P e5256d91808b47c195bc9b4dbd7f2b87 [term 7 LEADER]: Becoming Leader. State: Replica: e5256d91808b47c195bc9b4dbd7f2b87, State: Running, Role: LEADER
I20260709 13:05:16.015542 19410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edd7d470b5014c9489be7f41f64355c9" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
I20260709 13:05:16.016021 20105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "309c3ca0ca4b4f3ba129752ea2cb293b" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076"
W20260709 13:05:16.019479 19377 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.2:46257, user_credentials={real_user=slave}} blocked reactor thread for 44108.7us
I20260709 13:05:16.024564 19407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "309c3ca0ca4b4f3ba129752ea2cb293b" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
I20260709 13:05:16.008203 21956 raft_consensus.cc:2749] T a08760e15aac4630a629431f56024dc8 P 0473d2b2d01f4459b1e90fd12cc7840e [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:05:16.012758 21959 raft_consensus.cc:493] T 3e1f505cb0f1427bbd698ac889d80821 P e5256d91808b47c195bc9b4dbd7f2b87 [term 4 FOLLOWER]: Starting leader election (detected failure of leader e61c3a8f61bb48f8a963c9480e53c168)
I20260709 13:05:16.028498 20105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36f6ba92b9ba46babe4ebd6c02e5fbd9" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076"
I20260709 13:05:16.025705 19410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76cb037fc9064d13b59a8969d897ce8c" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
I20260709 13:05:16.024971 19377 leader_election.cc:304] T 46c5bfeecc314717bffe987e6844b6d0 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87; no voters: e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:05:16.023699 19526 leader_election.cc:304] T 1efebf73c86e432baa55533136b6e12c P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e61c3a8f61bb48f8a963c9480e53c168; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, 127766fc592545a4997f7790f50f6076
I20260709 13:05:16.030709 19410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e381f1d6b8184797ad142de49be225a8" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
I20260709 13:05:16.028834 19411 raft_consensus.cc:3060] T 309c3ca0ca4b4f3ba129752ea2cb293b P e5256d91808b47c195bc9b4dbd7f2b87 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:05:16.031164 19410 raft_consensus.cc:3060] T e381f1d6b8184797ad142de49be225a8 P e5256d91808b47c195bc9b4dbd7f2b87 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:05:16.031221 20105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9962423cb4e54fcfa5de01daf68a86e7" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076"
I20260709 13:05:16.034045 19478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2725d2c4cb054f18b0fc8f735c15f6c2" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:05:16.034201 19407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36f6ba92b9ba46babe4ebd6c02e5fbd9" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
I20260709 13:05:16.035046 19485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dc5b3532fe54f74876d02beffa2c230" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:05:16.036223 19478 raft_consensus.cc:2393] T 2725d2c4cb054f18b0fc8f735c15f6c2 P 0473d2b2d01f4459b1e90fd12cc7840e [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate e61c3a8f61bb48f8a963c9480e53c168 in current term 6: Already voted for candidate e5256d91808b47c195bc9b4dbd7f2b87 in this term.
I20260709 13:05:16.037103 19477 raft_consensus.cc:1275] T 62c6c134d3d24a1ab144dd9ee6bc3f64 P 0473d2b2d01f4459b1e90fd12cc7840e [term 7 FOLLOWER]: Refusing update from remote peer 127766fc592545a4997f7790f50f6076: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:05:16.037359 21958 raft_consensus.cc:2804] T 46c5bfeecc314717bffe987e6844b6d0 P e5256d91808b47c195bc9b4dbd7f2b87 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:05:16.037792 21958 raft_consensus.cc:493] T 46c5bfeecc314717bffe987e6844b6d0 P e5256d91808b47c195bc9b4dbd7f2b87 [term 9 FOLLOWER]: Starting leader election (detected failure of leader e61c3a8f61bb48f8a963c9480e53c168)
I20260709 13:05:16.037954 19377 leader_election.cc:304] T f93ee515a9c14139bf566522ed8232f3 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87; no voters: e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:05:16.038221 21958 raft_consensus.cc:3060] T 46c5bfeecc314717bffe987e6844b6d0 P e5256d91808b47c195bc9b4dbd7f2b87 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:05:16.039594 21916 raft_consensus.cc:2804] T f93ee515a9c14139bf566522ed8232f3 P e5256d91808b47c195bc9b4dbd7f2b87 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:05:16.039963 21916 raft_consensus.cc:493] T f93ee515a9c14139bf566522ed8232f3 P e5256d91808b47c195bc9b4dbd7f2b87 [term 7 FOLLOWER]: Starting leader election (detected failure of leader e61c3a8f61bb48f8a963c9480e53c168)
I20260709 13:05:16.040321 21916 raft_consensus.cc:3060] T f93ee515a9c14139bf566522ed8232f3 P e5256d91808b47c195bc9b4dbd7f2b87 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:05:16.041429 20103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62c6c134d3d24a1ab144dd9ee6bc3f64" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076"
I20260709 13:05:16.042944 19482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edd7d470b5014c9489be7f41f64355c9" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:05:16.014992 21790 consensus_queue.cc:1059] T 217b5fae677b4971b3bbd2f357a1f7ff P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.017s
I20260709 13:05:16.026887 21559 raft_consensus.cc:2749] T 28af091831594f9d8e96482078cc7625 P e61c3a8f61bb48f8a963c9480e53c168 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:05:16.043570 19377 leader_election.cc:304] T 2725d2c4cb054f18b0fc8f735c15f6c2 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87; no voters: e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:05:16.022202 21957 raft_consensus.cc:2804] T 5ec1c4ce15e04c7e8c283a62179f2a64 P e5256d91808b47c195bc9b4dbd7f2b87 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:05:16.024725 21849 raft_consensus.cc:493] T 22196caba61445d3bec98a0aab3c337d P e5256d91808b47c195bc9b4dbd7f2b87 [term 4 FOLLOWER]: Starting leader election (detected failure of leader e61c3a8f61bb48f8a963c9480e53c168)
I20260709 13:05:16.043668 19482 raft_consensus.cc:2393] T edd7d470b5014c9489be7f41f64355c9 P 0473d2b2d01f4459b1e90fd12cc7840e [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate e61c3a8f61bb48f8a963c9480e53c168 in current term 5: Already voted for candidate 0473d2b2d01f4459b1e90fd12cc7840e in this term.
I20260709 13:05:16.100186 21849 raft_consensus.cc:3060] T 22196caba61445d3bec98a0aab3c337d P e5256d91808b47c195bc9b4dbd7f2b87 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:05:16.052151 19410 raft_consensus.cc:2468] T e381f1d6b8184797ad142de49be225a8 P e5256d91808b47c195bc9b4dbd7f2b87 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 5.
I20260709 13:05:16.050489 19484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76cb037fc9064d13b59a8969d897ce8c" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:05:16.103255 19410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46c5bfeecc314717bffe987e6844b6d0" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 10 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
I20260709 13:05:16.052901 19406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cdf56e38bbc453d9438d359e5a69955" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
I20260709 13:05:16.104586 19406 raft_consensus.cc:2368] T 0cdf56e38bbc453d9438d359e5a69955 P e5256d91808b47c195bc9b4dbd7f2b87 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 0473d2b2d01f4459b1e90fd12cc7840e for earlier term 6. Current term is 7.
I20260709 13:05:16.043629 21952 raft_consensus.cc:2749] T 1efebf73c86e432baa55533136b6e12c P e61c3a8f61bb48f8a963c9480e53c168 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:05:16.104756 19407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9962423cb4e54fcfa5de01daf68a86e7" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
I20260709 13:05:16.059331 21958 raft_consensus.cc:515] T 46c5bfeecc314717bffe987e6844b6d0 P e5256d91808b47c195bc9b4dbd7f2b87 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:16.058928 19485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa8650e71aa14778b3d73721fc50d9fc" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:05:16.060278 19480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40e1e16737a842ee936002830f36882e" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:05:16.059559 20104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "775c229504194560ba9589bc2199b089" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:05:16.067824 19526 leader_election.cc:304] T 6c5eebf646ad445a9d1b1adc319d7b16 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e61c3a8f61bb48f8a963c9480e53c168; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, 127766fc592545a4997f7790f50f6076
I20260709 13:05:16.064325 21790 raft_consensus.cc:3055] T 217b5fae677b4971b3bbd2f357a1f7ff P 0473d2b2d01f4459b1e90fd12cc7840e [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:05:16.063115 21968 raft_consensus.cc:515] T fa8650e71aa14778b3d73721fc50d9fc P 0473d2b2d01f4459b1e90fd12cc7840e [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:16.031980 21959 raft_consensus.cc:3060] T 3e1f505cb0f1427bbd698ac889d80821 P e5256d91808b47c195bc9b4dbd7f2b87 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:05:16.077859 20111 raft_consensus.cc:1275] T 172b3dd13109415a955b71ac0e9d2234 P 127766fc592545a4997f7790f50f6076 [term 3 FOLLOWER]: Refusing update from remote peer e5256d91808b47c195bc9b4dbd7f2b87: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:05:16.045394 21932 raft_consensus.cc:515] T 22196caba61445d3bec98a0aab3c337d P 0473d2b2d01f4459b1e90fd12cc7840e [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:16.087874 21894 consensus_queue.cc:1059] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P 127766fc592545a4997f7790f50f6076 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:05:16.088948 19554 raft_consensus.cc:1240] T b08304a0a02b42d7840c4e8ee9a6bd1a P e61c3a8f61bb48f8a963c9480e53c168 [term 6 FOLLOWER]: Rejecting Update request from peer 0473d2b2d01f4459b1e90fd12cc7840e for earlier term 5. Current term is 6. Ops: []
W20260709 13:05:16.089146 19377 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.2:46257, user_credentials={real_user=slave}} blocked reactor thread for 48312.8us
I20260709 13:05:16.084451 21934 raft_consensus.cc:2749] T 7be9efa6559648dbb5a0f7684c4542d1 P e61c3a8f61bb48f8a963c9480e53c168 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:05:16.096357 21957 raft_consensus.cc:493] T 5ec1c4ce15e04c7e8c283a62179f2a64 P e5256d91808b47c195bc9b4dbd7f2b87 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 127766fc592545a4997f7790f50f6076)
I20260709 13:05:16.093497 19403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "775c229504194560ba9589bc2199b089" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:05:16.154057 19485 raft_consensus.cc:2393] T fa8650e71aa14778b3d73721fc50d9fc P 0473d2b2d01f4459b1e90fd12cc7840e [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate e61c3a8f61bb48f8a963c9480e53c168 in current term 7: Already voted for candidate 0473d2b2d01f4459b1e90fd12cc7840e in this term.
I20260709 13:05:16.154300 19377 leader_election.cc:304] T d1e5873a19244c5ebbcd38e126796ee7 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:05:16.097286 19411 raft_consensus.cc:2468] T 309c3ca0ca4b4f3ba129752ea2cb293b P e5256d91808b47c195bc9b4dbd7f2b87 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 6.
I20260709 13:05:16.099763 21935 leader_election.cc:290] T 70797e5783b5454ab0d0eea663e791e3 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 7 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:05:16.103320 19552 raft_consensus.cc:1240] T 70797e5783b5454ab0d0eea663e791e3 P e61c3a8f61bb48f8a963c9480e53c168 [term 7 FOLLOWER]: Rejecting Update request from peer e5256d91808b47c195bc9b4dbd7f2b87 for earlier term 6. Current term is 7. Ops: [6.6-6.6]
I20260709 13:05:16.103466 19484 raft_consensus.cc:2368] T 76cb037fc9064d13b59a8969d897ce8c P 0473d2b2d01f4459b1e90fd12cc7840e [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate e61c3a8f61bb48f8a963c9480e53c168 for earlier term 6. Current term is 7.
I20260709 13:05:16.053035 19481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "309c3ca0ca4b4f3ba129752ea2cb293b" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: true dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:05:16.159663 19481 raft_consensus.cc:2393] T 309c3ca0ca4b4f3ba129752ea2cb293b P 0473d2b2d01f4459b1e90fd12cc7840e [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate e61c3a8f61bb48f8a963c9480e53c168 in current term 6: Already voted for candidate 0473d2b2d01f4459b1e90fd12cc7840e in this term.
I20260709 13:05:16.104821 19410 raft_consensus.cc:1240] T 7be9efa6559648dbb5a0f7684c4542d1 P e5256d91808b47c195bc9b4dbd7f2b87 [term 6 FOLLOWER]: Rejecting Update request from peer 0473d2b2d01f4459b1e90fd12cc7840e for earlier term 5. Current term is 6. Ops: [5.4-5.4]
I20260709 13:05:16.072427 21917 raft_consensus.cc:3055] T 4509b76741dc428e9201c70c1658da13 P e5256d91808b47c195bc9b4dbd7f2b87 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:05:16.071105 21960 consensus_queue.cc:237] T 76cb037fc9064d13b59a8969d897ce8c P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:16.095465 19405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "179fd671030940b4b4a4e24bcc4aba0a" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
I20260709 13:05:16.163560 19405 raft_consensus.cc:3060] T 179fd671030940b4b4a4e24bcc4aba0a P e5256d91808b47c195bc9b4dbd7f2b87 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:05:16.076864 20103 raft_consensus.cc:1240] T 309c3ca0ca4b4f3ba129752ea2cb293b P 127766fc592545a4997f7790f50f6076 [term 6 FOLLOWER]: Rejecting Update request from peer e5256d91808b47c195bc9b4dbd7f2b87 for earlier term 5. Current term is 6. Ops: []
I20260709 13:05:16.113343 19409 raft_consensus.cc:2468] T edd7d470b5014c9489be7f41f64355c9 P e5256d91808b47c195bc9b4dbd7f2b87 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 5.
W20260709 13:05:16.120766 19526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.2:46257, user_credentials={real_user=slave}} blocked reactor thread for 53009.4us
W20260709 13:05:16.136159 19523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.1:40321, user_credentials={real_user=slave}} blocked reactor thread for 251702us
I20260709 13:05:16.092840 21916 raft_consensus.cc:515] T f93ee515a9c14139bf566522ed8232f3 P e5256d91808b47c195bc9b4dbd7f2b87 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:16.106689 21929 raft_consensus.cc:2804] T 2725d2c4cb054f18b0fc8f735c15f6c2 P e5256d91808b47c195bc9b4dbd7f2b87 [term 6 FOLLOWER]: Leader election won for term 6
W20260709 13:05:16.149968 19374 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:16.151571 20105 raft_consensus.cc:2468] T 9962423cb4e54fcfa5de01daf68a86e7 P 127766fc592545a4997f7790f50f6076 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 9.
I20260709 13:05:16.036643 21767 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.BulkChangeConfig from 127.0.0.1:39466 (request call id 9) took 6254 ms. Trace:
I20260709 13:05:16.109130 21790 raft_consensus.cc:740] T 217b5fae677b4971b3bbd2f357a1f7ff P 0473d2b2d01f4459b1e90fd12cc7840e [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 0473d2b2d01f4459b1e90fd12cc7840e, State: Running, Role: LEADER
I20260709 13:05:16.139470 21833 raft_consensus.cc:2749] T 6c5eebf646ad445a9d1b1adc319d7b16 P e61c3a8f61bb48f8a963c9480e53c168 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:05:16.167789 21958 leader_election.cc:290] T 46c5bfeecc314717bffe987e6844b6d0 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 10 election: Requested vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:05:16.169425 19526 leader_election.cc:304] T ff75a1d4cb1f493db8f71ddc136ba9ab P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e61c3a8f61bb48f8a963c9480e53c168; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:05:16.171756 19554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46c5bfeecc314717bffe987e6844b6d0" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 10 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:05:16.176108 19559 raft_consensus.cc:1240] T 7be9efa6559648dbb5a0f7684c4542d1 P e61c3a8f61bb48f8a963c9480e53c168 [term 6 FOLLOWER]: Rejecting Update request from peer 0473d2b2d01f4459b1e90fd12cc7840e for earlier term 5. Current term is 6. Ops: []
I20260709 13:05:16.177386 19523 leader_election.cc:304] T 40e1e16737a842ee936002830f36882e P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168; no voters: 0473d2b2d01f4459b1e90fd12cc7840e
I20260709 13:05:16.177449 19479 raft_consensus.cc:1240] T 46c5bfeecc314717bffe987e6844b6d0 P 0473d2b2d01f4459b1e90fd12cc7840e [term 10 FOLLOWER]: Rejecting Update request from peer e61c3a8f61bb48f8a963c9480e53c168 for earlier term 9. Current term is 10. Ops: []
I20260709 13:05:16.157732 21957 raft_consensus.cc:3060] T 5ec1c4ce15e04c7e8c283a62179f2a64 P e5256d91808b47c195bc9b4dbd7f2b87 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:05:16.191969 19523 leader_election.cc:304] T d1e5873a19244c5ebbcd38e126796ee7 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e61c3a8f61bb48f8a963c9480e53c168; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:05:16.192008 19526 leader_election.cc:304] T 0cdf56e38bbc453d9438d359e5a69955 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:05:16.196354 19479 raft_consensus.cc:1240] T 22196caba61445d3bec98a0aab3c337d P 0473d2b2d01f4459b1e90fd12cc7840e [term 5 FOLLOWER]: Rejecting Update request from peer e61c3a8f61bb48f8a963c9480e53c168 for earlier term 4. Current term is 5. Ops: []
I20260709 13:05:16.163134 21917 raft_consensus.cc:740] T 4509b76741dc428e9201c70c1658da13 P e5256d91808b47c195bc9b4dbd7f2b87 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e5256d91808b47c195bc9b4dbd7f2b87, State: Running, Role: LEADER
I20260709 13:05:16.170796 21867 raft_consensus.cc:2749] T edd7d470b5014c9489be7f41f64355c9 P e5256d91808b47c195bc9b4dbd7f2b87 [term 5 FOLLOWER]: Leader election lost for term 4. Reason: Vote denied by peer e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891) with higher term. Message: Invalid argument: T edd7d470b5014c9489be7f41f64355c9 P e61c3a8f61bb48f8a963c9480e53c168 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate e5256d91808b47c195bc9b4dbd7f2b87 for earlier term 4. Current term is 5.
I20260709 13:05:16.169533 21731 raft_consensus.cc:493] T 40e1e16737a842ee936002830f36882e P 0473d2b2d01f4459b1e90fd12cc7840e [term 6 FOLLOWER]: Starting pre-election (detected failure of leader e5256d91808b47c195bc9b4dbd7f2b87)
I20260709 13:05:16.162540 21411 consensus_queue.cc:1048] T 172b3dd13109415a955b71ac0e9d2234 P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Connected to new peer: Peer: permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.032s
I20260709 13:05:16.141705 21962 raft_consensus.cc:515] T ef32ce6fdd0e40d382c79974f30295c6 P e5256d91808b47c195bc9b4dbd7f2b87 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
W20260709 13:05:16.204198 19526 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:16.168952 21966 raft_consensus.cc:2749] T d1e5873a19244c5ebbcd38e126796ee7 P e5256d91808b47c195bc9b4dbd7f2b87 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:05:16.207974 19479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4509b76741dc428e9201c70c1658da13" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:05:16.215680 19477 raft_consensus.cc:1240] T 0afb57ae58a24a01850491d69f0213dd P 0473d2b2d01f4459b1e90fd12cc7840e [term 6 FOLLOWER]: Rejecting Update request from peer e61c3a8f61bb48f8a963c9480e53c168 for earlier term 5. Current term is 6. Ops: []
I20260709 13:05:16.217832 19479 raft_consensus.cc:3060] T 4509b76741dc428e9201c70c1658da13 P 0473d2b2d01f4459b1e90fd12cc7840e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:16.214602 19557 raft_consensus.cc:1240] T 4509b76741dc428e9201c70c1658da13 P e61c3a8f61bb48f8a963c9480e53c168 [term 2 FOLLOWER]: Rejecting Update request from peer e5256d91808b47c195bc9b4dbd7f2b87 for earlier term 1. Current term is 2. Ops: []
I20260709 13:05:16.198871 21935 raft_consensus.cc:2749] T ff75a1d4cb1f493db8f71ddc136ba9ab P e61c3a8f61bb48f8a963c9480e53c168 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:05:16.217133 19523 leader_election.cc:304] T b9f0d59553ad444883fcf5b5909f9798 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168; no voters: 0473d2b2d01f4459b1e90fd12cc7840e
I20260709 13:05:16.201889 21559 raft_consensus.cc:2804] T 0cdf56e38bbc453d9438d359e5a69955 P e61c3a8f61bb48f8a963c9480e53c168 [term 7 FOLLOWER]: Leader election won for term 7
W20260709 13:05:16.222023 19377 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.2:46257, user_credentials={real_user=slave}} blocked reactor thread for 56314.7us
I20260709 13:05:16.206884 21934 raft_consensus.cc:3060] T d1e5873a19244c5ebbcd38e126796ee7 P e61c3a8f61bb48f8a963c9480e53c168 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:05:16.227421 19377 leader_election.cc:304] T 217b5fae677b4971b3bbd2f357a1f7ff P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:05:16.229839 19523 leader_election.cc:304] T 85c494af21f9457a85da47b9bc70c1fd P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168; no voters: 127766fc592545a4997f7790f50f6076
I20260709 13:05:16.230285 19377 leader_election.cc:304] T f1b10566f45d4a7d9029858330e02d5b P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:05:16.206997 21731 raft_consensus.cc:515] T 40e1e16737a842ee936002830f36882e P 0473d2b2d01f4459b1e90fd12cc7840e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:16.233016 21823 raft_consensus.cc:2749] T 217b5fae677b4971b3bbd2f357a1f7ff P e5256d91808b47c195bc9b4dbd7f2b87 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:05:16.177064 21767 rpcz_store.cc:276] 0709 13:05:09.772613 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:09.772754 (+   141us) service_pool.cc:224] Handling call
0709 13:05:09.901793 (+129039us) spinlock_profiling.cc:243] Waited 16 ms on lock 0x7b54000d2da0. stack: 00007f4a79de9343 00007f4a79de9240 00007f4a797781d4 00007f4a834b6304 00007f4a834b6299 00007f4a7ce71571 00007f4a7ce85520 00007f4a7cf0eb42 00007f4a7cf0d800 00007f4a81eced29 00007f4a7b44d1d4 00007f4a7b44d162 00007f4a7b44d091 00007f4a7b44d00c 00007f4a7b44c2c2 00007f4a7b24348c
0709 13:05:10.446265 (+544472us) log.cc:844] Serialized 499 byte log entry
0709 13:05:13.500494 (+3054229us) spinlock_profiling.cc:243] Waited 20.2 ms on lock 0x7b18003e9500. stack: 00007f4a79de9343 00007f4a79de9240 00007f4a797781d4 00007f4a834b6304 00007f4a834b6299 00007f4a82ce3de1 00007f4a82cf05b1 00007f4a79e1b3f3 00007f4a79e1d7c1 00007f4a79e1d779 00007f4a79e1d709 00007f4a79e1d6d1 00007f4a79e1c9cd 000000000038f354 000000000038f199 00007f4a79dfe83a
0709 13:05:16.024842 (+2524348us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":212944,"raft.queue_time_us":325452,"raft.run_cpu_time_us":1791,"raft.run_wall_time_us":178872,"spinlock_wait_cycles":83413120,"thread_start_us":300884,"threads_started":2,"wal-append.queue_time_us":38925,"wal-append.run_cpu_time_us":2028,"wal-append.run_wall_time_us":1053483}
I20260709 13:05:16.237337 19479 raft_consensus.cc:2468] T 4509b76741dc428e9201c70c1658da13 P 0473d2b2d01f4459b1e90fd12cc7840e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 2.
I20260709 13:05:16.216848 21790 consensus_queue.cc:260] T 217b5fae677b4971b3bbd2f357a1f7ff P 0473d2b2d01f4459b1e90fd12cc7840e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:16.231410 21559 raft_consensus.cc:697] T 0cdf56e38bbc453d9438d359e5a69955 P e61c3a8f61bb48f8a963c9480e53c168 [term 7 LEADER]: Becoming Leader. State: Replica: e61c3a8f61bb48f8a963c9480e53c168, State: Running, Role: LEADER
W20260709 13:05:16.238797 21939 log.cc:927] Time spent T e381f1d6b8184797ad142de49be225a8 P e61c3a8f61bb48f8a963c9480e53c168: Append to log took a long time: real 0.728s	user 0.006s	sys 0.000s
I20260709 13:05:16.239564 21790 raft_consensus.cc:3060] T 217b5fae677b4971b3bbd2f357a1f7ff P 0473d2b2d01f4459b1e90fd12cc7840e [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:16.239681 21559 consensus_queue.cc:237] T 0cdf56e38bbc453d9438d359e5a69955 P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:16.243790 19484 raft_consensus.cc:1240] T e381f1d6b8184797ad142de49be225a8 P 0473d2b2d01f4459b1e90fd12cc7840e [term 5 FOLLOWER]: Rejecting Update request from peer e61c3a8f61bb48f8a963c9480e53c168 for earlier term 4. Current term is 5. Ops: []
I20260709 13:05:16.230898 21966 consensus_queue.cc:1059] T 14efcc79969f41babe5529c22d59156d P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.015s
I20260709 13:05:16.246176 21966 raft_consensus.cc:3055] T 14efcc79969f41babe5529c22d59156d P e5256d91808b47c195bc9b4dbd7f2b87 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:05:16.246497 21966 raft_consensus.cc:740] T 14efcc79969f41babe5529c22d59156d P e5256d91808b47c195bc9b4dbd7f2b87 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: e5256d91808b47c195bc9b4dbd7f2b87, State: Running, Role: LEADER
I20260709 13:05:16.246742 21970 consensus_queue.cc:1059] T 86a6797bdfe94fa496c050ceae4bd0d9 P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 }, Status: INVALID_TERM, Last received: 4.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.063s
I20260709 13:05:16.251075 21977 ts_tablet_manager.cc:933] T 7be9efa6559648dbb5a0f7684c4542d1 P 127766fc592545a4997f7790f50f6076: Initiating tablet copy from peer 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:05:16.254204 19405 raft_consensus.cc:2468] T 179fd671030940b4b4a4e24bcc4aba0a P e5256d91808b47c195bc9b4dbd7f2b87 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 5.
I20260709 13:05:16.231158 21976 raft_consensus.cc:2804] T 40e1e16737a842ee936002830f36882e P e61c3a8f61bb48f8a963c9480e53c168 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:05:16.257572 21833 raft_consensus.cc:2804] T 85c494af21f9457a85da47b9bc70c1fd P e61c3a8f61bb48f8a963c9480e53c168 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:05:16.258134 21833 raft_consensus.cc:697] T 85c494af21f9457a85da47b9bc70c1fd P e61c3a8f61bb48f8a963c9480e53c168 [term 3 LEADER]: Becoming Leader. State: Replica: e61c3a8f61bb48f8a963c9480e53c168, State: Running, Role: LEADER
I20260709 13:05:16.258982 19523 leader_election.cc:304] T fa8650e71aa14778b3d73721fc50d9fc P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:05:16.259043 21833 consensus_queue.cc:237] T 85c494af21f9457a85da47b9bc70c1fd P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:05:16.261260 21970 raft_consensus.cc:2804] T fa8650e71aa14778b3d73721fc50d9fc P e61c3a8f61bb48f8a963c9480e53c168 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:05:16.261655 21931 raft_consensus.cc:3055] T 86a6797bdfe94fa496c050ceae4bd0d9 P e61c3a8f61bb48f8a963c9480e53c168 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:05:16.261957 21932 leader_election.cc:290] T 22196caba61445d3bec98a0aab3c337d P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 5 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:05:16.262043 21931 raft_consensus.cc:740] T 86a6797bdfe94fa496c050ceae4bd0d9 P e61c3a8f61bb48f8a963c9480e53c168 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: e61c3a8f61bb48f8a963c9480e53c168, State: Running, Role: LEADER
I20260709 13:05:16.262995 21916 leader_election.cc:290] T f93ee515a9c14139bf566522ed8232f3 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 8 election: Requested vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:05:16.263465 21976 raft_consensus.cc:697] T 40e1e16737a842ee936002830f36882e P e61c3a8f61bb48f8a963c9480e53c168 [term 7 LEADER]: Becoming Leader. State: Replica: e61c3a8f61bb48f8a963c9480e53c168, State: Running, Role: LEADER
I20260709 13:05:16.263166 21931 consensus_queue.cc:260] T 86a6797bdfe94fa496c050ceae4bd0d9 P e61c3a8f61bb48f8a963c9480e53c168 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.2, Last appended by leader: 2, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:16.229945 21917 consensus_queue.cc:260] T 4509b76741dc428e9201c70c1658da13 P e5256d91808b47c195bc9b4dbd7f2b87 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:16.264842 21917 raft_consensus.cc:3060] T 4509b76741dc428e9201c70c1658da13 P e5256d91808b47c195bc9b4dbd7f2b87 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:16.264432 21976 consensus_queue.cc:237] T 40e1e16737a842ee936002830f36882e P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:16.268620 21931 raft_consensus.cc:3060] T 86a6797bdfe94fa496c050ceae4bd0d9 P e61c3a8f61bb48f8a963c9480e53c168 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:05:16.261818 21970 raft_consensus.cc:697] T fa8650e71aa14778b3d73721fc50d9fc P e61c3a8f61bb48f8a963c9480e53c168 [term 7 LEADER]: Becoming Leader. State: Replica: e61c3a8f61bb48f8a963c9480e53c168, State: Running, Role: LEADER
I20260709 13:05:16.269979 21970 consensus_queue.cc:237] T fa8650e71aa14778b3d73721fc50d9fc P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:16.260281 19523 leader_election.cc:304] T 40e1e16737a842ee936002830f36882e P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:05:16.271471 21952 raft_consensus.cc:2804] T b9f0d59553ad444883fcf5b5909f9798 P e61c3a8f61bb48f8a963c9480e53c168 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:05:16.287907 21962 leader_election.cc:290] T ef32ce6fdd0e40d382c79974f30295c6 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 6 election: Requested vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:05:16.288223 21952 raft_consensus.cc:493] T b9f0d59553ad444883fcf5b5909f9798 P e61c3a8f61bb48f8a963c9480e53c168 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 0473d2b2d01f4459b1e90fd12cc7840e)
I20260709 13:05:16.288066 21941 consensus_queue.cc:1048] T e381f1d6b8184797ad142de49be225a8 P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:05:16.288648 21952 raft_consensus.cc:3060] T b9f0d59553ad444883fcf5b5909f9798 P e61c3a8f61bb48f8a963c9480e53c168 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:05:16.289539 21941 consensus_queue.cc:1048] T 179fd671030940b4b4a4e24bcc4aba0a P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:05:16.290010 19480 raft_consensus.cc:1240] T 179fd671030940b4b4a4e24bcc4aba0a P 0473d2b2d01f4459b1e90fd12cc7840e [term 5 FOLLOWER]: Rejecting Update request from peer e61c3a8f61bb48f8a963c9480e53c168 for earlier term 4. Current term is 5. Ops: []
I20260709 13:05:16.293619 21731 leader_election.cc:290] T 40e1e16737a842ee936002830f36882e P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:05:16.294800 21920 raft_consensus.cc:3055] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P 127766fc592545a4997f7790f50f6076 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:05:16.295210 21920 raft_consensus.cc:740] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P 127766fc592545a4997f7790f50f6076 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 127766fc592545a4997f7790f50f6076, State: Running, Role: LEADER
I20260709 13:05:16.295974 21920 consensus_queue.cc:260] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P 127766fc592545a4997f7790f50f6076 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:05:16.251633 21968 leader_election.cc:290] T fa8650e71aa14778b3d73721fc50d9fc P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 7 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:05:16.301478 21920 raft_consensus.cc:3060] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P 127766fc592545a4997f7790f50f6076 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:05:16.302877 21958 raft_consensus.cc:2749] T f1b10566f45d4a7d9029858330e02d5b P e5256d91808b47c195bc9b4dbd7f2b87 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:05:16.303510 21958 raft_consensus.cc:993] T a08760e15aac4630a629431f56024dc8 P e5256d91808b47c195bc9b4dbd7f2b87: : Instructing follower e61c3a8f61bb48f8a963c9480e53c168 to start an election
I20260709 13:05:16.304111 21980 raft_consensus.cc:1081] T a08760e15aac4630a629431f56024dc8 P e5256d91808b47c195bc9b4dbd7f2b87 [term 5 LEADER]: Signalling peer e61c3a8f61bb48f8a963c9480e53c168 to start an election
I20260709 13:05:16.305459 21849 raft_consensus.cc:515] T 22196caba61445d3bec98a0aab3c337d P e5256d91808b47c195bc9b4dbd7f2b87 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:16.306346 21893 consensus_queue.cc:1048] T 62c6c134d3d24a1ab144dd9ee6bc3f64 P 127766fc592545a4997f7790f50f6076 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:05:16.308091 21926 raft_consensus.cc:515] T bc225c93219c45538b53a1bd3d387e4d P e5256d91808b47c195bc9b4dbd7f2b87 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:16.310163 21926 leader_election.cc:290] T bc225c93219c45538b53a1bd3d387e4d P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 8 election: Requested vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:05:16.312076 19404 raft_consensus.cc:2410] T bc225c93219c45538b53a1bd3d387e4d P e5256d91808b47c195bc9b4dbd7f2b87 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e61c3a8f61bb48f8a963c9480e53c168 for term 9 because replica has last-logged OpId of term: 7 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 3.
I20260709 13:05:16.276386 19523 leader_election.cc:304] T 309c3ca0ca4b4f3ba129752ea2cb293b P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 127766fc592545a4997f7790f50f6076, e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:05:16.284868 19557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f93ee515a9c14139bf566522ed8232f3" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 8 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:05:16.299774 19449 leader_election.cc:304] T 0afb57ae58a24a01850491d69f0213dd P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e; no voters: 127766fc592545a4997f7790f50f6076, e61c3a8f61bb48f8a963c9480e53c168
W20260709 13:05:16.282071 19377 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.2:46257, user_credentials={real_user=slave}} blocked reactor thread for 51843.1us
I20260709 13:05:16.314939 19449 leader_election.cc:304] T 14efcc79969f41babe5529c22d59156d P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e; no voters: 127766fc592545a4997f7790f50f6076, e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:05:16.316268 19377 leader_election.cc:304] T 1a61655d99124a29b486ba4a5b37faea P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:05:16.300407 19485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b08304a0a02b42d7840c4e8ee9a6bd1a" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:05:16.316310 19449 leader_election.cc:304] T 172b3dd13109415a955b71ac0e9d2234 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e; no voters: 127766fc592545a4997f7790f50f6076, e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:05:16.321098 19449 leader_election.cc:304] T 1f85fc4b527a48848e5faa083b604e36 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, 127766fc592545a4997f7790f50f6076; no voters: e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:05:16.321882 19479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a08760e15aac4630a629431f56024dc8" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:05:16.270613 21957 raft_consensus.cc:515] T 5ec1c4ce15e04c7e8c283a62179f2a64 P e5256d91808b47c195bc9b4dbd7f2b87 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
W20260709 13:05:16.323225 19523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.1:40321, user_credentials={real_user=slave}} blocked reactor thread for 46923.1us
I20260709 13:05:16.324288 19523 leader_election.cc:304] T edd7d470b5014c9489be7f41f64355c9 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:05:16.324651 19449 leader_election.cc:304] T 309c3ca0ca4b4f3ba129752ea2cb293b P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e; no voters: 127766fc592545a4997f7790f50f6076, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:05:16.332507 19449 leader_election.cc:304] T 62c6c134d3d24a1ab144dd9ee6bc3f64 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e; no voters: 127766fc592545a4997f7790f50f6076, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:05:16.337477 20105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65d8cb8d6ec64f459d5a47cefab10acf" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:05:16.338413 20105 raft_consensus.cc:2468] T 65d8cb8d6ec64f459d5a47cefab10acf P 127766fc592545a4997f7790f50f6076 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 2.
I20260709 13:05:16.340827 20105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70797e5783b5454ab0d0eea663e791e3" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 7 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076"
I20260709 13:05:16.345568 19449 leader_election.cc:304] T 9962423cb4e54fcfa5de01daf68a86e7 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, 127766fc592545a4997f7790f50f6076; no voters: 
I20260709 13:05:16.350958 19377 leader_election.cc:304] T b08304a0a02b42d7840c4e8ee9a6bd1a P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:05:16.352970 21977 tablet_copy_client.cc:323] T 7be9efa6559648dbb5a0f7684c4542d1 P 127766fc592545a4997f7790f50f6076: tablet copy: Beginning tablet copy session from remote peer at address 127.17.223.2:46257
I20260709 13:05:16.319550 21861 raft_consensus.cc:2749] T 14efcc79969f41babe5529c22d59156d P 0473d2b2d01f4459b1e90fd12cc7840e [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:05:16.330981 21968 raft_consensus.cc:2749] T 0afb57ae58a24a01850491d69f0213dd P 0473d2b2d01f4459b1e90fd12cc7840e [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:05:16.367064 19554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc225c93219c45538b53a1bd3d387e4d" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:05:16.369216 19554 raft_consensus.cc:2393] T bc225c93219c45538b53a1bd3d387e4d P e61c3a8f61bb48f8a963c9480e53c168 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate e5256d91808b47c195bc9b4dbd7f2b87 in current term 8: Already voted for candidate e61c3a8f61bb48f8a963c9480e53c168 in this term.
I20260709 13:05:16.366642 19560 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a08760e15aac4630a629431f56024dc8"
dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
 from {username='slave'} at 127.0.0.1:40438
I20260709 13:05:16.371220 19560 raft_consensus.cc:493] T a08760e15aac4630a629431f56024dc8 P e61c3a8f61bb48f8a963c9480e53c168 [term 5 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:16.371549 19560 raft_consensus.cc:3060] T a08760e15aac4630a629431f56024dc8 P e61c3a8f61bb48f8a963c9480e53c168 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:05:16.372809 19559 raft_consensus.cc:1275] T 62c6c134d3d24a1ab144dd9ee6bc3f64 P e61c3a8f61bb48f8a963c9480e53c168 [term 7 FOLLOWER]: Refusing update from remote peer 127766fc592545a4997f7790f50f6076: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:05:16.366322 19557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef32ce6fdd0e40d382c79974f30295c6" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:05:16.376003 19523 leader_election.cc:304] T 65d8cb8d6ec64f459d5a47cefab10acf P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 127766fc592545a4997f7790f50f6076, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:05:16.399463 19526 leader_election.cc:304] T 1dc5b3532fe54f74876d02beffa2c230 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e61c3a8f61bb48f8a963c9480e53c168; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:05:16.400103 19405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65d8cb8d6ec64f459d5a47cefab10acf" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:05:16.400782 19405 raft_consensus.cc:2468] T 65d8cb8d6ec64f459d5a47cefab10acf P e5256d91808b47c195bc9b4dbd7f2b87 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 2.
I20260709 13:05:16.401264 19526 leader_election.cc:304] T 2725d2c4cb054f18b0fc8f735c15f6c2 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e61c3a8f61bb48f8a963c9480e53c168; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:05:16.402053 19405 raft_consensus.cc:1240] T 179fd671030940b4b4a4e24bcc4aba0a P e5256d91808b47c195bc9b4dbd7f2b87 [term 5 FOLLOWER]: Rejecting Update request from peer e61c3a8f61bb48f8a963c9480e53c168 for earlier term 4. Current term is 5. Ops: [4.4-4.4]
I20260709 13:05:16.402403 19403 raft_consensus.cc:1240] T e381f1d6b8184797ad142de49be225a8 P e5256d91808b47c195bc9b4dbd7f2b87 [term 5 FOLLOWER]: Rejecting Update request from peer e61c3a8f61bb48f8a963c9480e53c168 for earlier term 4. Current term is 5. Ops: [4.4-4.4]
I20260709 13:05:16.403863 19409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70797e5783b5454ab0d0eea663e791e3" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 7 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
I20260709 13:05:16.247284 21966 consensus_queue.cc:260] T 14efcc79969f41babe5529c22d59156d P e5256d91808b47c195bc9b4dbd7f2b87 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:05:16.344074 21837 raft_consensus.cc:2804] T 1f85fc4b527a48848e5faa083b604e36 P 0473d2b2d01f4459b1e90fd12cc7840e [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:05:16.406592 19405 raft_consensus.cc:1240] T f1b10566f45d4a7d9029858330e02d5b P e5256d91808b47c195bc9b4dbd7f2b87 [term 7 FOLLOWER]: Rejecting Update request from peer 0473d2b2d01f4459b1e90fd12cc7840e for earlier term 6. Current term is 7. Ops: []
W20260709 13:05:16.405241 20075 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.1:40321, user_credentials={real_user=slave}} blocked reactor thread for 243149us
I20260709 13:05:16.355268 21936 raft_consensus.cc:2804] T edd7d470b5014c9489be7f41f64355c9 P e61c3a8f61bb48f8a963c9480e53c168 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:05:16.416879 19409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22196caba61445d3bec98a0aab3c337d" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
I20260709 13:05:16.355315 21941 raft_consensus.cc:2804] T 309c3ca0ca4b4f3ba129752ea2cb293b P e61c3a8f61bb48f8a963c9480e53c168 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:05:16.426115 19409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40e1e16737a842ee936002830f36882e" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:05:16.417969 19406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa8650e71aa14778b3d73721fc50d9fc" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
I20260709 13:05:16.355046 21932 raft_consensus.cc:2749] T 309c3ca0ca4b4f3ba129752ea2cb293b P 0473d2b2d01f4459b1e90fd12cc7840e [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:05:16.419445 19410 raft_consensus.cc:1240] T f93ee515a9c14139bf566522ed8232f3 P e5256d91808b47c195bc9b4dbd7f2b87 [term 8 FOLLOWER]: Rejecting Update request from peer e61c3a8f61bb48f8a963c9480e53c168 for earlier term 7. Current term is 8. Ops: []
I20260709 13:05:16.427058 19406 raft_consensus.cc:2393] T fa8650e71aa14778b3d73721fc50d9fc P e5256d91808b47c195bc9b4dbd7f2b87 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 0473d2b2d01f4459b1e90fd12cc7840e in current term 7: Already voted for candidate e61c3a8f61bb48f8a963c9480e53c168 in this term.
I20260709 13:05:16.427127 19523 leader_election.cc:304] T 70797e5783b5454ab0d0eea663e791e3 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e61c3a8f61bb48f8a963c9480e53c168; no voters: 127766fc592545a4997f7790f50f6076, e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:05:16.397066 21559 raft_consensus.cc:493] T 2a16f7501e2444fb86d4e2778e734e02 P e61c3a8f61bb48f8a963c9480e53c168 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 127766fc592545a4997f7790f50f6076)
I20260709 13:05:16.363567 21916 raft_consensus.cc:2749] T 1a61655d99124a29b486ba4a5b37faea P e5256d91808b47c195bc9b4dbd7f2b87 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:05:16.343627 21929 raft_consensus.cc:697] T 2725d2c4cb054f18b0fc8f735c15f6c2 P e5256d91808b47c195bc9b4dbd7f2b87 [term 6 LEADER]: Becoming Leader. State: Replica: e5256d91808b47c195bc9b4dbd7f2b87, State: Running, Role: LEADER
W20260709 13:05:16.423846 19377 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.2:46257, user_credentials={real_user=slave}} blocked reactor thread for 73021us
I20260709 13:05:16.415621 21833 raft_consensus.cc:2749] T 1dc5b3532fe54f74876d02beffa2c230 P e61c3a8f61bb48f8a963c9480e53c168 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:05:16.417375 19411 raft_consensus.cc:1240] T 22196caba61445d3bec98a0aab3c337d P e5256d91808b47c195bc9b4dbd7f2b87 [term 5 FOLLOWER]: Rejecting Update request from peer e61c3a8f61bb48f8a963c9480e53c168 for earlier term 4. Current term is 5. Ops: []
I20260709 13:05:16.428257 19406 raft_consensus.cc:1240] T 21e14947d70440f19044d8f75c31e1f9 P e5256d91808b47c195bc9b4dbd7f2b87 [term 6 FOLLOWER]: Rejecting Update request from peer 0473d2b2d01f4459b1e90fd12cc7840e for earlier term 5. Current term is 6. Ops: []
I20260709 13:05:16.405645 21962 raft_consensus.cc:2749] T b08304a0a02b42d7840c4e8ee9a6bd1a P e5256d91808b47c195bc9b4dbd7f2b87 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:05:16.427003 19409 raft_consensus.cc:2393] T 40e1e16737a842ee936002830f36882e P e5256d91808b47c195bc9b4dbd7f2b87 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0473d2b2d01f4459b1e90fd12cc7840e in current term 7: Already voted for candidate e61c3a8f61bb48f8a963c9480e53c168 in this term.
I20260709 13:05:16.419790 19449 leader_election.cc:304] T edd7d470b5014c9489be7f41f64355c9 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e; no voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168
W20260709 13:05:16.430136 20077 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:16.430707 19405 raft_consensus.cc:1240] T d1e5873a19244c5ebbcd38e126796ee7 P e5256d91808b47c195bc9b4dbd7f2b87 [term 7 FOLLOWER]: Rejecting Update request from peer 0473d2b2d01f4459b1e90fd12cc7840e for earlier term 6. Current term is 7. Ops: []
I20260709 13:05:16.403556 21935 raft_consensus.cc:2804] T 65d8cb8d6ec64f459d5a47cefab10acf P e61c3a8f61bb48f8a963c9480e53c168 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:05:16.431965 19526 leader_election.cc:400] T 76cb037fc9064d13b59a8969d897ce8c P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 6 election: Vote denied by peer 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257) with higher term. Message: Invalid argument: T 76cb037fc9064d13b59a8969d897ce8c P 0473d2b2d01f4459b1e90fd12cc7840e [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate e61c3a8f61bb48f8a963c9480e53c168 for earlier term 6. Current term is 7.
I20260709 13:05:16.331118 21731 raft_consensus.cc:2749] T 172b3dd13109415a955b71ac0e9d2234 P 0473d2b2d01f4459b1e90fd12cc7840e [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:05:16.417966 21931 raft_consensus.cc:2749] T 2725d2c4cb054f18b0fc8f735c15f6c2 P e61c3a8f61bb48f8a963c9480e53c168 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:05:16.352962 21924 raft_consensus.cc:515] T df751f992649444090e27965eb1af85d P e5256d91808b47c195bc9b4dbd7f2b87 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:16.436300 19406 raft_consensus.cc:1240] T 5ec1c4ce15e04c7e8c283a62179f2a64 P e5256d91808b47c195bc9b4dbd7f2b87 [term 4 FOLLOWER]: Rejecting Update request from peer 127766fc592545a4997f7790f50f6076 for earlier term 3. Current term is 4. Ops: []
I20260709 13:05:16.438441 20105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ec1c4ce15e04c7e8c283a62179f2a64" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076"
I20260709 13:05:16.439884 21965 raft_consensus.cc:2804] T 9962423cb4e54fcfa5de01daf68a86e7 P 0473d2b2d01f4459b1e90fd12cc7840e [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:05:16.441625 19496 tablet_copy_service.cc:140] P 0473d2b2d01f4459b1e90fd12cc7840e: Received BeginTabletCopySession request for tablet 7be9efa6559648dbb5a0f7684c4542d1 from peer 127766fc592545a4997f7790f50f6076 ({username='slave'} at 127.0.0.1:39478)
W20260709 13:05:16.441864 21988 log.cc:927] Time spent T 85c494af21f9457a85da47b9bc70c1fd P e61c3a8f61bb48f8a963c9480e53c168: Append to log took a long time: real 0.119s	user 0.000s	sys 0.001s
I20260709 13:05:16.442216 19496 tablet_copy_service.cc:161] P 0473d2b2d01f4459b1e90fd12cc7840e: Beginning new tablet copy session on tablet 7be9efa6559648dbb5a0f7684c4542d1 from peer 127766fc592545a4997f7790f50f6076 at {username='slave'} at 127.0.0.1:39478: session id = 127766fc592545a4997f7790f50f6076-7be9efa6559648dbb5a0f7684c4542d1
I20260709 13:05:16.442333 21934 raft_consensus.cc:2749] T d1e5873a19244c5ebbcd38e126796ee7 P e61c3a8f61bb48f8a963c9480e53c168 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:05:16.443379 21931 consensus_queue.cc:1059] T 46c5bfeecc314717bffe987e6844b6d0 P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 }, Status: INVALID_TERM, Last received: 9.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:05:16.446018 21935 raft_consensus.cc:493] T 65d8cb8d6ec64f459d5a47cefab10acf P e61c3a8f61bb48f8a963c9480e53c168 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:16.448462 21529 consensus_queue.cc:1059] T 22196caba61445d3bec98a0aab3c337d P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:05:16.481902 21934 raft_consensus.cc:3055] T 46c5bfeecc314717bffe987e6844b6d0 P e61c3a8f61bb48f8a963c9480e53c168 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:05:16.482079 21935 raft_consensus.cc:3060] T 65d8cb8d6ec64f459d5a47cefab10acf P e61c3a8f61bb48f8a963c9480e53c168 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:16.482398 21934 raft_consensus.cc:740] T 46c5bfeecc314717bffe987e6844b6d0 P e61c3a8f61bb48f8a963c9480e53c168 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: e61c3a8f61bb48f8a963c9480e53c168, State: Running, Role: LEADER
I20260709 13:05:16.482558 21529 raft_consensus.cc:3055] T 22196caba61445d3bec98a0aab3c337d P e61c3a8f61bb48f8a963c9480e53c168 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:05:16.483013 21529 raft_consensus.cc:740] T 22196caba61445d3bec98a0aab3c337d P e61c3a8f61bb48f8a963c9480e53c168 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: e61c3a8f61bb48f8a963c9480e53c168, State: Running, Role: LEADER
I20260709 13:05:16.483282 21934 consensus_queue.cc:260] T 46c5bfeecc314717bffe987e6844b6d0 P e61c3a8f61bb48f8a963c9480e53c168 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 9.4, Last appended by leader: 4, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:16.483829 21529 consensus_queue.cc:260] T 22196caba61445d3bec98a0aab3c337d P e61c3a8f61bb48f8a963c9480e53c168 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:16.484588 21934 raft_consensus.cc:3060] T 46c5bfeecc314717bffe987e6844b6d0 P e61c3a8f61bb48f8a963c9480e53c168 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:05:16.485080 21529 raft_consensus.cc:3060] T 22196caba61445d3bec98a0aab3c337d P e61c3a8f61bb48f8a963c9480e53c168 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:05:16.434109 21559 raft_consensus.cc:515] T 2a16f7501e2444fb86d4e2778e734e02 P e61c3a8f61bb48f8a963c9480e53c168 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:05:16.487491 21559 leader_election.cc:290] T 2a16f7501e2444fb86d4e2778e734e02 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:05:16.451295 19526 leader_election.cc:304] T 4509b76741dc428e9201c70c1658da13 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168; no voters: e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:05:16.489725 21833 raft_consensus.cc:2804] T 4509b76741dc428e9201c70c1658da13 P e61c3a8f61bb48f8a963c9480e53c168 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:05:16.490242 21833 raft_consensus.cc:697] T 4509b76741dc428e9201c70c1658da13 P e61c3a8f61bb48f8a963c9480e53c168 [term 2 LEADER]: Becoming Leader. State: Replica: e61c3a8f61bb48f8a963c9480e53c168, State: Running, Role: LEADER
I20260709 13:05:16.491132 21833 consensus_queue.cc:237] T 4509b76741dc428e9201c70c1658da13 P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:16.492213 19407 raft_consensus.cc:1240] T b08304a0a02b42d7840c4e8ee9a6bd1a P e5256d91808b47c195bc9b4dbd7f2b87 [term 6 FOLLOWER]: Rejecting Update request from peer 0473d2b2d01f4459b1e90fd12cc7840e for earlier term 5. Current term is 6. Ops: []
I20260709 13:05:16.498953 19558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa8650e71aa14778b3d73721fc50d9fc" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:05:16.503334 19559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40e1e16737a842ee936002830f36882e" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:05:16.503927 21935 raft_consensus.cc:515] T 65d8cb8d6ec64f459d5a47cefab10acf P e61c3a8f61bb48f8a963c9480e53c168 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:05:16.505298 19559 raft_consensus.cc:1240] T d1e5873a19244c5ebbcd38e126796ee7 P e61c3a8f61bb48f8a963c9480e53c168 [term 7 FOLLOWER]: Rejecting Update request from peer 0473d2b2d01f4459b1e90fd12cc7840e for earlier term 6. Current term is 7. Ops: []
I20260709 13:05:16.507625 19558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22196caba61445d3bec98a0aab3c337d" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:05:16.508328 21936 raft_consensus.cc:697] T edd7d470b5014c9489be7f41f64355c9 P e61c3a8f61bb48f8a963c9480e53c168 [term 5 LEADER]: Becoming Leader. State: Replica: e61c3a8f61bb48f8a963c9480e53c168, State: Running, Role: LEADER
I20260709 13:05:16.453913 21924 leader_election.cc:290] T df751f992649444090e27965eb1af85d P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 6 election: Requested vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:05:16.406392 21859 consensus_queue.cc:1048] T 62c6c134d3d24a1ab144dd9ee6bc3f64 P 127766fc592545a4997f7790f50f6076 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.028s
I20260709 13:05:16.510006 21933 raft_consensus.cc:2749] T 62c6c134d3d24a1ab144dd9ee6bc3f64 P 0473d2b2d01f4459b1e90fd12cc7840e [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:05:16.455472 19496 tablet_copy_source_session.cc:215] T 7be9efa6559648dbb5a0f7684c4542d1 P 0473d2b2d01f4459b1e90fd12cc7840e: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:05:16.432410 21837 raft_consensus.cc:697] T 1f85fc4b527a48848e5faa083b604e36 P 0473d2b2d01f4459b1e90fd12cc7840e [term 3 LEADER]: Becoming Leader. State: Replica: 0473d2b2d01f4459b1e90fd12cc7840e, State: Running, Role: LEADER
W20260709 13:05:16.510787 20076 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.3:36891, user_credentials={real_user=slave}} blocked reactor thread for 115033us
I20260709 13:05:16.511523 21933 consensus_queue.cc:1059] T b08304a0a02b42d7840c4e8ee9a6bd1a P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:05:16.511751 21837 consensus_queue.cc:237] T 1f85fc4b527a48848e5faa083b604e36 P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:05:16.512542 21933 raft_consensus.cc:3055] T b08304a0a02b42d7840c4e8ee9a6bd1a P 0473d2b2d01f4459b1e90fd12cc7840e [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:05:16.512912 21933 raft_consensus.cc:740] T b08304a0a02b42d7840c4e8ee9a6bd1a P 0473d2b2d01f4459b1e90fd12cc7840e [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 0473d2b2d01f4459b1e90fd12cc7840e, State: Running, Role: LEADER
I20260709 13:05:16.513778 21933 consensus_queue.cc:260] T b08304a0a02b42d7840c4e8ee9a6bd1a P 0473d2b2d01f4459b1e90fd12cc7840e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:16.455637 21849 leader_election.cc:290] T 22196caba61445d3bec98a0aab3c337d P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 5 election: Requested vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:05:16.433676 21957 leader_election.cc:290] T 5ec1c4ce15e04c7e8c283a62179f2a64 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 4 election: Requested vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:05:16.432179 21887 consensus_queue.cc:1059] T e381f1d6b8184797ad142de49be225a8 P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.026s
I20260709 13:05:16.458750 21959 raft_consensus.cc:515] T 3e1f505cb0f1427bbd698ac889d80821 P e5256d91808b47c195bc9b4dbd7f2b87 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:16.516057 19526 leader_election.cc:304] T a08760e15aac4630a629431f56024dc8 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e61c3a8f61bb48f8a963c9480e53c168; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:05:16.425530 21853 consensus_queue.cc:1059] T 179fd671030940b4b4a4e24bcc4aba0a P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.038s
I20260709 13:05:16.463969 19377 leader_election.cc:304] T 28af091831594f9d8e96482078cc7625 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:05:16.466704 19560 raft_consensus.cc:515] T a08760e15aac4630a629431f56024dc8 P e61c3a8f61bb48f8a963c9480e53c168 [term 6 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:16.517405 21959 leader_election.cc:290] T 3e1f505cb0f1427bbd698ac889d80821 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 5 election: Requested vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:05:16.517781 21853 raft_consensus.cc:3055] T e381f1d6b8184797ad142de49be225a8 P e61c3a8f61bb48f8a963c9480e53c168 [term 4 LEADER]: Stepping down as leader of term 4
W20260709 13:05:16.518067 19377 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.2:46257, user_credentials={real_user=slave}} blocked reactor thread for 54170.3us
I20260709 13:05:16.518203 21853 raft_consensus.cc:740] T e381f1d6b8184797ad142de49be225a8 P e61c3a8f61bb48f8a963c9480e53c168 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: e61c3a8f61bb48f8a963c9480e53c168, State: Running, Role: LEADER
I20260709 13:05:16.519199 19560 leader_election.cc:290] T a08760e15aac4630a629431f56024dc8 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 6 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:05:16.519001 21853 consensus_queue.cc:260] T e381f1d6b8184797ad142de49be225a8 P e61c3a8f61bb48f8a963c9480e53c168 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:16.519285 19377 leader_election.cc:304] T b9f0d59553ad444883fcf5b5909f9798 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:05:16.520100 21971 raft_consensus.cc:2749] T a08760e15aac4630a629431f56024dc8 P e61c3a8f61bb48f8a963c9480e53c168 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:05:16.467722 21929 consensus_queue.cc:237] T 2725d2c4cb054f18b0fc8f735c15f6c2 P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:16.520974 21971 raft_consensus.cc:3055] T 179fd671030940b4b4a4e24bcc4aba0a P e61c3a8f61bb48f8a963c9480e53c168 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:05:16.521126 21887 consensus_queue.cc:1059] T 179fd671030940b4b4a4e24bcc4aba0a P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:05:16.521566 21971 raft_consensus.cc:740] T 179fd671030940b4b4a4e24bcc4aba0a P e61c3a8f61bb48f8a963c9480e53c168 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: e61c3a8f61bb48f8a963c9480e53c168, State: Running, Role: LEADER
I20260709 13:05:16.469447 21916 consensus_queue.cc:1059] T 70797e5783b5454ab0d0eea663e791e3 P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:05:16.523626 19402 raft_consensus.cc:1240] T 3e1f505cb0f1427bbd698ac889d80821 P e5256d91808b47c195bc9b4dbd7f2b87 [term 5 FOLLOWER]: Rejecting Update request from peer e61c3a8f61bb48f8a963c9480e53c168 for earlier term 4. Current term is 5. Ops: []
I20260709 13:05:16.518081 21959 raft_consensus.cc:2749] T 28af091831594f9d8e96482078cc7625 P e5256d91808b47c195bc9b4dbd7f2b87 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:05:16.517390 19526 leader_election.cc:304] T b08304a0a02b42d7840c4e8ee9a6bd1a P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e61c3a8f61bb48f8a963c9480e53c168; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:05:16.525743 21994 raft_consensus.cc:2749] T b08304a0a02b42d7840c4e8ee9a6bd1a P e61c3a8f61bb48f8a963c9480e53c168 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:05:16.472574 19557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22196caba61445d3bec98a0aab3c337d" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:05:16.479714 21731 raft_consensus.cc:2749] T edd7d470b5014c9489be7f41f64355c9 P 0473d2b2d01f4459b1e90fd12cc7840e [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:05:16.479772 19552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df751f992649444090e27965eb1af85d" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:05:16.527712 21731 consensus_queue.cc:1059] T 7be9efa6559648dbb5a0f7684c4542d1 P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:05:16.454598 21952 raft_consensus.cc:515] T b9f0d59553ad444883fcf5b5909f9798 P e61c3a8f61bb48f8a963c9480e53c168 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:16.529958 21952 leader_election.cc:290] T b9f0d59553ad444883fcf5b5909f9798 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 6 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:05:16.520968 19377 leader_election.cc:400] T e381f1d6b8184797ad142de49be225a8 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 4 pre-election: Vote denied by peer 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257) with higher term. Message: Invalid argument: T e381f1d6b8184797ad142de49be225a8 P 0473d2b2d01f4459b1e90fd12cc7840e [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e5256d91808b47c195bc9b4dbd7f2b87 for earlier term 4. Current term is 5.
I20260709 13:05:16.530885 21790 raft_consensus.cc:3055] T 7be9efa6559648dbb5a0f7684c4542d1 P 0473d2b2d01f4459b1e90fd12cc7840e [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:05:16.531123 19377 leader_election.cc:403] T e381f1d6b8184797ad142de49be225a8 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 4 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:05:16.531332 21790 raft_consensus.cc:740] T 7be9efa6559648dbb5a0f7684c4542d1 P 0473d2b2d01f4459b1e90fd12cc7840e [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 0473d2b2d01f4459b1e90fd12cc7840e, State: Running, Role: LEADER
I20260709 13:05:16.531917 21958 raft_consensus.cc:2749] T e381f1d6b8184797ad142de49be225a8 P e5256d91808b47c195bc9b4dbd7f2b87 [term 5 FOLLOWER]: Leader pre-election lost for term 4. Reason: Vote denied by peer 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257) with higher term. Message: Invalid argument: T e381f1d6b8184797ad142de49be225a8 P 0473d2b2d01f4459b1e90fd12cc7840e [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e5256d91808b47c195bc9b4dbd7f2b87 for earlier term 4. Current term is 5.
I20260709 13:05:16.532229 21790 consensus_queue.cc:260] T 7be9efa6559648dbb5a0f7684c4542d1 P 0473d2b2d01f4459b1e90fd12cc7840e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } attrs { replace: true } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: NON_VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: true } }
I20260709 13:05:16.534876 19551 raft_consensus.cc:1240] T b9f0d59553ad444883fcf5b5909f9798 P e61c3a8f61bb48f8a963c9480e53c168 [term 6 FOLLOWER]: Rejecting Update request from peer 0473d2b2d01f4459b1e90fd12cc7840e for earlier term 5. Current term is 6. Ops: []
I20260709 13:05:16.533748 21790 raft_consensus.cc:3060] T 7be9efa6559648dbb5a0f7684c4542d1 P 0473d2b2d01f4459b1e90fd12cc7840e [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:05:16.536357 21979 raft_consensus.cc:3055] T 70797e5783b5454ab0d0eea663e791e3 P e5256d91808b47c195bc9b4dbd7f2b87 [term 6 LEADER]: Stepping down as leader of term 6
W20260709 13:05:16.536547 19524 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:16.536764 21979 raft_consensus.cc:740] T 70797e5783b5454ab0d0eea663e791e3 P e5256d91808b47c195bc9b4dbd7f2b87 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: e5256d91808b47c195bc9b4dbd7f2b87, State: Running, Role: LEADER
I20260709 13:05:16.522485 21971 consensus_queue.cc:260] T 179fd671030940b4b4a4e24bcc4aba0a P e61c3a8f61bb48f8a963c9480e53c168 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
W20260709 13:05:16.471709 19449 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.1:40321, user_credentials={real_user=slave}} blocked reactor thread for 52016.8us
I20260709 13:05:16.480857 21965 raft_consensus.cc:697] T 9962423cb4e54fcfa5de01daf68a86e7 P 0473d2b2d01f4459b1e90fd12cc7840e [term 9 LEADER]: Becoming Leader. State: Replica: 0473d2b2d01f4459b1e90fd12cc7840e, State: Running, Role: LEADER
I20260709 13:05:16.437101 21861 raft_consensus.cc:493] T ab43d85f64114d4ebf618930e43d9ed0 P 0473d2b2d01f4459b1e90fd12cc7840e [term 5 FOLLOWER]: Starting pre-election (detected failure of leader e61c3a8f61bb48f8a963c9480e53c168)
I20260709 13:05:16.541258 21861 raft_consensus.cc:515] T ab43d85f64114d4ebf618930e43d9ed0 P 0473d2b2d01f4459b1e90fd12cc7840e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } attrs { replace: true } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:05:16.541524 21965 consensus_queue.cc:237] T 9962423cb4e54fcfa5de01daf68a86e7 P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 7, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:05:16.544039 21861 leader_election.cc:290] T ab43d85f64114d4ebf618930e43d9ed0 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:05:16.520740 21957 raft_consensus.cc:2749] T b9f0d59553ad444883fcf5b5909f9798 P e5256d91808b47c195bc9b4dbd7f2b87 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 13:05:16.525377 21825 consensus_queue.cc:1175] T e381f1d6b8184797ad142de49be225a8 P e61c3a8f61bb48f8a963c9480e53c168 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" responder_term: 5 status { last_received { term: 3 index: 3 } last_committed_idx: 3 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer e61c3a8f61bb48f8a963c9480e53c168 for earlier term 4. Current term is 5. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 13:05:16.547138 21956 consensus_queue.cc:1059] T d1e5873a19244c5ebbcd38e126796ee7 P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:05:16.548405 21956 consensus_queue.cc:1059] T b9f0d59553ad444883fcf5b5909f9798 P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:05:16.549681 21969 raft_consensus.cc:3055] T d1e5873a19244c5ebbcd38e126796ee7 P 0473d2b2d01f4459b1e90fd12cc7840e [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:05:16.549787 21861 raft_consensus.cc:3055] T b9f0d59553ad444883fcf5b5909f9798 P 0473d2b2d01f4459b1e90fd12cc7840e [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:05:16.550185 21969 raft_consensus.cc:740] T d1e5873a19244c5ebbcd38e126796ee7 P 0473d2b2d01f4459b1e90fd12cc7840e [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 0473d2b2d01f4459b1e90fd12cc7840e, State: Running, Role: LEADER
I20260709 13:05:16.550428 21861 raft_consensus.cc:740] T b9f0d59553ad444883fcf5b5909f9798 P 0473d2b2d01f4459b1e90fd12cc7840e [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 0473d2b2d01f4459b1e90fd12cc7840e, State: Running, Role: LEADER
I20260709 13:05:16.551340 21969 consensus_queue.cc:260] T d1e5873a19244c5ebbcd38e126796ee7 P 0473d2b2d01f4459b1e90fd12cc7840e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:16.551842 21861 consensus_queue.cc:260] T b9f0d59553ad444883fcf5b5909f9798 P 0473d2b2d01f4459b1e90fd12cc7840e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:16.556042 21977 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7be9efa6559648dbb5a0f7684c4542d1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:16.562211 19485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86a6797bdfe94fa496c050ceae4bd0d9" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:05:16.562392 19479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7be9efa6559648dbb5a0f7684c4542d1" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:05:16.563674 19477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21e14947d70440f19044d8f75c31e1f9" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:05:16.575160 21933 raft_consensus.cc:3060] T b08304a0a02b42d7840c4e8ee9a6bd1a P 0473d2b2d01f4459b1e90fd12cc7840e [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:05:16.539693 19449 leader_election.cc:304] T 76cb037fc9064d13b59a8969d897ce8c P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e; no voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:05:16.582036 19449 leader_election.cc:304] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e; no voters: 127766fc592545a4997f7790f50f6076, e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:05:16.538221 21971 raft_consensus.cc:3060] T 179fd671030940b4b4a4e24bcc4aba0a P e61c3a8f61bb48f8a963c9480e53c168 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:05:16.520154 21853 raft_consensus.cc:3060] T e381f1d6b8184797ad142de49be225a8 P e61c3a8f61bb48f8a963c9480e53c168 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:05:16.552956 21969 raft_consensus.cc:3060] T d1e5873a19244c5ebbcd38e126796ee7 P 0473d2b2d01f4459b1e90fd12cc7840e [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:05:16.583081 19477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edd7d470b5014c9489be7f41f64355c9" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:05:16.607767 19560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e1f505cb0f1427bbd698ac889d80821" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
W20260709 13:05:16.584400 19523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.1:40321, user_credentials={real_user=slave}} blocked reactor thread for 157344us
I20260709 13:05:16.584834 19478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef32ce6fdd0e40d382c79974f30295c6" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:05:16.436178 21976 raft_consensus.cc:2749] T 70797e5783b5454ab0d0eea663e791e3 P e61c3a8f61bb48f8a963c9480e53c168 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:05:16.588811 19482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f93ee515a9c14139bf566522ed8232f3" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 8 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:05:16.588953 19552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab43d85f64114d4ebf618930e43d9ed0" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:05:16.589161 19485 raft_consensus.cc:1275] T 172b3dd13109415a955b71ac0e9d2234 P 0473d2b2d01f4459b1e90fd12cc7840e [term 3 FOLLOWER]: Refusing update from remote peer e5256d91808b47c195bc9b4dbd7f2b87: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:05:16.624373 19480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e36a9d6e29c4a7c860cf267efbd4c74" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:05:16.589357 19484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cdf56e38bbc453d9438d359e5a69955" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:05:16.626130 19484 raft_consensus.cc:2393] T 0cdf56e38bbc453d9438d359e5a69955 P 0473d2b2d01f4459b1e90fd12cc7840e [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate e5256d91808b47c195bc9b4dbd7f2b87 in current term 7: Already voted for candidate e61c3a8f61bb48f8a963c9480e53c168 in this term.
I20260709 13:05:16.589476 21731 raft_consensus.cc:2749] T 76cb037fc9064d13b59a8969d897ce8c P 0473d2b2d01f4459b1e90fd12cc7840e [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:05:16.628155 19477 raft_consensus.cc:2368] T edd7d470b5014c9489be7f41f64355c9 P 0473d2b2d01f4459b1e90fd12cc7840e [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate e5256d91808b47c195bc9b4dbd7f2b87 for earlier term 4. Current term is 5.
I20260709 13:05:16.589681 19481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46c5bfeecc314717bffe987e6844b6d0" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 10 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:05:16.628975 19481 raft_consensus.cc:2393] T 46c5bfeecc314717bffe987e6844b6d0 P 0473d2b2d01f4459b1e90fd12cc7840e [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate e5256d91808b47c195bc9b4dbd7f2b87 in current term 10: Already voted for candidate 0473d2b2d01f4459b1e90fd12cc7840e in this term.
I20260709 13:05:16.590289 19483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc225c93219c45538b53a1bd3d387e4d" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:05:16.257752 18300 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:05:16.593281 19449 leader_election.cc:304] T e381f1d6b8184797ad142de49be225a8 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87; no voters: e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:05:16.537563 21979 consensus_queue.cc:260] T 70797e5783b5454ab0d0eea663e791e3 P e5256d91808b47c195bc9b4dbd7f2b87 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.6, Last appended by leader: 6, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:05:16.593994 21968 raft_consensus.cc:2749] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P 0473d2b2d01f4459b1e90fd12cc7840e [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:05:16.604264 21935 leader_election.cc:290] T 65d8cb8d6ec64f459d5a47cefab10acf P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 3 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:05:16.590930 21861 raft_consensus.cc:3060] T b9f0d59553ad444883fcf5b5909f9798 P 0473d2b2d01f4459b1e90fd12cc7840e [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:05:16.610769 19408 raft_consensus.cc:1240] T df751f992649444090e27965eb1af85d P e5256d91808b47c195bc9b4dbd7f2b87 [term 6 FOLLOWER]: Rejecting Update request from peer e61c3a8f61bb48f8a963c9480e53c168 for earlier term 5. Current term is 6. Ops: []
I20260709 13:05:16.622195 19377 leader_election.cc:304] T 86a6797bdfe94fa496c050ceae4bd0d9 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:05:16.638975 19485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ec1c4ce15e04c7e8c283a62179f2a64" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:05:16.639340 19408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9f0d59553ad444883fcf5b5909f9798" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
I20260709 13:05:16.633119 19478 raft_consensus.cc:1275] T 2b74109013a140ada21feeef92d6f563 P 0473d2b2d01f4459b1e90fd12cc7840e [term 3 FOLLOWER]: Refusing update from remote peer e5256d91808b47c195bc9b4dbd7f2b87: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:05:16.633369 19449 leader_election.cc:304] T 46c5bfeecc314717bffe987e6844b6d0 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e; no voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:05:16.611461 19409 raft_consensus.cc:1240] T ef32ce6fdd0e40d382c79974f30295c6 P e5256d91808b47c195bc9b4dbd7f2b87 [term 6 FOLLOWER]: Rejecting Update request from peer e61c3a8f61bb48f8a963c9480e53c168 for earlier term 5. Current term is 6. Ops: []
I20260709 13:05:16.634352 19411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a08760e15aac4630a629431f56024dc8" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: true dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
I20260709 13:05:16.641613 19411 raft_consensus.cc:3055] T a08760e15aac4630a629431f56024dc8 P e5256d91808b47c195bc9b4dbd7f2b87 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:05:16.641901 19411 raft_consensus.cc:740] T a08760e15aac4630a629431f56024dc8 P e5256d91808b47c195bc9b4dbd7f2b87 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: e5256d91808b47c195bc9b4dbd7f2b87, State: Running, Role: LEADER
I20260709 13:05:16.635057 19406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a16f7501e2444fb86d4e2778e734e02" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:05:16.640669 19408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65d8cb8d6ec64f459d5a47cefab10acf" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
I20260709 13:05:16.642925 19408 raft_consensus.cc:3060] T 65d8cb8d6ec64f459d5a47cefab10acf P e5256d91808b47c195bc9b4dbd7f2b87 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:05:16.644318 19452 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:16.644215 19480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22196caba61445d3bec98a0aab3c337d" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:05:16.644850 19484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e1f505cb0f1427bbd698ac889d80821" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:05:16.644378 19481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df751f992649444090e27965eb1af85d" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:05:16.642978 19406 raft_consensus.cc:2393] T 2a16f7501e2444fb86d4e2778e734e02 P e5256d91808b47c195bc9b4dbd7f2b87 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e61c3a8f61bb48f8a963c9480e53c168 in current term 6: Already voted for candidate e5256d91808b47c195bc9b4dbd7f2b87 in this term.
I20260709 13:05:16.657538 19480 raft_consensus.cc:2393] T 22196caba61445d3bec98a0aab3c337d P 0473d2b2d01f4459b1e90fd12cc7840e [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate e5256d91808b47c195bc9b4dbd7f2b87 in current term 5: Already voted for candidate 0473d2b2d01f4459b1e90fd12cc7840e in this term.
I20260709 13:05:16.644022 21700 raft_consensus.cc:2804] T e381f1d6b8184797ad142de49be225a8 P 0473d2b2d01f4459b1e90fd12cc7840e [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:05:16.659760 21700 raft_consensus.cc:697] T e381f1d6b8184797ad142de49be225a8 P 0473d2b2d01f4459b1e90fd12cc7840e [term 5 LEADER]: Becoming Leader. State: Replica: 0473d2b2d01f4459b1e90fd12cc7840e, State: Running, Role: LEADER
I20260709 13:05:16.658179 19449 leader_election.cc:400] T 0cdf56e38bbc453d9438d359e5a69955 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 6 election: Vote denied by peer e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321) with higher term. Message: Invalid argument: T 0cdf56e38bbc453d9438d359e5a69955 P e5256d91808b47c195bc9b4dbd7f2b87 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 0473d2b2d01f4459b1e90fd12cc7840e for earlier term 6. Current term is 7.
I20260709 13:05:16.661468 19523 leader_election.cc:304] T bc225c93219c45538b53a1bd3d387e4d P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e61c3a8f61bb48f8a963c9480e53c168; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:05:16.662274 19377 leader_election.cc:304] T 21e14947d70440f19044d8f75c31e1f9 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:05:16.662982 19411 consensus_queue.cc:260] T a08760e15aac4630a629431f56024dc8 P e5256d91808b47c195bc9b4dbd7f2b87 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:16.664112 19482 raft_consensus.cc:1275] T 76cb037fc9064d13b59a8969d897ce8c P 0473d2b2d01f4459b1e90fd12cc7840e [term 7 FOLLOWER]: Refusing update from remote peer e5256d91808b47c195bc9b4dbd7f2b87: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:05:16.509351 21936 consensus_queue.cc:237] T edd7d470b5014c9489be7f41f64355c9 P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:16.665485 19377 leader_election.cc:304] T ef32ce6fdd0e40d382c79974f30295c6 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:05:16.632850 21932 raft_consensus.cc:493] T 7f575b143b844aa096b50997dad3516a P 0473d2b2d01f4459b1e90fd12cc7840e [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e5256d91808b47c195bc9b4dbd7f2b87)
I20260709 13:05:16.670147 19377 leader_election.cc:304] T 2e36a9d6e29c4a7c860cf267efbd4c74 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:05:16.658077 21966 raft_consensus.cc:3060] T 14efcc79969f41babe5529c22d59156d P e5256d91808b47c195bc9b4dbd7f2b87 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:05:16.672713 19449 leader_election.cc:304] T 775c229504194560ba9589bc2199b089 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e; no voters: 127766fc592545a4997f7790f50f6076, e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:05:16.657240 21979 raft_consensus.cc:3060] T 70797e5783b5454ab0d0eea663e791e3 P e5256d91808b47c195bc9b4dbd7f2b87 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:05:16.660898 21858 raft_consensus.cc:2749] T 46c5bfeecc314717bffe987e6844b6d0 P 0473d2b2d01f4459b1e90fd12cc7840e [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:05:16.665601 21958 raft_consensus.cc:2749] T 86a6797bdfe94fa496c050ceae4bd0d9 P e5256d91808b47c195bc9b4dbd7f2b87 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:05:16.680665 19377 leader_election.cc:304] T 46c5bfeecc314717bffe987e6844b6d0 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:05:16.688555 21916 consensus_queue.cc:1048] T 172b3dd13109415a955b71ac0e9d2234 P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:05:16.689185 21849 raft_consensus.cc:2749] T 2e36a9d6e29c4a7c860cf267efbd4c74 P e5256d91808b47c195bc9b4dbd7f2b87 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:05:16.705466 19377 leader_election.cc:304] T 0cdf56e38bbc453d9438d359e5a69955 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:05:16.674126 19449 leader_election.cc:304] T 179fd671030940b4b4a4e24bcc4aba0a P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87; no voters: e61c3a8f61bb48f8a963c9480e53c168
W20260709 13:05:16.706912 19376 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:16.661010 21931 consensus_queue.cc:1059] T f93ee515a9c14139bf566522ed8232f3 P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 }, Status: INVALID_TERM, Last received: 7.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.029s
I20260709 13:05:16.707859 19449 leader_election.cc:304] T fa8650e71aa14778b3d73721fc50d9fc P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e; no voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:05:16.707996 21931 raft_consensus.cc:3055] T f93ee515a9c14139bf566522ed8232f3 P e61c3a8f61bb48f8a963c9480e53c168 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:05:16.708446 21931 raft_consensus.cc:740] T f93ee515a9c14139bf566522ed8232f3 P e61c3a8f61bb48f8a963c9480e53c168 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: e61c3a8f61bb48f8a963c9480e53c168, State: Running, Role: LEADER
I20260709 13:05:16.709353 21965 raft_consensus.cc:2804] T 179fd671030940b4b4a4e24bcc4aba0a P 0473d2b2d01f4459b1e90fd12cc7840e [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:05:16.709218 21931 consensus_queue.cc:260] T f93ee515a9c14139bf566522ed8232f3 P e61c3a8f61bb48f8a963c9480e53c168 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 7.3, Last appended by leader: 3, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:16.693811 19483 raft_consensus.cc:2468] T bc225c93219c45538b53a1bd3d387e4d P 0473d2b2d01f4459b1e90fd12cc7840e [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 8.
I20260709 13:05:16.672281 21932 raft_consensus.cc:515] T 7f575b143b844aa096b50997dad3516a P 0473d2b2d01f4459b1e90fd12cc7840e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:16.667399 21959 raft_consensus.cc:2749] T 21e14947d70440f19044d8f75c31e1f9 P e5256d91808b47c195bc9b4dbd7f2b87 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:05:16.698755 20105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65d8cb8d6ec64f459d5a47cefab10acf" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076"
I20260709 13:05:16.716260 19449 leader_election.cc:304] T 40e1e16737a842ee936002830f36882e P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e; no voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:05:16.716682 20105 raft_consensus.cc:3060] T 65d8cb8d6ec64f459d5a47cefab10acf P 127766fc592545a4997f7790f50f6076 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:16.700984 19408 raft_consensus.cc:2468] T 65d8cb8d6ec64f459d5a47cefab10acf P e5256d91808b47c195bc9b4dbd7f2b87 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 3.
I20260709 13:05:16.690397 21700 consensus_queue.cc:237] T e381f1d6b8184797ad142de49be225a8 P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:16.673993 21929 raft_consensus.cc:2749] T ef32ce6fdd0e40d382c79974f30295c6 P e5256d91808b47c195bc9b4dbd7f2b87 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:05:16.676738 21935 raft_consensus.cc:2749] T bc225c93219c45538b53a1bd3d387e4d P e61c3a8f61bb48f8a963c9480e53c168 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:05:16.715054 19377 leader_election.cc:400] T edd7d470b5014c9489be7f41f64355c9 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 4 election: Vote denied by peer 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257) with higher term. Message: Invalid argument: T edd7d470b5014c9489be7f41f64355c9 P 0473d2b2d01f4459b1e90fd12cc7840e [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate e5256d91808b47c195bc9b4dbd7f2b87 for earlier term 4. Current term is 5.
I20260709 13:05:16.694418 21837 raft_consensus.cc:2749] T 775c229504194560ba9589bc2199b089 P 0473d2b2d01f4459b1e90fd12cc7840e [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:05:16.723574 21837 consensus_queue.cc:1059] T 21e14947d70440f19044d8f75c31e1f9 P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:05:16.725536 21837 raft_consensus.cc:3060] T 40e1e16737a842ee936002830f36882e P 0473d2b2d01f4459b1e90fd12cc7840e [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:05:16.725835 19526 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:16.725986 19377 leader_election.cc:304] T f93ee515a9c14139bf566522ed8232f3 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:05:16.726094 19523 leader_election.cc:304] T 65d8cb8d6ec64f459d5a47cefab10acf P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:05:16.731818 19377 leader_election.cc:304] T 5ec1c4ce15e04c7e8c283a62179f2a64 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, 127766fc592545a4997f7790f50f6076
I20260709 13:05:16.710645 21924 raft_consensus.cc:2749] T 46c5bfeecc314717bffe987e6844b6d0 P e5256d91808b47c195bc9b4dbd7f2b87 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:05:16.740602 19377 leader_election.cc:304] T 22196caba61445d3bec98a0aab3c337d P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:05:16.740717 20105 raft_consensus.cc:2468] T 65d8cb8d6ec64f459d5a47cefab10acf P 127766fc592545a4997f7790f50f6076 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 3.
W20260709 13:05:16.764904 19450 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:16.717192 21731 consensus_queue.cc:1059] T f1b10566f45d4a7d9029858330e02d5b P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 }, Status: INVALID_TERM, Last received: 6.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.075s
I20260709 13:05:16.702796 21934 consensus_queue.cc:1059] T df751f992649444090e27965eb1af85d P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.037s
W20260709 13:05:16.793495 20078 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.2:46257, user_credentials={real_user=slave}} blocked reactor thread for 53819.7us
I20260709 13:05:16.728199 21962 raft_consensus.cc:493] T 1f85fc4b527a48848e5faa083b604e36 P e5256d91808b47c195bc9b4dbd7f2b87 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:16.718005 21918 raft_consensus.cc:2749] T 0cdf56e38bbc453d9438d359e5a69955 P e5256d91808b47c195bc9b4dbd7f2b87 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
W20260709 13:05:16.814189 19523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.4:43121, user_credentials={real_user=slave}} blocked reactor thread for 51164.7us
I20260709 13:05:16.739593 21994 raft_consensus.cc:2804] T 65d8cb8d6ec64f459d5a47cefab10acf P e61c3a8f61bb48f8a963c9480e53c168 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:05:16.738905 21957 raft_consensus.cc:2749] T f93ee515a9c14139bf566522ed8232f3 P e5256d91808b47c195bc9b4dbd7f2b87 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
W20260709 13:05:16.820086 19377 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.2:46257, user_credentials={real_user=slave}} blocked reactor thread for 79525us
I20260709 13:05:16.793566 20103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a16f7501e2444fb86d4e2778e734e02" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:05:16.835543 19377 leader_election.cc:304] T df751f992649444090e27965eb1af85d P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:05:16.836452 21979 raft_consensus.cc:2749] T df751f992649444090e27965eb1af85d P e5256d91808b47c195bc9b4dbd7f2b87 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:05:16.815853 21969 raft_consensus.cc:3055] T 21e14947d70440f19044d8f75c31e1f9 P 0473d2b2d01f4459b1e90fd12cc7840e [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:05:16.837132 21969 raft_consensus.cc:740] T 21e14947d70440f19044d8f75c31e1f9 P 0473d2b2d01f4459b1e90fd12cc7840e [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 0473d2b2d01f4459b1e90fd12cc7840e, State: Running, Role: LEADER
I20260709 13:05:16.837536 19377 leader_election.cc:304] T bc225c93219c45538b53a1bd3d387e4d P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87; no voters: e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:05:16.819416 21992 consensus_queue.cc:1059] T ef32ce6fdd0e40d382c79974f30295c6 P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.137s
I20260709 13:05:16.838464 21958 raft_consensus.cc:2804] T bc225c93219c45538b53a1bd3d387e4d P e5256d91808b47c195bc9b4dbd7f2b87 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:05:16.839794 21958 raft_consensus.cc:697] T bc225c93219c45538b53a1bd3d387e4d P e5256d91808b47c195bc9b4dbd7f2b87 [term 8 LEADER]: Becoming Leader. State: Replica: e5256d91808b47c195bc9b4dbd7f2b87, State: Running, Role: LEADER
I20260709 13:05:16.840818 19404 raft_consensus.cc:1275] T 40e1e16737a842ee936002830f36882e P e5256d91808b47c195bc9b4dbd7f2b87 [term 7 FOLLOWER]: Refusing update from remote peer e61c3a8f61bb48f8a963c9480e53c168: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:05:16.842550 21992 consensus_queue.cc:1048] T 40e1e16737a842ee936002830f36882e P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
W20260709 13:05:16.823493 19449 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.1:40321, user_credentials={real_user=slave}} blocked reactor thread for 107321us
I20260709 13:05:16.826819 21981 raft_consensus.cc:493] T 2a16f7501e2444fb86d4e2778e734e02 P 127766fc592545a4997f7790f50f6076 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:16.826838 21924 raft_consensus.cc:2749] T 22196caba61445d3bec98a0aab3c337d P e5256d91808b47c195bc9b4dbd7f2b87 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:05:16.827152 21986 consensus_queue.cc:1059] T 5ec1c4ce15e04c7e8c283a62179f2a64 P 127766fc592545a4997f7790f50f6076 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.100s
I20260709 13:05:16.729287 21858 raft_consensus.cc:2749] T fa8650e71aa14778b3d73721fc50d9fc P 0473d2b2d01f4459b1e90fd12cc7840e [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:05:16.845988 21981 raft_consensus.cc:515] T 2a16f7501e2444fb86d4e2778e734e02 P 127766fc592545a4997f7790f50f6076 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:05:16.846966 21986 raft_consensus.cc:3055] T 5ec1c4ce15e04c7e8c283a62179f2a64 P 127766fc592545a4997f7790f50f6076 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:05:16.847415 21986 raft_consensus.cc:740] T 5ec1c4ce15e04c7e8c283a62179f2a64 P 127766fc592545a4997f7790f50f6076 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 127766fc592545a4997f7790f50f6076, State: Running, Role: LEADER
I20260709 13:05:16.850140 20105 raft_consensus.cc:1240] T 48824d5acfbc485ebf8c2d944e7202de P 127766fc592545a4997f7790f50f6076 [term 5 FOLLOWER]: Rejecting Update request from peer 0473d2b2d01f4459b1e90fd12cc7840e for earlier term 4. Current term is 5. Ops: []
I20260709 13:05:16.851585 20107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab43d85f64114d4ebf618930e43d9ed0" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:05:16.861593 19558 raft_consensus.cc:2468] T 22196caba61445d3bec98a0aab3c337d P e61c3a8f61bb48f8a963c9480e53c168 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 5.
I20260709 13:05:16.813772 21931 raft_consensus.cc:3060] T f93ee515a9c14139bf566522ed8232f3 P e61c3a8f61bb48f8a963c9480e53c168 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:05:16.793231 19374 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.4:43121, user_credentials={real_user=slave}} blocked reactor thread for 53079.1us
W20260709 13:05:16.865705 19449 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:16.793612 21926 raft_consensus.cc:2749] T 5ec1c4ce15e04c7e8c283a62179f2a64 P e5256d91808b47c195bc9b4dbd7f2b87 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:05:16.793385 21917 consensus_queue.cc:1048] T 2b74109013a140ada21feeef92d6f563 P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.063s
I20260709 13:05:16.865829 19552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a16f7501e2444fb86d4e2778e734e02" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:05:16.841374 21958 consensus_queue.cc:237] T bc225c93219c45538b53a1bd3d387e4d P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:16.871300 19552 raft_consensus.cc:2468] T 2a16f7501e2444fb86d4e2778e734e02 P e61c3a8f61bb48f8a963c9480e53c168 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 127766fc592545a4997f7790f50f6076 in term 5.
I20260709 13:05:16.875104 21731 raft_consensus.cc:493] T 96efeaaf1057492490e9a621f37e1a2d P 0473d2b2d01f4459b1e90fd12cc7840e [term 4 FOLLOWER]: Starting pre-election (detected failure of leader e61c3a8f61bb48f8a963c9480e53c168)
I20260709 13:05:16.875692 21731 raft_consensus.cc:515] T 96efeaaf1057492490e9a621f37e1a2d P 0473d2b2d01f4459b1e90fd12cc7840e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:05:16.878434 19560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96efeaaf1057492490e9a621f37e1a2d" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:05:16.879072 19560 raft_consensus.cc:2468] T 96efeaaf1057492490e9a621f37e1a2d P e61c3a8f61bb48f8a963c9480e53c168 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 5.
I20260709 13:05:16.879520 21932 leader_election.cc:290] T 7f575b143b844aa096b50997dad3516a P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:05:16.880275 21731 leader_election.cc:290] T 96efeaaf1057492490e9a621f37e1a2d P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:05:16.882584 19560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f575b143b844aa096b50997dad3516a" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:05:16.854979 21981 leader_election.cc:290] T 2a16f7501e2444fb86d4e2778e734e02 P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:05:16.885304 21981 raft_consensus.cc:493] T 833a2f0775ed407a94b8924ce50adb63 P 127766fc592545a4997f7790f50f6076 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader e5256d91808b47c195bc9b4dbd7f2b87)
I20260709 13:05:16.885746 21981 raft_consensus.cc:515] T 833a2f0775ed407a94b8924ce50adb63 P 127766fc592545a4997f7790f50f6076 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:05:16.820570 21962 raft_consensus.cc:515] T 1f85fc4b527a48848e5faa083b604e36 P e5256d91808b47c195bc9b4dbd7f2b87 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:05:16.887723 21981 leader_election.cc:290] T 833a2f0775ed407a94b8924ce50adb63 P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:05:16.888325 21962 leader_election.cc:290] T 1f85fc4b527a48848e5faa083b604e36 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:05:16.888984 21986 consensus_queue.cc:260] T 5ec1c4ce15e04c7e8c283a62179f2a64 P 127766fc592545a4997f7790f50f6076 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:05:16.889760 20076 leader_election.cc:304] T 2a16f7501e2444fb86d4e2778e734e02 P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 127766fc592545a4997f7790f50f6076, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:05:16.890240 21986 raft_consensus.cc:3060] T 5ec1c4ce15e04c7e8c283a62179f2a64 P 127766fc592545a4997f7790f50f6076 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:05:16.890805 19552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "833a2f0775ed407a94b8924ce50adb63" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:05:16.891536 19552 raft_consensus.cc:2393] T 833a2f0775ed407a94b8924ce50adb63 P e61c3a8f61bb48f8a963c9480e53c168 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 127766fc592545a4997f7790f50f6076 in current term 4: Already voted for candidate e61c3a8f61bb48f8a963c9480e53c168 in this term.
I20260709 13:05:16.894959 21837 raft_consensus.cc:2749] T 40e1e16737a842ee936002830f36882e P 0473d2b2d01f4459b1e90fd12cc7840e [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:05:16.896284 20105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f85fc4b527a48848e5faa083b604e36" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:05:16.896847 20105 raft_consensus.cc:2468] T 1f85fc4b527a48848e5faa083b604e36 P 127766fc592545a4997f7790f50f6076 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 3.
I20260709 13:05:16.898389 19374 leader_election.cc:304] T 1f85fc4b527a48848e5faa083b604e36 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 127766fc592545a4997f7790f50f6076, e5256d91808b47c195bc9b4dbd7f2b87; no voters: 
I20260709 13:05:16.899547 21929 raft_consensus.cc:2804] T 1f85fc4b527a48848e5faa083b604e36 P e5256d91808b47c195bc9b4dbd7f2b87 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:05:16.899896 21929 raft_consensus.cc:493] T 1f85fc4b527a48848e5faa083b604e36 P e5256d91808b47c195bc9b4dbd7f2b87 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:16.900333 21929 raft_consensus.cc:3060] T 1f85fc4b527a48848e5faa083b604e36 P e5256d91808b47c195bc9b4dbd7f2b87 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:05:16.900625 19486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f85fc4b527a48848e5faa083b604e36" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
W20260709 13:05:16.901662 19357 auto_rebalancer.cc:629] Failed to schedule move for tablet 4509b76741dc428e9201c70c1658da13: Illegal state: Replica e5256d91808b47c195bc9b4dbd7f2b87 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 2 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } }
W20260709 13:05:16.901919 21983 log.cc:927] Time spent T 0cdf56e38bbc453d9438d359e5a69955 P e61c3a8f61bb48f8a963c9480e53c168: Append to log took a long time: real 0.462s	user 0.005s	sys 0.000s
I20260709 13:05:16.907014 21858 raft_consensus.cc:493] T 2725d2c4cb054f18b0fc8f735c15f6c2 P 0473d2b2d01f4459b1e90fd12cc7840e [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:16.907446 21858 raft_consensus.cc:515] T 2725d2c4cb054f18b0fc8f735c15f6c2 P 0473d2b2d01f4459b1e90fd12cc7840e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:16.908910 19410 raft_consensus.cc:1275] T 85c494af21f9457a85da47b9bc70c1fd P e5256d91808b47c195bc9b4dbd7f2b87 [term 3 FOLLOWER]: Refusing update from remote peer e61c3a8f61bb48f8a963c9480e53c168: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:05:16.909498 21858 leader_election.cc:290] T 2725d2c4cb054f18b0fc8f735c15f6c2 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:05:16.863051 20103 raft_consensus.cc:2468] T 2a16f7501e2444fb86d4e2778e734e02 P 127766fc592545a4997f7790f50f6076 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 6.
I20260709 13:05:16.912474 21981 raft_consensus.cc:2804] T 2a16f7501e2444fb86d4e2778e734e02 P 127766fc592545a4997f7790f50f6076 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:05:16.912200 19552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2725d2c4cb054f18b0fc8f735c15f6c2" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:05:16.916651 19484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a08760e15aac4630a629431f56024dc8" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: true dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:05:16.917219 19484 raft_consensus.cc:3060] T a08760e15aac4630a629431f56024dc8 P 0473d2b2d01f4459b1e90fd12cc7840e [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:05:16.918299 20105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96efeaaf1057492490e9a621f37e1a2d" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:05:16.918620 19449 leader_election.cc:304] T ab43d85f64114d4ebf618930e43d9ed0 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e; no voters: 127766fc592545a4997f7790f50f6076, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:05:16.919325 20105 raft_consensus.cc:2393] T 96efeaaf1057492490e9a621f37e1a2d P 127766fc592545a4997f7790f50f6076 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0473d2b2d01f4459b1e90fd12cc7840e in current term 5: Already voted for candidate 127766fc592545a4997f7790f50f6076 in this term.
I20260709 13:05:16.915983 19552 raft_consensus.cc:2468] T 2725d2c4cb054f18b0fc8f735c15f6c2 P e61c3a8f61bb48f8a963c9480e53c168 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 6.
I20260709 13:05:16.922513 19486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9f0d59553ad444883fcf5b5909f9798" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
W20260709 13:05:16.924309 20075 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.1:40321, user_credentials={real_user=slave}} blocked reactor thread for 194214us
I20260709 13:05:16.871874 21994 raft_consensus.cc:697] T 65d8cb8d6ec64f459d5a47cefab10acf P e61c3a8f61bb48f8a963c9480e53c168 [term 3 LEADER]: Becoming Leader. State: Replica: e61c3a8f61bb48f8a963c9480e53c168, State: Running, Role: LEADER
I20260709 13:05:16.923677 21965 raft_consensus.cc:697] T 179fd671030940b4b4a4e24bcc4aba0a P 0473d2b2d01f4459b1e90fd12cc7840e [term 5 LEADER]: Becoming Leader. State: Replica: 0473d2b2d01f4459b1e90fd12cc7840e, State: Running, Role: LEADER
W20260709 13:05:16.937037 21990 log.cc:927] Time spent T 172b3dd13109415a955b71ac0e9d2234 P 127766fc592545a4997f7790f50f6076: Append to log took a long time: real 0.497s	user 0.008s	sys 0.000s
I20260709 13:05:16.941519 19486 raft_consensus.cc:2468] T b9f0d59553ad444883fcf5b5909f9798 P 0473d2b2d01f4459b1e90fd12cc7840e [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 6.
I20260709 13:05:16.920445 21935 consensus_queue.cc:1048] T 85c494af21f9457a85da47b9bc70c1fd P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.023s
I20260709 13:05:16.943315 21861 raft_consensus.cc:3055] T f1b10566f45d4a7d9029858330e02d5b P 0473d2b2d01f4459b1e90fd12cc7840e [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:05:16.944356 19479 raft_consensus.cc:2410] T 7be9efa6559648dbb5a0f7684c4542d1 P 0473d2b2d01f4459b1e90fd12cc7840e [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate e5256d91808b47c195bc9b4dbd7f2b87 for term 6 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 3.
I20260709 13:05:16.951458 19403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a16f7501e2444fb86d4e2778e734e02" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:05:16.952378 19403 raft_consensus.cc:2468] T 2a16f7501e2444fb86d4e2778e734e02 P e5256d91808b47c195bc9b4dbd7f2b87 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 127766fc592545a4997f7790f50f6076 in term 6.
I20260709 13:05:16.924796 21932 raft_consensus.cc:2749] T ab43d85f64114d4ebf618930e43d9ed0 P 0473d2b2d01f4459b1e90fd12cc7840e [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:05:16.955336 19484 raft_consensus.cc:2468] T a08760e15aac4630a629431f56024dc8 P 0473d2b2d01f4459b1e90fd12cc7840e [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 6.
I20260709 13:05:16.956378 21965 consensus_queue.cc:237] T 179fd671030940b4b4a4e24bcc4aba0a P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:16.958997 19407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "833a2f0775ed407a94b8924ce50adb63" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:05:16.959604 19407 raft_consensus.cc:2468] T 833a2f0775ed407a94b8924ce50adb63 P e5256d91808b47c195bc9b4dbd7f2b87 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 127766fc592545a4997f7790f50f6076 in term 4.
I20260709 13:05:16.943706 21861 raft_consensus.cc:740] T f1b10566f45d4a7d9029858330e02d5b P 0473d2b2d01f4459b1e90fd12cc7840e [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 0473d2b2d01f4459b1e90fd12cc7840e, State: Running, Role: LEADER
W20260709 13:05:16.965425 21941 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.511s	user 0.014s	sys 0.005s
I20260709 13:05:16.933632 21731 consensus_queue.cc:1059] T 48824d5acfbc485ebf8c2d944e7202de P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.047s
W20260709 13:05:16.976487 21941 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.522s	user 0.014s	sys 0.005s
I20260709 13:05:16.975061 21929 raft_consensus.cc:515] T 1f85fc4b527a48848e5faa083b604e36 P e5256d91808b47c195bc9b4dbd7f2b87 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:05:16.976357 21823 raft_consensus.cc:493] T 9962423cb4e54fcfa5de01daf68a86e7 P e5256d91808b47c195bc9b4dbd7f2b87 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 127766fc592545a4997f7790f50f6076)
I20260709 13:05:16.988184 20105 raft_consensus.cc:1275] T 1f85fc4b527a48848e5faa083b604e36 P 127766fc592545a4997f7790f50f6076 [term 3 FOLLOWER]: Refusing update from remote peer 0473d2b2d01f4459b1e90fd12cc7840e: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:05:16.988144 20075 leader_election.cc:304] T 833a2f0775ed407a94b8924ce50adb63 P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 127766fc592545a4997f7790f50f6076, e5256d91808b47c195bc9b4dbd7f2b87; no voters: e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:05:16.994639 21941 raft_consensus.cc:697] T 309c3ca0ca4b4f3ba129752ea2cb293b P e61c3a8f61bb48f8a963c9480e53c168 [term 6 LEADER]: Becoming Leader. State: Replica: e61c3a8f61bb48f8a963c9480e53c168, State: Running, Role: LEADER
W20260709 13:05:16.995954 21970 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.617s	user 0.004s	sys 0.007s
I20260709 13:05:16.998932 21823 raft_consensus.cc:515] T 9962423cb4e54fcfa5de01daf68a86e7 P e5256d91808b47c195bc9b4dbd7f2b87 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
W20260709 13:05:16.996622 21970 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.617s	user 0.004s	sys 0.008s
I20260709 13:05:17.076444 19481 raft_consensus.cc:1275] T 40e1e16737a842ee936002830f36882e P 0473d2b2d01f4459b1e90fd12cc7840e [term 7 FOLLOWER]: Refusing update from remote peer e61c3a8f61bb48f8a963c9480e53c168: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:05:17.030084 19484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f85fc4b527a48848e5faa083b604e36" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:05:17.079548 21861 consensus_queue.cc:260] T f1b10566f45d4a7d9029858330e02d5b P 0473d2b2d01f4459b1e90fd12cc7840e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
W20260709 13:05:17.037315 22010 log.cc:927] Time spent T edd7d470b5014c9489be7f41f64355c9 P e61c3a8f61bb48f8a963c9480e53c168: Append to log took a long time: real 0.055s	user 0.000s	sys 0.000s
I20260709 13:05:16.981927 21994 consensus_queue.cc:237] T 65d8cb8d6ec64f459d5a47cefab10acf P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:05:17.045778 21977 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.StartTabletCopy from 127.0.0.1:46436 (request call id 429) took 1028 ms. Trace:
I20260709 13:05:17.051524 19551 raft_consensus.cc:1240] T 70797e5783b5454ab0d0eea663e791e3 P e61c3a8f61bb48f8a963c9480e53c168 [term 7 FOLLOWER]: Rejecting Update request from peer e5256d91808b47c195bc9b4dbd7f2b87 for earlier term 6. Current term is 7. Ops: [6.6-6.6]
I20260709 13:05:17.084548 20105 raft_consensus.cc:1275] T 9962423cb4e54fcfa5de01daf68a86e7 P 127766fc592545a4997f7790f50f6076 [term 9 FOLLOWER]: Refusing update from remote peer 0473d2b2d01f4459b1e90fd12cc7840e: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 13:05:17.053341 19450 leader_election.cc:304] T 96efeaaf1057492490e9a621f37e1a2d P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168; no voters: 127766fc592545a4997f7790f50f6076
I20260709 13:05:17.056272 19486 raft_consensus.cc:1275] T 0cdf56e38bbc453d9438d359e5a69955 P 0473d2b2d01f4459b1e90fd12cc7840e [term 7 FOLLOWER]: Refusing update from remote peer e61c3a8f61bb48f8a963c9480e53c168: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:05:16.995904 21941 consensus_queue.cc:237] T 309c3ca0ca4b4f3ba129752ea2cb293b P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 6, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } attrs { replace: true } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:05:17.028884 21893 raft_consensus.cc:2804] T 833a2f0775ed407a94b8924ce50adb63 P 127766fc592545a4997f7790f50f6076 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:05:17.087299 19526 leader_election.cc:304] T b9f0d59553ad444883fcf5b5909f9798 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168; no voters: e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:05:17.086712 21966 consensus_queue.cc:1048] T 76cb037fc9064d13b59a8969d897ce8c P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.005s
I20260709 13:05:17.093235 21893 raft_consensus.cc:493] T 833a2f0775ed407a94b8924ce50adb63 P 127766fc592545a4997f7790f50f6076 [term 3 FOLLOWER]: Starting leader election (detected failure of leader e5256d91808b47c195bc9b4dbd7f2b87)
I20260709 13:05:17.096186 19404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f575b143b844aa096b50997dad3516a" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:05:17.097967 19405 raft_consensus.cc:1240] T 21e14947d70440f19044d8f75c31e1f9 P e5256d91808b47c195bc9b4dbd7f2b87 [term 6 FOLLOWER]: Rejecting Update request from peer 0473d2b2d01f4459b1e90fd12cc7840e for earlier term 5. Current term is 6. Ops: []
I20260709 13:05:17.032011 21731 raft_consensus.cc:493] T 1dc5b3532fe54f74876d02beffa2c230 P 0473d2b2d01f4459b1e90fd12cc7840e [term 3 FOLLOWER]: Starting pre-election (detected failure of leader e5256d91808b47c195bc9b4dbd7f2b87)
I20260709 13:05:17.097566 19526 leader_election.cc:304] T a08760e15aac4630a629431f56024dc8 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:05:17.101480 19405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2725d2c4cb054f18b0fc8f735c15f6c2" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:05:17.102185 19404 raft_consensus.cc:3060] T 9962423cb4e54fcfa5de01daf68a86e7 P e5256d91808b47c195bc9b4dbd7f2b87 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:05:17.093726 21893 raft_consensus.cc:3060] T 833a2f0775ed407a94b8924ce50adb63 P 127766fc592545a4997f7790f50f6076 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:05:17.105319 19407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab43d85f64114d4ebf618930e43d9ed0" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:05:17.104422 19449 leader_election.cc:304] T 7f575b143b844aa096b50997dad3516a P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e; no voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:05:17.084897 21929 leader_election.cc:290] T 1f85fc4b527a48848e5faa083b604e36 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 4 election: Requested vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:05:17.032327 21837 consensus_queue.cc:1048] T 1f85fc4b527a48848e5faa083b604e36 P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Connected to new peer: Peer: permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.068s
I20260709 13:05:17.103397 21934 raft_consensus.cc:2804] T b9f0d59553ad444883fcf5b5909f9798 P e61c3a8f61bb48f8a963c9480e53c168 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:05:17.103266 21700 raft_consensus.cc:2804] T 96efeaaf1057492490e9a621f37e1a2d P 0473d2b2d01f4459b1e90fd12cc7840e [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:05:17.139989 19405 raft_consensus.cc:1240] T ef32ce6fdd0e40d382c79974f30295c6 P e5256d91808b47c195bc9b4dbd7f2b87 [term 6 FOLLOWER]: Rejecting Update request from peer e61c3a8f61bb48f8a963c9480e53c168 for earlier term 5. Current term is 6. Ops: []
I20260709 13:05:17.140974 19404 raft_consensus.cc:1275] T 9962423cb4e54fcfa5de01daf68a86e7 P e5256d91808b47c195bc9b4dbd7f2b87 [term 9 FOLLOWER]: Refusing update from remote peer 0473d2b2d01f4459b1e90fd12cc7840e: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 13:05:17.113981 21992 raft_consensus.cc:2804] T a08760e15aac4630a629431f56024dc8 P e61c3a8f61bb48f8a963c9480e53c168 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:05:17.148515 21934 raft_consensus.cc:697] T b9f0d59553ad444883fcf5b5909f9798 P e61c3a8f61bb48f8a963c9480e53c168 [term 6 LEADER]: Becoming Leader. State: Replica: e61c3a8f61bb48f8a963c9480e53c168, State: Running, Role: LEADER
I20260709 13:05:17.149195 21858 consensus_queue.cc:1059] T 21e14947d70440f19044d8f75c31e1f9 P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.011s
I20260709 13:05:17.105019 21790 consensus_queue.cc:1048] T 9962423cb4e54fcfa5de01daf68a86e7 P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Connected to new peer: Peer: permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.042s
I20260709 13:05:17.159706 21934 consensus_queue.cc:237] T b9f0d59553ad444883fcf5b5909f9798 P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
W20260709 13:05:17.162320 19524 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:05:17.151209 19450 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.3:36891, user_credentials={real_user=slave}} blocked reactor thread for 53613.3us
I20260709 13:05:17.163161 19450 leader_election.cc:304] T 2725d2c4cb054f18b0fc8f735c15f6c2 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
W20260709 13:05:17.165560 19375 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:17.139549 21700 raft_consensus.cc:493] T 96efeaaf1057492490e9a621f37e1a2d P 0473d2b2d01f4459b1e90fd12cc7840e [term 4 FOLLOWER]: Starting leader election (detected failure of leader e61c3a8f61bb48f8a963c9480e53c168)
I20260709 13:05:17.167555 19486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9962423cb4e54fcfa5de01daf68a86e7" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:05:17.108605 21731 raft_consensus.cc:515] T 1dc5b3532fe54f74876d02beffa2c230 P 0473d2b2d01f4459b1e90fd12cc7840e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:17.142815 22007 raft_consensus.cc:2749] T 7f575b143b844aa096b50997dad3516a P 0473d2b2d01f4459b1e90fd12cc7840e [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 13:05:17.176887 19449 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.1:40321, user_credentials={real_user=slave}} blocked reactor thread for 55862.6us
W20260709 13:05:17.199359 19377 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:17.167181 21790 raft_consensus.cc:2804] T 2725d2c4cb054f18b0fc8f735c15f6c2 P 0473d2b2d01f4459b1e90fd12cc7840e [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:05:17.166742 21992 raft_consensus.cc:697] T a08760e15aac4630a629431f56024dc8 P e61c3a8f61bb48f8a963c9480e53c168 [term 6 LEADER]: Becoming Leader. State: Replica: e61c3a8f61bb48f8a963c9480e53c168, State: Running, Role: LEADER
I20260709 13:05:17.167770 21700 raft_consensus.cc:3060] T 96efeaaf1057492490e9a621f37e1a2d P 0473d2b2d01f4459b1e90fd12cc7840e [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:05:17.205103 21790 raft_consensus.cc:493] T 2725d2c4cb054f18b0fc8f735c15f6c2 P 0473d2b2d01f4459b1e90fd12cc7840e [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:17.205693 21790 raft_consensus.cc:3060] T 2725d2c4cb054f18b0fc8f735c15f6c2 P 0473d2b2d01f4459b1e90fd12cc7840e [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:05:17.212006 22017 log.cc:927] Time spent T bc225c93219c45538b53a1bd3d387e4d P e5256d91808b47c195bc9b4dbd7f2b87: Append to log took a long time: real 0.072s	user 0.001s	sys 0.000s
I20260709 13:05:17.218595 20105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f85fc4b527a48848e5faa083b604e36" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076"
I20260709 13:05:17.218848 20109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9962423cb4e54fcfa5de01daf68a86e7" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:05:17.219238 20105 raft_consensus.cc:3060] T 1f85fc4b527a48848e5faa083b604e36 P 127766fc592545a4997f7790f50f6076 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:05:17.219590 20109 raft_consensus.cc:2393] T 9962423cb4e54fcfa5de01daf68a86e7 P 127766fc592545a4997f7790f50f6076 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e5256d91808b47c195bc9b4dbd7f2b87 in current term 9: Already voted for candidate 0473d2b2d01f4459b1e90fd12cc7840e in this term.
I20260709 13:05:17.148478 22015 consensus_queue.cc:1059] T ef32ce6fdd0e40d382c79974f30295c6 P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.052s
I20260709 13:05:17.236963 19374 leader_election.cc:304] T 9962423cb4e54fcfa5de01daf68a86e7 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, 127766fc592545a4997f7790f50f6076
I20260709 13:05:17.238639 20105 raft_consensus.cc:2468] T 1f85fc4b527a48848e5faa083b604e36 P 127766fc592545a4997f7790f50f6076 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 4.
I20260709 13:05:17.240603 20105 raft_consensus.cc:1240] T 1f85fc4b527a48848e5faa083b604e36 P 127766fc592545a4997f7790f50f6076 [term 4 FOLLOWER]: Rejecting Update request from peer 0473d2b2d01f4459b1e90fd12cc7840e for earlier term 3. Current term is 4. Ops: [3.6-3.6]
I20260709 13:05:17.241005 19374 leader_election.cc:304] T 1f85fc4b527a48848e5faa083b604e36 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 127766fc592545a4997f7790f50f6076, e5256d91808b47c195bc9b4dbd7f2b87; no voters: 0473d2b2d01f4459b1e90fd12cc7840e
W20260709 13:05:17.248595 19449 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:17.250617 21957 raft_consensus.cc:2749] T 9962423cb4e54fcfa5de01daf68a86e7 P e5256d91808b47c195bc9b4dbd7f2b87 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:05:17.251472 22007 raft_consensus.cc:493] T 14935b3ddf914369822e4a0547aaa355 P 0473d2b2d01f4459b1e90fd12cc7840e [term 4 FOLLOWER]: Starting pre-election (detected failure of leader e5256d91808b47c195bc9b4dbd7f2b87)
I20260709 13:05:17.088927 21977 rpcz_store.cc:276] 0709 13:05:16.022995 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:16.025904 (+  2909us) service_pool.cc:224] Handling call
0709 13:05:16.251428 (+225524us) ts_tablet_manager.cc:934] T 7be9efa6559648dbb5a0f7684c4542d1 P 127766fc592545a4997f7790f50f6076: Initiating tablet copy from peer 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
0709 13:05:16.554425 (+302997us) tablet_copy_client.cc:368] Tablet copy session begun
0709 13:05:16.881562 (+327137us) tablet_metadata.cc:665] Metadata flushed
0709 13:05:16.881675 (+   113us) tablet_copy_client.cc:497] Wrote new tablet metadata
0709 13:05:17.044910 (+163235us) tablet_copy_client.cc:418] Wrote new consensus metadata
0709 13:05:17.045271 (+   361us) tablet_replica.cc:206] Creating consensus instance
0709 13:05:17.045631 (+   360us) ts_tablet_manager.cc:989] Replica registered.
0709 13:05:17.045689 (+    58us) inbound_call.cc:177] Queueing success response
Metrics: {"dns_us":9115,"tablet-copy.queue_time_us":180687,"thread_start_us":221970,"threads_started":2}
I20260709 13:05:17.275851 22021 raft_consensus.cc:493] T 0afb57ae58a24a01850491d69f0213dd P 127766fc592545a4997f7790f50f6076 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:17.276700 22021 raft_consensus.cc:515] T 0afb57ae58a24a01850491d69f0213dd P 127766fc592545a4997f7790f50f6076 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:05:17.284947 21969 consensus_queue.cc:260] T 21e14947d70440f19044d8f75c31e1f9 P 0473d2b2d01f4459b1e90fd12cc7840e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:17.287529 21992 consensus_queue.cc:237] T a08760e15aac4630a629431f56024dc8 P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
W20260709 13:05:17.292526 19449 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:17.292658 21731 leader_election.cc:290] T 1dc5b3532fe54f74876d02beffa2c230 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:05:17.293812 21932 raft_consensus.cc:3055] T 48824d5acfbc485ebf8c2d944e7202de P 0473d2b2d01f4459b1e90fd12cc7840e [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:05:17.294247 21932 raft_consensus.cc:740] T 48824d5acfbc485ebf8c2d944e7202de P 0473d2b2d01f4459b1e90fd12cc7840e [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 0473d2b2d01f4459b1e90fd12cc7840e, State: Running, Role: LEADER
W20260709 13:05:17.295380 19526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.2:46257, user_credentials={real_user=slave}} blocked reactor thread for 186892us
W20260709 13:05:17.296577 21989 log.cc:927] Time spent T 40e1e16737a842ee936002830f36882e P e61c3a8f61bb48f8a963c9480e53c168: Append to log took a long time: real 0.842s	user 0.005s	sys 0.003s
I20260709 13:05:17.296911 21932 consensus_queue.cc:260] T 48824d5acfbc485ebf8c2d944e7202de P 0473d2b2d01f4459b1e90fd12cc7840e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:05:17.267956 21957 raft_consensus.cc:2804] T 1f85fc4b527a48848e5faa083b604e36 P e5256d91808b47c195bc9b4dbd7f2b87 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:05:17.299470 21952 consensus_queue.cc:1048] T 40e1e16737a842ee936002830f36882e P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:05:17.300588 21981 raft_consensus.cc:493] T 2a16f7501e2444fb86d4e2778e734e02 P 127766fc592545a4997f7790f50f6076 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:17.319754 22021 leader_election.cc:290] T 0afb57ae58a24a01850491d69f0213dd P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:05:17.320683 19410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dc5b3532fe54f74876d02beffa2c230" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:05:17.325492 21700 raft_consensus.cc:515] T 96efeaaf1057492490e9a621f37e1a2d P 0473d2b2d01f4459b1e90fd12cc7840e [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
W20260709 13:05:17.331315 19451 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:17.264479 22013 consensus_queue.cc:1059] T 1f85fc4b527a48848e5faa083b604e36 P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.037s
W20260709 13:05:17.337319 22026 log.cc:927] Time spent T 309c3ca0ca4b4f3ba129752ea2cb293b P e61c3a8f61bb48f8a963c9480e53c168: Append to log took a long time: real 0.064s	user 0.001s	sys 0.000s
W20260709 13:05:17.339148 19357 auto_rebalancer.cc:629] Failed to schedule move for tablet 28af091831594f9d8e96482078cc7625: Illegal state: Replica e61c3a8f61bb48f8a963c9480e53c168 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 6 leader_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } }
I20260709 13:05:17.341048 21977 tablet_copy_client.cc:806] T 7be9efa6559648dbb5a0f7684c4542d1 P 127766fc592545a4997f7790f50f6076: tablet copy: Starting download of 0 data blocks...
I20260709 13:05:17.341905 21977 tablet_copy_client.cc:670] T 7be9efa6559648dbb5a0f7684c4542d1 P 127766fc592545a4997f7790f50f6076: tablet copy: Starting download of 1 WAL segments...
I20260709 13:05:17.333105 21957 raft_consensus.cc:697] T 1f85fc4b527a48848e5faa083b604e36 P e5256d91808b47c195bc9b4dbd7f2b87 [term 4 LEADER]: Becoming Leader. State: Replica: e5256d91808b47c195bc9b4dbd7f2b87, State: Running, Role: LEADER
I20260709 13:05:17.344595 21957 consensus_queue.cc:237] T 1f85fc4b527a48848e5faa083b604e36 P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:05:17.346891 21700 leader_election.cc:290] T 96efeaaf1057492490e9a621f37e1a2d P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 5 election: Requested vote from peers e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:05:17.313935 21970 raft_consensus.cc:493] T 0afb57ae58a24a01850491d69f0213dd P e61c3a8f61bb48f8a963c9480e53c168 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:17.347329 21893 raft_consensus.cc:515] T 833a2f0775ed407a94b8924ce50adb63 P 127766fc592545a4997f7790f50f6076 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:05:17.347824 21970 raft_consensus.cc:515] T 0afb57ae58a24a01850491d69f0213dd P e61c3a8f61bb48f8a963c9480e53c168 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:05:17.349972 21970 leader_election.cc:290] T 0afb57ae58a24a01850491d69f0213dd P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:05:17.351186 19410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "833a2f0775ed407a94b8924ce50adb63" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
I20260709 13:05:17.330318 21941 consensus_queue.cc:1048] T 0cdf56e38bbc453d9438d359e5a69955 P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.022s
I20260709 13:05:17.330744 21981 raft_consensus.cc:3060] T 2a16f7501e2444fb86d4e2778e734e02 P 127766fc592545a4997f7790f50f6076 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:05:17.295722 22007 raft_consensus.cc:515] T 14935b3ddf914369822e4a0547aaa355 P 0473d2b2d01f4459b1e90fd12cc7840e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } attrs { replace: true } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:05:17.361078 19410 raft_consensus.cc:2468] T 833a2f0775ed407a94b8924ce50adb63 P e5256d91808b47c195bc9b4dbd7f2b87 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 127766fc592545a4997f7790f50f6076 in term 4.
I20260709 13:05:17.362951 21559 raft_consensus.cc:3055] T ef32ce6fdd0e40d382c79974f30295c6 P e61c3a8f61bb48f8a963c9480e53c168 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:05:17.363029 20075 leader_election.cc:304] T 833a2f0775ed407a94b8924ce50adb63 P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 127766fc592545a4997f7790f50f6076, e5256d91808b47c195bc9b4dbd7f2b87; no voters: 
I20260709 13:05:17.363530 21559 raft_consensus.cc:740] T ef32ce6fdd0e40d382c79974f30295c6 P e61c3a8f61bb48f8a963c9480e53c168 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: e61c3a8f61bb48f8a963c9480e53c168, State: Running, Role: LEADER
I20260709 13:05:17.364120 22008 raft_consensus.cc:2804] T 833a2f0775ed407a94b8924ce50adb63 P 127766fc592545a4997f7790f50f6076 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:05:17.364614 22008 raft_consensus.cc:697] T 833a2f0775ed407a94b8924ce50adb63 P 127766fc592545a4997f7790f50f6076 [term 4 LEADER]: Becoming Leader. State: Replica: 127766fc592545a4997f7790f50f6076, State: Running, Role: LEADER
I20260709 13:05:17.364363 21559 consensus_queue.cc:260] T ef32ce6fdd0e40d382c79974f30295c6 P e61c3a8f61bb48f8a963c9480e53c168 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:17.365708 21559 raft_consensus.cc:3060] T ef32ce6fdd0e40d382c79974f30295c6 P e61c3a8f61bb48f8a963c9480e53c168 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:05:17.365428 22008 consensus_queue.cc:237] T 833a2f0775ed407a94b8924ce50adb63 P 127766fc592545a4997f7790f50f6076 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:05:17.368755 21932 raft_consensus.cc:3060] T 48824d5acfbc485ebf8c2d944e7202de P 0473d2b2d01f4459b1e90fd12cc7840e [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:05:17.376324 19403 raft_consensus.cc:1240] T 2e36a9d6e29c4a7c860cf267efbd4c74 P e5256d91808b47c195bc9b4dbd7f2b87 [term 5 FOLLOWER]: Rejecting Update request from peer 0473d2b2d01f4459b1e90fd12cc7840e for earlier term 4. Current term is 5. Ops: []
I20260709 13:05:17.357291 22007 leader_election.cc:290] T 14935b3ddf914369822e4a0547aaa355 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:05:17.381309 21790 raft_consensus.cc:515] T 2725d2c4cb054f18b0fc8f735c15f6c2 P 0473d2b2d01f4459b1e90fd12cc7840e [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:17.357741 21893 leader_election.cc:290] T 833a2f0775ed407a94b8924ce50adb63 P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 4 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:05:17.384982 21790 leader_election.cc:290] T 2725d2c4cb054f18b0fc8f735c15f6c2 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 7 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:05:17.423892 21861 raft_consensus.cc:3060] T f1b10566f45d4a7d9029858330e02d5b P 0473d2b2d01f4459b1e90fd12cc7840e [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:05:17.428128 19377 leader_election.cc:304] T 7be9efa6559648dbb5a0f7684c4542d1 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:05:17.425549 21956 raft_consensus.cc:3055] T 1f85fc4b527a48848e5faa083b604e36 P 0473d2b2d01f4459b1e90fd12cc7840e [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:05:17.434363 19559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dc5b3532fe54f74876d02beffa2c230" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:05:17.434924 19554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2725d2c4cb054f18b0fc8f735c15f6c2" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:05:17.441277 19559 raft_consensus.cc:2393] T 1dc5b3532fe54f74876d02beffa2c230 P e61c3a8f61bb48f8a963c9480e53c168 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0473d2b2d01f4459b1e90fd12cc7840e in current term 4: Already voted for candidate e61c3a8f61bb48f8a963c9480e53c168 in this term.
I20260709 13:05:17.440778 21956 raft_consensus.cc:740] T 1f85fc4b527a48848e5faa083b604e36 P 0473d2b2d01f4459b1e90fd12cc7840e [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 0473d2b2d01f4459b1e90fd12cc7840e, State: Running, Role: LEADER
I20260709 13:05:17.437278 19558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14935b3ddf914369822e4a0547aaa355" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:05:17.422008 21823 leader_election.cc:290] T 9962423cb4e54fcfa5de01daf68a86e7 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:05:17.442128 21956 consensus_queue.cc:260] T 1f85fc4b527a48848e5faa083b604e36 P 0473d2b2d01f4459b1e90fd12cc7840e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:05:17.435503 19557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96efeaaf1057492490e9a621f37e1a2d" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:05:17.443625 21956 raft_consensus.cc:3060] T 1f85fc4b527a48848e5faa083b604e36 P 0473d2b2d01f4459b1e90fd12cc7840e [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:05:17.420490 22005 log.cc:927] Time spent T e381f1d6b8184797ad142de49be225a8 P 0473d2b2d01f4459b1e90fd12cc7840e: Append to log took a long time: real 0.585s	user 0.003s	sys 0.000s
I20260709 13:05:17.395397 21887 raft_consensus.cc:3055] T df751f992649444090e27965eb1af85d P e61c3a8f61bb48f8a963c9480e53c168 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:05:17.454852 21887 raft_consensus.cc:740] T df751f992649444090e27965eb1af85d P e61c3a8f61bb48f8a963c9480e53c168 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: e61c3a8f61bb48f8a963c9480e53c168, State: Running, Role: LEADER
I20260709 13:05:17.455951 19375 leader_election.cc:304] T 3e1f505cb0f1427bbd698ac889d80821 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:05:17.455752 21887 consensus_queue.cc:260] T df751f992649444090e27965eb1af85d P e61c3a8f61bb48f8a963c9480e53c168 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:17.456758 20103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0afb57ae58a24a01850491d69f0213dd" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:05:17.457192 21887 raft_consensus.cc:3060] T df751f992649444090e27965eb1af85d P e61c3a8f61bb48f8a963c9480e53c168 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:05:17.457419 20103 raft_consensus.cc:2468] T 0afb57ae58a24a01850491d69f0213dd P 127766fc592545a4997f7790f50f6076 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 6.
I20260709 13:05:17.442567 19558 raft_consensus.cc:2468] T 14935b3ddf914369822e4a0547aaa355 P e61c3a8f61bb48f8a963c9480e53c168 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 4.
I20260709 13:05:17.441296 19554 raft_consensus.cc:3060] T 2725d2c4cb054f18b0fc8f735c15f6c2 P e61c3a8f61bb48f8a963c9480e53c168 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:05:17.435115 19552 raft_consensus.cc:1275] T e381f1d6b8184797ad142de49be225a8 P e61c3a8f61bb48f8a963c9480e53c168 [term 5 FOLLOWER]: Refusing update from remote peer 0473d2b2d01f4459b1e90fd12cc7840e: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 4. (term mismatch)
I20260709 13:05:17.459450 21969 raft_consensus.cc:3060] T 21e14947d70440f19044d8f75c31e1f9 P 0473d2b2d01f4459b1e90fd12cc7840e [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:05:17.459676 19552 pending_rounds.cc:85] T e381f1d6b8184797ad142de49be225a8 P e61c3a8f61bb48f8a963c9480e53c168: Aborting all ops after (but not including) 3
I20260709 13:05:17.459945 19552 pending_rounds.cc:107] T e381f1d6b8184797ad142de49be225a8 P e61c3a8f61bb48f8a963c9480e53c168: Aborting uncommitted NO_OP operation due to leader change: 4.4
I20260709 13:05:17.460032 21823 raft_consensus.cc:2749] T 3e1f505cb0f1427bbd698ac889d80821 P e5256d91808b47c195bc9b4dbd7f2b87 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:05:17.460191 19552 raft_consensus.cc:2889] T e381f1d6b8184797ad142de49be225a8 P e61c3a8f61bb48f8a963c9480e53c168 [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:05:17.461887 19411 raft_consensus.cc:3060] T a08760e15aac4630a629431f56024dc8 P e5256d91808b47c195bc9b4dbd7f2b87 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:05:17.446578 19523 leader_election.cc:304] T 2a16f7501e2444fb86d4e2778e734e02 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 127766fc592545a4997f7790f50f6076, e61c3a8f61bb48f8a963c9480e53c168; no voters: e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:05:17.447306 19404 raft_consensus.cc:1275] T 4509b76741dc428e9201c70c1658da13 P e5256d91808b47c195bc9b4dbd7f2b87 [term 2 FOLLOWER]: Refusing update from remote peer e61c3a8f61bb48f8a963c9480e53c168: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:17.436676 19450 leader_election.cc:304] T 22196caba61445d3bec98a0aab3c337d P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168; no voters: e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:05:17.467540 19558 raft_consensus.cc:1240] T 1dc5b3532fe54f74876d02beffa2c230 P e61c3a8f61bb48f8a963c9480e53c168 [term 4 FOLLOWER]: Rejecting Update request from peer e5256d91808b47c195bc9b4dbd7f2b87 for earlier term 3. Current term is 4. Ops: []
I20260709 13:05:17.468943 19557 raft_consensus.cc:2468] T 96efeaaf1057492490e9a621f37e1a2d P e61c3a8f61bb48f8a963c9480e53c168 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 5.
I20260709 13:05:17.470238 19404 raft_consensus.cc:1275] T e381f1d6b8184797ad142de49be225a8 P e5256d91808b47c195bc9b4dbd7f2b87 [term 5 FOLLOWER]: Refusing update from remote peer 0473d2b2d01f4459b1e90fd12cc7840e: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:05:17.470621 20105 raft_consensus.cc:1240] T 48824d5acfbc485ebf8c2d944e7202de P 127766fc592545a4997f7790f50f6076 [term 5 FOLLOWER]: Rejecting Update request from peer 0473d2b2d01f4459b1e90fd12cc7840e for earlier term 4. Current term is 5. Ops: []
I20260709 13:05:17.470993 19402 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52328 (request call id 1509) took 1071 ms. Trace:
I20260709 13:05:17.472091 19405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14935b3ddf914369822e4a0547aaa355" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:05:17.472922 19405 raft_consensus.cc:2468] T 14935b3ddf914369822e4a0547aaa355 P e5256d91808b47c195bc9b4dbd7f2b87 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 5.
I20260709 13:05:17.472949 19404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2725d2c4cb054f18b0fc8f735c15f6c2" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
I20260709 13:05:17.474187 20107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96efeaaf1057492490e9a621f37e1a2d" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076"
I20260709 13:05:17.475176 20107 raft_consensus.cc:2393] T 96efeaaf1057492490e9a621f37e1a2d P 127766fc592545a4997f7790f50f6076 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 0473d2b2d01f4459b1e90fd12cc7840e in current term 5: Already voted for candidate 127766fc592545a4997f7790f50f6076 in this term.
I20260709 13:05:17.472128 19403 raft_consensus.cc:1240] T 21e14947d70440f19044d8f75c31e1f9 P e5256d91808b47c195bc9b4dbd7f2b87 [term 6 FOLLOWER]: Rejecting Update request from peer 0473d2b2d01f4459b1e90fd12cc7840e for earlier term 5. Current term is 6. Ops: []
I20260709 13:05:17.477267 19560 raft_consensus.cc:1275] T 76cb037fc9064d13b59a8969d897ce8c P e61c3a8f61bb48f8a963c9480e53c168 [term 7 FOLLOWER]: Refusing update from remote peer e5256d91808b47c195bc9b4dbd7f2b87: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:05:17.491829 19409 raft_consensus.cc:1275] T 179fd671030940b4b4a4e24bcc4aba0a P e5256d91808b47c195bc9b4dbd7f2b87 [term 5 FOLLOWER]: Refusing update from remote peer 0473d2b2d01f4459b1e90fd12cc7840e: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:05:17.471415 19402 rpcz_store.cc:276] 0709 13:05:16.400025 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:16.406737 (+  6712us) service_pool.cc:224] Handling call
0709 13:05:16.419896 (+ 13159us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:16.524017 (+104121us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:17.470816 (+946799us) spinlock_profiling.cc:243] Waited 103 ms on lock 0x7b5400060254. stack: 00007f4a79de9343 00007f4a79de9240 00007f4a797781d4 00007f4a834b6304 00007f4a834b6299 00007f4a7ce71571 00007f4a7cf08e01 00007f4a7cf0783e 00007f4a81ecc419 00007f4a7b443bd4 00007f4a7b443b62 00007f4a7b443a91 00007f4a7b443a0c 00007f4a7b442cc2 00007f4a7b24348c 00007f4a7b2428c6
0709 13:05:17.470943 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":238025472}
W20260709 13:05:17.493194 19523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.4:43121, user_credentials={real_user=slave}} blocked reactor thread for 46703.9us
I20260709 13:05:17.494671 19557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0afb57ae58a24a01850491d69f0213dd" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:05:17.495385 19557 raft_consensus.cc:2468] T 0afb57ae58a24a01850491d69f0213dd P e61c3a8f61bb48f8a963c9480e53c168 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 127766fc592545a4997f7790f50f6076 in term 6.
I20260709 13:05:17.495988 19551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "833a2f0775ed407a94b8924ce50adb63" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:05:17.496680 19551 raft_consensus.cc:2393] T 833a2f0775ed407a94b8924ce50adb63 P e61c3a8f61bb48f8a963c9480e53c168 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 127766fc592545a4997f7790f50f6076 in current term 4: Already voted for candidate e61c3a8f61bb48f8a963c9480e53c168 in this term.
I20260709 13:05:17.497162 19406 raft_consensus.cc:1240] T df751f992649444090e27965eb1af85d P e5256d91808b47c195bc9b4dbd7f2b87 [term 6 FOLLOWER]: Rejecting Update request from peer e61c3a8f61bb48f8a963c9480e53c168 for earlier term 5. Current term is 6. Ops: []
I20260709 13:05:17.497969 19553 raft_consensus.cc:1275] T 2b74109013a140ada21feeef92d6f563 P e61c3a8f61bb48f8a963c9480e53c168 [term 3 FOLLOWER]: Refusing update from remote peer e5256d91808b47c195bc9b4dbd7f2b87: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:05:17.498958 20104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14935b3ddf914369822e4a0547aaa355" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:05:17.499709 20104 raft_consensus.cc:2393] T 14935b3ddf914369822e4a0547aaa355 P 127766fc592545a4997f7790f50f6076 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0473d2b2d01f4459b1e90fd12cc7840e in current term 5: Already voted for candidate 127766fc592545a4997f7790f50f6076 in this term.
I20260709 13:05:17.491394 21920 raft_consensus.cc:493] T 85c494af21f9457a85da47b9bc70c1fd P 127766fc592545a4997f7790f50f6076 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:17.500790 21920 raft_consensus.cc:515] T 85c494af21f9457a85da47b9bc70c1fd P 127766fc592545a4997f7790f50f6076 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:05:17.503177 19552 raft_consensus.cc:1240] T a08760e15aac4630a629431f56024dc8 P e61c3a8f61bb48f8a963c9480e53c168 [term 6 LEADER]: Rejecting Update request from peer e5256d91808b47c195bc9b4dbd7f2b87 for earlier term 5. Current term is 6. Ops: []
I20260709 13:05:17.504382 20103 raft_consensus.cc:1275] T 85c494af21f9457a85da47b9bc70c1fd P 127766fc592545a4997f7790f50f6076 [term 3 FOLLOWER]: Refusing update from remote peer e61c3a8f61bb48f8a963c9480e53c168: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:05:17.505556 19554 raft_consensus.cc:2468] T 2725d2c4cb054f18b0fc8f735c15f6c2 P e61c3a8f61bb48f8a963c9480e53c168 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 7.
I20260709 13:05:17.506203 19555 raft_consensus.cc:1240] T 2725d2c4cb054f18b0fc8f735c15f6c2 P e61c3a8f61bb48f8a963c9480e53c168 [term 7 FOLLOWER]: Rejecting Update request from peer e5256d91808b47c195bc9b4dbd7f2b87 for earlier term 6. Current term is 7. Ops: []
I20260709 13:05:17.506804 21684 raft_consensus.cc:2804] T 2a16f7501e2444fb86d4e2778e734e02 P e61c3a8f61bb48f8a963c9480e53c168 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:05:17.507244 21684 raft_consensus.cc:493] T 2a16f7501e2444fb86d4e2778e734e02 P e61c3a8f61bb48f8a963c9480e53c168 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 127766fc592545a4997f7790f50f6076)
I20260709 13:05:17.507651 21684 raft_consensus.cc:3060] T 2a16f7501e2444fb86d4e2778e734e02 P e61c3a8f61bb48f8a963c9480e53c168 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:05:17.464654 21731 raft_consensus.cc:493] T 0cdf56e38bbc453d9438d359e5a69955 P 0473d2b2d01f4459b1e90fd12cc7840e [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:17.508782 21731 raft_consensus.cc:515] T 0cdf56e38bbc453d9438d359e5a69955 P 0473d2b2d01f4459b1e90fd12cc7840e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:17.509563 21920 leader_election.cc:290] T 85c494af21f9457a85da47b9bc70c1fd P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:05:17.478984 21936 raft_consensus.cc:493] T 217b5fae677b4971b3bbd2f357a1f7ff P e61c3a8f61bb48f8a963c9480e53c168 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 0473d2b2d01f4459b1e90fd12cc7840e)
I20260709 13:05:17.516512 21936 raft_consensus.cc:515] T 217b5fae677b4971b3bbd2f357a1f7ff P e61c3a8f61bb48f8a963c9480e53c168 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:17.491595 21958 raft_consensus.cc:2749] T 7be9efa6559648dbb5a0f7684c4542d1 P e5256d91808b47c195bc9b4dbd7f2b87 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:05:17.530958 19411 raft_consensus.cc:2468] T a08760e15aac4630a629431f56024dc8 P e5256d91808b47c195bc9b4dbd7f2b87 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 6.
W20260709 13:05:17.536526 19450 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.3:36891, user_credentials={real_user=slave}} blocked reactor thread for 99971.8us
I20260709 13:05:17.535601 19410 raft_consensus.cc:1275] T 0cdf56e38bbc453d9438d359e5a69955 P e5256d91808b47c195bc9b4dbd7f2b87 [term 7 FOLLOWER]: Refusing update from remote peer e61c3a8f61bb48f8a963c9480e53c168: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:05:17.522238 21981 raft_consensus.cc:515] T 2a16f7501e2444fb86d4e2778e734e02 P 127766fc592545a4997f7790f50f6076 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:05:17.518579 21936 leader_election.cc:290] T 217b5fae677b4971b3bbd2f357a1f7ff P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:05:17.530954 21859 raft_consensus.cc:493] T 96efeaaf1057492490e9a621f37e1a2d P 127766fc592545a4997f7790f50f6076 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:17.422376 21911 raft_consensus.cc:493] T 309c3ca0ca4b4f3ba129752ea2cb293b P 127766fc592545a4997f7790f50f6076 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:17.535185 21731 leader_election.cc:290] T 0cdf56e38bbc453d9438d359e5a69955 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:05:17.544085 19411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85c494af21f9457a85da47b9bc70c1fd" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:05:17.544996 19485 raft_consensus.cc:1240] T 2725d2c4cb054f18b0fc8f735c15f6c2 P 0473d2b2d01f4459b1e90fd12cc7840e [term 7 FOLLOWER]: Rejecting Update request from peer e5256d91808b47c195bc9b4dbd7f2b87 for earlier term 6. Current term is 7. Ops: []
I20260709 13:05:17.542831 21767 consensus_queue.cc:1048] T 179fd671030940b4b4a4e24bcc4aba0a P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.005s
I20260709 13:05:17.547988 21958 consensus_queue.cc:1048] T 2b74109013a140ada21feeef92d6f563 P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:05:17.546379 20076 leader_election.cc:304] T 0afb57ae58a24a01850491d69f0213dd P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 127766fc592545a4997f7790f50f6076, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:05:17.550060 21971 consensus_queue.cc:1059] T 3e1f505cb0f1427bbd698ac889d80821 P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:05:17.542332 21926 consensus_queue.cc:1059] T 1dc5b3532fe54f74876d02beffa2c230 P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.010s
I20260709 13:05:17.551277 21403 raft_consensus.cc:2804] T 0afb57ae58a24a01850491d69f0213dd P 127766fc592545a4997f7790f50f6076 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:05:17.550115 21962 consensus_queue.cc:1048] T 76cb037fc9064d13b59a8969d897ce8c P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:05:17.551687 21403 raft_consensus.cc:493] T 0afb57ae58a24a01850491d69f0213dd P 127766fc592545a4997f7790f50f6076 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:17.552273 21403 raft_consensus.cc:3060] T 0afb57ae58a24a01850491d69f0213dd P 127766fc592545a4997f7790f50f6076 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:05:17.540221 21529 consensus_queue.cc:1048] T 4509b76741dc428e9201c70c1658da13 P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.012s
I20260709 13:05:17.542925 21861 consensus_queue.cc:1048] T e381f1d6b8184797ad142de49be225a8 P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.012s
I20260709 13:05:17.545524 21859 raft_consensus.cc:515] T 96efeaaf1057492490e9a621f37e1a2d P 127766fc592545a4997f7790f50f6076 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:05:17.540266 21790 consensus_queue.cc:1059] T 2e36a9d6e29c4a7c860cf267efbd4c74 P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.015s
I20260709 13:05:17.551708 21926 raft_consensus.cc:3055] T 1dc5b3532fe54f74876d02beffa2c230 P e5256d91808b47c195bc9b4dbd7f2b87 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:05:17.555353 21859 leader_election.cc:290] T 96efeaaf1057492490e9a621f37e1a2d P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:05:17.555421 21926 raft_consensus.cc:740] T 1dc5b3532fe54f74876d02beffa2c230 P e5256d91808b47c195bc9b4dbd7f2b87 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: e5256d91808b47c195bc9b4dbd7f2b87, State: Running, Role: LEADER
I20260709 13:05:17.555868 21529 raft_consensus.cc:493] T 833a2f0775ed407a94b8924ce50adb63 P e61c3a8f61bb48f8a963c9480e53c168 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:17.556365 21529 raft_consensus.cc:515] T 833a2f0775ed407a94b8924ce50adb63 P e61c3a8f61bb48f8a963c9480e53c168 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:05:17.556583 21926 consensus_queue.cc:260] T 1dc5b3532fe54f74876d02beffa2c230 P e5256d91808b47c195bc9b4dbd7f2b87 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:17.563135 19523 leader_election.cc:304] T 0afb57ae58a24a01850491d69f0213dd P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 127766fc592545a4997f7790f50f6076, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:05:17.566316 19556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96efeaaf1057492490e9a621f37e1a2d" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:05:17.567044 19556 raft_consensus.cc:2468] T 96efeaaf1057492490e9a621f37e1a2d P e61c3a8f61bb48f8a963c9480e53c168 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 127766fc592545a4997f7790f50f6076 in term 5.
I20260709 13:05:17.543480 22011 raft_consensus.cc:2804] T 22196caba61445d3bec98a0aab3c337d P 0473d2b2d01f4459b1e90fd12cc7840e [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:05:17.568733 20107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "833a2f0775ed407a94b8924ce50adb63" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:05:17.575675 19407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "217b5fae677b4971b3bbd2f357a1f7ff" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:05:17.576409 19407 raft_consensus.cc:2393] T 217b5fae677b4971b3bbd2f357a1f7ff P e5256d91808b47c195bc9b4dbd7f2b87 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e61c3a8f61bb48f8a963c9480e53c168 in current term 3: Already voted for candidate e5256d91808b47c195bc9b4dbd7f2b87 in this term.
I20260709 13:05:17.578780 19477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96efeaaf1057492490e9a621f37e1a2d" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:05:17.579608 19477 raft_consensus.cc:2468] T 96efeaaf1057492490e9a621f37e1a2d P 0473d2b2d01f4459b1e90fd12cc7840e [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 127766fc592545a4997f7790f50f6076 in term 5.
I20260709 13:05:17.587894 19477 raft_consensus.cc:1275] T 4509b76741dc428e9201c70c1658da13 P 0473d2b2d01f4459b1e90fd12cc7840e [term 2 FOLLOWER]: Refusing update from remote peer e61c3a8f61bb48f8a963c9480e53c168: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:17.588829 19558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cdf56e38bbc453d9438d359e5a69955" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:05:17.590224 20076 leader_election.cc:304] T 96efeaaf1057492490e9a621f37e1a2d P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 127766fc592545a4997f7790f50f6076, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:05:17.591161 19480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0afb57ae58a24a01850491d69f0213dd" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:05:17.591931 19480 raft_consensus.cc:2468] T 0afb57ae58a24a01850491d69f0213dd P 0473d2b2d01f4459b1e90fd12cc7840e [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 6.
I20260709 13:05:17.592226 19403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "833a2f0775ed407a94b8924ce50adb63" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:05:17.592803 19403 raft_consensus.cc:2468] T 833a2f0775ed407a94b8924ce50adb63 P e5256d91808b47c195bc9b4dbd7f2b87 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 4.
I20260709 13:05:17.594476 19523 leader_election.cc:304] T 833a2f0775ed407a94b8924ce50adb63 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168; no voters: 127766fc592545a4997f7790f50f6076
I20260709 13:05:17.595310 19553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85c494af21f9457a85da47b9bc70c1fd" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:05:17.597214 19479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0afb57ae58a24a01850491d69f0213dd" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:05:17.598045 19479 raft_consensus.cc:2468] T 0afb57ae58a24a01850491d69f0213dd P 0473d2b2d01f4459b1e90fd12cc7840e [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 127766fc592545a4997f7790f50f6076 in term 6.
I20260709 13:05:17.602196 19478 raft_consensus.cc:1275] T edd7d470b5014c9489be7f41f64355c9 P 0473d2b2d01f4459b1e90fd12cc7840e [term 5 FOLLOWER]: Refusing update from remote peer e61c3a8f61bb48f8a963c9480e53c168: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
W20260709 13:05:17.603447 19357 auto_rebalancer.cc:629] Failed to schedule move for tablet e381f1d6b8184797ad142de49be225a8: Illegal state: Leader has not yet committed an operation in its own term
I20260709 13:05:17.606316 19411 raft_consensus.cc:1275] T edd7d470b5014c9489be7f41f64355c9 P e5256d91808b47c195bc9b4dbd7f2b87 [term 5 FOLLOWER]: Refusing update from remote peer e61c3a8f61bb48f8a963c9480e53c168: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:05:17.562007 21926 raft_consensus.cc:3060] T 1dc5b3532fe54f74876d02beffa2c230 P e5256d91808b47c195bc9b4dbd7f2b87 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:05:17.620579 19477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "217b5fae677b4971b3bbd2f357a1f7ff" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:05:17.538508 21932 consensus_queue.cc:1048] T 9962423cb4e54fcfa5de01daf68a86e7 P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.054s
I20260709 13:05:17.643695 19410 raft_consensus.cc:1275] T fa8650e71aa14778b3d73721fc50d9fc P e5256d91808b47c195bc9b4dbd7f2b87 [term 7 FOLLOWER]: Refusing update from remote peer e61c3a8f61bb48f8a963c9480e53c168: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:05:17.574967 21936 raft_consensus.cc:2804] T 0afb57ae58a24a01850491d69f0213dd P e61c3a8f61bb48f8a963c9480e53c168 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:05:17.558604 21529 leader_election.cc:290] T 833a2f0775ed407a94b8924ce50adb63 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:05:17.646946 21825 consensus_queue.cc:1048] T edd7d470b5014c9489be7f41f64355c9 P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.007s
I20260709 13:05:17.555589 21790 raft_consensus.cc:3055] T 2e36a9d6e29c4a7c860cf267efbd4c74 P 0473d2b2d01f4459b1e90fd12cc7840e [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:05:17.662019 19450 leader_election.cc:304] T 1dc5b3532fe54f74876d02beffa2c230 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e; no voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:05:17.576871 21918 consensus_queue.cc:1059] T 2725d2c4cb054f18b0fc8f735c15f6c2 P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.085s
I20260709 13:05:17.577028 21971 consensus_queue.cc:1048] T 85c494af21f9457a85da47b9bc70c1fd P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Connected to new peer: Peer: permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.085s
I20260709 13:05:17.606786 22011 raft_consensus.cc:697] T 22196caba61445d3bec98a0aab3c337d P 0473d2b2d01f4459b1e90fd12cc7840e [term 5 LEADER]: Becoming Leader. State: Replica: 0473d2b2d01f4459b1e90fd12cc7840e, State: Running, Role: LEADER
I20260709 13:05:17.608765 21934 raft_consensus.cc:2804] T 833a2f0775ed407a94b8924ce50adb63 P e61c3a8f61bb48f8a963c9480e53c168 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:05:17.647480 21894 raft_consensus.cc:2804] T 96efeaaf1057492490e9a621f37e1a2d P 127766fc592545a4997f7790f50f6076 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:05:17.648627 22007 raft_consensus.cc:493] T 217b5fae677b4971b3bbd2f357a1f7ff P 0473d2b2d01f4459b1e90fd12cc7840e [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:17.667811 19411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cdf56e38bbc453d9438d359e5a69955" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:05:17.677588 21790 raft_consensus.cc:740] T 2e36a9d6e29c4a7c860cf267efbd4c74 P 0473d2b2d01f4459b1e90fd12cc7840e [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 0473d2b2d01f4459b1e90fd12cc7840e, State: Running, Role: LEADER
I20260709 13:05:17.681950 21931 raft_consensus.cc:493] T 86a6797bdfe94fa496c050ceae4bd0d9 P e61c3a8f61bb48f8a963c9480e53c168 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:05:17.682313 22032 log.cc:927] Time spent T 65d8cb8d6ec64f459d5a47cefab10acf P e61c3a8f61bb48f8a963c9480e53c168: Append to log took a long time: real 0.091s	user 0.001s	sys 0.000s
I20260709 13:05:17.687450 19450 leader_election.cc:304] T 14935b3ddf914369822e4a0547aaa355 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168; no voters: 127766fc592545a4997f7790f50f6076
I20260709 13:05:17.688443 21970 consensus_queue.cc:1048] T edd7d470b5014c9489be7f41f64355c9 P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.107s
W20260709 13:05:17.733572 19374 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.4:43121, user_credentials={real_user=slave}} blocked reactor thread for 43963.4us
I20260709 13:05:17.670542 21941 consensus_queue.cc:1048] T 4509b76741dc428e9201c70c1658da13 P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.070s
I20260709 13:05:17.670722 21980 raft_consensus.cc:493] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P e5256d91808b47c195bc9b4dbd7f2b87 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 127766fc592545a4997f7790f50f6076)
W20260709 13:05:17.819495 19450 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.3:36891, user_credentials={real_user=slave}} blocked reactor thread for 132115us
I20260709 13:05:17.819877 19407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a16f7501e2444fb86d4e2778e734e02" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
I20260709 13:05:17.820545 19407 raft_consensus.cc:3060] T 2a16f7501e2444fb86d4e2778e734e02 P e5256d91808b47c195bc9b4dbd7f2b87 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:05:17.820909 19450 leader_election.cc:304] T 96efeaaf1057492490e9a621f37e1a2d P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168; no voters: 127766fc592545a4997f7790f50f6076
W20260709 13:05:17.767680 19452 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:17.672176 21936 raft_consensus.cc:493] T 0afb57ae58a24a01850491d69f0213dd P e61c3a8f61bb48f8a963c9480e53c168 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:17.769790 19408 raft_consensus.cc:1240] T 1f85fc4b527a48848e5faa083b604e36 P e5256d91808b47c195bc9b4dbd7f2b87 [term 4 LEADER]: Rejecting Update request from peer 0473d2b2d01f4459b1e90fd12cc7840e for earlier term 3. Current term is 4. Ops: []
I20260709 13:05:17.570780 21911 raft_consensus.cc:515] T 309c3ca0ca4b4f3ba129752ea2cb293b P 127766fc592545a4997f7790f50f6076 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } attrs { replace: true } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:05:17.708657 21767 raft_consensus.cc:3060] T 1dc5b3532fe54f74876d02beffa2c230 P 0473d2b2d01f4459b1e90fd12cc7840e [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:05:17.778400 22033 log.cc:927] Time spent T 833a2f0775ed407a94b8924ce50adb63 P 127766fc592545a4997f7790f50f6076: Append to log took a long time: real 0.114s	user 0.000s	sys 0.000s
I20260709 13:05:17.720819 21892 raft_consensus.cc:493] T 48824d5acfbc485ebf8c2d944e7202de P 127766fc592545a4997f7790f50f6076 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:17.661437 21986 raft_consensus.cc:493] T 14935b3ddf914369822e4a0547aaa355 P 127766fc592545a4997f7790f50f6076 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:17.800189 19411 raft_consensus.cc:2468] T 0cdf56e38bbc453d9438d359e5a69955 P e5256d91808b47c195bc9b4dbd7f2b87 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 7.
W20260709 13:05:17.800243 19449 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.1:40321, user_credentials={real_user=slave}} blocked reactor thread for 55664.2us
I20260709 13:05:17.770637 21894 raft_consensus.cc:493] T 96efeaaf1057492490e9a621f37e1a2d P 127766fc592545a4997f7790f50f6076 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:17.766185 21934 raft_consensus.cc:493] T 833a2f0775ed407a94b8924ce50adb63 P e61c3a8f61bb48f8a963c9480e53c168 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:17.600736 21935 consensus_queue.cc:1048] T 0cdf56e38bbc453d9438d359e5a69955 P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.074s
I20260709 13:05:17.825564 19450 leader_election.cc:304] T 2725d2c4cb054f18b0fc8f735c15f6c2 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168; no voters: e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:05:17.689213 21859 raft_consensus.cc:493] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P 127766fc592545a4997f7790f50f6076 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:17.810794 21992 raft_consensus.cc:493] T 46c5bfeecc314717bffe987e6844b6d0 P e61c3a8f61bb48f8a963c9480e53c168 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:17.828210 21932 raft_consensus.cc:2804] T 96efeaaf1057492490e9a621f37e1a2d P 0473d2b2d01f4459b1e90fd12cc7840e [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:05:17.829025 21936 raft_consensus.cc:3060] T 0afb57ae58a24a01850491d69f0213dd P e61c3a8f61bb48f8a963c9480e53c168 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:05:17.824643 21963 raft_consensus.cc:2804] T 14935b3ddf914369822e4a0547aaa355 P 0473d2b2d01f4459b1e90fd12cc7840e [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:05:17.827869 21968 raft_consensus.cc:493] T 86a6797bdfe94fa496c050ceae4bd0d9 P 0473d2b2d01f4459b1e90fd12cc7840e [term 4 FOLLOWER]: Starting pre-election (detected failure of leader e61c3a8f61bb48f8a963c9480e53c168)
I20260709 13:05:17.840719 21981 leader_election.cc:290] T 2a16f7501e2444fb86d4e2778e734e02 P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 7 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:05:17.853307 21894 raft_consensus.cc:3060] T 96efeaaf1057492490e9a621f37e1a2d P 127766fc592545a4997f7790f50f6076 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:05:17.813845 22007 raft_consensus.cc:515] T 217b5fae677b4971b3bbd2f357a1f7ff P 0473d2b2d01f4459b1e90fd12cc7840e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:17.859266 21934 raft_consensus.cc:3060] T 833a2f0775ed407a94b8924ce50adb63 P e61c3a8f61bb48f8a963c9480e53c168 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:05:17.817095 21931 raft_consensus.cc:515] T 86a6797bdfe94fa496c050ceae4bd0d9 P e61c3a8f61bb48f8a963c9480e53c168 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:17.827534 21731 consensus_queue.cc:1048] T e381f1d6b8184797ad142de49be225a8 P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.066s
W20260709 13:05:17.894842 22012 log.cc:927] Time spent T 40e1e16737a842ee936002830f36882e P e5256d91808b47c195bc9b4dbd7f2b87: Append to log took a long time: real 0.059s	user 0.001s	sys 0.001s
I20260709 13:05:17.870110 21700 raft_consensus.cc:493] T ef32ce6fdd0e40d382c79974f30295c6 P 0473d2b2d01f4459b1e90fd12cc7840e [term 5 FOLLOWER]: Starting pre-election (detected failure of leader e61c3a8f61bb48f8a963c9480e53c168)
I20260709 13:05:17.987111 21700 raft_consensus.cc:515] T ef32ce6fdd0e40d382c79974f30295c6 P 0473d2b2d01f4459b1e90fd12cc7840e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:17.989451 21700 leader_election.cc:290] T ef32ce6fdd0e40d382c79974f30295c6 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:05:17.990021 21700 raft_consensus.cc:493] T 5ec1c4ce15e04c7e8c283a62179f2a64 P 0473d2b2d01f4459b1e90fd12cc7840e [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 127766fc592545a4997f7790f50f6076)
I20260709 13:05:17.992026 21931 leader_election.cc:290] T 86a6797bdfe94fa496c050ceae4bd0d9 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:05:17.922051 21932 raft_consensus.cc:697] T 96efeaaf1057492490e9a621f37e1a2d P 0473d2b2d01f4459b1e90fd12cc7840e [term 5 LEADER]: Becoming Leader. State: Replica: 0473d2b2d01f4459b1e90fd12cc7840e, State: Running, Role: LEADER
I20260709 13:05:17.827556 21980 raft_consensus.cc:515] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P e5256d91808b47c195bc9b4dbd7f2b87 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:05:17.919682 21963 raft_consensus.cc:493] T 14935b3ddf914369822e4a0547aaa355 P 0473d2b2d01f4459b1e90fd12cc7840e [term 4 FOLLOWER]: Starting leader election (detected failure of leader e5256d91808b47c195bc9b4dbd7f2b87)
I20260709 13:05:17.931778 22040 raft_consensus.cc:493] T 14efcc79969f41babe5529c22d59156d P 127766fc592545a4997f7790f50f6076 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader e5256d91808b47c195bc9b4dbd7f2b87)
W20260709 13:05:17.932641 22034 log.cc:927] Time spent T 2b74109013a140ada21feeef92d6f563 P e5256d91808b47c195bc9b4dbd7f2b87: Append to log took a long time: real 0.148s	user 0.000s	sys 0.000s
I20260709 13:05:17.932943 21929 consensus_queue.cc:1059] T 2725d2c4cb054f18b0fc8f735c15f6c2 P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.005s
I20260709 13:05:17.888448 21790 consensus_queue.cc:260] T 2e36a9d6e29c4a7c860cf267efbd4c74 P 0473d2b2d01f4459b1e90fd12cc7840e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:17.935606 21968 raft_consensus.cc:515] T 86a6797bdfe94fa496c050ceae4bd0d9 P 0473d2b2d01f4459b1e90fd12cc7840e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:17.913023 21956 raft_consensus.cc:2804] T 2725d2c4cb054f18b0fc8f735c15f6c2 P 0473d2b2d01f4459b1e90fd12cc7840e [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:05:18.016796 21956 raft_consensus.cc:697] T 2725d2c4cb054f18b0fc8f735c15f6c2 P 0473d2b2d01f4459b1e90fd12cc7840e [term 7 LEADER]: Becoming Leader. State: Replica: 0473d2b2d01f4459b1e90fd12cc7840e, State: Running, Role: LEADER
I20260709 13:05:18.017375 22007 leader_election.cc:290] T 217b5fae677b4971b3bbd2f357a1f7ff P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:05:18.017971 21968 leader_election.cc:290] T 86a6797bdfe94fa496c050ceae4bd0d9 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:05:18.017750 21956 consensus_queue.cc:237] T 2725d2c4cb054f18b0fc8f735c15f6c2 P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:17.847090 21892 raft_consensus.cc:515] T 48824d5acfbc485ebf8c2d944e7202de P 127766fc592545a4997f7790f50f6076 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:05:17.894598 21861 raft_consensus.cc:493] T f93ee515a9c14139bf566522ed8232f3 P 0473d2b2d01f4459b1e90fd12cc7840e [term 7 FOLLOWER]: Starting pre-election (detected failure of leader e61c3a8f61bb48f8a963c9480e53c168)
I20260709 13:05:18.019225 21861 raft_consensus.cc:515] T f93ee515a9c14139bf566522ed8232f3 P 0473d2b2d01f4459b1e90fd12cc7840e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:18.020072 21980 leader_election.cc:290] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:05:18.020233 21892 leader_election.cc:290] T 48824d5acfbc485ebf8c2d944e7202de P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:05:18.021250 21861 leader_election.cc:290] T f93ee515a9c14139bf566522ed8232f3 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
W20260709 13:05:18.024992 21969 consensus_meta.cc:287] T 21e14947d70440f19044d8f75c31e1f9 P 0473d2b2d01f4459b1e90fd12cc7840e: Time spent flushing consensus metadata: real 0.565s	user 0.005s	sys 0.004s
I20260709 13:05:17.983131 22027 raft_consensus.cc:493] T 7be9efa6559648dbb5a0f7684c4542d1 P e61c3a8f61bb48f8a963c9480e53c168 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:05:17.984961 22020 log.cc:927] Time spent T 85c494af21f9457a85da47b9bc70c1fd P e5256d91808b47c195bc9b4dbd7f2b87: Append to log took a long time: real 0.099s	user 0.000s	sys 0.000s
W20260709 13:05:17.985968 22036 log.cc:927] Time spent T 1f85fc4b527a48848e5faa083b604e36 P e5256d91808b47c195bc9b4dbd7f2b87: Append to log took a long time: real 0.091s	user 0.000s	sys 0.000s
I20260709 13:05:17.994951 20109 raft_consensus.cc:1275] T 1f85fc4b527a48848e5faa083b604e36 P 127766fc592545a4997f7790f50f6076 [term 4 FOLLOWER]: Refusing update from remote peer e5256d91808b47c195bc9b4dbd7f2b87: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:05:18.003305 19402 raft_consensus.cc:1275] T 833a2f0775ed407a94b8924ce50adb63 P e5256d91808b47c195bc9b4dbd7f2b87 [term 4 FOLLOWER]: Refusing update from remote peer 127766fc592545a4997f7790f50f6076: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:05:18.007012 19477 raft_consensus.cc:2468] T 217b5fae677b4971b3bbd2f357a1f7ff P 0473d2b2d01f4459b1e90fd12cc7840e [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 3.
I20260709 13:05:17.859272 21986 raft_consensus.cc:515] T 14935b3ddf914369822e4a0547aaa355 P 127766fc592545a4997f7790f50f6076 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } attrs { replace: true } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:05:17.909391 21992 raft_consensus.cc:515] T 46c5bfeecc314717bffe987e6844b6d0 P e61c3a8f61bb48f8a963c9480e53c168 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:17.907063 21859 raft_consensus.cc:515] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P 127766fc592545a4997f7790f50f6076 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:05:18.006186 21916 raft_consensus.cc:493] T 217b5fae677b4971b3bbd2f357a1f7ff P e5256d91808b47c195bc9b4dbd7f2b87 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:17.888847 22011 consensus_queue.cc:237] T 22196caba61445d3bec98a0aab3c337d P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
W20260709 13:05:17.984670 22043 log.cc:927] Time spent T fa8650e71aa14778b3d73721fc50d9fc P 0473d2b2d01f4459b1e90fd12cc7840e: Append to log took a long time: real 0.164s	user 0.001s	sys 0.000s
I20260709 13:05:18.086134 19555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48824d5acfbc485ebf8c2d944e7202de" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:05:18.034022 20076 leader_election.cc:304] T 85c494af21f9457a85da47b9bc70c1fd P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 127766fc592545a4997f7790f50f6076; no voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:05:18.038190 20107 raft_consensus.cc:1275] T 309c3ca0ca4b4f3ba129752ea2cb293b P 127766fc592545a4997f7790f50f6076 [term 6 FOLLOWER]: Refusing update from remote peer e61c3a8f61bb48f8a963c9480e53c168: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:05:18.051388 19560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a16f7501e2444fb86d4e2778e734e02" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:05:18.008920 21963 raft_consensus.cc:3060] T 14935b3ddf914369822e4a0547aaa355 P 0473d2b2d01f4459b1e90fd12cc7840e [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:05:17.990499 21700 raft_consensus.cc:515] T 5ec1c4ce15e04c7e8c283a62179f2a64 P 0473d2b2d01f4459b1e90fd12cc7840e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
W20260709 13:05:18.088253 20076 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.3:36891, user_credentials={real_user=slave}} blocked reactor thread for 54363us
I20260709 13:05:18.090962 19402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef32ce6fdd0e40d382c79974f30295c6" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:05:18.093119 19402 raft_consensus.cc:2393] T ef32ce6fdd0e40d382c79974f30295c6 P e5256d91808b47c195bc9b4dbd7f2b87 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0473d2b2d01f4459b1e90fd12cc7840e in current term 6: Already voted for candidate e5256d91808b47c195bc9b4dbd7f2b87 in this term.
I20260709 13:05:18.096227 19409 raft_consensus.cc:3060] T b9f0d59553ad444883fcf5b5909f9798 P e5256d91808b47c195bc9b4dbd7f2b87 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:05:18.098318 19411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "217b5fae677b4971b3bbd2f357a1f7ff" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:05:18.100356 19408 raft_consensus.cc:1275] T a08760e15aac4630a629431f56024dc8 P e5256d91808b47c195bc9b4dbd7f2b87 [term 6 FOLLOWER]: Refusing update from remote peer e61c3a8f61bb48f8a963c9480e53c168: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:05:18.103274 19403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86a6797bdfe94fa496c050ceae4bd0d9" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:05:18.104010 19403 raft_consensus.cc:2393] T 86a6797bdfe94fa496c050ceae4bd0d9 P e5256d91808b47c195bc9b4dbd7f2b87 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0473d2b2d01f4459b1e90fd12cc7840e in current term 5: Already voted for candidate e5256d91808b47c195bc9b4dbd7f2b87 in this term.
I20260709 13:05:18.051208 21971 raft_consensus.cc:493] T 179fd671030940b4b4a4e24bcc4aba0a P e61c3a8f61bb48f8a963c9480e53c168 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:18.094182 21952 consensus_queue.cc:1048] T 309c3ca0ca4b4f3ba129752ea2cb293b P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Connected to new peer: Peer: permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.011s
I20260709 13:05:18.105597 21971 raft_consensus.cc:515] T 179fd671030940b4b4a4e24bcc4aba0a P e61c3a8f61bb48f8a963c9480e53c168 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
W20260709 13:05:18.106355 19374 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.4:43121, user_credentials={real_user=slave}} blocked reactor thread for 48717.2us
I20260709 13:05:18.107478 21962 consensus_queue.cc:1048] T 1f85fc4b527a48848e5faa083b604e36 P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Connected to new peer: Peer: permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:05:18.081764 21861 raft_consensus.cc:493] T b08304a0a02b42d7840c4e8ee9a6bd1a P 0473d2b2d01f4459b1e90fd12cc7840e [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:18.108359 21861 raft_consensus.cc:515] T b08304a0a02b42d7840c4e8ee9a6bd1a P 0473d2b2d01f4459b1e90fd12cc7840e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:18.109362 21962 raft_consensus.cc:493] T fa8650e71aa14778b3d73721fc50d9fc P e5256d91808b47c195bc9b4dbd7f2b87 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:18.109869 21962 raft_consensus.cc:515] T fa8650e71aa14778b3d73721fc50d9fc P e5256d91808b47c195bc9b4dbd7f2b87 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:18.051469 21969 raft_consensus.cc:493] T 309c3ca0ca4b4f3ba129752ea2cb293b P 0473d2b2d01f4459b1e90fd12cc7840e [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:18.111122 21969 raft_consensus.cc:515] T 309c3ca0ca4b4f3ba129752ea2cb293b P 0473d2b2d01f4459b1e90fd12cc7840e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } attrs { replace: true } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:05:18.112371 21849 raft_consensus.cc:493] T 14efcc79969f41babe5529c22d59156d P e5256d91808b47c195bc9b4dbd7f2b87 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:18.112905 21849 raft_consensus.cc:515] T 14efcc79969f41babe5529c22d59156d P e5256d91808b47c195bc9b4dbd7f2b87 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:05:18.107743 21853 raft_consensus.cc:3055] T 3e1f505cb0f1427bbd698ac889d80821 P e61c3a8f61bb48f8a963c9480e53c168 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:05:18.113714 21853 raft_consensus.cc:740] T 3e1f505cb0f1427bbd698ac889d80821 P e61c3a8f61bb48f8a963c9480e53c168 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: e61c3a8f61bb48f8a963c9480e53c168, State: Running, Role: LEADER
I20260709 13:05:18.031769 22040 raft_consensus.cc:515] T 14efcc79969f41babe5529c22d59156d P 127766fc592545a4997f7790f50f6076 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
W20260709 13:05:18.110390 21403 consensus_meta.cc:287] T 0afb57ae58a24a01850491d69f0213dd P 127766fc592545a4997f7790f50f6076: Time spent flushing consensus metadata: real 0.558s	user 0.008s	sys 0.003s
I20260709 13:05:18.122035 19403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f93ee515a9c14139bf566522ed8232f3" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 8 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:05:18.123030 19403 raft_consensus.cc:2393] T f93ee515a9c14139bf566522ed8232f3 P e5256d91808b47c195bc9b4dbd7f2b87 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0473d2b2d01f4459b1e90fd12cc7840e in current term 8: Already voted for candidate e5256d91808b47c195bc9b4dbd7f2b87 in this term.
I20260709 13:05:18.121520 19409 raft_consensus.cc:1275] T b9f0d59553ad444883fcf5b5909f9798 P e5256d91808b47c195bc9b4dbd7f2b87 [term 6 FOLLOWER]: Refusing update from remote peer e61c3a8f61bb48f8a963c9480e53c168: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:05:18.123245 20104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36f6ba92b9ba46babe4ebd6c02e5fbd9" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:05:18.165671 20104 raft_consensus.cc:2468] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P 127766fc592545a4997f7790f50f6076 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 7.
W20260709 13:05:18.167192 21684 consensus_meta.cc:287] T 2a16f7501e2444fb86d4e2778e734e02 P e61c3a8f61bb48f8a963c9480e53c168: Time spent flushing consensus metadata: real 0.659s	user 0.005s	sys 0.005s
I20260709 13:05:18.167718 21684 raft_consensus.cc:515] T 2a16f7501e2444fb86d4e2778e734e02 P e61c3a8f61bb48f8a963c9480e53c168 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:05:18.170063 21684 leader_election.cc:290] T 2a16f7501e2444fb86d4e2778e734e02 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 6 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:05:18.167194 21849 leader_election.cc:290] T 14efcc79969f41babe5529c22d59156d P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:05:18.171558 19560 raft_consensus.cc:3060] T 2a16f7501e2444fb86d4e2778e734e02 P e61c3a8f61bb48f8a963c9480e53c168 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:05:18.173141 21700 leader_election.cc:290] T 5ec1c4ce15e04c7e8c283a62179f2a64 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:05:18.089864 21976 consensus_queue.cc:1048] T fa8650e71aa14778b3d73721fc50d9fc P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.086s
I20260709 13:05:18.181244 21969 leader_election.cc:290] T 309c3ca0ca4b4f3ba129752ea2cb293b P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:05:18.094726 21966 raft_consensus.cc:493] T d1e5873a19244c5ebbcd38e126796ee7 P e5256d91808b47c195bc9b4dbd7f2b87 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:18.182291 21966 raft_consensus.cc:515] T d1e5873a19244c5ebbcd38e126796ee7 P e5256d91808b47c195bc9b4dbd7f2b87 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:18.183511 21403 raft_consensus.cc:515] T 0afb57ae58a24a01850491d69f0213dd P 127766fc592545a4997f7790f50f6076 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:05:18.184916 21966 leader_election.cc:290] T d1e5873a19244c5ebbcd38e126796ee7 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:05:18.187868 21986 leader_election.cc:290] T 14935b3ddf914369822e4a0547aaa355 P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:05:18.189718 22040 leader_election.cc:290] T 14efcc79969f41babe5529c22d59156d P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:05:18.086033 21980 raft_consensus.cc:493] T 70797e5783b5454ab0d0eea663e791e3 P e5256d91808b47c195bc9b4dbd7f2b87 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:18.190661 21980 raft_consensus.cc:515] T 70797e5783b5454ab0d0eea663e791e3 P e5256d91808b47c195bc9b4dbd7f2b87 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:05:18.193356 21980 leader_election.cc:290] T 70797e5783b5454ab0d0eea663e791e3 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:05:18.195393 21962 leader_election.cc:290] T fa8650e71aa14778b3d73721fc50d9fc P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:05:18.195812 21911 leader_election.cc:290] T 309c3ca0ca4b4f3ba129752ea2cb293b P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:05:18.196359 22049 raft_consensus.cc:493] T b9f0d59553ad444883fcf5b5909f9798 P e5256d91808b47c195bc9b4dbd7f2b87 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:18.093591 21916 raft_consensus.cc:515] T 217b5fae677b4971b3bbd2f357a1f7ff P e5256d91808b47c195bc9b4dbd7f2b87 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:18.196967 22049 raft_consensus.cc:515] T b9f0d59553ad444883fcf5b5909f9798 P e5256d91808b47c195bc9b4dbd7f2b87 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:18.198225 19411 raft_consensus.cc:2468] T 217b5fae677b4971b3bbd2f357a1f7ff P e5256d91808b47c195bc9b4dbd7f2b87 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 3.
I20260709 13:05:18.203172 19560 raft_consensus.cc:2468] T 2a16f7501e2444fb86d4e2778e734e02 P e61c3a8f61bb48f8a963c9480e53c168 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 127766fc592545a4997f7790f50f6076 in term 7.
I20260709 13:05:18.203712 19407 raft_consensus.cc:2468] T 2a16f7501e2444fb86d4e2778e734e02 P e5256d91808b47c195bc9b4dbd7f2b87 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 127766fc592545a4997f7790f50f6076 in term 7.
I20260709 13:05:18.225041 20107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70797e5783b5454ab0d0eea663e791e3" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:05:18.225185 19374 leader_election.cc:304] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 127766fc592545a4997f7790f50f6076, e5256d91808b47c195bc9b4dbd7f2b87; no voters: 
I20260709 13:05:18.225679 20107 raft_consensus.cc:2468] T 70797e5783b5454ab0d0eea663e791e3 P 127766fc592545a4997f7790f50f6076 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 6.
W20260709 13:05:18.267114 19452 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:18.279109 19407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86a6797bdfe94fa496c050ceae4bd0d9" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:05:18.280112 19407 raft_consensus.cc:2468] T 86a6797bdfe94fa496c050ceae4bd0d9 P e5256d91808b47c195bc9b4dbd7f2b87 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 5.
I20260709 13:05:18.110530 21861 leader_election.cc:290] T b08304a0a02b42d7840c4e8ee9a6bd1a P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
W20260709 13:05:18.284041 19374 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.4:43121, user_credentials={real_user=slave}} blocked reactor thread for 58947.6us
I20260709 13:05:18.286283 19374 leader_election.cc:304] T 70797e5783b5454ab0d0eea663e791e3 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 127766fc592545a4997f7790f50f6076, e5256d91808b47c195bc9b4dbd7f2b87; no voters: 
I20260709 13:05:18.283133 19449 leader_election.cc:304] T 0cdf56e38bbc453d9438d359e5a69955 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87; no voters: 
I20260709 13:05:18.226698 21849 raft_consensus.cc:493] T 309c3ca0ca4b4f3ba129752ea2cb293b P e5256d91808b47c195bc9b4dbd7f2b87 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:18.222190 21403 leader_election.cc:290] T 0afb57ae58a24a01850491d69f0213dd P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 7 election: Requested vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:05:18.303444 19409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b08304a0a02b42d7840c4e8ee9a6bd1a" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:05:18.245501 21911 raft_consensus.cc:493] T 70797e5783b5454ab0d0eea663e791e3 P 127766fc592545a4997f7790f50f6076 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader e5256d91808b47c195bc9b4dbd7f2b87)
I20260709 13:05:18.204337 21934 raft_consensus.cc:515] T 833a2f0775ed407a94b8924ce50adb63 P e61c3a8f61bb48f8a963c9480e53c168 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:05:18.114557 21853 consensus_queue.cc:260] T 3e1f505cb0f1427bbd698ac889d80821 P e61c3a8f61bb48f8a963c9480e53c168 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:18.054371 22027 raft_consensus.cc:515] T 7be9efa6559648dbb5a0f7684c4542d1 P e61c3a8f61bb48f8a963c9480e53c168 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } attrs { replace: true } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: NON_VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: true } }
I20260709 13:05:18.289482 21966 raft_consensus.cc:493] T b08304a0a02b42d7840c4e8ee9a6bd1a P e5256d91808b47c195bc9b4dbd7f2b87 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:05:18.339461 21767 consensus_meta.cc:287] T 1dc5b3532fe54f74876d02beffa2c230 P 0473d2b2d01f4459b1e90fd12cc7840e: Time spent flushing consensus metadata: real 0.504s	user 0.009s	sys 0.000s
I20260709 13:05:18.388240 20107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ec1c4ce15e04c7e8c283a62179f2a64" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:05:18.414179 21767 raft_consensus.cc:2749] T 1dc5b3532fe54f74876d02beffa2c230 P 0473d2b2d01f4459b1e90fd12cc7840e [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:05:18.352396 19403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "309c3ca0ca4b4f3ba129752ea2cb293b" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:05:18.291186 21700 raft_consensus.cc:493] T 21e14947d70440f19044d8f75c31e1f9 P 0473d2b2d01f4459b1e90fd12cc7840e [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:18.290167 22040 raft_consensus.cc:493] T 5ec1c4ce15e04c7e8c283a62179f2a64 P 127766fc592545a4997f7790f50f6076 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:18.289203 21980 raft_consensus.cc:2804] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P e5256d91808b47c195bc9b4dbd7f2b87 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:05:18.353875 19404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ec1c4ce15e04c7e8c283a62179f2a64" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:05:18.298511 21861 raft_consensus.cc:2804] T 0cdf56e38bbc453d9438d359e5a69955 P 0473d2b2d01f4459b1e90fd12cc7840e [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:05:18.338943 22007 raft_consensus.cc:493] T edd7d470b5014c9489be7f41f64355c9 P 0473d2b2d01f4459b1e90fd12cc7840e [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:18.290135 20104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14efcc79969f41babe5529c22d59156d" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:05:18.432824 19559 raft_consensus.cc:1240] T 833a2f0775ed407a94b8924ce50adb63 P e61c3a8f61bb48f8a963c9480e53c168 [term 5 FOLLOWER]: Rejecting Update request from peer 127766fc592545a4997f7790f50f6076 for earlier term 4. Current term is 5. Ops: []
I20260709 13:05:18.421766 20075 leader_election.cc:304] T 2a16f7501e2444fb86d4e2778e734e02 P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 127766fc592545a4997f7790f50f6076, e5256d91808b47c195bc9b4dbd7f2b87; no voters: 
W20260709 13:05:18.359818 22042 log.cc:927] Time spent T 76cb037fc9064d13b59a8969d897ce8c P e61c3a8f61bb48f8a963c9480e53c168: Append to log took a long time: real 0.072s	user 0.000s	sys 0.000s
I20260709 13:05:18.286163 21932 consensus_queue.cc:237] T 96efeaaf1057492490e9a621f37e1a2d P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:05:18.305133 21931 raft_consensus.cc:493] T f93ee515a9c14139bf566522ed8232f3 P e61c3a8f61bb48f8a963c9480e53c168 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:18.424811 21968 raft_consensus.cc:493] T 7be9efa6559648dbb5a0f7684c4542d1 P 0473d2b2d01f4459b1e90fd12cc7840e [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:18.389180 20109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "309c3ca0ca4b4f3ba129752ea2cb293b" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:05:18.305389 21941 raft_consensus.cc:493] T e381f1d6b8184797ad142de49be225a8 P e61c3a8f61bb48f8a963c9480e53c168 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:18.320734 21684 raft_consensus.cc:493] T b08304a0a02b42d7840c4e8ee9a6bd1a P e61c3a8f61bb48f8a963c9480e53c168 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:18.323004 22048 raft_consensus.cc:2804] T 70797e5783b5454ab0d0eea663e791e3 P e5256d91808b47c195bc9b4dbd7f2b87 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:05:18.454262 20109 raft_consensus.cc:2468] T 309c3ca0ca4b4f3ba129752ea2cb293b P 127766fc592545a4997f7790f50f6076 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 6.
I20260709 13:05:18.431361 22055 raft_consensus.cc:493] T 21e14947d70440f19044d8f75c31e1f9 P e61c3a8f61bb48f8a963c9480e53c168 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 0473d2b2d01f4459b1e90fd12cc7840e)
I20260709 13:05:18.449620 19485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86a6797bdfe94fa496c050ceae4bd0d9" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:05:18.427572 21980 raft_consensus.cc:493] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P e5256d91808b47c195bc9b4dbd7f2b87 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 127766fc592545a4997f7790f50f6076)
I20260709 13:05:18.459510 19479 raft_consensus.cc:1275] T b9f0d59553ad444883fcf5b5909f9798 P 0473d2b2d01f4459b1e90fd12cc7840e [term 6 FOLLOWER]: Refusing update from remote peer e61c3a8f61bb48f8a963c9480e53c168: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:05:18.437417 19478 raft_consensus.cc:1275] T 309c3ca0ca4b4f3ba129752ea2cb293b P 0473d2b2d01f4459b1e90fd12cc7840e [term 6 FOLLOWER]: Refusing update from remote peer e61c3a8f61bb48f8a963c9480e53c168: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:05:18.428408 19404 raft_consensus.cc:2393] T 5ec1c4ce15e04c7e8c283a62179f2a64 P e5256d91808b47c195bc9b4dbd7f2b87 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0473d2b2d01f4459b1e90fd12cc7840e in current term 4: Already voted for candidate e5256d91808b47c195bc9b4dbd7f2b87 in this term.
I20260709 13:05:18.430699 21861 raft_consensus.cc:493] T 0cdf56e38bbc453d9438d359e5a69955 P 0473d2b2d01f4459b1e90fd12cc7840e [term 7 FOLLOWER]: Starting leader election (detected failure of leader e61c3a8f61bb48f8a963c9480e53c168)
I20260709 13:05:18.444420 21962 raft_consensus.cc:493] T ece3db938bc649d4a40a51522ed5259c P e5256d91808b47c195bc9b4dbd7f2b87 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 127766fc592545a4997f7790f50f6076)
I20260709 13:05:18.449721 20104 raft_consensus.cc:2468] T 14efcc79969f41babe5529c22d59156d P 127766fc592545a4997f7790f50f6076 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 4.
I20260709 13:05:18.464342 21684 raft_consensus.cc:515] T b08304a0a02b42d7840c4e8ee9a6bd1a P e61c3a8f61bb48f8a963c9480e53c168 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:18.454492 22049 leader_election.cc:290] T b9f0d59553ad444883fcf5b5909f9798 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:05:18.487879 21859 leader_election.cc:290] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:05:18.462162 22048 raft_consensus.cc:493] T 70797e5783b5454ab0d0eea663e791e3 P e5256d91808b47c195bc9b4dbd7f2b87 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:18.425051 21966 raft_consensus.cc:515] T b08304a0a02b42d7840c4e8ee9a6bd1a P e5256d91808b47c195bc9b4dbd7f2b87 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:18.426564 21892 consensus_queue.cc:1048] T 833a2f0775ed407a94b8924ce50adb63 P 127766fc592545a4997f7790f50f6076 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.032s
I20260709 13:05:18.492591 19485 raft_consensus.cc:2468] T 86a6797bdfe94fa496c050ceae4bd0d9 P 0473d2b2d01f4459b1e90fd12cc7840e [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 4.
W20260709 13:05:18.478323 19525 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.521s	user 0.021s	sys 0.034s
W20260709 13:05:18.576040 19525 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.746s	user 0.022s	sys 0.034s
W20260709 13:05:18.505558 21926 consensus_meta.cc:287] T 1dc5b3532fe54f74876d02beffa2c230 P e5256d91808b47c195bc9b4dbd7f2b87: Time spent flushing consensus metadata: real 0.838s	user 0.011s	sys 0.000s
I20260709 13:05:18.427740 21700 raft_consensus.cc:515] T 21e14947d70440f19044d8f75c31e1f9 P 0473d2b2d01f4459b1e90fd12cc7840e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:18.312604 21849 raft_consensus.cc:515] T 309c3ca0ca4b4f3ba129752ea2cb293b P e5256d91808b47c195bc9b4dbd7f2b87 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } attrs { replace: true } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:05:18.444234 22056 raft_consensus.cc:2804] T 2a16f7501e2444fb86d4e2778e734e02 P 127766fc592545a4997f7790f50f6076 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:05:18.460980 21853 raft_consensus.cc:3060] T 3e1f505cb0f1427bbd698ac889d80821 P e61c3a8f61bb48f8a963c9480e53c168 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:05:18.339107 21911 raft_consensus.cc:515] T 70797e5783b5454ab0d0eea663e791e3 P 127766fc592545a4997f7790f50f6076 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:05:18.462643 21941 raft_consensus.cc:515] T e381f1d6b8184797ad142de49be225a8 P e61c3a8f61bb48f8a963c9480e53c168 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:18.430501 22040 raft_consensus.cc:515] T 5ec1c4ce15e04c7e8c283a62179f2a64 P 127766fc592545a4997f7790f50f6076 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:05:18.444748 22007 raft_consensus.cc:515] T edd7d470b5014c9489be7f41f64355c9 P 0473d2b2d01f4459b1e90fd12cc7840e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:18.503650 21980 raft_consensus.cc:3060] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P e5256d91808b47c195bc9b4dbd7f2b87 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:05:18.457443 21767 raft_consensus.cc:493] T 14efcc79969f41babe5529c22d59156d P 0473d2b2d01f4459b1e90fd12cc7840e [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:18.514283 21861 raft_consensus.cc:3060] T 0cdf56e38bbc453d9438d359e5a69955 P 0473d2b2d01f4459b1e90fd12cc7840e [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:05:18.461253 21931 raft_consensus.cc:515] T f93ee515a9c14139bf566522ed8232f3 P e61c3a8f61bb48f8a963c9480e53c168 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:18.620186 19409 raft_consensus.cc:2468] T b08304a0a02b42d7840c4e8ee9a6bd1a P e5256d91808b47c195bc9b4dbd7f2b87 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 6.
I20260709 13:05:18.582787 22049 raft_consensus.cc:493] T f1b10566f45d4a7d9029858330e02d5b P e5256d91808b47c195bc9b4dbd7f2b87 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:05:18.612704 22051 log.cc:927] Time spent T e381f1d6b8184797ad142de49be225a8 P e5256d91808b47c195bc9b4dbd7f2b87: Append to log took a long time: real 0.093s	user 0.001s	sys 0.000s
I20260709 13:05:18.666836 22054 raft_consensus.cc:493] T 48824d5acfbc485ebf8c2d944e7202de P e61c3a8f61bb48f8a963c9480e53c168 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 0473d2b2d01f4459b1e90fd12cc7840e)
I20260709 13:05:18.583552 22048 raft_consensus.cc:3060] T 70797e5783b5454ab0d0eea663e791e3 P e5256d91808b47c195bc9b4dbd7f2b87 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:05:18.664335 21935 raft_consensus.cc:493] T d1e5873a19244c5ebbcd38e126796ee7 P e61c3a8f61bb48f8a963c9480e53c168 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:18.665500 19402 raft_consensus.cc:1275] T 309c3ca0ca4b4f3ba129752ea2cb293b P e5256d91808b47c195bc9b4dbd7f2b87 [term 6 FOLLOWER]: Refusing update from remote peer e61c3a8f61bb48f8a963c9480e53c168: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
W20260709 13:05:18.621548 21936 consensus_meta.cc:287] T 0afb57ae58a24a01850491d69f0213dd P e61c3a8f61bb48f8a963c9480e53c168: Time spent flushing consensus metadata: real 0.696s	user 0.009s	sys 0.001s
I20260709 13:05:18.550557 21962 raft_consensus.cc:515] T ece3db938bc649d4a40a51522ed5259c P e5256d91808b47c195bc9b4dbd7f2b87 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:05:18.693766 20107 raft_consensus.cc:2468] T 5ec1c4ce15e04c7e8c283a62179f2a64 P 127766fc592545a4997f7790f50f6076 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 4.
I20260709 13:05:18.463140 21968 raft_consensus.cc:515] T 7be9efa6559648dbb5a0f7684c4542d1 P 0473d2b2d01f4459b1e90fd12cc7840e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } attrs { replace: true } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: NON_VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: true } }
I20260709 13:05:18.630692 22056 raft_consensus.cc:697] T 2a16f7501e2444fb86d4e2778e734e02 P 127766fc592545a4997f7790f50f6076 [term 7 LEADER]: Becoming Leader. State: Replica: 127766fc592545a4997f7790f50f6076, State: Running, Role: LEADER
I20260709 13:05:18.691263 21767 raft_consensus.cc:515] T 14efcc79969f41babe5529c22d59156d P 0473d2b2d01f4459b1e90fd12cc7840e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:05:18.947942 19411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14935b3ddf914369822e4a0547aaa355" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:05:18.948235 21958 raft_consensus.cc:493] T 21e14947d70440f19044d8f75c31e1f9 P e5256d91808b47c195bc9b4dbd7f2b87 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:18.948956 19411 raft_consensus.cc:2468] T 14935b3ddf914369822e4a0547aaa355 P e5256d91808b47c195bc9b4dbd7f2b87 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 127766fc592545a4997f7790f50f6076 in term 5.
I20260709 13:05:18.948927 21958 raft_consensus.cc:515] T 21e14947d70440f19044d8f75c31e1f9 P e5256d91808b47c195bc9b4dbd7f2b87 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:18.949980 21767 leader_election.cc:290] T 14efcc79969f41babe5529c22d59156d P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:05:18.769035 21926 raft_consensus.cc:493] T 28af091831594f9d8e96482078cc7625 P e5256d91808b47c195bc9b4dbd7f2b87 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 0473d2b2d01f4459b1e90fd12cc7840e)
I20260709 13:05:18.885411 19403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14efcc79969f41babe5529c22d59156d" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:05:18.952630 19403 raft_consensus.cc:2468] T 14efcc79969f41babe5529c22d59156d P e5256d91808b47c195bc9b4dbd7f2b87 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 127766fc592545a4997f7790f50f6076 in term 5.
I20260709 13:05:18.954041 21916 leader_election.cc:290] T 217b5fae677b4971b3bbd2f357a1f7ff P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:05:18.686793 21559 raft_consensus.cc:493] T 1dc5b3532fe54f74876d02beffa2c230 P e61c3a8f61bb48f8a963c9480e53c168 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:18.955072 21559 raft_consensus.cc:515] T 1dc5b3532fe54f74876d02beffa2c230 P e61c3a8f61bb48f8a963c9480e53c168 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:18.957590 21559 leader_election.cc:290] T 1dc5b3532fe54f74876d02beffa2c230 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:05:18.972460 19410 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52342 (request call id 1954) took 1267 ms. Trace:
I20260709 13:05:18.761830 21929 raft_consensus.cc:493] T 46c5bfeecc314717bffe987e6844b6d0 P e5256d91808b47c195bc9b4dbd7f2b87 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:18.972831 19410 rpcz_store.cc:276] 0709 13:05:17.705038 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:17.705175 (+   137us) service_pool.cc:224] Handling call
0709 13:05:17.779487 (+ 74312us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:05:17.785987 (+  6500us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:05:17.786028 (+    41us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:05:17.801096 (+ 15068us) log.cc:844] Serialized 26 byte log entry
0709 13:05:18.121377 (+320281us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:05:18.121419 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:18.121490 (+    71us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:05:18.972276 (+850786us) raft_consensus.cc:1685] finished
0709 13:05:18.972295 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:18.972407 (+   112us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":6049,"raft.queue_time_us":11020,"raft.run_cpu_time_us":130,"raft.run_wall_time_us":16085,"thread_start_us":278436,"threads_started":1,"wal-append.queue_time_us":551879}
I20260709 13:05:18.728394 22049 raft_consensus.cc:515] T f1b10566f45d4a7d9029858330e02d5b P e5256d91808b47c195bc9b4dbd7f2b87 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:18.756526 21957 raft_consensus.cc:3055] T 2725d2c4cb054f18b0fc8f735c15f6c2 P e5256d91808b47c195bc9b4dbd7f2b87 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:05:18.960675 21935 raft_consensus.cc:515] T d1e5873a19244c5ebbcd38e126796ee7 P e61c3a8f61bb48f8a963c9480e53c168 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:19.018760 19405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "309c3ca0ca4b4f3ba129752ea2cb293b" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:05:18.504860 22055 raft_consensus.cc:515] T 21e14947d70440f19044d8f75c31e1f9 P e61c3a8f61bb48f8a963c9480e53c168 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:18.971036 21952 raft_consensus.cc:493] T 0e1085d23e8347fbbd5bce7542f4b1f4 P e61c3a8f61bb48f8a963c9480e53c168 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 127766fc592545a4997f7790f50f6076)
I20260709 13:05:18.805810 21992 leader_election.cc:290] T 46c5bfeecc314717bffe987e6844b6d0 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:05:19.025558 21790 raft_consensus.cc:3060] T 2e36a9d6e29c4a7c860cf267efbd4c74 P 0473d2b2d01f4459b1e90fd12cc7840e [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:05:19.025475 21952 raft_consensus.cc:515] T 0e1085d23e8347fbbd5bce7542f4b1f4 P e61c3a8f61bb48f8a963c9480e53c168 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:05:19.026918 19555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "217b5fae677b4971b3bbd2f357a1f7ff" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:05:19.027546 19555 raft_consensus.cc:2468] T 217b5fae677b4971b3bbd2f357a1f7ff P e61c3a8f61bb48f8a963c9480e53c168 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 2.
I20260709 13:05:19.027734 21952 leader_election.cc:290] T 0e1085d23e8347fbbd5bce7542f4b1f4 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:05:18.975557 21529 raft_consensus.cc:493] T 1a61655d99124a29b486ba4a5b37faea P e61c3a8f61bb48f8a963c9480e53c168 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 0473d2b2d01f4459b1e90fd12cc7840e)
I20260709 13:05:19.028569 21529 raft_consensus.cc:515] T 1a61655d99124a29b486ba4a5b37faea P e61c3a8f61bb48f8a963c9480e53c168 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:18.806537 21861 raft_consensus.cc:515] T 0cdf56e38bbc453d9438d359e5a69955 P 0473d2b2d01f4459b1e90fd12cc7840e [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
W20260709 13:05:19.031298 22060 log.cc:927] Time spent T 22196caba61445d3bec98a0aab3c337d P 0473d2b2d01f4459b1e90fd12cc7840e: Append to log took a long time: real 0.282s	user 0.007s	sys 0.000s
I20260709 13:05:19.031203 21980 raft_consensus.cc:515] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P e5256d91808b47c195bc9b4dbd7f2b87 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:05:19.032279 21861 leader_election.cc:290] T 0cdf56e38bbc453d9438d359e5a69955 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 8 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:05:18.975867 21958 leader_election.cc:290] T 21e14947d70440f19044d8f75c31e1f9 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:05:18.976177 19553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa8650e71aa14778b3d73721fc50d9fc" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:05:18.976853 21971 leader_election.cc:290] T 179fd671030940b4b4a4e24bcc4aba0a P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:05:19.030659 21529 leader_election.cc:290] T 1a61655d99124a29b486ba4a5b37faea P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:05:18.324649 18300 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:05:19.043524 19306 catalog_manager.cc:5697] T 46c5bfeecc314717bffe987e6844b6d0 P 0473d2b2d01f4459b1e90fd12cc7840e reported cstate change: term changed from 5 to 9. New cstate: current_term: 9 leader_uuid: "e61c3a8f61bb48f8a963c9480e53c168" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } }
W20260709 13:05:19.044795 21963 consensus_meta.cc:287] T 14935b3ddf914369822e4a0547aaa355 P 0473d2b2d01f4459b1e90fd12cc7840e: Time spent flushing consensus metadata: real 0.922s	user 0.008s	sys 0.000s
I20260709 13:05:19.045215 21963 raft_consensus.cc:515] T 14935b3ddf914369822e4a0547aaa355 P 0473d2b2d01f4459b1e90fd12cc7840e [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } attrs { replace: true } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:05:19.045125 19306 catalog_manager.cc:5697] T 21e14947d70440f19044d8f75c31e1f9 P 0473d2b2d01f4459b1e90fd12cc7840e reported cstate change: term changed from 2 to 5, leader changed from e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1) to 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2). New cstate: current_term: 5 leader_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } health_report { overall_health: HEALTHY } } }
I20260709 13:05:18.977808 21767 raft_consensus.cc:493] T 46c5bfeecc314717bffe987e6844b6d0 P 0473d2b2d01f4459b1e90fd12cc7840e [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:18.978389 19560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e5873a19244c5ebbcd38e126796ee7" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:05:18.978849 21968 leader_election.cc:290] T 7be9efa6559648dbb5a0f7684c4542d1 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:05:18.978991 19559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70797e5783b5454ab0d0eea663e791e3" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:05:18.979905 19552 raft_consensus.cc:1240] T 2725d2c4cb054f18b0fc8f735c15f6c2 P e61c3a8f61bb48f8a963c9480e53c168 [term 7 FOLLOWER]: Rejecting Update request from peer e5256d91808b47c195bc9b4dbd7f2b87 for earlier term 6. Current term is 7. Ops: [6.4-6.4]
I20260709 13:05:18.980034 21849 leader_election.cc:290] T 309c3ca0ca4b4f3ba129752ea2cb293b P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:05:18.979529 22056 consensus_queue.cc:237] T 2a16f7501e2444fb86d4e2778e734e02 P 127766fc592545a4997f7790f50f6076 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:05:18.980870 21931 leader_election.cc:290] T f93ee515a9c14139bf566522ed8232f3 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:05:18.983251 21858 raft_consensus.cc:493] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P 0473d2b2d01f4459b1e90fd12cc7840e [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:18.984234 21918 raft_consensus.cc:493] T 22196caba61445d3bec98a0aab3c337d P e5256d91808b47c195bc9b4dbd7f2b87 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:18.985832 21969 raft_consensus.cc:493] T 2b74109013a140ada21feeef92d6f563 P 0473d2b2d01f4459b1e90fd12cc7840e [term 3 FOLLOWER]: Starting pre-election (detected failure of leader e5256d91808b47c195bc9b4dbd7f2b87)
I20260709 13:05:18.987860 22057 raft_consensus.cc:493] T 48824d5acfbc485ebf8c2d944e7202de P 0473d2b2d01f4459b1e90fd12cc7840e [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:18.967818 21936 raft_consensus.cc:515] T 0afb57ae58a24a01850491d69f0213dd P e61c3a8f61bb48f8a963c9480e53c168 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
W20260709 13:05:18.962359 21894 consensus_meta.cc:287] T 96efeaaf1057492490e9a621f37e1a2d P 127766fc592545a4997f7790f50f6076: Time spent flushing consensus metadata: real 0.984s	user 0.012s	sys 0.008s
I20260709 13:05:19.004918 19403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "179fd671030940b4b4a4e24bcc4aba0a" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:05:19.006815 19411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a16f7501e2444fb86d4e2778e734e02" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
I20260709 13:05:19.008004 19554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9f0d59553ad444883fcf5b5909f9798" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:05:19.094065 19411 raft_consensus.cc:2368] T 2a16f7501e2444fb86d4e2778e734e02 P e5256d91808b47c195bc9b4dbd7f2b87 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate e61c3a8f61bb48f8a963c9480e53c168 for earlier term 6. Current term is 7.
I20260709 13:05:19.014779 21929 raft_consensus.cc:515] T 46c5bfeecc314717bffe987e6844b6d0 P e5256d91808b47c195bc9b4dbd7f2b87 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:19.015532 21916 raft_consensus.cc:493] T 5ec1c4ce15e04c7e8c283a62179f2a64 P e5256d91808b47c195bc9b4dbd7f2b87 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:18.951777 21970 raft_consensus.cc:493] T 22196caba61445d3bec98a0aab3c337d P e61c3a8f61bb48f8a963c9480e53c168 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:05:18.868018 19526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.2:46257, user_credentials={real_user=slave}} blocked reactor thread for 61980.1us
I20260709 13:05:18.968315 22054 raft_consensus.cc:515] T 48824d5acfbc485ebf8c2d944e7202de P e61c3a8f61bb48f8a963c9480e53c168 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:05:19.024840 22055 leader_election.cc:290] T 21e14947d70440f19044d8f75c31e1f9 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:05:19.077682 21767 raft_consensus.cc:515] T 46c5bfeecc314717bffe987e6844b6d0 P 0473d2b2d01f4459b1e90fd12cc7840e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:19.091259 21858 raft_consensus.cc:515] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P 0473d2b2d01f4459b1e90fd12cc7840e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:05:19.166693 20112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "833a2f0775ed407a94b8924ce50adb63" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076"
I20260709 13:05:19.161696 20103 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35874 (request call id 487) took 1046 ms. Trace:
I20260709 13:05:19.167023 20104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a16f7501e2444fb86d4e2778e734e02" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076"
I20260709 13:05:19.169483 19406 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52342 (request call id 1955) took 1159 ms. Trace:
I20260709 13:05:18.747555 21934 leader_election.cc:290] T 833a2f0775ed407a94b8924ce50adb63 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 5 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:05:19.186789 21858 leader_election.cc:290] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:05:19.047542 19556 raft_consensus.cc:1275] T bc225c93219c45538b53a1bd3d387e4d P e61c3a8f61bb48f8a963c9480e53c168 [term 8 FOLLOWER]: Refusing update from remote peer e5256d91808b47c195bc9b4dbd7f2b87: Log matching property violated. Preceding OpId in replica: term: 6 index: 3. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:05:19.069558 19559 raft_consensus.cc:2468] T 70797e5783b5454ab0d0eea663e791e3 P e61c3a8f61bb48f8a963c9480e53c168 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 7.
I20260709 13:05:19.187819 21958 raft_consensus.cc:493] T 4509b76741dc428e9201c70c1658da13 P e5256d91808b47c195bc9b4dbd7f2b87 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e61c3a8f61bb48f8a963c9480e53c168)
I20260709 13:05:19.018052 21867 raft_consensus.cc:493] T df751f992649444090e27965eb1af85d P e5256d91808b47c195bc9b4dbd7f2b87 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:19.188342 21958 raft_consensus.cc:515] T 4509b76741dc428e9201c70c1658da13 P e5256d91808b47c195bc9b4dbd7f2b87 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:19.188536 21867 raft_consensus.cc:515] T df751f992649444090e27965eb1af85d P e5256d91808b47c195bc9b4dbd7f2b87 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:19.127982 21992 raft_consensus.cc:493] T 62c6c134d3d24a1ab144dd9ee6bc3f64 P e61c3a8f61bb48f8a963c9480e53c168 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 127766fc592545a4997f7790f50f6076)
I20260709 13:05:19.190325 21958 leader_election.cc:290] T 4509b76741dc428e9201c70c1658da13 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:05:19.081398 19560 raft_consensus.cc:2468] T d1e5873a19244c5ebbcd38e126796ee7 P e61c3a8f61bb48f8a963c9480e53c168 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 7.
I20260709 13:05:19.153366 21911 leader_election.cc:290] T 70797e5783b5454ab0d0eea663e791e3 P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:05:19.190940 22063 raft_consensus.cc:493] T 7be9efa6559648dbb5a0f7684c4542d1 P e5256d91808b47c195bc9b4dbd7f2b87 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:19.191414 22063 raft_consensus.cc:515] T 7be9efa6559648dbb5a0f7684c4542d1 P e5256d91808b47c195bc9b4dbd7f2b87 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:19.048033 22053 raft_consensus.cc:493] T 14935b3ddf914369822e4a0547aaa355 P e61c3a8f61bb48f8a963c9480e53c168 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader e5256d91808b47c195bc9b4dbd7f2b87)
W20260709 13:05:19.058091 21956 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.571s	user 0.029s	sys 0.045s
I20260709 13:05:19.088016 19553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "309c3ca0ca4b4f3ba129752ea2cb293b" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:05:19.090819 21918 raft_consensus.cc:515] T 22196caba61445d3bec98a0aab3c337d P e5256d91808b47c195bc9b4dbd7f2b87 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
W20260709 13:05:19.211325 20078 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.17.223.2:46257 timed out after 1.651s (SENT) [suppressed 36 similar messages]
I20260709 13:05:19.187244 19406 rpcz_store.cc:276] 0709 13:05:18.010489 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:18.012271 (+  1782us) service_pool.cc:224] Handling call
0709 13:05:18.012587 (+   316us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:05:18.012925 (+   338us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:05:18.012962 (+    37us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:05:18.051357 (+ 38395us) log.cc:844] Serialized 26 byte log entry
0709 13:05:18.504668 (+453311us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:05:18.504705 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:18.504765 (+    60us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:05:19.169220 (+664455us) raft_consensus.cc:1685] finished
0709 13:05:19.169251 (+    31us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:19.169417 (+   166us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":31694,"raft.queue_time_us":538,"raft.run_cpu_time_us":128,"raft.run_wall_time_us":14125,"thread_start_us":339055,"threads_started":1,"wal-append.queue_time_us":1052730}
W20260709 13:05:19.089222 19377 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.716s	user 0.016s	sys 0.051s
I20260709 13:05:19.022332 21957 raft_consensus.cc:740] T 2725d2c4cb054f18b0fc8f735c15f6c2 P e5256d91808b47c195bc9b4dbd7f2b87 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: e5256d91808b47c195bc9b4dbd7f2b87, State: Running, Role: LEADER
I20260709 13:05:19.090902 19523 leader_election.cc:304] T 86a6797bdfe94fa496c050ceae4bd0d9 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:05:19.048655 19306 catalog_manager.cc:5697] T 2e36a9d6e29c4a7c860cf267efbd4c74 P 0473d2b2d01f4459b1e90fd12cc7840e reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } health_report { overall_health: UNKNOWN } } }
W20260709 13:05:19.252863 20109 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.638s	user 0.001s	sys 0.013s
W20260709 13:05:19.073066 21932 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.592s	user 0.028s	sys 0.060s
I20260709 13:05:18.968526 21926 raft_consensus.cc:515] T 28af091831594f9d8e96482078cc7625 P e5256d91808b47c195bc9b4dbd7f2b87 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:19.097535 19411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36f6ba92b9ba46babe4ebd6c02e5fbd9" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:05:19.138589 19402 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52328 (request call id 1541) took 1034 ms. Trace:
I20260709 13:05:19.141146 19480 raft_consensus.cc:1275] T a08760e15aac4630a629431f56024dc8 P 0473d2b2d01f4459b1e90fd12cc7840e [term 6 FOLLOWER]: Refusing update from remote peer e61c3a8f61bb48f8a963c9480e53c168: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:05:19.077498 21529 raft_consensus.cc:493] T ef32ce6fdd0e40d382c79974f30295c6 P e61c3a8f61bb48f8a963c9480e53c168 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:19.017975 21892 consensus_queue.cc:1059] T 833a2f0775ed407a94b8924ce50adb63 P 127766fc592545a4997f7790f50f6076 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.073s
I20260709 13:05:19.090250 21952 consensus_queue.cc:1048] T a08760e15aac4630a629431f56024dc8 P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.068s
I20260709 13:05:19.159644 21963 leader_election.cc:290] T 14935b3ddf914369822e4a0547aaa355 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 5 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:05:19.086150 21853 raft_consensus.cc:493] T f1b10566f45d4a7d9029858330e02d5b P e61c3a8f61bb48f8a963c9480e53c168 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 0473d2b2d01f4459b1e90fd12cc7840e)
I20260709 13:05:19.096196 21931 consensus_queue.cc:1048] T b9f0d59553ad444883fcf5b5909f9798 P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.065s
I20260709 13:05:19.167032 20111 raft_consensus.cc:1275] T 65d8cb8d6ec64f459d5a47cefab10acf P 127766fc592545a4997f7790f50f6076 [term 3 FOLLOWER]: Refusing update from remote peer e61c3a8f61bb48f8a963c9480e53c168: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:05:19.171890 19408 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52328 (request call id 1540) took 1069 ms. Trace:
I20260709 13:05:19.048436 19478 raft_consensus.cc:1240] T 0cdf56e38bbc453d9438d359e5a69955 P 0473d2b2d01f4459b1e90fd12cc7840e [term 8 FOLLOWER]: Rejecting Update request from peer e61c3a8f61bb48f8a963c9480e53c168 for earlier term 7. Current term is 8. Ops: []
W20260709 13:05:19.065917 19375 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.3:36891, user_credentials={real_user=slave}} blocked reactor thread for 51834.3us
I20260709 13:05:18.971248 21833 raft_consensus.cc:493] T df751f992649444090e27965eb1af85d P e61c3a8f61bb48f8a963c9480e53c168 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:19.190030 21992 raft_consensus.cc:515] T 62c6c134d3d24a1ab144dd9ee6bc3f64 P e61c3a8f61bb48f8a963c9480e53c168 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:05:19.011782 22027 leader_election.cc:290] T 7be9efa6559648dbb5a0f7684c4542d1 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
W20260709 13:05:19.163160 19309 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:44676 (request call id 220) took 15760 ms (client timeout 15000 ms). Trace:
I20260709 13:05:19.184836 19552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21e14947d70440f19044d8f75c31e1f9" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
W20260709 13:05:19.178231 19450 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.307s	user 0.008s	sys 0.023s
I20260709 13:05:19.033242 21980 leader_election.cc:290] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 7 election: Requested vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:05:19.161015 21684 leader_election.cc:290] T b08304a0a02b42d7840c4e8ee9a6bd1a P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:05:19.128278 21559 raft_consensus.cc:493] T fa731b585f684a7fb2d106c50f143b83 P e61c3a8f61bb48f8a963c9480e53c168 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 127766fc592545a4997f7790f50f6076)
W20260709 13:05:19.294793 20109 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.680s	user 0.009s	sys 0.015s
I20260709 13:05:19.305032 19411 raft_consensus.cc:2468] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P e5256d91808b47c195bc9b4dbd7f2b87 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 127766fc592545a4997f7790f50f6076 in term 7.
W20260709 13:05:19.307852 19483 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.641s	user 0.000s	sys 0.022s
W20260709 13:05:19.358858 19483 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.692s	user 0.000s	sys 0.022s
I20260709 13:05:19.358932 19411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ec1c4ce15e04c7e8c283a62179f2a64" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:05:19.294813 19306 catalog_manager.cc:5697] T d1e5873a19244c5ebbcd38e126796ee7 P 0473d2b2d01f4459b1e90fd12cc7840e reported cstate change: term changed from 4 to 6, leader changed from e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3) to 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2). New cstate: current_term: 6 leader_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } health_report { overall_health: HEALTHY } } }
I20260709 13:05:19.090833 21969 raft_consensus.cc:515] T 2b74109013a140ada21feeef92d6f563 P 0473d2b2d01f4459b1e90fd12cc7840e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:19.166925 21700 leader_election.cc:290] T 21e14947d70440f19044d8f75c31e1f9 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:05:19.305176 19402 rpcz_store.cc:276] 0709 13:05:18.105002 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:18.282120 (+177118us) service_pool.cc:224] Handling call
0709 13:05:18.282438 (+   318us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:18.951010 (+668572us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:19.138237 (+187227us) spinlock_profiling.cc:243] Waited 375 ms on lock 0x7b5400182754. stack: 00007f4a79de9343 00007f4a79de9240 00007f4a797781d4 00007f4a834b6304 00007f4a834b6299 00007f4a7ce71571 00007f4a7cf08e01 00007f4a7cf0783e 00007f4a81ecc419 00007f4a7b443bd4 00007f4a7b443b62 00007f4a7b443a91 00007f4a7b443a0c 00007f4a7b442cc2 00007f4a7b24348c 00007f4a7b2428c6
0709 13:05:19.138497 (+   260us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":862429952}
I20260709 13:05:19.369832 19402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46c5bfeecc314717bffe987e6844b6d0" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 11 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:05:19.316056 21867 leader_election.cc:290] T df751f992649444090e27965eb1af85d P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:05:19.370707 19402 raft_consensus.cc:2468] T 46c5bfeecc314717bffe987e6844b6d0 P e5256d91808b47c195bc9b4dbd7f2b87 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 10.
W20260709 13:05:19.228782 21956 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.738s	user 0.030s	sys 0.045s
W20260709 13:05:19.294080 21731 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.527s	user 0.005s	sys 0.022s
W20260709 13:05:19.302958 19377 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.929s	user 0.019s	sys 0.051s
I20260709 13:05:19.153359 21976 raft_consensus.cc:493] T 2e36a9d6e29c4a7c860cf267efbd4c74 P e61c3a8f61bb48f8a963c9480e53c168 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 0473d2b2d01f4459b1e90fd12cc7840e)
I20260709 13:05:19.194636 22007 leader_election.cc:290] T edd7d470b5014c9489be7f41f64355c9 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
W20260709 13:05:19.306833 19451 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.707s	user 0.014s	sys 0.007s
W20260709 13:05:19.410621 19451 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.828s	user 0.014s	sys 0.010s
I20260709 13:05:19.225301 21966 leader_election.cc:290] T b08304a0a02b42d7840c4e8ee9a6bd1a P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:05:19.184480 21929 leader_election.cc:290] T 46c5bfeecc314717bffe987e6844b6d0 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:05:19.229373 21934 raft_consensus.cc:493] T 2b74109013a140ada21feeef92d6f563 P e61c3a8f61bb48f8a963c9480e53c168 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader e5256d91808b47c195bc9b4dbd7f2b87)
I20260709 13:05:19.226326 21941 leader_election.cc:290] T e381f1d6b8184797ad142de49be225a8 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:05:19.496438 21941 raft_consensus.cc:2804] T 86a6797bdfe94fa496c050ceae4bd0d9 P e61c3a8f61bb48f8a963c9480e53c168 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:05:19.496831 21941 raft_consensus.cc:493] T 86a6797bdfe94fa496c050ceae4bd0d9 P e61c3a8f61bb48f8a963c9480e53c168 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:19.497159 21941 raft_consensus.cc:3060] T 86a6797bdfe94fa496c050ceae4bd0d9 P e61c3a8f61bb48f8a963c9480e53c168 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:05:19.180569 22049 leader_election.cc:290] T f1b10566f45d4a7d9029858330e02d5b P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:05:19.293226 22055 raft_consensus.cc:493] T 76cb037fc9064d13b59a8969d897ce8c P e61c3a8f61bb48f8a963c9480e53c168 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader e5256d91808b47c195bc9b4dbd7f2b87)
I20260709 13:05:19.500948 22055 raft_consensus.cc:515] T 76cb037fc9064d13b59a8969d897ce8c P e61c3a8f61bb48f8a963c9480e53c168 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:19.501448 21936 leader_election.cc:290] T 0afb57ae58a24a01850491d69f0213dd P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 7 election: Requested vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:05:19.503278 22055 leader_election.cc:290] T 76cb037fc9064d13b59a8969d897ce8c P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:05:19.126695 21894 raft_consensus.cc:515] T 96efeaaf1057492490e9a621f37e1a2d P 127766fc592545a4997f7790f50f6076 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:05:19.505214 21962 leader_election.cc:290] T ece3db938bc649d4a40a51522ed5259c P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:05:19.505203 21941 raft_consensus.cc:515] T 86a6797bdfe94fa496c050ceae4bd0d9 P e61c3a8f61bb48f8a963c9480e53c168 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
W20260709 13:05:19.302790 21932 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.822s	user 0.030s	sys 0.061s
I20260709 13:05:19.345228 19552 raft_consensus.cc:2468] T 21e14947d70440f19044d8f75c31e1f9 P e61c3a8f61bb48f8a963c9480e53c168 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 5.
W20260709 13:05:19.345268 19450 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.474s	user 0.008s	sys 0.023s
W20260709 13:05:19.509184 19450 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.3:36891, user_credentials={real_user=slave}} blocked reactor thread for 1.68359e+06us
I20260709 13:05:19.348425 19406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70797e5783b5454ab0d0eea663e791e3" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:05:19.513685 19409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "833a2f0775ed407a94b8924ce50adb63" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
I20260709 13:05:19.368889 21559 raft_consensus.cc:515] T fa731b585f684a7fb2d106c50f143b83 P e61c3a8f61bb48f8a963c9480e53c168 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:05:19.514482 19484 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58286 (request call id 1503) took 1927 ms. Trace:
I20260709 13:05:19.345870 21853 raft_consensus.cc:515] T f1b10566f45d4a7d9029858330e02d5b P e61c3a8f61bb48f8a963c9480e53c168 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:19.516705 21853 leader_election.cc:290] T f1b10566f45d4a7d9029858330e02d5b P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:05:19.514961 19484 rpcz_store.cc:276] 0709 13:05:17.586912 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:17.587037 (+   125us) service_pool.cc:224] Handling call
0709 13:05:17.587355 (+   318us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:05:17.594558 (+  7203us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:05:17.594589 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:05:18.491265 (+896676us) spinlock_profiling.cc:243] Waited 6.52 ms on lock 0x7b2c000010a8. stack: 00007f4a79de9343 00007f4a79de9240 00007f4a797781d4 00007f4a834b6304 00007f4a834b6299 00007f4a7b801a11 00007f4a7b811372 00007f4a7cf43a01 00007f4a7cf0843a 00007f4a7cf0783e 00007f4a81ecc419 00007f4a7b443bd4 00007f4a7b443b62 00007f4a7b443a91 00007f4a7b443a0c 00007f4a7b442cc2
0709 13:05:18.491686 (+   421us) log.cc:844] Serialized 26 byte log entry
0709 13:05:18.806116 (+314430us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:05:18.977576 (+171460us) spinlock_profiling.cc:243] Waited 37.3 ms on lock 0x7b48001ec258. stack: 00007f4a79de9343 00007f4a79de9240 00007f4a797781d4 00007f4a834b6304 00007f4a834b6299 00007f4a81e31aa1 00007f4a81e28b37 00007f4a81e289ca 00007f4a81f2026f 00007f4a81f1ff37 00007f4a81f3455c 00007f4a81f34508 00007f4a81f34488 00007f4a81f34443 00007f4a81f336ec 00007f4a80e5da96
0709 13:05:19.251323 (+273747us) log.cc:844] Serialized 14 byte log entry
0709 13:05:19.251596 (+   273us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:19.251696 (+   100us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:05:19.514227 (+262531us) raft_consensus.cc:1685] finished
0709 13:05:19.514254 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:19.514410 (+   156us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":26956,"prepare.queue_time_us":372882,"prepare.run_cpu_time_us":25,"prepare.run_wall_time_us":25,"raft.queue_time_us":49643,"raft.run_cpu_time_us":15641,"raft.run_wall_time_us":1386773,"spinlock_wait_cycles":100731136,"thread_start_us":758950,"threads_started":2,"wal-append.queue_time_us":855146}
I20260709 13:05:19.517222 21941 leader_election.cc:290] T 86a6797bdfe94fa496c050ceae4bd0d9 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 6 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:05:19.416554 21976 raft_consensus.cc:515] T 2e36a9d6e29c4a7c860cf267efbd4c74 P e61c3a8f61bb48f8a963c9480e53c168 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:19.519012 21976 leader_election.cc:290] T 2e36a9d6e29c4a7c860cf267efbd4c74 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:05:19.357872 22041 raft_consensus.cc:2749] T 85c494af21f9457a85da47b9bc70c1fd P 127766fc592545a4997f7790f50f6076 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:05:19.521533 22050 raft_consensus.cc:493] T 62c6c134d3d24a1ab144dd9ee6bc3f64 P 0473d2b2d01f4459b1e90fd12cc7840e [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 127766fc592545a4997f7790f50f6076)
I20260709 13:05:19.522230 22050 raft_consensus.cc:515] T 62c6c134d3d24a1ab144dd9ee6bc3f64 P 0473d2b2d01f4459b1e90fd12cc7840e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:05:19.153743 21916 raft_consensus.cc:515] T 5ec1c4ce15e04c7e8c283a62179f2a64 P e5256d91808b47c195bc9b4dbd7f2b87 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:05:19.524740 22050 leader_election.cc:290] T 62c6c134d3d24a1ab144dd9ee6bc3f64 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:05:19.525496 21916 leader_election.cc:290] T 5ec1c4ce15e04c7e8c283a62179f2a64 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:05:19.363773 20105 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46422 (request call id 547) took 1312 ms. Trace:
I20260709 13:05:19.525720 21932 raft_consensus.cc:493] T d1e5873a19244c5ebbcd38e126796ee7 P 0473d2b2d01f4459b1e90fd12cc7840e [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:19.362773 19306 catalog_manager.cc:5697] T 9962423cb4e54fcfa5de01daf68a86e7 P 0473d2b2d01f4459b1e90fd12cc7840e reported cstate change: term changed from 6 to 8. New cstate: current_term: 8 leader_uuid: "127766fc592545a4997f7790f50f6076" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } } }
I20260709 13:05:19.314733 21968 raft_consensus.cc:493] T 172b3dd13109415a955b71ac0e9d2234 P 0473d2b2d01f4459b1e90fd12cc7840e [term 3 FOLLOWER]: Starting pre-election (detected failure of leader e5256d91808b47c195bc9b4dbd7f2b87)
I20260709 13:05:19.526381 21932 raft_consensus.cc:515] T d1e5873a19244c5ebbcd38e126796ee7 P 0473d2b2d01f4459b1e90fd12cc7840e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:19.526916 21968 raft_consensus.cc:515] T 172b3dd13109415a955b71ac0e9d2234 P 0473d2b2d01f4459b1e90fd12cc7840e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:05:19.528925 21968 leader_election.cc:290] T 172b3dd13109415a955b71ac0e9d2234 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:05:19.529019 21932 leader_election.cc:290] T d1e5873a19244c5ebbcd38e126796ee7 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:05:19.529430 21968 raft_consensus.cc:493] T bc225c93219c45538b53a1bd3d387e4d P 0473d2b2d01f4459b1e90fd12cc7840e [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:19.529938 21968 raft_consensus.cc:515] T bc225c93219c45538b53a1bd3d387e4d P 0473d2b2d01f4459b1e90fd12cc7840e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:19.312711 22011 raft_consensus.cc:493] T 76cb037fc9064d13b59a8969d897ce8c P 0473d2b2d01f4459b1e90fd12cc7840e [term 7 FOLLOWER]: Starting pre-election (detected failure of leader e5256d91808b47c195bc9b4dbd7f2b87)
I20260709 13:05:19.094756 22057 raft_consensus.cc:515] T 48824d5acfbc485ebf8c2d944e7202de P 0473d2b2d01f4459b1e90fd12cc7840e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:05:19.530905 22011 raft_consensus.cc:515] T 76cb037fc9064d13b59a8969d897ce8c P 0473d2b2d01f4459b1e90fd12cc7840e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:19.532569 22057 leader_election.cc:290] T 48824d5acfbc485ebf8c2d944e7202de P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:05:19.532676 21918 leader_election.cc:290] T 22196caba61445d3bec98a0aab3c337d P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:05:19.359764 19374 leader_election.cc:304] T 14efcc79969f41babe5529c22d59156d P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 127766fc592545a4997f7790f50f6076, e5256d91808b47c195bc9b4dbd7f2b87; no voters: 
W20260709 13:05:19.533528 19374 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.4:43121, user_credentials={real_user=slave}} blocked reactor thread for 173836us
I20260709 13:05:19.533783 19411 raft_consensus.cc:2468] T 5ec1c4ce15e04c7e8c283a62179f2a64 P e5256d91808b47c195bc9b4dbd7f2b87 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 127766fc592545a4997f7790f50f6076 in term 4.
I20260709 13:05:19.377156 19402 raft_consensus.cc:1275] T 65d8cb8d6ec64f459d5a47cefab10acf P e5256d91808b47c195bc9b4dbd7f2b87 [term 3 FOLLOWER]: Refusing update from remote peer e61c3a8f61bb48f8a963c9480e53c168: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:05:19.534657 19306 catalog_manager.cc:5697] T b08304a0a02b42d7840c4e8ee9a6bd1a P 0473d2b2d01f4459b1e90fd12cc7840e reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } health_report { overall_health: HEALTHY } } }
I20260709 13:05:19.536850 19402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dc5b3532fe54f74876d02beffa2c230" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:05:19.185745 20103 rpcz_store.cc:276] 0709 13:05:18.115475 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:18.120998 (+  5523us) service_pool.cc:224] Handling call
0709 13:05:18.165409 (+ 44411us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:05:18.281731 (+116322us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:05:18.281783 (+    52us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:05:18.384513 (+102730us) log.cc:844] Serialized 26 byte log entry
0709 13:05:18.789924 (+405411us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:05:18.799602 (+  9678us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:18.804706 (+  5104us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:05:19.161476 (+356770us) raft_consensus.cc:1685] finished
0709 13:05:19.161497 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:19.161637 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":59176,"raft.queue_time_us":115962,"raft.run_cpu_time_us":105,"raft.run_wall_time_us":107,"thread_start_us":277834,"threads_started":1,"wal-append.queue_time_us":745702}
I20260709 13:05:19.547430 19481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e5873a19244c5ebbcd38e126796ee7" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:05:19.548236 19481 raft_consensus.cc:2468] T d1e5873a19244c5ebbcd38e126796ee7 P 0473d2b2d01f4459b1e90fd12cc7840e [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 7.
I20260709 13:05:19.408289 20111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "309c3ca0ca4b4f3ba129752ea2cb293b" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:05:19.318778 21529 raft_consensus.cc:515] T ef32ce6fdd0e40d382c79974f30295c6 P e61c3a8f61bb48f8a963c9480e53c168 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:19.232512 22053 raft_consensus.cc:515] T 14935b3ddf914369822e4a0547aaa355 P e61c3a8f61bb48f8a963c9480e53c168 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } attrs { replace: true } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:05:19.409440 20112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36f6ba92b9ba46babe4ebd6c02e5fbd9" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076"
I20260709 13:05:19.345011 22040 leader_election.cc:290] T 5ec1c4ce15e04c7e8c283a62179f2a64 P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:05:19.357838 22027 raft_consensus.cc:493] T 2725d2c4cb054f18b0fc8f735c15f6c2 P e61c3a8f61bb48f8a963c9480e53c168 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:19.555959 22027 raft_consensus.cc:515] T 2725d2c4cb054f18b0fc8f735c15f6c2 P e61c3a8f61bb48f8a963c9480e53c168 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:19.557214 22053 leader_election.cc:290] T 14935b3ddf914369822e4a0547aaa355 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
W20260709 13:05:19.344197 19309 rpcz_store.cc:269] 0709 13:05:03.494782 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:03.498067 (+  3285us) service_pool.cc:224] Handling call
0709 13:05:03.611569 (+113502us) spinlock_profiling.cc:243] Waited 1.5 ms on lock 0x7b5400002210. stack: 00007f4a79de9343 00007f4a79de9240 00007f4a797781d4 00007f4a834b6304 00007f4a834b6299 00007f4a79ca3db1 00007f4a79de3b71 00007f4a79de40b2 00007f4a82d5da89 00007f4a82cf5da6 00007f4a82cc7088 00007f4a82dc537e 00007f4a812862a4 00007f4a81286232 00007f4a81286161 00007f4a812860dc
0709 13:05:19.163034 (+15551465us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:05:15.551640 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:05:15.552194 (+   554us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:05:15.552225 (+    31us) write_op.cc:435] Acquired schema lock
0709 13:05:15.552243 (+    18us) tablet.cc:662] Decoding operations
0709 13:05:15.553180 (+   937us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:05:15.553266 (+    86us) write_op.cc:641] Partition lock acquired for write op
0709 13:05:15.553292 (+    26us) tablet.cc:685] Acquiring locks for 9 operations
0709 13:05:15.553982 (+   690us) tablet.cc:701] Row locks acquired
0709 13:05:15.554000 (+    18us) write_op.cc:260] PREPARE: finished
0709 13:05:15.554139 (+   139us) write_op.cc:270] Start()
0709 13:05:15.554255 (+   116us) write_op.cc:276] Timestamp: P: 1783602315554091 usec, L: 0
0709 13:05:15.554271 (+    16us) op_driver.cc:348] REPLICATION: starting
0709 13:05:15.639255 (+ 84984us) log.cc:844] Serialized 3619 byte log entry
0709 13:05:15.904800 (+265545us) op_driver.cc:464] REPLICATION: finished
0709 13:05:16.068465 (+163665us) write_op.cc:301] APPLY: starting
0709 13:05:16.068570 (+   105us) tablet.cc:1367] starting BulkCheckPresence
0709 13:05:16.068808 (+   238us) tablet.cc:1370] finished BulkCheckPresence
0709 13:05:16.068939 (+   131us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:05:16.070056 (+  1117us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:05:16.070298 (+   242us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=9
0709 13:05:16.070348 (+    50us) write_op.cc:312] APPLY: finished
0709 13:05:16.070639 (+   291us) log.cc:844] Serialized 71 byte log entry
0709 13:05:16.072360 (+  1721us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:05:16.072506 (+   146us) write_op.cc:454] Released schema lock
0709 13:05:16.072554 (+    48us) write_op.cc:341] FINISH: Updating metrics
0709 13:05:16.072916 (+   362us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:05:16.072945 (+    29us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":63352,"reported_tablets":37,"spinlock_wait_cycles":3447680,"child_traces":[["op",{"apply.queue_time_us":138357,"apply.run_cpu_time_us":2927,"apply.run_wall_time_us":22637,"num_ops":9,"prepare.queue_time_us":111788,"prepare.run_cpu_time_us":3883,"prepare.run_wall_time_us":97922,"replication_time_us":331219,"thread_start_us":171969,"threads_started":2}]]}
I20260709 13:05:19.363689 21823 raft_consensus.cc:493] T 1dc5b3532fe54f74876d02beffa2c230 P e5256d91808b47c195bc9b4dbd7f2b87 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:19.559854 22063 leader_election.cc:290] T 7be9efa6559648dbb5a0f7684c4542d1 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:05:19.559752 21823 raft_consensus.cc:515] T 1dc5b3532fe54f74876d02beffa2c230 P e5256d91808b47c195bc9b4dbd7f2b87 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:19.375222 21980 raft_consensus.cc:493] T f93ee515a9c14139bf566522ed8232f3 P e5256d91808b47c195bc9b4dbd7f2b87 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:19.368654 21684 raft_consensus.cc:493] T 1efebf73c86e432baa55533136b6e12c P e61c3a8f61bb48f8a963c9480e53c168 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 127766fc592545a4997f7790f50f6076)
W20260709 13:05:19.380256 21731 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.613s	user 0.005s	sys 0.022s
I20260709 13:05:19.091349 22048 raft_consensus.cc:515] T 70797e5783b5454ab0d0eea663e791e3 P e5256d91808b47c195bc9b4dbd7f2b87 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:05:19.495502 21934 raft_consensus.cc:515] T 2b74109013a140ada21feeef92d6f563 P e61c3a8f61bb48f8a963c9480e53c168 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:19.506315 21992 leader_election.cc:290] T 62c6c134d3d24a1ab144dd9ee6bc3f64 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:05:19.506776 21894 leader_election.cc:290] T 96efeaaf1057492490e9a621f37e1a2d P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 6 election: Requested vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:05:19.507051 21963 raft_consensus.cc:493] T f1b10566f45d4a7d9029858330e02d5b P 0473d2b2d01f4459b1e90fd12cc7840e [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:19.507503 21926 leader_election.cc:290] T 28af091831594f9d8e96482078cc7625 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:05:19.492244 21935 leader_election.cc:290] T d1e5873a19244c5ebbcd38e126796ee7 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:05:19.327504 19408 rpcz_store.cc:276] 0709 13:05:18.102092 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:18.103637 (+  1545us) service_pool.cc:224] Handling call
0709 13:05:18.104027 (+   390us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:05:18.116268 (+ 12241us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:05:18.116314 (+    46us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:05:18.283761 (+167447us) log.cc:844] Serialized 26 byte log entry
0709 13:05:18.503949 (+220188us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:05:18.503989 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:18.504054 (+    65us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:05:19.171682 (+667628us) raft_consensus.cc:1685] finished
0709 13:05:19.171702 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:19.171826 (+   124us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":11775,"raft.queue_time_us":16327,"raft.run_cpu_time_us":119,"raft.run_wall_time_us":121,"thread_start_us":213777,"threads_started":1,"wal-append.queue_time_us":880257}
I20260709 13:05:19.182587 21970 raft_consensus.cc:515] T 22196caba61445d3bec98a0aab3c337d P e61c3a8f61bb48f8a963c9480e53c168 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:19.532886 22011 leader_election.cc:290] T 76cb037fc9064d13b59a8969d897ce8c P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:05:19.537111 19306 catalog_manager.cc:5697] T 0cdf56e38bbc453d9438d359e5a69955 P 0473d2b2d01f4459b1e90fd12cc7840e reported cstate change: term changed from 4 to 5, leader changed from e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1) to e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3). New cstate: current_term: 5 leader_uuid: "e61c3a8f61bb48f8a963c9480e53c168" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } }
I20260709 13:05:19.578177 22049 raft_consensus.cc:493] T 85c494af21f9457a85da47b9bc70c1fd P e5256d91808b47c195bc9b4dbd7f2b87 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader e61c3a8f61bb48f8a963c9480e53c168)
I20260709 13:05:19.544394 19484 raft_consensus.cc:1275] T 1f85fc4b527a48848e5faa083b604e36 P 0473d2b2d01f4459b1e90fd12cc7840e [term 4 FOLLOWER]: Refusing update from remote peer e5256d91808b47c195bc9b4dbd7f2b87: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 6. (term mismatch)
I20260709 13:05:19.619520 19484 pending_rounds.cc:85] T 1f85fc4b527a48848e5faa083b604e36 P 0473d2b2d01f4459b1e90fd12cc7840e: Aborting all ops after (but not including) 5
I20260709 13:05:19.619808 19484 pending_rounds.cc:107] T 1f85fc4b527a48848e5faa083b604e36 P 0473d2b2d01f4459b1e90fd12cc7840e: Aborting uncommitted NO_OP operation due to leader change: 3.6
I20260709 13:05:19.620046 19484 raft_consensus.cc:2889] T 1f85fc4b527a48848e5faa083b604e36 P 0473d2b2d01f4459b1e90fd12cc7840e [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:05:19.546200 19477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14efcc79969f41babe5529c22d59156d" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:05:19.343775 21833 raft_consensus.cc:515] T df751f992649444090e27965eb1af85d P e61c3a8f61bb48f8a963c9480e53c168 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:19.551837 20104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ece3db938bc649d4a40a51522ed5259c" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:05:19.526144 20105 rpcz_store.cc:276] 0709 13:05:18.037836 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:18.038532 (+   696us) service_pool.cc:224] Handling call
0709 13:05:18.038869 (+   337us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:05:18.039315 (+   446us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:05:18.039354 (+    39us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:05:18.039918 (+   564us) log.cc:844] Serialized 26 byte log entry
0709 13:05:18.492296 (+452378us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:05:19.343907 (+851611us) log.cc:844] Serialized 14 byte log entry
0709 13:05:19.350247 (+  6340us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:19.350314 (+    67us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:05:19.350353 (+    39us) raft_consensus.cc:1685] finished
0709 13:05:19.350364 (+    11us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:19.350475 (+   111us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":11947,"prepare.queue_time_us":552551,"prepare.run_cpu_time_us":31,"prepare.run_wall_time_us":31,"raft.queue_time_us":7294,"raft.run_cpu_time_us":9123,"raft.run_wall_time_us":53744,"thread_start_us":726996,"threads_started":2,"wal-append.queue_time_us":1098021}
I20260709 13:05:19.552560 19478 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58286 (request call id 1517) took 1027 ms. Trace:
I20260709 13:05:19.553048 19480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36f6ba92b9ba46babe4ebd6c02e5fbd9" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:05:19.553076 21767 leader_election.cc:290] T 46c5bfeecc314717bffe987e6844b6d0 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:05:19.553609 21529 leader_election.cc:290] T ef32ce6fdd0e40d382c79974f30295c6 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:05:19.561870 19402 raft_consensus.cc:2468] T 1dc5b3532fe54f74876d02beffa2c230 P e5256d91808b47c195bc9b4dbd7f2b87 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 4.
I20260709 13:05:19.562337 20112 raft_consensus.cc:2468] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P 127766fc592545a4997f7790f50f6076 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 7.
I20260709 13:05:19.564797 19482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9f0d59553ad444883fcf5b5909f9798" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:05:19.579106 21980 raft_consensus.cc:515] T f93ee515a9c14139bf566522ed8232f3 P e5256d91808b47c195bc9b4dbd7f2b87 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:19.576051 19485 raft_consensus.cc:1275] T bc225c93219c45538b53a1bd3d387e4d P 0473d2b2d01f4459b1e90fd12cc7840e [term 8 FOLLOWER]: Refusing update from remote peer e5256d91808b47c195bc9b4dbd7f2b87: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:05:19.577278 19481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa8650e71aa14778b3d73721fc50d9fc" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:05:19.580842 20111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ec1c4ce15e04c7e8c283a62179f2a64" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:05:19.533706 21966 raft_consensus.cc:493] T a08760e15aac4630a629431f56024dc8 P e5256d91808b47c195bc9b4dbd7f2b87 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:19.539389 21956 raft_consensus.cc:493] T b9f0d59553ad444883fcf5b5909f9798 P 0473d2b2d01f4459b1e90fd12cc7840e [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:19.574745 22044 raft_consensus.cc:493] T 2e36a9d6e29c4a7c860cf267efbd4c74 P e5256d91808b47c195bc9b4dbd7f2b87 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:19.558542 22027 leader_election.cc:290] T 2725d2c4cb054f18b0fc8f735c15f6c2 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
W20260709 13:05:19.595505 19449 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.644s	user 0.028s	sys 0.057s
I20260709 13:05:19.554562 21559 leader_election.cc:290] T fa731b585f684a7fb2d106c50f143b83 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:05:19.568987 21918 raft_consensus.cc:2804] T 14efcc79969f41babe5529c22d59156d P e5256d91808b47c195bc9b4dbd7f2b87 [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 13:05:19.606863 19526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.2:46257, user_credentials={real_user=slave}} blocked reactor thread for 354565us
I20260709 13:05:19.608155 19404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f93ee515a9c14139bf566522ed8232f3" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 9 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:05:19.579332 22063 raft_consensus.cc:493] T ef32ce6fdd0e40d382c79974f30295c6 P e5256d91808b47c195bc9b4dbd7f2b87 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:19.615396 19406 raft_consensus.cc:2368] T 70797e5783b5454ab0d0eea663e791e3 P e5256d91808b47c195bc9b4dbd7f2b87 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 127766fc592545a4997f7790f50f6076 for earlier term 7. Current term is 8.
I20260709 13:05:19.615228 19306 catalog_manager.cc:5697] T f93ee515a9c14139bf566522ed8232f3 P 0473d2b2d01f4459b1e90fd12cc7840e reported cstate change: term changed from 6 to 7, leader changed from e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1) to e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3). New cstate: current_term: 7 leader_uuid: "e61c3a8f61bb48f8a963c9480e53c168" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } }
I20260709 13:05:19.538372 19409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7be9efa6559648dbb5a0f7684c4542d1" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:05:19.583294 22050 raft_consensus.cc:493] T 0afb57ae58a24a01850491d69f0213dd P 0473d2b2d01f4459b1e90fd12cc7840e [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:19.365046 21957 consensus_queue.cc:260] T 2725d2c4cb054f18b0fc8f735c15f6c2 P e5256d91808b47c195bc9b4dbd7f2b87 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:19.583086 21932 raft_consensus.cc:493] T 775c229504194560ba9589bc2199b089 P 0473d2b2d01f4459b1e90fd12cc7840e [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 127766fc592545a4997f7790f50f6076)
I20260709 13:05:19.583017 21962 raft_consensus.cc:493] T 179fd671030940b4b4a4e24bcc4aba0a P e5256d91808b47c195bc9b4dbd7f2b87 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 0473d2b2d01f4459b1e90fd12cc7840e)
I20260709 13:05:19.583421 22007 raft_consensus.cc:493] T 40e1e16737a842ee936002830f36882e P 0473d2b2d01f4459b1e90fd12cc7840e [term 7 FOLLOWER]: Starting pre-election (detected failure of leader e61c3a8f61bb48f8a963c9480e53c168)
I20260709 13:05:19.620239 19554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f93ee515a9c14139bf566522ed8232f3" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 8 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:05:19.581192 21684 raft_consensus.cc:515] T 1efebf73c86e432baa55533136b6e12c P e61c3a8f61bb48f8a963c9480e53c168 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:05:19.566195 19375 leader_election.cc:304] T 217b5fae677b4971b3bbd2f357a1f7ff P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:05:19.774987 19478 rpcz_store.cc:276] 0709 13:05:18.524745 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:18.524900 (+   155us) service_pool.cc:224] Handling call
0709 13:05:18.962930 (+438030us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:19.327701 (+364771us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:19.552353 (+224652us) spinlock_profiling.cc:243] Waited 85.3 ms on lock 0x7b54002b7fd4. stack: 00007f4a79de9343 00007f4a79de9240 00007f4a797781d4 00007f4a834b6304 00007f4a834b6299 00007f4a7ce71571 00007f4a7cf08e01 00007f4a7cf0783e 00007f4a81ecc419 00007f4a7b443bd4 00007f4a7b443b62 00007f4a7b443a91 00007f4a7b443a0c 00007f4a7b442cc2 00007f4a7b24348c 00007f4a7b2428c6
0709 13:05:19.552507 (+   154us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":196223872}
W20260709 13:05:19.775765 19375 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.3:36891, user_credentials={real_user=slave}} blocked reactor thread for 209674us
I20260709 13:05:19.774911 19306 catalog_manager.cc:5697] T 28af091831594f9d8e96482078cc7625 P 0473d2b2d01f4459b1e90fd12cc7840e reported cstate change: term changed from 4 to 6, leader changed from e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3) to 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2). New cstate: current_term: 6 leader_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } health_report { overall_health: HEALTHY } } }
W20260709 13:05:19.774428 19449 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.823s	user 0.030s	sys 0.058s
I20260709 13:05:19.652064 19552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "217b5fae677b4971b3bbd2f357a1f7ff" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:05:19.624239 19560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86a6797bdfe94fa496c050ceae4bd0d9" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:05:19.773805 19409 raft_consensus.cc:2468] T 7be9efa6559648dbb5a0f7684c4542d1 P e5256d91808b47c195bc9b4dbd7f2b87 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 6.
I20260709 13:05:19.778143 19560 raft_consensus.cc:2368] T 86a6797bdfe94fa496c050ceae4bd0d9 P e61c3a8f61bb48f8a963c9480e53c168 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0473d2b2d01f4459b1e90fd12cc7840e for earlier term 5. Current term is 6.
I20260709 13:05:19.651695 19484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "217b5fae677b4971b3bbd2f357a1f7ff" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:05:19.778797 20111 raft_consensus.cc:2468] T 5ec1c4ce15e04c7e8c283a62179f2a64 P 127766fc592545a4997f7790f50f6076 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 4.
I20260709 13:05:19.639374 19555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b08304a0a02b42d7840c4e8ee9a6bd1a" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:05:19.780087 19555 raft_consensus.cc:2468] T b08304a0a02b42d7840c4e8ee9a6bd1a P e61c3a8f61bb48f8a963c9480e53c168 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 6.
I20260709 13:05:19.664227 19559 raft_consensus.cc:1275] T 179fd671030940b4b4a4e24bcc4aba0a P e61c3a8f61bb48f8a963c9480e53c168 [term 5 FOLLOWER]: Refusing update from remote peer 0473d2b2d01f4459b1e90fd12cc7840e: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 4. (term mismatch)
I20260709 13:05:19.781077 19559 pending_rounds.cc:85] T 179fd671030940b4b4a4e24bcc4aba0a P e61c3a8f61bb48f8a963c9480e53c168: Aborting all ops after (but not including) 3
I20260709 13:05:19.781153 19477 raft_consensus.cc:2468] T 14efcc79969f41babe5529c22d59156d P 0473d2b2d01f4459b1e90fd12cc7840e [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 5.
I20260709 13:05:19.781431 19559 pending_rounds.cc:107] T 179fd671030940b4b4a4e24bcc4aba0a P e61c3a8f61bb48f8a963c9480e53c168: Aborting uncommitted NO_OP operation due to leader change: 4.4
I20260709 13:05:19.781774 19559 raft_consensus.cc:2889] T 179fd671030940b4b4a4e24bcc4aba0a P e61c3a8f61bb48f8a963c9480e53c168 [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:05:19.782105 19477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df751f992649444090e27965eb1af85d" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:05:19.782739 19477 raft_consensus.cc:2468] T df751f992649444090e27965eb1af85d P 0473d2b2d01f4459b1e90fd12cc7840e [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 5.
I20260709 13:05:19.779220 19484 raft_consensus.cc:2468] T 217b5fae677b4971b3bbd2f357a1f7ff P 0473d2b2d01f4459b1e90fd12cc7840e [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 3.
I20260709 13:05:19.664597 19553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef32ce6fdd0e40d382c79974f30295c6" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:05:19.776376 19478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4509b76741dc428e9201c70c1658da13" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:05:19.656302 19407 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52328 (request call id 1543) took 1355 ms. Trace:
I20260709 13:05:19.789057 19407 rpcz_store.cc:276] 0709 13:05:18.301415 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:18.301557 (+   142us) service_pool.cc:224] Handling call
0709 13:05:18.301955 (+   398us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:05:18.646638 (+344683us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:05:18.646684 (+    46us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:05:18.951616 (+304932us) log.cc:844] Serialized 26 byte log entry
0709 13:05:19.319518 (+367902us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:05:19.319559 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:19.319624 (+    65us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:05:19.656091 (+336467us) raft_consensus.cc:1685] finished
0709 13:05:19.656108 (+    17us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:19.656242 (+   134us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":123406,"raft.run_cpu_time_us":114,"raft.run_wall_time_us":3764,"thread_start_us":683137,"threads_started":2,"wal-append.queue_time_us":674114}
I20260709 13:05:19.835539 19555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7be9efa6559648dbb5a0f7684c4542d1" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:05:19.836360 19555 raft_consensus.cc:2468] T 7be9efa6559648dbb5a0f7684c4542d1 P e61c3a8f61bb48f8a963c9480e53c168 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 6.
I20260709 13:05:19.777860 19552 raft_consensus.cc:2468] T 217b5fae677b4971b3bbd2f357a1f7ff P e61c3a8f61bb48f8a963c9480e53c168 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 2.
I20260709 13:05:19.774585 19554 raft_consensus.cc:2468] T f93ee515a9c14139bf566522ed8232f3 P e61c3a8f61bb48f8a963c9480e53c168 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 8.
I20260709 13:05:19.777091 19306 catalog_manager.cc:5697] T bc225c93219c45538b53a1bd3d387e4d P 0473d2b2d01f4459b1e90fd12cc7840e reported cstate change: term changed from 4 to 7, leader changed from e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1) to 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2). New cstate: current_term: 7 leader_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:19.783937 19484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7be9efa6559648dbb5a0f7684c4542d1" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:05:19.838367 19484 raft_consensus.cc:2410] T 7be9efa6559648dbb5a0f7684c4542d1 P 0473d2b2d01f4459b1e90fd12cc7840e [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e5256d91808b47c195bc9b4dbd7f2b87 for term 7 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 3.
W20260709 13:05:19.791182 20078 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.560s	user 0.014s	sys 0.099s
I20260709 13:05:19.838696 19306 catalog_manager.cc:5697] T b9f0d59553ad444883fcf5b5909f9798 P 0473d2b2d01f4459b1e90fd12cc7840e reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } health_report { overall_health: HEALTHY } } }
I20260709 13:05:19.807894 19477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28af091831594f9d8e96482078cc7625" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:05:19.779181 19526 leader_election.cc:304] T 217b5fae677b4971b3bbd2f357a1f7ff P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168; no voters: e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:05:19.835032 19481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "309c3ca0ca4b4f3ba129752ea2cb293b" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:05:19.584837 21700 raft_consensus.cc:493] T 7f575b143b844aa096b50997dad3516a P 0473d2b2d01f4459b1e90fd12cc7840e [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e5256d91808b47c195bc9b4dbd7f2b87)
I20260709 13:05:19.774915 19480 raft_consensus.cc:2393] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P 0473d2b2d01f4459b1e90fd12cc7840e [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e5256d91808b47c195bc9b4dbd7f2b87 in current term 7: Already voted for candidate 0473d2b2d01f4459b1e90fd12cc7840e in this term.
W20260709 13:05:19.654066 22065 log.cc:927] Time spent T 0cdf56e38bbc453d9438d359e5a69955 P e61c3a8f61bb48f8a963c9480e53c168: Append to log took a long time: real 0.309s	user 0.001s	sys 0.001s
W20260709 13:05:19.896840 20078 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.666s	user 0.016s	sys 0.104s
I20260709 13:05:19.887676 19554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cdf56e38bbc453d9438d359e5a69955" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
W20260709 13:05:19.839002 19375 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.3:36891, user_credentials={real_user=slave}} blocked reactor thread for 61925.4us
I20260709 13:05:19.773135 21911 raft_consensus.cc:3055] T 833a2f0775ed407a94b8924ce50adb63 P 127766fc592545a4997f7790f50f6076 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:05:19.838337 19553 raft_consensus.cc:2468] T ef32ce6fdd0e40d382c79974f30295c6 P e61c3a8f61bb48f8a963c9480e53c168 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 6.
I20260709 13:05:19.606878 21894 raft_consensus.cc:493] T ed7fdbcb96d14d418db9ca90a792588a P 127766fc592545a4997f7790f50f6076 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 0473d2b2d01f4459b1e90fd12cc7840e)
I20260709 13:05:19.901105 19375 leader_election.cc:304] T d1e5873a19244c5ebbcd38e126796ee7 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
W20260709 13:05:19.897758 19526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.2:46257, user_credentials={real_user=slave}} blocked reactor thread for 118674us
I20260709 13:05:19.897348 19481 raft_consensus.cc:2468] T 309c3ca0ca4b4f3ba129752ea2cb293b P 0473d2b2d01f4459b1e90fd12cc7840e [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 6.
I20260709 13:05:19.903260 21529 raft_consensus.cc:2804] T 217b5fae677b4971b3bbd2f357a1f7ff P e61c3a8f61bb48f8a963c9480e53c168 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:05:19.925614 21529 raft_consensus.cc:493] T 217b5fae677b4971b3bbd2f357a1f7ff P e61c3a8f61bb48f8a963c9480e53c168 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 0473d2b2d01f4459b1e90fd12cc7840e)
I20260709 13:05:19.904013 19485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36f6ba92b9ba46babe4ebd6c02e5fbd9" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:05:19.904003 19484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21e14947d70440f19044d8f75c31e1f9" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:05:19.886978 21867 consensus_queue.cc:1048] T bc225c93219c45538b53a1bd3d387e4d P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.018s
I20260709 13:05:19.618120 21926 raft_consensus.cc:493] T ab43d85f64114d4ebf618930e43d9ed0 P e5256d91808b47c195bc9b4dbd7f2b87 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader e61c3a8f61bb48f8a963c9480e53c168)
I20260709 13:05:19.906512 19478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dc5b3532fe54f74876d02beffa2c230" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:05:19.906920 19559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "309c3ca0ca4b4f3ba129752ea2cb293b" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:05:19.910974 19552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14935b3ddf914369822e4a0547aaa355" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:05:19.938238 19484 raft_consensus.cc:2468] T 21e14947d70440f19044d8f75c31e1f9 P 0473d2b2d01f4459b1e90fd12cc7840e [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 6.
I20260709 13:05:19.941759 19552 raft_consensus.cc:3060] T 14935b3ddf914369822e4a0547aaa355 P e61c3a8f61bb48f8a963c9480e53c168 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:05:19.941316 19478 raft_consensus.cc:2468] T 1dc5b3532fe54f74876d02beffa2c230 P 0473d2b2d01f4459b1e90fd12cc7840e [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 4.
I20260709 13:05:19.653326 21823 leader_election.cc:290] T 1dc5b3532fe54f74876d02beffa2c230 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:05:19.911616 19555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21e14947d70440f19044d8f75c31e1f9" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:05:19.911989 19477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1b10566f45d4a7d9029858330e02d5b" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:05:19.912523 19480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46c5bfeecc314717bffe987e6844b6d0" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 11 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:05:19.942889 19555 raft_consensus.cc:2468] T 21e14947d70440f19044d8f75c31e1f9 P e61c3a8f61bb48f8a963c9480e53c168 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 5.
I20260709 13:05:19.942932 19478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22196caba61445d3bec98a0aab3c337d" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:05:19.912652 19560 raft_consensus.cc:1275] T 22196caba61445d3bec98a0aab3c337d P e61c3a8f61bb48f8a963c9480e53c168 [term 5 FOLLOWER]: Refusing update from remote peer 0473d2b2d01f4459b1e90fd12cc7840e: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:05:19.845856 19306 catalog_manager.cc:5697] T ef32ce6fdd0e40d382c79974f30295c6 P 0473d2b2d01f4459b1e90fd12cc7840e reported cstate change: term changed from 4 to 5, leader changed from e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1) to e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3). New cstate: current_term: 5 leader_uuid: "e61c3a8f61bb48f8a963c9480e53c168" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } }
I20260709 13:05:19.913295 19554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edd7d470b5014c9489be7f41f64355c9" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
W20260709 13:05:19.901787 20078 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.2:46257, user_credentials={real_user=slave}} blocked reactor thread for 690470us
I20260709 13:05:19.944579 19306 catalog_manager.cc:5697] T 48824d5acfbc485ebf8c2d944e7202de P 0473d2b2d01f4459b1e90fd12cc7840e reported cstate change: term changed from 2 to 4, leader changed from 127766fc592545a4997f7790f50f6076 (127.17.223.4) to 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2). New cstate: current_term: 4 leader_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:19.919194 19404 raft_consensus.cc:2468] T f93ee515a9c14139bf566522ed8232f3 P e5256d91808b47c195bc9b4dbd7f2b87 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 8.
W20260709 13:05:19.615964 21790 consensus_meta.cc:287] T 2e36a9d6e29c4a7c860cf267efbd4c74 P 0473d2b2d01f4459b1e90fd12cc7840e: Time spent flushing consensus metadata: real 0.590s	user 0.011s	sys 0.001s
I20260709 13:05:19.925657 19481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b08304a0a02b42d7840c4e8ee9a6bd1a" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:05:19.925556 22027 consensus_queue.cc:1048] T b9f0d59553ad444883fcf5b5909f9798 P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:05:19.923237 22076 raft_consensus.cc:493] T 3e1f505cb0f1427bbd698ac889d80821 P 0473d2b2d01f4459b1e90fd12cc7840e [term 4 FOLLOWER]: Starting pre-election (detected failure of leader e61c3a8f61bb48f8a963c9480e53c168)
I20260709 13:05:19.928074 21980 leader_election.cc:290] T f93ee515a9c14139bf566522ed8232f3 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:05:19.932405 21935 consensus_queue.cc:1048] T 309c3ca0ca4b4f3ba129752ea2cb293b P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:05:19.933033 19483 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58286 (request call id 1512) took 1499 ms. Trace:
I20260709 13:05:19.903770 21684 leader_election.cc:290] T 1efebf73c86e432baa55533136b6e12c P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:05:19.662827 21934 leader_election.cc:290] T 2b74109013a140ada21feeef92d6f563 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:05:19.645366 22049 raft_consensus.cc:515] T 85c494af21f9457a85da47b9bc70c1fd P e5256d91808b47c195bc9b4dbd7f2b87 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:05:19.776201 21918 raft_consensus.cc:493] T 14efcc79969f41babe5529c22d59156d P e5256d91808b47c195bc9b4dbd7f2b87 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:19.940820 19485 raft_consensus.cc:2393] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P 0473d2b2d01f4459b1e90fd12cc7840e [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate e5256d91808b47c195bc9b4dbd7f2b87 in current term 7: Already voted for candidate 0473d2b2d01f4459b1e90fd12cc7840e in this term.
I20260709 13:05:19.946419 19481 raft_consensus.cc:2468] T b08304a0a02b42d7840c4e8ee9a6bd1a P 0473d2b2d01f4459b1e90fd12cc7840e [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 6.
I20260709 13:05:19.787335 22050 raft_consensus.cc:515] T 0afb57ae58a24a01850491d69f0213dd P 0473d2b2d01f4459b1e90fd12cc7840e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:05:19.887248 22066 raft_consensus.cc:493] T 3e1f505cb0f1427bbd698ac889d80821 P e5256d91808b47c195bc9b4dbd7f2b87 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:19.890832 21969 leader_election.cc:290] T 2b74109013a140ada21feeef92d6f563 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:05:19.607046 21963 raft_consensus.cc:515] T f1b10566f45d4a7d9029858330e02d5b P 0473d2b2d01f4459b1e90fd12cc7840e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:19.787146 22007 raft_consensus.cc:515] T 40e1e16737a842ee936002830f36882e P 0473d2b2d01f4459b1e90fd12cc7840e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:19.884298 21916 raft_consensus.cc:2804] T 217b5fae677b4971b3bbd2f357a1f7ff P e5256d91808b47c195bc9b4dbd7f2b87 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:05:19.943105 19480 raft_consensus.cc:2468] T 46c5bfeecc314717bffe987e6844b6d0 P 0473d2b2d01f4459b1e90fd12cc7840e [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 10.
I20260709 13:05:19.887439 21849 raft_consensus.cc:493] T 40e1e16737a842ee936002830f36882e P e5256d91808b47c195bc9b4dbd7f2b87 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader e61c3a8f61bb48f8a963c9480e53c168)
W20260709 13:05:19.984244 20075 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.627s	user 0.005s	sys 0.025s
I20260709 13:05:19.624200 22057 raft_consensus.cc:493] T 1f85fc4b527a48848e5faa083b604e36 P 0473d2b2d01f4459b1e90fd12cc7840e [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:19.958154 19483 rpcz_store.cc:276] 0709 13:05:18.434134 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:18.434481 (+   347us) service_pool.cc:224] Handling call
0709 13:05:18.460242 (+ 25761us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:05:18.666078 (+205836us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:05:18.666122 (+    44us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:05:18.666721 (+   599us) log.cc:844] Serialized 26 byte log entry
0709 13:05:19.359288 (+692567us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:05:19.359330 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:19.520006 (+160676us) spinlock_profiling.cc:243] Waited 205 ms on lock 0x7b5400223b54. stack: 00007f4a79de9343 00007f4a79de9240 00007f4a797781d4 00007f4a834b6304 00007f4a834b6299 00007f4a7ce71571 00007f4a7cf08e01 00007f4a7cf0783e 00007f4a81ecc419 00007f4a7b443bd4 00007f4a7b443b62 00007f4a7b443a91 00007f4a7b443a0c 00007f4a7b442cc2 00007f4a7b24348c 00007f4a7b2428c6
0709 13:05:19.520053 (+    47us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:05:19.932744 (+412691us) raft_consensus.cc:1685] finished
0709 13:05:19.932763 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:19.932964 (+   201us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":284635,"raft.run_cpu_time_us":131,"raft.run_wall_time_us":11864,"spinlock_wait_cycles":472355584,"thread_start_us":692149,"threads_started":1,"wal-append.queue_time_us":1021716}
I20260709 13:05:19.920374 21911 raft_consensus.cc:740] T 833a2f0775ed407a94b8924ce50adb63 P 127766fc592545a4997f7790f50f6076 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 127766fc592545a4997f7790f50f6076, State: Running, Role: LEADER
W20260709 13:05:19.998198 19405 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.649s	user 0.017s	sys 0.027s
I20260709 13:05:19.783726 22063 raft_consensus.cc:515] T ef32ce6fdd0e40d382c79974f30295c6 P e5256d91808b47c195bc9b4dbd7f2b87 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:19.957578 22076 raft_consensus.cc:515] T 3e1f505cb0f1427bbd698ac889d80821 P 0473d2b2d01f4459b1e90fd12cc7840e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:19.954736 21823 raft_consensus.cc:493] T 65d8cb8d6ec64f459d5a47cefab10acf P e5256d91808b47c195bc9b4dbd7f2b87 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:19.960930 22064 raft_consensus.cc:493] T 2a16f7501e2444fb86d4e2778e734e02 P e5256d91808b47c195bc9b4dbd7f2b87 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:19.964735 19484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ec1c4ce15e04c7e8c283a62179f2a64" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:05:20.024732 19484 raft_consensus.cc:2468] T 5ec1c4ce15e04c7e8c283a62179f2a64 P 0473d2b2d01f4459b1e90fd12cc7840e [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 3.
I20260709 13:05:19.942171 21529 raft_consensus.cc:3060] T 217b5fae677b4971b3bbd2f357a1f7ff P e61c3a8f61bb48f8a963c9480e53c168 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:19.937460 22040 raft_consensus.cc:493] T 65d8cb8d6ec64f459d5a47cefab10acf P 127766fc592545a4997f7790f50f6076 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:19.967465 19485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48824d5acfbc485ebf8c2d944e7202de" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:05:19.946130 19306 catalog_manager.cc:5697] T 3e1f505cb0f1427bbd698ac889d80821 P 0473d2b2d01f4459b1e90fd12cc7840e reported cstate change: term changed from 1 to 4, leader changed from e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1) to e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3). New cstate: current_term: 4 leader_uuid: "e61c3a8f61bb48f8a963c9480e53c168" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } }
I20260709 13:05:20.039034 19485 raft_consensus.cc:2468] T 48824d5acfbc485ebf8c2d944e7202de P 0473d2b2d01f4459b1e90fd12cc7840e [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 127766fc592545a4997f7790f50f6076 in term 5.
I20260709 13:05:19.982918 21916 raft_consensus.cc:493] T 217b5fae677b4971b3bbd2f357a1f7ff P e5256d91808b47c195bc9b4dbd7f2b87 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:20.039392 19306 catalog_manager.cc:5697] T 62c6c134d3d24a1ab144dd9ee6bc3f64 P 0473d2b2d01f4459b1e90fd12cc7840e reported cstate change: term changed from 3 to 6, leader changed from 127766fc592545a4997f7790f50f6076 (127.17.223.4) to e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3). New cstate: current_term: 6 leader_uuid: "e61c3a8f61bb48f8a963c9480e53c168" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } } }
I20260709 13:05:19.937310 21992 raft_consensus.cc:493] T ff75a1d4cb1f493db8f71ddc136ba9ab P e61c3a8f61bb48f8a963c9480e53c168 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 0473d2b2d01f4459b1e90fd12cc7840e)
I20260709 13:05:20.051012 19480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14efcc79969f41babe5529c22d59156d" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:05:20.051209 19483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14935b3ddf914369822e4a0547aaa355" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:05:20.051983 19483 raft_consensus.cc:2468] T 14935b3ddf914369822e4a0547aaa355 P 0473d2b2d01f4459b1e90fd12cc7840e [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 127766fc592545a4997f7790f50f6076 in term 5.
I20260709 13:05:19.941300 22053 raft_consensus.cc:493] T ed7fdbcb96d14d418db9ca90a792588a P e61c3a8f61bb48f8a963c9480e53c168 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 0473d2b2d01f4459b1e90fd12cc7840e)
I20260709 13:05:19.947644 21976 raft_consensus.cc:493] T 3e1f505cb0f1427bbd698ac889d80821 P e61c3a8f61bb48f8a963c9480e53c168 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:19.950455 21559 raft_consensus.cc:493] T bc225c93219c45538b53a1bd3d387e4d P e61c3a8f61bb48f8a963c9480e53c168 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:20.080689 21559 raft_consensus.cc:515] T bc225c93219c45538b53a1bd3d387e4d P e61c3a8f61bb48f8a963c9480e53c168 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:20.080637 21976 raft_consensus.cc:515] T 3e1f505cb0f1427bbd698ac889d80821 P e61c3a8f61bb48f8a963c9480e53c168 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:19.835347 21932 raft_consensus.cc:515] T 775c229504194560ba9589bc2199b089 P 0473d2b2d01f4459b1e90fd12cc7840e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:05:19.940130 19449 leader_election.cc:304] T 217b5fae677b4971b3bbd2f357a1f7ff P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87; no voters: 
W20260709 13:05:20.082909 19479 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.559s	user 0.006s	sys 0.018s
W20260709 13:05:20.083247 19449 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.1:40321, user_credentials={real_user=slave}} blocked reactor thread for 143192us
I20260709 13:05:19.922067 21966 raft_consensus.cc:515] T a08760e15aac4630a629431f56024dc8 P e5256d91808b47c195bc9b4dbd7f2b87 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:19.922192 21700 raft_consensus.cc:515] T 7f575b143b844aa096b50997dad3516a P 0473d2b2d01f4459b1e90fd12cc7840e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:19.922293 21956 raft_consensus.cc:515] T b9f0d59553ad444883fcf5b5909f9798 P 0473d2b2d01f4459b1e90fd12cc7840e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
W20260709 13:05:19.983245 19403 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.622s	user 0.010s	sys 0.020s
I20260709 13:05:19.937584 21894 raft_consensus.cc:515] T ed7fdbcb96d14d418db9ca90a792588a P 127766fc592545a4997f7790f50f6076 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
W20260709 13:05:19.986375 19523 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.666s	user 0.010s	sys 0.019s
W20260709 13:05:20.102896 19403 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.741s	user 0.013s	sys 0.023s
W20260709 13:05:19.985528 20075 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.629s	user 0.006s	sys 0.025s
W20260709 13:05:20.103467 20075 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.1:40321, user_credentials={real_user=slave}} blocked reactor thread for 746782us
I20260709 13:05:20.104274 20075 leader_election.cc:304] T 14efcc79969f41babe5529c22d59156d P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 127766fc592545a4997f7790f50f6076, e5256d91808b47c195bc9b4dbd7f2b87; no voters: 
W20260709 13:05:19.991197 20109 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.632s	user 0.007s	sys 0.025s
W20260709 13:05:20.105441 20109 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.747s	user 0.007s	sys 0.025s
I20260709 13:05:19.787506 21962 raft_consensus.cc:515] T 179fd671030940b4b4a4e24bcc4aba0a P e5256d91808b47c195bc9b4dbd7f2b87 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:19.974251 21918 raft_consensus.cc:3060] T 14efcc79969f41babe5529c22d59156d P e5256d91808b47c195bc9b4dbd7f2b87 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:05:20.003937 19405 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.655s	user 0.017s	sys 0.027s
I20260709 13:05:19.998243 19477 raft_consensus.cc:2468] T f1b10566f45d4a7d9029858330e02d5b P 0473d2b2d01f4459b1e90fd12cc7840e [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 7.
I20260709 13:05:19.775766 22054 leader_election.cc:290] T 48824d5acfbc485ebf8c2d944e7202de P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:05:19.975848 21958 raft_consensus.cc:2804] T d1e5873a19244c5ebbcd38e126796ee7 P e5256d91808b47c195bc9b4dbd7f2b87 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:05:19.978304 22048 leader_election.cc:290] T 70797e5783b5454ab0d0eea663e791e3 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 8 election: Requested vote from peers e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:05:19.985704 21977 tablet_copy_client.cc:538] T 7be9efa6559648dbb5a0f7684c4542d1 P 127766fc592545a4997f7790f50f6076: tablet copy: Tablet Copy complete. Replacing tablet superblock.
W20260709 13:05:20.023792 22056 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.520s	user 0.005s	sys 0.018s
I20260709 13:05:19.937124 21971 raft_consensus.cc:493] T ece3db938bc649d4a40a51522ed5259c P e61c3a8f61bb48f8a963c9480e53c168 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 127766fc592545a4997f7790f50f6076)
I20260709 13:05:19.954840 21926 raft_consensus.cc:515] T ab43d85f64114d4ebf618930e43d9ed0 P e5256d91808b47c195bc9b4dbd7f2b87 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } attrs { replace: true } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:05:20.041530 21970 leader_election.cc:290] T 22196caba61445d3bec98a0aab3c337d P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
W20260709 13:05:20.042804 22084 log.cc:927] Time spent T 4509b76741dc428e9201c70c1658da13 P 0473d2b2d01f4459b1e90fd12cc7840e: Append to log took a long time: real 0.095s	user 0.001s	sys 0.000s
I20260709 13:05:19.813414 22044 raft_consensus.cc:515] T 2e36a9d6e29c4a7c860cf267efbd4c74 P e5256d91808b47c195bc9b4dbd7f2b87 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:20.054179 19480 raft_consensus.cc:2393] T 14efcc79969f41babe5529c22d59156d P 0473d2b2d01f4459b1e90fd12cc7840e [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 127766fc592545a4997f7790f50f6076 in current term 5: Already voted for candidate 0473d2b2d01f4459b1e90fd12cc7840e in this term.
I20260709 13:05:20.055475 19306 catalog_manager.cc:5697] T 0afb57ae58a24a01850491d69f0213dd P 0473d2b2d01f4459b1e90fd12cc7840e reported cstate change: term changed from 4 to 5, leader changed from 127766fc592545a4997f7790f50f6076 (127.17.223.4) to e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3). New cstate: current_term: 5 leader_uuid: "e61c3a8f61bb48f8a963c9480e53c168" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } } }
I20260709 13:05:20.151808 19306 catalog_manager.cc:5697] T 1a61655d99124a29b486ba4a5b37faea P 0473d2b2d01f4459b1e90fd12cc7840e reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:20.058271 21963 leader_election.cc:290] T f1b10566f45d4a7d9029858330e02d5b P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:05:20.058652 22007 leader_election.cc:290] T 40e1e16737a842ee936002830f36882e P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:05:20.059051 21833 leader_election.cc:290] T df751f992649444090e27965eb1af85d P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
W20260709 13:05:20.059329 22079 log.cc:927] Time spent T 179fd671030940b4b4a4e24bcc4aba0a P 0473d2b2d01f4459b1e90fd12cc7840e: Append to log took a long time: real 0.159s	user 0.001s	sys 0.000s
I20260709 13:05:19.980821 22066 raft_consensus.cc:515] T 3e1f505cb0f1427bbd698ac889d80821 P e5256d91808b47c195bc9b4dbd7f2b87 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:19.997936 21849 raft_consensus.cc:515] T 40e1e16737a842ee936002830f36882e P e5256d91808b47c195bc9b4dbd7f2b87 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:20.052534 22040 raft_consensus.cc:515] T 65d8cb8d6ec64f459d5a47cefab10acf P 127766fc592545a4997f7790f50f6076 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:05:20.050060 21916 raft_consensus.cc:3060] T 217b5fae677b4971b3bbd2f357a1f7ff P e5256d91808b47c195bc9b4dbd7f2b87 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:05:20.040853 21823 raft_consensus.cc:515] T 65d8cb8d6ec64f459d5a47cefab10acf P e5256d91808b47c195bc9b4dbd7f2b87 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:05:20.040577 22064 raft_consensus.cc:515] T 2a16f7501e2444fb86d4e2778e734e02 P e5256d91808b47c195bc9b4dbd7f2b87 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:05:20.062661 22076 leader_election.cc:290] T 3e1f505cb0f1427bbd698ac889d80821 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:05:20.075804 22050 leader_election.cc:290] T 0afb57ae58a24a01850491d69f0213dd P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:05:20.077702 22063 leader_election.cc:290] T ef32ce6fdd0e40d382c79974f30295c6 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:05:20.079207 22049 leader_election.cc:290] T 85c494af21f9457a85da47b9bc70c1fd P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
W20260709 13:05:20.083340 19479 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.559s	user 0.006s	sys 0.018s
I20260709 13:05:19.656052 21968 leader_election.cc:290] T bc225c93219c45538b53a1bd3d387e4d P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:05:20.095541 19485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36f6ba92b9ba46babe4ebd6c02e5fbd9" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:05:20.084475 19449 leader_election.cc:304] T b08304a0a02b42d7840c4e8ee9a6bd1a P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87; no voters: 
I20260709 13:05:20.100526 19481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ec1c4ce15e04c7e8c283a62179f2a64" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
W20260709 13:05:20.125833 22056 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.623s	user 0.005s	sys 0.019s
I20260709 13:05:20.123575 21958 raft_consensus.cc:493] T d1e5873a19244c5ebbcd38e126796ee7 P e5256d91808b47c195bc9b4dbd7f2b87 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:20.083436 21992 raft_consensus.cc:515] T ff75a1d4cb1f493db8f71ddc136ba9ab P e61c3a8f61bb48f8a963c9480e53c168 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:20.075943 19552 raft_consensus.cc:2468] T 14935b3ddf914369822e4a0547aaa355 P e61c3a8f61bb48f8a963c9480e53c168 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 5.
W20260709 13:05:20.102936 19523 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.790s	user 0.010s	sys 0.020s
W20260709 13:05:19.986414 19525 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.674s	user 0.017s	sys 0.023s
I20260709 13:05:20.110622 19555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62c6c134d3d24a1ab144dd9ee6bc3f64" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:05:20.112962 19554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48824d5acfbc485ebf8c2d944e7202de" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:05:20.116081 19560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e5873a19244c5ebbcd38e126796ee7" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:05:20.119834 19483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "309c3ca0ca4b4f3ba129752ea2cb293b" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:05:20.117817 19484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0afb57ae58a24a01850491d69f0213dd" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:05:20.124750 19558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc225c93219c45538b53a1bd3d387e4d" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:05:20.126266 20109 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46436 (request call id 449) took 1552 ms. Trace:
I20260709 13:05:20.126991 19553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46c5bfeecc314717bffe987e6844b6d0" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 11 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:05:20.123157 19482 raft_consensus.cc:2468] T b9f0d59553ad444883fcf5b5909f9798 P 0473d2b2d01f4459b1e90fd12cc7840e [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 6.
I20260709 13:05:20.130373 19559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76cb037fc9064d13b59a8969d897ce8c" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:05:20.098227 22011 raft_consensus.cc:2804] T 217b5fae677b4971b3bbd2f357a1f7ff P 0473d2b2d01f4459b1e90fd12cc7840e [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:05:20.024091 22057 raft_consensus.cc:515] T 1f85fc4b527a48848e5faa083b604e36 P 0473d2b2d01f4459b1e90fd12cc7840e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
W20260709 13:05:20.148540 19375 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.3:36891, user_credentials={real_user=slave}} blocked reactor thread for 247480us
I20260709 13:05:20.173048 22048 raft_consensus.cc:493] T 1a61655d99124a29b486ba4a5b37faea P e5256d91808b47c195bc9b4dbd7f2b87 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 0473d2b2d01f4459b1e90fd12cc7840e)
I20260709 13:05:20.177502 22021 raft_consensus.cc:493] T 9962423cb4e54fcfa5de01daf68a86e7 P 127766fc592545a4997f7790f50f6076 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 0473d2b2d01f4459b1e90fd12cc7840e)
W20260709 13:05:20.063920 19410 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.564s	user 0.015s	sys 0.035s
I20260709 13:05:20.092617 22053 raft_consensus.cc:515] T ed7fdbcb96d14d418db9ca90a792588a P e61c3a8f61bb48f8a963c9480e53c168 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:05:20.121455 21911 consensus_queue.cc:260] T 833a2f0775ed407a94b8924ce50adb63 P 127766fc592545a4997f7790f50f6076 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:05:20.733043 19486 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58286 (request call id 1511) took 2301 ms. Trace:
I20260709 13:05:20.733500 21926 leader_election.cc:290] T ab43d85f64114d4ebf618930e43d9ed0 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:05:20.734371 21894 leader_election.cc:290] T ed7fdbcb96d14d418db9ca90a792588a P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:05:20.515272 21962 leader_election.cc:290] T 179fd671030940b4b4a4e24bcc4aba0a P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:05:20.735000 22040 leader_election.cc:290] T 65d8cb8d6ec64f459d5a47cefab10acf P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:05:20.520424 21956 leader_election.cc:290] T b9f0d59553ad444883fcf5b5909f9798 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:05:20.735874 21963 raft_consensus.cc:2804] T b08304a0a02b42d7840c4e8ee9a6bd1a P 0473d2b2d01f4459b1e90fd12cc7840e [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:05:20.668179 22041 raft_consensus.cc:493] T ab43d85f64114d4ebf618930e43d9ed0 P 127766fc592545a4997f7790f50f6076 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader e61c3a8f61bb48f8a963c9480e53c168)
I20260709 13:05:20.736382 21963 raft_consensus.cc:493] T b08304a0a02b42d7840c4e8ee9a6bd1a P 0473d2b2d01f4459b1e90fd12cc7840e [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:20.737131 21963 raft_consensus.cc:3060] T b08304a0a02b42d7840c4e8ee9a6bd1a P 0473d2b2d01f4459b1e90fd12cc7840e [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:05:20.737208 22011 raft_consensus.cc:493] T 217b5fae677b4971b3bbd2f357a1f7ff P 0473d2b2d01f4459b1e90fd12cc7840e [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:20.737707 22011 raft_consensus.cc:3060] T 217b5fae677b4971b3bbd2f357a1f7ff P 0473d2b2d01f4459b1e90fd12cc7840e [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:05:20.738229 19483 raft_consensus.cc:2468] T 309c3ca0ca4b4f3ba129752ea2cb293b P 0473d2b2d01f4459b1e90fd12cc7840e [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 127766fc592545a4997f7790f50f6076 in term 6.
W20260709 13:05:20.369313 21731 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.502s	user 0.010s	sys 0.039s
W20260709 13:05:20.739562 21731 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.132s	user 0.010s	sys 0.057s
I20260709 13:05:20.400602 19403 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52328 (request call id 1546) took 1072 ms. Trace:
I20260709 13:05:20.740681 19403 rpcz_store.cc:276] 0709 13:05:19.327991 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:19.328719 (+   728us) service_pool.cc:224] Handling call
0709 13:05:19.329084 (+   365us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:19.329319 (+   235us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 13:05:20.106190 (+776871us) log.cc:844] Serialized 14 byte log entry
0709 13:05:20.400225 (+294035us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:05:20.400280 (+    55us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:05:20.400333 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:20.400409 (+    76us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:20.400531 (+   122us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":1255026,"prepare.run_cpu_time_us":44,"prepare.run_wall_time_us":46,"raft.queue_time_us":98,"raft.run_cpu_time_us":183,"raft.run_wall_time_us":26374,"thread_start_us":1038333,"threads_started":2,"wal-append.queue_time_us":624026}
W20260709 13:05:20.742776 19525 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.438s	user 0.019s	sys 0.047s
I20260709 13:05:20.743593 19484 raft_consensus.cc:3060] T 0afb57ae58a24a01850491d69f0213dd P 0473d2b2d01f4459b1e90fd12cc7840e [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:05:20.744375 22027 raft_consensus.cc:493] T 6c5eebf646ad445a9d1b1adc319d7b16 P e61c3a8f61bb48f8a963c9480e53c168 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 127766fc592545a4997f7790f50f6076)
I20260709 13:05:20.744447 19556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b74109013a140ada21feeef92d6f563" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:05:20.745134 19556 raft_consensus.cc:2468] T 2b74109013a140ada21feeef92d6f563 P e61c3a8f61bb48f8a963c9480e53c168 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 3.
I20260709 13:05:20.744982 22027 raft_consensus.cc:515] T 6c5eebf646ad445a9d1b1adc319d7b16 P e61c3a8f61bb48f8a963c9480e53c168 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:05:20.746698 22089 raft_consensus.cc:493] T 7f575b143b844aa096b50997dad3516a P e61c3a8f61bb48f8a963c9480e53c168 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e5256d91808b47c195bc9b4dbd7f2b87)
I20260709 13:05:20.747366 22027 leader_election.cc:290] T 6c5eebf646ad445a9d1b1adc319d7b16 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:05:20.747200 22089 raft_consensus.cc:515] T 7f575b143b844aa096b50997dad3516a P e61c3a8f61bb48f8a963c9480e53c168 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:20.592983 19405 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52328 (request call id 1547) took 1258 ms. Trace:
I20260709 13:05:20.749205 19554 raft_consensus.cc:2468] T 48824d5acfbc485ebf8c2d944e7202de P e61c3a8f61bb48f8a963c9480e53c168 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 4.
I20260709 13:05:20.749159 19405 rpcz_store.cc:276] 0709 13:05:19.334155 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:19.334299 (+   144us) service_pool.cc:224] Handling call
0709 13:05:19.334752 (+   453us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:05:19.335143 (+   391us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:05:19.335173 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:05:19.348578 (+ 13405us) log.cc:844] Serialized 26 byte log entry
0709 13:05:19.655816 (+307238us) spinlock_profiling.cc:243] Waited 14 ms on lock 0x7b4800002958. stack: 00007f4a79de9343 00007f4a79de9240 00007f4a797781d4 00007f4a834b6304 00007f4a834b6299 00007f4a81e31aa1 00007f4a81e28b37 00007f4a81e289ca 00007f4a81f2026f 00007f4a81f1ff37 00007f4a81f3455c 00007f4a81f34508 00007f4a81f34488 00007f4a81f34443 00007f4a81f336ec 00007f4a80e5da96
0709 13:05:20.106170 (+450354us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:05:20.106209 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:20.106274 (+    65us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:05:20.592561 (+486287us) raft_consensus.cc:1685] finished
0709 13:05:20.592594 (+    33us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:20.592902 (+   308us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":324,"raft.run_cpu_time_us":2476,"raft.run_wall_time_us":312108,"spinlock_wait_cycles":32173952,"thread_start_us":757159,"threads_started":1,"wal-append.queue_time_us":1241939}
I20260709 13:05:20.735277 19485 raft_consensus.cc:2468] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P 0473d2b2d01f4459b1e90fd12cc7840e [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 127766fc592545a4997f7790f50f6076 in term 7.
I20260709 13:05:20.751786 19375 leader_election.cc:304] T 309c3ca0ca4b4f3ba129752ea2cb293b P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87; no voters: 127766fc592545a4997f7790f50f6076, e61c3a8f61bb48f8a963c9480e53c168
W20260709 13:05:20.479238 20075 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.1:40321, user_credentials={real_user=slave}} blocked reactor thread for 359824us
I20260709 13:05:20.752628 19375 leader_election.cc:304] T 21e14947d70440f19044d8f75c31e1f9 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:05:20.752784 20075 leader_election.cc:304] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 127766fc592545a4997f7790f50f6076, e5256d91808b47c195bc9b4dbd7f2b87; no voters: 
I20260709 13:05:20.753261 19553 raft_consensus.cc:2468] T 46c5bfeecc314717bffe987e6844b6d0 P e61c3a8f61bb48f8a963c9480e53c168 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 10.
I20260709 13:05:20.753933 20075 leader_election.cc:304] T 5ec1c4ce15e04c7e8c283a62179f2a64 P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 127766fc592545a4997f7790f50f6076, e5256d91808b47c195bc9b4dbd7f2b87; no voters: 
I20260709 13:05:20.754410 19481 raft_consensus.cc:2468] T 5ec1c4ce15e04c7e8c283a62179f2a64 P 0473d2b2d01f4459b1e90fd12cc7840e [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 127766fc592545a4997f7790f50f6076 in term 3.
W20260709 13:05:20.751400 19523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.1:40321, user_credentials={real_user=slave}} blocked reactor thread for 1.66047e+06us
I20260709 13:05:20.723417 21929 raft_consensus.cc:493] T ff9b0eddd810459b82d91c60777c10eb P e5256d91808b47c195bc9b4dbd7f2b87 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 127766fc592545a4997f7790f50f6076)
I20260709 13:05:20.766299 22063 raft_consensus.cc:2804] T 21e14947d70440f19044d8f75c31e1f9 P e5256d91808b47c195bc9b4dbd7f2b87 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:05:20.766822 22063 raft_consensus.cc:493] T 21e14947d70440f19044d8f75c31e1f9 P e5256d91808b47c195bc9b4dbd7f2b87 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:20.766582 21929 raft_consensus.cc:515] T ff9b0eddd810459b82d91c60777c10eb P e5256d91808b47c195bc9b4dbd7f2b87 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:05:20.767316 22063 raft_consensus.cc:3060] T 21e14947d70440f19044d8f75c31e1f9 P e5256d91808b47c195bc9b4dbd7f2b87 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:05:20.733563 19486 rpcz_store.cc:276] 0709 13:05:18.431238 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:18.432213 (+   975us) service_pool.cc:224] Handling call
0709 13:05:18.432580 (+   367us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:05:18.728886 (+296306us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:05:18.728913 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:05:19.029995 (+301082us) spinlock_profiling.cc:243] Waited 1.61 ms on lock 0x7b2c000010a8. stack: 00007f4a79de9343 00007f4a79de9240 00007f4a797781d4 00007f4a834b6304 00007f4a834b6299 00007f4a7b801a11 00007f4a7b811372 00007f4a7cf43a01 00007f4a7cf0843a 00007f4a7cf0783e 00007f4a81ecc419 00007f4a7b443bd4 00007f4a7b443b62 00007f4a7b443a91 00007f4a7b443a0c 00007f4a7b442cc2
0709 13:05:19.030413 (+   418us) log.cc:844] Serialized 26 byte log entry
0709 13:05:19.375926 (+345513us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:05:19.375981 (+    55us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:19.376069 (+    88us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:05:20.729122 (+1353053us) raft_consensus.cc:1685] finished
0709 13:05:20.729150 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:20.732954 (+  3804us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":63529,"raft.run_cpu_time_us":194,"raft.run_wall_time_us":72950,"spinlock_wait_cycles":3694848,"thread_start_us":640972,"threads_started":2,"wal-append.queue_time_us":742088}
I20260709 13:05:20.153908 19306 catalog_manager.cc:5697] T f1b10566f45d4a7d9029858330e02d5b P 0473d2b2d01f4459b1e90fd12cc7840e reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } health_report { overall_health: HEALTHY } } }
I20260709 13:05:20.755736 20112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85c494af21f9457a85da47b9bc70c1fd" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:05:20.756220 19551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14935b3ddf914369822e4a0547aaa355" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:05:20.773305 20112 raft_consensus.cc:2468] T 85c494af21f9457a85da47b9bc70c1fd P 127766fc592545a4997f7790f50f6076 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 3.
I20260709 13:05:20.773368 19551 raft_consensus.cc:2468] T 14935b3ddf914369822e4a0547aaa355 P e61c3a8f61bb48f8a963c9480e53c168 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 127766fc592545a4997f7790f50f6076 in term 5.
I20260709 13:05:20.774521 19551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70797e5783b5454ab0d0eea663e791e3" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:05:20.775303 19551 raft_consensus.cc:2393] T 70797e5783b5454ab0d0eea663e791e3 P e61c3a8f61bb48f8a963c9480e53c168 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 127766fc592545a4997f7790f50f6076 in current term 7: Already voted for candidate e61c3a8f61bb48f8a963c9480e53c168 in this term.
I20260709 13:05:20.756436 19558 raft_consensus.cc:2468] T bc225c93219c45538b53a1bd3d387e4d P e61c3a8f61bb48f8a963c9480e53c168 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 8.
I20260709 13:05:20.121304 21957 raft_consensus.cc:3060] T 2725d2c4cb054f18b0fc8f735c15f6c2 P e5256d91808b47c195bc9b4dbd7f2b87 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:05:20.177868 19480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96efeaaf1057492490e9a621f37e1a2d" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:05:20.757133 19557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0afb57ae58a24a01850491d69f0213dd" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:05:20.777825 19557 raft_consensus.cc:2393] T 0afb57ae58a24a01850491d69f0213dd P e61c3a8f61bb48f8a963c9480e53c168 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 127766fc592545a4997f7790f50f6076 in current term 7: Already voted for candidate e61c3a8f61bb48f8a963c9480e53c168 in this term.
I20260709 13:05:20.778561 19557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4509b76741dc428e9201c70c1658da13" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:05:20.779628 19557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df751f992649444090e27965eb1af85d" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:05:20.780157 19557 raft_consensus.cc:2468] T df751f992649444090e27965eb1af85d P e61c3a8f61bb48f8a963c9480e53c168 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 6.
I20260709 13:05:20.780853 19557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ece3db938bc649d4a40a51522ed5259c" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:05:20.742442 21849 leader_election.cc:290] T 40e1e16737a842ee936002830f36882e P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:05:20.749312 22089 leader_election.cc:290] T 7f575b143b844aa096b50997dad3516a P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:05:20.758863 20103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70797e5783b5454ab0d0eea663e791e3" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076"
I20260709 13:05:20.793066 20103 raft_consensus.cc:3060] T 70797e5783b5454ab0d0eea663e791e3 P 127766fc592545a4997f7790f50f6076 [term 6 FOLLOWER]: Advancing to term 8
I20260709 13:05:20.794507 19558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e1f505cb0f1427bbd698ac889d80821" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:05:20.795113 19558 raft_consensus.cc:2468] T 3e1f505cb0f1427bbd698ac889d80821 P e61c3a8f61bb48f8a963c9480e53c168 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 5.
W20260709 13:05:20.795363 20078 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:20.795907 19558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40e1e16737a842ee936002830f36882e" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:05:20.759254 21911 raft_consensus.cc:3060] T 833a2f0775ed407a94b8924ce50adb63 P 127766fc592545a4997f7790f50f6076 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:05:20.759903 22048 raft_consensus.cc:515] T 1a61655d99124a29b486ba4a5b37faea P e5256d91808b47c195bc9b4dbd7f2b87 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:20.799763 19559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "309c3ca0ca4b4f3ba129752ea2cb293b" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:05:20.761152 22053 leader_election.cc:290] T ed7fdbcb96d14d418db9ca90a792588a P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:05:20.150954 21971 raft_consensus.cc:515] T ece3db938bc649d4a40a51522ed5259c P e61c3a8f61bb48f8a963c9480e53c168 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:05:20.732534 21700 leader_election.cc:290] T 7f575b143b844aa096b50997dad3516a P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:05:20.128895 21559 leader_election.cc:290] T bc225c93219c45538b53a1bd3d387e4d P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:05:20.762554 21962 raft_consensus.cc:2749] T 309c3ca0ca4b4f3ba129752ea2cb293b P e5256d91808b47c195bc9b4dbd7f2b87 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:05:20.507042 21976 leader_election.cc:290] T 3e1f505cb0f1427bbd698ac889d80821 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
W20260709 13:05:20.764111 21918 consensus_meta.cc:287] T 14efcc79969f41babe5529c22d59156d P e5256d91808b47c195bc9b4dbd7f2b87: Time spent flushing consensus metadata: real 0.637s	user 0.008s	sys 0.001s
I20260709 13:05:20.827157 21918 raft_consensus.cc:515] T 14efcc79969f41babe5529c22d59156d P e5256d91808b47c195bc9b4dbd7f2b87 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:05:20.817013 22101 raft_consensus.cc:493] T 775c229504194560ba9589bc2199b089 P e5256d91808b47c195bc9b4dbd7f2b87 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 127766fc592545a4997f7790f50f6076)
I20260709 13:05:20.828214 22101 raft_consensus.cc:515] T 775c229504194560ba9589bc2199b089 P e5256d91808b47c195bc9b4dbd7f2b87 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:05:20.829263 21918 leader_election.cc:290] T 14efcc79969f41babe5529c22d59156d P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 6 election: Requested vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:05:20.764055 22056 raft_consensus.cc:2804] T 5ec1c4ce15e04c7e8c283a62179f2a64 P 127766fc592545a4997f7790f50f6076 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:05:20.829957 22056 raft_consensus.cc:493] T 5ec1c4ce15e04c7e8c283a62179f2a64 P 127766fc592545a4997f7790f50f6076 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:20.830215 22101 leader_election.cc:290] T 775c229504194560ba9589bc2199b089 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:05:20.830333 22056 raft_consensus.cc:3060] T 5ec1c4ce15e04c7e8c283a62179f2a64 P 127766fc592545a4997f7790f50f6076 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:05:20.830950 19293 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 309c3ca0ca4b4f3ba129752ea2cb293b with cas_config_opid_index 5: ChangeConfig:REMOVE_PEER failed with leader e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica e5256d91808b47c195bc9b4dbd7f2b87 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 6 committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } attrs { replace: true } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } } }
I20260709 13:05:20.833217 19406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e381f1d6b8184797ad142de49be225a8" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:05:20.834023 19406 raft_consensus.cc:2410] T e381f1d6b8184797ad142de49be225a8 P e5256d91808b47c195bc9b4dbd7f2b87 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e61c3a8f61bb48f8a963c9480e53c168 for term 6 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 3.
I20260709 13:05:20.589298 21966 leader_election.cc:290] T a08760e15aac4630a629431f56024dc8 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:05:20.835086 19402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e5873a19244c5ebbcd38e126796ee7" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:05:20.835484 19405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21e14947d70440f19044d8f75c31e1f9" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:05:20.836410 19403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a61655d99124a29b486ba4a5b37faea" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:05:20.837021 19403 raft_consensus.cc:2468] T 1a61655d99124a29b486ba4a5b37faea P e5256d91808b47c195bc9b4dbd7f2b87 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 3.
I20260709 13:05:20.838070 19404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b08304a0a02b42d7840c4e8ee9a6bd1a" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:05:20.800621 21849 raft_consensus.cc:493] T 9962423cb4e54fcfa5de01daf68a86e7 P e5256d91808b47c195bc9b4dbd7f2b87 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 0473d2b2d01f4459b1e90fd12cc7840e)
I20260709 13:05:20.838701 19404 raft_consensus.cc:2468] T b08304a0a02b42d7840c4e8ee9a6bd1a P e5256d91808b47c195bc9b4dbd7f2b87 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 6.
W20260709 13:05:20.180372 22085 log.cc:927] Time spent T 309c3ca0ca4b4f3ba129752ea2cb293b P 127766fc592545a4997f7790f50f6076: Append to log took a long time: real 0.082s	user 0.000s	sys 0.000s
I20260709 13:05:20.839006 21849 raft_consensus.cc:515] T 9962423cb4e54fcfa5de01daf68a86e7 P e5256d91808b47c195bc9b4dbd7f2b87 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:05:20.765585 22057 leader_election.cc:290] T 1f85fc4b527a48848e5faa083b604e36 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:05:20.840446 20107 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46422 (request call id 548) took 1674 ms. Trace:
I20260709 13:05:20.727784 22044 leader_election.cc:290] T 2e36a9d6e29c4a7c860cf267efbd4c74 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:05:20.765951 21823 leader_election.cc:290] T 65d8cb8d6ec64f459d5a47cefab10acf P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:05:20.840991 21849 leader_election.cc:290] T 9962423cb4e54fcfa5de01daf68a86e7 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:05:20.734737 19555 raft_consensus.cc:2468] T 62c6c134d3d24a1ab144dd9ee6bc3f64 P e61c3a8f61bb48f8a963c9480e53c168 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 7.
I20260709 13:05:20.732440 21932 leader_election.cc:290] T 775c229504194560ba9589bc2199b089 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:05:20.843164 20105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62c6c134d3d24a1ab144dd9ee6bc3f64" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:05:20.769459 21958 raft_consensus.cc:3060] T d1e5873a19244c5ebbcd38e126796ee7 P e5256d91808b47c195bc9b4dbd7f2b87 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:05:20.599216 21980 raft_consensus.cc:493] T 4af19371ea874c09a0a2147040835cbb P e5256d91808b47c195bc9b4dbd7f2b87 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 127766fc592545a4997f7790f50f6076)
I20260709 13:05:20.846978 21980 raft_consensus.cc:515] T 4af19371ea874c09a0a2147040835cbb P e5256d91808b47c195bc9b4dbd7f2b87 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:05:20.847159 20112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e1085d23e8347fbbd5bce7542f4b1f4" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:05:20.739904 22041 raft_consensus.cc:515] T ab43d85f64114d4ebf618930e43d9ed0 P 127766fc592545a4997f7790f50f6076 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } attrs { replace: true } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:05:20.751158 19560 raft_consensus.cc:2468] T d1e5873a19244c5ebbcd38e126796ee7 P e61c3a8f61bb48f8a963c9480e53c168 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 7.
I20260709 13:05:20.748613 22066 leader_election.cc:290] T 3e1f505cb0f1427bbd698ac889d80821 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:05:20.753934 19479 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58286 (request call id 1518) took 2216 ms. Trace:
I20260709 13:05:20.842576 20111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0afb57ae58a24a01850491d69f0213dd" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076"
W20260709 13:05:20.736925 19449 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.1:40321, user_credentials={real_user=slave}} blocked reactor thread for 652463us
I20260709 13:05:20.859331 20111 raft_consensus.cc:2393] T 0afb57ae58a24a01850491d69f0213dd P 127766fc592545a4997f7790f50f6076 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate e61c3a8f61bb48f8a963c9480e53c168 in current term 7: Already voted for candidate 127766fc592545a4997f7790f50f6076 in this term.
I20260709 13:05:20.151311 21892 raft_consensus.cc:2804] T 14efcc79969f41babe5529c22d59156d P 127766fc592545a4997f7790f50f6076 [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 13:05:20.751381 19410 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.252s	user 0.018s	sys 0.045s
I20260709 13:05:20.868120 19404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76cb037fc9064d13b59a8969d897ce8c" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:05:20.868547 19410 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49050 (request call id 320) took 1574 ms. Trace:
I20260709 13:05:20.840768 20107 rpcz_store.cc:276] 0709 13:05:19.165621 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:19.165777 (+   156us) service_pool.cc:224] Handling call
0709 13:05:19.175577 (+  9800us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:05:19.176036 (+   459us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:05:19.176075 (+    39us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:05:19.176657 (+   582us) log.cc:844] Serialized 26 byte log entry
0709 13:05:19.597705 (+421048us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:05:19.597763 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:19.597858 (+    95us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:05:20.840264 (+1242406us) raft_consensus.cc:1685] finished
0709 13:05:20.840283 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:20.840393 (+   110us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1292,"raft.run_cpu_time_us":138,"raft.run_wall_time_us":138,"thread_start_us":420562,"threads_started":1,"wal-append.queue_time_us":807102}
I20260709 13:05:20.868883 19410 rpcz_store.cc:276] 0709 13:05:19.294257 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:19.294426 (+   169us) service_pool.cc:224] Handling call
0709 13:05:19.317275 (+ 22849us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:05:19.323375 (+  6100us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:05:19.323419 (+    44us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:05:19.346734 (+ 23315us) log.cc:844] Serialized 26 byte log entry
0709 13:05:20.868214 (+1521480us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:05:20.868253 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:20.868325 (+    72us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:05:20.868379 (+    54us) raft_consensus.cc:1685] finished
0709 13:05:20.868391 (+    12us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:20.868498 (+   107us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":5640,"raft.queue_time_us":6267,"raft.run_cpu_time_us":196,"raft.run_wall_time_us":34361,"thread_start_us":1368715,"threads_started":1,"wal-append.queue_time_us":766345}
I20260709 13:05:20.785737 19551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "309c3ca0ca4b4f3ba129752ea2cb293b" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:05:20.755905 20109 rpcz_store.cc:276] 0709 13:05:18.573977 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:18.574262 (+   285us) service_pool.cc:224] Handling call
0709 13:05:18.574634 (+   372us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:18.574916 (+   282us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:05:19.358432 (+783516us) log.cc:844] Serialized 14 byte log entry
0709 13:05:20.125926 (+767494us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:05:20.125977 (+    51us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:05:20.126020 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:20.126086 (+    66us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:20.126216 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":13435,"prepare.queue_time_us":803440,"prepare.run_cpu_time_us":63,"prepare.run_wall_time_us":77908,"raft.queue_time_us":40149,"raft.run_cpu_time_us":146,"raft.run_wall_time_us":26506,"thread_start_us":1490664,"threads_started":2,"wal-append.queue_time_us":818997}
I20260709 13:05:20.787747 19482 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58294 (request call id 1672) took 1211 ms. Trace:
I20260709 13:05:20.787943 19484 raft_consensus.cc:2468] T 0afb57ae58a24a01850491d69f0213dd P 0473d2b2d01f4459b1e90fd12cc7840e [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 127766fc592545a4997f7790f50f6076 in term 7.
I20260709 13:05:20.870975 19557 raft_consensus.cc:2468] T ece3db938bc649d4a40a51522ed5259c P e61c3a8f61bb48f8a963c9480e53c168 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 5.
I20260709 13:05:20.870798 19482 rpcz_store.cc:276] 0709 13:05:19.564423 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:19.564554 (+   131us) service_pool.cc:224] Handling call
0709 13:05:20.775804 (+1211250us) spinlock_profiling.cc:243] Waited 287 ms on lock 0x7b54003e94d4. stack: 00007f4a79de9343 00007f4a79de9240 00007f4a797781d4 00007f4a834b6304 00007f4a834b6299 00007f4a7ce71571 00007f4a7cf0c2fa 00007f4a81ecdb17 00007f4a7b4486d4 00007f4a7b448662 00007f4a7b448591 00007f4a7b44850c 00007f4a7b4477c2 00007f4a7b24348c 00007f4a7b2428c6 00007f4a7b24226f
0709 13:05:20.775897 (+    93us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":661115136}
I20260709 13:05:20.857936 19479 rpcz_store.cc:276] 0709 13:05:18.537437 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:18.537578 (+   141us) service_pool.cc:224] Handling call
0709 13:05:19.523049 (+985471us) spinlock_profiling.cc:243] Waited 36.3 ms on lock 0x7b58001b9998. stack: 00007f4a79de9343 00007f4a79de9240 00007f4a797781d4 00007f4a834b6304 00007f4a834b6299 00007f4a79ca3db1 00007f4a79de3b71 00007f4a79de3a22 00007f4a82cfcc09 00007f4a81e56ee0 00007f4a81f200ab 00007f4a81f20131 00007f4a81ee1fc0 00007f4a81ecc929 00007f4a81ecc3d2 00007f4a7b443bd4
0709 13:05:19.523246 (+   197us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:19.523455 (+   209us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 13:05:19.523696 (+   241us) log.cc:844] Serialized 14 byte log entry
0709 13:05:20.753620 (+1229924us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:05:20.753668 (+    48us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:05:20.753726 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:20.753794 (+    68us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:20.753883 (+    89us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":2094,"prepare.run_cpu_time_us":40,"prepare.run_wall_time_us":42,"raft.queue_time_us":6028,"raft.run_cpu_time_us":90,"raft.run_wall_time_us":91,"spinlock_wait_cycles":83429632,"thread_start_us":1229645,"threads_started":1,"wal-append.queue_time_us":774449}
I20260709 13:05:20.776577 19306 catalog_manager.cc:5697] T 14935b3ddf914369822e4a0547aaa355 P 0473d2b2d01f4459b1e90fd12cc7840e reported cstate change: config changed from index 2 to 4, term changed from 2 to 4, 127766fc592545a4997f7790f50f6076 (127.17.223.4) changed from NON_VOTER to VOTER. New cstate: current_term: 4 leader_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } attrs { replace: true } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } } }
I20260709 13:05:20.790910 20075 leader_election.cc:400] T 70797e5783b5454ab0d0eea663e791e3 P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 7 pre-election: Vote denied by peer e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321) with higher term. Message: Invalid argument: T 70797e5783b5454ab0d0eea663e791e3 P e5256d91808b47c195bc9b4dbd7f2b87 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 127766fc592545a4997f7790f50f6076 for earlier term 7. Current term is 8.
I20260709 13:05:20.872375 20075 leader_election.cc:403] T 70797e5783b5454ab0d0eea663e791e3 P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 7 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:05:20.173453 21867 raft_consensus.cc:493] T ff75a1d4cb1f493db8f71ddc136ba9ab P e5256d91808b47c195bc9b4dbd7f2b87 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 0473d2b2d01f4459b1e90fd12cc7840e)
I20260709 13:05:20.762589 21963 raft_consensus.cc:515] T b08304a0a02b42d7840c4e8ee9a6bd1a P 0473d2b2d01f4459b1e90fd12cc7840e [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:20.304440 21529 raft_consensus.cc:515] T 217b5fae677b4971b3bbd2f357a1f7ff P e61c3a8f61bb48f8a963c9480e53c168 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:20.759512 20104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab43d85f64114d4ebf618930e43d9ed0" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:05:20.775168 22021 raft_consensus.cc:515] T 9962423cb4e54fcfa5de01daf68a86e7 P 127766fc592545a4997f7790f50f6076 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:05:20.882375 20103 raft_consensus.cc:2468] T 70797e5783b5454ab0d0eea663e791e3 P 127766fc592545a4997f7790f50f6076 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 8.
I20260709 13:05:20.802651 19552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1b10566f45d4a7d9029858330e02d5b" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:05:20.895340 19552 raft_consensus.cc:2468] T f1b10566f45d4a7d9029858330e02d5b P e61c3a8f61bb48f8a963c9480e53c168 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 6.
I20260709 13:05:20.896157 19552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e1f505cb0f1427bbd698ac889d80821" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:05:20.896710 19552 raft_consensus.cc:2468] T 3e1f505cb0f1427bbd698ac889d80821 P e61c3a8f61bb48f8a963c9480e53c168 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 5.
I20260709 13:05:20.897439 19552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7be9efa6559648dbb5a0f7684c4542d1" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:05:20.898160 19552 raft_consensus.cc:2410] T 7be9efa6559648dbb5a0f7684c4542d1 P e61c3a8f61bb48f8a963c9480e53c168 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e5256d91808b47c195bc9b4dbd7f2b87 for term 7 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 3.
I20260709 13:05:20.802088 19554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46c5bfeecc314717bffe987e6844b6d0" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 11 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:05:20.898623 19554 raft_consensus.cc:2468] T 46c5bfeecc314717bffe987e6844b6d0 P e61c3a8f61bb48f8a963c9480e53c168 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 10.
I20260709 13:05:20.899415 19554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a08760e15aac4630a629431f56024dc8" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:05:20.899863 19479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46c5bfeecc314717bffe987e6844b6d0" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 11 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:05:20.900318 19554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "179fd671030940b4b4a4e24bcc4aba0a" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:05:20.900926 19554 raft_consensus.cc:2468] T 179fd671030940b4b4a4e24bcc4aba0a P e61c3a8f61bb48f8a963c9480e53c168 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 5.
I20260709 13:05:20.803572 19558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28af091831594f9d8e96482078cc7625" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:05:20.804253 19374 leader_election.cc:304] T 5ec1c4ce15e04c7e8c283a62179f2a64 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 127766fc592545a4997f7790f50f6076, e5256d91808b47c195bc9b4dbd7f2b87; no voters: 
I20260709 13:05:20.761973 22064 leader_election.cc:290] T 2a16f7501e2444fb86d4e2778e734e02 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:05:20.762020 22107 raft_consensus.cc:2804] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P 127766fc592545a4997f7790f50f6076 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:05:20.810866 22048 leader_election.cc:290] T 1a61655d99124a29b486ba4a5b37faea P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:05:20.815516 19559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14935b3ddf914369822e4a0547aaa355" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:05:20.910770 19559 raft_consensus.cc:2468] T 14935b3ddf914369822e4a0547aaa355 P e61c3a8f61bb48f8a963c9480e53c168 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 127766fc592545a4997f7790f50f6076 in term 5.
I20260709 13:05:20.818989 19556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0afb57ae58a24a01850491d69f0213dd" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:05:20.871840 21976 raft_consensus.cc:493] T 96efeaaf1057492490e9a621f37e1a2d P e61c3a8f61bb48f8a963c9480e53c168 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:20.768703 21929 leader_election.cc:290] T ff9b0eddd810459b82d91c60777c10eb P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:05:20.842576 19555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70797e5783b5454ab0d0eea663e791e3" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:05:20.913236 19555 raft_consensus.cc:2393] T 70797e5783b5454ab0d0eea663e791e3 P e61c3a8f61bb48f8a963c9480e53c168 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 127766fc592545a4997f7790f50f6076 in current term 7: Already voted for candidate e61c3a8f61bb48f8a963c9480e53c168 in this term.
I20260709 13:05:20.913308 19556 raft_consensus.cc:2393] T 0afb57ae58a24a01850491d69f0213dd P e61c3a8f61bb48f8a963c9480e53c168 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0473d2b2d01f4459b1e90fd12cc7840e in current term 7: Already voted for candidate e61c3a8f61bb48f8a963c9480e53c168 in this term.
W20260709 13:05:20.873437 20075 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.1:40321, user_credentials={real_user=slave}} blocked reactor thread for 82756us
I20260709 13:05:20.872959 19306 catalog_manager.cc:5697] T df751f992649444090e27965eb1af85d P 0473d2b2d01f4459b1e90fd12cc7840e reported cstate change: term changed from 4 to 5, leader changed from e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1) to e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3). New cstate: current_term: 5 leader_uuid: "e61c3a8f61bb48f8a963c9480e53c168" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } }
I20260709 13:05:20.791638 19450 leader_election.cc:400] T 86a6797bdfe94fa496c050ceae4bd0d9 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 5 pre-election: Vote denied by peer e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891) with higher term. Message: Invalid argument: T 86a6797bdfe94fa496c050ceae4bd0d9 P e61c3a8f61bb48f8a963c9480e53c168 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0473d2b2d01f4459b1e90fd12cc7840e for earlier term 5. Current term is 6.
I20260709 13:05:20.874090 19404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1b10566f45d4a7d9029858330e02d5b" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:05:20.915009 19450 leader_election.cc:403] T 86a6797bdfe94fa496c050ceae4bd0d9 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 5 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:05:20.915343 19404 raft_consensus.cc:2393] T f1b10566f45d4a7d9029858330e02d5b P e5256d91808b47c195bc9b4dbd7f2b87 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e61c3a8f61bb48f8a963c9480e53c168 in current term 7: Already voted for candidate e5256d91808b47c195bc9b4dbd7f2b87 in this term.
W20260709 13:05:20.915899 19450 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.3:36891, user_credentials={real_user=slave}} blocked reactor thread for 124380us
I20260709 13:05:20.916107 19404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "172b3dd13109415a955b71ac0e9d2234" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:05:20.875903 19408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14efcc79969f41babe5529c22d59156d" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:05:20.916980 19408 raft_consensus.cc:2393] T 14efcc79969f41babe5529c22d59156d P e5256d91808b47c195bc9b4dbd7f2b87 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0473d2b2d01f4459b1e90fd12cc7840e in current term 6: Already voted for candidate e5256d91808b47c195bc9b4dbd7f2b87 in this term.
I20260709 13:05:20.876204 19409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edd7d470b5014c9489be7f41f64355c9" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:05:20.876515 19411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7be9efa6559648dbb5a0f7684c4542d1" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:05:20.879359 20111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14935b3ddf914369822e4a0547aaa355" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:05:20.880192 20109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48824d5acfbc485ebf8c2d944e7202de" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:05:20.880306 21867 raft_consensus.cc:515] T ff75a1d4cb1f493db8f71ddc136ba9ab P e5256d91808b47c195bc9b4dbd7f2b87 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:20.919324 19408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b74109013a140ada21feeef92d6f563" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:05:20.881470 21971 leader_election.cc:290] T ece3db938bc649d4a40a51522ed5259c P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:05:20.883715 21977 tablet_bootstrap.cc:492] T 7be9efa6559648dbb5a0f7684c4542d1 P 127766fc592545a4997f7790f50f6076: Bootstrap starting.
I20260709 13:05:20.885653 22011 raft_consensus.cc:515] T 217b5fae677b4971b3bbd2f357a1f7ff P 0473d2b2d01f4459b1e90fd12cc7840e [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:20.886897 21980 leader_election.cc:290] T 4af19371ea874c09a0a2147040835cbb P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:05:20.888670 22063 raft_consensus.cc:515] T 21e14947d70440f19044d8f75c31e1f9 P e5256d91808b47c195bc9b4dbd7f2b87 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:20.889663 21916 raft_consensus.cc:515] T 217b5fae677b4971b3bbd2f357a1f7ff P e5256d91808b47c195bc9b4dbd7f2b87 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:20.890813 20112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa731b585f684a7fb2d106c50f143b83" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:05:20.930763 19408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df751f992649444090e27965eb1af85d" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:05:20.931375 19408 raft_consensus.cc:2468] T df751f992649444090e27965eb1af85d P e5256d91808b47c195bc9b4dbd7f2b87 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 6.
I20260709 13:05:20.892228 19551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0afb57ae58a24a01850491d69f0213dd" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:05:20.924268 19556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65d8cb8d6ec64f459d5a47cefab10acf" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
W20260709 13:05:20.932188 19377 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.2:46257, user_credentials={real_user=slave}} blocked reactor thread for 500408us
I20260709 13:05:20.932452 19551 raft_consensus.cc:2393] T 0afb57ae58a24a01850491d69f0213dd P e61c3a8f61bb48f8a963c9480e53c168 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 127766fc592545a4997f7790f50f6076 in current term 7: Already voted for candidate e61c3a8f61bb48f8a963c9480e53c168 in this term.
I20260709 13:05:20.893396 19560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed7fdbcb96d14d418db9ca90a792588a" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:05:20.894549 20107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1efebf73c86e432baa55533136b6e12c" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
W20260709 13:05:20.933238 19526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.2:46257, user_credentials={real_user=slave}} blocked reactor thread for 204617us
I20260709 13:05:20.396601 21790 raft_consensus.cc:493] T a08760e15aac4630a629431f56024dc8 P 0473d2b2d01f4459b1e90fd12cc7840e [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:20.802024 19553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1b10566f45d4a7d9029858330e02d5b" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:05:20.901521 19482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dc5b3532fe54f74876d02beffa2c230" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:05:20.937285 19553 raft_consensus.cc:2468] T f1b10566f45d4a7d9029858330e02d5b P e61c3a8f61bb48f8a963c9480e53c168 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 6.
I20260709 13:05:20.937463 19482 raft_consensus.cc:2468] T 1dc5b3532fe54f74876d02beffa2c230 P 0473d2b2d01f4459b1e90fd12cc7840e [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 4.
I20260709 13:05:20.901695 19484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "179fd671030940b4b4a4e24bcc4aba0a" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:05:20.937665 19556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef32ce6fdd0e40d382c79974f30295c6" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:05:20.901657 19554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85c494af21f9457a85da47b9bc70c1fd" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:05:20.938278 19556 raft_consensus.cc:2468] T ef32ce6fdd0e40d382c79974f30295c6 P e61c3a8f61bb48f8a963c9480e53c168 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 6.
I20260709 13:05:20.903908 20105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c5eebf646ad445a9d1b1adc319d7b16" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
W20260709 13:05:20.904876 19374 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.4:43121, user_credentials={real_user=slave}} blocked reactor thread for 100687us
I20260709 13:05:20.900414 19479 raft_consensus.cc:2468] T 46c5bfeecc314717bffe987e6844b6d0 P 0473d2b2d01f4459b1e90fd12cc7840e [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 10.
I20260709 13:05:20.905663 19552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40e1e16737a842ee936002830f36882e" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:05:20.941195 19374 leader_election.cc:304] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 127766fc592545a4997f7790f50f6076, e5256d91808b47c195bc9b4dbd7f2b87; no voters: 
I20260709 13:05:20.906585 19557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70797e5783b5454ab0d0eea663e791e3" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:05:20.941766 19479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76cb037fc9064d13b59a8969d897ce8c" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:05:20.942205 19557 raft_consensus.cc:3060] T 70797e5783b5454ab0d0eea663e791e3 P e61c3a8f61bb48f8a963c9480e53c168 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:05:20.907387 19481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21e14947d70440f19044d8f75c31e1f9" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:05:20.908517 19558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab43d85f64114d4ebf618930e43d9ed0" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:05:20.942790 19479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e36a9d6e29c4a7c860cf267efbd4c74" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:05:20.943104 19481 raft_consensus.cc:2468] T 21e14947d70440f19044d8f75c31e1f9 P 0473d2b2d01f4459b1e90fd12cc7840e [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 6.
I20260709 13:05:20.943648 19558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22196caba61445d3bec98a0aab3c337d" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:05:20.943974 19408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc225c93219c45538b53a1bd3d387e4d" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:05:20.890220 22056 raft_consensus.cc:515] T 5ec1c4ce15e04c7e8c283a62179f2a64 P 127766fc592545a4997f7790f50f6076 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:05:20.944080 19481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86a6797bdfe94fa496c050ceae4bd0d9" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:05:20.941165 19556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65d8cb8d6ec64f459d5a47cefab10acf" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:05:20.945040 19408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36f6ba92b9ba46babe4ebd6c02e5fbd9" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:05:20.945582 19408 raft_consensus.cc:2468] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P e5256d91808b47c195bc9b4dbd7f2b87 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 7.
I20260709 13:05:20.908875 19485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e1085d23e8347fbbd5bce7542f4b1f4" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:05:20.909104 19410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86a6797bdfe94fa496c050ceae4bd0d9" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
I20260709 13:05:20.911427 19478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b08304a0a02b42d7840c4e8ee9a6bd1a" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:05:20.946527 19410 raft_consensus.cc:3060] T 86a6797bdfe94fa496c050ceae4bd0d9 P e5256d91808b47c195bc9b4dbd7f2b87 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:05:20.946755 19478 raft_consensus.cc:2393] T b08304a0a02b42d7840c4e8ee9a6bd1a P 0473d2b2d01f4459b1e90fd12cc7840e [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e61c3a8f61bb48f8a963c9480e53c168 in current term 7: Already voted for candidate 0473d2b2d01f4459b1e90fd12cc7840e in this term.
I20260709 13:05:20.814005 22049 raft_consensus.cc:493] T edd7d470b5014c9489be7f41f64355c9 P e5256d91808b47c195bc9b4dbd7f2b87 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader e61c3a8f61bb48f8a963c9480e53c168)
I20260709 13:05:20.952801 19553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b08304a0a02b42d7840c4e8ee9a6bd1a" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:05:20.953648 19553 raft_consensus.cc:2468] T b08304a0a02b42d7840c4e8ee9a6bd1a P e61c3a8f61bb48f8a963c9480e53c168 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 6.
I20260709 13:05:20.872537 21559 raft_consensus.cc:493] T 4af19371ea874c09a0a2147040835cbb P e61c3a8f61bb48f8a963c9480e53c168 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 127766fc592545a4997f7790f50f6076)
I20260709 13:05:20.856390 20076 leader_election.cc:304] T 309c3ca0ca4b4f3ba129752ea2cb293b P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 127766fc592545a4997f7790f50f6076; no voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:05:20.867899 21892 raft_consensus.cc:493] T 14efcc79969f41babe5529c22d59156d P 127766fc592545a4997f7790f50f6076 [term 4 FOLLOWER]: Starting leader election (detected failure of leader e5256d91808b47c195bc9b4dbd7f2b87)
I20260709 13:05:20.918334 20109 raft_consensus.cc:2393] T 48824d5acfbc485ebf8c2d944e7202de P 127766fc592545a4997f7790f50f6076 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e61c3a8f61bb48f8a963c9480e53c168 in current term 5: Already voted for candidate 127766fc592545a4997f7790f50f6076 in this term.
I20260709 13:05:20.918529 20111 raft_consensus.cc:2393] T 14935b3ddf914369822e4a0547aaa355 P 127766fc592545a4997f7790f50f6076 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e61c3a8f61bb48f8a963c9480e53c168 in current term 5: Already voted for candidate 127766fc592545a4997f7790f50f6076 in this term.
I20260709 13:05:20.918880 19480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f93ee515a9c14139bf566522ed8232f3" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 9 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:05:20.958992 19480 raft_consensus.cc:2468] T f93ee515a9c14139bf566522ed8232f3 P 0473d2b2d01f4459b1e90fd12cc7840e [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 7.
I20260709 13:05:20.917553 19411 raft_consensus.cc:2468] T 7be9efa6559648dbb5a0f7684c4542d1 P e5256d91808b47c195bc9b4dbd7f2b87 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 6.
I20260709 13:05:20.954124 19478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0afb57ae58a24a01850491d69f0213dd" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:05:20.960229 19411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22196caba61445d3bec98a0aab3c337d" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:05:20.960961 19478 raft_consensus.cc:2393] T 0afb57ae58a24a01850491d69f0213dd P 0473d2b2d01f4459b1e90fd12cc7840e [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate e61c3a8f61bb48f8a963c9480e53c168 in current term 7: Already voted for candidate 127766fc592545a4997f7790f50f6076 in this term.
I20260709 13:05:20.957655 19408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa731b585f684a7fb2d106c50f143b83" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:05:20.962013 19478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e5873a19244c5ebbcd38e126796ee7" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:05:20.962327 19408 raft_consensus.cc:2468] T fa731b585f684a7fb2d106c50f143b83 P e5256d91808b47c195bc9b4dbd7f2b87 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 4.
I20260709 13:05:20.920394 19306 catalog_manager.cc:5697] T ab43d85f64114d4ebf618930e43d9ed0 P 0473d2b2d01f4459b1e90fd12cc7840e reported cstate change: config changed from index 2 to 5, 127766fc592545a4997f7790f50f6076 (127.17.223.4) changed from NON_VOTER to VOTER. New cstate: current_term: 5 leader_uuid: "e61c3a8f61bb48f8a963c9480e53c168" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } attrs { replace: true } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } } }
I20260709 13:05:20.963150 19478 raft_consensus.cc:2468] T d1e5873a19244c5ebbcd38e126796ee7 P 0473d2b2d01f4459b1e90fd12cc7840e [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 7.
I20260709 13:05:20.965932 19484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14935b3ddf914369822e4a0547aaa355" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:05:20.967546 19405 raft_consensus.cc:2368] T 21e14947d70440f19044d8f75c31e1f9 P e5256d91808b47c195bc9b4dbd7f2b87 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e61c3a8f61bb48f8a963c9480e53c168 for earlier term 6. Current term is 7.
I20260709 13:05:20.967805 19560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f93ee515a9c14139bf566522ed8232f3" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 9 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:05:20.966619 19484 raft_consensus.cc:2393] T 14935b3ddf914369822e4a0547aaa355 P 0473d2b2d01f4459b1e90fd12cc7840e [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e61c3a8f61bb48f8a963c9480e53c168 in current term 5: Already voted for candidate 0473d2b2d01f4459b1e90fd12cc7840e in this term.
I20260709 13:05:20.968595 19560 raft_consensus.cc:2468] T f93ee515a9c14139bf566522ed8232f3 P e61c3a8f61bb48f8a963c9480e53c168 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 8.
I20260709 13:05:20.923667 19477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e381f1d6b8184797ad142de49be225a8" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:05:20.969870 19477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48824d5acfbc485ebf8c2d944e7202de" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:05:20.970404 19477 raft_consensus.cc:2468] T 48824d5acfbc485ebf8c2d944e7202de P 0473d2b2d01f4459b1e90fd12cc7840e [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 5.
I20260709 13:05:20.963158 19408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76cb037fc9064d13b59a8969d897ce8c" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:05:20.971279 19477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2725d2c4cb054f18b0fc8f735c15f6c2" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:05:20.924677 20110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed7fdbcb96d14d418db9ca90a792588a" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:05:20.907301 22107 raft_consensus.cc:493] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P 127766fc592545a4997f7790f50f6076 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:20.925132 19404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14935b3ddf914369822e4a0547aaa355" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:05:20.974493 19404 raft_consensus.cc:2468] T 14935b3ddf914369822e4a0547aaa355 P e5256d91808b47c195bc9b4dbd7f2b87 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 5.
I20260709 13:05:20.920588 19555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96efeaaf1057492490e9a621f37e1a2d" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:05:20.923130 22076 raft_consensus.cc:3060] T 86a6797bdfe94fa496c050ceae4bd0d9 P 0473d2b2d01f4459b1e90fd12cc7840e [term 4 FOLLOWER]: Advancing to term 6
I20260709 13:05:20.913061 22089 consensus_queue.cc:1048] T 65d8cb8d6ec64f459d5a47cefab10acf P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Connected to new peer: Peer: permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.046s
I20260709 13:05:20.992606 19404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cdf56e38bbc453d9438d359e5a69955" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
I20260709 13:05:20.993422 19404 raft_consensus.cc:3060] T 0cdf56e38bbc453d9438d359e5a69955 P e5256d91808b47c195bc9b4dbd7f2b87 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:05:20.928112 19523 leader_election.cc:400] T 2a16f7501e2444fb86d4e2778e734e02 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 6 election: Vote denied by peer e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321) with higher term. Message: Invalid argument: T 2a16f7501e2444fb86d4e2778e734e02 P e5256d91808b47c195bc9b4dbd7f2b87 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate e61c3a8f61bb48f8a963c9480e53c168 for earlier term 6. Current term is 7.
I20260709 13:05:20.994006 19523 leader_election.cc:403] T 2a16f7501e2444fb86d4e2778e734e02 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 6 election: Cancelling election due to peer responding with higher term
I20260709 13:05:20.904222 21767 raft_consensus.cc:493] T 2e36a9d6e29c4a7c860cf267efbd4c74 P 0473d2b2d01f4459b1e90fd12cc7840e [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:05:21.018978 19377 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.2:46257, user_credentials={real_user=slave}} blocked reactor thread for 45001.8us
I20260709 13:05:20.929474 19559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dc5b3532fe54f74876d02beffa2c230" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:05:21.019939 19559 raft_consensus.cc:2468] T 1dc5b3532fe54f74876d02beffa2c230 P e61c3a8f61bb48f8a963c9480e53c168 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 4.
I20260709 13:05:20.910145 22064 raft_consensus.cc:2804] T 5ec1c4ce15e04c7e8c283a62179f2a64 P e5256d91808b47c195bc9b4dbd7f2b87 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:05:20.903190 19486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7be9efa6559648dbb5a0f7684c4542d1" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:05:21.029522 19407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1b10566f45d4a7d9029858330e02d5b" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:05:20.907606 22092 raft_consensus.cc:2749] T 70797e5783b5454ab0d0eea663e791e3 P 127766fc592545a4997f7790f50f6076 [term 8 FOLLOWER]: Leader pre-election lost for term 7. Reason: Vote denied by peer e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321) with higher term. Message: Invalid argument: T 70797e5783b5454ab0d0eea663e791e3 P e5256d91808b47c195bc9b4dbd7f2b87 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 127766fc592545a4997f7790f50f6076 for earlier term 7. Current term is 8.
I20260709 13:05:20.944218 19558 raft_consensus.cc:2468] T 22196caba61445d3bec98a0aab3c337d P e61c3a8f61bb48f8a963c9480e53c168 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 5.
I20260709 13:05:20.951113 19485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62c6c134d3d24a1ab144dd9ee6bc3f64" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:05:21.054613 19485 raft_consensus.cc:2468] T 62c6c134d3d24a1ab144dd9ee6bc3f64 P 0473d2b2d01f4459b1e90fd12cc7840e [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 7.
I20260709 13:05:21.054889 19377 leader_election.cc:304] T df751f992649444090e27965eb1af85d P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87; no voters: 
I20260709 13:05:21.055449 19485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df751f992649444090e27965eb1af85d" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:05:21.056057 19485 raft_consensus.cc:2468] T df751f992649444090e27965eb1af85d P 0473d2b2d01f4459b1e90fd12cc7840e [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 5.
I20260709 13:05:21.056849 19559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4af19371ea874c09a0a2147040835cbb" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:05:20.951517 19554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e36a9d6e29c4a7c860cf267efbd4c74" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:05:20.909914 20104 raft_consensus.cc:2468] T ab43d85f64114d4ebf618930e43d9ed0 P 127766fc592545a4997f7790f50f6076 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 5.
I20260709 13:05:21.057915 19559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21e14947d70440f19044d8f75c31e1f9" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:05:20.957638 19552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a16f7501e2444fb86d4e2778e734e02" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:05:21.058445 19559 raft_consensus.cc:3060] T 21e14947d70440f19044d8f75c31e1f9 P e61c3a8f61bb48f8a963c9480e53c168 [term 5 FOLLOWER]: Advancing to term 7
W20260709 13:05:20.957840 20076 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.3:36891, user_credentials={real_user=slave}} blocked reactor thread for 101582us
I20260709 13:05:20.960796 19411 raft_consensus.cc:2468] T 22196caba61445d3bec98a0aab3c337d P e5256d91808b47c195bc9b4dbd7f2b87 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 5.
I20260709 13:05:21.061014 19411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f575b143b844aa096b50997dad3516a" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:05:21.064004 22066 consensus_queue.cc:1048] T 1f85fc4b527a48848e5faa083b604e36 P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:05:21.065824 19559 raft_consensus.cc:2468] T 21e14947d70440f19044d8f75c31e1f9 P e61c3a8f61bb48f8a963c9480e53c168 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 7.
I20260709 13:05:20.972201 19408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e36a9d6e29c4a7c860cf267efbd4c74" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:05:21.066917 19408 raft_consensus.cc:2393] T 2e36a9d6e29c4a7c860cf267efbd4c74 P e5256d91808b47c195bc9b4dbd7f2b87 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e61c3a8f61bb48f8a963c9480e53c168 in current term 5: Already voted for candidate e5256d91808b47c195bc9b4dbd7f2b87 in this term.
I20260709 13:05:20.917594 19450 leader_election.cc:304] T 7be9efa6559648dbb5a0f7684c4542d1 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
W20260709 13:05:21.067759 19450 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.3:36891, user_credentials={real_user=slave}} blocked reactor thread for 150216us
I20260709 13:05:20.927409 19483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a61655d99124a29b486ba4a5b37faea" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:05:21.059770 19558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff75a1d4cb1f493db8f71ddc136ba9ab" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:05:21.069267 19450 leader_election.cc:304] T f93ee515a9c14139bf566522ed8232f3 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168; no voters: e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:05:21.070363 19554 raft_consensus.cc:2468] T 2e36a9d6e29c4a7c860cf267efbd4c74 P e61c3a8f61bb48f8a963c9480e53c168 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 4.
I20260709 13:05:20.983799 19405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e1f505cb0f1427bbd698ac889d80821" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
W20260709 13:05:20.985116 19374 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.4:43121, user_credentials={real_user=slave}} blocked reactor thread for 43999.6us
I20260709 13:05:21.056849 19485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c5eebf646ad445a9d1b1adc319d7b16" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:05:20.973642 21559 raft_consensus.cc:515] T 4af19371ea874c09a0a2147040835cbb P e61c3a8f61bb48f8a963c9480e53c168 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:05:20.986476 21867 leader_election.cc:290] T ff75a1d4cb1f493db8f71ddc136ba9ab P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:05:20.986650 19553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a61655d99124a29b486ba4a5b37faea" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:05:20.988539 22063 leader_election.cc:290] T 21e14947d70440f19044d8f75c31e1f9 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 7 election: Requested vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:05:20.990337 21963 leader_election.cc:290] T b08304a0a02b42d7840c4e8ee9a6bd1a P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 7 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:05:20.969973 21911 raft_consensus.cc:2749] T 309c3ca0ca4b4f3ba129752ea2cb293b P 127766fc592545a4997f7790f50f6076 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:05:20.970788 21892 raft_consensus.cc:3060] T 14efcc79969f41babe5529c22d59156d P 127766fc592545a4997f7790f50f6076 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:05:20.996803 19480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef32ce6fdd0e40d382c79974f30295c6" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:05:21.083449 19480 raft_consensus.cc:2468] T ef32ce6fdd0e40d382c79974f30295c6 P 0473d2b2d01f4459b1e90fd12cc7840e [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 5.
I20260709 13:05:20.927006 21700 consensus_queue.cc:1048] T 179fd671030940b4b4a4e24bcc4aba0a P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.050s
W20260709 13:05:21.027360 19526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.2:46257, user_credentials={real_user=slave}} blocked reactor thread for 90818.4us
I20260709 13:05:21.029598 19486 raft_consensus.cc:2468] T 7be9efa6559648dbb5a0f7684c4542d1 P 0473d2b2d01f4459b1e90fd12cc7840e [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 6.
I20260709 13:05:21.029268 22064 raft_consensus.cc:493] T 5ec1c4ce15e04c7e8c283a62179f2a64 P e5256d91808b47c195bc9b4dbd7f2b87 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:21.030339 19407 raft_consensus.cc:2468] T f1b10566f45d4a7d9029858330e02d5b P e5256d91808b47c195bc9b4dbd7f2b87 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 7.
W20260709 13:05:21.030469 19523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.1:40321, user_credentials={real_user=slave}} blocked reactor thread for 102486us
I20260709 13:05:21.048081 19477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22196caba61445d3bec98a0aab3c337d" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:05:21.054071 22048 raft_consensus.cc:2804] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P e5256d91808b47c195bc9b4dbd7f2b87 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:05:21.099200 19407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40e1e16737a842ee936002830f36882e" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:05:21.101076 19480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e1f505cb0f1427bbd698ac889d80821" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:05:21.079357 22057 raft_consensus.cc:2804] T f93ee515a9c14139bf566522ed8232f3 P 0473d2b2d01f4459b1e90fd12cc7840e [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:05:21.050997 19478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1efebf73c86e432baa55533136b6e12c" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:05:20.924186 21976 raft_consensus.cc:515] T 96efeaaf1057492490e9a621f37e1a2d P e61c3a8f61bb48f8a963c9480e53c168 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:05:21.053457 19410 raft_consensus.cc:2468] T 86a6797bdfe94fa496c050ceae4bd0d9 P e5256d91808b47c195bc9b4dbd7f2b87 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 6.
I20260709 13:05:21.055980 19377 leader_election.cc:304] T 4509b76741dc428e9201c70c1658da13 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:05:20.972352 20110 raft_consensus.cc:2468] T ed7fdbcb96d14d418db9ca90a792588a P 127766fc592545a4997f7790f50f6076 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 3.
I20260709 13:05:21.062376 19411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e5873a19244c5ebbcd38e126796ee7" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:05:21.051710 21767 raft_consensus.cc:515] T 2e36a9d6e29c4a7c860cf267efbd4c74 P 0473d2b2d01f4459b1e90fd12cc7840e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:21.093523 22007 raft_consensus.cc:2804] T 7be9efa6559648dbb5a0f7684c4542d1 P 0473d2b2d01f4459b1e90fd12cc7840e [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:05:21.074188 19404 raft_consensus.cc:2468] T 0cdf56e38bbc453d9438d359e5a69955 P e5256d91808b47c195bc9b4dbd7f2b87 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 8.
I20260709 13:05:21.075484 19484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b74109013a140ada21feeef92d6f563" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:05:21.152951 19484 raft_consensus.cc:2468] T 2b74109013a140ada21feeef92d6f563 P 0473d2b2d01f4459b1e90fd12cc7840e [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 3.
I20260709 13:05:21.076213 19374 leader_election.cc:304] T 85c494af21f9457a85da47b9bc70c1fd P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 127766fc592545a4997f7790f50f6076, e5256d91808b47c195bc9b4dbd7f2b87; no voters: 
W20260709 13:05:21.153942 19377 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.2:46257, user_credentials={real_user=slave}} blocked reactor thread for 98017.8us
I20260709 13:05:21.073460 19405 raft_consensus.cc:2468] T 3e1f505cb0f1427bbd698ac889d80821 P e5256d91808b47c195bc9b4dbd7f2b87 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 5.
I20260709 13:05:21.075538 19553 raft_consensus.cc:2468] T 1a61655d99124a29b486ba4a5b37faea P e61c3a8f61bb48f8a963c9480e53c168 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 3.
I20260709 13:05:20.943437 22027 consensus_queue.cc:1048] T a08760e15aac4630a629431f56024dc8 P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.088s
I20260709 13:05:21.077674 19408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21e14947d70440f19044d8f75c31e1f9" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:05:21.074247 19450 leader_election.cc:304] T ef32ce6fdd0e40d382c79974f30295c6 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168; no voters: e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:05:21.078461 19485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed7fdbcb96d14d418db9ca90a792588a" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:05:21.088949 21992 leader_election.cc:290] T ff75a1d4cb1f493db8f71ddc136ba9ab P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:05:20.981470 22107 raft_consensus.cc:3060] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P 127766fc592545a4997f7790f50f6076 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:05:21.174808 22021 leader_election.cc:290] T 9962423cb4e54fcfa5de01daf68a86e7 P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:05:20.992688 22104 raft_consensus.cc:493] T e381f1d6b8184797ad142de49be225a8 P e5256d91808b47c195bc9b4dbd7f2b87 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 0473d2b2d01f4459b1e90fd12cc7840e)
I20260709 13:05:21.178378 22104 raft_consensus.cc:515] T e381f1d6b8184797ad142de49be225a8 P e5256d91808b47c195bc9b4dbd7f2b87 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:21.180074 21767 leader_election.cc:290] T 2e36a9d6e29c4a7c860cf267efbd4c74 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:05:21.180429 22104 leader_election.cc:290] T e381f1d6b8184797ad142de49be225a8 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:05:21.017371 21929 raft_consensus.cc:493] T fa731b585f684a7fb2d106c50f143b83 P e5256d91808b47c195bc9b4dbd7f2b87 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 127766fc592545a4997f7790f50f6076)
I20260709 13:05:21.180152 22076 raft_consensus.cc:2749] T 86a6797bdfe94fa496c050ceae4bd0d9 P 0473d2b2d01f4459b1e90fd12cc7840e [term 6 FOLLOWER]: Leader pre-election lost for term 5. Reason: Vote denied by peer e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891) with higher term. Message: Invalid argument: T 86a6797bdfe94fa496c050ceae4bd0d9 P e61c3a8f61bb48f8a963c9480e53c168 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0473d2b2d01f4459b1e90fd12cc7840e for earlier term 5. Current term is 6.
I20260709 13:05:20.951006 21790 raft_consensus.cc:515] T a08760e15aac4630a629431f56024dc8 P 0473d2b2d01f4459b1e90fd12cc7840e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:21.087002 19486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc225c93219c45538b53a1bd3d387e4d" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 9 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:05:20.938524 19482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1b10566f45d4a7d9029858330e02d5b" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:05:21.087927 19483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f575b143b844aa096b50997dad3516a" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:05:21.077524 21833 raft_consensus.cc:2749] T 2a16f7501e2444fb86d4e2778e734e02 P e61c3a8f61bb48f8a963c9480e53c168 [term 7 FOLLOWER]: Leader election lost for term 6. Reason: Vote denied by peer e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321) with higher term. Message: Invalid argument: T 2a16f7501e2444fb86d4e2778e734e02 P e5256d91808b47c195bc9b4dbd7f2b87 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate e61c3a8f61bb48f8a963c9480e53c168 for earlier term 6. Current term is 7.
I20260709 13:05:21.208123 19482 raft_consensus.cc:2468] T f1b10566f45d4a7d9029858330e02d5b P 0473d2b2d01f4459b1e90fd12cc7840e [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 7.
I20260709 13:05:21.101881 19480 raft_consensus.cc:2468] T 3e1f505cb0f1427bbd698ac889d80821 P 0473d2b2d01f4459b1e90fd12cc7840e [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 4.
I20260709 13:05:21.046849 19557 raft_consensus.cc:2468] T 70797e5783b5454ab0d0eea663e791e3 P e61c3a8f61bb48f8a963c9480e53c168 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 8.
W20260709 13:05:21.146629 19523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.1:40321, user_credentials={real_user=slave}} blocked reactor thread for 54435us
W20260709 13:05:21.074120 20078 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.2:46257, user_credentials={real_user=slave}} blocked reactor thread for 276696us
I20260709 13:05:21.211035 19523 leader_election.cc:304] T 46c5bfeecc314717bffe987e6844b6d0 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:05:21.110616 22057 raft_consensus.cc:493] T f93ee515a9c14139bf566522ed8232f3 P 0473d2b2d01f4459b1e90fd12cc7840e [term 7 FOLLOWER]: Starting leader election (detected failure of leader e61c3a8f61bb48f8a963c9480e53c168)
I20260709 13:05:21.213845 20078 leader_election.cc:304] T 48824d5acfbc485ebf8c2d944e7202de P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, 127766fc592545a4997f7790f50f6076; no voters: e61c3a8f61bb48f8a963c9480e53c168
W20260709 13:05:21.114761 19375 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.3:36891, user_credentials={real_user=slave}} blocked reactor thread for 59717.8us
I20260709 13:05:21.214844 19375 leader_election.cc:304] T f1b10566f45d4a7d9029858330e02d5b P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:05:21.142802 19407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e1f505cb0f1427bbd698ac889d80821" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:05:21.066236 22066 raft_consensus.cc:2804] T df751f992649444090e27965eb1af85d P e5256d91808b47c195bc9b4dbd7f2b87 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:05:21.095459 22064 raft_consensus.cc:3060] T 5ec1c4ce15e04c7e8c283a62179f2a64 P e5256d91808b47c195bc9b4dbd7f2b87 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:05:21.166224 19408 raft_consensus.cc:2393] T 21e14947d70440f19044d8f75c31e1f9 P e5256d91808b47c195bc9b4dbd7f2b87 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0473d2b2d01f4459b1e90fd12cc7840e in current term 7: Already voted for candidate e5256d91808b47c195bc9b4dbd7f2b87 in this term.
I20260709 13:05:21.162861 19410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b74109013a140ada21feeef92d6f563" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:05:21.223290 20110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14efcc79969f41babe5529c22d59156d" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:05:21.163422 19405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46c5bfeecc314717bffe987e6844b6d0" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 11 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:05:21.224009 19405 raft_consensus.cc:2468] T 46c5bfeecc314717bffe987e6844b6d0 P e5256d91808b47c195bc9b4dbd7f2b87 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 10.
I20260709 13:05:21.219286 22104 raft_consensus.cc:2804] T f1b10566f45d4a7d9029858330e02d5b P e5256d91808b47c195bc9b4dbd7f2b87 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:05:21.224695 22104 raft_consensus.cc:493] T f1b10566f45d4a7d9029858330e02d5b P e5256d91808b47c195bc9b4dbd7f2b87 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:21.224792 19405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f575b143b844aa096b50997dad3516a" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:05:21.225061 22104 raft_consensus.cc:3060] T f1b10566f45d4a7d9029858330e02d5b P e5256d91808b47c195bc9b4dbd7f2b87 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:05:21.224974 21958 raft_consensus.cc:515] T d1e5873a19244c5ebbcd38e126796ee7 P e5256d91808b47c195bc9b4dbd7f2b87 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:21.225911 19405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9f0d59553ad444883fcf5b5909f9798" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:05:21.226920 19405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "775c229504194560ba9589bc2199b089" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
W20260709 13:05:21.162873 19374 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.4:43121, user_credentials={real_user=slave}} blocked reactor thread for 86742.7us
I20260709 13:05:21.164669 19404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef32ce6fdd0e40d382c79974f30295c6" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:05:21.228597 19523 leader_election.cc:304] T 833a2f0775ed407a94b8924ce50adb63 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e61c3a8f61bb48f8a963c9480e53c168; no voters: 127766fc592545a4997f7790f50f6076, e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:05:21.228765 19404 raft_consensus.cc:2468] T ef32ce6fdd0e40d382c79974f30295c6 P e5256d91808b47c195bc9b4dbd7f2b87 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 6.
I20260709 13:05:21.229882 19404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc225c93219c45538b53a1bd3d387e4d" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 9 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:05:21.227033 19402 raft_consensus.cc:2393] T d1e5873a19244c5ebbcd38e126796ee7 P e5256d91808b47c195bc9b4dbd7f2b87 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e61c3a8f61bb48f8a963c9480e53c168 in current term 8: Already voted for candidate e5256d91808b47c195bc9b4dbd7f2b87 in this term.
I20260709 13:05:21.166321 19377 leader_election.cc:304] T 1dc5b3532fe54f74876d02beffa2c230 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87; no voters: 
W20260709 13:05:21.162660 19450 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.3:36891, user_credentials={real_user=slave}} blocked reactor thread for 88519.7us
I20260709 13:05:21.174104 21916 leader_election.cc:290] T 217b5fae677b4971b3bbd2f357a1f7ff P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 4 election: Requested vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:05:21.223620 19410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f85fc4b527a48848e5faa083b604e36" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:05:21.233471 19408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2725d2c4cb054f18b0fc8f735c15f6c2" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
W20260709 13:05:21.213290 22115 log.cc:927] Time spent T b9f0d59553ad444883fcf5b5909f9798 P e5256d91808b47c195bc9b4dbd7f2b87: Append to log took a long time: real 0.050s	user 0.001s	sys 0.000s
I20260709 13:05:21.181195 21929 raft_consensus.cc:515] T fa731b585f684a7fb2d106c50f143b83 P e5256d91808b47c195bc9b4dbd7f2b87 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:05:21.202512 19555 raft_consensus.cc:3060] T 96efeaaf1057492490e9a621f37e1a2d P e61c3a8f61bb48f8a963c9480e53c168 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:05:21.204210 21790 leader_election.cc:290] T a08760e15aac4630a629431f56024dc8 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:05:21.174515 21926 consensus_queue.cc:1048] T bc225c93219c45538b53a1bd3d387e4d P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.012s
I20260709 13:05:21.206296 19481 raft_consensus.cc:2468] T 86a6797bdfe94fa496c050ceae4bd0d9 P 0473d2b2d01f4459b1e90fd12cc7840e [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 6.
I20260709 13:05:21.094828 21971 consensus_queue.cc:1059] T 0cdf56e38bbc453d9438d359e5a69955 P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.088s
I20260709 13:05:21.197494 21980 raft_consensus.cc:2804] T 85c494af21f9457a85da47b9bc70c1fd P e5256d91808b47c195bc9b4dbd7f2b87 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:05:21.258778 21929 leader_election.cc:290] T fa731b585f684a7fb2d106c50f143b83 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:05:21.258826 21980 raft_consensus.cc:493] T 85c494af21f9457a85da47b9bc70c1fd P e5256d91808b47c195bc9b4dbd7f2b87 [term 3 FOLLOWER]: Starting leader election (detected failure of leader e61c3a8f61bb48f8a963c9480e53c168)
I20260709 13:05:21.226490 22107 raft_consensus.cc:515] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P 127766fc592545a4997f7790f50f6076 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:05:21.207072 19411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14935b3ddf914369822e4a0547aaa355" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
I20260709 13:05:21.261090 22107 leader_election.cc:290] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 8 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:05:21.196913 21963 raft_consensus.cc:2804] T ef32ce6fdd0e40d382c79974f30295c6 P 0473d2b2d01f4459b1e90fd12cc7840e [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:05:21.049960 19449 leader_election.cc:304] T 5ec1c4ce15e04c7e8c283a62179f2a64 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, 127766fc592545a4997f7790f50f6076; no voters: e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:05:21.263870 21963 raft_consensus.cc:493] T ef32ce6fdd0e40d382c79974f30295c6 P 0473d2b2d01f4459b1e90fd12cc7840e [term 5 FOLLOWER]: Starting leader election (detected failure of leader e61c3a8f61bb48f8a963c9480e53c168)
I20260709 13:05:21.264307 21963 raft_consensus.cc:3060] T ef32ce6fdd0e40d382c79974f30295c6 P 0473d2b2d01f4459b1e90fd12cc7840e [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:05:21.264618 19449 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.4:43121, user_credentials={real_user=slave}} blocked reactor thread for 214740us
I20260709 13:05:21.208830 19486 raft_consensus.cc:2410] T bc225c93219c45538b53a1bd3d387e4d P 0473d2b2d01f4459b1e90fd12cc7840e [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e61c3a8f61bb48f8a963c9480e53c168 for term 9 because replica has last-logged OpId of term: 7 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 3.
I20260709 13:05:21.266638 21790 raft_consensus.cc:2804] T 5ec1c4ce15e04c7e8c283a62179f2a64 P 0473d2b2d01f4459b1e90fd12cc7840e [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:05:21.267153 21790 raft_consensus.cc:493] T 5ec1c4ce15e04c7e8c283a62179f2a64 P 0473d2b2d01f4459b1e90fd12cc7840e [term 3 FOLLOWER]: Starting leader election (detected failure of leader 127766fc592545a4997f7790f50f6076)
I20260709 13:05:21.267513 21790 raft_consensus.cc:3060] T 5ec1c4ce15e04c7e8c283a62179f2a64 P 0473d2b2d01f4459b1e90fd12cc7840e [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:05:21.267695 21559 leader_election.cc:290] T 4af19371ea874c09a0a2147040835cbb P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:05:21.110920 22048 raft_consensus.cc:697] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P e5256d91808b47c195bc9b4dbd7f2b87 [term 7 LEADER]: Becoming Leader. State: Replica: e5256d91808b47c195bc9b4dbd7f2b87, State: Running, Role: LEADER
I20260709 13:05:21.268285 21559 raft_consensus.cc:3055] T 0cdf56e38bbc453d9438d359e5a69955 P e61c3a8f61bb48f8a963c9480e53c168 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:05:21.268641 21559 raft_consensus.cc:740] T 0cdf56e38bbc453d9438d359e5a69955 P e61c3a8f61bb48f8a963c9480e53c168 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: e61c3a8f61bb48f8a963c9480e53c168, State: Running, Role: LEADER
I20260709 13:05:21.268836 22048 consensus_queue.cc:237] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:05:21.269455 21559 consensus_queue.cc:260] T 0cdf56e38bbc453d9438d359e5a69955 P e61c3a8f61bb48f8a963c9480e53c168 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:21.215914 19375 leader_election.cc:304] T 3e1f505cb0f1427bbd698ac889d80821 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:05:21.165966 21849 raft_consensus.cc:2749] T 4509b76741dc428e9201c70c1658da13 P e5256d91808b47c195bc9b4dbd7f2b87 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:05:21.231989 19450 leader_election.cc:304] T 309c3ca0ca4b4f3ba129752ea2cb293b P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, 127766fc592545a4997f7790f50f6076; no voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:05:20.967046 22049 raft_consensus.cc:515] T edd7d470b5014c9489be7f41f64355c9 P e5256d91808b47c195bc9b4dbd7f2b87 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:21.271431 22076 raft_consensus.cc:2749] T 309c3ca0ca4b4f3ba129752ea2cb293b P 0473d2b2d01f4459b1e90fd12cc7840e [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:05:21.247743 21892 raft_consensus.cc:515] T 14efcc79969f41babe5529c22d59156d P 127766fc592545a4997f7790f50f6076 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:05:21.272239 19450 leader_election.cc:304] T 21e14947d70440f19044d8f75c31e1f9 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:05:21.272724 22049 leader_election.cc:290] T edd7d470b5014c9489be7f41f64355c9 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:05:21.232862 19374 leader_election.cc:304] T 70797e5783b5454ab0d0eea663e791e3 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 127766fc592545a4997f7790f50f6076, e5256d91808b47c195bc9b4dbd7f2b87; no voters: 
I20260709 13:05:21.272979 22076 raft_consensus.cc:2804] T 21e14947d70440f19044d8f75c31e1f9 P 0473d2b2d01f4459b1e90fd12cc7840e [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:05:21.273372 21892 leader_election.cc:290] T 14efcc79969f41babe5529c22d59156d P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 5 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:05:21.273638 19450 leader_election.cc:304] T 2b74109013a140ada21feeef92d6f563 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:05:21.273531 21700 consensus_queue.cc:1048] T 22196caba61445d3bec98a0aab3c337d P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:05:21.227775 19405 raft_consensus.cc:2468] T 775c229504194560ba9589bc2199b089 P e5256d91808b47c195bc9b4dbd7f2b87 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 4.
I20260709 13:05:21.274001 22041 leader_election.cc:290] T ab43d85f64114d4ebf618930e43d9ed0 P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:05:21.211226 22027 consensus_queue.cc:1048] T 309c3ca0ca4b4f3ba129752ea2cb293b P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.024s
I20260709 13:05:21.234962 20104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14935b3ddf914369822e4a0547aaa355" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076"
I20260709 13:05:21.236397 19404 raft_consensus.cc:1275] T 22196caba61445d3bec98a0aab3c337d P e5256d91808b47c195bc9b4dbd7f2b87 [term 5 FOLLOWER]: Refusing update from remote peer 0473d2b2d01f4459b1e90fd12cc7840e: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:05:21.274724 20110 raft_consensus.cc:2468] T 14efcc79969f41babe5529c22d59156d P 127766fc592545a4997f7790f50f6076 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 5.
I20260709 13:05:21.236513 22007 raft_consensus.cc:493] T 7be9efa6559648dbb5a0f7684c4542d1 P 0473d2b2d01f4459b1e90fd12cc7840e [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:05:21.284498 19377 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.2:46257, user_credentials={real_user=slave}} blocked reactor thread for 118266us
I20260709 13:05:21.217403 22066 raft_consensus.cc:493] T df751f992649444090e27965eb1af85d P e5256d91808b47c195bc9b4dbd7f2b87 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:21.257551 20107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36f6ba92b9ba46babe4ebd6c02e5fbd9" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:05:21.218639 22057 raft_consensus.cc:3060] T f93ee515a9c14139bf566522ed8232f3 P 0473d2b2d01f4459b1e90fd12cc7840e [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:05:21.263082 21958 leader_election.cc:290] T d1e5873a19244c5ebbcd38e126796ee7 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 8 election: Requested vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:05:21.259474 21980 raft_consensus.cc:3060] T 85c494af21f9457a85da47b9bc70c1fd P e5256d91808b47c195bc9b4dbd7f2b87 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:05:21.182224 19479 raft_consensus.cc:2468] T 2e36a9d6e29c4a7c860cf267efbd4c74 P 0473d2b2d01f4459b1e90fd12cc7840e [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 5.
I20260709 13:05:21.275663 19409 raft_consensus.cc:2410] T edd7d470b5014c9489be7f41f64355c9 P e5256d91808b47c195bc9b4dbd7f2b87 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0473d2b2d01f4459b1e90fd12cc7840e for term 6 because replica has last-logged OpId of term: 5 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 13:05:21.163022 21991 raft_consensus.cc:493] T 1f85fc4b527a48848e5faa083b604e36 P 127766fc592545a4997f7790f50f6076 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader e5256d91808b47c195bc9b4dbd7f2b87)
I20260709 13:05:21.275779 19450 leader_election.cc:304] T 48824d5acfbc485ebf8c2d944e7202de P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:05:21.282810 19555 raft_consensus.cc:2468] T 96efeaaf1057492490e9a621f37e1a2d P e61c3a8f61bb48f8a963c9480e53c168 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 127766fc592545a4997f7790f50f6076 in term 6.
I20260709 13:05:21.283034 19411 raft_consensus.cc:2468] T 14935b3ddf914369822e4a0547aaa355 P e5256d91808b47c195bc9b4dbd7f2b87 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 5.
I20260709 13:05:21.305526 19411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b08304a0a02b42d7840c4e8ee9a6bd1a" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
I20260709 13:05:21.305864 20104 raft_consensus.cc:2393] T 14935b3ddf914369822e4a0547aaa355 P 127766fc592545a4997f7790f50f6076 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 0473d2b2d01f4459b1e90fd12cc7840e in current term 5: Already voted for candidate 127766fc592545a4997f7790f50f6076 in this term.
I20260709 13:05:21.306089 19411 raft_consensus.cc:3060] T b08304a0a02b42d7840c4e8ee9a6bd1a P e5256d91808b47c195bc9b4dbd7f2b87 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:05:21.217828 19407 raft_consensus.cc:2393] T 3e1f505cb0f1427bbd698ac889d80821 P e5256d91808b47c195bc9b4dbd7f2b87 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0473d2b2d01f4459b1e90fd12cc7840e in current term 5: Already voted for candidate e5256d91808b47c195bc9b4dbd7f2b87 in this term.
W20260709 13:05:21.308727 19375 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.3:36891, user_credentials={real_user=slave}} blocked reactor thread for 92911.9us
I20260709 13:05:21.309406 19375 leader_election.cc:304] T 46c5bfeecc314717bffe987e6844b6d0 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:05:21.274921 21833 raft_consensus.cc:2804] T 46c5bfeecc314717bffe987e6844b6d0 P e61c3a8f61bb48f8a963c9480e53c168 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:05:21.285983 19377 leader_election.cc:304] T b08304a0a02b42d7840c4e8ee9a6bd1a P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87; no voters: 
W20260709 13:05:21.313761 19374 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.4:43121, user_credentials={real_user=slave}} blocked reactor thread for 81013.4us
W20260709 13:05:21.283597 19526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.2:46257, user_credentials={real_user=slave}} blocked reactor thread for 195995us
I20260709 13:05:21.209657 21529 leader_election.cc:290] T 217b5fae677b4971b3bbd2f357a1f7ff P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 3 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:05:21.288450 19449 leader_election.cc:304] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87; no voters: 
I20260709 13:05:21.298702 19405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e36a9d6e29c4a7c860cf267efbd4c74" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:05:21.299890 19404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a08760e15aac4630a629431f56024dc8" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:05:21.302752 22066 raft_consensus.cc:3060] T df751f992649444090e27965eb1af85d P e5256d91808b47c195bc9b4dbd7f2b87 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:05:21.270560 21559 raft_consensus.cc:3060] T 0cdf56e38bbc453d9438d359e5a69955 P e61c3a8f61bb48f8a963c9480e53c168 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:05:21.227633 22111 raft_consensus.cc:2804] T 48824d5acfbc485ebf8c2d944e7202de P 127766fc592545a4997f7790f50f6076 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:05:21.285774 19402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "217b5fae677b4971b3bbd2f357a1f7ff" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
I20260709 13:05:21.308149 19450 leader_election.cc:304] T 46c5bfeecc314717bffe987e6844b6d0 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:05:21.273393 22076 raft_consensus.cc:493] T 21e14947d70440f19044d8f75c31e1f9 P 0473d2b2d01f4459b1e90fd12cc7840e [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:21.274830 22089 raft_consensus.cc:2749] T 833a2f0775ed407a94b8924ce50adb63 P e61c3a8f61bb48f8a963c9480e53c168 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:05:21.275156 22056 leader_election.cc:290] T 5ec1c4ce15e04c7e8c283a62179f2a64 P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 5 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:05:21.298722 22007 raft_consensus.cc:3060] T 7be9efa6559648dbb5a0f7684c4542d1 P 0473d2b2d01f4459b1e90fd12cc7840e [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:05:21.271224 21976 leader_election.cc:290] T 96efeaaf1057492490e9a621f37e1a2d P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:05:21.323053 19375 leader_election.cc:304] T 179fd671030940b4b4a4e24bcc4aba0a P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:05:21.301604 21867 raft_consensus.cc:2804] T 1dc5b3532fe54f74876d02beffa2c230 P e5256d91808b47c195bc9b4dbd7f2b87 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:05:21.285332 22011 leader_election.cc:290] T 217b5fae677b4971b3bbd2f357a1f7ff P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 4 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:05:21.301741 21767 raft_consensus.cc:2804] T 2b74109013a140ada21feeef92d6f563 P 0473d2b2d01f4459b1e90fd12cc7840e [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:05:21.326442 19404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9962423cb4e54fcfa5de01daf68a86e7" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:05:21.300362 20107 raft_consensus.cc:2393] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P 127766fc592545a4997f7790f50f6076 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0473d2b2d01f4459b1e90fd12cc7840e in current term 8: Already voted for candidate 127766fc592545a4997f7790f50f6076 in this term.
I20260709 13:05:21.330585 21958 raft_consensus.cc:493] T 833a2f0775ed407a94b8924ce50adb63 P e5256d91808b47c195bc9b4dbd7f2b87 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 127766fc592545a4997f7790f50f6076)
I20260709 13:05:21.325419 19405 raft_consensus.cc:2468] T 2e36a9d6e29c4a7c860cf267efbd4c74 P e5256d91808b47c195bc9b4dbd7f2b87 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 5.
I20260709 13:05:21.313299 21991 raft_consensus.cc:515] T 1f85fc4b527a48848e5faa083b604e36 P 127766fc592545a4997f7790f50f6076 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:05:21.322948 21823 raft_consensus.cc:2804] T 70797e5783b5454ab0d0eea663e791e3 P e5256d91808b47c195bc9b4dbd7f2b87 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:05:21.335726 21700 raft_consensus.cc:2804] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P 0473d2b2d01f4459b1e90fd12cc7840e [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:05:21.313629 21833 raft_consensus.cc:493] T 46c5bfeecc314717bffe987e6844b6d0 P e61c3a8f61bb48f8a963c9480e53c168 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:21.343120 20110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62c6c134d3d24a1ab144dd9ee6bc3f64" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:05:21.345194 20104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a16f7501e2444fb86d4e2778e734e02" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:05:21.345376 20105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65d8cb8d6ec64f459d5a47cefab10acf" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:05:21.388466 20105 raft_consensus.cc:2468] T 65d8cb8d6ec64f459d5a47cefab10acf P 127766fc592545a4997f7790f50f6076 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 3.
I20260709 13:05:21.345947 20111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14efcc79969f41babe5529c22d59156d" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076"
I20260709 13:05:21.389218 20111 raft_consensus.cc:3060] T 14efcc79969f41babe5529c22d59156d P 127766fc592545a4997f7790f50f6076 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:05:21.310703 21932 raft_consensus.cc:2804] T 48824d5acfbc485ebf8c2d944e7202de P 0473d2b2d01f4459b1e90fd12cc7840e [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:05:21.346468 19526 leader_election.cc:304] T 1dc5b3532fe54f74876d02beffa2c230 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:05:21.349970 20109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff9b0eddd810459b82d91c60777c10eb" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:05:21.354086 19411 raft_consensus.cc:2468] T b08304a0a02b42d7840c4e8ee9a6bd1a P e5256d91808b47c195bc9b4dbd7f2b87 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 7.
I20260709 13:05:21.357415 19402 raft_consensus.cc:2393] T 217b5fae677b4971b3bbd2f357a1f7ff P e5256d91808b47c195bc9b4dbd7f2b87 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 0473d2b2d01f4459b1e90fd12cc7840e in current term 4: Already voted for candidate e5256d91808b47c195bc9b4dbd7f2b87 in this term.
W20260709 13:05:21.357415 19450 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.3:36891, user_credentials={real_user=slave}} blocked reactor thread for 49370.7us
I20260709 13:05:21.390072 19404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab43d85f64114d4ebf618930e43d9ed0" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
W20260709 13:05:21.390162 19526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.2:46257, user_credentials={real_user=slave}} blocked reactor thread for 43775.1us
I20260709 13:05:21.390858 19450 leader_election.cc:304] T bc225c93219c45538b53a1bd3d387e4d P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168; no voters: e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:05:21.362267 22076 raft_consensus.cc:3060] T 21e14947d70440f19044d8f75c31e1f9 P 0473d2b2d01f4459b1e90fd12cc7840e [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:05:21.384720 21700 raft_consensus.cc:493] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P 0473d2b2d01f4459b1e90fd12cc7840e [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:21.392603 21700 raft_consensus.cc:3060] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P 0473d2b2d01f4459b1e90fd12cc7840e [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:05:21.322523 21926 raft_consensus.cc:2804] T 3e1f505cb0f1427bbd698ac889d80821 P e5256d91808b47c195bc9b4dbd7f2b87 [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 13:05:21.368109 19375 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.3:36891, user_credentials={real_user=slave}} blocked reactor thread for 45116.2us
I20260709 13:05:21.400481 19375 leader_election.cc:304] T 7be9efa6559648dbb5a0f7684c4542d1 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:05:21.396131 19450 leader_election.cc:304] T 3e1f505cb0f1427bbd698ac889d80821 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:05:21.350255 21849 raft_consensus.cc:2804] T 46c5bfeecc314717bffe987e6844b6d0 P e5256d91808b47c195bc9b4dbd7f2b87 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:05:21.374065 19406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36f6ba92b9ba46babe4ebd6c02e5fbd9" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
I20260709 13:05:21.423493 21849 raft_consensus.cc:493] T 46c5bfeecc314717bffe987e6844b6d0 P e5256d91808b47c195bc9b4dbd7f2b87 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:21.354804 22111 raft_consensus.cc:493] T 48824d5acfbc485ebf8c2d944e7202de P 127766fc592545a4997f7790f50f6076 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:21.423883 21849 raft_consensus.cc:3060] T 46c5bfeecc314717bffe987e6844b6d0 P e5256d91808b47c195bc9b4dbd7f2b87 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:05:21.424099 22111 raft_consensus.cc:3060] T 48824d5acfbc485ebf8c2d944e7202de P 127766fc592545a4997f7790f50f6076 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:05:21.427076 21929 raft_consensus.cc:2764] T b08304a0a02b42d7840c4e8ee9a6bd1a P e5256d91808b47c195bc9b4dbd7f2b87 [term 7 FOLLOWER]: Leader pre-election decision vote started in defunct term 6: won
I20260709 13:05:21.399823 21976 raft_consensus.cc:2804] T 1dc5b3532fe54f74876d02beffa2c230 P e61c3a8f61bb48f8a963c9480e53c168 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:05:21.428009 21976 raft_consensus.cc:493] T 1dc5b3532fe54f74876d02beffa2c230 P e61c3a8f61bb48f8a963c9480e53c168 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:21.428329 21976 raft_consensus.cc:3060] T 1dc5b3532fe54f74876d02beffa2c230 P e61c3a8f61bb48f8a963c9480e53c168 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:05:21.376063 19405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ec1c4ce15e04c7e8c283a62179f2a64" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
I20260709 13:05:21.389505 19374 leader_election.cc:304] T 65d8cb8d6ec64f459d5a47cefab10acf P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 127766fc592545a4997f7790f50f6076, e5256d91808b47c195bc9b4dbd7f2b87; no voters: 
I20260709 13:05:21.286121 21992 consensus_queue.cc:1048] T 65d8cb8d6ec64f459d5a47cefab10acf P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.040s
I20260709 13:05:21.391021 19526 leader_election.cc:304] T 179fd671030940b4b4a4e24bcc4aba0a P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e61c3a8f61bb48f8a963c9480e53c168; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:05:21.382826 21823 raft_consensus.cc:697] T 70797e5783b5454ab0d0eea663e791e3 P e5256d91808b47c195bc9b4dbd7f2b87 [term 8 LEADER]: Becoming Leader. State: Replica: e5256d91808b47c195bc9b4dbd7f2b87, State: Running, Role: LEADER
I20260709 13:05:21.391139 19404 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5ec1c4ce15e04c7e8c283a62179f2a64"
dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
mode: GRACEFUL
new_leader_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
 from {username='slave'} at 127.0.0.1:37312
I20260709 13:05:21.390890 19402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65d8cb8d6ec64f459d5a47cefab10acf" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:05:21.369138 19407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14efcc79969f41babe5529c22d59156d" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
I20260709 13:05:21.437734 19407 raft_consensus.cc:2368] T 14efcc79969f41babe5529c22d59156d P e5256d91808b47c195bc9b4dbd7f2b87 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 127766fc592545a4997f7790f50f6076 for earlier term 5. Current term is 6.
I20260709 13:05:21.394976 21932 raft_consensus.cc:493] T 48824d5acfbc485ebf8c2d944e7202de P 0473d2b2d01f4459b1e90fd12cc7840e [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:21.438711 21932 raft_consensus.cc:3060] T 48824d5acfbc485ebf8c2d944e7202de P 0473d2b2d01f4459b1e90fd12cc7840e [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:05:21.438874 21823 consensus_queue.cc:237] T 70797e5783b5454ab0d0eea663e791e3 P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.6, Last appended by leader: 6, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:05:21.440032 22111 raft_consensus.cc:515] T 48824d5acfbc485ebf8c2d944e7202de P 127766fc592545a4997f7790f50f6076 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:05:21.395015 20106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "172b3dd13109415a955b71ac0e9d2234" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:05:21.404670 20107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa731b585f684a7fb2d106c50f143b83" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:05:21.441468 20106 raft_consensus.cc:2468] T 172b3dd13109415a955b71ac0e9d2234 P 127766fc592545a4997f7790f50f6076 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 3.
I20260709 13:05:21.442085 22111 leader_election.cc:290] T 48824d5acfbc485ebf8c2d944e7202de P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 6 election: Requested vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:05:21.387900 21833 raft_consensus.cc:3060] T 46c5bfeecc314717bffe987e6844b6d0 P e61c3a8f61bb48f8a963c9480e53c168 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:05:21.442605 22063 raft_consensus.cc:2804] T 65d8cb8d6ec64f459d5a47cefab10acf P e5256d91808b47c195bc9b4dbd7f2b87 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:05:21.443039 22063 raft_consensus.cc:493] T 65d8cb8d6ec64f459d5a47cefab10acf P e5256d91808b47c195bc9b4dbd7f2b87 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:21.443389 22063 raft_consensus.cc:3060] T 65d8cb8d6ec64f459d5a47cefab10acf P e5256d91808b47c195bc9b4dbd7f2b87 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:05:21.444900 19406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f85fc4b527a48848e5faa083b604e36" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
W20260709 13:05:21.446929 22120 log.cc:927] Time spent T 309c3ca0ca4b4f3ba129752ea2cb293b P 0473d2b2d01f4459b1e90fd12cc7840e: Append to log took a long time: real 0.059s	user 0.001s	sys 0.000s
I20260709 13:05:21.395906 22011 raft_consensus.cc:2804] T 46c5bfeecc314717bffe987e6844b6d0 P 0473d2b2d01f4459b1e90fd12cc7840e [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:05:21.451046 22011 raft_consensus.cc:493] T 46c5bfeecc314717bffe987e6844b6d0 P 0473d2b2d01f4459b1e90fd12cc7840e [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:21.451422 22011 raft_consensus.cc:3060] T 46c5bfeecc314717bffe987e6844b6d0 P 0473d2b2d01f4459b1e90fd12cc7840e [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:05:21.411231 20108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4af19371ea874c09a0a2147040835cbb" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:05:21.453495 21833 raft_consensus.cc:515] T 46c5bfeecc314717bffe987e6844b6d0 P e61c3a8f61bb48f8a963c9480e53c168 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:21.411468 19375 leader_election.cc:304] T ece3db938bc649d4a40a51522ed5259c P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168; no voters: 127766fc592545a4997f7790f50f6076
I20260709 13:05:21.456166 21833 leader_election.cc:290] T 46c5bfeecc314717bffe987e6844b6d0 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 11 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
W20260709 13:05:21.456339 19526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.2:46257, user_credentials={real_user=slave}} blocked reactor thread for 65394.2us
I20260709 13:05:21.456871 21833 raft_consensus.cc:2749] T 179fd671030940b4b4a4e24bcc4aba0a P e61c3a8f61bb48f8a963c9480e53c168 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:05:21.457737 19526 leader_election.cc:304] T 21e14947d70440f19044d8f75c31e1f9 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:05:21.411921 20110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48824d5acfbc485ebf8c2d944e7202de" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:05:21.458833 22089 raft_consensus.cc:2764] T 21e14947d70440f19044d8f75c31e1f9 P e61c3a8f61bb48f8a963c9480e53c168 [term 7 FOLLOWER]: Leader pre-election decision vote started in defunct term 5: won
I20260709 13:05:21.459296 20110 raft_consensus.cc:2393] T 48824d5acfbc485ebf8c2d944e7202de P 127766fc592545a4997f7790f50f6076 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0473d2b2d01f4459b1e90fd12cc7840e in current term 6: Already voted for candidate 127766fc592545a4997f7790f50f6076 in this term.
I20260709 13:05:21.412078 22049 raft_consensus.cc:2749] T 7be9efa6559648dbb5a0f7684c4542d1 P e5256d91808b47c195bc9b4dbd7f2b87 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:05:21.460268 22049 raft_consensus.cc:2804] T ece3db938bc649d4a40a51522ed5259c P e5256d91808b47c195bc9b4dbd7f2b87 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:05:21.460613 22049 raft_consensus.cc:493] T ece3db938bc649d4a40a51522ed5259c P e5256d91808b47c195bc9b4dbd7f2b87 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 127766fc592545a4997f7790f50f6076)
I20260709 13:05:21.460987 22049 raft_consensus.cc:3060] T ece3db938bc649d4a40a51522ed5259c P e5256d91808b47c195bc9b4dbd7f2b87 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:05:21.375372 21962 raft_consensus.cc:2804] T 179fd671030940b4b4a4e24bcc4aba0a P e5256d91808b47c195bc9b4dbd7f2b87 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:05:21.462589 20107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f85fc4b527a48848e5faa083b604e36" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:05:21.375998 21867 raft_consensus.cc:493] T 1dc5b3532fe54f74876d02beffa2c230 P e5256d91808b47c195bc9b4dbd7f2b87 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:21.463413 21867 raft_consensus.cc:3060] T 1dc5b3532fe54f74876d02beffa2c230 P e5256d91808b47c195bc9b4dbd7f2b87 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:05:21.463717 20107 raft_consensus.cc:2410] T 1f85fc4b527a48848e5faa083b604e36 P 127766fc592545a4997f7790f50f6076 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0473d2b2d01f4459b1e90fd12cc7840e for term 5 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 13:05:21.400187 21926 raft_consensus.cc:493] T 3e1f505cb0f1427bbd698ac889d80821 P e5256d91808b47c195bc9b4dbd7f2b87 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:21.466912 21926 raft_consensus.cc:3060] T 3e1f505cb0f1427bbd698ac889d80821 P e5256d91808b47c195bc9b4dbd7f2b87 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:05:21.416877 20111 raft_consensus.cc:2468] T 14efcc79969f41babe5529c22d59156d P 127766fc592545a4997f7790f50f6076 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 6.
I20260709 13:05:21.473394 20106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "775c229504194560ba9589bc2199b089" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:05:21.474087 20110 raft_consensus.cc:1240] T 96efeaaf1057492490e9a621f37e1a2d P 127766fc592545a4997f7790f50f6076 [term 6 FOLLOWER]: Rejecting Update request from peer 0473d2b2d01f4459b1e90fd12cc7840e for earlier term 5. Current term is 6. Ops: []
W20260709 13:05:21.475407 22116 log.cc:927] Time spent T e381f1d6b8184797ad142de49be225a8 P 0473d2b2d01f4459b1e90fd12cc7840e: Append to log took a long time: real 0.228s	user 0.001s	sys 0.000s
I20260709 13:05:21.375527 20103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9962423cb4e54fcfa5de01daf68a86e7" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:05:21.386723 21958 raft_consensus.cc:515] T 833a2f0775ed407a94b8924ce50adb63 P e5256d91808b47c195bc9b4dbd7f2b87 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:05:21.403575 21991 leader_election.cc:290] T 1f85fc4b527a48848e5faa083b604e36 P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321)
I20260709 13:05:21.462862 21962 raft_consensus.cc:493] T 179fd671030940b4b4a4e24bcc4aba0a P e5256d91808b47c195bc9b4dbd7f2b87 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 0473d2b2d01f4459b1e90fd12cc7840e)
I20260709 13:05:21.479084 21962 raft_consensus.cc:3060] T 179fd671030940b4b4a4e24bcc4aba0a P e5256d91808b47c195bc9b4dbd7f2b87 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:05:21.374763 21767 raft_consensus.cc:493] T 2b74109013a140ada21feeef92d6f563 P 0473d2b2d01f4459b1e90fd12cc7840e [term 3 FOLLOWER]: Starting leader election (detected failure of leader e5256d91808b47c195bc9b4dbd7f2b87)
I20260709 13:05:21.482982 21767 raft_consensus.cc:3060] T 2b74109013a140ada21feeef92d6f563 P 0473d2b2d01f4459b1e90fd12cc7840e [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:05:21.478065 20103 raft_consensus.cc:2468] T 9962423cb4e54fcfa5de01daf68a86e7 P 127766fc592545a4997f7790f50f6076 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 9.
I20260709 13:05:21.477154 20112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "775c229504194560ba9589bc2199b089" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
W20260709 13:05:21.488214 20075 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.1:40321, user_credentials={real_user=slave}} blocked reactor thread for 50490.7us
I20260709 13:05:21.500680 21963 raft_consensus.cc:515] T ef32ce6fdd0e40d382c79974f30295c6 P 0473d2b2d01f4459b1e90fd12cc7840e [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:21.502017 20108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0afb57ae58a24a01850491d69f0213dd" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:05:21.502902 21700 raft_consensus.cc:515] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P 0473d2b2d01f4459b1e90fd12cc7840e [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
W20260709 13:05:21.504103 22112 log.cc:927] Time spent T a08760e15aac4630a629431f56024dc8 P e5256d91808b47c195bc9b4dbd7f2b87: Append to log took a long time: real 0.293s	user 0.000s	sys 0.003s
I20260709 13:05:21.505414 21700 leader_election.cc:290] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 8 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:05:21.506132 21700 raft_consensus.cc:2804] T bc225c93219c45538b53a1bd3d387e4d P 0473d2b2d01f4459b1e90fd12cc7840e [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 13:05:21.506332 21957 consensus_meta.cc:287] T 2725d2c4cb054f18b0fc8f735c15f6c2 P e5256d91808b47c195bc9b4dbd7f2b87: Time spent flushing consensus metadata: real 0.719s	user 0.008s	sys 0.002s
I20260709 13:05:21.507202 19408 raft_consensus.cc:2410] T 2725d2c4cb054f18b0fc8f735c15f6c2 P e5256d91808b47c195bc9b4dbd7f2b87 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e61c3a8f61bb48f8a963c9480e53c168 for term 8 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 13:05:21.508126 21790 raft_consensus.cc:515] T 5ec1c4ce15e04c7e8c283a62179f2a64 P 0473d2b2d01f4459b1e90fd12cc7840e [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:05:21.508632 21916 raft_consensus.cc:493] T 2725d2c4cb054f18b0fc8f735c15f6c2 P e5256d91808b47c195bc9b4dbd7f2b87 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:21.509114 21916 raft_consensus.cc:515] T 2725d2c4cb054f18b0fc8f735c15f6c2 P e5256d91808b47c195bc9b4dbd7f2b87 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:21.510126 21790 leader_election.cc:290] T 5ec1c4ce15e04c7e8c283a62179f2a64 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 4 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:05:21.511061 19410 raft_consensus.cc:1275] T 2725d2c4cb054f18b0fc8f735c15f6c2 P e5256d91808b47c195bc9b4dbd7f2b87 [term 7 FOLLOWER]: Refusing update from remote peer 0473d2b2d01f4459b1e90fd12cc7840e: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 4. (term mismatch)
I20260709 13:05:21.511386 19410 pending_rounds.cc:85] T 2725d2c4cb054f18b0fc8f735c15f6c2 P e5256d91808b47c195bc9b4dbd7f2b87: Aborting all ops after (but not including) 3
I20260709 13:05:21.511583 19410 pending_rounds.cc:107] T 2725d2c4cb054f18b0fc8f735c15f6c2 P e5256d91808b47c195bc9b4dbd7f2b87: Aborting uncommitted NO_OP operation due to leader change: 6.4
I20260709 13:05:21.511795 19410 raft_consensus.cc:2889] T 2725d2c4cb054f18b0fc8f735c15f6c2 P e5256d91808b47c195bc9b4dbd7f2b87 [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:05:21.458611 19526 leader_election.cc:304] T 0e1085d23e8347fbbd5bce7542f4b1f4 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e61c3a8f61bb48f8a963c9480e53c168; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, 127766fc592545a4997f7790f50f6076
I20260709 13:05:21.492489 22104 raft_consensus.cc:515] T f1b10566f45d4a7d9029858330e02d5b P e5256d91808b47c195bc9b4dbd7f2b87 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:21.522847 21992 raft_consensus.cc:2749] T 0e1085d23e8347fbbd5bce7542f4b1f4 P e61c3a8f61bb48f8a963c9480e53c168 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:05:21.524142 21790 raft_consensus.cc:2804] T 3e1f505cb0f1427bbd698ac889d80821 P 0473d2b2d01f4459b1e90fd12cc7840e [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:05:21.506605 21700 raft_consensus.cc:493] T bc225c93219c45538b53a1bd3d387e4d P 0473d2b2d01f4459b1e90fd12cc7840e [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:21.525182 21700 raft_consensus.cc:3060] T bc225c93219c45538b53a1bd3d387e4d P 0473d2b2d01f4459b1e90fd12cc7840e [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:05:21.524597 21790 raft_consensus.cc:493] T 3e1f505cb0f1427bbd698ac889d80821 P 0473d2b2d01f4459b1e90fd12cc7840e [term 4 FOLLOWER]: Starting leader election (detected failure of leader e61c3a8f61bb48f8a963c9480e53c168)
W20260709 13:05:21.498456 19374 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.4:43121, user_credentials={real_user=slave}} blocked reactor thread for 63786.4us
W20260709 13:05:21.526587 19526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.2:46257, user_credentials={real_user=slave}} blocked reactor thread for 68055.9us
I20260709 13:05:21.530591 19374 leader_election.cc:304] T 14efcc79969f41babe5529c22d59156d P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 127766fc592545a4997f7790f50f6076, e5256d91808b47c195bc9b4dbd7f2b87; no voters: 
I20260709 13:05:21.501498 21958 leader_election.cc:290] T 833a2f0775ed407a94b8924ce50adb63 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:05:21.535161 19526 leader_election.cc:304] T f93ee515a9c14139bf566522ed8232f3 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:05:21.538113 19526 leader_election.cc:304] T 0afb57ae58a24a01850491d69f0213dd P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e61c3a8f61bb48f8a963c9480e53c168; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, 127766fc592545a4997f7790f50f6076
I20260709 13:05:21.540175 19374 leader_election.cc:304] T 9962423cb4e54fcfa5de01daf68a86e7 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 127766fc592545a4997f7790f50f6076, e5256d91808b47c195bc9b4dbd7f2b87; no voters: 
I20260709 13:05:21.526325 22111 raft_consensus.cc:493] T 833a2f0775ed407a94b8924ce50adb63 P 127766fc592545a4997f7790f50f6076 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:21.558315 19526 leader_election.cc:304] T 48824d5acfbc485ebf8c2d944e7202de P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:05:21.560505 20075 leader_election.cc:400] T 14efcc79969f41babe5529c22d59156d P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 5 election: Vote denied by peer e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321) with higher term. Message: Invalid argument: T 14efcc79969f41babe5529c22d59156d P e5256d91808b47c195bc9b4dbd7f2b87 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 127766fc592545a4997f7790f50f6076 for earlier term 5. Current term is 6.
I20260709 13:05:21.528796 21790 raft_consensus.cc:3060] T 3e1f505cb0f1427bbd698ac889d80821 P 0473d2b2d01f4459b1e90fd12cc7840e [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:05:21.562240 20075 leader_election.cc:403] T 14efcc79969f41babe5529c22d59156d P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 5 election: Cancelling election due to peer responding with higher term
I20260709 13:05:21.563377 19526 leader_election.cc:304] T d1e5873a19244c5ebbcd38e126796ee7 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:05:21.562374 20108 raft_consensus.cc:2393] T 0afb57ae58a24a01850491d69f0213dd P 127766fc592545a4997f7790f50f6076 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0473d2b2d01f4459b1e90fd12cc7840e in current term 7: Already voted for candidate 127766fc592545a4997f7790f50f6076 in this term.
I20260709 13:05:21.568799 19526 leader_election.cc:304] T 62c6c134d3d24a1ab144dd9ee6bc3f64 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168; no voters: 127766fc592545a4997f7790f50f6076
I20260709 13:05:21.570648 19526 leader_election.cc:304] T df751f992649444090e27965eb1af85d P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
W20260709 13:05:21.568416 19523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.1:40321, user_credentials={real_user=slave}} blocked reactor thread for 338090us
I20260709 13:05:21.571774 19523 leader_election.cc:304] T 7be9efa6559648dbb5a0f7684c4542d1 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:05:21.560981 21958 raft_consensus.cc:2804] T 14efcc79969f41babe5529c22d59156d P e5256d91808b47c195bc9b4dbd7f2b87 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:05:21.562783 21992 raft_consensus.cc:2804] T f93ee515a9c14139bf566522ed8232f3 P e61c3a8f61bb48f8a963c9480e53c168 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:05:21.572999 21963 leader_election.cc:290] T ef32ce6fdd0e40d382c79974f30295c6 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 6 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:05:21.573213 21958 raft_consensus.cc:697] T 14efcc79969f41babe5529c22d59156d P e5256d91808b47c195bc9b4dbd7f2b87 [term 6 LEADER]: Becoming Leader. State: Replica: e5256d91808b47c195bc9b4dbd7f2b87, State: Running, Role: LEADER
I20260709 13:05:21.573799 22053 raft_consensus.cc:2804] T d1e5873a19244c5ebbcd38e126796ee7 P e61c3a8f61bb48f8a963c9480e53c168 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:05:21.574245 22053 raft_consensus.cc:493] T d1e5873a19244c5ebbcd38e126796ee7 P e61c3a8f61bb48f8a963c9480e53c168 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:21.574610 22053 raft_consensus.cc:3060] T d1e5873a19244c5ebbcd38e126796ee7 P e61c3a8f61bb48f8a963c9480e53c168 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:05:21.574491 21958 consensus_queue.cc:237] T 14efcc79969f41babe5529c22d59156d P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:05:21.573444 21992 raft_consensus.cc:493] T f93ee515a9c14139bf566522ed8232f3 P e61c3a8f61bb48f8a963c9480e53c168 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:21.579880 19526 leader_election.cc:304] T ef32ce6fdd0e40d382c79974f30295c6 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:05:21.577915 21833 raft_consensus.cc:2804] T 62c6c134d3d24a1ab144dd9ee6bc3f64 P e61c3a8f61bb48f8a963c9480e53c168 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:05:21.528347 22076 raft_consensus.cc:515] T 21e14947d70440f19044d8f75c31e1f9 P 0473d2b2d01f4459b1e90fd12cc7840e [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:21.561113 21529 raft_consensus.cc:2749] T 0afb57ae58a24a01850491d69f0213dd P e61c3a8f61bb48f8a963c9480e53c168 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:05:21.528031 22066 raft_consensus.cc:515] T df751f992649444090e27965eb1af85d P e5256d91808b47c195bc9b4dbd7f2b87 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:21.587116 19526 leader_election.cc:304] T 2b74109013a140ada21feeef92d6f563 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
W20260709 13:05:21.588296 19450 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.3:36891, user_credentials={real_user=slave}} blocked reactor thread for 192218us
I20260709 13:05:21.528851 22064 raft_consensus.cc:515] T 5ec1c4ce15e04c7e8c283a62179f2a64 P e5256d91808b47c195bc9b4dbd7f2b87 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:05:21.554370 21980 raft_consensus.cc:515] T 85c494af21f9457a85da47b9bc70c1fd P e5256d91808b47c195bc9b4dbd7f2b87 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:05:21.565351 22114 raft_consensus.cc:2804] T 48824d5acfbc485ebf8c2d944e7202de P e61c3a8f61bb48f8a963c9480e53c168 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:05:21.595886 20112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "833a2f0775ed407a94b8924ce50adb63" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:05:21.586913 22089 raft_consensus.cc:2804] T df751f992649444090e27965eb1af85d P e61c3a8f61bb48f8a963c9480e53c168 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:05:21.632381 21529 raft_consensus.cc:2804] T ef32ce6fdd0e40d382c79974f30295c6 P e61c3a8f61bb48f8a963c9480e53c168 [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 13:05:21.634724 19526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.2:46257, user_credentials={real_user=slave}} blocked reactor thread for 47701.8us
W20260709 13:05:21.596572 19449 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.1:40321, user_credentials={real_user=slave}} blocked reactor thread for 308178us
I20260709 13:05:21.645746 19449 leader_election.cc:304] T 76cb037fc9064d13b59a8969d897ce8c P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e; no voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:05:21.564538 22111 raft_consensus.cc:515] T 833a2f0775ed407a94b8924ce50adb63 P 127766fc592545a4997f7790f50f6076 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:05:21.645627 19526 leader_election.cc:304] T f1b10566f45d4a7d9029858330e02d5b P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:05:21.586361 21833 raft_consensus.cc:493] T 62c6c134d3d24a1ab144dd9ee6bc3f64 P e61c3a8f61bb48f8a963c9480e53c168 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 127766fc592545a4997f7790f50f6076)
I20260709 13:05:21.586717 21992 raft_consensus.cc:3060] T f93ee515a9c14139bf566522ed8232f3 P e61c3a8f61bb48f8a963c9480e53c168 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:05:21.654090 19450 leader_election.cc:304] T 62c6c134d3d24a1ab144dd9ee6bc3f64 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:05:21.584542 22027 raft_consensus.cc:2804] T 7be9efa6559648dbb5a0f7684c4542d1 P e61c3a8f61bb48f8a963c9480e53c168 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:05:21.682917 22027 raft_consensus.cc:493] T 7be9efa6559648dbb5a0f7684c4542d1 P e61c3a8f61bb48f8a963c9480e53c168 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:21.683506 22027 raft_consensus.cc:3060] T 7be9efa6559648dbb5a0f7684c4542d1 P e61c3a8f61bb48f8a963c9480e53c168 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:05:21.659636 19375 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.3:36891, user_credentials={real_user=slave}} blocked reactor thread for 248234us
I20260709 13:05:21.578357 22021 raft_consensus.cc:2749] T 14efcc79969f41babe5529c22d59156d P 127766fc592545a4997f7790f50f6076 [term 6 FOLLOWER]: Leader election lost for term 5. Reason: Vote denied by peer e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321) with higher term. Message: Invalid argument: T 14efcc79969f41babe5529c22d59156d P e5256d91808b47c195bc9b4dbd7f2b87 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 127766fc592545a4997f7790f50f6076 for earlier term 5. Current term is 6.
I20260709 13:05:21.703575 20112 raft_consensus.cc:2468] T 833a2f0775ed407a94b8924ce50adb63 P 127766fc592545a4997f7790f50f6076 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 5.
I20260709 13:05:21.643750 22114 raft_consensus.cc:493] T 48824d5acfbc485ebf8c2d944e7202de P e61c3a8f61bb48f8a963c9480e53c168 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 0473d2b2d01f4459b1e90fd12cc7840e)
I20260709 13:05:21.647888 22089 raft_consensus.cc:493] T df751f992649444090e27965eb1af85d P e61c3a8f61bb48f8a963c9480e53c168 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:21.647172 21529 raft_consensus.cc:493] T ef32ce6fdd0e40d382c79974f30295c6 P e61c3a8f61bb48f8a963c9480e53c168 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:21.691953 19404 raft_consensus.cc:606] T 5ec1c4ce15e04c7e8c283a62179f2a64 P e5256d91808b47c195bc9b4dbd7f2b87 [term 5 FOLLOWER]: Received request to transfer leadership to TS 0473d2b2d01f4459b1e90fd12cc7840e
I20260709 13:05:21.713411 19404 raft_consensus.cc:614] T 5ec1c4ce15e04c7e8c283a62179f2a64 P e5256d91808b47c195bc9b4dbd7f2b87 [term 5 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:05:21.662927 21833 raft_consensus.cc:3060] T 62c6c134d3d24a1ab144dd9ee6bc3f64 P e61c3a8f61bb48f8a963c9480e53c168 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:05:21.714390 19405 raft_consensus.cc:2393] T 5ec1c4ce15e04c7e8c283a62179f2a64 P e5256d91808b47c195bc9b4dbd7f2b87 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 127766fc592545a4997f7790f50f6076 in current term 5: Already voted for candidate e5256d91808b47c195bc9b4dbd7f2b87 in this term.
I20260709 13:05:21.712924 22114 raft_consensus.cc:3060] T 48824d5acfbc485ebf8c2d944e7202de P e61c3a8f61bb48f8a963c9480e53c168 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:05:21.717324 20078 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.2:46257, user_credentials={real_user=slave}} blocked reactor thread for 86418.1us
I20260709 13:05:21.638346 22057 raft_consensus.cc:515] T f93ee515a9c14139bf566522ed8232f3 P 0473d2b2d01f4459b1e90fd12cc7840e [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
W20260709 13:05:21.720789 19526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.2:46257, user_credentials={real_user=slave}} blocked reactor thread for 75244.5us
I20260709 13:05:21.706988 19375 leader_election.cc:304] T 28af091831594f9d8e96482078cc7625 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168
W20260709 13:05:21.725504 19523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.1:40321, user_credentials={real_user=slave}} blocked reactor thread for 142679us
I20260709 13:05:21.721694 19526 leader_election.cc:304] T 3e1f505cb0f1427bbd698ac889d80821 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:05:21.724655 19375 leader_election.cc:304] T ef32ce6fdd0e40d382c79974f30295c6 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:05:21.729239 22102 raft_consensus.cc:2804] T ef32ce6fdd0e40d382c79974f30295c6 P e5256d91808b47c195bc9b4dbd7f2b87 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:05:21.729671 22102 raft_consensus.cc:493] T ef32ce6fdd0e40d382c79974f30295c6 P e5256d91808b47c195bc9b4dbd7f2b87 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:21.730021 22102 raft_consensus.cc:3060] T ef32ce6fdd0e40d382c79974f30295c6 P e5256d91808b47c195bc9b4dbd7f2b87 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:05:21.730090 22076 leader_election.cc:290] T 21e14947d70440f19044d8f75c31e1f9 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 7 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:05:21.630252 22063 raft_consensus.cc:515] T 65d8cb8d6ec64f459d5a47cefab10acf P e5256d91808b47c195bc9b4dbd7f2b87 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:05:21.713624 22089 raft_consensus.cc:3060] T df751f992649444090e27965eb1af85d P e61c3a8f61bb48f8a963c9480e53c168 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:05:21.713259 21529 raft_consensus.cc:3060] T ef32ce6fdd0e40d382c79974f30295c6 P e61c3a8f61bb48f8a963c9480e53c168 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:05:21.734128 19374 leader_election.cc:304] T 833a2f0775ed407a94b8924ce50adb63 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 127766fc592545a4997f7790f50f6076, e5256d91808b47c195bc9b4dbd7f2b87; no voters: 
I20260709 13:05:21.765223 19375 leader_election.cc:304] T f93ee515a9c14139bf566522ed8232f3 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
W20260709 13:05:21.767244 19377 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.2:46257, user_credentials={real_user=slave}} blocked reactor thread for 48480.8us
I20260709 13:05:21.724432 22122 raft_consensus.cc:2804] T 2b74109013a140ada21feeef92d6f563 P e61c3a8f61bb48f8a963c9480e53c168 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:05:21.727927 21929 raft_consensus.cc:2749] T 28af091831594f9d8e96482078cc7625 P e5256d91808b47c195bc9b4dbd7f2b87 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:05:21.775597 19402 raft_consensus.cc:2393] T 65d8cb8d6ec64f459d5a47cefab10acf P e5256d91808b47c195bc9b4dbd7f2b87 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 127766fc592545a4997f7790f50f6076 in current term 4: Already voted for candidate e5256d91808b47c195bc9b4dbd7f2b87 in this term.
I20260709 13:05:21.771641 22076 raft_consensus.cc:2804] T 62c6c134d3d24a1ab144dd9ee6bc3f64 P 0473d2b2d01f4459b1e90fd12cc7840e [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:05:21.716506 21767 raft_consensus.cc:515] T 2b74109013a140ada21feeef92d6f563 P 0473d2b2d01f4459b1e90fd12cc7840e [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:21.781023 22076 raft_consensus.cc:493] T 62c6c134d3d24a1ab144dd9ee6bc3f64 P 0473d2b2d01f4459b1e90fd12cc7840e [term 7 FOLLOWER]: Starting leader election (detected failure of leader 127766fc592545a4997f7790f50f6076)
I20260709 13:05:21.781445 22076 raft_consensus.cc:3060] T 62c6c134d3d24a1ab144dd9ee6bc3f64 P 0473d2b2d01f4459b1e90fd12cc7840e [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:05:21.782840 21767 leader_election.cc:290] T 2b74109013a140ada21feeef92d6f563 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 4 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:05:21.796557 21867 raft_consensus.cc:515] T 1dc5b3532fe54f74876d02beffa2c230 P e5256d91808b47c195bc9b4dbd7f2b87 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
W20260709 13:05:21.799064 22125 log.cc:927] Time spent T e381f1d6b8184797ad142de49be225a8 P e5256d91808b47c195bc9b4dbd7f2b87: Append to log took a long time: real 0.214s	user 0.001s	sys 0.000s
I20260709 13:05:21.798908 22076 raft_consensus.cc:515] T 62c6c134d3d24a1ab144dd9ee6bc3f64 P 0473d2b2d01f4459b1e90fd12cc7840e [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:05:21.798897 21867 leader_election.cc:290] T 1dc5b3532fe54f74876d02beffa2c230 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 5 election: Requested vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:05:21.802737 21971 raft_consensus.cc:2804] T f1b10566f45d4a7d9029858330e02d5b P e61c3a8f61bb48f8a963c9480e53c168 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:05:21.803215 21971 raft_consensus.cc:493] T f1b10566f45d4a7d9029858330e02d5b P e61c3a8f61bb48f8a963c9480e53c168 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 0473d2b2d01f4459b1e90fd12cc7840e)
I20260709 13:05:21.811973 21971 raft_consensus.cc:3060] T f1b10566f45d4a7d9029858330e02d5b P e61c3a8f61bb48f8a963c9480e53c168 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:05:21.815373 22066 leader_election.cc:290] T df751f992649444090e27965eb1af85d P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 7 election: Requested vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:05:21.777884 22131 raft_consensus.cc:2804] T 833a2f0775ed407a94b8924ce50adb63 P e5256d91808b47c195bc9b4dbd7f2b87 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:05:21.816895 22131 raft_consensus.cc:493] T 833a2f0775ed407a94b8924ce50adb63 P e5256d91808b47c195bc9b4dbd7f2b87 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 127766fc592545a4997f7790f50f6076)
I20260709 13:05:21.817330 22131 raft_consensus.cc:3060] T 833a2f0775ed407a94b8924ce50adb63 P e5256d91808b47c195bc9b4dbd7f2b87 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:05:21.732662 22128 raft_consensus.cc:2749] T 76cb037fc9064d13b59a8969d897ce8c P 0473d2b2d01f4459b1e90fd12cc7840e [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:05:21.832056 21916 leader_election.cc:290] T 2725d2c4cb054f18b0fc8f735c15f6c2 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:05:21.778519 22104 leader_election.cc:290] T f1b10566f45d4a7d9029858330e02d5b P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 8 election: Requested vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:05:21.788524 21958 raft_consensus.cc:2804] T f93ee515a9c14139bf566522ed8232f3 P e5256d91808b47c195bc9b4dbd7f2b87 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:05:21.775960 22122 raft_consensus.cc:493] T 2b74109013a140ada21feeef92d6f563 P e61c3a8f61bb48f8a963c9480e53c168 [term 3 FOLLOWER]: Starting leader election (detected failure of leader e5256d91808b47c195bc9b4dbd7f2b87)
I20260709 13:05:21.842970 22122 raft_consensus.cc:3060] T 2b74109013a140ada21feeef92d6f563 P e61c3a8f61bb48f8a963c9480e53c168 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:05:21.843375 22011 raft_consensus.cc:515] T 46c5bfeecc314717bffe987e6844b6d0 P 0473d2b2d01f4459b1e90fd12cc7840e [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:21.844538 21980 leader_election.cc:290] T 85c494af21f9457a85da47b9bc70c1fd P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 4 election: Requested vote from peers e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:05:21.845216 21958 raft_consensus.cc:493] T f93ee515a9c14139bf566522ed8232f3 P e5256d91808b47c195bc9b4dbd7f2b87 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:21.846419 21958 raft_consensus.cc:3060] T f93ee515a9c14139bf566522ed8232f3 P e5256d91808b47c195bc9b4dbd7f2b87 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:05:21.848877 20112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85c494af21f9457a85da47b9bc70c1fd" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076"
I20260709 13:05:21.849645 20112 raft_consensus.cc:3060] T 85c494af21f9457a85da47b9bc70c1fd P 127766fc592545a4997f7790f50f6076 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:05:21.840472 22132 log.cc:927] Time spent T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P e5256d91808b47c195bc9b4dbd7f2b87: Append to log took a long time: real 0.071s	user 0.001s	sys 0.000s
W20260709 13:05:21.837993 22121 log.cc:927] Time spent T b9f0d59553ad444883fcf5b5909f9798 P 0473d2b2d01f4459b1e90fd12cc7840e: Append to log took a long time: real 0.203s	user 0.000s	sys 0.000s
I20260709 13:05:21.804455 21559 raft_consensus.cc:2804] T 3e1f505cb0f1427bbd698ac889d80821 P e61c3a8f61bb48f8a963c9480e53c168 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:05:21.856195 22064 leader_election.cc:290] T 5ec1c4ce15e04c7e8c283a62179f2a64 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 5 election: Requested vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:05:21.868090 22063 leader_election.cc:290] T 65d8cb8d6ec64f459d5a47cefab10acf P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 4 election: Requested vote from peers e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:05:21.867558 21932 raft_consensus.cc:515] T 48824d5acfbc485ebf8c2d944e7202de P 0473d2b2d01f4459b1e90fd12cc7840e [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:05:21.867560 21849 raft_consensus.cc:515] T 46c5bfeecc314717bffe987e6844b6d0 P e5256d91808b47c195bc9b4dbd7f2b87 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:21.870568 21926 raft_consensus.cc:515] T 3e1f505cb0f1427bbd698ac889d80821 P e5256d91808b47c195bc9b4dbd7f2b87 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:21.871062 21849 leader_election.cc:290] T 46c5bfeecc314717bffe987e6844b6d0 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 11 election: Requested vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:05:21.872840 21926 leader_election.cc:290] T 3e1f505cb0f1427bbd698ac889d80821 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 6 election: Requested vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:05:21.887825 22122 raft_consensus.cc:515] T 2b74109013a140ada21feeef92d6f563 P e61c3a8f61bb48f8a963c9480e53c168 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:21.901029 22122 leader_election.cc:290] T 2b74109013a140ada21feeef92d6f563 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 4 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:05:21.865653 19404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "833a2f0775ed407a94b8924ce50adb63" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:05:21.866495 21559 raft_consensus.cc:493] T 3e1f505cb0f1427bbd698ac889d80821 P e61c3a8f61bb48f8a963c9480e53c168 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:21.777539 21976 raft_consensus.cc:515] T 1dc5b3532fe54f74876d02beffa2c230 P e61c3a8f61bb48f8a963c9480e53c168 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:21.801620 22007 raft_consensus.cc:515] T 7be9efa6559648dbb5a0f7684c4542d1 P 0473d2b2d01f4459b1e90fd12cc7840e [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } attrs { replace: true } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: NON_VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: true } }
I20260709 13:05:21.876456 22049 raft_consensus.cc:515] T ece3db938bc649d4a40a51522ed5259c P e5256d91808b47c195bc9b4dbd7f2b87 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:05:21.881752 20108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ec1c4ce15e04c7e8c283a62179f2a64" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076"
I20260709 13:05:21.820461 22057 leader_election.cc:290] T f93ee515a9c14139bf566522ed8232f3 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 8 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:05:21.920394 20108 raft_consensus.cc:2393] T 5ec1c4ce15e04c7e8c283a62179f2a64 P 127766fc592545a4997f7790f50f6076 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate e5256d91808b47c195bc9b4dbd7f2b87 in current term 5: Already voted for candidate 127766fc592545a4997f7790f50f6076 in this term.
I20260709 13:05:21.921561 20103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65d8cb8d6ec64f459d5a47cefab10acf" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076"
I20260709 13:05:21.915381 21559 raft_consensus.cc:3060] T 3e1f505cb0f1427bbd698ac889d80821 P e61c3a8f61bb48f8a963c9480e53c168 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:05:21.932070 19408 raft_consensus.cc:1240] T ece3db938bc649d4a40a51522ed5259c P e5256d91808b47c195bc9b4dbd7f2b87 [term 6 FOLLOWER]: Rejecting Update request from peer 127766fc592545a4997f7790f50f6076 for earlier term 5. Current term is 6. Ops: []
W20260709 13:05:21.915982 19450 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.3:36891, user_credentials={real_user=slave}} blocked reactor thread for 261947us
I20260709 13:05:21.933552 20103 raft_consensus.cc:3060] T 65d8cb8d6ec64f459d5a47cefab10acf P 127766fc592545a4997f7790f50f6076 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:05:21.921211 21962 raft_consensus.cc:515] T 179fd671030940b4b4a4e24bcc4aba0a P e5256d91808b47c195bc9b4dbd7f2b87 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:21.945308 21962 leader_election.cc:290] T 179fd671030940b4b4a4e24bcc4aba0a P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 6 election: Requested vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
W20260709 13:05:21.947391 22137 log.cc:927] Time spent T 14efcc79969f41babe5529c22d59156d P e5256d91808b47c195bc9b4dbd7f2b87: Append to log took a long time: real 0.108s	user 0.003s	sys 0.000s
I20260709 13:05:21.936729 21957 raft_consensus.cc:2804] T 9962423cb4e54fcfa5de01daf68a86e7 P e5256d91808b47c195bc9b4dbd7f2b87 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:05:21.950788 22049 leader_election.cc:290] T ece3db938bc649d4a40a51522ed5259c P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 6 election: Requested vote from peers e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:05:21.951529 22011 leader_election.cc:290] T 46c5bfeecc314717bffe987e6844b6d0 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 11 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:05:21.884270 20112 raft_consensus.cc:2468] T 85c494af21f9457a85da47b9bc70c1fd P 127766fc592545a4997f7790f50f6076 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 4.
I20260709 13:05:21.835220 22027 raft_consensus.cc:515] T 7be9efa6559648dbb5a0f7684c4542d1 P e61c3a8f61bb48f8a963c9480e53c168 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } attrs { replace: true } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: NON_VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: true } }
I20260709 13:05:21.884795 22053 raft_consensus.cc:515] T d1e5873a19244c5ebbcd38e126796ee7 P e61c3a8f61bb48f8a963c9480e53c168 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:21.885156 19405 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7f575b143b844aa096b50997dad3516a"
dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
mode: GRACEFUL
new_leader_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
 from {username='slave'} at 127.0.0.1:37312
I20260709 13:05:21.887818 21700 raft_consensus.cc:515] T bc225c93219c45538b53a1bd3d387e4d P 0473d2b2d01f4459b1e90fd12cc7840e [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:21.888904 21992 raft_consensus.cc:515] T f93ee515a9c14139bf566522ed8232f3 P e61c3a8f61bb48f8a963c9480e53c168 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:21.892313 22111 leader_election.cc:290] T 833a2f0775ed407a94b8924ce50adb63 P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:05:21.952023 21957 raft_consensus.cc:493] T 9962423cb4e54fcfa5de01daf68a86e7 P e5256d91808b47c195bc9b4dbd7f2b87 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 0473d2b2d01f4459b1e90fd12cc7840e)
I20260709 13:05:21.893916 21790 raft_consensus.cc:515] T 3e1f505cb0f1427bbd698ac889d80821 P 0473d2b2d01f4459b1e90fd12cc7840e [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:21.895170 21833 raft_consensus.cc:515] T 62c6c134d3d24a1ab144dd9ee6bc3f64 P e61c3a8f61bb48f8a963c9480e53c168 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:05:21.898588 22076 leader_election.cc:290] T 62c6c134d3d24a1ab144dd9ee6bc3f64 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 8 election: Requested vote from peers e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:05:21.901175 21971 raft_consensus.cc:515] T f1b10566f45d4a7d9029858330e02d5b P e61c3a8f61bb48f8a963c9480e53c168 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:21.971131 19450 leader_election.cc:304] T d1e5873a19244c5ebbcd38e126796ee7 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
W20260709 13:05:22.023476 19450 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.3:36891, user_credentials={real_user=slave}} blocked reactor thread for 69436.4us
I20260709 13:05:22.024361 19450 leader_election.cc:304] T f1b10566f45d4a7d9029858330e02d5b P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:05:21.933591 21932 leader_election.cc:290] T 48824d5acfbc485ebf8c2d944e7202de P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 6 election: Requested vote from peers e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:05:21.952450 22114 raft_consensus.cc:515] T 48824d5acfbc485ebf8c2d944e7202de P e61c3a8f61bb48f8a963c9480e53c168 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:05:21.975193 22007 leader_election.cc:290] T 7be9efa6559648dbb5a0f7684c4542d1 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 7 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:05:22.010962 21957 raft_consensus.cc:3060] T 9962423cb4e54fcfa5de01daf68a86e7 P e5256d91808b47c195bc9b4dbd7f2b87 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:05:22.032053 19551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9f0d59553ad444883fcf5b5909f9798" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:05:21.974915 22102 raft_consensus.cc:515] T ef32ce6fdd0e40d382c79974f30295c6 P e5256d91808b47c195bc9b4dbd7f2b87 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:22.045220 19477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96efeaaf1057492490e9a621f37e1a2d" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:05:21.970808 20110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ece3db938bc649d4a40a51522ed5259c" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076"
I20260709 13:05:22.046048 19478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed7fdbcb96d14d418db9ca90a792588a" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:05:22.046195 19486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14935b3ddf914369822e4a0547aaa355" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:05:22.046427 19485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0afb57ae58a24a01850491d69f0213dd" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:05:22.046931 19481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14efcc79969f41babe5529c22d59156d" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:05:22.047194 19485 raft_consensus.cc:2376] T 0afb57ae58a24a01850491d69f0213dd P 0473d2b2d01f4459b1e90fd12cc7840e [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 127766fc592545a4997f7790f50f6076 in term 7. Re-sending same reply.
I20260709 13:05:22.047703 19481 raft_consensus.cc:2393] T 14efcc79969f41babe5529c22d59156d P 0473d2b2d01f4459b1e90fd12cc7840e [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 127766fc592545a4997f7790f50f6076 in current term 5: Already voted for candidate 0473d2b2d01f4459b1e90fd12cc7840e in this term.
I20260709 13:05:22.048429 19481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ec1c4ce15e04c7e8c283a62179f2a64" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:05:22.048730 19484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36f6ba92b9ba46babe4ebd6c02e5fbd9" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:05:22.049113 19481 raft_consensus.cc:3060] T 5ec1c4ce15e04c7e8c283a62179f2a64 P 0473d2b2d01f4459b1e90fd12cc7840e [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:05:22.049798 19484 raft_consensus.cc:2393] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P 0473d2b2d01f4459b1e90fd12cc7840e [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 127766fc592545a4997f7790f50f6076 in current term 8: Already voted for candidate 0473d2b2d01f4459b1e90fd12cc7840e in this term.
I20260709 13:05:22.051040 19479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "309c3ca0ca4b4f3ba129752ea2cb293b" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:05:22.051260 19551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef32ce6fdd0e40d382c79974f30295c6" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:05:21.979674 19374 leader_election.cc:304] T 85c494af21f9457a85da47b9bc70c1fd P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 127766fc592545a4997f7790f50f6076, e5256d91808b47c195bc9b4dbd7f2b87; no voters: 
I20260709 13:05:22.001740 19405 raft_consensus.cc:606] T 7f575b143b844aa096b50997dad3516a P e5256d91808b47c195bc9b4dbd7f2b87 [term 2 LEADER]: Received request to transfer leadership to TS e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:05:21.893066 22131 raft_consensus.cc:515] T 833a2f0775ed407a94b8924ce50adb63 P e5256d91808b47c195bc9b4dbd7f2b87 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
W20260709 13:05:22.010861 19449 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.1:40321, user_credentials={real_user=slave}} blocked reactor thread for 354233us
I20260709 13:05:22.061074 19557 raft_consensus.cc:1240] T 96efeaaf1057492490e9a621f37e1a2d P e61c3a8f61bb48f8a963c9480e53c168 [term 6 FOLLOWER]: Rejecting Update request from peer 0473d2b2d01f4459b1e90fd12cc7840e for earlier term 5. Current term is 6. Ops: []
I20260709 13:05:21.970767 22056 consensus_queue.cc:1059] T ece3db938bc649d4a40a51522ed5259c P 127766fc592545a4997f7790f50f6076 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.055s
I20260709 13:05:21.954433 21529 raft_consensus.cc:515] T ef32ce6fdd0e40d382c79974f30295c6 P e61c3a8f61bb48f8a963c9480e53c168 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
W20260709 13:05:22.029911 19523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.1:40321, user_credentials={real_user=slave}} blocked reactor thread for 303733us
I20260709 13:05:21.975342 22027 leader_election.cc:290] T 7be9efa6559648dbb5a0f7684c4542d1 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 7 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:05:22.033061 19555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f575b143b844aa096b50997dad3516a" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:05:22.039215 19553 raft_consensus.cc:1275] T 2725d2c4cb054f18b0fc8f735c15f6c2 P e61c3a8f61bb48f8a963c9480e53c168 [term 7 FOLLOWER]: Refusing update from remote peer 0473d2b2d01f4459b1e90fd12cc7840e: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:05:22.040004 19556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b08304a0a02b42d7840c4e8ee9a6bd1a" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:05:22.040911 19560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e36a9d6e29c4a7c860cf267efbd4c74" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:05:22.042230 19554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a08760e15aac4630a629431f56024dc8" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:05:22.042964 19559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "217b5fae677b4971b3bbd2f357a1f7ff" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
W20260709 13:05:22.043318 19375 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.3:36891, user_credentials={real_user=slave}} blocked reactor thread for 269783us
I20260709 13:05:22.046855 19486 raft_consensus.cc:2468] T 14935b3ddf914369822e4a0547aaa355 P 0473d2b2d01f4459b1e90fd12cc7840e [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 127766fc592545a4997f7790f50f6076 in term 5.
I20260709 13:05:21.952695 22089 raft_consensus.cc:515] T df751f992649444090e27965eb1af85d P e61c3a8f61bb48f8a963c9480e53c168 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:22.027896 20108 raft_consensus.cc:1240] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P 127766fc592545a4997f7790f50f6076 [term 8 FOLLOWER]: Rejecting Update request from peer e5256d91808b47c195bc9b4dbd7f2b87 for earlier term 7. Current term is 8. Ops: []
I20260709 13:05:22.069502 19377 leader_election.cc:304] T b9f0d59553ad444883fcf5b5909f9798 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87; no voters: e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:05:22.074029 19485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36f6ba92b9ba46babe4ebd6c02e5fbd9" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
W20260709 13:05:22.132932 19526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.2:46257, user_credentials={real_user=slave}} blocked reactor thread for 411337us
W20260709 13:05:22.080371 19374 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.4:43121, user_credentials={real_user=slave}} blocked reactor thread for 100822us
I20260709 13:05:22.091324 19480 raft_consensus.cc:1240] T 62c6c134d3d24a1ab144dd9ee6bc3f64 P 0473d2b2d01f4459b1e90fd12cc7840e [term 8 FOLLOWER]: Rejecting Update request from peer 127766fc592545a4997f7790f50f6076 for earlier term 7. Current term is 8. Ops: []
I20260709 13:05:22.135167 19559 raft_consensus.cc:3060] T 217b5fae677b4971b3bbd2f357a1f7ff P e61c3a8f61bb48f8a963c9480e53c168 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:05:22.136648 19555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21e14947d70440f19044d8f75c31e1f9" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:05:22.137641 19555 raft_consensus.cc:2393] T 21e14947d70440f19044d8f75c31e1f9 P e61c3a8f61bb48f8a963c9480e53c168 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 0473d2b2d01f4459b1e90fd12cc7840e in current term 7: Already voted for candidate e5256d91808b47c195bc9b4dbd7f2b87 in this term.
I20260709 13:05:22.139515 19556 raft_consensus.cc:3060] T b08304a0a02b42d7840c4e8ee9a6bd1a P e61c3a8f61bb48f8a963c9480e53c168 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:05:22.141268 19560 raft_consensus.cc:2468] T 2e36a9d6e29c4a7c860cf267efbd4c74 P e61c3a8f61bb48f8a963c9480e53c168 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 4.
I20260709 13:05:22.135031 19375 leader_election.cc:304] T 22196caba61445d3bec98a0aab3c337d P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168; no voters: 0473d2b2d01f4459b1e90fd12cc7840e
I20260709 13:05:22.133075 19485 raft_consensus.cc:2393] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P 0473d2b2d01f4459b1e90fd12cc7840e [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 127766fc592545a4997f7790f50f6076 in current term 8: Already voted for candidate 0473d2b2d01f4459b1e90fd12cc7840e in this term.
I20260709 13:05:22.028877 22011 raft_consensus.cc:2804] T d1e5873a19244c5ebbcd38e126796ee7 P 0473d2b2d01f4459b1e90fd12cc7840e [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 13:05:22.147831 19377 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.2:46257, user_credentials={real_user=slave}} blocked reactor thread for 78411us
I20260709 13:05:22.148839 19560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b74109013a140ada21feeef92d6f563" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:05:22.152745 19559 raft_consensus.cc:2468] T 217b5fae677b4971b3bbd2f357a1f7ff P e61c3a8f61bb48f8a963c9480e53c168 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 4.
W20260709 13:05:22.155300 19449 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.1:40321, user_credentials={real_user=slave}} blocked reactor thread for 94604.5us
I20260709 13:05:22.155375 19484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48824d5acfbc485ebf8c2d944e7202de" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:05:22.156006 19449 leader_election.cc:304] T 40e1e16737a842ee936002830f36882e P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e; no voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:05:22.156450 19484 raft_consensus.cc:2393] T 48824d5acfbc485ebf8c2d944e7202de P 0473d2b2d01f4459b1e90fd12cc7840e [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 127766fc592545a4997f7790f50f6076 in current term 6: Already voted for candidate 0473d2b2d01f4459b1e90fd12cc7840e in this term.
I20260709 13:05:22.157068 19485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f85fc4b527a48848e5faa083b604e36" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:05:22.157559 19485 raft_consensus.cc:2468] T 1f85fc4b527a48848e5faa083b604e36 P 0473d2b2d01f4459b1e90fd12cc7840e [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 127766fc592545a4997f7790f50f6076 in term 4.
I20260709 13:05:22.158192 19485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14efcc79969f41babe5529c22d59156d" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:05:22.158843 19481 raft_consensus.cc:2468] T 5ec1c4ce15e04c7e8c283a62179f2a64 P 0473d2b2d01f4459b1e90fd12cc7840e [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 127766fc592545a4997f7790f50f6076 in term 5.
I20260709 13:05:22.160262 19404 raft_consensus.cc:2468] T 833a2f0775ed407a94b8924ce50adb63 P e5256d91808b47c195bc9b4dbd7f2b87 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 127766fc592545a4997f7790f50f6076 in term 5.
I20260709 13:05:22.161496 19485 raft_consensus.cc:2393] T 14efcc79969f41babe5529c22d59156d P 0473d2b2d01f4459b1e90fd12cc7840e [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 127766fc592545a4997f7790f50f6076 in current term 5: Already voted for candidate 0473d2b2d01f4459b1e90fd12cc7840e in this term.
I20260709 13:05:22.161582 19554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f93ee515a9c14139bf566522ed8232f3" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 8 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:05:22.162463 19554 raft_consensus.cc:2368] T f93ee515a9c14139bf566522ed8232f3 P e61c3a8f61bb48f8a963c9480e53c168 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 0473d2b2d01f4459b1e90fd12cc7840e for earlier term 8. Current term is 9.
I20260709 13:05:22.164189 19481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f93ee515a9c14139bf566522ed8232f3" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 9 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:05:22.166334 19479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ec1c4ce15e04c7e8c283a62179f2a64" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:05:22.167446 19375 leader_election.cc:304] T 4af19371ea874c09a0a2147040835cbb P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87; no voters: 127766fc592545a4997f7790f50f6076, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:05:22.170943 19479 raft_consensus.cc:2376] T 5ec1c4ce15e04c7e8c283a62179f2a64 P 0473d2b2d01f4459b1e90fd12cc7840e [term 5 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 127766fc592545a4997f7790f50f6076 in term 5. Re-sending same reply.
I20260709 13:05:22.163419 19485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab43d85f64114d4ebf618930e43d9ed0" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:05:22.050422 22076 raft_consensus.cc:2804] T f1b10566f45d4a7d9029858330e02d5b P 0473d2b2d01f4459b1e90fd12cc7840e [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:05:22.173444 19449 leader_election.cc:304] T 0cdf56e38bbc453d9438d359e5a69955 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87; no voters: e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:05:22.174503 19478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e36a9d6e29c4a7c860cf267efbd4c74" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:05:22.175714 19478 raft_consensus.cc:2468] T 2e36a9d6e29c4a7c860cf267efbd4c74 P 0473d2b2d01f4459b1e90fd12cc7840e [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 5.
I20260709 13:05:22.164614 19484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef32ce6fdd0e40d382c79974f30295c6" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:05:22.173471 19486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "179fd671030940b4b4a4e24bcc4aba0a" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:05:22.176831 20075 leader_election.cc:304] T 833a2f0775ed407a94b8924ce50adb63 P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 127766fc592545a4997f7790f50f6076, e5256d91808b47c195bc9b4dbd7f2b87; no voters: 
I20260709 13:05:22.177269 19484 raft_consensus.cc:2468] T ef32ce6fdd0e40d382c79974f30295c6 P 0473d2b2d01f4459b1e90fd12cc7840e [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 6.
I20260709 13:05:22.177001 19477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a08760e15aac4630a629431f56024dc8" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:05:22.178587 20110 raft_consensus.cc:1275] T 14efcc79969f41babe5529c22d59156d P 127766fc592545a4997f7790f50f6076 [term 6 FOLLOWER]: Refusing update from remote peer e5256d91808b47c195bc9b4dbd7f2b87: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:05:22.179147 19551 raft_consensus.cc:2368] T ef32ce6fdd0e40d382c79974f30295c6 P e61c3a8f61bb48f8a963c9480e53c168 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 0473d2b2d01f4459b1e90fd12cc7840e for earlier term 6. Current term is 7.
I20260709 13:05:22.060146 21963 raft_consensus.cc:493] T 0e1085d23e8347fbbd5bce7542f4b1f4 P 0473d2b2d01f4459b1e90fd12cc7840e [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 127766fc592545a4997f7790f50f6076)
I20260709 13:05:22.211596 19559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48824d5acfbc485ebf8c2d944e7202de" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:05:22.194214 21962 raft_consensus.cc:2749] T 4af19371ea874c09a0a2147040835cbb P e5256d91808b47c195bc9b4dbd7f2b87 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:05:22.194453 22146 raft_consensus.cc:2804] T 22196caba61445d3bec98a0aab3c337d P e5256d91808b47c195bc9b4dbd7f2b87 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:05:22.195659 21700 leader_election.cc:290] T bc225c93219c45538b53a1bd3d387e4d P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 9 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:05:22.199259 19375 leader_election.cc:304] T 2a16f7501e2444fb86d4e2778e734e02 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87; no voters: 127766fc592545a4997f7790f50f6076, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:05:22.162501 22011 raft_consensus.cc:493] T d1e5873a19244c5ebbcd38e126796ee7 P 0473d2b2d01f4459b1e90fd12cc7840e [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:22.222462 19483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9962423cb4e54fcfa5de01daf68a86e7" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:05:22.199892 22131 leader_election.cc:290] T 833a2f0775ed407a94b8924ce50adb63 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 5 election: Requested vote from peers e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:05:22.202293 19560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62c6c134d3d24a1ab144dd9ee6bc3f64" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:05:22.179944 19481 raft_consensus.cc:2468] T f93ee515a9c14139bf566522ed8232f3 P 0473d2b2d01f4459b1e90fd12cc7840e [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 8.
I20260709 13:05:22.203517 22053 leader_election.cc:290] T d1e5873a19244c5ebbcd38e126796ee7 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 8 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:05:22.232256 19404 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "85c494af21f9457a85da47b9bc70c1fd"
dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
mode: GRACEFUL
new_leader_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
 from {username='slave'} at 127.0.0.1:37312
I20260709 13:05:22.132789 21849 raft_consensus.cc:2804] T 85c494af21f9457a85da47b9bc70c1fd P e5256d91808b47c195bc9b4dbd7f2b87 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:05:22.233695 19481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edd7d470b5014c9489be7f41f64355c9" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:05:22.237875 19481 raft_consensus.cc:2468] T edd7d470b5014c9489be7f41f64355c9 P 0473d2b2d01f4459b1e90fd12cc7840e [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 5.
I20260709 13:05:22.080314 21767 raft_consensus.cc:493] T fa8650e71aa14778b3d73721fc50d9fc P 0473d2b2d01f4459b1e90fd12cc7840e [term 7 FOLLOWER]: Starting pre-election (detected failure of leader e61c3a8f61bb48f8a963c9480e53c168)
I20260709 13:05:22.204151 19553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7be9efa6559648dbb5a0f7684c4542d1" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:05:22.164938 20103 raft_consensus.cc:2468] T 65d8cb8d6ec64f459d5a47cefab10acf P 127766fc592545a4997f7790f50f6076 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 4.
I20260709 13:05:22.204672 21971 leader_election.cc:290] T f1b10566f45d4a7d9029858330e02d5b P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 7 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:05:22.204829 19555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46c5bfeecc314717bffe987e6844b6d0" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 11 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:05:22.247426 22131 consensus_queue.cc:1059] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:05:22.248258 19555 raft_consensus.cc:2393] T 46c5bfeecc314717bffe987e6844b6d0 P e61c3a8f61bb48f8a963c9480e53c168 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 0473d2b2d01f4459b1e90fd12cc7840e in current term 11: Already voted for candidate e61c3a8f61bb48f8a963c9480e53c168 in this term.
I20260709 13:05:22.248706 22064 raft_consensus.cc:3055] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P e5256d91808b47c195bc9b4dbd7f2b87 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:05:22.249173 22064 raft_consensus.cc:740] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P e5256d91808b47c195bc9b4dbd7f2b87 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: e5256d91808b47c195bc9b4dbd7f2b87, State: Running, Role: LEADER
I20260709 13:05:22.069237 22050 raft_consensus.cc:493] T 4509b76741dc428e9201c70c1658da13 P 0473d2b2d01f4459b1e90fd12cc7840e [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e61c3a8f61bb48f8a963c9480e53c168)
I20260709 13:05:22.250236 22064 consensus_queue.cc:260] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P e5256d91808b47c195bc9b4dbd7f2b87 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:05:22.250524 22050 raft_consensus.cc:515] T 4509b76741dc428e9201c70c1658da13 P 0473d2b2d01f4459b1e90fd12cc7840e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:22.251176 19482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff9b0eddd810459b82d91c60777c10eb" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:05:22.252326 19482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa8650e71aa14778b3d73721fc50d9fc" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:05:22.252415 22089 leader_election.cc:290] T df751f992649444090e27965eb1af85d P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 7 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:05:22.252595 22050 leader_election.cc:290] T 4509b76741dc428e9201c70c1658da13 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
W20260709 13:05:22.205747 19523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.1:40321, user_credentials={real_user=slave}} blocked reactor thread for 57613.7us
I20260709 13:05:22.253420 19523 leader_election.cc:304] T e381f1d6b8184797ad142de49be225a8 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e61c3a8f61bb48f8a963c9480e53c168; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:05:22.102218 22114 leader_election.cc:290] T 48824d5acfbc485ebf8c2d944e7202de P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 5 election: Requested vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:05:22.214273 19559 raft_consensus.cc:3060] T 48824d5acfbc485ebf8c2d944e7202de P e61c3a8f61bb48f8a963c9480e53c168 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:05:22.253731 19478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a61655d99124a29b486ba4a5b37faea" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:05:22.216817 19556 raft_consensus.cc:2468] T b08304a0a02b42d7840c4e8ee9a6bd1a P e61c3a8f61bb48f8a963c9480e53c168 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 7.
I20260709 13:05:22.227635 21790 leader_election.cc:290] T 3e1f505cb0f1427bbd698ac889d80821 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 5 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:05:22.228543 20108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "833a2f0775ed407a94b8924ce50adb63" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076"
I20260709 13:05:22.230918 21957 raft_consensus.cc:515] T 9962423cb4e54fcfa5de01daf68a86e7 P e5256d91808b47c195bc9b4dbd7f2b87 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:05:22.255190 19478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2725d2c4cb054f18b0fc8f735c15f6c2" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:05:22.255607 21849 raft_consensus.cc:697] T 85c494af21f9457a85da47b9bc70c1fd P e5256d91808b47c195bc9b4dbd7f2b87 [term 4 LEADER]: Becoming Leader. State: Replica: e5256d91808b47c195bc9b4dbd7f2b87, State: Running, Role: LEADER
I20260709 13:05:22.256487 19478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9962423cb4e54fcfa5de01daf68a86e7" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:05:22.256964 21957 leader_election.cc:290] T 9962423cb4e54fcfa5de01daf68a86e7 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 10 election: Requested vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:05:22.256528 21849 consensus_queue.cc:237] T 85c494af21f9457a85da47b9bc70c1fd P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:05:22.181836 22140 raft_consensus.cc:2749] T 40e1e16737a842ee936002830f36882e P 0473d2b2d01f4459b1e90fd12cc7840e [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:05:22.180893 22111 raft_consensus.cc:2804] T 833a2f0775ed407a94b8924ce50adb63 P 127766fc592545a4997f7790f50f6076 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:05:22.258579 19479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40e1e16737a842ee936002830f36882e" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:05:22.259171 22111 raft_consensus.cc:493] T 833a2f0775ed407a94b8924ce50adb63 P 127766fc592545a4997f7790f50f6076 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:22.259609 22111 raft_consensus.cc:3060] T 833a2f0775ed407a94b8924ce50adb63 P 127766fc592545a4997f7790f50f6076 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:05:22.260689 19486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab43d85f64114d4ebf618930e43d9ed0" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:05:22.262092 19486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e381f1d6b8184797ad142de49be225a8" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:05:22.179395 22076 raft_consensus.cc:493] T f1b10566f45d4a7d9029858330e02d5b P 0473d2b2d01f4459b1e90fd12cc7840e [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:22.262948 22076 raft_consensus.cc:3060] T f1b10566f45d4a7d9029858330e02d5b P 0473d2b2d01f4459b1e90fd12cc7840e [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:05:22.266156 22104 raft_consensus.cc:993] T 7f575b143b844aa096b50997dad3516a P e5256d91808b47c195bc9b4dbd7f2b87: : Instructing follower e61c3a8f61bb48f8a963c9480e53c168 to start an election
I20260709 13:05:22.238647 19481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "775c229504194560ba9589bc2199b089" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:05:22.267730 19486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff75a1d4cb1f493db8f71ddc136ba9ab" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:05:22.166085 22144 raft_consensus.cc:2804] T b9f0d59553ad444883fcf5b5909f9798 P e5256d91808b47c195bc9b4dbd7f2b87 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:05:22.269172 19478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1b10566f45d4a7d9029858330e02d5b" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:05:22.242744 21976 leader_election.cc:290] T 1dc5b3532fe54f74876d02beffa2c230 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 5 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:05:22.232254 22011 raft_consensus.cc:3060] T d1e5873a19244c5ebbcd38e126796ee7 P 0473d2b2d01f4459b1e90fd12cc7840e [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:05:22.244396 19375 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.3:36891, user_credentials={real_user=slave}} blocked reactor thread for 45204.8us
I20260709 13:05:22.270936 19375 leader_election.cc:304] T 21e14947d70440f19044d8f75c31e1f9 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:05:22.271953 19375 leader_election.cc:304] T 2e36a9d6e29c4a7c860cf267efbd4c74 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:05:22.245349 22049 raft_consensus.cc:2749] T 2a16f7501e2444fb86d4e2778e734e02 P e5256d91808b47c195bc9b4dbd7f2b87 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:05:22.275173 19559 raft_consensus.cc:2468] T 48824d5acfbc485ebf8c2d944e7202de P e61c3a8f61bb48f8a963c9480e53c168 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 6.
I20260709 13:05:22.246112 21962 consensus_queue.cc:1048] T 14efcc79969f41babe5529c22d59156d P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Connected to new peer: Peer: permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:05:22.216423 22057 raft_consensus.cc:2804] T 0cdf56e38bbc453d9438d359e5a69955 P 0473d2b2d01f4459b1e90fd12cc7840e [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:05:22.280627 22057 raft_consensus.cc:697] T 0cdf56e38bbc453d9438d359e5a69955 P 0473d2b2d01f4459b1e90fd12cc7840e [term 8 LEADER]: Becoming Leader. State: Replica: 0473d2b2d01f4459b1e90fd12cc7840e, State: Running, Role: LEADER
I20260709 13:05:22.281422 22064 raft_consensus.cc:3060] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P e5256d91808b47c195bc9b4dbd7f2b87 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:05:22.281512 22057 consensus_queue.cc:237] T 0cdf56e38bbc453d9438d359e5a69955 P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:22.247141 19553 raft_consensus.cc:2393] T 7be9efa6559648dbb5a0f7684c4542d1 P e61c3a8f61bb48f8a963c9480e53c168 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 0473d2b2d01f4459b1e90fd12cc7840e in current term 7: Already voted for candidate e61c3a8f61bb48f8a963c9480e53c168 in this term.
I20260709 13:05:22.250718 21833 leader_election.cc:290] T 62c6c134d3d24a1ab144dd9ee6bc3f64 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 8 election: Requested vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:05:22.131188 22056 raft_consensus.cc:3055] T ece3db938bc649d4a40a51522ed5259c P 127766fc592545a4997f7790f50f6076 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:05:22.286556 22056 raft_consensus.cc:740] T ece3db938bc649d4a40a51522ed5259c P 127766fc592545a4997f7790f50f6076 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 127766fc592545a4997f7790f50f6076, State: Running, Role: LEADER
I20260709 13:05:22.287436 22056 consensus_queue.cc:260] T ece3db938bc649d4a40a51522ed5259c P 127766fc592545a4997f7790f50f6076 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:05:22.259447 19479 raft_consensus.cc:2468] T 40e1e16737a842ee936002830f36882e P 0473d2b2d01f4459b1e90fd12cc7840e [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 7.
I20260709 13:05:22.288574 21559 raft_consensus.cc:515] T 3e1f505cb0f1427bbd698ac889d80821 P e61c3a8f61bb48f8a963c9480e53c168 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:22.288920 21992 leader_election.cc:290] T f93ee515a9c14139bf566522ed8232f3 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 9 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:05:22.288966 19479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1b10566f45d4a7d9029858330e02d5b" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:05:22.290139 19479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "217b5fae677b4971b3bbd2f357a1f7ff" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:05:22.290427 22102 leader_election.cc:290] T ef32ce6fdd0e40d382c79974f30295c6 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 7 election: Requested vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:05:22.267861 19481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e5873a19244c5ebbcd38e126796ee7" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:05:22.179796 19477 raft_consensus.cc:2468] T a08760e15aac4630a629431f56024dc8 P 0473d2b2d01f4459b1e90fd12cc7840e [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 6.
I20260709 13:05:22.243299 21529 leader_election.cc:290] T ef32ce6fdd0e40d382c79974f30295c6 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 7 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:05:22.098134 21958 raft_consensus.cc:515] T f93ee515a9c14139bf566522ed8232f3 P e5256d91808b47c195bc9b4dbd7f2b87 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:22.266862 21957 raft_consensus.cc:1081] T 7f575b143b844aa096b50997dad3516a P e5256d91808b47c195bc9b4dbd7f2b87 [term 2 LEADER]: Signalling peer e61c3a8f61bb48f8a963c9480e53c168 to start an election
I20260709 13:05:22.272758 19374 leader_election.cc:304] T 65d8cb8d6ec64f459d5a47cefab10acf P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 127766fc592545a4997f7790f50f6076, e5256d91808b47c195bc9b4dbd7f2b87; no voters: 
I20260709 13:05:22.273062 19375 leader_election.cc:304] T 1a61655d99124a29b486ba4a5b37faea P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:05:22.225256 22146 raft_consensus.cc:493] T 22196caba61445d3bec98a0aab3c337d P e5256d91808b47c195bc9b4dbd7f2b87 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:22.276592 19486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dc5b3532fe54f74876d02beffa2c230" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:05:22.278136 22063 raft_consensus.cc:2804] T 21e14947d70440f19044d8f75c31e1f9 P e5256d91808b47c195bc9b4dbd7f2b87 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:05:22.242235 20110 raft_consensus.cc:1275] T 70797e5783b5454ab0d0eea663e791e3 P 127766fc592545a4997f7790f50f6076 [term 8 FOLLOWER]: Refusing update from remote peer e5256d91808b47c195bc9b4dbd7f2b87: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260709 13:05:22.290970 19479 raft_consensus.cc:2393] T 217b5fae677b4971b3bbd2f357a1f7ff P 0473d2b2d01f4459b1e90fd12cc7840e [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate e5256d91808b47c195bc9b4dbd7f2b87 in current term 4: Already voted for candidate 0473d2b2d01f4459b1e90fd12cc7840e in this term.
I20260709 13:05:22.221483 21963 raft_consensus.cc:515] T 0e1085d23e8347fbbd5bce7542f4b1f4 P 0473d2b2d01f4459b1e90fd12cc7840e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:05:22.269497 22144 raft_consensus.cc:493] T b9f0d59553ad444883fcf5b5909f9798 P e5256d91808b47c195bc9b4dbd7f2b87 [term 6 FOLLOWER]: Starting leader election (detected failure of leader e61c3a8f61bb48f8a963c9480e53c168)
I20260709 13:05:22.269425 21767 raft_consensus.cc:515] T fa8650e71aa14778b3d73721fc50d9fc P 0473d2b2d01f4459b1e90fd12cc7840e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:22.238938 19449 leader_election.cc:304] T 775c229504194560ba9589bc2199b089 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87; no voters: 
I20260709 13:05:22.294272 19483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21e14947d70440f19044d8f75c31e1f9" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
W20260709 13:05:22.507296 19449 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.1:40321, user_credentials={real_user=slave}} blocked reactor thread for 268417us
I20260709 13:05:22.507776 19483 raft_consensus.cc:2393] T 21e14947d70440f19044d8f75c31e1f9 P 0473d2b2d01f4459b1e90fd12cc7840e [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate e5256d91808b47c195bc9b4dbd7f2b87 in current term 7: Already voted for candidate 0473d2b2d01f4459b1e90fd12cc7840e in this term.
I20260709 13:05:22.387780 19484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e1f505cb0f1427bbd698ac889d80821" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:05:22.376063 19485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14efcc79969f41babe5529c22d59156d" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
W20260709 13:05:22.506868 19523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.1:40321, user_credentials={real_user=slave}} blocked reactor thread for 253502us
I20260709 13:05:22.325766 20078 leader_election.cc:304] T 0afb57ae58a24a01850491d69f0213dd P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, 127766fc592545a4997f7790f50f6076; no voters: 
W20260709 13:05:22.513577 20078 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.2:46257, user_credentials={real_user=slave}} blocked reactor thread for 187875us
I20260709 13:05:22.514523 19551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc225c93219c45538b53a1bd3d387e4d" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
W20260709 13:05:22.515220 19377 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:22.515951 19553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e1f505cb0f1427bbd698ac889d80821" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:05:22.516086 20078 leader_election.cc:304] T 14935b3ddf914369822e4a0547aaa355 P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, 127766fc592545a4997f7790f50f6076, e5256d91808b47c195bc9b4dbd7f2b87; no voters: 
W20260709 13:05:22.386813 20076 leader_election.cc:336] T 70797e5783b5454ab0d0eea663e791e3 P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891): Timed out: RequestConsensusVote RPC to 127.17.223.3:36891 timed out after 1.612s (SENT)
W20260709 13:05:22.517315 20076 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.3:36891, user_credentials={real_user=slave}} blocked reactor thread for 130561us
W20260709 13:05:22.509188 19374 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.4:43121, user_credentials={real_user=slave}} blocked reactor thread for 236515us
W20260709 13:05:22.518074 20076 leader_election.cc:336] T 14935b3ddf914369822e4a0547aaa355 P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891): Timed out: RequestConsensusVote RPC to 127.17.223.3:36891 timed out after 1.886s (SENT)
I20260709 13:05:22.509894 19486 raft_consensus.cc:3060] T 1dc5b3532fe54f74876d02beffa2c230 P 0473d2b2d01f4459b1e90fd12cc7840e [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:05:22.510272 19523 leader_election.cc:304] T 1a61655d99124a29b486ba4a5b37faea P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168; no voters: 0473d2b2d01f4459b1e90fd12cc7840e
I20260709 13:05:22.517326 19559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4509b76741dc428e9201c70c1658da13" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:05:22.519925 19523 leader_election.cc:304] T b08304a0a02b42d7840c4e8ee9a6bd1a P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168; no voters: 0473d2b2d01f4459b1e90fd12cc7840e
I20260709 13:05:22.520887 19523 leader_election.cc:304] T 76cb037fc9064d13b59a8969d897ce8c P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e61c3a8f61bb48f8a963c9480e53c168; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:05:22.508625 19484 raft_consensus.cc:2468] T 3e1f505cb0f1427bbd698ac889d80821 P 0473d2b2d01f4459b1e90fd12cc7840e [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 5.
I20260709 13:05:22.509711 19485 raft_consensus.cc:3060] T 14efcc79969f41babe5529c22d59156d P 0473d2b2d01f4459b1e90fd12cc7840e [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:05:22.517264 19449 leader_election.cc:304] T 14935b3ddf914369822e4a0547aaa355 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
W20260709 13:05:22.523337 19375 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.3:36891, user_credentials={real_user=slave}} blocked reactor thread for 250294us
I20260709 13:05:22.523712 19553 raft_consensus.cc:2368] T 3e1f505cb0f1427bbd698ac889d80821 P e61c3a8f61bb48f8a963c9480e53c168 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 0473d2b2d01f4459b1e90fd12cc7840e for earlier term 5. Current term is 6.
I20260709 13:05:22.526832 19553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e381f1d6b8184797ad142de49be225a8" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:05:22.528240 19560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "833a2f0775ed407a94b8924ce50adb63" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:05:22.528936 19560 raft_consensus.cc:2393] T 833a2f0775ed407a94b8924ce50adb63 P e61c3a8f61bb48f8a963c9480e53c168 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e5256d91808b47c195bc9b4dbd7f2b87 in current term 5: Already voted for candidate e61c3a8f61bb48f8a963c9480e53c168 in this term.
I20260709 13:05:22.529031 19553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dc5b3532fe54f74876d02beffa2c230" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:05:22.529399 19556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e5873a19244c5ebbcd38e126796ee7" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:05:22.530019 19556 raft_consensus.cc:2393] T d1e5873a19244c5ebbcd38e126796ee7 P e61c3a8f61bb48f8a963c9480e53c168 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate e5256d91808b47c195bc9b4dbd7f2b87 in current term 8: Already voted for candidate e61c3a8f61bb48f8a963c9480e53c168 in this term.
I20260709 13:05:22.515794 19377 leader_election.cc:304] T edd7d470b5014c9489be7f41f64355c9 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87; no voters: 
I20260709 13:05:22.530786 19557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1b10566f45d4a7d9029858330e02d5b" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:05:22.531361 19557 raft_consensus.cc:3060] T f1b10566f45d4a7d9029858330e02d5b P e61c3a8f61bb48f8a963c9480e53c168 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:05:22.531638 19553 raft_consensus.cc:2393] T 1dc5b3532fe54f74876d02beffa2c230 P e61c3a8f61bb48f8a963c9480e53c168 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate e5256d91808b47c195bc9b4dbd7f2b87 in current term 5: Already voted for candidate e61c3a8f61bb48f8a963c9480e53c168 in this term.
I20260709 13:05:22.525494 19523 leader_election.cc:304] T fa731b585f684a7fb2d106c50f143b83 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:05:22.532320 19559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa731b585f684a7fb2d106c50f143b83" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:05:22.532869 19559 raft_consensus.cc:2468] T fa731b585f684a7fb2d106c50f143b83 P e61c3a8f61bb48f8a963c9480e53c168 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 4.
I20260709 13:05:22.526067 19450 leader_election.cc:304] T b9f0d59553ad444883fcf5b5909f9798 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e; no voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:05:22.532863 19523 leader_election.cc:400] T 21e14947d70440f19044d8f75c31e1f9 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 6 pre-election: Vote denied by peer e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321) with higher term. Message: Invalid argument: T 21e14947d70440f19044d8f75c31e1f9 P e5256d91808b47c195bc9b4dbd7f2b87 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e61c3a8f61bb48f8a963c9480e53c168 for earlier term 6. Current term is 7.
I20260709 13:05:22.533874 19554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df751f992649444090e27965eb1af85d" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:05:22.534263 19523 leader_election.cc:304] T 22196caba61445d3bec98a0aab3c337d P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168; no voters: 0473d2b2d01f4459b1e90fd12cc7840e
I20260709 13:05:22.534556 19554 raft_consensus.cc:2393] T df751f992649444090e27965eb1af85d P e61c3a8f61bb48f8a963c9480e53c168 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate e5256d91808b47c195bc9b4dbd7f2b87 in current term 7: Already voted for candidate e61c3a8f61bb48f8a963c9480e53c168 in this term.
I20260709 13:05:22.535796 19554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2725d2c4cb054f18b0fc8f735c15f6c2" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:05:22.536317 19554 raft_consensus.cc:2468] T 2725d2c4cb054f18b0fc8f735c15f6c2 P e61c3a8f61bb48f8a963c9480e53c168 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 7.
I20260709 13:05:22.536468 19559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85c494af21f9457a85da47b9bc70c1fd" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:05:22.536509 19560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65d8cb8d6ec64f459d5a47cefab10acf" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:05:22.276096 21823 raft_consensus.cc:2804] T 2e36a9d6e29c4a7c860cf267efbd4c74 P e5256d91808b47c195bc9b4dbd7f2b87 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:05:22.539314 19523 leader_election.cc:304] T 7f575b143b844aa096b50997dad3516a P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e61c3a8f61bb48f8a963c9480e53c168; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:05:22.539492 19449 leader_election.cc:304] T edd7d470b5014c9489be7f41f64355c9 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e; no voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:05:22.540572 19523 leader_election.cc:304] T 86a6797bdfe94fa496c050ceae4bd0d9 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:05:22.540863 19560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46c5bfeecc314717bffe987e6844b6d0" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 11 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:05:22.542507 19560 raft_consensus.cc:2393] T 46c5bfeecc314717bffe987e6844b6d0 P e61c3a8f61bb48f8a963c9480e53c168 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate e5256d91808b47c195bc9b4dbd7f2b87 in current term 11: Already voted for candidate e61c3a8f61bb48f8a963c9480e53c168 in this term.
W20260709 13:05:22.508215 21977 log.cc:927] Time spent T 7be9efa6559648dbb5a0f7684c4542d1 P 127766fc592545a4997f7790f50f6076: Append to log took a long time: real 0.084s	user 0.000s	sys 0.000s
I20260709 13:05:22.547048 19557 raft_consensus.cc:2468] T f1b10566f45d4a7d9029858330e02d5b P e61c3a8f61bb48f8a963c9480e53c168 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 8.
I20260709 13:05:22.546823 19559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "179fd671030940b4b4a4e24bcc4aba0a" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:05:22.547425 19551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "217b5fae677b4971b3bbd2f357a1f7ff" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:05:22.553686 19551 raft_consensus.cc:2393] T 217b5fae677b4971b3bbd2f357a1f7ff P e61c3a8f61bb48f8a963c9480e53c168 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate e5256d91808b47c195bc9b4dbd7f2b87 in current term 4: Already voted for candidate 0473d2b2d01f4459b1e90fd12cc7840e in this term.
I20260709 13:05:22.319094 20103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9962423cb4e54fcfa5de01daf68a86e7" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076"
I20260709 13:05:22.523221 21790 raft_consensus.cc:2804] T 775c229504194560ba9589bc2199b089 P 0473d2b2d01f4459b1e90fd12cc7840e [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:05:22.549131 19556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "833a2f0775ed407a94b8924ce50adb63" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:05:22.568532 19556 raft_consensus.cc:2393] T 833a2f0775ed407a94b8924ce50adb63 P e61c3a8f61bb48f8a963c9480e53c168 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate e5256d91808b47c195bc9b4dbd7f2b87 in current term 5: Already voted for candidate e61c3a8f61bb48f8a963c9480e53c168 in this term.
I20260709 13:05:22.549813 19553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e1f505cb0f1427bbd698ac889d80821" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:05:22.550946 19377 leader_election.cc:304] T ff9b0eddd810459b82d91c60777c10eb P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, 127766fc592545a4997f7790f50f6076
I20260709 13:05:22.569150 19553 raft_consensus.cc:2393] T 3e1f505cb0f1427bbd698ac889d80821 P e61c3a8f61bb48f8a963c9480e53c168 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate e5256d91808b47c195bc9b4dbd7f2b87 in current term 6: Already voted for candidate e61c3a8f61bb48f8a963c9480e53c168 in this term.
I20260709 13:05:22.551573 19482 raft_consensus.cc:2410] T fa8650e71aa14778b3d73721fc50d9fc P 0473d2b2d01f4459b1e90fd12cc7840e [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e5256d91808b47c195bc9b4dbd7f2b87 for term 8 because replica has last-logged OpId of term: 7 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 3.
I20260709 13:05:22.555562 19555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edd7d470b5014c9489be7f41f64355c9" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:05:22.511195 22146 raft_consensus.cc:3060] T 22196caba61445d3bec98a0aab3c337d P e5256d91808b47c195bc9b4dbd7f2b87 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:05:22.538188 22118 raft_consensus.cc:2764] T b08304a0a02b42d7840c4e8ee9a6bd1a P e61c3a8f61bb48f8a963c9480e53c168 [term 7 FOLLOWER]: Leader pre-election decision vote started in defunct term 6: won
I20260709 13:05:22.542124 21823 raft_consensus.cc:493] T 2e36a9d6e29c4a7c860cf267efbd4c74 P e5256d91808b47c195bc9b4dbd7f2b87 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:22.555482 21529 raft_consensus.cc:2749] T 7f575b143b844aa096b50997dad3516a P e61c3a8f61bb48f8a963c9480e53c168 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:05:22.347116 21559 leader_election.cc:290] T 3e1f505cb0f1427bbd698ac889d80821 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 6 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:05:22.548475 19560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ece3db938bc649d4a40a51522ed5259c" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:05:22.549202 19554 raft_consensus.cc:1275] T 70797e5783b5454ab0d0eea663e791e3 P e61c3a8f61bb48f8a963c9480e53c168 [term 8 FOLLOWER]: Refusing update from remote peer e5256d91808b47c195bc9b4dbd7f2b87: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 6 index: 6. (index mismatch)
I20260709 13:05:22.559671 19479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e1f505cb0f1427bbd698ac889d80821" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:05:22.601927 19479 raft_consensus.cc:3060] T 3e1f505cb0f1427bbd698ac889d80821 P 0473d2b2d01f4459b1e90fd12cc7840e [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:05:22.523512 22056 raft_consensus.cc:3060] T ece3db938bc649d4a40a51522ed5259c P 127766fc592545a4997f7790f50f6076 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:05:22.550439 22127 raft_consensus.cc:2804] T 14935b3ddf914369822e4a0547aaa355 P 0473d2b2d01f4459b1e90fd12cc7840e [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:05:22.537798 22107 raft_consensus.cc:2804] T 0afb57ae58a24a01850491d69f0213dd P 127766fc592545a4997f7790f50f6076 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:05:22.554602 22007 raft_consensus.cc:2749] T edd7d470b5014c9489be7f41f64355c9 P 0473d2b2d01f4459b1e90fd12cc7840e [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:05:22.522903 22140 consensus_queue.cc:1048] T 22196caba61445d3bec98a0aab3c337d P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.032s
I20260709 13:05:22.512470 22144 raft_consensus.cc:3060] T b9f0d59553ad444883fcf5b5909f9798 P e5256d91808b47c195bc9b4dbd7f2b87 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:05:22.562963 19557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef32ce6fdd0e40d382c79974f30295c6" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:05:22.634862 19557 raft_consensus.cc:2393] T ef32ce6fdd0e40d382c79974f30295c6 P e61c3a8f61bb48f8a963c9480e53c168 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate e5256d91808b47c195bc9b4dbd7f2b87 in current term 7: Already voted for candidate e61c3a8f61bb48f8a963c9480e53c168 in this term.
I20260709 13:05:22.563778 19484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46c5bfeecc314717bffe987e6844b6d0" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 11 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:05:22.531930 22135 raft_consensus.cc:2804] T 1a61655d99124a29b486ba4a5b37faea P e61c3a8f61bb48f8a963c9480e53c168 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:05:22.356178 21992 raft_consensus.cc:2749] T e381f1d6b8184797ad142de49be225a8 P e61c3a8f61bb48f8a963c9480e53c168 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:05:22.532984 22063 raft_consensus.cc:697] T 21e14947d70440f19044d8f75c31e1f9 P e5256d91808b47c195bc9b4dbd7f2b87 [term 7 LEADER]: Becoming Leader. State: Replica: e5256d91808b47c195bc9b4dbd7f2b87, State: Running, Role: LEADER
I20260709 13:05:22.542484 22041 raft_consensus.cc:2804] T 14935b3ddf914369822e4a0547aaa355 P 127766fc592545a4997f7790f50f6076 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:05:22.537798 21833 raft_consensus.cc:2749] T 76cb037fc9064d13b59a8969d897ce8c P e61c3a8f61bb48f8a963c9480e53c168 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:05:22.598645 19483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "179fd671030940b4b4a4e24bcc4aba0a" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:05:22.541839 22102 raft_consensus.cc:2804] T 1a61655d99124a29b486ba4a5b37faea P e5256d91808b47c195bc9b4dbd7f2b87 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:05:22.551179 22145 raft_consensus.cc:2804] T fa731b585f684a7fb2d106c50f143b83 P e61c3a8f61bb48f8a963c9480e53c168 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:05:22.598532 19404 raft_consensus.cc:606] T 85c494af21f9457a85da47b9bc70c1fd P e5256d91808b47c195bc9b4dbd7f2b87 [term 4 LEADER]: Received request to transfer leadership to TS e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:05:22.663394 22145 raft_consensus.cc:493] T fa731b585f684a7fb2d106c50f143b83 P e61c3a8f61bb48f8a963c9480e53c168 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 127766fc592545a4997f7790f50f6076)
I20260709 13:05:22.522903 22049 raft_consensus.cc:2804] T 65d8cb8d6ec64f459d5a47cefab10acf P e5256d91808b47c195bc9b4dbd7f2b87 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:05:22.663863 22145 raft_consensus.cc:3060] T fa731b585f684a7fb2d106c50f143b83 P e61c3a8f61bb48f8a963c9480e53c168 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:05:22.664172 22049 raft_consensus.cc:697] T 65d8cb8d6ec64f459d5a47cefab10acf P e5256d91808b47c195bc9b4dbd7f2b87 [term 4 LEADER]: Becoming Leader. State: Replica: e5256d91808b47c195bc9b4dbd7f2b87, State: Running, Role: LEADER
I20260709 13:05:22.665129 22049 consensus_queue.cc:237] T 65d8cb8d6ec64f459d5a47cefab10acf P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:05:22.556167 21932 raft_consensus.cc:2749] T b9f0d59553ad444883fcf5b5909f9798 P 0473d2b2d01f4459b1e90fd12cc7840e [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:05:22.658859 22041 raft_consensus.cc:493] T 14935b3ddf914369822e4a0547aaa355 P 127766fc592545a4997f7790f50f6076 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:22.580654 19523 leader_election.cc:304] T 2725d2c4cb054f18b0fc8f735c15f6c2 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e61c3a8f61bb48f8a963c9480e53c168; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:05:22.583578 19486 raft_consensus.cc:2468] T 1dc5b3532fe54f74876d02beffa2c230 P 0473d2b2d01f4459b1e90fd12cc7840e [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 5.
W20260709 13:05:22.672326 19523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.1:40321, user_credentials={real_user=slave}} blocked reactor thread for 91817.6us
I20260709 13:05:22.644452 22127 raft_consensus.cc:697] T 14935b3ddf914369822e4a0547aaa355 P 0473d2b2d01f4459b1e90fd12cc7840e [term 5 LEADER]: Becoming Leader. State: Replica: 0473d2b2d01f4459b1e90fd12cc7840e, State: Running, Role: LEADER
I20260709 13:05:22.531736 22076 raft_consensus.cc:515] T f1b10566f45d4a7d9029858330e02d5b P 0473d2b2d01f4459b1e90fd12cc7840e [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:22.675231 20076 leader_election.cc:304] T 65d8cb8d6ec64f459d5a47cefab10acf P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 127766fc592545a4997f7790f50f6076; no voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:05:22.676934 19486 raft_consensus.cc:1240] T bc225c93219c45538b53a1bd3d387e4d P 0473d2b2d01f4459b1e90fd12cc7840e [term 9 FOLLOWER]: Rejecting Update request from peer e5256d91808b47c195bc9b4dbd7f2b87 for earlier term 8. Current term is 9. Ops: [8.5-8.5]
I20260709 13:05:22.678143 19486 raft_consensus.cc:1240] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P 0473d2b2d01f4459b1e90fd12cc7840e [term 8 FOLLOWER]: Rejecting Update request from peer e5256d91808b47c195bc9b4dbd7f2b87 for earlier term 7. Current term is 8. Ops: []
I20260709 13:05:22.559247 22114 raft_consensus.cc:2804] T 86a6797bdfe94fa496c050ceae4bd0d9 P e61c3a8f61bb48f8a963c9480e53c168 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:05:22.612962 19480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df751f992649444090e27965eb1af85d" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:05:22.679129 19480 raft_consensus.cc:3060] T df751f992649444090e27965eb1af85d P 0473d2b2d01f4459b1e90fd12cc7840e [term 5 FOLLOWER]: Advancing to term 7
I20260709 13:05:22.572474 21926 raft_consensus.cc:2804] T edd7d470b5014c9489be7f41f64355c9 P e5256d91808b47c195bc9b4dbd7f2b87 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:05:22.601332 21823 raft_consensus.cc:3060] T 2e36a9d6e29c4a7c860cf267efbd4c74 P e5256d91808b47c195bc9b4dbd7f2b87 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:05:22.684556 21926 raft_consensus.cc:493] T edd7d470b5014c9489be7f41f64355c9 P e5256d91808b47c195bc9b4dbd7f2b87 [term 5 FOLLOWER]: Starting leader election (detected failure of leader e61c3a8f61bb48f8a963c9480e53c168)
I20260709 13:05:22.685176 21926 raft_consensus.cc:3060] T edd7d470b5014c9489be7f41f64355c9 P e5256d91808b47c195bc9b4dbd7f2b87 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:05:22.687163 21767 leader_election.cc:290] T fa8650e71aa14778b3d73721fc50d9fc P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:05:22.689427 21958 leader_election.cc:290] T f93ee515a9c14139bf566522ed8232f3 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 9 election: Requested vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:05:22.691756 20107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96efeaaf1057492490e9a621f37e1a2d" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:05:22.692596 20107 raft_consensus.cc:2393] T 96efeaaf1057492490e9a621f37e1a2d P 127766fc592545a4997f7790f50f6076 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e61c3a8f61bb48f8a963c9480e53c168 in current term 6: Already voted for candidate 127766fc592545a4997f7790f50f6076 in this term.
I20260709 13:05:22.570322 22111 raft_consensus.cc:515] T 833a2f0775ed407a94b8924ce50adb63 P 127766fc592545a4997f7790f50f6076 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:05:22.567729 21790 raft_consensus.cc:493] T 775c229504194560ba9589bc2199b089 P 0473d2b2d01f4459b1e90fd12cc7840e [term 4 FOLLOWER]: Starting leader election (detected failure of leader 127766fc592545a4997f7790f50f6076)
I20260709 13:05:22.570967 20103 raft_consensus.cc:3060] T 9962423cb4e54fcfa5de01daf68a86e7 P 127766fc592545a4997f7790f50f6076 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:05:22.631176 19479 raft_consensus.cc:2468] T 3e1f505cb0f1427bbd698ac889d80821 P 0473d2b2d01f4459b1e90fd12cc7840e [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 6.
W20260709 13:05:22.633193 19449 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.1:40321, user_credentials={real_user=slave}} blocked reactor thread for 81061.7us
I20260709 13:05:22.707787 19478 raft_consensus.cc:2393] T f1b10566f45d4a7d9029858330e02d5b P 0473d2b2d01f4459b1e90fd12cc7840e [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e5256d91808b47c195bc9b4dbd7f2b87 in current term 8: Already voted for candidate 0473d2b2d01f4459b1e90fd12cc7840e in this term.
I20260709 13:05:22.708339 19449 leader_election.cc:304] T 2e36a9d6e29c4a7c860cf267efbd4c74 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87; no voters: 
W20260709 13:05:22.635975 19450 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.3:36891, user_credentials={real_user=slave}} blocked reactor thread for 93610.1us
I20260709 13:05:22.710469 19450 leader_election.cc:304] T 7f575b143b844aa096b50997dad3516a P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e; no voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:05:22.714728 22021 raft_consensus.cc:493] T 309c3ca0ca4b4f3ba129752ea2cb293b P 127766fc592545a4997f7790f50f6076 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader e61c3a8f61bb48f8a963c9480e53c168)
I20260709 13:05:22.715091 22127 consensus_queue.cc:237] T 14935b3ddf914369822e4a0547aaa355 P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.5, Last appended by leader: 5, Current term: 5, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } attrs { replace: true } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:05:22.600574 21867 raft_consensus.cc:2749] T ff9b0eddd810459b82d91c60777c10eb P e5256d91808b47c195bc9b4dbd7f2b87 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 13:05:22.646644 20075 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:22.654146 19482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef32ce6fdd0e40d382c79974f30295c6" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:05:22.717813 19482 raft_consensus.cc:3060] T ef32ce6fdd0e40d382c79974f30295c6 P 0473d2b2d01f4459b1e90fd12cc7840e [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:05:22.651578 20078 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.2:46257, user_credentials={real_user=slave}} blocked reactor thread for 117906us
I20260709 13:05:22.719833 22076 leader_election.cc:290] T f1b10566f45d4a7d9029858330e02d5b P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 8 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:05:22.719997 20078 leader_election.cc:304] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 127766fc592545a4997f7790f50f6076; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:05:22.720628 21963 leader_election.cc:290] T 0e1085d23e8347fbbd5bce7542f4b1f4 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:05:22.721323 20078 leader_election.cc:304] T 1f85fc4b527a48848e5faa083b604e36 P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, 127766fc592545a4997f7790f50f6076; no voters: e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:05:22.675938 21833 raft_consensus.cc:2749] T 2725d2c4cb054f18b0fc8f735c15f6c2 P e61c3a8f61bb48f8a963c9480e53c168 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:05:22.723773 20104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48824d5acfbc485ebf8c2d944e7202de" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076"
I20260709 13:05:22.724812 20104 raft_consensus.cc:2368] T 48824d5acfbc485ebf8c2d944e7202de P 127766fc592545a4997f7790f50f6076 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate e61c3a8f61bb48f8a963c9480e53c168 for earlier term 5. Current term is 6.
I20260709 13:05:22.725641 22063 consensus_queue.cc:237] T 21e14947d70440f19044d8f75c31e1f9 P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:22.571413 22057 consensus_queue.cc:1059] T 96efeaaf1057492490e9a621f37e1a2d P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.080s
I20260709 13:05:22.556778 22089 raft_consensus.cc:2804] T 22196caba61445d3bec98a0aab3c337d P e61c3a8f61bb48f8a963c9480e53c168 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:05:22.736049 19480 raft_consensus.cc:2468] T df751f992649444090e27965eb1af85d P 0473d2b2d01f4459b1e90fd12cc7840e [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 7.
I20260709 13:05:22.603502 19560 raft_consensus.cc:3060] T ece3db938bc649d4a40a51522ed5259c P e61c3a8f61bb48f8a963c9480e53c168 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:05:22.646865 22107 raft_consensus.cc:697] T 0afb57ae58a24a01850491d69f0213dd P 127766fc592545a4997f7790f50f6076 [term 7 LEADER]: Becoming Leader. State: Replica: 127766fc592545a4997f7790f50f6076, State: Running, Role: LEADER
W20260709 13:05:22.670197 19377 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.2:46257, user_credentials={real_user=slave}} blocked reactor thread for 119321us
I20260709 13:05:22.636541 22135 raft_consensus.cc:493] T 1a61655d99124a29b486ba4a5b37faea P e61c3a8f61bb48f8a963c9480e53c168 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 0473d2b2d01f4459b1e90fd12cc7840e)
W20260709 13:05:22.783775 20076 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.3:36891, user_credentials={real_user=slave}} blocked reactor thread for 108656us
I20260709 13:05:22.785180 19377 leader_election.cc:304] T ab43d85f64114d4ebf618930e43d9ed0 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 127766fc592545a4997f7790f50f6076, e5256d91808b47c195bc9b4dbd7f2b87; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168
W20260709 13:05:22.607810 19526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.2:46257, user_credentials={real_user=slave}} blocked reactor thread for 274390us
I20260709 13:05:22.679733 20112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ece3db938bc649d4a40a51522ed5259c" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:05:22.786504 19403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46c5bfeecc314717bffe987e6844b6d0" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 11 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
I20260709 13:05:22.787110 19377 leader_election.cc:304] T 775c229504194560ba9589bc2199b089 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, 127766fc592545a4997f7790f50f6076
I20260709 13:05:22.660236 22102 raft_consensus.cc:493] T 1a61655d99124a29b486ba4a5b37faea P e5256d91808b47c195bc9b4dbd7f2b87 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 0473d2b2d01f4459b1e90fd12cc7840e)
I20260709 13:05:22.708441 21790 raft_consensus.cc:3060] T 775c229504194560ba9589bc2199b089 P 0473d2b2d01f4459b1e90fd12cc7840e [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:05:22.715348 22021 raft_consensus.cc:515] T 309c3ca0ca4b4f3ba129752ea2cb293b P 127766fc592545a4997f7790f50f6076 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } attrs { replace: true } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:05:22.598424 21991 consensus_queue.cc:1059] T 62c6c134d3d24a1ab144dd9ee6bc3f64 P 127766fc592545a4997f7790f50f6076 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.038s
I20260709 13:05:22.709560 19449 leader_election.cc:304] T b08304a0a02b42d7840c4e8ee9a6bd1a P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87; no voters: 
W20260709 13:05:22.734001 19293 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 309c3ca0ca4b4f3ba129752ea2cb293b with cas_config_opid_index 5: ChangeConfig:REMOVE_PEER failed with leader e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica e5256d91808b47c195bc9b4dbd7f2b87 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 6 committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } attrs { replace: true } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } } }
I20260709 13:05:22.637326 19484 raft_consensus.cc:2393] T 46c5bfeecc314717bffe987e6844b6d0 P 0473d2b2d01f4459b1e90fd12cc7840e [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate e5256d91808b47c195bc9b4dbd7f2b87 in current term 11: Already voted for candidate 0473d2b2d01f4459b1e90fd12cc7840e in this term.
W20260709 13:05:22.800316 19293 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.ChangeConfig -> {remote=127.17.223.1:40321, user_credentials={real_user=slave}} blocked reactor thread for 66366.3us
I20260709 13:05:22.735505 19408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff75a1d4cb1f493db8f71ddc136ba9ab" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:05:22.800953 19408 raft_consensus.cc:2468] T ff75a1d4cb1f493db8f71ddc136ba9ab P e5256d91808b47c195bc9b4dbd7f2b87 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 5.
W20260709 13:05:22.801259 20078 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.2:46257, user_credentials={real_user=slave}} blocked reactor thread for 80019.5us
I20260709 13:05:22.801918 19408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dc5b3532fe54f74876d02beffa2c230" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
I20260709 13:05:22.802620 19408 raft_consensus.cc:2393] T 1dc5b3532fe54f74876d02beffa2c230 P e5256d91808b47c195bc9b4dbd7f2b87 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate e61c3a8f61bb48f8a963c9480e53c168 in current term 5: Already voted for candidate e5256d91808b47c195bc9b4dbd7f2b87 in this term.
I20260709 13:05:22.736512 19409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4af19371ea874c09a0a2147040835cbb" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:05:22.735872 19402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "217b5fae677b4971b3bbd2f357a1f7ff" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
I20260709 13:05:22.803399 19408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e5873a19244c5ebbcd38e126796ee7" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
I20260709 13:05:22.803958 19402 raft_consensus.cc:2368] T 217b5fae677b4971b3bbd2f357a1f7ff P e5256d91808b47c195bc9b4dbd7f2b87 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate e61c3a8f61bb48f8a963c9480e53c168 for earlier term 3. Current term is 4.
I20260709 13:05:22.736661 22140 raft_consensus.cc:2804] T 2e36a9d6e29c4a7c860cf267efbd4c74 P 0473d2b2d01f4459b1e90fd12cc7840e [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:05:22.740329 19450 leader_election.cc:304] T 217b5fae677b4971b3bbd2f357a1f7ff P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168; no voters: e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:05:22.777668 20104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62c6c134d3d24a1ab144dd9ee6bc3f64" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076"
W20260709 13:05:22.782791 20075 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:22.737141 22089 raft_consensus.cc:493] T 22196caba61445d3bec98a0aab3c337d P e61c3a8f61bb48f8a963c9480e53c168 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 0473d2b2d01f4459b1e90fd12cc7840e)
I20260709 13:05:22.786630 20112 raft_consensus.cc:2468] T ece3db938bc649d4a40a51522ed5259c P 127766fc592545a4997f7790f50f6076 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 6.
I20260709 13:05:22.683429 20106 raft_consensus.cc:1240] T 65d8cb8d6ec64f459d5a47cefab10acf P 127766fc592545a4997f7790f50f6076 [term 4 FOLLOWER]: Rejecting Update request from peer e61c3a8f61bb48f8a963c9480e53c168 for earlier term 3. Current term is 4. Ops: [3.5-3.5]
I20260709 13:05:22.787318 19403 raft_consensus.cc:2393] T 46c5bfeecc314717bffe987e6844b6d0 P e5256d91808b47c195bc9b4dbd7f2b87 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate e61c3a8f61bb48f8a963c9480e53c168 in current term 11: Already voted for candidate e5256d91808b47c195bc9b4dbd7f2b87 in this term.
I20260709 13:05:22.693907 20111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4af19371ea874c09a0a2147040835cbb" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:05:22.790876 21958 raft_consensus.cc:2749] T ab43d85f64114d4ebf618930e43d9ed0 P e5256d91808b47c195bc9b4dbd7f2b87 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:05:22.673246 22041 raft_consensus.cc:3060] T 14935b3ddf914369822e4a0547aaa355 P 127766fc592545a4997f7790f50f6076 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:05:22.792486 19377 leader_election.cc:304] T ff75a1d4cb1f493db8f71ddc136ba9ab P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:05:22.793220 19405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ece3db938bc649d4a40a51522ed5259c" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:05:22.782246 20103 raft_consensus.cc:2468] T 9962423cb4e54fcfa5de01daf68a86e7 P 127766fc592545a4997f7790f50f6076 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 10.
I20260709 13:05:22.802425 20078 leader_election.cc:304] T 5ec1c4ce15e04c7e8c283a62179f2a64 P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, 127766fc592545a4997f7790f50f6076; no voters: e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:05:22.727922 22114 raft_consensus.cc:697] T 86a6797bdfe94fa496c050ceae4bd0d9 P e61c3a8f61bb48f8a963c9480e53c168 [term 6 LEADER]: Becoming Leader. State: Replica: e61c3a8f61bb48f8a963c9480e53c168, State: Running, Role: LEADER
I20260709 13:05:22.804675 19402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1b10566f45d4a7d9029858330e02d5b" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
I20260709 13:05:22.808058 22140 raft_consensus.cc:493] T 2e36a9d6e29c4a7c860cf267efbd4c74 P 0473d2b2d01f4459b1e90fd12cc7840e [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:22.740113 22056 raft_consensus.cc:2749] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P 127766fc592545a4997f7790f50f6076 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:05:22.849031 19558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab43d85f64114d4ebf618930e43d9ed0" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:05:22.803503 19409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7be9efa6559648dbb5a0f7684c4542d1" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
I20260709 13:05:22.851864 19409 raft_consensus.cc:3060] T 7be9efa6559648dbb5a0f7684c4542d1 P e5256d91808b47c195bc9b4dbd7f2b87 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:05:22.849546 19557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "833a2f0775ed407a94b8924ce50adb63" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:05:22.806746 19560 raft_consensus.cc:2468] T ece3db938bc649d4a40a51522ed5259c P e61c3a8f61bb48f8a963c9480e53c168 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 6.
I20260709 13:05:22.736215 21932 raft_consensus.cc:2749] T 7f575b143b844aa096b50997dad3516a P 0473d2b2d01f4459b1e90fd12cc7840e [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:05:22.849852 19554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96efeaaf1057492490e9a621f37e1a2d" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:05:22.854203 19554 raft_consensus.cc:2376] T 96efeaaf1057492490e9a621f37e1a2d P e61c3a8f61bb48f8a963c9480e53c168 [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 127766fc592545a4997f7790f50f6076 in term 6. Re-sending same reply.
I20260709 13:05:22.855208 21957 raft_consensus.cc:2749] T ff75a1d4cb1f493db8f71ddc136ba9ab P e5256d91808b47c195bc9b4dbd7f2b87 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 13:05:22.855453 19377 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.2:46257, user_credentials={real_user=slave}} blocked reactor thread for 63027.7us
I20260709 13:05:22.856356 19377 leader_election.cc:304] T 40e1e16737a842ee936002830f36882e P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87; no voters: e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:05:22.857940 19377 leader_election.cc:304] T a08760e15aac4630a629431f56024dc8 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87; no voters: e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:05:22.858580 21957 raft_consensus.cc:2804] T 40e1e16737a842ee936002830f36882e P e5256d91808b47c195bc9b4dbd7f2b87 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:05:22.858851 22166 raft_consensus.cc:2804] T a08760e15aac4630a629431f56024dc8 P e5256d91808b47c195bc9b4dbd7f2b87 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:05:22.859087 21957 raft_consensus.cc:493] T 40e1e16737a842ee936002830f36882e P e5256d91808b47c195bc9b4dbd7f2b87 [term 7 FOLLOWER]: Starting leader election (detected failure of leader e61c3a8f61bb48f8a963c9480e53c168)
I20260709 13:05:22.859503 22166 raft_consensus.cc:493] T a08760e15aac4630a629431f56024dc8 P e5256d91808b47c195bc9b4dbd7f2b87 [term 6 FOLLOWER]: Starting leader election (detected failure of leader e61c3a8f61bb48f8a963c9480e53c168)
I20260709 13:05:22.860064 22166 raft_consensus.cc:3060] T a08760e15aac4630a629431f56024dc8 P e5256d91808b47c195bc9b4dbd7f2b87 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:05:22.672590 19483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ec1c4ce15e04c7e8c283a62179f2a64" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:05:22.863230 19483 raft_consensus.cc:2393] T 5ec1c4ce15e04c7e8c283a62179f2a64 P 0473d2b2d01f4459b1e90fd12cc7840e [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate e5256d91808b47c195bc9b4dbd7f2b87 in current term 5: Already voted for candidate 127766fc592545a4997f7790f50f6076 in this term.
I20260709 13:05:22.745824 22064 raft_consensus.cc:493] T 0cdf56e38bbc453d9438d359e5a69955 P e5256d91808b47c195bc9b4dbd7f2b87 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:22.864179 22064 raft_consensus.cc:515] T 0cdf56e38bbc453d9438d359e5a69955 P e5256d91808b47c195bc9b4dbd7f2b87 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:22.811632 20107 raft_consensus.cc:1240] T 85c494af21f9457a85da47b9bc70c1fd P 127766fc592545a4997f7790f50f6076 [term 4 FOLLOWER]: Rejecting Update request from peer e61c3a8f61bb48f8a963c9480e53c168 for earlier term 3. Current term is 4. Ops: []
I20260709 13:05:22.782186 21926 raft_consensus.cc:515] T edd7d470b5014c9489be7f41f64355c9 P e5256d91808b47c195bc9b4dbd7f2b87 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:22.869593 21926 leader_election.cc:290] T edd7d470b5014c9489be7f41f64355c9 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 6 election: Requested vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:05:22.791960 22135 raft_consensus.cc:3060] T 1a61655d99124a29b486ba4a5b37faea P e61c3a8f61bb48f8a963c9480e53c168 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:05:22.789997 19411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b74109013a140ada21feeef92d6f563" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
I20260709 13:05:22.793391 22102 raft_consensus.cc:3060] T 1a61655d99124a29b486ba4a5b37faea P e5256d91808b47c195bc9b4dbd7f2b87 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:05:22.820406 19403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef32ce6fdd0e40d382c79974f30295c6" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
I20260709 13:05:22.875528 19403 raft_consensus.cc:2393] T ef32ce6fdd0e40d382c79974f30295c6 P e5256d91808b47c195bc9b4dbd7f2b87 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate e61c3a8f61bb48f8a963c9480e53c168 in current term 7: Already voted for candidate e5256d91808b47c195bc9b4dbd7f2b87 in this term.
I20260709 13:05:22.875682 19411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f93ee515a9c14139bf566522ed8232f3" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 9 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
I20260709 13:05:22.876444 19403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "309c3ca0ca4b4f3ba129752ea2cb293b" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:05:22.876802 19407 raft_consensus.cc:1240] T edd7d470b5014c9489be7f41f64355c9 P e5256d91808b47c195bc9b4dbd7f2b87 [term 6 FOLLOWER]: Rejecting Update request from peer e61c3a8f61bb48f8a963c9480e53c168 for earlier term 5. Current term is 6. Ops: []
I20260709 13:05:22.850168 19559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed7fdbcb96d14d418db9ca90a792588a" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:05:22.877740 19403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df751f992649444090e27965eb1af85d" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
I20260709 13:05:22.807617 20108 raft_consensus.cc:2368] T 833a2f0775ed407a94b8924ce50adb63 P 127766fc592545a4997f7790f50f6076 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate e5256d91808b47c195bc9b4dbd7f2b87 for earlier term 5. Current term is 6.
I20260709 13:05:22.846755 19402 raft_consensus.cc:2368] T f1b10566f45d4a7d9029858330e02d5b P e5256d91808b47c195bc9b4dbd7f2b87 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate e61c3a8f61bb48f8a963c9480e53c168 for earlier term 7. Current term is 8.
I20260709 13:05:22.850461 19523 leader_election.cc:304] T 6c5eebf646ad445a9d1b1adc319d7b16 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e61c3a8f61bb48f8a963c9480e53c168; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, 127766fc592545a4997f7790f50f6076
I20260709 13:05:22.876461 19411 raft_consensus.cc:2393] T f93ee515a9c14139bf566522ed8232f3 P e5256d91808b47c195bc9b4dbd7f2b87 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate e61c3a8f61bb48f8a963c9480e53c168 in current term 9: Already voted for candidate e5256d91808b47c195bc9b4dbd7f2b87 in this term.
I20260709 13:05:22.880393 19523 leader_election.cc:304] T 14935b3ddf914369822e4a0547aaa355 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, 127766fc592545a4997f7790f50f6076
I20260709 13:05:22.881801 19411 raft_consensus.cc:1240] T ece3db938bc649d4a40a51522ed5259c P e5256d91808b47c195bc9b4dbd7f2b87 [term 6 FOLLOWER]: Rejecting Update request from peer 127766fc592545a4997f7790f50f6076 for earlier term 5. Current term is 6. Ops: []
I20260709 13:05:22.881613 22102 raft_consensus.cc:515] T 1a61655d99124a29b486ba4a5b37faea P e5256d91808b47c195bc9b4dbd7f2b87 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:22.824609 22021 leader_election.cc:290] T 309c3ca0ca4b4f3ba129752ea2cb293b P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:05:22.817445 22089 raft_consensus.cc:3060] T 22196caba61445d3bec98a0aab3c337d P e61c3a8f61bb48f8a963c9480e53c168 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:05:22.827694 19482 raft_consensus.cc:2468] T ef32ce6fdd0e40d382c79974f30295c6 P 0473d2b2d01f4459b1e90fd12cc7840e [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 7.
I20260709 13:05:22.828437 22104 consensus_queue.cc:1048] T 70797e5783b5454ab0d0eea663e791e3 P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Connected to new peer: Peer: permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:05:22.812495 21767 raft_consensus.cc:3055] T 96efeaaf1057492490e9a621f37e1a2d P 0473d2b2d01f4459b1e90fd12cc7840e [term 5 LEADER]: Stepping down as leader of term 5
W20260709 13:05:22.831279 22011 consensus_meta.cc:287] T d1e5873a19244c5ebbcd38e126796ee7 P 0473d2b2d01f4459b1e90fd12cc7840e: Time spent flushing consensus metadata: real 0.540s	user 0.005s	sys 0.005s
W20260709 13:05:22.836138 20076 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.3:36891, user_credentials={real_user=slave}} blocked reactor thread for 50698.8us
W20260709 13:05:22.837268 19449 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.1:40321, user_credentials={real_user=slave}} blocked reactor thread for 127798us
W20260709 13:05:22.837849 19450 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.3:36891, user_credentials={real_user=slave}} blocked reactor thread for 97757.5us
I20260709 13:05:22.913589 19450 leader_election.cc:304] T a08760e15aac4630a629431f56024dc8 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e; no voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:05:22.792367 21963 consensus_queue.cc:1048] T 2725d2c4cb054f18b0fc8f735c15f6c2 P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.033s
I20260709 13:05:22.799691 22131 raft_consensus.cc:2749] T 775c229504194560ba9589bc2199b089 P e5256d91808b47c195bc9b4dbd7f2b87 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:05:22.739516 19485 raft_consensus.cc:2468] T 14efcc79969f41babe5529c22d59156d P 0473d2b2d01f4459b1e90fd12cc7840e [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 6.
I20260709 13:05:22.784876 22146 raft_consensus.cc:515] T 22196caba61445d3bec98a0aab3c337d P e5256d91808b47c195bc9b4dbd7f2b87 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:22.931209 19486 raft_consensus.cc:1275] T 14efcc79969f41babe5529c22d59156d P 0473d2b2d01f4459b1e90fd12cc7840e [term 6 FOLLOWER]: Refusing update from remote peer e5256d91808b47c195bc9b4dbd7f2b87: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:05:22.852828 19557 raft_consensus.cc:2468] T 833a2f0775ed407a94b8924ce50adb63 P e61c3a8f61bb48f8a963c9480e53c168 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 127766fc592545a4997f7790f50f6076 in term 5.
I20260709 13:05:22.859598 21957 raft_consensus.cc:3060] T 40e1e16737a842ee936002830f36882e P e5256d91808b47c195bc9b4dbd7f2b87 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:05:22.878594 19403 raft_consensus.cc:2393] T df751f992649444090e27965eb1af85d P e5256d91808b47c195bc9b4dbd7f2b87 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate e61c3a8f61bb48f8a963c9480e53c168 in current term 7: Already voted for candidate e5256d91808b47c195bc9b4dbd7f2b87 in this term.
W20260709 13:05:22.809163 21977 log.cc:927] Time spent T 7be9efa6559648dbb5a0f7684c4542d1 P 127766fc592545a4997f7790f50f6076: Append to log took a long time: real 0.063s	user 0.000s	sys 0.000s
I20260709 13:05:22.881672 19523 leader_election.cc:304] T 1efebf73c86e432baa55533136b6e12c P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e61c3a8f61bb48f8a963c9480e53c168; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, 127766fc592545a4997f7790f50f6076
I20260709 13:05:22.844622 22076 raft_consensus.cc:2804] T 217b5fae677b4971b3bbd2f357a1f7ff P 0473d2b2d01f4459b1e90fd12cc7840e [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:05:22.844333 22050 raft_consensus.cc:2804] T b08304a0a02b42d7840c4e8ee9a6bd1a P 0473d2b2d01f4459b1e90fd12cc7840e [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:05:22.935974 19374 leader_election.cc:304] T 9962423cb4e54fcfa5de01daf68a86e7 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 127766fc592545a4997f7790f50f6076, e5256d91808b47c195bc9b4dbd7f2b87; no voters: 
I20260709 13:05:22.810863 19408 raft_consensus.cc:2393] T d1e5873a19244c5ebbcd38e126796ee7 P e5256d91808b47c195bc9b4dbd7f2b87 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate e61c3a8f61bb48f8a963c9480e53c168 in current term 8: Already voted for candidate e5256d91808b47c195bc9b4dbd7f2b87 in this term.
I20260709 13:05:22.894176 22111 leader_election.cc:290] T 833a2f0775ed407a94b8924ce50adb63 P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 6 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:05:22.894519 22102 leader_election.cc:290] T 1a61655d99124a29b486ba4a5b37faea P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 4 election: Requested vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:05:22.917657 19405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "833a2f0775ed407a94b8924ce50adb63" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
I20260709 13:05:22.917989 19449 leader_election.cc:304] T 14efcc79969f41babe5529c22d59156d P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, 127766fc592545a4997f7790f50f6076; no voters: e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:05:22.938995 19405 raft_consensus.cc:3060] T 833a2f0775ed407a94b8924ce50adb63 P e5256d91808b47c195bc9b4dbd7f2b87 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:05:22.925978 19552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48824d5acfbc485ebf8c2d944e7202de" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:05:22.835191 22107 consensus_queue.cc:237] T 0afb57ae58a24a01850491d69f0213dd P 127766fc592545a4997f7790f50f6076 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:05:22.846751 22168 raft_consensus.cc:2749] T 65d8cb8d6ec64f459d5a47cefab10acf P 127766fc592545a4997f7790f50f6076 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:05:22.883742 22140 raft_consensus.cc:3060] T 2e36a9d6e29c4a7c860cf267efbd4c74 P 0473d2b2d01f4459b1e90fd12cc7840e [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:05:22.947124 19409 raft_consensus.cc:2468] T 7be9efa6559648dbb5a0f7684c4542d1 P e5256d91808b47c195bc9b4dbd7f2b87 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 7.
W20260709 13:05:22.955212 20078 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.2:46257, user_credentials={real_user=slave}} blocked reactor thread for 152832us
I20260709 13:05:22.933022 22064 leader_election.cc:290] T 0cdf56e38bbc453d9438d359e5a69955 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:05:22.960359 19552 raft_consensus.cc:2393] T 48824d5acfbc485ebf8c2d944e7202de P e61c3a8f61bb48f8a963c9480e53c168 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 127766fc592545a4997f7790f50f6076 in current term 6: Already voted for candidate 0473d2b2d01f4459b1e90fd12cc7840e in this term.
I20260709 13:05:22.960685 19558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f93ee515a9c14139bf566522ed8232f3" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 9 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
W20260709 13:05:22.961036 19523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.4:43121, user_credentials={real_user=slave}} blocked reactor thread for 79460.6us
I20260709 13:05:22.960372 19559 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "7f575b143b844aa096b50997dad3516a"
dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
 from {username='slave'} at 127.0.0.1:40438
I20260709 13:05:22.981648 19559 raft_consensus.cc:493] T 7f575b143b844aa096b50997dad3516a P e61c3a8f61bb48f8a963c9480e53c168 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:22.981999 19559 raft_consensus.cc:3060] T 7f575b143b844aa096b50997dad3516a P e61c3a8f61bb48f8a963c9480e53c168 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:22.981949 19523 leader_election.cc:304] T ed7fdbcb96d14d418db9ca90a792588a P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 127766fc592545a4997f7790f50f6076, e61c3a8f61bb48f8a963c9480e53c168; no voters: 0473d2b2d01f4459b1e90fd12cc7840e
I20260709 13:05:22.962134 19554 raft_consensus.cc:1240] T 2b74109013a140ada21feeef92d6f563 P e61c3a8f61bb48f8a963c9480e53c168 [term 4 FOLLOWER]: Rejecting Update request from peer e5256d91808b47c195bc9b4dbd7f2b87 for earlier term 3. Current term is 4. Ops: []
W20260709 13:05:22.972029 19450 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.3:36891, user_credentials={real_user=slave}} blocked reactor thread for 58558.8us
I20260709 13:05:22.983948 19450 leader_election.cc:400] T f93ee515a9c14139bf566522ed8232f3 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 8 election: Vote denied by peer e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891) with higher term. Message: Invalid argument: T f93ee515a9c14139bf566522ed8232f3 P e61c3a8f61bb48f8a963c9480e53c168 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 0473d2b2d01f4459b1e90fd12cc7840e for earlier term 8. Current term is 9.
I20260709 13:05:22.984305 19450 leader_election.cc:403] T f93ee515a9c14139bf566522ed8232f3 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 8 election: Cancelling election due to peer responding with higher term
I20260709 13:05:22.911077 21992 raft_consensus.cc:2749] T 6c5eebf646ad445a9d1b1adc319d7b16 P e61c3a8f61bb48f8a963c9480e53c168 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:05:22.971683 21991 raft_consensus.cc:2804] T 5ec1c4ce15e04c7e8c283a62179f2a64 P 127766fc592545a4997f7790f50f6076 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:05:22.902163 21926 raft_consensus.cc:493] T 14935b3ddf914369822e4a0547aaa355 P e5256d91808b47c195bc9b4dbd7f2b87 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:22.847599 22162 raft_consensus.cc:2804] T 1f85fc4b527a48848e5faa083b604e36 P 127766fc592545a4997f7790f50f6076 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:05:22.918774 21971 raft_consensus.cc:2749] T 14935b3ddf914369822e4a0547aaa355 P e61c3a8f61bb48f8a963c9480e53c168 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:05:22.918370 21767 raft_consensus.cc:740] T 96efeaaf1057492490e9a621f37e1a2d P 0473d2b2d01f4459b1e90fd12cc7840e [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 0473d2b2d01f4459b1e90fd12cc7840e, State: Running, Role: LEADER
I20260709 13:05:22.991979 19558 raft_consensus.cc:2393] T f93ee515a9c14139bf566522ed8232f3 P e61c3a8f61bb48f8a963c9480e53c168 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate e5256d91808b47c195bc9b4dbd7f2b87 in current term 9: Already voted for candidate e61c3a8f61bb48f8a963c9480e53c168 in this term.
I20260709 13:05:22.998431 19559 raft_consensus.cc:515] T 7f575b143b844aa096b50997dad3516a P e61c3a8f61bb48f8a963c9480e53c168 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
W20260709 13:05:22.991571 20076 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.3:36891, user_credentials={real_user=slave}} blocked reactor thread for 79396.2us
I20260709 13:05:23.014705 20078 leader_election.cc:304] T ab43d85f64114d4ebf618930e43d9ed0 P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 127766fc592545a4997f7790f50f6076; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87
W20260709 13:05:23.019176 19377 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:23.019232 19559 leader_election.cc:290] T 7f575b143b844aa096b50997dad3516a P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 3 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:05:22.846227 22164 raft_consensus.cc:493] T 309c3ca0ca4b4f3ba129752ea2cb293b P 0473d2b2d01f4459b1e90fd12cc7840e [term 6 FOLLOWER]: Starting pre-election (detected failure of leader e61c3a8f61bb48f8a963c9480e53c168)
I20260709 13:05:23.019104 19523 leader_election.cc:400] T 48824d5acfbc485ebf8c2d944e7202de P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 5 election: Vote denied by peer 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121) with higher term. Message: Invalid argument: T 48824d5acfbc485ebf8c2d944e7202de P 127766fc592545a4997f7790f50f6076 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate e61c3a8f61bb48f8a963c9480e53c168 for earlier term 5. Current term is 6.
I20260709 13:05:23.022610 19523 leader_election.cc:403] T 48824d5acfbc485ebf8c2d944e7202de P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 5 election: Cancelling election due to peer responding with higher term
I20260709 13:05:23.023267 19409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e1f505cb0f1427bbd698ac889d80821" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
I20260709 13:05:23.023452 19523 leader_election.cc:304] T ece3db938bc649d4a40a51522ed5259c P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 127766fc592545a4997f7790f50f6076, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:05:23.024191 19409 raft_consensus.cc:2393] T 3e1f505cb0f1427bbd698ac889d80821 P e5256d91808b47c195bc9b4dbd7f2b87 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate e61c3a8f61bb48f8a963c9480e53c168 in current term 6: Already voted for candidate e5256d91808b47c195bc9b4dbd7f2b87 in this term.
I20260709 13:05:22.968711 22027 raft_consensus.cc:2749] T 1efebf73c86e432baa55533136b6e12c P e61c3a8f61bb48f8a963c9480e53c168 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:05:22.933346 22145 raft_consensus.cc:515] T fa731b585f684a7fb2d106c50f143b83 P e61c3a8f61bb48f8a963c9480e53c168 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:05:22.968474 22167 raft_consensus.cc:2804] T 9962423cb4e54fcfa5de01daf68a86e7 P e5256d91808b47c195bc9b4dbd7f2b87 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:05:22.981122 22111 raft_consensus.cc:3055] T 62c6c134d3d24a1ab144dd9ee6bc3f64 P 127766fc592545a4997f7790f50f6076 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:05:22.938622 22057 consensus_queue.cc:1048] T 2725d2c4cb054f18b0fc8f735c15f6c2 P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.077s
I20260709 13:05:22.969172 21958 raft_consensus.cc:493] T b08304a0a02b42d7840c4e8ee9a6bd1a P e5256d91808b47c195bc9b4dbd7f2b87 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:22.996526 22162 raft_consensus.cc:493] T 1f85fc4b527a48848e5faa083b604e36 P 127766fc592545a4997f7790f50f6076 [term 4 FOLLOWER]: Starting leader election (detected failure of leader e5256d91808b47c195bc9b4dbd7f2b87)
I20260709 13:05:22.936690 22011 raft_consensus.cc:515] T d1e5873a19244c5ebbcd38e126796ee7 P 0473d2b2d01f4459b1e90fd12cc7840e [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
W20260709 13:05:23.046628 19449 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.4:43121, user_credentials={real_user=slave}} blocked reactor thread for 105642us
I20260709 13:05:23.046636 19375 leader_election.cc:304] T e381f1d6b8184797ad142de49be225a8 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:05:23.010835 22141 raft_consensus.cc:2749] T a08760e15aac4630a629431f56024dc8 P 0473d2b2d01f4459b1e90fd12cc7840e [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:05:23.041667 21971 raft_consensus.cc:493] T 0e1085d23e8347fbbd5bce7542f4b1f4 P e61c3a8f61bb48f8a963c9480e53c168 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 127766fc592545a4997f7790f50f6076)
I20260709 13:05:23.013602 21991 raft_consensus.cc:697] T 5ec1c4ce15e04c7e8c283a62179f2a64 P 127766fc592545a4997f7790f50f6076 [term 5 LEADER]: Becoming Leader. State: Replica: 127766fc592545a4997f7790f50f6076, State: Running, Role: LEADER
I20260709 13:05:23.047586 19449 leader_election.cc:304] T 172b3dd13109415a955b71ac0e9d2234 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, 127766fc592545a4997f7790f50f6076; no voters: e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:05:23.022146 21992 raft_consensus.cc:493] T 0cdf56e38bbc453d9438d359e5a69955 P e61c3a8f61bb48f8a963c9480e53c168 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:23.028872 21559 raft_consensus.cc:2804] T ed7fdbcb96d14d418db9ca90a792588a P e61c3a8f61bb48f8a963c9480e53c168 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:05:23.026111 22007 raft_consensus.cc:2764] T 14efcc79969f41babe5529c22d59156d P 0473d2b2d01f4459b1e90fd12cc7840e [term 6 FOLLOWER]: Leader pre-election decision vote started in defunct term 5: won
I20260709 13:05:23.031345 22139 raft_consensus.cc:2764] T ece3db938bc649d4a40a51522ed5259c P e61c3a8f61bb48f8a963c9480e53c168 [term 6 FOLLOWER]: Leader pre-election decision vote started in defunct term 5: won
I20260709 13:05:23.031711 21833 raft_consensus.cc:2749] T 48824d5acfbc485ebf8c2d944e7202de P e61c3a8f61bb48f8a963c9480e53c168 [term 6 FOLLOWER]: Leader election lost for term 5. Reason: Vote denied by peer 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121) with higher term. Message: Invalid argument: T 48824d5acfbc485ebf8c2d944e7202de P 127766fc592545a4997f7790f50f6076 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate e61c3a8f61bb48f8a963c9480e53c168 for earlier term 5. Current term is 6.
I20260709 13:05:23.090513 19449 leader_election.cc:304] T 1f85fc4b527a48848e5faa083b604e36 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e; no voters: 127766fc592545a4997f7790f50f6076, e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:05:23.040431 22111 raft_consensus.cc:740] T 62c6c134d3d24a1ab144dd9ee6bc3f64 P 127766fc592545a4997f7790f50f6076 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 127766fc592545a4997f7790f50f6076, State: Running, Role: LEADER
W20260709 13:05:23.062160 20075 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.1:40321, user_credentials={real_user=slave}} blocked reactor thread for 168727us
I20260709 13:05:23.085811 19481 raft_consensus.cc:2393] T d1e5873a19244c5ebbcd38e126796ee7 P 0473d2b2d01f4459b1e90fd12cc7840e [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate e5256d91808b47c195bc9b4dbd7f2b87 in current term 8: Already voted for candidate 0473d2b2d01f4459b1e90fd12cc7840e in this term.
I20260709 13:05:23.086648 19375 leader_election.cc:304] T fa731b585f684a7fb2d106c50f143b83 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168; no voters: 127766fc592545a4997f7790f50f6076
I20260709 13:05:23.049999 22162 raft_consensus.cc:3060] T 1f85fc4b527a48848e5faa083b604e36 P 127766fc592545a4997f7790f50f6076 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:05:23.094434 19449 leader_election.cc:304] T 0afb57ae58a24a01850491d69f0213dd P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e; no voters: 127766fc592545a4997f7790f50f6076, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:05:23.000218 21926 raft_consensus.cc:515] T 14935b3ddf914369822e4a0547aaa355 P e5256d91808b47c195bc9b4dbd7f2b87 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } attrs { replace: true } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:05:23.051844 22167 raft_consensus.cc:697] T 9962423cb4e54fcfa5de01daf68a86e7 P e5256d91808b47c195bc9b4dbd7f2b87 [term 10 LEADER]: Becoming Leader. State: Replica: e5256d91808b47c195bc9b4dbd7f2b87, State: Running, Role: LEADER
I20260709 13:05:23.106859 19526 leader_election.cc:304] T bc225c93219c45538b53a1bd3d387e4d P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e61c3a8f61bb48f8a963c9480e53c168; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:05:23.099210 19375 leader_election.cc:304] T 2725d2c4cb054f18b0fc8f735c15f6c2 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168; no voters: 0473d2b2d01f4459b1e90fd12cc7840e
I20260709 13:05:23.132592 19375 leader_election.cc:304] T f1b10566f45d4a7d9029858330e02d5b P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168; no voters: 0473d2b2d01f4459b1e90fd12cc7840e
I20260709 13:05:23.041383 21976 consensus_queue.cc:1059] T 85c494af21f9457a85da47b9bc70c1fd P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.055s
I20260709 13:05:23.088811 22104 raft_consensus.cc:2749] T e381f1d6b8184797ad142de49be225a8 P e5256d91808b47c195bc9b4dbd7f2b87 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:05:23.138736 19405 raft_consensus.cc:2468] T 833a2f0775ed407a94b8924ce50adb63 P e5256d91808b47c195bc9b4dbd7f2b87 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 127766fc592545a4997f7790f50f6076 in term 6.
I20260709 13:05:23.022660 22114 consensus_queue.cc:237] T 86a6797bdfe94fa496c050ceae4bd0d9 P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.2, Last appended by leader: 2, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
W20260709 13:05:23.146938 19377 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.2:46257, user_credentials={real_user=slave}} blocked reactor thread for 96844us
I20260709 13:05:23.050588 21958 raft_consensus.cc:515] T b08304a0a02b42d7840c4e8ee9a6bd1a P e5256d91808b47c195bc9b4dbd7f2b87 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:23.097551 22050 raft_consensus.cc:697] T b08304a0a02b42d7840c4e8ee9a6bd1a P 0473d2b2d01f4459b1e90fd12cc7840e [term 7 LEADER]: Becoming Leader. State: Replica: 0473d2b2d01f4459b1e90fd12cc7840e, State: Running, Role: LEADER
W20260709 13:05:23.149462 19377 leader_election.cc:336] T fa8650e71aa14778b3d73721fc50d9fc P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257): Timed out: RequestConsensusVote RPC to 127.17.223.2:46257 timed out after 1.805s (SENT)
I20260709 13:05:23.156867 19377 leader_election.cc:304] T fa8650e71aa14778b3d73721fc50d9fc P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:05:23.089165 21559 raft_consensus.cc:493] T ed7fdbcb96d14d418db9ca90a792588a P e61c3a8f61bb48f8a963c9480e53c168 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 0473d2b2d01f4459b1e90fd12cc7840e)
I20260709 13:05:23.116464 22064 raft_consensus.cc:2804] T fa731b585f684a7fb2d106c50f143b83 P e5256d91808b47c195bc9b4dbd7f2b87 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:05:23.078718 21971 raft_consensus.cc:515] T 0e1085d23e8347fbbd5bce7542f4b1f4 P e61c3a8f61bb48f8a963c9480e53c168 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
W20260709 13:05:23.164677 19523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.4:43121, user_credentials={real_user=slave}} blocked reactor thread for 135429us
I20260709 13:05:23.091105 21992 raft_consensus.cc:515] T 0cdf56e38bbc453d9438d359e5a69955 P e61c3a8f61bb48f8a963c9480e53c168 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:23.039384 22164 raft_consensus.cc:515] T 309c3ca0ca4b4f3ba129752ea2cb293b P 0473d2b2d01f4459b1e90fd12cc7840e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } attrs { replace: true } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:05:23.139798 22131 raft_consensus.cc:2804] T 2725d2c4cb054f18b0fc8f735c15f6c2 P e5256d91808b47c195bc9b4dbd7f2b87 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:05:23.141034 22007 raft_consensus.cc:2804] T 172b3dd13109415a955b71ac0e9d2234 P 0473d2b2d01f4459b1e90fd12cc7840e [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:05:23.140919 22141 raft_consensus.cc:3060] T f93ee515a9c14139bf566522ed8232f3 P 0473d2b2d01f4459b1e90fd12cc7840e [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:05:23.141523 21833 raft_consensus.cc:2749] T bc225c93219c45538b53a1bd3d387e4d P e61c3a8f61bb48f8a963c9480e53c168 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:05:23.144100 22056 raft_consensus.cc:2749] T ab43d85f64114d4ebf618930e43d9ed0 P 127766fc592545a4997f7790f50f6076 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:05:23.212992 19482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff75a1d4cb1f493db8f71ddc136ba9ab" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:05:23.232116 19482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef32ce6fdd0e40d382c79974f30295c6" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:05:23.233116 19482 raft_consensus.cc:2393] T ef32ce6fdd0e40d382c79974f30295c6 P 0473d2b2d01f4459b1e90fd12cc7840e [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate e61c3a8f61bb48f8a963c9480e53c168 in current term 7: Already voted for candidate e5256d91808b47c195bc9b4dbd7f2b87 in this term.
I20260709 13:05:23.213024 19559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "309c3ca0ca4b4f3ba129752ea2cb293b" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:05:23.213835 19485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86a6797bdfe94fa496c050ceae4bd0d9" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:05:23.234496 19485 raft_consensus.cc:2376] T 86a6797bdfe94fa496c050ceae4bd0d9 P 0473d2b2d01f4459b1e90fd12cc7840e [term 6 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 6. Re-sending same reply.
I20260709 13:05:23.235597 19485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48824d5acfbc485ebf8c2d944e7202de" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:05:23.236430 19485 raft_consensus.cc:2368] T 48824d5acfbc485ebf8c2d944e7202de P 0473d2b2d01f4459b1e90fd12cc7840e [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate e61c3a8f61bb48f8a963c9480e53c168 for earlier term 5. Current term is 6.
I20260709 13:05:23.237296 19485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f575b143b844aa096b50997dad3516a" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:05:23.237954 19485 raft_consensus.cc:3060] T 7f575b143b844aa096b50997dad3516a P 0473d2b2d01f4459b1e90fd12cc7840e [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:23.214766 19558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "833a2f0775ed407a94b8924ce50adb63" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:05:23.238611 19558 raft_consensus.cc:3060] T 833a2f0775ed407a94b8924ce50adb63 P e61c3a8f61bb48f8a963c9480e53c168 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:05:23.214926 19484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "217b5fae677b4971b3bbd2f357a1f7ff" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:05:23.215790 19480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96efeaaf1057492490e9a621f37e1a2d" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:05:23.218588 19477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46c5bfeecc314717bffe987e6844b6d0" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 11 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:05:23.240688 19477 raft_consensus.cc:2393] T 46c5bfeecc314717bffe987e6844b6d0 P 0473d2b2d01f4459b1e90fd12cc7840e [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate e61c3a8f61bb48f8a963c9480e53c168 in current term 11: Already voted for candidate 0473d2b2d01f4459b1e90fd12cc7840e in this term.
W20260709 13:05:23.218129 20075 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.1:40321, user_credentials={real_user=slave}} blocked reactor thread for 115858us
I20260709 13:05:23.222375 20076 leader_election.cc:304] T 96efeaaf1057492490e9a621f37e1a2d P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 127766fc592545a4997f7790f50f6076, e61c3a8f61bb48f8a963c9480e53c168; no voters: 0473d2b2d01f4459b1e90fd12cc7840e
I20260709 13:05:23.075457 21767 consensus_queue.cc:260] T 96efeaaf1057492490e9a621f37e1a2d P 0473d2b2d01f4459b1e90fd12cc7840e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:05:23.159276 22102 raft_consensus.cc:2804] T f1b10566f45d4a7d9029858330e02d5b P e5256d91808b47c195bc9b4dbd7f2b87 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:05:23.251926 20075 leader_election.cc:304] T 833a2f0775ed407a94b8924ce50adb63 P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 127766fc592545a4997f7790f50f6076, e5256d91808b47c195bc9b4dbd7f2b87; no voters: 
I20260709 13:05:23.243568 19482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e1f505cb0f1427bbd698ac889d80821" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:05:23.253986 19482 raft_consensus.cc:2393] T 3e1f505cb0f1427bbd698ac889d80821 P 0473d2b2d01f4459b1e90fd12cc7840e [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate e61c3a8f61bb48f8a963c9480e53c168 in current term 6: Already voted for candidate e5256d91808b47c195bc9b4dbd7f2b87 in this term.
I20260709 13:05:23.159154 22163 raft_consensus.cc:2749] T 1f85fc4b527a48848e5faa083b604e36 P 0473d2b2d01f4459b1e90fd12cc7840e [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:05:23.244982 19477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b74109013a140ada21feeef92d6f563" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:05:23.255192 19477 raft_consensus.cc:2393] T 2b74109013a140ada21feeef92d6f563 P 0473d2b2d01f4459b1e90fd12cc7840e [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate e61c3a8f61bb48f8a963c9480e53c168 in current term 4: Already voted for candidate 0473d2b2d01f4459b1e90fd12cc7840e in this term.
I20260709 13:05:23.162216 22064 raft_consensus.cc:493] T fa731b585f684a7fb2d106c50f143b83 P e5256d91808b47c195bc9b4dbd7f2b87 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 127766fc592545a4997f7790f50f6076)
I20260709 13:05:23.248761 19526 leader_election.cc:400] T 48824d5acfbc485ebf8c2d944e7202de P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 5 election: Vote denied by peer 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257) with higher term. Message: Invalid argument: T 48824d5acfbc485ebf8c2d944e7202de P 0473d2b2d01f4459b1e90fd12cc7840e [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate e61c3a8f61bb48f8a963c9480e53c168 for earlier term 5. Current term is 6.
I20260709 13:05:23.207772 22180 raft_consensus.cc:2749] T 0afb57ae58a24a01850491d69f0213dd P 0473d2b2d01f4459b1e90fd12cc7840e [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:05:23.227289 22131 raft_consensus.cc:493] T 2725d2c4cb054f18b0fc8f735c15f6c2 P e5256d91808b47c195bc9b4dbd7f2b87 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:23.265440 19558 raft_consensus.cc:2468] T 833a2f0775ed407a94b8924ce50adb63 P e61c3a8f61bb48f8a963c9480e53c168 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 127766fc592545a4997f7790f50f6076 in term 6.
I20260709 13:05:23.166513 22104 consensus_queue.cc:1048] T 70797e5783b5454ab0d0eea663e791e3 P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.084s
I20260709 13:05:23.163017 21559 raft_consensus.cc:3060] T ed7fdbcb96d14d418db9ca90a792588a P e61c3a8f61bb48f8a963c9480e53c168 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:05:23.226322 22007 raft_consensus.cc:493] T 172b3dd13109415a955b71ac0e9d2234 P 0473d2b2d01f4459b1e90fd12cc7840e [term 3 FOLLOWER]: Starting leader election (detected failure of leader e5256d91808b47c195bc9b4dbd7f2b87)
I20260709 13:05:23.273605 19478 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58294 (request call id 1713) took 1006 ms. Trace:
I20260709 13:05:23.303653 19478 rpcz_store.cc:276] 0709 13:05:22.267456 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:22.268897 (+  1441us) service_pool.cc:224] Handling call
0709 13:05:23.273415 (+1004518us) spinlock_profiling.cc:243] Waited 437 ms on lock 0x7b5400353754. stack: 00007f4a79de9343 00007f4a79de9240 00007f4a797781d4 00007f4a834b6304 00007f4a834b6299 00007f4a7ce71571 00007f4a7cf0c2fa 00007f4a81ecdb17 00007f4a7b4486d4 00007f4a7b448662 00007f4a7b448591 00007f4a7b44850c 00007f4a7b4477c2 00007f4a7b24348c 00007f4a7b2428c6 00007f4a7b24226f
0709 13:05:23.273551 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1004816256}
I20260709 13:05:23.285840 19485 raft_consensus.cc:2468] T 7f575b143b844aa096b50997dad3516a P 0473d2b2d01f4459b1e90fd12cc7840e [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 3.
I20260709 13:05:23.291178 19406 raft_consensus.cc:1240] T 65d8cb8d6ec64f459d5a47cefab10acf P e5256d91808b47c195bc9b4dbd7f2b87 [term 4 LEADER]: Rejecting Update request from peer e61c3a8f61bb48f8a963c9480e53c168 for earlier term 3. Current term is 4. Ops: [3.5-3.5]
W20260709 13:05:23.266079 19450 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.3:36891, user_credentials={real_user=slave}} blocked reactor thread for 282306us
I20260709 13:05:23.166083 21823 raft_consensus.cc:515] T 2e36a9d6e29c4a7c860cf267efbd4c74 P e5256d91808b47c195bc9b4dbd7f2b87 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
W20260709 13:05:23.315827 19375 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.3:36891, user_credentials={real_user=slave}} blocked reactor thread for 162367us
I20260709 13:05:23.316300 19526 leader_election.cc:304] T 7f575b143b844aa096b50997dad3516a P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:05:23.317305 19482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62c6c134d3d24a1ab144dd9ee6bc3f64" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:05:23.279902 22064 raft_consensus.cc:3060] T fa731b585f684a7fb2d106c50f143b83 P e5256d91808b47c195bc9b4dbd7f2b87 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:05:23.305229 19478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e36a9d6e29c4a7c860cf267efbd4c74" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:05:23.324162 19485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e5873a19244c5ebbcd38e126796ee7" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:05:23.280594 22102 raft_consensus.cc:697] T f1b10566f45d4a7d9029858330e02d5b P e5256d91808b47c195bc9b4dbd7f2b87 [term 8 LEADER]: Becoming Leader. State: Replica: e5256d91808b47c195bc9b4dbd7f2b87, State: Running, Role: LEADER
I20260709 13:05:23.281523 22146 leader_election.cc:290] T 22196caba61445d3bec98a0aab3c337d P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 6 election: Requested vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:05:23.330179 19404 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.LeaderStepDown from 127.0.0.1:37312 (request call id 37) took 1096 ms. Trace:
I20260709 13:05:23.295773 22131 raft_consensus.cc:3060] T 2725d2c4cb054f18b0fc8f735c15f6c2 P e5256d91808b47c195bc9b4dbd7f2b87 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:05:23.275938 22076 raft_consensus.cc:697] T 217b5fae677b4971b3bbd2f357a1f7ff P 0473d2b2d01f4459b1e90fd12cc7840e [term 4 LEADER]: Becoming Leader. State: Replica: 0473d2b2d01f4459b1e90fd12cc7840e, State: Running, Role: LEADER
I20260709 13:05:23.348440 19404 rpcz_store.cc:276] 0709 13:05:22.231997 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:22.232141 (+   144us) service_pool.cc:224] Handling call
0709 13:05:22.940725 (+708584us) spinlock_profiling.cc:243] Waited 4.49 ms on lock 0x7b4c003289c0. stack: 00007f4a79de9343 00007f4a79de9240 00007f4a797781d4 00007f4a834b6304 00007f4a834b6299 00007f4a7b1d4a20 00007f4a7b1e5a29 00007f4a7b1ab644 00007f4a7b1d2f2d 00007f4a7b1d2b93 00007f4a7cf02c92 00007f4a7cf0284a 00007f4a81ed060a 00007f4a7b4567d4 00007f4a7b456762 00007f4a7b456691
0709 13:05:23.327773 (+387048us) spinlock_profiling.cc:243] Waited 361 ms on lock 0x7b5400065c54. stack: 00007f4a79de9343 00007f4a79de9240 00007f4a797781d4 00007f4a834b6304 00007f4a834b6299 00007f4a7ce71571 00007f4a7cf02853 00007f4a81ed060a 00007f4a7b4567d4 00007f4a7b456762 00007f4a7b456691 00007f4a7b45660c 00007f4a7b4558c2 00007f4a7b24348c 00007f4a7b2428c6 00007f4a7b24226f
0709 13:05:23.327877 (+   104us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":841471616}
I20260709 13:05:23.291519 22021 raft_consensus.cc:2804] T 833a2f0775ed407a94b8924ce50adb63 P 127766fc592545a4997f7790f50f6076 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:05:23.201459 21991 consensus_queue.cc:237] T 5ec1c4ce15e04c7e8c283a62179f2a64 P 127766fc592545a4997f7790f50f6076 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:05:23.361260 22021 raft_consensus.cc:697] T 833a2f0775ed407a94b8924ce50adb63 P 127766fc592545a4997f7790f50f6076 [term 6 LEADER]: Becoming Leader. State: Replica: 127766fc592545a4997f7790f50f6076, State: Running, Role: LEADER
I20260709 13:05:23.362160 22021 consensus_queue.cc:237] T 833a2f0775ed407a94b8924ce50adb63 P 127766fc592545a4997f7790f50f6076 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:05:23.199410 22111 consensus_queue.cc:260] T 62c6c134d3d24a1ab144dd9ee6bc3f64 P 127766fc592545a4997f7790f50f6076 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:05:23.319269 22007 raft_consensus.cc:3060] T 172b3dd13109415a955b71ac0e9d2234 P 0473d2b2d01f4459b1e90fd12cc7840e [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:05:23.338570 19451 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:23.340023 19482 raft_consensus.cc:2393] T 62c6c134d3d24a1ab144dd9ee6bc3f64 P 0473d2b2d01f4459b1e90fd12cc7840e [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate e61c3a8f61bb48f8a963c9480e53c168 in current term 8: Already voted for candidate 0473d2b2d01f4459b1e90fd12cc7840e in this term.
I20260709 13:05:23.272840 22184 consensus_queue.cc:1059] T 96efeaaf1057492490e9a621f37e1a2d P 0473d2b2d01f4459b1e90fd12cc7840e [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.085s
W20260709 13:05:23.347548 19377 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.2:46257, user_credentials={real_user=slave}} blocked reactor thread for 198179us
I20260709 13:05:23.322734 22185 raft_consensus.cc:493] T 2a16f7501e2444fb86d4e2778e734e02 P e61c3a8f61bb48f8a963c9480e53c168 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 127766fc592545a4997f7790f50f6076)
I20260709 13:05:23.242268 22167 consensus_queue.cc:237] T 9962423cb4e54fcfa5de01daf68a86e7 P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:05:23.349427 19375 leader_election.cc:304] T ece3db938bc649d4a40a51522ed5259c P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168; no voters: 127766fc592545a4997f7790f50f6076
I20260709 13:05:23.359229 22076 consensus_queue.cc:237] T 217b5fae677b4971b3bbd2f357a1f7ff P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:23.399763 22196 consensus_queue.cc:1059] T 2b74109013a140ada21feeef92d6f563 P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
W20260709 13:05:23.339108 22181 log.cc:927] Time spent T bc225c93219c45538b53a1bd3d387e4d P e61c3a8f61bb48f8a963c9480e53c168: Append to log took a long time: real 0.236s	user 0.000s	sys 0.001s
I20260709 13:05:23.404795 19485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f93ee515a9c14139bf566522ed8232f3" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 9 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:05:23.365469 22178 raft_consensus.cc:2804] T 96efeaaf1057492490e9a621f37e1a2d P 127766fc592545a4997f7790f50f6076 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:05:23.354833 22118 raft_consensus.cc:2804] T 7f575b143b844aa096b50997dad3516a P e61c3a8f61bb48f8a963c9480e53c168 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:05:23.295105 22186 consensus_queue.cc:1059] T 65d8cb8d6ec64f459d5a47cefab10acf P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.066s
I20260709 13:05:23.386855 19482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dc5b3532fe54f74876d02beffa2c230" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:05:23.390651 19523 leader_election.cc:304] T ff75a1d4cb1f493db8f71ddc136ba9ab P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:05:23.428448 19482 raft_consensus.cc:2393] T 1dc5b3532fe54f74876d02beffa2c230 P 0473d2b2d01f4459b1e90fd12cc7840e [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate e61c3a8f61bb48f8a963c9480e53c168 in current term 5: Already voted for candidate e5256d91808b47c195bc9b4dbd7f2b87 in this term.
I20260709 13:05:23.428987 19523 leader_election.cc:304] T 4af19371ea874c09a0a2147040835cbb P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e61c3a8f61bb48f8a963c9480e53c168; no voters: 127766fc592545a4997f7790f50f6076, e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:05:23.391662 19558 raft_consensus.cc:3055] T 85c494af21f9457a85da47b9bc70c1fd P e61c3a8f61bb48f8a963c9480e53c168 [term 3 LEADER]: Stepping down as leader of term 3
W20260709 13:05:23.392858 19526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.2:46257, user_credentials={real_user=slave}} blocked reactor thread for 76753.4us
I20260709 13:05:23.429713 19558 raft_consensus.cc:740] T 85c494af21f9457a85da47b9bc70c1fd P e61c3a8f61bb48f8a963c9480e53c168 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: e61c3a8f61bb48f8a963c9480e53c168, State: Running, Role: LEADER
I20260709 13:05:23.401152 22049 raft_consensus.cc:2804] T ece3db938bc649d4a40a51522ed5259c P e5256d91808b47c195bc9b4dbd7f2b87 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:05:23.396083 19559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edd7d470b5014c9489be7f41f64355c9" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:05:23.396355 19554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a61655d99124a29b486ba4a5b37faea" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:05:23.396950 19560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22196caba61445d3bec98a0aab3c337d" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:05:23.397022 19552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cdf56e38bbc453d9438d359e5a69955" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:05:23.437290 19552 raft_consensus.cc:2468] T 0cdf56e38bbc453d9438d359e5a69955 P e61c3a8f61bb48f8a963c9480e53c168 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 8.
I20260709 13:05:23.397814 22185 raft_consensus.cc:515] T 2a16f7501e2444fb86d4e2778e734e02 P e61c3a8f61bb48f8a963c9480e53c168 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:05:23.403614 22146 raft_consensus.cc:3055] T 2b74109013a140ada21feeef92d6f563 P e5256d91808b47c195bc9b4dbd7f2b87 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:05:23.346643 22145 leader_election.cc:290] T fa731b585f684a7fb2d106c50f143b83 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 5 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
W20260709 13:05:23.402756 20076 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.3:36891, user_credentials={real_user=slave}} blocked reactor thread for 180444us
I20260709 13:05:23.455077 20076 leader_election.cc:304] T ed7fdbcb96d14d418db9ca90a792588a P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 127766fc592545a4997f7790f50f6076; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168
W20260709 13:05:23.379684 20078 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.2:46257, user_credentials={real_user=slave}} blocked reactor thread for 365038us
I20260709 13:05:23.430171 19526 leader_election.cc:304] T 62c6c134d3d24a1ab144dd9ee6bc3f64 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e61c3a8f61bb48f8a963c9480e53c168; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, 127766fc592545a4997f7790f50f6076
W20260709 13:05:23.394863 19450 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.3:36891, user_credentials={real_user=slave}} blocked reactor thread for 79677us
I20260709 13:05:23.430461 19405 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a08760e15aac4630a629431f56024dc8"
dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
mode: GRACEFUL
new_leader_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
 from {username='slave'} at 127.0.0.1:37312
I20260709 13:05:23.433342 19523 leader_election.cc:400] T 217b5fae677b4971b3bbd2f357a1f7ff P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 3 election: Vote denied by peer e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321) with higher term. Message: Invalid argument: T 217b5fae677b4971b3bbd2f357a1f7ff P e5256d91808b47c195bc9b4dbd7f2b87 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate e61c3a8f61bb48f8a963c9480e53c168 for earlier term 3. Current term is 4.
I20260709 13:05:23.456357 19523 leader_election.cc:403] T 217b5fae677b4971b3bbd2f357a1f7ff P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 3 election: Cancelling election due to peer responding with higher term
I20260709 13:05:23.436693 19482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df751f992649444090e27965eb1af85d" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:05:23.430500 19558 consensus_queue.cc:260] T 85c494af21f9457a85da47b9bc70c1fd P e61c3a8f61bb48f8a963c9480e53c168 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:05:23.457187 19558 raft_consensus.cc:3060] T 85c494af21f9457a85da47b9bc70c1fd P e61c3a8f61bb48f8a963c9480e53c168 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:05:23.457258 19482 raft_consensus.cc:2393] T df751f992649444090e27965eb1af85d P 0473d2b2d01f4459b1e90fd12cc7840e [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate e61c3a8f61bb48f8a963c9480e53c168 in current term 7: Already voted for candidate e5256d91808b47c195bc9b4dbd7f2b87 in this term.
I20260709 13:05:23.298781 22050 consensus_queue.cc:237] T b08304a0a02b42d7840c4e8ee9a6bd1a P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:23.442389 19375 leader_election.cc:304] T 0cdf56e38bbc453d9438d359e5a69955 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
W20260709 13:05:23.416664 22144 consensus_meta.cc:287] T b9f0d59553ad444883fcf5b5909f9798 P e5256d91808b47c195bc9b4dbd7f2b87: Time spent flushing consensus metadata: real 0.767s	user 0.010s	sys 0.000s
I20260709 13:05:23.419772 22111 raft_consensus.cc:3060] T 62c6c134d3d24a1ab144dd9ee6bc3f64 P 127766fc592545a4997f7790f50f6076 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:05:23.420275 22011 leader_election.cc:290] T d1e5873a19244c5ebbcd38e126796ee7 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 8 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:05:23.464807 19482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1b10566f45d4a7d9029858330e02d5b" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:05:23.469863 19482 raft_consensus.cc:2368] T f1b10566f45d4a7d9029858330e02d5b P 0473d2b2d01f4459b1e90fd12cc7840e [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate e61c3a8f61bb48f8a963c9480e53c168 for earlier term 7. Current term is 8.
I20260709 13:05:23.466159 19411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f575b143b844aa096b50997dad3516a" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
I20260709 13:05:23.471088 19411 raft_consensus.cc:3055] T 7f575b143b844aa096b50997dad3516a P e5256d91808b47c195bc9b4dbd7f2b87 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:05:23.471534 19411 raft_consensus.cc:740] T 7f575b143b844aa096b50997dad3516a P e5256d91808b47c195bc9b4dbd7f2b87 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: e5256d91808b47c195bc9b4dbd7f2b87, State: Running, Role: LEADER
I20260709 13:05:23.472429 19411 consensus_queue.cc:260] T 7f575b143b844aa096b50997dad3516a P e5256d91808b47c195bc9b4dbd7f2b87 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:23.476563 20078 leader_election.cc:304] T 9962423cb4e54fcfa5de01daf68a86e7 P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 127766fc592545a4997f7790f50f6076; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:05:23.479206 21559 raft_consensus.cc:515] T ed7fdbcb96d14d418db9ca90a792588a P e61c3a8f61bb48f8a963c9480e53c168 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:05:23.497591 19482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7be9efa6559648dbb5a0f7684c4542d1" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:05:23.499187 19482 raft_consensus.cc:2393] T 7be9efa6559648dbb5a0f7684c4542d1 P 0473d2b2d01f4459b1e90fd12cc7840e [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate e61c3a8f61bb48f8a963c9480e53c168 in current term 7: Already voted for candidate 0473d2b2d01f4459b1e90fd12cc7840e in this term.
I20260709 13:05:23.495950 19411 raft_consensus.cc:3060] T 7f575b143b844aa096b50997dad3516a P e5256d91808b47c195bc9b4dbd7f2b87 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:23.503729 19558 raft_consensus.cc:1275] T 85c494af21f9457a85da47b9bc70c1fd P e61c3a8f61bb48f8a963c9480e53c168 [term 4 FOLLOWER]: Refusing update from remote peer e5256d91808b47c195bc9b4dbd7f2b87: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
I20260709 13:05:23.462920 22199 raft_consensus.cc:2804] T ff75a1d4cb1f493db8f71ddc136ba9ab P e61c3a8f61bb48f8a963c9480e53c168 [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 13:05:23.512516 20076 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.3:36891, user_credentials={real_user=slave}} blocked reactor thread for 57497.1us
I20260709 13:05:23.443535 22146 raft_consensus.cc:740] T 2b74109013a140ada21feeef92d6f563 P e5256d91808b47c195bc9b4dbd7f2b87 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: e5256d91808b47c195bc9b4dbd7f2b87, State: Running, Role: LEADER
I20260709 13:05:23.510982 21559 leader_election.cc:290] T ed7fdbcb96d14d418db9ca90a792588a P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 4 election: Requested vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:05:23.517975 20105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36f6ba92b9ba46babe4ebd6c02e5fbd9" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076"
I20260709 13:05:23.519858 20107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ec1c4ce15e04c7e8c283a62179f2a64" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076"
I20260709 13:05:23.520982 20112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e1085d23e8347fbbd5bce7542f4b1f4" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:05:23.514462 20076 leader_election.cc:304] T 309c3ca0ca4b4f3ba129752ea2cb293b P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 127766fc592545a4997f7790f50f6076; no voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:05:23.470994 21971 leader_election.cc:290] T 0e1085d23e8347fbbd5bce7542f4b1f4 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:05:23.528775 20105 raft_consensus.cc:2393] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P 127766fc592545a4997f7790f50f6076 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 0473d2b2d01f4459b1e90fd12cc7840e in current term 8: Already voted for candidate 127766fc592545a4997f7790f50f6076 in this term.
I20260709 13:05:23.529700 20110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48824d5acfbc485ebf8c2d944e7202de" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076"
I20260709 13:05:23.553920 20110 raft_consensus.cc:2393] T 48824d5acfbc485ebf8c2d944e7202de P 127766fc592545a4997f7790f50f6076 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 0473d2b2d01f4459b1e90fd12cc7840e in current term 6: Already voted for candidate 127766fc592545a4997f7790f50f6076 in this term.
I20260709 13:05:23.470726 22178 raft_consensus.cc:697] T 96efeaaf1057492490e9a621f37e1a2d P 127766fc592545a4997f7790f50f6076 [term 6 LEADER]: Becoming Leader. State: Replica: 127766fc592545a4997f7790f50f6076, State: Running, Role: LEADER
I20260709 13:05:23.436318 22131 raft_consensus.cc:515] T 2725d2c4cb054f18b0fc8f735c15f6c2 P e5256d91808b47c195bc9b4dbd7f2b87 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:23.503024 22145 raft_consensus.cc:2749] T 4af19371ea874c09a0a2147040835cbb P e61c3a8f61bb48f8a963c9480e53c168 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 13:05:23.560209 20076 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.3:36891, user_credentials={real_user=slave}} blocked reactor thread for 45852.5us
I20260709 13:05:23.507021 21992 leader_election.cc:290] T 0cdf56e38bbc453d9438d359e5a69955 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:05:23.469233 22144 raft_consensus.cc:515] T b9f0d59553ad444883fcf5b5909f9798 P e5256d91808b47c195bc9b4dbd7f2b87 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:23.512609 22199 raft_consensus.cc:493] T ff75a1d4cb1f493db8f71ddc136ba9ab P e61c3a8f61bb48f8a963c9480e53c168 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 0473d2b2d01f4459b1e90fd12cc7840e)
I20260709 13:05:23.565608 22173 raft_consensus.cc:2749] T ed7fdbcb96d14d418db9ca90a792588a P 127766fc592545a4997f7790f50f6076 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:05:23.569650 22053 raft_consensus.cc:2749] T 62c6c134d3d24a1ab144dd9ee6bc3f64 P e61c3a8f61bb48f8a963c9480e53c168 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:05:23.560521 21867 raft_consensus.cc:493] T 28af091831594f9d8e96482078cc7625 P e5256d91808b47c195bc9b4dbd7f2b87 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 0473d2b2d01f4459b1e90fd12cc7840e)
I20260709 13:05:23.560015 22208 raft_consensus.cc:2749] T 9962423cb4e54fcfa5de01daf68a86e7 P 127766fc592545a4997f7790f50f6076 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:05:23.576689 22179 raft_consensus.cc:2749] T 309c3ca0ca4b4f3ba129752ea2cb293b P 127766fc592545a4997f7790f50f6076 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:05:23.497282 22102 consensus_queue.cc:237] T f1b10566f45d4a7d9029858330e02d5b P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:23.586261 22049 raft_consensus.cc:697] T ece3db938bc649d4a40a51522ed5259c P e5256d91808b47c195bc9b4dbd7f2b87 [term 6 LEADER]: Becoming Leader. State: Replica: e5256d91808b47c195bc9b4dbd7f2b87, State: Running, Role: LEADER
I20260709 13:05:23.588706 21992 raft_consensus.cc:2749] T 217b5fae677b4971b3bbd2f357a1f7ff P e61c3a8f61bb48f8a963c9480e53c168 [term 4 FOLLOWER]: Leader election lost for term 3. Reason: Vote denied by peer e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321) with higher term. Message: Invalid argument: T 217b5fae677b4971b3bbd2f357a1f7ff P e5256d91808b47c195bc9b4dbd7f2b87 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate e61c3a8f61bb48f8a963c9480e53c168 for earlier term 3. Current term is 4.
I20260709 13:05:23.668656 19403 raft_consensus.cc:1240] T b9f0d59553ad444883fcf5b5909f9798 P e5256d91808b47c195bc9b4dbd7f2b87 [term 7 FOLLOWER]: Rejecting Update request from peer e61c3a8f61bb48f8a963c9480e53c168 for earlier term 6. Current term is 7. Ops: []
W20260709 13:05:23.670219 19450 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.3:36891, user_credentials={real_user=slave}} blocked reactor thread for 201892us
I20260709 13:05:23.734562 21992 raft_consensus.cc:493] T 179fd671030940b4b4a4e24bcc4aba0a P e61c3a8f61bb48f8a963c9480e53c168 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 0473d2b2d01f4459b1e90fd12cc7840e)
I20260709 13:05:23.735625 21992 raft_consensus.cc:515] T 179fd671030940b4b4a4e24bcc4aba0a P e61c3a8f61bb48f8a963c9480e53c168 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:23.671443 19409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa731b585f684a7fb2d106c50f143b83" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
W20260709 13:05:23.694305 19523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.1:40321, user_credentials={real_user=slave}} blocked reactor thread for 260960us
I20260709 13:05:23.740619 19523 leader_election.cc:304] T 46c5bfeecc314717bffe987e6844b6d0 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e61c3a8f61bb48f8a963c9480e53c168; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:05:23.744364 22049 consensus_queue.cc:237] T ece3db938bc649d4a40a51522ed5259c P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:05:23.747202 22053 raft_consensus.cc:2749] T 46c5bfeecc314717bffe987e6844b6d0 P e61c3a8f61bb48f8a963c9480e53c168 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:05:23.710055 19558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b08304a0a02b42d7840c4e8ee9a6bd1a" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:05:23.750156 19558 raft_consensus.cc:2468] T b08304a0a02b42d7840c4e8ee9a6bd1a P e61c3a8f61bb48f8a963c9480e53c168 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 7.
I20260709 13:05:23.607972 22131 leader_election.cc:290] T 2725d2c4cb054f18b0fc8f735c15f6c2 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 8 election: Requested vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
W20260709 13:05:23.716674 21790 consensus_meta.cc:287] T 775c229504194560ba9589bc2199b089 P 0473d2b2d01f4459b1e90fd12cc7840e: Time spent flushing consensus metadata: real 0.908s	user 0.006s	sys 0.004s
I20260709 13:05:23.751748 22118 raft_consensus.cc:697] T 7f575b143b844aa096b50997dad3516a P e61c3a8f61bb48f8a963c9480e53c168 [term 3 LEADER]: Becoming Leader. State: Replica: e61c3a8f61bb48f8a963c9480e53c168, State: Running, Role: LEADER
W20260709 13:05:23.752470 22135 consensus_meta.cc:287] T 1a61655d99124a29b486ba4a5b37faea P e61c3a8f61bb48f8a963c9480e53c168: Time spent flushing consensus metadata: real 0.882s	user 0.013s	sys 0.000s
I20260709 13:05:23.752632 21790 raft_consensus.cc:515] T 775c229504194560ba9589bc2199b089 P 0473d2b2d01f4459b1e90fd12cc7840e [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:05:23.753156 22135 raft_consensus.cc:515] T 1a61655d99124a29b486ba4a5b37faea P e61c3a8f61bb48f8a963c9480e53c168 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:23.753495 22118 consensus_queue.cc:237] T 7f575b143b844aa096b50997dad3516a P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:23.716295 21867 raft_consensus.cc:515] T 28af091831594f9d8e96482078cc7625 P e5256d91808b47c195bc9b4dbd7f2b87 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:23.577003 21958 leader_election.cc:290] T b08304a0a02b42d7840c4e8ee9a6bd1a P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:05:23.739403 21992 leader_election.cc:290] T 179fd671030940b4b4a4e24bcc4aba0a P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:05:23.574493 20103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62c6c134d3d24a1ab144dd9ee6bc3f64" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076"
I20260709 13:05:23.751631 19554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e36a9d6e29c4a7c860cf267efbd4c74" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
W20260709 13:05:23.620852 22156 log.cc:927] Time spent T 0cdf56e38bbc453d9438d359e5a69955 P 0473d2b2d01f4459b1e90fd12cc7840e: Append to log took a long time: real 0.770s	user 0.000s	sys 0.008s
I20260709 13:05:23.800055 19557 raft_consensus.cc:1240] T 2b74109013a140ada21feeef92d6f563 P e61c3a8f61bb48f8a963c9480e53c168 [term 4 FOLLOWER]: Rejecting Update request from peer e5256d91808b47c195bc9b4dbd7f2b87 for earlier term 3. Current term is 4. Ops: []
I20260709 13:05:23.620929 22162 raft_consensus.cc:515] T 1f85fc4b527a48848e5faa083b604e36 P 127766fc592545a4997f7790f50f6076 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
W20260709 13:05:23.627810 22170 log.cc:927] Time spent T b9f0d59553ad444883fcf5b5909f9798 P e61c3a8f61bb48f8a963c9480e53c168: Append to log took a long time: real 0.732s	user 0.001s	sys 0.007s
I20260709 13:05:23.615129 22178 consensus_queue.cc:237] T 96efeaaf1057492490e9a621f37e1a2d P 127766fc592545a4997f7790f50f6076 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
W20260709 13:05:23.809298 19526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.2:46257, user_credentials={real_user=slave}} blocked reactor thread for 379065us
I20260709 13:05:23.613479 22185 leader_election.cc:290] T 2a16f7501e2444fb86d4e2778e734e02 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:05:23.612664 22195 raft_consensus.cc:2804] T 0cdf56e38bbc453d9438d359e5a69955 P e5256d91808b47c195bc9b4dbd7f2b87 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:05:23.590279 22199 raft_consensus.cc:3060] T ff75a1d4cb1f493db8f71ddc136ba9ab P e61c3a8f61bb48f8a963c9480e53c168 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:05:23.833554 22195 raft_consensus.cc:493] T 0cdf56e38bbc453d9438d359e5a69955 P e5256d91808b47c195bc9b4dbd7f2b87 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:23.834188 22195 raft_consensus.cc:3060] T 0cdf56e38bbc453d9438d359e5a69955 P e5256d91808b47c195bc9b4dbd7f2b87 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:05:23.606474 22210 log.cc:927] Time spent T 5ec1c4ce15e04c7e8c283a62179f2a64 P 127766fc592545a4997f7790f50f6076: Append to log took a long time: real 0.077s	user 0.001s	sys 0.000s
I20260709 13:05:23.592425 22146 consensus_queue.cc:260] T 2b74109013a140ada21feeef92d6f563 P e5256d91808b47c195bc9b4dbd7f2b87 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:23.848189 22146 raft_consensus.cc:3060] T 2b74109013a140ada21feeef92d6f563 P e5256d91808b47c195bc9b4dbd7f2b87 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:05:23.848397 19375 leader_election.cc:304] T b08304a0a02b42d7840c4e8ee9a6bd1a P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:05:23.851531 21958 consensus_queue.cc:1048] T 85c494af21f9457a85da47b9bc70c1fd P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:05:23.853832 21958 raft_consensus.cc:2804] T b08304a0a02b42d7840c4e8ee9a6bd1a P e5256d91808b47c195bc9b4dbd7f2b87 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:05:23.854321 21958 raft_consensus.cc:493] T b08304a0a02b42d7840c4e8ee9a6bd1a P e5256d91808b47c195bc9b4dbd7f2b87 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:05:23.796283 22089 consensus_meta.cc:287] T 22196caba61445d3bec98a0aab3c337d P e61c3a8f61bb48f8a963c9480e53c168: Time spent flushing consensus metadata: real 0.869s	user 0.014s	sys 0.003s
W20260709 13:05:23.797717 21957 consensus_meta.cc:287] T 40e1e16737a842ee936002830f36882e P e5256d91808b47c195bc9b4dbd7f2b87: Time spent flushing consensus metadata: real 0.830s	user 0.009s	sys 0.011s
W20260709 13:05:23.804116 22041 consensus_meta.cc:287] T 14935b3ddf914369822e4a0547aaa355 P 127766fc592545a4997f7790f50f6076: Time spent flushing consensus metadata: real 0.963s	user 0.011s	sys 0.008s
I20260709 13:05:23.807108 19554 raft_consensus.cc:3060] T 2e36a9d6e29c4a7c860cf267efbd4c74 P e61c3a8f61bb48f8a963c9480e53c168 [term 4 FOLLOWER]: Advancing to term 6
I20260709 13:05:23.807008 22164 leader_election.cc:290] T 309c3ca0ca4b4f3ba129752ea2cb293b P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:05:23.807871 22162 leader_election.cc:290] T 1f85fc4b527a48848e5faa083b604e36 P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 5 election: Requested vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321)
W20260709 13:05:23.816695 19451 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:23.821228 21867 leader_election.cc:290] T 28af091831594f9d8e96482078cc7625 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:05:23.824492 19557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2725d2c4cb054f18b0fc8f735c15f6c2" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:05:23.826939 22169 raft_consensus.cc:2749] T fa8650e71aa14778b3d73721fc50d9fc P e5256d91808b47c195bc9b4dbd7f2b87 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:05:23.827337 22135 leader_election.cc:290] T 1a61655d99124a29b486ba4a5b37faea P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 4 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:05:23.828951 19523 leader_election.cc:304] T 2b74109013a140ada21feeef92d6f563 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e61c3a8f61bb48f8a963c9480e53c168; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87
W20260709 13:05:23.830624 22141 consensus_meta.cc:287] T f93ee515a9c14139bf566522ed8232f3 P 0473d2b2d01f4459b1e90fd12cc7840e: Time spent flushing consensus metadata: real 0.599s	user 0.008s	sys 0.005s
I20260709 13:05:23.844485 19411 raft_consensus.cc:2468] T 7f575b143b844aa096b50997dad3516a P e5256d91808b47c195bc9b4dbd7f2b87 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 3.
W20260709 13:05:23.787478 19450 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.3:36891, user_credentials={real_user=slave}} blocked reactor thread for 51720.2us
I20260709 13:05:23.857053 21958 raft_consensus.cc:3060] T b08304a0a02b42d7840c4e8ee9a6bd1a P e5256d91808b47c195bc9b4dbd7f2b87 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:05:23.870060 19523 leader_election.cc:304] T ef32ce6fdd0e40d382c79974f30295c6 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e61c3a8f61bb48f8a963c9480e53c168; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:05:23.871944 19523 leader_election.cc:400] T f1b10566f45d4a7d9029858330e02d5b P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 7 election: Vote denied by peer e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321) with higher term. Message: Invalid argument: T f1b10566f45d4a7d9029858330e02d5b P e5256d91808b47c195bc9b4dbd7f2b87 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate e61c3a8f61bb48f8a963c9480e53c168 for earlier term 7. Current term is 8.
I20260709 13:05:23.872247 19523 leader_election.cc:403] T f1b10566f45d4a7d9029858330e02d5b P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 7 election: Cancelling election due to peer responding with higher term
I20260709 13:05:23.874070 22141 raft_consensus.cc:2749] T f93ee515a9c14139bf566522ed8232f3 P 0473d2b2d01f4459b1e90fd12cc7840e [term 9 FOLLOWER]: Leader election lost for term 8. Reason: Vote denied by peer e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891) with higher term. Message: Invalid argument: T f93ee515a9c14139bf566522ed8232f3 P e61c3a8f61bb48f8a963c9480e53c168 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 0473d2b2d01f4459b1e90fd12cc7840e for earlier term 8. Current term is 9.
I20260709 13:05:23.875555 19411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f85fc4b527a48848e5faa083b604e36" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
I20260709 13:05:23.888912 22225 raft_consensus.cc:2749] T ef32ce6fdd0e40d382c79974f30295c6 P e61c3a8f61bb48f8a963c9480e53c168 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:05:23.892557 19557 raft_consensus.cc:3060] T 2725d2c4cb054f18b0fc8f735c15f6c2 P e61c3a8f61bb48f8a963c9480e53c168 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:05:23.864912 22089 raft_consensus.cc:515] T 22196caba61445d3bec98a0aab3c337d P e61c3a8f61bb48f8a963c9480e53c168 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:23.893555 19523 leader_election.cc:304] T d1e5873a19244c5ebbcd38e126796ee7 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e61c3a8f61bb48f8a963c9480e53c168; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:05:23.896858 19523 leader_election.cc:304] T 7be9efa6559648dbb5a0f7684c4542d1 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:05:23.898190 21529 raft_consensus.cc:2749] T d1e5873a19244c5ebbcd38e126796ee7 P e61c3a8f61bb48f8a963c9480e53c168 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:05:23.898363 19523 leader_election.cc:304] T 3e1f505cb0f1427bbd698ac889d80821 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e61c3a8f61bb48f8a963c9480e53c168; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:05:23.899044 21529 consensus_queue.cc:1059] T edd7d470b5014c9489be7f41f64355c9 P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:05:23.864845 21790 leader_election.cc:290] T 775c229504194560ba9589bc2199b089 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 5 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:05:23.900611 21529 raft_consensus.cc:2804] T 7be9efa6559648dbb5a0f7684c4542d1 P e61c3a8f61bb48f8a963c9480e53c168 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:05:23.901257 22150 raft_consensus.cc:2749] T 3e1f505cb0f1427bbd698ac889d80821 P e61c3a8f61bb48f8a963c9480e53c168 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:05:23.899257 19556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28af091831594f9d8e96482078cc7625" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:05:23.867728 22041 raft_consensus.cc:515] T 14935b3ddf914369822e4a0547aaa355 P 127766fc592545a4997f7790f50f6076 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } attrs { replace: true } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:05:23.909228 22223 raft_consensus.cc:2749] T f1b10566f45d4a7d9029858330e02d5b P e61c3a8f61bb48f8a963c9480e53c168 [term 8 FOLLOWER]: Leader election lost for term 7. Reason: Vote denied by peer e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321) with higher term. Message: Invalid argument: T f1b10566f45d4a7d9029858330e02d5b P e5256d91808b47c195bc9b4dbd7f2b87 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate e61c3a8f61bb48f8a963c9480e53c168 for earlier term 7. Current term is 8.
I20260709 13:05:23.863466 21957 raft_consensus.cc:515] T 40e1e16737a842ee936002830f36882e P e5256d91808b47c195bc9b4dbd7f2b87 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:23.916296 22007 raft_consensus.cc:515] T 172b3dd13109415a955b71ac0e9d2234 P 0473d2b2d01f4459b1e90fd12cc7840e [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:05:23.917346 19486 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58294 (request call id 1722) took 1596 ms. Trace:
W20260709 13:05:23.917734 22064 consensus_meta.cc:287] T fa731b585f684a7fb2d106c50f143b83 P e5256d91808b47c195bc9b4dbd7f2b87: Time spent flushing consensus metadata: real 0.564s	user 0.005s	sys 0.012s
I20260709 13:05:23.918901 19402 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49050 (request call id 344) took 1074 ms. Trace:
W20260709 13:05:23.919493 19377 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:23.919399 19402 rpcz_store.cc:276] 0709 13:05:22.816530 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:22.879404 (+ 62874us) service_pool.cc:224] Handling call
0709 13:05:22.879666 (+   262us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:22.969965 (+ 90299us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:05:22.970007 (+    42us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:05:22.970060 (+    53us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:05:22.970112 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:23.860281 (+890169us) spinlock_profiling.cc:243] Waited 90 ms on lock 0x7b540019f854. stack: 00007f4a79de9343 00007f4a79de9240 00007f4a797781d4 00007f4a834b6304 00007f4a834b6299 00007f4a7ce71571 00007f4a7cf08e01 00007f4a7cf0783e 00007f4a81ecc419 00007f4a7b443bd4 00007f4a7b443b62 00007f4a7b443a91 00007f4a7b443a0c 00007f4a7b442cc2 00007f4a7b24348c 00007f4a7b2428c6
0709 13:05:23.863839 (+  3558us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:23.890801 (+ 26962us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":207075072}
I20260709 13:05:23.922523 22144 leader_election.cc:290] T b9f0d59553ad444883fcf5b5909f9798 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 7 election: Requested vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:05:23.925017 21957 leader_election.cc:290] T 40e1e16737a842ee936002830f36882e P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 8 election: Requested vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
W20260709 13:05:23.930270 20108 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35874 (request call id 516) took 1710 ms (client timeout 1559 ms). Trace:
I20260709 13:05:23.901880 22053 raft_consensus.cc:3055] T edd7d470b5014c9489be7f41f64355c9 P e61c3a8f61bb48f8a963c9480e53c168 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:05:23.919191 19450 leader_election.cc:304] T 48824d5acfbc485ebf8c2d944e7202de P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:05:23.936669 19554 raft_consensus.cc:2468] T 2e36a9d6e29c4a7c860cf267efbd4c74 P e61c3a8f61bb48f8a963c9480e53c168 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 6.
I20260709 13:05:23.939399 19409 raft_consensus.cc:1240] T 40e1e16737a842ee936002830f36882e P e5256d91808b47c195bc9b4dbd7f2b87 [term 8 FOLLOWER]: Rejecting Update request from peer e61c3a8f61bb48f8a963c9480e53c168 for earlier term 7. Current term is 8. Ops: []
I20260709 13:05:23.904596 21529 raft_consensus.cc:697] T 7be9efa6559648dbb5a0f7684c4542d1 P e61c3a8f61bb48f8a963c9480e53c168 [term 7 LEADER]: Becoming Leader. State: Replica: e61c3a8f61bb48f8a963c9480e53c168, State: Running, Role: LEADER
I20260709 13:05:23.917776 19486 rpcz_store.cc:276] 0709 13:05:22.320629 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:22.679125 (+358496us) service_pool.cc:224] Handling call
0709 13:05:22.930797 (+251672us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:22.931665 (+   868us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:23.916904 (+985239us) spinlock_profiling.cc:243] Waited 251 ms on lock 0x7b540035cad0. stack: 00007f4a79de9343 00007f4a79de9240 00007f4a797781d4 00007f4a834b6304 00007f4a834b6299 00007f4a7ce71571 00007f4a7cf078ad 00007f4a81ecc419 00007f4a7b443bd4 00007f4a7b443b62 00007f4a7b443a91 00007f4a7b443a0c 00007f4a7b442cc2 00007f4a7b24348c 00007f4a7b2428c6 00007f4a7b24226f
0709 13:05:23.917138 (+   234us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":578158464}
W20260709 13:05:23.930903 20108 rpcz_store.cc:269] 0709 13:05:22.220031 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:22.221056 (+  1025us) service_pool.cc:224] Handling call
0709 13:05:23.929753 (+1708697us) spinlock_profiling.cc:243] Waited 473 ms on lock 0x7b54002468d4. stack: 00007f4a79de9343 00007f4a79de9240 00007f4a797781d4 00007f4a834b6304 00007f4a834b6299 00007f4a7ce71571 00007f4a7cf0c2fa 00007f4a81ecdb17 00007f4a7b4486d4 00007f4a7b448662 00007f4a7b448591 00007f4a7b44850c 00007f4a7b4477c2 00007f4a7b24348c 00007f4a7b2428c6 00007f4a7b24226f
0709 13:05:23.930001 (+   248us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1087128960}
I20260709 13:05:23.946409 22185 raft_consensus.cc:2749] T 2b74109013a140ada21feeef92d6f563 P e61c3a8f61bb48f8a963c9480e53c168 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
W20260709 13:05:23.948268 22140 consensus_meta.cc:287] T 2e36a9d6e29c4a7c860cf267efbd4c74 P 0473d2b2d01f4459b1e90fd12cc7840e: Time spent flushing consensus metadata: real 0.946s	user 0.003s	sys 0.012s
W20260709 13:05:23.953514 19524 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:23.954839 19556 raft_consensus.cc:2468] T 28af091831594f9d8e96482078cc7625 P e61c3a8f61bb48f8a963c9480e53c168 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 6.
I20260709 13:05:23.935107 22053 raft_consensus.cc:740] T edd7d470b5014c9489be7f41f64355c9 P e61c3a8f61bb48f8a963c9480e53c168 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: e61c3a8f61bb48f8a963c9480e53c168, State: Running, Role: LEADER
W20260709 13:05:23.955389 19450 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.3:36891, user_credentials={real_user=slave}} blocked reactor thread for 50325.4us
I20260709 13:05:23.955526 21790 raft_consensus.cc:2804] T 48824d5acfbc485ebf8c2d944e7202de P 0473d2b2d01f4459b1e90fd12cc7840e [term 6 FOLLOWER]: Leader election won for term 6
W20260709 13:05:23.956156 19377 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:23.952836 22195 raft_consensus.cc:515] T 0cdf56e38bbc453d9438d359e5a69955 P e5256d91808b47c195bc9b4dbd7f2b87 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:23.918286 22064 raft_consensus.cc:515] T fa731b585f684a7fb2d106c50f143b83 P e5256d91808b47c195bc9b4dbd7f2b87 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
W20260709 13:05:23.972970 19375 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:23.978611 21790 raft_consensus.cc:697] T 48824d5acfbc485ebf8c2d944e7202de P 0473d2b2d01f4459b1e90fd12cc7840e [term 6 LEADER]: Becoming Leader. State: Replica: 0473d2b2d01f4459b1e90fd12cc7840e, State: Running, Role: LEADER
I20260709 13:05:23.979439 22053 consensus_queue.cc:260] T edd7d470b5014c9489be7f41f64355c9 P e61c3a8f61bb48f8a963c9480e53c168 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:23.980108 21790 consensus_queue.cc:237] T 48824d5acfbc485ebf8c2d944e7202de P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:05:23.981201 22053 raft_consensus.cc:3060] T edd7d470b5014c9489be7f41f64355c9 P e61c3a8f61bb48f8a963c9480e53c168 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:05:23.982944 22140 raft_consensus.cc:515] T 2e36a9d6e29c4a7c860cf267efbd4c74 P 0473d2b2d01f4459b1e90fd12cc7840e [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:23.983660 19560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9f0d59553ad444883fcf5b5909f9798" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:05:23.981129 19375 leader_election.cc:304] T 2e36a9d6e29c4a7c860cf267efbd4c74 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:05:23.985342 22140 leader_election.cc:290] T 2e36a9d6e29c4a7c860cf267efbd4c74 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 6 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:05:23.985646 21867 raft_consensus.cc:2804] T 2e36a9d6e29c4a7c860cf267efbd4c74 P e5256d91808b47c195bc9b4dbd7f2b87 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:05:23.940291 22144 raft_consensus.cc:493] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P e5256d91808b47c195bc9b4dbd7f2b87 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:23.942248 22007 leader_election.cc:290] T 172b3dd13109415a955b71ac0e9d2234 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 4 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:05:23.986858 22144 raft_consensus.cc:515] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P e5256d91808b47c195bc9b4dbd7f2b87 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:05:23.986281 19478 raft_consensus.cc:2368] T 2e36a9d6e29c4a7c860cf267efbd4c74 P 0473d2b2d01f4459b1e90fd12cc7840e [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e61c3a8f61bb48f8a963c9480e53c168 for earlier term 5. Current term is 6.
I20260709 13:05:23.985283 19552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40e1e16737a842ee936002830f36882e" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:05:23.986284 21867 raft_consensus.cc:697] T 2e36a9d6e29c4a7c860cf267efbd4c74 P e5256d91808b47c195bc9b4dbd7f2b87 [term 6 LEADER]: Becoming Leader. State: Replica: e5256d91808b47c195bc9b4dbd7f2b87, State: Running, Role: LEADER
I20260709 13:05:23.977892 19557 raft_consensus.cc:2468] T 2725d2c4cb054f18b0fc8f735c15f6c2 P e61c3a8f61bb48f8a963c9480e53c168 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 8.
I20260709 13:05:23.976908 22223 raft_consensus.cc:493] T 21e14947d70440f19044d8f75c31e1f9 P e61c3a8f61bb48f8a963c9480e53c168 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:24.000120 19375 leader_election.cc:304] T 28af091831594f9d8e96482078cc7625 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:05:23.999308 21529 consensus_queue.cc:237] T 7be9efa6559648dbb5a0f7684c4542d1 P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } attrs { replace: true } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: NON_VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: true } }
I20260709 13:05:24.003587 19450 leader_election.cc:400] T ef32ce6fdd0e40d382c79974f30295c6 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 6 election: Vote denied by peer e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891) with higher term. Message: Invalid argument: T ef32ce6fdd0e40d382c79974f30295c6 P e61c3a8f61bb48f8a963c9480e53c168 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 0473d2b2d01f4459b1e90fd12cc7840e for earlier term 6. Current term is 7.
I20260709 13:05:24.030071 19450 leader_election.cc:403] T ef32ce6fdd0e40d382c79974f30295c6 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 6 election: Cancelling election due to peer responding with higher term
I20260709 13:05:24.004947 22199 raft_consensus.cc:515] T ff75a1d4cb1f493db8f71ddc136ba9ab P e61c3a8f61bb48f8a963c9480e53c168 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:23.976279 22041 leader_election.cc:290] T 14935b3ddf914369822e4a0547aaa355 P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 6 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
W20260709 13:05:24.009150 20077 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:05:24.009867 22166 consensus_meta.cc:287] T a08760e15aac4630a629431f56024dc8 P e5256d91808b47c195bc9b4dbd7f2b87: Time spent flushing consensus metadata: real 1.149s	user 0.018s	sys 0.000s
I20260709 13:05:24.009991 21926 leader_election.cc:290] T 14935b3ddf914369822e4a0547aaa355 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:05:24.030966 22223 raft_consensus.cc:515] T 21e14947d70440f19044d8f75c31e1f9 P e61c3a8f61bb48f8a963c9480e53c168 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:24.034207 19551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48824d5acfbc485ebf8c2d944e7202de" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:05:24.033785 21867 consensus_queue.cc:237] T 2e36a9d6e29c4a7c860cf267efbd4c74 P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:24.045768 21958 raft_consensus.cc:515] T b08304a0a02b42d7840c4e8ee9a6bd1a P e5256d91808b47c195bc9b4dbd7f2b87 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:24.040647 19450 leader_election.cc:400] T 3e1f505cb0f1427bbd698ac889d80821 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 5 election: Vote denied by peer e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891) with higher term. Message: Invalid argument: T 3e1f505cb0f1427bbd698ac889d80821 P e61c3a8f61bb48f8a963c9480e53c168 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 0473d2b2d01f4459b1e90fd12cc7840e for earlier term 5. Current term is 6.
I20260709 13:05:24.042665 21932 raft_consensus.cc:2749] T ef32ce6fdd0e40d382c79974f30295c6 P 0473d2b2d01f4459b1e90fd12cc7840e [term 7 FOLLOWER]: Leader election lost for term 6. Reason: Vote denied by peer e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891) with higher term. Message: Invalid argument: T ef32ce6fdd0e40d382c79974f30295c6 P e61c3a8f61bb48f8a963c9480e53c168 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 0473d2b2d01f4459b1e90fd12cc7840e for earlier term 6. Current term is 7.
I20260709 13:05:24.036571 22199 leader_election.cc:290] T ff75a1d4cb1f493db8f71ddc136ba9ab P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 6 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:05:24.047474 19450 leader_election.cc:403] T 3e1f505cb0f1427bbd698ac889d80821 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 5 election: Cancelling election due to peer responding with higher term
I20260709 13:05:24.026811 22185 raft_consensus.cc:493] T 0afb57ae58a24a01850491d69f0213dd P e61c3a8f61bb48f8a963c9480e53c168 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:24.045902 20104 raft_consensus.cc:1275] T 65d8cb8d6ec64f459d5a47cefab10acf P 127766fc592545a4997f7790f50f6076 [term 4 FOLLOWER]: Refusing update from remote peer e5256d91808b47c195bc9b4dbd7f2b87: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
I20260709 13:05:24.063297 19404 raft_consensus.cc:1240] T fa731b585f684a7fb2d106c50f143b83 P e5256d91808b47c195bc9b4dbd7f2b87 [term 5 FOLLOWER]: Rejecting Update request from peer 127766fc592545a4997f7790f50f6076 for earlier term 4. Current term is 5. Ops: []
I20260709 13:05:24.064958 21932 raft_consensus.cc:2749] T 3e1f505cb0f1427bbd698ac889d80821 P 0473d2b2d01f4459b1e90fd12cc7840e [term 6 FOLLOWER]: Leader election lost for term 5. Reason: Vote denied by peer e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891) with higher term. Message: Invalid argument: T 3e1f505cb0f1427bbd698ac889d80821 P e61c3a8f61bb48f8a963c9480e53c168 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 0473d2b2d01f4459b1e90fd12cc7840e for earlier term 5. Current term is 6.
I20260709 13:05:24.067838 20110 raft_consensus.cc:1240] T 1f85fc4b527a48848e5faa083b604e36 P 127766fc592545a4997f7790f50f6076 [term 5 FOLLOWER]: Rejecting Update request from peer e5256d91808b47c195bc9b4dbd7f2b87 for earlier term 4. Current term is 5. Ops: []
I20260709 13:05:24.057576 22049 raft_consensus.cc:2804] T 28af091831594f9d8e96482078cc7625 P e5256d91808b47c195bc9b4dbd7f2b87 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:05:24.069608 22049 raft_consensus.cc:493] T 28af091831594f9d8e96482078cc7625 P e5256d91808b47c195bc9b4dbd7f2b87 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 0473d2b2d01f4459b1e90fd12cc7840e)
I20260709 13:05:24.069793 19551 raft_consensus.cc:2393] T 48824d5acfbc485ebf8c2d944e7202de P e61c3a8f61bb48f8a963c9480e53c168 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 127766fc592545a4997f7790f50f6076 in current term 6: Already voted for candidate 0473d2b2d01f4459b1e90fd12cc7840e in this term.
I20260709 13:05:24.070045 22049 raft_consensus.cc:3060] T 28af091831594f9d8e96482078cc7625 P e5256d91808b47c195bc9b4dbd7f2b87 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:05:24.072418 19377 leader_election.cc:304] T 217b5fae677b4971b3bbd2f357a1f7ff P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:05:24.072588 19403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cdf56e38bbc453d9438d359e5a69955" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:05:24.113720 19552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14935b3ddf914369822e4a0547aaa355" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:05:24.128310 19403 raft_consensus.cc:2393] T 0cdf56e38bbc453d9438d359e5a69955 P e5256d91808b47c195bc9b4dbd7f2b87 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e61c3a8f61bb48f8a963c9480e53c168 in current term 9: Already voted for candidate e5256d91808b47c195bc9b4dbd7f2b87 in this term.
I20260709 13:05:24.075995 19402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a16f7501e2444fb86d4e2778e734e02" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:05:24.147136 19485 raft_consensus.cc:2468] T f93ee515a9c14139bf566522ed8232f3 P 0473d2b2d01f4459b1e90fd12cc7840e [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 9.
I20260709 13:05:24.115677 22185 raft_consensus.cc:515] T 0afb57ae58a24a01850491d69f0213dd P e61c3a8f61bb48f8a963c9480e53c168 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:05:24.144610 20103 raft_consensus.cc:2468] T 62c6c134d3d24a1ab144dd9ee6bc3f64 P 127766fc592545a4997f7790f50f6076 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 8.
I20260709 13:05:24.089778 22223 leader_election.cc:290] T 21e14947d70440f19044d8f75c31e1f9 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:05:24.057443 22166 raft_consensus.cc:515] T a08760e15aac4630a629431f56024dc8 P e5256d91808b47c195bc9b4dbd7f2b87 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:24.161450 19403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a61655d99124a29b486ba4a5b37faea" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
I20260709 13:05:24.161916 20106 raft_consensus.cc:1275] T 85c494af21f9457a85da47b9bc70c1fd P 127766fc592545a4997f7790f50f6076 [term 4 FOLLOWER]: Refusing update from remote peer e5256d91808b47c195bc9b4dbd7f2b87: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
I20260709 13:05:24.162504 19403 raft_consensus.cc:2393] T 1a61655d99124a29b486ba4a5b37faea P e5256d91808b47c195bc9b4dbd7f2b87 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate e61c3a8f61bb48f8a963c9480e53c168 in current term 4: Already voted for candidate e5256d91808b47c195bc9b4dbd7f2b87 in this term.
I20260709 13:05:24.159103 19552 raft_consensus.cc:2468] T 14935b3ddf914369822e4a0547aaa355 P e61c3a8f61bb48f8a963c9480e53c168 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 5.
I20260709 13:05:24.178853 19405 raft_consensus.cc:606] T a08760e15aac4630a629431f56024dc8 P e5256d91808b47c195bc9b4dbd7f2b87 [term 7 FOLLOWER]: Received request to transfer leadership to TS e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:05:24.179531 19405 raft_consensus.cc:614] T a08760e15aac4630a629431f56024dc8 P e5256d91808b47c195bc9b4dbd7f2b87 [term 7 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:05:24.180573 19408 raft_consensus.cc:1240] T a08760e15aac4630a629431f56024dc8 P e5256d91808b47c195bc9b4dbd7f2b87 [term 7 FOLLOWER]: Rejecting Update request from peer e61c3a8f61bb48f8a963c9480e53c168 for earlier term 6. Current term is 7. Ops: []
W20260709 13:05:24.182821 19377 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.2:46257, user_credentials={real_user=slave}} blocked reactor thread for 110544us
W20260709 13:05:24.185407 19377 leader_election.cc:336] T f1b10566f45d4a7d9029858330e02d5b P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257): Timed out: RequestConsensusVote RPC to 127.17.223.2:46257 timed out after 2.336s (SENT)
I20260709 13:05:24.186641 21962 raft_consensus.cc:2749] T 217b5fae677b4971b3bbd2f357a1f7ff P e5256d91808b47c195bc9b4dbd7f2b87 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:05:24.186972 22219 consensus_queue.cc:1059] T b9f0d59553ad444883fcf5b5909f9798 P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:05:24.188185 22219 raft_consensus.cc:3055] T b9f0d59553ad444883fcf5b5909f9798 P e61c3a8f61bb48f8a963c9480e53c168 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:05:24.188587 22219 raft_consensus.cc:740] T b9f0d59553ad444883fcf5b5909f9798 P e61c3a8f61bb48f8a963c9480e53c168 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: e61c3a8f61bb48f8a963c9480e53c168, State: Running, Role: LEADER
I20260709 13:05:24.199692 19402 raft_consensus.cc:2410] T 2a16f7501e2444fb86d4e2778e734e02 P e5256d91808b47c195bc9b4dbd7f2b87 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e61c3a8f61bb48f8a963c9480e53c168 for term 8 because replica has last-logged OpId of term: 7 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 6.
I20260709 13:05:24.194345 20110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa731b585f684a7fb2d106c50f143b83" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076"
I20260709 13:05:24.202260 22195 leader_election.cc:290] T 0cdf56e38bbc453d9438d359e5a69955 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 9 election: Requested vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:05:24.213550 20106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e1085d23e8347fbbd5bce7542f4b1f4" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:05:24.229467 19402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21e14947d70440f19044d8f75c31e1f9" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:05:24.236547 20110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a16f7501e2444fb86d4e2778e734e02" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:05:24.224434 20104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed7fdbcb96d14d418db9ca90a792588a" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076"
I20260709 13:05:24.238147 20104 raft_consensus.cc:3060] T ed7fdbcb96d14d418db9ca90a792588a P 127766fc592545a4997f7790f50f6076 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:05:24.239146 22237 log.cc:927] Time spent T 48824d5acfbc485ebf8c2d944e7202de P 0473d2b2d01f4459b1e90fd12cc7840e: Append to log took a long time: real 0.088s	user 0.001s	sys 0.000s
I20260709 13:05:24.247830 19526 leader_election.cc:304] T 1dc5b3532fe54f74876d02beffa2c230 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e61c3a8f61bb48f8a963c9480e53c168; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:05:24.248924 21529 raft_consensus.cc:2749] T 1dc5b3532fe54f74876d02beffa2c230 P e61c3a8f61bb48f8a963c9480e53c168 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:05:24.249511 19526 leader_election.cc:304] T df751f992649444090e27965eb1af85d P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e61c3a8f61bb48f8a963c9480e53c168; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:05:24.250319 21529 raft_consensus.cc:2749] T df751f992649444090e27965eb1af85d P e61c3a8f61bb48f8a963c9480e53c168 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
W20260709 13:05:24.259322 22241 log.cc:927] Time spent T 2e36a9d6e29c4a7c860cf267efbd4c74 P e5256d91808b47c195bc9b4dbd7f2b87: Append to log took a long time: real 0.050s	user 0.000s	sys 0.001s
I20260709 13:05:24.263945 20112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "775c229504194560ba9589bc2199b089" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076"
I20260709 13:05:24.264961 19411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22196caba61445d3bec98a0aab3c337d" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
I20260709 13:05:24.265897 19411 raft_consensus.cc:2393] T 22196caba61445d3bec98a0aab3c337d P e5256d91808b47c195bc9b4dbd7f2b87 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate e61c3a8f61bb48f8a963c9480e53c168 in current term 6: Already voted for candidate e5256d91808b47c195bc9b4dbd7f2b87 in this term.
I20260709 13:05:24.266772 20112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "172b3dd13109415a955b71ac0e9d2234" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076"
I20260709 13:05:24.271026 19526 leader_election.cc:400] T f1b10566f45d4a7d9029858330e02d5b P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 7 election: Vote denied by peer 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257) with higher term. Message: Invalid argument: T f1b10566f45d4a7d9029858330e02d5b P 0473d2b2d01f4459b1e90fd12cc7840e [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate e61c3a8f61bb48f8a963c9480e53c168 for earlier term 7. Current term is 8.
I20260709 13:05:24.271744 19411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "179fd671030940b4b4a4e24bcc4aba0a" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:05:24.228994 22144 leader_election.cc:290] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:05:24.189649 22219 consensus_queue.cc:260] T b9f0d59553ad444883fcf5b5909f9798 P e61c3a8f61bb48f8a963c9480e53c168 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:24.277532 20110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "309c3ca0ca4b4f3ba129752ea2cb293b" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:05:24.283627 21559 raft_consensus.cc:3055] T 65d8cb8d6ec64f459d5a47cefab10acf P e61c3a8f61bb48f8a963c9480e53c168 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:05:24.284210 21559 raft_consensus.cc:740] T 65d8cb8d6ec64f459d5a47cefab10acf P e61c3a8f61bb48f8a963c9480e53c168 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: e61c3a8f61bb48f8a963c9480e53c168, State: Running, Role: LEADER
I20260709 13:05:24.283701 19554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e1085d23e8347fbbd5bce7542f4b1f4" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:05:24.296000 19411 raft_consensus.cc:2393] T 179fd671030940b4b4a4e24bcc4aba0a P e5256d91808b47c195bc9b4dbd7f2b87 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e61c3a8f61bb48f8a963c9480e53c168 in current term 6: Already voted for candidate e5256d91808b47c195bc9b4dbd7f2b87 in this term.
I20260709 13:05:24.296196 20107 raft_consensus.cc:1240] T 65d8cb8d6ec64f459d5a47cefab10acf P 127766fc592545a4997f7790f50f6076 [term 4 FOLLOWER]: Rejecting Update request from peer e61c3a8f61bb48f8a963c9480e53c168 for earlier term 3. Current term is 4. Ops: [3.5-3.5]
I20260709 13:05:24.297420 19411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff75a1d4cb1f493db8f71ddc136ba9ab" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
I20260709 13:05:24.304925 19402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14935b3ddf914369822e4a0547aaa355" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
W20260709 13:05:24.279503 22063 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.377s	user 0.031s	sys 0.027s
I20260709 13:05:24.285385 21559 consensus_queue.cc:260] T 65d8cb8d6ec64f459d5a47cefab10acf P e61c3a8f61bb48f8a963c9480e53c168 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:05:24.335119 19411 raft_consensus.cc:3060] T ff75a1d4cb1f493db8f71ddc136ba9ab P e5256d91808b47c195bc9b4dbd7f2b87 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:05:24.338896 20104 raft_consensus.cc:2468] T ed7fdbcb96d14d418db9ca90a792588a P 127766fc592545a4997f7790f50f6076 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 4.
I20260709 13:05:24.332423 19523 leader_election.cc:304] T fa731b585f684a7fb2d106c50f143b83 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e61c3a8f61bb48f8a963c9480e53c168; no voters: 127766fc592545a4997f7790f50f6076, e5256d91808b47c195bc9b4dbd7f2b87
W20260709 13:05:24.317379 22063 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.496s	user 0.031s	sys 0.027s
I20260709 13:05:24.354983 21559 raft_consensus.cc:3060] T 65d8cb8d6ec64f459d5a47cefab10acf P e61c3a8f61bb48f8a963c9480e53c168 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:05:24.355080 19402 raft_consensus.cc:3060] T 14935b3ddf914369822e4a0547aaa355 P e5256d91808b47c195bc9b4dbd7f2b87 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:05:24.384426 20075 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.1:40321, user_credentials={real_user=slave}} blocked reactor thread for 66009.9us
I20260709 13:05:24.389276 19411 raft_consensus.cc:2468] T ff75a1d4cb1f493db8f71ddc136ba9ab P e5256d91808b47c195bc9b4dbd7f2b87 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 6.
W20260709 13:05:24.409533 19451 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:05:24.414209 19526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.2:46257, user_credentials={real_user=slave}} blocked reactor thread for 163597us
I20260709 13:05:24.417673 20104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14935b3ddf914369822e4a0547aaa355" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:05:24.418629 20104 raft_consensus.cc:2393] T 14935b3ddf914369822e4a0547aaa355 P 127766fc592545a4997f7790f50f6076 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e5256d91808b47c195bc9b4dbd7f2b87 in current term 6: Already voted for candidate 127766fc592545a4997f7790f50f6076 in this term.
I20260709 13:05:24.421972 19478 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58286 (request call id 1575) took 1155 ms. Trace:
W20260709 13:05:24.421180 19526 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.17.223.2:46257 timed out after 2.095s (SENT) [suppressed 31 similar messages]
I20260709 13:05:24.424448 22056 raft_consensus.cc:493] T 172b3dd13109415a955b71ac0e9d2234 P 127766fc592545a4997f7790f50f6076 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader e5256d91808b47c195bc9b4dbd7f2b87)
I20260709 13:05:24.425052 22056 raft_consensus.cc:515] T 172b3dd13109415a955b71ac0e9d2234 P 127766fc592545a4997f7790f50f6076 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:05:24.426496 20110 raft_consensus.cc:1275] T ece3db938bc649d4a40a51522ed5259c P 127766fc592545a4997f7790f50f6076 [term 6 FOLLOWER]: Refusing update from remote peer e5256d91808b47c195bc9b4dbd7f2b87: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:05:24.427579 21790 raft_consensus.cc:493] T 76cb037fc9064d13b59a8969d897ce8c P 0473d2b2d01f4459b1e90fd12cc7840e [term 7 FOLLOWER]: Starting pre-election (detected failure of leader e5256d91808b47c195bc9b4dbd7f2b87)
W20260709 13:05:24.428401 22027 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 4 current term: 4 is higher.
I20260709 13:05:24.428146 21790 raft_consensus.cc:515] T 76cb037fc9064d13b59a8969d897ce8c P 0473d2b2d01f4459b1e90fd12cc7840e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:24.430254 21790 leader_election.cc:290] T 76cb037fc9064d13b59a8969d897ce8c P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:05:24.430469 19403 raft_consensus.cc:1275] T 5ec1c4ce15e04c7e8c283a62179f2a64 P e5256d91808b47c195bc9b4dbd7f2b87 [term 5 FOLLOWER]: Refusing update from remote peer 127766fc592545a4997f7790f50f6076: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:05:24.431315 19411 raft_consensus.cc:1275] T 833a2f0775ed407a94b8924ce50adb63 P e5256d91808b47c195bc9b4dbd7f2b87 [term 6 FOLLOWER]: Refusing update from remote peer 127766fc592545a4997f7790f50f6076: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:05:24.431818 19403 raft_consensus.cc:1275] T 7f575b143b844aa096b50997dad3516a P e5256d91808b47c195bc9b4dbd7f2b87 [term 3 FOLLOWER]: Refusing update from remote peer e61c3a8f61bb48f8a963c9480e53c168: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:05:24.416157 21529 raft_consensus.cc:2749] T fa731b585f684a7fb2d106c50f143b83 P e61c3a8f61bb48f8a963c9480e53c168 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:05:24.423048 19478 rpcz_store.cc:276] 0709 13:05:23.236316 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:23.304898 (+ 68582us) service_pool.cc:224] Handling call
0709 13:05:24.385000 (+1080102us) spinlock_profiling.cc:243] Waited 645 ms on lock 0x7b5400222754. stack: 00007f4a79de9343 00007f4a79de9240 00007f4a797781d4 00007f4a834b6304 00007f4a834b6299 00007f4a7ce71571 00007f4a7cf0c2fa 00007f4a81ecdb17 00007f4a7b4486d4 00007f4a7b448662 00007f4a7b448591 00007f4a7b44850c 00007f4a7b4477c2 00007f4a7b24348c 00007f4a7b2428c6 00007f4a7b24226f
0709 13:05:24.391943 (+  6943us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1483443072}
I20260709 13:05:24.416635 22166 leader_election.cc:290] T a08760e15aac4630a629431f56024dc8 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 7 election: Requested vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:05:24.415881 22185 leader_election.cc:290] T 0afb57ae58a24a01850491d69f0213dd P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:05:24.433823 20107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36f6ba92b9ba46babe4ebd6c02e5fbd9" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:05:24.440449 20106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "833a2f0775ed407a94b8924ce50adb63" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076"
I20260709 13:05:24.442279 22111 raft_consensus.cc:493] T 14efcc79969f41babe5529c22d59156d P 127766fc592545a4997f7790f50f6076 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader e5256d91808b47c195bc9b4dbd7f2b87)
I20260709 13:05:24.449707 22111 raft_consensus.cc:515] T 14efcc79969f41babe5529c22d59156d P 127766fc592545a4997f7790f50f6076 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
W20260709 13:05:24.442945 19374 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.4:43121, user_credentials={real_user=slave}} blocked reactor thread for 45474.5us
I20260709 13:05:24.452221 19374 leader_election.cc:304] T 833a2f0775ed407a94b8924ce50adb63 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87; no voters: 127766fc592545a4997f7790f50f6076, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:05:24.443908 22056 leader_election.cc:290] T 172b3dd13109415a955b71ac0e9d2234 P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:05:24.418144 22182 raft_consensus.cc:493] T 6c5eebf646ad445a9d1b1adc319d7b16 P 0473d2b2d01f4459b1e90fd12cc7840e [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 127766fc592545a4997f7790f50f6076)
I20260709 13:05:24.468529 22182 raft_consensus.cc:515] T 6c5eebf646ad445a9d1b1adc319d7b16 P 0473d2b2d01f4459b1e90fd12cc7840e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:05:24.470112 19404 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49050 (request call id 351) took 1081 ms. Trace:
I20260709 13:05:24.422145 21932 raft_consensus.cc:493] T 1efebf73c86e432baa55533136b6e12c P 0473d2b2d01f4459b1e90fd12cc7840e [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 127766fc592545a4997f7790f50f6076)
I20260709 13:05:24.471043 21932 raft_consensus.cc:515] T 1efebf73c86e432baa55533136b6e12c P 0473d2b2d01f4459b1e90fd12cc7840e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:05:24.473492 21932 leader_election.cc:290] T 1efebf73c86e432baa55533136b6e12c P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:05:24.432046 22219 raft_consensus.cc:3060] T b9f0d59553ad444883fcf5b5909f9798 P e61c3a8f61bb48f8a963c9480e53c168 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:05:24.476263 19375 leader_election.cc:304] T 2725d2c4cb054f18b0fc8f735c15f6c2 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:05:24.478372 22146 raft_consensus.cc:2804] T 2725d2c4cb054f18b0fc8f735c15f6c2 P e5256d91808b47c195bc9b4dbd7f2b87 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:05:24.478929 22146 raft_consensus.cc:697] T 2725d2c4cb054f18b0fc8f735c15f6c2 P e5256d91808b47c195bc9b4dbd7f2b87 [term 8 LEADER]: Becoming Leader. State: Replica: e5256d91808b47c195bc9b4dbd7f2b87, State: Running, Role: LEADER
I20260709 13:05:24.479027 19485 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58286 (request call id 1568) took 1254 ms. Trace:
I20260709 13:05:24.479431 19485 rpcz_store.cc:276] 0709 13:05:23.224458 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:23.402366 (+177908us) service_pool.cc:224] Handling call
0709 13:05:24.478831 (+1076465us) spinlock_profiling.cc:243] Waited 472 ms on lock 0x7b54000edb54. stack: 00007f4a79de9343 00007f4a79de9240 00007f4a797781d4 00007f4a834b6304 00007f4a834b6299 00007f4a7ce71571 00007f4a7cf0c2fa 00007f4a81ecdb17 00007f4a7b4486d4 00007f4a7b448662 00007f4a7b448591 00007f4a7b44850c 00007f4a7b4477c2 00007f4a7b24348c 00007f4a7b2428c6 00007f4a7b24226f
0709 13:05:24.478970 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1085619072}
I20260709 13:05:24.479830 22146 consensus_queue.cc:237] T 2725d2c4cb054f18b0fc8f735c15f6c2 P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:24.480834 19408 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52328 (request call id 1598) took 1048 ms. Trace:
I20260709 13:05:24.481195 19408 rpcz_store.cc:276] 0709 13:05:23.432307 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:23.432427 (+   120us) service_pool.cc:224] Handling call
0709 13:05:23.432693 (+   266us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:24.181109 (+748416us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:24.480520 (+299411us) spinlock_profiling.cc:243] Waited 747 ms on lock 0x7b5400183654. stack: 00007f4a79de9343 00007f4a79de9240 00007f4a797781d4 00007f4a834b6304 00007f4a834b6299 00007f4a7ce71571 00007f4a7cf08e01 00007f4a7cf0783e 00007f4a81ecc419 00007f4a7b443bd4 00007f4a7b443b62 00007f4a7b443a91 00007f4a7b443a0c 00007f4a7b442cc2 00007f4a7b24348c 00007f4a7b2428c6
0709 13:05:24.480771 (+   251us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1718779776}
W20260709 13:05:24.483043 19523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.4:43121, user_credentials={real_user=slave}} blocked reactor thread for 150754us
W20260709 13:05:24.484581 19523 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:24.484814 22064 leader_election.cc:290] T fa731b585f684a7fb2d106c50f143b83 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 5 election: Requested vote from peers e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:05:24.486078 19523 leader_election.cc:304] T ed7fdbcb96d14d418db9ca90a792588a P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 127766fc592545a4997f7790f50f6076, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:05:24.487747 19405 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.LeaderStepDown from 127.0.0.1:37312 (request call id 38) took 1083 ms. Trace:
I20260709 13:05:24.458906 22089 leader_election.cc:290] T 22196caba61445d3bec98a0aab3c337d P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 6 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:05:24.460423 19484 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58286 (request call id 1555) took 1247 ms. Trace:
I20260709 13:05:24.461977 19409 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52328 (request call id 1600) took 1028 ms. Trace:
I20260709 13:05:24.456775 21957 consensus_queue.cc:1048] T ece3db938bc649d4a40a51522ed5259c P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Connected to new peer: Peer: permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:05:24.465065 21767 raft_consensus.cc:3060] T 96efeaaf1057492490e9a621f37e1a2d P 0473d2b2d01f4459b1e90fd12cc7840e [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:05:24.432821 22063 consensus_queue.cc:1048] T 65d8cb8d6ec64f459d5a47cefab10acf P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Connected to new peer: Peer: permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.035s
I20260709 13:05:24.418197 21849 consensus_queue.cc:1059] T 1f85fc4b527a48848e5faa083b604e36 P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.050s
I20260709 13:05:24.492707 21958 leader_election.cc:290] T b08304a0a02b42d7840c4e8ee9a6bd1a P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 8 election: Requested vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:05:24.493124 20107 raft_consensus.cc:2468] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P 127766fc592545a4997f7790f50f6076 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 8.
I20260709 13:05:24.495836 22049 raft_consensus.cc:515] T 28af091831594f9d8e96482078cc7625 P e5256d91808b47c195bc9b4dbd7f2b87 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
W20260709 13:05:24.500241 19293 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 309c3ca0ca4b4f3ba129752ea2cb293b with cas_config_opid_index 5: ChangeConfig:REMOVE_PEER failed with leader e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica e5256d91808b47c195bc9b4dbd7f2b87 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 6 leader_uuid: "e61c3a8f61bb48f8a963c9480e53c168" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } attrs { replace: true } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } } }
I20260709 13:05:24.542214 20110 raft_consensus.cc:1275] T 9962423cb4e54fcfa5de01daf68a86e7 P 127766fc592545a4997f7790f50f6076 [term 10 FOLLOWER]: Refusing update from remote peer e5256d91808b47c195bc9b4dbd7f2b87: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:05:24.503684 20103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0afb57ae58a24a01850491d69f0213dd" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:05:24.504390 21867 raft_consensus.cc:493] T 4509b76741dc428e9201c70c1658da13 P e5256d91808b47c195bc9b4dbd7f2b87 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e61c3a8f61bb48f8a963c9480e53c168)
I20260709 13:05:24.506065 19407 raft_consensus.cc:1240] T 85c494af21f9457a85da47b9bc70c1fd P e5256d91808b47c195bc9b4dbd7f2b87 [term 4 LEADER]: Rejecting Update request from peer e61c3a8f61bb48f8a963c9480e53c168 for earlier term 3. Current term is 4. Ops: []
I20260709 13:05:24.506515 19406 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52328 (request call id 1584) took 1718 ms. Trace:
I20260709 13:05:24.463944 22195 consensus_queue.cc:1048] T 85c494af21f9457a85da47b9bc70c1fd P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Connected to new peer: Peer: permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:05:24.512609 19402 raft_consensus.cc:2468] T 14935b3ddf914369822e4a0547aaa355 P e5256d91808b47c195bc9b4dbd7f2b87 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 127766fc592545a4997f7790f50f6076 in term 6.
I20260709 13:05:24.512245 19405 rpcz_store.cc:276] 0709 13:05:23.404143 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:23.404348 (+   205us) service_pool.cc:224] Handling call
0709 13:05:24.487520 (+1083172us) spinlock_profiling.cc:243] Waited 716 ms on lock 0x7b5400183654. stack: 00007f4a79de9343 00007f4a79de9240 00007f4a797781d4 00007f4a834b6304 00007f4a834b6299 00007f4a7ce71571 00007f4a7cf02853 00007f4a81ed060a 00007f4a7b4567d4 00007f4a7b456762 00007f4a7b456691 00007f4a7b45660c 00007f4a7b4558c2 00007f4a7b24348c 00007f4a7b2428c6 00007f4a7b24226f
0709 13:05:24.487644 (+   124us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1647174016}
W20260709 13:05:24.536269 19523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.4:43121, user_credentials={real_user=slave}} blocked reactor thread for 50244.8us
I20260709 13:05:24.518265 19409 rpcz_store.cc:276] 0709 13:05:23.433869 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:23.738621 (+304752us) service_pool.cc:224] Handling call
0709 13:05:23.739278 (+   657us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:23.939917 (+200639us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:24.461751 (+521834us) spinlock_profiling.cc:243] Waited 193 ms on lock 0x7b54000b31d4. stack: 00007f4a79de9343 00007f4a79de9240 00007f4a797781d4 00007f4a834b6304 00007f4a834b6299 00007f4a7ce71571 00007f4a7cf08e01 00007f4a7cf0783e 00007f4a81ecc419 00007f4a7b443bd4 00007f4a7b443b62 00007f4a7b443a91 00007f4a7b443a0c 00007f4a7b442cc2 00007f4a7b24348c 00007f4a7b2428c6
0709 13:05:24.461919 (+   168us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":442858240}
I20260709 13:05:24.518045 19484 rpcz_store.cc:276] 0709 13:05:23.213162 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:23.214620 (+  1458us) service_pool.cc:224] Handling call
0709 13:05:24.460052 (+1245432us) spinlock_profiling.cc:243] Waited 271 ms on lock 0x7b5400221854. stack: 00007f4a79de9343 00007f4a79de9240 00007f4a797781d4 00007f4a834b6304 00007f4a834b6299 00007f4a7ce71571 00007f4a7cf0c2fa 00007f4a81ecdb17 00007f4a7b4486d4 00007f4a7b448662 00007f4a7b448591 00007f4a7b44850c 00007f4a7b4477c2 00007f4a7b24348c 00007f4a7b2428c6 00007f4a7b24226f
0709 13:05:24.460241 (+   189us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":622936448}
I20260709 13:05:24.470482 19404 rpcz_store.cc:276] 0709 13:05:23.388911 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:23.389073 (+   162us) service_pool.cc:224] Handling call
0709 13:05:23.407165 (+ 18092us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:24.063777 (+656612us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:24.469810 (+406033us) spinlock_profiling.cc:243] Waited 630 ms on lock 0x7b540019fd54. stack: 00007f4a79de9343 00007f4a79de9240 00007f4a797781d4 00007f4a834b6304 00007f4a834b6299 00007f4a7ce71571 00007f4a7cf08e01 00007f4a7cf0783e 00007f4a81ecc419 00007f4a7b443bd4 00007f4a7b443b62 00007f4a7b443a91 00007f4a7b443a0c 00007f4a7b442cc2 00007f4a7b24348c 00007f4a7b2428c6
0709 13:05:24.470024 (+   214us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1448462592}
I20260709 13:05:24.544167 19406 rpcz_store.cc:276] 0709 13:05:22.788409 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:22.788607 (+   198us) service_pool.cc:224] Handling call
0709 13:05:22.808106 (+ 19499us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:05:23.314402 (+506296us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:24.506080 (+1191678us) spinlock_profiling.cc:243] Waited 483 ms on lock 0x7b540023ad54. stack: 00007f4a79de9343 00007f4a79de9240 00007f4a797781d4 00007f4a834b6304 00007f4a834b6299 00007f4a7ce71571 00007f4a7cf08e01 00007f4a7cf0783e 00007f4a81ecc419 00007f4a7b443bd4 00007f4a7b443b62 00007f4a7b443a91 00007f4a7b443a0c 00007f4a7b442cc2 00007f4a7b24348c 00007f4a7b2428c6
0709 13:05:24.506363 (+   283us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1110356352}
I20260709 13:05:24.547842 19407 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52328 (request call id 1597) took 1115 ms. Trace:
I20260709 13:05:24.548002 19560 raft_consensus.cc:1275] T f1b10566f45d4a7d9029858330e02d5b P e61c3a8f61bb48f8a963c9480e53c168 [term 8 FOLLOWER]: Refusing update from remote peer e5256d91808b47c195bc9b4dbd7f2b87: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 13:05:24.548202 19407 rpcz_store.cc:276] 0709 13:05:23.432018 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:23.432123 (+   105us) service_pool.cc:224] Handling call
0709 13:05:23.437328 (+  5205us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:24.505734 (+1068406us) spinlock_profiling.cc:243] Waited 2.27 ms on lock 0x7b5400276b20. stack: 00007f4a79de9343 00007f4a79de9240 00007f4a797781d4 00007f4a834b6304 00007f4a834b6299 00007f4a7ce71571 00007f4a7ce7fdc0 00007f4a7cf0a1c0 00007f4a7cf0b231 00007f4a7cf07d8f 00007f4a7cf0783e 00007f4a81ecc419 00007f4a7b443bd4 00007f4a7b443b62 00007f4a7b443a91 00007f4a7b443a0c
0709 13:05:24.547558 (+ 41824us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:24.547788 (+   230us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5233280}
I20260709 13:05:24.551107 19551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa731b585f684a7fb2d106c50f143b83" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:05:24.551230 21867 raft_consensus.cc:515] T 4509b76741dc428e9201c70c1658da13 P e5256d91808b47c195bc9b4dbd7f2b87 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:24.552055 19551 raft_consensus.cc:2393] T fa731b585f684a7fb2d106c50f143b83 P e61c3a8f61bb48f8a963c9480e53c168 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate e5256d91808b47c195bc9b4dbd7f2b87 in current term 5: Already voted for candidate e61c3a8f61bb48f8a963c9480e53c168 in this term.
I20260709 13:05:24.549539 19558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b08304a0a02b42d7840c4e8ee9a6bd1a" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:05:24.553527 19558 raft_consensus.cc:3060] T b08304a0a02b42d7840c4e8ee9a6bd1a P e61c3a8f61bb48f8a963c9480e53c168 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:05:24.559166 19555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cdf56e38bbc453d9438d359e5a69955" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:05:24.559514 19554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a08760e15aac4630a629431f56024dc8" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:05:24.559846 19555 raft_consensus.cc:3060] T 0cdf56e38bbc453d9438d359e5a69955 P e61c3a8f61bb48f8a963c9480e53c168 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:05:24.537953 22182 leader_election.cc:290] T 6c5eebf646ad445a9d1b1adc319d7b16 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:05:24.566280 21867 leader_election.cc:290] T 4509b76741dc428e9201c70c1658da13 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:05:24.567132 19484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "309c3ca0ca4b4f3ba129752ea2cb293b" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:05:24.561592 19523 leader_election.cc:304] T 2a16f7501e2444fb86d4e2778e734e02 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e61c3a8f61bb48f8a963c9480e53c168; no voters: 127766fc592545a4997f7790f50f6076, e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:05:24.559897 21976 raft_consensus.cc:2804] T ed7fdbcb96d14d418db9ca90a792588a P e61c3a8f61bb48f8a963c9480e53c168 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:05:24.569701 21976 raft_consensus.cc:697] T ed7fdbcb96d14d418db9ca90a792588a P e61c3a8f61bb48f8a963c9480e53c168 [term 4 LEADER]: Becoming Leader. State: Replica: e61c3a8f61bb48f8a963c9480e53c168, State: Running, Role: LEADER
I20260709 13:05:24.569881 22089 raft_consensus.cc:2749] T 2a16f7501e2444fb86d4e2778e734e02 P e61c3a8f61bb48f8a963c9480e53c168 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:05:24.575737 21976 consensus_queue.cc:237] T ed7fdbcb96d14d418db9ca90a792588a P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:05:24.577906 19484 raft_consensus.cc:2468] T 309c3ca0ca4b4f3ba129752ea2cb293b P 0473d2b2d01f4459b1e90fd12cc7840e [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 127766fc592545a4997f7790f50f6076 in term 6.
I20260709 13:05:24.567554 22049 leader_election.cc:290] T 28af091831594f9d8e96482078cc7625 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 7 election: Requested vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:05:24.563269 22166 raft_consensus.cc:2749] T 833a2f0775ed407a94b8924ce50adb63 P e5256d91808b47c195bc9b4dbd7f2b87 [term 6 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:05:24.585810 19523 leader_election.cc:304] T ff75a1d4cb1f493db8f71ddc136ba9ab P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
W20260709 13:05:24.594202 19526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.2:46257, user_credentials={real_user=slave}} blocked reactor thread for 154611us
I20260709 13:05:24.606266 19555 raft_consensus.cc:2468] T 0cdf56e38bbc453d9438d359e5a69955 P e61c3a8f61bb48f8a963c9480e53c168 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 9.
I20260709 13:05:24.608011 19375 leader_election.cc:304] T 0cdf56e38bbc453d9438d359e5a69955 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:05:24.615212 19486 raft_consensus.cc:1240] T 775c229504194560ba9589bc2199b089 P 0473d2b2d01f4459b1e90fd12cc7840e [term 5 FOLLOWER]: Rejecting Update request from peer 127766fc592545a4997f7790f50f6076 for earlier term 4. Current term is 5. Ops: []
I20260709 13:05:24.576999 22057 raft_consensus.cc:493] T ff9b0eddd810459b82d91c60777c10eb P 0473d2b2d01f4459b1e90fd12cc7840e [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 127766fc592545a4997f7790f50f6076)
I20260709 13:05:24.623826 22041 raft_consensus.cc:493] T ece3db938bc649d4a40a51522ed5259c P 127766fc592545a4997f7790f50f6076 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:24.624423 22041 raft_consensus.cc:515] T ece3db938bc649d4a40a51522ed5259c P 127766fc592545a4997f7790f50f6076 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
W20260709 13:05:24.628602 19375 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:24.586833 22111 leader_election.cc:290] T 14efcc79969f41babe5529c22d59156d P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
W20260709 13:05:24.630872 19523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.1:40321, user_credentials={real_user=slave}} blocked reactor thread for 45094.9us
W20260709 13:05:24.627944 22175 log.cc:927] Time spent T 309c3ca0ca4b4f3ba129752ea2cb293b P e5256d91808b47c195bc9b4dbd7f2b87: Append to log took a long time: real 1.556s	user 0.006s	sys 0.000s
I20260709 13:05:24.638031 19405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36f6ba92b9ba46babe4ebd6c02e5fbd9" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
I20260709 13:05:24.639132 19484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f85fc4b527a48848e5faa083b604e36" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:05:24.639716 19484 raft_consensus.cc:3060] T 1f85fc4b527a48848e5faa083b604e36 P 0473d2b2d01f4459b1e90fd12cc7840e [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:05:24.642563 19405 raft_consensus.cc:2410] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P e5256d91808b47c195bc9b4dbd7f2b87 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 0473d2b2d01f4459b1e90fd12cc7840e for term 8 because replica has last-logged OpId of term: 7 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 7.
W20260709 13:05:24.648463 19377 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:05:24.648973 19377 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:24.633852 22144 raft_consensus.cc:2804] T 0cdf56e38bbc453d9438d359e5a69955 P e5256d91808b47c195bc9b4dbd7f2b87 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:05:24.633457 21529 raft_consensus.cc:2804] T ff75a1d4cb1f493db8f71ddc136ba9ab P e61c3a8f61bb48f8a963c9480e53c168 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:05:24.619804 22049 consensus_queue.cc:1048] T f1b10566f45d4a7d9029858330e02d5b P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.022s
I20260709 13:05:24.651186 19409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ec1c4ce15e04c7e8c283a62179f2a64" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
I20260709 13:05:24.648201 19478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14935b3ddf914369822e4a0547aaa355" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:05:24.652994 22057 raft_consensus.cc:515] T ff9b0eddd810459b82d91c60777c10eb P 0473d2b2d01f4459b1e90fd12cc7840e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
W20260709 13:05:24.663623 22246 log.cc:927] Time spent T 22196caba61445d3bec98a0aab3c337d P 0473d2b2d01f4459b1e90fd12cc7840e: Append to log took a long time: real 0.121s	user 0.001s	sys 0.000s
I20260709 13:05:24.665364 22057 leader_election.cc:290] T ff9b0eddd810459b82d91c60777c10eb P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:05:24.643592 22041 leader_election.cc:290] T ece3db938bc649d4a40a51522ed5259c P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:05:24.667963 19409 raft_consensus.cc:2368] T 5ec1c4ce15e04c7e8c283a62179f2a64 P e5256d91808b47c195bc9b4dbd7f2b87 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 0473d2b2d01f4459b1e90fd12cc7840e for earlier term 4. Current term is 5.
W20260709 13:05:24.671226 19374 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.4:43121, user_credentials={real_user=slave}} blocked reactor thread for 219133us
I20260709 13:05:24.679508 19405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef32ce6fdd0e40d382c79974f30295c6" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
I20260709 13:05:24.680752 20111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa731b585f684a7fb2d106c50f143b83" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076"
I20260709 13:05:24.681972 19408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b74109013a140ada21feeef92d6f563" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
I20260709 13:05:24.683009 19409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21e14947d70440f19044d8f75c31e1f9" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
I20260709 13:05:24.684262 19409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc225c93219c45538b53a1bd3d387e4d" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
I20260709 13:05:24.685289 19409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e1f505cb0f1427bbd698ac889d80821" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
I20260709 13:05:24.685912 19409 raft_consensus.cc:2368] T 3e1f505cb0f1427bbd698ac889d80821 P e5256d91808b47c195bc9b4dbd7f2b87 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 0473d2b2d01f4459b1e90fd12cc7840e for earlier term 5. Current term is 6.
W20260709 13:05:24.686830 22127 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.811s	user 0.007s	sys 0.008s
W20260709 13:05:24.687208 22127 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.868s	user 0.007s	sys 0.008s
I20260709 13:05:24.687005 22056 consensus_queue.cc:1048] T 5ec1c4ce15e04c7e8c283a62179f2a64 P 127766fc592545a4997f7790f50f6076 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:05:24.690799 22049 raft_consensus.cc:493] T 86a6797bdfe94fa496c050ceae4bd0d9 P e5256d91808b47c195bc9b4dbd7f2b87 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:24.691520 22179 consensus_queue.cc:1048] T 833a2f0775ed407a94b8924ce50adb63 P 127766fc592545a4997f7790f50f6076 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:05:24.691390 22049 raft_consensus.cc:515] T 86a6797bdfe94fa496c050ceae4bd0d9 P e5256d91808b47c195bc9b4dbd7f2b87 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:24.692703 22041 consensus_queue.cc:1059] T fa731b585f684a7fb2d106c50f143b83 P 127766fc592545a4997f7790f50f6076 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:05:24.693765 22041 raft_consensus.cc:3055] T fa731b585f684a7fb2d106c50f143b83 P 127766fc592545a4997f7790f50f6076 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:05:24.694093 22041 raft_consensus.cc:740] T fa731b585f684a7fb2d106c50f143b83 P 127766fc592545a4997f7790f50f6076 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 127766fc592545a4997f7790f50f6076, State: Running, Role: LEADER
I20260709 13:05:24.694557 22049 leader_election.cc:290] T 86a6797bdfe94fa496c050ceae4bd0d9 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:05:24.695116 19478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "172b3dd13109415a955b71ac0e9d2234" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:05:24.686631 19409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "775c229504194560ba9589bc2199b089" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
I20260709 13:05:24.696429 19409 raft_consensus.cc:3060] T 775c229504194560ba9589bc2199b089 P e5256d91808b47c195bc9b4dbd7f2b87 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:05:24.697340 19477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14efcc79969f41babe5529c22d59156d" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:05:24.698119 19477 raft_consensus.cc:2468] T 14efcc79969f41babe5529c22d59156d P 0473d2b2d01f4459b1e90fd12cc7840e [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 127766fc592545a4997f7790f50f6076 in term 6.
I20260709 13:05:24.698712 19449 leader_election.cc:304] T 62c6c134d3d24a1ab144dd9ee6bc3f64 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, 127766fc592545a4997f7790f50f6076; no voters: e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:05:24.699136 19477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cdf56e38bbc453d9438d359e5a69955" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
W20260709 13:05:24.699699 19449 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.4:43121, user_credentials={real_user=slave}} blocked reactor thread for 122521us
I20260709 13:05:24.700459 19477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f93ee515a9c14139bf566522ed8232f3" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 9 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:05:24.701211 19477 raft_consensus.cc:2393] T f93ee515a9c14139bf566522ed8232f3 P 0473d2b2d01f4459b1e90fd12cc7840e [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate e5256d91808b47c195bc9b4dbd7f2b87 in current term 9: Already voted for candidate e61c3a8f61bb48f8a963c9480e53c168 in this term.
I20260709 13:05:24.702323 19477 raft_consensus.cc:1240] T 2b74109013a140ada21feeef92d6f563 P 0473d2b2d01f4459b1e90fd12cc7840e [term 4 FOLLOWER]: Rejecting Update request from peer e5256d91808b47c195bc9b4dbd7f2b87 for earlier term 3. Current term is 4. Ops: []
I20260709 13:05:24.702750 20076 leader_election.cc:304] T 48824d5acfbc485ebf8c2d944e7202de P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 127766fc592545a4997f7790f50f6076; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:05:24.703617 22056 raft_consensus.cc:2749] T 48824d5acfbc485ebf8c2d944e7202de P 127766fc592545a4997f7790f50f6076 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
W20260709 13:05:24.703858 20076 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.3:36891, user_credentials={real_user=slave}} blocked reactor thread for 52714.4us
I20260709 13:05:24.704753 22127 raft_consensus.cc:2804] T 62c6c134d3d24a1ab144dd9ee6bc3f64 P 0473d2b2d01f4459b1e90fd12cc7840e [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:05:24.705313 22127 raft_consensus.cc:697] T 62c6c134d3d24a1ab144dd9ee6bc3f64 P 0473d2b2d01f4459b1e90fd12cc7840e [term 8 LEADER]: Becoming Leader. State: Replica: 0473d2b2d01f4459b1e90fd12cc7840e, State: Running, Role: LEADER
I20260709 13:05:24.706614 19405 raft_consensus.cc:2368] T ef32ce6fdd0e40d382c79974f30295c6 P e5256d91808b47c195bc9b4dbd7f2b87 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 0473d2b2d01f4459b1e90fd12cc7840e for earlier term 6. Current term is 7.
I20260709 13:05:24.706301 22127 consensus_queue.cc:237] T 62c6c134d3d24a1ab144dd9ee6bc3f64 P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:05:24.712862 19479 raft_consensus.cc:1275] T 0afb57ae58a24a01850491d69f0213dd P 0473d2b2d01f4459b1e90fd12cc7840e [term 7 FOLLOWER]: Refusing update from remote peer 127766fc592545a4997f7790f50f6076: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 13:05:24.716275 19480 raft_consensus.cc:2410] T 96efeaaf1057492490e9a621f37e1a2d P 0473d2b2d01f4459b1e90fd12cc7840e [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e61c3a8f61bb48f8a963c9480e53c168 for term 6 because replica has last-logged OpId of term: 5 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260709 13:05:24.717916 19405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e36a9d6e29c4a7c860cf267efbd4c74" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
I20260709 13:05:24.720882 19405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1b10566f45d4a7d9029858330e02d5b" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
I20260709 13:05:24.710346 22041 consensus_queue.cc:260] T fa731b585f684a7fb2d106c50f143b83 P 127766fc592545a4997f7790f50f6076 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:05:24.670985 21529 raft_consensus.cc:697] T ff75a1d4cb1f493db8f71ddc136ba9ab P e61c3a8f61bb48f8a963c9480e53c168 [term 6 LEADER]: Becoming Leader. State: Replica: e61c3a8f61bb48f8a963c9480e53c168, State: Running, Role: LEADER
I20260709 13:05:24.719188 22114 consensus_queue.cc:1048] T 7f575b143b844aa096b50997dad3516a P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.072s
I20260709 13:05:24.725770 21529 consensus_queue.cc:237] T ff75a1d4cb1f493db8f71ddc136ba9ab P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:24.729895 19558 raft_consensus.cc:2468] T b08304a0a02b42d7840c4e8ee9a6bd1a P e61c3a8f61bb48f8a963c9480e53c168 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 8.
I20260709 13:05:24.709764 19484 raft_consensus.cc:2468] T 1f85fc4b527a48848e5faa083b604e36 P 0473d2b2d01f4459b1e90fd12cc7840e [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 127766fc592545a4997f7790f50f6076 in term 5.
I20260709 13:05:24.695981 19478 raft_consensus.cc:2393] T 172b3dd13109415a955b71ac0e9d2234 P 0473d2b2d01f4459b1e90fd12cc7840e [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 127766fc592545a4997f7790f50f6076 in current term 4: Already voted for candidate 0473d2b2d01f4459b1e90fd12cc7840e in this term.
I20260709 13:05:24.732957 19408 raft_consensus.cc:2468] T 2b74109013a140ada21feeef92d6f563 P e5256d91808b47c195bc9b4dbd7f2b87 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 4.
I20260709 13:05:24.746013 19486 raft_consensus.cc:1240] T 172b3dd13109415a955b71ac0e9d2234 P 0473d2b2d01f4459b1e90fd12cc7840e [term 4 FOLLOWER]: Rejecting Update request from peer e5256d91808b47c195bc9b4dbd7f2b87 for earlier term 3. Current term is 4. Ops: []
I20260709 13:05:24.746436 19409 raft_consensus.cc:2468] T 775c229504194560ba9589bc2199b089 P e5256d91808b47c195bc9b4dbd7f2b87 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 5.
I20260709 13:05:24.747232 20111 raft_consensus.cc:1240] T 14935b3ddf914369822e4a0547aaa355 P 127766fc592545a4997f7790f50f6076 [term 6 FOLLOWER]: Rejecting Update request from peer 0473d2b2d01f4459b1e90fd12cc7840e for earlier term 5. Current term is 6. Ops: []
I20260709 13:05:24.747431 19409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e5873a19244c5ebbcd38e126796ee7" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
I20260709 13:05:24.748212 19409 raft_consensus.cc:2393] T d1e5873a19244c5ebbcd38e126796ee7 P e5256d91808b47c195bc9b4dbd7f2b87 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 0473d2b2d01f4459b1e90fd12cc7840e in current term 8: Already voted for candidate e5256d91808b47c195bc9b4dbd7f2b87 in this term.
W20260709 13:05:24.735934 19523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.1:40321, user_credentials={real_user=slave}} blocked reactor thread for 61534.2us
I20260709 13:05:24.749140 19408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa8650e71aa14778b3d73721fc50d9fc" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:05:24.748886 21559 consensus_queue.cc:1059] T 40e1e16737a842ee936002830f36882e P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.043s
W20260709 13:05:24.791554 19375 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.3:36891, user_credentials={real_user=slave}} blocked reactor thread for 146263us
I20260709 13:05:24.792840 19402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f93ee515a9c14139bf566522ed8232f3" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 8 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
I20260709 13:05:24.750114 19477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edd7d470b5014c9489be7f41f64355c9" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:05:24.797945 19403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46c5bfeecc314717bffe987e6844b6d0" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 11 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
I20260709 13:05:24.798144 20111 raft_consensus.cc:1240] T 9962423cb4e54fcfa5de01daf68a86e7 P 127766fc592545a4997f7790f50f6076 [term 10 FOLLOWER]: Rejecting Update request from peer 0473d2b2d01f4459b1e90fd12cc7840e for earlier term 9. Current term is 10. Ops: []
I20260709 13:05:24.798893 20103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1efebf73c86e432baa55533136b6e12c" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:05:24.800254 19411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7be9efa6559648dbb5a0f7684c4542d1" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
I20260709 13:05:24.802711 19477 raft_consensus.cc:3060] T edd7d470b5014c9489be7f41f64355c9 P 0473d2b2d01f4459b1e90fd12cc7840e [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:05:24.798758 19375 leader_election.cc:304] T b08304a0a02b42d7840c4e8ee9a6bd1a P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:05:24.804828 19408 raft_consensus.cc:2468] T fa8650e71aa14778b3d73721fc50d9fc P e5256d91808b47c195bc9b4dbd7f2b87 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 7.
I20260709 13:05:24.809379 19409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4509b76741dc428e9201c70c1658da13" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
W20260709 13:05:24.809710 19524 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:24.810003 19409 raft_consensus.cc:2468] T 4509b76741dc428e9201c70c1658da13 P e5256d91808b47c195bc9b4dbd7f2b87 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 2.
W20260709 13:05:24.810962 19526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.2:46257, user_credentials={real_user=slave}} blocked reactor thread for 131685us
I20260709 13:05:24.815481 19402 raft_consensus.cc:2368] T f93ee515a9c14139bf566522ed8232f3 P e5256d91808b47c195bc9b4dbd7f2b87 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 0473d2b2d01f4459b1e90fd12cc7840e for earlier term 8. Current term is 9.
I20260709 13:05:24.822489 19449 leader_election.cc:304] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e; no voters: 127766fc592545a4997f7790f50f6076, e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:05:24.822858 19405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76cb037fc9064d13b59a8969d897ce8c" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:05:24.792183 21767 raft_consensus.cc:493] T 86a6797bdfe94fa496c050ceae4bd0d9 P 0473d2b2d01f4459b1e90fd12cc7840e [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:24.828078 22201 raft_consensus.cc:493] T 96efeaaf1057492490e9a621f37e1a2d P 0473d2b2d01f4459b1e90fd12cc7840e [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:24.795778 22179 raft_consensus.cc:493] T 85c494af21f9457a85da47b9bc70c1fd P 127766fc592545a4997f7790f50f6076 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:24.828668 19449 leader_election.cc:400] T 5ec1c4ce15e04c7e8c283a62179f2a64 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 4 election: Vote denied by peer e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321) with higher term. Message: Invalid argument: T 5ec1c4ce15e04c7e8c283a62179f2a64 P e5256d91808b47c195bc9b4dbd7f2b87 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 0473d2b2d01f4459b1e90fd12cc7840e for earlier term 4. Current term is 5.
I20260709 13:05:24.871709 19449 leader_election.cc:403] T 5ec1c4ce15e04c7e8c283a62179f2a64 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 4 election: Cancelling election due to peer responding with higher term
W20260709 13:05:24.828939 19481 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58294 (request call id 1707) took 2630 ms (client timeout 2325 ms). Trace:
I20260709 13:05:24.829689 22127 raft_consensus.cc:2749] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P 0473d2b2d01f4459b1e90fd12cc7840e [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:05:24.830904 20106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c5eebf646ad445a9d1b1adc319d7b16" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:05:24.831115 19408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14efcc79969f41babe5529c22d59156d" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:05:24.831955 19377 leader_election.cc:304] T 5ec1c4ce15e04c7e8c283a62179f2a64 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, 127766fc592545a4997f7790f50f6076
I20260709 13:05:24.832691 22254 consensus_queue.cc:1059] T bc225c93219c45538b53a1bd3d387e4d P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:05:24.835036 19479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e1f505cb0f1427bbd698ac889d80821" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:05:24.835106 22027 raft_consensus.cc:3055] T 40e1e16737a842ee936002830f36882e P e61c3a8f61bb48f8a963c9480e53c168 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:05:24.836181 19478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a61655d99124a29b486ba4a5b37faea" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:05:24.840315 19558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa8650e71aa14778b3d73721fc50d9fc" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:05:24.841408 19553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1b10566f45d4a7d9029858330e02d5b" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:05:24.787408 22185 consensus_queue.cc:1059] T a08760e15aac4630a629431f56024dc8 P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.094s
I20260709 13:05:24.842595 19554 raft_consensus.cc:1240] T 0cdf56e38bbc453d9438d359e5a69955 P e61c3a8f61bb48f8a963c9480e53c168 [term 9 FOLLOWER]: Rejecting Update request from peer 0473d2b2d01f4459b1e90fd12cc7840e for earlier term 8. Current term is 9. Ops: []
I20260709 13:05:24.823796 22049 raft_consensus.cc:2804] T b08304a0a02b42d7840c4e8ee9a6bd1a P e5256d91808b47c195bc9b4dbd7f2b87 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:05:24.843405 19555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e5873a19244c5ebbcd38e126796ee7" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:05:24.844290 19560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e36a9d6e29c4a7c860cf267efbd4c74" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
W20260709 13:05:24.845476 22249 log.cc:927] Time spent T 14935b3ddf914369822e4a0547aaa355 P 0473d2b2d01f4459b1e90fd12cc7840e: Append to log took a long time: real 0.180s	user 0.003s	sys 0.000s
I20260709 13:05:24.881044 19553 raft_consensus.cc:2393] T f1b10566f45d4a7d9029858330e02d5b P e61c3a8f61bb48f8a963c9480e53c168 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 0473d2b2d01f4459b1e90fd12cc7840e in current term 8: Already voted for candidate e5256d91808b47c195bc9b4dbd7f2b87 in this term.
I20260709 13:05:24.846607 19551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "309c3ca0ca4b4f3ba129752ea2cb293b" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:05:24.847441 19404 raft_consensus.cc:1240] T ff75a1d4cb1f493db8f71ddc136ba9ab P e5256d91808b47c195bc9b4dbd7f2b87 [term 6 FOLLOWER]: Rejecting Update request from peer 0473d2b2d01f4459b1e90fd12cc7840e for earlier term 5. Current term is 6. Ops: []
I20260709 13:05:24.848357 19484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22196caba61445d3bec98a0aab3c337d" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:05:24.850620 21977 tablet_bootstrap.cc:492] T 7be9efa6559648dbb5a0f7684c4542d1 P 127766fc592545a4997f7790f50f6076: Bootstrap replayed 1/1 log segments. Stats: ops{read=4 overwritten=0 applied=4 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:05:24.850493 19410 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52328 (request call id 1582) took 2077 ms. Trace:
I20260709 13:05:24.851586 19482 raft_consensus.cc:1275] T 5ec1c4ce15e04c7e8c283a62179f2a64 P 0473d2b2d01f4459b1e90fd12cc7840e [term 5 FOLLOWER]: Refusing update from remote peer 127766fc592545a4997f7790f50f6076: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:05:24.852694 22195 raft_consensus.cc:3055] T 1f85fc4b527a48848e5faa083b604e36 P e5256d91808b47c195bc9b4dbd7f2b87 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:05:24.843364 19483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9962423cb4e54fcfa5de01daf68a86e7" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:05:24.903648 19555 raft_consensus.cc:2393] T d1e5873a19244c5ebbcd38e126796ee7 P e61c3a8f61bb48f8a963c9480e53c168 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 0473d2b2d01f4459b1e90fd12cc7840e in current term 8: Already voted for candidate e61c3a8f61bb48f8a963c9480e53c168 in this term.
I20260709 13:05:24.855000 22163 raft_consensus.cc:493] T a08760e15aac4630a629431f56024dc8 P 0473d2b2d01f4459b1e90fd12cc7840e [term 6 FOLLOWER]: Starting pre-election (detected failure of leader e61c3a8f61bb48f8a963c9480e53c168)
I20260709 13:05:24.859787 19556 raft_consensus.cc:1275] T 217b5fae677b4971b3bbd2f357a1f7ff P e61c3a8f61bb48f8a963c9480e53c168 [term 4 FOLLOWER]: Refusing update from remote peer 0473d2b2d01f4459b1e90fd12cc7840e: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:05:24.862882 21823 leader_election.cc:290] T 2e36a9d6e29c4a7c860cf267efbd4c74 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 6 election: Requested vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:05:24.872471 19411 raft_consensus.cc:2393] T 7be9efa6559648dbb5a0f7684c4542d1 P e5256d91808b47c195bc9b4dbd7f2b87 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 0473d2b2d01f4459b1e90fd12cc7840e in current term 7: Already voted for candidate e61c3a8f61bb48f8a963c9480e53c168 in this term.
W20260709 13:05:24.874395 19523 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:24.870893 19374 leader_election.cc:304] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 127766fc592545a4997f7790f50f6076, e5256d91808b47c195bc9b4dbd7f2b87; no voters: 
I20260709 13:05:24.875193 19403 raft_consensus.cc:2393] T 46c5bfeecc314717bffe987e6844b6d0 P e5256d91808b47c195bc9b4dbd7f2b87 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 0473d2b2d01f4459b1e90fd12cc7840e in current term 11: Already voted for candidate e5256d91808b47c195bc9b4dbd7f2b87 in this term.
W20260709 13:05:24.872272 19481 rpcz_store.cc:269] 0709 13:05:22.204378 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:22.267635 (+ 63257us) service_pool.cc:224] Handling call
0709 13:05:24.797922 (+2530287us) spinlock_profiling.cc:243] Waited 794 ms on lock 0x7b54000a9e54. stack: 00007f4a79de9343 00007f4a79de9240 00007f4a797781d4 00007f4a834b6304 00007f4a834b6299 00007f4a7ce71571 00007f4a7cf0c2fa 00007f4a81ecdb17 00007f4a7b4486d4 00007f4a7b448662 00007f4a7b448591 00007f4a7b44850c 00007f4a7b4477c2 00007f4a7b24348c 00007f4a7b2428c6 00007f4a7b24226f
0709 13:05:24.828699 (+ 30777us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1826822016}
I20260709 13:05:24.895422 19560 raft_consensus.cc:2393] T 2e36a9d6e29c4a7c860cf267efbd4c74 P e61c3a8f61bb48f8a963c9480e53c168 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 0473d2b2d01f4459b1e90fd12cc7840e in current term 6: Already voted for candidate e5256d91808b47c195bc9b4dbd7f2b87 in this term.
I20260709 13:05:24.895500 19526 leader_election.cc:400] T 2e36a9d6e29c4a7c860cf267efbd4c74 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 5 pre-election: Vote denied by peer 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257) with higher term. Message: Invalid argument: T 2e36a9d6e29c4a7c860cf267efbd4c74 P 0473d2b2d01f4459b1e90fd12cc7840e [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e61c3a8f61bb48f8a963c9480e53c168 for earlier term 5. Current term is 6.
I20260709 13:05:24.910632 19526 leader_election.cc:403] T 2e36a9d6e29c4a7c860cf267efbd4c74 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 5 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:05:24.895814 19410 rpcz_store.cc:276] 0709 13:05:22.735919 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:22.785899 (+ 49980us) service_pool.cc:224] Handling call
0709 13:05:22.810265 (+ 24366us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:05:22.810606 (+   341us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:05:22.810630 (+    24us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:05:22.815587 (+  4957us) log.cc:844] Serialized 26 byte log entry
0709 13:05:22.912287 (+ 96700us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:05:22.912332 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:22.912397 (+    65us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:05:24.600833 (+1688436us) spinlock_profiling.cc:243] Waited 5.64 ms on lock 0x7b4400022b4c. stack: 00007f4a79de9343 00007f4a79de9240 00007f4a797781d4 00007f4a834b6304 00007f4a834b6299 00007f4a79ca3db1 00007f4a79d41c85 00007f4a79d426a2 00007f4a7cab41db 00007f4a7caafaaf 00007f4a7caa386e 00007f4a7caa2bb6 00007f4a7caa27d8 00007f4a7caac221 00007f4a7caac1d9 00007f4a7caac169
0709 13:05:24.731318 (+130485us) raft_consensus.cc:1685] finished
0709 13:05:24.731346 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:24.813696 (+ 82350us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":99,"raft.run_cpu_time_us":171,"raft.run_wall_time_us":5686,"spinlock_wait_cycles":12974976,"thread_start_us":71642,"threads_started":1,"wal-append.queue_time_us":182027}
I20260709 13:05:24.912523 19410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff9b0eddd810459b82d91c60777c10eb" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:05:24.913596 19482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e1f505cb0f1427bbd698ac889d80821" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:05:24.914278 19483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b08304a0a02b42d7840c4e8ee9a6bd1a" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:05:24.903689 22195 raft_consensus.cc:740] T 1f85fc4b527a48848e5faa083b604e36 P e5256d91808b47c195bc9b4dbd7f2b87 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: e5256d91808b47c195bc9b4dbd7f2b87, State: Running, Role: LEADER
I20260709 13:05:24.914884 19482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9f0d59553ad444883fcf5b5909f9798" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:05:24.915458 19483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dc5b3532fe54f74876d02beffa2c230" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:05:24.915572 22195 consensus_queue.cc:260] T 1f85fc4b527a48848e5faa083b604e36 P e5256d91808b47c195bc9b4dbd7f2b87 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:05:24.916018 19554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ece3db938bc649d4a40a51522ed5259c" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:05:24.916419 19559 raft_consensus.cc:1275] T 0afb57ae58a24a01850491d69f0213dd P e61c3a8f61bb48f8a963c9480e53c168 [term 7 FOLLOWER]: Refusing update from remote peer 127766fc592545a4997f7790f50f6076: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 13:05:24.916812 19554 raft_consensus.cc:2468] T ece3db938bc649d4a40a51522ed5259c P e61c3a8f61bb48f8a963c9480e53c168 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 127766fc592545a4997f7790f50f6076 in term 6.
I20260709 13:05:24.917436 19408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ece3db938bc649d4a40a51522ed5259c" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:05:24.917677 19559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76cb037fc9064d13b59a8969d897ce8c" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:05:24.918246 19554 raft_consensus.cc:1275] T 833a2f0775ed407a94b8924ce50adb63 P e61c3a8f61bb48f8a963c9480e53c168 [term 6 FOLLOWER]: Refusing update from remote peer 127766fc592545a4997f7790f50f6076: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:05:24.918555 19408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "309c3ca0ca4b4f3ba129752ea2cb293b" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:05:24.919566 19403 raft_consensus.cc:1240] T 179fd671030940b4b4a4e24bcc4aba0a P e5256d91808b47c195bc9b4dbd7f2b87 [term 6 FOLLOWER]: Rejecting Update request from peer 0473d2b2d01f4459b1e90fd12cc7840e for earlier term 5. Current term is 6. Ops: []
I20260709 13:05:24.919993 19408 raft_consensus.cc:1240] T 22196caba61445d3bec98a0aab3c337d P e5256d91808b47c195bc9b4dbd7f2b87 [term 6 FOLLOWER]: Rejecting Update request from peer 0473d2b2d01f4459b1e90fd12cc7840e for earlier term 5. Current term is 6. Ops: [5.4-5.4]
I20260709 13:05:24.921136 19408 raft_consensus.cc:1240] T 1a61655d99124a29b486ba4a5b37faea P e5256d91808b47c195bc9b4dbd7f2b87 [term 4 FOLLOWER]: Rejecting Update request from peer 0473d2b2d01f4459b1e90fd12cc7840e for earlier term 3. Current term is 4. Ops: []
I20260709 13:05:24.921712 22172 consensus_queue.cc:1059] T 775c229504194560ba9589bc2199b089 P 127766fc592545a4997f7790f50f6076 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:05:24.922838 22172 raft_consensus.cc:3055] T 775c229504194560ba9589bc2199b089 P 127766fc592545a4997f7790f50f6076 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:05:24.915567 19552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14935b3ddf914369822e4a0547aaa355" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:05:24.923209 19557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1efebf73c86e432baa55533136b6e12c" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:05:24.923581 19552 raft_consensus.cc:3060] T 14935b3ddf914369822e4a0547aaa355 P e61c3a8f61bb48f8a963c9480e53c168 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:05:24.923820 19377 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.2:46257, user_credentials={real_user=slave}} blocked reactor thread for 91992.8us
I20260709 13:05:24.924618 19377 leader_election.cc:304] T ef32ce6fdd0e40d382c79974f30295c6 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87; no voters: e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:05:24.925943 19557 raft_consensus.cc:1240] T 22196caba61445d3bec98a0aab3c337d P e61c3a8f61bb48f8a963c9480e53c168 [term 6 FOLLOWER]: Rejecting Update request from peer 0473d2b2d01f4459b1e90fd12cc7840e for earlier term 5. Current term is 6. Ops: []
I20260709 13:05:24.926235 22064 raft_consensus.cc:2749] T 5ec1c4ce15e04c7e8c283a62179f2a64 P e5256d91808b47c195bc9b4dbd7f2b87 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:05:24.878465 22027 raft_consensus.cc:740] T 40e1e16737a842ee936002830f36882e P e61c3a8f61bb48f8a963c9480e53c168 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: e61c3a8f61bb48f8a963c9480e53c168, State: Running, Role: LEADER
I20260709 13:05:24.926962 22251 raft_consensus.cc:2804] T ef32ce6fdd0e40d382c79974f30295c6 P e5256d91808b47c195bc9b4dbd7f2b87 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:05:24.927541 22251 raft_consensus.cc:697] T ef32ce6fdd0e40d382c79974f30295c6 P e5256d91808b47c195bc9b4dbd7f2b87 [term 7 LEADER]: Becoming Leader. State: Replica: e5256d91808b47c195bc9b4dbd7f2b87, State: Running, Role: LEADER
I20260709 13:05:24.927814 22027 consensus_queue.cc:260] T 40e1e16737a842ee936002830f36882e P e61c3a8f61bb48f8a963c9480e53c168 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:24.928562 22251 consensus_queue.cc:237] T ef32ce6fdd0e40d382c79974f30295c6 P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:24.929141 22027 raft_consensus.cc:3060] T 40e1e16737a842ee936002830f36882e P e61c3a8f61bb48f8a963c9480e53c168 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:05:24.929330 19374 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.4:43121, user_credentials={real_user=slave}} blocked reactor thread for 58517us
I20260709 13:05:24.930536 19479 raft_consensus.cc:2376] T 3e1f505cb0f1427bbd698ac889d80821 P 0473d2b2d01f4459b1e90fd12cc7840e [term 6 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 6. Re-sending same reply.
I20260709 13:05:24.930954 21926 raft_consensus.cc:2804] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P e5256d91808b47c195bc9b4dbd7f2b87 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:05:24.923213 22172 raft_consensus.cc:740] T 775c229504194560ba9589bc2199b089 P 127766fc592545a4997f7790f50f6076 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 127766fc592545a4997f7790f50f6076, State: Running, Role: LEADER
I20260709 13:05:24.931457 21926 raft_consensus.cc:493] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P e5256d91808b47c195bc9b4dbd7f2b87 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:24.931874 19479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a08760e15aac4630a629431f56024dc8" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:05:24.913640 19410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "172b3dd13109415a955b71ac0e9d2234" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
I20260709 13:05:24.916859 22195 raft_consensus.cc:3060] T 1f85fc4b527a48848e5faa083b604e36 P e5256d91808b47c195bc9b4dbd7f2b87 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:05:24.915589 19482 raft_consensus.cc:3060] T b9f0d59553ad444883fcf5b5909f9798 P 0473d2b2d01f4459b1e90fd12cc7840e [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:05:24.934468 20076 leader_election.cc:304] T ece3db938bc649d4a40a51522ed5259c P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 127766fc592545a4997f7790f50f6076, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:05:24.936619 19478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9962423cb4e54fcfa5de01daf68a86e7" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:05:24.916028 19483 raft_consensus.cc:2376] T 1dc5b3532fe54f74876d02beffa2c230 P 0473d2b2d01f4459b1e90fd12cc7840e [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 5. Re-sending same reply.
I20260709 13:05:24.932267 22172 consensus_queue.cc:260] T 775c229504194560ba9589bc2199b089 P 127766fc592545a4997f7790f50f6076 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:05:24.941905 19484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e36a9d6e29c4a7c860cf267efbd4c74" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:05:24.876085 22144 raft_consensus.cc:697] T 0cdf56e38bbc453d9438d359e5a69955 P e5256d91808b47c195bc9b4dbd7f2b87 [term 9 LEADER]: Becoming Leader. State: Replica: e5256d91808b47c195bc9b4dbd7f2b87, State: Running, Role: LEADER
I20260709 13:05:24.942806 19484 raft_consensus.cc:2393] T 2e36a9d6e29c4a7c860cf267efbd4c74 P 0473d2b2d01f4459b1e90fd12cc7840e [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate e5256d91808b47c195bc9b4dbd7f2b87 in current term 6: Already voted for candidate 0473d2b2d01f4459b1e90fd12cc7840e in this term.
I20260709 13:05:24.948035 19560 raft_consensus.cc:1240] T b08304a0a02b42d7840c4e8ee9a6bd1a P e61c3a8f61bb48f8a963c9480e53c168 [term 8 FOLLOWER]: Rejecting Update request from peer 0473d2b2d01f4459b1e90fd12cc7840e for earlier term 7. Current term is 8. Ops: []
I20260709 13:05:24.948886 20111 raft_consensus.cc:1240] T 1f85fc4b527a48848e5faa083b604e36 P 127766fc592545a4997f7790f50f6076 [term 5 FOLLOWER]: Rejecting Update request from peer e5256d91808b47c195bc9b4dbd7f2b87 for earlier term 4. Current term is 5. Ops: []
I20260709 13:05:24.948760 19559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c5eebf646ad445a9d1b1adc319d7b16" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:05:24.931893 21926 raft_consensus.cc:3060] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P e5256d91808b47c195bc9b4dbd7f2b87 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:05:24.954773 19411 raft_consensus.cc:1240] T 2725d2c4cb054f18b0fc8f735c15f6c2 P e5256d91808b47c195bc9b4dbd7f2b87 [term 8 LEADER]: Rejecting Update request from peer 0473d2b2d01f4459b1e90fd12cc7840e for earlier term 7. Current term is 8. Ops: [7.4-7.4]
I20260709 13:05:24.949909 19404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "172b3dd13109415a955b71ac0e9d2234" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:05:24.958417 19557 raft_consensus.cc:1240] T 1a61655d99124a29b486ba4a5b37faea P e61c3a8f61bb48f8a963c9480e53c168 [term 4 FOLLOWER]: Rejecting Update request from peer 0473d2b2d01f4459b1e90fd12cc7840e for earlier term 3. Current term is 4. Ops: []
I20260709 13:05:24.952652 19481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14935b3ddf914369822e4a0547aaa355" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:05:24.933135 22049 raft_consensus.cc:697] T b08304a0a02b42d7840c4e8ee9a6bd1a P e5256d91808b47c195bc9b4dbd7f2b87 [term 8 LEADER]: Becoming Leader. State: Replica: e5256d91808b47c195bc9b4dbd7f2b87, State: Running, Role: LEADER
I20260709 13:05:24.952564 19410 raft_consensus.cc:1240] T 9962423cb4e54fcfa5de01daf68a86e7 P e5256d91808b47c195bc9b4dbd7f2b87 [term 10 LEADER]: Rejecting Update request from peer 0473d2b2d01f4459b1e90fd12cc7840e for earlier term 9. Current term is 10. Ops: []
I20260709 13:05:24.961031 19478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2725d2c4cb054f18b0fc8f735c15f6c2" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:05:24.965034 19485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "179fd671030940b4b4a4e24bcc4aba0a" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:05:24.966259 19485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cdf56e38bbc453d9438d359e5a69955" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:05:24.945429 20108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff9b0eddd810459b82d91c60777c10eb" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:05:24.960330 22254 raft_consensus.cc:493] T 4af19371ea874c09a0a2147040835cbb P e5256d91808b47c195bc9b4dbd7f2b87 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 127766fc592545a4997f7790f50f6076)
W20260709 13:05:24.966939 19449 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.1:40321, user_credentials={real_user=slave}} blocked reactor thread for 138465us
I20260709 13:05:24.967270 22254 raft_consensus.cc:515] T 4af19371ea874c09a0a2147040835cbb P e5256d91808b47c195bc9b4dbd7f2b87 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:05:24.967886 19449 leader_election.cc:304] T 21e14947d70440f19044d8f75c31e1f9 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e; no voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:05:24.969373 19449 leader_election.cc:304] T bc225c93219c45538b53a1bd3d387e4d P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e; no voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:05:24.969848 19560 raft_consensus.cc:1240] T ff75a1d4cb1f493db8f71ddc136ba9ab P e61c3a8f61bb48f8a963c9480e53c168 [term 6 LEADER]: Rejecting Update request from peer 0473d2b2d01f4459b1e90fd12cc7840e for earlier term 5. Current term is 6. Ops: []
I20260709 13:05:24.952335 22163 raft_consensus.cc:515] T a08760e15aac4630a629431f56024dc8 P 0473d2b2d01f4459b1e90fd12cc7840e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:24.882649 21767 raft_consensus.cc:515] T 86a6797bdfe94fa496c050ceae4bd0d9 P 0473d2b2d01f4459b1e90fd12cc7840e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:24.972414 19479 raft_consensus.cc:3060] T a08760e15aac4630a629431f56024dc8 P 0473d2b2d01f4459b1e90fd12cc7840e [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:05:24.966935 19483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14efcc79969f41babe5529c22d59156d" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:05:24.980346 19483 raft_consensus.cc:2376] T 14efcc79969f41babe5529c22d59156d P 0473d2b2d01f4459b1e90fd12cc7840e [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 6. Re-sending same reply.
W20260709 13:05:24.980645 19526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.2:46257, user_credentials={real_user=slave}} blocked reactor thread for 103154us
I20260709 13:05:24.975704 19482 raft_consensus.cc:2468] T b9f0d59553ad444883fcf5b5909f9798 P 0473d2b2d01f4459b1e90fd12cc7840e [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 7.
W20260709 13:05:24.978519 19523 consensus_peers.cc:597] T 7be9efa6559648dbb5a0f7684c4542d1 P e61c3a8f61bb48f8a963c9480e53c168 -> Peer 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121): Couldn't send request to peer 127766fc592545a4997f7790f50f6076. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:05:24.970198 19485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46c5bfeecc314717bffe987e6844b6d0" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 11 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:05:24.982456 19482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4509b76741dc428e9201c70c1658da13" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:05:24.985354 19408 raft_consensus.cc:1240] T 14935b3ddf914369822e4a0547aaa355 P e5256d91808b47c195bc9b4dbd7f2b87 [term 6 FOLLOWER]: Rejecting Update request from peer 0473d2b2d01f4459b1e90fd12cc7840e for earlier term 5. Current term is 6. Ops: []
I20260709 13:05:24.926992 22064 consensus_queue.cc:1048] T 14efcc79969f41babe5529c22d59156d P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.030s
I20260709 13:05:24.880263 22179 raft_consensus.cc:515] T 85c494af21f9457a85da47b9bc70c1fd P 127766fc592545a4997f7790f50f6076 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:05:24.955209 21529 raft_consensus.cc:2749] T 2e36a9d6e29c4a7c860cf267efbd4c74 P e61c3a8f61bb48f8a963c9480e53c168 [term 6 FOLLOWER]: Leader pre-election lost for term 5. Reason: Vote denied by peer 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257) with higher term. Message: Invalid argument: T 2e36a9d6e29c4a7c860cf267efbd4c74 P 0473d2b2d01f4459b1e90fd12cc7840e [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e61c3a8f61bb48f8a963c9480e53c168 for earlier term 5. Current term is 6.
I20260709 13:05:24.878392 22201 raft_consensus.cc:515] T 96efeaaf1057492490e9a621f37e1a2d P 0473d2b2d01f4459b1e90fd12cc7840e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:05:24.948177 22197 raft_consensus.cc:2749] T 5ec1c4ce15e04c7e8c283a62179f2a64 P 0473d2b2d01f4459b1e90fd12cc7840e [term 5 FOLLOWER]: Leader election lost for term 4. Reason: Vote denied by peer e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321) with higher term. Message: Invalid argument: T 5ec1c4ce15e04c7e8c283a62179f2a64 P e5256d91808b47c195bc9b4dbd7f2b87 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 0473d2b2d01f4459b1e90fd12cc7840e for earlier term 4. Current term is 5.
I20260709 13:05:24.990803 19483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40e1e16737a842ee936002830f36882e" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:05:25.008526 19484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36f6ba92b9ba46babe4ebd6c02e5fbd9" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
W20260709 13:05:25.005307 19523 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:24.986032 19477 raft_consensus.cc:2468] T edd7d470b5014c9489be7f41f64355c9 P 0473d2b2d01f4459b1e90fd12cc7840e [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 6.
W20260709 13:05:24.996562 20078 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.2:46257, user_credentials={real_user=slave}} blocked reactor thread for 50290.8us
I20260709 13:05:24.996922 19485 raft_consensus.cc:2393] T 46c5bfeecc314717bffe987e6844b6d0 P 0473d2b2d01f4459b1e90fd12cc7840e [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate e5256d91808b47c195bc9b4dbd7f2b87 in current term 11: Already voted for candidate 0473d2b2d01f4459b1e90fd12cc7840e in this term.
I20260709 13:05:25.006502 19551 raft_consensus.cc:1240] T ed7fdbcb96d14d418db9ca90a792588a P e61c3a8f61bb48f8a963c9480e53c168 [term 4 LEADER]: Rejecting Update request from peer 0473d2b2d01f4459b1e90fd12cc7840e for earlier term 3. Current term is 4. Ops: []
I20260709 13:05:25.008157 19481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df751f992649444090e27965eb1af85d" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:05:24.991436 22172 raft_consensus.cc:3060] T 775c229504194560ba9589bc2199b089 P 127766fc592545a4997f7790f50f6076 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:05:25.015625 19481 raft_consensus.cc:2376] T df751f992649444090e27965eb1af85d P 0473d2b2d01f4459b1e90fd12cc7840e [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 7. Re-sending same reply.
I20260709 13:05:25.022385 19484 raft_consensus.cc:2468] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P 0473d2b2d01f4459b1e90fd12cc7840e [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 8.
I20260709 13:05:25.036502 22201 leader_election.cc:290] T 96efeaaf1057492490e9a621f37e1a2d P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:05:25.037168 19478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28af091831594f9d8e96482078cc7625" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:05:25.038993 19484 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ed7fdbcb96d14d418db9ca90a792588a"
dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
mode: GRACEFUL
new_leader_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
 from {username='slave'} at 127.0.0.1:48168
I20260709 13:05:25.039871 19484 raft_consensus.cc:606] T ed7fdbcb96d14d418db9ca90a792588a P 0473d2b2d01f4459b1e90fd12cc7840e [term 3 LEADER]: Received request to transfer leadership to TS e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:05:25.041442 19481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b08304a0a02b42d7840c4e8ee9a6bd1a" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:05:24.995641 22174 consensus_queue.cc:1048] T 0afb57ae58a24a01850491d69f0213dd P 127766fc592545a4997f7790f50f6076 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.104s
I20260709 13:05:25.043768 20078 leader_election.cc:304] T 14efcc79969f41babe5529c22d59156d P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, 127766fc592545a4997f7790f50f6076; no voters: e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:05:25.045351 22162 raft_consensus.cc:2804] T 14efcc79969f41babe5529c22d59156d P 127766fc592545a4997f7790f50f6076 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:05:25.045804 22162 raft_consensus.cc:493] T 14efcc79969f41babe5529c22d59156d P 127766fc592545a4997f7790f50f6076 [term 6 FOLLOWER]: Starting leader election (detected failure of leader e5256d91808b47c195bc9b4dbd7f2b87)
I20260709 13:05:25.045975 20078 leader_election.cc:304] T 1f85fc4b527a48848e5faa083b604e36 P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, 127766fc592545a4997f7790f50f6076; no voters: e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:05:25.046278 22162 raft_consensus.cc:3060] T 14efcc79969f41babe5529c22d59156d P 127766fc592545a4997f7790f50f6076 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:05:25.061838 18300 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:05:25.071987 21977 tablet_bootstrap.cc:492] T 7be9efa6559648dbb5a0f7684c4542d1 P 127766fc592545a4997f7790f50f6076: Bootstrap complete.
I20260709 13:05:25.073055 21977 ts_tablet_manager.cc:1403] T 7be9efa6559648dbb5a0f7684c4542d1 P 127766fc592545a4997f7790f50f6076: Time spent bootstrapping tablet: real 4.190s	user 0.049s	sys 0.041s
I20260709 13:05:25.024300 19482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e5873a19244c5ebbcd38e126796ee7" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:05:25.047238 19449 leader_election.cc:400] T 3e1f505cb0f1427bbd698ac889d80821 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 5 election: Vote denied by peer e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321) with higher term. Message: Invalid argument: T 3e1f505cb0f1427bbd698ac889d80821 P e5256d91808b47c195bc9b4dbd7f2b87 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 0473d2b2d01f4459b1e90fd12cc7840e for earlier term 5. Current term is 6.
I20260709 13:05:25.051992 19450 leader_election.cc:304] T 0e1085d23e8347fbbd5bce7542f4b1f4 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e; no voters: 127766fc592545a4997f7790f50f6076, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:05:25.001139 22144 consensus_queue.cc:237] T 0cdf56e38bbc453d9438d359e5a69955 P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:25.024849 19479 raft_consensus.cc:2468] T a08760e15aac4630a629431f56024dc8 P 0473d2b2d01f4459b1e90fd12cc7840e [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 7.
I20260709 13:05:25.007545 22127 raft_consensus.cc:2749] T bc225c93219c45538b53a1bd3d387e4d P 0473d2b2d01f4459b1e90fd12cc7840e [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
W20260709 13:05:25.083630 19449 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.1:40321, user_credentials={real_user=slave}} blocked reactor thread for 51407.8us
I20260709 13:05:24.997133 21767 leader_election.cc:290] T 86a6797bdfe94fa496c050ceae4bd0d9 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:05:24.993525 22179 leader_election.cc:290] T 85c494af21f9457a85da47b9bc70c1fd P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:05:24.997179 22184 raft_consensus.cc:2749] T 21e14947d70440f19044d8f75c31e1f9 P 0473d2b2d01f4459b1e90fd12cc7840e [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:05:25.103255 19482 raft_consensus.cc:2393] T d1e5873a19244c5ebbcd38e126796ee7 P 0473d2b2d01f4459b1e90fd12cc7840e [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate e5256d91808b47c195bc9b4dbd7f2b87 in current term 8: Already voted for candidate 0473d2b2d01f4459b1e90fd12cc7840e in this term.
I20260709 13:05:25.104182 19449 leader_election.cc:400] T ef32ce6fdd0e40d382c79974f30295c6 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 6 election: Vote denied by peer e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321) with higher term. Message: Invalid argument: T ef32ce6fdd0e40d382c79974f30295c6 P e5256d91808b47c195bc9b4dbd7f2b87 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 0473d2b2d01f4459b1e90fd12cc7840e for earlier term 6. Current term is 7.
I20260709 13:05:25.105638 19552 raft_consensus.cc:2468] T 14935b3ddf914369822e4a0547aaa355 P e61c3a8f61bb48f8a963c9480e53c168 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 127766fc592545a4997f7790f50f6076 in term 6.
I20260709 13:05:25.106328 19554 raft_consensus.cc:1240] T 14935b3ddf914369822e4a0547aaa355 P e61c3a8f61bb48f8a963c9480e53c168 [term 6 FOLLOWER]: Rejecting Update request from peer 0473d2b2d01f4459b1e90fd12cc7840e for earlier term 5. Current term is 6. Ops: []
I20260709 13:05:25.111483 19485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28af091831594f9d8e96482078cc7625" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:05:24.990279 21957 consensus_queue.cc:1048] T 9962423cb4e54fcfa5de01daf68a86e7 P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Connected to new peer: Peer: permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.098s
I20260709 13:05:25.120651 22209 consensus_queue.cc:1048] T 0afb57ae58a24a01850491d69f0213dd P 127766fc592545a4997f7790f50f6076 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.034s
I20260709 13:05:25.110423 22174 raft_consensus.cc:2804] T 1f85fc4b527a48848e5faa083b604e36 P 127766fc592545a4997f7790f50f6076 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:05:25.087343 22197 raft_consensus.cc:2749] T 0e1085d23e8347fbbd5bce7542f4b1f4 P 0473d2b2d01f4459b1e90fd12cc7840e [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 13:05:25.132700 19449 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.1:40321, user_credentials={real_user=slave}} blocked reactor thread for 48379.3us
W20260709 13:05:25.158492 19450 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.3:36891, user_credentials={real_user=slave}} blocked reactor thread for 106692us
I20260709 13:05:25.179196 19450 leader_election.cc:304] T 309c3ca0ca4b4f3ba129752ea2cb293b P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e; no voters: 127766fc592545a4997f7790f50f6076, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:05:25.185370 19449 leader_election.cc:304] T 2e36a9d6e29c4a7c860cf267efbd4c74 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e; no voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:05:25.190304 19402 raft_consensus.cc:1275] T 7be9efa6559648dbb5a0f7684c4542d1 P e5256d91808b47c195bc9b4dbd7f2b87 [term 7 FOLLOWER]: Refusing update from remote peer e61c3a8f61bb48f8a963c9480e53c168: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:05:25.192843 22250 raft_consensus.cc:3055] T bc225c93219c45538b53a1bd3d387e4d P e5256d91808b47c195bc9b4dbd7f2b87 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:05:25.193367 22250 raft_consensus.cc:740] T bc225c93219c45538b53a1bd3d387e4d P e5256d91808b47c195bc9b4dbd7f2b87 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: e5256d91808b47c195bc9b4dbd7f2b87, State: Running, Role: LEADER
I20260709 13:05:25.193953 22223 raft_consensus.cc:3055] T a08760e15aac4630a629431f56024dc8 P e61c3a8f61bb48f8a963c9480e53c168 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:05:25.194343 22223 raft_consensus.cc:740] T a08760e15aac4630a629431f56024dc8 P e61c3a8f61bb48f8a963c9480e53c168 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: e61c3a8f61bb48f8a963c9480e53c168, State: Running, Role: LEADER
I20260709 13:05:25.195281 22223 consensus_queue.cc:260] T a08760e15aac4630a629431f56024dc8 P e61c3a8f61bb48f8a963c9480e53c168 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:25.196278 22223 raft_consensus.cc:3060] T a08760e15aac4630a629431f56024dc8 P e61c3a8f61bb48f8a963c9480e53c168 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:05:25.197822 19480 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58286 (request call id 1556) took 1984 ms (client timeout 2132 ms). Trace:
W20260709 13:05:25.198247 19480 rpcz_store.cc:269] 0709 13:05:23.213425 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:23.215518 (+  2093us) service_pool.cc:224] Handling call
0709 13:05:25.197606 (+1982088us) spinlock_profiling.cc:243] Waited 1.48 s on lock 0x7b540035cfd4. stack: 00007f4a79de9343 00007f4a79de9240 00007f4a797781d4 00007f4a834b6304 00007f4a834b6299 00007f4a7ce71571 00007f4a7cf0c2fa 00007f4a81ecdb17 00007f4a7b4486d4 00007f4a7b448662 00007f4a7b448591 00007f4a7b44850c 00007f4a7b4477c2 00007f4a7b24348c 00007f4a7b2428c6 00007f4a7b24226f
0709 13:05:25.197770 (+   164us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3393261952}
I20260709 13:05:25.194216 22250 consensus_queue.cc:260] T bc225c93219c45538b53a1bd3d387e4d P e5256d91808b47c195bc9b4dbd7f2b87 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:25.200747 22250 raft_consensus.cc:3060] T bc225c93219c45538b53a1bd3d387e4d P e5256d91808b47c195bc9b4dbd7f2b87 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:05:25.208392 22219 raft_consensus.cc:493] T 48824d5acfbc485ebf8c2d944e7202de P e61c3a8f61bb48f8a963c9480e53c168 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:25.208922 22219 raft_consensus.cc:515] T 48824d5acfbc485ebf8c2d944e7202de P e61c3a8f61bb48f8a963c9480e53c168 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:05:25.218998 19556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86a6797bdfe94fa496c050ceae4bd0d9" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 7 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:05:25.223364 21529 consensus_queue.cc:1048] T 7be9efa6559648dbb5a0f7684c4542d1 P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:05:25.224067 19374 leader_election.cc:304] T fa731b585f684a7fb2d106c50f143b83 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87; no voters: 127766fc592545a4997f7790f50f6076, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:05:25.226083 19559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4509b76741dc428e9201c70c1658da13" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:05:25.192945 22041 raft_consensus.cc:3060] T fa731b585f684a7fb2d106c50f143b83 P 127766fc592545a4997f7790f50f6076 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:05:25.227123 22064 raft_consensus.cc:2749] T fa731b585f684a7fb2d106c50f143b83 P e5256d91808b47c195bc9b4dbd7f2b87 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:05:25.231389 19557 raft_consensus.cc:1275] T 2e36a9d6e29c4a7c860cf267efbd4c74 P e61c3a8f61bb48f8a963c9480e53c168 [term 6 FOLLOWER]: Refusing update from remote peer e5256d91808b47c195bc9b4dbd7f2b87: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:05:25.231755 21932 raft_consensus.cc:2749] T 309c3ca0ca4b4f3ba129752ea2cb293b P 0473d2b2d01f4459b1e90fd12cc7840e [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:05:25.231200 20109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4af19371ea874c09a0a2147040835cbb" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:05:25.236824 19410 raft_consensus.cc:1240] T 775c229504194560ba9589bc2199b089 P e5256d91808b47c195bc9b4dbd7f2b87 [term 5 FOLLOWER]: Rejecting Update request from peer 127766fc592545a4997f7790f50f6076 for earlier term 4. Current term is 5. Ops: []
W20260709 13:05:25.237988 19450 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.3:36891, user_credentials={real_user=slave}} blocked reactor thread for 53555.8us
W20260709 13:05:25.245049 19449 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.1:40321, user_credentials={real_user=slave}} blocked reactor thread for 59800.5us
I20260709 13:05:25.182848 22184 consensus_queue.cc:1059] T 0cdf56e38bbc453d9438d359e5a69955 P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.069s
I20260709 13:05:25.251780 19554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28af091831594f9d8e96482078cc7625" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:05:25.176931 22174 raft_consensus.cc:697] T 1f85fc4b527a48848e5faa083b604e36 P 127766fc592545a4997f7790f50f6076 [term 5 LEADER]: Becoming Leader. State: Replica: 127766fc592545a4997f7790f50f6076, State: Running, Role: LEADER
I20260709 13:05:25.176759 22163 leader_election.cc:290] T a08760e15aac4630a629431f56024dc8 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:05:25.261483 22184 raft_consensus.cc:3055] T 0cdf56e38bbc453d9438d359e5a69955 P 0473d2b2d01f4459b1e90fd12cc7840e [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:05:25.261380 21932 consensus_queue.cc:1048] T 217b5fae677b4971b3bbd2f357a1f7ff P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:05:25.262027 22184 raft_consensus.cc:740] T 0cdf56e38bbc453d9438d359e5a69955 P 0473d2b2d01f4459b1e90fd12cc7840e [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 0473d2b2d01f4459b1e90fd12cc7840e, State: Running, Role: LEADER
I20260709 13:05:25.262995 22254 leader_election.cc:290] T 4af19371ea874c09a0a2147040835cbb P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:05:25.262928 22184 consensus_queue.cc:260] T 0cdf56e38bbc453d9438d359e5a69955 P 0473d2b2d01f4459b1e90fd12cc7840e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:25.267195 19449 leader_election.cc:304] T 2b74109013a140ada21feeef92d6f563 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87; no voters: e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:05:25.268188 19556 raft_consensus.cc:1275] T 65d8cb8d6ec64f459d5a47cefab10acf P e61c3a8f61bb48f8a963c9480e53c168 [term 4 FOLLOWER]: Refusing update from remote peer e5256d91808b47c195bc9b4dbd7f2b87: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 5. (term mismatch)
I20260709 13:05:25.268599 19556 pending_rounds.cc:85] T 65d8cb8d6ec64f459d5a47cefab10acf P e61c3a8f61bb48f8a963c9480e53c168: Aborting all ops after (but not including) 4
I20260709 13:05:25.269964 20109 raft_consensus.cc:1275] T ed7fdbcb96d14d418db9ca90a792588a P 127766fc592545a4997f7790f50f6076 [term 4 FOLLOWER]: Refusing update from remote peer e61c3a8f61bb48f8a963c9480e53c168: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:05:25.268810 19556 pending_rounds.cc:107] T 65d8cb8d6ec64f459d5a47cefab10acf P e61c3a8f61bb48f8a963c9480e53c168: Aborting uncommitted NO_OP operation due to leader change: 3.5
I20260709 13:05:25.271790 18300 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:05:25.274907 19556 raft_consensus.cc:2889] T 65d8cb8d6ec64f459d5a47cefab10acf P e61c3a8f61bb48f8a963c9480e53c168 [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:05:25.258515 22197 raft_consensus.cc:2749] T 2e36a9d6e29c4a7c860cf267efbd4c74 P 0473d2b2d01f4459b1e90fd12cc7840e [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:05:25.155287 22049 consensus_queue.cc:237] T b08304a0a02b42d7840c4e8ee9a6bd1a P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:25.306550 21559 raft_consensus.cc:493] T 46c5bfeecc314717bffe987e6844b6d0 P e61c3a8f61bb48f8a963c9480e53c168 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:25.277987 19554 raft_consensus.cc:1275] T ece3db938bc649d4a40a51522ed5259c P e61c3a8f61bb48f8a963c9480e53c168 [term 6 FOLLOWER]: Refusing update from remote peer e5256d91808b47c195bc9b4dbd7f2b87: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
W20260709 13:05:25.319214 19523 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:05:25.277385 19377 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.2:46257, user_credentials={real_user=slave}} blocked reactor thread for 315018us
W20260709 13:05:25.275861 20076 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.3:36891, user_credentials={real_user=slave}} blocked reactor thread for 333825us
I20260709 13:05:25.306211 22171 raft_consensus.cc:2804] T ece3db938bc649d4a40a51522ed5259c P 127766fc592545a4997f7790f50f6076 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:05:25.321997 22184 raft_consensus.cc:3060] T 0cdf56e38bbc453d9438d359e5a69955 P 0473d2b2d01f4459b1e90fd12cc7840e [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:05:25.327286 22180 consensus_queue.cc:1059] T 22196caba61445d3bec98a0aab3c337d P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.056s
I20260709 13:05:25.327500 21977 raft_consensus.cc:359] T 7be9efa6559648dbb5a0f7684c4542d1 P 127766fc592545a4997f7790f50f6076 [term 5 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } attrs { replace: true } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: NON_VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: true } }
I20260709 13:05:25.328229 22180 raft_consensus.cc:3055] T 22196caba61445d3bec98a0aab3c337d P 0473d2b2d01f4459b1e90fd12cc7840e [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:05:25.328346 21977 raft_consensus.cc:740] T 7be9efa6559648dbb5a0f7684c4542d1 P 127766fc592545a4997f7790f50f6076 [term 5 LEARNER]: Becoming Follower/Learner. State: Replica: 127766fc592545a4997f7790f50f6076, State: Initialized, Role: LEARNER
I20260709 13:05:25.328681 22180 raft_consensus.cc:740] T 22196caba61445d3bec98a0aab3c337d P 0473d2b2d01f4459b1e90fd12cc7840e [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 0473d2b2d01f4459b1e90fd12cc7840e, State: Running, Role: LEADER
W20260709 13:05:25.329245 20077 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:25.329138 21977 consensus_queue.cc:260] T 7be9efa6559648dbb5a0f7684c4542d1 P 127766fc592545a4997f7790f50f6076 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } attrs { replace: true } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: NON_VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: true } }
I20260709 13:05:25.329531 22180 consensus_queue.cc:260] T 22196caba61445d3bec98a0aab3c337d P 0473d2b2d01f4459b1e90fd12cc7840e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:25.330868 20106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48824d5acfbc485ebf8c2d944e7202de" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:05:25.331120 21559 raft_consensus.cc:515] T 46c5bfeecc314717bffe987e6844b6d0 P e61c3a8f61bb48f8a963c9480e53c168 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:25.331660 20106 raft_consensus.cc:2468] T 48824d5acfbc485ebf8c2d944e7202de P 127766fc592545a4997f7790f50f6076 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 6.
I20260709 13:05:25.333106 21559 leader_election.cc:290] T 46c5bfeecc314717bffe987e6844b6d0 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:05:25.335618 22174 consensus_queue.cc:237] T 1f85fc4b527a48848e5faa083b604e36 P 127766fc592545a4997f7790f50f6076 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:05:25.336201 22171 raft_consensus.cc:493] T ece3db938bc649d4a40a51522ed5259c P 127766fc592545a4997f7790f50f6076 [term 6 FOLLOWER]: Starting leader election (detected failure of leader e5256d91808b47c195bc9b4dbd7f2b87)
I20260709 13:05:25.337615 21767 consensus_queue.cc:1059] T ff75a1d4cb1f493db8f71ddc136ba9ab P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:05:25.337800 21963 consensus_queue.cc:1059] T 1a61655d99124a29b486ba4a5b37faea P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:05:25.338541 21767 consensus_queue.cc:1243] T ff75a1d4cb1f493db8f71ddc136ba9ab P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Peer e61c3a8f61bb48f8a963c9480e53c168 log is divergent from this leader: its last log entry 6.4 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 3
W20260709 13:05:25.330943 19449 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.1:40321, user_credentials={real_user=slave}} blocked reactor thread for 63876.7us
I20260709 13:05:25.344491 19559 raft_consensus.cc:1275] T 2725d2c4cb054f18b0fc8f735c15f6c2 P e61c3a8f61bb48f8a963c9480e53c168 [term 8 FOLLOWER]: Refusing update from remote peer e5256d91808b47c195bc9b4dbd7f2b87: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 8 index: 4. (index mismatch)
I20260709 13:05:25.346527 19449 leader_election.cc:304] T 775c229504194560ba9589bc2199b089 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87; no voters: 127766fc592545a4997f7790f50f6076
I20260709 13:05:25.346765 19523 leader_election.cc:304] T 48824d5acfbc485ebf8c2d944e7202de P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 127766fc592545a4997f7790f50f6076, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:05:25.379114 19556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4af19371ea874c09a0a2147040835cbb" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:05:25.336830 22171 raft_consensus.cc:3060] T ece3db938bc649d4a40a51522ed5259c P 127766fc592545a4997f7790f50f6076 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:05:25.320039 22127 raft_consensus.cc:2804] T 2b74109013a140ada21feeef92d6f563 P 0473d2b2d01f4459b1e90fd12cc7840e [term 4 FOLLOWER]: Leader election won for term 4
W20260709 13:05:25.339738 22261 log.cc:927] Time spent T 70797e5783b5454ab0d0eea663e791e3 P 127766fc592545a4997f7790f50f6076: Append to log took a long time: real 0.073s	user 0.000s	sys 0.000s
I20260709 13:05:25.276335 22219 leader_election.cc:290] T 48824d5acfbc485ebf8c2d944e7202de P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:05:25.384596 20076 leader_election.cc:304] T 14935b3ddf914369822e4a0547aaa355 P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 127766fc592545a4997f7790f50f6076, e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168; no voters: 0473d2b2d01f4459b1e90fd12cc7840e
W20260709 13:05:25.423712 20078 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.2:46257, user_credentials={real_user=slave}} blocked reactor thread for 377769us
I20260709 13:05:25.402099 21559 raft_consensus.cc:493] T edd7d470b5014c9489be7f41f64355c9 P e61c3a8f61bb48f8a963c9480e53c168 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:25.347266 22180 raft_consensus.cc:3060] T 22196caba61445d3bec98a0aab3c337d P 0473d2b2d01f4459b1e90fd12cc7840e [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:05:25.391853 19449 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.1:40321, user_credentials={real_user=slave}} blocked reactor thread for 45407.2us
I20260709 13:05:25.434564 21559 raft_consensus.cc:515] T edd7d470b5014c9489be7f41f64355c9 P e61c3a8f61bb48f8a963c9480e53c168 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
W20260709 13:05:25.435850 19377 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.2:46257, user_credentials={real_user=slave}} blocked reactor thread for 49247.7us
I20260709 13:05:25.432045 19405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46c5bfeecc314717bffe987e6844b6d0" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 12 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:05:25.441762 19555 raft_consensus.cc:1240] T 2725d2c4cb054f18b0fc8f735c15f6c2 P e61c3a8f61bb48f8a963c9480e53c168 [term 8 FOLLOWER]: Rejecting Update request from peer 0473d2b2d01f4459b1e90fd12cc7840e for earlier term 7. Current term is 8. Ops: [7.4-7.4]
I20260709 13:05:25.308851 22163 consensus_queue.cc:1059] T b08304a0a02b42d7840c4e8ee9a6bd1a P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.110s
I20260709 13:05:25.457105 19449 leader_election.cc:304] T d1e5873a19244c5ebbcd38e126796ee7 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e; no voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:05:25.308681 22185 consensus_queue.cc:1048] T ed7fdbcb96d14d418db9ca90a792588a P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Connected to new peer: Peer: permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.113s
I20260709 13:05:25.451499 19407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85c494af21f9457a85da47b9bc70c1fd" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:05:25.339584 22076 consensus_queue.cc:1059] T 14935b3ddf914369822e4a0547aaa355 P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.082s
I20260709 13:05:25.459052 19405 raft_consensus.cc:2468] T 46c5bfeecc314717bffe987e6844b6d0 P e5256d91808b47c195bc9b4dbd7f2b87 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 11.
W20260709 13:05:25.459182 20076 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.3:36891, user_credentials={real_user=slave}} blocked reactor thread for 80919.4us
I20260709 13:05:25.453872 19556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86a6797bdfe94fa496c050ceae4bd0d9" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 7 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:05:25.453989 19554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96efeaaf1057492490e9a621f37e1a2d" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:05:25.419229 22197 raft_consensus.cc:2804] T 775c229504194560ba9589bc2199b089 P 0473d2b2d01f4459b1e90fd12cc7840e [term 5 FOLLOWER]: Leader election won for term 5
W20260709 13:05:25.477128 19377 leader_election.cc:336] T 3e1f505cb0f1427bbd698ac889d80821 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257): Timed out: RequestConsensusVote RPC to 127.17.223.2:46257 timed out after 1.628s (SENT)
I20260709 13:05:25.478981 19557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a08760e15aac4630a629431f56024dc8" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:05:25.460492 19560 raft_consensus.cc:1275] T 62c6c134d3d24a1ab144dd9ee6bc3f64 P e61c3a8f61bb48f8a963c9480e53c168 [term 8 FOLLOWER]: Refusing update from remote peer 0473d2b2d01f4459b1e90fd12cc7840e: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 13:05:25.383896 21529 raft_consensus.cc:2804] T 48824d5acfbc485ebf8c2d944e7202de P e61c3a8f61bb48f8a963c9480e53c168 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:05:25.473583 19523 leader_election.cc:304] T 46c5bfeecc314717bffe987e6844b6d0 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:05:25.386219 22056 consensus_queue.cc:1048] T 833a2f0775ed407a94b8924ce50adb63 P 127766fc592545a4997f7790f50f6076 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.075s
I20260709 13:05:25.339354 22201 consensus_queue.cc:1059] T ed7fdbcb96d14d418db9ca90a792588a P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.108s
I20260709 13:05:25.481037 19554 raft_consensus.cc:2468] T 96efeaaf1057492490e9a621f37e1a2d P e61c3a8f61bb48f8a963c9480e53c168 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 6.
I20260709 13:05:25.486395 19479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86a6797bdfe94fa496c050ceae4bd0d9" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 7 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:05:25.489216 19403 raft_consensus.cc:1240] T 0cdf56e38bbc453d9438d359e5a69955 P e5256d91808b47c195bc9b4dbd7f2b87 [term 9 LEADER]: Rejecting Update request from peer 0473d2b2d01f4459b1e90fd12cc7840e for earlier term 8. Current term is 9. Ops: []
I20260709 13:05:25.493235 19479 raft_consensus.cc:2468] T 86a6797bdfe94fa496c050ceae4bd0d9 P 0473d2b2d01f4459b1e90fd12cc7840e [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 6.
I20260709 13:05:25.420121 22064 consensus_queue.cc:1048] T 2725d2c4cb054f18b0fc8f735c15f6c2 P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.055s
I20260709 13:05:25.381951 22254 consensus_queue.cc:1048] T 2e36a9d6e29c4a7c860cf267efbd4c74 P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.094s
I20260709 13:05:25.503089 19553 raft_consensus.cc:1275] T 96efeaaf1057492490e9a621f37e1a2d P e61c3a8f61bb48f8a963c9480e53c168 [term 6 FOLLOWER]: Refusing update from remote peer 127766fc592545a4997f7790f50f6076: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:05:25.503568 21767 raft_consensus.cc:3055] T 1a61655d99124a29b486ba4a5b37faea P 0473d2b2d01f4459b1e90fd12cc7840e [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:05:25.504033 21767 raft_consensus.cc:740] T 1a61655d99124a29b486ba4a5b37faea P 0473d2b2d01f4459b1e90fd12cc7840e [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 0473d2b2d01f4459b1e90fd12cc7840e, State: Running, Role: LEADER
I20260709 13:05:25.504199 19553 raft_consensus.cc:1240] T fa731b585f684a7fb2d106c50f143b83 P e61c3a8f61bb48f8a963c9480e53c168 [term 5 FOLLOWER]: Rejecting Update request from peer 127766fc592545a4997f7790f50f6076 for earlier term 4. Current term is 5. Ops: []
I20260709 13:05:25.505062 21767 consensus_queue.cc:260] T 1a61655d99124a29b486ba4a5b37faea P 0473d2b2d01f4459b1e90fd12cc7840e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:25.507170 22194 raft_consensus.cc:3055] T ff75a1d4cb1f493db8f71ddc136ba9ab P 0473d2b2d01f4459b1e90fd12cc7840e [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:05:25.507656 22194 raft_consensus.cc:740] T ff75a1d4cb1f493db8f71ddc136ba9ab P 0473d2b2d01f4459b1e90fd12cc7840e [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 0473d2b2d01f4459b1e90fd12cc7840e, State: Running, Role: LEADER
I20260709 13:05:25.508662 22194 consensus_queue.cc:260] T ff75a1d4cb1f493db8f71ddc136ba9ab P 0473d2b2d01f4459b1e90fd12cc7840e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:25.509831 22194 raft_consensus.cc:3060] T ff75a1d4cb1f493db8f71ddc136ba9ab P 0473d2b2d01f4459b1e90fd12cc7840e [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:05:25.513375 19451 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:25.513548 19484 raft_consensus.cc:1240] T bc225c93219c45538b53a1bd3d387e4d P 0473d2b2d01f4459b1e90fd12cc7840e [term 9 FOLLOWER]: Rejecting Update request from peer e5256d91808b47c195bc9b4dbd7f2b87 for earlier term 8. Current term is 9. Ops: [8.5-8.5]
I20260709 13:05:25.515097 19305 catalog_manager.cc:5697] T 309c3ca0ca4b4f3ba129752ea2cb293b P e61c3a8f61bb48f8a963c9480e53c168 reported cstate change: term changed from 5 to 6, leader changed from e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1) to e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3). New cstate: current_term: 6 leader_uuid: "e61c3a8f61bb48f8a963c9480e53c168" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:25.518895 19482 raft_consensus.cc:1275] T f1b10566f45d4a7d9029858330e02d5b P 0473d2b2d01f4459b1e90fd12cc7840e [term 8 FOLLOWER]: Refusing update from remote peer e5256d91808b47c195bc9b4dbd7f2b87: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
W20260709 13:05:25.519068 19293 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 309c3ca0ca4b4f3ba129752ea2cb293b with cas_config_opid_index 5: ChangeConfig:REMOVE_PEER failed with leader e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica e5256d91808b47c195bc9b4dbd7f2b87 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 6 leader_uuid: "e61c3a8f61bb48f8a963c9480e53c168" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } attrs { replace: true } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } } }
I20260709 13:05:25.520188 22057 raft_consensus.cc:3055] T b08304a0a02b42d7840c4e8ee9a6bd1a P 0473d2b2d01f4459b1e90fd12cc7840e [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:05:25.520568 22057 raft_consensus.cc:740] T b08304a0a02b42d7840c4e8ee9a6bd1a P 0473d2b2d01f4459b1e90fd12cc7840e [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 0473d2b2d01f4459b1e90fd12cc7840e, State: Running, Role: LEADER
I20260709 13:05:25.521414 22057 consensus_queue.cc:260] T b08304a0a02b42d7840c4e8ee9a6bd1a P 0473d2b2d01f4459b1e90fd12cc7840e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:25.390161 22063 consensus_queue.cc:1048] T 65d8cb8d6ec64f459d5a47cefab10acf P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.089s
I20260709 13:05:25.456072 22127 raft_consensus.cc:697] T 2b74109013a140ada21feeef92d6f563 P 0473d2b2d01f4459b1e90fd12cc7840e [term 4 LEADER]: Becoming Leader. State: Replica: 0473d2b2d01f4459b1e90fd12cc7840e, State: Running, Role: LEADER
I20260709 13:05:25.532624 22127 consensus_queue.cc:237] T 2b74109013a140ada21feeef92d6f563 P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:25.535918 21977 ts_tablet_manager.cc:1434] T 7be9efa6559648dbb5a0f7684c4542d1 P 127766fc592545a4997f7790f50f6076: Time spent starting tablet: real 0.462s	user 0.000s	sys 0.010s
I20260709 13:05:25.539474 19556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85c494af21f9457a85da47b9bc70c1fd" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:05:25.494379 21559 leader_election.cc:290] T edd7d470b5014c9489be7f41f64355c9 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:05:25.495421 19480 raft_consensus.cc:1275] T 2e36a9d6e29c4a7c860cf267efbd4c74 P 0473d2b2d01f4459b1e90fd12cc7840e [term 6 FOLLOWER]: Refusing update from remote peer e5256d91808b47c195bc9b4dbd7f2b87: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:05:25.499323 19486 raft_consensus.cc:1275] T 21e14947d70440f19044d8f75c31e1f9 P 0473d2b2d01f4459b1e90fd12cc7840e [term 7 FOLLOWER]: Refusing update from remote peer e5256d91808b47c195bc9b4dbd7f2b87: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:05:25.458647 21963 raft_consensus.cc:493] T df751f992649444090e27965eb1af85d P 0473d2b2d01f4459b1e90fd12cc7840e [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:25.541754 21963 raft_consensus.cc:515] T df751f992649444090e27965eb1af85d P 0473d2b2d01f4459b1e90fd12cc7840e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:25.543920 21963 leader_election.cc:290] T df751f992649444090e27965eb1af85d P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
W20260709 13:05:25.544411 19449 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.1:40321, user_credentials={real_user=slave}} blocked reactor thread for 100533us
I20260709 13:05:25.500748 22027 raft_consensus.cc:2804] T 46c5bfeecc314717bffe987e6844b6d0 P e61c3a8f61bb48f8a963c9480e53c168 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:05:25.475558 22209 raft_consensus.cc:2804] T 14935b3ddf914369822e4a0547aaa355 P 127766fc592545a4997f7790f50f6076 [term 6 FOLLOWER]: Leader election won for term 6
W20260709 13:05:25.545681 19452 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:25.546600 19486 raft_consensus.cc:1275] T 96efeaaf1057492490e9a621f37e1a2d P 0473d2b2d01f4459b1e90fd12cc7840e [term 6 FOLLOWER]: Refusing update from remote peer 127766fc592545a4997f7790f50f6076: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 7. (term mismatch)
I20260709 13:05:25.560412 19486 pending_rounds.cc:85] T 96efeaaf1057492490e9a621f37e1a2d P 0473d2b2d01f4459b1e90fd12cc7840e: Aborting all ops after (but not including) 6
I20260709 13:05:25.560737 19486 pending_rounds.cc:107] T 96efeaaf1057492490e9a621f37e1a2d P 0473d2b2d01f4459b1e90fd12cc7840e: Aborting uncommitted NO_OP operation due to leader change: 5.7
I20260709 13:05:25.561020 19486 raft_consensus.cc:2889] T 96efeaaf1057492490e9a621f37e1a2d P 0473d2b2d01f4459b1e90fd12cc7840e [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:05:25.548086 22201 consensus_queue.cc:1243] T ed7fdbcb96d14d418db9ca90a792588a P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Peer e61c3a8f61bb48f8a963c9480e53c168 log is divergent from this leader: its last log entry 4.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 13:05:25.546633 22076 raft_consensus.cc:3055] T 14935b3ddf914369822e4a0547aaa355 P 0473d2b2d01f4459b1e90fd12cc7840e [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:05:25.548532 21932 consensus_queue.cc:1059] T 2725d2c4cb054f18b0fc8f735c15f6c2 P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:05:25.550776 19556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df751f992649444090e27965eb1af85d" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:05:25.544771 19377 leader_election.cc:304] T f93ee515a9c14139bf566522ed8232f3 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:05:25.552644 19478 raft_consensus.cc:3055] T 9962423cb4e54fcfa5de01daf68a86e7 P 0473d2b2d01f4459b1e90fd12cc7840e [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:05:25.563679 19478 raft_consensus.cc:740] T 9962423cb4e54fcfa5de01daf68a86e7 P 0473d2b2d01f4459b1e90fd12cc7840e [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 0473d2b2d01f4459b1e90fd12cc7840e, State: Running, Role: LEADER
W20260709 13:05:25.500458 22252 log.cc:927] Time spent T 2725d2c4cb054f18b0fc8f735c15f6c2 P e5256d91808b47c195bc9b4dbd7f2b87: Append to log took a long time: real 0.312s	user 0.002s	sys 0.000s
I20260709 13:05:25.544488 21963 raft_consensus.cc:2749] T d1e5873a19244c5ebbcd38e126796ee7 P 0473d2b2d01f4459b1e90fd12cc7840e [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:05:25.563287 22076 raft_consensus.cc:740] T 14935b3ddf914369822e4a0547aaa355 P 0473d2b2d01f4459b1e90fd12cc7840e [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 0473d2b2d01f4459b1e90fd12cc7840e, State: Running, Role: LEADER
I20260709 13:05:25.565523 21932 raft_consensus.cc:3055] T 2725d2c4cb054f18b0fc8f735c15f6c2 P 0473d2b2d01f4459b1e90fd12cc7840e [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:05:25.566869 22041 consensus_queue.cc:1048] T 5ec1c4ce15e04c7e8c283a62179f2a64 P 127766fc592545a4997f7790f50f6076 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:05:25.484135 21529 raft_consensus.cc:493] T 48824d5acfbc485ebf8c2d944e7202de P e61c3a8f61bb48f8a963c9480e53c168 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:25.563263 22027 raft_consensus.cc:493] T 46c5bfeecc314717bffe987e6844b6d0 P e61c3a8f61bb48f8a963c9480e53c168 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:25.627187 22027 raft_consensus.cc:3060] T 46c5bfeecc314717bffe987e6844b6d0 P e61c3a8f61bb48f8a963c9480e53c168 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:05:25.567134 19478 consensus_queue.cc:260] T 9962423cb4e54fcfa5de01daf68a86e7 P 0473d2b2d01f4459b1e90fd12cc7840e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:05:25.567987 19556 raft_consensus.cc:2468] T df751f992649444090e27965eb1af85d P e61c3a8f61bb48f8a963c9480e53c168 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 7.
W20260709 13:05:25.568142 20075 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:05:25.569465 21926 consensus_meta.cc:287] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P e5256d91808b47c195bc9b4dbd7f2b87: Time spent flushing consensus metadata: real 0.581s	user 0.005s	sys 0.002s
I20260709 13:05:25.570947 22209 raft_consensus.cc:697] T 14935b3ddf914369822e4a0547aaa355 P 127766fc592545a4997f7790f50f6076 [term 6 LEADER]: Becoming Leader. State: Replica: 127766fc592545a4997f7790f50f6076, State: Running, Role: LEADER
I20260709 13:05:25.572475 21823 raft_consensus.cc:2749] T f93ee515a9c14139bf566522ed8232f3 P e5256d91808b47c195bc9b4dbd7f2b87 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:05:25.573297 19377 leader_election.cc:304] T 22196caba61445d3bec98a0aab3c337d P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:05:25.574434 22208 consensus_queue.cc:1048] T 96efeaaf1057492490e9a621f37e1a2d P 127766fc592545a4997f7790f50f6076 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:05:25.561074 22197 raft_consensus.cc:697] T 775c229504194560ba9589bc2199b089 P 0473d2b2d01f4459b1e90fd12cc7840e [term 5 LEADER]: Becoming Leader. State: Replica: 0473d2b2d01f4459b1e90fd12cc7840e, State: Running, Role: LEADER
I20260709 13:05:25.582824 21559 raft_consensus.cc:493] T ef32ce6fdd0e40d382c79974f30295c6 P e61c3a8f61bb48f8a963c9480e53c168 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:25.585343 19375 leader_election.cc:304] T 4af19371ea874c09a0a2147040835cbb P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87; no voters: 127766fc592545a4997f7790f50f6076, e61c3a8f61bb48f8a963c9480e53c168
W20260709 13:05:25.586313 19376 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:25.586031 22166 consensus_queue.cc:1048] T ece3db938bc649d4a40a51522ed5259c P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:05:25.607507 21932 raft_consensus.cc:740] T 2725d2c4cb054f18b0fc8f735c15f6c2 P 0473d2b2d01f4459b1e90fd12cc7840e [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 0473d2b2d01f4459b1e90fd12cc7840e, State: Running, Role: LEADER
I20260709 13:05:25.629479 21529 raft_consensus.cc:3060] T 48824d5acfbc485ebf8c2d944e7202de P e61c3a8f61bb48f8a963c9480e53c168 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:05:25.590173 22172 consensus_meta.cc:287] T 775c229504194560ba9589bc2199b089 P 127766fc592545a4997f7790f50f6076: Time spent flushing consensus metadata: real 0.559s	user 0.007s	sys 0.003s
I20260709 13:05:25.591158 19449 leader_election.cc:304] T f1b10566f45d4a7d9029858330e02d5b P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e; no voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:05:25.592734 19496 tablet_copy_service.cc:342] P 0473d2b2d01f4459b1e90fd12cc7840e: Request end of tablet copy session 127766fc592545a4997f7790f50f6076-7be9efa6559648dbb5a0f7684c4542d1 received from {username='slave'} at 127.0.0.1:39478
I20260709 13:05:25.593552 19450 leader_election.cc:304] T 96efeaaf1057492490e9a621f37e1a2d P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:05:25.594738 21700 consensus_queue.cc:1048] T 62c6c134d3d24a1ab144dd9ee6bc3f64 P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:05:25.506493 21767 raft_consensus.cc:3060] T 1a61655d99124a29b486ba4a5b37faea P 0473d2b2d01f4459b1e90fd12cc7840e [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:05:25.628849 19478 raft_consensus.cc:3060] T 9962423cb4e54fcfa5de01daf68a86e7 P 0473d2b2d01f4459b1e90fd12cc7840e [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:05:25.629853 20075 leader_election.cc:304] T 172b3dd13109415a955b71ac0e9d2234 P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 127766fc592545a4997f7790f50f6076; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:05:25.564842 22057 raft_consensus.cc:3060] T b08304a0a02b42d7840c4e8ee9a6bd1a P 0473d2b2d01f4459b1e90fd12cc7840e [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:05:25.606139 22162 consensus_meta.cc:287] T 14efcc79969f41babe5529c22d59156d P 127766fc592545a4997f7790f50f6076: Time spent flushing consensus metadata: real 0.549s	user 0.011s	sys 0.000s
I20260709 13:05:25.657420 22162 raft_consensus.cc:515] T 14efcc79969f41babe5529c22d59156d P 127766fc592545a4997f7790f50f6076 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
W20260709 13:05:25.633738 22195 consensus_meta.cc:287] T 1f85fc4b527a48848e5faa083b604e36 P e5256d91808b47c195bc9b4dbd7f2b87: Time spent flushing consensus metadata: real 0.693s	user 0.009s	sys 0.001s
I20260709 13:05:25.659654 22162 leader_election.cc:290] T 14efcc79969f41babe5529c22d59156d P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 7 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:05:25.650657 21963 raft_consensus.cc:2804] T 96efeaaf1057492490e9a621f37e1a2d P 0473d2b2d01f4459b1e90fd12cc7840e [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:05:25.662084 22171 raft_consensus.cc:515] T ece3db938bc649d4a40a51522ed5259c P 127766fc592545a4997f7790f50f6076 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:05:25.662863 21963 raft_consensus.cc:493] T 96efeaaf1057492490e9a621f37e1a2d P 0473d2b2d01f4459b1e90fd12cc7840e [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:25.663280 21963 raft_consensus.cc:3060] T 96efeaaf1057492490e9a621f37e1a2d P 0473d2b2d01f4459b1e90fd12cc7840e [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:05:25.645977 19450 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.3:36891, user_credentials={real_user=slave}} blocked reactor thread for 52514us
I20260709 13:05:25.664376 19478 raft_consensus.cc:1275] T 9962423cb4e54fcfa5de01daf68a86e7 P 0473d2b2d01f4459b1e90fd12cc7840e [term 10 FOLLOWER]: Refusing update from remote peer e5256d91808b47c195bc9b4dbd7f2b87: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:05:25.666419 22171 leader_election.cc:290] T ece3db938bc649d4a40a51522ed5259c P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 7 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:05:25.643004 21559 raft_consensus.cc:515] T ef32ce6fdd0e40d382c79974f30295c6 P e61c3a8f61bb48f8a963c9480e53c168 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:25.668207 19478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14efcc79969f41babe5529c22d59156d" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:05:25.669529 21559 leader_election.cc:290] T ef32ce6fdd0e40d382c79974f30295c6 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:05:25.669950 22264 raft_consensus.cc:3060] T 172b3dd13109415a955b71ac0e9d2234 P 127766fc592545a4997f7790f50f6076 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:05:25.671700 19377 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.2:46257, user_credentials={real_user=slave}} blocked reactor thread for 98502.6us
I20260709 13:05:25.672531 19377 leader_election.cc:304] T 3e1f505cb0f1427bbd698ac889d80821 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:05:25.674203 19377 leader_election.cc:304] T 1dc5b3532fe54f74876d02beffa2c230 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87; no voters: e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:05:25.674945 22251 raft_consensus.cc:2749] T 3e1f505cb0f1427bbd698ac889d80821 P e5256d91808b47c195bc9b4dbd7f2b87 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:05:25.588304 22180 raft_consensus.cc:493] T 3e1f505cb0f1427bbd698ac889d80821 P 0473d2b2d01f4459b1e90fd12cc7840e [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:25.645352 19557 raft_consensus.cc:2468] T a08760e15aac4630a629431f56024dc8 P e61c3a8f61bb48f8a963c9480e53c168 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 7.
I20260709 13:05:25.654803 19496 tablet_copy_service.cc:434] P 0473d2b2d01f4459b1e90fd12cc7840e: ending tablet copy session 127766fc592545a4997f7790f50f6076-7be9efa6559648dbb5a0f7684c4542d1 on tablet 7be9efa6559648dbb5a0f7684c4542d1 with peer 127766fc592545a4997f7790f50f6076
I20260709 13:05:25.654878 22144 raft_consensus.cc:2749] T 22196caba61445d3bec98a0aab3c337d P e5256d91808b47c195bc9b4dbd7f2b87 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:05:25.655139 22220 raft_consensus.cc:2749] T f1b10566f45d4a7d9029858330e02d5b P 0473d2b2d01f4459b1e90fd12cc7840e [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:05:25.651151 21962 raft_consensus.cc:2749] T 4af19371ea874c09a0a2147040835cbb P e5256d91808b47c195bc9b4dbd7f2b87 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 13:05:25.647303 19375 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.3:36891, user_credentials={real_user=slave}} blocked reactor thread for 62074.2us
I20260709 13:05:25.675148 22197 consensus_queue.cc:237] T 775c229504194560ba9589bc2199b089 P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:05:25.679180 19405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ece3db938bc649d4a40a51522ed5259c" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
W20260709 13:05:25.682485 19449 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.1:40321, user_credentials={real_user=slave}} blocked reactor thread for 118273us
I20260709 13:05:25.683250 19449 leader_election.cc:304] T fa8650e71aa14778b3d73721fc50d9fc P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87; no voters: e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:05:25.687263 19408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14efcc79969f41babe5529c22d59156d" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
I20260709 13:05:25.634537 21926 raft_consensus.cc:515] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P e5256d91808b47c195bc9b4dbd7f2b87 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:05:25.699697 19449 leader_election.cc:304] T 4509b76741dc428e9201c70c1658da13 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87; no voters: e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:05:25.699457 21700 raft_consensus.cc:2804] T fa8650e71aa14778b3d73721fc50d9fc P 0473d2b2d01f4459b1e90fd12cc7840e [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:05:25.681751 22180 raft_consensus.cc:515] T 3e1f505cb0f1427bbd698ac889d80821 P 0473d2b2d01f4459b1e90fd12cc7840e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:25.740623 19449 leader_election.cc:400] T f93ee515a9c14139bf566522ed8232f3 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 8 election: Vote denied by peer e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321) with higher term. Message: Invalid argument: T f93ee515a9c14139bf566522ed8232f3 P e5256d91808b47c195bc9b4dbd7f2b87 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 0473d2b2d01f4459b1e90fd12cc7840e for earlier term 8. Current term is 9.
I20260709 13:05:25.723147 22144 raft_consensus.cc:2804] T 1dc5b3532fe54f74876d02beffa2c230 P e5256d91808b47c195bc9b4dbd7f2b87 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:05:25.722486 22201 raft_consensus.cc:493] T ab43d85f64114d4ebf618930e43d9ed0 P 0473d2b2d01f4459b1e90fd12cc7840e [term 5 FOLLOWER]: Starting pre-election (detected failure of leader e61c3a8f61bb48f8a963c9480e53c168)
I20260709 13:05:25.722884 21700 raft_consensus.cc:493] T fa8650e71aa14778b3d73721fc50d9fc P 0473d2b2d01f4459b1e90fd12cc7840e [term 7 FOLLOWER]: Starting leader election (detected failure of leader e61c3a8f61bb48f8a963c9480e53c168)
I20260709 13:05:25.751399 19449 leader_election.cc:304] T 76cb037fc9064d13b59a8969d897ce8c P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e; no voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:05:25.751940 22163 raft_consensus.cc:3055] T ed7fdbcb96d14d418db9ca90a792588a P 0473d2b2d01f4459b1e90fd12cc7840e [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:05:25.774101 22163 raft_consensus.cc:740] T ed7fdbcb96d14d418db9ca90a792588a P 0473d2b2d01f4459b1e90fd12cc7840e [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 0473d2b2d01f4459b1e90fd12cc7840e, State: Running, Role: LEADER
I20260709 13:05:25.775146 22163 consensus_queue.cc:260] T ed7fdbcb96d14d418db9ca90a792588a P 0473d2b2d01f4459b1e90fd12cc7840e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:05:25.776383 22163 raft_consensus.cc:3060] T ed7fdbcb96d14d418db9ca90a792588a P 0473d2b2d01f4459b1e90fd12cc7840e [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:05:25.752063 22050 raft_consensus.cc:493] T 1dc5b3532fe54f74876d02beffa2c230 P 0473d2b2d01f4459b1e90fd12cc7840e [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:25.756910 21926 leader_election.cc:290] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 9 election: Requested vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
W20260709 13:05:25.765244 19524 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:25.745795 22140 raft_consensus.cc:2804] T 4509b76741dc428e9201c70c1658da13 P 0473d2b2d01f4459b1e90fd12cc7840e [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:05:25.699237 22076 consensus_queue.cc:260] T 14935b3ddf914369822e4a0547aaa355 P 0473d2b2d01f4459b1e90fd12cc7840e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } attrs { replace: true } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
W20260709 13:05:25.767537 19452 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:05:25.779596 19377 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.2:46257, user_credentials={real_user=slave}} blocked reactor thread for 64684.4us
W20260709 13:05:25.780561 19523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.1:40321, user_credentials={real_user=slave}} blocked reactor thread for 307077us
I20260709 13:05:25.765262 19450 leader_election.cc:304] T df751f992649444090e27965eb1af85d P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:05:25.783464 21559 raft_consensus.cc:493] T d1e5873a19244c5ebbcd38e126796ee7 P e61c3a8f61bb48f8a963c9480e53c168 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:25.788232 21559 raft_consensus.cc:515] T d1e5873a19244c5ebbcd38e126796ee7 P e61c3a8f61bb48f8a963c9480e53c168 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:25.784283 22184 raft_consensus.cc:2749] T 76cb037fc9064d13b59a8969d897ce8c P 0473d2b2d01f4459b1e90fd12cc7840e [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:05:25.784289 22050 raft_consensus.cc:515] T 1dc5b3532fe54f74876d02beffa2c230 P 0473d2b2d01f4459b1e90fd12cc7840e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:25.725063 21932 consensus_queue.cc:260] T 2725d2c4cb054f18b0fc8f735c15f6c2 P 0473d2b2d01f4459b1e90fd12cc7840e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:25.809233 19377 leader_election.cc:304] T 179fd671030940b4b4a4e24bcc4aba0a P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:05:25.791967 22076 raft_consensus.cc:3060] T 14935b3ddf914369822e4a0547aaa355 P 0473d2b2d01f4459b1e90fd12cc7840e [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:05:25.778136 21700 raft_consensus.cc:3060] T fa8650e71aa14778b3d73721fc50d9fc P 0473d2b2d01f4459b1e90fd12cc7840e [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:05:25.780668 22144 raft_consensus.cc:697] T 1dc5b3532fe54f74876d02beffa2c230 P e5256d91808b47c195bc9b4dbd7f2b87 [term 5 LEADER]: Becoming Leader. State: Replica: e5256d91808b47c195bc9b4dbd7f2b87, State: Running, Role: LEADER
I20260709 13:05:25.788625 22140 raft_consensus.cc:493] T 4509b76741dc428e9201c70c1658da13 P 0473d2b2d01f4459b1e90fd12cc7840e [term 2 FOLLOWER]: Starting leader election (detected failure of leader e61c3a8f61bb48f8a963c9480e53c168)
I20260709 13:05:25.794747 22057 raft_consensus.cc:2804] T df751f992649444090e27965eb1af85d P 0473d2b2d01f4459b1e90fd12cc7840e [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:05:25.728356 22209 consensus_queue.cc:237] T 14935b3ddf914369822e4a0547aaa355 P 127766fc592545a4997f7790f50f6076 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.5, Last appended by leader: 5, Current term: 6, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } attrs { replace: true } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:05:25.784845 22201 raft_consensus.cc:515] T ab43d85f64114d4ebf618930e43d9ed0 P 0473d2b2d01f4459b1e90fd12cc7840e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } attrs { replace: true } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:05:25.793998 22027 raft_consensus.cc:515] T 46c5bfeecc314717bffe987e6844b6d0 P e61c3a8f61bb48f8a963c9480e53c168 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:25.771322 22185 raft_consensus.cc:493] T 1efebf73c86e432baa55533136b6e12c P e61c3a8f61bb48f8a963c9480e53c168 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 127766fc592545a4997f7790f50f6076)
I20260709 13:05:25.796788 22264 raft_consensus.cc:2749] T 172b3dd13109415a955b71ac0e9d2234 P 127766fc592545a4997f7790f50f6076 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:05:25.813879 20103 raft_consensus.cc:3060] T 7be9efa6559648dbb5a0f7684c4542d1 P 127766fc592545a4997f7790f50f6076 [term 5 LEARNER]: Advancing to term 7
W20260709 13:05:25.814333 19523 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:25.819147 20076 leader_election.cc:304] T 85c494af21f9457a85da47b9bc70c1fd P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 127766fc592545a4997f7790f50f6076; no voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:05:25.828173 21559 leader_election.cc:290] T d1e5873a19244c5ebbcd38e126796ee7 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:05:25.832787 19449 leader_election.cc:304] T 46c5bfeecc314717bffe987e6844b6d0 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e; no voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168
W20260709 13:05:25.833230 19451 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:25.822006 22140 raft_consensus.cc:3060] T 4509b76741dc428e9201c70c1658da13 P 0473d2b2d01f4459b1e90fd12cc7840e [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:25.808955 22041 consensus_queue.cc:1048] T 96efeaaf1057492490e9a621f37e1a2d P 127766fc592545a4997f7790f50f6076 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.023s
I20260709 13:05:25.826426 22057 raft_consensus.cc:493] T df751f992649444090e27965eb1af85d P 0473d2b2d01f4459b1e90fd12cc7840e [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:25.831597 22251 raft_consensus.cc:2749] T 179fd671030940b4b4a4e24bcc4aba0a P e5256d91808b47c195bc9b4dbd7f2b87 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:05:25.853128 22057 raft_consensus.cc:3060] T df751f992649444090e27965eb1af85d P 0473d2b2d01f4459b1e90fd12cc7840e [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:05:25.837841 22111 raft_consensus.cc:2749] T 85c494af21f9457a85da47b9bc70c1fd P 127766fc592545a4997f7790f50f6076 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:05:25.860495 22220 raft_consensus.cc:2749] T 46c5bfeecc314717bffe987e6844b6d0 P 0473d2b2d01f4459b1e90fd12cc7840e [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:05:25.860881 19557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ece3db938bc649d4a40a51522ed5259c" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:05:25.861472 19557 raft_consensus.cc:3060] T ece3db938bc649d4a40a51522ed5259c P e61c3a8f61bb48f8a963c9480e53c168 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:05:25.861589 19449 leader_election.cc:304] T 7be9efa6559648dbb5a0f7684c4542d1 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e; no voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:05:25.863157 22184 raft_consensus.cc:2749] T 7be9efa6559648dbb5a0f7684c4542d1 P 0473d2b2d01f4459b1e90fd12cc7840e [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:05:25.866290 19450 leader_election.cc:304] T a08760e15aac4630a629431f56024dc8 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:05:25.866639 22144 consensus_queue.cc:237] T 1dc5b3532fe54f74876d02beffa2c230 P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:25.868372 22201 leader_election.cc:290] T ab43d85f64114d4ebf618930e43d9ed0 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:05:25.868922 22201 raft_consensus.cc:2764] T a08760e15aac4630a629431f56024dc8 P 0473d2b2d01f4459b1e90fd12cc7840e [term 7 FOLLOWER]: Leader pre-election decision vote started in defunct term 6: won
I20260709 13:05:25.869839 19404 raft_consensus.cc:1275] T 86a6797bdfe94fa496c050ceae4bd0d9 P e5256d91808b47c195bc9b4dbd7f2b87 [term 6 FOLLOWER]: Refusing update from remote peer e61c3a8f61bb48f8a963c9480e53c168: Log matching property violated. Preceding OpId in replica: term: 4 index: 2. Preceding OpId from leader: term: 6 index: 3. (index mismatch)
I20260709 13:05:25.871147 22050 leader_election.cc:290] T 1dc5b3532fe54f74876d02beffa2c230 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:05:25.831120 22219 raft_consensus.cc:493] T b9f0d59553ad444883fcf5b5909f9798 P e61c3a8f61bb48f8a963c9480e53c168 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:05:25.869805 19377 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.2:46257, user_credentials={real_user=slave}} blocked reactor thread for 72453.6us
I20260709 13:05:25.861354 22220 consensus_queue.cc:1059] T 179fd671030940b4b4a4e24bcc4aba0a P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
W20260709 13:05:25.905405 19523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.1:40321, user_credentials={real_user=slave}} blocked reactor thread for 53261.3us
I20260709 13:05:25.843099 21932 raft_consensus.cc:3060] T 2725d2c4cb054f18b0fc8f735c15f6c2 P 0473d2b2d01f4459b1e90fd12cc7840e [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:05:25.912943 19451 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:25.919209 19411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef32ce6fdd0e40d382c79974f30295c6" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:05:25.934649 19551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab43d85f64114d4ebf618930e43d9ed0" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:05:25.917402 19406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edd7d470b5014c9489be7f41f64355c9" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:05:25.940689 21700 raft_consensus.cc:515] T fa8650e71aa14778b3d73721fc50d9fc P 0473d2b2d01f4459b1e90fd12cc7840e [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
W20260709 13:05:25.943020 19377 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.2:46257, user_credentials={real_user=slave}} blocked reactor thread for 50613.5us
I20260709 13:05:25.943848 19377 leader_election.cc:304] T 14935b3ddf914369822e4a0547aaa355 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, 127766fc592545a4997f7790f50f6076
I20260709 13:05:25.903019 22208 raft_consensus.cc:493] T fa731b585f684a7fb2d106c50f143b83 P 127766fc592545a4997f7790f50f6076 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:25.914263 22174 raft_consensus.cc:493] T 62c6c134d3d24a1ab144dd9ee6bc3f64 P 127766fc592545a4997f7790f50f6076 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:25.850519 22185 raft_consensus.cc:515] T 1efebf73c86e432baa55533136b6e12c P e61c3a8f61bb48f8a963c9480e53c168 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:05:25.917451 21926 raft_consensus.cc:493] T 217b5fae677b4971b3bbd2f357a1f7ff P e5256d91808b47c195bc9b4dbd7f2b87 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:05:25.963373 19450 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:25.966140 19405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46c5bfeecc314717bffe987e6844b6d0" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 12 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
I20260709 13:05:25.966813 19405 raft_consensus.cc:3060] T 46c5bfeecc314717bffe987e6844b6d0 P e5256d91808b47c195bc9b4dbd7f2b87 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:05:25.970737 19377 leader_election.cc:304] T b9f0d59553ad444883fcf5b5909f9798 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87; no voters: e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:05:25.954782 19406 raft_consensus.cc:2468] T edd7d470b5014c9489be7f41f64355c9 P e5256d91808b47c195bc9b4dbd7f2b87 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 6.
I20260709 13:05:25.972718 19486 raft_consensus.cc:1275] T 1f85fc4b527a48848e5faa083b604e36 P 0473d2b2d01f4459b1e90fd12cc7840e [term 5 FOLLOWER]: Refusing update from remote peer 127766fc592545a4997f7790f50f6076: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:05:25.906580 22219 raft_consensus.cc:515] T b9f0d59553ad444883fcf5b5909f9798 P e61c3a8f61bb48f8a963c9480e53c168 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:25.947880 22027 leader_election.cc:290] T 46c5bfeecc314717bffe987e6844b6d0 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 12 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:05:25.974642 19408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e5873a19244c5ebbcd38e126796ee7" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:05:25.974308 19411 raft_consensus.cc:1275] T ff75a1d4cb1f493db8f71ddc136ba9ab P e5256d91808b47c195bc9b4dbd7f2b87 [term 6 FOLLOWER]: Refusing update from remote peer e61c3a8f61bb48f8a963c9480e53c168: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:05:25.980319 19408 raft_consensus.cc:2468] T d1e5873a19244c5ebbcd38e126796ee7 P e5256d91808b47c195bc9b4dbd7f2b87 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 8.
I20260709 13:05:25.983428 19377 leader_election.cc:304] T 4509b76741dc428e9201c70c1658da13 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:05:25.980197 21700 leader_election.cc:290] T fa8650e71aa14778b3d73721fc50d9fc P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 8 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:05:25.990006 21559 consensus_queue.cc:1048] T 86a6797bdfe94fa496c050ceae4bd0d9 P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.009s
I20260709 13:05:25.988112 19552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e1f505cb0f1427bbd698ac889d80821" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
W20260709 13:05:25.995077 19451 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:26.019550 19551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dc5b3532fe54f74876d02beffa2c230" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:05:25.975345 22195 raft_consensus.cc:2749] T 14935b3ddf914369822e4a0547aaa355 P e5256d91808b47c195bc9b4dbd7f2b87 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:05:26.019594 19411 raft_consensus.cc:1275] T 1f85fc4b527a48848e5faa083b604e36 P e5256d91808b47c195bc9b4dbd7f2b87 [term 5 FOLLOWER]: Refusing update from remote peer 127766fc592545a4997f7790f50f6076: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:05:26.003261 19557 raft_consensus.cc:2468] T ece3db938bc649d4a40a51522ed5259c P e61c3a8f61bb48f8a963c9480e53c168 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 127766fc592545a4997f7790f50f6076 in term 7.
I20260709 13:05:25.956679 22208 raft_consensus.cc:515] T fa731b585f684a7fb2d106c50f143b83 P 127766fc592545a4997f7790f50f6076 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:05:26.028146 19551 raft_consensus.cc:2468] T 1dc5b3532fe54f74876d02beffa2c230 P e61c3a8f61bb48f8a963c9480e53c168 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 5.
I20260709 13:05:25.969341 22180 leader_election.cc:290] T 3e1f505cb0f1427bbd698ac889d80821 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:05:25.997038 22223 raft_consensus.cc:493] T 3e1f505cb0f1427bbd698ac889d80821 P e61c3a8f61bb48f8a963c9480e53c168 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:25.981571 21926 raft_consensus.cc:515] T 217b5fae677b4971b3bbd2f357a1f7ff P e5256d91808b47c195bc9b4dbd7f2b87 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:25.968055 21963 raft_consensus.cc:515] T 96efeaaf1057492490e9a621f37e1a2d P 0473d2b2d01f4459b1e90fd12cc7840e [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:05:26.049827 19377 leader_election.cc:304] T df751f992649444090e27965eb1af85d P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87; no voters: e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:05:25.968160 22174 raft_consensus.cc:515] T 62c6c134d3d24a1ab144dd9ee6bc3f64 P 127766fc592545a4997f7790f50f6076 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:05:26.060791 22174 leader_election.cc:290] T 62c6c134d3d24a1ab144dd9ee6bc3f64 P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
W20260709 13:05:26.061298 19376 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:26.062902 22251 raft_consensus.cc:2804] T df751f992649444090e27965eb1af85d P e5256d91808b47c195bc9b4dbd7f2b87 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:05:26.064234 19377 leader_election.cc:304] T 46c5bfeecc314717bffe987e6844b6d0 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:05:26.065737 19478 raft_consensus.cc:1240] T 96efeaaf1057492490e9a621f37e1a2d P 0473d2b2d01f4459b1e90fd12cc7840e [term 7 FOLLOWER]: Rejecting Update request from peer 127766fc592545a4997f7790f50f6076 for earlier term 6. Current term is 7. Ops: [6.7-6.7]
I20260709 13:05:26.066728 21963 leader_election.cc:290] T 96efeaaf1057492490e9a621f37e1a2d P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 7 election: Requested vote from peers e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
W20260709 13:05:26.026957 22194 consensus_meta.cc:287] T ff75a1d4cb1f493db8f71ddc136ba9ab P 0473d2b2d01f4459b1e90fd12cc7840e: Time spent flushing consensus metadata: real 0.517s	user 0.009s	sys 0.005s
I20260709 13:05:26.077580 20075 leader_election.cc:304] T 14efcc79969f41babe5529c22d59156d P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 127766fc592545a4997f7790f50f6076; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:05:26.027560 22293 raft_consensus.cc:2804] T b9f0d59553ad444883fcf5b5909f9798 P e5256d91808b47c195bc9b4dbd7f2b87 [term 7 FOLLOWER]: Leader election won for term 7
W20260709 13:05:26.083618 19452 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:26.042636 22295 raft_consensus.cc:2749] T 4509b76741dc428e9201c70c1658da13 P e5256d91808b47c195bc9b4dbd7f2b87 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:05:26.116153 19377 leader_election.cc:304] T 40e1e16737a842ee936002830f36882e P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:05:26.137075 20107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36f6ba92b9ba46babe4ebd6c02e5fbd9" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076"
I20260709 13:05:26.137712 20107 raft_consensus.cc:3060] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P 127766fc592545a4997f7790f50f6076 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:05:26.091424 21559 raft_consensus.cc:2955] T 7be9efa6559648dbb5a0f7684c4542d1 P e61c3a8f61bb48f8a963c9480e53c168 [term 7 LEADER]: Committing config change with OpId 5.4: config changed from index -1 to 4, NON_VOTER 127766fc592545a4997f7790f50f6076 (127.17.223.4) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } attrs { replace: true } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: NON_VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: true } } }
I20260709 13:05:26.095661 22293 raft_consensus.cc:697] T b9f0d59553ad444883fcf5b5909f9798 P e5256d91808b47c195bc9b4dbd7f2b87 [term 7 LEADER]: Becoming Leader. State: Replica: e5256d91808b47c195bc9b4dbd7f2b87, State: Running, Role: LEADER
I20260709 13:05:26.079700 22057 raft_consensus.cc:515] T df751f992649444090e27965eb1af85d P 0473d2b2d01f4459b1e90fd12cc7840e [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:26.152052 19377 leader_election.cc:304] T 28af091831594f9d8e96482078cc7625 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:05:26.073232 22223 raft_consensus.cc:515] T 3e1f505cb0f1427bbd698ac889d80821 P e61c3a8f61bb48f8a963c9480e53c168 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:26.094017 22162 raft_consensus.cc:2749] T 14efcc79969f41babe5529c22d59156d P 127766fc592545a4997f7790f50f6076 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
W20260709 13:05:26.148612 19449 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.1:40321, user_credentials={real_user=slave}} blocked reactor thread for 287054us
W20260709 13:05:26.160346 19452 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:26.168242 19449 leader_election.cc:304] T 172b3dd13109415a955b71ac0e9d2234 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e; no voters: 127766fc592545a4997f7790f50f6076, e5256d91808b47c195bc9b4dbd7f2b87
W20260709 13:05:26.171598 22297 log.cc:927] Time spent T 2b74109013a140ada21feeef92d6f563 P 0473d2b2d01f4459b1e90fd12cc7840e: Append to log took a long time: real 0.071s	user 0.000s	sys 0.000s
I20260709 13:05:26.173220 21767 raft_consensus.cc:3055] T 179fd671030940b4b4a4e24bcc4aba0a P 0473d2b2d01f4459b1e90fd12cc7840e [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:05:26.100117 22041 consensus_queue.cc:1048] T 1f85fc4b527a48848e5faa083b604e36 P 127766fc592545a4997f7790f50f6076 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.054s
I20260709 13:05:26.144596 22114 raft_consensus.cc:493] T 6c5eebf646ad445a9d1b1adc319d7b16 P e61c3a8f61bb48f8a963c9480e53c168 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 127766fc592545a4997f7790f50f6076)
I20260709 13:05:26.151584 22049 raft_consensus.cc:2749] T 40e1e16737a842ee936002830f36882e P e5256d91808b47c195bc9b4dbd7f2b87 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:05:26.184649 19556 raft_consensus.cc:1240] T ece3db938bc649d4a40a51522ed5259c P e61c3a8f61bb48f8a963c9480e53c168 [term 7 FOLLOWER]: Rejecting Update request from peer e5256d91808b47c195bc9b4dbd7f2b87 for earlier term 6. Current term is 7. Ops: [6.7-6.7]
I20260709 13:05:26.186461 19552 raft_consensus.cc:2468] T 3e1f505cb0f1427bbd698ac889d80821 P e61c3a8f61bb48f8a963c9480e53c168 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 6.
I20260709 13:05:26.173715 21767 raft_consensus.cc:740] T 179fd671030940b4b4a4e24bcc4aba0a P 0473d2b2d01f4459b1e90fd12cc7840e [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 0473d2b2d01f4459b1e90fd12cc7840e, State: Running, Role: LEADER
I20260709 13:05:26.197655 21767 consensus_queue.cc:260] T 179fd671030940b4b4a4e24bcc4aba0a P 0473d2b2d01f4459b1e90fd12cc7840e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:26.198596 22293 consensus_queue.cc:237] T b9f0d59553ad444883fcf5b5909f9798 P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:26.204056 22064 consensus_queue.cc:1059] T ece3db938bc649d4a40a51522ed5259c P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
W20260709 13:05:26.205982 22290 log.cc:927] Time spent T 2725d2c4cb054f18b0fc8f735c15f6c2 P e61c3a8f61bb48f8a963c9480e53c168: Append to log took a long time: real 0.186s	user 0.000s	sys 0.001s
I20260709 13:05:26.206658 22208 leader_election.cc:290] T fa731b585f684a7fb2d106c50f143b83 P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
W20260709 13:05:26.209300 22287 log.cc:927] Time spent T 0afb57ae58a24a01850491d69f0213dd P 0473d2b2d01f4459b1e90fd12cc7840e: Append to log took a long time: real 0.179s	user 0.000s	sys 0.000s
I20260709 13:05:26.210259 19411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa731b585f684a7fb2d106c50f143b83" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:05:26.210845 22185 leader_election.cc:290] T 1efebf73c86e432baa55533136b6e12c P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:05:26.211062 19411 raft_consensus.cc:2468] T fa731b585f684a7fb2d106c50f143b83 P e5256d91808b47c195bc9b4dbd7f2b87 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 127766fc592545a4997f7790f50f6076 in term 5.
I20260709 13:05:26.211958 22223 leader_election.cc:290] T 3e1f505cb0f1427bbd698ac889d80821 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:05:26.213163 20075 leader_election.cc:304] T fa731b585f684a7fb2d106c50f143b83 P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 127766fc592545a4997f7790f50f6076, e5256d91808b47c195bc9b4dbd7f2b87; no voters: 
W20260709 13:05:26.219038 19523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.1:40321, user_credentials={real_user=slave}} blocked reactor thread for 64541.6us
W20260709 13:05:26.175628 22280 log.cc:927] Time spent T 65d8cb8d6ec64f459d5a47cefab10acf P 127766fc592545a4997f7790f50f6076: Append to log took a long time: real 0.263s	user 0.000s	sys 0.001s
I20260709 13:05:26.232205 22208 raft_consensus.cc:2804] T fa731b585f684a7fb2d106c50f143b83 P 127766fc592545a4997f7790f50f6076 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:05:26.237828 22208 raft_consensus.cc:493] T fa731b585f684a7fb2d106c50f143b83 P 127766fc592545a4997f7790f50f6076 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:26.237951 22303 raft_consensus.cc:2749] T 172b3dd13109415a955b71ac0e9d2234 P 0473d2b2d01f4459b1e90fd12cc7840e [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:05:26.238309 22208 raft_consensus.cc:3060] T fa731b585f684a7fb2d106c50f143b83 P 127766fc592545a4997f7790f50f6076 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:05:26.238617 22219 leader_election.cc:290] T b9f0d59553ad444883fcf5b5909f9798 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
W20260709 13:05:26.239341 22300 log.cc:927] Time spent T 5ec1c4ce15e04c7e8c283a62179f2a64 P 0473d2b2d01f4459b1e90fd12cc7840e: Append to log took a long time: real 0.092s	user 0.000s	sys 0.000s
W20260709 13:05:26.242023 22298 log.cc:927] Time spent T 775c229504194560ba9589bc2199b089 P 0473d2b2d01f4459b1e90fd12cc7840e: Append to log took a long time: real 0.078s	user 0.000s	sys 0.000s
I20260709 13:05:26.248104 22208 raft_consensus.cc:515] T fa731b585f684a7fb2d106c50f143b83 P 127766fc592545a4997f7790f50f6076 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:05:26.253417 20104 raft_consensus.cc:1240] T ece3db938bc649d4a40a51522ed5259c P 127766fc592545a4997f7790f50f6076 [term 7 FOLLOWER]: Rejecting Update request from peer e5256d91808b47c195bc9b4dbd7f2b87 for earlier term 6. Current term is 7. Ops: []
W20260709 13:05:26.254086 19452 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:26.228376 19405 raft_consensus.cc:2468] T 46c5bfeecc314717bffe987e6844b6d0 P e5256d91808b47c195bc9b4dbd7f2b87 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 12.
I20260709 13:05:26.177434 19377 leader_election.cc:304] T d1e5873a19244c5ebbcd38e126796ee7 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:05:26.219815 19523 leader_election.cc:304] T edd7d470b5014c9489be7f41f64355c9 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:05:26.158994 22144 raft_consensus.cc:2749] T 28af091831594f9d8e96482078cc7625 P e5256d91808b47c195bc9b4dbd7f2b87 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:05:26.214872 22114 raft_consensus.cc:515] T 6c5eebf646ad445a9d1b1adc319d7b16 P e61c3a8f61bb48f8a963c9480e53c168 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
W20260709 13:05:26.205982 22289 log.cc:927] Time spent T 2e36a9d6e29c4a7c860cf267efbd4c74 P e61c3a8f61bb48f8a963c9480e53c168: Append to log took a long time: real 0.138s	user 0.000s	sys 0.001s
I20260709 13:05:26.220340 19556 raft_consensus.cc:1275] T b08304a0a02b42d7840c4e8ee9a6bd1a P e61c3a8f61bb48f8a963c9480e53c168 [term 8 FOLLOWER]: Refusing update from remote peer e5256d91808b47c195bc9b4dbd7f2b87: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
W20260709 13:05:26.266264 19523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.1:40321, user_credentials={real_user=slave}} blocked reactor thread for 46526.6us
I20260709 13:05:26.268543 19523 leader_election.cc:304] T d1e5873a19244c5ebbcd38e126796ee7 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:05:26.246381 21767 raft_consensus.cc:3060] T 179fd671030940b4b4a4e24bcc4aba0a P 0473d2b2d01f4459b1e90fd12cc7840e [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:05:26.194262 22140 raft_consensus.cc:515] T 4509b76741dc428e9201c70c1658da13 P 0473d2b2d01f4459b1e90fd12cc7840e [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:26.158656 22251 raft_consensus.cc:697] T df751f992649444090e27965eb1af85d P e5256d91808b47c195bc9b4dbd7f2b87 [term 7 LEADER]: Becoming Leader. State: Replica: e5256d91808b47c195bc9b4dbd7f2b87, State: Running, Role: LEADER
I20260709 13:05:26.283084 20076 leader_election.cc:304] T ece3db938bc649d4a40a51522ed5259c P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 127766fc592545a4997f7790f50f6076, e61c3a8f61bb48f8a963c9480e53c168; no voters: e5256d91808b47c195bc9b4dbd7f2b87
W20260709 13:05:26.285140 19523 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:26.285292 20104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1efebf73c86e432baa55533136b6e12c" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:05:26.258452 22195 raft_consensus.cc:2749] T 46c5bfeecc314717bffe987e6844b6d0 P e5256d91808b47c195bc9b4dbd7f2b87 [term 12 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:05:26.289165 22264 raft_consensus.cc:2804] T ece3db938bc649d4a40a51522ed5259c P 127766fc592545a4997f7790f50f6076 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:05:26.289407 19482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86a6797bdfe94fa496c050ceae4bd0d9" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:05:26.294416 19482 raft_consensus.cc:2376] T 86a6797bdfe94fa496c050ceae4bd0d9 P 0473d2b2d01f4459b1e90fd12cc7840e [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 6. Re-sending same reply.
I20260709 13:05:26.270354 22127 raft_consensus.cc:493] T ef32ce6fdd0e40d382c79974f30295c6 P 0473d2b2d01f4459b1e90fd12cc7840e [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:26.291363 19556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62c6c134d3d24a1ab144dd9ee6bc3f64" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
W20260709 13:05:26.296566 19523 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:26.309080 19554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa731b585f684a7fb2d106c50f143b83" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:05:26.309726 19554 raft_consensus.cc:2468] T fa731b585f684a7fb2d106c50f143b83 P e61c3a8f61bb48f8a963c9480e53c168 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 127766fc592545a4997f7790f50f6076 in term 5.
W20260709 13:05:26.298818 19451 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:26.307022 19482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "217b5fae677b4971b3bbd2f357a1f7ff" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:05:26.270565 22311 raft_consensus.cc:2804] T edd7d470b5014c9489be7f41f64355c9 P e61c3a8f61bb48f8a963c9480e53c168 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:05:26.312944 19480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff75a1d4cb1f493db8f71ddc136ba9ab" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:05:26.314459 19480 raft_consensus.cc:2468] T ff75a1d4cb1f493db8f71ddc136ba9ab P 0473d2b2d01f4459b1e90fd12cc7840e [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 6.
W20260709 13:05:26.326251 19377 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.2:46257, user_credentials={real_user=slave}} blocked reactor thread for 148884us
I20260709 13:05:26.287035 22303 raft_consensus.cc:493] T 40e1e16737a842ee936002830f36882e P 0473d2b2d01f4459b1e90fd12cc7840e [term 7 FOLLOWER]: Starting pre-election (detected failure of leader e61c3a8f61bb48f8a963c9480e53c168)
I20260709 13:05:26.333981 19482 raft_consensus.cc:1240] T b9f0d59553ad444883fcf5b5909f9798 P 0473d2b2d01f4459b1e90fd12cc7840e [term 7 FOLLOWER]: Rejecting Update request from peer e61c3a8f61bb48f8a963c9480e53c168 for earlier term 6. Current term is 7. Ops: []
I20260709 13:05:26.324626 22311 raft_consensus.cc:493] T edd7d470b5014c9489be7f41f64355c9 P e61c3a8f61bb48f8a963c9480e53c168 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:26.344746 19482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e1085d23e8347fbbd5bce7542f4b1f4" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:05:26.323346 21926 leader_election.cc:290] T 217b5fae677b4971b3bbd2f357a1f7ff P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:05:26.295430 22313 raft_consensus.cc:2749] T d1e5873a19244c5ebbcd38e126796ee7 P e5256d91808b47c195bc9b4dbd7f2b87 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
W20260709 13:05:26.361528 20076 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.3:36891, user_credentials={real_user=slave}} blocked reactor thread for 71316.9us
I20260709 13:05:26.291101 22284 consensus_queue.cc:1048] T ff75a1d4cb1f493db8f71ddc136ba9ab P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.052s
I20260709 13:05:26.367246 19482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cdf56e38bbc453d9438d359e5a69955" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:05:26.368304 19482 raft_consensus.cc:2410] T 0cdf56e38bbc453d9438d359e5a69955 P 0473d2b2d01f4459b1e90fd12cc7840e [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e61c3a8f61bb48f8a963c9480e53c168 for term 9 because replica has last-logged OpId of term: 8 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 5.
W20260709 13:05:26.340238 21529 consensus_meta.cc:287] T 48824d5acfbc485ebf8c2d944e7202de P e61c3a8f61bb48f8a963c9480e53c168: Time spent flushing consensus metadata: real 0.661s	user 0.010s	sys 0.001s
I20260709 13:05:26.330982 22208 leader_election.cc:290] T fa731b585f684a7fb2d106c50f143b83 P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 6 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
W20260709 13:05:26.369372 22076 consensus_meta.cc:287] T 14935b3ddf914369822e4a0547aaa355 P 0473d2b2d01f4459b1e90fd12cc7840e: Time spent flushing consensus metadata: real 0.550s	user 0.009s	sys 0.001s
I20260709 13:05:26.326951 22127 raft_consensus.cc:515] T ef32ce6fdd0e40d382c79974f30295c6 P 0473d2b2d01f4459b1e90fd12cc7840e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:26.360359 22311 raft_consensus.cc:3060] T edd7d470b5014c9489be7f41f64355c9 P e61c3a8f61bb48f8a963c9480e53c168 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:05:26.380744 19482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed7fdbcb96d14d418db9ca90a792588a" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:05:26.382316 19377 leader_election.cc:304] T a08760e15aac4630a629431f56024dc8 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87; no voters: e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:05:26.372654 21529 raft_consensus.cc:515] T 48824d5acfbc485ebf8c2d944e7202de P e61c3a8f61bb48f8a963c9480e53c168 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:05:26.387974 22286 raft_consensus.cc:2804] T d1e5873a19244c5ebbcd38e126796ee7 P e61c3a8f61bb48f8a963c9480e53c168 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:05:26.388413 22286 raft_consensus.cc:493] T d1e5873a19244c5ebbcd38e126796ee7 P e61c3a8f61bb48f8a963c9480e53c168 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:26.388717 22286 raft_consensus.cc:3060] T d1e5873a19244c5ebbcd38e126796ee7 P e61c3a8f61bb48f8a963c9480e53c168 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:05:26.388876 21529 leader_election.cc:290] T 48824d5acfbc485ebf8c2d944e7202de P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 7 election: Requested vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:05:26.389580 19559 raft_consensus.cc:1240] T 48824d5acfbc485ebf8c2d944e7202de P e61c3a8f61bb48f8a963c9480e53c168 [term 7 FOLLOWER]: Rejecting Update request from peer 0473d2b2d01f4459b1e90fd12cc7840e for earlier term 6. Current term is 7. Ops: []
I20260709 13:05:26.390785 22144 consensus_queue.cc:1059] T 172b3dd13109415a955b71ac0e9d2234 P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:05:26.391819 22144 raft_consensus.cc:3055] T 172b3dd13109415a955b71ac0e9d2234 P e5256d91808b47c195bc9b4dbd7f2b87 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:05:26.392132 22144 raft_consensus.cc:740] T 172b3dd13109415a955b71ac0e9d2234 P e5256d91808b47c195bc9b4dbd7f2b87 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: e5256d91808b47c195bc9b4dbd7f2b87, State: Running, Role: LEADER
W20260709 13:05:26.392395 19524 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:26.361807 22251 consensus_queue.cc:237] T df751f992649444090e27965eb1af85d P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:26.393378 19408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86a6797bdfe94fa496c050ceae4bd0d9" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 7 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:05:26.393953 19408 raft_consensus.cc:2468] T 86a6797bdfe94fa496c050ceae4bd0d9 P e5256d91808b47c195bc9b4dbd7f2b87 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 6.
I20260709 13:05:26.394213 19411 raft_consensus.cc:1275] T 217b5fae677b4971b3bbd2f357a1f7ff P e5256d91808b47c195bc9b4dbd7f2b87 [term 4 FOLLOWER]: Refusing update from remote peer 0473d2b2d01f4459b1e90fd12cc7840e: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:05:26.394845 19407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df751f992649444090e27965eb1af85d" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:05:26.395449 22140 leader_election.cc:290] T 4509b76741dc428e9201c70c1658da13 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 3 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:05:26.396485 19405 raft_consensus.cc:1240] T b08304a0a02b42d7840c4e8ee9a6bd1a P e5256d91808b47c195bc9b4dbd7f2b87 [term 8 LEADER]: Rejecting Update request from peer 0473d2b2d01f4459b1e90fd12cc7840e for earlier term 7. Current term is 8. Ops: []
I20260709 13:05:26.397493 19406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a08760e15aac4630a629431f56024dc8" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:05:26.398268 19406 raft_consensus.cc:2393] T a08760e15aac4630a629431f56024dc8 P e5256d91808b47c195bc9b4dbd7f2b87 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0473d2b2d01f4459b1e90fd12cc7840e in current term 7: Already voted for candidate e5256d91808b47c195bc9b4dbd7f2b87 in this term.
W20260709 13:05:26.398327 22163 consensus_meta.cc:287] T ed7fdbcb96d14d418db9ca90a792588a P 0473d2b2d01f4459b1e90fd12cc7840e: Time spent flushing consensus metadata: real 0.622s	user 0.004s	sys 0.004s
W20260709 13:05:26.400341 19375 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.3:36891, user_credentials={real_user=slave}} blocked reactor thread for 104524us
I20260709 13:05:26.401929 19551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa8650e71aa14778b3d73721fc50d9fc" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:05:26.403497 19377 leader_election.cc:304] T 86a6797bdfe94fa496c050ceae4bd0d9 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87; no voters: e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:05:26.404018 21957 raft_consensus.cc:2804] T a08760e15aac4630a629431f56024dc8 P e5256d91808b47c195bc9b4dbd7f2b87 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:05:26.411191 19404 raft_consensus.cc:1240] T 28af091831594f9d8e96482078cc7625 P e5256d91808b47c195bc9b4dbd7f2b87 [term 7 FOLLOWER]: Rejecting Update request from peer 0473d2b2d01f4459b1e90fd12cc7840e for earlier term 6. Current term is 7. Ops: []
W20260709 13:05:26.412089 19451 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:26.432317 20107 raft_consensus.cc:2468] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P 127766fc592545a4997f7790f50f6076 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 9.
I20260709 13:05:26.370626 22264 raft_consensus.cc:697] T ece3db938bc649d4a40a51522ed5259c P 127766fc592545a4997f7790f50f6076 [term 7 LEADER]: Becoming Leader. State: Replica: 127766fc592545a4997f7790f50f6076, State: Running, Role: LEADER
W20260709 13:05:26.383903 22322 log.cc:927] Time spent T ef32ce6fdd0e40d382c79974f30295c6 P e61c3a8f61bb48f8a963c9480e53c168: Append to log took a long time: real 0.056s	user 0.001s	sys 0.000s
I20260709 13:05:26.470122 22208 raft_consensus.cc:493] T 309c3ca0ca4b4f3ba129752ea2cb293b P 127766fc592545a4997f7790f50f6076 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader e61c3a8f61bb48f8a963c9480e53c168)
I20260709 13:05:26.470057 19408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dc5b3532fe54f74876d02beffa2c230" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:05:26.459352 19478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a61655d99124a29b486ba4a5b37faea" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:05:26.376434 22057 leader_election.cc:290] T df751f992649444090e27965eb1af85d P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 8 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:05:26.470336 19411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab43d85f64114d4ebf618930e43d9ed0" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:05:26.471036 19480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "179fd671030940b4b4a4e24bcc4aba0a" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:05:26.493198 19409 raft_consensus.cc:1240] T 179fd671030940b4b4a4e24bcc4aba0a P e5256d91808b47c195bc9b4dbd7f2b87 [term 6 FOLLOWER]: Rejecting Update request from peer 0473d2b2d01f4459b1e90fd12cc7840e for earlier term 5. Current term is 6. Ops: []
I20260709 13:05:26.409971 19560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96efeaaf1057492490e9a621f37e1a2d" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:05:26.343627 22303 raft_consensus.cc:515] T 40e1e16737a842ee936002830f36882e P 0473d2b2d01f4459b1e90fd12cc7840e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:26.492291 19406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa731b585f684a7fb2d106c50f143b83" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
W20260709 13:05:26.463408 19374 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.4:43121, user_credentials={real_user=slave}} blocked reactor thread for 55154.8us
I20260709 13:05:26.493516 20106 raft_consensus.cc:1240] T 172b3dd13109415a955b71ac0e9d2234 P 127766fc592545a4997f7790f50f6076 [term 4 FOLLOWER]: Rejecting Update request from peer e5256d91808b47c195bc9b4dbd7f2b87 for earlier term 3. Current term is 4. Ops: []
I20260709 13:05:26.494297 19484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96efeaaf1057492490e9a621f37e1a2d" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
W20260709 13:05:26.455408 19375 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.3:36891, user_credentials={real_user=slave}} blocked reactor thread for 47121.3us
I20260709 13:05:26.481226 19410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa8650e71aa14778b3d73721fc50d9fc" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
I20260709 13:05:26.494652 22254 consensus_queue.cc:1048] T b08304a0a02b42d7840c4e8ee9a6bd1a P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.182s
I20260709 13:05:26.520145 19481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21e14947d70440f19044d8f75c31e1f9" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:05:27.135099 19480 raft_consensus.cc:2468] T 179fd671030940b4b4a4e24bcc4aba0a P 0473d2b2d01f4459b1e90fd12cc7840e [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 6.
I20260709 13:05:27.135351 22056 raft_consensus.cc:493] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P 127766fc592545a4997f7790f50f6076 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:27.135900 20107 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35874 (request call id 546) took 1036 ms. Trace:
I20260709 13:05:27.135775 19449 leader_election.cc:304] T 1efebf73c86e432baa55533136b6e12c P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e; no voters: 127766fc592545a4997f7790f50f6076, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:05:27.136056 22056 raft_consensus.cc:515] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P 127766fc592545a4997f7790f50f6076 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:05:27.138953 22208 raft_consensus.cc:515] T 309c3ca0ca4b4f3ba129752ea2cb293b P 127766fc592545a4997f7790f50f6076 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } attrs { replace: true } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
W20260709 13:05:27.140072 22311 consensus_meta.cc:287] T edd7d470b5014c9489be7f41f64355c9 P e61c3a8f61bb48f8a963c9480e53c168: Time spent flushing consensus metadata: real 0.684s	user 0.010s	sys 0.000s
I20260709 13:05:27.140573 22311 raft_consensus.cc:515] T edd7d470b5014c9489be7f41f64355c9 P e61c3a8f61bb48f8a963c9480e53c168 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:26.557510 20105 raft_consensus.cc:1240] T 14efcc79969f41babe5529c22d59156d P 127766fc592545a4997f7790f50f6076 [term 7 FOLLOWER]: Rejecting Update request from peer e5256d91808b47c195bc9b4dbd7f2b87 for earlier term 6. Current term is 7. Ops: []
I20260709 13:05:27.142690 22208 leader_election.cc:290] T 309c3ca0ca4b4f3ba129752ea2cb293b P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:05:26.727048 19483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0afb57ae58a24a01850491d69f0213dd" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
W20260709 13:05:26.641520 19450 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:05:27.170050 19377 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.2:46257, user_credentials={real_user=slave}} blocked reactor thread for 766570us
I20260709 13:05:27.170406 19483 raft_consensus.cc:2410] T 0afb57ae58a24a01850491d69f0213dd P 0473d2b2d01f4459b1e90fd12cc7840e [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e61c3a8f61bb48f8a963c9480e53c168 for term 8 because replica has last-logged OpId of term: 7 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 6.
I20260709 13:05:27.170498 19449 leader_election.cc:304] T 6c5eebf646ad445a9d1b1adc319d7b16 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e; no voters: 127766fc592545a4997f7790f50f6076, e61c3a8f61bb48f8a963c9480e53c168
W20260709 13:05:27.142973 21559 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.829s	user 0.003s	sys 0.021s
W20260709 13:05:27.171226 21559 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.858s	user 0.003s	sys 0.021s
I20260709 13:05:27.171432 21957 raft_consensus.cc:697] T a08760e15aac4630a629431f56024dc8 P e5256d91808b47c195bc9b4dbd7f2b87 [term 7 LEADER]: Becoming Leader. State: Replica: e5256d91808b47c195bc9b4dbd7f2b87, State: Running, Role: LEADER
I20260709 13:05:27.171938 20105 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35874 (request call id 545) took 1080 ms. Trace:
W20260709 13:05:26.921362 22286 consensus_meta.cc:287] T d1e5873a19244c5ebbcd38e126796ee7 P e61c3a8f61bb48f8a963c9480e53c168: Time spent flushing consensus metadata: real 0.532s	user 0.011s	sys 0.000s
I20260709 13:05:27.174413 19480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9f0d59553ad444883fcf5b5909f9798" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:05:27.175136 19480 raft_consensus.cc:2468] T b9f0d59553ad444883fcf5b5909f9798 P 0473d2b2d01f4459b1e90fd12cc7840e [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 7.
I20260709 13:05:27.145955 19481 raft_consensus.cc:2468] T 21e14947d70440f19044d8f75c31e1f9 P 0473d2b2d01f4459b1e90fd12cc7840e [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 7.
I20260709 13:05:27.176107 19481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22196caba61445d3bec98a0aab3c337d" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:05:27.147387 19484 raft_consensus.cc:2368] T 96efeaaf1057492490e9a621f37e1a2d P 0473d2b2d01f4459b1e90fd12cc7840e [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e61c3a8f61bb48f8a963c9480e53c168 for earlier term 6. Current term is 7.
W20260709 13:05:26.560565 22288 log.cc:927] Time spent T 14efcc79969f41babe5529c22d59156d P 0473d2b2d01f4459b1e90fd12cc7840e: Append to log took a long time: real 0.543s	user 0.002s	sys 0.000s
I20260709 13:05:26.786552 22269 raft_consensus.cc:493] T 65d8cb8d6ec64f459d5a47cefab10acf P 127766fc592545a4997f7790f50f6076 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader e5256d91808b47c195bc9b4dbd7f2b87)
I20260709 13:05:26.772416 19477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f93ee515a9c14139bf566522ed8232f3" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 9 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:05:27.148792 19411 raft_consensus.cc:2468] T ab43d85f64114d4ebf618930e43d9ed0 P e5256d91808b47c195bc9b4dbd7f2b87 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 5.
I20260709 13:05:27.149010 19403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e1f505cb0f1427bbd698ac889d80821" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:05:26.579427 19479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff75a1d4cb1f493db8f71ddc136ba9ab" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:05:27.148083 20107 rpcz_store.cc:276] 0709 13:05:26.099296 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:26.099475 (+   179us) service_pool.cc:224] Handling call
0709 13:05:27.135841 (+1036366us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:05:27.150249 19406 raft_consensus.cc:3060] T fa731b585f684a7fb2d106c50f143b83 P e5256d91808b47c195bc9b4dbd7f2b87 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:05:26.564839 22319 log.cc:927] Time spent T ece3db938bc649d4a40a51522ed5259c P e5256d91808b47c195bc9b4dbd7f2b87: Append to log took a long time: real 0.193s	user 0.000s	sys 0.000s
I20260709 13:05:27.189373 22255 raft_consensus.cc:2804] T 86a6797bdfe94fa496c050ceae4bd0d9 P e5256d91808b47c195bc9b4dbd7f2b87 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:05:27.152899 22303 leader_election.cc:290] T 40e1e16737a842ee936002830f36882e P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:05:27.200908 19560 raft_consensus.cc:1275] T 1dc5b3532fe54f74876d02beffa2c230 P e61c3a8f61bb48f8a963c9480e53c168 [term 5 FOLLOWER]: Refusing update from remote peer e5256d91808b47c195bc9b4dbd7f2b87: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:05:27.201381 22303 raft_consensus.cc:2749] T 6c5eebf646ad445a9d1b1adc319d7b16 P 0473d2b2d01f4459b1e90fd12cc7840e [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 13:05:26.564128 22323 log.cc:927] Time spent T 14935b3ddf914369822e4a0547aaa355 P 127766fc592545a4997f7790f50f6076: Append to log took a long time: real 0.216s	user 0.000s	sys 0.001s
W20260709 13:05:27.202843 19523 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:05:27.203253 19523 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:27.203862 19523 leader_election.cc:304] T 46c5bfeecc314717bffe987e6844b6d0 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:05:27.205333 20108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c5eebf646ad445a9d1b1adc319d7b16" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:05:27.205575 20104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48824d5acfbc485ebf8c2d944e7202de" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076"
I20260709 13:05:27.206069 20104 raft_consensus.cc:3060] T 48824d5acfbc485ebf8c2d944e7202de P 127766fc592545a4997f7790f50f6076 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:05:27.206609 19407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9f0d59553ad444883fcf5b5909f9798" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:05:27.215865 19479 raft_consensus.cc:2468] T ff75a1d4cb1f493db8f71ddc136ba9ab P 0473d2b2d01f4459b1e90fd12cc7840e [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 6.
I20260709 13:05:27.155867 19559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df751f992649444090e27965eb1af85d" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:05:27.224107 19559 raft_consensus.cc:3060] T df751f992649444090e27965eb1af85d P e61c3a8f61bb48f8a963c9480e53c168 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:05:27.156900 19552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4509b76741dc428e9201c70c1658da13" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
W20260709 13:05:26.973261 21932 consensus_meta.cc:287] T 2725d2c4cb054f18b0fc8f735c15f6c2 P 0473d2b2d01f4459b1e90fd12cc7840e: Time spent flushing consensus metadata: real 1.055s	user 0.009s	sys 0.000s
I20260709 13:05:26.974323 22127 leader_election.cc:290] T ef32ce6fdd0e40d382c79974f30295c6 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
W20260709 13:05:26.610194 19452 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:27.167179 19478 raft_consensus.cc:2468] T 1a61655d99124a29b486ba4a5b37faea P 0473d2b2d01f4459b1e90fd12cc7840e [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 4.
W20260709 13:05:26.553680 22318 log.cc:927] Time spent T 9962423cb4e54fcfa5de01daf68a86e7 P e5256d91808b47c195bc9b4dbd7f2b87: Append to log took a long time: real 0.059s	user 0.000s	sys 0.000s
W20260709 13:05:27.250104 19452 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:27.186609 22332 raft_consensus.cc:493] T 40e1e16737a842ee936002830f36882e P e61c3a8f61bb48f8a963c9480e53c168 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:27.172041 22049 raft_consensus.cc:3055] T ece3db938bc649d4a40a51522ed5259c P e5256d91808b47c195bc9b4dbd7f2b87 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:05:27.170822 19450 leader_election.cc:304] T 1dc5b3532fe54f74876d02beffa2c230 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:05:27.172616 19486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edd7d470b5014c9489be7f41f64355c9" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:05:27.172360 21957 consensus_queue.cc:237] T a08760e15aac4630a629431f56024dc8 P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:27.255837 19486 raft_consensus.cc:2468] T edd7d470b5014c9489be7f41f64355c9 P 0473d2b2d01f4459b1e90fd12cc7840e [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 6.
W20260709 13:05:26.566367 22317 log.cc:927] Time spent T 833a2f0775ed407a94b8924ce50adb63 P e61c3a8f61bb48f8a963c9480e53c168: Append to log took a long time: real 0.159s	user 0.000s	sys 0.000s
W20260709 13:05:26.567487 22325 log.cc:927] Time spent T 7be9efa6559648dbb5a0f7684c4542d1 P e61c3a8f61bb48f8a963c9480e53c168: Append to log took a long time: real 0.112s	user 0.000s	sys 0.000s
I20260709 13:05:27.173409 20105 rpcz_store.cc:276] 0709 13:05:26.090848 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:26.091030 (+   182us) service_pool.cc:224] Handling call
0709 13:05:26.556966 (+465936us) spinlock_profiling.cc:243] Waited 6.47 ms on lock 0x7b5800010b98. stack: 00007f4a79de9343 00007f4a79de9240 00007f4a797781d4 00007f4a834b6304 00007f4a834b6299 00007f4a79ca3db1 00007f4a79de3b71 00007f4a79de3a22 00007f4a82cfcc09 00007f4a81e56ee0 00007f4a81f200ab 00007f4a81f20131 00007f4a81ee1fc0 00007f4a81ecc929 00007f4a81ecc3d2 00007f4a7b443bd4
0709 13:05:26.557189 (+   223us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:27.165251 (+608062us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:27.170896 (+  5645us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":14890880}
I20260709 13:05:27.174259 22286 raft_consensus.cc:515] T d1e5873a19244c5ebbcd38e126796ee7 P e61c3a8f61bb48f8a963c9480e53c168 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:26.482162 22114 leader_election.cc:290] T 6c5eebf646ad445a9d1b1adc319d7b16 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:05:27.176164 19480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1efebf73c86e432baa55533136b6e12c" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:05:26.481148 22316 raft_consensus.cc:493] T 2b74109013a140ada21feeef92d6f563 P e61c3a8f61bb48f8a963c9480e53c168 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:27.255507 22049 raft_consensus.cc:740] T ece3db938bc649d4a40a51522ed5259c P e5256d91808b47c195bc9b4dbd7f2b87 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: e5256d91808b47c195bc9b4dbd7f2b87, State: Running, Role: LEADER
I20260709 13:05:27.277705 22316 raft_consensus.cc:515] T 2b74109013a140ada21feeef92d6f563 P e61c3a8f61bb48f8a963c9480e53c168 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
W20260709 13:05:26.565618 22321 log.cc:927] Time spent T 65d8cb8d6ec64f459d5a47cefab10acf P e5256d91808b47c195bc9b4dbd7f2b87: Append to log took a long time: real 0.187s	user 0.000s	sys 0.000s
W20260709 13:05:27.017582 22172 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.731s	user 0.000s	sys 0.017s
I20260709 13:05:27.179505 22208 raft_consensus.cc:493] T 70797e5783b5454ab0d0eea663e791e3 P 127766fc592545a4997f7790f50f6076 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader e5256d91808b47c195bc9b4dbd7f2b87)
I20260709 13:05:27.253732 22127 raft_consensus.cc:493] T 0afb57ae58a24a01850491d69f0213dd P 0473d2b2d01f4459b1e90fd12cc7840e [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 127766fc592545a4997f7790f50f6076)
I20260709 13:05:27.179724 21767 raft_consensus.cc:493] T 7f575b143b844aa096b50997dad3516a P 0473d2b2d01f4459b1e90fd12cc7840e [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:27.259944 22326 raft_consensus.cc:493] T 775c229504194560ba9589bc2199b089 P 127766fc592545a4997f7790f50f6076 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:27.182734 22163 raft_consensus.cc:493] T 0cdf56e38bbc453d9438d359e5a69955 P 0473d2b2d01f4459b1e90fd12cc7840e [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:27.183849 19553 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40438 (request call id 1797) took 1127 ms. Trace:
I20260709 13:05:27.185948 19482 raft_consensus.cc:2468] T ed7fdbcb96d14d418db9ca90a792588a P 0473d2b2d01f4459b1e90fd12cc7840e [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 4.
I20260709 13:05:27.185856 19481 raft_consensus.cc:2468] T 22196caba61445d3bec98a0aab3c337d P 0473d2b2d01f4459b1e90fd12cc7840e [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 6.
I20260709 13:05:27.382175 19481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e1f505cb0f1427bbd698ac889d80821" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:05:27.382814 19481 raft_consensus.cc:2468] T 3e1f505cb0f1427bbd698ac889d80821 P 0473d2b2d01f4459b1e90fd12cc7840e [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 6.
I20260709 13:05:27.186648 19477 raft_consensus.cc:2376] T f93ee515a9c14139bf566522ed8232f3 P 0473d2b2d01f4459b1e90fd12cc7840e [term 9 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 9. Re-sending same reply.
I20260709 13:05:27.189796 19403 raft_consensus.cc:2468] T 3e1f505cb0f1427bbd698ac889d80821 P e5256d91808b47c195bc9b4dbd7f2b87 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 6.
W20260709 13:05:27.151558 19526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.2:46257, user_credentials={real_user=slave}} blocked reactor thread for 471898us
I20260709 13:05:27.383925 20105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab43d85f64114d4ebf618930e43d9ed0" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
W20260709 13:05:27.386492 19526 leader_election.cc:336] T ff75a1d4cb1f493db8f71ddc136ba9ab P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257): Timed out: RequestConsensusVote RPC to 127.17.223.2:46257 timed out after 1.741s (SENT)
W20260709 13:05:27.365027 22172 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.078s	user 0.003s	sys 0.018s
I20260709 13:05:27.194949 19556 raft_consensus.cc:1240] T ece3db938bc649d4a40a51522ed5259c P e61c3a8f61bb48f8a963c9480e53c168 [term 7 FOLLOWER]: Rejecting Update request from peer e5256d91808b47c195bc9b4dbd7f2b87 for earlier term 6. Current term is 7. Ops: [6.7-6.7]
I20260709 13:05:27.390166 19477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef32ce6fdd0e40d382c79974f30295c6" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:05:27.390893 19556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "309c3ca0ca4b4f3ba129752ea2cb293b" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:05:27.176885 22057 raft_consensus.cc:2749] T 1efebf73c86e432baa55533136b6e12c P 0473d2b2d01f4459b1e90fd12cc7840e [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:05:27.196100 19551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "217b5fae677b4971b3bbd2f357a1f7ff" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:05:27.194469 22255 raft_consensus.cc:493] T 86a6797bdfe94fa496c050ceae4bd0d9 P e5256d91808b47c195bc9b4dbd7f2b87 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:27.218083 19560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa731b585f684a7fb2d106c50f143b83" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:05:27.398588 19560 raft_consensus.cc:3060] T fa731b585f684a7fb2d106c50f143b83 P e61c3a8f61bb48f8a963c9480e53c168 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:05:27.158169 19524 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:27.208189 19404 raft_consensus.cc:2955] T 7be9efa6559648dbb5a0f7684c4542d1 P e5256d91808b47c195bc9b4dbd7f2b87 [term 7 FOLLOWER]: Committing config change with OpId 5.4: config changed from index -1 to 4, NON_VOTER 127766fc592545a4997f7790f50f6076 (127.17.223.4) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } attrs { replace: true } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: NON_VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: true } } }
W20260709 13:05:27.235596 19374 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.4:43121, user_credentials={real_user=slave}} blocked reactor thread for 44016.6us
I20260709 13:05:27.236436 19484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48824d5acfbc485ebf8c2d944e7202de" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:05:27.237401 19479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48824d5acfbc485ebf8c2d944e7202de" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
W20260709 13:05:27.239287 19377 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.2:46257, user_credentials={real_user=slave}} blocked reactor thread for 47228us
W20260709 13:05:27.401348 19293 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 309c3ca0ca4b4f3ba129752ea2cb293b with cas_config_opid_index 5: ChangeConfig:REMOVE_PEER failed with leader e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica e5256d91808b47c195bc9b4dbd7f2b87 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 6 leader_uuid: "e61c3a8f61bb48f8a963c9480e53c168" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } attrs { replace: true } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } } }
I20260709 13:05:27.235500 19406 raft_consensus.cc:2468] T fa731b585f684a7fb2d106c50f143b83 P e5256d91808b47c195bc9b4dbd7f2b87 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 127766fc592545a4997f7790f50f6076 in term 6.
I20260709 13:05:27.246222 20104 raft_consensus.cc:2468] T 48824d5acfbc485ebf8c2d944e7202de P 127766fc592545a4997f7790f50f6076 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 7.
I20260709 13:05:27.247656 19483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c5eebf646ad445a9d1b1adc319d7b16" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:05:27.402861 19483 raft_consensus.cc:2468] T 6c5eebf646ad445a9d1b1adc319d7b16 P 0473d2b2d01f4459b1e90fd12cc7840e [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 4.
I20260709 13:05:27.404655 20109 raft_consensus.cc:1240] T 48824d5acfbc485ebf8c2d944e7202de P 127766fc592545a4997f7790f50f6076 [term 7 FOLLOWER]: Rejecting Update request from peer 0473d2b2d01f4459b1e90fd12cc7840e for earlier term 6. Current term is 7. Ops: []
I20260709 13:05:27.137692 22264 consensus_queue.cc:237] T ece3db938bc649d4a40a51522ed5259c P 127766fc592545a4997f7790f50f6076 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
W20260709 13:05:27.255797 19450 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.3:36891, user_credentials={real_user=slave}} blocked reactor thread for 85033.5us
I20260709 13:05:27.255998 19478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e5873a19244c5ebbcd38e126796ee7" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:05:27.407817 19478 raft_consensus.cc:2468] T d1e5873a19244c5ebbcd38e126796ee7 P 0473d2b2d01f4459b1e90fd12cc7840e [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 8.
I20260709 13:05:27.270258 22293 consensus_queue.cc:1048] T 21e14947d70440f19044d8f75c31e1f9 P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.123s
I20260709 13:05:27.260257 19402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e1f505cb0f1427bbd698ac889d80821" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:05:27.413163 19481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46c5bfeecc314717bffe987e6844b6d0" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 12 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:05:27.413887 19481 raft_consensus.cc:3060] T 46c5bfeecc314717bffe987e6844b6d0 P 0473d2b2d01f4459b1e90fd12cc7840e [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:05:27.267071 19554 raft_consensus.cc:1275] T 14935b3ddf914369822e4a0547aaa355 P e61c3a8f61bb48f8a963c9480e53c168 [term 6 FOLLOWER]: Refusing update from remote peer 127766fc592545a4997f7790f50f6076: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 6 index: 6. (index mismatch)
I20260709 13:05:27.235430 22303 raft_consensus.cc:493] T 2e36a9d6e29c4a7c860cf267efbd4c74 P 0473d2b2d01f4459b1e90fd12cc7840e [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:27.242980 22285 raft_consensus.cc:2804] T 46c5bfeecc314717bffe987e6844b6d0 P e61c3a8f61bb48f8a963c9480e53c168 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:05:27.235098 22284 raft_consensus.cc:493] T bc225c93219c45538b53a1bd3d387e4d P e61c3a8f61bb48f8a963c9480e53c168 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader e5256d91808b47c195bc9b4dbd7f2b87)
I20260709 13:05:27.190117 22166 consensus_queue.cc:1048] T f1b10566f45d4a7d9029858330e02d5b P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.069s
I20260709 13:05:27.277725 19486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46c5bfeecc314717bffe987e6844b6d0" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 12 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:05:27.193038 22254 consensus_queue.cc:1059] T ece3db938bc649d4a40a51522ed5259c P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.075s
I20260709 13:05:27.190006 22269 raft_consensus.cc:515] T 65d8cb8d6ec64f459d5a47cefab10acf P 127766fc592545a4997f7790f50f6076 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:05:27.436156 19486 raft_consensus.cc:1240] T fa8650e71aa14778b3d73721fc50d9fc P 0473d2b2d01f4459b1e90fd12cc7840e [term 8 FOLLOWER]: Rejecting Update request from peer e61c3a8f61bb48f8a963c9480e53c168 for earlier term 7. Current term is 8. Ops: []
I20260709 13:05:27.437659 22269 leader_election.cc:290] T 65d8cb8d6ec64f459d5a47cefab10acf P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:05:27.283545 19485 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58294 (request call id 1758) took 1796 ms. Trace:
W20260709 13:05:27.284328 19449 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.4:43121, user_credentials={real_user=slave}} blocked reactor thread for 113896us
I20260709 13:05:27.439978 19449 leader_election.cc:304] T ff9b0eddd810459b82d91c60777c10eb P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e; no voters: 127766fc592545a4997f7790f50f6076, e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:05:27.441461 22269 consensus_queue.cc:1048] T 1f85fc4b527a48848e5faa083b604e36 P 127766fc592545a4997f7790f50f6076 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:05:27.258831 21932 raft_consensus.cc:493] T 0e1085d23e8347fbbd5bce7542f4b1f4 P 0473d2b2d01f4459b1e90fd12cc7840e [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 127766fc592545a4997f7790f50f6076)
I20260709 13:05:27.396402 20108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96efeaaf1057492490e9a621f37e1a2d" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:05:27.380750 20111 raft_consensus.cc:1275] T 62c6c134d3d24a1ab144dd9ee6bc3f64 P 127766fc592545a4997f7790f50f6076 [term 8 FOLLOWER]: Refusing update from remote peer 0473d2b2d01f4459b1e90fd12cc7840e: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 13:05:27.193596 22195 consensus_queue.cc:1048] T 2e36a9d6e29c4a7c860cf267efbd4c74 P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:05:27.276324 22311 leader_election.cc:290] T edd7d470b5014c9489be7f41f64355c9 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 7 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:05:27.381183 19553 rpcz_store.cc:276] 0709 13:05:26.056115 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:26.207465 (+151350us) service_pool.cc:224] Handling call
0709 13:05:26.207985 (+   520us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:05:26.208232 (+   247us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:05:26.208260 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:05:26.208812 (+   552us) log.cc:844] Serialized 26 byte log entry
0709 13:05:26.263090 (+ 54278us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:05:26.263132 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:26.263219 (+    87us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:05:27.183661 (+920442us) raft_consensus.cc:1685] finished
0709 13:05:27.183680 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:27.183795 (+   115us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":53885,"threads_started":1,"wal-append.queue_time_us":82066}
I20260709 13:05:27.390934 19477 raft_consensus.cc:2468] T ef32ce6fdd0e40d382c79974f30295c6 P 0473d2b2d01f4459b1e90fd12cc7840e [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 7.
I20260709 13:05:27.396821 19551 raft_consensus.cc:2410] T 217b5fae677b4971b3bbd2f357a1f7ff P e61c3a8f61bb48f8a963c9480e53c168 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e5256d91808b47c195bc9b4dbd7f2b87 for term 5 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 13:05:27.412248 19402 raft_consensus.cc:2468] T 3e1f505cb0f1427bbd698ac889d80821 P e5256d91808b47c195bc9b4dbd7f2b87 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 6.
I20260709 13:05:27.430856 19559 raft_consensus.cc:2468] T df751f992649444090e27965eb1af85d P e61c3a8f61bb48f8a963c9480e53c168 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 8.
I20260709 13:05:27.426657 19480 raft_consensus.cc:2468] T 1efebf73c86e432baa55533136b6e12c P 0473d2b2d01f4459b1e90fd12cc7840e [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 5.
I20260709 13:05:27.263104 22332 raft_consensus.cc:515] T 40e1e16737a842ee936002830f36882e P e61c3a8f61bb48f8a963c9480e53c168 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:27.180212 22313 raft_consensus.cc:493] T 775c229504194560ba9589bc2199b089 P e5256d91808b47c195bc9b4dbd7f2b87 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:27.387976 22163 raft_consensus.cc:515] T 0cdf56e38bbc453d9438d359e5a69955 P 0473d2b2d01f4459b1e90fd12cc7840e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:27.403913 22255 raft_consensus.cc:3060] T 86a6797bdfe94fa496c050ceae4bd0d9 P e5256d91808b47c195bc9b4dbd7f2b87 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:05:27.446916 19526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.2:46257, user_credentials={real_user=slave}} blocked reactor thread for 60456.3us
I20260709 13:05:27.448768 19479 raft_consensus.cc:1240] T a08760e15aac4630a629431f56024dc8 P 0473d2b2d01f4459b1e90fd12cc7840e [term 7 FOLLOWER]: Rejecting Update request from peer e61c3a8f61bb48f8a963c9480e53c168 for earlier term 6. Current term is 7. Ops: []
I20260709 13:05:27.449738 19411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4509b76741dc428e9201c70c1658da13" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
I20260709 13:05:27.457204 19481 raft_consensus.cc:2468] T 46c5bfeecc314717bffe987e6844b6d0 P 0473d2b2d01f4459b1e90fd12cc7840e [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 12.
W20260709 13:05:27.457826 19523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.4:43121, user_credentials={real_user=slave}} blocked reactor thread for 200378us
I20260709 13:05:27.458274 19557 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41504 (request call id 402) took 1609 ms. Trace:
I20260709 13:05:27.404698 22063 raft_consensus.cc:493] T 2a16f7501e2444fb86d4e2778e734e02 P e5256d91808b47c195bc9b4dbd7f2b87 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 127766fc592545a4997f7790f50f6076)
I20260709 13:05:27.388170 22127 raft_consensus.cc:515] T 0afb57ae58a24a01850491d69f0213dd P 0473d2b2d01f4459b1e90fd12cc7840e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:05:27.501552 19411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40e1e16737a842ee936002830f36882e" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:05:27.461447 19406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df751f992649444090e27965eb1af85d" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
I20260709 13:05:27.443676 19403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edd7d470b5014c9489be7f41f64355c9" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
W20260709 13:05:27.489171 19526 leader_election.cc:336] T 217b5fae677b4971b3bbd2f357a1f7ff P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257): Timed out: RequestConsensusVote RPC to 127.17.223.2:46257 timed out after 1.818s (SENT)
I20260709 13:05:27.503136 19403 raft_consensus.cc:3060] T edd7d470b5014c9489be7f41f64355c9 P e5256d91808b47c195bc9b4dbd7f2b87 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:05:27.391920 21767 raft_consensus.cc:515] T 7f575b143b844aa096b50997dad3516a P 0473d2b2d01f4459b1e90fd12cc7840e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
W20260709 13:05:27.456828 22288 log.cc:927] Time spent T 14efcc79969f41babe5529c22d59156d P 0473d2b2d01f4459b1e90fd12cc7840e: Append to log took a long time: real 0.058s	user 0.000s	sys 0.000s
I20260709 13:05:27.381203 22208 raft_consensus.cc:515] T 70797e5783b5454ab0d0eea663e791e3 P 127766fc592545a4997f7790f50f6076 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:05:27.492100 19557 rpcz_store.cc:276] 0709 13:05:25.834476 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:26.041796 (+207320us) service_pool.cc:224] Handling call
0709 13:05:26.042188 (+   392us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:05:26.094074 (+ 51886us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:05:26.094111 (+    37us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:05:26.101587 (+  7476us) log.cc:844] Serialized 52 byte log entry
0709 13:05:26.267754 (+166167us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:05:26.267863 (+   109us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:26.268337 (+   474us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:05:27.443442 (+1175105us) raft_consensus.cc:1685] finished
0709 13:05:27.443464 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:27.443591 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":261,"raft.queue_time_us":5070,"raft.run_cpu_time_us":124,"raft.run_wall_time_us":4158,"thread_start_us":103883,"threads_started":1,"wal-append.queue_time_us":215939}
I20260709 13:05:27.449159 22057 raft_consensus.cc:2804] T 1dc5b3532fe54f74876d02beffa2c230 P 0473d2b2d01f4459b1e90fd12cc7840e [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:05:27.439432 19485 rpcz_store.cc:276] 0709 13:05:25.487171 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:25.487273 (+   102us) service_pool.cc:224] Handling call
0709 13:05:25.514701 (+ 27428us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:05:25.551063 (+ 36362us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:05:25.551095 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:05:25.551582 (+   487us) log.cc:844] Serialized 26 byte log entry
0709 13:05:25.824397 (+272815us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:05:26.001872 (+177475us) log.cc:844] Serialized 14 byte log entry
0709 13:05:26.004248 (+  2376us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:26.004381 (+   133us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:05:26.559882 (+555501us) spinlock_profiling.cc:243] Waited 3.73 ms on lock 0x7b4400022b4c. stack: 00007f4a79de9343 00007f4a79de9240 00007f4a797781d4 00007f4a834b6304 00007f4a834b6299 00007f4a79ca3db1 00007f4a79d41c85 00007f4a79d426a2 00007f4a7cab41db 00007f4a7caafaaf 00007f4a7caa386e 00007f4a7caa2bb6 00007f4a7caa27d8 00007f4a7caac221 00007f4a7caac1d9 00007f4a7caac169
0709 13:05:27.283180 (+723298us) raft_consensus.cc:1685] finished
0709 13:05:27.283289 (+   109us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:27.283471 (+   182us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":37842,"prepare.queue_time_us":320258,"prepare.run_cpu_time_us":32,"prepare.run_wall_time_us":33,"raft.queue_time_us":39037,"raft.run_cpu_time_us":330,"raft.run_wall_time_us":18416,"spinlock_wait_cycles":8588544,"thread_start_us":422496,"threads_started":2,"wal-append.queue_time_us":391221}
I20260709 13:05:27.504253 19411 raft_consensus.cc:2393] T 40e1e16737a842ee936002830f36882e P e5256d91808b47c195bc9b4dbd7f2b87 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0473d2b2d01f4459b1e90fd12cc7840e in current term 8: Already voted for candidate e5256d91808b47c195bc9b4dbd7f2b87 in this term.
I20260709 13:05:27.494988 19409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef32ce6fdd0e40d382c79974f30295c6" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:05:27.388417 22326 raft_consensus.cc:515] T 775c229504194560ba9589bc2199b089 P 127766fc592545a4997f7790f50f6076 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:05:27.512259 19559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65d8cb8d6ec64f459d5a47cefab10acf" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:05:27.457312 22285 raft_consensus.cc:697] T 46c5bfeecc314717bffe987e6844b6d0 P e61c3a8f61bb48f8a963c9480e53c168 [term 12 LEADER]: Becoming Leader. State: Replica: e61c3a8f61bb48f8a963c9480e53c168, State: Running, Role: LEADER
I20260709 13:05:27.530473 19477 raft_consensus.cc:1240] T 4509b76741dc428e9201c70c1658da13 P 0473d2b2d01f4459b1e90fd12cc7840e [term 3 FOLLOWER]: Rejecting Update request from peer e61c3a8f61bb48f8a963c9480e53c168 for earlier term 2. Current term is 3. Ops: []
I20260709 13:05:27.442704 22303 raft_consensus.cc:515] T 2e36a9d6e29c4a7c860cf267efbd4c74 P 0473d2b2d01f4459b1e90fd12cc7840e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:27.539438 19479 raft_consensus.cc:1275] T 7be9efa6559648dbb5a0f7684c4542d1 P 0473d2b2d01f4459b1e90fd12cc7840e [term 7 FOLLOWER]: Refusing update from remote peer e61c3a8f61bb48f8a963c9480e53c168: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:05:27.558176 19483 raft_consensus.cc:1275] T 7f575b143b844aa096b50997dad3516a P 0473d2b2d01f4459b1e90fd12cc7840e [term 3 FOLLOWER]: Refusing update from remote peer e61c3a8f61bb48f8a963c9480e53c168: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:05:27.444368 22284 raft_consensus.cc:515] T bc225c93219c45538b53a1bd3d387e4d P e61c3a8f61bb48f8a963c9480e53c168 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:27.460855 21932 raft_consensus.cc:515] T 0e1085d23e8347fbbd5bce7542f4b1f4 P 0473d2b2d01f4459b1e90fd12cc7840e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:05:27.568980 19485 raft_consensus.cc:1275] T 86a6797bdfe94fa496c050ceae4bd0d9 P 0473d2b2d01f4459b1e90fd12cc7840e [term 6 FOLLOWER]: Refusing update from remote peer e61c3a8f61bb48f8a963c9480e53c168: Log matching property violated. Preceding OpId in replica: term: 4 index: 2. Preceding OpId from leader: term: 6 index: 3. (index mismatch)
I20260709 13:05:27.529623 22057 raft_consensus.cc:493] T 1dc5b3532fe54f74876d02beffa2c230 P 0473d2b2d01f4459b1e90fd12cc7840e [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:27.576104 22057 raft_consensus.cc:3060] T 1dc5b3532fe54f74876d02beffa2c230 P 0473d2b2d01f4459b1e90fd12cc7840e [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:05:27.575963 22340 consensus_queue.cc:1059] T 172b3dd13109415a955b71ac0e9d2234 P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:05:27.518344 22316 leader_election.cc:290] T 2b74109013a140ada21feeef92d6f563 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:05:27.584836 19477 raft_consensus.cc:1275] T ff75a1d4cb1f493db8f71ddc136ba9ab P 0473d2b2d01f4459b1e90fd12cc7840e [term 6 FOLLOWER]: Refusing update from remote peer e61c3a8f61bb48f8a963c9480e53c168: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
W20260709 13:05:27.585840 19450 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.3:36891, user_credentials={real_user=slave}} blocked reactor thread for 178641us
I20260709 13:05:27.616874 20110 raft_consensus.cc:1240] T ed7fdbcb96d14d418db9ca90a792588a P 127766fc592545a4997f7790f50f6076 [term 4 FOLLOWER]: Rejecting Update request from peer 0473d2b2d01f4459b1e90fd12cc7840e for earlier term 3. Current term is 4. Ops: []
W20260709 13:05:27.617159 19374 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.4:43121, user_credentials={real_user=slave}} blocked reactor thread for 209969us
I20260709 13:05:27.617889 19374 leader_election.cc:304] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 127766fc592545a4997f7790f50f6076, e5256d91808b47c195bc9b4dbd7f2b87; no voters: 
W20260709 13:05:27.634243 19526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.2:46257, user_credentials={real_user=slave}} blocked reactor thread for 89749.1us
I20260709 13:05:27.515202 22063 raft_consensus.cc:515] T 2a16f7501e2444fb86d4e2778e734e02 P e5256d91808b47c195bc9b4dbd7f2b87 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:05:27.495688 22313 raft_consensus.cc:515] T 775c229504194560ba9589bc2199b089 P e5256d91808b47c195bc9b4dbd7f2b87 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:05:27.605836 22316 raft_consensus.cc:493] T 217b5fae677b4971b3bbd2f357a1f7ff P e61c3a8f61bb48f8a963c9480e53c168 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 0473d2b2d01f4459b1e90fd12cc7840e)
I20260709 13:05:27.685029 19526 leader_election.cc:304] T 0e1085d23e8347fbbd5bce7542f4b1f4 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e61c3a8f61bb48f8a963c9480e53c168; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, 127766fc592545a4997f7790f50f6076
I20260709 13:05:27.609982 22311 raft_consensus.cc:493] T 62c6c134d3d24a1ab144dd9ee6bc3f64 P e61c3a8f61bb48f8a963c9480e53c168 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 0473d2b2d01f4459b1e90fd12cc7840e)
I20260709 13:05:27.676345 22286 leader_election.cc:290] T d1e5873a19244c5ebbcd38e126796ee7 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 9 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:05:27.713706 22286 raft_consensus.cc:2749] T 0e1085d23e8347fbbd5bce7542f4b1f4 P e61c3a8f61bb48f8a963c9480e53c168 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:05:27.715390 19526 leader_election.cc:304] T 179fd671030940b4b4a4e24bcc4aba0a P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168; no voters: e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:05:27.714305 22311 raft_consensus.cc:515] T 62c6c134d3d24a1ab144dd9ee6bc3f64 P e61c3a8f61bb48f8a963c9480e53c168 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:05:27.636788 22195 raft_consensus.cc:2804] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P e5256d91808b47c195bc9b4dbd7f2b87 [term 9 FOLLOWER]: Leader election won for term 9
W20260709 13:05:27.734126 19450 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.3:36891, user_credentials={real_user=slave}} blocked reactor thread for 131467us
I20260709 13:05:27.735101 19450 leader_election.cc:304] T 3e1f505cb0f1427bbd698ac889d80821 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
W20260709 13:05:27.739017 19523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.1:40321, user_credentials={real_user=slave}} blocked reactor thread for 209917us
W20260709 13:05:27.787333 19523 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:05:27.791381 19526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.2:46257, user_credentials={real_user=slave}} blocked reactor thread for 76075.9us
I20260709 13:05:27.793273 19526 leader_election.cc:304] T b9f0d59553ad444883fcf5b5909f9798 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168; no voters: e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:05:27.602463 22341 consensus_queue.cc:1048] T 9962423cb4e54fcfa5de01daf68a86e7 P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.135s
I20260709 13:05:27.685706 22166 raft_consensus.cc:493] T e381f1d6b8184797ad142de49be225a8 P e5256d91808b47c195bc9b4dbd7f2b87 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 0473d2b2d01f4459b1e90fd12cc7840e)
I20260709 13:05:27.740940 22312 raft_consensus.cc:493] T 2b74109013a140ada21feeef92d6f563 P e5256d91808b47c195bc9b4dbd7f2b87 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:05:27.895656 20078 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.510s	user 0.000s	sys 0.011s
W20260709 13:05:27.896082 20078 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.510s	user 0.000s	sys 0.011s
W20260709 13:05:27.896413 20078 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.2:46257, user_credentials={real_user=slave}} blocked reactor thread for 527905us
I20260709 13:05:27.898154 22352 raft_consensus.cc:2749] T ff9b0eddd810459b82d91c60777c10eb P 0473d2b2d01f4459b1e90fd12cc7840e [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:05:27.901507 22352 raft_consensus.cc:493] T 76cb037fc9064d13b59a8969d897ce8c P 0473d2b2d01f4459b1e90fd12cc7840e [term 7 FOLLOWER]: Starting pre-election (detected failure of leader e5256d91808b47c195bc9b4dbd7f2b87)
I20260709 13:05:27.902976 22360 raft_consensus.cc:493] T 85c494af21f9457a85da47b9bc70c1fd P 127766fc592545a4997f7790f50f6076 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader e5256d91808b47c195bc9b4dbd7f2b87)
I20260709 13:05:27.903635 22360 raft_consensus.cc:515] T 85c494af21f9457a85da47b9bc70c1fd P 127766fc592545a4997f7790f50f6076 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:05:27.906299 22360 leader_election.cc:290] T 85c494af21f9457a85da47b9bc70c1fd P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
W20260709 13:05:27.846632 19452 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.595s	user 0.000s	sys 0.030s
I20260709 13:05:27.670369 22293 consensus_queue.cc:1059] T 14efcc79969f41babe5529c22d59156d P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.162s
I20260709 13:05:27.918344 22286 raft_consensus.cc:493] T e381f1d6b8184797ad142de49be225a8 P e61c3a8f61bb48f8a963c9480e53c168 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 0473d2b2d01f4459b1e90fd12cc7840e)
W20260709 13:05:27.922164 19526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.2:46257, user_credentials={real_user=slave}} blocked reactor thread for 129168us
I20260709 13:05:27.820253 22316 raft_consensus.cc:515] T 217b5fae677b4971b3bbd2f357a1f7ff P e61c3a8f61bb48f8a963c9480e53c168 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:27.931736 22195 raft_consensus.cc:697] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P e5256d91808b47c195bc9b4dbd7f2b87 [term 9 LEADER]: Becoming Leader. State: Replica: e5256d91808b47c195bc9b4dbd7f2b87, State: Running, Role: LEADER
I20260709 13:05:27.920980 22382 raft_consensus.cc:2804] T 179fd671030940b4b4a4e24bcc4aba0a P e61c3a8f61bb48f8a963c9480e53c168 [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 13:05:27.940438 19449 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:05:27.942425 19524 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:27.875738 22312 raft_consensus.cc:515] T 2b74109013a140ada21feeef92d6f563 P e5256d91808b47c195bc9b4dbd7f2b87 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:27.730386 22285 consensus_queue.cc:237] T 46c5bfeecc314717bffe987e6844b6d0 P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 9.4, Last appended by leader: 4, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
W20260709 13:05:27.947341 22343 log.cc:927] Time spent T 1f85fc4b527a48848e5faa083b604e36 P e5256d91808b47c195bc9b4dbd7f2b87: Append to log took a long time: real 0.217s	user 0.000s	sys 0.000s
I20260709 13:05:27.947186 22327 consensus_queue.cc:1059] T 96efeaaf1057492490e9a621f37e1a2d P 127766fc592545a4997f7790f50f6076 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:05:27.948539 22344 raft_consensus.cc:493] T 70797e5783b5454ab0d0eea663e791e3 P e61c3a8f61bb48f8a963c9480e53c168 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader e5256d91808b47c195bc9b4dbd7f2b87)
W20260709 13:05:27.845996 19375 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.3:36891, user_credentials={real_user=slave}} blocked reactor thread for 444380us
W20260709 13:05:27.949539 19404 consensus_meta.cc:287] T 7be9efa6559648dbb5a0f7684c4542d1 P e5256d91808b47c195bc9b4dbd7f2b87: Time spent flushing consensus metadata: real 0.545s	user 0.008s	sys 0.000s
I20260709 13:05:27.972571 20112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96efeaaf1057492490e9a621f37e1a2d" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076"
I20260709 13:05:27.973997 22057 raft_consensus.cc:515] T 1dc5b3532fe54f74876d02beffa2c230 P 0473d2b2d01f4459b1e90fd12cc7840e [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:27.975016 22381 raft_consensus.cc:2804] T 3e1f505cb0f1427bbd698ac889d80821 P 0473d2b2d01f4459b1e90fd12cc7840e [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 13:05:27.975471 22336 log.cc:927] Time spent T b08304a0a02b42d7840c4e8ee9a6bd1a P e61c3a8f61bb48f8a963c9480e53c168: Append to log took a long time: real 0.085s	user 0.000s	sys 0.000s
I20260709 13:05:27.975617 22365 raft_consensus.cc:493] T f1b10566f45d4a7d9029858330e02d5b P 0473d2b2d01f4459b1e90fd12cc7840e [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:27.975914 22332 leader_election.cc:290] T 40e1e16737a842ee936002830f36882e P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:05:27.977243 22353 raft_consensus.cc:493] T 5ec1c4ce15e04c7e8c283a62179f2a64 P e5256d91808b47c195bc9b4dbd7f2b87 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 127766fc592545a4997f7790f50f6076)
I20260709 13:05:27.978029 22284 leader_election.cc:290] T bc225c93219c45538b53a1bd3d387e4d P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:05:27.889389 22166 raft_consensus.cc:515] T e381f1d6b8184797ad142de49be225a8 P e5256d91808b47c195bc9b4dbd7f2b87 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:27.929689 22163 leader_election.cc:290] T 0cdf56e38bbc453d9438d359e5a69955 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
W20260709 13:05:27.992081 19560 consensus_meta.cc:287] T fa731b585f684a7fb2d106c50f143b83 P e61c3a8f61bb48f8a963c9480e53c168: Time spent flushing consensus metadata: real 0.569s	user 0.010s	sys 0.000s
I20260709 13:05:28.132110 19560 raft_consensus.cc:2468] T fa731b585f684a7fb2d106c50f143b83 P e61c3a8f61bb48f8a963c9480e53c168 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 127766fc592545a4997f7790f50f6076 in term 6.
W20260709 13:05:27.994247 19452 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.743s	user 0.000s	sys 0.030s
I20260709 13:05:28.003969 19526 leader_election.cc:400] T 96efeaaf1057492490e9a621f37e1a2d P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 6 pre-election: Vote denied by peer 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257) with higher term. Message: Invalid argument: T 96efeaaf1057492490e9a621f37e1a2d P 0473d2b2d01f4459b1e90fd12cc7840e [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e61c3a8f61bb48f8a963c9480e53c168 for earlier term 6. Current term is 7.
I20260709 13:05:28.133090 19526 leader_election.cc:403] T 96efeaaf1057492490e9a621f37e1a2d P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 6 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:05:27.961808 22208 leader_election.cc:290] T 70797e5783b5454ab0d0eea663e791e3 P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:05:27.902125 22352 raft_consensus.cc:515] T 76cb037fc9064d13b59a8969d897ce8c P 0473d2b2d01f4459b1e90fd12cc7840e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:27.851699 22172 consensus_queue.cc:1048] T 14935b3ddf914369822e4a0547aaa355 P 127766fc592545a4997f7790f50f6076 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.168s
I20260709 13:05:28.047122 20110 raft_consensus.cc:1275] T 775c229504194560ba9589bc2199b089 P 127766fc592545a4997f7790f50f6076 [term 5 FOLLOWER]: Refusing update from remote peer 0473d2b2d01f4459b1e90fd12cc7840e: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:05:28.068179 19556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70797e5783b5454ab0d0eea663e791e3" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:05:28.125487 19551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85c494af21f9457a85da47b9bc70c1fd" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
W20260709 13:05:28.133308 19452 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:05:28.136296 19450 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.3:36891, user_credentials={real_user=slave}} blocked reactor thread for 401270us
I20260709 13:05:28.019022 22382 raft_consensus.cc:493] T 179fd671030940b4b4a4e24bcc4aba0a P e61c3a8f61bb48f8a963c9480e53c168 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 0473d2b2d01f4459b1e90fd12cc7840e)
I20260709 13:05:28.165055 22382 raft_consensus.cc:3060] T 179fd671030940b4b4a4e24bcc4aba0a P e61c3a8f61bb48f8a963c9480e53c168 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:05:28.164717 22352 leader_election.cc:290] T 76cb037fc9064d13b59a8969d897ce8c P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:05:28.175068 22382 raft_consensus.cc:515] T 179fd671030940b4b4a4e24bcc4aba0a P e61c3a8f61bb48f8a963c9480e53c168 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:28.179564 19449 leader_election.cc:304] T 86a6797bdfe94fa496c050ceae4bd0d9 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87; no voters: e61c3a8f61bb48f8a963c9480e53c168
W20260709 13:05:28.099189 21957 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.562s	user 0.014s	sys 0.021s
I20260709 13:05:28.058743 22381 raft_consensus.cc:493] T 3e1f505cb0f1427bbd698ac889d80821 P 0473d2b2d01f4459b1e90fd12cc7840e [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:28.091663 22064 raft_consensus.cc:493] T 7f575b143b844aa096b50997dad3516a P e5256d91808b47c195bc9b4dbd7f2b87 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader e61c3a8f61bb48f8a963c9480e53c168)
I20260709 13:05:28.095722 22303 leader_election.cc:290] T 2e36a9d6e29c4a7c860cf267efbd4c74 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:05:28.060496 22344 raft_consensus.cc:515] T 70797e5783b5454ab0d0eea663e791e3 P e61c3a8f61bb48f8a963c9480e53c168 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:05:28.100988 22127 leader_election.cc:290] T 0afb57ae58a24a01850491d69f0213dd P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
W20260709 13:05:28.203142 19403 consensus_meta.cc:287] T edd7d470b5014c9489be7f41f64355c9 P e5256d91808b47c195bc9b4dbd7f2b87: Time spent flushing consensus metadata: real 0.687s	user 0.011s	sys 0.000s
I20260709 13:05:28.207583 19403 raft_consensus.cc:2468] T edd7d470b5014c9489be7f41f64355c9 P e5256d91808b47c195bc9b4dbd7f2b87 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 7.
W20260709 13:05:28.204085 19526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.2:46257, user_credentials={real_user=slave}} blocked reactor thread for 200236us
I20260709 13:05:28.183998 22326 leader_election.cc:290] T 775c229504194560ba9589bc2199b089 P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:05:28.040289 22286 raft_consensus.cc:515] T e381f1d6b8184797ad142de49be225a8 P e61c3a8f61bb48f8a963c9480e53c168 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:28.203569 22388 raft_consensus.cc:493] T 309c3ca0ca4b4f3ba129752ea2cb293b P 0473d2b2d01f4459b1e90fd12cc7840e [term 6 FOLLOWER]: Starting pre-election (detected failure of leader e61c3a8f61bb48f8a963c9480e53c168)
I20260709 13:05:28.203011 22352 raft_consensus.cc:493] T 1f85fc4b527a48848e5faa083b604e36 P 0473d2b2d01f4459b1e90fd12cc7840e [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:28.216936 19526 leader_election.cc:304] T 0afb57ae58a24a01850491d69f0213dd P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e61c3a8f61bb48f8a963c9480e53c168; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, 127766fc592545a4997f7790f50f6076
W20260709 13:05:28.185519 22330 log.cc:927] Time spent T 96efeaaf1057492490e9a621f37e1a2d P e61c3a8f61bb48f8a963c9480e53c168: Append to log took a long time: real 0.086s	user 0.000s	sys 0.000s
I20260709 13:05:28.229211 19405 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49050 (request call id 376) took 1821 ms. Trace:
I20260709 13:05:28.230563 19450 leader_election.cc:304] T df751f992649444090e27965eb1af85d P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:05:28.247763 19405 rpcz_store.cc:276] 0709 13:05:26.407743 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:26.413232 (+  5489us) service_pool.cc:224] Handling call
0709 13:05:26.413517 (+   285us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:05:27.165799 (+752282us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:05:27.165823 (+    24us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:05:27.179367 (+ 13544us) log.cc:844] Serialized 26 byte log entry
0709 13:05:27.435688 (+256321us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:05:27.435739 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:27.435814 (+    75us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:05:28.228926 (+793112us) raft_consensus.cc:1685] finished
0709 13:05:28.228954 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:28.229138 (+   184us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":67387,"raft.queue_time_us":755955,"raft.run_cpu_time_us":90,"raft.run_wall_time_us":2757,"thread_start_us":198800,"threads_started":1,"wal-append.queue_time_us":417599}
I20260709 13:05:28.191630 22063 leader_election.cc:290] T 2a16f7501e2444fb86d4e2778e734e02 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:05:28.252133 19556 raft_consensus.cc:2468] T 70797e5783b5454ab0d0eea663e791e3 P e61c3a8f61bb48f8a963c9480e53c168 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 127766fc592545a4997f7790f50f6076 in term 8.
I20260709 13:05:28.134912 22284 raft_consensus.cc:493] T 14935b3ddf914369822e4a0547aaa355 P e61c3a8f61bb48f8a963c9480e53c168 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:28.258289 19560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40e1e16737a842ee936002830f36882e" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:05:28.325654 19559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cdf56e38bbc453d9438d359e5a69955" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:05:28.326275 19560 raft_consensus.cc:2468] T 40e1e16737a842ee936002830f36882e P e61c3a8f61bb48f8a963c9480e53c168 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 8.
I20260709 13:05:28.326332 19559 raft_consensus.cc:2468] T 0cdf56e38bbc453d9438d359e5a69955 P e61c3a8f61bb48f8a963c9480e53c168 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 9.
W20260709 13:05:28.261821 19449 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.1:40321, user_credentials={real_user=slave}} blocked reactor thread for 44953.3us
I20260709 13:05:28.328243 19558 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40438 (request call id 1808) took 1130 ms. Trace:
I20260709 13:05:28.148193 22332 raft_consensus.cc:2804] T b9f0d59553ad444883fcf5b5909f9798 P e61c3a8f61bb48f8a963c9480e53c168 [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 13:05:28.216245 21957 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.669s	user 0.021s	sys 0.025s
I20260709 13:05:28.246434 22352 raft_consensus.cc:515] T 1f85fc4b527a48848e5faa083b604e36 P 0473d2b2d01f4459b1e90fd12cc7840e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:05:28.316624 22286 leader_election.cc:290] T e381f1d6b8184797ad142de49be225a8 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:05:28.317569 22339 raft_consensus.cc:493] T 9962423cb4e54fcfa5de01daf68a86e7 P 0473d2b2d01f4459b1e90fd12cc7840e [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:05:28.318032 22355 log.cc:927] Time spent T 7f575b143b844aa096b50997dad3516a P e5256d91808b47c195bc9b4dbd7f2b87: Append to log took a long time: real 0.137s	user 0.001s	sys 0.000s
I20260709 13:05:28.319958 22166 leader_election.cc:290] T e381f1d6b8184797ad142de49be225a8 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:05:28.257494 19554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef32ce6fdd0e40d382c79974f30295c6" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
W20260709 13:05:28.321794 19526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.2:46257, user_credentials={real_user=slave}} blocked reactor thread for 104941us
I20260709 13:05:28.228478 22303 raft_consensus.cc:493] T bc225c93219c45538b53a1bd3d387e4d P 0473d2b2d01f4459b1e90fd12cc7840e [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:28.328630 19558 rpcz_store.cc:276] 0709 13:05:27.197423 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:27.197533 (+   110us) service_pool.cc:224] Handling call
0709 13:05:27.197814 (+   281us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:05:27.198196 (+   382us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:05:27.198224 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:05:27.198636 (+   412us) log.cc:844] Serialized 26 byte log entry
0709 13:05:27.463994 (+265358us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:05:27.464050 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:27.464149 (+    99us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:05:28.328039 (+863890us) raft_consensus.cc:1685] finished
0709 13:05:28.328057 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:28.328185 (+   128us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":159,"raft.run_cpu_time_us":71,"raft.run_wall_time_us":72,"thread_start_us":264950,"threads_started":1,"wal-append.queue_time_us":487387}
I20260709 13:05:28.337338 22360 raft_consensus.cc:3055] T 96efeaaf1057492490e9a621f37e1a2d P 127766fc592545a4997f7790f50f6076 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:05:28.215251 22351 raft_consensus.cc:3055] T 14efcc79969f41babe5529c22d59156d P e5256d91808b47c195bc9b4dbd7f2b87 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:05:28.349888 19559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0afb57ae58a24a01850491d69f0213dd" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:05:28.390697 19560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e1085d23e8347fbbd5bce7542f4b1f4" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:05:28.119474 22365 raft_consensus.cc:515] T f1b10566f45d4a7d9029858330e02d5b P 0473d2b2d01f4459b1e90fd12cc7840e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:28.227939 22313 leader_election.cc:290] T 775c229504194560ba9589bc2199b089 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:05:28.256135 22195 consensus_queue.cc:237] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:05:28.436578 19553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e36a9d6e29c4a7c860cf267efbd4c74" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:05:28.437402 22344 leader_election.cc:290] T 70797e5783b5454ab0d0eea663e791e3 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:05:28.438221 19557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76cb037fc9064d13b59a8969d897ce8c" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
W20260709 13:05:28.440188 22363 log.cc:927] Time spent T 2e36a9d6e29c4a7c860cf267efbd4c74 P e5256d91808b47c195bc9b4dbd7f2b87: Append to log took a long time: real 0.201s	user 0.000s	sys 0.000s
W20260709 13:05:28.442057 22255 consensus_meta.cc:287] T 86a6797bdfe94fa496c050ceae4bd0d9 P e5256d91808b47c195bc9b4dbd7f2b87: Time spent flushing consensus metadata: real 0.938s	user 0.008s	sys 0.000s
I20260709 13:05:28.444712 22390 raft_consensus.cc:3060] T 96efeaaf1057492490e9a621f37e1a2d P e61c3a8f61bb48f8a963c9480e53c168 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:05:28.461841 19554 raft_consensus.cc:2410] T ef32ce6fdd0e40d382c79974f30295c6 P e61c3a8f61bb48f8a963c9480e53c168 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0473d2b2d01f4459b1e90fd12cc7840e for term 8 because replica has last-logged OpId of term: 7 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 4.
I20260709 13:05:28.462605 19526 leader_election.cc:304] T 1a61655d99124a29b486ba4a5b37faea P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168; no voters: e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:05:28.206489 22381 raft_consensus.cc:3060] T 3e1f505cb0f1427bbd698ac889d80821 P 0473d2b2d01f4459b1e90fd12cc7840e [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:05:28.239694 22127 consensus_queue.cc:1059] T 48824d5acfbc485ebf8c2d944e7202de P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.155s
I20260709 13:05:28.217737 22064 raft_consensus.cc:515] T 7f575b143b844aa096b50997dad3516a P e5256d91808b47c195bc9b4dbd7f2b87 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:28.238114 22388 raft_consensus.cc:515] T 309c3ca0ca4b4f3ba129752ea2cb293b P 0473d2b2d01f4459b1e90fd12cc7840e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } attrs { replace: true } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:05:28.388554 22332 raft_consensus.cc:493] T b9f0d59553ad444883fcf5b5909f9798 P e61c3a8f61bb48f8a963c9480e53c168 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:28.388303 22264 raft_consensus.cc:493] T 14efcc79969f41babe5529c22d59156d P 127766fc592545a4997f7790f50f6076 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:28.475363 22303 raft_consensus.cc:515] T bc225c93219c45538b53a1bd3d387e4d P 0473d2b2d01f4459b1e90fd12cc7840e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:28.472070 22339 raft_consensus.cc:515] T 9962423cb4e54fcfa5de01daf68a86e7 P 0473d2b2d01f4459b1e90fd12cc7840e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
W20260709 13:05:28.477442 19449 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.1:40321, user_credentials={real_user=slave}} blocked reactor thread for 87938us
I20260709 13:05:28.389361 22284 raft_consensus.cc:515] T 14935b3ddf914369822e4a0547aaa355 P e61c3a8f61bb48f8a963c9480e53c168 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } attrs { replace: true } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:05:28.478206 22369 raft_consensus.cc:493] T b08304a0a02b42d7840c4e8ee9a6bd1a P 0473d2b2d01f4459b1e90fd12cc7840e [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:28.478160 22384 consensus_queue.cc:1048] T 217b5fae677b4971b3bbd2f357a1f7ff P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.011s
I20260709 13:05:28.491153 22391 consensus_queue.cc:1059] T 28af091831594f9d8e96482078cc7625 P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 }, Status: INVALID_TERM, Last received: 6.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:05:28.151839 22353 raft_consensus.cc:515] T 5ec1c4ce15e04c7e8c283a62179f2a64 P e5256d91808b47c195bc9b4dbd7f2b87 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
W20260709 13:05:28.509589 19452 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:28.499619 22365 leader_election.cc:290] T f1b10566f45d4a7d9029858330e02d5b P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
W20260709 13:05:28.530211 19524 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:28.479317 22351 raft_consensus.cc:740] T 14efcc79969f41babe5529c22d59156d P e5256d91808b47c195bc9b4dbd7f2b87 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: e5256d91808b47c195bc9b4dbd7f2b87, State: Running, Role: LEADER
I20260709 13:05:28.473760 22360 raft_consensus.cc:740] T 96efeaaf1057492490e9a621f37e1a2d P 127766fc592545a4997f7790f50f6076 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 127766fc592545a4997f7790f50f6076, State: Running, Role: LEADER
I20260709 13:05:28.532620 22380 raft_consensus.cc:493] T f1b10566f45d4a7d9029858330e02d5b P e61c3a8f61bb48f8a963c9480e53c168 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader e5256d91808b47c195bc9b4dbd7f2b87)
I20260709 13:05:28.477586 22361 raft_consensus.cc:2804] T df751f992649444090e27965eb1af85d P 0473d2b2d01f4459b1e90fd12cc7840e [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:05:28.568234 19449 leader_election.cc:304] T fa8650e71aa14778b3d73721fc50d9fc P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e; no voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:05:28.554950 22332 raft_consensus.cc:3060] T b9f0d59553ad444883fcf5b5909f9798 P e61c3a8f61bb48f8a963c9480e53c168 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:05:28.555402 19526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.2:46257, user_credentials={real_user=slave}} blocked reactor thread for 92888.2us
I20260709 13:05:28.611029 19405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "309c3ca0ca4b4f3ba129752ea2cb293b" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:05:28.613646 19403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65d8cb8d6ec64f459d5a47cefab10acf" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:05:28.566484 22344 raft_consensus.cc:2804] T 1a61655d99124a29b486ba4a5b37faea P e61c3a8f61bb48f8a963c9480e53c168 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:05:28.567698 22316 leader_election.cc:290] T 217b5fae677b4971b3bbd2f357a1f7ff P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:05:28.634863 19526 leader_election.cc:304] T 22196caba61445d3bec98a0aab3c337d P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168; no voters: e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:05:28.606978 22313 raft_consensus.cc:493] T 14935b3ddf914369822e4a0547aaa355 P e5256d91808b47c195bc9b4dbd7f2b87 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:28.607271 22385 raft_consensus.cc:493] T f93ee515a9c14139bf566522ed8232f3 P e5256d91808b47c195bc9b4dbd7f2b87 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:28.534797 22255 raft_consensus.cc:515] T 86a6797bdfe94fa496c050ceae4bd0d9 P e5256d91808b47c195bc9b4dbd7f2b87 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
W20260709 13:05:28.654284 19449 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.1:40321, user_credentials={real_user=slave}} blocked reactor thread for 86152.9us
I20260709 13:05:28.657577 19449 leader_election.cc:304] T 4509b76741dc428e9201c70c1658da13 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e; no voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:05:28.657717 19526 leader_election.cc:304] T 3e1f505cb0f1427bbd698ac889d80821 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:05:28.567222 22264 raft_consensus.cc:515] T 14efcc79969f41babe5529c22d59156d P 127766fc592545a4997f7790f50f6076 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:05:28.613325 22057 leader_election.cc:290] T 1dc5b3532fe54f74876d02beffa2c230 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 6 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:05:28.690063 20110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0afb57ae58a24a01850491d69f0213dd" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
W20260709 13:05:28.659435 20076 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.3:36891, user_credentials={real_user=slave}} blocked reactor thread for 62444us
I20260709 13:05:28.659574 19526 leader_election.cc:304] T f93ee515a9c14139bf566522ed8232f3 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168; no voters: e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:05:28.633134 22365 raft_consensus.cc:3055] T 48824d5acfbc485ebf8c2d944e7202de P 0473d2b2d01f4459b1e90fd12cc7840e [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:05:28.694624 19449 leader_election.cc:304] T ab43d85f64114d4ebf618930e43d9ed0 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87; no voters: 127766fc592545a4997f7790f50f6076, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:05:28.725190 19410 raft_consensus.cc:1240] T 86a6797bdfe94fa496c050ceae4bd0d9 P e5256d91808b47c195bc9b4dbd7f2b87 [term 7 FOLLOWER]: Rejecting Update request from peer e61c3a8f61bb48f8a963c9480e53c168 for earlier term 6. Current term is 7. Ops: [6.3-6.3]
I20260709 13:05:28.619192 22312 leader_election.cc:290] T 2b74109013a140ada21feeef92d6f563 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:05:28.733609 19484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cdf56e38bbc453d9438d359e5a69955" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:05:28.746388 19484 raft_consensus.cc:2410] T 0cdf56e38bbc453d9438d359e5a69955 P 0473d2b2d01f4459b1e90fd12cc7840e [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e61c3a8f61bb48f8a963c9480e53c168 for term 9 because replica has last-logged OpId of term: 8 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 5.
I20260709 13:05:28.734508 19485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b74109013a140ada21feeef92d6f563" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:05:28.725749 19477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edd7d470b5014c9489be7f41f64355c9" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:05:28.649602 22386 raft_consensus.cc:2804] T 86a6797bdfe94fa496c050ceae4bd0d9 P 0473d2b2d01f4459b1e90fd12cc7840e [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:05:28.753473 20112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e1085d23e8347fbbd5bce7542f4b1f4" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:05:28.753986 20076 leader_election.cc:304] T fa731b585f684a7fb2d106c50f143b83 P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 127766fc592545a4997f7790f50f6076, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:05:28.747872 19477 raft_consensus.cc:3060] T edd7d470b5014c9489be7f41f64355c9 P 0473d2b2d01f4459b1e90fd12cc7840e [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:05:28.636471 21957 raft_consensus.cc:493] T bc225c93219c45538b53a1bd3d387e4d P e5256d91808b47c195bc9b4dbd7f2b87 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:28.597590 22369 raft_consensus.cc:515] T b08304a0a02b42d7840c4e8ee9a6bd1a P 0473d2b2d01f4459b1e90fd12cc7840e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:28.732949 22365 raft_consensus.cc:740] T 48824d5acfbc485ebf8c2d944e7202de P 0473d2b2d01f4459b1e90fd12cc7840e [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 0473d2b2d01f4459b1e90fd12cc7840e, State: Running, Role: LEADER
I20260709 13:05:28.677491 22391 raft_consensus.cc:3055] T 28af091831594f9d8e96482078cc7625 P 0473d2b2d01f4459b1e90fd12cc7840e [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:05:28.704108 22373 raft_consensus.cc:2804] T 3e1f505cb0f1427bbd698ac889d80821 P e61c3a8f61bb48f8a963c9480e53c168 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:05:28.762089 22386 raft_consensus.cc:493] T 86a6797bdfe94fa496c050ceae4bd0d9 P 0473d2b2d01f4459b1e90fd12cc7840e [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:28.743505 22286 raft_consensus.cc:493] T 2725d2c4cb054f18b0fc8f735c15f6c2 P e61c3a8f61bb48f8a963c9480e53c168 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader e5256d91808b47c195bc9b4dbd7f2b87)
I20260709 13:05:28.676371 22127 raft_consensus.cc:2749] T fa8650e71aa14778b3d73721fc50d9fc P 0473d2b2d01f4459b1e90fd12cc7840e [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:05:28.656421 22361 raft_consensus.cc:697] T df751f992649444090e27965eb1af85d P 0473d2b2d01f4459b1e90fd12cc7840e [term 8 LEADER]: Becoming Leader. State: Replica: 0473d2b2d01f4459b1e90fd12cc7840e, State: Running, Role: LEADER
I20260709 13:05:28.788897 22111 raft_consensus.cc:2804] T fa731b585f684a7fb2d106c50f143b83 P 127766fc592545a4997f7790f50f6076 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:05:28.770618 22057 raft_consensus.cc:2749] T 4509b76741dc428e9201c70c1658da13 P 0473d2b2d01f4459b1e90fd12cc7840e [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:05:28.650938 22313 raft_consensus.cc:515] T 14935b3ddf914369822e4a0547aaa355 P e5256d91808b47c195bc9b4dbd7f2b87 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } attrs { replace: true } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:05:28.776412 22366 raft_consensus.cc:2749] T 0afb57ae58a24a01850491d69f0213dd P e61c3a8f61bb48f8a963c9480e53c168 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:05:28.835708 22312 raft_consensus.cc:493] T 28af091831594f9d8e96482078cc7625 P e5256d91808b47c195bc9b4dbd7f2b87 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:05:28.861541 19449 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.4:43121, user_credentials={real_user=slave}} blocked reactor thread for 167046us
I20260709 13:05:28.820250 22378 raft_consensus.cc:493] T 179fd671030940b4b4a4e24bcc4aba0a P 0473d2b2d01f4459b1e90fd12cc7840e [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:05:28.864884 20075 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.136s	user 0.041s	sys 0.188s
W20260709 13:05:28.970393 20075 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.241s	user 0.042s	sys 0.188s
I20260709 13:05:28.834887 22344 raft_consensus.cc:697] T 1a61655d99124a29b486ba4a5b37faea P e61c3a8f61bb48f8a963c9480e53c168 [term 4 LEADER]: Becoming Leader. State: Replica: e61c3a8f61bb48f8a963c9480e53c168, State: Running, Role: LEADER
I20260709 13:05:28.696707 22316 raft_consensus.cc:2804] T 22196caba61445d3bec98a0aab3c337d P e61c3a8f61bb48f8a963c9480e53c168 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:05:28.878806 19477 raft_consensus.cc:2468] T edd7d470b5014c9489be7f41f64355c9 P 0473d2b2d01f4459b1e90fd12cc7840e [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 7.
I20260709 13:05:28.941160 22171 raft_consensus.cc:493] T ab43d85f64114d4ebf618930e43d9ed0 P 127766fc592545a4997f7790f50f6076 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader e61c3a8f61bb48f8a963c9480e53c168)
I20260709 13:05:28.940287 22383 raft_consensus.cc:2804] T f93ee515a9c14139bf566522ed8232f3 P e61c3a8f61bb48f8a963c9480e53c168 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:05:28.821465 22351 consensus_queue.cc:260] T 14efcc79969f41babe5529c22d59156d P e5256d91808b47c195bc9b4dbd7f2b87 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:05:28.636358 22380 raft_consensus.cc:515] T f1b10566f45d4a7d9029858330e02d5b P e61c3a8f61bb48f8a963c9480e53c168 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:28.853803 22377 raft_consensus.cc:493] T 22196caba61445d3bec98a0aab3c337d P e5256d91808b47c195bc9b4dbd7f2b87 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:05:28.946637 19375 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.853s	user 0.018s	sys 0.046s
W20260709 13:05:28.981796 19375 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.888s	user 0.019s	sys 0.046s
W20260709 13:05:28.982270 19375 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.3:36891, user_credentials={real_user=slave}} blocked reactor thread for 907037us
I20260709 13:05:26.374231 18300 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:05:28.950438 22284 leader_election.cc:290] T 14935b3ddf914369822e4a0547aaa355 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:05:28.726612 22360 consensus_queue.cc:260] T 96efeaaf1057492490e9a621f37e1a2d P 127766fc592545a4997f7790f50f6076 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
W20260709 13:05:28.991333 22395 log.cc:927] Time spent T 7be9efa6559648dbb5a0f7684c4542d1 P e5256d91808b47c195bc9b4dbd7f2b87: Append to log took a long time: real 0.159s	user 0.000s	sys 0.001s
I20260709 13:05:28.991456 22360 raft_consensus.cc:3060] T 96efeaaf1057492490e9a621f37e1a2d P 127766fc592545a4997f7790f50f6076 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:05:28.992761 22393 log.cc:927] Time spent T ece3db938bc649d4a40a51522ed5259c P 127766fc592545a4997f7790f50f6076: Append to log took a long time: real 0.340s	user 0.001s	sys 0.000s
I20260709 13:05:28.994037 22353 leader_election.cc:290] T 5ec1c4ce15e04c7e8c283a62179f2a64 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:05:28.659600 22385 raft_consensus.cc:515] T f93ee515a9c14139bf566522ed8232f3 P e5256d91808b47c195bc9b4dbd7f2b87 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:28.994982 22366 raft_consensus.cc:493] T 2a16f7501e2444fb86d4e2778e734e02 P e61c3a8f61bb48f8a963c9480e53c168 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 127766fc592545a4997f7790f50f6076)
I20260709 13:05:28.995235 22344 consensus_queue.cc:237] T 1a61655d99124a29b486ba4a5b37faea P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:28.776870 21957 raft_consensus.cc:515] T bc225c93219c45538b53a1bd3d387e4d P e5256d91808b47c195bc9b4dbd7f2b87 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
W20260709 13:05:28.854480 22293 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.729s	user 0.020s	sys 0.045s
W20260709 13:05:28.965986 19526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.2:46257, user_credentials={real_user=slave}} blocked reactor thread for 306471us
I20260709 13:05:28.958914 22286 raft_consensus.cc:515] T 2725d2c4cb054f18b0fc8f735c15f6c2 P e61c3a8f61bb48f8a963c9480e53c168 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
W20260709 13:05:28.940413 22375 log.cc:927] Time spent T 2e36a9d6e29c4a7c860cf267efbd4c74 P e61c3a8f61bb48f8a963c9480e53c168: Append to log took a long time: real 0.289s	user 0.001s	sys 0.000s
W20260709 13:05:29.054239 19449 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.4:43121, user_credentials={real_user=slave}} blocked reactor thread for 84272.6us
I20260709 13:05:28.953884 22373 raft_consensus.cc:493] T 3e1f505cb0f1427bbd698ac889d80821 P e61c3a8f61bb48f8a963c9480e53c168 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:28.955053 22386 raft_consensus.cc:3060] T 86a6797bdfe94fa496c050ceae4bd0d9 P 0473d2b2d01f4459b1e90fd12cc7840e [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:05:28.942291 22391 raft_consensus.cc:740] T 28af091831594f9d8e96482078cc7625 P 0473d2b2d01f4459b1e90fd12cc7840e [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 0473d2b2d01f4459b1e90fd12cc7840e, State: Running, Role: LEADER
I20260709 13:05:28.954849 22163 raft_consensus.cc:493] T f93ee515a9c14139bf566522ed8232f3 P 0473d2b2d01f4459b1e90fd12cc7840e [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:28.963498 22384 raft_consensus.cc:2749] T ab43d85f64114d4ebf618930e43d9ed0 P 0473d2b2d01f4459b1e90fd12cc7840e [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 13:05:29.139510 20076 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:05:28.974368 22358 log.cc:927] Time spent T 7be9efa6559648dbb5a0f7684c4542d1 P 127766fc592545a4997f7790f50f6076: Append to log took a long time: real 0.412s	user 0.001s	sys 0.001s
I20260709 13:05:28.955413 22387 raft_consensus.cc:493] T 40e1e16737a842ee936002830f36882e P e5256d91808b47c195bc9b4dbd7f2b87 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:28.981490 22171 raft_consensus.cc:515] T ab43d85f64114d4ebf618930e43d9ed0 P 127766fc592545a4997f7790f50f6076 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } attrs { replace: true } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:05:28.989789 22379 raft_consensus.cc:493] T 65d8cb8d6ec64f459d5a47cefab10acf P e61c3a8f61bb48f8a963c9480e53c168 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader e5256d91808b47c195bc9b4dbd7f2b87)
I20260709 13:05:28.978900 22303 leader_election.cc:290] T bc225c93219c45538b53a1bd3d387e4d P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:05:28.995522 22366 raft_consensus.cc:515] T 2a16f7501e2444fb86d4e2778e734e02 P e61c3a8f61bb48f8a963c9480e53c168 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:05:28.972864 22144 consensus_queue.cc:260] T 172b3dd13109415a955b71ac0e9d2234 P e5256d91808b47c195bc9b4dbd7f2b87 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
W20260709 13:05:29.162412 19404 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.596s	user 0.011s	sys 0.017s
I20260709 13:05:29.051282 19526 leader_election.cc:304] T 6c5eebf646ad445a9d1b1adc319d7b16 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168; no voters: 127766fc592545a4997f7790f50f6076
W20260709 13:05:28.997442 22293 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.875s	user 0.020s	sys 0.045s
I20260709 13:05:28.984201 22365 consensus_queue.cc:260] T 48824d5acfbc485ebf8c2d944e7202de P 0473d2b2d01f4459b1e90fd12cc7840e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:05:29.137219 22376 consensus_queue.cc:1059] T ece3db938bc649d4a40a51522ed5259c P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.083s
W20260709 13:05:29.173213 19524 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:05:29.173957 19526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.2:46257, user_credentials={real_user=slave}} blocked reactor thread for 122760us
I20260709 13:05:29.137665 22127 consensus_queue.cc:1048] T 62c6c134d3d24a1ab144dd9ee6bc3f64 P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Connected to new peer: Peer: permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:05:28.999569 22377 raft_consensus.cc:515] T 22196caba61445d3bec98a0aab3c337d P e5256d91808b47c195bc9b4dbd7f2b87 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:28.982208 22316 raft_consensus.cc:697] T 22196caba61445d3bec98a0aab3c337d P e61c3a8f61bb48f8a963c9480e53c168 [term 6 LEADER]: Becoming Leader. State: Replica: e61c3a8f61bb48f8a963c9480e53c168, State: Running, Role: LEADER
I20260709 13:05:28.975940 22312 raft_consensus.cc:515] T 28af091831594f9d8e96482078cc7625 P e5256d91808b47c195bc9b4dbd7f2b87 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
W20260709 13:05:29.143378 19449 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.4:43121, user_credentials={real_user=slave}} blocked reactor thread for 59357.9us
W20260709 13:05:29.173581 22027 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 2.767s	user 0.026s	sys 0.052s
W20260709 13:05:29.153738 19375 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.3:36891, user_credentials={real_user=slave}} blocked reactor thread for 104251us
I20260709 13:05:28.978951 22339 leader_election.cc:290] T 9962423cb4e54fcfa5de01daf68a86e7 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:05:29.053438 22057 raft_consensus.cc:493] T 7be9efa6559648dbb5a0f7684c4542d1 P 0473d2b2d01f4459b1e90fd12cc7840e [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:28.985726 22327 raft_consensus.cc:493] T 172b3dd13109415a955b71ac0e9d2234 P 127766fc592545a4997f7790f50f6076 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:05:29.051638 22271 consensus_queue.cc:1175] T 96efeaaf1057492490e9a621f37e1a2d P 127766fc592545a4997f7790f50f6076 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "e61c3a8f61bb48f8a963c9480e53c168" responder_term: 6 status { last_received { term: 6 index: 7 } last_committed_idx: 7 last_received_current_leader { term: 6 index: 7 } }
W20260709 13:05:29.056809 22372 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.764s	user 0.000s	sys 0.029s
I20260709 13:05:29.048013 22383 raft_consensus.cc:697] T f93ee515a9c14139bf566522ed8232f3 P e61c3a8f61bb48f8a963c9480e53c168 [term 9 LEADER]: Becoming Leader. State: Replica: e61c3a8f61bb48f8a963c9480e53c168, State: Running, Role: LEADER
I20260709 13:05:28.998260 22111 raft_consensus.cc:697] T fa731b585f684a7fb2d106c50f143b83 P 127766fc592545a4997f7790f50f6076 [term 6 LEADER]: Becoming Leader. State: Replica: 127766fc592545a4997f7790f50f6076, State: Running, Role: LEADER
I20260709 13:05:29.166461 22410 raft_consensus.cc:493] T a08760e15aac4630a629431f56024dc8 P 0473d2b2d01f4459b1e90fd12cc7840e [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:05:29.167389 19404 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.601s	user 0.011s	sys 0.017s
I20260709 13:05:29.167758 19479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cdf56e38bbc453d9438d359e5a69955" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:05:29.171518 19485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edd7d470b5014c9489be7f41f64355c9" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:05:29.070744 22373 raft_consensus.cc:3060] T 3e1f505cb0f1427bbd698ac889d80821 P e61c3a8f61bb48f8a963c9480e53c168 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:05:29.209025 22404 log.cc:927] Time spent T 217b5fae677b4971b3bbd2f357a1f7ff P e61c3a8f61bb48f8a963c9480e53c168: Append to log took a long time: real 0.334s	user 0.001s	sys 0.000s
I20260709 13:05:29.209520 22312 leader_election.cc:290] T 28af091831594f9d8e96482078cc7625 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:05:29.209683 22327 raft_consensus.cc:515] T 172b3dd13109415a955b71ac0e9d2234 P 127766fc592545a4997f7790f50f6076 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
W20260709 13:05:29.210778 20076 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:29.210714 22410 raft_consensus.cc:515] T a08760e15aac4630a629431f56024dc8 P 0473d2b2d01f4459b1e90fd12cc7840e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:29.211421 22057 raft_consensus.cc:515] T 7be9efa6559648dbb5a0f7684c4542d1 P 0473d2b2d01f4459b1e90fd12cc7840e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } attrs { replace: true } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: NON_VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: true } }
I20260709 13:05:29.213119 22410 leader_election.cc:290] T a08760e15aac4630a629431f56024dc8 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:05:29.213575 22057 leader_election.cc:290] T 7be9efa6559648dbb5a0f7684c4542d1 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:05:29.203449 22316 consensus_queue.cc:237] T 22196caba61445d3bec98a0aab3c337d P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:29.215065 22380 leader_election.cc:290] T f1b10566f45d4a7d9029858330e02d5b P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
W20260709 13:05:29.203511 22392 log.cc:927] Time spent T a08760e15aac4630a629431f56024dc8 P e5256d91808b47c195bc9b4dbd7f2b87: Append to log took a long time: real 0.208s	user 0.000s	sys 0.001s
I20260709 13:05:29.220991 19553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e381f1d6b8184797ad142de49be225a8" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:05:28.977803 22378 raft_consensus.cc:515] T 179fd671030940b4b4a4e24bcc4aba0a P 0473d2b2d01f4459b1e90fd12cc7840e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:29.054602 21926 consensus_queue.cc:1048] T 1dc5b3532fe54f74876d02beffa2c230 P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.108s
I20260709 13:05:29.059217 22402 raft_consensus.cc:493] T 9962423cb4e54fcfa5de01daf68a86e7 P 127766fc592545a4997f7790f50f6076 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader e5256d91808b47c195bc9b4dbd7f2b87)
I20260709 13:05:29.232255 19559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b74109013a140ada21feeef92d6f563" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:05:29.180055 19526 leader_election.cc:304] T ef32ce6fdd0e40d382c79974f30295c6 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168; no voters: e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:05:29.186599 19449 leader_election.cc:304] T 96efeaaf1057492490e9a621f37e1a2d P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e; no voters: 127766fc592545a4997f7790f50f6076, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:05:29.232976 19559 raft_consensus.cc:2468] T 2b74109013a140ada21feeef92d6f563 P e61c3a8f61bb48f8a963c9480e53c168 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 4.
I20260709 13:05:29.152333 19477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a61655d99124a29b486ba4a5b37faea" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
W20260709 13:05:29.233513 19449 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.4:43121, user_credentials={real_user=slave}} blocked reactor thread for 47001.8us
I20260709 13:05:29.234105 19477 raft_consensus.cc:2393] T 1a61655d99124a29b486ba4a5b37faea P 0473d2b2d01f4459b1e90fd12cc7840e [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate e5256d91808b47c195bc9b4dbd7f2b87 in current term 4: Already voted for candidate e61c3a8f61bb48f8a963c9480e53c168 in this term.
I20260709 13:05:29.173040 22255 leader_election.cc:290] T 86a6797bdfe94fa496c050ceae4bd0d9 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 7 election: Requested vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:05:29.170704 22303 raft_consensus.cc:493] T 21e14947d70440f19044d8f75c31e1f9 P 0473d2b2d01f4459b1e90fd12cc7840e [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:29.169857 22384 raft_consensus.cc:493] T 172b3dd13109415a955b71ac0e9d2234 P 0473d2b2d01f4459b1e90fd12cc7840e [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:29.147961 22163 raft_consensus.cc:515] T f93ee515a9c14139bf566522ed8232f3 P 0473d2b2d01f4459b1e90fd12cc7840e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:29.207383 19485 raft_consensus.cc:2368] T edd7d470b5014c9489be7f41f64355c9 P 0473d2b2d01f4459b1e90fd12cc7840e [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate e5256d91808b47c195bc9b4dbd7f2b87 for earlier term 6. Current term is 7.
I20260709 13:05:29.208124 19479 raft_consensus.cc:2410] T 0cdf56e38bbc453d9438d359e5a69955 P 0473d2b2d01f4459b1e90fd12cc7840e [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e5256d91808b47c195bc9b4dbd7f2b87 for term 9 because replica has last-logged OpId of term: 8 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 5.
I20260709 13:05:29.216802 22313 leader_election.cc:290] T 14935b3ddf914369822e4a0547aaa355 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:05:29.193240 22365 raft_consensus.cc:3060] T 48824d5acfbc485ebf8c2d944e7202de P 0473d2b2d01f4459b1e90fd12cc7840e [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:05:29.223376 19554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a16f7501e2444fb86d4e2778e734e02" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:05:29.223572 19404 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52328 (request call id 1633) took 2018 ms. Trace:
W20260709 13:05:29.171096 20075 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.1:40321, user_credentials={real_user=slave}} blocked reactor thread for 183914us
I20260709 13:05:29.232358 19558 raft_consensus.cc:1275] T 0cdf56e38bbc453d9438d359e5a69955 P e61c3a8f61bb48f8a963c9480e53c168 [term 9 FOLLOWER]: Refusing update from remote peer e5256d91808b47c195bc9b4dbd7f2b87: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
W20260709 13:05:29.238125 19526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.2:46257, user_credentials={real_user=slave}} blocked reactor thread for 58144.4us
I20260709 13:05:29.244555 19404 rpcz_store.cc:276] 0709 13:05:27.205636 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:27.207653 (+  2017us) service_pool.cc:224] Handling call
0709 13:05:27.207898 (+   245us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:27.208075 (+   177us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:05:28.043586 (+835511us) log.cc:844] Serialized 14 byte log entry
0709 13:05:29.207267 (+1163681us) log.cc:844] Serialized 14 byte log entry
0709 13:05:29.223257 (+ 15990us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:05:29.223308 (+    51us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:05:29.223357 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:29.223419 (+    62us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:29.223523 (+   104us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":43382,"raft.queue_time_us":60854,"raft.run_cpu_time_us":291,"raft.run_wall_time_us":30692,"thread_start_us":1120090,"threads_started":2,"wal-append.queue_time_us":639105}
W20260709 13:05:29.159911 22285 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.705s	user 0.005s	sys 0.021s
W20260709 13:05:29.191486 22027 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 2.808s	user 0.026s	sys 0.052s
W20260709 13:05:29.207670 22372 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.229s	user 0.004s	sys 0.034s
I20260709 13:05:29.247787 22412 raft_consensus.cc:2804] T 6c5eebf646ad445a9d1b1adc319d7b16 P e61c3a8f61bb48f8a963c9480e53c168 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:05:29.203755 22408 raft_consensus.cc:493] T 14935b3ddf914369822e4a0547aaa355 P 0473d2b2d01f4459b1e90fd12cc7840e [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:29.248057 22414 raft_consensus.cc:2749] T 96efeaaf1057492490e9a621f37e1a2d P 0473d2b2d01f4459b1e90fd12cc7840e [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:05:29.250324 19558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86a6797bdfe94fa496c050ceae4bd0d9" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 7 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:05:29.244160 19554 raft_consensus.cc:2468] T 2a16f7501e2444fb86d4e2778e734e02 P e61c3a8f61bb48f8a963c9480e53c168 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 7.
I20260709 13:05:29.252125 19477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "775c229504194560ba9589bc2199b089" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:05:29.190117 22264 leader_election.cc:290] T 14efcc79969f41babe5529c22d59156d P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:05:29.160907 22387 raft_consensus.cc:515] T 40e1e16737a842ee936002830f36882e P e5256d91808b47c195bc9b4dbd7f2b87 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:29.203585 22405 raft_consensus.cc:493] T 2725d2c4cb054f18b0fc8f735c15f6c2 P 0473d2b2d01f4459b1e90fd12cc7840e [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:29.259588 19559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28af091831594f9d8e96482078cc7625" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:05:29.289424 19559 raft_consensus.cc:2468] T 28af091831594f9d8e96482078cc7625 P e61c3a8f61bb48f8a963c9480e53c168 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 6.
I20260709 13:05:29.247896 22369 leader_election.cc:290] T b08304a0a02b42d7840c4e8ee9a6bd1a P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:05:29.260699 19479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36f6ba92b9ba46babe4ebd6c02e5fbd9" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:05:29.264012 22171 leader_election.cc:290] T ab43d85f64114d4ebf618930e43d9ed0 P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:05:29.264250 21932 leader_election.cc:290] T 0e1085d23e8347fbbd5bce7542f4b1f4 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:05:29.253973 22399 raft_consensus.cc:493] T 7be9efa6559648dbb5a0f7684c4542d1 P e5256d91808b47c195bc9b4dbd7f2b87 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader e61c3a8f61bb48f8a963c9480e53c168)
I20260709 13:05:29.254580 22402 raft_consensus.cc:515] T 9962423cb4e54fcfa5de01daf68a86e7 P 127766fc592545a4997f7790f50f6076 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:05:29.251098 22057 consensus_queue.cc:1048] T 775c229504194560ba9589bc2199b089 P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Connected to new peer: Peer: permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.046s
W20260709 13:05:29.268448 19306 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:44688 (request call id 224) took 14942 ms (client timeout 15000 ms). Trace:
I20260709 13:05:29.248651 22111 consensus_queue.cc:237] T fa731b585f684a7fb2d106c50f143b83 P 127766fc592545a4997f7790f50f6076 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:05:29.273366 19305 catalog_manager.cc:5697] T 4af19371ea874c09a0a2147040835cbb P e61c3a8f61bb48f8a963c9480e53c168 reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "127766fc592545a4997f7790f50f6076" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } } }
I20260709 13:05:29.276078 19485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e381f1d6b8184797ad142de49be225a8" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:05:29.277942 19553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14935b3ddf914369822e4a0547aaa355" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 7 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:05:29.185051 22284 consensus_queue.cc:1059] T fa8650e71aa14778b3d73721fc50d9fc P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.069s
I20260709 13:05:29.226755 22388 leader_election.cc:290] T 309c3ca0ca4b4f3ba129752ea2cb293b P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:05:29.242985 22380 raft_consensus.cc:2804] T ef32ce6fdd0e40d382c79974f30295c6 P e61c3a8f61bb48f8a963c9480e53c168 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:05:29.285322 20075 leader_election.cc:304] T 65d8cb8d6ec64f459d5a47cefab10acf P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 127766fc592545a4997f7790f50f6076; no voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168
W20260709 13:05:29.256265 22285 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.811s	user 0.005s	sys 0.022s
I20260709 13:05:29.286931 22389 consensus_queue.cc:1059] T 4509b76741dc428e9201c70c1658da13 P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.007s
I20260709 13:05:29.252364 22410 raft_consensus.cc:493] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P 0473d2b2d01f4459b1e90fd12cc7840e [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:29.205122 22361 consensus_queue.cc:237] T df751f992649444090e27965eb1af85d P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:29.288167 22366 leader_election.cc:290] T 2a16f7501e2444fb86d4e2778e734e02 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:05:29.269511 22377 leader_election.cc:290] T 22196caba61445d3bec98a0aab3c337d P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:05:29.304797 19477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "217b5fae677b4971b3bbd2f357a1f7ff" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
W20260709 13:05:29.338490 19526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.2:46257, user_credentials={real_user=slave}} blocked reactor thread for 85059.6us
I20260709 13:05:29.353189 19553 raft_consensus.cc:2468] T 14935b3ddf914369822e4a0547aaa355 P e61c3a8f61bb48f8a963c9480e53c168 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 6.
I20260709 13:05:29.292835 22339 raft_consensus.cc:493] T ed7fdbcb96d14d418db9ca90a792588a P 0473d2b2d01f4459b1e90fd12cc7840e [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:29.388099 19404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b74109013a140ada21feeef92d6f563" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:05:29.385445 19305 catalog_manager.cc:5697] T e381f1d6b8184797ad142de49be225a8 P e61c3a8f61bb48f8a963c9480e53c168 reported cstate change: term changed from 3 to 4, leader changed from 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2) to e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3). New cstate: current_term: 4 leader_uuid: "e61c3a8f61bb48f8a963c9480e53c168" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } health_report { overall_health: HEALTHY } } }
I20260709 13:05:29.388672 19405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40e1e16737a842ee936002830f36882e" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:05:29.389186 19403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc225c93219c45538b53a1bd3d387e4d" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:05:29.405750 19405 raft_consensus.cc:2468] T 40e1e16737a842ee936002830f36882e P e5256d91808b47c195bc9b4dbd7f2b87 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 8.
I20260709 13:05:29.406078 19403 raft_consensus.cc:2468] T bc225c93219c45538b53a1bd3d387e4d P e5256d91808b47c195bc9b4dbd7f2b87 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 9.
I20260709 13:05:29.250775 22303 raft_consensus.cc:515] T 21e14947d70440f19044d8f75c31e1f9 P 0473d2b2d01f4459b1e90fd12cc7840e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:29.284475 22412 raft_consensus.cc:493] T 6c5eebf646ad445a9d1b1adc319d7b16 P e61c3a8f61bb48f8a963c9480e53c168 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 127766fc592545a4997f7790f50f6076)
W20260709 13:05:29.394001 20075 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.1:40321, user_credentials={real_user=slave}} blocked reactor thread for 108846us
I20260709 13:05:29.409467 19408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e5873a19244c5ebbcd38e126796ee7" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
I20260709 13:05:29.410050 20075 leader_election.cc:304] T 309c3ca0ca4b4f3ba129752ea2cb293b P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 127766fc592545a4997f7790f50f6076; no voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:05:29.300715 22369 raft_consensus.cc:493] T 14efcc79969f41babe5529c22d59156d P 0473d2b2d01f4459b1e90fd12cc7840e [term 6 FOLLOWER]: Starting pre-election (detected failure of leader e5256d91808b47c195bc9b4dbd7f2b87)
I20260709 13:05:29.165530 22379 raft_consensus.cc:515] T 65d8cb8d6ec64f459d5a47cefab10acf P e61c3a8f61bb48f8a963c9480e53c168 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:05:29.405423 19404 raft_consensus.cc:2468] T 2b74109013a140ada21feeef92d6f563 P e5256d91808b47c195bc9b4dbd7f2b87 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 4.
I20260709 13:05:29.407171 19485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b74109013a140ada21feeef92d6f563" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:05:29.303891 22402 leader_election.cc:290] T 9962423cb4e54fcfa5de01daf68a86e7 P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:05:29.255715 22384 raft_consensus.cc:515] T 172b3dd13109415a955b71ac0e9d2234 P 0473d2b2d01f4459b1e90fd12cc7840e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:05:29.355229 22254 raft_consensus.cc:493] T 833a2f0775ed407a94b8924ce50adb63 P e5256d91808b47c195bc9b4dbd7f2b87 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 127766fc592545a4997f7790f50f6076)
W20260709 13:05:29.411989 22407 log.cc:927] Time spent T 62c6c134d3d24a1ab144dd9ee6bc3f64 P e61c3a8f61bb48f8a963c9480e53c168: Append to log took a long time: real 0.064s	user 0.000s	sys 0.000s
I20260709 13:05:29.217970 22391 consensus_queue.cc:260] T 28af091831594f9d8e96482078cc7625 P 0473d2b2d01f4459b1e90fd12cc7840e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.3, Last appended by leader: 3, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:29.448101 19405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "775c229504194560ba9589bc2199b089" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:05:29.448886 19405 raft_consensus.cc:2468] T 775c229504194560ba9589bc2199b089 P e5256d91808b47c195bc9b4dbd7f2b87 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 127766fc592545a4997f7790f50f6076 in term 5.
I20260709 13:05:29.421161 19403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70797e5783b5454ab0d0eea663e791e3" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:05:29.394044 22398 raft_consensus.cc:493] T d1e5873a19244c5ebbcd38e126796ee7 P e5256d91808b47c195bc9b4dbd7f2b87 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:29.424846 22389 raft_consensus.cc:3055] T 4509b76741dc428e9201c70c1658da13 P e61c3a8f61bb48f8a963c9480e53c168 [term 2 LEADER]: Stepping down as leader of term 2
W20260709 13:05:29.426472 22381 consensus_meta.cc:287] T 3e1f505cb0f1427bbd698ac889d80821 P 0473d2b2d01f4459b1e90fd12cc7840e: Time spent flushing consensus metadata: real 0.864s	user 0.006s	sys 0.002s
I20260709 13:05:29.416033 22416 raft_consensus.cc:2749] T 309c3ca0ca4b4f3ba129752ea2cb293b P 127766fc592545a4997f7790f50f6076 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:05:29.401878 22264 raft_consensus.cc:2749] T 65d8cb8d6ec64f459d5a47cefab10acf P 127766fc592545a4997f7790f50f6076 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:05:29.394495 22380 raft_consensus.cc:493] T ef32ce6fdd0e40d382c79974f30295c6 P e61c3a8f61bb48f8a963c9480e53c168 [term 7 FOLLOWER]: Starting leader election (detected failure of leader e5256d91808b47c195bc9b4dbd7f2b87)
W20260709 13:05:29.428752 22411 log.cc:927] Time spent T 217b5fae677b4971b3bbd2f357a1f7ff P 0473d2b2d01f4459b1e90fd12cc7840e: Append to log took a long time: real 0.210s	user 0.001s	sys 0.000s
I20260709 13:05:29.419797 22369 raft_consensus.cc:515] T 14efcc79969f41babe5529c22d59156d P 0473d2b2d01f4459b1e90fd12cc7840e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
W20260709 13:05:29.304142 19306 rpcz_store.cc:269] 0709 13:05:14.325732 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:14.326013 (+   281us) service_pool.cc:224] Handling call
0709 13:05:29.268237 (+14942224us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:05:21.287591 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:05:21.288365 (+   774us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:05:21.288412 (+    47us) write_op.cc:435] Acquired schema lock
0709 13:05:21.288438 (+    26us) tablet.cc:662] Decoding operations
0709 13:05:21.290596 (+  2158us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:05:21.303005 (+ 12409us) write_op.cc:641] Partition lock acquired for write op
0709 13:05:21.304962 (+  1957us) tablet.cc:685] Acquiring locks for 21 operations
0709 13:05:21.348507 (+ 43545us) tablet.cc:701] Row locks acquired
0709 13:05:21.348527 (+    20us) write_op.cc:260] PREPARE: finished
0709 13:05:21.348667 (+   140us) write_op.cc:270] Start()
0709 13:05:21.348779 (+   112us) write_op.cc:276] Timestamp: P: 1783602321348619 usec, L: 0
0709 13:05:21.348800 (+    21us) op_driver.cc:348] REPLICATION: starting
0709 13:05:21.445883 (+ 97083us) log.cc:844] Serialized 8329 byte log entry
0709 13:05:22.319476 (+873593us) op_driver.cc:464] REPLICATION: finished
0709 13:05:22.840486 (+521010us) write_op.cc:301] APPLY: starting
0709 13:05:22.840565 (+    79us) tablet.cc:1367] starting BulkCheckPresence
0709 13:05:22.840963 (+   398us) tablet.cc:1370] finished BulkCheckPresence
0709 13:05:22.841083 (+   120us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:05:23.332960 (+491877us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:05:23.400423 (+ 67463us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=21
0709 13:05:23.400475 (+    52us) write_op.cc:312] APPLY: finished
0709 13:05:23.400845 (+   370us) log.cc:844] Serialized 145 byte log entry
0709 13:05:23.529794 (+128949us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:05:23.573440 (+ 43646us) write_op.cc:454] Released schema lock
0709 13:05:23.585390 (+ 11950us) write_op.cc:341] FINISH: Updating metrics
0709 13:05:23.611986 (+ 26596us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:05:23.617898 (+  5912us) write_op.cc:454] Released schema lock
0709 13:05:24.496895 (+878997us) spinlock_profiling.cc:243] Waited 2.56 ms on lock 0x7b18003472c0. stack: 00007f4a79de9343 00007f4a79de9240 00007f4a797781d4 00007f4a834b6304 00007f4a834b6299 00007f4a82ce3de1 00007f4a82cf05b1 00007f4a79e1b3f3 00007f4a79e1d7c1 00007f4a79e1d779 00007f4a79e1d709 00007f4a79e1d6d1 00007f4a79e1c9cd 000000000038f354 000000000038f199 00007f4a79dfe83a
Metrics: {"mutex_wait_us":1516552,"reported_tablets":36,"spinlock_wait_cycles":1792,"child_traces":[["op",{"apply.queue_time_us":494906,"apply.run_cpu_time_us":13324,"apply.run_wall_time_us":757693,"num_ops":21,"prepare.queue_time_us":40965,"prepare.run_cpu_time_us":19855,"prepare.run_wall_time_us":419996,"raft.queue_time_us":497628,"raft.run_cpu_time_us":25453,"raft.run_wall_time_us":242443,"replication_time_us":970518,"spinlock_wait_cycles":5895040,"thread_start_us":871499,"threads_started":5,"wal-append.queue_time_us":487862,"wal-append.run_cpu_time_us":19084,"wal-append.run_wall_time_us":2416463}]]}
I20260709 13:05:29.395773 22286 leader_election.cc:290] T 2725d2c4cb054f18b0fc8f735c15f6c2 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:05:29.431912 22379 leader_election.cc:290] T 65d8cb8d6ec64f459d5a47cefab10acf P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:05:29.433736 22303 leader_election.cc:290] T 21e14947d70440f19044d8f75c31e1f9 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:05:29.299083 22408 raft_consensus.cc:515] T 14935b3ddf914369822e4a0547aaa355 P 0473d2b2d01f4459b1e90fd12cc7840e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } attrs { replace: true } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:05:29.434957 22254 raft_consensus.cc:515] T 833a2f0775ed407a94b8924ce50adb63 P e5256d91808b47c195bc9b4dbd7f2b87 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:05:29.436239 22378 leader_election.cc:290] T 179fd671030940b4b4a4e24bcc4aba0a P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:05:29.418216 22412 raft_consensus.cc:3060] T 6c5eebf646ad445a9d1b1adc319d7b16 P e61c3a8f61bb48f8a963c9480e53c168 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:05:29.412411 22410 raft_consensus.cc:515] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P 0473d2b2d01f4459b1e90fd12cc7840e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
W20260709 13:05:29.440887 22390 consensus_meta.cc:287] T 96efeaaf1057492490e9a621f37e1a2d P e61c3a8f61bb48f8a963c9480e53c168: Time spent flushing consensus metadata: real 0.874s	user 0.004s	sys 0.005s
I20260709 13:05:29.444831 19404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85c494af21f9457a85da47b9bc70c1fd" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:05:29.445591 19406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab43d85f64114d4ebf618930e43d9ed0" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:05:29.446216 19409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14efcc79969f41babe5529c22d59156d" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:05:29.446561 19402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9962423cb4e54fcfa5de01daf68a86e7" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:05:29.510730 19406 raft_consensus.cc:2468] T ab43d85f64114d4ebf618930e43d9ed0 P e5256d91808b47c195bc9b4dbd7f2b87 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 127766fc592545a4997f7790f50f6076 in term 5.
I20260709 13:05:29.423578 19485 raft_consensus.cc:1275] T b08304a0a02b42d7840c4e8ee9a6bd1a P 0473d2b2d01f4459b1e90fd12cc7840e [term 8 FOLLOWER]: Refusing update from remote peer e5256d91808b47c195bc9b4dbd7f2b87: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 5. (term mismatch)
I20260709 13:05:29.511425 19485 pending_rounds.cc:85] T b08304a0a02b42d7840c4e8ee9a6bd1a P 0473d2b2d01f4459b1e90fd12cc7840e: Aborting all ops after (but not including) 4
I20260709 13:05:29.511683 19485 pending_rounds.cc:107] T b08304a0a02b42d7840c4e8ee9a6bd1a P 0473d2b2d01f4459b1e90fd12cc7840e: Aborting uncommitted NO_OP operation due to leader change: 7.5
I20260709 13:05:29.511920 19485 raft_consensus.cc:2889] T b08304a0a02b42d7840c4e8ee9a6bd1a P 0473d2b2d01f4459b1e90fd12cc7840e [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:05:29.513187 19485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62c6c134d3d24a1ab144dd9ee6bc3f64" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:05:29.514235 19485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "309c3ca0ca4b4f3ba129752ea2cb293b" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:05:29.515074 19485 raft_consensus.cc:2468] T 309c3ca0ca4b4f3ba129752ea2cb293b P 0473d2b2d01f4459b1e90fd12cc7840e [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 127766fc592545a4997f7790f50f6076 in term 6.
I20260709 13:05:29.515903 19485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "775c229504194560ba9589bc2199b089" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:05:29.451450 20075 leader_election.cc:304] T 775c229504194560ba9589bc2199b089 P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 127766fc592545a4997f7790f50f6076, e5256d91808b47c195bc9b4dbd7f2b87; no voters: 
I20260709 13:05:29.479214 22327 leader_election.cc:290] T 172b3dd13109415a955b71ac0e9d2234 P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:05:29.479629 22387 leader_election.cc:290] T 40e1e16737a842ee936002830f36882e P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:05:29.532323 22416 raft_consensus.cc:2804] T 775c229504194560ba9589bc2199b089 P 127766fc592545a4997f7790f50f6076 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:05:29.532814 22416 raft_consensus.cc:493] T 775c229504194560ba9589bc2199b089 P 127766fc592545a4997f7790f50f6076 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:29.460909 22389 raft_consensus.cc:740] T 4509b76741dc428e9201c70c1658da13 P e61c3a8f61bb48f8a963c9480e53c168 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: e61c3a8f61bb48f8a963c9480e53c168, State: Running, Role: LEADER
I20260709 13:05:29.533159 22416 raft_consensus.cc:3060] T 775c229504194560ba9589bc2199b089 P 127766fc592545a4997f7790f50f6076 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:05:29.533928 22389 consensus_queue.cc:260] T 4509b76741dc428e9201c70c1658da13 P e61c3a8f61bb48f8a963c9480e53c168 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:29.534979 19485 raft_consensus.cc:1275] T 0cdf56e38bbc453d9438d359e5a69955 P 0473d2b2d01f4459b1e90fd12cc7840e [term 9 FOLLOWER]: Refusing update from remote peer e5256d91808b47c195bc9b4dbd7f2b87: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 9 index: 6. (term mismatch)
I20260709 13:05:29.535365 22389 raft_consensus.cc:3060] T 4509b76741dc428e9201c70c1658da13 P e61c3a8f61bb48f8a963c9480e53c168 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:29.535367 19485 pending_rounds.cc:85] T 0cdf56e38bbc453d9438d359e5a69955 P 0473d2b2d01f4459b1e90fd12cc7840e: Aborting all ops after (but not including) 5
I20260709 13:05:29.536114 19485 pending_rounds.cc:107] T 0cdf56e38bbc453d9438d359e5a69955 P 0473d2b2d01f4459b1e90fd12cc7840e: Aborting uncommitted NO_OP operation due to leader change: 8.6
I20260709 13:05:29.536360 19485 raft_consensus.cc:2889] T 0cdf56e38bbc453d9438d359e5a69955 P 0473d2b2d01f4459b1e90fd12cc7840e [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:05:29.537648 19485 raft_consensus.cc:1240] T 1dc5b3532fe54f74876d02beffa2c230 P 0473d2b2d01f4459b1e90fd12cc7840e [term 6 FOLLOWER]: Rejecting Update request from peer e5256d91808b47c195bc9b4dbd7f2b87 for earlier term 5. Current term is 6. Ops: []
I20260709 13:05:29.501448 22369 leader_election.cc:290] T 14efcc79969f41babe5529c22d59156d P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:05:29.540174 22056 leader_election.cc:290] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:05:29.482926 19553 raft_consensus.cc:1275] T 2b74109013a140ada21feeef92d6f563 P e61c3a8f61bb48f8a963c9480e53c168 [term 4 FOLLOWER]: Refusing update from remote peer 0473d2b2d01f4459b1e90fd12cc7840e: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
W20260709 13:05:29.540928 20078 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.17.223.2:46257 timed out after 1.676s (SENT) [suppressed 7 similar messages]
I20260709 13:05:29.483428 19305 catalog_manager.cc:5697] T a08760e15aac4630a629431f56024dc8 P e61c3a8f61bb48f8a963c9480e53c168 reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } }
W20260709 13:05:29.487141 19526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.2:46257, user_credentials={real_user=slave}} blocked reactor thread for 81844us
I20260709 13:05:29.542498 19526 leader_election.cc:304] T 0cdf56e38bbc453d9438d359e5a69955 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e61c3a8f61bb48f8a963c9480e53c168; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:05:29.542981 22390 raft_consensus.cc:2749] T 96efeaaf1057492490e9a621f37e1a2d P e61c3a8f61bb48f8a963c9480e53c168 [term 7 FOLLOWER]: Leader pre-election lost for term 6. Reason: Vote denied by peer 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257) with higher term. Message: Invalid argument: T 96efeaaf1057492490e9a621f37e1a2d P 0473d2b2d01f4459b1e90fd12cc7840e [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e61c3a8f61bb48f8a963c9480e53c168 for earlier term 6. Current term is 7.
I20260709 13:05:29.543633 19526 leader_election.cc:304] T edd7d470b5014c9489be7f41f64355c9 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:05:29.544893 22410 leader_election.cc:290] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:05:29.487610 22380 raft_consensus.cc:3060] T ef32ce6fdd0e40d382c79974f30295c6 P e61c3a8f61bb48f8a963c9480e53c168 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:05:29.412856 22339 raft_consensus.cc:515] T ed7fdbcb96d14d418db9ca90a792588a P 0473d2b2d01f4459b1e90fd12cc7840e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:05:29.482700 22381 raft_consensus.cc:515] T 3e1f505cb0f1427bbd698ac889d80821 P 0473d2b2d01f4459b1e90fd12cc7840e [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:29.492219 19559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1b10566f45d4a7d9029858330e02d5b" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:05:29.561445 19559 raft_consensus.cc:2410] T f1b10566f45d4a7d9029858330e02d5b P e61c3a8f61bb48f8a963c9480e53c168 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0473d2b2d01f4459b1e90fd12cc7840e for term 9 because replica has last-logged OpId of term: 8 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 5.
I20260709 13:05:29.386391 22399 raft_consensus.cc:515] T 7be9efa6559648dbb5a0f7684c4542d1 P e5256d91808b47c195bc9b4dbd7f2b87 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } attrs { replace: true } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: NON_VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: true } }
I20260709 13:05:29.495208 19554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dc5b3532fe54f74876d02beffa2c230" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:05:29.568656 19554 raft_consensus.cc:3060] T 1dc5b3532fe54f74876d02beffa2c230 P e61c3a8f61bb48f8a963c9480e53c168 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:05:29.495520 19560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc225c93219c45538b53a1bd3d387e4d" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:05:29.570173 19560 raft_consensus.cc:2410] T bc225c93219c45538b53a1bd3d387e4d P e61c3a8f61bb48f8a963c9480e53c168 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0473d2b2d01f4459b1e90fd12cc7840e for term 10 because replica has last-logged OpId of term: 8 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 4.
I20260709 13:05:29.501214 22254 leader_election.cc:290] T 833a2f0775ed407a94b8924ce50adb63 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:05:29.527582 22373 raft_consensus.cc:515] T 3e1f505cb0f1427bbd698ac889d80821 P e61c3a8f61bb48f8a963c9480e53c168 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:29.528713 19558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "309c3ca0ca4b4f3ba129752ea2cb293b" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:05:29.547022 19479 raft_consensus.cc:3060] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P 0473d2b2d01f4459b1e90fd12cc7840e [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:05:29.547910 20076 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:29.548575 19553 raft_consensus.cc:1240] T df751f992649444090e27965eb1af85d P e61c3a8f61bb48f8a963c9480e53c168 [term 8 FOLLOWER]: Rejecting Update request from peer e5256d91808b47c195bc9b4dbd7f2b87 for earlier term 7. Current term is 8. Ops: []
W20260709 13:05:29.505831 19376 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:05:29.510358 22360 consensus_meta.cc:287] T 96efeaaf1057492490e9a621f37e1a2d P 127766fc592545a4997f7790f50f6076: Time spent flushing consensus metadata: real 0.518s	user 0.010s	sys 0.000s
W20260709 13:05:29.553149 20075 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.1:40321, user_credentials={real_user=slave}} blocked reactor thread for 101750us
I20260709 13:05:29.589051 21559 raft_consensus.cc:493] T 4af19371ea874c09a0a2147040835cbb P e61c3a8f61bb48f8a963c9480e53c168 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 127766fc592545a4997f7790f50f6076)
I20260709 13:05:29.616331 19559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a08760e15aac4630a629431f56024dc8" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:05:29.616813 19559 raft_consensus.cc:2468] T a08760e15aac4630a629431f56024dc8 P e61c3a8f61bb48f8a963c9480e53c168 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 7.
I20260709 13:05:29.304299 22405 raft_consensus.cc:515] T 2725d2c4cb054f18b0fc8f735c15f6c2 P 0473d2b2d01f4459b1e90fd12cc7840e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
W20260709 13:05:29.519456 22332 consensus_meta.cc:287] T b9f0d59553ad444883fcf5b5909f9798 P e61c3a8f61bb48f8a963c9480e53c168: Time spent flushing consensus metadata: real 0.864s	user 0.009s	sys 0.002s
I20260709 13:05:29.507845 22353 raft_consensus.cc:493] T 4509b76741dc428e9201c70c1658da13 P e5256d91808b47c195bc9b4dbd7f2b87 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e61c3a8f61bb48f8a963c9480e53c168)
I20260709 13:05:29.407606 22383 consensus_queue.cc:237] T f93ee515a9c14139bf566522ed8232f3 P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 7.3, Last appended by leader: 3, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
W20260709 13:05:29.573729 19450 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:29.619227 19404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36f6ba92b9ba46babe4ebd6c02e5fbd9" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 10 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:05:29.493692 22423 consensus_queue.cc:1048] T 7be9efa6559648dbb5a0f7684c4542d1 P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.073s
I20260709 13:05:29.618595 19411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "172b3dd13109415a955b71ac0e9d2234" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:05:29.621039 19553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b08304a0a02b42d7840c4e8ee9a6bd1a" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:05:29.629912 19553 raft_consensus.cc:2410] T b08304a0a02b42d7840c4e8ee9a6bd1a P e61c3a8f61bb48f8a963c9480e53c168 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0473d2b2d01f4459b1e90fd12cc7840e for term 9 because replica has last-logged OpId of term: 8 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 5.
I20260709 13:05:29.630362 21559 raft_consensus.cc:515] T 4af19371ea874c09a0a2147040835cbb P e61c3a8f61bb48f8a963c9480e53c168 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:05:29.625218 19558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "179fd671030940b4b4a4e24bcc4aba0a" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:05:29.490850 22398 raft_consensus.cc:515] T d1e5873a19244c5ebbcd38e126796ee7 P e5256d91808b47c195bc9b4dbd7f2b87 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:29.637959 19404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a08760e15aac4630a629431f56024dc8" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:05:29.626698 19560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7be9efa6559648dbb5a0f7684c4542d1" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:05:29.618320 19375 leader_election.cc:304] T 2b74109013a140ada21feeef92d6f563 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:05:29.628422 19405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e36a9d6e29c4a7c860cf267efbd4c74" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
W20260709 13:05:29.635013 19449 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.1:40321, user_credentials={real_user=slave}} blocked reactor thread for 245598us
I20260709 13:05:29.640952 19559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21e14947d70440f19044d8f75c31e1f9" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:05:29.566999 22163 leader_election.cc:290] T f93ee515a9c14139bf566522ed8232f3 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:05:29.641733 19559 raft_consensus.cc:2410] T 21e14947d70440f19044d8f75c31e1f9 P e61c3a8f61bb48f8a963c9480e53c168 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0473d2b2d01f4459b1e90fd12cc7840e for term 8 because replica has last-logged OpId of term: 7 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 3.
I20260709 13:05:29.576228 22286 raft_consensus.cc:2804] T edd7d470b5014c9489be7f41f64355c9 P e61c3a8f61bb48f8a963c9480e53c168 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:05:29.632215 19558 raft_consensus.cc:2468] T 179fd671030940b4b4a4e24bcc4aba0a P e61c3a8f61bb48f8a963c9480e53c168 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 6.
I20260709 13:05:29.543664 22390 consensus_queue.cc:1048] T 86a6797bdfe94fa496c050ceae4bd0d9 P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.084s
I20260709 13:05:29.644991 19404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1b10566f45d4a7d9029858330e02d5b" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:05:29.646039 19403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dc5b3532fe54f74876d02beffa2c230" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
I20260709 13:05:29.643093 19450 leader_election.cc:304] T 40e1e16737a842ee936002830f36882e P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:05:29.565933 22379 raft_consensus.cc:2749] T 0cdf56e38bbc453d9438d359e5a69955 P e61c3a8f61bb48f8a963c9480e53c168 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:05:29.651624 19402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cdf56e38bbc453d9438d359e5a69955" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:05:29.624451 22056 raft_consensus.cc:493] T 48824d5acfbc485ebf8c2d944e7202de P 127766fc592545a4997f7790f50f6076 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:29.650025 19477 raft_consensus.cc:1275] T 2725d2c4cb054f18b0fc8f735c15f6c2 P 0473d2b2d01f4459b1e90fd12cc7840e [term 8 FOLLOWER]: Refusing update from remote peer e5256d91808b47c195bc9b4dbd7f2b87: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 8 index: 4. (term mismatch)
I20260709 13:05:29.704967 19477 pending_rounds.cc:85] T 2725d2c4cb054f18b0fc8f735c15f6c2 P 0473d2b2d01f4459b1e90fd12cc7840e: Aborting all ops after (but not including) 3
I20260709 13:05:29.705204 19477 pending_rounds.cc:107] T 2725d2c4cb054f18b0fc8f735c15f6c2 P 0473d2b2d01f4459b1e90fd12cc7840e: Aborting uncommitted NO_OP operation due to leader change: 7.4
I20260709 13:05:29.705417 19477 raft_consensus.cc:2889] T 2725d2c4cb054f18b0fc8f735c15f6c2 P 0473d2b2d01f4459b1e90fd12cc7840e [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:05:29.612353 22303 raft_consensus.cc:493] T 5ec1c4ce15e04c7e8c283a62179f2a64 P 0473d2b2d01f4459b1e90fd12cc7840e [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 127766fc592545a4997f7790f50f6076)
I20260709 13:05:29.706313 22303 raft_consensus.cc:515] T 5ec1c4ce15e04c7e8c283a62179f2a64 P 0473d2b2d01f4459b1e90fd12cc7840e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:05:29.708631 22303 leader_election.cc:290] T 5ec1c4ce15e04c7e8c283a62179f2a64 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:05:29.651685 19405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b08304a0a02b42d7840c4e8ee9a6bd1a" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
W20260709 13:05:29.659065 19526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.2:46257, user_credentials={real_user=slave}} blocked reactor thread for 69948.1us
I20260709 13:05:29.691145 19408 raft_consensus.cc:3060] T d1e5873a19244c5ebbcd38e126796ee7 P e5256d91808b47c195bc9b4dbd7f2b87 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:05:29.560894 22284 consensus_queue.cc:1048] T ff75a1d4cb1f493db8f71ddc136ba9ab P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.083s
I20260709 13:05:29.694306 19479 raft_consensus.cc:2468] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P 0473d2b2d01f4459b1e90fd12cc7840e [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 9.
I20260709 13:05:29.651208 19450 leader_election.cc:304] T 0cdf56e38bbc453d9438d359e5a69955 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:05:29.632583 22295 raft_consensus.cc:493] T 179fd671030940b4b4a4e24bcc4aba0a P e5256d91808b47c195bc9b4dbd7f2b87 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:05:29.714511 19450 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.3:36891, user_credentials={real_user=slave}} blocked reactor thread for 63377.9us
I20260709 13:05:29.699314 19403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7be9efa6559648dbb5a0f7684c4542d1" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:05:29.715525 19403 raft_consensus.cc:2410] T 7be9efa6559648dbb5a0f7684c4542d1 P e5256d91808b47c195bc9b4dbd7f2b87 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0473d2b2d01f4459b1e90fd12cc7840e for term 8 because replica has last-logged OpId of term: 7 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 4.
I20260709 13:05:29.649624 19375 leader_election.cc:304] T 2a16f7501e2444fb86d4e2778e734e02 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:05:29.699314 21559 leader_election.cc:290] T 4af19371ea874c09a0a2147040835cbb P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
W20260709 13:05:29.648306 20078 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.2:46257, user_credentials={real_user=slave}} blocked reactor thread for 107396us
I20260709 13:05:29.710955 19404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc225c93219c45538b53a1bd3d387e4d" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:05:29.718587 19404 raft_consensus.cc:2410] T bc225c93219c45538b53a1bd3d387e4d P e5256d91808b47c195bc9b4dbd7f2b87 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0473d2b2d01f4459b1e90fd12cc7840e for term 10 because replica has last-logged OpId of term: 8 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 4.
I20260709 13:05:29.639318 22344 raft_consensus.cc:493] T 0e1085d23e8347fbbd5bce7542f4b1f4 P e61c3a8f61bb48f8a963c9480e53c168 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 127766fc592545a4997f7790f50f6076)
I20260709 13:05:29.722232 19554 raft_consensus.cc:2468] T 1dc5b3532fe54f74876d02beffa2c230 P e61c3a8f61bb48f8a963c9480e53c168 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 6.
I20260709 13:05:29.715758 19450 leader_election.cc:304] T 0afb57ae58a24a01850491d69f0213dd P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e; no voters: 127766fc592545a4997f7790f50f6076, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:05:29.652313 22163 raft_consensus.cc:493] T 22196caba61445d3bec98a0aab3c337d P 0473d2b2d01f4459b1e90fd12cc7840e [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:29.649681 22063 raft_consensus.cc:493] T ff75a1d4cb1f493db8f71ddc136ba9ab P e5256d91808b47c195bc9b4dbd7f2b87 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader e61c3a8f61bb48f8a963c9480e53c168)
I20260709 13:05:29.652478 22254 raft_consensus.cc:2804] T 2b74109013a140ada21feeef92d6f563 P e5256d91808b47c195bc9b4dbd7f2b87 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:05:29.634239 22332 raft_consensus.cc:515] T b9f0d59553ad444883fcf5b5909f9798 P e61c3a8f61bb48f8a963c9480e53c168 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
W20260709 13:05:29.729262 19375 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.3:36891, user_credentials={real_user=slave}} blocked reactor thread for 84173.5us
I20260709 13:05:29.726357 19449 leader_election.cc:304] T 0e1085d23e8347fbbd5bce7542f4b1f4 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e; no voters: 127766fc592545a4997f7790f50f6076, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:05:29.731297 19560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "833a2f0775ed407a94b8924ce50adb63" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:05:29.732352 20112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9962423cb4e54fcfa5de01daf68a86e7" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:05:29.737372 19560 raft_consensus.cc:2468] T 833a2f0775ed407a94b8924ce50adb63 P e61c3a8f61bb48f8a963c9480e53c168 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 6.
I20260709 13:05:29.737807 20112 raft_consensus.cc:2410] T 9962423cb4e54fcfa5de01daf68a86e7 P 127766fc592545a4997f7790f50f6076 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0473d2b2d01f4459b1e90fd12cc7840e for term 11 because replica has last-logged OpId of term: 10 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 8.
I20260709 13:05:29.614310 22386 raft_consensus.cc:515] T 86a6797bdfe94fa496c050ceae4bd0d9 P 0473d2b2d01f4459b1e90fd12cc7840e [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:29.730304 22344 raft_consensus.cc:515] T 0e1085d23e8347fbbd5bce7542f4b1f4 P e61c3a8f61bb48f8a963c9480e53c168 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:05:29.739749 22408 leader_election.cc:290] T 14935b3ddf914369822e4a0547aaa355 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:05:29.740654 22386 leader_election.cc:290] T 86a6797bdfe94fa496c050ceae4bd0d9 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 7 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:05:29.637277 22353 raft_consensus.cc:515] T 4509b76741dc428e9201c70c1658da13 P e5256d91808b47c195bc9b4dbd7f2b87 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:29.691093 22286 raft_consensus.cc:697] T edd7d470b5014c9489be7f41f64355c9 P e61c3a8f61bb48f8a963c9480e53c168 [term 7 LEADER]: Becoming Leader. State: Replica: e61c3a8f61bb48f8a963c9480e53c168, State: Running, Role: LEADER
I20260709 13:05:29.699043 22410 raft_consensus.cc:2804] T 40e1e16737a842ee936002830f36882e P 0473d2b2d01f4459b1e90fd12cc7840e [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:05:29.727268 22365 raft_consensus.cc:2804] T 0cdf56e38bbc453d9438d359e5a69955 P 0473d2b2d01f4459b1e90fd12cc7840e [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:05:29.738785 19402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14efcc79969f41babe5529c22d59156d" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:05:29.709942 22056 raft_consensus.cc:515] T 48824d5acfbc485ebf8c2d944e7202de P 127766fc592545a4997f7790f50f6076 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:05:29.736541 19375 leader_election.cc:304] T 28af091831594f9d8e96482078cc7625 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:05:29.744508 19449 leader_election.cc:304] T ef32ce6fdd0e40d382c79974f30295c6 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e; no voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:05:29.748304 20110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "309c3ca0ca4b4f3ba129752ea2cb293b" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:05:29.715024 22250 raft_consensus.cc:493] T fa8650e71aa14778b3d73721fc50d9fc P e5256d91808b47c195bc9b4dbd7f2b87 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader e61c3a8f61bb48f8a963c9480e53c168)
I20260709 13:05:29.734766 22313 raft_consensus.cc:2804] T 2a16f7501e2444fb86d4e2778e734e02 P e5256d91808b47c195bc9b4dbd7f2b87 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:05:29.715327 22413 raft_consensus.cc:493] T ece3db938bc649d4a40a51522ed5259c P e61c3a8f61bb48f8a963c9480e53c168 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:29.749374 19450 leader_election.cc:304] T a08760e15aac4630a629431f56024dc8 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:05:29.690371 22387 consensus_queue.cc:1048] T 0cdf56e38bbc453d9438d359e5a69955 P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.045s
I20260709 13:05:29.761562 19557 raft_consensus.cc:1240] T b9f0d59553ad444883fcf5b5909f9798 P e61c3a8f61bb48f8a963c9480e53c168 [term 8 FOLLOWER]: Rejecting Update request from peer e5256d91808b47c195bc9b4dbd7f2b87 for earlier term 7. Current term is 8. Ops: []
I20260709 13:05:29.747458 22388 raft_consensus.cc:2749] T 0e1085d23e8347fbbd5bce7542f4b1f4 P 0473d2b2d01f4459b1e90fd12cc7840e [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:05:29.762015 20112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36f6ba92b9ba46babe4ebd6c02e5fbd9" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:05:29.733144 22254 raft_consensus.cc:493] T 2b74109013a140ada21feeef92d6f563 P e5256d91808b47c195bc9b4dbd7f2b87 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:29.724268 22384 leader_election.cc:290] T 172b3dd13109415a955b71ac0e9d2234 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:05:29.765334 19481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2725d2c4cb054f18b0fc8f735c15f6c2" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:05:29.742928 22353 leader_election.cc:290] T 4509b76741dc428e9201c70c1658da13 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
W20260709 13:05:29.754567 19526 connection.cc:256] RPC call timeout handler was delayed by -1.6940701050000371s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16090000000000002s for a response
I20260709 13:05:29.743046 22378 raft_consensus.cc:2749] T 0afb57ae58a24a01850491d69f0213dd P 0473d2b2d01f4459b1e90fd12cc7840e [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:05:29.759047 20110 raft_consensus.cc:2468] T 309c3ca0ca4b4f3ba129752ea2cb293b P 127766fc592545a4997f7790f50f6076 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 6.
I20260709 13:05:29.778748 20112 raft_consensus.cc:2393] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P 127766fc592545a4997f7790f50f6076 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0473d2b2d01f4459b1e90fd12cc7840e in current term 9: Already voted for candidate e5256d91808b47c195bc9b4dbd7f2b87 in this term.
I20260709 13:05:29.779624 19406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76cb037fc9064d13b59a8969d897ce8c" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
W20260709 13:05:29.781972 20076 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:29.780494 20111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62c6c134d3d24a1ab144dd9ee6bc3f64" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:05:29.814455 19402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "179fd671030940b4b4a4e24bcc4aba0a" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:05:29.760363 22365 raft_consensus.cc:493] T 0cdf56e38bbc453d9438d359e5a69955 P 0473d2b2d01f4459b1e90fd12cc7840e [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:29.732280 22163 raft_consensus.cc:515] T 22196caba61445d3bec98a0aab3c337d P 0473d2b2d01f4459b1e90fd12cc7840e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:29.820645 19560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40e1e16737a842ee936002830f36882e" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:05:29.831895 19560 raft_consensus.cc:2468] T 40e1e16737a842ee936002830f36882e P e61c3a8f61bb48f8a963c9480e53c168 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 8.
I20260709 13:05:29.751195 22410 raft_consensus.cc:493] T 40e1e16737a842ee936002830f36882e P 0473d2b2d01f4459b1e90fd12cc7840e [term 7 FOLLOWER]: Starting leader election (detected failure of leader e61c3a8f61bb48f8a963c9480e53c168)
I20260709 13:05:29.820382 19449 leader_election.cc:304] T 2e36a9d6e29c4a7c860cf267efbd4c74 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e; no voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:05:29.825096 19406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9962423cb4e54fcfa5de01daf68a86e7" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:05:29.735174 22063 raft_consensus.cc:515] T ff75a1d4cb1f493db8f71ddc136ba9ab P e5256d91808b47c195bc9b4dbd7f2b87 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:29.840541 19481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62c6c134d3d24a1ab144dd9ee6bc3f64" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:05:29.769557 22341 raft_consensus.cc:2804] T 28af091831594f9d8e96482078cc7625 P e5256d91808b47c195bc9b4dbd7f2b87 [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 13:05:29.816062 22424 log.cc:927] Time spent T 62c6c134d3d24a1ab144dd9ee6bc3f64 P 0473d2b2d01f4459b1e90fd12cc7840e: Append to log took a long time: real 0.105s	user 0.000s	sys 0.001s
I20260709 13:05:29.776214 22386 raft_consensus.cc:2804] T a08760e15aac4630a629431f56024dc8 P 0473d2b2d01f4459b1e90fd12cc7840e [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:05:29.851537 19485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "217b5fae677b4971b3bbd2f357a1f7ff" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:05:29.851992 22386 raft_consensus.cc:493] T a08760e15aac4630a629431f56024dc8 P 0473d2b2d01f4459b1e90fd12cc7840e [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:05:29.852265 22427 log.cc:927] Time spent T 5ec1c4ce15e04c7e8c283a62179f2a64 P e5256d91808b47c195bc9b4dbd7f2b87: Append to log took a long time: real 0.076s	user 0.000s	sys 0.000s
I20260709 13:05:29.852380 22386 raft_consensus.cc:3060] T a08760e15aac4630a629431f56024dc8 P 0473d2b2d01f4459b1e90fd12cc7840e [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:05:29.852762 19485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36f6ba92b9ba46babe4ebd6c02e5fbd9" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 10 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:05:29.766702 22313 raft_consensus.cc:493] T 2a16f7501e2444fb86d4e2778e734e02 P e5256d91808b47c195bc9b4dbd7f2b87 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 127766fc592545a4997f7790f50f6076)
I20260709 13:05:29.839185 19408 raft_consensus.cc:2468] T d1e5873a19244c5ebbcd38e126796ee7 P e5256d91808b47c195bc9b4dbd7f2b87 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 9.
I20260709 13:05:29.726934 22295 raft_consensus.cc:515] T 179fd671030940b4b4a4e24bcc4aba0a P e5256d91808b47c195bc9b4dbd7f2b87 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:29.841617 19449 leader_election.cc:304] T f1b10566f45d4a7d9029858330e02d5b P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e; no voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:05:29.843601 22408 raft_consensus.cc:2749] T 2e36a9d6e29c4a7c860cf267efbd4c74 P 0473d2b2d01f4459b1e90fd12cc7840e [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:05:29.848856 22405 leader_election.cc:290] T 2725d2c4cb054f18b0fc8f735c15f6c2 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:05:29.830973 22365 raft_consensus.cc:3060] T 0cdf56e38bbc453d9438d359e5a69955 P 0473d2b2d01f4459b1e90fd12cc7840e [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:05:29.850955 22056 leader_election.cc:290] T 48824d5acfbc485ebf8c2d944e7202de P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:05:29.771377 22250 raft_consensus.cc:515] T fa8650e71aa14778b3d73721fc50d9fc P e5256d91808b47c195bc9b4dbd7f2b87 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:29.747779 22414 consensus_queue.cc:1048] T 2b74109013a140ada21feeef92d6f563 P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.094s
I20260709 13:05:29.786278 22413 raft_consensus.cc:515] T ece3db938bc649d4a40a51522ed5259c P e61c3a8f61bb48f8a963c9480e53c168 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:05:29.833187 20108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14efcc79969f41babe5529c22d59156d" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:05:29.772817 22421 consensus_queue.cc:1059] T df751f992649444090e27965eb1af85d P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.164s
W20260709 13:05:29.968442 19374 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:29.991490 19377 leader_election.cc:304] T 1a61655d99124a29b486ba4a5b37faea P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:05:29.988806 19478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9962423cb4e54fcfa5de01daf68a86e7" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
W20260709 13:05:29.993651 19449 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.1:40321, user_credentials={real_user=slave}} blocked reactor thread for 152093us
I20260709 13:05:29.874899 19485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21e14947d70440f19044d8f75c31e1f9" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:05:29.994329 20110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a16f7501e2444fb86d4e2778e734e02" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:05:29.819617 22254 raft_consensus.cc:3060] T 2b74109013a140ada21feeef92d6f563 P e5256d91808b47c195bc9b4dbd7f2b87 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:05:29.995260 19449 leader_election.cc:304] T 7be9efa6559648dbb5a0f7684c4542d1 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e; no voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:05:29.854436 19406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "309c3ca0ca4b4f3ba129752ea2cb293b" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:05:29.895572 19481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edd7d470b5014c9489be7f41f64355c9" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:05:30.020165 19481 raft_consensus.cc:2376] T edd7d470b5014c9489be7f41f64355c9 P 0473d2b2d01f4459b1e90fd12cc7840e [term 7 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 7. Re-sending same reply.
I20260709 13:05:30.020514 19449 leader_election.cc:304] T b08304a0a02b42d7840c4e8ee9a6bd1a P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e; no voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:05:30.020686 19377 leader_election.cc:400] T edd7d470b5014c9489be7f41f64355c9 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 6 election: Vote denied by peer 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257) with higher term. Message: Invalid argument: T edd7d470b5014c9489be7f41f64355c9 P 0473d2b2d01f4459b1e90fd12cc7840e [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate e5256d91808b47c195bc9b4dbd7f2b87 for earlier term 6. Current term is 7.
I20260709 13:05:29.875192 20078 leader_election.cc:304] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 127766fc592545a4997f7790f50f6076; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:05:29.822170 22369 raft_consensus.cc:2749] T ef32ce6fdd0e40d382c79974f30295c6 P 0473d2b2d01f4459b1e90fd12cc7840e [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:05:29.872866 19560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22196caba61445d3bec98a0aab3c337d" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:05:29.994391 19478 raft_consensus.cc:2468] T 9962423cb4e54fcfa5de01daf68a86e7 P 0473d2b2d01f4459b1e90fd12cc7840e [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 127766fc592545a4997f7790f50f6076 in term 10.
I20260709 13:05:30.021083 19377 leader_election.cc:403] T edd7d470b5014c9489be7f41f64355c9 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 6 election: Cancelling election due to peer responding with higher term
W20260709 13:05:30.022104 20078 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.2:46257, user_credentials={real_user=slave}} blocked reactor thread for 147014us
I20260709 13:05:29.851567 22341 raft_consensus.cc:493] T 28af091831594f9d8e96482078cc7625 P e5256d91808b47c195bc9b4dbd7f2b87 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:05:29.986819 22356 log.cc:927] Time spent T f1b10566f45d4a7d9029858330e02d5b P e5256d91808b47c195bc9b4dbd7f2b87: Append to log took a long time: real 2.059s	user 0.002s	sys 0.002s
I20260709 13:05:29.834431 22284 raft_consensus.cc:493] T b08304a0a02b42d7840c4e8ee9a6bd1a P e61c3a8f61bb48f8a963c9480e53c168 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader e5256d91808b47c195bc9b4dbd7f2b87)
I20260709 13:05:30.028402 19402 raft_consensus.cc:2468] T 179fd671030940b4b4a4e24bcc4aba0a P e5256d91808b47c195bc9b4dbd7f2b87 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 6.
I20260709 13:05:29.872267 22313 raft_consensus.cc:3060] T 2a16f7501e2444fb86d4e2778e734e02 P e5256d91808b47c195bc9b4dbd7f2b87 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:05:30.028430 19526 leader_election.cc:304] T 21e14947d70440f19044d8f75c31e1f9 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e61c3a8f61bb48f8a963c9480e53c168; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:05:29.989135 22398 leader_election.cc:290] T d1e5873a19244c5ebbcd38e126796ee7 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:05:29.840233 22410 raft_consensus.cc:3060] T 40e1e16737a842ee936002830f36882e P 0473d2b2d01f4459b1e90fd12cc7840e [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:05:29.853853 22339 leader_election.cc:290] T ed7fdbcb96d14d418db9ca90a792588a P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:05:30.033422 19481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab43d85f64114d4ebf618930e43d9ed0" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:05:30.016983 22303 raft_consensus.cc:2749] T f1b10566f45d4a7d9029858330e02d5b P 0473d2b2d01f4459b1e90fd12cc7840e [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:05:29.860939 22114 raft_consensus.cc:493] T 76cb037fc9064d13b59a8969d897ce8c P e61c3a8f61bb48f8a963c9480e53c168 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader e5256d91808b47c195bc9b4dbd7f2b87)
I20260709 13:05:30.038821 19481 raft_consensus.cc:2468] T ab43d85f64114d4ebf618930e43d9ed0 P 0473d2b2d01f4459b1e90fd12cc7840e [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 127766fc592545a4997f7790f50f6076 in term 5.
I20260709 13:05:29.954278 22388 raft_consensus.cc:493] T ff9b0eddd810459b82d91c60777c10eb P 0473d2b2d01f4459b1e90fd12cc7840e [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 127766fc592545a4997f7790f50f6076)
I20260709 13:05:30.036397 20104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ec1c4ce15e04c7e8c283a62179f2a64" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
W20260709 13:05:30.037187 20076 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:30.016348 21926 raft_consensus.cc:493] T 309c3ca0ca4b4f3ba129752ea2cb293b P e5256d91808b47c195bc9b4dbd7f2b87 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader e61c3a8f61bb48f8a963c9480e53c168)
I20260709 13:05:30.034035 19485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48824d5acfbc485ebf8c2d944e7202de" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:05:30.023691 22341 raft_consensus.cc:3060] T 28af091831594f9d8e96482078cc7625 P e5256d91808b47c195bc9b4dbd7f2b87 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:05:30.045085 20104 raft_consensus.cc:1240] T ece3db938bc649d4a40a51522ed5259c P 127766fc592545a4997f7790f50f6076 [term 7 LEADER]: Rejecting Update request from peer e5256d91808b47c195bc9b4dbd7f2b87 for earlier term 6. Current term is 7. Ops: []
I20260709 13:05:30.024080 22056 raft_consensus.cc:2749] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P 127766fc592545a4997f7790f50f6076 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:05:30.032640 22408 raft_consensus.cc:493] T ff75a1d4cb1f493db8f71ddc136ba9ab P 0473d2b2d01f4459b1e90fd12cc7840e [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:30.027511 22384 raft_consensus.cc:2749] T 7be9efa6559648dbb5a0f7684c4542d1 P 0473d2b2d01f4459b1e90fd12cc7840e [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:05:30.048173 19485 raft_consensus.cc:2410] T 48824d5acfbc485ebf8c2d944e7202de P 0473d2b2d01f4459b1e90fd12cc7840e [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 127766fc592545a4997f7790f50f6076 for term 8 because replica has last-logged OpId of term: 6 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260709 13:05:30.033006 22387 raft_consensus.cc:2749] T 1a61655d99124a29b486ba4a5b37faea P e5256d91808b47c195bc9b4dbd7f2b87 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:05:30.031247 22405 raft_consensus.cc:2749] T b08304a0a02b42d7840c4e8ee9a6bd1a P 0473d2b2d01f4459b1e90fd12cc7840e [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:05:30.042644 20108 raft_consensus.cc:2393] T 14efcc79969f41babe5529c22d59156d P 127766fc592545a4997f7790f50f6076 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0473d2b2d01f4459b1e90fd12cc7840e in current term 7: Already voted for candidate 127766fc592545a4997f7790f50f6076 in this term.
I20260709 13:05:30.052192 19481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40e1e16737a842ee936002830f36882e" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:05:30.053354 20104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14935b3ddf914369822e4a0547aaa355" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:05:30.050148 20110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "172b3dd13109415a955b71ac0e9d2234" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:05:30.063730 19485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e381f1d6b8184797ad142de49be225a8" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:05:30.064432 19483 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58286 (request call id 1592) took 3098 ms. Trace:
I20260709 13:05:30.048429 22339 raft_consensus.cc:493] T 1a61655d99124a29b486ba4a5b37faea P 0473d2b2d01f4459b1e90fd12cc7840e [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:30.066643 19483 rpcz_store.cc:276] 0709 13:05:26.956658 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:27.422786 (+466128us) service_pool.cc:224] Handling call
0709 13:05:27.463143 (+ 40357us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:27.558730 (+ 95587us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:30.055093 (+2496363us) spinlock_profiling.cc:243] Waited 74.6 ms on lock 0x7b5400343d54. stack: 00007f4a79de9343 00007f4a79de9240 00007f4a797781d4 00007f4a834b6304 00007f4a834b6299 00007f4a7ce71571 00007f4a7cf08e01 00007f4a7cf0783e 00007f4a81ecc419 00007f4a7b443bd4 00007f4a7b443b62 00007f4a7b443a91 00007f4a7b443a0c 00007f4a7b442cc2 00007f4a7b24348c 00007f4a7b2428c6
0709 13:05:30.055322 (+   229us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":171692288}
I20260709 13:05:29.873596 22286 consensus_queue.cc:237] T edd7d470b5014c9489be7f41f64355c9 P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:30.066192 20110 raft_consensus.cc:2468] T 172b3dd13109415a955b71ac0e9d2234 P 127766fc592545a4997f7790f50f6076 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 4.
W20260709 13:05:30.059098 22416 consensus_meta.cc:287] T 775c229504194560ba9589bc2199b089 P 127766fc592545a4997f7790f50f6076: Time spent flushing consensus metadata: real 0.525s	user 0.009s	sys 0.002s
I20260709 13:05:30.072428 20103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ec1c4ce15e04c7e8c283a62179f2a64" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:05:30.049045 22421 raft_consensus.cc:2749] T edd7d470b5014c9489be7f41f64355c9 P e5256d91808b47c195bc9b4dbd7f2b87 [term 7 FOLLOWER]: Leader election lost for term 6. Reason: Vote denied by peer 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257) with higher term. Message: Invalid argument: T edd7d470b5014c9489be7f41f64355c9 P 0473d2b2d01f4459b1e90fd12cc7840e [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate e5256d91808b47c195bc9b4dbd7f2b87 for earlier term 6. Current term is 7.
I20260709 13:05:30.040190 22438 raft_consensus.cc:2749] T 21e14947d70440f19044d8f75c31e1f9 P e61c3a8f61bb48f8a963c9480e53c168 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:05:30.075207 19377 leader_election.cc:304] T e381f1d6b8184797ad142de49be225a8 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:05:30.076392 20105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14935b3ddf914369822e4a0547aaa355" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 7 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:05:30.035230 22284 raft_consensus.cc:515] T b08304a0a02b42d7840c4e8ee9a6bd1a P e61c3a8f61bb48f8a963c9480e53c168 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:30.056139 22399 leader_election.cc:290] T 7be9efa6559648dbb5a0f7684c4542d1 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:05:30.081658 19485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62c6c134d3d24a1ab144dd9ee6bc3f64" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:05:30.084848 20104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed7fdbcb96d14d418db9ca90a792588a" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
W20260709 13:05:30.084988 22434 log.cc:927] Time spent T f1b10566f45d4a7d9029858330e02d5b P 0473d2b2d01f4459b1e90fd12cc7840e: Append to log took a long time: real 0.080s	user 0.000s	sys 0.000s
I20260709 13:05:30.086037 22163 leader_election.cc:290] T 22196caba61445d3bec98a0aab3c337d P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:05:30.106526 20104 raft_consensus.cc:2410] T ed7fdbcb96d14d418db9ca90a792588a P 127766fc592545a4997f7790f50f6076 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0473d2b2d01f4459b1e90fd12cc7840e for term 5 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 5.
I20260709 13:05:30.088280 21767 leader_election.cc:290] T 7f575b143b844aa096b50997dad3516a P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:05:30.093605 22063 leader_election.cc:290] T ff75a1d4cb1f493db8f71ddc136ba9ab P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:05:30.096714 22332 leader_election.cc:290] T b9f0d59553ad444883fcf5b5909f9798 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 8 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:05:30.098035 22373 leader_election.cc:290] T 3e1f505cb0f1427bbd698ac889d80821 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 7 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:05:30.046959 22388 raft_consensus.cc:515] T ff9b0eddd810459b82d91c60777c10eb P 0473d2b2d01f4459b1e90fd12cc7840e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:05:30.047719 22114 raft_consensus.cc:515] T 76cb037fc9064d13b59a8969d897ce8c P e61c3a8f61bb48f8a963c9480e53c168 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:30.183308 20111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "775c229504194560ba9589bc2199b089" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
W20260709 13:05:30.184343 22389 consensus_meta.cc:287] T 4509b76741dc428e9201c70c1658da13 P e61c3a8f61bb48f8a963c9480e53c168: Time spent flushing consensus metadata: real 0.648s	user 0.009s	sys 0.000s
I20260709 13:05:30.184628 22388 leader_election.cc:290] T ff9b0eddd810459b82d91c60777c10eb P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:05:30.185338 22413 leader_election.cc:290] T ece3db938bc649d4a40a51522ed5259c P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:05:30.185940 22114 leader_election.cc:290] T 76cb037fc9064d13b59a8969d897ce8c P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
W20260709 13:05:30.186779 22380 consensus_meta.cc:287] T ef32ce6fdd0e40d382c79974f30295c6 P e61c3a8f61bb48f8a963c9480e53c168: Time spent flushing consensus metadata: real 0.614s	user 0.007s	sys 0.002s
I20260709 13:05:30.187196 22380 raft_consensus.cc:515] T ef32ce6fdd0e40d382c79974f30295c6 P e61c3a8f61bb48f8a963c9480e53c168 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:30.188330 19560 raft_consensus.cc:1240] T ef32ce6fdd0e40d382c79974f30295c6 P e61c3a8f61bb48f8a963c9480e53c168 [term 8 FOLLOWER]: Rejecting Update request from peer e5256d91808b47c195bc9b4dbd7f2b87 for earlier term 7. Current term is 8. Ops: []
I20260709 13:05:30.082024 22339 raft_consensus.cc:515] T 1a61655d99124a29b486ba4a5b37faea P 0473d2b2d01f4459b1e90fd12cc7840e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:30.113353 19483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ec1c4ce15e04c7e8c283a62179f2a64" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:05:30.191025 19483 raft_consensus.cc:2468] T 5ec1c4ce15e04c7e8c283a62179f2a64 P 0473d2b2d01f4459b1e90fd12cc7840e [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 5.
I20260709 13:05:30.191896 19483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e1f505cb0f1427bbd698ac889d80821" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:05:30.192570 19483 raft_consensus.cc:2393] T 3e1f505cb0f1427bbd698ac889d80821 P 0473d2b2d01f4459b1e90fd12cc7840e [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate e61c3a8f61bb48f8a963c9480e53c168 in current term 7: Already voted for candidate 0473d2b2d01f4459b1e90fd12cc7840e in this term.
I20260709 13:05:30.193287 19483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e1085d23e8347fbbd5bce7542f4b1f4" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:05:30.193384 22339 leader_election.cc:290] T 1a61655d99124a29b486ba4a5b37faea P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:05:30.193835 19483 raft_consensus.cc:2468] T 0e1085d23e8347fbbd5bce7542f4b1f4 P 0473d2b2d01f4459b1e90fd12cc7840e [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 4.
I20260709 13:05:30.058188 22408 raft_consensus.cc:515] T ff75a1d4cb1f493db8f71ddc136ba9ab P 0473d2b2d01f4459b1e90fd12cc7840e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
W20260709 13:05:30.143967 19450 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:30.109354 19449 leader_election.cc:304] T 172b3dd13109415a955b71ac0e9d2234 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, 127766fc592545a4997f7790f50f6076; no voters: 
I20260709 13:05:30.194607 19483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9f0d59553ad444883fcf5b5909f9798" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:05:30.114271 19377 leader_election.cc:304] T 217b5fae677b4971b3bbd2f357a1f7ff P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:05:30.196179 19483 raft_consensus.cc:3060] T b9f0d59553ad444883fcf5b5909f9798 P 0473d2b2d01f4459b1e90fd12cc7840e [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:05:30.196226 19449 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.4:43121, user_credentials={real_user=slave}} blocked reactor thread for 86896.2us
I20260709 13:05:30.194492 22380 leader_election.cc:290] T ef32ce6fdd0e40d382c79974f30295c6 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 8 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:05:30.176018 20110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "833a2f0775ed407a94b8924ce50adb63" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:05:30.176568 20105 raft_consensus.cc:1240] T 172b3dd13109415a955b71ac0e9d2234 P 127766fc592545a4997f7790f50f6076 [term 4 FOLLOWER]: Rejecting Update request from peer e5256d91808b47c195bc9b4dbd7f2b87 for earlier term 3. Current term is 4. Ops: []
I20260709 13:05:30.052677 21926 raft_consensus.cc:515] T 309c3ca0ca4b4f3ba129752ea2cb293b P e5256d91808b47c195bc9b4dbd7f2b87 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } attrs { replace: true } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:05:30.103937 22416 raft_consensus.cc:515] T 775c229504194560ba9589bc2199b089 P 127766fc592545a4997f7790f50f6076 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:05:30.113708 22341 raft_consensus.cc:515] T 28af091831594f9d8e96482078cc7625 P e5256d91808b47c195bc9b4dbd7f2b87 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:30.179502 22250 leader_election.cc:290] T fa8650e71aa14778b3d73721fc50d9fc P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
W20260709 13:05:30.113880 22429 log.cc:927] Time spent T b08304a0a02b42d7840c4e8ee9a6bd1a P e5256d91808b47c195bc9b4dbd7f2b87: Append to log took a long time: real 0.272s	user 0.000s	sys 0.001s
I20260709 13:05:30.105576 22405 raft_consensus.cc:493] T 46c5bfeecc314717bffe987e6844b6d0 P 0473d2b2d01f4459b1e90fd12cc7840e [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:30.106841 19485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4509b76741dc428e9201c70c1658da13" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:05:30.190349 22144 raft_consensus.cc:3060] T 172b3dd13109415a955b71ac0e9d2234 P e5256d91808b47c195bc9b4dbd7f2b87 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:05:30.178237 22433 log.cc:927] Time spent T 1f85fc4b527a48848e5faa083b604e36 P e5256d91808b47c195bc9b4dbd7f2b87: Append to log took a long time: real 0.159s	user 0.007s	sys 0.011s
I20260709 13:05:30.207078 19526 leader_election.cc:304] T 0e1085d23e8347fbbd5bce7542f4b1f4 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:05:30.115185 22399 raft_consensus.cc:2749] T e381f1d6b8184797ad142de49be225a8 P e5256d91808b47c195bc9b4dbd7f2b87 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 13:05:30.174923 19374 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.4:43121, user_credentials={real_user=slave}} blocked reactor thread for 70006.2us
W20260709 13:05:30.204259 22412 consensus_meta.cc:287] T 6c5eebf646ad445a9d1b1adc319d7b16 P e61c3a8f61bb48f8a963c9480e53c168: Time spent flushing consensus metadata: real 0.685s	user 0.006s	sys 0.004s
W20260709 13:05:30.211555 19377 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.2:46257, user_credentials={real_user=slave}} blocked reactor thread for 97351.7us
I20260709 13:05:30.212981 19485 raft_consensus.cc:2393] T 4509b76741dc428e9201c70c1658da13 P 0473d2b2d01f4459b1e90fd12cc7840e [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e5256d91808b47c195bc9b4dbd7f2b87 in current term 3: Already voted for candidate 0473d2b2d01f4459b1e90fd12cc7840e in this term.
I20260709 13:05:30.180172 22063 raft_consensus.cc:493] T ff9b0eddd810459b82d91c60777c10eb P e5256d91808b47c195bc9b4dbd7f2b87 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 127766fc592545a4997f7790f50f6076)
I20260709 13:05:30.217118 20107 raft_consensus.cc:1240] T 775c229504194560ba9589bc2199b089 P 127766fc592545a4997f7790f50f6076 [term 6 FOLLOWER]: Rejecting Update request from peer 0473d2b2d01f4459b1e90fd12cc7840e for earlier term 5. Current term is 6. Ops: [5.7-5.7]
I20260709 13:05:30.204746 22339 raft_consensus.cc:2804] T 172b3dd13109415a955b71ac0e9d2234 P 0473d2b2d01f4459b1e90fd12cc7840e [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:05:30.248813 22339 raft_consensus.cc:493] T 172b3dd13109415a955b71ac0e9d2234 P 0473d2b2d01f4459b1e90fd12cc7840e [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:30.249198 22339 raft_consensus.cc:3060] T 172b3dd13109415a955b71ac0e9d2234 P 0473d2b2d01f4459b1e90fd12cc7840e [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:05:30.250166 22284 leader_election.cc:290] T b08304a0a02b42d7840c4e8ee9a6bd1a P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:05:30.250857 22295 leader_election.cc:290] T 179fd671030940b4b4a4e24bcc4aba0a P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:05:30.247875 22063 raft_consensus.cc:515] T ff9b0eddd810459b82d91c60777c10eb P e5256d91808b47c195bc9b4dbd7f2b87 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:05:30.255276 19484 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58294 (request call id 1774) took 1089 ms. Trace:
I20260709 13:05:30.255585 19485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1efebf73c86e432baa55533136b6e12c" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:05:30.218247 20103 raft_consensus.cc:1275] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P 127766fc592545a4997f7790f50f6076 [term 9 FOLLOWER]: Refusing update from remote peer e5256d91808b47c195bc9b4dbd7f2b87: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
W20260709 13:05:30.255012 20076 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:30.255632 19484 rpcz_store.cc:276] 0709 13:05:29.166156 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:29.542859 (+376703us) service_pool.cc:224] Handling call
0709 13:05:29.543169 (+   310us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:05:29.567580 (+ 24411us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:05:29.567623 (+    43us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:05:29.568204 (+   581us) log.cc:844] Serialized 26 byte log entry
0709 13:05:29.704195 (+135991us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:05:29.769927 (+ 65732us) log.cc:844] Serialized 14 byte log entry
0709 13:05:29.770164 (+   237us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:29.770237 (+    73us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:05:30.255113 (+484876us) raft_consensus.cc:1685] finished
0709 13:05:30.255131 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:30.255229 (+    98us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":26272,"prepare.queue_time_us":258705,"prepare.run_cpu_time_us":29,"prepare.run_wall_time_us":30,"raft.queue_time_us":35511,"raft.run_cpu_time_us":249,"raft.run_wall_time_us":47034,"thread_start_us":122419,"threads_started":2,"wal-append.queue_time_us":120693}
W20260709 13:05:30.257840 19375 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:30.245246 19406 raft_consensus.cc:2468] T 309c3ca0ca4b4f3ba129752ea2cb293b P e5256d91808b47c195bc9b4dbd7f2b87 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 6.
I20260709 13:05:30.246050 18300 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:05:30.247740 22380 raft_consensus.cc:2804] T 0e1085d23e8347fbbd5bce7542f4b1f4 P e61c3a8f61bb48f8a963c9480e53c168 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:05:30.258605 19375 leader_election.cc:304] T 833a2f0775ed407a94b8924ce50adb63 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:05:30.216133 22340 raft_consensus.cc:2749] T 217b5fae677b4971b3bbd2f357a1f7ff P e5256d91808b47c195bc9b4dbd7f2b87 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:05:30.271251 19485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14efcc79969f41babe5529c22d59156d" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:05:30.275084 19526 leader_election.cc:304] T 1efebf73c86e432baa55533136b6e12c P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e61c3a8f61bb48f8a963c9480e53c168; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, 127766fc592545a4997f7790f50f6076
I20260709 13:05:30.273962 19485 raft_consensus.cc:2468] T 14efcc79969f41babe5529c22d59156d P 0473d2b2d01f4459b1e90fd12cc7840e [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 127766fc592545a4997f7790f50f6076 in term 6.
I20260709 13:05:30.277477 19374 leader_election.cc:304] T 775c229504194560ba9589bc2199b089 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, 127766fc592545a4997f7790f50f6076
I20260709 13:05:30.277798 19485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7be9efa6559648dbb5a0f7684c4542d1" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:05:30.243290 22405 raft_consensus.cc:515] T 46c5bfeecc314717bffe987e6844b6d0 P 0473d2b2d01f4459b1e90fd12cc7840e [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:30.278415 19485 raft_consensus.cc:2468] T 7be9efa6559648dbb5a0f7684c4542d1 P 0473d2b2d01f4459b1e90fd12cc7840e [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 7.
I20260709 13:05:30.282994 19485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1b10566f45d4a7d9029858330e02d5b" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
W20260709 13:05:30.283565 22441 log.cc:927] Time spent T 65d8cb8d6ec64f459d5a47cefab10acf P 127766fc592545a4997f7790f50f6076: Append to log took a long time: real 0.081s	user 0.000s	sys 0.000s
I20260709 13:05:30.283638 22341 leader_election.cc:290] T 28af091831594f9d8e96482078cc7625 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 8 election: Requested vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:05:30.283927 22399 raft_consensus.cc:2804] T 833a2f0775ed407a94b8924ce50adb63 P e5256d91808b47c195bc9b4dbd7f2b87 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:05:30.284128 19485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14935b3ddf914369822e4a0547aaa355" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 7 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:05:30.284466 22399 raft_consensus.cc:493] T 833a2f0775ed407a94b8924ce50adb63 P e5256d91808b47c195bc9b4dbd7f2b87 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 127766fc592545a4997f7790f50f6076)
W20260709 13:05:30.284704 22440 log.cc:927] Time spent T df751f992649444090e27965eb1af85d P e5256d91808b47c195bc9b4dbd7f2b87: Append to log took a long time: real 0.105s	user 0.000s	sys 0.000s
I20260709 13:05:30.284922 22399 raft_consensus.cc:3060] T 833a2f0775ed407a94b8924ce50adb63 P e5256d91808b47c195bc9b4dbd7f2b87 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:05:30.280040 22387 consensus_queue.cc:1048] T b08304a0a02b42d7840c4e8ee9a6bd1a P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.008s
I20260709 13:05:30.280799 19375 leader_election.cc:304] T 40e1e16737a842ee936002830f36882e P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:05:30.283452 22374 raft_consensus.cc:2749] T 775c229504194560ba9589bc2199b089 P e5256d91808b47c195bc9b4dbd7f2b87 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:05:30.285004 19485 raft_consensus.cc:2410] T 14935b3ddf914369822e4a0547aaa355 P 0473d2b2d01f4459b1e90fd12cc7840e [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e5256d91808b47c195bc9b4dbd7f2b87 for term 7 because replica has last-logged OpId of term: 5 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 5.
W20260709 13:05:30.254964 22428 log.cc:927] Time spent T ff75a1d4cb1f493db8f71ddc136ba9ab P e5256d91808b47c195bc9b4dbd7f2b87: Append to log took a long time: real 0.078s	user 0.000s	sys 0.000s
I20260709 13:05:30.296464 19483 raft_consensus.cc:2468] T b9f0d59553ad444883fcf5b5909f9798 P 0473d2b2d01f4459b1e90fd12cc7840e [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 8.
I20260709 13:05:30.300926 19484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc225c93219c45538b53a1bd3d387e4d" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:05:30.297986 19526 leader_election.cc:304] T b9f0d59553ad444883fcf5b5909f9798 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:05:30.306967 19484 raft_consensus.cc:2393] T bc225c93219c45538b53a1bd3d387e4d P 0473d2b2d01f4459b1e90fd12cc7840e [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e61c3a8f61bb48f8a963c9480e53c168 in current term 9: Already voted for candidate 0473d2b2d01f4459b1e90fd12cc7840e in this term.
I20260709 13:05:30.307902 19484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "309c3ca0ca4b4f3ba129752ea2cb293b" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:05:30.308465 19484 raft_consensus.cc:2468] T 309c3ca0ca4b4f3ba129752ea2cb293b P 0473d2b2d01f4459b1e90fd12cc7840e [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 127766fc592545a4997f7790f50f6076 in term 6.
I20260709 13:05:30.308538 22387 consensus_queue.cc:1048] T 0cdf56e38bbc453d9438d359e5a69955 P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:05:30.309298 19484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef32ce6fdd0e40d382c79974f30295c6" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:05:30.309911 22387 consensus_queue.cc:1059] T 1dc5b3532fe54f74876d02beffa2c230 P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:05:30.310302 19484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76cb037fc9064d13b59a8969d897ce8c" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:05:30.311069 19485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b08304a0a02b42d7840c4e8ee9a6bd1a" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:05:30.311453 22408 leader_election.cc:290] T ff75a1d4cb1f493db8f71ddc136ba9ab P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:05:30.273630 22380 raft_consensus.cc:493] T 0e1085d23e8347fbbd5bce7542f4b1f4 P e61c3a8f61bb48f8a963c9480e53c168 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 127766fc592545a4997f7790f50f6076)
I20260709 13:05:30.267771 22412 raft_consensus.cc:515] T 6c5eebf646ad445a9d1b1adc319d7b16 P e61c3a8f61bb48f8a963c9480e53c168 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:05:30.264557 21767 raft_consensus.cc:493] T d1e5873a19244c5ebbcd38e126796ee7 P 0473d2b2d01f4459b1e90fd12cc7840e [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:30.311942 22063 leader_election.cc:290] T ff9b0eddd810459b82d91c60777c10eb P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:05:30.312031 22195 consensus_queue.cc:1048] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Connected to new peer: Peer: permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:05:30.312961 19411 raft_consensus.cc:2468] T 172b3dd13109415a955b71ac0e9d2234 P e5256d91808b47c195bc9b4dbd7f2b87 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 127766fc592545a4997f7790f50f6076 in term 4.
I20260709 13:05:30.212764 22332 consensus_queue.cc:1048] T 7f575b143b844aa096b50997dad3516a P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.080s
I20260709 13:05:30.311633 21962 raft_consensus.cc:3055] T 1dc5b3532fe54f74876d02beffa2c230 P e5256d91808b47c195bc9b4dbd7f2b87 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:05:30.313947 21926 leader_election.cc:290] T 309c3ca0ca4b4f3ba129752ea2cb293b P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:05:30.400441 19558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7be9efa6559648dbb5a0f7684c4542d1" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:05:30.400738 19410 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52328 (request call id 1630) took 3195 ms. Trace:
I20260709 13:05:30.373509 19553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4509b76741dc428e9201c70c1658da13" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:05:30.401187 19410 rpcz_store.cc:276] 0709 13:05:27.204829 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:27.208805 (+  3976us) service_pool.cc:224] Handling call
0709 13:05:27.261200 (+ 52395us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:05:28.732049 (+1470849us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:30.400453 (+1668404us) spinlock_profiling.cc:243] Waited 1.46 s on lock 0x7b5400182c54. stack: 00007f4a79de9343 00007f4a79de9240 00007f4a797781d4 00007f4a834b6304 00007f4a834b6299 00007f4a7ce71571 00007f4a7cf08e01 00007f4a7cf0783e 00007f4a81ecc419 00007f4a7b443bd4 00007f4a7b443b62 00007f4a7b443a91 00007f4a7b443a0c 00007f4a7b442cc2 00007f4a7b24348c 00007f4a7b2428c6
0709 13:05:30.400650 (+   197us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3366135680}
I20260709 13:05:30.401621 19558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa8650e71aa14778b3d73721fc50d9fc" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:05:30.401715 19553 raft_consensus.cc:2468] T 4509b76741dc428e9201c70c1658da13 P e61c3a8f61bb48f8a963c9480e53c168 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 3.
I20260709 13:05:30.400828 19407 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52328 (request call id 1638) took 3134 ms. Trace:
I20260709 13:05:30.402529 19410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ec1c4ce15e04c7e8c283a62179f2a64" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
W20260709 13:05:30.377209 19480 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58286 (request call id 1608) took 3256 ms (client timeout 1609 ms). Trace:
I20260709 13:05:30.392709 19402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df751f992649444090e27965eb1af85d" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
W20260709 13:05:30.411731 19480 rpcz_store.cc:269] 0709 13:05:27.120427 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:27.175846 (+ 55419us) service_pool.cc:224] Handling call
0709 13:05:30.377023 (+3201177us) spinlock_profiling.cc:243] Waited 152 ms on lock 0x7b5400148f54. stack: 00007f4a79de9343 00007f4a79de9240 00007f4a797781d4 00007f4a834b6304 00007f4a834b6299 00007f4a7ce71571 00007f4a7cf0c2fa 00007f4a81ecdb17 00007f4a7b4486d4 00007f4a7b448662 00007f4a7b448591 00007f4a7b44850c 00007f4a7b4477c2 00007f4a7b24348c 00007f4a7b2428c6 00007f4a7b24226f
0709 13:05:30.377136 (+   113us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":349348736}
I20260709 13:05:30.403415 19557 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40438 (request call id 1815) took 1183 ms. Trace:
I20260709 13:05:30.378211 19552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "179fd671030940b4b4a4e24bcc4aba0a" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
W20260709 13:05:30.403569 19482 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58286 (request call id 1583) took 4030 ms (client timeout 2166 ms). Trace:
I20260709 13:05:30.412588 19557 rpcz_store.cc:276] 0709 13:05:29.220289 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:29.220748 (+   459us) service_pool.cc:224] Handling call
0709 13:05:29.221001 (+   253us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:29.771106 (+550105us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:30.403155 (+632049us) spinlock_profiling.cc:243] Waited 540 ms on lock 0x7b5400125054. stack: 00007f4a79de9343 00007f4a79de9240 00007f4a797781d4 00007f4a834b6304 00007f4a834b6299 00007f4a7ce71571 00007f4a7cf08e01 00007f4a7cf0783e 00007f4a81ecc419 00007f4a7b443bd4 00007f4a7b443b62 00007f4a7b443a91 00007f4a7b443a0c 00007f4a7b442cc2 00007f4a7b24348c 00007f4a7b2428c6
0709 13:05:30.403352 (+   197us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1242775808}
I20260709 13:05:30.403810 19403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e1f505cb0f1427bbd698ac889d80821" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
I20260709 13:05:30.413676 19552 raft_consensus.cc:2468] T 179fd671030940b4b4a4e24bcc4aba0a P e61c3a8f61bb48f8a963c9480e53c168 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 6.
I20260709 13:05:30.415086 19403 raft_consensus.cc:3060] T 3e1f505cb0f1427bbd698ac889d80821 P e5256d91808b47c195bc9b4dbd7f2b87 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:05:30.402607 19558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff75a1d4cb1f493db8f71ddc136ba9ab" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
W20260709 13:05:30.325866 19375 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.3:36891, user_credentials={real_user=slave}} blocked reactor thread for 45139.8us
I20260709 13:05:30.420608 19375 leader_election.cc:304] T 4509b76741dc428e9201c70c1658da13 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:05:30.404233 19486 raft_consensus.cc:1275] T ed7fdbcb96d14d418db9ca90a792588a P 0473d2b2d01f4459b1e90fd12cc7840e [term 4 FOLLOWER]: Refusing update from remote peer e61c3a8f61bb48f8a963c9480e53c168: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:05:30.348084 20110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "309c3ca0ca4b4f3ba129752ea2cb293b" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:05:30.424578 20110 raft_consensus.cc:2468] T 309c3ca0ca4b4f3ba129752ea2cb293b P 127766fc592545a4997f7790f50f6076 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 6.
I20260709 13:05:30.402801 19553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e5873a19244c5ebbcd38e126796ee7" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
W20260709 13:05:30.414098 19482 rpcz_store.cc:269] 0709 13:05:26.376539 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:26.380481 (+  3942us) service_pool.cc:224] Handling call
0709 13:05:30.387141 (+4006660us) spinlock_profiling.cc:243] Waited 34.9 ms on lock 0x7b54000a9954. stack: 00007f4a79de9343 00007f4a79de9240 00007f4a797781d4 00007f4a834b6304 00007f4a834b6299 00007f4a7ce71571 00007f4a7cf0c2fa 00007f4a81ecdb17 00007f4a7b4486d4 00007f4a7b448662 00007f4a7b448591 00007f4a7b44850c 00007f4a7b4477c2 00007f4a7b24348c 00007f4a7b2428c6 00007f4a7b24226f
0709 13:05:30.403504 (+ 16363us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":80351104}
I20260709 13:05:30.432245 19483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc225c93219c45538b53a1bd3d387e4d" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:05:30.433171 19483 raft_consensus.cc:2468] T bc225c93219c45538b53a1bd3d387e4d P 0473d2b2d01f4459b1e90fd12cc7840e [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 9.
I20260709 13:05:30.433120 19482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed7fdbcb96d14d418db9ca90a792588a" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:05:30.434034 19482 raft_consensus.cc:2376] T ed7fdbcb96d14d418db9ca90a792588a P 0473d2b2d01f4459b1e90fd12cc7840e [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 4. Re-sending same reply.
I20260709 13:05:30.434945 19482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff75a1d4cb1f493db8f71ddc136ba9ab" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:05:30.435667 19482 raft_consensus.cc:2468] T ff75a1d4cb1f493db8f71ddc136ba9ab P 0473d2b2d01f4459b1e90fd12cc7840e [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 6.
I20260709 13:05:30.437994 19553 raft_consensus.cc:2393] T d1e5873a19244c5ebbcd38e126796ee7 P e61c3a8f61bb48f8a963c9480e53c168 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e5256d91808b47c195bc9b4dbd7f2b87 in current term 9: Already voted for candidate e61c3a8f61bb48f8a963c9480e53c168 in this term.
I20260709 13:05:30.279704 22284 raft_consensus.cc:2749] T 1efebf73c86e432baa55533136b6e12c P e61c3a8f61bb48f8a963c9480e53c168 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:05:30.381680 22416 leader_election.cc:290] T 775c229504194560ba9589bc2199b089 P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 6 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:05:30.402321 19407 rpcz_store.cc:276] 0709 13:05:27.266001 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:27.267579 (+  1578us) service_pool.cc:224] Handling call
0709 13:05:27.278790 (+ 11211us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:05:29.485810 (+2207020us) spinlock_profiling.cc:243] Waited 1.2 ms on lock 0x7b1800360880. stack: 00007f4a79de9343 00007f4a79de9240 00007f4a797781d4 00007f4a834b6304 00007f4a834b6299 00007f4a82ce3de1 00007f4a82cf05b1 00007f4a7cab04bc 00007f4a79dfe48b 00007f4a82c58ab9 00007f4a79e1a69b 00007f4a79e1893f 00007f4a79e18455 00007f4a7cf00060 00007f4a7cf00bfb 00007f4a7cf0b64b
0709 13:05:29.485968 (+   158us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:05:29.485989 (+    21us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:05:29.486462 (+   473us) log.cc:844] Serialized 26 byte log entry
0709 13:05:29.647903 (+161441us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:05:29.647956 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:29.648123 (+   167us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:05:30.389456 (+741333us) raft_consensus.cc:1685] finished
0709 13:05:30.389482 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:30.400769 (+ 11287us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":8612,"raft.queue_time_us":269550,"raft.run_cpu_time_us":160,"raft.run_wall_time_us":10789,"spinlock_wait_cycles":2752256,"thread_start_us":466616,"threads_started":2,"wal-append.queue_time_us":294290}
I20260709 13:05:30.440819 19375 leader_election.cc:304] T 179fd671030940b4b4a4e24bcc4aba0a P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:05:30.472736 19553 raft_consensus.cc:1240] T ece3db938bc649d4a40a51522ed5259c P e61c3a8f61bb48f8a963c9480e53c168 [term 7 FOLLOWER]: Rejecting Update request from peer e5256d91808b47c195bc9b4dbd7f2b87 for earlier term 6. Current term is 7. Ops: [6.7-6.7]
I20260709 13:05:30.475843 19402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2725d2c4cb054f18b0fc8f735c15f6c2" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:05:30.476380 19480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa8650e71aa14778b3d73721fc50d9fc" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
W20260709 13:05:30.389717 22434 log.cc:927] Time spent T f1b10566f45d4a7d9029858330e02d5b P 0473d2b2d01f4459b1e90fd12cc7840e: Append to log took a long time: real 0.063s	user 0.000s	sys 0.000s
I20260709 13:05:30.477754 19478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "179fd671030940b4b4a4e24bcc4aba0a" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:05:30.478718 19478 raft_consensus.cc:2468] T 179fd671030940b4b4a4e24bcc4aba0a P 0473d2b2d01f4459b1e90fd12cc7840e [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 6.
I20260709 13:05:30.479103 19484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40e1e16737a842ee936002830f36882e" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:05:30.476397 19485 raft_consensus.cc:2468] T b08304a0a02b42d7840c4e8ee9a6bd1a P 0473d2b2d01f4459b1e90fd12cc7840e [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 8.
I20260709 13:05:30.483691 19526 leader_election.cc:304] T b08304a0a02b42d7840c4e8ee9a6bd1a P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:05:30.487911 19403 raft_consensus.cc:2468] T 3e1f505cb0f1427bbd698ac889d80821 P e5256d91808b47c195bc9b4dbd7f2b87 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 7.
I20260709 13:05:30.367389 22174 raft_consensus.cc:493] T 96efeaaf1057492490e9a621f37e1a2d P 127766fc592545a4997f7790f50f6076 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:30.491801 19480 raft_consensus.cc:2393] T fa8650e71aa14778b3d73721fc50d9fc P 0473d2b2d01f4459b1e90fd12cc7840e [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e5256d91808b47c195bc9b4dbd7f2b87 in current term 8: Already voted for candidate 0473d2b2d01f4459b1e90fd12cc7840e in this term.
I20260709 13:05:30.491719 19483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28af091831594f9d8e96482078cc7625" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:05:30.325574 22114 raft_consensus.cc:2804] T b9f0d59553ad444883fcf5b5909f9798 P e61c3a8f61bb48f8a963c9480e53c168 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:05:30.494146 19484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f93ee515a9c14139bf566522ed8232f3" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 10 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:05:30.367185 22374 raft_consensus.cc:2804] T 40e1e16737a842ee936002830f36882e P e5256d91808b47c195bc9b4dbd7f2b87 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:05:30.494176 19558 raft_consensus.cc:1240] T 1dc5b3532fe54f74876d02beffa2c230 P e61c3a8f61bb48f8a963c9480e53c168 [term 6 FOLLOWER]: Rejecting Update request from peer e5256d91808b47c195bc9b4dbd7f2b87 for earlier term 5. Current term is 6. Ops: [5.3-5.3]
I20260709 13:05:30.278321 22365 raft_consensus.cc:515] T 0cdf56e38bbc453d9438d359e5a69955 P 0473d2b2d01f4459b1e90fd12cc7840e [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:30.503538 19403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40e1e16737a842ee936002830f36882e" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:05:30.386602 21957 leader_election.cc:290] T bc225c93219c45538b53a1bd3d387e4d P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:05:30.402923 22378 raft_consensus.cc:493] T 1efebf73c86e432baa55533136b6e12c P 0473d2b2d01f4459b1e90fd12cc7840e [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 127766fc592545a4997f7790f50f6076)
I20260709 13:05:30.280547 22295 consensus_queue.cc:1059] T ece3db938bc649d4a40a51522ed5259c P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.196s
I20260709 13:05:30.367568 22389 raft_consensus.cc:493] T df751f992649444090e27965eb1af85d P e61c3a8f61bb48f8a963c9480e53c168 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:30.393433 22405 leader_election.cc:290] T 46c5bfeecc314717bffe987e6844b6d0 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:05:30.502302 19485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14935b3ddf914369822e4a0547aaa355" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 7 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:05:30.389406 22254 raft_consensus.cc:515] T 2b74109013a140ada21feeef92d6f563 P e5256d91808b47c195bc9b4dbd7f2b87 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:30.309929 22399 raft_consensus.cc:515] T 833a2f0775ed407a94b8924ce50adb63 P e5256d91808b47c195bc9b4dbd7f2b87 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:05:30.433457 22162 raft_consensus.cc:493] T ed7fdbcb96d14d418db9ca90a792588a P 127766fc592545a4997f7790f50f6076 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader e61c3a8f61bb48f8a963c9480e53c168)
I20260709 13:05:30.440126 21926 raft_consensus.cc:2804] T 4509b76741dc428e9201c70c1658da13 P e5256d91808b47c195bc9b4dbd7f2b87 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:05:30.382150 22381 leader_election.cc:290] T 3e1f505cb0f1427bbd698ac889d80821 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 7 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:05:30.470037 22063 raft_consensus.cc:493] T fa731b585f684a7fb2d106c50f143b83 P e5256d91808b47c195bc9b4dbd7f2b87 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:30.491479 22174 raft_consensus.cc:515] T 96efeaaf1057492490e9a621f37e1a2d P 127766fc592545a4997f7790f50f6076 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:05:30.432588 22255 raft_consensus.cc:493] T 172b3dd13109415a955b71ac0e9d2234 P e5256d91808b47c195bc9b4dbd7f2b87 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:30.411044 21962 raft_consensus.cc:740] T 1dc5b3532fe54f74876d02beffa2c230 P e5256d91808b47c195bc9b4dbd7f2b87 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: e5256d91808b47c195bc9b4dbd7f2b87, State: Running, Role: LEADER
I20260709 13:05:30.434657 22380 raft_consensus.cc:3060] T 0e1085d23e8347fbbd5bce7542f4b1f4 P e61c3a8f61bb48f8a963c9480e53c168 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:05:30.553166 22295 consensus_queue.cc:1243] T ece3db938bc649d4a40a51522ed5259c P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Peer 127766fc592545a4997f7790f50f6076 log is divergent from this leader: its last log entry 7.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 13:05:30.567879 21926 raft_consensus.cc:493] T 4509b76741dc428e9201c70c1658da13 P e5256d91808b47c195bc9b4dbd7f2b87 [term 2 FOLLOWER]: Starting leader election (detected failure of leader e61c3a8f61bb48f8a963c9480e53c168)
I20260709 13:05:30.495157 19484 raft_consensus.cc:2468] T f93ee515a9c14139bf566522ed8232f3 P 0473d2b2d01f4459b1e90fd12cc7840e [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 9.
I20260709 13:05:30.535627 19480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "179fd671030940b4b4a4e24bcc4aba0a" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:05:30.535629 19407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f93ee515a9c14139bf566522ed8232f3" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 10 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:05:30.553552 22340 raft_consensus.cc:493] T 4af19371ea874c09a0a2147040835cbb P e5256d91808b47c195bc9b4dbd7f2b87 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 127766fc592545a4997f7790f50f6076)
I20260709 13:05:30.475535 22144 raft_consensus.cc:493] T 46c5bfeecc314717bffe987e6844b6d0 P e5256d91808b47c195bc9b4dbd7f2b87 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:30.385409 22339 raft_consensus.cc:515] T 172b3dd13109415a955b71ac0e9d2234 P 0473d2b2d01f4459b1e90fd12cc7840e [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:05:30.543668 19485 raft_consensus.cc:2410] T 14935b3ddf914369822e4a0547aaa355 P 0473d2b2d01f4459b1e90fd12cc7840e [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e61c3a8f61bb48f8a963c9480e53c168 for term 7 because replica has last-logged OpId of term: 5 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 5.
I20260709 13:05:30.349164 20106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff9b0eddd810459b82d91c60777c10eb" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:05:30.499809 22398 raft_consensus.cc:2804] T 179fd671030940b4b4a4e24bcc4aba0a P e5256d91808b47c195bc9b4dbd7f2b87 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:05:30.505575 22374 raft_consensus.cc:493] T 40e1e16737a842ee936002830f36882e P e5256d91808b47c195bc9b4dbd7f2b87 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:30.527318 19410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14935b3ddf914369822e4a0547aaa355" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:05:30.349279 22386 raft_consensus.cc:515] T a08760e15aac4630a629431f56024dc8 P 0473d2b2d01f4459b1e90fd12cc7840e [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:30.593237 19410 raft_consensus.cc:2468] T 14935b3ddf914369822e4a0547aaa355 P e5256d91808b47c195bc9b4dbd7f2b87 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 6.
I20260709 13:05:30.531160 22114 raft_consensus.cc:697] T b9f0d59553ad444883fcf5b5909f9798 P e61c3a8f61bb48f8a963c9480e53c168 [term 8 LEADER]: Becoming Leader. State: Replica: e61c3a8f61bb48f8a963c9480e53c168, State: Running, Role: LEADER
W20260709 13:05:30.548135 19377 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.2:46257, user_credentials={real_user=slave}} blocked reactor thread for 244784us
I20260709 13:05:30.500798 22382 leader_election.cc:290] T 179fd671030940b4b4a4e24bcc4aba0a P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 6 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
W20260709 13:05:30.531735 22361 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.086s	user 0.037s	sys 0.042s
I20260709 13:05:30.440696 21767 raft_consensus.cc:515] T d1e5873a19244c5ebbcd38e126796ee7 P 0473d2b2d01f4459b1e90fd12cc7840e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:30.472043 21823 consensus_queue.cc:1059] T b9f0d59553ad444883fcf5b5909f9798 P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.074s
I20260709 13:05:30.552531 19558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc225c93219c45538b53a1bd3d387e4d" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:05:30.604305 19558 raft_consensus.cc:2468] T bc225c93219c45538b53a1bd3d387e4d P e61c3a8f61bb48f8a963c9480e53c168 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 8.
I20260709 13:05:30.555694 22162 raft_consensus.cc:515] T ed7fdbcb96d14d418db9ca90a792588a P 127766fc592545a4997f7790f50f6076 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:05:30.557729 22353 raft_consensus.cc:3055] T df751f992649444090e27965eb1af85d P e5256d91808b47c195bc9b4dbd7f2b87 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:05:30.558604 19486 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58286 (request call id 1598) took 3600 ms. Trace:
I20260709 13:05:30.607872 19486 rpcz_store.cc:276] 0709 13:05:26.958635 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:27.437063 (+478428us) service_pool.cc:224] Handling call
0709 13:05:30.403946 (+2966883us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:30.423206 (+ 19260us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:30.558416 (+135210us) spinlock_profiling.cc:243] Waited 2.97 s on lock 0x7b54000a9950. stack: 00007f4a79de9343 00007f4a79de9240 00007f4a797781d4 00007f4a834b6304 00007f4a834b6299 00007f4a7ce71571 00007f4a7cf078ad 00007f4a81ecc419 00007f4a7b443bd4 00007f4a7b443b62 00007f4a7b443a91 00007f4a7b443a0c 00007f4a7b442cc2 00007f4a7b24348c 00007f4a7b2428c6 00007f4a7b24226f
0709 13:05:30.558558 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":6822520064}
I20260709 13:05:30.559345 20109 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46436 (request call id 475) took 3292 ms. Trace:
I20260709 13:05:30.561836 22254 leader_election.cc:290] T 2b74109013a140ada21feeef92d6f563 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 5 election: Requested vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:05:30.616120 21823 raft_consensus.cc:3055] T b9f0d59553ad444883fcf5b5909f9798 P e5256d91808b47c195bc9b4dbd7f2b87 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:05:30.616623 21823 raft_consensus.cc:740] T b9f0d59553ad444883fcf5b5909f9798 P e5256d91808b47c195bc9b4dbd7f2b87 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: e5256d91808b47c195bc9b4dbd7f2b87, State: Running, Role: LEADER
W20260709 13:05:30.598846 22361 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.157s	user 0.038s	sys 0.042s
I20260709 13:05:30.564247 22399 leader_election.cc:290] T 833a2f0775ed407a94b8924ce50adb63 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 7 election: Requested vote from peers e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:05:30.564776 19482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86a6797bdfe94fa496c050ceae4bd0d9" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 7 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:05:30.626223 19482 raft_consensus.cc:2393] T 86a6797bdfe94fa496c050ceae4bd0d9 P 0473d2b2d01f4459b1e90fd12cc7840e [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate e5256d91808b47c195bc9b4dbd7f2b87 in current term 7: Already voted for candidate 0473d2b2d01f4459b1e90fd12cc7840e in this term.
I20260709 13:05:30.627108 19482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e5873a19244c5ebbcd38e126796ee7" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
W20260709 13:05:30.565886 19556 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41504 (request call id 423) took 2498 ms (client timeout 1820 ms). Trace:
I20260709 13:05:30.473608 22443 consensus_queue.cc:1059] T ef32ce6fdd0e40d382c79974f30295c6 P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.106s
I20260709 13:05:30.565999 20110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "833a2f0775ed407a94b8924ce50adb63" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076"
I20260709 13:05:30.629988 19482 raft_consensus.cc:2468] T d1e5873a19244c5ebbcd38e126796ee7 P 0473d2b2d01f4459b1e90fd12cc7840e [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 8.
I20260709 13:05:30.349469 22413 raft_consensus.cc:493] T fa731b585f684a7fb2d106c50f143b83 P e61c3a8f61bb48f8a963c9480e53c168 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:30.568609 19406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff9b0eddd810459b82d91c60777c10eb" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:05:30.535840 19402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f85fc4b527a48848e5faa083b604e36" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:05:30.582795 19407 raft_consensus.cc:2468] T f93ee515a9c14139bf566522ed8232f3 P e5256d91808b47c195bc9b4dbd7f2b87 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 9.
I20260709 13:05:30.588265 19484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "172b3dd13109415a955b71ac0e9d2234" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:05:30.545110 22389 raft_consensus.cc:515] T df751f992649444090e27965eb1af85d P e61c3a8f61bb48f8a963c9480e53c168 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:30.596109 19485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e5873a19244c5ebbcd38e126796ee7" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
W20260709 13:05:30.627959 19556 rpcz_store.cc:269] 0709 13:05:28.067823 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:28.067940 (+   117us) service_pool.cc:224] Handling call
0709 13:05:30.565688 (+2497748us) spinlock_profiling.cc:243] Waited 99 ms on lock 0x7b54002e90d4. stack: 00007f4a79de9343 00007f4a79de9240 00007f4a797781d4 00007f4a834b6304 00007f4a834b6299 00007f4a7ce71571 00007f4a7cf0c2fa 00007f4a81ecdb17 00007f4a7b4486d4 00007f4a7b448662 00007f4a7b448591 00007f4a7b44850c 00007f4a7b4477c2 00007f4a7b24348c 00007f4a7b2428c6 00007f4a7b24226f
0709 13:05:30.565797 (+   109us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":227619584}
I20260709 13:05:30.585424 21926 raft_consensus.cc:3060] T 4509b76741dc428e9201c70c1658da13 P e5256d91808b47c195bc9b4dbd7f2b87 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:30.599576 19377 leader_election.cc:304] T 5ec1c4ce15e04c7e8c283a62179f2a64 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87; no voters: 127766fc592545a4997f7790f50f6076
I20260709 13:05:30.636301 19377 leader_election.cc:304] T 7be9efa6559648dbb5a0f7684c4542d1 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87; no voters: e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:05:30.637432 19402 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52342 (request call id 2048) took 1007 ms. Trace:
I20260709 13:05:30.637956 19402 rpcz_store.cc:276] 0709 13:05:29.629635 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:30.496589 (+866954us) service_pool.cc:224] Handling call
0709 13:05:30.637350 (+140761us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:05:30.611171 19410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "775c229504194560ba9589bc2199b089" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
I20260709 13:05:30.639108 19410 raft_consensus.cc:3060] T 775c229504194560ba9589bc2199b089 P e5256d91808b47c195bc9b4dbd7f2b87 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:05:30.592430 22398 raft_consensus.cc:493] T 179fd671030940b4b4a4e24bcc4aba0a P e5256d91808b47c195bc9b4dbd7f2b87 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:30.537460 22378 raft_consensus.cc:515] T 1efebf73c86e432baa55533136b6e12c P 0473d2b2d01f4459b1e90fd12cc7840e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:05:30.576695 22063 raft_consensus.cc:515] T fa731b585f684a7fb2d106c50f143b83 P e5256d91808b47c195bc9b4dbd7f2b87 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:05:30.593565 22374 raft_consensus.cc:3060] T 40e1e16737a842ee936002830f36882e P e5256d91808b47c195bc9b4dbd7f2b87 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:05:30.652046 19407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22196caba61445d3bec98a0aab3c337d" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:05:30.618407 22353 raft_consensus.cc:740] T df751f992649444090e27965eb1af85d P e5256d91808b47c195bc9b4dbd7f2b87 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: e5256d91808b47c195bc9b4dbd7f2b87, State: Running, Role: LEADER
I20260709 13:05:30.652881 19407 raft_consensus.cc:2468] T 22196caba61445d3bec98a0aab3c337d P e5256d91808b47c195bc9b4dbd7f2b87 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 6.
I20260709 13:05:30.609229 20109 rpcz_store.cc:276] 0709 13:05:27.267539 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:27.267729 (+   190us) service_pool.cc:224] Handling call
0709 13:05:27.404479 (+136750us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:27.405077 (+   598us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:30.559126 (+3154049us) spinlock_profiling.cc:243] Waited 123 ms on lock 0x7b54004b5350. stack: 00007f4a79de9343 00007f4a79de9240 00007f4a797781d4 00007f4a834b6304 00007f4a834b6299 00007f4a7ce71571 00007f4a7cf078ad 00007f4a81ecc419 00007f4a7b443bd4 00007f4a7b443b62 00007f4a7b443a91 00007f4a7b443a0c 00007f4a7b442cc2 00007f4a7b24348c 00007f4a7b2428c6 00007f4a7b24226f
0709 13:05:30.559258 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":282824960}
I20260709 13:05:30.583770 21957 consensus_queue.cc:1059] T ece3db938bc649d4a40a51522ed5259c P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.018s
I20260709 13:05:30.630810 19406 raft_consensus.cc:2468] T ff9b0eddd810459b82d91c60777c10eb P e5256d91808b47c195bc9b4dbd7f2b87 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 4.
I20260709 13:05:30.661099 19406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21e14947d70440f19044d8f75c31e1f9" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:05:30.661844 19406 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52342 (request call id 2056) took 1020 ms. Trace:
I20260709 13:05:30.662159 19406 rpcz_store.cc:276] 0709 13:05:29.641718 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:30.660857 (+1019139us) service_pool.cc:224] Handling call
0709 13:05:30.661790 (+   933us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:05:30.633536 19485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28af091831594f9d8e96482078cc7625" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:05:30.633982 19558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "833a2f0775ed407a94b8924ce50adb63" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:05:30.585702 22255 raft_consensus.cc:515] T 172b3dd13109415a955b71ac0e9d2234 P e5256d91808b47c195bc9b4dbd7f2b87 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:05:30.642136 19556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b74109013a140ada21feeef92d6f563" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:05:30.591599 22144 raft_consensus.cc:515] T 46c5bfeecc314717bffe987e6844b6d0 P e5256d91808b47c195bc9b4dbd7f2b87 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:30.589870 22340 raft_consensus.cc:515] T 4af19371ea874c09a0a2147040835cbb P e5256d91808b47c195bc9b4dbd7f2b87 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
W20260709 13:05:30.631465 22316 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.202s	user 0.007s	sys 0.036s
I20260709 13:05:30.645864 19486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22196caba61445d3bec98a0aab3c337d" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:05:30.655755 22174 leader_election.cc:290] T 96efeaaf1057492490e9a621f37e1a2d P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:05:30.657788 22162 leader_election.cc:290] T ed7fdbcb96d14d418db9ca90a792588a P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:05:30.658849 22443 raft_consensus.cc:2804] T 7be9efa6559648dbb5a0f7684c4542d1 P e5256d91808b47c195bc9b4dbd7f2b87 [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 13:05:30.644089 22313 consensus_meta.cc:287] T 2a16f7501e2444fb86d4e2778e734e02 P e5256d91808b47c195bc9b4dbd7f2b87: Time spent flushing consensus metadata: real 0.603s	user 0.009s	sys 0.002s
I20260709 13:05:30.659222 21767 leader_election.cc:290] T d1e5873a19244c5ebbcd38e126796ee7 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:05:30.617458 21823 consensus_queue.cc:260] T b9f0d59553ad444883fcf5b5909f9798 P e5256d91808b47c195bc9b4dbd7f2b87 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:30.663385 19558 raft_consensus.cc:3060] T 833a2f0775ed407a94b8924ce50adb63 P e61c3a8f61bb48f8a963c9480e53c168 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:05:30.654986 19377 leader_election.cc:304] T 14935b3ddf914369822e4a0547aaa355 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, 127766fc592545a4997f7790f50f6076
I20260709 13:05:30.665504 19556 raft_consensus.cc:3060] T 2b74109013a140ada21feeef92d6f563 P e61c3a8f61bb48f8a963c9480e53c168 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:05:30.640600 19484 raft_consensus.cc:2393] T 172b3dd13109415a955b71ac0e9d2234 P 0473d2b2d01f4459b1e90fd12cc7840e [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 127766fc592545a4997f7790f50f6076 in current term 5: Already voted for candidate 0473d2b2d01f4459b1e90fd12cc7840e in this term.
I20260709 13:05:30.666183 19407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff75a1d4cb1f493db8f71ddc136ba9ab" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:05:30.670632 19410 raft_consensus.cc:2468] T 775c229504194560ba9589bc2199b089 P e5256d91808b47c195bc9b4dbd7f2b87 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 127766fc592545a4997f7790f50f6076 in term 6.
I20260709 13:05:30.671715 19406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cdf56e38bbc453d9438d359e5a69955" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
I20260709 13:05:30.651392 22399 raft_consensus.cc:2804] T 5ec1c4ce15e04c7e8c283a62179f2a64 P e5256d91808b47c195bc9b4dbd7f2b87 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:05:30.674800 19555 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40438 (request call id 1813) took 1455 ms. Trace:
I20260709 13:05:30.642899 22398 raft_consensus.cc:3060] T 179fd671030940b4b4a4e24bcc4aba0a P e5256d91808b47c195bc9b4dbd7f2b87 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:05:30.675498 19486 raft_consensus.cc:2410] T 22196caba61445d3bec98a0aab3c337d P 0473d2b2d01f4459b1e90fd12cc7840e [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e5256d91808b47c195bc9b4dbd7f2b87 for term 7 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 13:05:30.674225 22144 leader_election.cc:290] T 46c5bfeecc314717bffe987e6844b6d0 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
W20260709 13:05:30.674945 22316 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.246s	user 0.007s	sys 0.037s
I20260709 13:05:30.659713 19402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a61655d99124a29b486ba4a5b37faea" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:05:30.681502 22365 leader_election.cc:290] T 0cdf56e38bbc453d9438d359e5a69955 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 10 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:05:30.643123 22413 raft_consensus.cc:515] T fa731b585f684a7fb2d106c50f143b83 P e61c3a8f61bb48f8a963c9480e53c168 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:05:30.698994 19402 raft_consensus.cc:2468] T 1a61655d99124a29b486ba4a5b37faea P e5256d91808b47c195bc9b4dbd7f2b87 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 4.
I20260709 13:05:30.670949 22412 leader_election.cc:290] T 6c5eebf646ad445a9d1b1adc319d7b16 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 5 election: Requested vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:05:30.700521 19410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "172b3dd13109415a955b71ac0e9d2234" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:05:30.696851 19555 rpcz_store.cc:276] 0709 13:05:29.219779 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:29.220139 (+   360us) service_pool.cc:224] Handling call
0709 13:05:30.566268 (+1346129us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:30.566447 (+   179us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:05:30.566481 (+    34us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:05:30.566526 (+    45us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:05:30.566570 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:30.566631 (+    61us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:30.674611 (+107980us) spinlock_profiling.cc:243] Waited 1.35 s on lock 0x7b54002e90d0. stack: 00007f4a79de9343 00007f4a79de9240 00007f4a797781d4 00007f4a834b6304 00007f4a834b6299 00007f4a7ce71571 00007f4a7cf078ad 00007f4a81ecc419 00007f4a7b443bd4 00007f4a7b443b62 00007f4a7b443a91 00007f4a7b443a0c 00007f4a7b442cc2 00007f4a7b24348c 00007f4a7b2428c6 00007f4a7b24226f
0709 13:05:30.674739 (+   128us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3095235328}
I20260709 13:05:30.702934 19555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "309c3ca0ca4b4f3ba129752ea2cb293b" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:05:30.704967 19406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86a6797bdfe94fa496c050ceae4bd0d9" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 7 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
I20260709 13:05:30.662856 22114 consensus_queue.cc:237] T b9f0d59553ad444883fcf5b5909f9798 P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:30.711043 19557 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40438 (request call id 1826) took 1160 ms. Trace:
I20260709 13:05:30.685920 22443 raft_consensus.cc:493] T 7be9efa6559648dbb5a0f7684c4542d1 P e5256d91808b47c195bc9b4dbd7f2b87 [term 7 FOLLOWER]: Starting leader election (detected failure of leader e61c3a8f61bb48f8a963c9480e53c168)
I20260709 13:05:30.709825 19406 raft_consensus.cc:2393] T 86a6797bdfe94fa496c050ceae4bd0d9 P e5256d91808b47c195bc9b4dbd7f2b87 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 0473d2b2d01f4459b1e90fd12cc7840e in current term 7: Already voted for candidate e5256d91808b47c195bc9b4dbd7f2b87 in this term.
I20260709 13:05:30.711894 19557 rpcz_store.cc:276] 0709 13:05:29.550654 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:30.439435 (+888781us) service_pool.cc:224] Handling call
0709 13:05:30.439765 (+   330us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:30.439974 (+   209us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:05:30.608218 (+168244us) log.cc:844] Serialized 14 byte log entry
0709 13:05:30.710566 (+102348us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:05:30.710640 (+    74us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:05:30.710716 (+    76us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:30.710826 (+   110us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:30.710972 (+   146us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":231670,"prepare.run_cpu_time_us":36,"prepare.run_wall_time_us":37,"raft.queue_time_us":326,"spinlock_wait_cycles":35584,"thread_start_us":196629,"threads_started":2}
I20260709 13:05:30.718338 19402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f575b143b844aa096b50997dad3516a" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:05:30.719599 19402 raft_consensus.cc:2410] T 7f575b143b844aa096b50997dad3516a P e5256d91808b47c195bc9b4dbd7f2b87 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0473d2b2d01f4459b1e90fd12cc7840e for term 4 because replica has last-logged OpId of term: 3 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 13:05:30.713538 19555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4af19371ea874c09a0a2147040835cbb" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:05:30.720656 19555 raft_consensus.cc:2468] T 4af19371ea874c09a0a2147040835cbb P e61c3a8f61bb48f8a963c9480e53c168 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 4.
I20260709 13:05:30.715286 19407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e5873a19244c5ebbcd38e126796ee7" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:05:30.718256 19557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28af091831594f9d8e96482078cc7625" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:05:30.643219 21962 consensus_queue.cc:260] T 1dc5b3532fe54f74876d02beffa2c230 P e5256d91808b47c195bc9b4dbd7f2b87 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:30.726655 19410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46c5bfeecc314717bffe987e6844b6d0" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 13 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:05:30.727495 19410 raft_consensus.cc:2468] T 46c5bfeecc314717bffe987e6844b6d0 P e5256d91808b47c195bc9b4dbd7f2b87 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 12.
I20260709 13:05:30.721844 19555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46c5bfeecc314717bffe987e6844b6d0" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 13 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
W20260709 13:05:30.714370 19377 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:30.723623 19406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "172b3dd13109415a955b71ac0e9d2234" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
I20260709 13:05:30.725266 19486 raft_consensus.cc:1240] T df751f992649444090e27965eb1af85d P 0473d2b2d01f4459b1e90fd12cc7840e [term 8 LEADER]: Rejecting Update request from peer e5256d91808b47c195bc9b4dbd7f2b87 for earlier term 7. Current term is 8. Ops: []
I20260709 13:05:30.722559 19557 raft_consensus.cc:3060] T 28af091831594f9d8e96482078cc7625 P e61c3a8f61bb48f8a963c9480e53c168 [term 6 FOLLOWER]: Advancing to term 8
I20260709 13:05:30.696614 22399 raft_consensus.cc:493] T 5ec1c4ce15e04c7e8c283a62179f2a64 P e5256d91808b47c195bc9b4dbd7f2b87 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 127766fc592545a4997f7790f50f6076)
I20260709 13:05:30.704393 22311 leader_election.cc:290] T 62c6c134d3d24a1ab144dd9ee6bc3f64 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:05:30.742071 19480 raft_consensus.cc:2468] T 179fd671030940b4b4a4e24bcc4aba0a P 0473d2b2d01f4459b1e90fd12cc7840e [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 6.
I20260709 13:05:30.699899 22452 raft_consensus.cc:2749] T 14935b3ddf914369822e4a0547aaa355 P e5256d91808b47c195bc9b4dbd7f2b87 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:05:30.716236 21823 raft_consensus.cc:3060] T b9f0d59553ad444883fcf5b5909f9798 P e5256d91808b47c195bc9b4dbd7f2b87 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:05:30.719159 22373 raft_consensus.cc:2804] T b08304a0a02b42d7840c4e8ee9a6bd1a P e61c3a8f61bb48f8a963c9480e53c168 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:05:30.760780 19555 raft_consensus.cc:1275] T a08760e15aac4630a629431f56024dc8 P e61c3a8f61bb48f8a963c9480e53c168 [term 7 FOLLOWER]: Refusing update from remote peer e5256d91808b47c195bc9b4dbd7f2b87: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:05:30.690778 22313 raft_consensus.cc:515] T 2a16f7501e2444fb86d4e2778e734e02 P e5256d91808b47c195bc9b4dbd7f2b87 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:05:30.744131 19486 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58294 (request call id 1777) took 1576 ms. Trace:
I20260709 13:05:30.763187 19402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36f6ba92b9ba46babe4ebd6c02e5fbd9" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:05:30.719403 22443 raft_consensus.cc:3060] T 7be9efa6559648dbb5a0f7684c4542d1 P e5256d91808b47c195bc9b4dbd7f2b87 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:05:30.756232 19480 raft_consensus.cc:1240] T b9f0d59553ad444883fcf5b5909f9798 P 0473d2b2d01f4459b1e90fd12cc7840e [term 8 FOLLOWER]: Rejecting Update request from peer e5256d91808b47c195bc9b4dbd7f2b87 for earlier term 7. Current term is 8. Ops: []
I20260709 13:05:30.768431 19558 raft_consensus.cc:2468] T 833a2f0775ed407a94b8924ce50adb63 P e61c3a8f61bb48f8a963c9480e53c168 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 7.
I20260709 13:05:30.772821 19486 rpcz_store.cc:276] 0709 13:05:29.167337 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:30.704374 (+1537037us) service_pool.cc:224] Handling call
0709 13:05:30.725053 (+ 20679us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:30.743826 (+ 18773us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:30.744065 (+   239us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:05:30.731057 22365 raft_consensus.cc:493] T 6c5eebf646ad445a9d1b1adc319d7b16 P 0473d2b2d01f4459b1e90fd12cc7840e [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 127766fc592545a4997f7790f50f6076)
I20260709 13:05:30.712127 22353 consensus_queue.cc:260] T df751f992649444090e27965eb1af85d P e5256d91808b47c195bc9b4dbd7f2b87 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:30.773874 19555 raft_consensus.cc:1240] T df751f992649444090e27965eb1af85d P e61c3a8f61bb48f8a963c9480e53c168 [term 8 FOLLOWER]: Rejecting Update request from peer e5256d91808b47c195bc9b4dbd7f2b87 for earlier term 7. Current term is 8. Ops: [7.5-7.5]
I20260709 13:05:30.774049 19410 raft_consensus.cc:1240] T 2b74109013a140ada21feeef92d6f563 P e5256d91808b47c195bc9b4dbd7f2b87 [term 5 FOLLOWER]: Rejecting Update request from peer 0473d2b2d01f4459b1e90fd12cc7840e for earlier term 4. Current term is 5. Ops: []
I20260709 13:05:30.972743 19410 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52342 (request call id 2044) took 1344 ms. Trace:
I20260709 13:05:30.973173 19410 rpcz_store.cc:276] 0709 13:05:29.627841 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:30.745775 (+1117934us) service_pool.cc:224] Handling call
0709 13:05:30.773942 (+ 28167us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:30.972539 (+198597us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:30.972693 (+   154us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:05:30.793112 19557 raft_consensus.cc:2468] T 28af091831594f9d8e96482078cc7625 P e61c3a8f61bb48f8a963c9480e53c168 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 8.
I20260709 13:05:30.974243 20078 leader_election.cc:304] T 9962423cb4e54fcfa5de01daf68a86e7 P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, 127766fc592545a4997f7790f50f6076; no voters: e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:05:30.748302 22399 raft_consensus.cc:3060] T 5ec1c4ce15e04c7e8c283a62179f2a64 P e5256d91808b47c195bc9b4dbd7f2b87 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:05:30.960644 19556 raft_consensus.cc:2468] T 2b74109013a140ada21feeef92d6f563 P e61c3a8f61bb48f8a963c9480e53c168 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 5.
I20260709 13:05:30.777580 19407 raft_consensus.cc:1240] T 775c229504194560ba9589bc2199b089 P e5256d91808b47c195bc9b4dbd7f2b87 [term 6 FOLLOWER]: Rejecting Update request from peer 0473d2b2d01f4459b1e90fd12cc7840e for earlier term 5. Current term is 6. Ops: []
I20260709 13:05:30.774552 19402 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52342 (request call id 2060) took 1078 ms. Trace:
I20260709 13:05:30.975863 20078 leader_election.cc:304] T ab43d85f64114d4ebf618930e43d9ed0 P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, 127766fc592545a4997f7790f50f6076, e5256d91808b47c195bc9b4dbd7f2b87; no voters: 
I20260709 13:05:30.980064 19402 rpcz_store.cc:276] 0709 13:05:29.695676 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:30.720335 (+1024659us) service_pool.cc:224] Handling call
0709 13:05:30.774487 (+ 54152us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:05:30.981050 20078 leader_election.cc:304] T 62c6c134d3d24a1ab144dd9ee6bc3f64 P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 127766fc592545a4997f7790f50f6076; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:05:30.846148 19477 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58294 (request call id 1766) took 1686 ms. Trace:
W20260709 13:05:30.840874 22449 log.cc:927] Time spent T 22196caba61445d3bec98a0aab3c337d P e61c3a8f61bb48f8a963c9480e53c168: Append to log took a long time: real 0.118s	user 0.000s	sys 0.000s
I20260709 13:05:30.983171 19480 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58294 (request call id 1780) took 1720 ms. Trace:
I20260709 13:05:30.989775 19407 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52342 (request call id 2045) took 1361 ms. Trace:
I20260709 13:05:30.847025 19551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a16f7501e2444fb86d4e2778e734e02" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:05:30.984783 19477 rpcz_store.cc:276] 0709 13:05:29.159940 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:29.410854 (+250914us) service_pool.cc:224] Handling call
0709 13:05:29.427872 (+ 17018us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:29.705867 (+277995us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:30.845859 (+1139992us) spinlock_profiling.cc:243] Waited 222 ms on lock 0x7b54003e8fd4. stack: 00007f4a79de9343 00007f4a79de9240 00007f4a797781d4 00007f4a834b6304 00007f4a834b6299 00007f4a7ce71571 00007f4a7cf08e01 00007f4a7cf0783e 00007f4a81ecc419 00007f4a7b443bd4 00007f4a7b443b62 00007f4a7b443a91 00007f4a7b443a0c 00007f4a7b442cc2 00007f4a7b24348c 00007f4a7b2428c6
0709 13:05:30.846080 (+   221us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":510201728}
W20260709 13:05:30.845454 22418 log.cc:927] Time spent T ed7fdbcb96d14d418db9ca90a792588a P e61c3a8f61bb48f8a963c9480e53c168: Append to log took a long time: real 1.443s	user 0.002s	sys 0.000s
W20260709 13:05:30.846779 22450 log.cc:927] Time spent T edd7d470b5014c9489be7f41f64355c9 P e61c3a8f61bb48f8a963c9480e53c168: Append to log took a long time: real 0.211s	user 0.001s	sys 0.000s
I20260709 13:05:31.013541 19480 rpcz_store.cc:276] 0709 13:05:29.277297 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:30.755398 (+1478101us) service_pool.cc:224] Handling call
0709 13:05:30.755874 (+   476us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:30.982846 (+226972us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:30.983093 (+   247us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:05:31.015043 19477 raft_consensus.cc:1240] T 172b3dd13109415a955b71ac0e9d2234 P 0473d2b2d01f4459b1e90fd12cc7840e [term 5 FOLLOWER]: Rejecting Update request from peer e5256d91808b47c195bc9b4dbd7f2b87 for earlier term 3. Current term is 5. Ops: []
I20260709 13:05:31.015343 19404 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.ChangeConfig from 127.0.0.1:52318 (request call id 84) took 1249 ms. Trace:
I20260709 13:05:31.016776 20078 leader_election.cc:304] T 14efcc79969f41babe5529c22d59156d P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, 127766fc592545a4997f7790f50f6076; no voters: 
W20260709 13:05:30.847769 22448 log.cc:927] Time spent T df751f992649444090e27965eb1af85d P 0473d2b2d01f4459b1e90fd12cc7840e: Append to log took a long time: real 0.223s	user 0.000s	sys 0.001s
I20260709 13:05:31.023030 19477 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58294 (request call id 1783) took 1629 ms. Trace:
I20260709 13:05:31.023940 19477 rpcz_store.cc:276] 0709 13:05:29.393144 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:31.011988 (+1618844us) service_pool.cc:224] Handling call
0709 13:05:31.014792 (+  2804us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:31.022653 (+  7861us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:31.022956 (+   303us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:05:30.844188 22410 consensus_meta.cc:287] T 40e1e16737a842ee936002830f36882e P 0473d2b2d01f4459b1e90fd12cc7840e: Time spent flushing consensus metadata: real 0.801s	user 0.008s	sys 0.001s
W20260709 13:05:30.847361 22446 log.cc:927] Time spent T f93ee515a9c14139bf566522ed8232f3 P e61c3a8f61bb48f8a963c9480e53c168: Append to log took a long time: real 0.151s	user 0.000s	sys 0.000s
I20260709 13:05:30.772466 21962 raft_consensus.cc:3060] T 1dc5b3532fe54f74876d02beffa2c230 P e5256d91808b47c195bc9b4dbd7f2b87 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:05:31.010707 19551 raft_consensus.cc:3060] T 2a16f7501e2444fb86d4e2778e734e02 P e61c3a8f61bb48f8a963c9480e53c168 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:05:31.010022 19407 rpcz_store.cc:276] 0709 13:05:29.628950 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:30.747324 (+1118374us) service_pool.cc:224] Handling call
0709 13:05:30.777331 (+ 30007us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:30.989437 (+212106us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:30.989702 (+   265us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:05:31.022689 19404 rpcz_store.cc:276] 0709 13:05:29.765961 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:30.898767 (+1132806us) service_pool.cc:224] Handling call
0709 13:05:31.015195 (+116428us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:05:31.044914 20105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff9b0eddd810459b82d91c60777c10eb" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:05:30.815591 22339 leader_election.cc:290] T 172b3dd13109415a955b71ac0e9d2234 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 5 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:05:31.007465 22174 raft_consensus.cc:2804] T ab43d85f64114d4ebf618930e43d9ed0 P 127766fc592545a4997f7790f50f6076 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:05:30.848336 22386 leader_election.cc:290] T a08760e15aac4630a629431f56024dc8 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 8 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:05:30.848452 22285 raft_consensus.cc:3055] T fa8650e71aa14778b3d73721fc50d9fc P e61c3a8f61bb48f8a963c9480e53c168 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:05:30.927276 22063 leader_election.cc:290] T fa731b585f684a7fb2d106c50f143b83 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:05:31.007647 22350 raft_consensus.cc:2804] T 9962423cb4e54fcfa5de01daf68a86e7 P 127766fc592545a4997f7790f50f6076 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:05:31.048518 19486 raft_consensus.cc:1240] T a08760e15aac4630a629431f56024dc8 P 0473d2b2d01f4459b1e90fd12cc7840e [term 8 FOLLOWER]: Rejecting Update request from peer e5256d91808b47c195bc9b4dbd7f2b87 for earlier term 7. Current term is 8. Ops: []
I20260709 13:05:31.013309 22353 raft_consensus.cc:3060] T df751f992649444090e27965eb1af85d P e5256d91808b47c195bc9b4dbd7f2b87 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:05:31.054379 19477 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39478 (request call id 367) took 1575 ms. Trace:
I20260709 13:05:31.058504 19480 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39478 (request call id 365) took 1650 ms. Trace:
I20260709 13:05:30.898789 22398 raft_consensus.cc:515] T 179fd671030940b4b4a4e24bcc4aba0a P e5256d91808b47c195bc9b4dbd7f2b87 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:31.008934 22365 raft_consensus.cc:515] T 6c5eebf646ad445a9d1b1adc319d7b16 P 0473d2b2d01f4459b1e90fd12cc7840e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
W20260709 13:05:30.747893 22387 consensus_queue.cc:1175] T 1dc5b3532fe54f74876d02beffa2c230 P e5256d91808b47c195bc9b4dbd7f2b87 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "e61c3a8f61bb48f8a963c9480e53c168" responder_term: 6 status { last_received { term: 3 index: 2 } last_committed_idx: 2 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer e5256d91808b47c195bc9b4dbd7f2b87 for earlier term 5. Current term is 6. Ops: [5.3-5.3]" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 13:05:31.026749 22269 raft_consensus.cc:2749] T 62c6c134d3d24a1ab144dd9ee6bc3f64 P 127766fc592545a4997f7790f50f6076 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:05:31.295871 19377 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:31.434245 19480 rpcz_store.cc:276] 0709 13:05:29.408343 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:31.022267 (+1613924us) service_pool.cc:224] Handling call
0709 13:05:31.057902 (+ 35635us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:31.058087 (+   185us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:05:31.058129 (+    42us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:05:31.058184 (+    55us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:05:31.058226 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:31.058298 (+    72us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:31.058436 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:05:31.173286 19452 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:31.522702 19486 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58294 (request call id 1781) took 2224 ms. Trace:
I20260709 13:05:31.523160 19486 rpcz_store.cc:276] 0709 13:05:29.298386 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:31.007751 (+1709365us) service_pool.cc:224] Handling call
0709 13:05:31.048292 (+ 40541us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:31.522328 (+474036us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:31.522593 (+   265us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:05:31.178791 19407 raft_consensus.cc:1240] T 833a2f0775ed407a94b8924ce50adb63 P e5256d91808b47c195bc9b4dbd7f2b87 [term 7 FOLLOWER]: Rejecting Update request from peer 127766fc592545a4997f7790f50f6076 for earlier term 6. Current term is 7. Ops: []
I20260709 13:05:31.435546 19477 rpcz_store.cc:276] 0709 13:05:29.479059 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:31.024960 (+1545901us) service_pool.cc:224] Handling call
0709 13:05:31.053718 (+ 28758us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:31.053956 (+   238us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:05:31.053996 (+    40us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:05:31.054053 (+    57us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:05:31.054108 (+    55us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:31.054178 (+    70us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:31.054311 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:05:31.072050 22453 log.cc:927] Time spent T 0cdf56e38bbc453d9438d359e5a69955 P e61c3a8f61bb48f8a963c9480e53c168: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
I20260709 13:05:31.059485 22313 leader_election.cc:290] T 2a16f7501e2444fb86d4e2778e734e02 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 8 election: Requested vote from peers e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:05:31.534113 19404 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49050 (request call id 397) took 1147 ms. Trace:
I20260709 13:05:31.534729 19404 rpcz_store.cc:276] 0709 13:05:30.387044 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:31.434423 (+1047379us) service_pool.cc:224] Handling call
0709 13:05:31.533415 (+ 98992us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:31.533659 (+   244us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:05:31.533696 (+    37us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:05:31.533756 (+    60us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:05:31.533821 (+    65us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:31.533892 (+    71us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:31.534037 (+   145us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:05:31.515914 22398 leader_election.cc:290] T 179fd671030940b4b4a4e24bcc4aba0a P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 7 election: Requested vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:05:31.517931 22049 consensus_queue.cc:260] T ece3db938bc649d4a40a51522ed5259c P e5256d91808b47c195bc9b4dbd7f2b87 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:05:31.073484 19484 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58294 (request call id 1776) took 1906 ms. Trace:
I20260709 13:05:31.527803 19407 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49050 (request call id 396) took 1141 ms. Trace:
W20260709 13:05:31.528739 19377 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:31.051620 22056 raft_consensus.cc:2804] T 14efcc79969f41babe5529c22d59156d P 127766fc592545a4997f7790f50f6076 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:05:31.057009 22174 raft_consensus.cc:493] T ab43d85f64114d4ebf618930e43d9ed0 P 127766fc592545a4997f7790f50f6076 [term 5 FOLLOWER]: Starting leader election (detected failure of leader e61c3a8f61bb48f8a963c9480e53c168)
I20260709 13:05:31.067545 22285 raft_consensus.cc:740] T fa8650e71aa14778b3d73721fc50d9fc P e61c3a8f61bb48f8a963c9480e53c168 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: e61c3a8f61bb48f8a963c9480e53c168, State: Running, Role: LEADER
I20260709 13:05:31.075683 22350 raft_consensus.cc:493] T 9962423cb4e54fcfa5de01daf68a86e7 P 127766fc592545a4997f7790f50f6076 [term 10 FOLLOWER]: Starting leader election (detected failure of leader e5256d91808b47c195bc9b4dbd7f2b87)
I20260709 13:05:31.140312 22389 leader_election.cc:290] T df751f992649444090e27965eb1af85d P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:05:31.553574 19486 raft_consensus.cc:1275] T 14935b3ddf914369822e4a0547aaa355 P 0473d2b2d01f4459b1e90fd12cc7840e [term 6 FOLLOWER]: Refusing update from remote peer 127766fc592545a4997f7790f50f6076: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 6 index: 6. (term mismatch)
I20260709 13:05:31.047652 22410 raft_consensus.cc:515] T 40e1e16737a842ee936002830f36882e P 0473d2b2d01f4459b1e90fd12cc7840e [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:31.564373 19480 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39478 (request call id 368) took 2085 ms. Trace:
I20260709 13:05:31.563015 19560 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40438 (request call id 1837) took 1368 ms. Trace:
I20260709 13:05:31.588759 19404 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49050 (request call id 398) took 1201 ms. Trace:
I20260709 13:05:31.616724 22049 raft_consensus.cc:3060] T ece3db938bc649d4a40a51522ed5259c P e5256d91808b47c195bc9b4dbd7f2b87 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:05:31.613363 19486 pending_rounds.cc:85] T 14935b3ddf914369822e4a0547aaa355 P 0473d2b2d01f4459b1e90fd12cc7840e: Aborting all ops after (but not including) 5
I20260709 13:05:31.627650 19486 pending_rounds.cc:107] T 14935b3ddf914369822e4a0547aaa355 P 0473d2b2d01f4459b1e90fd12cc7840e: Aborting uncommitted NO_OP operation due to leader change: 5.6
I20260709 13:05:31.628134 19486 raft_consensus.cc:2889] T 14935b3ddf914369822e4a0547aaa355 P 0473d2b2d01f4459b1e90fd12cc7840e [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:05:31.629086 19486 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39478 (request call id 369) took 2149 ms. Trace:
I20260709 13:05:31.614377 19484 rpcz_store.cc:276] 0709 13:05:29.166775 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:30.694125 (+1527350us) service_pool.cc:224] Handling call
0709 13:05:30.694526 (+   401us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:05:30.694984 (+   458us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:05:30.695021 (+    37us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:05:30.695559 (+   538us) log.cc:844] Serialized 26 byte log entry
0709 13:05:30.770689 (+ 75130us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:05:31.072860 (+302171us) log.cc:844] Serialized 14 byte log entry
0709 13:05:31.073151 (+   291us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:31.073252 (+   101us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:05:31.073295 (+    43us) raft_consensus.cc:1685] finished
0709 13:05:31.073306 (+    11us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:31.073429 (+   123us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1195,"raft.run_cpu_time_us":250,"raft.run_wall_time_us":57828,"thread_start_us":280818,"threads_started":2,"wal-append.queue_time_us":130848}
I20260709 13:05:31.589808 19407 rpcz_store.cc:276] 0709 13:05:30.386782 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:31.074159 (+687377us) service_pool.cc:224] Handling call
0709 13:05:31.178520 (+104361us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:31.524149 (+345629us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:31.527720 (+  3571us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:05:31.617630 22463 log.cc:927] Time spent T ef32ce6fdd0e40d382c79974f30295c6 P e5256d91808b47c195bc9b4dbd7f2b87: Append to log took a long time: real 0.301s	user 0.001s	sys 0.000s
W20260709 13:05:31.561532 22458 log.cc:927] Time spent T 2e36a9d6e29c4a7c860cf267efbd4c74 P 0473d2b2d01f4459b1e90fd12cc7840e: Append to log took a long time: real 0.411s	user 0.000s	sys 0.000s
I20260709 13:05:31.629482 19486 rpcz_store.cc:276] 0709 13:05:29.479676 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:31.530518 (+2050842us) service_pool.cc:224] Handling call
0709 13:05:31.553228 (+ 22710us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:31.628732 (+ 75504us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:31.629007 (+   275us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:05:31.643699 19479 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58294 (request call id 1767) took 2479 ms (client timeout 2014 ms). Trace:
I20260709 13:05:31.633510 19407 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52342 (request call id 2074) took 1084 ms. Trace:
I20260709 13:05:31.644641 19407 rpcz_store.cc:276] 0709 13:05:30.549145 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:31.630290 (+1081145us) service_pool.cc:224] Handling call
0709 13:05:31.633005 (+  2715us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:31.633173 (+   168us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:05:31.633200 (+    27us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:05:31.633240 (+    40us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:05:31.633272 (+    32us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:31.633320 (+    48us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:31.633431 (+   111us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:05:31.634089 22352 leader_election.cc:290] T 1f85fc4b527a48848e5faa083b604e36 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:05:31.653762 19485 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58294 (request call id 1775) took 2487 ms. Trace:
W20260709 13:05:31.655162 22462 log.cc:927] Time spent T 217b5fae677b4971b3bbd2f357a1f7ff P e5256d91808b47c195bc9b4dbd7f2b87: Append to log took a long time: real 0.462s	user 0.002s	sys 0.000s
I20260709 13:05:31.654234 19485 rpcz_store.cc:276] 0709 13:05:29.166510 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:30.666046 (+1499536us) service_pool.cc:224] Handling call
0709 13:05:30.666443 (+   397us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:05:30.667034 (+   591us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:05:30.667076 (+    42us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:05:30.676193 (+  9117us) log.cc:844] Serialized 26 byte log entry
0709 13:05:30.775265 (+ 99072us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:05:31.296076 (+520811us) log.cc:844] Serialized 14 byte log entry
0709 13:05:31.296341 (+   265us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:31.296419 (+    78us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:05:31.653523 (+357104us) raft_consensus.cc:1685] finished
0709 13:05:31.653547 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:31.653690 (+   143us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":62104,"raft.queue_time_us":20450,"raft.run_cpu_time_us":298,"raft.run_wall_time_us":40191,"thread_start_us":358811,"threads_started":2,"wal-append.queue_time_us":359086}
I20260709 13:05:31.656766 19485 raft_consensus.cc:1240] T 96efeaaf1057492490e9a621f37e1a2d P 0473d2b2d01f4459b1e90fd12cc7840e [term 7 FOLLOWER]: Rejecting Update request from peer 127766fc592545a4997f7790f50f6076 for earlier term 6. Current term is 7. Ops: [6.7-6.7]
I20260709 13:05:31.657460 19485 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39478 (request call id 375) took 2176 ms. Trace:
I20260709 13:05:31.657775 19485 rpcz_store.cc:276] 0709 13:05:29.481449 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:31.656099 (+2174650us) service_pool.cc:224] Handling call
0709 13:05:31.656516 (+   417us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:05:31.657206 (+   690us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:31.657408 (+   202us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:05:31.635179 22413 leader_election.cc:290] T fa731b585f684a7fb2d106c50f143b83 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
W20260709 13:05:31.637780 19375 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:31.658582 19486 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39478 (request call id 374) took 2177 ms. Trace:
I20260709 13:05:31.612635 22350 raft_consensus.cc:3060] T 9962423cb4e54fcfa5de01daf68a86e7 P 127766fc592545a4997f7790f50f6076 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:05:31.661628 19375 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:05:31.661873 19293 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 309c3ca0ca4b4f3ba129752ea2cb293b with cas_config_opid_index 5: ChangeConfig:REMOVE_PEER failed with leader e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica e5256d91808b47c195bc9b4dbd7f2b87 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 6 leader_uuid: "e61c3a8f61bb48f8a963c9480e53c168" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } attrs { replace: true } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } } }
I20260709 13:05:31.664215 19375 leader_election.cc:304] T bc225c93219c45538b53a1bd3d387e4d P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:05:31.612339 22174 raft_consensus.cc:3060] T ab43d85f64114d4ebf618930e43d9ed0 P 127766fc592545a4997f7790f50f6076 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:05:31.642267 22410 leader_election.cc:290] T 40e1e16737a842ee936002830f36882e P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 8 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:05:31.642757 19481 raft_consensus.cc:2468] T 40e1e16737a842ee936002830f36882e P 0473d2b2d01f4459b1e90fd12cc7840e [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 8.
I20260709 13:05:31.631438 19404 rpcz_store.cc:276] 0709 13:05:30.387352 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:31.536106 (+1148754us) service_pool.cc:224] Handling call
0709 13:05:31.587751 (+ 51645us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:31.588276 (+   525us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:05:31.588320 (+    44us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:05:31.588380 (+    60us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:05:31.588435 (+    55us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:31.588510 (+    75us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:31.588677 (+   167us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":133,"raft.run_cpu_time_us":124,"raft.run_wall_time_us":125}
I20260709 13:05:31.625829 19480 rpcz_store.cc:276] 0709 13:05:29.479399 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:31.529935 (+2050536us) service_pool.cc:224] Handling call
0709 13:05:31.563699 (+ 33764us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:31.563952 (+   253us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:05:31.563992 (+    40us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:05:31.564048 (+    56us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:05:31.564102 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:31.564172 (+    70us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:31.564303 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:05:31.608497 22365 leader_election.cc:290] T 6c5eebf646ad445a9d1b1adc319d7b16 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
W20260709 13:05:31.644320 19479 rpcz_store.cc:269] 0709 13:05:29.164411 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:29.243006 (+ 78595us) service_pool.cc:224] Handling call
0709 13:05:31.643439 (+2400433us) spinlock_profiling.cc:243] Waited 256 ms on lock 0x7b540029de54. stack: 00007f4a79de9343 00007f4a79de9240 00007f4a797781d4 00007f4a834b6304 00007f4a834b6299 00007f4a7ce71571 00007f4a7cf0c2fa 00007f4a81ecdb17 00007f4a7b4486d4 00007f4a7b448662 00007f4a7b448591 00007f4a7b44850c 00007f4a7b4477c2 00007f4a7b24348c 00007f4a7b2428c6 00007f4a7b24226f
0709 13:05:31.643576 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":589902080}
I20260709 13:05:31.639869 19411 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49050 (request call id 390) took 2021 ms. Trace:
I20260709 13:05:31.668186 19485 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58286 (request call id 1623) took 1956 ms. Trace:
I20260709 13:05:31.659673 19486 rpcz_store.cc:276] 0709 13:05:29.481172 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:31.644299 (+2163127us) service_pool.cc:224] Handling call
0709 13:05:31.658104 (+ 13805us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:31.658274 (+   170us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:05:31.658301 (+    27us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:05:31.658343 (+    42us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:05:31.658373 (+    30us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:31.658426 (+    53us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:31.658526 (+   100us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:05:31.672410 19479 raft_consensus.cc:1275] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P 0473d2b2d01f4459b1e90fd12cc7840e [term 9 FOLLOWER]: Refusing update from remote peer e5256d91808b47c195bc9b4dbd7f2b87: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:05:31.672034 19485 rpcz_store.cc:276] 0709 13:05:29.712828 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:31.658560 (+1945732us) service_pool.cc:224] Handling call
0709 13:05:31.667193 (+  8633us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:31.667420 (+   227us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:05:31.667454 (+    34us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:05:31.667487 (+    33us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:05:31.667542 (+    55us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:31.667613 (+    71us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:31.668133 (+   520us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:05:31.660127 22351 raft_consensus.cc:3060] T 14efcc79969f41babe5529c22d59156d P e5256d91808b47c195bc9b4dbd7f2b87 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:05:31.627115 19560 rpcz_store.cc:276] 0709 13:05:30.194526 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:30.496793 (+302267us) service_pool.cc:224] Handling call
0709 13:05:30.538597 (+ 41804us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:05:30.544044 (+  5447us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:05:30.544073 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:05:30.550268 (+  6195us) log.cc:844] Serialized 26 byte log entry
0709 13:05:30.679924 (+129656us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:05:30.679981 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:30.680053 (+    72us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:05:31.562700 (+882647us) raft_consensus.cc:1685] finished
0709 13:05:31.562733 (+    33us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:31.562932 (+   199us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2184,"raft.queue_time_us":5122,"raft.run_cpu_time_us":118,"raft.run_wall_time_us":6036,"thread_start_us":94764,"threads_started":1,"wal-append.queue_time_us":196245}
W20260709 13:05:31.629757 22111 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 2.194s	user 0.065s	sys 0.105s
I20260709 13:05:31.671087 19406 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52342 (request call id 2051) took 2040 ms. Trace:
I20260709 13:05:31.589704 22056 raft_consensus.cc:493] T 14efcc79969f41babe5529c22d59156d P 127766fc592545a4997f7790f50f6076 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:31.673311 19479 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58294 (request call id 1790) took 1684 ms. Trace:
I20260709 13:05:31.671622 19411 rpcz_store.cc:276] 0709 13:05:29.618226 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:29.618376 (+   150us) service_pool.cc:224] Handling call
0709 13:05:31.639585 (+2021209us) spinlock_profiling.cc:243] Waited 684 ms on lock 0x7b54001de554. stack: 00007f4a79de9343 00007f4a79de9240 00007f4a797781d4 00007f4a834b6304 00007f4a834b6299 00007f4a7ce71571 00007f4a7cf0c2fa 00007f4a81ecdb17 00007f4a7b4486d4 00007f4a7b448662 00007f4a7b448591 00007f4a7b44850c 00007f4a7b4477c2 00007f4a7b24348c 00007f4a7b2428c6 00007f4a7b24226f
0709 13:05:31.639752 (+   167us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1572862720}
I20260709 13:05:31.675683 20111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "172b3dd13109415a955b71ac0e9d2234" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076"
I20260709 13:05:31.696403 19479 rpcz_store.cc:276] 0709 13:05:29.988623 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:31.671784 (+1683161us) service_pool.cc:224] Handling call
0709 13:05:31.672084 (+   300us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:31.672806 (+   722us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:31.673255 (+   449us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:05:31.697520 20111 raft_consensus.cc:3060] T 172b3dd13109415a955b71ac0e9d2234 P 127766fc592545a4997f7790f50f6076 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:05:31.676622 20105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c5eebf646ad445a9d1b1adc319d7b16" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:05:31.684922 19406 rpcz_store.cc:276] 0709 13:05:29.630289 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:30.747475 (+1117186us) service_pool.cc:224] Handling call
0709 13:05:30.764070 (+ 16595us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:05:30.764502 (+   432us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:05:30.764542 (+    40us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:05:30.795032 (+ 30490us) log.cc:844] Serialized 26 byte log entry
0709 13:05:31.014535 (+219503us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:05:31.047604 (+ 33069us) log.cc:844] Serialized 14 byte log entry
0709 13:05:31.047901 (+   297us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:31.048005 (+   104us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:05:31.654380 (+606375us) spinlock_profiling.cc:243] Waited 73.1 ms on lock 0x7b4400022b4c. stack: 00007f4a79de9343 00007f4a79de9240 00007f4a797781d4 00007f4a834b6304 00007f4a834b6299 00007f4a79ca3db1 00007f4a79d41c85 00007f4a79d426a2 00007f4a7cab41db 00007f4a7caafaaf 00007f4a7caa386e 00007f4a7caa2bb6 00007f4a7caa27d8 00007f4a7caac221 00007f4a7caac1d9 00007f4a7caac169
0709 13:05:31.668354 (+ 13974us) raft_consensus.cc:1685] finished
0709 13:05:31.670894 (+  2540us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:31.671029 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":131925,"prepare.queue_time_us":33187,"prepare.run_cpu_time_us":52,"prepare.run_wall_time_us":54,"raft.queue_time_us":3670,"raft.run_cpu_time_us":268,"raft.run_wall_time_us":10278,"spinlock_wait_cycles":168099712,"thread_start_us":115790,"threads_started":1,"wal-append.queue_time_us":159135}
I20260709 13:05:31.680847 20109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f85fc4b527a48848e5faa083b604e36" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
W20260709 13:05:31.687886 22111 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 2.252s	user 0.065s	sys 0.106s
W20260709 13:05:31.723697 19551 consensus_meta.cc:287] T 2a16f7501e2444fb86d4e2778e734e02 P e61c3a8f61bb48f8a963c9480e53c168: Time spent flushing consensus metadata: real 0.670s	user 0.009s	sys 0.001s
I20260709 13:05:31.732573 19551 raft_consensus.cc:2468] T 2a16f7501e2444fb86d4e2778e734e02 P e61c3a8f61bb48f8a963c9480e53c168 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 8.
W20260709 13:05:31.722594 22399 consensus_meta.cc:287] T 5ec1c4ce15e04c7e8c283a62179f2a64 P e5256d91808b47c195bc9b4dbd7f2b87: Time spent flushing consensus metadata: real 0.709s	user 0.005s	sys 0.003s
I20260709 13:05:31.735953 22399 raft_consensus.cc:515] T 5ec1c4ce15e04c7e8c283a62179f2a64 P e5256d91808b47c195bc9b4dbd7f2b87 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:05:31.742892 19404 raft_consensus.cc:1275] T 14935b3ddf914369822e4a0547aaa355 P e5256d91808b47c195bc9b4dbd7f2b87 [term 6 FOLLOWER]: Refusing update from remote peer 127766fc592545a4997f7790f50f6076: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 6 index: 6. (index mismatch)
I20260709 13:05:31.743682 19485 raft_consensus.cc:1275] T 1a61655d99124a29b486ba4a5b37faea P 0473d2b2d01f4459b1e90fd12cc7840e [term 4 FOLLOWER]: Refusing update from remote peer e61c3a8f61bb48f8a963c9480e53c168: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:05:31.744269 19485 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58286 (request call id 1630) took 1637 ms. Trace:
I20260709 13:05:31.748070 19485 rpcz_store.cc:276] 0709 13:05:30.106817 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:31.673487 (+1566670us) service_pool.cc:224] Handling call
0709 13:05:31.673757 (+   270us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:31.744033 (+ 70276us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:31.744218 (+   185us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:05:31.670957 22063 raft_consensus.cc:2804] T bc225c93219c45538b53a1bd3d387e4d P e5256d91808b47c195bc9b4dbd7f2b87 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:05:31.744515 19375 leader_election.cc:304] T 4af19371ea874c09a0a2147040835cbb P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
W20260709 13:05:31.751089 19375 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.3:36891, user_credentials={real_user=slave}} blocked reactor thread for 59437.6us
I20260709 13:05:31.752058 19480 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58286 (request call id 1627) took 2037 ms. Trace:
I20260709 13:05:31.753544 19479 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58286 (request call id 1632) took 1646 ms. Trace:
I20260709 13:05:31.753351 19480 rpcz_store.cc:276] 0709 13:05:29.714275 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:31.670174 (+1955899us) service_pool.cc:224] Handling call
0709 13:05:31.746299 (+ 76125us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:31.750279 (+  3980us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:05:31.750321 (+    42us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:05:31.750405 (+    84us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:05:31.750454 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:31.750511 (+    57us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:31.751992 (+  1481us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3543,"raft.queue_time_us":4980}
I20260709 13:05:31.754057 19479 rpcz_store.cc:276] 0709 13:05:30.107268 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:31.697745 (+1590477us) service_pool.cc:224] Handling call
0709 13:05:31.753079 (+ 55334us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:31.753246 (+   167us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:05:31.753275 (+    29us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:05:31.753313 (+    38us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:05:31.753351 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:31.753404 (+    53us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:31.753497 (+    93us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:05:31.756892 19480 raft_consensus.cc:1240] T 86a6797bdfe94fa496c050ceae4bd0d9 P 0473d2b2d01f4459b1e90fd12cc7840e [term 7 FOLLOWER]: Rejecting Update request from peer e61c3a8f61bb48f8a963c9480e53c168 for earlier term 6. Current term is 7. Ops: [6.3-6.3]
I20260709 13:05:31.690742 22398 raft_consensus.cc:3055] T ef32ce6fdd0e40d382c79974f30295c6 P e5256d91808b47c195bc9b4dbd7f2b87 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:05:31.744196 22056 raft_consensus.cc:3060] T 14efcc79969f41babe5529c22d59156d P 127766fc592545a4997f7790f50f6076 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:05:31.760792 19480 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58286 (request call id 1634) took 1650 ms. Trace:
I20260709 13:05:31.755951 19375 leader_election.cc:304] T 833a2f0775ed407a94b8924ce50adb63 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168; no voters: 127766fc592545a4997f7790f50f6076
I20260709 13:05:31.764873 19480 rpcz_store.cc:276] 0709 13:05:30.107626 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:31.754717 (+1647091us) service_pool.cc:224] Handling call
0709 13:05:31.756640 (+  1923us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:05:31.757420 (+   780us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:31.757650 (+   230us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:05:31.766501 19479 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58286 (request call id 1635) took 1658 ms. Trace:
I20260709 13:05:31.767017 19479 rpcz_store.cc:276] 0709 13:05:30.107867 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:31.754968 (+1647101us) service_pool.cc:224] Handling call
0709 13:05:31.765225 (+ 10257us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:31.766067 (+   842us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:05:31.766111 (+    44us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:05:31.766164 (+    53us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:05:31.766212 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:31.766292 (+    80us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:31.766436 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:05:31.769024 19375 leader_election.cc:304] T 28af091831594f9d8e96482078cc7625 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:05:31.750658 22063 raft_consensus.cc:493] T bc225c93219c45538b53a1bd3d387e4d P e5256d91808b47c195bc9b4dbd7f2b87 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:31.773972 22295 raft_consensus.cc:2804] T 833a2f0775ed407a94b8924ce50adb63 P e5256d91808b47c195bc9b4dbd7f2b87 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:05:31.781002 22378 leader_election.cc:290] T 1efebf73c86e432baa55533136b6e12c P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:05:31.755816 22396 raft_consensus.cc:2804] T 4af19371ea874c09a0a2147040835cbb P e5256d91808b47c195bc9b4dbd7f2b87 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:05:31.787622 22295 raft_consensus.cc:697] T 833a2f0775ed407a94b8924ce50adb63 P e5256d91808b47c195bc9b4dbd7f2b87 [term 7 LEADER]: Becoming Leader. State: Replica: e5256d91808b47c195bc9b4dbd7f2b87, State: Running, Role: LEADER
I20260709 13:05:31.761538 22398 raft_consensus.cc:740] T ef32ce6fdd0e40d382c79974f30295c6 P e5256d91808b47c195bc9b4dbd7f2b87 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: e5256d91808b47c195bc9b4dbd7f2b87, State: Running, Role: LEADER
I20260709 13:05:31.797747 22373 raft_consensus.cc:493] T b08304a0a02b42d7840c4e8ee9a6bd1a P e61c3a8f61bb48f8a963c9480e53c168 [term 8 FOLLOWER]: Starting leader election (detected failure of leader e5256d91808b47c195bc9b4dbd7f2b87)
I20260709 13:05:31.798270 22373 raft_consensus.cc:3060] T b08304a0a02b42d7840c4e8ee9a6bd1a P e61c3a8f61bb48f8a963c9480e53c168 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:05:31.783339 22293 raft_consensus.cc:2804] T 28af091831594f9d8e96482078cc7625 P e5256d91808b47c195bc9b4dbd7f2b87 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:05:31.786913 22063 raft_consensus.cc:3060] T bc225c93219c45538b53a1bd3d387e4d P e5256d91808b47c195bc9b4dbd7f2b87 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:05:31.791643 22255 leader_election.cc:290] T 172b3dd13109415a955b71ac0e9d2234 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:05:31.764111 22195 consensus_queue.cc:1048] T a08760e15aac4630a629431f56024dc8 P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.032s
W20260709 13:05:31.807807 20075 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.1:40321, user_credentials={real_user=slave}} blocked reactor thread for 283320us
I20260709 13:05:31.791985 22396 raft_consensus.cc:493] T 4af19371ea874c09a0a2147040835cbb P e5256d91808b47c195bc9b4dbd7f2b87 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 127766fc592545a4997f7790f50f6076)
I20260709 13:05:31.815156 20111 raft_consensus.cc:2468] T 172b3dd13109415a955b71ac0e9d2234 P 127766fc592545a4997f7790f50f6076 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 5.
W20260709 13:05:31.818128 19449 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.1:40321, user_credentials={real_user=slave}} blocked reactor thread for 154746us
I20260709 13:05:31.752246 22285 consensus_queue.cc:260] T fa8650e71aa14778b3d73721fc50d9fc P e61c3a8f61bb48f8a963c9480e53c168 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:31.823803 19449 leader_election.cc:304] T bc225c93219c45538b53a1bd3d387e4d P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e; no voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:05:31.824913 22378 raft_consensus.cc:2749] T bc225c93219c45538b53a1bd3d387e4d P 0473d2b2d01f4459b1e90fd12cc7840e [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:05:31.825625 19449 leader_election.cc:304] T 14efcc79969f41babe5529c22d59156d P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e; no voters: 127766fc592545a4997f7790f50f6076, e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:05:31.826495 22378 raft_consensus.cc:3060] T 14efcc79969f41babe5529c22d59156d P 0473d2b2d01f4459b1e90fd12cc7840e [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:05:31.826972 19449 leader_election.cc:304] T 9962423cb4e54fcfa5de01daf68a86e7 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e; no voters: 127766fc592545a4997f7790f50f6076, e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:05:31.828126 19449 leader_election.cc:304] T 179fd671030940b4b4a4e24bcc4aba0a P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87; no voters: 
I20260709 13:05:31.828253 22365 raft_consensus.cc:2749] T 9962423cb4e54fcfa5de01daf68a86e7 P 0473d2b2d01f4459b1e90fd12cc7840e [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:05:31.829877 19449 leader_election.cc:304] T 5ec1c4ce15e04c7e8c283a62179f2a64 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e; no voters: 127766fc592545a4997f7790f50f6076, e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:05:31.831655 19449 leader_election.cc:304] T 3e1f505cb0f1427bbd698ac889d80821 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87; no voters: 
I20260709 13:05:31.832683 19449 leader_election.cc:304] T 309c3ca0ca4b4f3ba129752ea2cb293b P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, 127766fc592545a4997f7790f50f6076, e5256d91808b47c195bc9b4dbd7f2b87; no voters: e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:05:31.812254 22293 raft_consensus.cc:697] T 28af091831594f9d8e96482078cc7625 P e5256d91808b47c195bc9b4dbd7f2b87 [term 8 LEADER]: Becoming Leader. State: Replica: e5256d91808b47c195bc9b4dbd7f2b87, State: Running, Role: LEADER
I20260709 13:05:31.818892 22396 raft_consensus.cc:3060] T 4af19371ea874c09a0a2147040835cbb P e5256d91808b47c195bc9b4dbd7f2b87 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:05:31.840548 21823 consensus_meta.cc:287] T b9f0d59553ad444883fcf5b5909f9798 P e5256d91808b47c195bc9b4dbd7f2b87: Time spent flushing consensus metadata: real 1.067s	user 0.010s	sys 0.001s
I20260709 13:05:31.839586 22410 raft_consensus.cc:2749] T 5ec1c4ce15e04c7e8c283a62179f2a64 P 0473d2b2d01f4459b1e90fd12cc7840e [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 13:05:31.847761 22380 consensus_meta.cc:287] T 0e1085d23e8347fbbd5bce7542f4b1f4 P e61c3a8f61bb48f8a963c9480e53c168: Time spent flushing consensus metadata: real 1.254s	user 0.006s	sys 0.006s
I20260709 13:05:31.843925 22352 raft_consensus.cc:2804] T 179fd671030940b4b4a4e24bcc4aba0a P 0473d2b2d01f4459b1e90fd12cc7840e [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 13:05:31.849699 21926 consensus_meta.cc:287] T 4509b76741dc428e9201c70c1658da13 P e5256d91808b47c195bc9b4dbd7f2b87: Time spent flushing consensus metadata: real 1.203s	user 0.007s	sys 0.005s
W20260709 13:05:31.848402 22374 consensus_meta.cc:287] T 40e1e16737a842ee936002830f36882e P e5256d91808b47c195bc9b4dbd7f2b87: Time spent flushing consensus metadata: real 1.181s	user 0.008s	sys 0.003s
I20260709 13:05:31.863093 19404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14efcc79969f41babe5529c22d59156d" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:05:31.850485 22111 raft_consensus.cc:493] T 65d8cb8d6ec64f459d5a47cefab10acf P 127766fc592545a4997f7790f50f6076 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader e5256d91808b47c195bc9b4dbd7f2b87)
I20260709 13:05:31.857863 22285 raft_consensus.cc:3060] T fa8650e71aa14778b3d73721fc50d9fc P e61c3a8f61bb48f8a963c9480e53c168 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:05:31.857980 22365 raft_consensus.cc:2804] T 3e1f505cb0f1427bbd698ac889d80821 P 0473d2b2d01f4459b1e90fd12cc7840e [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:05:31.858310 22410 raft_consensus.cc:2804] T 309c3ca0ca4b4f3ba129752ea2cb293b P 0473d2b2d01f4459b1e90fd12cc7840e [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 13:05:31.882143 19449 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.1:40321, user_credentials={real_user=slave}} blocked reactor thread for 49558.7us
I20260709 13:05:31.870731 22352 raft_consensus.cc:493] T 179fd671030940b4b4a4e24bcc4aba0a P 0473d2b2d01f4459b1e90fd12cc7840e [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:31.883337 19449 leader_election.cc:304] T f93ee515a9c14139bf566522ed8232f3 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87; no voters: 
I20260709 13:05:31.887145 19449 leader_election.cc:304] T 22196caba61445d3bec98a0aab3c337d P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87; no voters: 
I20260709 13:05:31.870509 22380 raft_consensus.cc:515] T 0e1085d23e8347fbbd5bce7542f4b1f4 P e61c3a8f61bb48f8a963c9480e53c168 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:05:31.848862 22295 consensus_queue.cc:237] T 833a2f0775ed407a94b8924ce50adb63 P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:05:31.873493 21926 raft_consensus.cc:515] T 4509b76741dc428e9201c70c1658da13 P e5256d91808b47c195bc9b4dbd7f2b87 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:31.853355 22398 consensus_queue.cc:260] T ef32ce6fdd0e40d382c79974f30295c6 P e5256d91808b47c195bc9b4dbd7f2b87 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:31.884821 22410 raft_consensus.cc:493] T 309c3ca0ca4b4f3ba129752ea2cb293b P 0473d2b2d01f4459b1e90fd12cc7840e [term 6 FOLLOWER]: Starting leader election (detected failure of leader e61c3a8f61bb48f8a963c9480e53c168)
I20260709 13:05:31.886550 22352 raft_consensus.cc:3060] T 179fd671030940b4b4a4e24bcc4aba0a P 0473d2b2d01f4459b1e90fd12cc7840e [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:05:31.876312 22374 raft_consensus.cc:515] T 40e1e16737a842ee936002830f36882e P e5256d91808b47c195bc9b4dbd7f2b87 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:31.886091 22365 raft_consensus.cc:697] T 3e1f505cb0f1427bbd698ac889d80821 P 0473d2b2d01f4459b1e90fd12cc7840e [term 7 LEADER]: Becoming Leader. State: Replica: 0473d2b2d01f4459b1e90fd12cc7840e, State: Running, Role: LEADER
I20260709 13:05:31.902077 22064 leader_election.cc:290] T 7f575b143b844aa096b50997dad3516a P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:05:31.903292 22476 raft_consensus.cc:2804] T 22196caba61445d3bec98a0aab3c337d P 0473d2b2d01f4459b1e90fd12cc7840e [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:05:31.903795 22476 raft_consensus.cc:493] T 22196caba61445d3bec98a0aab3c337d P 0473d2b2d01f4459b1e90fd12cc7840e [term 6 FOLLOWER]: Starting leader election (detected failure of leader e61c3a8f61bb48f8a963c9480e53c168)
I20260709 13:05:31.904186 22476 raft_consensus.cc:3060] T 22196caba61445d3bec98a0aab3c337d P 0473d2b2d01f4459b1e90fd12cc7840e [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:05:31.907272 22466 log.cc:927] Time spent T fa731b585f684a7fb2d106c50f143b83 P 127766fc592545a4997f7790f50f6076: Append to log took a long time: real 0.090s	user 0.000s	sys 0.000s
I20260709 13:05:31.879246 22111 raft_consensus.cc:515] T 65d8cb8d6ec64f459d5a47cefab10acf P 127766fc592545a4997f7790f50f6076 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:05:31.910750 19449 leader_election.cc:304] T ff9b0eddd810459b82d91c60777c10eb P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87; no voters: 127766fc592545a4997f7790f50f6076
I20260709 13:05:31.894925 22470 raft_consensus.cc:2804] T f93ee515a9c14139bf566522ed8232f3 P 0473d2b2d01f4459b1e90fd12cc7840e [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:05:31.913127 19407 raft_consensus.cc:1275] T ece3db938bc649d4a40a51522ed5259c P e5256d91808b47c195bc9b4dbd7f2b87 [term 7 FOLLOWER]: Refusing update from remote peer 127766fc592545a4997f7790f50f6076: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:05:31.898381 22410 raft_consensus.cc:3060] T 309c3ca0ca4b4f3ba129752ea2cb293b P 0473d2b2d01f4459b1e90fd12cc7840e [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:05:31.915515 19403 raft_consensus.cc:2368] T 40e1e16737a842ee936002830f36882e P e5256d91808b47c195bc9b4dbd7f2b87 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0473d2b2d01f4459b1e90fd12cc7840e for earlier term 8. Current term is 9.
W20260709 13:05:31.925930 21962 consensus_meta.cc:287] T 1dc5b3532fe54f74876d02beffa2c230 P e5256d91808b47c195bc9b4dbd7f2b87: Time spent flushing consensus metadata: real 0.872s	user 0.005s	sys 0.002s
W20260709 13:05:31.926260 22443 consensus_meta.cc:287] T 7be9efa6559648dbb5a0f7684c4542d1 P e5256d91808b47c195bc9b4dbd7f2b87: Time spent flushing consensus metadata: real 0.915s	user 0.007s	sys 0.000s
I20260709 13:05:31.927881 19405 raft_consensus.cc:1240] T 2a16f7501e2444fb86d4e2778e734e02 P e5256d91808b47c195bc9b4dbd7f2b87 [term 8 FOLLOWER]: Rejecting Update request from peer 127766fc592545a4997f7790f50f6076 for earlier term 7. Current term is 8. Ops: []
I20260709 13:05:31.884773 22293 consensus_queue.cc:237] T 28af091831594f9d8e96482078cc7625 P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.3, Last appended by leader: 3, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:31.914278 22470 raft_consensus.cc:493] T f93ee515a9c14139bf566522ed8232f3 P 0473d2b2d01f4459b1e90fd12cc7840e [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:31.931100 19449 leader_election.cc:304] T 1a61655d99124a29b486ba4a5b37faea P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87; no voters: 
I20260709 13:05:31.936973 22480 raft_consensus.cc:2804] T ff9b0eddd810459b82d91c60777c10eb P 0473d2b2d01f4459b1e90fd12cc7840e [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:05:31.937520 22480 raft_consensus.cc:493] T ff9b0eddd810459b82d91c60777c10eb P 0473d2b2d01f4459b1e90fd12cc7840e [term 4 FOLLOWER]: Starting leader election (detected failure of leader 127766fc592545a4997f7790f50f6076)
I20260709 13:05:31.937990 22480 raft_consensus.cc:3060] T ff9b0eddd810459b82d91c60777c10eb P 0473d2b2d01f4459b1e90fd12cc7840e [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:05:31.915874 22398 raft_consensus.cc:3060] T ef32ce6fdd0e40d382c79974f30295c6 P e5256d91808b47c195bc9b4dbd7f2b87 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:05:31.914582 22400 raft_consensus.cc:493] T ece3db938bc649d4a40a51522ed5259c P e5256d91808b47c195bc9b4dbd7f2b87 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:31.943049 22400 raft_consensus.cc:515] T ece3db938bc649d4a40a51522ed5259c P e5256d91808b47c195bc9b4dbd7f2b87 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:05:31.946527 19485 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58286 (request call id 1633) took 1839 ms. Trace:
I20260709 13:05:31.979010 22365 consensus_queue.cc:237] T 3e1f505cb0f1427bbd698ac889d80821 P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:31.981925 22111 leader_election.cc:290] T 65d8cb8d6ec64f459d5a47cefab10acf P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:05:31.983402 22344 leader_election.cc:290] T 0e1085d23e8347fbbd5bce7542f4b1f4 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:05:31.935446 22443 raft_consensus.cc:515] T 7be9efa6559648dbb5a0f7684c4542d1 P e5256d91808b47c195bc9b4dbd7f2b87 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } attrs { replace: true } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: NON_VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: true } }
I20260709 13:05:31.946964 19485 rpcz_store.cc:276] 0709 13:05:30.107418 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:31.749091 (+1641673us) service_pool.cc:224] Handling call
0709 13:05:31.749469 (+   378us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:05:31.751537 (+  2068us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:05:31.751563 (+    26us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:05:31.756571 (+  5008us) log.cc:844] Serialized 26 byte log entry
0709 13:05:31.851535 (+ 94964us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:05:31.851620 (+    85us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:31.851742 (+   122us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:05:31.946291 (+ 94549us) raft_consensus.cc:1685] finished
0709 13:05:31.946313 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:31.946468 (+   155us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1643,"raft.queue_time_us":1835,"raft.run_cpu_time_us":122,"raft.run_wall_time_us":7319,"thread_start_us":57634,"threads_started":1,"wal-append.queue_time_us":105683}
I20260709 13:05:31.992095 22350 raft_consensus.cc:515] T 9962423cb4e54fcfa5de01daf68a86e7 P 127766fc592545a4997f7790f50f6076 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:05:31.993932 22254 raft_consensus.cc:493] T 14efcc79969f41babe5529c22d59156d P e5256d91808b47c195bc9b4dbd7f2b87 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:32.002853 19410 raft_consensus.cc:1240] T 5ec1c4ce15e04c7e8c283a62179f2a64 P e5256d91808b47c195bc9b4dbd7f2b87 [term 6 FOLLOWER]: Rejecting Update request from peer 127766fc592545a4997f7790f50f6076 for earlier term 5. Current term is 6. Ops: []
W20260709 13:05:32.009191 19449 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.1:40321, user_credentials={real_user=slave}} blocked reactor thread for 72914us
I20260709 13:05:32.001494 19484 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39478 (request call id 373) took 2520 ms. Trace:
I20260709 13:05:32.020017 19410 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49050 (request call id 393) took 2165 ms. Trace:
I20260709 13:05:32.020730 19449 leader_election.cc:304] T 46c5bfeecc314717bffe987e6844b6d0 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87; no voters: 
I20260709 13:05:32.020177 19484 rpcz_store.cc:276] 0709 13:05:29.480875 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:31.633956 (+2153081us) service_pool.cc:224] Handling call
0709 13:05:31.634259 (+   303us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:05:31.821602 (+187343us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:05:31.821633 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:05:31.840199 (+ 18566us) log.cc:844] Serialized 26 byte log entry
0709 13:05:31.875587 (+ 35388us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:05:31.875624 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:31.875692 (+    68us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:05:32.001217 (+125525us) raft_consensus.cc:1685] finished
0709 13:05:32.001245 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:32.001429 (+   184us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":19546,"raft.run_cpu_time_us":81,"raft.run_wall_time_us":81,"thread_start_us":206746,"threads_started":2,"wal-append.queue_time_us":44279}
I20260709 13:05:32.020453 19410 rpcz_store.cc:276] 0709 13:05:29.854396 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:30.973958 (+1119562us) service_pool.cc:224] Handling call
0709 13:05:32.002372 (+1028414us) spinlock_profiling.cc:243] Waited 3.41 ms on lock 0x7b5800183c98. stack: 00007f4a79de9343 00007f4a79de9240 00007f4a797781d4 00007f4a834b6304 00007f4a834b6299 00007f4a79ca3db1 00007f4a79de3b71 00007f4a79de3a22 00007f4a82cfcc09 00007f4a81e56ee0 00007f4a81f200ab 00007f4a81f20131 00007f4a81ee1fc0 00007f4a81ecc929 00007f4a81ecc3d2 00007f4a7b443bd4
0709 13:05:32.002573 (+   201us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:32.019758 (+ 17185us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:32.019960 (+   202us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":7853824}
I20260709 13:05:32.005569 19404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9962423cb4e54fcfa5de01daf68a86e7" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
I20260709 13:05:32.002395 19405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65d8cb8d6ec64f459d5a47cefab10acf" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:05:32.024361 22374 leader_election.cc:290] T 40e1e16737a842ee936002830f36882e P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 9 election: Requested vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:05:32.044498 19479 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58286 (request call id 1644) took 1489 ms. Trace:
I20260709 13:05:31.999706 22372 raft_consensus.cc:2804] T 1a61655d99124a29b486ba4a5b37faea P 0473d2b2d01f4459b1e90fd12cc7840e [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:05:32.051276 22372 raft_consensus.cc:493] T 1a61655d99124a29b486ba4a5b37faea P 0473d2b2d01f4459b1e90fd12cc7840e [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:31.995862 22373 raft_consensus.cc:515] T b08304a0a02b42d7840c4e8ee9a6bd1a P e61c3a8f61bb48f8a963c9480e53c168 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:31.994376 22350 leader_election.cc:290] T 9962423cb4e54fcfa5de01daf68a86e7 P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 11 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
W20260709 13:05:32.046185 19377 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.2:46257, user_credentials={real_user=slave}} blocked reactor thread for 119448us
I20260709 13:05:31.994491 22254 raft_consensus.cc:515] T 14efcc79969f41babe5529c22d59156d P e5256d91808b47c195bc9b4dbd7f2b87 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:05:32.026166 19486 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58286 (request call id 1629) took 1919 ms. Trace:
I20260709 13:05:32.047214 22352 raft_consensus.cc:515] T 179fd671030940b4b4a4e24bcc4aba0a P 0473d2b2d01f4459b1e90fd12cc7840e [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:31.947319 22470 raft_consensus.cc:3060] T f93ee515a9c14139bf566522ed8232f3 P 0473d2b2d01f4459b1e90fd12cc7840e [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:05:32.062611 22468 log.cc:927] Time spent T b9f0d59553ad444883fcf5b5909f9798 P e61c3a8f61bb48f8a963c9480e53c168: Append to log took a long time: real 0.240s	user 0.004s	sys 0.000s
I20260709 13:05:32.064316 22056 raft_consensus.cc:515] T 14efcc79969f41babe5529c22d59156d P 127766fc592545a4997f7790f50f6076 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:05:32.067236 19405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14efcc79969f41babe5529c22d59156d" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
I20260709 13:05:32.067624 22179 consensus_queue.cc:1048] T 14935b3ddf914369822e4a0547aaa355 P 127766fc592545a4997f7790f50f6076 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:05:32.050966 19479 rpcz_store.cc:276] 0709 13:05:30.555309 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:31.785413 (+1230104us) service_pool.cc:224] Handling call
0709 13:05:31.794310 (+  8897us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:05:31.814929 (+ 20619us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:05:31.814977 (+    48us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:05:31.842563 (+ 27586us) log.cc:844] Serialized 26 byte log entry
0709 13:05:31.877399 (+ 34836us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:05:31.895611 (+ 18212us) log.cc:844] Serialized 14 byte log entry
0709 13:05:32.044055 (+148444us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:32.044163 (+   108us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:05:32.044222 (+    59us) raft_consensus.cc:1685] finished
0709 13:05:32.044242 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:32.044417 (+   175us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":19966,"prepare.run_cpu_time_us":39,"prepare.run_wall_time_us":41,"raft.queue_time_us":44057,"raft.run_cpu_time_us":235,"raft.run_wall_time_us":6560,"thread_start_us":170299,"threads_started":2,"wal-append.queue_time_us":60736}
I20260709 13:05:32.069443 22056 leader_election.cc:290] T 14efcc79969f41babe5529c22d59156d P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 8 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:05:32.056655 19477 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39478 (request call id 372) took 2576 ms. Trace:
I20260709 13:05:32.060689 19377 leader_election.cc:304] T ff75a1d4cb1f493db8f71ddc136ba9ab P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87; no voters: e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:05:32.062069 19409 raft_consensus.cc:2468] T 14efcc79969f41babe5529c22d59156d P e5256d91808b47c195bc9b4dbd7f2b87 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 127766fc592545a4997f7790f50f6076 in term 7.
I20260709 13:05:32.060230 19486 rpcz_store.cc:276] 0709 13:05:30.106513 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:31.672749 (+1566236us) service_pool.cc:224] Handling call
0709 13:05:31.743244 (+ 70495us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:05:31.743554 (+   310us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:05:31.743578 (+    24us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:05:31.762104 (+ 18526us) log.cc:844] Serialized 26 byte log entry
0709 13:05:31.877740 (+115636us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:05:31.893976 (+ 16236us) log.cc:844] Serialized 14 byte log entry
0709 13:05:31.894160 (+   184us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:31.894236 (+    76us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:05:32.025966 (+131730us) raft_consensus.cc:1685] finished
0709 13:05:32.025988 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:32.026114 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":10673,"prepare.queue_time_us":19736,"prepare.run_cpu_time_us":49,"prepare.run_wall_time_us":50,"raft.queue_time_us":46186,"raft.run_cpu_time_us":222,"raft.run_wall_time_us":4025,"thread_start_us":98651,"threads_started":1,"wal-append.queue_time_us":113078}
I20260709 13:05:32.072068 21957 raft_consensus.cc:2804] T ff75a1d4cb1f493db8f71ddc136ba9ab P e5256d91808b47c195bc9b4dbd7f2b87 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:05:32.072471 21957 raft_consensus.cc:493] T ff75a1d4cb1f493db8f71ddc136ba9ab P e5256d91808b47c195bc9b4dbd7f2b87 [term 6 FOLLOWER]: Starting leader election (detected failure of leader e61c3a8f61bb48f8a963c9480e53c168)
I20260709 13:05:32.072824 21957 raft_consensus.cc:3060] T ff75a1d4cb1f493db8f71ddc136ba9ab P e5256d91808b47c195bc9b4dbd7f2b87 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:05:32.073462 20076 connection.cc:256] RPC call timeout handler was delayed by -1.197235871000089s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1777s for a response
I20260709 13:05:32.074967 19408 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52328 (request call id 1642) took 2686 ms. Trace:
I20260709 13:05:32.075584 19402 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52342 (request call id 2069) took 2025 ms. Trace:
I20260709 13:05:32.075929 19402 rpcz_store.cc:276] 0709 13:05:30.049736 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:31.047434 (+997698us) service_pool.cc:224] Handling call
0709 13:05:31.067004 (+ 19570us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:31.993454 (+926450us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 13:05:31.993500 (+    46us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:05:31.993557 (+    57us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:05:31.993596 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:32.075376 (+ 81780us) spinlock_profiling.cc:243] Waited 926 ms on lock 0x7b54000e6ad4. stack: 00007f4a79de9343 00007f4a79de9240 00007f4a797781d4 00007f4a834b6304 00007f4a834b6299 00007f4a7ce71571 00007f4a7cf08e01 00007f4a7cf0783e 00007f4a81ecc419 00007f4a7b443bd4 00007f4a7b443b62 00007f4a7b443a91 00007f4a7b443a0c 00007f4a7b442cc2 00007f4a7b24348c 00007f4a7b2428c6
0709 13:05:32.075422 (+    46us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:32.075534 (+   112us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":451,"raft.run_cpu_time_us":86,"raft.run_wall_time_us":87,"spinlock_wait_cycles":2129667456}
W20260709 13:05:32.076838 19526 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:32.077740 19484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e1085d23e8347fbbd5bce7542f4b1f4" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:05:31.978482 22378 raft_consensus.cc:2749] T 14efcc79969f41babe5529c22d59156d P 0473d2b2d01f4459b1e90fd12cc7840e [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:05:32.078418 19526 leader_election.cc:304] T 179fd671030940b4b4a4e24bcc4aba0a P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:05:32.078888 19377 leader_election.cc:304] T fa8650e71aa14778b3d73721fc50d9fc P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:05:32.075390 19408 rpcz_store.cc:276] 0709 13:05:29.388021 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:29.394479 (+  6458us) service_pool.cc:224] Handling call
0709 13:05:32.074765 (+2680286us) spinlock_profiling.cc:243] Waited 281 ms on lock 0x7b54000e60d4. stack: 00007f4a79de9343 00007f4a79de9240 00007f4a797781d4 00007f4a834b6304 00007f4a834b6299 00007f4a7ce71571 00007f4a7cf0c2fa 00007f4a81ecdb17 00007f4a7b4486d4 00007f4a7b448662 00007f4a7b448591 00007f4a7b44850c 00007f4a7b4477c2 00007f4a7b24348c 00007f4a7b2428c6 00007f4a7b24226f
0709 13:05:32.074882 (+   117us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":646471552}
I20260709 13:05:32.070062 19477 rpcz_store.cc:276] 0709 13:05:29.480553 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:31.530133 (+2049580us) service_pool.cc:224] Handling call
0709 13:05:31.550125 (+ 19992us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:31.550381 (+   256us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:05:31.818827 (+268446us) log.cc:844] Serialized 14 byte log entry
0709 13:05:32.056215 (+237388us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:05:32.056299 (+    84us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:05:32.056367 (+    68us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:32.056460 (+    93us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:32.056602 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":221856,"prepare.run_cpu_time_us":47,"prepare.run_wall_time_us":49,"raft.queue_time_us":37870,"raft.run_cpu_time_us":79,"raft.run_wall_time_us":80,"thread_start_us":426759,"threads_started":3,"wal-append.queue_time_us":115600}
I20260709 13:05:32.051827 22372 raft_consensus.cc:3060] T 1a61655d99124a29b486ba4a5b37faea P 0473d2b2d01f4459b1e90fd12cc7840e [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:05:32.084803 19486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c5eebf646ad445a9d1b1adc319d7b16" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:05:32.088805 19479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df751f992649444090e27965eb1af85d" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 9 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:05:32.056923 22339 raft_consensus.cc:493] T 0afb57ae58a24a01850491d69f0213dd P 0473d2b2d01f4459b1e90fd12cc7840e [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 127766fc592545a4997f7790f50f6076)
I20260709 13:05:32.093904 22351 raft_consensus.cc:3060] T fa8650e71aa14778b3d73721fc50d9fc P e5256d91808b47c195bc9b4dbd7f2b87 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:05:32.095188 22174 raft_consensus.cc:515] T ab43d85f64114d4ebf618930e43d9ed0 P 127766fc592545a4997f7790f50f6076 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } attrs { replace: true } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:05:32.096130 22340 leader_election.cc:290] T 4af19371ea874c09a0a2147040835cbb P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:05:32.098181 22174 leader_election.cc:290] T ab43d85f64114d4ebf618930e43d9ed0 P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 6 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:05:32.097916 22396 raft_consensus.cc:515] T 4af19371ea874c09a0a2147040835cbb P e5256d91808b47c195bc9b4dbd7f2b87 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:05:32.098445 22391 raft_consensus.cc:3060] T 28af091831594f9d8e96482078cc7625 P 0473d2b2d01f4459b1e90fd12cc7840e [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:05:32.086843 22380 leader_election.cc:290] T 0e1085d23e8347fbbd5bce7542f4b1f4 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 5 election: Requested vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:05:32.083030 22388 raft_consensus.cc:2804] T 46c5bfeecc314717bffe987e6844b6d0 P 0473d2b2d01f4459b1e90fd12cc7840e [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:05:32.078055 22344 consensus_queue.cc:1048] T ed7fdbcb96d14d418db9ca90a792588a P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.010s
I20260709 13:05:32.022550 22480 raft_consensus.cc:515] T ff9b0eddd810459b82d91c60777c10eb P 0473d2b2d01f4459b1e90fd12cc7840e [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:05:32.092432 19377 leader_election.cc:304] T f93ee515a9c14139bf566522ed8232f3 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87; no voters: 
I20260709 13:05:32.103292 20075 leader_election.cc:304] T 775c229504194560ba9589bc2199b089 P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 127766fc592545a4997f7790f50f6076, e5256d91808b47c195bc9b4dbd7f2b87; no voters: 
I20260709 13:05:32.104862 19408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab43d85f64114d4ebf618930e43d9ed0" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
I20260709 13:05:32.079593 20106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1efebf73c86e432baa55533136b6e12c" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:05:32.119138 19408 raft_consensus.cc:3060] T ab43d85f64114d4ebf618930e43d9ed0 P e5256d91808b47c195bc9b4dbd7f2b87 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:05:32.087814 22381 raft_consensus.cc:493] T 96efeaaf1057492490e9a621f37e1a2d P 0473d2b2d01f4459b1e90fd12cc7840e [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:32.069557 22063 raft_consensus.cc:515] T bc225c93219c45538b53a1bd3d387e4d P e5256d91808b47c195bc9b4dbd7f2b87 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:32.120779 19377 leader_election.cc:304] T 86a6797bdfe94fa496c050ceae4bd0d9 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168
W20260709 13:05:32.122954 19452 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:32.086908 22285 raft_consensus.cc:2804] T 179fd671030940b4b4a4e24bcc4aba0a P e61c3a8f61bb48f8a963c9480e53c168 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:05:32.124676 22295 raft_consensus.cc:2749] T 86a6797bdfe94fa496c050ceae4bd0d9 P e5256d91808b47c195bc9b4dbd7f2b87 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:05:32.107019 22385 leader_election.cc:290] T f93ee515a9c14139bf566522ed8232f3 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:05:32.105646 22409 raft_consensus.cc:493] T edd7d470b5014c9489be7f41f64355c9 P 0473d2b2d01f4459b1e90fd12cc7840e [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:32.074992 22470 raft_consensus.cc:515] T f93ee515a9c14139bf566522ed8232f3 P 0473d2b2d01f4459b1e90fd12cc7840e [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:32.107254 22388 raft_consensus.cc:493] T 46c5bfeecc314717bffe987e6844b6d0 P 0473d2b2d01f4459b1e90fd12cc7840e [term 12 FOLLOWER]: Starting leader election (detected failure of leader e61c3a8f61bb48f8a963c9480e53c168)
I20260709 13:05:32.092396 22413 consensus_queue.cc:1048] T 1a61655d99124a29b486ba4a5b37faea P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.035s
I20260709 13:05:32.139428 19377 leader_election.cc:304] T 22196caba61445d3bec98a0aab3c337d P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:05:32.122581 22340 raft_consensus.cc:2804] T f93ee515a9c14139bf566522ed8232f3 P e5256d91808b47c195bc9b4dbd7f2b87 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:05:32.124807 22352 leader_election.cc:290] T 179fd671030940b4b4a4e24bcc4aba0a P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 7 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:05:32.124984 22400 leader_election.cc:290] T ece3db938bc649d4a40a51522ed5259c P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:05:32.104347 22485 consensus_queue.cc:1059] T 2b74109013a140ada21feeef92d6f563 P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.049s
I20260709 13:05:32.136011 22174 raft_consensus.cc:2804] T 775c229504194560ba9589bc2199b089 P 127766fc592545a4997f7790f50f6076 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:05:32.151175 20075 leader_election.cc:304] T 172b3dd13109415a955b71ac0e9d2234 P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 127766fc592545a4997f7790f50f6076, e5256d91808b47c195bc9b4dbd7f2b87; no voters: 0473d2b2d01f4459b1e90fd12cc7840e
I20260709 13:05:32.127241 22381 raft_consensus.cc:515] T 96efeaaf1057492490e9a621f37e1a2d P 0473d2b2d01f4459b1e90fd12cc7840e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:05:32.140682 22409 raft_consensus.cc:515] T edd7d470b5014c9489be7f41f64355c9 P 0473d2b2d01f4459b1e90fd12cc7840e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:32.124859 22476 raft_consensus.cc:515] T 22196caba61445d3bec98a0aab3c337d P 0473d2b2d01f4459b1e90fd12cc7840e [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:32.142953 22388 raft_consensus.cc:3060] T 46c5bfeecc314717bffe987e6844b6d0 P 0473d2b2d01f4459b1e90fd12cc7840e [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:05:32.138963 22285 raft_consensus.cc:697] T 179fd671030940b4b4a4e24bcc4aba0a P e61c3a8f61bb48f8a963c9480e53c168 [term 6 LEADER]: Becoming Leader. State: Replica: e61c3a8f61bb48f8a963c9480e53c168, State: Running, Role: LEADER
I20260709 13:05:32.144925 22340 raft_consensus.cc:493] T f93ee515a9c14139bf566522ed8232f3 P e5256d91808b47c195bc9b4dbd7f2b87 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:32.107906 22339 raft_consensus.cc:515] T 0afb57ae58a24a01850491d69f0213dd P 0473d2b2d01f4459b1e90fd12cc7840e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:05:32.157987 20107 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46436 (request call id 486) took 2425 ms. Trace:
I20260709 13:05:32.204715 19559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2725d2c4cb054f18b0fc8f735c15f6c2" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:05:32.145325 22482 raft_consensus.cc:493] T 4509b76741dc428e9201c70c1658da13 P 0473d2b2d01f4459b1e90fd12cc7840e [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:32.159919 22352 raft_consensus.cc:493] T f1b10566f45d4a7d9029858330e02d5b P 0473d2b2d01f4459b1e90fd12cc7840e [term 8 FOLLOWER]: Starting pre-election (detected failure of leader e5256d91808b47c195bc9b4dbd7f2b87)
I20260709 13:05:32.222867 22482 raft_consensus.cc:515] T 4509b76741dc428e9201c70c1658da13 P 0473d2b2d01f4459b1e90fd12cc7840e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:32.223134 22352 raft_consensus.cc:515] T f1b10566f45d4a7d9029858330e02d5b P 0473d2b2d01f4459b1e90fd12cc7840e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:32.149712 22399 leader_election.cc:290] T 5ec1c4ce15e04c7e8c283a62179f2a64 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 6 election: Requested vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:05:32.224998 22482 leader_election.cc:290] T 4509b76741dc428e9201c70c1658da13 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:05:32.225090 22352 leader_election.cc:290] T f1b10566f45d4a7d9029858330e02d5b P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:05:32.225373 22476 leader_election.cc:290] T 22196caba61445d3bec98a0aab3c337d P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 7 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:05:32.152504 22374 consensus_queue.cc:1059] T a08760e15aac4630a629431f56024dc8 P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.073s
I20260709 13:05:32.185436 22443 leader_election.cc:290] T 7be9efa6559648dbb5a0f7684c4542d1 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 8 election: Requested vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:05:32.198514 22063 leader_election.cc:290] T bc225c93219c45538b53a1bd3d387e4d P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 10 election: Requested vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:05:32.187840 22381 leader_election.cc:290] T 96efeaaf1057492490e9a621f37e1a2d P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:05:32.186298 22396 leader_election.cc:290] T 4af19371ea874c09a0a2147040835cbb P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 5 election: Requested vote from peers e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:05:32.226475 22360 raft_consensus.cc:2764] T 172b3dd13109415a955b71ac0e9d2234 P 127766fc592545a4997f7790f50f6076 [term 5 FOLLOWER]: Leader pre-election decision vote started in defunct term 4: won
W20260709 13:05:32.228065 19481 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58286 (request call id 1620) took 2536 ms (client timeout 1935 ms). Trace:
W20260709 13:05:32.228454 19481 rpcz_store.cc:269] 0709 13:05:29.691657 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:30.040469 (+348812us) service_pool.cc:224] Handling call
0709 13:05:32.227904 (+2187435us) spinlock_profiling.cc:243] Waited 1.58 s on lock 0x7b5400148554. stack: 00007f4a79de9343 00007f4a79de9240 00007f4a797781d4 00007f4a834b6304 00007f4a834b6299 00007f4a7ce71571 00007f4a7cf0c2fa 00007f4a81ecdb17 00007f4a7b4486d4 00007f4a7b448662 00007f4a7b448591 00007f4a7b44850c 00007f4a7b4477c2 00007f4a7b24348c 00007f4a7b2428c6 00007f4a7b24226f
0709 13:05:32.228001 (+    97us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3624720768}
I20260709 13:05:32.229013 19482 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58294 (request call id 1795) took 1916 ms. Trace:
I20260709 13:05:32.229346 19482 rpcz_store.cc:276] 0709 13:05:30.312822 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:30.626825 (+314003us) service_pool.cc:224] Handling call
0709 13:05:32.228874 (+1602049us) spinlock_profiling.cc:243] Waited 2.21 ms on lock 0x7b54000a9e54. stack: 00007f4a79de9343 00007f4a79de9240 00007f4a797781d4 00007f4a834b6304 00007f4a834b6299 00007f4a7ce71571 00007f4a7cf0c2fa 00007f4a81ecdb17 00007f4a7b4486d4 00007f4a7b448662 00007f4a7b448591 00007f4a7b44850c 00007f4a7b4477c2 00007f4a7b24348c 00007f4a7b2428c6 00007f4a7b24226f
0709 13:05:32.228963 (+    89us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5081856}
I20260709 13:05:32.144701 22295 raft_consensus.cc:2749] T 22196caba61445d3bec98a0aab3c337d P e5256d91808b47c195bc9b4dbd7f2b87 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:05:32.200105 19553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f93ee515a9c14139bf566522ed8232f3" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 10 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
W20260709 13:05:32.233685 19449 leader_election.cc:336] T 40e1e16737a842ee936002830f36882e P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321): Timed out: RequestConsensusVote RPC to 127.17.223.1:40321 timed out after 2.099s (SENT)
I20260709 13:05:32.153340 22174 raft_consensus.cc:697] T 775c229504194560ba9589bc2199b089 P 127766fc592545a4997f7790f50f6076 [term 6 LEADER]: Becoming Leader. State: Replica: 127766fc592545a4997f7790f50f6076, State: Running, Role: LEADER
W20260709 13:05:32.238878 20076 leader_election.cc:336] T 85c494af21f9457a85da47b9bc70c1fd P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891): Timed out: RequestConsensusVote RPC to 127.17.223.3:36891 timed out after 1.659s (SENT)
I20260709 13:05:32.239327 20076 leader_election.cc:304] T 85c494af21f9457a85da47b9bc70c1fd P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 127766fc592545a4997f7790f50f6076; no voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168
W20260709 13:05:32.239939 19526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.2:46257, user_credentials={real_user=slave}} blocked reactor thread for 151390us
W20260709 13:05:32.195581 19377 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.2:46257, user_credentials={real_user=slave}} blocked reactor thread for 45497.9us
I20260709 13:05:32.201159 19554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14935b3ddf914369822e4a0547aaa355" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:05:32.201505 19551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86a6797bdfe94fa496c050ceae4bd0d9" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 7 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:05:32.241516 19554 raft_consensus.cc:2468] T 14935b3ddf914369822e4a0547aaa355 P e61c3a8f61bb48f8a963c9480e53c168 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 6.
I20260709 13:05:32.203043 19555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22196caba61445d3bec98a0aab3c337d" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:05:32.159655 19407 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49050 (request call id 400) took 1581 ms. Trace:
W20260709 13:05:32.149511 19450 connection.cc:256] RPC call timeout handler was delayed by -1.0350080939999771s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1646s for a response
I20260709 13:05:32.243005 19407 rpcz_store.cc:276] 0709 13:05:30.578015 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:31.646087 (+1068072us) service_pool.cc:224] Handling call
0709 13:05:31.657679 (+ 11592us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:31.914397 (+256718us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:32.159423 (+245026us) spinlock_profiling.cc:243] Waited 255 ms on lock 0x7b54000e6fd4. stack: 00007f4a79de9343 00007f4a79de9240 00007f4a797781d4 00007f4a834b6304 00007f4a834b6299 00007f4a7ce71571 00007f4a7cf08e01 00007f4a7cf0783e 00007f4a81ecc419 00007f4a7b443bd4 00007f4a7b443b62 00007f4a7b443a91 00007f4a7b443a0c 00007f4a7b442cc2 00007f4a7b24348c 00007f4a7b2428c6
0709 13:05:32.159581 (+   158us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":586643328}
I20260709 13:05:32.156934 19483 raft_consensus.cc:2468] T 28af091831594f9d8e96482078cc7625 P 0473d2b2d01f4459b1e90fd12cc7840e [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 7.
I20260709 13:05:32.205097 19408 raft_consensus.cc:2468] T ab43d85f64114d4ebf618930e43d9ed0 P e5256d91808b47c195bc9b4dbd7f2b87 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 127766fc592545a4997f7790f50f6076 in term 6.
I20260709 13:05:32.237741 22271 raft_consensus.cc:493] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P 127766fc592545a4997f7790f50f6076 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader e5256d91808b47c195bc9b4dbd7f2b87)
I20260709 13:05:32.146963 22209 consensus_queue.cc:1059] T 833a2f0775ed407a94b8924ce50adb63 P 127766fc592545a4997f7790f50f6076 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.088s
W20260709 13:05:32.205721 20075 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.1:40321, user_credentials={real_user=slave}} blocked reactor thread for 54623.8us
I20260709 13:05:32.204895 20107 rpcz_store.cc:276] 0709 13:05:29.732879 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:29.733003 (+   124us) service_pool.cc:224] Handling call
0709 13:05:29.750193 (+ 17190us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:05:30.244106 (+493913us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:32.157726 (+1913620us) spinlock_profiling.cc:243] Waited 467 ms on lock 0x7b540036c754. stack: 00007f4a79de9343 00007f4a79de9240 00007f4a797781d4 00007f4a834b6304 00007f4a834b6299 00007f4a7ce71571 00007f4a7cf08e01 00007f4a7cf0783e 00007f4a81ecc419 00007f4a7b443bd4 00007f4a7b443b62 00007f4a7b443a91 00007f4a7b443a0c 00007f4a7b442cc2 00007f4a7b24348c 00007f4a7b2428c6
0709 13:05:32.157929 (+   203us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1073296640}
I20260709 13:05:32.152957 19375 leader_election.cc:304] T 2b74109013a140ada21feeef92d6f563 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:05:32.161966 22254 leader_election.cc:290] T 14efcc79969f41babe5529c22d59156d P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:05:32.197471 22373 leader_election.cc:290] T b08304a0a02b42d7840c4e8ee9a6bd1a P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 9 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:05:32.197295 22470 leader_election.cc:290] T f93ee515a9c14139bf566522ed8232f3 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 10 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:05:32.211745 19560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed7fdbcb96d14d418db9ca90a792588a" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:05:32.196512 22480 leader_election.cc:290] T ff9b0eddd810459b82d91c60777c10eb P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 5 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:05:32.212821 19552 raft_consensus.cc:1240] T 2b74109013a140ada21feeef92d6f563 P e61c3a8f61bb48f8a963c9480e53c168 [term 5 FOLLOWER]: Rejecting Update request from peer 0473d2b2d01f4459b1e90fd12cc7840e for earlier term 4. Current term is 5. Ops: [4.4-4.4]
I20260709 13:05:32.189083 20106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96efeaaf1057492490e9a621f37e1a2d" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:05:32.272833 22487 raft_consensus.cc:493] T 2e36a9d6e29c4a7c860cf267efbd4c74 P 0473d2b2d01f4459b1e90fd12cc7840e [term 6 FOLLOWER]: Starting pre-election (detected failure of leader e5256d91808b47c195bc9b4dbd7f2b87)
I20260709 13:05:32.213217 20104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff9b0eddd810459b82d91c60777c10eb" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076"
W20260709 13:05:32.283939 19483 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58294 (request call id 1788) took 2295 ms (client timeout 2506 ms). Trace:
I20260709 13:05:32.284092 22487 raft_consensus.cc:515] T 2e36a9d6e29c4a7c860cf267efbd4c74 P 0473d2b2d01f4459b1e90fd12cc7840e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
W20260709 13:05:32.273576 19375 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.3:36891, user_credentials={real_user=slave}} blocked reactor thread for 120674us
I20260709 13:05:32.285562 19375 leader_election.cc:304] T 2a16f7501e2444fb86d4e2778e734e02 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:05:32.285673 20107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4af19371ea874c09a0a2147040835cbb" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:05:32.286684 22056 raft_consensus.cc:2749] T 85c494af21f9457a85da47b9bc70c1fd P 127766fc592545a4997f7790f50f6076 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:05:32.287614 20105 raft_consensus.cc:1240] T 9962423cb4e54fcfa5de01daf68a86e7 P 127766fc592545a4997f7790f50f6076 [term 11 FOLLOWER]: Rejecting Update request from peer e5256d91808b47c195bc9b4dbd7f2b87 for earlier term 10. Current term is 11. Ops: []
I20260709 13:05:32.288137 19479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "172b3dd13109415a955b71ac0e9d2234" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:05:32.288833 19479 raft_consensus.cc:2393] T 172b3dd13109415a955b71ac0e9d2234 P 0473d2b2d01f4459b1e90fd12cc7840e [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e5256d91808b47c195bc9b4dbd7f2b87 in current term 5: Already voted for candidate 0473d2b2d01f4459b1e90fd12cc7840e in this term.
I20260709 13:05:32.289575 19479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b74109013a140ada21feeef92d6f563" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:05:32.289880 20108 raft_consensus.cc:1217] T ece3db938bc649d4a40a51522ed5259c P 127766fc592545a4997f7790f50f6076 [term 7 LEADER]: Deduplicated request from leader. Original: 5.6->[6.7-6.7]   Dedup: 6.7->[]
I20260709 13:05:32.290364 20108 raft_consensus.cc:1240] T ece3db938bc649d4a40a51522ed5259c P 127766fc592545a4997f7790f50f6076 [term 7 LEADER]: Rejecting Update request from peer e5256d91808b47c195bc9b4dbd7f2b87 for earlier term 6. Current term is 7. Ops: [6.7-6.7]
I20260709 13:05:32.291349 20112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa731b585f684a7fb2d106c50f143b83" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:05:32.291827 22353 raft_consensus.cc:2804] T 2a16f7501e2444fb86d4e2778e734e02 P e5256d91808b47c195bc9b4dbd7f2b87 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:05:32.149510 22378 raft_consensus.cc:493] T 48824d5acfbc485ebf8c2d944e7202de P 0473d2b2d01f4459b1e90fd12cc7840e [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:32.204128 22340 raft_consensus.cc:3060] T f93ee515a9c14139bf566522ed8232f3 P e5256d91808b47c195bc9b4dbd7f2b87 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:05:32.292335 22353 raft_consensus.cc:697] T 2a16f7501e2444fb86d4e2778e734e02 P e5256d91808b47c195bc9b4dbd7f2b87 [term 8 LEADER]: Becoming Leader. State: Replica: e5256d91808b47c195bc9b4dbd7f2b87, State: Running, Role: LEADER
I20260709 13:05:32.292445 22378 raft_consensus.cc:515] T 48824d5acfbc485ebf8c2d944e7202de P 0473d2b2d01f4459b1e90fd12cc7840e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:05:32.158125 22485 raft_consensus.cc:3055] T 2b74109013a140ada21feeef92d6f563 P 0473d2b2d01f4459b1e90fd12cc7840e [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:05:32.293642 22485 raft_consensus.cc:740] T 2b74109013a140ada21feeef92d6f563 P 0473d2b2d01f4459b1e90fd12cc7840e [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 0473d2b2d01f4459b1e90fd12cc7840e, State: Running, Role: LEADER
I20260709 13:05:32.294451 22485 consensus_queue.cc:260] T 2b74109013a140ada21feeef92d6f563 P 0473d2b2d01f4459b1e90fd12cc7840e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:32.274873 22271 raft_consensus.cc:515] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P 127766fc592545a4997f7790f50f6076 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:05:32.280975 22295 raft_consensus.cc:2804] T 2b74109013a140ada21feeef92d6f563 P e5256d91808b47c195bc9b4dbd7f2b87 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:05:32.151084 22385 consensus_queue.cc:1048] T 2725d2c4cb054f18b0fc8f735c15f6c2 P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.066s
I20260709 13:05:32.296283 22295 raft_consensus.cc:697] T 2b74109013a140ada21feeef92d6f563 P e5256d91808b47c195bc9b4dbd7f2b87 [term 5 LEADER]: Becoming Leader. State: Replica: e5256d91808b47c195bc9b4dbd7f2b87, State: Running, Role: LEADER
I20260709 13:05:32.148962 22483 raft_consensus.cc:493] T fa8650e71aa14778b3d73721fc50d9fc P 0473d2b2d01f4459b1e90fd12cc7840e [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:32.296938 22271 leader_election.cc:290] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:05:32.297101 22295 consensus_queue.cc:237] T 2b74109013a140ada21feeef92d6f563 P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:32.297643 19478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff9b0eddd810459b82d91c60777c10eb" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:05:32.298300 20103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a16f7501e2444fb86d4e2778e734e02" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076"
I20260709 13:05:32.248528 19484 raft_consensus.cc:1240] T 0cdf56e38bbc453d9438d359e5a69955 P 0473d2b2d01f4459b1e90fd12cc7840e [term 10 FOLLOWER]: Rejecting Update request from peer e5256d91808b47c195bc9b4dbd7f2b87 for earlier term 9. Current term is 10. Ops: [9.6-9.6]
I20260709 13:05:32.282352 22399 consensus_queue.cc:1048] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.017s
W20260709 13:05:32.282931 19525 connection.cc:256] RPC call timeout handler was delayed by -1.0880122500000198s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 1.5s for a response
I20260709 13:05:32.300032 19484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46c5bfeecc314717bffe987e6844b6d0" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 13 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:05:32.279033 19486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed7fdbcb96d14d418db9ca90a792588a" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:05:32.300683 19486 raft_consensus.cc:2468] T ed7fdbcb96d14d418db9ca90a792588a P 0473d2b2d01f4459b1e90fd12cc7840e [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 127766fc592545a4997f7790f50f6076 in term 4.
I20260709 13:05:32.210697 22413 raft_consensus.cc:493] T 4509b76741dc428e9201c70c1658da13 P e61c3a8f61bb48f8a963c9480e53c168 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:32.250970 19485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "309c3ca0ca4b4f3ba129752ea2cb293b" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
W20260709 13:05:32.284454 19483 rpcz_store.cc:269] 0709 13:05:29.988062 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:30.491418 (+503356us) service_pool.cc:224] Handling call
0709 13:05:32.283780 (+1792362us) spinlock_profiling.cc:243] Waited 1.66 s on lock 0x7b5400344754. stack: 00007f4a79de9343 00007f4a79de9240 00007f4a797781d4 00007f4a834b6304 00007f4a834b6299 00007f4a7ce71571 00007f4a7cf0c2fa 00007f4a81ecdb17 00007f4a7b4486d4 00007f4a7b448662 00007f4a7b448591 00007f4a7b44850c 00007f4a7b4477c2 00007f4a7b24348c 00007f4a7b2428c6 00007f4a7b24226f
0709 13:05:32.283885 (+   105us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3827881728}
I20260709 13:05:32.280159 22174 consensus_queue.cc:237] T 775c229504194560ba9589bc2199b089 P 127766fc592545a4997f7790f50f6076 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:05:32.283927 20106 raft_consensus.cc:2410] T 96efeaaf1057492490e9a621f37e1a2d P 127766fc592545a4997f7790f50f6076 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0473d2b2d01f4459b1e90fd12cc7840e for term 8 because replica has last-logged OpId of term: 6 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260709 13:05:32.303319 19551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40e1e16737a842ee936002830f36882e" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:05:32.303880 19551 raft_consensus.cc:3060] T 40e1e16737a842ee936002830f36882e P e61c3a8f61bb48f8a963c9480e53c168 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:05:32.301530 22413 raft_consensus.cc:515] T 4509b76741dc428e9201c70c1658da13 P e61c3a8f61bb48f8a963c9480e53c168 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:32.305089 21957 raft_consensus.cc:515] T ff75a1d4cb1f493db8f71ddc136ba9ab P e5256d91808b47c195bc9b4dbd7f2b87 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:32.305616 22413 leader_election.cc:290] T 4509b76741dc428e9201c70c1658da13 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:05:32.279033 19481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96efeaaf1057492490e9a621f37e1a2d" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:05:32.218166 22372 raft_consensus.cc:515] T 1a61655d99124a29b486ba4a5b37faea P 0473d2b2d01f4459b1e90fd12cc7840e [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:32.306656 19481 raft_consensus.cc:2468] T 96efeaaf1057492490e9a621f37e1a2d P 0473d2b2d01f4459b1e90fd12cc7840e [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 127766fc592545a4997f7790f50f6076 in term 7.
I20260709 13:05:32.288856 19449 leader_election.cc:304] T 1f85fc4b527a48848e5faa083b604e36 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e; no voters: 127766fc592545a4997f7790f50f6076, e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:05:32.205626 19559 raft_consensus.cc:2410] T 2725d2c4cb054f18b0fc8f735c15f6c2 P e61c3a8f61bb48f8a963c9480e53c168 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0473d2b2d01f4459b1e90fd12cc7840e for term 9 because replica has last-logged OpId of term: 8 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 4.
I20260709 13:05:32.160624 22410 raft_consensus.cc:515] T 309c3ca0ca4b4f3ba129752ea2cb293b P 0473d2b2d01f4459b1e90fd12cc7840e [term 7 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } attrs { replace: true } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:05:32.293265 22353 consensus_queue.cc:237] T 2a16f7501e2444fb86d4e2778e734e02 P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:05:32.295670 22485 raft_consensus.cc:3060] T 2b74109013a140ada21feeef92d6f563 P 0473d2b2d01f4459b1e90fd12cc7840e [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:05:32.297338 22483 raft_consensus.cc:515] T fa8650e71aa14778b3d73721fc50d9fc P 0473d2b2d01f4459b1e90fd12cc7840e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:32.185935 22351 raft_consensus.cc:2749] T fa8650e71aa14778b3d73721fc50d9fc P e5256d91808b47c195bc9b4dbd7f2b87 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:05:32.219951 22409 leader_election.cc:290] T edd7d470b5014c9489be7f41f64355c9 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:05:32.215413 22285 consensus_queue.cc:237] T 179fd671030940b4b4a4e24bcc4aba0a P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:32.246455 19482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "775c229504194560ba9589bc2199b089" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:05:32.275077 19377 leader_election.cc:304] T d1e5873a19244c5ebbcd38e126796ee7 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87; no voters: e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:05:32.290529 19479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36f6ba92b9ba46babe4ebd6c02e5fbd9" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:05:32.298786 19478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "179fd671030940b4b4a4e24bcc4aba0a" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:05:32.329840 20112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ece3db938bc649d4a40a51522ed5259c" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:05:32.307046 21957 leader_election.cc:290] T ff75a1d4cb1f493db8f71ddc136ba9ab P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 7 election: Requested vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:05:32.333992 19551 raft_consensus.cc:2468] T 40e1e16737a842ee936002830f36882e P e61c3a8f61bb48f8a963c9480e53c168 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 9.
I20260709 13:05:32.301230 19555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "179fd671030940b4b4a4e24bcc4aba0a" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:05:32.246824 22443 raft_consensus.cc:3055] T a08760e15aac4630a629431f56024dc8 P e5256d91808b47c195bc9b4dbd7f2b87 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:05:32.349272 19558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f575b143b844aa096b50997dad3516a" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:05:32.347939 22480 raft_consensus.cc:2749] T 1f85fc4b527a48848e5faa083b604e36 P 0473d2b2d01f4459b1e90fd12cc7840e [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:05:32.348372 22172 consensus_queue.cc:1048] T 14935b3ddf914369822e4a0547aaa355 P 127766fc592545a4997f7790f50f6076 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.002s
I20260709 13:05:32.350154 22487 leader_election.cc:290] T 2e36a9d6e29c4a7c860cf267efbd4c74 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:05:32.353130 22378 leader_election.cc:290] T 48824d5acfbc485ebf8c2d944e7202de P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:05:32.354992 19552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa731b585f684a7fb2d106c50f143b83" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:05:32.246194 22481 raft_consensus.cc:493] T 28af091831594f9d8e96482078cc7625 P 0473d2b2d01f4459b1e90fd12cc7840e [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:32.533213 20108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ec1c4ce15e04c7e8c283a62179f2a64" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076"
I20260709 13:05:32.367466 20103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "172b3dd13109415a955b71ac0e9d2234" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:05:32.596083 22339 leader_election.cc:290] T 0afb57ae58a24a01850491d69f0213dd P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:05:32.356805 22340 raft_consensus.cc:515] T f93ee515a9c14139bf566522ed8232f3 P e5256d91808b47c195bc9b4dbd7f2b87 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:32.259289 22380 consensus_queue.cc:1059] T 86a6797bdfe94fa496c050ceae4bd0d9 P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 }, Status: INVALID_TERM, Last received: 4.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.342s
W20260709 13:05:32.574503 20075 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.1:40321, user_credentials={real_user=slave}} blocked reactor thread for 321725us
W20260709 13:05:32.367283 19403 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52342 (request call id 2068) took 2319 ms (client timeout 2099 ms). Trace:
I20260709 13:05:32.602758 22340 leader_election.cc:290] T f93ee515a9c14139bf566522ed8232f3 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 10 election: Requested vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
W20260709 13:05:32.602939 19403 rpcz_store.cc:269] 0709 13:05:30.047972 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:30.502980 (+455008us) service_pool.cc:224] Handling call
0709 13:05:32.367047 (+1864067us) spinlock_profiling.cc:243] Waited 1.41 s on lock 0x7b54000b31d4. stack: 00007f4a79de9343 00007f4a79de9240 00007f4a797781d4 00007f4a834b6304 00007f4a834b6299 00007f4a7ce71571 00007f4a7cf0c2fa 00007f4a81ecdb17 00007f4a7b4486d4 00007f4a7b448662 00007f4a7b448591 00007f4a7b44850c 00007f4a7b4477c2 00007f4a7b24348c 00007f4a7b2428c6 00007f4a7b24226f
0709 13:05:32.367201 (+   154us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3245709568}
I20260709 13:05:32.603505 19479 raft_consensus.cc:2376] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P 0473d2b2d01f4459b1e90fd12cc7840e [term 9 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 9. Re-sending same reply.
I20260709 13:05:32.355756 20110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14efcc79969f41babe5529c22d59156d" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:05:32.607154 20110 raft_consensus.cc:2393] T 14efcc79969f41babe5529c22d59156d P 127766fc592545a4997f7790f50f6076 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e5256d91808b47c195bc9b4dbd7f2b87 in current term 8: Already voted for candidate 127766fc592545a4997f7790f50f6076 in this term.
I20260709 13:05:32.365067 20109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4af19371ea874c09a0a2147040835cbb" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076"
I20260709 13:05:32.604375 19560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a61655d99124a29b486ba4a5b37faea" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:05:32.607740 22327 consensus_queue.cc:1059] T 2a16f7501e2444fb86d4e2778e734e02 P 127766fc592545a4997f7790f50f6076 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:05:32.608692 19560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c5eebf646ad445a9d1b1adc319d7b16" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:05:32.608799 22327 consensus_queue.cc:1059] T 5ec1c4ce15e04c7e8c283a62179f2a64 P 127766fc592545a4997f7790f50f6076 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:05:32.609426 19560 raft_consensus.cc:2393] T 6c5eebf646ad445a9d1b1adc319d7b16 P e61c3a8f61bb48f8a963c9480e53c168 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0473d2b2d01f4459b1e90fd12cc7840e in current term 5: Already voted for candidate e61c3a8f61bb48f8a963c9480e53c168 in this term.
I20260709 13:05:32.609946 22350 raft_consensus.cc:3055] T 2a16f7501e2444fb86d4e2778e734e02 P 127766fc592545a4997f7790f50f6076 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:05:32.610157 19560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "179fd671030940b4b4a4e24bcc4aba0a" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:05:32.610319 22350 raft_consensus.cc:740] T 2a16f7501e2444fb86d4e2778e734e02 P 127766fc592545a4997f7790f50f6076 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 127766fc592545a4997f7790f50f6076, State: Running, Role: LEADER
I20260709 13:05:32.611274 22410 leader_election.cc:290] T 309c3ca0ca4b4f3ba129752ea2cb293b P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 7 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:05:32.611320 19560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40e1e16737a842ee936002830f36882e" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:05:32.486492 22398 raft_consensus.cc:493] T 3e1f505cb0f1427bbd698ac889d80821 P e5256d91808b47c195bc9b4dbd7f2b87 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:32.611658 22350 consensus_queue.cc:260] T 2a16f7501e2444fb86d4e2778e734e02 P 127766fc592545a4997f7790f50f6076 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
W20260709 13:05:32.598698 20076 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.3:36891, user_credentials={real_user=slave}} blocked reactor thread for 359799us
I20260709 13:05:32.612680 22350 raft_consensus.cc:3060] T 2a16f7501e2444fb86d4e2778e734e02 P 127766fc592545a4997f7790f50f6076 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:05:32.612517 22398 raft_consensus.cc:515] T 3e1f505cb0f1427bbd698ac889d80821 P e5256d91808b47c195bc9b4dbd7f2b87 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:32.605047 22481 raft_consensus.cc:515] T 28af091831594f9d8e96482078cc7625 P 0473d2b2d01f4459b1e90fd12cc7840e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:32.610837 22179 raft_consensus.cc:3055] T 5ec1c4ce15e04c7e8c283a62179f2a64 P 127766fc592545a4997f7790f50f6076 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:05:32.600823 20103 raft_consensus.cc:2393] T 172b3dd13109415a955b71ac0e9d2234 P 127766fc592545a4997f7790f50f6076 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e5256d91808b47c195bc9b4dbd7f2b87 in current term 5: Already voted for candidate 0473d2b2d01f4459b1e90fd12cc7840e in this term.
I20260709 13:05:32.614751 22443 raft_consensus.cc:740] T a08760e15aac4630a629431f56024dc8 P e5256d91808b47c195bc9b4dbd7f2b87 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: e5256d91808b47c195bc9b4dbd7f2b87, State: Running, Role: LEADER
I20260709 13:05:32.614923 22179 raft_consensus.cc:740] T 5ec1c4ce15e04c7e8c283a62179f2a64 P 127766fc592545a4997f7790f50f6076 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 127766fc592545a4997f7790f50f6076, State: Running, Role: LEADER
I20260709 13:05:32.606072 19375 leader_election.cc:304] T 40e1e16737a842ee936002830f36882e P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:05:32.600841 19552 raft_consensus.cc:2468] T fa731b585f684a7fb2d106c50f143b83 P e61c3a8f61bb48f8a963c9480e53c168 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 6.
I20260709 13:05:32.612262 19560 raft_consensus.cc:2368] T 40e1e16737a842ee936002830f36882e P e61c3a8f61bb48f8a963c9480e53c168 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 0473d2b2d01f4459b1e90fd12cc7840e for earlier term 8. Current term is 9.
W20260709 13:05:32.616111 19377 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.2:46257, user_credentials={real_user=slave}} blocked reactor thread for 341119us
I20260709 13:05:32.616672 19478 raft_consensus.cc:2393] T 179fd671030940b4b4a4e24bcc4aba0a P 0473d2b2d01f4459b1e90fd12cc7840e [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate e5256d91808b47c195bc9b4dbd7f2b87 in current term 7: Already voted for candidate 0473d2b2d01f4459b1e90fd12cc7840e in this term.
I20260709 13:05:32.617157 19403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a08760e15aac4630a629431f56024dc8" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
I20260709 13:05:32.619168 19405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76cb037fc9064d13b59a8969d897ce8c" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:05:32.619285 19553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f575b143b844aa096b50997dad3516a" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:05:32.620129 19410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff9b0eddd810459b82d91c60777c10eb" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
I20260709 13:05:32.620683 19410 raft_consensus.cc:3060] T ff9b0eddd810459b82d91c60777c10eb P e5256d91808b47c195bc9b4dbd7f2b87 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:05:32.265476 19450 leader_election.cc:304] T 21e14947d70440f19044d8f75c31e1f9 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e; no voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168
W20260709 13:05:32.385859 19526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.2:46257, user_credentials={real_user=slave}} blocked reactor thread for 130656us
I20260709 13:05:32.623000 19411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22196caba61445d3bec98a0aab3c337d" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
I20260709 13:05:32.623533 19411 raft_consensus.cc:3060] T 22196caba61445d3bec98a0aab3c337d P e5256d91808b47c195bc9b4dbd7f2b87 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:05:32.618742 19449 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:32.628793 19403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e36a9d6e29c4a7c860cf267efbd4c74" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:05:32.634888 19403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a61655d99124a29b486ba4a5b37faea" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
I20260709 13:05:32.635484 19403 raft_consensus.cc:3060] T 1a61655d99124a29b486ba4a5b37faea P e5256d91808b47c195bc9b4dbd7f2b87 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:05:32.632994 19410 raft_consensus.cc:2468] T ff9b0eddd810459b82d91c60777c10eb P e5256d91808b47c195bc9b4dbd7f2b87 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 5.
I20260709 13:05:32.637327 19410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edd7d470b5014c9489be7f41f64355c9" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:05:32.637964 19410 raft_consensus.cc:2468] T edd7d470b5014c9489be7f41f64355c9 P e5256d91808b47c195bc9b4dbd7f2b87 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 7.
I20260709 13:05:32.639098 19410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4509b76741dc428e9201c70c1658da13" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:05:32.639688 19410 raft_consensus.cc:2468] T 4509b76741dc428e9201c70c1658da13 P e5256d91808b47c195bc9b4dbd7f2b87 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 3.
I20260709 13:05:32.627924 20109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0afb57ae58a24a01850491d69f0213dd" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:05:32.620592 19553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff75a1d4cb1f493db8f71ddc136ba9ab" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:05:32.642171 19553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1efebf73c86e432baa55533136b6e12c" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:05:32.644207 19553 raft_consensus.cc:2468] T 1efebf73c86e432baa55533136b6e12c P e61c3a8f61bb48f8a963c9480e53c168 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 5.
I20260709 13:05:32.646420 19553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e5873a19244c5ebbcd38e126796ee7" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:05:32.626138 20110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "309c3ca0ca4b4f3ba129752ea2cb293b" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076"
I20260709 13:05:32.651087 20110 raft_consensus.cc:3060] T 309c3ca0ca4b4f3ba129752ea2cb293b P 127766fc592545a4997f7790f50f6076 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:05:32.653252 19405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "309c3ca0ca4b4f3ba129752ea2cb293b" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
I20260709 13:05:32.655598 19553 raft_consensus.cc:2393] T d1e5873a19244c5ebbcd38e126796ee7 P e61c3a8f61bb48f8a963c9480e53c168 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0473d2b2d01f4459b1e90fd12cc7840e in current term 9: Already voted for candidate e61c3a8f61bb48f8a963c9480e53c168 in this term.
W20260709 13:05:32.655705 19452 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:32.655588 19449 leader_election.cc:304] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e; no voters: 127766fc592545a4997f7790f50f6076, e5256d91808b47c195bc9b4dbd7f2b87
W20260709 13:05:32.655447 19450 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.3:36891, user_credentials={real_user=slave}} blocked reactor thread for 390075us
I20260709 13:05:32.691411 19405 raft_consensus.cc:3060] T 309c3ca0ca4b4f3ba129752ea2cb293b P e5256d91808b47c195bc9b4dbd7f2b87 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:05:32.668601 20078 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:32.692462 19404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "179fd671030940b4b4a4e24bcc4aba0a" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
I20260709 13:05:32.693737 19404 raft_consensus.cc:2393] T 179fd671030940b4b4a4e24bcc4aba0a P e5256d91808b47c195bc9b4dbd7f2b87 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 0473d2b2d01f4459b1e90fd12cc7840e in current term 7: Already voted for candidate e5256d91808b47c195bc9b4dbd7f2b87 in this term.
W20260709 13:05:32.694466 19374 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:05:32.694823 19375 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.3:36891, user_credentials={real_user=slave}} blocked reactor thread for 88823us
I20260709 13:05:32.695230 19377 leader_election.cc:304] T ff9b0eddd810459b82d91c60777c10eb P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, 127766fc592545a4997f7790f50f6076
W20260709 13:05:32.696277 19526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.2:46257, user_credentials={real_user=slave}} blocked reactor thread for 74021.2us
I20260709 13:05:32.699477 19403 raft_consensus.cc:2468] T 1a61655d99124a29b486ba4a5b37faea P e5256d91808b47c195bc9b4dbd7f2b87 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 5.
I20260709 13:05:32.614538 22398 leader_election.cc:290] T 3e1f505cb0f1427bbd698ac889d80821 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:05:32.573449 22470 raft_consensus.cc:493] T 0e1085d23e8347fbbd5bce7542f4b1f4 P 0473d2b2d01f4459b1e90fd12cc7840e [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 127766fc592545a4997f7790f50f6076)
I20260709 13:05:32.702253 19377 leader_election.cc:304] T 46c5bfeecc314717bffe987e6844b6d0 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:05:32.710382 19559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46c5bfeecc314717bffe987e6844b6d0" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 13 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:05:32.703524 19560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a08760e15aac4630a629431f56024dc8" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:05:32.707280 20103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48824d5acfbc485ebf8c2d944e7202de" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:05:32.708431 19402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40e1e16737a842ee936002830f36882e" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
I20260709 13:05:32.708966 19553 raft_consensus.cc:1240] T 28af091831594f9d8e96482078cc7625 P e61c3a8f61bb48f8a963c9480e53c168 [term 8 FOLLOWER]: Rejecting Update request from peer 0473d2b2d01f4459b1e90fd12cc7840e for earlier term 6. Current term is 8. Ops: []
I20260709 13:05:32.712360 19411 raft_consensus.cc:2468] T 22196caba61445d3bec98a0aab3c337d P e5256d91808b47c195bc9b4dbd7f2b87 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 7.
I20260709 13:05:32.671977 19410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1b10566f45d4a7d9029858330e02d5b" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
W20260709 13:05:32.714279 19449 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.1:40321, user_credentials={real_user=slave}} blocked reactor thread for 58789.7us
I20260709 13:05:32.658450 19406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f93ee515a9c14139bf566522ed8232f3" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 10 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
I20260709 13:05:32.616272 22372 leader_election.cc:290] T 1a61655d99124a29b486ba4a5b37faea P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 5 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:05:32.723609 19553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f93ee515a9c14139bf566522ed8232f3" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 10 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:05:32.740689 19405 raft_consensus.cc:2468] T 309c3ca0ca4b4f3ba129752ea2cb293b P e5256d91808b47c195bc9b4dbd7f2b87 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 7.
I20260709 13:05:32.713294 20103 raft_consensus.cc:2468] T 48824d5acfbc485ebf8c2d944e7202de P 127766fc592545a4997f7790f50f6076 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 7.
I20260709 13:05:32.710599 19526 leader_election.cc:304] T 40e1e16737a842ee936002830f36882e P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:05:32.708211 22251 raft_consensus.cc:2749] T ff9b0eddd810459b82d91c60777c10eb P e5256d91808b47c195bc9b4dbd7f2b87 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:05:32.657521 22254 raft_consensus.cc:2764] T d1e5873a19244c5ebbcd38e126796ee7 P e5256d91808b47c195bc9b4dbd7f2b87 [term 9 FOLLOWER]: Leader pre-election decision vote started in defunct term 8: won
I20260709 13:05:32.724617 19406 raft_consensus.cc:2393] T f93ee515a9c14139bf566522ed8232f3 P e5256d91808b47c195bc9b4dbd7f2b87 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 0473d2b2d01f4459b1e90fd12cc7840e in current term 10: Already voted for candidate e5256d91808b47c195bc9b4dbd7f2b87 in this term.
W20260709 13:05:32.761853 19449 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.1:40321, user_credentials={real_user=slave}} blocked reactor thread for 46552.6us
I20260709 13:05:32.760977 20110 raft_consensus.cc:2468] T 309c3ca0ca4b4f3ba129752ea2cb293b P 127766fc592545a4997f7790f50f6076 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 7.
I20260709 13:05:32.764410 19553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edd7d470b5014c9489be7f41f64355c9" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:05:32.692034 22399 raft_consensus.cc:493] T b9f0d59553ad444883fcf5b5909f9798 P e5256d91808b47c195bc9b4dbd7f2b87 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:32.703145 21957 raft_consensus.cc:2804] T 40e1e16737a842ee936002830f36882e P e5256d91808b47c195bc9b4dbd7f2b87 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:05:32.691780 22480 raft_consensus.cc:2749] T 21e14947d70440f19044d8f75c31e1f9 P 0473d2b2d01f4459b1e90fd12cc7840e [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:05:32.524374 22388 raft_consensus.cc:515] T 46c5bfeecc314717bffe987e6844b6d0 P 0473d2b2d01f4459b1e90fd12cc7840e [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:32.791522 19553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4509b76741dc428e9201c70c1658da13" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:05:32.719134 22391 raft_consensus.cc:2749] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P 0473d2b2d01f4459b1e90fd12cc7840e [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:05:32.825866 19557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4509b76741dc428e9201c70c1658da13" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:05:32.827147 19449 leader_election.cc:304] T 76cb037fc9064d13b59a8969d897ce8c P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e; no voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:05:32.718827 22179 consensus_queue.cc:260] T 5ec1c4ce15e04c7e8c283a62179f2a64 P 127766fc592545a4997f7790f50f6076 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:05:32.761920 22373 raft_consensus.cc:2764] T 40e1e16737a842ee936002830f36882e P e61c3a8f61bb48f8a963c9480e53c168 [term 9 FOLLOWER]: Leader pre-election decision vote started in defunct term 8: won
I20260709 13:05:32.718762 22195 consensus_queue.cc:1059] T 0cdf56e38bbc453d9438d359e5a69955 P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.076s
I20260709 13:05:32.797322 21957 raft_consensus.cc:697] T 40e1e16737a842ee936002830f36882e P e5256d91808b47c195bc9b4dbd7f2b87 [term 9 LEADER]: Becoming Leader. State: Replica: e5256d91808b47c195bc9b4dbd7f2b87, State: Running, Role: LEADER
I20260709 13:05:32.719460 22470 raft_consensus.cc:515] T 0e1085d23e8347fbbd5bce7542f4b1f4 P 0473d2b2d01f4459b1e90fd12cc7840e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
W20260709 13:05:32.799917 22473 log.cc:927] Time spent T b08304a0a02b42d7840c4e8ee9a6bd1a P 0473d2b2d01f4459b1e90fd12cc7840e: Append to log took a long time: real 0.872s	user 0.014s	sys 0.003s
I20260709 13:05:32.786718 22372 consensus_queue.cc:1059] T 775c229504194560ba9589bc2199b089 P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.015s
I20260709 13:05:32.801530 21926 leader_election.cc:290] T 4509b76741dc428e9201c70c1658da13 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 3 election: Requested vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:05:32.801900 22385 raft_consensus.cc:2749] T 46c5bfeecc314717bffe987e6844b6d0 P e5256d91808b47c195bc9b4dbd7f2b87 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:05:32.786360 22251 raft_consensus.cc:493] T 1dc5b3532fe54f74876d02beffa2c230 P e5256d91808b47c195bc9b4dbd7f2b87 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:32.811147 19556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96efeaaf1057492490e9a621f37e1a2d" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:05:32.895423 19556 raft_consensus.cc:2410] T 96efeaaf1057492490e9a621f37e1a2d P e61c3a8f61bb48f8a963c9480e53c168 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0473d2b2d01f4459b1e90fd12cc7840e for term 8 because replica has last-logged OpId of term: 6 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260709 13:05:32.896224 19556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22196caba61445d3bec98a0aab3c337d" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:05:32.897202 19556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff75a1d4cb1f493db8f71ddc136ba9ab" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
W20260709 13:05:32.897848 20076 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.3:36891, user_credentials={real_user=slave}} blocked reactor thread for 284396us
I20260709 13:05:32.898219 19556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4af19371ea874c09a0a2147040835cbb" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:05:32.811897 22483 leader_election.cc:290] T fa8650e71aa14778b3d73721fc50d9fc P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:05:32.792428 22399 raft_consensus.cc:515] T b9f0d59553ad444883fcf5b5909f9798 P e5256d91808b47c195bc9b4dbd7f2b87 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
W20260709 13:05:32.822975 19409 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49050 (request call id 387) took 3378 ms (client timeout 2111 ms). Trace:
W20260709 13:05:32.901381 19409 rpcz_store.cc:269] 0709 13:05:29.444191 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:29.445926 (+  1735us) service_pool.cc:224] Handling call
0709 13:05:32.822727 (+3376801us) spinlock_profiling.cc:243] Waited 2.55 s on lock 0x7b5400064354. stack: 00007f4a79de9343 00007f4a79de9240 00007f4a797781d4 00007f4a834b6304 00007f4a834b6299 00007f4a7ce71571 00007f4a7cf0c2fa 00007f4a81ecdb17 00007f4a7b4486d4 00007f4a7b448662 00007f4a7b448591 00007f4a7b44850c 00007f4a7b4477c2 00007f4a7b24348c 00007f4a7b2428c6 00007f4a7b24226f
0709 13:05:32.822876 (+   149us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5867371264}
I20260709 13:05:32.824342 19560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ece3db938bc649d4a40a51522ed5259c" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:05:32.867000 22365 raft_consensus.cc:2749] T 76cb037fc9064d13b59a8969d897ce8c P 0473d2b2d01f4459b1e90fd12cc7840e [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:05:32.792591 19553 raft_consensus.cc:2468] T 4509b76741dc428e9201c70c1658da13 P e61c3a8f61bb48f8a963c9480e53c168 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 3.
I20260709 13:05:32.829214 19449 leader_election.cc:304] T ff9b0eddd810459b82d91c60777c10eb P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87; no voters: 
I20260709 13:05:32.830971 19557 raft_consensus.cc:1240] T b08304a0a02b42d7840c4e8ee9a6bd1a P e61c3a8f61bb48f8a963c9480e53c168 [term 9 FOLLOWER]: Rejecting Update request from peer e5256d91808b47c195bc9b4dbd7f2b87 for earlier term 8. Current term is 9. Ops: []
I20260709 13:05:32.865041 19559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f93ee515a9c14139bf566522ed8232f3" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 10 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:05:32.868032 19375 leader_election.cc:304] T fa731b585f684a7fb2d106c50f143b83 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:05:32.903357 19553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e36a9d6e29c4a7c860cf267efbd4c74" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:05:32.904382 19553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1b10566f45d4a7d9029858330e02d5b" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
W20260709 13:05:32.904636 19377 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.2:46257, user_credentials={real_user=slave}} blocked reactor thread for 202443us
I20260709 13:05:32.904975 19553 raft_consensus.cc:2468] T f1b10566f45d4a7d9029858330e02d5b P e61c3a8f61bb48f8a963c9480e53c168 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 8.
I20260709 13:05:32.652827 22271 consensus_queue.cc:1048] T ece3db938bc649d4a40a51522ed5259c P 127766fc592545a4997f7790f50f6076 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.213s
I20260709 13:05:32.877331 19552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7be9efa6559648dbb5a0f7684c4542d1" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
W20260709 13:05:32.907917 19449 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.1:40321, user_credentials={real_user=slave}} blocked reactor thread for 78810.2us
I20260709 13:05:32.908878 19449 leader_election.cc:304] T edd7d470b5014c9489be7f41f64355c9 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87; no voters: 
I20260709 13:05:32.909870 19449 leader_election.cc:304] T 4509b76741dc428e9201c70c1658da13 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87; no voters: 
I20260709 13:05:32.912163 19449 leader_election.cc:304] T 1a61655d99124a29b486ba4a5b37faea P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87; no voters: 
I20260709 13:05:32.900475 19556 raft_consensus.cc:3060] T 4af19371ea874c09a0a2147040835cbb P e61c3a8f61bb48f8a963c9480e53c168 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:05:32.905756 19553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e1f505cb0f1427bbd698ac889d80821" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:05:32.913782 19553 raft_consensus.cc:2468] T 3e1f505cb0f1427bbd698ac889d80821 P e61c3a8f61bb48f8a963c9480e53c168 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 7.
I20260709 13:05:32.914907 19553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f93ee515a9c14139bf566522ed8232f3" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 10 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
W20260709 13:05:32.879118 19450 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.3:36891, user_credentials={real_user=slave}} blocked reactor thread for 94163.6us
W20260709 13:05:32.878860 22064 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.584s	user 0.031s	sys 0.051s
I20260709 13:05:32.902612 19560 raft_consensus.cc:2468] T ece3db938bc649d4a40a51522ed5259c P e61c3a8f61bb48f8a963c9480e53c168 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 7.
W20260709 13:05:32.919067 20076 leader_election.cc:336] T 70797e5783b5454ab0d0eea663e791e3 P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891): Timed out: RequestConsensusVote RPC to 127.17.223.3:36891 timed out after 1.820s (SENT)
I20260709 13:05:32.917603 19375 leader_election.cc:304] T 3e1f505cb0f1427bbd698ac889d80821 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:05:32.919252 19557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc225c93219c45538b53a1bd3d387e4d" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:05:32.919538 20076 leader_election.cc:304] T 70797e5783b5454ab0d0eea663e791e3 P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 127766fc592545a4997f7790f50f6076; no voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:05:32.905959 19377 leader_election.cc:304] T 309c3ca0ca4b4f3ba129752ea2cb293b P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 127766fc592545a4997f7790f50f6076, e5256d91808b47c195bc9b4dbd7f2b87; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:05:32.919858 19557 raft_consensus.cc:3060] T bc225c93219c45538b53a1bd3d387e4d P e61c3a8f61bb48f8a963c9480e53c168 [term 8 FOLLOWER]: Advancing to term 10
I20260709 13:05:32.922464 19482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4509b76741dc428e9201c70c1658da13" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:05:32.922833 19485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc225c93219c45538b53a1bd3d387e4d" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:05:32.923555 19479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40e1e16737a842ee936002830f36882e" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:05:32.924122 19479 raft_consensus.cc:3060] T 40e1e16737a842ee936002830f36882e P 0473d2b2d01f4459b1e90fd12cc7840e [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:05:32.924391 19477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ec1c4ce15e04c7e8c283a62179f2a64" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:05:32.901961 22179 raft_consensus.cc:3060] T 5ec1c4ce15e04c7e8c283a62179f2a64 P 127766fc592545a4997f7790f50f6076 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:05:32.923493 19485 raft_consensus.cc:2468] T bc225c93219c45538b53a1bd3d387e4d P 0473d2b2d01f4459b1e90fd12cc7840e [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 9.
I20260709 13:05:32.776144 22443 consensus_queue.cc:260] T a08760e15aac4630a629431f56024dc8 P e5256d91808b47c195bc9b4dbd7f2b87 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:32.991900 19477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7be9efa6559648dbb5a0f7684c4542d1" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
W20260709 13:05:32.983009 20076 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.3:36891, user_credentials={real_user=slave}} blocked reactor thread for 63968.3us
I20260709 13:05:32.994210 19560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48824d5acfbc485ebf8c2d944e7202de" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:05:32.998914 19478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f575b143b844aa096b50997dad3516a" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:05:32.999351 19560 raft_consensus.cc:2468] T 48824d5acfbc485ebf8c2d944e7202de P e61c3a8f61bb48f8a963c9480e53c168 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 7.
I20260709 13:05:32.999733 22388 leader_election.cc:290] T 46c5bfeecc314717bffe987e6844b6d0 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 13 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:05:33.000192 19560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a61655d99124a29b486ba4a5b37faea" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:05:32.903693 22251 raft_consensus.cc:515] T 1dc5b3532fe54f74876d02beffa2c230 P e5256d91808b47c195bc9b4dbd7f2b87 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:33.004479 22251 leader_election.cc:290] T 1dc5b3532fe54f74876d02beffa2c230 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:05:33.005093 22251 consensus_queue.cc:1059] T b08304a0a02b42d7840c4e8ee9a6bd1a P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:05:33.005833 22251 raft_consensus.cc:2804] T 3e1f505cb0f1427bbd698ac889d80821 P e5256d91808b47c195bc9b4dbd7f2b87 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:05:33.006146 22251 raft_consensus.cc:493] T 3e1f505cb0f1427bbd698ac889d80821 P e5256d91808b47c195bc9b4dbd7f2b87 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:32.921190 22374 raft_consensus.cc:2804] T fa731b585f684a7fb2d106c50f143b83 P e5256d91808b47c195bc9b4dbd7f2b87 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:05:33.006888 22374 raft_consensus.cc:493] T fa731b585f684a7fb2d106c50f143b83 P e5256d91808b47c195bc9b4dbd7f2b87 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 127766fc592545a4997f7790f50f6076)
I20260709 13:05:33.007004 19485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14efcc79969f41babe5529c22d59156d" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:05:33.007412 22374 raft_consensus.cc:3060] T fa731b585f684a7fb2d106c50f143b83 P e5256d91808b47c195bc9b4dbd7f2b87 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:05:33.007711 19485 raft_consensus.cc:2468] T 14efcc79969f41babe5529c22d59156d P 0473d2b2d01f4459b1e90fd12cc7840e [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 7.
I20260709 13:05:33.009192 19478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff75a1d4cb1f493db8f71ddc136ba9ab" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:05:33.009730 21962 raft_consensus.cc:2749] T 309c3ca0ca4b4f3ba129752ea2cb293b P e5256d91808b47c195bc9b4dbd7f2b87 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:05:33.010629 19478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f93ee515a9c14139bf566522ed8232f3" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 10 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:05:33.011071 21962 raft_consensus.cc:3055] T b08304a0a02b42d7840c4e8ee9a6bd1a P e5256d91808b47c195bc9b4dbd7f2b87 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:05:32.894833 22049 raft_consensus.cc:493] T 775c229504194560ba9589bc2199b089 P e5256d91808b47c195bc9b4dbd7f2b87 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:33.011384 19478 raft_consensus.cc:2393] T f93ee515a9c14139bf566522ed8232f3 P 0473d2b2d01f4459b1e90fd12cc7840e [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate e5256d91808b47c195bc9b4dbd7f2b87 in current term 10: Already voted for candidate 0473d2b2d01f4459b1e90fd12cc7840e in this term.
I20260709 13:05:33.011232 21957 consensus_queue.cc:237] T 40e1e16737a842ee936002830f36882e P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:33.011740 22049 raft_consensus.cc:515] T 775c229504194560ba9589bc2199b089 P e5256d91808b47c195bc9b4dbd7f2b87 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:05:33.012624 19480 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58294 (request call id 1800) took 2665 ms. Trace:
I20260709 13:05:33.013971 22049 leader_election.cc:290] T 775c229504194560ba9589bc2199b089 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:05:33.013041 19480 rpcz_store.cc:276] 0709 13:05:30.347674 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:31.773927 (+1426253us) service_pool.cc:224] Handling call
0709 13:05:31.774270 (+   343us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:05:31.774593 (+   323us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:05:31.774624 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:05:31.775056 (+   432us) log.cc:844] Serialized 26 byte log entry
0709 13:05:31.878057 (+103001us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:05:31.897519 (+ 19462us) log.cc:844] Serialized 14 byte log entry
0709 13:05:32.192472 (+294953us) spinlock_profiling.cc:243] Waited 11.5 ms on lock 0x7b18003771a0. stack: 00007f4a79de9343 00007f4a79de9240 00007f4a797781d4 00007f4a834b6304 00007f4a834b6299 00007f4a82ce3de1 00007f4a82cf05b1 00007f4a79dfde07 00007f4a82c58ab9 00007f4a79e1a69b 00007f4a79e1893f 00007f4a79e18455 00007f4a7cf00060 00007f4a7cf12716 00007f4a7cf23287 00007f4a7cf23208
0709 13:05:32.364793 (+172321us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:32.364885 (+    92us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:05:32.797958 (+433073us) spinlock_profiling.cc:243] Waited 5.55 ms on lock 0x7b18003771a0. stack: 00007f4a79de9343 00007f4a79de9240 00007f4a797781d4 00007f4a834b6304 00007f4a834b6299 00007f4a82ce3de1 00007f4a82cf05b1 00007f4a79de92a6 00007f4a79de9240 00007f4a797781d4 00007f4a834b6304 00007f4a834b6299 00007f4a79ca3db1 00007f4a79d41c85 00007f4a79d426a2 00007f4a7cab41db
0709 13:05:32.799405 (+  1447us) spinlock_profiling.cc:243] Waited 5.53 ms on lock 0x7b4400022b4c. stack: 00007f4a79de9343 00007f4a79de9240 00007f4a797781d4 00007f4a834b6304 00007f4a834b6299 00007f4a79ca3db1 00007f4a79d41c85 00007f4a79d426a2 00007f4a7cab41db 00007f4a7caafaaf 00007f4a7caa386e 00007f4a7caa2bb6 00007f4a7caa27d8 00007f4a7caac221 00007f4a7caac1d9 00007f4a7caac169
0709 13:05:32.804412 (+  5007us) spinlock_profiling.cc:243] Waited 2.82 ms on lock 0x7b18003771a0. stack: 00007f4a79de9343 00007f4a79de9240 00007f4a797781d4 00007f4a834b6304 00007f4a834b6299 00007f4a82ce3de1 00007f4a82cf05b1 00007f4a79e1b522 00007f4a79e1d7c1 00007f4a79e1d779 00007f4a79e1d709 00007f4a79e1d6d1 00007f4a79e1c9cd 000000000038f354 000000000038f199 00007f4a79dfe83a
0709 13:05:33.012411 (+207999us) raft_consensus.cc:1685] finished
0709 13:05:33.012430 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:33.012549 (+   119us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":28730,"prepare.queue_time_us":19458,"prepare.run_cpu_time_us":62,"prepare.run_wall_time_us":7382,"raft.queue_time_us":37739,"raft.run_cpu_time_us":218,"raft.run_wall_time_us":8193,"spinlock_wait_cycles":58519168,"thread_start_us":274809,"threads_started":2,"wal-append.queue_time_us":124795}
I20260709 13:05:33.017896 19558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cdf56e38bbc453d9438d359e5a69955" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:05:33.018770 22470 leader_election.cc:290] T 0e1085d23e8347fbbd5bce7542f4b1f4 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:05:33.019084 19558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dc5b3532fe54f74876d02beffa2c230" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:05:33.019629 19558 raft_consensus.cc:2376] T 1dc5b3532fe54f74876d02beffa2c230 P e61c3a8f61bb48f8a963c9480e53c168 [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 6. Re-sending same reply.
I20260709 13:05:33.019838 19480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e1f505cb0f1427bbd698ac889d80821" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:05:33.020454 19558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "309c3ca0ca4b4f3ba129752ea2cb293b" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:05:33.020547 19555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22196caba61445d3bec98a0aab3c337d" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:05:33.021412 19480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9962423cb4e54fcfa5de01daf68a86e7" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:05:33.021549 19555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed7fdbcb96d14d418db9ca90a792588a" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:05:33.022058 19480 raft_consensus.cc:3060] T 9962423cb4e54fcfa5de01daf68a86e7 P 0473d2b2d01f4459b1e90fd12cc7840e [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:05:33.023068 22443 raft_consensus.cc:3060] T a08760e15aac4630a629431f56024dc8 P e5256d91808b47c195bc9b4dbd7f2b87 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:05:33.023639 19479 raft_consensus.cc:2468] T 40e1e16737a842ee936002830f36882e P 0473d2b2d01f4459b1e90fd12cc7840e [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 9.
I20260709 13:05:33.006466 22251 raft_consensus.cc:3060] T 3e1f505cb0f1427bbd698ac889d80821 P e5256d91808b47c195bc9b4dbd7f2b87 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:05:33.027753 19555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14935b3ddf914369822e4a0547aaa355" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:05:33.028367 19555 raft_consensus.cc:2468] T 14935b3ddf914369822e4a0547aaa355 P e61c3a8f61bb48f8a963c9480e53c168 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 6.
I20260709 13:05:33.028620 19480 raft_consensus.cc:2468] T 9962423cb4e54fcfa5de01daf68a86e7 P 0473d2b2d01f4459b1e90fd12cc7840e [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 127766fc592545a4997f7790f50f6076 in term 11.
W20260709 13:05:32.982498 19375 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.3:36891, user_credentials={real_user=slave}} blocked reactor thread for 57250.3us
I20260709 13:05:32.990211 19557 raft_consensus.cc:2468] T bc225c93219c45538b53a1bd3d387e4d P e61c3a8f61bb48f8a963c9480e53c168 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 10.
W20260709 13:05:32.925083 22064 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.624s	user 0.031s	sys 0.052s
I20260709 13:05:32.983636 19481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "179fd671030940b4b4a4e24bcc4aba0a" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:05:32.995651 19483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc225c93219c45538b53a1bd3d387e4d" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:05:32.908233 22483 raft_consensus.cc:3055] T 775c229504194560ba9589bc2199b089 P 0473d2b2d01f4459b1e90fd12cc7840e [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:05:33.029209 19555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0afb57ae58a24a01850491d69f0213dd" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:05:33.030071 20106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70797e5783b5454ab0d0eea663e791e3" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:05:33.031124 20110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14935b3ddf914369822e4a0547aaa355" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 7 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:05:33.034085 20078 leader_election.cc:304] T ed7fdbcb96d14d418db9ca90a792588a P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, 127766fc592545a4997f7790f50f6076; no voters: 
W20260709 13:05:33.037218 20076 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:32.921228 19449 leader_election.cc:304] T 22196caba61445d3bec98a0aab3c337d P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87; no voters: 
I20260709 13:05:33.037933 20112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4af19371ea874c09a0a2147040835cbb" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:05:33.039342 20103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a16f7501e2444fb86d4e2778e734e02" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:05:32.922245 19377 leader_election.cc:304] T 179fd671030940b4b4a4e24bcc4aba0a P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:05:33.040011 19477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab43d85f64114d4ebf618930e43d9ed0" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:05:32.991001 22369 raft_consensus.cc:2804] T edd7d470b5014c9489be7f41f64355c9 P 0473d2b2d01f4459b1e90fd12cc7840e [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 13:05:33.042835 19375 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:32.990859 22490 raft_consensus.cc:2804] T 4509b76741dc428e9201c70c1658da13 P 0473d2b2d01f4459b1e90fd12cc7840e [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:05:33.151108 19483 raft_consensus.cc:3060] T bc225c93219c45538b53a1bd3d387e4d P 0473d2b2d01f4459b1e90fd12cc7840e [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:05:33.148326 19411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "179fd671030940b4b4a4e24bcc4aba0a" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
I20260709 13:05:33.151468 19477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36f6ba92b9ba46babe4ebd6c02e5fbd9" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:05:33.151561 20111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c5eebf646ad445a9d1b1adc319d7b16" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076"
I20260709 13:05:33.151973 19411 raft_consensus.cc:2368] T 179fd671030940b4b4a4e24bcc4aba0a P e5256d91808b47c195bc9b4dbd7f2b87 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate e61c3a8f61bb48f8a963c9480e53c168 for earlier term 6. Current term is 7.
I20260709 13:05:33.152367 19557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "179fd671030940b4b4a4e24bcc4aba0a" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:05:33.153052 19411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70797e5783b5454ab0d0eea663e791e3" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:05:32.986308 22174 raft_consensus.cc:2749] T 70797e5783b5454ab0d0eea663e791e3 P 127766fc592545a4997f7790f50f6076 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:05:33.149855 20076 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:33.147521 19555 raft_consensus.cc:2468] T 0afb57ae58a24a01850491d69f0213dd P e61c3a8f61bb48f8a963c9480e53c168 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 7.
W20260709 13:05:33.146090 19526 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:33.154881 20103 raft_consensus.cc:2468] T 2a16f7501e2444fb86d4e2778e734e02 P 127766fc592545a4997f7790f50f6076 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 8.
I20260709 13:05:33.043704 19556 raft_consensus.cc:2468] T 4af19371ea874c09a0a2147040835cbb P e61c3a8f61bb48f8a963c9480e53c168 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 5.
I20260709 13:05:32.991102 22372 raft_consensus.cc:2804] T ff9b0eddd810459b82d91c60777c10eb P 0473d2b2d01f4459b1e90fd12cc7840e [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:05:33.155576 19481 raft_consensus.cc:2393] T 179fd671030940b4b4a4e24bcc4aba0a P 0473d2b2d01f4459b1e90fd12cc7840e [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e5256d91808b47c195bc9b4dbd7f2b87 in current term 7: Already voted for candidate 0473d2b2d01f4459b1e90fd12cc7840e in this term.
I20260709 13:05:33.049661 20109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65d8cb8d6ec64f459d5a47cefab10acf" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:05:33.158478 19411 raft_consensus.cc:1240] T ff9b0eddd810459b82d91c60777c10eb P e5256d91808b47c195bc9b4dbd7f2b87 [term 5 FOLLOWER]: Rejecting Update request from peer 127766fc592545a4997f7790f50f6076 for earlier term 4. Current term is 5. Ops: []
I20260709 13:05:33.178476 19404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e381f1d6b8184797ad142de49be225a8" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:05:33.179936 19404 raft_consensus.cc:2468] T e381f1d6b8184797ad142de49be225a8 P e5256d91808b47c195bc9b4dbd7f2b87 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 5.
I20260709 13:05:33.180404 19411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "217b5fae677b4971b3bbd2f357a1f7ff" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:05:33.153545 19557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f93ee515a9c14139bf566522ed8232f3" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 10 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:05:33.181154 19411 raft_consensus.cc:2468] T 217b5fae677b4971b3bbd2f357a1f7ff P e5256d91808b47c195bc9b4dbd7f2b87 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 4.
W20260709 13:05:33.168006 19449 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.1:40321, user_credentials={real_user=slave}} blocked reactor thread for 246840us
W20260709 13:05:33.168164 20078 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.2:46257, user_credentials={real_user=slave}} blocked reactor thread for 134158us
I20260709 13:05:33.168512 19403 raft_consensus.cc:1240] T ab43d85f64114d4ebf618930e43d9ed0 P e5256d91808b47c195bc9b4dbd7f2b87 [term 6 FOLLOWER]: Rejecting Update request from peer e61c3a8f61bb48f8a963c9480e53c168 for earlier term 5. Current term is 6. Ops: []
I20260709 13:05:32.991219 22391 raft_consensus.cc:2804] T 1a61655d99124a29b486ba4a5b37faea P 0473d2b2d01f4459b1e90fd12cc7840e [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:05:33.113689 19478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14efcc79969f41babe5529c22d59156d" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:05:33.183301 19449 leader_election.cc:304] T 172b3dd13109415a955b71ac0e9d2234 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, 127766fc592545a4997f7790f50f6076; no voters: e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:05:33.011788 22399 leader_election.cc:290] T b9f0d59553ad444883fcf5b5909f9798 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:05:33.182404 19411 raft_consensus.cc:1240] T 833a2f0775ed407a94b8924ce50adb63 P e5256d91808b47c195bc9b4dbd7f2b87 [term 7 LEADER]: Rejecting Update request from peer 127766fc592545a4997f7790f50f6076 for earlier term 6. Current term is 7. Ops: []
W20260709 13:05:33.149943 22295 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.549s	user 0.011s	sys 0.027s
I20260709 13:05:33.037642 21962 raft_consensus.cc:740] T b08304a0a02b42d7840c4e8ee9a6bd1a P e5256d91808b47c195bc9b4dbd7f2b87 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: e5256d91808b47c195bc9b4dbd7f2b87, State: Running, Role: LEADER
I20260709 13:05:33.178804 19407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36f6ba92b9ba46babe4ebd6c02e5fbd9" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:05:33.192909 19403 raft_consensus.cc:1240] T 309c3ca0ca4b4f3ba129752ea2cb293b P e5256d91808b47c195bc9b4dbd7f2b87 [term 7 FOLLOWER]: Rejecting Update request from peer e61c3a8f61bb48f8a963c9480e53c168 for earlier term 6. Current term is 7. Ops: []
I20260709 13:05:33.193476 19409 raft_consensus.cc:1240] T 4af19371ea874c09a0a2147040835cbb P e5256d91808b47c195bc9b4dbd7f2b87 [term 5 FOLLOWER]: Rejecting Update request from peer 127766fc592545a4997f7790f50f6076 for earlier term 4. Current term is 5. Ops: []
I20260709 13:05:33.186331 19478 raft_consensus.cc:3060] T 14efcc79969f41babe5529c22d59156d P 0473d2b2d01f4459b1e90fd12cc7840e [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:05:33.149544 22369 raft_consensus.cc:493] T edd7d470b5014c9489be7f41f64355c9 P 0473d2b2d01f4459b1e90fd12cc7840e [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:33.147011 22483 raft_consensus.cc:740] T 775c229504194560ba9589bc2199b089 P 0473d2b2d01f4459b1e90fd12cc7840e [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 0473d2b2d01f4459b1e90fd12cc7840e, State: Running, Role: LEADER
W20260709 13:05:33.155237 22285 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.551s	user 0.009s	sys 0.020s
I20260709 13:05:33.208779 20078 leader_election.cc:304] T 9962423cb4e54fcfa5de01daf68a86e7 P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, 127766fc592545a4997f7790f50f6076; no voters: e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:05:33.210503 19483 raft_consensus.cc:2468] T bc225c93219c45538b53a1bd3d387e4d P 0473d2b2d01f4459b1e90fd12cc7840e [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 10.
I20260709 13:05:33.217092 19403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1b10566f45d4a7d9029858330e02d5b" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
W20260709 13:05:33.198258 22295 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.602s	user 0.011s	sys 0.028s
I20260709 13:05:33.225392 19403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a16f7501e2444fb86d4e2778e734e02" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:05:33.215502 19449 leader_election.cc:304] T 48824d5acfbc485ebf8c2d944e7202de P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, 127766fc592545a4997f7790f50f6076; no voters: 
I20260709 13:05:33.179078 22368 raft_consensus.cc:2804] T ed7fdbcb96d14d418db9ca90a792588a P 127766fc592545a4997f7790f50f6076 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:05:33.227489 19449 leader_election.cc:304] T 309c3ca0ca4b4f3ba129752ea2cb293b P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, 127766fc592545a4997f7790f50f6076, e5256d91808b47c195bc9b4dbd7f2b87; no voters: 
W20260709 13:05:33.222857 22285 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.614s	user 0.009s	sys 0.020s
W20260709 13:05:33.223564 19452 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:33.199062 22470 raft_consensus.cc:2804] T 172b3dd13109415a955b71ac0e9d2234 P 0473d2b2d01f4459b1e90fd12cc7840e [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:05:33.167534 22490 raft_consensus.cc:493] T 4509b76741dc428e9201c70c1658da13 P 0473d2b2d01f4459b1e90fd12cc7840e [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:33.233091 19409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14935b3ddf914369822e4a0547aaa355" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 7 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:05:33.203104 20108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ece3db938bc649d4a40a51522ed5259c" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:05:33.192898 22365 raft_consensus.cc:2804] T 22196caba61445d3bec98a0aab3c337d P 0473d2b2d01f4459b1e90fd12cc7840e [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:05:33.244014 19483 raft_consensus.cc:1240] T 46c5bfeecc314717bffe987e6844b6d0 P 0473d2b2d01f4459b1e90fd12cc7840e [term 13 FOLLOWER]: Rejecting Update request from peer e61c3a8f61bb48f8a963c9480e53c168 for earlier term 12. Current term is 13. Ops: [12.5-12.5]
I20260709 13:05:33.202564 22399 raft_consensus.cc:493] T 217b5fae677b4971b3bbd2f357a1f7ff P e5256d91808b47c195bc9b4dbd7f2b87 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 0473d2b2d01f4459b1e90fd12cc7840e)
I20260709 13:05:33.202338 22372 raft_consensus.cc:697] T ff9b0eddd810459b82d91c60777c10eb P 0473d2b2d01f4459b1e90fd12cc7840e [term 5 LEADER]: Becoming Leader. State: Replica: 0473d2b2d01f4459b1e90fd12cc7840e, State: Running, Role: LEADER
I20260709 13:05:33.215526 22369 raft_consensus.cc:3060] T edd7d470b5014c9489be7f41f64355c9 P 0473d2b2d01f4459b1e90fd12cc7840e [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:05:33.254467 20109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e1085d23e8347fbbd5bce7542f4b1f4" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:05:33.211966 22391 raft_consensus.cc:697] T 1a61655d99124a29b486ba4a5b37faea P 0473d2b2d01f4459b1e90fd12cc7840e [term 5 LEADER]: Becoming Leader. State: Replica: 0473d2b2d01f4459b1e90fd12cc7840e, State: Running, Role: LEADER
I20260709 13:05:33.256366 19403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65d8cb8d6ec64f459d5a47cefab10acf" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:05:33.224371 22174 raft_consensus.cc:2804] T 9962423cb4e54fcfa5de01daf68a86e7 P 127766fc592545a4997f7790f50f6076 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:05:33.273978 22340 raft_consensus.cc:2749] T 179fd671030940b4b4a4e24bcc4aba0a P e5256d91808b47c195bc9b4dbd7f2b87 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:05:33.276479 22174 raft_consensus.cc:697] T 9962423cb4e54fcfa5de01daf68a86e7 P 127766fc592545a4997f7790f50f6076 [term 11 LEADER]: Becoming Leader. State: Replica: 127766fc592545a4997f7790f50f6076, State: Running, Role: LEADER
I20260709 13:05:33.277141 19409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2725d2c4cb054f18b0fc8f735c15f6c2" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:05:33.241128 22388 raft_consensus.cc:2804] T 48824d5acfbc485ebf8c2d944e7202de P 0473d2b2d01f4459b1e90fd12cc7840e [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:05:33.253703 22487 raft_consensus.cc:493] T b9f0d59553ad444883fcf5b5909f9798 P 0473d2b2d01f4459b1e90fd12cc7840e [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:33.284260 19403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e1f505cb0f1427bbd698ac889d80821" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
I20260709 13:05:33.239372 22368 raft_consensus.cc:493] T ed7fdbcb96d14d418db9ca90a792588a P 127766fc592545a4997f7790f50f6076 [term 4 FOLLOWER]: Starting leader election (detected failure of leader e61c3a8f61bb48f8a963c9480e53c168)
I20260709 13:05:33.245652 22339 raft_consensus.cc:2804] T 309c3ca0ca4b4f3ba129752ea2cb293b P 0473d2b2d01f4459b1e90fd12cc7840e [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:05:33.287492 19407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4af19371ea874c09a0a2147040835cbb" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:05:33.297928 19478 raft_consensus.cc:2468] T 14efcc79969f41babe5529c22d59156d P 0473d2b2d01f4459b1e90fd12cc7840e [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 127766fc592545a4997f7790f50f6076 in term 8.
I20260709 13:05:33.298310 19407 raft_consensus.cc:2393] T 4af19371ea874c09a0a2147040835cbb P e5256d91808b47c195bc9b4dbd7f2b87 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e61c3a8f61bb48f8a963c9480e53c168 in current term 5: Already voted for candidate e5256d91808b47c195bc9b4dbd7f2b87 in this term.
I20260709 13:05:33.224200 22485 consensus_queue.cc:1059] T 775c229504194560ba9589bc2199b089 P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.051s
I20260709 13:05:33.311205 19409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9f0d59553ad444883fcf5b5909f9798" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
I20260709 13:05:33.312486 19409 raft_consensus.cc:2410] T b9f0d59553ad444883fcf5b5909f9798 P e5256d91808b47c195bc9b4dbd7f2b87 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate e61c3a8f61bb48f8a963c9480e53c168 for term 8 because replica has last-logged OpId of term: 7 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
I20260709 13:05:33.247270 22490 raft_consensus.cc:3060] T 4509b76741dc428e9201c70c1658da13 P 0473d2b2d01f4459b1e90fd12cc7840e [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:05:33.311421 19483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4509b76741dc428e9201c70c1658da13" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:05:33.267334 21962 consensus_queue.cc:260] T b08304a0a02b42d7840c4e8ee9a6bd1a P e5256d91808b47c195bc9b4dbd7f2b87 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:33.318255 21962 raft_consensus.cc:3060] T b08304a0a02b42d7840c4e8ee9a6bd1a P e5256d91808b47c195bc9b4dbd7f2b87 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:05:33.317677 22174 consensus_queue.cc:237] T 9962423cb4e54fcfa5de01daf68a86e7 P 127766fc592545a4997f7790f50f6076 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:05:33.319482 19478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b08304a0a02b42d7840c4e8ee9a6bd1a" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
W20260709 13:05:33.320428 22502 log.cc:927] Time spent T 775c229504194560ba9589bc2199b089 P 127766fc592545a4997f7790f50f6076: Append to log took a long time: real 0.074s	user 0.000s	sys 0.001s
I20260709 13:05:33.322160 19409 raft_consensus.cc:1240] T fa8650e71aa14778b3d73721fc50d9fc P e5256d91808b47c195bc9b4dbd7f2b87 [term 8 FOLLOWER]: Rejecting Update request from peer e61c3a8f61bb48f8a963c9480e53c168 for earlier term 7. Current term is 8. Ops: []
I20260709 13:05:33.326015 22481 leader_election.cc:290] T 28af091831594f9d8e96482078cc7625 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:05:33.331184 22111 raft_consensus.cc:3055] T 833a2f0775ed407a94b8924ce50adb63 P 127766fc592545a4997f7790f50f6076 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:05:33.333832 19551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e1f505cb0f1427bbd698ac889d80821" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:05:33.354754 19551 raft_consensus.cc:2393] T 3e1f505cb0f1427bbd698ac889d80821 P e61c3a8f61bb48f8a963c9480e53c168 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 0473d2b2d01f4459b1e90fd12cc7840e in current term 7: Already voted for candidate e61c3a8f61bb48f8a963c9480e53c168 in this term.
I20260709 13:05:33.333948 22251 raft_consensus.cc:515] T 3e1f505cb0f1427bbd698ac889d80821 P e5256d91808b47c195bc9b4dbd7f2b87 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:33.347327 22373 raft_consensus.cc:493] T 833a2f0775ed407a94b8924ce50adb63 P e61c3a8f61bb48f8a963c9480e53c168 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:33.347059 22391 consensus_queue.cc:237] T 1a61655d99124a29b486ba4a5b37faea P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:33.354206 22111 raft_consensus.cc:740] T 833a2f0775ed407a94b8924ce50adb63 P 127766fc592545a4997f7790f50f6076 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 127766fc592545a4997f7790f50f6076, State: Running, Role: LEADER
I20260709 13:05:33.322052 19411 raft_consensus.cc:1240] T 22196caba61445d3bec98a0aab3c337d P e5256d91808b47c195bc9b4dbd7f2b87 [term 7 FOLLOWER]: Rejecting Update request from peer e61c3a8f61bb48f8a963c9480e53c168 for earlier term 6. Current term is 7. Ops: []
I20260709 13:05:33.365516 22111 consensus_queue.cc:260] T 833a2f0775ed407a94b8924ce50adb63 P 127766fc592545a4997f7790f50f6076 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:05:33.274926 22365 raft_consensus.cc:697] T 22196caba61445d3bec98a0aab3c337d P 0473d2b2d01f4459b1e90fd12cc7840e [term 7 LEADER]: Becoming Leader. State: Replica: 0473d2b2d01f4459b1e90fd12cc7840e, State: Running, Role: LEADER
I20260709 13:05:33.275786 22399 raft_consensus.cc:515] T 217b5fae677b4971b3bbd2f357a1f7ff P e5256d91808b47c195bc9b4dbd7f2b87 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:33.367436 22365 consensus_queue.cc:237] T 22196caba61445d3bec98a0aab3c337d P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:33.368708 22399 leader_election.cc:290] T 217b5fae677b4971b3bbd2f357a1f7ff P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:05:33.312529 22368 raft_consensus.cc:3060] T ed7fdbcb96d14d418db9ca90a792588a P 127766fc592545a4997f7790f50f6076 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:05:33.338294 22114 raft_consensus.cc:3055] T 86a6797bdfe94fa496c050ceae4bd0d9 P e61c3a8f61bb48f8a963c9480e53c168 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:05:33.284317 22388 raft_consensus.cc:493] T 48824d5acfbc485ebf8c2d944e7202de P 0473d2b2d01f4459b1e90fd12cc7840e [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:33.362501 22374 raft_consensus.cc:515] T fa731b585f684a7fb2d106c50f143b83 P e5256d91808b47c195bc9b4dbd7f2b87 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:05:33.372311 19407 raft_consensus.cc:1275] T 46c5bfeecc314717bffe987e6844b6d0 P e5256d91808b47c195bc9b4dbd7f2b87 [term 12 FOLLOWER]: Refusing update from remote peer e61c3a8f61bb48f8a963c9480e53c168: Log matching property violated. Preceding OpId in replica: term: 9 index: 4. Preceding OpId from leader: term: 12 index: 5. (index mismatch)
I20260709 13:05:33.387669 19558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2725d2c4cb054f18b0fc8f735c15f6c2" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:05:33.289122 22380 raft_consensus.cc:493] T 85c494af21f9457a85da47b9bc70c1fd P e61c3a8f61bb48f8a963c9480e53c168 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader e5256d91808b47c195bc9b4dbd7f2b87)
I20260709 13:05:33.256749 22295 consensus_queue.cc:1059] T 9962423cb4e54fcfa5de01daf68a86e7 P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.092s
I20260709 13:05:33.429105 20111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa731b585f684a7fb2d106c50f143b83" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:05:33.431151 19553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dc5b3532fe54f74876d02beffa2c230" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:05:33.431770 19553 raft_consensus.cc:2468] T 1dc5b3532fe54f74876d02beffa2c230 P e61c3a8f61bb48f8a963c9480e53c168 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 6.
I20260709 13:05:33.433599 19403 raft_consensus.cc:2368] T 3e1f505cb0f1427bbd698ac889d80821 P e5256d91808b47c195bc9b4dbd7f2b87 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate e61c3a8f61bb48f8a963c9480e53c168 for earlier term 7. Current term is 8.
I20260709 13:05:33.434574 19557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa731b585f684a7fb2d106c50f143b83" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:05:33.435321 19557 raft_consensus.cc:3060] T fa731b585f684a7fb2d106c50f143b83 P e61c3a8f61bb48f8a963c9480e53c168 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:05:33.435551 19555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "217b5fae677b4971b3bbd2f357a1f7ff" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:05:33.358006 22485 raft_consensus.cc:493] T ab43d85f64114d4ebf618930e43d9ed0 P 0473d2b2d01f4459b1e90fd12cc7840e [term 5 FOLLOWER]: Starting pre-election (detected failure of leader e61c3a8f61bb48f8a963c9480e53c168)
I20260709 13:05:33.371429 22114 raft_consensus.cc:740] T 86a6797bdfe94fa496c050ceae4bd0d9 P e61c3a8f61bb48f8a963c9480e53c168 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: e61c3a8f61bb48f8a963c9480e53c168, State: Running, Role: LEADER
I20260709 13:05:33.404769 22374 leader_election.cc:290] T fa731b585f684a7fb2d106c50f143b83 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 7 election: Requested vote from peers e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
W20260709 13:05:33.407325 20078 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:33.388955 22388 raft_consensus.cc:3060] T 48824d5acfbc485ebf8c2d944e7202de P 0473d2b2d01f4459b1e90fd12cc7840e [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:05:33.412778 19406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef32ce6fdd0e40d382c79974f30295c6" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
I20260709 13:05:33.413017 19411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ece3db938bc649d4a40a51522ed5259c" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:05:33.413439 19409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b08304a0a02b42d7840c4e8ee9a6bd1a" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:05:33.412793 19405 raft_consensus.cc:1240] T fa731b585f684a7fb2d106c50f143b83 P e5256d91808b47c195bc9b4dbd7f2b87 [term 7 FOLLOWER]: Rejecting Update request from peer 127766fc592545a4997f7790f50f6076 for earlier term 6. Current term is 7. Ops: [6.7-6.7]
I20260709 13:05:33.414980 19408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df751f992649444090e27965eb1af85d" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 9 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:05:33.457074 19558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9f0d59553ad444883fcf5b5909f9798" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:05:33.421514 22251 leader_election.cc:290] T 3e1f505cb0f1427bbd698ac889d80821 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 8 election: Requested vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:05:33.425815 19554 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40438 (request call id 1857) took 1124 ms. Trace:
I20260709 13:05:33.425657 20108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e1085d23e8347fbbd5bce7542f4b1f4" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:05:33.426584 20109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e1085d23e8347fbbd5bce7542f4b1f4" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076"
I20260709 13:05:33.400245 20105 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35874 (request call id 580) took 1059 ms. Trace:
I20260709 13:05:33.358771 22339 raft_consensus.cc:697] T 309c3ca0ca4b4f3ba129752ea2cb293b P 0473d2b2d01f4459b1e90fd12cc7840e [term 7 LEADER]: Becoming Leader. State: Replica: 0473d2b2d01f4459b1e90fd12cc7840e, State: Running, Role: LEADER
I20260709 13:05:33.449617 19557 raft_consensus.cc:2468] T fa731b585f684a7fb2d106c50f143b83 P e61c3a8f61bb48f8a963c9480e53c168 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 7.
I20260709 13:05:33.412050 19407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76cb037fc9064d13b59a8969d897ce8c" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
W20260709 13:05:33.453339 19375 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:33.455644 19551 raft_consensus.cc:1275] T 2b74109013a140ada21feeef92d6f563 P e61c3a8f61bb48f8a963c9480e53c168 [term 5 FOLLOWER]: Refusing update from remote peer e5256d91808b47c195bc9b4dbd7f2b87: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:05:33.459049 22485 raft_consensus.cc:515] T ab43d85f64114d4ebf618930e43d9ed0 P 0473d2b2d01f4459b1e90fd12cc7840e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } attrs { replace: true } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:05:33.459467 19411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b08304a0a02b42d7840c4e8ee9a6bd1a" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
I20260709 13:05:33.428138 22111 raft_consensus.cc:3060] T 833a2f0775ed407a94b8924ce50adb63 P 127766fc592545a4997f7790f50f6076 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:05:33.315876 22487 raft_consensus.cc:515] T b9f0d59553ad444883fcf5b5909f9798 P 0473d2b2d01f4459b1e90fd12cc7840e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:33.464833 19554 rpcz_store.cc:276] 0709 13:05:32.301181 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:32.302712 (+  1531us) service_pool.cc:224] Handling call
0709 13:05:32.334662 (+ 31950us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:32.334851 (+   189us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:05:32.334873 (+    22us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:05:32.334911 (+    38us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:05:32.334962 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:32.335016 (+    54us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:33.425640 (+1090624us) spinlock_profiling.cc:243] Waited 31.7 ms on lock 0x7b5400124b50. stack: 00007f4a79de9343 00007f4a79de9240 00007f4a797781d4 00007f4a834b6304 00007f4a834b6299 00007f4a7ce71571 00007f4a7cf078ad 00007f4a81ecc419 00007f4a7b443bd4 00007f4a7b443b62 00007f4a7b443a91 00007f4a7b443a0c 00007f4a7b442cc2 00007f4a7b24348c 00007f4a7b2428c6 00007f4a7b24226f
0709 13:05:33.425758 (+   118us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":72877440}
I20260709 13:05:33.435253 22285 raft_consensus.cc:493] T fa8650e71aa14778b3d73721fc50d9fc P e61c3a8f61bb48f8a963c9480e53c168 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:33.496874 19408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4509b76741dc428e9201c70c1658da13" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:05:33.524425 19408 raft_consensus.cc:2468] T 4509b76741dc428e9201c70c1658da13 P e5256d91808b47c195bc9b4dbd7f2b87 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 3.
I20260709 13:05:33.477836 20105 rpcz_store.cc:276] 0709 13:05:32.341104 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:32.341320 (+   216us) service_pool.cc:224] Handling call
0709 13:05:32.347052 (+  5732us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:32.347262 (+   210us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:05:32.897300 (+550038us) log.cc:844] Serialized 14 byte log entry
0709 13:05:33.380326 (+483026us) log.cc:844] Serialized 14 byte log entry
0709 13:05:33.399737 (+ 19411us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:05:33.399810 (+    73us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:05:33.399875 (+    65us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:33.399981 (+   106us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:33.400168 (+   187us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":10875,"prepare.queue_time_us":856521,"prepare.run_cpu_time_us":73,"prepare.run_wall_time_us":75,"raft.queue_time_us":32373,"raft.run_cpu_time_us":208,"raft.run_wall_time_us":16168,"thread_start_us":873307,"threads_started":2}
I20260709 13:05:33.490785 19375 leader_election.cc:304] T ece3db938bc649d4a40a51522ed5259c P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:05:33.389500 22373 raft_consensus.cc:515] T 833a2f0775ed407a94b8924ce50adb63 P e61c3a8f61bb48f8a963c9480e53c168 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:05:33.532357 22373 leader_election.cc:290] T 833a2f0775ed407a94b8924ce50adb63 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:05:33.534242 19556 raft_consensus.cc:1275] T 833a2f0775ed407a94b8924ce50adb63 P e61c3a8f61bb48f8a963c9480e53c168 [term 7 FOLLOWER]: Refusing update from remote peer e5256d91808b47c195bc9b4dbd7f2b87: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:05:33.537218 19407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa731b585f684a7fb2d106c50f143b83" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
W20260709 13:05:33.537406 19375 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.3:36891, user_credentials={real_user=slave}} blocked reactor thread for 46767.8us
I20260709 13:05:33.539175 19375 leader_election.cc:304] T bc225c93219c45538b53a1bd3d387e4d P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:05:33.436151 22380 raft_consensus.cc:515] T 85c494af21f9457a85da47b9bc70c1fd P e61c3a8f61bb48f8a963c9480e53c168 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
W20260709 13:05:33.550289 19523 connection.cc:256] RPC call timeout handler was delayed by -2.451517363999983s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.30160000000000003s for a response
I20260709 13:05:33.464897 22368 raft_consensus.cc:515] T ed7fdbcb96d14d418db9ca90a792588a P 127766fc592545a4997f7790f50f6076 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
W20260709 13:05:33.555660 19523 connection.cc:256] RPC call timeout handler was delayed by -2.3624317559999781s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2096s for a response
W20260709 13:05:33.556694 19523 connection.cc:256] RPC call timeout handler was delayed by -2.3471317559999534s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21130000000000002s for a response
I20260709 13:05:33.546941 19406 raft_consensus.cc:2468] T ef32ce6fdd0e40d382c79974f30295c6 P e5256d91808b47c195bc9b4dbd7f2b87 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 8.
W20260709 13:05:33.551608 19526 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:05:33.558393 19523 connection.cc:256] RPC call timeout handler was delayed by -2.1958538809999482s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19540000000000002s for a response
W20260709 13:05:33.561398 19523 connection.cc:256] RPC call timeout handler was delayed by -2.0806682999999566s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15560000000000002s for a response
W20260709 13:05:33.564630 19523 connection.cc:256] RPC call timeout handler was delayed by -1.7395682999999735s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1935s for a response
I20260709 13:05:33.562592 19406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa8650e71aa14778b3d73721fc50d9fc" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:05:33.566078 19402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46c5bfeecc314717bffe987e6844b6d0" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 13 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
I20260709 13:05:33.567188 19402 raft_consensus.cc:3060] T 46c5bfeecc314717bffe987e6844b6d0 P e5256d91808b47c195bc9b4dbd7f2b87 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:05:33.570912 19406 raft_consensus.cc:2468] T fa8650e71aa14778b3d73721fc50d9fc P e5256d91808b47c195bc9b4dbd7f2b87 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 8.
I20260709 13:05:33.572115 19406 pending_rounds.cc:85] T df751f992649444090e27965eb1af85d P e5256d91808b47c195bc9b4dbd7f2b87: Aborting all ops after (but not including) 4
I20260709 13:05:33.572439 19406 pending_rounds.cc:107] T df751f992649444090e27965eb1af85d P e5256d91808b47c195bc9b4dbd7f2b87: Aborting uncommitted NO_OP operation due to leader change: 7.5
I20260709 13:05:33.572729 19406 raft_consensus.cc:2889] T df751f992649444090e27965eb1af85d P e5256d91808b47c195bc9b4dbd7f2b87 [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:05:33.581288 19523 connection.cc:256] RPC call timeout handler was delayed by -1.5334682999999814s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21640000000000004s for a response
I20260709 13:05:33.549160 22251 raft_consensus.cc:2804] T bc225c93219c45538b53a1bd3d387e4d P e5256d91808b47c195bc9b4dbd7f2b87 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:05:33.582551 19523 leader_election.cc:304] T 48824d5acfbc485ebf8c2d944e7202de P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 127766fc592545a4997f7790f50f6076, e61c3a8f61bb48f8a963c9480e53c168; no voters: 0473d2b2d01f4459b1e90fd12cc7840e
I20260709 13:05:33.549546 21957 raft_consensus.cc:2804] T ece3db938bc649d4a40a51522ed5259c P e5256d91808b47c195bc9b4dbd7f2b87 [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 13:05:33.589210 19374 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.4:43121, user_credentials={real_user=slave}} blocked reactor thread for 426924us
I20260709 13:05:33.590595 19411 raft_consensus.cc:1240] T 3e1f505cb0f1427bbd698ac889d80821 P e5256d91808b47c195bc9b4dbd7f2b87 [term 8 FOLLOWER]: Rejecting Update request from peer 0473d2b2d01f4459b1e90fd12cc7840e for earlier term 7. Current term is 8. Ops: []
I20260709 13:05:33.599936 19402 raft_consensus.cc:2468] T 46c5bfeecc314717bffe987e6844b6d0 P e5256d91808b47c195bc9b4dbd7f2b87 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 13.
I20260709 13:05:33.542821 22285 raft_consensus.cc:515] T fa8650e71aa14778b3d73721fc50d9fc P e61c3a8f61bb48f8a963c9480e53c168 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:33.555696 22465 raft_consensus.cc:493] T 62c6c134d3d24a1ab144dd9ee6bc3f64 P 127766fc592545a4997f7790f50f6076 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 0473d2b2d01f4459b1e90fd12cc7840e)
I20260709 13:05:33.602526 19403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28af091831594f9d8e96482078cc7625" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
W20260709 13:05:33.603937 20077 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:33.598840 19374 leader_election.cc:304] T 172b3dd13109415a955b71ac0e9d2234 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, 127766fc592545a4997f7790f50f6076
I20260709 13:05:33.496484 22372 consensus_queue.cc:237] T ff9b0eddd810459b82d91c60777c10eb P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:05:33.592694 21957 raft_consensus.cc:493] T ece3db938bc649d4a40a51522ed5259c P e5256d91808b47c195bc9b4dbd7f2b87 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 127766fc592545a4997f7790f50f6076)
I20260709 13:05:33.600975 22251 raft_consensus.cc:697] T bc225c93219c45538b53a1bd3d387e4d P e5256d91808b47c195bc9b4dbd7f2b87 [term 10 LEADER]: Becoming Leader. State: Replica: e5256d91808b47c195bc9b4dbd7f2b87, State: Running, Role: LEADER
I20260709 13:05:33.623586 19449 leader_election.cc:304] T fa8650e71aa14778b3d73721fc50d9fc P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87; no voters: 
I20260709 13:05:33.633836 19449 leader_election.cc:304] T 46c5bfeecc314717bffe987e6844b6d0 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87; no voters: 
I20260709 13:05:33.607282 22470 raft_consensus.cc:697] T 172b3dd13109415a955b71ac0e9d2234 P 0473d2b2d01f4459b1e90fd12cc7840e [term 5 LEADER]: Becoming Leader. State: Replica: 0473d2b2d01f4459b1e90fd12cc7840e, State: Running, Role: LEADER
W20260709 13:05:33.639413 19375 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.3:36891, user_credentials={real_user=slave}} blocked reactor thread for 99243us
W20260709 13:05:33.641891 22500 log.cc:927] Time spent T 179fd671030940b4b4a4e24bcc4aba0a P e61c3a8f61bb48f8a963c9480e53c168: Append to log took a long time: real 0.053s	user 0.000s	sys 0.000s
I20260709 13:05:33.643293 22251 consensus_queue.cc:237] T bc225c93219c45538b53a1bd3d387e4d P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:33.676481 22526 raft_consensus.cc:2804] T fa8650e71aa14778b3d73721fc50d9fc P 0473d2b2d01f4459b1e90fd12cc7840e [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:05:33.676975 22526 raft_consensus.cc:493] T fa8650e71aa14778b3d73721fc50d9fc P 0473d2b2d01f4459b1e90fd12cc7840e [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:33.677342 22526 raft_consensus.cc:3060] T fa8650e71aa14778b3d73721fc50d9fc P 0473d2b2d01f4459b1e90fd12cc7840e [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:05:33.646255 20110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "775c229504194560ba9589bc2199b089" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:05:33.614681 22465 raft_consensus.cc:515] T 62c6c134d3d24a1ab144dd9ee6bc3f64 P 127766fc592545a4997f7790f50f6076 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:05:33.648392 22056 consensus_queue.cc:1059] T ff9b0eddd810459b82d91c60777c10eb P 127766fc592545a4997f7790f50f6076 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:05:33.679500 22487 leader_election.cc:290] T b9f0d59553ad444883fcf5b5909f9798 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:05:33.680142 22487 raft_consensus.cc:2804] T 46c5bfeecc314717bffe987e6844b6d0 P 0473d2b2d01f4459b1e90fd12cc7840e [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:05:33.680336 22056 raft_consensus.cc:3055] T ff9b0eddd810459b82d91c60777c10eb P 127766fc592545a4997f7790f50f6076 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:05:33.680617 22487 raft_consensus.cc:697] T 46c5bfeecc314717bffe987e6844b6d0 P 0473d2b2d01f4459b1e90fd12cc7840e [term 13 LEADER]: Becoming Leader. State: Replica: 0473d2b2d01f4459b1e90fd12cc7840e, State: Running, Role: LEADER
I20260709 13:05:33.680778 22056 raft_consensus.cc:740] T ff9b0eddd810459b82d91c60777c10eb P 127766fc592545a4997f7790f50f6076 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 127766fc592545a4997f7790f50f6076, State: Running, Role: LEADER
I20260709 13:05:33.681308 22465 leader_election.cc:290] T 62c6c134d3d24a1ab144dd9ee6bc3f64 P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:05:33.681627 22487 consensus_queue.cc:237] T 46c5bfeecc314717bffe987e6844b6d0 P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 9.4, Last appended by leader: 4, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:33.681713 22056 consensus_queue.cc:260] T ff9b0eddd810459b82d91c60777c10eb P 127766fc592545a4997f7790f50f6076 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:05:33.682916 22413 consensus_queue.cc:1059] T 46c5bfeecc314717bffe987e6844b6d0 P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 }, Status: INVALID_TERM, Last received: 9.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:05:33.683292 22056 raft_consensus.cc:3060] T ff9b0eddd810459b82d91c60777c10eb P 127766fc592545a4997f7790f50f6076 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:05:33.642526 22369 raft_consensus.cc:515] T edd7d470b5014c9489be7f41f64355c9 P 0473d2b2d01f4459b1e90fd12cc7840e [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:33.653285 20105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa731b585f684a7fb2d106c50f143b83" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076"
I20260709 13:05:33.629479 21957 raft_consensus.cc:3060] T ece3db938bc649d4a40a51522ed5259c P e5256d91808b47c195bc9b4dbd7f2b87 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:05:33.658257 22490 raft_consensus.cc:515] T 4509b76741dc428e9201c70c1658da13 P 0473d2b2d01f4459b1e90fd12cc7840e [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:33.663784 19552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e1f505cb0f1427bbd698ac889d80821" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:05:33.691089 19552 raft_consensus.cc:3060] T 3e1f505cb0f1427bbd698ac889d80821 P e61c3a8f61bb48f8a963c9480e53c168 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:05:33.658382 19449 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:05:33.692576 19452 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:33.693841 19402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40e1e16737a842ee936002830f36882e" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
W20260709 13:05:33.694948 19377 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.519s	user 0.001s	sys 0.022s
I20260709 13:05:33.668794 22483 consensus_queue.cc:260] T 775c229504194560ba9589bc2199b089 P 0473d2b2d01f4459b1e90fd12cc7840e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:05:33.671850 22398 raft_consensus.cc:3055] T 9962423cb4e54fcfa5de01daf68a86e7 P e5256d91808b47c195bc9b4dbd7f2b87 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:05:33.670594 22470 consensus_queue.cc:237] T 172b3dd13109415a955b71ac0e9d2234 P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:05:33.672232 22368 leader_election.cc:290] T ed7fdbcb96d14d418db9ca90a792588a P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 5 election: Requested vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:05:33.650383 20075 leader_election.cc:304] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 127766fc592545a4997f7790f50f6076; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87
W20260709 13:05:33.718377 20075 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.1:40321, user_credentials={real_user=slave}} blocked reactor thread for 68080.4us
I20260709 13:05:33.553586 22114 consensus_queue.cc:260] T 86a6797bdfe94fa496c050ceae4bd0d9 P e61c3a8f61bb48f8a963c9480e53c168 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 6.3, Last appended by leader: 3, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:33.682979 19375 leader_election.cc:304] T 4af19371ea874c09a0a2147040835cbb P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168; no voters: 127766fc592545a4997f7790f50f6076
I20260709 13:05:33.624598 22504 raft_consensus.cc:3060] T 172b3dd13109415a955b71ac0e9d2234 P e5256d91808b47c195bc9b4dbd7f2b87 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:05:33.720774 22114 raft_consensus.cc:3060] T 86a6797bdfe94fa496c050ceae4bd0d9 P e61c3a8f61bb48f8a963c9480e53c168 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:05:33.720916 22506 raft_consensus.cc:2804] T 4af19371ea874c09a0a2147040835cbb P e5256d91808b47c195bc9b4dbd7f2b87 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:05:33.721558 22506 raft_consensus.cc:697] T 4af19371ea874c09a0a2147040835cbb P e5256d91808b47c195bc9b4dbd7f2b87 [term 5 LEADER]: Becoming Leader. State: Replica: e5256d91808b47c195bc9b4dbd7f2b87, State: Running, Role: LEADER
I20260709 13:05:33.694092 19403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9f0d59553ad444883fcf5b5909f9798" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:05:33.723816 19403 raft_consensus.cc:2410] T b9f0d59553ad444883fcf5b5909f9798 P e5256d91808b47c195bc9b4dbd7f2b87 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0473d2b2d01f4459b1e90fd12cc7840e for term 9 because replica has last-logged OpId of term: 7 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
W20260709 13:05:33.693879 22396 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.900s	user 0.014s	sys 0.014s
I20260709 13:05:33.668658 22388 raft_consensus.cc:515] T 48824d5acfbc485ebf8c2d944e7202de P 0473d2b2d01f4459b1e90fd12cc7840e [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:05:33.678189 22481 consensus_queue.cc:1059] T 3e1f505cb0f1427bbd698ac889d80821 P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:05:33.639285 22373 raft_consensus.cc:2804] T 48824d5acfbc485ebf8c2d944e7202de P e61c3a8f61bb48f8a963c9480e53c168 [term 7 FOLLOWER]: Leader election won for term 7
W20260709 13:05:33.715554 19479 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.678s	user 0.013s	sys 0.012s
I20260709 13:05:33.726212 19480 raft_consensus.cc:1240] T 22196caba61445d3bec98a0aab3c337d P 0473d2b2d01f4459b1e90fd12cc7840e [term 7 LEADER]: Rejecting Update request from peer e61c3a8f61bb48f8a963c9480e53c168 for earlier term 6. Current term is 7. Ops: [6.5-6.5]
I20260709 13:05:33.691684 22389 raft_consensus.cc:3055] T 46c5bfeecc314717bffe987e6844b6d0 P e61c3a8f61bb48f8a963c9480e53c168 [term 12 LEADER]: Stepping down as leader of term 12
W20260709 13:05:33.695288 19377 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.520s	user 0.001s	sys 0.022s
I20260709 13:05:33.726819 19402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab43d85f64114d4ebf618930e43d9ed0" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:05:33.730378 19482 raft_consensus.cc:2368] T 4509b76741dc428e9201c70c1658da13 P 0473d2b2d01f4459b1e90fd12cc7840e [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate e5256d91808b47c195bc9b4dbd7f2b87 for earlier term 3. Current term is 4.
I20260709 13:05:33.735327 19402 raft_consensus.cc:2393] T ab43d85f64114d4ebf618930e43d9ed0 P e5256d91808b47c195bc9b4dbd7f2b87 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0473d2b2d01f4459b1e90fd12cc7840e in current term 6: Already voted for candidate 127766fc592545a4997f7790f50f6076 in this term.
W20260709 13:05:33.735917 19377 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.2:46257, user_credentials={real_user=slave}} blocked reactor thread for 813676us
I20260709 13:05:33.737020 19375 leader_election.cc:304] T 1dc5b3532fe54f74876d02beffa2c230 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
W20260709 13:05:33.738790 19479 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.702s	user 0.014s	sys 0.013s
W20260709 13:05:33.741655 19450 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.3:36891, user_credentials={real_user=slave}} blocked reactor thread for 493949us
I20260709 13:05:33.701464 22398 raft_consensus.cc:740] T 9962423cb4e54fcfa5de01daf68a86e7 P e5256d91808b47c195bc9b4dbd7f2b87 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: e5256d91808b47c195bc9b4dbd7f2b87, State: Running, Role: LEADER
I20260709 13:05:33.758435 19375 leader_election.cc:304] T fa731b585f684a7fb2d106c50f143b83 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168; no voters: 127766fc592545a4997f7790f50f6076
I20260709 13:05:33.761871 19482 raft_consensus.cc:1275] T b9f0d59553ad444883fcf5b5909f9798 P 0473d2b2d01f4459b1e90fd12cc7840e [term 8 FOLLOWER]: Refusing update from remote peer e61c3a8f61bb48f8a963c9480e53c168: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:05:33.764864 19377 leader_election.cc:304] T 5ec1c4ce15e04c7e8c283a62179f2a64 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, 127766fc592545a4997f7790f50f6076
I20260709 13:05:33.768404 19552 raft_consensus.cc:2468] T 3e1f505cb0f1427bbd698ac889d80821 P e61c3a8f61bb48f8a963c9480e53c168 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 8.
I20260709 13:05:33.753705 19480 raft_consensus.cc:1240] T 86a6797bdfe94fa496c050ceae4bd0d9 P 0473d2b2d01f4459b1e90fd12cc7840e [term 7 FOLLOWER]: Rejecting Update request from peer e61c3a8f61bb48f8a963c9480e53c168 for earlier term 6. Current term is 7. Ops: [6.3-6.3]
I20260709 13:05:33.755082 19407 raft_consensus.cc:1275] T 775c229504194560ba9589bc2199b089 P e5256d91808b47c195bc9b4dbd7f2b87 [term 6 FOLLOWER]: Refusing update from remote peer 127766fc592545a4997f7790f50f6076: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
W20260709 13:05:33.727994 22396 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.937s	user 0.014s	sys 0.014s
I20260709 13:05:33.727382 22327 raft_consensus.cc:2749] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P 127766fc592545a4997f7790f50f6076 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:05:33.628963 22339 consensus_queue.cc:237] T 309c3ca0ca4b4f3ba129752ea2cb293b P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 7, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } attrs { replace: true } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:05:33.783888 19377 leader_election.cc:304] T 7be9efa6559648dbb5a0f7684c4542d1 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:05:33.722427 22506 consensus_queue.cc:237] T 4af19371ea874c09a0a2147040835cbb P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:05:33.765888 22483 raft_consensus.cc:3060] T 775c229504194560ba9589bc2199b089 P 0473d2b2d01f4459b1e90fd12cc7840e [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:05:33.740984 22389 raft_consensus.cc:740] T 46c5bfeecc314717bffe987e6844b6d0 P e61c3a8f61bb48f8a963c9480e53c168 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: e61c3a8f61bb48f8a963c9480e53c168, State: Running, Role: LEADER
I20260709 13:05:33.787088 19375 leader_election.cc:304] T 3e1f505cb0f1427bbd698ac889d80821 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:05:33.756567 22373 raft_consensus.cc:697] T 48824d5acfbc485ebf8c2d944e7202de P e61c3a8f61bb48f8a963c9480e53c168 [term 7 LEADER]: Becoming Leader. State: Replica: e61c3a8f61bb48f8a963c9480e53c168, State: Running, Role: LEADER
W20260709 13:05:33.783208 19484 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.539s	user 0.004s	sys 0.023s
I20260709 13:05:33.741324 22174 consensus_queue.cc:1059] T fa731b585f684a7fb2d106c50f143b83 P 127766fc592545a4997f7790f50f6076 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.043s
I20260709 13:05:33.729943 22162 consensus_queue.cc:1059] T 4af19371ea874c09a0a2147040835cbb P 127766fc592545a4997f7790f50f6076 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.051s
I20260709 13:05:33.776908 22443 raft_consensus.cc:2804] T fa731b585f684a7fb2d106c50f143b83 P e5256d91808b47c195bc9b4dbd7f2b87 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:05:33.770027 21926 raft_consensus.cc:2804] T 1dc5b3532fe54f74876d02beffa2c230 P e5256d91808b47c195bc9b4dbd7f2b87 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:05:33.842617 19557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa8650e71aa14778b3d73721fc50d9fc" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:05:33.986065 19557 raft_consensus.cc:2468] T fa8650e71aa14778b3d73721fc50d9fc P e61c3a8f61bb48f8a963c9480e53c168 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 8.
I20260709 13:05:33.846503 19556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46c5bfeecc314717bffe987e6844b6d0" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 13 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:05:33.850068 19478 raft_consensus.cc:1240] T 1a61655d99124a29b486ba4a5b37faea P 0473d2b2d01f4459b1e90fd12cc7840e [term 5 LEADER]: Rejecting Update request from peer e61c3a8f61bb48f8a963c9480e53c168 for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 13:05:33.850854 19553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e1085d23e8347fbbd5bce7542f4b1f4" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
W20260709 13:05:33.854969 20075 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.1:40321, user_credentials={real_user=slave}} blocked reactor thread for 51972.6us
W20260709 13:05:33.988474 20075 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:33.854789 19554 raft_consensus.cc:1240] T 3e1f505cb0f1427bbd698ac889d80821 P e61c3a8f61bb48f8a963c9480e53c168 [term 8 FOLLOWER]: Rejecting Update request from peer 0473d2b2d01f4459b1e90fd12cc7840e for earlier term 7. Current term is 8. Ops: []
W20260709 13:05:33.854738 19377 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.2:46257, user_credentials={real_user=slave}} blocked reactor thread for 74359.8us
W20260709 13:05:33.906342 19484 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.663s	user 0.008s	sys 0.030s
W20260709 13:05:33.933212 19375 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.3:36891, user_credentials={real_user=slave}} blocked reactor thread for 146220us
I20260709 13:05:33.989612 19377 leader_election.cc:304] T 7f575b143b844aa096b50997dad3516a P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:05:33.934139 19551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a61655d99124a29b486ba4a5b37faea" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:05:33.778544 22505 consensus_queue.cc:1048] T 2b74109013a140ada21feeef92d6f563 P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.078s
I20260709 13:05:33.963459 19558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff75a1d4cb1f493db8f71ddc136ba9ab" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:05:33.785079 22503 raft_consensus.cc:2749] T 5ec1c4ce15e04c7e8c283a62179f2a64 P e5256d91808b47c195bc9b4dbd7f2b87 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:05:33.971565 19552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e1f505cb0f1427bbd698ac889d80821" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:05:33.993254 19552 raft_consensus.cc:2368] T 3e1f505cb0f1427bbd698ac889d80821 P e61c3a8f61bb48f8a963c9480e53c168 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 0473d2b2d01f4459b1e90fd12cc7840e for earlier term 7. Current term is 8.
W20260709 13:05:33.972452 19523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.4:43121, user_credentials={real_user=slave}} blocked reactor thread for 365464us
I20260709 13:05:33.995507 19553 raft_consensus.cc:2393] T 0e1085d23e8347fbbd5bce7542f4b1f4 P e61c3a8f61bb48f8a963c9480e53c168 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0473d2b2d01f4459b1e90fd12cc7840e in current term 5: Already voted for candidate e61c3a8f61bb48f8a963c9480e53c168 in this term.
I20260709 13:05:33.995398 19523 leader_election.cc:304] T 62c6c134d3d24a1ab144dd9ee6bc3f64 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e61c3a8f61bb48f8a963c9480e53c168; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, 127766fc592545a4997f7790f50f6076
I20260709 13:05:33.804040 22254 consensus_queue.cc:1048] T 833a2f0775ed407a94b8924ce50adb63 P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.168s
I20260709 13:05:33.971905 22396 raft_consensus.cc:2804] T 3e1f505cb0f1427bbd698ac889d80821 P e5256d91808b47c195bc9b4dbd7f2b87 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:05:33.971650 22524 raft_consensus.cc:3055] T 3e1f505cb0f1427bbd698ac889d80821 P 0473d2b2d01f4459b1e90fd12cc7840e [term 7 LEADER]: Stepping down as leader of term 7
W20260709 13:05:34.015105 19305 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:44698 (request call id 230) took 16333 ms (client timeout 15000 ms). Trace:
I20260709 13:05:33.985674 22380 leader_election.cc:290] T 85c494af21f9457a85da47b9bc70c1fd P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:05:33.990458 22391 raft_consensus.cc:493] T 5ec1c4ce15e04c7e8c283a62179f2a64 P 0473d2b2d01f4459b1e90fd12cc7840e [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 127766fc592545a4997f7790f50f6076)
W20260709 13:05:34.018653 19450 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.3:36891, user_credentials={real_user=slave}} blocked reactor thread for 269978us
I20260709 13:05:34.034060 19450 leader_election.cc:304] T 6c5eebf646ad445a9d1b1adc319d7b16 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e; no voters: 127766fc592545a4997f7790f50f6076, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:05:33.963533 22465 consensus_queue.cc:1048] T 775c229504194560ba9589bc2199b089 P 127766fc592545a4997f7790f50f6076 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.063s
I20260709 13:05:33.995024 21926 raft_consensus.cc:493] T 1dc5b3532fe54f74876d02beffa2c230 P e5256d91808b47c195bc9b4dbd7f2b87 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:34.028795 20105 raft_consensus.cc:1240] T 9962423cb4e54fcfa5de01daf68a86e7 P 127766fc592545a4997f7790f50f6076 [term 11 LEADER]: Rejecting Update request from peer e5256d91808b47c195bc9b4dbd7f2b87 for earlier term 10. Current term is 11. Ops: []
I20260709 13:05:33.994663 22381 raft_consensus.cc:493] T ef32ce6fdd0e40d382c79974f30295c6 P 0473d2b2d01f4459b1e90fd12cc7840e [term 7 FOLLOWER]: Starting pre-election (detected failure of leader e5256d91808b47c195bc9b4dbd7f2b87)
W20260709 13:05:34.036135 19526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.2:46257, user_credentials={real_user=slave}} blocked reactor thread for 240332us
I20260709 13:05:34.014217 22285 leader_election.cc:290] T fa8650e71aa14778b3d73721fc50d9fc P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
W20260709 13:05:34.026952 20076 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.3:36891, user_credentials={real_user=slave}} blocked reactor thread for 441227us
W20260709 13:05:34.051265 19377 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.2:46257, user_credentials={real_user=slave}} blocked reactor thread for 61730.1us
I20260709 13:05:34.200380 19377 leader_election.cc:304] T 14efcc79969f41babe5529c22d59156d P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87; no voters: 127766fc592545a4997f7790f50f6076
W20260709 13:05:34.054924 19374 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.4:43121, user_credentials={real_user=slave}} blocked reactor thread for 45560.2us
W20260709 13:05:34.201431 19374 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:34.005899 22485 leader_election.cc:290] T ab43d85f64114d4ebf618930e43d9ed0 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:05:34.025120 22524 raft_consensus.cc:740] T 3e1f505cb0f1427bbd698ac889d80821 P 0473d2b2d01f4459b1e90fd12cc7840e [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 0473d2b2d01f4459b1e90fd12cc7840e, State: Running, Role: LEADER
I20260709 13:05:33.994575 22517 consensus_queue.cc:1059] T 22196caba61445d3bec98a0aab3c337d P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.078s
I20260709 13:05:34.213187 19480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa8650e71aa14778b3d73721fc50d9fc" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
W20260709 13:05:34.133096 19526 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:34.035538 22385 raft_consensus.cc:493] T ab43d85f64114d4ebf618930e43d9ed0 P e5256d91808b47c195bc9b4dbd7f2b87 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:05:34.149335 19452 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:05:34.238646 19526 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:34.204319 19560 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40438 (request call id 1871) took 1374 ms. Trace:
W20260709 13:05:34.132345 20077 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:34.073514 21926 raft_consensus.cc:3060] T 1dc5b3532fe54f74876d02beffa2c230 P e5256d91808b47c195bc9b4dbd7f2b87 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:05:34.075765 22295 raft_consensus.cc:2749] T 7f575b143b844aa096b50997dad3516a P e5256d91808b47c195bc9b4dbd7f2b87 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:05:34.065966 22374 raft_consensus.cc:2749] T 7be9efa6559648dbb5a0f7684c4542d1 P e5256d91808b47c195bc9b4dbd7f2b87 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:05:34.195736 22380 raft_consensus.cc:1064] T 7be9efa6559648dbb5a0f7684c4542d1 P e61c3a8f61bb48f8a963c9480e53c168: attempting to promote NON_VOTER 127766fc592545a4997f7790f50f6076 to VOTER
I20260709 13:05:34.050697 22443 raft_consensus.cc:697] T fa731b585f684a7fb2d106c50f143b83 P e5256d91808b47c195bc9b4dbd7f2b87 [term 7 LEADER]: Becoming Leader. State: Replica: e5256d91808b47c195bc9b4dbd7f2b87, State: Running, Role: LEADER
W20260709 13:05:34.211809 21962 consensus_meta.cc:287] T b08304a0a02b42d7840c4e8ee9a6bd1a P e5256d91808b47c195bc9b4dbd7f2b87: Time spent flushing consensus metadata: real 0.890s	user 0.002s	sys 0.008s
W20260709 13:05:34.321744 22111 consensus_meta.cc:287] T 833a2f0775ed407a94b8924ce50adb63 P 127766fc592545a4997f7790f50f6076: Time spent flushing consensus metadata: real 0.786s	user 0.007s	sys 0.000s
I20260709 13:05:34.322633 20103 raft_consensus.cc:1275] T 833a2f0775ed407a94b8924ce50adb63 P 127766fc592545a4997f7790f50f6076 [term 7 FOLLOWER]: Refusing update from remote peer e5256d91808b47c195bc9b4dbd7f2b87: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:05:34.051149 22391 raft_consensus.cc:515] T 5ec1c4ce15e04c7e8c283a62179f2a64 P 0473d2b2d01f4459b1e90fd12cc7840e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:05:34.031791 22389 consensus_queue.cc:260] T 46c5bfeecc314717bffe987e6844b6d0 P e61c3a8f61bb48f8a963c9480e53c168 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 12.5, Last appended by leader: 5, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:34.050532 22525 consensus_queue.cc:1048] T b9f0d59553ad444883fcf5b5909f9798 P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.185s
W20260709 13:05:34.327569 22532 log.cc:927] Time spent T 9962423cb4e54fcfa5de01daf68a86e7 P 127766fc592545a4997f7790f50f6076: Append to log took a long time: real 0.085s	user 0.000s	sys 0.000s
I20260709 13:05:34.212095 22490 leader_election.cc:290] T 4509b76741dc428e9201c70c1658da13 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 4 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:05:34.239861 19560 rpcz_store.cc:276] 0709 13:05:32.830177 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:33.001019 (+170842us) service_pool.cc:224] Handling call
0709 13:05:33.001258 (+   239us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:33.001435 (+   177us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:05:33.450970 (+449535us) log.cc:844] Serialized 14 byte log entry
0709 13:05:34.203549 (+752579us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:05:34.203632 (+    83us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:05:34.203852 (+   220us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:34.203980 (+   128us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:34.204200 (+   220us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":612405,"prepare.run_cpu_time_us":63,"prepare.run_wall_time_us":4024,"raft.queue_time_us":388744,"thread_start_us":1195731,"threads_started":3}
I20260709 13:05:34.242301 22517 consensus_queue.cc:1243] T 22196caba61445d3bec98a0aab3c337d P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Peer 0473d2b2d01f4459b1e90fd12cc7840e log is divergent from this leader: its last log entry 7.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 13:05:34.328521 22391 leader_election.cc:290] T 5ec1c4ce15e04c7e8c283a62179f2a64 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:05:34.241287 22396 raft_consensus.cc:697] T 3e1f505cb0f1427bbd698ac889d80821 P e5256d91808b47c195bc9b4dbd7f2b87 [term 8 LEADER]: Becoming Leader. State: Replica: e5256d91808b47c195bc9b4dbd7f2b87, State: Running, Role: LEADER
I20260709 13:05:34.256138 22527 raft_consensus.cc:3060] T 6c5eebf646ad445a9d1b1adc319d7b16 P 0473d2b2d01f4459b1e90fd12cc7840e [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:05:34.301198 22519 log.cc:927] Time spent T ece3db938bc649d4a40a51522ed5259c P e5256d91808b47c195bc9b4dbd7f2b87: Append to log took a long time: real 0.447s	user 0.000s	sys 0.000s
I20260709 13:05:34.254495 22385 raft_consensus.cc:515] T ab43d85f64114d4ebf618930e43d9ed0 P e5256d91808b47c195bc9b4dbd7f2b87 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } attrs { replace: true } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
W20260709 13:05:34.301820 22520 log.cc:927] Time spent T 0cdf56e38bbc453d9438d359e5a69955 P e5256d91808b47c195bc9b4dbd7f2b87: Append to log took a long time: real 0.307s	user 0.000s	sys 0.000s
I20260709 13:05:34.301692 22555 raft_consensus.cc:2749] T 62c6c134d3d24a1ab144dd9ee6bc3f64 P e61c3a8f61bb48f8a963c9480e53c168 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:05:34.301952 22539 log.cc:927] Time spent T 22196caba61445d3bec98a0aab3c337d P 0473d2b2d01f4459b1e90fd12cc7840e: Append to log took a long time: real 0.274s	user 0.001s	sys 0.000s
W20260709 13:05:34.302423 22522 log.cc:927] Time spent T 14935b3ddf914369822e4a0547aaa355 P e5256d91808b47c195bc9b4dbd7f2b87: Append to log took a long time: real 0.338s	user 0.000s	sys 0.001s
W20260709 13:05:34.302935 22529 log.cc:927] Time spent T 14935b3ddf914369822e4a0547aaa355 P 0473d2b2d01f4459b1e90fd12cc7840e: Append to log took a long time: real 0.093s	user 0.001s	sys 0.000s
W20260709 13:05:34.303849 22528 log.cc:927] Time spent T ed7fdbcb96d14d418db9ca90a792588a P 0473d2b2d01f4459b1e90fd12cc7840e: Append to log took a long time: real 0.177s	user 0.000s	sys 0.000s
I20260709 13:05:34.304788 22503 raft_consensus.cc:3055] T 0cdf56e38bbc453d9438d359e5a69955 P e5256d91808b47c195bc9b4dbd7f2b87 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:05:34.258392 22251 raft_consensus.cc:493] T a08760e15aac4630a629431f56024dc8 P e5256d91808b47c195bc9b4dbd7f2b87 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:34.300383 22481 raft_consensus.cc:493] T 2b74109013a140ada21feeef92d6f563 P 0473d2b2d01f4459b1e90fd12cc7840e [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:34.372800 22481 raft_consensus.cc:515] T 2b74109013a140ada21feeef92d6f563 P 0473d2b2d01f4459b1e90fd12cc7840e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:34.373286 22443 consensus_queue.cc:237] T fa731b585f684a7fb2d106c50f143b83 P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:05:34.253647 22388 leader_election.cc:290] T 48824d5acfbc485ebf8c2d944e7202de P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 8 election: Requested vote from peers e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:05:34.124851 22381 raft_consensus.cc:515] T ef32ce6fdd0e40d382c79974f30295c6 P 0473d2b2d01f4459b1e90fd12cc7840e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:34.225129 22373 consensus_queue.cc:237] T 48824d5acfbc485ebf8c2d944e7202de P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
W20260709 13:05:34.335572 22056 consensus_meta.cc:287] T ff9b0eddd810459b82d91c60777c10eb P 127766fc592545a4997f7790f50f6076: Time spent flushing consensus metadata: real 0.652s	user 0.006s	sys 0.005s
I20260709 13:05:34.375036 22251 raft_consensus.cc:515] T a08760e15aac4630a629431f56024dc8 P e5256d91808b47c195bc9b4dbd7f2b87 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:34.370743 22503 raft_consensus.cc:740] T 0cdf56e38bbc453d9438d359e5a69955 P e5256d91808b47c195bc9b4dbd7f2b87 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: e5256d91808b47c195bc9b4dbd7f2b87, State: Running, Role: LEADER
W20260709 13:05:34.386564 22504 consensus_meta.cc:287] T 172b3dd13109415a955b71ac0e9d2234 P e5256d91808b47c195bc9b4dbd7f2b87: Time spent flushing consensus metadata: real 0.666s	user 0.007s	sys 0.003s
I20260709 13:05:34.397403 22481 leader_election.cc:290] T 2b74109013a140ada21feeef92d6f563 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:05:34.329741 22524 consensus_queue.cc:260] T 3e1f505cb0f1427bbd698ac889d80821 P 0473d2b2d01f4459b1e90fd12cc7840e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:34.399094 22396 consensus_queue.cc:237] T 3e1f505cb0f1427bbd698ac889d80821 P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
W20260709 13:05:34.408572 22531 log.cc:927] Time spent T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P 0473d2b2d01f4459b1e90fd12cc7840e: Append to log took a long time: real 0.174s	user 0.001s	sys 0.000s
W20260709 13:05:34.410398 22521 log.cc:927] Time spent T 1f85fc4b527a48848e5faa083b604e36 P 0473d2b2d01f4459b1e90fd12cc7840e: Append to log took a long time: real 0.081s	user 0.001s	sys 0.000s
I20260709 13:05:34.399852 22504 raft_consensus.cc:2749] T 172b3dd13109415a955b71ac0e9d2234 P e5256d91808b47c195bc9b4dbd7f2b87 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:05:34.411064 22503 consensus_queue.cc:260] T 0cdf56e38bbc453d9438d359e5a69955 P e5256d91808b47c195bc9b4dbd7f2b87 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:34.412269 22503 raft_consensus.cc:3060] T 0cdf56e38bbc453d9438d359e5a69955 P e5256d91808b47c195bc9b4dbd7f2b87 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:05:34.403200 22535 log.cc:927] Time spent T 1a61655d99124a29b486ba4a5b37faea P 0473d2b2d01f4459b1e90fd12cc7840e: Append to log took a long time: real 0.177s	user 0.000s	sys 0.001s
W20260709 13:05:34.420413 22526 consensus_meta.cc:287] T fa8650e71aa14778b3d73721fc50d9fc P 0473d2b2d01f4459b1e90fd12cc7840e: Time spent flushing consensus metadata: real 0.743s	user 0.008s	sys 0.004s
I20260709 13:05:34.421064 22526 raft_consensus.cc:515] T fa8650e71aa14778b3d73721fc50d9fc P 0473d2b2d01f4459b1e90fd12cc7840e [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:34.429214 22526 leader_election.cc:290] T fa8650e71aa14778b3d73721fc50d9fc P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 9 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:05:34.030237 19308 catalog_manager.cc:5697] T 62c6c134d3d24a1ab144dd9ee6bc3f64 P 127766fc592545a4997f7790f50f6076 reported cstate change: term changed from 6 to 7, leader changed from e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3) to 127766fc592545a4997f7790f50f6076 (127.17.223.4). New cstate: current_term: 7 leader_uuid: "127766fc592545a4997f7790f50f6076" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:05:34.472257 19375 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:05:34.473511 19375 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:34.485363 19308 catalog_manager.cc:5697] T 775c229504194560ba9589bc2199b089 P 127766fc592545a4997f7790f50f6076 reported cstate change: term changed from 3 to 4, leader changed from 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2) to 127766fc592545a4997f7790f50f6076 (127.17.223.4). New cstate: current_term: 4 leader_uuid: "127766fc592545a4997f7790f50f6076" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:05:34.487556 19377 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.2:46257, user_credentials={real_user=slave}} blocked reactor thread for 287156us
W20260709 13:05:34.025556 19305 rpcz_store.cc:269] 0709 13:05:17.681724 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:17.682400 (+   676us) service_pool.cc:224] Handling call
0709 13:05:34.015012 (+16332612us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:05:30.563091 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:05:30.563722 (+   631us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:05:30.563777 (+    55us) write_op.cc:435] Acquired schema lock
0709 13:05:30.563796 (+    19us) tablet.cc:662] Decoding operations
0709 13:05:30.564442 (+   646us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:05:30.564517 (+    75us) write_op.cc:641] Partition lock acquired for write op
0709 13:05:30.564546 (+    29us) tablet.cc:685] Acquiring locks for 4 operations
0709 13:05:30.565033 (+   487us) tablet.cc:701] Row locks acquired
0709 13:05:30.565081 (+    48us) write_op.cc:260] PREPARE: finished
0709 13:05:30.565253 (+   172us) write_op.cc:270] Start()
0709 13:05:30.565402 (+   149us) write_op.cc:276] Timestamp: P: 1783602330565187 usec, L: 0
0709 13:05:30.565425 (+    23us) op_driver.cc:348] REPLICATION: starting
0709 13:05:30.594997 (+ 29572us) log.cc:844] Serialized 1746 byte log entry
0709 13:05:31.296649 (+701652us) op_driver.cc:464] REPLICATION: finished
0709 13:05:31.656574 (+359925us) spinlock_profiling.cc:243] Waited 19.3 ms on lock 0x7b4400022b4c. stack: 00007f4a79de9343 00007f4a79de9240 00007f4a797781d4 00007f4a834b6304 00007f4a834b6299 00007f4a79ca3db1 00007f4a79d41c85 00007f4a79d426a2 00007f4a7cab41db 00007f4a7caafaaf 00007f4a79dfe0ac 00007f4a82c58ab9 00007f4a79e1a69b 00007f4a79e1893f 00007f4a79e1ac02 00007f4a8093eef0
0709 13:05:31.823385 (+166811us) write_op.cc:301] APPLY: starting
0709 13:05:31.823511 (+   126us) tablet.cc:1367] starting BulkCheckPresence
0709 13:05:31.823735 (+   224us) tablet.cc:1370] finished BulkCheckPresence
0709 13:05:31.823779 (+    44us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:05:31.824695 (+   916us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:05:31.825015 (+   320us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=4
0709 13:05:31.825065 (+    50us) write_op.cc:312] APPLY: finished
0709 13:05:31.825405 (+   340us) log.cc:844] Serialized 41 byte log entry
0709 13:05:31.825581 (+   176us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:05:31.825697 (+   116us) write_op.cc:454] Released schema lock
0709 13:05:31.825773 (+    76us) write_op.cc:341] FINISH: Updating metrics
0709 13:05:31.826324 (+   551us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:05:31.826356 (+    32us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":4900603,"reported_tablets":49,"child_traces":[["op",{"apply.queue_time_us":478366,"apply.run_cpu_time_us":2889,"apply.run_wall_time_us":2896,"num_ops":4,"prepare.queue_time_us":469013,"prepare.run_cpu_time_us":31202,"prepare.run_wall_time_us":206782,"raft.queue_time_us":217000,"raft.run_cpu_time_us":19988,"raft.run_wall_time_us":744093,"replication_time_us":574430,"spinlock_wait_cycles":44290432,"thread_start_us":805815,"threads_started":4,"wal-append.queue_time_us":231109,"wal-append.run_cpu_time_us":21814,"wal-append.run_wall_time_us":2036654}]]}
I20260709 13:05:34.489297 19377 leader_election.cc:304] T ff75a1d4cb1f493db8f71ddc136ba9ab P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:05:34.492439 19377 leader_election.cc:304] T f93ee515a9c14139bf566522ed8232f3 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:05:34.491670 19308 catalog_manager.cc:5697] T 5ec1c4ce15e04c7e8c283a62179f2a64 P 127766fc592545a4997f7790f50f6076 reported cstate change: term changed from 1 to 3, leader changed from e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1) to 127766fc592545a4997f7790f50f6076 (127.17.223.4). New cstate: current_term: 3 leader_uuid: "127766fc592545a4997f7790f50f6076" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:05:34.499351 19410 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49050 (request call id 411) took 1379 ms. Trace:
I20260709 13:05:34.500005 19404 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49050 (request call id 413) took 1338 ms. Trace:
I20260709 13:05:34.500553 19404 rpcz_store.cc:276] 0709 13:05:33.161363 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:33.180733 (+ 19370us) service_pool.cc:224] Handling call
0709 13:05:33.212811 (+ 32078us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:05:33.222038 (+  9227us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:05:33.222084 (+    46us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:05:33.222661 (+   577us) log.cc:844] Serialized 26 byte log entry
0709 13:05:33.540462 (+317801us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:05:33.540514 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:33.540601 (+    87us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:05:34.498551 (+957950us) raft_consensus.cc:1685] finished
0709 13:05:34.498610 (+    59us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:34.499805 (+  1195us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":71634,"raft.queue_time_us":67721,"raft.run_cpu_time_us":76,"raft.run_wall_time_us":76,"thread_start_us":317436,"threads_started":1,"wal-append.queue_time_us":547612}
I20260709 13:05:34.505988 19480 raft_consensus.cc:2393] T fa8650e71aa14778b3d73721fc50d9fc P 0473d2b2d01f4459b1e90fd12cc7840e [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e61c3a8f61bb48f8a963c9480e53c168 in current term 9: Already voted for candidate 0473d2b2d01f4459b1e90fd12cc7840e in this term.
I20260709 13:05:34.505972 19477 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58286 (request call id 1649) took 1268 ms. Trace:
I20260709 13:05:34.506857 19479 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39478 (request call id 389) took 1472 ms. Trace:
I20260709 13:05:34.507158 19477 rpcz_store.cc:276] 0709 13:05:33.237173 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:33.237315 (+   142us) service_pool.cc:224] Handling call
0709 13:05:33.241033 (+  3718us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:05:33.241453 (+   420us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:05:33.241491 (+    38us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:05:33.258022 (+ 16531us) log.cc:844] Serialized 26 byte log entry
0709 13:05:33.738106 (+480084us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:05:33.781886 (+ 43780us) log.cc:844] Serialized 14 byte log entry
0709 13:05:34.203743 (+421857us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:34.203823 (+    80us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:05:34.505137 (+301314us) raft_consensus.cc:1685] finished
0709 13:05:34.505195 (+    58us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:34.505641 (+   446us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":15072,"raft.queue_time_us":413408,"raft.run_cpu_time_us":342,"raft.run_wall_time_us":36363,"thread_start_us":845562,"threads_started":2,"wal-append.queue_time_us":727605}
I20260709 13:05:34.507584 19479 rpcz_store.cc:276] 0709 13:05:33.034452 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:33.035599 (+  1147us) service_pool.cc:224] Handling call
0709 13:05:33.035947 (+   348us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:05:33.036362 (+   415us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:05:33.036390 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:05:33.036839 (+   449us) log.cc:844] Serialized 26 byte log entry
0709 13:05:33.739298 (+702459us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:05:33.739352 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:33.739442 (+    90us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:05:34.506155 (+766713us) raft_consensus.cc:1685] finished
0709 13:05:34.506218 (+    63us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:34.506579 (+   361us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1953,"raft.run_cpu_time_us":100,"raft.run_wall_time_us":2310,"thread_start_us":702142,"threads_started":1,"wal-append.queue_time_us":993364}
I20260709 13:05:34.499405 19409 raft_consensus.cc:2468] T b08304a0a02b42d7840c4e8ee9a6bd1a P e5256d91808b47c195bc9b4dbd7f2b87 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 9.
I20260709 13:05:34.500038 19410 rpcz_store.cc:276] 0709 13:05:33.119364 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:33.119504 (+   140us) service_pool.cc:224] Handling call
0709 13:05:33.119874 (+   370us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:05:33.146319 (+ 26445us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:05:33.146502 (+   183us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:05:33.169729 (+ 23227us) log.cc:844] Serialized 26 byte log entry
0709 13:05:33.557848 (+388119us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:05:33.557899 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:33.557990 (+    91us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:05:34.498563 (+940573us) raft_consensus.cc:1685] finished
0709 13:05:34.498618 (+    55us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:34.499014 (+   396us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":111701,"raft.run_cpu_time_us":98,"raft.run_wall_time_us":99,"thread_start_us":337384,"threads_started":1,"wal-append.queue_time_us":582700}
W20260709 13:05:34.226758 19523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.4:43121, user_credentials={real_user=slave}} blocked reactor thread for 231453us
W20260709 13:05:34.535017 22488 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.696s	user 0.007s	sys 0.026s
W20260709 13:05:34.535604 22488 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.709s	user 0.008s	sys 0.027s
I20260709 13:05:34.539724 19483 raft_consensus.cc:1240] T 309c3ca0ca4b4f3ba129752ea2cb293b P 0473d2b2d01f4459b1e90fd12cc7840e [term 7 LEADER]: Rejecting Update request from peer e61c3a8f61bb48f8a963c9480e53c168 for earlier term 6. Current term is 7. Ops: []
I20260709 13:05:34.551680 21962 raft_consensus.cc:2804] T 14efcc79969f41babe5529c22d59156d P e5256d91808b47c195bc9b4dbd7f2b87 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:05:34.552174 22534 raft_consensus.cc:2749] T f93ee515a9c14139bf566522ed8232f3 P e5256d91808b47c195bc9b4dbd7f2b87 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:05:34.552361 21962 raft_consensus.cc:493] T 14efcc79969f41babe5529c22d59156d P e5256d91808b47c195bc9b4dbd7f2b87 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:34.553613 21962 raft_consensus.cc:3060] T 14efcc79969f41babe5529c22d59156d P e5256d91808b47c195bc9b4dbd7f2b87 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:05:34.557304 19478 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58286 (request call id 1650) took 1319 ms. Trace:
I20260709 13:05:34.557581 22505 consensus_queue.cc:1059] T 9962423cb4e54fcfa5de01daf68a86e7 P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:05:34.557760 19478 rpcz_store.cc:276] 0709 13:05:33.237532 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:33.320536 (+ 83004us) service_pool.cc:224] Handling call
0709 13:05:33.320874 (+   338us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:05:33.987618 (+666744us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:34.556653 (+569035us) spinlock_profiling.cc:243] Waited 529 ms on lock 0x7b5400223154. stack: 00007f4a79de9343 00007f4a79de9240 00007f4a797781d4 00007f4a834b6304 00007f4a834b6299 00007f4a7ce71571 00007f4a7cf08e01 00007f4a7cf0783e 00007f4a81ecc419 00007f4a7b443bd4 00007f4a7b443b62 00007f4a7b443a91 00007f4a7b443a0c 00007f4a7b442cc2 00007f4a7b24348c 00007f4a7b2428c6
0709 13:05:34.557121 (+   468us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1216146304}
I20260709 13:05:34.558781 22505 consensus_queue.cc:1243] T 9962423cb4e54fcfa5de01daf68a86e7 P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Peer 127766fc592545a4997f7790f50f6076 log is divergent from this leader: its last log entry 11.10 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 9
W20260709 13:05:34.387738 22114 consensus_meta.cc:287] T 86a6797bdfe94fa496c050ceae4bd0d9 P e61c3a8f61bb48f8a963c9480e53c168: Time spent flushing consensus metadata: real 0.666s	user 0.010s	sys 0.002s
I20260709 13:05:34.563560 22369 leader_election.cc:290] T edd7d470b5014c9489be7f41f64355c9 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 8 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:05:34.563812 19409 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52328 (request call id 1665) took 1152 ms. Trace:
I20260709 13:05:34.564302 19409 rpcz_store.cc:276] 0709 13:05:33.411669 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:33.413217 (+  1548us) service_pool.cc:224] Handling call
0709 13:05:34.563550 (+1150333us) spinlock_profiling.cc:243] Waited 1.04 s on lock 0x7b5400196254. stack: 00007f4a79de9343 00007f4a79de9240 00007f4a797781d4 00007f4a834b6304 00007f4a834b6299 00007f4a7ce71571 00007f4a7cf0c2fa 00007f4a81ecdb17 00007f4a7b4486d4 00007f4a7b448662 00007f4a7b448591 00007f4a7b44850c 00007f4a7b4477c2 00007f4a7b24348c 00007f4a7b2428c6 00007f4a7b24226f
0709 13:05:34.563706 (+   156us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2396998400}
I20260709 13:05:34.569633 20108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab43d85f64114d4ebf618930e43d9ed0" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:05:34.571003 20108 raft_consensus.cc:2393] T ab43d85f64114d4ebf618930e43d9ed0 P 127766fc592545a4997f7790f50f6076 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0473d2b2d01f4459b1e90fd12cc7840e in current term 6: Already voted for candidate 127766fc592545a4997f7790f50f6076 in this term.
I20260709 13:05:34.551771 22530 raft_consensus.cc:2749] T ff75a1d4cb1f493db8f71ddc136ba9ab P e5256d91808b47c195bc9b4dbd7f2b87 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
W20260709 13:05:34.580624 19377 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.2:46257, user_credentials={real_user=slave}} blocked reactor thread for 79034.6us
W20260709 13:05:34.594851 19523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.4:43121, user_credentials={real_user=slave}} blocked reactor thread for 50959.9us
I20260709 13:05:34.596355 22174 raft_consensus.cc:3055] T 4af19371ea874c09a0a2147040835cbb P 127766fc592545a4997f7790f50f6076 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:05:34.596225 19523 leader_election.cc:304] T 2a16f7501e2444fb86d4e2778e734e02 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 127766fc592545a4997f7790f50f6076, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:05:34.596864 22174 raft_consensus.cc:740] T 4af19371ea874c09a0a2147040835cbb P 127766fc592545a4997f7790f50f6076 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 127766fc592545a4997f7790f50f6076, State: Running, Role: LEADER
I20260709 13:05:34.604975 22327 raft_consensus.cc:3055] T fa731b585f684a7fb2d106c50f143b83 P 127766fc592545a4997f7790f50f6076 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:05:34.605683 22327 raft_consensus.cc:740] T fa731b585f684a7fb2d106c50f143b83 P 127766fc592545a4997f7790f50f6076 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 127766fc592545a4997f7790f50f6076, State: Running, Role: LEADER
I20260709 13:05:34.606758 22374 raft_consensus.cc:493] T 86a6797bdfe94fa496c050ceae4bd0d9 P e5256d91808b47c195bc9b4dbd7f2b87 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:34.607713 22374 raft_consensus.cc:515] T 86a6797bdfe94fa496c050ceae4bd0d9 P e5256d91808b47c195bc9b4dbd7f2b87 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:34.614799 20105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48824d5acfbc485ebf8c2d944e7202de" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076"
I20260709 13:05:34.615716 20105 raft_consensus.cc:3060] T 48824d5acfbc485ebf8c2d944e7202de P 127766fc592545a4997f7790f50f6076 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:05:34.616899 22398 consensus_queue.cc:260] T 9962423cb4e54fcfa5de01daf68a86e7 P e5256d91808b47c195bc9b4dbd7f2b87 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:05:34.619925 22251 leader_election.cc:290] T a08760e15aac4630a629431f56024dc8 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:05:34.602497 22526 raft_consensus.cc:493] T b08304a0a02b42d7840c4e8ee9a6bd1a P 0473d2b2d01f4459b1e90fd12cc7840e [term 8 FOLLOWER]: Starting pre-election (detected failure of leader e5256d91808b47c195bc9b4dbd7f2b87)
I20260709 13:05:34.623721 22526 raft_consensus.cc:515] T b08304a0a02b42d7840c4e8ee9a6bd1a P 0473d2b2d01f4459b1e90fd12cc7840e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:34.626165 22526 leader_election.cc:290] T b08304a0a02b42d7840c4e8ee9a6bd1a P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
W20260709 13:05:34.631412 19375 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.3:36891, user_credentials={real_user=slave}} blocked reactor thread for 54189.8us
I20260709 13:05:34.656032 20110 raft_consensus.cc:1275] T 2a16f7501e2444fb86d4e2778e734e02 P 127766fc592545a4997f7790f50f6076 [term 8 FOLLOWER]: Refusing update from remote peer e5256d91808b47c195bc9b4dbd7f2b87: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
W20260709 13:05:34.656554 20076 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.17.223.3:36891 timed out after 1.668s (SENT) [suppressed 28 similar messages]
W20260709 13:05:34.658047 20076 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:34.660774 22374 leader_election.cc:290] T 86a6797bdfe94fa496c050ceae4bd0d9 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:05:34.661988 22174 consensus_queue.cc:260] T 4af19371ea874c09a0a2147040835cbb P 127766fc592545a4997f7790f50f6076 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:05:34.663414 22174 raft_consensus.cc:3060] T 4af19371ea874c09a0a2147040835cbb P 127766fc592545a4997f7790f50f6076 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:05:34.618527 22398 raft_consensus.cc:3060] T 9962423cb4e54fcfa5de01daf68a86e7 P e5256d91808b47c195bc9b4dbd7f2b87 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:05:34.675132 20105 raft_consensus.cc:2468] T 48824d5acfbc485ebf8c2d944e7202de P 127766fc592545a4997f7790f50f6076 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 8.
I20260709 13:05:34.681851 22504 consensus_queue.cc:1048] T 2a16f7501e2444fb86d4e2778e734e02 P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Connected to new peer: Peer: permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.005s
I20260709 13:05:34.679694 22385 leader_election.cc:290] T ab43d85f64114d4ebf618930e43d9ed0 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
W20260709 13:05:34.687713 19450 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.555s	user 0.004s	sys 0.012s
W20260709 13:05:34.688234 19450 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.653s	user 0.004s	sys 0.013s
I20260709 13:05:34.689548 20109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab43d85f64114d4ebf618930e43d9ed0" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
W20260709 13:05:34.680723 19523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.4:43121, user_credentials={real_user=slave}} blocked reactor thread for 84743.8us
I20260709 13:05:34.690445 20109 raft_consensus.cc:2468] T ab43d85f64114d4ebf618930e43d9ed0 P 127766fc592545a4997f7790f50f6076 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 6.
W20260709 13:05:34.703503 21957 consensus_meta.cc:287] T ece3db938bc649d4a40a51522ed5259c P e5256d91808b47c195bc9b4dbd7f2b87: Time spent flushing consensus metadata: real 0.975s	user 0.009s	sys 0.010s
I20260709 13:05:34.704412 22544 raft_consensus.cc:2764] T 2a16f7501e2444fb86d4e2778e734e02 P e61c3a8f61bb48f8a963c9480e53c168 [term 8 FOLLOWER]: Leader pre-election decision vote started in defunct term 7: won
I20260709 13:05:34.704352 21957 raft_consensus.cc:515] T ece3db938bc649d4a40a51522ed5259c P e5256d91808b47c195bc9b4dbd7f2b87 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:05:34.705885 22327 consensus_queue.cc:260] T fa731b585f684a7fb2d106c50f143b83 P 127766fc592545a4997f7790f50f6076 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:05:34.707504 22327 raft_consensus.cc:3060] T fa731b585f684a7fb2d106c50f143b83 P 127766fc592545a4997f7790f50f6076 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:05:34.722067 19526 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:05:34.733174 20077 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:34.726647 19485 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58294 (request call id 1820) took 1735 ms. Trace:
W20260709 13:05:34.746448 20076 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.3:36891, user_credentials={real_user=slave}} blocked reactor thread for 55814.4us
I20260709 13:05:34.679747 19308 catalog_manager.cc:5697] T 70797e5783b5454ab0d0eea663e791e3 P 127766fc592545a4997f7790f50f6076 reported cstate change: term changed from 3 to 6. New cstate: current_term: 6 leader_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } } }
W20260709 13:05:34.742769 19450 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.3:36891, user_credentials={real_user=slave}} blocked reactor thread for 708739us
W20260709 13:05:34.749722 20077 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:34.752707 19402 raft_consensus.cc:1275] T 22196caba61445d3bec98a0aab3c337d P e5256d91808b47c195bc9b4dbd7f2b87 [term 7 FOLLOWER]: Refusing update from remote peer 0473d2b2d01f4459b1e90fd12cc7840e: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:05:34.718051 19403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ec1c4ce15e04c7e8c283a62179f2a64" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:05:34.754626 19411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa8650e71aa14778b3d73721fc50d9fc" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
I20260709 13:05:34.756616 19411 raft_consensus.cc:3060] T fa8650e71aa14778b3d73721fc50d9fc P e5256d91808b47c195bc9b4dbd7f2b87 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:05:34.755663 19403 raft_consensus.cc:2393] T 5ec1c4ce15e04c7e8c283a62179f2a64 P e5256d91808b47c195bc9b4dbd7f2b87 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0473d2b2d01f4459b1e90fd12cc7840e in current term 6: Already voted for candidate e5256d91808b47c195bc9b4dbd7f2b87 in this term.
I20260709 13:05:34.681237 21962 raft_consensus.cc:515] T 14efcc79969f41babe5529c22d59156d P e5256d91808b47c195bc9b4dbd7f2b87 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:05:34.721452 22540 raft_consensus.cc:3055] T 22196caba61445d3bec98a0aab3c337d P e61c3a8f61bb48f8a963c9480e53c168 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:05:34.747350 19485 rpcz_store.cc:276] 0709 13:05:33.008493 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:33.036981 (+ 28488us) service_pool.cc:224] Handling call
0709 13:05:33.037281 (+   300us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:05:33.040556 (+  3275us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:05:33.040584 (+    28us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:05:33.114031 (+ 73447us) log.cc:844] Serialized 52 byte log entry
0709 13:05:33.702007 (+587976us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:05:33.741642 (+ 39635us) log.cc:844] Serialized 14 byte log entry
0709 13:05:34.725100 (+983458us) spinlock_profiling.cc:243] Waited 4.44 ms on lock 0x7b18003e31a0. stack: 00007f4a79de9343 00007f4a79de9240 00007f4a797781d4 00007f4a834b6304 00007f4a834b6299 00007f4a82ce3de1 00007f4a82cf05b1 00007f4a79d95c0a 00007f4a834d5219 00007f4a79e1da40 00007f4a79e184e4 00007f4a79e18455 00007f4a809003c7 00007f4a7cf129a7 00007f4a7cf220bf 00007f4a7cf22038
0709 13:05:34.725422 (+   322us) log.cc:844] Serialized 14 byte log entry
0709 13:05:34.725834 (+   412us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:34.725966 (+   132us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:05:34.726159 (+   193us) raft_consensus.cc:1685] finished
0709 13:05:34.726189 (+    30us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:34.726419 (+   230us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":980637,"prepare.queue_time_us":1022266,"prepare.run_cpu_time_us":94,"prepare.run_wall_time_us":94,"raft.queue_time_us":120006,"raft.run_cpu_time_us":384,"raft.run_wall_time_us":147526,"spinlock_wait_cycles":10222976,"thread_start_us":490203,"threads_started":1,"wal-append.queue_time_us":860525}
I20260709 13:05:34.758637 21926 raft_consensus.cc:515] T 1dc5b3532fe54f74876d02beffa2c230 P e5256d91808b47c195bc9b4dbd7f2b87 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
W20260709 13:05:34.765590 20078 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:34.710868 22381 leader_election.cc:290] T ef32ce6fdd0e40d382c79974f30295c6 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:05:34.715847 22389 raft_consensus.cc:3060] T 46c5bfeecc314717bffe987e6844b6d0 P e61c3a8f61bb48f8a963c9480e53c168 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:05:34.767202 20075 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.1:40321, user_credentials={real_user=slave}} blocked reactor thread for 83143.2us
I20260709 13:05:34.732764 19449 leader_election.cc:304] T ab43d85f64114d4ebf618930e43d9ed0 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e; no voters: 127766fc592545a4997f7790f50f6076, e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:05:34.768355 22381 raft_consensus.cc:3060] T ab43d85f64114d4ebf618930e43d9ed0 P 0473d2b2d01f4459b1e90fd12cc7840e [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:05:34.770567 19403 raft_consensus.cc:1275] T 309c3ca0ca4b4f3ba129752ea2cb293b P e5256d91808b47c195bc9b4dbd7f2b87 [term 7 FOLLOWER]: Refusing update from remote peer 0473d2b2d01f4459b1e90fd12cc7840e: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:05:34.772231 22114 consensus_queue.cc:1059] T 1a61655d99124a29b486ba4a5b37faea P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:05:34.773265 22114 consensus_queue.cc:1243] T 1a61655d99124a29b486ba4a5b37faea P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Peer 0473d2b2d01f4459b1e90fd12cc7840e log is divergent from this leader: its last log entry 5.3 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 2
I20260709 13:05:34.774176 22544 raft_consensus.cc:3055] T 1a61655d99124a29b486ba4a5b37faea P e61c3a8f61bb48f8a963c9480e53c168 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:05:34.767370 21926 leader_election.cc:290] T 1dc5b3532fe54f74876d02beffa2c230 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 7 election: Requested vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:05:34.774657 22544 raft_consensus.cc:740] T 1a61655d99124a29b486ba4a5b37faea P e61c3a8f61bb48f8a963c9480e53c168 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: e61c3a8f61bb48f8a963c9480e53c168, State: Running, Role: LEADER
I20260709 13:05:34.776084 22544 consensus_queue.cc:260] T 1a61655d99124a29b486ba4a5b37faea P e61c3a8f61bb48f8a963c9480e53c168 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:34.777251 19403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef32ce6fdd0e40d382c79974f30295c6" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:05:34.717329 19407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4509b76741dc428e9201c70c1658da13" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
W20260709 13:05:34.876611 22527 consensus_meta.cc:287] T 6c5eebf646ad445a9d1b1adc319d7b16 P 0473d2b2d01f4459b1e90fd12cc7840e: Time spent flushing consensus metadata: real 0.529s	user 0.010s	sys 0.009s
I20260709 13:05:34.716037 19523 leader_election.cc:304] T 14935b3ddf914369822e4a0547aaa355 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: e61c3a8f61bb48f8a963c9480e53c168; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, 127766fc592545a4997f7790f50f6076
W20260709 13:05:34.832767 19452 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:34.826571 19408 raft_consensus.cc:1275] T 1a61655d99124a29b486ba4a5b37faea P e5256d91808b47c195bc9b4dbd7f2b87 [term 5 FOLLOWER]: Refusing update from remote peer 0473d2b2d01f4459b1e90fd12cc7840e: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
W20260709 13:05:34.778071 19449 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:05:34.855940 19377 leader_election.cc:336] T 179fd671030940b4b4a4e24bcc4aba0a P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257): Timed out: RequestConsensusVote RPC to 127.17.223.2:46257 timed out after 1.708s (SENT)
W20260709 13:05:34.834802 19526 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:34.761529 19405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edd7d470b5014c9489be7f41f64355c9" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
W20260709 13:05:34.868484 20078 leader_election.cc:336] T 96efeaaf1057492490e9a621f37e1a2d P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257): Timed out: RequestConsensusVote RPC to 127.17.223.2:46257 timed out after 1.668s (SENT)
I20260709 13:05:34.823204 19402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b08304a0a02b42d7840c4e8ee9a6bd1a" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:05:34.820739 20110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ec1c4ce15e04c7e8c283a62179f2a64" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
W20260709 13:05:34.888898 19526 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:34.887073 19402 raft_consensus.cc:2468] T b08304a0a02b42d7840c4e8ee9a6bd1a P e5256d91808b47c195bc9b4dbd7f2b87 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 9.
I20260709 13:05:34.761423 21957 leader_election.cc:290] T ece3db938bc649d4a40a51522ed5259c P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 8 election: Requested vote from peers e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:05:34.761657 22111 raft_consensus.cc:493] T 833a2f0775ed407a94b8924ce50adb63 P 127766fc592545a4997f7790f50f6076 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:34.825619 19450 leader_election.cc:304] T 179fd671030940b4b4a4e24bcc4aba0a P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e; no voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:05:34.777333 22544 raft_consensus.cc:3060] T 1a61655d99124a29b486ba4a5b37faea P e61c3a8f61bb48f8a963c9480e53c168 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:05:34.825524 22483 consensus_meta.cc:287] T 775c229504194560ba9589bc2199b089 P 0473d2b2d01f4459b1e90fd12cc7840e: Time spent flushing consensus metadata: real 0.921s	user 0.017s	sys 0.001s
I20260709 13:05:34.901839 19554 raft_consensus.cc:1275] T bc225c93219c45538b53a1bd3d387e4d P e61c3a8f61bb48f8a963c9480e53c168 [term 10 FOLLOWER]: Refusing update from remote peer e5256d91808b47c195bc9b4dbd7f2b87: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:05:34.901976 19410 raft_consensus.cc:1240] T fa731b585f684a7fb2d106c50f143b83 P e5256d91808b47c195bc9b4dbd7f2b87 [term 7 LEADER]: Rejecting Update request from peer 127766fc592545a4997f7790f50f6076 for earlier term 6. Current term is 7. Ops: [6.7-6.7]
I20260709 13:05:34.903285 19481 raft_consensus.cc:1275] T 775c229504194560ba9589bc2199b089 P 0473d2b2d01f4459b1e90fd12cc7840e [term 6 FOLLOWER]: Refusing update from remote peer 127766fc592545a4997f7790f50f6076: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 7. (term mismatch)
I20260709 13:05:34.903625 19481 pending_rounds.cc:85] T 775c229504194560ba9589bc2199b089 P 0473d2b2d01f4459b1e90fd12cc7840e: Aborting all ops after (but not including) 6
I20260709 13:05:34.903961 19481 pending_rounds.cc:107] T 775c229504194560ba9589bc2199b089 P 0473d2b2d01f4459b1e90fd12cc7840e: Aborting uncommitted NO_OP operation due to leader change: 5.7
I20260709 13:05:34.904285 19481 raft_consensus.cc:2889] T 775c229504194560ba9589bc2199b089 P 0473d2b2d01f4459b1e90fd12cc7840e [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:05:34.905171 22549 raft_consensus.cc:493] T 775c229504194560ba9589bc2199b089 P 0473d2b2d01f4459b1e90fd12cc7840e [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:34.905710 22549 raft_consensus.cc:515] T 775c229504194560ba9589bc2199b089 P 0473d2b2d01f4459b1e90fd12cc7840e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:05:34.906973 19558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a08760e15aac4630a629431f56024dc8" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:05:34.907411 19403 raft_consensus.cc:2393] T ef32ce6fdd0e40d382c79974f30295c6 P e5256d91808b47c195bc9b4dbd7f2b87 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0473d2b2d01f4459b1e90fd12cc7840e in current term 8: Already voted for candidate e61c3a8f61bb48f8a963c9480e53c168 in this term.
I20260709 13:05:34.907699 19558 raft_consensus.cc:2468] T a08760e15aac4630a629431f56024dc8 P e61c3a8f61bb48f8a963c9480e53c168 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 7.
I20260709 13:05:34.910544 19404 raft_consensus.cc:1240] T 4af19371ea874c09a0a2147040835cbb P e5256d91808b47c195bc9b4dbd7f2b87 [term 5 LEADER]: Rejecting Update request from peer 127766fc592545a4997f7790f50f6076 for earlier term 4. Current term is 5. Ops: []
I20260709 13:05:34.912575 22480 raft_consensus.cc:493] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P 0473d2b2d01f4459b1e90fd12cc7840e [term 9 FOLLOWER]: Starting pre-election (detected failure of leader e5256d91808b47c195bc9b4dbd7f2b87)
I20260709 13:05:34.913226 22480 raft_consensus.cc:515] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P 0473d2b2d01f4459b1e90fd12cc7840e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
W20260709 13:05:34.914506 20075 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:34.915512 22480 leader_election.cc:290] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:05:34.894408 20110 raft_consensus.cc:2468] T 5ec1c4ce15e04c7e8c283a62179f2a64 P 127766fc592545a4997f7790f50f6076 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 6.
I20260709 13:05:34.761374 21962 leader_election.cc:290] T 14efcc79969f41babe5529c22d59156d P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 8 election: Requested vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:05:34.777338 22470 raft_consensus.cc:493] T 1f85fc4b527a48848e5faa083b604e36 P 0473d2b2d01f4459b1e90fd12cc7840e [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 127766fc592545a4997f7790f50f6076)
I20260709 13:05:34.762228 22540 raft_consensus.cc:740] T 22196caba61445d3bec98a0aab3c337d P e61c3a8f61bb48f8a963c9480e53c168 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: e61c3a8f61bb48f8a963c9480e53c168, State: Running, Role: LEADER
I20260709 13:05:34.901257 22373 raft_consensus.cc:2749] T 14935b3ddf914369822e4a0547aaa355 P e61c3a8f61bb48f8a963c9480e53c168 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:05:34.903760 19406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b74109013a140ada21feeef92d6f563" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:05:34.892625 19405 raft_consensus.cc:3060] T edd7d470b5014c9489be7f41f64355c9 P e5256d91808b47c195bc9b4dbd7f2b87 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:05:34.899684 19523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.4:43121, user_credentials={real_user=slave}} blocked reactor thread for 183876us
I20260709 13:05:34.878108 22527 raft_consensus.cc:2749] T 6c5eebf646ad445a9d1b1adc319d7b16 P 0473d2b2d01f4459b1e90fd12cc7840e [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:05:34.920614 19407 raft_consensus.cc:3060] T 4509b76741dc428e9201c70c1658da13 P e5256d91808b47c195bc9b4dbd7f2b87 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:05:34.933769 20109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14efcc79969f41babe5529c22d59156d" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076"
I20260709 13:05:34.932063 19481 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39478 (request call id 398) took 1753 ms. Trace:
I20260709 13:05:34.934557 19481 rpcz_store.cc:276] 0709 13:05:33.176201 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:33.194007 (+ 17806us) service_pool.cc:224] Handling call
0709 13:05:33.194285 (+   278us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:34.904884 (+1710599us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:34.920167 (+ 15283us) spinlock_profiling.cc:243] Waited 1.71 s on lock 0x7b540029e354. stack: 00007f4a79de9343 00007f4a79de9240 00007f4a797781d4 00007f4a834b6304 00007f4a834b6299 00007f4a7ce71571 00007f4a7cf08e01 00007f4a7cf0783e 00007f4a81ecc419 00007f4a7b443bd4 00007f4a7b443b62 00007f4a7b443a91 00007f4a7b443a0c 00007f4a7b442cc2 00007f4a7b24348c 00007f4a7b2428c6
0709 13:05:34.929434 (+  9267us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3929029376}
I20260709 13:05:34.939553 19558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86a6797bdfe94fa496c050ceae4bd0d9" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 8 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:05:34.944413 20108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ece3db938bc649d4a40a51522ed5259c" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076"
W20260709 13:05:34.953291 19377 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.2:46257, user_credentials={real_user=slave}} blocked reactor thread for 110112us
I20260709 13:05:34.951908 22558 raft_consensus.cc:493] T 172b3dd13109415a955b71ac0e9d2234 P 127766fc592545a4997f7790f50f6076 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:34.952615 19523 leader_election.cc:304] T 6c5eebf646ad445a9d1b1adc319d7b16 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e61c3a8f61bb48f8a963c9480e53c168; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, 127766fc592545a4997f7790f50f6076
I20260709 13:05:34.956519 19558 raft_consensus.cc:2410] T 86a6797bdfe94fa496c050ceae4bd0d9 P e61c3a8f61bb48f8a963c9480e53c168 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e5256d91808b47c195bc9b4dbd7f2b87 for term 8 because replica has last-logged OpId of term: 6 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 2.
I20260709 13:05:34.957232 20109 raft_consensus.cc:2393] T 14efcc79969f41babe5529c22d59156d P 127766fc592545a4997f7790f50f6076 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate e5256d91808b47c195bc9b4dbd7f2b87 in current term 8: Already voted for candidate 127766fc592545a4997f7790f50f6076 in this term.
I20260709 13:05:34.957623 22399 raft_consensus.cc:493] T d1e5873a19244c5ebbcd38e126796ee7 P e5256d91808b47c195bc9b4dbd7f2b87 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:34.958249 22399 raft_consensus.cc:515] T d1e5873a19244c5ebbcd38e126796ee7 P e5256d91808b47c195bc9b4dbd7f2b87 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
W20260709 13:05:34.955129 20076 leader_election.cc:336] T 48824d5acfbc485ebf8c2d944e7202de P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891): Timed out: RequestConsensusVote RPC to 127.17.223.3:36891 timed out after 1.762s (SENT)
W20260709 13:05:34.963737 22503 consensus_meta.cc:287] T 0cdf56e38bbc453d9438d359e5a69955 P e5256d91808b47c195bc9b4dbd7f2b87: Time spent flushing consensus metadata: real 0.551s	user 0.015s	sys 0.000s
I20260709 13:05:34.933773 22111 raft_consensus.cc:515] T 833a2f0775ed407a94b8924ce50adb63 P 127766fc592545a4997f7790f50f6076 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:05:34.967626 19483 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58286 (request call id 1652) took 1729 ms. Trace:
I20260709 13:05:34.968024 19483 rpcz_store.cc:276] 0709 13:05:33.238165 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:33.355133 (+116968us) service_pool.cc:224] Handling call
0709 13:05:33.374618 (+ 19485us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:34.540378 (+1165760us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:34.967369 (+426991us) spinlock_profiling.cc:243] Waited 1.16 s on lock 0x7b540029d454. stack: 00007f4a79de9343 00007f4a79de9240 00007f4a797781d4 00007f4a834b6304 00007f4a834b6299 00007f4a7ce71571 00007f4a7cf08e01 00007f4a7cf0783e 00007f4a81ecc419 00007f4a7b443bd4 00007f4a7b443b62 00007f4a7b443a91 00007f4a7b443a0c 00007f4a7b442cc2 00007f4a7b24348c 00007f4a7b2428c6
0709 13:05:34.967567 (+   198us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2674002304}
I20260709 13:05:34.968887 22111 leader_election.cc:290] T 833a2f0775ed407a94b8924ce50adb63 P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:05:34.970643 19405 raft_consensus.cc:2468] T edd7d470b5014c9489be7f41f64355c9 P e5256d91808b47c195bc9b4dbd7f2b87 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 8.
W20260709 13:05:34.972532 20078 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:34.972416 20076 leader_election.cc:304] T 48824d5acfbc485ebf8c2d944e7202de P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 127766fc592545a4997f7790f50f6076; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:05:34.954356 22480 raft_consensus.cc:2749] T 179fd671030940b4b4a4e24bcc4aba0a P 0473d2b2d01f4459b1e90fd12cc7840e [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:05:34.974838 22558 raft_consensus.cc:515] T 172b3dd13109415a955b71ac0e9d2234 P 127766fc592545a4997f7790f50f6076 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:05:34.987334 22558 leader_election.cc:290] T 172b3dd13109415a955b71ac0e9d2234 P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:05:34.982101 22399 leader_election.cc:290] T d1e5873a19244c5ebbcd38e126796ee7 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
W20260709 13:05:34.982901 22581 log.cc:927] Time spent T 2a16f7501e2444fb86d4e2778e734e02 P 127766fc592545a4997f7790f50f6076: Append to log took a long time: real 0.067s	user 0.000s	sys 0.001s
I20260709 13:05:34.944552 22470 raft_consensus.cc:515] T 1f85fc4b527a48848e5faa083b604e36 P 0473d2b2d01f4459b1e90fd12cc7840e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:05:34.990877 19553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab43d85f64114d4ebf618930e43d9ed0" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:05:34.990695 22540 consensus_queue.cc:260] T 22196caba61445d3bec98a0aab3c337d P e61c3a8f61bb48f8a963c9480e53c168 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 3, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:34.992614 22470 leader_election.cc:290] T 1f85fc4b527a48848e5faa083b604e36 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:05:34.995280 22524 raft_consensus.cc:3060] T 3e1f505cb0f1427bbd698ac889d80821 P 0473d2b2d01f4459b1e90fd12cc7840e [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:05:35.001260 19484 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58294 (request call id 1804) took 2752 ms. Trace:
W20260709 13:05:34.999450 20076 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.3:36891, user_credentials={real_user=slave}} blocked reactor thread for 55015us
W20260709 13:05:35.003602 20076 leader_election.cc:336] T ab43d85f64114d4ebf618930e43d9ed0 P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891): Timed out: RequestConsensusVote RPC to 127.17.223.3:36891 timed out after 1.777s (SENT)
I20260709 13:05:35.001678 19484 rpcz_store.cc:276] 0709 13:05:32.248707 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:32.300895 (+ 52188us) service_pool.cc:224] Handling call
0709 13:05:32.301166 (+   271us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:05:32.824281 (+523115us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:05:32.824309 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:05:32.824796 (+   487us) log.cc:844] Serialized 26 byte log entry
0709 13:05:33.232823 (+408027us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:05:33.994175 (+761352us) log.cc:844] Serialized 14 byte log entry
0709 13:05:33.994411 (+   236us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:35.000582 (+1006171us) spinlock_profiling.cc:243] Waited 523 ms on lock 0x7b54000a9454. stack: 00007f4a79de9343 00007f4a79de9240 00007f4a797781d4 00007f4a834b6304 00007f4a834b6299 00007f4a7ce71571 00007f4a7cf08e01 00007f4a7cf0783e 00007f4a81ecc419 00007f4a7b443bd4 00007f4a7b443b62 00007f4a7b443a91 00007f4a7b443a0c 00007f4a7b442cc2 00007f4a7b24348c 00007f4a7b2428c6
0709 13:05:35.000693 (+   111us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:05:35.000770 (+    77us) raft_consensus.cc:1685] finished
0709 13:05:35.000854 (+    84us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:35.001060 (+   206us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":22080,"prepare.run_cpu_time_us":50,"prepare.run_wall_time_us":50,"raft.queue_time_us":234351,"raft.run_cpu_time_us":139,"raft.run_wall_time_us":8996,"spinlock_wait_cycles":1202550528,"thread_start_us":1153972,"threads_started":2,"wal-append.queue_time_us":588997}
I20260709 13:05:35.007504 22549 leader_election.cc:290] T 775c229504194560ba9589bc2199b089 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:05:35.018365 22549 consensus_queue.cc:1048] T 22196caba61445d3bec98a0aab3c337d P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:05:35.019906 22399 raft_consensus.cc:493] T ff9b0eddd810459b82d91c60777c10eb P e5256d91808b47c195bc9b4dbd7f2b87 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:35.020071 22549 consensus_queue.cc:1048] T 309c3ca0ca4b4f3ba129752ea2cb293b P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:05:35.020823 22399 raft_consensus.cc:515] T ff9b0eddd810459b82d91c60777c10eb P e5256d91808b47c195bc9b4dbd7f2b87 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
W20260709 13:05:35.023772 19376 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:35.024549 22413 raft_consensus.cc:493] T 40e1e16737a842ee936002830f36882e P e61c3a8f61bb48f8a963c9480e53c168 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:05:35.025053 19523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.4:43121, user_credentials={real_user=slave}} blocked reactor thread for 94317.5us
I20260709 13:05:35.025269 22413 raft_consensus.cc:515] T 40e1e16737a842ee936002830f36882e P e61c3a8f61bb48f8a963c9480e53c168 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:35.026163 22399 leader_election.cc:290] T ff9b0eddd810459b82d91c60777c10eb P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
W20260709 13:05:35.026911 19450 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.3:36891, user_credentials={real_user=slave}} blocked reactor thread for 201470us
I20260709 13:05:35.027398 19523 leader_election.cc:304] T 0e1085d23e8347fbbd5bce7542f4b1f4 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e61c3a8f61bb48f8a963c9480e53c168; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, 127766fc592545a4997f7790f50f6076
I20260709 13:05:35.028909 22285 raft_consensus.cc:2749] T 6c5eebf646ad445a9d1b1adc319d7b16 P e61c3a8f61bb48f8a963c9480e53c168 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:05:35.029798 22285 raft_consensus.cc:2749] T 0e1085d23e8347fbbd5bce7542f4b1f4 P e61c3a8f61bb48f8a963c9480e53c168 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
W20260709 13:05:35.030292 19374 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:35.007735 19484 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1a61655d99124a29b486ba4a5b37faea"
dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
mode: GRACEFUL
new_leader_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
 from {username='slave'} at 127.0.0.1:48168
I20260709 13:05:35.031044 22480 consensus_queue.cc:1048] T 1a61655d99124a29b486ba4a5b37faea P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:05:35.008282 19411 raft_consensus.cc:2468] T fa8650e71aa14778b3d73721fc50d9fc P e5256d91808b47c195bc9b4dbd7f2b87 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 9.
I20260709 13:05:35.008201 22558 raft_consensus.cc:2749] T 48824d5acfbc485ebf8c2d944e7202de P 127766fc592545a4997f7790f50f6076 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:05:35.012835 19556 raft_consensus.cc:2410] T 46c5bfeecc314717bffe987e6844b6d0 P e61c3a8f61bb48f8a963c9480e53c168 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 0473d2b2d01f4459b1e90fd12cc7840e for term 13 because replica has last-logged OpId of term: 12 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 4.
I20260709 13:05:35.017299 20103 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35874 (request call id 583) took 1365 ms. Trace:
I20260709 13:05:35.032990 19484 raft_consensus.cc:606] T 1a61655d99124a29b486ba4a5b37faea P 0473d2b2d01f4459b1e90fd12cc7840e [term 5 LEADER]: Received request to transfer leadership to TS e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:05:35.033375 20103 rpcz_store.cc:276] 0709 13:05:33.651690 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:33.651887 (+   197us) service_pool.cc:224] Handling call
0709 13:05:33.652189 (+   302us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:34.322995 (+670806us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:35.016657 (+693662us) spinlock_profiling.cc:243] Waited 670 ms on lock 0x7b54002468d4. stack: 00007f4a79de9343 00007f4a79de9240 00007f4a797781d4 00007f4a834b6304 00007f4a834b6299 00007f4a7ce71571 00007f4a7cf08e01 00007f4a7cf0783e 00007f4a81ecc419 00007f4a7b443bd4 00007f4a7b443b62 00007f4a7b443a91 00007f4a7b443a0c 00007f4a7b442cc2 00007f4a7b24348c 00007f4a7b2428c6
0709 13:05:35.017011 (+   354us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1541023488}
I20260709 13:05:35.035347 19556 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40428 (request call id 2089) took 1192 ms. Trace:
I20260709 13:05:35.035738 19556 rpcz_store.cc:276] 0709 13:05:33.842462 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:33.846174 (+  3712us) service_pool.cc:224] Handling call
0709 13:05:35.035091 (+1188917us) spinlock_profiling.cc:243] Waited 1.02 s on lock 0x7b5400341a54. stack: 00007f4a79de9343 00007f4a79de9240 00007f4a797781d4 00007f4a834b6304 00007f4a834b6299 00007f4a7ce71571 00007f4a7cf0c2fa 00007f4a81ecdb17 00007f4a7b4486d4 00007f4a7b448662 00007f4a7b448591 00007f4a7b44850c 00007f4a7b4477c2 00007f4a7b24348c 00007f4a7b2428c6 00007f4a7b24226f
0709 13:05:35.035264 (+   173us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2356979584}
I20260709 13:05:35.027948 19450 leader_election.cc:400] T 40e1e16737a842ee936002830f36882e P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 8 election: Vote denied by peer e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891) with higher term. Message: Invalid argument: T 40e1e16737a842ee936002830f36882e P e61c3a8f61bb48f8a963c9480e53c168 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 0473d2b2d01f4459b1e90fd12cc7840e for earlier term 8. Current term is 9.
I20260709 13:05:35.047650 19450 leader_election.cc:403] T 40e1e16737a842ee936002830f36882e P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 8 election: Cancelling election due to peer responding with higher term
I20260709 13:05:35.049686 19484 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "28af091831594f9d8e96482078cc7625"
dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
mode: GRACEFUL
new_leader_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
 from {username='slave'} at 127.0.0.1:48168
I20260709 13:05:35.040447 19449 leader_election.cc:304] T b08304a0a02b42d7840c4e8ee9a6bd1a P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87; no voters: 
I20260709 13:05:35.050407 19484 raft_consensus.cc:606] T 28af091831594f9d8e96482078cc7625 P 0473d2b2d01f4459b1e90fd12cc7840e [term 7 FOLLOWER]: Received request to transfer leadership to TS e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:05:35.050740 22549 raft_consensus.cc:2804] T b08304a0a02b42d7840c4e8ee9a6bd1a P 0473d2b2d01f4459b1e90fd12cc7840e [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:05:35.051498 22549 raft_consensus.cc:493] T b08304a0a02b42d7840c4e8ee9a6bd1a P 0473d2b2d01f4459b1e90fd12cc7840e [term 8 FOLLOWER]: Starting leader election (detected failure of leader e5256d91808b47c195bc9b4dbd7f2b87)
I20260709 13:05:35.051968 22549 raft_consensus.cc:3060] T b08304a0a02b42d7840c4e8ee9a6bd1a P 0473d2b2d01f4459b1e90fd12cc7840e [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:05:35.048843 21957 consensus_queue.cc:1048] T bc225c93219c45538b53a1bd3d387e4d P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:05:35.050930 19484 raft_consensus.cc:614] T 28af091831594f9d8e96482078cc7625 P 0473d2b2d01f4459b1e90fd12cc7840e [term 7 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:05:35.048666 19552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ece3db938bc649d4a40a51522ed5259c" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:05:35.060359 19410 raft_consensus.cc:1240] T ece3db938bc649d4a40a51522ed5259c P e5256d91808b47c195bc9b4dbd7f2b87 [term 8 FOLLOWER]: Rejecting Update request from peer 127766fc592545a4997f7790f50f6076 for earlier term 7. Current term is 8. Ops: []
W20260709 13:05:35.060484 19377 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.2:46257, user_credentials={real_user=slave}} blocked reactor thread for 70260.8us
I20260709 13:05:34.999686 22381 raft_consensus.cc:2749] T ab43d85f64114d4ebf618930e43d9ed0 P 0473d2b2d01f4459b1e90fd12cc7840e [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:05:35.088943 19411 raft_consensus.cc:1275] T 9962423cb4e54fcfa5de01daf68a86e7 P e5256d91808b47c195bc9b4dbd7f2b87 [term 11 FOLLOWER]: Refusing update from remote peer 127766fc592545a4997f7790f50f6076: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:05:35.050592 19523 leader_election.cc:304] T bc225c93219c45538b53a1bd3d387e4d P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168; no voters: 0473d2b2d01f4459b1e90fd12cc7840e
I20260709 13:05:35.087702 19375 leader_election.cc:304] T a08760e15aac4630a629431f56024dc8 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
W20260709 13:05:35.088444 20078 leader_election.cc:336] T 775c229504194560ba9589bc2199b089 P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257): Timed out: RequestConsensusVote RPC to 127.17.223.2:46257 timed out after 1.836s (SENT)
I20260709 13:05:35.096097 19553 raft_consensus.cc:1275] T 40e1e16737a842ee936002830f36882e P e61c3a8f61bb48f8a963c9480e53c168 [term 9 FOLLOWER]: Refusing update from remote peer e5256d91808b47c195bc9b4dbd7f2b87: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:05:35.097359 19552 raft_consensus.cc:3060] T ece3db938bc649d4a40a51522ed5259c P e61c3a8f61bb48f8a963c9480e53c168 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:05:35.096097 19556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dc5b3532fe54f74876d02beffa2c230" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:05:35.103195 19407 raft_consensus.cc:2468] T 4509b76741dc428e9201c70c1658da13 P e5256d91808b47c195bc9b4dbd7f2b87 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 4.
I20260709 13:05:35.103695 19556 raft_consensus.cc:3060] T 1dc5b3532fe54f74876d02beffa2c230 P e61c3a8f61bb48f8a963c9480e53c168 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:05:35.063400 22413 leader_election.cc:290] T 40e1e16737a842ee936002830f36882e P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
W20260709 13:05:35.114986 19449 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.1:40321, user_credentials={real_user=slave}} blocked reactor thread for 59135us
W20260709 13:05:35.121620 20077 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:35.121356 19449 leader_election.cc:304] T edd7d470b5014c9489be7f41f64355c9 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87; no voters: 
I20260709 13:05:35.126068 19407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "833a2f0775ed407a94b8924ce50adb63" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
W20260709 13:05:35.130406 20078 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.2:46257, user_credentials={real_user=slave}} blocked reactor thread for 70097.9us
I20260709 13:05:35.129443 22516 raft_consensus.cc:2764] T bc225c93219c45538b53a1bd3d387e4d P e61c3a8f61bb48f8a963c9480e53c168 [term 10 FOLLOWER]: Leader pre-election decision vote started in defunct term 8: won
I20260709 13:05:35.127789 19558 raft_consensus.cc:1275] T 4af19371ea874c09a0a2147040835cbb P e61c3a8f61bb48f8a963c9480e53c168 [term 5 FOLLOWER]: Refusing update from remote peer e5256d91808b47c195bc9b4dbd7f2b87: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:05:35.132452 19449 leader_election.cc:304] T fa8650e71aa14778b3d73721fc50d9fc P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87; no voters: 
I20260709 13:05:35.143257 19551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e5873a19244c5ebbcd38e126796ee7" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 10 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:05:35.121138 22540 raft_consensus.cc:3060] T 22196caba61445d3bec98a0aab3c337d P e61c3a8f61bb48f8a963c9480e53c168 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:05:35.144037 19551 raft_consensus.cc:2468] T d1e5873a19244c5ebbcd38e126796ee7 P e61c3a8f61bb48f8a963c9480e53c168 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 9.
I20260709 13:05:35.119608 22470 raft_consensus.cc:2749] T 40e1e16737a842ee936002830f36882e P 0473d2b2d01f4459b1e90fd12cc7840e [term 9 FOLLOWER]: Leader election lost for term 8. Reason: Vote denied by peer e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891) with higher term. Message: Invalid argument: T 40e1e16737a842ee936002830f36882e P e61c3a8f61bb48f8a963c9480e53c168 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 0473d2b2d01f4459b1e90fd12cc7840e for earlier term 8. Current term is 9.
I20260709 13:05:35.148095 19484 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2b74109013a140ada21feeef92d6f563"
dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
mode: GRACEFUL
new_leader_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
 from {username='slave'} at 127.0.0.1:48168
W20260709 13:05:35.148156 20077 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:05:35.150128 19450 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.3:36891, user_credentials={real_user=slave}} blocked reactor thread for 122403us
I20260709 13:05:35.148509 19410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "172b3dd13109415a955b71ac0e9d2234" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:05:35.158785 20103 raft_consensus.cc:1275] T 4af19371ea874c09a0a2147040835cbb P 127766fc592545a4997f7790f50f6076 [term 5 FOLLOWER]: Refusing update from remote peer e5256d91808b47c195bc9b4dbd7f2b87: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:05:35.161695 22111 consensus_queue.cc:1059] T ece3db938bc649d4a40a51522ed5259c P 127766fc592545a4997f7790f50f6076 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:05:35.162487 22380 consensus_queue.cc:237] T 7be9efa6559648dbb5a0f7684c4542d1 P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 4, Current term: 7, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } attrs { replace: true } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:05:35.163115 22111 consensus_queue.cc:1048] T 9962423cb4e54fcfa5de01daf68a86e7 P 127766fc592545a4997f7790f50f6076 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:05:35.166468 22251 raft_consensus.cc:493] T df751f992649444090e27965eb1af85d P e5256d91808b47c195bc9b4dbd7f2b87 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 0473d2b2d01f4459b1e90fd12cc7840e)
I20260709 13:05:35.167152 22251 raft_consensus.cc:515] T df751f992649444090e27965eb1af85d P e5256d91808b47c195bc9b4dbd7f2b87 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:35.170570 22534 consensus_queue.cc:1048] T 833a2f0775ed407a94b8924ce50adb63 P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Connected to new peer: Peer: permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:05:35.172112 22534 consensus_queue.cc:1048] T 4af19371ea874c09a0a2147040835cbb P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Connected to new peer: Peer: permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:05:35.173189 20105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff9b0eddd810459b82d91c60777c10eb" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:05:35.173854 20105 raft_consensus.cc:2468] T ff9b0eddd810459b82d91c60777c10eb P 127766fc592545a4997f7790f50f6076 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 5.
I20260709 13:05:35.174579 21926 raft_consensus.cc:2804] T a08760e15aac4630a629431f56024dc8 P e5256d91808b47c195bc9b4dbd7f2b87 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:05:35.175062 21926 raft_consensus.cc:493] T a08760e15aac4630a629431f56024dc8 P e5256d91808b47c195bc9b4dbd7f2b87 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:35.175427 21926 raft_consensus.cc:3060] T a08760e15aac4630a629431f56024dc8 P e5256d91808b47c195bc9b4dbd7f2b87 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:05:35.176468 22374 raft_consensus.cc:493] T ef32ce6fdd0e40d382c79974f30295c6 P e5256d91808b47c195bc9b4dbd7f2b87 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:35.177022 22374 raft_consensus.cc:515] T ef32ce6fdd0e40d382c79974f30295c6 P e5256d91808b47c195bc9b4dbd7f2b87 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:35.182740 22526 raft_consensus.cc:2804] T edd7d470b5014c9489be7f41f64355c9 P 0473d2b2d01f4459b1e90fd12cc7840e [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:05:35.183423 22526 raft_consensus.cc:697] T edd7d470b5014c9489be7f41f64355c9 P 0473d2b2d01f4459b1e90fd12cc7840e [term 8 LEADER]: Becoming Leader. State: Replica: 0473d2b2d01f4459b1e90fd12cc7840e, State: Running, Role: LEADER
I20260709 13:05:35.184482 22526 consensus_queue.cc:237] T edd7d470b5014c9489be7f41f64355c9 P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:35.185153 22374 leader_election.cc:290] T ef32ce6fdd0e40d382c79974f30295c6 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:05:35.196902 22056 raft_consensus.cc:3055] T ece3db938bc649d4a40a51522ed5259c P 127766fc592545a4997f7790f50f6076 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:05:35.197446 22056 raft_consensus.cc:740] T ece3db938bc649d4a40a51522ed5259c P 127766fc592545a4997f7790f50f6076 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 127766fc592545a4997f7790f50f6076, State: Running, Role: LEADER
I20260709 13:05:35.153093 19484 raft_consensus.cc:606] T 2b74109013a140ada21feeef92d6f563 P 0473d2b2d01f4459b1e90fd12cc7840e [term 5 FOLLOWER]: Received request to transfer leadership to TS e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:05:35.199036 19484 raft_consensus.cc:614] T 2b74109013a140ada21feeef92d6f563 P 0473d2b2d01f4459b1e90fd12cc7840e [term 5 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:05:35.202912 19410 raft_consensus.cc:2468] T 172b3dd13109415a955b71ac0e9d2234 P e5256d91808b47c195bc9b4dbd7f2b87 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 127766fc592545a4997f7790f50f6076 in term 5.
I20260709 13:05:35.153321 22399 raft_consensus.cc:493] T 309c3ca0ca4b4f3ba129752ea2cb293b P e5256d91808b47c195bc9b4dbd7f2b87 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:05:35.211401 19375 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:05:35.214802 19449 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.1:40321, user_credentials={real_user=slave}} blocked reactor thread for 82944.4us
W20260709 13:05:35.218504 19526 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:35.236078 19374 leader_election.cc:304] T ff9b0eddd810459b82d91c60777c10eb P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 127766fc592545a4997f7790f50f6076, e5256d91808b47c195bc9b4dbd7f2b87; no voters: 
W20260709 13:05:35.240760 19525 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:35.248900 19450 leader_election.cc:304] T 7f575b143b844aa096b50997dad3516a P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e; no voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:05:35.251138 19450 leader_election.cc:304] T 1efebf73c86e432baa55533136b6e12c P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168; no voters: 127766fc592545a4997f7790f50f6076
I20260709 13:05:35.253654 22524 raft_consensus.cc:2749] T 7f575b143b844aa096b50997dad3516a P 0473d2b2d01f4459b1e90fd12cc7840e [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:05:35.254405 22524 raft_consensus.cc:2804] T 1efebf73c86e432baa55533136b6e12c P 0473d2b2d01f4459b1e90fd12cc7840e [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:05:35.254840 22524 raft_consensus.cc:493] T 1efebf73c86e432baa55533136b6e12c P 0473d2b2d01f4459b1e90fd12cc7840e [term 5 FOLLOWER]: Starting leader election (detected failure of leader 127766fc592545a4997f7790f50f6076)
I20260709 13:05:35.255178 22524 raft_consensus.cc:3060] T 1efebf73c86e432baa55533136b6e12c P 0473d2b2d01f4459b1e90fd12cc7840e [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:05:35.230727 22251 leader_election.cc:290] T df751f992649444090e27965eb1af85d P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:05:35.225595 22381 raft_consensus.cc:2804] T fa8650e71aa14778b3d73721fc50d9fc P 0473d2b2d01f4459b1e90fd12cc7840e [term 9 FOLLOWER]: Leader election won for term 9
W20260709 13:05:35.261742 19523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.1:40321, user_credentials={real_user=slave}} blocked reactor thread for 211241us
I20260709 13:05:35.262434 22399 raft_consensus.cc:515] T 309c3ca0ca4b4f3ba129752ea2cb293b P e5256d91808b47c195bc9b4dbd7f2b87 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } attrs { replace: true } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:05:35.253305 22293 raft_consensus.cc:2804] T ff9b0eddd810459b82d91c60777c10eb P e5256d91808b47c195bc9b4dbd7f2b87 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:05:35.261363 20075 leader_election.cc:304] T 172b3dd13109415a955b71ac0e9d2234 P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 127766fc592545a4997f7790f50f6076, e5256d91808b47c195bc9b4dbd7f2b87; no voters: 
W20260709 13:05:35.274768 19526 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:05:35.291035 19526 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:05:35.287818 20076 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:35.304216 19449 leader_election.cc:304] T 4509b76741dc428e9201c70c1658da13 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87; no voters: 
I20260709 13:05:35.198482 22056 consensus_queue.cc:260] T ece3db938bc649d4a40a51522ed5259c P 127766fc592545a4997f7790f50f6076 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:05:35.289703 22293 raft_consensus.cc:493] T ff9b0eddd810459b82d91c60777c10eb P e5256d91808b47c195bc9b4dbd7f2b87 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:35.290684 22544 raft_consensus.cc:493] T 46c5bfeecc314717bffe987e6844b6d0 P e61c3a8f61bb48f8a963c9480e53c168 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:35.311327 22174 raft_consensus.cc:2804] T 172b3dd13109415a955b71ac0e9d2234 P 127766fc592545a4997f7790f50f6076 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:05:35.304528 22516 raft_consensus.cc:493] T 86a6797bdfe94fa496c050ceae4bd0d9 P e61c3a8f61bb48f8a963c9480e53c168 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:35.336215 19556 raft_consensus.cc:2468] T 1dc5b3532fe54f74876d02beffa2c230 P e61c3a8f61bb48f8a963c9480e53c168 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 7.
W20260709 13:05:35.343847 20075 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:35.343668 19523 leader_election.cc:304] T 2b74109013a140ada21feeef92d6f563 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168; no voters: 0473d2b2d01f4459b1e90fd12cc7840e
W20260709 13:05:35.339969 19449 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.1:40321, user_credentials={real_user=slave}} blocked reactor thread for 123343us
W20260709 13:05:35.350131 20078 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:05:35.351699 19525 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:05:35.352253 19525 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:35.305352 22381 raft_consensus.cc:697] T fa8650e71aa14778b3d73721fc50d9fc P 0473d2b2d01f4459b1e90fd12cc7840e [term 9 LEADER]: Becoming Leader. State: Replica: 0473d2b2d01f4459b1e90fd12cc7840e, State: Running, Role: LEADER
I20260709 13:05:35.347193 22544 raft_consensus.cc:515] T 46c5bfeecc314717bffe987e6844b6d0 P e61c3a8f61bb48f8a963c9480e53c168 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:35.339546 22174 raft_consensus.cc:493] T 172b3dd13109415a955b71ac0e9d2234 P 127766fc592545a4997f7790f50f6076 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:35.334362 22293 raft_consensus.cc:3060] T ff9b0eddd810459b82d91c60777c10eb P e5256d91808b47c195bc9b4dbd7f2b87 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:05:35.383572 22544 leader_election.cc:290] T 46c5bfeecc314717bffe987e6844b6d0 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:05:35.387944 19557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef32ce6fdd0e40d382c79974f30295c6" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:05:35.388679 19557 raft_consensus.cc:2468] T ef32ce6fdd0e40d382c79974f30295c6 P e61c3a8f61bb48f8a963c9480e53c168 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 8.
I20260709 13:05:35.389004 19559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df751f992649444090e27965eb1af85d" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:05:35.389784 19559 raft_consensus.cc:2468] T df751f992649444090e27965eb1af85d P e61c3a8f61bb48f8a963c9480e53c168 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 8.
I20260709 13:05:35.374823 19450 leader_election.cc:304] T d1e5873a19244c5ebbcd38e126796ee7 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e; no voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:05:35.356832 22540 raft_consensus.cc:2764] T 2b74109013a140ada21feeef92d6f563 P e61c3a8f61bb48f8a963c9480e53c168 [term 5 FOLLOWER]: Leader pre-election decision vote started in defunct term 4: won
I20260709 13:05:35.390470 19480 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7be9efa6559648dbb5a0f7684c4542d1"
dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
mode: GRACEFUL
new_leader_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
 from {username='slave'} at 127.0.0.1:48168
I20260709 13:05:35.394272 19480 raft_consensus.cc:606] T 7be9efa6559648dbb5a0f7684c4542d1 P 0473d2b2d01f4459b1e90fd12cc7840e [term 7 FOLLOWER]: Received request to transfer leadership to TS e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:05:35.397630 19480 raft_consensus.cc:614] T 7be9efa6559648dbb5a0f7684c4542d1 P 0473d2b2d01f4459b1e90fd12cc7840e [term 7 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:05:35.381273 22480 raft_consensus.cc:2804] T 4509b76741dc428e9201c70c1658da13 P 0473d2b2d01f4459b1e90fd12cc7840e [term 4 FOLLOWER]: Leader election won for term 4
W20260709 13:05:35.404100 19376 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:35.406981 19484 raft_consensus.cc:1240] T ab43d85f64114d4ebf618930e43d9ed0 P 0473d2b2d01f4459b1e90fd12cc7840e [term 6 FOLLOWER]: Rejecting Update request from peer e61c3a8f61bb48f8a963c9480e53c168 for earlier term 5. Current term is 6. Ops: []
I20260709 13:05:35.407238 19556 raft_consensus.cc:1275] T fa731b585f684a7fb2d106c50f143b83 P e61c3a8f61bb48f8a963c9480e53c168 [term 7 FOLLOWER]: Refusing update from remote peer e5256d91808b47c195bc9b4dbd7f2b87: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 13:05:35.375140 19375 leader_election.cc:304] T d1e5873a19244c5ebbcd38e126796ee7 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:05:35.410426 19551 raft_consensus.cc:1275] T 3e1f505cb0f1427bbd698ac889d80821 P e61c3a8f61bb48f8a963c9480e53c168 [term 8 FOLLOWER]: Refusing update from remote peer e5256d91808b47c195bc9b4dbd7f2b87: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 8 index: 4. (index mismatch)
W20260709 13:05:35.411654 19450 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.3:36891, user_credentials={real_user=slave}} blocked reactor thread for 77875.3us
I20260709 13:05:35.413339 20103 raft_consensus.cc:1275] T fa731b585f684a7fb2d106c50f143b83 P 127766fc592545a4997f7790f50f6076 [term 7 FOLLOWER]: Refusing update from remote peer e5256d91808b47c195bc9b4dbd7f2b87: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 7. (term mismatch)
I20260709 13:05:35.413744 20103 pending_rounds.cc:85] T fa731b585f684a7fb2d106c50f143b83 P 127766fc592545a4997f7790f50f6076: Aborting all ops after (but not including) 6
I20260709 13:05:35.413977 20103 pending_rounds.cc:107] T fa731b585f684a7fb2d106c50f143b83 P 127766fc592545a4997f7790f50f6076: Aborting uncommitted NO_OP operation due to leader change: 6.7
I20260709 13:05:35.414191 20103 raft_consensus.cc:2889] T fa731b585f684a7fb2d106c50f143b83 P 127766fc592545a4997f7790f50f6076 [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:05:35.415063 19526 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:35.413259 19450 leader_election.cc:304] T a08760e15aac4630a629431f56024dc8 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e; no voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:05:35.360224 21926 raft_consensus.cc:515] T a08760e15aac4630a629431f56024dc8 P e5256d91808b47c195bc9b4dbd7f2b87 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:35.413767 22369 raft_consensus.cc:3060] T d1e5873a19244c5ebbcd38e126796ee7 P 0473d2b2d01f4459b1e90fd12cc7840e [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:05:35.391261 22174 raft_consensus.cc:3060] T 172b3dd13109415a955b71ac0e9d2234 P 127766fc592545a4997f7790f50f6076 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:05:35.391291 22251 consensus_queue.cc:1048] T 4af19371ea874c09a0a2147040835cbb P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.025s
I20260709 13:05:35.360167 22516 raft_consensus.cc:515] T 86a6797bdfe94fa496c050ceae4bd0d9 P e61c3a8f61bb48f8a963c9480e53c168 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:35.402781 22544 raft_consensus.cc:493] T 1efebf73c86e432baa55533136b6e12c P e61c3a8f61bb48f8a963c9480e53c168 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 127766fc592545a4997f7790f50f6076)
I20260709 13:05:35.360524 22374 raft_consensus.cc:493] T 179fd671030940b4b4a4e24bcc4aba0a P e5256d91808b47c195bc9b4dbd7f2b87 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:35.409487 19375 leader_election.cc:304] T 1dc5b3532fe54f74876d02beffa2c230 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:05:35.418987 22503 raft_consensus.cc:2804] T d1e5873a19244c5ebbcd38e126796ee7 P e5256d91808b47c195bc9b4dbd7f2b87 [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 13:05:35.451851 20077 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:35.421559 22443 consensus_queue.cc:1048] T fa731b585f684a7fb2d106c50f143b83 P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Connected to new peer: Peer: permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.006s
I20260709 13:05:35.448664 20103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "309c3ca0ca4b4f3ba129752ea2cb293b" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:05:35.371529 22534 consensus_queue.cc:1048] T 40e1e16737a842ee936002830f36882e P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.054s
W20260709 13:05:35.456598 19452 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:35.424284 22399 leader_election.cc:290] T 309c3ca0ca4b4f3ba129752ea2cb293b P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:05:35.427183 22480 raft_consensus.cc:697] T 4509b76741dc428e9201c70c1658da13 P 0473d2b2d01f4459b1e90fd12cc7840e [term 4 LEADER]: Becoming Leader. State: Replica: 0473d2b2d01f4459b1e90fd12cc7840e, State: Running, Role: LEADER
I20260709 13:05:35.470188 20103 raft_consensus.cc:2468] T 309c3ca0ca4b4f3ba129752ea2cb293b P 127766fc592545a4997f7790f50f6076 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 7.
W20260709 13:05:35.475380 19450 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.3:36891, user_credentials={real_user=slave}} blocked reactor thread for 62233.5us
I20260709 13:05:35.460372 22503 raft_consensus.cc:493] T d1e5873a19244c5ebbcd38e126796ee7 P e5256d91808b47c195bc9b4dbd7f2b87 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:05:35.473405 19375 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.3:36891, user_credentials={real_user=slave}} blocked reactor thread for 63999.8us
W20260709 13:05:35.490068 19523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.1:40321, user_credentials={real_user=slave}} blocked reactor thread for 187750us
I20260709 13:05:35.491219 19485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40e1e16737a842ee936002830f36882e" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:05:35.485831 19481 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b9f0d59553ad444883fcf5b5909f9798"
dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
mode: GRACEFUL
new_leader_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
 from {username='slave'} at 127.0.0.1:48168
W20260709 13:05:35.505952 19374 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:35.479393 22399 raft_consensus.cc:2804] T 1dc5b3532fe54f74876d02beffa2c230 P e5256d91808b47c195bc9b4dbd7f2b87 [term 7 FOLLOWER]: Leader election won for term 7
W20260709 13:05:35.511052 22591 log.cc:927] Time spent T 775c229504194560ba9589bc2199b089 P 127766fc592545a4997f7790f50f6076: Append to log took a long time: real 0.113s	user 0.000s	sys 0.003s
I20260709 13:05:35.486419 22503 raft_consensus.cc:3060] T d1e5873a19244c5ebbcd38e126796ee7 P e5256d91808b47c195bc9b4dbd7f2b87 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:05:35.463353 22544 raft_consensus.cc:515] T 1efebf73c86e432baa55533136b6e12c P e61c3a8f61bb48f8a963c9480e53c168 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:05:35.515333 22056 raft_consensus.cc:3060] T ece3db938bc649d4a40a51522ed5259c P 127766fc592545a4997f7790f50f6076 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:05:35.519747 21926 leader_election.cc:290] T a08760e15aac4630a629431f56024dc8 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 9 election: Requested vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:05:35.520776 19449 leader_election.cc:304] T 48824d5acfbc485ebf8c2d944e7202de P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, 127766fc592545a4997f7790f50f6076; no voters: 
I20260709 13:05:35.520663 22480 consensus_queue.cc:237] T 4509b76741dc428e9201c70c1658da13 P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:35.521628 19478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46c5bfeecc314717bffe987e6844b6d0" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 14 candidate_status { last_received { term: 12 index: 5 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:05:35.525096 19552 raft_consensus.cc:2468] T ece3db938bc649d4a40a51522ed5259c P e61c3a8f61bb48f8a963c9480e53c168 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 8.
I20260709 13:05:35.527120 19480 raft_consensus.cc:1240] T 48824d5acfbc485ebf8c2d944e7202de P 0473d2b2d01f4459b1e90fd12cc7840e [term 8 FOLLOWER]: Rejecting Update request from peer e61c3a8f61bb48f8a963c9480e53c168 for earlier term 7. Current term is 8. Ops: []
I20260709 13:05:35.527467 19484 raft_consensus.cc:1240] T 22196caba61445d3bec98a0aab3c337d P 0473d2b2d01f4459b1e90fd12cc7840e [term 7 LEADER]: Rejecting Update request from peer e61c3a8f61bb48f8a963c9480e53c168 for earlier term 6. Current term is 7. Ops: [6.5-6.5]
I20260709 13:05:35.464607 22527 raft_consensus.cc:2749] T a08760e15aac4630a629431f56024dc8 P 0473d2b2d01f4459b1e90fd12cc7840e [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:05:35.476086 22381 consensus_queue.cc:237] T fa8650e71aa14778b3d73721fc50d9fc P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:35.528425 19375 leader_election.cc:304] T ef32ce6fdd0e40d382c79974f30295c6 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:05:35.529217 19485 raft_consensus.cc:2468] T 40e1e16737a842ee936002830f36882e P 0473d2b2d01f4459b1e90fd12cc7840e [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 9.
I20260709 13:05:35.556740 19481 raft_consensus.cc:606] T b9f0d59553ad444883fcf5b5909f9798 P 0473d2b2d01f4459b1e90fd12cc7840e [term 8 FOLLOWER]: Received request to transfer leadership to TS e5256d91808b47c195bc9b4dbd7f2b87
W20260709 13:05:35.595247 20077 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:35.650835 19481 raft_consensus.cc:614] T b9f0d59553ad444883fcf5b5909f9798 P 0473d2b2d01f4459b1e90fd12cc7840e [term 8 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 13:05:35.652726 19450 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.3:36891, user_credentials={real_user=slave}} blocked reactor thread for 85880.8us
W20260709 13:05:35.651799 19449 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.4:43121, user_credentials={real_user=slave}} blocked reactor thread for 131139us
I20260709 13:05:35.488931 22374 raft_consensus.cc:515] T 179fd671030940b4b4a4e24bcc4aba0a P e5256d91808b47c195bc9b4dbd7f2b87 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
W20260709 13:05:35.657536 19375 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.3:36891, user_credentials={real_user=slave}} blocked reactor thread for 162452us
I20260709 13:05:35.661702 19375 leader_election.cc:304] T df751f992649444090e27965eb1af85d P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:05:35.552297 22399 raft_consensus.cc:697] T 1dc5b3532fe54f74876d02beffa2c230 P e5256d91808b47c195bc9b4dbd7f2b87 [term 7 LEADER]: Becoming Leader. State: Replica: e5256d91808b47c195bc9b4dbd7f2b87, State: Running, Role: LEADER
W20260709 13:05:35.671970 20077 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:35.660727 19449 leader_election.cc:304] T 5ec1c4ce15e04c7e8c283a62179f2a64 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, 127766fc592545a4997f7790f50f6076; no voters: e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:05:35.674866 22483 raft_consensus.cc:2804] T 5ec1c4ce15e04c7e8c283a62179f2a64 P 0473d2b2d01f4459b1e90fd12cc7840e [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:05:35.675356 22483 raft_consensus.cc:493] T 5ec1c4ce15e04c7e8c283a62179f2a64 P 0473d2b2d01f4459b1e90fd12cc7840e [term 5 FOLLOWER]: Starting leader election (detected failure of leader 127766fc592545a4997f7790f50f6076)
I20260709 13:05:35.573614 22524 raft_consensus.cc:515] T 1efebf73c86e432baa55533136b6e12c P 0473d2b2d01f4459b1e90fd12cc7840e [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
W20260709 13:05:35.683139 19526 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:35.727866 19450 leader_election.cc:304] T f93ee515a9c14139bf566522ed8232f3 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e; no voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168
W20260709 13:05:35.737259 19526 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:05:35.737272 19374 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.4:43121, user_credentials={real_user=slave}} blocked reactor thread for 54484.7us
I20260709 13:05:35.658748 22526 raft_consensus.cc:2804] T 48824d5acfbc485ebf8c2d944e7202de P 0473d2b2d01f4459b1e90fd12cc7840e [term 8 FOLLOWER]: Leader election won for term 8
W20260709 13:05:35.677521 22592 log.cc:927] Time spent T 833a2f0775ed407a94b8924ce50adb63 P e5256d91808b47c195bc9b4dbd7f2b87: Append to log took a long time: real 0.094s	user 0.000s	sys 0.001s
W20260709 13:05:35.741588 19523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.1:40321, user_credentials={real_user=slave}} blocked reactor thread for 89717.2us
W20260709 13:05:35.677691 22585 log.cc:927] Time spent T ece3db938bc649d4a40a51522ed5259c P 127766fc592545a4997f7790f50f6076: Append to log took a long time: real 0.122s	user 0.001s	sys 0.000s
W20260709 13:05:35.674885 22549 consensus_meta.cc:287] T b08304a0a02b42d7840c4e8ee9a6bd1a P 0473d2b2d01f4459b1e90fd12cc7840e: Time spent flushing consensus metadata: real 0.622s	user 0.012s	sys 0.008s
I20260709 13:05:35.745620 19409 raft_consensus.cc:1275] T 172b3dd13109415a955b71ac0e9d2234 P e5256d91808b47c195bc9b4dbd7f2b87 [term 5 FOLLOWER]: Refusing update from remote peer 0473d2b2d01f4459b1e90fd12cc7840e: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:05:35.746539 22524 leader_election.cc:290] T 1efebf73c86e432baa55533136b6e12c P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 6 election: Requested vote from peers e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:05:35.747272 19450 leader_election.cc:304] T 96efeaaf1057492490e9a621f37e1a2d P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e; no voters: 127766fc592545a4997f7790f50f6076, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:05:35.747846 22443 raft_consensus.cc:2804] T df751f992649444090e27965eb1af85d P e5256d91808b47c195bc9b4dbd7f2b87 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:05:35.671402 22251 raft_consensus.cc:2804] T ef32ce6fdd0e40d382c79974f30295c6 P e5256d91808b47c195bc9b4dbd7f2b87 [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 13:05:35.743686 19375 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.3:36891, user_credentials={real_user=slave}} blocked reactor thread for 82085.1us
I20260709 13:05:35.733242 22483 raft_consensus.cc:3060] T 5ec1c4ce15e04c7e8c283a62179f2a64 P 0473d2b2d01f4459b1e90fd12cc7840e [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:05:35.761660 19525 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:35.770951 19405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "775c229504194560ba9589bc2199b089" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:05:35.743294 22527 raft_consensus.cc:2749] T f93ee515a9c14139bf566522ed8232f3 P 0473d2b2d01f4459b1e90fd12cc7840e [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:05:35.755650 22251 raft_consensus.cc:493] T ef32ce6fdd0e40d382c79974f30295c6 P e5256d91808b47c195bc9b4dbd7f2b87 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:35.755903 22443 raft_consensus.cc:493] T df751f992649444090e27965eb1af85d P e5256d91808b47c195bc9b4dbd7f2b87 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 0473d2b2d01f4459b1e90fd12cc7840e)
W20260709 13:05:35.783735 20075 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:35.787111 19410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f85fc4b527a48848e5faa083b604e36" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:05:35.762620 22534 raft_consensus.cc:493] T 1a61655d99124a29b486ba4a5b37faea P e5256d91808b47c195bc9b4dbd7f2b87 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:35.755432 22549 raft_consensus.cc:515] T b08304a0a02b42d7840c4e8ee9a6bd1a P 0473d2b2d01f4459b1e90fd12cc7840e [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:35.765650 22516 leader_election.cc:290] T 86a6797bdfe94fa496c050ceae4bd0d9 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:05:35.787276 19409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36f6ba92b9ba46babe4ebd6c02e5fbd9" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:05:35.773729 22470 raft_consensus.cc:2749] T 96efeaaf1057492490e9a621f37e1a2d P 0473d2b2d01f4459b1e90fd12cc7840e [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:05:35.788257 22443 raft_consensus.cc:3060] T df751f992649444090e27965eb1af85d P e5256d91808b47c195bc9b4dbd7f2b87 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:05:35.782840 22251 raft_consensus.cc:3060] T ef32ce6fdd0e40d382c79974f30295c6 P e5256d91808b47c195bc9b4dbd7f2b87 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:05:35.807104 19450 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.3:36891, user_credentials={real_user=slave}} blocked reactor thread for 59956.9us
I20260709 13:05:35.675587 22399 consensus_queue.cc:237] T 1dc5b3532fe54f74876d02beffa2c230 P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 5.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:35.769433 22504 consensus_queue.cc:1048] T 3e1f505cb0f1427bbd698ac889d80821 P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.031s
I20260709 13:05:35.802134 22524 raft_consensus.cc:493] T 3e1f505cb0f1427bbd698ac889d80821 P 0473d2b2d01f4459b1e90fd12cc7840e [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:35.787703 22385 consensus_queue.cc:1048] T fa731b585f684a7fb2d106c50f143b83 P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.042s
I20260709 13:05:35.842607 19526 leader_election.cc:304] T 40e1e16737a842ee936002830f36882e P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:05:35.800832 22413 consensus_queue.cc:1059] T 309c3ca0ca4b4f3ba129752ea2cb293b P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.040s
I20260709 13:05:35.797111 22534 raft_consensus.cc:515] T 1a61655d99124a29b486ba4a5b37faea P e5256d91808b47c195bc9b4dbd7f2b87 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:35.864038 22549 leader_election.cc:290] T b08304a0a02b42d7840c4e8ee9a6bd1a P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 9 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:05:35.872018 19523 leader_election.cc:304] T d1e5873a19244c5ebbcd38e126796ee7 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168; no voters: 0473d2b2d01f4459b1e90fd12cc7840e
W20260709 13:05:35.882938 19376 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:35.866617 22544 leader_election.cc:290] T 1efebf73c86e432baa55533136b6e12c P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:05:35.846088 22285 consensus_queue.cc:1059] T ab43d85f64114d4ebf618930e43d9ed0 P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 }, Status: INVALID_TERM, Last received: 5.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.033s
I20260709 13:05:35.852468 22524 raft_consensus.cc:515] T 3e1f505cb0f1427bbd698ac889d80821 P 0473d2b2d01f4459b1e90fd12cc7840e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
W20260709 13:05:35.890748 20076 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:35.853693 22540 consensus_queue.cc:1059] T 48824d5acfbc485ebf8c2d944e7202de P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.029s
I20260709 13:05:35.884644 22413 consensus_queue.cc:1243] T 309c3ca0ca4b4f3ba129752ea2cb293b P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Peer 0473d2b2d01f4459b1e90fd12cc7840e log is divergent from this leader: its last log entry 7.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
W20260709 13:05:35.898077 19450 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.3:36891, user_credentials={real_user=slave}} blocked reactor thread for 62673.4us
I20260709 13:05:35.906891 22551 raft_consensus.cc:2804] T d1e5873a19244c5ebbcd38e126796ee7 P e61c3a8f61bb48f8a963c9480e53c168 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:05:35.900152 18300 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:05:35.909682 18300 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
W20260709 13:05:35.911207 22597 log.cc:927] Time spent T 833a2f0775ed407a94b8924ce50adb63 P 127766fc592545a4997f7790f50f6076: Append to log took a long time: real 0.109s	user 0.000s	sys 0.000s
I20260709 13:05:35.914381 19450 leader_election.cc:304] T 2e36a9d6e29c4a7c860cf267efbd4c74 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e; no voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:05:35.915777 19450 leader_election.cc:304] T f1b10566f45d4a7d9029858330e02d5b P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168; no voters: e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:05:35.916764 22470 raft_consensus.cc:2749] T 2e36a9d6e29c4a7c860cf267efbd4c74 P 0473d2b2d01f4459b1e90fd12cc7840e [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 13:05:35.919865 20078 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.2:46257, user_credentials={real_user=slave}} blocked reactor thread for 335973us
I20260709 13:05:35.903916 22544 raft_consensus.cc:2804] T 40e1e16737a842ee936002830f36882e P e61c3a8f61bb48f8a963c9480e53c168 [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 13:05:35.925886 20078 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:35.917484 22470 raft_consensus.cc:2804] T f1b10566f45d4a7d9029858330e02d5b P 0473d2b2d01f4459b1e90fd12cc7840e [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:05:35.917506 22369 raft_consensus.cc:2749] T d1e5873a19244c5ebbcd38e126796ee7 P 0473d2b2d01f4459b1e90fd12cc7840e [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:05:35.930852 19523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.1:40321, user_credentials={real_user=slave}} blocked reactor thread for 107354us
I20260709 13:05:35.928553 22470 raft_consensus.cc:493] T f1b10566f45d4a7d9029858330e02d5b P 0473d2b2d01f4459b1e90fd12cc7840e [term 8 FOLLOWER]: Starting leader election (detected failure of leader e5256d91808b47c195bc9b4dbd7f2b87)
I20260709 13:05:35.920199 22551 raft_consensus.cc:697] T d1e5873a19244c5ebbcd38e126796ee7 P e61c3a8f61bb48f8a963c9480e53c168 [term 9 LEADER]: Becoming Leader. State: Replica: e61c3a8f61bb48f8a963c9480e53c168, State: Running, Role: LEADER
I20260709 13:05:35.933228 22470 raft_consensus.cc:3060] T f1b10566f45d4a7d9029858330e02d5b P 0473d2b2d01f4459b1e90fd12cc7840e [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:05:35.928005 22544 raft_consensus.cc:493] T 40e1e16737a842ee936002830f36882e P e61c3a8f61bb48f8a963c9480e53c168 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:35.919471 22174 raft_consensus.cc:515] T 172b3dd13109415a955b71ac0e9d2234 P 127766fc592545a4997f7790f50f6076 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
W20260709 13:05:35.971277 20077 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:35.943946 22544 raft_consensus.cc:3060] T 40e1e16737a842ee936002830f36882e P e61c3a8f61bb48f8a963c9480e53c168 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:05:35.974045 20105 raft_consensus.cc:1275] T ff9b0eddd810459b82d91c60777c10eb P 127766fc592545a4997f7790f50f6076 [term 5 FOLLOWER]: Refusing update from remote peer 0473d2b2d01f4459b1e90fd12cc7840e: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:05:35.977461 20109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36f6ba92b9ba46babe4ebd6c02e5fbd9" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:05:35.978569 20110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f85fc4b527a48848e5faa083b604e36" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:05:35.982060 22524 leader_election.cc:290] T 3e1f505cb0f1427bbd698ac889d80821 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:05:35.983160 19523 leader_election.cc:400] T 179fd671030940b4b4a4e24bcc4aba0a P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 6 election: Vote denied by peer e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321) with higher term. Message: Invalid argument: T 179fd671030940b4b4a4e24bcc4aba0a P e5256d91808b47c195bc9b4dbd7f2b87 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate e61c3a8f61bb48f8a963c9480e53c168 for earlier term 6. Current term is 7.
I20260709 13:05:35.995769 20105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "775c229504194560ba9589bc2199b089" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:05:35.989723 22551 consensus_queue.cc:237] T d1e5873a19244c5ebbcd38e126796ee7 P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
W20260709 13:05:36.060842 19450 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.3:36891, user_credentials={real_user=slave}} blocked reactor thread for 115336us
W20260709 13:05:36.078075 19375 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.3:36891, user_credentials={real_user=slave}} blocked reactor thread for 290397us
I20260709 13:05:36.081637 19375 leader_election.cc:304] T ece3db938bc649d4a40a51522ed5259c P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168; no voters: 127766fc592545a4997f7790f50f6076
I20260709 13:05:36.078121 22534 leader_election.cc:290] T 1a61655d99124a29b486ba4a5b37faea P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:05:36.085312 20109 raft_consensus.cc:1275] T 309c3ca0ca4b4f3ba129752ea2cb293b P 127766fc592545a4997f7790f50f6076 [term 7 FOLLOWER]: Refusing update from remote peer 0473d2b2d01f4459b1e90fd12cc7840e: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
W20260709 13:05:36.085290 19523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.1:40321, user_credentials={real_user=slave}} blocked reactor thread for 130198us
I20260709 13:05:36.067122 22174 leader_election.cc:290] T 172b3dd13109415a955b71ac0e9d2234 P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 6 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
W20260709 13:05:36.089900 19374 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:05:36.082865 22056 consensus_meta.cc:287] T ece3db938bc649d4a40a51522ed5259c P 127766fc592545a4997f7790f50f6076: Time spent flushing consensus metadata: real 0.517s	user 0.011s	sys 0.000s
I20260709 13:05:36.097180 22504 raft_consensus.cc:2804] T ece3db938bc649d4a40a51522ed5259c P e5256d91808b47c195bc9b4dbd7f2b87 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:05:36.109685 19450 leader_election.cc:304] T 0cdf56e38bbc453d9438d359e5a69955 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e; no voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:05:36.111265 19450 leader_election.cc:304] T 1dc5b3532fe54f74876d02beffa2c230 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168; no voters: e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:05:36.133750 22524 raft_consensus.cc:2749] T 0cdf56e38bbc453d9438d359e5a69955 P 0473d2b2d01f4459b1e90fd12cc7840e [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:05:36.134616 22524 raft_consensus.cc:2804] T 1dc5b3532fe54f74876d02beffa2c230 P 0473d2b2d01f4459b1e90fd12cc7840e [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:05:36.135154 22524 raft_consensus.cc:697] T 1dc5b3532fe54f74876d02beffa2c230 P 0473d2b2d01f4459b1e90fd12cc7840e [term 6 LEADER]: Becoming Leader. State: Replica: 0473d2b2d01f4459b1e90fd12cc7840e, State: Running, Role: LEADER
I20260709 13:05:36.136006 22524 consensus_queue.cc:237] T 1dc5b3532fe54f74876d02beffa2c230 P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
W20260709 13:05:36.139498 19525 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:36.144467 19523 leader_election.cc:304] T 70797e5783b5454ab0d0eea663e791e3 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e61c3a8f61bb48f8a963c9480e53c168; no voters: 127766fc592545a4997f7790f50f6076, e5256d91808b47c195bc9b4dbd7f2b87
W20260709 13:05:36.134819 22293 consensus_meta.cc:287] T ff9b0eddd810459b82d91c60777c10eb P e5256d91808b47c195bc9b4dbd7f2b87: Time spent flushing consensus metadata: real 0.751s	user 0.014s	sys 0.001s
W20260709 13:05:36.161818 19526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.2:46257, user_credentials={real_user=slave}} blocked reactor thread for 319303us
I20260709 13:05:36.142416 22504 raft_consensus.cc:697] T ece3db938bc649d4a40a51522ed5259c P e5256d91808b47c195bc9b4dbd7f2b87 [term 8 LEADER]: Becoming Leader. State: Replica: e5256d91808b47c195bc9b4dbd7f2b87, State: Running, Role: LEADER
I20260709 13:05:36.157051 19554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "309c3ca0ca4b4f3ba129752ea2cb293b" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:05:36.163753 22540 consensus_queue.cc:1243] T 48824d5acfbc485ebf8c2d944e7202de P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Peer 0473d2b2d01f4459b1e90fd12cc7840e log is divergent from this leader: its last log entry 6.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 13:05:36.158299 22526 raft_consensus.cc:697] T 48824d5acfbc485ebf8c2d944e7202de P 0473d2b2d01f4459b1e90fd12cc7840e [term 8 LEADER]: Becoming Leader. State: Replica: 0473d2b2d01f4459b1e90fd12cc7840e, State: Running, Role: LEADER
I20260709 13:05:36.188846 19405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b08304a0a02b42d7840c4e8ee9a6bd1a" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
W20260709 13:05:36.190017 20077 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:05:36.188273 19449 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:36.191584 22540 raft_consensus.cc:3055] T 48824d5acfbc485ebf8c2d944e7202de P e61c3a8f61bb48f8a963c9480e53c168 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:05:36.198814 19483 raft_consensus.cc:1275] T 7be9efa6559648dbb5a0f7684c4542d1 P 0473d2b2d01f4459b1e90fd12cc7840e [term 7 FOLLOWER]: Refusing update from remote peer e61c3a8f61bb48f8a963c9480e53c168: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
W20260709 13:05:36.199069 19450 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.3:36891, user_credentials={real_user=slave}} blocked reactor thread for 87918.6us
I20260709 13:05:36.143738 22503 raft_consensus.cc:515] T d1e5873a19244c5ebbcd38e126796ee7 P e5256d91808b47c195bc9b4dbd7f2b87 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:36.168593 22381 raft_consensus.cc:493] T 9962423cb4e54fcfa5de01daf68a86e7 P 0473d2b2d01f4459b1e90fd12cc7840e [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:36.200277 19402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e1f505cb0f1427bbd698ac889d80821" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:05:36.194815 19481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86a6797bdfe94fa496c050ceae4bd0d9" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
W20260709 13:05:36.215672 20077 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:36.215903 19481 raft_consensus.cc:2468] T 86a6797bdfe94fa496c050ceae4bd0d9 P 0473d2b2d01f4459b1e90fd12cc7840e [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 7.
W20260709 13:05:36.205189 20076 leader_election.cc:336] T 65d8cb8d6ec64f459d5a47cefab10acf P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891): Timed out: RequestConsensusVote RPC to 127.17.223.3:36891 timed out after 1.513s (SENT)
I20260709 13:05:36.216681 20076 leader_election.cc:304] T 65d8cb8d6ec64f459d5a47cefab10acf P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 127766fc592545a4997f7790f50f6076; no voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:05:36.161676 22293 raft_consensus.cc:515] T ff9b0eddd810459b82d91c60777c10eb P e5256d91808b47c195bc9b4dbd7f2b87 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:05:36.191856 22385 raft_consensus.cc:493] T 7be9efa6559648dbb5a0f7684c4542d1 P e5256d91808b47c195bc9b4dbd7f2b87 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:36.222450 19450 leader_election.cc:304] T ed7fdbcb96d14d418db9ca90a792588a P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e; no voters: 127766fc592545a4997f7790f50f6076, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:05:36.230777 19555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a08760e15aac4630a629431f56024dc8" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:05:36.240895 19555 raft_consensus.cc:3060] T a08760e15aac4630a629431f56024dc8 P e61c3a8f61bb48f8a963c9480e53c168 [term 7 FOLLOWER]: Advancing to term 9
I20260709 13:05:36.198547 22540 raft_consensus.cc:740] T 48824d5acfbc485ebf8c2d944e7202de P e61c3a8f61bb48f8a963c9480e53c168 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: e61c3a8f61bb48f8a963c9480e53c168, State: Running, Role: LEADER
I20260709 13:05:36.243652 19554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a61655d99124a29b486ba4a5b37faea" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:05:36.228523 22526 consensus_queue.cc:237] T 48824d5acfbc485ebf8c2d944e7202de P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:05:36.238413 22381 raft_consensus.cc:515] T 9962423cb4e54fcfa5de01daf68a86e7 P 0473d2b2d01f4459b1e90fd12cc7840e [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:05:36.238951 22611 consensus_queue.cc:1048] T 172b3dd13109415a955b71ac0e9d2234 P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.055s
I20260709 13:05:36.250017 19405 raft_consensus.cc:2468] T b08304a0a02b42d7840c4e8ee9a6bd1a P e5256d91808b47c195bc9b4dbd7f2b87 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 9.
I20260709 13:05:36.257238 19554 raft_consensus.cc:2410] T 1a61655d99124a29b486ba4a5b37faea P e61c3a8f61bb48f8a963c9480e53c168 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e5256d91808b47c195bc9b4dbd7f2b87 for term 6 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 13:05:36.277534 19407 raft_consensus.cc:1240] T ff9b0eddd810459b82d91c60777c10eb P e5256d91808b47c195bc9b4dbd7f2b87 [term 6 FOLLOWER]: Rejecting Update request from peer 0473d2b2d01f4459b1e90fd12cc7840e for earlier term 5. Current term is 6. Ops: []
W20260709 13:05:36.281270 19374 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.4:43121, user_credentials={real_user=slave}} blocked reactor thread for 121367us
I20260709 13:05:36.281910 19481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1efebf73c86e432baa55533136b6e12c" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:05:36.305825 19555 raft_consensus.cc:2468] T a08760e15aac4630a629431f56024dc8 P e61c3a8f61bb48f8a963c9480e53c168 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 9.
W20260709 13:05:36.317616 20075 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:05:36.282387 19525 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:05:36.304704 20076 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.3:36891, user_credentials={real_user=slave}} blocked reactor thread for 100577us
I20260709 13:05:36.363925 19481 raft_consensus.cc:2393] T 1efebf73c86e432baa55533136b6e12c P 0473d2b2d01f4459b1e90fd12cc7840e [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e61c3a8f61bb48f8a963c9480e53c168 in current term 6: Already voted for candidate 0473d2b2d01f4459b1e90fd12cc7840e in this term.
W20260709 13:05:36.310849 19450 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.3:36891, user_credentials={real_user=slave}} blocked reactor thread for 88514us
I20260709 13:05:36.360780 19449 leader_election.cc:304] T b08304a0a02b42d7840c4e8ee9a6bd1a P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87; no voters: 
I20260709 13:05:36.367177 22503 leader_election.cc:290] T d1e5873a19244c5ebbcd38e126796ee7 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 10 election: Requested vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:05:36.309377 22443 raft_consensus.cc:515] T df751f992649444090e27965eb1af85d P e5256d91808b47c195bc9b4dbd7f2b87 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
W20260709 13:05:36.368235 20076 leader_election.cc:336] T 96efeaaf1057492490e9a621f37e1a2d P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891): Timed out: RequestConsensusVote RPC to 127.17.223.3:36891 timed out after 1.668s (SENT)
I20260709 13:05:36.288285 22618 raft_consensus.cc:2749] T 70797e5783b5454ab0d0eea663e791e3 P e61c3a8f61bb48f8a963c9480e53c168 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:05:36.368727 20076 leader_election.cc:304] T 96efeaaf1057492490e9a621f37e1a2d P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 127766fc592545a4997f7790f50f6076; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:05:36.369738 22443 leader_election.cc:290] T df751f992649444090e27965eb1af85d P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 9 election: Requested vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
W20260709 13:05:36.299738 22617 log.cc:927] Time spent T fa8650e71aa14778b3d73721fc50d9fc P 0473d2b2d01f4459b1e90fd12cc7840e: Append to log took a long time: real 0.060s	user 0.000s	sys 0.000s
I20260709 13:05:36.297087 22504 consensus_queue.cc:237] T ece3db938bc649d4a40a51522ed5259c P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:05:36.370517 22111 raft_consensus.cc:2749] T 96efeaaf1057492490e9a621f37e1a2d P 127766fc592545a4997f7790f50f6076 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:05:36.313450 22470 raft_consensus.cc:515] T f1b10566f45d4a7d9029858330e02d5b P 0473d2b2d01f4459b1e90fd12cc7840e [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:36.372051 22611 raft_consensus.cc:2804] T b08304a0a02b42d7840c4e8ee9a6bd1a P 0473d2b2d01f4459b1e90fd12cc7840e [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:05:36.372304 22369 raft_consensus.cc:993] T 1a61655d99124a29b486ba4a5b37faea P 0473d2b2d01f4459b1e90fd12cc7840e: : Instructing follower e5256d91808b47c195bc9b4dbd7f2b87 to start an election
I20260709 13:05:36.372553 22611 raft_consensus.cc:697] T b08304a0a02b42d7840c4e8ee9a6bd1a P 0473d2b2d01f4459b1e90fd12cc7840e [term 9 LEADER]: Becoming Leader. State: Replica: 0473d2b2d01f4459b1e90fd12cc7840e, State: Running, Role: LEADER
I20260709 13:05:36.373250 19411 raft_consensus.cc:1240] T df751f992649444090e27965eb1af85d P e5256d91808b47c195bc9b4dbd7f2b87 [term 9 FOLLOWER]: Rejecting Update request from peer 0473d2b2d01f4459b1e90fd12cc7840e for earlier term 8. Current term is 9. Ops: []
I20260709 13:05:36.311465 19409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9962423cb4e54fcfa5de01daf68a86e7" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:05:36.368739 20109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff9b0eddd810459b82d91c60777c10eb" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076"
I20260709 13:05:36.374392 20109 raft_consensus.cc:3060] T ff9b0eddd810459b82d91c60777c10eb P 127766fc592545a4997f7790f50f6076 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:05:36.374440 19375 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:05:36.392323 20076 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:36.409129 19405 raft_consensus.cc:1275] T fa8650e71aa14778b3d73721fc50d9fc P e5256d91808b47c195bc9b4dbd7f2b87 [term 9 FOLLOWER]: Refusing update from remote peer 0473d2b2d01f4459b1e90fd12cc7840e: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
W20260709 13:05:36.411669 20077 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:05:36.305781 22605 log.cc:927] Time spent T fa731b585f684a7fb2d106c50f143b83 P 127766fc592545a4997f7790f50f6076: Append to log took a long time: real 0.204s	user 0.003s	sys 0.000s
W20260709 13:05:36.415731 19523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.1:40321, user_credentials={real_user=slave}} blocked reactor thread for 274811us
W20260709 13:05:36.327708 22483 consensus_meta.cc:287] T 5ec1c4ce15e04c7e8c283a62179f2a64 P 0473d2b2d01f4459b1e90fd12cc7840e: Time spent flushing consensus metadata: real 0.541s	user 0.014s	sys 0.000s
I20260709 13:05:36.292447 22293 leader_election.cc:290] T ff9b0eddd810459b82d91c60777c10eb P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 6 election: Requested vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:05:36.364187 22549 raft_consensus.cc:493] T 14efcc79969f41babe5529c22d59156d P 0473d2b2d01f4459b1e90fd12cc7840e [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:36.282001 22612 raft_consensus.cc:2749] T ed7fdbcb96d14d418db9ca90a792588a P 0473d2b2d01f4459b1e90fd12cc7840e [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:05:36.269026 22056 raft_consensus.cc:2749] T 65d8cb8d6ec64f459d5a47cefab10acf P 127766fc592545a4997f7790f50f6076 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:05:36.323442 22516 raft_consensus.cc:3055] T 309c3ca0ca4b4f3ba129752ea2cb293b P e61c3a8f61bb48f8a963c9480e53c168 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:05:36.292930 22381 leader_election.cc:290] T 9962423cb4e54fcfa5de01daf68a86e7 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:05:36.439282 22516 raft_consensus.cc:740] T 309c3ca0ca4b4f3ba129752ea2cb293b P e61c3a8f61bb48f8a963c9480e53c168 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: e61c3a8f61bb48f8a963c9480e53c168, State: Running, Role: LEADER
I20260709 13:05:36.325793 22413 raft_consensus.cc:3055] T ab43d85f64114d4ebf618930e43d9ed0 P e61c3a8f61bb48f8a963c9480e53c168 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:05:36.440586 22413 raft_consensus.cc:740] T ab43d85f64114d4ebf618930e43d9ed0 P e61c3a8f61bb48f8a963c9480e53c168 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: e61c3a8f61bb48f8a963c9480e53c168, State: Running, Role: LEADER
I20260709 13:05:36.440290 22516 consensus_queue.cc:260] T 309c3ca0ca4b4f3ba129752ea2cb293b P e61c3a8f61bb48f8a963c9480e53c168 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } attrs { replace: true } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:05:36.441757 22516 raft_consensus.cc:3060] T 309c3ca0ca4b4f3ba129752ea2cb293b P e61c3a8f61bb48f8a963c9480e53c168 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:05:36.441509 22413 consensus_queue.cc:260] T ab43d85f64114d4ebf618930e43d9ed0 P e61c3a8f61bb48f8a963c9480e53c168 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.5, Last appended by leader: 5, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } attrs { replace: true } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:05:36.301254 22544 raft_consensus.cc:515] T 40e1e16737a842ee936002830f36882e P e61c3a8f61bb48f8a963c9480e53c168 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:36.294865 22251 raft_consensus.cc:515] T ef32ce6fdd0e40d382c79974f30295c6 P e5256d91808b47c195bc9b4dbd7f2b87 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:36.443244 22399 raft_consensus.cc:493] T 0cdf56e38bbc453d9438d359e5a69955 P e5256d91808b47c195bc9b4dbd7f2b87 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:36.443745 22399 raft_consensus.cc:515] T 0cdf56e38bbc453d9438d359e5a69955 P e5256d91808b47c195bc9b4dbd7f2b87 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:36.444492 22544 leader_election.cc:290] T 40e1e16737a842ee936002830f36882e P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 10 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:05:36.444905 22251 leader_election.cc:290] T ef32ce6fdd0e40d382c79974f30295c6 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 9 election: Requested vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:05:36.445236 19556 raft_consensus.cc:1240] T 40e1e16737a842ee936002830f36882e P e61c3a8f61bb48f8a963c9480e53c168 [term 10 FOLLOWER]: Rejecting Update request from peer e5256d91808b47c195bc9b4dbd7f2b87 for earlier term 9. Current term is 10. Ops: [9.6-9.6]
I20260709 13:05:36.445680 22399 leader_election.cc:290] T 0cdf56e38bbc453d9438d359e5a69955 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:05:36.446290 22413 raft_consensus.cc:3060] T ab43d85f64114d4ebf618930e43d9ed0 P e61c3a8f61bb48f8a963c9480e53c168 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:05:36.443279 19450 leader_election.cc:304] T 14935b3ddf914369822e4a0547aaa355 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168; no voters: 127766fc592545a4997f7790f50f6076
I20260709 13:05:36.446894 22627 raft_consensus.cc:493] T 7f575b143b844aa096b50997dad3516a P e5256d91808b47c195bc9b4dbd7f2b87 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader e61c3a8f61bb48f8a963c9480e53c168)
I20260709 13:05:36.447520 22627 raft_consensus.cc:515] T 7f575b143b844aa096b50997dad3516a P e5256d91808b47c195bc9b4dbd7f2b87 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:36.448197 22374 leader_election.cc:290] T 179fd671030940b4b4a4e24bcc4aba0a P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:05:36.300031 22540 consensus_queue.cc:260] T 48824d5acfbc485ebf8c2d944e7202de P e61c3a8f61bb48f8a963c9480e53c168 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:05:36.449523 22612 raft_consensus.cc:2804] T 14935b3ddf914369822e4a0547aaa355 P 0473d2b2d01f4459b1e90fd12cc7840e [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:05:36.449656 22627 leader_election.cc:290] T 7f575b143b844aa096b50997dad3516a P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:05:36.450042 22612 raft_consensus.cc:493] T 14935b3ddf914369822e4a0547aaa355 P 0473d2b2d01f4459b1e90fd12cc7840e [term 6 FOLLOWER]: Starting leader election (detected failure of leader 127766fc592545a4997f7790f50f6076)
I20260709 13:05:36.449903 22611 consensus_queue.cc:237] T b08304a0a02b42d7840c4e8ee9a6bd1a P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:36.450498 22612 raft_consensus.cc:3060] T 14935b3ddf914369822e4a0547aaa355 P 0473d2b2d01f4459b1e90fd12cc7840e [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:05:36.455220 21926 raft_consensus.cc:493] T ff75a1d4cb1f493db8f71ddc136ba9ab P e5256d91808b47c195bc9b4dbd7f2b87 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:36.455709 21926 raft_consensus.cc:515] T ff75a1d4cb1f493db8f71ddc136ba9ab P e5256d91808b47c195bc9b4dbd7f2b87 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:36.457866 21926 leader_election.cc:290] T ff75a1d4cb1f493db8f71ddc136ba9ab P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:05:36.458343 21926 raft_consensus.cc:493] T 5ec1c4ce15e04c7e8c283a62179f2a64 P e5256d91808b47c195bc9b4dbd7f2b87 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:36.422907 19402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "172b3dd13109415a955b71ac0e9d2234" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
I20260709 13:05:36.449558 22540 raft_consensus.cc:3060] T 48824d5acfbc485ebf8c2d944e7202de P e61c3a8f61bb48f8a963c9480e53c168 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:05:36.459519 22620 raft_consensus.cc:493] T 1a61655d99124a29b486ba4a5b37faea P e61c3a8f61bb48f8a963c9480e53c168 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:36.460006 22620 raft_consensus.cc:515] T 1a61655d99124a29b486ba4a5b37faea P e61c3a8f61bb48f8a963c9480e53c168 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:36.417500 22527 raft_consensus.cc:1081] T 1a61655d99124a29b486ba4a5b37faea P 0473d2b2d01f4459b1e90fd12cc7840e [term 5 LEADER]: Signalling peer e5256d91808b47c195bc9b4dbd7f2b87 to start an election
I20260709 13:05:36.435870 19403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1b10566f45d4a7d9029858330e02d5b" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
I20260709 13:05:36.438769 22549 raft_consensus.cc:515] T 14efcc79969f41babe5529c22d59156d P 0473d2b2d01f4459b1e90fd12cc7840e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:05:36.465077 22470 leader_election.cc:290] T f1b10566f45d4a7d9029858330e02d5b P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 9 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:05:36.465149 22549 leader_election.cc:290] T 14efcc79969f41babe5529c22d59156d P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:05:36.448693 19450 leader_election.cc:304] T 0afb57ae58a24a01850491d69f0213dd P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168; no voters: 127766fc592545a4997f7790f50f6076
I20260709 13:05:36.282944 22385 raft_consensus.cc:515] T 7be9efa6559648dbb5a0f7684c4542d1 P e5256d91808b47c195bc9b4dbd7f2b87 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } attrs { replace: true } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: NON_VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: true } }
I20260709 13:05:36.467940 22549 raft_consensus.cc:2804] T 0afb57ae58a24a01850491d69f0213dd P 0473d2b2d01f4459b1e90fd12cc7840e [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:05:36.468356 22549 raft_consensus.cc:493] T 0afb57ae58a24a01850491d69f0213dd P 0473d2b2d01f4459b1e90fd12cc7840e [term 7 FOLLOWER]: Starting leader election (detected failure of leader 127766fc592545a4997f7790f50f6076)
I20260709 13:05:36.468746 22549 raft_consensus.cc:3060] T 0afb57ae58a24a01850491d69f0213dd P 0473d2b2d01f4459b1e90fd12cc7840e [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:05:36.469619 22385 leader_election.cc:290] T 7be9efa6559648dbb5a0f7684c4542d1 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
W20260709 13:05:36.470649 22610 log.cc:927] Time spent T 2b74109013a140ada21feeef92d6f563 P e61c3a8f61bb48f8a963c9480e53c168: Append to log took a long time: real 0.105s	user 0.000s	sys 0.000s
W20260709 13:05:36.435461 22606 log.cc:927] Time spent T 9962423cb4e54fcfa5de01daf68a86e7 P 127766fc592545a4997f7790f50f6076: Append to log took a long time: real 0.124s	user 0.002s	sys 0.002s
W20260709 13:05:36.473850 22604 log.cc:927] Time spent T 4af19371ea874c09a0a2147040835cbb P 127766fc592545a4997f7790f50f6076: Append to log took a long time: real 0.371s	user 0.000s	sys 0.003s
I20260709 13:05:36.467105 19523 leader_election.cc:304] T e381f1d6b8184797ad142de49be225a8 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168; no voters: 0473d2b2d01f4459b1e90fd12cc7840e
I20260709 13:05:36.474295 19375 leader_election.cc:304] T a08760e15aac4630a629431f56024dc8 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
W20260709 13:05:36.484719 20078 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:36.475039 20108 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35874 (request call id 600) took 1238 ms. Trace:
I20260709 13:05:36.485988 22385 raft_consensus.cc:2804] T a08760e15aac4630a629431f56024dc8 P e5256d91808b47c195bc9b4dbd7f2b87 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:05:36.486223 20108 rpcz_store.cc:276] 0709 13:05:35.236740 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:35.237957 (+  1217us) service_pool.cc:224] Handling call
0709 13:05:35.339273 (+101316us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:05:35.400154 (+ 60881us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:05:35.402067 (+  1913us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:05:35.481539 (+ 79472us) log.cc:844] Serialized 26 byte log entry
0709 13:05:35.934820 (+453281us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:05:35.934870 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:35.942684 (+  7814us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:05:36.473140 (+530456us) spinlock_profiling.cc:243] Waited 36.9 ms on lock 0x7b4400022b4c. stack: 00007f4a79de9343 00007f4a79de9240 00007f4a797781d4 00007f4a834b6304 00007f4a834b6299 00007f4a79ca3db1 00007f4a79d41c85 00007f4a79d426a2 00007f4a7cab41db 00007f4a7caafaaf 00007f4a7caa386e 00007f4a7caa2bb6 00007f4a7caa27d8 00007f4a7caac221 00007f4a7caac1d9 00007f4a7caac169
0709 13:05:36.474702 (+  1562us) raft_consensus.cc:1685] finished
0709 13:05:36.474732 (+    30us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:36.474977 (+   245us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":13,"raft.queue_time_us":17276,"raft.run_cpu_time_us":121,"raft.run_wall_time_us":3538,"spinlock_wait_cycles":84850560,"thread_start_us":413081,"threads_started":1,"wal-append.queue_time_us":577270}
I20260709 13:05:36.488865 19402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14efcc79969f41babe5529c22d59156d" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:05:36.489643 19402 raft_consensus.cc:2468] T 14efcc79969f41babe5529c22d59156d P e5256d91808b47c195bc9b4dbd7f2b87 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 8.
I20260709 13:05:36.491564 19403 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "1a61655d99124a29b486ba4a5b37faea"
dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
 from {username='slave'} at 127.0.0.1:52342
I20260709 13:05:36.492190 19403 raft_consensus.cc:493] T 1a61655d99124a29b486ba4a5b37faea P e5256d91808b47c195bc9b4dbd7f2b87 [term 5 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:36.492506 19403 raft_consensus.cc:3060] T 1a61655d99124a29b486ba4a5b37faea P e5256d91808b47c195bc9b4dbd7f2b87 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:05:36.492762 19560 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40438 (request call id 1916) took 1108 ms. Trace:
I20260709 13:05:36.493096 19560 rpcz_store.cc:276] 0709 13:05:35.384365 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:35.387146 (+  2781us) service_pool.cc:224] Handling call
0709 13:05:35.387474 (+   328us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:35.405458 (+ 17984us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 13:05:35.768235 (+362777us) log.cc:844] Serialized 14 byte log entry
0709 13:05:36.168449 (+400214us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:05:36.168504 (+    55us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:05:36.168560 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:36.469931 (+301371us) spinlock_profiling.cc:243] Waited 9.77 ms on lock 0x7b4400022b4c. stack: 00007f4a79de9343 00007f4a79de9240 00007f4a797781d4 00007f4a834b6304 00007f4a834b6299 00007f4a79ca3db1 00007f4a79d41c85 00007f4a79d426a2 00007f4a7cab41db 00007f4a7caafaaf 00007f4a7caa386e 00007f4a7caa2bb6 00007f4a7caa27d8 00007f4a7caac221 00007f4a7caac1d9 00007f4a7caac169
0709 13:05:36.492422 (+ 22491us) spinlock_profiling.cc:243] Waited 17.8 ms on lock 0x7b540014a854. stack: 00007f4a79de9343 00007f4a79de9240 00007f4a797781d4 00007f4a834b6304 00007f4a834b6299 00007f4a7ce71571 00007f4a7cf08e01 00007f4a7cf0783e 00007f4a81ecc419 00007f4a7b443bd4 00007f4a7b443b62 00007f4a7b443a91 00007f4a7b443a0c 00007f4a7b442cc2 00007f4a7b24348c 00007f4a7b2428c6
0709 13:05:36.492468 (+    46us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:36.492586 (+   118us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":21125,"prepare.queue_time_us":154478,"prepare.run_cpu_time_us":87,"prepare.run_wall_time_us":87,"raft.queue_time_us":127646,"raft.run_cpu_time_us":65,"raft.run_wall_time_us":65,"spinlock_wait_cycles":63312640,"thread_start_us":723459,"threads_started":2,"wal-append.queue_time_us":499447}
I20260709 13:05:36.494901 22380 raft_consensus.cc:2804] T e381f1d6b8184797ad142de49be225a8 P e61c3a8f61bb48f8a963c9480e53c168 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:05:36.495338 22380 raft_consensus.cc:493] T e381f1d6b8184797ad142de49be225a8 P e61c3a8f61bb48f8a963c9480e53c168 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 0473d2b2d01f4459b1e90fd12cc7840e)
I20260709 13:05:36.495707 22380 raft_consensus.cc:3060] T e381f1d6b8184797ad142de49be225a8 P e61c3a8f61bb48f8a963c9480e53c168 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:05:36.497527 22620 leader_election.cc:290] T 1a61655d99124a29b486ba4a5b37faea P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:05:36.497702 20109 raft_consensus.cc:2468] T ff9b0eddd810459b82d91c60777c10eb P 127766fc592545a4997f7790f50f6076 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 6.
I20260709 13:05:36.503461 19403 raft_consensus.cc:515] T 1a61655d99124a29b486ba4a5b37faea P e5256d91808b47c195bc9b4dbd7f2b87 [term 6 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:36.504556 22549 raft_consensus.cc:515] T 0afb57ae58a24a01850491d69f0213dd P 0473d2b2d01f4459b1e90fd12cc7840e [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:05:36.506989 19403 leader_election.cc:290] T 1a61655d99124a29b486ba4a5b37faea P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 6 election: Requested vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:05:36.488951 19450 leader_election.cc:304] T 2725d2c4cb054f18b0fc8f735c15f6c2 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e; no voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:05:36.490348 19523 leader_election.cc:304] T 217b5fae677b4971b3bbd2f357a1f7ff P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168; no voters: 0473d2b2d01f4459b1e90fd12cc7840e
W20260709 13:05:36.515368 19376 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:36.518616 19405 raft_consensus.cc:1240] T 1a61655d99124a29b486ba4a5b37faea P e5256d91808b47c195bc9b4dbd7f2b87 [term 6 FOLLOWER]: Rejecting Update request from peer 0473d2b2d01f4459b1e90fd12cc7840e for earlier term 5. Current term is 6. Ops: []
I20260709 13:05:36.527417 19374 leader_election.cc:304] T ff9b0eddd810459b82d91c60777c10eb P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 127766fc592545a4997f7790f50f6076, e5256d91808b47c195bc9b4dbd7f2b87; no voters: 
I20260709 13:05:36.531826 19449 leader_election.cc:304] T 14efcc79969f41babe5529c22d59156d P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87; no voters: 
I20260709 13:05:36.507709 22549 leader_election.cc:290] T 0afb57ae58a24a01850491d69f0213dd P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 8 election: Requested vote from peers e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:05:36.519884 22385 raft_consensus.cc:697] T a08760e15aac4630a629431f56024dc8 P e5256d91808b47c195bc9b4dbd7f2b87 [term 9 LEADER]: Becoming Leader. State: Replica: e5256d91808b47c195bc9b4dbd7f2b87, State: Running, Role: LEADER
I20260709 13:05:36.550212 20109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1efebf73c86e432baa55533136b6e12c" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076"
I20260709 13:05:36.422387 22483 raft_consensus.cc:515] T 5ec1c4ce15e04c7e8c283a62179f2a64 P 0473d2b2d01f4459b1e90fd12cc7840e [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:05:36.485545 22524 consensus_queue.cc:1048] T fa8650e71aa14778b3d73721fc50d9fc P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.057s
W20260709 13:05:36.572715 20076 leader_election.cc:336] T ab43d85f64114d4ebf618930e43d9ed0 P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891): Timed out: RequestConsensusVote RPC to 127.17.223.3:36891 timed out after 1.799s (SENT)
I20260709 13:05:36.575407 20076 leader_election.cc:304] T ab43d85f64114d4ebf618930e43d9ed0 P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 127766fc592545a4997f7790f50f6076, e5256d91808b47c195bc9b4dbd7f2b87; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:05:36.536883 22470 raft_consensus.cc:2749] T 2725d2c4cb054f18b0fc8f735c15f6c2 P 0473d2b2d01f4459b1e90fd12cc7840e [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:05:36.568980 19526 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:36.574882 19558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df751f992649444090e27965eb1af85d" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
W20260709 13:05:36.581146 19450 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.3:36891, user_credentials={real_user=slave}} blocked reactor thread for 92282.4us
W20260709 13:05:36.581251 19526 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:36.581252 19558 raft_consensus.cc:3060] T df751f992649444090e27965eb1af85d P e61c3a8f61bb48f8a963c9480e53c168 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:05:36.582984 19555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e5873a19244c5ebbcd38e126796ee7" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 10 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:05:36.543668 22549 raft_consensus.cc:2804] T 14efcc79969f41babe5529c22d59156d P 0473d2b2d01f4459b1e90fd12cc7840e [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:05:36.547304 22293 raft_consensus.cc:2804] T ff9b0eddd810459b82d91c60777c10eb P e5256d91808b47c195bc9b4dbd7f2b87 [term 6 FOLLOWER]: Leader election won for term 6
W20260709 13:05:36.595240 19523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.1:40321, user_credentials={real_user=slave}} blocked reactor thread for 105004us
I20260709 13:05:36.537705 22381 consensus_queue.cc:1059] T df751f992649444090e27965eb1af85d P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.044s
I20260709 13:05:36.550166 22540 raft_consensus.cc:2804] T 217b5fae677b4971b3bbd2f357a1f7ff P e61c3a8f61bb48f8a963c9480e53c168 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:05:36.506570 22612 raft_consensus.cc:515] T 14935b3ddf914369822e4a0547aaa355 P 0473d2b2d01f4459b1e90fd12cc7840e [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } attrs { replace: true } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:05:36.520699 21926 raft_consensus.cc:515] T 5ec1c4ce15e04c7e8c283a62179f2a64 P e5256d91808b47c195bc9b4dbd7f2b87 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
W20260709 13:05:36.616597 20077 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:36.604658 22293 raft_consensus.cc:697] T ff9b0eddd810459b82d91c60777c10eb P e5256d91808b47c195bc9b4dbd7f2b87 [term 6 LEADER]: Becoming Leader. State: Replica: e5256d91808b47c195bc9b4dbd7f2b87, State: Running, Role: LEADER
I20260709 13:05:36.618194 22293 consensus_queue.cc:237] T ff9b0eddd810459b82d91c60777c10eb P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:05:36.595064 20108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9962423cb4e54fcfa5de01daf68a86e7" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:05:36.623344 22631 raft_consensus.cc:493] T 22196caba61445d3bec98a0aab3c337d P e61c3a8f61bb48f8a963c9480e53c168 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:36.592360 22549 raft_consensus.cc:493] T 14efcc79969f41babe5529c22d59156d P 0473d2b2d01f4459b1e90fd12cc7840e [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:36.632525 19556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef32ce6fdd0e40d382c79974f30295c6" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:05:36.634079 19556 raft_consensus.cc:3060] T ef32ce6fdd0e40d382c79974f30295c6 P e61c3a8f61bb48f8a963c9480e53c168 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:05:36.595142 22558 raft_consensus.cc:2749] T ab43d85f64114d4ebf618930e43d9ed0 P 127766fc592545a4997f7790f50f6076 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:05:36.637055 22483 leader_election.cc:290] T 5ec1c4ce15e04c7e8c283a62179f2a64 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 6 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
W20260709 13:05:36.638984 20076 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.3:36891, user_credentials={real_user=slave}} blocked reactor thread for 66323.1us
I20260709 13:05:36.580415 22443 consensus_queue.cc:1059] T 40e1e16737a842ee936002830f36882e P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.035s
I20260709 13:05:36.639722 19558 raft_consensus.cc:2468] T df751f992649444090e27965eb1af85d P e61c3a8f61bb48f8a963c9480e53c168 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 9.
I20260709 13:05:36.579216 22526 consensus_queue.cc:1059] T ff9b0eddd810459b82d91c60777c10eb P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.033s
I20260709 13:05:36.643167 19558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cdf56e38bbc453d9438d359e5a69955" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
W20260709 13:05:36.643117 19450 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.3:36891, user_credentials={real_user=slave}} blocked reactor thread for 47463us
I20260709 13:05:36.605563 22540 raft_consensus.cc:493] T 217b5fae677b4971b3bbd2f357a1f7ff P e61c3a8f61bb48f8a963c9480e53c168 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 0473d2b2d01f4459b1e90fd12cc7840e)
W20260709 13:05:36.652040 19377 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.2:46257, user_credentials={real_user=slave}} blocked reactor thread for 144794us
I20260709 13:05:36.640599 19526 leader_election.cc:304] T 86a6797bdfe94fa496c050ceae4bd0d9 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:05:36.639473 22549 raft_consensus.cc:3060] T 14efcc79969f41babe5529c22d59156d P 0473d2b2d01f4459b1e90fd12cc7840e [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:05:36.670428 19558 raft_consensus.cc:2468] T 0cdf56e38bbc453d9438d359e5a69955 P e61c3a8f61bb48f8a963c9480e53c168 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 9.
I20260709 13:05:36.687708 19554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "179fd671030940b4b4a4e24bcc4aba0a" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
W20260709 13:05:36.689267 19449 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.1:40321, user_credentials={real_user=slave}} blocked reactor thread for 155891us
W20260709 13:05:36.692443 20077 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:05:36.693617 19526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.2:46257, user_credentials={real_user=slave}} blocked reactor thread for 53136.1us
I20260709 13:05:36.670089 22540 raft_consensus.cc:3060] T 217b5fae677b4971b3bbd2f357a1f7ff P e61c3a8f61bb48f8a963c9480e53c168 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:05:36.623904 22631 raft_consensus.cc:515] T 22196caba61445d3bec98a0aab3c337d P e61c3a8f61bb48f8a963c9480e53c168 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:36.715502 19558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f575b143b844aa096b50997dad3516a" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:05:36.727413 19449 leader_election.cc:304] T 775c229504194560ba9589bc2199b089 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e; no voters: 127766fc592545a4997f7790f50f6076, e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:05:36.680954 22483 raft_consensus.cc:493] T ab43d85f64114d4ebf618930e43d9ed0 P 0473d2b2d01f4459b1e90fd12cc7840e [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:36.735666 19449 leader_election.cc:304] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e; no voters: 127766fc592545a4997f7790f50f6076, e5256d91808b47c195bc9b4dbd7f2b87
W20260709 13:05:36.737159 19374 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:05:36.714635 22480 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.600s	user 0.004s	sys 0.015s
I20260709 13:05:36.753196 19558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7be9efa6559648dbb5a0f7684c4542d1" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
W20260709 13:05:36.748395 19308 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:51954 (request call id 129) took 20001 ms (client timeout 15000 ms). Trace:
W20260709 13:05:36.755470 19450 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.3:36891, user_credentials={real_user=slave}} blocked reactor thread for 60316.7us
I20260709 13:05:36.696586 22056 raft_consensus.cc:493] T 5ec1c4ce15e04c7e8c283a62179f2a64 P 127766fc592545a4997f7790f50f6076 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:36.700793 22620 raft_consensus.cc:2804] T 86a6797bdfe94fa496c050ceae4bd0d9 P e61c3a8f61bb48f8a963c9480e53c168 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:05:36.755669 19449 leader_election.cc:304] T 1f85fc4b527a48848e5faa083b604e36 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e; no voters: 127766fc592545a4997f7790f50f6076, e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:05:36.761053 19556 raft_consensus.cc:2468] T ef32ce6fdd0e40d382c79974f30295c6 P e61c3a8f61bb48f8a963c9480e53c168 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 9.
I20260709 13:05:36.769446 19556 raft_consensus.cc:1275] T 1dc5b3532fe54f74876d02beffa2c230 P e61c3a8f61bb48f8a963c9480e53c168 [term 7 FOLLOWER]: Refusing update from remote peer e5256d91808b47c195bc9b4dbd7f2b87: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
W20260709 13:05:36.761734 19523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.1:40321, user_credentials={real_user=slave}} blocked reactor thread for 90547.7us
I20260709 13:05:36.762825 19560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff75a1d4cb1f493db8f71ddc136ba9ab" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:05:36.746685 22640 raft_consensus.cc:2749] T 775c229504194560ba9589bc2199b089 P 0473d2b2d01f4459b1e90fd12cc7840e [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 13:05:36.757632 22480 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.654s	user 0.004s	sys 0.015s
I20260709 13:05:36.700531 22470 consensus_queue.cc:1059] T 1a61655d99124a29b486ba4a5b37faea P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.066s
I20260709 13:05:36.796139 19558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a61655d99124a29b486ba4a5b37faea" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: true dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:05:36.796784 19558 raft_consensus.cc:3060] T 1a61655d99124a29b486ba4a5b37faea P e61c3a8f61bb48f8a963c9480e53c168 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:05:36.756896 22597 log.cc:927] Time spent T 833a2f0775ed407a94b8924ce50adb63 P 127766fc592545a4997f7790f50f6076: Append to log took a long time: real 0.061s	user 0.001s	sys 0.000s
W20260709 13:05:36.777083 19525 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:36.749562 22381 raft_consensus.cc:2749] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P 0473d2b2d01f4459b1e90fd12cc7840e [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:05:36.673441 22385 consensus_queue.cc:237] T a08760e15aac4630a629431f56024dc8 P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 7.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:36.782933 22628 raft_consensus.cc:493] T 62c6c134d3d24a1ab144dd9ee6bc3f64 P e61c3a8f61bb48f8a963c9480e53c168 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 0473d2b2d01f4459b1e90fd12cc7840e)
W20260709 13:05:36.783646 22637 log.cc:927] Time spent T d1e5873a19244c5ebbcd38e126796ee7 P e61c3a8f61bb48f8a963c9480e53c168: Append to log took a long time: real 0.087s	user 0.000s	sys 0.000s
W20260709 13:05:36.784492 22639 log.cc:927] Time spent T 172b3dd13109415a955b71ac0e9d2234 P e5256d91808b47c195bc9b4dbd7f2b87: Append to log took a long time: real 0.082s	user 0.000s	sys 0.000s
I20260709 13:05:36.755615 22483 raft_consensus.cc:515] T ab43d85f64114d4ebf618930e43d9ed0 P 0473d2b2d01f4459b1e90fd12cc7840e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } attrs { replace: true } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
W20260709 13:05:36.785188 22638 log.cc:927] Time spent T bc225c93219c45538b53a1bd3d387e4d P e5256d91808b47c195bc9b4dbd7f2b87: Append to log took a long time: real 0.124s	user 0.000s	sys 0.000s
W20260709 13:05:36.785924 22630 log.cc:927] Time spent T 22196caba61445d3bec98a0aab3c337d P e5256d91808b47c195bc9b4dbd7f2b87: Append to log took a long time: real 0.147s	user 0.001s	sys 0.000s
I20260709 13:05:36.786695 22612 leader_election.cc:290] T 14935b3ddf914369822e4a0547aaa355 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 7 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:05:36.732640 22526 consensus_queue.cc:1048] T ff9b0eddd810459b82d91c60777c10eb P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Connected to new peer: Peer: permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.042s
I20260709 13:05:36.695732 22380 raft_consensus.cc:515] T e381f1d6b8184797ad142de49be225a8 P e61c3a8f61bb48f8a963c9480e53c168 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:36.770255 22620 raft_consensus.cc:493] T 86a6797bdfe94fa496c050ceae4bd0d9 P e61c3a8f61bb48f8a963c9480e53c168 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:36.767608 22056 raft_consensus.cc:515] T 5ec1c4ce15e04c7e8c283a62179f2a64 P 127766fc592545a4997f7790f50f6076 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:05:36.791195 19450 leader_election.cc:304] T ff75a1d4cb1f493db8f71ddc136ba9ab P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e; no voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168
W20260709 13:05:36.805752 19525 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:05:36.819303 20076 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:05:36.836932 19525 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:05:36.843847 19450 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.3:36891, user_credentials={real_user=slave}} blocked reactor thread for 52741.4us
I20260709 13:05:36.844816 19450 leader_election.cc:400] T 3e1f505cb0f1427bbd698ac889d80821 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 7 election: Vote denied by peer e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891) with higher term. Message: Invalid argument: T 3e1f505cb0f1427bbd698ac889d80821 P e61c3a8f61bb48f8a963c9480e53c168 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 0473d2b2d01f4459b1e90fd12cc7840e for earlier term 7. Current term is 8.
I20260709 13:05:36.845777 19450 leader_election.cc:304] T 0e1085d23e8347fbbd5bce7542f4b1f4 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e; no voters: 127766fc592545a4997f7790f50f6076, e61c3a8f61bb48f8a963c9480e53c168
W20260709 13:05:36.848323 20076 leader_election.cc:336] T ed7fdbcb96d14d418db9ca90a792588a P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891): Timed out: RequestConsensusVote RPC to 127.17.223.3:36891 timed out after 2.075s (SENT)
W20260709 13:05:36.848551 22636 log.cc:927] Time spent T 48824d5acfbc485ebf8c2d944e7202de P 0473d2b2d01f4459b1e90fd12cc7840e: Append to log took a long time: real 0.083s	user 0.000s	sys 0.000s
I20260709 13:05:36.849107 19375 leader_election.cc:304] T df751f992649444090e27965eb1af85d P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:05:36.850324 19375 leader_election.cc:304] T 0cdf56e38bbc453d9438d359e5a69955 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:05:36.851258 22251 raft_consensus.cc:2804] T df751f992649444090e27965eb1af85d P e5256d91808b47c195bc9b4dbd7f2b87 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:05:36.843919 21926 leader_election.cc:290] T 5ec1c4ce15e04c7e8c283a62179f2a64 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:05:36.852267 22251 raft_consensus.cc:697] T df751f992649444090e27965eb1af85d P e5256d91808b47c195bc9b4dbd7f2b87 [term 9 LEADER]: Becoming Leader. State: Replica: e5256d91808b47c195bc9b4dbd7f2b87, State: Running, Role: LEADER
I20260709 13:05:36.852559 22503 raft_consensus.cc:2804] T 0cdf56e38bbc453d9438d359e5a69955 P e5256d91808b47c195bc9b4dbd7f2b87 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:05:36.852962 22503 raft_consensus.cc:493] T 0cdf56e38bbc453d9438d359e5a69955 P e5256d91808b47c195bc9b4dbd7f2b87 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:36.853173 22056 leader_election.cc:290] T 5ec1c4ce15e04c7e8c283a62179f2a64 P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:05:36.853333 22503 raft_consensus.cc:3060] T 0cdf56e38bbc453d9438d359e5a69955 P e5256d91808b47c195bc9b4dbd7f2b87 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:05:36.836113 22620 raft_consensus.cc:3060] T 86a6797bdfe94fa496c050ceae4bd0d9 P e61c3a8f61bb48f8a963c9480e53c168 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:05:36.854948 22612 raft_consensus.cc:2749] T ff75a1d4cb1f493db8f71ddc136ba9ab P 0473d2b2d01f4459b1e90fd12cc7840e [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:05:36.855695 22612 raft_consensus.cc:3060] T 0e1085d23e8347fbbd5bce7542f4b1f4 P 0473d2b2d01f4459b1e90fd12cc7840e [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:05:36.857182 22174 raft_consensus.cc:493] T ece3db938bc649d4a40a51522ed5259c P 127766fc592545a4997f7790f50f6076 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:36.857671 22174 raft_consensus.cc:515] T ece3db938bc649d4a40a51522ed5259c P 127766fc592545a4997f7790f50f6076 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
W20260709 13:05:36.758040 19308 rpcz_store.cc:269] 0709 13:05:16.715542 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:16.730633 (+ 15091us) service_pool.cc:224] Handling call
0709 13:05:36.716897 (+19986264us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:05:34.956903 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:05:34.970230 (+ 13327us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:05:34.970270 (+    40us) write_op.cc:435] Acquired schema lock
0709 13:05:34.970279 (+     9us) tablet.cc:662] Decoding operations
0709 13:05:35.009256 (+ 38977us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:05:35.009344 (+    88us) write_op.cc:641] Partition lock acquired for write op
0709 13:05:35.009383 (+    39us) tablet.cc:685] Acquiring locks for 4 operations
0709 13:05:35.009906 (+   523us) tablet.cc:701] Row locks acquired
0709 13:05:35.009968 (+    62us) write_op.cc:260] PREPARE: finished
0709 13:05:35.010162 (+   194us) write_op.cc:270] Start()
0709 13:05:35.010311 (+   149us) write_op.cc:276] Timestamp: P: 1783602335010079 usec, L: 0
0709 13:05:35.010329 (+    18us) op_driver.cc:348] REPLICATION: starting
0709 13:05:35.011156 (+   827us) log.cc:844] Serialized 1674 byte log entry
0709 13:05:35.485457 (+474301us) op_driver.cc:464] REPLICATION: finished
0709 13:05:35.864439 (+378982us) write_op.cc:301] APPLY: starting
0709 13:05:35.864558 (+   119us) tablet.cc:1367] starting BulkCheckPresence
0709 13:05:35.864798 (+   240us) tablet.cc:1370] finished BulkCheckPresence
0709 13:05:35.889496 (+ 24698us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:05:35.987220 (+ 97724us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:05:35.987603 (+   383us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=4
0709 13:05:35.987679 (+    76us) write_op.cc:312] APPLY: finished
0709 13:05:35.988068 (+   389us) log.cc:844] Serialized 41 byte log entry
0709 13:05:35.988266 (+   198us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:05:35.988360 (+    94us) write_op.cc:454] Released schema lock
0709 13:05:35.988415 (+    55us) write_op.cc:341] FINISH: Updating metrics
0709 13:05:35.988878 (+   463us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:05:35.988925 (+    47us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":791171,"reported_tablets":12,"child_traces":[["op",{"apply.queue_time_us":367822,"apply.run_cpu_time_us":4033,"apply.run_wall_time_us":124428,"num_ops":4,"prepare.queue_time_us":83968,"prepare.run_cpu_time_us":11559,"prepare.run_wall_time_us":186116,"raft.queue_time_us":278981,"raft.run_cpu_time_us":4552,"raft.run_wall_time_us":326723,"replication_time_us":465021,"thread_start_us":394929,"threads_started":4,"wal-append.queue_time_us":176190}]]}
I20260709 13:05:36.858770 22380 leader_election.cc:290] T e381f1d6b8184797ad142de49be225a8 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 6 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
W20260709 13:05:36.861840 20077 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:36.860378 19375 leader_election.cc:304] T ef32ce6fdd0e40d382c79974f30295c6 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:05:36.829715 22480 raft_consensus.cc:2749] T 1f85fc4b527a48848e5faa083b604e36 P 0473d2b2d01f4459b1e90fd12cc7840e [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:05:36.870365 19523 leader_election.cc:304] T f1b10566f45d4a7d9029858330e02d5b P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e61c3a8f61bb48f8a963c9480e53c168; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:05:36.890825 20109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14efcc79969f41babe5529c22d59156d" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:05:36.893442 20103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ec1c4ce15e04c7e8c283a62179f2a64" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:05:36.894302 20103 raft_consensus.cc:2468] T 5ec1c4ce15e04c7e8c283a62179f2a64 P 127766fc592545a4997f7790f50f6076 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 6.
W20260709 13:05:36.895594 19449 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.4:43121, user_credentials={real_user=slave}} blocked reactor thread for 122701us
I20260709 13:05:36.782946 22624 consensus_queue.cc:1048] T 7be9efa6559648dbb5a0f7684c4542d1 P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.209s
W20260709 13:05:36.902885 19524 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:36.900213 22614 raft_consensus.cc:2804] T ef32ce6fdd0e40d382c79974f30295c6 P e5256d91808b47c195bc9b4dbd7f2b87 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:05:36.904107 22614 raft_consensus.cc:697] T ef32ce6fdd0e40d382c79974f30295c6 P e5256d91808b47c195bc9b4dbd7f2b87 [term 9 LEADER]: Becoming Leader. State: Replica: e5256d91808b47c195bc9b4dbd7f2b87, State: Running, Role: LEADER
I20260709 13:05:36.904219 22613 consensus_queue.cc:1048] T 1dc5b3532fe54f74876d02beffa2c230 P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:05:36.904676 19406 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52342 (request call id 2119) took 1107 ms. Trace:
I20260709 13:05:36.905022 22614 consensus_queue.cc:237] T ef32ce6fdd0e40d382c79974f30295c6 P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:36.899014 20109 raft_consensus.cc:2468] T 14efcc79969f41babe5529c22d59156d P 127766fc592545a4997f7790f50f6076 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 8.
W20260709 13:05:36.908095 20075 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:05:36.911415 19375 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:36.905129 19406 rpcz_store.cc:276] 0709 13:05:35.797064 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:35.797215 (+   151us) service_pool.cc:224] Handling call
0709 13:05:35.814786 (+ 17571us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:05:36.077904 (+263118us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:05:36.078161 (+   257us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:05:36.151210 (+ 73049us) log.cc:844] Serialized 52 byte log entry
0709 13:05:36.417170 (+265960us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:05:36.518095 (+100925us) log.cc:844] Serialized 14 byte log entry
0709 13:05:36.533319 (+ 15224us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:36.533386 (+    67us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:05:36.895645 (+362259us) spinlock_profiling.cc:243] Waited 2.19 ms on lock 0x7b18003f2620. stack: 00007f4a79de9343 00007f4a79de9240 00007f4a797781d4 00007f4a834b6304 00007f4a834b6299 00007f4a82ce3de1 00007f4a82cf05b1 00007f4a79de92a6 00007f4a79de9240 00007f4a797781d4 00007f4a834b6304 00007f4a834b6299 00007f4a81e31aa1 00007f4a81e28b37 00007f4a81e289ca 00007f4a81f2026f
0709 13:05:36.904391 (+  8746us) raft_consensus.cc:1685] finished
0709 13:05:36.904485 (+    94us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:36.904621 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":14962,"prepare.queue_time_us":102416,"prepare.run_cpu_time_us":37,"prepare.run_wall_time_us":38,"raft.queue_time_us":55432,"raft.run_cpu_time_us":109,"raft.run_wall_time_us":109,"spinlock_wait_cycles":17166464,"thread_start_us":475700,"threads_started":2,"wal-append.queue_time_us":390084}
I20260709 13:05:36.831562 22628 raft_consensus.cc:515] T 62c6c134d3d24a1ab144dd9ee6bc3f64 P e61c3a8f61bb48f8a963c9480e53c168 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:05:36.917325 22626 raft_consensus.cc:493] T 2a16f7501e2444fb86d4e2778e734e02 P e61c3a8f61bb48f8a963c9480e53c168 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader e5256d91808b47c195bc9b4dbd7f2b87)
I20260709 13:05:36.917950 22626 raft_consensus.cc:515] T 2a16f7501e2444fb86d4e2778e734e02 P e61c3a8f61bb48f8a963c9480e53c168 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:05:36.853205 22251 consensus_queue.cc:237] T df751f992649444090e27965eb1af85d P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:36.919700 19551 raft_consensus.cc:1275] T ece3db938bc649d4a40a51522ed5259c P e61c3a8f61bb48f8a963c9480e53c168 [term 8 FOLLOWER]: Refusing update from remote peer e5256d91808b47c195bc9b4dbd7f2b87: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 13:05:36.920047 22626 leader_election.cc:290] T 2a16f7501e2444fb86d4e2778e734e02 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
W20260709 13:05:36.920948 20076 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.3:36891, user_credentials={real_user=slave}} blocked reactor thread for 72656.5us
I20260709 13:05:36.911849 19558 raft_consensus.cc:2468] T 1a61655d99124a29b486ba4a5b37faea P e61c3a8f61bb48f8a963c9480e53c168 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 6.
I20260709 13:05:36.918301 22611 raft_consensus.cc:3055] T ff9b0eddd810459b82d91c60777c10eb P 0473d2b2d01f4459b1e90fd12cc7840e [term 5 LEADER]: Stepping down as leader of term 5
W20260709 13:05:36.933322 19525 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:36.907051 22634 raft_consensus.cc:2749] T f1b10566f45d4a7d9029858330e02d5b P e61c3a8f61bb48f8a963c9480e53c168 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:05:36.935111 19556 raft_consensus.cc:1240] T 40e1e16737a842ee936002830f36882e P e61c3a8f61bb48f8a963c9480e53c168 [term 10 FOLLOWER]: Rejecting Update request from peer e5256d91808b47c195bc9b4dbd7f2b87 for earlier term 9. Current term is 10. Ops: [9.6-9.6]
I20260709 13:05:36.910197 21957 raft_consensus.cc:3055] T 40e1e16737a842ee936002830f36882e P e5256d91808b47c195bc9b4dbd7f2b87 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:05:36.943071 19374 leader_election.cc:304] T 5ec1c4ce15e04c7e8c283a62179f2a64 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 127766fc592545a4997f7790f50f6076, e5256d91808b47c195bc9b4dbd7f2b87; no voters: 
W20260709 13:05:36.943576 19523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.1:40321, user_credentials={real_user=slave}} blocked reactor thread for 101861us
I20260709 13:05:36.881114 22640 consensus_queue.cc:1048] T 309c3ca0ca4b4f3ba129752ea2cb293b P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Connected to new peer: Peer: permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.059s
W20260709 13:05:36.965360 19376 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:36.956844 19404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ece3db938bc649d4a40a51522ed5259c" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:05:36.958626 18300 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 13:05:37.014662 22635 log.cc:927] Time spent T 3e1f505cb0f1427bbd698ac889d80821 P e61c3a8f61bb48f8a963c9480e53c168: Append to log took a long time: real 0.067s	user 0.000s	sys 0.000s
I20260709 13:05:37.031008 21926 raft_consensus.cc:493] T fa8650e71aa14778b3d73721fc50d9fc P e5256d91808b47c195bc9b4dbd7f2b87 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:37.031898 21926 raft_consensus.cc:515] T fa8650e71aa14778b3d73721fc50d9fc P e5256d91808b47c195bc9b4dbd7f2b87 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:37.032461 19556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28af091831594f9d8e96482078cc7625" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:05:37.033166 19551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86a6797bdfe94fa496c050ceae4bd0d9" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 7 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:05:37.033823 19560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9f0d59553ad444883fcf5b5909f9798" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:05:36.991263 19406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ec1c4ce15e04c7e8c283a62179f2a64" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
W20260709 13:05:36.992257 20078 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:05:36.977603 19526 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:37.041767 21926 leader_election.cc:290] T fa8650e71aa14778b3d73721fc50d9fc P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:05:37.011862 22549 raft_consensus.cc:515] T 14efcc79969f41babe5529c22d59156d P 0473d2b2d01f4459b1e90fd12cc7840e [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:05:36.936172 22611 raft_consensus.cc:740] T ff9b0eddd810459b82d91c60777c10eb P 0473d2b2d01f4459b1e90fd12cc7840e [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 0473d2b2d01f4459b1e90fd12cc7840e, State: Running, Role: LEADER
I20260709 13:05:37.004612 22658 raft_consensus.cc:493] T 7f575b143b844aa096b50997dad3516a P 0473d2b2d01f4459b1e90fd12cc7840e [term 3 FOLLOWER]: Starting pre-election (detected failure of leader e61c3a8f61bb48f8a963c9480e53c168)
I20260709 13:05:37.044142 22611 consensus_queue.cc:260] T ff9b0eddd810459b82d91c60777c10eb P 0473d2b2d01f4459b1e90fd12cc7840e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:05:37.045203 22611 raft_consensus.cc:3060] T ff9b0eddd810459b82d91c60777c10eb P 0473d2b2d01f4459b1e90fd12cc7840e [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:05:37.044836 22658 raft_consensus.cc:515] T 7f575b143b844aa096b50997dad3516a P 0473d2b2d01f4459b1e90fd12cc7840e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:36.989128 19305 catalog_manager.cc:5697] T 9962423cb4e54fcfa5de01daf68a86e7 P 127766fc592545a4997f7790f50f6076 reported cstate change: term changed from 8 to 11. New cstate: current_term: 11 leader_uuid: "127766fc592545a4997f7790f50f6076" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:05:37.041589 19526 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:05:37.015713 22652 log.cc:927] Time spent T 4509b76741dc428e9201c70c1658da13 P 0473d2b2d01f4459b1e90fd12cc7840e: Append to log took a long time: real 0.057s	user 0.000s	sys 0.000s
W20260709 13:05:37.014919 22647 log.cc:927] Time spent T 4af19371ea874c09a0a2147040835cbb P e61c3a8f61bb48f8a963c9480e53c168: Append to log took a long time: real 0.100s	user 0.000s	sys 0.001s
W20260709 13:05:37.012693 22642 log.cc:927] Time spent T b08304a0a02b42d7840c4e8ee9a6bd1a P 0473d2b2d01f4459b1e90fd12cc7840e: Append to log took a long time: real 0.098s	user 0.000s	sys 0.000s
I20260709 13:05:37.058247 19305 catalog_manager.cc:5697] T 0afb57ae58a24a01850491d69f0213dd P 127766fc592545a4997f7790f50f6076 reported cstate change: term changed from 5 to 7, leader changed from e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3) to 127766fc592545a4997f7790f50f6076 (127.17.223.4). New cstate: current_term: 7 leader_uuid: "127766fc592545a4997f7790f50f6076" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:05:37.016271 22483 leader_election.cc:290] T ab43d85f64114d4ebf618930e43d9ed0 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:05:37.044039 22549 leader_election.cc:290] T 14efcc79969f41babe5529c22d59156d P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 9 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:05:36.933053 22174 leader_election.cc:290] T ece3db938bc649d4a40a51522ed5259c P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:05:36.917364 22628 leader_election.cc:290] T 62c6c134d3d24a1ab144dd9ee6bc3f64 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:05:36.971577 22534 raft_consensus.cc:2804] T 5ec1c4ce15e04c7e8c283a62179f2a64 P e5256d91808b47c195bc9b4dbd7f2b87 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:05:36.958696 22631 leader_election.cc:290] T 22196caba61445d3bec98a0aab3c337d P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:05:36.940650 22527 raft_consensus.cc:3055] T df751f992649444090e27965eb1af85d P 0473d2b2d01f4459b1e90fd12cc7840e [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:05:37.095466 22527 raft_consensus.cc:740] T df751f992649444090e27965eb1af85d P 0473d2b2d01f4459b1e90fd12cc7840e [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 0473d2b2d01f4459b1e90fd12cc7840e, State: Running, Role: LEADER
I20260709 13:05:37.090131 22620 raft_consensus.cc:515] T 86a6797bdfe94fa496c050ceae4bd0d9 P e61c3a8f61bb48f8a963c9480e53c168 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:37.096760 20103 raft_consensus.cc:1275] T ff9b0eddd810459b82d91c60777c10eb P 127766fc592545a4997f7790f50f6076 [term 6 FOLLOWER]: Refusing update from remote peer e5256d91808b47c195bc9b4dbd7f2b87: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:05:37.097960 22620 leader_election.cc:290] T 86a6797bdfe94fa496c050ceae4bd0d9 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 8 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:05:37.099902 19560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48824d5acfbc485ebf8c2d944e7202de" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:05:37.100739 19560 raft_consensus.cc:2410] T 48824d5acfbc485ebf8c2d944e7202de P e61c3a8f61bb48f8a963c9480e53c168 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 0473d2b2d01f4459b1e90fd12cc7840e for term 8 because replica has last-logged OpId of term: 7 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 7.
I20260709 13:05:37.101622 19554 raft_consensus.cc:1240] T e381f1d6b8184797ad142de49be225a8 P e61c3a8f61bb48f8a963c9480e53c168 [term 6 FOLLOWER]: Rejecting Update request from peer 0473d2b2d01f4459b1e90fd12cc7840e for earlier term 5. Current term is 6. Ops: []
I20260709 13:05:37.101920 19556 raft_consensus.cc:1275] T 22196caba61445d3bec98a0aab3c337d P e61c3a8f61bb48f8a963c9480e53c168 [term 7 FOLLOWER]: Refusing update from remote peer 0473d2b2d01f4459b1e90fd12cc7840e: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 7 index: 5. (term mismatch)
I20260709 13:05:37.102298 19556 pending_rounds.cc:85] T 22196caba61445d3bec98a0aab3c337d P e61c3a8f61bb48f8a963c9480e53c168: Aborting all ops after (but not including) 4
I20260709 13:05:37.102528 19556 pending_rounds.cc:107] T 22196caba61445d3bec98a0aab3c337d P e61c3a8f61bb48f8a963c9480e53c168: Aborting uncommitted NO_OP operation due to leader change: 6.5
I20260709 13:05:37.102770 19556 raft_consensus.cc:2889] T 22196caba61445d3bec98a0aab3c337d P e61c3a8f61bb48f8a963c9480e53c168 [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:05:37.103021 19559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b74109013a140ada21feeef92d6f563" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:05:37.079305 22650 raft_consensus.cc:493] T bc225c93219c45538b53a1bd3d387e4d P 0473d2b2d01f4459b1e90fd12cc7840e [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:37.103807 19559 raft_consensus.cc:2410] T 2b74109013a140ada21feeef92d6f563 P e61c3a8f61bb48f8a963c9480e53c168 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0473d2b2d01f4459b1e90fd12cc7840e for term 6 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 4.
I20260709 13:05:37.103946 22655 raft_consensus.cc:493] T 40e1e16737a842ee936002830f36882e P 0473d2b2d01f4459b1e90fd12cc7840e [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:37.104245 20109 raft_consensus.cc:1275] T ece3db938bc649d4a40a51522ed5259c P 127766fc592545a4997f7790f50f6076 [term 8 FOLLOWER]: Refusing update from remote peer e5256d91808b47c195bc9b4dbd7f2b87: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 13:05:37.104091 22650 raft_consensus.cc:515] T bc225c93219c45538b53a1bd3d387e4d P 0473d2b2d01f4459b1e90fd12cc7840e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:37.104423 22655 raft_consensus.cc:515] T 40e1e16737a842ee936002830f36882e P 0473d2b2d01f4459b1e90fd12cc7840e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:37.105331 19551 raft_consensus.cc:2368] T 86a6797bdfe94fa496c050ceae4bd0d9 P e61c3a8f61bb48f8a963c9480e53c168 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 0473d2b2d01f4459b1e90fd12cc7840e for earlier term 7. Current term is 8.
I20260709 13:05:37.091580 19523 leader_election.cc:304] T 65d8cb8d6ec64f459d5a47cefab10acf P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e61c3a8f61bb48f8a963c9480e53c168; no voters: 127766fc592545a4997f7790f50f6076, e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:05:37.061918 22634 raft_consensus.cc:493] T 6c5eebf646ad445a9d1b1adc319d7b16 P e61c3a8f61bb48f8a963c9480e53c168 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:37.070212 22658 leader_election.cc:290] T 7f575b143b844aa096b50997dad3516a P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:05:37.093063 22540 raft_consensus.cc:515] T 217b5fae677b4971b3bbd2f357a1f7ff P e61c3a8f61bb48f8a963c9480e53c168 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:37.014396 22503 raft_consensus.cc:515] T 0cdf56e38bbc453d9438d359e5a69955 P e5256d91808b47c195bc9b4dbd7f2b87 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:36.951226 21957 raft_consensus.cc:740] T 40e1e16737a842ee936002830f36882e P e5256d91808b47c195bc9b4dbd7f2b87 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: e5256d91808b47c195bc9b4dbd7f2b87, State: Running, Role: LEADER
I20260709 13:05:37.104722 19557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa8650e71aa14778b3d73721fc50d9fc" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:05:37.110651 19552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab43d85f64114d4ebf618930e43d9ed0" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:05:37.113312 22634 raft_consensus.cc:515] T 6c5eebf646ad445a9d1b1adc319d7b16 P e61c3a8f61bb48f8a963c9480e53c168 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:05:37.113827 19552 raft_consensus.cc:2468] T ab43d85f64114d4ebf618930e43d9ed0 P e61c3a8f61bb48f8a963c9480e53c168 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 6.
I20260709 13:05:37.113983 21957 consensus_queue.cc:260] T 40e1e16737a842ee936002830f36882e P e5256d91808b47c195bc9b4dbd7f2b87 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:37.114650 22540 leader_election.cc:290] T 217b5fae677b4971b3bbd2f357a1f7ff P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 5 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:05:37.115067 21957 raft_consensus.cc:3060] T 40e1e16737a842ee936002830f36882e P e5256d91808b47c195bc9b4dbd7f2b87 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:05:37.115331 19555 raft_consensus.cc:1240] T 217b5fae677b4971b3bbd2f357a1f7ff P e61c3a8f61bb48f8a963c9480e53c168 [term 5 FOLLOWER]: Rejecting Update request from peer 0473d2b2d01f4459b1e90fd12cc7840e for earlier term 4. Current term is 5. Ops: []
I20260709 13:05:37.115558 22634 leader_election.cc:290] T 6c5eebf646ad445a9d1b1adc319d7b16 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:05:37.116199 19557 raft_consensus.cc:3060] T fa8650e71aa14778b3d73721fc50d9fc P e61c3a8f61bb48f8a963c9480e53c168 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:05:37.110889 19558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4509b76741dc428e9201c70c1658da13" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:05:37.116991 19558 raft_consensus.cc:3060] T 4509b76741dc428e9201c70c1658da13 P e61c3a8f61bb48f8a963c9480e53c168 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:05:37.121213 22648 log.cc:927] Time spent T fa731b585f684a7fb2d106c50f143b83 P e61c3a8f61bb48f8a963c9480e53c168: Append to log took a long time: real 0.204s	user 0.002s	sys 0.000s
I20260709 13:05:37.122084 22650 leader_election.cc:290] T bc225c93219c45538b53a1bd3d387e4d P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:05:37.122316 22381 raft_consensus.cc:493] T 179fd671030940b4b4a4e24bcc4aba0a P 0473d2b2d01f4459b1e90fd12cc7840e [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:37.107040 22613 consensus_queue.cc:1048] T ff9b0eddd810459b82d91c60777c10eb P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Connected to new peer: Peer: permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.017s
I20260709 13:05:37.123222 22381 raft_consensus.cc:515] T 179fd671030940b4b4a4e24bcc4aba0a P 0473d2b2d01f4459b1e90fd12cc7840e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:37.125278 22381 leader_election.cc:290] T 179fd671030940b4b4a4e24bcc4aba0a P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:05:37.125803 22624 raft_consensus.cc:493] T 0e1085d23e8347fbbd5bce7542f4b1f4 P e61c3a8f61bb48f8a963c9480e53c168 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:37.126346 22624 raft_consensus.cc:515] T 0e1085d23e8347fbbd5bce7542f4b1f4 P e61c3a8f61bb48f8a963c9480e53c168 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:05:37.128340 19553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edd7d470b5014c9489be7f41f64355c9" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:05:37.128677 22624 leader_election.cc:290] T 0e1085d23e8347fbbd5bce7542f4b1f4 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:05:37.129953 19553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef32ce6fdd0e40d382c79974f30295c6" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:05:37.130398 19523 leader_election.cc:304] T 2725d2c4cb054f18b0fc8f735c15f6c2 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e61c3a8f61bb48f8a963c9480e53c168; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:05:37.130609 19553 raft_consensus.cc:2368] T ef32ce6fdd0e40d382c79974f30295c6 P e61c3a8f61bb48f8a963c9480e53c168 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0473d2b2d01f4459b1e90fd12cc7840e for earlier term 8. Current term is 9.
I20260709 13:05:37.132669 19523 leader_election.cc:304] T 4af19371ea874c09a0a2147040835cbb P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e61c3a8f61bb48f8a963c9480e53c168; no voters: 127766fc592545a4997f7790f50f6076, e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:05:37.132803 19552 raft_consensus.cc:1240] T df751f992649444090e27965eb1af85d P e61c3a8f61bb48f8a963c9480e53c168 [term 9 FOLLOWER]: Rejecting Update request from peer 0473d2b2d01f4459b1e90fd12cc7840e for earlier term 8. Current term is 9. Ops: [8.5-8.5]
I20260709 13:05:37.134025 22612 raft_consensus.cc:2749] T 0e1085d23e8347fbbd5bce7542f4b1f4 P 0473d2b2d01f4459b1e90fd12cc7840e [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:05:37.134898 19555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b08304a0a02b42d7840c4e8ee9a6bd1a" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:05:37.135673 19555 raft_consensus.cc:2393] T b08304a0a02b42d7840c4e8ee9a6bd1a P e61c3a8f61bb48f8a963c9480e53c168 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0473d2b2d01f4459b1e90fd12cc7840e in current term 9: Already voted for candidate e61c3a8f61bb48f8a963c9480e53c168 in this term.
I20260709 13:05:37.112373 22655 leader_election.cc:290] T 40e1e16737a842ee936002830f36882e P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:05:37.136201 19551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1efebf73c86e432baa55533136b6e12c" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:05:37.136859 22634 raft_consensus.cc:2749] T 65d8cb8d6ec64f459d5a47cefab10acf P e61c3a8f61bb48f8a963c9480e53c168 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:05:37.136978 19551 raft_consensus.cc:3060] T 1efebf73c86e432baa55533136b6e12c P e61c3a8f61bb48f8a963c9480e53c168 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:05:37.137638 22634 raft_consensus.cc:2749] T 2725d2c4cb054f18b0fc8f735c15f6c2 P e61c3a8f61bb48f8a963c9480e53c168 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:05:37.082020 22534 raft_consensus.cc:493] T 5ec1c4ce15e04c7e8c283a62179f2a64 P e5256d91808b47c195bc9b4dbd7f2b87 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:37.107923 22399 consensus_queue.cc:1048] T ece3db938bc649d4a40a51522ed5259c P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Connected to new peer: Peer: permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.031s
I20260709 13:05:37.138888 22534 raft_consensus.cc:3060] T 5ec1c4ce15e04c7e8c283a62179f2a64 P e5256d91808b47c195bc9b4dbd7f2b87 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:05:37.140103 19558 raft_consensus.cc:2468] T 4509b76741dc428e9201c70c1658da13 P e61c3a8f61bb48f8a963c9480e53c168 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 4.
I20260709 13:05:37.143445 19552 raft_consensus.cc:1275] T 46c5bfeecc314717bffe987e6844b6d0 P e61c3a8f61bb48f8a963c9480e53c168 [term 13 FOLLOWER]: Refusing update from remote peer 0473d2b2d01f4459b1e90fd12cc7840e: Log matching property violated. Preceding OpId in replica: term: 12 index: 5. Preceding OpId from leader: term: 13 index: 5. (term mismatch)
I20260709 13:05:37.143549 19483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dc5b3532fe54f74876d02beffa2c230" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:05:37.143896 19552 pending_rounds.cc:85] T 46c5bfeecc314717bffe987e6844b6d0 P e61c3a8f61bb48f8a963c9480e53c168: Aborting all ops after (but not including) 4
I20260709 13:05:37.144205 19552 pending_rounds.cc:107] T 46c5bfeecc314717bffe987e6844b6d0 P e61c3a8f61bb48f8a963c9480e53c168: Aborting uncommitted NO_OP operation due to leader change: 12.5
I20260709 13:05:37.144433 19552 raft_consensus.cc:2889] T 46c5bfeecc314717bffe987e6844b6d0 P e61c3a8f61bb48f8a963c9480e53c168 [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:05:37.145732 19483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9f0d59553ad444883fcf5b5909f9798" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:05:37.146579 19483 raft_consensus.cc:2410] T b9f0d59553ad444883fcf5b5909f9798 P 0473d2b2d01f4459b1e90fd12cc7840e [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e5256d91808b47c195bc9b4dbd7f2b87 for term 9 because replica has last-logged OpId of term: 8 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 5.
I20260709 13:05:37.147046 22503 leader_election.cc:290] T 0cdf56e38bbc453d9438d359e5a69955 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 11 election: Requested vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:05:37.147567 22655 raft_consensus.cc:493] T 7be9efa6559648dbb5a0f7684c4542d1 P 0473d2b2d01f4459b1e90fd12cc7840e [term 7 FOLLOWER]: Starting pre-election (detected failure of leader e61c3a8f61bb48f8a963c9480e53c168)
I20260709 13:05:37.148138 22655 raft_consensus.cc:515] T 7be9efa6559648dbb5a0f7684c4542d1 P 0473d2b2d01f4459b1e90fd12cc7840e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } attrs { replace: true } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: NON_VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: true } }
I20260709 13:05:37.151050 19483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "775c229504194560ba9589bc2199b089" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:05:37.151688 19483 raft_consensus.cc:2468] T 775c229504194560ba9589bc2199b089 P 0473d2b2d01f4459b1e90fd12cc7840e [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 6.
I20260709 13:05:37.152804 22612 raft_consensus.cc:493] T 21e14947d70440f19044d8f75c31e1f9 P 0473d2b2d01f4459b1e90fd12cc7840e [term 7 FOLLOWER]: Starting pre-election (detected failure of leader e5256d91808b47c195bc9b4dbd7f2b87)
I20260709 13:05:37.153450 22612 raft_consensus.cc:515] T 21e14947d70440f19044d8f75c31e1f9 P 0473d2b2d01f4459b1e90fd12cc7840e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:37.155517 22612 leader_election.cc:290] T 21e14947d70440f19044d8f75c31e1f9 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:05:37.156095 22612 raft_consensus.cc:493] T 76cb037fc9064d13b59a8969d897ce8c P 0473d2b2d01f4459b1e90fd12cc7840e [term 7 FOLLOWER]: Starting pre-election (detected failure of leader e5256d91808b47c195bc9b4dbd7f2b87)
I20260709 13:05:37.156183 19523 leader_election.cc:304] T df751f992649444090e27965eb1af85d P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e61c3a8f61bb48f8a963c9480e53c168; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:05:37.080441 19305 catalog_manager.cc:5697] T 62c6c134d3d24a1ab144dd9ee6bc3f64 P 127766fc592545a4997f7790f50f6076 reported cstate change: term changed from 7 to 8, leader changed from 127766fc592545a4997f7790f50f6076 (127.17.223.4) to 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2). New cstate: current_term: 8 leader_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } } }
I20260709 13:05:37.156948 22624 raft_consensus.cc:2749] T 4af19371ea874c09a0a2147040835cbb P e61c3a8f61bb48f8a963c9480e53c168 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:05:37.157612 22624 raft_consensus.cc:2749] T df751f992649444090e27965eb1af85d P e61c3a8f61bb48f8a963c9480e53c168 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:05:37.158738 19523 leader_election.cc:304] T ece3db938bc649d4a40a51522ed5259c P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e61c3a8f61bb48f8a963c9480e53c168; no voters: 127766fc592545a4997f7790f50f6076, e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:05:37.150408 22655 leader_election.cc:290] T 7be9efa6559648dbb5a0f7684c4542d1 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
W20260709 13:05:37.164093 20077 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:37.167760 22612 raft_consensus.cc:515] T 76cb037fc9064d13b59a8969d897ce8c P 0473d2b2d01f4459b1e90fd12cc7840e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:37.159744 22527 consensus_queue.cc:260] T df751f992649444090e27965eb1af85d P 0473d2b2d01f4459b1e90fd12cc7840e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:37.171064 19483 raft_consensus.cc:1240] T 9962423cb4e54fcfa5de01daf68a86e7 P 0473d2b2d01f4459b1e90fd12cc7840e [term 11 FOLLOWER]: Rejecting Update request from peer e5256d91808b47c195bc9b4dbd7f2b87 for earlier term 10. Current term is 11. Ops: []
I20260709 13:05:37.171707 22527 raft_consensus.cc:3060] T df751f992649444090e27965eb1af85d P 0473d2b2d01f4459b1e90fd12cc7840e [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:05:37.173259 19481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "217b5fae677b4971b3bbd2f357a1f7ff" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:05:37.174116 19483 raft_consensus.cc:1240] T f1b10566f45d4a7d9029858330e02d5b P 0473d2b2d01f4459b1e90fd12cc7840e [term 9 FOLLOWER]: Rejecting Update request from peer e5256d91808b47c195bc9b4dbd7f2b87 for earlier term 8. Current term is 9. Ops: []
W20260709 13:05:37.175704 19449 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.4:43121, user_credentials={real_user=slave}} blocked reactor thread for 279429us
I20260709 13:05:37.176497 19478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e1f505cb0f1427bbd698ac889d80821" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:05:37.177357 19478 raft_consensus.cc:2410] T 3e1f505cb0f1427bbd698ac889d80821 P 0473d2b2d01f4459b1e90fd12cc7840e [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate e5256d91808b47c195bc9b4dbd7f2b87 for term 8 because replica has last-logged OpId of term: 7 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 13:05:37.157863 19305 catalog_manager.cc:5697] T 775c229504194560ba9589bc2199b089 P 127766fc592545a4997f7790f50f6076 reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "127766fc592545a4997f7790f50f6076" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:05:37.180204 19305 catalog_manager.cc:5697] T 14935b3ddf914369822e4a0547aaa355 P 127766fc592545a4997f7790f50f6076 reported cstate change: term changed from 4 to 6, leader changed from e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1) to 127766fc592545a4997f7790f50f6076 (127.17.223.4). New cstate: current_term: 6 leader_uuid: "127766fc592545a4997f7790f50f6076" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:05:37.182008 19305 catalog_manager.cc:5697] T ece3db938bc649d4a40a51522ed5259c P 127766fc592545a4997f7790f50f6076 reported cstate change: term changed from 5 to 7. New cstate: current_term: 7 leader_uuid: "127766fc592545a4997f7790f50f6076" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:05:37.177361 19449 leader_election.cc:304] T 9962423cb4e54fcfa5de01daf68a86e7 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e; no voters: 127766fc592545a4997f7790f50f6076, e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:05:37.183547 19478 raft_consensus.cc:1240] T 0cdf56e38bbc453d9438d359e5a69955 P 0473d2b2d01f4459b1e90fd12cc7840e [term 10 FOLLOWER]: Rejecting Update request from peer e5256d91808b47c195bc9b4dbd7f2b87 for earlier term 9. Current term is 10. Ops: [9.6-9.6]
W20260709 13:05:37.184470 19377 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:37.184960 19557 raft_consensus.cc:2468] T fa8650e71aa14778b3d73721fc50d9fc P e61c3a8f61bb48f8a963c9480e53c168 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 9.
I20260709 13:05:37.185243 19481 raft_consensus.cc:1275] T 2b74109013a140ada21feeef92d6f563 P 0473d2b2d01f4459b1e90fd12cc7840e [term 5 FOLLOWER]: Refusing update from remote peer e5256d91808b47c195bc9b4dbd7f2b87: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 4. (term mismatch)
W20260709 13:05:37.249141 19449 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.4:43121, user_credentials={real_user=slave}} blocked reactor thread for 71843.3us
I20260709 13:05:37.249503 19481 pending_rounds.cc:85] T 2b74109013a140ada21feeef92d6f563 P 0473d2b2d01f4459b1e90fd12cc7840e: Aborting all ops after (but not including) 3
I20260709 13:05:37.249752 19481 pending_rounds.cc:107] T 2b74109013a140ada21feeef92d6f563 P 0473d2b2d01f4459b1e90fd12cc7840e: Aborting uncommitted NO_OP operation due to leader change: 4.4
I20260709 13:05:37.249660 19478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a08760e15aac4630a629431f56024dc8" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:05:37.250191 19481 raft_consensus.cc:2889] T 2b74109013a140ada21feeef92d6f563 P 0473d2b2d01f4459b1e90fd12cc7840e [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:05:37.185403 19483 raft_consensus.cc:3060] T 28af091831594f9d8e96482078cc7625 P 0473d2b2d01f4459b1e90fd12cc7840e [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:05:37.253952 19408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14efcc79969f41babe5529c22d59156d" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
I20260709 13:05:37.254539 19408 raft_consensus.cc:3060] T 14efcc79969f41babe5529c22d59156d P e5256d91808b47c195bc9b4dbd7f2b87 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:05:37.255354 22526 raft_consensus.cc:2749] T 9962423cb4e54fcfa5de01daf68a86e7 P 0473d2b2d01f4459b1e90fd12cc7840e [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:05:37.255616 19404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f575b143b844aa096b50997dad3516a" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:05:37.186446 19555 raft_consensus.cc:3055] T edd7d470b5014c9489be7f41f64355c9 P e61c3a8f61bb48f8a963c9480e53c168 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:05:37.256342 19404 raft_consensus.cc:2468] T 7f575b143b844aa096b50997dad3516a P e5256d91808b47c195bc9b4dbd7f2b87 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 3.
I20260709 13:05:37.256511 19555 raft_consensus.cc:740] T edd7d470b5014c9489be7f41f64355c9 P e61c3a8f61bb48f8a963c9480e53c168 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: e61c3a8f61bb48f8a963c9480e53c168, State: Running, Role: LEADER
I20260709 13:05:37.257483 19404 raft_consensus.cc:1240] T 1a61655d99124a29b486ba4a5b37faea P e5256d91808b47c195bc9b4dbd7f2b87 [term 6 FOLLOWER]: Rejecting Update request from peer 0473d2b2d01f4459b1e90fd12cc7840e for earlier term 5. Current term is 6. Ops: []
I20260709 13:05:37.257376 19555 consensus_queue.cc:260] T edd7d470b5014c9489be7f41f64355c9 P e61c3a8f61bb48f8a963c9480e53c168 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:37.187377 19553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1b10566f45d4a7d9029858330e02d5b" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:05:37.258335 19403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ec1c4ce15e04c7e8c283a62179f2a64" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
I20260709 13:05:37.188093 19558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e1f505cb0f1427bbd698ac889d80821" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:05:37.188395 19523 leader_election.cc:304] T 76cb037fc9064d13b59a8969d897ce8c P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e61c3a8f61bb48f8a963c9480e53c168; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:05:37.259625 19405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14935b3ddf914369822e4a0547aaa355" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
I20260709 13:05:37.262197 19409 raft_consensus.cc:1217] T ff9b0eddd810459b82d91c60777c10eb P e5256d91808b47c195bc9b4dbd7f2b87 [term 6 LEADER]: Deduplicated request from leader. Original: 4.6->[5.7-5.7]   Dedup: 5.7->[]
I20260709 13:05:37.259653 19553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cdf56e38bbc453d9438d359e5a69955" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:05:37.250453 19478 raft_consensus.cc:3060] T a08760e15aac4630a629431f56024dc8 P 0473d2b2d01f4459b1e90fd12cc7840e [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:05:37.260438 19523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.1:40321, user_credentials={real_user=slave}} blocked reactor thread for 72168.6us
I20260709 13:05:37.264361 19523 leader_election.cc:304] T b08304a0a02b42d7840c4e8ee9a6bd1a P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e61c3a8f61bb48f8a963c9480e53c168; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:05:37.265080 22540 raft_consensus.cc:2749] T b08304a0a02b42d7840c4e8ee9a6bd1a P e61c3a8f61bb48f8a963c9480e53c168 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:05:37.265585 19523 leader_election.cc:304] T fa731b585f684a7fb2d106c50f143b83 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e61c3a8f61bb48f8a963c9480e53c168; no voters: 127766fc592545a4997f7790f50f6076, e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:05:37.190797 22551 raft_consensus.cc:493] T 14935b3ddf914369822e4a0547aaa355 P e61c3a8f61bb48f8a963c9480e53c168 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:37.191938 19485 raft_consensus.cc:1275] T bc225c93219c45538b53a1bd3d387e4d P 0473d2b2d01f4459b1e90fd12cc7840e [term 10 FOLLOWER]: Refusing update from remote peer e5256d91808b47c195bc9b4dbd7f2b87: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
W20260709 13:05:37.261175 19449 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:37.192354 19554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa8650e71aa14778b3d73721fc50d9fc" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:05:37.193336 19480 raft_consensus.cc:1275] T 40e1e16737a842ee936002830f36882e P 0473d2b2d01f4459b1e90fd12cc7840e [term 9 FOLLOWER]: Refusing update from remote peer e5256d91808b47c195bc9b4dbd7f2b87: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:05:37.193796 22369 raft_consensus.cc:3055] T 1a61655d99124a29b486ba4a5b37faea P 0473d2b2d01f4459b1e90fd12cc7840e [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:05:37.194223 19484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86a6797bdfe94fa496c050ceae4bd0d9" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 8 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:05:37.263327 19553 raft_consensus.cc:3060] T 0cdf56e38bbc453d9438d359e5a69955 P e61c3a8f61bb48f8a963c9480e53c168 [term 9 FOLLOWER]: Advancing to term 11
I20260709 13:05:37.196499 22385 consensus_queue.cc:1048] T ece3db938bc649d4a40a51522ed5259c P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:05:37.271252 19485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cdf56e38bbc453d9438d359e5a69955" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:05:37.270812 22551 raft_consensus.cc:515] T 14935b3ddf914369822e4a0547aaa355 P e61c3a8f61bb48f8a963c9480e53c168 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } attrs { replace: true } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:05:37.271827 19485 raft_consensus.cc:2468] T 0cdf56e38bbc453d9438d359e5a69955 P 0473d2b2d01f4459b1e90fd12cc7840e [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 10.
I20260709 13:05:37.272792 19485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14efcc79969f41babe5529c22d59156d" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:05:37.273387 19485 raft_consensus.cc:2368] T 14efcc79969f41babe5529c22d59156d P 0473d2b2d01f4459b1e90fd12cc7840e [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate e5256d91808b47c195bc9b4dbd7f2b87 for earlier term 8. Current term is 9.
I20260709 13:05:37.273893 22551 leader_election.cc:290] T 14935b3ddf914369822e4a0547aaa355 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:05:37.209491 19477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a08760e15aac4630a629431f56024dc8" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:05:37.210577 19560 raft_consensus.cc:1240] T 1dc5b3532fe54f74876d02beffa2c230 P e61c3a8f61bb48f8a963c9480e53c168 [term 7 FOLLOWER]: Rejecting Update request from peer 0473d2b2d01f4459b1e90fd12cc7840e for earlier term 6. Current term is 7. Ops: []
I20260709 13:05:37.275166 19523 leader_election.cc:304] T 4509b76741dc428e9201c70c1658da13 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168; no voters: 0473d2b2d01f4459b1e90fd12cc7840e
I20260709 13:05:37.275749 19477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dc5b3532fe54f74876d02beffa2c230" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:05:37.276010 22551 raft_consensus.cc:2764] T 4509b76741dc428e9201c70c1658da13 P e61c3a8f61bb48f8a963c9480e53c168 [term 4 FOLLOWER]: Leader pre-election decision vote started in defunct term 3: won
I20260709 13:05:37.276360 19523 leader_election.cc:304] T ef32ce6fdd0e40d382c79974f30295c6 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168; no voters: 0473d2b2d01f4459b1e90fd12cc7840e
I20260709 13:05:37.276816 19477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e1f505cb0f1427bbd698ac889d80821" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:05:37.277621 19523 leader_election.cc:400] T 3e1f505cb0f1427bbd698ac889d80821 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 7 election: Vote denied by peer e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321) with higher term. Message: Invalid argument: T 3e1f505cb0f1427bbd698ac889d80821 P e5256d91808b47c195bc9b4dbd7f2b87 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate e61c3a8f61bb48f8a963c9480e53c168 for earlier term 7. Current term is 8.
I20260709 13:05:37.277980 19523 leader_election.cc:403] T 3e1f505cb0f1427bbd698ac889d80821 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 7 election: Cancelling election due to peer responding with higher term
I20260709 13:05:37.278122 22551 raft_consensus.cc:2764] T ef32ce6fdd0e40d382c79974f30295c6 P e61c3a8f61bb48f8a963c9480e53c168 [term 9 FOLLOWER]: Leader election decision vote started in defunct term 8: won
I20260709 13:05:37.268839 19484 raft_consensus.cc:2468] T 86a6797bdfe94fa496c050ceae4bd0d9 P 0473d2b2d01f4459b1e90fd12cc7840e [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 7.
I20260709 13:05:37.278987 22551 raft_consensus.cc:2749] T 3e1f505cb0f1427bbd698ac889d80821 P e61c3a8f61bb48f8a963c9480e53c168 [term 8 FOLLOWER]: Leader election lost for term 7. Reason: Vote denied by peer e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321) with higher term. Message: Invalid argument: T 3e1f505cb0f1427bbd698ac889d80821 P e5256d91808b47c195bc9b4dbd7f2b87 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate e61c3a8f61bb48f8a963c9480e53c168 for earlier term 7. Current term is 8.
I20260709 13:05:37.277613 19477 raft_consensus.cc:2410] T 3e1f505cb0f1427bbd698ac889d80821 P 0473d2b2d01f4459b1e90fd12cc7840e [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate e5256d91808b47c195bc9b4dbd7f2b87 for term 8 because replica has last-logged OpId of term: 7 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 13:05:37.279531 19484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff9b0eddd810459b82d91c60777c10eb" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:05:37.280421 19484 raft_consensus.cc:2410] T ff9b0eddd810459b82d91c60777c10eb P 0473d2b2d01f4459b1e90fd12cc7840e [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e5256d91808b47c195bc9b4dbd7f2b87 for term 6 because replica has last-logged OpId of term: 5 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260709 13:05:37.281184 19554 raft_consensus.cc:1240] T 4af19371ea874c09a0a2147040835cbb P e61c3a8f61bb48f8a963c9480e53c168 [term 5 FOLLOWER]: Rejecting Update request from peer 127766fc592545a4997f7790f50f6076 for earlier term 4. Current term is 5. Ops: []
I20260709 13:05:37.230568 19486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dc5b3532fe54f74876d02beffa2c230" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
W20260709 13:05:37.212560 20077 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:37.282281 19554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab43d85f64114d4ebf618930e43d9ed0" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:05:37.215597 19482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14efcc79969f41babe5529c22d59156d" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:05:37.277988 19483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef32ce6fdd0e40d382c79974f30295c6" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:05:37.187302 22620 raft_consensus.cc:2749] T ece3db938bc649d4a40a51522ed5259c P e61c3a8f61bb48f8a963c9480e53c168 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:05:37.262831 19409 raft_consensus.cc:1240] T ff9b0eddd810459b82d91c60777c10eb P e5256d91808b47c195bc9b4dbd7f2b87 [term 6 LEADER]: Rejecting Update request from peer 0473d2b2d01f4459b1e90fd12cc7840e for earlier term 5. Current term is 6. Ops: [5.7-5.7]
I20260709 13:05:37.188753 22612 leader_election.cc:290] T 76cb037fc9064d13b59a8969d897ce8c P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:05:37.266386 22540 raft_consensus.cc:2749] T fa731b585f684a7fb2d106c50f143b83 P e61c3a8f61bb48f8a963c9480e53c168 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:05:37.261179 19481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a08760e15aac4630a629431f56024dc8" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:05:37.261286 19410 raft_consensus.cc:1275] T b08304a0a02b42d7840c4e8ee9a6bd1a P e5256d91808b47c195bc9b4dbd7f2b87 [term 9 FOLLOWER]: Refusing update from remote peer 0473d2b2d01f4459b1e90fd12cc7840e: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:05:37.258621 19555 raft_consensus.cc:3060] T edd7d470b5014c9489be7f41f64355c9 P e61c3a8f61bb48f8a963c9480e53c168 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:05:37.261677 19402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab43d85f64114d4ebf618930e43d9ed0" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:05:37.230906 19559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0afb57ae58a24a01850491d69f0213dd" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:05:37.291249 19559 raft_consensus.cc:3060] T 0afb57ae58a24a01850491d69f0213dd P e61c3a8f61bb48f8a963c9480e53c168 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:05:37.268163 19480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a61655d99124a29b486ba4a5b37faea" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: true dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:05:37.260679 22624 raft_consensus.cc:2749] T 76cb037fc9064d13b59a8969d897ce8c P e61c3a8f61bb48f8a963c9480e53c168 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:05:37.274071 19485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dc5b3532fe54f74876d02beffa2c230" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
W20260709 13:05:37.261685 19377 leader_election.cc:336] T 1dc5b3532fe54f74876d02beffa2c230 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257): Timed out: RequestConsensusVote RPC to 127.17.223.2:46257 timed out after 1.724s (SENT)
I20260709 13:05:37.197259 19375 leader_election.cc:304] T 1a61655d99124a29b486ba4a5b37faea P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:05:37.260478 19558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14935b3ddf914369822e4a0547aaa355" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:05:37.295022 19553 raft_consensus.cc:2468] T 0cdf56e38bbc453d9438d359e5a69955 P e61c3a8f61bb48f8a963c9480e53c168 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 11.
I20260709 13:05:37.295177 19483 raft_consensus.cc:2468] T ef32ce6fdd0e40d382c79974f30295c6 P 0473d2b2d01f4459b1e90fd12cc7840e [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 7.
I20260709 13:05:37.268548 22369 raft_consensus.cc:740] T 1a61655d99124a29b486ba4a5b37faea P 0473d2b2d01f4459b1e90fd12cc7840e [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 0473d2b2d01f4459b1e90fd12cc7840e, State: Running, Role: LEADER
I20260709 13:05:37.296372 19481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cdf56e38bbc453d9438d359e5a69955" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:05:37.296967 19481 raft_consensus.cc:3060] T 0cdf56e38bbc453d9438d359e5a69955 P 0473d2b2d01f4459b1e90fd12cc7840e [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:05:37.296842 22369 consensus_queue.cc:260] T 1a61655d99124a29b486ba4a5b37faea P 0473d2b2d01f4459b1e90fd12cc7840e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:37.297889 22369 raft_consensus.cc:3060] T 1a61655d99124a29b486ba4a5b37faea P 0473d2b2d01f4459b1e90fd12cc7840e [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:05:37.300101 19375 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.3:36891, user_credentials={real_user=slave}} blocked reactor thread for 102915us
W20260709 13:05:37.300321 19524 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:37.290017 19402 raft_consensus.cc:2468] T ab43d85f64114d4ebf618930e43d9ed0 P e5256d91808b47c195bc9b4dbd7f2b87 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 6.
I20260709 13:05:37.280279 19477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef32ce6fdd0e40d382c79974f30295c6" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:05:37.281184 19484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa8650e71aa14778b3d73721fc50d9fc" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:05:37.282902 19554 raft_consensus.cc:2468] T ab43d85f64114d4ebf618930e43d9ed0 P e61c3a8f61bb48f8a963c9480e53c168 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 127766fc592545a4997f7790f50f6076 in term 6.
I20260709 13:05:37.212690 19479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab43d85f64114d4ebf618930e43d9ed0" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:05:37.282303 19486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff9b0eddd810459b82d91c60777c10eb" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
W20260709 13:05:37.226528 20078 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.2:46257, user_credentials={real_user=slave}} blocked reactor thread for 143938us
I20260709 13:05:37.303982 19486 raft_consensus.cc:2410] T ff9b0eddd810459b82d91c60777c10eb P 0473d2b2d01f4459b1e90fd12cc7840e [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e5256d91808b47c195bc9b4dbd7f2b87 for term 6 because replica has last-logged OpId of term: 5 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260709 13:05:37.284548 19405 raft_consensus.cc:1240] T df751f992649444090e27965eb1af85d P e5256d91808b47c195bc9b4dbd7f2b87 [term 9 LEADER]: Rejecting Update request from peer 0473d2b2d01f4459b1e90fd12cc7840e for earlier term 8. Current term is 9. Ops: []
I20260709 13:05:37.211323 19552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b08304a0a02b42d7840c4e8ee9a6bd1a" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:05:37.285692 19407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40e1e16737a842ee936002830f36882e" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:05:37.305337 19407 raft_consensus.cc:2410] T 40e1e16737a842ee936002830f36882e P e5256d91808b47c195bc9b4dbd7f2b87 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0473d2b2d01f4459b1e90fd12cc7840e for term 10 because replica has last-logged OpId of term: 9 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 5.
I20260709 13:05:37.285887 19408 raft_consensus.cc:2468] T 14efcc79969f41babe5529c22d59156d P e5256d91808b47c195bc9b4dbd7f2b87 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 9.
I20260709 13:05:37.221896 19551 raft_consensus.cc:2468] T 1efebf73c86e432baa55533136b6e12c P e61c3a8f61bb48f8a963c9480e53c168 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 6.
I20260709 13:05:37.306147 19558 raft_consensus.cc:1240] T 1efebf73c86e432baa55533136b6e12c P e61c3a8f61bb48f8a963c9480e53c168 [term 6 FOLLOWER]: Rejecting Update request from peer 127766fc592545a4997f7790f50f6076 for earlier term 5. Current term is 6. Ops: []
I20260709 13:05:37.303690 19479 raft_consensus.cc:2468] T ab43d85f64114d4ebf618930e43d9ed0 P 0473d2b2d01f4459b1e90fd12cc7840e [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 6.
I20260709 13:05:37.290722 19305 catalog_manager.cc:5697] T 2a16f7501e2444fb86d4e2778e734e02 P 127766fc592545a4997f7790f50f6076 reported cstate change: term changed from 5 to 8, leader changed from 127766fc592545a4997f7790f50f6076 (127.17.223.4) to e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1). New cstate: current_term: 8 leader_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } } }
W20260709 13:05:37.292275 20077 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:37.294616 19482 raft_consensus.cc:2368] T 14efcc79969f41babe5529c22d59156d P 0473d2b2d01f4459b1e90fd12cc7840e [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate e5256d91808b47c195bc9b4dbd7f2b87 for earlier term 8. Current term is 9.
I20260709 13:05:37.304790 19552 raft_consensus.cc:2393] T b08304a0a02b42d7840c4e8ee9a6bd1a P e61c3a8f61bb48f8a963c9480e53c168 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 0473d2b2d01f4459b1e90fd12cc7840e in current term 9: Already voted for candidate e61c3a8f61bb48f8a963c9480e53c168 in this term.
I20260709 13:05:37.305264 20105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ec1c4ce15e04c7e8c283a62179f2a64" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076"
I20260709 13:05:37.307152 19403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc225c93219c45538b53a1bd3d387e4d" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 11 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:05:37.307629 20109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0afb57ae58a24a01850491d69f0213dd" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076"
I20260709 13:05:37.303079 19477 raft_consensus.cc:2468] T ef32ce6fdd0e40d382c79974f30295c6 P 0473d2b2d01f4459b1e90fd12cc7840e [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 7.
W20260709 13:05:37.309356 19377 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.2:46257, user_credentials={real_user=slave}} blocked reactor thread for 47707.5us
I20260709 13:05:37.309773 20103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14935b3ddf914369822e4a0547aaa355" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076"
W20260709 13:05:37.310628 19525 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:37.316562 20109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab43d85f64114d4ebf618930e43d9ed0" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:05:37.317205 20109 raft_consensus.cc:2468] T ab43d85f64114d4ebf618930e43d9ed0 P 127766fc592545a4997f7790f50f6076 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 6.
W20260709 13:05:37.318555 19377 leader_election.cc:336] T 3e1f505cb0f1427bbd698ac889d80821 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 8 election: RPC error from VoteRequest() call to peer 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257): Timed out: RequestConsensusVote RPC to 127.17.223.2:46257 timed out after 1.768s (SENT)
I20260709 13:05:37.319353 19407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "179fd671030940b4b4a4e24bcc4aba0a" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:05:37.319986 19407 raft_consensus.cc:2468] T 179fd671030940b4b4a4e24bcc4aba0a P e5256d91808b47c195bc9b4dbd7f2b87 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 7.
I20260709 13:05:37.311064 21957 raft_consensus.cc:2804] T 1a61655d99124a29b486ba4a5b37faea P e5256d91808b47c195bc9b4dbd7f2b87 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:05:37.325135 19482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a61655d99124a29b486ba4a5b37faea" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:05:37.331157 20108 raft_consensus.cc:1217] T ff9b0eddd810459b82d91c60777c10eb P 127766fc592545a4997f7790f50f6076 [term 6 FOLLOWER]: Deduplicated request from leader. Original: 4.6->[5.7-5.7]   Dedup: 5.7->[]
I20260709 13:05:37.331749 20108 raft_consensus.cc:1240] T ff9b0eddd810459b82d91c60777c10eb P 127766fc592545a4997f7790f50f6076 [term 6 FOLLOWER]: Rejecting Update request from peer 0473d2b2d01f4459b1e90fd12cc7840e for earlier term 5. Current term is 6. Ops: [5.7-5.7]
I20260709 13:05:37.332026 19482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e381f1d6b8184797ad142de49be225a8" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:05:37.332232 20110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14efcc79969f41babe5529c22d59156d" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076"
I20260709 13:05:37.332799 20110 raft_consensus.cc:3060] T 14efcc79969f41babe5529c22d59156d P 127766fc592545a4997f7790f50f6076 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:05:37.333132 19482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "775c229504194560ba9589bc2199b089" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:05:37.325659 19483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96efeaaf1057492490e9a621f37e1a2d" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:05:37.310580 19305 catalog_manager.cc:5697] T 70797e5783b5454ab0d0eea663e791e3 P 127766fc592545a4997f7790f50f6076 reported cstate change: term changed from 6 to 8. New cstate: current_term: 8 leader_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } } }
I20260709 13:05:37.341913 19558 raft_consensus.cc:1240] T 6c5eebf646ad445a9d1b1adc319d7b16 P e61c3a8f61bb48f8a963c9480e53c168 [term 5 FOLLOWER]: Rejecting Update request from peer 127766fc592545a4997f7790f50f6076 for earlier term 4. Current term is 5. Ops: []
I20260709 13:05:37.335000 19486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e5873a19244c5ebbcd38e126796ee7" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 10 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:05:37.343314 19558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48824d5acfbc485ebf8c2d944e7202de" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:05:37.344141 19558 raft_consensus.cc:2410] T 48824d5acfbc485ebf8c2d944e7202de P e61c3a8f61bb48f8a963c9480e53c168 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 127766fc592545a4997f7790f50f6076 for term 8 because replica has last-logged OpId of term: 7 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260709 13:05:37.345757 19557 raft_consensus.cc:1240] T 833a2f0775ed407a94b8924ce50adb63 P e61c3a8f61bb48f8a963c9480e53c168 [term 7 FOLLOWER]: Rejecting Update request from peer 127766fc592545a4997f7790f50f6076 for earlier term 6. Current term is 7. Ops: []
I20260709 13:05:37.335244 19483 raft_consensus.cc:2468] T 96efeaaf1057492490e9a621f37e1a2d P 0473d2b2d01f4459b1e90fd12cc7840e [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 127766fc592545a4997f7790f50f6076 in term 7.
I20260709 13:05:37.346915 19404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7be9efa6559648dbb5a0f7684c4542d1" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
W20260709 13:05:37.354096 19452 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:37.354342 19404 raft_consensus.cc:2393] T 7be9efa6559648dbb5a0f7684c4542d1 P e5256d91808b47c195bc9b4dbd7f2b87 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0473d2b2d01f4459b1e90fd12cc7840e in current term 8: Already voted for candidate e5256d91808b47c195bc9b4dbd7f2b87 in this term.
I20260709 13:05:37.349982 19402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76cb037fc9064d13b59a8969d897ce8c" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:05:37.349648 19305 catalog_manager.cc:5697] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P 127766fc592545a4997f7790f50f6076 reported cstate change: term changed from 6 to 9, leader changed from 127766fc592545a4997f7790f50f6076 (127.17.223.4) to e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1). New cstate: current_term: 9 leader_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } } }
I20260709 13:05:37.337709 19479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a61655d99124a29b486ba4a5b37faea" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
W20260709 13:05:37.355235 20075 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:37.326740 19551 raft_consensus.cc:1240] T 2a16f7501e2444fb86d4e2778e734e02 P e61c3a8f61bb48f8a963c9480e53c168 [term 8 FOLLOWER]: Rejecting Update request from peer 127766fc592545a4997f7790f50f6076 for earlier term 7. Current term is 8. Ops: []
I20260709 13:05:37.355819 19485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e5873a19244c5ebbcd38e126796ee7" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 10 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:05:37.356379 19485 raft_consensus.cc:2468] T d1e5873a19244c5ebbcd38e126796ee7 P 0473d2b2d01f4459b1e90fd12cc7840e [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 9.
I20260709 13:05:37.352669 19484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab43d85f64114d4ebf618930e43d9ed0" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
W20260709 13:05:37.353428 19525 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:37.337538 19403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21e14947d70440f19044d8f75c31e1f9" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:05:37.357179 19484 raft_consensus.cc:2468] T ab43d85f64114d4ebf618930e43d9ed0 P 0473d2b2d01f4459b1e90fd12cc7840e [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 6.
I20260709 13:05:37.358789 19555 raft_consensus.cc:1275] T edd7d470b5014c9489be7f41f64355c9 P e61c3a8f61bb48f8a963c9480e53c168 [term 8 FOLLOWER]: Refusing update from remote peer 0473d2b2d01f4459b1e90fd12cc7840e: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 8 index: 4. (term mismatch)
I20260709 13:05:37.359122 19555 pending_rounds.cc:85] T edd7d470b5014c9489be7f41f64355c9 P e61c3a8f61bb48f8a963c9480e53c168: Aborting all ops after (but not including) 3
I20260709 13:05:37.359326 19555 pending_rounds.cc:107] T edd7d470b5014c9489be7f41f64355c9 P e61c3a8f61bb48f8a963c9480e53c168: Aborting uncommitted NO_OP operation due to leader change: 7.4
I20260709 13:05:37.359540 19555 raft_consensus.cc:2889] T edd7d470b5014c9489be7f41f64355c9 P e61c3a8f61bb48f8a963c9480e53c168 [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:05:37.362946 19477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9f0d59553ad444883fcf5b5909f9798" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:05:37.358023 19486 raft_consensus.cc:2468] T d1e5873a19244c5ebbcd38e126796ee7 P 0473d2b2d01f4459b1e90fd12cc7840e [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 9.
I20260709 13:05:37.360993 19305 catalog_manager.cc:5697] T 7be9efa6559648dbb5a0f7684c4542d1 P 127766fc592545a4997f7790f50f6076 reported cstate change: config changed from index -1 to 4, term changed from 5 to 7, leader changed from 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2) to e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3), NON_VOTER 127766fc592545a4997f7790f50f6076 (127.17.223.4) added. New cstate: current_term: 7 leader_uuid: "e61c3a8f61bb48f8a963c9480e53c168" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } attrs { replace: true } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: NON_VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: true } } }
I20260709 13:05:37.365856 19478 raft_consensus.cc:2468] T a08760e15aac4630a629431f56024dc8 P 0473d2b2d01f4459b1e90fd12cc7840e [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 9.
I20260709 13:05:37.365778 19485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22196caba61445d3bec98a0aab3c337d" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:05:37.367844 19477 raft_consensus.cc:2410] T b9f0d59553ad444883fcf5b5909f9798 P 0473d2b2d01f4459b1e90fd12cc7840e [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e5256d91808b47c195bc9b4dbd7f2b87 for term 9 because replica has last-logged OpId of term: 8 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 5.
I20260709 13:05:37.372721 19560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85c494af21f9457a85da47b9bc70c1fd" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:05:37.372993 19483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e1085d23e8347fbbd5bce7542f4b1f4" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:05:37.372367 20105 raft_consensus.cc:2468] T 5ec1c4ce15e04c7e8c283a62179f2a64 P 127766fc592545a4997f7790f50f6076 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 6.
I20260709 13:05:37.373020 19557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70797e5783b5454ab0d0eea663e791e3" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:05:37.373854 19483 raft_consensus.cc:2468] T 0e1085d23e8347fbbd5bce7542f4b1f4 P 0473d2b2d01f4459b1e90fd12cc7840e [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 5.
I20260709 13:05:37.373935 19551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96efeaaf1057492490e9a621f37e1a2d" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:05:37.376612 19558 raft_consensus.cc:1240] T fa731b585f684a7fb2d106c50f143b83 P e61c3a8f61bb48f8a963c9480e53c168 [term 7 FOLLOWER]: Rejecting Update request from peer 127766fc592545a4997f7790f50f6076 for earlier term 6. Current term is 7. Ops: []
I20260709 13:05:37.376848 19551 raft_consensus.cc:2468] T 96efeaaf1057492490e9a621f37e1a2d P e61c3a8f61bb48f8a963c9480e53c168 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 127766fc592545a4997f7790f50f6076 in term 7.
I20260709 13:05:37.377167 19478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7be9efa6559648dbb5a0f7684c4542d1" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:05:37.378640 19449 leader_election.cc:304] T 7f575b143b844aa096b50997dad3516a P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87; no voters: 
I20260709 13:05:37.378823 19554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed7fdbcb96d14d418db9ca90a792588a" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:05:37.379323 19484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "217b5fae677b4971b3bbd2f357a1f7ff" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:05:37.378050 19478 raft_consensus.cc:2468] T 7be9efa6559648dbb5a0f7684c4542d1 P 0473d2b2d01f4459b1e90fd12cc7840e [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 7.
I20260709 13:05:37.379668 19483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "217b5fae677b4971b3bbd2f357a1f7ff" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:05:37.384292 19479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86a6797bdfe94fa496c050ceae4bd0d9" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:05:37.384754 19479 raft_consensus.cc:3060] T 86a6797bdfe94fa496c050ceae4bd0d9 P 0473d2b2d01f4459b1e90fd12cc7840e [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:05:37.386910 19486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "775c229504194560ba9589bc2199b089" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:05:37.310882 22534 raft_consensus.cc:515] T 5ec1c4ce15e04c7e8c283a62179f2a64 P e5256d91808b47c195bc9b4dbd7f2b87 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:05:37.389824 19485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed7fdbcb96d14d418db9ca90a792588a" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:05:37.392844 19485 raft_consensus.cc:3060] T ed7fdbcb96d14d418db9ca90a792588a P 0473d2b2d01f4459b1e90fd12cc7840e [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:05:37.361990 21957 raft_consensus.cc:697] T 1a61655d99124a29b486ba4a5b37faea P e5256d91808b47c195bc9b4dbd7f2b87 [term 6 LEADER]: Becoming Leader. State: Replica: e5256d91808b47c195bc9b4dbd7f2b87, State: Running, Role: LEADER
I20260709 13:05:37.396956 19483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4509b76741dc428e9201c70c1658da13" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:05:37.400775 19477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df751f992649444090e27965eb1af85d" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:05:37.385213 19305 catalog_manager.cc:5697] T 85c494af21f9457a85da47b9bc70c1fd P 127766fc592545a4997f7790f50f6076 reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } } }
I20260709 13:05:37.401038 19551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65d8cb8d6ec64f459d5a47cefab10acf" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:05:37.403335 19305 catalog_manager.cc:5697] T 65d8cb8d6ec64f459d5a47cefab10acf P 127766fc592545a4997f7790f50f6076 reported cstate change: term changed from 1 to 4, leader changed from e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3) to e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1). New cstate: current_term: 4 leader_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } } }
I20260709 13:05:37.359982 22056 consensus_queue.cc:1048] T 775c229504194560ba9589bc2199b089 P 127766fc592545a4997f7790f50f6076 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.031s
I20260709 13:05:37.405825 19449 leader_election.cc:304] T 14efcc79969f41babe5529c22d59156d P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87; no voters: 
I20260709 13:05:37.406523 19484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "172b3dd13109415a955b71ac0e9d2234" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:05:37.407797 19478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc225c93219c45538b53a1bd3d387e4d" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:05:37.411876 19478 raft_consensus.cc:2376] T bc225c93219c45538b53a1bd3d387e4d P 0473d2b2d01f4459b1e90fd12cc7840e [term 10 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 10. Re-sending same reply.
I20260709 13:05:37.412667 19478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff75a1d4cb1f493db8f71ddc136ba9ab" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:05:37.413069 19478 raft_consensus.cc:2468] T ff75a1d4cb1f493db8f71ddc136ba9ab P 0473d2b2d01f4459b1e90fd12cc7840e [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 6.
I20260709 13:05:37.413151 20110 raft_consensus.cc:2468] T 14efcc79969f41babe5529c22d59156d P 127766fc592545a4997f7790f50f6076 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 9.
I20260709 13:05:37.413630 19478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef32ce6fdd0e40d382c79974f30295c6" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:05:37.414093 19478 raft_consensus.cc:3060] T ef32ce6fdd0e40d382c79974f30295c6 P 0473d2b2d01f4459b1e90fd12cc7840e [term 7 FOLLOWER]: Advancing to term 9
I20260709 13:05:37.414716 19481 raft_consensus.cc:2468] T 0cdf56e38bbc453d9438d359e5a69955 P 0473d2b2d01f4459b1e90fd12cc7840e [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 11.
I20260709 13:05:37.415508 19481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ec1c4ce15e04c7e8c283a62179f2a64" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:05:37.416031 19481 raft_consensus.cc:2468] T 5ec1c4ce15e04c7e8c283a62179f2a64 P 0473d2b2d01f4459b1e90fd12cc7840e [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 6.
I20260709 13:05:37.416921 19481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62c6c134d3d24a1ab144dd9ee6bc3f64" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:05:37.418120 19481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a08760e15aac4630a629431f56024dc8" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:05:37.418726 19481 raft_consensus.cc:2376] T a08760e15aac4630a629431f56024dc8 P 0473d2b2d01f4459b1e90fd12cc7840e [term 9 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 9. Re-sending same reply.
I20260709 13:05:37.421330 19478 raft_consensus.cc:2468] T ef32ce6fdd0e40d382c79974f30295c6 P 0473d2b2d01f4459b1e90fd12cc7840e [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 9.
I20260709 13:05:37.421614 19557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "179fd671030940b4b4a4e24bcc4aba0a" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:05:37.422297 19478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40e1e16737a842ee936002830f36882e" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:05:37.422838 19478 raft_consensus.cc:3060] T 40e1e16737a842ee936002830f36882e P 0473d2b2d01f4459b1e90fd12cc7840e [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:05:37.422955 19555 raft_consensus.cc:1240] T 1a61655d99124a29b486ba4a5b37faea P e61c3a8f61bb48f8a963c9480e53c168 [term 6 FOLLOWER]: Rejecting Update request from peer 0473d2b2d01f4459b1e90fd12cc7840e for earlier term 5. Current term is 6. Ops: []
I20260709 13:05:37.423213 19558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc225c93219c45538b53a1bd3d387e4d" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 11 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:05:37.424286 19554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40e1e16737a842ee936002830f36882e" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
W20260709 13:05:37.425014 20076 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:37.425125 19554 raft_consensus.cc:2393] T 40e1e16737a842ee936002830f36882e P e61c3a8f61bb48f8a963c9480e53c168 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0473d2b2d01f4459b1e90fd12cc7840e in current term 10: Already voted for candidate e61c3a8f61bb48f8a963c9480e53c168 in this term.
I20260709 13:05:37.425626 19553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f575b143b844aa096b50997dad3516a" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:05:37.426893 19551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab43d85f64114d4ebf618930e43d9ed0" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:05:37.427861 19551 raft_consensus.cc:2468] T ab43d85f64114d4ebf618930e43d9ed0 P e61c3a8f61bb48f8a963c9480e53c168 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 6.
I20260709 13:05:37.419449 19481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ec1c4ce15e04c7e8c283a62179f2a64" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:05:37.428750 19481 raft_consensus.cc:2468] T 5ec1c4ce15e04c7e8c283a62179f2a64 P 0473d2b2d01f4459b1e90fd12cc7840e [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 127766fc592545a4997f7790f50f6076 in term 6.
I20260709 13:05:37.430124 19478 raft_consensus.cc:2468] T 40e1e16737a842ee936002830f36882e P 0473d2b2d01f4459b1e90fd12cc7840e [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 10.
I20260709 13:05:37.431217 19478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62c6c134d3d24a1ab144dd9ee6bc3f64" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:05:37.431447 19305 catalog_manager.cc:5697] T 1f85fc4b527a48848e5faa083b604e36 P 127766fc592545a4997f7790f50f6076 reported cstate change: term changed from 2 to 5, leader changed from e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1) to 127766fc592545a4997f7790f50f6076 (127.17.223.4). New cstate: current_term: 5 leader_uuid: "127766fc592545a4997f7790f50f6076" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:05:37.432250 19478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c5eebf646ad445a9d1b1adc319d7b16" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:05:37.432993 19478 raft_consensus.cc:2468] T 6c5eebf646ad445a9d1b1adc319d7b16 P 0473d2b2d01f4459b1e90fd12cc7840e [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 5.
I20260709 13:05:37.433979 19478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "179fd671030940b4b4a4e24bcc4aba0a" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:05:37.434741 19478 raft_consensus.cc:2468] T 179fd671030940b4b4a4e24bcc4aba0a P 0473d2b2d01f4459b1e90fd12cc7840e [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 7.
I20260709 13:05:37.435616 19406 raft_consensus.cc:2393] T 5ec1c4ce15e04c7e8c283a62179f2a64 P e5256d91808b47c195bc9b4dbd7f2b87 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 127766fc592545a4997f7790f50f6076 in current term 7: Already voted for candidate e5256d91808b47c195bc9b4dbd7f2b87 in this term.
I20260709 13:05:37.436285 19486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed7fdbcb96d14d418db9ca90a792588a" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:05:37.434084 19555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76cb037fc9064d13b59a8969d897ce8c" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:05:37.439337 19483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df751f992649444090e27965eb1af85d" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:05:37.443265 19483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff9b0eddd810459b82d91c60777c10eb" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:05:37.438323 19449 leader_election.cc:304] T 179fd671030940b4b4a4e24bcc4aba0a P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87; no voters: 
I20260709 13:05:37.444274 19483 raft_consensus.cc:2410] T ff9b0eddd810459b82d91c60777c10eb P 0473d2b2d01f4459b1e90fd12cc7840e [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate e5256d91808b47c195bc9b4dbd7f2b87 for term 6 because replica has last-logged OpId of term: 5 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260709 13:05:37.445148 19478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14efcc79969f41babe5529c22d59156d" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:05:37.445475 20078 leader_election.cc:304] T 172b3dd13109415a955b71ac0e9d2234 P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 127766fc592545a4997f7790f50f6076; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:05:37.446722 19483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f575b143b844aa096b50997dad3516a" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:05:37.449572 19305 catalog_manager.cc:5697] T fa731b585f684a7fb2d106c50f143b83 P 127766fc592545a4997f7790f50f6076 reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "127766fc592545a4997f7790f50f6076" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:05:37.452346 19375 leader_election.cc:304] T 0cdf56e38bbc453d9438d359e5a69955 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:05:37.455281 22655 raft_consensus.cc:2804] T 179fd671030940b4b4a4e24bcc4aba0a P 0473d2b2d01f4459b1e90fd12cc7840e [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:05:37.455657 19557 raft_consensus.cc:1275] T 4509b76741dc428e9201c70c1658da13 P e61c3a8f61bb48f8a963c9480e53c168 [term 4 FOLLOWER]: Refusing update from remote peer 0473d2b2d01f4459b1e90fd12cc7840e: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:05:37.455735 22655 raft_consensus.cc:493] T 179fd671030940b4b4a4e24bcc4aba0a P 0473d2b2d01f4459b1e90fd12cc7840e [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:37.456326 22655 raft_consensus.cc:3060] T 179fd671030940b4b4a4e24bcc4aba0a P 0473d2b2d01f4459b1e90fd12cc7840e [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:05:37.458925 19484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "309c3ca0ca4b4f3ba129752ea2cb293b" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:05:37.459069 19555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab43d85f64114d4ebf618930e43d9ed0" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:05:37.460219 19484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "172b3dd13109415a955b71ac0e9d2234" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:05:37.461516 19484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14935b3ddf914369822e4a0547aaa355" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 7 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:05:37.462356 19484 raft_consensus.cc:2393] T 14935b3ddf914369822e4a0547aaa355 P 0473d2b2d01f4459b1e90fd12cc7840e [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e61c3a8f61bb48f8a963c9480e53c168 in current term 7: Already voted for candidate 0473d2b2d01f4459b1e90fd12cc7840e in this term.
I20260709 13:05:37.462836 19486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e5873a19244c5ebbcd38e126796ee7" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 10 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:05:37.463366 19486 raft_consensus.cc:3060] T d1e5873a19244c5ebbcd38e126796ee7 P 0473d2b2d01f4459b1e90fd12cc7840e [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:05:37.463572 22655 raft_consensus.cc:515] T 179fd671030940b4b4a4e24bcc4aba0a P 0473d2b2d01f4459b1e90fd12cc7840e [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:37.465492 22655 leader_election.cc:290] T 179fd671030940b4b4a4e24bcc4aba0a P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 8 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:05:37.469135 19560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7be9efa6559648dbb5a0f7684c4542d1" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:05:37.470607 19560 raft_consensus.cc:1275] T b08304a0a02b42d7840c4e8ee9a6bd1a P e61c3a8f61bb48f8a963c9480e53c168 [term 9 FOLLOWER]: Refusing update from remote peer 0473d2b2d01f4459b1e90fd12cc7840e: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:05:37.470932 19481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62c6c134d3d24a1ab144dd9ee6bc3f64" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:05:37.471485 19558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21e14947d70440f19044d8f75c31e1f9" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:05:37.472623 19481 raft_consensus.cc:1275] T 3e1f505cb0f1427bbd698ac889d80821 P 0473d2b2d01f4459b1e90fd12cc7840e [term 8 FOLLOWER]: Refusing update from remote peer e5256d91808b47c195bc9b4dbd7f2b87: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 8 index: 4. (term mismatch)
I20260709 13:05:37.472970 19481 pending_rounds.cc:85] T 3e1f505cb0f1427bbd698ac889d80821 P 0473d2b2d01f4459b1e90fd12cc7840e: Aborting all ops after (but not including) 3
I20260709 13:05:37.473235 19481 pending_rounds.cc:107] T 3e1f505cb0f1427bbd698ac889d80821 P 0473d2b2d01f4459b1e90fd12cc7840e: Aborting uncommitted NO_OP operation due to leader change: 7.4
I20260709 13:05:37.473517 19481 raft_consensus.cc:2889] T 3e1f505cb0f1427bbd698ac889d80821 P 0473d2b2d01f4459b1e90fd12cc7840e [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:05:37.480664 19559 raft_consensus.cc:2468] T 0afb57ae58a24a01850491d69f0213dd P e61c3a8f61bb48f8a963c9480e53c168 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 8.
I20260709 13:05:37.484949 19485 raft_consensus.cc:2468] T ed7fdbcb96d14d418db9ca90a792588a P 0473d2b2d01f4459b1e90fd12cc7840e [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 127766fc592545a4997f7790f50f6076 in term 5.
I20260709 13:05:37.491607 19486 raft_consensus.cc:2468] T d1e5873a19244c5ebbcd38e126796ee7 P 0473d2b2d01f4459b1e90fd12cc7840e [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 10.
I20260709 13:05:37.494102 19486 raft_consensus.cc:1240] T 309c3ca0ca4b4f3ba129752ea2cb293b P 0473d2b2d01f4459b1e90fd12cc7840e [term 7 LEADER]: Rejecting Update request from peer e61c3a8f61bb48f8a963c9480e53c168 for earlier term 6. Current term is 7. Ops: []
I20260709 13:05:37.492964 19555 raft_consensus.cc:2468] T ab43d85f64114d4ebf618930e43d9ed0 P e61c3a8f61bb48f8a963c9480e53c168 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 127766fc592545a4997f7790f50f6076 in term 6.
I20260709 13:05:37.496546 19449 leader_election.cc:304] T ab43d85f64114d4ebf618930e43d9ed0 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, 127766fc592545a4997f7790f50f6076, e5256d91808b47c195bc9b4dbd7f2b87; no voters: 
I20260709 13:05:37.516192 19526 leader_election.cc:304] T 0e1085d23e8347fbbd5bce7542f4b1f4 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:05:37.517282 19553 raft_consensus.cc:1275] T fa8650e71aa14778b3d73721fc50d9fc P e61c3a8f61bb48f8a963c9480e53c168 [term 9 FOLLOWER]: Refusing update from remote peer 0473d2b2d01f4459b1e90fd12cc7840e: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 13:05:37.395656 22640 consensus_queue.cc:1048] T b08304a0a02b42d7840c4e8ee9a6bd1a P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.081s
I20260709 13:05:37.523013 19403 raft_consensus.cc:1240] T 1dc5b3532fe54f74876d02beffa2c230 P e5256d91808b47c195bc9b4dbd7f2b87 [term 7 LEADER]: Rejecting Update request from peer 0473d2b2d01f4459b1e90fd12cc7840e for earlier term 6. Current term is 7. Ops: []
I20260709 13:05:37.519929 19481 raft_consensus.cc:3055] T 1dc5b3532fe54f74876d02beffa2c230 P 0473d2b2d01f4459b1e90fd12cc7840e [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:05:37.524116 19481 raft_consensus.cc:740] T 1dc5b3532fe54f74876d02beffa2c230 P 0473d2b2d01f4459b1e90fd12cc7840e [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 0473d2b2d01f4459b1e90fd12cc7840e, State: Running, Role: LEADER
I20260709 13:05:37.518776 19404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "179fd671030940b4b4a4e24bcc4aba0a" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
I20260709 13:05:37.522688 19484 raft_consensus.cc:1275] T ff9b0eddd810459b82d91c60777c10eb P 0473d2b2d01f4459b1e90fd12cc7840e [term 6 FOLLOWER]: Refusing update from remote peer e5256d91808b47c195bc9b4dbd7f2b87: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 7. (term mismatch)
I20260709 13:05:37.526587 19404 raft_consensus.cc:3060] T 179fd671030940b4b4a4e24bcc4aba0a P e5256d91808b47c195bc9b4dbd7f2b87 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:05:37.489636 22665 raft_consensus.cc:2804] T 7f575b143b844aa096b50997dad3516a P 0473d2b2d01f4459b1e90fd12cc7840e [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:05:37.526829 19484 pending_rounds.cc:85] T ff9b0eddd810459b82d91c60777c10eb P 0473d2b2d01f4459b1e90fd12cc7840e: Aborting all ops after (but not including) 6
I20260709 13:05:37.536067 19484 pending_rounds.cc:107] T ff9b0eddd810459b82d91c60777c10eb P 0473d2b2d01f4459b1e90fd12cc7840e: Aborting uncommitted NO_OP operation due to leader change: 5.7
I20260709 13:05:37.536404 19484 raft_consensus.cc:2889] T ff9b0eddd810459b82d91c60777c10eb P 0473d2b2d01f4459b1e90fd12cc7840e [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:05:37.525030 19481 consensus_queue.cc:260] T 1dc5b3532fe54f74876d02beffa2c230 P 0473d2b2d01f4459b1e90fd12cc7840e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 6.3, Last appended by leader: 3, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:37.533017 19526 leader_election.cc:304] T 40e1e16737a842ee936002830f36882e P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:05:37.534241 22558 raft_consensus.cc:2749] T 172b3dd13109415a955b71ac0e9d2234 P 127766fc592545a4997f7790f50f6076 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:05:37.537523 19481 raft_consensus.cc:3060] T 1dc5b3532fe54f74876d02beffa2c230 P 0473d2b2d01f4459b1e90fd12cc7840e [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:05:37.543769 19526 leader_election.cc:304] T 6c5eebf646ad445a9d1b1adc319d7b16 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:05:37.544659 19553 raft_consensus.cc:1240] T ece3db938bc649d4a40a51522ed5259c P e61c3a8f61bb48f8a963c9480e53c168 [term 8 FOLLOWER]: Rejecting Update request from peer 127766fc592545a4997f7790f50f6076 for earlier term 7. Current term is 8. Ops: []
I20260709 13:05:37.529668 22293 raft_consensus.cc:2804] T 0cdf56e38bbc453d9438d359e5a69955 P e5256d91808b47c195bc9b4dbd7f2b87 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:05:37.522369 22540 raft_consensus.cc:2804] T 0e1085d23e8347fbbd5bce7542f4b1f4 P e61c3a8f61bb48f8a963c9480e53c168 [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 13:05:37.513763 19375 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.3:36891, user_credentials={real_user=slave}} blocked reactor thread for 61478us
I20260709 13:05:37.503104 19552 raft_consensus.cc:1240] T 0afb57ae58a24a01850491d69f0213dd P e61c3a8f61bb48f8a963c9480e53c168 [term 8 FOLLOWER]: Rejecting Update request from peer 127766fc592545a4997f7790f50f6076 for earlier term 7. Current term is 8. Ops: []
I20260709 13:05:37.555604 19377 leader_election.cc:400] T 14efcc79969f41babe5529c22d59156d P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 8 election: Vote denied by peer 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257) with higher term. Message: Invalid argument: T 14efcc79969f41babe5529c22d59156d P 0473d2b2d01f4459b1e90fd12cc7840e [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate e5256d91808b47c195bc9b4dbd7f2b87 for earlier term 8. Current term is 9.
I20260709 13:05:37.584574 19377 leader_election.cc:403] T 14efcc79969f41babe5529c22d59156d P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 8 election: Cancelling election due to peer responding with higher term
I20260709 13:05:37.556965 19555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48824d5acfbc485ebf8c2d944e7202de" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:05:37.585659 19555 raft_consensus.cc:2410] T 48824d5acfbc485ebf8c2d944e7202de P e61c3a8f61bb48f8a963c9480e53c168 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 127766fc592545a4997f7790f50f6076 for term 8 because replica has last-logged OpId of term: 7 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
W20260709 13:05:37.557792 19524 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:05:37.585661 19449 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.4:43121, user_credentials={real_user=slave}} blocked reactor thread for 89212.3us
I20260709 13:05:37.587898 19449 leader_election.cc:304] T 14935b3ddf914369822e4a0547aaa355 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e; no voters: 127766fc592545a4997f7790f50f6076, e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:05:37.534081 21957 consensus_queue.cc:237] T 1a61655d99124a29b486ba4a5b37faea P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 5.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:37.539242 22665 raft_consensus.cc:493] T 7f575b143b844aa096b50997dad3516a P 0473d2b2d01f4459b1e90fd12cc7840e [term 3 FOLLOWER]: Starting leader election (detected failure of leader e61c3a8f61bb48f8a963c9480e53c168)
I20260709 13:05:37.554332 22385 consensus_queue.cc:1048] T 2b74109013a140ada21feeef92d6f563 P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:05:37.551378 22624 raft_consensus.cc:2804] T 40e1e16737a842ee936002830f36882e P e61c3a8f61bb48f8a963c9480e53c168 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:05:37.595471 22534 leader_election.cc:290] T 5ec1c4ce15e04c7e8c283a62179f2a64 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 7 election: Requested vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:05:37.551198 22620 raft_consensus.cc:2804] T 6c5eebf646ad445a9d1b1adc319d7b16 P e61c3a8f61bb48f8a963c9480e53c168 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:05:37.615140 19551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab43d85f64114d4ebf618930e43d9ed0" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:05:37.623549 19551 raft_consensus.cc:2376] T ab43d85f64114d4ebf618930e43d9ed0 P e61c3a8f61bb48f8a963c9480e53c168 [term 6 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 127766fc592545a4997f7790f50f6076 in term 6. Re-sending same reply.
I20260709 13:05:37.478370 22658 raft_consensus.cc:2804] T 14efcc79969f41babe5529c22d59156d P 0473d2b2d01f4459b1e90fd12cc7840e [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:05:37.603363 19479 raft_consensus.cc:2468] T 86a6797bdfe94fa496c050ceae4bd0d9 P 0473d2b2d01f4459b1e90fd12cc7840e [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 8.
W20260709 13:05:37.617146 20078 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.2:46257, user_credentials={real_user=slave}} blocked reactor thread for 171714us
I20260709 13:05:37.606060 19404 raft_consensus.cc:2468] T 179fd671030940b4b4a4e24bcc4aba0a P e5256d91808b47c195bc9b4dbd7f2b87 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 8.
W20260709 13:05:37.630748 20078 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:05:37.608788 22639 log.cc:927] Time spent T 172b3dd13109415a955b71ac0e9d2234 P e5256d91808b47c195bc9b4dbd7f2b87: Append to log took a long time: real 0.067s	user 0.000s	sys 0.001s
W20260709 13:05:37.631431 20078 leader_election.cc:336] T 14efcc79969f41babe5529c22d59156d P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 8 election: RPC error from VoteRequest() call to peer 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257): Timed out: RequestConsensusVote RPC to 127.17.223.2:46257 timed out after 2.637s (SENT)
I20260709 13:05:37.642416 20078 leader_election.cc:304] T 14efcc79969f41babe5529c22d59156d P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 127766fc592545a4997f7790f50f6076; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87
W20260709 13:05:37.643364 19450 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:37.600291 22540 raft_consensus.cc:493] T 0e1085d23e8347fbbd5bce7542f4b1f4 P e61c3a8f61bb48f8a963c9480e53c168 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:37.616600 22665 raft_consensus.cc:3060] T 7f575b143b844aa096b50997dad3516a P 0473d2b2d01f4459b1e90fd12cc7840e [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:05:37.599908 22293 raft_consensus.cc:697] T 0cdf56e38bbc453d9438d359e5a69955 P e5256d91808b47c195bc9b4dbd7f2b87 [term 11 LEADER]: Becoming Leader. State: Replica: e5256d91808b47c195bc9b4dbd7f2b87, State: Running, Role: LEADER
I20260709 13:05:37.616364 22381 raft_consensus.cc:2804] T ab43d85f64114d4ebf618930e43d9ed0 P 0473d2b2d01f4459b1e90fd12cc7840e [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:05:37.654493 19551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed7fdbcb96d14d418db9ca90a792588a" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:05:37.656214 19479 raft_consensus.cc:1240] T ff9b0eddd810459b82d91c60777c10eb P 0473d2b2d01f4459b1e90fd12cc7840e [term 6 FOLLOWER]: Rejecting Update request from peer 127766fc592545a4997f7790f50f6076 for earlier term 4. Current term is 6. Ops: []
I20260709 13:05:37.489106 22625 consensus_queue.cc:1059] T f1b10566f45d4a7d9029858330e02d5b P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 }, Status: INVALID_TERM, Last received: 8.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.153s
I20260709 13:05:37.572965 22503 consensus_queue.cc:1048] T bc225c93219c45538b53a1bd3d387e4d P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.066s
I20260709 13:05:37.623003 22620 raft_consensus.cc:493] T 6c5eebf646ad445a9d1b1adc319d7b16 P e61c3a8f61bb48f8a963c9480e53c168 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:37.675002 19450 leader_election.cc:304] T 28af091831594f9d8e96482078cc7625 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e; no voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168
W20260709 13:05:37.682277 20078 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.2:46257, user_credentials={real_user=slave}} blocked reactor thread for 50878.2us
I20260709 13:05:37.638079 22624 raft_consensus.cc:697] T 40e1e16737a842ee936002830f36882e P e61c3a8f61bb48f8a963c9480e53c168 [term 10 LEADER]: Becoming Leader. State: Replica: e61c3a8f61bb48f8a963c9480e53c168, State: Running, Role: LEADER
I20260709 13:05:37.652894 22540 raft_consensus.cc:3060] T 0e1085d23e8347fbbd5bce7542f4b1f4 P e61c3a8f61bb48f8a963c9480e53c168 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:05:37.652283 22658 raft_consensus.cc:697] T 14efcc79969f41babe5529c22d59156d P 0473d2b2d01f4459b1e90fd12cc7840e [term 9 LEADER]: Becoming Leader. State: Replica: 0473d2b2d01f4459b1e90fd12cc7840e, State: Running, Role: LEADER
I20260709 13:05:37.675717 22534 raft_consensus.cc:2749] T 14efcc79969f41babe5529c22d59156d P e5256d91808b47c195bc9b4dbd7f2b87 [term 9 FOLLOWER]: Leader election lost for term 8. Reason: Vote denied by peer 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257) with higher term. Message: Invalid argument: T 14efcc79969f41babe5529c22d59156d P 0473d2b2d01f4459b1e90fd12cc7840e [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate e5256d91808b47c195bc9b4dbd7f2b87 for earlier term 8. Current term is 9.
I20260709 13:05:37.689503 19482 raft_consensus.cc:2468] T 775c229504194560ba9589bc2199b089 P 0473d2b2d01f4459b1e90fd12cc7840e [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 127766fc592545a4997f7790f50f6076 in term 6.
I20260709 13:05:37.671859 22381 raft_consensus.cc:493] T ab43d85f64114d4ebf618930e43d9ed0 P 0473d2b2d01f4459b1e90fd12cc7840e [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:37.695524 20110 raft_consensus.cc:1240] T 172b3dd13109415a955b71ac0e9d2234 P 127766fc592545a4997f7790f50f6076 [term 6 FOLLOWER]: Rejecting Update request from peer 0473d2b2d01f4459b1e90fd12cc7840e for earlier term 5. Current term is 6. Ops: []
I20260709 13:05:37.700850 19551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62c6c134d3d24a1ab144dd9ee6bc3f64" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:05:37.689388 19481 raft_consensus.cc:1275] T 1dc5b3532fe54f74876d02beffa2c230 P 0473d2b2d01f4459b1e90fd12cc7840e [term 7 FOLLOWER]: Refusing update from remote peer e5256d91808b47c195bc9b4dbd7f2b87: Log matching property violated. Preceding OpId in replica: term: 6 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:05:37.704382 19479 raft_consensus.cc:1240] T 1efebf73c86e432baa55533136b6e12c P 0473d2b2d01f4459b1e90fd12cc7840e [term 6 FOLLOWER]: Rejecting Update request from peer 127766fc592545a4997f7790f50f6076 for earlier term 5. Current term is 6. Ops: []
I20260709 13:05:37.669598 22679 raft_consensus.cc:2749] T 14efcc79969f41babe5529c22d59156d P 127766fc592545a4997f7790f50f6076 [term 9 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:05:37.722656 19482 raft_consensus.cc:1240] T 0e1085d23e8347fbbd5bce7542f4b1f4 P 0473d2b2d01f4459b1e90fd12cc7840e [term 5 FOLLOWER]: Rejecting Update request from peer 127766fc592545a4997f7790f50f6076 for earlier term 4. Current term is 5. Ops: []
W20260709 13:05:37.725502 19450 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.3:36891, user_credentials={real_user=slave}} blocked reactor thread for 81024.8us
I20260709 13:05:37.693518 22620 raft_consensus.cc:3060] T 6c5eebf646ad445a9d1b1adc319d7b16 P e61c3a8f61bb48f8a963c9480e53c168 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:05:37.741884 19450 leader_election.cc:304] T b9f0d59553ad444883fcf5b5909f9798 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e; no voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:05:37.690418 22640 raft_consensus.cc:2749] T 14935b3ddf914369822e4a0547aaa355 P 0473d2b2d01f4459b1e90fd12cc7840e [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
W20260709 13:05:37.759632 19524 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:37.743757 19551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65d8cb8d6ec64f459d5a47cefab10acf" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:05:37.759636 19482 raft_consensus.cc:1240] T d1e5873a19244c5ebbcd38e126796ee7 P 0473d2b2d01f4459b1e90fd12cc7840e [term 10 FOLLOWER]: Rejecting Update request from peer e61c3a8f61bb48f8a963c9480e53c168 for earlier term 9. Current term is 10. Ops: []
W20260709 13:05:37.754082 19525 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:37.712987 22527 raft_consensus.cc:2749] T 28af091831594f9d8e96482078cc7625 P 0473d2b2d01f4459b1e90fd12cc7840e [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:05:37.721691 22381 raft_consensus.cc:3060] T ab43d85f64114d4ebf618930e43d9ed0 P 0473d2b2d01f4459b1e90fd12cc7840e [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:05:37.771155 19479 raft_consensus.cc:1275] T 9962423cb4e54fcfa5de01daf68a86e7 P 0473d2b2d01f4459b1e90fd12cc7840e [term 11 FOLLOWER]: Refusing update from remote peer 127766fc592545a4997f7790f50f6076: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:05:37.782534 19482 raft_consensus.cc:1240] T 6c5eebf646ad445a9d1b1adc319d7b16 P 0473d2b2d01f4459b1e90fd12cc7840e [term 5 FOLLOWER]: Rejecting Update request from peer 127766fc592545a4997f7790f50f6076 for earlier term 4. Current term is 5. Ops: []
I20260709 13:05:37.729617 22504 raft_consensus.cc:493] T 46c5bfeecc314717bffe987e6844b6d0 P e5256d91808b47c195bc9b4dbd7f2b87 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:37.793939 19477 raft_consensus.cc:2468] T df751f992649444090e27965eb1af85d P 0473d2b2d01f4459b1e90fd12cc7840e [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 9.
W20260709 13:05:37.798852 19451 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:05:37.918463 19450 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.3:36891, user_credentials={real_user=slave}} blocked reactor thread for 191984us
I20260709 13:05:37.803930 19479 raft_consensus.cc:1240] T 0afb57ae58a24a01850491d69f0213dd P 0473d2b2d01f4459b1e90fd12cc7840e [term 8 FOLLOWER]: Rejecting Update request from peer 127766fc592545a4997f7790f50f6076 for earlier term 7. Current term is 8. Ops: []
I20260709 13:05:37.922161 19551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96efeaaf1057492490e9a621f37e1a2d" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
W20260709 13:05:37.800441 22680 log.cc:927] Time spent T fa8650e71aa14778b3d73721fc50d9fc P 0473d2b2d01f4459b1e90fd12cc7840e: Append to log took a long time: real 0.105s	user 0.000s	sys 0.000s
I20260709 13:05:37.922943 19551 raft_consensus.cc:2468] T 96efeaaf1057492490e9a621f37e1a2d P e61c3a8f61bb48f8a963c9480e53c168 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 127766fc592545a4997f7790f50f6076 in term 7.
I20260709 13:05:37.779876 22676 raft_consensus.cc:493] T 22196caba61445d3bec98a0aab3c337d P e5256d91808b47c195bc9b4dbd7f2b87 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 0473d2b2d01f4459b1e90fd12cc7840e)
W20260709 13:05:37.923552 19449 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.4:43121, user_credentials={real_user=slave}} blocked reactor thread for 335731us
W20260709 13:05:37.970964 19377 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.2:46257, user_credentials={real_user=slave}} blocked reactor thread for 415448us
I20260709 13:05:37.971382 19449 leader_election.cc:304] T 5ec1c4ce15e04c7e8c283a62179f2a64 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, 127766fc592545a4997f7790f50f6076; no voters: e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:05:37.794775 22682 raft_consensus.cc:3055] T f1b10566f45d4a7d9029858330e02d5b P e5256d91808b47c195bc9b4dbd7f2b87 [term 8 LEADER]: Stepping down as leader of term 8
W20260709 13:05:37.972527 19450 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.3:36891, user_credentials={real_user=slave}} blocked reactor thread for 53006.5us
W20260709 13:05:37.922253 22672 log.cc:927] Time spent T fa8650e71aa14778b3d73721fc50d9fc P e5256d91808b47c195bc9b4dbd7f2b87: Append to log took a long time: real 0.145s	user 0.001s	sys 0.000s
W20260709 13:05:38.000876 19449 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:05:37.923153 22648 log.cc:927] Time spent T fa731b585f684a7fb2d106c50f143b83 P e61c3a8f61bb48f8a963c9480e53c168: Append to log took a long time: real 0.140s	user 0.000s	sys 0.000s
I20260709 13:05:38.017222 19449 leader_election.cc:304] T 179fd671030940b4b4a4e24bcc4aba0a P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87; no voters: 
I20260709 13:05:38.021301 19551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab43d85f64114d4ebf618930e43d9ed0" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:05:38.024435 19377 leader_election.cc:304] T 86a6797bdfe94fa496c050ceae4bd0d9 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87; no voters: e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:05:37.998886 22682 raft_consensus.cc:740] T f1b10566f45d4a7d9029858330e02d5b P e5256d91808b47c195bc9b4dbd7f2b87 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: e5256d91808b47c195bc9b4dbd7f2b87, State: Running, Role: LEADER
W20260709 13:05:38.028015 20076 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:05:38.028749 19524 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:38.023514 19551 raft_consensus.cc:2376] T ab43d85f64114d4ebf618930e43d9ed0 P e61c3a8f61bb48f8a963c9480e53c168 [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 127766fc592545a4997f7790f50f6076 in term 6. Re-sending same reply.
I20260709 13:05:37.932683 22551 raft_consensus.cc:493] T 309c3ca0ca4b4f3ba129752ea2cb293b P e61c3a8f61bb48f8a963c9480e53c168 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:37.800629 22504 raft_consensus.cc:515] T 46c5bfeecc314717bffe987e6844b6d0 P e5256d91808b47c195bc9b4dbd7f2b87 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:37.996562 22628 raft_consensus.cc:493] T 48824d5acfbc485ebf8c2d944e7202de P e61c3a8f61bb48f8a963c9480e53c168 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:38.052999 19377 leader_election.cc:304] T fa8650e71aa14778b3d73721fc50d9fc P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168
W20260709 13:05:38.021773 22677 log.cc:927] Time spent T 172b3dd13109415a955b71ac0e9d2234 P 0473d2b2d01f4459b1e90fd12cc7840e: Append to log took a long time: real 0.413s	user 0.001s	sys 0.000s
W20260709 13:05:38.062378 19526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.2:46257, user_credentials={real_user=slave}} blocked reactor thread for 45835.8us
I20260709 13:05:38.017673 22655 raft_consensus.cc:2804] T 5ec1c4ce15e04c7e8c283a62179f2a64 P 0473d2b2d01f4459b1e90fd12cc7840e [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:05:38.063207 19526 leader_election.cc:304] T 86a6797bdfe94fa496c050ceae4bd0d9 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
W20260709 13:05:38.032788 22673 log.cc:927] Time spent T 1dc5b3532fe54f74876d02beffa2c230 P e61c3a8f61bb48f8a963c9480e53c168: Append to log took a long time: real 0.481s	user 0.001s	sys 0.000s
I20260709 13:05:37.795341 22293 consensus_queue.cc:237] T 0cdf56e38bbc453d9438d359e5a69955 P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:38.059530 19377 leader_election.cc:304] T 1a61655d99124a29b486ba4a5b37faea P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:05:38.081103 19551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed7fdbcb96d14d418db9ca90a792588a" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:05:38.043100 22685 raft_consensus.cc:493] T 85c494af21f9457a85da47b9bc70c1fd P 127766fc592545a4997f7790f50f6076 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader e5256d91808b47c195bc9b4dbd7f2b87)
I20260709 13:05:38.082314 22399 raft_consensus.cc:493] T b08304a0a02b42d7840c4e8ee9a6bd1a P e5256d91808b47c195bc9b4dbd7f2b87 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:37.932582 22624 consensus_queue.cc:237] T 40e1e16737a842ee936002830f36882e P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:38.112195 19551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "833a2f0775ed407a94b8924ce50adb63" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
W20260709 13:05:38.118815 19377 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.2:46257, user_credentials={real_user=slave}} blocked reactor thread for 59357.2us
I20260709 13:05:38.015096 22676 raft_consensus.cc:515] T 22196caba61445d3bec98a0aab3c337d P e5256d91808b47c195bc9b4dbd7f2b87 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:38.120991 19377 leader_election.cc:304] T ab43d85f64114d4ebf618930e43d9ed0 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, 127766fc592545a4997f7790f50f6076, e5256d91808b47c195bc9b4dbd7f2b87; no voters: e61c3a8f61bb48f8a963c9480e53c168
W20260709 13:05:38.122947 19450 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.3:36891, user_credentials={real_user=slave}} blocked reactor thread for 83049.3us
W20260709 13:05:38.103574 22369 consensus_meta.cc:287] T 1a61655d99124a29b486ba4a5b37faea P 0473d2b2d01f4459b1e90fd12cc7840e: Time spent flushing consensus metadata: real 0.805s	user 0.011s	sys 0.000s
I20260709 13:05:38.065269 22628 raft_consensus.cc:515] T 48824d5acfbc485ebf8c2d944e7202de P e61c3a8f61bb48f8a963c9480e53c168 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:05:37.970793 22658 consensus_queue.cc:237] T 14efcc79969f41babe5529c22d59156d P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:05:38.103093 22640 raft_consensus.cc:2804] T 179fd671030940b4b4a4e24bcc4aba0a P 0473d2b2d01f4459b1e90fd12cc7840e [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:05:38.131521 19551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed7fdbcb96d14d418db9ca90a792588a" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:05:38.060375 22551 raft_consensus.cc:515] T 309c3ca0ca4b4f3ba129752ea2cb293b P e61c3a8f61bb48f8a963c9480e53c168 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } attrs { replace: true } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:05:38.112632 22685 raft_consensus.cc:515] T 85c494af21f9457a85da47b9bc70c1fd P 127766fc592545a4997f7790f50f6076 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:05:38.155616 22685 leader_election.cc:290] T 85c494af21f9457a85da47b9bc70c1fd P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:05:38.156114 22551 leader_election.cc:290] T 309c3ca0ca4b4f3ba129752ea2cb293b P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:05:38.040619 22682 consensus_queue.cc:260] T f1b10566f45d4a7d9029858330e02d5b P e5256d91808b47c195bc9b4dbd7f2b87 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:38.120838 22526 consensus_queue.cc:1059] T e381f1d6b8184797ad142de49be225a8 P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.026s
I20260709 13:05:38.221729 19551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62c6c134d3d24a1ab144dd9ee6bc3f64" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
W20260709 13:05:38.224048 19377 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.2:46257, user_credentials={real_user=slave}} blocked reactor thread for 103090us
I20260709 13:05:38.123744 22399 raft_consensus.cc:515] T b08304a0a02b42d7840c4e8ee9a6bd1a P e5256d91808b47c195bc9b4dbd7f2b87 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:38.148102 19450 leader_election.cc:304] T 2b74109013a140ada21feeef92d6f563 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e; no voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:05:38.239996 22650 raft_consensus.cc:493] T 2725d2c4cb054f18b0fc8f735c15f6c2 P 0473d2b2d01f4459b1e90fd12cc7840e [term 8 FOLLOWER]: Starting pre-election (detected failure of leader e5256d91808b47c195bc9b4dbd7f2b87)
I20260709 13:05:38.243448 22504 leader_election.cc:290] T 46c5bfeecc314717bffe987e6844b6d0 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
W20260709 13:05:38.244656 20078 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:38.245136 22701 raft_consensus.cc:2804] T 86a6797bdfe94fa496c050ceae4bd0d9 P e61c3a8f61bb48f8a963c9480e53c168 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:05:38.246737 22470 consensus_queue.cc:1059] T 172b3dd13109415a955b71ac0e9d2234 P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
W20260709 13:05:38.247162 19525 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:05:38.281191 19525 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:38.248119 19477 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58294 (request call id 1862) took 1010 ms. Trace:
I20260709 13:05:38.282891 19477 rpcz_store.cc:276] 0709 13:05:37.237527 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:37.380811 (+143284us) service_pool.cc:224] Handling call
0709 13:05:38.247967 (+867156us) spinlock_profiling.cc:243] Waited 138 ms on lock 0x7b540030cfd4. stack: 00007f4a79de9343 00007f4a79de9240 00007f4a797781d4 00007f4a834b6304 00007f4a834b6299 00007f4a7ce71571 00007f4a7cf0c2fa 00007f4a81ecdb17 00007f4a7b4486d4 00007f4a7b448662 00007f4a7b448591 00007f4a7b44850c 00007f4a7b4477c2 00007f4a7b24348c 00007f4a7b2428c6 00007f4a7b24226f
0709 13:05:38.248062 (+    95us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":317282176}
I20260709 13:05:38.140677 22655 raft_consensus.cc:697] T 5ec1c4ce15e04c7e8c283a62179f2a64 P 0473d2b2d01f4459b1e90fd12cc7840e [term 6 LEADER]: Becoming Leader. State: Replica: 0473d2b2d01f4459b1e90fd12cc7840e, State: Running, Role: LEADER
I20260709 13:05:38.252907 19480 raft_consensus.cc:2468] T 1a61655d99124a29b486ba4a5b37faea P 0473d2b2d01f4459b1e90fd12cc7840e [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 6.
W20260709 13:05:38.262609 19484 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.654s	user 0.007s	sys 0.007s
I20260709 13:05:38.141378 22692 consensus_queue.cc:1048] T 22196caba61445d3bec98a0aab3c337d P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.127s
I20260709 13:05:38.293519 19559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "833a2f0775ed407a94b8924ce50adb63" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
W20260709 13:05:38.272735 20076 leader_election.cc:336] T ed7fdbcb96d14d418db9ca90a792588a P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 5 election: RPC error from VoteRequest() call to peer e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891): Timed out: RequestConsensusVote RPC to 127.17.223.3:36891 timed out after 1.907s (SENT)
I20260709 13:05:38.272840 19377 leader_election.cc:304] T b9f0d59553ad444883fcf5b5909f9798 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:05:38.277253 19551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ece3db938bc649d4a40a51522ed5259c" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
W20260709 13:05:38.286710 19526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.2:46257, user_credentials={real_user=slave}} blocked reactor thread for 223566us
W20260709 13:05:38.288372 19484 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.680s	user 0.008s	sys 0.007s
I20260709 13:05:38.291882 19554 raft_consensus.cc:1275] T ef32ce6fdd0e40d382c79974f30295c6 P e61c3a8f61bb48f8a963c9480e53c168 [term 9 FOLLOWER]: Refusing update from remote peer e5256d91808b47c195bc9b4dbd7f2b87: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:05:38.292991 20111 raft_consensus.cc:1275] T 48824d5acfbc485ebf8c2d944e7202de P 127766fc592545a4997f7790f50f6076 [term 8 FOLLOWER]: Refusing update from remote peer 0473d2b2d01f4459b1e90fd12cc7840e: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:05:38.272322 22685 raft_consensus.cc:493] T 65d8cb8d6ec64f459d5a47cefab10acf P 127766fc592545a4997f7790f50f6076 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader e5256d91808b47c195bc9b4dbd7f2b87)
W20260709 13:05:38.306836 19450 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.3:36891, user_credentials={real_user=slave}} blocked reactor thread for 159336us
I20260709 13:05:38.657958 19450 leader_election.cc:400] T 86a6797bdfe94fa496c050ceae4bd0d9 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 7 election: Vote denied by peer e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891) with higher term. Message: Invalid argument: T 86a6797bdfe94fa496c050ceae4bd0d9 P e61c3a8f61bb48f8a963c9480e53c168 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 0473d2b2d01f4459b1e90fd12cc7840e for earlier term 7. Current term is 8.
I20260709 13:05:38.658305 19450 leader_election.cc:403] T 86a6797bdfe94fa496c050ceae4bd0d9 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 7 election: Cancelling election due to peer responding with higher term
I20260709 13:05:38.273767 22174 raft_consensus.cc:493] T 96efeaaf1057492490e9a621f37e1a2d P 127766fc592545a4997f7790f50f6076 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:38.309587 19551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85c494af21f9457a85da47b9bc70c1fd" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:05:38.280439 22534 raft_consensus.cc:2749] T fa8650e71aa14778b3d73721fc50d9fc P e5256d91808b47c195bc9b4dbd7f2b87 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:05:38.281054 22699 raft_consensus.cc:2804] T 86a6797bdfe94fa496c050ceae4bd0d9 P e5256d91808b47c195bc9b4dbd7f2b87 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:05:38.286278 22655 consensus_queue.cc:237] T 5ec1c4ce15e04c7e8c283a62179f2a64 P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:05:38.311331 22703 raft_consensus.cc:2749] T 2b74109013a140ada21feeef92d6f563 P 0473d2b2d01f4459b1e90fd12cc7840e [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:05:38.333967 22399 leader_election.cc:290] T b08304a0a02b42d7840c4e8ee9a6bd1a P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
W20260709 13:05:38.339921 19377 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.2:46257, user_credentials={real_user=slave}} blocked reactor thread for 78763.4us
I20260709 13:05:38.671590 19377 leader_election.cc:304] T 7be9efa6559648dbb5a0f7684c4542d1 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87; no voters: e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:05:38.340520 22504 raft_consensus.cc:2749] T b9f0d59553ad444883fcf5b5909f9798 P e5256d91808b47c195bc9b4dbd7f2b87 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:05:38.341208 22551 consensus_queue.cc:1059] T d1e5873a19244c5ebbcd38e126796ee7 P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:05:38.312624 22470 raft_consensus.cc:3055] T 172b3dd13109415a955b71ac0e9d2234 P 0473d2b2d01f4459b1e90fd12cc7840e [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:05:38.343269 22628 leader_election.cc:290] T 48824d5acfbc485ebf8c2d944e7202de P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:05:38.281644 22650 raft_consensus.cc:515] T 2725d2c4cb054f18b0fc8f735c15f6c2 P 0473d2b2d01f4459b1e90fd12cc7840e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:38.344520 19408 raft_consensus.cc:1275] T 46c5bfeecc314717bffe987e6844b6d0 P e5256d91808b47c195bc9b4dbd7f2b87 [term 13 FOLLOWER]: Refusing update from remote peer 0473d2b2d01f4459b1e90fd12cc7840e: Log matching property violated. Preceding OpId in replica: term: 9 index: 4. Preceding OpId from leader: term: 13 index: 5. (index mismatch)
I20260709 13:05:38.312114 22611 raft_consensus.cc:2749] T b9f0d59553ad444883fcf5b5909f9798 P 0473d2b2d01f4459b1e90fd12cc7840e [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:05:38.322402 22665 consensus_meta.cc:287] T 7f575b143b844aa096b50997dad3516a P 0473d2b2d01f4459b1e90fd12cc7840e: Time spent flushing consensus metadata: real 0.628s	user 0.009s	sys 0.002s
I20260709 13:05:38.308123 22640 raft_consensus.cc:697] T 179fd671030940b4b4a4e24bcc4aba0a P 0473d2b2d01f4459b1e90fd12cc7840e [term 8 LEADER]: Becoming Leader. State: Replica: 0473d2b2d01f4459b1e90fd12cc7840e, State: Running, Role: LEADER
I20260709 13:05:38.313016 22689 raft_consensus.cc:2804] T ab43d85f64114d4ebf618930e43d9ed0 P e5256d91808b47c195bc9b4dbd7f2b87 [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 13:05:38.366864 22381 consensus_meta.cc:287] T ab43d85f64114d4ebf618930e43d9ed0 P 0473d2b2d01f4459b1e90fd12cc7840e: Time spent flushing consensus metadata: real 0.568s	user 0.003s	sys 0.008s
W20260709 13:05:38.370796 22540 consensus_meta.cc:287] T 0e1085d23e8347fbbd5bce7542f4b1f4 P e61c3a8f61bb48f8a963c9480e53c168: Time spent flushing consensus metadata: real 0.649s	user 0.008s	sys 0.004s
W20260709 13:05:38.372326 22695 log.cc:927] Time spent T ece3db938bc649d4a40a51522ed5259c P e61c3a8f61bb48f8a963c9480e53c168: Append to log took a long time: real 0.124s	user 0.000s	sys 0.001s
I20260709 13:05:38.313128 22685 raft_consensus.cc:515] T 65d8cb8d6ec64f459d5a47cefab10acf P 127766fc592545a4997f7790f50f6076 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:05:38.354288 22693 raft_consensus.cc:493] T edd7d470b5014c9489be7f41f64355c9 P e5256d91808b47c195bc9b4dbd7f2b87 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:38.688653 22693 raft_consensus.cc:515] T edd7d470b5014c9489be7f41f64355c9 P e5256d91808b47c195bc9b4dbd7f2b87 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:38.689936 19556 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40438 (request call id 1955) took 1501 ms. Trace:
W20260709 13:05:38.376231 20077 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:05:38.691067 20077 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:05:38.691531 20077 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:38.692917 22685 leader_election.cc:290] T 65d8cb8d6ec64f459d5a47cefab10acf P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:05:38.400656 22676 leader_election.cc:290] T 22196caba61445d3bec98a0aab3c337d P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:05:38.693833 20110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "833a2f0775ed407a94b8924ce50adb63" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:05:38.694705 20110 raft_consensus.cc:2410] T 833a2f0775ed407a94b8924ce50adb63 P 127766fc592545a4997f7790f50f6076 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e61c3a8f61bb48f8a963c9480e53c168 for term 8 because replica has last-logged OpId of term: 7 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 7.
W20260709 13:05:38.419643 19449 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:38.696722 19450 leader_election.cc:400] T ef32ce6fdd0e40d382c79974f30295c6 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 8 pre-election: Vote denied by peer e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891) with higher term. Message: Invalid argument: T ef32ce6fdd0e40d382c79974f30295c6 P e61c3a8f61bb48f8a963c9480e53c168 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0473d2b2d01f4459b1e90fd12cc7840e for earlier term 8. Current term is 9.
I20260709 13:05:38.697002 19450 leader_election.cc:403] T ef32ce6fdd0e40d382c79974f30295c6 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 8 pre-election: Cancelling election due to peer responding with higher term
W20260709 13:05:38.435796 20078 leader_election.cc:336] T ed7fdbcb96d14d418db9ca90a792588a P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 5 election: RPC error from VoteRequest() call to peer 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257): Timed out: RequestConsensusVote RPC to 127.17.223.2:46257 timed out after 1.907s (SENT)
W20260709 13:05:38.560369 19526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.2:46257, user_credentials={real_user=slave}} blocked reactor thread for 265226us
I20260709 13:05:38.698357 20078 leader_election.cc:304] T ed7fdbcb96d14d418db9ca90a792588a P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 127766fc592545a4997f7790f50f6076; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:05:38.536144 19552 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41504 (request call id 430) took 1255 ms. Trace:
I20260709 13:05:38.698851 22703 consensus_queue.cc:1059] T 217b5fae677b4971b3bbd2f357a1f7ff P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:05:38.549981 22711 raft_consensus.cc:493] T 70797e5783b5454ab0d0eea663e791e3 P e61c3a8f61bb48f8a963c9480e53c168 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader e5256d91808b47c195bc9b4dbd7f2b87)
I20260709 13:05:38.700685 20103 raft_consensus.cc:1240] T 48824d5acfbc485ebf8c2d944e7202de P 127766fc592545a4997f7790f50f6076 [term 8 FOLLOWER]: Rejecting Update request from peer e61c3a8f61bb48f8a963c9480e53c168 for earlier term 7. Current term is 8. Ops: []
I20260709 13:05:38.701190 22527 raft_consensus.cc:3055] T 217b5fae677b4971b3bbd2f357a1f7ff P 0473d2b2d01f4459b1e90fd12cc7840e [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:05:38.701602 22527 raft_consensus.cc:740] T 217b5fae677b4971b3bbd2f357a1f7ff P 0473d2b2d01f4459b1e90fd12cc7840e [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 0473d2b2d01f4459b1e90fd12cc7840e, State: Running, Role: LEADER
I20260709 13:05:38.702193 20108 raft_consensus.cc:1275] T 7be9efa6559648dbb5a0f7684c4542d1 P 127766fc592545a4997f7790f50f6076 [term 7 LEARNER]: Refusing update from remote peer e61c3a8f61bb48f8a963c9480e53c168: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
W20260709 13:05:38.603179 22620 consensus_meta.cc:287] T 6c5eebf646ad445a9d1b1adc319d7b16 P e61c3a8f61bb48f8a963c9480e53c168: Time spent flushing consensus metadata: real 0.837s	user 0.012s	sys 0.000s
W20260709 13:05:38.590262 19294 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet ab43d85f64114d4ebf618930e43d9ed0 with cas_config_opid_index 5: ChangeConfig:REMOVE_PEER failed with leader e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica e61c3a8f61bb48f8a963c9480e53c168 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 6 committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } attrs { replace: true } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } } }
W20260709 13:05:38.622651 19525 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:38.583961 22111 consensus_queue.cc:1059] T 1efebf73c86e432baa55533136b6e12c P 127766fc592545a4997f7790f50f6076 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.014s
W20260709 13:05:38.639292 19524 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:38.659345 19551 raft_consensus.cc:2468] T 85c494af21f9457a85da47b9bc70c1fd P e61c3a8f61bb48f8a963c9480e53c168 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 127766fc592545a4997f7790f50f6076 in term 4.
I20260709 13:05:38.665338 22721 raft_consensus.cc:493] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P 127766fc592545a4997f7790f50f6076 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader e5256d91808b47c195bc9b4dbd7f2b87)
I20260709 13:05:38.667917 22612 raft_consensus.cc:493] T 2e36a9d6e29c4a7c860cf267efbd4c74 P 0473d2b2d01f4459b1e90fd12cc7840e [term 6 FOLLOWER]: Starting pre-election (detected failure of leader e5256d91808b47c195bc9b4dbd7f2b87)
I20260709 13:05:38.645186 22722 raft_consensus.cc:493] T 1f85fc4b527a48848e5faa083b604e36 P 0473d2b2d01f4459b1e90fd12cc7840e [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 127766fc592545a4997f7790f50f6076)
I20260709 13:05:38.673429 19377 leader_election.cc:304] T 217b5fae677b4971b3bbd2f357a1f7ff P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:05:38.669767 22699 raft_consensus.cc:493] T 86a6797bdfe94fa496c050ceae4bd0d9 P e5256d91808b47c195bc9b4dbd7f2b87 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:38.664582 22692 raft_consensus.cc:2749] T 86a6797bdfe94fa496c050ceae4bd0d9 P 0473d2b2d01f4459b1e90fd12cc7840e [term 8 FOLLOWER]: Leader election lost for term 7. Reason: Vote denied by peer e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891) with higher term. Message: Invalid argument: T 86a6797bdfe94fa496c050ceae4bd0d9 P e61c3a8f61bb48f8a963c9480e53c168 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 0473d2b2d01f4459b1e90fd12cc7840e for earlier term 7. Current term is 8.
I20260709 13:05:38.680595 22640 consensus_queue.cc:237] T 179fd671030940b4b4a4e24bcc4aba0a P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:38.676600 22443 raft_consensus.cc:2804] T 7be9efa6559648dbb5a0f7684c4542d1 P e5256d91808b47c195bc9b4dbd7f2b87 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:05:38.682857 22665 raft_consensus.cc:515] T 7f575b143b844aa096b50997dad3516a P 0473d2b2d01f4459b1e90fd12cc7840e [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:38.686786 22540 raft_consensus.cc:515] T 0e1085d23e8347fbbd5bce7542f4b1f4 P e61c3a8f61bb48f8a963c9480e53c168 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:05:38.320936 22526 consensus_queue.cc:1048] T 48824d5acfbc485ebf8c2d944e7202de P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Connected to new peer: Peer: permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.045s
I20260709 13:05:38.692880 20111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85c494af21f9457a85da47b9bc70c1fd" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
W20260709 13:05:38.741034 19375 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:38.699067 19406 raft_consensus.cc:1275] T edd7d470b5014c9489be7f41f64355c9 P e5256d91808b47c195bc9b4dbd7f2b87 [term 8 FOLLOWER]: Refusing update from remote peer 0473d2b2d01f4459b1e90fd12cc7840e: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 8 index: 4. (index mismatch)
I20260709 13:05:38.699885 20109 raft_consensus.cc:1240] T ab43d85f64114d4ebf618930e43d9ed0 P 127766fc592545a4997f7790f50f6076 [term 6 FOLLOWER]: Rejecting Update request from peer e61c3a8f61bb48f8a963c9480e53c168 for earlier term 5. Current term is 6. Ops: []
I20260709 13:05:38.700338 22711 raft_consensus.cc:515] T 70797e5783b5454ab0d0eea663e791e3 P e61c3a8f61bb48f8a963c9480e53c168 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
W20260709 13:05:38.745132 19377 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.2:46257, user_credentials={real_user=slave}} blocked reactor thread for 71771.5us
I20260709 13:05:38.745262 22711 leader_election.cc:290] T 70797e5783b5454ab0d0eea663e791e3 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:05:38.745905 19377 leader_election.cc:304] T 775c229504194560ba9589bc2199b089 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, 127766fc592545a4997f7790f50f6076
I20260709 13:05:38.745985 19560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b08304a0a02b42d7840c4e8ee9a6bd1a" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
W20260709 13:05:38.575134 20076 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.3:36891, user_credentials={real_user=slave}} blocked reactor thread for 174694us
I20260709 13:05:38.746687 19560 raft_consensus.cc:2468] T b08304a0a02b42d7840c4e8ee9a6bd1a P e61c3a8f61bb48f8a963c9480e53c168 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 9.
I20260709 13:05:38.747210 22693 leader_election.cc:290] T edd7d470b5014c9489be7f41f64355c9 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
W20260709 13:05:38.747432 20076 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:38.748678 19407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85c494af21f9457a85da47b9bc70c1fd" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
W20260709 13:05:38.610409 22688 log.cc:927] Time spent T 4509b76741dc428e9201c70c1658da13 P e5256d91808b47c195bc9b4dbd7f2b87: Append to log took a long time: real 0.365s	user 0.000s	sys 0.002s
I20260709 13:05:38.675180 22470 raft_consensus.cc:740] T 172b3dd13109415a955b71ac0e9d2234 P 0473d2b2d01f4459b1e90fd12cc7840e [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 0473d2b2d01f4459b1e90fd12cc7840e, State: Running, Role: LEADER
I20260709 13:05:38.546348 22701 raft_consensus.cc:697] T 86a6797bdfe94fa496c050ceae4bd0d9 P e61c3a8f61bb48f8a963c9480e53c168 [term 8 LEADER]: Becoming Leader. State: Replica: e61c3a8f61bb48f8a963c9480e53c168, State: Running, Role: LEADER
I20260709 13:05:38.603567 19403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85c494af21f9457a85da47b9bc70c1fd" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:05:38.690434 19556 rpcz_store.cc:276] 0709 13:05:37.188556 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:37.200034 (+ 11478us) service_pool.cc:224] Handling call
0709 13:05:37.277807 (+ 77773us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:05:37.278211 (+   404us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:05:37.278239 (+    28us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:05:37.278826 (+   587us) log.cc:844] Serialized 52 byte log entry
0709 13:05:37.368297 (+ 89471us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:05:37.368357 (+    60us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:37.368451 (+    94us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:05:38.173126 (+804675us) raft_consensus.cc:1685] finished
0709 13:05:38.173145 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:38.689588 (+516443us) spinlock_profiling.cc:243] Waited 67.2 ms on lock 0x7b5400342950. stack: 00007f4a79de9343 00007f4a79de9240 00007f4a797781d4 00007f4a834b6304 00007f4a834b6299 00007f4a7ce71571 00007f4a7cf078ad 00007f4a81ecc419 00007f4a7b443bd4 00007f4a7b443b62 00007f4a7b443a91 00007f4a7b443a0c 00007f4a7b442cc2 00007f4a7b24348c 00007f4a7b2428c6 00007f4a7b24226f
0709 13:05:38.689857 (+   269us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":660,"raft.run_cpu_time_us":77,"raft.run_wall_time_us":77,"spinlock_wait_cycles":154668928,"thread_start_us":89039,"threads_started":1,"wal-append.queue_time_us":220788}
I20260709 13:05:38.708168 21926 consensus_queue.cc:1048] T ef32ce6fdd0e40d382c79974f30295c6 P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:05:38.760113 19560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22196caba61445d3bec98a0aab3c337d" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:05:38.711962 19559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46c5bfeecc314717bffe987e6844b6d0" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 14 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:05:38.761409 19559 raft_consensus.cc:2468] T 46c5bfeecc314717bffe987e6844b6d0 P e61c3a8f61bb48f8a963c9480e53c168 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 13.
W20260709 13:05:38.712775 19294 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.ChangeConfig -> {remote=127.17.223.3:36891, user_credentials={real_user=slave}} blocked reactor thread for 125397us
I20260709 13:05:38.702373 22527 consensus_queue.cc:260] T 217b5fae677b4971b3bbd2f357a1f7ff P 0473d2b2d01f4459b1e90fd12cc7840e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
W20260709 13:05:38.715147 19451 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:38.719729 19450 leader_election.cc:304] T f1b10566f45d4a7d9029858330e02d5b P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e; no voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:05:38.683957 22374 raft_consensus.cc:2749] T 1a61655d99124a29b486ba4a5b37faea P e5256d91808b47c195bc9b4dbd7f2b87 [term 6 LEADER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:05:38.683298 22689 raft_consensus.cc:493] T ab43d85f64114d4ebf618930e43d9ed0 P e5256d91808b47c195bc9b4dbd7f2b87 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:05:38.721478 20078 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.2:46257, user_credentials={real_user=slave}} blocked reactor thread for 285734us
I20260709 13:05:38.669925 22174 raft_consensus.cc:515] T 96efeaaf1057492490e9a621f37e1a2d P 127766fc592545a4997f7790f50f6076 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:05:38.699908 22703 raft_consensus.cc:2749] T ef32ce6fdd0e40d382c79974f30295c6 P 0473d2b2d01f4459b1e90fd12cc7840e [term 9 FOLLOWER]: Leader pre-election lost for term 8. Reason: Vote denied by peer e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891) with higher term. Message: Invalid argument: T ef32ce6fdd0e40d382c79974f30295c6 P e61c3a8f61bb48f8a963c9480e53c168 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0473d2b2d01f4459b1e90fd12cc7840e for earlier term 8. Current term is 9.
I20260709 13:05:38.718454 22628 raft_consensus.cc:493] T f1b10566f45d4a7d9029858330e02d5b P e61c3a8f61bb48f8a963c9480e53c168 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader e5256d91808b47c195bc9b4dbd7f2b87)
I20260709 13:05:38.722435 22551 raft_consensus.cc:493] T 2e36a9d6e29c4a7c860cf267efbd4c74 P e61c3a8f61bb48f8a963c9480e53c168 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader e5256d91808b47c195bc9b4dbd7f2b87)
I20260709 13:05:38.718568 22662 consensus_queue.cc:1048] T 46c5bfeecc314717bffe987e6844b6d0 P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.028s
I20260709 13:05:38.741207 20111 raft_consensus.cc:2468] T 85c494af21f9457a85da47b9bc70c1fd P 127766fc592545a4997f7790f50f6076 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 4.
I20260709 13:05:38.755934 19557 raft_consensus.cc:1275] T df751f992649444090e27965eb1af85d P e61c3a8f61bb48f8a963c9480e53c168 [term 9 FOLLOWER]: Refusing update from remote peer e5256d91808b47c195bc9b4dbd7f2b87: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:05:38.760910 19560 raft_consensus.cc:2468] T 22196caba61445d3bec98a0aab3c337d P e61c3a8f61bb48f8a963c9480e53c168 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 7.
W20260709 13:05:38.762373 20075 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.1:40321, user_credentials={real_user=slave}} blocked reactor thread for 95859.1us
I20260709 13:05:38.762526 19404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "833a2f0775ed407a94b8924ce50adb63" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:05:38.730448 22612 raft_consensus.cc:515] T 2e36a9d6e29c4a7c860cf267efbd4c74 P 0473d2b2d01f4459b1e90fd12cc7840e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:38.763654 19405 raft_consensus.cc:1240] T f93ee515a9c14139bf566522ed8232f3 P e5256d91808b47c195bc9b4dbd7f2b87 [term 10 FOLLOWER]: Rejecting Update request from peer e61c3a8f61bb48f8a963c9480e53c168 for earlier term 9. Current term is 10. Ops: []
I20260709 13:05:38.782213 19377 leader_election.cc:304] T 4509b76741dc428e9201c70c1658da13 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:05:38.734159 22685 raft_consensus.cc:2749] T ed7fdbcb96d14d418db9ca90a792588a P 127766fc592545a4997f7790f50f6076 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:05:38.724283 22699 raft_consensus.cc:3060] T 86a6797bdfe94fa496c050ceae4bd0d9 P e5256d91808b47c195bc9b4dbd7f2b87 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:05:38.769102 19483 raft_consensus.cc:2393] T 7f575b143b844aa096b50997dad3516a P 0473d2b2d01f4459b1e90fd12cc7840e [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e5256d91808b47c195bc9b4dbd7f2b87 in current term 4: Already voted for candidate 0473d2b2d01f4459b1e90fd12cc7840e in this term.
I20260709 13:05:38.685912 22381 raft_consensus.cc:515] T ab43d85f64114d4ebf618930e43d9ed0 P 0473d2b2d01f4459b1e90fd12cc7840e [term 7 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } attrs { replace: true } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:05:38.770439 19410 raft_consensus.cc:1275] T b9f0d59553ad444883fcf5b5909f9798 P e5256d91808b47c195bc9b4dbd7f2b87 [term 8 FOLLOWER]: Refusing update from remote peer e61c3a8f61bb48f8a963c9480e53c168: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 5. (term mismatch)
I20260709 13:05:38.769992 19407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46c5bfeecc314717bffe987e6844b6d0" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 14 candidate_status { last_received { term: 12 index: 5 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
W20260709 13:05:38.771458 19450 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.3:36891, user_credentials={real_user=slave}} blocked reactor thread for 51825.5us
I20260709 13:05:38.770977 19553 raft_consensus.cc:1240] T 0e1085d23e8347fbbd5bce7542f4b1f4 P e61c3a8f61bb48f8a963c9480e53c168 [term 6 FOLLOWER]: Rejecting Update request from peer 127766fc592545a4997f7790f50f6076 for earlier term 4. Current term is 6. Ops: []
I20260709 13:05:38.771171 19408 raft_consensus.cc:1240] T 179fd671030940b4b4a4e24bcc4aba0a P e5256d91808b47c195bc9b4dbd7f2b87 [term 8 FOLLOWER]: Rejecting Update request from peer e61c3a8f61bb48f8a963c9480e53c168 for earlier term 6. Current term is 8. Ops: []
I20260709 13:05:38.794476 19407 raft_consensus.cc:2468] T 46c5bfeecc314717bffe987e6844b6d0 P e5256d91808b47c195bc9b4dbd7f2b87 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 13.
I20260709 13:05:38.794798 19450 leader_election.cc:304] T 3e1f505cb0f1427bbd698ac889d80821 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e; no voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168
W20260709 13:05:38.772806 20078 leader_election.cc:336] T 62c6c134d3d24a1ab144dd9ee6bc3f64 P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257): Timed out: RequestConsensusVote RPC to 127.17.223.2:46257 timed out after 2.112s (SENT)
I20260709 13:05:38.738657 22443 raft_consensus.cc:493] T 7be9efa6559648dbb5a0f7684c4542d1 P e5256d91808b47c195bc9b4dbd7f2b87 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:38.775465 19403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86a6797bdfe94fa496c050ceae4bd0d9" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:05:38.713277 22620 raft_consensus.cc:515] T 6c5eebf646ad445a9d1b1adc319d7b16 P e61c3a8f61bb48f8a963c9480e53c168 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:05:38.743103 22682 raft_consensus.cc:3060] T f1b10566f45d4a7d9029858330e02d5b P e5256d91808b47c195bc9b4dbd7f2b87 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:05:38.754226 22399 raft_consensus.cc:2749] T 217b5fae677b4971b3bbd2f357a1f7ff P e5256d91808b47c195bc9b4dbd7f2b87 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:05:38.699021 19552 rpcz_store.cc:276] 0709 13:05:37.281225 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:37.326488 (+ 45263us) service_pool.cc:224] Handling call
0709 13:05:37.485972 (+159484us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:37.582446 (+ 96474us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:38.535841 (+953395us) spinlock_profiling.cc:243] Waited 159 ms on lock 0x7b5400124650. stack: 00007f4a79de9343 00007f4a79de9240 00007f4a797781d4 00007f4a834b6304 00007f4a834b6299 00007f4a7ce71571 00007f4a7cf078ad 00007f4a81ecc419 00007f4a7b443bd4 00007f4a7b443b62 00007f4a7b443a91 00007f4a7b443a0c 00007f4a7b442cc2 00007f4a7b24348c 00007f4a7b2428c6 00007f4a7b24226f
0709 13:05:38.536064 (+   223us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":366098304}
I20260709 13:05:38.764245 22705 raft_consensus.cc:2749] T 775c229504194560ba9589bc2199b089 P e5256d91808b47c195bc9b4dbd7f2b87 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:05:38.719775 22721 raft_consensus.cc:515] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P 127766fc592545a4997f7790f50f6076 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:05:38.786654 19404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40e1e16737a842ee936002830f36882e" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:05:38.794157 19410 pending_rounds.cc:85] T b9f0d59553ad444883fcf5b5909f9798 P e5256d91808b47c195bc9b4dbd7f2b87: Aborting all ops after (but not including) 4
I20260709 13:05:38.798883 19555 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40438 (request call id 1968) took 1194 ms. Trace:
W20260709 13:05:38.787189 20075 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:38.773623 22689 raft_consensus.cc:3060] T ab43d85f64114d4ebf618930e43d9ed0 P e5256d91808b47c195bc9b4dbd7f2b87 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:05:38.805029 19404 raft_consensus.cc:2410] T 40e1e16737a842ee936002830f36882e P e5256d91808b47c195bc9b4dbd7f2b87 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e61c3a8f61bb48f8a963c9480e53c168 for term 10 because replica has last-logged OpId of term: 9 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 5.
I20260709 13:05:38.804870 19405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa8650e71aa14778b3d73721fc50d9fc" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:05:38.801698 19555 rpcz_store.cc:276] 0709 13:05:37.604570 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:37.606018 (+  1448us) service_pool.cc:224] Handling call
0709 13:05:37.629425 (+ 23407us) raft_consensus.cc:1471] Updating replica for 3 ops
0709 13:05:37.629863 (+   438us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:05:37.629892 (+    29us) raft_consensus.cc:1539] Triggering prepare for 3 ops
0709 13:05:37.630551 (+   659us) log.cc:844] Serialized 78 byte log entry
0709 13:05:37.948761 (+318210us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:05:38.270492 (+321731us) log.cc:844] Serialized 14 byte log entry
0709 13:05:38.273310 (+  2818us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:38.274217 (+   907us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:05:38.798523 (+524306us) raft_consensus.cc:1685] finished
0709 13:05:38.798554 (+    31us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:38.798797 (+   243us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":300304,"prepare.run_cpu_time_us":47,"prepare.run_wall_time_us":48,"raft.queue_time_us":43480,"raft.run_cpu_time_us":216,"raft.run_wall_time_us":8133,"spinlock_wait_cycles":1922304,"thread_start_us":495115,"threads_started":2,"wal-append.queue_time_us":454481}
I20260709 13:05:38.805950 19404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40e1e16737a842ee936002830f36882e" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
I20260709 13:05:38.806636 19404 raft_consensus.cc:2410] T 40e1e16737a842ee936002830f36882e P e5256d91808b47c195bc9b4dbd7f2b87 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate e61c3a8f61bb48f8a963c9480e53c168 for term 10 because replica has last-logged OpId of term: 9 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 5.
I20260709 13:05:38.812587 19450 leader_election.cc:304] T 1efebf73c86e432baa55533136b6e12c P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168; no voters: 127766fc592545a4997f7790f50f6076
I20260709 13:05:38.806878 19410 pending_rounds.cc:107] T b9f0d59553ad444883fcf5b5909f9798 P e5256d91808b47c195bc9b4dbd7f2b87: Aborting uncommitted NO_OP operation due to leader change: 7.5
I20260709 13:05:38.820217 19410 raft_consensus.cc:2889] T b9f0d59553ad444883fcf5b5909f9798 P e5256d91808b47c195bc9b4dbd7f2b87 [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:05:38.824679 19408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65d8cb8d6ec64f459d5a47cefab10acf" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:05:38.827536 22701 consensus_queue.cc:237] T 86a6797bdfe94fa496c050ceae4bd0d9 P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 6.3, Last appended by leader: 3, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:38.828141 20106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1efebf73c86e432baa55533136b6e12c" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:05:38.825739 22470 consensus_queue.cc:260] T 172b3dd13109415a955b71ac0e9d2234 P 0473d2b2d01f4459b1e90fd12cc7840e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:05:38.830348 22470 raft_consensus.cc:3060] T 172b3dd13109415a955b71ac0e9d2234 P 0473d2b2d01f4459b1e90fd12cc7840e [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:05:38.793316 21957 raft_consensus.cc:2749] T 4509b76741dc428e9201c70c1658da13 P e5256d91808b47c195bc9b4dbd7f2b87 [term 4 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:05:38.833698 19402 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52342 (request call id 2153) took 1342 ms. Trace:
I20260709 13:05:38.836140 19377 leader_election.cc:304] T ff75a1d4cb1f493db8f71ddc136ba9ab P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87; no voters: e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:05:38.730688 22722 raft_consensus.cc:515] T 1f85fc4b527a48848e5faa083b604e36 P 0473d2b2d01f4459b1e90fd12cc7840e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:05:38.793406 22624 raft_consensus.cc:493] T 2725d2c4cb054f18b0fc8f735c15f6c2 P e61c3a8f61bb48f8a963c9480e53c168 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader e5256d91808b47c195bc9b4dbd7f2b87)
I20260709 13:05:38.783562 22628 raft_consensus.cc:515] T f1b10566f45d4a7d9029858330e02d5b P e61c3a8f61bb48f8a963c9480e53c168 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:38.798274 22443 raft_consensus.cc:3060] T 7be9efa6559648dbb5a0f7684c4542d1 P e5256d91808b47c195bc9b4dbd7f2b87 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:05:38.801112 22655 raft_consensus.cc:2749] T f1b10566f45d4a7d9029858330e02d5b P 0473d2b2d01f4459b1e90fd12cc7840e [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:05:38.803340 22703 raft_consensus.cc:2749] T 3e1f505cb0f1427bbd698ac889d80821 P 0473d2b2d01f4459b1e90fd12cc7840e [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:05:38.852312 19405 raft_consensus.cc:1240] T ff75a1d4cb1f493db8f71ddc136ba9ab P e5256d91808b47c195bc9b4dbd7f2b87 [term 7 FOLLOWER]: Rejecting Update request from peer e61c3a8f61bb48f8a963c9480e53c168 for earlier term 6. Current term is 7. Ops: []
I20260709 13:05:38.834128 19402 rpcz_store.cc:276] 0709 13:05:37.491418 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:37.515234 (+ 23816us) service_pool.cc:224] Handling call
0709 13:05:37.531546 (+ 16312us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:05:37.531822 (+   276us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:05:37.531857 (+    35us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:05:37.540562 (+  8705us) log.cc:844] Serialized 26 byte log entry
0709 13:05:37.797997 (+257435us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:05:37.798047 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:37.798138 (+    91us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:05:38.609900 (+811762us) spinlock_profiling.cc:243] Waited 3.52 ms on lock 0x7b4400022b4c. stack: 00007f4a79de9343 00007f4a79de9240 00007f4a797781d4 00007f4a834b6304 00007f4a834b6299 00007f4a79ca3db1 00007f4a79d41c85 00007f4a79d426a2 00007f4a7cab41db 00007f4a7caafaaf 00007f4a7caa386e 00007f4a7caa2bb6 00007f4a7caa27d8 00007f4a7caac221 00007f4a7caac1d9 00007f4a7caac169
0709 13:05:38.833382 (+223482us) raft_consensus.cc:1685] finished
0709 13:05:38.833407 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:38.833634 (+   227us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":8102144,"thread_start_us":190898,"threads_started":1,"wal-append.queue_time_us":664627}
I20260709 13:05:38.784587 22551 raft_consensus.cc:515] T 2e36a9d6e29c4a7c860cf267efbd4c74 P e61c3a8f61bb48f8a963c9480e53c168 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:38.825165 22527 raft_consensus.cc:3060] T 217b5fae677b4971b3bbd2f357a1f7ff P 0473d2b2d01f4459b1e90fd12cc7840e [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:05:38.786204 22658 consensus_queue.cc:1048] T 46c5bfeecc314717bffe987e6844b6d0 P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.051s
I20260709 13:05:38.858131 19551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65d8cb8d6ec64f459d5a47cefab10acf" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:05:38.830341 22710 raft_consensus.cc:2804] T 1efebf73c86e432baa55533136b6e12c P 0473d2b2d01f4459b1e90fd12cc7840e [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:05:38.862026 19551 raft_consensus.cc:2468] T 65d8cb8d6ec64f459d5a47cefab10acf P e61c3a8f61bb48f8a963c9480e53c168 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 127766fc592545a4997f7790f50f6076 in term 4.
I20260709 13:05:38.859503 22663 raft_consensus.cc:2804] T ff75a1d4cb1f493db8f71ddc136ba9ab P e5256d91808b47c195bc9b4dbd7f2b87 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:05:38.873306 19410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a61655d99124a29b486ba4a5b37faea" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:05:38.875128 22174 leader_election.cc:290] T 96efeaaf1057492490e9a621f37e1a2d P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:05:38.879966 22551 leader_election.cc:290] T 2e36a9d6e29c4a7c860cf267efbd4c74 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:05:38.883960 22628 leader_election.cc:290] T f1b10566f45d4a7d9029858330e02d5b P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:05:38.884752 19402 raft_consensus.cc:1240] T d1e5873a19244c5ebbcd38e126796ee7 P e5256d91808b47c195bc9b4dbd7f2b87 [term 10 FOLLOWER]: Rejecting Update request from peer e61c3a8f61bb48f8a963c9480e53c168 for earlier term 9. Current term is 10. Ops: []
I20260709 13:05:38.886758 22650 leader_election.cc:290] T 2725d2c4cb054f18b0fc8f735c15f6c2 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:05:38.887814 22620 leader_election.cc:290] T 6c5eebf646ad445a9d1b1adc319d7b16 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 6 election: Requested vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:05:38.888549 22665 leader_election.cc:290] T 7f575b143b844aa096b50997dad3516a P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 4 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:05:38.890281 22443 raft_consensus.cc:515] T 7be9efa6559648dbb5a0f7684c4542d1 P e5256d91808b47c195bc9b4dbd7f2b87 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } attrs { replace: true } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: NON_VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: true } }
I20260709 13:05:38.850229 22730 raft_consensus.cc:493] T fa731b585f684a7fb2d106c50f143b83 P 127766fc592545a4997f7790f50f6076 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader e5256d91808b47c195bc9b4dbd7f2b87)
I20260709 13:05:38.874089 22710 raft_consensus.cc:697] T 1efebf73c86e432baa55533136b6e12c P 0473d2b2d01f4459b1e90fd12cc7840e [term 6 LEADER]: Becoming Leader. State: Replica: 0473d2b2d01f4459b1e90fd12cc7840e, State: Running, Role: LEADER
I20260709 13:05:38.852451 22706 consensus_queue.cc:1048] T edd7d470b5014c9489be7f41f64355c9 P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.044s
I20260709 13:05:38.894696 22663 raft_consensus.cc:493] T ff75a1d4cb1f493db8f71ddc136ba9ab P e5256d91808b47c195bc9b4dbd7f2b87 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:38.855468 22624 raft_consensus.cc:515] T 2725d2c4cb054f18b0fc8f735c15f6c2 P e61c3a8f61bb48f8a963c9480e53c168 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:38.909915 19407 raft_consensus.cc:1240] T 7be9efa6559648dbb5a0f7684c4542d1 P e5256d91808b47c195bc9b4dbd7f2b87 [term 9 FOLLOWER]: Rejecting Update request from peer e61c3a8f61bb48f8a963c9480e53c168 for earlier term 7. Current term is 9. Ops: []
I20260709 13:05:38.913161 19410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e381f1d6b8184797ad142de49be225a8" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
I20260709 13:05:38.916941 19402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22196caba61445d3bec98a0aab3c337d" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
W20260709 13:05:38.918730 19449 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.1:40321, user_credentials={real_user=slave}} blocked reactor thread for 201671us
I20260709 13:05:38.921290 22540 leader_election.cc:290] T 0e1085d23e8347fbbd5bce7542f4b1f4 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 6 election: Requested vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:05:38.914609 22663 raft_consensus.cc:3060] T ff75a1d4cb1f493db8f71ddc136ba9ab P e5256d91808b47c195bc9b4dbd7f2b87 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:05:38.904731 22174 consensus_queue.cc:1059] T 6c5eebf646ad445a9d1b1adc319d7b16 P 127766fc592545a4997f7790f50f6076 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.016s
I20260709 13:05:38.922142 22702 raft_consensus.cc:3055] T e381f1d6b8184797ad142de49be225a8 P 0473d2b2d01f4459b1e90fd12cc7840e [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:05:38.929760 19405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2725d2c4cb054f18b0fc8f735c15f6c2" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:05:38.935475 22704 raft_consensus.cc:493] T 40e1e16737a842ee936002830f36882e P e5256d91808b47c195bc9b4dbd7f2b87 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:38.935770 19484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48824d5acfbc485ebf8c2d944e7202de" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:05:38.935532 19486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "309c3ca0ca4b4f3ba129752ea2cb293b" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:05:38.937463 19410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a16f7501e2444fb86d4e2778e734e02" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
W20260709 13:05:38.940891 20078 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.2:46257, user_credentials={real_user=slave}} blocked reactor thread for 143046us
I20260709 13:05:38.943703 19477 raft_consensus.cc:1240] T f93ee515a9c14139bf566522ed8232f3 P 0473d2b2d01f4459b1e90fd12cc7840e [term 10 FOLLOWER]: Rejecting Update request from peer e61c3a8f61bb48f8a963c9480e53c168 for earlier term 9. Current term is 10. Ops: []
I20260709 13:05:38.945714 20103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab43d85f64114d4ebf618930e43d9ed0" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076"
I20260709 13:05:38.946321 20103 raft_consensus.cc:3060] T ab43d85f64114d4ebf618930e43d9ed0 P 127766fc592545a4997f7790f50f6076 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:05:38.946393 19481 raft_consensus.cc:1240] T d1e5873a19244c5ebbcd38e126796ee7 P 0473d2b2d01f4459b1e90fd12cc7840e [term 10 FOLLOWER]: Rejecting Update request from peer e61c3a8f61bb48f8a963c9480e53c168 for earlier term 9. Current term is 10. Ops: [9.5-9.5]
I20260709 13:05:38.916836 22699 raft_consensus.cc:515] T 86a6797bdfe94fa496c050ceae4bd0d9 P e5256d91808b47c195bc9b4dbd7f2b87 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:38.951475 19408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86a6797bdfe94fa496c050ceae4bd0d9" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
I20260709 13:05:38.954071 19484 raft_consensus.cc:1240] T ed7fdbcb96d14d418db9ca90a792588a P 0473d2b2d01f4459b1e90fd12cc7840e [term 5 FOLLOWER]: Rejecting Update request from peer e61c3a8f61bb48f8a963c9480e53c168 for earlier term 4. Current term is 5. Ops: []
I20260709 13:05:38.933959 22702 raft_consensus.cc:740] T e381f1d6b8184797ad142de49be225a8 P 0473d2b2d01f4459b1e90fd12cc7840e [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 0473d2b2d01f4459b1e90fd12cc7840e, State: Running, Role: LEADER
I20260709 13:05:38.911288 22730 raft_consensus.cc:515] T fa731b585f684a7fb2d106c50f143b83 P 127766fc592545a4997f7790f50f6076 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:05:38.956408 19402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36f6ba92b9ba46babe4ebd6c02e5fbd9" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:05:38.958549 19477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e36a9d6e29c4a7c860cf267efbd4c74" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:05:38.972668 19477 raft_consensus.cc:2468] T 2e36a9d6e29c4a7c860cf267efbd4c74 P 0473d2b2d01f4459b1e90fd12cc7840e [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 6.
I20260709 13:05:38.936288 22704 raft_consensus.cc:515] T 40e1e16737a842ee936002830f36882e P e5256d91808b47c195bc9b4dbd7f2b87 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:38.961220 19404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e36a9d6e29c4a7c860cf267efbd4c74" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:05:38.988718 19526 leader_election.cc:304] T 2e36a9d6e29c4a7c860cf267efbd4c74 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:05:38.943703 22727 raft_consensus.cc:493] T 2a16f7501e2444fb86d4e2778e734e02 P 127766fc592545a4997f7790f50f6076 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader e5256d91808b47c195bc9b4dbd7f2b87)
I20260709 13:05:38.943598 22111 raft_consensus.cc:493] T 4af19371ea874c09a0a2147040835cbb P 127766fc592545a4997f7790f50f6076 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader e5256d91808b47c195bc9b4dbd7f2b87)
I20260709 13:05:38.964596 22711 raft_consensus.cc:493] T a08760e15aac4630a629431f56024dc8 P e61c3a8f61bb48f8a963c9480e53c168 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:38.964748 19410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f575b143b844aa096b50997dad3516a" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
I20260709 13:05:38.990816 20103 raft_consensus.cc:2468] T ab43d85f64114d4ebf618930e43d9ed0 P 127766fc592545a4997f7790f50f6076 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 7.
I20260709 13:05:38.991111 19410 raft_consensus.cc:3060] T 7f575b143b844aa096b50997dad3516a P e5256d91808b47c195bc9b4dbd7f2b87 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:05:38.965334 19479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e1085d23e8347fbbd5bce7542f4b1f4" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:05:38.991936 19479 raft_consensus.cc:3060] T 0e1085d23e8347fbbd5bce7542f4b1f4 P 0473d2b2d01f4459b1e90fd12cc7840e [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:05:38.966856 19481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c5eebf646ad445a9d1b1adc319d7b16" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:05:38.993170 19481 raft_consensus.cc:3060] T 6c5eebf646ad445a9d1b1adc319d7b16 P 0473d2b2d01f4459b1e90fd12cc7840e [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:05:38.969172 22701 consensus_queue.cc:1059] T f93ee515a9c14139bf566522ed8232f3 P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:05:38.970225 22620 consensus_queue.cc:1059] T d1e5873a19244c5ebbcd38e126796ee7 P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:05:38.969185 22721 leader_election.cc:290] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:05:38.996439 22745 raft_consensus.cc:493] T ff9b0eddd810459b82d91c60777c10eb P 127766fc592545a4997f7790f50f6076 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader e5256d91808b47c195bc9b4dbd7f2b87)
I20260709 13:05:38.987687 19402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "217b5fae677b4971b3bbd2f357a1f7ff" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
I20260709 13:05:38.998802 19482 raft_consensus.cc:1240] T 179fd671030940b4b4a4e24bcc4aba0a P 0473d2b2d01f4459b1e90fd12cc7840e [term 8 LEADER]: Rejecting Update request from peer e61c3a8f61bb48f8a963c9480e53c168 for earlier term 6. Current term is 8. Ops: []
I20260709 13:05:39.005149 19408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e36a9d6e29c4a7c860cf267efbd4c74" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
W20260709 13:05:39.029619 19450 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.3:36891, user_credentials={real_user=slave}} blocked reactor thread for 205440us
I20260709 13:05:39.043550 19403 raft_consensus.cc:2393] T 86a6797bdfe94fa496c050ceae4bd0d9 P e5256d91808b47c195bc9b4dbd7f2b87 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e61c3a8f61bb48f8a963c9480e53c168 in current term 8: Already voted for candidate e5256d91808b47c195bc9b4dbd7f2b87 in this term.
I20260709 13:05:39.021697 19481 raft_consensus.cc:2468] T 6c5eebf646ad445a9d1b1adc319d7b16 P 0473d2b2d01f4459b1e90fd12cc7840e [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 6.
I20260709 13:05:39.045583 19526 leader_election.cc:304] T 6c5eebf646ad445a9d1b1adc319d7b16 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:05:39.014398 19404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70797e5783b5454ab0d0eea663e791e3" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:05:39.047159 18300 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:05:39.048529 19450 leader_election.cc:304] T bc225c93219c45538b53a1bd3d387e4d P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e; no voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:05:39.050194 19450 leader_election.cc:304] T 76cb037fc9064d13b59a8969d897ce8c P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e; no voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:05:39.050925 22655 raft_consensus.cc:2749] T 76cb037fc9064d13b59a8969d897ce8c P 0473d2b2d01f4459b1e90fd12cc7840e [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 13:05:39.051949 20076 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.3:36891, user_credentials={real_user=slave}} blocked reactor thread for 111596us
I20260709 13:05:39.054631 20076 leader_election.cc:304] T 62c6c134d3d24a1ab144dd9ee6bc3f64 P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 127766fc592545a4997f7790f50f6076; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:05:39.056761 19450 leader_election.cc:304] T 7be9efa6559648dbb5a0f7684c4542d1 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e; no voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:05:39.058208 19402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f85fc4b527a48848e5faa083b604e36" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:05:39.059226 19405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1b10566f45d4a7d9029858330e02d5b" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:05:39.059875 19405 raft_consensus.cc:2468] T f1b10566f45d4a7d9029858330e02d5b P e5256d91808b47c195bc9b4dbd7f2b87 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 9.
I20260709 13:05:39.014683 19484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1b10566f45d4a7d9029858330e02d5b" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:05:39.066483 19484 raft_consensus.cc:2393] T f1b10566f45d4a7d9029858330e02d5b P 0473d2b2d01f4459b1e90fd12cc7840e [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e61c3a8f61bb48f8a963c9480e53c168 in current term 9: Already voted for candidate 0473d2b2d01f4459b1e90fd12cc7840e in this term.
I20260709 13:05:39.085822 20076 leader_election.cc:304] T 833a2f0775ed407a94b8924ce50adb63 P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 127766fc592545a4997f7790f50f6076; no voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:05:39.141511 19477 raft_consensus.cc:1275] T 40e1e16737a842ee936002830f36882e P 0473d2b2d01f4459b1e90fd12cc7840e [term 10 FOLLOWER]: Refusing update from remote peer e61c3a8f61bb48f8a963c9480e53c168: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:05:39.142887 19481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2725d2c4cb054f18b0fc8f735c15f6c2" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:05:39.143739 19481 raft_consensus.cc:2468] T 2725d2c4cb054f18b0fc8f735c15f6c2 P 0473d2b2d01f4459b1e90fd12cc7840e [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 8.
I20260709 13:05:39.056945 19375 leader_election.cc:304] T b08304a0a02b42d7840c4e8ee9a6bd1a P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
W20260709 13:05:39.145242 20076 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.3:36891, user_credentials={real_user=slave}} blocked reactor thread for 59531.2us
W20260709 13:05:39.145830 19375 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.3:36891, user_credentials={real_user=slave}} blocked reactor thread for 88990.4us
I20260709 13:05:39.146200 20076 leader_election.cc:304] T ece3db938bc649d4a40a51522ed5259c P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 127766fc592545a4997f7790f50f6076; no voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:05:39.147521 20076 leader_election.cc:304] T 85c494af21f9457a85da47b9bc70c1fd P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 127766fc592545a4997f7790f50f6076, e61c3a8f61bb48f8a963c9480e53c168; no voters: e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:05:39.148032 19404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab43d85f64114d4ebf618930e43d9ed0" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
I20260709 13:05:39.151870 19405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14935b3ddf914369822e4a0547aaa355" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 7 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:05:39.155059 19408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "309c3ca0ca4b4f3ba129752ea2cb293b" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:05:39.157500 19526 leader_election.cc:304] T 2725d2c4cb054f18b0fc8f735c15f6c2 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:05:39.044668 22682 raft_consensus.cc:493] T f93ee515a9c14139bf566522ed8232f3 P e5256d91808b47c195bc9b4dbd7f2b87 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:39.043382 22712 raft_consensus.cc:2804] T 2e36a9d6e29c4a7c860cf267efbd4c74 P e61c3a8f61bb48f8a963c9480e53c168 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:05:38.990958 22628 consensus_queue.cc:1059] T ed7fdbcb96d14d418db9ca90a792588a P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.154s
W20260709 13:05:39.171308 19480 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58294 (request call id 1869) took 1924 ms (client timeout 1599 ms). Trace:
I20260709 13:05:39.060014 22624 leader_election.cc:290] T 2725d2c4cb054f18b0fc8f735c15f6c2 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
W20260709 13:05:39.173872 19480 rpcz_store.cc:269] 0709 13:05:37.239379 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:37.267955 (+ 28576us) service_pool.cc:224] Handling call
0709 13:05:39.164042 (+1896087us) spinlock_profiling.cc:243] Waited 839 ms on lock 0x7b5400223154. stack: 00007f4a79de9343 00007f4a79de9240 00007f4a797781d4 00007f4a834b6304 00007f4a834b6299 00007f4a7ce71571 00007f4a7cf0c2fa 00007f4a81ecdb17 00007f4a7b4486d4 00007f4a7b448662 00007f4a7b448591 00007f4a7b44850c 00007f4a7b4477c2 00007f4a7b24348c 00007f4a7b2428c6 00007f4a7b24226f
0709 13:05:39.164210 (+   168us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1929228544}
I20260709 13:05:39.068346 22526 raft_consensus.cc:2749] T bc225c93219c45538b53a1bd3d387e4d P 0473d2b2d01f4459b1e90fd12cc7840e [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:05:39.182910 19408 raft_consensus.cc:1275] T 40e1e16737a842ee936002830f36882e P e5256d91808b47c195bc9b4dbd7f2b87 [term 10 FOLLOWER]: Refusing update from remote peer e61c3a8f61bb48f8a963c9480e53c168: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 6. (term mismatch)
I20260709 13:05:39.141284 22732 raft_consensus.cc:493] T ab43d85f64114d4ebf618930e43d9ed0 P e61c3a8f61bb48f8a963c9480e53c168 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:39.183533 19408 pending_rounds.cc:85] T 40e1e16737a842ee936002830f36882e P e5256d91808b47c195bc9b4dbd7f2b87: Aborting all ops after (but not including) 5
I20260709 13:05:39.158224 22470 raft_consensus.cc:3060] T 7be9efa6559648dbb5a0f7684c4542d1 P 0473d2b2d01f4459b1e90fd12cc7840e [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:05:39.141147 22655 consensus_queue.cc:1048] T 4509b76741dc428e9201c70c1658da13 P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.114s
I20260709 13:05:39.155047 22685 raft_consensus.cc:2749] T 62c6c134d3d24a1ab144dd9ee6bc3f64 P 127766fc592545a4997f7790f50f6076 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:05:39.004937 22111 raft_consensus.cc:515] T 4af19371ea874c09a0a2147040835cbb P 127766fc592545a4997f7790f50f6076 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:05:39.187579 19408 pending_rounds.cc:107] T 40e1e16737a842ee936002830f36882e P e5256d91808b47c195bc9b4dbd7f2b87: Aborting uncommitted NO_OP operation due to leader change: 9.6
I20260709 13:05:39.184617 19479 raft_consensus.cc:2468] T 0e1085d23e8347fbbd5bce7542f4b1f4 P 0473d2b2d01f4459b1e90fd12cc7840e [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 6.
W20260709 13:05:39.190601 19524 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:39.192293 19478 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39478 (request call id 407) took 1857 ms. Trace:
I20260709 13:05:39.193372 22715 raft_consensus.cc:3055] T d1e5873a19244c5ebbcd38e126796ee7 P e61c3a8f61bb48f8a963c9480e53c168 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:05:39.195228 22701 raft_consensus.cc:2804] T 2725d2c4cb054f18b0fc8f735c15f6c2 P e61c3a8f61bb48f8a963c9480e53c168 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:05:39.005160 22711 raft_consensus.cc:515] T a08760e15aac4630a629431f56024dc8 P e61c3a8f61bb48f8a963c9480e53c168 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:38.997166 22689 raft_consensus.cc:515] T ab43d85f64114d4ebf618930e43d9ed0 P e5256d91808b47c195bc9b4dbd7f2b87 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } attrs { replace: true } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:05:39.202869 22732 raft_consensus.cc:515] T ab43d85f64114d4ebf618930e43d9ed0 P e61c3a8f61bb48f8a963c9480e53c168 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } attrs { replace: true } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:05:39.245399 19408 raft_consensus.cc:2889] T 40e1e16737a842ee936002830f36882e P e5256d91808b47c195bc9b4dbd7f2b87 [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:05:38.997058 22745 raft_consensus.cc:515] T ff9b0eddd810459b82d91c60777c10eb P 127766fc592545a4997f7790f50f6076 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:05:39.187911 22624 raft_consensus.cc:493] T 3e1f505cb0f1427bbd698ac889d80821 P e61c3a8f61bb48f8a963c9480e53c168 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader e5256d91808b47c195bc9b4dbd7f2b87)
I20260709 13:05:39.247496 22624 raft_consensus.cc:515] T 3e1f505cb0f1427bbd698ac889d80821 P e61c3a8f61bb48f8a963c9480e53c168 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:39.249011 22624 leader_election.cc:290] T 3e1f505cb0f1427bbd698ac889d80821 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:05:39.249112 22745 leader_election.cc:290] T ff9b0eddd810459b82d91c60777c10eb P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:05:39.197444 19485 raft_consensus.cc:1240] T 7f575b143b844aa096b50997dad3516a P 0473d2b2d01f4459b1e90fd12cc7840e [term 4 FOLLOWER]: Rejecting Update request from peer e61c3a8f61bb48f8a963c9480e53c168 for earlier term 3. Current term is 4. Ops: []
I20260709 13:05:39.163535 22676 raft_consensus.cc:2804] T b08304a0a02b42d7840c4e8ee9a6bd1a P e5256d91808b47c195bc9b4dbd7f2b87 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:05:39.249769 22715 raft_consensus.cc:740] T d1e5873a19244c5ebbcd38e126796ee7 P e61c3a8f61bb48f8a963c9480e53c168 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: e61c3a8f61bb48f8a963c9480e53c168, State: Running, Role: LEADER
I20260709 13:05:39.250082 22676 raft_consensus.cc:493] T b08304a0a02b42d7840c4e8ee9a6bd1a P e5256d91808b47c195bc9b4dbd7f2b87 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 0473d2b2d01f4459b1e90fd12cc7840e)
I20260709 13:05:39.168702 22551 raft_consensus.cc:2804] T 6c5eebf646ad445a9d1b1adc319d7b16 P e61c3a8f61bb48f8a963c9480e53c168 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:05:39.250550 22676 raft_consensus.cc:3060] T b08304a0a02b42d7840c4e8ee9a6bd1a P e5256d91808b47c195bc9b4dbd7f2b87 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:05:39.163610 22721 raft_consensus.cc:2749] T 833a2f0775ed407a94b8924ce50adb63 P 127766fc592545a4997f7790f50f6076 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:05:39.250954 22551 raft_consensus.cc:697] T 6c5eebf646ad445a9d1b1adc319d7b16 P e61c3a8f61bb48f8a963c9480e53c168 [term 6 LEADER]: Becoming Leader. State: Replica: e61c3a8f61bb48f8a963c9480e53c168, State: Running, Role: LEADER
I20260709 13:05:39.251886 22551 consensus_queue.cc:237] T 6c5eebf646ad445a9d1b1adc319d7b16 P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:05:39.252553 22663 raft_consensus.cc:515] T ff75a1d4cb1f493db8f71ddc136ba9ab P e5256d91808b47c195bc9b4dbd7f2b87 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:39.196914 19483 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58294 (request call id 1865) took 1958 ms. Trace:
I20260709 13:05:39.173274 22682 raft_consensus.cc:515] T f93ee515a9c14139bf566522ed8232f3 P e5256d91808b47c195bc9b4dbd7f2b87 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:39.254817 19483 rpcz_store.cc:276] 0709 13:05:37.238325 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:37.446491 (+208166us) service_pool.cc:224] Handling call
0709 13:05:39.196720 (+1750229us) spinlock_profiling.cc:243] Waited 1.32 s on lock 0x7b5400343d54. stack: 00007f4a79de9343 00007f4a79de9240 00007f4a797781d4 00007f4a834b6304 00007f4a834b6299 00007f4a7ce71571 00007f4a7cf0c2fa 00007f4a81ecdb17 00007f4a7b4486d4 00007f4a7b448662 00007f4a7b448591 00007f4a7b44850c 00007f4a7b4477c2 00007f4a7b24348c 00007f4a7b2428c6 00007f4a7b24226f
0709 13:05:39.196858 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3039526272}
I20260709 13:05:39.256549 22682 leader_election.cc:290] T f93ee515a9c14139bf566522ed8232f3 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:05:38.999856 22710 consensus_queue.cc:237] T 1efebf73c86e432baa55533136b6e12c P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:05:39.210839 22734 consensus_queue.cc:1059] T f93ee515a9c14139bf566522ed8232f3 P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.024s
I20260709 13:05:39.169201 22712 raft_consensus.cc:493] T 2e36a9d6e29c4a7c860cf267efbd4c74 P e61c3a8f61bb48f8a963c9480e53c168 [term 6 FOLLOWER]: Starting leader election (detected failure of leader e5256d91808b47c195bc9b4dbd7f2b87)
I20260709 13:05:39.246376 19478 rpcz_store.cc:276] 0709 13:05:37.334404 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:37.442647 (+108243us) service_pool.cc:224] Handling call
0709 13:05:39.192048 (+1749401us) spinlock_profiling.cc:243] Waited 1.13 s on lock 0x7b540035cad4. stack: 00007f4a79de9343 00007f4a79de9240 00007f4a797781d4 00007f4a834b6304 00007f4a834b6299 00007f4a7ce71571 00007f4a7cf0c2fa 00007f4a81ecdb17 00007f4a7b4486d4 00007f4a7b448662 00007f4a7b448591 00007f4a7b44850c 00007f4a7b4477c2 00007f4a7b24348c 00007f4a7b2428c6 00007f4a7b24226f
0709 13:05:39.192227 (+   179us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2599371520}
I20260709 13:05:39.201179 19553 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41504 (request call id 447) took 1414 ms. Trace:
I20260709 13:05:39.257462 22676 raft_consensus.cc:515] T b08304a0a02b42d7840c4e8ee9a6bd1a P e5256d91808b47c195bc9b4dbd7f2b87 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:39.257912 22712 raft_consensus.cc:3060] T 2e36a9d6e29c4a7c860cf267efbd4c74 P e61c3a8f61bb48f8a963c9480e53c168 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:05:39.258138 19553 rpcz_store.cc:276] 0709 13:05:37.786563 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:37.789314 (+  2751us) service_pool.cc:224] Handling call
0709 13:05:37.804376 (+ 15062us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:38.794590 (+990214us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:39.200986 (+406396us) spinlock_profiling.cc:243] Waited 966 ms on lock 0x7b5400125a54. stack: 00007f4a79de9343 00007f4a79de9240 00007f4a797781d4 00007f4a834b6304 00007f4a834b6299 00007f4a7ce71571 00007f4a7cf08e01 00007f4a7cf0783e 00007f4a81ecc419 00007f4a7b443bd4 00007f4a7b443b62 00007f4a7b443a91 00007f4a7b443a0c 00007f4a7b442cc2 00007f4a7b24348c 00007f4a7b2428c6
0709 13:05:39.201123 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2222608128}
I20260709 13:05:39.004803 22727 raft_consensus.cc:515] T 2a16f7501e2444fb86d4e2778e734e02 P 127766fc592545a4997f7790f50f6076 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:05:39.260267 22676 leader_election.cc:290] T b08304a0a02b42d7840c4e8ee9a6bd1a P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 10 election: Requested vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:05:39.261250 22727 leader_election.cc:290] T 2a16f7501e2444fb86d4e2778e734e02 P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:05:39.264703 22711 leader_election.cc:290] T a08760e15aac4630a629431f56024dc8 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:05:39.265360 22701 raft_consensus.cc:493] T 2725d2c4cb054f18b0fc8f735c15f6c2 P e61c3a8f61bb48f8a963c9480e53c168 [term 8 FOLLOWER]: Starting leader election (detected failure of leader e5256d91808b47c195bc9b4dbd7f2b87)
I20260709 13:05:39.265769 22701 raft_consensus.cc:3060] T 2725d2c4cb054f18b0fc8f735c15f6c2 P e61c3a8f61bb48f8a963c9480e53c168 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:05:39.266928 20112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48824d5acfbc485ebf8c2d944e7202de" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:05:39.267045 20111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e1085d23e8347fbbd5bce7542f4b1f4" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:05:39.268644 22443 leader_election.cc:290] T 7be9efa6559648dbb5a0f7684c4542d1 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 9 election: Requested vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:05:39.270480 20108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62c6c134d3d24a1ab144dd9ee6bc3f64" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:05:39.270888 22699 leader_election.cc:290] T 86a6797bdfe94fa496c050ceae4bd0d9 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 8 election: Requested vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:05:39.272384 20110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14935b3ddf914369822e4a0547aaa355" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 7 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:05:39.233114 19410 raft_consensus.cc:2468] T 7f575b143b844aa096b50997dad3516a P e5256d91808b47c195bc9b4dbd7f2b87 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 4.
I20260709 13:05:39.280995 19402 raft_consensus.cc:1240] T 7f575b143b844aa096b50997dad3516a P e5256d91808b47c195bc9b4dbd7f2b87 [term 4 FOLLOWER]: Rejecting Update request from peer e61c3a8f61bb48f8a963c9480e53c168 for earlier term 3. Current term is 4. Ops: []
I20260709 13:05:39.283917 20105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "309c3ca0ca4b4f3ba129752ea2cb293b" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:05:39.284977 20103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c5eebf646ad445a9d1b1adc319d7b16" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:05:39.172384 22650 consensus_queue.cc:1048] T b08304a0a02b42d7840c4e8ee9a6bd1a P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.048s
I20260709 13:05:39.271795 20106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a16f7501e2444fb86d4e2778e734e02" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:05:39.283413 22685 raft_consensus.cc:2804] T 85c494af21f9457a85da47b9bc70c1fd P 127766fc592545a4997f7790f50f6076 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:05:39.299512 20108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70797e5783b5454ab0d0eea663e791e3" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:05:39.300062 22470 raft_consensus.cc:2749] T 7be9efa6559648dbb5a0f7684c4542d1 P 0473d2b2d01f4459b1e90fd12cc7840e [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:05:39.254523 22663 leader_election.cc:290] T ff75a1d4cb1f493db8f71ddc136ba9ab P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 8 election: Requested vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:05:39.337277 22111 leader_election.cc:290] T 4af19371ea874c09a0a2147040835cbb P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:05:39.339720 22704 leader_election.cc:290] T 40e1e16737a842ee936002830f36882e P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:05:39.346827 19404 raft_consensus.cc:2393] T ab43d85f64114d4ebf618930e43d9ed0 P e5256d91808b47c195bc9b4dbd7f2b87 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 0473d2b2d01f4459b1e90fd12cc7840e in current term 7: Already voted for candidate e5256d91808b47c195bc9b4dbd7f2b87 in this term.
I20260709 13:05:39.348595 22730 leader_election.cc:290] T fa731b585f684a7fb2d106c50f143b83 P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:05:39.352191 20108 raft_consensus.cc:2468] T 70797e5783b5454ab0d0eea663e791e3 P 127766fc592545a4997f7790f50f6076 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 8.
I20260709 13:05:39.353585 20108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab43d85f64114d4ebf618930e43d9ed0" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076"
I20260709 13:05:39.286911 22727 consensus_queue.cc:1059] T 0afb57ae58a24a01850491d69f0213dd P 127766fc592545a4997f7790f50f6076 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.069s
I20260709 13:05:39.316130 22685 raft_consensus.cc:493] T 85c494af21f9457a85da47b9bc70c1fd P 127766fc592545a4997f7790f50f6076 [term 4 FOLLOWER]: Starting leader election (detected failure of leader e5256d91808b47c195bc9b4dbd7f2b87)
I20260709 13:05:39.357529 22685 raft_consensus.cc:3060] T 85c494af21f9457a85da47b9bc70c1fd P 127766fc592545a4997f7790f50f6076 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:05:39.363922 22721 raft_consensus.cc:3055] T 0afb57ae58a24a01850491d69f0213dd P 127766fc592545a4997f7790f50f6076 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:05:39.364465 22721 raft_consensus.cc:740] T 0afb57ae58a24a01850491d69f0213dd P 127766fc592545a4997f7790f50f6076 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 127766fc592545a4997f7790f50f6076, State: Running, Role: LEADER
I20260709 13:05:39.365531 22721 consensus_queue.cc:260] T 0afb57ae58a24a01850491d69f0213dd P 127766fc592545a4997f7790f50f6076 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:05:39.280545 22715 consensus_queue.cc:260] T d1e5873a19244c5ebbcd38e126796ee7 P e61c3a8f61bb48f8a963c9480e53c168 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 9.5, Last appended by leader: 5, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:39.368131 22715 raft_consensus.cc:3060] T d1e5873a19244c5ebbcd38e126796ee7 P e61c3a8f61bb48f8a963c9480e53c168 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:05:39.370031 22711 raft_consensus.cc:493] T 1dc5b3532fe54f74876d02beffa2c230 P e61c3a8f61bb48f8a963c9480e53c168 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader e5256d91808b47c195bc9b4dbd7f2b87)
I20260709 13:05:39.370774 22711 raft_consensus.cc:515] T 1dc5b3532fe54f74876d02beffa2c230 P e61c3a8f61bb48f8a963c9480e53c168 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:39.313589 20105 raft_consensus.cc:1240] T ed7fdbcb96d14d418db9ca90a792588a P 127766fc592545a4997f7790f50f6076 [term 5 FOLLOWER]: Rejecting Update request from peer e61c3a8f61bb48f8a963c9480e53c168 for earlier term 4. Current term is 5. Ops: []
W20260709 13:05:39.315174 19377 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.2:46257, user_credentials={real_user=slave}} blocked reactor thread for 450899us
W20260709 13:05:39.380455 19375 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.3:36891, user_credentials={real_user=slave}} blocked reactor thread for 233776us
I20260709 13:05:39.319316 19479 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "172b3dd13109415a955b71ac0e9d2234"
dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
mode: GRACEFUL
new_leader_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
 from {username='slave'} at 127.0.0.1:48168
I20260709 13:05:39.319774 20112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ec1c4ce15e04c7e8c283a62179f2a64" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076"
I20260709 13:05:39.382324 19479 raft_consensus.cc:606] T 172b3dd13109415a955b71ac0e9d2234 P 0473d2b2d01f4459b1e90fd12cc7840e [term 6 FOLLOWER]: Received request to transfer leadership to TS e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:05:39.382406 20112 raft_consensus.cc:3060] T 5ec1c4ce15e04c7e8c283a62179f2a64 P 127766fc592545a4997f7790f50f6076 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:05:39.382802 19479 raft_consensus.cc:614] T 172b3dd13109415a955b71ac0e9d2234 P 0473d2b2d01f4459b1e90fd12cc7840e [term 6 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:05:39.320084 20103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c5eebf646ad445a9d1b1adc319d7b16" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076"
I20260709 13:05:39.317443 20106 raft_consensus.cc:2468] T 2a16f7501e2444fb86d4e2778e734e02 P 127766fc592545a4997f7790f50f6076 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 8.
I20260709 13:05:39.322747 20110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e1085d23e8347fbbd5bce7542f4b1f4" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076"
W20260709 13:05:39.387676 19523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.1:40321, user_credentials={real_user=slave}} blocked reactor thread for 343051us
W20260709 13:05:39.324785 19525 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:05:39.389339 19525 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:05:39.389959 19525 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:05:39.390326 19525 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:39.272032 22745 raft_consensus.cc:2749] T ece3db938bc649d4a40a51522ed5259c P 127766fc592545a4997f7790f50f6076 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:05:39.393841 20076 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.3:36891, user_credentials={real_user=slave}} blocked reactor thread for 215286us
I20260709 13:05:39.338269 22689 leader_election.cc:290] T ab43d85f64114d4ebf618930e43d9ed0 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 7 election: Requested vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:05:39.399202 19405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4af19371ea874c09a0a2147040835cbb" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:05:39.396883 20076 leader_election.cc:304] T 65d8cb8d6ec64f459d5a47cefab10acf P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 127766fc592545a4997f7790f50f6076, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:05:39.406663 19405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa731b585f684a7fb2d106c50f143b83" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
W20260709 13:05:39.408079 20075 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:39.409711 19408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a16f7501e2444fb86d4e2778e734e02" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
W20260709 13:05:39.383999 19450 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.3:36891, user_credentials={real_user=slave}} blocked reactor thread for 324344us
I20260709 13:05:39.412119 19450 leader_election.cc:304] T 21e14947d70440f19044d8f75c31e1f9 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e; no voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:05:39.413587 19450 leader_election.cc:304] T 40e1e16737a842ee936002830f36882e P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e; no voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:05:39.388646 19523 leader_election.cc:304] T 46c5bfeecc314717bffe987e6844b6d0 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168; no voters: 0473d2b2d01f4459b1e90fd12cc7840e
I20260709 13:05:39.354595 20108 raft_consensus.cc:2393] T ab43d85f64114d4ebf618930e43d9ed0 P 127766fc592545a4997f7790f50f6076 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate e5256d91808b47c195bc9b4dbd7f2b87 in current term 7: Already voted for candidate 0473d2b2d01f4459b1e90fd12cc7840e in this term.
I20260709 13:05:39.320792 22702 consensus_queue.cc:260] T e381f1d6b8184797ad142de49be225a8 P 0473d2b2d01f4459b1e90fd12cc7840e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:39.395018 19375 leader_election.cc:304] T 46c5bfeecc314717bffe987e6844b6d0 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:05:39.396016 19410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff9b0eddd810459b82d91c60777c10eb" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:05:39.388068 22381 leader_election.cc:290] T ab43d85f64114d4ebf618930e43d9ed0 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 7 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:05:39.423269 19450 leader_election.cc:304] T 0afb57ae58a24a01850491d69f0213dd P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168; no voters: 127766fc592545a4997f7790f50f6076
I20260709 13:05:39.421173 22655 raft_consensus.cc:2749] T 40e1e16737a842ee936002830f36882e P 0473d2b2d01f4459b1e90fd12cc7840e [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:05:39.426519 22540 consensus_queue.cc:1059] T 179fd671030940b4b4a4e24bcc4aba0a P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:05:39.427629 22540 raft_consensus.cc:493] T 4509b76741dc428e9201c70c1658da13 P e61c3a8f61bb48f8a963c9480e53c168 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:39.428145 22540 raft_consensus.cc:515] T 4509b76741dc428e9201c70c1658da13 P e61c3a8f61bb48f8a963c9480e53c168 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:39.428659 22655 raft_consensus.cc:2804] T 0afb57ae58a24a01850491d69f0213dd P 0473d2b2d01f4459b1e90fd12cc7840e [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:05:39.429215 22655 raft_consensus.cc:697] T 0afb57ae58a24a01850491d69f0213dd P 0473d2b2d01f4459b1e90fd12cc7840e [term 8 LEADER]: Becoming Leader. State: Replica: 0473d2b2d01f4459b1e90fd12cc7840e, State: Running, Role: LEADER
I20260709 13:05:39.430292 22540 leader_election.cc:290] T 4509b76741dc428e9201c70c1658da13 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:05:39.430135 22655 consensus_queue.cc:237] T 0afb57ae58a24a01850491d69f0213dd P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:05:39.431743 22540 raft_consensus.cc:493] T ef32ce6fdd0e40d382c79974f30295c6 P e61c3a8f61bb48f8a963c9480e53c168 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:39.432193 22540 raft_consensus.cc:515] T ef32ce6fdd0e40d382c79974f30295c6 P e61c3a8f61bb48f8a963c9480e53c168 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:39.433343 19449 leader_election.cc:304] T 7f575b143b844aa096b50997dad3516a P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87; no voters: 
I20260709 13:05:39.434257 22540 leader_election.cc:290] T ef32ce6fdd0e40d382c79974f30295c6 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:05:39.434988 22540 raft_consensus.cc:2804] T 46c5bfeecc314717bffe987e6844b6d0 P e61c3a8f61bb48f8a963c9480e53c168 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:05:39.435369 22540 raft_consensus.cc:493] T 46c5bfeecc314717bffe987e6844b6d0 P e61c3a8f61bb48f8a963c9480e53c168 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:39.435509 22640 raft_consensus.cc:2804] T 7f575b143b844aa096b50997dad3516a P 0473d2b2d01f4459b1e90fd12cc7840e [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:05:39.435750 22540 raft_consensus.cc:3060] T 46c5bfeecc314717bffe987e6844b6d0 P e61c3a8f61bb48f8a963c9480e53c168 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:05:39.436034 22640 raft_consensus.cc:697] T 7f575b143b844aa096b50997dad3516a P 0473d2b2d01f4459b1e90fd12cc7840e [term 4 LEADER]: Becoming Leader. State: Replica: 0473d2b2d01f4459b1e90fd12cc7840e, State: Running, Role: LEADER
I20260709 13:05:39.436923 22640 consensus_queue.cc:237] T 7f575b143b844aa096b50997dad3516a P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:39.439774 22612 leader_election.cc:290] T 2e36a9d6e29c4a7c860cf267efbd4c74 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:05:39.441207 19479 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2b74109013a140ada21feeef92d6f563"
dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
mode: GRACEFUL
new_leader_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
 from {username='slave'} at 127.0.0.1:48168
I20260709 13:05:39.448585 19479 raft_consensus.cc:606] T 2b74109013a140ada21feeef92d6f563 P 0473d2b2d01f4459b1e90fd12cc7840e [term 5 FOLLOWER]: Received request to transfer leadership to TS e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:05:39.448925 19479 raft_consensus.cc:614] T 2b74109013a140ada21feeef92d6f563 P 0473d2b2d01f4459b1e90fd12cc7840e [term 5 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:05:39.450102 22702 raft_consensus.cc:3060] T e381f1d6b8184797ad142de49be225a8 P 0473d2b2d01f4459b1e90fd12cc7840e [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:05:39.441289 22620 raft_consensus.cc:3055] T f93ee515a9c14139bf566522ed8232f3 P e61c3a8f61bb48f8a963c9480e53c168 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:05:39.452075 22620 raft_consensus.cc:740] T f93ee515a9c14139bf566522ed8232f3 P e61c3a8f61bb48f8a963c9480e53c168 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: e61c3a8f61bb48f8a963c9480e53c168, State: Running, Role: LEADER
I20260709 13:05:39.452564 19478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df751f992649444090e27965eb1af85d" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:05:39.453213 19478 raft_consensus.cc:2376] T df751f992649444090e27965eb1af85d P 0473d2b2d01f4459b1e90fd12cc7840e [term 9 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 9. Re-sending same reply.
I20260709 13:05:39.453008 22620 consensus_queue.cc:260] T f93ee515a9c14139bf566522ed8232f3 P e61c3a8f61bb48f8a963c9480e53c168 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 9.4, Last appended by leader: 4, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:39.409219 22730 raft_consensus.cc:2804] T 65d8cb8d6ec64f459d5a47cefab10acf P 127766fc592545a4997f7790f50f6076 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:05:39.454082 22730 raft_consensus.cc:493] T 65d8cb8d6ec64f459d5a47cefab10acf P 127766fc592545a4997f7790f50f6076 [term 4 FOLLOWER]: Starting leader election (detected failure of leader e5256d91808b47c195bc9b4dbd7f2b87)
I20260709 13:05:39.454190 22620 raft_consensus.cc:3060] T f93ee515a9c14139bf566522ed8232f3 P e61c3a8f61bb48f8a963c9480e53c168 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:05:39.454490 22730 raft_consensus.cc:3060] T 65d8cb8d6ec64f459d5a47cefab10acf P 127766fc592545a4997f7790f50f6076 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:05:39.411523 22732 leader_election.cc:290] T ab43d85f64114d4ebf618930e43d9ed0 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:05:39.443598 22740 raft_consensus.cc:493] T 14935b3ddf914369822e4a0547aaa355 P 0473d2b2d01f4459b1e90fd12cc7840e [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:05:39.444766 22748 log.cc:927] Time spent T 309c3ca0ca4b4f3ba129752ea2cb293b P 127766fc592545a4997f7790f50f6076: Append to log took a long time: real 0.259s	user 0.002s	sys 0.000s
I20260709 13:05:39.419963 22470 raft_consensus.cc:2749] T 21e14947d70440f19044d8f75c31e1f9 P 0473d2b2d01f4459b1e90fd12cc7840e [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:05:39.438867 22527 consensus_queue.cc:1048] T fa8650e71aa14778b3d73721fc50d9fc P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:05:39.461831 22612 raft_consensus.cc:493] T 0cdf56e38bbc453d9438d359e5a69955 P 0473d2b2d01f4459b1e90fd12cc7840e [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:39.462056 19483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ec1c4ce15e04c7e8c283a62179f2a64" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:05:39.454991 19479 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "48824d5acfbc485ebf8c2d944e7202de"
dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
mode: GRACEFUL
new_leader_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
 from {username='slave'} at 127.0.0.1:48168
I20260709 13:05:39.462875 19479 raft_consensus.cc:606] T 48824d5acfbc485ebf8c2d944e7202de P 0473d2b2d01f4459b1e90fd12cc7840e [term 8 LEADER]: Received request to transfer leadership to TS e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:05:39.465847 22732 raft_consensus.cc:3055] T 179fd671030940b4b4a4e24bcc4aba0a P e61c3a8f61bb48f8a963c9480e53c168 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:05:39.456408 20112 raft_consensus.cc:2468] T 5ec1c4ce15e04c7e8c283a62179f2a64 P 127766fc592545a4997f7790f50f6076 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 7.
W20260709 13:05:39.458046 19375 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.3:36891, user_credentials={real_user=slave}} blocked reactor thread for 63101.9us
I20260709 13:05:39.460896 19478 raft_consensus.cc:1275] T a08760e15aac4630a629431f56024dc8 P 0473d2b2d01f4459b1e90fd12cc7840e [term 9 FOLLOWER]: Refusing update from remote peer e5256d91808b47c195bc9b4dbd7f2b87: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:05:39.469744 20106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ec1c4ce15e04c7e8c283a62179f2a64" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076"
I20260709 13:05:39.470463 20106 raft_consensus.cc:2376] T 5ec1c4ce15e04c7e8c283a62179f2a64 P 127766fc592545a4997f7790f50f6076 [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 7. Re-sending same reply.
I20260709 13:05:39.469875 22740 raft_consensus.cc:515] T 14935b3ddf914369822e4a0547aaa355 P 0473d2b2d01f4459b1e90fd12cc7840e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } attrs { replace: true } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:05:39.472213 19478 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "edd7d470b5014c9489be7f41f64355c9"
dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
mode: GRACEFUL
new_leader_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
 from {username='slave'} at 127.0.0.1:48168
I20260709 13:05:39.472795 19478 raft_consensus.cc:606] T edd7d470b5014c9489be7f41f64355c9 P 0473d2b2d01f4459b1e90fd12cc7840e [term 8 LEADER]: Received request to transfer leadership to TS e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:05:39.479413 19375 leader_election.cc:304] T 22196caba61445d3bec98a0aab3c337d P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:05:39.422796 22711 leader_election.cc:290] T 1dc5b3532fe54f74876d02beffa2c230 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:05:39.490444 18300 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 4
I20260709 13:05:39.491794 19559 raft_consensus.cc:1275] T a08760e15aac4630a629431f56024dc8 P e61c3a8f61bb48f8a963c9480e53c168 [term 9 FOLLOWER]: Refusing update from remote peer e5256d91808b47c195bc9b4dbd7f2b87: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:05:39.503141 19552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff75a1d4cb1f493db8f71ddc136ba9ab" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:05:39.504478 19559 raft_consensus.cc:1275] T 0cdf56e38bbc453d9438d359e5a69955 P e61c3a8f61bb48f8a963c9480e53c168 [term 11 FOLLOWER]: Refusing update from remote peer e5256d91808b47c195bc9b4dbd7f2b87: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:05:39.509917 19483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46c5bfeecc314717bffe987e6844b6d0" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 14 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:05:39.511445 19410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2725d2c4cb054f18b0fc8f735c15f6c2" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:05:39.462324 22612 raft_consensus.cc:515] T 0cdf56e38bbc453d9438d359e5a69955 P 0473d2b2d01f4459b1e90fd12cc7840e [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:39.519114 19551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f93ee515a9c14139bf566522ed8232f3" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 11 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:05:39.519484 19552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b08304a0a02b42d7840c4e8ee9a6bd1a" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:05:39.529655 19552 raft_consensus.cc:3060] T b08304a0a02b42d7840c4e8ee9a6bd1a P e61c3a8f61bb48f8a963c9480e53c168 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:05:39.531347 19526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.2:46257, user_credentials={real_user=slave}} blocked reactor thread for 373901us
I20260709 13:05:39.533396 19483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab43d85f64114d4ebf618930e43d9ed0" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:05:39.533767 19478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e1f505cb0f1427bbd698ac889d80821" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:05:39.534412 19478 raft_consensus.cc:2468] T 3e1f505cb0f1427bbd698ac889d80821 P 0473d2b2d01f4459b1e90fd12cc7840e [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 8.
I20260709 13:05:39.466315 22732 raft_consensus.cc:740] T 179fd671030940b4b4a4e24bcc4aba0a P e61c3a8f61bb48f8a963c9480e53c168 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: e61c3a8f61bb48f8a963c9480e53c168, State: Running, Role: LEADER
I20260709 13:05:39.528203 19558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edd7d470b5014c9489be7f41f64355c9" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 9 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:05:39.478531 22699 raft_consensus.cc:2804] T 46c5bfeecc314717bffe987e6844b6d0 P e5256d91808b47c195bc9b4dbd7f2b87 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:05:39.543886 19558 raft_consensus.cc:2468] T edd7d470b5014c9489be7f41f64355c9 P e61c3a8f61bb48f8a963c9480e53c168 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 8.
I20260709 13:05:39.536043 19478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22196caba61445d3bec98a0aab3c337d" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:05:39.545110 19483 raft_consensus.cc:2393] T ab43d85f64114d4ebf618930e43d9ed0 P 0473d2b2d01f4459b1e90fd12cc7840e [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e61c3a8f61bb48f8a963c9480e53c168 in current term 7: Already voted for candidate 0473d2b2d01f4459b1e90fd12cc7840e in this term.
I20260709 13:05:39.491092 22700 raft_consensus.cc:2804] T 22196caba61445d3bec98a0aab3c337d P e5256d91808b47c195bc9b4dbd7f2b87 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:05:39.548372 19478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b08304a0a02b42d7840c4e8ee9a6bd1a" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:05:39.570930 19554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab43d85f64114d4ebf618930e43d9ed0" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:05:39.466046 22712 raft_consensus.cc:515] T 2e36a9d6e29c4a7c860cf267efbd4c74 P e61c3a8f61bb48f8a963c9480e53c168 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:39.571743 19554 raft_consensus.cc:3060] T ab43d85f64114d4ebf618930e43d9ed0 P e61c3a8f61bb48f8a963c9480e53c168 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:05:39.484272 22740 leader_election.cc:290] T 14935b3ddf914369822e4a0547aaa355 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
W20260709 13:05:39.572715 19523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.1:40321, user_credentials={real_user=slave}} blocked reactor thread for 184135us
I20260709 13:05:39.574734 19559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40e1e16737a842ee936002830f36882e" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:05:39.578145 19523 leader_election.cc:304] T fa8650e71aa14778b3d73721fc50d9fc P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e61c3a8f61bb48f8a963c9480e53c168; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:05:39.582123 19553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86a6797bdfe94fa496c050ceae4bd0d9" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 8 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:05:39.488515 22504 consensus_queue.cc:1048] T df751f992649444090e27965eb1af85d P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.074s
I20260709 13:05:39.595191 19523 leader_election.cc:304] T 1a61655d99124a29b486ba4a5b37faea P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e61c3a8f61bb48f8a963c9480e53c168; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:05:39.596170 19523 leader_election.cc:304] T e381f1d6b8184797ad142de49be225a8 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e61c3a8f61bb48f8a963c9480e53c168; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:05:39.583913 19552 raft_consensus.cc:2468] T b08304a0a02b42d7840c4e8ee9a6bd1a P e61c3a8f61bb48f8a963c9480e53c168 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 10.
I20260709 13:05:39.584620 19558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7be9efa6559648dbb5a0f7684c4542d1" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:05:39.585180 19483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4509b76741dc428e9201c70c1658da13" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:05:39.591131 19478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dc5b3532fe54f74876d02beffa2c230" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:05:39.547231 22699 raft_consensus.cc:493] T 46c5bfeecc314717bffe987e6844b6d0 P e5256d91808b47c195bc9b4dbd7f2b87 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:39.609833 19478 raft_consensus.cc:2468] T 1dc5b3532fe54f74876d02beffa2c230 P 0473d2b2d01f4459b1e90fd12cc7840e [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 7.
I20260709 13:05:39.615787 19478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7be9efa6559648dbb5a0f7684c4542d1" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:05:39.616065 19483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a08760e15aac4630a629431f56024dc8" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:05:39.617054 19478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef32ce6fdd0e40d382c79974f30295c6" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:05:39.618729 19478 raft_consensus.cc:2468] T ef32ce6fdd0e40d382c79974f30295c6 P 0473d2b2d01f4459b1e90fd12cc7840e [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 9.
I20260709 13:05:39.619807 19478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edd7d470b5014c9489be7f41f64355c9" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 9 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:05:39.566438 22752 raft_consensus.cc:493] T 172b3dd13109415a955b71ac0e9d2234 P 127766fc592545a4997f7790f50f6076 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:39.617686 19483 raft_consensus.cc:2468] T a08760e15aac4630a629431f56024dc8 P 0473d2b2d01f4459b1e90fd12cc7840e [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 9.
I20260709 13:05:39.569635 22700 raft_consensus.cc:493] T 22196caba61445d3bec98a0aab3c337d P e5256d91808b47c195bc9b4dbd7f2b87 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 0473d2b2d01f4459b1e90fd12cc7840e)
I20260709 13:05:39.641263 19478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff75a1d4cb1f493db8f71ddc136ba9ab" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:05:39.641748 19559 raft_consensus.cc:1275] T 1a61655d99124a29b486ba4a5b37faea P e61c3a8f61bb48f8a963c9480e53c168 [term 6 FOLLOWER]: Refusing update from remote peer e5256d91808b47c195bc9b4dbd7f2b87: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:05:39.643191 22763 consensus_queue.cc:1048] T b9f0d59553ad444883fcf5b5909f9798 P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:05:39.643589 22612 leader_election.cc:290] T 0cdf56e38bbc453d9438d359e5a69955 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:05:39.575001 22534 consensus_queue.cc:1048] T a08760e15aac4630a629431f56024dc8 P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 3, Time since last communication: 0.056s
I20260709 13:05:39.618842 22699 raft_consensus.cc:3060] T 46c5bfeecc314717bffe987e6844b6d0 P e5256d91808b47c195bc9b4dbd7f2b87 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:05:39.657363 19478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f93ee515a9c14139bf566522ed8232f3" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 11 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:05:39.660411 19478 raft_consensus.cc:2468] T f93ee515a9c14139bf566522ed8232f3 P 0473d2b2d01f4459b1e90fd12cc7840e [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 10.
I20260709 13:05:39.662904 19478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b08304a0a02b42d7840c4e8ee9a6bd1a" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
W20260709 13:05:39.703794 19377 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.17.223.2:46257 timed out after 2.813s (SENT) [suppressed 33 similar messages]
I20260709 13:05:39.631034 22761 raft_consensus.cc:2749] T fa8650e71aa14778b3d73721fc50d9fc P e61c3a8f61bb48f8a963c9480e53c168 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:05:39.704290 19375 leader_election.cc:304] T edd7d470b5014c9489be7f41f64355c9 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:05:39.638618 22700 raft_consensus.cc:3060] T 22196caba61445d3bec98a0aab3c337d P e5256d91808b47c195bc9b4dbd7f2b87 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:05:39.658878 22540 raft_consensus.cc:515] T 46c5bfeecc314717bffe987e6844b6d0 P e61c3a8f61bb48f8a963c9480e53c168 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
W20260709 13:05:39.715932 22767 log.cc:927] Time spent T 1dc5b3532fe54f74876d02beffa2c230 P e5256d91808b47c195bc9b4dbd7f2b87: Append to log took a long time: real 0.071s	user 0.000s	sys 0.000s
I20260709 13:05:39.721433 19478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40e1e16737a842ee936002830f36882e" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:05:39.725553 19478 raft_consensus.cc:2468] T 40e1e16737a842ee936002830f36882e P 0473d2b2d01f4459b1e90fd12cc7840e [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 10.
I20260709 13:05:39.722688 19375 leader_election.cc:304] T b08304a0a02b42d7840c4e8ee9a6bd1a P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:05:39.726810 19478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a61655d99124a29b486ba4a5b37faea" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: true dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:05:39.727504 19478 raft_consensus.cc:2376] T 1a61655d99124a29b486ba4a5b37faea P 0473d2b2d01f4459b1e90fd12cc7840e [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 6. Re-sending same reply.
I20260709 13:05:39.730465 19554 raft_consensus.cc:2468] T ab43d85f64114d4ebf618930e43d9ed0 P e61c3a8f61bb48f8a963c9480e53c168 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 7.
I20260709 13:05:39.734205 19478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab43d85f64114d4ebf618930e43d9ed0" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:05:39.739593 19478 raft_consensus.cc:2393] T ab43d85f64114d4ebf618930e43d9ed0 P 0473d2b2d01f4459b1e90fd12cc7840e [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate e5256d91808b47c195bc9b4dbd7f2b87 in current term 7: Already voted for candidate 0473d2b2d01f4459b1e90fd12cc7840e in this term.
I20260709 13:05:39.670176 22763 consensus_queue.cc:1059] T ff75a1d4cb1f493db8f71ddc136ba9ab P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.060s
I20260709 13:05:39.741838 19478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "309c3ca0ca4b4f3ba129752ea2cb293b" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:05:39.631500 22752 raft_consensus.cc:515] T 172b3dd13109415a955b71ac0e9d2234 P 127766fc592545a4997f7790f50f6076 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:05:39.724627 22689 raft_consensus.cc:2804] T edd7d470b5014c9489be7f41f64355c9 P e5256d91808b47c195bc9b4dbd7f2b87 [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 13:05:39.750212 19451 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:39.635416 22732 consensus_queue.cc:260] T 179fd671030940b4b4a4e24bcc4aba0a P e61c3a8f61bb48f8a963c9480e53c168 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
W20260709 13:05:39.786787 20076 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:39.737522 22682 raft_consensus.cc:2804] T b08304a0a02b42d7840c4e8ee9a6bd1a P e5256d91808b47c195bc9b4dbd7f2b87 [term 10 FOLLOWER]: Leader election won for term 10
W20260709 13:05:39.789399 22767 log.cc:927] Time spent T 1dc5b3532fe54f74876d02beffa2c230 P e5256d91808b47c195bc9b4dbd7f2b87: Append to log took a long time: real 0.050s	user 0.001s	sys 0.000s
I20260709 13:05:39.811723 19478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df751f992649444090e27965eb1af85d" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:05:39.784157 22689 raft_consensus.cc:493] T edd7d470b5014c9489be7f41f64355c9 P e5256d91808b47c195bc9b4dbd7f2b87 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:39.813103 19478 raft_consensus.cc:2376] T df751f992649444090e27965eb1af85d P 0473d2b2d01f4459b1e90fd12cc7840e [term 9 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 9. Re-sending same reply.
I20260709 13:05:39.743579 22504 consensus_queue.cc:1048] T 1a61655d99124a29b486ba4a5b37faea P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.067s
I20260709 13:05:39.734635 22701 raft_consensus.cc:515] T 2725d2c4cb054f18b0fc8f735c15f6c2 P e61c3a8f61bb48f8a963c9480e53c168 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:39.811249 22697 raft_consensus.cc:493] T 14efcc79969f41babe5529c22d59156d P e5256d91808b47c195bc9b4dbd7f2b87 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:05:39.823227 22764 log.cc:927] Time spent T 0afb57ae58a24a01850491d69f0213dd P 0473d2b2d01f4459b1e90fd12cc7840e: Append to log took a long time: real 0.109s	user 0.001s	sys 0.000s
I20260709 13:05:39.815515 22504 consensus_queue.cc:1243] T 1a61655d99124a29b486ba4a5b37faea P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Peer e61c3a8f61bb48f8a963c9480e53c168 log is divergent from this leader: its last log entry 4.3 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 2
I20260709 13:05:39.827327 19483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "179fd671030940b4b4a4e24bcc4aba0a" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:05:39.828474 19483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86a6797bdfe94fa496c050ceae4bd0d9" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 8 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:05:39.829197 19483 raft_consensus.cc:2393] T 86a6797bdfe94fa496c050ceae4bd0d9 P 0473d2b2d01f4459b1e90fd12cc7840e [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate e5256d91808b47c195bc9b4dbd7f2b87 in current term 8: Already voted for candidate e61c3a8f61bb48f8a963c9480e53c168 in this term.
I20260709 13:05:39.831132 19483 raft_consensus.cc:1275] T df751f992649444090e27965eb1af85d P 0473d2b2d01f4459b1e90fd12cc7840e [term 9 FOLLOWER]: Refusing update from remote peer e5256d91808b47c195bc9b4dbd7f2b87: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:05:39.831238 22758 raft_consensus.cc:2749] T e381f1d6b8184797ad142de49be225a8 P e61c3a8f61bb48f8a963c9480e53c168 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:05:39.832283 19483 raft_consensus.cc:1275] T 0cdf56e38bbc453d9438d359e5a69955 P 0473d2b2d01f4459b1e90fd12cc7840e [term 11 FOLLOWER]: Refusing update from remote peer e5256d91808b47c195bc9b4dbd7f2b87: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:05:39.834209 19483 raft_consensus.cc:1275] T ef32ce6fdd0e40d382c79974f30295c6 P 0473d2b2d01f4459b1e90fd12cc7840e [term 9 FOLLOWER]: Refusing update from remote peer e5256d91808b47c195bc9b4dbd7f2b87: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:05:39.834746 22750 raft_consensus.cc:2749] T 1a61655d99124a29b486ba4a5b37faea P e61c3a8f61bb48f8a963c9480e53c168 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 13:05:39.836584 22769 log.cc:927] Time spent T 309c3ca0ca4b4f3ba129752ea2cb293b P 0473d2b2d01f4459b1e90fd12cc7840e: Append to log took a long time: real 0.105s	user 0.000s	sys 0.000s
I20260709 13:05:39.838842 19483 raft_consensus.cc:1275] T 86a6797bdfe94fa496c050ceae4bd0d9 P 0473d2b2d01f4459b1e90fd12cc7840e [term 8 FOLLOWER]: Refusing update from remote peer e61c3a8f61bb48f8a963c9480e53c168: Log matching property violated. Preceding OpId in replica: term: 4 index: 2. Preceding OpId from leader: term: 8 index: 4. (index mismatch)
I20260709 13:05:39.745133 22609 consensus_queue.cc:1048] T 0cdf56e38bbc453d9438d359e5a69955 P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.106s
I20260709 13:05:39.851189 19560 raft_consensus.cc:1240] T 2725d2c4cb054f18b0fc8f735c15f6c2 P e61c3a8f61bb48f8a963c9480e53c168 [term 9 FOLLOWER]: Rejecting Update request from peer e5256d91808b47c195bc9b4dbd7f2b87 for earlier term 8. Current term is 9. Ops: []
I20260709 13:05:39.810885 22682 raft_consensus.cc:697] T b08304a0a02b42d7840c4e8ee9a6bd1a P e5256d91808b47c195bc9b4dbd7f2b87 [term 10 LEADER]: Becoming Leader. State: Replica: e5256d91808b47c195bc9b4dbd7f2b87, State: Running, Role: LEADER
W20260709 13:05:39.843176 19524 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:39.843931 19478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef32ce6fdd0e40d382c79974f30295c6" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:05:39.847311 22701 leader_election.cc:290] T 2725d2c4cb054f18b0fc8f735c15f6c2 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 9 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:05:39.869539 22111 consensus_queue.cc:1059] T 1efebf73c86e432baa55533136b6e12c P 127766fc592545a4997f7790f50f6076 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:05:39.859234 19377 leader_election.cc:304] T d1e5873a19244c5ebbcd38e126796ee7 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87; no voters: e61c3a8f61bb48f8a963c9480e53c168
W20260709 13:05:39.859654 19524 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:39.871104 22760 consensus_queue.cc:1059] T 0e1085d23e8347fbbd5bce7542f4b1f4 P 127766fc592545a4997f7790f50f6076 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:05:39.871323 22111 consensus_queue.cc:1048] T 9962423cb4e54fcfa5de01daf68a86e7 P 127766fc592545a4997f7790f50f6076 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:05:39.872121 22760 consensus_queue.cc:1059] T 6c5eebf646ad445a9d1b1adc319d7b16 P 127766fc592545a4997f7790f50f6076 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:05:39.872747 19552 raft_consensus.cc:1275] T 48824d5acfbc485ebf8c2d944e7202de P e61c3a8f61bb48f8a963c9480e53c168 [term 8 FOLLOWER]: Refusing update from remote peer 0473d2b2d01f4459b1e90fd12cc7840e: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:05:39.873018 22760 consensus_queue.cc:1059] T 0afb57ae58a24a01850491d69f0213dd P 127766fc592545a4997f7790f50f6076 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:05:39.874012 19559 raft_consensus.cc:1275] T 309c3ca0ca4b4f3ba129752ea2cb293b P e61c3a8f61bb48f8a963c9480e53c168 [term 7 FOLLOWER]: Refusing update from remote peer 0473d2b2d01f4459b1e90fd12cc7840e: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:05:39.874315 22111 raft_consensus.cc:3055] T 0e1085d23e8347fbbd5bce7542f4b1f4 P 127766fc592545a4997f7790f50f6076 [term 4 LEADER]: Stepping down as leader of term 4
W20260709 13:05:39.868587 19525 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:39.868783 19483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff9b0eddd810459b82d91c60777c10eb" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:05:39.872133 19554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "179fd671030940b4b4a4e24bcc4aba0a" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:05:39.875572 22693 consensus_queue.cc:1048] T 3e1f505cb0f1427bbd698ac889d80821 P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:05:39.876534 19482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f575b143b844aa096b50997dad3516a" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:05:39.876848 19553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2725d2c4cb054f18b0fc8f735c15f6c2" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:05:39.880374 22443 raft_consensus.cc:2804] T d1e5873a19244c5ebbcd38e126796ee7 P e5256d91808b47c195bc9b4dbd7f2b87 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:05:39.881295 22705 consensus_queue.cc:1048] T ff9b0eddd810459b82d91c60777c10eb P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:05:39.881543 19483 raft_consensus.cc:2468] T ff9b0eddd810459b82d91c60777c10eb P 0473d2b2d01f4459b1e90fd12cc7840e [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 6.
W20260709 13:05:39.882341 19525 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:39.882656 22705 consensus_queue.cc:1048] T 1dc5b3532fe54f74876d02beffa2c230 P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:05:39.883329 22705 consensus_queue.cc:1243] T 1dc5b3532fe54f74876d02beffa2c230 P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Peer 0473d2b2d01f4459b1e90fd12cc7840e log is divergent from this leader: its last log entry 6.3 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 2
I20260709 13:05:39.883157 22111 raft_consensus.cc:740] T 0e1085d23e8347fbbd5bce7542f4b1f4 P 127766fc592545a4997f7790f50f6076 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 127766fc592545a4997f7790f50f6076, State: Running, Role: LEADER
I20260709 13:05:39.884287 19377 leader_election.cc:304] T 7be9efa6559648dbb5a0f7684c4542d1 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:05:39.885982 22374 raft_consensus.cc:2749] T 7be9efa6559648dbb5a0f7684c4542d1 P e5256d91808b47c195bc9b4dbd7f2b87 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:05:39.886783 19377 leader_election.cc:304] T ff75a1d4cb1f493db8f71ddc136ba9ab P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:05:39.874492 22702 raft_consensus.cc:493] T 9962423cb4e54fcfa5de01daf68a86e7 P 0473d2b2d01f4459b1e90fd12cc7840e [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:39.888048 22111 consensus_queue.cc:260] T 0e1085d23e8347fbbd5bce7542f4b1f4 P 127766fc592545a4997f7790f50f6076 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:05:39.888877 22702 raft_consensus.cc:515] T 9962423cb4e54fcfa5de01daf68a86e7 P 0473d2b2d01f4459b1e90fd12cc7840e [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:05:39.889343 22111 raft_consensus.cc:3060] T 0e1085d23e8347fbbd5bce7542f4b1f4 P 127766fc592545a4997f7790f50f6076 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:05:39.890923 22702 leader_election.cc:290] T 9962423cb4e54fcfa5de01daf68a86e7 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:05:39.895869 19552 raft_consensus.cc:1240] T e381f1d6b8184797ad142de49be225a8 P e61c3a8f61bb48f8a963c9480e53c168 [term 6 FOLLOWER]: Rejecting Update request from peer 0473d2b2d01f4459b1e90fd12cc7840e for earlier term 5. Current term is 6. Ops: []
I20260709 13:05:39.859673 19478 raft_consensus.cc:2376] T ef32ce6fdd0e40d382c79974f30295c6 P 0473d2b2d01f4459b1e90fd12cc7840e [term 9 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 9. Re-sending same reply.
I20260709 13:05:39.898389 19483 raft_consensus.cc:1240] T 14935b3ddf914369822e4a0547aaa355 P 0473d2b2d01f4459b1e90fd12cc7840e [term 7 FOLLOWER]: Rejecting Update request from peer 127766fc592545a4997f7790f50f6076 for earlier term 6. Current term is 7. Ops: []
I20260709 13:05:39.900542 22526 raft_consensus.cc:493] T ff9b0eddd810459b82d91c60777c10eb P 0473d2b2d01f4459b1e90fd12cc7840e [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:39.901052 22526 raft_consensus.cc:515] T ff9b0eddd810459b82d91c60777c10eb P 0473d2b2d01f4459b1e90fd12cc7840e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:05:39.816886 22689 raft_consensus.cc:3060] T edd7d470b5014c9489be7f41f64355c9 P e5256d91808b47c195bc9b4dbd7f2b87 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:05:39.903174 19523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.1:40321, user_credentials={real_user=slave}} blocked reactor thread for 307043us
W20260709 13:05:39.903999 19525 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:39.906980 19555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab43d85f64114d4ebf618930e43d9ed0" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:05:39.905652 19377 leader_election.cc:304] T f93ee515a9c14139bf566522ed8232f3 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87; no voters: 
I20260709 13:05:39.934314 19482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96efeaaf1057492490e9a621f37e1a2d" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:05:39.941401 19482 raft_consensus.cc:2468] T 96efeaaf1057492490e9a621f37e1a2d P 0473d2b2d01f4459b1e90fd12cc7840e [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 127766fc592545a4997f7790f50f6076 in term 7.
I20260709 13:05:39.933337 19552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f575b143b844aa096b50997dad3516a" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:05:39.944615 19523 leader_election.cc:304] T 22196caba61445d3bec98a0aab3c337d P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e61c3a8f61bb48f8a963c9480e53c168; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:05:39.946240 19377 leader_election.cc:304] T 40e1e16737a842ee936002830f36882e P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87; no voters: e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:05:39.947261 19552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e36a9d6e29c4a7c860cf267efbd4c74" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:05:39.852476 22697 raft_consensus.cc:515] T 14efcc79969f41babe5529c22d59156d P e5256d91808b47c195bc9b4dbd7f2b87 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:05:39.913626 22712 leader_election.cc:290] T 2e36a9d6e29c4a7c860cf267efbd4c74 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 7 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:05:39.906037 22705 consensus_queue.cc:1048] T a08760e15aac4630a629431f56024dc8 P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 3, Time since last communication: 0.044s
I20260709 13:05:39.955082 19555 raft_consensus.cc:2393] T ab43d85f64114d4ebf618930e43d9ed0 P e61c3a8f61bb48f8a963c9480e53c168 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 0473d2b2d01f4459b1e90fd12cc7840e in current term 7: Already voted for candidate e5256d91808b47c195bc9b4dbd7f2b87 in this term.
I20260709 13:05:39.955526 21926 raft_consensus.cc:2804] T 40e1e16737a842ee936002830f36882e P e5256d91808b47c195bc9b4dbd7f2b87 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:05:39.955916 21926 raft_consensus.cc:493] T 40e1e16737a842ee936002830f36882e P e5256d91808b47c195bc9b4dbd7f2b87 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:39.956377 21926 raft_consensus.cc:3060] T 40e1e16737a842ee936002830f36882e P e5256d91808b47c195bc9b4dbd7f2b87 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:05:39.966800 19482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36f6ba92b9ba46babe4ebd6c02e5fbd9" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:05:39.908758 22676 raft_consensus.cc:2749] T ff75a1d4cb1f493db8f71ddc136ba9ab P e5256d91808b47c195bc9b4dbd7f2b87 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:05:39.969211 19478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "172b3dd13109415a955b71ac0e9d2234" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:05:39.965179 22697 leader_election.cc:290] T 14efcc79969f41babe5529c22d59156d P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:05:39.966997 20078 leader_election.cc:304] T 96efeaaf1057492490e9a621f37e1a2d P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, 127766fc592545a4997f7790f50f6076; no voters: 
I20260709 13:05:39.943776 22693 raft_consensus.cc:2804] T f93ee515a9c14139bf566522ed8232f3 P e5256d91808b47c195bc9b4dbd7f2b87 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:05:39.976899 19478 raft_consensus.cc:2410] T 172b3dd13109415a955b71ac0e9d2234 P 0473d2b2d01f4459b1e90fd12cc7840e [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 127766fc592545a4997f7790f50f6076 for term 6 because replica has last-logged OpId of term: 5 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 5.
I20260709 13:05:39.980139 19555 raft_consensus.cc:1240] T b08304a0a02b42d7840c4e8ee9a6bd1a P e61c3a8f61bb48f8a963c9480e53c168 [term 10 FOLLOWER]: Rejecting Update request from peer 0473d2b2d01f4459b1e90fd12cc7840e for earlier term 9. Current term is 10. Ops: [9.6-9.6]
I20260709 13:05:39.984421 22749 raft_consensus.cc:2804] T 96efeaaf1057492490e9a621f37e1a2d P 127766fc592545a4997f7790f50f6076 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:05:39.984871 22749 raft_consensus.cc:493] T 96efeaaf1057492490e9a621f37e1a2d P 127766fc592545a4997f7790f50f6076 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:39.985236 22749 raft_consensus.cc:3060] T 96efeaaf1057492490e9a621f37e1a2d P 127766fc592545a4997f7790f50f6076 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:05:39.987435 20075 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:39.987473 19477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ec1c4ce15e04c7e8c283a62179f2a64" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
W20260709 13:05:39.988685 22715 consensus_meta.cc:287] T d1e5873a19244c5ebbcd38e126796ee7 P e61c3a8f61bb48f8a963c9480e53c168: Time spent flushing consensus metadata: real 0.620s	user 0.011s	sys 0.000s
I20260709 13:05:39.989233 22693 raft_consensus.cc:493] T f93ee515a9c14139bf566522ed8232f3 P e5256d91808b47c195bc9b4dbd7f2b87 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:39.989696 22693 raft_consensus.cc:3060] T f93ee515a9c14139bf566522ed8232f3 P e5256d91808b47c195bc9b4dbd7f2b87 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:05:39.989789 19406 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52342 (request call id 2160) took 1647 ms. Trace:
I20260709 13:05:39.990193 19406 rpcz_store.cc:276] 0709 13:05:38.342437 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:38.352103 (+  9666us) service_pool.cc:224] Handling call
0709 13:05:38.365162 (+ 13059us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:38.741687 (+376525us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:39.989565 (+1247878us) spinlock_profiling.cc:243] Waited 334 ms on lock 0x7b5400183b54. stack: 00007f4a79de9343 00007f4a79de9240 00007f4a797781d4 00007f4a834b6304 00007f4a834b6299 00007f4a7ce71571 00007f4a7cf08e01 00007f4a7cf0783e 00007f4a81ecc419 00007f4a7b443bd4 00007f4a7b443b62 00007f4a7b443a91 00007f4a7b443a0c 00007f4a7b442cc2 00007f4a7b24348c 00007f4a7b2428c6
0709 13:05:39.989733 (+   168us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":767179136}
I20260709 13:05:39.990937 19484 raft_consensus.cc:1240] T 6c5eebf646ad445a9d1b1adc319d7b16 P 0473d2b2d01f4459b1e90fd12cc7840e [term 6 FOLLOWER]: Rejecting Update request from peer 127766fc592545a4997f7790f50f6076 for earlier term 4. Current term is 6. Ops: []
W20260709 13:05:39.993993 22759 log.cc:927] Time spent T 6c5eebf646ad445a9d1b1adc319d7b16 P e61c3a8f61bb48f8a963c9480e53c168: Append to log took a long time: real 0.193s	user 0.000s	sys 0.001s
W20260709 13:05:40.000267 22771 log.cc:927] Time spent T 2b74109013a140ada21feeef92d6f563 P 0473d2b2d01f4459b1e90fd12cc7840e: Append to log took a long time: real 0.058s	user 0.000s	sys 0.000s
I20260709 13:05:40.003340 22526 leader_election.cc:290] T ff9b0eddd810459b82d91c60777c10eb P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:05:39.976400 22682 consensus_queue.cc:237] T b08304a0a02b42d7840c4e8ee9a6bd1a P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:40.004871 19408 raft_consensus.cc:1275] T 179fd671030940b4b4a4e24bcc4aba0a P e5256d91808b47c195bc9b4dbd7f2b87 [term 8 FOLLOWER]: Refusing update from remote peer 0473d2b2d01f4459b1e90fd12cc7840e: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:05:39.989277 22540 leader_election.cc:290] T 46c5bfeecc314717bffe987e6844b6d0 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 14 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:05:40.010249 20108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14935b3ddf914369822e4a0547aaa355" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:05:40.014531 19407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cdf56e38bbc453d9438d359e5a69955" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 12 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:05:40.015846 22722 leader_election.cc:290] T 1f85fc4b527a48848e5faa083b604e36 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:05:40.017050 19407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9962423cb4e54fcfa5de01daf68a86e7" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:05:39.968778 22760 consensus_queue.cc:1059] T 14935b3ddf914369822e4a0547aaa355 P 127766fc592545a4997f7790f50f6076 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 }, Status: INVALID_TERM, Last received: 6.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.049s
I20260709 13:05:40.018586 22760 raft_consensus.cc:3055] T 14935b3ddf914369822e4a0547aaa355 P 127766fc592545a4997f7790f50f6076 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:05:40.018939 22760 raft_consensus.cc:740] T 14935b3ddf914369822e4a0547aaa355 P 127766fc592545a4997f7790f50f6076 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 127766fc592545a4997f7790f50f6076, State: Running, Role: LEADER
W20260709 13:05:39.987921 22620 consensus_meta.cc:287] T f93ee515a9c14139bf566522ed8232f3 P e61c3a8f61bb48f8a963c9480e53c168: Time spent flushing consensus metadata: real 0.533s	user 0.010s	sys 0.002s
I20260709 13:05:40.020150 22551 raft_consensus.cc:3055] T ff75a1d4cb1f493db8f71ddc136ba9ab P e61c3a8f61bb48f8a963c9480e53c168 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:05:40.020776 22551 raft_consensus.cc:740] T ff75a1d4cb1f493db8f71ddc136ba9ab P e61c3a8f61bb48f8a963c9480e53c168 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: e61c3a8f61bb48f8a963c9480e53c168, State: Running, Role: LEADER
I20260709 13:05:40.021570 22551 consensus_queue.cc:260] T ff75a1d4cb1f493db8f71ddc136ba9ab P e61c3a8f61bb48f8a963c9480e53c168 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:40.021626 22760 consensus_queue.cc:260] T 14935b3ddf914369822e4a0547aaa355 P 127766fc592545a4997f7790f50f6076 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.6, Last appended by leader: 6, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } attrs { replace: true } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:05:40.022357 22694 consensus_queue.cc:1048] T edd7d470b5014c9489be7f41f64355c9 P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:05:40.023178 22760 raft_consensus.cc:3060] T 14935b3ddf914369822e4a0547aaa355 P 127766fc592545a4997f7790f50f6076 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:05:40.020941 19551 raft_consensus.cc:2410] T f93ee515a9c14139bf566522ed8232f3 P e61c3a8f61bb48f8a963c9480e53c168 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e5256d91808b47c195bc9b4dbd7f2b87 for term 11 because replica has last-logged OpId of term: 9 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 3.
W20260709 13:05:40.024809 19375 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.3:36891, user_credentials={real_user=slave}} blocked reactor thread for 296859us
I20260709 13:05:40.025727 19402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14935b3ddf914369822e4a0547aaa355" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:05:40.020243 19405 raft_consensus.cc:1240] T b08304a0a02b42d7840c4e8ee9a6bd1a P e5256d91808b47c195bc9b4dbd7f2b87 [term 10 LEADER]: Rejecting Update request from peer 0473d2b2d01f4459b1e90fd12cc7840e for earlier term 9. Current term is 10. Ops: []
I20260709 13:05:40.034116 20110 raft_consensus.cc:1240] T 5ec1c4ce15e04c7e8c283a62179f2a64 P 127766fc592545a4997f7790f50f6076 [term 7 FOLLOWER]: Rejecting Update request from peer 0473d2b2d01f4459b1e90fd12cc7840e for earlier term 6. Current term is 7. Ops: []
W20260709 13:05:40.034925 19403 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52328 (request call id 1680) took 1271 ms (client timeout 1579 ms). Trace:
I20260709 13:05:40.035166 20078 leader_election.cc:304] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 127766fc592545a4997f7790f50f6076; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87
W20260709 13:05:40.035342 19403 rpcz_store.cc:269] 0709 13:05:38.763202 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:38.774234 (+ 11032us) service_pool.cc:224] Handling call
0709 13:05:40.034744 (+1260510us) spinlock_profiling.cc:243] Waited 210 ms on lock 0x7b5400182c54. stack: 00007f4a79de9343 00007f4a79de9240 00007f4a797781d4 00007f4a834b6304 00007f4a834b6299 00007f4a7ce71571 00007f4a7cf0c2fa 00007f4a81ecdb17 00007f4a7b4486d4 00007f4a7b448662 00007f4a7b448591 00007f4a7b44850c 00007f4a7b4477c2 00007f4a7b24348c 00007f4a7b2428c6 00007f4a7b24226f
0709 13:05:40.034869 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":484025600}
I20260709 13:05:40.037132 20078 leader_election.cc:304] T 5ec1c4ce15e04c7e8c283a62179f2a64 P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 127766fc592545a4997f7790f50f6076; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:05:40.037128 19482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff9b0eddd810459b82d91c60777c10eb" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:05:40.039651 19479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e36a9d6e29c4a7c860cf267efbd4c74" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:05:40.043321 19449 leader_election.cc:304] T 14935b3ddf914369822e4a0547aaa355 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e; no voters: 127766fc592545a4997f7790f50f6076, e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:05:40.046478 20111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9962423cb4e54fcfa5de01daf68a86e7" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:05:40.046737 19403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff9b0eddd810459b82d91c60777c10eb" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:05:40.048130 19406 raft_consensus.cc:1275] T 14efcc79969f41babe5529c22d59156d P e5256d91808b47c195bc9b4dbd7f2b87 [term 9 FOLLOWER]: Refusing update from remote peer 0473d2b2d01f4459b1e90fd12cc7840e: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 13:05:40.049015 20110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff9b0eddd810459b82d91c60777c10eb" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:05:40.038386 19482 raft_consensus.cc:2468] T ff9b0eddd810459b82d91c60777c10eb P 0473d2b2d01f4459b1e90fd12cc7840e [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 127766fc592545a4997f7790f50f6076 in term 6.
I20260709 13:05:40.051777 20111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f85fc4b527a48848e5faa083b604e36" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
W20260709 13:05:40.036893 22685 consensus_meta.cc:287] T 85c494af21f9457a85da47b9bc70c1fd P 127766fc592545a4997f7790f50f6076: Time spent flushing consensus metadata: real 0.677s	user 0.012s	sys 0.000s
I20260709 13:05:40.047569 22745 raft_consensus.cc:2749] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P 127766fc592545a4997f7790f50f6076 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:05:40.056936 22693 raft_consensus.cc:515] T f93ee515a9c14139bf566522ed8232f3 P e5256d91808b47c195bc9b4dbd7f2b87 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:39.958529 19377 leader_election.cc:304] T 309c3ca0ca4b4f3ba129752ea2cb293b P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 127766fc592545a4997f7790f50f6076, e5256d91808b47c195bc9b4dbd7f2b87; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168
W20260709 13:05:40.064874 19377 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.2:46257, user_credentials={real_user=slave}} blocked reactor thread for 106380us
I20260709 13:05:40.059070 19486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2725d2c4cb054f18b0fc8f735c15f6c2" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:05:40.059623 19450 leader_election.cc:304] T 2725d2c4cb054f18b0fc8f735c15f6c2 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e; no voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:05:40.059168 22662 consensus_queue.cc:1048] T 48824d5acfbc485ebf8c2d944e7202de P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:05:40.042510 22551 raft_consensus.cc:3060] T ff75a1d4cb1f493db8f71ddc136ba9ab P e61c3a8f61bb48f8a963c9480e53c168 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:05:40.061112 19478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46c5bfeecc314717bffe987e6844b6d0" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 14 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:05:40.036039 22722 raft_consensus.cc:493] T df751f992649444090e27965eb1af85d P 0473d2b2d01f4459b1e90fd12cc7840e [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:40.060258 22752 leader_election.cc:290] T 172b3dd13109415a955b71ac0e9d2234 P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:05:40.047089 22443 raft_consensus.cc:697] T d1e5873a19244c5ebbcd38e126796ee7 P e5256d91808b47c195bc9b4dbd7f2b87 [term 10 LEADER]: Becoming Leader. State: Replica: e5256d91808b47c195bc9b4dbd7f2b87, State: Running, Role: LEADER
I20260709 13:05:40.067274 19449 leader_election.cc:304] T 9962423cb4e54fcfa5de01daf68a86e7 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e; no voters: 127766fc592545a4997f7790f50f6076, e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:05:40.049912 22174 raft_consensus.cc:2749] T 5ec1c4ce15e04c7e8c283a62179f2a64 P 127766fc592545a4997f7790f50f6076 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:05:40.050132 22650 raft_consensus.cc:2749] T 14935b3ddf914369822e4a0547aaa355 P 0473d2b2d01f4459b1e90fd12cc7840e [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:05:40.041532 22526 consensus_queue.cc:1048] T 179fd671030940b4b4a4e24bcc4aba0a P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.032s
W20260709 13:05:40.091044 22765 log.cc:927] Time spent T 1efebf73c86e432baa55533136b6e12c P 0473d2b2d01f4459b1e90fd12cc7840e: Append to log took a long time: real 0.268s	user 0.000s	sys 0.001s
I20260709 13:05:40.091495 22443 consensus_queue.cc:237] T d1e5873a19244c5ebbcd38e126796ee7 P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:40.085858 19449 leader_election.cc:304] T ff9b0eddd810459b82d91c60777c10eb P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e; no voters: 127766fc592545a4997f7790f50f6076, e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:05:40.094863 22744 consensus_queue.cc:1059] T 6c5eebf646ad445a9d1b1adc319d7b16 P 127766fc592545a4997f7790f50f6076 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.044s
I20260709 13:05:40.097483 22706 consensus_queue.cc:1048] T 14efcc79969f41babe5529c22d59156d P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:05:40.097954 22689 raft_consensus.cc:515] T edd7d470b5014c9489be7f41f64355c9 P e5256d91808b47c195bc9b4dbd7f2b87 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:40.100364 22655 raft_consensus.cc:2749] T 2725d2c4cb054f18b0fc8f735c15f6c2 P 0473d2b2d01f4459b1e90fd12cc7840e [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:05:40.102613 19450 leader_election.cc:304] T 2e36a9d6e29c4a7c860cf267efbd4c74 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e; no voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:05:40.083189 21926 raft_consensus.cc:515] T 40e1e16737a842ee936002830f36882e P e5256d91808b47c195bc9b4dbd7f2b87 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:40.122532 21926 leader_election.cc:290] T 40e1e16737a842ee936002830f36882e P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 11 election: Requested vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:05:40.072700 22662 consensus_queue.cc:1243] T 48824d5acfbc485ebf8c2d944e7202de P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Peer e61c3a8f61bb48f8a963c9480e53c168 log is divergent from this leader: its last log entry 7.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
W20260709 13:05:40.133543 19449 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.4:43121, user_credentials={real_user=slave}} blocked reactor thread for 47733.3us
I20260709 13:05:40.134506 22655 raft_consensus.cc:2749] T ff9b0eddd810459b82d91c60777c10eb P 0473d2b2d01f4459b1e90fd12cc7840e [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:05:40.074863 22682 raft_consensus.cc:2749] T 309c3ca0ca4b4f3ba129752ea2cb293b P e5256d91808b47c195bc9b4dbd7f2b87 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 13:05:40.119871 19377 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.2:46257, user_credentials={real_user=slave}} blocked reactor thread for 49292.6us
I20260709 13:05:40.135690 19449 leader_election.cc:304] T 1f85fc4b527a48848e5faa083b604e36 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e; no voters: 127766fc592545a4997f7790f50f6076, e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:05:40.085592 22722 raft_consensus.cc:515] T df751f992649444090e27965eb1af85d P 0473d2b2d01f4459b1e90fd12cc7840e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:40.136708 22710 raft_consensus.cc:2749] T 2e36a9d6e29c4a7c860cf267efbd4c74 P 0473d2b2d01f4459b1e90fd12cc7840e [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:05:40.081072 22702 consensus_queue.cc:1048] T 309c3ca0ca4b4f3ba129752ea2cb293b P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.055s
I20260709 13:05:40.141510 19409 raft_consensus.cc:1240] T edd7d470b5014c9489be7f41f64355c9 P e5256d91808b47c195bc9b4dbd7f2b87 [term 9 FOLLOWER]: Rejecting Update request from peer e61c3a8f61bb48f8a963c9480e53c168 for earlier term 7. Current term is 9. Ops: []
I20260709 13:05:40.061470 22611 consensus_queue.cc:1059] T 5ec1c4ce15e04c7e8c283a62179f2a64 P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.058s
I20260709 13:05:40.066753 22685 raft_consensus.cc:515] T 85c494af21f9457a85da47b9bc70c1fd P 127766fc592545a4997f7790f50f6076 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:05:40.150475 20078 leader_election.cc:304] T ff9b0eddd810459b82d91c60777c10eb P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, 127766fc592545a4997f7790f50f6076; no voters: e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:05:40.150859 22381 consensus_queue.cc:1059] T b08304a0a02b42d7840c4e8ee9a6bd1a P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:05:40.151047 19478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "172b3dd13109415a955b71ac0e9d2234" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 7 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:05:40.154814 19478 raft_consensus.cc:2410] T 172b3dd13109415a955b71ac0e9d2234 P 0473d2b2d01f4459b1e90fd12cc7840e [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 127766fc592545a4997f7790f50f6076 for term 7 because replica has last-logged OpId of term: 5 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 5.
I20260709 13:05:40.154938 22724 raft_consensus.cc:3055] T 1efebf73c86e432baa55533136b6e12c P 127766fc592545a4997f7790f50f6076 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:05:40.155354 22724 raft_consensus.cc:740] T 1efebf73c86e432baa55533136b6e12c P 127766fc592545a4997f7790f50f6076 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 127766fc592545a4997f7790f50f6076, State: Running, Role: LEADER
I20260709 13:05:40.155649 22111 raft_consensus.cc:2804] T ff9b0eddd810459b82d91c60777c10eb P 127766fc592545a4997f7790f50f6076 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:05:40.156072 22111 raft_consensus.cc:493] T ff9b0eddd810459b82d91c60777c10eb P 127766fc592545a4997f7790f50f6076 [term 6 FOLLOWER]: Starting leader election (detected failure of leader e5256d91808b47c195bc9b4dbd7f2b87)
I20260709 13:05:40.156503 22111 raft_consensus.cc:3060] T ff9b0eddd810459b82d91c60777c10eb P 127766fc592545a4997f7790f50f6076 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:05:40.156258 22724 consensus_queue.cc:260] T 1efebf73c86e432baa55533136b6e12c P 127766fc592545a4997f7790f50f6076 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:05:40.157583 22724 raft_consensus.cc:3060] T 1efebf73c86e432baa55533136b6e12c P 127766fc592545a4997f7790f50f6076 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:05:40.135896 19377 leader_election.cc:304] T 179fd671030940b4b4a4e24bcc4aba0a P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:05:40.151512 22650 raft_consensus.cc:2749] T 1f85fc4b527a48848e5faa083b604e36 P 0473d2b2d01f4459b1e90fd12cc7840e [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:05:40.161855 19485 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58286 (request call id 1673) took 2893 ms. Trace:
I20260709 13:05:40.162636 19377 leader_election.cc:304] T 86a6797bdfe94fa496c050ceae4bd0d9 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:05:40.162381 19485 rpcz_store.cc:276] 0709 13:05:37.267967 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:37.487185 (+219218us) service_pool.cc:224] Handling call
0709 13:05:39.197286 (+1710101us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:39.250030 (+ 52744us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:40.161592 (+911562us) spinlock_profiling.cc:243] Waited 1.71 s on lock 0x7b5400343d50. stack: 00007f4a79de9343 00007f4a79de9240 00007f4a797781d4 00007f4a834b6304 00007f4a834b6299 00007f4a7ce71571 00007f4a7cf078ad 00007f4a81ecc419 00007f4a7b443bd4 00007f4a7b443b62 00007f4a7b443a91 00007f4a7b443a0c 00007f4a7b442cc2 00007f4a7b24348c 00007f4a7b2428c6 00007f4a7b24226f
0709 13:05:40.161782 (+   190us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3932145408}
W20260709 13:05:40.153926 22730 consensus_meta.cc:287] T 65d8cb8d6ec64f459d5a47cefab10acf P 127766fc592545a4997f7790f50f6076: Time spent flushing consensus metadata: real 0.699s	user 0.004s	sys 0.007s
I20260709 13:05:40.191795 21926 consensus_queue.cc:1048] T df751f992649444090e27965eb1af85d P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:05:40.159243 22611 raft_consensus.cc:3055] T 5ec1c4ce15e04c7e8c283a62179f2a64 P 0473d2b2d01f4459b1e90fd12cc7840e [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:05:40.162050 22694 raft_consensus.cc:2749] T 9962423cb4e54fcfa5de01daf68a86e7 P 0473d2b2d01f4459b1e90fd12cc7840e [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:05:40.168411 22704 raft_consensus.cc:2749] T 179fd671030940b4b4a4e24bcc4aba0a P e5256d91808b47c195bc9b4dbd7f2b87 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:05:40.201937 21926 consensus_queue.cc:1048] T ef32ce6fdd0e40d382c79974f30295c6 P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:05:40.169378 22676 raft_consensus.cc:2749] T 86a6797bdfe94fa496c050ceae4bd0d9 P e5256d91808b47c195bc9b4dbd7f2b87 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:05:40.202205 19377 leader_election.cc:304] T 7f575b143b844aa096b50997dad3516a P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:05:40.204556 20107 raft_consensus.cc:1240] T 85c494af21f9457a85da47b9bc70c1fd P 127766fc592545a4997f7790f50f6076 [term 5 FOLLOWER]: Rejecting Update request from peer e5256d91808b47c195bc9b4dbd7f2b87 for earlier term 4. Current term is 5. Ops: []
W20260709 13:05:40.222385 20076 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:05:40.227407 22628 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.028s	user 0.001s	sys 0.002s
W20260709 13:05:40.227861 22628 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.044s	user 0.001s	sys 0.003s
I20260709 13:05:40.198127 22650 raft_consensus.cc:493] T 172b3dd13109415a955b71ac0e9d2234 P 0473d2b2d01f4459b1e90fd12cc7840e [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:40.231065 22650 raft_consensus.cc:515] T 172b3dd13109415a955b71ac0e9d2234 P 0473d2b2d01f4459b1e90fd12cc7840e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:05:40.233237 22650 leader_election.cc:290] T 172b3dd13109415a955b71ac0e9d2234 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:05:40.233898 22682 raft_consensus.cc:2749] T 7f575b143b844aa096b50997dad3516a P e5256d91808b47c195bc9b4dbd7f2b87 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:05:40.236027 19402 raft_consensus.cc:1275] T 7f575b143b844aa096b50997dad3516a P e5256d91808b47c195bc9b4dbd7f2b87 [term 4 FOLLOWER]: Refusing update from remote peer 0473d2b2d01f4459b1e90fd12cc7840e: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:05:40.238858 20109 raft_consensus.cc:1275] T 14efcc79969f41babe5529c22d59156d P 127766fc592545a4997f7790f50f6076 [term 9 FOLLOWER]: Refusing update from remote peer 0473d2b2d01f4459b1e90fd12cc7840e: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 13:05:40.243466 19408 raft_consensus.cc:1240] T 5ec1c4ce15e04c7e8c283a62179f2a64 P e5256d91808b47c195bc9b4dbd7f2b87 [term 7 FOLLOWER]: Rejecting Update request from peer 0473d2b2d01f4459b1e90fd12cc7840e for earlier term 6. Current term is 7. Ops: []
I20260709 13:05:40.195595 22611 raft_consensus.cc:740] T 5ec1c4ce15e04c7e8c283a62179f2a64 P 0473d2b2d01f4459b1e90fd12cc7840e [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 0473d2b2d01f4459b1e90fd12cc7840e, State: Running, Role: LEADER
I20260709 13:05:40.246536 22689 leader_election.cc:290] T edd7d470b5014c9489be7f41f64355c9 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 9 election: Requested vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:05:40.246258 22611 consensus_queue.cc:260] T 5ec1c4ce15e04c7e8c283a62179f2a64 P 0473d2b2d01f4459b1e90fd12cc7840e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:05:40.247635 22611 raft_consensus.cc:3060] T 5ec1c4ce15e04c7e8c283a62179f2a64 P 0473d2b2d01f4459b1e90fd12cc7840e [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:05:40.248687 22766 log.cc:927] Time spent T 7f575b143b844aa096b50997dad3516a P 0473d2b2d01f4459b1e90fd12cc7840e: Append to log took a long time: real 0.405s	user 0.001s	sys 0.000s
I20260709 13:05:40.244976 22735 raft_consensus.cc:3055] T 6c5eebf646ad445a9d1b1adc319d7b16 P 127766fc592545a4997f7790f50f6076 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:05:40.252986 19408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "172b3dd13109415a955b71ac0e9d2234" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:05:40.254601 19408 raft_consensus.cc:2468] T 172b3dd13109415a955b71ac0e9d2234 P e5256d91808b47c195bc9b4dbd7f2b87 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 5.
I20260709 13:05:40.257256 19449 leader_election.cc:304] T 172b3dd13109415a955b71ac0e9d2234 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87; no voters: 
I20260709 13:05:40.256070 22710 consensus_queue.cc:1048] T 14efcc79969f41babe5529c22d59156d P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Connected to new peer: Peer: permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.011s
I20260709 13:05:40.190022 22730 raft_consensus.cc:515] T 65d8cb8d6ec64f459d5a47cefab10acf P 127766fc592545a4997f7790f50f6076 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:05:40.269843 20103 raft_consensus.cc:1240] T 65d8cb8d6ec64f459d5a47cefab10acf P 127766fc592545a4997f7790f50f6076 [term 5 FOLLOWER]: Rejecting Update request from peer e5256d91808b47c195bc9b4dbd7f2b87 for earlier term 4. Current term is 5. Ops: []
I20260709 13:05:40.271006 22662 raft_consensus.cc:2804] T 172b3dd13109415a955b71ac0e9d2234 P 0473d2b2d01f4459b1e90fd12cc7840e [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:05:40.271425 22662 raft_consensus.cc:493] T 172b3dd13109415a955b71ac0e9d2234 P 0473d2b2d01f4459b1e90fd12cc7840e [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:40.271756 22662 raft_consensus.cc:3060] T 172b3dd13109415a955b71ac0e9d2234 P 0473d2b2d01f4459b1e90fd12cc7840e [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:05:40.272152 22722 leader_election.cc:290] T df751f992649444090e27965eb1af85d P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:05:40.273294 22732 raft_consensus.cc:3060] T 179fd671030940b4b4a4e24bcc4aba0a P e61c3a8f61bb48f8a963c9480e53c168 [term 6 FOLLOWER]: Advancing to term 8
I20260709 13:05:40.277770 20109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "172b3dd13109415a955b71ac0e9d2234" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:05:40.254014 22735 raft_consensus.cc:740] T 6c5eebf646ad445a9d1b1adc319d7b16 P 127766fc592545a4997f7790f50f6076 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 127766fc592545a4997f7790f50f6076, State: Running, Role: LEADER
I20260709 13:05:40.262413 22685 leader_election.cc:290] T 85c494af21f9457a85da47b9bc70c1fd P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 5 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:05:40.280133 19560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40e1e16737a842ee936002830f36882e" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 11 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:05:40.280982 22730 leader_election.cc:290] T 65d8cb8d6ec64f459d5a47cefab10acf P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 5 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:05:40.281627 19560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edd7d470b5014c9489be7f41f64355c9" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 9 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:05:40.283074 22735 consensus_queue.cc:260] T 6c5eebf646ad445a9d1b1adc319d7b16 P 127766fc592545a4997f7790f50f6076 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
W20260709 13:05:40.285378 22768 log.cc:927] Time spent T bc225c93219c45538b53a1bd3d387e4d P 0473d2b2d01f4459b1e90fd12cc7840e: Append to log took a long time: real 0.572s	user 0.001s	sys 0.001s
W20260709 13:05:40.286787 20076 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:40.290510 20109 raft_consensus.cc:2468] T 172b3dd13109415a955b71ac0e9d2234 P 127766fc592545a4997f7790f50f6076 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 6.
I20260709 13:05:40.295316 22624 raft_consensus.cc:3055] T ed7fdbcb96d14d418db9ca90a792588a P e61c3a8f61bb48f8a963c9480e53c168 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:05:40.295764 22624 raft_consensus.cc:740] T ed7fdbcb96d14d418db9ca90a792588a P e61c3a8f61bb48f8a963c9480e53c168 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: e61c3a8f61bb48f8a963c9480e53c168, State: Running, Role: LEADER
I20260709 13:05:40.296146 22735 raft_consensus.cc:3060] T 6c5eebf646ad445a9d1b1adc319d7b16 P 127766fc592545a4997f7790f50f6076 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:05:40.263298 22704 raft_consensus.cc:493] T fa8650e71aa14778b3d73721fc50d9fc P e5256d91808b47c195bc9b4dbd7f2b87 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 0473d2b2d01f4459b1e90fd12cc7840e)
W20260709 13:05:40.264803 22700 consensus_meta.cc:287] T 22196caba61445d3bec98a0aab3c337d P e5256d91808b47c195bc9b4dbd7f2b87: Time spent flushing consensus metadata: real 0.536s	user 0.010s	sys 0.000s
I20260709 13:05:40.265182 22658 consensus_queue.cc:1048] T 7f575b143b844aa096b50997dad3516a P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:05:40.205379 22374 consensus_queue.cc:1048] T 0cdf56e38bbc453d9438d359e5a69955 P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 4, Time since last communication: 0.060s
I20260709 13:05:40.344305 19558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f93ee515a9c14139bf566522ed8232f3" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 11 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:05:40.345055 19558 raft_consensus.cc:3060] T f93ee515a9c14139bf566522ed8232f3 P e61c3a8f61bb48f8a963c9480e53c168 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:05:40.294397 19523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.1:40321, user_credentials={real_user=slave}} blocked reactor thread for 350335us
I20260709 13:05:40.345674 19479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14efcc79969f41babe5529c22d59156d" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 10 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
W20260709 13:05:40.261214 22699 consensus_meta.cc:287] T 46c5bfeecc314717bffe987e6844b6d0 P e5256d91808b47c195bc9b4dbd7f2b87: Time spent flushing consensus metadata: real 0.547s	user 0.005s	sys 0.003s
I20260709 13:05:40.307677 22625 consensus_queue.cc:1059] T 2725d2c4cb054f18b0fc8f735c15f6c2 P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 }, Status: INVALID_TERM, Last received: 8.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:05:40.307581 22111 raft_consensus.cc:515] T ff9b0eddd810459b82d91c60777c10eb P 127766fc592545a4997f7790f50f6076 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:05:40.355167 19403 raft_consensus.cc:1240] T edd7d470b5014c9489be7f41f64355c9 P e5256d91808b47c195bc9b4dbd7f2b87 [term 9 FOLLOWER]: Rejecting Update request from peer 0473d2b2d01f4459b1e90fd12cc7840e for earlier term 8. Current term is 9. Ops: [8.4-8.4]
W20260709 13:05:40.307451 20078 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:05:40.313022 22790 log.cc:927] Time spent T 14efcc79969f41babe5529c22d59156d P e5256d91808b47c195bc9b4dbd7f2b87: Append to log took a long time: real 0.085s	user 0.002s	sys 0.000s
I20260709 13:05:40.312913 19405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df751f992649444090e27965eb1af85d" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:05:40.314054 22694 consensus_queue.cc:1059] T b08304a0a02b42d7840c4e8ee9a6bd1a P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:05:40.366365 19478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edd7d470b5014c9489be7f41f64355c9" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 9 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:05:40.302775 19560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14935b3ddf914369822e4a0547aaa355" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:05:40.367532 19560 raft_consensus.cc:2468] T 14935b3ddf914369822e4a0547aaa355 P e61c3a8f61bb48f8a963c9480e53c168 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 6.
I20260709 13:05:40.368362 19560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df751f992649444090e27965eb1af85d" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:05:40.315414 22721 raft_consensus.cc:3060] T 0afb57ae58a24a01850491d69f0213dd P 127766fc592545a4997f7790f50f6076 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:05:40.315430 19554 raft_consensus.cc:2410] T 179fd671030940b4b4a4e24bcc4aba0a P e61c3a8f61bb48f8a963c9480e53c168 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 0473d2b2d01f4459b1e90fd12cc7840e for term 8 because replica has last-logged OpId of term: 6 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 4.
I20260709 13:05:40.321342 22624 consensus_queue.cc:260] T ed7fdbcb96d14d418db9ca90a792588a P e61c3a8f61bb48f8a963c9480e53c168 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:05:40.373092 22624 raft_consensus.cc:3060] T ed7fdbcb96d14d418db9ca90a792588a P e61c3a8f61bb48f8a963c9480e53c168 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:05:40.375089 22694 consensus_queue.cc:1243] T b08304a0a02b42d7840c4e8ee9a6bd1a P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Peer e5256d91808b47c195bc9b4dbd7f2b87 log is divergent from this leader: its last log entry 10.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 13:05:40.324762 22749 raft_consensus.cc:515] T 96efeaaf1057492490e9a621f37e1a2d P 127766fc592545a4997f7790f50f6076 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:05:40.325628 22761 consensus_queue.cc:1048] T 40e1e16737a842ee936002830f36882e P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:05:40.325953 19404 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52342 (request call id 2171) took 1382 ms. Trace:
W20260709 13:05:40.326169 19526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.2:46257, user_credentials={real_user=slave}} blocked reactor thread for 329992us
I20260709 13:05:40.337327 18300 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:05:40.339104 19480 raft_consensus.cc:1240] T 6c5eebf646ad445a9d1b1adc319d7b16 P 0473d2b2d01f4459b1e90fd12cc7840e [term 6 FOLLOWER]: Rejecting Update request from peer 127766fc592545a4997f7790f50f6076 for earlier term 4. Current term is 6. Ops: []
I20260709 13:05:40.383575 19404 rpcz_store.cc:276] 0709 13:05:38.943331 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:39.147794 (+204463us) service_pool.cc:224] Handling call
0709 13:05:40.325766 (+1177972us) spinlock_profiling.cc:243] Waited 167 ms on lock 0x7b5400184a54. stack: 00007f4a79de9343 00007f4a79de9240 00007f4a797781d4 00007f4a834b6304 00007f4a834b6299 00007f4a7ce71571 00007f4a7cf0c2fa 00007f4a81ecdb17 00007f4a7b4486d4 00007f4a7b448662 00007f4a7b448591 00007f4a7b44850c 00007f4a7b4477c2 00007f4a7b24348c 00007f4a7b2428c6 00007f4a7b24226f
0709 13:05:40.325893 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":383157632}
W20260709 13:05:40.384240 19526 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:40.341750 19481 pending_rounds.cc:85] T 1dc5b3532fe54f74876d02beffa2c230 P 0473d2b2d01f4459b1e90fd12cc7840e: Aborting all ops after (but not including) 2
I20260709 13:05:40.384968 19481 pending_rounds.cc:107] T 1dc5b3532fe54f74876d02beffa2c230 P 0473d2b2d01f4459b1e90fd12cc7840e: Aborting uncommitted NO_OP operation due to leader change: 6.3
I20260709 13:05:40.385350 19481 raft_consensus.cc:2889] T 1dc5b3532fe54f74876d02beffa2c230 P 0473d2b2d01f4459b1e90fd12cc7840e [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:05:40.349037 19523 leader_election.cc:304] T 217b5fae677b4971b3bbd2f357a1f7ff P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e61c3a8f61bb48f8a963c9480e53c168; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:05:40.351282 19479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40e1e16737a842ee936002830f36882e" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 11 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:05:40.353124 20111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14efcc79969f41babe5529c22d59156d" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 10 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:05:40.387560 19479 raft_consensus.cc:3060] T 40e1e16737a842ee936002830f36882e P 0473d2b2d01f4459b1e90fd12cc7840e [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:05:40.359717 22662 raft_consensus.cc:515] T 172b3dd13109415a955b71ac0e9d2234 P 0473d2b2d01f4459b1e90fd12cc7840e [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:05:40.362504 19551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cdf56e38bbc453d9438d359e5a69955" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 12 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:05:40.366097 20104 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35874 (request call id 638) took 1018 ms. Trace:
I20260709 13:05:40.407269 20104 rpcz_store.cc:276] 0709 13:05:39.331697 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:39.333075 (+  1378us) service_pool.cc:224] Handling call
0709 13:05:39.388404 (+ 55329us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:39.388634 (+   230us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:05:39.388670 (+    36us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:05:39.388720 (+    50us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:05:39.388771 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:39.388843 (+    72us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:40.341121 (+952278us) spinlock_profiling.cc:243] Waited 55.1 ms on lock 0x7b54005555d0. stack: 00007f4a79de9343 00007f4a79de9240 00007f4a797781d4 00007f4a834b6304 00007f4a834b6299 00007f4a7ce71571 00007f4a7cf078ad 00007f4a81ecc419 00007f4a7b443bd4 00007f4a7b443b62 00007f4a7b443a91 00007f4a7b443a0c 00007f4a7b442cc2 00007f4a7b24348c 00007f4a7b2428c6 00007f4a7b24226f
0709 13:05:40.350398 (+  9277us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":126619008}
I20260709 13:05:40.369733 19377 leader_election.cc:304] T edd7d470b5014c9489be7f41f64355c9 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:05:40.363479 19374 leader_election.cc:304] T ab43d85f64114d4ebf618930e43d9ed0 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, 127766fc592545a4997f7790f50f6076
I20260709 13:05:40.401862 19449 leader_election.cc:304] T df751f992649444090e27965eb1af85d P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e; no voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:05:40.404475 20111 raft_consensus.cc:1275] T 1efebf73c86e432baa55533136b6e12c P 127766fc592545a4997f7790f50f6076 [term 6 FOLLOWER]: Refusing update from remote peer 0473d2b2d01f4459b1e90fd12cc7840e: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
W20260709 13:05:40.411743 19374 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.4:43121, user_credentials={real_user=slave}} blocked reactor thread for 48349.5us
I20260709 13:05:40.405670 19478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f93ee515a9c14139bf566522ed8232f3" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 11 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:05:40.412487 19478 raft_consensus.cc:3060] T f93ee515a9c14139bf566522ed8232f3 P 0473d2b2d01f4459b1e90fd12cc7840e [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:05:40.412452 19374 leader_election.cc:304] T 5ec1c4ce15e04c7e8c283a62179f2a64 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 127766fc592545a4997f7790f50f6076, e5256d91808b47c195bc9b4dbd7f2b87; no voters: 0473d2b2d01f4459b1e90fd12cc7840e
I20260709 13:05:40.414471 21926 raft_consensus.cc:2749] T ab43d85f64114d4ebf618930e43d9ed0 P e5256d91808b47c195bc9b4dbd7f2b87 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:05:40.415197 21926 raft_consensus.cc:2804] T 5ec1c4ce15e04c7e8c283a62179f2a64 P e5256d91808b47c195bc9b4dbd7f2b87 [term 7 FOLLOWER]: Leader election won for term 7
W20260709 13:05:40.415709 19525 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:40.417204 19526 leader_election.cc:304] T 0e1085d23e8347fbbd5bce7542f4b1f4 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:05:40.415709 21926 raft_consensus.cc:697] T 5ec1c4ce15e04c7e8c283a62179f2a64 P e5256d91808b47c195bc9b4dbd7f2b87 [term 7 LEADER]: Becoming Leader. State: Replica: e5256d91808b47c195bc9b4dbd7f2b87, State: Running, Role: LEADER
W20260709 13:05:40.417932 19377 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.2:46257, user_credentials={real_user=slave}} blocked reactor thread for 48278.1us
I20260709 13:05:40.418064 19526 leader_election.cc:304] T 3e1f505cb0f1427bbd698ac889d80821 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
W20260709 13:05:40.424652 19523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.1:40321, user_credentials={real_user=slave}} blocked reactor thread for 75712.2us
I20260709 13:05:40.427314 21926 consensus_queue.cc:237] T 5ec1c4ce15e04c7e8c283a62179f2a64 P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:05:40.428151 19526 leader_election.cc:304] T 1dc5b3532fe54f74876d02beffa2c230 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:05:40.426409 19523 leader_election.cc:304] T f1b10566f45d4a7d9029858330e02d5b P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168; no voters: 0473d2b2d01f4459b1e90fd12cc7840e
I20260709 13:05:40.434507 19479 raft_consensus.cc:2468] T 40e1e16737a842ee936002830f36882e P 0473d2b2d01f4459b1e90fd12cc7840e [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 11.
I20260709 13:05:40.434940 19558 raft_consensus.cc:2410] T f93ee515a9c14139bf566522ed8232f3 P e61c3a8f61bb48f8a963c9480e53c168 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate e5256d91808b47c195bc9b4dbd7f2b87 for term 11 because replica has last-logged OpId of term: 9 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 3.
I20260709 13:05:40.436632 19374 leader_election.cc:304] T 14efcc79969f41babe5529c22d59156d P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, 127766fc592545a4997f7790f50f6076
I20260709 13:05:40.362534 22699 raft_consensus.cc:515] T 46c5bfeecc314717bffe987e6844b6d0 P e5256d91808b47c195bc9b4dbd7f2b87 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:40.342311 22704 raft_consensus.cc:515] T fa8650e71aa14778b3d73721fc50d9fc P e5256d91808b47c195bc9b4dbd7f2b87 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:40.464382 19405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65d8cb8d6ec64f459d5a47cefab10acf" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
I20260709 13:05:40.441488 22662 leader_election.cc:290] T 172b3dd13109415a955b71ac0e9d2234 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 7 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:05:40.442288 22779 raft_consensus.cc:2749] T 14efcc79969f41babe5529c22d59156d P e5256d91808b47c195bc9b4dbd7f2b87 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:05:40.443209 19526 leader_election.cc:304] T ef32ce6fdd0e40d382c79974f30295c6 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:05:40.444205 19523 leader_election.cc:304] T 309c3ca0ca4b4f3ba129752ea2cb293b P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: e61c3a8f61bb48f8a963c9480e53c168; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87
W20260709 13:05:40.444643 19525 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:40.444986 22620 raft_consensus.cc:2804] T 1dc5b3532fe54f74876d02beffa2c230 P e61c3a8f61bb48f8a963c9480e53c168 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:05:40.445501 22763 raft_consensus.cc:2804] T f1b10566f45d4a7d9029858330e02d5b P e61c3a8f61bb48f8a963c9480e53c168 [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 13:05:40.446470 20076 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:40.347311 22700 raft_consensus.cc:515] T 22196caba61445d3bec98a0aab3c337d P e5256d91808b47c195bc9b4dbd7f2b87 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:40.459970 22749 leader_election.cc:290] T 96efeaaf1057492490e9a621f37e1a2d P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 8 election: Requested vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:05:40.461004 19406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "172b3dd13109415a955b71ac0e9d2234" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 7 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
W20260709 13:05:40.435969 22794 log.cc:927] Time spent T 4509b76741dc428e9201c70c1658da13 P e61c3a8f61bb48f8a963c9480e53c168: Append to log took a long time: real 0.054s	user 0.000s	sys 0.000s
I20260709 13:05:40.507505 19407 raft_consensus.cc:1240] T 46c5bfeecc314717bffe987e6844b6d0 P e5256d91808b47c195bc9b4dbd7f2b87 [term 14 FOLLOWER]: Rejecting Update request from peer 0473d2b2d01f4459b1e90fd12cc7840e for earlier term 13. Current term is 14. Ops: [13.5-13.5]
I20260709 13:05:40.463424 19404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85c494af21f9457a85da47b9bc70c1fd" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
W20260709 13:05:40.463748 20075 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:05:40.463873 19524 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:05:40.465811 19449 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.1:40321, user_credentials={real_user=slave}} blocked reactor thread for 64035.9us
I20260709 13:05:40.473889 19523 leader_election.cc:304] T 14935b3ddf914369822e4a0547aaa355 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: e61c3a8f61bb48f8a963c9480e53c168; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:05:40.439307 22715 raft_consensus.cc:2749] T 217b5fae677b4971b3bbd2f357a1f7ff P e61c3a8f61bb48f8a963c9480e53c168 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:05:40.477092 19526 leader_election.cc:304] T a08760e15aac4630a629431f56024dc8 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:05:40.424940 22625 raft_consensus.cc:2749] T edd7d470b5014c9489be7f41f64355c9 P e5256d91808b47c195bc9b4dbd7f2b87 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
W20260709 13:05:40.477416 19450 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.3:36891, user_credentials={real_user=slave}} blocked reactor thread for 52507.7us
W20260709 13:05:40.497947 19525 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:40.498016 19558 raft_consensus.cc:1240] T 46c5bfeecc314717bffe987e6844b6d0 P e61c3a8f61bb48f8a963c9480e53c168 [term 14 FOLLOWER]: Rejecting Update request from peer 0473d2b2d01f4459b1e90fd12cc7840e for earlier term 13. Current term is 14. Ops: [13.5-13.5]
I20260709 13:05:40.504058 19406 raft_consensus.cc:2410] T 172b3dd13109415a955b71ac0e9d2234 P e5256d91808b47c195bc9b4dbd7f2b87 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 127766fc592545a4997f7790f50f6076 for term 7 because replica has last-logged OpId of term: 5 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 5.
I20260709 13:05:40.439777 22758 raft_consensus.cc:2804] T 0e1085d23e8347fbbd5bce7542f4b1f4 P e61c3a8f61bb48f8a963c9480e53c168 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:05:40.429136 22540 raft_consensus.cc:493] T bc225c93219c45538b53a1bd3d387e4d P e61c3a8f61bb48f8a963c9480e53c168 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader e5256d91808b47c195bc9b4dbd7f2b87)
I20260709 13:05:40.439102 22750 raft_consensus.cc:2804] T 3e1f505cb0f1427bbd698ac889d80821 P e61c3a8f61bb48f8a963c9480e53c168 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:05:40.462805 22609 raft_consensus.cc:476] T 1a61655d99124a29b486ba4a5b37faea P e5256d91808b47c195bc9b4dbd7f2b87 [term 6 LEADER]: Not starting pre-election -- already a leader
I20260709 13:05:40.510535 19449 leader_election.cc:304] T ab43d85f64114d4ebf618930e43d9ed0 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, 127766fc592545a4997f7790f50f6076; no voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:05:40.522068 19410 raft_consensus.cc:1240] T 22196caba61445d3bec98a0aab3c337d P e5256d91808b47c195bc9b4dbd7f2b87 [term 8 FOLLOWER]: Rejecting Update request from peer 0473d2b2d01f4459b1e90fd12cc7840e for earlier term 7. Current term is 8. Ops: []
I20260709 13:05:40.492885 22628 raft_consensus.cc:2804] T ef32ce6fdd0e40d382c79974f30295c6 P e61c3a8f61bb48f8a963c9480e53c168 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:05:40.486295 22620 raft_consensus.cc:493] T 1dc5b3532fe54f74876d02beffa2c230 P e61c3a8f61bb48f8a963c9480e53c168 [term 7 FOLLOWER]: Starting leader election (detected failure of leader e5256d91808b47c195bc9b4dbd7f2b87)
I20260709 13:05:40.486289 22665 raft_consensus.cc:2749] T df751f992649444090e27965eb1af85d P 0473d2b2d01f4459b1e90fd12cc7840e [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:05:40.486217 22763 raft_consensus.cc:493] T f1b10566f45d4a7d9029858330e02d5b P e61c3a8f61bb48f8a963c9480e53c168 [term 8 FOLLOWER]: Starting leader election (detected failure of leader e5256d91808b47c195bc9b4dbd7f2b87)
I20260709 13:05:40.523029 19555 pending_rounds.cc:85] T 48824d5acfbc485ebf8c2d944e7202de P e61c3a8f61bb48f8a963c9480e53c168: Aborting all ops after (but not including) 6
I20260709 13:05:40.515621 22734 raft_consensus.cc:3060] T 14935b3ddf914369822e4a0547aaa355 P e61c3a8f61bb48f8a963c9480e53c168 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:05:40.557953 19555 pending_rounds.cc:107] T 48824d5acfbc485ebf8c2d944e7202de P e61c3a8f61bb48f8a963c9480e53c168: Aborting uncommitted NO_OP operation due to leader change: 7.7
I20260709 13:05:40.558403 19555 raft_consensus.cc:2889] T 48824d5acfbc485ebf8c2d944e7202de P e61c3a8f61bb48f8a963c9480e53c168 [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:05:40.521178 22611 raft_consensus.cc:493] T f1b10566f45d4a7d9029858330e02d5b P 0473d2b2d01f4459b1e90fd12cc7840e [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:40.544461 22628 raft_consensus.cc:493] T ef32ce6fdd0e40d382c79974f30295c6 P e61c3a8f61bb48f8a963c9480e53c168 [term 9 FOLLOWER]: Starting leader election (detected failure of leader e5256d91808b47c195bc9b4dbd7f2b87)
W20260709 13:05:40.563946 19526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.2:46257, user_credentials={real_user=slave}} blocked reactor thread for 90723us
I20260709 13:05:40.525697 22750 raft_consensus.cc:493] T 3e1f505cb0f1427bbd698ac889d80821 P e61c3a8f61bb48f8a963c9480e53c168 [term 8 FOLLOWER]: Starting leader election (detected failure of leader e5256d91808b47c195bc9b4dbd7f2b87)
I20260709 13:05:40.543046 22612 raft_consensus.cc:2749] T ab43d85f64114d4ebf618930e43d9ed0 P 0473d2b2d01f4459b1e90fd12cc7840e [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:05:40.541354 20111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "172b3dd13109415a955b71ac0e9d2234" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076"
I20260709 13:05:40.572657 20111 raft_consensus.cc:3060] T 172b3dd13109415a955b71ac0e9d2234 P 127766fc592545a4997f7790f50f6076 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:05:40.545930 22758 raft_consensus.cc:697] T 0e1085d23e8347fbbd5bce7542f4b1f4 P e61c3a8f61bb48f8a963c9480e53c168 [term 6 LEADER]: Becoming Leader. State: Replica: e61c3a8f61bb48f8a963c9480e53c168, State: Running, Role: LEADER
I20260709 13:05:40.544039 19478 raft_consensus.cc:2468] T f93ee515a9c14139bf566522ed8232f3 P 0473d2b2d01f4459b1e90fd12cc7840e [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 11.
I20260709 13:05:40.507607 22551 raft_consensus.cc:2749] T 309c3ca0ca4b4f3ba129752ea2cb293b P e61c3a8f61bb48f8a963c9480e53c168 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:05:40.542517 22650 raft_consensus.cc:493] T e381f1d6b8184797ad142de49be225a8 P 0473d2b2d01f4459b1e90fd12cc7840e [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:40.436080 22443 consensus_queue.cc:1059] T 65d8cb8d6ec64f459d5a47cefab10acf P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false }, Status: INVALID_TERM, Last received: 4.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.084s
I20260709 13:05:40.556454 22620 raft_consensus.cc:3060] T 1dc5b3532fe54f74876d02beffa2c230 P e61c3a8f61bb48f8a963c9480e53c168 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:05:40.536439 22540 raft_consensus.cc:515] T bc225c93219c45538b53a1bd3d387e4d P e61c3a8f61bb48f8a963c9480e53c168 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:40.563701 22628 raft_consensus.cc:3060] T ef32ce6fdd0e40d382c79974f30295c6 P e61c3a8f61bb48f8a963c9480e53c168 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:05:40.521747 22732 consensus_queue.cc:1059] T 7be9efa6559648dbb5a0f7684c4542d1 P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } attrs { replace: true }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.042s
I20260709 13:05:40.560416 22763 raft_consensus.cc:3060] T f1b10566f45d4a7d9029858330e02d5b P e61c3a8f61bb48f8a963c9480e53c168 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:05:40.556619 22715 raft_consensus.cc:2804] T a08760e15aac4630a629431f56024dc8 P e61c3a8f61bb48f8a963c9480e53c168 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:05:40.546293 22701 consensus_queue.cc:1048] T 40e1e16737a842ee936002830f36882e P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.029s
I20260709 13:05:40.573563 22750 raft_consensus.cc:3060] T 3e1f505cb0f1427bbd698ac889d80821 P e61c3a8f61bb48f8a963c9480e53c168 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:05:40.588523 19478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96efeaaf1057492490e9a621f37e1a2d" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:05:41.051893 19559 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40428 (request call id 2133) took 1177 ms. Trace:
I20260709 13:05:41.053172 19478 raft_consensus.cc:3060] T 96efeaaf1057492490e9a621f37e1a2d P 0473d2b2d01f4459b1e90fd12cc7840e [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:05:40.555160 22655 consensus_queue.cc:1048] T 1efebf73c86e432baa55533136b6e12c P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Connected to new peer: Peer: permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.035s
W20260709 13:05:40.626808 19526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.2:46257, user_credentials={real_user=slave}} blocked reactor thread for 61675.7us
W20260709 13:05:40.808142 19523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.1:40321, user_credentials={real_user=slave}} blocked reactor thread for 296628us
W20260709 13:05:40.991214 19525 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:05:41.059333 19525 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:05:41.059639 19525 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:05:41.063050 20075 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:41.053311 19559 rpcz_store.cc:276] 0709 13:05:39.874978 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:39.904799 (+ 29821us) service_pool.cc:224] Handling call
0709 13:05:39.905090 (+   291us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:05:39.905430 (+   340us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 13:05:39.907955 (+  2525us) log.cc:844] Serialized 14 byte log entry
0709 13:05:39.995982 (+ 88027us) spinlock_profiling.cc:243] Waited 928 us on lock 0x7b1800429700. stack: 00007f4a79de9343 00007f4a79de9240 00007f4a797781d4 00007f4a834b6304 00007f4a834b6299 00007f4a82ce3de1 00007f4a82cf05b1 00007f4a79dfde07 00007f4a82c58ab9 00007f4a79e1a69b 00007f4a79e1893f 00007f4a79e1ac02 00007f4a7caa220b 00007f4a7caa7d23 00007f4a7caa823a 00007f4a7cf12a2a
0709 13:05:40.341466 (+345484us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:05:40.341874 (+   408us) log.cc:844] Serialized 26 byte log entry
0709 13:05:40.341998 (+   124us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:05:40.541859 (+199861us) log.cc:844] Serialized 14 byte log entry
0709 13:05:40.544506 (+  2647us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:40.544578 (+    72us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:05:41.045430 (+500852us) spinlock_profiling.cc:243] Waited 4.22 ms on lock 0x7b1800429700. stack: 00007f4a79de9343 00007f4a79de9240 00007f4a797781d4 00007f4a834b6304 00007f4a834b6299 00007f4a82ce3de1 00007f4a82cf05b1 00007f4a79e1b3f3 00007f4a79e1d7c1 00007f4a79e1d779 00007f4a79e1d709 00007f4a79e1d6d1 00007f4a79e1c9cd 000000000038f354 000000000038f199 00007f4a79dfe83a
0709 13:05:41.051695 (+  6265us) raft_consensus.cc:1685] finished
0709 13:05:41.051716 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:41.051833 (+   117us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":137120,"prepare.queue_time_us":31938,"prepare.run_cpu_time_us":63,"prepare.run_wall_time_us":63,"raft.queue_time_us":202055,"raft.run_cpu_time_us":250,"raft.run_wall_time_us":29510,"spinlock_wait_cycles":57798528,"thread_start_us":398547,"threads_started":2,"wal-append.queue_time_us":433810}
W20260709 13:05:40.644268 22796 log.cc:927] Time spent T 179fd671030940b4b4a4e24bcc4aba0a P e5256d91808b47c195bc9b4dbd7f2b87: Append to log took a long time: real 0.060s	user 0.001s	sys 0.000s
I20260709 13:05:40.644229 22777 raft_consensus.cc:2749] T 22196caba61445d3bec98a0aab3c337d P e61c3a8f61bb48f8a963c9480e53c168 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 13:05:40.671173 22795 log.cc:927] Time spent T edd7d470b5014c9489be7f41f64355c9 P e61c3a8f61bb48f8a963c9480e53c168: Append to log took a long time: real 0.194s	user 0.000s	sys 0.001s
W20260709 13:05:41.073753 19294 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet ab43d85f64114d4ebf618930e43d9ed0 with cas_config_opid_index 5: ChangeConfig:REMOVE_PEER failed with leader e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica e61c3a8f61bb48f8a963c9480e53c168 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 6 committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } attrs { replace: true } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } } }
I20260709 13:05:40.565209 22611 raft_consensus.cc:515] T f1b10566f45d4a7d9029858330e02d5b P 0473d2b2d01f4459b1e90fd12cc7840e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:41.078761 20109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab43d85f64114d4ebf618930e43d9ed0" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:05:41.080293 22611 leader_election.cc:290] T f1b10566f45d4a7d9029858330e02d5b P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:05:41.080909 19552 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40428 (request call id 2142) took 1111 ms. Trace:
I20260709 13:05:41.081290 19552 rpcz_store.cc:276] 0709 13:05:39.969657 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:39.969792 (+   135us) service_pool.cc:224] Handling call
0709 13:05:39.970171 (+   379us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:05:40.295273 (+325102us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:05:40.295303 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:05:40.295740 (+   437us) log.cc:844] Serialized 26 byte log entry
0709 13:05:40.361377 (+ 65637us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:05:40.363661 (+  2284us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:40.363727 (+    66us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:05:41.080722 (+716995us) raft_consensus.cc:1685] finished
0709 13:05:41.080742 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:41.080855 (+   113us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":399667,"raft.queue_time_us":319220,"raft.run_cpu_time_us":64,"raft.run_wall_time_us":65,"spinlock_wait_cycles":2816,"thread_start_us":65275,"threads_started":1,"wal-append.queue_time_us":89484}
I20260709 13:05:41.083407 19552 pending_rounds.cc:85] T 1a61655d99124a29b486ba4a5b37faea P e61c3a8f61bb48f8a963c9480e53c168: Aborting all ops after (but not including) 2
I20260709 13:05:41.083652 19552 pending_rounds.cc:107] T 1a61655d99124a29b486ba4a5b37faea P e61c3a8f61bb48f8a963c9480e53c168: Aborting uncommitted NO_OP operation due to leader change: 4.3
I20260709 13:05:41.083881 19552 raft_consensus.cc:2889] T 1a61655d99124a29b486ba4a5b37faea P e61c3a8f61bb48f8a963c9480e53c168 [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:05:40.582346 22650 raft_consensus.cc:515] T e381f1d6b8184797ad142de49be225a8 P 0473d2b2d01f4459b1e90fd12cc7840e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:41.084431 22699 leader_election.cc:290] T 46c5bfeecc314717bffe987e6844b6d0 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 14 election: Requested vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:05:41.085862 22650 leader_election.cc:290] T e381f1d6b8184797ad142de49be225a8 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:05:40.627740 22715 raft_consensus.cc:493] T a08760e15aac4630a629431f56024dc8 P e61c3a8f61bb48f8a963c9480e53c168 [term 9 FOLLOWER]: Starting leader election (detected failure of leader e5256d91808b47c195bc9b4dbd7f2b87)
I20260709 13:05:41.086549 22715 raft_consensus.cc:3060] T a08760e15aac4630a629431f56024dc8 P e61c3a8f61bb48f8a963c9480e53c168 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:05:41.087199 19559 raft_consensus.cc:1240] T 2e36a9d6e29c4a7c860cf267efbd4c74 P e61c3a8f61bb48f8a963c9480e53c168 [term 7 FOLLOWER]: Rejecting Update request from peer e5256d91808b47c195bc9b4dbd7f2b87 for earlier term 6. Current term is 7. Ops: []
I20260709 13:05:41.088656 19559 raft_consensus.cc:1275] T 1efebf73c86e432baa55533136b6e12c P e61c3a8f61bb48f8a963c9480e53c168 [term 6 FOLLOWER]: Refusing update from remote peer 0473d2b2d01f4459b1e90fd12cc7840e: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:05:40.638819 22111 leader_election.cc:290] T ff9b0eddd810459b82d91c60777c10eb P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 7 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:05:40.988286 22700 leader_election.cc:290] T 22196caba61445d3bec98a0aab3c337d P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 8 election: Requested vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:05:41.036267 22620 raft_consensus.cc:515] T 1dc5b3532fe54f74876d02beffa2c230 P e61c3a8f61bb48f8a963c9480e53c168 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:41.091115 22808 raft_consensus.cc:493] T d1e5873a19244c5ebbcd38e126796ee7 P e61c3a8f61bb48f8a963c9480e53c168 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:41.091619 22808 raft_consensus.cc:515] T d1e5873a19244c5ebbcd38e126796ee7 P e61c3a8f61bb48f8a963c9480e53c168 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:41.092691 22620 leader_election.cc:290] T 1dc5b3532fe54f74876d02beffa2c230 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 8 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:05:41.037349 22704 leader_election.cc:290] T fa8650e71aa14778b3d73721fc50d9fc P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:05:41.039930 22628 raft_consensus.cc:515] T ef32ce6fdd0e40d382c79974f30295c6 P e61c3a8f61bb48f8a963c9480e53c168 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:41.093506 22808 leader_election.cc:290] T d1e5873a19244c5ebbcd38e126796ee7 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
W20260709 13:05:41.094709 20075 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:41.095070 22628 leader_election.cc:290] T ef32ce6fdd0e40d382c79974f30295c6 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 10 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:05:41.095170 22757 raft_consensus.cc:3055] T 2725d2c4cb054f18b0fc8f735c15f6c2 P e5256d91808b47c195bc9b4dbd7f2b87 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:05:41.041555 22540 leader_election.cc:290] T bc225c93219c45538b53a1bd3d387e4d P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:05:41.095655 22757 raft_consensus.cc:740] T 2725d2c4cb054f18b0fc8f735c15f6c2 P e5256d91808b47c195bc9b4dbd7f2b87 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: e5256d91808b47c195bc9b4dbd7f2b87, State: Running, Role: LEADER
I20260709 13:05:41.095999 19558 raft_consensus.cc:1240] T ef32ce6fdd0e40d382c79974f30295c6 P e61c3a8f61bb48f8a963c9480e53c168 [term 10 FOLLOWER]: Rejecting Update request from peer e5256d91808b47c195bc9b4dbd7f2b87 for earlier term 9. Current term is 10. Ops: []
I20260709 13:05:41.096207 22735 raft_consensus.cc:493] T 833a2f0775ed407a94b8924ce50adb63 P 127766fc592545a4997f7790f50f6076 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader e5256d91808b47c195bc9b4dbd7f2b87)
I20260709 13:05:41.096462 22757 consensus_queue.cc:260] T 2725d2c4cb054f18b0fc8f735c15f6c2 P e5256d91808b47c195bc9b4dbd7f2b87 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.4, Last appended by leader: 4, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:41.096735 22735 raft_consensus.cc:515] T 833a2f0775ed407a94b8924ce50adb63 P 127766fc592545a4997f7790f50f6076 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:05:41.097721 22757 raft_consensus.cc:3060] T 2725d2c4cb054f18b0fc8f735c15f6c2 P e5256d91808b47c195bc9b4dbd7f2b87 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:05:41.098186 19558 raft_consensus.cc:1240] T b08304a0a02b42d7840c4e8ee9a6bd1a P e61c3a8f61bb48f8a963c9480e53c168 [term 10 FOLLOWER]: Rejecting Update request from peer 0473d2b2d01f4459b1e90fd12cc7840e for earlier term 9. Current term is 10. Ops: [9.6-9.6]
I20260709 13:05:41.044219 19486 raft_consensus.cc:1275] T 6c5eebf646ad445a9d1b1adc319d7b16 P 0473d2b2d01f4459b1e90fd12cc7840e [term 6 FOLLOWER]: Refusing update from remote peer e61c3a8f61bb48f8a963c9480e53c168: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:05:41.032922 22551 consensus_queue.cc:1048] T 86a6797bdfe94fa496c050ceae4bd0d9 P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:05:41.101052 22111 raft_consensus.cc:493] T ece3db938bc649d4a40a51522ed5259c P 127766fc592545a4997f7790f50f6076 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader e5256d91808b47c195bc9b4dbd7f2b87)
I20260709 13:05:41.101588 22111 raft_consensus.cc:515] T ece3db938bc649d4a40a51522ed5259c P 127766fc592545a4997f7790f50f6076 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:05:41.043957 22763 raft_consensus.cc:515] T f1b10566f45d4a7d9029858330e02d5b P e61c3a8f61bb48f8a963c9480e53c168 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:41.103966 22810 consensus_queue.cc:1059] T 7f575b143b844aa096b50997dad3516a P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:05:41.104466 22763 leader_election.cc:290] T f1b10566f45d4a7d9029858330e02d5b P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 9 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:05:41.107609 22111 leader_election.cc:290] T ece3db938bc649d4a40a51522ed5259c P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
W20260709 13:05:41.044852 22793 log.cc:927] Time spent T 4509b76741dc428e9201c70c1658da13 P 0473d2b2d01f4459b1e90fd12cc7840e: Append to log took a long time: real 0.484s	user 0.002s	sys 0.013s
I20260709 13:05:41.108980 22813 consensus_queue.cc:1059] T 7f575b143b844aa096b50997dad3516a P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
W20260709 13:05:41.109562 22624 consensus_meta.cc:287] T ed7fdbcb96d14d418db9ca90a792588a P e61c3a8f61bb48f8a963c9480e53c168: Time spent flushing consensus metadata: real 0.736s	user 0.008s	sys 0.013s
I20260709 13:05:41.108750 19556 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40428 (request call id 2144) took 1053 ms. Trace:
I20260709 13:05:41.110769 19556 rpcz_store.cc:276] 0709 13:05:40.054997 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:40.475402 (+420405us) service_pool.cc:224] Handling call
0709 13:05:40.475672 (+   270us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:05:40.493236 (+ 17564us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:05:40.493269 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:05:40.508118 (+ 14849us) log.cc:844] Serialized 26 byte log entry
0709 13:05:40.859005 (+350887us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:05:41.076813 (+217808us) log.cc:844] Serialized 14 byte log entry
0709 13:05:41.108477 (+ 31664us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:41.108545 (+    68us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:05:41.108580 (+    35us) raft_consensus.cc:1685] finished
0709 13:05:41.108592 (+    12us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:41.108697 (+   105us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":33426,"prepare.queue_time_us":247584,"prepare.run_cpu_time_us":37,"prepare.run_wall_time_us":32,"raft.queue_time_us":63841,"raft.run_cpu_time_us":172,"raft.run_wall_time_us":9747,"spinlock_wait_cycles":8448,"thread_start_us":302808,"threads_started":1,"wal-append.queue_time_us":522470}
I20260709 13:05:41.112248 22702 raft_consensus.cc:493] T 217b5fae677b4971b3bbd2f357a1f7ff P 0473d2b2d01f4459b1e90fd12cc7840e [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:41.112612 22735 leader_election.cc:290] T 833a2f0775ed407a94b8924ce50adb63 P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:05:41.047905 20111 raft_consensus.cc:2468] T 172b3dd13109415a955b71ac0e9d2234 P 127766fc592545a4997f7790f50f6076 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 7.
I20260709 13:05:40.598199 22727 raft_consensus.cc:493] T ab43d85f64114d4ebf618930e43d9ed0 P 127766fc592545a4997f7790f50f6076 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:40.676662 22758 consensus_queue.cc:237] T 0e1085d23e8347fbbd5bce7542f4b1f4 P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:05:41.054279 19409 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52328 (request call id 1673) took 2306 ms. Trace:
W20260709 13:05:41.068361 20076 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:41.125363 19409 rpcz_store.cc:276] 0709 13:05:38.744895 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:38.762986 (+ 18091us) service_pool.cc:224] Handling call
0709 13:05:39.992066 (+1229080us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:40.153583 (+161517us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:40.354729 (+201146us) spinlock_profiling.cc:243] Waited 149 ms on lock 0x7b5400183b54. stack: 00007f4a79de9343 00007f4a79de9240 00007f4a797781d4 00007f4a834b6304 00007f4a834b6299 00007f4a7ce71571 00007f4a7cf08e01 00007f4a7cf0783e 00007f4a81ecc419 00007f4a7b443bd4 00007f4a7b443b62 00007f4a7b443a91 00007f4a7b443a0c 00007f4a7b442cc2 00007f4a7b24348c 00007f4a7b2428c6
0709 13:05:41.051332 (+696603us) spinlock_profiling.cc:243] Waited 1.21 s on lock 0x7b5400183b50. stack: 00007f4a79de9343 00007f4a79de9240 00007f4a797781d4 00007f4a834b6304 00007f4a834b6299 00007f4a7ce71571 00007f4a7cf078ad 00007f4a81ecc419 00007f4a7b443bd4 00007f4a7b443b62 00007f4a7b443a91 00007f4a7b443a0c 00007f4a7b442cc2 00007f4a7b24348c 00007f4a7b2428c6 00007f4a7b24226f
0709 13:05:41.051473 (+   141us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3133124352}
I20260709 13:05:41.118016 19478 raft_consensus.cc:2468] T 96efeaaf1057492490e9a621f37e1a2d P 0473d2b2d01f4459b1e90fd12cc7840e [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 127766fc592545a4997f7790f50f6076 in term 8.
W20260709 13:05:41.126479 20076 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:41.112718 22702 raft_consensus.cc:515] T 217b5fae677b4971b3bbd2f357a1f7ff P 0473d2b2d01f4459b1e90fd12cc7840e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:41.115046 19410 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52342 (request call id 2178) took 1113 ms. Trace:
W20260709 13:05:41.065065 22800 log.cc:927] Time spent T ff9b0eddd810459b82d91c60777c10eb P 0473d2b2d01f4459b1e90fd12cc7840e: Append to log took a long time: real 0.474s	user 0.007s	sys 0.009s
I20260709 13:05:41.123507 19556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e381f1d6b8184797ad142de49be225a8" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:05:41.114334 22640 raft_consensus.cc:493] T 6c5eebf646ad445a9d1b1adc319d7b16 P 0473d2b2d01f4459b1e90fd12cc7840e [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:41.123919 19558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1b10566f45d4a7d9029858330e02d5b" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:05:41.140722 19558 raft_consensus.cc:2468] T f1b10566f45d4a7d9029858330e02d5b P e61c3a8f61bb48f8a963c9480e53c168 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 9.
I20260709 13:05:41.140870 19481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff9b0eddd810459b82d91c60777c10eb" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:05:41.140884 19410 rpcz_store.cc:276] 0709 13:05:40.001947 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:40.003489 (+  1542us) service_pool.cc:224] Handling call
0709 13:05:40.003847 (+   358us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:40.537676 (+533829us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:41.114826 (+577150us) spinlock_profiling.cc:243] Waited 518 ms on lock 0x7b5400195d54. stack: 00007f4a79de9343 00007f4a79de9240 00007f4a797781d4 00007f4a834b6304 00007f4a834b6299 00007f4a7ce71571 00007f4a7cf08e01 00007f4a7cf0783e 00007f4a81ecc419 00007f4a7b443bd4 00007f4a7b443b62 00007f4a7b443a91 00007f4a7b443a0c 00007f4a7b442cc2 00007f4a7b24348c 00007f4a7b2428c6
0709 13:05:41.114991 (+   165us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1191440640}
W20260709 13:05:41.135895 19523 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:05:41.119159 22734 consensus_meta.cc:287] T 14935b3ddf914369822e4a0547aaa355 P e61c3a8f61bb48f8a963c9480e53c168: Time spent flushing consensus metadata: real 0.556s	user 0.012s	sys 0.004s
I20260709 13:05:41.146804 19486 raft_consensus.cc:1240] T 40e1e16737a842ee936002830f36882e P 0473d2b2d01f4459b1e90fd12cc7840e [term 11 FOLLOWER]: Rejecting Update request from peer e61c3a8f61bb48f8a963c9480e53c168 for earlier term 10. Current term is 11. Ops: [10.6-10.6]
I20260709 13:05:41.148135 19556 raft_consensus.cc:2468] T e381f1d6b8184797ad142de49be225a8 P e61c3a8f61bb48f8a963c9480e53c168 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 6.
I20260709 13:05:41.146070 20106 raft_consensus.cc:3060] T 6c5eebf646ad445a9d1b1adc319d7b16 P 127766fc592545a4997f7790f50f6076 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:05:41.171720 19478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc225c93219c45538b53a1bd3d387e4d" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:05:41.182763 19481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e5873a19244c5ebbcd38e126796ee7" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:05:41.191994 22702 leader_election.cc:290] T 217b5fae677b4971b3bbd2f357a1f7ff P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:05:41.181137 19486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef32ce6fdd0e40d382c79974f30295c6" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
W20260709 13:05:41.264020 22721 consensus_meta.cc:287] T 0afb57ae58a24a01850491d69f0213dd P 127766fc592545a4997f7790f50f6076: Time spent flushing consensus metadata: real 0.887s	user 0.014s	sys 0.007s
I20260709 13:05:41.264925 22693 leader_election.cc:290] T f93ee515a9c14139bf566522ed8232f3 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 11 election: Requested vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:05:41.264955 20104 raft_consensus.cc:1275] T 0afb57ae58a24a01850491d69f0213dd P 127766fc592545a4997f7790f50f6076 [term 8 FOLLOWER]: Refusing update from remote peer 0473d2b2d01f4459b1e90fd12cc7840e: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:05:41.182339 22624 consensus_queue.cc:1059] T 40e1e16737a842ee936002830f36882e P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.083s
I20260709 13:05:41.266108 22111 raft_consensus.cc:493] T 0afb57ae58a24a01850491d69f0213dd P 127766fc592545a4997f7790f50f6076 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:05:41.204573 19526 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:41.180639 22611 raft_consensus.cc:493] T ed7fdbcb96d14d418db9ca90a792588a P 0473d2b2d01f4459b1e90fd12cc7840e [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:41.268646 22611 raft_consensus.cc:515] T ed7fdbcb96d14d418db9ca90a792588a P 0473d2b2d01f4459b1e90fd12cc7840e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:05:41.188917 19478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dc5b3532fe54f74876d02beffa2c230" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:05:41.270880 19554 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40428 (request call id 2130) took 1399 ms. Trace:
I20260709 13:05:41.271410 19554 rpcz_store.cc:276] 0709 13:05:39.871135 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:39.871913 (+   778us) service_pool.cc:224] Handling call
0709 13:05:41.270602 (+1398689us) spinlock_profiling.cc:243] Waited 439 ms on lock 0x7b540012b954. stack: 00007f4a79de9343 00007f4a79de9240 00007f4a797781d4 00007f4a834b6304 00007f4a834b6299 00007f4a7ce71571 00007f4a7cf0c2fa 00007f4a81ecdb17 00007f4a7b4486d4 00007f4a7b448662 00007f4a7b448591 00007f4a7b44850c 00007f4a7b4477c2 00007f4a7b24348c 00007f4a7b2428c6 00007f4a7b24226f
0709 13:05:41.270807 (+   205us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1010077440}
I20260709 13:05:41.263403 19481 raft_consensus.cc:2468] T d1e5873a19244c5ebbcd38e126796ee7 P 0473d2b2d01f4459b1e90fd12cc7840e [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 10.
I20260709 13:05:41.180336 22658 raft_consensus.cc:493] T 2b74109013a140ada21feeef92d6f563 P 0473d2b2d01f4459b1e90fd12cc7840e [term 5 FOLLOWER]: Starting pre-election (detected failure of leader e5256d91808b47c195bc9b4dbd7f2b87)
I20260709 13:05:41.273105 22658 raft_consensus.cc:515] T 2b74109013a140ada21feeef92d6f563 P 0473d2b2d01f4459b1e90fd12cc7840e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:41.275821 19526 leader_election.cc:304] T d1e5873a19244c5ebbcd38e126796ee7 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:05:41.276949 22712 raft_consensus.cc:2804] T d1e5873a19244c5ebbcd38e126796ee7 P e61c3a8f61bb48f8a963c9480e53c168 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:05:41.277329 22712 raft_consensus.cc:493] T d1e5873a19244c5ebbcd38e126796ee7 P e61c3a8f61bb48f8a963c9480e53c168 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:41.277643 22712 raft_consensus.cc:3060] T d1e5873a19244c5ebbcd38e126796ee7 P e61c3a8f61bb48f8a963c9480e53c168 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:05:41.277685 20106 raft_consensus.cc:1275] T 6c5eebf646ad445a9d1b1adc319d7b16 P 127766fc592545a4997f7790f50f6076 [term 6 FOLLOWER]: Refusing update from remote peer e61c3a8f61bb48f8a963c9480e53c168: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:05:41.274369 19557 raft_consensus.cc:1275] T 179fd671030940b4b4a4e24bcc4aba0a P e61c3a8f61bb48f8a963c9480e53c168 [term 8 FOLLOWER]: Refusing update from remote peer 0473d2b2d01f4459b1e90fd12cc7840e: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 8 index: 5. (term mismatch)
I20260709 13:05:41.279659 19557 pending_rounds.cc:85] T 179fd671030940b4b4a4e24bcc4aba0a P e61c3a8f61bb48f8a963c9480e53c168: Aborting all ops after (but not including) 4
I20260709 13:05:41.280128 19557 pending_rounds.cc:107] T 179fd671030940b4b4a4e24bcc4aba0a P e61c3a8f61bb48f8a963c9480e53c168: Aborting uncommitted NO_OP operation due to leader change: 6.5
I20260709 13:05:41.190645 19559 raft_consensus.cc:3055] T 7f575b143b844aa096b50997dad3516a P e61c3a8f61bb48f8a963c9480e53c168 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:05:41.280725 19557 raft_consensus.cc:2889] T 179fd671030940b4b4a4e24bcc4aba0a P e61c3a8f61bb48f8a963c9480e53c168 [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:05:41.281071 19559 raft_consensus.cc:740] T 7f575b143b844aa096b50997dad3516a P e61c3a8f61bb48f8a963c9480e53c168 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: e61c3a8f61bb48f8a963c9480e53c168, State: Running, Role: LEADER
W20260709 13:05:41.171263 19523 connection.cc:256] RPC call timeout handler was delayed by -1.3405478369999173s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1552s for a response
W20260709 13:05:41.283615 19523 connection.cc:256] RPC call timeout handler was delayed by -1.2901478369999495s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16080000000000003s for a response
W20260709 13:05:41.284106 19523 connection.cc:256] RPC call timeout handler was delayed by -1.2748478369999248s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1625s for a response
W20260709 13:05:41.284474 19523 connection.cc:256] RPC call timeout handler was delayed by -1.0903027499998643s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15880000000000002s for a response
W20260709 13:05:41.284848 19523 connection.cc:256] RPC call timeout handler was delayed by -1.0822478369999544s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1839s for a response
I20260709 13:05:41.286054 19554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96efeaaf1057492490e9a621f37e1a2d" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:05:41.287525 19551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a16f7501e2444fb86d4e2778e734e02" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:05:41.288166 22658 leader_election.cc:290] T 2b74109013a140ada21feeef92d6f563 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:05:41.182145 22662 raft_consensus.cc:493] T 28af091831594f9d8e96482078cc7625 P 0473d2b2d01f4459b1e90fd12cc7840e [term 8 FOLLOWER]: Starting pre-election (detected failure of leader e5256d91808b47c195bc9b4dbd7f2b87)
I20260709 13:05:41.188593 19480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1b10566f45d4a7d9029858330e02d5b" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:05:41.126410 22810 consensus_queue.cc:1048] T 6c5eebf646ad445a9d1b1adc319d7b16 P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.090s
I20260709 13:05:41.181700 19560 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40438 (request call id 2016) took 1138 ms. Trace:
I20260709 13:05:41.203733 19555 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40428 (request call id 2148) took 1035 ms. Trace:
I20260709 13:05:41.291584 19555 rpcz_store.cc:276] 0709 13:05:40.167960 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:40.522399 (+354439us) service_pool.cc:224] Handling call
0709 13:05:40.522822 (+   423us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:05:41.044604 (+521782us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:05:41.044638 (+    34us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:05:41.045226 (+   588us) log.cc:844] Serialized 52 byte log entry
0709 13:05:41.147932 (+102706us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:05:41.184533 (+ 36601us) log.cc:844] Serialized 14 byte log entry
0709 13:05:41.184927 (+   394us) log.cc:844] Serialized 14 byte log entry
0709 13:05:41.185110 (+   183us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:41.185195 (+    85us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:05:41.203470 (+ 18275us) raft_consensus.cc:1685] finished
0709 13:05:41.203495 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:41.203663 (+   168us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":36498,"prepare.run_cpu_time_us":53,"prepare.run_wall_time_us":55,"raft.queue_time_us":25578,"raft.run_cpu_time_us":231,"raft.run_wall_time_us":1829,"thread_start_us":428510,"threads_started":2,"wal-append.queue_time_us":148673}
I20260709 13:05:41.180727 22625 raft_consensus.cc:3055] T 65d8cb8d6ec64f459d5a47cefab10acf P e5256d91808b47c195bc9b4dbd7f2b87 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:05:41.296147 22662 raft_consensus.cc:515] T 28af091831594f9d8e96482078cc7625 P 0473d2b2d01f4459b1e90fd12cc7840e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:41.296686 22625 raft_consensus.cc:740] T 65d8cb8d6ec64f459d5a47cefab10acf P e5256d91808b47c195bc9b4dbd7f2b87 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: e5256d91808b47c195bc9b4dbd7f2b87, State: Running, Role: LEADER
I20260709 13:05:41.297592 22625 consensus_queue.cc:260] T 65d8cb8d6ec64f459d5a47cefab10acf P e5256d91808b47c195bc9b4dbd7f2b87 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.5, Last appended by leader: 5, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:05:41.298271 22662 leader_election.cc:290] T 28af091831594f9d8e96482078cc7625 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
W20260709 13:05:41.194201 22805 log.cc:927] Time spent T 1a61655d99124a29b486ba4a5b37faea P 0473d2b2d01f4459b1e90fd12cc7840e: Append to log took a long time: real 0.206s	user 0.000s	sys 0.003s
I20260709 13:05:41.179971 22761 raft_consensus.cc:3055] T 7be9efa6559648dbb5a0f7684c4542d1 P e61c3a8f61bb48f8a963c9480e53c168 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:05:41.303869 22761 raft_consensus.cc:740] T 7be9efa6559648dbb5a0f7684c4542d1 P e61c3a8f61bb48f8a963c9480e53c168 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: e61c3a8f61bb48f8a963c9480e53c168, State: Running, Role: LEADER
I20260709 13:05:41.289018 22611 leader_election.cc:290] T ed7fdbcb96d14d418db9ca90a792588a P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:05:41.258565 22703 raft_consensus.cc:493] T 7be9efa6559648dbb5a0f7684c4542d1 P 0473d2b2d01f4459b1e90fd12cc7840e [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:41.281917 19559 consensus_queue.cc:260] T 7f575b143b844aa096b50997dad3516a P e61c3a8f61bb48f8a963c9480e53c168 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:41.151398 22734 raft_consensus.cc:2749] T 14935b3ddf914369822e4a0547aaa355 P e61c3a8f61bb48f8a963c9480e53c168 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:05:41.150604 22640 raft_consensus.cc:515] T 6c5eebf646ad445a9d1b1adc319d7b16 P 0473d2b2d01f4459b1e90fd12cc7840e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:05:41.208993 22715 raft_consensus.cc:515] T a08760e15aac4630a629431f56024dc8 P e61c3a8f61bb48f8a963c9480e53c168 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:41.179241 22711 raft_consensus.cc:493] T 0afb57ae58a24a01850491d69f0213dd P e61c3a8f61bb48f8a963c9480e53c168 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:41.200896 22750 raft_consensus.cc:515] T 3e1f505cb0f1427bbd698ac889d80821 P e61c3a8f61bb48f8a963c9480e53c168 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:41.309468 19553 raft_consensus.cc:1240] T 3e1f505cb0f1427bbd698ac889d80821 P e61c3a8f61bb48f8a963c9480e53c168 [term 9 FOLLOWER]: Rejecting Update request from peer e5256d91808b47c195bc9b4dbd7f2b87 for earlier term 8. Current term is 9. Ops: []
I20260709 13:05:41.178926 22369 raft_consensus.cc:3055] T b08304a0a02b42d7840c4e8ee9a6bd1a P 0473d2b2d01f4459b1e90fd12cc7840e [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:05:41.180143 22813 raft_consensus.cc:493] T 96efeaaf1057492490e9a621f37e1a2d P e61c3a8f61bb48f8a963c9480e53c168 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:41.299870 19480 raft_consensus.cc:2393] T f1b10566f45d4a7d9029858330e02d5b P 0473d2b2d01f4459b1e90fd12cc7840e [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate e61c3a8f61bb48f8a963c9480e53c168 in current term 9: Already voted for candidate 0473d2b2d01f4459b1e90fd12cc7840e in this term.
I20260709 13:05:41.312135 19559 raft_consensus.cc:3060] T 7f575b143b844aa096b50997dad3516a P e61c3a8f61bb48f8a963c9480e53c168 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:05:41.187223 20107 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35874 (request call id 635) took 1856 ms. Trace:
I20260709 13:05:41.299353 22625 raft_consensus.cc:3060] T 65d8cb8d6ec64f459d5a47cefab10acf P e5256d91808b47c195bc9b4dbd7f2b87 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:05:41.289888 19560 rpcz_store.cc:276] 0709 13:05:40.043548 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:40.384742 (+341194us) service_pool.cc:224] Handling call
0709 13:05:40.385064 (+   322us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:05:40.424134 (+ 39070us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:05:40.424163 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:05:40.435659 (+ 11496us) log.cc:844] Serialized 26 byte log entry
0709 13:05:40.588652 (+152993us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:05:40.588691 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:40.588764 (+    73us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:05:41.181499 (+592735us) raft_consensus.cc:1685] finished
0709 13:05:41.181520 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:41.181643 (+   123us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":33647,"raft.queue_time_us":44035,"raft.run_cpu_time_us":107,"raft.run_wall_time_us":23203,"thread_start_us":95374,"threads_started":1,"wal-append.queue_time_us":680594}
I20260709 13:05:41.314567 19551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa731b585f684a7fb2d106c50f143b83" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:05:41.312893 20107 rpcz_store.cc:276] 0709 13:05:39.330718 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:39.334799 (+  4081us) service_pool.cc:224] Handling call
0709 13:05:39.335147 (+   348us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:40.207274 (+872127us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:41.186945 (+979671us) spinlock_profiling.cc:243] Waited 832 ms on lock 0x7b54002d5ad4. stack: 00007f4a79de9343 00007f4a79de9240 00007f4a797781d4 00007f4a834b6304 00007f4a834b6299 00007f4a7ce71571 00007f4a7cf08e01 00007f4a7cf0783e 00007f4a81ecc419 00007f4a7b443bd4 00007f4a7b443b62 00007f4a7b443a91 00007f4a7b443a0c 00007f4a7b442cc2 00007f4a7b24348c 00007f4a7b2428c6
0709 13:05:41.187143 (+   198us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1914138880}
I20260709 13:05:41.318384 22730 raft_consensus.cc:493] T 1efebf73c86e432baa55533136b6e12c P 127766fc592545a4997f7790f50f6076 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:41.306100 19555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4af19371ea874c09a0a2147040835cbb" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:05:41.289147 22624 raft_consensus.cc:493] T f93ee515a9c14139bf566522ed8232f3 P e61c3a8f61bb48f8a963c9480e53c168 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:41.134547 22727 raft_consensus.cc:515] T ab43d85f64114d4ebf618930e43d9ed0 P 127766fc592545a4997f7790f50f6076 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } attrs { replace: true } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:05:41.311468 22369 raft_consensus.cc:740] T b08304a0a02b42d7840c4e8ee9a6bd1a P 0473d2b2d01f4459b1e90fd12cc7840e [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 0473d2b2d01f4459b1e90fd12cc7840e, State: Running, Role: LEADER
I20260709 13:05:41.324728 19551 raft_consensus.cc:1240] T 14935b3ddf914369822e4a0547aaa355 P e61c3a8f61bb48f8a963c9480e53c168 [term 7 FOLLOWER]: Rejecting Update request from peer 127766fc592545a4997f7790f50f6076 for earlier term 6. Current term is 7. Ops: []
I20260709 13:05:41.289309 22111 raft_consensus.cc:515] T 0afb57ae58a24a01850491d69f0213dd P 127766fc592545a4997f7790f50f6076 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:05:41.340631 20075 leader_election.cc:304] T 172b3dd13109415a955b71ac0e9d2234 P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 127766fc592545a4997f7790f50f6076; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:05:41.343776 19449 leader_election.cc:304] T 172b3dd13109415a955b71ac0e9d2234 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, 127766fc592545a4997f7790f50f6076; no voters: 
I20260709 13:05:41.347728 20078 leader_election.cc:304] T 96efeaaf1057492490e9a621f37e1a2d P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, 127766fc592545a4997f7790f50f6076; no voters: 
I20260709 13:05:41.308987 22711 raft_consensus.cc:515] T 0afb57ae58a24a01850491d69f0213dd P e61c3a8f61bb48f8a963c9480e53c168 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:05:41.321695 22701 raft_consensus.cc:3055] T 40e1e16737a842ee936002830f36882e P e61c3a8f61bb48f8a963c9480e53c168 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:05:41.364595 19551 raft_consensus.cc:1240] T 1efebf73c86e432baa55533136b6e12c P e61c3a8f61bb48f8a963c9480e53c168 [term 6 FOLLOWER]: Rejecting Update request from peer 127766fc592545a4997f7790f50f6076 for earlier term 5. Current term is 6. Ops: []
I20260709 13:05:41.373695 20109 raft_consensus.cc:2393] T ab43d85f64114d4ebf618930e43d9ed0 P 127766fc592545a4997f7790f50f6076 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e61c3a8f61bb48f8a963c9480e53c168 in current term 7: Already voted for candidate 0473d2b2d01f4459b1e90fd12cc7840e in this term.
I20260709 13:05:41.350117 22662 raft_consensus.cc:493] T b9f0d59553ad444883fcf5b5909f9798 P 0473d2b2d01f4459b1e90fd12cc7840e [term 8 FOLLOWER]: Starting pre-election (detected failure of leader e61c3a8f61bb48f8a963c9480e53c168)
I20260709 13:05:41.376438 19407 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52342 (request call id 2185) took 1355 ms. Trace:
I20260709 13:05:41.325834 22721 raft_consensus.cc:493] T ed7fdbcb96d14d418db9ca90a792588a P 127766fc592545a4997f7790f50f6076 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:41.381338 19407 rpcz_store.cc:276] 0709 13:05:40.020945 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:40.021100 (+   155us) service_pool.cc:224] Handling call
0709 13:05:40.021507 (+   407us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:05:40.511904 (+490397us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:41.376103 (+864199us) spinlock_profiling.cc:243] Waited 482 ms on lock 0x7b5400239e54. stack: 00007f4a79de9343 00007f4a79de9240 00007f4a797781d4 00007f4a834b6304 00007f4a834b6299 00007f4a7ce71571 00007f4a7cf08e01 00007f4a7cf0783e 00007f4a81ecc419 00007f4a7b443bd4 00007f4a7b443b62 00007f4a7b443a91 00007f4a7b443a0c 00007f4a7b442cc2 00007f4a7b24348c 00007f4a7b2428c6
0709 13:05:41.376346 (+   243us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1109283712}
I20260709 13:05:41.321187 22813 raft_consensus.cc:515] T 96efeaaf1057492490e9a621f37e1a2d P e61c3a8f61bb48f8a963c9480e53c168 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:05:41.379359 19403 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52342 (request call id 2187) took 1327 ms. Trace:
I20260709 13:05:41.359227 22760 raft_consensus.cc:2749] T 172b3dd13109415a955b71ac0e9d2234 P 127766fc592545a4997f7790f50f6076 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:05:41.310128 22703 raft_consensus.cc:515] T 7be9efa6559648dbb5a0f7684c4542d1 P 0473d2b2d01f4459b1e90fd12cc7840e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } attrs { replace: true } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:05:41.389067 19403 rpcz_store.cc:276] 0709 13:05:40.052311 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:40.052424 (+   113us) service_pool.cc:224] Handling call
0709 13:05:40.354925 (+302501us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:05:40.355570 (+   645us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:41.379157 (+1023587us) spinlock_profiling.cc:243] Waited 296 ms on lock 0x7b5400183b50. stack: 00007f4a79de9343 00007f4a79de9240 00007f4a797781d4 00007f4a834b6304 00007f4a834b6299 00007f4a7ce71571 00007f4a7cf078ad 00007f4a81ecc419 00007f4a7b443bd4 00007f4a7b443b62 00007f4a7b443a91 00007f4a7b443a0c 00007f4a7b442cc2 00007f4a7b24348c 00007f4a7b2428c6 00007f4a7b24226f
0709 13:05:41.379294 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":681177344}
I20260709 13:05:41.371265 22611 raft_consensus.cc:2804] T 172b3dd13109415a955b71ac0e9d2234 P 0473d2b2d01f4459b1e90fd12cc7840e [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:05:41.363785 22735 raft_consensus.cc:2804] T 96efeaaf1057492490e9a621f37e1a2d P 127766fc592545a4997f7790f50f6076 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:05:41.387238 19551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85c494af21f9457a85da47b9bc70c1fd" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:05:41.322968 22730 raft_consensus.cc:515] T 1efebf73c86e432baa55533136b6e12c P 127766fc592545a4997f7790f50f6076 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:05:41.392953 19402 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52342 (request call id 2195) took 1062 ms. Trace:
I20260709 13:05:41.414557 19402 rpcz_store.cc:276] 0709 13:05:40.330822 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:40.330960 (+   138us) service_pool.cc:224] Handling call
0709 13:05:40.331231 (+   271us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:40.509078 (+177847us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:05:40.509130 (+    52us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:05:40.509184 (+    54us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:05:40.509234 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:41.392689 (+883455us) spinlock_profiling.cc:243] Waited 178 ms on lock 0x7b54000e5bd4. stack: 00007f4a79de9343 00007f4a79de9240 00007f4a797781d4 00007f4a834b6304 00007f4a834b6299 00007f4a7ce71571 00007f4a7cf08e01 00007f4a7cf0783e 00007f4a81ecc419 00007f4a7b443bd4 00007f4a7b443b62 00007f4a7b443a91 00007f4a7b443a0c 00007f4a7b442cc2 00007f4a7b24348c 00007f4a7b2428c6
0709 13:05:41.392746 (+    57us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:41.392884 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":408512256}
I20260709 13:05:41.389176 22662 raft_consensus.cc:515] T b9f0d59553ad444883fcf5b5909f9798 P 0473d2b2d01f4459b1e90fd12cc7840e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:41.366835 22701 raft_consensus.cc:740] T 40e1e16737a842ee936002830f36882e P e61c3a8f61bb48f8a963c9480e53c168 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: e61c3a8f61bb48f8a963c9480e53c168, State: Running, Role: LEADER
I20260709 13:05:41.388132 20107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed7fdbcb96d14d418db9ca90a792588a" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:05:41.371364 22702 raft_consensus.cc:493] T ff75a1d4cb1f493db8f71ddc136ba9ab P 0473d2b2d01f4459b1e90fd12cc7840e [term 6 FOLLOWER]: Starting pre-election (detected failure of leader e61c3a8f61bb48f8a963c9480e53c168)
I20260709 13:05:41.325984 22624 raft_consensus.cc:515] T f93ee515a9c14139bf566522ed8232f3 P e61c3a8f61bb48f8a963c9480e53c168 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:41.404973 19560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28af091831594f9d8e96482078cc7625" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:05:41.426016 19560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b74109013a140ada21feeef92d6f563" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:05:41.400403 19553 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40438 (request call id 2022) took 1355 ms. Trace:
W20260709 13:05:41.400971 19376 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:41.427147 19484 raft_consensus.cc:1240] T 7be9efa6559648dbb5a0f7684c4542d1 P 0473d2b2d01f4459b1e90fd12cc7840e [term 8 FOLLOWER]: Rejecting Update request from peer e61c3a8f61bb48f8a963c9480e53c168 for earlier term 7. Current term is 8. Ops: []
I20260709 13:05:41.406461 19555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "217b5fae677b4971b3bbd2f357a1f7ff" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:05:41.428565 19555 raft_consensus.cc:2468] T 217b5fae677b4971b3bbd2f357a1f7ff P e61c3a8f61bb48f8a963c9480e53c168 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 5.
I20260709 13:05:41.429631 19555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22196caba61445d3bec98a0aab3c337d" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:05:41.431066 19480 raft_consensus.cc:1240] T 40e1e16737a842ee936002830f36882e P 0473d2b2d01f4459b1e90fd12cc7840e [term 11 FOLLOWER]: Rejecting Update request from peer e61c3a8f61bb48f8a963c9480e53c168 for earlier term 10. Current term is 11. Ops: [10.6-10.6]
I20260709 13:05:41.431713 19555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65d8cb8d6ec64f459d5a47cefab10acf" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:05:41.432833 22611 raft_consensus.cc:697] T 172b3dd13109415a955b71ac0e9d2234 P 0473d2b2d01f4459b1e90fd12cc7840e [term 7 LEADER]: Becoming Leader. State: Replica: 0473d2b2d01f4459b1e90fd12cc7840e, State: Running, Role: LEADER
I20260709 13:05:41.433586 19560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c5eebf646ad445a9d1b1adc319d7b16" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:05:41.432854 19555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed7fdbcb96d14d418db9ca90a792588a" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:05:41.434412 19555 raft_consensus.cc:2468] T ed7fdbcb96d14d418db9ca90a792588a P e61c3a8f61bb48f8a963c9480e53c168 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 5.
I20260709 13:05:41.434638 19560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96efeaaf1057492490e9a621f37e1a2d" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:05:41.404247 19450 leader_election.cc:304] T 0cdf56e38bbc453d9438d359e5a69955 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e; no voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:05:41.410866 22722 consensus_queue.cc:1048] T 0afb57ae58a24a01850491d69f0213dd P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Connected to new peer: Peer: permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:05:41.413609 22727 leader_election.cc:290] T ab43d85f64114d4ebf618930e43d9ed0 P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:05:41.418733 19554 raft_consensus.cc:2468] T 96efeaaf1057492490e9a621f37e1a2d P e61c3a8f61bb48f8a963c9480e53c168 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 127766fc592545a4997f7790f50f6076 in term 7.
I20260709 13:05:41.419730 19551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa8650e71aa14778b3d73721fc50d9fc" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:05:41.449337 19551 raft_consensus.cc:1275] T 0afb57ae58a24a01850491d69f0213dd P e61c3a8f61bb48f8a963c9480e53c168 [term 8 FOLLOWER]: Refusing update from remote peer 0473d2b2d01f4459b1e90fd12cc7840e: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:05:41.427033 19553 rpcz_store.cc:276] 0709 13:05:40.045296 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:40.456212 (+410916us) service_pool.cc:224] Handling call
0709 13:05:40.456497 (+   285us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:41.311244 (+854747us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:41.400198 (+ 88954us) spinlock_profiling.cc:243] Waited 853 ms on lock 0x7b5400341f54. stack: 00007f4a79de9343 00007f4a79de9240 00007f4a797781d4 00007f4a834b6304 00007f4a834b6299 00007f4a7ce71571 00007f4a7cf08e01 00007f4a7cf0783e 00007f4a81ecc419 00007f4a7b443bd4 00007f4a7b443b62 00007f4a7b443a91 00007f4a7b443a0c 00007f4a7b442cc2 00007f4a7b24348c 00007f4a7b2428c6
0709 13:05:41.400351 (+   153us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1961317760}
I20260709 13:05:41.435168 19555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46c5bfeecc314717bffe987e6844b6d0" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 14 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
W20260709 13:05:41.450340 20075 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:41.450472 19555 raft_consensus.cc:2393] T 46c5bfeecc314717bffe987e6844b6d0 P e61c3a8f61bb48f8a963c9480e53c168 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate e5256d91808b47c195bc9b4dbd7f2b87 in current term 14: Already voted for candidate e61c3a8f61bb48f8a963c9480e53c168 in this term.
I20260709 13:05:41.445106 19559 raft_consensus.cc:1275] T 7f575b143b844aa096b50997dad3516a P e61c3a8f61bb48f8a963c9480e53c168 [term 4 FOLLOWER]: Refusing update from remote peer 0473d2b2d01f4459b1e90fd12cc7840e: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:05:41.325801 22761 consensus_queue.cc:260] T 7be9efa6559648dbb5a0f7684c4542d1 P e61c3a8f61bb48f8a963c9480e53c168 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.6, Last appended by leader: 6, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } attrs { replace: true } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:05:41.446686 22551 raft_consensus.cc:493] T 179fd671030940b4b4a4e24bcc4aba0a P e61c3a8f61bb48f8a963c9480e53c168 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:41.445830 22658 consensus_queue.cc:1059] T edd7d470b5014c9489be7f41f64355c9 P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.027s
I20260709 13:05:41.461161 22551 raft_consensus.cc:515] T 179fd671030940b4b4a4e24bcc4aba0a P e61c3a8f61bb48f8a963c9480e53c168 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:41.456156 22712 raft_consensus.cc:515] T d1e5873a19244c5ebbcd38e126796ee7 P e61c3a8f61bb48f8a963c9480e53c168 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:41.463200 22551 leader_election.cc:290] T 179fd671030940b4b4a4e24bcc4aba0a P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:05:41.464566 22712 leader_election.cc:290] T d1e5873a19244c5ebbcd38e126796ee7 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 11 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
W20260709 13:05:41.456964 22763 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 4 current term: 4 is higher.
I20260709 13:05:41.459775 22682 raft_consensus.cc:493] T e381f1d6b8184797ad142de49be225a8 P e5256d91808b47c195bc9b4dbd7f2b87 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 0473d2b2d01f4459b1e90fd12cc7840e)
I20260709 13:05:41.467350 22682 raft_consensus.cc:515] T e381f1d6b8184797ad142de49be225a8 P e5256d91808b47c195bc9b4dbd7f2b87 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:41.460489 22693 raft_consensus.cc:493] T f1b10566f45d4a7d9029858330e02d5b P e5256d91808b47c195bc9b4dbd7f2b87 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:41.469823 22693 raft_consensus.cc:515] T f1b10566f45d4a7d9029858330e02d5b P e5256d91808b47c195bc9b4dbd7f2b87 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:41.471760 22693 leader_election.cc:290] T f1b10566f45d4a7d9029858330e02d5b P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:05:41.389870 22721 raft_consensus.cc:515] T ed7fdbcb96d14d418db9ca90a792588a P 127766fc592545a4997f7790f50f6076 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:05:41.472328 22703 leader_election.cc:290] T 7be9efa6559648dbb5a0f7684c4542d1 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:05:41.472836 20107 raft_consensus.cc:2468] T ed7fdbcb96d14d418db9ca90a792588a P 127766fc592545a4997f7790f50f6076 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 5.
I20260709 13:05:41.422863 22735 raft_consensus.cc:697] T 96efeaaf1057492490e9a621f37e1a2d P 127766fc592545a4997f7790f50f6076 [term 8 LEADER]: Becoming Leader. State: Replica: 127766fc592545a4997f7790f50f6076, State: Running, Role: LEADER
I20260709 13:05:41.476356 19559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ece3db938bc649d4a40a51522ed5259c" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:05:41.424892 22650 consensus_queue.cc:1059] T 22196caba61445d3bec98a0aab3c337d P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.052s
I20260709 13:05:41.488194 19559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "833a2f0775ed407a94b8924ce50adb63" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:05:41.428340 22702 raft_consensus.cc:515] T ff75a1d4cb1f493db8f71ddc136ba9ab P 0473d2b2d01f4459b1e90fd12cc7840e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:41.428469 22710 consensus_queue.cc:1059] T 46c5bfeecc314717bffe987e6844b6d0 P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 }, Status: INVALID_TERM, Last received: 9.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.053s
I20260709 13:05:41.488621 19523 leader_election.cc:304] T 833a2f0775ed407a94b8924ce50adb63 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e61c3a8f61bb48f8a963c9480e53c168; no voters: 127766fc592545a4997f7790f50f6076, e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:05:41.398826 22369 consensus_queue.cc:260] T b08304a0a02b42d7840c4e8ee9a6bd1a P 0473d2b2d01f4459b1e90fd12cc7840e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:41.474258 22750 leader_election.cc:290] T 3e1f505cb0f1427bbd698ac889d80821 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 9 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:05:41.473730 22640 leader_election.cc:290] T 6c5eebf646ad445a9d1b1adc319d7b16 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:05:41.490583 19377 leader_election.cc:304] T 40e1e16737a842ee936002830f36882e P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87; no voters: e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:05:41.501044 19377 leader_election.cc:304] T f93ee515a9c14139bf566522ed8232f3 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87; no voters: 
I20260709 13:05:41.502251 22821 raft_consensus.cc:2804] T 40e1e16737a842ee936002830f36882e P e5256d91808b47c195bc9b4dbd7f2b87 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:05:41.502787 22821 raft_consensus.cc:697] T 40e1e16737a842ee936002830f36882e P e5256d91808b47c195bc9b4dbd7f2b87 [term 11 LEADER]: Becoming Leader. State: Replica: e5256d91808b47c195bc9b4dbd7f2b87, State: Running, Role: LEADER
I20260709 13:05:41.503000 22730 leader_election.cc:290] T 1efebf73c86e432baa55533136b6e12c P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:05:41.492096 22658 raft_consensus.cc:3055] T edd7d470b5014c9489be7f41f64355c9 P 0473d2b2d01f4459b1e90fd12cc7840e [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:05:41.503666 22658 raft_consensus.cc:740] T edd7d470b5014c9489be7f41f64355c9 P 0473d2b2d01f4459b1e90fd12cc7840e [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 0473d2b2d01f4459b1e90fd12cc7840e, State: Running, Role: LEADER
I20260709 13:05:41.503815 22821 consensus_queue.cc:237] T 40e1e16737a842ee936002830f36882e P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:41.504508 22658 consensus_queue.cc:260] T edd7d470b5014c9489be7f41f64355c9 P 0473d2b2d01f4459b1e90fd12cc7840e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 8.4, Last appended by leader: 4, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:41.505628 22658 raft_consensus.cc:3060] T edd7d470b5014c9489be7f41f64355c9 P 0473d2b2d01f4459b1e90fd12cc7840e [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:05:41.507772 22693 raft_consensus.cc:2804] T f93ee515a9c14139bf566522ed8232f3 P e5256d91808b47c195bc9b4dbd7f2b87 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:05:41.486251 22703 raft_consensus.cc:2749] T 0cdf56e38bbc453d9438d359e5a69955 P 0473d2b2d01f4459b1e90fd12cc7840e [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:05:41.521144 19523 leader_election.cc:304] T 85c494af21f9457a85da47b9bc70c1fd P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 127766fc592545a4997f7790f50f6076, e61c3a8f61bb48f8a963c9480e53c168; no voters: e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:05:41.495395 22682 leader_election.cc:290] T e381f1d6b8184797ad142de49be225a8 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:05:41.499228 22712 raft_consensus.cc:2749] T 833a2f0775ed407a94b8924ce50adb63 P e61c3a8f61bb48f8a963c9480e53c168 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 13:05:41.551865 19452 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:41.508278 22693 raft_consensus.cc:697] T f93ee515a9c14139bf566522ed8232f3 P e5256d91808b47c195bc9b4dbd7f2b87 [term 11 LEADER]: Becoming Leader. State: Replica: e5256d91808b47c195bc9b4dbd7f2b87, State: Running, Role: LEADER
I20260709 13:05:41.507772 22813 leader_election.cc:290] T 96efeaaf1057492490e9a621f37e1a2d P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
W20260709 13:05:41.574120 20076 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.3:36891, user_credentials={real_user=slave}} blocked reactor thread for 239271us
I20260709 13:05:41.558981 19523 leader_election.cc:304] T 1efebf73c86e432baa55533136b6e12c P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e61c3a8f61bb48f8a963c9480e53c168; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, 127766fc592545a4997f7790f50f6076
I20260709 13:05:41.486192 22701 consensus_queue.cc:260] T 40e1e16737a842ee936002830f36882e P e61c3a8f61bb48f8a963c9480e53c168 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:41.474967 22611 consensus_queue.cc:237] T 172b3dd13109415a955b71ac0e9d2234 P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
W20260709 13:05:41.550104 19525 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:05:41.569085 19524 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:41.518608 22369 raft_consensus.cc:3060] T b08304a0a02b42d7840c4e8ee9a6bd1a P 0473d2b2d01f4459b1e90fd12cc7840e [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:05:41.554948 19556 raft_consensus.cc:1240] T 6c5eebf646ad445a9d1b1adc319d7b16 P e61c3a8f61bb48f8a963c9480e53c168 [term 6 LEADER]: Rejecting Update request from peer 127766fc592545a4997f7790f50f6076 for earlier term 4. Current term is 6. Ops: []
W20260709 13:05:41.582643 19449 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.4:43121, user_credentials={real_user=slave}} blocked reactor thread for 158121us
I20260709 13:05:41.580099 19523 leader_election.cc:304] T 48824d5acfbc485ebf8c2d944e7202de P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e61c3a8f61bb48f8a963c9480e53c168; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, 127766fc592545a4997f7790f50f6076
I20260709 13:05:41.557960 22721 leader_election.cc:290] T ed7fdbcb96d14d418db9ca90a792588a P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:05:41.583520 19402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab43d85f64114d4ebf618930e43d9ed0" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:05:41.562769 22758 raft_consensus.cc:2804] T 85c494af21f9457a85da47b9bc70c1fd P e61c3a8f61bb48f8a963c9480e53c168 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:05:41.586588 19523 leader_election.cc:304] T 62c6c134d3d24a1ab144dd9ee6bc3f64 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e61c3a8f61bb48f8a963c9480e53c168; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, 127766fc592545a4997f7790f50f6076
I20260709 13:05:41.572193 22722 raft_consensus.cc:493] T 5ec1c4ce15e04c7e8c283a62179f2a64 P 0473d2b2d01f4459b1e90fd12cc7840e [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:41.590042 19402 raft_consensus.cc:2393] T ab43d85f64114d4ebf618930e43d9ed0 P e5256d91808b47c195bc9b4dbd7f2b87 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e61c3a8f61bb48f8a963c9480e53c168 in current term 7: Already voted for candidate e5256d91808b47c195bc9b4dbd7f2b87 in this term.
I20260709 13:05:41.592424 19407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a08760e15aac4630a629431f56024dc8" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:05:41.592761 19410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dc5b3532fe54f74876d02beffa2c230" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:05:41.593320 19408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4509b76741dc428e9201c70c1658da13" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:05:41.594588 19403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e1f505cb0f1427bbd698ac889d80821" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:05:41.593609 19523 leader_election.cc:304] T 70797e5783b5454ab0d0eea663e791e3 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 127766fc592545a4997f7790f50f6076, e61c3a8f61bb48f8a963c9480e53c168; no voters: e5256d91808b47c195bc9b4dbd7f2b87
W20260709 13:05:41.601392 20076 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:05:41.606731 19450 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.3:36891, user_credentials={real_user=slave}} blocked reactor thread for 202557us
I20260709 13:05:41.599803 22701 raft_consensus.cc:3060] T 40e1e16737a842ee936002830f36882e P e61c3a8f61bb48f8a963c9480e53c168 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:05:41.611860 19409 raft_consensus.cc:1275] T 86a6797bdfe94fa496c050ceae4bd0d9 P e5256d91808b47c195bc9b4dbd7f2b87 [term 8 FOLLOWER]: Refusing update from remote peer e61c3a8f61bb48f8a963c9480e53c168: Log matching property violated. Preceding OpId in replica: term: 4 index: 2. Preceding OpId from leader: term: 8 index: 4. (index mismatch)
I20260709 13:05:41.588665 22730 raft_consensus.cc:493] T 14935b3ddf914369822e4a0547aaa355 P 127766fc592545a4997f7790f50f6076 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:41.589870 22712 raft_consensus.cc:2749] T 1efebf73c86e432baa55533136b6e12c P e61c3a8f61bb48f8a963c9480e53c168 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:05:41.617595 19408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e36a9d6e29c4a7c860cf267efbd4c74" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
I20260709 13:05:41.618238 19523 leader_election.cc:304] T 2a16f7501e2444fb86d4e2778e734e02 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 127766fc592545a4997f7790f50f6076, e61c3a8f61bb48f8a963c9480e53c168; no voters: e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:05:41.594300 22763 raft_consensus.cc:2749] T 62c6c134d3d24a1ab144dd9ee6bc3f64 P e61c3a8f61bb48f8a963c9480e53c168 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:05:41.603015 22625 raft_consensus.cc:493] T b9f0d59553ad444883fcf5b5909f9798 P e5256d91808b47c195bc9b4dbd7f2b87 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:41.597704 22813 raft_consensus.cc:2749] T 48824d5acfbc485ebf8c2d944e7202de P e61c3a8f61bb48f8a963c9480e53c168 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:05:41.589416 22711 leader_election.cc:290] T 0afb57ae58a24a01850491d69f0213dd P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:05:41.589711 22758 raft_consensus.cc:493] T 85c494af21f9457a85da47b9bc70c1fd P e61c3a8f61bb48f8a963c9480e53c168 [term 4 FOLLOWER]: Starting leader election (detected failure of leader e5256d91808b47c195bc9b4dbd7f2b87)
I20260709 13:05:41.621776 19410 raft_consensus.cc:1240] T 179fd671030940b4b4a4e24bcc4aba0a P e5256d91808b47c195bc9b4dbd7f2b87 [term 8 FOLLOWER]: Rejecting Update request from peer e61c3a8f61bb48f8a963c9480e53c168 for earlier term 6. Current term is 8. Ops: [6.5-6.5]
I20260709 13:05:41.630240 19409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46c5bfeecc314717bffe987e6844b6d0" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 14 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
I20260709 13:05:41.624435 19402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc225c93219c45538b53a1bd3d387e4d" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:05:41.625591 19406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef32ce6fdd0e40d382c79974f30295c6" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:05:41.620460 19403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2725d2c4cb054f18b0fc8f735c15f6c2" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
I20260709 13:05:41.600570 22721 raft_consensus.cc:493] T 70797e5783b5454ab0d0eea663e791e3 P 127766fc592545a4997f7790f50f6076 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader e5256d91808b47c195bc9b4dbd7f2b87)
W20260709 13:05:41.683560 19523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.4:43121, user_credentials={real_user=slave}} blocked reactor thread for 50155.4us
I20260709 13:05:41.611974 22820 raft_consensus.cc:493] T 0e1085d23e8347fbbd5bce7542f4b1f4 P 127766fc592545a4997f7790f50f6076 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:41.686314 19409 raft_consensus.cc:2393] T 46c5bfeecc314717bffe987e6844b6d0 P e5256d91808b47c195bc9b4dbd7f2b87 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate e61c3a8f61bb48f8a963c9480e53c168 in current term 14: Already voted for candidate e5256d91808b47c195bc9b4dbd7f2b87 in this term.
W20260709 13:05:41.687109 19377 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.2:46257, user_credentials={real_user=slave}} blocked reactor thread for 183932us
I20260709 13:05:41.612555 22727 raft_consensus.cc:493] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P 127766fc592545a4997f7790f50f6076 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader e5256d91808b47c195bc9b4dbd7f2b87)
I20260709 13:05:41.612843 22750 raft_consensus.cc:2804] T 70797e5783b5454ab0d0eea663e791e3 P e61c3a8f61bb48f8a963c9480e53c168 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:05:41.578886 22735 consensus_queue.cc:237] T 96efeaaf1057492490e9a621f37e1a2d P 127766fc592545a4997f7790f50f6076 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:05:41.633725 22758 raft_consensus.cc:3060] T 85c494af21f9457a85da47b9bc70c1fd P e61c3a8f61bb48f8a963c9480e53c168 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:05:41.623167 22551 raft_consensus.cc:2804] T 2a16f7501e2444fb86d4e2778e734e02 P e61c3a8f61bb48f8a963c9480e53c168 [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 13:05:41.690636 19375 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.3:36891, user_credentials={real_user=slave}} blocked reactor thread for 62287us
I20260709 13:05:41.602798 22722 raft_consensus.cc:515] T 5ec1c4ce15e04c7e8c283a62179f2a64 P 0473d2b2d01f4459b1e90fd12cc7840e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:05:41.697211 20076 leader_election.cc:304] T 4af19371ea874c09a0a2147040835cbb P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 127766fc592545a4997f7790f50f6076; no voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:05:41.714071 20076 leader_election.cc:304] T 85c494af21f9457a85da47b9bc70c1fd P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 127766fc592545a4997f7790f50f6076; no voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:05:41.626621 22640 consensus_queue.cc:1059] T 46c5bfeecc314717bffe987e6844b6d0 P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 }, Status: INVALID_TERM, Last received: 9.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.076s
I20260709 13:05:41.716590 20076 leader_election.cc:304] T 65d8cb8d6ec64f459d5a47cefab10acf P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 127766fc592545a4997f7790f50f6076; no voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:05:41.717085 19406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff9b0eddd810459b82d91c60777c10eb" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
I20260709 13:05:41.629448 22624 leader_election.cc:290] T f93ee515a9c14139bf566522ed8232f3 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:05:41.707211 19402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "172b3dd13109415a955b71ac0e9d2234" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
I20260709 13:05:41.724073 19402 raft_consensus.cc:3060] T 172b3dd13109415a955b71ac0e9d2234 P e5256d91808b47c195bc9b4dbd7f2b87 [term 5 FOLLOWER]: Advancing to term 7
I20260709 13:05:41.633812 22662 leader_election.cc:290] T b9f0d59553ad444883fcf5b5909f9798 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
W20260709 13:05:41.704932 22757 consensus_meta.cc:287] T 2725d2c4cb054f18b0fc8f735c15f6c2 P e5256d91808b47c195bc9b4dbd7f2b87: Time spent flushing consensus metadata: real 0.603s	user 0.003s	sys 0.011s
I20260709 13:05:41.730391 19408 raft_consensus.cc:1240] T b08304a0a02b42d7840c4e8ee9a6bd1a P e5256d91808b47c195bc9b4dbd7f2b87 [term 10 LEADER]: Rejecting Update request from peer 0473d2b2d01f4459b1e90fd12cc7840e for earlier term 9. Current term is 10. Ops: []
I20260709 13:05:41.730749 19404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1b10566f45d4a7d9029858330e02d5b" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:05:41.739410 19404 raft_consensus.cc:2468] T f1b10566f45d4a7d9029858330e02d5b P e5256d91808b47c195bc9b4dbd7f2b87 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 9.
I20260709 13:05:41.741432 19410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ece3db938bc649d4a40a51522ed5259c" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:05:41.714910 22760 raft_consensus.cc:2749] T 4af19371ea874c09a0a2147040835cbb P 127766fc592545a4997f7790f50f6076 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:05:41.746538 19404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e381f1d6b8184797ad142de49be225a8" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:05:41.732363 20104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96efeaaf1057492490e9a621f37e1a2d" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:05:41.635457 22625 raft_consensus.cc:515] T b9f0d59553ad444883fcf5b5909f9798 P e5256d91808b47c195bc9b4dbd7f2b87 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:41.781054 20111 raft_consensus.cc:1240] T 65d8cb8d6ec64f459d5a47cefab10acf P 127766fc592545a4997f7790f50f6076 [term 5 FOLLOWER]: Rejecting Update request from peer e5256d91808b47c195bc9b4dbd7f2b87 for earlier term 4. Current term is 5. Ops: []
I20260709 13:05:41.781154 19410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab43d85f64114d4ebf618930e43d9ed0" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 8 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:05:41.782145 20112 raft_consensus.cc:1240] T ff9b0eddd810459b82d91c60777c10eb P 127766fc592545a4997f7790f50f6076 [term 7 FOLLOWER]: Rejecting Update request from peer e5256d91808b47c195bc9b4dbd7f2b87 for earlier term 6. Current term is 7. Ops: []
I20260709 13:05:41.782639 19410 raft_consensus.cc:2468] T ab43d85f64114d4ebf618930e43d9ed0 P e5256d91808b47c195bc9b4dbd7f2b87 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 127766fc592545a4997f7790f50f6076 in term 7.
I20260709 13:05:41.783255 19404 raft_consensus.cc:2468] T e381f1d6b8184797ad142de49be225a8 P e5256d91808b47c195bc9b4dbd7f2b87 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 5.
I20260709 13:05:41.690124 22734 consensus_queue.cc:1048] T 6c5eebf646ad445a9d1b1adc319d7b16 P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Connected to new peer: Peer: permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.047s
I20260709 13:05:41.788160 19409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "833a2f0775ed407a94b8924ce50adb63" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:05:41.711524 22551 raft_consensus.cc:493] T 2a16f7501e2444fb86d4e2778e734e02 P e61c3a8f61bb48f8a963c9480e53c168 [term 8 FOLLOWER]: Starting leader election (detected failure of leader e5256d91808b47c195bc9b4dbd7f2b87)
I20260709 13:05:41.732424 20106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0afb57ae58a24a01850491d69f0213dd" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:05:41.629650 22730 raft_consensus.cc:515] T 14935b3ddf914369822e4a0547aaa355 P 127766fc592545a4997f7790f50f6076 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } attrs { replace: true } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:05:41.793329 19557 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40428 (request call id 2141) took 1832 ms. Trace:
I20260709 13:05:41.795096 19404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b74109013a140ada21feeef92d6f563" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:05:41.709883 22750 raft_consensus.cc:493] T 70797e5783b5454ab0d0eea663e791e3 P e61c3a8f61bb48f8a963c9480e53c168 [term 8 FOLLOWER]: Starting leader election (detected failure of leader e5256d91808b47c195bc9b4dbd7f2b87)
I20260709 13:05:41.736420 22818 raft_consensus.cc:2749] T 85c494af21f9457a85da47b9bc70c1fd P 127766fc592545a4997f7790f50f6076 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:05:41.818789 19410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28af091831594f9d8e96482078cc7625" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:05:41.817901 19557 rpcz_store.cc:276] 0709 13:05:39.961151 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:39.961309 (+   158us) service_pool.cc:224] Handling call
0709 13:05:41.273957 (+1312648us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:41.281386 (+  7429us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:41.793118 (+511732us) spinlock_profiling.cc:243] Waited 1.3 s on lock 0x7b540012b950. stack: 00007f4a79de9343 00007f4a79de9240 00007f4a797781d4 00007f4a834b6304 00007f4a834b6299 00007f4a7ce71571 00007f4a7cf078ad 00007f4a81ecc419 00007f4a7b443bd4 00007f4a7b443b62 00007f4a7b443a91 00007f4a7b443a0c 00007f4a7b442cc2 00007f4a7b24348c 00007f4a7b2428c6 00007f4a7b24226f
0709 13:05:41.793266 (+   148us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2996935040}
I20260709 13:05:41.750559 19408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "217b5fae677b4971b3bbd2f357a1f7ff" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:05:41.708830 22820 raft_consensus.cc:515] T 0e1085d23e8347fbbd5bce7542f4b1f4 P 127766fc592545a4997f7790f50f6076 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
W20260709 13:05:41.816903 22817 log.cc:927] Time spent T 5ec1c4ce15e04c7e8c283a62179f2a64 P e5256d91808b47c195bc9b4dbd7f2b87: Append to log took a long time: real 0.256s	user 0.000s	sys 0.001s
I20260709 13:05:41.689890 22693 consensus_queue.cc:237] T f93ee515a9c14139bf566522ed8232f3 P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 7.3, Last appended by leader: 3, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:41.733227 22702 leader_election.cc:290] T ff75a1d4cb1f493db8f71ddc136ba9ab P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:05:41.831638 19403 raft_consensus.cc:2468] T 2725d2c4cb054f18b0fc8f735c15f6c2 P e5256d91808b47c195bc9b4dbd7f2b87 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 9.
I20260709 13:05:41.708179 22727 raft_consensus.cc:515] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P 127766fc592545a4997f7790f50f6076 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:05:41.700999 22721 raft_consensus.cc:515] T 70797e5783b5454ab0d0eea663e791e3 P 127766fc592545a4997f7790f50f6076 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:05:41.793327 22703 consensus_queue.cc:1048] T 1efebf73c86e432baa55533136b6e12c P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.050s
W20260709 13:05:41.838743 19523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.1:40321, user_credentials={real_user=slave}} blocked reactor thread for 110299us
I20260709 13:05:41.848982 19408 raft_consensus.cc:2468] T 217b5fae677b4971b3bbd2f357a1f7ff P e5256d91808b47c195bc9b4dbd7f2b87 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 4.
W20260709 13:05:41.842447 19450 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.3:36891, user_credentials={real_user=slave}} blocked reactor thread for 209731us
I20260709 13:05:41.818401 22551 raft_consensus.cc:3060] T 2a16f7501e2444fb86d4e2778e734e02 P e61c3a8f61bb48f8a963c9480e53c168 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:05:41.828841 22819 raft_consensus.cc:2749] T 65d8cb8d6ec64f459d5a47cefab10acf P 127766fc592545a4997f7790f50f6076 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:05:41.823621 22750 raft_consensus.cc:3060] T 70797e5783b5454ab0d0eea663e791e3 P e61c3a8f61bb48f8a963c9480e53c168 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:05:41.872347 19556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab43d85f64114d4ebf618930e43d9ed0" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 8 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:05:41.873159 20110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7be9efa6559648dbb5a0f7684c4542d1" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:05:41.888908 20110 raft_consensus.cc:2468] T 7be9efa6559648dbb5a0f7684c4542d1 P 127766fc592545a4997f7790f50f6076 [term 7 LEARNER]: Leader pre-election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 7.
I20260709 13:05:41.874251 19404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff75a1d4cb1f493db8f71ddc136ba9ab" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:05:41.831135 20106 raft_consensus.cc:2468] T 0afb57ae58a24a01850491d69f0213dd P 127766fc592545a4997f7790f50f6076 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 8.
W20260709 13:05:41.860460 22826 log.cc:927] Time spent T 1a61655d99124a29b486ba4a5b37faea P e61c3a8f61bb48f8a963c9480e53c168: Append to log took a long time: real 0.170s	user 0.000s	sys 0.001s
I20260709 13:05:41.893466 19558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed7fdbcb96d14d418db9ca90a792588a" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:05:41.893838 19404 raft_consensus.cc:2368] T ff75a1d4cb1f493db8f71ddc136ba9ab P e5256d91808b47c195bc9b4dbd7f2b87 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0473d2b2d01f4459b1e90fd12cc7840e for earlier term 7. Current term is 8.
I20260709 13:05:41.894268 19558 raft_consensus.cc:2468] T ed7fdbcb96d14d418db9ca90a792588a P e61c3a8f61bb48f8a963c9480e53c168 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 127766fc592545a4997f7790f50f6076 in term 5.
I20260709 13:05:41.899554 22727 leader_election.cc:290] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:05:41.903826 19409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9f0d59553ad444883fcf5b5909f9798" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
W20260709 13:05:41.906109 19377 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.2:46257, user_credentials={real_user=slave}} blocked reactor thread for 197982us
I20260709 13:05:41.884899 19408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7be9efa6559648dbb5a0f7684c4542d1" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:05:41.886433 19402 raft_consensus.cc:2468] T 172b3dd13109415a955b71ac0e9d2234 P e5256d91808b47c195bc9b4dbd7f2b87 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 7.
I20260709 13:05:41.886791 19557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1efebf73c86e432baa55533136b6e12c" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:05:41.870056 19450 leader_election.cc:304] T f1b10566f45d4a7d9029858330e02d5b P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:05:41.891407 20104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c5eebf646ad445a9d1b1adc319d7b16" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:05:41.892334 19556 raft_consensus.cc:2468] T ab43d85f64114d4ebf618930e43d9ed0 P e61c3a8f61bb48f8a963c9480e53c168 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 127766fc592545a4997f7790f50f6076 in term 7.
W20260709 13:05:41.908689 19374 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.4:43121, user_credentials={real_user=slave}} blocked reactor thread for 123061us
I20260709 13:05:41.909001 19408 raft_consensus.cc:2393] T 7be9efa6559648dbb5a0f7684c4542d1 P e5256d91808b47c195bc9b4dbd7f2b87 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0473d2b2d01f4459b1e90fd12cc7840e in current term 9: Already voted for candidate e5256d91808b47c195bc9b4dbd7f2b87 in this term.
I20260709 13:05:41.909940 22840 raft_consensus.cc:2804] T f1b10566f45d4a7d9029858330e02d5b P 0473d2b2d01f4459b1e90fd12cc7840e [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:05:41.910598 22840 raft_consensus.cc:493] T f1b10566f45d4a7d9029858330e02d5b P 0473d2b2d01f4459b1e90fd12cc7840e [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:41.911078 22840 raft_consensus.cc:3060] T f1b10566f45d4a7d9029858330e02d5b P 0473d2b2d01f4459b1e90fd12cc7840e [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:05:41.922708 19450 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.3:36891, user_credentials={real_user=slave}} blocked reactor thread for 52752.1us
I20260709 13:05:41.907946 19557 raft_consensus.cc:2468] T 1efebf73c86e432baa55533136b6e12c P e61c3a8f61bb48f8a963c9480e53c168 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 127766fc592545a4997f7790f50f6076 in term 6.
I20260709 13:05:41.908485 20104 raft_consensus.cc:2468] T 6c5eebf646ad445a9d1b1adc319d7b16 P 127766fc592545a4997f7790f50f6076 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 6.
W20260709 13:05:41.928939 19375 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.3:36891, user_credentials={real_user=slave}} blocked reactor thread for 207507us
W20260709 13:05:41.931702 20075 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.1:40321, user_credentials={real_user=slave}} blocked reactor thread for 147785us
W20260709 13:05:41.932722 20075 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:41.942689 22721 leader_election.cc:290] T 70797e5783b5454ab0d0eea663e791e3 P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:05:41.944475 20075 leader_election.cc:304] T ff9b0eddd810459b82d91c60777c10eb P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 127766fc592545a4997f7790f50f6076; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:05:41.939291 22702 raft_consensus.cc:493] T 21e14947d70440f19044d8f75c31e1f9 P 0473d2b2d01f4459b1e90fd12cc7840e [term 7 FOLLOWER]: Starting pre-election (detected failure of leader e5256d91808b47c195bc9b4dbd7f2b87)
I20260709 13:05:41.949906 22845 consensus_queue.cc:1059] T ff9b0eddd810459b82d91c60777c10eb P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:05:41.951472 22843 raft_consensus.cc:493] T 14935b3ddf914369822e4a0547aaa355 P e5256d91808b47c195bc9b4dbd7f2b87 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 127766fc592545a4997f7790f50f6076)
I20260709 13:05:41.954573 22730 leader_election.cc:290] T 14935b3ddf914369822e4a0547aaa355 P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
W20260709 13:05:41.971299 20076 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.3:36891, user_credentials={real_user=slave}} blocked reactor thread for 254901us
I20260709 13:05:41.991382 20076 leader_election.cc:304] T ece3db938bc649d4a40a51522ed5259c P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 127766fc592545a4997f7790f50f6076; no voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:05:41.992725 20076 leader_election.cc:304] T 833a2f0775ed407a94b8924ce50adb63 P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 127766fc592545a4997f7790f50f6076; no voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168
W20260709 13:05:42.043824 20076 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.3:36891, user_credentials={real_user=slave}} blocked reactor thread for 44934.6us
I20260709 13:05:42.044736 19552 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40438 (request call id 2031) took 1722 ms. Trace:
I20260709 13:05:42.045126 19552 rpcz_store.cc:276] 0709 13:05:40.322609 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:41.082839 (+760230us) service_pool.cc:224] Handling call
0709 13:05:41.083199 (+   360us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:05:41.113564 (+ 30365us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:05:41.113596 (+    32us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:05:41.114126 (+   530us) log.cc:844] Serialized 52 byte log entry
0709 13:05:41.522590 (+408464us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:05:41.522643 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:41.523412 (+   769us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:05:42.044497 (+521085us) raft_consensus.cc:1685] finished
0709 13:05:42.044518 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:42.044664 (+   146us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":28720,"raft.queue_time_us":31837,"raft.run_cpu_time_us":70,"raft.run_wall_time_us":70,"thread_start_us":405565,"threads_started":1,"wal-append.queue_time_us":491582}
I20260709 13:05:42.045089 20076 leader_election.cc:304] T ed7fdbcb96d14d418db9ca90a792588a P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 127766fc592545a4997f7790f50f6076, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:05:41.934753 22831 consensus_queue.cc:1059] T 85c494af21f9457a85da47b9bc70c1fd P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false }, Status: INVALID_TERM, Last received: 4.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.066s
W20260709 13:05:41.985334 19374 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.4:43121, user_credentials={real_user=slave}} blocked reactor thread for 54549.4us
I20260709 13:05:42.071506 22831 raft_consensus.cc:3055] T 85c494af21f9457a85da47b9bc70c1fd P e5256d91808b47c195bc9b4dbd7f2b87 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:05:42.071872 22831 raft_consensus.cc:740] T 85c494af21f9457a85da47b9bc70c1fd P e5256d91808b47c195bc9b4dbd7f2b87 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: e5256d91808b47c195bc9b4dbd7f2b87, State: Running, Role: LEADER
I20260709 13:05:42.072749 19402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14935b3ddf914369822e4a0547aaa355" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:05:42.072634 22831 consensus_queue.cc:260] T 85c494af21f9457a85da47b9bc70c1fd P e5256d91808b47c195bc9b4dbd7f2b87 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 4.7, Last appended by leader: 7, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:05:42.073256 19406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36f6ba92b9ba46babe4ebd6c02e5fbd9" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:05:42.074513 19409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70797e5783b5454ab0d0eea663e791e3" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
W20260709 13:05:42.051296 19377 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:42.049422 20076 leader_election.cc:304] T ab43d85f64114d4ebf618930e43d9ed0 P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 127766fc592545a4997f7790f50f6076, e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:05:42.078812 20076 leader_election.cc:304] T 1efebf73c86e432baa55533136b6e12c P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 127766fc592545a4997f7790f50f6076, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:05:42.045287 22727 raft_consensus.cc:2749] T ece3db938bc649d4a40a51522ed5259c P 127766fc592545a4997f7790f50f6076 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:05:42.079732 22727 raft_consensus.cc:2804] T ab43d85f64114d4ebf618930e43d9ed0 P 127766fc592545a4997f7790f50f6076 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:05:42.080106 22727 raft_consensus.cc:493] T ab43d85f64114d4ebf618930e43d9ed0 P 127766fc592545a4997f7790f50f6076 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:42.080443 22727 raft_consensus.cc:3060] T ab43d85f64114d4ebf618930e43d9ed0 P 127766fc592545a4997f7790f50f6076 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:05:42.048568 22730 raft_consensus.cc:2749] T 833a2f0775ed407a94b8924ce50adb63 P 127766fc592545a4997f7790f50f6076 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:05:42.059376 22847 raft_consensus.cc:2804] T ed7fdbcb96d14d418db9ca90a792588a P 127766fc592545a4997f7790f50f6076 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:05:42.044023 22703 raft_consensus.cc:493] T 2725d2c4cb054f18b0fc8f735c15f6c2 P 0473d2b2d01f4459b1e90fd12cc7840e [term 8 FOLLOWER]: Starting pre-election (detected failure of leader e5256d91808b47c195bc9b4dbd7f2b87)
I20260709 13:05:41.999154 22701 raft_consensus.cc:493] T fa8650e71aa14778b3d73721fc50d9fc P e61c3a8f61bb48f8a963c9480e53c168 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 0473d2b2d01f4459b1e90fd12cc7840e)
I20260709 13:05:42.066021 22682 raft_consensus.cc:3055] T ff9b0eddd810459b82d91c60777c10eb P e5256d91808b47c195bc9b4dbd7f2b87 [term 6 LEADER]: Stepping down as leader of term 6
W20260709 13:05:42.067178 22828 log.cc:927] Time spent T 6c5eebf646ad445a9d1b1adc319d7b16 P 0473d2b2d01f4459b1e90fd12cc7840e: Append to log took a long time: real 0.237s	user 0.000s	sys 0.001s
I20260709 13:05:42.070591 22820 leader_election.cc:290] T 0e1085d23e8347fbbd5bce7542f4b1f4 P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:05:41.988847 22722 leader_election.cc:290] T 5ec1c4ce15e04c7e8c283a62179f2a64 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:05:42.133744 22111 leader_election.cc:290] T 0afb57ae58a24a01850491d69f0213dd P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:05:41.989295 22819 raft_consensus.cc:2749] T ff9b0eddd810459b82d91c60777c10eb P 127766fc592545a4997f7790f50f6076 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:05:42.079754 22640 raft_consensus.cc:493] T df751f992649444090e27965eb1af85d P 0473d2b2d01f4459b1e90fd12cc7840e [term 9 FOLLOWER]: Starting pre-election (detected failure of leader e5256d91808b47c195bc9b4dbd7f2b87)
W20260709 13:05:42.094945 19375 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.3:36891, user_credentials={real_user=slave}} blocked reactor thread for 154991us
I20260709 13:05:42.135301 22640 raft_consensus.cc:515] T df751f992649444090e27965eb1af85d P 0473d2b2d01f4459b1e90fd12cc7840e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:42.137385 22640 leader_election.cc:290] T df751f992649444090e27965eb1af85d P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:05:42.094995 22818 raft_consensus.cc:2804] T 1efebf73c86e432baa55533136b6e12c P 127766fc592545a4997f7790f50f6076 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:05:41.928335 19450 leader_election.cc:304] T e381f1d6b8184797ad142de49be225a8 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:05:42.099515 19523 leader_election.cc:304] T 0afb57ae58a24a01850491d69f0213dd P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 127766fc592545a4997f7790f50f6076, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
W20260709 13:05:42.140818 19523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.4:43121, user_credentials={real_user=slave}} blocked reactor thread for 159129us
W20260709 13:05:42.141544 19523 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:05:42.141947 19523 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:05:42.142316 19523 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:42.143395 19552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa731b585f684a7fb2d106c50f143b83" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:05:42.143726 19557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70797e5783b5454ab0d0eea663e791e3" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:05:42.143992 19552 raft_consensus.cc:2468] T fa731b585f684a7fb2d106c50f143b83 P e61c3a8f61bb48f8a963c9480e53c168 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 127766fc592545a4997f7790f50f6076 in term 7.
I20260709 13:05:42.144095 19556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14935b3ddf914369822e4a0547aaa355" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:05:42.144651 19556 raft_consensus.cc:2468] T 14935b3ddf914369822e4a0547aaa355 P e61c3a8f61bb48f8a963c9480e53c168 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 127766fc592545a4997f7790f50f6076 in term 7.
I20260709 13:05:41.921605 22840 raft_consensus.cc:515] T f1b10566f45d4a7d9029858330e02d5b P 0473d2b2d01f4459b1e90fd12cc7840e [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:42.119012 22715 leader_election.cc:290] T a08760e15aac4630a629431f56024dc8 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 10 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:05:42.020423 22625 leader_election.cc:290] T b9f0d59553ad444883fcf5b5909f9798 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:05:42.146401 19556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e1085d23e8347fbbd5bce7542f4b1f4" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:05:42.147640 19552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0afb57ae58a24a01850491d69f0213dd" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:05:42.156476 22840 leader_election.cc:290] T f1b10566f45d4a7d9029858330e02d5b P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 10 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:05:42.147754 20076 leader_election.cc:304] T fa731b585f684a7fb2d106c50f143b83 P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 127766fc592545a4997f7790f50f6076, e61c3a8f61bb48f8a963c9480e53c168; no voters: e5256d91808b47c195bc9b4dbd7f2b87
W20260709 13:05:42.149437 19452 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:41.989322 22702 raft_consensus.cc:515] T 21e14947d70440f19044d8f75c31e1f9 P 0473d2b2d01f4459b1e90fd12cc7840e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:42.161005 22702 leader_election.cc:290] T 21e14947d70440f19044d8f75c31e1f9 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:05:42.095438 22847 raft_consensus.cc:493] T ed7fdbcb96d14d418db9ca90a792588a P 127766fc592545a4997f7790f50f6076 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:42.162081 22847 raft_consensus.cc:3060] T ed7fdbcb96d14d418db9ca90a792588a P 127766fc592545a4997f7790f50f6076 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:05:42.138077 22818 raft_consensus.cc:493] T 1efebf73c86e432baa55533136b6e12c P 127766fc592545a4997f7790f50f6076 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 0473d2b2d01f4459b1e90fd12cc7840e)
I20260709 13:05:42.166972 22818 raft_consensus.cc:3060] T 1efebf73c86e432baa55533136b6e12c P 127766fc592545a4997f7790f50f6076 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:05:42.112726 22658 consensus_meta.cc:287] T edd7d470b5014c9489be7f41f64355c9 P 0473d2b2d01f4459b1e90fd12cc7840e: Time spent flushing consensus metadata: real 0.607s	user 0.006s	sys 0.006s
I20260709 13:05:42.171487 22819 raft_consensus.cc:2804] T fa731b585f684a7fb2d106c50f143b83 P 127766fc592545a4997f7790f50f6076 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:05:42.172088 22819 raft_consensus.cc:493] T fa731b585f684a7fb2d106c50f143b83 P 127766fc592545a4997f7790f50f6076 [term 7 FOLLOWER]: Starting leader election (detected failure of leader e5256d91808b47c195bc9b4dbd7f2b87)
I20260709 13:05:42.172551 22819 raft_consensus.cc:3060] T fa731b585f684a7fb2d106c50f143b83 P 127766fc592545a4997f7790f50f6076 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:05:42.110868 22721 raft_consensus.cc:493] T 5ec1c4ce15e04c7e8c283a62179f2a64 P 127766fc592545a4997f7790f50f6076 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:05:42.185066 19375 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.3:36891, user_credentials={real_user=slave}} blocked reactor thread for 44761.3us
I20260709 13:05:42.185247 20076 leader_election.cc:304] T 70797e5783b5454ab0d0eea663e791e3 P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 127766fc592545a4997f7790f50f6076; no voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:05:42.195604 22859 consensus_queue.cc:1059] T ef32ce6fdd0e40d382c79974f30295c6 P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.009s
I20260709 13:05:42.121727 22682 raft_consensus.cc:740] T ff9b0eddd810459b82d91c60777c10eb P e5256d91808b47c195bc9b4dbd7f2b87 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: e5256d91808b47c195bc9b4dbd7f2b87, State: Running, Role: LEADER
I20260709 13:05:42.197484 22682 consensus_queue.cc:260] T ff9b0eddd810459b82d91c60777c10eb P e5256d91808b47c195bc9b4dbd7f2b87 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:05:42.198395 22551 raft_consensus.cc:515] T 2a16f7501e2444fb86d4e2778e734e02 P e61c3a8f61bb48f8a963c9480e53c168 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:05:42.199082 22682 raft_consensus.cc:3060] T ff9b0eddd810459b82d91c60777c10eb P e5256d91808b47c195bc9b4dbd7f2b87 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:05:42.200995 22551 leader_election.cc:290] T 2a16f7501e2444fb86d4e2778e734e02 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 9 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
W20260709 13:05:42.201999 19450 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.3:36891, user_credentials={real_user=slave}} blocked reactor thread for 273727us
I20260709 13:05:42.203977 19450 leader_election.cc:304] T 217b5fae677b4971b3bbd2f357a1f7ff P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:05:42.205509 19450 leader_election.cc:304] T ed7fdbcb96d14d418db9ca90a792588a P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:05:42.154948 22734 raft_consensus.cc:2804] T 0afb57ae58a24a01850491d69f0213dd P e61c3a8f61bb48f8a963c9480e53c168 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:05:42.206789 22111 raft_consensus.cc:2749] T 70797e5783b5454ab0d0eea663e791e3 P 127766fc592545a4997f7790f50f6076 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:05:42.207029 22734 raft_consensus.cc:493] T 0afb57ae58a24a01850491d69f0213dd P e61c3a8f61bb48f8a963c9480e53c168 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:42.207479 22734 raft_consensus.cc:3060] T 0afb57ae58a24a01850491d69f0213dd P e61c3a8f61bb48f8a963c9480e53c168 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:05:42.211421 22443 consensus_queue.cc:1059] T 3e1f505cb0f1427bbd698ac889d80821 P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 }, Status: INVALID_TERM, Last received: 8.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:05:42.213168 22792 raft_consensus.cc:2804] T e381f1d6b8184797ad142de49be225a8 P 0473d2b2d01f4459b1e90fd12cc7840e [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:05:42.213275 22830 raft_consensus.cc:3055] T 3e1f505cb0f1427bbd698ac889d80821 P e5256d91808b47c195bc9b4dbd7f2b87 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:05:42.213619 22792 raft_consensus.cc:493] T e381f1d6b8184797ad142de49be225a8 P 0473d2b2d01f4459b1e90fd12cc7840e [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:42.213863 22830 raft_consensus.cc:740] T 3e1f505cb0f1427bbd698ac889d80821 P e5256d91808b47c195bc9b4dbd7f2b87 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: e5256d91808b47c195bc9b4dbd7f2b87, State: Running, Role: LEADER
I20260709 13:05:42.214944 22830 consensus_queue.cc:260] T 3e1f505cb0f1427bbd698ac889d80821 P e5256d91808b47c195bc9b4dbd7f2b87 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.4, Last appended by leader: 4, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:42.215555 22721 raft_consensus.cc:515] T 5ec1c4ce15e04c7e8c283a62179f2a64 P 127766fc592545a4997f7790f50f6076 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:05:42.214052 22792 raft_consensus.cc:3060] T e381f1d6b8184797ad142de49be225a8 P 0473d2b2d01f4459b1e90fd12cc7840e [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:05:42.217031 19374 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:05:42.218744 19294 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet ab43d85f64114d4ebf618930e43d9ed0 with cas_config_opid_index 5: ChangeConfig:REMOVE_PEER failed with leader e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica e61c3a8f61bb48f8a963c9480e53c168 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 7 committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } attrs { replace: true } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } } }
I20260709 13:05:42.219573 20103 raft_consensus.cc:3060] T 0e1085d23e8347fbbd5bce7542f4b1f4 P 127766fc592545a4997f7790f50f6076 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:05:42.222038 19485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e5873a19244c5ebbcd38e126796ee7" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:05:42.222759 19485 raft_consensus.cc:3060] T d1e5873a19244c5ebbcd38e126796ee7 P 0473d2b2d01f4459b1e90fd12cc7840e [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:05:42.228389 19477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0afb57ae58a24a01850491d69f0213dd" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:05:42.229332 20107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a16f7501e2444fb86d4e2778e734e02" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076"
I20260709 13:05:42.230010 19480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "179fd671030940b4b4a4e24bcc4aba0a" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 9 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:05:42.231854 19481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e1f505cb0f1427bbd698ac889d80821" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:05:42.232393 19481 raft_consensus.cc:3060] T 3e1f505cb0f1427bbd698ac889d80821 P 0473d2b2d01f4459b1e90fd12cc7840e [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:05:42.234480 19485 raft_consensus.cc:2468] T d1e5873a19244c5ebbcd38e126796ee7 P 0473d2b2d01f4459b1e90fd12cc7840e [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 11.
I20260709 13:05:42.074481 22758 raft_consensus.cc:515] T 85c494af21f9457a85da47b9bc70c1fd P e61c3a8f61bb48f8a963c9480e53c168 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:05:42.121134 22703 raft_consensus.cc:515] T 2725d2c4cb054f18b0fc8f735c15f6c2 P 0473d2b2d01f4459b1e90fd12cc7840e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:42.125860 22701 raft_consensus.cc:515] T fa8650e71aa14778b3d73721fc50d9fc P e61c3a8f61bb48f8a963c9480e53c168 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:42.228978 22658 raft_consensus.cc:2804] T 217b5fae677b4971b3bbd2f357a1f7ff P 0473d2b2d01f4459b1e90fd12cc7840e [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:05:42.221462 22551 raft_consensus.cc:493] T ff75a1d4cb1f493db8f71ddc136ba9ab P e61c3a8f61bb48f8a963c9480e53c168 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:42.242529 22640 consensus_queue.cc:1048] T 7f575b143b844aa096b50997dad3516a P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:05:42.245751 22818 raft_consensus.cc:515] T 1efebf73c86e432baa55533136b6e12c P 127766fc592545a4997f7790f50f6076 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:05:42.247714 22692 raft_consensus.cc:3055] T 22196caba61445d3bec98a0aab3c337d P 0473d2b2d01f4459b1e90fd12cc7840e [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:05:42.248852 22722 consensus_queue.cc:1048] T 179fd671030940b4b4a4e24bcc4aba0a P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:05:42.249523 22758 leader_election.cc:290] T 85c494af21f9457a85da47b9bc70c1fd P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 5 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
W20260709 13:05:42.250754 19526 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:42.294061 19556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9f0d59553ad444883fcf5b5909f9798" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:05:42.251955 20107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85c494af21f9457a85da47b9bc70c1fd" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076"
I20260709 13:05:42.254231 20103 raft_consensus.cc:1275] T 0e1085d23e8347fbbd5bce7542f4b1f4 P 127766fc592545a4997f7790f50f6076 [term 6 FOLLOWER]: Refusing update from remote peer e61c3a8f61bb48f8a963c9480e53c168: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:05:42.254947 19485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96efeaaf1057492490e9a621f37e1a2d" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:05:42.295928 19485 raft_consensus.cc:2393] T 96efeaaf1057492490e9a621f37e1a2d P 0473d2b2d01f4459b1e90fd12cc7840e [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e61c3a8f61bb48f8a963c9480e53c168 in current term 8: Already voted for candidate 127766fc592545a4997f7790f50f6076 in this term.
I20260709 13:05:42.187490 22845 consensus_queue.cc:1059] T 2e36a9d6e29c4a7c860cf267efbd4c74 P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.089s
I20260709 13:05:42.256356 19555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df751f992649444090e27965eb1af85d" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:05:42.257279 19551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21e14947d70440f19044d8f75c31e1f9" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:05:42.297856 19551 raft_consensus.cc:2468] T 21e14947d70440f19044d8f75c31e1f9 P e61c3a8f61bb48f8a963c9480e53c168 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 7.
I20260709 13:05:42.258476 19560 raft_consensus.cc:1240] T 46c5bfeecc314717bffe987e6844b6d0 P e61c3a8f61bb48f8a963c9480e53c168 [term 14 FOLLOWER]: Rejecting Update request from peer 0473d2b2d01f4459b1e90fd12cc7840e for earlier term 13. Current term is 14. Ops: [13.5-13.5]
I20260709 13:05:42.274868 19477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a08760e15aac4630a629431f56024dc8" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:05:41.999239 22843 raft_consensus.cc:515] T 14935b3ddf914369822e4a0547aaa355 P e5256d91808b47c195bc9b4dbd7f2b87 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } attrs { replace: true } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:05:42.279091 19557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7be9efa6559648dbb5a0f7684c4542d1" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:05:42.282568 22692 raft_consensus.cc:740] T 22196caba61445d3bec98a0aab3c337d P 0473d2b2d01f4459b1e90fd12cc7840e [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 0473d2b2d01f4459b1e90fd12cc7840e, State: Running, Role: LEADER
I20260709 13:05:42.292629 19481 raft_consensus.cc:2468] T 3e1f505cb0f1427bbd698ac889d80821 P 0473d2b2d01f4459b1e90fd12cc7840e [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 9.
I20260709 13:05:42.237531 22702 raft_consensus.cc:2804] T ed7fdbcb96d14d418db9ca90a792588a P 0473d2b2d01f4459b1e90fd12cc7840e [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:05:42.254017 19558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff75a1d4cb1f493db8f71ddc136ba9ab" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:05:42.287922 19553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1b10566f45d4a7d9029858330e02d5b" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:05:42.297204 19555 raft_consensus.cc:2468] T df751f992649444090e27965eb1af85d P e61c3a8f61bb48f8a963c9480e53c168 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 9.
I20260709 13:05:42.242193 22655 consensus_queue.cc:1048] T 0afb57ae58a24a01850491d69f0213dd P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.053s
I20260709 13:05:42.273329 22721 leader_election.cc:290] T 5ec1c4ce15e04c7e8c283a62179f2a64 P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:05:42.273136 22658 raft_consensus.cc:493] T 217b5fae677b4971b3bbd2f357a1f7ff P 0473d2b2d01f4459b1e90fd12cc7840e [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:42.304014 20107 raft_consensus.cc:2393] T 85c494af21f9457a85da47b9bc70c1fd P 127766fc592545a4997f7790f50f6076 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate e61c3a8f61bb48f8a963c9480e53c168 in current term 5: Already voted for candidate 127766fc592545a4997f7790f50f6076 in this term.
I20260709 13:05:42.307173 19553 raft_consensus.cc:3060] T f1b10566f45d4a7d9029858330e02d5b P e61c3a8f61bb48f8a963c9480e53c168 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:05:42.312485 19480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f93ee515a9c14139bf566522ed8232f3" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 12 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:05:42.323585 19480 raft_consensus.cc:2468] T f93ee515a9c14139bf566522ed8232f3 P 0473d2b2d01f4459b1e90fd12cc7840e [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 11.
I20260709 13:05:42.282028 22551 raft_consensus.cc:515] T ff75a1d4cb1f493db8f71ddc136ba9ab P e61c3a8f61bb48f8a963c9480e53c168 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:42.326143 19402 raft_consensus.cc:2468] T 14935b3ddf914369822e4a0547aaa355 P e5256d91808b47c195bc9b4dbd7f2b87 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 127766fc592545a4997f7790f50f6076 in term 6.
I20260709 13:05:42.309715 22702 raft_consensus.cc:493] T ed7fdbcb96d14d418db9ca90a792588a P 0473d2b2d01f4459b1e90fd12cc7840e [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:42.337983 22703 leader_election.cc:290] T 2725d2c4cb054f18b0fc8f735c15f6c2 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:05:42.338173 22551 leader_election.cc:290] T ff75a1d4cb1f493db8f71ddc136ba9ab P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:05:42.339704 22701 leader_election.cc:290] T fa8650e71aa14778b3d73721fc50d9fc P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:05:42.342840 22722 raft_consensus.cc:493] T 2e36a9d6e29c4a7c860cf267efbd4c74 P 0473d2b2d01f4459b1e90fd12cc7840e [term 6 FOLLOWER]: Starting pre-election (detected failure of leader e5256d91808b47c195bc9b4dbd7f2b87)
I20260709 13:05:42.344420 22847 raft_consensus.cc:515] T ed7fdbcb96d14d418db9ca90a792588a P 127766fc592545a4997f7790f50f6076 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
W20260709 13:05:42.332650 22694 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.775s	user 0.010s	sys 0.012s
I20260709 13:05:42.377622 19555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1efebf73c86e432baa55533136b6e12c" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:05:42.348214 19558 raft_consensus.cc:2468] T ff75a1d4cb1f493db8f71ddc136ba9ab P e61c3a8f61bb48f8a963c9480e53c168 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 7.
W20260709 13:05:42.375221 20075 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.1:40321, user_credentials={real_user=slave}} blocked reactor thread for 293132us
I20260709 13:05:42.301751 22715 consensus_queue.cc:1048] T 0e1085d23e8347fbbd5bce7542f4b1f4 P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Connected to new peer: Peer: permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.031s
I20260709 13:05:42.326969 22658 raft_consensus.cc:3060] T 217b5fae677b4971b3bbd2f357a1f7ff P 0473d2b2d01f4459b1e90fd12cc7840e [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:05:42.348012 22818 leader_election.cc:290] T 1efebf73c86e432baa55533136b6e12c P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 7 election: Requested vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:05:42.381009 19480 raft_consensus.cc:1275] T 0e1085d23e8347fbbd5bce7542f4b1f4 P 0473d2b2d01f4459b1e90fd12cc7840e [term 6 FOLLOWER]: Refusing update from remote peer e61c3a8f61bb48f8a963c9480e53c168: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:05:42.382022 22692 consensus_queue.cc:260] T 22196caba61445d3bec98a0aab3c337d P 0473d2b2d01f4459b1e90fd12cc7840e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:42.386731 22722 raft_consensus.cc:515] T 2e36a9d6e29c4a7c860cf267efbd4c74 P 0473d2b2d01f4459b1e90fd12cc7840e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:42.388090 22727 raft_consensus.cc:515] T ab43d85f64114d4ebf618930e43d9ed0 P 127766fc592545a4997f7790f50f6076 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } attrs { replace: true } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:05:42.388780 22722 leader_election.cc:290] T 2e36a9d6e29c4a7c860cf267efbd4c74 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:05:42.391327 22658 raft_consensus.cc:515] T 217b5fae677b4971b3bbd2f357a1f7ff P 0473d2b2d01f4459b1e90fd12cc7840e [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:42.393754 22658 leader_election.cc:290] T 217b5fae677b4971b3bbd2f357a1f7ff P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 6 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:05:42.400863 19553 raft_consensus.cc:2468] T f1b10566f45d4a7d9029858330e02d5b P e61c3a8f61bb48f8a963c9480e53c168 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 10.
I20260709 13:05:42.407526 19555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab43d85f64114d4ebf618930e43d9ed0" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 8 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:05:42.408329 19555 raft_consensus.cc:3060] T ab43d85f64114d4ebf618930e43d9ed0 P e61c3a8f61bb48f8a963c9480e53c168 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:05:42.369778 22702 raft_consensus.cc:3060] T ed7fdbcb96d14d418db9ca90a792588a P 0473d2b2d01f4459b1e90fd12cc7840e [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:05:42.403142 22694 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.859s	user 0.010s	sys 0.012s
I20260709 13:05:42.463557 19555 raft_consensus.cc:2468] T ab43d85f64114d4ebf618930e43d9ed0 P e61c3a8f61bb48f8a963c9480e53c168 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 127766fc592545a4997f7790f50f6076 in term 8.
W20260709 13:05:42.466528 19449 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.4:43121, user_credentials={real_user=slave}} blocked reactor thread for 118728us
I20260709 13:05:42.467036 22777 raft_consensus.cc:493] T 7f575b143b844aa096b50997dad3516a P e61c3a8f61bb48f8a963c9480e53c168 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:42.467263 19449 leader_election.cc:304] T 6c5eebf646ad445a9d1b1adc319d7b16 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, 127766fc592545a4997f7790f50f6076; no voters: e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:05:42.467553 22777 raft_consensus.cc:515] T 7f575b143b844aa096b50997dad3516a P e61c3a8f61bb48f8a963c9480e53c168 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:42.469310 22722 raft_consensus.cc:2804] T 6c5eebf646ad445a9d1b1adc319d7b16 P 0473d2b2d01f4459b1e90fd12cc7840e [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:05:42.469688 22722 raft_consensus.cc:493] T 6c5eebf646ad445a9d1b1adc319d7b16 P 0473d2b2d01f4459b1e90fd12cc7840e [term 6 FOLLOWER]: Starting leader election (detected failure of leader e61c3a8f61bb48f8a963c9480e53c168)
I20260709 13:05:42.470057 22722 raft_consensus.cc:3060] T 6c5eebf646ad445a9d1b1adc319d7b16 P 0473d2b2d01f4459b1e90fd12cc7840e [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:05:42.470124 20103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ec1c4ce15e04c7e8c283a62179f2a64" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:05:42.471105 20103 raft_consensus.cc:2468] T 5ec1c4ce15e04c7e8c283a62179f2a64 P 127766fc592545a4997f7790f50f6076 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 7.
I20260709 13:05:42.470059 22640 raft_consensus.cc:493] T 0e1085d23e8347fbbd5bce7542f4b1f4 P 0473d2b2d01f4459b1e90fd12cc7840e [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:42.473703 22640 raft_consensus.cc:515] T 0e1085d23e8347fbbd5bce7542f4b1f4 P 0473d2b2d01f4459b1e90fd12cc7840e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:05:42.475369 20109 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46422 (request call id 623) took 1354 ms. Trace:
I20260709 13:05:42.475900 22650 raft_consensus.cc:3055] T 46c5bfeecc314717bffe987e6844b6d0 P 0473d2b2d01f4459b1e90fd12cc7840e [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:05:42.476325 22650 raft_consensus.cc:740] T 46c5bfeecc314717bffe987e6844b6d0 P 0473d2b2d01f4459b1e90fd12cc7840e [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 0473d2b2d01f4459b1e90fd12cc7840e, State: Running, Role: LEADER
I20260709 13:05:42.476675 22703 raft_consensus.cc:493] T 1dc5b3532fe54f74876d02beffa2c230 P 0473d2b2d01f4459b1e90fd12cc7840e [term 7 FOLLOWER]: Starting pre-election (detected failure of leader e5256d91808b47c195bc9b4dbd7f2b87)
I20260709 13:05:42.475744 20109 rpcz_store.cc:276] 0709 13:05:41.075337 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:41.075479 (+   142us) service_pool.cc:224] Handling call
0709 13:05:42.428965 (+1353486us) spinlock_profiling.cc:243] Waited 294 ms on lock 0x7b5400604d54. stack: 00007f4a79de9343 00007f4a79de9240 00007f4a797781d4 00007f4a834b6304 00007f4a834b6299 00007f4a7ce71571 00007f4a7cf0c2fa 00007f4a81ecdb17 00007f4a7b4486d4 00007f4a7b448662 00007f4a7b448591 00007f4a7b44850c 00007f4a7b4477c2 00007f4a7b24348c 00007f4a7b2428c6 00007f4a7b24226f
0709 13:05:42.429180 (+   215us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":676303616}
I20260709 13:05:42.478823 19523 leader_election.cc:304] T ab43d85f64114d4ebf618930e43d9ed0 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: e61c3a8f61bb48f8a963c9480e53c168; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, 127766fc592545a4997f7790f50f6076
I20260709 13:05:42.479701 22715 raft_consensus.cc:2749] T ab43d85f64114d4ebf618930e43d9ed0 P e61c3a8f61bb48f8a963c9480e53c168 [term 8 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:05:42.487936 22715 raft_consensus.cc:493] T 28af091831594f9d8e96482078cc7625 P e61c3a8f61bb48f8a963c9480e53c168 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader e5256d91808b47c195bc9b4dbd7f2b87)
I20260709 13:05:42.488484 22710 raft_consensus.cc:493] T ff9b0eddd810459b82d91c60777c10eb P 0473d2b2d01f4459b1e90fd12cc7840e [term 6 FOLLOWER]: Starting pre-election (detected failure of leader e5256d91808b47c195bc9b4dbd7f2b87)
I20260709 13:05:42.488601 22715 raft_consensus.cc:515] T 28af091831594f9d8e96482078cc7625 P e61c3a8f61bb48f8a963c9480e53c168 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:42.489133 22710 raft_consensus.cc:515] T ff9b0eddd810459b82d91c60777c10eb P 0473d2b2d01f4459b1e90fd12cc7840e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:05:42.489778 22831 raft_consensus.cc:3060] T 85c494af21f9457a85da47b9bc70c1fd P e5256d91808b47c195bc9b4dbd7f2b87 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:05:42.495486 19449 leader_election.cc:304] T 2b74109013a140ada21feeef92d6f563 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e; no voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:05:42.497339 19449 leader_election.cc:304] T 28af091831594f9d8e96482078cc7625 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e; no voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:05:42.498282 19477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa8650e71aa14778b3d73721fc50d9fc" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:05:42.499516 19485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22196caba61445d3bec98a0aab3c337d" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:05:42.507318 19477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e381f1d6b8184797ad142de49be225a8" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:05:42.508067 19482 raft_consensus.cc:1275] T b08304a0a02b42d7840c4e8ee9a6bd1a P 0473d2b2d01f4459b1e90fd12cc7840e [term 10 FOLLOWER]: Refusing update from remote peer e5256d91808b47c195bc9b4dbd7f2b87: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:05:42.509240 19482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1b10566f45d4a7d9029858330e02d5b" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:05:42.404016 22727 leader_election.cc:290] T ab43d85f64114d4ebf618930e43d9ed0 P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 8 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:05:42.547663 19482 raft_consensus.cc:2393] T f1b10566f45d4a7d9029858330e02d5b P 0473d2b2d01f4459b1e90fd12cc7840e [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e5256d91808b47c195bc9b4dbd7f2b87 in current term 10: Already voted for candidate 0473d2b2d01f4459b1e90fd12cc7840e in this term.
I20260709 13:05:42.550661 19482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9f0d59553ad444883fcf5b5909f9798" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:05:42.550976 19478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46c5bfeecc314717bffe987e6844b6d0" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 14 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:05:42.556051 19526 leader_election.cc:304] T d1e5873a19244c5ebbcd38e126796ee7 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:05:42.476557 22882 raft_consensus.cc:493] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P 0473d2b2d01f4459b1e90fd12cc7840e [term 9 FOLLOWER]: Starting pre-election (detected failure of leader e5256d91808b47c195bc9b4dbd7f2b87)
I20260709 13:05:42.487928 22842 raft_consensus.cc:493] T bc225c93219c45538b53a1bd3d387e4d P 0473d2b2d01f4459b1e90fd12cc7840e [term 10 FOLLOWER]: Starting pre-election (detected failure of leader e5256d91808b47c195bc9b4dbd7f2b87)
I20260709 13:05:42.550614 22763 raft_consensus.cc:493] T 4af19371ea874c09a0a2147040835cbb P e61c3a8f61bb48f8a963c9480e53c168 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader e5256d91808b47c195bc9b4dbd7f2b87)
W20260709 13:05:42.602038 19375 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.3:36891, user_credentials={real_user=slave}} blocked reactor thread for 416195us
I20260709 13:05:42.512087 22703 raft_consensus.cc:515] T 1dc5b3532fe54f74876d02beffa2c230 P 0473d2b2d01f4459b1e90fd12cc7840e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:42.632637 19408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df751f992649444090e27965eb1af85d" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:05:42.576521 22873 raft_consensus.cc:493] T 76cb037fc9064d13b59a8969d897ce8c P 0473d2b2d01f4459b1e90fd12cc7840e [term 7 FOLLOWER]: Starting pre-election (detected failure of leader e5256d91808b47c195bc9b4dbd7f2b87)
I20260709 13:05:42.634267 19406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21e14947d70440f19044d8f75c31e1f9" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
W20260709 13:05:42.644608 19377 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:42.646842 19408 raft_consensus.cc:1240] T 46c5bfeecc314717bffe987e6844b6d0 P e5256d91808b47c195bc9b4dbd7f2b87 [term 14 FOLLOWER]: Rejecting Update request from peer 0473d2b2d01f4459b1e90fd12cc7840e for earlier term 13. Current term is 14. Ops: [13.5-13.5]
I20260709 13:05:42.649566 19404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dc5b3532fe54f74876d02beffa2c230" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
I20260709 13:05:42.650631 19404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef32ce6fdd0e40d382c79974f30295c6" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
I20260709 13:05:42.653779 19411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e5873a19244c5ebbcd38e126796ee7" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:05:42.571156 22819 raft_consensus.cc:515] T fa731b585f684a7fb2d106c50f143b83 P 127766fc592545a4997f7790f50f6076 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:05:42.625137 22655 raft_consensus.cc:2749] T 2b74109013a140ada21feeef92d6f563 P 0473d2b2d01f4459b1e90fd12cc7840e [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:05:42.729467 19406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2725d2c4cb054f18b0fc8f735c15f6c2" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:05:42.550201 22650 consensus_queue.cc:260] T 46c5bfeecc314717bffe987e6844b6d0 P 0473d2b2d01f4459b1e90fd12cc7840e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 13.5, Last appended by leader: 5, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:42.717057 19408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e1f505cb0f1427bbd698ac889d80821" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
W20260709 13:05:42.661561 19377 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:42.656262 19410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ec1c4ce15e04c7e8c283a62179f2a64" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:05:42.640509 22715 leader_election.cc:290] T 28af091831594f9d8e96482078cc7625 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
W20260709 13:05:42.725940 19451 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:42.716751 19409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1b10566f45d4a7d9029858330e02d5b" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
I20260709 13:05:42.740202 19409 raft_consensus.cc:3060] T f1b10566f45d4a7d9029858330e02d5b P e5256d91808b47c195bc9b4dbd7f2b87 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:05:42.639518 22551 raft_consensus.cc:2804] T d1e5873a19244c5ebbcd38e126796ee7 P e61c3a8f61bb48f8a963c9480e53c168 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:05:42.735481 20103 raft_consensus.cc:1275] T 5ec1c4ce15e04c7e8c283a62179f2a64 P 127766fc592545a4997f7790f50f6076 [term 7 FOLLOWER]: Refusing update from remote peer e5256d91808b47c195bc9b4dbd7f2b87: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
W20260709 13:05:42.719993 22824 log.cc:927] Time spent T 86a6797bdfe94fa496c050ceae4bd0d9 P 0473d2b2d01f4459b1e90fd12cc7840e: Append to log took a long time: real 0.050s	user 0.000s	sys 0.000s
I20260709 13:05:42.737452 19404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa8650e71aa14778b3d73721fc50d9fc" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:05:42.624028 22763 raft_consensus.cc:515] T 4af19371ea874c09a0a2147040835cbb P e61c3a8f61bb48f8a963c9480e53c168 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:05:42.761087 19406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff75a1d4cb1f493db8f71ddc136ba9ab" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:05:42.762049 19406 raft_consensus.cc:2393] T ff75a1d4cb1f493db8f71ddc136ba9ab P e5256d91808b47c195bc9b4dbd7f2b87 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e61c3a8f61bb48f8a963c9480e53c168 in current term 8: Already voted for candidate e5256d91808b47c195bc9b4dbd7f2b87 in this term.
I20260709 13:05:42.759927 19404 raft_consensus.cc:2468] T fa8650e71aa14778b3d73721fc50d9fc P e5256d91808b47c195bc9b4dbd7f2b87 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 9.
I20260709 13:05:42.728544 19411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "179fd671030940b4b4a4e24bcc4aba0a" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 9 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:05:42.720098 22369 raft_consensus.cc:2749] T 28af091831594f9d8e96482078cc7625 P 0473d2b2d01f4459b1e90fd12cc7840e [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:05:42.764910 22551 raft_consensus.cc:697] T d1e5873a19244c5ebbcd38e126796ee7 P e61c3a8f61bb48f8a963c9480e53c168 [term 11 LEADER]: Becoming Leader. State: Replica: e61c3a8f61bb48f8a963c9480e53c168, State: Running, Role: LEADER
W20260709 13:05:42.786257 19524 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:42.582989 22842 raft_consensus.cc:515] T bc225c93219c45538b53a1bd3d387e4d P 0473d2b2d01f4459b1e90fd12cc7840e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:42.655970 22792 raft_consensus.cc:515] T e381f1d6b8184797ad142de49be225a8 P 0473d2b2d01f4459b1e90fd12cc7840e [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:42.798194 19377 leader_election.cc:304] T fa8650e71aa14778b3d73721fc50d9fc P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:05:42.836097 19555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e36a9d6e29c4a7c860cf267efbd4c74" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:05:42.849129 19555 raft_consensus.cc:2393] T 2e36a9d6e29c4a7c860cf267efbd4c74 P e61c3a8f61bb48f8a963c9480e53c168 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0473d2b2d01f4459b1e90fd12cc7840e in current term 7: Already voted for candidate e61c3a8f61bb48f8a963c9480e53c168 in this term.
I20260709 13:05:42.841558 19553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2725d2c4cb054f18b0fc8f735c15f6c2" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:05:42.850001 19553 raft_consensus.cc:2393] T 2725d2c4cb054f18b0fc8f735c15f6c2 P e61c3a8f61bb48f8a963c9480e53c168 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0473d2b2d01f4459b1e90fd12cc7840e in current term 9: Already voted for candidate e61c3a8f61bb48f8a963c9480e53c168 in this term.
I20260709 13:05:42.842823 22710 leader_election.cc:290] T ff9b0eddd810459b82d91c60777c10eb P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:05:42.843904 22847 leader_election.cc:290] T ed7fdbcb96d14d418db9ca90a792588a P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 6 election: Requested vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:05:42.585111 22882 raft_consensus.cc:515] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P 0473d2b2d01f4459b1e90fd12cc7840e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:05:42.845649 19551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "217b5fae677b4971b3bbd2f357a1f7ff" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:05:42.854205 19551 raft_consensus.cc:3060] T 217b5fae677b4971b3bbd2f357a1f7ff P e61c3a8f61bb48f8a963c9480e53c168 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:05:42.762723 22650 raft_consensus.cc:3060] T 46c5bfeecc314717bffe987e6844b6d0 P 0473d2b2d01f4459b1e90fd12cc7840e [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:05:42.843968 22843 leader_election.cc:290] T 14935b3ddf914369822e4a0547aaa355 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
W20260709 13:05:42.845434 22856 log.cc:927] Time spent T 172b3dd13109415a955b71ac0e9d2234 P 0473d2b2d01f4459b1e90fd12cc7840e: Append to log took a long time: real 0.467s	user 0.001s	sys 0.000s
I20260709 13:05:42.791121 22881 raft_consensus.cc:493] T b08304a0a02b42d7840c4e8ee9a6bd1a P 0473d2b2d01f4459b1e90fd12cc7840e [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:42.898425 19477 raft_consensus.cc:2368] T e381f1d6b8184797ad142de49be225a8 P 0473d2b2d01f4459b1e90fd12cc7840e [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e5256d91808b47c195bc9b4dbd7f2b87 for earlier term 6. Current term is 7.
W20260709 13:05:42.898559 19449 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.1:40321, user_credentials={real_user=slave}} blocked reactor thread for 401290us
I20260709 13:05:42.883383 19404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e36a9d6e29c4a7c860cf267efbd4c74" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:05:42.919970 19553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e1085d23e8347fbbd5bce7542f4b1f4" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:05:42.940887 19551 raft_consensus.cc:2468] T 217b5fae677b4971b3bbd2f357a1f7ff P e61c3a8f61bb48f8a963c9480e53c168 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 6.
W20260709 13:05:42.891284 19374 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.4:43121, user_credentials={real_user=slave}} blocked reactor thread for 46467.1us
I20260709 13:05:42.730154 22873 raft_consensus.cc:515] T 76cb037fc9064d13b59a8969d897ce8c P 0473d2b2d01f4459b1e90fd12cc7840e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:42.942919 22885 raft_consensus.cc:493] T 775c229504194560ba9589bc2199b089 P 0473d2b2d01f4459b1e90fd12cc7840e [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 127766fc592545a4997f7790f50f6076)
I20260709 13:05:42.943427 19450 leader_election.cc:304] T 21e14947d70440f19044d8f75c31e1f9 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
W20260709 13:05:42.944885 19449 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.1:40321, user_credentials={real_user=slave}} blocked reactor thread for 44759.7us
W20260709 13:05:42.950666 19377 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.2:46257, user_credentials={real_user=slave}} blocked reactor thread for 152539us
W20260709 13:05:43.208595 19377 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:05:42.889421 19526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.2:46257, user_credentials={real_user=slave}} blocked reactor thread for 333406us
I20260709 13:05:42.897855 22847 raft_consensus.cc:493] T 48824d5acfbc485ebf8c2d944e7202de P 127766fc592545a4997f7790f50f6076 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 0473d2b2d01f4459b1e90fd12cc7840e)
I20260709 13:05:42.774686 22551 consensus_queue.cc:237] T d1e5873a19244c5ebbcd38e126796ee7 P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 9.5, Last appended by leader: 5, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
W20260709 13:05:43.231282 19450 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.3:36891, user_credentials={real_user=slave}} blocked reactor thread for 287916us
W20260709 13:05:43.155339 19452 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.590s	user 0.010s	sys 0.013s
I20260709 13:05:42.967913 22727 raft_consensus.cc:493] T 309c3ca0ca4b4f3ba129752ea2cb293b P 127766fc592545a4997f7790f50f6076 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 0473d2b2d01f4459b1e90fd12cc7840e)
I20260709 13:05:43.054392 22792 leader_election.cc:290] T e381f1d6b8184797ad142de49be225a8 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 7 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:05:43.046322 22777 leader_election.cc:290] T 7f575b143b844aa096b50997dad3516a P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:05:42.966416 22880 raft_consensus.cc:2749] T fa8650e71aa14778b3d73721fc50d9fc P e5256d91808b47c195bc9b4dbd7f2b87 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:05:43.052320 22763 leader_election.cc:290] T 4af19371ea874c09a0a2147040835cbb P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:05:42.965816 22369 raft_consensus.cc:493] T 1f85fc4b527a48848e5faa083b604e36 P 0473d2b2d01f4459b1e90fd12cc7840e [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 127766fc592545a4997f7790f50f6076)
W20260709 13:05:43.051879 22865 log.cc:927] Time spent T 96efeaaf1057492490e9a621f37e1a2d P 127766fc592545a4997f7790f50f6076: Append to log took a long time: real 0.331s	user 0.001s	sys 0.000s
I20260709 13:05:43.051121 22879 raft_consensus.cc:493] T 86a6797bdfe94fa496c050ceae4bd0d9 P e5256d91808b47c195bc9b4dbd7f2b87 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:05:43.052557 22870 log.cc:927] Time spent T 1efebf73c86e432baa55533136b6e12c P e61c3a8f61bb48f8a963c9480e53c168: Append to log took a long time: real 0.193s	user 0.000s	sys 0.000s
I20260709 13:05:42.947150 22881 raft_consensus.cc:515] T b08304a0a02b42d7840c4e8ee9a6bd1a P 0473d2b2d01f4459b1e90fd12cc7840e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
W20260709 13:05:43.155447 19486 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.574s	user 0.012s	sys 0.012s
W20260709 13:05:43.115841 19451 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:43.133152 19404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1b10566f45d4a7d9029858330e02d5b" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
W20260709 13:05:43.133579 22750 consensus_meta.cc:287] T 70797e5783b5454ab0d0eea663e791e3 P e61c3a8f61bb48f8a963c9480e53c168: Time spent flushing consensus metadata: real 1.241s	user 0.011s	sys 0.000s
I20260709 13:05:43.205559 19409 raft_consensus.cc:2468] T f1b10566f45d4a7d9029858330e02d5b P e5256d91808b47c195bc9b4dbd7f2b87 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 10.
W20260709 13:05:43.100265 22866 log.cc:927] Time spent T a08760e15aac4630a629431f56024dc8 P e5256d91808b47c195bc9b4dbd7f2b87: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
I20260709 13:05:42.896767 22640 leader_election.cc:290] T 0e1085d23e8347fbbd5bce7542f4b1f4 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:05:43.074766 22819 leader_election.cc:290] T fa731b585f684a7fb2d106c50f143b83 P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 8 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
W20260709 13:05:43.233639 19452 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.668s	user 0.011s	sys 0.014s
W20260709 13:05:43.061620 22734 consensus_meta.cc:287] T 0afb57ae58a24a01850491d69f0213dd P e61c3a8f61bb48f8a963c9480e53c168: Time spent flushing consensus metadata: real 0.854s	user 0.008s	sys 0.000s
W20260709 13:05:43.057773 22722 consensus_meta.cc:287] T 6c5eebf646ad445a9d1b1adc319d7b16 P 0473d2b2d01f4459b1e90fd12cc7840e: Time spent flushing consensus metadata: real 0.587s	user 0.005s	sys 0.002s
I20260709 13:05:43.211898 19526 leader_election.cc:304] T 96efeaaf1057492490e9a621f37e1a2d P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e61c3a8f61bb48f8a963c9480e53c168; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, 127766fc592545a4997f7790f50f6076
W20260709 13:05:43.106602 22831 consensus_meta.cc:287] T 85c494af21f9457a85da47b9bc70c1fd P e5256d91808b47c195bc9b4dbd7f2b87: Time spent flushing consensus metadata: real 0.616s	user 0.008s	sys 0.000s
W20260709 13:05:43.155680 22701 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.516s	user 0.013s	sys 0.010s
I20260709 13:05:43.063426 22882 leader_election.cc:290] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:05:43.071650 22703 leader_election.cc:290] T 1dc5b3532fe54f74876d02beffa2c230 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:05:43.233008 19449 leader_election.cc:400] T ff75a1d4cb1f493db8f71ddc136ba9ab P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 7 pre-election: Vote denied by peer e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321) with higher term. Message: Invalid argument: T ff75a1d4cb1f493db8f71ddc136ba9ab P e5256d91808b47c195bc9b4dbd7f2b87 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0473d2b2d01f4459b1e90fd12cc7840e for earlier term 7. Current term is 8.
I20260709 13:05:43.249279 22873 leader_election.cc:290] T 76cb037fc9064d13b59a8969d897ce8c P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
W20260709 13:05:43.427361 19483 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.530s	user 0.017s	sys 0.009s
I20260709 13:05:43.730064 22777 raft_consensus.cc:3060] T 96efeaaf1057492490e9a621f37e1a2d P e61c3a8f61bb48f8a963c9480e53c168 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:05:43.730625 19449 leader_election.cc:403] T ff75a1d4cb1f493db8f71ddc136ba9ab P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 7 pre-election: Cancelling election due to peer responding with higher term
W20260709 13:05:43.731226 19449 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.1:40321, user_credentials={real_user=slave}} blocked reactor thread for 520075us
I20260709 13:05:43.731099 22734 raft_consensus.cc:515] T 0afb57ae58a24a01850491d69f0213dd P e61c3a8f61bb48f8a963c9480e53c168 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:05:43.732247 19552 raft_consensus.cc:2393] T 0afb57ae58a24a01850491d69f0213dd P e61c3a8f61bb48f8a963c9480e53c168 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 127766fc592545a4997f7790f50f6076 in current term 9: Already voted for candidate e61c3a8f61bb48f8a963c9480e53c168 in this term.
W20260709 13:05:43.732630 19483 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.839s	user 0.025s	sys 0.016s
W20260709 13:05:43.733678 22701 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.094s	user 0.016s	sys 0.017s
I20260709 13:05:43.733855 22734 leader_election.cc:290] T 0afb57ae58a24a01850491d69f0213dd P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 9 election: Requested vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
W20260709 13:05:43.516973 19481 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.946s	user 0.004s	sys 0.037s
W20260709 13:05:43.734612 19481 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.163s	user 0.009s	sys 0.038s
I20260709 13:05:43.587548 22792 raft_consensus.cc:493] T 40e1e16737a842ee936002830f36882e P 0473d2b2d01f4459b1e90fd12cc7840e [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:43.735469 22792 raft_consensus.cc:515] T 40e1e16737a842ee936002830f36882e P 0473d2b2d01f4459b1e90fd12cc7840e [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:43.250638 22369 raft_consensus.cc:515] T 1f85fc4b527a48848e5faa083b604e36 P 0473d2b2d01f4459b1e90fd12cc7840e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:05:43.737823 22792 leader_election.cc:290] T 40e1e16737a842ee936002830f36882e P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:05:43.738374 22792 raft_consensus.cc:3060] T ff75a1d4cb1f493db8f71ddc136ba9ab P 0473d2b2d01f4459b1e90fd12cc7840e [term 6 FOLLOWER]: Advancing to term 8
I20260709 13:05:43.738906 22369 leader_election.cc:290] T 1f85fc4b527a48848e5faa083b604e36 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
W20260709 13:05:43.645571 22702 consensus_meta.cc:287] T ed7fdbcb96d14d418db9ca90a792588a P 0473d2b2d01f4459b1e90fd12cc7840e: Time spent flushing consensus metadata: real 1.160s	user 0.012s	sys 0.000s
I20260709 13:05:43.739886 22702 raft_consensus.cc:515] T ed7fdbcb96d14d418db9ca90a792588a P 0473d2b2d01f4459b1e90fd12cc7840e [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:05:43.740585 22777 raft_consensus.cc:2749] T 96efeaaf1057492490e9a621f37e1a2d P e61c3a8f61bb48f8a963c9480e53c168 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:05:43.254256 22881 leader_election.cc:290] T b08304a0a02b42d7840c4e8ee9a6bd1a P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:05:43.285524 19404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a16f7501e2444fb86d4e2778e734e02" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
I20260709 13:05:43.743942 19404 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52328 (request call id 1722) took 1092 ms. Trace:
I20260709 13:05:43.744436 19404 rpcz_store.cc:276] 0709 13:05:42.651925 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:43.285164 (+633239us) service_pool.cc:224] Handling call
0709 13:05:43.743871 (+458707us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:05:43.246315 22888 raft_consensus.cc:2804] T 21e14947d70440f19044d8f75c31e1f9 P 0473d2b2d01f4459b1e90fd12cc7840e [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:05:43.745652 22888 raft_consensus.cc:493] T 21e14947d70440f19044d8f75c31e1f9 P 0473d2b2d01f4459b1e90fd12cc7840e [term 7 FOLLOWER]: Starting leader election (detected failure of leader e5256d91808b47c195bc9b4dbd7f2b87)
I20260709 13:05:43.746865 22722 raft_consensus.cc:515] T 6c5eebf646ad445a9d1b1adc319d7b16 P 0473d2b2d01f4459b1e90fd12cc7840e [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:05:43.255009 22838 consensus_queue.cc:1048] T b08304a0a02b42d7840c4e8ee9a6bd1a P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.502s
W20260709 13:05:43.294183 19524 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:43.749707 22722 leader_election.cc:290] T 6c5eebf646ad445a9d1b1adc319d7b16 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 7 election: Requested vote from peers e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
W20260709 13:05:43.846136 19451 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:43.285989 22658 raft_consensus.cc:493] T edd7d470b5014c9489be7f41f64355c9 P 0473d2b2d01f4459b1e90fd12cc7840e [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:05:43.435009 22715 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.544s	user 0.003s	sys 0.015s
I20260709 13:05:43.750530 22907 raft_consensus.cc:493] T a08760e15aac4630a629431f56024dc8 P 0473d2b2d01f4459b1e90fd12cc7840e [term 9 FOLLOWER]: Starting pre-election (detected failure of leader e5256d91808b47c195bc9b4dbd7f2b87)
I20260709 13:05:43.251670 22879 raft_consensus.cc:515] T 86a6797bdfe94fa496c050ceae4bd0d9 P e5256d91808b47c195bc9b4dbd7f2b87 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
W20260709 13:05:43.636562 22650 consensus_meta.cc:287] T 46c5bfeecc314717bffe987e6844b6d0 P 0473d2b2d01f4459b1e90fd12cc7840e: Time spent flushing consensus metadata: real 0.754s	user 0.009s	sys 0.003s
I20260709 13:05:43.254557 19559 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40428 (request call id 2166) took 1002 ms. Trace:
I20260709 13:05:43.859766 19559 rpcz_store.cc:276] 0709 13:05:42.252133 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:42.254525 (+  2392us) service_pool.cc:224] Handling call
0709 13:05:42.254937 (+   412us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:05:42.255343 (+   406us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:05:42.255382 (+    39us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:05:42.255930 (+   548us) log.cc:844] Serialized 26 byte log entry
0709 13:05:42.585105 (+329175us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:05:42.585143 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:42.585208 (+    65us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:05:43.254339 (+669131us) raft_consensus.cc:1685] finished
0709 13:05:43.254363 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:43.254498 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":3583,"raft.run_cpu_time_us":125,"raft.run_wall_time_us":6388,"thread_start_us":305914,"threads_started":1,"wal-append.queue_time_us":438555}
W20260709 13:05:43.675943 19560 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.781s	user 0.010s	sys 0.016s
W20260709 13:05:43.861908 19560 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.971s	user 0.011s	sys 0.019s
I20260709 13:05:43.730007 19409 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52342 (request call id 2213) took 1097 ms. Trace:
I20260709 13:05:43.862716 19409 rpcz_store.cc:276] 0709 13:05:42.632568 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:42.633282 (+   714us) service_pool.cc:224] Handling call
0709 13:05:43.729930 (+1096648us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:05:43.863854 19409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "217b5fae677b4971b3bbd2f357a1f7ff" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
I20260709 13:05:43.864496 19409 raft_consensus.cc:3060] T 217b5fae677b4971b3bbd2f357a1f7ff P e5256d91808b47c195bc9b4dbd7f2b87 [term 4 FOLLOWER]: Advancing to term 6
I20260709 13:05:43.063522 22890 raft_consensus.cc:493] T ece3db938bc649d4a40a51522ed5259c P e61c3a8f61bb48f8a963c9480e53c168 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader e5256d91808b47c195bc9b4dbd7f2b87)
I20260709 13:05:43.250788 22874 raft_consensus.cc:493] T 775c229504194560ba9589bc2199b089 P e5256d91808b47c195bc9b4dbd7f2b87 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 127766fc592545a4997f7790f50f6076)
I20260709 13:05:43.375979 22750 raft_consensus.cc:515] T 70797e5783b5454ab0d0eea663e791e3 P e61c3a8f61bb48f8a963c9480e53c168 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:05:43.246726 22847 raft_consensus.cc:515] T 48824d5acfbc485ebf8c2d944e7202de P 127766fc592545a4997f7790f50f6076 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:05:43.767747 22819 raft_consensus.cc:493] T 85c494af21f9457a85da47b9bc70c1fd P 127766fc592545a4997f7790f50f6076 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:43.435161 22845 raft_consensus.cc:493] T 1f85fc4b527a48848e5faa083b604e36 P e5256d91808b47c195bc9b4dbd7f2b87 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 127766fc592545a4997f7790f50f6076)
I20260709 13:05:43.241856 22885 raft_consensus.cc:515] T 775c229504194560ba9589bc2199b089 P 0473d2b2d01f4459b1e90fd12cc7840e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:05:43.771556 22821 raft_consensus.cc:493] T 14efcc79969f41babe5529c22d59156d P e5256d91808b47c195bc9b4dbd7f2b87 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 0473d2b2d01f4459b1e90fd12cc7840e)
W20260709 13:05:43.773206 19377 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:05:43.730481 19526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.2:46257, user_credentials={real_user=slave}} blocked reactor thread for 518662us
I20260709 13:05:43.892545 19526 leader_election.cc:304] T 3e1f505cb0f1427bbd698ac889d80821 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:05:43.893638 19526 leader_election.cc:304] T f93ee515a9c14139bf566522ed8232f3 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:05:43.774718 22703 raft_consensus.cc:493] T ab43d85f64114d4ebf618930e43d9ed0 P 0473d2b2d01f4459b1e90fd12cc7840e [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:05:43.254966 19486 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.674s	user 0.012s	sys 0.012s
I20260709 13:05:43.746050 19404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85c494af21f9457a85da47b9bc70c1fd" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
I20260709 13:05:43.742832 22702 leader_election.cc:290] T ed7fdbcb96d14d418db9ca90a792588a P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 6 election: Requested vote from peers e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
W20260709 13:05:43.729328 19450 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.3:36891, user_credentials={real_user=slave}} blocked reactor thread for 497061us
I20260709 13:05:43.897274 19450 leader_election.cc:304] T b9f0d59553ad444883fcf5b5909f9798 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e; no voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:05:43.752851 22777 raft_consensus.cc:493] T ed7fdbcb96d14d418db9ca90a792588a P e61c3a8f61bb48f8a963c9480e53c168 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:43.746397 22888 raft_consensus.cc:3060] T 21e14947d70440f19044d8f75c31e1f9 P 0473d2b2d01f4459b1e90fd12cc7840e [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:05:43.838975 19481 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58286 (request call id 1735) took 1526 ms. Trace:
I20260709 13:05:43.898517 19450 leader_election.cc:304] T df751f992649444090e27965eb1af85d P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:05:43.874924 19409 raft_consensus.cc:2468] T 217b5fae677b4971b3bbd2f357a1f7ff P e5256d91808b47c195bc9b4dbd7f2b87 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 6.
I20260709 13:05:43.901106 19450 leader_election.cc:304] T f1b10566f45d4a7d9029858330e02d5b P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:05:43.901659 19409 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52342 (request call id 2218) took 1169 ms. Trace:
I20260709 13:05:43.902123 19409 rpcz_store.cc:276] 0709 13:05:42.732597 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:43.863521 (+1130924us) service_pool.cc:224] Handling call
0709 13:05:43.901580 (+ 38059us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:05:43.850867 22715 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.983s	user 0.007s	sys 0.022s
I20260709 13:05:43.900370 19481 rpcz_store.cc:276] 0709 13:05:42.312315 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:42.312480 (+   165us) service_pool.cc:224] Handling call
0709 13:05:42.312741 (+   261us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:42.312941 (+   200us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 13:05:42.570800 (+257859us) log.cc:844] Serialized 14 byte log entry
0709 13:05:43.735119 (+1164319us) log.cc:844] Serialized 14 byte log entry
0709 13:05:43.838540 (+103421us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:05:43.838597 (+    57us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:05:43.838649 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:43.838739 (+    90us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:43.838904 (+   165us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":376178,"prepare.run_cpu_time_us":71,"prepare.run_wall_time_us":71,"raft.queue_time_us":275618,"raft.run_cpu_time_us":252,"raft.run_wall_time_us":253,"thread_start_us":1500983,"threads_started":3}
I20260709 13:05:43.855868 22658 raft_consensus.cc:515] T edd7d470b5014c9489be7f41f64355c9 P 0473d2b2d01f4459b1e90fd12cc7840e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:43.255496 22727 raft_consensus.cc:515] T 309c3ca0ca4b4f3ba129752ea2cb293b P 127766fc592545a4997f7790f50f6076 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } attrs { replace: true } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:05:43.878597 19478 raft_consensus.cc:2410] T 46c5bfeecc314717bffe987e6844b6d0 P 0473d2b2d01f4459b1e90fd12cc7840e [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate e5256d91808b47c195bc9b4dbd7f2b87 for term 14 because replica has last-logged OpId of term: 13 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 4.
I20260709 13:05:43.905085 19483 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58294 (request call id 1940) took 1400 ms. Trace:
I20260709 13:05:43.899546 22734 raft_consensus.cc:2804] T 3e1f505cb0f1427bbd698ac889d80821 P e61c3a8f61bb48f8a963c9480e53c168 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:05:43.905495 19483 rpcz_store.cc:276] 0709 13:05:42.504736 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:42.556406 (+ 51670us) service_pool.cc:224] Handling call
0709 13:05:42.584140 (+ 27734us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:42.584402 (+   262us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:05:42.893134 (+308732us) log.cc:844] Serialized 14 byte log entry
0709 13:05:43.904765 (+1011631us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:05:43.904818 (+    53us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:05:43.904870 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:43.904937 (+    67us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:43.905037 (+   100us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":386926,"prepare.run_cpu_time_us":60,"prepare.run_wall_time_us":62,"raft.queue_time_us":6461,"raft.run_cpu_time_us":84,"raft.run_wall_time_us":84,"spinlock_wait_cycles":75634560,"thread_start_us":1314628,"threads_started":3,"wal-append.queue_time_us":887561}
I20260709 13:05:43.907310 19409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a08760e15aac4630a629431f56024dc8" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
I20260709 13:05:43.910133 19409 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52328 (request call id 1718) took 1259 ms. Trace:
I20260709 13:05:43.910434 19409 rpcz_store.cc:276] 0709 13:05:42.651017 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:43.907073 (+1256056us) service_pool.cc:224] Handling call
0709 13:05:43.910082 (+  3009us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:05:43.907401 19526 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:43.911243 19409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f93ee515a9c14139bf566522ed8232f3" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 12 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
W20260709 13:05:43.907814 19480 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.703s	user 0.004s	sys 0.018s
W20260709 13:05:43.911821 19480 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.707s	user 0.004s	sys 0.019s
I20260709 13:05:43.911940 19409 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52328 (request call id 1721) took 1260 ms. Trace:
I20260709 13:05:43.912267 19409 rpcz_store.cc:276] 0709 13:05:42.651705 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:43.911027 (+1259322us) service_pool.cc:224] Handling call
0709 13:05:43.911893 (+   866us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:05:43.913244 19409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab43d85f64114d4ebf618930e43d9ed0" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 8 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
I20260709 13:05:43.913759 19409 raft_consensus.cc:3060] T ab43d85f64114d4ebf618930e43d9ed0 P e5256d91808b47c195bc9b4dbd7f2b87 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:05:43.915443 20076 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.512s	user 0.007s	sys 0.015s
W20260709 13:05:43.915808 20076 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.512s	user 0.007s	sys 0.015s
I20260709 13:05:43.859232 22907 raft_consensus.cc:515] T a08760e15aac4630a629431f56024dc8 P 0473d2b2d01f4459b1e90fd12cc7840e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:43.919787 19450 leader_election.cc:304] T 217b5fae677b4971b3bbd2f357a1f7ff P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:05:43.901955 22813 raft_consensus.cc:2804] T f93ee515a9c14139bf566522ed8232f3 P e61c3a8f61bb48f8a963c9480e53c168 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:05:43.904830 22650 raft_consensus.cc:2749] T b9f0d59553ad444883fcf5b5909f9798 P 0473d2b2d01f4459b1e90fd12cc7840e [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:05:43.932806 19450 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:43.908326 22882 raft_consensus.cc:2804] T df751f992649444090e27965eb1af85d P 0473d2b2d01f4459b1e90fd12cc7840e [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:05:43.926381 19404 raft_consensus.cc:2468] T 85c494af21f9457a85da47b9bc70c1fd P e5256d91808b47c195bc9b4dbd7f2b87 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 5.
I20260709 13:05:43.939736 19483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e1085d23e8347fbbd5bce7542f4b1f4" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:05:43.940212 19404 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52328 (request call id 1723) took 1288 ms. Trace:
I20260709 13:05:43.940784 19483 raft_consensus.cc:2393] T 0e1085d23e8347fbbd5bce7542f4b1f4 P 0473d2b2d01f4459b1e90fd12cc7840e [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 127766fc592545a4997f7790f50f6076 in current term 6: Already voted for candidate e61c3a8f61bb48f8a963c9480e53c168 in this term.
I20260709 13:05:43.940734 19404 rpcz_store.cc:276] 0709 13:05:42.652137 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:43.745731 (+1093594us) service_pool.cc:224] Handling call
0709 13:05:43.940134 (+194403us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:05:43.929478 19481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1efebf73c86e432baa55533136b6e12c" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:05:43.931841 19551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dc5b3532fe54f74876d02beffa2c230" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:05:43.921943 19409 raft_consensus.cc:2468] T ab43d85f64114d4ebf618930e43d9ed0 P e5256d91808b47c195bc9b4dbd7f2b87 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 127766fc592545a4997f7790f50f6076 in term 8.
I20260709 13:05:43.907928 22722 raft_consensus.cc:2804] T f1b10566f45d4a7d9029858330e02d5b P 0473d2b2d01f4459b1e90fd12cc7840e [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:05:43.933529 19559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e381f1d6b8184797ad142de49be225a8" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
W20260709 13:05:43.933986 19556 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.704s	user 0.014s	sys 0.003s
W20260709 13:05:43.944873 19556 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.715s	user 0.014s	sys 0.004s
I20260709 13:05:43.934067 19553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76cb037fc9064d13b59a8969d897ce8c" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:05:43.942812 19551 raft_consensus.cc:2393] T 1dc5b3532fe54f74876d02beffa2c230 P e61c3a8f61bb48f8a963c9480e53c168 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0473d2b2d01f4459b1e90fd12cc7840e in current term 8: Already voted for candidate e61c3a8f61bb48f8a963c9480e53c168 in this term.
W20260709 13:05:43.945956 19554 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41504 (request call id 458) took 2649 ms (client timeout 2506 ms). Trace:
I20260709 13:05:43.945605 19483 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39478 (request call id 438) took 1190 ms. Trace:
I20260709 13:05:43.946635 19551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b08304a0a02b42d7840c4e8ee9a6bd1a" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:05:43.945729 19553 raft_consensus.cc:2468] T 76cb037fc9064d13b59a8969d897ce8c P e61c3a8f61bb48f8a963c9480e53c168 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 7.
W20260709 13:05:43.946893 19554 rpcz_store.cc:269] 0709 13:05:41.285595 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:41.285753 (+   158us) service_pool.cc:224] Handling call
0709 13:05:43.934282 (+2648529us) spinlock_profiling.cc:243] Waited 132 ms on lock 0x7b54002f0dd4. stack: 00007f4a79de9343 00007f4a79de9240 00007f4a797781d4 00007f4a834b6304 00007f4a834b6299 00007f4a7ce71571 00007f4a7cf0c2fa 00007f4a81ecdb17 00007f4a7b4486d4 00007f4a7b448662 00007f4a7b448591 00007f4a7b44850c 00007f4a7b4477c2 00007f4a7b24348c 00007f4a7b2428c6 00007f4a7b24226f
0709 13:05:43.934380 (+    98us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":303431040}
I20260709 13:05:43.917692 22701 raft_consensus.cc:493] T e381f1d6b8184797ad142de49be225a8 P e61c3a8f61bb48f8a963c9480e53c168 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:43.894990 22703 raft_consensus.cc:515] T ab43d85f64114d4ebf618930e43d9ed0 P 0473d2b2d01f4459b1e90fd12cc7840e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } attrs { replace: true } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:05:43.888999 22874 raft_consensus.cc:515] T 775c229504194560ba9589bc2199b089 P e5256d91808b47c195bc9b4dbd7f2b87 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:05:43.948544 19553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40e1e16737a842ee936002830f36882e" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 12 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
W20260709 13:05:43.959074 19481 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39478 (request call id 434) took 1322 ms (client timeout 1749 ms). Trace:
I20260709 13:05:43.947292 19551 raft_consensus.cc:2468] T b08304a0a02b42d7840c4e8ee9a6bd1a P e61c3a8f61bb48f8a963c9480e53c168 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 10.
W20260709 13:05:43.959573 19481 rpcz_store.cc:269] 0709 13:05:42.637407 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:43.911197 (+1273790us) service_pool.cc:224] Handling call
0709 13:05:43.958998 (+ 47801us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:05:43.893754 22845 raft_consensus.cc:515] T 1f85fc4b527a48848e5faa083b604e36 P e5256d91808b47c195bc9b4dbd7f2b87 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:05:43.913458 22810 raft_consensus.cc:493] T 22196caba61445d3bec98a0aab3c337d P e61c3a8f61bb48f8a963c9480e53c168 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 0473d2b2d01f4459b1e90fd12cc7840e)
I20260709 13:05:43.947005 19483 rpcz_store.cc:276] 0709 13:05:42.755341 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:43.916185 (+1160844us) service_pool.cc:224] Handling call
0709 13:05:43.945252 (+ 29067us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:05:43.950754 19404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa731b585f684a7fb2d106c50f143b83" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
I20260709 13:05:43.950886 19554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed7fdbcb96d14d418db9ca90a792588a" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:05:43.892565 22819 raft_consensus.cc:515] T 85c494af21f9457a85da47b9bc70c1fd P 127766fc592545a4997f7790f50f6076 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:05:43.922351 22763 raft_consensus.cc:493] T 1a61655d99124a29b486ba4a5b37faea P e61c3a8f61bb48f8a963c9480e53c168 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader e5256d91808b47c195bc9b4dbd7f2b87)
I20260709 13:05:43.904735 22777 raft_consensus.cc:515] T ed7fdbcb96d14d418db9ca90a792588a P e61c3a8f61bb48f8a963c9480e53c168 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:05:43.895251 22821 raft_consensus.cc:515] T 14efcc79969f41babe5529c22d59156d P e5256d91808b47c195bc9b4dbd7f2b87 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:05:43.926998 22813 raft_consensus.cc:493] T f93ee515a9c14139bf566522ed8232f3 P e61c3a8f61bb48f8a963c9480e53c168 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:43.887832 22890 raft_consensus.cc:515] T ece3db938bc649d4a40a51522ed5259c P e61c3a8f61bb48f8a963c9480e53c168 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:05:43.960750 19551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c5eebf646ad445a9d1b1adc319d7b16" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:05:43.942761 19409 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49050 (request call id 481) took 1105 ms. Trace:
I20260709 13:05:43.988303 19409 rpcz_store.cc:276] 0709 13:05:42.837772 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:43.913036 (+1075264us) service_pool.cc:224] Handling call
0709 13:05:43.942604 (+ 29568us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:05:43.959810 19553 raft_consensus.cc:2410] T 40e1e16737a842ee936002830f36882e P e61c3a8f61bb48f8a963c9480e53c168 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0473d2b2d01f4459b1e90fd12cc7840e for term 12 because replica has last-logged OpId of term: 10 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 5.
I20260709 13:05:43.905957 22898 consensus_queue.cc:1048] T 0e1085d23e8347fbbd5bce7542f4b1f4 P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.047s
W20260709 13:05:43.924602 19449 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.1:40321, user_credentials={real_user=slave}} blocked reactor thread for 191581us
I20260709 13:05:43.978099 19481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1efebf73c86e432baa55533136b6e12c" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:05:43.999823 19404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ec1c4ce15e04c7e8c283a62179f2a64" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:05:44.000638 19404 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49050 (request call id 480) took 1163 ms. Trace:
I20260709 13:05:44.001014 19404 rpcz_store.cc:276] 0709 13:05:42.837467 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:43.971729 (+1134262us) service_pool.cc:224] Handling call
0709 13:05:44.000563 (+ 28834us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:05:43.998977 19483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14935b3ddf914369822e4a0547aaa355" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:05:43.948810 22896 raft_consensus.cc:2804] T 217b5fae677b4971b3bbd2f357a1f7ff P 0473d2b2d01f4459b1e90fd12cc7840e [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:05:43.959529 22722 raft_consensus.cc:697] T f1b10566f45d4a7d9029858330e02d5b P 0473d2b2d01f4459b1e90fd12cc7840e [term 10 LEADER]: Becoming Leader. State: Replica: 0473d2b2d01f4459b1e90fd12cc7840e, State: Running, Role: LEADER
I20260709 13:05:44.004405 19481 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39478 (request call id 441) took 1217 ms. Trace:
I20260709 13:05:44.006896 19481 rpcz_store.cc:276] 0709 13:05:42.786790 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:43.960681 (+1173891us) service_pool.cc:224] Handling call
0709 13:05:44.004346 (+ 43665us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:05:44.008006 19481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0afb57ae58a24a01850491d69f0213dd" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:05:44.008899 19481 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39478 (request call id 439) took 1245 ms. Trace:
I20260709 13:05:44.009269 19481 rpcz_store.cc:276] 0709 13:05:42.763870 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:44.007733 (+1243863us) service_pool.cc:224] Handling call
0709 13:05:44.008835 (+  1102us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:05:44.010156 19554 raft_consensus.cc:3060] T ed7fdbcb96d14d418db9ca90a792588a P e61c3a8f61bb48f8a963c9480e53c168 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:05:44.002223 19483 raft_consensus.cc:2468] T 14935b3ddf914369822e4a0547aaa355 P 0473d2b2d01f4459b1e90fd12cc7840e [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 127766fc592545a4997f7790f50f6076 in term 7.
I20260709 13:05:44.005074 19409 raft_consensus.cc:1240] T 40e1e16737a842ee936002830f36882e P e5256d91808b47c195bc9b4dbd7f2b87 [term 11 LEADER]: Rejecting Update request from peer e61c3a8f61bb48f8a963c9480e53c168 for earlier term 10. Current term is 11. Ops: [10.6-10.6]
I20260709 13:05:44.006290 19449 leader_election.cc:304] T 2725d2c4cb054f18b0fc8f735c15f6c2 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e; no voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:05:44.011299 19483 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39478 (request call id 437) took 1263 ms. Trace:
I20260709 13:05:44.011633 19409 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52328 (request call id 1715) took 1361 ms. Trace:
I20260709 13:05:44.011677 19483 rpcz_store.cc:276] 0709 13:05:42.747656 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:43.965260 (+1217604us) service_pool.cc:224] Handling call
0709 13:05:44.011245 (+ 45985us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:05:44.012148 19409 rpcz_store.cc:276] 0709 13:05:42.650293 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:44.004342 (+1354049us) service_pool.cc:224] Handling call
0709 13:05:44.004754 (+   412us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:05:44.011323 (+  6569us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:44.011565 (+   242us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:05:43.988585 22813 raft_consensus.cc:3060] T f93ee515a9c14139bf566522ed8232f3 P e61c3a8f61bb48f8a963c9480e53c168 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:05:44.018847 19404 raft_consensus.cc:1240] T 7f575b143b844aa096b50997dad3516a P e5256d91808b47c195bc9b4dbd7f2b87 [term 4 FOLLOWER]: Rejecting Update request from peer e61c3a8f61bb48f8a963c9480e53c168 for earlier term 3. Current term is 4. Ops: []
I20260709 13:05:44.027717 19409 raft_consensus.cc:1240] T 7be9efa6559648dbb5a0f7684c4542d1 P e5256d91808b47c195bc9b4dbd7f2b87 [term 9 FOLLOWER]: Rejecting Update request from peer e61c3a8f61bb48f8a963c9480e53c168 for earlier term 7. Current term is 9. Ops: [7.6-7.6]
I20260709 13:05:44.027971 19404 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52328 (request call id 1716) took 1377 ms. Trace:
I20260709 13:05:44.028512 19404 rpcz_store.cc:276] 0709 13:05:42.650520 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:44.004880 (+1354360us) service_pool.cc:224] Handling call
0709 13:05:44.018653 (+ 13773us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:44.027675 (+  9022us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:44.027913 (+   238us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:05:43.960254 22701 raft_consensus.cc:515] T e381f1d6b8184797ad142de49be225a8 P e61c3a8f61bb48f8a963c9480e53c168 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:44.031294 19409 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52328 (request call id 1726) took 1378 ms. Trace:
I20260709 13:05:44.032075 19409 rpcz_store.cc:276] 0709 13:05:42.652828 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:44.013647 (+1360819us) service_pool.cc:224] Handling call
0709 13:05:44.014284 (+   637us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:05:44.028254 (+ 13970us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:44.031214 (+  2960us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:05:44.040099 19483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36f6ba92b9ba46babe4ebd6c02e5fbd9" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:05:44.041287 19483 raft_consensus.cc:2468] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P 0473d2b2d01f4459b1e90fd12cc7840e [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 127766fc592545a4997f7790f50f6076 in term 9.
I20260709 13:05:44.041849 19483 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39478 (request call id 436) took 1304 ms. Trace:
I20260709 13:05:44.042258 19483 rpcz_store.cc:276] 0709 13:05:42.737657 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:44.012849 (+1275192us) service_pool.cc:224] Handling call
0709 13:05:44.041785 (+ 28936us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:05:44.040066 19486 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58294 (request call id 1942) took 1534 ms. Trace:
W20260709 13:05:44.043030 19377 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.2:46257, user_credentials={real_user=slave}} blocked reactor thread for 76420.1us
I20260709 13:05:44.043289 19486 rpcz_store.cc:276] 0709 13:05:42.505301 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:42.557947 (+ 52646us) service_pool.cc:224] Handling call
0709 13:05:42.580717 (+ 22770us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:42.580984 (+   267us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 13:05:43.895299 (+1314315us) log.cc:844] Serialized 14 byte log entry
0709 13:05:44.039692 (+144393us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:05:44.039747 (+    55us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:05:44.039795 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:44.039891 (+    96us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:44.040014 (+   123us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":32328,"prepare.queue_time_us":299991,"prepare.run_cpu_time_us":43,"prepare.run_wall_time_us":59,"thread_start_us":1421552,"threads_started":2}
I20260709 13:05:44.052302 22905 raft_consensus.cc:3060] T 2725d2c4cb054f18b0fc8f735c15f6c2 P 0473d2b2d01f4459b1e90fd12cc7840e [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:05:44.006139 22734 raft_consensus.cc:697] T 3e1f505cb0f1427bbd698ac889d80821 P e61c3a8f61bb48f8a963c9480e53c168 [term 9 LEADER]: Becoming Leader. State: Replica: e61c3a8f61bb48f8a963c9480e53c168, State: Running, Role: LEADER
I20260709 13:05:44.058969 22875 raft_consensus.cc:493] T 1a61655d99124a29b486ba4a5b37faea P 0473d2b2d01f4459b1e90fd12cc7840e [term 6 FOLLOWER]: Starting pre-election (detected failure of leader e5256d91808b47c195bc9b4dbd7f2b87)
W20260709 13:05:44.061905 22902 log.cc:927] Time spent T 0cdf56e38bbc453d9438d359e5a69955 P 0473d2b2d01f4459b1e90fd12cc7840e: Append to log took a long time: real 0.051s	user 0.001s	sys 0.000s
I20260709 13:05:44.063426 22909 raft_consensus.cc:493] T ff9b0eddd810459b82d91c60777c10eb P e5256d91808b47c195bc9b4dbd7f2b87 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:44.064270 22845 leader_election.cc:290] T 1f85fc4b527a48848e5faa083b604e36 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:05:44.065757 19556 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40428 (request call id 2173) took 1268 ms. Trace:
I20260709 13:05:44.105711 19404 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49050 (request call id 478) took 1269 ms. Trace:
I20260709 13:05:44.106241 19404 rpcz_store.cc:276] 0709 13:05:42.836833 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:44.029560 (+1192727us) service_pool.cc:224] Handling call
0709 13:05:44.050806 (+ 21246us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:44.051043 (+   237us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:05:44.051087 (+    44us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:05:44.051143 (+    56us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:05:44.051200 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:44.051272 (+    72us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:44.105660 (+ 54388us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:05:44.105250 19556 rpcz_store.cc:276] 0709 13:05:42.797139 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:42.799129 (+  1990us) service_pool.cc:224] Handling call
0709 13:05:42.840976 (+ 41847us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:05:43.162478 (+321502us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:05:43.162522 (+    44us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:05:43.163213 (+   691us) log.cc:844] Serialized 26 byte log entry
0709 13:05:43.945252 (+782039us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:05:43.974448 (+ 29196us) log.cc:844] Serialized 14 byte log entry
0709 13:05:43.974779 (+   331us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:43.974876 (+    97us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:05:44.065562 (+ 90686us) raft_consensus.cc:1685] finished
0709 13:05:44.065579 (+    17us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:44.065699 (+   120us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":12735,"prepare.queue_time_us":26698,"raft.queue_time_us":124651,"raft.run_cpu_time_us":282,"raft.run_wall_time_us":52762,"spinlock_wait_cycles":36678016,"thread_start_us":1023291,"threads_started":2,"wal-append.queue_time_us":775626}
I20260709 13:05:44.068188 22819 leader_election.cc:290] T 85c494af21f9457a85da47b9bc70c1fd P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:05:44.078575 22847 leader_election.cc:290] T 48824d5acfbc485ebf8c2d944e7202de P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:05:44.079391 22750 leader_election.cc:290] T 70797e5783b5454ab0d0eea663e791e3 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 9 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:05:44.040220 22912 raft_consensus.cc:493] T ff9b0eddd810459b82d91c60777c10eb P 127766fc592545a4997f7790f50f6076 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:44.026952 22896 raft_consensus.cc:697] T 217b5fae677b4971b3bbd2f357a1f7ff P 0473d2b2d01f4459b1e90fd12cc7840e [term 6 LEADER]: Becoming Leader. State: Replica: 0473d2b2d01f4459b1e90fd12cc7840e, State: Running, Role: LEADER
I20260709 13:05:43.976899 22810 raft_consensus.cc:515] T 22196caba61445d3bec98a0aab3c337d P e61c3a8f61bb48f8a963c9480e53c168 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:43.985832 22763 raft_consensus.cc:515] T 1a61655d99124a29b486ba4a5b37faea P e61c3a8f61bb48f8a963c9480e53c168 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:44.080202 22722 consensus_queue.cc:237] T f1b10566f45d4a7d9029858330e02d5b P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:44.092509 19559 raft_consensus.cc:3060] T e381f1d6b8184797ad142de49be225a8 P e61c3a8f61bb48f8a963c9480e53c168 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:05:44.086273 22894 raft_consensus.cc:493] T 0cdf56e38bbc453d9438d359e5a69955 P 0473d2b2d01f4459b1e90fd12cc7840e [term 11 FOLLOWER]: Starting pre-election (detected failure of leader e5256d91808b47c195bc9b4dbd7f2b87)
I20260709 13:05:44.094713 19481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab43d85f64114d4ebf618930e43d9ed0" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 8 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:05:44.095643 19411 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49050 (request call id 479) took 1258 ms. Trace:
I20260709 13:05:44.099997 19554 raft_consensus.cc:2468] T ed7fdbcb96d14d418db9ca90a792588a P e61c3a8f61bb48f8a963c9480e53c168 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 6.
I20260709 13:05:44.101342 19409 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49050 (request call id 482) took 1263 ms. Trace:
I20260709 13:05:44.101619 20075 leader_election.cc:304] T ab43d85f64114d4ebf618930e43d9ed0 P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 127766fc592545a4997f7790f50f6076, e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:05:44.104115 22727 leader_election.cc:290] T 309c3ca0ca4b4f3ba129752ea2cb293b P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:05:44.112548 19479 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58294 (request call id 1927) took 3765 ms. Trace:
I20260709 13:05:44.077965 22879 leader_election.cc:290] T 86a6797bdfe94fa496c050ceae4bd0d9 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:05:44.119334 22819 raft_consensus.cc:493] T 65d8cb8d6ec64f459d5a47cefab10acf P 127766fc592545a4997f7790f50f6076 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:44.119016 19404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85c494af21f9457a85da47b9bc70c1fd" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
W20260709 13:05:44.289393 19526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.2:46257, user_credentials={real_user=slave}} blocked reactor thread for 237879us
I20260709 13:05:44.379338 19404 raft_consensus.cc:2468] T 85c494af21f9457a85da47b9bc70c1fd P e5256d91808b47c195bc9b4dbd7f2b87 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 127766fc592545a4997f7790f50f6076 in term 5.
I20260709 13:05:44.379930 19481 raft_consensus.cc:3060] T ab43d85f64114d4ebf618930e43d9ed0 P 0473d2b2d01f4459b1e90fd12cc7840e [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:05:44.247967 19402 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49050 (request call id 477) took 2175 ms (client timeout 2077 ms). Trace:
I20260709 13:05:44.250324 19484 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58286 (request call id 1724) took 3030 ms. Trace:
I20260709 13:05:44.381347 19484 rpcz_store.cc:276] 0709 13:05:41.219886 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:41.220042 (+   156us) service_pool.cc:224] Handling call
0709 13:05:41.288006 (+ 67964us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:41.431964 (+143958us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:44.250014 (+2818050us) spinlock_profiling.cc:243] Waited 134 ms on lock 0x7b54001bf3d4. stack: 00007f4a79de9343 00007f4a79de9240 00007f4a797781d4 00007f4a834b6304 00007f4a834b6299 00007f4a7ce71571 00007f4a7cf08e01 00007f4a7cf0783e 00007f4a81ecc419 00007f4a7b443bd4 00007f4a7b443b62 00007f4a7b443a91 00007f4a7b443a0c 00007f4a7b442cc2 00007f4a7b24348c 00007f4a7b2428c6
0709 13:05:44.250245 (+   231us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":309234560}
W20260709 13:05:44.381848 19526 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:05:44.323879 19524 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:44.255170 19478 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58294 (request call id 1932) took 1755 ms. Trace:
I20260709 13:05:44.293963 19483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa8650e71aa14778b3d73721fc50d9fc" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:05:41.948827 18300 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:05:44.383066 19411 rpcz_store.cc:276] 0709 13:05:42.837158 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:44.094905 (+1257747us) service_pool.cc:224] Handling call
0709 13:05:44.095203 (+   298us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:44.095368 (+   165us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:05:44.095392 (+    24us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:05:44.095430 (+    38us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:05:44.095457 (+    27us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:44.095502 (+    45us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:44.095595 (+    93us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:05:44.380250 19479 rpcz_store.cc:276] 0709 13:05:40.346851 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:40.440906 (+ 94055us) service_pool.cc:224] Handling call
0709 13:05:40.441167 (+   261us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:05:40.526020 (+ 84853us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:05:40.526065 (+    45us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:05:41.376499 (+850434us) spinlock_profiling.cc:243] Waited 3.08 ms on lock 0x7b2c000010a8. stack: 00007f4a79de9343 00007f4a79de9240 00007f4a797781d4 00007f4a834b6304 00007f4a834b6299 00007f4a7b801a11 00007f4a7b811372 00007f4a7cf43a01 00007f4a7cf0843a 00007f4a7cf0783e 00007f4a81ecc419 00007f4a7b443bd4 00007f4a7b443b62 00007f4a7b443a91 00007f4a7b443a0c 00007f4a7b442cc2
0709 13:05:41.385499 (+  9000us) log.cc:844] Serialized 26 byte log entry
0709 13:05:41.612792 (+227293us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:05:41.691395 (+ 78603us) log.cc:844] Serialized 14 byte log entry
0709 13:05:41.905065 (+213670us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:41.905137 (+    72us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:05:44.110718 (+2205581us) spinlock_profiling.cc:243] Waited 3.63 ms on lock 0x7b18000774a0. stack: 00007f4a79de9343 00007f4a79de9240 00007f4a797781d4 00007f4a834b6304 00007f4a834b6299 00007f4a82ce3de1 00007f4a82cf05b1 00007f4a79e1b3f3 00007f4a79e1d7c1 00007f4a79e1d779 00007f4a79e1d709 00007f4a79e1d6d1 00007f4a79e1c9cd 000000000038f354 000000000038f199 00007f4a79dfe83a
0709 13:05:44.112331 (+  1613us) raft_consensus.cc:1685] finished
0709 13:05:44.112351 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:44.112481 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":66013,"prepare.queue_time_us":76599,"prepare.run_cpu_time_us":58,"prepare.run_wall_time_us":2459,"raft.queue_time_us":190509,"raft.run_cpu_time_us":280,"raft.run_wall_time_us":27704,"spinlock_wait_cycles":15432832,"thread_start_us":407739,"threads_started":2,"wal-append.queue_time_us":403761}
I20260709 13:05:44.162371 19480 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58294 (request call id 1929) took 1685 ms. Trace:
I20260709 13:05:44.467494 19479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff75a1d4cb1f493db8f71ddc136ba9ab" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
W20260709 13:05:44.449564 19451 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:44.436589 19305 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:51954 (request call id 130) took 8887 ms. Trace:
I20260709 13:05:44.383132 19478 rpcz_store.cc:276] 0709 13:05:42.500261 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:42.500388 (+   127us) service_pool.cc:224] Handling call
0709 13:05:44.254914 (+1754526us) spinlock_profiling.cc:243] Waited 1.33 s on lock 0x7b5400353c54. stack: 00007f4a79de9343 00007f4a79de9240 00007f4a797781d4 00007f4a834b6304 00007f4a834b6299 00007f4a7ce71571 00007f4a7cf0c2fa 00007f4a81ecdb17 00007f4a7b4486d4 00007f4a7b448662 00007f4a7b448591 00007f4a7b44850c 00007f4a7b4477c2 00007f4a7b24348c 00007f4a7b2428c6 00007f4a7b24226f
0709 13:05:44.255102 (+   188us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3049929088}
I20260709 13:05:44.408420 19409 rpcz_store.cc:276] 0709 13:05:42.838053 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:44.100633 (+1262580us) service_pool.cc:224] Handling call
0709 13:05:44.100894 (+   261us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:44.101060 (+   166us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:05:44.101092 (+    32us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:05:44.101130 (+    38us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:05:44.101158 (+    28us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:44.101209 (+    51us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:44.101294 (+    85us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:05:44.115754 22907 leader_election.cc:290] T a08760e15aac4630a629431f56024dc8 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:05:44.109119 22875 raft_consensus.cc:515] T 1a61655d99124a29b486ba4a5b37faea P 0473d2b2d01f4459b1e90fd12cc7840e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:44.118944 22914 raft_consensus.cc:493] T 2725d2c4cb054f18b0fc8f735c15f6c2 P e5256d91808b47c195bc9b4dbd7f2b87 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:44.324747 22916 raft_consensus.cc:493] T 70797e5783b5454ab0d0eea663e791e3 P 127766fc592545a4997f7790f50f6076 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader e5256d91808b47c195bc9b4dbd7f2b87)
I20260709 13:05:44.366364 22920 raft_consensus.cc:493] T 96efeaaf1057492490e9a621f37e1a2d P 0473d2b2d01f4459b1e90fd12cc7840e [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:44.474360 22914 raft_consensus.cc:515] T 2725d2c4cb054f18b0fc8f735c15f6c2 P e5256d91808b47c195bc9b4dbd7f2b87 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:44.474869 22920 raft_consensus.cc:515] T 96efeaaf1057492490e9a621f37e1a2d P 0473d2b2d01f4459b1e90fd12cc7840e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:05:44.476745 22914 leader_election.cc:290] T 2725d2c4cb054f18b0fc8f735c15f6c2 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:05:44.241037 22847 raft_consensus.cc:493] T 4af19371ea874c09a0a2147040835cbb P 127766fc592545a4997f7790f50f6076 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader e5256d91808b47c195bc9b4dbd7f2b87)
I20260709 13:05:44.328867 22905 raft_consensus.cc:2749] T 2725d2c4cb054f18b0fc8f735c15f6c2 P 0473d2b2d01f4459b1e90fd12cc7840e [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:05:44.477605 22847 raft_consensus.cc:515] T 4af19371ea874c09a0a2147040835cbb P 127766fc592545a4997f7790f50f6076 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:05:44.119022 22821 leader_election.cc:290] T 14efcc79969f41babe5529c22d59156d P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:05:44.476850 22920 leader_election.cc:290] T 96efeaaf1057492490e9a621f37e1a2d P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
W20260709 13:05:44.339594 22792 consensus_meta.cc:287] T ff75a1d4cb1f493db8f71ddc136ba9ab P 0473d2b2d01f4459b1e90fd12cc7840e: Time spent flushing consensus metadata: real 0.601s	user 0.010s	sys 0.000s
I20260709 13:05:44.155195 22734 consensus_queue.cc:237] T 3e1f505cb0f1427bbd698ac889d80821 P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:44.467845 19484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28af091831594f9d8e96482078cc7625" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:05:44.499854 19484 raft_consensus.cc:2468] T 28af091831594f9d8e96482078cc7625 P 0473d2b2d01f4459b1e90fd12cc7840e [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 8.
W20260709 13:05:44.243002 22899 log.cc:927] Time spent T 7f575b143b844aa096b50997dad3516a P e61c3a8f61bb48f8a963c9480e53c168: Append to log took a long time: real 0.463s	user 0.005s	sys 0.000s
W20260709 13:05:44.115010 22624 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.648s	user 0.002s	sys 0.011s
W20260709 13:05:44.380625 19402 rpcz_store.cc:269] 0709 13:05:42.072409 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:42.072519 (+   110us) service_pool.cc:224] Handling call
0709 13:05:44.247695 (+2175176us) spinlock_profiling.cc:243] Waited 253 ms on lock 0x7b54001ff9d4. stack: 00007f4a79de9343 00007f4a79de9240 00007f4a797781d4 00007f4a834b6304 00007f4a834b6299 00007f4a7ce71571 00007f4a7cf0c2fa 00007f4a81ecdb17 00007f4a7b4486d4 00007f4a7b448662 00007f4a7b448591 00007f4a7b44850c 00007f4a7b4477c2 00007f4a7b24348c 00007f4a7b2428c6 00007f4a7b24226f
0709 13:05:44.247846 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":581214080}
I20260709 13:05:44.525393 19478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed7fdbcb96d14d418db9ca90a792588a" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:05:44.385130 22701 leader_election.cc:290] T e381f1d6b8184797ad142de49be225a8 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:05:44.490701 19481 raft_consensus.cc:2468] T ab43d85f64114d4ebf618930e43d9ed0 P 0473d2b2d01f4459b1e90fd12cc7840e [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 127766fc592545a4997f7790f50f6076 in term 8.
W20260709 13:05:44.526789 19481 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39478 (request call id 442) took 1731 ms (client timeout 2280 ms). Trace:
W20260709 13:05:44.527444 19481 rpcz_store.cc:269] 0709 13:05:42.795435 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:44.009972 (+1214537us) service_pool.cc:224] Handling call
0709 13:05:44.526704 (+516732us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:05:44.528553 19559 raft_consensus.cc:2468] T e381f1d6b8184797ad142de49be225a8 P e61c3a8f61bb48f8a963c9480e53c168 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 7.
I20260709 13:05:44.529022 19481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14935b3ddf914369822e4a0547aaa355" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:05:44.530267 19481 raft_consensus.cc:2393] T 14935b3ddf914369822e4a0547aaa355 P 0473d2b2d01f4459b1e90fd12cc7840e [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e5256d91808b47c195bc9b4dbd7f2b87 in current term 7: Already voted for candidate 0473d2b2d01f4459b1e90fd12cc7840e in this term.
I20260709 13:05:44.531494 19481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f575b143b844aa096b50997dad3516a" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:05:44.160163 22692 raft_consensus.cc:3060] T 22196caba61445d3bec98a0aab3c337d P 0473d2b2d01f4459b1e90fd12cc7840e [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:05:44.251124 22898 raft_consensus.cc:493] T ab43d85f64114d4ebf618930e43d9ed0 P e61c3a8f61bb48f8a963c9480e53c168 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:44.365322 22777 leader_election.cc:290] T ed7fdbcb96d14d418db9ca90a792588a P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:05:44.501699 22890 leader_election.cc:290] T ece3db938bc649d4a40a51522ed5259c P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:05:44.501854 22847 leader_election.cc:290] T 4af19371ea874c09a0a2147040835cbb P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
W20260709 13:05:44.502506 22901 log.cc:927] Time spent T df751f992649444090e27965eb1af85d P 0473d2b2d01f4459b1e90fd12cc7840e: Append to log took a long time: real 0.721s	user 0.000s	sys 0.002s
W20260709 13:05:44.503897 22888 consensus_meta.cc:287] T 21e14947d70440f19044d8f75c31e1f9 P 0473d2b2d01f4459b1e90fd12cc7840e: Time spent flushing consensus metadata: real 0.591s	user 0.007s	sys 0.003s
W20260709 13:05:44.505714 19525 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:44.507279 22760 raft_consensus.cc:493] T ece3db938bc649d4a40a51522ed5259c P 127766fc592545a4997f7790f50f6076 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader e5256d91808b47c195bc9b4dbd7f2b87)
I20260709 13:05:44.509593 22846 raft_consensus.cc:2804] T ab43d85f64114d4ebf618930e43d9ed0 P 127766fc592545a4997f7790f50f6076 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:05:44.158357 22834 raft_consensus.cc:493] T 86a6797bdfe94fa496c050ceae4bd0d9 P 0473d2b2d01f4459b1e90fd12cc7840e [term 8 FOLLOWER]: Starting pre-election (detected failure of leader e61c3a8f61bb48f8a963c9480e53c168)
I20260709 13:05:44.331033 22885 leader_election.cc:290] T 775c229504194560ba9589bc2199b089 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:05:44.514350 22792 raft_consensus.cc:2749] T ff75a1d4cb1f493db8f71ddc136ba9ab P 0473d2b2d01f4459b1e90fd12cc7840e [term 8 FOLLOWER]: Leader pre-election lost for term 7. Reason: Vote denied by peer e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321) with higher term. Message: Invalid argument: T ff75a1d4cb1f493db8f71ddc136ba9ab P e5256d91808b47c195bc9b4dbd7f2b87 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0473d2b2d01f4459b1e90fd12cc7840e for earlier term 7. Current term is 8.
I20260709 13:05:44.526975 19478 raft_consensus.cc:2393] T ed7fdbcb96d14d418db9ca90a792588a P 0473d2b2d01f4459b1e90fd12cc7840e [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 127766fc592545a4997f7790f50f6076 in current term 6: Already voted for candidate 0473d2b2d01f4459b1e90fd12cc7840e in this term.
I20260709 13:05:44.537384 22703 leader_election.cc:290] T ab43d85f64114d4ebf618930e43d9ed0 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:05:44.253698 22882 raft_consensus.cc:493] T df751f992649444090e27965eb1af85d P 0473d2b2d01f4459b1e90fd12cc7840e [term 9 FOLLOWER]: Starting leader election (detected failure of leader e5256d91808b47c195bc9b4dbd7f2b87)
I20260709 13:05:44.497009 19483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ec1c4ce15e04c7e8c283a62179f2a64" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:05:44.249758 22625 raft_consensus.cc:3055] T ef32ce6fdd0e40d382c79974f30295c6 P e5256d91808b47c195bc9b4dbd7f2b87 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:05:44.113950 22909 raft_consensus.cc:515] T ff9b0eddd810459b82d91c60777c10eb P e5256d91808b47c195bc9b4dbd7f2b87 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:05:44.469323 19305 rpcz_store.cc:276] 0709 13:05:35.516353 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:35.516731 (+   378us) service_pool.cc:224] Handling call
0709 13:05:35.837119 (+320388us) spinlock_profiling.cc:243] Waited 281 ms on lock 0x7b54003fb6d4. stack: 00007f4a79de9343 00007f4a79de9240 00007f4a797781d4 00007f4a834b6304 00007f4a834b6299 00007f4a7ce72090 00007f4a7cf10f3a 00007f4a82cc71cc 00007f4a82dc537e 00007f4a812862a4 00007f4a81286232 00007f4a81286161 00007f4a812860dc 00007f4a81285392 00007f4a7b24348c 00007f4a7b2428c6
0709 13:05:44.385729 (+8548610us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:05:37.932849 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:05:38.107345 (+174496us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:05:38.108610 (+  1265us) write_op.cc:435] Acquired schema lock
0709 13:05:38.114496 (+  5886us) tablet.cc:662] Decoding operations
0709 13:05:38.246488 (+131992us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:05:38.246548 (+    60us) write_op.cc:641] Partition lock acquired for write op
0709 13:05:38.246573 (+    25us) tablet.cc:685] Acquiring locks for 14 operations
0709 13:05:38.247667 (+  1094us) tablet.cc:701] Row locks acquired
0709 13:05:38.247685 (+    18us) write_op.cc:260] PREPARE: finished
0709 13:05:38.247837 (+   152us) write_op.cc:270] Start()
0709 13:05:38.247978 (+   141us) write_op.cc:276] Timestamp: P: 1783602338247790 usec, L: 0
0709 13:05:38.247994 (+    16us) op_driver.cc:348] REPLICATION: starting
0709 13:05:38.357180 (+109186us) log.cc:844] Serialized 5594 byte log entry
0709 13:05:38.612271 (+255091us) spinlock_profiling.cc:243] Waited 4.4 ms on lock 0x7b4400022b4c. stack: 00007f4a79de9343 00007f4a79de9240 00007f4a797781d4 00007f4a834b6304 00007f4a834b6299 00007f4a79ca3db1 00007f4a79d41c85 00007f4a79d426a2 00007f4a7cab41db 00007f4a7caafaaf 00007f4a79dfe0ac 00007f4a82c58ab9 00007f4a79e1a69b 00007f4a79e1893f 00007f4a79e1ac02 00007f4a7caa220b
0709 13:05:38.806279 (+194008us) op_driver.cc:464] REPLICATION: finished
0709 13:05:38.970641 (+164362us) write_op.cc:301] APPLY: starting
0709 13:05:38.970761 (+   120us) tablet.cc:1367] starting BulkCheckPresence
0709 13:05:38.971023 (+   262us) tablet.cc:1370] finished BulkCheckPresence
0709 13:05:38.971153 (+   130us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:05:39.194221 (+223068us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:05:39.194467 (+   246us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=14
0709 13:05:39.194531 (+    64us) write_op.cc:312] APPLY: finished
0709 13:05:39.242317 (+ 47786us) log.cc:844] Serialized 101 byte log entry
0709 13:05:39.243126 (+   809us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:05:39.243283 (+   157us) write_op.cc:454] Released schema lock
0709 13:05:39.243333 (+    50us) write_op.cc:341] FINISH: Updating metrics
0709 13:05:39.243715 (+   382us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:05:39.243741 (+    26us) write_op.cc:454] Released schema lock
0709 13:05:39.892985 (+649244us) spinlock_profiling.cc:243] Waited 1.67 ms on lock 0x7b54003fb6d4. stack: 00007f4a79de9343 00007f4a79de9240 00007f4a797781d4 00007f4a834b6304 00007f4a834b6299 00007f4a7ce71571 00007f4a7cf0532a 00007f4a7ce8af14 00007f4a7ce8aec3 00007f4a7ce8ae38 00007f4a7ce8adf3 00007f4a7ce8a0dc 00007f4a7ceb3e16 00007f4a7ce9bcbb 00007f4a7ce8639d 00007f4a7ce89d75
Metrics: {"mutex_wait_us":56344,"reported_tablets":25,"spinlock_wait_cycles":646080896,"child_traces":[["op",{"apply.queue_time_us":122941,"apply.run_cpu_time_us":7812,"apply.run_wall_time_us":285066,"num_ops":14,"prepare.queue_time_us":248594,"prepare.run_cpu_time_us":28332,"prepare.run_wall_time_us":853349,"raft.queue_time_us":108017,"raft.run_cpu_time_us":19570,"raft.run_wall_time_us":1127035,"replication_time_us":534587,"spinlock_wait_cycles":13974656,"thread_start_us":540420,"threads_started":4,"wal-append.queue_time_us":285686,"wal-append.run_cpu_time_us":15823,"wal-append.run_wall_time_us":1599702}]]}
I20260709 13:05:44.534466 19481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0afb57ae58a24a01850491d69f0213dd" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:05:44.588661 19479 raft_consensus.cc:2468] T ff75a1d4cb1f493db8f71ddc136ba9ab P 0473d2b2d01f4459b1e90fd12cc7840e [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 8.
I20260709 13:05:44.424636 22874 leader_election.cc:290] T 775c229504194560ba9589bc2199b089 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:05:44.536618 19484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab43d85f64114d4ebf618930e43d9ed0" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 8 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:05:44.204279 22912 raft_consensus.cc:515] T ff9b0eddd810459b82d91c60777c10eb P 127766fc592545a4997f7790f50f6076 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
W20260709 13:05:44.541471 22881 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.799s	user 0.014s	sys 0.005s
I20260709 13:05:44.423334 22894 raft_consensus.cc:515] T 0cdf56e38bbc453d9438d359e5a69955 P 0473d2b2d01f4459b1e90fd12cc7840e [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:44.539662 22907 raft_consensus.cc:493] T 46c5bfeecc314717bffe987e6844b6d0 P 0473d2b2d01f4459b1e90fd12cc7840e [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:44.289896 22813 raft_consensus.cc:515] T f93ee515a9c14139bf566522ed8232f3 P e61c3a8f61bb48f8a963c9480e53c168 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
W20260709 13:05:44.543149 20075 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.1:40321, user_credentials={real_user=slave}} blocked reactor thread for 441600us
I20260709 13:05:44.615095 19449 leader_election.cc:304] T 5ec1c4ce15e04c7e8c283a62179f2a64 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, 127766fc592545a4997f7790f50f6076; no voters: e5256d91808b47c195bc9b4dbd7f2b87
W20260709 13:05:44.533253 22624 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.096s	user 0.004s	sys 0.013s
I20260709 13:05:44.422149 22819 raft_consensus.cc:515] T 65d8cb8d6ec64f459d5a47cefab10acf P 127766fc592545a4997f7790f50f6076 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:05:44.581884 19551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e381f1d6b8184797ad142de49be225a8" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:05:44.467907 19480 rpcz_store.cc:276] 0709 13:05:42.496200 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:42.496330 (+   130us) service_pool.cc:224] Handling call
0709 13:05:42.496652 (+   322us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:05:42.554722 (+ 58070us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:05:42.888980 (+334258us) log.cc:844] Serialized 14 byte log entry
0709 13:05:43.919306 (+1030326us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:05:43.934837 (+ 15531us) log.cc:844] Serialized 52 byte log entry
0709 13:05:43.944448 (+  9611us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:05:43.944706 (+   258us) log.cc:844] Serialized 14 byte log entry
0709 13:05:43.952149 (+  7443us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:43.952218 (+    69us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:05:44.162082 (+209864us) raft_consensus.cc:1685] finished
0709 13:05:44.162111 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:44.162299 (+   188us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":15882,"prepare.queue_time_us":200440,"raft.queue_time_us":198119,"raft.run_cpu_time_us":457,"raft.run_wall_time_us":39884,"spinlock_wait_cycles":12144896,"thread_start_us":1080861,"threads_started":3,"wal-append.queue_time_us":936918}
I20260709 13:05:44.587028 19553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1b10566f45d4a7d9029858330e02d5b" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:05:44.632637 19553 raft_consensus.cc:2393] T f1b10566f45d4a7d9029858330e02d5b P e61c3a8f61bb48f8a963c9480e53c168 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e5256d91808b47c195bc9b4dbd7f2b87 in current term 10: Already voted for candidate 0473d2b2d01f4459b1e90fd12cc7840e in this term.
I20260709 13:05:44.590338 19556 raft_consensus.cc:1240] T 1dc5b3532fe54f74876d02beffa2c230 P e61c3a8f61bb48f8a963c9480e53c168 [term 8 FOLLOWER]: Rejecting Update request from peer e5256d91808b47c195bc9b4dbd7f2b87 for earlier term 7. Current term is 8. Ops: []
I20260709 13:05:44.591022 19560 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40428 (request call id 2175) took 1759 ms. Trace:
I20260709 13:05:44.591356 19483 raft_consensus.cc:2410] T 5ec1c4ce15e04c7e8c283a62179f2a64 P 0473d2b2d01f4459b1e90fd12cc7840e [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 127766fc592545a4997f7790f50f6076 for term 8 because replica has last-logged OpId of term: 6 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 6.
I20260709 13:05:44.592012 20111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f85fc4b527a48848e5faa083b604e36" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:05:44.588863 19478 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39478 (request call id 433) took 1954 ms. Trace:
I20260709 13:05:44.633657 19478 rpcz_store.cc:276] 0709 13:05:42.635098 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:44.495729 (+1860631us) service_pool.cc:224] Handling call
0709 13:05:44.588798 (+ 93069us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:05:44.474382 22916 raft_consensus.cc:515] T 70797e5783b5454ab0d0eea663e791e3 P 127766fc592545a4997f7790f50f6076 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:05:44.595245 20105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14935b3ddf914369822e4a0547aaa355" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:05:44.592634 22846 raft_consensus.cc:697] T ab43d85f64114d4ebf618930e43d9ed0 P 127766fc592545a4997f7790f50f6076 [term 8 LEADER]: Becoming Leader. State: Replica: 127766fc592545a4997f7790f50f6076, State: Running, Role: LEADER
I20260709 13:05:44.595778 19484 raft_consensus.cc:2376] T ab43d85f64114d4ebf618930e43d9ed0 P 0473d2b2d01f4459b1e90fd12cc7840e [term 8 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 127766fc592545a4997f7790f50f6076 in term 8. Re-sending same reply.
I20260709 13:05:44.613328 20104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14efcc79969f41babe5529c22d59156d" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:05:44.580587 22847 raft_consensus.cc:493] T 833a2f0775ed407a94b8924ce50adb63 P 127766fc592545a4997f7790f50f6076 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader e5256d91808b47c195bc9b4dbd7f2b87)
I20260709 13:05:44.585650 22760 raft_consensus.cc:515] T ece3db938bc649d4a40a51522ed5259c P 127766fc592545a4997f7790f50f6076 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:05:44.630321 19402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "309c3ca0ca4b4f3ba129752ea2cb293b" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:05:44.751375 19402 raft_consensus.cc:2468] T 309c3ca0ca4b4f3ba129752ea2cb293b P e5256d91808b47c195bc9b4dbd7f2b87 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 127766fc592545a4997f7790f50f6076 in term 7.
I20260709 13:05:44.630303 19409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4af19371ea874c09a0a2147040835cbb" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
W20260709 13:05:44.616379 19451 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:44.644724 19478 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58294 (request call id 1945) took 2089 ms. Trace:
I20260709 13:05:44.600097 19481 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58294 (request call id 1943) took 2094 ms. Trace:
I20260709 13:05:44.672456 19485 raft_consensus.cc:2468] T 22196caba61445d3bec98a0aab3c337d P 0473d2b2d01f4459b1e90fd12cc7840e [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 8.
I20260709 13:05:44.635059 19483 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39478 (request call id 440) took 1863 ms. Trace:
I20260709 13:05:44.759665 19483 rpcz_store.cc:276] 0709 13:05:42.772112 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:44.452432 (+1680320us) service_pool.cc:224] Handling call
0709 13:05:44.635000 (+182568us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:05:44.759167 19481 rpcz_store.cc:276] 0709 13:05:42.505566 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:44.599142 (+2093576us) service_pool.cc:224] Handling call
0709 13:05:44.599480 (+   338us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:44.599698 (+   218us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:05:44.599734 (+    36us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:05:44.599789 (+    55us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:05:44.599833 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:44.599903 (+    70us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:44.600030 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:05:44.761533 19480 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58294 (request call id 1944) took 2255 ms. Trace:
I20260709 13:05:44.640203 19484 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39478 (request call id 432) took 2006 ms. Trace:
I20260709 13:05:44.639179 19526 leader_election.cc:304] T 28af091831594f9d8e96482078cc7625 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:05:44.640337 20104 raft_consensus.cc:2468] T 14efcc79969f41babe5529c22d59156d P 127766fc592545a4997f7790f50f6076 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 9.
I20260709 13:05:44.655151 19556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9f0d59553ad444883fcf5b5909f9798" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
W20260709 13:05:44.765534 19526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.2:46257, user_credentials={real_user=slave}} blocked reactor thread for 126263us
I20260709 13:05:44.637463 20105 raft_consensus.cc:2468] T 14935b3ddf914369822e4a0547aaa355 P 127766fc592545a4997f7790f50f6076 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 7.
I20260709 13:05:44.642282 20075 leader_election.cc:304] T 85c494af21f9457a85da47b9bc70c1fd P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 127766fc592545a4997f7790f50f6076, e5256d91808b47c195bc9b4dbd7f2b87; no voters: 
I20260709 13:05:44.763049 19484 rpcz_store.cc:276] 0709 13:05:42.634295 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:44.500466 (+1866171us) service_pool.cc:224] Handling call
0709 13:05:44.640147 (+139681us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:05:44.633132 19560 rpcz_store.cc:276] 0709 13:05:42.831463 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:42.831759 (+   296us) service_pool.cc:224] Handling call
0709 13:05:42.832178 (+   419us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:05:42.853594 (+ 21416us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:05:42.853636 (+    42us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:05:42.890977 (+ 37341us) log.cc:844] Serialized 26 byte log entry
0709 13:05:43.862357 (+971380us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:05:43.862409 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:43.862498 (+    89us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:05:44.242324 (+379826us) spinlock_profiling.cc:243] Waited 2.7 ms on lock 0x7b4400022b4c. stack: 00007f4a79de9343 00007f4a79de9240 00007f4a797781d4 00007f4a834b6304 00007f4a834b6299 00007f4a79ca3db1 00007f4a79d41c85 00007f4a79d426a2 00007f4a7cab41db 00007f4a7caafaaf 00007f4a7caa386e 00007f4a7caa2bb6 00007f4a7caa27d8 00007f4a7caac221 00007f4a7caac1d9 00007f4a7caac169
0709 13:05:44.590735 (+348411us) raft_consensus.cc:1685] finished
0709 13:05:44.590764 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:44.590969 (+   205us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":20922,"raft.queue_time_us":62727,"raft.run_cpu_time_us":170,"raft.run_wall_time_us":55239,"spinlock_wait_cycles":6218496,"thread_start_us":970966,"threads_started":1,"wal-append.queue_time_us":888593}
I20260709 13:05:44.591615 22625 raft_consensus.cc:740] T ef32ce6fdd0e40d382c79974f30295c6 P e5256d91808b47c195bc9b4dbd7f2b87 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: e5256d91808b47c195bc9b4dbd7f2b87, State: Running, Role: LEADER
W20260709 13:05:44.636682 22706 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 3.226s	user 0.038s	sys 0.071s
I20260709 13:05:44.636894 22722 raft_consensus.cc:2804] T 5ec1c4ce15e04c7e8c283a62179f2a64 P 0473d2b2d01f4459b1e90fd12cc7840e [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:05:44.677645 22760 leader_election.cc:290] T ece3db938bc649d4a40a51522ed5259c P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:05:44.591288 22763 leader_election.cc:290] T 1a61655d99124a29b486ba4a5b37faea P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:05:44.661219 22810 leader_election.cc:290] T 22196caba61445d3bec98a0aab3c337d P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:05:44.657745 22813 leader_election.cc:290] T f93ee515a9c14139bf566522ed8232f3 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 12 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:05:44.660614 22819 leader_election.cc:290] T 65d8cb8d6ec64f459d5a47cefab10acf P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:05:44.588768 22834 raft_consensus.cc:515] T 86a6797bdfe94fa496c050ceae4bd0d9 P 0473d2b2d01f4459b1e90fd12cc7840e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:44.663267 22846 consensus_queue.cc:237] T ab43d85f64114d4ebf618930e43d9ed0 P 127766fc592545a4997f7790f50f6076 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.5, Last appended by leader: 5, Current term: 8, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } attrs { replace: true } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:05:44.645295 22847 raft_consensus.cc:515] T 833a2f0775ed407a94b8924ce50adb63 P 127766fc592545a4997f7790f50f6076 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
W20260709 13:05:44.628419 22881 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.878s	user 0.014s	sys 0.005s
I20260709 13:05:44.592789 22882 raft_consensus.cc:3060] T df751f992649444090e27965eb1af85d P 0473d2b2d01f4459b1e90fd12cc7840e [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:05:44.580209 22888 raft_consensus.cc:515] T 21e14947d70440f19044d8f75c31e1f9 P 0473d2b2d01f4459b1e90fd12cc7840e [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:44.659082 22894 leader_election.cc:290] T 0cdf56e38bbc453d9438d359e5a69955 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:05:44.573239 22896 consensus_queue.cc:237] T 217b5fae677b4971b3bbd2f357a1f7ff P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:44.571727 22898 raft_consensus.cc:515] T ab43d85f64114d4ebf618930e43d9ed0 P e61c3a8f61bb48f8a963c9480e53c168 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } attrs { replace: true } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:05:44.619897 22907 raft_consensus.cc:515] T 46c5bfeecc314717bffe987e6844b6d0 P 0473d2b2d01f4459b1e90fd12cc7840e [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:44.679770 22909 leader_election.cc:290] T ff9b0eddd810459b82d91c60777c10eb P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:05:44.662536 22912 leader_election.cc:290] T ff9b0eddd810459b82d91c60777c10eb P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:05:44.656517 22916 leader_election.cc:290] T 70797e5783b5454ab0d0eea663e791e3 P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:05:44.588512 22921 raft_consensus.cc:493] T 62c6c134d3d24a1ab144dd9ee6bc3f64 P 127766fc592545a4997f7790f50f6076 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 0473d2b2d01f4459b1e90fd12cc7840e)
I20260709 13:05:44.758385 19478 rpcz_store.cc:276] 0709 13:05:42.557381 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:44.634733 (+2077352us) service_pool.cc:224] Handling call
0709 13:05:44.644410 (+  9677us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:44.644531 (+   121us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:05:44.644544 (+    13us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:05:44.644570 (+    26us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:05:44.644592 (+    22us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:44.644623 (+    31us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:44.644686 (+    63us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:05:44.767925 20075 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.1:40321, user_credentials={real_user=slave}} blocked reactor thread for 125547us
I20260709 13:05:44.771004 19483 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58294 (request call id 1946) took 2170 ms. Trace:
W20260709 13:05:45.243088 19374 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.4:43121, user_credentials={real_user=slave}} blocked reactor thread for 78944.6us
I20260709 13:05:44.791185 19556 raft_consensus.cc:1275] T b08304a0a02b42d7840c4e8ee9a6bd1a P e61c3a8f61bb48f8a963c9480e53c168 [term 10 FOLLOWER]: Refusing update from remote peer e5256d91808b47c195bc9b4dbd7f2b87: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
W20260709 13:05:45.251336 19524 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:44.794209 19481 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58294 (request call id 1947) took 2130 ms. Trace:
W20260709 13:05:45.000998 19526 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:44.793301 19482 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58294 (request call id 1939) took 2288 ms. Trace:
I20260709 13:05:45.022838 20112 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35874 (request call id 654) took 3235 ms. Trace:
W20260709 13:05:44.858040 19450 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.756s	user 0.000s	sys 0.012s
I20260709 13:05:45.259868 19483 rpcz_store.cc:276] 0709 13:05:42.600881 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:44.761339 (+2160458us) service_pool.cc:224] Handling call
0709 13:05:44.762302 (+   963us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:44.770576 (+  8274us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:05:44.770604 (+    28us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:05:44.770688 (+    84us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:05:44.770741 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:44.770794 (+    53us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:44.770913 (+   119us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":82176}
W20260709 13:05:45.051465 19451 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:05:45.056522 19558 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40428 (request call id 2165) took 2804 ms (client timeout 2225 ms). Trace:
W20260709 13:05:44.808107 19552 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41504 (request call id 477) took 2660 ms (client timeout 2176 ms). Trace:
I20260709 13:05:44.784715 22624 raft_consensus.cc:2804] T 28af091831594f9d8e96482078cc7625 P e61c3a8f61bb48f8a963c9480e53c168 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:05:45.265116 19481 rpcz_store.cc:276] 0709 13:05:42.633811 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:44.761361 (+2127550us) service_pool.cc:224] Handling call
0709 13:05:44.762357 (+   996us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:44.762914 (+   557us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:05:44.762942 (+    28us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:05:44.763000 (+    58us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:05:44.763036 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:44.763096 (+    60us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:44.763810 (+   714us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":51712}
W20260709 13:05:45.268976 19450 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.168s	user 0.009s	sys 0.041s
W20260709 13:05:45.267621 19558 rpcz_store.cc:269] 0709 13:05:42.251865 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:42.253761 (+  1896us) service_pool.cc:224] Handling call
0709 13:05:44.909581 (+2655820us) spinlock_profiling.cc:243] Waited 41.3 ms on lock 0x7b540002f8d4. stack: 00007f4a79de9343 00007f4a79de9240 00007f4a797781d4 00007f4a834b6304 00007f4a834b6299 00007f4a7ce71571 00007f4a7cf0c2fa 00007f4a81ecdb17 00007f4a7b4486d4 00007f4a7b448662 00007f4a7b448591 00007f4a7b44850c 00007f4a7b4477c2 00007f4a7b24348c 00007f4a7b2428c6 00007f4a7b24226f
0709 13:05:45.056191 (+146610us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":94966144}
I20260709 13:05:45.265300 19482 rpcz_store.cc:276] 0709 13:05:42.504461 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:42.552961 (+ 48500us) service_pool.cc:224] Handling call
0709 13:05:42.553271 (+   310us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:42.881448 (+328177us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:05:42.881490 (+    42us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:05:42.881547 (+    57us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:05:42.881595 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:44.792684 (+1911089us) spinlock_profiling.cc:243] Waited 328 ms on lock 0x7b5400344254. stack: 00007f4a79de9343 00007f4a79de9240 00007f4a797781d4 00007f4a834b6304 00007f4a834b6299 00007f4a7ce71571 00007f4a7cf08e01 00007f4a7cf0783e 00007f4a81ecc419 00007f4a7b443bd4 00007f4a7b443b62 00007f4a7b443a91 00007f4a7b443a0c 00007f4a7b442cc2 00007f4a7b24348c 00007f4a7b2428c6
0709 13:05:44.792751 (+    67us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:44.793070 (+   319us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":754158976}
I20260709 13:05:44.897178 22928 raft_consensus.cc:2804] T 85c494af21f9457a85da47b9bc70c1fd P 127766fc592545a4997f7790f50f6076 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:05:45.265767 20112 rpcz_store.cc:276] 0709 13:05:41.786964 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:41.787135 (+   171us) service_pool.cc:224] Handling call
0709 13:05:41.819855 (+ 32720us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:41.887614 (+ 67759us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:05:41.887655 (+    41us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:05:41.887694 (+    39us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:05:41.887731 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:45.022242 (+3134511us) spinlock_profiling.cc:243] Waited 67.6 ms on lock 0x7b5400245c54. stack: 00007f4a79de9343 00007f4a79de9240 00007f4a797781d4 00007f4a834b6304 00007f4a834b6299 00007f4a7ce71571 00007f4a7cf08e01 00007f4a7cf0783e 00007f4a81ecc419 00007f4a7b443bd4 00007f4a7b443b62 00007f4a7b443a91 00007f4a7b443a0c 00007f4a7b442cc2 00007f4a7b24348c 00007f4a7b2428c6
0709 13:05:45.022345 (+   103us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:45.022610 (+   265us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":155383168}
I20260709 13:05:44.890724 22873 raft_consensus.cc:493] T 22196caba61445d3bec98a0aab3c337d P 0473d2b2d01f4459b1e90fd12cc7840e [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:05:45.268047 19552 rpcz_store.cc:269] 0709 13:05:42.147301 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:42.147412 (+   111us) service_pool.cc:224] Handling call
0709 13:05:44.807460 (+2660048us) spinlock_profiling.cc:243] Waited 1.58 s on lock 0x7b5400124654. stack: 00007f4a79de9343 00007f4a79de9240 00007f4a797781d4 00007f4a834b6304 00007f4a834b6299 00007f4a7ce71571 00007f4a7cf0c2fa 00007f4a81ecdb17 00007f4a7b4486d4 00007f4a7b448662 00007f4a7b448591 00007f4a7b44850c 00007f4a7b4477c2 00007f4a7b24348c 00007f4a7b2428c6 00007f4a7b24226f
0709 13:05:44.807801 (+   341us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3622828288}
W20260709 13:05:45.282230 19485 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58294 (request call id 1931) took 2783 ms (client timeout 2087 ms). Trace:
W20260709 13:05:45.291460 19449 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.1:40321, user_credentials={real_user=slave}} blocked reactor thread for 651137us
I20260709 13:05:45.281857 22625 consensus_queue.cc:260] T ef32ce6fdd0e40d382c79974f30295c6 P e5256d91808b47c195bc9b4dbd7f2b87 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
W20260709 13:05:45.271965 22706 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 3.856s	user 0.043s	sys 0.075s
I20260709 13:05:45.292788 22625 raft_consensus.cc:3060] T ef32ce6fdd0e40d382c79974f30295c6 P e5256d91808b47c195bc9b4dbd7f2b87 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:05:45.292829 22706 raft_consensus.cc:493] T 9962423cb4e54fcfa5de01daf68a86e7 P 0473d2b2d01f4459b1e90fd12cc7840e [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 127766fc592545a4997f7790f50f6076)
I20260709 13:05:45.293856 22706 raft_consensus.cc:515] T 9962423cb4e54fcfa5de01daf68a86e7 P 0473d2b2d01f4459b1e90fd12cc7840e [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:05:45.269249 22624 raft_consensus.cc:493] T 28af091831594f9d8e96482078cc7625 P e61c3a8f61bb48f8a963c9480e53c168 [term 8 FOLLOWER]: Starting leader election (detected failure of leader e5256d91808b47c195bc9b4dbd7f2b87)
I20260709 13:05:45.295202 22624 raft_consensus.cc:3060] T 28af091831594f9d8e96482078cc7625 P e61c3a8f61bb48f8a963c9480e53c168 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:05:45.296489 19560 raft_consensus.cc:1240] T a08760e15aac4630a629431f56024dc8 P e61c3a8f61bb48f8a963c9480e53c168 [term 10 FOLLOWER]: Rejecting Update request from peer e5256d91808b47c195bc9b4dbd7f2b87 for earlier term 9. Current term is 10. Ops: []
I20260709 13:05:45.021617 20110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "775c229504194560ba9589bc2199b089" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:05:45.301935 22761 raft_consensus.cc:3060] T 7be9efa6559648dbb5a0f7684c4542d1 P e61c3a8f61bb48f8a963c9480e53c168 [term 7 FOLLOWER]: Advancing to term 9
I20260709 13:05:45.302588 19558 raft_consensus.cc:1240] T 2a16f7501e2444fb86d4e2778e734e02 P e61c3a8f61bb48f8a963c9480e53c168 [term 9 FOLLOWER]: Rejecting Update request from peer e5256d91808b47c195bc9b4dbd7f2b87 for earlier term 8. Current term is 9. Ops: []
I20260709 13:05:45.285601 19478 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58294 (request call id 1954) took 1355 ms. Trace:
I20260709 13:05:45.285838 22834 leader_election.cc:290] T 86a6797bdfe94fa496c050ceae4bd0d9 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
W20260709 13:05:45.283771 19477 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58294 (request call id 1937) took 2779 ms (client timeout 1906 ms). Trace:
I20260709 13:05:45.287796 19374 leader_election.cc:304] T 14efcc79969f41babe5529c22d59156d P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 127766fc592545a4997f7790f50f6076, e5256d91808b47c195bc9b4dbd7f2b87; no voters: 
I20260709 13:05:45.277365 22928 raft_consensus.cc:493] T 85c494af21f9457a85da47b9bc70c1fd P 127766fc592545a4997f7790f50f6076 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:45.290126 22873 raft_consensus.cc:515] T 22196caba61445d3bec98a0aab3c337d P 0473d2b2d01f4459b1e90fd12cc7840e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
W20260709 13:05:45.291385 19485 rpcz_store.cc:269] 0709 13:05:42.499121 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:42.499255 (+   134us) service_pool.cc:224] Handling call
0709 13:05:45.281860 (+2782605us) spinlock_profiling.cc:243] Waited 2.16 s on lock 0x7b54000ed654. stack: 00007f4a79de9343 00007f4a79de9240 00007f4a797781d4 00007f4a834b6304 00007f4a834b6299 00007f4a7ce71571 00007f4a7cf0c2fa 00007f4a81ecdb17 00007f4a7b4486d4 00007f4a7b448662 00007f4a7b448591 00007f4a7b44850c 00007f4a7b4477c2 00007f4a7b24348c 00007f4a7b2428c6 00007f4a7b24226f
0709 13:05:45.282015 (+   155us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4972056832}
I20260709 13:05:45.283771 19484 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39478 (request call id 435) took 2645 ms. Trace:
I20260709 13:05:45.303556 19478 rpcz_store.cc:276] 0709 13:05:43.930035 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:45.284345 (+1354310us) service_pool.cc:224] Handling call
0709 13:05:45.284864 (+   519us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:45.285237 (+   373us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:05:45.285261 (+    24us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:05:45.285315 (+    54us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:05:45.285368 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:45.285437 (+    69us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:45.285527 (+    90us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:05:45.305660 22928 raft_consensus.cc:3060] T 85c494af21f9457a85da47b9bc70c1fd P 127766fc592545a4997f7790f50f6076 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:05:45.308391 22907 leader_election.cc:290] T 46c5bfeecc314717bffe987e6844b6d0 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:05:45.308911 22758 raft_consensus.cc:493] T 14935b3ddf914369822e4a0547aaa355 P e61c3a8f61bb48f8a963c9480e53c168 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:45.309731 22758 raft_consensus.cc:515] T 14935b3ddf914369822e4a0547aaa355 P e61c3a8f61bb48f8a963c9480e53c168 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } attrs { replace: true } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:05:45.310845 22921 raft_consensus.cc:515] T 62c6c134d3d24a1ab144dd9ee6bc3f64 P 127766fc592545a4997f7790f50f6076 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:05:45.311412 19485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed7fdbcb96d14d418db9ca90a792588a" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:05:45.312373 19485 raft_consensus.cc:2393] T ed7fdbcb96d14d418db9ca90a792588a P 0473d2b2d01f4459b1e90fd12cc7840e [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e61c3a8f61bb48f8a963c9480e53c168 in current term 6: Already voted for candidate 0473d2b2d01f4459b1e90fd12cc7840e in this term.
I20260709 13:05:45.313354 22921 leader_election.cc:290] T 62c6c134d3d24a1ab144dd9ee6bc3f64 P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:05:45.306206 19484 rpcz_store.cc:276] 0709 13:05:42.643501 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:44.768039 (+2124538us) service_pool.cc:224] Handling call
0709 13:05:45.278430 (+510391us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:45.283265 (+  4835us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:05:45.283317 (+    52us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:05:45.283398 (+    81us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:05:45.283453 (+    55us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:45.283545 (+    92us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:45.283679 (+   134us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:05:45.315231 19484 raft_consensus.cc:1240] T 6c5eebf646ad445a9d1b1adc319d7b16 P 0473d2b2d01f4459b1e90fd12cc7840e [term 7 FOLLOWER]: Rejecting Update request from peer e61c3a8f61bb48f8a963c9480e53c168 for earlier term 6. Current term is 7. Ops: []
I20260709 13:05:45.316040 19484 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58286 (request call id 1742) took 1211 ms. Trace:
I20260709 13:05:45.316476 19484 rpcz_store.cc:276] 0709 13:05:44.105185 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:45.314385 (+1209200us) service_pool.cc:224] Handling call
0709 13:05:45.314893 (+   508us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:45.315721 (+   828us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:45.315969 (+   248us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:05:44.762127 19480 rpcz_store.cc:276] 0709 13:05:42.505821 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:44.637864 (+2132043us) service_pool.cc:224] Handling call
0709 13:05:44.638148 (+   284us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:44.638337 (+   189us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:05:44.647299 (+  8962us) log.cc:844] Serialized 14 byte log entry
0709 13:05:44.759795 (+112496us) log.cc:844] Serialized 14 byte log entry
0709 13:05:44.760367 (+   572us) log.cc:844] Serialized 14 byte log entry
0709 13:05:44.760541 (+   174us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:05:44.760609 (+    68us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:05:44.760773 (+   164us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:44.760945 (+   172us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:44.761257 (+   312us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":11758,"prepare.queue_time_us":245008,"prepare.run_cpu_time_us":137,"prepare.run_wall_time_us":140,"raft.queue_time_us":336224,"raft.run_cpu_time_us":645,"raft.run_wall_time_us":19542,"spinlock_wait_cycles":31356288,"thread_start_us":110911,"threads_started":1,"wal-append.queue_time_us":64476}
W20260709 13:05:45.303791 19477 rpcz_store.cc:269] 0709 13:05:42.503953 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:42.507081 (+  3128us) service_pool.cc:224] Handling call
0709 13:05:45.283185 (+2776104us) spinlock_profiling.cc:243] Waited 390 ms on lock 0x7b5400224f54. stack: 00007f4a79de9343 00007f4a79de9240 00007f4a797781d4 00007f4a834b6304 00007f4a834b6299 00007f4a7ce71571 00007f4a7cf0c2fa 00007f4a81ecdb17 00007f4a7b4486d4 00007f4a7b448662 00007f4a7b448591 00007f4a7b44850c 00007f4a7b4477c2 00007f4a7b24348c 00007f4a7b2428c6 00007f4a7b24226f
0709 13:05:45.283546 (+   361us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":897564032}
I20260709 13:05:44.810348 19553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14935b3ddf914369822e4a0547aaa355" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:05:45.313396 19485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e381f1d6b8184797ad142de49be225a8" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:05:45.320246 19553 raft_consensus.cc:2468] T 14935b3ddf914369822e4a0547aaa355 P e61c3a8f61bb48f8a963c9480e53c168 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 7.
I20260709 13:05:45.325703 19477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff75a1d4cb1f493db8f71ddc136ba9ab" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:05:45.326653 19477 raft_consensus.cc:2468] T ff75a1d4cb1f493db8f71ddc136ba9ab P 0473d2b2d01f4459b1e90fd12cc7840e [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 8.
I20260709 13:05:45.051196 22693 consensus_queue.cc:1048] T 5ec1c4ce15e04c7e8c283a62179f2a64 P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Connected to new peer: Peer: permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.276s
I20260709 13:05:45.328722 19477 raft_consensus.cc:1275] T d1e5873a19244c5ebbcd38e126796ee7 P 0473d2b2d01f4459b1e90fd12cc7840e [term 11 FOLLOWER]: Refusing update from remote peer e61c3a8f61bb48f8a963c9480e53c168: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 13:05:45.329089 22693 raft_consensus.cc:2804] T 14efcc79969f41babe5529c22d59156d P e5256d91808b47c195bc9b4dbd7f2b87 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:05:45.329150 22830 raft_consensus.cc:3060] T 3e1f505cb0f1427bbd698ac889d80821 P e5256d91808b47c195bc9b4dbd7f2b87 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:05:45.329627 22693 raft_consensus.cc:493] T 14efcc79969f41babe5529c22d59156d P e5256d91808b47c195bc9b4dbd7f2b87 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 0473d2b2d01f4459b1e90fd12cc7840e)
I20260709 13:05:45.330204 22693 raft_consensus.cc:3060] T 14efcc79969f41babe5529c22d59156d P e5256d91808b47c195bc9b4dbd7f2b87 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:05:45.330881 19485 raft_consensus.cc:2393] T e381f1d6b8184797ad142de49be225a8 P 0473d2b2d01f4459b1e90fd12cc7840e [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e61c3a8f61bb48f8a963c9480e53c168 in current term 7: Already voted for candidate 0473d2b2d01f4459b1e90fd12cc7840e in this term.
I20260709 13:05:44.768244 20104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff9b0eddd810459b82d91c60777c10eb" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:05:45.320330 19484 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58286 (request call id 1743) took 1207 ms. Trace:
I20260709 13:05:45.332293 19484 rpcz_store.cc:276] 0709 13:05:44.113226 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:45.317470 (+1204244us) service_pool.cc:224] Handling call
0709 13:05:45.318011 (+   541us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:45.318439 (+   428us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:05:45.318472 (+    33us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:05:45.318542 (+    70us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:05:45.318628 (+    86us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:45.320187 (+  1559us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:45.320283 (+    96us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:05:45.342367 19478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa8650e71aa14778b3d73721fc50d9fc" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
W20260709 13:05:45.349682 19451 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:45.344430 20104 raft_consensus.cc:2468] T ff9b0eddd810459b82d91c60777c10eb P 127766fc592545a4997f7790f50f6076 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 7.
I20260709 13:05:45.351764 19553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86a6797bdfe94fa496c050ceae4bd0d9" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 9 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:05:45.354331 19483 raft_consensus.cc:1240] T 21e14947d70440f19044d8f75c31e1f9 P 0473d2b2d01f4459b1e90fd12cc7840e [term 8 FOLLOWER]: Rejecting Update request from peer e5256d91808b47c195bc9b4dbd7f2b87 for earlier term 7. Current term is 8. Ops: []
I20260709 13:05:45.350883 19484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a61655d99124a29b486ba4a5b37faea" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
W20260709 13:05:45.363381 20076 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.17.223.3:36891 timed out after 2.233s (SENT) [suppressed 10 similar messages]
I20260709 13:05:45.366813 22898 leader_election.cc:290] T ab43d85f64114d4ebf618930e43d9ed0 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:05:45.356313 22722 raft_consensus.cc:493] T 5ec1c4ce15e04c7e8c283a62179f2a64 P 0473d2b2d01f4459b1e90fd12cc7840e [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:45.373442 22722 raft_consensus.cc:3060] T 5ec1c4ce15e04c7e8c283a62179f2a64 P 0473d2b2d01f4459b1e90fd12cc7840e [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:05:45.375422 19553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2725d2c4cb054f18b0fc8f735c15f6c2" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:05:45.376317 19553 raft_consensus.cc:2468] T 2725d2c4cb054f18b0fc8f735c15f6c2 P e61c3a8f61bb48f8a963c9480e53c168 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 9.
I20260709 13:05:45.377238 19553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a08760e15aac4630a629431f56024dc8" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:05:45.378041 19553 raft_consensus.cc:2393] T a08760e15aac4630a629431f56024dc8 P e61c3a8f61bb48f8a963c9480e53c168 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0473d2b2d01f4459b1e90fd12cc7840e in current term 10: Already voted for candidate e61c3a8f61bb48f8a963c9480e53c168 in this term.
I20260709 13:05:45.382544 19552 raft_consensus.cc:1240] T ef32ce6fdd0e40d382c79974f30295c6 P e61c3a8f61bb48f8a963c9480e53c168 [term 10 FOLLOWER]: Rejecting Update request from peer e5256d91808b47c195bc9b4dbd7f2b87 for earlier term 9. Current term is 10. Ops: []
I20260709 13:05:45.384097 19556 raft_consensus.cc:1275] T 40e1e16737a842ee936002830f36882e P e61c3a8f61bb48f8a963c9480e53c168 [term 11 FOLLOWER]: Refusing update from remote peer e5256d91808b47c195bc9b4dbd7f2b87: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 6. (term mismatch)
I20260709 13:05:45.384508 19556 pending_rounds.cc:85] T 40e1e16737a842ee936002830f36882e P e61c3a8f61bb48f8a963c9480e53c168: Aborting all ops after (but not including) 5
I20260709 13:05:45.391214 19485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f93ee515a9c14139bf566522ed8232f3" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 12 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:05:45.388343 19556 pending_rounds.cc:107] T 40e1e16737a842ee936002830f36882e P e61c3a8f61bb48f8a963c9480e53c168: Aborting uncommitted NO_OP operation due to leader change: 10.6
I20260709 13:05:45.402164 19556 raft_consensus.cc:2889] T 40e1e16737a842ee936002830f36882e P e61c3a8f61bb48f8a963c9480e53c168 [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:05:45.406857 19484 raft_consensus.cc:2468] T 1a61655d99124a29b486ba4a5b37faea P 0473d2b2d01f4459b1e90fd12cc7840e [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 6.
I20260709 13:05:45.414065 19555 raft_consensus.cc:1240] T 0afb57ae58a24a01850491d69f0213dd P e61c3a8f61bb48f8a963c9480e53c168 [term 9 FOLLOWER]: Rejecting Update request from peer 0473d2b2d01f4459b1e90fd12cc7840e for earlier term 8. Current term is 9. Ops: [8.8-8.8]
I20260709 13:05:45.412714 22757 raft_consensus.cc:493] T 65d8cb8d6ec64f459d5a47cefab10acf P e5256d91808b47c195bc9b4dbd7f2b87 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:45.415320 22847 leader_election.cc:290] T 833a2f0775ed407a94b8924ce50adb63 P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:05:45.414907 19478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22196caba61445d3bec98a0aab3c337d" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:05:45.416961 19485 raft_consensus.cc:3060] T f93ee515a9c14139bf566522ed8232f3 P 0473d2b2d01f4459b1e90fd12cc7840e [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:05:45.415337 19559 raft_consensus.cc:1240] T 70797e5783b5454ab0d0eea663e791e3 P e61c3a8f61bb48f8a963c9480e53c168 [term 9 FOLLOWER]: Rejecting Update request from peer e5256d91808b47c195bc9b4dbd7f2b87 for earlier term 8. Current term is 9. Ops: []
I20260709 13:05:45.415904 22757 raft_consensus.cc:515] T 65d8cb8d6ec64f459d5a47cefab10acf P e5256d91808b47c195bc9b4dbd7f2b87 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:05:45.420184 19478 raft_consensus.cc:2393] T 22196caba61445d3bec98a0aab3c337d P 0473d2b2d01f4459b1e90fd12cc7840e [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e61c3a8f61bb48f8a963c9480e53c168 in current term 8: Already voted for candidate e5256d91808b47c195bc9b4dbd7f2b87 in this term.
I20260709 13:05:45.416612 19552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab43d85f64114d4ebf618930e43d9ed0" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 8 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:05:45.408954 22706 leader_election.cc:290] T 9962423cb4e54fcfa5de01daf68a86e7 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:05:45.423404 19405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70797e5783b5454ab0d0eea663e791e3" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:05:45.428576 22757 leader_election.cc:290] T 65d8cb8d6ec64f459d5a47cefab10acf P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:05:45.429961 22658 leader_election.cc:290] T edd7d470b5014c9489be7f41f64355c9 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:05:45.438633 19409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65d8cb8d6ec64f459d5a47cefab10acf" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:05:45.439409 19409 raft_consensus.cc:2468] T 65d8cb8d6ec64f459d5a47cefab10acf P e5256d91808b47c195bc9b4dbd7f2b87 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 127766fc592545a4997f7790f50f6076 in term 5.
W20260709 13:05:45.440014 22825 log.cc:927] Time spent T 0e1085d23e8347fbbd5bce7542f4b1f4 P e61c3a8f61bb48f8a963c9480e53c168: Append to log took a long time: real 3.812s	user 0.028s	sys 0.043s
I20260709 13:05:45.442895 19552 raft_consensus.cc:2393] T ab43d85f64114d4ebf618930e43d9ed0 P e61c3a8f61bb48f8a963c9480e53c168 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0473d2b2d01f4459b1e90fd12cc7840e in current term 8: Already voted for candidate 127766fc592545a4997f7790f50f6076 in this term.
I20260709 13:05:45.449275 19478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab43d85f64114d4ebf618930e43d9ed0" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 9 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:05:45.450121 19478 raft_consensus.cc:2468] T ab43d85f64114d4ebf618930e43d9ed0 P 0473d2b2d01f4459b1e90fd12cc7840e [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 8.
W20260709 13:05:45.450443 22868 log.cc:927] Time spent T df751f992649444090e27965eb1af85d P e5256d91808b47c195bc9b4dbd7f2b87: Append to log took a long time: real 2.351s	user 0.016s	sys 0.023s
I20260709 13:05:45.454739 19483 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58294 (request call id 1950) took 1525 ms. Trace:
I20260709 13:05:45.455180 19483 rpcz_store.cc:276] 0709 13:05:43.928896 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:45.275806 (+1346910us) service_pool.cc:224] Handling call
0709 13:05:45.338370 (+ 62564us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:45.354774 (+ 16404us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:45.454456 (+ 99682us) spinlock_profiling.cc:243] Waited 1.15 ms on lock 0x7b540035d9d4. stack: 00007f4a79de9343 00007f4a79de9240 00007f4a797781d4 00007f4a834b6304 00007f4a834b6299 00007f4a7ce71571 00007f4a7cf08e01 00007f4a7cf0783e 00007f4a81ecc419 00007f4a7b443bd4 00007f4a7b443b62 00007f4a7b443a91 00007f4a7b443a0c 00007f4a7b442cc2 00007f4a7b24348c 00007f4a7b2428c6
0709 13:05:45.454641 (+   185us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2687872}
I20260709 13:05:45.459965 22875 leader_election.cc:290] T 1a61655d99124a29b486ba4a5b37faea P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:05:45.467374 19409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff9b0eddd810459b82d91c60777c10eb" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:05:45.467734 19479 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58294 (request call id 1948) took 1539 ms. Trace:
I20260709 13:05:45.468317 19409 raft_consensus.cc:2468] T ff9b0eddd810459b82d91c60777c10eb P e5256d91808b47c195bc9b4dbd7f2b87 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 127766fc592545a4997f7790f50f6076 in term 7.
W20260709 13:05:45.473615 20078 connection.cc:256] RPC call timeout handler was delayed by -2.3889922500000011s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17490000000000003s for a response
W20260709 13:05:45.474107 20078 connection.cc:256] RPC call timeout handler was delayed by -1.8727237560000276s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1688s for a response
W20260709 13:05:45.474411 20078 connection.cc:256] RPC call timeout handler was delayed by -1.6464036680000618s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2077s for a response
I20260709 13:05:45.470418 19479 rpcz_store.cc:276] 0709 13:05:43.928263 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:44.797194 (+868931us) service_pool.cc:224] Handling call
0709 13:05:45.466629 (+669435us) spinlock_profiling.cc:243] Waited 1.23 ms on lock 0x7b58001b9998. stack: 00007f4a79de9343 00007f4a79de9240 00007f4a797781d4 00007f4a834b6304 00007f4a834b6299 00007f4a79ca3db1 00007f4a79de3b71 00007f4a79de3a22 00007f4a82cfcc09 00007f4a81e56ee0 00007f4a81f200ab 00007f4a81f20131 00007f4a81ee1fc0 00007f4a81ecc929 00007f4a81ecc3d2 00007f4a7b443bd4
0709 13:05:45.466896 (+   267us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:45.467210 (+   314us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:05:45.467235 (+    25us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:05:45.467308 (+    73us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:05:45.467354 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:45.467413 (+    59us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:45.467543 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2837376}
W20260709 13:05:45.478804 20078 connection.cc:256] RPC call timeout handler was delayed by -1.385653972s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.24260000000000004s for a response
W20260709 13:05:45.479216 20078 connection.cc:256] RPC call timeout handler was delayed by -1.3741111850000607s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19410000000000002s for a response
W20260709 13:05:45.479398 20078 connection.cc:256] RPC call timeout handler was delayed by -1.3724885940000604s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21760000000000002s for a response
W20260709 13:05:45.479552 20078 connection.cc:256] RPC call timeout handler was delayed by -1.0580736840000782s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.3252s for a response
W20260709 13:05:45.479701 20078 connection.cc:256] RPC call timeout handler was delayed by -1.0235532860000376s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.33580000000000004s for a response
W20260709 13:05:45.479851 20078 connection.cc:256] RPC call timeout handler was delayed by -1.0038164459999734s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.22799999999999998s for a response
I20260709 13:05:45.493762 19409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ece3db938bc649d4a40a51522ed5259c" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:05:45.496977 19410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e5873a19244c5ebbcd38e126796ee7" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
W20260709 13:05:45.497565 19450 connection.cc:256] RPC call timeout handler was delayed by -1.065416177999964s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.22250000000000003s for a response
W20260709 13:05:45.497989 19410 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52328 (request call id 1720) took 2846 ms (client timeout 1759 ms). Trace:
I20260709 13:05:45.500211 19407 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52328 (request call id 1705) took 3890 ms. Trace:
I20260709 13:05:45.500540 22928 raft_consensus.cc:515] T 85c494af21f9457a85da47b9bc70c1fd P 127766fc592545a4997f7790f50f6076 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
W20260709 13:05:45.503490 19377 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:45.503697 19479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86a6797bdfe94fa496c050ceae4bd0d9" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 9 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:05:45.506764 22928 leader_election.cc:290] T 85c494af21f9457a85da47b9bc70c1fd P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 6 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
W20260709 13:05:45.507364 19523 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:45.508695 19483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14efcc79969f41babe5529c22d59156d" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:05:45.510059 19478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "775c229504194560ba9589bc2199b089" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:05:45.510749 19478 raft_consensus.cc:2468] T 775c229504194560ba9589bc2199b089 P 0473d2b2d01f4459b1e90fd12cc7840e [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 6.
I20260709 13:05:45.511240 19483 raft_consensus.cc:1240] T d1e5873a19244c5ebbcd38e126796ee7 P 0473d2b2d01f4459b1e90fd12cc7840e [term 11 FOLLOWER]: Rejecting Update request from peer e5256d91808b47c195bc9b4dbd7f2b87 for earlier term 10. Current term is 11. Ops: []
I20260709 13:05:45.511274 20112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4af19371ea874c09a0a2147040835cbb" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:05:45.511557 19478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22196caba61445d3bec98a0aab3c337d" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:05:45.512166 19478 raft_consensus.cc:2376] T 22196caba61445d3bec98a0aab3c337d P 0473d2b2d01f4459b1e90fd12cc7840e [term 8 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 8. Re-sending same reply.
I20260709 13:05:45.512460 22624 raft_consensus.cc:515] T 28af091831594f9d8e96482078cc7625 P e61c3a8f61bb48f8a963c9480e53c168 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:45.513072 19477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e381f1d6b8184797ad142de49be225a8" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:05:45.513792 19477 raft_consensus.cc:2368] T e381f1d6b8184797ad142de49be225a8 P 0473d2b2d01f4459b1e90fd12cc7840e [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e5256d91808b47c195bc9b4dbd7f2b87 for earlier term 6. Current term is 7.
I20260709 13:05:45.514685 20104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0afb57ae58a24a01850491d69f0213dd" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076"
I20260709 13:05:45.515116 22624 leader_election.cc:290] T 28af091831594f9d8e96482078cc7625 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 9 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:05:45.515445 20104 raft_consensus.cc:3060] T 0afb57ae58a24a01850491d69f0213dd P 127766fc592545a4997f7790f50f6076 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:05:45.519037 19479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f85fc4b527a48848e5faa083b604e36" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:05:45.522919 19560 raft_consensus.cc:1240] T 28af091831594f9d8e96482078cc7625 P e61c3a8f61bb48f8a963c9480e53c168 [term 9 FOLLOWER]: Rejecting Update request from peer e5256d91808b47c195bc9b4dbd7f2b87 for earlier term 8. Current term is 9. Ops: []
W20260709 13:05:45.523425 22945 log.cc:927] Time spent T 7f575b143b844aa096b50997dad3516a P 0473d2b2d01f4459b1e90fd12cc7840e: Append to log took a long time: real 0.081s	user 0.000s	sys 0.000s
I20260709 13:05:45.524763 19485 raft_consensus.cc:2468] T f93ee515a9c14139bf566522ed8232f3 P 0473d2b2d01f4459b1e90fd12cc7840e [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 12.
W20260709 13:05:45.498446 19410 rpcz_store.cc:269] 0709 13:05:42.651483 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:42.733662 (+ 82179us) service_pool.cc:224] Handling call
0709 13:05:45.496685 (+2763023us) spinlock_profiling.cc:243] Waited 1.32 ms on lock 0x7b5800183c98. stack: 00007f4a79de9343 00007f4a79de9240 00007f4a797781d4 00007f4a834b6304 00007f4a834b6299 00007f4a79ca3db1 00007f4a79de3b71 00007f4a79de3eee 0000000000375939 00007f4a81e571e0 00007f4a81f200c4 00007f4a81f20131 00007f4a81ece0a0 00007f4a81ecd984 00007f4a7b4486d4 00007f4a7b448662
0709 13:05:45.497902 (+  1217us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3047552}
I20260709 13:05:45.527338 20104 raft_consensus.cc:2410] T 0afb57ae58a24a01850491d69f0213dd P 127766fc592545a4997f7790f50f6076 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate e61c3a8f61bb48f8a963c9480e53c168 for term 9 because replica has last-logged OpId of term: 8 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 7.
I20260709 13:05:45.528927 22888 leader_election.cc:290] T 21e14947d70440f19044d8f75c31e1f9 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 8 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:05:45.530138 19409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "833a2f0775ed407a94b8924ce50adb63" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:05:45.538304 19526 leader_election.cc:304] T ff75a1d4cb1f493db8f71ddc136ba9ab P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:05:45.539501 22946 raft_consensus.cc:2804] T ff75a1d4cb1f493db8f71ddc136ba9ab P e61c3a8f61bb48f8a963c9480e53c168 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:05:45.539958 22946 raft_consensus.cc:493] T ff75a1d4cb1f493db8f71ddc136ba9ab P e61c3a8f61bb48f8a963c9480e53c168 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:45.539784 22898 consensus_queue.cc:1048] T d1e5873a19244c5ebbcd38e126796ee7 P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:05:45.540380 22946 raft_consensus.cc:3060] T ff75a1d4cb1f493db8f71ddc136ba9ab P e61c3a8f61bb48f8a963c9480e53c168 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:05:45.541745 22873 leader_election.cc:290] T 22196caba61445d3bec98a0aab3c337d P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:05:45.545426 19408 raft_consensus.cc:2468] T 3e1f505cb0f1427bbd698ac889d80821 P e5256d91808b47c195bc9b4dbd7f2b87 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 9.
I20260709 13:05:45.546023 22850 raft_consensus.cc:493] T 3e1f505cb0f1427bbd698ac889d80821 P e5256d91808b47c195bc9b4dbd7f2b87 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:45.546499 22850 raft_consensus.cc:515] T 3e1f505cb0f1427bbd698ac889d80821 P e5256d91808b47c195bc9b4dbd7f2b87 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:45.547025 19554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edd7d470b5014c9489be7f41f64355c9" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:05:45.547770 19554 raft_consensus.cc:2468] T edd7d470b5014c9489be7f41f64355c9 P e61c3a8f61bb48f8a963c9480e53c168 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 8.
I20260709 13:05:45.547619 22693 raft_consensus.cc:515] T 14efcc79969f41babe5529c22d59156d P e5256d91808b47c195bc9b4dbd7f2b87 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:05:45.549422 22850 leader_election.cc:290] T 3e1f505cb0f1427bbd698ac889d80821 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:05:45.549767 22693 leader_election.cc:290] T 14efcc79969f41babe5529c22d59156d P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 10 election: Requested vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:05:45.554329 22848 raft_consensus.cc:3055] T 2e36a9d6e29c4a7c860cf267efbd4c74 P e5256d91808b47c195bc9b4dbd7f2b87 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:05:45.554786 22848 raft_consensus.cc:740] T 2e36a9d6e29c4a7c860cf267efbd4c74 P e5256d91808b47c195bc9b4dbd7f2b87 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: e5256d91808b47c195bc9b4dbd7f2b87, State: Running, Role: LEADER
I20260709 13:05:45.555958 20078 leader_election.cc:304] T 0e1085d23e8347fbbd5bce7542f4b1f4 P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 127766fc592545a4997f7790f50f6076; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:05:45.556130 22848 consensus_queue.cc:260] T 2e36a9d6e29c4a7c860cf267efbd4c74 P e5256d91808b47c195bc9b4dbd7f2b87 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:45.557126 22727 raft_consensus.cc:2749] T 0e1085d23e8347fbbd5bce7542f4b1f4 P 127766fc592545a4997f7790f50f6076 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:05:45.557922 20078 leader_election.cc:304] T 1efebf73c86e432baa55533136b6e12c P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 127766fc592545a4997f7790f50f6076; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:05:45.558893 22727 raft_consensus.cc:2749] T 1efebf73c86e432baa55533136b6e12c P 127766fc592545a4997f7790f50f6076 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
W20260709 13:05:45.559362 19403 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52328 (request call id 1708) took 3940 ms (client timeout 2220 ms). Trace:
W20260709 13:05:45.559814 19403 rpcz_store.cc:269] 0709 13:05:41.618545 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:41.618651 (+   106us) service_pool.cc:224] Handling call
0709 13:05:45.558956 (+3940305us) spinlock_profiling.cc:243] Waited 113 ms on lock 0x7b54002ee854. stack: 00007f4a79de9343 00007f4a79de9240 00007f4a797781d4 00007f4a834b6304 00007f4a834b6299 00007f4a7ce71571 00007f4a7cf0c2fa 00007f4a81ecdb17 00007f4a7b4486d4 00007f4a7b448662 00007f4a7b448591 00007f4a7b44850c 00007f4a7b4477c2 00007f4a7b24348c 00007f4a7b2428c6 00007f4a7b24226f
0709 13:05:45.559164 (+   208us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":260846336}
I20260709 13:05:45.526271 22722 raft_consensus.cc:515] T 5ec1c4ce15e04c7e8c283a62179f2a64 P 0473d2b2d01f4459b1e90fd12cc7840e [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:05:45.561426 19481 raft_consensus.cc:1240] T 5ec1c4ce15e04c7e8c283a62179f2a64 P 0473d2b2d01f4459b1e90fd12cc7840e [term 8 FOLLOWER]: Rejecting Update request from peer e5256d91808b47c195bc9b4dbd7f2b87 for earlier term 7. Current term is 8. Ops: []
I20260709 13:05:45.561514 19374 leader_election.cc:304] T ff9b0eddd810459b82d91c60777c10eb P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 127766fc592545a4997f7790f50f6076, e5256d91808b47c195bc9b4dbd7f2b87; no voters: 
I20260709 13:05:45.566783 19486 raft_consensus.cc:1275] T 40e1e16737a842ee936002830f36882e P 0473d2b2d01f4459b1e90fd12cc7840e [term 11 FOLLOWER]: Refusing update from remote peer e5256d91808b47c195bc9b4dbd7f2b87: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 13:05:45.567088 19410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85c494af21f9457a85da47b9bc70c1fd" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
I20260709 13:05:45.567384 19486 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58294 (request call id 1949) took 1638 ms. Trace:
I20260709 13:05:45.567793 19410 raft_consensus.cc:3060] T 85c494af21f9457a85da47b9bc70c1fd P e5256d91808b47c195bc9b4dbd7f2b87 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:05:45.568008 22722 leader_election.cc:290] T 5ec1c4ce15e04c7e8c283a62179f2a64 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 8 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:05:45.567795 19486 rpcz_store.cc:276] 0709 13:05:43.928612 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:44.799918 (+871306us) service_pool.cc:224] Handling call
0709 13:05:45.566008 (+766090us) spinlock_profiling.cc:243] Waited 1.11 ms on lock 0x7b58001b9998. stack: 00007f4a79de9343 00007f4a79de9240 00007f4a797781d4 00007f4a834b6304 00007f4a834b6299 00007f4a79ca3db1 00007f4a79de3b71 00007f4a79de3a22 00007f4a82cfcc09 00007f4a81e56ee0 00007f4a81f200ab 00007f4a81f20131 00007f4a81ee1fc0 00007f4a81ecc929 00007f4a81ecc3d2 00007f4a7b443bd4
0709 13:05:45.566242 (+   234us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:45.567143 (+   901us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:45.567338 (+   195us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2562432}
I20260709 13:05:45.573251 22869 raft_consensus.cc:493] T 172b3dd13109415a955b71ac0e9d2234 P e5256d91808b47c195bc9b4dbd7f2b87 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:45.573907 22869 raft_consensus.cc:515] T 172b3dd13109415a955b71ac0e9d2234 P e5256d91808b47c195bc9b4dbd7f2b87 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:05:45.575928 19479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2725d2c4cb054f18b0fc8f735c15f6c2" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:05:45.576208 22869 leader_election.cc:290] T 172b3dd13109415a955b71ac0e9d2234 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:05:45.576691 19479 raft_consensus.cc:2468] T 2725d2c4cb054f18b0fc8f735c15f6c2 P 0473d2b2d01f4459b1e90fd12cc7840e [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 9.
I20260709 13:05:45.579005 19560 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40438 (request call id 2049) took 1002 ms. Trace:
I20260709 13:05:45.579422 20112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed7fdbcb96d14d418db9ca90a792588a" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:05:45.579375 19560 rpcz_store.cc:276] 0709 13:05:44.576771 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:45.297336 (+720565us) service_pool.cc:224] Handling call
0709 13:05:45.297670 (+   334us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:45.523361 (+225691us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:45.578800 (+ 55439us) spinlock_profiling.cc:243] Waited 225 ms on lock 0x7b540030acd4. stack: 00007f4a79de9343 00007f4a79de9240 00007f4a797781d4 00007f4a834b6304 00007f4a834b6299 00007f4a7ce71571 00007f4a7cf08e01 00007f4a7cf0783e 00007f4a81ecc419 00007f4a7b443bd4 00007f4a7b443b62 00007f4a7b443a91 00007f4a7b443a0c 00007f4a7b442cc2 00007f4a7b24348c 00007f4a7b2428c6
0709 13:05:45.578953 (+   153us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":517490944}
I20260709 13:05:45.580387 20112 raft_consensus.cc:2393] T ed7fdbcb96d14d418db9ca90a792588a P 127766fc592545a4997f7790f50f6076 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e61c3a8f61bb48f8a963c9480e53c168 in current term 6: Already voted for candidate 127766fc592545a4997f7790f50f6076 in this term.
I20260709 13:05:45.580473 20109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ece3db938bc649d4a40a51522ed5259c" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:05:45.578939 20104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70797e5783b5454ab0d0eea663e791e3" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076"
I20260709 13:05:45.582865 20109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab43d85f64114d4ebf618930e43d9ed0" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 9 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:05:45.584992 19482 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58294 (request call id 1953) took 1655 ms. Trace:
I20260709 13:05:45.585047 19553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96efeaaf1057492490e9a621f37e1a2d" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 9 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:05:45.585376 19482 rpcz_store.cc:276] 0709 13:05:43.929756 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:45.330768 (+1401012us) service_pool.cc:224] Handling call
0709 13:05:45.331287 (+   519us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:05:45.340636 (+  9349us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:05:45.340678 (+    42us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:05:45.369636 (+ 28958us) log.cc:844] Serialized 26 byte log entry
0709 13:05:45.441306 (+ 71670us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:05:45.441330 (+    24us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:45.441374 (+    44us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:05:45.584772 (+143398us) raft_consensus.cc:1685] finished
0709 13:05:45.584790 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:45.584936 (+   146us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":4611,"raft.run_cpu_time_us":170,"raft.run_wall_time_us":9525,"thread_start_us":32387,"threads_started":1,"wal-append.queue_time_us":138313}
I20260709 13:05:45.591400 19553 raft_consensus.cc:2410] T 96efeaaf1057492490e9a621f37e1a2d P e61c3a8f61bb48f8a963c9480e53c168 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0473d2b2d01f4459b1e90fd12cc7840e for term 9 because replica has last-logged OpId of term: 6 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260709 13:05:45.553984 22882 raft_consensus.cc:515] T df751f992649444090e27965eb1af85d P 0473d2b2d01f4459b1e90fd12cc7840e [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
W20260709 13:05:45.582535 19523 connection.cc:256] RPC call timeout handler was delayed by -2.9385239060000004s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16690000000000002s for a response
I20260709 13:05:45.500713 19407 rpcz_store.cc:276] 0709 13:05:41.609450 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:41.611070 (+  1620us) service_pool.cc:224] Handling call
0709 13:05:41.611376 (+   306us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:05:41.929218 (+317842us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 13:05:43.767709 (+1838491us) spinlock_profiling.cc:243] Waited 12.8 ms on lock 0x7b1800364f60. stack: 00007f4a79de9343 00007f4a79de9240 00007f4a797781d4 00007f4a834b6304 00007f4a834b6299 00007f4a82ce3de1 00007f4a82cf05b1 00007f4a79dfde07 00007f4a82c58ab9 00007f4a79e1a69b 00007f4a79e1893f 00007f4a79e18455 00007f4a809003c7 00007f4a7cf129a7 00007f4a7cf220bf 00007f4a7cf22038
0709 13:05:43.908568 (+140859us) log.cc:844] Serialized 14 byte log entry
0709 13:05:44.288846 (+380278us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:05:44.312909 (+ 24063us) log.cc:844] Serialized 26 byte log entry
0709 13:05:44.314173 (+  1264us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:05:44.314509 (+   336us) log.cc:844] Serialized 14 byte log entry
0709 13:05:44.325988 (+ 11479us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:45.499608 (+1173620us) spinlock_profiling.cc:243] Waited 212 ms on lock 0x7b540023a354. stack: 00007f4a79de9343 00007f4a79de9240 00007f4a797781d4 00007f4a834b6304 00007f4a834b6299 00007f4a7ce71571 00007f4a7cf08e01 00007f4a7cf0783e 00007f4a81ecc419 00007f4a7b443bd4 00007f4a7b443b62 00007f4a7b443a91 00007f4a7b443a0c 00007f4a7b442cc2 00007f4a7b24348c 00007f4a7b2428c6
0709 13:05:45.499692 (+    84us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:05:45.499766 (+    74us) raft_consensus.cc:1685] finished
0709 13:05:45.499784 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:45.500002 (+   218us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":12009,"prepare.queue_time_us":149774,"prepare.run_cpu_time_us":62,"prepare.run_wall_time_us":65,"raft.queue_time_us":214991,"raft.run_cpu_time_us":356,"raft.run_wall_time_us":35692,"spinlock_wait_cycles":517768448,"thread_start_us":573136,"threads_started":4,"wal-append.queue_time_us":217009,"wal-append.run_cpu_time_us":3051,"wal-append.run_wall_time_us":1181879}
I20260709 13:05:45.560020 20078 leader_election.cc:304] T 14935b3ddf914369822e4a0547aaa355 P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, 127766fc592545a4997f7790f50f6076, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:05:45.593394 19552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cdf56e38bbc453d9438d359e5a69955" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
W20260709 13:05:45.599184 19408 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52328 (request call id 1717) took 2948 ms (client timeout 1689 ms). Trace:
I20260709 13:05:45.602209 19410 raft_consensus.cc:2468] T 85c494af21f9457a85da47b9bc70c1fd P e5256d91808b47c195bc9b4dbd7f2b87 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 127766fc592545a4997f7790f50f6076 in term 6.
I20260709 13:05:45.595785 19555 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40428 (request call id 2179) took 2734 ms. Trace:
I20260709 13:05:45.584609 22777 raft_consensus.cc:493] T fa731b585f684a7fb2d106c50f143b83 P e61c3a8f61bb48f8a963c9480e53c168 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader e5256d91808b47c195bc9b4dbd7f2b87)
I20260709 13:05:45.596626 22842 leader_election.cc:290] T bc225c93219c45538b53a1bd3d387e4d P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:05:45.595332 22830 raft_consensus.cc:493] T ff75a1d4cb1f493db8f71ddc136ba9ab P e5256d91808b47c195bc9b4dbd7f2b87 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:05:45.602291 19408 rpcz_store.cc:269] 0709 13:05:42.650785 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:42.716821 (+ 66036us) service_pool.cc:224] Handling call
0709 13:05:45.598965 (+2882144us) spinlock_profiling.cc:243] Waited 2.81 s on lock 0x7b5400060254. stack: 00007f4a79de9343 00007f4a79de9240 00007f4a797781d4 00007f4a834b6304 00007f4a834b6299 00007f4a7ce71571 00007f4a7cf0c2fa 00007f4a81ecdb17 00007f4a7b4486d4 00007f4a7b448662 00007f4a7b448591 00007f4a7b44850c 00007f4a7b4477c2 00007f4a7b24348c 00007f4a7b2428c6 00007f4a7b24226f
0709 13:05:45.599116 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":6452206464}
I20260709 13:05:45.603559 19555 rpcz_store.cc:276] 0709 13:05:42.861922 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:42.863721 (+  1799us) service_pool.cc:224] Handling call
0709 13:05:45.265627 (+2401906us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:05:45.420444 (+154817us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:45.595571 (+175127us) spinlock_profiling.cc:243] Waited 1.95 s on lock 0x7b5400124650. stack: 00007f4a79de9343 00007f4a79de9240 00007f4a797781d4 00007f4a834b6304 00007f4a834b6299 00007f4a7ce71571 00007f4a7cf078ad 00007f4a81ecc419 00007f4a7b443bd4 00007f4a7b443b62 00007f4a7b443a91 00007f4a7b443a0c 00007f4a7b442cc2 00007f4a7b24348c 00007f4a7b2428c6 00007f4a7b24226f
0709 13:05:45.595712 (+   141us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4476321536}
W20260709 13:05:45.605654 19374 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.4:43121, user_credentials={real_user=slave}} blocked reactor thread for 44234.4us
I20260709 13:05:45.609364 19481 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58294 (request call id 1952) took 1680 ms. Trace:
I20260709 13:05:45.609730 19481 rpcz_store.cc:276] 0709 13:05:43.929470 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:45.275412 (+1345942us) service_pool.cc:224] Handling call
0709 13:05:45.342059 (+ 66647us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:45.561802 (+219743us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:45.609149 (+ 47347us) spinlock_profiling.cc:243] Waited 219 ms on lock 0x7b5400111054. stack: 00007f4a79de9343 00007f4a79de9240 00007f4a797781d4 00007f4a834b6304 00007f4a834b6299 00007f4a7ce71571 00007f4a7cf08e01 00007f4a7cf0783e 00007f4a81ecc419 00007f4a7b443bd4 00007f4a7b443b62 00007f4a7b443a91 00007f4a7b443a0c 00007f4a7b442cc2 00007f4a7b24348c 00007f4a7b2428c6
0709 13:05:45.609310 (+   161us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":504079232}
I20260709 13:05:45.610845 22898 raft_consensus.cc:493] T 65d8cb8d6ec64f459d5a47cefab10acf P e61c3a8f61bb48f8a963c9480e53c168 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader e5256d91808b47c195bc9b4dbd7f2b87)
I20260709 13:05:45.611471 22898 raft_consensus.cc:515] T 65d8cb8d6ec64f459d5a47cefab10acf P e61c3a8f61bb48f8a963c9480e53c168 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:05:45.613587 22898 leader_election.cc:290] T 65d8cb8d6ec64f459d5a47cefab10acf P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:05:45.614710 22830 raft_consensus.cc:515] T ff75a1d4cb1f493db8f71ddc136ba9ab P e5256d91808b47c195bc9b4dbd7f2b87 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:45.616848 22830 leader_election.cc:290] T ff75a1d4cb1f493db8f71ddc136ba9ab P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:05:45.617789 19403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14935b3ddf914369822e4a0547aaa355" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:05:45.618568 19403 raft_consensus.cc:2468] T 14935b3ddf914369822e4a0547aaa355 P e5256d91808b47c195bc9b4dbd7f2b87 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 127766fc592545a4997f7790f50f6076 in term 6.
I20260709 13:05:45.605360 22777 raft_consensus.cc:515] T fa731b585f684a7fb2d106c50f143b83 P e61c3a8f61bb48f8a963c9480e53c168 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:05:45.621388 22777 leader_election.cc:290] T fa731b585f684a7fb2d106c50f143b83 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:05:45.622058 22758 leader_election.cc:290] T 14935b3ddf914369822e4a0547aaa355 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:05:45.623631 19554 raft_consensus.cc:1275] T f1b10566f45d4a7d9029858330e02d5b P e61c3a8f61bb48f8a963c9480e53c168 [term 10 FOLLOWER]: Refusing update from remote peer 0473d2b2d01f4459b1e90fd12cc7840e: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:05:45.624938 22859 raft_consensus.cc:493] T 7be9efa6559648dbb5a0f7684c4542d1 P e5256d91808b47c195bc9b4dbd7f2b87 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:45.625661 22859 raft_consensus.cc:515] T 7be9efa6559648dbb5a0f7684c4542d1 P e5256d91808b47c195bc9b4dbd7f2b87 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } attrs { replace: true } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: NON_VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: true } }
I20260709 13:05:45.628010 22859 leader_election.cc:290] T 7be9efa6559648dbb5a0f7684c4542d1 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:05:45.630923 22843 raft_consensus.cc:2804] T ff9b0eddd810459b82d91c60777c10eb P e5256d91808b47c195bc9b4dbd7f2b87 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:05:45.631349 22843 raft_consensus.cc:493] T ff9b0eddd810459b82d91c60777c10eb P e5256d91808b47c195bc9b4dbd7f2b87 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:45.631700 22843 raft_consensus.cc:3060] T ff9b0eddd810459b82d91c60777c10eb P e5256d91808b47c195bc9b4dbd7f2b87 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:05:45.634261 22860 consensus_queue.cc:1059] T 1dc5b3532fe54f74876d02beffa2c230 P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:05:45.635574 22838 raft_consensus.cc:3055] T 1dc5b3532fe54f74876d02beffa2c230 P e5256d91808b47c195bc9b4dbd7f2b87 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:05:45.635943 22838 raft_consensus.cc:740] T 1dc5b3532fe54f74876d02beffa2c230 P e5256d91808b47c195bc9b4dbd7f2b87 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: e5256d91808b47c195bc9b4dbd7f2b87, State: Running, Role: LEADER
I20260709 13:05:45.636831 22838 consensus_queue.cc:260] T 1dc5b3532fe54f74876d02beffa2c230 P e5256d91808b47c195bc9b4dbd7f2b87 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:45.638746 19375 leader_election.cc:304] T f1b10566f45d4a7d9029858330e02d5b P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:05:45.641197 22890 raft_consensus.cc:493] T 309c3ca0ca4b4f3ba129752ea2cb293b P e61c3a8f61bb48f8a963c9480e53c168 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 0473d2b2d01f4459b1e90fd12cc7840e)
I20260709 13:05:45.642120 22890 raft_consensus.cc:515] T 309c3ca0ca4b4f3ba129752ea2cb293b P e61c3a8f61bb48f8a963c9480e53c168 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } attrs { replace: true } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:05:45.643765 19557 raft_consensus.cc:2468] T 7be9efa6559648dbb5a0f7684c4542d1 P e61c3a8f61bb48f8a963c9480e53c168 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 9.
I20260709 13:05:45.645805 22890 leader_election.cc:290] T 309c3ca0ca4b4f3ba129752ea2cb293b P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
W20260709 13:05:45.641445 19376 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:45.647279 22903 raft_consensus.cc:493] T 6c5eebf646ad445a9d1b1adc319d7b16 P 127766fc592545a4997f7790f50f6076 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader e61c3a8f61bb48f8a963c9480e53c168)
I20260709 13:05:45.647969 22903 raft_consensus.cc:515] T 6c5eebf646ad445a9d1b1adc319d7b16 P 127766fc592545a4997f7790f50f6076 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:05:45.641281 22857 raft_consensus.cc:493] T 7f575b143b844aa096b50997dad3516a P e5256d91808b47c195bc9b4dbd7f2b87 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 0473d2b2d01f4459b1e90fd12cc7840e)
I20260709 13:05:45.649444 22857 raft_consensus.cc:515] T 7f575b143b844aa096b50997dad3516a P e5256d91808b47c195bc9b4dbd7f2b87 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
W20260709 13:05:45.650794 19450 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.3:36891, user_credentials={real_user=slave}} blocked reactor thread for 48336.8us
I20260709 13:05:45.651561 19450 leader_election.cc:304] T 76cb037fc9064d13b59a8969d897ce8c P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:05:45.651737 22857 leader_election.cc:290] T 7f575b143b844aa096b50997dad3516a P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:05:45.652258 22857 raft_consensus.cc:493] T 179fd671030940b4b4a4e24bcc4aba0a P e5256d91808b47c195bc9b4dbd7f2b87 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 0473d2b2d01f4459b1e90fd12cc7840e)
I20260709 13:05:45.652581 19450 leader_election.cc:304] T b08304a0a02b42d7840c4e8ee9a6bd1a P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:05:45.652850 22857 raft_consensus.cc:515] T 179fd671030940b4b4a4e24bcc4aba0a P e5256d91808b47c195bc9b4dbd7f2b87 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:45.653354 22722 raft_consensus.cc:2804] T 76cb037fc9064d13b59a8969d897ce8c P 0473d2b2d01f4459b1e90fd12cc7840e [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:05:45.653752 22722 raft_consensus.cc:493] T 76cb037fc9064d13b59a8969d897ce8c P 0473d2b2d01f4459b1e90fd12cc7840e [term 7 FOLLOWER]: Starting leader election (detected failure of leader e5256d91808b47c195bc9b4dbd7f2b87)
I20260709 13:05:45.654139 22722 raft_consensus.cc:3060] T 76cb037fc9064d13b59a8969d897ce8c P 0473d2b2d01f4459b1e90fd12cc7840e [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:05:45.654961 22869 raft_consensus.cc:493] T edd7d470b5014c9489be7f41f64355c9 P e5256d91808b47c195bc9b4dbd7f2b87 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:45.655689 22869 raft_consensus.cc:515] T edd7d470b5014c9489be7f41f64355c9 P e5256d91808b47c195bc9b4dbd7f2b87 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:45.657928 22869 leader_election.cc:290] T edd7d470b5014c9489be7f41f64355c9 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:05:45.662101 19410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e381f1d6b8184797ad142de49be225a8" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
I20260709 13:05:45.662772 19410 raft_consensus.cc:3060] T e381f1d6b8184797ad142de49be225a8 P e5256d91808b47c195bc9b4dbd7f2b87 [term 5 FOLLOWER]: Advancing to term 7
I20260709 13:05:45.662822 22859 raft_consensus.cc:493] T fa8650e71aa14778b3d73721fc50d9fc P e5256d91808b47c195bc9b4dbd7f2b87 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 0473d2b2d01f4459b1e90fd12cc7840e)
I20260709 13:05:45.663494 22859 raft_consensus.cc:515] T fa8650e71aa14778b3d73721fc50d9fc P e5256d91808b47c195bc9b4dbd7f2b87 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:45.665472 22859 leader_election.cc:290] T fa8650e71aa14778b3d73721fc50d9fc P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:05:45.658833 22842 raft_consensus.cc:2804] T b08304a0a02b42d7840c4e8ee9a6bd1a P 0473d2b2d01f4459b1e90fd12cc7840e [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:05:45.666158 22842 raft_consensus.cc:493] T b08304a0a02b42d7840c4e8ee9a6bd1a P 0473d2b2d01f4459b1e90fd12cc7840e [term 10 FOLLOWER]: Starting leader election (detected failure of leader e5256d91808b47c195bc9b4dbd7f2b87)
W20260709 13:05:45.668393 20078 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.2:46257, user_credentials={real_user=slave}} blocked reactor thread for 108497us
I20260709 13:05:45.670190 19410 raft_consensus.cc:2468] T e381f1d6b8184797ad142de49be225a8 P e5256d91808b47c195bc9b4dbd7f2b87 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 7.
I20260709 13:05:45.666538 22842 raft_consensus.cc:3060] T b08304a0a02b42d7840c4e8ee9a6bd1a P 0473d2b2d01f4459b1e90fd12cc7840e [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:05:45.666181 19526 leader_election.cc:304] T 1a61655d99124a29b486ba4a5b37faea P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:05:45.688644 20104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65d8cb8d6ec64f459d5a47cefab10acf" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:05:45.688936 22758 raft_consensus.cc:493] T 217b5fae677b4971b3bbd2f357a1f7ff P e61c3a8f61bb48f8a963c9480e53c168 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:45.689394 20104 raft_consensus.cc:2468] T 65d8cb8d6ec64f459d5a47cefab10acf P 127766fc592545a4997f7790f50f6076 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 5.
I20260709 13:05:45.689474 22758 raft_consensus.cc:515] T 217b5fae677b4971b3bbd2f357a1f7ff P e61c3a8f61bb48f8a963c9480e53c168 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:45.604576 22624 consensus_queue.cc:1059] T 6c5eebf646ad445a9d1b1adc319d7b16 P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.071s
I20260709 13:05:45.701531 22624 raft_consensus.cc:3055] T 6c5eebf646ad445a9d1b1adc319d7b16 P e61c3a8f61bb48f8a963c9480e53c168 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:05:45.695525 22758 leader_election.cc:290] T 217b5fae677b4971b3bbd2f357a1f7ff P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:05:45.696122 22859 raft_consensus.cc:2749] T f1b10566f45d4a7d9029858330e02d5b P e5256d91808b47c195bc9b4dbd7f2b87 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:05:45.682832 22898 raft_consensus.cc:493] T 48824d5acfbc485ebf8c2d944e7202de P e61c3a8f61bb48f8a963c9480e53c168 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 0473d2b2d01f4459b1e90fd12cc7840e)
I20260709 13:05:45.701867 19408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff9b0eddd810459b82d91c60777c10eb" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:05:45.702699 22898 raft_consensus.cc:515] T 48824d5acfbc485ebf8c2d944e7202de P e61c3a8f61bb48f8a963c9480e53c168 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:05:45.704716 22898 leader_election.cc:290] T 48824d5acfbc485ebf8c2d944e7202de P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:05:45.705585 19551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46c5bfeecc314717bffe987e6844b6d0" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 15 candidate_status { last_received { term: 13 index: 5 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:05:45.705928 22848 raft_consensus.cc:3060] T 2e36a9d6e29c4a7c860cf267efbd4c74 P e5256d91808b47c195bc9b4dbd7f2b87 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:05:45.706348 19551 raft_consensus.cc:2468] T 46c5bfeecc314717bffe987e6844b6d0 P e61c3a8f61bb48f8a963c9480e53c168 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 14.
I20260709 13:05:45.707815 22857 leader_election.cc:290] T 179fd671030940b4b4a4e24bcc4aba0a P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:05:45.709406 22882 leader_election.cc:290] T df751f992649444090e27965eb1af85d P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 10 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:05:45.711210 19377 leader_election.cc:304] T 46c5bfeecc314717bffe987e6844b6d0 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:05:45.714155 22839 raft_consensus.cc:2749] T 46c5bfeecc314717bffe987e6844b6d0 P e5256d91808b47c195bc9b4dbd7f2b87 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:05:45.723489 20075 leader_election.cc:304] T 65d8cb8d6ec64f459d5a47cefab10acf P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 127766fc592545a4997f7790f50f6076, e5256d91808b47c195bc9b4dbd7f2b87; no voters: 
I20260709 13:05:45.724797 20075 leader_election.cc:304] T ff9b0eddd810459b82d91c60777c10eb P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 127766fc592545a4997f7790f50f6076, e5256d91808b47c195bc9b4dbd7f2b87; no voters: 
I20260709 13:05:45.726804 19559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86a6797bdfe94fa496c050ceae4bd0d9" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:05:45.728533 22928 raft_consensus.cc:2804] T 65d8cb8d6ec64f459d5a47cefab10acf P 127766fc592545a4997f7790f50f6076 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:05:45.729100 22928 raft_consensus.cc:493] T 65d8cb8d6ec64f459d5a47cefab10acf P 127766fc592545a4997f7790f50f6076 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:45.729553 22928 raft_consensus.cc:3060] T 65d8cb8d6ec64f459d5a47cefab10acf P 127766fc592545a4997f7790f50f6076 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:05:45.731047 22926 raft_consensus.cc:2804] T ff9b0eddd810459b82d91c60777c10eb P 127766fc592545a4997f7790f50f6076 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:05:45.732016 22722 raft_consensus.cc:515] T 76cb037fc9064d13b59a8969d897ce8c P 0473d2b2d01f4459b1e90fd12cc7840e [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:45.731498 19410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36f6ba92b9ba46babe4ebd6c02e5fbd9" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
W20260709 13:05:45.740707 19557 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40428 (request call id 2163) took 3490 ms (client timeout 1805 ms). Trace:
W20260709 13:05:45.741362 19557 rpcz_store.cc:269] 0709 13:05:42.250464 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:42.250596 (+   132us) service_pool.cc:224] Handling call
0709 13:05:45.740413 (+3489817us) spinlock_profiling.cc:243] Waited 3.34 s on lock 0x7b540002eed4. stack: 00007f4a79de9343 00007f4a79de9240 00007f4a797781d4 00007f4a834b6304 00007f4a834b6299 00007f4a7ce71571 00007f4a7cf0c2fa 00007f4a81ecdb17 00007f4a7b4486d4 00007f4a7b448662 00007f4a7b448591 00007f4a7b44850c 00007f4a7b4477c2 00007f4a7b24348c 00007f4a7b2428c6 00007f4a7b24226f
0709 13:05:45.740603 (+   190us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":7683103488}
I20260709 13:05:45.697898 22761 raft_consensus.cc:2804] T 1a61655d99124a29b486ba4a5b37faea P e61c3a8f61bb48f8a963c9480e53c168 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:05:45.742913 22761 raft_consensus.cc:493] T 1a61655d99124a29b486ba4a5b37faea P e61c3a8f61bb48f8a963c9480e53c168 [term 6 FOLLOWER]: Starting leader election (detected failure of leader e5256d91808b47c195bc9b4dbd7f2b87)
I20260709 13:05:45.743506 22761 raft_consensus.cc:3060] T 1a61655d99124a29b486ba4a5b37faea P e61c3a8f61bb48f8a963c9480e53c168 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:05:45.698022 20104 raft_consensus.cc:1240] T fa731b585f684a7fb2d106c50f143b83 P 127766fc592545a4997f7790f50f6076 [term 8 FOLLOWER]: Rejecting Update request from peer e5256d91808b47c195bc9b4dbd7f2b87 for earlier term 7. Current term is 8. Ops: []
I20260709 13:05:45.698856 22727 raft_consensus.cc:2804] T 14935b3ddf914369822e4a0547aaa355 P 127766fc592545a4997f7790f50f6076 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:05:45.748085 22727 raft_consensus.cc:493] T 14935b3ddf914369822e4a0547aaa355 P 127766fc592545a4997f7790f50f6076 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:45.748661 22727 raft_consensus.cc:3060] T 14935b3ddf914369822e4a0547aaa355 P 127766fc592545a4997f7790f50f6076 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:05:45.749181 19484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28af091831594f9d8e96482078cc7625" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:05:45.749922 19484 raft_consensus.cc:3060] T 28af091831594f9d8e96482078cc7625 P 0473d2b2d01f4459b1e90fd12cc7840e [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:05:45.699600 20109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "172b3dd13109415a955b71ac0e9d2234" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:05:45.751116 20109 raft_consensus.cc:2468] T 172b3dd13109415a955b71ac0e9d2234 P 127766fc592545a4997f7790f50f6076 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 7.
I20260709 13:05:45.696163 20107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14efcc79969f41babe5529c22d59156d" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076"
I20260709 13:05:45.752346 20107 raft_consensus.cc:3060] T 14efcc79969f41babe5529c22d59156d P 127766fc592545a4997f7790f50f6076 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:05:45.696985 19526 leader_election.cc:304] T f93ee515a9c14139bf566522ed8232f3 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
W20260709 13:05:45.755232 19526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.2:46257, user_credentials={real_user=slave}} blocked reactor thread for 58392.6us
W20260709 13:05:45.757332 19526 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:45.758159 22777 raft_consensus.cc:2804] T f93ee515a9c14139bf566522ed8232f3 P e61c3a8f61bb48f8a963c9480e53c168 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:05:45.758927 22777 raft_consensus.cc:697] T f93ee515a9c14139bf566522ed8232f3 P e61c3a8f61bb48f8a963c9480e53c168 [term 12 LEADER]: Becoming Leader. State: Replica: e61c3a8f61bb48f8a963c9480e53c168, State: Running, Role: LEADER
I20260709 13:05:45.760377 22777 consensus_queue.cc:237] T f93ee515a9c14139bf566522ed8232f3 P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 9.4, Last appended by leader: 4, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:45.731643 22842 raft_consensus.cc:515] T b08304a0a02b42d7840c4e8ee9a6bd1a P 0473d2b2d01f4459b1e90fd12cc7840e [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:45.762745 19480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14935b3ddf914369822e4a0547aaa355" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:05:45.731596 22926 raft_consensus.cc:493] T ff9b0eddd810459b82d91c60777c10eb P 127766fc592545a4997f7790f50f6076 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:45.763500 19480 raft_consensus.cc:2468] T 14935b3ddf914369822e4a0547aaa355 P 0473d2b2d01f4459b1e90fd12cc7840e [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 7.
I20260709 13:05:45.763666 22926 raft_consensus.cc:3060] T ff9b0eddd810459b82d91c60777c10eb P 127766fc592545a4997f7790f50f6076 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:05:45.765937 22842 leader_election.cc:290] T b08304a0a02b42d7840c4e8ee9a6bd1a P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 11 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:05:45.766820 19480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "309c3ca0ca4b4f3ba129752ea2cb293b" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:05:45.748683 22722 leader_election.cc:290] T 76cb037fc9064d13b59a8969d897ce8c P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 8 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:05:45.776643 19374 leader_election.cc:304] T 65d8cb8d6ec64f459d5a47cefab10acf P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 127766fc592545a4997f7790f50f6076, e5256d91808b47c195bc9b4dbd7f2b87; no voters: 
I20260709 13:05:45.781587 22869 raft_consensus.cc:2804] T 65d8cb8d6ec64f459d5a47cefab10acf P e5256d91808b47c195bc9b4dbd7f2b87 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:05:45.782188 22869 raft_consensus.cc:493] T 65d8cb8d6ec64f459d5a47cefab10acf P e5256d91808b47c195bc9b4dbd7f2b87 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:45.782601 22869 raft_consensus.cc:3060] T 65d8cb8d6ec64f459d5a47cefab10acf P e5256d91808b47c195bc9b4dbd7f2b87 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:05:45.786475 19374 leader_election.cc:304] T 172b3dd13109415a955b71ac0e9d2234 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 127766fc592545a4997f7790f50f6076, e5256d91808b47c195bc9b4dbd7f2b87; no voters: 
I20260709 13:05:45.787662 22857 consensus_queue.cc:1059] T fa731b585f684a7fb2d106c50f143b83 P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:05:45.789018 22857 raft_consensus.cc:2804] T 172b3dd13109415a955b71ac0e9d2234 P e5256d91808b47c195bc9b4dbd7f2b87 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:05:45.789433 22857 raft_consensus.cc:493] T 172b3dd13109415a955b71ac0e9d2234 P e5256d91808b47c195bc9b4dbd7f2b87 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:45.789819 22857 raft_consensus.cc:3060] T 172b3dd13109415a955b71ac0e9d2234 P e5256d91808b47c195bc9b4dbd7f2b87 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:05:45.790263 22700 raft_consensus.cc:3055] T fa731b585f684a7fb2d106c50f143b83 P e5256d91808b47c195bc9b4dbd7f2b87 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:05:45.790745 22700 raft_consensus.cc:740] T fa731b585f684a7fb2d106c50f143b83 P e5256d91808b47c195bc9b4dbd7f2b87 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: e5256d91808b47c195bc9b4dbd7f2b87, State: Running, Role: LEADER
I20260709 13:05:45.791821 22700 consensus_queue.cc:260] T fa731b585f684a7fb2d106c50f143b83 P e5256d91808b47c195bc9b4dbd7f2b87 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:05:45.793452 22700 raft_consensus.cc:3060] T fa731b585f684a7fb2d106c50f143b83 P e5256d91808b47c195bc9b4dbd7f2b87 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:05:45.808458 20075 leader_election.cc:304] T 85c494af21f9457a85da47b9bc70c1fd P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 127766fc592545a4997f7790f50f6076, e5256d91808b47c195bc9b4dbd7f2b87; no voters: 
I20260709 13:05:45.811127 22818 raft_consensus.cc:2804] T 85c494af21f9457a85da47b9bc70c1fd P 127766fc592545a4997f7790f50f6076 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:05:45.811882 22818 raft_consensus.cc:697] T 85c494af21f9457a85da47b9bc70c1fd P 127766fc592545a4997f7790f50f6076 [term 6 LEADER]: Becoming Leader. State: Replica: 127766fc592545a4997f7790f50f6076, State: Running, Role: LEADER
I20260709 13:05:45.813012 22818 consensus_queue.cc:237] T 85c494af21f9457a85da47b9bc70c1fd P 127766fc592545a4997f7790f50f6076 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 4.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:05:45.701915 22624 raft_consensus.cc:740] T 6c5eebf646ad445a9d1b1adc319d7b16 P e61c3a8f61bb48f8a963c9480e53c168 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: e61c3a8f61bb48f8a963c9480e53c168, State: Running, Role: LEADER
I20260709 13:05:45.835750 22624 consensus_queue.cc:260] T 6c5eebf646ad445a9d1b1adc319d7b16 P e61c3a8f61bb48f8a963c9480e53c168 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:05:45.604836 22946 raft_consensus.cc:515] T ff75a1d4cb1f493db8f71ddc136ba9ab P e61c3a8f61bb48f8a963c9480e53c168 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:45.849045 19484 raft_consensus.cc:2468] T 28af091831594f9d8e96482078cc7625 P 0473d2b2d01f4459b1e90fd12cc7840e [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 9.
I20260709 13:05:45.770642 22903 leader_election.cc:290] T 6c5eebf646ad445a9d1b1adc319d7b16 P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:05:45.851742 20078 leader_election.cc:304] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, 127766fc592545a4997f7790f50f6076; no voters: e5256d91808b47c195bc9b4dbd7f2b87
W20260709 13:05:45.859025 19526 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:05:45.867013 19523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.1:40321, user_credentials={real_user=slave}} blocked reactor thread for 225100us
W20260709 13:05:45.867534 19523 connection.cc:256] RPC call timeout handler was delayed by -2.7792239060000838s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18460000000000001s for a response
W20260709 13:05:45.869300 19375 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.3:36891, user_credentials={real_user=slave}} blocked reactor thread for 230779us
I20260709 13:05:45.875676 19482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48824d5acfbc485ebf8c2d944e7202de" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:05:45.876955 22946 leader_election.cc:290] T ff75a1d4cb1f493db8f71ddc136ba9ab P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 8 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:05:45.875813 19480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "217b5fae677b4971b3bbd2f357a1f7ff" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
W20260709 13:05:45.883224 19524 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:05:45.884295 19523 connection.cc:256] RPC call timeout handler was delayed by -2.6937239060000593s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19410000000000002s for a response
I20260709 13:05:45.886377 19410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dc5b3532fe54f74876d02beffa2c230" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:05:45.853315 22838 raft_consensus.cc:3060] T 1dc5b3532fe54f74876d02beffa2c230 P e5256d91808b47c195bc9b4dbd7f2b87 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:05:45.893877 19403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76cb037fc9064d13b59a8969d897ce8c" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:05:45.894661 19526 leader_election.cc:304] T 28af091831594f9d8e96482078cc7625 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:05:45.895743 22946 raft_consensus.cc:493] T 96efeaaf1057492490e9a621f37e1a2d P e61c3a8f61bb48f8a963c9480e53c168 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:45.896412 22890 raft_consensus.cc:2804] T 28af091831594f9d8e96482078cc7625 P e61c3a8f61bb48f8a963c9480e53c168 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:05:45.896355 22946 raft_consensus.cc:515] T 96efeaaf1057492490e9a621f37e1a2d P e61c3a8f61bb48f8a963c9480e53c168 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:05:45.896991 22890 raft_consensus.cc:697] T 28af091831594f9d8e96482078cc7625 P e61c3a8f61bb48f8a963c9480e53c168 [term 9 LEADER]: Becoming Leader. State: Replica: e61c3a8f61bb48f8a963c9480e53c168, State: Running, Role: LEADER
I20260709 13:05:45.897930 22890 consensus_queue.cc:237] T 28af091831594f9d8e96482078cc7625 P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
W20260709 13:05:45.904042 19451 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:45.912352 19480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff75a1d4cb1f493db8f71ddc136ba9ab" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:05:45.908879 19375 leader_election.cc:304] T b9f0d59553ad444883fcf5b5909f9798 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:05:45.920328 19308 catalog_manager.cc:5697] T 2725d2c4cb054f18b0fc8f735c15f6c2 P e5256d91808b47c195bc9b4dbd7f2b87 reported cstate change: term changed from 3 to 8. New cstate: current_term: 8 leader_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } health_report { overall_health: HEALTHY } } }
I20260709 13:05:45.922241 19308 catalog_manager.cc:5697] T 309c3ca0ca4b4f3ba129752ea2cb293b P e5256d91808b47c195bc9b4dbd7f2b87 reported cstate change: term changed from 6 to 7, leader changed from e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3) to 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2). New cstate: current_term: 7 leader_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } attrs { replace: true } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } } }
I20260709 13:05:45.923161 19406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40e1e16737a842ee936002830f36882e" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 12 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:05:45.924393 19409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f85fc4b527a48848e5faa083b604e36" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:05:45.924103 19308 catalog_manager.cc:5697] T 22196caba61445d3bec98a0aab3c337d P e5256d91808b47c195bc9b4dbd7f2b87 reported cstate change: term changed from 4 to 7, leader changed from e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3) to 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2). New cstate: current_term: 7 leader_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } }
I20260709 13:05:45.926271 19308 catalog_manager.cc:5697] T 21e14947d70440f19044d8f75c31e1f9 P e5256d91808b47c195bc9b4dbd7f2b87 reported cstate change: term changed from 5 to 7, leader changed from 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2) to e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1). New cstate: current_term: 7 leader_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } health_report { overall_health: HEALTHY } } }
I20260709 13:05:45.927129 19484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96efeaaf1057492490e9a621f37e1a2d" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:05:45.928020 19484 raft_consensus.cc:2468] T 96efeaaf1057492490e9a621f37e1a2d P 0473d2b2d01f4459b1e90fd12cc7840e [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 8.
I20260709 13:05:45.928473 19308 catalog_manager.cc:5697] T 40e1e16737a842ee936002830f36882e P e5256d91808b47c195bc9b4dbd7f2b87 reported cstate change: term changed from 4 to 9. New cstate: current_term: 9 leader_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } health_report { overall_health: UNKNOWN } } }
W20260709 13:05:45.940616 19377 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.2:46257, user_credentials={real_user=slave}} blocked reactor thread for 170065us
I20260709 13:05:45.907698 22903 raft_consensus.cc:2804] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P 127766fc592545a4997f7790f50f6076 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:05:45.908138 22624 raft_consensus.cc:3060] T 6c5eebf646ad445a9d1b1adc319d7b16 P e61c3a8f61bb48f8a963c9480e53c168 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:05:45.930230 19308 catalog_manager.cc:5697] T 217b5fae677b4971b3bbd2f357a1f7ff P e5256d91808b47c195bc9b4dbd7f2b87 reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } }
I20260709 13:05:45.930276 19411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "775c229504194560ba9589bc2199b089" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:05:45.947634 19406 raft_consensus.cc:1240] T 22196caba61445d3bec98a0aab3c337d P e5256d91808b47c195bc9b4dbd7f2b87 [term 8 FOLLOWER]: Rejecting Update request from peer 0473d2b2d01f4459b1e90fd12cc7840e for earlier term 7. Current term is 8. Ops: []
I20260709 13:05:45.948096 19409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a08760e15aac4630a629431f56024dc8" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:05:45.948678 19404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edd7d470b5014c9489be7f41f64355c9" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:05:45.944280 22758 raft_consensus.cc:493] T 40e1e16737a842ee936002830f36882e P e61c3a8f61bb48f8a963c9480e53c168 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:45.985505 19404 raft_consensus.cc:2468] T edd7d470b5014c9489be7f41f64355c9 P e5256d91808b47c195bc9b4dbd7f2b87 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 9.
I20260709 13:05:45.952303 19402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab43d85f64114d4ebf618930e43d9ed0" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 8 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:05:45.953181 19450 leader_election.cc:304] T ed7fdbcb96d14d418db9ca90a792588a P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:05:45.944728 22903 raft_consensus.cc:493] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P 127766fc592545a4997f7790f50f6076 [term 9 FOLLOWER]: Starting leader election (detected failure of leader e5256d91808b47c195bc9b4dbd7f2b87)
I20260709 13:05:45.954054 22830 raft_consensus.cc:2749] T b9f0d59553ad444883fcf5b5909f9798 P e5256d91808b47c195bc9b4dbd7f2b87 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:05:45.954450 20075 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.1:40321, user_credentials={real_user=slave}} blocked reactor thread for 107735us
I20260709 13:05:45.954550 19403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b08304a0a02b42d7840c4e8ee9a6bd1a" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:05:45.957382 19405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cdf56e38bbc453d9438d359e5a69955" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
W20260709 13:05:45.965004 20078 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.2:46257, user_credentials={real_user=slave}} blocked reactor thread for 285363us
I20260709 13:05:45.965895 20108 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46422 (request call id 627) took 4041 ms. Trace:
W20260709 13:05:45.971729 19523 connection.cc:256] RPC call timeout handler was delayed by -2.6163239060000478s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20270000000000002s for a response
I20260709 13:05:45.996377 19411 raft_consensus.cc:2468] T 775c229504194560ba9589bc2199b089 P e5256d91808b47c195bc9b4dbd7f2b87 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 6.
I20260709 13:05:45.996510 19404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86a6797bdfe94fa496c050ceae4bd0d9" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:05:45.999305 19404 raft_consensus.cc:2468] T 86a6797bdfe94fa496c050ceae4bd0d9 P e5256d91808b47c195bc9b4dbd7f2b87 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 8.
I20260709 13:05:45.996876 22758 raft_consensus.cc:515] T 40e1e16737a842ee936002830f36882e P e61c3a8f61bb48f8a963c9480e53c168 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:46.000353 19406 raft_consensus.cc:1275] T f1b10566f45d4a7d9029858330e02d5b P e5256d91808b47c195bc9b4dbd7f2b87 [term 10 FOLLOWER]: Refusing update from remote peer 0473d2b2d01f4459b1e90fd12cc7840e: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:05:46.001173 19402 raft_consensus.cc:2393] T ab43d85f64114d4ebf618930e43d9ed0 P e5256d91808b47c195bc9b4dbd7f2b87 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0473d2b2d01f4459b1e90fd12cc7840e in current term 8: Already voted for candidate 127766fc592545a4997f7790f50f6076 in this term.
I20260709 13:05:46.002091 22758 leader_election.cc:290] T 40e1e16737a842ee936002830f36882e P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:05:46.002724 22840 raft_consensus.cc:2804] T ed7fdbcb96d14d418db9ca90a792588a P 0473d2b2d01f4459b1e90fd12cc7840e [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:05:45.991931 20108 rpcz_store.cc:276] 0709 13:05:41.924203 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:41.924899 (+   696us) service_pool.cc:224] Handling call
0709 13:05:41.930921 (+  6022us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:05:41.980534 (+ 49613us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:05:41.988689 (+  8155us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:05:41.997026 (+  8337us) log.cc:844] Serialized 26 byte log entry
0709 13:05:45.495601 (+3498575us) spinlock_profiling.cc:243] Waited 1.71 ms on lock 0x7b18003573a0. stack: 00007f4a79de9343 00007f4a79de9240 00007f4a797781d4 00007f4a834b6304 00007f4a834b6299 00007f4a82ce3de1 00007f4a82cf05b1 00007f4a79dfde07 00007f4a82c58ab9 00007f4a79e1a69b 00007f4a79e1893f 00007f4a79e1ac02 00007f4a7caa220b 00007f4a7caa7d23 00007f4a7caa80d1 00007f4a7cec3a0f
0709 13:05:45.646953 (+151352us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:05:45.647018 (+    65us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:45.647124 (+   106us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:05:45.964108 (+316984us) raft_consensus.cc:1685] finished
0709 13:05:45.964133 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:45.965635 (+  1502us) spinlock_profiling.cc:243] Waited 3.8 ms on lock 0x7b5400661050. stack: 00007f4a79de9343 00007f4a79de9240 00007f4a797781d4 00007f4a834b6304 00007f4a834b6299 00007f4a7ce71571 00007f4a7cf078ad 00007f4a81ecc419 00007f4a7b443bd4 00007f4a7b443b62 00007f4a7b443a91 00007f4a7b443a0c 00007f4a7b442cc2 00007f4a7b24348c 00007f4a7b2428c6 00007f4a7b24226f
0709 13:05:45.965736 (+   101us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":14282,"raft.queue_time_us":28804,"raft.run_cpu_time_us":123,"raft.run_wall_time_us":7486,"spinlock_wait_cycles":12676864,"thread_start_us":143309,"threads_started":1,"wal-append.queue_time_us":3892965}
I20260709 13:05:46.003285 22840 raft_consensus.cc:697] T ed7fdbcb96d14d418db9ca90a792588a P 0473d2b2d01f4459b1e90fd12cc7840e [term 6 LEADER]: Becoming Leader. State: Replica: 0473d2b2d01f4459b1e90fd12cc7840e, State: Running, Role: LEADER
W20260709 13:05:45.997573 19523 connection.cc:256] RPC call timeout handler was delayed by -2.5785239059999867s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2069s for a response
W20260709 13:05:46.004423 19523 connection.cc:256] RPC call timeout handler was delayed by -2.4741239060000453s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21850000000000003s for a response
W20260709 13:05:46.004848 19523 connection.cc:256] RPC call timeout handler was delayed by -2.4723239060000424s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2187s for a response
W20260709 13:05:46.005302 19523 connection.cc:256] RPC call timeout handler was delayed by -2.4426239059999943s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.22200000000000003s for a response
W20260709 13:05:46.005647 19523 connection.cc:256] RPC call timeout handler was delayed by -2.4318239060000906s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.22320000000000004s for a response
W20260709 13:05:46.005910 19523 connection.cc:256] RPC call timeout handler was delayed by -2.397902294000005s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1574s for a response
W20260709 13:05:46.006247 19523 connection.cc:256] RPC call timeout handler was delayed by -2.3169022939999877s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1664s for a response
W20260709 13:05:46.006212 19375 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.3:36891, user_credentials={real_user=slave}} blocked reactor thread for 102007us
W20260709 13:05:46.006819 19523 connection.cc:256] RPC call timeout handler was delayed by -2.294402294000065s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16890000000000002s for a response
I20260709 13:05:45.977743 22869 raft_consensus.cc:515] T 65d8cb8d6ec64f459d5a47cefab10acf P e5256d91808b47c195bc9b4dbd7f2b87 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:05:45.988436 19526 leader_election.cc:304] T 96efeaaf1057492490e9a621f37e1a2d P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:05:45.999379 19411 raft_consensus.cc:1240] T 14efcc79969f41babe5529c22d59156d P e5256d91808b47c195bc9b4dbd7f2b87 [term 10 FOLLOWER]: Rejecting Update request from peer 0473d2b2d01f4459b1e90fd12cc7840e for earlier term 9. Current term is 10. Ops: []
I20260709 13:05:45.983915 22946 leader_election.cc:290] T 96efeaaf1057492490e9a621f37e1a2d P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
W20260709 13:05:46.007166 19523 connection.cc:256] RPC call timeout handler was delayed by -2.2674022940000214s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17190000000000003s for a response
W20260709 13:05:46.011636 19523 connection.cc:256] RPC call timeout handler was delayed by -2.2314022940000768s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1759s for a response
I20260709 13:05:45.994159 22903 raft_consensus.cc:3060] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P 127766fc592545a4997f7790f50f6076 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:05:46.011955 19523 connection.cc:256] RPC call timeout handler was delayed by -2.1540022940000654s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1845s for a response
W20260709 13:05:46.015599 19523 connection.cc:256] RPC call timeout handler was delayed by -1.9641022939999857s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2056s for a response
W20260709 13:05:46.015954 19523 connection.cc:256] RPC call timeout handler was delayed by -1.9209022940000295s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21040000000000003s for a response
W20260709 13:05:46.016247 19523 connection.cc:256] RPC call timeout handler was delayed by -1.8993022939999946s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21280000000000002s for a response
W20260709 13:05:46.016633 19523 connection.cc:256] RPC call timeout handler was delayed by -1.7757745449999902s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1544s for a response
W20260709 13:05:46.017045 19523 connection.cc:256] RPC call timeout handler was delayed by -1.5898590059999833s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1889s for a response
W20260709 13:05:46.017323 19523 connection.cc:256] RPC call timeout handler was delayed by -1.563240651000001s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1785s for a response
W20260709 13:05:46.017584 19523 connection.cc:256] RPC call timeout handler was delayed by -1.4920616079999718s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1962s for a response
I20260709 13:05:45.987433 19480 raft_consensus.cc:2468] T ff75a1d4cb1f493db8f71ddc136ba9ab P 0473d2b2d01f4459b1e90fd12cc7840e [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 8.
I20260709 13:05:46.017836 19450 leader_election.cc:304] T e381f1d6b8184797ad142de49be225a8 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:05:46.019323 19526 leader_election.cc:304] T ff75a1d4cb1f493db8f71ddc136ba9ab P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:05:46.023671 19484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40e1e16737a842ee936002830f36882e" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 12 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:05:46.007472 22624 raft_consensus.cc:493] T 2b74109013a140ada21feeef92d6f563 P e61c3a8f61bb48f8a963c9480e53c168 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader e5256d91808b47c195bc9b4dbd7f2b87)
I20260709 13:05:46.025415 19411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46c5bfeecc314717bffe987e6844b6d0" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 15 candidate_status { last_received { term: 13 index: 5 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:05:46.013022 22758 raft_consensus.cc:2804] T 96efeaaf1057492490e9a621f37e1a2d P e61c3a8f61bb48f8a963c9480e53c168 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:05:46.028169 19484 raft_consensus.cc:2468] T 40e1e16737a842ee936002830f36882e P 0473d2b2d01f4459b1e90fd12cc7840e [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 11.
I20260709 13:05:46.009483 19308 catalog_manager.cc:5697] T 76cb037fc9064d13b59a8969d897ce8c P e5256d91808b47c195bc9b4dbd7f2b87 reported cstate change: term changed from 5 to 7, leader changed from 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2) to e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1). New cstate: current_term: 7 leader_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } health_report { overall_health: HEALTHY } } }
I20260709 13:05:46.004796 22843 raft_consensus.cc:515] T ff9b0eddd810459b82d91c60777c10eb P e5256d91808b47c195bc9b4dbd7f2b87 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
W20260709 13:05:46.027869 22625 consensus_meta.cc:287] T ef32ce6fdd0e40d382c79974f30295c6 P e5256d91808b47c195bc9b4dbd7f2b87: Time spent flushing consensus metadata: real 0.734s	user 0.016s	sys 0.000s
I20260709 13:05:46.055236 19411 raft_consensus.cc:2468] T 46c5bfeecc314717bffe987e6844b6d0 P e5256d91808b47c195bc9b4dbd7f2b87 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 14.
I20260709 13:05:46.057400 19409 raft_consensus.cc:1275] T ab43d85f64114d4ebf618930e43d9ed0 P e5256d91808b47c195bc9b4dbd7f2b87 [term 8 FOLLOWER]: Refusing update from remote peer 127766fc592545a4997f7790f50f6076: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 13:05:46.058151 19450 leader_election.cc:304] T edd7d470b5014c9489be7f41f64355c9 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:05:46.058897 22810 raft_consensus.cc:2804] T ff75a1d4cb1f493db8f71ddc136ba9ab P e61c3a8f61bb48f8a963c9480e53c168 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:05:46.059419 22810 raft_consensus.cc:697] T ff75a1d4cb1f493db8f71ddc136ba9ab P e61c3a8f61bb48f8a963c9480e53c168 [term 8 LEADER]: Becoming Leader. State: Replica: e61c3a8f61bb48f8a963c9480e53c168, State: Running, Role: LEADER
I20260709 13:05:46.060169 19405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e36a9d6e29c4a7c860cf267efbd4c74" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:05:46.064702 22840 consensus_queue.cc:237] T ed7fdbcb96d14d418db9ca90a792588a P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:05:46.031647 22722 raft_consensus.cc:2804] T e381f1d6b8184797ad142de49be225a8 P 0473d2b2d01f4459b1e90fd12cc7840e [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:05:46.032121 22758 raft_consensus.cc:493] T 96efeaaf1057492490e9a621f37e1a2d P e61c3a8f61bb48f8a963c9480e53c168 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:46.067117 19411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a61655d99124a29b486ba4a5b37faea" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:05:46.068351 19411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df751f992649444090e27965eb1af85d" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
I20260709 13:05:46.068462 19406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76cb037fc9064d13b59a8969d897ce8c" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
I20260709 13:05:46.069866 19526 leader_election.cc:304] T 40e1e16737a842ee936002830f36882e P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:05:46.067265 22758 raft_consensus.cc:3060] T 96efeaaf1057492490e9a621f37e1a2d P e61c3a8f61bb48f8a963c9480e53c168 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:05:46.062845 19523 leader_election.cc:304] T 0afb57ae58a24a01850491d69f0213dd P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e61c3a8f61bb48f8a963c9480e53c168; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, 127766fc592545a4997f7790f50f6076
I20260709 13:05:46.074924 19408 raft_consensus.cc:2368] T ff9b0eddd810459b82d91c60777c10eb P e5256d91808b47c195bc9b4dbd7f2b87 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0473d2b2d01f4459b1e90fd12cc7840e for earlier term 7. Current term is 8.
I20260709 13:05:46.077406 19403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21e14947d70440f19044d8f75c31e1f9" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
I20260709 13:05:46.087880 19406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22196caba61445d3bec98a0aab3c337d" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:05:46.088716 19406 raft_consensus.cc:2468] T 22196caba61445d3bec98a0aab3c337d P e5256d91808b47c195bc9b4dbd7f2b87 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 8.
I20260709 13:05:46.091281 19409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9962423cb4e54fcfa5de01daf68a86e7" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:05:46.091739 19411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ec1c4ce15e04c7e8c283a62179f2a64" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
I20260709 13:05:46.070133 19308 catalog_manager.cc:5697] T e381f1d6b8184797ad142de49be225a8 P e5256d91808b47c195bc9b4dbd7f2b87 reported cstate change: term changed from 4 to 5, leader changed from e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3) to 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2). New cstate: current_term: 5 leader_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } }
I20260709 13:05:46.093041 20078 leader_election.cc:304] T 5ec1c4ce15e04c7e8c283a62179f2a64 P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 127766fc592545a4997f7790f50f6076; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:05:46.099251 22763 raft_consensus.cc:2749] T 0afb57ae58a24a01850491d69f0213dd P e61c3a8f61bb48f8a963c9480e53c168 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:05:46.101912 22843 leader_election.cc:290] T ff9b0eddd810459b82d91c60777c10eb P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 8 election: Requested vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
W20260709 13:05:46.102973 19523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.4:43121, user_credentials={real_user=slave}} blocked reactor thread for 49859.4us
I20260709 13:05:46.103200 22810 consensus_queue.cc:237] T ff75a1d4cb1f493db8f71ddc136ba9ab P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:46.103994 19523 leader_election.cc:304] T ed7fdbcb96d14d418db9ca90a792588a P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e61c3a8f61bb48f8a963c9480e53c168; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, 127766fc592545a4997f7790f50f6076
I20260709 13:05:46.103030 22624 raft_consensus.cc:515] T 2b74109013a140ada21feeef92d6f563 P e61c3a8f61bb48f8a963c9480e53c168 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:46.108769 22624 leader_election.cc:290] T 2b74109013a140ada21feeef92d6f563 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:05:46.109365 22624 raft_consensus.cc:2749] T ed7fdbcb96d14d418db9ca90a792588a P e61c3a8f61bb48f8a963c9480e53c168 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:05:46.111783 19375 leader_election.cc:304] T 14935b3ddf914369822e4a0547aaa355 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 127766fc592545a4997f7790f50f6076, e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168; no voters: 0473d2b2d01f4459b1e90fd12cc7840e
I20260709 13:05:46.085765 22898 raft_consensus.cc:2804] T 40e1e16737a842ee936002830f36882e P e61c3a8f61bb48f8a963c9480e53c168 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:05:46.069235 22818 consensus_queue.cc:1048] T ab43d85f64114d4ebf618930e43d9ed0 P 127766fc592545a4997f7790f50f6076 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.044s
I20260709 13:05:46.132197 19403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dc5b3532fe54f74876d02beffa2c230" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
W20260709 13:05:46.133819 20078 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.2:46257, user_credentials={real_user=slave}} blocked reactor thread for 70873.6us
I20260709 13:05:46.135732 22880 consensus_queue.cc:1059] T 2a16f7501e2444fb86d4e2778e734e02 P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.024s
I20260709 13:05:46.138833 19409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc225c93219c45538b53a1bd3d387e4d" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:05:46.141261 22845 consensus_queue.cc:1059] T a08760e15aac4630a629431f56024dc8 P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 3, Time since last communication: 0.055s
I20260709 13:05:46.142025 19402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b08304a0a02b42d7840c4e8ee9a6bd1a" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
I20260709 13:05:46.119015 22869 leader_election.cc:290] T 65d8cb8d6ec64f459d5a47cefab10acf P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 6 election: Requested vote from peers e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:05:46.130784 19308 catalog_manager.cc:5697] T fa731b585f684a7fb2d106c50f143b83 P e5256d91808b47c195bc9b4dbd7f2b87 reported cstate change: term changed from 6 to 7, leader changed from 127766fc592545a4997f7790f50f6076 (127.17.223.4) to e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1). New cstate: current_term: 7 leader_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:46.142843 21926 consensus_queue.cc:1048] T b08304a0a02b42d7840c4e8ee9a6bd1a P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.013s
I20260709 13:05:46.097210 22926 raft_consensus.cc:515] T ff9b0eddd810459b82d91c60777c10eb P 127766fc592545a4997f7790f50f6076 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:05:46.165076 20107 raft_consensus.cc:2468] T 14efcc79969f41babe5529c22d59156d P 127766fc592545a4997f7790f50f6076 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 10.
I20260709 13:05:46.165305 19411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "217b5fae677b4971b3bbd2f357a1f7ff" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
I20260709 13:05:46.128906 22898 raft_consensus.cc:493] T 40e1e16737a842ee936002830f36882e P e61c3a8f61bb48f8a963c9480e53c168 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:46.179711 20108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff9b0eddd810459b82d91c60777c10eb" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076"
I20260709 13:05:46.178596 20104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65d8cb8d6ec64f459d5a47cefab10acf" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076"
W20260709 13:05:46.185590 19375 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.3:36891, user_credentials={real_user=slave}} blocked reactor thread for 73906.8us
I20260709 13:05:46.187458 19551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed7fdbcb96d14d418db9ca90a792588a" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:05:46.189174 20108 raft_consensus.cc:2393] T ff9b0eddd810459b82d91c60777c10eb P 127766fc592545a4997f7790f50f6076 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate e5256d91808b47c195bc9b4dbd7f2b87 in current term 8: Already voted for candidate 127766fc592545a4997f7790f50f6076 in this term.
I20260709 13:05:46.179562 22898 raft_consensus.cc:3060] T 40e1e16737a842ee936002830f36882e P e61c3a8f61bb48f8a963c9480e53c168 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:05:46.199225 19554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa731b585f684a7fb2d106c50f143b83" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:05:46.199980 19554 raft_consensus.cc:3060] T fa731b585f684a7fb2d106c50f143b83 P e61c3a8f61bb48f8a963c9480e53c168 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:05:46.197902 19374 leader_election.cc:304] T 14efcc79969f41babe5529c22d59156d P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 127766fc592545a4997f7790f50f6076, e5256d91808b47c195bc9b4dbd7f2b87; no voters: 
I20260709 13:05:46.202337 19375 leader_election.cc:304] T 2725d2c4cb054f18b0fc8f735c15f6c2 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:05:46.137769 22758 raft_consensus.cc:515] T 96efeaaf1057492490e9a621f37e1a2d P e61c3a8f61bb48f8a963c9480e53c168 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:05:46.193640 22880 raft_consensus.cc:3055] T 2a16f7501e2444fb86d4e2778e734e02 P e5256d91808b47c195bc9b4dbd7f2b87 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:05:46.210421 22845 raft_consensus.cc:2804] T 14efcc79969f41babe5529c22d59156d P e5256d91808b47c195bc9b4dbd7f2b87 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:05:46.214488 19551 raft_consensus.cc:2393] T ed7fdbcb96d14d418db9ca90a792588a P e61c3a8f61bb48f8a963c9480e53c168 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 127766fc592545a4997f7790f50f6076 in current term 6: Already voted for candidate 0473d2b2d01f4459b1e90fd12cc7840e in this term.
I20260709 13:05:46.216661 19552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85c494af21f9457a85da47b9bc70c1fd" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:05:46.213949 19308 catalog_manager.cc:5697] T f1b10566f45d4a7d9029858330e02d5b P e5256d91808b47c195bc9b4dbd7f2b87 reported cstate change: term changed from 6 to 8, leader changed from 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2) to e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1). New cstate: current_term: 8 leader_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } health_report { overall_health: HEALTHY } } }
I20260709 13:05:46.225647 19557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48824d5acfbc485ebf8c2d944e7202de" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:05:46.226363 19557 raft_consensus.cc:2468] T 48824d5acfbc485ebf8c2d944e7202de P e61c3a8f61bb48f8a963c9480e53c168 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 127766fc592545a4997f7790f50f6076 in term 8.
I20260709 13:05:46.197227 22928 raft_consensus.cc:515] T 65d8cb8d6ec64f459d5a47cefab10acf P 127766fc592545a4997f7790f50f6076 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:05:46.230207 19559 raft_consensus.cc:1240] T 96efeaaf1057492490e9a621f37e1a2d P e61c3a8f61bb48f8a963c9480e53c168 [term 9 FOLLOWER]: Rejecting Update request from peer 127766fc592545a4997f7790f50f6076 for earlier term 8. Current term is 9. Ops: []
W20260709 13:05:46.244040 20076 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.3:36891, user_credentials={real_user=slave}} blocked reactor thread for 77144.5us
I20260709 13:05:46.244786 19556 raft_consensus.cc:1240] T d1e5873a19244c5ebbcd38e126796ee7 P e61c3a8f61bb48f8a963c9480e53c168 [term 11 LEADER]: Rejecting Update request from peer e5256d91808b47c195bc9b4dbd7f2b87 for earlier term 10. Current term is 11. Ops: []
I20260709 13:05:46.232192 19551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "309c3ca0ca4b4f3ba129752ea2cb293b" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:05:46.241092 19553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65d8cb8d6ec64f459d5a47cefab10acf" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:05:46.216897 22880 raft_consensus.cc:740] T 2a16f7501e2444fb86d4e2778e734e02 P e5256d91808b47c195bc9b4dbd7f2b87 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: e5256d91808b47c195bc9b4dbd7f2b87, State: Running, Role: LEADER
I20260709 13:05:46.238878 19552 raft_consensus.cc:2468] T 85c494af21f9457a85da47b9bc70c1fd P e61c3a8f61bb48f8a963c9480e53c168 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 127766fc592545a4997f7790f50f6076 in term 5.
I20260709 13:05:46.240615 19560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ece3db938bc649d4a40a51522ed5259c" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:05:46.253698 19553 raft_consensus.cc:2468] T 65d8cb8d6ec64f459d5a47cefab10acf P e61c3a8f61bb48f8a963c9480e53c168 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 127766fc592545a4997f7790f50f6076 in term 4.
I20260709 13:05:46.253602 19551 raft_consensus.cc:2468] T 309c3ca0ca4b4f3ba129752ea2cb293b P e61c3a8f61bb48f8a963c9480e53c168 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 127766fc592545a4997f7790f50f6076 in term 7.
I20260709 13:05:46.239981 19555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70797e5783b5454ab0d0eea663e791e3" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:05:46.263384 19558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65d8cb8d6ec64f459d5a47cefab10acf" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:05:46.279503 20104 raft_consensus.cc:2393] T 65d8cb8d6ec64f459d5a47cefab10acf P 127766fc592545a4997f7790f50f6076 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate e5256d91808b47c195bc9b4dbd7f2b87 in current term 6: Already voted for candidate 127766fc592545a4997f7790f50f6076 in this term.
I20260709 13:05:46.280319 19553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e1f505cb0f1427bbd698ac889d80821" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
W20260709 13:05:46.235672 22848 consensus_meta.cc:287] T 2e36a9d6e29c4a7c860cf267efbd4c74 P e5256d91808b47c195bc9b4dbd7f2b87: Time spent flushing consensus metadata: real 0.529s	user 0.011s	sys 0.002s
I20260709 13:05:46.272608 19558 raft_consensus.cc:2468] T 65d8cb8d6ec64f459d5a47cefab10acf P e61c3a8f61bb48f8a963c9480e53c168 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 4.
I20260709 13:05:46.284958 19555 raft_consensus.cc:2393] T 70797e5783b5454ab0d0eea663e791e3 P e61c3a8f61bb48f8a963c9480e53c168 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 127766fc592545a4997f7790f50f6076 in current term 9: Already voted for candidate e61c3a8f61bb48f8a963c9480e53c168 in this term.
I20260709 13:05:46.238111 22727 raft_consensus.cc:515] T 14935b3ddf914369822e4a0547aaa355 P 127766fc592545a4997f7790f50f6076 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } attrs { replace: true } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:05:46.285820 19555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a16f7501e2444fb86d4e2778e734e02" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:05:46.286499 19555 raft_consensus.cc:2393] T 2a16f7501e2444fb86d4e2778e734e02 P e61c3a8f61bb48f8a963c9480e53c168 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 127766fc592545a4997f7790f50f6076 in current term 9: Already voted for candidate e61c3a8f61bb48f8a963c9480e53c168 in this term.
I20260709 13:05:46.287279 19555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c5eebf646ad445a9d1b1adc319d7b16" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:05:46.287866 19555 raft_consensus.cc:2468] T 6c5eebf646ad445a9d1b1adc319d7b16 P e61c3a8f61bb48f8a963c9480e53c168 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 127766fc592545a4997f7790f50f6076 in term 7.
I20260709 13:05:46.288847 19555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4af19371ea874c09a0a2147040835cbb" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:05:46.289951 19523 leader_election.cc:304] T 4509b76741dc428e9201c70c1658da13 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e61c3a8f61bb48f8a963c9480e53c168; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:05:46.290237 19551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62c6c134d3d24a1ab144dd9ee6bc3f64" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:05:46.248288 22830 consensus_queue.cc:1059] T 28af091831594f9d8e96482078cc7625 P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 }, Status: INVALID_TERM, Last received: 8.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.043s
I20260709 13:05:46.247141 22700 consensus_queue.cc:1048] T 40e1e16737a842ee936002830f36882e P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.044s
I20260709 13:05:46.267647 22903 raft_consensus.cc:515] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P 127766fc592545a4997f7790f50f6076 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:05:46.246224 22859 consensus_queue.cc:1059] T 70797e5783b5454ab0d0eea663e791e3 P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 }, Status: INVALID_TERM, Last received: 8.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.045s
I20260709 13:05:46.234547 22625 raft_consensus.cc:2804] T 2725d2c4cb054f18b0fc8f735c15f6c2 P e5256d91808b47c195bc9b4dbd7f2b87 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:05:46.250815 22821 raft_consensus.cc:2804] T 14935b3ddf914369822e4a0547aaa355 P e5256d91808b47c195bc9b4dbd7f2b87 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:05:46.290002 19555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85c494af21f9457a85da47b9bc70c1fd" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:05:46.234388 22869 raft_consensus.cc:3055] T a08760e15aac4630a629431f56024dc8 P e5256d91808b47c195bc9b4dbd7f2b87 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:05:46.294186 19557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4af19371ea874c09a0a2147040835cbb" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:05:46.251777 22845 raft_consensus.cc:697] T 14efcc79969f41babe5529c22d59156d P e5256d91808b47c195bc9b4dbd7f2b87 [term 10 LEADER]: Becoming Leader. State: Replica: e5256d91808b47c195bc9b4dbd7f2b87, State: Running, Role: LEADER
I20260709 13:05:46.225458 22761 raft_consensus.cc:515] T 1a61655d99124a29b486ba4a5b37faea P e61c3a8f61bb48f8a963c9480e53c168 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:46.301312 19405 raft_consensus.cc:2468] T 2e36a9d6e29c4a7c860cf267efbd4c74 P e5256d91808b47c195bc9b4dbd7f2b87 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 7.
I20260709 13:05:46.304733 19555 raft_consensus.cc:2468] T 85c494af21f9457a85da47b9bc70c1fd P e61c3a8f61bb48f8a963c9480e53c168 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 127766fc592545a4997f7790f50f6076 in term 5.
W20260709 13:05:46.306115 19526 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:46.305102 19308 catalog_manager.cc:5697] T 2b74109013a140ada21feeef92d6f563 P e5256d91808b47c195bc9b4dbd7f2b87 reported cstate change: term changed from 2 to 5, leader changed from 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2) to e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1). New cstate: current_term: 5 leader_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } health_report { overall_health: HEALTHY } } }
I20260709 13:05:46.307328 19554 raft_consensus.cc:2468] T fa731b585f684a7fb2d106c50f143b83 P e61c3a8f61bb48f8a963c9480e53c168 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 127766fc592545a4997f7790f50f6076 in term 8.
I20260709 13:05:46.304442 19409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff9b0eddd810459b82d91c60777c10eb" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
I20260709 13:05:46.321354 19409 raft_consensus.cc:2393] T ff9b0eddd810459b82d91c60777c10eb P e5256d91808b47c195bc9b4dbd7f2b87 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 127766fc592545a4997f7790f50f6076 in current term 8: Already voted for candidate e5256d91808b47c195bc9b4dbd7f2b87 in this term.
I20260709 13:05:46.306267 19551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa731b585f684a7fb2d106c50f143b83" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:05:46.311991 19560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "833a2f0775ed407a94b8924ce50adb63" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:05:46.318819 19558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96efeaaf1057492490e9a621f37e1a2d" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:05:46.321080 19553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed7fdbcb96d14d418db9ca90a792588a" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:05:46.322058 19552 raft_consensus.cc:1240] T fa731b585f684a7fb2d106c50f143b83 P e61c3a8f61bb48f8a963c9480e53c168 [term 8 FOLLOWER]: Rejecting Update request from peer e5256d91808b47c195bc9b4dbd7f2b87 for earlier term 7. Current term is 8. Ops: []
I20260709 13:05:46.243796 22857 raft_consensus.cc:515] T 172b3dd13109415a955b71ac0e9d2234 P e5256d91808b47c195bc9b4dbd7f2b87 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:05:46.322749 19553 raft_consensus.cc:2393] T ed7fdbcb96d14d418db9ca90a792588a P e61c3a8f61bb48f8a963c9480e53c168 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 127766fc592545a4997f7790f50f6076 in current term 6: Already voted for candidate 0473d2b2d01f4459b1e90fd12cc7840e in this term.
I20260709 13:05:46.339392 19558 raft_consensus.cc:2368] T 96efeaaf1057492490e9a621f37e1a2d P e61c3a8f61bb48f8a963c9480e53c168 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 127766fc592545a4997f7790f50f6076 for earlier term 8. Current term is 9.
I20260709 13:05:46.321987 19556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0afb57ae58a24a01850491d69f0213dd" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:05:46.300384 22946 raft_consensus.cc:2749] T 4509b76741dc428e9201c70c1658da13 P e61c3a8f61bb48f8a963c9480e53c168 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:05:46.303474 22625 raft_consensus.cc:493] T 2725d2c4cb054f18b0fc8f735c15f6c2 P e5256d91808b47c195bc9b4dbd7f2b87 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:46.304536 22821 raft_consensus.cc:493] T 14935b3ddf914369822e4a0547aaa355 P e5256d91808b47c195bc9b4dbd7f2b87 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 127766fc592545a4997f7790f50f6076)
I20260709 13:05:46.310791 22869 raft_consensus.cc:740] T a08760e15aac4630a629431f56024dc8 P e5256d91808b47c195bc9b4dbd7f2b87 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: e5256d91808b47c195bc9b4dbd7f2b87, State: Running, Role: LEADER
I20260709 13:05:46.354346 19556 raft_consensus.cc:2393] T 0afb57ae58a24a01850491d69f0213dd P e61c3a8f61bb48f8a963c9480e53c168 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 127766fc592545a4997f7790f50f6076 in current term 9: Already voted for candidate e61c3a8f61bb48f8a963c9480e53c168 in this term.
I20260709 13:05:46.354571 19553 raft_consensus.cc:1275] T ab43d85f64114d4ebf618930e43d9ed0 P e61c3a8f61bb48f8a963c9480e53c168 [term 8 FOLLOWER]: Refusing update from remote peer 127766fc592545a4997f7790f50f6076: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 13:05:46.351534 19555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85c494af21f9457a85da47b9bc70c1fd" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:05:46.355445 19555 raft_consensus.cc:3060] T 85c494af21f9457a85da47b9bc70c1fd P e61c3a8f61bb48f8a963c9480e53c168 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:05:46.352125 19407 raft_consensus.cc:1240] T 172b3dd13109415a955b71ac0e9d2234 P e5256d91808b47c195bc9b4dbd7f2b87 [term 8 FOLLOWER]: Rejecting Update request from peer 0473d2b2d01f4459b1e90fd12cc7840e for earlier term 7. Current term is 8. Ops: []
I20260709 13:05:46.404706 19559 raft_consensus.cc:1240] T f93ee515a9c14139bf566522ed8232f3 P e61c3a8f61bb48f8a963c9480e53c168 [term 12 LEADER]: Rejecting Update request from peer e5256d91808b47c195bc9b4dbd7f2b87 for earlier term 11. Current term is 12. Ops: []
I20260709 13:05:46.349745 22625 raft_consensus.cc:3060] T 2725d2c4cb054f18b0fc8f735c15f6c2 P e5256d91808b47c195bc9b4dbd7f2b87 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:05:46.413230 19559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa8650e71aa14778b3d73721fc50d9fc" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:05:46.415031 19554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edd7d470b5014c9489be7f41f64355c9" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 10 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
W20260709 13:05:46.415165 19523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.1:40321, user_credentials={real_user=slave}} blocked reactor thread for 125319us
I20260709 13:05:46.415889 19554 raft_consensus.cc:2410] T edd7d470b5014c9489be7f41f64355c9 P e61c3a8f61bb48f8a963c9480e53c168 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e5256d91808b47c195bc9b4dbd7f2b87 for term 10 because replica has last-logged OpId of term: 8 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 3.
I20260709 13:05:46.352008 22926 leader_election.cc:290] T ff9b0eddd810459b82d91c60777c10eb P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 8 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:05:46.414713 19553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff75a1d4cb1f493db8f71ddc136ba9ab" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:05:46.410902 22880 consensus_queue.cc:260] T 2a16f7501e2444fb86d4e2778e734e02 P e5256d91808b47c195bc9b4dbd7f2b87 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
W20260709 13:05:46.411815 22950 log.cc:927] Time spent T 5ec1c4ce15e04c7e8c283a62179f2a64 P 127766fc592545a4997f7790f50f6076: Append to log took a long time: real 0.062s	user 0.000s	sys 0.000s
I20260709 13:05:46.413172 22857 leader_election.cc:290] T 172b3dd13109415a955b71ac0e9d2234 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 8 election: Requested vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:05:46.413805 22916 raft_consensus.cc:2749] T 5ec1c4ce15e04c7e8c283a62179f2a64 P 127766fc592545a4997f7790f50f6076 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:05:46.353490 22821 raft_consensus.cc:3060] T 14935b3ddf914369822e4a0547aaa355 P e5256d91808b47c195bc9b4dbd7f2b87 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:05:46.408209 22845 consensus_queue.cc:237] T 14efcc79969f41babe5529c22d59156d P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:05:46.403708 19560 raft_consensus.cc:2468] T 833a2f0775ed407a94b8924ce50adb63 P e61c3a8f61bb48f8a963c9480e53c168 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 127766fc592545a4997f7790f50f6076 in term 7.
I20260709 13:05:46.420717 19523 leader_election.cc:304] T 2e36a9d6e29c4a7c860cf267efbd4c74 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e61c3a8f61bb48f8a963c9480e53c168; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:05:46.421379 22946 consensus_queue.cc:1048] T 86a6797bdfe94fa496c050ceae4bd0d9 P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.000s
W20260709 13:05:46.422780 19524 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:46.422938 19557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f575b143b844aa096b50997dad3516a" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
W20260709 13:05:46.423465 19451 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:46.465010 19556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7be9efa6559648dbb5a0f7684c4542d1" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:05:46.456816 19558 raft_consensus.cc:1240] T 1a61655d99124a29b486ba4a5b37faea P e61c3a8f61bb48f8a963c9480e53c168 [term 7 FOLLOWER]: Rejecting Update request from peer e5256d91808b47c195bc9b4dbd7f2b87 for earlier term 6. Current term is 7. Ops: []
W20260709 13:05:46.418351 22838 consensus_meta.cc:287] T 1dc5b3532fe54f74876d02beffa2c230 P e5256d91808b47c195bc9b4dbd7f2b87: Time spent flushing consensus metadata: real 0.514s	user 0.007s	sys 0.003s
I20260709 13:05:46.468748 19559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "179fd671030940b4b4a4e24bcc4aba0a" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:05:46.468935 22898 raft_consensus.cc:515] T 40e1e16737a842ee936002830f36882e P e61c3a8f61bb48f8a963c9480e53c168 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:46.413977 22869 consensus_queue.cc:260] T a08760e15aac4630a629431f56024dc8 P e5256d91808b47c195bc9b4dbd7f2b87 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:46.475472 19556 raft_consensus.cc:2410] T 7be9efa6559648dbb5a0f7684c4542d1 P e61c3a8f61bb48f8a963c9480e53c168 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e5256d91808b47c195bc9b4dbd7f2b87 for term 10 because replica has last-logged OpId of term: 7 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 5.
I20260709 13:05:46.478469 19410 raft_consensus.cc:2468] T 1dc5b3532fe54f74876d02beffa2c230 P e5256d91808b47c195bc9b4dbd7f2b87 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 8.
I20260709 13:05:46.478642 19551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65d8cb8d6ec64f459d5a47cefab10acf" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:05:46.480342 19551 raft_consensus.cc:3060] T 65d8cb8d6ec64f459d5a47cefab10acf P e61c3a8f61bb48f8a963c9480e53c168 [term 4 FOLLOWER]: Advancing to term 6
I20260709 13:05:46.483675 19405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28af091831594f9d8e96482078cc7625" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:05:46.431701 22727 leader_election.cc:290] T 14935b3ddf914369822e4a0547aaa355 P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 8 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:05:46.482399 22763 raft_consensus.cc:2749] T 2e36a9d6e29c4a7c860cf267efbd4c74 P e61c3a8f61bb48f8a963c9480e53c168 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
W20260709 13:05:46.494997 19523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.1:40321, user_credentials={real_user=slave}} blocked reactor thread for 74442.7us
I20260709 13:05:46.486699 19557 raft_consensus.cc:2468] T 7f575b143b844aa096b50997dad3516a P e61c3a8f61bb48f8a963c9480e53c168 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 4.
I20260709 13:05:46.500427 19407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f575b143b844aa096b50997dad3516a" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:05:46.498447 19308 catalog_manager.cc:5697] T 4af19371ea874c09a0a2147040835cbb P e5256d91808b47c195bc9b4dbd7f2b87 reported cstate change: term changed from 4 to 5, leader changed from 127766fc592545a4997f7790f50f6076 (127.17.223.4) to e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1). New cstate: current_term: 5 leader_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:46.486910 19559 raft_consensus.cc:2468] T 179fd671030940b4b4a4e24bcc4aba0a P e61c3a8f61bb48f8a963c9480e53c168 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 8.
W20260709 13:05:46.520078 19450 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.3:36891, user_credentials={real_user=slave}} blocked reactor thread for 461979us
I20260709 13:05:46.529035 19405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4af19371ea874c09a0a2147040835cbb" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:05:46.487818 22758 leader_election.cc:290] T 96efeaaf1057492490e9a621f37e1a2d P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 9 election: Requested vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:05:46.489116 22722 raft_consensus.cc:697] T e381f1d6b8184797ad142de49be225a8 P 0473d2b2d01f4459b1e90fd12cc7840e [term 7 LEADER]: Becoming Leader. State: Replica: 0473d2b2d01f4459b1e90fd12cc7840e, State: Running, Role: LEADER
I20260709 13:05:46.531333 19308 catalog_manager.cc:5697] T bc225c93219c45538b53a1bd3d387e4d P e5256d91808b47c195bc9b4dbd7f2b87 reported cstate change: term changed from 7 to 10, leader changed from 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2) to e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1). New cstate: current_term: 10 leader_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:46.498768 22843 raft_consensus.cc:493] T ab43d85f64114d4ebf618930e43d9ed0 P e5256d91808b47c195bc9b4dbd7f2b87 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 127766fc592545a4997f7790f50f6076)
I20260709 13:05:46.512355 22880 raft_consensus.cc:3060] T 2a16f7501e2444fb86d4e2778e734e02 P e5256d91808b47c195bc9b4dbd7f2b87 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:05:46.549834 19409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70797e5783b5454ab0d0eea663e791e3" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
W20260709 13:05:46.555282 20078 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.2:46257, user_credentials={real_user=slave}} blocked reactor thread for 419890us
I20260709 13:05:46.555195 19308 catalog_manager.cc:5697] T 28af091831594f9d8e96482078cc7625 P e5256d91808b47c195bc9b4dbd7f2b87 reported cstate change: term changed from 6 to 8, leader changed from 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2) to e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1). New cstate: current_term: 8 leader_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } health_report { overall_health: HEALTHY } } }
I20260709 13:05:46.557859 19410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e381f1d6b8184797ad142de49be225a8" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:05:46.558610 19410 raft_consensus.cc:2393] T e381f1d6b8184797ad142de49be225a8 P e5256d91808b47c195bc9b4dbd7f2b87 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e61c3a8f61bb48f8a963c9480e53c168 in current term 7: Already voted for candidate 0473d2b2d01f4459b1e90fd12cc7840e in this term.
I20260709 13:05:46.547428 22928 leader_election.cc:290] T 65d8cb8d6ec64f459d5a47cefab10acf P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 6 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:05:46.572880 19523 leader_election.cc:304] T bc225c93219c45538b53a1bd3d387e4d P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e61c3a8f61bb48f8a963c9480e53c168; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:05:46.576607 19409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ece3db938bc649d4a40a51522ed5259c" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:05:46.578588 19308 catalog_manager.cc:5697] T 7f575b143b844aa096b50997dad3516a P e5256d91808b47c195bc9b4dbd7f2b87 reported cstate change: term changed from 2 to 3, leader changed from e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1) to e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3). New cstate: current_term: 3 leader_uuid: "e61c3a8f61bb48f8a963c9480e53c168" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } }
I20260709 13:05:46.554061 22903 leader_election.cc:290] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 10 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:05:46.583752 20110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "172b3dd13109415a955b71ac0e9d2234" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076"
I20260709 13:05:46.583621 19410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a61655d99124a29b486ba4a5b37faea" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:05:46.584465 20110 raft_consensus.cc:3060] T 172b3dd13109415a955b71ac0e9d2234 P 127766fc592545a4997f7790f50f6076 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:05:46.561144 22882 raft_consensus.cc:2804] T edd7d470b5014c9489be7f41f64355c9 P 0473d2b2d01f4459b1e90fd12cc7840e [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 13:05:46.570574 19449 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.1:40321, user_credentials={real_user=slave}} blocked reactor thread for 458580us
I20260709 13:05:46.560843 22869 raft_consensus.cc:3060] T a08760e15aac4630a629431f56024dc8 P e5256d91808b47c195bc9b4dbd7f2b87 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:05:46.590914 20104 raft_consensus.cc:1240] T 1efebf73c86e432baa55533136b6e12c P 127766fc592545a4997f7790f50f6076 [term 7 FOLLOWER]: Rejecting Update request from peer 0473d2b2d01f4459b1e90fd12cc7840e for earlier term 6. Current term is 7. Ops: []
I20260709 13:05:46.569165 22761 leader_election.cc:290] T 1a61655d99124a29b486ba4a5b37faea P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 7 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:05:46.605854 19403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36f6ba92b9ba46babe4ebd6c02e5fbd9" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
W20260709 13:05:46.609272 19377 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:46.611450 19403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f93ee515a9c14139bf566522ed8232f3" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 12 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
I20260709 13:05:46.616390 19410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22196caba61445d3bec98a0aab3c337d" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:05:46.618016 19449 leader_election.cc:304] T 40e1e16737a842ee936002830f36882e P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e; no voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:05:46.618162 19409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14935b3ddf914369822e4a0547aaa355" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
I20260709 13:05:46.584079 22758 raft_consensus.cc:2749] T bc225c93219c45538b53a1bd3d387e4d P e61c3a8f61bb48f8a963c9480e53c168 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:05:46.554277 22843 raft_consensus.cc:515] T ab43d85f64114d4ebf618930e43d9ed0 P e5256d91808b47c195bc9b4dbd7f2b87 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } attrs { replace: true } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:05:46.624579 19407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65d8cb8d6ec64f459d5a47cefab10acf" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
I20260709 13:05:46.626993 20109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff9b0eddd810459b82d91c60777c10eb" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:05:46.591933 22882 raft_consensus.cc:493] T edd7d470b5014c9489be7f41f64355c9 P 0473d2b2d01f4459b1e90fd12cc7840e [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:46.632490 20109 raft_consensus.cc:2368] T ff9b0eddd810459b82d91c60777c10eb P 127766fc592545a4997f7790f50f6076 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0473d2b2d01f4459b1e90fd12cc7840e for earlier term 7. Current term is 8.
W20260709 13:05:46.640990 19523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.1:40321, user_credentials={real_user=slave}} blocked reactor thread for 89384us
I20260709 13:05:46.629276 19407 raft_consensus.cc:2393] T 65d8cb8d6ec64f459d5a47cefab10acf P e5256d91808b47c195bc9b4dbd7f2b87 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 127766fc592545a4997f7790f50f6076 in current term 6: Already voted for candidate e5256d91808b47c195bc9b4dbd7f2b87 in this term.
I20260709 13:05:46.632093 19410 raft_consensus.cc:2393] T 22196caba61445d3bec98a0aab3c337d P e5256d91808b47c195bc9b4dbd7f2b87 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e61c3a8f61bb48f8a963c9480e53c168 in current term 8: Already voted for candidate e5256d91808b47c195bc9b4dbd7f2b87 in this term.
I20260709 13:05:46.664637 20104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e1085d23e8347fbbd5bce7542f4b1f4" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:05:46.666229 22857 raft_consensus.cc:3055] T 70797e5783b5454ab0d0eea663e791e3 P e5256d91808b47c195bc9b4dbd7f2b87 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:05:46.664990 19405 raft_consensus.cc:1275] T 3e1f505cb0f1427bbd698ac889d80821 P e5256d91808b47c195bc9b4dbd7f2b87 [term 9 FOLLOWER]: Refusing update from remote peer e61c3a8f61bb48f8a963c9480e53c168: Log matching property violated. Preceding OpId in replica: term: 8 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 13:05:46.665472 20104 raft_consensus.cc:2410] T 0e1085d23e8347fbbd5bce7542f4b1f4 P 127766fc592545a4997f7790f50f6076 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0473d2b2d01f4459b1e90fd12cc7840e for term 7 because replica has last-logged OpId of term: 6 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260709 13:05:46.663362 19403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14935b3ddf914369822e4a0547aaa355" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
W20260709 13:05:46.664722 19449 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.1:40321, user_credentials={real_user=slave}} blocked reactor thread for 59710.8us
I20260709 13:05:46.636149 22882 raft_consensus.cc:3060] T edd7d470b5014c9489be7f41f64355c9 P 0473d2b2d01f4459b1e90fd12cc7840e [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:05:46.677855 22843 leader_election.cc:290] T ab43d85f64114d4ebf618930e43d9ed0 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
W20260709 13:05:46.683230 22959 log.cc:927] Time spent T 217b5fae677b4971b3bbd2f357a1f7ff P 0473d2b2d01f4459b1e90fd12cc7840e: Append to log took a long time: real 0.136s	user 0.001s	sys 0.000s
I20260709 13:05:46.666441 19523 leader_election.cc:304] T 46c5bfeecc314717bffe987e6844b6d0 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e61c3a8f61bb48f8a963c9480e53c168; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:05:46.711063 22758 raft_consensus.cc:2749] T 46c5bfeecc314717bffe987e6844b6d0 P e61c3a8f61bb48f8a963c9480e53c168 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:05:46.643115 22722 consensus_queue.cc:237] T e381f1d6b8184797ad142de49be225a8 P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
W20260709 13:05:46.689107 22958 log.cc:927] Time spent T f93ee515a9c14139bf566522ed8232f3 P e61c3a8f61bb48f8a963c9480e53c168: Append to log took a long time: real 0.099s	user 0.000s	sys 0.001s
I20260709 13:05:46.689311 19449 leader_election.cc:304] T 775c229504194560ba9589bc2199b089 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87; no voters: 
I20260709 13:05:46.689492 22898 leader_election.cc:290] T 40e1e16737a842ee936002830f36882e P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 12 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:05:46.720618 22961 raft_consensus.cc:2804] T 775c229504194560ba9589bc2199b089 P 0473d2b2d01f4459b1e90fd12cc7840e [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:05:46.721067 22961 raft_consensus.cc:493] T 775c229504194560ba9589bc2199b089 P 0473d2b2d01f4459b1e90fd12cc7840e [term 6 FOLLOWER]: Starting leader election (detected failure of leader 127766fc592545a4997f7790f50f6076)
I20260709 13:05:46.720252 19308 catalog_manager.cc:5697] T 2e36a9d6e29c4a7c860cf267efbd4c74 P e5256d91808b47c195bc9b4dbd7f2b87 reported cstate change: term changed from 4 to 6, leader changed from 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2) to e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1). New cstate: current_term: 6 leader_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } health_report { overall_health: HEALTHY } } }
I20260709 13:05:46.721447 22961 raft_consensus.cc:3060] T 775c229504194560ba9589bc2199b089 P 0473d2b2d01f4459b1e90fd12cc7840e [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:05:46.692420 22840 raft_consensus.cc:2749] T 40e1e16737a842ee936002830f36882e P 0473d2b2d01f4459b1e90fd12cc7840e [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:05:46.724038 19411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab43d85f64114d4ebf618930e43d9ed0" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 9 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:05:46.667160 22857 raft_consensus.cc:740] T 70797e5783b5454ab0d0eea663e791e3 P e5256d91808b47c195bc9b4dbd7f2b87 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: e5256d91808b47c195bc9b4dbd7f2b87, State: Running, Role: LEADER
I20260709 13:05:46.725951 20108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36f6ba92b9ba46babe4ebd6c02e5fbd9" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:05:46.725831 22857 consensus_queue.cc:260] T 70797e5783b5454ab0d0eea663e791e3 P e5256d91808b47c195bc9b4dbd7f2b87 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 7, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:05:46.726281 20107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f85fc4b527a48848e5faa083b604e36" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:05:46.728674 20107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed7fdbcb96d14d418db9ca90a792588a" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076"
I20260709 13:05:46.729329 20107 raft_consensus.cc:2393] T ed7fdbcb96d14d418db9ca90a792588a P 127766fc592545a4997f7790f50f6076 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 0473d2b2d01f4459b1e90fd12cc7840e in current term 6: Already voted for candidate 127766fc592545a4997f7790f50f6076 in this term.
I20260709 13:05:46.729324 19559 raft_consensus.cc:1240] T 40e1e16737a842ee936002830f36882e P e61c3a8f61bb48f8a963c9480e53c168 [term 12 FOLLOWER]: Rejecting Update request from peer e5256d91808b47c195bc9b4dbd7f2b87 for earlier term 11. Current term is 12. Ops: [11.6-11.6]
I20260709 13:05:46.722189 19308 catalog_manager.cc:5697] T 4509b76741dc428e9201c70c1658da13 P e5256d91808b47c195bc9b4dbd7f2b87 reported cstate change: term changed from 1 to 2, leader changed from e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1) to e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3). New cstate: current_term: 2 leader_uuid: "e61c3a8f61bb48f8a963c9480e53c168" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } }
I20260709 13:05:46.731165 20108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c5eebf646ad445a9d1b1adc319d7b16" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076"
I20260709 13:05:46.761716 20108 raft_consensus.cc:3060] T 6c5eebf646ad445a9d1b1adc319d7b16 P 127766fc592545a4997f7790f50f6076 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:05:46.697880 19551 raft_consensus.cc:2468] T 65d8cb8d6ec64f459d5a47cefab10acf P e61c3a8f61bb48f8a963c9480e53c168 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 6.
I20260709 13:05:46.761785 19555 raft_consensus.cc:2468] T 85c494af21f9457a85da47b9bc70c1fd P e61c3a8f61bb48f8a963c9480e53c168 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 127766fc592545a4997f7790f50f6076 in term 6.
W20260709 13:05:46.764325 19449 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.1:40321, user_credentials={real_user=slave}} blocked reactor thread for 44065.4us
W20260709 13:05:46.764979 19523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.1:40321, user_credentials={real_user=slave}} blocked reactor thread for 98609us
W20260709 13:05:46.669049 19450 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.3:36891, user_credentials={real_user=slave}} blocked reactor thread for 108536us
I20260709 13:05:46.731487 20104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab43d85f64114d4ebf618930e43d9ed0" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
W20260709 13:05:46.767119 19375 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:46.768904 20110 raft_consensus.cc:2468] T 172b3dd13109415a955b71ac0e9d2234 P 127766fc592545a4997f7790f50f6076 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 8.
I20260709 13:05:46.773254 22625 raft_consensus.cc:515] T 2725d2c4cb054f18b0fc8f735c15f6c2 P e5256d91808b47c195bc9b4dbd7f2b87 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:46.775133 19449 leader_election.cc:304] T 86a6797bdfe94fa496c050ceae4bd0d9 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87; no voters: 
I20260709 13:05:46.767237 19308 catalog_manager.cc:5697] T 833a2f0775ed407a94b8924ce50adb63 P e5256d91808b47c195bc9b4dbd7f2b87 reported cstate change: term changed from 3 to 6, leader changed from e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1) to 127766fc592545a4997f7790f50f6076 (127.17.223.4). New cstate: current_term: 6 leader_uuid: "127766fc592545a4997f7790f50f6076" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } } }
I20260709 13:05:46.773828 22882 raft_consensus.cc:515] T edd7d470b5014c9489be7f41f64355c9 P 0473d2b2d01f4459b1e90fd12cc7840e [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:46.777516 22840 raft_consensus.cc:2804] T 86a6797bdfe94fa496c050ceae4bd0d9 P 0473d2b2d01f4459b1e90fd12cc7840e [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:05:46.777961 22840 raft_consensus.cc:493] T 86a6797bdfe94fa496c050ceae4bd0d9 P 0473d2b2d01f4459b1e90fd12cc7840e [term 8 FOLLOWER]: Starting leader election (detected failure of leader e61c3a8f61bb48f8a963c9480e53c168)
I20260709 13:05:46.778048 19450 leader_election.cc:304] T 0cdf56e38bbc453d9438d359e5a69955 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e; no voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:05:46.778384 22840 raft_consensus.cc:3060] T 86a6797bdfe94fa496c050ceae4bd0d9 P 0473d2b2d01f4459b1e90fd12cc7840e [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:05:46.777549 19523 leader_election.cc:304] T 1dc5b3532fe54f74876d02beffa2c230 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e61c3a8f61bb48f8a963c9480e53c168; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:05:46.779996 20109 raft_consensus.cc:1240] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P 127766fc592545a4997f7790f50f6076 [term 10 FOLLOWER]: Rejecting Update request from peer e5256d91808b47c195bc9b4dbd7f2b87 for earlier term 9. Current term is 10. Ops: []
I20260709 13:05:46.780742 19551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab43d85f64114d4ebf618930e43d9ed0" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:05:46.781225 19551 raft_consensus.cc:2468] T ab43d85f64114d4ebf618930e43d9ed0 P e61c3a8f61bb48f8a963c9480e53c168 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 8.
I20260709 13:05:46.782791 19449 leader_election.cc:304] T ab43d85f64114d4ebf618930e43d9ed0 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e; no voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:05:46.786306 20112 raft_consensus.cc:1240] T 14efcc79969f41babe5529c22d59156d P 127766fc592545a4997f7790f50f6076 [term 10 FOLLOWER]: Rejecting Update request from peer 0473d2b2d01f4459b1e90fd12cc7840e for earlier term 9. Current term is 10. Ops: []
I20260709 13:05:46.789523 22966 consensus_queue.cc:1048] T f1b10566f45d4a7d9029858330e02d5b P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.003s
I20260709 13:05:46.789937 19523 leader_election.cc:304] T ef32ce6fdd0e40d382c79974f30295c6 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e61c3a8f61bb48f8a963c9480e53c168; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:05:46.791194 22965 consensus_queue.cc:1059] T 0afb57ae58a24a01850491d69f0213dd P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.003s
I20260709 13:05:46.795584 22898 raft_consensus.cc:2749] T 1dc5b3532fe54f74876d02beffa2c230 P e61c3a8f61bb48f8a963c9480e53c168 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:05:46.798784 22972 consensus_queue.cc:1059] T d1e5873a19244c5ebbcd38e126796ee7 P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:05:46.800505 20108 raft_consensus.cc:2468] T 6c5eebf646ad445a9d1b1adc319d7b16 P 127766fc592545a4997f7790f50f6076 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 7.
I20260709 13:05:46.802791 19523 leader_election.cc:304] T fa8650e71aa14778b3d73721fc50d9fc P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168; no voters: 0473d2b2d01f4459b1e90fd12cc7840e
I20260709 13:05:46.803074 22625 leader_election.cc:290] T 2725d2c4cb054f18b0fc8f735c15f6c2 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 10 election: Requested vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:05:46.803669 22974 raft_consensus.cc:2749] T ef32ce6fdd0e40d382c79974f30295c6 P e61c3a8f61bb48f8a963c9480e53c168 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:05:46.804003 19523 leader_election.cc:304] T 179fd671030940b4b4a4e24bcc4aba0a P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e61c3a8f61bb48f8a963c9480e53c168; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:05:46.803937 22961 raft_consensus.cc:515] T 775c229504194560ba9589bc2199b089 P 0473d2b2d01f4459b1e90fd12cc7840e [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:05:46.804876 22758 raft_consensus.cc:2804] T fa8650e71aa14778b3d73721fc50d9fc P e61c3a8f61bb48f8a963c9480e53c168 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:05:46.805282 22758 raft_consensus.cc:493] T fa8650e71aa14778b3d73721fc50d9fc P e61c3a8f61bb48f8a963c9480e53c168 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 0473d2b2d01f4459b1e90fd12cc7840e)
I20260709 13:05:46.805647 22758 raft_consensus.cc:3060] T fa8650e71aa14778b3d73721fc50d9fc P e61c3a8f61bb48f8a963c9480e53c168 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:05:46.805866 19523 leader_election.cc:304] T f1b10566f45d4a7d9029858330e02d5b P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e61c3a8f61bb48f8a963c9480e53c168; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:05:46.806175 22961 leader_election.cc:290] T 775c229504194560ba9589bc2199b089 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 7 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:05:46.757177 22821 raft_consensus.cc:515] T 14935b3ddf914369822e4a0547aaa355 P e5256d91808b47c195bc9b4dbd7f2b87 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } attrs { replace: true } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:05:46.806857 22946 raft_consensus.cc:2749] T 179fd671030940b4b4a4e24bcc4aba0a P e61c3a8f61bb48f8a963c9480e53c168 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:05:46.807538 22946 raft_consensus.cc:2749] T f1b10566f45d4a7d9029858330e02d5b P e61c3a8f61bb48f8a963c9480e53c168 [term 10 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:05:46.808313 19409 raft_consensus.cc:3060] T 14935b3ddf914369822e4a0547aaa355 P e5256d91808b47c195bc9b4dbd7f2b87 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:05:46.809130 22821 leader_election.cc:290] T 14935b3ddf914369822e4a0547aaa355 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 7 election: Requested vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:05:46.814416 20104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "775c229504194560ba9589bc2199b089" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:05:46.815514 22860 consensus_queue.cc:1059] T f93ee515a9c14139bf566522ed8232f3 P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:05:46.816443 22972 consensus_queue.cc:1243] T d1e5873a19244c5ebbcd38e126796ee7 P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Peer e61c3a8f61bb48f8a963c9480e53c168 log is divergent from this leader: its last log entry 11.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 13:05:46.816994 22972 raft_consensus.cc:3055] T d1e5873a19244c5ebbcd38e126796ee7 P e5256d91808b47c195bc9b4dbd7f2b87 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:05:46.817291 22972 raft_consensus.cc:740] T d1e5873a19244c5ebbcd38e126796ee7 P e5256d91808b47c195bc9b4dbd7f2b87 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: e5256d91808b47c195bc9b4dbd7f2b87, State: Running, Role: LEADER
I20260709 13:05:46.787429 22857 raft_consensus.cc:3060] T 70797e5783b5454ab0d0eea663e791e3 P e5256d91808b47c195bc9b4dbd7f2b87 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:05:46.823982 19449 leader_election.cc:304] T a08760e15aac4630a629431f56024dc8 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e; no voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:05:46.788893 22882 leader_election.cc:290] T edd7d470b5014c9489be7f41f64355c9 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 10 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:05:46.827679 19374 leader_election.cc:304] T 172b3dd13109415a955b71ac0e9d2234 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 127766fc592545a4997f7790f50f6076, e5256d91808b47c195bc9b4dbd7f2b87; no voters: 
W20260709 13:05:46.828392 19450 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.3:36891, user_credentials={real_user=slave}} blocked reactor thread for 50432.9us
I20260709 13:05:46.829535 22860 consensus_queue.cc:1243] T f93ee515a9c14139bf566522ed8232f3 P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Peer e61c3a8f61bb48f8a963c9480e53c168 log is divergent from this leader: its last log entry 12.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 3
I20260709 13:05:46.829993 22821 raft_consensus.cc:3055] T f93ee515a9c14139bf566522ed8232f3 P e5256d91808b47c195bc9b4dbd7f2b87 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:05:46.830143 22967 raft_consensus.cc:3055] T 0afb57ae58a24a01850491d69f0213dd P 0473d2b2d01f4459b1e90fd12cc7840e [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:05:46.830382 22821 raft_consensus.cc:740] T f93ee515a9c14139bf566522ed8232f3 P e5256d91808b47c195bc9b4dbd7f2b87 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: e5256d91808b47c195bc9b4dbd7f2b87, State: Running, Role: LEADER
I20260709 13:05:46.831393 22821 consensus_queue.cc:260] T f93ee515a9c14139bf566522ed8232f3 P e5256d91808b47c195bc9b4dbd7f2b87 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 11.4, Last appended by leader: 4, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:46.833668 19450 leader_election.cc:304] T 46c5bfeecc314717bffe987e6844b6d0 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:05:46.833966 22964 raft_consensus.cc:2749] T 0cdf56e38bbc453d9438d359e5a69955 P 0473d2b2d01f4459b1e90fd12cc7840e [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:05:46.825749 22978 raft_consensus.cc:2749] T ab43d85f64114d4ebf618930e43d9ed0 P 0473d2b2d01f4459b1e90fd12cc7840e [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:05:46.834923 22842 consensus_queue.cc:1048] T f1b10566f45d4a7d9029858330e02d5b P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:05:46.835918 22978 raft_consensus.cc:2804] T 46c5bfeecc314717bffe987e6844b6d0 P 0473d2b2d01f4459b1e90fd12cc7840e [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:05:46.836119 22860 raft_consensus.cc:2804] T 172b3dd13109415a955b71ac0e9d2234 P e5256d91808b47c195bc9b4dbd7f2b87 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:05:46.836321 22978 raft_consensus.cc:493] T 46c5bfeecc314717bffe987e6844b6d0 P 0473d2b2d01f4459b1e90fd12cc7840e [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:46.836427 22977 consensus_queue.cc:1059] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:05:46.836830 22978 raft_consensus.cc:3060] T 46c5bfeecc314717bffe987e6844b6d0 P 0473d2b2d01f4459b1e90fd12cc7840e [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:05:46.836670 22860 raft_consensus.cc:697] T 172b3dd13109415a955b71ac0e9d2234 P e5256d91808b47c195bc9b4dbd7f2b87 [term 8 LEADER]: Becoming Leader. State: Replica: e5256d91808b47c195bc9b4dbd7f2b87, State: Running, Role: LEADER
I20260709 13:05:46.837631 22838 raft_consensus.cc:3055] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P e5256d91808b47c195bc9b4dbd7f2b87 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:05:46.838065 22838 raft_consensus.cc:740] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P e5256d91808b47c195bc9b4dbd7f2b87 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: e5256d91808b47c195bc9b4dbd7f2b87, State: Running, Role: LEADER
I20260709 13:05:46.830578 22967 raft_consensus.cc:740] T 0afb57ae58a24a01850491d69f0213dd P 0473d2b2d01f4459b1e90fd12cc7840e [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 0473d2b2d01f4459b1e90fd12cc7840e, State: Running, Role: LEADER
I20260709 13:05:46.838366 22860 consensus_queue.cc:237] T 172b3dd13109415a955b71ac0e9d2234 P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:05:46.838861 22838 consensus_queue.cc:260] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P e5256d91808b47c195bc9b4dbd7f2b87 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:05:46.839668 22967 consensus_queue.cc:260] T 0afb57ae58a24a01850491d69f0213dd P 0473d2b2d01f4459b1e90fd12cc7840e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:05:46.840953 22967 raft_consensus.cc:3060] T 0afb57ae58a24a01850491d69f0213dd P 0473d2b2d01f4459b1e90fd12cc7840e [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:05:46.840102 22838 raft_consensus.cc:3060] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P e5256d91808b47c195bc9b4dbd7f2b87 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:05:46.842728 22972 consensus_queue.cc:260] T d1e5873a19244c5ebbcd38e126796ee7 P e5256d91808b47c195bc9b4dbd7f2b87 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 10.5, Last appended by leader: 5, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:46.844028 22972 raft_consensus.cc:3060] T d1e5873a19244c5ebbcd38e126796ee7 P e5256d91808b47c195bc9b4dbd7f2b87 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:05:46.844435 19560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a61655d99124a29b486ba4a5b37faea" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:05:46.845206 19560 raft_consensus.cc:2393] T 1a61655d99124a29b486ba4a5b37faea P e61c3a8f61bb48f8a963c9480e53c168 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0473d2b2d01f4459b1e90fd12cc7840e in current term 7: Already voted for candidate e61c3a8f61bb48f8a963c9480e53c168 in this term.
I20260709 13:05:46.846839 19523 leader_election.cc:304] T 2a16f7501e2444fb86d4e2778e734e02 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e61c3a8f61bb48f8a963c9480e53c168; no voters: 127766fc592545a4997f7790f50f6076, e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:05:46.847043 20110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96efeaaf1057492490e9a621f37e1a2d" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 9 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:05:46.849159 20104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14935b3ddf914369822e4a0547aaa355" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076"
I20260709 13:05:46.849875 20104 raft_consensus.cc:2368] T 14935b3ddf914369822e4a0547aaa355 P 127766fc592545a4997f7790f50f6076 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate e5256d91808b47c195bc9b4dbd7f2b87 for earlier term 7. Current term is 8.
I20260709 13:05:46.853386 19559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21e14947d70440f19044d8f75c31e1f9" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:05:46.853556 22974 raft_consensus.cc:2749] T 2a16f7501e2444fb86d4e2778e734e02 P e61c3a8f61bb48f8a963c9480e53c168 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:05:46.853987 19523 leader_election.cc:304] T a08760e15aac4630a629431f56024dc8 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e61c3a8f61bb48f8a963c9480e53c168; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:05:46.854259 19557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22196caba61445d3bec98a0aab3c337d" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:05:46.850793 19560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7be9efa6559648dbb5a0f7684c4542d1" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:05:46.854007 19559 raft_consensus.cc:3060] T 21e14947d70440f19044d8f75c31e1f9 P e61c3a8f61bb48f8a963c9480e53c168 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:05:46.855345 19560 raft_consensus.cc:2468] T 7be9efa6559648dbb5a0f7684c4542d1 P e61c3a8f61bb48f8a963c9480e53c168 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 9.
I20260709 13:05:46.852485 19375 leader_election.cc:304] T 7f575b143b844aa096b50997dad3516a P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:05:46.857868 19557 raft_consensus.cc:2468] T 22196caba61445d3bec98a0aab3c337d P e61c3a8f61bb48f8a963c9480e53c168 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 7.
I20260709 13:05:46.858029 19523 leader_election.cc:304] T 85c494af21f9457a85da47b9bc70c1fd P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168; no voters: 127766fc592545a4997f7790f50f6076
I20260709 13:05:46.858824 22974 raft_consensus.cc:2749] T a08760e15aac4630a629431f56024dc8 P e61c3a8f61bb48f8a963c9480e53c168 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:05:46.859537 22898 raft_consensus.cc:2764] T 85c494af21f9457a85da47b9bc70c1fd P e61c3a8f61bb48f8a963c9480e53c168 [term 6 FOLLOWER]: Leader election decision vote started in defunct term 5: won
I20260709 13:05:46.861066 22880 consensus_queue.cc:1059] T 1a61655d99124a29b486ba4a5b37faea P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:05:46.861792 22758 raft_consensus.cc:515] T fa8650e71aa14778b3d73721fc50d9fc P e61c3a8f61bb48f8a963c9480e53c168 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:46.864259 22758 leader_election.cc:290] T fa8650e71aa14778b3d73721fc50d9fc P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 10 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:05:46.864982 19523 leader_election.cc:304] T 2725d2c4cb054f18b0fc8f735c15f6c2 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168; no voters: 0473d2b2d01f4459b1e90fd12cc7840e
I20260709 13:05:46.867118 22979 raft_consensus.cc:2804] T 2725d2c4cb054f18b0fc8f735c15f6c2 P e61c3a8f61bb48f8a963c9480e53c168 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:05:46.867710 22979 raft_consensus.cc:697] T 2725d2c4cb054f18b0fc8f735c15f6c2 P e61c3a8f61bb48f8a963c9480e53c168 [term 9 LEADER]: Becoming Leader. State: Replica: e61c3a8f61bb48f8a963c9480e53c168, State: Running, Role: LEADER
I20260709 13:05:46.867555 19523 leader_election.cc:304] T 7f575b143b844aa096b50997dad3516a P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e61c3a8f61bb48f8a963c9480e53c168; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:05:46.868913 22880 raft_consensus.cc:2804] T 7f575b143b844aa096b50997dad3516a P e5256d91808b47c195bc9b4dbd7f2b87 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:05:46.868754 22979 consensus_queue.cc:237] T 2725d2c4cb054f18b0fc8f735c15f6c2 P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:46.869103 19523 leader_election.cc:304] T 4af19371ea874c09a0a2147040835cbb P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e61c3a8f61bb48f8a963c9480e53c168; no voters: 127766fc592545a4997f7790f50f6076, e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:05:46.869335 22880 raft_consensus.cc:493] T 7f575b143b844aa096b50997dad3516a P e5256d91808b47c195bc9b4dbd7f2b87 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 0473d2b2d01f4459b1e90fd12cc7840e)
I20260709 13:05:46.869786 22880 raft_consensus.cc:3060] T 7f575b143b844aa096b50997dad3516a P e5256d91808b47c195bc9b4dbd7f2b87 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:05:46.869967 22758 raft_consensus.cc:2749] T 7f575b143b844aa096b50997dad3516a P e61c3a8f61bb48f8a963c9480e53c168 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:05:46.870699 22758 raft_consensus.cc:2749] T 4af19371ea874c09a0a2147040835cbb P e61c3a8f61bb48f8a963c9480e53c168 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:05:46.870915 22975 raft_consensus.cc:3055] T 1a61655d99124a29b486ba4a5b37faea P e5256d91808b47c195bc9b4dbd7f2b87 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:05:46.871378 22975 raft_consensus.cc:740] T 1a61655d99124a29b486ba4a5b37faea P e5256d91808b47c195bc9b4dbd7f2b87 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: e5256d91808b47c195bc9b4dbd7f2b87, State: Running, Role: LEADER
I20260709 13:05:46.872094 19523 leader_election.cc:304] T 70797e5783b5454ab0d0eea663e791e3 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e61c3a8f61bb48f8a963c9480e53c168; no voters: 127766fc592545a4997f7790f50f6076, e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:05:46.872192 22975 consensus_queue.cc:260] T 1a61655d99124a29b486ba4a5b37faea P e5256d91808b47c195bc9b4dbd7f2b87 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:46.872865 22758 raft_consensus.cc:2749] T 70797e5783b5454ab0d0eea663e791e3 P e61c3a8f61bb48f8a963c9480e53c168 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:05:46.873497 22975 raft_consensus.cc:3060] T 1a61655d99124a29b486ba4a5b37faea P e5256d91808b47c195bc9b4dbd7f2b87 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:05:46.873974 19523 leader_election.cc:304] T e381f1d6b8184797ad142de49be225a8 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e61c3a8f61bb48f8a963c9480e53c168; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:05:46.875576 22758 raft_consensus.cc:2749] T e381f1d6b8184797ad142de49be225a8 P e61c3a8f61bb48f8a963c9480e53c168 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:05:46.848055 22965 raft_consensus.cc:3060] T a08760e15aac4630a629431f56024dc8 P 0473d2b2d01f4459b1e90fd12cc7840e [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:05:46.877554 19523 leader_election.cc:304] T ece3db938bc649d4a40a51522ed5259c P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e61c3a8f61bb48f8a963c9480e53c168; no voters: 127766fc592545a4997f7790f50f6076, e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:05:46.878993 19375 leader_election.cc:304] T 179fd671030940b4b4a4e24bcc4aba0a P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:05:46.889130 19374 leader_election.cc:400] T 14935b3ddf914369822e4a0547aaa355 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 7 election: Vote denied by peer 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121) with higher term. Message: Invalid argument: T 14935b3ddf914369822e4a0547aaa355 P 127766fc592545a4997f7790f50f6076 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate e5256d91808b47c195bc9b4dbd7f2b87 for earlier term 7. Current term is 8.
I20260709 13:05:46.889514 19374 leader_election.cc:403] T 14935b3ddf914369822e4a0547aaa355 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 7 election: Cancelling election due to peer responding with higher term
I20260709 13:05:46.890909 22898 raft_consensus.cc:2749] T ece3db938bc649d4a40a51522ed5259c P e61c3a8f61bb48f8a963c9480e53c168 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:05:46.891570 22758 consensus_queue.cc:1048] T 3e1f505cb0f1427bbd698ac889d80821 P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
W20260709 13:05:46.892601 19376 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:46.892494 19560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc225c93219c45538b53a1bd3d387e4d" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:05:46.894909 19523 leader_election.cc:304] T 22196caba61445d3bec98a0aab3c337d P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e61c3a8f61bb48f8a963c9480e53c168; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:05:46.895690 22758 raft_consensus.cc:3060] T 22196caba61445d3bec98a0aab3c337d P e61c3a8f61bb48f8a963c9480e53c168 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:05:46.899786 22843 consensus_queue.cc:1059] T 21e14947d70440f19044d8f75c31e1f9 P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:05:46.901446 21926 raft_consensus.cc:3055] T 21e14947d70440f19044d8f75c31e1f9 P e5256d91808b47c195bc9b4dbd7f2b87 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:05:46.901782 21926 raft_consensus.cc:740] T 21e14947d70440f19044d8f75c31e1f9 P e5256d91808b47c195bc9b4dbd7f2b87 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: e5256d91808b47c195bc9b4dbd7f2b87, State: Running, Role: LEADER
I20260709 13:05:46.902573 21926 consensus_queue.cc:260] T 21e14947d70440f19044d8f75c31e1f9 P e5256d91808b47c195bc9b4dbd7f2b87 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:46.903975 21926 raft_consensus.cc:3060] T 21e14947d70440f19044d8f75c31e1f9 P e5256d91808b47c195bc9b4dbd7f2b87 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:05:46.907212 20108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65d8cb8d6ec64f459d5a47cefab10acf" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:05:46.907979 20108 raft_consensus.cc:2368] T 65d8cb8d6ec64f459d5a47cefab10acf P 127766fc592545a4997f7790f50f6076 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e61c3a8f61bb48f8a963c9480e53c168 for earlier term 5. Current term is 6.
I20260709 13:05:46.909060 19377 leader_election.cc:304] T 22196caba61445d3bec98a0aab3c337d P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87; no voters: e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:05:46.910013 22758 raft_consensus.cc:2749] T 22196caba61445d3bec98a0aab3c337d P e61c3a8f61bb48f8a963c9480e53c168 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:05:46.913544 20112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96efeaaf1057492490e9a621f37e1a2d" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:05:46.912635 20108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14935b3ddf914369822e4a0547aaa355" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:05:46.914587 20108 raft_consensus.cc:2393] T 14935b3ddf914369822e4a0547aaa355 P 127766fc592545a4997f7790f50f6076 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e61c3a8f61bb48f8a963c9480e53c168 in current term 8: Already voted for candidate 127766fc592545a4997f7790f50f6076 in this term.
I20260709 13:05:46.915198 20109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "309c3ca0ca4b4f3ba129752ea2cb293b" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:05:46.915822 20109 raft_consensus.cc:2468] T 309c3ca0ca4b4f3ba129752ea2cb293b P 127766fc592545a4997f7790f50f6076 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 7.
I20260709 13:05:46.917809 20076 leader_election.cc:304] T 70797e5783b5454ab0d0eea663e791e3 P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 127766fc592545a4997f7790f50f6076; no voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:05:46.919049 20076 leader_election.cc:304] T 2a16f7501e2444fb86d4e2778e734e02 P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 127766fc592545a4997f7790f50f6076; no voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:05:46.919873 22912 consensus_queue.cc:1059] T 96efeaaf1057492490e9a621f37e1a2d P 127766fc592545a4997f7790f50f6076 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:05:46.920724 22968 raft_consensus.cc:3060] T 70797e5783b5454ab0d0eea663e791e3 P 127766fc592545a4997f7790f50f6076 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:05:46.920869 22916 raft_consensus.cc:3055] T 96efeaaf1057492490e9a621f37e1a2d P 127766fc592545a4997f7790f50f6076 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:05:46.921422 22916 raft_consensus.cc:740] T 96efeaaf1057492490e9a621f37e1a2d P 127766fc592545a4997f7790f50f6076 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 127766fc592545a4997f7790f50f6076, State: Running, Role: LEADER
I20260709 13:05:46.922173 19375 leader_election.cc:304] T 65d8cb8d6ec64f459d5a47cefab10acf P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168; no voters: 127766fc592545a4997f7790f50f6076
W20260709 13:05:46.914558 19294 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet ab43d85f64114d4ebf618930e43d9ed0 with cas_config_opid_index 5: ChangeConfig:REMOVE_PEER failed with leader e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica e61c3a8f61bb48f8a963c9480e53c168 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 8 committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } attrs { replace: true } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } } }
I20260709 13:05:46.913539 20110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48824d5acfbc485ebf8c2d944e7202de" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:05:46.923838 22977 consensus_queue.cc:1059] T 40e1e16737a842ee936002830f36882e P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:05:46.924263 20110 raft_consensus.cc:2468] T 48824d5acfbc485ebf8c2d944e7202de P 127766fc592545a4997f7790f50f6076 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 8.
I20260709 13:05:46.924664 22839 raft_consensus.cc:2804] T 65d8cb8d6ec64f459d5a47cefab10acf P e5256d91808b47c195bc9b4dbd7f2b87 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:05:46.925172 22839 raft_consensus.cc:697] T 65d8cb8d6ec64f459d5a47cefab10acf P e5256d91808b47c195bc9b4dbd7f2b87 [term 6 LEADER]: Becoming Leader. State: Replica: e5256d91808b47c195bc9b4dbd7f2b87, State: Running, Role: LEADER
I20260709 13:05:46.910482 22859 raft_consensus.cc:2804] T 22196caba61445d3bec98a0aab3c337d P e5256d91808b47c195bc9b4dbd7f2b87 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:05:46.925848 22859 raft_consensus.cc:697] T 22196caba61445d3bec98a0aab3c337d P e5256d91808b47c195bc9b4dbd7f2b87 [term 8 LEADER]: Becoming Leader. State: Replica: e5256d91808b47c195bc9b4dbd7f2b87, State: Running, Role: LEADER
I20260709 13:05:46.926107 22839 consensus_queue.cc:237] T 65d8cb8d6ec64f459d5a47cefab10acf P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.5, Last appended by leader: 5, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:05:46.920737 22912 raft_consensus.cc:3060] T 2a16f7501e2444fb86d4e2778e734e02 P 127766fc592545a4997f7790f50f6076 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:05:46.926923 22859 consensus_queue.cc:237] T 22196caba61445d3bec98a0aab3c337d P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:46.932406 19377 leader_election.cc:400] T e381f1d6b8184797ad142de49be225a8 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 6 pre-election: Vote denied by peer 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257) with higher term. Message: Invalid argument: T e381f1d6b8184797ad142de49be225a8 P 0473d2b2d01f4459b1e90fd12cc7840e [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e5256d91808b47c195bc9b4dbd7f2b87 for earlier term 6. Current term is 7.
I20260709 13:05:46.932814 19377 leader_election.cc:403] T e381f1d6b8184797ad142de49be225a8 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 6 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:05:46.925258 22977 raft_consensus.cc:3055] T 40e1e16737a842ee936002830f36882e P e5256d91808b47c195bc9b4dbd7f2b87 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:05:46.934120 19409 raft_consensus.cc:2468] T 14935b3ddf914369822e4a0547aaa355 P e5256d91808b47c195bc9b4dbd7f2b87 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 127766fc592545a4997f7790f50f6076 in term 8.
I20260709 13:05:46.941725 19559 raft_consensus.cc:2468] T 21e14947d70440f19044d8f75c31e1f9 P e61c3a8f61bb48f8a963c9480e53c168 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 8.
I20260709 13:05:46.934414 20076 leader_election.cc:304] T 6c5eebf646ad445a9d1b1adc319d7b16 P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 127766fc592545a4997f7790f50f6076, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:05:46.855373 22821 raft_consensus.cc:3060] T f93ee515a9c14139bf566522ed8232f3 P e5256d91808b47c195bc9b4dbd7f2b87 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:05:46.954514 20076 leader_election.cc:304] T 4af19371ea874c09a0a2147040835cbb P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 127766fc592545a4997f7790f50f6076; no voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:05:46.955942 20108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96efeaaf1057492490e9a621f37e1a2d" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076"
I20260709 13:05:46.960273 19557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df751f992649444090e27965eb1af85d" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:05:46.959117 19553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65d8cb8d6ec64f459d5a47cefab10acf" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:05:46.968545 19553 raft_consensus.cc:2393] T 65d8cb8d6ec64f459d5a47cefab10acf P e61c3a8f61bb48f8a963c9480e53c168 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 127766fc592545a4997f7790f50f6076 in current term 6: Already voted for candidate e5256d91808b47c195bc9b4dbd7f2b87 in this term.
I20260709 13:05:46.961802 19449 leader_election.cc:304] T 22196caba61445d3bec98a0aab3c337d P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87; no voters: 
I20260709 13:05:46.969269 19558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14935b3ddf914369822e4a0547aaa355" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:05:46.969848 19558 raft_consensus.cc:3060] T 14935b3ddf914369822e4a0547aaa355 P e61c3a8f61bb48f8a963c9480e53c168 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:05:46.972211 22968 raft_consensus.cc:2749] T 70797e5783b5454ab0d0eea663e791e3 P 127766fc592545a4997f7790f50f6076 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:05:46.973224 20110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab43d85f64114d4ebf618930e43d9ed0" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 8 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:05:46.974701 19560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b08304a0a02b42d7840c4e8ee9a6bd1a" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:05:46.974380 19552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48824d5acfbc485ebf8c2d944e7202de" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:05:46.967625 19523 leader_election.cc:400] T 65d8cb8d6ec64f459d5a47cefab10acf P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 5 pre-election: Vote denied by peer 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121) with higher term. Message: Invalid argument: T 65d8cb8d6ec64f459d5a47cefab10acf P 127766fc592545a4997f7790f50f6076 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e61c3a8f61bb48f8a963c9480e53c168 for earlier term 5. Current term is 6.
I20260709 13:05:46.975427 19552 raft_consensus.cc:2468] T 48824d5acfbc485ebf8c2d944e7202de P e61c3a8f61bb48f8a963c9480e53c168 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 127766fc592545a4997f7790f50f6076 in term 8.
I20260709 13:05:46.975719 19523 leader_election.cc:403] T 65d8cb8d6ec64f459d5a47cefab10acf P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 5 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:05:46.976835 20104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa731b585f684a7fb2d106c50f143b83" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:05:46.977846 19558 raft_consensus.cc:2468] T 14935b3ddf914369822e4a0547aaa355 P e61c3a8f61bb48f8a963c9480e53c168 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 127766fc592545a4997f7790f50f6076 in term 8.
I20260709 13:05:46.977425 19523 leader_election.cc:304] T 14935b3ddf914369822e4a0547aaa355 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168; no voters: 127766fc592545a4997f7790f50f6076, e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:05:46.979804 19523 leader_election.cc:304] T 48824d5acfbc485ebf8c2d944e7202de P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 127766fc592545a4997f7790f50f6076, e61c3a8f61bb48f8a963c9480e53c168; no voters: 0473d2b2d01f4459b1e90fd12cc7840e
I20260709 13:05:46.981554 20104 raft_consensus.cc:2393] T fa731b585f684a7fb2d106c50f143b83 P 127766fc592545a4997f7790f50f6076 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e61c3a8f61bb48f8a963c9480e53c168 in current term 8: Already voted for candidate 127766fc592545a4997f7790f50f6076 in this term.
I20260709 13:05:46.982225 19554 raft_consensus.cc:1275] T ed7fdbcb96d14d418db9ca90a792588a P e61c3a8f61bb48f8a963c9480e53c168 [term 6 FOLLOWER]: Refusing update from remote peer 0473d2b2d01f4459b1e90fd12cc7840e: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:05:46.982270 19559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76cb037fc9064d13b59a8969d897ce8c" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:05:46.983276 19554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ece3db938bc649d4a40a51522ed5259c" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:05:46.943845 22700 raft_consensus.cc:2804] T 179fd671030940b4b4a4e24bcc4aba0a P e5256d91808b47c195bc9b4dbd7f2b87 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:05:46.985149 19556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "309c3ca0ca4b4f3ba129752ea2cb293b" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:05:46.985297 19407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "309c3ca0ca4b4f3ba129752ea2cb293b" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:05:46.983705 19406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28af091831594f9d8e96482078cc7625" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
I20260709 13:05:46.987185 19556 raft_consensus.cc:2468] T 309c3ca0ca4b4f3ba129752ea2cb293b P e61c3a8f61bb48f8a963c9480e53c168 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 127766fc592545a4997f7790f50f6076 in term 7.
I20260709 13:05:46.985569 19403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "217b5fae677b4971b3bbd2f357a1f7ff" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:05:46.943745 22977 raft_consensus.cc:740] T 40e1e16737a842ee936002830f36882e P e5256d91808b47c195bc9b4dbd7f2b87 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: e5256d91808b47c195bc9b4dbd7f2b87, State: Running, Role: LEADER
I20260709 13:05:46.957196 22965 raft_consensus.cc:2749] T a08760e15aac4630a629431f56024dc8 P 0473d2b2d01f4459b1e90fd12cc7840e [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:05:46.960772 22921 raft_consensus.cc:2764] T 6c5eebf646ad445a9d1b1adc319d7b16 P 127766fc592545a4997f7790f50f6076 [term 7 FOLLOWER]: Leader pre-election decision vote started in defunct term 6: won
I20260709 13:05:47.006711 19551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edd7d470b5014c9489be7f41f64355c9" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:05:46.960427 22845 raft_consensus.cc:2749] T e381f1d6b8184797ad142de49be225a8 P e5256d91808b47c195bc9b4dbd7f2b87 [term 7 FOLLOWER]: Leader pre-election lost for term 6. Reason: Vote denied by peer 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257) with higher term. Message: Invalid argument: T e381f1d6b8184797ad142de49be225a8 P 0473d2b2d01f4459b1e90fd12cc7840e [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e5256d91808b47c195bc9b4dbd7f2b87 for earlier term 6. Current term is 7.
I20260709 13:05:47.019133 22964 raft_consensus.cc:2804] T 22196caba61445d3bec98a0aab3c337d P 0473d2b2d01f4459b1e90fd12cc7840e [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:05:47.019574 22964 raft_consensus.cc:493] T 22196caba61445d3bec98a0aab3c337d P 0473d2b2d01f4459b1e90fd12cc7840e [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:47.019940 22964 raft_consensus.cc:3060] T 22196caba61445d3bec98a0aab3c337d P 0473d2b2d01f4459b1e90fd12cc7840e [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:05:46.955825 22843 raft_consensus.cc:2749] T 14935b3ddf914369822e4a0547aaa355 P e5256d91808b47c195bc9b4dbd7f2b87 [term 8 FOLLOWER]: Leader election lost for term 7. Reason: Vote denied by peer 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121) with higher term. Message: Invalid argument: T 14935b3ddf914369822e4a0547aaa355 P 127766fc592545a4997f7790f50f6076 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate e5256d91808b47c195bc9b4dbd7f2b87 for earlier term 7. Current term is 8.
I20260709 13:05:46.980031 22722 consensus_queue.cc:1059] T 14efcc79969f41babe5529c22d59156d P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 }, Status: INVALID_TERM, Last received: 9.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.047s
W20260709 13:05:47.001597 19374 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:47.007449 19559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14935b3ddf914369822e4a0547aaa355" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:05:47.008185 19402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b74109013a140ada21feeef92d6f563" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:05:47.007422 19551 raft_consensus.cc:3060] T edd7d470b5014c9489be7f41f64355c9 P e61c3a8f61bb48f8a963c9480e53c168 [term 8 FOLLOWER]: Advancing to term 10
W20260709 13:05:47.008275 19377 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.2:46257, user_credentials={real_user=slave}} blocked reactor thread for 75995us
I20260709 13:05:47.008924 19404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40e1e16737a842ee936002830f36882e" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 12 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:05:47.009027 19410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa731b585f684a7fb2d106c50f143b83" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
W20260709 13:05:47.009369 20076 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.3:36891, user_credentials={real_user=slave}} blocked reactor thread for 54933.2us
I20260709 13:05:47.009462 19552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2725d2c4cb054f18b0fc8f735c15f6c2" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:05:47.009692 19408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dc5b3532fe54f74876d02beffa2c230" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:05:47.027215 19408 raft_consensus.cc:2468] T 1dc5b3532fe54f74876d02beffa2c230 P e5256d91808b47c195bc9b4dbd7f2b87 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 8.
I20260709 13:05:46.922312 22916 consensus_queue.cc:260] T 96efeaaf1057492490e9a621f37e1a2d P 127766fc592545a4997f7790f50f6076 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:05:47.010247 19411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65d8cb8d6ec64f459d5a47cefab10acf" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:05:47.010941 20112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9962423cb4e54fcfa5de01daf68a86e7" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:05:47.011219 20104 raft_consensus.cc:1240] T 0afb57ae58a24a01850491d69f0213dd P 127766fc592545a4997f7790f50f6076 [term 9 FOLLOWER]: Rejecting Update request from peer 0473d2b2d01f4459b1e90fd12cc7840e for earlier term 8. Current term is 9. Ops: []
I20260709 13:05:47.011044 22977 consensus_queue.cc:260] T 40e1e16737a842ee936002830f36882e P e5256d91808b47c195bc9b4dbd7f2b87 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 11.6, Last appended by leader: 6, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:47.011792 19403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a61655d99124a29b486ba4a5b37faea" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
I20260709 13:05:47.012039 19405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff75a1d4cb1f493db8f71ddc136ba9ab" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
I20260709 13:05:47.015144 20110 raft_consensus.cc:1240] T 172b3dd13109415a955b71ac0e9d2234 P 127766fc592545a4997f7790f50f6076 [term 8 FOLLOWER]: Rejecting Update request from peer 0473d2b2d01f4459b1e90fd12cc7840e for earlier term 7. Current term is 8. Ops: []
I20260709 13:05:46.980628 22890 raft_consensus.cc:2749] T 65d8cb8d6ec64f459d5a47cefab10acf P e61c3a8f61bb48f8a963c9480e53c168 [term 6 FOLLOWER]: Leader pre-election lost for term 5. Reason: Vote denied by peer 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121) with higher term. Message: Invalid argument: T 65d8cb8d6ec64f459d5a47cefab10acf P 127766fc592545a4997f7790f50f6076 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e61c3a8f61bb48f8a963c9480e53c168 for earlier term 5. Current term is 6.
I20260709 13:05:47.027534 19410 raft_consensus.cc:2468] T fa731b585f684a7fb2d106c50f143b83 P e5256d91808b47c195bc9b4dbd7f2b87 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 8.
I20260709 13:05:47.039618 19405 raft_consensus.cc:2393] T ff75a1d4cb1f493db8f71ddc136ba9ab P e5256d91808b47c195bc9b4dbd7f2b87 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate e61c3a8f61bb48f8a963c9480e53c168 in current term 8: Already voted for candidate e5256d91808b47c195bc9b4dbd7f2b87 in this term.
W20260709 13:05:47.043154 19374 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:46.984745 22946 raft_consensus.cc:2749] T 14935b3ddf914369822e4a0547aaa355 P e61c3a8f61bb48f8a963c9480e53c168 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:05:47.060686 19558 raft_consensus.cc:1240] T 21e14947d70440f19044d8f75c31e1f9 P e61c3a8f61bb48f8a963c9480e53c168 [term 8 FOLLOWER]: Rejecting Update request from peer e5256d91808b47c195bc9b4dbd7f2b87 for earlier term 7. Current term is 8. Ops: []
I20260709 13:05:47.063854 19485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff9b0eddd810459b82d91c60777c10eb" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:05:47.064498 19485 raft_consensus.cc:2468] T ff9b0eddd810459b82d91c60777c10eb P 0473d2b2d01f4459b1e90fd12cc7840e [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 6.
I20260709 13:05:47.064816 19523 leader_election.cc:304] T ab43d85f64114d4ebf618930e43d9ed0 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168; no voters: 127766fc592545a4997f7790f50f6076, e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:05:47.067034 19479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff9b0eddd810459b82d91c60777c10eb" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:05:47.067708 19479 raft_consensus.cc:2468] T ff9b0eddd810459b82d91c60777c10eb P 0473d2b2d01f4459b1e90fd12cc7840e [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 127766fc592545a4997f7790f50f6076 in term 6.
I20260709 13:05:47.067763 22842 raft_consensus.cc:493] T 2b74109013a140ada21feeef92d6f563 P 0473d2b2d01f4459b1e90fd12cc7840e [term 5 FOLLOWER]: Starting pre-election (detected failure of leader e5256d91808b47c195bc9b4dbd7f2b87)
I20260709 13:05:47.068463 22842 raft_consensus.cc:515] T 2b74109013a140ada21feeef92d6f563 P 0473d2b2d01f4459b1e90fd12cc7840e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:47.068799 19486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62c6c134d3d24a1ab144dd9ee6bc3f64" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:05:47.069443 19481 raft_consensus.cc:1240] T 775c229504194560ba9589bc2199b089 P 0473d2b2d01f4459b1e90fd12cc7840e [term 7 FOLLOWER]: Rejecting Update request from peer 127766fc592545a4997f7790f50f6076 for earlier term 6. Current term is 7. Ops: []
I20260709 13:05:47.070200 19477 raft_consensus.cc:1240] T f93ee515a9c14139bf566522ed8232f3 P 0473d2b2d01f4459b1e90fd12cc7840e [term 12 FOLLOWER]: Rejecting Update request from peer e5256d91808b47c195bc9b4dbd7f2b87 for earlier term 11. Current term is 12. Ops: []
I20260709 13:05:47.070662 22896 raft_consensus.cc:493] T ef32ce6fdd0e40d382c79974f30295c6 P 0473d2b2d01f4459b1e90fd12cc7840e [term 9 FOLLOWER]: Starting pre-election (detected failure of leader e5256d91808b47c195bc9b4dbd7f2b87)
I20260709 13:05:47.070873 22898 raft_consensus.cc:2749] T ab43d85f64114d4ebf618930e43d9ed0 P e61c3a8f61bb48f8a963c9480e53c168 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:05:47.071247 19478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e1f505cb0f1427bbd698ac889d80821" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:05:47.071293 22896 raft_consensus.cc:515] T ef32ce6fdd0e40d382c79974f30295c6 P 0473d2b2d01f4459b1e90fd12cc7840e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
W20260709 13:05:47.072045 20076 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.3:36891, user_credentials={real_user=slave}} blocked reactor thread for 44727.8us
I20260709 13:05:47.073096 20076 leader_election.cc:304] T fa731b585f684a7fb2d106c50f143b83 P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 127766fc592545a4997f7790f50f6076; no voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:05:47.073570 22896 leader_election.cc:290] T ef32ce6fdd0e40d382c79974f30295c6 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:05:47.074394 19480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed7fdbcb96d14d418db9ca90a792588a" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:05:46.988847 22700 raft_consensus.cc:493] T 179fd671030940b4b4a4e24bcc4aba0a P e5256d91808b47c195bc9b4dbd7f2b87 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 0473d2b2d01f4459b1e90fd12cc7840e)
I20260709 13:05:47.070551 19482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "309c3ca0ca4b4f3ba129752ea2cb293b" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:05:47.075155 19484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48824d5acfbc485ebf8c2d944e7202de" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:05:47.083654 19554 raft_consensus.cc:1275] T 85c494af21f9457a85da47b9bc70c1fd P e61c3a8f61bb48f8a963c9480e53c168 [term 6 FOLLOWER]: Refusing update from remote peer 127766fc592545a4997f7790f50f6076: Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 13:05:47.086419 19486 raft_consensus.cc:1240] T 28af091831594f9d8e96482078cc7625 P 0473d2b2d01f4459b1e90fd12cc7840e [term 9 FOLLOWER]: Rejecting Update request from peer e5256d91808b47c195bc9b4dbd7f2b87 for earlier term 8. Current term is 9. Ops: []
I20260709 13:05:46.987795 22903 raft_consensus.cc:2749] T 4af19371ea874c09a0a2147040835cbb P 127766fc592545a4997f7790f50f6076 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:05:47.085846 19477 raft_consensus.cc:1240] T df751f992649444090e27965eb1af85d P 0473d2b2d01f4459b1e90fd12cc7840e [term 10 FOLLOWER]: Rejecting Update request from peer e5256d91808b47c195bc9b4dbd7f2b87 for earlier term 9. Current term is 10. Ops: []
I20260709 13:05:46.994076 22974 raft_consensus.cc:2804] T 48824d5acfbc485ebf8c2d944e7202de P e61c3a8f61bb48f8a963c9480e53c168 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:05:47.084192 20112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ec1c4ce15e04c7e8c283a62179f2a64" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076"
I20260709 13:05:47.074596 20076 leader_election.cc:400] T 96efeaaf1057492490e9a621f37e1a2d P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 8 pre-election: Vote denied by peer e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891) with higher term. Message: Invalid argument: T 96efeaaf1057492490e9a621f37e1a2d P e61c3a8f61bb48f8a963c9480e53c168 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 127766fc592545a4997f7790f50f6076 for earlier term 8. Current term is 9.
I20260709 13:05:47.083788 19483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14efcc79969f41babe5529c22d59156d" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:05:47.086581 19485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7be9efa6559648dbb5a0f7684c4542d1" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:05:47.135082 19485 raft_consensus.cc:2410] T 7be9efa6559648dbb5a0f7684c4542d1 P 0473d2b2d01f4459b1e90fd12cc7840e [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e5256d91808b47c195bc9b4dbd7f2b87 for term 10 because replica has last-logged OpId of term: 7 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 5.
I20260709 13:05:47.024150 22722 raft_consensus.cc:3055] T 14efcc79969f41babe5529c22d59156d P 0473d2b2d01f4459b1e90fd12cc7840e [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:05:46.993026 22882 raft_consensus.cc:493] T 3e1f505cb0f1427bbd698ac889d80821 P 0473d2b2d01f4459b1e90fd12cc7840e [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:47.098606 19481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "172b3dd13109415a955b71ac0e9d2234" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
W20260709 13:05:47.131201 19377 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.2:46257, user_credentials={real_user=slave}} blocked reactor thread for 59369.2us
I20260709 13:05:47.132316 19449 leader_election.cc:400] T ff9b0eddd810459b82d91c60777c10eb P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 7 pre-election: Vote denied by peer e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321) with higher term. Message: Invalid argument: T ff9b0eddd810459b82d91c60777c10eb P e5256d91808b47c195bc9b4dbd7f2b87 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0473d2b2d01f4459b1e90fd12cc7840e for earlier term 7. Current term is 8.
I20260709 13:05:47.141307 19449 leader_election.cc:403] T ff9b0eddd810459b82d91c60777c10eb P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 7 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:05:47.139675 19479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff75a1d4cb1f493db8f71ddc136ba9ab" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:05:47.142632 19482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f575b143b844aa096b50997dad3516a" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:05:47.133612 22974 raft_consensus.cc:493] T 48824d5acfbc485ebf8c2d944e7202de P e61c3a8f61bb48f8a963c9480e53c168 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 0473d2b2d01f4459b1e90fd12cc7840e)
I20260709 13:05:47.144595 19486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "179fd671030940b4b4a4e24bcc4aba0a" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:05:47.142784 19479 raft_consensus.cc:2468] T ff75a1d4cb1f493db8f71ddc136ba9ab P 0473d2b2d01f4459b1e90fd12cc7840e [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 8.
I20260709 13:05:47.144595 19405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40e1e16737a842ee936002830f36882e" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 12 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
I20260709 13:05:47.145792 19484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa8650e71aa14778b3d73721fc50d9fc" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:05:47.153780 19559 raft_consensus.cc:2368] T 14935b3ddf914369822e4a0547aaa355 P e61c3a8f61bb48f8a963c9480e53c168 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate e5256d91808b47c195bc9b4dbd7f2b87 for earlier term 7. Current term is 8.
W20260709 13:05:47.149060 19449 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.1:40321, user_credentials={real_user=slave}} blocked reactor thread for 112404us
I20260709 13:05:47.086228 22848 raft_consensus.cc:3055] T 28af091831594f9d8e96482078cc7625 P e5256d91808b47c195bc9b4dbd7f2b87 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:05:47.148160 19402 raft_consensus.cc:1275] T ff75a1d4cb1f493db8f71ddc136ba9ab P e5256d91808b47c195bc9b4dbd7f2b87 [term 8 FOLLOWER]: Refusing update from remote peer e61c3a8f61bb48f8a963c9480e53c168: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:05:47.157240 19480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edd7d470b5014c9489be7f41f64355c9" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 10 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:05:47.076534 22842 leader_election.cc:290] T 2b74109013a140ada21feeef92d6f563 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:05:47.117623 22700 raft_consensus.cc:3060] T 179fd671030940b4b4a4e24bcc4aba0a P e5256d91808b47c195bc9b4dbd7f2b87 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:05:47.166622 19485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14efcc79969f41babe5529c22d59156d" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:05:47.167039 19481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f85fc4b527a48848e5faa083b604e36" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:05:47.153745 22974 raft_consensus.cc:3060] T 48824d5acfbc485ebf8c2d944e7202de P e61c3a8f61bb48f8a963c9480e53c168 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:05:47.167668 19481 raft_consensus.cc:2468] T 1f85fc4b527a48848e5faa083b604e36 P 0473d2b2d01f4459b1e90fd12cc7840e [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 5.
I20260709 13:05:47.167835 19483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "775c229504194560ba9589bc2199b089" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:05:47.157375 22848 raft_consensus.cc:740] T 28af091831594f9d8e96482078cc7625 P e5256d91808b47c195bc9b4dbd7f2b87 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: e5256d91808b47c195bc9b4dbd7f2b87, State: Running, Role: LEADER
I20260709 13:05:47.168615 19483 raft_consensus.cc:2393] T 775c229504194560ba9589bc2199b089 P 0473d2b2d01f4459b1e90fd12cc7840e [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e5256d91808b47c195bc9b4dbd7f2b87 in current term 7: Already voted for candidate 0473d2b2d01f4459b1e90fd12cc7840e in this term.
I20260709 13:05:47.169149 22848 consensus_queue.cc:260] T 28af091831594f9d8e96482078cc7625 P e5256d91808b47c195bc9b4dbd7f2b87 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.4, Last appended by leader: 4, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:47.171000 19484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff9b0eddd810459b82d91c60777c10eb" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:05:47.141208 22722 raft_consensus.cc:740] T 14efcc79969f41babe5529c22d59156d P 0473d2b2d01f4459b1e90fd12cc7840e [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 0473d2b2d01f4459b1e90fd12cc7840e, State: Running, Role: LEADER
I20260709 13:05:47.171974 19479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86a6797bdfe94fa496c050ceae4bd0d9" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 9 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:05:47.172582 22722 consensus_queue.cc:260] T 14efcc79969f41babe5529c22d59156d P 0473d2b2d01f4459b1e90fd12cc7840e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:05:47.158069 19480 raft_consensus.cc:2393] T edd7d470b5014c9489be7f41f64355c9 P 0473d2b2d01f4459b1e90fd12cc7840e [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e5256d91808b47c195bc9b4dbd7f2b87 in current term 10: Already voted for candidate 0473d2b2d01f4459b1e90fd12cc7840e in this term.
I20260709 13:05:47.173897 22722 raft_consensus.cc:3060] T 14efcc79969f41babe5529c22d59156d P 0473d2b2d01f4459b1e90fd12cc7840e [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:05:47.160677 19551 raft_consensus.cc:2468] T edd7d470b5014c9489be7f41f64355c9 P e61c3a8f61bb48f8a963c9480e53c168 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 10.
I20260709 13:05:47.156296 22987 raft_consensus.cc:493] T ef32ce6fdd0e40d382c79974f30295c6 P e5256d91808b47c195bc9b4dbd7f2b87 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:47.175243 19477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "172b3dd13109415a955b71ac0e9d2234" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:05:47.175699 22987 raft_consensus.cc:515] T ef32ce6fdd0e40d382c79974f30295c6 P e5256d91808b47c195bc9b4dbd7f2b87 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:47.176653 22843 consensus_queue.cc:1059] T 5ec1c4ce15e04c7e8c283a62179f2a64 P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:05:47.177347 22843 consensus_queue.cc:1243] T 5ec1c4ce15e04c7e8c283a62179f2a64 P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Peer 0473d2b2d01f4459b1e90fd12cc7840e log is divergent from this leader: its last log entry 6.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 13:05:47.177837 22987 leader_election.cc:290] T ef32ce6fdd0e40d382c79974f30295c6 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:05:47.178658 22843 raft_consensus.cc:3055] T 5ec1c4ce15e04c7e8c283a62179f2a64 P e5256d91808b47c195bc9b4dbd7f2b87 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:05:47.179028 22843 raft_consensus.cc:740] T 5ec1c4ce15e04c7e8c283a62179f2a64 P e5256d91808b47c195bc9b4dbd7f2b87 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: e5256d91808b47c195bc9b4dbd7f2b87, State: Running, Role: LEADER
I20260709 13:05:47.179874 22843 consensus_queue.cc:260] T 5ec1c4ce15e04c7e8c283a62179f2a64 P e5256d91808b47c195bc9b4dbd7f2b87 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:05:47.180923 20104 raft_consensus.cc:1275] T 14efcc79969f41babe5529c22d59156d P 127766fc592545a4997f7790f50f6076 [term 10 FOLLOWER]: Refusing update from remote peer e5256d91808b47c195bc9b4dbd7f2b87: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:05:47.181128 22843 raft_consensus.cc:3060] T 5ec1c4ce15e04c7e8c283a62179f2a64 P e5256d91808b47c195bc9b4dbd7f2b87 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:05:47.080363 22840 raft_consensus.cc:515] T 86a6797bdfe94fa496c050ceae4bd0d9 P 0473d2b2d01f4459b1e90fd12cc7840e [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:47.182793 22700 raft_consensus.cc:515] T 179fd671030940b4b4a4e24bcc4aba0a P e5256d91808b47c195bc9b4dbd7f2b87 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:47.184021 19411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa8650e71aa14778b3d73721fc50d9fc" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
I20260709 13:05:47.184381 22840 leader_election.cc:290] T 86a6797bdfe94fa496c050ceae4bd0d9 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 9 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:05:47.139930 22830 consensus_queue.cc:1048] T 40e1e16737a842ee936002830f36882e P e5256d91808b47c195bc9b4dbd7f2b87 [NON_LEADER]: Connected to new peer: Peer: permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.045s
I20260709 13:05:47.185202 22700 leader_election.cc:290] T 179fd671030940b4b4a4e24bcc4aba0a P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 9 election: Requested vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:05:47.186828 22977 raft_consensus.cc:3060] T 40e1e16737a842ee936002830f36882e P e5256d91808b47c195bc9b4dbd7f2b87 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:05:47.082913 22880 raft_consensus.cc:515] T 7f575b143b844aa096b50997dad3516a P e5256d91808b47c195bc9b4dbd7f2b87 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:47.192579 22880 leader_election.cc:290] T 7f575b143b844aa096b50997dad3516a P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 5 election: Requested vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:05:47.159546 22965 raft_consensus.cc:3060] T ff9b0eddd810459b82d91c60777c10eb P 0473d2b2d01f4459b1e90fd12cc7840e [term 6 FOLLOWER]: Advancing to term 8
I20260709 13:05:47.193708 19406 raft_consensus.cc:1275] T f93ee515a9c14139bf566522ed8232f3 P e5256d91808b47c195bc9b4dbd7f2b87 [term 12 FOLLOWER]: Refusing update from remote peer e61c3a8f61bb48f8a963c9480e53c168: Log matching property violated. Preceding OpId in replica: term: 11 index: 4. Preceding OpId from leader: term: 9 index: 4. (term mismatch)
I20260709 13:05:47.194080 19406 pending_rounds.cc:85] T f93ee515a9c14139bf566522ed8232f3 P e5256d91808b47c195bc9b4dbd7f2b87: Aborting all ops after (but not including) 3
I20260709 13:05:47.194293 19406 pending_rounds.cc:107] T f93ee515a9c14139bf566522ed8232f3 P e5256d91808b47c195bc9b4dbd7f2b87: Aborting uncommitted NO_OP operation due to leader change: 11.4
I20260709 13:05:47.156999 19449 leader_election.cc:304] T 1dc5b3532fe54f74876d02beffa2c230 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e; no voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:05:47.163491 18300 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:05:47.163269 22882 raft_consensus.cc:515] T 3e1f505cb0f1427bbd698ac889d80821 P 0473d2b2d01f4459b1e90fd12cc7840e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:47.202977 22882 leader_election.cc:290] T 3e1f505cb0f1427bbd698ac889d80821 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:05:47.203507 19478 raft_consensus.cc:2468] T 3e1f505cb0f1427bbd698ac889d80821 P 0473d2b2d01f4459b1e90fd12cc7840e [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 9.
I20260709 13:05:47.205256 19405 raft_consensus.cc:1275] T d1e5873a19244c5ebbcd38e126796ee7 P e5256d91808b47c195bc9b4dbd7f2b87 [term 11 FOLLOWER]: Refusing update from remote peer e61c3a8f61bb48f8a963c9480e53c168: Log matching property violated. Preceding OpId in replica: term: 10 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 13:05:47.205760 19523 leader_election.cc:304] T 309c3ca0ca4b4f3ba129752ea2cb293b P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 127766fc592545a4997f7790f50f6076, e61c3a8f61bb48f8a963c9480e53c168; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:05:47.206997 19523 leader_election.cc:304] T 217b5fae677b4971b3bbd2f357a1f7ff P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e61c3a8f61bb48f8a963c9480e53c168; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:05:47.208573 19523 leader_election.cc:304] T fa731b585f684a7fb2d106c50f143b83 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168; no voters: 127766fc592545a4997f7790f50f6076
I20260709 13:05:47.210867 22890 raft_consensus.cc:2749] T 309c3ca0ca4b4f3ba129752ea2cb293b P e61c3a8f61bb48f8a963c9480e53c168 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:05:47.211627 22890 raft_consensus.cc:2749] T 217b5fae677b4971b3bbd2f357a1f7ff P e61c3a8f61bb48f8a963c9480e53c168 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:05:47.212234 22890 raft_consensus.cc:2764] T fa731b585f684a7fb2d106c50f143b83 P e61c3a8f61bb48f8a963c9480e53c168 [term 8 FOLLOWER]: Leader pre-election decision vote started in defunct term 7: won
I20260709 13:05:47.213248 22848 raft_consensus.cc:3060] T 28af091831594f9d8e96482078cc7625 P e5256d91808b47c195bc9b4dbd7f2b87 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:05:47.216809 19556 raft_consensus.cc:1240] T 28af091831594f9d8e96482078cc7625 P e61c3a8f61bb48f8a963c9480e53c168 [term 9 LEADER]: Rejecting Update request from peer e5256d91808b47c195bc9b4dbd7f2b87 for earlier term 8. Current term is 9. Ops: []
I20260709 13:05:47.194528 19406 raft_consensus.cc:2889] T f93ee515a9c14139bf566522ed8232f3 P e5256d91808b47c195bc9b4dbd7f2b87 [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:05:47.217867 19479 raft_consensus.cc:2393] T 86a6797bdfe94fa496c050ceae4bd0d9 P 0473d2b2d01f4459b1e90fd12cc7840e [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e5256d91808b47c195bc9b4dbd7f2b87 in current term 9: Already voted for candidate 0473d2b2d01f4459b1e90fd12cc7840e in this term.
I20260709 13:05:47.074851 22968 raft_consensus.cc:2749] T fa731b585f684a7fb2d106c50f143b83 P 127766fc592545a4997f7790f50f6076 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:05:47.225198 19375 leader_election.cc:400] T 14935b3ddf914369822e4a0547aaa355 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 7 election: Vote denied by peer e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891) with higher term. Message: Invalid argument: T 14935b3ddf914369822e4a0547aaa355 P e61c3a8f61bb48f8a963c9480e53c168 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate e5256d91808b47c195bc9b4dbd7f2b87 for earlier term 7. Current term is 8.
W20260709 13:05:47.227751 19449 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.1:40321, user_credentials={real_user=slave}} blocked reactor thread for 70810.9us
I20260709 13:05:47.230584 19554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "179fd671030940b4b4a4e24bcc4aba0a" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:05:47.210317 22964 raft_consensus.cc:515] T 22196caba61445d3bec98a0aab3c337d P 0473d2b2d01f4459b1e90fd12cc7840e [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:47.162635 22916 raft_consensus.cc:3060] T 96efeaaf1057492490e9a621f37e1a2d P 127766fc592545a4997f7790f50f6076 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:05:47.236413 19559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f575b143b844aa096b50997dad3516a" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:05:47.233600 19477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2725d2c4cb054f18b0fc8f735c15f6c2" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:05:47.238466 19477 raft_consensus.cc:3060] T 2725d2c4cb054f18b0fc8f735c15f6c2 P 0473d2b2d01f4459b1e90fd12cc7840e [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:05:47.244181 19556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef32ce6fdd0e40d382c79974f30295c6" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:05:47.245138 19556 raft_consensus.cc:2468] T ef32ce6fdd0e40d382c79974f30295c6 P e61c3a8f61bb48f8a963c9480e53c168 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 10.
I20260709 13:05:47.244431 19478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab43d85f64114d4ebf618930e43d9ed0" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:05:47.246402 19478 raft_consensus.cc:2468] T ab43d85f64114d4ebf618930e43d9ed0 P 0473d2b2d01f4459b1e90fd12cc7840e [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 8.
I20260709 13:05:47.249336 22964 leader_election.cc:290] T 22196caba61445d3bec98a0aab3c337d P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 9 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:05:47.251624 22978 raft_consensus.cc:515] T 46c5bfeecc314717bffe987e6844b6d0 P 0473d2b2d01f4459b1e90fd12cc7840e [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:47.253312 19449 leader_election.cc:304] T 2e36a9d6e29c4a7c860cf267efbd4c74 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87; no voters: e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:05:47.254952 22961 raft_consensus.cc:2804] T 2e36a9d6e29c4a7c860cf267efbd4c74 P 0473d2b2d01f4459b1e90fd12cc7840e [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:05:47.227397 22882 raft_consensus.cc:3060] T 1dc5b3532fe54f74876d02beffa2c230 P 0473d2b2d01f4459b1e90fd12cc7840e [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:05:47.256273 22840 consensus_queue.cc:1059] T 172b3dd13109415a955b71ac0e9d2234 P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:05:47.257367 22840 raft_consensus.cc:3055] T 172b3dd13109415a955b71ac0e9d2234 P 0473d2b2d01f4459b1e90fd12cc7840e [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:05:47.257757 22840 raft_consensus.cc:740] T 172b3dd13109415a955b71ac0e9d2234 P 0473d2b2d01f4459b1e90fd12cc7840e [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 0473d2b2d01f4459b1e90fd12cc7840e, State: Running, Role: LEADER
W20260709 13:05:47.262979 20076 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.3:36891, user_credentials={real_user=slave}} blocked reactor thread for 188527us
I20260709 13:05:47.264009 20076 leader_election.cc:304] T 0afb57ae58a24a01850491d69f0213dd P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 127766fc592545a4997f7790f50f6076; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:05:47.278213 19477 raft_consensus.cc:2468] T 2725d2c4cb054f18b0fc8f735c15f6c2 P 0473d2b2d01f4459b1e90fd12cc7840e [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 10.
I20260709 13:05:47.290091 19406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edd7d470b5014c9489be7f41f64355c9" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:05:47.290100 19480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14935b3ddf914369822e4a0547aaa355" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:05:47.291790 19480 raft_consensus.cc:2393] T 14935b3ddf914369822e4a0547aaa355 P 0473d2b2d01f4459b1e90fd12cc7840e [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate e5256d91808b47c195bc9b4dbd7f2b87 in current term 7: Already voted for candidate 0473d2b2d01f4459b1e90fd12cc7840e in this term.
I20260709 13:05:47.224195 22972 consensus_queue.cc:1048] T 14efcc79969f41babe5529c22d59156d P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Connected to new peer: Peer: permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.061s
W20260709 13:05:47.316695 19449 connection.cc:256] RPC call timeout handler was delayed by -1.1666277150000042s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.22200000000000003s for a response
I20260709 13:05:47.322319 19479 raft_consensus.cc:1240] T 76cb037fc9064d13b59a8969d897ce8c P 0473d2b2d01f4459b1e90fd12cc7840e [term 8 FOLLOWER]: Rejecting Update request from peer e5256d91808b47c195bc9b4dbd7f2b87 for earlier term 7. Current term is 8. Ops: []
I20260709 13:05:47.290767 19406 raft_consensus.cc:2468] T edd7d470b5014c9489be7f41f64355c9 P e5256d91808b47c195bc9b4dbd7f2b87 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 9.
W20260709 13:05:47.317203 20076 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.3:36891, user_credentials={real_user=slave}} blocked reactor thread for 53266.9us
I20260709 13:05:47.254544 22978 leader_election.cc:290] T 46c5bfeecc314717bffe987e6844b6d0 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 15 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:05:47.320289 20109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed7fdbcb96d14d418db9ca90a792588a" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076"
I20260709 13:05:47.229166 22979 consensus_queue.cc:1048] T ff75a1d4cb1f493db8f71ddc136ba9ab P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.069s
I20260709 13:05:47.255352 22961 raft_consensus.cc:493] T 2e36a9d6e29c4a7c860cf267efbd4c74 P 0473d2b2d01f4459b1e90fd12cc7840e [term 6 FOLLOWER]: Starting leader election (detected failure of leader e5256d91808b47c195bc9b4dbd7f2b87)
I20260709 13:05:47.336406 19480 raft_consensus.cc:1240] T b08304a0a02b42d7840c4e8ee9a6bd1a P 0473d2b2d01f4459b1e90fd12cc7840e [term 11 FOLLOWER]: Rejecting Update request from peer e5256d91808b47c195bc9b4dbd7f2b87 for earlier term 10. Current term is 11. Ops: []
I20260709 13:05:47.339141 19406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e1f505cb0f1427bbd698ac889d80821" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:05:47.340366 19408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "775c229504194560ba9589bc2199b089" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
I20260709 13:05:47.340595 20107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "775c229504194560ba9589bc2199b089" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076"
I20260709 13:05:47.341377 19405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edd7d470b5014c9489be7f41f64355c9" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
I20260709 13:05:47.403057 19405 raft_consensus.cc:3060] T edd7d470b5014c9489be7f41f64355c9 P e5256d91808b47c195bc9b4dbd7f2b87 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:05:47.288693 22921 raft_consensus.cc:493] T 1efebf73c86e432baa55533136b6e12c P 127766fc592545a4997f7790f50f6076 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:47.341935 20109 raft_consensus.cc:2393] T ed7fdbcb96d14d418db9ca90a792588a P 127766fc592545a4997f7790f50f6076 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 0473d2b2d01f4459b1e90fd12cc7840e in current term 6: Already voted for candidate 127766fc592545a4997f7790f50f6076 in this term.
I20260709 13:05:47.373979 19411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b08304a0a02b42d7840c4e8ee9a6bd1a" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:05:47.289105 22912 raft_consensus.cc:2749] T 2a16f7501e2444fb86d4e2778e734e02 P 127766fc592545a4997f7790f50f6076 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:05:47.288488 22968 raft_consensus.cc:2749] T 0afb57ae58a24a01850491d69f0213dd P 127766fc592545a4997f7790f50f6076 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:05:47.376019 22988 log.cc:927] Time spent T 65d8cb8d6ec64f459d5a47cefab10acf P e5256d91808b47c195bc9b4dbd7f2b87: Append to log took a long time: real 0.220s	user 0.001s	sys 0.000s
I20260709 13:05:47.374044 19479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef32ce6fdd0e40d382c79974f30295c6" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:05:47.447923 19479 raft_consensus.cc:2468] T ef32ce6fdd0e40d382c79974f30295c6 P 0473d2b2d01f4459b1e90fd12cc7840e [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 9.
I20260709 13:05:47.293013 22890 consensus_queue.cc:1048] T d1e5873a19244c5ebbcd38e126796ee7 P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.094s
W20260709 13:05:47.384752 19375 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:47.448781 22890 consensus_queue.cc:1243] T d1e5873a19244c5ebbcd38e126796ee7 P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Peer e5256d91808b47c195bc9b4dbd7f2b87 log is divergent from this leader: its last log entry 10.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 13:05:47.450029 19375 leader_election.cc:304] T ef32ce6fdd0e40d382c79974f30295c6 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:05:47.438007 19480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f575b143b844aa096b50997dad3516a" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:05:47.451247 19477 raft_consensus.cc:1275] T 14efcc79969f41babe5529c22d59156d P 0473d2b2d01f4459b1e90fd12cc7840e [term 10 FOLLOWER]: Refusing update from remote peer e5256d91808b47c195bc9b4dbd7f2b87: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:05:47.451773 22987 raft_consensus.cc:2804] T ef32ce6fdd0e40d382c79974f30295c6 P e5256d91808b47c195bc9b4dbd7f2b87 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:05:47.452239 22987 raft_consensus.cc:493] T ef32ce6fdd0e40d382c79974f30295c6 P e5256d91808b47c195bc9b4dbd7f2b87 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:47.443504 19478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "179fd671030940b4b4a4e24bcc4aba0a" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:05:47.452618 22987 raft_consensus.cc:3060] T ef32ce6fdd0e40d382c79974f30295c6 P e5256d91808b47c195bc9b4dbd7f2b87 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:05:47.446651 22921 raft_consensus.cc:515] T 1efebf73c86e432baa55533136b6e12c P 127766fc592545a4997f7790f50f6076 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:05:47.409765 22961 raft_consensus.cc:3060] T 2e36a9d6e29c4a7c860cf267efbd4c74 P 0473d2b2d01f4459b1e90fd12cc7840e [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:05:47.455380 19559 raft_consensus.cc:1275] T 22196caba61445d3bec98a0aab3c337d P e61c3a8f61bb48f8a963c9480e53c168 [term 8 FOLLOWER]: Refusing update from remote peer e5256d91808b47c195bc9b4dbd7f2b87: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 13:05:47.455576 19551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef32ce6fdd0e40d382c79974f30295c6" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:05:47.456387 19551 raft_consensus.cc:2393] T ef32ce6fdd0e40d382c79974f30295c6 P e61c3a8f61bb48f8a963c9480e53c168 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0473d2b2d01f4459b1e90fd12cc7840e in current term 10: Already voted for candidate e61c3a8f61bb48f8a963c9480e53c168 in this term.
I20260709 13:05:47.273259 22840 consensus_queue.cc:260] T 172b3dd13109415a955b71ac0e9d2234 P 0473d2b2d01f4459b1e90fd12cc7840e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:05:47.446430 19408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86a6797bdfe94fa496c050ceae4bd0d9" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
I20260709 13:05:47.483553 19403 raft_consensus.cc:2468] T 1a61655d99124a29b486ba4a5b37faea P e5256d91808b47c195bc9b4dbd7f2b87 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 7.
I20260709 13:05:47.490926 20110 raft_consensus.cc:1275] T ed7fdbcb96d14d418db9ca90a792588a P 127766fc592545a4997f7790f50f6076 [term 6 FOLLOWER]: Refusing update from remote peer 0473d2b2d01f4459b1e90fd12cc7840e: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
W20260709 13:05:47.491793 19377 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.2:46257, user_credentials={real_user=slave}} blocked reactor thread for 161641us
I20260709 13:05:47.511060 19552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b74109013a140ada21feeef92d6f563" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:05:47.517868 19551 raft_consensus.cc:1275] T 65d8cb8d6ec64f459d5a47cefab10acf P e61c3a8f61bb48f8a963c9480e53c168 [term 6 FOLLOWER]: Refusing update from remote peer e5256d91808b47c195bc9b4dbd7f2b87: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 6 index: 6. (index mismatch)
I20260709 13:05:47.400671 22758 consensus_queue.cc:1048] T f93ee515a9c14139bf566522ed8232f3 P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.120s
W20260709 13:05:47.520459 20076 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.3:36891, user_credentials={real_user=slave}} blocked reactor thread for 182880us
I20260709 13:05:47.523025 20076 leader_election.cc:304] T 833a2f0775ed407a94b8924ce50adb63 P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 127766fc592545a4997f7790f50f6076, e61c3a8f61bb48f8a963c9480e53c168; no voters: e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:05:47.521929 19408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef32ce6fdd0e40d382c79974f30295c6" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
W20260709 13:05:47.522200 20078 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.2:46257, user_credentials={real_user=slave}} blocked reactor thread for 105326us
I20260709 13:05:47.521307 19411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b74109013a140ada21feeef92d6f563" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:05:47.527220 20076 leader_election.cc:304] T 48824d5acfbc485ebf8c2d944e7202de P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 127766fc592545a4997f7790f50f6076, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
W20260709 13:05:47.523425 22967 consensus_meta.cc:287] T 0afb57ae58a24a01850491d69f0213dd P 0473d2b2d01f4459b1e90fd12cc7840e: Time spent flushing consensus metadata: real 0.682s	user 0.004s	sys 0.008s
W20260709 13:05:47.526975 19523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.1:40321, user_credentials={real_user=slave}} blocked reactor thread for 243161us
I20260709 13:05:47.538053 19411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46c5bfeecc314717bffe987e6844b6d0" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 15 candidate_status { last_received { term: 13 index: 5 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
I20260709 13:05:47.538851 19411 raft_consensus.cc:3060] T 46c5bfeecc314717bffe987e6844b6d0 P e5256d91808b47c195bc9b4dbd7f2b87 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:05:47.545120 19406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22196caba61445d3bec98a0aab3c337d" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
I20260709 13:05:47.528723 22840 raft_consensus.cc:3060] T 172b3dd13109415a955b71ac0e9d2234 P 0473d2b2d01f4459b1e90fd12cc7840e [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:05:47.550418 19523 leader_election.cc:304] T 1a61655d99124a29b486ba4a5b37faea P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:05:47.529001 22965 raft_consensus.cc:2749] T ff9b0eddd810459b82d91c60777c10eb P 0473d2b2d01f4459b1e90fd12cc7840e [term 8 FOLLOWER]: Leader pre-election lost for term 7. Reason: Vote denied by peer e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321) with higher term. Message: Invalid argument: T ff9b0eddd810459b82d91c60777c10eb P e5256d91808b47c195bc9b4dbd7f2b87 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0473d2b2d01f4459b1e90fd12cc7840e for earlier term 7. Current term is 8.
W20260709 13:05:47.566694 19374 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:47.526376 22903 consensus_queue.cc:1048] T ab43d85f64114d4ebf618930e43d9ed0 P 127766fc592545a4997f7790f50f6076 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.029s
W20260709 13:05:47.557861 22994 log.cc:927] Time spent T 22196caba61445d3bec98a0aab3c337d P e5256d91808b47c195bc9b4dbd7f2b87: Append to log took a long time: real 0.069s	user 0.001s	sys 0.001s
I20260709 13:05:47.582280 20112 raft_consensus.cc:1275] T 172b3dd13109415a955b71ac0e9d2234 P 127766fc592545a4997f7790f50f6076 [term 8 FOLLOWER]: Refusing update from remote peer e5256d91808b47c195bc9b4dbd7f2b87: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
W20260709 13:05:47.585186 20076 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.3:36891, user_credentials={real_user=slave}} blocked reactor thread for 58023.1us
I20260709 13:05:47.585944 20076 leader_election.cc:304] T 14935b3ddf914369822e4a0547aaa355 P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 127766fc592545a4997f7790f50f6076, e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
W20260709 13:05:47.580495 22992 log.cc:927] Time spent T f1b10566f45d4a7d9029858330e02d5b P e61c3a8f61bb48f8a963c9480e53c168: Append to log took a long time: real 0.180s	user 0.000s	sys 0.001s
I20260709 13:05:47.568809 22898 raft_consensus.cc:2804] T 1a61655d99124a29b486ba4a5b37faea P e61c3a8f61bb48f8a963c9480e53c168 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:05:47.582012 22978 raft_consensus.cc:493] T 28af091831594f9d8e96482078cc7625 P 0473d2b2d01f4459b1e90fd12cc7840e [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:47.590121 19405 raft_consensus.cc:2468] T edd7d470b5014c9489be7f41f64355c9 P e5256d91808b47c195bc9b4dbd7f2b87 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 10.
I20260709 13:05:47.589411 22912 raft_consensus.cc:2804] T 48824d5acfbc485ebf8c2d944e7202de P 127766fc592545a4997f7790f50f6076 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:05:47.602821 22912 raft_consensus.cc:493] T 48824d5acfbc485ebf8c2d944e7202de P 127766fc592545a4997f7790f50f6076 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 0473d2b2d01f4459b1e90fd12cc7840e)
I20260709 13:05:47.603286 22912 raft_consensus.cc:3060] T 48824d5acfbc485ebf8c2d944e7202de P 127766fc592545a4997f7790f50f6076 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:05:47.604858 20108 raft_consensus.cc:2410] T 96efeaaf1057492490e9a621f37e1a2d P 127766fc592545a4997f7790f50f6076 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate e61c3a8f61bb48f8a963c9480e53c168 for term 9 because replica has last-logged OpId of term: 8 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 7.
W20260709 13:05:47.600488 20077 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:05:47.609331 22996 log.cc:927] Time spent T 86a6797bdfe94fa496c050ceae4bd0d9 P e5256d91808b47c195bc9b4dbd7f2b87: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
I20260709 13:05:47.598102 22978 raft_consensus.cc:515] T 28af091831594f9d8e96482078cc7625 P 0473d2b2d01f4459b1e90fd12cc7840e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:47.612782 22978 leader_election.cc:290] T 28af091831594f9d8e96482078cc7625 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
W20260709 13:05:47.601135 22991 log.cc:927] Time spent T b08304a0a02b42d7840c4e8ee9a6bd1a P e5256d91808b47c195bc9b4dbd7f2b87: Append to log took a long time: real 0.129s	user 0.001s	sys 0.000s
I20260709 13:05:47.610824 19477 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "28af091831594f9d8e96482078cc7625"
dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
mode: GRACEFUL
new_leader_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
 from {username='slave'} at 127.0.0.1:48168
I20260709 13:05:47.615584 19407 raft_consensus.cc:1240] T 2725d2c4cb054f18b0fc8f735c15f6c2 P e5256d91808b47c195bc9b4dbd7f2b87 [term 10 FOLLOWER]: Rejecting Update request from peer e61c3a8f61bb48f8a963c9480e53c168 for earlier term 9. Current term is 10. Ops: []
I20260709 13:05:47.617151 19477 raft_consensus.cc:606] T 28af091831594f9d8e96482078cc7625 P 0473d2b2d01f4459b1e90fd12cc7840e [term 9 FOLLOWER]: Received request to transfer leadership to TS e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:05:47.617511 19477 raft_consensus.cc:614] T 28af091831594f9d8e96482078cc7625 P 0473d2b2d01f4459b1e90fd12cc7840e [term 9 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 13:05:47.591060 19449 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.4:43121, user_credentials={real_user=slave}} blocked reactor thread for 255891us
I20260709 13:05:47.618460 20076 leader_election.cc:304] T 309c3ca0ca4b4f3ba129752ea2cb293b P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 127766fc592545a4997f7790f50f6076, e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:05:47.619438 22916 raft_consensus.cc:2804] T 14935b3ddf914369822e4a0547aaa355 P 127766fc592545a4997f7790f50f6076 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:05:47.619952 22916 raft_consensus.cc:697] T 14935b3ddf914369822e4a0547aaa355 P 127766fc592545a4997f7790f50f6076 [term 8 LEADER]: Becoming Leader. State: Replica: 127766fc592545a4997f7790f50f6076, State: Running, Role: LEADER
I20260709 13:05:47.620873 22916 consensus_queue.cc:237] T 14935b3ddf914369822e4a0547aaa355 P 127766fc592545a4997f7790f50f6076 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.6, Last appended by leader: 6, Current term: 8, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } attrs { replace: true } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:05:47.589790 22921 leader_election.cc:290] T 1efebf73c86e432baa55533136b6e12c P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:05:47.588918 22999 raft_consensus.cc:2804] T 833a2f0775ed407a94b8924ce50adb63 P 127766fc592545a4997f7790f50f6076 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:05:47.632521 19484 raft_consensus.cc:2468] T ff9b0eddd810459b82d91c60777c10eb P 0473d2b2d01f4459b1e90fd12cc7840e [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 8.
I20260709 13:05:47.634992 19405 pending_rounds.cc:85] T d1e5873a19244c5ebbcd38e126796ee7 P e5256d91808b47c195bc9b4dbd7f2b87: Aborting all ops after (but not including) 4
I20260709 13:05:47.635468 19405 pending_rounds.cc:107] T d1e5873a19244c5ebbcd38e126796ee7 P e5256d91808b47c195bc9b4dbd7f2b87: Aborting uncommitted NO_OP operation due to leader change: 10.5
I20260709 13:05:47.635784 19405 raft_consensus.cc:2889] T d1e5873a19244c5ebbcd38e126796ee7 P e5256d91808b47c195bc9b4dbd7f2b87 [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:05:47.636803 20076 leader_election.cc:304] T ece3db938bc649d4a40a51522ed5259c P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 127766fc592545a4997f7790f50f6076; no voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:05:47.641772 22882 raft_consensus.cc:2749] T 1dc5b3532fe54f74876d02beffa2c230 P 0473d2b2d01f4459b1e90fd12cc7840e [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:05:47.641749 22912 raft_consensus.cc:515] T 48824d5acfbc485ebf8c2d944e7202de P 127766fc592545a4997f7790f50f6076 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:05:47.645562 19404 raft_consensus.cc:2410] T 40e1e16737a842ee936002830f36882e P e5256d91808b47c195bc9b4dbd7f2b87 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e61c3a8f61bb48f8a963c9480e53c168 for term 12 because replica has last-logged OpId of term: 11 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 5.
W20260709 13:05:47.649968 19449 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:47.660444 19409 raft_consensus.cc:1275] T 28af091831594f9d8e96482078cc7625 P e5256d91808b47c195bc9b4dbd7f2b87 [term 9 FOLLOWER]: Refusing update from remote peer e61c3a8f61bb48f8a963c9480e53c168: Log matching property violated. Preceding OpId in replica: term: 8 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 13:05:47.668579 20076 leader_election.cc:304] T 65d8cb8d6ec64f459d5a47cefab10acf P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 127766fc592545a4997f7790f50f6076; no voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:05:47.671288 19553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1efebf73c86e432baa55533136b6e12c" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:05:47.671921 19553 raft_consensus.cc:2468] T 1efebf73c86e432baa55533136b6e12c P e61c3a8f61bb48f8a963c9480e53c168 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 127766fc592545a4997f7790f50f6076 in term 6.
I20260709 13:05:47.633555 22999 raft_consensus.cc:493] T 833a2f0775ed407a94b8924ce50adb63 P 127766fc592545a4997f7790f50f6076 [term 7 FOLLOWER]: Starting leader election (detected failure of leader e5256d91808b47c195bc9b4dbd7f2b87)
I20260709 13:05:47.676896 22912 leader_election.cc:290] T 48824d5acfbc485ebf8c2d944e7202de P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 9 election: Requested vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:05:47.648510 22961 raft_consensus.cc:515] T 2e36a9d6e29c4a7c860cf267efbd4c74 P 0473d2b2d01f4459b1e90fd12cc7840e [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:47.651249 22968 raft_consensus.cc:2749] T ece3db938bc649d4a40a51522ed5259c P 127766fc592545a4997f7790f50f6076 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:05:47.659130 22921 raft_consensus.cc:2804] T 309c3ca0ca4b4f3ba129752ea2cb293b P 127766fc592545a4997f7790f50f6076 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:05:47.687315 23006 consensus_queue.cc:1048] T 85c494af21f9457a85da47b9bc70c1fd P 127766fc592545a4997f7790f50f6076 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.011s
I20260709 13:05:47.700139 22921 raft_consensus.cc:493] T 309c3ca0ca4b4f3ba129752ea2cb293b P 127766fc592545a4997f7790f50f6076 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 0473d2b2d01f4459b1e90fd12cc7840e)
I20260709 13:05:47.700652 22921 raft_consensus.cc:3060] T 309c3ca0ca4b4f3ba129752ea2cb293b P 127766fc592545a4997f7790f50f6076 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:05:47.673507 22903 raft_consensus.cc:2749] T 65d8cb8d6ec64f459d5a47cefab10acf P 127766fc592545a4997f7790f50f6076 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:05:47.709823 19411 raft_consensus.cc:2468] T 46c5bfeecc314717bffe987e6844b6d0 P e5256d91808b47c195bc9b4dbd7f2b87 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 15.
I20260709 13:05:47.683859 22999 raft_consensus.cc:3060] T 833a2f0775ed407a94b8924ce50adb63 P 127766fc592545a4997f7790f50f6076 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:05:47.684201 22896 raft_consensus.cc:493] T b9f0d59553ad444883fcf5b5909f9798 P 0473d2b2d01f4459b1e90fd12cc7840e [term 8 FOLLOWER]: Starting pre-election (detected failure of leader e61c3a8f61bb48f8a963c9480e53c168)
I20260709 13:05:47.722762 19449 leader_election.cc:304] T 0e1085d23e8347fbbd5bce7542f4b1f4 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e; no voters: 127766fc592545a4997f7790f50f6076, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:05:47.724826 22965 raft_consensus.cc:2749] T 0e1085d23e8347fbbd5bce7542f4b1f4 P 0473d2b2d01f4459b1e90fd12cc7840e [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 13:05:47.732549 19376 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:47.734730 19406 raft_consensus.cc:1240] T 179fd671030940b4b4a4e24bcc4aba0a P e5256d91808b47c195bc9b4dbd7f2b87 [term 9 FOLLOWER]: Rejecting Update request from peer 0473d2b2d01f4459b1e90fd12cc7840e for earlier term 8. Current term is 9. Ops: []
I20260709 13:05:47.736030 19450 leader_election.cc:304] T 1a61655d99124a29b486ba4a5b37faea P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e; no voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:05:47.743172 19450 leader_election.cc:304] T 7be9efa6559648dbb5a0f7684c4542d1 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, 127766fc592545a4997f7790f50f6076, e61c3a8f61bb48f8a963c9480e53c168; no voters: e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:05:47.716159 22898 raft_consensus.cc:697] T 1a61655d99124a29b486ba4a5b37faea P e61c3a8f61bb48f8a963c9480e53c168 [term 7 LEADER]: Becoming Leader. State: Replica: e61c3a8f61bb48f8a963c9480e53c168, State: Running, Role: LEADER
I20260709 13:05:47.752094 19558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86a6797bdfe94fa496c050ceae4bd0d9" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:05:47.713631 22978 consensus_queue.cc:1059] T 1efebf73c86e432baa55533136b6e12c P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.033s
W20260709 13:05:47.748776 22974 consensus_meta.cc:287] T 48824d5acfbc485ebf8c2d944e7202de P e61c3a8f61bb48f8a963c9480e53c168: Time spent flushing consensus metadata: real 0.579s	user 0.006s	sys 0.004s
I20260709 13:05:47.769541 19449 leader_election.cc:304] T 1f85fc4b527a48848e5faa083b604e36 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e; no voters: 127766fc592545a4997f7790f50f6076, e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:05:47.770041 19484 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2b74109013a140ada21feeef92d6f563"
dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
mode: GRACEFUL
new_leader_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
 from {username='slave'} at 127.0.0.1:48168
I20260709 13:05:47.778421 19484 raft_consensus.cc:606] T 2b74109013a140ada21feeef92d6f563 P 0473d2b2d01f4459b1e90fd12cc7840e [term 5 FOLLOWER]: Received request to transfer leadership to TS e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:05:47.746475 22722 raft_consensus.cc:3060] T 1a61655d99124a29b486ba4a5b37faea P 0473d2b2d01f4459b1e90fd12cc7840e [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:05:47.778816 19484 raft_consensus.cc:614] T 2b74109013a140ada21feeef92d6f563 P 0473d2b2d01f4459b1e90fd12cc7840e [term 5 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:05:47.779541 19558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e1f505cb0f1427bbd698ac889d80821" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:05:47.748127 22977 raft_consensus.cc:493] T 309c3ca0ca4b4f3ba129752ea2cb293b P e5256d91808b47c195bc9b4dbd7f2b87 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 0473d2b2d01f4459b1e90fd12cc7840e)
W20260709 13:05:47.772157 19374 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:47.775097 20108 raft_consensus.cc:1275] T 65d8cb8d6ec64f459d5a47cefab10acf P 127766fc592545a4997f7790f50f6076 [term 6 FOLLOWER]: Refusing update from remote peer e5256d91808b47c195bc9b4dbd7f2b87: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 6 index: 6. (index mismatch)
I20260709 13:05:47.775403 22978 raft_consensus.cc:3055] T 1efebf73c86e432baa55533136b6e12c P 0473d2b2d01f4459b1e90fd12cc7840e [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:05:47.725694 22896 raft_consensus.cc:515] T b9f0d59553ad444883fcf5b5909f9798 P 0473d2b2d01f4459b1e90fd12cc7840e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:47.788130 20078 leader_election.cc:304] T ed7fdbcb96d14d418db9ca90a792588a P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 127766fc592545a4997f7790f50f6076; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:05:47.786749 19377 leader_election.cc:304] T 7be9efa6559648dbb5a0f7684c4542d1 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:05:47.790861 22964 raft_consensus.cc:2749] T 1f85fc4b527a48848e5faa083b604e36 P 0473d2b2d01f4459b1e90fd12cc7840e [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:05:47.790791 22977 raft_consensus.cc:515] T 309c3ca0ca4b4f3ba129752ea2cb293b P e5256d91808b47c195bc9b4dbd7f2b87 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } attrs { replace: true } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:05:47.794837 22912 consensus_queue.cc:1059] T 775c229504194560ba9589bc2199b089 P 127766fc592545a4997f7790f50f6076 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:05:47.795883 22912 raft_consensus.cc:3055] T 775c229504194560ba9589bc2199b089 P 127766fc592545a4997f7790f50f6076 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:05:47.781558 22965 raft_consensus.cc:2804] T 7be9efa6559648dbb5a0f7684c4542d1 P 0473d2b2d01f4459b1e90fd12cc7840e [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:05:47.796634 22965 raft_consensus.cc:493] T 7be9efa6559648dbb5a0f7684c4542d1 P 0473d2b2d01f4459b1e90fd12cc7840e [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:47.796979 22965 raft_consensus.cc:3060] T 7be9efa6559648dbb5a0f7684c4542d1 P 0473d2b2d01f4459b1e90fd12cc7840e [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:05:47.749773 22890 consensus_queue.cc:1048] T 28af091831594f9d8e96482078cc7625 P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.038s
I20260709 13:05:47.741832 22979 consensus_queue.cc:1059] T 2725d2c4cb054f18b0fc8f735c15f6c2 P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.037s
I20260709 13:05:47.801388 19558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22196caba61445d3bec98a0aab3c337d" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:05:47.801898 19558 raft_consensus.cc:3060] T 22196caba61445d3bec98a0aab3c337d P e61c3a8f61bb48f8a963c9480e53c168 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:05:47.796214 22912 raft_consensus.cc:740] T 775c229504194560ba9589bc2199b089 P 127766fc592545a4997f7790f50f6076 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 127766fc592545a4997f7790f50f6076, State: Running, Role: LEADER
I20260709 13:05:47.816545 19407 raft_consensus.cc:1275] T 85c494af21f9457a85da47b9bc70c1fd P e5256d91808b47c195bc9b4dbd7f2b87 [term 6 FOLLOWER]: Refusing update from remote peer 127766fc592545a4997f7790f50f6076: Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 13:05:47.819823 19555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46c5bfeecc314717bffe987e6844b6d0" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 15 candidate_status { last_received { term: 13 index: 5 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:05:47.820670 19555 raft_consensus.cc:3060] T 46c5bfeecc314717bffe987e6844b6d0 P e61c3a8f61bb48f8a963c9480e53c168 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:05:47.755043 22700 consensus_queue.cc:1048] T 65d8cb8d6ec64f459d5a47cefab10acf P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.052s
I20260709 13:05:47.786782 22978 raft_consensus.cc:740] T 1efebf73c86e432baa55533136b6e12c P 0473d2b2d01f4459b1e90fd12cc7840e [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 0473d2b2d01f4459b1e90fd12cc7840e, State: Running, Role: LEADER
W20260709 13:05:47.842175 19450 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.3:36891, user_credentials={real_user=slave}} blocked reactor thread for 99081.4us
I20260709 13:05:47.844014 19450 leader_election.cc:304] T bc225c93219c45538b53a1bd3d387e4d P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e; no voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168
W20260709 13:05:47.844964 20078 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.2:46257, user_credentials={real_user=slave}} blocked reactor thread for 56892.3us
I20260709 13:05:47.858358 19450 leader_election.cc:304] T 21e14947d70440f19044d8f75c31e1f9 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168; no voters: e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:05:47.861711 19558 raft_consensus.cc:2468] T 22196caba61445d3bec98a0aab3c337d P e61c3a8f61bb48f8a963c9480e53c168 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 9.
I20260709 13:05:47.781605 22974 raft_consensus.cc:515] T 48824d5acfbc485ebf8c2d944e7202de P e61c3a8f61bb48f8a963c9480e53c168 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:05:47.865648 22974 leader_election.cc:290] T 48824d5acfbc485ebf8c2d944e7202de P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 9 election: Requested vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:05:47.801321 22859 consensus_queue.cc:1059] T df751f992649444090e27965eb1af85d P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.049s
I20260709 13:05:47.866600 22961 leader_election.cc:290] T 2e36a9d6e29c4a7c860cf267efbd4c74 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 7 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:05:47.866922 22882 raft_consensus.cc:2749] T bc225c93219c45538b53a1bd3d387e4d P 0473d2b2d01f4459b1e90fd12cc7840e [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:05:47.856715 23006 raft_consensus.cc:2749] T ed7fdbcb96d14d418db9ca90a792588a P 127766fc592545a4997f7790f50f6076 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:05:47.868438 19554 raft_consensus.cc:1240] T 48824d5acfbc485ebf8c2d944e7202de P e61c3a8f61bb48f8a963c9480e53c168 [term 9 FOLLOWER]: Rejecting Update request from peer 0473d2b2d01f4459b1e90fd12cc7840e for earlier term 8. Current term is 9. Ops: []
I20260709 13:05:47.815572 22845 raft_consensus.cc:493] T 2a16f7501e2444fb86d4e2778e734e02 P e5256d91808b47c195bc9b4dbd7f2b87 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:47.870265 20110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48824d5acfbc485ebf8c2d944e7202de" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076"
I20260709 13:05:47.911835 19555 raft_consensus.cc:2468] T 46c5bfeecc314717bffe987e6844b6d0 P e61c3a8f61bb48f8a963c9480e53c168 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 15.
I20260709 13:05:47.894999 19484 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "48824d5acfbc485ebf8c2d944e7202de"
dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
mode: GRACEFUL
new_leader_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
 from {username='slave'} at 127.0.0.1:48168
I20260709 13:05:47.899770 22987 raft_consensus.cc:515] T ef32ce6fdd0e40d382c79974f30295c6 P e5256d91808b47c195bc9b4dbd7f2b87 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:47.900576 22882 raft_consensus.cc:2804] T 21e14947d70440f19044d8f75c31e1f9 P 0473d2b2d01f4459b1e90fd12cc7840e [term 8 FOLLOWER]: Leader election won for term 8
W20260709 13:05:47.900935 23008 log.cc:927] Time spent T ff75a1d4cb1f493db8f71ddc136ba9ab P e5256d91808b47c195bc9b4dbd7f2b87: Append to log took a long time: real 0.122s	user 0.001s	sys 0.000s
I20260709 13:05:47.888089 22971 raft_consensus.cc:493] T 85c494af21f9457a85da47b9bc70c1fd P e5256d91808b47c195bc9b4dbd7f2b87 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:47.847909 22912 consensus_queue.cc:260] T 775c229504194560ba9589bc2199b089 P 127766fc592545a4997f7790f50f6076 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
W20260709 13:05:47.937397 19377 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.2:46257, user_credentials={real_user=slave}} blocked reactor thread for 150778us
I20260709 13:05:47.903569 22722 raft_consensus.cc:2749] T 1a61655d99124a29b486ba4a5b37faea P 0473d2b2d01f4459b1e90fd12cc7840e [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:05:47.904995 22972 raft_consensus.cc:3055] T df751f992649444090e27965eb1af85d P e5256d91808b47c195bc9b4dbd7f2b87 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:05:47.826969 22890 raft_consensus.cc:3055] T 2725d2c4cb054f18b0fc8f735c15f6c2 P e61c3a8f61bb48f8a963c9480e53c168 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:05:47.830391 22843 consensus_queue.cc:1048] T 22196caba61445d3bec98a0aab3c337d P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.077s
W20260709 13:05:47.910662 19450 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.3:36891, user_credentials={real_user=slave}} blocked reactor thread for 52407.5us
I20260709 13:05:47.871122 22999 raft_consensus.cc:515] T 833a2f0775ed407a94b8924ce50adb63 P 127766fc592545a4997f7790f50f6076 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:05:47.887290 22848 consensus_queue.cc:1048] T 172b3dd13109415a955b71ac0e9d2234 P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Connected to new peer: Peer: permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
W20260709 13:05:47.920868 19375 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.3:36891, user_credentials={real_user=slave}} blocked reactor thread for 104046us
I20260709 13:05:47.912698 19484 raft_consensus.cc:606] T 48824d5acfbc485ebf8c2d944e7202de P 0473d2b2d01f4459b1e90fd12cc7840e [term 8 LEADER]: Received request to transfer leadership to TS e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:05:47.871346 22857 raft_consensus.cc:2749] T 7be9efa6559648dbb5a0f7684c4542d1 P e5256d91808b47c195bc9b4dbd7f2b87 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 13:05:47.933694 19449 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.4:43121, user_credentials={real_user=slave}} blocked reactor thread for 141422us
I20260709 13:05:47.939040 19377 leader_election.cc:304] T ff75a1d4cb1f493db8f71ddc136ba9ab P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87; no voters: e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:05:47.940795 19408 raft_consensus.cc:2368] T ef32ce6fdd0e40d382c79974f30295c6 P e5256d91808b47c195bc9b4dbd7f2b87 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0473d2b2d01f4459b1e90fd12cc7840e for earlier term 10. Current term is 11.
W20260709 13:05:47.952261 20076 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:47.952834 19450 leader_election.cc:304] T 76cb037fc9064d13b59a8969d897ce8c P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e; no voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:05:47.953629 20076 leader_election.cc:304] T 1efebf73c86e432baa55533136b6e12c P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 127766fc592545a4997f7790f50f6076, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:05:47.953734 19557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48824d5acfbc485ebf8c2d944e7202de" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:05:47.954061 19450 leader_election.cc:304] T df751f992649444090e27965eb1af85d P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e; no voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168
W20260709 13:05:47.954805 19374 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.4:43121, user_credentials={real_user=slave}} blocked reactor thread for 91565.7us
I20260709 13:05:47.911324 22860 consensus_queue.cc:1048] T 65d8cb8d6ec64f459d5a47cefab10acf P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Connected to new peer: Peer: permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.035s
I20260709 13:05:47.939822 22882 raft_consensus.cc:697] T 21e14947d70440f19044d8f75c31e1f9 P 0473d2b2d01f4459b1e90fd12cc7840e [term 8 LEADER]: Becoming Leader. State: Replica: 0473d2b2d01f4459b1e90fd12cc7840e, State: Running, Role: LEADER
I20260709 13:05:47.944327 22890 raft_consensus.cc:740] T 2725d2c4cb054f18b0fc8f735c15f6c2 P e61c3a8f61bb48f8a963c9480e53c168 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: e61c3a8f61bb48f8a963c9480e53c168, State: Running, Role: LEADER
I20260709 13:05:47.941885 22972 raft_consensus.cc:740] T df751f992649444090e27965eb1af85d P e5256d91808b47c195bc9b4dbd7f2b87 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: e5256d91808b47c195bc9b4dbd7f2b87, State: Running, Role: LEADER
I20260709 13:05:47.958725 19557 raft_consensus.cc:2393] T 48824d5acfbc485ebf8c2d944e7202de P e61c3a8f61bb48f8a963c9480e53c168 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 127766fc592545a4997f7790f50f6076 in current term 9: Already voted for candidate e61c3a8f61bb48f8a963c9480e53c168 in this term.
I20260709 13:05:47.932785 22845 raft_consensus.cc:515] T 2a16f7501e2444fb86d4e2778e734e02 P e5256d91808b47c195bc9b4dbd7f2b87 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:05:47.967407 19555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "309c3ca0ca4b4f3ba129752ea2cb293b" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:05:47.871656 22898 consensus_queue.cc:237] T 1a61655d99124a29b486ba4a5b37faea P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 6.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:47.970436 22916 raft_consensus.cc:2804] T 1efebf73c86e432baa55533136b6e12c P 127766fc592545a4997f7790f50f6076 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:05:47.979540 22967 raft_consensus.cc:2749] T df751f992649444090e27965eb1af85d P 0473d2b2d01f4459b1e90fd12cc7840e [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:05:47.935180 22965 raft_consensus.cc:515] T 7be9efa6559648dbb5a0f7684c4542d1 P 0473d2b2d01f4459b1e90fd12cc7840e [term 9 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } attrs { replace: true } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
W20260709 13:05:47.995391 19377 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.2:46257, user_credentials={real_user=slave}} blocked reactor thread for 56427.5us
I20260709 13:05:47.938544 22971 raft_consensus.cc:515] T 85c494af21f9457a85da47b9bc70c1fd P e5256d91808b47c195bc9b4dbd7f2b87 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:05:48.004823 19411 raft_consensus.cc:1240] T 2725d2c4cb054f18b0fc8f735c15f6c2 P e5256d91808b47c195bc9b4dbd7f2b87 [term 10 FOLLOWER]: Rejecting Update request from peer e61c3a8f61bb48f8a963c9480e53c168 for earlier term 9. Current term is 10. Ops: [9.5-9.5]
I20260709 13:05:48.005478 22987 leader_election.cc:290] T ef32ce6fdd0e40d382c79974f30295c6 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 11 election: Requested vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:05:48.006489 22845 leader_election.cc:290] T 2a16f7501e2444fb86d4e2778e734e02 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:05:48.008078 22896 leader_election.cc:290] T b9f0d59553ad444883fcf5b5909f9798 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:05:48.011706 19484 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b08304a0a02b42d7840c4e8ee9a6bd1a"
dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
mode: GRACEFUL
new_leader_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
 from {username='slave'} at 127.0.0.1:48168
I20260709 13:05:47.967339 22840 consensus_queue.cc:1048] T ed7fdbcb96d14d418db9ca90a792588a P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.059s
I20260709 13:05:48.032748 19484 raft_consensus.cc:606] T b08304a0a02b42d7840c4e8ee9a6bd1a P 0473d2b2d01f4459b1e90fd12cc7840e [term 11 FOLLOWER]: Received request to transfer leadership to TS e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:05:48.033068 20108 raft_consensus.cc:1240] T 833a2f0775ed407a94b8924ce50adb63 P 127766fc592545a4997f7790f50f6076 [term 8 FOLLOWER]: Rejecting Update request from peer e5256d91808b47c195bc9b4dbd7f2b87 for earlier term 7. Current term is 8. Ops: []
I20260709 13:05:48.011891 22843 raft_consensus.cc:2804] T ff75a1d4cb1f493db8f71ddc136ba9ab P e5256d91808b47c195bc9b4dbd7f2b87 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:05:47.999924 23009 raft_consensus.cc:493] T 2e36a9d6e29c4a7c860cf267efbd4c74 P e61c3a8f61bb48f8a963c9480e53c168 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:48.013545 23011 consensus_queue.cc:1048] T 85c494af21f9457a85da47b9bc70c1fd P 127766fc592545a4997f7790f50f6076 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.014s
I20260709 13:05:47.999356 22921 raft_consensus.cc:515] T 309c3ca0ca4b4f3ba129752ea2cb293b P 127766fc592545a4997f7790f50f6076 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } attrs { replace: true } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:05:47.967563 22722 raft_consensus.cc:2749] T 76cb037fc9064d13b59a8969d897ce8c P 0473d2b2d01f4459b1e90fd12cc7840e [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:05:47.951014 22978 consensus_queue.cc:260] T 1efebf73c86e432baa55533136b6e12c P 0473d2b2d01f4459b1e90fd12cc7840e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
W20260709 13:05:48.023434 19294 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet ab43d85f64114d4ebf618930e43d9ed0 with cas_config_opid_index 5: ChangeConfig:REMOVE_PEER failed with leader e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica e61c3a8f61bb48f8a963c9480e53c168 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 8 leader_uuid: "127766fc592545a4997f7790f50f6076" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } attrs { replace: true } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } } }
I20260709 13:05:48.029480 20110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a16f7501e2444fb86d4e2778e734e02" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:05:48.033128 19484 raft_consensus.cc:614] T b08304a0a02b42d7840c4e8ee9a6bd1a P 0473d2b2d01f4459b1e90fd12cc7840e [term 11 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:05:47.957720 22821 raft_consensus.cc:493] T a08760e15aac4630a629431f56024dc8 P e5256d91808b47c195bc9b4dbd7f2b87 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:48.020882 22916 raft_consensus.cc:493] T 1efebf73c86e432baa55533136b6e12c P 127766fc592545a4997f7790f50f6076 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:48.054260 19377 leader_election.cc:304] T 1f85fc4b527a48848e5faa083b604e36 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87; no voters: 127766fc592545a4997f7790f50f6076
I20260709 13:05:48.056953 20110 raft_consensus.cc:2468] T 2a16f7501e2444fb86d4e2778e734e02 P 127766fc592545a4997f7790f50f6076 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 9.
I20260709 13:05:48.063252 19552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a16f7501e2444fb86d4e2778e734e02" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:05:48.053802 19449 leader_election.cc:304] T 96efeaaf1057492490e9a621f37e1a2d P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e; no voters: 127766fc592545a4997f7790f50f6076, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:05:48.063882 19552 raft_consensus.cc:2468] T 2a16f7501e2444fb86d4e2778e734e02 P e61c3a8f61bb48f8a963c9480e53c168 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 9.
W20260709 13:05:48.054431 19450 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.3:36891, user_credentials={real_user=slave}} blocked reactor thread for 100440us
I20260709 13:05:48.030916 22912 raft_consensus.cc:3060] T 775c229504194560ba9589bc2199b089 P 127766fc592545a4997f7790f50f6076 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:05:48.065727 19450 leader_election.cc:304] T b08304a0a02b42d7840c4e8ee9a6bd1a P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e; no voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:05:48.045802 22843 raft_consensus.cc:493] T ff75a1d4cb1f493db8f71ddc136ba9ab P e5256d91808b47c195bc9b4dbd7f2b87 [term 8 FOLLOWER]: Starting leader election (detected failure of leader e61c3a8f61bb48f8a963c9480e53c168)
I20260709 13:05:48.088266 19552 raft_consensus.cc:1240] T 22196caba61445d3bec98a0aab3c337d P e61c3a8f61bb48f8a963c9480e53c168 [term 9 FOLLOWER]: Rejecting Update request from peer e5256d91808b47c195bc9b4dbd7f2b87 for earlier term 8. Current term is 9. Ops: [8.6-8.6]
I20260709 13:05:48.088210 19450 leader_election.cc:304] T edd7d470b5014c9489be7f41f64355c9 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:05:48.075284 19374 leader_election.cc:304] T 2a16f7501e2444fb86d4e2778e734e02 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 127766fc592545a4997f7790f50f6076, e5256d91808b47c195bc9b4dbd7f2b87; no voters: 
I20260709 13:05:48.094033 19558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef32ce6fdd0e40d382c79974f30295c6" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:05:48.094606 19558 raft_consensus.cc:3060] T ef32ce6fdd0e40d382c79974f30295c6 P e61c3a8f61bb48f8a963c9480e53c168 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:05:48.094559 19377 leader_election.cc:304] T 775c229504194560ba9589bc2199b089 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, 127766fc592545a4997f7790f50f6076
I20260709 13:05:48.098002 22896 raft_consensus.cc:2804] T edd7d470b5014c9489be7f41f64355c9 P 0473d2b2d01f4459b1e90fd12cc7840e [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:05:48.099907 20112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "309c3ca0ca4b4f3ba129752ea2cb293b" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:05:48.101024 19450 leader_election.cc:304] T 22196caba61445d3bec98a0aab3c337d P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:05:48.071883 22916 raft_consensus.cc:3060] T 1efebf73c86e432baa55533136b6e12c P 127766fc592545a4997f7790f50f6076 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:05:48.055923 22977 leader_election.cc:290] T 309c3ca0ca4b4f3ba129752ea2cb293b P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:05:48.107702 19557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85c494af21f9457a85da47b9bc70c1fd" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 7 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:05:48.093596 23030 raft_consensus.cc:493] T 6c5eebf646ad445a9d1b1adc319d7b16 P e61c3a8f61bb48f8a963c9480e53c168 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:48.089951 22840 raft_consensus.cc:2749] T b08304a0a02b42d7840c4e8ee9a6bd1a P 0473d2b2d01f4459b1e90fd12cc7840e [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:05:48.089931 22967 raft_consensus.cc:2749] T 96efeaaf1057492490e9a621f37e1a2d P 0473d2b2d01f4459b1e90fd12cc7840e [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:05:48.044623 22972 consensus_queue.cc:260] T df751f992649444090e27965eb1af85d P e5256d91808b47c195bc9b4dbd7f2b87 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:48.095124 22843 raft_consensus.cc:3060] T ff75a1d4cb1f493db8f71ddc136ba9ab P e5256d91808b47c195bc9b4dbd7f2b87 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:05:48.106684 23021 log.cc:927] Time spent T f93ee515a9c14139bf566522ed8232f3 P e5256d91808b47c195bc9b4dbd7f2b87: Append to log took a long time: real 0.060s	user 0.000s	sys 0.000s
I20260709 13:05:48.118148 19450 leader_election.cc:304] T 46c5bfeecc314717bffe987e6844b6d0 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:05:48.120860 19410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "833a2f0775ed407a94b8924ce50adb63" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
I20260709 13:05:48.109732 22830 raft_consensus.cc:2804] T 2a16f7501e2444fb86d4e2778e734e02 P e5256d91808b47c195bc9b4dbd7f2b87 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:05:48.062892 22845 consensus_queue.cc:1059] T 833a2f0775ed407a94b8924ce50adb63 P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.047s
I20260709 13:05:48.071488 22821 raft_consensus.cc:515] T a08760e15aac4630a629431f56024dc8 P e5256d91808b47c195bc9b4dbd7f2b87 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:48.105162 23023 raft_consensus.cc:2804] T 1f85fc4b527a48848e5faa083b604e36 P e5256d91808b47c195bc9b4dbd7f2b87 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:05:48.127087 19377 leader_election.cc:304] T edd7d470b5014c9489be7f41f64355c9 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:05:48.058844 23009 raft_consensus.cc:515] T 2e36a9d6e29c4a7c860cf267efbd4c74 P e61c3a8f61bb48f8a963c9480e53c168 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:48.063944 22890 consensus_queue.cc:260] T 2725d2c4cb054f18b0fc8f735c15f6c2 P e61c3a8f61bb48f8a963c9480e53c168 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 9.5, Last appended by leader: 5, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:48.129102 19449 leader_election.cc:304] T 9962423cb4e54fcfa5de01daf68a86e7 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e; no voters: 127766fc592545a4997f7790f50f6076, e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:05:48.122591 22975 raft_consensus.cc:3060] T 775c229504194560ba9589bc2199b089 P e5256d91808b47c195bc9b4dbd7f2b87 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:05:48.150894 19374 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:48.070935 22882 consensus_queue.cc:237] T 21e14947d70440f19044d8f75c31e1f9 P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:48.142298 23023 raft_consensus.cc:493] T 1f85fc4b527a48848e5faa083b604e36 P e5256d91808b47c195bc9b4dbd7f2b87 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 127766fc592545a4997f7790f50f6076)
I20260709 13:05:48.147714 23009 leader_election.cc:290] T 2e36a9d6e29c4a7c860cf267efbd4c74 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:05:48.130077 22830 raft_consensus.cc:493] T 2a16f7501e2444fb86d4e2778e734e02 P e5256d91808b47c195bc9b4dbd7f2b87 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:48.166211 22830 raft_consensus.cc:3060] T 2a16f7501e2444fb86d4e2778e734e02 P e5256d91808b47c195bc9b4dbd7f2b87 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:05:48.129004 22978 raft_consensus.cc:3060] T 1efebf73c86e432baa55533136b6e12c P 0473d2b2d01f4459b1e90fd12cc7840e [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:05:48.143481 22967 raft_consensus.cc:2804] T 46c5bfeecc314717bffe987e6844b6d0 P 0473d2b2d01f4459b1e90fd12cc7840e [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:05:48.115520 23020 consensus_queue.cc:1059] T 22196caba61445d3bec98a0aab3c337d P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.056s
I20260709 13:05:48.174415 19558 raft_consensus.cc:2468] T ef32ce6fdd0e40d382c79974f30295c6 P e61c3a8f61bb48f8a963c9480e53c168 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 11.
I20260709 13:05:48.189631 19377 leader_election.cc:304] T 86a6797bdfe94fa496c050ceae4bd0d9 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:05:48.170508 19449 leader_election.cc:304] T 5ec1c4ce15e04c7e8c283a62179f2a64 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e; no voters: 127766fc592545a4997f7790f50f6076, e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:05:48.173949 22999 leader_election.cc:290] T 833a2f0775ed407a94b8924ce50adb63 P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 8 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:05:48.136703 23018 raft_consensus.cc:2804] T 22196caba61445d3bec98a0aab3c337d P 0473d2b2d01f4459b1e90fd12cc7840e [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:05:48.193768 22965 leader_election.cc:290] T 7be9efa6559648dbb5a0f7684c4542d1 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 9 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:05:48.189313 22758 raft_consensus.cc:493] T ed7fdbcb96d14d418db9ca90a792588a P e61c3a8f61bb48f8a963c9480e53c168 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:48.167099 22840 raft_consensus.cc:2749] T 9962423cb4e54fcfa5de01daf68a86e7 P 0473d2b2d01f4459b1e90fd12cc7840e [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:05:48.200541 19450 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.3:36891, user_credentials={real_user=slave}} blocked reactor thread for 82463.5us
W20260709 13:05:48.192668 19526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.2:46257, user_credentials={real_user=slave}} blocked reactor thread for 76854.1us
I20260709 13:05:48.200565 22758 raft_consensus.cc:515] T ed7fdbcb96d14d418db9ca90a792588a P e61c3a8f61bb48f8a963c9480e53c168 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:05:48.203398 22758 leader_election.cc:290] T ed7fdbcb96d14d418db9ca90a792588a P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:05:48.209250 19482 raft_consensus.cc:1275] T 96efeaaf1057492490e9a621f37e1a2d P 0473d2b2d01f4459b1e90fd12cc7840e [term 8 FOLLOWER]: Refusing update from remote peer 127766fc592545a4997f7790f50f6076: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:05:48.210855 19482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c5eebf646ad445a9d1b1adc319d7b16" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:05:48.211628 19482 raft_consensus.cc:2393] T 6c5eebf646ad445a9d1b1adc319d7b16 P 0473d2b2d01f4459b1e90fd12cc7840e [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 127766fc592545a4997f7790f50f6076 in current term 7: Already voted for candidate 0473d2b2d01f4459b1e90fd12cc7840e in this term.
I20260709 13:05:48.162931 23011 raft_consensus.cc:493] T 5ec1c4ce15e04c7e8c283a62179f2a64 P 127766fc592545a4997f7790f50f6076 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader e5256d91808b47c195bc9b4dbd7f2b87)
I20260709 13:05:48.213083 19377 leader_election.cc:304] T ab43d85f64114d4ebf618930e43d9ed0 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168; no voters: 127766fc592545a4997f7790f50f6076
I20260709 13:05:48.214430 19555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "833a2f0775ed407a94b8924ce50adb63" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:05:48.215469 19481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62c6c134d3d24a1ab144dd9ee6bc3f64" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:05:48.150792 22974 consensus_queue.cc:1059] T 2725d2c4cb054f18b0fc8f735c15f6c2 P e61c3a8f61bb48f8a963c9480e53c168 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 }, Status: INVALID_TERM, Last received: 8.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.037s
I20260709 13:05:48.166971 23023 raft_consensus.cc:3060] T 1f85fc4b527a48848e5faa083b604e36 P e5256d91808b47c195bc9b4dbd7f2b87 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:05:48.170212 22859 raft_consensus.cc:2749] T edd7d470b5014c9489be7f41f64355c9 P e5256d91808b47c195bc9b4dbd7f2b87 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 13:05:48.218160 19449 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.4:43121, user_credentials={real_user=slave}} blocked reactor thread for 47762.5us
I20260709 13:05:48.235471 19478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14935b3ddf914369822e4a0547aaa355" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:05:48.236253 19478 raft_consensus.cc:3060] T 14935b3ddf914369822e4a0547aaa355 P 0473d2b2d01f4459b1e90fd12cc7840e [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:05:48.236552 19477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff9b0eddd810459b82d91c60777c10eb" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:05:48.237533 19477 raft_consensus.cc:2393] T ff9b0eddd810459b82d91c60777c10eb P 0473d2b2d01f4459b1e90fd12cc7840e [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 127766fc592545a4997f7790f50f6076 in current term 8: Already voted for candidate e5256d91808b47c195bc9b4dbd7f2b87 in this term.
I20260709 13:05:48.239290 19483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48824d5acfbc485ebf8c2d944e7202de" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:05:48.123276 23030 raft_consensus.cc:515] T 6c5eebf646ad445a9d1b1adc319d7b16 P e61c3a8f61bb48f8a963c9480e53c168 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:05:48.243507 19486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1efebf73c86e432baa55533136b6e12c" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:05:48.243079 19480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36f6ba92b9ba46babe4ebd6c02e5fbd9" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:05:48.244125 20076 leader_election.cc:304] T 833a2f0775ed407a94b8924ce50adb63 P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 127766fc592545a4997f7790f50f6076; no voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:05:48.192696 22967 raft_consensus.cc:697] T 46c5bfeecc314717bffe987e6844b6d0 P 0473d2b2d01f4459b1e90fd12cc7840e [term 15 LEADER]: Becoming Leader. State: Replica: 0473d2b2d01f4459b1e90fd12cc7840e, State: Running, Role: LEADER
I20260709 13:05:48.144320 23027 consensus_queue.cc:1059] T 48824d5acfbc485ebf8c2d944e7202de P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.095s
I20260709 13:05:48.243240 19479 raft_consensus.cc:1275] T ab43d85f64114d4ebf618930e43d9ed0 P 0473d2b2d01f4459b1e90fd12cc7840e [term 8 FOLLOWER]: Refusing update from remote peer 127766fc592545a4997f7790f50f6076: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 13:05:48.247778 20078 leader_election.cc:304] T 62c6c134d3d24a1ab144dd9ee6bc3f64 P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 127766fc592545a4997f7790f50f6076; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:05:48.224056 23018 raft_consensus.cc:697] T 22196caba61445d3bec98a0aab3c337d P 0473d2b2d01f4459b1e90fd12cc7840e [term 9 LEADER]: Becoming Leader. State: Replica: 0473d2b2d01f4459b1e90fd12cc7840e, State: Running, Role: LEADER
I20260709 13:05:48.211644 22845 raft_consensus.cc:3060] T 86a6797bdfe94fa496c050ceae4bd0d9 P e5256d91808b47c195bc9b4dbd7f2b87 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:05:48.256570 19558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28af091831594f9d8e96482078cc7625" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:05:48.257216 19477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48824d5acfbc485ebf8c2d944e7202de" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:05:48.296244 19485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "309c3ca0ca4b4f3ba129752ea2cb293b" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:05:48.297839 19555 raft_consensus.cc:1240] T fa8650e71aa14778b3d73721fc50d9fc P e61c3a8f61bb48f8a963c9480e53c168 [term 10 FOLLOWER]: Rejecting Update request from peer 0473d2b2d01f4459b1e90fd12cc7840e for earlier term 9. Current term is 10. Ops: []
I20260709 13:05:48.300127 19559 raft_consensus.cc:1275] T e381f1d6b8184797ad142de49be225a8 P e61c3a8f61bb48f8a963c9480e53c168 [term 7 FOLLOWER]: Refusing update from remote peer 0473d2b2d01f4459b1e90fd12cc7840e: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:05:48.243083 22840 raft_consensus.cc:2749] T 5ec1c4ce15e04c7e8c283a62179f2a64 P 0473d2b2d01f4459b1e90fd12cc7840e [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
W20260709 13:05:48.303539 19449 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.4:43121, user_credentials={real_user=slave}} blocked reactor thread for 71474us
I20260709 13:05:48.306288 19559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e36a9d6e29c4a7c860cf267efbd4c74" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:05:48.309543 19552 raft_consensus.cc:1275] T 217b5fae677b4971b3bbd2f357a1f7ff P e61c3a8f61bb48f8a963c9480e53c168 [term 6 FOLLOWER]: Refusing update from remote peer 0473d2b2d01f4459b1e90fd12cc7840e: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
W20260709 13:05:48.314781 19523 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:48.316242 22967 consensus_queue.cc:237] T 46c5bfeecc314717bffe987e6844b6d0 P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 13.5, Last appended by leader: 5, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:48.318953 22821 leader_election.cc:290] T a08760e15aac4630a629431f56024dc8 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:05:48.319442 23006 raft_consensus.cc:2749] T 833a2f0775ed407a94b8924ce50adb63 P 127766fc592545a4997f7790f50f6076 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:05:48.320178 23006 raft_consensus.cc:2749] T 62c6c134d3d24a1ab144dd9ee6bc3f64 P 127766fc592545a4997f7790f50f6076 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:05:48.320871 23014 log.cc:927] Time spent T d1e5873a19244c5ebbcd38e126796ee7 P e5256d91808b47c195bc9b4dbd7f2b87: Append to log took a long time: real 0.292s	user 0.001s	sys 0.000s
I20260709 13:05:48.321604 23030 leader_election.cc:290] T 6c5eebf646ad445a9d1b1adc319d7b16 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:05:48.322006 19559 raft_consensus.cc:2393] T 2e36a9d6e29c4a7c860cf267efbd4c74 P e61c3a8f61bb48f8a963c9480e53c168 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 0473d2b2d01f4459b1e90fd12cc7840e in current term 7: Already voted for candidate e61c3a8f61bb48f8a963c9480e53c168 in this term.
W20260709 13:05:48.323354 23017 log.cc:927] Time spent T 14935b3ddf914369822e4a0547aaa355 P 127766fc592545a4997f7790f50f6076: Append to log took a long time: real 0.283s	user 0.000s	sys 0.001s
W20260709 13:05:48.326099 23029 log.cc:927] Time spent T 85c494af21f9457a85da47b9bc70c1fd P e61c3a8f61bb48f8a963c9480e53c168: Append to log took a long time: real 0.083s	user 0.000s	sys 0.000s
W20260709 13:05:48.327847 23025 log.cc:927] Time spent T 3e1f505cb0f1427bbd698ac889d80821 P e61c3a8f61bb48f8a963c9480e53c168: Append to log took a long time: real 0.209s	user 0.000s	sys 0.001s
I20260709 13:05:48.328455 23003 raft_consensus.cc:493] T 96efeaaf1057492490e9a621f37e1a2d P 127766fc592545a4997f7790f50f6076 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:48.329128 23003 raft_consensus.cc:515] T 96efeaaf1057492490e9a621f37e1a2d P 127766fc592545a4997f7790f50f6076 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:05:48.350358 19552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9f0d59553ad444883fcf5b5909f9798" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:05:48.358837 19478 raft_consensus.cc:2468] T 14935b3ddf914369822e4a0547aaa355 P 0473d2b2d01f4459b1e90fd12cc7840e [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 127766fc592545a4997f7790f50f6076 in term 8.
I20260709 13:05:48.297456 22859 raft_consensus.cc:2804] T ab43d85f64114d4ebf618930e43d9ed0 P e5256d91808b47c195bc9b4dbd7f2b87 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:05:48.380986 19555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7be9efa6559648dbb5a0f7684c4542d1" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:05:48.384097 22921 leader_election.cc:290] T 309c3ca0ca4b4f3ba129752ea2cb293b P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 8 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
W20260709 13:05:48.386847 19449 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.4:43121, user_credentials={real_user=slave}} blocked reactor thread for 78710.3us
W20260709 13:05:48.387370 19377 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.2:46257, user_credentials={real_user=slave}} blocked reactor thread for 174409us
I20260709 13:05:48.388525 19478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b74109013a140ada21feeef92d6f563" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:05:48.394559 19486 raft_consensus.cc:2468] T 1efebf73c86e432baa55533136b6e12c P 0473d2b2d01f4459b1e90fd12cc7840e [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 127766fc592545a4997f7790f50f6076 in term 7.
W20260709 13:05:48.382938 20078 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.2:46257, user_credentials={real_user=slave}} blocked reactor thread for 135208us
I20260709 13:05:48.419538 19377 leader_election.cc:304] T 2725d2c4cb054f18b0fc8f735c15f6c2 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87; no voters: e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:05:48.420598 19485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96efeaaf1057492490e9a621f37e1a2d" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:05:48.421185 19485 raft_consensus.cc:3060] T 96efeaaf1057492490e9a621f37e1a2d P 0473d2b2d01f4459b1e90fd12cc7840e [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:05:48.421854 20078 leader_election.cc:304] T ff9b0eddd810459b82d91c60777c10eb P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 127766fc592545a4997f7790f50f6076; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:05:48.422576 22968 raft_consensus.cc:2749] T ff9b0eddd810459b82d91c60777c10eb P 127766fc592545a4997f7790f50f6076 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:05:48.423285 20078 leader_election.cc:304] T 48824d5acfbc485ebf8c2d944e7202de P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 127766fc592545a4997f7790f50f6076; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:05:48.423995 22921 raft_consensus.cc:2749] T 48824d5acfbc485ebf8c2d944e7202de P 127766fc592545a4997f7790f50f6076 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:05:48.424503 22968 consensus_queue.cc:1048] T ab43d85f64114d4ebf618930e43d9ed0 P 127766fc592545a4997f7790f50f6076 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:05:48.424664 20078 leader_election.cc:304] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 127766fc592545a4997f7790f50f6076; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:05:48.382896 22859 raft_consensus.cc:493] T ab43d85f64114d4ebf618930e43d9ed0 P e5256d91808b47c195bc9b4dbd7f2b87 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 127766fc592545a4997f7790f50f6076)
I20260709 13:05:48.240882 23011 raft_consensus.cc:515] T 5ec1c4ce15e04c7e8c283a62179f2a64 P 127766fc592545a4997f7790f50f6076 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:05:48.430938 19485 raft_consensus.cc:2468] T 96efeaaf1057492490e9a621f37e1a2d P 0473d2b2d01f4459b1e90fd12cc7840e [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 9.
I20260709 13:05:48.434496 19481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a61655d99124a29b486ba4a5b37faea" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
W20260709 13:05:48.443166 20076 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.3:36891, user_credentials={real_user=slave}} blocked reactor thread for 199118us
I20260709 13:05:48.445068 19485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40e1e16737a842ee936002830f36882e" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 12 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:05:48.445787 19485 raft_consensus.cc:3060] T 40e1e16737a842ee936002830f36882e P 0473d2b2d01f4459b1e90fd12cc7840e [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:05:48.394817 23038 raft_consensus.cc:493] T d1e5873a19244c5ebbcd38e126796ee7 P 0473d2b2d01f4459b1e90fd12cc7840e [term 11 FOLLOWER]: Starting pre-election (detected failure of leader e61c3a8f61bb48f8a963c9480e53c168)
I20260709 13:05:48.451293 19478 raft_consensus.cc:1275] T 172b3dd13109415a955b71ac0e9d2234 P 0473d2b2d01f4459b1e90fd12cc7840e [term 8 FOLLOWER]: Refusing update from remote peer e5256d91808b47c195bc9b4dbd7f2b87: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 8 index: 7. (term mismatch)
I20260709 13:05:48.451718 19478 pending_rounds.cc:85] T 172b3dd13109415a955b71ac0e9d2234 P 0473d2b2d01f4459b1e90fd12cc7840e: Aborting all ops after (but not including) 6
I20260709 13:05:48.451942 19478 pending_rounds.cc:107] T 172b3dd13109415a955b71ac0e9d2234 P 0473d2b2d01f4459b1e90fd12cc7840e: Aborting uncommitted NO_OP operation due to leader change: 7.7
I20260709 13:05:48.452174 19478 raft_consensus.cc:2889] T 172b3dd13109415a955b71ac0e9d2234 P 0473d2b2d01f4459b1e90fd12cc7840e [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:05:48.453799 19552 raft_consensus.cc:1275] T 14935b3ddf914369822e4a0547aaa355 P e61c3a8f61bb48f8a963c9480e53c168 [term 8 FOLLOWER]: Refusing update from remote peer 127766fc592545a4997f7790f50f6076: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260709 13:05:48.454169 19377 leader_election.cc:304] T 7f575b143b844aa096b50997dad3516a P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:05:48.457226 19483 raft_consensus.cc:1240] T 86a6797bdfe94fa496c050ceae4bd0d9 P 0473d2b2d01f4459b1e90fd12cc7840e [term 9 FOLLOWER]: Rejecting Update request from peer e61c3a8f61bb48f8a963c9480e53c168 for earlier term 8. Current term is 9. Ops: []
I20260709 13:05:48.457350 19554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "309c3ca0ca4b4f3ba129752ea2cb293b" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:05:48.457914 19481 raft_consensus.cc:1275] T 28af091831594f9d8e96482078cc7625 P 0473d2b2d01f4459b1e90fd12cc7840e [term 9 FOLLOWER]: Refusing update from remote peer e61c3a8f61bb48f8a963c9480e53c168: Log matching property violated. Preceding OpId in replica: term: 8 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 13:05:48.461319 19555 raft_consensus.cc:2468] T 7be9efa6559648dbb5a0f7684c4542d1 P e61c3a8f61bb48f8a963c9480e53c168 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 9.
I20260709 13:05:48.442430 22859 raft_consensus.cc:3060] T ab43d85f64114d4ebf618930e43d9ed0 P e5256d91808b47c195bc9b4dbd7f2b87 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:05:48.394570 22978 consensus_queue.cc:1048] T ed7fdbcb96d14d418db9ca90a792588a P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Connected to new peer: Peer: permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.060s
I20260709 13:05:48.384511 23018 consensus_queue.cc:237] T 22196caba61445d3bec98a0aab3c337d P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:48.470043 19377 leader_election.cc:304] T 179fd671030940b4b4a4e24bcc4aba0a P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:05:48.471849 19485 raft_consensus.cc:2468] T 40e1e16737a842ee936002830f36882e P 0473d2b2d01f4459b1e90fd12cc7840e [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 12.
I20260709 13:05:48.441192 22946 raft_consensus.cc:493] T a08760e15aac4630a629431f56024dc8 P e61c3a8f61bb48f8a963c9480e53c168 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:48.453433 22968 raft_consensus.cc:2749] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P 127766fc592545a4997f7790f50f6076 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:05:48.453408 23020 raft_consensus.cc:2804] T 2725d2c4cb054f18b0fc8f735c15f6c2 P e5256d91808b47c195bc9b4dbd7f2b87 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:05:48.463090 22979 raft_consensus.cc:493] T 179fd671030940b4b4a4e24bcc4aba0a P e61c3a8f61bb48f8a963c9480e53c168 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 0473d2b2d01f4459b1e90fd12cc7840e)
I20260709 13:05:48.479557 19485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96efeaaf1057492490e9a621f37e1a2d" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:05:48.485111 19485 raft_consensus.cc:2468] T 96efeaaf1057492490e9a621f37e1a2d P 0473d2b2d01f4459b1e90fd12cc7840e [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 127766fc592545a4997f7790f50f6076 in term 9.
I20260709 13:05:48.486961 19478 raft_consensus.cc:1275] T 14935b3ddf914369822e4a0547aaa355 P 0473d2b2d01f4459b1e90fd12cc7840e [term 8 FOLLOWER]: Refusing update from remote peer 127766fc592545a4997f7790f50f6076: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260709 13:05:48.464223 22896 raft_consensus.cc:697] T edd7d470b5014c9489be7f41f64355c9 P 0473d2b2d01f4459b1e90fd12cc7840e [term 10 LEADER]: Becoming Leader. State: Replica: 0473d2b2d01f4459b1e90fd12cc7840e, State: Running, Role: LEADER
I20260709 13:05:48.480188 19481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "309c3ca0ca4b4f3ba129752ea2cb293b" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:05:48.467825 19477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa8650e71aa14778b3d73721fc50d9fc" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:05:48.488214 19555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96efeaaf1057492490e9a621f37e1a2d" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:05:48.490111 19555 raft_consensus.cc:2468] T 96efeaaf1057492490e9a621f37e1a2d P e61c3a8f61bb48f8a963c9480e53c168 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 127766fc592545a4997f7790f50f6076 in term 9.
I20260709 13:05:48.498770 19483 raft_consensus.cc:1275] T 3e1f505cb0f1427bbd698ac889d80821 P 0473d2b2d01f4459b1e90fd12cc7840e [term 9 FOLLOWER]: Refusing update from remote peer e61c3a8f61bb48f8a963c9480e53c168: Log matching property violated. Preceding OpId in replica: term: 8 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 13:05:48.502081 20078 leader_election.cc:304] T 96efeaaf1057492490e9a621f37e1a2d P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, 127766fc592545a4997f7790f50f6076; no voters: 
I20260709 13:05:48.471026 23003 leader_election.cc:290] T 96efeaaf1057492490e9a621f37e1a2d P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:05:48.454475 22821 consensus_queue.cc:1059] T 76cb037fc9064d13b59a8969d897ce8c P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.026s
I20260709 13:05:48.481985 23036 consensus_queue.cc:1048] T 14935b3ddf914369822e4a0547aaa355 P 127766fc592545a4997f7790f50f6076 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.038s
I20260709 13:05:48.503974 22961 consensus_queue.cc:1048] T 217b5fae677b4971b3bbd2f357a1f7ff P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:05:48.501209 23020 raft_consensus.cc:697] T 2725d2c4cb054f18b0fc8f735c15f6c2 P e5256d91808b47c195bc9b4dbd7f2b87 [term 10 LEADER]: Becoming Leader. State: Replica: e5256d91808b47c195bc9b4dbd7f2b87, State: Running, Role: LEADER
I20260709 13:05:48.511839 19411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7be9efa6559648dbb5a0f7684c4542d1" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
I20260709 13:05:48.536458 19411 raft_consensus.cc:2393] T 7be9efa6559648dbb5a0f7684c4542d1 P e5256d91808b47c195bc9b4dbd7f2b87 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 0473d2b2d01f4459b1e90fd12cc7840e in current term 9: Already voted for candidate e5256d91808b47c195bc9b4dbd7f2b87 in this term.
I20260709 13:05:48.513088 19405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28af091831594f9d8e96482078cc7625" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:05:48.513774 19406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e36a9d6e29c4a7c860cf267efbd4c74" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
I20260709 13:05:48.514370 23046 raft_consensus.cc:2749] T 7f575b143b844aa096b50997dad3516a P e5256d91808b47c195bc9b4dbd7f2b87 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:05:48.514483 19410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9f0d59553ad444883fcf5b5909f9798" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:05:48.515736 19526 leader_election.cc:304] T 96efeaaf1057492490e9a621f37e1a2d P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168; no voters: 127766fc592545a4997f7790f50f6076
I20260709 13:05:48.516125 23011 leader_election.cc:290] T 5ec1c4ce15e04c7e8c283a62179f2a64 P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:05:48.516561 23037 raft_consensus.cc:493] T 21e14947d70440f19044d8f75c31e1f9 P e61c3a8f61bb48f8a963c9480e53c168 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:48.498153 22975 raft_consensus.cc:2749] T 775c229504194560ba9589bc2199b089 P e5256d91808b47c195bc9b4dbd7f2b87 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:05:48.519630 23049 raft_consensus.cc:493] T 14efcc79969f41babe5529c22d59156d P 0473d2b2d01f4459b1e90fd12cc7840e [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:05:48.520841 23040 log.cc:927] Time spent T 172b3dd13109415a955b71ac0e9d2234 P 127766fc592545a4997f7790f50f6076: Append to log took a long time: real 0.185s	user 0.001s	sys 0.000s
I20260709 13:05:48.521029 20104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36f6ba92b9ba46babe4ebd6c02e5fbd9" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:05:48.472448 22882 consensus_queue.cc:1059] T fa8650e71aa14778b3d73721fc50d9fc P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 }, Status: INVALID_TERM, Last received: 9.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.066s
I20260709 13:05:48.522260 20108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff9b0eddd810459b82d91c60777c10eb" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:05:48.554019 19402 raft_consensus.cc:1240] T 7f575b143b844aa096b50997dad3516a P e5256d91808b47c195bc9b4dbd7f2b87 [term 5 FOLLOWER]: Rejecting Update request from peer 0473d2b2d01f4459b1e90fd12cc7840e for earlier term 4. Current term is 5. Ops: []
I20260709 13:05:48.554382 20108 raft_consensus.cc:2368] T ff9b0eddd810459b82d91c60777c10eb P 127766fc592545a4997f7790f50f6076 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0473d2b2d01f4459b1e90fd12cc7840e for earlier term 7. Current term is 8.
I20260709 13:05:48.481781 22946 raft_consensus.cc:515] T a08760e15aac4630a629431f56024dc8 P e61c3a8f61bb48f8a963c9480e53c168 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:48.523595 20112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c5eebf646ad445a9d1b1adc319d7b16" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076"
I20260709 13:05:48.524755 22977 raft_consensus.cc:3055] T 833a2f0775ed407a94b8924ce50adb63 P e5256d91808b47c195bc9b4dbd7f2b87 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:05:48.498299 22860 raft_consensus.cc:2749] T 179fd671030940b4b4a4e24bcc4aba0a P e5256d91808b47c195bc9b4dbd7f2b87 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:05:48.457000 23038 raft_consensus.cc:515] T d1e5873a19244c5ebbcd38e126796ee7 P 0473d2b2d01f4459b1e90fd12cc7840e [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:48.527096 19486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e36a9d6e29c4a7c860cf267efbd4c74" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
W20260709 13:05:48.527503 23015 log.cc:927] Time spent T 00000000000000000000000000000000 P 97750b77d35444acb7791ebf26cc2685: Append to log took a long time: real 0.512s	user 0.003s	sys 0.000s
I20260709 13:05:48.502101 22979 raft_consensus.cc:515] T 179fd671030940b4b4a4e24bcc4aba0a P e61c3a8f61bb48f8a963c9480e53c168 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:48.475804 23032 raft_consensus.cc:493] T e381f1d6b8184797ad142de49be225a8 P e61c3a8f61bb48f8a963c9480e53c168 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:48.529770 20078 leader_election.cc:304] T 309c3ca0ca4b4f3ba129752ea2cb293b P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 127766fc592545a4997f7790f50f6076; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168
W20260709 13:05:48.566579 19377 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.2:46257, user_credentials={real_user=slave}} blocked reactor thread for 96623.6us
I20260709 13:05:48.532366 19484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c5eebf646ad445a9d1b1adc319d7b16" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:05:48.569574 19484 raft_consensus.cc:2468] T 6c5eebf646ad445a9d1b1adc319d7b16 P 0473d2b2d01f4459b1e90fd12cc7840e [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 7.
I20260709 13:05:48.537729 20109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7be9efa6559648dbb5a0f7684c4542d1" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076"
I20260709 13:05:48.537873 22821 raft_consensus.cc:3055] T 76cb037fc9064d13b59a8969d897ce8c P e5256d91808b47c195bc9b4dbd7f2b87 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:05:48.543505 19483 raft_consensus.cc:1240] T 2725d2c4cb054f18b0fc8f735c15f6c2 P 0473d2b2d01f4459b1e90fd12cc7840e [term 10 FOLLOWER]: Rejecting Update request from peer e61c3a8f61bb48f8a963c9480e53c168 for earlier term 9. Current term is 10. Ops: []
I20260709 13:05:48.543642 19478 raft_consensus.cc:1275] T f93ee515a9c14139bf566522ed8232f3 P 0473d2b2d01f4459b1e90fd12cc7840e [term 12 FOLLOWER]: Refusing update from remote peer e61c3a8f61bb48f8a963c9480e53c168: Log matching property violated. Preceding OpId in replica: term: 7 index: 3. Preceding OpId from leader: term: 12 index: 5. (index mismatch)
I20260709 13:05:48.539732 18300 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 4
I20260709 13:05:48.521561 23006 raft_consensus.cc:2804] T 96efeaaf1057492490e9a621f37e1a2d P 127766fc592545a4997f7790f50f6076 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:05:48.552899 20104 raft_consensus.cc:2393] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P 127766fc592545a4997f7790f50f6076 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0473d2b2d01f4459b1e90fd12cc7840e in current term 10: Already voted for candidate 127766fc592545a4997f7790f50f6076 in this term.
I20260709 13:05:48.556720 19526 leader_election.cc:304] T 40e1e16737a842ee936002830f36882e P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168; no voters: e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:05:48.488520 22840 consensus_queue.cc:1048] T e381f1d6b8184797ad142de49be225a8 P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.055s
I20260709 13:05:48.531558 23009 raft_consensus.cc:493] T 7f575b143b844aa096b50997dad3516a P e61c3a8f61bb48f8a963c9480e53c168 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 0473d2b2d01f4459b1e90fd12cc7840e)
I20260709 13:05:48.559841 19449 leader_election.cc:304] T 775c229504194560ba9589bc2199b089 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e; no voters: 127766fc592545a4997f7790f50f6076, e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:05:48.555223 20112 raft_consensus.cc:2376] T 6c5eebf646ad445a9d1b1adc319d7b16 P 127766fc592545a4997f7790f50f6076 [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 7. Re-sending same reply.
I20260709 13:05:48.559219 19486 raft_consensus.cc:2468] T 2e36a9d6e29c4a7c860cf267efbd4c74 P 0473d2b2d01f4459b1e90fd12cc7840e [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 7.
I20260709 13:05:48.581938 19449 leader_election.cc:304] T 3e1f505cb0f1427bbd698ac889d80821 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e; no voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:05:48.577793 20109 raft_consensus.cc:3060] T 7be9efa6559648dbb5a0f7684c4542d1 P 127766fc592545a4997f7790f50f6076 [term 7 LEARNER]: Advancing to term 9
I20260709 13:05:48.530642 19481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48824d5acfbc485ebf8c2d944e7202de" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:05:48.571707 19377 leader_election.cc:304] T ff9b0eddd810459b82d91c60777c10eb P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87; no voters: 127766fc592545a4997f7790f50f6076
I20260709 13:05:48.551460 22758 raft_consensus.cc:2804] T 96efeaaf1057492490e9a621f37e1a2d P e61c3a8f61bb48f8a963c9480e53c168 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:05:48.579852 19484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b74109013a140ada21feeef92d6f563" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:05:48.575347 18300 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:05:48.558091 22977 raft_consensus.cc:740] T 833a2f0775ed407a94b8924ce50adb63 P e5256d91808b47c195bc9b4dbd7f2b87 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: e5256d91808b47c195bc9b4dbd7f2b87, State: Running, Role: LEADER
I20260709 13:05:48.549320 22830 raft_consensus.cc:515] T 2a16f7501e2444fb86d4e2778e734e02 P e5256d91808b47c195bc9b4dbd7f2b87 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:05:48.587198 19478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ec1c4ce15e04c7e8c283a62179f2a64" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:05:48.589206 23054 raft_consensus.cc:493] T 0afb57ae58a24a01850491d69f0213dd P 0473d2b2d01f4459b1e90fd12cc7840e [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:48.591244 19478 raft_consensus.cc:2393] T 5ec1c4ce15e04c7e8c283a62179f2a64 P 0473d2b2d01f4459b1e90fd12cc7840e [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 127766fc592545a4997f7790f50f6076 in current term 8: Already voted for candidate 0473d2b2d01f4459b1e90fd12cc7840e in this term.
I20260709 13:05:48.591420 23054 raft_consensus.cc:515] T 0afb57ae58a24a01850491d69f0213dd P 0473d2b2d01f4459b1e90fd12cc7840e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:05:48.592273 23038 leader_election.cc:290] T d1e5873a19244c5ebbcd38e126796ee7 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:05:48.592674 22946 leader_election.cc:290] T a08760e15aac4630a629431f56024dc8 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:05:48.593153 23028 raft_consensus.cc:3055] T 22196caba61445d3bec98a0aab3c337d P e5256d91808b47c195bc9b4dbd7f2b87 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:05:48.568357 22921 raft_consensus.cc:2749] T 309c3ca0ca4b4f3ba129752ea2cb293b P 127766fc592545a4997f7790f50f6076 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:05:48.595252 19554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0afb57ae58a24a01850491d69f0213dd" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:05:48.599447 19483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed7fdbcb96d14d418db9ca90a792588a" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:05:48.546938 23037 raft_consensus.cc:515] T 21e14947d70440f19044d8f75c31e1f9 P e61c3a8f61bb48f8a963c9480e53c168 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:48.593706 23054 leader_election.cc:290] T 0afb57ae58a24a01850491d69f0213dd P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:05:48.592690 22971 leader_election.cc:290] T 85c494af21f9457a85da47b9bc70c1fd P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:05:48.555667 23049 raft_consensus.cc:515] T 14efcc79969f41babe5529c22d59156d P 0473d2b2d01f4459b1e90fd12cc7840e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:05:48.599705 19554 raft_consensus.cc:2468] T 0afb57ae58a24a01850491d69f0213dd P e61c3a8f61bb48f8a963c9480e53c168 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 9.
I20260709 13:05:48.602747 23046 consensus_queue.cc:1048] T 172b3dd13109415a955b71ac0e9d2234 P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:05:48.603868 19478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e1f505cb0f1427bbd698ac889d80821" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:05:48.604713 23049 leader_election.cc:290] T 14efcc79969f41babe5529c22d59156d P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:05:48.560782 22997 consensus_queue.cc:1059] T 86a6797bdfe94fa496c050ceae4bd0d9 P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 }, Status: INVALID_TERM, Last received: 8.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.033s
I20260709 13:05:48.605464 22997 raft_consensus.cc:3055] T 86a6797bdfe94fa496c050ceae4bd0d9 P e61c3a8f61bb48f8a963c9480e53c168 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:05:48.605787 22997 raft_consensus.cc:740] T 86a6797bdfe94fa496c050ceae4bd0d9 P e61c3a8f61bb48f8a963c9480e53c168 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: e61c3a8f61bb48f8a963c9480e53c168, State: Running, Role: LEADER
I20260709 13:05:48.572889 22821 raft_consensus.cc:740] T 76cb037fc9064d13b59a8969d897ce8c P e5256d91808b47c195bc9b4dbd7f2b87 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: e5256d91808b47c195bc9b4dbd7f2b87, State: Running, Role: LEADER
I20260709 13:05:48.606518 22997 consensus_queue.cc:260] T 86a6797bdfe94fa496c050ceae4bd0d9 P e61c3a8f61bb48f8a963c9480e53c168 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.4, Last appended by leader: 4, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:48.606730 22916 raft_consensus.cc:515] T 1efebf73c86e432baa55533136b6e12c P 127766fc592545a4997f7790f50f6076 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:05:48.607738 22997 raft_consensus.cc:3060] T 86a6797bdfe94fa496c050ceae4bd0d9 P e61c3a8f61bb48f8a963c9480e53c168 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:05:48.577560 23006 raft_consensus.cc:493] T 96efeaaf1057492490e9a621f37e1a2d P 127766fc592545a4997f7790f50f6076 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:48.610522 23006 raft_consensus.cc:3060] T 96efeaaf1057492490e9a621f37e1a2d P 127766fc592545a4997f7790f50f6076 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:05:48.610831 23034 raft_consensus.cc:2804] T 40e1e16737a842ee936002830f36882e P e61c3a8f61bb48f8a963c9480e53c168 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:05:48.611363 23034 raft_consensus.cc:697] T 40e1e16737a842ee936002830f36882e P e61c3a8f61bb48f8a963c9480e53c168 [term 12 LEADER]: Becoming Leader. State: Replica: e61c3a8f61bb48f8a963c9480e53c168, State: Running, Role: LEADER
I20260709 13:05:48.612219 23034 consensus_queue.cc:237] T 40e1e16737a842ee936002830f36882e P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:48.561669 22898 consensus_queue.cc:1048] T 28af091831594f9d8e96482078cc7625 P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.028s
I20260709 13:05:48.593544 23028 raft_consensus.cc:740] T 22196caba61445d3bec98a0aab3c337d P e5256d91808b47c195bc9b4dbd7f2b87 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: e5256d91808b47c195bc9b4dbd7f2b87, State: Running, Role: LEADER
I20260709 13:05:48.574384 23011 consensus_queue.cc:1048] T 14935b3ddf914369822e4a0547aaa355 P 127766fc592545a4997f7790f50f6076 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.042s
I20260709 13:05:48.616595 23023 raft_consensus.cc:515] T 1f85fc4b527a48848e5faa083b604e36 P e5256d91808b47c195bc9b4dbd7f2b87 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:05:48.616549 19555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e5873a19244c5ebbcd38e126796ee7" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:05:48.587549 23055 consensus_queue.cc:1059] T b08304a0a02b42d7840c4e8ee9a6bd1a P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.146s
I20260709 13:05:48.578774 23032 raft_consensus.cc:515] T e381f1d6b8184797ad142de49be225a8 P e61c3a8f61bb48f8a963c9480e53c168 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:48.618654 23037 leader_election.cc:290] T 21e14947d70440f19044d8f75c31e1f9 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:05:48.619164 23055 raft_consensus.cc:3055] T b08304a0a02b42d7840c4e8ee9a6bd1a P e5256d91808b47c195bc9b4dbd7f2b87 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:05:48.619211 22916 leader_election.cc:290] T 1efebf73c86e432baa55533136b6e12c P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 8 election: Requested vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:05:48.619710 23055 raft_consensus.cc:740] T b08304a0a02b42d7840c4e8ee9a6bd1a P e5256d91808b47c195bc9b4dbd7f2b87 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: e5256d91808b47c195bc9b4dbd7f2b87, State: Running, Role: LEADER
I20260709 13:05:48.620172 23032 leader_election.cc:290] T e381f1d6b8184797ad142de49be225a8 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:05:48.620690 23055 consensus_queue.cc:260] T b08304a0a02b42d7840c4e8ee9a6bd1a P e5256d91808b47c195bc9b4dbd7f2b87 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:48.587647 22722 raft_consensus.cc:2749] T 775c229504194560ba9589bc2199b089 P 0473d2b2d01f4459b1e90fd12cc7840e [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:05:48.624423 23006 raft_consensus.cc:515] T 96efeaaf1057492490e9a621f37e1a2d P 127766fc592545a4997f7790f50f6076 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:05:48.589614 23009 raft_consensus.cc:515] T 7f575b143b844aa096b50997dad3516a P e61c3a8f61bb48f8a963c9480e53c168 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:48.627596 23006 leader_election.cc:290] T 96efeaaf1057492490e9a621f37e1a2d P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 10 election: Requested vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:05:48.629232 23009 leader_election.cc:290] T 7f575b143b844aa096b50997dad3516a P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:05:48.602939 23060 raft_consensus.cc:2804] T ff9b0eddd810459b82d91c60777c10eb P e5256d91808b47c195bc9b4dbd7f2b87 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:05:48.630381 23060 raft_consensus.cc:697] T ff9b0eddd810459b82d91c60777c10eb P e5256d91808b47c195bc9b4dbd7f2b87 [term 8 LEADER]: Becoming Leader. State: Replica: e5256d91808b47c195bc9b4dbd7f2b87, State: Running, Role: LEADER
I20260709 13:05:48.576800 22860 consensus_queue.cc:1048] T 14efcc79969f41babe5529c22d59156d P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.054s
I20260709 13:05:48.631524 23060 consensus_queue.cc:237] T ff9b0eddd810459b82d91c60777c10eb P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:05:48.599085 23020 consensus_queue.cc:237] T 2725d2c4cb054f18b0fc8f735c15f6c2 P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.4, Last appended by leader: 4, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:48.607394 22821 consensus_queue.cc:260] T 76cb037fc9064d13b59a8969d897ce8c P e5256d91808b47c195bc9b4dbd7f2b87 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
W20260709 13:05:48.645406 19377 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:05:48.640241 22843 consensus_meta.cc:287] T ff75a1d4cb1f493db8f71ddc136ba9ab P e5256d91808b47c195bc9b4dbd7f2b87: Time spent flushing consensus metadata: real 0.511s	user 0.007s	sys 0.002s
W20260709 13:05:48.640678 19449 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.1:40321, user_credentials={real_user=slave}} blocked reactor thread for 54390.1us
I20260709 13:05:48.651033 19449 leader_election.cc:304] T 86a6797bdfe94fa496c050ceae4bd0d9 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e; no voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:05:48.622385 23055 raft_consensus.cc:3060] T b08304a0a02b42d7840c4e8ee9a6bd1a P e5256d91808b47c195bc9b4dbd7f2b87 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:05:48.679554 19406 raft_consensus.cc:2468] T 2e36a9d6e29c4a7c860cf267efbd4c74 P e5256d91808b47c195bc9b4dbd7f2b87 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 7.
I20260709 13:05:48.681676 20109 raft_consensus.cc:2468] T 7be9efa6559648dbb5a0f7684c4542d1 P 127766fc592545a4997f7790f50f6076 [term 9 LEARNER]: Leader election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 9.
I20260709 13:05:48.682494 19449 leader_election.cc:304] T 2b74109013a140ada21feeef92d6f563 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e; no voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:05:48.685461 19481 raft_consensus.cc:1240] T 22196caba61445d3bec98a0aab3c337d P 0473d2b2d01f4459b1e90fd12cc7840e [term 9 LEADER]: Rejecting Update request from peer e5256d91808b47c195bc9b4dbd7f2b87 for earlier term 8. Current term is 9. Ops: []
I20260709 13:05:48.686349 22821 raft_consensus.cc:3060] T 76cb037fc9064d13b59a8969d897ce8c P e5256d91808b47c195bc9b4dbd7f2b87 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:05:48.687397 22979 leader_election.cc:290] T 179fd671030940b4b4a4e24bcc4aba0a P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:05:48.688081 23051 raft_consensus.cc:2749] T 86a6797bdfe94fa496c050ceae4bd0d9 P 0473d2b2d01f4459b1e90fd12cc7840e [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:05:48.691041 22977 consensus_queue.cc:260] T 833a2f0775ed407a94b8924ce50adb63 P e5256d91808b47c195bc9b4dbd7f2b87 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:05:48.692428 22977 raft_consensus.cc:3060] T 833a2f0775ed407a94b8924ce50adb63 P e5256d91808b47c195bc9b4dbd7f2b87 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:05:48.694963 23018 raft_consensus.cc:2749] T 2b74109013a140ada21feeef92d6f563 P 0473d2b2d01f4459b1e90fd12cc7840e [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:05:48.642912 22882 raft_consensus.cc:2749] T 3e1f505cb0f1427bbd698ac889d80821 P 0473d2b2d01f4459b1e90fd12cc7840e [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:05:48.684233 23011 raft_consensus.cc:493] T 6c5eebf646ad445a9d1b1adc319d7b16 P 127766fc592545a4997f7790f50f6076 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:48.671473 22843 raft_consensus.cc:515] T ff75a1d4cb1f493db8f71ddc136ba9ab P e5256d91808b47c195bc9b4dbd7f2b87 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:48.696389 23011 raft_consensus.cc:515] T 6c5eebf646ad445a9d1b1adc319d7b16 P 127766fc592545a4997f7790f50f6076 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:05:48.697928 22843 leader_election.cc:290] T ff75a1d4cb1f493db8f71ddc136ba9ab P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 9 election: Requested vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:05:48.650009 23046 raft_consensus.cc:493] T 40e1e16737a842ee936002830f36882e P e5256d91808b47c195bc9b4dbd7f2b87 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:48.698402 23023 leader_election.cc:290] T 1f85fc4b527a48848e5faa083b604e36 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 6 election: Requested vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:05:48.699828 19478 raft_consensus.cc:2468] T 3e1f505cb0f1427bbd698ac889d80821 P 0473d2b2d01f4459b1e90fd12cc7840e [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 9.
I20260709 13:05:48.698829 23046 raft_consensus.cc:515] T 40e1e16737a842ee936002830f36882e P e5256d91808b47c195bc9b4dbd7f2b87 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:48.719599 19449 leader_election.cc:400] T ef32ce6fdd0e40d382c79974f30295c6 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 10 pre-election: Vote denied by peer e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321) with higher term. Message: Invalid argument: T ef32ce6fdd0e40d382c79974f30295c6 P e5256d91808b47c195bc9b4dbd7f2b87 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0473d2b2d01f4459b1e90fd12cc7840e for earlier term 10. Current term is 11.
I20260709 13:05:48.719950 19449 leader_election.cc:403] T ef32ce6fdd0e40d382c79974f30295c6 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 10 pre-election: Cancelling election due to peer responding with higher term
W20260709 13:05:48.724030 19526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.2:46257, user_credentials={real_user=slave}} blocked reactor thread for 167413us
I20260709 13:05:48.724983 19526 leader_election.cc:304] T fa8650e71aa14778b3d73721fc50d9fc P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e61c3a8f61bb48f8a963c9480e53c168; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:05:48.718611 22758 raft_consensus.cc:697] T 96efeaaf1057492490e9a621f37e1a2d P e61c3a8f61bb48f8a963c9480e53c168 [term 9 LEADER]: Becoming Leader. State: Replica: e61c3a8f61bb48f8a963c9480e53c168, State: Running, Role: LEADER
I20260709 13:05:48.588657 22896 consensus_queue.cc:237] T edd7d470b5014c9489be7f41f64355c9 P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 8.4, Last appended by leader: 4, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:48.732436 19526 leader_election.cc:304] T 6c5eebf646ad445a9d1b1adc319d7b16 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:05:48.726876 22979 raft_consensus.cc:2749] T fa8650e71aa14778b3d73721fc50d9fc P e61c3a8f61bb48f8a963c9480e53c168 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:05:48.728979 23038 raft_consensus.cc:3060] T ef32ce6fdd0e40d382c79974f30295c6 P 0473d2b2d01f4459b1e90fd12cc7840e [term 9 FOLLOWER]: Advancing to term 11
I20260709 13:05:48.744931 23052 raft_consensus.cc:493] T 65d8cb8d6ec64f459d5a47cefab10acf P e61c3a8f61bb48f8a963c9480e53c168 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:48.723471 22967 consensus_queue.cc:1059] T 179fd671030940b4b4a4e24bcc4aba0a P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.018s
I20260709 13:05:48.827651 23051 raft_consensus.cc:3055] T 179fd671030940b4b4a4e24bcc4aba0a P 0473d2b2d01f4459b1e90fd12cc7840e [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:05:48.828104 23051 raft_consensus.cc:740] T 179fd671030940b4b4a4e24bcc4aba0a P 0473d2b2d01f4459b1e90fd12cc7840e [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 0473d2b2d01f4459b1e90fd12cc7840e, State: Running, Role: LEADER
I20260709 13:05:48.828742 22758 consensus_queue.cc:237] T 96efeaaf1057492490e9a621f37e1a2d P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:05:48.828948 23051 consensus_queue.cc:260] T 179fd671030940b4b4a4e24bcc4aba0a P 0473d2b2d01f4459b1e90fd12cc7840e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:48.830760 19482 raft_consensus.cc:1275] T ff75a1d4cb1f493db8f71ddc136ba9ab P 0473d2b2d01f4459b1e90fd12cc7840e [term 8 FOLLOWER]: Refusing update from remote peer e61c3a8f61bb48f8a963c9480e53c168: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:05:48.616539 23028 consensus_queue.cc:260] T 22196caba61445d3bec98a0aab3c337d P e5256d91808b47c195bc9b4dbd7f2b87 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:48.741154 23037 raft_consensus.cc:2804] T 6c5eebf646ad445a9d1b1adc319d7b16 P e61c3a8f61bb48f8a963c9480e53c168 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:05:48.728883 23030 consensus_queue.cc:1048] T 3e1f505cb0f1427bbd698ac889d80821 P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.071s
I20260709 13:05:48.865494 23066 raft_consensus.cc:493] T 1dc5b3532fe54f74876d02beffa2c230 P e61c3a8f61bb48f8a963c9480e53c168 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:48.873204 23066 raft_consensus.cc:515] T 1dc5b3532fe54f74876d02beffa2c230 P e61c3a8f61bb48f8a963c9480e53c168 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:48.861686 23037 raft_consensus.cc:493] T 6c5eebf646ad445a9d1b1adc319d7b16 P e61c3a8f61bb48f8a963c9480e53c168 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:48.901232 23051 raft_consensus.cc:3060] T 179fd671030940b4b4a4e24bcc4aba0a P 0473d2b2d01f4459b1e90fd12cc7840e [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:05:48.906333 23009 consensus_queue.cc:1048] T f93ee515a9c14139bf566522ed8232f3 P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:05:48.888250 23028 raft_consensus.cc:3060] T 22196caba61445d3bec98a0aab3c337d P e5256d91808b47c195bc9b4dbd7f2b87 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:05:48.924610 20104 raft_consensus.cc:1240] T 309c3ca0ca4b4f3ba129752ea2cb293b P 127766fc592545a4997f7790f50f6076 [term 8 FOLLOWER]: Rejecting Update request from peer 0473d2b2d01f4459b1e90fd12cc7840e for earlier term 7. Current term is 8. Ops: []
I20260709 13:05:48.917476 20110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0afb57ae58a24a01850491d69f0213dd" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:05:48.926227 20110 raft_consensus.cc:2468] T 0afb57ae58a24a01850491d69f0213dd P 127766fc592545a4997f7790f50f6076 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 9.
I20260709 13:05:48.921581 20112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14efcc79969f41babe5529c22d59156d" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
W20260709 13:05:48.928274 19524 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:48.915019 19526 leader_election.cc:304] T 2e36a9d6e29c4a7c860cf267efbd4c74 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
W20260709 13:05:48.901381 23061 log.cc:927] Time spent T 85c494af21f9457a85da47b9bc70c1fd P 127766fc592545a4997f7790f50f6076: Append to log took a long time: real 0.139s	user 0.000s	sys 0.000s
I20260709 13:05:48.963052 19481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21e14947d70440f19044d8f75c31e1f9" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:05:48.965095 19484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "179fd671030940b4b4a4e24bcc4aba0a" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:05:48.966039 19449 leader_election.cc:400] T ff9b0eddd810459b82d91c60777c10eb P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 7 pre-election: Vote denied by peer 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121) with higher term. Message: Invalid argument: T ff9b0eddd810459b82d91c60777c10eb P 127766fc592545a4997f7790f50f6076 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0473d2b2d01f4459b1e90fd12cc7840e for earlier term 7. Current term is 8.
I20260709 13:05:48.893384 23037 raft_consensus.cc:3060] T 6c5eebf646ad445a9d1b1adc319d7b16 P e61c3a8f61bb48f8a963c9480e53c168 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:05:48.910980 22912 consensus_meta.cc:287] T 775c229504194560ba9589bc2199b089 P 127766fc592545a4997f7790f50f6076: Time spent flushing consensus metadata: real 0.824s	user 0.014s	sys 0.000s
I20260709 13:05:48.990708 19481 raft_consensus.cc:1275] T 1a61655d99124a29b486ba4a5b37faea P 0473d2b2d01f4459b1e90fd12cc7840e [term 7 FOLLOWER]: Refusing update from remote peer e61c3a8f61bb48f8a963c9480e53c168: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
W20260709 13:05:48.982260 22845 consensus_meta.cc:287] T 86a6797bdfe94fa496c050ceae4bd0d9 P e5256d91808b47c195bc9b4dbd7f2b87: Time spent flushing consensus metadata: real 0.678s	user 0.015s	sys 0.006s
I20260709 13:05:48.984988 19483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f575b143b844aa096b50997dad3516a" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:05:48.847028 23052 raft_consensus.cc:515] T 65d8cb8d6ec64f459d5a47cefab10acf P e61c3a8f61bb48f8a963c9480e53c168 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
W20260709 13:05:48.989197 19526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.2:46257, user_credentials={real_user=slave}} blocked reactor thread for 74284.6us
I20260709 13:05:48.987970 19482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a08760e15aac4630a629431f56024dc8" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:05:48.983052 19486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e381f1d6b8184797ad142de49be225a8" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:05:48.997855 19482 raft_consensus.cc:2468] T a08760e15aac4630a629431f56024dc8 P 0473d2b2d01f4459b1e90fd12cc7840e [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 10.
I20260709 13:05:48.993726 19449 leader_election.cc:304] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e; no voters: 127766fc592545a4997f7790f50f6076, e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:05:48.999085 23048 raft_consensus.cc:493] T fa731b585f684a7fb2d106c50f143b83 P 127766fc592545a4997f7790f50f6076 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:48.999749 23048 raft_consensus.cc:515] T fa731b585f684a7fb2d106c50f143b83 P 127766fc592545a4997f7790f50f6076 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:05:49.001792 23048 leader_election.cc:290] T fa731b585f684a7fb2d106c50f143b83 P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:05:48.999078 19526 leader_election.cc:304] T 2b74109013a140ada21feeef92d6f563 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e61c3a8f61bb48f8a963c9480e53c168; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:05:49.003160 22965 raft_consensus.cc:3055] T 48824d5acfbc485ebf8c2d944e7202de P 0473d2b2d01f4459b1e90fd12cc7840e [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:05:49.003562 22965 raft_consensus.cc:740] T 48824d5acfbc485ebf8c2d944e7202de P 0473d2b2d01f4459b1e90fd12cc7840e [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 0473d2b2d01f4459b1e90fd12cc7840e, State: Running, Role: LEADER
I20260709 13:05:49.004347 22965 consensus_queue.cc:260] T 48824d5acfbc485ebf8c2d944e7202de P 0473d2b2d01f4459b1e90fd12cc7840e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:05:49.005656 22965 raft_consensus.cc:3060] T 48824d5acfbc485ebf8c2d944e7202de P 0473d2b2d01f4459b1e90fd12cc7840e [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:05:49.008112 19526 leader_election.cc:304] T 48824d5acfbc485ebf8c2d944e7202de P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e61c3a8f61bb48f8a963c9480e53c168; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, 127766fc592545a4997f7790f50f6076
I20260709 13:05:49.009018 23030 raft_consensus.cc:2749] T 48824d5acfbc485ebf8c2d944e7202de P e61c3a8f61bb48f8a963c9480e53c168 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:05:48.983230 22830 leader_election.cc:290] T 2a16f7501e2444fb86d4e2778e734e02 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 10 election: Requested vote from peers e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
W20260709 13:05:48.994529 22859 consensus_meta.cc:287] T ab43d85f64114d4ebf618930e43d9ed0 P e5256d91808b47c195bc9b4dbd7f2b87: Time spent flushing consensus metadata: real 0.514s	user 0.014s	sys 0.000s
I20260709 13:05:48.986907 22840 raft_consensus.cc:493] T 172b3dd13109415a955b71ac0e9d2234 P 0473d2b2d01f4459b1e90fd12cc7840e [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:49.014377 19449 leader_election.cc:304] T 6c5eebf646ad445a9d1b1adc319d7b16 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, 127766fc592545a4997f7790f50f6076; no voters: e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:05:49.010954 23066 leader_election.cc:290] T 1dc5b3532fe54f74876d02beffa2c230 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
W20260709 13:05:49.016814 19375 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:48.997659 23011 leader_election.cc:290] T 6c5eebf646ad445a9d1b1adc319d7b16 P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:05:49.007217 22845 raft_consensus.cc:2749] T 86a6797bdfe94fa496c050ceae4bd0d9 P e5256d91808b47c195bc9b4dbd7f2b87 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:05:49.021590 19449 leader_election.cc:304] T 7be9efa6559648dbb5a0f7684c4542d1 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, 127766fc592545a4997f7790f50f6076, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:05:48.998561 23034 raft_consensus.cc:2804] T 2e36a9d6e29c4a7c860cf267efbd4c74 P e61c3a8f61bb48f8a963c9480e53c168 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:05:49.019719 19406 raft_consensus.cc:1240] T ff75a1d4cb1f493db8f71ddc136ba9ab P e5256d91808b47c195bc9b4dbd7f2b87 [term 9 FOLLOWER]: Rejecting Update request from peer e61c3a8f61bb48f8a963c9480e53c168 for earlier term 8. Current term is 9. Ops: []
I20260709 13:05:48.996469 23046 leader_election.cc:290] T 40e1e16737a842ee936002830f36882e P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:05:49.024004 19375 leader_election.cc:304] T ef32ce6fdd0e40d382c79974f30295c6 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:05:49.027604 19410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e36a9d6e29c4a7c860cf267efbd4c74" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:05:49.012571 22758 raft_consensus.cc:2749] T 2b74109013a140ada21feeef92d6f563 P e61c3a8f61bb48f8a963c9480e53c168 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:05:49.029448 19410 raft_consensus.cc:2468] T 2e36a9d6e29c4a7c860cf267efbd4c74 P e5256d91808b47c195bc9b4dbd7f2b87 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 7.
I20260709 13:05:49.017586 22964 raft_consensus.cc:3060] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P 0473d2b2d01f4459b1e90fd12cc7840e [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:05:49.063593 19408 raft_consensus.cc:1240] T 86a6797bdfe94fa496c050ceae4bd0d9 P e5256d91808b47c195bc9b4dbd7f2b87 [term 9 FOLLOWER]: Rejecting Update request from peer e61c3a8f61bb48f8a963c9480e53c168 for earlier term 8. Current term is 9. Ops: []
I20260709 13:05:49.018085 23020 raft_consensus.cc:493] T 14935b3ddf914369822e4a0547aaa355 P e5256d91808b47c195bc9b4dbd7f2b87 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:05:49.075455 19377 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:49.026901 23034 raft_consensus.cc:493] T 2e36a9d6e29c4a7c860cf267efbd4c74 P e61c3a8f61bb48f8a963c9480e53c168 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:49.066949 22997 raft_consensus.cc:493] T f1b10566f45d4a7d9029858330e02d5b P e61c3a8f61bb48f8a963c9480e53c168 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 0473d2b2d01f4459b1e90fd12cc7840e)
I20260709 13:05:49.027529 22967 raft_consensus.cc:2804] T 6c5eebf646ad445a9d1b1adc319d7b16 P 0473d2b2d01f4459b1e90fd12cc7840e [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:05:49.017845 22840 raft_consensus.cc:515] T 172b3dd13109415a955b71ac0e9d2234 P 0473d2b2d01f4459b1e90fd12cc7840e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
W20260709 13:05:49.100349 19451 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:49.083949 20109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed7fdbcb96d14d418db9ca90a792588a" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
W20260709 13:05:49.078502 19449 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.4:43121, user_credentials={real_user=slave}} blocked reactor thread for 50716.2us
I20260709 13:05:49.016701 22859 raft_consensus.cc:515] T ab43d85f64114d4ebf618930e43d9ed0 P e5256d91808b47c195bc9b4dbd7f2b87 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } attrs { replace: true } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:05:49.031488 22880 raft_consensus.cc:493] T 5ec1c4ce15e04c7e8c283a62179f2a64 P e5256d91808b47c195bc9b4dbd7f2b87 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:49.033491 22860 raft_consensus.cc:2804] T ef32ce6fdd0e40d382c79974f30295c6 P e5256d91808b47c195bc9b4dbd7f2b87 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:05:49.027379 23023 raft_consensus.cc:493] T fa731b585f684a7fb2d106c50f143b83 P e5256d91808b47c195bc9b4dbd7f2b87 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:49.112269 22843 raft_consensus.cc:493] T e381f1d6b8184797ad142de49be225a8 P e5256d91808b47c195bc9b4dbd7f2b87 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:49.112407 19410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14efcc79969f41babe5529c22d59156d" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:05:49.113076 22843 raft_consensus.cc:515] T e381f1d6b8184797ad142de49be225a8 P e5256d91808b47c195bc9b4dbd7f2b87 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:49.113880 23023 raft_consensus.cc:515] T fa731b585f684a7fb2d106c50f143b83 P e5256d91808b47c195bc9b4dbd7f2b87 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:05:49.115952 23023 leader_election.cc:290] T fa731b585f684a7fb2d106c50f143b83 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:05:49.082087 22821 raft_consensus.cc:493] T 217b5fae677b4971b3bbd2f357a1f7ff P e5256d91808b47c195bc9b4dbd7f2b87 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 0473d2b2d01f4459b1e90fd12cc7840e)
I20260709 13:05:49.116338 19411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e5873a19244c5ebbcd38e126796ee7" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:05:49.116662 22821 raft_consensus.cc:515] T 217b5fae677b4971b3bbd2f357a1f7ff P e5256d91808b47c195bc9b4dbd7f2b87 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:49.033412 23072 raft_consensus.cc:2804] T 7be9efa6559648dbb5a0f7684c4542d1 P 0473d2b2d01f4459b1e90fd12cc7840e [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:05:49.105760 23034 raft_consensus.cc:3060] T 2e36a9d6e29c4a7c860cf267efbd4c74 P e61c3a8f61bb48f8a963c9480e53c168 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:05:49.121399 23037 raft_consensus.cc:515] T 6c5eebf646ad445a9d1b1adc319d7b16 P e61c3a8f61bb48f8a963c9480e53c168 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:05:49.124008 23037 leader_election.cc:290] T 6c5eebf646ad445a9d1b1adc319d7b16 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 8 election: Requested vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:05:49.080835 23020 raft_consensus.cc:515] T 14935b3ddf914369822e4a0547aaa355 P e5256d91808b47c195bc9b4dbd7f2b87 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } attrs { replace: true } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:05:49.126154 22840 leader_election.cc:290] T 172b3dd13109415a955b71ac0e9d2234 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
W20260709 13:05:49.129977 19374 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:49.130658 22848 raft_consensus.cc:493] T 70797e5783b5454ab0d0eea663e791e3 P e5256d91808b47c195bc9b4dbd7f2b87 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:05:49.131203 19523 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:49.131301 22848 raft_consensus.cc:515] T 70797e5783b5454ab0d0eea663e791e3 P e5256d91808b47c195bc9b4dbd7f2b87 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:05:49.134028 22848 leader_election.cc:290] T 70797e5783b5454ab0d0eea663e791e3 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:05:49.134310 19404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "179fd671030940b4b4a4e24bcc4aba0a" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:05:49.135028 19405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e381f1d6b8184797ad142de49be225a8" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:05:49.135377 19406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f575b143b844aa096b50997dad3516a" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:05:49.135622 19405 raft_consensus.cc:2468] T e381f1d6b8184797ad142de49be225a8 P e5256d91808b47c195bc9b4dbd7f2b87 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 7.
I20260709 13:05:49.136040 19406 raft_consensus.cc:2393] T 7f575b143b844aa096b50997dad3516a P e5256d91808b47c195bc9b4dbd7f2b87 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e61c3a8f61bb48f8a963c9480e53c168 in current term 5: Already voted for candidate e5256d91808b47c195bc9b4dbd7f2b87 in this term.
I20260709 13:05:49.136464 19403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dc5b3532fe54f74876d02beffa2c230" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:05:49.135052 19404 raft_consensus.cc:2393] T 179fd671030940b4b4a4e24bcc4aba0a P e5256d91808b47c195bc9b4dbd7f2b87 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e61c3a8f61bb48f8a963c9480e53c168 in current term 9: Already voted for candidate e5256d91808b47c195bc9b4dbd7f2b87 in this term.
I20260709 13:05:49.137040 19403 raft_consensus.cc:2468] T 1dc5b3532fe54f74876d02beffa2c230 P e5256d91808b47c195bc9b4dbd7f2b87 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 8.
I20260709 13:05:49.138314 19407 raft_consensus.cc:1275] T 40e1e16737a842ee936002830f36882e P e5256d91808b47c195bc9b4dbd7f2b87 [term 12 FOLLOWER]: Refusing update from remote peer e61c3a8f61bb48f8a963c9480e53c168: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 12 index: 6. (term mismatch)
I20260709 13:05:49.138764 19407 pending_rounds.cc:85] T 40e1e16737a842ee936002830f36882e P e5256d91808b47c195bc9b4dbd7f2b87: Aborting all ops after (but not including) 5
I20260709 13:05:49.138442 20112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85c494af21f9457a85da47b9bc70c1fd" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 7 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:05:49.138994 19407 pending_rounds.cc:107] T 40e1e16737a842ee936002830f36882e P e5256d91808b47c195bc9b4dbd7f2b87: Aborting uncommitted NO_OP operation due to leader change: 11.6
I20260709 13:05:49.139276 19407 raft_consensus.cc:2889] T 40e1e16737a842ee936002830f36882e P e5256d91808b47c195bc9b4dbd7f2b87 [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:05:49.141338 22997 raft_consensus.cc:515] T f1b10566f45d4a7d9029858330e02d5b P e61c3a8f61bb48f8a963c9480e53c168 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:49.141829 20109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c5eebf646ad445a9d1b1adc319d7b16" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:05:49.142655 20109 raft_consensus.cc:2468] T 6c5eebf646ad445a9d1b1adc319d7b16 P 127766fc592545a4997f7790f50f6076 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 7.
I20260709 13:05:49.143489 22997 leader_election.cc:290] T f1b10566f45d4a7d9029858330e02d5b P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
W20260709 13:05:49.146279 23043 log.cc:927] Time spent T ff75a1d4cb1f493db8f71ddc136ba9ab P e61c3a8f61bb48f8a963c9480e53c168: Append to log took a long time: real 0.705s	user 0.003s	sys 0.000s
W20260709 13:05:49.147416 23077 log.cc:927] Time spent T 96efeaaf1057492490e9a621f37e1a2d P e61c3a8f61bb48f8a963c9480e53c168: Append to log took a long time: real 0.075s	user 0.000s	sys 0.000s
I20260709 13:05:49.154572 23050 raft_consensus.cc:3055] T fa8650e71aa14778b3d73721fc50d9fc P 0473d2b2d01f4459b1e90fd12cc7840e [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:05:49.155009 23050 raft_consensus.cc:740] T fa8650e71aa14778b3d73721fc50d9fc P 0473d2b2d01f4459b1e90fd12cc7840e [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 0473d2b2d01f4459b1e90fd12cc7840e, State: Running, Role: LEADER
I20260709 13:05:49.148391 19402 raft_consensus.cc:1275] T 1a61655d99124a29b486ba4a5b37faea P e5256d91808b47c195bc9b4dbd7f2b87 [term 7 FOLLOWER]: Refusing update from remote peer e61c3a8f61bb48f8a963c9480e53c168: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:05:49.156095 22880 raft_consensus.cc:515] T 5ec1c4ce15e04c7e8c283a62179f2a64 P e5256d91808b47c195bc9b4dbd7f2b87 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:05:49.150599 22758 raft_consensus.cc:493] T b08304a0a02b42d7840c4e8ee9a6bd1a P e61c3a8f61bb48f8a963c9480e53c168 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader e5256d91808b47c195bc9b4dbd7f2b87)
I20260709 13:05:49.157951 19450 leader_election.cc:304] T 0afb57ae58a24a01850491d69f0213dd P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:05:49.143462 19411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a08760e15aac4630a629431f56024dc8" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:05:49.159626 19411 raft_consensus.cc:2468] T a08760e15aac4630a629431f56024dc8 P e5256d91808b47c195bc9b4dbd7f2b87 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 10.
I20260709 13:05:49.162375 19377 leader_election.cc:304] T 3e1f505cb0f1427bbd698ac889d80821 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87; no voters: e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:05:49.149478 23052 leader_election.cc:290] T 65d8cb8d6ec64f459d5a47cefab10acf P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:05:49.150482 22974 raft_consensus.cc:493] T df751f992649444090e27965eb1af85d P e61c3a8f61bb48f8a963c9480e53c168 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader e5256d91808b47c195bc9b4dbd7f2b87)
I20260709 13:05:49.157064 22967 raft_consensus.cc:697] T 6c5eebf646ad445a9d1b1adc319d7b16 P 0473d2b2d01f4459b1e90fd12cc7840e [term 7 LEADER]: Becoming Leader. State: Replica: 0473d2b2d01f4459b1e90fd12cc7840e, State: Running, Role: LEADER
I20260709 13:05:49.167412 19557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a08760e15aac4630a629431f56024dc8" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:05:49.169932 19374 leader_election.cc:304] T 309c3ca0ca4b4f3ba129752ea2cb293b P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87; no voters: 127766fc592545a4997f7790f50f6076, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:05:49.173244 20112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f85fc4b527a48848e5faa083b604e36" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076"
I20260709 13:05:49.174834 19410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21e14947d70440f19044d8f75c31e1f9" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:05:49.177325 19557 raft_consensus.cc:2468] T a08760e15aac4630a629431f56024dc8 P e61c3a8f61bb48f8a963c9480e53c168 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 10.
W20260709 13:05:49.175380 19449 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.4:43121, user_credentials={real_user=slave}} blocked reactor thread for 67168us
I20260709 13:05:49.180181 23030 raft_consensus.cc:493] T edd7d470b5014c9489be7f41f64355c9 P e61c3a8f61bb48f8a963c9480e53c168 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:49.180606 22974 raft_consensus.cc:515] T df751f992649444090e27965eb1af85d P e61c3a8f61bb48f8a963c9480e53c168 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:49.180671 23030 raft_consensus.cc:515] T edd7d470b5014c9489be7f41f64355c9 P e61c3a8f61bb48f8a963c9480e53c168 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:49.182890 22974 leader_election.cc:290] T df751f992649444090e27965eb1af85d P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:05:49.183072 23030 leader_election.cc:290] T edd7d470b5014c9489be7f41f64355c9 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:05:49.183976 22722 raft_consensus.cc:2804] T 0afb57ae58a24a01850491d69f0213dd P 0473d2b2d01f4459b1e90fd12cc7840e [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:05:49.184440 22722 raft_consensus.cc:493] T 0afb57ae58a24a01850491d69f0213dd P 0473d2b2d01f4459b1e90fd12cc7840e [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:49.184799 22722 raft_consensus.cc:3060] T 0afb57ae58a24a01850491d69f0213dd P 0473d2b2d01f4459b1e90fd12cc7840e [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:05:49.171700 22700 raft_consensus.cc:493] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P e5256d91808b47c195bc9b4dbd7f2b87 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:49.187419 20112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a16f7501e2444fb86d4e2778e734e02" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076"
I20260709 13:05:49.187811 22700 raft_consensus.cc:515] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P e5256d91808b47c195bc9b4dbd7f2b87 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:05:49.188174 20112 raft_consensus.cc:3060] T 2a16f7501e2444fb86d4e2778e734e02 P 127766fc592545a4997f7790f50f6076 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:05:49.191071 20110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c5eebf646ad445a9d1b1adc319d7b16" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076"
I20260709 13:05:49.191763 20110 raft_consensus.cc:3060] T 6c5eebf646ad445a9d1b1adc319d7b16 P 127766fc592545a4997f7790f50f6076 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:05:49.190331 20109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa731b585f684a7fb2d106c50f143b83" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:05:49.193125 20109 raft_consensus.cc:2468] T fa731b585f684a7fb2d106c50f143b83 P 127766fc592545a4997f7790f50f6076 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 8.
I20260709 13:05:49.194721 19411 raft_consensus.cc:1275] T 46c5bfeecc314717bffe987e6844b6d0 P e5256d91808b47c195bc9b4dbd7f2b87 [term 15 FOLLOWER]: Refusing update from remote peer 0473d2b2d01f4459b1e90fd12cc7840e: Log matching property violated. Preceding OpId in replica: term: 9 index: 4. Preceding OpId from leader: term: 15 index: 6. (index mismatch)
I20260709 13:05:49.200917 19557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff75a1d4cb1f493db8f71ddc136ba9ab" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:05:49.204022 20109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65d8cb8d6ec64f459d5a47cefab10acf" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 7 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:05:49.204386 19556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1efebf73c86e432baa55533136b6e12c" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:05:49.206398 19404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "172b3dd13109415a955b71ac0e9d2234" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 9 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:05:49.158272 22758 raft_consensus.cc:515] T b08304a0a02b42d7840c4e8ee9a6bd1a P e61c3a8f61bb48f8a963c9480e53c168 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:49.217730 19556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa731b585f684a7fb2d106c50f143b83" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:05:49.211231 19557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c5eebf646ad445a9d1b1adc319d7b16" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:05:49.205047 20104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "172b3dd13109415a955b71ac0e9d2234" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 9 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:05:49.221252 19526 leader_election.cc:304] T a08760e15aac4630a629431f56024dc8 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:05:49.221827 19405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df751f992649444090e27965eb1af85d" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:05:49.224408 19557 raft_consensus.cc:2393] T 6c5eebf646ad445a9d1b1adc319d7b16 P e61c3a8f61bb48f8a963c9480e53c168 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 127766fc592545a4997f7790f50f6076 in current term 8: Already voted for candidate e61c3a8f61bb48f8a963c9480e53c168 in this term.
I20260709 13:05:49.218519 19556 raft_consensus.cc:2468] T fa731b585f684a7fb2d106c50f143b83 P e61c3a8f61bb48f8a963c9480e53c168 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 127766fc592545a4997f7790f50f6076 in term 8.
I20260709 13:05:49.227592 19560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96efeaaf1057492490e9a621f37e1a2d" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:05:49.235683 20110 raft_consensus.cc:2468] T 6c5eebf646ad445a9d1b1adc319d7b16 P 127766fc592545a4997f7790f50f6076 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 8.
I20260709 13:05:49.176415 23028 raft_consensus.cc:493] T f1b10566f45d4a7d9029858330e02d5b P e5256d91808b47c195bc9b4dbd7f2b87 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 0473d2b2d01f4459b1e90fd12cc7840e)
I20260709 13:05:49.199980 23046 raft_consensus.cc:2804] T 3e1f505cb0f1427bbd698ac889d80821 P e5256d91808b47c195bc9b4dbd7f2b87 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:05:49.243791 19404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edd7d470b5014c9489be7f41f64355c9" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 11 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:05:49.269536 19404 raft_consensus.cc:2468] T edd7d470b5014c9489be7f41f64355c9 P e5256d91808b47c195bc9b4dbd7f2b87 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 10.
I20260709 13:05:49.270102 19411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1b10566f45d4a7d9029858330e02d5b" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:05:49.239041 19553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a16f7501e2444fb86d4e2778e734e02" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:05:49.208462 23052 raft_consensus.cc:493] T 70797e5783b5454ab0d0eea663e791e3 P e61c3a8f61bb48f8a963c9480e53c168 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:49.265590 19406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65d8cb8d6ec64f459d5a47cefab10acf" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 7 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:05:49.171999 23023 raft_consensus.cc:493] T 21e14947d70440f19044d8f75c31e1f9 P e5256d91808b47c195bc9b4dbd7f2b87 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:49.210321 22975 raft_consensus.cc:2749] T 309c3ca0ca4b4f3ba129752ea2cb293b P e5256d91808b47c195bc9b4dbd7f2b87 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:05:49.130329 23034 raft_consensus.cc:515] T 2e36a9d6e29c4a7c860cf267efbd4c74 P e61c3a8f61bb48f8a963c9480e53c168 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:49.271735 19553 raft_consensus.cc:3060] T 2a16f7501e2444fb86d4e2778e734e02 P e61c3a8f61bb48f8a963c9480e53c168 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:05:49.209059 23066 raft_consensus.cc:493] T 62c6c134d3d24a1ab144dd9ee6bc3f64 P e61c3a8f61bb48f8a963c9480e53c168 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 0473d2b2d01f4459b1e90fd12cc7840e)
I20260709 13:05:49.155758 23050 consensus_queue.cc:260] T fa8650e71aa14778b3d73721fc50d9fc P 0473d2b2d01f4459b1e90fd12cc7840e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:49.229090 22848 raft_consensus.cc:493] T 4509b76741dc428e9201c70c1658da13 P e5256d91808b47c195bc9b4dbd7f2b87 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 0473d2b2d01f4459b1e90fd12cc7840e)
I20260709 13:05:49.265813 22903 raft_consensus.cc:493] T 775c229504194560ba9589bc2199b089 P 127766fc592545a4997f7790f50f6076 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:49.301415 19560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40e1e16737a842ee936002830f36882e" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:05:49.269225 23046 raft_consensus.cc:493] T 3e1f505cb0f1427bbd698ac889d80821 P e5256d91808b47c195bc9b4dbd7f2b87 [term 9 FOLLOWER]: Starting leader election (detected failure of leader e61c3a8f61bb48f8a963c9480e53c168)
I20260709 13:05:49.219856 22965 consensus_queue.cc:1059] T 309c3ca0ca4b4f3ba129752ea2cb293b P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.074s
I20260709 13:05:49.227329 22974 consensus_queue.cc:1048] T ff75a1d4cb1f493db8f71ddc136ba9ab P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.066s
I20260709 13:05:49.291793 22997 raft_consensus.cc:2804] T a08760e15aac4630a629431f56024dc8 P e61c3a8f61bb48f8a963c9480e53c168 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:05:49.278085 23009 consensus_queue.cc:1048] T 1a61655d99124a29b486ba4a5b37faea P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.031s
I20260709 13:05:49.296077 23037 raft_consensus.cc:493] T 4af19371ea874c09a0a2147040835cbb P e61c3a8f61bb48f8a963c9480e53c168 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader e5256d91808b47c195bc9b4dbd7f2b87)
I20260709 13:05:49.319782 23027 raft_consensus.cc:493] T 0cdf56e38bbc453d9438d359e5a69955 P 0473d2b2d01f4459b1e90fd12cc7840e [term 11 FOLLOWER]: Starting pre-election (detected failure of leader e5256d91808b47c195bc9b4dbd7f2b87)
I20260709 13:05:49.320293 23034 leader_election.cc:290] T 2e36a9d6e29c4a7c860cf267efbd4c74 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 8 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:05:49.314322 22967 consensus_queue.cc:237] T 6c5eebf646ad445a9d1b1adc319d7b16 P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:05:49.291544 23052 raft_consensus.cc:515] T 70797e5783b5454ab0d0eea663e791e3 P e61c3a8f61bb48f8a963c9480e53c168 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:05:49.323058 23052 leader_election.cc:290] T 70797e5783b5454ab0d0eea663e791e3 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:05:49.293565 23023 raft_consensus.cc:515] T 21e14947d70440f19044d8f75c31e1f9 P e5256d91808b47c195bc9b4dbd7f2b87 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:49.314189 22997 raft_consensus.cc:493] T a08760e15aac4630a629431f56024dc8 P e61c3a8f61bb48f8a963c9480e53c168 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:49.323786 22997 raft_consensus.cc:3060] T a08760e15aac4630a629431f56024dc8 P e61c3a8f61bb48f8a963c9480e53c168 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:05:49.324976 23023 leader_election.cc:290] T 21e14947d70440f19044d8f75c31e1f9 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:05:49.320317 23027 raft_consensus.cc:515] T 0cdf56e38bbc453d9438d359e5a69955 P 0473d2b2d01f4459b1e90fd12cc7840e [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:49.328234 23027 leader_election.cc:290] T 0cdf56e38bbc453d9438d359e5a69955 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
W20260709 13:05:49.331207 23078 log.cc:927] Time spent T 28af091831594f9d8e96482078cc7625 P 0473d2b2d01f4459b1e90fd12cc7840e: Append to log took a long time: real 0.094s	user 0.000s	sys 0.001s
I20260709 13:05:49.336649 22997 raft_consensus.cc:515] T a08760e15aac4630a629431f56024dc8 P e61c3a8f61bb48f8a963c9480e53c168 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:49.344760 22880 leader_election.cc:290] T 5ec1c4ce15e04c7e8c283a62179f2a64 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:05:49.326450 19410 raft_consensus.cc:2468] T 21e14947d70440f19044d8f75c31e1f9 P e5256d91808b47c195bc9b4dbd7f2b87 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 8.
W20260709 13:05:49.328114 23070 log.cc:927] Time spent T ff9b0eddd810459b82d91c60777c10eb P e5256d91808b47c195bc9b4dbd7f2b87: Append to log took a long time: real 0.120s	user 0.000s	sys 0.001s
I20260709 13:05:49.348371 19481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff9b0eddd810459b82d91c60777c10eb" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:05:49.310699 23046 raft_consensus.cc:3060] T 3e1f505cb0f1427bbd698ac889d80821 P e5256d91808b47c195bc9b4dbd7f2b87 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:05:49.357059 19481 raft_consensus.cc:2376] T ff9b0eddd810459b82d91c60777c10eb P 0473d2b2d01f4459b1e90fd12cc7840e [term 8 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 8. Re-sending same reply.
I20260709 13:05:49.279532 23028 raft_consensus.cc:515] T f1b10566f45d4a7d9029858330e02d5b P e5256d91808b47c195bc9b4dbd7f2b87 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:49.348995 19485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa8650e71aa14778b3d73721fc50d9fc" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:05:49.359769 19480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40e1e16737a842ee936002830f36882e" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:05:49.363111 23072 raft_consensus.cc:697] T 7be9efa6559648dbb5a0f7684c4542d1 P 0473d2b2d01f4459b1e90fd12cc7840e [term 9 LEADER]: Becoming Leader. State: Replica: 0473d2b2d01f4459b1e90fd12cc7840e, State: Running, Role: LEADER
I20260709 13:05:49.369797 22997 leader_election.cc:290] T a08760e15aac4630a629431f56024dc8 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 11 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
W20260709 13:05:49.371682 19524 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:49.403551 19482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14efcc79969f41babe5529c22d59156d" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:05:49.401634 19480 raft_consensus.cc:2468] T 40e1e16737a842ee936002830f36882e P 0473d2b2d01f4459b1e90fd12cc7840e [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 12.
I20260709 13:05:49.405993 19557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cdf56e38bbc453d9438d359e5a69955" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:05:49.406185 19478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f575b143b844aa096b50997dad3516a" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:05:49.408016 19449 leader_election.cc:304] T 28af091831594f9d8e96482078cc7625 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e; no voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:05:49.411903 19558 raft_consensus.cc:1275] T 46c5bfeecc314717bffe987e6844b6d0 P e61c3a8f61bb48f8a963c9480e53c168 [term 15 FOLLOWER]: Refusing update from remote peer 0473d2b2d01f4459b1e90fd12cc7840e: Log matching property violated. Preceding OpId in replica: term: 9 index: 4. Preceding OpId from leader: term: 15 index: 6. (index mismatch)
I20260709 13:05:49.385965 19483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ec1c4ce15e04c7e8c283a62179f2a64" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
W20260709 13:05:49.397571 19374 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.4:43121, user_credentials={real_user=slave}} blocked reactor thread for 165736us
I20260709 13:05:49.401170 19479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "309c3ca0ca4b4f3ba129752ea2cb293b" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:05:49.413365 19374 leader_election.cc:304] T 85c494af21f9457a85da47b9bc70c1fd P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87; no voters: 127766fc592545a4997f7790f50f6076, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:05:49.413651 19483 raft_consensus.cc:2468] T 5ec1c4ce15e04c7e8c283a62179f2a64 P 0473d2b2d01f4459b1e90fd12cc7840e [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 8.
I20260709 13:05:49.401484 19555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa731b585f684a7fb2d106c50f143b83" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:05:49.402500 19486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef32ce6fdd0e40d382c79974f30295c6" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:05:49.414332 22830 raft_consensus.cc:2749] T 85c494af21f9457a85da47b9bc70c1fd P e5256d91808b47c195bc9b4dbd7f2b87 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:05:49.415158 22860 raft_consensus.cc:697] T ef32ce6fdd0e40d382c79974f30295c6 P e5256d91808b47c195bc9b4dbd7f2b87 [term 11 LEADER]: Becoming Leader. State: Replica: e5256d91808b47c195bc9b4dbd7f2b87, State: Running, Role: LEADER
I20260709 13:05:49.415673 19555 raft_consensus.cc:2468] T fa731b585f684a7fb2d106c50f143b83 P e61c3a8f61bb48f8a963c9480e53c168 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 8.
I20260709 13:05:49.415699 19374 leader_election.cc:304] T fa731b585f684a7fb2d106c50f143b83 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 127766fc592545a4997f7790f50f6076, e5256d91808b47c195bc9b4dbd7f2b87; no voters: 
I20260709 13:05:49.416939 22830 raft_consensus.cc:2804] T fa731b585f684a7fb2d106c50f143b83 P e5256d91808b47c195bc9b4dbd7f2b87 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:05:49.417325 22830 raft_consensus.cc:493] T fa731b585f684a7fb2d106c50f143b83 P e5256d91808b47c195bc9b4dbd7f2b87 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:49.416087 22860 consensus_queue.cc:237] T ef32ce6fdd0e40d382c79974f30295c6 P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:49.417644 22830 raft_consensus.cc:3060] T fa731b585f684a7fb2d106c50f143b83 P e5256d91808b47c195bc9b4dbd7f2b87 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:05:49.417590 19403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "309c3ca0ca4b4f3ba129752ea2cb293b" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
I20260709 13:05:49.301328 23066 raft_consensus.cc:515] T 62c6c134d3d24a1ab144dd9ee6bc3f64 P e61c3a8f61bb48f8a963c9480e53c168 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:05:49.424015 19556 raft_consensus.cc:1275] T 22196caba61445d3bec98a0aab3c337d P e61c3a8f61bb48f8a963c9480e53c168 [term 9 FOLLOWER]: Refusing update from remote peer 0473d2b2d01f4459b1e90fd12cc7840e: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:05:49.424007 19449 leader_election.cc:304] T b9f0d59553ad444883fcf5b5909f9798 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e; no voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:05:49.425163 20112 raft_consensus.cc:2468] T 2a16f7501e2444fb86d4e2778e734e02 P 127766fc592545a4997f7790f50f6076 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 10.
I20260709 13:05:49.307058 22848 raft_consensus.cc:515] T 4509b76741dc428e9201c70c1658da13 P e5256d91808b47c195bc9b4dbd7f2b87 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:49.307312 22903 raft_consensus.cc:515] T 775c229504194560ba9589bc2199b089 P 127766fc592545a4997f7790f50f6076 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:05:49.440326 19481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e381f1d6b8184797ad142de49be225a8" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:05:49.441342 19411 raft_consensus.cc:2468] T f1b10566f45d4a7d9029858330e02d5b P e5256d91808b47c195bc9b4dbd7f2b87 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 10.
I20260709 13:05:49.442248 19560 raft_consensus.cc:1275] T 21e14947d70440f19044d8f75c31e1f9 P e61c3a8f61bb48f8a963c9480e53c168 [term 8 FOLLOWER]: Refusing update from remote peer 0473d2b2d01f4459b1e90fd12cc7840e: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:05:49.447687 19408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ec1c4ce15e04c7e8c283a62179f2a64" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:05:49.448346 19408 raft_consensus.cc:2468] T 5ec1c4ce15e04c7e8c283a62179f2a64 P e5256d91808b47c195bc9b4dbd7f2b87 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 127766fc592545a4997f7790f50f6076 in term 8.
I20260709 13:05:49.357846 23050 raft_consensus.cc:3060] T fa8650e71aa14778b3d73721fc50d9fc P 0473d2b2d01f4459b1e90fd12cc7840e [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:05:49.451790 19403 raft_consensus.cc:1240] T 1f85fc4b527a48848e5faa083b604e36 P e5256d91808b47c195bc9b4dbd7f2b87 [term 6 FOLLOWER]: Rejecting Update request from peer 127766fc592545a4997f7790f50f6076 for earlier term 5. Current term is 6. Ops: []
I20260709 13:05:49.454902 19406 raft_consensus.cc:1240] T ab43d85f64114d4ebf618930e43d9ed0 P e5256d91808b47c195bc9b4dbd7f2b87 [term 9 FOLLOWER]: Rejecting Update request from peer 127766fc592545a4997f7790f50f6076 for earlier term 8. Current term is 9. Ops: []
W20260709 13:05:49.459007 19526 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:05:49.460847 19452 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:49.424890 22896 raft_consensus.cc:2749] T 28af091831594f9d8e96482078cc7625 P 0473d2b2d01f4459b1e90fd12cc7840e [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:05:49.463052 19408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa731b585f684a7fb2d106c50f143b83" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:05:49.464175 20112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70797e5783b5454ab0d0eea663e791e3" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:05:49.464749 20112 raft_consensus.cc:2468] T 70797e5783b5454ab0d0eea663e791e3 P 127766fc592545a4997f7790f50f6076 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 9.
I20260709 13:05:49.466367 20109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ec1c4ce15e04c7e8c283a62179f2a64" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:05:49.466717 19481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96efeaaf1057492490e9a621f37e1a2d" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:05:49.467139 20109 raft_consensus.cc:2468] T 5ec1c4ce15e04c7e8c283a62179f2a64 P 127766fc592545a4997f7790f50f6076 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 7.
I20260709 13:05:49.467494 19481 raft_consensus.cc:3060] T 96efeaaf1057492490e9a621f37e1a2d P 0473d2b2d01f4459b1e90fd12cc7840e [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:05:49.475221 19406 raft_consensus.cc:1275] T 14935b3ddf914369822e4a0547aaa355 P e5256d91808b47c195bc9b4dbd7f2b87 [term 8 FOLLOWER]: Refusing update from remote peer 127766fc592545a4997f7790f50f6076: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260709 13:05:49.471143 19480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1efebf73c86e432baa55533136b6e12c" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:05:49.476356 19480 raft_consensus.cc:3060] T 1efebf73c86e432baa55533136b6e12c P 0473d2b2d01f4459b1e90fd12cc7840e [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:05:49.479075 19560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70797e5783b5454ab0d0eea663e791e3" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:05:49.420085 23037 raft_consensus.cc:515] T 4af19371ea874c09a0a2147040835cbb P e61c3a8f61bb48f8a963c9480e53c168 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:05:49.471047 20075 leader_election.cc:304] T 5ec1c4ce15e04c7e8c283a62179f2a64 P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 127766fc592545a4997f7790f50f6076, e5256d91808b47c195bc9b4dbd7f2b87; no voters: 0473d2b2d01f4459b1e90fd12cc7840e
I20260709 13:05:49.484207 19374 leader_election.cc:304] T 2a16f7501e2444fb86d4e2778e734e02 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 127766fc592545a4997f7790f50f6076, e5256d91808b47c195bc9b4dbd7f2b87; no voters: 
I20260709 13:05:49.479823 19560 raft_consensus.cc:2468] T 70797e5783b5454ab0d0eea663e791e3 P e61c3a8f61bb48f8a963c9480e53c168 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 9.
I20260709 13:05:49.493304 19374 leader_election.cc:304] T 70797e5783b5454ab0d0eea663e791e3 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 127766fc592545a4997f7790f50f6076, e5256d91808b47c195bc9b4dbd7f2b87; no voters: 
I20260709 13:05:49.470564 22890 raft_consensus.cc:3060] T 2725d2c4cb054f18b0fc8f735c15f6c2 P e61c3a8f61bb48f8a963c9480e53c168 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:05:49.496743 19523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.1:40321, user_credentials={real_user=slave}} blocked reactor thread for 292703us
I20260709 13:05:49.501221 19374 leader_election.cc:304] T 5ec1c4ce15e04c7e8c283a62179f2a64 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 127766fc592545a4997f7790f50f6076, e5256d91808b47c195bc9b4dbd7f2b87; no voters: 
I20260709 13:05:49.471172 22997 raft_consensus.cc:493] T bc225c93219c45538b53a1bd3d387e4d P e61c3a8f61bb48f8a963c9480e53c168 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader e5256d91808b47c195bc9b4dbd7f2b87)
I20260709 13:05:49.480397 23083 raft_consensus.cc:493] T 1dc5b3532fe54f74876d02beffa2c230 P 0473d2b2d01f4459b1e90fd12cc7840e [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:49.484911 23060 raft_consensus.cc:493] T d1e5873a19244c5ebbcd38e126796ee7 P e5256d91808b47c195bc9b4dbd7f2b87 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader e61c3a8f61bb48f8a963c9480e53c168)
I20260709 13:05:49.519194 19480 raft_consensus.cc:2468] T 1efebf73c86e432baa55533136b6e12c P 0473d2b2d01f4459b1e90fd12cc7840e [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 127766fc592545a4997f7790f50f6076 in term 8.
I20260709 13:05:49.525465 19523 leader_election.cc:304] T e381f1d6b8184797ad142de49be225a8 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168; no voters: 0473d2b2d01f4459b1e90fd12cc7840e
I20260709 13:05:49.495097 23091 raft_consensus.cc:493] T f93ee515a9c14139bf566522ed8232f3 P e5256d91808b47c195bc9b4dbd7f2b87 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader e61c3a8f61bb48f8a963c9480e53c168)
I20260709 13:05:49.560403 19480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a08760e15aac4630a629431f56024dc8" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:05:49.561458 19480 raft_consensus.cc:2468] T a08760e15aac4630a629431f56024dc8 P 0473d2b2d01f4459b1e90fd12cc7840e [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 10.
I20260709 13:05:49.511312 22845 raft_consensus.cc:2804] T 2a16f7501e2444fb86d4e2778e734e02 P e5256d91808b47c195bc9b4dbd7f2b87 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:05:49.511735 22965 raft_consensus.cc:2749] T b9f0d59553ad444883fcf5b5909f9798 P 0473d2b2d01f4459b1e90fd12cc7840e [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:05:49.516857 23051 consensus_meta.cc:287] T 179fd671030940b4b4a4e24bcc4aba0a P 0473d2b2d01f4459b1e90fd12cc7840e: Time spent flushing consensus metadata: real 0.615s	user 0.007s	sys 0.004s
I20260709 13:05:49.516023 22880 raft_consensus.cc:2804] T 70797e5783b5454ab0d0eea663e791e3 P e5256d91808b47c195bc9b4dbd7f2b87 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:05:49.588792 22700 leader_election.cc:290] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:05:49.589368 22880 raft_consensus.cc:493] T 70797e5783b5454ab0d0eea663e791e3 P e5256d91808b47c195bc9b4dbd7f2b87 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:49.589874 22880 raft_consensus.cc:3060] T 70797e5783b5454ab0d0eea663e791e3 P e5256d91808b47c195bc9b4dbd7f2b87 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:05:49.590989 23020 leader_election.cc:290] T 14935b3ddf914369822e4a0547aaa355 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:05:49.592842 22859 leader_election.cc:290] T ab43d85f64114d4ebf618930e43d9ed0 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 9 election: Requested vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:05:49.600244 23037 leader_election.cc:290] T 4af19371ea874c09a0a2147040835cbb P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:05:49.602409 22845 raft_consensus.cc:697] T 2a16f7501e2444fb86d4e2778e734e02 P e5256d91808b47c195bc9b4dbd7f2b87 [term 10 LEADER]: Becoming Leader. State: Replica: e5256d91808b47c195bc9b4dbd7f2b87, State: Running, Role: LEADER
I20260709 13:05:49.588722 22722 raft_consensus.cc:515] T 0afb57ae58a24a01850491d69f0213dd P 0473d2b2d01f4459b1e90fd12cc7840e [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:05:49.603433 22845 consensus_queue.cc:237] T 2a16f7501e2444fb86d4e2778e734e02 P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:05:49.522806 22999 raft_consensus.cc:2804] T 5ec1c4ce15e04c7e8c283a62179f2a64 P 127766fc592545a4997f7790f50f6076 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:05:49.604490 22999 raft_consensus.cc:493] T 5ec1c4ce15e04c7e8c283a62179f2a64 P 127766fc592545a4997f7790f50f6076 [term 7 FOLLOWER]: Starting leader election (detected failure of leader e5256d91808b47c195bc9b4dbd7f2b87)
I20260709 13:05:49.604911 22999 raft_consensus.cc:3060] T 5ec1c4ce15e04c7e8c283a62179f2a64 P 127766fc592545a4997f7790f50f6076 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:05:49.605029 22722 leader_election.cc:290] T 0afb57ae58a24a01850491d69f0213dd P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 10 election: Requested vote from peers e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
W20260709 13:05:49.564209 19450 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.3:36891, user_credentials={real_user=slave}} blocked reactor thread for 135208us
W20260709 13:05:49.541229 19375 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:49.569695 19553 raft_consensus.cc:2468] T 2a16f7501e2444fb86d4e2778e734e02 P e61c3a8f61bb48f8a963c9480e53c168 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 10.
I20260709 13:05:49.549362 19523 leader_election.cc:304] T 7f575b143b844aa096b50997dad3516a P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e61c3a8f61bb48f8a963c9480e53c168; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:05:49.571144 22903 leader_election.cc:290] T 775c229504194560ba9589bc2199b089 P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:05:49.571653 22912 raft_consensus.cc:493] T 4af19371ea874c09a0a2147040835cbb P 127766fc592545a4997f7790f50f6076 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader e5256d91808b47c195bc9b4dbd7f2b87)
I20260709 13:05:49.572094 23097 raft_consensus.cc:493] T ff9b0eddd810459b82d91c60777c10eb P 0473d2b2d01f4459b1e90fd12cc7840e [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:49.519794 23019 raft_consensus.cc:2804] T 5ec1c4ce15e04c7e8c283a62179f2a64 P e5256d91808b47c195bc9b4dbd7f2b87 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:05:49.523280 22974 consensus_queue.cc:1059] T ff75a1d4cb1f493db8f71ddc136ba9ab P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.055s
I20260709 13:05:49.575009 19558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21e14947d70440f19044d8f75c31e1f9" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:05:49.519627 23084 consensus_queue.cc:1048] T 46c5bfeecc314717bffe987e6844b6d0 P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.072s
I20260709 13:05:49.579511 23028 leader_election.cc:290] T f1b10566f45d4a7d9029858330e02d5b P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:05:49.581296 19478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c5eebf646ad445a9d1b1adc319d7b16" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:05:49.582736 19479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21e14947d70440f19044d8f75c31e1f9" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:05:49.587564 22848 leader_election.cc:290] T 4509b76741dc428e9201c70c1658da13 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:05:49.521533 22758 leader_election.cc:290] T b08304a0a02b42d7840c4e8ee9a6bd1a P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:05:49.526058 23083 raft_consensus.cc:515] T 1dc5b3532fe54f74876d02beffa2c230 P 0473d2b2d01f4459b1e90fd12cc7840e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:49.603454 23066 leader_election.cc:290] T 62c6c134d3d24a1ab144dd9ee6bc3f64 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:05:50.352797 22903 raft_consensus.cc:493] T 833a2f0775ed407a94b8924ce50adb63 P 127766fc592545a4997f7790f50f6076 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:49.823666 23046 raft_consensus.cc:515] T 3e1f505cb0f1427bbd698ac889d80821 P e5256d91808b47c195bc9b4dbd7f2b87 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:50.353809 22903 raft_consensus.cc:515] T 833a2f0775ed407a94b8924ce50adb63 P 127766fc592545a4997f7790f50f6076 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
W20260709 13:05:50.190775 19377 leader_election.cc:336] T 7f575b143b844aa096b50997dad3516a P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257): Timed out: RequestConsensusVote RPC to 127.17.223.2:46257 timed out after 1.593s (SENT)
I20260709 13:05:50.149886 19483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff75a1d4cb1f493db8f71ddc136ba9ab" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
W20260709 13:05:49.838598 19524 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:05:49.746032 22964 consensus_meta.cc:287] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P 0473d2b2d01f4459b1e90fd12cc7840e: Time spent flushing consensus metadata: real 0.672s	user 0.006s	sys 0.007s
W20260709 13:05:50.356994 19377 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.2:46257, user_credentials={real_user=slave}} blocked reactor thread for 166294us
I20260709 13:05:49.840091 20112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14935b3ddf914369822e4a0547aaa355" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
W20260709 13:05:49.704286 23040 log.cc:927] Time spent T 172b3dd13109415a955b71ac0e9d2234 P 127766fc592545a4997f7790f50f6076: Append to log took a long time: real 0.102s	user 0.001s	sys 0.000s
I20260709 13:05:50.084025 22700 raft_consensus.cc:493] T 7f575b143b844aa096b50997dad3516a P e5256d91808b47c195bc9b4dbd7f2b87 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:05:50.358052 19523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.1:40321, user_credentials={real_user=slave}} blocked reactor thread for 808774us
I20260709 13:05:50.357837 23097 raft_consensus.cc:515] T ff9b0eddd810459b82d91c60777c10eb P 0473d2b2d01f4459b1e90fd12cc7840e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:05:49.617105 19482 raft_consensus.cc:2468] T 14efcc79969f41babe5529c22d59156d P 0473d2b2d01f4459b1e90fd12cc7840e [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 10.
I20260709 13:05:49.815479 23049 raft_consensus.cc:493] T ff75a1d4cb1f493db8f71ddc136ba9ab P 0473d2b2d01f4459b1e90fd12cc7840e [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:49.565785 23091 raft_consensus.cc:515] T f93ee515a9c14139bf566522ed8232f3 P e5256d91808b47c195bc9b4dbd7f2b87 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:50.359421 19480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36f6ba92b9ba46babe4ebd6c02e5fbd9" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:05:50.359683 23019 raft_consensus.cc:493] T 5ec1c4ce15e04c7e8c283a62179f2a64 P e5256d91808b47c195bc9b4dbd7f2b87 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:50.351027 22972 raft_consensus.cc:3060] T df751f992649444090e27965eb1af85d P e5256d91808b47c195bc9b4dbd7f2b87 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:05:50.359992 19553 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40438 (request call id 2117) took 1122 ms. Trace:
W20260709 13:05:50.351506 19449 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.1:40321, user_credentials={real_user=slave}} blocked reactor thread for 927522us
I20260709 13:05:50.362377 22890 raft_consensus.cc:3055] T ff75a1d4cb1f493db8f71ddc136ba9ab P e61c3a8f61bb48f8a963c9480e53c168 [term 8 LEADER]: Stepping down as leader of term 8
W20260709 13:05:50.123847 19552 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.608s	user 0.005s	sys 0.005s
W20260709 13:05:50.418542 19552 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.906s	user 0.006s	sys 0.008s
I20260709 13:05:50.392956 23028 raft_consensus.cc:493] T 22196caba61445d3bec98a0aab3c337d P e5256d91808b47c195bc9b4dbd7f2b87 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:50.081310 22977 raft_consensus.cc:493] T 7be9efa6559648dbb5a0f7684c4542d1 P e5256d91808b47c195bc9b4dbd7f2b87 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:05:49.894876 19452 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:05:50.364588 20075 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.1:40321, user_credentials={real_user=slave}} blocked reactor thread for 893553us
I20260709 13:05:50.362368 23126 raft_consensus.cc:3060] T 7f575b143b844aa096b50997dad3516a P e61c3a8f61bb48f8a963c9480e53c168 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:05:49.569458 22898 raft_consensus.cc:2804] T e381f1d6b8184797ad142de49be225a8 P e61c3a8f61bb48f8a963c9480e53c168 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:05:50.366827 22974 raft_consensus.cc:493] T 86a6797bdfe94fa496c050ceae4bd0d9 P e61c3a8f61bb48f8a963c9480e53c168 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:49.540148 23060 raft_consensus.cc:515] T d1e5873a19244c5ebbcd38e126796ee7 P e5256d91808b47c195bc9b4dbd7f2b87 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:50.368045 22840 consensus_queue.cc:1048] T 21e14947d70440f19044d8f75c31e1f9 P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:05:49.618571 23072 consensus_queue.cc:237] T 7be9efa6559648dbb5a0f7684c4542d1 P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.6, Last appended by leader: 6, Current term: 9, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } attrs { replace: true } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
W20260709 13:05:50.176517 19407 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.637s	user 0.001s	sys 0.006s
W20260709 13:05:50.506909 19407 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.984s	user 0.002s	sys 0.009s
I20260709 13:05:50.368616 23075 consensus_queue.cc:1048] T 22196caba61445d3bec98a0aab3c337d P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:05:50.075273 23054 raft_consensus.cc:493] T bc225c93219c45538b53a1bd3d387e4d P 0473d2b2d01f4459b1e90fd12cc7840e [term 10 FOLLOWER]: Starting pre-election (detected failure of leader e5256d91808b47c195bc9b4dbd7f2b87)
I20260709 13:05:49.657709 22830 raft_consensus.cc:515] T fa731b585f684a7fb2d106c50f143b83 P e5256d91808b47c195bc9b4dbd7f2b87 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:05:49.814741 19555 raft_consensus.cc:1275] T 2725d2c4cb054f18b0fc8f735c15f6c2 P e61c3a8f61bb48f8a963c9480e53c168 [term 10 FOLLOWER]: Refusing update from remote peer e5256d91808b47c195bc9b4dbd7f2b87: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 10 index: 5. (term mismatch)
I20260709 13:05:49.838702 20110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab43d85f64114d4ebf618930e43d9ed0" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076"
I20260709 13:05:50.371845 19479 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58294 (request call id 2020) took 1017 ms. Trace:
I20260709 13:05:50.372440 19558 raft_consensus.cc:2468] T 21e14947d70440f19044d8f75c31e1f9 P e61c3a8f61bb48f8a963c9480e53c168 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 8.
I20260709 13:05:50.220049 19477 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58286 (request call id 1777) took 1691 ms. Trace:
I20260709 13:05:50.107818 23027 raft_consensus.cc:3055] T 309c3ca0ca4b4f3ba129752ea2cb293b P 0473d2b2d01f4459b1e90fd12cc7840e [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:05:50.373056 19554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1b10566f45d4a7d9029858330e02d5b" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:05:50.056227 22821 leader_election.cc:290] T 217b5fae677b4971b3bbd2f357a1f7ff P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:05:50.201342 18300 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:05:50.148490 23020 raft_consensus.cc:493] T 76cb037fc9064d13b59a8969d897ce8c P e5256d91808b47c195bc9b4dbd7f2b87 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:50.373770 19556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4509b76741dc428e9201c70c1658da13" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
W20260709 13:05:50.223263 22896 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.543s	user 0.006s	sys 0.006s
I20260709 13:05:49.898041 20108 raft_consensus.cc:1275] T ff9b0eddd810459b82d91c60777c10eb P 127766fc592545a4997f7790f50f6076 [term 8 FOLLOWER]: Refusing update from remote peer e5256d91808b47c195bc9b4dbd7f2b87: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:05:50.374544 19557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14935b3ddf914369822e4a0547aaa355" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:05:50.372568 19559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab43d85f64114d4ebf618930e43d9ed0" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:05:50.369925 22912 raft_consensus.cc:515] T 4af19371ea874c09a0a2147040835cbb P 127766fc592545a4997f7790f50f6076 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:05:50.147890 22978 raft_consensus.cc:493] T 76cb037fc9064d13b59a8969d897ce8c P 0473d2b2d01f4459b1e90fd12cc7840e [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:05:49.645388 23065 log.cc:927] Time spent T d1e5873a19244c5ebbcd38e126796ee7 P 0473d2b2d01f4459b1e90fd12cc7840e: Append to log took a long time: real 0.051s	user 0.001s	sys 0.000s
W20260709 13:05:49.662200 23038 consensus_meta.cc:287] T ef32ce6fdd0e40d382c79974f30295c6 P 0473d2b2d01f4459b1e90fd12cc7840e: Time spent flushing consensus metadata: real 0.819s	user 0.008s	sys 0.003s
W20260709 13:05:50.199057 23106 log.cc:927] Time spent T 217b5fae677b4971b3bbd2f357a1f7ff P e5256d91808b47c195bc9b4dbd7f2b87: Append to log took a long time: real 0.172s	user 0.001s	sys 0.000s
I20260709 13:05:49.829660 19481 raft_consensus.cc:2468] T 96efeaaf1057492490e9a621f37e1a2d P 0473d2b2d01f4459b1e90fd12cc7840e [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 127766fc592545a4997f7790f50f6076 in term 10.
I20260709 13:05:50.537739 19481 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39478 (request call id 470) took 1162 ms. Trace:
I20260709 13:05:50.538058 19481 rpcz_store.cc:276] 0709 13:05:49.376558 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:49.453936 (+ 77378us) service_pool.cc:224] Handling call
0709 13:05:50.537655 (+1083719us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:05:50.377206 23083 leader_election.cc:290] T 1dc5b3532fe54f74876d02beffa2c230 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:05:50.377492 19484 raft_consensus.cc:2468] T 179fd671030940b4b4a4e24bcc4aba0a P 0473d2b2d01f4459b1e90fd12cc7840e [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 9.
I20260709 13:05:49.839332 20109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36f6ba92b9ba46babe4ebd6c02e5fbd9" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:05:50.526062 19477 rpcz_store.cc:276] 0709 13:05:48.482322 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:48.489073 (+  6751us) service_pool.cc:224] Handling call
0709 13:05:48.518478 (+ 29405us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:48.578710 (+ 60232us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:05:48.587176 (+  8466us) log.cc:844] Serialized 14 byte log entry
0709 13:05:48.685976 (+ 98800us) log.cc:844] Serialized 14 byte log entry
0709 13:05:48.700499 (+ 14523us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:05:48.700545 (+    46us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:05:48.700590 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:49.126486 (+425896us) spinlock_profiling.cc:243] Waited 926 us on lock 0x7b1800073ea0. stack: 00007f4a79de9343 00007f4a79de9240 00007f4a797781d4 00007f4a834b6304 00007f4a834b6299 00007f4a82ce3de1 00007f4a82cf05b1 00007f4a79e1b522 00007f4a79e1d7c1 00007f4a79e1d779 00007f4a79e1d709 00007f4a79e1d6d1 00007f4a79e1c9cd 000000000038f354 000000000038f199 00007f4a79dfe83a
0709 13:05:49.592260 (+465774us) spinlock_profiling.cc:243] Waited 1.21 ms on lock 0x7b1800073ea0. stack: 00007f4a79de9343 00007f4a79de9240 00007f4a797781d4 00007f4a834b6304 00007f4a834b6299 00007f4a82ce3de1 00007f4a82cf05b1 00007f4a79de92a6 00007f4a79de9240 00007f4a797781d4 00007f4a834b6304 00007f4a834b6299 00007f4a82ce3de1 00007f4a82cf05b1 00007f4a79e1b3f3 00007f4a79e1d7c1
0709 13:05:49.593985 (+  1725us) spinlock_profiling.cc:243] Waited 11.2 ms on lock 0x7b1800073ea0. stack: 00007f4a79de9343 00007f4a79de9240 00007f4a797781d4 00007f4a834b6304 00007f4a834b6299 00007f4a82ce3de1 00007f4a82cf05b1 00007f4a79e1b3f3 00007f4a79e1d7c1 00007f4a79e1d779 00007f4a79e1d709 00007f4a79e1d6d1 00007f4a79e1c9cd 000000000038f354 000000000038f199 00007f4a79dfe83a
0709 13:05:49.600889 (+  6904us) spinlock_profiling.cc:243] Waited 29.7 ms on lock 0x7b1800073ea0. stack: 00007f4a79de9343 00007f4a79de9240 00007f4a797781d4 00007f4a834b6304 00007f4a834b6299 00007f4a82ce3de1 00007f4a82cf05b1 00007f4a79e1b522 00007f4a79e1d7c1 00007f4a79e1d779 00007f4a79e1d709 00007f4a79e1d6d1 00007f4a79e1c9cd 000000000038f354 000000000038f199 00007f4a79dfe83a
0709 13:05:49.658623 (+ 57734us) spinlock_profiling.cc:243] Waited 12.7 ms on lock 0x7b1800073ea0. stack: 00007f4a79de9343 00007f4a79de9240 00007f4a797781d4 00007f4a834b6304 00007f4a834b6299 00007f4a82ce3de1 00007f4a82cf05b1 00007f4a79de92a6 00007f4a79de9240 00007f4a797781d4 00007f4a834b6304 00007f4a834b6299 00007f4a7ce71571 00007f4a7cf08e01 00007f4a7cf0783e 00007f4a81ecc419
0709 13:05:49.809120 (+150497us) spinlock_profiling.cc:243] Waited 14.1 ms on lock 0x7b1800073ea0. stack: 00007f4a79de9343 00007f4a79de9240 00007f4a797781d4 00007f4a834b6304 00007f4a834b6299 00007f4a82ce3de1 00007f4a82cf05b1 00007f4a79e1b3f3 00007f4a79e1d7c1 00007f4a79e1d779 00007f4a79e1d709 00007f4a79e1d6d1 00007f4a79e1c9cd 000000000038f354 000000000038f199 00007f4a79dfe83a
0709 13:05:50.173471 (+364351us) spinlock_profiling.cc:243] Waited 60 ms on lock 0x7b54000a9e54. stack: 00007f4a79de9343 00007f4a79de9240 00007f4a797781d4 00007f4a834b6304 00007f4a834b6299 00007f4a7ce71571 00007f4a7cf08e01 00007f4a7cf0783e 00007f4a81ecc419 00007f4a7b443bd4 00007f4a7b443b62 00007f4a7b443a91 00007f4a7b443a0c 00007f4a7b442cc2 00007f4a7b24348c 00007f4a7b2428c6
0709 13:05:50.173554 (+    83us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:50.173741 (+   187us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":9151,"prepare.queue_time_us":7127,"prepare.run_cpu_time_us":63,"prepare.run_wall_time_us":65,"raft.queue_time_us":1065,"raft.run_cpu_time_us":234,"raft.run_wall_time_us":4661,"spinlock_wait_cycles":298512512,"thread_start_us":93791,"threads_started":1,"wal-append.queue_time_us":101105}
I20260709 13:05:50.027966 22880 raft_consensus.cc:515] T 70797e5783b5454ab0d0eea663e791e3 P e5256d91808b47c195bc9b4dbd7f2b87 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:05:49.524384 22997 raft_consensus.cc:515] T bc225c93219c45538b53a1bd3d387e4d P e61c3a8f61bb48f8a963c9480e53c168 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
W20260709 13:05:50.123170 20104 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.504s	user 0.000s	sys 0.011s
W20260709 13:05:49.637295 23055 consensus_meta.cc:287] T b08304a0a02b42d7840c4e8ee9a6bd1a P e5256d91808b47c195bc9b4dbd7f2b87: Time spent flushing consensus metadata: real 0.957s	user 0.007s	sys 0.004s
I20260709 13:05:50.372511 19375 leader_election.cc:304] T a08760e15aac4630a629431f56024dc8 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:05:50.391106 22848 raft_consensus.cc:493] T 1a61655d99124a29b486ba4a5b37faea P e5256d91808b47c195bc9b4dbd7f2b87 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:50.412705 19482 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58294 (request call id 2002) took 1050 ms. Trace:
I20260709 13:05:50.574626 19558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e381f1d6b8184797ad142de49be225a8" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:05:50.528712 22903 leader_election.cc:290] T 833a2f0775ed407a94b8924ce50adb63 P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:05:50.390836 19478 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39478 (request call id 471) took 1014 ms. Trace:
I20260709 13:05:50.415055 19449 leader_election.cc:304] T 2e36a9d6e29c4a7c860cf267efbd4c74 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87; no voters: e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:05:50.415619 19553 rpcz_store.cc:276] 0709 13:05:49.237931 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:49.238721 (+   790us) service_pool.cc:224] Handling call
0709 13:05:50.359904 (+1121183us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:05:50.399305 19523 leader_election.cc:304] T 1dc5b3532fe54f74876d02beffa2c230 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
W20260709 13:05:50.646157 19523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.1:40321, user_credentials={real_user=slave}} blocked reactor thread for 246926us
I20260709 13:05:50.647220 19556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "217b5fae677b4971b3bbd2f357a1f7ff" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
W20260709 13:05:50.647842 23119 log.cc:927] Time spent T 217b5fae677b4971b3bbd2f357a1f7ff P 0473d2b2d01f4459b1e90fd12cc7840e: Append to log took a long time: real 0.075s	user 0.000s	sys 0.000s
I20260709 13:05:50.648226 19523 leader_election.cc:304] T edd7d470b5014c9489be7f41f64355c9 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:05:50.533317 23054 raft_consensus.cc:515] T bc225c93219c45538b53a1bd3d387e4d P 0473d2b2d01f4459b1e90fd12cc7840e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
W20260709 13:05:50.096704 23086 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.585s	user 0.016s	sys 0.011s
I20260709 13:05:50.648959 19553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dc5b3532fe54f74876d02beffa2c230" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
W20260709 13:05:50.649179 23086 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.145s	user 0.019s	sys 0.013s
I20260709 13:05:50.649560 19553 raft_consensus.cc:2468] T 1dc5b3532fe54f74876d02beffa2c230 P e61c3a8f61bb48f8a963c9480e53c168 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 8.
I20260709 13:05:50.650298 23054 leader_election.cc:290] T bc225c93219c45538b53a1bd3d387e4d P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:05:50.651244 19481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f85fc4b527a48848e5faa083b604e36" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:05:50.651777 19481 raft_consensus.cc:3060] T 1f85fc4b527a48848e5faa083b604e36 P 0473d2b2d01f4459b1e90fd12cc7840e [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:05:49.720759 22722 raft_consensus.cc:493] T 9962423cb4e54fcfa5de01daf68a86e7 P 0473d2b2d01f4459b1e90fd12cc7840e [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 127766fc592545a4997f7790f50f6076)
I20260709 13:05:50.360891 22843 leader_election.cc:290] T e381f1d6b8184797ad142de49be225a8 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
W20260709 13:05:50.482172 20076 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.17.223.3:36891 timed out after 1.871s (SENT) [suppressed 29 similar messages]
I20260709 13:05:50.480386 19552 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41504 (request call id 517) took 1221 ms. Trace:
I20260709 13:05:50.393532 22964 raft_consensus.cc:2749] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P 0473d2b2d01f4459b1e90fd12cc7840e [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:05:50.414153 23019 raft_consensus.cc:3060] T 5ec1c4ce15e04c7e8c283a62179f2a64 P e5256d91808b47c195bc9b4dbd7f2b87 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:05:50.415169 22882 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.638s	user 0.003s	sys 0.014s
W20260709 13:05:50.413641 23034 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.588s	user 0.011s	sys 0.017s
I20260709 13:05:50.517445 19407 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52342 (request call id 2281) took 1313 ms. Trace:
W20260709 13:05:50.686995 20075 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.1:40321, user_credentials={real_user=slave}} blocked reactor thread for 182003us
I20260709 13:05:50.413182 23089 raft_consensus.cc:493] T df751f992649444090e27965eb1af85d P 0473d2b2d01f4459b1e90fd12cc7840e [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:50.483880 23018 raft_consensus.cc:493] T b08304a0a02b42d7840c4e8ee9a6bd1a P 0473d2b2d01f4459b1e90fd12cc7840e [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:50.418447 22890 raft_consensus.cc:740] T ff75a1d4cb1f493db8f71ddc136ba9ab P e61c3a8f61bb48f8a963c9480e53c168 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: e61c3a8f61bb48f8a963c9480e53c168, State: Running, Role: LEADER
I20260709 13:05:50.483986 22898 raft_consensus.cc:493] T e381f1d6b8184797ad142de49be225a8 P e61c3a8f61bb48f8a963c9480e53c168 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 0473d2b2d01f4459b1e90fd12cc7840e)
I20260709 13:05:50.487263 23046 leader_election.cc:290] T 3e1f505cb0f1427bbd698ac889d80821 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 10 election: Requested vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:05:50.525365 19479 rpcz_store.cc:276] 0709 13:05:49.354430 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:49.582410 (+227980us) service_pool.cc:224] Handling call
0709 13:05:50.371785 (+789375us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:05:50.526794 19555 pending_rounds.cc:85] T 2725d2c4cb054f18b0fc8f735c15f6c2 P e61c3a8f61bb48f8a963c9480e53c168: Aborting all ops after (but not including) 4
I20260709 13:05:50.802443 19555 pending_rounds.cc:107] T 2725d2c4cb054f18b0fc8f735c15f6c2 P e61c3a8f61bb48f8a963c9480e53c168: Aborting uncommitted NO_OP operation due to leader change: 9.5
I20260709 13:05:50.802924 19555 raft_consensus.cc:2889] T 2725d2c4cb054f18b0fc8f735c15f6c2 P e61c3a8f61bb48f8a963c9480e53c168 [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:05:50.803038 19480 raft_consensus.cc:2468] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P 0473d2b2d01f4459b1e90fd12cc7840e [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 10.
I20260709 13:05:50.412037 23049 raft_consensus.cc:515] T ff75a1d4cb1f493db8f71ddc136ba9ab P 0473d2b2d01f4459b1e90fd12cc7840e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:50.480427 22700 raft_consensus.cc:515] T 7f575b143b844aa096b50997dad3516a P e5256d91808b47c195bc9b4dbd7f2b87 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:50.378104 23115 raft_consensus.cc:493] T 833a2f0775ed407a94b8924ce50adb63 P e5256d91808b47c195bc9b4dbd7f2b87 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:50.560870 19408 raft_consensus.cc:2393] T fa731b585f684a7fb2d106c50f143b83 P e5256d91808b47c195bc9b4dbd7f2b87 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 127766fc592545a4997f7790f50f6076 in current term 9: Already voted for candidate e5256d91808b47c195bc9b4dbd7f2b87 in this term.
I20260709 13:05:50.560809 20109 raft_consensus.cc:2468] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P 127766fc592545a4997f7790f50f6076 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 10.
I20260709 13:05:50.517303 23108 raft_consensus.cc:493] T 2b74109013a140ada21feeef92d6f563 P 0473d2b2d01f4459b1e90fd12cc7840e [term 5 FOLLOWER]: Starting pre-election (detected failure of leader e5256d91808b47c195bc9b4dbd7f2b87)
W20260709 13:05:50.535053 22896 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.873s	user 0.006s	sys 0.007s
W20260709 13:05:50.569512 19484 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58286 (request call id 1790) took 1604 ms (client timeout 2087 ms). Trace:
I20260709 13:05:50.684525 23083 raft_consensus.cc:493] T 86a6797bdfe94fa496c050ceae4bd0d9 P 0473d2b2d01f4459b1e90fd12cc7840e [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:50.520565 23118 raft_consensus.cc:493] T ed7fdbcb96d14d418db9ca90a792588a P 127766fc592545a4997f7790f50f6076 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 0473d2b2d01f4459b1e90fd12cc7840e)
I20260709 13:05:50.504551 23028 raft_consensus.cc:515] T 22196caba61445d3bec98a0aab3c337d P e5256d91808b47c195bc9b4dbd7f2b87 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:50.575003 19482 rpcz_store.cc:276] 0709 13:05:49.348211 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:49.348309 (+    98us) service_pool.cc:224] Handling call
0709 13:05:50.398274 (+1049965us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:05:50.391538 19377 leader_election.cc:336] T 14efcc79969f41babe5529c22d59156d P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 10 election: RPC error from VoteRequest() call to peer 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257): Timed out: RequestConsensusVote RPC to 127.17.223.2:46257 timed out after 1.716s (SENT)
I20260709 13:05:50.505324 22974 raft_consensus.cc:515] T 86a6797bdfe94fa496c050ceae4bd0d9 P e61c3a8f61bb48f8a963c9480e53c168 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:50.490119 22977 raft_consensus.cc:515] T 7be9efa6559648dbb5a0f7684c4542d1 P e5256d91808b47c195bc9b4dbd7f2b87 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } attrs { replace: true } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: NON_VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: true } }
I20260709 13:05:50.533715 22821 raft_consensus.cc:493] T 775c229504194560ba9589bc2199b089 P e5256d91808b47c195bc9b4dbd7f2b87 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:50.680966 23124 raft_consensus.cc:493] T 62c6c134d3d24a1ab144dd9ee6bc3f64 P 127766fc592545a4997f7790f50f6076 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 0473d2b2d01f4459b1e90fd12cc7840e)
I20260709 13:05:50.529299 23027 raft_consensus.cc:740] T 309c3ca0ca4b4f3ba129752ea2cb293b P 0473d2b2d01f4459b1e90fd12cc7840e [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 0473d2b2d01f4459b1e90fd12cc7840e, State: Running, Role: LEADER
I20260709 13:05:50.534960 23020 raft_consensus.cc:515] T 76cb037fc9064d13b59a8969d897ce8c P e5256d91808b47c195bc9b4dbd7f2b87 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:50.641607 22848 raft_consensus.cc:515] T 1a61655d99124a29b486ba4a5b37faea P e5256d91808b47c195bc9b4dbd7f2b87 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:50.579895 19478 rpcz_store.cc:276] 0709 13:05:49.376881 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:49.581021 (+204140us) service_pool.cc:224] Handling call
0709 13:05:50.390774 (+809753us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:05:50.640437 19477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "217b5fae677b4971b3bbd2f357a1f7ff" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:05:50.557814 23038 raft_consensus.cc:2749] T ef32ce6fdd0e40d382c79974f30295c6 P 0473d2b2d01f4459b1e90fd12cc7840e [term 11 FOLLOWER]: Leader pre-election lost for term 10. Reason: Vote denied by peer e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321) with higher term. Message: Invalid argument: T ef32ce6fdd0e40d382c79974f30295c6 P e5256d91808b47c195bc9b4dbd7f2b87 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0473d2b2d01f4459b1e90fd12cc7840e for earlier term 10. Current term is 11.
I20260709 13:05:50.654928 19450 leader_election.cc:304] T 1dc5b3532fe54f74876d02beffa2c230 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:05:50.534144 23084 raft_consensus.cc:493] T ab43d85f64114d4ebf618930e43d9ed0 P 0473d2b2d01f4459b1e90fd12cc7840e [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 127766fc592545a4997f7790f50f6076)
W20260709 13:05:50.653393 19449 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.1:40321, user_credentials={real_user=slave}} blocked reactor thread for 238433us
I20260709 13:05:50.675086 19552 rpcz_store.cc:276] 0709 13:05:49.197977 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:49.198265 (+   288us) service_pool.cc:224] Handling call
0709 13:05:49.208720 (+ 10455us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:49.208902 (+   182us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:05:49.512593 (+303691us) log.cc:844] Serialized 14 byte log entry
0709 13:05:50.419005 (+906412us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:05:50.419060 (+    55us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:05:50.419107 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:50.419175 (+    68us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:50.419283 (+   108us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":412535,"prepare.run_cpu_time_us":3884,"prepare.run_wall_time_us":22276,"raft.queue_time_us":77,"raft.run_wall_time_us":58575,"spinlock_wait_cycles":6622976,"thread_start_us":1180907,"threads_started":2,"wal-append.queue_time_us":968257}
W20260709 13:05:50.686285 19375 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.3:36891, user_credentials={real_user=slave}} blocked reactor thread for 313819us
I20260709 13:05:50.577076 23088 raft_consensus.cc:493] T b08304a0a02b42d7840c4e8ee9a6bd1a P e5256d91808b47c195bc9b4dbd7f2b87 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:50.710347 19557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc225c93219c45538b53a1bd3d387e4d" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
W20260709 13:05:50.642653 23065 log.cc:927] Time spent T d1e5873a19244c5ebbcd38e126796ee7 P 0473d2b2d01f4459b1e90fd12cc7840e: Append to log took a long time: real 0.081s	user 0.000s	sys 0.000s
I20260709 13:05:50.559183 22978 raft_consensus.cc:515] T 76cb037fc9064d13b59a8969d897ce8c P 0473d2b2d01f4459b1e90fd12cc7840e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:50.655402 23055 raft_consensus.cc:2804] T a08760e15aac4630a629431f56024dc8 P e5256d91808b47c195bc9b4dbd7f2b87 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:05:50.652959 22903 raft_consensus.cc:493] T 309c3ca0ca4b4f3ba129752ea2cb293b P 127766fc592545a4997f7790f50f6076 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:50.561724 22859 consensus_queue.cc:1048] T ff9b0eddd810459b82d91c60777c10eb P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Connected to new peer: Peer: permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.123s
I20260709 13:05:50.820030 19481 raft_consensus.cc:2468] T 1f85fc4b527a48848e5faa083b604e36 P 0473d2b2d01f4459b1e90fd12cc7840e [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 6.
I20260709 13:05:50.822964 19374 leader_election.cc:304] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 127766fc592545a4997f7790f50f6076, e5256d91808b47c195bc9b4dbd7f2b87; no voters: 
I20260709 13:05:50.679078 23066 raft_consensus.cc:2804] T 1dc5b3532fe54f74876d02beffa2c230 P e61c3a8f61bb48f8a963c9480e53c168 [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 13:05:50.691243 22882 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.914s	user 0.011s	sys 0.026s
W20260709 13:05:50.569721 20104 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.951s	user 0.000s	sys 0.014s
W20260709 13:05:50.831192 19484 rpcz_store.cc:269] 0709 13:05:48.964748 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:48.964856 (+   108us) service_pool.cc:224] Handling call
0709 13:05:50.569322 (+1604466us) spinlock_profiling.cc:243] Waited 1.39 s on lock 0x7b5400310954. stack: 00007f4a79de9343 00007f4a79de9240 00007f4a797781d4 00007f4a834b6304 00007f4a834b6299 00007f4a7ce71571 00007f4a7cf0c2fa 00007f4a81ecdb17 00007f4a7b4486d4 00007f4a7b448662 00007f4a7b448591 00007f4a7b44850c 00007f4a7b4477c2 00007f4a7b24348c 00007f4a7b2428c6 00007f4a7b24226f
0709 13:05:50.569437 (+   115us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3196587904}
I20260709 13:05:50.679406 23086 raft_consensus.cc:2804] T 2e36a9d6e29c4a7c860cf267efbd4c74 P 0473d2b2d01f4459b1e90fd12cc7840e [term 7 FOLLOWER]: Leader election won for term 7
W20260709 13:05:50.726769 20076 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.3:36891, user_credentials={real_user=slave}} blocked reactor thread for 244600us
I20260709 13:05:50.647225 19558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0afb57ae58a24a01850491d69f0213dd" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:05:50.693141 19407 rpcz_store.cc:276] 0709 13:05:49.194147 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:49.194632 (+   485us) service_pool.cc:224] Handling call
0709 13:05:49.194970 (+   338us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:49.195225 (+   255us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 13:05:49.450215 (+254990us) log.cc:844] Serialized 14 byte log entry
0709 13:05:50.507243 (+1057028us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:05:50.507303 (+    60us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:05:50.507358 (+    55us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:50.507425 (+    67us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:50.507541 (+   116us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":160965,"prepare.run_cpu_time_us":41,"prepare.run_wall_time_us":42,"raft.queue_time_us":78996,"raft.run_cpu_time_us":98,"raft.run_wall_time_us":98,"thread_start_us":1289741,"threads_started":3,"wal-append.queue_time_us":464955}
W20260709 13:05:50.845372 19377 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.2:46257, user_credentials={real_user=slave}} blocked reactor thread for 453829us
I20260709 13:05:50.847975 19483 raft_consensus.cc:3060] T ff75a1d4cb1f493db8f71ddc136ba9ab P 0473d2b2d01f4459b1e90fd12cc7840e [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:05:50.671494 22860 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.517s	user 0.022s	sys 0.022s
I20260709 13:05:50.765257 22758 raft_consensus.cc:2804] T edd7d470b5014c9489be7f41f64355c9 P e61c3a8f61bb48f8a963c9480e53c168 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:05:50.809122 23052 raft_consensus.cc:493] T 2725d2c4cb054f18b0fc8f735c15f6c2 P e61c3a8f61bb48f8a963c9480e53c168 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:50.708976 23064 consensus_queue.cc:1048] T 1a61655d99124a29b486ba4a5b37faea P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.183s
I20260709 13:05:50.819059 22898 raft_consensus.cc:3060] T e381f1d6b8184797ad142de49be225a8 P e61c3a8f61bb48f8a963c9480e53c168 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:05:50.986442 19484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1b10566f45d4a7d9029858330e02d5b" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:05:50.861083 19478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "775c229504194560ba9589bc2199b089" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:05:51.058532 19478 raft_consensus.cc:2468] T 775c229504194560ba9589bc2199b089 P 0473d2b2d01f4459b1e90fd12cc7840e [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 127766fc592545a4997f7790f50f6076 in term 7.
W20260709 13:05:50.875164 19374 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.4:43121, user_credentials={real_user=slave}} blocked reactor thread for 52320.8us
I20260709 13:05:50.861745 19477 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58294 (request call id 2016) took 1508 ms. Trace:
I20260709 13:05:50.978073 19486 raft_consensus.cc:2468] T ef32ce6fdd0e40d382c79974f30295c6 P 0473d2b2d01f4459b1e90fd12cc7840e [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 11.
W20260709 13:05:50.875561 20075 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.1:40321, user_credentials={real_user=slave}} blocked reactor thread for 163933us
I20260709 13:05:51.065390 20108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa731b585f684a7fb2d106c50f143b83" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076"
I20260709 13:05:51.066766 20108 raft_consensus.cc:3060] T fa731b585f684a7fb2d106c50f143b83 P 127766fc592545a4997f7790f50f6076 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:05:50.884349 19450 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.3:36891, user_credentials={real_user=slave}} blocked reactor thread for 229480us
I20260709 13:05:51.059780 19477 rpcz_store.cc:276] 0709 13:05:49.353323 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:50.563067 (+1209744us) service_pool.cc:224] Handling call
0709 13:05:50.861676 (+298609us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:05:50.856601 23120 log.cc:927] Time spent T 85c494af21f9457a85da47b9bc70c1fd P e61c3a8f61bb48f8a963c9480e53c168: Append to log took a long time: real 0.334s	user 0.000s	sys 0.000s
I20260709 13:05:50.874847 19481 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58294 (request call id 2008) took 1523 ms. Trace:
I20260709 13:05:50.708484 22722 raft_consensus.cc:515] T 9962423cb4e54fcfa5de01daf68a86e7 P 0473d2b2d01f4459b1e90fd12cc7840e [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
W20260709 13:05:50.712317 23034 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.886s	user 0.011s	sys 0.017s
I20260709 13:05:50.873603 22903 raft_consensus.cc:515] T 309c3ca0ca4b4f3ba129752ea2cb293b P 127766fc592545a4997f7790f50f6076 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } attrs { replace: true } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:05:50.860226 22848 leader_election.cc:290] T 1a61655d99124a29b486ba4a5b37faea P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:05:51.043586 19555 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40438 (request call id 2123) took 1552 ms. Trace:
I20260709 13:05:50.945926 23066 raft_consensus.cc:493] T 1dc5b3532fe54f74876d02beffa2c230 P e61c3a8f61bb48f8a963c9480e53c168 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:50.869998 23088 raft_consensus.cc:515] T b08304a0a02b42d7840c4e8ee9a6bd1a P e5256d91808b47c195bc9b4dbd7f2b87 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:51.038762 23131 consensus_queue.cc:1059] T 1f85fc4b527a48848e5faa083b604e36 P 127766fc592545a4997f7790f50f6076 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.060s
I20260709 13:05:51.036957 23052 raft_consensus.cc:515] T 2725d2c4cb054f18b0fc8f735c15f6c2 P e61c3a8f61bb48f8a963c9480e53c168 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:51.047276 22830 leader_election.cc:290] T fa731b585f684a7fb2d106c50f143b83 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 9 election: Requested vote from peers e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
W20260709 13:05:51.047538 23123 log.cc:927] Time spent T ed7fdbcb96d14d418db9ca90a792588a P 0473d2b2d01f4459b1e90fd12cc7840e: Append to log took a long time: real 0.246s	user 0.000s	sys 0.000s
I20260709 13:05:50.856927 22974 leader_election.cc:290] T 86a6797bdfe94fa496c050ceae4bd0d9 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
W20260709 13:05:51.049016 22999 consensus_meta.cc:287] T 5ec1c4ce15e04c7e8c283a62179f2a64 P 127766fc592545a4997f7790f50f6076: Time spent flushing consensus metadata: real 1.444s	user 0.010s	sys 0.002s
I20260709 13:05:50.988265 23086 raft_consensus.cc:697] T 2e36a9d6e29c4a7c860cf267efbd4c74 P 0473d2b2d01f4459b1e90fd12cc7840e [term 7 LEADER]: Becoming Leader. State: Replica: 0473d2b2d01f4459b1e90fd12cc7840e, State: Running, Role: LEADER
I20260709 13:05:50.852367 23083 raft_consensus.cc:515] T 86a6797bdfe94fa496c050ceae4bd0d9 P 0473d2b2d01f4459b1e90fd12cc7840e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:51.052086 19560 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40438 (request call id 2124) took 1535 ms. Trace:
I20260709 13:05:50.679283 23093 consensus_queue.cc:1048] T 40e1e16737a842ee936002830f36882e P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.170s
I20260709 13:05:50.863519 19449 leader_election.cc:304] T 14efcc79969f41babe5529c22d59156d P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e; no voters: 127766fc592545a4997f7790f50f6076, e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:05:50.857369 19482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14935b3ddf914369822e4a0547aaa355" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
W20260709 13:05:50.969105 19377 leader_election.cc:336] T fa8650e71aa14778b3d73721fc50d9fc P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257): Timed out: RequestConsensusVote RPC to 127.17.223.2:46257 timed out after 1.718s (SENT)
I20260709 13:05:51.068624 19558 raft_consensus.cc:3060] T 0afb57ae58a24a01850491d69f0213dd P e61c3a8f61bb48f8a963c9480e53c168 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:05:50.875126 19479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e1f505cb0f1427bbd698ac889d80821" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
W20260709 13:05:50.979643 22860 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.850s	user 0.029s	sys 0.025s
I20260709 13:05:51.073923 19551 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41504 (request call id 518) took 1875 ms. Trace:
I20260709 13:05:51.075968 19477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab43d85f64114d4ebf618930e43d9ed0" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
W20260709 13:05:50.984472 19526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.2:46257, user_credentials={real_user=slave}} blocked reactor thread for 273076us
I20260709 13:05:51.075441 19481 rpcz_store.cc:276] 0709 13:05:49.351136 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:50.572617 (+1221481us) service_pool.cc:224] Handling call
0709 13:05:50.874794 (+302177us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:05:51.063750 19452 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.578s	user 0.043s	sys 0.113s
W20260709 13:05:51.178310 19452 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.693s	user 0.043s	sys 0.114s
I20260709 13:05:50.860281 23020 leader_election.cc:290] T 76cb037fc9064d13b59a8969d897ce8c P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:05:51.078588 20078 leader_election.cc:304] T 1efebf73c86e432baa55533136b6e12c P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, 127766fc592545a4997f7790f50f6076; no voters: 
I20260709 13:05:50.875355 22859 raft_consensus.cc:2804] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P e5256d91808b47c195bc9b4dbd7f2b87 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:05:50.863289 23084 raft_consensus.cc:515] T ab43d85f64114d4ebf618930e43d9ed0 P 0473d2b2d01f4459b1e90fd12cc7840e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } attrs { replace: true } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:05:50.578310 23104 raft_consensus.cc:493] T f93ee515a9c14139bf566522ed8232f3 P 0473d2b2d01f4459b1e90fd12cc7840e [term 12 FOLLOWER]: Starting pre-election (detected failure of leader e61c3a8f61bb48f8a963c9480e53c168)
I20260709 13:05:50.979449 22964 raft_consensus.cc:2804] T 1dc5b3532fe54f74876d02beffa2c230 P 0473d2b2d01f4459b1e90fd12cc7840e [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:05:51.090567 19555 rpcz_store.cc:276] 0709 13:05:49.490872 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:49.491096 (+   224us) service_pool.cc:224] Handling call
0709 13:05:49.491438 (+   342us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:50.803543 (+1312105us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:51.043359 (+239816us) spinlock_profiling.cc:243] Waited 323 ms on lock 0x7b5400124b54. stack: 00007f4a79de9343 00007f4a79de9240 00007f4a797781d4 00007f4a834b6304 00007f4a834b6299 00007f4a7ce71571 00007f4a7cf08e01 00007f4a7cf0783e 00007f4a81ecc419 00007f4a7b443bd4 00007f4a7b443b62 00007f4a7b443a91 00007f4a7b443a0c 00007f4a7b442cc2 00007f4a7b24348c 00007f4a7b2428c6
0709 13:05:51.043525 (+   166us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":742436096}
I20260709 13:05:50.983058 22758 raft_consensus.cc:493] T edd7d470b5014c9489be7f41f64355c9 P e61c3a8f61bb48f8a963c9480e53c168 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:50.855293 22821 raft_consensus.cc:515] T 775c229504194560ba9589bc2199b089 P e5256d91808b47c195bc9b4dbd7f2b87 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:05:51.043781 22700 leader_election.cc:290] T 7f575b143b844aa096b50997dad3516a P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
W20260709 13:05:50.857124 23116 log.cc:927] Time spent T 172b3dd13109415a955b71ac0e9d2234 P e5256d91808b47c195bc9b4dbd7f2b87: Append to log took a long time: real 0.148s	user 0.000s	sys 0.001s
I20260709 13:05:50.831532 23115 raft_consensus.cc:515] T 833a2f0775ed407a94b8924ce50adb63 P e5256d91808b47c195bc9b4dbd7f2b87 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
W20260709 13:05:50.856217 23121 log.cc:927] Time spent T e381f1d6b8184797ad142de49be225a8 P 0473d2b2d01f4459b1e90fd12cc7840e: Append to log took a long time: real 0.347s	user 0.000s	sys 0.001s
I20260709 13:05:50.873201 22978 leader_election.cc:290] T 76cb037fc9064d13b59a8969d897ce8c P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:05:51.109457 20108 raft_consensus.cc:2468] T fa731b585f684a7fb2d106c50f143b83 P 127766fc592545a4997f7790f50f6076 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 9.
I20260709 13:05:51.057113 23122 raft_consensus.cc:493] T 86a6797bdfe94fa496c050ceae4bd0d9 P e5256d91808b47c195bc9b4dbd7f2b87 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:50.835490 23108 raft_consensus.cc:515] T 2b74109013a140ada21feeef92d6f563 P 0473d2b2d01f4459b1e90fd12cc7840e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:50.873414 23055 raft_consensus.cc:493] T a08760e15aac4630a629431f56024dc8 P e5256d91808b47c195bc9b4dbd7f2b87 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:51.112337 19478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4509b76741dc428e9201c70c1658da13" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
W20260709 13:05:51.350890 19450 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.3:36891, user_credentials={real_user=slave}} blocked reactor thread for 105269us
I20260709 13:05:51.056900 22979 raft_consensus.cc:493] T 2b74109013a140ada21feeef92d6f563 P e61c3a8f61bb48f8a963c9480e53c168 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader e5256d91808b47c195bc9b4dbd7f2b87)
W20260709 13:05:51.113507 19375 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.3:36891, user_credentials={real_user=slave}} blocked reactor thread for 246990us
I20260709 13:05:51.033074 23097 leader_election.cc:290] T ff9b0eddd810459b82d91c60777c10eb P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:05:50.856954 23028 leader_election.cc:290] T 22196caba61445d3bec98a0aab3c337d P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
W20260709 13:05:51.114140 19523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.1:40321, user_credentials={real_user=slave}} blocked reactor thread for 462132us
I20260709 13:05:51.356313 19523 leader_election.cc:304] T 21e14947d70440f19044d8f75c31e1f9 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168; no voters: 0473d2b2d01f4459b1e90fd12cc7840e
I20260709 13:05:51.038340 23049 leader_election.cc:290] T ff75a1d4cb1f493db8f71ddc136ba9ab P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:05:51.032279 22912 leader_election.cc:290] T 4af19371ea874c09a0a2147040835cbb P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
W20260709 13:05:51.049777 23117 log.cc:927] Time spent T 65d8cb8d6ec64f459d5a47cefab10acf P 127766fc592545a4997f7790f50f6076: Append to log took a long time: real 0.244s	user 0.000s	sys 0.000s
W20260709 13:05:51.051218 19480 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58294 (request call id 2014) took 1698 ms (client timeout 1986 ms). Trace:
I20260709 13:05:51.237605 23104 raft_consensus.cc:515] T f93ee515a9c14139bf566522ed8232f3 P 0473d2b2d01f4459b1e90fd12cc7840e [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:51.104300 23066 raft_consensus.cc:3060] T 1dc5b3532fe54f74876d02beffa2c230 P e61c3a8f61bb48f8a963c9480e53c168 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:05:51.181162 19479 raft_consensus.cc:3060] T 3e1f505cb0f1427bbd698ac889d80821 P 0473d2b2d01f4459b1e90fd12cc7840e [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:05:51.181990 19377 leader_election.cc:304] T fa8650e71aa14778b3d73721fc50d9fc P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:05:51.182730 19482 raft_consensus.cc:2468] T 14935b3ddf914369822e4a0547aaa355 P 0473d2b2d01f4459b1e90fd12cc7840e [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 8.
I20260709 13:05:50.858381 22977 leader_election.cc:290] T 7be9efa6559648dbb5a0f7684c4542d1 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:05:50.855156 23118 raft_consensus.cc:515] T ed7fdbcb96d14d418db9ca90a792588a P 127766fc592545a4997f7790f50f6076 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:05:50.858624 22890 consensus_queue.cc:260] T ff75a1d4cb1f493db8f71ddc136ba9ab P e61c3a8f61bb48f8a963c9480e53c168 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:50.854930 23018 raft_consensus.cc:515] T b08304a0a02b42d7840c4e8ee9a6bd1a P 0473d2b2d01f4459b1e90fd12cc7840e [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:51.118439 22896 raft_consensus.cc:493] T a08760e15aac4630a629431f56024dc8 P 0473d2b2d01f4459b1e90fd12cc7840e [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:51.177942 19551 rpcz_store.cc:276] 0709 13:05:49.198305 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:49.198400 (+    95us) service_pool.cc:224] Handling call
0709 13:05:49.202892 (+  4492us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:05:49.278319 (+ 75427us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:05:49.498571 (+220252us) log.cc:844] Serialized 14 byte log entry
0709 13:05:49.816795 (+318224us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:05:50.561682 (+744887us) spinlock_profiling.cc:243] Waited 29.1 ms on lock 0x7b2c00078318. stack: 00007f4a79de9343 00007f4a79de9240 00007f4a797781d4 00007f4a834b6304 00007f4a834b6299 00007f4a7b801a11 00007f4a7b811372 00007f4a7cf43a01 00007f4a7cf0843a 00007f4a7cf0783e 00007f4a81ecc419 00007f4a7b443bd4 00007f4a7b443b62 00007f4a7b443a91 00007f4a7b443a0c 00007f4a7b442cc2
0709 13:05:50.679736 (+118054us) log.cc:844] Serialized 26 byte log entry
0709 13:05:50.681144 (+  1408us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:05:50.681182 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:50.681249 (+    67us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:05:51.056838 (+375589us) raft_consensus.cc:1685] finished
0709 13:05:51.073706 (+ 16868us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:51.073854 (+   148us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":65972,"prepare.queue_time_us":428952,"prepare.run_cpu_time_us":42,"prepare.run_wall_time_us":43,"raft.queue_time_us":108591,"raft.run_cpu_time_us":233,"raft.run_wall_time_us":13159,"spinlock_wait_cycles":66848000,"thread_start_us":390941,"threads_started":2,"wal-append.queue_time_us":1350445}
I20260709 13:05:51.367753 22974 raft_consensus.cc:493] T 14935b3ddf914369822e4a0547aaa355 P e61c3a8f61bb48f8a963c9480e53c168 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 127766fc592545a4997f7790f50f6076)
I20260709 13:05:51.113178 23137 raft_consensus.cc:493] T ab43d85f64114d4ebf618930e43d9ed0 P e61c3a8f61bb48f8a963c9480e53c168 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 127766fc592545a4997f7790f50f6076)
I20260709 13:05:51.114379 23051 raft_consensus.cc:493] T 2725d2c4cb054f18b0fc8f735c15f6c2 P 0473d2b2d01f4459b1e90fd12cc7840e [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:05:51.231770 19452 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:51.232229 20104 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35874 (request call id 716) took 1750 ms. Trace:
I20260709 13:05:51.396255 20104 rpcz_store.cc:276] 0709 13:05:49.476543 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:49.476701 (+   158us) service_pool.cc:224] Handling call
0709 13:05:49.476932 (+   231us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:49.477142 (+   210us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:05:49.618897 (+141755us) log.cc:844] Serialized 14 byte log entry
0709 13:05:51.226456 (+1607559us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:05:51.226528 (+    72us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:05:51.226589 (+    61us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:51.226704 (+   115us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:51.226876 (+   172us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":95556,"prepare.queue_time_us":341689,"prepare.run_cpu_time_us":27,"prepare.run_wall_time_us":27,"raft.queue_time_us":497700,"raft.run_cpu_time_us":117,"raft.run_wall_time_us":2730,"thread_start_us":1627368,"threads_started":3,"wal-append.queue_time_us":956974}
W20260709 13:05:51.234486 20075 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.1:40321, user_credentials={real_user=slave}} blocked reactor thread for 168193us
W20260709 13:05:51.224709 22972 consensus_meta.cc:287] T df751f992649444090e27965eb1af85d P e5256d91808b47c195bc9b4dbd7f2b87: Time spent flushing consensus metadata: real 0.799s	user 0.015s	sys 0.003s
I20260709 13:05:50.855751 23124 raft_consensus.cc:515] T 62c6c134d3d24a1ab144dd9ee6bc3f64 P 127766fc592545a4997f7790f50f6076 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:05:50.883864 23089 raft_consensus.cc:515] T df751f992649444090e27965eb1af85d P 0473d2b2d01f4459b1e90fd12cc7840e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:51.401566 19405 raft_consensus.cc:2468] T df751f992649444090e27965eb1af85d P e5256d91808b47c195bc9b4dbd7f2b87 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 10.
I20260709 13:05:51.225168 22859 raft_consensus.cc:493] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P e5256d91808b47c195bc9b4dbd7f2b87 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:50.858253 23027 consensus_queue.cc:260] T 309c3ca0ca4b4f3ba129752ea2cb293b P 0473d2b2d01f4459b1e90fd12cc7840e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } attrs { replace: true } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:05:51.402199 23022 raft_consensus.cc:493] T df751f992649444090e27965eb1af85d P e5256d91808b47c195bc9b4dbd7f2b87 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:51.402973 23027 raft_consensus.cc:3060] T 309c3ca0ca4b4f3ba129752ea2cb293b P 0473d2b2d01f4459b1e90fd12cc7840e [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:05:51.234179 22758 raft_consensus.cc:3060] T edd7d470b5014c9489be7f41f64355c9 P e61c3a8f61bb48f8a963c9480e53c168 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:05:51.407272 22722 leader_election.cc:290] T 9962423cb4e54fcfa5de01daf68a86e7 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:05:51.124778 22999 raft_consensus.cc:515] T 5ec1c4ce15e04c7e8c283a62179f2a64 P 127766fc592545a4997f7790f50f6076 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
W20260709 13:05:51.408248 23133 log.cc:927] Time spent T 2a16f7501e2444fb86d4e2778e734e02 P e5256d91808b47c195bc9b4dbd7f2b87: Append to log took a long time: real 0.053s	user 0.000s	sys 0.000s
I20260709 13:05:51.409386 22999 leader_election.cc:290] T 5ec1c4ce15e04c7e8c283a62179f2a64 P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 8 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:05:51.409548 23148 raft_consensus.cc:493] T 48824d5acfbc485ebf8c2d944e7202de P 127766fc592545a4997f7790f50f6076 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:51.409930 22999 raft_consensus.cc:3055] T 1f85fc4b527a48848e5faa083b604e36 P 127766fc592545a4997f7790f50f6076 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:05:51.410356 22999 raft_consensus.cc:740] T 1f85fc4b527a48848e5faa083b604e36 P 127766fc592545a4997f7790f50f6076 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 127766fc592545a4997f7790f50f6076, State: Running, Role: LEADER
I20260709 13:05:51.251173 19477 raft_consensus.cc:3060] T ab43d85f64114d4ebf618930e43d9ed0 P 0473d2b2d01f4459b1e90fd12cc7840e [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:05:51.320779 19374 leader_election.cc:304] T fa731b585f684a7fb2d106c50f143b83 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 127766fc592545a4997f7790f50f6076, e5256d91808b47c195bc9b4dbd7f2b87; no voters: 
W20260709 13:05:51.412281 19374 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.4:43121, user_credentials={real_user=slave}} blocked reactor thread for 138141us
I20260709 13:05:51.413589 19479 raft_consensus.cc:2468] T 3e1f505cb0f1427bbd698ac889d80821 P 0473d2b2d01f4459b1e90fd12cc7840e [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 10.
I20260709 13:05:51.414237 19479 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58294 (request call id 2025) took 1010 ms. Trace:
W20260709 13:05:51.329444 19486 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58294 (request call id 2004) took 1979 ms (client timeout 1897 ms). Trace:
I20260709 13:05:51.414574 19479 rpcz_store.cc:276] 0709 13:05:50.403396 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:50.834207 (+430811us) service_pool.cc:224] Handling call
0709 13:05:51.414171 (+579964us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:05:51.414858 19486 rpcz_store.cc:269] 0709 13:05:49.349863 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:49.350048 (+   185us) service_pool.cc:224] Handling call
0709 13:05:51.329221 (+1979173us) spinlock_profiling.cc:243] Waited 1.45 s on lock 0x7b54000a9454. stack: 00007f4a79de9343 00007f4a79de9240 00007f4a797781d4 00007f4a834b6304 00007f4a834b6299 00007f4a7ce71571 00007f4a7cf0c2fa 00007f4a81ecdb17 00007f4a7b4486d4 00007f4a7b448662 00007f4a7b448591 00007f4a7b44850c 00007f4a7b4477c2 00007f4a7b24348c 00007f4a7b2428c6 00007f4a7b24226f
0709 13:05:51.329359 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3328831872}
I20260709 13:05:51.417007 19486 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58294 (request call id 2015) took 2064 ms. Trace:
I20260709 13:05:51.417474 19486 rpcz_store.cc:276] 0709 13:05:49.353052 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:51.416132 (+2063080us) service_pool.cc:224] Handling call
0709 13:05:51.416455 (+   323us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:51.416622 (+   167us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:05:51.416654 (+    32us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:05:51.416694 (+    40us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:05:51.416733 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:51.416796 (+    63us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:51.416941 (+   145us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:05:51.388182 22975 raft_consensus.cc:2749] T fa8650e71aa14778b3d73721fc50d9fc P e5256d91808b47c195bc9b4dbd7f2b87 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 13:05:51.321235 23126 consensus_meta.cc:287] T 7f575b143b844aa096b50997dad3516a P e61c3a8f61bb48f8a963c9480e53c168: Time spent flushing consensus metadata: real 0.787s	user 0.006s	sys 0.004s
I20260709 13:05:51.238240 23034 raft_consensus.cc:493] T 85c494af21f9457a85da47b9bc70c1fd P e61c3a8f61bb48f8a963c9480e53c168 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 127766fc592545a4997f7790f50f6076)
I20260709 13:05:51.353116 19375 leader_election.cc:304] T 21e14947d70440f19044d8f75c31e1f9 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
W20260709 13:05:51.367018 19480 rpcz_store.cc:269] 0709 13:05:49.352784 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:49.570237 (+217453us) service_pool.cc:224] Handling call
0709 13:05:51.051057 (+1480820us) spinlock_profiling.cc:243] Waited 390 ms on lock 0x7b540029de54. stack: 00007f4a79de9343 00007f4a79de9240 00007f4a797781d4 00007f4a834b6304 00007f4a834b6299 00007f4a7ce71571 00007f4a7cf0c2fa 00007f4a81ecdb17 00007f4a7b4486d4 00007f4a7b448662 00007f4a7b448591 00007f4a7b44850c 00007f4a7b4477c2 00007f4a7b24348c 00007f4a7b2428c6 00007f4a7b24226f
0709 13:05:51.051162 (+   105us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":897968512}
I20260709 13:05:51.122295 19560 rpcz_store.cc:276] 0709 13:05:49.517108 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:49.517521 (+   413us) service_pool.cc:224] Handling call
0709 13:05:49.540481 (+ 22960us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:50.673050 (+1132569us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:05:50.673082 (+    32us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:05:50.673129 (+    47us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:05:50.673164 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:51.051854 (+378690us) spinlock_profiling.cc:243] Waited 1.13 s on lock 0x7b5400342454. stack: 00007f4a79de9343 00007f4a79de9240 00007f4a797781d4 00007f4a834b6304 00007f4a834b6299 00007f4a7ce71571 00007f4a7cf08e01 00007f4a7cf0783e 00007f4a81ecc419 00007f4a7b443bd4 00007f4a7b443b62 00007f4a7b443a91 00007f4a7b443a0c 00007f4a7b442cc2 00007f4a7b24348c 00007f4a7b2428c6
0709 13:05:51.051897 (+    43us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:51.052026 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2604199168}
I20260709 13:05:51.372268 22903 leader_election.cc:290] T 309c3ca0ca4b4f3ba129752ea2cb293b P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:05:51.373874 19478 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58294 (request call id 2011) took 2021 ms. Trace:
I20260709 13:05:51.363878 22979 raft_consensus.cc:515] T 2b74109013a140ada21feeef92d6f563 P e61c3a8f61bb48f8a963c9480e53c168 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
W20260709 13:05:51.375420 23128 log.cc:927] Time spent T ef32ce6fdd0e40d382c79974f30295c6 P e5256d91808b47c195bc9b4dbd7f2b87: Append to log took a long time: real 0.151s	user 0.000s	sys 0.001s
I20260709 13:05:51.376114 22880 leader_election.cc:290] T 70797e5783b5454ab0d0eea663e791e3 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 10 election: Requested vote from peers e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:05:51.353175 22997 leader_election.cc:290] T bc225c93219c45538b53a1bd3d387e4d P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:05:51.353605 23055 raft_consensus.cc:3060] T a08760e15aac4630a629431f56024dc8 P e5256d91808b47c195bc9b4dbd7f2b87 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:05:51.418697 22974 raft_consensus.cc:515] T 14935b3ddf914369822e4a0547aaa355 P e61c3a8f61bb48f8a963c9480e53c168 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } attrs { replace: true } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:05:51.460944 23141 raft_consensus.cc:2804] T 1efebf73c86e432baa55533136b6e12c P 127766fc592545a4997f7790f50f6076 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:05:51.435660 22972 raft_consensus.cc:2804] T fa731b585f684a7fb2d106c50f143b83 P e5256d91808b47c195bc9b4dbd7f2b87 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:05:51.470266 22972 raft_consensus.cc:697] T fa731b585f684a7fb2d106c50f143b83 P e5256d91808b47c195bc9b4dbd7f2b87 [term 9 LEADER]: Becoming Leader. State: Replica: e5256d91808b47c195bc9b4dbd7f2b87, State: Running, Role: LEADER
I20260709 13:05:51.470916 22999 consensus_queue.cc:260] T 1f85fc4b527a48848e5faa083b604e36 P 127766fc592545a4997f7790f50f6076 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:05:51.471155 22972 consensus_queue.cc:237] T fa731b585f684a7fb2d106c50f143b83 P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:05:51.472251 23147 raft_consensus.cc:493] T fa731b585f684a7fb2d106c50f143b83 P e61c3a8f61bb48f8a963c9480e53c168 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:51.472743 23147 raft_consensus.cc:515] T fa731b585f684a7fb2d106c50f143b83 P e61c3a8f61bb48f8a963c9480e53c168 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:05:51.473711 23055 raft_consensus.cc:515] T a08760e15aac4630a629431f56024dc8 P e5256d91808b47c195bc9b4dbd7f2b87 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:51.402979 23022 raft_consensus.cc:515] T df751f992649444090e27965eb1af85d P e5256d91808b47c195bc9b4dbd7f2b87 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
W20260709 13:05:51.474934 23102 consensus_queue.cc:1175] T 309c3ca0ca4b4f3ba129752ea2cb293b P 0473d2b2d01f4459b1e90fd12cc7840e [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "e61c3a8f61bb48f8a963c9480e53c168" responder_term: 7 status { last_received { term: 7 index: 8 } last_committed_idx: 8 last_received_current_leader { term: 7 index: 8 } }
I20260709 13:05:51.476096 23055 leader_election.cc:290] T a08760e15aac4630a629431f56024dc8 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 11 election: Requested vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:05:51.476642 19411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ec1c4ce15e04c7e8c283a62179f2a64" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
I20260709 13:05:51.479167 19408 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49050 (request call id 521) took 2029 ms. Trace:
W20260709 13:05:51.381461 20078 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.2:46257, user_credentials={real_user=slave}} blocked reactor thread for 273703us
I20260709 13:05:51.383194 19483 raft_consensus.cc:2468] T ff75a1d4cb1f493db8f71ddc136ba9ab P 0473d2b2d01f4459b1e90fd12cc7840e [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 9.
I20260709 13:05:51.384886 19482 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58294 (request call id 2013) took 2032 ms. Trace:
W20260709 13:05:51.385378 19377 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.2:46257, user_credentials={real_user=slave}} blocked reactor thread for 416306us
I20260709 13:05:51.145576 23130 consensus_queue.cc:1059] T ab43d85f64114d4ebf618930e43d9ed0 P 127766fc592545a4997f7790f50f6076 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } attrs { replace: true }, Status: INVALID_TERM, Last received: 8.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.235s
I20260709 13:05:51.416543 23051 raft_consensus.cc:515] T 2725d2c4cb054f18b0fc8f735c15f6c2 P 0473d2b2d01f4459b1e90fd12cc7840e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:51.389935 19555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76cb037fc9064d13b59a8969d897ce8c" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
W20260709 13:05:51.380883 23019 consensus_meta.cc:287] T 5ec1c4ce15e04c7e8c283a62179f2a64 P e5256d91808b47c195bc9b4dbd7f2b87: Time spent flushing consensus metadata: real 0.614s	user 0.009s	sys 0.000s
I20260709 13:05:51.392140 19551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff75a1d4cb1f493db8f71ddc136ba9ab" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
W20260709 13:05:51.124671 23050 consensus_meta.cc:287] T fa8650e71aa14778b3d73721fc50d9fc P 0473d2b2d01f4459b1e90fd12cc7840e: Time spent flushing consensus metadata: real 1.667s	user 0.009s	sys 0.003s
I20260709 13:05:51.231655 22964 raft_consensus.cc:493] T 1dc5b3532fe54f74876d02beffa2c230 P 0473d2b2d01f4459b1e90fd12cc7840e [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:51.333986 19558 raft_consensus.cc:2468] T 0afb57ae58a24a01850491d69f0213dd P e61c3a8f61bb48f8a963c9480e53c168 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 10.
I20260709 13:05:51.420215 20104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70797e5783b5454ab0d0eea663e791e3" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076"
I20260709 13:05:51.421106 19407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "775c229504194560ba9589bc2199b089" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:05:51.436570 19403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "309c3ca0ca4b4f3ba129752ea2cb293b" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:05:51.349509 23122 raft_consensus.cc:515] T 86a6797bdfe94fa496c050ceae4bd0d9 P e5256d91808b47c195bc9b4dbd7f2b87 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:51.453194 19478 rpcz_store.cc:276] 0709 13:05:49.351993 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:51.373122 (+2021129us) service_pool.cc:224] Handling call
0709 13:05:51.373428 (+   306us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:51.373598 (+   170us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:05:51.373620 (+    22us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:05:51.373655 (+    35us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:05:51.373688 (+    33us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:51.373734 (+    46us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:51.373824 (+    90us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:05:51.454764 19409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4af19371ea874c09a0a2147040835cbb" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:05:51.365525 23086 consensus_queue.cc:237] T 2e36a9d6e29c4a7c860cf267efbd4c74 P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:51.437701 19402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "833a2f0775ed407a94b8924ce50adb63" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:05:51.402241 22859 raft_consensus.cc:3060] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P e5256d91808b47c195bc9b4dbd7f2b87 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:05:51.410138 23148 raft_consensus.cc:515] T 48824d5acfbc485ebf8c2d944e7202de P 127766fc592545a4997f7790f50f6076 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
W20260709 13:05:51.459519 19375 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.3:36891, user_credentials={real_user=slave}} blocked reactor thread for 106491us
I20260709 13:05:51.461328 23115 leader_election.cc:290] T 833a2f0775ed407a94b8924ce50adb63 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:05:51.457151 23034 raft_consensus.cc:515] T 85c494af21f9457a85da47b9bc70c1fd P e61c3a8f61bb48f8a963c9480e53c168 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:05:51.411499 22890 raft_consensus.cc:3060] T ff75a1d4cb1f493db8f71ddc136ba9ab P e61c3a8f61bb48f8a963c9480e53c168 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:05:51.228250 23139 consensus_queue.cc:1048] T 14935b3ddf914369822e4a0547aaa355 P 127766fc592545a4997f7790f50f6076 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.194s
I20260709 13:05:51.463959 20108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "833a2f0775ed407a94b8924ce50adb63" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:05:51.395644 22896 raft_consensus.cc:515] T a08760e15aac4630a629431f56024dc8 P 0473d2b2d01f4459b1e90fd12cc7840e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:51.452502 19479 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58294 (request call id 2012) took 2100 ms. Trace:
I20260709 13:05:51.380841 23140 raft_consensus.cc:493] T fa8650e71aa14778b3d73721fc50d9fc P e61c3a8f61bb48f8a963c9480e53c168 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:51.459048 23126 raft_consensus.cc:2749] T 7f575b143b844aa096b50997dad3516a P e61c3a8f61bb48f8a963c9480e53c168 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 13:05:51.382320 19449 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.1:40321, user_credentials={real_user=slave}} blocked reactor thread for 518847us
I20260709 13:05:51.479537 19408 rpcz_store.cc:276] 0709 13:05:49.449434 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:49.449800 (+   366us) service_pool.cc:224] Handling call
0709 13:05:51.478983 (+2029183us) spinlock_profiling.cc:243] Waited 1.09 s on lock 0x7b540019fd54. stack: 00007f4a79de9343 00007f4a79de9240 00007f4a797781d4 00007f4a834b6304 00007f4a834b6299 00007f4a7ce71571 00007f4a7cf0c2fa 00007f4a81ecdb17 00007f4a7b4486d4 00007f4a7b448662 00007f4a7b448591 00007f4a7b44850c 00007f4a7b4477c2 00007f4a7b24348c 00007f4a7b2428c6 00007f4a7b24226f
0709 13:05:51.479091 (+   108us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2517107584}
I20260709 13:05:51.519809 19484 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58294 (request call id 2006) took 2169 ms. Trace:
I20260709 13:05:51.545917 19477 raft_consensus.cc:2468] T ab43d85f64114d4ebf618930e43d9ed0 P 0473d2b2d01f4459b1e90fd12cc7840e [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 9.
I20260709 13:05:51.576334 19560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b08304a0a02b42d7840c4e8ee9a6bd1a" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:05:51.574528 19484 rpcz_store.cc:276] 0709 13:05:49.350517 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:51.096476 (+1745959us) service_pool.cc:224] Handling call
0709 13:05:51.096870 (+   394us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:05:51.192401 (+ 95531us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:05:51.192446 (+    45us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:05:51.193017 (+   571us) log.cc:844] Serialized 26 byte log entry
0709 13:05:51.519129 (+326112us) spinlock_profiling.cc:243] Waited 20.8 ms on lock 0x7b54000d8ca0. stack: 00007f4a79de9343 00007f4a79de9240 00007f4a797781d4 00007f4a834b6304 00007f4a834b6299 00007f4a7ce72090 00007f4a7ce7f6b8 00007f4a7cf0892b 00007f4a7cf0783e 00007f4a81ecc419 00007f4a7b443bd4 00007f4a7b443b62 00007f4a7b443a91 00007f4a7b443a0c 00007f4a7b442cc2 00007f4a7b24348c
0709 13:05:51.519207 (+    78us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:05:51.519272 (+    65us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:51.519369 (+    97us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:05:51.519424 (+    55us) raft_consensus.cc:1685] finished
0709 13:05:51.519444 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:51.519716 (+   272us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":189093,"raft.queue_time_us":95173,"raft.run_cpu_time_us":98,"raft.run_wall_time_us":3845,"spinlock_wait_cycles":47853312,"thread_start_us":140297,"threads_started":1,"wal-append.queue_time_us":168406}
W20260709 13:05:51.545341 19523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.1:40321, user_credentials={real_user=slave}} blocked reactor thread for 189116us
I20260709 13:05:51.547868 19482 rpcz_store.cc:276] 0709 13:05:49.352510 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:50.857027 (+1504517us) service_pool.cc:224] Handling call
0709 13:05:51.384758 (+527731us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:05:51.574627 19449 leader_election.cc:304] T d1e5873a19244c5ebbcd38e126796ee7 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e; no voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:05:51.579619 19482 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39478 (request call id 472) took 2202 ms. Trace:
I20260709 13:05:51.579945 19482 rpcz_store.cc:276] 0709 13:05:49.377181 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:51.578912 (+2201731us) service_pool.cc:224] Handling call
0709 13:05:51.579175 (+   263us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:51.579323 (+   148us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:05:51.579347 (+    24us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:05:51.579385 (+    38us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:05:51.579415 (+    30us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:51.579464 (+    49us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:51.579571 (+   107us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:05:51.462123 23093 raft_consensus.cc:493] T 48824d5acfbc485ebf8c2d944e7202de P e61c3a8f61bb48f8a963c9480e53c168 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:51.546811 19403 raft_consensus.cc:2468] T 309c3ca0ca4b4f3ba129752ea2cb293b P e5256d91808b47c195bc9b4dbd7f2b87 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 127766fc592545a4997f7790f50f6076 in term 7.
I20260709 13:05:51.454306 22898 raft_consensus.cc:515] T e381f1d6b8184797ad142de49be225a8 P e61c3a8f61bb48f8a963c9480e53c168 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:51.479784 23018 leader_election.cc:290] T b08304a0a02b42d7840c4e8ee9a6bd1a P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:05:51.464232 22977 raft_consensus.cc:2804] T 21e14947d70440f19044d8f75c31e1f9 P e5256d91808b47c195bc9b4dbd7f2b87 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:05:51.550120 20078 leader_election.cc:304] T 96efeaaf1057492490e9a621f37e1a2d P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, 127766fc592545a4997f7790f50f6076; no voters: 
W20260709 13:05:51.632172 20078 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.2:46257, user_credentials={real_user=slave}} blocked reactor thread for 82185.8us
I20260709 13:05:51.632505 19556 raft_consensus.cc:1240] T 7f575b143b844aa096b50997dad3516a P e61c3a8f61bb48f8a963c9480e53c168 [term 5 FOLLOWER]: Rejecting Update request from peer 0473d2b2d01f4459b1e90fd12cc7840e for earlier term 4. Current term is 5. Ops: []
I20260709 13:05:51.633232 20078 leader_election.cc:304] T 775c229504194560ba9589bc2199b089 P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, 127766fc592545a4997f7790f50f6076; no voters: 
I20260709 13:05:51.545678 19555 raft_consensus.cc:2468] T 76cb037fc9064d13b59a8969d897ce8c P e61c3a8f61bb48f8a963c9480e53c168 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 7.
I20260709 13:05:51.567265 20108 raft_consensus.cc:2468] T 833a2f0775ed407a94b8924ce50adb63 P 127766fc592545a4997f7790f50f6076 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 8.
I20260709 13:05:51.414093 22840 raft_consensus.cc:493] T 3e1f505cb0f1427bbd698ac889d80821 P 0473d2b2d01f4459b1e90fd12cc7840e [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:51.568130 19485 raft_consensus.cc:2468] T fa8650e71aa14778b3d73721fc50d9fc P 0473d2b2d01f4459b1e90fd12cc7840e [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 10.
I20260709 13:05:51.551051 19375 leader_election.cc:304] T 14935b3ddf914369822e4a0547aaa355 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87; no voters: 127766fc592545a4997f7790f50f6076, e61c3a8f61bb48f8a963c9480e53c168
W20260709 13:05:51.652180 19375 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.3:36891, user_credentials={real_user=slave}} blocked reactor thread for 101195us
I20260709 13:05:51.653086 19375 leader_election.cc:304] T ab43d85f64114d4ebf618930e43d9ed0 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87; no voters: 127766fc592545a4997f7790f50f6076, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:05:51.548028 19407 raft_consensus.cc:2468] T 775c229504194560ba9589bc2199b089 P e5256d91808b47c195bc9b4dbd7f2b87 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 127766fc592545a4997f7790f50f6076 in term 7.
I20260709 13:05:51.569657 19479 rpcz_store.cc:276] 0709 13:05:49.352280 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:51.415998 (+2063718us) service_pool.cc:224] Handling call
0709 13:05:51.452011 (+ 36013us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:51.452182 (+   171us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:05:51.452209 (+    27us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:05:51.452248 (+    39us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:05:51.452278 (+    30us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:51.452328 (+    50us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:51.452443 (+   115us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:05:51.576936 19560 raft_consensus.cc:2468] T b08304a0a02b42d7840c4e8ee9a6bd1a P e61c3a8f61bb48f8a963c9480e53c168 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 10.
I20260709 13:05:51.547133 19558 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40428 (request call id 2250) took 1158 ms. Trace:
I20260709 13:05:51.545919 20104 raft_consensus.cc:3060] T 70797e5783b5454ab0d0eea663e791e3 P 127766fc592545a4997f7790f50f6076 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:05:51.514935 23038 raft_consensus.cc:493] T b9f0d59553ad444883fcf5b5909f9798 P 0473d2b2d01f4459b1e90fd12cc7840e [term 8 FOLLOWER]: Starting pre-election (detected failure of leader e61c3a8f61bb48f8a963c9480e53c168)
I20260709 13:05:51.583770 19486 raft_consensus.cc:1275] T 2725d2c4cb054f18b0fc8f735c15f6c2 P 0473d2b2d01f4459b1e90fd12cc7840e [term 10 FOLLOWER]: Refusing update from remote peer e5256d91808b47c195bc9b4dbd7f2b87: Log matching property violated. Preceding OpId in replica: term: 8 index: 4. Preceding OpId from leader: term: 10 index: 5. (index mismatch)
I20260709 13:05:51.583781 20109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "775c229504194560ba9589bc2199b089" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:05:51.656451 20109 raft_consensus.cc:2468] T 775c229504194560ba9589bc2199b089 P 127766fc592545a4997f7790f50f6076 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 7.
I20260709 13:05:51.494913 22821 leader_election.cc:290] T 775c229504194560ba9589bc2199b089 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:05:51.520408 23060 leader_election.cc:290] T d1e5873a19244c5ebbcd38e126796ee7 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:05:51.654932 19558 rpcz_store.cc:276] 0709 13:05:50.388482 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:50.575671 (+187189us) service_pool.cc:224] Handling call
0709 13:05:51.547057 (+971386us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":37888}
I20260709 13:05:51.659471 19560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b74109013a140ada21feeef92d6f563" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:05:51.660249 19560 raft_consensus.cc:2468] T 2b74109013a140ada21feeef92d6f563 P e61c3a8f61bb48f8a963c9480e53c168 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 5.
I20260709 13:05:51.506057 23141 raft_consensus.cc:697] T 1efebf73c86e432baa55533136b6e12c P 127766fc592545a4997f7790f50f6076 [term 8 LEADER]: Becoming Leader. State: Replica: 127766fc592545a4997f7790f50f6076, State: Running, Role: LEADER
I20260709 13:05:51.665297 23141 consensus_queue.cc:237] T 1efebf73c86e432baa55533136b6e12c P 127766fc592545a4997f7790f50f6076 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:05:51.546787 19377 leader_election.cc:304] T 40e1e16737a842ee936002830f36882e P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87; no voters: e61c3a8f61bb48f8a963c9480e53c168
W20260709 13:05:51.670920 19377 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.2:46257, user_credentials={real_user=slave}} blocked reactor thread for 124255us
I20260709 13:05:51.578256 19523 leader_election.cc:304] T f1b10566f45d4a7d9029858330e02d5b P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
W20260709 13:05:51.675177 19523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.1:40321, user_credentials={real_user=slave}} blocked reactor thread for 96981.8us
I20260709 13:05:51.676438 19523 leader_election.cc:304] T ed7fdbcb96d14d418db9ca90a792588a P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e61c3a8f61bb48f8a963c9480e53c168; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, 127766fc592545a4997f7790f50f6076
I20260709 13:05:51.677531 23158 raft_consensus.cc:2804] T f1b10566f45d4a7d9029858330e02d5b P e61c3a8f61bb48f8a963c9480e53c168 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:05:51.677954 23158 raft_consensus.cc:493] T f1b10566f45d4a7d9029858330e02d5b P e61c3a8f61bb48f8a963c9480e53c168 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 0473d2b2d01f4459b1e90fd12cc7840e)
I20260709 13:05:51.678318 23158 raft_consensus.cc:3060] T f1b10566f45d4a7d9029858330e02d5b P e61c3a8f61bb48f8a963c9480e53c168 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:05:51.481272 23091 leader_election.cc:290] T f93ee515a9c14139bf566522ed8232f3 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:05:51.679033 23091 raft_consensus.cc:2804] T 40e1e16737a842ee936002830f36882e P e5256d91808b47c195bc9b4dbd7f2b87 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:05:51.679404 23091 raft_consensus.cc:493] T 40e1e16737a842ee936002830f36882e P e5256d91808b47c195bc9b4dbd7f2b87 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:51.679750 23091 raft_consensus.cc:3060] T 40e1e16737a842ee936002830f36882e P e5256d91808b47c195bc9b4dbd7f2b87 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:05:51.683388 23126 raft_consensus.cc:2749] T ed7fdbcb96d14d418db9ca90a792588a P e61c3a8f61bb48f8a963c9480e53c168 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:05:51.545547 19402 raft_consensus.cc:2468] T 833a2f0775ed407a94b8924ce50adb63 P e5256d91808b47c195bc9b4dbd7f2b87 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 127766fc592545a4997f7790f50f6076 in term 8.
I20260709 13:05:51.587451 19482 raft_consensus.cc:1275] T ff9b0eddd810459b82d91c60777c10eb P 0473d2b2d01f4459b1e90fd12cc7840e [term 8 FOLLOWER]: Refusing update from remote peer e5256d91808b47c195bc9b4dbd7f2b87: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:05:51.684465 19482 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58294 (request call id 2024) took 1281 ms. Trace:
I20260709 13:05:51.684814 19482 rpcz_store.cc:276] 0709 13:05:50.403125 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:51.586905 (+1183780us) service_pool.cc:224] Handling call
0709 13:05:51.587171 (+   266us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:51.684246 (+ 97075us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:51.684418 (+   172us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:05:51.634457 19555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab43d85f64114d4ebf618930e43d9ed0" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:05:51.648425 19374 leader_election.cc:304] T 833a2f0775ed407a94b8924ce50adb63 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 127766fc592545a4997f7790f50f6076, e5256d91808b47c195bc9b4dbd7f2b87; no voters: 
I20260709 13:05:51.499043 23142 raft_consensus.cc:493] T 4509b76741dc428e9201c70c1658da13 P e61c3a8f61bb48f8a963c9480e53c168 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 0473d2b2d01f4459b1e90fd12cc7840e)
I20260709 13:05:51.686921 22821 raft_consensus.cc:2804] T 833a2f0775ed407a94b8924ce50adb63 P e5256d91808b47c195bc9b4dbd7f2b87 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:05:51.686501 23142 raft_consensus.cc:515] T 4509b76741dc428e9201c70c1658da13 P e61c3a8f61bb48f8a963c9480e53c168 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:51.687448 22821 raft_consensus.cc:493] T 833a2f0775ed407a94b8924ce50adb63 P e5256d91808b47c195bc9b4dbd7f2b87 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:51.687934 22821 raft_consensus.cc:3060] T 833a2f0775ed407a94b8924ce50adb63 P e5256d91808b47c195bc9b4dbd7f2b87 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:05:51.649923 19450 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.3:36891, user_credentials={real_user=slave}} blocked reactor thread for 55803.9us
I20260709 13:05:51.691262 23142 leader_election.cc:290] T 4509b76741dc428e9201c70c1658da13 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:05:51.697732 23158 raft_consensus.cc:515] T f1b10566f45d4a7d9029858330e02d5b P e61c3a8f61bb48f8a963c9480e53c168 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:51.705931 23158 leader_election.cc:290] T f1b10566f45d4a7d9029858330e02d5b P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 11 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:05:51.703140 22821 raft_consensus.cc:515] T 833a2f0775ed407a94b8924ce50adb63 P e5256d91808b47c195bc9b4dbd7f2b87 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:05:51.632215 23131 raft_consensus.cc:493] T ff9b0eddd810459b82d91c60777c10eb P 127766fc592545a4997f7790f50f6076 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader e5256d91808b47c195bc9b4dbd7f2b87)
I20260709 13:05:51.711717 23084 leader_election.cc:290] T ab43d85f64114d4ebf618930e43d9ed0 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:05:51.711429 23093 raft_consensus.cc:515] T 48824d5acfbc485ebf8c2d944e7202de P e61c3a8f61bb48f8a963c9480e53c168 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:05:51.712054 23131 raft_consensus.cc:515] T ff9b0eddd810459b82d91c60777c10eb P 127766fc592545a4997f7790f50f6076 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:05:51.713130 22903 raft_consensus.cc:2804] T 775c229504194560ba9589bc2199b089 P 127766fc592545a4997f7790f50f6076 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:05:51.631506 22978 raft_consensus.cc:493] T 28af091831594f9d8e96482078cc7625 P 0473d2b2d01f4459b1e90fd12cc7840e [term 9 FOLLOWER]: Starting pre-election (detected failure of leader e61c3a8f61bb48f8a963c9480e53c168)
I20260709 13:05:51.550824 23124 leader_election.cc:290] T 62c6c134d3d24a1ab144dd9ee6bc3f64 P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:05:51.556928 22964 raft_consensus.cc:3060] T 1dc5b3532fe54f74876d02beffa2c230 P 0473d2b2d01f4459b1e90fd12cc7840e [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:05:51.713533 22903 raft_consensus.cc:493] T 775c229504194560ba9589bc2199b089 P 127766fc592545a4997f7790f50f6076 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:51.714426 19553 raft_consensus.cc:1240] T e381f1d6b8184797ad142de49be225a8 P e61c3a8f61bb48f8a963c9480e53c168 [term 8 FOLLOWER]: Rejecting Update request from peer 0473d2b2d01f4459b1e90fd12cc7840e for earlier term 7. Current term is 8. Ops: []
I20260709 13:05:51.713788 23093 leader_election.cc:290] T 48824d5acfbc485ebf8c2d944e7202de P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:05:51.582067 22912 raft_consensus.cc:493] T 0e1085d23e8347fbbd5bce7542f4b1f4 P 127766fc592545a4997f7790f50f6076 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader e61c3a8f61bb48f8a963c9480e53c168)
I20260709 13:05:52.032378 22912 raft_consensus.cc:515] T 0e1085d23e8347fbbd5bce7542f4b1f4 P 127766fc592545a4997f7790f50f6076 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:05:51.634996 22999 raft_consensus.cc:3060] T 1f85fc4b527a48848e5faa083b604e36 P 127766fc592545a4997f7790f50f6076 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:05:51.582752 23050 raft_consensus.cc:2749] T d1e5873a19244c5ebbcd38e126796ee7 P 0473d2b2d01f4459b1e90fd12cc7840e [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:05:52.034767 22912 leader_election.cc:290] T 0e1085d23e8347fbbd5bce7542f4b1f4 P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:05:51.587255 23149 raft_consensus.cc:493] T 65d8cb8d6ec64f459d5a47cefab10acf P 127766fc592545a4997f7790f50f6076 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader e5256d91808b47c195bc9b4dbd7f2b87)
W20260709 13:05:52.035808 23160 log.cc:927] Time spent T ff9b0eddd810459b82d91c60777c10eb P 127766fc592545a4997f7790f50f6076: Append to log took a long time: real 0.255s	user 0.003s	sys 0.001s
I20260709 13:05:52.035482 23149 raft_consensus.cc:515] T 65d8cb8d6ec64f459d5a47cefab10acf P 127766fc592545a4997f7790f50f6076 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:05:52.037669 23149 leader_election.cc:290] T 65d8cb8d6ec64f459d5a47cefab10acf P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:05:51.654930 23052 leader_election.cc:290] T 2725d2c4cb054f18b0fc8f735c15f6c2 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:05:51.710165 23091 raft_consensus.cc:515] T 40e1e16737a842ee936002830f36882e P e5256d91808b47c195bc9b4dbd7f2b87 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:51.714504 23055 raft_consensus.cc:2749] T 14935b3ddf914369822e4a0547aaa355 P e5256d91808b47c195bc9b4dbd7f2b87 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:05:52.039853 23091 leader_election.cc:290] T 40e1e16737a842ee936002830f36882e P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 13 election: Requested vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:05:51.714169 22977 raft_consensus.cc:493] T 21e14947d70440f19044d8f75c31e1f9 P e5256d91808b47c195bc9b4dbd7f2b87 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:52.040557 22977 raft_consensus.cc:3060] T 21e14947d70440f19044d8f75c31e1f9 P e5256d91808b47c195bc9b4dbd7f2b87 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:05:51.568564 23019 raft_consensus.cc:515] T 5ec1c4ce15e04c7e8c283a62179f2a64 P e5256d91808b47c195bc9b4dbd7f2b87 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:05:51.714772 22882 raft_consensus.cc:493] T fa8650e71aa14778b3d73721fc50d9fc P 0473d2b2d01f4459b1e90fd12cc7840e [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:52.041497 22882 raft_consensus.cc:515] T fa8650e71aa14778b3d73721fc50d9fc P 0473d2b2d01f4459b1e90fd12cc7840e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:51.713554 22898 leader_election.cc:290] T e381f1d6b8184797ad142de49be225a8 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 8 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:05:52.042639 23019 leader_election.cc:290] T 5ec1c4ce15e04c7e8c283a62179f2a64 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 9 election: Requested vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:05:52.042639 19411 raft_consensus.cc:2368] T 5ec1c4ce15e04c7e8c283a62179f2a64 P e5256d91808b47c195bc9b4dbd7f2b87 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 127766fc592545a4997f7790f50f6076 for earlier term 8. Current term is 9.
I20260709 13:05:52.042722 19479 raft_consensus.cc:1240] T 1f85fc4b527a48848e5faa083b604e36 P 0473d2b2d01f4459b1e90fd12cc7840e [term 6 FOLLOWER]: Rejecting Update request from peer 127766fc592545a4997f7790f50f6076 for earlier term 5. Current term is 6. Ops: []
I20260709 13:05:52.044185 19479 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39478 (request call id 475) took 1629 ms. Trace:
I20260709 13:05:52.044500 19479 rpcz_store.cc:276] 0709 13:05:50.414938 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:51.654111 (+1239173us) service_pool.cc:224] Handling call
0709 13:05:52.041234 (+387123us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:52.043931 (+  2697us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:52.044133 (+   202us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:05:51.631711 23097 consensus_queue.cc:1059] T 7f575b143b844aa096b50997dad3516a P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 }, Status: INVALID_TERM, Last received: 4.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.164s
I20260709 13:05:51.434471 23137 raft_consensus.cc:515] T ab43d85f64114d4ebf618930e43d9ed0 P e61c3a8f61bb48f8a963c9480e53c168 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } attrs { replace: true } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:05:51.752326 22903 raft_consensus.cc:3060] T 775c229504194560ba9589bc2199b089 P 127766fc592545a4997f7790f50f6076 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:05:52.047384 22977 raft_consensus.cc:515] T 21e14947d70440f19044d8f75c31e1f9 P e5256d91808b47c195bc9b4dbd7f2b87 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:52.048170 23137 leader_election.cc:290] T ab43d85f64114d4ebf618930e43d9ed0 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:05:52.049348 22977 leader_election.cc:290] T 21e14947d70440f19044d8f75c31e1f9 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 9 election: Requested vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:05:51.633124 23072 consensus_queue.cc:1048] T 46c5bfeecc314717bffe987e6844b6d0 P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.128s
I20260709 13:05:51.714056 22978 raft_consensus.cc:515] T 28af091831594f9d8e96482078cc7625 P 0473d2b2d01f4459b1e90fd12cc7840e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:51.716094 22840 raft_consensus.cc:515] T 3e1f505cb0f1427bbd698ac889d80821 P 0473d2b2d01f4459b1e90fd12cc7840e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:52.052049 22978 leader_election.cc:290] T 28af091831594f9d8e96482078cc7625 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:05:52.052563 22903 raft_consensus.cc:515] T 775c229504194560ba9589bc2199b089 P 127766fc592545a4997f7790f50f6076 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:05:52.054059 22840 leader_election.cc:290] T 3e1f505cb0f1427bbd698ac889d80821 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:05:51.720868 23038 raft_consensus.cc:515] T b9f0d59553ad444883fcf5b5909f9798 P 0473d2b2d01f4459b1e90fd12cc7840e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:52.054517 22903 leader_election.cc:290] T 775c229504194560ba9589bc2199b089 P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 8 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:05:51.581918 23140 raft_consensus.cc:515] T fa8650e71aa14778b3d73721fc50d9fc P e61c3a8f61bb48f8a963c9480e53c168 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:51.769822 22979 leader_election.cc:290] T 2b74109013a140ada21feeef92d6f563 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:05:51.721004 23147 leader_election.cc:290] T fa731b585f684a7fb2d106c50f143b83 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:05:51.783038 23153 raft_consensus.cc:2804] T 96efeaaf1057492490e9a621f37e1a2d P 127766fc592545a4997f7790f50f6076 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:05:51.783821 23155 raft_consensus.cc:493] T 2a16f7501e2444fb86d4e2778e734e02 P 127766fc592545a4997f7790f50f6076 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:52.055675 23153 raft_consensus.cc:697] T 96efeaaf1057492490e9a621f37e1a2d P 127766fc592545a4997f7790f50f6076 [term 10 LEADER]: Becoming Leader. State: Replica: 127766fc592545a4997f7790f50f6076, State: Running, Role: LEADER
I20260709 13:05:52.055872 23038 leader_election.cc:290] T b9f0d59553ad444883fcf5b5909f9798 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:05:52.055724 23155 raft_consensus.cc:515] T 2a16f7501e2444fb86d4e2778e734e02 P 127766fc592545a4997f7790f50f6076 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:05:52.056465 23140 leader_election.cc:290] T fa8650e71aa14778b3d73721fc50d9fc P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:05:52.056706 23153 consensus_queue.cc:237] T 96efeaaf1057492490e9a621f37e1a2d P 127766fc592545a4997f7790f50f6076 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:05:52.057967 23155 leader_election.cc:290] T 2a16f7501e2444fb86d4e2778e734e02 P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:05:51.786316 23150 raft_consensus.cc:2804] T 21e14947d70440f19044d8f75c31e1f9 P e61c3a8f61bb48f8a963c9480e53c168 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:05:51.787125 23034 leader_election.cc:290] T 85c494af21f9457a85da47b9bc70c1fd P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:05:51.787326 23051 leader_election.cc:290] T 2725d2c4cb054f18b0fc8f735c15f6c2 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:05:51.788057 23148 leader_election.cc:290] T 48824d5acfbc485ebf8c2d944e7202de P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:05:51.788200 22896 leader_election.cc:290] T a08760e15aac4630a629431f56024dc8 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:05:52.060438 23150 raft_consensus.cc:493] T 21e14947d70440f19044d8f75c31e1f9 P e61c3a8f61bb48f8a963c9480e53c168 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 0473d2b2d01f4459b1e90fd12cc7840e)
I20260709 13:05:52.060992 23150 raft_consensus.cc:3060] T 21e14947d70440f19044d8f75c31e1f9 P e61c3a8f61bb48f8a963c9480e53c168 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:05:51.787799 23066 raft_consensus.cc:515] T 1dc5b3532fe54f74876d02beffa2c230 P e61c3a8f61bb48f8a963c9480e53c168 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:51.793244 22758 raft_consensus.cc:515] T edd7d470b5014c9489be7f41f64355c9 P e61c3a8f61bb48f8a963c9480e53c168 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:51.786556 23122 leader_election.cc:290] T 86a6797bdfe94fa496c050ceae4bd0d9 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:05:51.801290 22964 raft_consensus.cc:515] T 1dc5b3532fe54f74876d02beffa2c230 P 0473d2b2d01f4459b1e90fd12cc7840e [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:52.064013 23066 leader_election.cc:290] T 1dc5b3532fe54f74876d02beffa2c230 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 9 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:05:51.812690 22859 raft_consensus.cc:515] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P e5256d91808b47c195bc9b4dbd7f2b87 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:05:52.064283 22964 leader_election.cc:290] T 1dc5b3532fe54f74876d02beffa2c230 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 9 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
W20260709 13:05:52.064477 19485 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58294 (request call id 2003) took 2716 ms (client timeout 1718 ms). Trace:
W20260709 13:05:52.064899 19485 rpcz_store.cc:269] 0709 13:05:49.348561 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:49.348708 (+   147us) service_pool.cc:224] Handling call
0709 13:05:52.064307 (+2715599us) spinlock_profiling.cc:243] Waited 2.16 s on lock 0x7b5400221d54. stack: 00007f4a79de9343 00007f4a79de9240 00007f4a797781d4 00007f4a834b6304 00007f4a834b6299 00007f4a7ce71571 00007f4a7cf0c2fa 00007f4a81ecdb17 00007f4a7b4486d4 00007f4a7b448662 00007f4a7b448591 00007f4a7b44850c 00007f4a7b4477c2 00007f4a7b24348c 00007f4a7b2428c6 00007f4a7b24226f
0709 13:05:52.064410 (+   103us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4968736000}
I20260709 13:05:51.884052 23088 leader_election.cc:290] T b08304a0a02b42d7840c4e8ee9a6bd1a P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:05:51.678238 19523 leader_election.cc:304] T 65d8cb8d6ec64f459d5a47cefab10acf P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e61c3a8f61bb48f8a963c9480e53c168; no voters: 127766fc592545a4997f7790f50f6076, e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:05:51.952229 23118 leader_election.cc:290] T ed7fdbcb96d14d418db9ca90a792588a P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:05:51.964373 23022 leader_election.cc:290] T df751f992649444090e27965eb1af85d P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
W20260709 13:05:51.964401 19452 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:05:52.066418 19523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.4:43121, user_credentials={real_user=slave}} blocked reactor thread for 388224us
I20260709 13:05:51.992519 23139 raft_consensus.cc:493] T 14efcc79969f41babe5529c22d59156d P 127766fc592545a4997f7790f50f6076 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader e5256d91808b47c195bc9b4dbd7f2b87)
I20260709 13:05:52.067139 19523 leader_election.cc:304] T 6c5eebf646ad445a9d1b1adc319d7b16 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 127766fc592545a4997f7790f50f6076, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:05:52.067214 23139 raft_consensus.cc:515] T 14efcc79969f41babe5529c22d59156d P 127766fc592545a4997f7790f50f6076 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:05:52.068202 22974 leader_election.cc:290] T 14935b3ddf914369822e4a0547aaa355 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:05:52.068280 23034 raft_consensus.cc:2749] T 65d8cb8d6ec64f459d5a47cefab10acf P e61c3a8f61bb48f8a963c9480e53c168 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:05:52.068751 22974 raft_consensus.cc:2804] T 6c5eebf646ad445a9d1b1adc319d7b16 P e61c3a8f61bb48f8a963c9480e53c168 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:05:52.069317 23139 leader_election.cc:290] T 14efcc79969f41babe5529c22d59156d P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:05:52.069243 22974 raft_consensus.cc:697] T 6c5eebf646ad445a9d1b1adc319d7b16 P e61c3a8f61bb48f8a963c9480e53c168 [term 8 LEADER]: Becoming Leader. State: Replica: e61c3a8f61bb48f8a963c9480e53c168, State: Running, Role: LEADER
W20260709 13:05:51.994223 19405 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52328 (request call id 1782) took 2773 ms (client timeout 2031 ms). Trace:
I20260709 13:05:51.995039 23089 leader_election.cc:290] T df751f992649444090e27965eb1af85d P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:05:51.997623 19551 raft_consensus.cc:2410] T ff75a1d4cb1f493db8f71ddc136ba9ab P e61c3a8f61bb48f8a963c9480e53c168 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0473d2b2d01f4459b1e90fd12cc7840e for term 9 because replica has last-logged OpId of term: 8 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
I20260709 13:05:52.070415 22974 consensus_queue.cc:237] T 6c5eebf646ad445a9d1b1adc319d7b16 P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:05:52.064148 22758 leader_election.cc:290] T edd7d470b5014c9489be7f41f64355c9 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 11 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:05:52.021235 19556 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40428 (request call id 2247) took 1633 ms. Trace:
W20260709 13:05:52.071372 19405 rpcz_store.cc:269] 0709 13:05:49.221000 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:49.221546 (+   546us) service_pool.cc:224] Handling call
0709 13:05:51.994068 (+2772522us) spinlock_profiling.cc:243] Waited 2.18 s on lock 0x7b54000e6ad4. stack: 00007f4a79de9343 00007f4a79de9240 00007f4a797781d4 00007f4a834b6304 00007f4a834b6299 00007f4a7ce71571 00007f4a7cf0c2fa 00007f4a81ecdb17 00007f4a7b4486d4 00007f4a7b448662 00007f4a7b448591 00007f4a7b44850c 00007f4a7b4477c2 00007f4a7b24348c 00007f4a7b2428c6 00007f4a7b24226f
0709 13:05:51.994169 (+   101us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5011270400}
I20260709 13:05:52.071990 19556 rpcz_store.cc:276] 0709 13:05:50.387657 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:50.648269 (+260612us) service_pool.cc:224] Handling call
0709 13:05:50.648526 (+   257us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:51.634321 (+985795us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:52.020996 (+386675us) spinlock_profiling.cc:243] Waited 984 ms on lock 0x7b540012aa54. stack: 00007f4a79de9343 00007f4a79de9240 00007f4a797781d4 00007f4a834b6304 00007f4a834b6299 00007f4a7ce71571 00007f4a7cf08e01 00007f4a7cf0783e 00007f4a81ecc419 00007f4a7b443bd4 00007f4a7b443b62 00007f4a7b443a91 00007f4a7b443a0c 00007f4a7b442cc2 00007f4a7b24348c 00007f4a7b2428c6
0709 13:05:52.021176 (+   180us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2262576384}
I20260709 13:05:52.073797 20110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62c6c134d3d24a1ab144dd9ee6bc3f64" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:05:52.074378 20110 raft_consensus.cc:2468] T 62c6c134d3d24a1ab144dd9ee6bc3f64 P 127766fc592545a4997f7790f50f6076 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 8.
I20260709 13:05:52.072908 22859 leader_election.cc:290] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 11 election: Requested vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:05:52.078233 23150 raft_consensus.cc:515] T 21e14947d70440f19044d8f75c31e1f9 P e61c3a8f61bb48f8a963c9480e53c168 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:52.079499 20110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48824d5acfbc485ebf8c2d944e7202de" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:05:52.080092 20110 raft_consensus.cc:2468] T 48824d5acfbc485ebf8c2d944e7202de P 127766fc592545a4997f7790f50f6076 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 9.
W20260709 13:05:52.080257 19480 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.562s	user 0.043s	sys 0.063s
W20260709 13:05:52.080744 19480 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.562s	user 0.043s	sys 0.063s
I20260709 13:05:52.082111 20110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa731b585f684a7fb2d106c50f143b83" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:05:52.080330 23150 leader_election.cc:290] T 21e14947d70440f19044d8f75c31e1f9 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 9 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:05:52.083425 20110 raft_consensus.cc:2393] T fa731b585f684a7fb2d106c50f143b83 P 127766fc592545a4997f7790f50f6076 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e61c3a8f61bb48f8a963c9480e53c168 in current term 9: Already voted for candidate e5256d91808b47c195bc9b4dbd7f2b87 in this term.
I20260709 13:05:52.086354 20110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85c494af21f9457a85da47b9bc70c1fd" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
W20260709 13:05:52.087292 20076 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:52.088541 20110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab43d85f64114d4ebf618930e43d9ed0" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:05:52.090768 20109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70797e5783b5454ab0d0eea663e791e3" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:05:52.092082 20107 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35874 (request call id 724) took 1030 ms. Trace:
I20260709 13:05:52.093283 23150 raft_consensus.cc:493] T 833a2f0775ed407a94b8924ce50adb63 P e61c3a8f61bb48f8a963c9480e53c168 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader e5256d91808b47c195bc9b4dbd7f2b87)
I20260709 13:05:52.095752 22758 raft_consensus.cc:493] T 7be9efa6559648dbb5a0f7684c4542d1 P e61c3a8f61bb48f8a963c9480e53c168 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:52.096312 23150 raft_consensus.cc:515] T 833a2f0775ed407a94b8924ce50adb63 P e61c3a8f61bb48f8a963c9480e53c168 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:05:52.096457 22758 raft_consensus.cc:515] T 7be9efa6559648dbb5a0f7684c4542d1 P e61c3a8f61bb48f8a963c9480e53c168 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } attrs { replace: true } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:05:52.098316 23150 leader_election.cc:290] T 833a2f0775ed407a94b8924ce50adb63 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:05:52.098791 23150 raft_consensus.cc:493] T ef32ce6fdd0e40d382c79974f30295c6 P e61c3a8f61bb48f8a963c9480e53c168 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:52.099175 22758 leader_election.cc:290] T 7be9efa6559648dbb5a0f7684c4542d1 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:05:52.099193 23150 raft_consensus.cc:515] T ef32ce6fdd0e40d382c79974f30295c6 P e61c3a8f61bb48f8a963c9480e53c168 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:52.094884 22974 raft_consensus.cc:493] T 0cdf56e38bbc453d9438d359e5a69955 P e61c3a8f61bb48f8a963c9480e53c168 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader e5256d91808b47c195bc9b4dbd7f2b87)
I20260709 13:05:52.100531 22974 raft_consensus.cc:515] T 0cdf56e38bbc453d9438d359e5a69955 P e61c3a8f61bb48f8a963c9480e53c168 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:52.102459 22974 leader_election.cc:290] T 0cdf56e38bbc453d9438d359e5a69955 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
W20260709 13:05:52.095732 19523 connection.cc:256] RPC call timeout handler was delayed by -1.037645901000019s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20310000000000003s for a response
I20260709 13:05:52.103785 19556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "833a2f0775ed407a94b8924ce50adb63" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:05:52.103972 19560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4af19371ea874c09a0a2147040835cbb" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:05:52.104357 19556 raft_consensus.cc:2468] T 833a2f0775ed407a94b8924ce50adb63 P e61c3a8f61bb48f8a963c9480e53c168 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 127766fc592545a4997f7790f50f6076 in term 7.
I20260709 13:05:52.104787 19558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1efebf73c86e432baa55533136b6e12c" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:05:52.105253 19556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62c6c134d3d24a1ab144dd9ee6bc3f64" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:05:52.105370 19560 raft_consensus.cc:2468] T 4af19371ea874c09a0a2147040835cbb P e61c3a8f61bb48f8a963c9480e53c168 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 127766fc592545a4997f7790f50f6076 in term 5.
I20260709 13:05:52.106196 19560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65d8cb8d6ec64f459d5a47cefab10acf" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:05:52.106850 19560 raft_consensus.cc:2468] T 65d8cb8d6ec64f459d5a47cefab10acf P e61c3a8f61bb48f8a963c9480e53c168 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 127766fc592545a4997f7790f50f6076 in term 6.
I20260709 13:05:52.107358 20109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14935b3ddf914369822e4a0547aaa355" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:05:52.107745 19553 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40428 (request call id 2259) took 1106 ms. Trace:
I20260709 13:05:52.105286 19558 raft_consensus.cc:3060] T 1efebf73c86e432baa55533136b6e12c P e61c3a8f61bb48f8a963c9480e53c168 [term 6 FOLLOWER]: Advancing to term 8
I20260709 13:05:52.108215 19553 rpcz_store.cc:276] 0709 13:05:51.001905 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:51.119048 (+117143us) service_pool.cc:224] Handling call
0709 13:05:51.119407 (+   359us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:52.031989 (+912582us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:52.107540 (+ 75551us) spinlock_profiling.cc:243] Waited 595 ms on lock 0x7b540009c9d4. stack: 00007f4a79de9343 00007f4a79de9240 00007f4a797781d4 00007f4a834b6304 00007f4a834b6299 00007f4a7ce71571 00007f4a7cf08e01 00007f4a7cf0783e 00007f4a81ecc419 00007f4a7b443bd4 00007f4a7b443b62 00007f4a7b443a91 00007f4a7b443a0c 00007f4a7b442cc2 00007f4a7b24348c 00007f4a7b2428c6
0709 13:05:52.107696 (+   156us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1367992064}
W20260709 13:05:52.110427 19449 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.1:40321, user_credentials={real_user=slave}} blocked reactor thread for 476446us
I20260709 13:05:52.111155 20109 raft_consensus.cc:1240] T 96efeaaf1057492490e9a621f37e1a2d P 127766fc592545a4997f7790f50f6076 [term 10 LEADER]: Rejecting Update request from peer e61c3a8f61bb48f8a963c9480e53c168 for earlier term 9. Current term is 10. Ops: []
I20260709 13:05:52.112080 19482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c5eebf646ad445a9d1b1adc319d7b16" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:05:52.113184 20109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "833a2f0775ed407a94b8924ce50adb63" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:05:52.113521 23150 leader_election.cc:290] T ef32ce6fdd0e40d382c79974f30295c6 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:05:52.114042 20109 raft_consensus.cc:2393] T 833a2f0775ed407a94b8924ce50adb63 P 127766fc592545a4997f7790f50f6076 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e61c3a8f61bb48f8a963c9480e53c168 in current term 8: Already voted for candidate 127766fc592545a4997f7790f50f6076 in this term.
I20260709 13:05:52.113160 19482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1b10566f45d4a7d9029858330e02d5b" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:05:52.115271 23156 raft_consensus.cc:3055] T ab43d85f64114d4ebf618930e43d9ed0 P 127766fc592545a4997f7790f50f6076 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:05:52.115454 19482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62c6c134d3d24a1ab144dd9ee6bc3f64" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:05:52.115686 23156 raft_consensus.cc:740] T ab43d85f64114d4ebf618930e43d9ed0 P 127766fc592545a4997f7790f50f6076 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 127766fc592545a4997f7790f50f6076, State: Running, Role: LEADER
I20260709 13:05:52.116056 19523 leader_election.cc:304] T 62c6c134d3d24a1ab144dd9ee6bc3f64 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 127766fc592545a4997f7790f50f6076, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:05:52.116460 19482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b08304a0a02b42d7840c4e8ee9a6bd1a" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:05:52.116883 19523 leader_election.cc:304] T 48824d5acfbc485ebf8c2d944e7202de P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 127766fc592545a4997f7790f50f6076, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:05:52.116518 23156 consensus_queue.cc:260] T ab43d85f64114d4ebf618930e43d9ed0 P 127766fc592545a4997f7790f50f6076 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } attrs { replace: true } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
W20260709 13:05:52.117409 19450 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.3:36891, user_credentials={real_user=slave}} blocked reactor thread for 427735us
I20260709 13:05:52.117672 22974 raft_consensus.cc:2804] T 62c6c134d3d24a1ab144dd9ee6bc3f64 P e61c3a8f61bb48f8a963c9480e53c168 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:05:52.117764 20109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7be9efa6559648dbb5a0f7684c4542d1" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:05:52.118149 23156 raft_consensus.cc:3060] T ab43d85f64114d4ebf618930e43d9ed0 P 127766fc592545a4997f7790f50f6076 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:05:52.106249 19556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "309c3ca0ca4b4f3ba129752ea2cb293b" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:05:52.118328 23150 raft_consensus.cc:2804] T 48824d5acfbc485ebf8c2d944e7202de P e61c3a8f61bb48f8a963c9480e53c168 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:05:52.118882 23150 raft_consensus.cc:493] T 48824d5acfbc485ebf8c2d944e7202de P e61c3a8f61bb48f8a963c9480e53c168 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:52.118181 22974 raft_consensus.cc:493] T 62c6c134d3d24a1ab144dd9ee6bc3f64 P e61c3a8f61bb48f8a963c9480e53c168 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 0473d2b2d01f4459b1e90fd12cc7840e)
I20260709 13:05:52.107672 19560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96efeaaf1057492490e9a621f37e1a2d" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:05:52.119354 23150 raft_consensus.cc:3060] T 48824d5acfbc485ebf8c2d944e7202de P e61c3a8f61bb48f8a963c9480e53c168 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:05:52.119474 22974 raft_consensus.cc:3060] T 62c6c134d3d24a1ab144dd9ee6bc3f64 P e61c3a8f61bb48f8a963c9480e53c168 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:05:52.119725 19479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dc5b3532fe54f74876d02beffa2c230" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:05:52.120221 19560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed7fdbcb96d14d418db9ca90a792588a" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:05:52.120435 19479 raft_consensus.cc:2393] T 1dc5b3532fe54f74876d02beffa2c230 P 0473d2b2d01f4459b1e90fd12cc7840e [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e61c3a8f61bb48f8a963c9480e53c168 in current term 9: Already voted for candidate 0473d2b2d01f4459b1e90fd12cc7840e in this term.
I20260709 13:05:52.121222 19479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a08760e15aac4630a629431f56024dc8" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:05:52.119285 19556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e1085d23e8347fbbd5bce7542f4b1f4" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:05:52.121896 19479 raft_consensus.cc:3060] T a08760e15aac4630a629431f56024dc8 P 0473d2b2d01f4459b1e90fd12cc7840e [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:05:52.122417 19556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a16f7501e2444fb86d4e2778e734e02" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:05:52.123013 19556 raft_consensus.cc:2468] T 2a16f7501e2444fb86d4e2778e734e02 P e61c3a8f61bb48f8a963c9480e53c168 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 127766fc592545a4997f7790f50f6076 in term 10.
I20260709 13:05:52.109308 19553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c5eebf646ad445a9d1b1adc319d7b16" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:05:52.118413 20109 raft_consensus.cc:2468] T 7be9efa6559648dbb5a0f7684c4542d1 P 127766fc592545a4997f7790f50f6076 [term 9 LEARNER]: Leader pre-election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 9.
I20260709 13:05:52.117278 19482 raft_consensus.cc:2393] T b08304a0a02b42d7840c4e8ee9a6bd1a P 0473d2b2d01f4459b1e90fd12cc7840e [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e61c3a8f61bb48f8a963c9480e53c168 in current term 11: Already voted for candidate 0473d2b2d01f4459b1e90fd12cc7840e in this term.
I20260709 13:05:52.099982 23104 leader_election.cc:290] T f93ee515a9c14139bf566522ed8232f3 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:05:52.092478 20107 rpcz_store.cc:276] 0709 13:05:51.062201 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:51.063057 (+   856us) service_pool.cc:224] Handling call
0709 13:05:51.063459 (+   402us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:05:51.385299 (+321840us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:05:51.385332 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:05:51.390404 (+  5072us) log.cc:844] Serialized 26 byte log entry
0709 13:05:51.611409 (+221005us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:05:51.611465 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:51.611573 (+   108us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:05:52.035245 (+423672us) spinlock_profiling.cc:243] Waited 6.43 ms on lock 0x7b4400022b4c. stack: 00007f4a79de9343 00007f4a79de9240 00007f4a797781d4 00007f4a834b6304 00007f4a834b6299 00007f4a79ca3db1 00007f4a79d41c85 00007f4a79d426a2 00007f4a7cab41db 00007f4a7caafaaf 00007f4a7caa386e 00007f4a7caa2bb6 00007f4a7caa27d8 00007f4a7caac221 00007f4a7caac1d9 00007f4a7caac169
0709 13:05:52.091829 (+ 56584us) raft_consensus.cc:1685] finished
0709 13:05:52.091848 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:52.092029 (+   181us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":55068,"raft.queue_time_us":323200,"raft.run_cpu_time_us":156,"raft.run_wall_time_us":6922,"spinlock_wait_cycles":14783744,"thread_start_us":456162,"threads_started":2,"wal-append.queue_time_us":345242}
I20260709 13:05:52.128660 19553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa731b585f684a7fb2d106c50f143b83" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:05:52.121235 19560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48824d5acfbc485ebf8c2d944e7202de" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:05:52.133064 19482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edd7d470b5014c9489be7f41f64355c9" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 11 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:05:52.134207 19553 raft_consensus.cc:2468] T fa731b585f684a7fb2d106c50f143b83 P e61c3a8f61bb48f8a963c9480e53c168 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 127766fc592545a4997f7790f50f6076 in term 8.
I20260709 13:05:52.126660 20076 leader_election.cc:304] T 833a2f0775ed407a94b8924ce50adb63 P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 127766fc592545a4997f7790f50f6076, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:05:52.119251 19485 raft_consensus.cc:1240] T 3e1f505cb0f1427bbd698ac889d80821 P 0473d2b2d01f4459b1e90fd12cc7840e [term 10 FOLLOWER]: Rejecting Update request from peer e61c3a8f61bb48f8a963c9480e53c168 for earlier term 9. Current term is 10. Ops: [9.5-9.5]
I20260709 13:05:52.128074 22758 consensus_queue.cc:1059] T 96efeaaf1057492490e9a621f37e1a2d P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:05:52.129458 23072 raft_consensus.cc:3055] T 7f575b143b844aa096b50997dad3516a P 0473d2b2d01f4459b1e90fd12cc7840e [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:05:52.141966 23072 raft_consensus.cc:740] T 7f575b143b844aa096b50997dad3516a P 0473d2b2d01f4459b1e90fd12cc7840e [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 0473d2b2d01f4459b1e90fd12cc7840e, State: Running, Role: LEADER
I20260709 13:05:52.142066 22758 consensus_queue.cc:1243] T 96efeaaf1057492490e9a621f37e1a2d P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Peer 127766fc592545a4997f7790f50f6076 log is divergent from this leader: its last log entry 10.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
I20260709 13:05:52.127475 19558 raft_consensus.cc:2468] T 1efebf73c86e432baa55533136b6e12c P e61c3a8f61bb48f8a963c9480e53c168 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 127766fc592545a4997f7790f50f6076 in term 8.
I20260709 13:05:52.131153 19557 raft_consensus.cc:1240] T edd7d470b5014c9489be7f41f64355c9 P e61c3a8f61bb48f8a963c9480e53c168 [term 11 FOLLOWER]: Rejecting Update request from peer 0473d2b2d01f4459b1e90fd12cc7840e for earlier term 10. Current term is 11. Ops: []
I20260709 13:05:52.142649 22758 raft_consensus.cc:3055] T 96efeaaf1057492490e9a621f37e1a2d P e61c3a8f61bb48f8a963c9480e53c168 [term 9 LEADER]: Stepping down as leader of term 9
W20260709 13:05:52.133659 19294 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet ab43d85f64114d4ebf618930e43d9ed0 with cas_config_opid_index 5: ChangeConfig:REMOVE_PEER failed with leader e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica e61c3a8f61bb48f8a963c9480e53c168 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 8 leader_uuid: "127766fc592545a4997f7790f50f6076" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } attrs { replace: true } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } } }
I20260709 13:05:52.143023 23072 consensus_queue.cc:260] T 7f575b143b844aa096b50997dad3516a P 0473d2b2d01f4459b1e90fd12cc7840e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:52.144404 23072 raft_consensus.cc:3060] T 7f575b143b844aa096b50997dad3516a P 0473d2b2d01f4459b1e90fd12cc7840e [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:05:52.145239 19405 raft_consensus.cc:1240] T 21e14947d70440f19044d8f75c31e1f9 P e5256d91808b47c195bc9b4dbd7f2b87 [term 9 FOLLOWER]: Rejecting Update request from peer 0473d2b2d01f4459b1e90fd12cc7840e for earlier term 8. Current term is 9. Ops: []
W20260709 13:05:52.146117 19450 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:52.145759 22974 raft_consensus.cc:515] T 62c6c134d3d24a1ab144dd9ee6bc3f64 P e61c3a8f61bb48f8a963c9480e53c168 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:05:52.128382 23066 raft_consensus.cc:493] T ece3db938bc649d4a40a51522ed5259c P e61c3a8f61bb48f8a963c9480e53c168 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader e5256d91808b47c195bc9b4dbd7f2b87)
I20260709 13:05:52.147046 23066 raft_consensus.cc:515] T ece3db938bc649d4a40a51522ed5259c P e61c3a8f61bb48f8a963c9480e53c168 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:05:52.147567 19408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cdf56e38bbc453d9438d359e5a69955" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:05:52.135030 19482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df751f992649444090e27965eb1af85d" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:05:52.149226 19482 raft_consensus.cc:2393] T df751f992649444090e27965eb1af85d P 0473d2b2d01f4459b1e90fd12cc7840e [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e61c3a8f61bb48f8a963c9480e53c168 in current term 10: Already voted for candidate 0473d2b2d01f4459b1e90fd12cc7840e in this term.
I20260709 13:05:52.149359 23066 leader_election.cc:290] T ece3db938bc649d4a40a51522ed5259c P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:05:52.143096 22758 raft_consensus.cc:740] T 96efeaaf1057492490e9a621f37e1a2d P e61c3a8f61bb48f8a963c9480e53c168 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: e61c3a8f61bb48f8a963c9480e53c168, State: Running, Role: LEADER
I20260709 13:05:52.135707 19485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e36a9d6e29c4a7c860cf267efbd4c74" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:05:52.150701 22758 consensus_queue.cc:260] T 96efeaaf1057492490e9a621f37e1a2d P e61c3a8f61bb48f8a963c9480e53c168 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:05:52.155380 22758 raft_consensus.cc:3060] T 96efeaaf1057492490e9a621f37e1a2d P e61c3a8f61bb48f8a963c9480e53c168 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:05:52.157280 19484 raft_consensus.cc:1240] T ab43d85f64114d4ebf618930e43d9ed0 P 0473d2b2d01f4459b1e90fd12cc7840e [term 9 FOLLOWER]: Rejecting Update request from peer 127766fc592545a4997f7790f50f6076 for earlier term 8. Current term is 9. Ops: []
I20260709 13:05:52.141073 19479 raft_consensus.cc:2468] T a08760e15aac4630a629431f56024dc8 P 0473d2b2d01f4459b1e90fd12cc7840e [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 11.
I20260709 13:05:52.150010 19482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1b10566f45d4a7d9029858330e02d5b" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
W20260709 13:05:52.151319 19477 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58294 (request call id 2021) took 1749 ms (client timeout 2247 ms). Trace:
I20260709 13:05:52.162313 19402 raft_consensus.cc:1275] T e381f1d6b8184797ad142de49be225a8 P e5256d91808b47c195bc9b4dbd7f2b87 [term 7 FOLLOWER]: Refusing update from remote peer 0473d2b2d01f4459b1e90fd12cc7840e: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
W20260709 13:05:52.162384 19477 rpcz_store.cc:269] 0709 13:05:50.402219 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:51.075725 (+673506us) service_pool.cc:224] Handling call
0709 13:05:52.151160 (+1075435us) spinlock_profiling.cc:243] Waited 71.3 ms on lock 0x7b5400224a54. stack: 00007f4a79de9343 00007f4a79de9240 00007f4a797781d4 00007f4a834b6304 00007f4a834b6299 00007f4a7ce71571 00007f4a7cf0c2fa 00007f4a81ecdb17 00007f4a7b4486d4 00007f4a7b448662 00007f4a7b448591 00007f4a7b44850c 00007f4a7b4477c2 00007f4a7b24348c 00007f4a7b2428c6 00007f4a7b24226f
0709 13:05:52.151268 (+   108us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":164098816}
W20260709 13:05:52.163228 20104 consensus_meta.cc:287] T 70797e5783b5454ab0d0eea663e791e3 P 127766fc592545a4997f7790f50f6076: Time spent flushing consensus metadata: real 0.508s	user 0.009s	sys 0.001s
I20260709 13:05:52.163561 20104 raft_consensus.cc:2468] T 70797e5783b5454ab0d0eea663e791e3 P 127766fc592545a4997f7790f50f6076 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 10.
I20260709 13:05:52.163681 19477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2725d2c4cb054f18b0fc8f735c15f6c2" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 11 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:05:52.152277 19485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dc5b3532fe54f74876d02beffa2c230" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:05:52.137403 23139 raft_consensus.cc:2804] T 833a2f0775ed407a94b8924ce50adb63 P 127766fc592545a4997f7790f50f6076 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:05:52.136818 20076 leader_election.cc:304] T 4af19371ea874c09a0a2147040835cbb P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 127766fc592545a4997f7790f50f6076, e61c3a8f61bb48f8a963c9480e53c168; no voters: e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:05:52.159207 23151 raft_consensus.cc:493] T 0afb57ae58a24a01850491d69f0213dd P 127766fc592545a4997f7790f50f6076 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:52.160969 20107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ece3db938bc649d4a40a51522ed5259c" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:05:52.164836 19485 raft_consensus.cc:2393] T 1dc5b3532fe54f74876d02beffa2c230 P 0473d2b2d01f4459b1e90fd12cc7840e [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e61c3a8f61bb48f8a963c9480e53c168 in current term 9: Already voted for candidate 0473d2b2d01f4459b1e90fd12cc7840e in this term.
I20260709 13:05:52.165632 19479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14efcc79969f41babe5529c22d59156d" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:05:52.161008 19480 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39478 (request call id 469) took 2785 ms. Trace:
I20260709 13:05:52.168383 19402 raft_consensus.cc:1275] T 22196caba61445d3bec98a0aab3c337d P e5256d91808b47c195bc9b4dbd7f2b87 [term 9 FOLLOWER]: Refusing update from remote peer 0473d2b2d01f4459b1e90fd12cc7840e: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 9 index: 6. (term mismatch)
I20260709 13:05:52.170598 20110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0afb57ae58a24a01850491d69f0213dd" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076"
I20260709 13:05:52.171022 19482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62c6c134d3d24a1ab144dd9ee6bc3f64" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:05:52.171640 19409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dc5b3532fe54f74876d02beffa2c230" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:05:52.172096 19408 raft_consensus.cc:1275] T edd7d470b5014c9489be7f41f64355c9 P e5256d91808b47c195bc9b4dbd7f2b87 [term 10 FOLLOWER]: Refusing update from remote peer 0473d2b2d01f4459b1e90fd12cc7840e: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 10 index: 5. (index mismatch)
I20260709 13:05:52.173003 19477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86a6797bdfe94fa496c050ceae4bd0d9" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:05:52.173444 23066 raft_consensus.cc:493] T 309c3ca0ca4b4f3ba129752ea2cb293b P e61c3a8f61bb48f8a963c9480e53c168 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 0473d2b2d01f4459b1e90fd12cc7840e)
I20260709 13:05:52.174291 19405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc225c93219c45538b53a1bd3d387e4d" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:05:52.174937 22974 leader_election.cc:290] T 62c6c134d3d24a1ab144dd9ee6bc3f64 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 9 election: Requested vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:05:52.175079 19410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff9b0eddd810459b82d91c60777c10eb" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:05:52.176555 19404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff75a1d4cb1f493db8f71ddc136ba9ab" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:05:52.263794 19404 raft_consensus.cc:2393] T ff75a1d4cb1f493db8f71ddc136ba9ab P e5256d91808b47c195bc9b4dbd7f2b87 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0473d2b2d01f4459b1e90fd12cc7840e in current term 9: Already voted for candidate e5256d91808b47c195bc9b4dbd7f2b87 in this term.
I20260709 13:05:52.264081 19410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9962423cb4e54fcfa5de01daf68a86e7" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:05:52.265146 19404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab43d85f64114d4ebf618930e43d9ed0" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:05:52.265854 19404 raft_consensus.cc:2393] T ab43d85f64114d4ebf618930e43d9ed0 P e5256d91808b47c195bc9b4dbd7f2b87 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0473d2b2d01f4459b1e90fd12cc7840e in current term 9: Already voted for candidate e5256d91808b47c195bc9b4dbd7f2b87 in this term.
I20260709 13:05:52.265782 19410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86a6797bdfe94fa496c050ceae4bd0d9" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:05:52.271379 23066 raft_consensus.cc:515] T 309c3ca0ca4b4f3ba129752ea2cb293b P e61c3a8f61bb48f8a963c9480e53c168 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } attrs { replace: true } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:05:52.262755 20105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9962423cb4e54fcfa5de01daf68a86e7" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
W20260709 13:05:52.274561 20076 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.3:36891, user_credentials={real_user=slave}} blocked reactor thread for 137827us
I20260709 13:05:52.275660 20076 leader_election.cc:304] T 65d8cb8d6ec64f459d5a47cefab10acf P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 127766fc592545a4997f7790f50f6076, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:05:52.275743 20105 raft_consensus.cc:1275] T 7be9efa6559648dbb5a0f7684c4542d1 P 127766fc592545a4997f7790f50f6076 [term 9 LEARNER]: Refusing update from remote peer 0473d2b2d01f4459b1e90fd12cc7840e: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 13:05:52.266464 19410 raft_consensus.cc:2468] T 86a6797bdfe94fa496c050ceae4bd0d9 P e5256d91808b47c195bc9b4dbd7f2b87 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 9.
I20260709 13:05:52.277262 19410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b08304a0a02b42d7840c4e8ee9a6bd1a" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:05:52.277807 20076 leader_election.cc:304] T 2a16f7501e2444fb86d4e2778e734e02 P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 127766fc592545a4997f7790f50f6076, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:05:52.275849 23066 leader_election.cc:290] T 309c3ca0ca4b4f3ba129752ea2cb293b P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:05:52.282632 20105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "309c3ca0ca4b4f3ba129752ea2cb293b" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:05:52.277944 19410 raft_consensus.cc:2468] T b08304a0a02b42d7840c4e8ee9a6bd1a P e5256d91808b47c195bc9b4dbd7f2b87 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 11.
I20260709 13:05:52.285917 20076 leader_election.cc:304] T 6c5eebf646ad445a9d1b1adc319d7b16 P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 127766fc592545a4997f7790f50f6076; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:05:52.288249 19404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b74109013a140ada21feeef92d6f563" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:05:52.291872 20105 raft_consensus.cc:2393] T 309c3ca0ca4b4f3ba129752ea2cb293b P 127766fc592545a4997f7790f50f6076 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e61c3a8f61bb48f8a963c9480e53c168 in current term 8: Already voted for candidate 127766fc592545a4997f7790f50f6076 in this term.
I20260709 13:05:52.176199 19481 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58294 (request call id 2007) took 2825 ms. Trace:
I20260709 13:05:52.293691 19477 raft_consensus.cc:2468] T 86a6797bdfe94fa496c050ceae4bd0d9 P 0473d2b2d01f4459b1e90fd12cc7840e [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 9.
W20260709 13:05:52.295742 19449 connection.cc:256] RPC call timeout handler was delayed by -1.2252776300000505s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1918s for a response
I20260709 13:05:52.294363 19402 pending_rounds.cc:85] T 22196caba61445d3bec98a0aab3c337d P e5256d91808b47c195bc9b4dbd7f2b87: Aborting all ops after (but not including) 5
I20260709 13:05:52.296916 19449 leader_election.cc:304] T 172b3dd13109415a955b71ac0e9d2234 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e; no voters: 127766fc592545a4997f7790f50f6076, e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:05:52.294584 19481 rpcz_store.cc:276] 0709 13:05:49.350828 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:51.178135 (+1827307us) service_pool.cc:224] Handling call
0709 13:05:51.229483 (+ 51348us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:05:51.250329 (+ 20846us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:05:51.250374 (+    45us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:05:51.250880 (+   506us) log.cc:844] Serialized 26 byte log entry
0709 13:05:51.632531 (+381651us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:05:52.175635 (+543104us) log.cc:844] Serialized 14 byte log entry
0709 13:05:52.175843 (+   208us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:52.175979 (+   136us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:05:52.176024 (+    45us) raft_consensus.cc:1685] finished
0709 13:05:52.176037 (+    13us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:52.176152 (+   115us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3754,"prepare.queue_time_us":492018,"prepare.run_cpu_time_us":24,"prepare.run_wall_time_us":24,"raft.queue_time_us":37865,"raft.run_cpu_time_us":251,"raft.run_wall_time_us":87567,"thread_start_us":346840,"threads_started":2,"wal-append.queue_time_us":509473}
I20260709 13:05:52.283192 23018 raft_consensus.cc:493] T 1efebf73c86e432baa55533136b6e12c P 0473d2b2d01f4459b1e90fd12cc7840e [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:52.297828 19410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a08760e15aac4630a629431f56024dc8" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:05:52.301090 19477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "775c229504194560ba9589bc2199b089" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:05:52.301764 19477 raft_consensus.cc:3060] T 775c229504194560ba9589bc2199b089 P 0473d2b2d01f4459b1e90fd12cc7840e [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:05:52.297590 19405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2725d2c4cb054f18b0fc8f735c15f6c2" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 11 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:05:52.299702 19408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f93ee515a9c14139bf566522ed8232f3" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 13 candidate_status { last_received { term: 12 index: 5 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:05:52.303102 19408 raft_consensus.cc:2468] T f93ee515a9c14139bf566522ed8232f3 P e5256d91808b47c195bc9b4dbd7f2b87 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 12.
I20260709 13:05:52.299093 19485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "309c3ca0ca4b4f3ba129752ea2cb293b" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:05:52.300101 19402 pending_rounds.cc:107] T 22196caba61445d3bec98a0aab3c337d P e5256d91808b47c195bc9b4dbd7f2b87: Aborting uncommitted NO_OP operation due to leader change: 8.6
I20260709 13:05:52.294302 19409 raft_consensus.cc:2468] T 1dc5b3532fe54f74876d02beffa2c230 P e5256d91808b47c195bc9b4dbd7f2b87 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 8.
I20260709 13:05:52.301816 19410 raft_consensus.cc:2393] T a08760e15aac4630a629431f56024dc8 P e5256d91808b47c195bc9b4dbd7f2b87 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0473d2b2d01f4459b1e90fd12cc7840e in current term 11: Already voted for candidate e5256d91808b47c195bc9b4dbd7f2b87 in this term.
I20260709 13:05:52.297557 19404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df751f992649444090e27965eb1af85d" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:05:52.304173 19402 raft_consensus.cc:2889] T 22196caba61445d3bec98a0aab3c337d P e5256d91808b47c195bc9b4dbd7f2b87 [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:05:52.291285 19480 rpcz_store.cc:276] 0709 13:05:49.375439 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:51.461235 (+2085796us) service_pool.cc:224] Handling call
0709 13:05:51.461559 (+   324us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:05:51.483146 (+ 21587us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:05:52.081366 (+598220us) log.cc:844] Serialized 14 byte log entry
0709 13:05:52.137923 (+ 56557us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:05:52.138414 (+   491us) log.cc:844] Serialized 26 byte log entry
0709 13:05:52.138591 (+   177us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:05:52.138630 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:52.138730 (+   100us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:05:52.160827 (+ 22097us) raft_consensus.cc:1685] finished
0709 13:05:52.160844 (+    17us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:52.160958 (+   114us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":9893,"prepare.queue_time_us":655527,"prepare.run_cpu_time_us":34,"prepare.run_wall_time_us":35,"raft.queue_time_us":41857,"raft.run_cpu_time_us":209,"raft.run_wall_time_us":209,"thread_start_us":609092,"threads_started":2,"wal-append.queue_time_us":13325}
I20260709 13:05:52.305394 19404 raft_consensus.cc:2468] T df751f992649444090e27965eb1af85d P e5256d91808b47c195bc9b4dbd7f2b87 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 10.
I20260709 13:05:52.304196 19485 raft_consensus.cc:2468] T 309c3ca0ca4b4f3ba129752ea2cb293b P 0473d2b2d01f4459b1e90fd12cc7840e [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 127766fc592545a4997f7790f50f6076 in term 8.
I20260709 13:05:52.308859 19485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc225c93219c45538b53a1bd3d387e4d" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:05:52.309943 19485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e1085d23e8347fbbd5bce7542f4b1f4" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:05:52.313400 20076 leader_election.cc:304] T fa731b585f684a7fb2d106c50f143b83 P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 127766fc592545a4997f7790f50f6076, e61c3a8f61bb48f8a963c9480e53c168; no voters: e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:05:52.175984 23139 raft_consensus.cc:493] T 833a2f0775ed407a94b8924ce50adb63 P 127766fc592545a4997f7790f50f6076 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:52.327785 20109 raft_consensus.cc:1240] T 309c3ca0ca4b4f3ba129752ea2cb293b P 127766fc592545a4997f7790f50f6076 [term 8 FOLLOWER]: Rejecting Update request from peer 0473d2b2d01f4459b1e90fd12cc7840e for earlier term 7. Current term is 8. Ops: []
I20260709 13:05:52.329069 19479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ec1c4ce15e04c7e8c283a62179f2a64" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:05:52.329852 19479 raft_consensus.cc:2393] T 5ec1c4ce15e04c7e8c283a62179f2a64 P 0473d2b2d01f4459b1e90fd12cc7840e [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 127766fc592545a4997f7790f50f6076 in current term 8: Already voted for candidate 0473d2b2d01f4459b1e90fd12cc7840e in this term.
I20260709 13:05:52.315359 19482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4509b76741dc428e9201c70c1658da13" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:05:52.300567 23027 raft_consensus.cc:2749] T 172b3dd13109415a955b71ac0e9d2234 P 0473d2b2d01f4459b1e90fd12cc7840e [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:05:52.298012 23156 raft_consensus.cc:2804] T 65d8cb8d6ec64f459d5a47cefab10acf P 127766fc592545a4997f7790f50f6076 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:05:52.331763 23156 raft_consensus.cc:493] T 65d8cb8d6ec64f459d5a47cefab10acf P 127766fc592545a4997f7790f50f6076 [term 6 FOLLOWER]: Starting leader election (detected failure of leader e5256d91808b47c195bc9b4dbd7f2b87)
I20260709 13:05:52.316517 22758 raft_consensus.cc:493] T ff75a1d4cb1f493db8f71ddc136ba9ab P e61c3a8f61bb48f8a963c9480e53c168 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:52.332183 23156 raft_consensus.cc:3060] T 65d8cb8d6ec64f459d5a47cefab10acf P 127766fc592545a4997f7790f50f6076 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:05:52.332553 22758 raft_consensus.cc:515] T ff75a1d4cb1f493db8f71ddc136ba9ab P e61c3a8f61bb48f8a963c9480e53c168 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:52.333753 23131 leader_election.cc:290] T ff9b0eddd810459b82d91c60777c10eb P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:05:52.298213 23089 raft_consensus.cc:493] T 48824d5acfbc485ebf8c2d944e7202de P 0473d2b2d01f4459b1e90fd12cc7840e [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:52.316634 19481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "179fd671030940b4b4a4e24bcc4aba0a" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:05:52.335080 19481 raft_consensus.cc:2468] T 179fd671030940b4b4a4e24bcc4aba0a P 0473d2b2d01f4459b1e90fd12cc7840e [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 9.
I20260709 13:05:52.334967 23089 raft_consensus.cc:515] T 48824d5acfbc485ebf8c2d944e7202de P 0473d2b2d01f4459b1e90fd12cc7840e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:05:52.297842 23148 raft_consensus.cc:2804] T 2a16f7501e2444fb86d4e2778e734e02 P 127766fc592545a4997f7790f50f6076 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:05:52.335878 23148 raft_consensus.cc:493] T 2a16f7501e2444fb86d4e2778e734e02 P 127766fc592545a4997f7790f50f6076 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:52.335739 23150 raft_consensus.cc:515] T 48824d5acfbc485ebf8c2d944e7202de P e61c3a8f61bb48f8a963c9480e53c168 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:05:52.336323 23148 raft_consensus.cc:3060] T 2a16f7501e2444fb86d4e2778e734e02 P 127766fc592545a4997f7790f50f6076 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:05:52.338407 23108 leader_election.cc:290] T 2b74109013a140ada21feeef92d6f563 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:05:52.291953 23097 raft_consensus.cc:493] T 0e1085d23e8347fbbd5bce7542f4b1f4 P 0473d2b2d01f4459b1e90fd12cc7840e [term 6 FOLLOWER]: Starting pre-election (detected failure of leader e61c3a8f61bb48f8a963c9480e53c168)
I20260709 13:05:52.340814 23097 raft_consensus.cc:515] T 0e1085d23e8347fbbd5bce7542f4b1f4 P 0473d2b2d01f4459b1e90fd12cc7840e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:05:52.341423 22758 leader_election.cc:290] T ff75a1d4cb1f493db8f71ddc136ba9ab P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:05:52.343317 20103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff9b0eddd810459b82d91c60777c10eb" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:05:52.311895 23018 raft_consensus.cc:515] T 1efebf73c86e432baa55533136b6e12c P 0473d2b2d01f4459b1e90fd12cc7840e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:05:52.318287 19405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e1f505cb0f1427bbd698ac889d80821" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 11 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:05:52.344923 19405 raft_consensus.cc:2410] T 3e1f505cb0f1427bbd698ac889d80821 P e5256d91808b47c195bc9b4dbd7f2b87 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0473d2b2d01f4459b1e90fd12cc7840e for term 11 because replica has last-logged OpId of term: 9 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 4.
I20260709 13:05:52.346403 23083 leader_election.cc:290] T 86a6797bdfe94fa496c050ceae4bd0d9 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:05:52.346738 23139 raft_consensus.cc:3060] T 833a2f0775ed407a94b8924ce50adb63 P 127766fc592545a4997f7790f50f6076 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:05:52.347371 19560 raft_consensus.cc:2393] T 48824d5acfbc485ebf8c2d944e7202de P e61c3a8f61bb48f8a963c9480e53c168 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 127766fc592545a4997f7790f50f6076 in current term 10: Already voted for candidate e61c3a8f61bb48f8a963c9480e53c168 in this term.
I20260709 13:05:52.347262 20103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48824d5acfbc485ebf8c2d944e7202de" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076"
I20260709 13:05:52.347856 20103 raft_consensus.cc:3060] T 48824d5acfbc485ebf8c2d944e7202de P 127766fc592545a4997f7790f50f6076 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:05:52.348214 19375 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.3:36891, user_credentials={real_user=slave}} blocked reactor thread for 695210us
I20260709 13:05:52.349126 19375 leader_election.cc:304] T e381f1d6b8184797ad142de49be225a8 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:05:52.351182 19558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df751f992649444090e27965eb1af85d" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:05:52.351758 19558 raft_consensus.cc:2468] T df751f992649444090e27965eb1af85d P e61c3a8f61bb48f8a963c9480e53c168 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 9.
I20260709 13:05:52.352480 19553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f93ee515a9c14139bf566522ed8232f3" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 13 candidate_status { last_received { term: 12 index: 5 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:05:52.353614 19556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86a6797bdfe94fa496c050ceae4bd0d9" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:05:52.354074 19479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48824d5acfbc485ebf8c2d944e7202de" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:05:52.181789 23103 raft_consensus.cc:2749] T 14efcc79969f41babe5529c22d59156d P 0473d2b2d01f4459b1e90fd12cc7840e [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:05:52.319108 23153 raft_consensus.cc:2749] T 6c5eebf646ad445a9d1b1adc319d7b16 P 127766fc592545a4997f7790f50f6076 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:05:52.319191 19410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9f0d59553ad444883fcf5b5909f9798" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:05:52.357640 19410 raft_consensus.cc:2468] T b9f0d59553ad444883fcf5b5909f9798 P e5256d91808b47c195bc9b4dbd7f2b87 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 8.
I20260709 13:05:52.319757 23104 consensus_queue.cc:1048] T 7be9efa6559648dbb5a0f7684c4542d1 P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Connected to new peer: Peer: permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:05:52.322130 23118 raft_consensus.cc:2764] T fa731b585f684a7fb2d106c50f143b83 P 127766fc592545a4997f7790f50f6076 [term 9 FOLLOWER]: Leader pre-election decision vote started in defunct term 8: won
I20260709 13:05:52.323009 19409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dc5b3532fe54f74876d02beffa2c230" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
I20260709 13:05:52.323205 19551 raft_consensus.cc:1275] T 1efebf73c86e432baa55533136b6e12c P e61c3a8f61bb48f8a963c9480e53c168 [term 8 FOLLOWER]: Refusing update from remote peer 127766fc592545a4997f7790f50f6076: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:05:52.323622 19480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed7fdbcb96d14d418db9ca90a792588a" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:05:52.323698 22896 consensus_queue.cc:1059] T 21e14947d70440f19044d8f75c31e1f9 P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:05:52.324847 19449 leader_election.cc:304] T 0cdf56e38bbc453d9438d359e5a69955 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e; no voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168
W20260709 13:05:52.325377 23162 log.cc:927] Time spent T 21e14947d70440f19044d8f75c31e1f9 P e61c3a8f61bb48f8a963c9480e53c168: Append to log took a long time: real 0.541s	user 0.003s	sys 0.000s
I20260709 13:05:52.295346 23130 raft_consensus.cc:2804] T 4af19371ea874c09a0a2147040835cbb P 127766fc592545a4997f7790f50f6076 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:05:52.295614 22964 raft_consensus.cc:493] T 1a61655d99124a29b486ba4a5b37faea P 0473d2b2d01f4459b1e90fd12cc7840e [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:05:52.326993 19451 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:52.357527 23143 raft_consensus.cc:2749] T ab43d85f64114d4ebf618930e43d9ed0 P e5256d91808b47c195bc9b4dbd7f2b87 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
W20260709 13:05:52.340260 19377 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.2:46257, user_credentials={real_user=slave}} blocked reactor thread for 665582us
I20260709 13:05:52.354198 19556 raft_consensus.cc:2468] T 86a6797bdfe94fa496c050ceae4bd0d9 P e61c3a8f61bb48f8a963c9480e53c168 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 9.
W20260709 13:05:52.368732 19449 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.1:40321, user_credentials={real_user=slave}} blocked reactor thread for 43995.6us
I20260709 13:05:52.369375 19377 leader_election.cc:304] T f1b10566f45d4a7d9029858330e02d5b P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:05:52.369726 19556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9f0d59553ad444883fcf5b5909f9798" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:05:52.370857 19556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2725d2c4cb054f18b0fc8f735c15f6c2" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 11 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
W20260709 13:05:52.356019 19559 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.975s	user 0.021s	sys 0.091s
W20260709 13:05:52.371417 19559 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.990s	user 0.022s	sys 0.092s
I20260709 13:05:52.371505 19377 leader_election.cc:304] T 1f85fc4b527a48848e5faa083b604e36 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87; no voters: 127766fc592545a4997f7790f50f6076
I20260709 13:05:52.358491 22859 raft_consensus.cc:2749] T e381f1d6b8184797ad142de49be225a8 P e5256d91808b47c195bc9b4dbd7f2b87 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 13:05:52.360112 19524 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:52.318451 19404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28af091831594f9d8e96482078cc7625" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:05:52.360411 19485 raft_consensus.cc:2468] T 0e1085d23e8347fbbd5bce7542f4b1f4 P 0473d2b2d01f4459b1e90fd12cc7840e [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 127766fc592545a4997f7790f50f6076 in term 6.
I20260709 13:05:52.361711 19482 raft_consensus.cc:1275] T 40e1e16737a842ee936002830f36882e P 0473d2b2d01f4459b1e90fd12cc7840e [term 12 FOLLOWER]: Refusing update from remote peer e61c3a8f61bb48f8a963c9480e53c168: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 12 index: 6. (index mismatch)
W20260709 13:05:52.374221 19524 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:52.363205 19409 raft_consensus.cc:3060] T 1dc5b3532fe54f74876d02beffa2c230 P e5256d91808b47c195bc9b4dbd7f2b87 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:05:52.363845 19551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dc5b3532fe54f74876d02beffa2c230" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:05:52.374356 19404 raft_consensus.cc:2468] T 28af091831594f9d8e96482078cc7625 P e5256d91808b47c195bc9b4dbd7f2b87 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 9.
I20260709 13:05:52.375028 19551 raft_consensus.cc:2393] T 1dc5b3532fe54f74876d02beffa2c230 P e61c3a8f61bb48f8a963c9480e53c168 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 0473d2b2d01f4459b1e90fd12cc7840e in current term 9: Already voted for candidate e61c3a8f61bb48f8a963c9480e53c168 in this term.
W20260709 13:05:52.375280 19450 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.3:36891, user_credentials={real_user=slave}} blocked reactor thread for 85817.8us
I20260709 13:05:52.365268 19555 raft_consensus.cc:2468] T ab43d85f64114d4ebf618930e43d9ed0 P e61c3a8f61bb48f8a963c9480e53c168 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 8.
I20260709 13:05:52.365360 20103 raft_consensus.cc:2468] T 48824d5acfbc485ebf8c2d944e7202de P 127766fc592545a4997f7790f50f6076 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 10.
I20260709 13:05:52.376658 19523 leader_election.cc:304] T 48824d5acfbc485ebf8c2d944e7202de P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 127766fc592545a4997f7790f50f6076, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:05:52.299352 23151 raft_consensus.cc:515] T 0afb57ae58a24a01850491d69f0213dd P 127766fc592545a4997f7790f50f6076 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:05:52.354737 19479 raft_consensus.cc:2468] T 48824d5acfbc485ebf8c2d944e7202de P 0473d2b2d01f4459b1e90fd12cc7840e [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 127766fc592545a4997f7790f50f6076 in term 9.
I20260709 13:05:52.350589 19375 leader_election.cc:304] T 217b5fae677b4971b3bbd2f357a1f7ff P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:05:52.364224 19558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a08760e15aac4630a629431f56024dc8" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:05:52.396562 19558 raft_consensus.cc:2393] T a08760e15aac4630a629431f56024dc8 P e61c3a8f61bb48f8a963c9480e53c168 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0473d2b2d01f4459b1e90fd12cc7840e in current term 11: Already voted for candidate e61c3a8f61bb48f8a963c9480e53c168 in this term.
I20260709 13:05:52.377041 20078 leader_election.cc:304] T 62c6c134d3d24a1ab144dd9ee6bc3f64 P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 127766fc592545a4997f7790f50f6076; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:05:52.377923 20106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab43d85f64114d4ebf618930e43d9ed0" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:05:52.399369 20106 raft_consensus.cc:2468] T ab43d85f64114d4ebf618930e43d9ed0 P 127766fc592545a4997f7790f50f6076 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 9.
I20260709 13:05:52.399608 23153 raft_consensus.cc:2749] T 62c6c134d3d24a1ab144dd9ee6bc3f64 P 127766fc592545a4997f7790f50f6076 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:05:52.400740 19558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48824d5acfbc485ebf8c2d944e7202de" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:05:52.401863 19558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1efebf73c86e432baa55533136b6e12c" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:05:52.377724 22964 raft_consensus.cc:515] T 1a61655d99124a29b486ba4a5b37faea P 0473d2b2d01f4459b1e90fd12cc7840e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:52.402771 23089 leader_election.cc:290] T 48824d5acfbc485ebf8c2d944e7202de P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:05:52.373202 23146 raft_consensus.cc:493] T 22196caba61445d3bec98a0aab3c337d P e61c3a8f61bb48f8a963c9480e53c168 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 0473d2b2d01f4459b1e90fd12cc7840e)
I20260709 13:05:52.404479 23146 raft_consensus.cc:515] T 22196caba61445d3bec98a0aab3c337d P e61c3a8f61bb48f8a963c9480e53c168 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:52.379652 19554 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40428 (request call id 2256) took 1725 ms. Trace:
W20260709 13:05:52.407963 19375 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.3:36891, user_credentials={real_user=slave}} blocked reactor thread for 57436.1us
I20260709 13:05:52.381318 19486 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58294 (request call id 2018) took 3027 ms. Trace:
I20260709 13:05:52.408732 20078 leader_election.cc:304] T ed7fdbcb96d14d418db9ca90a792588a P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 127766fc592545a4997f7790f50f6076; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:05:52.381464 22758 raft_consensus.cc:2804] T 48824d5acfbc485ebf8c2d944e7202de P e61c3a8f61bb48f8a963c9480e53c168 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:05:52.372118 19559 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40428 (request call id 2257) took 1717 ms. Trace:
I20260709 13:05:52.412456 19477 raft_consensus.cc:2468] T 775c229504194560ba9589bc2199b089 P 0473d2b2d01f4459b1e90fd12cc7840e [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 127766fc592545a4997f7790f50f6076 in term 8.
I20260709 13:05:52.382720 19406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76cb037fc9064d13b59a8969d897ce8c" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:05:52.413569 19406 raft_consensus.cc:2468] T 76cb037fc9064d13b59a8969d897ce8c P e5256d91808b47c195bc9b4dbd7f2b87 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 8.
I20260709 13:05:52.383291 19551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e1f505cb0f1427bbd698ac889d80821" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 11 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:05:52.383728 23072 raft_consensus.cc:2749] T 0cdf56e38bbc453d9438d359e5a69955 P 0473d2b2d01f4459b1e90fd12cc7840e [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:05:52.383780 20111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62c6c134d3d24a1ab144dd9ee6bc3f64" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076"
I20260709 13:05:52.367419 23131 consensus_queue.cc:1048] T 1efebf73c86e432baa55533136b6e12c P 127766fc592545a4997f7790f50f6076 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.017s
I20260709 13:05:52.387923 19449 leader_election.cc:304] T 9962423cb4e54fcfa5de01daf68a86e7 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e; no voters: 127766fc592545a4997f7790f50f6076, e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:05:52.388437 22896 consensus_queue.cc:1048] T e381f1d6b8184797ad142de49be225a8 P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:05:52.389050 23143 raft_consensus.cc:2804] T 1f85fc4b527a48848e5faa083b604e36 P e5256d91808b47c195bc9b4dbd7f2b87 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:05:52.388998 23066 raft_consensus.cc:493] T 217b5fae677b4971b3bbd2f357a1f7ff P e61c3a8f61bb48f8a963c9480e53c168 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 0473d2b2d01f4459b1e90fd12cc7840e)
I20260709 13:05:52.382750 19377 leader_election.cc:304] T 4509b76741dc428e9201c70c1658da13 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:05:52.428157 19449 leader_election.cc:304] T 86a6797bdfe94fa496c050ceae4bd0d9 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87; no voters: 
I20260709 13:05:52.393328 23156 raft_consensus.cc:515] T 65d8cb8d6ec64f459d5a47cefab10acf P 127766fc592545a4997f7790f50f6076 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:05:52.371460 19556 raft_consensus.cc:2468] T 2725d2c4cb054f18b0fc8f735c15f6c2 P e61c3a8f61bb48f8a963c9480e53c168 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 10.
I20260709 13:05:52.368294 23130 raft_consensus.cc:493] T 4af19371ea874c09a0a2147040835cbb P 127766fc592545a4997f7790f50f6076 [term 5 FOLLOWER]: Starting leader election (detected failure of leader e5256d91808b47c195bc9b4dbd7f2b87)
I20260709 13:05:52.436051 23130 raft_consensus.cc:3060] T 4af19371ea874c09a0a2147040835cbb P 127766fc592545a4997f7790f50f6076 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:05:52.402391 19558 raft_consensus.cc:2468] T 1efebf73c86e432baa55533136b6e12c P e61c3a8f61bb48f8a963c9480e53c168 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 8.
I20260709 13:05:52.409334 19486 rpcz_store.cc:276] 0709 13:05:49.353896 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:51.418602 (+2064706us) service_pool.cc:224] Handling call
0709 13:05:51.423191 (+  4589us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:51.655989 (+232798us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:52.381083 (+725094us) spinlock_profiling.cc:243] Waited 160 ms on lock 0x7b54003e8fd4. stack: 00007f4a79de9343 00007f4a79de9240 00007f4a797781d4 00007f4a834b6304 00007f4a834b6299 00007f4a7ce71571 00007f4a7cf08e01 00007f4a7cf0783e 00007f4a81ecc419 00007f4a7b443bd4 00007f4a7b443b62 00007f4a7b443a91 00007f4a7b443a0c 00007f4a7b442cc2 00007f4a7b24348c 00007f4a7b2428c6
0709 13:05:52.381242 (+   159us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":367987456}
I20260709 13:05:52.407229 19554 rpcz_store.cc:276] 0709 13:05:50.654128 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:50.889062 (+234934us) service_pool.cc:224] Handling call
0709 13:05:50.889382 (+   320us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:05:51.239480 (+350098us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:05:51.239527 (+    47us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:05:51.322174 (+ 82647us) log.cc:844] Serialized 26 byte log entry
0709 13:05:51.715183 (+393009us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:05:51.715222 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:51.715288 (+    66us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:05:52.324635 (+609347us) spinlock_profiling.cc:243] Waited 2.35 ms on lock 0x7b4400022b4c. stack: 00007f4a79de9343 00007f4a79de9240 00007f4a797781d4 00007f4a834b6304 00007f4a834b6299 00007f4a79ca3db1 00007f4a79d41c85 00007f4a79d426a2 00007f4a7cab41db 00007f4a7caafaaf 00007f4a7caa386e 00007f4a7caa2bb6 00007f4a7caa27d8 00007f4a7caac221 00007f4a7caac1d9 00007f4a7caac169
0709 13:05:52.379340 (+ 54705us) raft_consensus.cc:1685] finished
0709 13:05:52.379363 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:52.379592 (+   229us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":294744,"raft.run_cpu_time_us":117,"raft.run_wall_time_us":4608,"spinlock_wait_cycles":5395328,"thread_start_us":710108,"threads_started":2,"wal-append.queue_time_us":457561}
I20260709 13:05:52.411139 19526 leader_election.cc:304] T 86a6797bdfe94fa496c050ceae4bd0d9 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:05:52.412597 19559 rpcz_store.cc:276] 0709 13:05:50.654433 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:50.946583 (+292150us) service_pool.cc:224] Handling call
0709 13:05:50.946947 (+   364us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:05:51.320513 (+373566us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:05:51.320544 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:05:51.356072 (+ 35528us) log.cc:844] Serialized 26 byte log entry
0709 13:05:52.371792 (+1015720us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:05:52.371842 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:52.371906 (+    64us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:05:52.371945 (+    39us) raft_consensus.cc:1685] finished
0709 13:05:52.371954 (+     9us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:52.372070 (+   116us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":278436,"raft.run_cpu_time_us":139,"raft.run_wall_time_us":2588,"thread_start_us":1339522,"threads_started":2,"wal-append.queue_time_us":404049}
I20260709 13:05:52.415376 19551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e1085d23e8347fbbd5bce7542f4b1f4" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:05:52.437832 19558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e1f505cb0f1427bbd698ac889d80821" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:05:52.438163 19559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22196caba61445d3bec98a0aab3c337d" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:05:52.418200 19479 raft_consensus.cc:1240] T 96efeaaf1057492490e9a621f37e1a2d P 0473d2b2d01f4459b1e90fd12cc7840e [term 10 FOLLOWER]: Rejecting Update request from peer e61c3a8f61bb48f8a963c9480e53c168 for earlier term 9. Current term is 10. Ops: []
W20260709 13:05:52.438764 19377 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.2:46257, user_credentials={real_user=slave}} blocked reactor thread for 56150.9us
I20260709 13:05:52.438890 19551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a61655d99124a29b486ba4a5b37faea" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:05:52.439455 19377 leader_election.cc:304] T 3e1f505cb0f1427bbd698ac889d80821 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87; no voters: 
I20260709 13:05:52.438913 19558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76cb037fc9064d13b59a8969d897ce8c" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:05:52.440384 19558 raft_consensus.cc:2468] T 76cb037fc9064d13b59a8969d897ce8c P e61c3a8f61bb48f8a963c9480e53c168 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 7.
I20260709 13:05:52.410904 19450 leader_election.cc:304] T 76cb037fc9064d13b59a8969d897ce8c P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:05:52.382393 23148 raft_consensus.cc:515] T 2a16f7501e2444fb86d4e2778e734e02 P 127766fc592545a4997f7790f50f6076 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:05:52.430791 20110 raft_consensus.cc:3060] T 0afb57ae58a24a01850491d69f0213dd P 127766fc592545a4997f7790f50f6076 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:05:52.441529 19407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70797e5783b5454ab0d0eea663e791e3" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:05:52.409718 22859 raft_consensus.cc:2749] T 217b5fae677b4971b3bbd2f357a1f7ff P e5256d91808b47c195bc9b4dbd7f2b87 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:05:52.444945 19551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28af091831594f9d8e96482078cc7625" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:05:52.441171 19558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7be9efa6559648dbb5a0f7684c4542d1" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:05:52.446027 19558 raft_consensus.cc:2410] T 7be9efa6559648dbb5a0f7684c4542d1 P e61c3a8f61bb48f8a963c9480e53c168 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e5256d91808b47c195bc9b4dbd7f2b87 for term 10 because replica has last-logged OpId of term: 7 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 5.
I20260709 13:05:52.443416 19449 leader_election.cc:304] T b08304a0a02b42d7840c4e8ee9a6bd1a P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87; no voters: 
I20260709 13:05:52.446624 19402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4af19371ea874c09a0a2147040835cbb" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:05:52.447345 19449 leader_election.cc:304] T bc225c93219c45538b53a1bd3d387e4d P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e; no voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:05:52.444331 19407 raft_consensus.cc:2393] T 70797e5783b5454ab0d0eea663e791e3 P e5256d91808b47c195bc9b4dbd7f2b87 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e61c3a8f61bb48f8a963c9480e53c168 in current term 10: Already voted for candidate e5256d91808b47c195bc9b4dbd7f2b87 in this term.
I20260709 13:05:52.446519 19404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a08760e15aac4630a629431f56024dc8" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
I20260709 13:05:52.444147 19409 raft_consensus.cc:2468] T 1dc5b3532fe54f74876d02beffa2c230 P e5256d91808b47c195bc9b4dbd7f2b87 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 9.
I20260709 13:05:52.448626 19404 raft_consensus.cc:2393] T a08760e15aac4630a629431f56024dc8 P e5256d91808b47c195bc9b4dbd7f2b87 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate e61c3a8f61bb48f8a963c9480e53c168 in current term 11: Already voted for candidate e5256d91808b47c195bc9b4dbd7f2b87 in this term.
I20260709 13:05:52.449565 19410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b08304a0a02b42d7840c4e8ee9a6bd1a" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:05:52.450287 19410 raft_consensus.cc:2468] T b08304a0a02b42d7840c4e8ee9a6bd1a P e5256d91808b47c195bc9b4dbd7f2b87 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 11.
I20260709 13:05:52.450814 19449 leader_election.cc:304] T f93ee515a9c14139bf566522ed8232f3 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87; no voters: 
I20260709 13:05:52.449442 19409 raft_consensus.cc:1240] T 3e1f505cb0f1427bbd698ac889d80821 P e5256d91808b47c195bc9b4dbd7f2b87 [term 10 FOLLOWER]: Rejecting Update request from peer e61c3a8f61bb48f8a963c9480e53c168 for earlier term 9. Current term is 10. Ops: []
I20260709 13:05:52.452334 19449 leader_election.cc:304] T df751f992649444090e27965eb1af85d P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87; no voters: 
I20260709 13:05:52.452571 19558 raft_consensus.cc:1275] T 7be9efa6559648dbb5a0f7684c4542d1 P e61c3a8f61bb48f8a963c9480e53c168 [term 9 FOLLOWER]: Refusing update from remote peer 0473d2b2d01f4459b1e90fd12cc7840e: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 13:05:52.453797 19558 raft_consensus.cc:1240] T f1b10566f45d4a7d9029858330e02d5b P e61c3a8f61bb48f8a963c9480e53c168 [term 11 FOLLOWER]: Rejecting Update request from peer 0473d2b2d01f4459b1e90fd12cc7840e for earlier term 10. Current term is 11. Ops: []
I20260709 13:05:52.454811 19556 raft_consensus.cc:1240] T 62c6c134d3d24a1ab144dd9ee6bc3f64 P e61c3a8f61bb48f8a963c9480e53c168 [term 9 FOLLOWER]: Rejecting Update request from peer 0473d2b2d01f4459b1e90fd12cc7840e for earlier term 8. Current term is 9. Ops: []
I20260709 13:05:52.456128 19409 raft_consensus.cc:1240] T ff75a1d4cb1f493db8f71ddc136ba9ab P e5256d91808b47c195bc9b4dbd7f2b87 [term 9 FOLLOWER]: Rejecting Update request from peer e61c3a8f61bb48f8a963c9480e53c168 for earlier term 8. Current term is 9. Ops: []
I20260709 13:05:52.415163 22758 raft_consensus.cc:697] T 48824d5acfbc485ebf8c2d944e7202de P e61c3a8f61bb48f8a963c9480e53c168 [term 10 LEADER]: Becoming Leader. State: Replica: e61c3a8f61bb48f8a963c9480e53c168, State: Running, Role: LEADER
I20260709 13:05:52.467049 19409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86a6797bdfe94fa496c050ceae4bd0d9" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:05:52.468940 19409 raft_consensus.cc:2468] T 86a6797bdfe94fa496c050ceae4bd0d9 P e5256d91808b47c195bc9b4dbd7f2b87 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 9.
I20260709 13:05:52.469331 19449 leader_election.cc:304] T b9f0d59553ad444883fcf5b5909f9798 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87; no voters: 
I20260709 13:05:52.412992 23147 consensus_queue.cc:1059] T 3e1f505cb0f1427bbd698ac889d80821 P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 }, Status: INVALID_TERM, Last received: 8.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.032s
I20260709 13:05:52.468364 19556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa731b585f684a7fb2d106c50f143b83" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:05:52.476008 19556 raft_consensus.cc:3060] T fa731b585f684a7fb2d106c50f143b83 P e61c3a8f61bb48f8a963c9480e53c168 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:05:52.470893 19406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e36a9d6e29c4a7c860cf267efbd4c74" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
I20260709 13:05:52.470445 20110 raft_consensus.cc:2468] T 0afb57ae58a24a01850491d69f0213dd P 127766fc592545a4997f7790f50f6076 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 10.
I20260709 13:05:52.474458 19449 leader_election.cc:304] T 28af091831594f9d8e96482078cc7625 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87; no voters: 
I20260709 13:05:52.437347 23104 raft_consensus.cc:2749] T 9962423cb4e54fcfa5de01daf68a86e7 P 0473d2b2d01f4459b1e90fd12cc7840e [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:05:52.415562 23060 consensus_queue.cc:1048] T 2725d2c4cb054f18b0fc8f735c15f6c2 P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.042s
I20260709 13:05:52.442134 23066 raft_consensus.cc:515] T 217b5fae677b4971b3bbd2f357a1f7ff P e61c3a8f61bb48f8a963c9480e53c168 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:52.552332 19402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc225c93219c45538b53a1bd3d387e4d" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:05:52.707840 19559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f575b143b844aa096b50997dad3516a" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:05:52.707881 19406 raft_consensus.cc:3060] T 2e36a9d6e29c4a7c860cf267efbd4c74 P e5256d91808b47c195bc9b4dbd7f2b87 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:05:52.709583 19559 raft_consensus.cc:2468] T 7f575b143b844aa096b50997dad3516a P e61c3a8f61bb48f8a963c9480e53c168 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 5.
I20260709 13:05:52.726593 19559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70797e5783b5454ab0d0eea663e791e3" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:05:52.727365 19559 raft_consensus.cc:3060] T 70797e5783b5454ab0d0eea663e791e3 P e61c3a8f61bb48f8a963c9480e53c168 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:05:52.444468 23019 raft_consensus.cc:2749] T 4509b76741dc428e9201c70c1658da13 P e5256d91808b47c195bc9b4dbd7f2b87 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:05:52.449347 23072 raft_consensus.cc:2804] T 76cb037fc9064d13b59a8969d897ce8c P 0473d2b2d01f4459b1e90fd12cc7840e [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:05:52.450044 23089 raft_consensus.cc:2804] T 86a6797bdfe94fa496c050ceae4bd0d9 P 0473d2b2d01f4459b1e90fd12cc7840e [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:05:52.467912 23055 raft_consensus.cc:2804] T 3e1f505cb0f1427bbd698ac889d80821 P e5256d91808b47c195bc9b4dbd7f2b87 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:05:52.449498 22974 raft_consensus.cc:2804] T 86a6797bdfe94fa496c050ceae4bd0d9 P e61c3a8f61bb48f8a963c9480e53c168 [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 13:05:52.734351 19449 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.1:40321, user_credentials={real_user=slave}} blocked reactor thread for 259965us
I20260709 13:05:52.733058 19403 raft_consensus.cc:1240] T 40e1e16737a842ee936002830f36882e P e5256d91808b47c195bc9b4dbd7f2b87 [term 13 FOLLOWER]: Rejecting Update request from peer e61c3a8f61bb48f8a963c9480e53c168 for earlier term 12. Current term is 13. Ops: [12.6-12.6]
I20260709 13:05:52.739321 23097 leader_election.cc:290] T 0e1085d23e8347fbbd5bce7542f4b1f4 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:05:52.739403 22758 consensus_queue.cc:237] T 48824d5acfbc485ebf8c2d944e7202de P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:05:52.740475 23038 raft_consensus.cc:2804] T 28af091831594f9d8e96482078cc7625 P 0473d2b2d01f4459b1e90fd12cc7840e [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:05:52.449617 23143 raft_consensus.cc:697] T 1f85fc4b527a48848e5faa083b604e36 P e5256d91808b47c195bc9b4dbd7f2b87 [term 6 LEADER]: Becoming Leader. State: Replica: e5256d91808b47c195bc9b4dbd7f2b87, State: Running, Role: LEADER
I20260709 13:05:52.468997 23102 raft_consensus.cc:2804] T b08304a0a02b42d7840c4e8ee9a6bd1a P 0473d2b2d01f4459b1e90fd12cc7840e [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:05:52.467155 23027 raft_consensus.cc:2804] T f93ee515a9c14139bf566522ed8232f3 P 0473d2b2d01f4459b1e90fd12cc7840e [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:05:52.456278 23108 raft_consensus.cc:2749] T bc225c93219c45538b53a1bd3d387e4d P 0473d2b2d01f4459b1e90fd12cc7840e [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:05:52.525213 20076 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.3:36891, user_credentials={real_user=slave}} blocked reactor thread for 56519.3us
I20260709 13:05:52.744410 23089 raft_consensus.cc:493] T 86a6797bdfe94fa496c050ceae4bd0d9 P 0473d2b2d01f4459b1e90fd12cc7840e [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:52.747081 19559 raft_consensus.cc:2468] T 70797e5783b5454ab0d0eea663e791e3 P e61c3a8f61bb48f8a963c9480e53c168 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 10.
I20260709 13:05:52.469914 23118 raft_consensus.cc:2749] T ed7fdbcb96d14d418db9ca90a792588a P 127766fc592545a4997f7790f50f6076 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:05:52.520339 22978 raft_consensus.cc:2804] T b9f0d59553ad444883fcf5b5909f9798 P 0473d2b2d01f4459b1e90fd12cc7840e [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:05:52.757440 19402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2725d2c4cb054f18b0fc8f735c15f6c2" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 11 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
W20260709 13:05:52.769491 19377 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.2:46257, user_credentials={real_user=slave}} blocked reactor thread for 323311us
I20260709 13:05:52.765497 19526 leader_election.cc:304] T 179fd671030940b4b4a4e24bcc4aba0a P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168; no voters: e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:05:52.677084 23022 raft_consensus.cc:2749] T f1b10566f45d4a7d9029858330e02d5b P e5256d91808b47c195bc9b4dbd7f2b87 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:05:52.769825 19484 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39478 (request call id 473) took 2366 ms. Trace:
I20260709 13:05:52.795470 19484 rpcz_store.cc:276] 0709 13:05:50.403705 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:51.587874 (+1184169us) service_pool.cc:224] Handling call
0709 13:05:52.157114 (+569240us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:52.157674 (+   560us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:52.769556 (+611882us) spinlock_profiling.cc:243] Waited 569 ms on lock 0x7b5400224a50. stack: 00007f4a79de9343 00007f4a79de9240 00007f4a797781d4 00007f4a834b6304 00007f4a834b6299 00007f4a7ce71571 00007f4a7cf078ad 00007f4a81ecc419 00007f4a7b443bd4 00007f4a7b443b62 00007f4a7b443a91 00007f4a7b443a0c 00007f4a7b442cc2 00007f4a7b24348c 00007f4a7b2428c6 00007f4a7b24226f
0709 13:05:52.769746 (+   190us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1308496640}
W20260709 13:05:52.770857 19449 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:52.745007 23131 raft_consensus.cc:493] T 1f85fc4b527a48848e5faa083b604e36 P 127766fc592545a4997f7790f50f6076 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:52.801292 23131 raft_consensus.cc:515] T 1f85fc4b527a48848e5faa083b604e36 P 127766fc592545a4997f7790f50f6076 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:05:52.803478 20112 raft_consensus.cc:1240] T 6c5eebf646ad445a9d1b1adc319d7b16 P 127766fc592545a4997f7790f50f6076 [term 8 FOLLOWER]: Rejecting Update request from peer 0473d2b2d01f4459b1e90fd12cc7840e for earlier term 7. Current term is 8. Ops: []
W20260709 13:05:52.806630 19377 connection.cc:256] RPC call timeout handler was delayed by -2.1969663119999723s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21150000000000002s for a response
I20260709 13:05:52.784808 19406 raft_consensus.cc:2468] T 2e36a9d6e29c4a7c860cf267efbd4c74 P e5256d91808b47c195bc9b4dbd7f2b87 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 8.
I20260709 13:05:52.809602 19402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa731b585f684a7fb2d106c50f143b83" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:05:52.811019 19402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1b10566f45d4a7d9029858330e02d5b" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
I20260709 13:05:52.812294 19402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e381f1d6b8184797ad142de49be225a8" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
I20260709 13:05:52.812879 19402 raft_consensus.cc:3060] T e381f1d6b8184797ad142de49be225a8 P e5256d91808b47c195bc9b4dbd7f2b87 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:05:52.787895 19559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e5873a19244c5ebbcd38e126796ee7" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:05:52.776291 23038 raft_consensus.cc:493] T 28af091831594f9d8e96482078cc7625 P 0473d2b2d01f4459b1e90fd12cc7840e [term 9 FOLLOWER]: Starting leader election (detected failure of leader e61c3a8f61bb48f8a963c9480e53c168)
I20260709 13:05:52.915452 23038 raft_consensus.cc:3060] T 28af091831594f9d8e96482078cc7625 P 0473d2b2d01f4459b1e90fd12cc7840e [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:05:52.771972 23055 raft_consensus.cc:697] T 3e1f505cb0f1427bbd698ac889d80821 P e5256d91808b47c195bc9b4dbd7f2b87 [term 10 LEADER]: Becoming Leader. State: Replica: e5256d91808b47c195bc9b4dbd7f2b87, State: Running, Role: LEADER
I20260709 13:05:52.476269 22840 consensus_queue.cc:1048] T 22196caba61445d3bec98a0aab3c337d P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.296s
I20260709 13:05:52.468029 23050 raft_consensus.cc:2804] T df751f992649444090e27965eb1af85d P 0473d2b2d01f4459b1e90fd12cc7840e [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:05:52.928236 23050 raft_consensus.cc:493] T df751f992649444090e27965eb1af85d P 0473d2b2d01f4459b1e90fd12cc7840e [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:52.928781 23050 raft_consensus.cc:3060] T df751f992649444090e27965eb1af85d P 0473d2b2d01f4459b1e90fd12cc7840e [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:05:52.467087 23110 consensus_queue.cc:1048] T edd7d470b5014c9489be7f41f64355c9 P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 2, Time since last communication: 0.287s
I20260709 13:05:52.807219 19411 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49050 (request call id 528) took 1331 ms. Trace:
I20260709 13:05:53.006336 19411 rpcz_store.cc:276] 0709 13:05:51.476267 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:51.476383 (+   116us) service_pool.cc:224] Handling call
0709 13:05:52.806992 (+1330609us) spinlock_profiling.cc:243] Waited 565 ms on lock 0x7b5400196c54. stack: 00007f4a79de9343 00007f4a79de9240 00007f4a797781d4 00007f4a834b6304 00007f4a834b6299 00007f4a7ce71571 00007f4a7cf0c2fa 00007f4a81ecdb17 00007f4a7b4486d4 00007f4a7b448662 00007f4a7b448591 00007f4a7b44850c 00007f4a7b4477c2 00007f4a7b24348c 00007f4a7b2428c6 00007f4a7b24226f
0709 13:05:52.807156 (+   164us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1300068224}
I20260709 13:05:53.007901 19411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff75a1d4cb1f493db8f71ddc136ba9ab" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:05:53.008687 19411 raft_consensus.cc:2468] T ff75a1d4cb1f493db8f71ddc136ba9ab P e5256d91808b47c195bc9b4dbd7f2b87 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 9.
I20260709 13:05:53.008890 23148 leader_election.cc:290] T 2a16f7501e2444fb86d4e2778e734e02 P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 11 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:05:52.815281 19410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14935b3ddf914369822e4a0547aaa355" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:05:53.009778 19410 raft_consensus.cc:2468] T 14935b3ddf914369822e4a0547aaa355 P e5256d91808b47c195bc9b4dbd7f2b87 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 8.
I20260709 13:05:53.010926 19410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ece3db938bc649d4a40a51522ed5259c" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:05:53.011390 22964 leader_election.cc:290] T 1a61655d99124a29b486ba4a5b37faea P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:05:52.813719 19404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b74109013a140ada21feeef92d6f563" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:05:53.012326 19410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "309c3ca0ca4b4f3ba129752ea2cb293b" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:05:53.012791 19404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df751f992649444090e27965eb1af85d" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:05:53.013415 19404 raft_consensus.cc:2468] T df751f992649444090e27965eb1af85d P e5256d91808b47c195bc9b4dbd7f2b87 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 10.
I20260709 13:05:53.013458 19410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21e14947d70440f19044d8f75c31e1f9" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
I20260709 13:05:53.014310 19404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "833a2f0775ed407a94b8924ce50adb63" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:05:53.015028 19404 raft_consensus.cc:2368] T 833a2f0775ed407a94b8924ce50adb63 P e5256d91808b47c195bc9b4dbd7f2b87 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e61c3a8f61bb48f8a963c9480e53c168 for earlier term 8. Current term is 9.
I20260709 13:05:53.009764 19411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cdf56e38bbc453d9438d359e5a69955" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:05:53.015792 19404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef32ce6fdd0e40d382c79974f30295c6" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:05:53.016302 19411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7be9efa6559648dbb5a0f7684c4542d1" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:05:53.016849 19404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab43d85f64114d4ebf618930e43d9ed0" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:05:53.016904 19411 raft_consensus.cc:2468] T 7be9efa6559648dbb5a0f7684c4542d1 P e5256d91808b47c195bc9b4dbd7f2b87 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 9.
I20260709 13:05:53.017740 19404 raft_consensus.cc:2393] T ab43d85f64114d4ebf618930e43d9ed0 P e5256d91808b47c195bc9b4dbd7f2b87 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e61c3a8f61bb48f8a963c9480e53c168 in current term 9: Already voted for candidate e5256d91808b47c195bc9b4dbd7f2b87 in this term.
I20260709 13:05:53.018163 19411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edd7d470b5014c9489be7f41f64355c9" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 11 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
I20260709 13:05:52.818730 19406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4509b76741dc428e9201c70c1658da13" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:05:53.018887 19411 raft_consensus.cc:3060] T edd7d470b5014c9489be7f41f64355c9 P e5256d91808b47c195bc9b4dbd7f2b87 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:05:53.019450 19406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a61655d99124a29b486ba4a5b37faea" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:05:53.020759 19406 raft_consensus.cc:1240] T 2e36a9d6e29c4a7c860cf267efbd4c74 P e5256d91808b47c195bc9b4dbd7f2b87 [term 8 FOLLOWER]: Rejecting Update request from peer 0473d2b2d01f4459b1e90fd12cc7840e for earlier term 7. Current term is 8. Ops: []
I20260709 13:05:52.824499 19559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "833a2f0775ed407a94b8924ce50adb63" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:05:53.021659 19559 raft_consensus.cc:2468] T 833a2f0775ed407a94b8924ce50adb63 P e61c3a8f61bb48f8a963c9480e53c168 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 7.
I20260709 13:05:53.014467 19410 raft_consensus.cc:2393] T 21e14947d70440f19044d8f75c31e1f9 P e5256d91808b47c195bc9b4dbd7f2b87 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate e61c3a8f61bb48f8a963c9480e53c168 in current term 9: Already voted for candidate e5256d91808b47c195bc9b4dbd7f2b87 in this term.
I20260709 13:05:53.022536 19559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b08304a0a02b42d7840c4e8ee9a6bd1a" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:05:53.023151 19559 raft_consensus.cc:2468] T b08304a0a02b42d7840c4e8ee9a6bd1a P e61c3a8f61bb48f8a963c9480e53c168 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 10.
I20260709 13:05:53.023947 19559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21e14947d70440f19044d8f75c31e1f9" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:05:53.024973 19559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86a6797bdfe94fa496c050ceae4bd0d9" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:05:52.619508 23155 raft_consensus.cc:493] T 172b3dd13109415a955b71ac0e9d2234 P 127766fc592545a4997f7790f50f6076 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader e5256d91808b47c195bc9b4dbd7f2b87)
I20260709 13:05:53.130220 23155 raft_consensus.cc:515] T 172b3dd13109415a955b71ac0e9d2234 P 127766fc592545a4997f7790f50f6076 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:05:52.745036 23072 raft_consensus.cc:493] T 76cb037fc9064d13b59a8969d897ce8c P 0473d2b2d01f4459b1e90fd12cc7840e [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:52.836336 19560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f93ee515a9c14139bf566522ed8232f3" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 13 candidate_status { last_received { term: 12 index: 5 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:05:52.838050 19403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85c494af21f9457a85da47b9bc70c1fd" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:05:53.153435 23072 raft_consensus.cc:3060] T 76cb037fc9064d13b59a8969d897ce8c P 0473d2b2d01f4459b1e90fd12cc7840e [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:05:52.829594 23174 log.cc:927] Time spent T 46c5bfeecc314717bffe987e6844b6d0 P e5256d91808b47c195bc9b4dbd7f2b87: Append to log took a long time: real 0.067s	user 0.000s	sys 0.000s
I20260709 13:05:52.851140 23178 raft_consensus.cc:493] T 179fd671030940b4b4a4e24bcc4aba0a P e5256d91808b47c195bc9b4dbd7f2b87 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:53.160059 23178 raft_consensus.cc:515] T 179fd671030940b4b4a4e24bcc4aba0a P e5256d91808b47c195bc9b4dbd7f2b87 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:52.829382 23179 consensus_queue.cc:1048] T ff9b0eddd810459b82d91c60777c10eb P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.044s
I20260709 13:05:52.779678 23102 raft_consensus.cc:493] T b08304a0a02b42d7840c4e8ee9a6bd1a P 0473d2b2d01f4459b1e90fd12cc7840e [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:52.864522 19523 leader_election.cc:304] T 70797e5783b5454ab0d0eea663e791e3 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e61c3a8f61bb48f8a963c9480e53c168; no voters: 127766fc592545a4997f7790f50f6076, e5256d91808b47c195bc9b4dbd7f2b87
W20260709 13:05:52.868095 19524 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:53.163483 23102 raft_consensus.cc:3060] T b08304a0a02b42d7840c4e8ee9a6bd1a P 0473d2b2d01f4459b1e90fd12cc7840e [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:05:53.163906 19523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.1:40321, user_credentials={real_user=slave}} blocked reactor thread for 299472us
W20260709 13:05:53.164100 19524 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:53.164654 19523 leader_election.cc:304] T b08304a0a02b42d7840c4e8ee9a6bd1a P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:05:52.870653 23190 raft_consensus.cc:493] T 85c494af21f9457a85da47b9bc70c1fd P e5256d91808b47c195bc9b4dbd7f2b87 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 127766fc592545a4997f7790f50f6076)
I20260709 13:05:53.165340 23190 raft_consensus.cc:515] T 85c494af21f9457a85da47b9bc70c1fd P e5256d91808b47c195bc9b4dbd7f2b87 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:05:53.167011 19523 leader_election.cc:304] T bc225c93219c45538b53a1bd3d387e4d P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e61c3a8f61bb48f8a963c9480e53c168; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:05:53.167594 23190 leader_election.cc:290] T 85c494af21f9457a85da47b9bc70c1fd P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:05:53.168033 23195 raft_consensus.cc:2749] T 70797e5783b5454ab0d0eea663e791e3 P e61c3a8f61bb48f8a963c9480e53c168 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:05:53.168851 23195 raft_consensus.cc:2804] T b08304a0a02b42d7840c4e8ee9a6bd1a P e61c3a8f61bb48f8a963c9480e53c168 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:05:53.169183 23140 consensus_queue.cc:1059] T 3e1f505cb0f1427bbd698ac889d80821 P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 }, Status: INVALID_TERM, Last received: 9.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:05:52.872512 22821 leader_election.cc:290] T 833a2f0775ed407a94b8924ce50adb63 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 9 election: Requested vote from peers e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:05:53.170050 23194 raft_consensus.cc:2749] T bc225c93219c45538b53a1bd3d387e4d P e61c3a8f61bb48f8a963c9480e53c168 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:05:53.170384 19403 raft_consensus.cc:2468] T 85c494af21f9457a85da47b9bc70c1fd P e5256d91808b47c195bc9b4dbd7f2b87 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 6.
I20260709 13:05:53.169224 23195 raft_consensus.cc:493] T b08304a0a02b42d7840c4e8ee9a6bd1a P e61c3a8f61bb48f8a963c9480e53c168 [term 10 FOLLOWER]: Starting leader election (detected failure of leader e5256d91808b47c195bc9b4dbd7f2b87)
I20260709 13:05:53.171005 23195 raft_consensus.cc:3060] T b08304a0a02b42d7840c4e8ee9a6bd1a P e61c3a8f61bb48f8a963c9480e53c168 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:05:53.171475 23102 raft_consensus.cc:515] T b08304a0a02b42d7840c4e8ee9a6bd1a P 0473d2b2d01f4459b1e90fd12cc7840e [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:53.173689 23102 leader_election.cc:290] T b08304a0a02b42d7840c4e8ee9a6bd1a P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 12 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:05:52.878918 19554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df751f992649444090e27965eb1af85d" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:05:53.174615 19554 raft_consensus.cc:2468] T df751f992649444090e27965eb1af85d P e61c3a8f61bb48f8a963c9480e53c168 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 9.
I20260709 13:05:53.175891 19554 raft_consensus.cc:1275] T 96efeaaf1057492490e9a621f37e1a2d P e61c3a8f61bb48f8a963c9480e53c168 [term 10 FOLLOWER]: Refusing update from remote peer 127766fc592545a4997f7790f50f6076: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
W20260709 13:05:52.882329 19555 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40428 (request call id 2265) took 1294 ms (client timeout 1613 ms). Trace:
I20260709 13:05:52.882906 19556 raft_consensus.cc:2468] T fa731b585f684a7fb2d106c50f143b83 P e61c3a8f61bb48f8a963c9480e53c168 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 9.
I20260709 13:05:52.883751 20108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4af19371ea874c09a0a2147040835cbb" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
W20260709 13:05:53.177572 19555 rpcz_store.cc:269] 0709 13:05:51.588100 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:51.634226 (+ 46126us) service_pool.cc:224] Handling call
0709 13:05:52.882170 (+1247944us) spinlock_profiling.cc:243] Waited 679 ms on lock 0x7b5400126454. stack: 00007f4a79de9343 00007f4a79de9240 00007f4a797781d4 00007f4a834b6304 00007f4a834b6299 00007f4a7ce71571 00007f4a7cf0c2fa 00007f4a81ecdb17 00007f4a7b4486d4 00007f4a7b448662 00007f4a7b448591 00007f4a7b44850c 00007f4a7b4477c2 00007f4a7b24348c 00007f4a7b2428c6 00007f4a7b24226f
0709 13:05:52.882270 (+   100us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1562245376}
I20260709 13:05:52.886958 23131 leader_election.cc:290] T 1f85fc4b527a48848e5faa083b604e36 P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321)
I20260709 13:05:52.891160 19375 leader_election.cc:304] T 76cb037fc9064d13b59a8969d897ce8c P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
W20260709 13:05:52.893019 19451 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:52.896361 23156 leader_election.cc:290] T 65d8cb8d6ec64f459d5a47cefab10acf P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 7 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
W20260709 13:05:53.179608 19375 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.3:36891, user_credentials={real_user=slave}} blocked reactor thread for 288498us
I20260709 13:05:53.179915 22821 raft_consensus.cc:2804] T 76cb037fc9064d13b59a8969d897ce8c P e5256d91808b47c195bc9b4dbd7f2b87 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:05:53.180353 22821 raft_consensus.cc:493] T 76cb037fc9064d13b59a8969d897ce8c P e5256d91808b47c195bc9b4dbd7f2b87 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:53.180830 22821 raft_consensus.cc:3060] T 76cb037fc9064d13b59a8969d897ce8c P e5256d91808b47c195bc9b4dbd7f2b87 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:05:53.180420 23195 raft_consensus.cc:515] T b08304a0a02b42d7840c4e8ee9a6bd1a P e61c3a8f61bb48f8a963c9480e53c168 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:53.181537 19375 leader_election.cc:304] T 7f575b143b844aa096b50997dad3516a P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:05:53.182022 23102 raft_consensus.cc:493] T ef32ce6fdd0e40d382c79974f30295c6 P 0473d2b2d01f4459b1e90fd12cc7840e [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:52.900921 23066 leader_election.cc:290] T 217b5fae677b4971b3bbd2f357a1f7ff P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:05:52.904270 19552 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40428 (request call id 2253) took 2381 ms. Trace:
I20260709 13:05:53.182494 23102 raft_consensus.cc:515] T ef32ce6fdd0e40d382c79974f30295c6 P 0473d2b2d01f4459b1e90fd12cc7840e [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:53.183096 19552 rpcz_store.cc:276] 0709 13:05:50.522985 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:50.864069 (+341084us) service_pool.cc:224] Handling call
0709 13:05:50.864387 (+   318us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:05:51.073788 (+209401us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:05:51.073820 (+    32us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:05:51.074384 (+   564us) log.cc:844] Serialized 52 byte log entry
0709 13:05:52.881330 (+1806946us) spinlock_profiling.cc:243] Waited 30.3 ms on lock 0x7b18003a5ca0. stack: 00007f4a79de9343 00007f4a79de9240 00007f4a797781d4 00007f4a834b6304 00007f4a834b6299 00007f4a82ce3de1 00007f4a82cf05b1 00007f4a79dfde07 00007f4a82c58ab9 00007f4a79e1a69b 00007f4a79e1893f 00007f4a79e1ac02 00007f4a7caa220b 00007f4a7caa7d23 00007f4a7caa80d1 00007f4a7cec3a0f
0709 13:05:52.903119 (+ 21789us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:05:52.903160 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:52.903234 (+    74us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:05:52.903988 (+   754us) raft_consensus.cc:1685] finished
0709 13:05:52.904014 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:52.904214 (+   200us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":253272,"raft.run_cpu_time_us":176,"raft.run_wall_time_us":23549,"spinlock_wait_cycles":69719296,"thread_start_us":230556,"threads_started":2,"wal-append.queue_time_us":1798653}
I20260709 13:05:53.184487 23102 leader_election.cc:290] T ef32ce6fdd0e40d382c79974f30295c6 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:05:52.918406 23055 consensus_queue.cc:237] T 3e1f505cb0f1427bbd698ac889d80821 P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:53.162370 23178 leader_election.cc:290] T 179fd671030940b4b4a4e24bcc4aba0a P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:05:52.940346 19558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "833a2f0775ed407a94b8924ce50adb63" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:05:53.187556 19558 raft_consensus.cc:3060] T 833a2f0775ed407a94b8924ce50adb63 P e61c3a8f61bb48f8a963c9480e53c168 [term 7 FOLLOWER]: Advancing to term 9
I20260709 13:05:53.182374 19375 leader_election.cc:304] T 70797e5783b5454ab0d0eea663e791e3 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:05:52.941975 19557 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40428 (request call id 2254) took 2383 ms. Trace:
I20260709 13:05:53.190809 19557 rpcz_store.cc:276] 0709 13:05:50.558910 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:50.870838 (+311928us) service_pool.cc:224] Handling call
0709 13:05:50.873881 (+  3043us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:52.143002 (+1269121us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:52.941764 (+798762us) spinlock_profiling.cc:243] Waited 1.26 s on lock 0x7b54001f5ed4. stack: 00007f4a79de9343 00007f4a79de9240 00007f4a797781d4 00007f4a834b6304 00007f4a834b6299 00007f4a7ce71571 00007f4a7cf08e01 00007f4a7cf0783e 00007f4a81ecc419 00007f4a7b443bd4 00007f4a7b443b62 00007f4a7b443a91 00007f4a7b443a0c 00007f4a7b442cc2 00007f4a7b24348c 00007f4a7b2428c6
0709 13:05:52.941912 (+   148us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2891024768}
I20260709 13:05:52.945539 19402 raft_consensus.cc:2468] T e381f1d6b8184797ad142de49be225a8 P e5256d91808b47c195bc9b4dbd7f2b87 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 8.
I20260709 13:05:52.951319 23038 raft_consensus.cc:515] T 28af091831594f9d8e96482078cc7625 P 0473d2b2d01f4459b1e90fd12cc7840e [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:53.192462 23178 raft_consensus.cc:2804] T 70797e5783b5454ab0d0eea663e791e3 P e5256d91808b47c195bc9b4dbd7f2b87 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:05:53.192719 23195 leader_election.cc:290] T b08304a0a02b42d7840c4e8ee9a6bd1a P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 11 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:05:53.193186 23178 raft_consensus.cc:697] T 70797e5783b5454ab0d0eea663e791e3 P e5256d91808b47c195bc9b4dbd7f2b87 [term 10 LEADER]: Becoming Leader. State: Replica: e5256d91808b47c195bc9b4dbd7f2b87, State: Running, Role: LEADER
I20260709 13:05:53.193532 23038 leader_election.cc:290] T 28af091831594f9d8e96482078cc7625 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 10 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:05:52.956177 23143 consensus_queue.cc:237] T 1f85fc4b527a48848e5faa083b604e36 P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:05:53.186080 19306 catalog_manager.cc:5697] T b9f0d59553ad444883fcf5b5909f9798 P e61c3a8f61bb48f8a963c9480e53c168 reported cstate change: term changed from 5 to 8, leader changed from 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2) to e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3). New cstate: current_term: 8 leader_uuid: "e61c3a8f61bb48f8a963c9480e53c168" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } health_report { overall_health: HEALTHY } } }
I20260709 13:05:53.195909 19523 leader_election.cc:304] T 2725d2c4cb054f18b0fc8f735c15f6c2 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e61c3a8f61bb48f8a963c9480e53c168; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:05:52.960497 19484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e381f1d6b8184797ad142de49be225a8" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:05:52.963068 19409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa8650e71aa14778b3d73721fc50d9fc" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:05:53.196954 19409 raft_consensus.cc:2468] T fa8650e71aa14778b3d73721fc50d9fc P e5256d91808b47c195bc9b4dbd7f2b87 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 9.
I20260709 13:05:53.197043 19523 leader_election.cc:304] T 2e36a9d6e29c4a7c860cf267efbd4c74 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168; no voters: 0473d2b2d01f4459b1e90fd12cc7840e
I20260709 13:05:52.964067 19480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48824d5acfbc485ebf8c2d944e7202de" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:05:53.197402 19484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62c6c134d3d24a1ab144dd9ee6bc3f64" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:05:53.197799 19480 raft_consensus.cc:2468] T 48824d5acfbc485ebf8c2d944e7202de P 0473d2b2d01f4459b1e90fd12cc7840e [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 9.
I20260709 13:05:53.198015 23195 raft_consensus.cc:2749] T 2725d2c4cb054f18b0fc8f735c15f6c2 P e61c3a8f61bb48f8a963c9480e53c168 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:05:53.198490 19484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa8650e71aa14778b3d73721fc50d9fc" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:05:53.199205 19484 raft_consensus.cc:2468] T fa8650e71aa14778b3d73721fc50d9fc P 0473d2b2d01f4459b1e90fd12cc7840e [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 10.
I20260709 13:05:53.199355 23195 raft_consensus.cc:2804] T 2e36a9d6e29c4a7c860cf267efbd4c74 P e61c3a8f61bb48f8a963c9480e53c168 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:05:53.200052 19484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edd7d470b5014c9489be7f41f64355c9" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 11 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
W20260709 13:05:53.200459 19308 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:44676 (request call id 221) took 16130 ms (client timeout 15000 ms). Trace:
I20260709 13:05:53.200712 19523 leader_election.cc:304] T fa731b585f684a7fb2d106c50f143b83 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e61c3a8f61bb48f8a963c9480e53c168; no voters: 127766fc592545a4997f7790f50f6076, e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:05:53.194293 23178 consensus_queue.cc:237] T 70797e5783b5454ab0d0eea663e791e3 P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 7, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:05:52.965096 23051 raft_consensus.cc:493] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P 0473d2b2d01f4459b1e90fd12cc7840e [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:52.965389 19486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62c6c134d3d24a1ab144dd9ee6bc3f64" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:05:52.966012 19477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b08304a0a02b42d7840c4e8ee9a6bd1a" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:05:52.969616 19449 leader_election.cc:304] T ff9b0eddd810459b82d91c60777c10eb P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e; no voters: 127766fc592545a4997f7790f50f6076, e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:05:52.969671 19553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a08760e15aac4630a629431f56024dc8" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:05:52.971602 19478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1b10566f45d4a7d9029858330e02d5b" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:05:52.980088 23183 raft_consensus.cc:493] T ece3db938bc649d4a40a51522ed5259c P 127766fc592545a4997f7790f50f6076 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader e5256d91808b47c195bc9b4dbd7f2b87)
I20260709 13:05:52.974278 19374 leader_election.cc:304] T 775c229504194560ba9589bc2199b089 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 127766fc592545a4997f7790f50f6076, e5256d91808b47c195bc9b4dbd7f2b87; no voters: 
I20260709 13:05:52.981230 23034 raft_consensus.cc:3055] T 3e1f505cb0f1427bbd698ac889d80821 P e61c3a8f61bb48f8a963c9480e53c168 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:05:52.984580 23089 raft_consensus.cc:3060] T 86a6797bdfe94fa496c050ceae4bd0d9 P 0473d2b2d01f4459b1e90fd12cc7840e [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:05:52.989238 22979 raft_consensus.cc:2804] T 179fd671030940b4b4a4e24bcc4aba0a P e61c3a8f61bb48f8a963c9480e53c168 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:05:52.989415 23050 raft_consensus.cc:515] T df751f992649444090e27965eb1af85d P 0473d2b2d01f4459b1e90fd12cc7840e [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:52.992206 23151 leader_election.cc:290] T 0afb57ae58a24a01850491d69f0213dd P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
W20260709 13:05:52.993723 19525 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:52.995234 19551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40e1e16737a842ee936002830f36882e" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 13 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:05:53.002871 23083 raft_consensus.cc:3055] T 21e14947d70440f19044d8f75c31e1f9 P 0473d2b2d01f4459b1e90fd12cc7840e [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:05:53.005254 23093 consensus_queue.cc:1048] T 40e1e16737a842ee936002830f36882e P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:05:53.018491 19404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dc5b3532fe54f74876d02beffa2c230" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
W20260709 13:05:53.032693 20078 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:52.774346 23104 raft_consensus.cc:493] T 1f85fc4b527a48848e5faa083b604e36 P 0473d2b2d01f4459b1e90fd12cc7840e [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:53.041296 19411 raft_consensus.cc:2468] T edd7d470b5014c9489be7f41f64355c9 P e5256d91808b47c195bc9b4dbd7f2b87 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 11.
I20260709 13:05:53.045401 23018 leader_election.cc:290] T 1efebf73c86e432baa55533136b6e12c P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:05:53.057334 23150 leader_election.cc:290] T 48824d5acfbc485ebf8c2d944e7202de P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 10 election: Requested vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:05:53.060813 23146 leader_election.cc:290] T 22196caba61445d3bec98a0aab3c337d P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:05:53.069617 22978 raft_consensus.cc:493] T b9f0d59553ad444883fcf5b5909f9798 P 0473d2b2d01f4459b1e90fd12cc7840e [term 8 FOLLOWER]: Starting leader election (detected failure of leader e61c3a8f61bb48f8a963c9480e53c168)
W20260709 13:05:53.080641 19483 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58294 (request call id 2009) took 3729 ms (client timeout 2115 ms). Trace:
I20260709 13:05:53.081282 19482 raft_consensus.cc:1240] T ff75a1d4cb1f493db8f71ddc136ba9ab P 0473d2b2d01f4459b1e90fd12cc7840e [term 9 FOLLOWER]: Rejecting Update request from peer e61c3a8f61bb48f8a963c9480e53c168 for earlier term 8. Current term is 9. Ops: [8.5-8.5]
W20260709 13:05:53.087224 19450 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.3:36891, user_credentials={real_user=slave}} blocked reactor thread for 641804us
I20260709 13:05:52.756436 22974 raft_consensus.cc:493] T 86a6797bdfe94fa496c050ceae4bd0d9 P e61c3a8f61bb48f8a963c9480e53c168 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:05:53.115085 23139 consensus_meta.cc:287] T 833a2f0775ed407a94b8924ce50adb63 P 127766fc592545a4997f7790f50f6076: Time spent flushing consensus metadata: real 0.768s	user 0.008s	sys 0.004s
W20260709 13:05:53.118217 23153 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.552s	user 0.028s	sys 0.032s
I20260709 13:05:53.123734 19485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48824d5acfbc485ebf8c2d944e7202de" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:05:53.126052 19481 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58286 (request call id 1806) took 1012 ms. Trace:
W20260709 13:05:53.133219 23130 consensus_meta.cc:287] T 4af19371ea874c09a0a2147040835cbb P 127766fc592545a4997f7790f50f6076: Time spent flushing consensus metadata: real 0.696s	user 0.011s	sys 0.003s
I20260709 13:05:53.133436 23155 leader_election.cc:290] T 172b3dd13109415a955b71ac0e9d2234 P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:05:53.137833 22882 leader_election.cc:290] T fa8650e71aa14778b3d73721fc50d9fc P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:05:53.184123 23088 raft_consensus.cc:2804] T 7f575b143b844aa096b50997dad3516a P e5256d91808b47c195bc9b4dbd7f2b87 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:05:53.198557 19480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a08760e15aac4630a629431f56024dc8" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:05:52.964737 19479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b74109013a140ada21feeef92d6f563" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:05:52.781301 23027 raft_consensus.cc:493] T f93ee515a9c14139bf566522ed8232f3 P 0473d2b2d01f4459b1e90fd12cc7840e [term 12 FOLLOWER]: Starting leader election (detected failure of leader e61c3a8f61bb48f8a963c9480e53c168)
I20260709 13:05:53.201099 19484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff75a1d4cb1f493db8f71ddc136ba9ab" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:05:53.212965 19523 leader_election.cc:304] T ff75a1d4cb1f493db8f71ddc136ba9ab P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:05:53.332376 23183 raft_consensus.cc:515] T ece3db938bc649d4a40a51522ed5259c P 127766fc592545a4997f7790f50f6076 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:05:53.210510 23195 raft_consensus.cc:697] T 2e36a9d6e29c4a7c860cf267efbd4c74 P e61c3a8f61bb48f8a963c9480e53c168 [term 8 LEADER]: Becoming Leader. State: Replica: e61c3a8f61bb48f8a963c9480e53c168, State: Running, Role: LEADER
I20260709 13:05:53.333369 23130 raft_consensus.cc:515] T 4af19371ea874c09a0a2147040835cbb P 127766fc592545a4997f7790f50f6076 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:05:53.334440 19477 raft_consensus.cc:2368] T b08304a0a02b42d7840c4e8ee9a6bd1a P 0473d2b2d01f4459b1e90fd12cc7840e [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e61c3a8f61bb48f8a963c9480e53c168 for earlier term 11. Current term is 12.
I20260709 13:05:53.334625 20108 raft_consensus.cc:2393] T 4af19371ea874c09a0a2147040835cbb P 127766fc592545a4997f7790f50f6076 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e61c3a8f61bb48f8a963c9480e53c168 in current term 6: Already voted for candidate 127766fc592545a4997f7790f50f6076 in this term.
I20260709 13:05:53.335217 23183 leader_election.cc:290] T ece3db938bc649d4a40a51522ed5259c P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:05:53.335347 19477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cdf56e38bbc453d9438d359e5a69955" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:05:53.333678 19484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14935b3ddf914369822e4a0547aaa355" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:05:53.335638 20108 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46422 (request call id 655) took 1262 ms. Trace:
I20260709 13:05:53.336061 20108 rpcz_store.cc:276] 0709 13:05:52.072768 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:52.883493 (+810725us) service_pool.cc:224] Handling call
0709 13:05:53.335462 (+451969us) spinlock_profiling.cc:243] Waited 156 ms on lock 0x7b54003fff54. stack: 00007f4a79de9343 00007f4a79de9240 00007f4a797781d4 00007f4a834b6304 00007f4a834b6299 00007f4a7ce71571 00007f4a7cf0c2fa 00007f4a81ecdb17 00007f4a7b4486d4 00007f4a7b448662 00007f4a7b448591 00007f4a7b44850c 00007f4a7b4477c2 00007f4a7b24348c 00007f4a7b2428c6 00007f4a7b24226f
0709 13:05:53.335584 (+   122us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":359644544}
I20260709 13:05:53.336510 23104 raft_consensus.cc:515] T 1f85fc4b527a48848e5faa083b604e36 P 0473d2b2d01f4459b1e90fd12cc7840e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:05:53.204607 22758 raft_consensus.cc:2749] T fa731b585f684a7fb2d106c50f143b83 P e61c3a8f61bb48f8a963c9480e53c168 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:05:53.337085 19486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "309c3ca0ca4b4f3ba129752ea2cb293b" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:05:53.337822 23194 raft_consensus.cc:2804] T ff75a1d4cb1f493db8f71ddc136ba9ab P e61c3a8f61bb48f8a963c9480e53c168 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:05:53.337903 19486 raft_consensus.cc:2468] T 309c3ca0ca4b4f3ba129752ea2cb293b P 0473d2b2d01f4459b1e90fd12cc7840e [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 8.
I20260709 13:05:53.338454 23194 raft_consensus.cc:493] T ff75a1d4cb1f493db8f71ddc136ba9ab P e61c3a8f61bb48f8a963c9480e53c168 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:53.336133 19484 raft_consensus.cc:2468] T 14935b3ddf914369822e4a0547aaa355 P 0473d2b2d01f4459b1e90fd12cc7840e [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 8.
I20260709 13:05:53.339075 19486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c5eebf646ad445a9d1b1adc319d7b16" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:05:53.338886 23194 raft_consensus.cc:3060] T ff75a1d4cb1f493db8f71ddc136ba9ab P e61c3a8f61bb48f8a963c9480e53c168 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:05:53.339480 19484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df751f992649444090e27965eb1af85d" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:05:53.340175 23130 leader_election.cc:290] T 4af19371ea874c09a0a2147040835cbb P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 6 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
W20260709 13:05:53.340670 19483 rpcz_store.cc:269] 0709 13:05:49.351423 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:50.149489 (+798066us) service_pool.cc:224] Handling call
0709 13:05:53.080407 (+2930918us) spinlock_profiling.cc:243] Waited 491 ms on lock 0x7b5400222c54. stack: 00007f4a79de9343 00007f4a79de9240 00007f4a797781d4 00007f4a834b6304 00007f4a834b6299 00007f4a7ce71571 00007f4a7cf0c2fa 00007f4a81ecdb17 00007f4a7b4486d4 00007f4a7b448662 00007f4a7b448591 00007f4a7b44850c 00007f4a7b4477c2 00007f4a7b24348c 00007f4a7b2428c6 00007f4a7b24226f
0709 13:05:53.080563 (+   156us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1129013504}
I20260709 13:05:53.276458 23072 raft_consensus.cc:515] T 76cb037fc9064d13b59a8969d897ce8c P 0473d2b2d01f4459b1e90fd12cc7840e [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
W20260709 13:05:53.342034 23153 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.802s	user 0.033s	sys 0.035s
I20260709 13:05:53.342180 19483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef32ce6fdd0e40d382c79974f30295c6" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:05:53.342810 19483 raft_consensus.cc:2468] T ef32ce6fdd0e40d382c79974f30295c6 P 0473d2b2d01f4459b1e90fd12cc7840e [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 11.
I20260709 13:05:53.343755 23072 leader_election.cc:290] T 76cb037fc9064d13b59a8969d897ce8c P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 9 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:05:53.343948 19483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7be9efa6559648dbb5a0f7684c4542d1" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:05:53.344483 22974 raft_consensus.cc:3060] T 86a6797bdfe94fa496c050ceae4bd0d9 P e61c3a8f61bb48f8a963c9480e53c168 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:05:53.304674 20075 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.1:40321, user_credentials={real_user=slave}} blocked reactor thread for 89134.4us
I20260709 13:05:53.362536 19558 raft_consensus.cc:2468] T 833a2f0775ed407a94b8924ce50adb63 P e61c3a8f61bb48f8a963c9480e53c168 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 9.
I20260709 13:05:53.344633 23139 raft_consensus.cc:515] T 833a2f0775ed407a94b8924ce50adb63 P 127766fc592545a4997f7790f50f6076 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
W20260709 13:05:53.344874 19523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.1:40321, user_credentials={real_user=slave}} blocked reactor thread for 131996us
I20260709 13:05:53.368360 19523 leader_election.cc:304] T ece3db938bc649d4a40a51522ed5259c P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e61c3a8f61bb48f8a963c9480e53c168; no voters: 127766fc592545a4997f7790f50f6076, e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:05:53.369659 19523 leader_election.cc:304] T 309c3ca0ca4b4f3ba129752ea2cb293b P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: e61c3a8f61bb48f8a963c9480e53c168; no voters: 127766fc592545a4997f7790f50f6076, e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:05:53.345423 19480 raft_consensus.cc:2376] T a08760e15aac4630a629431f56024dc8 P 0473d2b2d01f4459b1e90fd12cc7840e [term 11 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 11. Re-sending same reply.
I20260709 13:05:53.345897 19479 raft_consensus.cc:2468] T 2b74109013a140ada21feeef92d6f563 P 0473d2b2d01f4459b1e90fd12cc7840e [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 5.
I20260709 13:05:53.347352 19478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab43d85f64114d4ebf618930e43d9ed0" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:05:53.372035 19478 raft_consensus.cc:2393] T ab43d85f64114d4ebf618930e43d9ed0 P 0473d2b2d01f4459b1e90fd12cc7840e [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e61c3a8f61bb48f8a963c9480e53c168 in current term 9: Already voted for candidate e5256d91808b47c195bc9b4dbd7f2b87 in this term.
I20260709 13:05:53.344462 23050 leader_election.cc:290] T df751f992649444090e27965eb1af85d P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 11 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:05:53.347530 23194 raft_consensus.cc:515] T ff75a1d4cb1f493db8f71ddc136ba9ab P e61c3a8f61bb48f8a963c9480e53c168 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
W20260709 13:05:53.348173 19449 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.4:43121, user_credentials={real_user=slave}} blocked reactor thread for 378647us
I20260709 13:05:53.348665 20110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48824d5acfbc485ebf8c2d944e7202de" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:05:53.375520 20110 raft_consensus.cc:2393] T 48824d5acfbc485ebf8c2d944e7202de P 127766fc592545a4997f7790f50f6076 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0473d2b2d01f4459b1e90fd12cc7840e in current term 10: Already voted for candidate e61c3a8f61bb48f8a963c9480e53c168 in this term.
I20260709 13:05:53.377704 19449 leader_election.cc:304] T 0afb57ae58a24a01850491d69f0213dd P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, 127766fc592545a4997f7790f50f6076; no voters: 
I20260709 13:05:53.348863 23051 raft_consensus.cc:515] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P 0473d2b2d01f4459b1e90fd12cc7840e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:05:53.334002 23195 consensus_queue.cc:237] T 2e36a9d6e29c4a7c860cf267efbd4c74 P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:53.395660 19523 leader_election.cc:304] T df751f992649444090e27965eb1af85d P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:05:53.396591 19523 leader_election.cc:400] T 833a2f0775ed407a94b8924ce50adb63 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 8 pre-election: Vote denied by peer e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321) with higher term. Message: Invalid argument: T 833a2f0775ed407a94b8924ce50adb63 P e5256d91808b47c195bc9b4dbd7f2b87 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e61c3a8f61bb48f8a963c9480e53c168 for earlier term 8. Current term is 9.
I20260709 13:05:53.396816 19523 leader_election.cc:403] T 833a2f0775ed407a94b8924ce50adb63 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 8 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:05:53.398003 19523 leader_election.cc:304] T 7be9efa6559648dbb5a0f7684c4542d1 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 127766fc592545a4997f7790f50f6076, e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:05:53.349905 20105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1efebf73c86e432baa55533136b6e12c" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:05:53.395153 20110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f85fc4b527a48848e5faa083b604e36" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:05:53.402765 20110 raft_consensus.cc:2468] T 1f85fc4b527a48848e5faa083b604e36 P 127766fc592545a4997f7790f50f6076 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 6.
I20260709 13:05:53.406734 19407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa8650e71aa14778b3d73721fc50d9fc" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:05:53.407490 19407 raft_consensus.cc:2468] T fa8650e71aa14778b3d73721fc50d9fc P e5256d91808b47c195bc9b4dbd7f2b87 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 9.
I20260709 13:05:53.410558 19406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f85fc4b527a48848e5faa083b604e36" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:05:53.411456 19523 leader_election.cc:304] T ab43d85f64114d4ebf618930e43d9ed0 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: e61c3a8f61bb48f8a963c9480e53c168; no voters: 127766fc592545a4997f7790f50f6076, e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:05:53.412089 19402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef32ce6fdd0e40d382c79974f30295c6" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:05:53.412705 19523 leader_election.cc:304] T 4509b76741dc428e9201c70c1658da13 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e61c3a8f61bb48f8a963c9480e53c168; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:05:53.413991 23018 consensus_queue.cc:1059] T 6c5eebf646ad445a9d1b1adc319d7b16 P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:05:53.417047 23139 leader_election.cc:290] T 833a2f0775ed407a94b8924ce50adb63 P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 9 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:05:53.350512 19482 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58286 (request call id 1804) took 1237 ms. Trace:
I20260709 13:05:53.253227 23190 raft_consensus.cc:493] T 9962423cb4e54fcfa5de01daf68a86e7 P e5256d91808b47c195bc9b4dbd7f2b87 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 127766fc592545a4997f7790f50f6076)
I20260709 13:05:53.418116 23190 raft_consensus.cc:515] T 9962423cb4e54fcfa5de01daf68a86e7 P e5256d91808b47c195bc9b4dbd7f2b87 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:05:53.417963 19482 rpcz_store.cc:276] 0709 13:05:52.113516 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:52.405351 (+291835us) service_pool.cc:224] Handling call
0709 13:05:53.081057 (+675706us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:05:53.349720 (+268663us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:53.350335 (+   615us) spinlock_profiling.cc:243] Waited 675 ms on lock 0x7b5400222c50. stack: 00007f4a79de9343 00007f4a79de9240 00007f4a797781d4 00007f4a834b6304 00007f4a834b6299 00007f4a7ce71571 00007f4a7cf078ad 00007f4a81ecc419 00007f4a7b443bd4 00007f4a7b443b62 00007f4a7b443a91 00007f4a7b443a0c 00007f4a7b442cc2 00007f4a7b24348c 00007f4a7b2428c6 00007f4a7b24226f
0709 13:05:53.350453 (+   118us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1553322368}
I20260709 13:05:53.420287 23190 leader_election.cc:290] T 9962423cb4e54fcfa5de01daf68a86e7 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:05:53.350956 23088 raft_consensus.cc:493] T 7f575b143b844aa096b50997dad3516a P e5256d91808b47c195bc9b4dbd7f2b87 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:53.351151 23066 consensus_queue.cc:1059] T 40e1e16737a842ee936002830f36882e P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:05:53.351296 23034 raft_consensus.cc:740] T 3e1f505cb0f1427bbd698ac889d80821 P e61c3a8f61bb48f8a963c9480e53c168 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: e61c3a8f61bb48f8a963c9480e53c168, State: Running, Role: LEADER
I20260709 13:05:53.351753 23083 raft_consensus.cc:740] T 21e14947d70440f19044d8f75c31e1f9 P 0473d2b2d01f4459b1e90fd12cc7840e [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 0473d2b2d01f4459b1e90fd12cc7840e, State: Running, Role: LEADER
I20260709 13:05:53.427938 19407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b08304a0a02b42d7840c4e8ee9a6bd1a" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
I20260709 13:05:53.428304 19405 raft_consensus.cc:1240] T edd7d470b5014c9489be7f41f64355c9 P e5256d91808b47c195bc9b4dbd7f2b87 [term 11 FOLLOWER]: Rejecting Update request from peer 0473d2b2d01f4459b1e90fd12cc7840e for earlier term 10. Current term is 11. Ops: [8.4-10.5]
I20260709 13:05:53.428639 19407 raft_consensus.cc:3060] T b08304a0a02b42d7840c4e8ee9a6bd1a P e5256d91808b47c195bc9b4dbd7f2b87 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:05:53.352141 19553 raft_consensus.cc:2393] T a08760e15aac4630a629431f56024dc8 P e61c3a8f61bb48f8a963c9480e53c168 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate e5256d91808b47c195bc9b4dbd7f2b87 in current term 11: Already voted for candidate e61c3a8f61bb48f8a963c9480e53c168 in this term.
I20260709 13:05:53.336243 22978 raft_consensus.cc:3060] T b9f0d59553ad444883fcf5b5909f9798 P 0473d2b2d01f4459b1e90fd12cc7840e [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:05:53.352497 19404 raft_consensus.cc:2393] T 1dc5b3532fe54f74876d02beffa2c230 P e5256d91808b47c195bc9b4dbd7f2b87 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate e61c3a8f61bb48f8a963c9480e53c168 in current term 9: Already voted for candidate 0473d2b2d01f4459b1e90fd12cc7840e in this term.
I20260709 13:05:53.351420 23027 raft_consensus.cc:3060] T f93ee515a9c14139bf566522ed8232f3 P 0473d2b2d01f4459b1e90fd12cc7840e [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:05:53.203702 19306 catalog_manager.cc:5697] T 833a2f0775ed407a94b8924ce50adb63 P e61c3a8f61bb48f8a963c9480e53c168 reported cstate change: term changed from 6 to 7, leader changed from 127766fc592545a4997f7790f50f6076 (127.17.223.4) to e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1). New cstate: current_term: 7 leader_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } } }
I20260709 13:05:53.433401 23147 raft_consensus.cc:3060] T ab43d85f64114d4ebf618930e43d9ed0 P e61c3a8f61bb48f8a963c9480e53c168 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:05:53.352994 19484 raft_consensus.cc:2368] T df751f992649444090e27965eb1af85d P 0473d2b2d01f4459b1e90fd12cc7840e [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e61c3a8f61bb48f8a963c9480e53c168 for earlier term 10. Current term is 11.
I20260709 13:05:53.332999 19485 raft_consensus.cc:3060] T 48824d5acfbc485ebf8c2d944e7202de P 0473d2b2d01f4459b1e90fd12cc7840e [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:05:53.340723 22979 raft_consensus.cc:493] T 179fd671030940b4b4a4e24bcc4aba0a P e61c3a8f61bb48f8a963c9480e53c168 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 0473d2b2d01f4459b1e90fd12cc7840e)
I20260709 13:05:53.353267 23055 raft_consensus.cc:2804] T 775c229504194560ba9589bc2199b089 P e5256d91808b47c195bc9b4dbd7f2b87 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:05:53.336133 19477 raft_consensus.cc:2468] T 0cdf56e38bbc453d9438d359e5a69955 P 0473d2b2d01f4459b1e90fd12cc7840e [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 11.
W20260709 13:05:53.200819 19308 rpcz_store.cc:269] 0709 13:05:37.069816 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:37.079367 (+  9551us) service_pool.cc:224] Handling call
0709 13:05:53.200362 (+16120995us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:05:47.597745 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:05:47.692644 (+ 94899us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:05:47.692700 (+    56us) write_op.cc:435] Acquired schema lock
0709 13:05:47.692733 (+    33us) tablet.cc:662] Decoding operations
0709 13:05:47.771201 (+ 78468us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:05:47.771282 (+    81us) write_op.cc:641] Partition lock acquired for write op
0709 13:05:47.771312 (+    30us) tablet.cc:685] Acquiring locks for 18 operations
0709 13:05:47.772808 (+  1496us) tablet.cc:701] Row locks acquired
0709 13:05:47.772856 (+    48us) write_op.cc:260] PREPARE: finished
0709 13:05:47.773020 (+   164us) write_op.cc:270] Start()
0709 13:05:47.773167 (+   147us) write_op.cc:276] Timestamp: P: 1783602347772955 usec, L: 0
0709 13:05:47.773190 (+    23us) op_driver.cc:348] REPLICATION: starting
0709 13:05:47.773921 (+   731us) log.cc:844] Serialized 7126 byte log entry
0709 13:05:48.865657 (+1091736us) op_driver.cc:464] REPLICATION: finished
0709 13:05:49.010124 (+144467us) write_op.cc:301] APPLY: starting
0709 13:05:49.010218 (+    94us) tablet.cc:1367] starting BulkCheckPresence
0709 13:05:49.012597 (+  2379us) tablet.cc:1370] finished BulkCheckPresence
0709 13:05:49.021687 (+  9090us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:05:49.145267 (+123580us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:05:49.145642 (+   375us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=18
0709 13:05:49.145687 (+    45us) write_op.cc:312] APPLY: finished
0709 13:05:49.146139 (+   452us) log.cc:844] Serialized 125 byte log entry
0709 13:05:49.146334 (+   195us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:05:49.146507 (+   173us) write_op.cc:454] Released schema lock
0709 13:05:49.146600 (+    93us) write_op.cc:341] FINISH: Updating metrics
0709 13:05:49.147145 (+   545us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:05:49.147176 (+    31us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":197610,"reported_tablets":51,"child_traces":[["op",{"apply.queue_time_us":143362,"apply.run_cpu_time_us":5422,"apply.run_wall_time_us":136931,"num_ops":18,"prepare.queue_time_us":180487,"prepare.run_cpu_time_us":40832,"prepare.run_wall_time_us":364094,"raft.queue_time_us":208329,"raft.run_cpu_time_us":13813,"raft.run_wall_time_us":111768,"replication_time_us":1044703,"thread_start_us":457927,"threads_started":4,"wal-append.queue_time_us":241427,"wal-append.run_cpu_time_us":18192,"wal-append.run_wall_time_us":2132303}]]}
I20260709 13:05:53.356629 19375 leader_election.cc:304] T b08304a0a02b42d7840c4e8ee9a6bd1a P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
W20260709 13:05:53.474956 19375 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.3:36891, user_credentials={real_user=slave}} blocked reactor thread for 118366us
I20260709 13:05:53.340257 19486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21e14947d70440f19044d8f75c31e1f9" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:05:53.350636 19481 rpcz_store.cc:276] 0709 13:05:52.113976 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:52.404626 (+290650us) service_pool.cc:224] Handling call
0709 13:05:53.124217 (+719591us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:53.124396 (+   179us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:05:53.124421 (+    25us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:05:53.124468 (+    47us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:05:53.124499 (+    31us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:53.124548 (+    49us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:53.125879 (+  1331us) spinlock_profiling.cc:243] Waited 719 ms on lock 0x7b5400224050. stack: 00007f4a79de9343 00007f4a79de9240 00007f4a797781d4 00007f4a834b6304 00007f4a834b6299 00007f4a7ce71571 00007f4a7cf078ad 00007f4a81ecc419 00007f4a7b443bd4 00007f4a7b443b62 00007f4a7b443a91 00007f4a7b443a0c 00007f4a7b442cc2 00007f4a7b24348c 00007f4a7b2428c6 00007f4a7b24226f
0709 13:05:53.125995 (+   116us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1654221568}
I20260709 13:05:53.357836 19483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edd7d470b5014c9489be7f41f64355c9" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 11 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:05:53.364838 19552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "179fd671030940b4b4a4e24bcc4aba0a" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:05:53.366154 22821 raft_consensus.cc:515] T 76cb037fc9064d13b59a8969d897ce8c P e5256d91808b47c195bc9b4dbd7f2b87 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:53.366516 19551 raft_consensus.cc:1275] T ef32ce6fdd0e40d382c79974f30295c6 P e61c3a8f61bb48f8a963c9480e53c168 [term 11 FOLLOWER]: Refusing update from remote peer e5256d91808b47c195bc9b4dbd7f2b87: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
W20260709 13:05:53.341080 19374 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.4:43121, user_credentials={real_user=slave}} blocked reactor thread for 366899us
I20260709 13:05:53.367147 19557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85c494af21f9457a85da47b9bc70c1fd" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:05:53.347733 20108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e1085d23e8347fbbd5bce7542f4b1f4" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:05:53.348706 22882 raft_consensus.cc:2749] T ff9b0eddd810459b82d91c60777c10eb P 0473d2b2d01f4459b1e90fd12cc7840e [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:05:53.390730 19411 raft_consensus.cc:1240] T e381f1d6b8184797ad142de49be225a8 P e5256d91808b47c195bc9b4dbd7f2b87 [term 8 FOLLOWER]: Rejecting Update request from peer 0473d2b2d01f4459b1e90fd12cc7840e for earlier term 7. Current term is 8. Ops: [7.5-7.5]
I20260709 13:05:53.421439 23089 raft_consensus.cc:515] T 86a6797bdfe94fa496c050ceae4bd0d9 P 0473d2b2d01f4459b1e90fd12cc7840e [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:53.525504 23089 leader_election.cc:290] T 86a6797bdfe94fa496c050ceae4bd0d9 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 10 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:05:53.411391 19410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28af091831594f9d8e96482078cc7625" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
I20260709 13:05:53.423069 19480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dc5b3532fe54f74876d02beffa2c230" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:05:53.338572 23104 leader_election.cc:290] T 1f85fc4b527a48848e5faa083b604e36 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:05:53.429500 23088 raft_consensus.cc:3060] T 7f575b143b844aa096b50997dad3516a P e5256d91808b47c195bc9b4dbd7f2b87 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:05:53.411176 23199 raft_consensus.cc:2749] T ece3db938bc649d4a40a51522ed5259c P e61c3a8f61bb48f8a963c9480e53c168 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:05:53.453377 23050 raft_consensus.cc:2804] T 0afb57ae58a24a01850491d69f0213dd P 0473d2b2d01f4459b1e90fd12cc7840e [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:05:53.421270 22758 raft_consensus.cc:3060] T 309c3ca0ca4b4f3ba129752ea2cb293b P e61c3a8f61bb48f8a963c9480e53c168 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:05:53.463380 19403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df751f992649444090e27965eb1af85d" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
I20260709 13:05:53.531502 19403 raft_consensus.cc:3060] T df751f992649444090e27965eb1af85d P e5256d91808b47c195bc9b4dbd7f2b87 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:05:53.464224 19404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76cb037fc9064d13b59a8969d897ce8c" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
I20260709 13:05:53.429183 23146 raft_consensus.cc:2749] T 833a2f0775ed407a94b8924ce50adb63 P e61c3a8f61bb48f8a963c9480e53c168 [term 9 FOLLOWER]: Leader pre-election lost for term 8. Reason: Vote denied by peer e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321) with higher term. Message: Invalid argument: T 833a2f0775ed407a94b8924ce50adb63 P e5256d91808b47c195bc9b4dbd7f2b87 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e61c3a8f61bb48f8a963c9480e53c168 for earlier term 8. Current term is 9.
I20260709 13:05:53.427623 23140 raft_consensus.cc:2804] T df751f992649444090e27965eb1af85d P e61c3a8f61bb48f8a963c9480e53c168 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:05:53.346526 19450 leader_election.cc:304] T 2b74109013a140ada21feeef92d6f563 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168; no voters: e5256d91808b47c195bc9b4dbd7f2b87
W20260709 13:05:53.540779 19523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.1:40321, user_credentials={real_user=slave}} blocked reactor thread for 128172us
W20260709 13:05:53.540987 19450 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.3:36891, user_credentials={real_user=slave}} blocked reactor thread for 194543us
I20260709 13:05:53.441461 23150 raft_consensus.cc:2804] T 7be9efa6559648dbb5a0f7684c4542d1 P e61c3a8f61bb48f8a963c9480e53c168 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:05:53.542871 19404 raft_consensus.cc:2393] T 76cb037fc9064d13b59a8969d897ce8c P e5256d91808b47c195bc9b4dbd7f2b87 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 0473d2b2d01f4459b1e90fd12cc7840e in current term 9: Already voted for candidate e5256d91808b47c195bc9b4dbd7f2b87 in this term.
I20260709 13:05:53.543638 20108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "833a2f0775ed407a94b8924ce50adb63" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076"
I20260709 13:05:53.544478 20108 raft_consensus.cc:2393] T 833a2f0775ed407a94b8924ce50adb63 P 127766fc592545a4997f7790f50f6076 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate e5256d91808b47c195bc9b4dbd7f2b87 in current term 9: Already voted for candidate 127766fc592545a4997f7790f50f6076 in this term.
I20260709 13:05:53.487833 19449 leader_election.cc:304] T 1dc5b3532fe54f74876d02beffa2c230 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87; no voters: 
I20260709 13:05:53.486228 19306 catalog_manager.cc:5697] T 0cdf56e38bbc453d9438d359e5a69955 P e61c3a8f61bb48f8a963c9480e53c168 reported cstate change: term changed from 5 to 9, leader changed from e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3) to e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1). New cstate: current_term: 9 leader_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } }
I20260709 13:05:53.393982 19408 raft_consensus.cc:1275] T 7be9efa6559648dbb5a0f7684c4542d1 P e5256d91808b47c195bc9b4dbd7f2b87 [term 9 FOLLOWER]: Refusing update from remote peer 0473d2b2d01f4459b1e90fd12cc7840e: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 13:05:53.545595 20110 raft_consensus.cc:1240] T 4af19371ea874c09a0a2147040835cbb P 127766fc592545a4997f7790f50f6076 [term 6 FOLLOWER]: Rejecting Update request from peer e5256d91808b47c195bc9b4dbd7f2b87 for earlier term 5. Current term is 6. Ops: []
I20260709 13:05:53.494663 23051 leader_election.cc:290] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:05:53.462154 23139 raft_consensus.cc:493] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P 127766fc592545a4997f7790f50f6076 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:53.473729 22979 raft_consensus.cc:3060] T 179fd671030940b4b4a4e24bcc4aba0a P e61c3a8f61bb48f8a963c9480e53c168 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:05:53.508394 23083 consensus_queue.cc:260] T 21e14947d70440f19044d8f75c31e1f9 P 0473d2b2d01f4459b1e90fd12cc7840e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:53.515172 23194 leader_election.cc:290] T ff75a1d4cb1f493db8f71ddc136ba9ab P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 10 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:05:53.473915 23055 raft_consensus.cc:493] T 775c229504194560ba9589bc2199b089 P e5256d91808b47c195bc9b4dbd7f2b87 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:53.554653 19403 raft_consensus.cc:2468] T df751f992649444090e27965eb1af85d P e5256d91808b47c195bc9b4dbd7f2b87 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 11.
I20260709 13:05:53.527412 19480 raft_consensus.cc:2393] T 1dc5b3532fe54f74876d02beffa2c230 P 0473d2b2d01f4459b1e90fd12cc7840e [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate e61c3a8f61bb48f8a963c9480e53c168 in current term 9: Already voted for candidate 0473d2b2d01f4459b1e90fd12cc7840e in this term.
I20260709 13:05:53.491681 19375 leader_election.cc:304] T df751f992649444090e27965eb1af85d P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:05:53.547680 20110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ec1c4ce15e04c7e8c283a62179f2a64" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076"
I20260709 13:05:53.610392 20110 raft_consensus.cc:3060] T 5ec1c4ce15e04c7e8c283a62179f2a64 P 127766fc592545a4997f7790f50f6076 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:05:53.589517 20108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36f6ba92b9ba46babe4ebd6c02e5fbd9" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076"
I20260709 13:05:53.547909 19450 leader_election.cc:304] T ff75a1d4cb1f493db8f71ddc136ba9ab P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e; no voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168
W20260709 13:05:53.549023 19449 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.1:40321, user_credentials={real_user=slave}} blocked reactor thread for 61270us
I20260709 13:05:53.552659 19485 raft_consensus.cc:2468] T 48824d5acfbc485ebf8c2d944e7202de P 0473d2b2d01f4459b1e90fd12cc7840e [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 10.
I20260709 13:05:53.517867 23102 raft_consensus.cc:3055] T 6c5eebf646ad445a9d1b1adc319d7b16 P 0473d2b2d01f4459b1e90fd12cc7840e [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:05:53.615962 23102 raft_consensus.cc:740] T 6c5eebf646ad445a9d1b1adc319d7b16 P 0473d2b2d01f4459b1e90fd12cc7840e [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 0473d2b2d01f4459b1e90fd12cc7840e, State: Running, Role: LEADER
I20260709 13:05:53.616745 23102 consensus_queue.cc:260] T 6c5eebf646ad445a9d1b1adc319d7b16 P 0473d2b2d01f4459b1e90fd12cc7840e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:05:53.617839 23102 raft_consensus.cc:3060] T 6c5eebf646ad445a9d1b1adc319d7b16 P 0473d2b2d01f4459b1e90fd12cc7840e [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:05:53.619127 19404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65d8cb8d6ec64f459d5a47cefab10acf" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
W20260709 13:05:53.619413 19450 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.3:36891, user_credentials={real_user=slave}} blocked reactor thread for 71585.5us
I20260709 13:05:53.620220 19410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "775c229504194560ba9589bc2199b089" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
I20260709 13:05:53.620615 19411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14efcc79969f41babe5529c22d59156d" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:05:53.621034 19409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a16f7501e2444fb86d4e2778e734e02" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:05:53.622859 22882 raft_consensus.cc:2749] T ff75a1d4cb1f493db8f71ddc136ba9ab P 0473d2b2d01f4459b1e90fd12cc7840e [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:05:53.622944 19409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff9b0eddd810459b82d91c60777c10eb" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
W20260709 13:05:53.624010 19375 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.3:36891, user_credentials={real_user=slave}} blocked reactor thread for 132444us
I20260709 13:05:53.625016 19449 leader_election.cc:304] T fa8650e71aa14778b3d73721fc50d9fc P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87; no voters: 
I20260709 13:05:53.626550 23072 consensus_queue.cc:1059] T 2e36a9d6e29c4a7c860cf267efbd4c74 P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:05:53.627481 19404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65d8cb8d6ec64f459d5a47cefab10acf" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
I20260709 13:05:53.627738 19411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f85fc4b527a48848e5faa083b604e36" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:05:53.628490 19409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a16f7501e2444fb86d4e2778e734e02" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
I20260709 13:05:53.628713 23072 raft_consensus.cc:2804] T fa8650e71aa14778b3d73721fc50d9fc P 0473d2b2d01f4459b1e90fd12cc7840e [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:05:53.629129 23072 raft_consensus.cc:493] T fa8650e71aa14778b3d73721fc50d9fc P 0473d2b2d01f4459b1e90fd12cc7840e [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:53.629437 23072 raft_consensus.cc:3060] T fa8650e71aa14778b3d73721fc50d9fc P 0473d2b2d01f4459b1e90fd12cc7840e [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:05:53.630226 19411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "309c3ca0ca4b4f3ba129752ea2cb293b" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:05:53.630462 19409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "172b3dd13109415a955b71ac0e9d2234" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:05:53.630836 23018 raft_consensus.cc:3055] T 2e36a9d6e29c4a7c860cf267efbd4c74 P 0473d2b2d01f4459b1e90fd12cc7840e [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:05:53.631227 23018 raft_consensus.cc:740] T 2e36a9d6e29c4a7c860cf267efbd4c74 P 0473d2b2d01f4459b1e90fd12cc7840e [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 0473d2b2d01f4459b1e90fd12cc7840e, State: Running, Role: LEADER
I20260709 13:05:53.631655 19404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ece3db938bc649d4a40a51522ed5259c" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:05:53.631951 23018 consensus_queue.cc:260] T 2e36a9d6e29c4a7c860cf267efbd4c74 P 0473d2b2d01f4459b1e90fd12cc7840e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:53.633143 23018 raft_consensus.cc:3060] T 2e36a9d6e29c4a7c860cf267efbd4c74 P 0473d2b2d01f4459b1e90fd12cc7840e [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:05:53.634891 20075 leader_election.cc:304] T 14efcc79969f41babe5529c22d59156d P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 127766fc592545a4997f7790f50f6076; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:05:53.635341 19404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4af19371ea874c09a0a2147040835cbb" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
I20260709 13:05:53.636382 19409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "833a2f0775ed407a94b8924ce50adb63" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
I20260709 13:05:53.637240 19409 raft_consensus.cc:2393] T 833a2f0775ed407a94b8924ce50adb63 P e5256d91808b47c195bc9b4dbd7f2b87 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 127766fc592545a4997f7790f50f6076 in current term 9: Already voted for candidate e5256d91808b47c195bc9b4dbd7f2b87 in this term.
I20260709 13:05:53.626052 19375 leader_election.cc:304] T 833a2f0775ed407a94b8924ce50adb63 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:05:53.638480 23190 raft_consensus.cc:2804] T 833a2f0775ed407a94b8924ce50adb63 P e5256d91808b47c195bc9b4dbd7f2b87 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:05:53.639492 23190 raft_consensus.cc:697] T 833a2f0775ed407a94b8924ce50adb63 P e5256d91808b47c195bc9b4dbd7f2b87 [term 9 LEADER]: Becoming Leader. State: Replica: e5256d91808b47c195bc9b4dbd7f2b87, State: Running, Role: LEADER
I20260709 13:05:53.640817 23179 consensus_queue.cc:1059] T 4af19371ea874c09a0a2147040835cbb P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:05:53.642112 23178 raft_consensus.cc:2764] T df751f992649444090e27965eb1af85d P e5256d91808b47c195bc9b4dbd7f2b87 [term 11 FOLLOWER]: Leader pre-election decision vote started in defunct term 10: won
I20260709 13:05:53.622337 19450 leader_election.cc:304] T a08760e15aac4630a629431f56024dc8 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e; no voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:05:53.644316 23190 consensus_queue.cc:237] T 833a2f0775ed407a94b8924ce50adb63 P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:05:53.646081 22882 raft_consensus.cc:2749] T a08760e15aac4630a629431f56024dc8 P 0473d2b2d01f4459b1e90fd12cc7840e [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:05:53.653716 19450 leader_election.cc:304] T 3e1f505cb0f1427bbd698ac889d80821 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e; no voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:05:53.654920 19450 leader_election.cc:304] T 1efebf73c86e432baa55533136b6e12c P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:05:53.655632 22882 raft_consensus.cc:2749] T 3e1f505cb0f1427bbd698ac889d80821 P 0473d2b2d01f4459b1e90fd12cc7840e [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:05:53.657114 19450 leader_election.cc:304] T 2725d2c4cb054f18b0fc8f735c15f6c2 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168; no voters: e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:05:53.547402 23104 raft_consensus.cc:2804] T 2b74109013a140ada21feeef92d6f563 P 0473d2b2d01f4459b1e90fd12cc7840e [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:05:53.660210 23104 raft_consensus.cc:493] T 2b74109013a140ada21feeef92d6f563 P 0473d2b2d01f4459b1e90fd12cc7840e [term 5 FOLLOWER]: Starting leader election (detected failure of leader e5256d91808b47c195bc9b4dbd7f2b87)
I20260709 13:05:53.660598 23104 raft_consensus.cc:3060] T 2b74109013a140ada21feeef92d6f563 P 0473d2b2d01f4459b1e90fd12cc7840e [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:05:53.542876 23050 raft_consensus.cc:697] T 0afb57ae58a24a01850491d69f0213dd P 0473d2b2d01f4459b1e90fd12cc7840e [term 10 LEADER]: Becoming Leader. State: Replica: 0473d2b2d01f4459b1e90fd12cc7840e, State: Running, Role: LEADER
I20260709 13:05:53.661545 23050 consensus_queue.cc:237] T 0afb57ae58a24a01850491d69f0213dd P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:05:53.672974 19558 raft_consensus.cc:1275] T fa731b585f684a7fb2d106c50f143b83 P e61c3a8f61bb48f8a963c9480e53c168 [term 9 FOLLOWER]: Refusing update from remote peer e5256d91808b47c195bc9b4dbd7f2b87: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 13:05:53.553678 19306 catalog_manager.cc:5697] T ff75a1d4cb1f493db8f71ddc136ba9ab P e61c3a8f61bb48f8a963c9480e53c168 reported cstate change: term changed from 5 to 6, leader changed from 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2) to e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3). New cstate: current_term: 6 leader_uuid: "e61c3a8f61bb48f8a963c9480e53c168" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } health_report { overall_health: HEALTHY } } }
I20260709 13:05:53.668459 20075 leader_election.cc:304] T 309c3ca0ca4b4f3ba129752ea2cb293b P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, 127766fc592545a4997f7790f50f6076; no voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:05:53.689916 20110 raft_consensus.cc:2468] T 5ec1c4ce15e04c7e8c283a62179f2a64 P 127766fc592545a4997f7790f50f6076 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 9.
I20260709 13:05:53.692471 20105 raft_consensus.cc:1240] T 2a16f7501e2444fb86d4e2778e734e02 P 127766fc592545a4997f7790f50f6076 [term 11 FOLLOWER]: Rejecting Update request from peer e5256d91808b47c195bc9b4dbd7f2b87 for earlier term 10. Current term is 11. Ops: []
I20260709 13:05:53.553282 23199 raft_consensus.cc:2749] T 4509b76741dc428e9201c70c1658da13 P e61c3a8f61bb48f8a963c9480e53c168 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:05:53.542771 23140 raft_consensus.cc:493] T df751f992649444090e27965eb1af85d P e61c3a8f61bb48f8a963c9480e53c168 [term 9 FOLLOWER]: Starting leader election (detected failure of leader e5256d91808b47c195bc9b4dbd7f2b87)
I20260709 13:05:53.547559 23150 raft_consensus.cc:493] T 7be9efa6559648dbb5a0f7684c4542d1 P e61c3a8f61bb48f8a963c9480e53c168 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:53.614019 23055 raft_consensus.cc:3060] T 775c229504194560ba9589bc2199b089 P e5256d91808b47c195bc9b4dbd7f2b87 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:05:53.613674 23051 raft_consensus.cc:493] T 7f575b143b844aa096b50997dad3516a P 0473d2b2d01f4459b1e90fd12cc7840e [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:53.507778 23034 consensus_queue.cc:260] T 3e1f505cb0f1427bbd698ac889d80821 P e61c3a8f61bb48f8a963c9480e53c168 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:53.666283 23038 raft_consensus.cc:2804] T 1dc5b3532fe54f74876d02beffa2c230 P 0473d2b2d01f4459b1e90fd12cc7840e [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:05:53.666779 22882 raft_consensus.cc:2804] T 1efebf73c86e432baa55533136b6e12c P 0473d2b2d01f4459b1e90fd12cc7840e [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:05:53.691845 23194 raft_consensus.cc:3055] T 40e1e16737a842ee936002830f36882e P e61c3a8f61bb48f8a963c9480e53c168 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:05:53.713317 20104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85c494af21f9457a85da47b9bc70c1fd" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:05:53.684877 23183 raft_consensus.cc:2749] T 14efcc79969f41babe5529c22d59156d P 127766fc592545a4997f7790f50f6076 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:05:53.714351 20110 raft_consensus.cc:1240] T 65d8cb8d6ec64f459d5a47cefab10acf P 127766fc592545a4997f7790f50f6076 [term 7 FOLLOWER]: Rejecting Update request from peer e5256d91808b47c195bc9b4dbd7f2b87 for earlier term 6. Current term is 7. Ops: []
I20260709 13:05:53.706521 23150 raft_consensus.cc:3060] T 7be9efa6559648dbb5a0f7684c4542d1 P e61c3a8f61bb48f8a963c9480e53c168 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:05:53.716478 20111 raft_consensus.cc:1275] T fa731b585f684a7fb2d106c50f143b83 P 127766fc592545a4997f7790f50f6076 [term 9 FOLLOWER]: Refusing update from remote peer e5256d91808b47c195bc9b4dbd7f2b87: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
W20260709 13:05:53.717512 19560 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.561s	user 0.023s	sys 0.018s
I20260709 13:05:53.553455 23089 consensus_queue.cc:1059] T e381f1d6b8184797ad142de49be225a8 P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.155s
I20260709 13:05:53.698338 23131 raft_consensus.cc:2749] T 309c3ca0ca4b4f3ba129752ea2cb293b P 127766fc592545a4997f7790f50f6076 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:05:53.725871 20111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9962423cb4e54fcfa5de01daf68a86e7" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:05:53.706748 23140 raft_consensus.cc:3060] T df751f992649444090e27965eb1af85d P e61c3a8f61bb48f8a963c9480e53c168 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:05:53.722205 19560 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.566s	user 0.023s	sys 0.018s
I20260709 13:05:53.613294 23139 raft_consensus.cc:515] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P 127766fc592545a4997f7790f50f6076 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:05:53.737520 19403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ec1c4ce15e04c7e8c283a62179f2a64" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
I20260709 13:05:53.732455 22979 raft_consensus.cc:515] T 179fd671030940b4b4a4e24bcc4aba0a P e61c3a8f61bb48f8a963c9480e53c168 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:53.713708 23083 raft_consensus.cc:3060] T 21e14947d70440f19044d8f75c31e1f9 P 0473d2b2d01f4459b1e90fd12cc7840e [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:05:53.738365 19403 raft_consensus.cc:2368] T 5ec1c4ce15e04c7e8c283a62179f2a64 P e5256d91808b47c195bc9b4dbd7f2b87 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 127766fc592545a4997f7790f50f6076 for earlier term 8. Current term is 9.
I20260709 13:05:53.739408 20110 raft_consensus.cc:1275] T 1f85fc4b527a48848e5faa083b604e36 P 127766fc592545a4997f7790f50f6076 [term 6 FOLLOWER]: Refusing update from remote peer e5256d91808b47c195bc9b4dbd7f2b87: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
W20260709 13:05:53.745379 19526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.2:46257, user_credentials={real_user=slave}} blocked reactor thread for 365941us
W20260709 13:05:53.747982 19524 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:53.734102 19306 catalog_manager.cc:5697] T d1e5873a19244c5ebbcd38e126796ee7 P e61c3a8f61bb48f8a963c9480e53c168 reported cstate change: term changed from 6 to 9, leader changed from 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2) to e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3). New cstate: current_term: 9 leader_uuid: "e61c3a8f61bb48f8a963c9480e53c168" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } health_report { overall_health: HEALTHY } } }
I20260709 13:05:53.719681 22882 raft_consensus.cc:493] T 1efebf73c86e432baa55533136b6e12c P 0473d2b2d01f4459b1e90fd12cc7840e [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:53.719156 23194 raft_consensus.cc:740] T 40e1e16737a842ee936002830f36882e P e61c3a8f61bb48f8a963c9480e53c168 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: e61c3a8f61bb48f8a963c9480e53c168, State: Running, Role: LEADER
I20260709 13:05:53.788561 19526 leader_election.cc:304] T fa8650e71aa14778b3d73721fc50d9fc P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:05:53.804013 19552 raft_consensus.cc:2468] T 179fd671030940b4b4a4e24bcc4aba0a P e61c3a8f61bb48f8a963c9480e53c168 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 9.
I20260709 13:05:53.806886 20108 raft_consensus.cc:3060] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P 127766fc592545a4997f7790f50f6076 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:05:53.740149 23034 raft_consensus.cc:3060] T 3e1f505cb0f1427bbd698ac889d80821 P e61c3a8f61bb48f8a963c9480e53c168 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:05:53.796080 20133 debug-util.cc:398] Leaking SignalData structure 0x7b0800271800 after lost signal to thread 18303
W20260709 13:05:53.839399 20133 debug-util.cc:398] Leaking SignalData structure 0x7b08000aa0a0 after lost signal to thread 19343
I20260709 13:05:53.839604 20108 raft_consensus.cc:2468] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P 127766fc592545a4997f7790f50f6076 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 11.
W20260709 13:05:53.840742 20133 debug-util.cc:398] Leaking SignalData structure 0x7b08002a9ec0 after lost signal to thread 19435
W20260709 13:05:53.842126 20133 debug-util.cc:398] Leaking SignalData structure 0x7b08003228e0 after lost signal to thread 19510
W20260709 13:05:53.842439 20133 debug-util.cc:398] Leaking SignalData structure 0x7b0800372fe0 after lost signal to thread 19511
W20260709 13:05:53.845984 19450 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.3:36891, user_credentials={real_user=slave}} blocked reactor thread for 186620us
I20260709 13:05:53.790014 22882 raft_consensus.cc:3060] T 1efebf73c86e432baa55533136b6e12c P 0473d2b2d01f4459b1e90fd12cc7840e [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:05:53.851657 20133 debug-util.cc:398] Leaking SignalData structure 0x7b080036fde0 after lost signal to thread 19584
W20260709 13:05:53.846006 19449 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.1:40321, user_credentials={real_user=slave}} blocked reactor thread for 221035us
W20260709 13:05:53.852836 20133 debug-util.cc:398] Leaking SignalData structure 0x7b08002eae40 after lost signal to thread 20136
W20260709 13:05:53.856750 20133 debug-util.cc:398] Leaking SignalData structure 0x7b080039e3a0 after lost signal to thread 20137
W20260709 13:05:53.857365 20133 debug-util.cc:398] Leaking SignalData structure 0x7b08003b16e0 after lost signal to thread 22912
W20260709 13:05:53.857978 20133 debug-util.cc:398] Leaking SignalData structure 0x7b0800325840 after lost signal to thread 23049
W20260709 13:05:53.858317 20133 debug-util.cc:398] Leaking SignalData structure 0x7b0800337480 after lost signal to thread 23054
W20260709 13:05:53.858789 20133 debug-util.cc:398] Leaking SignalData structure 0x7b08003cd5c0 after lost signal to thread 23075
W20260709 13:05:53.859136 20133 debug-util.cc:398] Leaking SignalData structure 0x7b080038cda0 after lost signal to thread 23084
W20260709 13:05:53.859844 20133 debug-util.cc:398] Leaking SignalData structure 0x7b0800060f80 after lost signal to thread 23137
W20260709 13:05:53.860334 20133 debug-util.cc:398] Leaking SignalData structure 0x7b08002e2340 after lost signal to thread 23149
W20260709 13:05:53.860729 20133 debug-util.cc:398] Leaking SignalData structure 0x7b08003e4de0 after lost signal to thread 23154
I20260709 13:05:53.869114 20075 leader_election.cc:400] T 5ec1c4ce15e04c7e8c283a62179f2a64 P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 8 election: Vote denied by peer e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321) with higher term. Message: Invalid argument: T 5ec1c4ce15e04c7e8c283a62179f2a64 P e5256d91808b47c195bc9b4dbd7f2b87 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 127766fc592545a4997f7790f50f6076 for earlier term 8. Current term is 9.
I20260709 13:05:53.869225 19405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "775c229504194560ba9589bc2199b089" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:05:53.869606 20075 leader_election.cc:403] T 5ec1c4ce15e04c7e8c283a62179f2a64 P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 8 election: Cancelling election due to peer responding with higher term
I20260709 13:05:53.718467 23051 raft_consensus.cc:515] T 7f575b143b844aa096b50997dad3516a P 0473d2b2d01f4459b1e90fd12cc7840e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
W20260709 13:05:53.871102 19526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.2:46257, user_credentials={real_user=slave}} blocked reactor thread for 82625.9us
I20260709 13:05:53.874735 23214 raft_consensus.cc:493] T ed7fdbcb96d14d418db9ca90a792588a P e61c3a8f61bb48f8a963c9480e53c168 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 0473d2b2d01f4459b1e90fd12cc7840e)
I20260709 13:05:53.877789 23183 raft_consensus.cc:2749] T 5ec1c4ce15e04c7e8c283a62179f2a64 P 127766fc592545a4997f7790f50f6076 [term 9 FOLLOWER]: Leader election lost for term 8. Reason: Vote denied by peer e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321) with higher term. Message: Invalid argument: T 5ec1c4ce15e04c7e8c283a62179f2a64 P e5256d91808b47c195bc9b4dbd7f2b87 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 127766fc592545a4997f7790f50f6076 for earlier term 8. Current term is 9.
I20260709 13:05:53.877851 19407 raft_consensus.cc:2468] T b08304a0a02b42d7840c4e8ee9a6bd1a P e5256d91808b47c195bc9b4dbd7f2b87 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 12.
I20260709 13:05:53.883677 22882 raft_consensus.cc:515] T 1efebf73c86e432baa55533136b6e12c P 0473d2b2d01f4459b1e90fd12cc7840e [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:05:53.886545 23190 raft_consensus.cc:493] T 309c3ca0ca4b4f3ba129752ea2cb293b P e5256d91808b47c195bc9b4dbd7f2b87 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 0473d2b2d01f4459b1e90fd12cc7840e)
I20260709 13:05:53.887880 23208 raft_consensus.cc:2804] T fa8650e71aa14778b3d73721fc50d9fc P e61c3a8f61bb48f8a963c9480e53c168 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:05:53.907248 23208 raft_consensus.cc:493] T fa8650e71aa14778b3d73721fc50d9fc P e61c3a8f61bb48f8a963c9480e53c168 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:53.907768 23208 raft_consensus.cc:3060] T fa8650e71aa14778b3d73721fc50d9fc P e61c3a8f61bb48f8a963c9480e53c168 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:05:53.907203 23190 raft_consensus.cc:515] T 309c3ca0ca4b4f3ba129752ea2cb293b P e5256d91808b47c195bc9b4dbd7f2b87 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } attrs { replace: true } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:05:53.912616 22882 leader_election.cc:290] T 1efebf73c86e432baa55533136b6e12c P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 9 election: Requested vote from peers e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:05:53.888140 23018 raft_consensus.cc:2804] T 2725d2c4cb054f18b0fc8f735c15f6c2 P 0473d2b2d01f4459b1e90fd12cc7840e [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:05:53.891096 22821 leader_election.cc:290] T 76cb037fc9064d13b59a8969d897ce8c P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 9 election: Requested vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:05:53.898198 19306 catalog_manager.cc:5697] T ed7fdbcb96d14d418db9ca90a792588a P e61c3a8f61bb48f8a963c9480e53c168 reported cstate change: term changed from 3 to 4, leader changed from 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2) to e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3). New cstate: current_term: 4 leader_uuid: "e61c3a8f61bb48f8a963c9480e53c168" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:05:53.902158 19523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.1:40321, user_credentials={real_user=slave}} blocked reactor thread for 360406us
I20260709 13:05:53.932051 19523 leader_election.cc:304] T 85c494af21f9457a85da47b9bc70c1fd P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168; no voters: 127766fc592545a4997f7790f50f6076
I20260709 13:05:53.925487 19526 leader_election.cc:400] T b08304a0a02b42d7840c4e8ee9a6bd1a P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 11 pre-election: Vote denied by peer 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257) with higher term. Message: Invalid argument: T b08304a0a02b42d7840c4e8ee9a6bd1a P 0473d2b2d01f4459b1e90fd12cc7840e [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e61c3a8f61bb48f8a963c9480e53c168 for earlier term 11. Current term is 12.
I20260709 13:05:53.934808 19526 leader_election.cc:304] T 14935b3ddf914369822e4a0547aaa355 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168; no voters: 127766fc592545a4997f7790f50f6076
I20260709 13:05:53.936206 19523 leader_election.cc:304] T e381f1d6b8184797ad142de49be225a8 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168; no voters: 0473d2b2d01f4459b1e90fd12cc7840e
W20260709 13:05:53.936653 19375 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.3:36891, user_credentials={real_user=slave}} blocked reactor thread for 264764us
I20260709 13:05:53.812062 23189 consensus_queue.cc:1048] T ef32ce6fdd0e40d382c79974f30295c6 P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.113s
I20260709 13:05:53.944316 19551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76cb037fc9064d13b59a8969d897ce8c" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
W20260709 13:05:53.946269 20078 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:53.952253 19556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "309c3ca0ca4b4f3ba129752ea2cb293b" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:05:53.955253 19551 raft_consensus.cc:3060] T 76cb037fc9064d13b59a8969d897ce8c P e61c3a8f61bb48f8a963c9480e53c168 [term 7 FOLLOWER]: Advancing to term 9
I20260709 13:05:53.924736 22830 raft_consensus.cc:2764] T b08304a0a02b42d7840c4e8ee9a6bd1a P e5256d91808b47c195bc9b4dbd7f2b87 [term 12 FOLLOWER]: Leader pre-election decision vote started in defunct term 11: won
I20260709 13:05:53.935328 23018 raft_consensus.cc:493] T 2725d2c4cb054f18b0fc8f735c15f6c2 P 0473d2b2d01f4459b1e90fd12cc7840e [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:53.985147 22821 consensus_queue.cc:1048] T fa731b585f684a7fb2d106c50f143b83 P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:05:54.005869 23146 raft_consensus.cc:493] T 96efeaaf1057492490e9a621f37e1a2d P e61c3a8f61bb48f8a963c9480e53c168 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:54.006389 23146 raft_consensus.cc:515] T 96efeaaf1057492490e9a621f37e1a2d P e61c3a8f61bb48f8a963c9480e53c168 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:05:54.008476 23146 leader_election.cc:290] T 96efeaaf1057492490e9a621f37e1a2d P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:05:53.994549 23072 raft_consensus.cc:515] T fa8650e71aa14778b3d73721fc50d9fc P 0473d2b2d01f4459b1e90fd12cc7840e [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:54.010104 19551 raft_consensus.cc:2468] T 76cb037fc9064d13b59a8969d897ce8c P e61c3a8f61bb48f8a963c9480e53c168 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 9.
I20260709 13:05:54.017441 23018 raft_consensus.cc:3060] T 2725d2c4cb054f18b0fc8f735c15f6c2 P 0473d2b2d01f4459b1e90fd12cc7840e [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:05:53.987949 23027 consensus_meta.cc:287] T f93ee515a9c14139bf566522ed8232f3 P 0473d2b2d01f4459b1e90fd12cc7840e: Time spent flushing consensus metadata: real 0.503s	user 0.008s	sys 0.000s
I20260709 13:05:54.018263 23027 raft_consensus.cc:515] T f93ee515a9c14139bf566522ed8232f3 P 0473d2b2d01f4459b1e90fd12cc7840e [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:54.020291 23027 leader_election.cc:290] T f93ee515a9c14139bf566522ed8232f3 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 13 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:05:54.020882 19479 raft_consensus.cc:1240] T f93ee515a9c14139bf566522ed8232f3 P 0473d2b2d01f4459b1e90fd12cc7840e [term 13 FOLLOWER]: Rejecting Update request from peer e61c3a8f61bb48f8a963c9480e53c168 for earlier term 12. Current term is 13. Ops: []
I20260709 13:05:54.023057 23072 leader_election.cc:290] T fa8650e71aa14778b3d73721fc50d9fc P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 11 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:05:54.024940 23104 raft_consensus.cc:515] T 2b74109013a140ada21feeef92d6f563 P 0473d2b2d01f4459b1e90fd12cc7840e [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:54.027153 23222 consensus_queue.cc:1059] T f1b10566f45d4a7d9029858330e02d5b P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:05:54.027944 22964 consensus_queue.cc:1059] T edd7d470b5014c9489be7f41f64355c9 P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:05:53.984663 19306 catalog_manager.cc:5697] T f93ee515a9c14139bf566522ed8232f3 P e61c3a8f61bb48f8a963c9480e53c168 reported cstate change: term changed from 7 to 9. New cstate: current_term: 9 leader_uuid: "e61c3a8f61bb48f8a963c9480e53c168" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } health_report { overall_health: HEALTHY } } }
I20260709 13:05:54.031476 23139 leader_election.cc:290] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:05:53.929605 22882 consensus_queue.cc:1048] T 7be9efa6559648dbb5a0f7684c4542d1 P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.052s
I20260709 13:05:53.932539 23214 raft_consensus.cc:515] T ed7fdbcb96d14d418db9ca90a792588a P e61c3a8f61bb48f8a963c9480e53c168 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:05:54.034222 22882 raft_consensus.cc:3055] T edd7d470b5014c9489be7f41f64355c9 P 0473d2b2d01f4459b1e90fd12cc7840e [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:05:54.036836 22882 raft_consensus.cc:740] T edd7d470b5014c9489be7f41f64355c9 P 0473d2b2d01f4459b1e90fd12cc7840e [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 0473d2b2d01f4459b1e90fd12cc7840e, State: Running, Role: LEADER
I20260709 13:05:54.037804 19374 leader_election.cc:304] T 5ec1c4ce15e04c7e8c283a62179f2a64 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 127766fc592545a4997f7790f50f6076, e5256d91808b47c195bc9b4dbd7f2b87; no voters: 
W20260709 13:05:53.997493 23201 log.cc:927] Time spent T 1f85fc4b527a48848e5faa083b604e36 P e5256d91808b47c195bc9b4dbd7f2b87: Append to log took a long time: real 0.119s	user 0.000s	sys 0.001s
I20260709 13:05:54.037804 22882 consensus_queue.cc:260] T edd7d470b5014c9489be7f41f64355c9 P 0473d2b2d01f4459b1e90fd12cc7840e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 10.5, Last appended by leader: 5, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
W20260709 13:05:53.969033 22974 consensus_meta.cc:287] T 86a6797bdfe94fa496c050ceae4bd0d9 P e61c3a8f61bb48f8a963c9480e53c168: Time spent flushing consensus metadata: real 0.597s	user 0.013s	sys 0.008s
I20260709 13:05:53.995029 23210 raft_consensus.cc:2804] T 14935b3ddf914369822e4a0547aaa355 P e61c3a8f61bb48f8a963c9480e53c168 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:05:54.017504 19560 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41504 (request call id 539) took 1232 ms. Trace:
I20260709 13:05:53.989821 22979 leader_election.cc:290] T 179fd671030940b4b4a4e24bcc4aba0a P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 9 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:05:54.034426 23214 leader_election.cc:290] T ed7fdbcb96d14d418db9ca90a792588a P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:05:53.938076 23194 consensus_queue.cc:260] T 40e1e16737a842ee936002830f36882e P e61c3a8f61bb48f8a963c9480e53c168 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 12.6, Last appended by leader: 6, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:53.994879 23093 raft_consensus.cc:2804] T 85c494af21f9457a85da47b9bc70c1fd P e61c3a8f61bb48f8a963c9480e53c168 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:05:54.041167 19408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36f6ba92b9ba46babe4ebd6c02e5fbd9" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
W20260709 13:05:53.989004 22978 consensus_meta.cc:287] T b9f0d59553ad444883fcf5b5909f9798 P 0473d2b2d01f4459b1e90fd12cc7840e: Time spent flushing consensus metadata: real 0.530s	user 0.006s	sys 0.002s
I20260709 13:05:54.042526 19374 leader_election.cc:304] T 85c494af21f9457a85da47b9bc70c1fd P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87; no voters: 127766fc592545a4997f7790f50f6076, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:05:53.998646 23209 raft_consensus.cc:2804] T e381f1d6b8184797ad142de49be225a8 P e61c3a8f61bb48f8a963c9480e53c168 [term 8 FOLLOWER]: Leader election won for term 8
W20260709 13:05:54.040215 23213 log.cc:927] Time spent T 7be9efa6559648dbb5a0f7684c4542d1 P 127766fc592545a4997f7790f50f6076: Append to log took a long time: real 0.054s	user 0.000s	sys 0.001s
I20260709 13:05:54.050755 23178 raft_consensus.cc:2804] T 5ec1c4ce15e04c7e8c283a62179f2a64 P e5256d91808b47c195bc9b4dbd7f2b87 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:05:54.064728 20105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "309c3ca0ca4b4f3ba129752ea2cb293b" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
W20260709 13:05:54.088023 19450 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.3:36891, user_credentials={real_user=slave}} blocked reactor thread for 238304us
I20260709 13:05:54.092682 20105 raft_consensus.cc:2393] T 309c3ca0ca4b4f3ba129752ea2cb293b P 127766fc592545a4997f7790f50f6076 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e5256d91808b47c195bc9b4dbd7f2b87 in current term 8: Already voted for candidate 127766fc592545a4997f7790f50f6076 in this term.
W20260709 13:05:54.046036 23088 consensus_meta.cc:287] T 7f575b143b844aa096b50997dad3516a P e5256d91808b47c195bc9b4dbd7f2b87: Time spent flushing consensus metadata: real 0.503s	user 0.008s	sys 0.000s
I20260709 13:05:54.047113 23139 raft_consensus.cc:493] T 6c5eebf646ad445a9d1b1adc319d7b16 P 127766fc592545a4997f7790f50f6076 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:54.085022 19408 raft_consensus.cc:2393] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P e5256d91808b47c195bc9b4dbd7f2b87 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 127766fc592545a4997f7790f50f6076 in current term 11: Already voted for candidate e5256d91808b47c195bc9b4dbd7f2b87 in this term.
I20260709 13:05:54.076315 19560 rpcz_store.cc:276] 0709 13:05:52.784976 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:53.155009 (+370033us) service_pool.cc:224] Handling call
0709 13:05:53.155288 (+   279us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:05:53.155633 (+   345us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:05:53.155664 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:05:53.156103 (+   439us) log.cc:844] Serialized 26 byte log entry
0709 13:05:53.727314 (+571211us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:05:53.727355 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:53.727414 (+    59us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:05:54.017303 (+289889us) raft_consensus.cc:1685] finished
0709 13:05:54.017325 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:54.017450 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":937,"raft.run_cpu_time_us":82,"raft.run_wall_time_us":82,"thread_start_us":570808,"threads_started":1,"wal-append.queue_time_us":741128}
I20260709 13:05:54.089956 19479 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58286 (request call id 1841) took 1120 ms. Trace:
W20260709 13:05:54.104202 19374 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.4:43121, user_credentials={real_user=slave}} blocked reactor thread for 61742.5us
I20260709 13:05:54.107117 19479 rpcz_store.cc:276] 0709 13:05:52.969302 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:53.371147 (+401845us) service_pool.cc:224] Handling call
0709 13:05:53.371401 (+   254us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:54.021266 (+649865us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:54.089668 (+ 68402us) spinlock_profiling.cc:243] Waited 649 ms on lock 0x7b54000edb54. stack: 00007f4a79de9343 00007f4a79de9240 00007f4a797781d4 00007f4a834b6304 00007f4a834b6299 00007f4a7ce71571 00007f4a7cf08e01 00007f4a7cf0783e 00007f4a81ecc419 00007f4a7b443bd4 00007f4a7b443b62 00007f4a7b443a91 00007f4a7b443a0c 00007f4a7b442cc2 00007f4a7b24348c 00007f4a7b2428c6
0709 13:05:54.089885 (+   217us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1493314944}
I20260709 13:05:54.109376 23190 leader_election.cc:290] T 309c3ca0ca4b4f3ba129752ea2cb293b P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:05:54.114828 23072 consensus_queue.cc:1059] T 62c6c134d3d24a1ab144dd9ee6bc3f64 P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 }, Status: INVALID_TERM, Last received: 8.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:05:54.091379 22978 raft_consensus.cc:515] T b9f0d59553ad444883fcf5b5909f9798 P 0473d2b2d01f4459b1e90fd12cc7840e [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:54.115957 23072 raft_consensus.cc:3055] T 62c6c134d3d24a1ab144dd9ee6bc3f64 P 0473d2b2d01f4459b1e90fd12cc7840e [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:05:54.116330 23072 raft_consensus.cc:740] T 62c6c134d3d24a1ab144dd9ee6bc3f64 P 0473d2b2d01f4459b1e90fd12cc7840e [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 0473d2b2d01f4459b1e90fd12cc7840e, State: Running, Role: LEADER
I20260709 13:05:54.117146 22978 leader_election.cc:290] T b9f0d59553ad444883fcf5b5909f9798 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 9 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:05:54.117118 23072 consensus_queue.cc:260] T 62c6c134d3d24a1ab144dd9ee6bc3f64 P 0473d2b2d01f4459b1e90fd12cc7840e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:05:54.118753 23220 raft_consensus.cc:493] T 172b3dd13109415a955b71ac0e9d2234 P 0473d2b2d01f4459b1e90fd12cc7840e [term 8 FOLLOWER]: Starting pre-election (detected failure of leader e5256d91808b47c195bc9b4dbd7f2b87)
I20260709 13:05:54.119252 23220 raft_consensus.cc:515] T 172b3dd13109415a955b71ac0e9d2234 P 0473d2b2d01f4459b1e90fd12cc7840e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:05:54.119689 23225 raft_consensus.cc:2749] T 85c494af21f9457a85da47b9bc70c1fd P e5256d91808b47c195bc9b4dbd7f2b87 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:05:54.121383 23220 leader_election.cc:290] T 172b3dd13109415a955b71ac0e9d2234 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:05:54.118523 23072 raft_consensus.cc:3060] T 62c6c134d3d24a1ab144dd9ee6bc3f64 P 0473d2b2d01f4459b1e90fd12cc7840e [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:05:54.084568 23093 raft_consensus.cc:493] T 85c494af21f9457a85da47b9bc70c1fd P e61c3a8f61bb48f8a963c9480e53c168 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 127766fc592545a4997f7790f50f6076)
I20260709 13:05:54.128759 23093 raft_consensus.cc:3060] T 85c494af21f9457a85da47b9bc70c1fd P e61c3a8f61bb48f8a963c9480e53c168 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:05:54.129977 23147 consensus_meta.cc:287] T ab43d85f64114d4ebf618930e43d9ed0 P e61c3a8f61bb48f8a963c9480e53c168: Time spent flushing consensus metadata: real 0.650s	user 0.006s	sys 0.003s
I20260709 13:05:54.130614 23147 raft_consensus.cc:2749] T ab43d85f64114d4ebf618930e43d9ed0 P e61c3a8f61bb48f8a963c9480e53c168 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:05:54.132980 19374 leader_election.cc:304] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 127766fc592545a4997f7790f50f6076, e5256d91808b47c195bc9b4dbd7f2b87; no voters: 
I20260709 13:05:54.135059 19450 leader_election.cc:304] T ab43d85f64114d4ebf618930e43d9ed0 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, 127766fc592545a4997f7790f50f6076, e61c3a8f61bb48f8a963c9480e53c168; no voters: e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:05:54.135205 23218 consensus_queue.cc:1059] T 65d8cb8d6ec64f459d5a47cefab10acf P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:05:54.136384 23027 raft_consensus.cc:2764] T ab43d85f64114d4ebf618930e43d9ed0 P 0473d2b2d01f4459b1e90fd12cc7840e [term 9 FOLLOWER]: Leader pre-election decision vote started in defunct term 8: won
I20260709 13:05:54.136597 23218 consensus_queue.cc:1048] T fa731b585f684a7fb2d106c50f143b83 P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Connected to new peer: Peer: permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:05:54.138482 23179 consensus_queue.cc:1048] T 1f85fc4b527a48848e5faa083b604e36 P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Connected to new peer: Peer: permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:05:54.140642 19479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff9b0eddd810459b82d91c60777c10eb" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:05:54.140854 23179 raft_consensus.cc:2804] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P e5256d91808b47c195bc9b4dbd7f2b87 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:05:54.141229 19479 raft_consensus.cc:2468] T ff9b0eddd810459b82d91c60777c10eb P 0473d2b2d01f4459b1e90fd12cc7840e [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 127766fc592545a4997f7790f50f6076 in term 8.
I20260709 13:05:54.141578 23179 raft_consensus.cc:697] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P e5256d91808b47c195bc9b4dbd7f2b87 [term 11 LEADER]: Becoming Leader. State: Replica: e5256d91808b47c195bc9b4dbd7f2b87, State: Running, Role: LEADER
I20260709 13:05:54.142751 19555 raft_consensus.cc:1275] T 3e1f505cb0f1427bbd698ac889d80821 P e61c3a8f61bb48f8a963c9480e53c168 [term 10 FOLLOWER]: Refusing update from remote peer e5256d91808b47c195bc9b4dbd7f2b87: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:05:54.143601 23223 raft_consensus.cc:3055] T 65d8cb8d6ec64f459d5a47cefab10acf P e5256d91808b47c195bc9b4dbd7f2b87 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:05:54.144111 23223 raft_consensus.cc:740] T 65d8cb8d6ec64f459d5a47cefab10acf P e5256d91808b47c195bc9b4dbd7f2b87 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: e5256d91808b47c195bc9b4dbd7f2b87, State: Running, Role: LEADER
I20260709 13:05:54.145184 23223 consensus_queue.cc:260] T 65d8cb8d6ec64f459d5a47cefab10acf P e5256d91808b47c195bc9b4dbd7f2b87 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.6, Last appended by leader: 6, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:05:54.147109 19480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0afb57ae58a24a01850491d69f0213dd" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:05:54.146925 23139 raft_consensus.cc:515] T 6c5eebf646ad445a9d1b1adc319d7b16 P 127766fc592545a4997f7790f50f6076 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:05:54.148563 19480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f85fc4b527a48848e5faa083b604e36" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:05:54.149055 23139 leader_election.cc:290] T 6c5eebf646ad445a9d1b1adc319d7b16 P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:05:54.149132 19480 raft_consensus.cc:2468] T 1f85fc4b527a48848e5faa083b604e36 P 0473d2b2d01f4459b1e90fd12cc7840e [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 127766fc592545a4997f7790f50f6076 in term 6.
I20260709 13:05:54.076244 23210 raft_consensus.cc:493] T 14935b3ddf914369822e4a0547aaa355 P e61c3a8f61bb48f8a963c9480e53c168 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 127766fc592545a4997f7790f50f6076)
I20260709 13:05:54.142794 19479 raft_consensus.cc:1240] T 1efebf73c86e432baa55533136b6e12c P 0473d2b2d01f4459b1e90fd12cc7840e [term 9 FOLLOWER]: Rejecting Update request from peer 127766fc592545a4997f7790f50f6076 for earlier term 8. Current term is 9. Ops: []
I20260709 13:05:54.153962 19480 raft_consensus.cc:1275] T 96efeaaf1057492490e9a621f37e1a2d P 0473d2b2d01f4459b1e90fd12cc7840e [term 10 FOLLOWER]: Refusing update from remote peer 127766fc592545a4997f7790f50f6076: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:05:54.154940 19486 raft_consensus.cc:2468] T 21e14947d70440f19044d8f75c31e1f9 P 0473d2b2d01f4459b1e90fd12cc7840e [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 9.
I20260709 13:05:54.150419 19306 catalog_manager.cc:5697] T edd7d470b5014c9489be7f41f64355c9 P e61c3a8f61bb48f8a963c9480e53c168 reported cstate change: term changed from 3 to 7, leader changed from 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2) to e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3). New cstate: current_term: 7 leader_uuid: "e61c3a8f61bb48f8a963c9480e53c168" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } health_report { overall_health: HEALTHY } } }
I20260709 13:05:54.093233 23194 raft_consensus.cc:3060] T 40e1e16737a842ee936002830f36882e P e61c3a8f61bb48f8a963c9480e53c168 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:05:54.087649 23104 leader_election.cc:290] T 2b74109013a140ada21feeef92d6f563 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 6 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:05:54.158318 19484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "172b3dd13109415a955b71ac0e9d2234" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:05:54.107658 23209 raft_consensus.cc:697] T e381f1d6b8184797ad142de49be225a8 P e61c3a8f61bb48f8a963c9480e53c168 [term 8 LEADER]: Becoming Leader. State: Replica: e61c3a8f61bb48f8a963c9480e53c168, State: Running, Role: LEADER
I20260709 13:05:54.054308 22859 consensus_queue.cc:1059] T 2a16f7501e2444fb86d4e2778e734e02 P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.054s
I20260709 13:05:54.061873 22974 raft_consensus.cc:515] T 86a6797bdfe94fa496c050ceae4bd0d9 P e61c3a8f61bb48f8a963c9480e53c168 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:54.163342 19306 catalog_manager.cc:5697] T 48824d5acfbc485ebf8c2d944e7202de P e61c3a8f61bb48f8a963c9480e53c168 reported cstate change: term changed from 4 to 7, leader changed from 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2) to e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3). New cstate: current_term: 7 leader_uuid: "e61c3a8f61bb48f8a963c9480e53c168" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:54.167275 19484 raft_consensus.cc:2468] T 172b3dd13109415a955b71ac0e9d2234 P 0473d2b2d01f4459b1e90fd12cc7840e [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 127766fc592545a4997f7790f50f6076 in term 8.
I20260709 13:05:54.171600 19306 catalog_manager.cc:5697] T 3e1f505cb0f1427bbd698ac889d80821 P e61c3a8f61bb48f8a963c9480e53c168 reported cstate change: term changed from 4 to 8, leader changed from e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3) to e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1). New cstate: current_term: 8 leader_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } }
I20260709 13:05:54.180501 19484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "775c229504194560ba9589bc2199b089" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:05:54.181286 19484 raft_consensus.cc:2376] T 775c229504194560ba9589bc2199b089 P 0473d2b2d01f4459b1e90fd12cc7840e [term 8 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 127766fc592545a4997f7790f50f6076 in term 8. Re-sending same reply.
I20260709 13:05:54.184890 19484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36f6ba92b9ba46babe4ebd6c02e5fbd9" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:05:54.185587 19484 raft_consensus.cc:2468] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P 0473d2b2d01f4459b1e90fd12cc7840e [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 127766fc592545a4997f7790f50f6076 in term 10.
I20260709 13:05:54.188813 19484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c5eebf646ad445a9d1b1adc319d7b16" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
W20260709 13:05:54.190059 19524 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:54.190965 20078 leader_election.cc:304] T 48824d5acfbc485ebf8c2d944e7202de P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, 127766fc592545a4997f7790f50f6076; no voters: e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:05:54.194103 19555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a61655d99124a29b486ba4a5b37faea" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:05:54.198787 19560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0afb57ae58a24a01850491d69f0213dd" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:05:54.203893 19484 raft_consensus.cc:2410] T 6c5eebf646ad445a9d1b1adc319d7b16 P 0473d2b2d01f4459b1e90fd12cc7840e [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 127766fc592545a4997f7790f50f6076 for term 9 because replica has last-logged OpId of term: 7 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 7.
I20260709 13:05:54.158775 23210 raft_consensus.cc:3060] T 14935b3ddf914369822e4a0547aaa355 P e61c3a8f61bb48f8a963c9480e53c168 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:05:54.155719 23178 raft_consensus.cc:697] T 5ec1c4ce15e04c7e8c283a62179f2a64 P e5256d91808b47c195bc9b4dbd7f2b87 [term 9 LEADER]: Becoming Leader. State: Replica: e5256d91808b47c195bc9b4dbd7f2b87, State: Running, Role: LEADER
I20260709 13:05:54.204559 19306 catalog_manager.cc:5697] T 179fd671030940b4b4a4e24bcc4aba0a P e61c3a8f61bb48f8a963c9480e53c168 reported cstate change: term changed from 3 to 6, leader changed from 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2) to e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3). New cstate: current_term: 6 leader_uuid: "e61c3a8f61bb48f8a963c9480e53c168" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } health_report { overall_health: HEALTHY } } }
I20260709 13:05:54.153657 23088 raft_consensus.cc:515] T 7f575b143b844aa096b50997dad3516a P e5256d91808b47c195bc9b4dbd7f2b87 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:54.206022 23153 raft_consensus.cc:2764] T 48824d5acfbc485ebf8c2d944e7202de P 127766fc592545a4997f7790f50f6076 [term 10 FOLLOWER]: Leader pre-election decision vote started in defunct term 9: won
I20260709 13:05:54.208891 23088 leader_election.cc:290] T 7f575b143b844aa096b50997dad3516a P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 6 election: Requested vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:05:54.209892 19408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "775c229504194560ba9589bc2199b089" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
W20260709 13:05:54.214954 19452 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:54.217666 19559 raft_consensus.cc:2393] T 86a6797bdfe94fa496c050ceae4bd0d9 P e61c3a8f61bb48f8a963c9480e53c168 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e5256d91808b47c195bc9b4dbd7f2b87 in current term 10: Already voted for candidate e61c3a8f61bb48f8a963c9480e53c168 in this term.
I20260709 13:05:54.164529 23223 raft_consensus.cc:3060] T 65d8cb8d6ec64f459d5a47cefab10acf P e5256d91808b47c195bc9b4dbd7f2b87 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:05:54.218988 19486 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58286 (request call id 1833) took 1251 ms. Trace:
I20260709 13:05:54.219350 19486 rpcz_store.cc:276] 0709 13:05:52.967124 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:53.340043 (+372919us) service_pool.cc:224] Handling call
0709 13:05:54.218839 (+878796us) spinlock_profiling.cc:243] Waited 644 ms on lock 0x7b540035d9d4. stack: 00007f4a79de9343 00007f4a79de9240 00007f4a797781d4 00007f4a834b6304 00007f4a834b6299 00007f4a7ce71571 00007f4a7cf0c2fa 00007f4a81ecdb17 00007f4a7b4486d4 00007f4a7b448662 00007f4a7b448591 00007f4a7b44850c 00007f4a7b4477c2 00007f4a7b24348c 00007f4a7b2428c6 00007f4a7b24226f
0709 13:05:54.218938 (+    99us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1481947520}
I20260709 13:05:54.199487 19560 raft_consensus.cc:2376] T 0afb57ae58a24a01850491d69f0213dd P e61c3a8f61bb48f8a963c9480e53c168 [term 10 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 10. Re-sending same reply.
W20260709 13:05:54.228869 19526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.2:46257, user_credentials={real_user=slave}} blocked reactor thread for 294134us
I20260709 13:05:54.230099 19560 raft_consensus.cc:1240] T 6c5eebf646ad445a9d1b1adc319d7b16 P e61c3a8f61bb48f8a963c9480e53c168 [term 8 LEADER]: Rejecting Update request from peer 0473d2b2d01f4459b1e90fd12cc7840e for earlier term 7. Current term is 8. Ops: []
I20260709 13:05:54.232759 19526 leader_election.cc:304] T ef32ce6fdd0e40d382c79974f30295c6 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168; no voters: e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:05:54.236115 18300 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:05:54.237425 19526 leader_election.cc:304] T f1b10566f45d4a7d9029858330e02d5b P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e61c3a8f61bb48f8a963c9480e53c168; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:05:54.232760 20078 leader_election.cc:304] T 0e1085d23e8347fbbd5bce7542f4b1f4 P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, 127766fc592545a4997f7790f50f6076; no voters: e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:05:54.234464 19555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa8650e71aa14778b3d73721fc50d9fc" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
W20260709 13:05:54.235204 19523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.1:40321, user_credentials={real_user=slave}} blocked reactor thread for 299087us
I20260709 13:05:54.241211 19526 leader_election.cc:304] T a08760e15aac4630a629431f56024dc8 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168; no voters: e5256d91808b47c195bc9b4dbd7f2b87
W20260709 13:05:54.244860 19449 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.1:40321, user_credentials={real_user=slave}} blocked reactor thread for 388697us
I20260709 13:05:54.245046 19526 leader_election.cc:304] T 2b74109013a140ada21feeef92d6f563 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168; no voters: e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:05:54.162392 23208 raft_consensus.cc:515] T fa8650e71aa14778b3d73721fc50d9fc P e61c3a8f61bb48f8a963c9480e53c168 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
W20260709 13:05:54.247319 19375 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.3:36891, user_credentials={real_user=slave}} blocked reactor thread for 269018us
I20260709 13:05:54.240659 19523 leader_election.cc:304] T edd7d470b5014c9489be7f41f64355c9 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:05:54.256052 20112 raft_consensus.cc:1275] T 6c5eebf646ad445a9d1b1adc319d7b16 P 127766fc592545a4997f7790f50f6076 [term 8 FOLLOWER]: Refusing update from remote peer e61c3a8f61bb48f8a963c9480e53c168: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
W20260709 13:05:54.261183 19523 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:54.264631 19554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0afb57ae58a24a01850491d69f0213dd" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:05:54.266296 19558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a16f7501e2444fb86d4e2778e734e02" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:05:54.269595 19553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ece3db938bc649d4a40a51522ed5259c" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:05:54.273193 19553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4af19371ea874c09a0a2147040835cbb" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:05:54.273959 20103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed7fdbcb96d14d418db9ca90a792588a" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:05:54.274832 20103 raft_consensus.cc:2468] T ed7fdbcb96d14d418db9ca90a792588a P 127766fc592545a4997f7790f50f6076 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 6.
I20260709 13:05:54.275590 20104 raft_consensus.cc:1275] T 48824d5acfbc485ebf8c2d944e7202de P 127766fc592545a4997f7790f50f6076 [term 10 FOLLOWER]: Refusing update from remote peer e61c3a8f61bb48f8a963c9480e53c168: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:05:54.278290 19558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c5eebf646ad445a9d1b1adc319d7b16" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:05:54.164695 23179 consensus_queue.cc:237] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:05:54.280575 19552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65d8cb8d6ec64f459d5a47cefab10acf" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:05:54.281368 19554 raft_consensus.cc:2393] T 0afb57ae58a24a01850491d69f0213dd P e61c3a8f61bb48f8a963c9480e53c168 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 127766fc592545a4997f7790f50f6076 in current term 10: Already voted for candidate 0473d2b2d01f4459b1e90fd12cc7840e in this term.
I20260709 13:05:54.277516 19449 leader_election.cc:304] T df751f992649444090e27965eb1af85d P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87; no voters: 
I20260709 13:05:54.284085 19555 raft_consensus.cc:2393] T fa8650e71aa14778b3d73721fc50d9fc P e61c3a8f61bb48f8a963c9480e53c168 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0473d2b2d01f4459b1e90fd12cc7840e in current term 11: Already voted for candidate e61c3a8f61bb48f8a963c9480e53c168 in this term.
I20260709 13:05:54.254827 23066 raft_consensus.cc:2749] T f1b10566f45d4a7d9029858330e02d5b P e61c3a8f61bb48f8a963c9480e53c168 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:05:54.285168 20106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96efeaaf1057492490e9a621f37e1a2d" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:05:54.288646 19560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "833a2f0775ed407a94b8924ce50adb63" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:05:54.293736 19449 leader_election.cc:304] T b08304a0a02b42d7840c4e8ee9a6bd1a P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87; no voters: 
I20260709 13:05:54.234426 23218 consensus_queue.cc:1048] T 2725d2c4cb054f18b0fc8f735c15f6c2 P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.052s
I20260709 13:05:54.314980 19560 raft_consensus.cc:2393] T 833a2f0775ed407a94b8924ce50adb63 P e61c3a8f61bb48f8a963c9480e53c168 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 127766fc592545a4997f7790f50f6076 in current term 9: Already voted for candidate e5256d91808b47c195bc9b4dbd7f2b87 in this term.
I20260709 13:05:54.277580 19523 leader_election.cc:304] T 62c6c134d3d24a1ab144dd9ee6bc3f64 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e61c3a8f61bb48f8a963c9480e53c168; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, 127766fc592545a4997f7790f50f6076
I20260709 13:05:54.318176 23208 leader_election.cc:290] T fa8650e71aa14778b3d73721fc50d9fc P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 11 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:05:54.318255 23104 raft_consensus.cc:2804] T b08304a0a02b42d7840c4e8ee9a6bd1a P 0473d2b2d01f4459b1e90fd12cc7840e [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:05:54.319270 19486 raft_consensus.cc:1240] T 3e1f505cb0f1427bbd698ac889d80821 P 0473d2b2d01f4459b1e90fd12cc7840e [term 10 FOLLOWER]: Rejecting Update request from peer e61c3a8f61bb48f8a963c9480e53c168 for earlier term 9. Current term is 10. Ops: [9.5-9.5]
I20260709 13:05:54.320212 19486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "179fd671030940b4b4a4e24bcc4aba0a" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:05:54.263243 23153 raft_consensus.cc:2804] T 0e1085d23e8347fbbd5bce7542f4b1f4 P 127766fc592545a4997f7790f50f6076 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:05:54.322609 19480 raft_consensus.cc:1240] T 28af091831594f9d8e96482078cc7625 P 0473d2b2d01f4459b1e90fd12cc7840e [term 10 FOLLOWER]: Rejecting Update request from peer e61c3a8f61bb48f8a963c9480e53c168 for earlier term 9. Current term is 10. Ops: []
I20260709 13:05:54.324286 19480 raft_consensus.cc:1275] T 48824d5acfbc485ebf8c2d944e7202de P 0473d2b2d01f4459b1e90fd12cc7840e [term 10 FOLLOWER]: Refusing update from remote peer e61c3a8f61bb48f8a963c9480e53c168: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:05:54.326270 19482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff75a1d4cb1f493db8f71ddc136ba9ab" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:05:54.326965 19482 raft_consensus.cc:3060] T ff75a1d4cb1f493db8f71ddc136ba9ab P 0473d2b2d01f4459b1e90fd12cc7840e [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:05:54.294305 23089 raft_consensus.cc:3055] T f1b10566f45d4a7d9029858330e02d5b P 0473d2b2d01f4459b1e90fd12cc7840e [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:05:54.294936 19559 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40438 (request call id 2150) took 1447 ms. Trace:
I20260709 13:05:54.331398 19559 rpcz_store.cc:276] 0709 13:05:52.848224 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:53.024759 (+176535us) service_pool.cc:224] Handling call
0709 13:05:54.294754 (+1269995us) spinlock_profiling.cc:243] Waited 1.19 s on lock 0x7b54000dfa54. stack: 00007f4a79de9343 00007f4a79de9240 00007f4a797781d4 00007f4a834b6304 00007f4a834b6299 00007f4a7ce71571 00007f4a7cf0c2fa 00007f4a81ecdb17 00007f4a7b4486d4 00007f4a7b448662 00007f4a7b448591 00007f4a7b44850c 00007f4a7b4477c2 00007f4a7b24348c 00007f4a7b2428c6 00007f4a7b24226f
0709 13:05:54.294880 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2741322112}
I20260709 13:05:54.271100 23214 raft_consensus.cc:493] T 46c5bfeecc314717bffe987e6844b6d0 P e61c3a8f61bb48f8a963c9480e53c168 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 0473d2b2d01f4459b1e90fd12cc7840e)
I20260709 13:05:54.260495 23147 raft_consensus.cc:2804] T a08760e15aac4630a629431f56024dc8 P e61c3a8f61bb48f8a963c9480e53c168 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:05:54.279943 23072 consensus_queue.cc:1059] T e381f1d6b8184797ad142de49be225a8 P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.028s
I20260709 13:05:54.301442 23230 consensus_queue.cc:1048] T 7be9efa6559648dbb5a0f7684c4542d1 P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
W20260709 13:05:54.302088 23055 consensus_meta.cc:287] T 775c229504194560ba9589bc2199b089 P e5256d91808b47c195bc9b4dbd7f2b87: Time spent flushing consensus metadata: real 0.584s	user 0.008s	sys 0.000s
I20260709 13:05:54.271032 22979 raft_consensus.cc:2804] T 2b74109013a140ada21feeef92d6f563 P e61c3a8f61bb48f8a963c9480e53c168 [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 13:05:54.306196 23150 consensus_meta.cc:287] T 7be9efa6559648dbb5a0f7684c4542d1 P e61c3a8f61bb48f8a963c9480e53c168: Time spent flushing consensus metadata: real 0.566s	user 0.007s	sys 0.002s
I20260709 13:05:54.286572 23051 leader_election.cc:290] T 7f575b143b844aa096b50997dad3516a P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:05:54.287189 23209 consensus_queue.cc:237] T e381f1d6b8184797ad142de49be225a8 P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:54.309689 20103 raft_consensus.cc:1275] T 70797e5783b5454ab0d0eea663e791e3 P 127766fc592545a4997f7790f50f6076 [term 10 FOLLOWER]: Refusing update from remote peer e5256d91808b47c195bc9b4dbd7f2b87: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 13:05:54.312759 22974 leader_election.cc:290] T 86a6797bdfe94fa496c050ceae4bd0d9 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 10 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:05:54.271248 23212 raft_consensus.cc:2804] T edd7d470b5014c9489be7f41f64355c9 P e61c3a8f61bb48f8a963c9480e53c168 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:05:54.254706 23034 raft_consensus.cc:2804] T ef32ce6fdd0e40d382c79974f30295c6 P e61c3a8f61bb48f8a963c9480e53c168 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:05:54.294269 23228 raft_consensus.cc:2804] T df751f992649444090e27965eb1af85d P 0473d2b2d01f4459b1e90fd12cc7840e [term 11 FOLLOWER]: Leader election won for term 11
W20260709 13:05:54.328816 19523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.4:43121, user_credentials={real_user=slave}} blocked reactor thread for 51304.6us
I20260709 13:05:54.392236 19523 leader_election.cc:304] T 4af19371ea874c09a0a2147040835cbb P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e61c3a8f61bb48f8a963c9480e53c168; no voters: 127766fc592545a4997f7790f50f6076, e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:05:54.329972 19480 raft_consensus.cc:1240] T b9f0d59553ad444883fcf5b5909f9798 P 0473d2b2d01f4459b1e90fd12cc7840e [term 9 FOLLOWER]: Rejecting Update request from peer e61c3a8f61bb48f8a963c9480e53c168 for earlier term 8. Current term is 9. Ops: []
I20260709 13:05:54.336964 19483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22196caba61445d3bec98a0aab3c337d" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:05:54.342664 19486 raft_consensus.cc:2468] T 179fd671030940b4b4a4e24bcc4aba0a P 0473d2b2d01f4459b1e90fd12cc7840e [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 9.
I20260709 13:05:54.345063 19484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "217b5fae677b4971b3bbd2f357a1f7ff" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:05:54.394228 19484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed7fdbcb96d14d418db9ca90a792588a" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:05:54.347491 20078 leader_election.cc:304] T ff9b0eddd810459b82d91c60777c10eb P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, 127766fc592545a4997f7790f50f6076; no voters: e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:05:54.331339 23089 raft_consensus.cc:740] T f1b10566f45d4a7d9029858330e02d5b P 0473d2b2d01f4459b1e90fd12cc7840e [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 0473d2b2d01f4459b1e90fd12cc7840e, State: Running, Role: LEADER
I20260709 13:05:54.318868 23208 raft_consensus.cc:2749] T 62c6c134d3d24a1ab144dd9ee6bc3f64 P e61c3a8f61bb48f8a963c9480e53c168 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:05:54.362969 19477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b08304a0a02b42d7840c4e8ee9a6bd1a" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:05:54.372382 19479 raft_consensus.cc:1275] T 6c5eebf646ad445a9d1b1adc319d7b16 P 0473d2b2d01f4459b1e90fd12cc7840e [term 8 FOLLOWER]: Refusing update from remote peer e61c3a8f61bb48f8a963c9480e53c168: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 8. (term mismatch)
I20260709 13:05:54.435745 19479 pending_rounds.cc:85] T 6c5eebf646ad445a9d1b1adc319d7b16 P 0473d2b2d01f4459b1e90fd12cc7840e: Aborting all ops after (but not including) 7
I20260709 13:05:54.436017 19479 pending_rounds.cc:107] T 6c5eebf646ad445a9d1b1adc319d7b16 P 0473d2b2d01f4459b1e90fd12cc7840e: Aborting uncommitted NO_OP operation due to leader change: 7.8
I20260709 13:05:54.436275 19479 raft_consensus.cc:2889] T 6c5eebf646ad445a9d1b1adc319d7b16 P 0473d2b2d01f4459b1e90fd12cc7840e [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:05:54.263068 23183 consensus_queue.cc:1048] T 96efeaaf1057492490e9a621f37e1a2d P 127766fc592545a4997f7790f50f6076 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.072s
I20260709 13:05:54.318917 23104 raft_consensus.cc:697] T b08304a0a02b42d7840c4e8ee9a6bd1a P 0473d2b2d01f4459b1e90fd12cc7840e [term 12 LEADER]: Becoming Leader. State: Replica: 0473d2b2d01f4459b1e90fd12cc7840e, State: Running, Role: LEADER
W20260709 13:05:54.353363 23038 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.568s	user 0.015s	sys 0.038s
I20260709 13:05:54.378865 19482 raft_consensus.cc:2468] T ff75a1d4cb1f493db8f71ddc136ba9ab P 0473d2b2d01f4459b1e90fd12cc7840e [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 10.
W20260709 13:05:54.386387 19449 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:54.444046 19402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f575b143b844aa096b50997dad3516a" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:05:54.377763 23147 raft_consensus.cc:697] T a08760e15aac4630a629431f56024dc8 P e61c3a8f61bb48f8a963c9480e53c168 [term 11 LEADER]: Becoming Leader. State: Replica: e61c3a8f61bb48f8a963c9480e53c168, State: Running, Role: LEADER
W20260709 13:05:54.352756 19450 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:54.281524 23093 raft_consensus.cc:515] T 85c494af21f9457a85da47b9bc70c1fd P e61c3a8f61bb48f8a963c9480e53c168 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:05:54.412001 19486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96efeaaf1057492490e9a621f37e1a2d" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:05:54.448271 19486 raft_consensus.cc:2468] T 96efeaaf1057492490e9a621f37e1a2d P 0473d2b2d01f4459b1e90fd12cc7840e [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 10.
W20260709 13:05:54.450572 19375 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.3:36891, user_credentials={real_user=slave}} blocked reactor thread for 201851us
I20260709 13:05:54.451911 19479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76cb037fc9064d13b59a8969d897ce8c" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:05:54.452612 19479 raft_consensus.cc:2393] T 76cb037fc9064d13b59a8969d897ce8c P 0473d2b2d01f4459b1e90fd12cc7840e [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e5256d91808b47c195bc9b4dbd7f2b87 in current term 9: Already voted for candidate 0473d2b2d01f4459b1e90fd12cc7840e in this term.
I20260709 13:05:54.453263 19479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "775c229504194560ba9589bc2199b089" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:05:54.453873 19479 raft_consensus.cc:2393] T 775c229504194560ba9589bc2199b089 P 0473d2b2d01f4459b1e90fd12cc7840e [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e5256d91808b47c195bc9b4dbd7f2b87 in current term 8: Already voted for candidate 127766fc592545a4997f7790f50f6076 in this term.
I20260709 13:05:54.453956 19482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7be9efa6559648dbb5a0f7684c4542d1" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:05:54.454579 19479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a08760e15aac4630a629431f56024dc8" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:05:54.454972 19482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b08304a0a02b42d7840c4e8ee9a6bd1a" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:05:54.455356 19479 raft_consensus.cc:2393] T a08760e15aac4630a629431f56024dc8 P 0473d2b2d01f4459b1e90fd12cc7840e [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate e5256d91808b47c195bc9b4dbd7f2b87 in current term 11: Already voted for candidate e61c3a8f61bb48f8a963c9480e53c168 in this term.
I20260709 13:05:54.456048 19482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f575b143b844aa096b50997dad3516a" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:05:54.456655 19482 raft_consensus.cc:2468] T 7f575b143b844aa096b50997dad3516a P 0473d2b2d01f4459b1e90fd12cc7840e [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 5.
I20260709 13:05:54.457319 19482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86a6797bdfe94fa496c050ceae4bd0d9" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:05:54.458482 19483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a61655d99124a29b486ba4a5b37faea" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:05:54.459518 19480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e5873a19244c5ebbcd38e126796ee7" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:05:54.460942 19484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f93ee515a9c14139bf566522ed8232f3" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 13 candidate_status { last_received { term: 12 index: 5 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:05:54.462261 19486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22196caba61445d3bec98a0aab3c337d" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
W20260709 13:05:54.462502 19526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.2:46257, user_credentials={real_user=slave}} blocked reactor thread for 204947us
I20260709 13:05:54.413475 19523 leader_election.cc:304] T ed7fdbcb96d14d418db9ca90a792588a P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 127766fc592545a4997f7790f50f6076, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:05:54.413717 23228 raft_consensus.cc:697] T df751f992649444090e27965eb1af85d P 0473d2b2d01f4459b1e90fd12cc7840e [term 11 LEADER]: Becoming Leader. State: Replica: 0473d2b2d01f4459b1e90fd12cc7840e, State: Running, Role: LEADER
I20260709 13:05:54.395594 23034 raft_consensus.cc:493] T ef32ce6fdd0e40d382c79974f30295c6 P e61c3a8f61bb48f8a963c9480e53c168 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:54.414387 23066 raft_consensus.cc:3060] T 4af19371ea874c09a0a2147040835cbb P e61c3a8f61bb48f8a963c9480e53c168 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:05:54.418128 22974 consensus_queue.cc:1048] T 6c5eebf646ad445a9d1b1adc319d7b16 P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Connected to new peer: Peer: permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.000s
W20260709 13:05:54.463860 19523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.4:43121, user_credentials={real_user=slave}} blocked reactor thread for 50477.8us
I20260709 13:05:54.465382 19482 raft_consensus.cc:2393] T 86a6797bdfe94fa496c050ceae4bd0d9 P 0473d2b2d01f4459b1e90fd12cc7840e [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e5256d91808b47c195bc9b4dbd7f2b87 in current term 10: Already voted for candidate 0473d2b2d01f4459b1e90fd12cc7840e in this term.
I20260709 13:05:54.466898 23233 raft_consensus.cc:2804] T ed7fdbcb96d14d418db9ca90a792588a P e61c3a8f61bb48f8a963c9480e53c168 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:05:54.467339 23233 raft_consensus.cc:493] T ed7fdbcb96d14d418db9ca90a792588a P e61c3a8f61bb48f8a963c9480e53c168 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 0473d2b2d01f4459b1e90fd12cc7840e)
I20260709 13:05:54.467801 23233 raft_consensus.cc:3060] T ed7fdbcb96d14d418db9ca90a792588a P e61c3a8f61bb48f8a963c9480e53c168 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:05:54.470696 20076 leader_election.cc:304] T 2a16f7501e2444fb86d4e2778e734e02 P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 127766fc592545a4997f7790f50f6076; no voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:05:54.451431 19375 leader_election.cc:304] T 179fd671030940b4b4a4e24bcc4aba0a P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
W20260709 13:05:54.441551 22758 consensus_meta.cc:287] T 309c3ca0ca4b4f3ba129752ea2cb293b P e61c3a8f61bb48f8a963c9480e53c168: Time spent flushing consensus metadata: real 0.899s	user 0.004s	sys 0.007s
I20260709 13:05:54.427757 23234 raft_consensus.cc:493] T 46c5bfeecc314717bffe987e6844b6d0 P e5256d91808b47c195bc9b4dbd7f2b87 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 0473d2b2d01f4459b1e90fd12cc7840e)
I20260709 13:05:54.428213 23218 raft_consensus.cc:493] T ab43d85f64114d4ebf618930e43d9ed0 P e5256d91808b47c195bc9b4dbd7f2b87 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:54.428804 19408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36f6ba92b9ba46babe4ebd6c02e5fbd9" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:05:54.442780 23183 consensus_queue.cc:1243] T 96efeaaf1057492490e9a621f37e1a2d P 127766fc592545a4997f7790f50f6076 [LEADER]: Peer e61c3a8f61bb48f8a963c9480e53c168 log is divergent from this leader: its last log entry 9.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
I20260709 13:05:54.430975 19409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f93ee515a9c14139bf566522ed8232f3" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 13 candidate_status { last_received { term: 12 index: 5 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
I20260709 13:05:54.510305 19409 raft_consensus.cc:3060] T f93ee515a9c14139bf566522ed8232f3 P e5256d91808b47c195bc9b4dbd7f2b87 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:05:54.431579 19404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b74109013a140ada21feeef92d6f563" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
I20260709 13:05:54.432209 19411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9f0d59553ad444883fcf5b5909f9798" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
I20260709 13:05:54.512341 19411 raft_consensus.cc:3060] T b9f0d59553ad444883fcf5b5909f9798 P e5256d91808b47c195bc9b4dbd7f2b87 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:05:54.432087 23089 consensus_queue.cc:260] T f1b10566f45d4a7d9029858330e02d5b P 0473d2b2d01f4459b1e90fd12cc7840e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:54.432824 19406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "172b3dd13109415a955b71ac0e9d2234" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:05:54.353164 23214 raft_consensus.cc:515] T 46c5bfeecc314717bffe987e6844b6d0 P e61c3a8f61bb48f8a963c9480e53c168 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:54.375852 23018 raft_consensus.cc:515] T 2725d2c4cb054f18b0fc8f735c15f6c2 P 0473d2b2d01f4459b1e90fd12cc7840e [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:54.430460 19403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa8650e71aa14778b3d73721fc50d9fc" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
W20260709 13:05:54.440835 19451 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:54.374524 22979 raft_consensus.cc:493] T 2b74109013a140ada21feeef92d6f563 P e61c3a8f61bb48f8a963c9480e53c168 [term 5 FOLLOWER]: Starting leader election (detected failure of leader e5256d91808b47c195bc9b4dbd7f2b87)
I20260709 13:05:54.556720 22979 raft_consensus.cc:3060] T 2b74109013a140ada21feeef92d6f563 P e61c3a8f61bb48f8a963c9480e53c168 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:05:54.444700 19402 raft_consensus.cc:2393] T 7f575b143b844aa096b50997dad3516a P e5256d91808b47c195bc9b4dbd7f2b87 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0473d2b2d01f4459b1e90fd12cc7840e in current term 6: Already voted for candidate e5256d91808b47c195bc9b4dbd7f2b87 in this term.
I20260709 13:05:54.445041 19449 leader_election.cc:304] T 48824d5acfbc485ebf8c2d944e7202de P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e; no voters: 127766fc592545a4997f7790f50f6076, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:05:54.334849 23153 raft_consensus.cc:493] T 0e1085d23e8347fbbd5bce7542f4b1f4 P 127766fc592545a4997f7790f50f6076 [term 6 FOLLOWER]: Starting leader election (detected failure of leader e61c3a8f61bb48f8a963c9480e53c168)
I20260709 13:05:54.475939 19484 raft_consensus.cc:2393] T f93ee515a9c14139bf566522ed8232f3 P 0473d2b2d01f4459b1e90fd12cc7840e [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e5256d91808b47c195bc9b4dbd7f2b87 in current term 13: Already voted for candidate 0473d2b2d01f4459b1e90fd12cc7840e in this term.
W20260709 13:05:54.475908 19526 leader_election.cc:336] T df751f992649444090e27965eb1af85d P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257): Timed out: RequestConsensusVote RPC to 127.17.223.2:46257 timed out after 2.031s (SENT)
W20260709 13:05:54.443766 23038 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.703s	user 0.015s	sys 0.038s
W20260709 13:05:54.445065 23140 consensus_meta.cc:287] T df751f992649444090e27965eb1af85d P e61c3a8f61bb48f8a963c9480e53c168: Time spent flushing consensus metadata: real 0.656s	user 0.004s	sys 0.006s
I20260709 13:05:54.429445 19405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86a6797bdfe94fa496c050ceae4bd0d9" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
W20260709 13:05:54.561959 19449 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.4:43121, user_credentials={real_user=slave}} blocked reactor thread for 117000us
I20260709 13:05:54.562325 19405 raft_consensus.cc:3060] T 86a6797bdfe94fa496c050ceae4bd0d9 P e5256d91808b47c195bc9b4dbd7f2b87 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:05:54.493686 19482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df751f992649444090e27965eb1af85d" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:05:54.320364 23178 consensus_queue.cc:237] T 5ec1c4ce15e04c7e8c283a62179f2a64 P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:05:54.377480 23055 raft_consensus.cc:515] T 775c229504194560ba9589bc2199b089 P e5256d91808b47c195bc9b4dbd7f2b87 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:05:54.518416 19551 raft_consensus.cc:1240] T 85c494af21f9457a85da47b9bc70c1fd P e61c3a8f61bb48f8a963c9480e53c168 [term 7 FOLLOWER]: Rejecting Update request from peer 127766fc592545a4997f7790f50f6076 for earlier term 6. Current term is 7. Ops: []
I20260709 13:05:54.442487 23212 raft_consensus.cc:697] T edd7d470b5014c9489be7f41f64355c9 P e61c3a8f61bb48f8a963c9480e53c168 [term 11 LEADER]: Becoming Leader. State: Replica: e61c3a8f61bb48f8a963c9480e53c168, State: Running, Role: LEADER
I20260709 13:05:54.509567 19479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40e1e16737a842ee936002830f36882e" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 13 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:05:54.520596 23218 raft_consensus.cc:515] T ab43d85f64114d4ebf618930e43d9ed0 P e5256d91808b47c195bc9b4dbd7f2b87 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } attrs { replace: true } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:05:54.532059 19486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21e14947d70440f19044d8f75c31e1f9" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:05:54.586802 19486 raft_consensus.cc:2393] T 21e14947d70440f19044d8f75c31e1f9 P 0473d2b2d01f4459b1e90fd12cc7840e [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate e5256d91808b47c195bc9b4dbd7f2b87 in current term 9: Already voted for candidate e61c3a8f61bb48f8a963c9480e53c168 in this term.
I20260709 13:05:54.533761 19409 raft_consensus.cc:2468] T f93ee515a9c14139bf566522ed8232f3 P e5256d91808b47c195bc9b4dbd7f2b87 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 13.
I20260709 13:05:54.536727 19403 raft_consensus.cc:3060] T fa8650e71aa14778b3d73721fc50d9fc P e5256d91808b47c195bc9b4dbd7f2b87 [term 9 FOLLOWER]: Advancing to term 11
I20260709 13:05:54.537887 19480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36f6ba92b9ba46babe4ebd6c02e5fbd9" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:05:54.588272 19480 raft_consensus.cc:3060] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P 0473d2b2d01f4459b1e90fd12cc7840e [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:05:54.541890 22978 raft_consensus.cc:493] T bc225c93219c45538b53a1bd3d387e4d P 0473d2b2d01f4459b1e90fd12cc7840e [term 10 FOLLOWER]: Starting pre-election (detected failure of leader e5256d91808b47c195bc9b4dbd7f2b87)
I20260709 13:05:54.555003 23147 consensus_queue.cc:237] T a08760e15aac4630a629431f56024dc8 P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 9.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:54.397253 23150 raft_consensus.cc:515] T 7be9efa6559648dbb5a0f7684c4542d1 P e61c3a8f61bb48f8a963c9480e53c168 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } attrs { replace: true } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:05:54.559525 19484 raft_consensus.cc:1275] T ef32ce6fdd0e40d382c79974f30295c6 P 0473d2b2d01f4459b1e90fd12cc7840e [term 11 FOLLOWER]: Refusing update from remote peer e5256d91808b47c195bc9b4dbd7f2b87: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
W20260709 13:05:54.560281 19526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.2:46257, user_credentials={real_user=slave}} blocked reactor thread for 84386.9us
I20260709 13:05:54.560384 19411 raft_consensus.cc:2468] T b9f0d59553ad444883fcf5b5909f9798 P e5256d91808b47c195bc9b4dbd7f2b87 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 9.
I20260709 13:05:54.493320 19375 leader_election.cc:304] T 76cb037fc9064d13b59a8969d897ce8c P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:05:54.475009 23034 raft_consensus.cc:3060] T ef32ce6fdd0e40d382c79974f30295c6 P e61c3a8f61bb48f8a963c9480e53c168 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:05:54.474354 23224 raft_consensus.cc:493] T 14efcc79969f41babe5529c22d59156d P 0473d2b2d01f4459b1e90fd12cc7840e [term 10 FOLLOWER]: Starting pre-election (detected failure of leader e5256d91808b47c195bc9b4dbd7f2b87)
I20260709 13:05:54.492923 23072 raft_consensus.cc:493] T 5ec1c4ce15e04c7e8c283a62179f2a64 P 0473d2b2d01f4459b1e90fd12cc7840e [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:54.509246 22758 raft_consensus.cc:2749] T 309c3ca0ca4b4f3ba129752ea2cb293b P e61c3a8f61bb48f8a963c9480e53c168 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:05:54.519953 23143 raft_consensus.cc:2804] T 179fd671030940b4b4a4e24bcc4aba0a P e5256d91808b47c195bc9b4dbd7f2b87 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:05:54.508988 22859 raft_consensus.cc:493] T 28af091831594f9d8e96482078cc7625 P e5256d91808b47c195bc9b4dbd7f2b87 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader e61c3a8f61bb48f8a963c9480e53c168)
I20260709 13:05:54.593508 19449 leader_election.cc:304] T 1f85fc4b527a48848e5faa083b604e36 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, 127766fc592545a4997f7790f50f6076; no voters: e5256d91808b47c195bc9b4dbd7f2b87
W20260709 13:05:54.595731 20078 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.2:46257, user_credentials={real_user=slave}} blocked reactor thread for 248310us
I20260709 13:05:54.600353 19526 leader_election.cc:304] T 1dc5b3532fe54f74876d02beffa2c230 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e61c3a8f61bb48f8a963c9480e53c168; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:05:54.607386 19405 raft_consensus.cc:2468] T 86a6797bdfe94fa496c050ceae4bd0d9 P e5256d91808b47c195bc9b4dbd7f2b87 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 10.
W20260709 13:05:54.608029 19375 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.3:36891, user_credentials={real_user=slave}} blocked reactor thread for 114774us
I20260709 13:05:54.609905 19481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff75a1d4cb1f493db8f71ddc136ba9ab" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:05:54.508335 23208 consensus_queue.cc:1048] T 48824d5acfbc485ebf8c2d944e7202de P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Connected to new peer: Peer: permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.081s
I20260709 13:05:54.628671 19449 leader_election.cc:304] T 0e1085d23e8347fbbd5bce7542f4b1f4 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e; no voters: 127766fc592545a4997f7790f50f6076, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:05:54.576821 23153 raft_consensus.cc:3060] T 0e1085d23e8347fbbd5bce7542f4b1f4 P 127766fc592545a4997f7790f50f6076 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:05:54.561791 23038 raft_consensus.cc:697] T 1dc5b3532fe54f74876d02beffa2c230 P 0473d2b2d01f4459b1e90fd12cc7840e [term 9 LEADER]: Becoming Leader. State: Replica: 0473d2b2d01f4459b1e90fd12cc7840e, State: Running, Role: LEADER
I20260709 13:05:54.634546 19403 raft_consensus.cc:2468] T fa8650e71aa14778b3d73721fc50d9fc P e5256d91808b47c195bc9b4dbd7f2b87 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 11.
I20260709 13:05:54.512763 23234 raft_consensus.cc:515] T 46c5bfeecc314717bffe987e6844b6d0 P e5256d91808b47c195bc9b4dbd7f2b87 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:54.597266 23229 raft_consensus.cc:2749] T 48824d5acfbc485ebf8c2d944e7202de P 0473d2b2d01f4459b1e90fd12cc7840e [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:05:54.538276 23236 consensus_queue.cc:1048] T 70797e5783b5454ab0d0eea663e791e3 P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Connected to new peer: Peer: permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.096s
I20260709 13:05:54.627100 19556 raft_consensus.cc:2468] T 309c3ca0ca4b4f3ba129752ea2cb293b P e61c3a8f61bb48f8a963c9480e53c168 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 8.
W20260709 13:05:54.629788 20076 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.3:36891, user_credentials={real_user=slave}} blocked reactor thread for 159232us
I20260709 13:05:54.621068 19480 raft_consensus.cc:2468] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P 0473d2b2d01f4459b1e90fd12cc7840e [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 11.
I20260709 13:05:54.636159 19405 raft_consensus.cc:1240] T e381f1d6b8184797ad142de49be225a8 P e5256d91808b47c195bc9b4dbd7f2b87 [term 8 FOLLOWER]: Rejecting Update request from peer 0473d2b2d01f4459b1e90fd12cc7840e for earlier term 7. Current term is 8. Ops: [7.5-7.5]
I20260709 13:05:54.623032 19410 raft_consensus.cc:2393] T 775c229504194560ba9589bc2199b089 P e5256d91808b47c195bc9b4dbd7f2b87 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 127766fc592545a4997f7790f50f6076 in current term 8: Already voted for candidate e5256d91808b47c195bc9b4dbd7f2b87 in this term.
I20260709 13:05:54.624402 19481 raft_consensus.cc:2368] T ff75a1d4cb1f493db8f71ddc136ba9ab P 0473d2b2d01f4459b1e90fd12cc7840e [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate e5256d91808b47c195bc9b4dbd7f2b87 for earlier term 9. Current term is 10.
I20260709 13:05:54.638576 19484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "179fd671030940b4b4a4e24bcc4aba0a" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:05:54.612907 23091 raft_consensus.cc:3055] T 4af19371ea874c09a0a2147040835cbb P e5256d91808b47c195bc9b4dbd7f2b87 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:05:54.641351 19484 raft_consensus.cc:2468] T 179fd671030940b4b4a4e24bcc4aba0a P 0473d2b2d01f4459b1e90fd12cc7840e [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 9.
I20260709 13:05:54.576704 23140 raft_consensus.cc:515] T df751f992649444090e27965eb1af85d P e61c3a8f61bb48f8a963c9480e53c168 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:54.641955 20076 leader_election.cc:304] T ece3db938bc649d4a40a51522ed5259c P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 127766fc592545a4997f7790f50f6076; no voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:05:54.615962 23179 raft_consensus.cc:2804] T 76cb037fc9064d13b59a8969d897ce8c P e5256d91808b47c195bc9b4dbd7f2b87 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:05:54.615267 23143 raft_consensus.cc:493] T 179fd671030940b4b4a4e24bcc4aba0a P e5256d91808b47c195bc9b4dbd7f2b87 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:54.665313 19526 leader_election.cc:304] T 21e14947d70440f19044d8f75c31e1f9 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168; no voters: e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:05:54.639726 22758 consensus_queue.cc:1059] T f93ee515a9c14139bf566522ed8232f3 P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 }, Status: INVALID_TERM, Last received: 12.5, Next index: 6, Last known committed idx: 3, Time since last communication: 0.031s
I20260709 13:05:54.668771 23255 raft_consensus.cc:2804] T ff9b0eddd810459b82d91c60777c10eb P 127766fc592545a4997f7790f50f6076 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:05:54.669034 22758 raft_consensus.cc:3055] T f93ee515a9c14139bf566522ed8232f3 P e61c3a8f61bb48f8a963c9480e53c168 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:05:54.669235 23255 raft_consensus.cc:493] T ff9b0eddd810459b82d91c60777c10eb P 127766fc592545a4997f7790f50f6076 [term 8 FOLLOWER]: Starting leader election (detected failure of leader e5256d91808b47c195bc9b4dbd7f2b87)
I20260709 13:05:54.669523 22758 raft_consensus.cc:740] T f93ee515a9c14139bf566522ed8232f3 P e61c3a8f61bb48f8a963c9480e53c168 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: e61c3a8f61bb48f8a963c9480e53c168, State: Running, Role: LEADER
I20260709 13:05:54.606138 22978 raft_consensus.cc:515] T bc225c93219c45538b53a1bd3d387e4d P 0473d2b2d01f4459b1e90fd12cc7840e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:54.669659 23255 raft_consensus.cc:3060] T ff9b0eddd810459b82d91c60777c10eb P 127766fc592545a4997f7790f50f6076 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:05:54.555003 23104 consensus_queue.cc:237] T b08304a0a02b42d7840c4e8ee9a6bd1a P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:54.673071 20076 leader_election.cc:304] T 4af19371ea874c09a0a2147040835cbb P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 127766fc592545a4997f7790f50f6076; no voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:05:54.637157 23220 raft_consensus.cc:2804] T 1f85fc4b527a48848e5faa083b604e36 P 0473d2b2d01f4459b1e90fd12cc7840e [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:05:54.640569 23050 raft_consensus.cc:2749] T 0e1085d23e8347fbbd5bce7542f4b1f4 P 0473d2b2d01f4459b1e90fd12cc7840e [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:05:54.615417 23224 raft_consensus.cc:515] T 14efcc79969f41babe5529c22d59156d P 0473d2b2d01f4459b1e90fd12cc7840e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:05:54.670481 22758 consensus_queue.cc:260] T f93ee515a9c14139bf566522ed8232f3 P e61c3a8f61bb48f8a963c9480e53c168 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 12.5, Last appended by leader: 5, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:54.676674 22978 leader_election.cc:290] T bc225c93219c45538b53a1bd3d387e4d P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:05:54.680713 20076 leader_election.cc:304] T 65d8cb8d6ec64f459d5a47cefab10acf P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 127766fc592545a4997f7790f50f6076; no voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168
W20260709 13:05:54.673902 23194 consensus_meta.cc:287] T 40e1e16737a842ee936002830f36882e P e61c3a8f61bb48f8a963c9480e53c168: Time spent flushing consensus metadata: real 0.504s	user 0.009s	sys 0.000s
I20260709 13:05:54.663280 23088 raft_consensus.cc:493] T f1b10566f45d4a7d9029858330e02d5b P e5256d91808b47c195bc9b4dbd7f2b87 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 0473d2b2d01f4459b1e90fd12cc7840e)
I20260709 13:05:54.674382 23179 raft_consensus.cc:697] T 76cb037fc9064d13b59a8969d897ce8c P e5256d91808b47c195bc9b4dbd7f2b87 [term 9 LEADER]: Becoming Leader. State: Replica: e5256d91808b47c195bc9b4dbd7f2b87, State: Running, Role: LEADER
I20260709 13:05:54.690904 23038 consensus_queue.cc:237] T 1dc5b3532fe54f74876d02beffa2c230 P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:54.617789 23072 raft_consensus.cc:515] T 5ec1c4ce15e04c7e8c283a62179f2a64 P 0473d2b2d01f4459b1e90fd12cc7840e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:05:54.631934 23195 raft_consensus.cc:2749] T 1dc5b3532fe54f74876d02beffa2c230 P e61c3a8f61bb48f8a963c9480e53c168 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:05:54.660785 23091 raft_consensus.cc:740] T 4af19371ea874c09a0a2147040835cbb P e5256d91808b47c195bc9b4dbd7f2b87 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: e5256d91808b47c195bc9b4dbd7f2b87, State: Running, Role: LEADER
I20260709 13:05:54.698001 23066 raft_consensus.cc:2749] T 4af19371ea874c09a0a2147040835cbb P e61c3a8f61bb48f8a963c9480e53c168 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:05:54.632251 22859 raft_consensus.cc:515] T 28af091831594f9d8e96482078cc7625 P e5256d91808b47c195bc9b4dbd7f2b87 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:54.671775 23143 raft_consensus.cc:3060] T 179fd671030940b4b4a4e24bcc4aba0a P e5256d91808b47c195bc9b4dbd7f2b87 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:05:54.672049 23243 consensus_queue.cc:1048] T 3e1f505cb0f1427bbd698ac889d80821 P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.022s
I20260709 13:05:54.710664 22758 raft_consensus.cc:3060] T f93ee515a9c14139bf566522ed8232f3 P e61c3a8f61bb48f8a963c9480e53c168 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:05:54.694593 23220 raft_consensus.cc:493] T 1f85fc4b527a48848e5faa083b604e36 P 0473d2b2d01f4459b1e90fd12cc7840e [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:54.721887 19480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9962423cb4e54fcfa5de01daf68a86e7" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:05:54.634096 23228 consensus_queue.cc:237] T df751f992649444090e27965eb1af85d P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:54.701900 19483 raft_consensus.cc:1240] T 2b74109013a140ada21feeef92d6f563 P 0473d2b2d01f4459b1e90fd12cc7840e [term 6 FOLLOWER]: Rejecting Update request from peer e5256d91808b47c195bc9b4dbd7f2b87 for earlier term 5. Current term is 6. Ops: []
W20260709 13:05:54.732514 19452 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:05:54.733358 19377 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.2:46257, user_credentials={real_user=slave}} blocked reactor thread for 104843us
I20260709 13:05:54.734063 19486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "309c3ca0ca4b4f3ba129752ea2cb293b" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:05:54.746912 19486 raft_consensus.cc:2468] T 309c3ca0ca4b4f3ba129752ea2cb293b P 0473d2b2d01f4459b1e90fd12cc7840e [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 8.
I20260709 13:05:54.708376 23208 raft_consensus.cc:2804] T 21e14947d70440f19044d8f75c31e1f9 P e61c3a8f61bb48f8a963c9480e53c168 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:05:54.748785 23208 raft_consensus.cc:697] T 21e14947d70440f19044d8f75c31e1f9 P e61c3a8f61bb48f8a963c9480e53c168 [term 9 LEADER]: Becoming Leader. State: Replica: e61c3a8f61bb48f8a963c9480e53c168, State: Running, Role: LEADER
I20260709 13:05:54.749806 23208 consensus_queue.cc:237] T 21e14947d70440f19044d8f75c31e1f9 P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:54.751442 23140 leader_election.cc:290] T df751f992649444090e27965eb1af85d P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 10 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:05:54.752076 23072 leader_election.cc:290] T 5ec1c4ce15e04c7e8c283a62179f2a64 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:05:54.752717 23179 consensus_queue.cc:237] T 76cb037fc9064d13b59a8969d897ce8c P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:54.739283 19479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76cb037fc9064d13b59a8969d897ce8c" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:05:54.721393 23131 raft_consensus.cc:493] T ab43d85f64114d4ebf618930e43d9ed0 P 127766fc592545a4997f7790f50f6076 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:05:54.728873 19374 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.4:43121, user_credentials={real_user=slave}} blocked reactor thread for 49736.5us
I20260709 13:05:54.747915 19480 raft_consensus.cc:1275] T 3e1f505cb0f1427bbd698ac889d80821 P 0473d2b2d01f4459b1e90fd12cc7840e [term 10 FOLLOWER]: Refusing update from remote peer e5256d91808b47c195bc9b4dbd7f2b87: Log matching property violated. Preceding OpId in replica: term: 8 index: 4. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:05:54.757756 19479 raft_consensus.cc:2393] T 76cb037fc9064d13b59a8969d897ce8c P 0473d2b2d01f4459b1e90fd12cc7840e [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate e5256d91808b47c195bc9b4dbd7f2b87 in current term 9: Already voted for candidate 0473d2b2d01f4459b1e90fd12cc7840e in this term.
I20260709 13:05:54.729982 23249 raft_consensus.cc:2749] T 2a16f7501e2444fb86d4e2778e734e02 P 127766fc592545a4997f7790f50f6076 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:05:54.711490 23199 consensus_queue.cc:1048] T 48824d5acfbc485ebf8c2d944e7202de P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.034s
I20260709 13:05:54.766108 19480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f575b143b844aa096b50997dad3516a" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:05:54.766700 19480 raft_consensus.cc:3060] T 7f575b143b844aa096b50997dad3516a P 0473d2b2d01f4459b1e90fd12cc7840e [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:05:54.766924 19486 raft_consensus.cc:1240] T 2725d2c4cb054f18b0fc8f735c15f6c2 P 0473d2b2d01f4459b1e90fd12cc7840e [term 11 FOLLOWER]: Rejecting Update request from peer e5256d91808b47c195bc9b4dbd7f2b87 for earlier term 10. Current term is 11. Ops: [10.5-10.5]
I20260709 13:05:54.773914 19450 leader_election.cc:304] T 1a61655d99124a29b486ba4a5b37faea P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e; no voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:05:54.774727 23072 raft_consensus.cc:2749] T 1a61655d99124a29b486ba4a5b37faea P 0473d2b2d01f4459b1e90fd12cc7840e [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:05:54.775525 19480 raft_consensus.cc:2468] T 7f575b143b844aa096b50997dad3516a P 0473d2b2d01f4459b1e90fd12cc7840e [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 6.
I20260709 13:05:54.699245 23210 raft_consensus.cc:515] T 14935b3ddf914369822e4a0547aaa355 P e61c3a8f61bb48f8a963c9480e53c168 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } attrs { replace: true } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:05:54.744616 23093 leader_election.cc:290] T 85c494af21f9457a85da47b9bc70c1fd P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 7 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:05:54.746239 23220 raft_consensus.cc:3060] T 1f85fc4b527a48848e5faa083b604e36 P 0473d2b2d01f4459b1e90fd12cc7840e [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:05:54.778757 23183 raft_consensus.cc:2749] T ece3db938bc649d4a40a51522ed5259c P 127766fc592545a4997f7790f50f6076 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:05:54.788094 23256 log.cc:927] Time spent T 00000000000000000000000000000000 P 97750b77d35444acb7791ebf26cc2685: Append to log took a long time: real 0.096s	user 0.000s	sys 0.000s
W20260709 13:05:54.789780 23253 log.cc:927] Time spent T 40e1e16737a842ee936002830f36882e P 0473d2b2d01f4459b1e90fd12cc7840e: Append to log took a long time: real 0.055s	user 0.000s	sys 0.000s
W20260709 13:05:54.789913 19375 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.3:36891, user_credentials={real_user=slave}} blocked reactor thread for 166119us
I20260709 13:05:54.730160 23088 raft_consensus.cc:515] T f1b10566f45d4a7d9029858330e02d5b P e5256d91808b47c195bc9b4dbd7f2b87 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:54.726871 23259 consensus_queue.cc:1059] T 28af091831594f9d8e96482078cc7625 P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 }, Status: INVALID_TERM, Last received: 9.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.053s
I20260709 13:05:54.820217 19557 raft_consensus.cc:1240] T 14935b3ddf914369822e4a0547aaa355 P e61c3a8f61bb48f8a963c9480e53c168 [term 9 FOLLOWER]: Rejecting Update request from peer 127766fc592545a4997f7790f50f6076 for earlier term 8. Current term is 9. Ops: []
W20260709 13:05:54.816470 20076 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.3:36891, user_credentials={real_user=slave}} blocked reactor thread for 135835us
I20260709 13:05:54.764801 23216 raft_consensus.cc:3055] T e381f1d6b8184797ad142de49be225a8 P 0473d2b2d01f4459b1e90fd12cc7840e [term 7 LEADER]: Stepping down as leader of term 7
W20260709 13:05:54.789798 19526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.2:46257, user_credentials={real_user=slave}} blocked reactor thread for 83705.4us
I20260709 13:05:54.805635 23249 raft_consensus.cc:2749] T 65d8cb8d6ec64f459d5a47cefab10acf P 127766fc592545a4997f7790f50f6076 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:05:54.829321 19406 raft_consensus.cc:1240] T b9f0d59553ad444883fcf5b5909f9798 P e5256d91808b47c195bc9b4dbd7f2b87 [term 9 FOLLOWER]: Rejecting Update request from peer e61c3a8f61bb48f8a963c9480e53c168 for earlier term 8. Current term is 9. Ops: []
I20260709 13:05:54.818727 20110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36f6ba92b9ba46babe4ebd6c02e5fbd9" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:05:54.822012 20076 leader_election.cc:304] T 833a2f0775ed407a94b8924ce50adb63 P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 127766fc592545a4997f7790f50f6076; no voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:05:54.822911 19526 leader_election.cc:304] T 179fd671030940b4b4a4e24bcc4aba0a P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:05:54.831214 19402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff75a1d4cb1f493db8f71ddc136ba9ab" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
I20260709 13:05:54.831902 19402 raft_consensus.cc:3060] T ff75a1d4cb1f493db8f71ddc136ba9ab P e5256d91808b47c195bc9b4dbd7f2b87 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:05:54.824961 20108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1efebf73c86e432baa55533136b6e12c" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076"
W20260709 13:05:54.825416 19525 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:54.825737 19403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22196caba61445d3bec98a0aab3c337d" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:05:54.825918 19411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b08304a0a02b42d7840c4e8ee9a6bd1a" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
I20260709 13:05:54.834241 19411 raft_consensus.cc:2368] T b08304a0a02b42d7840c4e8ee9a6bd1a P e5256d91808b47c195bc9b4dbd7f2b87 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate e61c3a8f61bb48f8a963c9480e53c168 for earlier term 11. Current term is 12.
I20260709 13:05:54.834244 19403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa8650e71aa14778b3d73721fc50d9fc" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
I20260709 13:05:54.835184 19403 raft_consensus.cc:2393] T fa8650e71aa14778b3d73721fc50d9fc P e5256d91808b47c195bc9b4dbd7f2b87 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate e61c3a8f61bb48f8a963c9480e53c168 in current term 11: Already voted for candidate 0473d2b2d01f4459b1e90fd12cc7840e in this term.
I20260709 13:05:54.835640 19411 raft_consensus.cc:1240] T f93ee515a9c14139bf566522ed8232f3 P e5256d91808b47c195bc9b4dbd7f2b87 [term 13 FOLLOWER]: Rejecting Update request from peer e61c3a8f61bb48f8a963c9480e53c168 for earlier term 12. Current term is 13. Ops: []
I20260709 13:05:54.826335 19558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f575b143b844aa096b50997dad3516a" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:05:54.827039 19405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "217b5fae677b4971b3bbd2f357a1f7ff" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:05:54.837813 19558 raft_consensus.cc:3060] T 7f575b143b844aa096b50997dad3516a P e61c3a8f61bb48f8a963c9480e53c168 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:05:54.828389 19408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "179fd671030940b4b4a4e24bcc4aba0a" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
I20260709 13:05:54.830529 19406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86a6797bdfe94fa496c050ceae4bd0d9" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
I20260709 13:05:54.754627 23153 raft_consensus.cc:515] T 0e1085d23e8347fbbd5bce7542f4b1f4 P 127766fc592545a4997f7790f50f6076 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:05:54.831215 20110 raft_consensus.cc:2393] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P 127766fc592545a4997f7790f50f6076 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0473d2b2d01f4459b1e90fd12cc7840e in current term 11: Already voted for candidate e5256d91808b47c195bc9b4dbd7f2b87 in this term.
I20260709 13:05:54.838809 19406 raft_consensus.cc:2393] T 86a6797bdfe94fa496c050ceae4bd0d9 P e5256d91808b47c195bc9b4dbd7f2b87 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate e61c3a8f61bb48f8a963c9480e53c168 in current term 10: Already voted for candidate 0473d2b2d01f4459b1e90fd12cc7840e in this term.
I20260709 13:05:54.839802 19553 raft_consensus.cc:1275] T 833a2f0775ed407a94b8924ce50adb63 P e61c3a8f61bb48f8a963c9480e53c168 [term 9 FOLLOWER]: Refusing update from remote peer e5256d91808b47c195bc9b4dbd7f2b87: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:05:54.708074 23212 consensus_queue.cc:237] T edd7d470b5014c9489be7f41f64355c9 P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 8.4, Last appended by leader: 4, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:54.873301 19552 raft_consensus.cc:1240] T 4af19371ea874c09a0a2147040835cbb P e61c3a8f61bb48f8a963c9480e53c168 [term 6 FOLLOWER]: Rejecting Update request from peer e5256d91808b47c195bc9b4dbd7f2b87 for earlier term 5. Current term is 6. Ops: []
I20260709 13:05:54.803014 23018 leader_election.cc:290] T 2725d2c4cb054f18b0fc8f735c15f6c2 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 11 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
W20260709 13:05:54.877207 19526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.2:46257, user_credentials={real_user=slave}} blocked reactor thread for 54396.4us
I20260709 13:05:54.879956 20110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "172b3dd13109415a955b71ac0e9d2234" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:05:54.881135 20078 leader_election.cc:304] T 0afb57ae58a24a01850491d69f0213dd P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 127766fc592545a4997f7790f50f6076; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:05:54.877662 19402 raft_consensus.cc:2468] T ff75a1d4cb1f493db8f71ddc136ba9ab P e5256d91808b47c195bc9b4dbd7f2b87 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 10.
W20260709 13:05:54.883040 19523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.1:40321, user_credentials={real_user=slave}} blocked reactor thread for 52979.4us
I20260709 13:05:54.890333 20078 leader_election.cc:304] T 1f85fc4b527a48848e5faa083b604e36 P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, 127766fc592545a4997f7790f50f6076; no voters: e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:05:54.894703 19558 raft_consensus.cc:2468] T 7f575b143b844aa096b50997dad3516a P e61c3a8f61bb48f8a963c9480e53c168 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 6.
I20260709 13:05:54.897013 19560 raft_consensus.cc:1275] T 70797e5783b5454ab0d0eea663e791e3 P e61c3a8f61bb48f8a963c9480e53c168 [term 10 FOLLOWER]: Refusing update from remote peer e5256d91808b47c195bc9b4dbd7f2b87: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 13:05:54.822569 23216 raft_consensus.cc:740] T e381f1d6b8184797ad142de49be225a8 P 0473d2b2d01f4459b1e90fd12cc7840e [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 0473d2b2d01f4459b1e90fd12cc7840e, State: Running, Role: LEADER
I20260709 13:05:54.821548 23252 raft_consensus.cc:2749] T 4af19371ea874c09a0a2147040835cbb P 127766fc592545a4997f7790f50f6076 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:05:54.906502 20105 raft_consensus.cc:1240] T 0e1085d23e8347fbbd5bce7542f4b1f4 P 127766fc592545a4997f7790f50f6076 [term 7 FOLLOWER]: Rejecting Update request from peer e61c3a8f61bb48f8a963c9480e53c168 for earlier term 6. Current term is 7. Ops: []
I20260709 13:05:54.845906 23183 raft_consensus.cc:2749] T 833a2f0775ed407a94b8924ce50adb63 P 127766fc592545a4997f7790f50f6076 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:05:54.901952 19526 leader_election.cc:304] T ff75a1d4cb1f493db8f71ddc136ba9ab P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:05:54.764402 23131 raft_consensus.cc:515] T ab43d85f64114d4ebf618930e43d9ed0 P 127766fc592545a4997f7790f50f6076 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } attrs { replace: true } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:05:54.935348 19526 leader_election.cc:304] T 96efeaaf1057492490e9a621f37e1a2d P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168; no voters: 127766fc592545a4997f7790f50f6076
I20260709 13:05:54.903003 23066 raft_consensus.cc:2804] T 179fd671030940b4b4a4e24bcc4aba0a P e61c3a8f61bb48f8a963c9480e53c168 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:05:54.915719 23254 raft_consensus.cc:2749] T 0afb57ae58a24a01850491d69f0213dd P 127766fc592545a4997f7790f50f6076 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:05:54.817183 23091 consensus_queue.cc:260] T 4af19371ea874c09a0a2147040835cbb P e5256d91808b47c195bc9b4dbd7f2b87 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:05:54.873610 22979 raft_consensus.cc:515] T 2b74109013a140ada21feeef92d6f563 P e61c3a8f61bb48f8a963c9480e53c168 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:54.911223 23260 raft_consensus.cc:493] T 70797e5783b5454ab0d0eea663e791e3 P 127766fc592545a4997f7790f50f6076 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:54.955372 19480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46c5bfeecc314717bffe987e6844b6d0" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 16 candidate_status { last_received { term: 15 index: 6 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:05:54.955612 19486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "775c229504194560ba9589bc2199b089" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:05:54.955993 19483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab43d85f64114d4ebf618930e43d9ed0" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:05:54.935204 23249 raft_consensus.cc:493] T 62c6c134d3d24a1ab144dd9ee6bc3f64 P 127766fc592545a4997f7790f50f6076 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 0473d2b2d01f4459b1e90fd12cc7840e)
I20260709 13:05:54.963330 19486 raft_consensus.cc:2393] T 775c229504194560ba9589bc2199b089 P 0473d2b2d01f4459b1e90fd12cc7840e [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate e5256d91808b47c195bc9b4dbd7f2b87 in current term 8: Already voted for candidate 127766fc592545a4997f7790f50f6076 in this term.
I20260709 13:05:54.963666 19483 raft_consensus.cc:2468] T ab43d85f64114d4ebf618930e43d9ed0 P 0473d2b2d01f4459b1e90fd12cc7840e [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 9.
I20260709 13:05:54.952745 22830 raft_consensus.cc:493] T 1dc5b3532fe54f74876d02beffa2c230 P e5256d91808b47c195bc9b4dbd7f2b87 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:54.943326 23265 consensus_queue.cc:1059] T b9f0d59553ad444883fcf5b5909f9798 P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.052s
I20260709 13:05:54.954176 23252 consensus_queue.cc:1059] T 1efebf73c86e432baa55533136b6e12c P 127766fc592545a4997f7790f50f6076 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.007s
I20260709 13:05:54.914276 23259 consensus_queue.cc:1048] T 6c5eebf646ad445a9d1b1adc319d7b16 P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.048s
I20260709 13:05:54.939654 23199 raft_consensus.cc:2804] T ff75a1d4cb1f493db8f71ddc136ba9ab P e61c3a8f61bb48f8a963c9480e53c168 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:05:54.939864 23195 raft_consensus.cc:2804] T 96efeaaf1057492490e9a621f37e1a2d P e61c3a8f61bb48f8a963c9480e53c168 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:05:54.979903 23131 leader_election.cc:290] T ab43d85f64114d4ebf618930e43d9ed0 P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:05:54.980187 23195 raft_consensus.cc:493] T 96efeaaf1057492490e9a621f37e1a2d P e61c3a8f61bb48f8a963c9480e53c168 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:54.980733 23195 raft_consensus.cc:3060] T 96efeaaf1057492490e9a621f37e1a2d P e61c3a8f61bb48f8a963c9480e53c168 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:05:54.982057 23266 consensus_queue.cc:1048] T 833a2f0775ed407a94b8924ce50adb63 P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.018s
W20260709 13:05:54.969115 19375 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.3:36891, user_credentials={real_user=slave}} blocked reactor thread for 77876.3us
W20260709 13:05:54.973088 19451 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:54.985211 19403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab43d85f64114d4ebf618930e43d9ed0" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:05:54.985816 19403 raft_consensus.cc:2468] T ab43d85f64114d4ebf618930e43d9ed0 P e5256d91808b47c195bc9b4dbd7f2b87 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 127766fc592545a4997f7790f50f6076 in term 9.
I20260709 13:05:54.957685 23234 leader_election.cc:290] T 46c5bfeecc314717bffe987e6844b6d0 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:05:54.986387 19375 leader_election.cc:304] T 7f575b143b844aa096b50997dad3516a P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:05:54.961843 23273 raft_consensus.cc:2804] T 1f85fc4b527a48848e5faa083b604e36 P 127766fc592545a4997f7790f50f6076 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:05:55.061841 19552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1b10566f45d4a7d9029858330e02d5b" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:05:55.075865 19552 raft_consensus.cc:2393] T f1b10566f45d4a7d9029858330e02d5b P e61c3a8f61bb48f8a963c9480e53c168 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e5256d91808b47c195bc9b4dbd7f2b87 in current term 11: Already voted for candidate e61c3a8f61bb48f8a963c9480e53c168 in this term.
W20260709 13:05:54.983855 23251 log.cc:927] Time spent T 1a61655d99124a29b486ba4a5b37faea P 0473d2b2d01f4459b1e90fd12cc7840e: Append to log took a long time: real 0.191s	user 0.000s	sys 0.001s
I20260709 13:05:54.971556 23249 raft_consensus.cc:515] T 62c6c134d3d24a1ab144dd9ee6bc3f64 P 127766fc592545a4997f7790f50f6076 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:05:55.079401 19560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46c5bfeecc314717bffe987e6844b6d0" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 16 candidate_status { last_received { term: 15 index: 6 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:05:55.079989 19560 raft_consensus.cc:2468] T 46c5bfeecc314717bffe987e6844b6d0 P e61c3a8f61bb48f8a963c9480e53c168 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 15.
I20260709 13:05:55.081446 23249 leader_election.cc:290] T 62c6c134d3d24a1ab144dd9ee6bc3f64 P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:05:54.986886 23199 raft_consensus.cc:697] T ff75a1d4cb1f493db8f71ddc136ba9ab P e61c3a8f61bb48f8a963c9480e53c168 [term 10 LEADER]: Becoming Leader. State: Replica: e61c3a8f61bb48f8a963c9480e53c168, State: Running, Role: LEADER
I20260709 13:05:54.971736 23250 consensus_queue.cc:1048] T 96efeaaf1057492490e9a621f37e1a2d P 127766fc592545a4997f7790f50f6076 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 6, Time since last communication: 0.115s
I20260709 13:05:55.070811 19558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab43d85f64114d4ebf618930e43d9ed0" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:05:55.091320 19558 raft_consensus.cc:2468] T ab43d85f64114d4ebf618930e43d9ed0 P e61c3a8f61bb48f8a963c9480e53c168 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 9.
W20260709 13:05:55.078833 23270 log.cc:927] Time spent T 76cb037fc9064d13b59a8969d897ce8c P e5256d91808b47c195bc9b4dbd7f2b87: Append to log took a long time: real 0.127s	user 0.001s	sys 0.000s
I20260709 13:05:55.079064 23273 raft_consensus.cc:493] T 1f85fc4b527a48848e5faa083b604e36 P 127766fc592545a4997f7790f50f6076 [term 6 FOLLOWER]: Starting leader election (detected failure of leader e5256d91808b47c195bc9b4dbd7f2b87)
I20260709 13:05:55.087230 19375 leader_election.cc:304] T 46c5bfeecc314717bffe987e6844b6d0 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
W20260709 13:05:54.987499 23261 log.cc:927] Time spent T 1efebf73c86e432baa55533136b6e12c P 127766fc592545a4997f7790f50f6076: Append to log took a long time: real 0.084s	user 0.000s	sys 0.000s
W20260709 13:05:55.104494 20078 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.2:46257, user_credentials={real_user=slave}} blocked reactor thread for 203377us
I20260709 13:05:54.968647 23216 consensus_queue.cc:260] T e381f1d6b8184797ad142de49be225a8 P 0473d2b2d01f4459b1e90fd12cc7840e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:55.050107 23066 raft_consensus.cc:697] T 179fd671030940b4b4a4e24bcc4aba0a P e61c3a8f61bb48f8a963c9480e53c168 [term 9 LEADER]: Becoming Leader. State: Replica: e61c3a8f61bb48f8a963c9480e53c168, State: Running, Role: LEADER
I20260709 13:05:54.984972 22882 raft_consensus.cc:3060] T edd7d470b5014c9489be7f41f64355c9 P 0473d2b2d01f4459b1e90fd12cc7840e [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:05:55.004769 23262 consensus_queue.cc:1059] T 4af19371ea874c09a0a2147040835cbb P e5256d91808b47c195bc9b4dbd7f2b87 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.135s
I20260709 13:05:55.108991 20078 leader_election.cc:304] T 172b3dd13109415a955b71ac0e9d2234 P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, 127766fc592545a4997f7790f50f6076; no voters: e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:05:55.022711 23236 raft_consensus.cc:2804] T 7f575b143b844aa096b50997dad3516a P e5256d91808b47c195bc9b4dbd7f2b87 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:05:55.113159 19552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28af091831594f9d8e96482078cc7625" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:05:54.966324 23260 raft_consensus.cc:515] T 70797e5783b5454ab0d0eea663e791e3 P 127766fc592545a4997f7790f50f6076 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:05:55.099757 23273 raft_consensus.cc:3060] T 1f85fc4b527a48848e5faa083b604e36 P 127766fc592545a4997f7790f50f6076 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:05:55.111982 23275 raft_consensus.cc:493] T 2e36a9d6e29c4a7c860cf267efbd4c74 P e5256d91808b47c195bc9b4dbd7f2b87 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:55.057570 23218 leader_election.cc:290] T ab43d85f64114d4ebf618930e43d9ed0 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:05:55.112933 22859 leader_election.cc:290] T 28af091831594f9d8e96482078cc7625 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:05:55.082509 23234 consensus_queue.cc:1048] T 70797e5783b5454ab0d0eea663e791e3 P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.065s
I20260709 13:05:55.110278 23278 raft_consensus.cc:2804] T 46c5bfeecc314717bffe987e6844b6d0 P e5256d91808b47c195bc9b4dbd7f2b87 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:05:55.149595 23278 raft_consensus.cc:493] T 46c5bfeecc314717bffe987e6844b6d0 P e5256d91808b47c195bc9b4dbd7f2b87 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 0473d2b2d01f4459b1e90fd12cc7840e)
I20260709 13:05:55.149924 23209 raft_consensus.cc:493] T 40e1e16737a842ee936002830f36882e P e61c3a8f61bb48f8a963c9480e53c168 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:55.150372 23209 raft_consensus.cc:515] T 40e1e16737a842ee936002830f36882e P e61c3a8f61bb48f8a963c9480e53c168 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:55.152415 23209 leader_election.cc:290] T 40e1e16737a842ee936002830f36882e P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
W20260709 13:05:55.119176 23272 log.cc:927] Time spent T ff9b0eddd810459b82d91c60777c10eb P 0473d2b2d01f4459b1e90fd12cc7840e: Append to log took a long time: real 0.135s	user 0.000s	sys 0.000s
I20260709 13:05:55.154754 23216 raft_consensus.cc:3060] T e381f1d6b8184797ad142de49be225a8 P 0473d2b2d01f4459b1e90fd12cc7840e [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:05:55.127056 23258 log.cc:927] Time spent T 172b3dd13109415a955b71ac0e9d2234 P 0473d2b2d01f4459b1e90fd12cc7840e: Append to log took a long time: real 0.192s	user 0.000s	sys 0.001s
I20260709 13:05:55.131274 22979 leader_election.cc:290] T 2b74109013a140ada21feeef92d6f563 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 6 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:05:55.131366 23260 leader_election.cc:290] T 70797e5783b5454ab0d0eea663e791e3 P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:05:55.133996 19403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70797e5783b5454ab0d0eea663e791e3" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:05:55.134493 23210 leader_election.cc:290] T 14935b3ddf914369822e4a0547aaa355 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 9 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:05:55.134691 23276 raft_consensus.cc:493] T 217b5fae677b4971b3bbd2f357a1f7ff P e5256d91808b47c195bc9b4dbd7f2b87 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 0473d2b2d01f4459b1e90fd12cc7840e)
I20260709 13:05:55.159013 23276 raft_consensus.cc:515] T 217b5fae677b4971b3bbd2f357a1f7ff P e5256d91808b47c195bc9b4dbd7f2b87 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:55.161234 23276 leader_election.cc:290] T 217b5fae677b4971b3bbd2f357a1f7ff P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:05:55.162034 23236 raft_consensus.cc:697] T 7f575b143b844aa096b50997dad3516a P e5256d91808b47c195bc9b4dbd7f2b87 [term 6 LEADER]: Becoming Leader. State: Replica: e5256d91808b47c195bc9b4dbd7f2b87, State: Running, Role: LEADER
I20260709 13:05:55.163177 23066 consensus_queue.cc:237] T 179fd671030940b4b4a4e24bcc4aba0a P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:55.164577 23236 consensus_queue.cc:237] T 7f575b143b844aa096b50997dad3516a P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:55.118928 23153 leader_election.cc:290] T 0e1085d23e8347fbbd5bce7542f4b1f4 P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 7 election: Requested vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
W20260709 13:05:55.135015 23264 log.cc:927] Time spent T 46c5bfeecc314717bffe987e6844b6d0 P e5256d91808b47c195bc9b4dbd7f2b87: Append to log took a long time: real 0.171s	user 0.000s	sys 0.001s
I20260709 13:05:55.137025 23275 raft_consensus.cc:515] T 2e36a9d6e29c4a7c860cf267efbd4c74 P e5256d91808b47c195bc9b4dbd7f2b87 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:55.005649 23088 leader_election.cc:290] T f1b10566f45d4a7d9029858330e02d5b P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
W20260709 13:05:55.142067 23223 consensus_meta.cc:287] T 65d8cb8d6ec64f459d5a47cefab10acf P e5256d91808b47c195bc9b4dbd7f2b87: Time spent flushing consensus metadata: real 0.914s	user 0.004s	sys 0.004s
I20260709 13:05:55.169008 19552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "217b5fae677b4971b3bbd2f357a1f7ff" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:05:55.171808 19552 raft_consensus.cc:2468] T 217b5fae677b4971b3bbd2f357a1f7ff P e61c3a8f61bb48f8a963c9480e53c168 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 6.
I20260709 13:05:55.122601 20078 leader_election.cc:304] T 775c229504194560ba9589bc2199b089 P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, 127766fc592545a4997f7790f50f6076; no voters: e5256d91808b47c195bc9b4dbd7f2b87
W20260709 13:05:55.168536 23034 consensus_meta.cc:287] T ef32ce6fdd0e40d382c79974f30295c6 P e61c3a8f61bb48f8a963c9480e53c168: Time spent flushing consensus metadata: real 0.545s	user 0.005s	sys 0.005s
I20260709 13:05:54.975453 22830 raft_consensus.cc:515] T 1dc5b3532fe54f74876d02beffa2c230 P e5256d91808b47c195bc9b4dbd7f2b87 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:55.121582 23286 raft_consensus.cc:2804] T 172b3dd13109415a955b71ac0e9d2234 P 127766fc592545a4997f7790f50f6076 [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 13:05:55.170403 23233 consensus_meta.cc:287] T ed7fdbcb96d14d418db9ca90a792588a P e61c3a8f61bb48f8a963c9480e53c168: Time spent flushing consensus metadata: real 0.702s	user 0.011s	sys 0.001s
I20260709 13:05:55.149953 23278 raft_consensus.cc:3060] T 46c5bfeecc314717bffe987e6844b6d0 P e5256d91808b47c195bc9b4dbd7f2b87 [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:05:55.176709 20078 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.2:46257, user_credentials={real_user=slave}} blocked reactor thread for 54379.2us
I20260709 13:05:55.220372 20078 leader_election.cc:304] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, 127766fc592545a4997f7790f50f6076; no voters: e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:05:55.223469 20078 leader_election.cc:304] T 6c5eebf646ad445a9d1b1adc319d7b16 P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 127766fc592545a4997f7790f50f6076; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:05:55.184334 23153 raft_consensus.cc:2804] T 775c229504194560ba9589bc2199b089 P 127766fc592545a4997f7790f50f6076 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:05:55.237874 22830 leader_election.cc:290] T 1dc5b3532fe54f74876d02beffa2c230 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:05:55.142566 23199 consensus_queue.cc:237] T ff75a1d4cb1f493db8f71ddc136ba9ab P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:55.220213 23286 raft_consensus.cc:493] T 172b3dd13109415a955b71ac0e9d2234 P 127766fc592545a4997f7790f50f6076 [term 8 FOLLOWER]: Starting leader election (detected failure of leader e5256d91808b47c195bc9b4dbd7f2b87)
I20260709 13:05:55.222579 23260 raft_consensus.cc:2764] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P 127766fc592545a4997f7790f50f6076 [term 11 FOLLOWER]: Leader pre-election decision vote started in defunct term 10: won
I20260709 13:05:55.142158 23255 raft_consensus.cc:515] T ff9b0eddd810459b82d91c60777c10eb P 127766fc592545a4997f7790f50f6076 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:05:55.175678 23195 raft_consensus.cc:515] T 96efeaaf1057492490e9a621f37e1a2d P e61c3a8f61bb48f8a963c9480e53c168 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:05:55.174243 23220 raft_consensus.cc:515] T 1f85fc4b527a48848e5faa083b604e36 P 0473d2b2d01f4459b1e90fd12cc7840e [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:05:55.183463 23034 raft_consensus.cc:515] T ef32ce6fdd0e40d382c79974f30295c6 P e61c3a8f61bb48f8a963c9480e53c168 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:55.227707 23233 raft_consensus.cc:515] T ed7fdbcb96d14d418db9ca90a792588a P e61c3a8f61bb48f8a963c9480e53c168 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:05:55.244680 23286 raft_consensus.cc:3060] T 172b3dd13109415a955b71ac0e9d2234 P 127766fc592545a4997f7790f50f6076 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:05:55.256238 23275 leader_election.cc:290] T 2e36a9d6e29c4a7c860cf267efbd4c74 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:05:55.264899 23273 raft_consensus.cc:515] T 1f85fc4b527a48848e5faa083b604e36 P 127766fc592545a4997f7790f50f6076 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:05:55.266455 23278 raft_consensus.cc:515] T 46c5bfeecc314717bffe987e6844b6d0 P e5256d91808b47c195bc9b4dbd7f2b87 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:55.268618 23278 leader_election.cc:290] T 46c5bfeecc314717bffe987e6844b6d0 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 16 election: Requested vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:05:55.272449 23286 raft_consensus.cc:515] T 172b3dd13109415a955b71ac0e9d2234 P 127766fc592545a4997f7790f50f6076 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:05:55.274223 23286 leader_election.cc:290] T 172b3dd13109415a955b71ac0e9d2234 P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 9 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:05:55.175606 19375 leader_election.cc:304] T 217b5fae677b4971b3bbd2f357a1f7ff P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
W20260709 13:05:55.317662 19376 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:05:55.317420 19375 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.3:36891, user_credentials={real_user=slave}} blocked reactor thread for 141755us
I20260709 13:05:55.318743 19377 leader_election.cc:304] T 7be9efa6559648dbb5a0f7684c4542d1 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:05:55.323791 19377 leader_election.cc:304] T 1a61655d99124a29b486ba4a5b37faea P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:05:55.333735 19479 raft_consensus.cc:1240] T 1f85fc4b527a48848e5faa083b604e36 P 0473d2b2d01f4459b1e90fd12cc7840e [term 7 FOLLOWER]: Rejecting Update request from peer e5256d91808b47c195bc9b4dbd7f2b87 for earlier term 6. Current term is 7. Ops: []
I20260709 13:05:55.339633 19552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dc5b3532fe54f74876d02beffa2c230" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:05:55.341104 19552 raft_consensus.cc:2468] T 1dc5b3532fe54f74876d02beffa2c230 P e61c3a8f61bb48f8a963c9480e53c168 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 9.
I20260709 13:05:55.343520 19558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e1085d23e8347fbbd5bce7542f4b1f4" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:05:55.343854 19477 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58286 (request call id 1848) took 1026 ms. Trace:
I20260709 13:05:55.344439 19477 rpcz_store.cc:276] 0709 13:05:54.316820 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:54.325922 (+  9102us) service_pool.cc:224] Handling call
0709 13:05:55.343400 (+1017478us) spinlock_profiling.cc:243] Waited 897 ms on lock 0x7b54001bf8d4. stack: 00007f4a79de9343 00007f4a79de9240 00007f4a797781d4 00007f4a834b6304 00007f4a834b6299 00007f4a7ce71571 00007f4a7cf0c2fa 00007f4a81ecdb17 00007f4a7b4486d4 00007f4a7b448662 00007f4a7b448591 00007f4a7b44850c 00007f4a7b4477c2 00007f4a7b24348c 00007f4a7b2428c6 00007f4a7b24226f
0709 13:05:55.343593 (+   193us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2062022400}
I20260709 13:05:55.345047 19558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab43d85f64114d4ebf618930e43d9ed0" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:05:55.346097 19558 raft_consensus.cc:2468] T ab43d85f64114d4ebf618930e43d9ed0 P e61c3a8f61bb48f8a963c9480e53c168 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 127766fc592545a4997f7790f50f6076 in term 9.
I20260709 13:05:55.347097 19551 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41504 (request call id 541) took 1084 ms. Trace:
I20260709 13:05:55.347582 19551 rpcz_store.cc:276] 0709 13:05:54.262628 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:54.262799 (+   171us) service_pool.cc:224] Handling call
0709 13:05:54.263168 (+   369us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:54.583403 (+320235us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:55.346460 (+763057us) spinlock_profiling.cc:243] Waited 255 ms on lock 0x7b5400319cd4. stack: 00007f4a79de9343 00007f4a79de9240 00007f4a797781d4 00007f4a834b6304 00007f4a834b6299 00007f4a7ce71571 00007f4a7cf08e01 00007f4a7cf0783e 00007f4a81ecc419 00007f4a7b443bd4 00007f4a7b443b62 00007f4a7b443a91 00007f4a7b443a0c 00007f4a7b442cc2 00007f4a7b24348c 00007f4a7b2428c6
0709 13:05:55.346858 (+   398us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":586400512}
I20260709 13:05:55.349895 19551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46c5bfeecc314717bffe987e6844b6d0" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 16 candidate_status { last_received { term: 15 index: 6 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:05:55.350924 19551 raft_consensus.cc:3060] T 46c5bfeecc314717bffe987e6844b6d0 P e61c3a8f61bb48f8a963c9480e53c168 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:05:55.342595 19552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62c6c134d3d24a1ab144dd9ee6bc3f64" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:05:55.352756 19485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ec1c4ce15e04c7e8c283a62179f2a64" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:05:55.353245 19402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "172b3dd13109415a955b71ac0e9d2234" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
I20260709 13:05:55.353819 19485 raft_consensus.cc:3060] T 5ec1c4ce15e04c7e8c283a62179f2a64 P 0473d2b2d01f4459b1e90fd12cc7840e [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:05:55.354074 19552 raft_consensus.cc:2393] T 62c6c134d3d24a1ab144dd9ee6bc3f64 P e61c3a8f61bb48f8a963c9480e53c168 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 127766fc592545a4997f7790f50f6076 in current term 9: Already voted for candidate e61c3a8f61bb48f8a963c9480e53c168 in this term.
I20260709 13:05:55.355120 19552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e36a9d6e29c4a7c860cf267efbd4c74" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:05:55.355193 19409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff9b0eddd810459b82d91c60777c10eb" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
W20260709 13:05:55.356799 19452 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:55.356668 19477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86a6797bdfe94fa496c050ceae4bd0d9" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:05:55.357909 19477 raft_consensus.cc:2393] T 86a6797bdfe94fa496c050ceae4bd0d9 P 0473d2b2d01f4459b1e90fd12cc7840e [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate e61c3a8f61bb48f8a963c9480e53c168 in current term 10: Already voted for candidate 0473d2b2d01f4459b1e90fd12cc7840e in this term.
I20260709 13:05:55.358197 19483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48824d5acfbc485ebf8c2d944e7202de" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:05:55.359148 19483 raft_consensus.cc:2376] T 48824d5acfbc485ebf8c2d944e7202de P 0473d2b2d01f4459b1e90fd12cc7840e [term 10 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 10. Re-sending same reply.
I20260709 13:05:55.360623 22758 raft_consensus.cc:493] T 2725d2c4cb054f18b0fc8f735c15f6c2 P e61c3a8f61bb48f8a963c9480e53c168 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader e5256d91808b47c195bc9b4dbd7f2b87)
I20260709 13:05:55.360725 19481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa8650e71aa14778b3d73721fc50d9fc" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:05:55.360982 19557 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41504 (request call id 545) took 1094 ms. Trace:
I20260709 13:05:55.361872 19481 raft_consensus.cc:2393] T fa8650e71aa14778b3d73721fc50d9fc P 0473d2b2d01f4459b1e90fd12cc7840e [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate e61c3a8f61bb48f8a963c9480e53c168 in current term 11: Already voted for candidate 0473d2b2d01f4459b1e90fd12cc7840e in this term.
I20260709 13:05:55.361400 22758 raft_consensus.cc:515] T 2725d2c4cb054f18b0fc8f735c15f6c2 P e61c3a8f61bb48f8a963c9480e53c168 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:55.362660 20105 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46422 (request call id 671) took 1112 ms. Trace:
I20260709 13:05:55.371263 20105 rpcz_store.cc:276] 0709 13:05:54.250538 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:54.250765 (+   227us) service_pool.cc:224] Handling call
0709 13:05:54.276863 (+ 26098us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:54.907047 (+630184us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:55.362187 (+455140us) spinlock_profiling.cc:243] Waited 627 ms on lock 0x7b54006202d4. stack: 00007f4a79de9343 00007f4a79de9240 00007f4a797781d4 00007f4a834b6304 00007f4a834b6299 00007f4a7ce71571 00007f4a7cf08e01 00007f4a7cf0783e 00007f4a81ecc419 00007f4a7b443bd4 00007f4a7b443b62 00007f4a7b443a91 00007f4a7b443a0c 00007f4a7b442cc2 00007f4a7b24348c 00007f4a7b2428c6
0709 13:05:55.362404 (+   217us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1441335040}
I20260709 13:05:55.375398 22821 raft_consensus.cc:2804] T 217b5fae677b4971b3bbd2f357a1f7ff P e5256d91808b47c195bc9b4dbd7f2b87 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:05:55.375805 22821 raft_consensus.cc:493] T 217b5fae677b4971b3bbd2f357a1f7ff P e5256d91808b47c195bc9b4dbd7f2b87 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 0473d2b2d01f4459b1e90fd12cc7840e)
I20260709 13:05:55.376157 22821 raft_consensus.cc:3060] T 217b5fae677b4971b3bbd2f357a1f7ff P e5256d91808b47c195bc9b4dbd7f2b87 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:05:55.380000 19560 raft_consensus.cc:1240] T 96efeaaf1057492490e9a621f37e1a2d P e61c3a8f61bb48f8a963c9480e53c168 [term 11 FOLLOWER]: Rejecting Update request from peer 127766fc592545a4997f7790f50f6076 for earlier term 10. Current term is 11. Ops: [8.8-10.9]
W20260709 13:05:55.364328 19524 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:55.383510 19556 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40438 (request call id 2171) took 1443 ms. Trace:
I20260709 13:05:55.383950 19556 rpcz_store.cc:276] 0709 13:05:53.940296 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:53.940555 (+   259us) service_pool.cc:224] Handling call
0709 13:05:55.383115 (+1442560us) spinlock_profiling.cc:243] Waited 671 ms on lock 0x7b540012a554. stack: 00007f4a79de9343 00007f4a79de9240 00007f4a797781d4 00007f4a834b6304 00007f4a834b6299 00007f4a7ce71571 00007f4a7cf0c2fa 00007f4a81ecdb17 00007f4a7b4486d4 00007f4a7b448662 00007f4a7b448591 00007f4a7b44850c 00007f4a7b4477c2 00007f4a7b24348c 00007f4a7b2428c6 00007f4a7b24226f
0709 13:05:55.383299 (+   184us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1543976704}
I20260709 13:05:55.388253 19523 leader_election.cc:304] T 22196caba61445d3bec98a0aab3c337d P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e61c3a8f61bb48f8a963c9480e53c168; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87
W20260709 13:05:55.396297 19410 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49050 (request call id 532) took 1778 ms (client timeout 1858 ms). Trace:
I20260709 13:05:55.396895 19558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef32ce6fdd0e40d382c79974f30295c6" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:05:55.398063 19555 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40428 (request call id 2288) took 1164 ms. Trace:
I20260709 13:05:55.398319 19558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76cb037fc9064d13b59a8969d897ce8c" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
W20260709 13:05:55.396757 19410 rpcz_store.cc:269] 0709 13:05:53.617664 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:53.620000 (+  2336us) service_pool.cc:224] Handling call
0709 13:05:55.395927 (+1775927us) spinlock_profiling.cc:243] Waited 995 ms on lock 0x7b540019f854. stack: 00007f4a79de9343 00007f4a79de9240 00007f4a797781d4 00007f4a834b6304 00007f4a834b6299 00007f4a7ce71571 00007f4a7cf0c2fa 00007f4a81ecdb17 00007f4a7b4486d4 00007f4a7b448662 00007f4a7b448591 00007f4a7b44850c 00007f4a7b4477c2 00007f4a7b24348c 00007f4a7b2428c6 00007f4a7b24226f
0709 13:05:55.396132 (+   205us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2289527552}
I20260709 13:05:55.400290 19560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b08304a0a02b42d7840c4e8ee9a6bd1a" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:05:55.398437 19555 rpcz_store.cc:276] 0709 13:05:54.234007 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:54.234193 (+   186us) service_pool.cc:224] Handling call
0709 13:05:55.397687 (+1163494us) spinlock_profiling.cc:243] Waited 44.3 ms on lock 0x7b54002e8bd4. stack: 00007f4a79de9343 00007f4a79de9240 00007f4a797781d4 00007f4a834b6304 00007f4a834b6299 00007f4a7ce71571 00007f4a7cf0c2fa 00007f4a81ecdb17 00007f4a7b4486d4 00007f4a7b448662 00007f4a7b448591 00007f4a7b44850c 00007f4a7b4477c2 00007f4a7b24348c 00007f4a7b2428c6 00007f4a7b24226f
0709 13:05:55.397870 (+   183us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":101912320}
I20260709 13:05:55.401019 19560 raft_consensus.cc:3060] T b08304a0a02b42d7840c4e8ee9a6bd1a P e61c3a8f61bb48f8a963c9480e53c168 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:05:55.402421 19555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28af091831594f9d8e96482078cc7625" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:05:55.403744 19558 raft_consensus.cc:2393] T 76cb037fc9064d13b59a8969d897ce8c P e61c3a8f61bb48f8a963c9480e53c168 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 0473d2b2d01f4459b1e90fd12cc7840e in current term 9: Already voted for candidate e5256d91808b47c195bc9b4dbd7f2b87 in this term.
I20260709 13:05:55.404708 19556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70797e5783b5454ab0d0eea663e791e3" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:05:55.364813 22758 leader_election.cc:290] T 2725d2c4cb054f18b0fc8f735c15f6c2 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:05:55.368161 19481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df751f992649444090e27965eb1af85d" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:05:55.361403 19557 rpcz_store.cc:276] 0709 13:05:54.266239 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:54.266785 (+   546us) service_pool.cc:224] Handling call
0709 13:05:54.267122 (+   337us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:54.828650 (+561528us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:55.360410 (+531760us) spinlock_profiling.cc:243] Waited 553 ms on lock 0x7b540002f3d4. stack: 00007f4a79de9343 00007f4a79de9240 00007f4a797781d4 00007f4a834b6304 00007f4a834b6299 00007f4a7ce71571 00007f4a7cf08e01 00007f4a7cf0783e 00007f4a81ecc419 00007f4a7b443bd4 00007f4a7b443b62 00007f4a7b443a91 00007f4a7b443a0c 00007f4a7b442cc2 00007f4a7b24348c 00007f4a7b2428c6
0709 13:05:55.360807 (+   397us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1271575296}
I20260709 13:05:55.369313 19483 pending_rounds.cc:85] T 2e36a9d6e29c4a7c860cf267efbd4c74 P 0473d2b2d01f4459b1e90fd12cc7840e: Aborting all ops after (but not including) 4
I20260709 13:05:55.367866 19480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7be9efa6559648dbb5a0f7684c4542d1" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:05:55.410176 19483 pending_rounds.cc:107] T 2e36a9d6e29c4a7c860cf267efbd4c74 P 0473d2b2d01f4459b1e90fd12cc7840e: Aborting uncommitted NO_OP operation due to leader change: 7.5
I20260709 13:05:55.365159 19486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cdf56e38bbc453d9438d359e5a69955" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:05:55.410502 19483 raft_consensus.cc:2889] T 2e36a9d6e29c4a7c860cf267efbd4c74 P 0473d2b2d01f4459b1e90fd12cc7840e [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:05:55.431095 19451 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:55.435117 19557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df751f992649444090e27965eb1af85d" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:05:55.435343 23286 raft_consensus.cc:493] T 7be9efa6559648dbb5a0f7684c4542d1 P 127766fc592545a4997f7790f50f6076 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 0473d2b2d01f4459b1e90fd12cc7840e)
I20260709 13:05:55.436225 19557 raft_consensus.cc:3060] T df751f992649444090e27965eb1af85d P e61c3a8f61bb48f8a963c9480e53c168 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:05:55.436532 23286 raft_consensus.cc:515] T 7be9efa6559648dbb5a0f7684c4542d1 P 127766fc592545a4997f7790f50f6076 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } attrs { replace: true } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:05:55.437000 23210 raft_consensus.cc:493] T 65d8cb8d6ec64f459d5a47cefab10acf P e61c3a8f61bb48f8a963c9480e53c168 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader e5256d91808b47c195bc9b4dbd7f2b87)
I20260709 13:05:55.437193 23220 leader_election.cc:290] T 1f85fc4b527a48848e5faa083b604e36 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 7 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:05:55.444700 22974 raft_consensus.cc:3055] T b9f0d59553ad444883fcf5b5909f9798 P e61c3a8f61bb48f8a963c9480e53c168 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:05:55.445212 22974 raft_consensus.cc:740] T b9f0d59553ad444883fcf5b5909f9798 P e61c3a8f61bb48f8a963c9480e53c168 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: e61c3a8f61bb48f8a963c9480e53c168, State: Running, Role: LEADER
I20260709 13:05:55.446204 23259 consensus_queue.cc:1059] T b9f0d59553ad444883fcf5b5909f9798 P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:05:55.447011 23212 raft_consensus.cc:2749] T 22196caba61445d3bec98a0aab3c337d P e61c3a8f61bb48f8a963c9480e53c168 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:05:55.431033 23236 raft_consensus.cc:2749] T 1a61655d99124a29b486ba4a5b37faea P e5256d91808b47c195bc9b4dbd7f2b87 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:05:55.426282 19377 leader_election.cc:304] T 86a6797bdfe94fa496c050ceae4bd0d9 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:05:55.437873 23210 raft_consensus.cc:515] T 65d8cb8d6ec64f459d5a47cefab10acf P e61c3a8f61bb48f8a963c9480e53c168 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:05:55.472695 22974 consensus_queue.cc:260] T b9f0d59553ad444883fcf5b5909f9798 P e61c3a8f61bb48f8a963c9480e53c168 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
W20260709 13:05:55.474133 23143 consensus_meta.cc:287] T 179fd671030940b4b4a4e24bcc4aba0a P e5256d91808b47c195bc9b4dbd7f2b87: Time spent flushing consensus metadata: real 0.668s	user 0.006s	sys 0.003s
I20260709 13:05:55.475011 23143 raft_consensus.cc:515] T 179fd671030940b4b4a4e24bcc4aba0a P e5256d91808b47c195bc9b4dbd7f2b87 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:55.477106 23034 leader_election.cc:290] T ef32ce6fdd0e40d382c79974f30295c6 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 12 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:05:55.477986 19554 raft_consensus.cc:1240] T ef32ce6fdd0e40d382c79974f30295c6 P e61c3a8f61bb48f8a963c9480e53c168 [term 12 FOLLOWER]: Rejecting Update request from peer e5256d91808b47c195bc9b4dbd7f2b87 for earlier term 11. Current term is 12. Ops: [11.7-11.7]
I20260709 13:05:55.478542 19480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b74109013a140ada21feeef92d6f563" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
W20260709 13:05:55.484072 19375 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.3:36891, user_credentials={real_user=slave}} blocked reactor thread for 69832.1us
I20260709 13:05:55.482722 19523 leader_election.cc:400] T b08304a0a02b42d7840c4e8ee9a6bd1a P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 11 election: Vote denied by peer e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321) with higher term. Message: Invalid argument: T b08304a0a02b42d7840c4e8ee9a6bd1a P e5256d91808b47c195bc9b4dbd7f2b87 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate e61c3a8f61bb48f8a963c9480e53c168 for earlier term 11. Current term is 12.
I20260709 13:05:55.485693 19523 leader_election.cc:403] T b08304a0a02b42d7840c4e8ee9a6bd1a P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 11 election: Cancelling election due to peer responding with higher term
I20260709 13:05:55.486889 23218 raft_consensus.cc:2749] T 7be9efa6559648dbb5a0f7684c4542d1 P e5256d91808b47c195bc9b4dbd7f2b87 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:05:55.245879 23153 raft_consensus.cc:697] T 775c229504194560ba9589bc2199b089 P 127766fc592545a4997f7790f50f6076 [term 8 LEADER]: Becoming Leader. State: Replica: 127766fc592545a4997f7790f50f6076, State: Running, Role: LEADER
I20260709 13:05:55.483857 19556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86a6797bdfe94fa496c050ceae4bd0d9" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:05:55.492411 19485 raft_consensus.cc:2468] T 5ec1c4ce15e04c7e8c283a62179f2a64 P 0473d2b2d01f4459b1e90fd12cc7840e [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 9.
W20260709 13:05:55.499356 19452 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:05:55.499573 19525 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:05:55.501516 19523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.1:40321, user_credentials={real_user=slave}} blocked reactor thread for 60659.1us
I20260709 13:05:55.503126 19556 raft_consensus.cc:2393] T 86a6797bdfe94fa496c050ceae4bd0d9 P e61c3a8f61bb48f8a963c9480e53c168 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 0473d2b2d01f4459b1e90fd12cc7840e in current term 10: Already voted for candidate e61c3a8f61bb48f8a963c9480e53c168 in this term.
I20260709 13:05:55.503509 19523 leader_election.cc:304] T 217b5fae677b4971b3bbd2f357a1f7ff P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e61c3a8f61bb48f8a963c9480e53c168; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:05:55.508092 23283 raft_consensus.cc:2749] T 217b5fae677b4971b3bbd2f357a1f7ff P e61c3a8f61bb48f8a963c9480e53c168 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:05:55.508487 23093 raft_consensus.cc:3055] T 28af091831594f9d8e96482078cc7625 P e61c3a8f61bb48f8a963c9480e53c168 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:05:55.508951 23093 raft_consensus.cc:740] T 28af091831594f9d8e96482078cc7625 P e61c3a8f61bb48f8a963c9480e53c168 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: e61c3a8f61bb48f8a963c9480e53c168, State: Running, Role: LEADER
I20260709 13:05:55.501556 23210 leader_election.cc:290] T 65d8cb8d6ec64f459d5a47cefab10acf P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:05:55.513772 19555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f93ee515a9c14139bf566522ed8232f3" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 13 candidate_status { last_received { term: 12 index: 5 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:05:55.515718 23210 raft_consensus.cc:493] T ece3db938bc649d4a40a51522ed5259c P e61c3a8f61bb48f8a963c9480e53c168 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader e5256d91808b47c195bc9b4dbd7f2b87)
I20260709 13:05:55.516434 23210 raft_consensus.cc:515] T ece3db938bc649d4a40a51522ed5259c P e61c3a8f61bb48f8a963c9480e53c168 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:05:55.518011 19560 raft_consensus.cc:2468] T b08304a0a02b42d7840c4e8ee9a6bd1a P e61c3a8f61bb48f8a963c9480e53c168 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 12.
I20260709 13:05:55.519191 23210 leader_election.cc:290] T ece3db938bc649d4a40a51522ed5259c P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:05:55.519390 19410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7be9efa6559648dbb5a0f7684c4542d1" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:05:55.520267 19410 raft_consensus.cc:2468] T 7be9efa6559648dbb5a0f7684c4542d1 P e5256d91808b47c195bc9b4dbd7f2b87 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 127766fc592545a4997f7790f50f6076 in term 9.
I20260709 13:05:55.521247 23210 consensus_queue.cc:1059] T 0e1085d23e8347fbbd5bce7542f4b1f4 P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:05:55.483850 22821 raft_consensus.cc:515] T 217b5fae677b4971b3bbd2f357a1f7ff P e5256d91808b47c195bc9b4dbd7f2b87 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
W20260709 13:05:55.522990 19377 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.2:46257, user_credentials={real_user=slave}} blocked reactor thread for 196484us
I20260709 13:05:55.524008 19404 raft_consensus.cc:1240] T 217b5fae677b4971b3bbd2f357a1f7ff P e5256d91808b47c195bc9b4dbd7f2b87 [term 7 FOLLOWER]: Rejecting Update request from peer 0473d2b2d01f4459b1e90fd12cc7840e for earlier term 6. Current term is 7. Ops: []
I20260709 13:05:55.525346 19377 leader_election.cc:400] T ff75a1d4cb1f493db8f71ddc136ba9ab P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 9 election: Vote denied by peer 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257) with higher term. Message: Invalid argument: T ff75a1d4cb1f493db8f71ddc136ba9ab P 0473d2b2d01f4459b1e90fd12cc7840e [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate e5256d91808b47c195bc9b4dbd7f2b87 for earlier term 9. Current term is 10.
I20260709 13:05:55.525765 19377 leader_election.cc:403] T ff75a1d4cb1f493db8f71ddc136ba9ab P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 9 election: Cancelling election due to peer responding with higher term
I20260709 13:05:55.527652 23153 consensus_queue.cc:237] T 775c229504194560ba9589bc2199b089 P 127766fc592545a4997f7790f50f6076 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:05:55.509049 19375 leader_election.cc:304] T 1dc5b3532fe54f74876d02beffa2c230 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:05:55.516711 23286 leader_election.cc:290] T 7be9efa6559648dbb5a0f7684c4542d1 P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:05:55.532799 19485 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58294 (request call id 2039) took 1014 ms. Trace:
I20260709 13:05:55.542264 19485 rpcz_store.cc:276] 0709 13:05:54.518653 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:54.518910 (+   257us) service_pool.cc:224] Handling call
0709 13:05:55.352223 (+833313us) spinlock_profiling.cc:243] Waited 7.28 ms on lock 0x7b58001b9998. stack: 00007f4a79de9343 00007f4a79de9240 00007f4a797781d4 00007f4a834b6304 00007f4a834b6299 00007f4a79ca3db1 00007f4a79de3b71 00007f4a79de3a22 00007f4a82cfcc09 00007f4a81e56ee0 00007f4a81f200ab 00007f4a81f20131 00007f4a81ece0a0 00007f4a81ecd984 00007f4a7b4486d4 00007f4a7b448662
0709 13:05:55.532727 (+180504us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":16745344}
I20260709 13:05:55.545255 19408 raft_consensus.cc:2368] T 179fd671030940b4b4a4e24bcc4aba0a P e5256d91808b47c195bc9b4dbd7f2b87 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate e61c3a8f61bb48f8a963c9480e53c168 for earlier term 9. Current term is 10.
I20260709 13:05:55.550065 19482 raft_consensus.cc:1275] T 21e14947d70440f19044d8f75c31e1f9 P 0473d2b2d01f4459b1e90fd12cc7840e [term 9 FOLLOWER]: Refusing update from remote peer e61c3a8f61bb48f8a963c9480e53c168: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:05:55.529757 22821 leader_election.cc:290] T 217b5fae677b4971b3bbd2f357a1f7ff P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 7 election: Requested vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:05:55.510284 23093 consensus_queue.cc:260] T 28af091831594f9d8e96482078cc7625 P e61c3a8f61bb48f8a963c9480e53c168 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:55.550526 19557 raft_consensus.cc:2468] T df751f992649444090e27965eb1af85d P e61c3a8f61bb48f8a963c9480e53c168 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 11.
W20260709 13:05:55.580856 19375 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.3:36891, user_credentials={real_user=slave}} blocked reactor thread for 71969.2us
I20260709 13:05:55.570911 19552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa8650e71aa14778b3d73721fc50d9fc" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:05:55.588893 19560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9f0d59553ad444883fcf5b5909f9798" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:05:55.551769 19480 raft_consensus.cc:2393] T 2b74109013a140ada21feeef92d6f563 P 0473d2b2d01f4459b1e90fd12cc7840e [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate e61c3a8f61bb48f8a963c9480e53c168 in current term 6: Already voted for candidate 0473d2b2d01f4459b1e90fd12cc7840e in this term.
I20260709 13:05:55.550719 19556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1efebf73c86e432baa55533136b6e12c" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:05:55.553766 19481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b08304a0a02b42d7840c4e8ee9a6bd1a" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:05:55.551262 19482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef32ce6fdd0e40d382c79974f30295c6" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
W20260709 13:05:55.554615 23279 log.cc:927] Time spent T fa731b585f684a7fb2d106c50f143b83 P e61c3a8f61bb48f8a963c9480e53c168: Append to log took a long time: real 0.070s	user 0.000s	sys 0.000s
I20260709 13:05:55.540956 22758 raft_consensus.cc:493] T 1efebf73c86e432baa55533136b6e12c P e61c3a8f61bb48f8a963c9480e53c168 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 127766fc592545a4997f7790f50f6076)
I20260709 13:05:55.574542 23236 raft_consensus.cc:2749] T ff75a1d4cb1f493db8f71ddc136ba9ab P e5256d91808b47c195bc9b4dbd7f2b87 [term 10 FOLLOWER]: Leader election lost for term 9. Reason: Vote denied by peer 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257) with higher term. Message: Invalid argument: T ff75a1d4cb1f493db8f71ddc136ba9ab P 0473d2b2d01f4459b1e90fd12cc7840e [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate e5256d91808b47c195bc9b4dbd7f2b87 for earlier term 9. Current term is 10.
I20260709 13:05:55.553535 23233 leader_election.cc:290] T ed7fdbcb96d14d418db9ca90a792588a P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 7 election: Requested vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:05:55.601917 19557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc225c93219c45538b53a1bd3d387e4d" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:05:55.551795 23275 raft_consensus.cc:2749] T 86a6797bdfe94fa496c050ceae4bd0d9 P e5256d91808b47c195bc9b4dbd7f2b87 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:05:55.605525 19482 raft_consensus.cc:3060] T ef32ce6fdd0e40d382c79974f30295c6 P 0473d2b2d01f4459b1e90fd12cc7840e [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:05:55.554318 23249 raft_consensus.cc:2749] T 6c5eebf646ad445a9d1b1adc319d7b16 P 127766fc592545a4997f7790f50f6076 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:05:55.608994 19477 raft_consensus.cc:1275] T a08760e15aac4630a629431f56024dc8 P 0473d2b2d01f4459b1e90fd12cc7840e [term 11 FOLLOWER]: Refusing update from remote peer e61c3a8f61bb48f8a963c9480e53c168: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:05:55.610235 23140 raft_consensus.cc:2749] T b08304a0a02b42d7840c4e8ee9a6bd1a P e61c3a8f61bb48f8a963c9480e53c168 [term 12 FOLLOWER]: Leader election lost for term 11. Reason: Vote denied by peer e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321) with higher term. Message: Invalid argument: T b08304a0a02b42d7840c4e8ee9a6bd1a P e5256d91808b47c195bc9b4dbd7f2b87 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate e61c3a8f61bb48f8a963c9480e53c168 for earlier term 11. Current term is 12.
I20260709 13:05:55.610378 19450 leader_election.cc:304] T ef32ce6fdd0e40d382c79974f30295c6 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e; no voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:05:55.611300 19553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7be9efa6559648dbb5a0f7684c4542d1" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:05:55.612376 19553 raft_consensus.cc:2393] T 7be9efa6559648dbb5a0f7684c4542d1 P e61c3a8f61bb48f8a963c9480e53c168 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 127766fc592545a4997f7790f50f6076 in current term 10: Already voted for candidate e61c3a8f61bb48f8a963c9480e53c168 in this term.
W20260709 13:05:55.615482 19377 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.2:46257, user_credentials={real_user=slave}} blocked reactor thread for 90376.5us
I20260709 13:05:55.615895 23195 leader_election.cc:290] T 96efeaaf1057492490e9a621f37e1a2d P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 11 election: Requested vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:05:55.619824 23143 leader_election.cc:290] T 179fd671030940b4b4a4e24bcc4aba0a P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 10 election: Requested vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:05:55.554921 23223 consensus_queue.cc:1048] T ef32ce6fdd0e40d382c79974f30295c6 P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.052s
I20260709 13:05:55.631815 23178 raft_consensus.cc:2804] T 1dc5b3532fe54f74876d02beffa2c230 P e5256d91808b47c195bc9b4dbd7f2b87 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:05:55.632426 19410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f85fc4b527a48848e5faa083b604e36" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
I20260709 13:05:55.648464 19557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2725d2c4cb054f18b0fc8f735c15f6c2" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 11 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:05:55.626437 22758 raft_consensus.cc:515] T 1efebf73c86e432baa55533136b6e12c P e61c3a8f61bb48f8a963c9480e53c168 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:05:55.626024 23273 leader_election.cc:290] T 1f85fc4b527a48848e5faa083b604e36 P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 7 election: Requested vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321)
I20260709 13:05:55.650043 19552 raft_consensus.cc:2393] T fa8650e71aa14778b3d73721fc50d9fc P e61c3a8f61bb48f8a963c9480e53c168 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 0473d2b2d01f4459b1e90fd12cc7840e in current term 11: Already voted for candidate e61c3a8f61bb48f8a963c9480e53c168 in this term.
I20260709 13:05:55.659256 19556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b74109013a140ada21feeef92d6f563" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:05:55.648557 23178 raft_consensus.cc:493] T 1dc5b3532fe54f74876d02beffa2c230 P e5256d91808b47c195bc9b4dbd7f2b87 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:55.660425 23178 raft_consensus.cc:3060] T 1dc5b3532fe54f74876d02beffa2c230 P e5256d91808b47c195bc9b4dbd7f2b87 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:05:55.660493 19556 raft_consensus.cc:2393] T 2b74109013a140ada21feeef92d6f563 P e61c3a8f61bb48f8a963c9480e53c168 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 0473d2b2d01f4459b1e90fd12cc7840e in current term 6: Already voted for candidate e61c3a8f61bb48f8a963c9480e53c168 in this term.
I20260709 13:05:55.668032 19557 raft_consensus.cc:1240] T 7be9efa6559648dbb5a0f7684c4542d1 P e61c3a8f61bb48f8a963c9480e53c168 [term 10 FOLLOWER]: Rejecting Update request from peer 0473d2b2d01f4459b1e90fd12cc7840e for earlier term 9. Current term is 10. Ops: [9.7-9.7]
I20260709 13:05:55.669149 19557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "217b5fae677b4971b3bbd2f357a1f7ff" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:05:55.669494 22974 raft_consensus.cc:3060] T b9f0d59553ad444883fcf5b5909f9798 P e61c3a8f61bb48f8a963c9480e53c168 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:05:55.669813 19557 raft_consensus.cc:3060] T 217b5fae677b4971b3bbd2f357a1f7ff P e61c3a8f61bb48f8a963c9480e53c168 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:05:55.671964 23255 leader_election.cc:290] T ff9b0eddd810459b82d91c60777c10eb P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 9 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:05:55.677003 19551 raft_consensus.cc:2468] T 46c5bfeecc314717bffe987e6844b6d0 P e61c3a8f61bb48f8a963c9480e53c168 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 16.
I20260709 13:05:55.677604 19552 raft_consensus.cc:1240] T f1b10566f45d4a7d9029858330e02d5b P e61c3a8f61bb48f8a963c9480e53c168 [term 11 FOLLOWER]: Rejecting Update request from peer 0473d2b2d01f4459b1e90fd12cc7840e for earlier term 10. Current term is 11. Ops: []
I20260709 13:05:55.672747 19554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "179fd671030940b4b4a4e24bcc4aba0a" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:05:55.682596 19556 raft_consensus.cc:1240] T 46c5bfeecc314717bffe987e6844b6d0 P e61c3a8f61bb48f8a963c9480e53c168 [term 16 FOLLOWER]: Rejecting Update request from peer 0473d2b2d01f4459b1e90fd12cc7840e for earlier term 15. Current term is 16. Ops: []
I20260709 13:05:55.682408 22821 consensus_queue.cc:1059] T ef32ce6fdd0e40d382c79974f30295c6 P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:05:55.682953 23055 leader_election.cc:290] T 775c229504194560ba9589bc2199b089 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 8 election: Requested vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:05:55.683640 23131 raft_consensus.cc:3055] T 1efebf73c86e432baa55533136b6e12c P 127766fc592545a4997f7790f50f6076 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:05:55.684091 23131 raft_consensus.cc:740] T 1efebf73c86e432baa55533136b6e12c P 127766fc592545a4997f7790f50f6076 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 127766fc592545a4997f7790f50f6076, State: Running, Role: LEADER
I20260709 13:05:55.684495 19554 raft_consensus.cc:1240] T e381f1d6b8184797ad142de49be225a8 P e61c3a8f61bb48f8a963c9480e53c168 [term 8 LEADER]: Rejecting Update request from peer 0473d2b2d01f4459b1e90fd12cc7840e for earlier term 7. Current term is 8. Ops: []
I20260709 13:05:55.684772 23150 leader_election.cc:290] T 7be9efa6559648dbb5a0f7684c4542d1 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 10 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:05:55.685417 23131 consensus_queue.cc:260] T 1efebf73c86e432baa55533136b6e12c P 127766fc592545a4997f7790f50f6076 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:05:55.692916 19557 raft_consensus.cc:2468] T 217b5fae677b4971b3bbd2f357a1f7ff P e61c3a8f61bb48f8a963c9480e53c168 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 7.
I20260709 13:05:55.695061 19554 raft_consensus.cc:1240] T 217b5fae677b4971b3bbd2f357a1f7ff P e61c3a8f61bb48f8a963c9480e53c168 [term 7 FOLLOWER]: Rejecting Update request from peer 0473d2b2d01f4459b1e90fd12cc7840e for earlier term 6. Current term is 7. Ops: []
I20260709 13:05:55.680757 19555 raft_consensus.cc:2468] T f93ee515a9c14139bf566522ed8232f3 P e61c3a8f61bb48f8a963c9480e53c168 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 13.
I20260709 13:05:55.691404 19553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f575b143b844aa096b50997dad3516a" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:05:55.698808 19551 raft_consensus.cc:1240] T ed7fdbcb96d14d418db9ca90a792588a P e61c3a8f61bb48f8a963c9480e53c168 [term 7 FOLLOWER]: Rejecting Update request from peer 0473d2b2d01f4459b1e90fd12cc7840e for earlier term 6. Current term is 7. Ops: []
I20260709 13:05:55.699721 19553 raft_consensus.cc:2393] T 7f575b143b844aa096b50997dad3516a P e61c3a8f61bb48f8a963c9480e53c168 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0473d2b2d01f4459b1e90fd12cc7840e in current term 6: Already voted for candidate e5256d91808b47c195bc9b4dbd7f2b87 in this term.
I20260709 13:05:55.700498 19551 raft_consensus.cc:1240] T 2b74109013a140ada21feeef92d6f563 P e61c3a8f61bb48f8a963c9480e53c168 [term 6 FOLLOWER]: Rejecting Update request from peer e5256d91808b47c195bc9b4dbd7f2b87 for earlier term 5. Current term is 6. Ops: []
I20260709 13:05:55.702775 19552 raft_consensus.cc:1275] T 1dc5b3532fe54f74876d02beffa2c230 P e61c3a8f61bb48f8a963c9480e53c168 [term 9 FOLLOWER]: Refusing update from remote peer 0473d2b2d01f4459b1e90fd12cc7840e: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 13:05:55.684093 19478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40e1e16737a842ee936002830f36882e" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:05:55.686578 23131 raft_consensus.cc:3060] T 1efebf73c86e432baa55533136b6e12c P 127766fc592545a4997f7790f50f6076 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:05:55.711870 23190 raft_consensus.cc:3055] T 2a16f7501e2444fb86d4e2778e734e02 P e5256d91808b47c195bc9b4dbd7f2b87 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:05:55.718326 19555 raft_consensus.cc:1275] T 76cb037fc9064d13b59a8969d897ce8c P e61c3a8f61bb48f8a963c9480e53c168 [term 9 FOLLOWER]: Refusing update from remote peer e5256d91808b47c195bc9b4dbd7f2b87: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 13:05:55.715773 23228 raft_consensus.cc:493] T 6c5eebf646ad445a9d1b1adc319d7b16 P 0473d2b2d01f4459b1e90fd12cc7840e [term 8 FOLLOWER]: Starting pre-election (detected failure of leader e61c3a8f61bb48f8a963c9480e53c168)
I20260709 13:05:55.712373 23190 raft_consensus.cc:740] T 2a16f7501e2444fb86d4e2778e734e02 P e5256d91808b47c195bc9b4dbd7f2b87 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: e5256d91808b47c195bc9b4dbd7f2b87, State: Running, Role: LEADER
I20260709 13:05:55.725514 19559 raft_consensus.cc:1275] T 0afb57ae58a24a01850491d69f0213dd P e61c3a8f61bb48f8a963c9480e53c168 [term 10 FOLLOWER]: Refusing update from remote peer 0473d2b2d01f4459b1e90fd12cc7840e: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:05:55.725867 19375 leader_election.cc:304] T 46c5bfeecc314717bffe987e6844b6d0 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:05:55.728652 19377 leader_election.cc:304] T 9962423cb4e54fcfa5de01daf68a86e7 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, 127766fc592545a4997f7790f50f6076
I20260709 13:05:55.730026 19450 leader_election.cc:304] T 28af091831594f9d8e96482078cc7625 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e; no voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:05:55.737597 19482 raft_consensus.cc:2468] T ef32ce6fdd0e40d382c79974f30295c6 P 0473d2b2d01f4459b1e90fd12cc7840e [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 12.
W20260709 13:05:55.741681 19376 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:55.744988 20105 raft_consensus.cc:1240] T 172b3dd13109415a955b71ac0e9d2234 P 127766fc592545a4997f7790f50f6076 [term 9 FOLLOWER]: Rejecting Update request from peer e5256d91808b47c195bc9b4dbd7f2b87 for earlier term 8. Current term is 9. Ops: []
I20260709 13:05:55.746022 20110 raft_consensus.cc:1240] T 4af19371ea874c09a0a2147040835cbb P 127766fc592545a4997f7790f50f6076 [term 6 FOLLOWER]: Rejecting Update request from peer e5256d91808b47c195bc9b4dbd7f2b87 for earlier term 5. Current term is 6. Ops: []
I20260709 13:05:55.746887 20108 raft_consensus.cc:1240] T 1f85fc4b527a48848e5faa083b604e36 P 127766fc592545a4997f7790f50f6076 [term 7 FOLLOWER]: Rejecting Update request from peer e5256d91808b47c195bc9b4dbd7f2b87 for earlier term 6. Current term is 7. Ops: []
I20260709 13:05:55.747816 23104 raft_consensus.cc:2749] T ef32ce6fdd0e40d382c79974f30295c6 P 0473d2b2d01f4459b1e90fd12cc7840e [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:05:55.748224 22979 raft_consensus.cc:3055] T 0e1085d23e8347fbbd5bce7542f4b1f4 P e61c3a8f61bb48f8a963c9480e53c168 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:05:55.748687 22979 raft_consensus.cc:740] T 0e1085d23e8347fbbd5bce7542f4b1f4 P e61c3a8f61bb48f8a963c9480e53c168 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: e61c3a8f61bb48f8a963c9480e53c168, State: Running, Role: LEADER
I20260709 13:05:55.750882 23190 consensus_queue.cc:260] T 2a16f7501e2444fb86d4e2778e734e02 P e5256d91808b47c195bc9b4dbd7f2b87 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:05:55.752025 20111 raft_consensus.cc:1275] T 833a2f0775ed407a94b8924ce50adb63 P 127766fc592545a4997f7790f50f6076 [term 9 FOLLOWER]: Refusing update from remote peer e5256d91808b47c195bc9b4dbd7f2b87: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:05:55.752421 23091 raft_consensus.cc:3060] T 4af19371ea874c09a0a2147040835cbb P e5256d91808b47c195bc9b4dbd7f2b87 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:05:55.753870 19449 leader_election.cc:304] T f93ee515a9c14139bf566522ed8232f3 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87; no voters: 
I20260709 13:05:55.755000 19449 leader_election.cc:304] T b9f0d59553ad444883fcf5b5909f9798 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87; no voters: 
I20260709 13:05:55.756140 23220 raft_consensus.cc:2804] T b9f0d59553ad444883fcf5b5909f9798 P 0473d2b2d01f4459b1e90fd12cc7840e [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:05:55.756311 19449 leader_election.cc:304] T 86a6797bdfe94fa496c050ceae4bd0d9 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87; no voters: 
I20260709 13:05:55.756714 23220 raft_consensus.cc:697] T b9f0d59553ad444883fcf5b5909f9798 P 0473d2b2d01f4459b1e90fd12cc7840e [term 9 LEADER]: Becoming Leader. State: Replica: 0473d2b2d01f4459b1e90fd12cc7840e, State: Running, Role: LEADER
I20260709 13:05:55.757431 23083 raft_consensus.cc:2804] T 86a6797bdfe94fa496c050ceae4bd0d9 P 0473d2b2d01f4459b1e90fd12cc7840e [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:05:55.757498 19449 leader_election.cc:304] T fa8650e71aa14778b3d73721fc50d9fc P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87; no voters: 
I20260709 13:05:55.758206 23083 raft_consensus.cc:697] T 86a6797bdfe94fa496c050ceae4bd0d9 P 0473d2b2d01f4459b1e90fd12cc7840e [term 10 LEADER]: Becoming Leader. State: Replica: 0473d2b2d01f4459b1e90fd12cc7840e, State: Running, Role: LEADER
I20260709 13:05:55.755273 23238 raft_consensus.cc:2804] T f93ee515a9c14139bf566522ed8232f3 P 0473d2b2d01f4459b1e90fd12cc7840e [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:05:55.752501 23190 raft_consensus.cc:3060] T 2a16f7501e2444fb86d4e2778e734e02 P e5256d91808b47c195bc9b4dbd7f2b87 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:05:55.749904 22979 consensus_queue.cc:260] T 0e1085d23e8347fbbd5bce7542f4b1f4 P e61c3a8f61bb48f8a963c9480e53c168 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:05:55.757731 23220 consensus_queue.cc:237] T b9f0d59553ad444883fcf5b5909f9798 P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:55.776539 23245 raft_consensus.cc:2749] T 9962423cb4e54fcfa5de01daf68a86e7 P e5256d91808b47c195bc9b4dbd7f2b87 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:05:55.777828 19375 leader_election.cc:304] T 217b5fae677b4971b3bbd2f357a1f7ff P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
W20260709 13:05:55.776737 19377 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.2:46257, user_credentials={real_user=slave}} blocked reactor thread for 54374.9us
I20260709 13:05:55.778173 22979 raft_consensus.cc:3060] T 0e1085d23e8347fbbd5bce7542f4b1f4 P e61c3a8f61bb48f8a963c9480e53c168 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:05:55.787014 23093 raft_consensus.cc:3060] T 28af091831594f9d8e96482078cc7625 P e61c3a8f61bb48f8a963c9480e53c168 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:05:55.787547 23083 consensus_queue.cc:237] T 86a6797bdfe94fa496c050ceae4bd0d9 P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.4, Last appended by leader: 4, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:55.789543 23051 raft_consensus.cc:2749] T 28af091831594f9d8e96482078cc7625 P 0473d2b2d01f4459b1e90fd12cc7840e [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:05:55.779065 23275 raft_consensus.cc:2804] T 46c5bfeecc314717bffe987e6844b6d0 P e5256d91808b47c195bc9b4dbd7f2b87 [term 16 FOLLOWER]: Leader election won for term 16
W20260709 13:05:55.790966 19450 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.3:36891, user_credentials={real_user=slave}} blocked reactor thread for 92682.9us
I20260709 13:05:55.791352 20110 raft_consensus.cc:1240] T 2a16f7501e2444fb86d4e2778e734e02 P 127766fc592545a4997f7790f50f6076 [term 11 FOLLOWER]: Rejecting Update request from peer e5256d91808b47c195bc9b4dbd7f2b87 for earlier term 10. Current term is 11. Ops: [10.9-10.9]
I20260709 13:05:55.791815 19450 leader_election.cc:304] T 76cb037fc9064d13b59a8969d897ce8c P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e; no voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:05:55.779654 20108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab43d85f64114d4ebf618930e43d9ed0" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:05:55.792649 20108 raft_consensus.cc:2468] T ab43d85f64114d4ebf618930e43d9ed0 P 127766fc592545a4997f7790f50f6076 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 9.
I20260709 13:05:55.793512 23275 raft_consensus.cc:697] T 46c5bfeecc314717bffe987e6844b6d0 P e5256d91808b47c195bc9b4dbd7f2b87 [term 16 LEADER]: Becoming Leader. State: Replica: e5256d91808b47c195bc9b4dbd7f2b87, State: Running, Role: LEADER
I20260709 13:05:55.782348 23216 raft_consensus.cc:2804] T fa8650e71aa14778b3d73721fc50d9fc P 0473d2b2d01f4459b1e90fd12cc7840e [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:05:55.783113 23225 consensus_queue.cc:1059] T 2b74109013a140ada21feeef92d6f563 P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.009s
I20260709 13:05:55.779790 20105 raft_consensus.cc:1275] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P 127766fc592545a4997f7790f50f6076 [term 11 FOLLOWER]: Refusing update from remote peer e5256d91808b47c195bc9b4dbd7f2b87: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:05:55.792661 23224 leader_election.cc:290] T 14efcc79969f41babe5529c22d59156d P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:05:55.803002 23122 raft_consensus.cc:3055] T 2b74109013a140ada21feeef92d6f563 P e5256d91808b47c195bc9b4dbd7f2b87 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:05:55.803488 23122 raft_consensus.cc:740] T 2b74109013a140ada21feeef92d6f563 P e5256d91808b47c195bc9b4dbd7f2b87 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: e5256d91808b47c195bc9b4dbd7f2b87, State: Running, Role: LEADER
I20260709 13:05:55.804680 23122 consensus_queue.cc:260] T 2b74109013a140ada21feeef92d6f563 P e5256d91808b47c195bc9b4dbd7f2b87 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:55.805763 23122 raft_consensus.cc:3060] T 2b74109013a140ada21feeef92d6f563 P e5256d91808b47c195bc9b4dbd7f2b87 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:05:55.805655 23178 raft_consensus.cc:515] T 1dc5b3532fe54f74876d02beffa2c230 P e5256d91808b47c195bc9b4dbd7f2b87 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:55.722625 23228 raft_consensus.cc:515] T 6c5eebf646ad445a9d1b1adc319d7b16 P 0473d2b2d01f4459b1e90fd12cc7840e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:05:55.808068 19410 raft_consensus.cc:1275] T 2e36a9d6e29c4a7c860cf267efbd4c74 P e5256d91808b47c195bc9b4dbd7f2b87 [term 8 FOLLOWER]: Refusing update from remote peer e61c3a8f61bb48f8a963c9480e53c168: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:05:55.809970 23228 leader_election.cc:290] T 6c5eebf646ad445a9d1b1adc319d7b16 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:05:55.811409 19377 leader_election.cc:304] T 309c3ca0ca4b4f3ba129752ea2cb293b P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168; no voters: 127766fc592545a4997f7790f50f6076
I20260709 13:05:55.812271 19410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85c494af21f9457a85da47b9bc70c1fd" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
I20260709 13:05:55.814150 23218 raft_consensus.cc:2804] T 309c3ca0ca4b4f3ba129752ea2cb293b P e5256d91808b47c195bc9b4dbd7f2b87 [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 13:05:55.825747 19376 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:55.857653 19404 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52342 (request call id 2338) took 1380 ms. Trace:
W20260709 13:05:55.844830 19449 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.1:40321, user_credentials={real_user=slave}} blocked reactor thread for 73179.1us
I20260709 13:05:55.818848 19479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14935b3ddf914369822e4a0547aaa355" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
W20260709 13:05:55.865811 19452 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:55.858147 19404 rpcz_store.cc:276] 0709 13:05:54.438131 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:54.511742 (+ 73611us) service_pool.cc:224] Handling call
0709 13:05:55.399161 (+887419us) spinlock_profiling.cc:243] Waited 6.09 ms on lock 0x7b5800183c98. stack: 00007f4a79de9343 00007f4a79de9240 00007f4a797781d4 00007f4a834b6304 00007f4a834b6299 00007f4a79ca3db1 00007f4a79de3b71 00007f4a79de3a22 00007f4a82cfcc09 00007f4a81e56ee0 00007f4a81f200ab 00007f4a81f20131 00007f4a81ee1fc0 00007f4a81ecc929 00007f4a81ecc3d2 00007f4a7b443bd4
0709 13:05:55.399481 (+   320us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:55.524549 (+125068us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:55.798700 (+274151us) spinlock_profiling.cc:243] Waited 124 ms on lock 0x7b5400182254. stack: 00007f4a79de9343 00007f4a79de9240 00007f4a797781d4 00007f4a834b6304 00007f4a834b6299 00007f4a7ce71571 00007f4a7cf08e01 00007f4a7cf0783e 00007f4a81ecc419 00007f4a7b443bd4 00007f4a7b443b62 00007f4a7b443a91 00007f4a7b443a0c 00007f4a7b442cc2 00007f4a7b24348c 00007f4a7b2428c6
0709 13:05:55.818822 (+ 20122us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":299415296}
W20260709 13:05:55.871733 19377 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.2:46257, user_credentials={real_user=slave}} blocked reactor thread for 57522.5us
I20260709 13:05:55.814638 23218 raft_consensus.cc:493] T 309c3ca0ca4b4f3ba129752ea2cb293b P e5256d91808b47c195bc9b4dbd7f2b87 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 0473d2b2d01f4459b1e90fd12cc7840e)
I20260709 13:05:55.805702 22758 leader_election.cc:290] T 1efebf73c86e432baa55533136b6e12c P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:05:55.877254 19408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df751f992649444090e27965eb1af85d" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
I20260709 13:05:55.880362 23089 raft_consensus.cc:3060] T f1b10566f45d4a7d9029858330e02d5b P 0473d2b2d01f4459b1e90fd12cc7840e [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:05:55.815501 23216 raft_consensus.cc:697] T fa8650e71aa14778b3d73721fc50d9fc P 0473d2b2d01f4459b1e90fd12cc7840e [term 11 LEADER]: Becoming Leader. State: Replica: 0473d2b2d01f4459b1e90fd12cc7840e, State: Running, Role: LEADER
I20260709 13:05:55.902518 19402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14935b3ddf914369822e4a0547aaa355" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
I20260709 13:05:55.903607 20103 raft_consensus.cc:1275] T 5ec1c4ce15e04c7e8c283a62179f2a64 P 127766fc592545a4997f7790f50f6076 [term 9 FOLLOWER]: Refusing update from remote peer e5256d91808b47c195bc9b4dbd7f2b87: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 13:05:55.882956 20105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "775c229504194560ba9589bc2199b089" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076"
I20260709 13:05:55.904654 19410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7be9efa6559648dbb5a0f7684c4542d1" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
W20260709 13:05:55.905198 19452 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:55.905386 19410 raft_consensus.cc:3060] T 7be9efa6559648dbb5a0f7684c4542d1 P e5256d91808b47c195bc9b4dbd7f2b87 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:05:55.903915 19406 raft_consensus.cc:1275] T a08760e15aac4630a629431f56024dc8 P e5256d91808b47c195bc9b4dbd7f2b87 [term 11 FOLLOWER]: Refusing update from remote peer e61c3a8f61bb48f8a963c9480e53c168: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:05:55.906149 23228 raft_consensus.cc:2749] T 76cb037fc9064d13b59a8969d897ce8c P 0473d2b2d01f4459b1e90fd12cc7840e [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:05:55.875572 20111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14935b3ddf914369822e4a0547aaa355" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076"
I20260709 13:05:55.906629 20110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85c494af21f9457a85da47b9bc70c1fd" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076"
I20260709 13:05:55.910627 23214 leader_election.cc:290] T 46c5bfeecc314717bffe987e6844b6d0 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:05:55.910475 23216 consensus_queue.cc:237] T fa8650e71aa14778b3d73721fc50d9fc P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:55.906163 23262 consensus_queue.cc:1048] T 3e1f505cb0f1427bbd698ac889d80821 P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.096s
I20260709 13:05:55.912415 19405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2725d2c4cb054f18b0fc8f735c15f6c2" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:05:55.913555 20109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ece3db938bc649d4a40a51522ed5259c" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:05:55.914259 20109 raft_consensus.cc:2468] T ece3db938bc649d4a40a51522ed5259c P 127766fc592545a4997f7790f50f6076 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 8.
I20260709 13:05:55.915545 19479 raft_consensus.cc:3060] T 14935b3ddf914369822e4a0547aaa355 P 0473d2b2d01f4459b1e90fd12cc7840e [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:05:55.915262 19404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40e1e16737a842ee936002830f36882e" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:05:55.883535 23225 raft_consensus.cc:493] T df751f992649444090e27965eb1af85d P e5256d91808b47c195bc9b4dbd7f2b87 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:55.875439 23218 raft_consensus.cc:3060] T 309c3ca0ca4b4f3ba129752ea2cb293b P e5256d91808b47c195bc9b4dbd7f2b87 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:05:55.914862 23307 log.cc:927] Time spent T 22196caba61445d3bec98a0aab3c337d P e61c3a8f61bb48f8a963c9480e53c168: Append to log took a long time: real 0.120s	user 0.000s	sys 0.001s
I20260709 13:05:55.794601 23275 consensus_queue.cc:237] T 46c5bfeecc314717bffe987e6844b6d0 P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 15.6, Last appended by leader: 6, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:55.961164 19404 raft_consensus.cc:2468] T 40e1e16737a842ee936002830f36882e P e5256d91808b47c195bc9b4dbd7f2b87 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 13.
I20260709 13:05:55.931003 19409 raft_consensus.cc:1275] T e381f1d6b8184797ad142de49be225a8 P e5256d91808b47c195bc9b4dbd7f2b87 [term 8 FOLLOWER]: Refusing update from remote peer e61c3a8f61bb48f8a963c9480e53c168: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:05:55.965338 20107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed7fdbcb96d14d418db9ca90a792588a" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076"
W20260709 13:05:55.967367 19526 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:55.968021 23243 raft_consensus.cc:2804] T 217b5fae677b4971b3bbd2f357a1f7ff P e5256d91808b47c195bc9b4dbd7f2b87 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:05:55.971028 20109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7be9efa6559648dbb5a0f7684c4542d1" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076"
I20260709 13:05:55.971597 20109 raft_consensus.cc:3060] T 7be9efa6559648dbb5a0f7684c4542d1 P 127766fc592545a4997f7790f50f6076 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:05:55.979651 19479 raft_consensus.cc:2468] T 14935b3ddf914369822e4a0547aaa355 P 0473d2b2d01f4459b1e90fd12cc7840e [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 9.
I20260709 13:05:55.974810 19406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65d8cb8d6ec64f459d5a47cefab10acf" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
W20260709 13:05:55.983006 19449 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.1:40321, user_credentials={real_user=slave}} blocked reactor thread for 60240us
W20260709 13:05:55.994060 19524 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:56.006138 20111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1efebf73c86e432baa55533136b6e12c" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:05:56.008174 19411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef32ce6fdd0e40d382c79974f30295c6" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
I20260709 13:05:56.015702 19406 raft_consensus.cc:2468] T 65d8cb8d6ec64f459d5a47cefab10acf P e5256d91808b47c195bc9b4dbd7f2b87 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 7.
I20260709 13:05:56.017092 19407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46c5bfeecc314717bffe987e6844b6d0" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 16 candidate_status { last_received { term: 15 index: 6 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:05:56.021327 20109 raft_consensus.cc:2410] T 7be9efa6559648dbb5a0f7684c4542d1 P 127766fc592545a4997f7790f50f6076 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate e61c3a8f61bb48f8a963c9480e53c168 for term 10 because replica has last-logged OpId of term: 9 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 6.
I20260709 13:05:56.022817 23276 consensus_queue.cc:1059] T 2725d2c4cb054f18b0fc8f735c15f6c2 P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 }, Status: INVALID_TERM, Last received: 8.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.205s
I20260709 13:05:56.023437 23178 leader_election.cc:290] T 1dc5b3532fe54f74876d02beffa2c230 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 10 election: Requested vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:05:56.023945 19410 raft_consensus.cc:2468] T 7be9efa6559648dbb5a0f7684c4542d1 P e5256d91808b47c195bc9b4dbd7f2b87 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 10.
W20260709 13:05:56.024410 20078 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:56.025202 20112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65d8cb8d6ec64f459d5a47cefab10acf" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:05:56.026469 20112 raft_consensus.cc:2393] T 65d8cb8d6ec64f459d5a47cefab10acf P 127766fc592545a4997f7790f50f6076 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e61c3a8f61bb48f8a963c9480e53c168 in current term 7: Already voted for candidate 127766fc592545a4997f7790f50f6076 in this term.
I20260709 13:05:56.022758 23275 raft_consensus.cc:493] T 65d8cb8d6ec64f459d5a47cefab10acf P e5256d91808b47c195bc9b4dbd7f2b87 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:05:56.034369 19451 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:05:56.047714 19526 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:56.000881 23243 raft_consensus.cc:697] T 217b5fae677b4971b3bbd2f357a1f7ff P e5256d91808b47c195bc9b4dbd7f2b87 [term 7 LEADER]: Becoming Leader. State: Replica: e5256d91808b47c195bc9b4dbd7f2b87, State: Running, Role: LEADER
W20260709 13:05:56.028066 19523 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.17.223.1:40321 timed out after 1.723s (SENT) [suppressed 34 similar messages]
W20260709 13:05:56.027321 23264 log.cc:927] Time spent T 46c5bfeecc314717bffe987e6844b6d0 P e5256d91808b47c195bc9b4dbd7f2b87: Append to log took a long time: real 0.066s	user 0.000s	sys 0.000s
W20260709 13:05:56.063405 19450 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.3:36891, user_credentials={real_user=slave}} blocked reactor thread for 271705us
I20260709 13:05:55.975378 23225 raft_consensus.cc:515] T df751f992649444090e27965eb1af85d P e5256d91808b47c195bc9b4dbd7f2b87 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:56.063854 19409 raft_consensus.cc:1275] T edd7d470b5014c9489be7f41f64355c9 P e5256d91808b47c195bc9b4dbd7f2b87 [term 11 FOLLOWER]: Refusing update from remote peer e61c3a8f61bb48f8a963c9480e53c168: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 11 index: 5. (index mismatch)
W20260709 13:05:56.068589 19449 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.1:40321, user_credentials={real_user=slave}} blocked reactor thread for 56600.7us
I20260709 13:05:56.072643 19410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ece3db938bc649d4a40a51522ed5259c" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:05:56.061213 23249 raft_consensus.cc:493] T 5ec1c4ce15e04c7e8c283a62179f2a64 P 127766fc592545a4997f7790f50f6076 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:56.069111 23238 raft_consensus.cc:697] T f93ee515a9c14139bf566522ed8232f3 P 0473d2b2d01f4459b1e90fd12cc7840e [term 13 LEADER]: Becoming Leader. State: Replica: 0473d2b2d01f4459b1e90fd12cc7840e, State: Running, Role: LEADER
I20260709 13:05:56.079362 19408 raft_consensus.cc:2368] T df751f992649444090e27965eb1af85d P e5256d91808b47c195bc9b4dbd7f2b87 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate e61c3a8f61bb48f8a963c9480e53c168 for earlier term 10. Current term is 11.
I20260709 13:05:56.076327 23083 consensus_queue.cc:1059] T 217b5fae677b4971b3bbd2f357a1f7ff P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.006s
I20260709 13:05:56.082864 23091 consensus_queue.cc:1059] T 1f85fc4b527a48848e5faa083b604e36 P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:05:56.083891 23091 raft_consensus.cc:3055] T 1f85fc4b527a48848e5faa083b604e36 P e5256d91808b47c195bc9b4dbd7f2b87 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:05:56.083171 23083 raft_consensus.cc:3055] T 217b5fae677b4971b3bbd2f357a1f7ff P 0473d2b2d01f4459b1e90fd12cc7840e [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:05:56.074976 19403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b74109013a140ada21feeef92d6f563" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
I20260709 13:05:56.085420 20106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96efeaaf1057492490e9a621f37e1a2d" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076"
I20260709 13:05:56.091758 23278 consensus_queue.cc:1048] T 833a2f0775ed407a94b8924ce50adb63 P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Connected to new peer: Peer: permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:05:56.094585 20111 raft_consensus.cc:2468] T 1efebf73c86e432baa55533136b6e12c P 127766fc592545a4997f7790f50f6076 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 9.
I20260709 13:05:56.065644 23275 raft_consensus.cc:515] T 65d8cb8d6ec64f459d5a47cefab10acf P e5256d91808b47c195bc9b4dbd7f2b87 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
W20260709 13:05:56.098760 19377 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.2:46257, user_credentials={real_user=slave}} blocked reactor thread for 189301us
I20260709 13:05:56.099364 19409 raft_consensus.cc:1240] T 179fd671030940b4b4a4e24bcc4aba0a P e5256d91808b47c195bc9b4dbd7f2b87 [term 10 FOLLOWER]: Rejecting Update request from peer e61c3a8f61bb48f8a963c9480e53c168 for earlier term 9. Current term is 10. Ops: []
W20260709 13:05:56.084734 23310 log.cc:927] Time spent T 6c5eebf646ad445a9d1b1adc319d7b16 P 0473d2b2d01f4459b1e90fd12cc7840e: Append to log took a long time: real 0.082s	user 0.000s	sys 0.001s
I20260709 13:05:56.086519 23091 raft_consensus.cc:740] T 1f85fc4b527a48848e5faa083b604e36 P e5256d91808b47c195bc9b4dbd7f2b87 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: e5256d91808b47c195bc9b4dbd7f2b87, State: Running, Role: LEADER
I20260709 13:05:56.088259 23083 raft_consensus.cc:740] T 217b5fae677b4971b3bbd2f357a1f7ff P 0473d2b2d01f4459b1e90fd12cc7840e [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 0473d2b2d01f4459b1e90fd12cc7840e, State: Running, Role: LEADER
W20260709 13:05:56.105950 20076 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.3:36891, user_credentials={real_user=slave}} blocked reactor thread for 88021.1us
I20260709 13:05:56.079180 23249 raft_consensus.cc:515] T 5ec1c4ce15e04c7e8c283a62179f2a64 P 127766fc592545a4997f7790f50f6076 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:05:56.125090 19377 leader_election.cc:304] T ab43d85f64114d4ebf618930e43d9ed0 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:05:56.135648 19560 raft_consensus.cc:2468] T b9f0d59553ad444883fcf5b5909f9798 P e61c3a8f61bb48f8a963c9480e53c168 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 9.
I20260709 13:05:56.139686 19407 raft_consensus.cc:1275] T 21e14947d70440f19044d8f75c31e1f9 P e5256d91808b47c195bc9b4dbd7f2b87 [term 9 FOLLOWER]: Refusing update from remote peer e61c3a8f61bb48f8a963c9480e53c168: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:05:56.147347 19409 raft_consensus.cc:1240] T 7be9efa6559648dbb5a0f7684c4542d1 P e5256d91808b47c195bc9b4dbd7f2b87 [term 10 FOLLOWER]: Rejecting Update request from peer 0473d2b2d01f4459b1e90fd12cc7840e for earlier term 9. Current term is 10. Ops: [7.6-9.7]
I20260709 13:05:56.137296 20076 leader_election.cc:304] T ab43d85f64114d4ebf618930e43d9ed0 P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 127766fc592545a4997f7790f50f6076, e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
W20260709 13:05:56.152997 19523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.1:40321, user_credentials={real_user=slave}} blocked reactor thread for 142043us
I20260709 13:05:56.123767 22830 consensus_queue.cc:1059] T 172b3dd13109415a955b71ac0e9d2234 P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.120s
I20260709 13:05:56.159492 22830 raft_consensus.cc:3055] T 172b3dd13109415a955b71ac0e9d2234 P e5256d91808b47c195bc9b4dbd7f2b87 [term 8 LEADER]: Stepping down as leader of term 8
W20260709 13:05:56.159955 23319 log.cc:927] Time spent T 48824d5acfbc485ebf8c2d944e7202de P 127766fc592545a4997f7790f50f6076: Append to log took a long time: real 0.078s	user 0.001s	sys 0.000s
W20260709 13:05:56.160370 20078 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:56.147563 23316 raft_consensus.cc:493] T 21e14947d70440f19044d8f75c31e1f9 P 0473d2b2d01f4459b1e90fd12cc7840e [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:56.167357 23027 raft_consensus.cc:493] T ff9b0eddd810459b82d91c60777c10eb P 0473d2b2d01f4459b1e90fd12cc7840e [term 8 FOLLOWER]: Starting pre-election (detected failure of leader e5256d91808b47c195bc9b4dbd7f2b87)
I20260709 13:05:56.168080 23027 raft_consensus.cc:515] T ff9b0eddd810459b82d91c60777c10eb P 0473d2b2d01f4459b1e90fd12cc7840e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:05:56.169899 22821 consensus_queue.cc:1048] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Connected to new peer: Peer: permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:05:56.139061 23243 consensus_queue.cc:237] T 217b5fae677b4971b3bbd2f357a1f7ff P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
W20260709 13:05:56.171998 19450 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.3:36891, user_credentials={real_user=slave}} blocked reactor thread for 68355.2us
I20260709 13:05:56.172410 20076 leader_election.cc:304] T 70797e5783b5454ab0d0eea663e791e3 P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 127766fc592545a4997f7790f50f6076; no voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:05:56.174019 23268 raft_consensus.cc:2804] T ab43d85f64114d4ebf618930e43d9ed0 P 127766fc592545a4997f7790f50f6076 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:05:56.167096 23316 raft_consensus.cc:515] T 21e14947d70440f19044d8f75c31e1f9 P 0473d2b2d01f4459b1e90fd12cc7840e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:56.159888 22830 raft_consensus.cc:740] T 172b3dd13109415a955b71ac0e9d2234 P e5256d91808b47c195bc9b4dbd7f2b87 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: e5256d91808b47c195bc9b4dbd7f2b87, State: Running, Role: LEADER
I20260709 13:05:56.176424 19374 leader_election.cc:304] T 775c229504194560ba9589bc2199b089 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, 127766fc592545a4997f7790f50f6076
I20260709 13:05:56.182914 19407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc225c93219c45538b53a1bd3d387e4d" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:05:56.174463 23268 raft_consensus.cc:493] T ab43d85f64114d4ebf618930e43d9ed0 P 127766fc592545a4997f7790f50f6076 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:56.183418 19450 leader_election.cc:304] T 2b74109013a140ada21feeef92d6f563 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e; no voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:05:56.123030 23091 consensus_queue.cc:260] T 1f85fc4b527a48848e5faa083b604e36 P e5256d91808b47c195bc9b4dbd7f2b87 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:05:56.175477 23254 raft_consensus.cc:2749] T 70797e5783b5454ab0d0eea663e791e3 P 127766fc592545a4997f7790f50f6076 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:05:56.155194 23276 raft_consensus.cc:2804] T ab43d85f64114d4ebf618930e43d9ed0 P e5256d91808b47c195bc9b4dbd7f2b87 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:05:56.192587 23236 raft_consensus.cc:2749] T 775c229504194560ba9589bc2199b089 P e5256d91808b47c195bc9b4dbd7f2b87 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
W20260709 13:05:56.194818 23313 log.cc:927] Time spent T 6c5eebf646ad445a9d1b1adc319d7b16 P e61c3a8f61bb48f8a963c9480e53c168: Append to log took a long time: real 0.118s	user 0.004s	sys 0.000s
I20260709 13:05:56.197219 23055 raft_consensus.cc:3055] T ef32ce6fdd0e40d382c79974f30295c6 P e5256d91808b47c195bc9b4dbd7f2b87 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:05:56.199026 23194 raft_consensus.cc:493] T 4509b76741dc428e9201c70c1658da13 P e61c3a8f61bb48f8a963c9480e53c168 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 0473d2b2d01f4459b1e90fd12cc7840e)
I20260709 13:05:56.199410 19555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dc5b3532fe54f74876d02beffa2c230" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:05:56.216331 19555 raft_consensus.cc:3060] T 1dc5b3532fe54f74876d02beffa2c230 P e61c3a8f61bb48f8a963c9480e53c168 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:05:56.200515 19554 raft_consensus.cc:1275] T 7f575b143b844aa096b50997dad3516a P e61c3a8f61bb48f8a963c9480e53c168 [term 6 FOLLOWER]: Refusing update from remote peer e5256d91808b47c195bc9b4dbd7f2b87: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 13:05:56.200590 23218 raft_consensus.cc:515] T 309c3ca0ca4b4f3ba129752ea2cb293b P e5256d91808b47c195bc9b4dbd7f2b87 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } attrs { replace: true } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:05:56.205267 19409 raft_consensus.cc:1275] T ff75a1d4cb1f493db8f71ddc136ba9ab P e5256d91808b47c195bc9b4dbd7f2b87 [term 10 FOLLOWER]: Refusing update from remote peer e61c3a8f61bb48f8a963c9480e53c168: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
W20260709 13:05:56.206015 19377 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.2:46257, user_credentials={real_user=slave}} blocked reactor thread for 97294.7us
I20260709 13:05:56.206817 23091 raft_consensus.cc:3060] T 1f85fc4b527a48848e5faa083b604e36 P e5256d91808b47c195bc9b4dbd7f2b87 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:05:56.175700 23273 consensus_queue.cc:1059] T 14935b3ddf914369822e4a0547aaa355 P 127766fc592545a4997f7790f50f6076 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 }, Status: INVALID_TERM, Last received: 8.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.029s
I20260709 13:05:56.175143 23131 consensus_queue.cc:1059] T 96efeaaf1057492490e9a621f37e1a2d P 127766fc592545a4997f7790f50f6076 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.028s
I20260709 13:05:56.174912 23153 consensus_queue.cc:1059] T 85c494af21f9457a85da47b9bc70c1fd P 127766fc592545a4997f7790f50f6076 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 }, Status: INVALID_TERM, Last received: 6.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.030s
I20260709 13:05:56.211752 19403 raft_consensus.cc:2468] T 2b74109013a140ada21feeef92d6f563 P e5256d91808b47c195bc9b4dbd7f2b87 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 6.
I20260709 13:05:56.188665 23268 raft_consensus.cc:3060] T ab43d85f64114d4ebf618930e43d9ed0 P 127766fc592545a4997f7790f50f6076 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:05:56.220274 19374 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.4:43121, user_credentials={real_user=slave}} blocked reactor thread for 44032.1us
I20260709 13:05:56.226087 23228 consensus_queue.cc:1059] T 7be9efa6559648dbb5a0f7684c4542d1 P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 }, Status: INVALID_TERM, Last received: 7.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:05:56.153219 23083 consensus_queue.cc:260] T 217b5fae677b4971b3bbd2f357a1f7ff P 0473d2b2d01f4459b1e90fd12cc7840e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:56.212296 23276 raft_consensus.cc:493] T ab43d85f64114d4ebf618930e43d9ed0 P e5256d91808b47c195bc9b4dbd7f2b87 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:56.215148 22830 consensus_queue.cc:260] T 172b3dd13109415a955b71ac0e9d2234 P e5256d91808b47c195bc9b4dbd7f2b87 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 7, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:05:56.234743 20108 raft_consensus.cc:1240] T ff9b0eddd810459b82d91c60777c10eb P 127766fc592545a4997f7790f50f6076 [term 9 FOLLOWER]: Rejecting Update request from peer e5256d91808b47c195bc9b4dbd7f2b87 for earlier term 8. Current term is 9. Ops: []
I20260709 13:05:56.234601 19484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2725d2c4cb054f18b0fc8f735c15f6c2" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:05:56.185693 23223 consensus_queue.cc:1048] T 5ec1c4ce15e04c7e8c283a62179f2a64 P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Connected to new peer: Peer: permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.034s
I20260709 13:05:56.217566 23055 raft_consensus.cc:740] T ef32ce6fdd0e40d382c79974f30295c6 P e5256d91808b47c195bc9b4dbd7f2b87 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: e5256d91808b47c195bc9b4dbd7f2b87, State: Running, Role: LEADER
I20260709 13:05:56.154477 23238 consensus_queue.cc:237] T f93ee515a9c14139bf566522ed8232f3 P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 12.5, Last appended by leader: 5, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:56.245705 23027 leader_election.cc:290] T ff9b0eddd810459b82d91c60777c10eb P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
W20260709 13:05:56.247304 23308 log.cc:927] Time spent T 2e36a9d6e29c4a7c860cf267efbd4c74 P 0473d2b2d01f4459b1e90fd12cc7840e: Append to log took a long time: real 0.535s	user 0.008s	sys 0.021s
W20260709 13:05:56.248147 23311 log.cc:927] Time spent T 775c229504194560ba9589bc2199b089 P 127766fc592545a4997f7790f50f6076: Append to log took a long time: real 0.178s	user 0.001s	sys 0.000s
I20260709 13:05:56.250078 23225 leader_election.cc:290] T df751f992649444090e27965eb1af85d P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:05:56.268909 23055 consensus_queue.cc:260] T ef32ce6fdd0e40d382c79974f30295c6 P e5256d91808b47c195bc9b4dbd7f2b87 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:56.270308 23055 raft_consensus.cc:3060] T ef32ce6fdd0e40d382c79974f30295c6 P e5256d91808b47c195bc9b4dbd7f2b87 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:05:56.251832 19374 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:56.226822 23143 raft_consensus.cc:3055] T 2725d2c4cb054f18b0fc8f735c15f6c2 P e5256d91808b47c195bc9b4dbd7f2b87 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:05:56.271849 23143 raft_consensus.cc:740] T 2725d2c4cb054f18b0fc8f735c15f6c2 P e5256d91808b47c195bc9b4dbd7f2b87 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: e5256d91808b47c195bc9b4dbd7f2b87, State: Running, Role: LEADER
I20260709 13:05:56.219007 23102 raft_consensus.cc:2749] T 2b74109013a140ada21feeef92d6f563 P 0473d2b2d01f4459b1e90fd12cc7840e [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:05:56.233096 23228 raft_consensus.cc:3055] T 7be9efa6559648dbb5a0f7684c4542d1 P 0473d2b2d01f4459b1e90fd12cc7840e [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:05:56.242470 23276 raft_consensus.cc:3060] T ab43d85f64114d4ebf618930e43d9ed0 P e5256d91808b47c195bc9b4dbd7f2b87 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:05:56.274199 23093 consensus_queue.cc:1048] T a08760e15aac4630a629431f56024dc8 P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.009s
I20260709 13:05:56.283530 19484 raft_consensus.cc:2393] T 2725d2c4cb054f18b0fc8f735c15f6c2 P 0473d2b2d01f4459b1e90fd12cc7840e [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e61c3a8f61bb48f8a963c9480e53c168 in current term 11: Already voted for candidate 0473d2b2d01f4459b1e90fd12cc7840e in this term.
I20260709 13:05:56.262758 23140 raft_consensus.cc:493] T 0afb57ae58a24a01850491d69f0213dd P e61c3a8f61bb48f8a963c9480e53c168 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:56.278264 19556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df751f992649444090e27965eb1af85d" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:05:56.272796 23143 consensus_queue.cc:260] T 2725d2c4cb054f18b0fc8f735c15f6c2 P e5256d91808b47c195bc9b4dbd7f2b87 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.5, Last appended by leader: 5, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:56.219305 23262 consensus_queue.cc:1048] T 76cb037fc9064d13b59a8969d897ce8c P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.055s
I20260709 13:05:56.285768 19403 raft_consensus.cc:1275] T 775c229504194560ba9589bc2199b089 P e5256d91808b47c195bc9b4dbd7f2b87 [term 8 FOLLOWER]: Refusing update from remote peer 127766fc592545a4997f7790f50f6076: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:05:56.274591 23224 raft_consensus.cc:493] T f1b10566f45d4a7d9029858330e02d5b P 0473d2b2d01f4459b1e90fd12cc7840e [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:56.303020 19556 raft_consensus.cc:2468] T df751f992649444090e27965eb1af85d P e61c3a8f61bb48f8a963c9480e53c168 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 11.
I20260709 13:05:56.250739 22979 consensus_queue.cc:1048] T 2e36a9d6e29c4a7c860cf267efbd4c74 P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.038s
I20260709 13:05:56.277544 23236 consensus_queue.cc:1048] T 7f575b143b844aa096b50997dad3516a P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.044s
I20260709 13:05:56.233376 23194 raft_consensus.cc:515] T 4509b76741dc428e9201c70c1658da13 P e61c3a8f61bb48f8a963c9480e53c168 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:56.335203 19407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ec1c4ce15e04c7e8c283a62179f2a64" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:05:56.336264 23083 raft_consensus.cc:3060] T 217b5fae677b4971b3bbd2f357a1f7ff P 0473d2b2d01f4459b1e90fd12cc7840e [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:05:56.337252 19408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2725d2c4cb054f18b0fc8f735c15f6c2" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 11 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
I20260709 13:05:56.320542 19523 leader_election.cc:304] T 40e1e16737a842ee936002830f36882e P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:05:56.280078 23228 raft_consensus.cc:740] T 7be9efa6559648dbb5a0f7684c4542d1 P 0473d2b2d01f4459b1e90fd12cc7840e [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 0473d2b2d01f4459b1e90fd12cc7840e, State: Running, Role: LEADER
I20260709 13:05:56.308501 19526 leader_election.cc:304] T 86a6797bdfe94fa496c050ceae4bd0d9 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e61c3a8f61bb48f8a963c9480e53c168; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:05:56.356647 19555 raft_consensus.cc:2468] T 1dc5b3532fe54f74876d02beffa2c230 P e61c3a8f61bb48f8a963c9480e53c168 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 10.
I20260709 13:05:56.328162 23224 raft_consensus.cc:515] T f1b10566f45d4a7d9029858330e02d5b P 0473d2b2d01f4459b1e90fd12cc7840e [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:56.361109 19410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f85fc4b527a48848e5faa083b604e36" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
I20260709 13:05:56.361925 19410 raft_consensus.cc:2410] T 1f85fc4b527a48848e5faa083b604e36 P e5256d91808b47c195bc9b4dbd7f2b87 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 0473d2b2d01f4459b1e90fd12cc7840e for term 7 because replica has last-logged OpId of term: 6 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 7.
W20260709 13:05:56.362761 19526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.2:46257, user_credentials={real_user=slave}} blocked reactor thread for 67461.5us
I20260709 13:05:56.365442 19526 leader_election.cc:304] T fa8650e71aa14778b3d73721fc50d9fc P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e61c3a8f61bb48f8a963c9480e53c168; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:05:56.365911 23194 leader_election.cc:290] T 4509b76741dc428e9201c70c1658da13 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:05:56.366509 23194 raft_consensus.cc:2749] T 86a6797bdfe94fa496c050ceae4bd0d9 P e61c3a8f61bb48f8a963c9480e53c168 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:05:56.367231 23194 raft_consensus.cc:2749] T fa8650e71aa14778b3d73721fc50d9fc P e61c3a8f61bb48f8a963c9480e53c168 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:05:56.367831 19526 leader_election.cc:304] T 0cdf56e38bbc453d9438d359e5a69955 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e61c3a8f61bb48f8a963c9480e53c168; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:05:56.359462 23027 raft_consensus.cc:493] T 62c6c134d3d24a1ab144dd9ee6bc3f64 P 0473d2b2d01f4459b1e90fd12cc7840e [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:56.369922 23027 raft_consensus.cc:515] T 62c6c134d3d24a1ab144dd9ee6bc3f64 P 0473d2b2d01f4459b1e90fd12cc7840e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:05:56.330015 23102 raft_consensus.cc:493] T 775c229504194560ba9589bc2199b089 P 0473d2b2d01f4459b1e90fd12cc7840e [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:56.371042 23102 raft_consensus.cc:515] T 775c229504194560ba9589bc2199b089 P 0473d2b2d01f4459b1e90fd12cc7840e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:05:56.372040 23027 leader_election.cc:290] T 62c6c134d3d24a1ab144dd9ee6bc3f64 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:05:56.373016 23102 leader_election.cc:290] T 775c229504194560ba9589bc2199b089 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:05:56.332765 23190 raft_consensus.cc:493] T 85c494af21f9457a85da47b9bc70c1fd P e5256d91808b47c195bc9b4dbd7f2b87 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 127766fc592545a4997f7790f50f6076)
I20260709 13:05:56.374805 23316 leader_election.cc:290] T 21e14947d70440f19044d8f75c31e1f9 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:05:56.374614 23190 raft_consensus.cc:515] T 85c494af21f9457a85da47b9bc70c1fd P e5256d91808b47c195bc9b4dbd7f2b87 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:05:56.376353 22830 raft_consensus.cc:3060] T 172b3dd13109415a955b71ac0e9d2234 P e5256d91808b47c195bc9b4dbd7f2b87 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:05:56.376603 23275 leader_election.cc:290] T 65d8cb8d6ec64f459d5a47cefab10acf P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:05:56.376742 23190 leader_election.cc:290] T 85c494af21f9457a85da47b9bc70c1fd P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:05:56.319741 23140 raft_consensus.cc:515] T 0afb57ae58a24a01850491d69f0213dd P e61c3a8f61bb48f8a963c9480e53c168 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:05:56.353660 23278 consensus_queue.cc:1059] T ff9b0eddd810459b82d91c60777c10eb P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.027s
I20260709 13:05:56.378854 23140 leader_election.cc:290] T 0afb57ae58a24a01850491d69f0213dd P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:05:56.379581 23249 leader_election.cc:290] T 5ec1c4ce15e04c7e8c283a62179f2a64 P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:05:56.379787 23275 raft_consensus.cc:3055] T ff9b0eddd810459b82d91c60777c10eb P e5256d91808b47c195bc9b4dbd7f2b87 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:05:56.380208 23275 raft_consensus.cc:740] T ff9b0eddd810459b82d91c60777c10eb P e5256d91808b47c195bc9b4dbd7f2b87 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: e5256d91808b47c195bc9b4dbd7f2b87, State: Running, Role: LEADER
I20260709 13:05:56.380805 23228 consensus_queue.cc:260] T 7be9efa6559648dbb5a0f7684c4542d1 P 0473d2b2d01f4459b1e90fd12cc7840e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.7, Last appended by leader: 7, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } attrs { replace: true } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:05:56.381100 23275 consensus_queue.cc:260] T ff9b0eddd810459b82d91c60777c10eb P e5256d91808b47c195bc9b4dbd7f2b87 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:05:56.381867 23255 raft_consensus.cc:493] T ed7fdbcb96d14d418db9ca90a792588a P 127766fc592545a4997f7790f50f6076 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 0473d2b2d01f4459b1e90fd12cc7840e)
I20260709 13:05:56.382315 23228 raft_consensus.cc:3060] T 7be9efa6559648dbb5a0f7684c4542d1 P 0473d2b2d01f4459b1e90fd12cc7840e [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:05:56.383929 23254 raft_consensus.cc:3055] T 14935b3ddf914369822e4a0547aaa355 P 127766fc592545a4997f7790f50f6076 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:05:56.384311 23254 raft_consensus.cc:740] T 14935b3ddf914369822e4a0547aaa355 P 127766fc592545a4997f7790f50f6076 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 127766fc592545a4997f7790f50f6076, State: Running, Role: LEADER
I20260709 13:05:56.385273 23254 consensus_queue.cc:260] T 14935b3ddf914369822e4a0547aaa355 P 127766fc592545a4997f7790f50f6076 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 7, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } attrs { replace: true } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:05:56.389091 19407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14efcc79969f41babe5529c22d59156d" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:05:56.392856 23102 raft_consensus.cc:493] T 179fd671030940b4b4a4e24bcc4aba0a P 0473d2b2d01f4459b1e90fd12cc7840e [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:56.403455 19409 raft_consensus.cc:1240] T 1dc5b3532fe54f74876d02beffa2c230 P e5256d91808b47c195bc9b4dbd7f2b87 [term 10 FOLLOWER]: Rejecting Update request from peer 0473d2b2d01f4459b1e90fd12cc7840e for earlier term 9. Current term is 10. Ops: []
W20260709 13:05:56.403970 19523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.1:40321, user_credentials={real_user=slave}} blocked reactor thread for 124616us
I20260709 13:05:56.392088 22974 raft_consensus.cc:2749] T 0cdf56e38bbc453d9438d359e5a69955 P e61c3a8f61bb48f8a963c9480e53c168 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:05:56.426553 19523 leader_election.cc:304] T 65d8cb8d6ec64f459d5a47cefab10acf P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:05:56.382465 23255 raft_consensus.cc:515] T ed7fdbcb96d14d418db9ca90a792588a P 127766fc592545a4997f7790f50f6076 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:05:56.401418 23220 raft_consensus.cc:493] T 0cdf56e38bbc453d9438d359e5a69955 P 0473d2b2d01f4459b1e90fd12cc7840e [term 11 FOLLOWER]: Starting pre-election (detected failure of leader e5256d91808b47c195bc9b4dbd7f2b87)
I20260709 13:05:56.393913 23093 consensus_queue.cc:1048] T 21e14947d70440f19044d8f75c31e1f9 P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.031s
I20260709 13:05:56.427695 23143 raft_consensus.cc:3060] T 2725d2c4cb054f18b0fc8f735c15f6c2 P e5256d91808b47c195bc9b4dbd7f2b87 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:05:56.437759 20108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ec1c4ce15e04c7e8c283a62179f2a64" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:05:56.442243 20108 raft_consensus.cc:2393] T 5ec1c4ce15e04c7e8c283a62179f2a64 P 127766fc592545a4997f7790f50f6076 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0473d2b2d01f4459b1e90fd12cc7840e in current term 9: Already voted for candidate e5256d91808b47c195bc9b4dbd7f2b87 in this term.
I20260709 13:05:56.434114 22758 raft_consensus.cc:2804] T 65d8cb8d6ec64f459d5a47cefab10acf P e61c3a8f61bb48f8a963c9480e53c168 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:05:56.423286 23153 consensus_queue.cc:1048] T 775c229504194560ba9589bc2199b089 P 127766fc592545a4997f7790f50f6076 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.025s
I20260709 13:05:56.440969 22974 consensus_queue.cc:1059] T 179fd671030940b4b4a4e24bcc4aba0a P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.011s
I20260709 13:05:56.436076 23214 consensus_queue.cc:1048] T e381f1d6b8184797ad142de49be225a8 P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.015s
I20260709 13:05:56.451582 20112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14efcc79969f41babe5529c22d59156d" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:05:56.438565 23233 consensus_queue.cc:1048] T edd7d470b5014c9489be7f41f64355c9 P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 2, Time since last communication: 0.012s
I20260709 13:05:56.405889 23316 consensus_queue.cc:1059] T ed7fdbcb96d14d418db9ca90a792588a P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.034s
I20260709 13:05:56.438655 23194 raft_consensus.cc:2804] T 40e1e16737a842ee936002830f36882e P e61c3a8f61bb48f8a963c9480e53c168 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:05:56.425379 23102 raft_consensus.cc:515] T 179fd671030940b4b4a4e24bcc4aba0a P 0473d2b2d01f4459b1e90fd12cc7840e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
W20260709 13:05:56.464133 19377 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.2:46257, user_credentials={real_user=slave}} blocked reactor thread for 80087.6us
I20260709 13:05:56.473889 20111 raft_consensus.cc:1275] T 0afb57ae58a24a01850491d69f0213dd P 127766fc592545a4997f7790f50f6076 [term 10 FOLLOWER]: Refusing update from remote peer 0473d2b2d01f4459b1e90fd12cc7840e: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:05:56.463665 23194 raft_consensus.cc:493] T 40e1e16737a842ee936002830f36882e P e61c3a8f61bb48f8a963c9480e53c168 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:56.486536 20107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65d8cb8d6ec64f459d5a47cefab10acf" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:05:56.489746 20105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85c494af21f9457a85da47b9bc70c1fd" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:05:56.491268 20108 raft_consensus.cc:1240] T 7be9efa6559648dbb5a0f7684c4542d1 P 127766fc592545a4997f7790f50f6076 [term 10 FOLLOWER]: Rejecting Update request from peer 0473d2b2d01f4459b1e90fd12cc7840e for earlier term 9. Current term is 10. Ops: []
I20260709 13:05:56.453622 22758 raft_consensus.cc:493] T 65d8cb8d6ec64f459d5a47cefab10acf P e61c3a8f61bb48f8a963c9480e53c168 [term 6 FOLLOWER]: Starting leader election (detected failure of leader e5256d91808b47c195bc9b4dbd7f2b87)
I20260709 13:05:56.487926 20107 raft_consensus.cc:2468] T 65d8cb8d6ec64f459d5a47cefab10acf P 127766fc592545a4997f7790f50f6076 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 7.
I20260709 13:05:56.446796 23220 raft_consensus.cc:515] T 0cdf56e38bbc453d9438d359e5a69955 P 0473d2b2d01f4459b1e90fd12cc7840e [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
W20260709 13:05:56.495296 19450 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.3:36891, user_credentials={real_user=slave}} blocked reactor thread for 131748us
W20260709 13:05:56.495942 19451 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:56.501101 19526 leader_election.cc:304] T ef32ce6fdd0e40d382c79974f30295c6 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168; no voters: e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:05:56.482861 23194 raft_consensus.cc:3060] T 40e1e16737a842ee936002830f36882e P e61c3a8f61bb48f8a963c9480e53c168 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:05:56.503346 20112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f85fc4b527a48848e5faa083b604e36" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076"
I20260709 13:05:56.472931 23190 raft_consensus.cc:493] T 14935b3ddf914369822e4a0547aaa355 P e5256d91808b47c195bc9b4dbd7f2b87 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 127766fc592545a4997f7790f50f6076)
W20260709 13:05:56.507205 19523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.1:40321, user_credentials={real_user=slave}} blocked reactor thread for 69158.7us
I20260709 13:05:56.507781 20112 raft_consensus.cc:2393] T 1f85fc4b527a48848e5faa083b604e36 P 127766fc592545a4997f7790f50f6076 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 0473d2b2d01f4459b1e90fd12cc7840e in current term 7: Already voted for candidate 127766fc592545a4997f7790f50f6076 in this term.
I20260709 13:05:56.508338 19523 leader_election.cc:400] T df751f992649444090e27965eb1af85d P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 10 election: Vote denied by peer e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321) with higher term. Message: Invalid argument: T df751f992649444090e27965eb1af85d P e5256d91808b47c195bc9b4dbd7f2b87 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate e61c3a8f61bb48f8a963c9480e53c168 for earlier term 10. Current term is 11.
I20260709 13:05:56.509181 19523 leader_election.cc:403] T df751f992649444090e27965eb1af85d P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 10 election: Cancelling election due to peer responding with higher term
I20260709 13:05:56.497932 22758 raft_consensus.cc:3060] T 65d8cb8d6ec64f459d5a47cefab10acf P e61c3a8f61bb48f8a963c9480e53c168 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:05:56.479324 23140 consensus_queue.cc:1048] T 21e14947d70440f19044d8f75c31e1f9 P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.027s
I20260709 13:05:56.519429 19450 leader_election.cc:304] T 7f575b143b844aa096b50997dad3516a P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e; no voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:05:56.521065 20112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c5eebf646ad445a9d1b1adc319d7b16" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:05:56.525445 20105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "309c3ca0ca4b4f3ba129752ea2cb293b" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076"
I20260709 13:05:56.532836 20105 raft_consensus.cc:2393] T 309c3ca0ca4b4f3ba129752ea2cb293b P 127766fc592545a4997f7790f50f6076 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate e5256d91808b47c195bc9b4dbd7f2b87 in current term 8: Already voted for candidate 127766fc592545a4997f7790f50f6076 in this term.
I20260709 13:05:56.538600 23083 raft_consensus.cc:2749] T 7f575b143b844aa096b50997dad3516a P 0473d2b2d01f4459b1e90fd12cc7840e [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:05:56.542908 22758 raft_consensus.cc:515] T 65d8cb8d6ec64f459d5a47cefab10acf P e61c3a8f61bb48f8a963c9480e53c168 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:05:56.546458 19449 leader_election.cc:304] T 1efebf73c86e432baa55533136b6e12c P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e; no voters: 127766fc592545a4997f7790f50f6076, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:05:56.517835 23218 leader_election.cc:290] T 309c3ca0ca4b4f3ba129752ea2cb293b P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 8 election: Requested vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:05:56.551892 22758 leader_election.cc:290] T 65d8cb8d6ec64f459d5a47cefab10acf P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 7 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:05:56.519999 23131 consensus_queue.cc:1243] T 96efeaaf1057492490e9a621f37e1a2d P 127766fc592545a4997f7790f50f6076 [LEADER]: Peer e61c3a8f61bb48f8a963c9480e53c168 log is divergent from this leader: its last log entry 9.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
W20260709 13:05:56.552225 20075 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.1:40321, user_credentials={real_user=slave}} blocked reactor thread for 90308.4us
I20260709 13:05:56.562880 19555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65d8cb8d6ec64f459d5a47cefab10acf" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:05:56.563710 19555 raft_consensus.cc:2468] T 65d8cb8d6ec64f459d5a47cefab10acf P e61c3a8f61bb48f8a963c9480e53c168 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 7.
I20260709 13:05:56.514230 23190 raft_consensus.cc:515] T 14935b3ddf914369822e4a0547aaa355 P e5256d91808b47c195bc9b4dbd7f2b87 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } attrs { replace: true } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:05:56.567219 22758 consensus_queue.cc:1048] T a08760e15aac4630a629431f56024dc8 P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:05:56.576889 22974 raft_consensus.cc:2804] T ef32ce6fdd0e40d382c79974f30295c6 P e61c3a8f61bb48f8a963c9480e53c168 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:05:56.577303 23214 raft_consensus.cc:493] T 62c6c134d3d24a1ab144dd9ee6bc3f64 P e61c3a8f61bb48f8a963c9480e53c168 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:56.577987 23093 raft_consensus.cc:2749] T df751f992649444090e27965eb1af85d P e61c3a8f61bb48f8a963c9480e53c168 [term 11 FOLLOWER]: Leader election lost for term 10. Reason: Vote denied by peer e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321) with higher term. Message: Invalid argument: T df751f992649444090e27965eb1af85d P e5256d91808b47c195bc9b4dbd7f2b87 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate e61c3a8f61bb48f8a963c9480e53c168 for earlier term 10. Current term is 11.
I20260709 13:05:56.511384 19407 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "21e14947d70440f19044d8f75c31e1f9"
dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
mode: GRACEFUL
new_leader_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
 from {username='slave'} at 127.0.0.1:37312
I20260709 13:05:56.579037 19407 raft_consensus.cc:606] T 21e14947d70440f19044d8f75c31e1f9 P e5256d91808b47c195bc9b4dbd7f2b87 [term 9 FOLLOWER]: Received request to transfer leadership to TS 0473d2b2d01f4459b1e90fd12cc7840e
I20260709 13:05:56.577440 22974 raft_consensus.cc:697] T ef32ce6fdd0e40d382c79974f30295c6 P e61c3a8f61bb48f8a963c9480e53c168 [term 12 LEADER]: Becoming Leader. State: Replica: e61c3a8f61bb48f8a963c9480e53c168, State: Running, Role: LEADER
I20260709 13:05:56.579386 19559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "309c3ca0ca4b4f3ba129752ea2cb293b" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:05:56.580179 22974 consensus_queue.cc:237] T ef32ce6fdd0e40d382c79974f30295c6 P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
W20260709 13:05:56.582873 23322 log.cc:927] Time spent T b9f0d59553ad444883fcf5b5909f9798 P 0473d2b2d01f4459b1e90fd12cc7840e: Append to log took a long time: real 0.128s	user 0.001s	sys 0.000s
W20260709 13:05:56.584105 19450 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.3:36891, user_credentials={real_user=slave}} blocked reactor thread for 71469.4us
I20260709 13:05:56.576440 22758 raft_consensus.cc:493] T 4af19371ea874c09a0a2147040835cbb P e61c3a8f61bb48f8a963c9480e53c168 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:56.579416 19407 raft_consensus.cc:614] T 21e14947d70440f19044d8f75c31e1f9 P e5256d91808b47c195bc9b4dbd7f2b87 [term 9 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:05:56.591642 19556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85c494af21f9457a85da47b9bc70c1fd" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:05:56.595211 22758 raft_consensus.cc:515] T 4af19371ea874c09a0a2147040835cbb P e61c3a8f61bb48f8a963c9480e53c168 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:05:56.597759 22758 leader_election.cc:290] T 4af19371ea874c09a0a2147040835cbb P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:05:56.600282 23276 raft_consensus.cc:515] T ab43d85f64114d4ebf618930e43d9ed0 P e5256d91808b47c195bc9b4dbd7f2b87 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } attrs { replace: true } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
W20260709 13:05:56.603354 23323 log.cc:927] Time spent T 217b5fae677b4971b3bbd2f357a1f7ff P e5256d91808b47c195bc9b4dbd7f2b87: Append to log took a long time: real 0.162s	user 0.000s	sys 0.000s
W20260709 13:05:56.604996 19374 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:56.578173 23214 raft_consensus.cc:515] T 62c6c134d3d24a1ab144dd9ee6bc3f64 P e61c3a8f61bb48f8a963c9480e53c168 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
W20260709 13:05:56.607231 19449 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.4:43121, user_credentials={real_user=slave}} blocked reactor thread for 75666.9us
I20260709 13:05:56.608850 19449 leader_election.cc:304] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e; no voters: 127766fc592545a4997f7790f50f6076, e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:05:56.610021 19449 leader_election.cc:304] T 172b3dd13109415a955b71ac0e9d2234 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e; no voters: 127766fc592545a4997f7790f50f6076, e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:05:56.610819 23027 raft_consensus.cc:2749] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P 0473d2b2d01f4459b1e90fd12cc7840e [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:05:56.611436 23027 raft_consensus.cc:2749] T 172b3dd13109415a955b71ac0e9d2234 P 0473d2b2d01f4459b1e90fd12cc7840e [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:05:56.615666 19374 leader_election.cc:304] T 65d8cb8d6ec64f459d5a47cefab10acf P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 127766fc592545a4997f7790f50f6076, e5256d91808b47c195bc9b4dbd7f2b87; no voters: 
I20260709 13:05:56.617386 23122 raft_consensus.cc:2804] T 65d8cb8d6ec64f459d5a47cefab10acf P e5256d91808b47c195bc9b4dbd7f2b87 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:05:56.617795 23122 raft_consensus.cc:493] T 65d8cb8d6ec64f459d5a47cefab10acf P e5256d91808b47c195bc9b4dbd7f2b87 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:56.618139 23122 raft_consensus.cc:3060] T 65d8cb8d6ec64f459d5a47cefab10acf P e5256d91808b47c195bc9b4dbd7f2b87 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:05:56.619441 19559 raft_consensus.cc:2468] T 309c3ca0ca4b4f3ba129752ea2cb293b P e61c3a8f61bb48f8a963c9480e53c168 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 8.
I20260709 13:05:56.623337 23273 raft_consensus.cc:3055] T 85c494af21f9457a85da47b9bc70c1fd P 127766fc592545a4997f7790f50f6076 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:05:56.623785 23273 raft_consensus.cc:740] T 85c494af21f9457a85da47b9bc70c1fd P 127766fc592545a4997f7790f50f6076 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 127766fc592545a4997f7790f50f6076, State: Running, Role: LEADER
I20260709 13:05:56.624650 23273 consensus_queue.cc:260] T 85c494af21f9457a85da47b9bc70c1fd P 127766fc592545a4997f7790f50f6076 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:05:56.626189 23273 raft_consensus.cc:3060] T 85c494af21f9457a85da47b9bc70c1fd P 127766fc592545a4997f7790f50f6076 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:05:56.628034 23214 leader_election.cc:290] T 62c6c134d3d24a1ab144dd9ee6bc3f64 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:05:56.631800 23254 raft_consensus.cc:3060] T 14935b3ddf914369822e4a0547aaa355 P 127766fc592545a4997f7790f50f6076 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:05:56.635720 23216 consensus_queue.cc:1048] T 0afb57ae58a24a01850491d69f0213dd P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Connected to new peer: Peer: permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.000s
W20260709 13:05:56.639343 19450 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.3:36891, user_credentials={real_user=slave}} blocked reactor thread for 48943.4us
I20260709 13:05:56.644768 23027 raft_consensus.cc:493] T a08760e15aac4630a629431f56024dc8 P 0473d2b2d01f4459b1e90fd12cc7840e [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:56.645309 23027 raft_consensus.cc:515] T a08760e15aac4630a629431f56024dc8 P 0473d2b2d01f4459b1e90fd12cc7840e [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:56.647336 23027 leader_election.cc:290] T a08760e15aac4630a629431f56024dc8 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:05:56.656068 23276 leader_election.cc:290] T ab43d85f64114d4ebf618930e43d9ed0 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 10 election: Requested vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:05:56.657773 20107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab43d85f64114d4ebf618930e43d9ed0" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076"
I20260709 13:05:56.659623 19556 raft_consensus.cc:2393] T 85c494af21f9457a85da47b9bc70c1fd P e61c3a8f61bb48f8a963c9480e53c168 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e5256d91808b47c195bc9b4dbd7f2b87 in current term 7: Already voted for candidate e61c3a8f61bb48f8a963c9480e53c168 in this term.
I20260709 13:05:56.630414 23255 leader_election.cc:290] T ed7fdbcb96d14d418db9ca90a792588a P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
W20260709 13:05:56.662823 19523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.1:40321, user_credentials={real_user=slave}} blocked reactor thread for 154699us
I20260709 13:05:56.585546 23337 raft_consensus.cc:2749] T 1efebf73c86e432baa55533136b6e12c P 0473d2b2d01f4459b1e90fd12cc7840e [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:05:56.647271 23102 leader_election.cc:290] T 179fd671030940b4b4a4e24bcc4aba0a P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:05:56.679299 19523 leader_election.cc:304] T 2b74109013a140ada21feeef92d6f563 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168; no voters: 0473d2b2d01f4459b1e90fd12cc7840e
I20260709 13:05:56.679591 22758 consensus_queue.cc:1048] T ff75a1d4cb1f493db8f71ddc136ba9ab P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.000s
W20260709 13:05:56.660715 23326 log.cc:927] Time spent T f93ee515a9c14139bf566522ed8232f3 P 0473d2b2d01f4459b1e90fd12cc7840e: Append to log took a long time: real 0.058s	user 0.001s	sys 0.000s
I20260709 13:05:56.682327 19482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1efebf73c86e432baa55533136b6e12c" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:05:56.683399 19479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96efeaaf1057492490e9a621f37e1a2d" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:05:56.589644 23238 consensus_queue.cc:1048] T 1dc5b3532fe54f74876d02beffa2c230 P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.074s
I20260709 13:05:56.691004 19478 raft_consensus.cc:1275] T 179fd671030940b4b4a4e24bcc4aba0a P 0473d2b2d01f4459b1e90fd12cc7840e [term 9 FOLLOWER]: Refusing update from remote peer e61c3a8f61bb48f8a963c9480e53c168: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:05:56.690970 19486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed7fdbcb96d14d418db9ca90a792588a" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:05:56.695272 19407 raft_consensus.cc:1240] T 46c5bfeecc314717bffe987e6844b6d0 P e5256d91808b47c195bc9b4dbd7f2b87 [term 16 LEADER]: Rejecting Update request from peer 0473d2b2d01f4459b1e90fd12cc7840e for earlier term 15. Current term is 16. Ops: []
I20260709 13:05:56.695969 19485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4509b76741dc428e9201c70c1658da13" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:05:56.701063 19478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0afb57ae58a24a01850491d69f0213dd" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 11 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:05:56.700044 19477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46c5bfeecc314717bffe987e6844b6d0" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 16 candidate_status { last_received { term: 15 index: 6 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:05:56.707693 19523 leader_election.cc:304] T ece3db938bc649d4a40a51522ed5259c P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 127766fc592545a4997f7790f50f6076, e61c3a8f61bb48f8a963c9480e53c168; no voters: e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:05:56.663133 23316 consensus_queue.cc:1048] T 0afb57ae58a24a01850491d69f0213dd P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.033s
I20260709 13:05:56.710767 19407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff9b0eddd810459b82d91c60777c10eb" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:05:56.714478 19481 raft_consensus.cc:1275] T e381f1d6b8184797ad142de49be225a8 P 0473d2b2d01f4459b1e90fd12cc7840e [term 8 FOLLOWER]: Refusing update from remote peer e61c3a8f61bb48f8a963c9480e53c168: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 13:05:56.715682 19479 raft_consensus.cc:3060] T 96efeaaf1057492490e9a621f37e1a2d P 0473d2b2d01f4459b1e90fd12cc7840e [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:05:56.691947 23220 leader_election.cc:290] T 0cdf56e38bbc453d9438d359e5a69955 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:05:56.710834 19523 leader_election.cc:304] T 14935b3ddf914369822e4a0547aaa355 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168; no voters: 127766fc592545a4997f7790f50f6076, e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:05:56.723255 19526 leader_election.cc:304] T 2725d2c4cb054f18b0fc8f735c15f6c2 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e61c3a8f61bb48f8a963c9480e53c168; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:05:56.723438 19480 raft_consensus.cc:1275] T ff75a1d4cb1f493db8f71ddc136ba9ab P 0473d2b2d01f4459b1e90fd12cc7840e [term 10 FOLLOWER]: Refusing update from remote peer e61c3a8f61bb48f8a963c9480e53c168: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:05:56.724124 19483 raft_consensus.cc:1275] T edd7d470b5014c9489be7f41f64355c9 P 0473d2b2d01f4459b1e90fd12cc7840e [term 11 FOLLOWER]: Refusing update from remote peer e61c3a8f61bb48f8a963c9480e53c168: Log matching property violated. Preceding OpId in replica: term: 10 index: 5. Preceding OpId from leader: term: 11 index: 5. (term mismatch)
I20260709 13:05:56.724484 19483 pending_rounds.cc:85] T edd7d470b5014c9489be7f41f64355c9 P 0473d2b2d01f4459b1e90fd12cc7840e: Aborting all ops after (but not including) 4
I20260709 13:05:56.724735 19483 pending_rounds.cc:107] T edd7d470b5014c9489be7f41f64355c9 P 0473d2b2d01f4459b1e90fd12cc7840e: Aborting uncommitted NO_OP operation due to leader change: 10.5
I20260709 13:05:56.724908 19483 raft_consensus.cc:2889] T edd7d470b5014c9489be7f41f64355c9 P 0473d2b2d01f4459b1e90fd12cc7840e [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:05:56.696040 23338 raft_consensus.cc:2804] T 2b74109013a140ada21feeef92d6f563 P e61c3a8f61bb48f8a963c9480e53c168 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:05:56.722404 19409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21e14947d70440f19044d8f75c31e1f9" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:05:56.728320 19409 raft_consensus.cc:2468] T 21e14947d70440f19044d8f75c31e1f9 P e5256d91808b47c195bc9b4dbd7f2b87 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 9.
I20260709 13:05:56.729158 19482 raft_consensus.cc:2393] T 1efebf73c86e432baa55533136b6e12c P 0473d2b2d01f4459b1e90fd12cc7840e [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e61c3a8f61bb48f8a963c9480e53c168 in current term 9: Already voted for candidate 0473d2b2d01f4459b1e90fd12cc7840e in this term.
I20260709 13:05:56.716997 23214 raft_consensus.cc:2804] T ece3db938bc649d4a40a51522ed5259c P e61c3a8f61bb48f8a963c9480e53c168 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:05:56.734190 19410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "775c229504194560ba9589bc2199b089" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:05:56.737027 19410 raft_consensus.cc:2468] T 775c229504194560ba9589bc2199b089 P e5256d91808b47c195bc9b4dbd7f2b87 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 8.
I20260709 13:05:56.742069 23233 raft_consensus.cc:2749] T 14935b3ddf914369822e4a0547aaa355 P e61c3a8f61bb48f8a963c9480e53c168 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:05:56.742363 19405 raft_consensus.cc:1275] T b9f0d59553ad444883fcf5b5909f9798 P e5256d91808b47c195bc9b4dbd7f2b87 [term 9 FOLLOWER]: Refusing update from remote peer 0473d2b2d01f4459b1e90fd12cc7840e: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:05:56.743669 19406 raft_consensus.cc:1275] T 86a6797bdfe94fa496c050ceae4bd0d9 P e5256d91808b47c195bc9b4dbd7f2b87 [term 10 FOLLOWER]: Refusing update from remote peer 0473d2b2d01f4459b1e90fd12cc7840e: Log matching property violated. Preceding OpId in replica: term: 8 index: 4. Preceding OpId from leader: term: 10 index: 5. (index mismatch)
I20260709 13:05:56.747169 19408 raft_consensus.cc:2410] T 2725d2c4cb054f18b0fc8f735c15f6c2 P e5256d91808b47c195bc9b4dbd7f2b87 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 0473d2b2d01f4459b1e90fd12cc7840e for term 11 because replica has last-logged OpId of term: 10 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 4.
I20260709 13:05:56.754004 19479 raft_consensus.cc:2468] T 96efeaaf1057492490e9a621f37e1a2d P 0473d2b2d01f4459b1e90fd12cc7840e [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 11.
W20260709 13:05:56.757733 19523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.4:43121, user_credentials={real_user=slave}} blocked reactor thread for 47015.9us
I20260709 13:05:56.736789 23214 raft_consensus.cc:493] T ece3db938bc649d4a40a51522ed5259c P e61c3a8f61bb48f8a963c9480e53c168 [term 8 FOLLOWER]: Starting leader election (detected failure of leader e5256d91808b47c195bc9b4dbd7f2b87)
I20260709 13:05:56.816504 19404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a08760e15aac4630a629431f56024dc8" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:05:56.760007 19523 leader_election.cc:304] T 85c494af21f9457a85da47b9bc70c1fd P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e61c3a8f61bb48f8a963c9480e53c168; no voters: 127766fc592545a4997f7790f50f6076, e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:05:56.828457 19406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cdf56e38bbc453d9438d359e5a69955" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:05:56.816663 19480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab43d85f64114d4ebf618930e43d9ed0" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:05:56.821345 19404 raft_consensus.cc:2468] T a08760e15aac4630a629431f56024dc8 P e5256d91808b47c195bc9b4dbd7f2b87 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 11.
I20260709 13:05:56.830840 19409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "179fd671030940b4b4a4e24bcc4aba0a" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:05:56.745502 22974 raft_consensus.cc:3060] T 2725d2c4cb054f18b0fc8f735c15f6c2 P e61c3a8f61bb48f8a963c9480e53c168 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:05:56.833168 19405 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2725d2c4cb054f18b0fc8f735c15f6c2"
dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
mode: GRACEFUL
new_leader_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
 from {username='slave'} at 127.0.0.1:37312
I20260709 13:05:56.836529 19405 raft_consensus.cc:606] T 2725d2c4cb054f18b0fc8f735c15f6c2 P e5256d91808b47c195bc9b4dbd7f2b87 [term 11 FOLLOWER]: Received request to transfer leadership to TS 0473d2b2d01f4459b1e90fd12cc7840e
I20260709 13:05:56.836747 19480 raft_consensus.cc:2468] T ab43d85f64114d4ebf618930e43d9ed0 P 0473d2b2d01f4459b1e90fd12cc7840e [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 127766fc592545a4997f7790f50f6076 in term 9.
I20260709 13:05:56.837005 19405 raft_consensus.cc:614] T 2725d2c4cb054f18b0fc8f735c15f6c2 P e5256d91808b47c195bc9b4dbd7f2b87 [term 11 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:05:56.835427 19409 raft_consensus.cc:2393] T 179fd671030940b4b4a4e24bcc4aba0a P e5256d91808b47c195bc9b4dbd7f2b87 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0473d2b2d01f4459b1e90fd12cc7840e in current term 10: Already voted for candidate e5256d91808b47c195bc9b4dbd7f2b87 in this term.
I20260709 13:05:56.745832 23338 raft_consensus.cc:697] T 2b74109013a140ada21feeef92d6f563 P e61c3a8f61bb48f8a963c9480e53c168 [term 6 LEADER]: Becoming Leader. State: Replica: e61c3a8f61bb48f8a963c9480e53c168, State: Running, Role: LEADER
I20260709 13:05:56.841132 23335 consensus_queue.cc:1059] T 46c5bfeecc314717bffe987e6844b6d0 P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 }, Status: INVALID_TERM, Last received: 15.6, Next index: 7, Last known committed idx: 4, Time since last communication: 0.115s
I20260709 13:05:56.841464 19449 leader_election.cc:304] T bc225c93219c45538b53a1bd3d387e4d P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e; no voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:05:56.842378 23335 raft_consensus.cc:3055] T 46c5bfeecc314717bffe987e6844b6d0 P 0473d2b2d01f4459b1e90fd12cc7840e [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:05:56.842489 23337 raft_consensus.cc:2749] T bc225c93219c45538b53a1bd3d387e4d P 0473d2b2d01f4459b1e90fd12cc7840e [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:05:56.842834 23335 raft_consensus.cc:740] T 46c5bfeecc314717bffe987e6844b6d0 P 0473d2b2d01f4459b1e90fd12cc7840e [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 0473d2b2d01f4459b1e90fd12cc7840e, State: Running, Role: LEADER
I20260709 13:05:56.843721 23335 consensus_queue.cc:260] T 46c5bfeecc314717bffe987e6844b6d0 P 0473d2b2d01f4459b1e90fd12cc7840e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 15.6, Last appended by leader: 6, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:56.844851 23335 raft_consensus.cc:3060] T 46c5bfeecc314717bffe987e6844b6d0 P 0473d2b2d01f4459b1e90fd12cc7840e [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:05:56.846323 19523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.4:43121, user_credentials={real_user=slave}} blocked reactor thread for 87653.7us
I20260709 13:05:56.847169 19523 leader_election.cc:304] T 7be9efa6559648dbb5a0f7684c4542d1 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, 127766fc592545a4997f7790f50f6076
I20260709 13:05:56.848212 19483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62c6c134d3d24a1ab144dd9ee6bc3f64" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:05:56.848848 19483 raft_consensus.cc:2468] T 62c6c134d3d24a1ab144dd9ee6bc3f64 P 0473d2b2d01f4459b1e90fd12cc7840e [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 127766fc592545a4997f7790f50f6076 in term 9.
W20260709 13:05:56.851353 23334 log.cc:927] Time spent T fa8650e71aa14778b3d73721fc50d9fc P 0473d2b2d01f4459b1e90fd12cc7840e: Append to log took a long time: real 0.117s	user 0.000s	sys 0.000s
I20260709 13:05:56.830299 23214 raft_consensus.cc:3060] T ece3db938bc649d4a40a51522ed5259c P e61c3a8f61bb48f8a963c9480e53c168 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:05:56.847573 23268 consensus_meta.cc:287] T ab43d85f64114d4ebf618930e43d9ed0 P 127766fc592545a4997f7790f50f6076: Time spent flushing consensus metadata: real 0.588s	user 0.005s	sys 0.006s
I20260709 13:05:56.883315 23233 raft_consensus.cc:2749] T 7be9efa6559648dbb5a0f7684c4542d1 P e61c3a8f61bb48f8a963c9480e53c168 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:05:56.884687 23189 raft_consensus.cc:493] T 4af19371ea874c09a0a2147040835cbb P e5256d91808b47c195bc9b4dbd7f2b87 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:56.891006 23268 raft_consensus.cc:515] T ab43d85f64114d4ebf618930e43d9ed0 P 127766fc592545a4997f7790f50f6076 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } attrs { replace: true } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:05:56.891446 23189 raft_consensus.cc:515] T 4af19371ea874c09a0a2147040835cbb P e5256d91808b47c195bc9b4dbd7f2b87 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:05:56.893585 23189 leader_election.cc:290] T 4af19371ea874c09a0a2147040835cbb P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:05:56.894018 23268 leader_election.cc:290] T ab43d85f64114d4ebf618930e43d9ed0 P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 10 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:05:56.894942 20107 raft_consensus.cc:2393] T ab43d85f64114d4ebf618930e43d9ed0 P 127766fc592545a4997f7790f50f6076 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate e5256d91808b47c195bc9b4dbd7f2b87 in current term 10: Already voted for candidate 127766fc592545a4997f7790f50f6076 in this term.
W20260709 13:05:56.902915 19523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.4:43121, user_credentials={real_user=slave}} blocked reactor thread for 55827.8us
I20260709 13:05:56.903995 23190 leader_election.cc:290] T 14935b3ddf914369822e4a0547aaa355 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:05:56.909206 23214 raft_consensus.cc:515] T ece3db938bc649d4a40a51522ed5259c P e61c3a8f61bb48f8a963c9480e53c168 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:05:56.911439 23224 leader_election.cc:290] T f1b10566f45d4a7d9029858330e02d5b P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:05:56.836311 23344 raft_consensus.cc:2749] T 85c494af21f9457a85da47b9bc70c1fd P e61c3a8f61bb48f8a963c9480e53c168 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:05:56.914155 19479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e1085d23e8347fbbd5bce7542f4b1f4" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:05:56.914815 19479 raft_consensus.cc:3060] T 0e1085d23e8347fbbd5bce7542f4b1f4 P 0473d2b2d01f4459b1e90fd12cc7840e [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:05:56.915582 20078 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:56.915719 23122 raft_consensus.cc:515] T 65d8cb8d6ec64f459d5a47cefab10acf P e5256d91808b47c195bc9b4dbd7f2b87 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:05:56.916822 19483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "172b3dd13109415a955b71ac0e9d2234" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:05:56.916213 19449 leader_election.cc:304] T 5ec1c4ce15e04c7e8c283a62179f2a64 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e; no voters: 127766fc592545a4997f7790f50f6076, e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:05:56.855262 23338 consensus_queue.cc:237] T 2b74109013a140ada21feeef92d6f563 P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:56.917411 19483 raft_consensus.cc:3060] T 172b3dd13109415a955b71ac0e9d2234 P 0473d2b2d01f4459b1e90fd12cc7840e [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:05:56.918603 23122 leader_election.cc:290] T 65d8cb8d6ec64f459d5a47cefab10acf P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 8 election: Requested vote from peers e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:05:56.921357 23220 raft_consensus.cc:2749] T 5ec1c4ce15e04c7e8c283a62179f2a64 P 0473d2b2d01f4459b1e90fd12cc7840e [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:05:56.923277 19523 leader_election.cc:304] T 1efebf73c86e432baa55533136b6e12c P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 127766fc592545a4997f7790f50f6076, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:05:56.923535 19478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7be9efa6559648dbb5a0f7684c4542d1" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:05:56.921485 19449 leader_election.cc:304] T 1f85fc4b527a48848e5faa083b604e36 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e; no voters: 127766fc592545a4997f7790f50f6076, e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:05:56.924165 19478 raft_consensus.cc:2468] T 7be9efa6559648dbb5a0f7684c4542d1 P 0473d2b2d01f4459b1e90fd12cc7840e [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 127766fc592545a4997f7790f50f6076 in term 10.
I20260709 13:05:56.925081 19449 leader_election.cc:304] T 14efcc79969f41babe5529c22d59156d P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e; no voters: 127766fc592545a4997f7790f50f6076, e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:05:56.926373 19481 raft_consensus.cc:1240] T 96efeaaf1057492490e9a621f37e1a2d P 0473d2b2d01f4459b1e90fd12cc7840e [term 11 FOLLOWER]: Rejecting Update request from peer 127766fc592545a4997f7790f50f6076 for earlier term 10. Current term is 11. Ops: [6.7-10.9]
I20260709 13:05:56.928754 19478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f85fc4b527a48848e5faa083b604e36" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:05:56.929227 23344 raft_consensus.cc:2804] T 1efebf73c86e432baa55533136b6e12c P e61c3a8f61bb48f8a963c9480e53c168 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:05:56.929667 23344 raft_consensus.cc:493] T 1efebf73c86e432baa55533136b6e12c P e61c3a8f61bb48f8a963c9480e53c168 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 127766fc592545a4997f7790f50f6076)
I20260709 13:05:56.929877 19480 raft_consensus.cc:1240] T 14935b3ddf914369822e4a0547aaa355 P 0473d2b2d01f4459b1e90fd12cc7840e [term 9 FOLLOWER]: Rejecting Update request from peer 127766fc592545a4997f7790f50f6076 for earlier term 8. Current term is 9. Ops: []
I20260709 13:05:56.930016 23344 raft_consensus.cc:3060] T 1efebf73c86e432baa55533136b6e12c P e61c3a8f61bb48f8a963c9480e53c168 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:05:56.926347 23228 raft_consensus.cc:2749] T 1f85fc4b527a48848e5faa083b604e36 P 0473d2b2d01f4459b1e90fd12cc7840e [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:05:56.931385 23220 raft_consensus.cc:2749] T 14efcc79969f41babe5529c22d59156d P 0473d2b2d01f4459b1e90fd12cc7840e [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:05:56.931860 23102 consensus_queue.cc:1059] T 1dc5b3532fe54f74876d02beffa2c230 P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
W20260709 13:05:56.933995 19375 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:56.934345 23220 raft_consensus.cc:3055] T 1dc5b3532fe54f74876d02beffa2c230 P 0473d2b2d01f4459b1e90fd12cc7840e [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:05:56.954444 23220 raft_consensus.cc:740] T 1dc5b3532fe54f74876d02beffa2c230 P 0473d2b2d01f4459b1e90fd12cc7840e [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 0473d2b2d01f4459b1e90fd12cc7840e, State: Running, Role: LEADER
I20260709 13:05:56.955440 23220 consensus_queue.cc:260] T 1dc5b3532fe54f74876d02beffa2c230 P 0473d2b2d01f4459b1e90fd12cc7840e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 9.5, Last appended by leader: 5, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:56.932412 19478 raft_consensus.cc:2393] T 1f85fc4b527a48848e5faa083b604e36 P 0473d2b2d01f4459b1e90fd12cc7840e [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 127766fc592545a4997f7790f50f6076 in current term 7: Already voted for candidate 0473d2b2d01f4459b1e90fd12cc7840e in this term.
W20260709 13:05:56.956626 20075 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.1:40321, user_credentials={real_user=slave}} blocked reactor thread for 397562us
W20260709 13:05:56.959337 23342 log.cc:927] Time spent T 5ec1c4ce15e04c7e8c283a62179f2a64 P 127766fc592545a4997f7790f50f6076: Append to log took a long time: real 0.085s	user 0.000s	sys 0.003s
I20260709 13:05:56.961987 23255 raft_consensus.cc:493] T 309c3ca0ca4b4f3ba129752ea2cb293b P 127766fc592545a4997f7790f50f6076 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:05:56.964560 20078 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:56.966019 20109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff9b0eddd810459b82d91c60777c10eb" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:05:56.966804 20109 raft_consensus.cc:2393] T ff9b0eddd810459b82d91c60777c10eb P 127766fc592545a4997f7790f50f6076 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0473d2b2d01f4459b1e90fd12cc7840e in current term 9: Already voted for candidate 127766fc592545a4997f7790f50f6076 in this term.
I20260709 13:05:56.969077 20110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "775c229504194560ba9589bc2199b089" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
W20260709 13:05:56.969901 19523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.4:43121, user_credentials={real_user=slave}} blocked reactor thread for 46693.8us
W20260709 13:05:56.977924 19449 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.1:40321, user_credentials={real_user=slave}} blocked reactor thread for 51791.4us
I20260709 13:05:56.943419 23214 leader_election.cc:290] T ece3db938bc649d4a40a51522ed5259c P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 9 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:05:56.945256 23249 raft_consensus.cc:3055] T 96efeaaf1057492490e9a621f37e1a2d P 127766fc592545a4997f7790f50f6076 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:05:56.898530 23194 raft_consensus.cc:515] T 40e1e16737a842ee936002830f36882e P e61c3a8f61bb48f8a963c9480e53c168 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:56.948751 23140 raft_consensus.cc:3055] T 179fd671030940b4b4a4e24bcc4aba0a P e61c3a8f61bb48f8a963c9480e53c168 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:05:56.861114 23104 raft_consensus.cc:3055] T ed7fdbcb96d14d418db9ca90a792588a P 0473d2b2d01f4459b1e90fd12cc7840e [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:05:57.001097 20106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4af19371ea874c09a0a2147040835cbb" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:05:56.988729 19483 raft_consensus.cc:2468] T 172b3dd13109415a955b71ac0e9d2234 P 0473d2b2d01f4459b1e90fd12cc7840e [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 127766fc592545a4997f7790f50f6076 in term 9.
I20260709 13:05:56.995996 20112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14935b3ddf914369822e4a0547aaa355" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:05:57.003509 20107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62c6c134d3d24a1ab144dd9ee6bc3f64" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:05:57.003868 20112 raft_consensus.cc:2468] T 14935b3ddf914369822e4a0547aaa355 P 127766fc592545a4997f7790f50f6076 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 9.
I20260709 13:05:56.998219 19406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ec1c4ce15e04c7e8c283a62179f2a64" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:05:56.997285 19555 raft_consensus.cc:1275] T 46c5bfeecc314717bffe987e6844b6d0 P e61c3a8f61bb48f8a963c9480e53c168 [term 16 FOLLOWER]: Refusing update from remote peer e5256d91808b47c195bc9b4dbd7f2b87: Log matching property violated. Preceding OpId in replica: term: 15 index: 6. Preceding OpId from leader: term: 16 index: 7. (index mismatch)
W20260709 13:05:57.011148 20078 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:57.014060 19483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff9b0eddd810459b82d91c60777c10eb" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:05:56.962631 23255 raft_consensus.cc:515] T 309c3ca0ca4b4f3ba129752ea2cb293b P 127766fc592545a4997f7790f50f6076 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } attrs { replace: true } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:05:57.015129 20105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0afb57ae58a24a01850491d69f0213dd" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 11 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:05:57.018101 19483 raft_consensus.cc:3060] T ff9b0eddd810459b82d91c60777c10eb P 0473d2b2d01f4459b1e90fd12cc7840e [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:05:57.018473 20105 raft_consensus.cc:2410] T 0afb57ae58a24a01850491d69f0213dd P 127766fc592545a4997f7790f50f6076 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e61c3a8f61bb48f8a963c9480e53c168 for term 11 because replica has last-logged OpId of term: 8 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 7.
I20260709 13:05:57.019572 19479 raft_consensus.cc:2468] T 0e1085d23e8347fbbd5bce7542f4b1f4 P 0473d2b2d01f4459b1e90fd12cc7840e [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 127766fc592545a4997f7790f50f6076 in term 7.
I20260709 13:05:57.021034 19560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab43d85f64114d4ebf618930e43d9ed0" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:05:57.021275 19557 raft_consensus.cc:1240] T ece3db938bc649d4a40a51522ed5259c P e61c3a8f61bb48f8a963c9480e53c168 [term 9 FOLLOWER]: Rejecting Update request from peer e5256d91808b47c195bc9b4dbd7f2b87 for earlier term 8. Current term is 9. Ops: []
I20260709 13:05:57.021575 19560 raft_consensus.cc:3060] T ab43d85f64114d4ebf618930e43d9ed0 P e61c3a8f61bb48f8a963c9480e53c168 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:05:57.017555 19449 leader_election.cc:304] T 21e14947d70440f19044d8f75c31e1f9 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87; no voters: 
I20260709 13:05:57.025153 20107 raft_consensus.cc:2468] T 62c6c134d3d24a1ab144dd9ee6bc3f64 P 127766fc592545a4997f7790f50f6076 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 8.
I20260709 13:05:57.031250 19449 leader_election.cc:304] T 775c229504194560ba9589bc2199b089 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87; no voters: 
I20260709 13:05:56.992676 23243 raft_consensus.cc:493] T e381f1d6b8184797ad142de49be225a8 P e5256d91808b47c195bc9b4dbd7f2b87 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:56.993031 23249 raft_consensus.cc:740] T 96efeaaf1057492490e9a621f37e1a2d P 127766fc592545a4997f7790f50f6076 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 127766fc592545a4997f7790f50f6076, State: Running, Role: LEADER
I20260709 13:05:57.034484 19558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4af19371ea874c09a0a2147040835cbb" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:05:56.996625 23140 raft_consensus.cc:740] T 179fd671030940b4b4a4e24bcc4aba0a P e61c3a8f61bb48f8a963c9480e53c168 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: e61c3a8f61bb48f8a963c9480e53c168, State: Running, Role: LEADER
I20260709 13:05:57.033937 20108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65d8cb8d6ec64f459d5a47cefab10acf" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076"
I20260709 13:05:57.038543 20104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65d8cb8d6ec64f459d5a47cefab10acf" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076"
I20260709 13:05:56.998220 23104 raft_consensus.cc:740] T ed7fdbcb96d14d418db9ca90a792588a P 0473d2b2d01f4459b1e90fd12cc7840e [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 0473d2b2d01f4459b1e90fd12cc7840e, State: Running, Role: LEADER
I20260709 13:05:57.042187 20110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4af19371ea874c09a0a2147040835cbb" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:05:57.043349 19558 raft_consensus.cc:2468] T 4af19371ea874c09a0a2147040835cbb P e61c3a8f61bb48f8a963c9480e53c168 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 6.
I20260709 13:05:57.044816 20108 raft_consensus.cc:2393] T 65d8cb8d6ec64f459d5a47cefab10acf P 127766fc592545a4997f7790f50f6076 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate e61c3a8f61bb48f8a963c9480e53c168 in current term 7: Already voted for candidate 127766fc592545a4997f7790f50f6076 in this term.
I20260709 13:05:57.039175 20105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62c6c134d3d24a1ab144dd9ee6bc3f64" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:05:57.047242 19449 leader_election.cc:304] T a08760e15aac4630a629431f56024dc8 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87; no voters: 
I20260709 13:05:57.027076 23190 raft_consensus.cc:493] T b9f0d59553ad444883fcf5b5909f9798 P e5256d91808b47c195bc9b4dbd7f2b87 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:57.058810 23336 raft_consensus.cc:493] T f1b10566f45d4a7d9029858330e02d5b P e61c3a8f61bb48f8a963c9480e53c168 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:57.059098 23190 raft_consensus.cc:515] T b9f0d59553ad444883fcf5b5909f9798 P e5256d91808b47c195bc9b4dbd7f2b87 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:57.059221 23249 consensus_queue.cc:260] T 96efeaaf1057492490e9a621f37e1a2d P 127766fc592545a4997f7790f50f6076 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:05:57.060143 23255 leader_election.cc:290] T 309c3ca0ca4b4f3ba129752ea2cb293b P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:05:57.046782 23224 consensus_queue.cc:1048] T 86a6797bdfe94fa496c050ceae4bd0d9 P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.014s
W20260709 13:05:57.061362 19451 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:57.049718 22758 raft_consensus.cc:493] T 2a16f7501e2444fb86d4e2778e734e02 P e61c3a8f61bb48f8a963c9480e53c168 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader e5256d91808b47c195bc9b4dbd7f2b87)
I20260709 13:05:57.051275 19555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14935b3ddf914369822e4a0547aaa355" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:05:57.053390 19375 leader_election.cc:304] T df751f992649444090e27965eb1af85d P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
W20260709 13:05:57.053682 23317 log.cc:927] Time spent T 86a6797bdfe94fa496c050ceae4bd0d9 P 0473d2b2d01f4459b1e90fd12cc7840e: Append to log took a long time: real 0.982s	user 0.005s	sys 0.012s
I20260709 13:05:57.053572 19553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65d8cb8d6ec64f459d5a47cefab10acf" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:05:57.054147 23140 consensus_queue.cc:260] T 179fd671030940b4b4a4e24bcc4aba0a P e61c3a8f61bb48f8a963c9480e53c168 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:57.047171 23083 consensus_queue.cc:1048] T b9f0d59553ad444883fcf5b5909f9798 P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.008s
I20260709 13:05:57.056428 23194 leader_election.cc:290] T 40e1e16737a842ee936002830f36882e P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 14 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:05:57.058311 19404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab43d85f64114d4ebf618930e43d9ed0" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
I20260709 13:05:57.087214 19552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed7fdbcb96d14d418db9ca90a792588a" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:05:57.087404 19480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed7fdbcb96d14d418db9ca90a792588a" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:05:57.060201 23249 raft_consensus.cc:3060] T 96efeaaf1057492490e9a621f37e1a2d P 127766fc592545a4997f7790f50f6076 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:05:57.063602 19375 leader_election.cc:304] T 1dc5b3532fe54f74876d02beffa2c230 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:05:57.048434 20105 raft_consensus.cc:2468] T 62c6c134d3d24a1ab144dd9ee6bc3f64 P 127766fc592545a4997f7790f50f6076 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 8.
I20260709 13:05:57.046607 19479 raft_consensus.cc:1275] T 775c229504194560ba9589bc2199b089 P 0473d2b2d01f4459b1e90fd12cc7840e [term 8 FOLLOWER]: Refusing update from remote peer 127766fc592545a4997f7790f50f6076: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:05:57.069831 19551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab43d85f64114d4ebf618930e43d9ed0" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:05:57.078125 19483 raft_consensus.cc:2468] T ff9b0eddd810459b82d91c60777c10eb P 0473d2b2d01f4459b1e90fd12cc7840e [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 127766fc592545a4997f7790f50f6076 in term 9.
I20260709 13:05:57.082877 19553 raft_consensus.cc:3060] T 65d8cb8d6ec64f459d5a47cefab10acf P e61c3a8f61bb48f8a963c9480e53c168 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:05:57.088048 19555 raft_consensus.cc:2393] T 14935b3ddf914369822e4a0547aaa355 P e61c3a8f61bb48f8a963c9480e53c168 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e5256d91808b47c195bc9b4dbd7f2b87 in current term 9: Already voted for candidate e61c3a8f61bb48f8a963c9480e53c168 in this term.
I20260709 13:05:57.059374 23336 raft_consensus.cc:515] T f1b10566f45d4a7d9029858330e02d5b P e61c3a8f61bb48f8a963c9480e53c168 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:57.095077 19558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "309c3ca0ca4b4f3ba129752ea2cb293b" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:05:57.095129 22758 raft_consensus.cc:515] T 2a16f7501e2444fb86d4e2778e734e02 P e61c3a8f61bb48f8a963c9480e53c168 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:05:57.095580 19558 raft_consensus.cc:2468] T 309c3ca0ca4b4f3ba129752ea2cb293b P e61c3a8f61bb48f8a963c9480e53c168 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 127766fc592545a4997f7790f50f6076 in term 8.
I20260709 13:05:57.044406 23243 raft_consensus.cc:515] T e381f1d6b8184797ad142de49be225a8 P e5256d91808b47c195bc9b4dbd7f2b87 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:57.098090 19477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab43d85f64114d4ebf618930e43d9ed0" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:05:57.098420 19406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "309c3ca0ca4b4f3ba129752ea2cb293b" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
W20260709 13:05:57.089663 19374 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:57.098783 19477 raft_consensus.cc:3060] T ab43d85f64114d4ebf618930e43d9ed0 P 0473d2b2d01f4459b1e90fd12cc7840e [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:05:57.097558 19560 raft_consensus.cc:2468] T ab43d85f64114d4ebf618930e43d9ed0 P e61c3a8f61bb48f8a963c9480e53c168 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 10.
I20260709 13:05:57.094507 19404 raft_consensus.cc:2393] T ab43d85f64114d4ebf618930e43d9ed0 P e5256d91808b47c195bc9b4dbd7f2b87 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 127766fc592545a4997f7790f50f6076 in current term 10: Already voted for candidate e5256d91808b47c195bc9b4dbd7f2b87 in this term.
I20260709 13:05:57.088980 19478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ec1c4ce15e04c7e8c283a62179f2a64" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:05:57.092564 19375 leader_election.cc:304] T 85c494af21f9457a85da47b9bc70c1fd P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87; no voters: 127766fc592545a4997f7790f50f6076, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:05:57.102403 19478 raft_consensus.cc:2468] T 5ec1c4ce15e04c7e8c283a62179f2a64 P 0473d2b2d01f4459b1e90fd12cc7840e [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 127766fc592545a4997f7790f50f6076 in term 9.
I20260709 13:05:57.103433 19555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21e14947d70440f19044d8f75c31e1f9" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:05:57.103615 19551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a08760e15aac4630a629431f56024dc8" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:05:57.099038 19406 raft_consensus.cc:2468] T 309c3ca0ca4b4f3ba129752ea2cb293b P e5256d91808b47c195bc9b4dbd7f2b87 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 127766fc592545a4997f7790f50f6076 in term 8.
I20260709 13:05:57.082526 23276 raft_consensus.cc:2804] T df751f992649444090e27965eb1af85d P e5256d91808b47c195bc9b4dbd7f2b87 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:05:57.082762 23340 raft_consensus.cc:493] T 22196caba61445d3bec98a0aab3c337d P e61c3a8f61bb48f8a963c9480e53c168 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 0473d2b2d01f4459b1e90fd12cc7840e)
I20260709 13:05:57.070650 23238 raft_consensus.cc:2804] T a08760e15aac4630a629431f56024dc8 P 0473d2b2d01f4459b1e90fd12cc7840e [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:05:57.107326 19560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62c6c134d3d24a1ab144dd9ee6bc3f64" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:05:57.106478 19411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1b10566f45d4a7d9029858330e02d5b" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:05:57.109162 19552 raft_consensus.cc:2393] T ed7fdbcb96d14d418db9ca90a792588a P e61c3a8f61bb48f8a963c9480e53c168 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 127766fc592545a4997f7790f50f6076 in current term 7: Already voted for candidate e61c3a8f61bb48f8a963c9480e53c168 in this term.
I20260709 13:05:57.114820 23278 consensus_queue.cc:1059] T ece3db938bc649d4a40a51522ed5259c P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 }, Status: INVALID_TERM, Last received: 8.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:05:57.115525 23324 raft_consensus.cc:493] T 4af19371ea874c09a0a2147040835cbb P 127766fc592545a4997f7790f50f6076 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:57.099339 23027 raft_consensus.cc:2804] T 21e14947d70440f19044d8f75c31e1f9 P 0473d2b2d01f4459b1e90fd12cc7840e [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:05:57.118307 20105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ece3db938bc649d4a40a51522ed5259c" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076"
I20260709 13:05:57.112378 19523 leader_election.cc:304] T 62c6c134d3d24a1ab144dd9ee6bc3f64 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 127766fc592545a4997f7790f50f6076, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:05:57.088753 23190 leader_election.cc:290] T b9f0d59553ad444883fcf5b5909f9798 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:05:57.070268 23093 raft_consensus.cc:493] T 28af091831594f9d8e96482078cc7625 P e61c3a8f61bb48f8a963c9480e53c168 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:57.114838 22758 leader_election.cc:290] T 2a16f7501e2444fb86d4e2778e734e02 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:05:57.123204 19560 raft_consensus.cc:2468] T 62c6c134d3d24a1ab144dd9ee6bc3f64 P e61c3a8f61bb48f8a963c9480e53c168 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 9.
I20260709 13:05:57.127744 20076 leader_election.cc:304] T ab43d85f64114d4ebf618930e43d9ed0 P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 127766fc592545a4997f7790f50f6076; no voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:05:57.083760 22979 consensus_queue.cc:1048] T 179fd671030940b4b4a4e24bcc4aba0a P e61c3a8f61bb48f8a963c9480e53c168 [NON_LEADER]: Connected to new peer: Peer: permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.036s
I20260709 13:05:57.135762 20076 leader_election.cc:304] T 309c3ca0ca4b4f3ba129752ea2cb293b P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 127766fc592545a4997f7790f50f6076, e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:05:57.136837 19479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62c6c134d3d24a1ab144dd9ee6bc3f64" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:05:57.137465 19479 raft_consensus.cc:2468] T 62c6c134d3d24a1ab144dd9ee6bc3f64 P 0473d2b2d01f4459b1e90fd12cc7840e [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 9.
I20260709 13:05:57.106093 23218 raft_consensus.cc:3060] T 85c494af21f9457a85da47b9bc70c1fd P e5256d91808b47c195bc9b4dbd7f2b87 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:05:57.147233 19451 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:57.099326 23228 raft_consensus.cc:2804] T 775c229504194560ba9589bc2199b089 P 0473d2b2d01f4459b1e90fd12cc7840e [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:05:57.123536 23238 raft_consensus.cc:493] T a08760e15aac4630a629431f56024dc8 P 0473d2b2d01f4459b1e90fd12cc7840e [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:57.152726 19555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "179fd671030940b4b4a4e24bcc4aba0a" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:05:57.155179 19560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cdf56e38bbc453d9438d359e5a69955" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:05:57.121434 23276 raft_consensus.cc:493] T df751f992649444090e27965eb1af85d P e5256d91808b47c195bc9b4dbd7f2b87 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:57.139290 23194 raft_consensus.cc:2804] T 62c6c134d3d24a1ab144dd9ee6bc3f64 P e61c3a8f61bb48f8a963c9480e53c168 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:05:57.120779 23143 consensus_queue.cc:1048] T 46c5bfeecc314717bffe987e6844b6d0 P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 4, Time since last communication: 0.031s
I20260709 13:05:57.058346 23104 consensus_queue.cc:260] T ed7fdbcb96d14d418db9ca90a792588a P 0473d2b2d01f4459b1e90fd12cc7840e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:05:57.148005 23255 raft_consensus.cc:2749] T ab43d85f64114d4ebf618930e43d9ed0 P 127766fc592545a4997f7790f50f6076 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:05:57.169293 19552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c5eebf646ad445a9d1b1adc319d7b16" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:05:57.172721 19479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40e1e16737a842ee936002830f36882e" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:05:57.150239 23254 raft_consensus.cc:2804] T 309c3ca0ca4b4f3ba129752ea2cb293b P 127766fc592545a4997f7790f50f6076 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:05:57.153242 23214 raft_consensus.cc:493] T 76cb037fc9064d13b59a8969d897ce8c P e61c3a8f61bb48f8a963c9480e53c168 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader e5256d91808b47c195bc9b4dbd7f2b87)
I20260709 13:05:57.158197 23238 raft_consensus.cc:3060] T a08760e15aac4630a629431f56024dc8 P 0473d2b2d01f4459b1e90fd12cc7840e [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:05:57.181131 19560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1b10566f45d4a7d9029858330e02d5b" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:05:57.181974 19560 raft_consensus.cc:2468] T f1b10566f45d4a7d9029858330e02d5b P e61c3a8f61bb48f8a963c9480e53c168 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 11.
I20260709 13:05:57.136083 23324 raft_consensus.cc:515] T 4af19371ea874c09a0a2147040835cbb P 127766fc592545a4997f7790f50f6076 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:05:57.184657 20106 raft_consensus.cc:2468] T 4af19371ea874c09a0a2147040835cbb P 127766fc592545a4997f7790f50f6076 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 6.
W20260709 13:05:57.184726 19375 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.3:36891, user_credentials={real_user=slave}} blocked reactor thread for 55896.6us
I20260709 13:05:57.136168 23340 raft_consensus.cc:515] T 22196caba61445d3bec98a0aab3c337d P e61c3a8f61bb48f8a963c9480e53c168 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:57.139256 23093 raft_consensus.cc:515] T 28af091831594f9d8e96482078cc7625 P e61c3a8f61bb48f8a963c9480e53c168 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:57.191494 19479 raft_consensus.cc:3060] T 40e1e16737a842ee936002830f36882e P 0473d2b2d01f4459b1e90fd12cc7840e [term 12 FOLLOWER]: Advancing to term 14
I20260709 13:05:57.161831 23276 raft_consensus.cc:3060] T df751f992649444090e27965eb1af85d P e5256d91808b47c195bc9b4dbd7f2b87 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:05:57.189381 19405 raft_consensus.cc:1275] T f93ee515a9c14139bf566522ed8232f3 P e5256d91808b47c195bc9b4dbd7f2b87 [term 13 FOLLOWER]: Refusing update from remote peer 0473d2b2d01f4459b1e90fd12cc7840e: Log matching property violated. Preceding OpId in replica: term: 12 index: 5. Preceding OpId from leader: term: 13 index: 6. (index mismatch)
I20260709 13:05:57.193635 19560 raft_consensus.cc:1240] T 96efeaaf1057492490e9a621f37e1a2d P e61c3a8f61bb48f8a963c9480e53c168 [term 11 FOLLOWER]: Rejecting Update request from peer 127766fc592545a4997f7790f50f6076 for earlier term 10. Current term is 11. Ops: [8.8-10.9]
I20260709 13:05:57.185890 23214 raft_consensus.cc:515] T 76cb037fc9064d13b59a8969d897ce8c P e61c3a8f61bb48f8a963c9480e53c168 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:57.194764 23179 raft_consensus.cc:2804] T 1dc5b3532fe54f74876d02beffa2c230 P e5256d91808b47c195bc9b4dbd7f2b87 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:05:57.195407 23179 raft_consensus.cc:697] T 1dc5b3532fe54f74876d02beffa2c230 P e5256d91808b47c195bc9b4dbd7f2b87 [term 10 LEADER]: Becoming Leader. State: Replica: e5256d91808b47c195bc9b4dbd7f2b87, State: Running, Role: LEADER
I20260709 13:05:57.196894 19409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "179fd671030940b4b4a4e24bcc4aba0a" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
I20260709 13:05:57.197564 19409 raft_consensus.cc:2368] T 179fd671030940b4b4a4e24bcc4aba0a P e5256d91808b47c195bc9b4dbd7f2b87 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate e61c3a8f61bb48f8a963c9480e53c168 for earlier term 9. Current term is 10.
I20260709 13:05:57.204167 23220 raft_consensus.cc:3060] T 1dc5b3532fe54f74876d02beffa2c230 P 0473d2b2d01f4459b1e90fd12cc7840e [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:05:57.175294 23254 raft_consensus.cc:493] T 309c3ca0ca4b4f3ba129752ea2cb293b P 127766fc592545a4997f7790f50f6076 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:57.207521 19523 leader_election.cc:400] T 179fd671030940b4b4a4e24bcc4aba0a P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 9 election: Vote denied by peer e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321) with higher term. Message: Invalid argument: T 179fd671030940b4b4a4e24bcc4aba0a P e5256d91808b47c195bc9b4dbd7f2b87 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate e61c3a8f61bb48f8a963c9480e53c168 for earlier term 9. Current term is 10.
I20260709 13:05:57.198375 19409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40e1e16737a842ee936002830f36882e" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
I20260709 13:05:57.212117 19409 raft_consensus.cc:3060] T 40e1e16737a842ee936002830f36882e P e5256d91808b47c195bc9b4dbd7f2b87 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:05:57.196401 23179 consensus_queue.cc:237] T 1dc5b3532fe54f74876d02beffa2c230 P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:57.226419 19477 raft_consensus.cc:2468] T ab43d85f64114d4ebf618930e43d9ed0 P 0473d2b2d01f4459b1e90fd12cc7840e [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 127766fc592545a4997f7790f50f6076 in term 10.
I20260709 13:05:57.229612 19560 raft_consensus.cc:1275] T df751f992649444090e27965eb1af85d P e61c3a8f61bb48f8a963c9480e53c168 [term 11 FOLLOWER]: Refusing update from remote peer 0473d2b2d01f4459b1e90fd12cc7840e: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:05:57.211637 23254 raft_consensus.cc:3060] T 309c3ca0ca4b4f3ba129752ea2cb293b P 127766fc592545a4997f7790f50f6076 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:05:57.230631 22758 raft_consensus.cc:493] T f93ee515a9c14139bf566522ed8232f3 P e61c3a8f61bb48f8a963c9480e53c168 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:57.235648 22758 raft_consensus.cc:515] T f93ee515a9c14139bf566522ed8232f3 P e61c3a8f61bb48f8a963c9480e53c168 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:57.234404 19479 raft_consensus.cc:2468] T 40e1e16737a842ee936002830f36882e P 0473d2b2d01f4459b1e90fd12cc7840e [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 14.
I20260709 13:05:57.270605 19481 raft_consensus.cc:1240] T 1efebf73c86e432baa55533136b6e12c P 0473d2b2d01f4459b1e90fd12cc7840e [term 9 FOLLOWER]: Rejecting Update request from peer 127766fc592545a4997f7790f50f6076 for earlier term 8. Current term is 9. Ops: [8.8-8.8]
I20260709 13:05:57.255069 23337 raft_consensus.cc:493] T d1e5873a19244c5ebbcd38e126796ee7 P 0473d2b2d01f4459b1e90fd12cc7840e [term 11 FOLLOWER]: Starting pre-election (detected failure of leader e61c3a8f61bb48f8a963c9480e53c168)
W20260709 13:05:57.315383 19294 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet ab43d85f64114d4ebf618930e43d9ed0 with cas_config_opid_index 5: ChangeConfig:REMOVE_PEER failed with leader e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica e61c3a8f61bb48f8a963c9480e53c168 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 10 committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } attrs { replace: true } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } } }
W20260709 13:05:57.317313 23347 log.cc:927] Time spent T 21e14947d70440f19044d8f75c31e1f9 P 0473d2b2d01f4459b1e90fd12cc7840e: Append to log took a long time: real 0.128s	user 0.000s	sys 0.000s
I20260709 13:05:57.318396 23027 raft_consensus.cc:493] T 21e14947d70440f19044d8f75c31e1f9 P 0473d2b2d01f4459b1e90fd12cc7840e [term 9 FOLLOWER]: Starting leader election (detected failure of leader e61c3a8f61bb48f8a963c9480e53c168)
I20260709 13:05:57.318897 23027 raft_consensus.cc:3060] T 21e14947d70440f19044d8f75c31e1f9 P 0473d2b2d01f4459b1e90fd12cc7840e [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:05:57.321410 19404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1b10566f45d4a7d9029858330e02d5b" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:05:57.323282 19403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4af19371ea874c09a0a2147040835cbb" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:05:57.323841 19403 raft_consensus.cc:2468] T 4af19371ea874c09a0a2147040835cbb P e5256d91808b47c195bc9b4dbd7f2b87 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 127766fc592545a4997f7790f50f6076 in term 6.
I20260709 13:05:57.324735 19403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4509b76741dc428e9201c70c1658da13" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:05:57.325744 19403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4af19371ea874c09a0a2147040835cbb" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:05:57.326225 19403 raft_consensus.cc:2468] T 4af19371ea874c09a0a2147040835cbb P e5256d91808b47c195bc9b4dbd7f2b87 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 6.
I20260709 13:05:57.327417 20075 leader_election.cc:304] T 4af19371ea874c09a0a2147040835cbb P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 127766fc592545a4997f7790f50f6076, e5256d91808b47c195bc9b4dbd7f2b87; no voters: 
I20260709 13:05:57.328866 23268 raft_consensus.cc:2804] T 4af19371ea874c09a0a2147040835cbb P 127766fc592545a4997f7790f50f6076 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:05:57.329247 23268 raft_consensus.cc:493] T 4af19371ea874c09a0a2147040835cbb P 127766fc592545a4997f7790f50f6076 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:57.329561 23268 raft_consensus.cc:3060] T 4af19371ea874c09a0a2147040835cbb P 127766fc592545a4997f7790f50f6076 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:05:57.333237 20075 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:57.334527 23194 raft_consensus.cc:493] T 62c6c134d3d24a1ab144dd9ee6bc3f64 P e61c3a8f61bb48f8a963c9480e53c168 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:57.322592 19404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a16f7501e2444fb86d4e2778e734e02" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:05:57.335654 19404 raft_consensus.cc:2468] T 2a16f7501e2444fb86d4e2778e734e02 P e5256d91808b47c195bc9b4dbd7f2b87 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 11.
W20260709 13:05:57.380645 19526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.2:46257, user_credentials={real_user=slave}} blocked reactor thread for 309621us
I20260709 13:05:57.420287 19526 leader_election.cc:304] T 4509b76741dc428e9201c70c1658da13 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e61c3a8f61bb48f8a963c9480e53c168; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:05:57.432561 19526 leader_election.cc:304] T ed7fdbcb96d14d418db9ca90a792588a P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e61c3a8f61bb48f8a963c9480e53c168; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, 127766fc592545a4997f7790f50f6076
I20260709 13:05:57.438432 19403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ece3db938bc649d4a40a51522ed5259c" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
I20260709 13:05:57.439635 19403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65d8cb8d6ec64f459d5a47cefab10acf" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
I20260709 13:05:57.440263 19403 raft_consensus.cc:2368] T 65d8cb8d6ec64f459d5a47cefab10acf P e5256d91808b47c195bc9b4dbd7f2b87 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate e61c3a8f61bb48f8a963c9480e53c168 for earlier term 7. Current term is 8.
I20260709 13:05:57.416535 23194 raft_consensus.cc:3060] T 62c6c134d3d24a1ab144dd9ee6bc3f64 P e61c3a8f61bb48f8a963c9480e53c168 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:05:57.444621 19556 raft_consensus.cc:1240] T 1dc5b3532fe54f74876d02beffa2c230 P e61c3a8f61bb48f8a963c9480e53c168 [term 10 FOLLOWER]: Rejecting Update request from peer 0473d2b2d01f4459b1e90fd12cc7840e for earlier term 9. Current term is 10. Ops: [9.5-9.5]
I20260709 13:05:57.445987 19556 raft_consensus.cc:1275] T b9f0d59553ad444883fcf5b5909f9798 P e61c3a8f61bb48f8a963c9480e53c168 [term 9 FOLLOWER]: Refusing update from remote peer 0473d2b2d01f4459b1e90fd12cc7840e: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:05:57.446470 23140 raft_consensus.cc:3060] T 179fd671030940b4b4a4e24bcc4aba0a P e61c3a8f61bb48f8a963c9480e53c168 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:05:57.452334 23324 leader_election.cc:290] T 4af19371ea874c09a0a2147040835cbb P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:05:57.457894 19552 raft_consensus.cc:1275] T 86a6797bdfe94fa496c050ceae4bd0d9 P e61c3a8f61bb48f8a963c9480e53c168 [term 10 FOLLOWER]: Refusing update from remote peer 0473d2b2d01f4459b1e90fd12cc7840e: Log matching property violated. Preceding OpId in replica: term: 8 index: 4. Preceding OpId from leader: term: 10 index: 5. (index mismatch)
I20260709 13:05:57.463017 22758 leader_election.cc:290] T f93ee515a9c14139bf566522ed8232f3 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:05:57.464095 19560 raft_consensus.cc:1275] T f93ee515a9c14139bf566522ed8232f3 P e61c3a8f61bb48f8a963c9480e53c168 [term 13 FOLLOWER]: Refusing update from remote peer 0473d2b2d01f4459b1e90fd12cc7840e: Log matching property violated. Preceding OpId in replica: term: 12 index: 5. Preceding OpId from leader: term: 13 index: 6. (index mismatch)
I20260709 13:05:57.465965 19556 raft_consensus.cc:1240] T ed7fdbcb96d14d418db9ca90a792588a P e61c3a8f61bb48f8a963c9480e53c168 [term 7 FOLLOWER]: Rejecting Update request from peer 0473d2b2d01f4459b1e90fd12cc7840e for earlier term 6. Current term is 7. Ops: []
W20260709 13:05:57.473323 19451 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:57.475121 19526 leader_election.cc:304] T 46c5bfeecc314717bffe987e6844b6d0 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e61c3a8f61bb48f8a963c9480e53c168; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:05:57.480096 22758 raft_consensus.cc:2749] T ed7fdbcb96d14d418db9ca90a792588a P e61c3a8f61bb48f8a963c9480e53c168 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:05:57.481087 22758 raft_consensus.cc:2749] T 46c5bfeecc314717bffe987e6844b6d0 P e61c3a8f61bb48f8a963c9480e53c168 [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:05:57.482319 19552 raft_consensus.cc:1275] T b08304a0a02b42d7840c4e8ee9a6bd1a P e61c3a8f61bb48f8a963c9480e53c168 [term 12 FOLLOWER]: Refusing update from remote peer 0473d2b2d01f4459b1e90fd12cc7840e: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:05:57.432931 23358 raft_consensus.cc:493] T ff75a1d4cb1f493db8f71ddc136ba9ab P e5256d91808b47c195bc9b4dbd7f2b87 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:57.459066 23343 raft_consensus.cc:2749] T 4509b76741dc428e9201c70c1658da13 P e61c3a8f61bb48f8a963c9480e53c168 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:05:57.492149 19560 raft_consensus.cc:1275] T fa8650e71aa14778b3d73721fc50d9fc P e61c3a8f61bb48f8a963c9480e53c168 [term 11 FOLLOWER]: Refusing update from remote peer 0473d2b2d01f4459b1e90fd12cc7840e: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 13:05:57.473688 23091 raft_consensus.cc:493] T 2725d2c4cb054f18b0fc8f735c15f6c2 P e5256d91808b47c195bc9b4dbd7f2b87 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:57.339474 23337 raft_consensus.cc:515] T d1e5873a19244c5ebbcd38e126796ee7 P 0473d2b2d01f4459b1e90fd12cc7840e [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:57.551210 19553 raft_consensus.cc:2468] T 65d8cb8d6ec64f459d5a47cefab10acf P e61c3a8f61bb48f8a963c9480e53c168 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 8.
I20260709 13:05:57.493541 23358 raft_consensus.cc:515] T ff75a1d4cb1f493db8f71ddc136ba9ab P e5256d91808b47c195bc9b4dbd7f2b87 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:57.546036 23093 leader_election.cc:290] T 28af091831594f9d8e96482078cc7625 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:05:57.499909 23091 raft_consensus.cc:515] T 2725d2c4cb054f18b0fc8f735c15f6c2 P e5256d91808b47c195bc9b4dbd7f2b87 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:57.575183 19408 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52342 (request call id 2342) took 1240 ms. Trace:
I20260709 13:05:57.575613 19408 rpcz_store.cc:276] 0709 13:05:56.334543 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:56.334687 (+   144us) service_pool.cc:224] Handling call
0709 13:05:57.567680 (+1232993us) spinlock_profiling.cc:243] Waited 409 ms on lock 0x7b54002ee854. stack: 00007f4a79de9343 00007f4a79de9240 00007f4a797781d4 00007f4a834b6304 00007f4a834b6299 00007f4a7ce71571 00007f4a7cf0c2fa 00007f4a81ecdb17 00007f4a7b4486d4 00007f4a7b448662 00007f4a7b448591 00007f4a7b44850c 00007f4a7b4477c2 00007f4a7b24348c 00007f4a7b2428c6 00007f4a7b24226f
0709 13:05:57.575125 (+  7445us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":940603264}
I20260709 13:05:57.577430 19405 raft_consensus.cc:1240] T 179fd671030940b4b4a4e24bcc4aba0a P e5256d91808b47c195bc9b4dbd7f2b87 [term 10 FOLLOWER]: Rejecting Update request from peer e61c3a8f61bb48f8a963c9480e53c168 for earlier term 9. Current term is 10. Ops: [9.6-9.6]
W20260709 13:05:57.577752 19451 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:05:57.594758 19526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.2:46257, user_credentials={real_user=slave}} blocked reactor thread for 119712us
I20260709 13:05:57.567005 23340 leader_election.cc:290] T 22196caba61445d3bec98a0aab3c337d P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:05:57.597215 19526 leader_election.cc:304] T 0afb57ae58a24a01850491d69f0213dd P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e61c3a8f61bb48f8a963c9480e53c168; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, 127766fc592545a4997f7790f50f6076
I20260709 13:05:57.599740 19526 leader_election.cc:304] T 96efeaaf1057492490e9a621f37e1a2d P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168; no voters: 127766fc592545a4997f7790f50f6076
I20260709 13:05:57.599647 22758 consensus_queue.cc:1048] T ff75a1d4cb1f493db8f71ddc136ba9ab P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:05:57.600705 23093 consensus_queue.cc:1048] T e381f1d6b8184797ad142de49be225a8 P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:05:57.602213 23190 raft_consensus.cc:3055] T ece3db938bc649d4a40a51522ed5259c P e5256d91808b47c195bc9b4dbd7f2b87 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:05:57.611377 23190 raft_consensus.cc:740] T ece3db938bc649d4a40a51522ed5259c P e5256d91808b47c195bc9b4dbd7f2b87 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: e5256d91808b47c195bc9b4dbd7f2b87, State: Running, Role: LEADER
I20260709 13:05:57.612301 23190 consensus_queue.cc:260] T ece3db938bc649d4a40a51522ed5259c P e5256d91808b47c195bc9b4dbd7f2b87 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:05:57.613314 23190 raft_consensus.cc:3060] T ece3db938bc649d4a40a51522ed5259c P e5256d91808b47c195bc9b4dbd7f2b87 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:05:57.606082 19375 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:05:57.607373 23359 log.cc:927] Time spent T 48824d5acfbc485ebf8c2d944e7202de P 0473d2b2d01f4459b1e90fd12cc7840e: Append to log took a long time: real 0.120s	user 0.000s	sys 0.001s
I20260709 13:05:57.603880 23275 raft_consensus.cc:3060] T ff9b0eddd810459b82d91c60777c10eb P e5256d91808b47c195bc9b4dbd7f2b87 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:05:57.610824 20106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a16f7501e2444fb86d4e2778e734e02" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:05:57.624163 20106 raft_consensus.cc:2393] T 2a16f7501e2444fb86d4e2778e734e02 P 127766fc592545a4997f7790f50f6076 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e61c3a8f61bb48f8a963c9480e53c168 in current term 11: Already voted for candidate 127766fc592545a4997f7790f50f6076 in this term.
I20260709 13:05:57.612668 19374 leader_election.cc:304] T 4af19371ea874c09a0a2147040835cbb P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 127766fc592545a4997f7790f50f6076, e5256d91808b47c195bc9b4dbd7f2b87; no voters: 
I20260709 13:05:57.584148 23218 raft_consensus.cc:2749] T 85c494af21f9457a85da47b9bc70c1fd P e5256d91808b47c195bc9b4dbd7f2b87 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:05:57.625734 22830 raft_consensus.cc:2804] T 4af19371ea874c09a0a2147040835cbb P e5256d91808b47c195bc9b4dbd7f2b87 [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 13:05:57.609165 20077 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:57.628857 22758 raft_consensus.cc:2804] T 96efeaaf1057492490e9a621f37e1a2d P e61c3a8f61bb48f8a963c9480e53c168 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:05:57.629369 22758 raft_consensus.cc:697] T 96efeaaf1057492490e9a621f37e1a2d P e61c3a8f61bb48f8a963c9480e53c168 [term 11 LEADER]: Becoming Leader. State: Replica: e61c3a8f61bb48f8a963c9480e53c168, State: Running, Role: LEADER
W20260709 13:05:57.630472 19374 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:57.633718 22758 consensus_queue.cc:237] T 96efeaaf1057492490e9a621f37e1a2d P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.8, Last appended by leader: 8, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
W20260709 13:05:57.635155 23354 log.cc:927] Time spent T 76cb037fc9064d13b59a8969d897ce8c P e61c3a8f61bb48f8a963c9480e53c168: Append to log took a long time: real 0.297s	user 0.001s	sys 0.000s
I20260709 13:05:57.638075 19409 raft_consensus.cc:2468] T 40e1e16737a842ee936002830f36882e P e5256d91808b47c195bc9b4dbd7f2b87 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 14.
I20260709 13:05:57.645419 23233 consensus_queue.cc:1048] T edd7d470b5014c9489be7f41f64355c9 P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:05:57.646734 23091 leader_election.cc:290] T 2725d2c4cb054f18b0fc8f735c15f6c2 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:05:57.667909 19407 raft_consensus.cc:2468] T ff9b0eddd810459b82d91c60777c10eb P e5256d91808b47c195bc9b4dbd7f2b87 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 9.
I20260709 13:05:57.668120 19410 raft_consensus.cc:1275] T ef32ce6fdd0e40d382c79974f30295c6 P e5256d91808b47c195bc9b4dbd7f2b87 [term 12 FOLLOWER]: Refusing update from remote peer e61c3a8f61bb48f8a963c9480e53c168: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 12 index: 7. (term mismatch)
I20260709 13:05:57.668615 19410 pending_rounds.cc:85] T ef32ce6fdd0e40d382c79974f30295c6 P e5256d91808b47c195bc9b4dbd7f2b87: Aborting all ops after (but not including) 6
I20260709 13:05:57.668917 19410 pending_rounds.cc:107] T ef32ce6fdd0e40d382c79974f30295c6 P e5256d91808b47c195bc9b4dbd7f2b87: Aborting uncommitted NO_OP operation due to leader change: 11.7
I20260709 13:05:57.669209 19410 raft_consensus.cc:2889] T ef32ce6fdd0e40d382c79974f30295c6 P e5256d91808b47c195bc9b4dbd7f2b87 [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:05:57.669546 23102 raft_consensus.cc:493] T edd7d470b5014c9489be7f41f64355c9 P 0473d2b2d01f4459b1e90fd12cc7840e [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:57.670212 23102 raft_consensus.cc:515] T edd7d470b5014c9489be7f41f64355c9 P 0473d2b2d01f4459b1e90fd12cc7840e [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:57.672727 23102 leader_election.cc:290] T edd7d470b5014c9489be7f41f64355c9 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:05:57.673332 23102 raft_consensus.cc:493] T e381f1d6b8184797ad142de49be225a8 P 0473d2b2d01f4459b1e90fd12cc7840e [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:57.673861 23102 raft_consensus.cc:515] T e381f1d6b8184797ad142de49be225a8 P 0473d2b2d01f4459b1e90fd12cc7840e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:57.680279 23228 raft_consensus.cc:493] T 775c229504194560ba9589bc2199b089 P 0473d2b2d01f4459b1e90fd12cc7840e [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:57.681099 23228 raft_consensus.cc:3060] T 775c229504194560ba9589bc2199b089 P 0473d2b2d01f4459b1e90fd12cc7840e [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:05:57.632128 22830 raft_consensus.cc:493] T 4af19371ea874c09a0a2147040835cbb P e5256d91808b47c195bc9b4dbd7f2b87 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:05:57.687898 23344 consensus_meta.cc:287] T 1efebf73c86e432baa55533136b6e12c P e61c3a8f61bb48f8a963c9480e53c168: Time spent flushing consensus metadata: real 0.757s	user 0.015s	sys 0.002s
I20260709 13:05:57.688318 23243 leader_election.cc:290] T e381f1d6b8184797ad142de49be225a8 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:05:57.689850 23027 raft_consensus.cc:515] T 21e14947d70440f19044d8f75c31e1f9 P 0473d2b2d01f4459b1e90fd12cc7840e [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
W20260709 13:05:57.691077 19525 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:57.693557 19559 raft_consensus.cc:1275] T 217b5fae677b4971b3bbd2f357a1f7ff P e61c3a8f61bb48f8a963c9480e53c168 [term 7 FOLLOWER]: Refusing update from remote peer e5256d91808b47c195bc9b4dbd7f2b87: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:05:57.694552 19558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9f0d59553ad444883fcf5b5909f9798" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:05:57.694801 19523 leader_election.cc:304] T 4af19371ea874c09a0a2147040835cbb P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168; no voters: 127766fc592545a4997f7790f50f6076
I20260709 13:05:57.695180 19558 raft_consensus.cc:2468] T b9f0d59553ad444883fcf5b5909f9798 P e61c3a8f61bb48f8a963c9480e53c168 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 9.
I20260709 13:05:57.695888 19523 leader_election.cc:304] T 2a16f7501e2444fb86d4e2778e734e02 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:05:57.658929 23316 raft_consensus.cc:493] T 309c3ca0ca4b4f3ba129752ea2cb293b P 0473d2b2d01f4459b1e90fd12cc7840e [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:57.696848 23316 raft_consensus.cc:515] T 309c3ca0ca4b4f3ba129752ea2cb293b P 0473d2b2d01f4459b1e90fd12cc7840e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } attrs { replace: true } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:05:57.697461 23340 raft_consensus.cc:493] T 0e1085d23e8347fbbd5bce7542f4b1f4 P e61c3a8f61bb48f8a963c9480e53c168 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:57.697986 23340 raft_consensus.cc:515] T 0e1085d23e8347fbbd5bce7542f4b1f4 P e61c3a8f61bb48f8a963c9480e53c168 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:05:57.700452 19523 leader_election.cc:400] T 65d8cb8d6ec64f459d5a47cefab10acf P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 7 election: Vote denied by peer e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321) with higher term. Message: Invalid argument: T 65d8cb8d6ec64f459d5a47cefab10acf P e5256d91808b47c195bc9b4dbd7f2b87 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate e61c3a8f61bb48f8a963c9480e53c168 for earlier term 7. Current term is 8.
I20260709 13:05:57.700924 19523 leader_election.cc:403] T 65d8cb8d6ec64f459d5a47cefab10acf P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 7 election: Cancelling election due to peer responding with higher term
I20260709 13:05:57.703073 19375 leader_election.cc:304] T 65d8cb8d6ec64f459d5a47cefab10acf P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168; no voters: 127766fc592545a4997f7790f50f6076
W20260709 13:05:57.704504 19524 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:57.698853 23233 raft_consensus.cc:2804] T 4af19371ea874c09a0a2147040835cbb P e61c3a8f61bb48f8a963c9480e53c168 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:05:57.708190 19523 leader_election.cc:304] T 40e1e16737a842ee936002830f36882e P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:05:57.654152 23194 raft_consensus.cc:515] T 62c6c134d3d24a1ab144dd9ee6bc3f64 P e61c3a8f61bb48f8a963c9480e53c168 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:05:57.699124 22979 raft_consensus.cc:2804] T 2a16f7501e2444fb86d4e2778e734e02 P e61c3a8f61bb48f8a963c9480e53c168 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:05:57.713280 22979 raft_consensus.cc:493] T 2a16f7501e2444fb86d4e2778e734e02 P e61c3a8f61bb48f8a963c9480e53c168 [term 10 FOLLOWER]: Starting leader election (detected failure of leader e5256d91808b47c195bc9b4dbd7f2b87)
I20260709 13:05:57.713676 22979 raft_consensus.cc:3060] T 2a16f7501e2444fb86d4e2778e734e02 P e61c3a8f61bb48f8a963c9480e53c168 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:05:57.710770 23368 raft_consensus.cc:2749] T 65d8cb8d6ec64f459d5a47cefab10acf P e61c3a8f61bb48f8a963c9480e53c168 [term 8 FOLLOWER]: Leader election lost for term 7. Reason: Vote denied by peer e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321) with higher term. Message: Invalid argument: T 65d8cb8d6ec64f459d5a47cefab10acf P e5256d91808b47c195bc9b4dbd7f2b87 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate e61c3a8f61bb48f8a963c9480e53c168 for earlier term 7. Current term is 8.
I20260709 13:05:57.714661 23194 leader_election.cc:290] T 62c6c134d3d24a1ab144dd9ee6bc3f64 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 10 election: Requested vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:05:57.599341 23238 raft_consensus.cc:515] T a08760e15aac4630a629431f56024dc8 P 0473d2b2d01f4459b1e90fd12cc7840e [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:57.716982 19411 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "28af091831594f9d8e96482078cc7625"
dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
mode: GRACEFUL
new_leader_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
 from {username='slave'} at 127.0.0.1:37312
I20260709 13:05:57.737115 19552 raft_consensus.cc:1240] T ece3db938bc649d4a40a51522ed5259c P e61c3a8f61bb48f8a963c9480e53c168 [term 9 FOLLOWER]: Rejecting Update request from peer e5256d91808b47c195bc9b4dbd7f2b87 for earlier term 8. Current term is 9. Ops: []
I20260709 13:05:57.737334 19411 raft_consensus.cc:606] T 28af091831594f9d8e96482078cc7625 P e5256d91808b47c195bc9b4dbd7f2b87 [term 9 FOLLOWER]: Received request to transfer leadership to TS 0473d2b2d01f4459b1e90fd12cc7840e
I20260709 13:05:57.737732 19411 raft_consensus.cc:614] T 28af091831594f9d8e96482078cc7625 P e5256d91808b47c195bc9b4dbd7f2b87 [term 9 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:05:57.738917 19553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2725d2c4cb054f18b0fc8f735c15f6c2" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:05:57.739116 19558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e381f1d6b8184797ad142de49be225a8" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 9 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
W20260709 13:05:57.739796 22974 consensus_meta.cc:287] T 2725d2c4cb054f18b0fc8f735c15f6c2 P e61c3a8f61bb48f8a963c9480e53c168: Time spent flushing consensus metadata: real 0.899s	user 0.008s	sys 0.004s
I20260709 13:05:57.740278 22974 raft_consensus.cc:2749] T 2725d2c4cb054f18b0fc8f735c15f6c2 P e61c3a8f61bb48f8a963c9480e53c168 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:05:57.712646 23233 raft_consensus.cc:493] T 4af19371ea874c09a0a2147040835cbb P e61c3a8f61bb48f8a963c9480e53c168 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:57.740885 23340 leader_election.cc:290] T 0e1085d23e8347fbbd5bce7542f4b1f4 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:05:57.741164 23233 raft_consensus.cc:3060] T 4af19371ea874c09a0a2147040835cbb P e61c3a8f61bb48f8a963c9480e53c168 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:05:57.742007 23369 log.cc:927] Time spent T 6c5eebf646ad445a9d1b1adc319d7b16 P 0473d2b2d01f4459b1e90fd12cc7840e: Append to log took a long time: real 0.083s	user 0.000s	sys 0.000s
W20260709 13:05:57.743251 23372 log.cc:927] Time spent T 2e36a9d6e29c4a7c860cf267efbd4c74 P e5256d91808b47c195bc9b4dbd7f2b87: Append to log took a long time: real 0.091s	user 0.001s	sys 0.000s
I20260709 13:05:57.744524 23268 raft_consensus.cc:515] T 4af19371ea874c09a0a2147040835cbb P 127766fc592545a4997f7790f50f6076 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:05:57.747296 23337 leader_election.cc:290] T d1e5873a19244c5ebbcd38e126796ee7 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:05:57.700796 22830 raft_consensus.cc:3060] T 4af19371ea874c09a0a2147040835cbb P e5256d91808b47c195bc9b4dbd7f2b87 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:05:57.750999 23220 consensus_meta.cc:287] T 1dc5b3532fe54f74876d02beffa2c230 P 0473d2b2d01f4459b1e90fd12cc7840e: Time spent flushing consensus metadata: real 0.546s	user 0.012s	sys 0.000s
I20260709 13:05:57.751811 23102 leader_election.cc:290] T e381f1d6b8184797ad142de49be225a8 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:05:57.688392 23344 raft_consensus.cc:515] T 1efebf73c86e432baa55533136b6e12c P e61c3a8f61bb48f8a963c9480e53c168 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:05:57.752936 19555 raft_consensus.cc:2410] T 179fd671030940b4b4a4e24bcc4aba0a P e61c3a8f61bb48f8a963c9480e53c168 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0473d2b2d01f4459b1e90fd12cc7840e for term 10 because replica has last-logged OpId of term: 9 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 5.
I20260709 13:05:57.716660 23338 raft_consensus.cc:2804] T 40e1e16737a842ee936002830f36882e P e61c3a8f61bb48f8a963c9480e53c168 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:05:57.753885 23338 raft_consensus.cc:697] T 40e1e16737a842ee936002830f36882e P e61c3a8f61bb48f8a963c9480e53c168 [term 14 LEADER]: Becoming Leader. State: Replica: e61c3a8f61bb48f8a963c9480e53c168, State: Running, Role: LEADER
I20260709 13:05:57.754035 23344 leader_election.cc:290] T 1efebf73c86e432baa55533136b6e12c P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 9 election: Requested vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:05:57.754796 23338 consensus_queue.cc:237] T 40e1e16737a842ee936002830f36882e P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 12.6, Last appended by leader: 6, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:57.755422 23358 leader_election.cc:290] T ff75a1d4cb1f493db8f71ddc136ba9ab P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:05:57.756023 23238 leader_election.cc:290] T a08760e15aac4630a629431f56024dc8 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 12 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:05:57.756721 19484 raft_consensus.cc:1240] T a08760e15aac4630a629431f56024dc8 P 0473d2b2d01f4459b1e90fd12cc7840e [term 12 FOLLOWER]: Rejecting Update request from peer e61c3a8f61bb48f8a963c9480e53c168 for earlier term 11. Current term is 12. Ops: [11.7-11.7]
I20260709 13:05:57.758293 19553 raft_consensus.cc:2468] T 2725d2c4cb054f18b0fc8f735c15f6c2 P e61c3a8f61bb48f8a963c9480e53c168 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 11.
I20260709 13:05:57.757292 23122 raft_consensus.cc:2804] T 65d8cb8d6ec64f459d5a47cefab10acf P e5256d91808b47c195bc9b4dbd7f2b87 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:05:57.785949 19375 leader_election.cc:304] T b9f0d59553ad444883fcf5b5909f9798 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
W20260709 13:05:57.781224 23249 consensus_meta.cc:287] T 96efeaaf1057492490e9a621f37e1a2d P 127766fc592545a4997f7790f50f6076: Time spent flushing consensus metadata: real 0.678s	user 0.010s	sys 0.000s
I20260709 13:05:57.798009 23233 raft_consensus.cc:515] T 4af19371ea874c09a0a2147040835cbb P e61c3a8f61bb48f8a963c9480e53c168 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:05:57.781121 23027 leader_election.cc:290] T 21e14947d70440f19044d8f75c31e1f9 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 10 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:05:57.801659 23189 raft_consensus.cc:2804] T b9f0d59553ad444883fcf5b5909f9798 P e5256d91808b47c195bc9b4dbd7f2b87 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:05:57.802858 23223 raft_consensus.cc:493] T 172b3dd13109415a955b71ac0e9d2234 P e5256d91808b47c195bc9b4dbd7f2b87 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:05:57.791776 20078 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.2:46257, user_credentials={real_user=slave}} blocked reactor thread for 98023.2us
I20260709 13:05:57.781325 23343 raft_consensus.cc:2749] T 0afb57ae58a24a01850491d69f0213dd P e61c3a8f61bb48f8a963c9480e53c168 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:05:57.781427 23324 raft_consensus.cc:493] T 833a2f0775ed407a94b8924ce50adb63 P 127766fc592545a4997f7790f50f6076 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader e5256d91808b47c195bc9b4dbd7f2b87)
I20260709 13:05:57.737727 23276 raft_consensus.cc:515] T df751f992649444090e27965eb1af85d P e5256d91808b47c195bc9b4dbd7f2b87 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:57.788082 23316 leader_election.cc:290] T 309c3ca0ca4b4f3ba129752ea2cb293b P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:05:57.814106 19403 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "70797e5783b5454ab0d0eea663e791e3"
dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
mode: GRACEFUL
new_leader_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
 from {username='slave'} at 127.0.0.1:37312
W20260709 13:05:57.831175 19523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.1:40321, user_credentials={real_user=slave}} blocked reactor thread for 120156us
I20260709 13:05:57.787945 23122 raft_consensus.cc:697] T 65d8cb8d6ec64f459d5a47cefab10acf P e5256d91808b47c195bc9b4dbd7f2b87 [term 8 LEADER]: Becoming Leader. State: Replica: e5256d91808b47c195bc9b4dbd7f2b87, State: Running, Role: LEADER
W20260709 13:05:57.818939 19376 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:57.820243 23233 leader_election.cc:290] T 4af19371ea874c09a0a2147040835cbb P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 7 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:05:57.822738 23249 raft_consensus.cc:493] T 0afb57ae58a24a01850491d69f0213dd P 127766fc592545a4997f7790f50f6076 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:57.836591 19523 leader_election.cc:304] T ece3db938bc649d4a40a51522ed5259c P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e61c3a8f61bb48f8a963c9480e53c168; no voters: 127766fc592545a4997f7790f50f6076, e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:05:57.824450 23332 raft_consensus.cc:493] T 1efebf73c86e432baa55533136b6e12c P 127766fc592545a4997f7790f50f6076 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:57.832319 22758 consensus_queue.cc:1048] T ef32ce6fdd0e40d382c79974f30295c6 P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:05:57.831781 19403 raft_consensus.cc:606] T 70797e5783b5454ab0d0eea663e791e3 P e5256d91808b47c195bc9b4dbd7f2b87 [term 10 LEADER]: Received request to transfer leadership to TS e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:05:57.781387 23254 raft_consensus.cc:515] T 309c3ca0ca4b4f3ba129752ea2cb293b P 127766fc592545a4997f7790f50f6076 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } attrs { replace: true } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:05:57.813849 23189 raft_consensus.cc:493] T b9f0d59553ad444883fcf5b5909f9798 P e5256d91808b47c195bc9b4dbd7f2b87 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 0473d2b2d01f4459b1e90fd12cc7840e)
I20260709 13:05:57.851886 19402 raft_consensus.cc:1240] T df751f992649444090e27965eb1af85d P e5256d91808b47c195bc9b4dbd7f2b87 [term 12 FOLLOWER]: Rejecting Update request from peer 0473d2b2d01f4459b1e90fd12cc7840e for earlier term 11. Current term is 12. Ops: []
I20260709 13:05:57.807250 23275 consensus_queue.cc:1048] T 217b5fae677b4971b3bbd2f357a1f7ff P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.030s
I20260709 13:05:57.853849 19483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df751f992649444090e27965eb1af85d" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
W20260709 13:05:57.860260 20075 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:05:57.863768 23376 log.cc:927] Time spent T b9f0d59553ad444883fcf5b5909f9798 P e5256d91808b47c195bc9b4dbd7f2b87: Append to log took a long time: real 0.074s	user 0.001s	sys 0.000s
I20260709 13:05:57.864096 19477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a08760e15aac4630a629431f56024dc8" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:05:57.849357 23249 raft_consensus.cc:515] T 0afb57ae58a24a01850491d69f0213dd P 127766fc592545a4997f7790f50f6076 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:05:57.866179 23122 consensus_queue.cc:237] T 65d8cb8d6ec64f459d5a47cefab10acf P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.6, Last appended by leader: 6, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:05:57.838218 23340 raft_consensus.cc:2749] T ece3db938bc649d4a40a51522ed5259c P e61c3a8f61bb48f8a963c9480e53c168 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:05:57.867738 23249 leader_election.cc:290] T 0afb57ae58a24a01850491d69f0213dd P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:05:57.863636 19482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28af091831594f9d8e96482078cc7625" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:05:57.868578 19482 raft_consensus.cc:2393] T 28af091831594f9d8e96482078cc7625 P 0473d2b2d01f4459b1e90fd12cc7840e [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e5256d91808b47c195bc9b4dbd7f2b87 in current term 10: Already voted for candidate 0473d2b2d01f4459b1e90fd12cc7840e in this term.
I20260709 13:05:57.854640 23178 raft_consensus.cc:493] T ef32ce6fdd0e40d382c79974f30295c6 P e5256d91808b47c195bc9b4dbd7f2b87 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:57.871124 23178 raft_consensus.cc:515] T ef32ce6fdd0e40d382c79974f30295c6 P e5256d91808b47c195bc9b4dbd7f2b87 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:57.873194 23178 leader_election.cc:290] T ef32ce6fdd0e40d382c79974f30295c6 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:05:57.874279 23276 leader_election.cc:290] T df751f992649444090e27965eb1af85d P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 12 election: Requested vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:05:57.880137 19481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1b10566f45d4a7d9029858330e02d5b" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:05:57.885728 19481 raft_consensus.cc:2468] T f1b10566f45d4a7d9029858330e02d5b P 0473d2b2d01f4459b1e90fd12cc7840e [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 11.
W20260709 13:05:57.887254 20078 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.2:46257, user_credentials={real_user=slave}} blocked reactor thread for 63230.6us
I20260709 13:05:57.884258 19449 leader_election.cc:304] T 62c6c134d3d24a1ab144dd9ee6bc3f64 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, 127766fc592545a4997f7790f50f6076; no voters: 
W20260709 13:05:57.892412 19523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.4:43121, user_credentials={real_user=slave}} blocked reactor thread for 53480.9us
I20260709 13:05:57.892693 19479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22196caba61445d3bec98a0aab3c337d" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
W20260709 13:05:57.893186 19375 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.3:36891, user_credentials={real_user=slave}} blocked reactor thread for 97515.9us
I20260709 13:05:57.897228 19481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f93ee515a9c14139bf566522ed8232f3" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 13 candidate_status { last_received { term: 12 index: 5 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:05:57.907788 19485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e5873a19244c5ebbcd38e126796ee7" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:05:57.894344 19449 leader_election.cc:304] T 2725d2c4cb054f18b0fc8f735c15f6c2 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e; no voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:05:57.854041 23189 raft_consensus.cc:3060] T b9f0d59553ad444883fcf5b5909f9798 P e5256d91808b47c195bc9b4dbd7f2b87 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:05:57.922158 20110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4af19371ea874c09a0a2147040835cbb" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076"
I20260709 13:05:57.923556 20104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e1085d23e8347fbbd5bce7542f4b1f4" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:05:57.940672 20110 raft_consensus.cc:2393] T 4af19371ea874c09a0a2147040835cbb P 127766fc592545a4997f7790f50f6076 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate e61c3a8f61bb48f8a963c9480e53c168 in current term 7: Already voted for candidate 127766fc592545a4997f7790f50f6076 in this term.
I20260709 13:05:57.941061 20112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62c6c134d3d24a1ab144dd9ee6bc3f64" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076"
I20260709 13:05:57.941610 20112 raft_consensus.cc:3060] T 62c6c134d3d24a1ab144dd9ee6bc3f64 P 127766fc592545a4997f7790f50f6076 [term 8 FOLLOWER]: Advancing to term 10
I20260709 13:05:57.856220 23316 raft_consensus.cc:493] T 3e1f505cb0f1427bbd698ac889d80821 P 0473d2b2d01f4459b1e90fd12cc7840e [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:57.940464 19483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40e1e16737a842ee936002830f36882e" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 13 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:05:57.944331 19558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df751f992649444090e27965eb1af85d" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:05:57.946369 19483 raft_consensus.cc:2368] T 40e1e16737a842ee936002830f36882e P 0473d2b2d01f4459b1e90fd12cc7840e [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate e5256d91808b47c195bc9b4dbd7f2b87 for earlier term 13. Current term is 14.
I20260709 13:05:57.946579 19558 raft_consensus.cc:3060] T df751f992649444090e27965eb1af85d P e61c3a8f61bb48f8a963c9480e53c168 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:05:57.938809 19552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef32ce6fdd0e40d382c79974f30295c6" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 13 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:05:57.948388 19411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21e14947d70440f19044d8f75c31e1f9" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
I20260709 13:05:57.830262 23223 raft_consensus.cc:515] T 172b3dd13109415a955b71ac0e9d2234 P e5256d91808b47c195bc9b4dbd7f2b87 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:05:57.944028 20104 raft_consensus.cc:2468] T 0e1085d23e8347fbbd5bce7542f4b1f4 P 127766fc592545a4997f7790f50f6076 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 7.
I20260709 13:05:57.948154 20105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1efebf73c86e432baa55533136b6e12c" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076"
I20260709 13:05:57.944119 19554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4af19371ea874c09a0a2147040835cbb" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:05:57.957834 19557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff75a1d4cb1f493db8f71ddc136ba9ab" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:05:57.958748 19485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b08304a0a02b42d7840c4e8ee9a6bd1a" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
W20260709 13:05:57.958844 19526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.2:46257, user_credentials={real_user=slave}} blocked reactor thread for 78356.6us
I20260709 13:05:57.838624 23324 raft_consensus.cc:515] T 833a2f0775ed407a94b8924ce50adb63 P 127766fc592545a4997f7790f50f6076 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:05:57.958545 19408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edd7d470b5014c9489be7f41f64355c9" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 12 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:05:57.960402 19554 raft_consensus.cc:2393] T 4af19371ea874c09a0a2147040835cbb P e61c3a8f61bb48f8a963c9480e53c168 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 127766fc592545a4997f7790f50f6076 in current term 7: Already voted for candidate e61c3a8f61bb48f8a963c9480e53c168 in this term.
I20260709 13:05:57.963924 19479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76cb037fc9064d13b59a8969d897ce8c" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:05:57.948113 20078 leader_election.cc:304] T 1f85fc4b527a48848e5faa083b604e36 P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 127766fc592545a4997f7790f50f6076; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:05:57.910089 23027 raft_consensus.cc:2804] T 62c6c134d3d24a1ab144dd9ee6bc3f64 P 0473d2b2d01f4459b1e90fd12cc7840e [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:05:57.965852 19403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e5873a19244c5ebbcd38e126796ee7" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:05:57.960996 19483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "775c229504194560ba9589bc2199b089" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:05:57.967726 19410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "309c3ca0ca4b4f3ba129752ea2cb293b" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:05:57.909822 23344 raft_consensus.cc:493] T b08304a0a02b42d7840c4e8ee9a6bd1a P e61c3a8f61bb48f8a963c9480e53c168 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:57.962270 19555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0afb57ae58a24a01850491d69f0213dd" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:05:57.968307 20112 raft_consensus.cc:2468] T 62c6c134d3d24a1ab144dd9ee6bc3f64 P 127766fc592545a4997f7790f50f6076 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 10.
I20260709 13:05:57.968331 19410 raft_consensus.cc:2468] T 309c3ca0ca4b4f3ba129752ea2cb293b P e5256d91808b47c195bc9b4dbd7f2b87 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 8.
I20260709 13:05:57.972009 19479 raft_consensus.cc:2393] T 76cb037fc9064d13b59a8969d897ce8c P 0473d2b2d01f4459b1e90fd12cc7840e [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e5256d91808b47c195bc9b4dbd7f2b87 in current term 9: Already voted for candidate 0473d2b2d01f4459b1e90fd12cc7840e in this term.
I20260709 13:05:57.851768 23332 raft_consensus.cc:515] T 1efebf73c86e432baa55533136b6e12c P 127766fc592545a4997f7790f50f6076 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:05:57.983387 19410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e381f1d6b8184797ad142de49be225a8" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:05:57.995222 19485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "217b5fae677b4971b3bbd2f357a1f7ff" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:05:57.995883 19407 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52342 (request call id 2351) took 1285 ms. Trace:
I20260709 13:05:57.996088 19485 raft_consensus.cc:2468] T 217b5fae677b4971b3bbd2f357a1f7ff P 0473d2b2d01f4459b1e90fd12cc7840e [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 7.
I20260709 13:05:57.996300 19407 rpcz_store.cc:276] 0709 13:05:56.710319 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:56.710526 (+   207us) service_pool.cc:224] Handling call
0709 13:05:57.995719 (+1285193us) spinlock_profiling.cc:243] Waited 953 ms on lock 0x7b540023b254. stack: 00007f4a79de9343 00007f4a79de9240 00007f4a797781d4 00007f4a834b6304 00007f4a834b6299 00007f4a7ce71571 00007f4a7cf0c2fa 00007f4a81ecdb17 00007f4a7b4486d4 00007f4a7b448662 00007f4a7b448591 00007f4a7b44850c 00007f4a7b4477c2 00007f4a7b24348c 00007f4a7b2428c6 00007f4a7b24226f
0709 13:05:57.995825 (+   106us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2192359808}
I20260709 13:05:57.922305 23238 consensus_queue.cc:1048] T f93ee515a9c14139bf566522ed8232f3 P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.054s
I20260709 13:05:58.000813 19407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4af19371ea874c09a0a2147040835cbb" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
W20260709 13:05:58.005201 20078 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.2:46257, user_credentials={real_user=slave}} blocked reactor thread for 57159.2us
I20260709 13:05:58.006006 20078 leader_election.cc:304] T 172b3dd13109415a955b71ac0e9d2234 P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, 127766fc592545a4997f7790f50f6076; no voters: e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:05:57.970427 23027 raft_consensus.cc:493] T 62c6c134d3d24a1ab144dd9ee6bc3f64 P 0473d2b2d01f4459b1e90fd12cc7840e [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:05:58.019560 19449 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.1:40321, user_credentials={real_user=slave}} blocked reactor thread for 125274us
I20260709 13:05:58.022418 19479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e36a9d6e29c4a7c860cf267efbd4c74" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:05:58.028488 19410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a08760e15aac4630a629431f56024dc8" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
I20260709 13:05:58.028738 19486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dc5b3532fe54f74876d02beffa2c230" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
W20260709 13:05:58.032176 19377 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.2:46257, user_credentials={real_user=slave}} blocked reactor thread for 70790.9us
I20260709 13:05:57.985730 23083 raft_consensus.cc:2749] T 2725d2c4cb054f18b0fc8f735c15f6c2 P 0473d2b2d01f4459b1e90fd12cc7840e [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:05:57.985546 23268 leader_election.cc:290] T 4af19371ea874c09a0a2147040835cbb P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 7 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:05:58.033952 19486 raft_consensus.cc:2410] T 1dc5b3532fe54f74876d02beffa2c230 P 0473d2b2d01f4459b1e90fd12cc7840e [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e5256d91808b47c195bc9b4dbd7f2b87 for term 10 because replica has last-logged OpId of term: 9 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 4.
I20260709 13:05:58.042227 19408 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a08760e15aac4630a629431f56024dc8"
dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
mode: GRACEFUL
new_leader_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
 from {username='slave'} at 127.0.0.1:37312
I20260709 13:05:58.042842 19408 raft_consensus.cc:606] T a08760e15aac4630a629431f56024dc8 P e5256d91808b47c195bc9b4dbd7f2b87 [term 11 FOLLOWER]: Received request to transfer leadership to TS e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:05:58.043213 19408 raft_consensus.cc:614] T a08760e15aac4630a629431f56024dc8 P e5256d91808b47c195bc9b4dbd7f2b87 [term 11 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:05:58.037340 19449 leader_election.cc:304] T ff9b0eddd810459b82d91c60777c10eb P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87; no voters: 127766fc592545a4997f7790f50f6076
I20260709 13:05:58.044446 19523 leader_election.cc:304] T 0e1085d23e8347fbbd5bce7542f4b1f4 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 127766fc592545a4997f7790f50f6076, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:05:58.069370 19481 raft_consensus.cc:1275] T ef32ce6fdd0e40d382c79974f30295c6 P 0473d2b2d01f4459b1e90fd12cc7840e [term 12 FOLLOWER]: Refusing update from remote peer e61c3a8f61bb48f8a963c9480e53c168: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:05:58.071375 19485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46c5bfeecc314717bffe987e6844b6d0" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 16 candidate_status { last_received { term: 15 index: 6 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:05:58.073355 19479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21e14947d70440f19044d8f75c31e1f9" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:05:57.981396 23344 raft_consensus.cc:515] T b08304a0a02b42d7840c4e8ee9a6bd1a P e61c3a8f61bb48f8a963c9480e53c168 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:57.976208 23316 raft_consensus.cc:515] T 3e1f505cb0f1427bbd698ac889d80821 P 0473d2b2d01f4459b1e90fd12cc7840e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:58.079936 19557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4af19371ea874c09a0a2147040835cbb" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:05:58.080845 19557 raft_consensus.cc:2393] T 4af19371ea874c09a0a2147040835cbb P e61c3a8f61bb48f8a963c9480e53c168 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 127766fc592545a4997f7790f50f6076 in current term 7: Already voted for candidate e61c3a8f61bb48f8a963c9480e53c168 in this term.
I20260709 13:05:58.023765 23336 leader_election.cc:290] T f1b10566f45d4a7d9029858330e02d5b P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:05:58.030301 23027 raft_consensus.cc:3060] T 62c6c134d3d24a1ab144dd9ee6bc3f64 P 0473d2b2d01f4459b1e90fd12cc7840e [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:05:58.076303 19481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62c6c134d3d24a1ab144dd9ee6bc3f64" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:05:58.078116 19478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36f6ba92b9ba46babe4ebd6c02e5fbd9" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:05:58.087646 19482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f93ee515a9c14139bf566522ed8232f3" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 14 candidate_status { last_received { term: 12 index: 5 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:05:58.089210 19482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1efebf73c86e432baa55533136b6e12c" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:05:58.089962 19486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "217b5fae677b4971b3bbd2f357a1f7ff" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:05:58.089972 19482 raft_consensus.cc:2393] T 1efebf73c86e432baa55533136b6e12c P 0473d2b2d01f4459b1e90fd12cc7840e [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate e61c3a8f61bb48f8a963c9480e53c168 in current term 9: Already voted for candidate 0473d2b2d01f4459b1e90fd12cc7840e in this term.
I20260709 13:05:58.091548 19482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e1085d23e8347fbbd5bce7542f4b1f4" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:05:58.092271 19482 raft_consensus.cc:2468] T 0e1085d23e8347fbbd5bce7542f4b1f4 P 0473d2b2d01f4459b1e90fd12cc7840e [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 7.
I20260709 13:05:58.093997 22830 raft_consensus.cc:515] T 4af19371ea874c09a0a2147040835cbb P e5256d91808b47c195bc9b4dbd7f2b87 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:05:58.095012 19477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28af091831594f9d8e96482078cc7625" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:05:58.099026 19477 raft_consensus.cc:2468] T 28af091831594f9d8e96482078cc7625 P 0473d2b2d01f4459b1e90fd12cc7840e [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 10.
I20260709 13:05:58.102042 22830 leader_election.cc:290] T 4af19371ea874c09a0a2147040835cbb P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 7 election: Requested vote from peers e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:05:58.041455 23387 raft_consensus.cc:2749] T 1f85fc4b527a48848e5faa083b604e36 P 127766fc592545a4997f7790f50f6076 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:05:58.107410 19407 raft_consensus.cc:2393] T 4af19371ea874c09a0a2147040835cbb P e5256d91808b47c195bc9b4dbd7f2b87 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 127766fc592545a4997f7790f50f6076 in current term 7: Already voted for candidate e5256d91808b47c195bc9b4dbd7f2b87 in this term.
I20260709 13:05:58.083169 19478 raft_consensus.cc:2376] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P 0473d2b2d01f4459b1e90fd12cc7840e [term 11 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 11. Re-sending same reply.
I20260709 13:05:58.116597 19479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22196caba61445d3bec98a0aab3c337d" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:05:58.111817 19486 raft_consensus.cc:2468] T 217b5fae677b4971b3bbd2f357a1f7ff P 0473d2b2d01f4459b1e90fd12cc7840e [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 7.
I20260709 13:05:58.075289 23083 raft_consensus.cc:2764] T ff9b0eddd810459b82d91c60777c10eb P 0473d2b2d01f4459b1e90fd12cc7840e [term 9 FOLLOWER]: Leader pre-election decision vote started in defunct term 8: won
I20260709 13:05:58.042955 23335 consensus_queue.cc:1059] T df751f992649444090e27965eb1af85d P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.078s
I20260709 13:05:58.131842 19486 raft_consensus.cc:1275] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P 0473d2b2d01f4459b1e90fd12cc7840e [term 11 FOLLOWER]: Refusing update from remote peer e5256d91808b47c195bc9b4dbd7f2b87: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:05:58.129943 19409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "309c3ca0ca4b4f3ba129752ea2cb293b" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
I20260709 13:05:58.133749 19409 raft_consensus.cc:3060] T 309c3ca0ca4b4f3ba129752ea2cb293b P e5256d91808b47c195bc9b4dbd7f2b87 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:05:58.173789 19409 raft_consensus.cc:2468] T 309c3ca0ca4b4f3ba129752ea2cb293b P e5256d91808b47c195bc9b4dbd7f2b87 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 127766fc592545a4997f7790f50f6076 in term 9.
I20260709 13:05:58.181912 20108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4af19371ea874c09a0a2147040835cbb" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076"
I20260709 13:05:58.182861 20108 raft_consensus.cc:2393] T 4af19371ea874c09a0a2147040835cbb P 127766fc592545a4997f7790f50f6076 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate e5256d91808b47c195bc9b4dbd7f2b87 in current term 7: Already voted for candidate 127766fc592545a4997f7790f50f6076 in this term.
I20260709 13:05:58.163957 23268 raft_consensus.cc:493] T 14efcc79969f41babe5529c22d59156d P 127766fc592545a4997f7790f50f6076 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader e5256d91808b47c195bc9b4dbd7f2b87)
I20260709 13:05:58.211515 23332 leader_election.cc:290] T 1efebf73c86e432baa55533136b6e12c P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:05:58.235577 23223 leader_election.cc:290] T 172b3dd13109415a955b71ac0e9d2234 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:05:58.239230 23316 leader_election.cc:290] T 3e1f505cb0f1427bbd698ac889d80821 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
W20260709 13:05:58.241429 23382 log.cc:927] Time spent T 1dc5b3532fe54f74876d02beffa2c230 P e5256d91808b47c195bc9b4dbd7f2b87: Append to log took a long time: real 0.135s	user 0.001s	sys 0.000s
I20260709 13:05:58.171685 23387 raft_consensus.cc:2804] T 172b3dd13109415a955b71ac0e9d2234 P 127766fc592545a4997f7790f50f6076 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:05:58.242121 23387 raft_consensus.cc:697] T 172b3dd13109415a955b71ac0e9d2234 P 127766fc592545a4997f7790f50f6076 [term 9 LEADER]: Becoming Leader. State: Replica: 127766fc592545a4997f7790f50f6076, State: Running, Role: LEADER
W20260709 13:05:58.243193 23389 log.cc:927] Time spent T 40e1e16737a842ee936002830f36882e P e61c3a8f61bb48f8a963c9480e53c168: Append to log took a long time: real 0.073s	user 0.000s	sys 0.000s
I20260709 13:05:58.243324 23387 consensus_queue.cc:237] T 172b3dd13109415a955b71ac0e9d2234 P 127766fc592545a4997f7790f50f6076 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 7, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:05:58.245042 23324 leader_election.cc:290] T 833a2f0775ed407a94b8924ce50adb63 P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:05:58.260666 23335 raft_consensus.cc:3055] T df751f992649444090e27965eb1af85d P 0473d2b2d01f4459b1e90fd12cc7840e [term 11 LEADER]: Stepping down as leader of term 11
W20260709 13:05:58.261830 19374 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.4:43121, user_credentials={real_user=slave}} blocked reactor thread for 75214.5us
W20260709 13:05:58.262218 19452 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:58.242379 20105 raft_consensus.cc:2468] T 1efebf73c86e432baa55533136b6e12c P 127766fc592545a4997f7790f50f6076 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 9.
I20260709 13:05:58.264025 23335 raft_consensus.cc:740] T df751f992649444090e27965eb1af85d P 0473d2b2d01f4459b1e90fd12cc7840e [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 0473d2b2d01f4459b1e90fd12cc7840e, State: Running, Role: LEADER
I20260709 13:05:58.267911 19479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "179fd671030940b4b4a4e24bcc4aba0a" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:05:58.212867 23394 raft_consensus.cc:493] T 85c494af21f9457a85da47b9bc70c1fd P 127766fc592545a4997f7790f50f6076 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:58.272298 19409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "833a2f0775ed407a94b8924ce50adb63" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:05:58.256742 23254 leader_election.cc:290] T 309c3ca0ca4b4f3ba129752ea2cb293b P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 9 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:05:58.259819 23344 leader_election.cc:290] T b08304a0a02b42d7840c4e8ee9a6bd1a P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:05:58.275609 19479 raft_consensus.cc:3060] T 179fd671030940b4b4a4e24bcc4aba0a P 0473d2b2d01f4459b1e90fd12cc7840e [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:05:58.276360 19558 raft_consensus.cc:2468] T df751f992649444090e27965eb1af85d P e61c3a8f61bb48f8a963c9480e53c168 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 12.
W20260709 13:05:58.425010 19526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.2:46257, user_credentials={real_user=slave}} blocked reactor thread for 465467us
W20260709 13:05:58.323763 19451 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:05:58.248881 23190 consensus_meta.cc:287] T ece3db938bc649d4a40a51522ed5259c P e5256d91808b47c195bc9b4dbd7f2b87: Time spent flushing consensus metadata: real 0.635s	user 0.007s	sys 0.002s
I20260709 13:05:58.284125 20108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "172b3dd13109415a955b71ac0e9d2234" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:05:58.948333 19410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4af19371ea874c09a0a2147040835cbb" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
I20260709 13:05:58.949559 19404 raft_consensus.cc:1275] T 2b74109013a140ada21feeef92d6f563 P e5256d91808b47c195bc9b4dbd7f2b87 [term 6 FOLLOWER]: Refusing update from remote peer e61c3a8f61bb48f8a963c9480e53c168: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 13:05:58.950716 19408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22196caba61445d3bec98a0aab3c337d" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
W20260709 13:05:58.950274 19375 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:58.281713 19485 raft_consensus.cc:2468] T 46c5bfeecc314717bffe987e6844b6d0 P 0473d2b2d01f4459b1e90fd12cc7840e [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 16.
I20260709 13:05:58.951676 19402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f93ee515a9c14139bf566522ed8232f3" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 14 candidate_status { last_received { term: 12 index: 5 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:05:58.987826 19410 raft_consensus.cc:2393] T 4af19371ea874c09a0a2147040835cbb P e5256d91808b47c195bc9b4dbd7f2b87 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate e61c3a8f61bb48f8a963c9480e53c168 in current term 7: Already voted for candidate e5256d91808b47c195bc9b4dbd7f2b87 in this term.
I20260709 13:05:58.988348 19402 raft_consensus.cc:2468] T f93ee515a9c14139bf566522ed8232f3 P e5256d91808b47c195bc9b4dbd7f2b87 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 13.
I20260709 13:05:58.916218 23336 raft_consensus.cc:493] T 86a6797bdfe94fa496c050ceae4bd0d9 P e61c3a8f61bb48f8a963c9480e53c168 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:58.925045 23194 raft_consensus.cc:493] T 70797e5783b5454ab0d0eea663e791e3 P e61c3a8f61bb48f8a963c9480e53c168 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader e5256d91808b47c195bc9b4dbd7f2b87)
I20260709 13:05:58.245131 23268 raft_consensus.cc:515] T 14efcc79969f41babe5529c22d59156d P 127766fc592545a4997f7790f50f6076 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:05:58.989830 23336 raft_consensus.cc:515] T 86a6797bdfe94fa496c050ceae4bd0d9 P e61c3a8f61bb48f8a963c9480e53c168 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:58.990255 23194 raft_consensus.cc:515] T 70797e5783b5454ab0d0eea663e791e3 P e61c3a8f61bb48f8a963c9480e53c168 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:05:58.991855 23336 leader_election.cc:290] T 86a6797bdfe94fa496c050ceae4bd0d9 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
W20260709 13:05:58.924489 23405 log.cc:927] Time spent T a08760e15aac4630a629431f56024dc8 P e61c3a8f61bb48f8a963c9480e53c168: Append to log took a long time: real 0.659s	user 0.000s	sys 0.006s
I20260709 13:05:58.992885 23194 leader_election.cc:290] T 70797e5783b5454ab0d0eea663e791e3 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:05:58.944991 23238 raft_consensus.cc:493] T ef32ce6fdd0e40d382c79974f30295c6 P 0473d2b2d01f4459b1e90fd12cc7840e [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:58.993500 23268 leader_election.cc:290] T 14efcc79969f41babe5529c22d59156d P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
W20260709 13:05:58.831672 23189 consensus_meta.cc:287] T b9f0d59553ad444883fcf5b5909f9798 P e5256d91808b47c195bc9b4dbd7f2b87: Time spent flushing consensus metadata: real 0.884s	user 0.005s	sys 0.006s
I20260709 13:05:58.993875 23238 raft_consensus.cc:515] T ef32ce6fdd0e40d382c79974f30295c6 P 0473d2b2d01f4459b1e90fd12cc7840e [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:58.925871 19309 catalog_manager.cc:5697] T 7f575b143b844aa096b50997dad3516a P 0473d2b2d01f4459b1e90fd12cc7840e reported cstate change: term changed from 3 to 4, leader changed from e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3) to 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2). New cstate: current_term: 4 leader_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:58.994357 23189 raft_consensus.cc:515] T b9f0d59553ad444883fcf5b5909f9798 P e5256d91808b47c195bc9b4dbd7f2b87 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:58.971308 23216 raft_consensus.cc:493] T 7be9efa6559648dbb5a0f7684c4542d1 P 0473d2b2d01f4459b1e90fd12cc7840e [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:58.997571 23216 raft_consensus.cc:515] T 7be9efa6559648dbb5a0f7684c4542d1 P 0473d2b2d01f4459b1e90fd12cc7840e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } attrs { replace: true } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:05:58.999444 23238 leader_election.cc:290] T ef32ce6fdd0e40d382c79974f30295c6 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:05:58.999169 23189 leader_election.cc:290] T b9f0d59553ad444883fcf5b5909f9798 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 10 election: Requested vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:05:59.000985 19402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14efcc79969f41babe5529c22d59156d" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:05:58.956389 19407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28af091831594f9d8e96482078cc7625" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:05:59.003180 19407 raft_consensus.cc:2468] T 28af091831594f9d8e96482078cc7625 P e5256d91808b47c195bc9b4dbd7f2b87 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 9.
I20260709 13:05:58.928158 23214 leader_election.cc:290] T 76cb037fc9064d13b59a8969d897ce8c P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
W20260709 13:05:58.295977 23228 consensus_meta.cc:287] T 775c229504194560ba9589bc2199b089 P 0473d2b2d01f4459b1e90fd12cc7840e: Time spent flushing consensus metadata: real 0.614s	user 0.010s	sys 0.002s
W20260709 13:05:58.918756 23027 consensus_meta.cc:287] T 62c6c134d3d24a1ab144dd9ee6bc3f64 P 0473d2b2d01f4459b1e90fd12cc7840e: Time spent flushing consensus metadata: real 0.795s	user 0.010s	sys 0.001s
I20260709 13:05:58.691326 23102 raft_consensus.cc:493] T bc225c93219c45538b53a1bd3d387e4d P 0473d2b2d01f4459b1e90fd12cc7840e [term 10 FOLLOWER]: Starting pre-election (detected failure of leader e5256d91808b47c195bc9b4dbd7f2b87)
I20260709 13:05:58.429952 19484 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58286 (request call id 1889) took 1342 ms. Trace:
W20260709 13:05:58.856354 19452 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:05:58.431787 19523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.4:43121, user_credentials={real_user=slave}} blocked reactor thread for 387382us
I20260709 13:05:58.277839 23316 raft_consensus.cc:493] T 1efebf73c86e432baa55533136b6e12c P 0473d2b2d01f4459b1e90fd12cc7840e [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:58.282578 23324 raft_consensus.cc:493] T 96efeaaf1057492490e9a621f37e1a2d P 127766fc592545a4997f7790f50f6076 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:59.020033 19526 leader_election.cc:304] T 28af091831594f9d8e96482078cc7625 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
W20260709 13:05:59.078092 19526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.2:46257, user_credentials={real_user=slave}} blocked reactor thread for 58150.1us
W20260709 13:05:58.380645 22979 consensus_meta.cc:287] T 2a16f7501e2444fb86d4e2778e734e02 P e61c3a8f61bb48f8a963c9480e53c168: Time spent flushing consensus metadata: real 0.666s	user 0.012s	sys 0.000s
I20260709 13:05:58.484995 23335 consensus_queue.cc:260] T df751f992649444090e27965eb1af85d P 0473d2b2d01f4459b1e90fd12cc7840e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:59.079372 22979 raft_consensus.cc:515] T 2a16f7501e2444fb86d4e2778e734e02 P e61c3a8f61bb48f8a963c9480e53c168 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:05:58.559175 23332 raft_consensus.cc:493] T 65d8cb8d6ec64f459d5a47cefab10acf P 127766fc592545a4997f7790f50f6076 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:59.081142 22758 raft_consensus.cc:493] T 179fd671030940b4b4a4e24bcc4aba0a P e61c3a8f61bb48f8a963c9480e53c168 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:59.050042 19485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dc5b3532fe54f74876d02beffa2c230" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:05:59.081493 22979 leader_election.cc:290] T 2a16f7501e2444fb86d4e2778e734e02 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 11 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:05:59.060884 19484 rpcz_store.cc:276] 0709 13:05:57.088105 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:57.088265 (+   160us) service_pool.cc:224] Handling call
0709 13:05:57.088542 (+   277us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:05:57.757120 (+668578us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:58.429583 (+672463us) spinlock_profiling.cc:243] Waited 668 ms on lock 0x7b5400223654. stack: 00007f4a79de9343 00007f4a79de9240 00007f4a797781d4 00007f4a834b6304 00007f4a834b6299 00007f4a7ce71571 00007f4a7cf08e01 00007f4a7cf0783e 00007f4a81ecc419 00007f4a7b443bd4 00007f4a7b443b62 00007f4a7b443a91 00007f4a7b443a0c 00007f4a7b442cc2 00007f4a7b24348c 00007f4a7b2428c6
0709 13:05:58.429828 (+   245us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1536179584}
I20260709 13:05:59.081655 22758 raft_consensus.cc:515] T 179fd671030940b4b4a4e24bcc4aba0a P e61c3a8f61bb48f8a963c9480e53c168 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:59.082266 19485 raft_consensus.cc:2410] T 1dc5b3532fe54f74876d02beffa2c230 P 0473d2b2d01f4459b1e90fd12cc7840e [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate e5256d91808b47c195bc9b4dbd7f2b87 for term 10 because replica has last-logged OpId of term: 9 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 4.
I20260709 13:05:59.083150 19485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df751f992649444090e27965eb1af85d" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:05:59.083616 22758 leader_election.cc:290] T 179fd671030940b4b4a4e24bcc4aba0a P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
W20260709 13:05:58.376665 23401 log.cc:927] Time spent T fa8650e71aa14778b3d73721fc50d9fc P e5256d91808b47c195bc9b4dbd7f2b87: Append to log took a long time: real 0.185s	user 0.001s	sys 0.000s
I20260709 13:05:58.980130 19486 raft_consensus.cc:1275] T 5ec1c4ce15e04c7e8c283a62179f2a64 P 0473d2b2d01f4459b1e90fd12cc7840e [term 9 FOLLOWER]: Refusing update from remote peer e5256d91808b47c195bc9b4dbd7f2b87: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 13:05:58.953140 23104 raft_consensus.cc:3060] T ed7fdbcb96d14d418db9ca90a792588a P 0473d2b2d01f4459b1e90fd12cc7840e [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:05:58.966172 19558 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40438 (request call id 2237) took 1026 ms. Trace:
I20260709 13:05:59.073539 19479 raft_consensus.cc:2468] T 179fd671030940b4b4a4e24bcc4aba0a P 0473d2b2d01f4459b1e90fd12cc7840e [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 10.
I20260709 13:05:59.110796 19479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ec1c4ce15e04c7e8c283a62179f2a64" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:05:59.111322 19479 raft_consensus.cc:2376] T 5ec1c4ce15e04c7e8c283a62179f2a64 P 0473d2b2d01f4459b1e90fd12cc7840e [term 9 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 9. Re-sending same reply.
I20260709 13:05:59.109607 19558 rpcz_store.cc:276] 0709 13:05:57.939943 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:57.940085 (+   142us) service_pool.cc:224] Handling call
0709 13:05:58.966098 (+1026013us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:05:59.107086 19406 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52342 (request call id 2367) took 1230 ms. Trace:
I20260709 13:05:59.060375 19523 leader_election.cc:304] T 62c6c134d3d24a1ab144dd9ee6bc3f64 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 127766fc592545a4997f7790f50f6076, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
W20260709 13:05:58.947659 23402 log.cc:927] Time spent T 76cb037fc9064d13b59a8969d897ce8c P e5256d91808b47c195bc9b4dbd7f2b87: Append to log took a long time: real 0.345s	user 0.000s	sys 0.000s
W20260709 13:05:58.363226 23392 log.cc:927] Time spent T 0afb57ae58a24a01850491d69f0213dd P 127766fc592545a4997f7790f50f6076: Append to log took a long time: real 0.194s	user 0.000s	sys 0.000s
I20260709 13:05:58.631287 19405 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52328 (request call id 1862) took 1441 ms. Trace:
I20260709 13:05:59.124269 22979 raft_consensus.cc:2804] T 62c6c134d3d24a1ab144dd9ee6bc3f64 P e61c3a8f61bb48f8a963c9480e53c168 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:05:59.124876 22979 raft_consensus.cc:697] T 62c6c134d3d24a1ab144dd9ee6bc3f64 P e61c3a8f61bb48f8a963c9480e53c168 [term 10 LEADER]: Becoming Leader. State: Replica: e61c3a8f61bb48f8a963c9480e53c168, State: Running, Role: LEADER
I20260709 13:05:59.124454 19309 catalog_manager.cc:5697] T fa8650e71aa14778b3d73721fc50d9fc P 0473d2b2d01f4459b1e90fd12cc7840e reported cstate change: term changed from 4 to 9, leader changed from e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3) to 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2). New cstate: current_term: 9 leader_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:59.125731 22979 consensus_queue.cc:237] T 62c6c134d3d24a1ab144dd9ee6bc3f64 P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:05:59.126291 18300 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:05:59.122740 19405 rpcz_store.cc:276] 0709 13:05:57.189377 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:57.578205 (+388828us) service_pool.cc:224] Handling call
0709 13:05:57.578531 (+   326us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:05:57.578959 (+   428us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 13:05:57.579256 (+   297us) log.cc:844] Serialized 14 byte log entry
0709 13:05:57.689313 (+110057us) spinlock_profiling.cc:243] Waited 3.1 ms on lock 0x7b1800284620. stack: 00007f4a79de9343 00007f4a79de9240 00007f4a797781d4 00007f4a834b6304 00007f4a834b6299 00007f4a82ce3de1 00007f4a82cf05b1 00007f4a79e1b3f3 00007f4a79e1d7c1 00007f4a79e1d779 00007f4a79e1d709 00007f4a79e1d6d1 00007f4a79e1c9cd 000000000038f354 000000000038f199 00007f4a79dfe83a
0709 13:05:57.804107 (+114794us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:05:57.804759 (+   652us) log.cc:844] Serialized 52 byte log entry
0709 13:05:57.804893 (+   134us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:05:57.804926 (+    33us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:57.804989 (+    63us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:05:58.236750 (+431761us) spinlock_profiling.cc:243] Waited 7.06 ms on lock 0x7b4800002958. stack: 00007f4a79de9343 00007f4a79de9240 00007f4a797781d4 00007f4a834b6304 00007f4a834b6299 00007f4a81e31aa1 00007f4a81e28b37 00007f4a81e289ca 00007f4a81f2026f 00007f4a81f1ff37 00007f4a81f3455c 00007f4a81f34508 00007f4a81f34488 00007f4a81f34443 00007f4a81f336ec 00007f4a80e5da96
0709 13:05:58.628408 (+391658us) spinlock_profiling.cc:243] Waited 7.45 ms on lock 0x7b1800284620. stack: 00007f4a79de9343 00007f4a79de9240 00007f4a797781d4 00007f4a834b6304 00007f4a834b6299 00007f4a82ce3de1 00007f4a82cf05b1 00007f4a79e1b3f3 00007f4a79e1d7c1 00007f4a79e1d779 00007f4a79e1d709 00007f4a79e1d6d1 00007f4a79e1c9cd 000000000038f354 000000000038f199 00007f4a79dfe83a
0709 13:05:58.631030 (+  2622us) raft_consensus.cc:1685] finished
0709 13:05:58.631056 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:58.631213 (+   157us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":32067,"prepare.queue_time_us":2996,"prepare.run_cpu_time_us":34,"prepare.run_wall_time_us":35,"raft.queue_time_us":14719,"raft.run_cpu_time_us":3334,"raft.run_wall_time_us":434420,"spinlock_wait_cycles":40514944,"thread_start_us":210396,"threads_started":1,"wal-append.queue_time_us":216082}
I20260709 13:05:59.128204 18300 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:05:59.068811 23027 raft_consensus.cc:515] T 62c6c134d3d24a1ab144dd9ee6bc3f64 P 0473d2b2d01f4459b1e90fd12cc7840e [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:05:59.131304 23027 leader_election.cc:290] T 62c6c134d3d24a1ab144dd9ee6bc3f64 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 10 election: Requested vote from peers e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:05:59.091394 23194 raft_consensus.cc:493] T 217b5fae677b4971b3bbd2f357a1f7ff P e61c3a8f61bb48f8a963c9480e53c168 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:59.132296 19479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab43d85f64114d4ebf618930e43d9ed0" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:05:59.132966 19481 raft_consensus.cc:2393] T 62c6c134d3d24a1ab144dd9ee6bc3f64 P 0473d2b2d01f4459b1e90fd12cc7840e [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate e61c3a8f61bb48f8a963c9480e53c168 in current term 10: Already voted for candidate 0473d2b2d01f4459b1e90fd12cc7840e in this term.
I20260709 13:05:59.048750 23228 raft_consensus.cc:515] T 775c229504194560ba9589bc2199b089 P 0473d2b2d01f4459b1e90fd12cc7840e [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:05:59.092023 19554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4af19371ea874c09a0a2147040835cbb" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:05:59.133896 19554 raft_consensus.cc:2393] T 4af19371ea874c09a0a2147040835cbb P e61c3a8f61bb48f8a963c9480e53c168 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate e5256d91808b47c195bc9b4dbd7f2b87 in current term 7: Already voted for candidate e61c3a8f61bb48f8a963c9480e53c168 in this term.
I20260709 13:05:59.093466 23338 raft_consensus.cc:493] T 85c494af21f9457a85da47b9bc70c1fd P e61c3a8f61bb48f8a963c9480e53c168 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:59.093093 23395 raft_consensus.cc:493] T 7be9efa6559648dbb5a0f7684c4542d1 P e61c3a8f61bb48f8a963c9480e53c168 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:58.284817 23394 raft_consensus.cc:515] T 85c494af21f9457a85da47b9bc70c1fd P 127766fc592545a4997f7790f50f6076 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:05:58.695225 23337 raft_consensus.cc:493] T 48824d5acfbc485ebf8c2d944e7202de P 0473d2b2d01f4459b1e90fd12cc7840e [term 10 FOLLOWER]: Starting pre-election (detected failure of leader e61c3a8f61bb48f8a963c9480e53c168)
I20260709 13:05:59.134826 23338 raft_consensus.cc:515] T 85c494af21f9457a85da47b9bc70c1fd P e61c3a8f61bb48f8a963c9480e53c168 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:05:59.135617 23337 raft_consensus.cc:515] T 48824d5acfbc485ebf8c2d944e7202de P 0473d2b2d01f4459b1e90fd12cc7840e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:05:59.136658 23394 leader_election.cc:290] T 85c494af21f9457a85da47b9bc70c1fd P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:05:59.136905 23338 leader_election.cc:290] T 85c494af21f9457a85da47b9bc70c1fd P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:05:59.137732 23337 leader_election.cc:290] T 48824d5acfbc485ebf8c2d944e7202de P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:05:59.000432 23216 leader_election.cc:290] T 7be9efa6559648dbb5a0f7684c4542d1 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:05:59.048786 23268 raft_consensus.cc:493] T 14935b3ddf914369822e4a0547aaa355 P 127766fc592545a4997f7790f50f6076 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:59.095077 23324 raft_consensus.cc:515] T 96efeaaf1057492490e9a621f37e1a2d P 127766fc592545a4997f7790f50f6076 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:05:59.081444 23332 raft_consensus.cc:515] T 65d8cb8d6ec64f459d5a47cefab10acf P 127766fc592545a4997f7790f50f6076 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:05:59.098362 23344 raft_consensus.cc:493] T ed7fdbcb96d14d418db9ca90a792588a P e61c3a8f61bb48f8a963c9480e53c168 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:59.094470 23102 raft_consensus.cc:515] T bc225c93219c45538b53a1bd3d387e4d P 0473d2b2d01f4459b1e90fd12cc7840e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
W20260709 13:05:59.102643 19374 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.4:43121, user_credentials={real_user=slave}} blocked reactor thread for 72954.8us
W20260709 13:05:59.104378 19376 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:59.134881 23228 leader_election.cc:290] T 775c229504194560ba9589bc2199b089 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 9 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:05:59.109236 23335 raft_consensus.cc:3060] T df751f992649444090e27965eb1af85d P 0473d2b2d01f4459b1e90fd12cc7840e [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:05:59.104714 23243 raft_consensus.cc:493] T 2b74109013a140ada21feeef92d6f563 P e5256d91808b47c195bc9b4dbd7f2b87 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:59.155200 19404 raft_consensus.cc:1240] T b9f0d59553ad444883fcf5b5909f9798 P e5256d91808b47c195bc9b4dbd7f2b87 [term 10 FOLLOWER]: Rejecting Update request from peer 0473d2b2d01f4459b1e90fd12cc7840e for earlier term 9. Current term is 10. Ops: []
I20260709 13:05:59.155135 23243 raft_consensus.cc:515] T 2b74109013a140ada21feeef92d6f563 P e5256d91808b47c195bc9b4dbd7f2b87 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:59.156239 19404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7be9efa6559648dbb5a0f7684c4542d1" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:05:59.156809 19404 raft_consensus.cc:2468] T 7be9efa6559648dbb5a0f7684c4542d1 P e5256d91808b47c195bc9b4dbd7f2b87 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 10.
I20260709 13:05:59.157199 23243 leader_election.cc:290] T 2b74109013a140ada21feeef92d6f563 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:05:59.158562 19407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e1f505cb0f1427bbd698ac889d80821" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 11 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:05:59.152899 23344 raft_consensus.cc:515] T ed7fdbcb96d14d418db9ca90a792588a P e61c3a8f61bb48f8a963c9480e53c168 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:05:59.160938 23344 leader_election.cc:290] T ed7fdbcb96d14d418db9ca90a792588a P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:05:59.161926 23102 leader_election.cc:290] T bc225c93219c45538b53a1bd3d387e4d P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:05:59.148811 23415 raft_consensus.cc:493] T 1dc5b3532fe54f74876d02beffa2c230 P 0473d2b2d01f4459b1e90fd12cc7840e [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:59.162968 23218 raft_consensus.cc:493] T 1f85fc4b527a48848e5faa083b604e36 P e5256d91808b47c195bc9b4dbd7f2b87 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:59.163179 23415 raft_consensus.cc:515] T 1dc5b3532fe54f74876d02beffa2c230 P 0473d2b2d01f4459b1e90fd12cc7840e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:59.163470 23218 raft_consensus.cc:515] T 1f85fc4b527a48848e5faa083b604e36 P e5256d91808b47c195bc9b4dbd7f2b87 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:05:59.165254 23415 leader_election.cc:290] T 1dc5b3532fe54f74876d02beffa2c230 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:05:59.165354 23218 leader_election.cc:290] T 1f85fc4b527a48848e5faa083b604e36 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:05:59.165850 23218 raft_consensus.cc:493] T ece3db938bc649d4a40a51522ed5259c P e5256d91808b47c195bc9b4dbd7f2b87 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:05:59.120054 19523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.4:43121, user_credentials={real_user=slave}} blocked reactor thread for 59770.7us
I20260709 13:05:59.166225 23407 raft_consensus.cc:493] T 7f575b143b844aa096b50997dad3516a P 0473d2b2d01f4459b1e90fd12cc7840e [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:59.120795 22758 raft_consensus.cc:493] T fa8650e71aa14778b3d73721fc50d9fc P e61c3a8f61bb48f8a963c9480e53c168 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:59.121820 19486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "309c3ca0ca4b4f3ba129752ea2cb293b" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:05:59.107867 23360 raft_consensus.cc:2804] T 28af091831594f9d8e96482078cc7625 P e61c3a8f61bb48f8a963c9480e53c168 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:05:59.132067 23194 raft_consensus.cc:515] T 217b5fae677b4971b3bbd2f357a1f7ff P e61c3a8f61bb48f8a963c9480e53c168 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:59.112416 19406 rpcz_store.cc:276] 0709 13:05:57.876329 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:57.876479 (+   150us) service_pool.cc:224] Handling call
0709 13:05:57.923499 (+ 47020us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:05:57.923714 (+   215us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:05:57.923742 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:05:57.982730 (+ 58988us) log.cc:844] Serialized 26 byte log entry
0709 13:05:58.076113 (+ 93383us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:05:58.076146 (+    33us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:58.076204 (+    58us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:05:59.106803 (+1030599us) raft_consensus.cc:1685] finished
0709 13:05:59.106831 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:59.107008 (+   177us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":40533,"threads_started":1,"wal-append.queue_time_us":125169}
I20260709 13:05:59.134932 19483 raft_consensus.cc:2368] T 775c229504194560ba9589bc2199b089 P 0473d2b2d01f4459b1e90fd12cc7840e [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e5256d91808b47c195bc9b4dbd7f2b87 for earlier term 8. Current term is 9.
W20260709 13:05:59.035704 23233 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.558s	user 0.005s	sys 0.010s
W20260709 13:05:58.894896 23378 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.524s	user 0.011s	sys 0.019s
W20260709 13:05:59.024044 20078 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.2:46257, user_credentials={real_user=slave}} blocked reactor thread for 1.01804e+06us
I20260709 13:05:59.132990 19479 raft_consensus.cc:2393] T ab43d85f64114d4ebf618930e43d9ed0 P 0473d2b2d01f4459b1e90fd12cc7840e [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate e5256d91808b47c195bc9b4dbd7f2b87 in current term 10: Already voted for candidate 127766fc592545a4997f7790f50f6076 in this term.
W20260709 13:05:58.658849 23400 log.cc:927] Time spent T 46c5bfeecc314717bffe987e6844b6d0 P e61c3a8f61bb48f8a963c9480e53c168: Append to log took a long time: real 0.075s	user 0.001s	sys 0.000s
I20260709 13:05:59.075356 23399 raft_consensus.cc:493] T 48824d5acfbc485ebf8c2d944e7202de P 127766fc592545a4997f7790f50f6076 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader e61c3a8f61bb48f8a963c9480e53c168)
I20260709 13:05:58.457515 23368 raft_consensus.cc:2804] T 0e1085d23e8347fbbd5bce7542f4b1f4 P e61c3a8f61bb48f8a963c9480e53c168 [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 13:05:59.115741 19377 connection.cc:256] RPC call timeout handler was delayed by -1.0129813099999865s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19540000000000002s for a response
I20260709 13:05:59.126179 19309 catalog_manager.cc:5697] T b08304a0a02b42d7840c4e8ee9a6bd1a P 0473d2b2d01f4459b1e90fd12cc7840e reported cstate change: term changed from 5 to 9. New cstate: current_term: 9 leader_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:59.048738 23214 consensus_queue.cc:1048] T ef32ce6fdd0e40d382c79974f30295c6 P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.074s
I20260709 13:05:59.146153 19481 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58286 (request call id 1903) took 1071 ms. Trace:
I20260709 13:05:59.152866 19409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef32ce6fdd0e40d382c79974f30295c6" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 13 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:05:59.086583 23316 raft_consensus.cc:515] T 1efebf73c86e432baa55533136b6e12c P 0473d2b2d01f4459b1e90fd12cc7840e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:05:59.134948 23395 raft_consensus.cc:515] T 7be9efa6559648dbb5a0f7684c4542d1 P e61c3a8f61bb48f8a963c9480e53c168 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } attrs { replace: true } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
W20260709 13:05:59.369244 19451 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:59.166802 19523 leader_election.cc:304] T 1efebf73c86e432baa55533136b6e12c P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 127766fc592545a4997f7790f50f6076, e61c3a8f61bb48f8a963c9480e53c168; no voters: 0473d2b2d01f4459b1e90fd12cc7840e
W20260709 13:05:59.541410 19452 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:05:59.706221 19523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.4:43121, user_credentials={real_user=slave}} blocked reactor thread for 539495us
I20260709 13:05:59.196372 19407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85c494af21f9457a85da47b9bc70c1fd" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:05:59.224260 19477 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58286 (request call id 1901) took 1152 ms. Trace:
I20260709 13:05:59.199330 20106 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46436 (request call id 617) took 1376 ms. Trace:
I20260709 13:05:59.226768 19478 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58286 (request call id 1902) took 1154 ms. Trace:
I20260709 13:05:59.717993 19479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14935b3ddf914369822e4a0547aaa355" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:05:59.719314 19479 raft_consensus.cc:2393] T 14935b3ddf914369822e4a0547aaa355 P 0473d2b2d01f4459b1e90fd12cc7840e [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e5256d91808b47c195bc9b4dbd7f2b87 in current term 9: Already voted for candidate e61c3a8f61bb48f8a963c9480e53c168 in this term.
I20260709 13:05:59.269764 20108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f85fc4b527a48848e5faa083b604e36" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:05:59.722070 20108 raft_consensus.cc:2468] T 1f85fc4b527a48848e5faa083b604e36 P 127766fc592545a4997f7790f50f6076 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 7.
I20260709 13:05:59.718854 22758 raft_consensus.cc:515] T fa8650e71aa14778b3d73721fc50d9fc P e61c3a8f61bb48f8a963c9480e53c168 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:59.715404 19407 raft_consensus.cc:2468] T 85c494af21f9457a85da47b9bc70c1fd P e5256d91808b47c195bc9b4dbd7f2b87 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 127766fc592545a4997f7790f50f6076 in term 7.
W20260709 13:05:59.748087 20076 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.765s	user 0.009s	sys 0.001s
W20260709 13:05:59.821534 20076 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.838s	user 0.014s	sys 0.002s
I20260709 13:05:59.821360 19479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "179fd671030940b4b4a4e24bcc4aba0a" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
W20260709 13:05:59.820813 19377 leader_election.cc:336] T df751f992649444090e27965eb1af85d P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257): Timed out: RequestConsensusVote RPC to 127.17.223.2:46257 timed out after 1.662s (SENT)
I20260709 13:05:59.822288 19479 raft_consensus.cc:2468] T 179fd671030940b4b4a4e24bcc4aba0a P 0473d2b2d01f4459b1e90fd12cc7840e [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 10.
I20260709 13:05:59.823155 19479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1b10566f45d4a7d9029858330e02d5b" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:05:59.720189 19481 rpcz_store.cc:276] 0709 13:05:58.072216 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:58.076087 (+  3871us) service_pool.cc:224] Handling call
0709 13:05:59.143078 (+1066991us) spinlock_profiling.cc:243] Waited 1.05 s on lock 0x7b5400310454. stack: 00007f4a79de9343 00007f4a79de9240 00007f4a797781d4 00007f4a834b6304 00007f4a834b6299 00007f4a7ce71571 00007f4a7cf0c2fa 00007f4a81ecdb17 00007f4a7b4486d4 00007f4a7b448662 00007f4a7b448591 00007f4a7b44850c 00007f4a7b4477c2 00007f4a7b24348c 00007f4a7b2428c6 00007f4a7b24226f
0709 13:05:59.143249 (+   171us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2415090560}
I20260709 13:05:59.823963 19479 raft_consensus.cc:2468] T f1b10566f45d4a7d9029858330e02d5b P 0473d2b2d01f4459b1e90fd12cc7840e [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 11.
W20260709 13:05:59.740532 19376 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:59.826274 19409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dc5b3532fe54f74876d02beffa2c230" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:05:59.717765 19478 rpcz_store.cc:276] 0709 13:05:58.071997 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:58.123759 (+ 51762us) service_pool.cc:224] Handling call
0709 13:05:58.133008 (+  9249us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:05:58.260492 (+127484us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 13:05:58.260524 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:05:58.261009 (+   485us) log.cc:844] Serialized 26 byte log entry
0709 13:05:58.565432 (+304423us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:05:58.565472 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:58.565543 (+    71us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:05:59.226528 (+660985us) raft_consensus.cc:1685] finished
0709 13:05:59.226552 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:59.226712 (+   160us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":126994,"raft.queue_time_us":128619,"raft.run_cpu_time_us":101,"raft.run_wall_time_us":3227,"thread_start_us":304043,"threads_started":1,"wal-append.queue_time_us":960882}
W20260709 13:05:59.827883 19374 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.4:43121, user_credentials={real_user=slave}} blocked reactor thread for 80344.6us
I20260709 13:05:59.715523 19477 rpcz_store.cc:276] 0709 13:05:58.071770 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:58.099777 (+ 28007us) service_pool.cc:224] Handling call
0709 13:05:58.100116 (+   339us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:05:58.261145 (+161029us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:05:58.261180 (+    35us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:05:58.261557 (+   377us) log.cc:844] Serialized 26 byte log entry
0709 13:05:58.603761 (+342204us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:05:58.603802 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:58.603869 (+    67us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:05:59.223975 (+620106us) raft_consensus.cc:1685] finished
0709 13:05:59.224002 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:59.224191 (+   189us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":27277,"raft.queue_time_us":160097,"raft.run_cpu_time_us":65,"raft.run_wall_time_us":65,"thread_start_us":325930,"threads_started":1,"wal-append.queue_time_us":944784}
I20260709 13:05:59.833774 19407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc225c93219c45538b53a1bd3d387e4d" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:05:59.854616 19479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2725d2c4cb054f18b0fc8f735c15f6c2" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:05:59.855336 19479 raft_consensus.cc:2468] T 2725d2c4cb054f18b0fc8f735c15f6c2 P 0473d2b2d01f4459b1e90fd12cc7840e [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 11.
I20260709 13:05:59.824731 19481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76cb037fc9064d13b59a8969d897ce8c" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
W20260709 13:05:59.861753 19483 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58294 (request call id 2071) took 1914 ms (client timeout 1970 ms). Trace:
W20260709 13:05:59.862776 19402 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.702s	user 0.001s	sys 0.016s
W20260709 13:05:59.437103 23387 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.606s	user 0.022s	sys 0.046s
W20260709 13:05:59.864053 19402 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.704s	user 0.001s	sys 0.016s
I20260709 13:05:59.865593 19374 leader_election.cc:304] T 1f85fc4b527a48848e5faa083b604e36 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 127766fc592545a4997f7790f50f6076, e5256d91808b47c195bc9b4dbd7f2b87; no voters: 
I20260709 13:05:59.866297 19409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65d8cb8d6ec64f459d5a47cefab10acf" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:05:59.875151 19479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9f0d59553ad444883fcf5b5909f9798" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
W20260709 13:05:59.862185 19483 rpcz_store.cc:269] 0709 13:05:57.958090 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:57.960743 (+  2653us) service_pool.cc:224] Handling call
0709 13:05:59.855399 (+1894656us) spinlock_profiling.cc:243] Waited 1.17 s on lock 0x7b540029e354. stack: 00007f4a79de9343 00007f4a79de9240 00007f4a797781d4 00007f4a834b6304 00007f4a834b6299 00007f4a7ce71571 00007f4a7cf0c2fa 00007f4a81ecdb17 00007f4a7b4486d4 00007f4a7b448662 00007f4a7b448591 00007f4a7b44850c 00007f4a7b4477c2 00007f4a7b24348c 00007f4a7b2428c6 00007f4a7b24226f
0709 13:05:59.861695 (+  6296us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2686157056}
I20260709 13:05:59.225385 23332 leader_election.cc:290] T 65d8cb8d6ec64f459d5a47cefab10acf P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:05:59.622267 23140 raft_consensus.cc:493] T b9f0d59553ad444883fcf5b5909f9798 P e61c3a8f61bb48f8a963c9480e53c168 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:59.871035 19406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "775c229504194560ba9589bc2199b089" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
I20260709 13:05:59.654855 23324 leader_election.cc:290] T 96efeaaf1057492490e9a621f37e1a2d P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
W20260709 13:05:59.723073 23233 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.237s	user 0.016s	sys 0.029s
W20260709 13:05:59.866739 19482 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.766s	user 0.021s	sys 0.024s
I20260709 13:05:59.853926 23378 raft_consensus.cc:493] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P 0473d2b2d01f4459b1e90fd12cc7840e [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:59.436499 23093 raft_consensus.cc:493] T 309c3ca0ca4b4f3ba129752ea2cb293b P e61c3a8f61bb48f8a963c9480e53c168 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:59.221613 23414 raft_consensus.cc:493] T 76cb037fc9064d13b59a8969d897ce8c P 0473d2b2d01f4459b1e90fd12cc7840e [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:59.716250 20106 rpcz_store.cc:276] 0709 13:05:57.823108 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:57.824880 (+  1772us) service_pool.cc:224] Handling call
0709 13:05:57.825272 (+   392us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:05:57.869159 (+ 43887us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:05:57.869438 (+   279us) log.cc:844] Serialized 14 byte log entry
0709 13:05:58.270321 (+400883us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:05:58.270804 (+   483us) log.cc:844] Serialized 26 byte log entry
0709 13:05:58.270939 (+   135us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:05:58.270972 (+    33us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:58.692222 (+421250us) spinlock_profiling.cc:243] Waited 43.5 ms on lock 0x7b54004f74d4. stack: 00007f4a79de9343 00007f4a79de9240 00007f4a797781d4 00007f4a834b6304 00007f4a834b6299 00007f4a7ce71571 00007f4a7cf08e01 00007f4a7cf0783e 00007f4a81ecc419 00007f4a7b443bd4 00007f4a7b443b62 00007f4a7b443a91 00007f4a7b443a0c 00007f4a7b442cc2 00007f4a7b24348c 00007f4a7b2428c6
0709 13:05:58.692271 (+    49us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:05:59.199065 (+506794us) raft_consensus.cc:1685] finished
0709 13:05:59.199169 (+   104us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:59.199279 (+   110us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":640,"prepare.run_cpu_time_us":29,"prepare.run_wall_time_us":31,"raft.queue_time_us":237560,"raft.run_cpu_time_us":317,"raft.run_wall_time_us":33754,"spinlock_wait_cycles":100100480,"thread_start_us":400426,"threads_started":2,"wal-append.queue_time_us":217573}
I20260709 13:05:59.446360 23413 raft_consensus.cc:493] T fa731b585f684a7fb2d106c50f143b83 P e61c3a8f61bb48f8a963c9480e53c168 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader e5256d91808b47c195bc9b4dbd7f2b87)
I20260709 13:05:59.391633 23338 raft_consensus.cc:493] T 65d8cb8d6ec64f459d5a47cefab10acf P e61c3a8f61bb48f8a963c9480e53c168 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:59.222431 23336 raft_consensus.cc:493] T 0cdf56e38bbc453d9438d359e5a69955 P e61c3a8f61bb48f8a963c9480e53c168 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader e5256d91808b47c195bc9b4dbd7f2b87)
I20260709 13:05:59.717231 23403 raft_consensus.cc:493] T ab43d85f64114d4ebf618930e43d9ed0 P 0473d2b2d01f4459b1e90fd12cc7840e [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:59.454137 22974 raft_consensus.cc:493] T 0afb57ae58a24a01850491d69f0213dd P e61c3a8f61bb48f8a963c9480e53c168 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 0473d2b2d01f4459b1e90fd12cc7840e)
I20260709 13:05:59.147523 23268 raft_consensus.cc:515] T 14935b3ddf914369822e4a0547aaa355 P 127766fc592545a4997f7790f50f6076 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } attrs { replace: true } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:05:59.166857 23407 raft_consensus.cc:515] T 7f575b143b844aa096b50997dad3516a P 0473d2b2d01f4459b1e90fd12cc7840e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:59.884544 19483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef32ce6fdd0e40d382c79974f30295c6" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 13 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:05:59.909373 19483 raft_consensus.cc:2468] T ef32ce6fdd0e40d382c79974f30295c6 P 0473d2b2d01f4459b1e90fd12cc7840e [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 12.
I20260709 13:05:59.910210 19483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "172b3dd13109415a955b71ac0e9d2234" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:05:59.910732 19483 raft_consensus.cc:2468] T 172b3dd13109415a955b71ac0e9d2234 P 0473d2b2d01f4459b1e90fd12cc7840e [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 9.
I20260709 13:05:59.885156 19479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1efebf73c86e432baa55533136b6e12c" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:05:59.911674 19479 raft_consensus.cc:2393] T 1efebf73c86e432baa55533136b6e12c P 0473d2b2d01f4459b1e90fd12cc7840e [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e61c3a8f61bb48f8a963c9480e53c168 in current term 9: Already voted for candidate 0473d2b2d01f4459b1e90fd12cc7840e in this term.
I20260709 13:05:59.790197 23368 raft_consensus.cc:493] T 0e1085d23e8347fbbd5bce7542f4b1f4 P e61c3a8f61bb48f8a963c9480e53c168 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:59.869647 19486 raft_consensus.cc:2468] T 309c3ca0ca4b4f3ba129752ea2cb293b P 0473d2b2d01f4459b1e90fd12cc7840e [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 8.
I20260709 13:05:59.198755 23344 raft_consensus.cc:493] T 833a2f0775ed407a94b8924ce50adb63 P e61c3a8f61bb48f8a963c9480e53c168 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader e5256d91808b47c195bc9b4dbd7f2b87)
I20260709 13:05:59.166657 23415 raft_consensus.cc:493] T 14efcc79969f41babe5529c22d59156d P 0473d2b2d01f4459b1e90fd12cc7840e [term 10 FOLLOWER]: Starting pre-election (detected failure of leader e5256d91808b47c195bc9b4dbd7f2b87)
I20260709 13:05:59.269174 23340 raft_consensus.cc:493] T 7f575b143b844aa096b50997dad3516a P e61c3a8f61bb48f8a963c9480e53c168 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader e5256d91808b47c195bc9b4dbd7f2b87)
I20260709 13:05:59.887137 19309 catalog_manager.cc:5697] T 14efcc79969f41babe5529c22d59156d P 0473d2b2d01f4459b1e90fd12cc7840e reported cstate change: term changed from 4 to 9, leader changed from e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1) to 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2). New cstate: current_term: 9 leader_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:59.737500 23360 raft_consensus.cc:493] T 28af091831594f9d8e96482078cc7625 P e61c3a8f61bb48f8a963c9480e53c168 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:05:59.889089 19482 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.788s	user 0.022s	sys 0.024s
I20260709 13:05:59.715575 23343 raft_consensus.cc:2804] T 1efebf73c86e432baa55533136b6e12c P e61c3a8f61bb48f8a963c9480e53c168 [term 9 FOLLOWER]: Leader election won for term 9
W20260709 13:05:59.882899 19403 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.708s	user 0.003s	sys 0.015s
W20260709 13:05:59.874514 23387 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.043s	user 0.031s	sys 0.060s
I20260709 13:05:59.890381 19478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df751f992649444090e27965eb1af85d" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
W20260709 13:05:59.933213 19403 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.779s	user 0.003s	sys 0.016s
W20260709 13:05:59.891113 19484 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.725s	user 0.005s	sys 0.016s
W20260709 13:05:59.933748 19484 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.768s	user 0.005s	sys 0.016s
W20260709 13:05:59.892120 19377 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.2:46257, user_credentials={real_user=slave}} blocked reactor thread for 170995us
I20260709 13:05:59.221817 23102 consensus_queue.cc:1059] T b9f0d59553ad444883fcf5b5909f9798 P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.662s
W20260709 13:05:59.894106 19375 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.794s	user 0.014s	sys 0.006s
W20260709 13:05:59.939366 19375 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.839s	user 0.015s	sys 0.006s
W20260709 13:05:59.939779 19375 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.3:36891, user_credentials={real_user=slave}} blocked reactor thread for 839360us
I20260709 13:05:59.940783 19375 leader_election.cc:304] T 2725d2c4cb054f18b0fc8f735c15f6c2 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:05:59.898859 22758 leader_election.cc:290] T fa8650e71aa14778b3d73721fc50d9fc P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:05:59.900615 19558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e5873a19244c5ebbcd38e126796ee7" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:05:59.901355 19552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a08760e15aac4630a629431f56024dc8" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:05:59.942797 22758 raft_consensus.cc:493] T ab43d85f64114d4ebf618930e43d9ed0 P e61c3a8f61bb48f8a963c9480e53c168 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:59.166266 23218 raft_consensus.cc:515] T ece3db938bc649d4a40a51522ed5259c P e5256d91808b47c195bc9b4dbd7f2b87 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:05:59.222299 23412 consensus_queue.cc:1059] T a08760e15aac4630a629431f56024dc8 P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.668s
W20260709 13:05:59.911078 19450 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:59.914227 19555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edd7d470b5014c9489be7f41f64355c9" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 12 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:05:59.828714 23399 raft_consensus.cc:515] T 48824d5acfbc485ebf8c2d944e7202de P 127766fc592545a4997f7790f50f6076 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:05:59.891471 23324 raft_consensus.cc:493] T ab43d85f64114d4ebf618930e43d9ed0 P 127766fc592545a4997f7790f50f6076 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:59.919178 19554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "309c3ca0ca4b4f3ba129752ea2cb293b" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:05:59.919581 19560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21e14947d70440f19044d8f75c31e1f9" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:05:59.921393 19477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dc5b3532fe54f74876d02beffa2c230" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:05:59.889453 23140 raft_consensus.cc:515] T b9f0d59553ad444883fcf5b5909f9798 P e61c3a8f61bb48f8a963c9480e53c168 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:59.972343 19477 raft_consensus.cc:2410] T 1dc5b3532fe54f74876d02beffa2c230 P 0473d2b2d01f4459b1e90fd12cc7840e [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate e5256d91808b47c195bc9b4dbd7f2b87 for term 10 because replica has last-logged OpId of term: 9 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 4.
I20260709 13:05:59.972632 19478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86a6797bdfe94fa496c050ceae4bd0d9" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 11 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:05:59.921566 19483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff75a1d4cb1f493db8f71ddc136ba9ab" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
W20260709 13:05:59.922221 19405 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.512s	user 0.003s	sys 0.020s
I20260709 13:05:59.918509 19556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e1f505cb0f1427bbd698ac889d80821" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 11 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
W20260709 13:05:59.973315 19405 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.563s	user 0.003s	sys 0.020s
I20260709 13:05:59.914196 19479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b08304a0a02b42d7840c4e8ee9a6bd1a" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
W20260709 13:05:59.973656 19377 leader_election.cc:336] T 22196caba61445d3bec98a0aab3c337d P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257): Timed out: RequestConsensusVote RPC to 127.17.223.2:46257 timed out after 1.672s (SENT)
I20260709 13:05:59.923431 19553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e381f1d6b8184797ad142de49be225a8" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
W20260709 13:05:59.932621 19408 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.771s	user 0.019s	sys 0.020s
I20260709 13:05:59.943248 22758 raft_consensus.cc:515] T ab43d85f64114d4ebf618930e43d9ed0 P e61c3a8f61bb48f8a963c9480e53c168 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } attrs { replace: true } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
W20260709 13:05:59.921922 23351 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.230s	user 0.007s	sys 0.014s
I20260709 13:05:59.932446 23360 raft_consensus.cc:3060] T 28af091831594f9d8e96482078cc7625 P e61c3a8f61bb48f8a963c9480e53c168 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:05:59.947960 19559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62c6c134d3d24a1ab144dd9ee6bc3f64" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:05:59.947865 23344 raft_consensus.cc:515] T 833a2f0775ed407a94b8924ce50adb63 P e61c3a8f61bb48f8a963c9480e53c168 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:05:59.948627 23091 raft_consensus.cc:2804] T 2725d2c4cb054f18b0fc8f735c15f6c2 P e5256d91808b47c195bc9b4dbd7f2b87 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:05:59.949687 23194 leader_election.cc:290] T 217b5fae677b4971b3bbd2f357a1f7ff P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:05:59.951997 23268 leader_election.cc:290] T 14935b3ddf914369822e4a0547aaa355 P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:05:59.912870 22974 raft_consensus.cc:515] T 0afb57ae58a24a01850491d69f0213dd P e61c3a8f61bb48f8a963c9480e53c168 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:05:59.975001 19553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef32ce6fdd0e40d382c79974f30295c6" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 13 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:05:59.908622 23378 raft_consensus.cc:515] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P 0473d2b2d01f4459b1e90fd12cc7840e [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:05:59.974965 19556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48824d5acfbc485ebf8c2d944e7202de" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
W20260709 13:05:59.975595 19408 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.814s	user 0.019s	sys 0.020s
I20260709 13:05:59.975781 19558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dc5b3532fe54f74876d02beffa2c230" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:05:59.995455 19558 raft_consensus.cc:2468] T 1dc5b3532fe54f74876d02beffa2c230 P e61c3a8f61bb48f8a963c9480e53c168 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 10.
I20260709 13:05:59.924851 23122 raft_consensus.cc:2804] T 1f85fc4b527a48848e5faa083b604e36 P e5256d91808b47c195bc9b4dbd7f2b87 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:05:59.978760 19483 raft_consensus.cc:1240] T ef32ce6fdd0e40d382c79974f30295c6 P 0473d2b2d01f4459b1e90fd12cc7840e [term 12 FOLLOWER]: Rejecting Update request from peer e5256d91808b47c195bc9b4dbd7f2b87 for earlier term 11. Current term is 12. Ops: [11.7-11.7]
I20260709 13:05:59.917832 19486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9f0d59553ad444883fcf5b5909f9798" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:05:59.997738 19483 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58294 (request call id 2085) took 1382 ms. Trace:
I20260709 13:05:59.932763 23415 raft_consensus.cc:515] T 14efcc79969f41babe5529c22d59156d P 0473d2b2d01f4459b1e90fd12cc7840e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:05:59.981719 19479 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58294 (request call id 2086) took 1269 ms. Trace:
I20260709 13:05:59.982214 19477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e381f1d6b8184797ad142de49be225a8" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 9 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:05:59.983279 19555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc225c93219c45538b53a1bd3d387e4d" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:05:59.974071 19377 leader_election.cc:304] T 22196caba61445d3bec98a0aab3c337d P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:05:59.907862 23093 raft_consensus.cc:515] T 309c3ca0ca4b4f3ba129752ea2cb293b P e61c3a8f61bb48f8a963c9480e53c168 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } attrs { replace: true } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:05:59.985692 19478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed7fdbcb96d14d418db9ca90a792588a" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:05:59.987419 19309 catalog_manager.cc:5697] T 5ec1c4ce15e04c7e8c283a62179f2a64 P 0473d2b2d01f4459b1e90fd12cc7840e reported cstate change: term changed from 3 to 6, leader changed from 127766fc592545a4997f7790f50f6076 (127.17.223.4) to 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2). New cstate: current_term: 6 leader_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 13:05:59.977377 23351 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.305s	user 0.008s	sys 0.014s
I20260709 13:05:59.922490 23368 raft_consensus.cc:3060] T 0e1085d23e8347fbbd5bce7542f4b1f4 P e61c3a8f61bb48f8a963c9480e53c168 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:05:59.991788 19551 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40438 (request call id 2229) took 2293 ms. Trace:
I20260709 13:05:59.993537 23194 raft_consensus.cc:493] T ece3db938bc649d4a40a51522ed5259c P e61c3a8f61bb48f8a963c9480e53c168 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:59.959466 23343 raft_consensus.cc:697] T 1efebf73c86e432baa55533136b6e12c P e61c3a8f61bb48f8a963c9480e53c168 [term 9 LEADER]: Becoming Leader. State: Replica: e61c3a8f61bb48f8a963c9480e53c168, State: Running, Role: LEADER
W20260709 13:05:59.926272 19526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.2:46257, user_credentials={real_user=slave}} blocked reactor thread for 327722us
I20260709 13:06:00.013881 19526 leader_election.cc:304] T 179fd671030940b4b4a4e24bcc4aba0a P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:05:59.989856 23091 raft_consensus.cc:493] T 2725d2c4cb054f18b0fc8f735c15f6c2 P e5256d91808b47c195bc9b4dbd7f2b87 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:59.920409 23336 raft_consensus.cc:515] T 0cdf56e38bbc453d9438d359e5a69955 P e61c3a8f61bb48f8a963c9480e53c168 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:59.993784 22758 leader_election.cc:290] T ab43d85f64114d4ebf618930e43d9ed0 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:05:59.915498 23414 raft_consensus.cc:515] T 76cb037fc9064d13b59a8969d897ce8c P 0473d2b2d01f4459b1e90fd12cc7840e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:59.932933 23340 raft_consensus.cc:515] T 7f575b143b844aa096b50997dad3516a P e61c3a8f61bb48f8a963c9480e53c168 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:05:59.979583 19552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7be9efa6559648dbb5a0f7684c4542d1" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:05:59.980654 23324 raft_consensus.cc:515] T ab43d85f64114d4ebf618930e43d9ed0 P 127766fc592545a4997f7790f50f6076 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } attrs { replace: true } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:05:59.940073 23413 raft_consensus.cc:515] T fa731b585f684a7fb2d106c50f143b83 P e61c3a8f61bb48f8a963c9480e53c168 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:05:59.998080 19483 rpcz_store.cc:276] 0709 13:05:58.615225 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:59.978249 (+1363024us) service_pool.cc:224] Handling call
0709 13:05:59.978503 (+   254us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:05:59.997459 (+ 18956us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:59.997689 (+   230us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:00.024353 19483 raft_consensus.cc:1275] T 2b74109013a140ada21feeef92d6f563 P 0473d2b2d01f4459b1e90fd12cc7840e [term 6 FOLLOWER]: Refusing update from remote peer e61c3a8f61bb48f8a963c9480e53c168: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 13:05:59.997287 23122 raft_consensus.cc:493] T 1f85fc4b527a48848e5faa083b604e36 P e5256d91808b47c195bc9b4dbd7f2b87 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:00.000952 19479 rpcz_store.cc:276] 0709 13:05:58.712892 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:59.977784 (+1264892us) service_pool.cc:224] Handling call
0709 13:05:59.978055 (+   271us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:59.981384 (+  3329us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:05:59.981413 (+    29us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:05:59.981453 (+    40us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:05:59.981486 (+    33us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:59.981541 (+    55us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:59.981651 (+   110us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:05:59.912981 23338 raft_consensus.cc:515] T 65d8cb8d6ec64f459d5a47cefab10acf P e61c3a8f61bb48f8a963c9480e53c168 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:05:59.915361 23403 raft_consensus.cc:515] T ab43d85f64114d4ebf618930e43d9ed0 P 0473d2b2d01f4459b1e90fd12cc7840e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } attrs { replace: true } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:00.034847 19479 raft_consensus.cc:1275] T 217b5fae677b4971b3bbd2f357a1f7ff P 0473d2b2d01f4459b1e90fd12cc7840e [term 7 FOLLOWER]: Refusing update from remote peer e5256d91808b47c195bc9b4dbd7f2b87: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
W20260709 13:06:00.004622 22979 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.672s	user 0.018s	sys 0.055s
I20260709 13:06:00.016340 19554 raft_consensus.cc:2468] T 309c3ca0ca4b4f3ba129752ea2cb293b P e61c3a8f61bb48f8a963c9480e53c168 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 8.
I20260709 13:06:00.015239 19526 leader_election.cc:304] T f1b10566f45d4a7d9029858330e02d5b P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168; no voters: e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:06:00.019824 19477 raft_consensus.cc:1275] T 46c5bfeecc314717bffe987e6844b6d0 P 0473d2b2d01f4459b1e90fd12cc7840e [term 16 FOLLOWER]: Refusing update from remote peer e5256d91808b47c195bc9b4dbd7f2b87: Log matching property violated. Preceding OpId in replica: term: 15 index: 6. Preceding OpId from leader: term: 16 index: 7. (index mismatch)
I20260709 13:06:00.020784 19552 raft_consensus.cc:2468] T 7be9efa6559648dbb5a0f7684c4542d1 P e61c3a8f61bb48f8a963c9480e53c168 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 10.
W20260709 13:06:00.033644 19377 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.2:46257, user_credentials={real_user=slave}} blocked reactor thread for 99058.1us
I20260709 13:06:00.041811 19479 raft_consensus.cc:1275] T 40e1e16737a842ee936002830f36882e P 0473d2b2d01f4459b1e90fd12cc7840e [term 14 FOLLOWER]: Refusing update from remote peer e61c3a8f61bb48f8a963c9480e53c168: Log matching property violated. Preceding OpId in replica: term: 12 index: 6. Preceding OpId from leader: term: 14 index: 7. (index mismatch)
W20260709 13:06:00.042062 19377 leader_election.cc:336] T d1e5873a19244c5ebbcd38e126796ee7 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257): Timed out: RequestConsensusVote RPC to 127.17.223.2:46257 timed out after 1.679s (SENT)
I20260709 13:06:00.017575 23091 raft_consensus.cc:3060] T 2725d2c4cb054f18b0fc8f735c15f6c2 P e5256d91808b47c195bc9b4dbd7f2b87 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:06:00.007987 19551 rpcz_store.cc:276] 0709 13:05:57.695459 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:57.701521 (+  6062us) service_pool.cc:224] Handling call
0709 13:05:57.736602 (+ 35081us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:05:57.737104 (+   502us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:05:57.963074 (+225970us) log.cc:844] Serialized 14 byte log entry
0709 13:05:58.453868 (+490794us) log.cc:844] Serialized 14 byte log entry
0709 13:05:58.454017 (+   149us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:05:58.454461 (+   444us) log.cc:844] Serialized 26 byte log entry
0709 13:05:58.924892 (+470431us) spinlock_profiling.cc:243] Waited 6.49 ms on lock 0x7b1800104260. stack: 00007f4a79de9343 00007f4a79de9240 00007f4a797781d4 00007f4a834b6304 00007f4a834b6299 00007f4a82ce3de1 00007f4a82cf05b1 00007f4a79e1b3f3 00007f4a79e1d7c1 00007f4a79e1d779 00007f4a79e1d709 00007f4a79e1d6d1 00007f4a79e1c9cd 000000000038f354 000000000038f199 00007f4a79dfe83a
0709 13:05:58.955653 (+ 30761us) spinlock_profiling.cc:243] Waited 19.2 ms on lock 0x7b1800104260. stack: 00007f4a79de9343 00007f4a79de9240 00007f4a797781d4 00007f4a834b6304 00007f4a834b6299 00007f4a82ce3de1 00007f4a82cf05b1 00007f4a79d95c0a 00007f4a834d5219 00007f4a7cabed70 00007f4a7cab2293 00007f4a7caa7cea 00007f4a7caa80d1 00007f4a7cec3a0f 00007f4a7ce7f621 00007f4a7cf0892b
0709 13:05:58.955899 (+   246us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:05:58.955940 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:58.956038 (+    98us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:05:59.005006 (+ 48968us) spinlock_profiling.cc:243] Waited 7.06 ms on lock 0x7b1800104260. stack: 00007f4a79de9343 00007f4a79de9240 00007f4a797781d4 00007f4a834b6304 00007f4a834b6299 00007f4a82ce3de1 00007f4a82cf05b1 00007f4a79e1b3f3 00007f4a79e1d7c1 00007f4a79e1d779 00007f4a79e1d709 00007f4a79e1d6d1 00007f4a79e1c9cd 000000000038f354 000000000038f199 00007f4a79dfe83a
0709 13:05:59.988600 (+983594us) raft_consensus.cc:1685] finished
0709 13:05:59.988629 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:59.988802 (+   173us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":380995,"prepare.queue_time_us":132480,"prepare.run_cpu_time_us":72,"prepare.run_wall_time_us":74,"raft.queue_time_us":593851,"raft.run_cpu_time_us":281,"raft.run_wall_time_us":293,"spinlock_wait_cycles":75353856,"thread_start_us":251304,"threads_started":2,"wal-append.queue_time_us":261053}
I20260709 13:06:00.036964 19478 raft_consensus.cc:1275] T 7f575b143b844aa096b50997dad3516a P 0473d2b2d01f4459b1e90fd12cc7840e [term 6 FOLLOWER]: Refusing update from remote peer e5256d91808b47c195bc9b4dbd7f2b87: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 13:06:00.017297 23412 raft_consensus.cc:2804] T 179fd671030940b4b4a4e24bcc4aba0a P e61c3a8f61bb48f8a963c9480e53c168 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:06:00.019290 23351 raft_consensus.cc:493] T 1f85fc4b527a48848e5faa083b604e36 P 0473d2b2d01f4459b1e90fd12cc7840e [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:00.041026 22758 raft_consensus.cc:2804] T f1b10566f45d4a7d9029858330e02d5b P e61c3a8f61bb48f8a963c9480e53c168 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:06:00.042497 19377 leader_election.cc:304] T d1e5873a19244c5ebbcd38e126796ee7 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:06:00.034646 19481 raft_consensus.cc:2468] T 76cb037fc9064d13b59a8969d897ce8c P 0473d2b2d01f4459b1e90fd12cc7840e [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 9.
I20260709 13:06:00.030094 23316 leader_election.cc:290] T 1efebf73c86e432baa55533136b6e12c P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:06:00.015336 23194 raft_consensus.cc:515] T ece3db938bc649d4a40a51522ed5259c P e61c3a8f61bb48f8a963c9480e53c168 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:00.031330 23122 raft_consensus.cc:3060] T 1f85fc4b527a48848e5faa083b604e36 P e5256d91808b47c195bc9b4dbd7f2b87 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:06:00.049183 19309 catalog_manager.cc:5697] T 46c5bfeecc314717bffe987e6844b6d0 P 0473d2b2d01f4459b1e90fd12cc7840e reported cstate change: term changed from 9 to 13, leader changed from e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3) to 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2). New cstate: current_term: 13 leader_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:00.053642 22758 raft_consensus.cc:493] T f1b10566f45d4a7d9029858330e02d5b P e61c3a8f61bb48f8a963c9480e53c168 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:00.057448 22758 raft_consensus.cc:3060] T f1b10566f45d4a7d9029858330e02d5b P e61c3a8f61bb48f8a963c9480e53c168 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:06:00.055696 19477 raft_consensus.cc:1240] T ff9b0eddd810459b82d91c60777c10eb P 0473d2b2d01f4459b1e90fd12cc7840e [term 9 FOLLOWER]: Rejecting Update request from peer e5256d91808b47c195bc9b4dbd7f2b87 for earlier term 8. Current term is 9. Ops: []
I20260709 13:06:00.060134 19479 raft_consensus.cc:1240] T 21e14947d70440f19044d8f75c31e1f9 P 0473d2b2d01f4459b1e90fd12cc7840e [term 10 FOLLOWER]: Rejecting Update request from peer e61c3a8f61bb48f8a963c9480e53c168 for earlier term 9. Current term is 10. Ops: []
W20260709 13:06:00.042990 22979 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.713s	user 0.019s	sys 0.055s
I20260709 13:06:00.048441 23412 raft_consensus.cc:493] T 179fd671030940b4b4a4e24bcc4aba0a P e61c3a8f61bb48f8a963c9480e53c168 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:00.067907 19309 catalog_manager.cc:5697] T 48824d5acfbc485ebf8c2d944e7202de P 0473d2b2d01f4459b1e90fd12cc7840e reported cstate change: term changed from 7 to 8, leader changed from e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3) to 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2). New cstate: current_term: 8 leader_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:00.090201 19479 raft_consensus.cc:1275] T 1dc5b3532fe54f74876d02beffa2c230 P 0473d2b2d01f4459b1e90fd12cc7840e [term 10 FOLLOWER]: Refusing update from remote peer e5256d91808b47c195bc9b4dbd7f2b87: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 10 index: 5. (term mismatch)
I20260709 13:06:00.090900 19479 pending_rounds.cc:85] T 1dc5b3532fe54f74876d02beffa2c230 P 0473d2b2d01f4459b1e90fd12cc7840e: Aborting all ops after (but not including) 4
I20260709 13:06:00.091251 19479 pending_rounds.cc:107] T 1dc5b3532fe54f74876d02beffa2c230 P 0473d2b2d01f4459b1e90fd12cc7840e: Aborting uncommitted NO_OP operation due to leader change: 9.5
I20260709 13:06:00.091612 19479 raft_consensus.cc:2889] T 1dc5b3532fe54f74876d02beffa2c230 P 0473d2b2d01f4459b1e90fd12cc7840e [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:06:00.058975 23316 raft_consensus.cc:493] T 2b74109013a140ada21feeef92d6f563 P 0473d2b2d01f4459b1e90fd12cc7840e [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:06:00.103935 23427 log.cc:927] Time spent T ef32ce6fdd0e40d382c79974f30295c6 P e5256d91808b47c195bc9b4dbd7f2b87: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
I20260709 13:06:00.105217 19403 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52328 (request call id 1874) took 1157 ms. Trace:
W20260709 13:06:00.105495 23421 log.cc:927] Time spent T ff75a1d4cb1f493db8f71ddc136ba9ab P 0473d2b2d01f4459b1e90fd12cc7840e: Append to log took a long time: real 0.089s	user 0.000s	sys 0.000s
I20260709 13:06:00.105620 19403 rpcz_store.cc:276] 0709 13:05:58.948193 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:58.948399 (+   206us) service_pool.cc:224] Handling call
0709 13:05:58.948690 (+   291us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:05:59.107159 (+158469us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:05:59.107188 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:05:59.107593 (+   405us) log.cc:844] Serialized 26 byte log entry
0709 13:05:59.933629 (+826036us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:05:59.933664 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:59.933727 (+    63us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:00.104953 (+171226us) raft_consensus.cc:1685] finished
0709 13:06:00.104979 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:00.105153 (+   174us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":158108,"raft.queue_time_us":159031,"raft.run_cpu_time_us":148,"raft.run_wall_time_us":9256,"thread_start_us":779459,"threads_started":1,"wal-append.queue_time_us":893910}
W20260709 13:06:00.107121 23416 log.cc:927] Time spent T 172b3dd13109415a955b71ac0e9d2234 P 127766fc592545a4997f7790f50f6076: Append to log took a long time: real 0.129s	user 0.000s	sys 0.000s
I20260709 13:06:00.107561 22974 leader_election.cc:290] T 0afb57ae58a24a01850491d69f0213dd P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
W20260709 13:06:00.111299 19306 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:44698 (request call id 231) took 22876 ms (client timeout 15000 ms). Trace:
I20260709 13:06:00.114707 23344 leader_election.cc:290] T 833a2f0775ed407a94b8924ce50adb63 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
W20260709 13:06:00.115479 23419 log.cc:927] Time spent T 76cb037fc9064d13b59a8969d897ce8c P e61c3a8f61bb48f8a963c9480e53c168: Append to log took a long time: real 0.125s	user 0.001s	sys 0.000s
I20260709 13:06:00.115808 23194 leader_election.cc:290] T ece3db938bc649d4a40a51522ed5259c P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:06:00.117229 23316 raft_consensus.cc:515] T 2b74109013a140ada21feeef92d6f563 P 0473d2b2d01f4459b1e90fd12cc7840e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:00.117616 23403 leader_election.cc:290] T ab43d85f64114d4ebf618930e43d9ed0 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:06:00.119398 23316 leader_election.cc:290] T 2b74109013a140ada21feeef92d6f563 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:06:00.119508 23414 leader_election.cc:290] T 76cb037fc9064d13b59a8969d897ce8c P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
W20260709 13:06:00.120643 23104 consensus_meta.cc:287] T ed7fdbcb96d14d418db9ca90a792588a P 0473d2b2d01f4459b1e90fd12cc7840e: Time spent flushing consensus metadata: real 1.007s	user 0.007s	sys 0.004s
I20260709 13:06:00.121207 19480 raft_consensus.cc:2468] T ed7fdbcb96d14d418db9ca90a792588a P 0473d2b2d01f4459b1e90fd12cc7840e [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 127766fc592545a4997f7790f50f6076 in term 7.
W20260709 13:06:00.122262 23335 consensus_meta.cc:287] T df751f992649444090e27965eb1af85d P 0473d2b2d01f4459b1e90fd12cc7840e: Time spent flushing consensus metadata: real 0.859s	user 0.008s	sys 0.001s
W20260709 13:06:00.122483 19480 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39478 (request call id 508) took 3066 ms (client timeout 1866 ms). Trace:
W20260709 13:06:00.123117 23418 log.cc:927] Time spent T 65d8cb8d6ec64f459d5a47cefab10acf P e5256d91808b47c195bc9b4dbd7f2b87: Append to log took a long time: real 0.103s	user 0.000s	sys 0.001s
I20260709 13:06:00.123271 23083 raft_consensus.cc:493] T ed7fdbcb96d14d418db9ca90a792588a P 0473d2b2d01f4459b1e90fd12cc7840e [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:00.125690 19485 raft_consensus.cc:2410] T df751f992649444090e27965eb1af85d P 0473d2b2d01f4459b1e90fd12cc7840e [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e5256d91808b47c195bc9b4dbd7f2b87 for term 12 because replica has last-logged OpId of term: 11 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 6.
W20260709 13:06:00.122897 19480 rpcz_store.cc:269] 0709 13:05:57.055827 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:57.061282 (+  5455us) service_pool.cc:224] Handling call
0709 13:06:00.122269 (+3060987us) spinlock_profiling.cc:243] Waited 3.03 s on lock 0x7b54000a9954. stack: 00007f4a79de9343 00007f4a79de9240 00007f4a797781d4 00007f4a834b6304 00007f4a834b6299 00007f4a7ce71571 00007f4a7cf0c2fa 00007f4a81ecdb17 00007f4a7b4486d4 00007f4a7b448662 00007f4a7b448591 00007f4a7b44850c 00007f4a7b4477c2 00007f4a7b24348c 00007f4a7b2428c6 00007f4a7b24226f
0709 13:06:00.122373 (+   104us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":6975774080}
I20260709 13:06:00.070887 23243 raft_consensus.cc:2749] T 22196caba61445d3bec98a0aab3c337d P e5256d91808b47c195bc9b4dbd7f2b87 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:06:00.056808 23351 raft_consensus.cc:515] T 1f85fc4b527a48848e5faa083b604e36 P 0473d2b2d01f4459b1e90fd12cc7840e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:00.123023 23395 leader_election.cc:290] T 7be9efa6559648dbb5a0f7684c4542d1 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
W20260709 13:06:00.142747 20078 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.2:46257, user_credentials={real_user=slave}} blocked reactor thread for 278780us
W20260709 13:06:00.143496 20078 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:00.143851 20078 connection.cc:256] RPC call timeout handler was delayed by -1.3202346440000383s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1635s for a response
W20260709 13:06:00.144258 20078 connection.cc:256] RPC call timeout handler was delayed by -1.1123346440000432s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18660000000000002s for a response
I20260709 13:06:00.144364 23140 leader_election.cc:290] T b9f0d59553ad444883fcf5b5909f9798 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:06:00.144001 19309 catalog_manager.cc:5697] T 1a61655d99124a29b486ba4a5b37faea P 0473d2b2d01f4459b1e90fd12cc7840e reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:00.145439 20106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "309c3ca0ca4b4f3ba129752ea2cb293b" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:06:00.146188 20106 raft_consensus.cc:2393] T 309c3ca0ca4b4f3ba129752ea2cb293b P 127766fc592545a4997f7790f50f6076 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0473d2b2d01f4459b1e90fd12cc7840e in current term 9: Already voted for candidate 127766fc592545a4997f7790f50f6076 in this term.
I20260709 13:06:00.145623 19309 catalog_manager.cc:5697] T edd7d470b5014c9489be7f41f64355c9 P 0473d2b2d01f4459b1e90fd12cc7840e reported cstate change: term changed from 7 to 8, leader changed from e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3) to 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2). New cstate: current_term: 8 leader_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:00.129839 23083 raft_consensus.cc:515] T ed7fdbcb96d14d418db9ca90a792588a P 0473d2b2d01f4459b1e90fd12cc7840e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:00.129097 23102 raft_consensus.cc:493] T df751f992649444090e27965eb1af85d P 0473d2b2d01f4459b1e90fd12cc7840e [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:00.151289 23102 raft_consensus.cc:515] T df751f992649444090e27965eb1af85d P 0473d2b2d01f4459b1e90fd12cc7840e [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
W20260709 13:06:00.139124 20075 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.1:40321, user_credentials={real_user=slave}} blocked reactor thread for 274656us
I20260709 13:06:00.153746 19405 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52342 (request call id 2376) took 1003 ms. Trace:
I20260709 13:06:00.133540 23218 leader_election.cc:290] T ece3db938bc649d4a40a51522ed5259c P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:06:00.154207 19405 rpcz_store.cc:276] 0709 13:05:59.150469 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:59.157703 (+  7234us) service_pool.cc:224] Handling call
0709 13:05:59.158046 (+   343us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:05:59.195508 (+ 37462us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:05:59.195541 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:05:59.230553 (+ 35012us) log.cc:844] Serialized 26 byte log entry
0709 13:05:59.973702 (+743149us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:05:59.973738 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:59.973798 (+    60us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:00.153489 (+179691us) raft_consensus.cc:1685] finished
0709 13:06:00.153519 (+    30us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:00.153688 (+   169us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":15986,"raft.queue_time_us":46028,"raft.run_cpu_time_us":150,"raft.run_wall_time_us":72642,"thread_start_us":563180,"threads_started":1,"wal-append.queue_time_us":769673}
I20260709 13:06:00.155499 23336 leader_election.cc:290] T 0cdf56e38bbc453d9438d359e5a69955 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:06:00.155994 20075 leader_election.cc:304] T 85c494af21f9457a85da47b9bc70c1fd P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 127766fc592545a4997f7790f50f6076, e5256d91808b47c195bc9b4dbd7f2b87; no voters: 
I20260709 13:06:00.156193 23415 leader_election.cc:290] T 14efcc79969f41babe5529c22d59156d P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:06:00.156929 23268 raft_consensus.cc:2804] T 85c494af21f9457a85da47b9bc70c1fd P 127766fc592545a4997f7790f50f6076 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:06:00.157356 23268 raft_consensus.cc:493] T 85c494af21f9457a85da47b9bc70c1fd P 127766fc592545a4997f7790f50f6076 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:00.157522 23093 leader_election.cc:290] T 309c3ca0ca4b4f3ba129752ea2cb293b P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:06:00.157773 23268 raft_consensus.cc:3060] T 85c494af21f9457a85da47b9bc70c1fd P 127766fc592545a4997f7790f50f6076 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:06:00.157866 23324 leader_election.cc:290] T ab43d85f64114d4ebf618930e43d9ed0 P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:06:00.158959 23378 leader_election.cc:290] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:06:00.159490 19485 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58294 (request call id 2087) took 1337 ms. Trace:
I20260709 13:06:00.159850 19485 rpcz_store.cc:276] 0709 13:05:58.822472 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:59.082901 (+260429us) service_pool.cc:224] Handling call
0709 13:06:00.159301 (+1076400us) spinlock_profiling.cc:243] Waited 1.04 s on lock 0x7b540030cfd4. stack: 00007f4a79de9343 00007f4a79de9240 00007f4a797781d4 00007f4a834b6304 00007f4a834b6299 00007f4a7ce71571 00007f4a7cf0c2fa 00007f4a81ecdb17 00007f4a7b4486d4 00007f4a7b448662 00007f4a7b448591 00007f4a7b44850c 00007f4a7b4477c2 00007f4a7b24348c 00007f4a7b2428c6 00007f4a7b24226f
0709 13:06:00.159436 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2395514624}
I20260709 13:06:00.160708 23351 leader_election.cc:290] T 1f85fc4b527a48848e5faa083b604e36 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
W20260709 13:06:00.161558 19449 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.1:40321, user_credentials={real_user=slave}} blocked reactor thread for 301729us
I20260709 13:06:00.170001 23413 leader_election.cc:290] T fa731b585f684a7fb2d106c50f143b83 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:06:00.170746 23414 raft_consensus.cc:3055] T b9f0d59553ad444883fcf5b5909f9798 P 0473d2b2d01f4459b1e90fd12cc7840e [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:06:00.171157 23414 raft_consensus.cc:740] T b9f0d59553ad444883fcf5b5909f9798 P 0473d2b2d01f4459b1e90fd12cc7840e [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 0473d2b2d01f4459b1e90fd12cc7840e, State: Running, Role: LEADER
I20260709 13:06:00.172068 23414 consensus_queue.cc:260] T b9f0d59553ad444883fcf5b5909f9798 P 0473d2b2d01f4459b1e90fd12cc7840e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:00.173234 23414 raft_consensus.cc:3060] T b9f0d59553ad444883fcf5b5909f9798 P 0473d2b2d01f4459b1e90fd12cc7840e [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:06:00.174449 19486 raft_consensus.cc:1275] T 76cb037fc9064d13b59a8969d897ce8c P 0473d2b2d01f4459b1e90fd12cc7840e [term 9 FOLLOWER]: Refusing update from remote peer e5256d91808b47c195bc9b4dbd7f2b87: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 13:06:00.174530 23102 leader_election.cc:290] T df751f992649444090e27965eb1af85d P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:06:00.175803 23243 raft_consensus.cc:993] T 70797e5783b5454ab0d0eea663e791e3 P e5256d91808b47c195bc9b4dbd7f2b87: : Instructing follower e61c3a8f61bb48f8a963c9480e53c168 to start an election
I20260709 13:06:00.138614 23399 leader_election.cc:290] T 48824d5acfbc485ebf8c2d944e7202de P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
W20260709 13:06:00.176952 19452 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:00.177212 18300 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:06:00.178577 23338 leader_election.cc:290] T 65d8cb8d6ec64f459d5a47cefab10acf P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:06:00.179685 23368 raft_consensus.cc:515] T 0e1085d23e8347fbbd5bce7542f4b1f4 P e61c3a8f61bb48f8a963c9480e53c168 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:00.184430 23360 raft_consensus.cc:515] T 28af091831594f9d8e96482078cc7625 P e61c3a8f61bb48f8a963c9480e53c168 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:00.176262 23243 raft_consensus.cc:1081] T 70797e5783b5454ab0d0eea663e791e3 P e5256d91808b47c195bc9b4dbd7f2b87 [term 10 LEADER]: Signalling peer e61c3a8f61bb48f8a963c9480e53c168 to start an election
I20260709 13:06:00.065440 23343 consensus_queue.cc:237] T 1efebf73c86e432baa55533136b6e12c P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:00.190582 23340 leader_election.cc:290] T 7f575b143b844aa096b50997dad3516a P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:06:00.194047 23083 leader_election.cc:290] T ed7fdbcb96d14d418db9ca90a792588a P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
W20260709 13:06:00.111722 19306 rpcz_store.cc:269] 0709 13:05:37.234600 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:37.234902 (+   302us) service_pool.cc:224] Handling call
0709 13:06:00.111040 (+22876138us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:05:54.447269 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:05:54.486140 (+ 38871us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:05:54.486185 (+    45us) write_op.cc:435] Acquired schema lock
0709 13:05:54.486211 (+    26us) tablet.cc:662] Decoding operations
0709 13:05:54.487535 (+  1324us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:05:54.487641 (+   106us) write_op.cc:641] Partition lock acquired for write op
0709 13:05:54.487683 (+    42us) tablet.cc:685] Acquiring locks for 11 operations
0709 13:05:54.488923 (+  1240us) tablet.cc:701] Row locks acquired
0709 13:05:54.488949 (+    26us) write_op.cc:260] PREPARE: finished
0709 13:05:54.489136 (+   187us) write_op.cc:270] Start()
0709 13:05:54.489265 (+   129us) write_op.cc:276] Timestamp: P: 1783602354489079 usec, L: 0
0709 13:05:54.489293 (+    28us) op_driver.cc:348] REPLICATION: starting
0709 13:05:54.490126 (+   833us) log.cc:844] Serialized 4370 byte log entry
0709 13:05:55.254198 (+764072us) op_driver.cc:464] REPLICATION: finished
0709 13:05:55.271599 (+ 17401us) write_op.cc:301] APPLY: starting
0709 13:05:55.271710 (+   111us) tablet.cc:1367] starting BulkCheckPresence
0709 13:05:55.272043 (+   333us) tablet.cc:1370] finished BulkCheckPresence
0709 13:05:55.272211 (+   168us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:05:55.273675 (+  1464us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:05:55.274024 (+   349us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=11
0709 13:05:55.274125 (+   101us) write_op.cc:312] APPLY: finished
0709 13:05:55.274525 (+   400us) log.cc:844] Serialized 83 byte log entry
0709 13:05:55.274748 (+   223us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:05:55.274940 (+   192us) write_op.cc:454] Released schema lock
0709 13:05:55.275005 (+    65us) write_op.cc:341] FINISH: Updating metrics
0709 13:05:55.275547 (+   542us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:05:55.275586 (+    39us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":60369,"reported_tablets":51,"child_traces":[["op",{"apply.queue_time_us":17137,"apply.run_cpu_time_us":3862,"apply.run_wall_time_us":3869,"num_ops":11,"prepare.queue_time_us":155178,"prepare.run_cpu_time_us":21349,"prepare.run_wall_time_us":189677,"raft.queue_time_us":336792,"raft.run_cpu_time_us":7453,"raft.run_wall_time_us":19255,"replication_time_us":764753,"spinlock_wait_cycles":34176,"thread_start_us":562042,"threads_started":4,"wal-append.queue_time_us":201887,"wal-append.run_cpu_time_us":39527,"wal-append.run_wall_time_us":1741878}]]}
I20260709 13:06:00.196568 23194 consensus_queue.cc:1048] T 2b74109013a140ada21feeef92d6f563 P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:06:00.199209 19486 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58294 (request call id 2088) took 1215 ms. Trace:
I20260709 13:06:00.199584 19486 rpcz_store.cc:276] 0709 13:05:58.983670 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:00.004997 (+1021327us) service_pool.cc:224] Handling call
0709 13:06:00.174129 (+169132us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:00.174898 (+   769us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:00.199017 (+ 24119us) spinlock_profiling.cc:243] Waited 163 ms on lock 0x7b5400149450. stack: 00007f4a79de9343 00007f4a79de9240 00007f4a797781d4 00007f4a834b6304 00007f4a834b6299 00007f4a7ce71571 00007f4a7cf078ad 00007f4a81ecc419 00007f4a7b443bd4 00007f4a7b443b62 00007f4a7b443a91 00007f4a7b443a0c 00007f4a7b442cc2 00007f4a7b24348c 00007f4a7b2428c6 00007f4a7b24226f
0709 13:06:00.199154 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":373914880}
I20260709 13:06:00.200052 19403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14efcc79969f41babe5529c22d59156d" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:06:00.201752 19406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab43d85f64114d4ebf618930e43d9ed0" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:06:00.202536 19406 raft_consensus.cc:2468] T ab43d85f64114d4ebf618930e43d9ed0 P e5256d91808b47c195bc9b4dbd7f2b87 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 10.
I20260709 13:06:00.094249 23190 raft_consensus.cc:2749] T d1e5873a19244c5ebbcd38e126796ee7 P e5256d91808b47c195bc9b4dbd7f2b87 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:06:00.093832 23407 leader_election.cc:290] T 7f575b143b844aa096b50997dad3516a P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:06:00.203500 20106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7be9efa6559648dbb5a0f7684c4542d1" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:06:00.203925 19409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b74109013a140ada21feeef92d6f563" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:06:00.204113 20106 raft_consensus.cc:2468] T 7be9efa6559648dbb5a0f7684c4542d1 P 127766fc592545a4997f7790f50f6076 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 10.
I20260709 13:06:00.204496 19409 raft_consensus.cc:2468] T 2b74109013a140ada21feeef92d6f563 P e5256d91808b47c195bc9b4dbd7f2b87 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 6.
I20260709 13:06:00.205487 19407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36f6ba92b9ba46babe4ebd6c02e5fbd9" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:06:00.152108 19309 catalog_manager.cc:5697] T 179fd671030940b4b4a4e24bcc4aba0a P 0473d2b2d01f4459b1e90fd12cc7840e reported cstate change: term changed from 6 to 8, leader changed from e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3) to 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2). New cstate: current_term: 8 leader_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:00.079551 23412 raft_consensus.cc:3060] T 179fd671030940b4b4a4e24bcc4aba0a P e61c3a8f61bb48f8a963c9480e53c168 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:06:00.211848 22758 raft_consensus.cc:515] T f1b10566f45d4a7d9029858330e02d5b P e61c3a8f61bb48f8a963c9480e53c168 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:00.214991 20106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62c6c134d3d24a1ab144dd9ee6bc3f64" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076"
W20260709 13:06:00.199601 20075 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.1:40321, user_credentials={real_user=slave}} blocked reactor thread for 43702.2us
I20260709 13:06:00.226513 19411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76cb037fc9064d13b59a8969d897ce8c" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:06:00.226855 20108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "775c229504194560ba9589bc2199b089" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076"
I20260709 13:06:00.227581 23091 raft_consensus.cc:515] T 2725d2c4cb054f18b0fc8f735c15f6c2 P e5256d91808b47c195bc9b4dbd7f2b87 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:00.228255 19405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f575b143b844aa096b50997dad3516a" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:06:00.228255 20108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48824d5acfbc485ebf8c2d944e7202de" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:06:00.229077 20108 raft_consensus.cc:2468] T 48824d5acfbc485ebf8c2d944e7202de P 127766fc592545a4997f7790f50f6076 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 10.
I20260709 13:06:00.229910 23091 leader_election.cc:290] T 2725d2c4cb054f18b0fc8f735c15f6c2 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 12 election: Requested vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:06:00.230249 20108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1efebf73c86e432baa55533136b6e12c" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 10 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:06:00.230520 20106 raft_consensus.cc:2393] T 62c6c134d3d24a1ab144dd9ee6bc3f64 P 127766fc592545a4997f7790f50f6076 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 0473d2b2d01f4459b1e90fd12cc7840e in current term 10: Already voted for candidate e61c3a8f61bb48f8a963c9480e53c168 in this term.
I20260709 13:06:00.231076 20108 raft_consensus.cc:2410] T 1efebf73c86e432baa55533136b6e12c P 127766fc592545a4997f7790f50f6076 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0473d2b2d01f4459b1e90fd12cc7840e for term 10 because replica has last-logged OpId of term: 8 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 7.
I20260709 13:06:00.232208 20108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab43d85f64114d4ebf618930e43d9ed0" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:06:00.232738 20108 raft_consensus.cc:2468] T ab43d85f64114d4ebf618930e43d9ed0 P 127766fc592545a4997f7790f50f6076 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 10.
I20260709 13:06:00.233896 20108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14efcc79969f41babe5529c22d59156d" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:06:00.235589 22758 leader_election.cc:290] T f1b10566f45d4a7d9029858330e02d5b P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 12 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:06:00.238050 20108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36f6ba92b9ba46babe4ebd6c02e5fbd9" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:06:00.249502 19408 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52342 (request call id 2379) took 1098 ms. Trace:
I20260709 13:06:00.239385 23122 raft_consensus.cc:515] T 1f85fc4b527a48848e5faa083b604e36 P e5256d91808b47c195bc9b4dbd7f2b87 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
W20260709 13:06:00.289278 19523 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.575s	user 0.012s	sys 0.007s
W20260709 13:06:00.289686 19523 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.575s	user 0.012s	sys 0.007s
W20260709 13:06:00.289959 19523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.1:40321, user_credentials={real_user=slave}} blocked reactor thread for 575561us
W20260709 13:06:00.291980 19375 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.3:36891, user_credentials={real_user=slave}} blocked reactor thread for 349975us
I20260709 13:06:00.292727 19375 leader_election.cc:304] T df751f992649444090e27965eb1af85d P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:06:00.292205 19309 catalog_manager.cc:5697] T 172b3dd13109415a955b71ac0e9d2234 P 0473d2b2d01f4459b1e90fd12cc7840e reported cstate change: term changed from 1 to 5. New cstate: current_term: 5 leader_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:00.250043 19408 rpcz_store.cc:276] 0709 13:05:59.151385 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:59.160463 (+  9078us) service_pool.cc:224] Handling call
0709 13:05:59.160734 (+   271us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:59.160919 (+   185us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:05:59.994980 (+834061us) log.cc:844] Serialized 14 byte log entry
0709 13:06:00.249155 (+254175us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:00.249206 (+    51us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:06:00.249258 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:00.249320 (+    62us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:00.249441 (+   121us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":834747,"prepare.run_cpu_time_us":34,"prepare.run_wall_time_us":38,"thread_start_us":1087595,"threads_started":2}
W20260709 13:06:00.296123 19451 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:00.318418 19405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f85fc4b527a48848e5faa083b604e36" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:06:00.323592 19405 raft_consensus.cc:2393] T 1f85fc4b527a48848e5faa083b604e36 P e5256d91808b47c195bc9b4dbd7f2b87 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0473d2b2d01f4459b1e90fd12cc7840e in current term 8: Already voted for candidate e5256d91808b47c195bc9b4dbd7f2b87 in this term.
I20260709 13:06:00.323563 19402 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52342 (request call id 2378) took 1172 ms. Trace:
I20260709 13:06:00.328433 19375 leader_election.cc:304] T 4af19371ea874c09a0a2147040835cbb P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87; no voters: 127766fc592545a4997f7790f50f6076, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:06:00.305106 19309 catalog_manager.cc:5697] T 1dc5b3532fe54f74876d02beffa2c230 P 0473d2b2d01f4459b1e90fd12cc7840e reported cstate change: term changed from 3 to 6, leader changed from e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1) to 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2). New cstate: current_term: 6 leader_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:00.295209 23399 raft_consensus.cc:493] T 2a16f7501e2444fb86d4e2778e734e02 P 127766fc592545a4997f7790f50f6076 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:00.291373 23340 consensus_queue.cc:1048] T 40e1e16737a842ee936002830f36882e P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.036s
I20260709 13:06:00.345382 19309 catalog_manager.cc:5697] T 4509b76741dc428e9201c70c1658da13 P 0473d2b2d01f4459b1e90fd12cc7840e reported cstate change: term changed from 2 to 4, leader changed from e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3) to 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2). New cstate: current_term: 4 leader_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:00.348249 20108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f85fc4b527a48848e5faa083b604e36" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:06:00.319370 23360 leader_election.cc:290] T 28af091831594f9d8e96482078cc7625 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 11 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
W20260709 13:06:00.352885 19523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.1:40321, user_credentials={real_user=slave}} blocked reactor thread for 62138.7us
I20260709 13:06:00.321461 23387 raft_consensus.cc:493] T fa731b585f684a7fb2d106c50f143b83 P 127766fc592545a4997f7790f50f6076 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader e5256d91808b47c195bc9b4dbd7f2b87)
I20260709 13:06:00.350250 20108 raft_consensus.cc:2410] T 1f85fc4b527a48848e5faa083b604e36 P 127766fc592545a4997f7790f50f6076 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0473d2b2d01f4459b1e90fd12cc7840e for term 8 because replica has last-logged OpId of term: 6 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 7.
I20260709 13:06:00.325006 19402 rpcz_store.cc:276] 0709 13:05:59.151111 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:59.152539 (+  1428us) service_pool.cc:224] Handling call
0709 13:05:59.159770 (+  7231us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:59.159977 (+   207us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:05:59.878057 (+718080us) log.cc:844] Serialized 14 byte log entry
0709 13:06:00.323052 (+444995us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:00.323131 (+    79us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:06:00.323205 (+    74us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:00.323302 (+    97us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:00.323480 (+   178us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":28699,"prepare.queue_time_us":814957,"prepare.run_cpu_time_us":46,"prepare.run_wall_time_us":3950,"thread_start_us":1131328,"threads_started":2,"wal-append.queue_time_us":411740}
I20260709 13:06:00.294307 23413 consensus_queue.cc:1059] T 21e14947d70440f19044d8f75c31e1f9 P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 4, Time since last communication: 0.051s
W20260709 13:06:00.377102 19377 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.2:46257, user_credentials={real_user=slave}} blocked reactor thread for 298104us
W20260709 13:06:00.378443 20076 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.540s	user 0.001s	sys 0.017s
W20260709 13:06:00.379025 20076 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.541s	user 0.002s	sys 0.017s
W20260709 13:06:00.381774 19374 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.4:43121, user_credentials={real_user=slave}} blocked reactor thread for 516225us
I20260709 13:06:00.351650 23190 raft_consensus.cc:2749] T 4af19371ea874c09a0a2147040835cbb P e5256d91808b47c195bc9b4dbd7f2b87 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:06:00.387702 19408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14935b3ddf914369822e4a0547aaa355" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:06:00.388346 19408 raft_consensus.cc:2468] T 14935b3ddf914369822e4a0547aaa355 P e5256d91808b47c195bc9b4dbd7f2b87 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 127766fc592545a4997f7790f50f6076 in term 8.
I20260709 13:06:00.391803 19408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab43d85f64114d4ebf618930e43d9ed0" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:06:00.392584 19408 raft_consensus.cc:2468] T ab43d85f64114d4ebf618930e43d9ed0 P e5256d91808b47c195bc9b4dbd7f2b87 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 127766fc592545a4997f7790f50f6076 in term 10.
I20260709 13:06:00.397537 20108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ece3db938bc649d4a40a51522ed5259c" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:06:00.398259 20108 raft_consensus.cc:2468] T ece3db938bc649d4a40a51522ed5259c P 127766fc592545a4997f7790f50f6076 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 8.
I20260709 13:06:00.337679 23091 raft_consensus.cc:2804] T df751f992649444090e27965eb1af85d P e5256d91808b47c195bc9b4dbd7f2b87 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:06:00.416873 19551 raft_consensus.cc:1275] T 1dc5b3532fe54f74876d02beffa2c230 P e61c3a8f61bb48f8a963c9480e53c168 [term 10 FOLLOWER]: Refusing update from remote peer e5256d91808b47c195bc9b4dbd7f2b87: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 10 index: 5. (index mismatch)
W20260709 13:06:00.423116 19377 leader_election.cc:336] T 40e1e16737a842ee936002830f36882e P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 13 election: RPC error from VoteRequest() call to peer 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257): Timed out: RequestConsensusVote RPC to 127.17.223.2:46257 timed out after 1.883s (SENT)
I20260709 13:06:00.338270 23332 consensus_queue.cc:1048] T 775c229504194560ba9589bc2199b089 P 127766fc592545a4997f7790f50f6076 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.057s
I20260709 13:06:00.424134 19377 leader_election.cc:304] T 40e1e16737a842ee936002830f36882e P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168
W20260709 13:06:00.436340 19450 connection.cc:256] RPC call timeout handler was delayed by -1.1768630420000363s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18480000000000002s for a response
W20260709 13:06:00.436897 19450 connection.cc:256] RPC call timeout handler was delayed by -1.0868630420000045s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1948s for a response
W20260709 13:06:00.437266 19450 connection.cc:256] RPC call timeout handler was delayed by -1.0679630419999739s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19690000000000002s for a response
W20260709 13:06:00.437655 19450 connection.cc:256] RPC call timeout handler was delayed by -1.0679630419999739s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19690000000000002s for a response
W20260709 13:06:00.438004 19450 connection.cc:256] RPC call timeout handler was delayed by -1.0472630419999405s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19920000000000002s for a response
I20260709 13:06:00.440164 19481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0afb57ae58a24a01850491d69f0213dd" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
W20260709 13:06:00.446905 19523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.1:40321, user_credentials={real_user=slave}} blocked reactor thread for 52705.3us
I20260709 13:06:00.447039 19483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62c6c134d3d24a1ab144dd9ee6bc3f64" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
W20260709 13:06:00.447571 19376 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:00.447793 19483 raft_consensus.cc:2368] T 62c6c134d3d24a1ab144dd9ee6bc3f64 P 0473d2b2d01f4459b1e90fd12cc7840e [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 127766fc592545a4997f7790f50f6076 for earlier term 9. Current term is 10.
I20260709 13:06:00.447785 19523 leader_election.cc:304] T 4af19371ea874c09a0a2147040835cbb P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e61c3a8f61bb48f8a963c9480e53c168; no voters: 127766fc592545a4997f7790f50f6076, e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:06:00.448789 19485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7be9efa6559648dbb5a0f7684c4542d1" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:06:00.448995 19523 leader_election.cc:304] T f93ee515a9c14139bf566522ed8232f3 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168; no voters: 0473d2b2d01f4459b1e90fd12cc7840e
I20260709 13:06:00.449395 19485 raft_consensus.cc:2468] T 7be9efa6559648dbb5a0f7684c4542d1 P 0473d2b2d01f4459b1e90fd12cc7840e [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 127766fc592545a4997f7790f50f6076 in term 10.
I20260709 13:06:00.450021 19523 leader_election.cc:304] T 22196caba61445d3bec98a0aab3c337d P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e61c3a8f61bb48f8a963c9480e53c168; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:06:00.449388 23439 consensus_queue.cc:1048] T 2b74109013a140ada21feeef92d6f563 P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:06:00.450803 22979 raft_consensus.cc:493] T 2725d2c4cb054f18b0fc8f735c15f6c2 P e61c3a8f61bb48f8a963c9480e53c168 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:00.450945 19554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9f0d59553ad444883fcf5b5909f9798" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:06:00.451198 19484 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58294 (request call id 2082) took 2117 ms. Trace:
I20260709 13:06:00.451294 22979 raft_consensus.cc:515] T 2725d2c4cb054f18b0fc8f735c15f6c2 P e61c3a8f61bb48f8a963c9480e53c168 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:00.452996 23442 raft_consensus.cc:2804] T f93ee515a9c14139bf566522ed8232f3 P e61c3a8f61bb48f8a963c9480e53c168 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:06:00.453351 22979 leader_election.cc:290] T 2725d2c4cb054f18b0fc8f735c15f6c2 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:06:00.453420 23442 raft_consensus.cc:493] T f93ee515a9c14139bf566522ed8232f3 P e61c3a8f61bb48f8a963c9480e53c168 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:00.453967 23442 raft_consensus.cc:3060] T f93ee515a9c14139bf566522ed8232f3 P e61c3a8f61bb48f8a963c9480e53c168 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:06:00.451552 23439 raft_consensus.cc:2749] T 4af19371ea874c09a0a2147040835cbb P e61c3a8f61bb48f8a963c9480e53c168 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:06:00.456074 23437 raft_consensus.cc:493] T 6c5eebf646ad445a9d1b1adc319d7b16 P 127766fc592545a4997f7790f50f6076 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader e61c3a8f61bb48f8a963c9480e53c168)
I20260709 13:06:00.456817 19482 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58286 (request call id 1900) took 2385 ms. Trace:
I20260709 13:06:00.456687 23437 raft_consensus.cc:515] T 6c5eebf646ad445a9d1b1adc319d7b16 P 127766fc592545a4997f7790f50f6076 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:00.409320 23243 raft_consensus.cc:493] T 2a16f7501e2444fb86d4e2778e734e02 P e5256d91808b47c195bc9b4dbd7f2b87 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:00.457350 19482 rpcz_store.cc:276] 0709 13:05:58.071553 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:58.092997 (+ 21444us) service_pool.cc:224] Handling call
0709 13:05:58.093357 (+   360us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:05:58.964518 (+871161us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:05:58.964556 (+    38us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:05:59.038187 (+ 73631us) log.cc:844] Serialized 52 byte log entry
0709 13:05:59.923113 (+884926us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:06:00.395918 (+472805us) log.cc:844] Serialized 14 byte log entry
0709 13:06:00.456495 (+ 60577us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:00.456583 (+    88us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:00.456619 (+    36us) raft_consensus.cc:1685] finished
0709 13:06:00.456629 (+    10us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:00.456743 (+   114us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":79362,"prepare.queue_time_us":59465,"prepare.run_cpu_time_us":42,"prepare.run_wall_time_us":42,"raft.queue_time_us":166276,"raft.run_cpu_time_us":114,"raft.run_wall_time_us":113,"thread_start_us":1497636,"threads_started":3,"wal-append.queue_time_us":888962}
I20260709 13:06:00.464094 19551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b74109013a140ada21feeef92d6f563" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:06:00.451534 19554 raft_consensus.cc:3060] T b9f0d59553ad444883fcf5b5909f9798 P e61c3a8f61bb48f8a963c9480e53c168 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:06:00.351684 23399 raft_consensus.cc:515] T 2a16f7501e2444fb86d4e2778e734e02 P 127766fc592545a4997f7790f50f6076 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:00.466298 19486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "309c3ca0ca4b4f3ba129752ea2cb293b" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:06:00.471272 19480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e1085d23e8347fbbd5bce7542f4b1f4" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:06:00.471801 19482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1efebf73c86e432baa55533136b6e12c" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:06:00.472401 19482 raft_consensus.cc:2468] T 1efebf73c86e432baa55533136b6e12c P 0473d2b2d01f4459b1e90fd12cc7840e [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 127766fc592545a4997f7790f50f6076 in term 9.
I20260709 13:06:00.472628 19483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14efcc79969f41babe5529c22d59156d" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
W20260709 13:06:00.475133 19374 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.4:43121, user_credentials={real_user=slave}} blocked reactor thread for 79407.4us
I20260709 13:06:00.479260 19482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14935b3ddf914369822e4a0547aaa355" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:06:00.479930 19482 raft_consensus.cc:2468] T 14935b3ddf914369822e4a0547aaa355 P 0473d2b2d01f4459b1e90fd12cc7840e [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 127766fc592545a4997f7790f50f6076 in term 9.
I20260709 13:06:00.481031 19478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48824d5acfbc485ebf8c2d944e7202de" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:06:00.456625 23220 raft_consensus.cc:493] T ff75a1d4cb1f493db8f71ddc136ba9ab P 0473d2b2d01f4459b1e90fd12cc7840e [term 10 FOLLOWER]: Starting pre-election (detected failure of leader e61c3a8f61bb48f8a963c9480e53c168)
I20260709 13:06:00.390532 23387 raft_consensus.cc:515] T fa731b585f684a7fb2d106c50f143b83 P 127766fc592545a4997f7790f50f6076 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:00.488368 20076 leader_election.cc:304] T 4af19371ea874c09a0a2147040835cbb P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 127766fc592545a4997f7790f50f6076; no voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:06:00.489238 19479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab43d85f64114d4ebf618930e43d9ed0" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:06:00.472011 19480 raft_consensus.cc:2376] T 0e1085d23e8347fbbd5bce7542f4b1f4 P 0473d2b2d01f4459b1e90fd12cc7840e [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 127766fc592545a4997f7790f50f6076 in term 7. Re-sending same reply.
I20260709 13:06:00.467074 19486 raft_consensus.cc:2468] T 309c3ca0ca4b4f3ba129752ea2cb293b P 0473d2b2d01f4459b1e90fd12cc7840e [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 127766fc592545a4997f7790f50f6076 in term 8.
I20260709 13:06:00.435572 23091 raft_consensus.cc:697] T df751f992649444090e27965eb1af85d P e5256d91808b47c195bc9b4dbd7f2b87 [term 12 LEADER]: Becoming Leader. State: Replica: e5256d91808b47c195bc9b4dbd7f2b87, State: Running, Role: LEADER
I20260709 13:06:00.459825 23214 raft_consensus.cc:3055] T 21e14947d70440f19044d8f75c31e1f9 P e61c3a8f61bb48f8a963c9480e53c168 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:06:00.489807 19479 raft_consensus.cc:2376] T ab43d85f64114d4ebf618930e43d9ed0 P 0473d2b2d01f4459b1e90fd12cc7840e [term 10 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 127766fc592545a4997f7790f50f6076 in term 10. Re-sending same reply.
I20260709 13:06:00.495746 19485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "309c3ca0ca4b4f3ba129752ea2cb293b" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:06:00.487013 19481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96efeaaf1057492490e9a621f37e1a2d" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:06:00.483101 19552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ece3db938bc649d4a40a51522ed5259c" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:06:00.496372 19485 raft_consensus.cc:3060] T 309c3ca0ca4b4f3ba129752ea2cb293b P 0473d2b2d01f4459b1e90fd12cc7840e [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:06:00.496734 19481 raft_consensus.cc:2468] T 96efeaaf1057492490e9a621f37e1a2d P 0473d2b2d01f4459b1e90fd12cc7840e [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 127766fc592545a4997f7790f50f6076 in term 11.
W20260709 13:06:00.466748 23424 log.cc:927] Time spent T 3e1f505cb0f1427bbd698ac889d80821 P 0473d2b2d01f4459b1e90fd12cc7840e: Append to log took a long time: real 0.054s	user 0.000s	sys 0.000s
I20260709 13:06:00.496744 19552 raft_consensus.cc:2468] T ece3db938bc649d4a40a51522ed5259c P e61c3a8f61bb48f8a963c9480e53c168 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 9.
I20260709 13:06:00.459517 23403 raft_consensus.cc:493] T 46c5bfeecc314717bffe987e6844b6d0 P 0473d2b2d01f4459b1e90fd12cc7840e [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:00.499832 19374 leader_election.cc:304] T ece3db938bc649d4a40a51522ed5259c P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 127766fc592545a4997f7790f50f6076, e5256d91808b47c195bc9b4dbd7f2b87; no voters: 
W20260709 13:06:00.499076 19449 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.4:43121, user_credentials={real_user=slave}} blocked reactor thread for 242181us
I20260709 13:06:00.465834 23413 raft_consensus.cc:2749] T 22196caba61445d3bec98a0aab3c337d P e61c3a8f61bb48f8a963c9480e53c168 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:06:00.502804 19478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab43d85f64114d4ebf618930e43d9ed0" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:06:00.504266 19483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "309c3ca0ca4b4f3ba129752ea2cb293b" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:06:00.507462 19486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff9b0eddd810459b82d91c60777c10eb" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:06:00.508044 19486 raft_consensus.cc:2376] T ff9b0eddd810459b82d91c60777c10eb P 0473d2b2d01f4459b1e90fd12cc7840e [term 9 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 127766fc592545a4997f7790f50f6076 in term 9. Re-sending same reply.
I20260709 13:06:00.506102 19480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab43d85f64114d4ebf618930e43d9ed0" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:06:00.505657 19478 raft_consensus.cc:2376] T ab43d85f64114d4ebf618930e43d9ed0 P 0473d2b2d01f4459b1e90fd12cc7840e [term 10 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 127766fc592545a4997f7790f50f6076 in term 10. Re-sending same reply.
I20260709 13:06:00.508914 19482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "217b5fae677b4971b3bbd2f357a1f7ff" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:06:00.509513 19482 raft_consensus.cc:2468] T 217b5fae677b4971b3bbd2f357a1f7ff P 0473d2b2d01f4459b1e90fd12cc7840e [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 7.
I20260709 13:06:00.451578 19484 rpcz_store.cc:276] 0709 13:05:58.333718 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:59.097620 (+763902us) service_pool.cc:224] Handling call
0709 13:05:59.097925 (+   305us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:05:59.164914 (+ 66989us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:05:59.164960 (+    46us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:05:59.165640 (+   680us) log.cc:844] Serialized 52 byte log entry
0709 13:05:59.934159 (+768519us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:06:00.248683 (+314524us) log.cc:844] Serialized 14 byte log entry
0709 13:06:00.259268 (+ 10585us) log.cc:844] Serialized 14 byte log entry
0709 13:06:00.416319 (+157051us) spinlock_profiling.cc:243] Waited 1.04 ms on lock 0x7b18004447c0. stack: 00007f4a79de9343 00007f4a79de9240 00007f4a797781d4 00007f4a834b6304 00007f4a834b6299 00007f4a82ce3de1 00007f4a82cf05b1 00007f4a79d95c0a 00007f4a834d5219 00007f4a79e1da40 00007f4a79e184e4 00007f4a79e18455 00007f4a7cf00060 00007f4a7cf12716 00007f4a7cf23287 00007f4a7cf23208
0709 13:06:00.416522 (+   203us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:00.416623 (+   101us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:00.451000 (+ 34377us) raft_consensus.cc:1685] finished
0709 13:06:00.451020 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:00.451151 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":255884,"prepare.queue_time_us":108419,"prepare.run_cpu_time_us":85,"prepare.run_wall_time_us":1049,"raft.queue_time_us":277841,"raft.run_cpu_time_us":352,"raft.run_wall_time_us":32442,"spinlock_wait_cycles":2381568,"thread_start_us":1006558,"threads_started":2,"wal-append.queue_time_us":902608}
I20260709 13:06:00.516647 19481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa8650e71aa14778b3d73721fc50d9fc" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:06:00.519282 23420 raft_consensus.cc:2804] T ece3db938bc649d4a40a51522ed5259c P e5256d91808b47c195bc9b4dbd7f2b87 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:06:00.519738 23420 raft_consensus.cc:493] T ece3db938bc649d4a40a51522ed5259c P e5256d91808b47c195bc9b4dbd7f2b87 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:00.520077 23420 raft_consensus.cc:3060] T ece3db938bc649d4a40a51522ed5259c P e5256d91808b47c195bc9b4dbd7f2b87 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:06:00.484769 23425 raft_consensus.cc:493] T 70797e5783b5454ab0d0eea663e791e3 P 127766fc592545a4997f7790f50f6076 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader e5256d91808b47c195bc9b4dbd7f2b87)
I20260709 13:06:00.523797 19551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2725d2c4cb054f18b0fc8f735c15f6c2" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:06:00.524469 19551 raft_consensus.cc:3060] T 2725d2c4cb054f18b0fc8f735c15f6c2 P e61c3a8f61bb48f8a963c9480e53c168 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:06:00.528249 19450 leader_election.cc:304] T 0cdf56e38bbc453d9438d359e5a69955 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e; no voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:06:00.538233 20106 raft_consensus.cc:1275] T 96efeaaf1057492490e9a621f37e1a2d P 127766fc592545a4997f7790f50f6076 [term 11 FOLLOWER]: Refusing update from remote peer e61c3a8f61bb48f8a963c9480e53c168: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 11 index: 9. (term mismatch)
I20260709 13:06:00.538638 20106 pending_rounds.cc:85] T 96efeaaf1057492490e9a621f37e1a2d P 127766fc592545a4997f7790f50f6076: Aborting all ops after (but not including) 8
I20260709 13:06:00.538875 20106 pending_rounds.cc:107] T 96efeaaf1057492490e9a621f37e1a2d P 127766fc592545a4997f7790f50f6076: Aborting uncommitted NO_OP operation due to leader change: 10.9
I20260709 13:06:00.499423 23214 raft_consensus.cc:740] T 21e14947d70440f19044d8f75c31e1f9 P e61c3a8f61bb48f8a963c9480e53c168 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: e61c3a8f61bb48f8a963c9480e53c168, State: Running, Role: LEADER
I20260709 13:06:00.540278 19450 leader_election.cc:304] T 6c5eebf646ad445a9d1b1adc319d7b16 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e; no voters: 127766fc592545a4997f7790f50f6076, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:06:00.548254 20106 raft_consensus.cc:2889] T 96efeaaf1057492490e9a621f37e1a2d P 127766fc592545a4997f7790f50f6076 [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:06:00.549881 20108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70797e5783b5454ab0d0eea663e791e3" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:06:00.504256 23443 raft_consensus.cc:493] T ff9b0eddd810459b82d91c60777c10eb P e5256d91808b47c195bc9b4dbd7f2b87 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:06:00.557708 19375 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.3:36891, user_credentials={real_user=slave}} blocked reactor thread for 134591us
I20260709 13:06:00.474713 23243 raft_consensus.cc:515] T 2a16f7501e2444fb86d4e2778e734e02 P e5256d91808b47c195bc9b4dbd7f2b87 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:00.553337 20112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a16f7501e2444fb86d4e2778e734e02" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076"
I20260709 13:06:00.559979 20112 raft_consensus.cc:2393] T 2a16f7501e2444fb86d4e2778e734e02 P 127766fc592545a4997f7790f50f6076 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate e61c3a8f61bb48f8a963c9480e53c168 in current term 11: Already voted for candidate 127766fc592545a4997f7790f50f6076 in this term.
I20260709 13:06:00.522987 23425 raft_consensus.cc:515] T 70797e5783b5454ab0d0eea663e791e3 P 127766fc592545a4997f7790f50f6076 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:00.555886 23091 consensus_queue.cc:237] T df751f992649444090e27965eb1af85d P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:00.539750 19552 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "70797e5783b5454ab0d0eea663e791e3"
dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
 from {username='slave'} at 127.0.0.1:40438
I20260709 13:06:00.564182 19552 raft_consensus.cc:493] T 70797e5783b5454ab0d0eea663e791e3 P e61c3a8f61bb48f8a963c9480e53c168 [term 10 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:06:00.564638 19552 raft_consensus.cc:3060] T 70797e5783b5454ab0d0eea663e791e3 P e61c3a8f61bb48f8a963c9480e53c168 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:06:00.565385 20112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85c494af21f9457a85da47b9bc70c1fd" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:06:00.495524 23220 raft_consensus.cc:515] T ff75a1d4cb1f493db8f71ddc136ba9ab P 0473d2b2d01f4459b1e90fd12cc7840e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:00.514578 23218 raft_consensus.cc:2749] T 40e1e16737a842ee936002830f36882e P e5256d91808b47c195bc9b4dbd7f2b87 [term 14 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:06:00.545971 23335 raft_consensus.cc:2749] T 0cdf56e38bbc453d9438d359e5a69955 P 0473d2b2d01f4459b1e90fd12cc7840e [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:06:00.525308 23434 raft_consensus.cc:2749] T 4af19371ea874c09a0a2147040835cbb P 127766fc592545a4997f7790f50f6076 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:06:00.572448 19450 leader_election.cc:304] T f1b10566f45d4a7d9029858330e02d5b P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168; no voters: e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:06:00.572755 19485 raft_consensus.cc:2468] T 309c3ca0ca4b4f3ba129752ea2cb293b P 0473d2b2d01f4459b1e90fd12cc7840e [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 127766fc592545a4997f7790f50f6076 in term 9.
I20260709 13:06:00.569990 20108 raft_consensus.cc:2468] T 70797e5783b5454ab0d0eea663e791e3 P 127766fc592545a4997f7790f50f6076 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 10.
I20260709 13:06:00.548079 23233 raft_consensus.cc:3055] T a08760e15aac4630a629431f56024dc8 P e61c3a8f61bb48f8a963c9480e53c168 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:06:00.506963 23403 raft_consensus.cc:515] T 46c5bfeecc314717bffe987e6844b6d0 P 0473d2b2d01f4459b1e90fd12cc7840e [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:00.591747 19551 raft_consensus.cc:2468] T 2725d2c4cb054f18b0fc8f735c15f6c2 P e61c3a8f61bb48f8a963c9480e53c168 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 12.
I20260709 13:06:00.586879 20106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed7fdbcb96d14d418db9ca90a792588a" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:06:00.576009 23407 raft_consensus.cc:2749] T 6c5eebf646ad445a9d1b1adc319d7b16 P 0473d2b2d01f4459b1e90fd12cc7840e [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:06:00.596211 20106 raft_consensus.cc:2468] T ed7fdbcb96d14d418db9ca90a792588a P 127766fc592545a4997f7790f50f6076 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 6.
I20260709 13:06:00.570269 23122 leader_election.cc:290] T 1f85fc4b527a48848e5faa083b604e36 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 8 election: Requested vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:06:00.600441 19558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85c494af21f9457a85da47b9bc70c1fd" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:06:00.601331 19558 raft_consensus.cc:2468] T 85c494af21f9457a85da47b9bc70c1fd P e61c3a8f61bb48f8a963c9480e53c168 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 127766fc592545a4997f7790f50f6076 in term 7.
I20260709 13:06:00.602887 19555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "833a2f0775ed407a94b8924ce50adb63" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:06:00.603699 20106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab43d85f64114d4ebf618930e43d9ed0" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:06:00.604346 20106 raft_consensus.cc:2468] T ab43d85f64114d4ebf618930e43d9ed0 P 127766fc592545a4997f7790f50f6076 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 10.
I20260709 13:06:00.577000 23368 leader_election.cc:290] T 0e1085d23e8347fbbd5bce7542f4b1f4 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 8 election: Requested vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:06:00.573268 23268 raft_consensus.cc:515] T 85c494af21f9457a85da47b9bc70c1fd P 127766fc592545a4997f7790f50f6076 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:00.613739 23104 consensus_queue.cc:1048] T f93ee515a9c14139bf566522ed8232f3 P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:06:00.606087 19551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1efebf73c86e432baa55533136b6e12c" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:06:00.588382 23233 raft_consensus.cc:740] T a08760e15aac4630a629431f56024dc8 P e61c3a8f61bb48f8a963c9480e53c168 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: e61c3a8f61bb48f8a963c9480e53c168, State: Running, Role: LEADER
I20260709 13:06:00.615510 20105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0afb57ae58a24a01850491d69f0213dd" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:06:00.596097 23433 raft_consensus.cc:2804] T f1b10566f45d4a7d9029858330e02d5b P 0473d2b2d01f4459b1e90fd12cc7840e [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:06:00.617759 19556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "309c3ca0ca4b4f3ba129752ea2cb293b" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:06:00.618065 19553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65d8cb8d6ec64f459d5a47cefab10acf" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:06:00.618266 23351 consensus_queue.cc:1048] T fa8650e71aa14778b3d73721fc50d9fc P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:06:00.618835 19553 raft_consensus.cc:2393] T 65d8cb8d6ec64f459d5a47cefab10acf P e61c3a8f61bb48f8a963c9480e53c168 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 127766fc592545a4997f7790f50f6076 in current term 8: Already voted for candidate e5256d91808b47c195bc9b4dbd7f2b87 in this term.
I20260709 13:06:00.619065 23268 leader_election.cc:290] T 85c494af21f9457a85da47b9bc70c1fd P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 8 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:06:00.619784 20112 raft_consensus.cc:2393] T 85c494af21f9457a85da47b9bc70c1fd P 127766fc592545a4997f7790f50f6076 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e61c3a8f61bb48f8a963c9480e53c168 in current term 8: Already voted for candidate 127766fc592545a4997f7790f50f6076 in this term.
I20260709 13:06:00.615517 23214 consensus_queue.cc:260] T 21e14947d70440f19044d8f75c31e1f9 P e61c3a8f61bb48f8a963c9480e53c168 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:00.621008 23214 raft_consensus.cc:3060] T 21e14947d70440f19044d8f75c31e1f9 P e61c3a8f61bb48f8a963c9480e53c168 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:06:00.621090 23233 consensus_queue.cc:260] T a08760e15aac4630a629431f56024dc8 P e61c3a8f61bb48f8a963c9480e53c168 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:00.622195 23233 raft_consensus.cc:3060] T a08760e15aac4630a629431f56024dc8 P e61c3a8f61bb48f8a963c9480e53c168 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:06:00.623446 19405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85c494af21f9457a85da47b9bc70c1fd" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
I20260709 13:06:00.623994 19405 raft_consensus.cc:3060] T 85c494af21f9457a85da47b9bc70c1fd P e5256d91808b47c195bc9b4dbd7f2b87 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:06:00.625072 23412 raft_consensus.cc:515] T 179fd671030940b4b4a4e24bcc4aba0a P e61c3a8f61bb48f8a963c9480e53c168 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:00.626782 23446 consensus_queue.cc:1048] T b08304a0a02b42d7840c4e8ee9a6bd1a P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:06:00.627689 19402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a16f7501e2444fb86d4e2778e734e02" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 12 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:06:00.605943 23413 raft_consensus.cc:493] T 4509b76741dc428e9201c70c1658da13 P e61c3a8f61bb48f8a963c9480e53c168 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 0473d2b2d01f4459b1e90fd12cc7840e)
I20260709 13:06:00.628494 19402 raft_consensus.cc:2410] T 2a16f7501e2444fb86d4e2778e734e02 P e5256d91808b47c195bc9b4dbd7f2b87 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 127766fc592545a4997f7790f50f6076 for term 12 because replica has last-logged OpId of term: 10 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 8.
I20260709 13:06:00.628580 23413 raft_consensus.cc:515] T 4509b76741dc428e9201c70c1658da13 P e61c3a8f61bb48f8a963c9480e53c168 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:00.617144 19551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96efeaaf1057492490e9a621f37e1a2d" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:06:00.631726 23243 leader_election.cc:290] T 2a16f7501e2444fb86d4e2778e734e02 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:06:00.633496 23403 leader_election.cc:290] T 46c5bfeecc314717bffe987e6844b6d0 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:06:00.636205 23387 leader_election.cc:290] T fa731b585f684a7fb2d106c50f143b83 P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:06:00.566804 23443 raft_consensus.cc:515] T ff9b0eddd810459b82d91c60777c10eb P e5256d91808b47c195bc9b4dbd7f2b87 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:00.595746 23338 raft_consensus.cc:493] T bc225c93219c45538b53a1bd3d387e4d P e61c3a8f61bb48f8a963c9480e53c168 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader e5256d91808b47c195bc9b4dbd7f2b87)
I20260709 13:06:00.639503 23338 raft_consensus.cc:515] T bc225c93219c45538b53a1bd3d387e4d P e61c3a8f61bb48f8a963c9480e53c168 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:00.638752 23436 consensus_queue.cc:1048] T 86a6797bdfe94fa496c050ceae4bd0d9 P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.029s
I20260709 13:06:00.618342 19556 raft_consensus.cc:3060] T 309c3ca0ca4b4f3ba129752ea2cb293b P e61c3a8f61bb48f8a963c9480e53c168 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:06:00.643226 19408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70797e5783b5454ab0d0eea663e791e3" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:06:00.644244 19450 leader_election.cc:304] T 179fd671030940b4b4a4e24bcc4aba0a P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e; no voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:06:00.640965 19405 raft_consensus.cc:2468] T 85c494af21f9457a85da47b9bc70c1fd P e5256d91808b47c195bc9b4dbd7f2b87 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 127766fc592545a4997f7790f50f6076 in term 8.
I20260709 13:06:00.654903 19551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14935b3ddf914369822e4a0547aaa355" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:06:00.598204 23194 raft_consensus.cc:493] T 14935b3ddf914369822e4a0547aaa355 P e61c3a8f61bb48f8a963c9480e53c168 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:00.651772 20105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "833a2f0775ed407a94b8924ce50adb63" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:06:00.641543 23338 leader_election.cc:290] T bc225c93219c45538b53a1bd3d387e4d P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:06:00.652205 20106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ece3db938bc649d4a40a51522ed5259c" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:06:00.655316 19554 raft_consensus.cc:2468] T b9f0d59553ad444883fcf5b5909f9798 P e61c3a8f61bb48f8a963c9480e53c168 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 10.
I20260709 13:06:00.656102 19450 leader_election.cc:304] T edd7d470b5014c9489be7f41f64355c9 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e; no voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:06:00.604048 23140 raft_consensus.cc:493] T 3e1f505cb0f1427bbd698ac889d80821 P e61c3a8f61bb48f8a963c9480e53c168 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader e5256d91808b47c195bc9b4dbd7f2b87)
I20260709 13:06:00.617693 23433 raft_consensus.cc:493] T f1b10566f45d4a7d9029858330e02d5b P 0473d2b2d01f4459b1e90fd12cc7840e [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:00.657653 20106 raft_consensus.cc:2468] T ece3db938bc649d4a40a51522ed5259c P 127766fc592545a4997f7790f50f6076 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 8.
I20260709 13:06:00.670094 19402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa731b585f684a7fb2d106c50f143b83" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:06:00.670501 20105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7be9efa6559648dbb5a0f7684c4542d1" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 11 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:06:00.672607 19553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48824d5acfbc485ebf8c2d944e7202de" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:06:00.673550 20105 raft_consensus.cc:2410] T 7be9efa6559648dbb5a0f7684c4542d1 P 127766fc592545a4997f7790f50f6076 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e61c3a8f61bb48f8a963c9480e53c168 for term 11 because replica has last-logged OpId of term: 9 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 6.
I20260709 13:06:00.701659 19552 raft_consensus.cc:515] T 70797e5783b5454ab0d0eea663e791e3 P e61c3a8f61bb48f8a963c9480e53c168 [term 11 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:00.704272 19450 leader_election.cc:304] T d1e5873a19244c5ebbcd38e126796ee7 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e; no voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:06:00.705142 20106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "309c3ca0ca4b4f3ba129752ea2cb293b" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:06:00.627310 23425 leader_election.cc:290] T 70797e5783b5454ab0d0eea663e791e3 P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:06:00.615118 23437 leader_election.cc:290] T 6c5eebf646ad445a9d1b1adc319d7b16 P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:06:00.656046 23407 raft_consensus.cc:2749] T 179fd671030940b4b4a4e24bcc4aba0a P 0473d2b2d01f4459b1e90fd12cc7840e [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:06:00.659286 20075 leader_election.cc:304] T 85c494af21f9457a85da47b9bc70c1fd P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 127766fc592545a4997f7790f50f6076, e5256d91808b47c195bc9b4dbd7f2b87; no voters: 
I20260709 13:06:00.586580 23456 consensus_queue.cc:1048] T 1dc5b3532fe54f74876d02beffa2c230 P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.087s
I20260709 13:06:00.646153 23443 leader_election.cc:290] T ff9b0eddd810459b82d91c60777c10eb P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:06:00.647347 23413 leader_election.cc:290] T 4509b76741dc428e9201c70c1658da13 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:06:00.721007 20106 raft_consensus.cc:2393] T 309c3ca0ca4b4f3ba129752ea2cb293b P 127766fc592545a4997f7790f50f6076 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e61c3a8f61bb48f8a963c9480e53c168 in current term 9: Already voted for candidate 127766fc592545a4997f7790f50f6076 in this term.
I20260709 13:06:00.717842 20076 leader_election.cc:304] T 65d8cb8d6ec64f459d5a47cefab10acf P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 127766fc592545a4997f7790f50f6076; no voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:06:00.723448 19554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab43d85f64114d4ebf618930e43d9ed0" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:06:00.726008 19553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c5eebf646ad445a9d1b1adc319d7b16" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:06:00.727360 19554 raft_consensus.cc:2468] T ab43d85f64114d4ebf618930e43d9ed0 P e61c3a8f61bb48f8a963c9480e53c168 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 127766fc592545a4997f7790f50f6076 in term 10.
I20260709 13:06:00.674242 23351 raft_consensus.cc:2749] T edd7d470b5014c9489be7f41f64355c9 P 0473d2b2d01f4459b1e90fd12cc7840e [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:06:00.672366 23399 leader_election.cc:290] T 2a16f7501e2444fb86d4e2778e734e02 P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
W20260709 13:06:00.726186 19450 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.3:36891, user_credentials={real_user=slave}} blocked reactor thread for 54223.6us
I20260709 13:06:00.730690 19450 leader_election.cc:304] T a08760e15aac4630a629431f56024dc8 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e; no voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168
W20260709 13:06:00.729043 20075 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.1:40321, user_credentials={real_user=slave}} blocked reactor thread for 69823.6us
I20260709 13:06:00.732448 20106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa731b585f684a7fb2d106c50f143b83" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:06:00.713263 23433 raft_consensus.cc:3060] T f1b10566f45d4a7d9029858330e02d5b P 0473d2b2d01f4459b1e90fd12cc7840e [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:06:00.735376 19552 leader_election.cc:290] T 70797e5783b5454ab0d0eea663e791e3 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 11 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:06:00.668562 23194 raft_consensus.cc:515] T 14935b3ddf914369822e4a0547aaa355 P e61c3a8f61bb48f8a963c9480e53c168 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } attrs { replace: true } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:00.675015 23140 raft_consensus.cc:515] T 3e1f505cb0f1427bbd698ac889d80821 P e61c3a8f61bb48f8a963c9480e53c168 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:00.739521 20076 leader_election.cc:304] T ab43d85f64114d4ebf618930e43d9ed0 P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 127766fc592545a4997f7790f50f6076, e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:06:00.730584 23437 raft_consensus.cc:3060] T 65d8cb8d6ec64f459d5a47cefab10acf P 127766fc592545a4997f7790f50f6076 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:06:00.731643 23387 raft_consensus.cc:2804] T 85c494af21f9457a85da47b9bc70c1fd P 127766fc592545a4997f7790f50f6076 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:06:00.748631 20106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65d8cb8d6ec64f459d5a47cefab10acf" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:06:00.749612 23436 raft_consensus.cc:2749] T a08760e15aac4630a629431f56024dc8 P 0473d2b2d01f4459b1e90fd12cc7840e [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:06:00.749953 19450 leader_election.cc:304] T 3e1f505cb0f1427bbd698ac889d80821 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e; no voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168
W20260709 13:06:00.751052 19525 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:00.752262 19557 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40438 (request call id 2240) took 1713 ms. Trace:
I20260709 13:06:00.752720 19557 rpcz_store.cc:276] 0709 13:05:59.038825 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:59.038945 (+   120us) service_pool.cc:224] Handling call
0709 13:05:59.094758 (+ 55813us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:00.327474 (+1232716us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:00.327654 (+   180us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:00.367496 (+ 39842us) log.cc:844] Serialized 26 byte log entry
0709 13:06:00.566347 (+198851us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:06:00.566386 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:00.592036 (+ 25650us) spinlock_profiling.cc:243] Waited 777 ms on lock 0x7b54000b8bd4. stack: 00007f4a79de9343 00007f4a79de9240 00007f4a797781d4 00007f4a834b6304 00007f4a834b6299 00007f4a7ce71571 00007f4a7cf08e01 00007f4a7cf0783e 00007f4a81ecc419 00007f4a7b443bd4 00007f4a7b443b62 00007f4a7b443a91 00007f4a7b443a0c 00007f4a7b442cc2 00007f4a7b24348c 00007f4a7b2428c6
0709 13:06:00.594951 (+  2915us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:00.751919 (+156968us) raft_consensus.cc:1685] finished
0709 13:06:00.751954 (+    35us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:00.752187 (+   233us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":6932,"raft.queue_time_us":107105,"raft.run_cpu_time_us":130,"raft.run_wall_time_us":6550,"spinlock_wait_cycles":1787108608,"thread_start_us":587348,"threads_started":2,"wal-append.queue_time_us":223393}
I20260709 13:06:00.755512 23140 leader_election.cc:290] T 3e1f505cb0f1427bbd698ac889d80821 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:06:00.756793 23194 leader_election.cc:290] T 14935b3ddf914369822e4a0547aaa355 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:06:00.743046 23324 raft_consensus.cc:2804] T ab43d85f64114d4ebf618930e43d9ed0 P 127766fc592545a4997f7790f50f6076 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:06:00.759563 23324 raft_consensus.cc:493] T ab43d85f64114d4ebf618930e43d9ed0 P 127766fc592545a4997f7790f50f6076 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:00.759922 23324 raft_consensus.cc:3060] T ab43d85f64114d4ebf618930e43d9ed0 P 127766fc592545a4997f7790f50f6076 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:06:00.763238 19551 raft_consensus.cc:2468] T 14935b3ddf914369822e4a0547aaa355 P e61c3a8f61bb48f8a963c9480e53c168 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 127766fc592545a4997f7790f50f6076 in term 9.
I20260709 13:06:00.735854 23316 raft_consensus.cc:2749] T d1e5873a19244c5ebbcd38e126796ee7 P 0473d2b2d01f4459b1e90fd12cc7840e [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:06:00.766728 19556 raft_consensus.cc:2468] T 309c3ca0ca4b4f3ba129752ea2cb293b P e61c3a8f61bb48f8a963c9480e53c168 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 127766fc592545a4997f7790f50f6076 in term 9.
I20260709 13:06:00.767562 19450 leader_election.cc:304] T e381f1d6b8184797ad142de49be225a8 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e; no voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:06:00.740425 23412 leader_election.cc:290] T 179fd671030940b4b4a4e24bcc4aba0a P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 11 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:06:00.774452 19450 leader_election.cc:304] T 21e14947d70440f19044d8f75c31e1f9 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e; no voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168
W20260709 13:06:00.776418 19375 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.3:36891, user_credentials={real_user=slave}} blocked reactor thread for 198800us
I20260709 13:06:00.777060 19481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab43d85f64114d4ebf618930e43d9ed0" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:06:00.791422 19481 raft_consensus.cc:2468] T ab43d85f64114d4ebf618930e43d9ed0 P 0473d2b2d01f4459b1e90fd12cc7840e [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 10.
I20260709 13:06:00.792054 19375 leader_election.cc:304] T 2725d2c4cb054f18b0fc8f735c15f6c2 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:06:00.777413 19485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7be9efa6559648dbb5a0f7684c4542d1" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 11 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:06:00.793136 19485 raft_consensus.cc:2410] T 7be9efa6559648dbb5a0f7684c4542d1 P 0473d2b2d01f4459b1e90fd12cc7840e [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e61c3a8f61bb48f8a963c9480e53c168 for term 11 because replica has last-logged OpId of term: 9 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 6.
I20260709 13:06:00.793072 19375 leader_election.cc:304] T b9f0d59553ad444883fcf5b5909f9798 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:06:00.778467 20105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e1085d23e8347fbbd5bce7542f4b1f4" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076"
I20260709 13:06:00.779347 19478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9f0d59553ad444883fcf5b5909f9798" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:06:00.778601 19483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62c6c134d3d24a1ab144dd9ee6bc3f64" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:06:00.793993 20105 raft_consensus.cc:3060] T 0e1085d23e8347fbbd5bce7542f4b1f4 P 127766fc592545a4997f7790f50f6076 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:06:00.781121 19482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cdf56e38bbc453d9438d359e5a69955" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:06:00.794601 19482 raft_consensus.cc:2468] T 0cdf56e38bbc453d9438d359e5a69955 P 0473d2b2d01f4459b1e90fd12cc7840e [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 11.
I20260709 13:06:00.775259 23407 raft_consensus.cc:2749] T e381f1d6b8184797ad142de49be225a8 P 0473d2b2d01f4459b1e90fd12cc7840e [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:06:00.773212 23414 consensus_meta.cc:287] T b9f0d59553ad444883fcf5b5909f9798 P 0473d2b2d01f4459b1e90fd12cc7840e: Time spent flushing consensus metadata: real 0.600s	user 0.012s	sys 0.001s
I20260709 13:06:00.770051 23436 raft_consensus.cc:2749] T 3e1f505cb0f1427bbd698ac889d80821 P 0473d2b2d01f4459b1e90fd12cc7840e [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:06:00.769074 23387 raft_consensus.cc:697] T 85c494af21f9457a85da47b9bc70c1fd P 127766fc592545a4997f7790f50f6076 [term 8 LEADER]: Becoming Leader. State: Replica: 127766fc592545a4997f7790f50f6076, State: Running, Role: LEADER
I20260709 13:06:00.786715 19486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f575b143b844aa096b50997dad3516a" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:06:00.797653 19486 raft_consensus.cc:2468] T 7f575b143b844aa096b50997dad3516a P 0473d2b2d01f4459b1e90fd12cc7840e [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 6.
I20260709 13:06:00.786463 19480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "309c3ca0ca4b4f3ba129752ea2cb293b" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:06:00.787776 19484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0afb57ae58a24a01850491d69f0213dd" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:06:00.796366 19483 raft_consensus.cc:2393] T 62c6c134d3d24a1ab144dd9ee6bc3f64 P 0473d2b2d01f4459b1e90fd12cc7840e [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate e61c3a8f61bb48f8a963c9480e53c168 in current term 10: Already voted for candidate 0473d2b2d01f4459b1e90fd12cc7840e in this term.
I20260709 13:06:00.799104 20108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70797e5783b5454ab0d0eea663e791e3" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: true dest_uuid: "127766fc592545a4997f7790f50f6076"
I20260709 13:06:00.802029 20108 raft_consensus.cc:3060] T 70797e5783b5454ab0d0eea663e791e3 P 127766fc592545a4997f7790f50f6076 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:06:00.803718 19478 raft_consensus.cc:2410] T b9f0d59553ad444883fcf5b5909f9798 P 0473d2b2d01f4459b1e90fd12cc7840e [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e61c3a8f61bb48f8a963c9480e53c168 for term 10 because replica has last-logged OpId of term: 9 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 5.
I20260709 13:06:00.805157 19483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2725d2c4cb054f18b0fc8f735c15f6c2" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
W20260709 13:06:00.806627 19377 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.2:46257, user_credentials={real_user=slave}} blocked reactor thread for 383560us
W20260709 13:06:00.807330 19377 leader_election.cc:336] T a08760e15aac4630a629431f56024dc8 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 11 election: RPC error from VoteRequest() call to peer 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257): Timed out: RequestConsensusVote RPC to 127.17.223.2:46257 timed out after 1.889s (SENT)
I20260709 13:06:00.807698 19377 leader_election.cc:304] T a08760e15aac4630a629431f56024dc8 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168
W20260709 13:06:00.808933 19377 leader_election.cc:336] T f93ee515a9c14139bf566522ed8232f3 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257): Timed out: RequestConsensusVote RPC to 127.17.223.2:46257 timed out after 1.892s (SENT)
I20260709 13:06:00.809350 19377 leader_election.cc:304] T f93ee515a9c14139bf566522ed8232f3 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:06:00.810273 19486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1b10566f45d4a7d9029858330e02d5b" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:06:00.812633 23442 raft_consensus.cc:515] T f93ee515a9c14139bf566522ed8232f3 P e61c3a8f61bb48f8a963c9480e53c168 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:00.816149 19523 leader_election.cc:304] T ed7fdbcb96d14d418db9ca90a792588a P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 127766fc592545a4997f7790f50f6076, e61c3a8f61bb48f8a963c9480e53c168; no voters: 0473d2b2d01f4459b1e90fd12cc7840e
I20260709 13:06:00.816706 20110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14935b3ddf914369822e4a0547aaa355" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:06:00.817306 20110 raft_consensus.cc:2468] T 14935b3ddf914369822e4a0547aaa355 P 127766fc592545a4997f7790f50f6076 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 9.
I20260709 13:06:00.818346 19523 leader_election.cc:304] T ece3db938bc649d4a40a51522ed5259c P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 127766fc592545a4997f7790f50f6076, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:06:00.823336 20104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f85fc4b527a48848e5faa083b604e36" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076"
I20260709 13:06:00.824162 20104 raft_consensus.cc:3060] T 1f85fc4b527a48848e5faa083b604e36 P 127766fc592545a4997f7790f50f6076 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:06:00.799327 19482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e1085d23e8347fbbd5bce7542f4b1f4" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:06:00.826330 19482 raft_consensus.cc:3060] T 0e1085d23e8347fbbd5bce7542f4b1f4 P 0473d2b2d01f4459b1e90fd12cc7840e [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:06:00.799880 19480 raft_consensus.cc:2393] T 309c3ca0ca4b4f3ba129752ea2cb293b P 0473d2b2d01f4459b1e90fd12cc7840e [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e61c3a8f61bb48f8a963c9480e53c168 in current term 9: Already voted for candidate 127766fc592545a4997f7790f50f6076 in this term.
I20260709 13:06:00.805998 19483 raft_consensus.cc:2468] T 2725d2c4cb054f18b0fc8f735c15f6c2 P 0473d2b2d01f4459b1e90fd12cc7840e [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 11.
I20260709 13:06:00.832144 19484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28af091831594f9d8e96482078cc7625" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:06:00.832662 19484 raft_consensus.cc:3060] T 28af091831594f9d8e96482078cc7625 P 0473d2b2d01f4459b1e90fd12cc7840e [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:06:00.836012 19523 leader_election.cc:304] T 70797e5783b5454ab0d0eea663e791e3 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 127766fc592545a4997f7790f50f6076, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:06:00.818969 23360 raft_consensus.cc:2804] T ed7fdbcb96d14d418db9ca90a792588a P e61c3a8f61bb48f8a963c9480e53c168 [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 13:06:00.848346 19450 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.3:36891, user_credentials={real_user=slave}} blocked reactor thread for 74013.4us
I20260709 13:06:00.848654 20112 raft_consensus.cc:1275] T 1efebf73c86e432baa55533136b6e12c P 127766fc592545a4997f7790f50f6076 [term 9 FOLLOWER]: Refusing update from remote peer e61c3a8f61bb48f8a963c9480e53c168: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:06:00.849514 19450 leader_election.cc:304] T ef32ce6fdd0e40d382c79974f30295c6 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e; no voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:06:00.846976 20109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff9b0eddd810459b82d91c60777c10eb" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:06:00.850970 20109 raft_consensus.cc:2468] T ff9b0eddd810459b82d91c60777c10eb P 127766fc592545a4997f7790f50f6076 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 9.
I20260709 13:06:00.844081 20110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a16f7501e2444fb86d4e2778e734e02" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
W20260709 13:06:00.854538 19526 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:00.851719 20110 raft_consensus.cc:2468] T 2a16f7501e2444fb86d4e2778e734e02 P 127766fc592545a4997f7790f50f6076 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 11.
I20260709 13:06:00.858737 20076 leader_election.cc:304] T 14935b3ddf914369822e4a0547aaa355 P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 127766fc592545a4997f7790f50f6076, e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:06:00.818830 23412 consensus_queue.cc:1048] T 96efeaaf1057492490e9a621f37e1a2d P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Connected to new peer: Peer: permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.012s
I20260709 13:06:00.866564 20105 raft_consensus.cc:2468] T 0e1085d23e8347fbbd5bce7542f4b1f4 P 127766fc592545a4997f7790f50f6076 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 8.
I20260709 13:06:00.798424 23469 raft_consensus.cc:2804] T 2725d2c4cb054f18b0fc8f735c15f6c2 P e5256d91808b47c195bc9b4dbd7f2b87 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:06:00.871521 19523 leader_election.cc:304] T 0e1085d23e8347fbbd5bce7542f4b1f4 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 127766fc592545a4997f7790f50f6076, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
W20260709 13:06:00.871176 19524 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:00.872443 19374 leader_election.cc:304] T ff9b0eddd810459b82d91c60777c10eb P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 127766fc592545a4997f7790f50f6076, e5256d91808b47c195bc9b4dbd7f2b87; no voters: 
W20260709 13:06:00.871733 19375 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.3:36891, user_credentials={real_user=slave}} blocked reactor thread for 78728.8us
I20260709 13:06:00.867812 19450 leader_election.cc:304] T 1dc5b3532fe54f74876d02beffa2c230 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:06:00.879771 19450 leader_election.cc:304] T 7be9efa6559648dbb5a0f7684c4542d1 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:06:00.848644 23360 raft_consensus.cc:493] T ed7fdbcb96d14d418db9ca90a792588a P e61c3a8f61bb48f8a963c9480e53c168 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:00.853155 23140 raft_consensus.cc:2764] T 70797e5783b5454ab0d0eea663e791e3 P e61c3a8f61bb48f8a963c9480e53c168 [term 11 FOLLOWER]: Leader pre-election decision vote started in defunct term 10: won
I20260709 13:06:00.848311 23190 raft_consensus.cc:2749] T a08760e15aac4630a629431f56024dc8 P e5256d91808b47c195bc9b4dbd7f2b87 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:06:00.859936 23340 raft_consensus.cc:2804] T ece3db938bc649d4a40a51522ed5259c P e61c3a8f61bb48f8a963c9480e53c168 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:06:00.882769 19479 raft_consensus.cc:1240] T a08760e15aac4630a629431f56024dc8 P 0473d2b2d01f4459b1e90fd12cc7840e [term 12 FOLLOWER]: Rejecting Update request from peer e61c3a8f61bb48f8a963c9480e53c168 for earlier term 11. Current term is 12. Ops: [11.7-11.7]
I20260709 13:06:00.858965 23407 raft_consensus.cc:2749] T 21e14947d70440f19044d8f75c31e1f9 P 0473d2b2d01f4459b1e90fd12cc7840e [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
W20260709 13:06:00.889065 19377 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.2:46257, user_credentials={real_user=slave}} blocked reactor thread for 80187.9us
I20260709 13:06:00.868634 23412 consensus_queue.cc:1243] T 96efeaaf1057492490e9a621f37e1a2d P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Peer 127766fc592545a4997f7790f50f6076 log is divergent from this leader: its last log entry 8.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
I20260709 13:06:00.892216 19482 raft_consensus.cc:2468] T 0e1085d23e8347fbbd5bce7542f4b1f4 P 0473d2b2d01f4459b1e90fd12cc7840e [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 8.
I20260709 13:06:00.892345 19450 leader_election.cc:304] T 309c3ca0ca4b4f3ba129752ea2cb293b P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:06:00.868047 23268 raft_consensus.cc:2804] T 14935b3ddf914369822e4a0547aaa355 P 127766fc592545a4997f7790f50f6076 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:06:00.874992 23414 raft_consensus.cc:2749] T ef32ce6fdd0e40d382c79974f30295c6 P 0473d2b2d01f4459b1e90fd12cc7840e [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:06:00.897415 19480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4509b76741dc428e9201c70c1658da13" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:06:00.863031 23468 raft_consensus.cc:2749] T f93ee515a9c14139bf566522ed8232f3 P e5256d91808b47c195bc9b4dbd7f2b87 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:06:00.900352 19482 raft_consensus.cc:1275] T 96efeaaf1057492490e9a621f37e1a2d P 0473d2b2d01f4459b1e90fd12cc7840e [term 11 FOLLOWER]: Refusing update from remote peer e61c3a8f61bb48f8a963c9480e53c168: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
W20260709 13:06:00.897935 19377 leader_election.cc:336] T b08304a0a02b42d7840c4e8ee9a6bd1a P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257): Timed out: RequestConsensusVote RPC to 127.17.223.2:46257 timed out after 1.926s (SENT)
I20260709 13:06:00.887143 23436 raft_consensus.cc:2804] T 1dc5b3532fe54f74876d02beffa2c230 P 0473d2b2d01f4459b1e90fd12cc7840e [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:06:00.887419 23360 raft_consensus.cc:3060] T ed7fdbcb96d14d418db9ca90a792588a P e61c3a8f61bb48f8a963c9480e53c168 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:06:00.910701 19478 raft_consensus.cc:1240] T 21e14947d70440f19044d8f75c31e1f9 P 0473d2b2d01f4459b1e90fd12cc7840e [term 10 FOLLOWER]: Rejecting Update request from peer e61c3a8f61bb48f8a963c9480e53c168 for earlier term 9. Current term is 10. Ops: []
I20260709 13:06:00.886822 23344 raft_consensus.cc:2804] T 0e1085d23e8347fbbd5bce7542f4b1f4 P e61c3a8f61bb48f8a963c9480e53c168 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:06:00.938035 19554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed7fdbcb96d14d418db9ca90a792588a" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:06:01.005610 19482 raft_consensus.cc:1240] T 775c229504194560ba9589bc2199b089 P 0473d2b2d01f4459b1e90fd12cc7840e [term 9 FOLLOWER]: Rejecting Update request from peer 127766fc592545a4997f7790f50f6076 for earlier term 8. Current term is 9. Ops: [8.8-8.8]
W20260709 13:06:01.005649 19375 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.3:36891, user_credentials={real_user=slave}} blocked reactor thread for 128562us
I20260709 13:06:01.013986 19482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc225c93219c45538b53a1bd3d387e4d" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:06:01.013986 19553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df751f992649444090e27965eb1af85d" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:06:01.005749 19479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c5eebf646ad445a9d1b1adc319d7b16" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
W20260709 13:06:01.007054 19525 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:01.015489 19553 raft_consensus.cc:2468] T df751f992649444090e27965eb1af85d P e61c3a8f61bb48f8a963c9480e53c168 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 12.
I20260709 13:06:01.016947 19480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed7fdbcb96d14d418db9ca90a792588a" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:06:01.017200 19556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b74109013a140ada21feeef92d6f563" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:06:00.877444 23413 consensus_queue.cc:1048] T 1efebf73c86e432baa55533136b6e12c P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Connected to new peer: Peer: permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.032s
I20260709 13:06:01.020607 19482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ec1c4ce15e04c7e8c283a62179f2a64" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:06:01.001343 23316 raft_consensus.cc:2764] T 309c3ca0ca4b4f3ba129752ea2cb293b P 0473d2b2d01f4459b1e90fd12cc7840e [term 9 FOLLOWER]: Leader pre-election decision vote started in defunct term 8: won
I20260709 13:06:01.029033 20108 raft_consensus.cc:2468] T 70797e5783b5454ab0d0eea663e791e3 P 127766fc592545a4997f7790f50f6076 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 11.
I20260709 13:06:01.021095 19482 raft_consensus.cc:2468] T 5ec1c4ce15e04c7e8c283a62179f2a64 P 0473d2b2d01f4459b1e90fd12cc7840e [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 127766fc592545a4997f7790f50f6076 in term 9.
I20260709 13:06:01.007015 23436 raft_consensus.cc:493] T 1dc5b3532fe54f74876d02beffa2c230 P 0473d2b2d01f4459b1e90fd12cc7840e [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:00.913549 19558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f575b143b844aa096b50997dad3516a" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:06:01.034986 19558 raft_consensus.cc:2410] T 7f575b143b844aa096b50997dad3516a P e61c3a8f61bb48f8a963c9480e53c168 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0473d2b2d01f4459b1e90fd12cc7840e for term 7 because replica has last-logged OpId of term: 6 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 4.
I20260709 13:06:01.035331 20104 raft_consensus.cc:2468] T 1f85fc4b527a48848e5faa083b604e36 P 127766fc592545a4997f7790f50f6076 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 8.
I20260709 13:06:01.039047 19479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "179fd671030940b4b4a4e24bcc4aba0a" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:06:01.039783 19479 raft_consensus.cc:3060] T 179fd671030940b4b4a4e24bcc4aba0a P 0473d2b2d01f4459b1e90fd12cc7840e [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:06:00.912988 19551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1efebf73c86e432baa55533136b6e12c" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 10 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:06:00.889742 23340 raft_consensus.cc:493] T ece3db938bc649d4a40a51522ed5259c P e61c3a8f61bb48f8a963c9480e53c168 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:01.017566 19480 raft_consensus.cc:2468] T ed7fdbcb96d14d418db9ca90a792588a P 0473d2b2d01f4459b1e90fd12cc7840e [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 127766fc592545a4997f7790f50f6076 in term 7.
I20260709 13:06:01.017892 19560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46c5bfeecc314717bffe987e6844b6d0" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 17 candidate_status { last_received { term: 15 index: 6 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:06:00.896883 23268 raft_consensus.cc:493] T 14935b3ddf914369822e4a0547aaa355 P 127766fc592545a4997f7790f50f6076 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:00.897099 23403 raft_consensus.cc:2804] T 7be9efa6559648dbb5a0f7684c4542d1 P 0473d2b2d01f4459b1e90fd12cc7840e [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:06:01.017366 19557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76cb037fc9064d13b59a8969d897ce8c" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:06:00.888435 23218 raft_consensus.cc:2804] T b9f0d59553ad444883fcf5b5909f9798 P e5256d91808b47c195bc9b4dbd7f2b87 [term 10 FOLLOWER]: Leader election won for term 10
W20260709 13:06:01.032820 19375 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:01.048381 19557 raft_consensus.cc:2410] T 76cb037fc9064d13b59a8969d897ce8c P e61c3a8f61bb48f8a963c9480e53c168 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0473d2b2d01f4459b1e90fd12cc7840e for term 10 because replica has last-logged OpId of term: 9 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 4.
I20260709 13:06:01.049316 19408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76cb037fc9064d13b59a8969d897ce8c" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:06:01.032927 19523 leader_election.cc:304] T 70797e5783b5454ab0d0eea663e791e3 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 127766fc592545a4997f7790f50f6076, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:06:01.051035 19403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a16f7501e2444fb86d4e2778e734e02" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
I20260709 13:06:01.053025 19407 raft_consensus.cc:1275] T 40e1e16737a842ee936002830f36882e P e5256d91808b47c195bc9b4dbd7f2b87 [term 14 FOLLOWER]: Refusing update from remote peer e61c3a8f61bb48f8a963c9480e53c168: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 14 index: 7. (index mismatch)
I20260709 13:06:01.054211 19404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "179fd671030940b4b4a4e24bcc4aba0a" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:06:01.029882 23443 raft_consensus.cc:2804] T ff9b0eddd810459b82d91c60777c10eb P e5256d91808b47c195bc9b4dbd7f2b87 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:06:01.055051 19404 raft_consensus.cc:2468] T 179fd671030940b4b4a4e24bcc4aba0a P e5256d91808b47c195bc9b4dbd7f2b87 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 10.
I20260709 13:06:01.057848 19551 raft_consensus.cc:1240] T f93ee515a9c14139bf566522ed8232f3 P e61c3a8f61bb48f8a963c9480e53c168 [term 14 FOLLOWER]: Rejecting Update request from peer 0473d2b2d01f4459b1e90fd12cc7840e for earlier term 13. Current term is 14. Ops: [13.6-13.6]
I20260709 13:06:00.914052 19552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab43d85f64114d4ebf618930e43d9ed0" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:06:01.058869 19552 raft_consensus.cc:2468] T ab43d85f64114d4ebf618930e43d9ed0 P e61c3a8f61bb48f8a963c9480e53c168 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 10.
I20260709 13:06:01.044108 19482 raft_consensus.cc:1275] T 1efebf73c86e432baa55533136b6e12c P 0473d2b2d01f4459b1e90fd12cc7840e [term 9 FOLLOWER]: Refusing update from remote peer e61c3a8f61bb48f8a963c9480e53c168: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:06:01.059258 19551 raft_consensus.cc:1275] T 65d8cb8d6ec64f459d5a47cefab10acf P e61c3a8f61bb48f8a963c9480e53c168 [term 8 FOLLOWER]: Refusing update from remote peer e5256d91808b47c195bc9b4dbd7f2b87: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260709 13:06:00.933892 20078 leader_election.cc:304] T 0afb57ae58a24a01850491d69f0213dd P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 127766fc592545a4997f7790f50f6076; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168
W20260709 13:06:01.059322 19377 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.2:46257, user_credentials={real_user=slave}} blocked reactor thread for 167831us
W20260709 13:06:01.062660 20078 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.2:46257, user_credentials={real_user=slave}} blocked reactor thread for 128912us
I20260709 13:06:01.062779 19480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e1f505cb0f1427bbd698ac889d80821" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:06:01.063359 19480 raft_consensus.cc:2468] T 3e1f505cb0f1427bbd698ac889d80821 P 0473d2b2d01f4459b1e90fd12cc7840e [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 10.
I20260709 13:06:01.063755 20078 leader_election.cc:400] T 62c6c134d3d24a1ab144dd9ee6bc3f64 P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 9 pre-election: Vote denied by peer 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257) with higher term. Message: Invalid argument: T 62c6c134d3d24a1ab144dd9ee6bc3f64 P 0473d2b2d01f4459b1e90fd12cc7840e [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 127766fc592545a4997f7790f50f6076 for earlier term 9. Current term is 10.
W20260709 13:06:01.043853 23473 log.cc:927] Time spent T e381f1d6b8184797ad142de49be225a8 P 0473d2b2d01f4459b1e90fd12cc7840e: Append to log took a long time: real 0.165s	user 0.001s	sys 0.000s
I20260709 13:06:01.060346 19407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85c494af21f9457a85da47b9bc70c1fd" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:06:01.060410 19409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86a6797bdfe94fa496c050ceae4bd0d9" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 11 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:06:01.072068 19406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70797e5783b5454ab0d0eea663e791e3" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:06:01.072410 19409 raft_consensus.cc:2410] T 86a6797bdfe94fa496c050ceae4bd0d9 P e5256d91808b47c195bc9b4dbd7f2b87 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e61c3a8f61bb48f8a963c9480e53c168 for term 11 because replica has last-logged OpId of term: 10 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 4.
I20260709 13:06:01.073351 19404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "217b5fae677b4971b3bbd2f357a1f7ff" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:06:00.891806 23387 consensus_queue.cc:237] T 85c494af21f9457a85da47b9bc70c1fd P 127766fc592545a4997f7790f50f6076 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:01.047614 23340 raft_consensus.cc:3060] T ece3db938bc649d4a40a51522ed5259c P e61c3a8f61bb48f8a963c9480e53c168 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:06:01.069705 19408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa8650e71aa14778b3d73721fc50d9fc" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:06:01.081820 19409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab43d85f64114d4ebf618930e43d9ed0" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:06:01.082165 19408 raft_consensus.cc:2410] T fa8650e71aa14778b3d73721fc50d9fc P e5256d91808b47c195bc9b4dbd7f2b87 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e61c3a8f61bb48f8a963c9480e53c168 for term 12 because replica has last-logged OpId of term: 11 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 5.
I20260709 13:06:01.045058 19553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a16f7501e2444fb86d4e2778e734e02" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:06:01.082446 19409 raft_consensus.cc:2468] T ab43d85f64114d4ebf618930e43d9ed0 P e5256d91808b47c195bc9b4dbd7f2b87 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 10.
I20260709 13:06:01.082862 19553 raft_consensus.cc:2468] T 2a16f7501e2444fb86d4e2778e734e02 P e61c3a8f61bb48f8a963c9480e53c168 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 11.
I20260709 13:06:01.078534 19449 leader_election.cc:304] T bc225c93219c45538b53a1bd3d387e4d P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e; no voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:06:01.032765 23344 raft_consensus.cc:697] T 0e1085d23e8347fbbd5bce7542f4b1f4 P e61c3a8f61bb48f8a963c9480e53c168 [term 8 LEADER]: Becoming Leader. State: Replica: e61c3a8f61bb48f8a963c9480e53c168, State: Running, Role: LEADER
I20260709 13:06:01.037561 23436 raft_consensus.cc:3060] T 1dc5b3532fe54f74876d02beffa2c230 P 0473d2b2d01f4459b1e90fd12cc7840e [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:06:01.071215 19405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b08304a0a02b42d7840c4e8ee9a6bd1a" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:06:01.084209 19405 raft_consensus.cc:2410] T b08304a0a02b42d7840c4e8ee9a6bd1a P e5256d91808b47c195bc9b4dbd7f2b87 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e61c3a8f61bb48f8a963c9480e53c168 for term 13 because replica has last-logged OpId of term: 12 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 7.
I20260709 13:06:01.074156 19407 raft_consensus.cc:2393] T 85c494af21f9457a85da47b9bc70c1fd P e5256d91808b47c195bc9b4dbd7f2b87 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e61c3a8f61bb48f8a963c9480e53c168 in current term 8: Already voted for candidate 127766fc592545a4997f7790f50f6076 in this term.
I20260709 13:06:01.064109 20078 leader_election.cc:403] T 62c6c134d3d24a1ab144dd9ee6bc3f64 P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 9 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:06:01.047500 23268 raft_consensus.cc:3060] T 14935b3ddf914369822e4a0547aaa355 P 127766fc592545a4997f7790f50f6076 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:06:01.047729 23403 raft_consensus.cc:493] T 7be9efa6559648dbb5a0f7684c4542d1 P 0473d2b2d01f4459b1e90fd12cc7840e [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:06:01.067301 19374 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.4:43121, user_credentials={real_user=slave}} blocked reactor thread for 194953us
I20260709 13:06:01.070741 23425 raft_consensus.cc:2749] T 0afb57ae58a24a01850491d69f0213dd P 127766fc592545a4997f7790f50f6076 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:06:01.086730 19374 leader_election.cc:304] T 2a16f7501e2444fb86d4e2778e734e02 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 127766fc592545a4997f7790f50f6076, e5256d91808b47c195bc9b4dbd7f2b87; no voters: 
I20260709 13:06:01.088989 19403 raft_consensus.cc:2468] T 2a16f7501e2444fb86d4e2778e734e02 P e5256d91808b47c195bc9b4dbd7f2b87 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 11.
I20260709 13:06:01.089632 19480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14935b3ddf914369822e4a0547aaa355" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:06:01.057493 23093 raft_consensus.cc:2804] T 70797e5783b5454ab0d0eea663e791e3 P e61c3a8f61bb48f8a963c9480e53c168 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:06:01.090709 19449 leader_election.cc:304] T 2b74109013a140ada21feeef92d6f563 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87; no voters: 
I20260709 13:06:01.058606 23443 raft_consensus.cc:493] T ff9b0eddd810459b82d91c60777c10eb P e5256d91808b47c195bc9b4dbd7f2b87 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:01.093079 19480 raft_consensus.cc:2468] T 14935b3ddf914369822e4a0547aaa355 P 0473d2b2d01f4459b1e90fd12cc7840e [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 9.
I20260709 13:06:01.099113 19402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7be9efa6559648dbb5a0f7684c4542d1" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 11 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:06:01.100088 19402 raft_consensus.cc:2468] T 7be9efa6559648dbb5a0f7684c4542d1 P e5256d91808b47c195bc9b4dbd7f2b87 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 10.
I20260709 13:06:01.110072 19479 raft_consensus.cc:2468] T 179fd671030940b4b4a4e24bcc4aba0a P 0473d2b2d01f4459b1e90fd12cc7840e [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 11.
I20260709 13:06:01.111552 23480 raft_consensus.cc:493] T fa8650e71aa14778b3d73721fc50d9fc P e5256d91808b47c195bc9b4dbd7f2b87 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 0473d2b2d01f4459b1e90fd12cc7840e)
I20260709 13:06:01.112179 23457 raft_consensus.cc:493] T b08304a0a02b42d7840c4e8ee9a6bd1a P e5256d91808b47c195bc9b4dbd7f2b87 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 0473d2b2d01f4459b1e90fd12cc7840e)
I20260709 13:06:01.112298 23480 raft_consensus.cc:515] T fa8650e71aa14778b3d73721fc50d9fc P e5256d91808b47c195bc9b4dbd7f2b87 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:01.112725 23457 raft_consensus.cc:515] T b08304a0a02b42d7840c4e8ee9a6bd1a P e5256d91808b47c195bc9b4dbd7f2b87 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:01.128374 20108 raft_consensus.cc:1240] T 70797e5783b5454ab0d0eea663e791e3 P 127766fc592545a4997f7790f50f6076 [term 11 FOLLOWER]: Rejecting Update request from peer e5256d91808b47c195bc9b4dbd7f2b87 for earlier term 10. Current term is 11. Ops: []
I20260709 13:06:01.130096 19407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9f0d59553ad444883fcf5b5909f9798" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:06:01.076491 23469 raft_consensus.cc:697] T 2725d2c4cb054f18b0fc8f735c15f6c2 P e5256d91808b47c195bc9b4dbd7f2b87 [term 12 LEADER]: Becoming Leader. State: Replica: e5256d91808b47c195bc9b4dbd7f2b87, State: Running, Role: LEADER
I20260709 13:06:01.092459 23403 raft_consensus.cc:3060] T 7be9efa6559648dbb5a0f7684c4542d1 P 0473d2b2d01f4459b1e90fd12cc7840e [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:06:01.091075 23414 raft_consensus.cc:2749] T bc225c93219c45538b53a1bd3d387e4d P 0473d2b2d01f4459b1e90fd12cc7840e [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:06:01.136003 19403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ece3db938bc649d4a40a51522ed5259c" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:06:01.141636 19402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "833a2f0775ed407a94b8924ce50adb63" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:06:01.095237 23218 raft_consensus.cc:697] T b9f0d59553ad444883fcf5b5909f9798 P e5256d91808b47c195bc9b4dbd7f2b87 [term 10 LEADER]: Becoming Leader. State: Replica: e5256d91808b47c195bc9b4dbd7f2b87, State: Running, Role: LEADER
W20260709 13:06:01.145725 19376 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:01.141317 20078 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.2:46257, user_credentials={real_user=slave}} blocked reactor thread for 77689.5us
I20260709 13:06:01.146821 20078 leader_election.cc:304] T 7be9efa6559648dbb5a0f7684c4542d1 P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, 127766fc592545a4997f7790f50f6076, e5256d91808b47c195bc9b4dbd7f2b87; no voters: e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:06:01.148356 19404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46c5bfeecc314717bffe987e6844b6d0" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 17 candidate_status { last_received { term: 15 index: 6 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:06:01.119112 23443 raft_consensus.cc:3060] T ff9b0eddd810459b82d91c60777c10eb P e5256d91808b47c195bc9b4dbd7f2b87 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:06:01.150497 19409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cdf56e38bbc453d9438d359e5a69955" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:06:01.152071 20078 leader_election.cc:304] T 1efebf73c86e432baa55533136b6e12c P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, 127766fc592545a4997f7790f50f6076; no voters: 
I20260709 13:06:01.153728 23335 raft_consensus.cc:2804] T 2b74109013a140ada21feeef92d6f563 P 0473d2b2d01f4459b1e90fd12cc7840e [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:06:01.156513 20078 leader_election.cc:304] T 14efcc79969f41babe5529c22d59156d P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 127766fc592545a4997f7790f50f6076; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87
W20260709 13:06:01.157307 19526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.2:46257, user_credentials={real_user=slave}} blocked reactor thread for 52785.2us
I20260709 13:06:01.159457 19404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "309c3ca0ca4b4f3ba129752ea2cb293b" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:06:01.160249 19404 raft_consensus.cc:2393] T 309c3ca0ca4b4f3ba129752ea2cb293b P e5256d91808b47c195bc9b4dbd7f2b87 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e61c3a8f61bb48f8a963c9480e53c168 in current term 9: Already voted for candidate 127766fc592545a4997f7790f50f6076 in this term.
I20260709 13:06:01.160053 19526 leader_election.cc:304] T 217b5fae677b4971b3bbd2f357a1f7ff P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:06:01.161345 19526 leader_election.cc:304] T ab43d85f64114d4ebf618930e43d9ed0 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, 127766fc592545a4997f7790f50f6076, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:06:01.162212 19526 leader_election.cc:304] T 7be9efa6559648dbb5a0f7684c4542d1 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: e61c3a8f61bb48f8a963c9480e53c168; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, 127766fc592545a4997f7790f50f6076
I20260709 13:06:01.135121 23478 raft_consensus.cc:2804] T 2a16f7501e2444fb86d4e2778e734e02 P e5256d91808b47c195bc9b4dbd7f2b87 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:06:01.163585 19405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f575b143b844aa096b50997dad3516a" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:06:01.163853 19526 leader_election.cc:304] T 0cdf56e38bbc453d9438d359e5a69955 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:06:01.163666 19402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df751f992649444090e27965eb1af85d" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:06:01.168969 19526 leader_election.cc:304] T 7f575b143b844aa096b50997dad3516a P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:06:01.169631 19405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa731b585f684a7fb2d106c50f143b83" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:06:01.169750 22758 raft_consensus.cc:2804] T 7f575b143b844aa096b50997dad3516a P e61c3a8f61bb48f8a963c9480e53c168 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:06:01.169845 19526 leader_election.cc:304] T 0afb57ae58a24a01850491d69f0213dd P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e61c3a8f61bb48f8a963c9480e53c168; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, 127766fc592545a4997f7790f50f6076
I20260709 13:06:01.170352 22758 raft_consensus.cc:493] T 7f575b143b844aa096b50997dad3516a P e61c3a8f61bb48f8a963c9480e53c168 [term 6 FOLLOWER]: Starting leader election (detected failure of leader e5256d91808b47c195bc9b4dbd7f2b87)
I20260709 13:06:01.170903 22758 raft_consensus.cc:3060] T 7f575b143b844aa096b50997dad3516a P e61c3a8f61bb48f8a963c9480e53c168 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:06:01.145789 23093 raft_consensus.cc:697] T 70797e5783b5454ab0d0eea663e791e3 P e61c3a8f61bb48f8a963c9480e53c168 [term 11 LEADER]: Becoming Leader. State: Replica: e61c3a8f61bb48f8a963c9480e53c168, State: Running, Role: LEADER
I20260709 13:06:01.166501 23343 raft_consensus.cc:2749] T 7be9efa6559648dbb5a0f7684c4542d1 P e61c3a8f61bb48f8a963c9480e53c168 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:06:01.157773 23425 raft_consensus.cc:2764] T 7be9efa6559648dbb5a0f7684c4542d1 P 127766fc592545a4997f7790f50f6076 [term 10 FOLLOWER]: Leader pre-election decision vote started in defunct term 9: won
I20260709 13:06:01.165925 23478 raft_consensus.cc:493] T 2a16f7501e2444fb86d4e2778e734e02 P e5256d91808b47c195bc9b4dbd7f2b87 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:01.177922 23104 raft_consensus.cc:493] T ff9b0eddd810459b82d91c60777c10eb P 0473d2b2d01f4459b1e90fd12cc7840e [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:01.167667 23140 raft_consensus.cc:2804] T ab43d85f64114d4ebf618930e43d9ed0 P e61c3a8f61bb48f8a963c9480e53c168 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:06:01.187505 19402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65d8cb8d6ec64f459d5a47cefab10acf" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:06:01.195943 19484 raft_consensus.cc:2468] T 28af091831594f9d8e96482078cc7625 P 0473d2b2d01f4459b1e90fd12cc7840e [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 11.
I20260709 13:06:01.167994 23412 raft_consensus.cc:2804] T 217b5fae677b4971b3bbd2f357a1f7ff P e61c3a8f61bb48f8a963c9480e53c168 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:06:01.207139 23412 raft_consensus.cc:493] T 217b5fae677b4971b3bbd2f357a1f7ff P e61c3a8f61bb48f8a963c9480e53c168 [term 7 FOLLOWER]: Starting leader election (detected failure of leader e5256d91808b47c195bc9b4dbd7f2b87)
I20260709 13:06:01.207717 23412 raft_consensus.cc:3060] T 217b5fae677b4971b3bbd2f357a1f7ff P e61c3a8f61bb48f8a963c9480e53c168 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:06:01.211753 19484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b74109013a140ada21feeef92d6f563" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:06:01.185338 19449 leader_election.cc:304] T 775c229504194560ba9589bc2199b089 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e; no voters: 127766fc592545a4997f7790f50f6076, e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:06:01.204353 19411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1b10566f45d4a7d9029858330e02d5b" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
I20260709 13:06:01.213016 19450 leader_election.cc:304] T df751f992649444090e27965eb1af85d P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:06:01.213734 19411 raft_consensus.cc:3060] T f1b10566f45d4a7d9029858330e02d5b P e5256d91808b47c195bc9b4dbd7f2b87 [term 10 FOLLOWER]: Advancing to term 12
I20260709 13:06:01.214944 19450 leader_election.cc:304] T 76cb037fc9064d13b59a8969d897ce8c P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e; no voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:06:01.177057 23194 raft_consensus.cc:2804] T 0cdf56e38bbc453d9438d359e5a69955 P e61c3a8f61bb48f8a963c9480e53c168 [term 11 FOLLOWER]: Leader pre-election won for term 12
W20260709 13:06:01.220533 19377 connection.cc:256] RPC call timeout handler was delayed by -1.9826544740000145s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1704s for a response
W20260709 13:06:01.220949 19377 connection.cc:256] RPC call timeout handler was delayed by -1.9698403769999686s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2926s for a response
W20260709 13:06:01.221299 19377 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.17.223.2:46257 timed out after 1.639s (SENT) [suppressed 22 similar messages]
I20260709 13:06:01.176040 23457 leader_election.cc:290] T b08304a0a02b42d7840c4e8ee9a6bd1a P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:06:01.223181 19405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28af091831594f9d8e96482078cc7625" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
I20260709 13:06:01.227154 19405 raft_consensus.cc:3060] T 28af091831594f9d8e96482078cc7625 P e5256d91808b47c195bc9b4dbd7f2b87 [term 9 FOLLOWER]: Advancing to term 11
I20260709 13:06:01.228346 23093 consensus_queue.cc:237] T 70797e5783b5454ab0d0eea663e791e3 P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:01.230371 23480 leader_election.cc:290] T fa8650e71aa14778b3d73721fc50d9fc P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:06:01.223863 22758 raft_consensus.cc:515] T 7f575b143b844aa096b50997dad3516a P e61c3a8f61bb48f8a963c9480e53c168 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
W20260709 13:06:01.221861 19377 leader_election.cc:336] T 76cb037fc9064d13b59a8969d897ce8c P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257): Timed out: RequestConsensusVote RPC to 127.17.223.2:46257 timed out after 1.954s (SENT)
I20260709 13:06:01.203172 23478 raft_consensus.cc:3060] T 2a16f7501e2444fb86d4e2778e734e02 P e5256d91808b47c195bc9b4dbd7f2b87 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:06:01.274032 22758 leader_election.cc:290] T 7f575b143b844aa096b50997dad3516a P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 7 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:06:01.205874 23140 raft_consensus.cc:493] T ab43d85f64114d4ebf618930e43d9ed0 P e61c3a8f61bb48f8a963c9480e53c168 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:01.223623 23351 raft_consensus.cc:2804] T df751f992649444090e27965eb1af85d P 0473d2b2d01f4459b1e90fd12cc7840e [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:06:01.205466 23456 raft_consensus.cc:493] T 86a6797bdfe94fa496c050ceae4bd0d9 P e5256d91808b47c195bc9b4dbd7f2b87 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 0473d2b2d01f4459b1e90fd12cc7840e)
I20260709 13:06:01.288254 19374 leader_election.cc:304] T 1f85fc4b527a48848e5faa083b604e36 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 127766fc592545a4997f7790f50f6076, e5256d91808b47c195bc9b4dbd7f2b87; no voters: 
W20260709 13:06:01.289608 19526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.2:46257, user_credentials={real_user=slave}} blocked reactor thread for 119839us
I20260709 13:06:01.323006 19526 leader_election.cc:304] T 309c3ca0ca4b4f3ba129752ea2cb293b P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: e61c3a8f61bb48f8a963c9480e53c168; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, 127766fc592545a4997f7790f50f6076
I20260709 13:06:01.278355 19405 raft_consensus.cc:2468] T 28af091831594f9d8e96482078cc7625 P e5256d91808b47c195bc9b4dbd7f2b87 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 11.
I20260709 13:06:01.294330 19406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2725d2c4cb054f18b0fc8f735c15f6c2" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:06:01.223105 23475 raft_consensus.cc:493] T 1a61655d99124a29b486ba4a5b37faea P e5256d91808b47c195bc9b4dbd7f2b87 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader e61c3a8f61bb48f8a963c9480e53c168)
W20260709 13:06:01.328595 19377 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.2:46257, user_credentials={real_user=slave}} blocked reactor thread for 106741us
W20260709 13:06:01.285866 23482 log.cc:927] Time spent T 21e14947d70440f19044d8f75c31e1f9 P e5256d91808b47c195bc9b4dbd7f2b87: Append to log took a long time: real 0.060s	user 0.000s	sys 0.000s
I20260709 13:06:01.222460 23194 raft_consensus.cc:493] T 0cdf56e38bbc453d9438d359e5a69955 P e61c3a8f61bb48f8a963c9480e53c168 [term 11 FOLLOWER]: Starting leader election (detected failure of leader e5256d91808b47c195bc9b4dbd7f2b87)
I20260709 13:06:01.233317 23425 raft_consensus.cc:2804] T 1efebf73c86e432baa55533136b6e12c P 127766fc592545a4997f7790f50f6076 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:06:01.224982 23474 raft_consensus.cc:493] T edd7d470b5014c9489be7f41f64355c9 P e5256d91808b47c195bc9b4dbd7f2b87 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader e61c3a8f61bb48f8a963c9480e53c168)
I20260709 13:06:01.295661 23140 raft_consensus.cc:3060] T ab43d85f64114d4ebf618930e43d9ed0 P e61c3a8f61bb48f8a963c9480e53c168 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:06:01.187296 23218 consensus_queue.cc:237] T b9f0d59553ad444883fcf5b5909f9798 P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:01.275193 23407 raft_consensus.cc:2749] T 76cb037fc9064d13b59a8969d897ce8c P 0473d2b2d01f4459b1e90fd12cc7840e [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:06:01.216787 23104 raft_consensus.cc:515] T ff9b0eddd810459b82d91c60777c10eb P 0473d2b2d01f4459b1e90fd12cc7840e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:01.341734 23104 leader_election.cc:290] T ff9b0eddd810459b82d91c60777c10eb P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:06:01.342531 19406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e1f505cb0f1427bbd698ac889d80821" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:06:01.343753 19406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "179fd671030940b4b4a4e24bcc4aba0a" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
I20260709 13:06:01.344256 19406 raft_consensus.cc:3060] T 179fd671030940b4b4a4e24bcc4aba0a P e5256d91808b47c195bc9b4dbd7f2b87 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:06:01.346762 23414 raft_consensus.cc:2749] T 775c229504194560ba9589bc2199b089 P 0473d2b2d01f4459b1e90fd12cc7840e [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:06:01.328688 23480 raft_consensus.cc:2804] T 1f85fc4b527a48848e5faa083b604e36 P e5256d91808b47c195bc9b4dbd7f2b87 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:06:01.335960 23475 raft_consensus.cc:515] T 1a61655d99124a29b486ba4a5b37faea P e5256d91808b47c195bc9b4dbd7f2b87 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:01.335640 23476 consensus_queue.cc:1059] T 70797e5783b5454ab0d0eea663e791e3 P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false }, Status: INVALID_TERM, Last received: 10.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.014s
I20260709 13:06:01.349820 19558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70797e5783b5454ab0d0eea663e791e3" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:06:01.349354 19555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1efebf73c86e432baa55533136b6e12c" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:06:01.350430 23476 raft_consensus.cc:3055] T 70797e5783b5454ab0d0eea663e791e3 P e5256d91808b47c195bc9b4dbd7f2b87 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:06:01.350831 23476 raft_consensus.cc:740] T 70797e5783b5454ab0d0eea663e791e3 P e5256d91808b47c195bc9b4dbd7f2b87 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: e5256d91808b47c195bc9b4dbd7f2b87, State: Running, Role: LEADER
I20260709 13:06:01.328087 23456 raft_consensus.cc:515] T 86a6797bdfe94fa496c050ceae4bd0d9 P e5256d91808b47c195bc9b4dbd7f2b87 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:01.351646 23476 consensus_queue.cc:260] T 70797e5783b5454ab0d0eea663e791e3 P e5256d91808b47c195bc9b4dbd7f2b87 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
W20260709 13:06:01.352764 23420 consensus_meta.cc:287] T ece3db938bc649d4a40a51522ed5259c P e5256d91808b47c195bc9b4dbd7f2b87: Time spent flushing consensus metadata: real 0.832s	user 0.008s	sys 0.004s
W20260709 13:06:01.353471 23484 log.cc:927] Time spent T 2b74109013a140ada21feeef92d6f563 P 0473d2b2d01f4459b1e90fd12cc7840e: Append to log took a long time: real 0.065s	user 0.000s	sys 0.000s
I20260709 13:06:01.353267 23420 raft_consensus.cc:515] T ece3db938bc649d4a40a51522ed5259c P e5256d91808b47c195bc9b4dbd7f2b87 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:01.203466 23469 consensus_queue.cc:237] T 2725d2c4cb054f18b0fc8f735c15f6c2 P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.5, Last appended by leader: 5, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:01.176548 23344 consensus_queue.cc:237] T 0e1085d23e8347fbbd5bce7542f4b1f4 P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:01.329147 22758 raft_consensus.cc:2749] T 309c3ca0ca4b4f3ba129752ea2cb293b P e61c3a8f61bb48f8a963c9480e53c168 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:06:01.375072 19524 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:01.375982 19558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a16f7501e2444fb86d4e2778e734e02" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 12 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:06:01.377126 19558 raft_consensus.cc:2410] T 2a16f7501e2444fb86d4e2778e734e02 P e61c3a8f61bb48f8a963c9480e53c168 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 127766fc592545a4997f7790f50f6076 for term 12 because replica has last-logged OpId of term: 10 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 8.
I20260709 13:06:01.378155 19558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "309c3ca0ca4b4f3ba129752ea2cb293b" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
W20260709 13:06:01.330540 19449 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.4:43121, user_credentials={real_user=slave}} blocked reactor thread for 145307us
I20260709 13:06:01.380005 19449 leader_election.cc:304] T 48824d5acfbc485ebf8c2d944e7202de P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, 127766fc592545a4997f7790f50f6076; no voters: e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:06:01.380900 19558 raft_consensus.cc:2376] T 309c3ca0ca4b4f3ba129752ea2cb293b P e61c3a8f61bb48f8a963c9480e53c168 [term 9 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 127766fc592545a4997f7790f50f6076 in term 9. Re-sending same reply.
I20260709 13:06:01.381084 19555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa731b585f684a7fb2d106c50f143b83" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:06:01.332553 19405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc225c93219c45538b53a1bd3d387e4d" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
W20260709 13:06:01.333657 19377 leader_election.cc:336] T 775c229504194560ba9589bc2199b089 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257): Timed out: RequestConsensusVote RPC to 127.17.223.2:46257 timed out after 1.970s (SENT)
I20260709 13:06:01.296358 23351 raft_consensus.cc:493] T df751f992649444090e27965eb1af85d P 0473d2b2d01f4459b1e90fd12cc7840e [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:06:01.327389 23471 log.cc:927] Time spent T 0afb57ae58a24a01850491d69f0213dd P 0473d2b2d01f4459b1e90fd12cc7840e: Append to log took a long time: real 0.279s	user 0.001s	sys 0.000s
I20260709 13:06:01.335367 23425 raft_consensus.cc:493] T 1efebf73c86e432baa55533136b6e12c P 127766fc592545a4997f7790f50f6076 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:01.356261 19403 raft_consensus.cc:2393] T ece3db938bc649d4a40a51522ed5259c P e5256d91808b47c195bc9b4dbd7f2b87 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e61c3a8f61bb48f8a963c9480e53c168 in current term 10: Already voted for candidate e5256d91808b47c195bc9b4dbd7f2b87 in this term.
I20260709 13:06:01.349272 19553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85c494af21f9457a85da47b9bc70c1fd" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:06:01.392879 19449 leader_election.cc:304] T 62c6c134d3d24a1ab144dd9ee6bc3f64 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e; no voters: 127766fc592545a4997f7790f50f6076, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:06:01.393950 19553 raft_consensus.cc:3060] T 85c494af21f9457a85da47b9bc70c1fd P e61c3a8f61bb48f8a963c9480e53c168 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:06:01.334980 23194 raft_consensus.cc:3060] T 0cdf56e38bbc453d9438d359e5a69955 P e61c3a8f61bb48f8a963c9480e53c168 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:06:01.342278 23104 consensus_queue.cc:1059] T f93ee515a9c14139bf566522ed8232f3 P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 }, Status: INVALID_TERM, Last received: 12.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:06:01.407859 19555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "833a2f0775ed407a94b8924ce50adb63" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
W20260709 13:06:01.416471 20075 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.1:40321, user_credentials={real_user=slave}} blocked reactor thread for 288527us
W20260709 13:06:01.430687 23479 log.cc:927] Time spent T b08304a0a02b42d7840c4e8ee9a6bd1a P e61c3a8f61bb48f8a963c9480e53c168: Append to log took a long time: real 0.097s	user 0.000s	sys 0.000s
I20260709 13:06:01.455842 19404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70797e5783b5454ab0d0eea663e791e3" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: true dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
I20260709 13:06:01.459285 19523 leader_election.cc:304] T 86a6797bdfe94fa496c050ceae4bd0d9 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e61c3a8f61bb48f8a963c9480e53c168; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:06:01.395045 19449 leader_election.cc:304] T 1efebf73c86e432baa55533136b6e12c P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e; no voters: 127766fc592545a4997f7790f50f6076, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:06:01.461961 19523 leader_election.cc:304] T b08304a0a02b42d7840c4e8ee9a6bd1a P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e61c3a8f61bb48f8a963c9480e53c168; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:06:01.464506 19523 leader_election.cc:304] T fa8650e71aa14778b3d73721fc50d9fc P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e61c3a8f61bb48f8a963c9480e53c168; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87
W20260709 13:06:01.466150 20078 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.2:46257, user_credentials={real_user=slave}} blocked reactor thread for 309689us
I20260709 13:06:01.469072 20078 leader_election.cc:304] T 0e1085d23e8347fbbd5bce7542f4b1f4 P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, 127766fc592545a4997f7790f50f6076; no voters: e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:06:01.433568 22758 consensus_queue.cc:1048] T 40e1e16737a842ee936002830f36882e P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.035s
I20260709 13:06:01.473879 22758 raft_consensus.cc:2749] T b08304a0a02b42d7840c4e8ee9a6bd1a P e61c3a8f61bb48f8a963c9480e53c168 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:06:01.474759 22758 raft_consensus.cc:2749] T fa8650e71aa14778b3d73721fc50d9fc P e61c3a8f61bb48f8a963c9480e53c168 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:06:01.466936 19449 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.4:43121, user_credentials={real_user=slave}} blocked reactor thread for 71999.6us
I20260709 13:06:01.477032 19449 leader_election.cc:304] T ab43d85f64114d4ebf618930e43d9ed0 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, 127766fc592545a4997f7790f50f6076, e5256d91808b47c195bc9b4dbd7f2b87; no voters: 
I20260709 13:06:01.484917 23403 raft_consensus.cc:515] T 7be9efa6559648dbb5a0f7684c4542d1 P 0473d2b2d01f4459b1e90fd12cc7840e [term 11 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } attrs { replace: true } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:01.496878 23478 raft_consensus.cc:515] T 2a16f7501e2444fb86d4e2778e734e02 P e5256d91808b47c195bc9b4dbd7f2b87 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:01.500042 23443 raft_consensus.cc:515] T ff9b0eddd810459b82d91c60777c10eb P e5256d91808b47c195bc9b4dbd7f2b87 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
W20260709 13:06:01.502074 23437 consensus_meta.cc:287] T 65d8cb8d6ec64f459d5a47cefab10acf P 127766fc592545a4997f7790f50f6076: Time spent flushing consensus metadata: real 0.753s	user 0.008s	sys 0.002s
W20260709 13:06:01.494415 23433 consensus_meta.cc:287] T f1b10566f45d4a7d9029858330e02d5b P 0473d2b2d01f4459b1e90fd12cc7840e: Time spent flushing consensus metadata: real 0.752s	user 0.007s	sys 0.001s
I20260709 13:06:01.505260 19405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14935b3ddf914369822e4a0547aaa355" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:06:01.385413 23476 raft_consensus.cc:3060] T 70797e5783b5454ab0d0eea663e791e3 P e5256d91808b47c195bc9b4dbd7f2b87 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:06:01.524118 23220 leader_election.cc:290] T ff75a1d4cb1f493db8f71ddc136ba9ab P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:06:01.385223 23343 raft_consensus.cc:2749] T 0afb57ae58a24a01850491d69f0213dd P e61c3a8f61bb48f8a963c9480e53c168 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:06:01.393735 23351 raft_consensus.cc:3060] T df751f992649444090e27965eb1af85d P 0473d2b2d01f4459b1e90fd12cc7840e [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:06:01.403391 23425 raft_consensus.cc:3060] T 1efebf73c86e432baa55533136b6e12c P 127766fc592545a4997f7790f50f6076 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:06:01.339807 23474 raft_consensus.cc:515] T edd7d470b5014c9489be7f41f64355c9 P e5256d91808b47c195bc9b4dbd7f2b87 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
W20260709 13:06:01.534060 19483 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.646s	user 0.000s	sys 0.013s
W20260709 13:06:01.608484 19483 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.720s	user 0.000s	sys 0.013s
W20260709 13:06:01.542821 19377 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.2:46257, user_credentials={real_user=slave}} blocked reactor thread for 213580us
I20260709 13:06:01.504357 23407 raft_consensus.cc:2804] T 48824d5acfbc485ebf8c2d944e7202de P 0473d2b2d01f4459b1e90fd12cc7840e [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:06:01.557366 19553 raft_consensus.cc:2468] T 85c494af21f9457a85da47b9bc70c1fd P e61c3a8f61bb48f8a963c9480e53c168 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 127766fc592545a4997f7790f50f6076 in term 8.
I20260709 13:06:01.560519 19406 raft_consensus.cc:2468] T 179fd671030940b4b4a4e24bcc4aba0a P e5256d91808b47c195bc9b4dbd7f2b87 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 11.
W20260709 13:06:01.615480 19526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.2:46257, user_credentials={real_user=slave}} blocked reactor thread for 292573us
I20260709 13:06:01.544401 19405 raft_consensus.cc:2468] T 14935b3ddf914369822e4a0547aaa355 P e5256d91808b47c195bc9b4dbd7f2b87 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 8.
W20260709 13:06:01.535544 19449 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.4:43121, user_credentials={real_user=slave}} blocked reactor thread for 58641.1us
I20260709 13:06:01.617973 19526 leader_election.cc:304] T 2725d2c4cb054f18b0fc8f735c15f6c2 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
W20260709 13:06:01.543076 19450 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.3:36891, user_credentials={real_user=slave}} blocked reactor thread for 324048us
I20260709 13:06:01.466840 23486 raft_consensus.cc:2749] T 86a6797bdfe94fa496c050ceae4bd0d9 P e61c3a8f61bb48f8a963c9480e53c168 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:06:01.572930 23403 leader_election.cc:290] T 7be9efa6559648dbb5a0f7684c4542d1 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 11 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:06:01.621065 19450 leader_election.cc:304] T 7f575b143b844aa096b50997dad3516a P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e; no voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:06:01.555154 23437 raft_consensus.cc:2749] T 65d8cb8d6ec64f459d5a47cefab10acf P 127766fc592545a4997f7790f50f6076 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:06:01.618006 19406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f93ee515a9c14139bf566522ed8232f3" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 14 candidate_status { last_received { term: 12 index: 5 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
I20260709 13:06:01.537868 23488 raft_consensus.cc:2749] T 62c6c134d3d24a1ab144dd9ee6bc3f64 P 0473d2b2d01f4459b1e90fd12cc7840e [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:06:01.643101 19406 raft_consensus.cc:3060] T f93ee515a9c14139bf566522ed8232f3 P e5256d91808b47c195bc9b4dbd7f2b87 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:06:01.643570 23387 raft_consensus.cc:2764] T 0e1085d23e8347fbbd5bce7542f4b1f4 P 127766fc592545a4997f7790f50f6076 [term 8 FOLLOWER]: Leader election decision vote started in defunct term 7: won
I20260709 13:06:01.622891 23407 raft_consensus.cc:493] T 48824d5acfbc485ebf8c2d944e7202de P 0473d2b2d01f4459b1e90fd12cc7840e [term 10 FOLLOWER]: Starting leader election (detected failure of leader e61c3a8f61bb48f8a963c9480e53c168)
I20260709 13:06:01.667236 23403 raft_consensus.cc:2749] T 1efebf73c86e432baa55533136b6e12c P 0473d2b2d01f4459b1e90fd12cc7840e [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:06:01.636564 19405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4509b76741dc428e9201c70c1658da13" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
W20260709 13:06:01.611348 23324 consensus_meta.cc:287] T ab43d85f64114d4ebf618930e43d9ed0 P 127766fc592545a4997f7790f50f6076: Time spent flushing consensus metadata: real 0.851s	user 0.012s	sys 0.006s
I20260709 13:06:01.655624 20106 raft_consensus.cc:2468] T 65d8cb8d6ec64f459d5a47cefab10acf P 127766fc592545a4997f7790f50f6076 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 8.
I20260709 13:06:01.619177 19449 leader_election.cc:304] T 14efcc79969f41babe5529c22d59156d P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e; no voters: 127766fc592545a4997f7790f50f6076, e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:06:01.566704 23399 raft_consensus.cc:2749] T 62c6c134d3d24a1ab144dd9ee6bc3f64 P 127766fc592545a4997f7790f50f6076 [term 10 FOLLOWER]: Leader pre-election lost for term 9. Reason: Vote denied by peer 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257) with higher term. Message: Invalid argument: T 62c6c134d3d24a1ab144dd9ee6bc3f64 P 0473d2b2d01f4459b1e90fd12cc7840e [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 127766fc592545a4997f7790f50f6076 for earlier term 9. Current term is 10.
W20260709 13:06:01.635151 23360 consensus_meta.cc:287] T ed7fdbcb96d14d418db9ca90a792588a P e61c3a8f61bb48f8a963c9480e53c168: Time spent flushing consensus metadata: real 0.616s	user 0.014s	sys 0.001s
W20260709 13:06:01.662070 19523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.1:40321, user_credentials={real_user=slave}} blocked reactor thread for 197635us
I20260709 13:06:01.611753 23492 raft_consensus.cc:2749] T 14efcc79969f41babe5529c22d59156d P 127766fc592545a4997f7790f50f6076 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:06:01.635942 19377 leader_election.cc:336] T 21e14947d70440f19044d8f75c31e1f9 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 9 election: RPC error from VoteRequest() call to peer 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257): Timed out: RequestConsensusVote RPC to 127.17.223.2:46257 timed out after 2.049s (SENT)
I20260709 13:06:01.688444 19377 leader_election.cc:304] T 21e14947d70440f19044d8f75c31e1f9 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168
W20260709 13:06:01.692754 19449 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.4:43121, user_credentials={real_user=slave}} blocked reactor thread for 73654.2us
I20260709 13:06:01.693760 19449 leader_election.cc:304] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e; no voters: 127766fc592545a4997f7790f50f6076, e5256d91808b47c195bc9b4dbd7f2b87
W20260709 13:06:01.671367 20078 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.2:46257, user_credentials={real_user=slave}} blocked reactor thread for 202384us
I20260709 13:06:01.693739 19523 leader_election.cc:304] T 85c494af21f9457a85da47b9bc70c1fd P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e61c3a8f61bb48f8a963c9480e53c168; no voters: 127766fc592545a4997f7790f50f6076, e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:06:01.636080 23413 raft_consensus.cc:2764] T 2725d2c4cb054f18b0fc8f735c15f6c2 P e61c3a8f61bb48f8a963c9480e53c168 [term 12 FOLLOWER]: Leader pre-election decision vote started in defunct term 11: won
I20260709 13:06:01.673180 19405 raft_consensus.cc:2468] T 4509b76741dc428e9201c70c1658da13 P e5256d91808b47c195bc9b4dbd7f2b87 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 4.
I20260709 13:06:01.558085 23433 raft_consensus.cc:515] T f1b10566f45d4a7d9029858330e02d5b P 0473d2b2d01f4459b1e90fd12cc7840e [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:01.678187 19406 raft_consensus.cc:2410] T f93ee515a9c14139bf566522ed8232f3 P e5256d91808b47c195bc9b4dbd7f2b87 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate e61c3a8f61bb48f8a963c9480e53c168 for term 14 because replica has last-logged OpId of term: 13 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 5.
I20260709 13:06:01.639580 23456 leader_election.cc:290] T 86a6797bdfe94fa496c050ceae4bd0d9 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:06:01.539139 23483 consensus_queue.cc:1048] T 65d8cb8d6ec64f459d5a47cefab10acf P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.119s
I20260709 13:06:01.669040 23407 raft_consensus.cc:3060] T 48824d5acfbc485ebf8c2d944e7202de P 0473d2b2d01f4459b1e90fd12cc7840e [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:06:01.699478 19449 leader_election.cc:304] T 1f85fc4b527a48848e5faa083b604e36 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e; no voters: 127766fc592545a4997f7790f50f6076, e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:06:01.697942 19523 leader_election.cc:304] T 2a16f7501e2444fb86d4e2778e734e02 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168; no voters: 127766fc592545a4997f7790f50f6076
I20260709 13:06:01.703140 19411 raft_consensus.cc:2468] T f1b10566f45d4a7d9029858330e02d5b P e5256d91808b47c195bc9b4dbd7f2b87 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 12.
I20260709 13:06:01.706840 19523 leader_election.cc:304] T 833a2f0775ed407a94b8924ce50adb63 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e61c3a8f61bb48f8a963c9480e53c168; no voters: 127766fc592545a4997f7790f50f6076, e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:06:01.694772 23220 raft_consensus.cc:2804] T ab43d85f64114d4ebf618930e43d9ed0 P 0473d2b2d01f4459b1e90fd12cc7840e [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:06:01.711261 23093 raft_consensus.cc:2804] T 2a16f7501e2444fb86d4e2778e734e02 P e61c3a8f61bb48f8a963c9480e53c168 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:06:01.711428 23475 leader_election.cc:290] T 1a61655d99124a29b486ba4a5b37faea P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
W20260709 13:06:01.711737 23485 log.cc:927] Time spent T 86a6797bdfe94fa496c050ceae4bd0d9 P e61c3a8f61bb48f8a963c9480e53c168: Append to log took a long time: real 0.331s	user 0.001s	sys 0.000s
W20260709 13:06:01.700071 19375 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.3:36891, user_credentials={real_user=slave}} blocked reactor thread for 295441us
I20260709 13:06:01.697253 23091 raft_consensus.cc:2749] T 21e14947d70440f19044d8f75c31e1f9 P e5256d91808b47c195bc9b4dbd7f2b87 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:06:01.721984 19449 leader_election.cc:304] T 46c5bfeecc314717bffe987e6844b6d0 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e; no voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168
W20260709 13:06:01.722687 19376 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:01.723835 19486 raft_consensus.cc:2393] T f1b10566f45d4a7d9029858330e02d5b P 0473d2b2d01f4459b1e90fd12cc7840e [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate e61c3a8f61bb48f8a963c9480e53c168 in current term 12: Already voted for candidate 0473d2b2d01f4459b1e90fd12cc7840e in this term.
I20260709 13:06:01.737020 20078 leader_election.cc:304] T 96efeaaf1057492490e9a621f37e1a2d P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, 127766fc592545a4997f7790f50f6076; no voters: e61c3a8f61bb48f8a963c9480e53c168
W20260709 13:06:01.716579 19377 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.2:46257, user_credentials={real_user=slave}} blocked reactor thread for 80670.2us
W20260709 13:06:01.755223 19377 leader_election.cc:336] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 11 election: RPC error from VoteRequest() call to peer 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257): Timed out: RequestConsensusVote RPC to 127.17.223.2:46257 timed out after 2.051s (SENT)
I20260709 13:06:01.755637 20078 leader_election.cc:304] T 48824d5acfbc485ebf8c2d944e7202de P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 127766fc592545a4997f7790f50f6076; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:06:01.679255 23324 raft_consensus.cc:515] T ab43d85f64114d4ebf618930e43d9ed0 P 127766fc592545a4997f7790f50f6076 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } attrs { replace: true } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:01.742020 19523 leader_election.cc:304] T fa731b585f684a7fb2d106c50f143b83 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e61c3a8f61bb48f8a963c9480e53c168; no voters: 127766fc592545a4997f7790f50f6076, e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:06:01.742858 23505 raft_consensus.cc:2749] T 833a2f0775ed407a94b8924ce50adb63 P e61c3a8f61bb48f8a963c9480e53c168 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 13:06:01.743654 19450 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.3:36891, user_credentials={real_user=slave}} blocked reactor thread for 102423us
I20260709 13:06:01.699604 23403 raft_consensus.cc:2749] T 7f575b143b844aa096b50997dad3516a P 0473d2b2d01f4459b1e90fd12cc7840e [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:06:01.711287 23220 raft_consensus.cc:493] T ab43d85f64114d4ebf618930e43d9ed0 P 0473d2b2d01f4459b1e90fd12cc7840e [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:01.689888 23360 raft_consensus.cc:515] T ed7fdbcb96d14d418db9ca90a792588a P e61c3a8f61bb48f8a963c9480e53c168 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
W20260709 13:06:01.816033 19377 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.2:46257, user_credentials={real_user=slave}} blocked reactor thread for 60833.3us
I20260709 13:06:01.717290 23486 raft_consensus.cc:2749] T 85c494af21f9457a85da47b9bc70c1fd P e61c3a8f61bb48f8a963c9480e53c168 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 13:06:01.773680 19449 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.1:40321, user_credentials={real_user=slave}} blocked reactor thread for 51827.4us
W20260709 13:06:01.818322 19526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.2:46257, user_credentials={real_user=slave}} blocked reactor thread for 163427us
I20260709 13:06:01.773236 19523 leader_election.cc:304] T 28af091831594f9d8e96482078cc7625 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
W20260709 13:06:01.824542 19523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.1:40321, user_credentials={real_user=slave}} blocked reactor thread for 51373.8us
W20260709 13:06:01.827358 19377 connection.cc:256] RPC call timeout handler was delayed by -1.8872544739999739s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18100000000000002s for a response
I20260709 13:06:01.831373 23443 leader_election.cc:290] T ff9b0eddd810459b82d91c60777c10eb P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 10 election: Requested vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:06:01.753849 23488 raft_consensus.cc:2749] T 14efcc79969f41babe5529c22d59156d P 0473d2b2d01f4459b1e90fd12cc7840e [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:06:01.832779 19377 leader_election.cc:336] T 5ec1c4ce15e04c7e8c283a62179f2a64 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 9 election: RPC error from VoteRequest() call to peer 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257): Timed out: RequestConsensusVote RPC to 127.17.223.2:46257 timed out after 2.130s (SENT)
W20260709 13:06:01.831117 19375 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:01.836139 19554 raft_consensus.cc:2393] T ed7fdbcb96d14d418db9ca90a792588a P e61c3a8f61bb48f8a963c9480e53c168 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0473d2b2d01f4459b1e90fd12cc7840e in current term 8: Already voted for candidate e61c3a8f61bb48f8a963c9480e53c168 in this term.
I20260709 13:06:01.753436 23093 raft_consensus.cc:697] T 2a16f7501e2444fb86d4e2778e734e02 P e61c3a8f61bb48f8a963c9480e53c168 [term 11 LEADER]: Becoming Leader. State: Replica: e61c3a8f61bb48f8a963c9480e53c168, State: Running, Role: LEADER
I20260709 13:06:01.804672 23220 raft_consensus.cc:3060] T ab43d85f64114d4ebf618930e43d9ed0 P 0473d2b2d01f4459b1e90fd12cc7840e [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:06:01.852962 19405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff75a1d4cb1f493db8f71ddc136ba9ab" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:06:01.852942 19408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff9b0eddd810459b82d91c60777c10eb" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:06:01.855760 19408 raft_consensus.cc:2393] T ff9b0eddd810459b82d91c60777c10eb P e5256d91808b47c195bc9b4dbd7f2b87 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0473d2b2d01f4459b1e90fd12cc7840e in current term 10: Already voted for candidate e5256d91808b47c195bc9b4dbd7f2b87 in this term.
I20260709 13:06:01.817894 23492 raft_consensus.cc:2749] T 48824d5acfbc485ebf8c2d944e7202de P 127766fc592545a4997f7790f50f6076 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:06:01.853876 19523 leader_election.cc:304] T 179fd671030940b4b4a4e24bcc4aba0a P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:06:01.779072 23475 raft_consensus.cc:493] T d1e5873a19244c5ebbcd38e126796ee7 P e5256d91808b47c195bc9b4dbd7f2b87 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader e61c3a8f61bb48f8a963c9480e53c168)
I20260709 13:06:01.868921 19405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7be9efa6559648dbb5a0f7684c4542d1" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
I20260709 13:06:01.869724 19405 raft_consensus.cc:3060] T 7be9efa6559648dbb5a0f7684c4542d1 P e5256d91808b47c195bc9b4dbd7f2b87 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:06:01.847162 23505 raft_consensus.cc:2749] T fa731b585f684a7fb2d106c50f143b83 P e61c3a8f61bb48f8a963c9480e53c168 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:06:01.878252 19405 raft_consensus.cc:2468] T 7be9efa6559648dbb5a0f7684c4542d1 P e5256d91808b47c195bc9b4dbd7f2b87 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 11.
W20260709 13:06:01.879194 19526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.2:46257, user_credentials={real_user=slave}} blocked reactor thread for 51011.1us
I20260709 13:06:01.882179 19526 leader_election.cc:304] T bc225c93219c45538b53a1bd3d387e4d P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e61c3a8f61bb48f8a963c9480e53c168; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:06:01.833642 23403 raft_consensus.cc:493] T b9f0d59553ad444883fcf5b5909f9798 P 0473d2b2d01f4459b1e90fd12cc7840e [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:01.833652 23491 raft_consensus.cc:2804] T 96efeaaf1057492490e9a621f37e1a2d P 127766fc592545a4997f7790f50f6076 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:06:01.857100 23486 raft_consensus.cc:2804] T 28af091831594f9d8e96482078cc7625 P e61c3a8f61bb48f8a963c9480e53c168 [term 11 FOLLOWER]: Leader election won for term 11
W20260709 13:06:01.888151 19377 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.2:46257, user_credentials={real_user=slave}} blocked reactor thread for 55393.5us
W20260709 13:06:01.899780 19377 connection.cc:256] RPC call timeout handler was delayed by -1.7781639140000607s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1647s for a response
W20260709 13:06:01.900175 19377 connection.cc:256] RPC call timeout handler was delayed by -1.7466639140001234s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16820000000000002s for a response
I20260709 13:06:01.856803 23478 leader_election.cc:290] T 2a16f7501e2444fb86d4e2778e734e02 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 12 election: Requested vote from peers e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:06:01.888722 23489 raft_consensus.cc:3060] T 1f85fc4b527a48848e5faa083b604e36 P 0473d2b2d01f4459b1e90fd12cc7840e [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:06:01.885569 23488 raft_consensus.cc:2749] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P 0473d2b2d01f4459b1e90fd12cc7840e [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:06:01.912201 23499 log.cc:927] Time spent T 2e36a9d6e29c4a7c860cf267efbd4c74 P e5256d91808b47c195bc9b4dbd7f2b87: Append to log took a long time: real 0.211s	user 0.000s	sys 0.000s
I20260709 13:06:01.900333 23491 raft_consensus.cc:493] T 96efeaaf1057492490e9a621f37e1a2d P 127766fc592545a4997f7790f50f6076 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:01.862699 23509 consensus_queue.cc:1048] T 96efeaaf1057492490e9a621f37e1a2d P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 6, Time since last communication: 0.053s
I20260709 13:06:01.926011 19526 leader_election.cc:304] T 3e1f505cb0f1427bbd698ac889d80821 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168; no voters: e5256d91808b47c195bc9b4dbd7f2b87
W20260709 13:06:01.918315 23502 log.cc:927] Time spent T 1dc5b3532fe54f74876d02beffa2c230 P e61c3a8f61bb48f8a963c9480e53c168: Append to log took a long time: real 0.083s	user 0.000s	sys 0.000s
I20260709 13:06:01.884898 23475 raft_consensus.cc:515] T d1e5873a19244c5ebbcd38e126796ee7 P e5256d91808b47c195bc9b4dbd7f2b87 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:01.901290 23403 raft_consensus.cc:515] T b9f0d59553ad444883fcf5b5909f9798 P 0473d2b2d01f4459b1e90fd12cc7840e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
W20260709 13:06:01.931610 23490 log.cc:927] Time spent T 0afb57ae58a24a01850491d69f0213dd P e61c3a8f61bb48f8a963c9480e53c168: Append to log took a long time: real 0.274s	user 0.001s	sys 0.000s
I20260709 13:06:01.922412 23491 raft_consensus.cc:3060] T 96efeaaf1057492490e9a621f37e1a2d P 127766fc592545a4997f7790f50f6076 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:06:01.927416 23413 raft_consensus.cc:2804] T 179fd671030940b4b4a4e24bcc4aba0a P e61c3a8f61bb48f8a963c9480e53c168 [term 11 FOLLOWER]: Leader election won for term 11
W20260709 13:06:01.963837 19523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.1:40321, user_credentials={real_user=slave}} blocked reactor thread for 104906us
W20260709 13:06:01.956491 23493 log.cc:927] Time spent T 46c5bfeecc314717bffe987e6844b6d0 P e5256d91808b47c195bc9b4dbd7f2b87: Append to log took a long time: real 0.263s	user 0.001s	sys 0.000s
W20260709 13:06:01.969781 23498 log.cc:927] Time spent T e381f1d6b8184797ad142de49be225a8 P e5256d91808b47c195bc9b4dbd7f2b87: Append to log took a long time: real 0.241s	user 0.001s	sys 0.000s
W20260709 13:06:01.970584 23507 log.cc:927] Time spent T 85c494af21f9457a85da47b9bc70c1fd P 127766fc592545a4997f7790f50f6076: Append to log took a long time: real 0.085s	user 0.000s	sys 0.000s
I20260709 13:06:02.023499 23420 leader_election.cc:290] T ece3db938bc649d4a40a51522ed5259c P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 10 election: Requested vote from peers e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:06:01.962620 23523 raft_consensus.cc:2749] T 46c5bfeecc314717bffe987e6844b6d0 P 0473d2b2d01f4459b1e90fd12cc7840e [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:06:02.025003 23523 raft_consensus.cc:493] T 172b3dd13109415a955b71ac0e9d2234 P 0473d2b2d01f4459b1e90fd12cc7840e [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 127766fc592545a4997f7790f50f6076)
I20260709 13:06:02.025507 23523 raft_consensus.cc:515] T 172b3dd13109415a955b71ac0e9d2234 P 0473d2b2d01f4459b1e90fd12cc7840e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:01.937418 23474 leader_election.cc:290] T edd7d470b5014c9489be7f41f64355c9 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:06:01.979779 23368 consensus_queue.cc:1048] T 1efebf73c86e432baa55533136b6e12c P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:06:02.027199 20106 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46422 (request call id 714) took 1279 ms. Trace:
I20260709 13:06:02.027700 20106 rpcz_store.cc:276] 0709 13:06:00.748257 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:00.748379 (+   122us) service_pool.cc:224] Handling call
0709 13:06:02.026953 (+1278574us) spinlock_profiling.cc:243] Waited 897 ms on lock 0x7b540036fe54. stack: 00007f4a79de9343 00007f4a79de9240 00007f4a797781d4 00007f4a834b6304 00007f4a834b6299 00007f4a7ce71571 00007f4a7cf0c2fa 00007f4a81ecdb17 00007f4a7b4486d4 00007f4a7b448662 00007f4a7b448591 00007f4a7b44850c 00007f4a7b4477c2 00007f4a7b24348c 00007f4a7b2428c6 00007f4a7b24226f
0709 13:06:02.027098 (+   145us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2063007616}
I20260709 13:06:01.980564 19483 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58286 (request call id 1941) took 1177 ms. Trace:
I20260709 13:06:02.028625 19483 rpcz_store.cc:276] 0709 13:06:00.803027 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:00.829976 (+ 26949us) service_pool.cc:224] Handling call
0709 13:06:00.831633 (+  1657us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:00.846020 (+ 14387us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:06:00.846050 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:00.867494 (+ 21444us) log.cc:844] Serialized 26 byte log entry
0709 13:06:01.609046 (+741552us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:06:01.609106 (+    60us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:01.609232 (+   126us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:01.980347 (+371115us) raft_consensus.cc:1685] finished
0709 13:06:01.980367 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:01.980509 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":16123,"raft.run_cpu_time_us":105,"raft.run_wall_time_us":5990,"thread_start_us":720561,"threads_started":1,"wal-append.queue_time_us":1036812}
W20260709 13:06:02.030985 23506 log.cc:927] Time spent T 70797e5783b5454ab0d0eea663e791e3 P e61c3a8f61bb48f8a963c9480e53c168: Append to log took a long time: real 0.068s	user 0.000s	sys 0.001s
I20260709 13:06:02.031323 23523 leader_election.cc:290] T 172b3dd13109415a955b71ac0e9d2234 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:06:01.968259 19523 leader_election.cc:304] T 14935b3ddf914369822e4a0547aaa355 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 127766fc592545a4997f7790f50f6076, e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
W20260709 13:06:01.982280 23412 consensus_meta.cc:287] T 217b5fae677b4971b3bbd2f357a1f7ff P e61c3a8f61bb48f8a963c9480e53c168: Time spent flushing consensus metadata: real 0.774s	user 0.007s	sys 0.003s
I20260709 13:06:01.983934 23475 leader_election.cc:290] T d1e5873a19244c5ebbcd38e126796ee7 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:06:02.043892 19551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86a6797bdfe94fa496c050ceae4bd0d9" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:06:01.985505 19554 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40428 (request call id 2349) took 1048 ms. Trace:
I20260709 13:06:01.962918 23517 raft_consensus.cc:2749] T bc225c93219c45538b53a1bd3d387e4d P e61c3a8f61bb48f8a963c9480e53c168 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:06:02.045178 19554 rpcz_store.cc:276] 0709 13:06:00.937487 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:00.937679 (+   192us) service_pool.cc:224] Handling call
0709 13:06:01.985291 (+1047612us) spinlock_profiling.cc:243] Waited 824 ms on lock 0x7b540009bad4. stack: 00007f4a79de9343 00007f4a79de9240 00007f4a797781d4 00007f4a834b6304 00007f4a834b6299 00007f4a7ce71571 00007f4a7cf0c2fa 00007f4a81ecdb17 00007f4a7b4486d4 00007f4a7b448662 00007f4a7b448591 00007f4a7b44850c 00007f4a7b4477c2 00007f4a7b24348c 00007f4a7b2428c6 00007f4a7b24226f
0709 13:06:01.985446 (+   155us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1894866816}
I20260709 13:06:01.996507 23324 leader_election.cc:290] T ab43d85f64114d4ebf618930e43d9ed0 P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 11 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:06:01.999114 23360 leader_election.cc:290] T ed7fdbcb96d14d418db9ca90a792588a P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 8 election: Requested vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:06:01.999945 19485 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58286 (request call id 1934) took 1210 ms. Trace:
I20260709 13:06:02.053143 19485 rpcz_store.cc:276] 0709 13:06:00.789416 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:00.797972 (+  8556us) service_pool.cc:224] Handling call
0709 13:06:00.819000 (+ 21028us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:00.830972 (+ 11972us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:06:00.862574 (+ 31602us) log.cc:844] Serialized 14 byte log entry
0709 13:06:00.877534 (+ 14960us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:00.877602 (+    68us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:06:00.877659 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:01.230639 (+352980us) spinlock_profiling.cc:243] Waited 4.29 ms on lock 0x7b18002e9cc0. stack: 00007f4a79de9343 00007f4a79de9240 00007f4a797781d4 00007f4a834b6304 00007f4a834b6299 00007f4a82ce3de1 00007f4a82cf05b1 00007f4a79de92a6 00007f4a79de9240 00007f4a797781d4 00007f4a834b6304 00007f4a834b6299 00007f4a7ce71571 00007f4a7cf08e01 00007f4a7cf0783e 00007f4a81ecc419
0709 13:06:01.996175 (+765536us) spinlock_profiling.cc:243] Waited 5.3 ms on lock 0x7b18002e9cc0. stack: 00007f4a79de9343 00007f4a79de9240 00007f4a797781d4 00007f4a834b6304 00007f4a834b6299 00007f4a82ce3de1 00007f4a82cf05b1 00007f4a79e1b522 00007f4a79e1d7c1 00007f4a79e1d779 00007f4a79e1d709 00007f4a79e1d6d1 00007f4a79e1c9cd 000000000038f354 000000000038f199 00007f4a79dfe83a
0709 13:06:01.999729 (+  3554us) spinlock_profiling.cc:243] Waited 11.7 ms on lock 0x7b5400224f54. stack: 00007f4a79de9343 00007f4a79de9240 00007f4a797781d4 00007f4a834b6304 00007f4a834b6299 00007f4a7ce71571 00007f4a7cf08e01 00007f4a7cf0783e 00007f4a81ecc419 00007f4a7b443bd4 00007f4a7b443b62 00007f4a7b443a91 00007f4a7b443a0c 00007f4a7b442cc2 00007f4a7b24348c 00007f4a7b2428c6
0709 13:06:01.999776 (+    47us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:01.999888 (+   112us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":31446,"prepare.run_cpu_time_us":33,"prepare.run_wall_time_us":33,"raft.queue_time_us":85,"raft.run_cpu_time_us":125,"raft.run_wall_time_us":7195,"spinlock_wait_cycles":49059456,"thread_start_us":14561,"threads_started":1,"wal-append.queue_time_us":13515}
I20260709 13:06:02.002758 19559 raft_consensus.cc:1240] T 7f575b143b844aa096b50997dad3516a P e61c3a8f61bb48f8a963c9480e53c168 [term 7 FOLLOWER]: Rejecting Update request from peer e5256d91808b47c195bc9b4dbd7f2b87 for earlier term 6. Current term is 7. Ops: []
I20260709 13:06:02.003208 23505 raft_consensus.cc:2804] T 3e1f505cb0f1427bbd698ac889d80821 P e61c3a8f61bb48f8a963c9480e53c168 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:06:02.007037 19478 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58286 (request call id 1945) took 1151 ms. Trace:
W20260709 13:06:02.068728 19449 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.1:40321, user_credentials={real_user=slave}} blocked reactor thread for 150056us
I20260709 13:06:02.009752 19552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b08304a0a02b42d7840c4e8ee9a6bd1a" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:06:02.012029 19558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa8650e71aa14778b3d73721fc50d9fc" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
W20260709 13:06:02.012563 23495 log.cc:927] Time spent T a08760e15aac4630a629431f56024dc8 P e5256d91808b47c195bc9b4dbd7f2b87: Append to log took a long time: real 0.365s	user 0.000s	sys 0.005s
I20260709 13:06:02.002792 23413 raft_consensus.cc:697] T 179fd671030940b4b4a4e24bcc4aba0a P e61c3a8f61bb48f8a963c9480e53c168 [term 11 LEADER]: Becoming Leader. State: Replica: e61c3a8f61bb48f8a963c9480e53c168, State: Running, Role: LEADER
I20260709 13:06:02.013092 19553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ece3db938bc649d4a40a51522ed5259c" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:06:01.927603 23093 consensus_queue.cc:237] T 2a16f7501e2444fb86d4e2778e734e02 P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:01.962920 23433 leader_election.cc:290] T f1b10566f45d4a7d9029858330e02d5b P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 12 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:06:02.036463 19405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab43d85f64114d4ebf618930e43d9ed0" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
I20260709 13:06:02.071913 19406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "172b3dd13109415a955b71ac0e9d2234" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:06:02.072003 19405 raft_consensus.cc:3060] T ab43d85f64114d4ebf618930e43d9ed0 P e5256d91808b47c195bc9b4dbd7f2b87 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:06:02.041116 19523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.1:40321, user_credentials={real_user=slave}} blocked reactor thread for 73035us
W20260709 13:06:02.018610 23194 consensus_meta.cc:287] T 0cdf56e38bbc453d9438d359e5a69955 P e61c3a8f61bb48f8a963c9480e53c168: Time spent flushing consensus metadata: real 0.552s	user 0.005s	sys 0.004s
W20260709 13:06:01.978596 23436 consensus_meta.cc:287] T 1dc5b3532fe54f74876d02beffa2c230 P 0473d2b2d01f4459b1e90fd12cc7840e: Time spent flushing consensus metadata: real 0.880s	user 0.014s	sys 0.000s
I20260709 13:06:02.057199 19554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a61655d99124a29b486ba4a5b37faea" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:06:02.068550 19478 rpcz_store.cc:276] 0709 13:06:00.855662 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:00.857173 (+  1511us) service_pool.cc:224] Handling call
0709 13:06:00.857490 (+   317us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:01.008011 (+150521us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:02.006808 (+998797us) spinlock_profiling.cc:243] Waited 52.9 ms on lock 0x7b540035d9d4. stack: 00007f4a79de9343 00007f4a79de9240 00007f4a797781d4 00007f4a834b6304 00007f4a834b6299 00007f4a7ce71571 00007f4a7cf08e01 00007f4a7cf0783e 00007f4a81ecc419 00007f4a7b443bd4 00007f4a7b443b62 00007f4a7b443a91 00007f4a7b443a0c 00007f4a7b442cc2 00007f4a7b24348c 00007f4a7b2428c6
0709 13:06:02.006978 (+   170us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":121711872}
I20260709 13:06:02.008797 19477 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58286 (request call id 1932) took 1226 ms. Trace:
I20260709 13:06:02.073865 19523 leader_election.cc:304] T 4509b76741dc428e9201c70c1658da13 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168; no voters: 0473d2b2d01f4459b1e90fd12cc7840e
I20260709 13:06:02.078532 19558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a16f7501e2444fb86d4e2778e734e02" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:06:02.078481 19477 rpcz_store.cc:276] 0709 13:06:00.783313 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:00.783532 (+   219us) service_pool.cc:224] Handling call
0709 13:06:00.786390 (+  2858us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:01.211047 (+424657us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:06:01.538633 (+327586us) log.cc:844] Serialized 14 byte log entry
0709 13:06:01.718202 (+179569us) log.cc:844] Serialized 14 byte log entry
0709 13:06:01.883736 (+165534us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:01.883785 (+    49us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:06:01.883835 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:02.008531 (+124696us) spinlock_profiling.cc:243] Waited 424 ms on lock 0x7b5400223b54. stack: 00007f4a79de9343 00007f4a79de9240 00007f4a797781d4 00007f4a834b6304 00007f4a834b6299 00007f4a7ce71571 00007f4a7cf08e01 00007f4a7cf0783e 00007f4a81ecc419 00007f4a7b443bd4 00007f4a7b443b62 00007f4a7b443a91 00007f4a7b443a0c 00007f4a7b442cc2 00007f4a7b24348c 00007f4a7b2428c6
0709 13:06:02.008587 (+    56us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:02.008729 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":4615,"prepare.queue_time_us":65175,"prepare.run_cpu_time_us":463,"prepare.run_wall_time_us":11141,"raft.queue_time_us":209929,"raft.run_cpu_time_us":104,"raft.run_wall_time_us":4294,"spinlock_wait_cycles":975917440,"thread_start_us":600295,"threads_started":3}
I20260709 13:06:02.047272 23338 raft_consensus.cc:2804] T 14935b3ddf914369822e4a0547aaa355 P e61c3a8f61bb48f8a963c9480e53c168 [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 13:06:02.070029 23340 consensus_meta.cc:287] T ece3db938bc649d4a40a51522ed5259c P e61c3a8f61bb48f8a963c9480e53c168: Time spent flushing consensus metadata: real 0.976s	user 0.006s	sys 0.009s
I20260709 13:06:02.093261 20104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff9b0eddd810459b82d91c60777c10eb" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076"
I20260709 13:06:02.093891 20104 raft_consensus.cc:3060] T ff9b0eddd810459b82d91c60777c10eb P 127766fc592545a4997f7790f50f6076 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:06:02.085489 19409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1b10566f45d4a7d9029858330e02d5b" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
I20260709 13:06:02.094827 19409 raft_consensus.cc:2393] T f1b10566f45d4a7d9029858330e02d5b P e5256d91808b47c195bc9b4dbd7f2b87 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 0473d2b2d01f4459b1e90fd12cc7840e in current term 12: Already voted for candidate e61c3a8f61bb48f8a963c9480e53c168 in this term.
I20260709 13:06:02.095611 20106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ece3db938bc649d4a40a51522ed5259c" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076"
I20260709 13:06:02.096158 20106 raft_consensus.cc:3060] T ece3db938bc649d4a40a51522ed5259c P 127766fc592545a4997f7790f50f6076 [term 8 FOLLOWER]: Advancing to term 10
I20260709 13:06:02.091852 19523 leader_election.cc:304] T f1b10566f45d4a7d9029858330e02d5b P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:06:02.103430 20104 raft_consensus.cc:2468] T ff9b0eddd810459b82d91c60777c10eb P 127766fc592545a4997f7790f50f6076 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 10.
I20260709 13:06:02.106166 20108 raft_consensus.cc:1275] T 65d8cb8d6ec64f459d5a47cefab10acf P 127766fc592545a4997f7790f50f6076 [term 8 FOLLOWER]: Refusing update from remote peer e5256d91808b47c195bc9b4dbd7f2b87: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260709 13:06:02.106082 19558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edd7d470b5014c9489be7f41f64355c9" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 12 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:06:02.067430 23505 raft_consensus.cc:493] T 3e1f505cb0f1427bbd698ac889d80821 P e61c3a8f61bb48f8a963c9480e53c168 [term 10 FOLLOWER]: Starting leader election (detected failure of leader e5256d91808b47c195bc9b4dbd7f2b87)
I20260709 13:06:02.110477 19405 raft_consensus.cc:2468] T ab43d85f64114d4ebf618930e43d9ed0 P e5256d91808b47c195bc9b4dbd7f2b87 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 127766fc592545a4997f7790f50f6076 in term 11.
I20260709 13:06:02.106596 19374 leader_election.cc:304] T ff9b0eddd810459b82d91c60777c10eb P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 127766fc592545a4997f7790f50f6076, e5256d91808b47c195bc9b4dbd7f2b87; no voters: 
I20260709 13:06:02.047220 23412 raft_consensus.cc:515] T 217b5fae677b4971b3bbd2f357a1f7ff P e61c3a8f61bb48f8a963c9480e53c168 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:02.124018 20105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a16f7501e2444fb86d4e2778e734e02" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076"
I20260709 13:06:02.124621 20105 raft_consensus.cc:3060] T 2a16f7501e2444fb86d4e2778e734e02 P 127766fc592545a4997f7790f50f6076 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:06:02.128700 19523 leader_election.cc:304] T 65d8cb8d6ec64f459d5a47cefab10acf P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 127766fc592545a4997f7790f50f6076, e61c3a8f61bb48f8a963c9480e53c168; no voters: e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:06:02.125574 20076 leader_election.cc:304] T 70797e5783b5454ab0d0eea663e791e3 P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 127766fc592545a4997f7790f50f6076; no voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:06:02.086086 23338 raft_consensus.cc:493] T 14935b3ddf914369822e4a0547aaa355 P e61c3a8f61bb48f8a963c9480e53c168 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:06:02.191607 20076 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.3:36891, user_credentials={real_user=slave}} blocked reactor thread for 66151.3us
I20260709 13:06:02.154215 19405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f575b143b844aa096b50997dad3516a" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
I20260709 13:06:02.193058 19558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e5873a19244c5ebbcd38e126796ee7" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:06:02.109846 23344 raft_consensus.cc:2804] T 4509b76741dc428e9201c70c1658da13 P e61c3a8f61bb48f8a963c9480e53c168 [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 13:06:02.127069 23140 consensus_meta.cc:287] T ab43d85f64114d4ebf618930e43d9ed0 P e61c3a8f61bb48f8a963c9480e53c168: Time spent flushing consensus metadata: real 0.787s	user 0.007s	sys 0.003s
I20260709 13:06:02.202811 20076 leader_election.cc:304] T 2a16f7501e2444fb86d4e2778e734e02 P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 127766fc592545a4997f7790f50f6076; no voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:06:02.083703 23194 raft_consensus.cc:515] T 0cdf56e38bbc453d9438d359e5a69955 P e61c3a8f61bb48f8a963c9480e53c168 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:02.211704 19558 raft_consensus.cc:1240] T 217b5fae677b4971b3bbd2f357a1f7ff P e61c3a8f61bb48f8a963c9480e53c168 [term 8 FOLLOWER]: Rejecting Update request from peer e5256d91808b47c195bc9b4dbd7f2b87 for earlier term 7. Current term is 8. Ops: []
I20260709 13:06:02.110798 23517 raft_consensus.cc:2804] T f1b10566f45d4a7d9029858330e02d5b P e61c3a8f61bb48f8a963c9480e53c168 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:06:02.123250 23505 raft_consensus.cc:3060] T 3e1f505cb0f1427bbd698ac889d80821 P e61c3a8f61bb48f8a963c9480e53c168 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:06:02.207296 20112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed7fdbcb96d14d418db9ca90a792588a" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076"
I20260709 13:06:02.221375 20112 raft_consensus.cc:3060] T ed7fdbcb96d14d418db9ca90a792588a P 127766fc592545a4997f7790f50f6076 [term 6 FOLLOWER]: Advancing to term 8
W20260709 13:06:02.211899 19450 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.3:36891, user_credentials={real_user=slave}} blocked reactor thread for 394479us
W20260709 13:06:02.211846 19374 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.4:43121, user_credentials={real_user=slave}} blocked reactor thread for 89805.6us
I20260709 13:06:02.201902 23378 raft_consensus.cc:3055] T f93ee515a9c14139bf566522ed8232f3 P 0473d2b2d01f4459b1e90fd12cc7840e [term 13 LEADER]: Stepping down as leader of term 13
W20260709 13:06:02.212913 19523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.4:43121, user_credentials={real_user=slave}} blocked reactor thread for 84305.2us
W20260709 13:06:02.215029 20078 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.2:46257, user_credentials={real_user=slave}} blocked reactor thread for 457826us
I20260709 13:06:02.229753 19558 raft_consensus.cc:1275] T 85c494af21f9457a85da47b9bc70c1fd P e61c3a8f61bb48f8a963c9480e53c168 [term 8 FOLLOWER]: Refusing update from remote peer 127766fc592545a4997f7790f50f6076: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 13:06:02.229921 20078 leader_election.cc:304] T ff9b0eddd810459b82d91c60777c10eb P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, 127766fc592545a4997f7790f50f6076; no voters: e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:06:02.230759 19552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab43d85f64114d4ebf618930e43d9ed0" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:06:02.218245 20076 leader_election.cc:304] T fa731b585f684a7fb2d106c50f143b83 P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 127766fc592545a4997f7790f50f6076; no voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:06:02.085753 23436 raft_consensus.cc:515] T 1dc5b3532fe54f74876d02beffa2c230 P 0473d2b2d01f4459b1e90fd12cc7840e [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:02.098006 23407 raft_consensus.cc:515] T 48824d5acfbc485ebf8c2d944e7202de P 0473d2b2d01f4459b1e90fd12cc7840e [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:02.195065 23338 raft_consensus.cc:3060] T 14935b3ddf914369822e4a0547aaa355 P e61c3a8f61bb48f8a963c9480e53c168 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:06:02.220361 19526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.2:46257, user_credentials={real_user=slave}} blocked reactor thread for 294648us
I20260709 13:06:02.212735 22758 raft_consensus.cc:493] T a08760e15aac4630a629431f56024dc8 P e61c3a8f61bb48f8a963c9480e53c168 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:02.107793 23340 raft_consensus.cc:515] T ece3db938bc649d4a40a51522ed5259c P e61c3a8f61bb48f8a963c9480e53c168 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
W20260709 13:06:02.205848 23465 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.545s	user 0.005s	sys 0.006s
I20260709 13:06:02.243178 19481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff9b0eddd810459b82d91c60777c10eb" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:06:02.262286 19555 raft_consensus.cc:1240] T f93ee515a9c14139bf566522ed8232f3 P e61c3a8f61bb48f8a963c9480e53c168 [term 14 FOLLOWER]: Rejecting Update request from peer 0473d2b2d01f4459b1e90fd12cc7840e for earlier term 13. Current term is 14. Ops: [13.6-13.6]
I20260709 13:06:02.263896 19480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "217b5fae677b4971b3bbd2f357a1f7ff" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:06:02.264117 19482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b08304a0a02b42d7840c4e8ee9a6bd1a" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:06:02.205792 23344 raft_consensus.cc:493] T 4509b76741dc428e9201c70c1658da13 P e61c3a8f61bb48f8a963c9480e53c168 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 0473d2b2d01f4459b1e90fd12cc7840e)
I20260709 13:06:02.237850 19557 raft_consensus.cc:1240] T 0cdf56e38bbc453d9438d359e5a69955 P e61c3a8f61bb48f8a963c9480e53c168 [term 12 FOLLOWER]: Rejecting Update request from peer e5256d91808b47c195bc9b4dbd7f2b87 for earlier term 11. Current term is 12. Ops: []
I20260709 13:06:02.262746 19481 raft_consensus.cc:2468] T ff9b0eddd810459b82d91c60777c10eb P 0473d2b2d01f4459b1e90fd12cc7840e [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 9.
I20260709 13:06:02.239473 19558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff75a1d4cb1f493db8f71ddc136ba9ab" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:06:02.240607 19551 raft_consensus.cc:1275] T b9f0d59553ad444883fcf5b5909f9798 P e61c3a8f61bb48f8a963c9480e53c168 [term 10 FOLLOWER]: Refusing update from remote peer e5256d91808b47c195bc9b4dbd7f2b87: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:06:02.267076 19481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa8650e71aa14778b3d73721fc50d9fc" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:06:02.240924 19560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1b10566f45d4a7d9029858330e02d5b" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:06:02.241181 19477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f85fc4b527a48848e5faa083b604e36" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:06:02.204643 23469 raft_consensus.cc:2804] T ff9b0eddd810459b82d91c60777c10eb P e5256d91808b47c195bc9b4dbd7f2b87 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:06:02.242035 19478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2725d2c4cb054f18b0fc8f735c15f6c2" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:06:02.270092 19478 raft_consensus.cc:3060] T 2725d2c4cb054f18b0fc8f735c15f6c2 P 0473d2b2d01f4459b1e90fd12cc7840e [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:06:02.241253 19556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7be9efa6559648dbb5a0f7684c4542d1" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:06:02.270967 19556 raft_consensus.cc:3060] T 7be9efa6559648dbb5a0f7684c4542d1 P e61c3a8f61bb48f8a963c9480e53c168 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:06:02.262526 20076 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.3:36891, user_credentials={real_user=slave}} blocked reactor thread for 44357.5us
W20260709 13:06:02.225914 23218 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.552s	user 0.017s	sys 0.050s
I20260709 13:06:02.262850 22758 raft_consensus.cc:515] T a08760e15aac4630a629431f56024dc8 P e61c3a8f61bb48f8a963c9480e53c168 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:02.242971 19483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28af091831594f9d8e96482078cc7625" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:06:02.264514 19480 raft_consensus.cc:2376] T 217b5fae677b4971b3bbd2f357a1f7ff P 0473d2b2d01f4459b1e90fd12cc7840e [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 7. Re-sending same reply.
W20260709 13:06:02.237771 19411 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.511s	user 0.014s	sys 0.013s
W20260709 13:06:02.279280 19411 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.553s	user 0.015s	sys 0.013s
W20260709 13:06:02.237617 23316 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.891s	user 0.000s	sys 0.026s
I20260709 13:06:02.270896 20078 leader_election.cc:304] T 309c3ca0ca4b4f3ba129752ea2cb293b P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, 127766fc592545a4997f7790f50f6076, e5256d91808b47c195bc9b4dbd7f2b87; no voters: 
I20260709 13:06:02.204587 23486 raft_consensus.cc:697] T 28af091831594f9d8e96482078cc7625 P e61c3a8f61bb48f8a963c9480e53c168 [term 11 LEADER]: Becoming Leader. State: Replica: e61c3a8f61bb48f8a963c9480e53c168, State: Running, Role: LEADER
I20260709 13:06:02.271996 20076 leader_election.cc:304] T 833a2f0775ed407a94b8924ce50adb63 P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 127766fc592545a4997f7790f50f6076; no voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:06:02.273413 19484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df751f992649444090e27965eb1af85d" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
W20260709 13:06:02.242865 23351 consensus_meta.cc:287] T df751f992649444090e27965eb1af85d P 0473d2b2d01f4459b1e90fd12cc7840e: Time spent flushing consensus metadata: real 0.626s	user 0.007s	sys 0.003s
I20260709 13:06:02.279929 19483 raft_consensus.cc:2368] T 28af091831594f9d8e96482078cc7625 P 0473d2b2d01f4459b1e90fd12cc7840e [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e5256d91808b47c195bc9b4dbd7f2b87 for earlier term 10. Current term is 11.
I20260709 13:06:02.282909 19485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f85fc4b527a48848e5faa083b604e36" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:06:02.283641 19479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dc5b3532fe54f74876d02beffa2c230" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:06:02.289969 19479 raft_consensus.cc:2368] T 1dc5b3532fe54f74876d02beffa2c230 P 0473d2b2d01f4459b1e90fd12cc7840e [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e5256d91808b47c195bc9b4dbd7f2b87 for earlier term 10. Current term is 11.
W20260709 13:06:02.263175 23465 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.606s	user 0.005s	sys 0.006s
I20260709 13:06:02.287732 20105 raft_consensus.cc:2468] T 2a16f7501e2444fb86d4e2778e734e02 P 127766fc592545a4997f7790f50f6076 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 12.
I20260709 13:06:02.290037 20112 raft_consensus.cc:2468] T ed7fdbcb96d14d418db9ca90a792588a P 127766fc592545a4997f7790f50f6076 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 8.
W20260709 13:06:02.286576 23316 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.945s	user 0.000s	sys 0.028s
I20260709 13:06:02.217406 23483 consensus_queue.cc:1048] T 65d8cb8d6ec64f459d5a47cefab10acf P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Connected to new peer: Peer: permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.053s
W20260709 13:06:02.276676 23218 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.608s	user 0.021s	sys 0.050s
I20260709 13:06:02.303452 19374 leader_election.cc:304] T 2a16f7501e2444fb86d4e2778e734e02 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 127766fc592545a4997f7790f50f6076, e5256d91808b47c195bc9b4dbd7f2b87; no voters: e61c3a8f61bb48f8a963c9480e53c168
W20260709 13:06:02.269660 23476 consensus_meta.cc:287] T 70797e5783b5454ab0d0eea663e791e3 P e5256d91808b47c195bc9b4dbd7f2b87: Time spent flushing consensus metadata: real 0.709s	user 0.009s	sys 0.003s
I20260709 13:06:02.304417 19411 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52328 (request call id 1905) took 1012 ms. Trace:
I20260709 13:06:02.237073 23517 raft_consensus.cc:697] T f1b10566f45d4a7d9029858330e02d5b P e61c3a8f61bb48f8a963c9480e53c168 [term 12 LEADER]: Becoming Leader. State: Replica: e61c3a8f61bb48f8a963c9480e53c168, State: Running, Role: LEADER
I20260709 13:06:02.228435 23378 raft_consensus.cc:740] T f93ee515a9c14139bf566522ed8232f3 P 0473d2b2d01f4459b1e90fd12cc7840e [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 0473d2b2d01f4459b1e90fd12cc7840e, State: Running, Role: LEADER
I20260709 13:06:02.309203 20106 raft_consensus.cc:2468] T ece3db938bc649d4a40a51522ed5259c P 127766fc592545a4997f7790f50f6076 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 10.
I20260709 13:06:02.270150 23344 raft_consensus.cc:3060] T 4509b76741dc428e9201c70c1658da13 P e61c3a8f61bb48f8a963c9480e53c168 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:02.303354 19523 leader_election.cc:304] T ed7fdbcb96d14d418db9ca90a792588a P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 127766fc592545a4997f7790f50f6076, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:06:02.320363 19556 raft_consensus.cc:2468] T 7be9efa6559648dbb5a0f7684c4542d1 P e61c3a8f61bb48f8a963c9480e53c168 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 11.
I20260709 13:06:02.269110 23442 leader_election.cc:290] T f93ee515a9c14139bf566522ed8232f3 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 14 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:06:02.275446 23324 raft_consensus.cc:2749] T fa731b585f684a7fb2d106c50f143b83 P 127766fc592545a4997f7790f50f6076 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:06:02.323377 22758 leader_election.cc:290] T a08760e15aac4630a629431f56024dc8 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:06:02.323711 19553 raft_consensus.cc:2393] T ece3db938bc649d4a40a51522ed5259c P e61c3a8f61bb48f8a963c9480e53c168 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate e5256d91808b47c195bc9b4dbd7f2b87 in current term 10: Already voted for candidate e61c3a8f61bb48f8a963c9480e53c168 in this term.
W20260709 13:06:02.327059 19375 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:02.216368 23140 raft_consensus.cc:515] T ab43d85f64114d4ebf618930e43d9ed0 P e61c3a8f61bb48f8a963c9480e53c168 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } attrs { replace: true } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:02.268766 23511 raft_consensus.cc:2764] T ff9b0eddd810459b82d91c60777c10eb P 127766fc592545a4997f7790f50f6076 [term 10 FOLLOWER]: Leader election decision vote started in defunct term 9: won
I20260709 13:06:02.323887 23403 leader_election.cc:290] T b9f0d59553ad444883fcf5b5909f9798 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:06:02.334089 23368 raft_consensus.cc:2804] T 65d8cb8d6ec64f459d5a47cefab10acf P e61c3a8f61bb48f8a963c9480e53c168 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:06:02.302889 23399 raft_consensus.cc:2749] T 2a16f7501e2444fb86d4e2778e734e02 P 127766fc592545a4997f7790f50f6076 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:06:02.214144 23413 consensus_queue.cc:237] T 179fd671030940b4b4a4e24bcc4aba0a P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:02.308609 23434 raft_consensus.cc:2804] T 309c3ca0ca4b4f3ba129752ea2cb293b P 127766fc592545a4997f7790f50f6076 [term 9 FOLLOWER]: Leader election won for term 9
W20260709 13:06:02.367884 19450 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.3:36891, user_credentials={real_user=slave}} blocked reactor thread for 101084us
I20260709 13:06:02.344668 19374 leader_election.cc:304] T ece3db938bc649d4a40a51522ed5259c P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 127766fc592545a4997f7790f50f6076, e5256d91808b47c195bc9b4dbd7f2b87; no voters: 
W20260709 13:06:02.309122 23268 consensus_meta.cc:287] T 14935b3ddf914369822e4a0547aaa355 P 127766fc592545a4997f7790f50f6076: Time spent flushing consensus metadata: real 1.213s	user 0.015s	sys 0.000s
W20260709 13:06:02.357161 23514 log.cc:927] Time spent T edd7d470b5014c9489be7f41f64355c9 P 0473d2b2d01f4459b1e90fd12cc7840e: Append to log took a long time: real 0.148s	user 0.000s	sys 0.000s
I20260709 13:06:02.305119 23443 consensus_queue.cc:1059] T 7f575b143b844aa096b50997dad3516a P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 }, Status: INVALID_TERM, Last received: 6.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.043s
I20260709 13:06:02.308279 23468 consensus_queue.cc:1059] T 217b5fae677b4971b3bbd2f357a1f7ff P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.042s
I20260709 13:06:02.347599 23433 raft_consensus.cc:493] T 9962423cb4e54fcfa5de01daf68a86e7 P 0473d2b2d01f4459b1e90fd12cc7840e [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 127766fc592545a4997f7790f50f6076)
W20260709 13:06:02.365203 20076 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.3:36891, user_credentials={real_user=slave}} blocked reactor thread for 93339.4us
I20260709 13:06:02.344383 23478 raft_consensus.cc:2804] T 2a16f7501e2444fb86d4e2778e734e02 P e5256d91808b47c195bc9b4dbd7f2b87 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:06:02.307358 23351 raft_consensus.cc:515] T df751f992649444090e27965eb1af85d P 0473d2b2d01f4459b1e90fd12cc7840e [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:02.308630 23469 raft_consensus.cc:697] T ff9b0eddd810459b82d91c60777c10eb P e5256d91808b47c195bc9b4dbd7f2b87 [term 10 LEADER]: Becoming Leader. State: Replica: e5256d91808b47c195bc9b4dbd7f2b87, State: Running, Role: LEADER
I20260709 13:06:02.386564 23434 raft_consensus.cc:697] T 309c3ca0ca4b4f3ba129752ea2cb293b P 127766fc592545a4997f7790f50f6076 [term 9 LEADER]: Becoming Leader. State: Replica: 127766fc592545a4997f7790f50f6076, State: Running, Role: LEADER
W20260709 13:06:02.381078 23425 consensus_meta.cc:287] T 1efebf73c86e432baa55533136b6e12c P 127766fc592545a4997f7790f50f6076: Time spent flushing consensus metadata: real 0.762s	user 0.009s	sys 0.001s
I20260709 13:06:02.369210 22758 raft_consensus.cc:2804] T ed7fdbcb96d14d418db9ca90a792588a P e61c3a8f61bb48f8a963c9480e53c168 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:06:02.370561 19552 raft_consensus.cc:2393] T ab43d85f64114d4ebf618930e43d9ed0 P e61c3a8f61bb48f8a963c9480e53c168 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 127766fc592545a4997f7790f50f6076 in current term 11: Already voted for candidate e61c3a8f61bb48f8a963c9480e53c168 in this term.
I20260709 13:06:02.386031 19479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76cb037fc9064d13b59a8969d897ce8c" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:06:02.397315 22758 raft_consensus.cc:697] T ed7fdbcb96d14d418db9ca90a792588a P e61c3a8f61bb48f8a963c9480e53c168 [term 8 LEADER]: Becoming Leader. State: Replica: e61c3a8f61bb48f8a963c9480e53c168, State: Running, Role: LEADER
I20260709 13:06:02.388691 19485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f575b143b844aa096b50997dad3516a" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:06:02.340525 23220 raft_consensus.cc:515] T ab43d85f64114d4ebf618930e43d9ed0 P 0473d2b2d01f4459b1e90fd12cc7840e [term 11 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } attrs { replace: true } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:02.376061 19482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed7fdbcb96d14d418db9ca90a792588a" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:06:02.369656 23324 raft_consensus.cc:2749] T 833a2f0775ed407a94b8924ce50adb63 P 127766fc592545a4997f7790f50f6076 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:06:02.366148 23335 raft_consensus.cc:493] T 2b74109013a140ada21feeef92d6f563 P 0473d2b2d01f4459b1e90fd12cc7840e [term 6 FOLLOWER]: Starting leader election (detected failure of leader e61c3a8f61bb48f8a963c9480e53c168)
I20260709 13:06:02.365624 23528 raft_consensus.cc:2749] T 70797e5783b5454ab0d0eea663e791e3 P 127766fc592545a4997f7790f50f6076 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:06:02.407068 23335 raft_consensus.cc:3060] T 2b74109013a140ada21feeef92d6f563 P 0473d2b2d01f4459b1e90fd12cc7840e [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:06:02.401904 23425 raft_consensus.cc:515] T 1efebf73c86e432baa55533136b6e12c P 127766fc592545a4997f7790f50f6076 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
W20260709 13:06:02.410815 23501 log.cc:927] Time spent T 46c5bfeecc314717bffe987e6844b6d0 P e61c3a8f61bb48f8a963c9480e53c168: Append to log took a long time: real 0.278s	user 0.001s	sys 0.000s
I20260709 13:06:02.412269 23425 leader_election.cc:290] T 1efebf73c86e432baa55533136b6e12c P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 10 election: Requested vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:06:02.415684 20108 raft_consensus.cc:1240] T 1efebf73c86e432baa55533136b6e12c P 127766fc592545a4997f7790f50f6076 [term 10 FOLLOWER]: Rejecting Update request from peer e61c3a8f61bb48f8a963c9480e53c168 for earlier term 9. Current term is 10. Ops: [9.9-9.9]
I20260709 13:06:02.391448 23475 raft_consensus.cc:2804] T ece3db938bc649d4a40a51522ed5259c P e5256d91808b47c195bc9b4dbd7f2b87 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:06:02.386145 19556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9f0d59553ad444883fcf5b5909f9798" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:06:02.421278 19556 raft_consensus.cc:2468] T b9f0d59553ad444883fcf5b5909f9798 P e61c3a8f61bb48f8a963c9480e53c168 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 10.
I20260709 13:06:02.398097 19485 raft_consensus.cc:3060] T 7f575b143b844aa096b50997dad3516a P 0473d2b2d01f4459b1e90fd12cc7840e [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:06:02.373032 23532 raft_consensus.cc:493] T d1e5873a19244c5ebbcd38e126796ee7 P 0473d2b2d01f4459b1e90fd12cc7840e [term 11 FOLLOWER]: Starting pre-election (detected failure of leader e61c3a8f61bb48f8a963c9480e53c168)
I20260709 13:06:02.399924 19482 raft_consensus.cc:3060] T ed7fdbcb96d14d418db9ca90a792588a P 0473d2b2d01f4459b1e90fd12cc7840e [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:06:02.375694 19450 leader_election.cc:304] T ff75a1d4cb1f493db8f71ddc136ba9ab P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e; no voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168
W20260709 13:06:02.376370 23496 log.cc:927] Time spent T f93ee515a9c14139bf566522ed8232f3 P 0473d2b2d01f4459b1e90fd12cc7840e: Append to log took a long time: real 0.096s	user 0.000s	sys 0.000s
I20260709 13:06:02.397495 19479 raft_consensus.cc:2468] T 76cb037fc9064d13b59a8969d897ce8c P 0473d2b2d01f4459b1e90fd12cc7840e [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 9.
W20260709 13:06:02.413897 23520 log.cc:927] Time spent T ef32ce6fdd0e40d382c79974f30295c6 P e5256d91808b47c195bc9b4dbd7f2b87: Append to log took a long time: real 0.282s	user 0.001s	sys 0.000s
I20260709 13:06:02.376984 23530 raft_consensus.cc:493] T e381f1d6b8184797ad142de49be225a8 P 0473d2b2d01f4459b1e90fd12cc7840e [term 8 FOLLOWER]: Starting pre-election (detected failure of leader e61c3a8f61bb48f8a963c9480e53c168)
I20260709 13:06:02.361734 23378 consensus_queue.cc:260] T f93ee515a9c14139bf566522ed8232f3 P 0473d2b2d01f4459b1e90fd12cc7840e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 13.6, Last appended by leader: 6, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:02.373209 23511 consensus_queue.cc:1059] T 775c229504194560ba9589bc2199b089 P 127766fc592545a4997f7790f50f6076 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.035s
I20260709 13:06:02.404563 22758 consensus_queue.cc:237] T ed7fdbcb96d14d418db9ca90a792588a P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
W20260709 13:06:02.430912 19523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.4:43121, user_credentials={real_user=slave}} blocked reactor thread for 127645us
I20260709 13:06:02.432729 19484 raft_consensus.cc:2368] T df751f992649444090e27965eb1af85d P 0473d2b2d01f4459b1e90fd12cc7840e [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e5256d91808b47c195bc9b4dbd7f2b87 for earlier term 12. Current term is 13.
I20260709 13:06:02.407908 23412 leader_election.cc:290] T 217b5fae677b4971b3bbd2f357a1f7ff P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 8 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:06:02.379599 23268 raft_consensus.cc:515] T 14935b3ddf914369822e4a0547aaa355 P 127766fc592545a4997f7790f50f6076 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } attrs { replace: true } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:02.403337 23478 raft_consensus.cc:697] T 2a16f7501e2444fb86d4e2778e734e02 P e5256d91808b47c195bc9b4dbd7f2b87 [term 12 LEADER]: Becoming Leader. State: Replica: e5256d91808b47c195bc9b4dbd7f2b87, State: Running, Role: LEADER
I20260709 13:06:02.367969 23486 consensus_queue.cc:237] T 28af091831594f9d8e96482078cc7625 P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:02.465794 20112 raft_consensus.cc:1275] T 0e1085d23e8347fbbd5bce7542f4b1f4 P 127766fc592545a4997f7790f50f6076 [term 8 FOLLOWER]: Refusing update from remote peer e61c3a8f61bb48f8a963c9480e53c168: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:06:02.466264 19403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cdf56e38bbc453d9438d359e5a69955" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
I20260709 13:06:02.466475 19410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "217b5fae677b4971b3bbd2f357a1f7ff" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
I20260709 13:06:02.392104 23433 raft_consensus.cc:515] T 9962423cb4e54fcfa5de01daf68a86e7 P 0473d2b2d01f4459b1e90fd12cc7840e [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:02.418993 23194 leader_election.cc:290] T 0cdf56e38bbc453d9438d359e5a69955 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 12 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
W20260709 13:06:02.444357 23480 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.096s	user 0.002s	sys 0.018s
I20260709 13:06:02.494935 19479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a08760e15aac4630a629431f56024dc8" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:06:02.495729 19479 raft_consensus.cc:2468] T a08760e15aac4630a629431f56024dc8 P 0473d2b2d01f4459b1e90fd12cc7840e [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 12.
I20260709 13:06:02.401826 23534 consensus_queue.cc:1048] T 85c494af21f9457a85da47b9bc70c1fd P 127766fc592545a4997f7790f50f6076 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.076s
W20260709 13:06:02.463546 23537 log.cc:927] Time spent T b9f0d59553ad444883fcf5b5909f9798 P e5256d91808b47c195bc9b4dbd7f2b87: Append to log took a long time: real 0.087s	user 0.000s	sys 0.001s
I20260709 13:06:02.488551 19556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1efebf73c86e432baa55533136b6e12c" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:06:02.488915 19409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a08760e15aac4630a629431f56024dc8" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:06:02.490613 19482 raft_consensus.cc:2468] T ed7fdbcb96d14d418db9ca90a792588a P 0473d2b2d01f4459b1e90fd12cc7840e [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 8.
I20260709 13:06:02.502434 19403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ece3db938bc649d4a40a51522ed5259c" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
I20260709 13:06:02.510250 20112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ece3db938bc649d4a40a51522ed5259c" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076"
I20260709 13:06:02.449743 23475 raft_consensus.cc:697] T ece3db938bc649d4a40a51522ed5259c P e5256d91808b47c195bc9b4dbd7f2b87 [term 10 LEADER]: Becoming Leader. State: Replica: e5256d91808b47c195bc9b4dbd7f2b87, State: Running, Role: LEADER
I20260709 13:06:02.511020 20112 raft_consensus.cc:2393] T ece3db938bc649d4a40a51522ed5259c P 127766fc592545a4997f7790f50f6076 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate e61c3a8f61bb48f8a963c9480e53c168 in current term 10: Already voted for candidate e5256d91808b47c195bc9b4dbd7f2b87 in this term.
I20260709 13:06:02.423175 23491 raft_consensus.cc:515] T 96efeaaf1057492490e9a621f37e1a2d P 127766fc592545a4997f7790f50f6076 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
W20260709 13:06:02.488528 23446 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.314s	user 0.012s	sys 0.011s
W20260709 13:06:02.561739 23446 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.394s	user 0.012s	sys 0.011s
W20260709 13:06:02.515501 20078 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.2:46257, user_credentials={real_user=slave}} blocked reactor thread for 228351us
I20260709 13:06:02.538295 19483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f93ee515a9c14139bf566522ed8232f3" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 14 candidate_status { last_received { term: 12 index: 5 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
W20260709 13:06:02.494347 23480 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.146s	user 0.003s	sys 0.019s
I20260709 13:06:02.597843 20078 leader_election.cc:304] T 6c5eebf646ad445a9d1b1adc319d7b16 P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 127766fc592545a4997f7790f50f6076; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:06:02.599239 20078 leader_election.cc:304] T 5ec1c4ce15e04c7e8c283a62179f2a64 P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, 127766fc592545a4997f7790f50f6076; no voters: e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:06:02.414824 23469 consensus_queue.cc:237] T ff9b0eddd810459b82d91c60777c10eb P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:02.543125 23434 consensus_queue.cc:237] T 309c3ca0ca4b4f3ba129752ea2cb293b P 127766fc592545a4997f7790f50f6076 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 9, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } attrs { replace: true } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
W20260709 13:06:02.546277 23542 log.cc:927] Time spent T 40e1e16737a842ee936002830f36882e P e5256d91808b47c195bc9b4dbd7f2b87: Append to log took a long time: real 0.097s	user 0.001s	sys 0.000s
I20260709 13:06:02.555853 19478 raft_consensus.cc:2468] T 2725d2c4cb054f18b0fc8f735c15f6c2 P 0473d2b2d01f4459b1e90fd12cc7840e [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 12.
I20260709 13:06:02.517313 23340 leader_election.cc:290] T ece3db938bc649d4a40a51522ed5259c P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 10 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:06:02.559928 20110 raft_consensus.cc:1240] T 96efeaaf1057492490e9a621f37e1a2d P 127766fc592545a4997f7790f50f6076 [term 12 FOLLOWER]: Rejecting Update request from peer e61c3a8f61bb48f8a963c9480e53c168 for earlier term 11. Current term is 12. Ops: [9.8-11.9]
I20260709 13:06:02.476033 23378 raft_consensus.cc:3060] T f93ee515a9c14139bf566522ed8232f3 P 0473d2b2d01f4459b1e90fd12cc7840e [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:06:02.376747 23517 consensus_queue.cc:237] T f1b10566f45d4a7d9029858330e02d5b P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
W20260709 13:06:02.543918 23496 log.cc:927] Time spent T f93ee515a9c14139bf566522ed8232f3 P 0473d2b2d01f4459b1e90fd12cc7840e: Append to log took a long time: real 0.062s	user 0.000s	sys 0.000s
W20260709 13:06:02.566816 23539 log.cc:927] Time spent T 2b74109013a140ada21feeef92d6f563 P e5256d91808b47c195bc9b4dbd7f2b87: Append to log took a long time: real 0.102s	user 0.000s	sys 0.001s
I20260709 13:06:02.619078 19402 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52328 (request call id 1901) took 1335 ms. Trace:
I20260709 13:06:02.619442 19402 rpcz_store.cc:276] 0709 13:06:01.283584 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:01.283757 (+   173us) service_pool.cc:224] Handling call
0709 13:06:01.310933 (+ 27176us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:01.311445 (+   512us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:01.311497 (+    52us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:01.312090 (+   593us) log.cc:844] Serialized 26 byte log entry
0709 13:06:02.018489 (+706399us) spinlock_profiling.cc:243] Waited 3.48 ms on lock 0x7b1800433a20. stack: 00007f4a79de9343 00007f4a79de9240 00007f4a797781d4 00007f4a834b6304 00007f4a834b6299 00007f4a82ce3de1 00007f4a82cf05b1 00007f4a79dfde07 00007f4a82c58ab9 00007f4a79e1a69b 00007f4a79e1893f 00007f4a79e1ac02 00007f4a7caa220b 00007f4a7caa7d23 00007f4a7caa80d1 00007f4a7cec3a0f
0709 13:06:02.226340 (+207851us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:06:02.226382 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:02.226449 (+    67us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:02.618796 (+392347us) raft_consensus.cc:1685] finished
0709 13:06:02.618813 (+    17us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:02.619009 (+   196us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":7929,"raft.run_cpu_time_us":192,"raft.run_wall_time_us":10600,"spinlock_wait_cycles":8002432,"thread_start_us":207666,"threads_started":1,"wal-append.queue_time_us":1005179}
I20260709 13:06:02.622445 23268 leader_election.cc:290] T 14935b3ddf914369822e4a0547aaa355 P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 10 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:06:02.568049 19408 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52328 (request call id 1910) took 1274 ms. Trace:
W20260709 13:06:02.570732 19376 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:02.626827 23545 consensus_queue.cc:1059] T 1efebf73c86e432baa55533136b6e12c P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.027s
I20260709 13:06:02.627034 19408 rpcz_store.cc:276] 0709 13:06:01.293784 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:01.880764 (+586980us) service_pool.cc:224] Handling call
0709 13:06:01.881122 (+   358us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:01.961692 (+ 80570us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:01.961740 (+    48us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:01.961797 (+    57us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:06:01.961849 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:02.567829 (+605980us) spinlock_profiling.cc:243] Waited 80.3 ms on lock 0x7b54000e60d4. stack: 00007f4a79de9343 00007f4a79de9240 00007f4a797781d4 00007f4a834b6304 00007f4a834b6299 00007f4a7ce71571 00007f4a7cf08e01 00007f4a7cf0783e 00007f4a81ecc419 00007f4a7b443bd4 00007f4a7b443b62 00007f4a7b443a91 00007f4a7b443a0c 00007f4a7b442cc2 00007f4a7b24348c 00007f4a7b2428c6
0709 13:06:02.567873 (+    44us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:02.567997 (+   124us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":184693120}
I20260709 13:06:02.627722 23343 raft_consensus.cc:3055] T 1efebf73c86e432baa55533136b6e12c P e61c3a8f61bb48f8a963c9480e53c168 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:06:02.628427 23343 raft_consensus.cc:740] T 1efebf73c86e432baa55533136b6e12c P e61c3a8f61bb48f8a963c9480e53c168 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: e61c3a8f61bb48f8a963c9480e53c168, State: Running, Role: LEADER
I20260709 13:06:02.600838 23480 raft_consensus.cc:697] T 1f85fc4b527a48848e5faa083b604e36 P e5256d91808b47c195bc9b4dbd7f2b87 [term 8 LEADER]: Becoming Leader. State: Replica: e5256d91808b47c195bc9b4dbd7f2b87, State: Running, Role: LEADER
I20260709 13:06:02.629213 23343 consensus_queue.cc:260] T 1efebf73c86e432baa55533136b6e12c P e61c3a8f61bb48f8a963c9480e53c168 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:02.576870 23538 raft_consensus.cc:2749] T ff75a1d4cb1f493db8f71ddc136ba9ab P 0473d2b2d01f4459b1e90fd12cc7840e [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:06:02.630016 23480 consensus_queue.cc:237] T 1f85fc4b527a48848e5faa083b604e36 P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:02.579910 23220 leader_election.cc:290] T ab43d85f64114d4ebf618930e43d9ed0 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 11 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:06:02.580792 19484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cdf56e38bbc453d9438d359e5a69955" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:06:02.631596 19484 raft_consensus.cc:3060] T 0cdf56e38bbc453d9438d359e5a69955 P 0473d2b2d01f4459b1e90fd12cc7840e [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:06:02.580919 23335 raft_consensus.cc:515] T 2b74109013a140ada21feeef92d6f563 P 0473d2b2d01f4459b1e90fd12cc7840e [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:02.581658 19404 raft_consensus.cc:2468] T 70797e5783b5454ab0d0eea663e791e3 P e5256d91808b47c195bc9b4dbd7f2b87 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 11.
I20260709 13:06:02.582150 23368 raft_consensus.cc:493] T 65d8cb8d6ec64f459d5a47cefab10acf P e61c3a8f61bb48f8a963c9480e53c168 [term 8 FOLLOWER]: Starting leader election (detected failure of leader e5256d91808b47c195bc9b4dbd7f2b87)
I20260709 13:06:02.583145 23549 raft_consensus.cc:493] T 85c494af21f9457a85da47b9bc70c1fd P e5256d91808b47c195bc9b4dbd7f2b87 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:02.651258 23549 raft_consensus.cc:515] T 85c494af21f9457a85da47b9bc70c1fd P e5256d91808b47c195bc9b4dbd7f2b87 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:02.651697 23335 leader_election.cc:290] T 2b74109013a140ada21feeef92d6f563 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 7 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:06:02.544499 23505 raft_consensus.cc:515] T 3e1f505cb0f1427bbd698ac889d80821 P e61c3a8f61bb48f8a963c9480e53c168 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
W20260709 13:06:02.583616 23535 log.cc:927] Time spent T 217b5fae677b4971b3bbd2f357a1f7ff P e5256d91808b47c195bc9b4dbd7f2b87: Append to log took a long time: real 0.180s	user 0.001s	sys 0.000s
I20260709 13:06:02.653087 23368 raft_consensus.cc:3060] T 65d8cb8d6ec64f459d5a47cefab10acf P e61c3a8f61bb48f8a963c9480e53c168 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:06:02.584396 23531 log.cc:927] Time spent T ff75a1d4cb1f493db8f71ddc136ba9ab P e5256d91808b47c195bc9b4dbd7f2b87: Append to log took a long time: real 0.212s	user 0.000s	sys 0.001s
W20260709 13:06:02.585315 23540 log.cc:927] Time spent T 65d8cb8d6ec64f459d5a47cefab10acf P e61c3a8f61bb48f8a963c9480e53c168: Append to log took a long time: real 0.139s	user 0.000s	sys 0.000s
I20260709 13:06:02.654170 23505 leader_election.cc:290] T 3e1f505cb0f1427bbd698ac889d80821 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 11 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:06:02.324383 19411 rpcz_store.cc:276] 0709 13:06:01.292235 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:01.703890 (+411655us) service_pool.cc:224] Handling call
0709 13:06:01.708641 (+  4751us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:01.708784 (+   143us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:06:01.726045 (+ 17261us) log.cc:844] Serialized 14 byte log entry
0709 13:06:02.304061 (+578016us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:02.304115 (+    54us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:06:02.304169 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:02.304234 (+    65us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:02.304342 (+   108us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":41238,"prepare.queue_time_us":112415,"prepare.run_cpu_time_us":50,"prepare.run_wall_time_us":2503,"raft.queue_time_us":24776,"raft.run_cpu_time_us":126,"raft.run_wall_time_us":8256,"thread_start_us":553409,"threads_started":1}
I20260709 13:06:02.654716 23475 consensus_queue.cc:237] T ece3db938bc649d4a40a51522ed5259c P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:02.655791 19554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14935b3ddf914369822e4a0547aaa355" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
W20260709 13:06:02.585974 19486 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58286 (request call id 1936) took 1789 ms (client timeout 1678 ms). Trace:
I20260709 13:06:02.539490 23194 consensus_queue.cc:1048] T 0e1085d23e8347fbbd5bce7542f4b1f4 P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Connected to new peer: Peer: permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.053s
I20260709 13:06:02.432045 23532 raft_consensus.cc:515] T d1e5873a19244c5ebbcd38e126796ee7 P 0473d2b2d01f4459b1e90fd12cc7840e [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:02.464380 23530 raft_consensus.cc:515] T e381f1d6b8184797ad142de49be225a8 P 0473d2b2d01f4459b1e90fd12cc7840e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:02.587911 23433 leader_election.cc:290] T 9962423cb4e54fcfa5de01daf68a86e7 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
W20260709 13:06:02.588630 23536 log.cc:927] Time spent T 00000000000000000000000000000000 P 97750b77d35444acb7791ebf26cc2685: Append to log took a long time: real 0.250s	user 0.000s	sys 0.001s
I20260709 13:06:02.589077 23351 leader_election.cc:290] T df751f992649444090e27965eb1af85d P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 13 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
W20260709 13:06:02.475075 23523 consensus_queue.cc:1175] T f93ee515a9c14139bf566522ed8232f3 P 0473d2b2d01f4459b1e90fd12cc7840e [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "e61c3a8f61bb48f8a963c9480e53c168" responder_term: 14 status { last_received { term: 12 index: 5 } last_committed_idx: 5 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer 0473d2b2d01f4459b1e90fd12cc7840e for earlier term 13. Current term is 14. Ops: [13.6-13.6]" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 13:06:02.590019 19556 raft_consensus.cc:1240] T 7f575b143b844aa096b50997dad3516a P e61c3a8f61bb48f8a963c9480e53c168 [term 7 FOLLOWER]: Rejecting Update request from peer e5256d91808b47c195bc9b4dbd7f2b87 for earlier term 6. Current term is 7. Ops: []
I20260709 13:06:02.589701 23478 consensus_queue.cc:237] T 2a16f7501e2444fb86d4e2778e734e02 P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:02.590468 19555 raft_consensus.cc:1240] T 217b5fae677b4971b3bbd2f357a1f7ff P e61c3a8f61bb48f8a963c9480e53c168 [term 8 FOLLOWER]: Rejecting Update request from peer e5256d91808b47c195bc9b4dbd7f2b87 for earlier term 7. Current term is 8. Ops: []
I20260709 13:06:02.591109 19410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab43d85f64114d4ebf618930e43d9ed0" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
I20260709 13:06:02.591606 19481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "217b5fae677b4971b3bbd2f357a1f7ff" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:06:02.724941 19481 raft_consensus.cc:3060] T 217b5fae677b4971b3bbd2f357a1f7ff P 0473d2b2d01f4459b1e90fd12cc7840e [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:06:02.592000 23491 leader_election.cc:290] T 96efeaaf1057492490e9a621f37e1a2d P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 12 election: Requested vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:06:02.589102 23529 raft_consensus.cc:493] T 21e14947d70440f19044d8f75c31e1f9 P e61c3a8f61bb48f8a963c9480e53c168 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:02.568471 23420 raft_consensus.cc:493] T a08760e15aac4630a629431f56024dc8 P e5256d91808b47c195bc9b4dbd7f2b87 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader e61c3a8f61bb48f8a963c9480e53c168)
W20260709 13:06:02.699831 23502 log.cc:927] Time spent T 1dc5b3532fe54f74876d02beffa2c230 P e61c3a8f61bb48f8a963c9480e53c168: Append to log took a long time: real 0.087s	user 0.000s	sys 0.000s
I20260709 13:06:02.602088 20078 leader_election.cc:304] T ed7fdbcb96d14d418db9ca90a792588a P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, 127766fc592545a4997f7790f50f6076; no voters: e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:06:02.602494 19478 raft_consensus.cc:1240] T 48824d5acfbc485ebf8c2d944e7202de P 0473d2b2d01f4459b1e90fd12cc7840e [term 11 FOLLOWER]: Rejecting Update request from peer e61c3a8f61bb48f8a963c9480e53c168 for earlier term 10. Current term is 11. Ops: []
W20260709 13:06:02.730121 20078 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.2:46257, user_credentials={real_user=slave}} blocked reactor thread for 128111us
W20260709 13:06:02.730437 19452 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:02.730834 19478 raft_consensus.cc:1275] T 62c6c134d3d24a1ab144dd9ee6bc3f64 P 0473d2b2d01f4459b1e90fd12cc7840e [term 10 FOLLOWER]: Refusing update from remote peer e61c3a8f61bb48f8a963c9480e53c168: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 13:06:02.731880 19478 raft_consensus.cc:1240] T 2b74109013a140ada21feeef92d6f563 P 0473d2b2d01f4459b1e90fd12cc7840e [term 7 FOLLOWER]: Rejecting Update request from peer e61c3a8f61bb48f8a963c9480e53c168 for earlier term 6. Current term is 7. Ops: []
W20260709 13:06:02.603773 19450 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.3:36891, user_credentials={real_user=slave}} blocked reactor thread for 228252us
I20260709 13:06:02.733372 19450 leader_election.cc:304] T 7be9efa6559648dbb5a0f7684c4542d1 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:06:02.574554 23436 leader_election.cc:290] T 1dc5b3532fe54f74876d02beffa2c230 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 11 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:06:02.614789 19558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96efeaaf1057492490e9a621f37e1a2d" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 12 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:06:02.611196 23492 raft_consensus.cc:2804] T 5ec1c4ce15e04c7e8c283a62179f2a64 P 127766fc592545a4997f7790f50f6076 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:06:02.571812 19407 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52328 (request call id 1890) took 1479 ms. Trace:
I20260709 13:06:02.604243 23534 raft_consensus.cc:2749] T 6c5eebf646ad445a9d1b1adc319d7b16 P 127766fc592545a4997f7790f50f6076 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:06:02.656507 19486 rpcz_store.cc:269] 0709 13:06:00.796094 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:00.798253 (+  2159us) service_pool.cc:224] Handling call
0709 13:06:02.585749 (+1787496us) spinlock_profiling.cc:243] Waited 913 ms on lock 0x7b5400353754. stack: 00007f4a79de9343 00007f4a79de9240 00007f4a797781d4 00007f4a834b6304 00007f4a834b6299 00007f4a7ce71571 00007f4a7cf0c2fa 00007f4a81ecdb17 00007f4a7b4486d4 00007f4a7b448662 00007f4a7b448591 00007f4a7b44850c 00007f4a7b4477c2 00007f4a7b24348c 00007f4a7b2428c6 00007f4a7b24226f
0709 13:06:02.585904 (+   155us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2098925824}
I20260709 13:06:02.664629 19484 raft_consensus.cc:2468] T 0cdf56e38bbc453d9438d359e5a69955 P 0473d2b2d01f4459b1e90fd12cc7840e [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 12.
I20260709 13:06:02.666946 19409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9f0d59553ad444883fcf5b5909f9798" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:06:02.646559 23343 raft_consensus.cc:3060] T 1efebf73c86e432baa55533136b6e12c P e61c3a8f61bb48f8a963c9480e53c168 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:06:02.634176 23338 raft_consensus.cc:515] T 14935b3ddf914369822e4a0547aaa355 P e61c3a8f61bb48f8a963c9480e53c168 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } attrs { replace: true } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:02.733645 23351 raft_consensus.cc:493] T edd7d470b5014c9489be7f41f64355c9 P 0473d2b2d01f4459b1e90fd12cc7840e [term 11 FOLLOWER]: Starting pre-election (detected failure of leader e61c3a8f61bb48f8a963c9480e53c168)
W20260709 13:06:02.716357 19526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.2:46257, user_credentials={real_user=slave}} blocked reactor thread for 154220us
I20260709 13:06:02.718372 19402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dc5b3532fe54f74876d02beffa2c230" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 11 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
I20260709 13:06:02.721344 23368 raft_consensus.cc:515] T 65d8cb8d6ec64f459d5a47cefab10acf P e61c3a8f61bb48f8a963c9480e53c168 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:02.607710 23344 raft_consensus.cc:515] T 4509b76741dc428e9201c70c1658da13 P e61c3a8f61bb48f8a963c9480e53c168 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:02.755239 20107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "309c3ca0ca4b4f3ba129752ea2cb293b" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:06:02.727284 19410 raft_consensus.cc:2393] T ab43d85f64114d4ebf618930e43d9ed0 P e5256d91808b47c195bc9b4dbd7f2b87 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate e61c3a8f61bb48f8a963c9480e53c168 in current term 11: Already voted for candidate 127766fc592545a4997f7790f50f6076 in this term.
I20260709 13:06:02.520524 19485 raft_consensus.cc:2468] T 7f575b143b844aa096b50997dad3516a P 0473d2b2d01f4459b1e90fd12cc7840e [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 7.
I20260709 13:06:02.728716 19408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14935b3ddf914369822e4a0547aaa355" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
I20260709 13:06:02.757855 19408 raft_consensus.cc:3060] T 14935b3ddf914369822e4a0547aaa355 P e5256d91808b47c195bc9b4dbd7f2b87 [term 8 FOLLOWER]: Advancing to term 10
I20260709 13:06:02.734962 19478 raft_consensus.cc:1275] T 0e1085d23e8347fbbd5bce7542f4b1f4 P 0473d2b2d01f4459b1e90fd12cc7840e [term 8 FOLLOWER]: Refusing update from remote peer e61c3a8f61bb48f8a963c9480e53c168: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:06:02.736387 20104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed7fdbcb96d14d418db9ca90a792588a" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:06:02.737795 19407 rpcz_store.cc:276] 0709 13:06:01.092914 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:01.093226 (+   312us) service_pool.cc:224] Handling call
0709 13:06:02.571639 (+1478413us) spinlock_profiling.cc:243] Waited 1.21 s on lock 0x7b540023a354. stack: 00007f4a79de9343 00007f4a79de9240 00007f4a797781d4 00007f4a834b6304 00007f4a834b6299 00007f4a7ce71571 00007f4a7cf0c2fa 00007f4a81ecdb17 00007f4a7b4486d4 00007f4a7b448662 00007f4a7b448591 00007f4a7b44850c 00007f4a7b4477c2 00007f4a7b24348c 00007f4a7b2428c6 00007f4a7b24226f
0709 13:06:02.571760 (+   121us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2772701440}
W20260709 13:06:02.663530 23489 consensus_meta.cc:287] T 1f85fc4b527a48848e5faa083b604e36 P 0473d2b2d01f4459b1e90fd12cc7840e: Time spent flushing consensus metadata: real 0.743s	user 0.008s	sys 0.004s
I20260709 13:06:02.747392 20111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff9b0eddd810459b82d91c60777c10eb" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:06:02.767611 20111 raft_consensus.cc:2393] T ff9b0eddd810459b82d91c60777c10eb P 127766fc592545a4997f7790f50f6076 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0473d2b2d01f4459b1e90fd12cc7840e in current term 10: Already voted for candidate e5256d91808b47c195bc9b4dbd7f2b87 in this term.
I20260709 13:06:02.748430 19450 leader_election.cc:304] T b9f0d59553ad444883fcf5b5909f9798 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:06:02.749791 19526 leader_election.cc:304] T 76cb037fc9064d13b59a8969d897ce8c P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168; no voters: e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:06:02.771744 19558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48824d5acfbc485ebf8c2d944e7202de" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:06:02.730700 23420 raft_consensus.cc:515] T a08760e15aac4630a629431f56024dc8 P e5256d91808b47c195bc9b4dbd7f2b87 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:02.761318 19409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b74109013a140ada21feeef92d6f563" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
I20260709 13:06:02.764415 19554 raft_consensus.cc:2393] T 14935b3ddf914369822e4a0547aaa355 P e61c3a8f61bb48f8a963c9480e53c168 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 127766fc592545a4997f7790f50f6076 in current term 10: Already voted for candidate e61c3a8f61bb48f8a963c9480e53c168 in this term.
I20260709 13:06:02.735796 23491 raft_consensus.cc:2764] T ed7fdbcb96d14d418db9ca90a792588a P 127766fc592545a4997f7790f50f6076 [term 8 FOLLOWER]: Leader pre-election decision vote started in defunct term 6: won
I20260709 13:06:02.773216 19410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df751f992649444090e27965eb1af85d" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
I20260709 13:06:02.754796 20103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7be9efa6559648dbb5a0f7684c4542d1" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076"
I20260709 13:06:02.781778 20103 raft_consensus.cc:3060] T 7be9efa6559648dbb5a0f7684c4542d1 P 127766fc592545a4997f7790f50f6076 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:06:02.783731 19478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab43d85f64114d4ebf618930e43d9ed0" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:06:02.784511 19478 raft_consensus.cc:2393] T ab43d85f64114d4ebf618930e43d9ed0 P 0473d2b2d01f4459b1e90fd12cc7840e [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 127766fc592545a4997f7790f50f6076 in current term 11: Already voted for candidate 0473d2b2d01f4459b1e90fd12cc7840e in this term.
I20260709 13:06:02.737658 23492 raft_consensus.cc:493] T 5ec1c4ce15e04c7e8c283a62179f2a64 P 127766fc592545a4997f7790f50f6076 [term 9 FOLLOWER]: Starting leader election (detected failure of leader e5256d91808b47c195bc9b4dbd7f2b87)
I20260709 13:06:02.785609 19407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9962423cb4e54fcfa5de01daf68a86e7" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:06:02.780512 19526 leader_election.cc:304] T a08760e15aac4630a629431f56024dc8 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168; no voters: e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:06:02.739315 23559 raft_consensus.cc:493] T 21e14947d70440f19044d8f75c31e1f9 P 0473d2b2d01f4459b1e90fd12cc7840e [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:02.729362 23529 raft_consensus.cc:515] T 21e14947d70440f19044d8f75c31e1f9 P e61c3a8f61bb48f8a963c9480e53c168 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:03.098250 19478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1efebf73c86e432baa55533136b6e12c" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:06:02.787671 19485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96efeaaf1057492490e9a621f37e1a2d" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 12 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:06:03.094445 19408 raft_consensus.cc:2468] T 14935b3ddf914369822e4a0547aaa355 P e5256d91808b47c195bc9b4dbd7f2b87 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 127766fc592545a4997f7790f50f6076 in term 10.
I20260709 13:06:02.840997 20111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48824d5acfbc485ebf8c2d944e7202de" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076"
I20260709 13:06:03.093550 19557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab43d85f64114d4ebf618930e43d9ed0" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:06:02.840169 19559 raft_consensus.cc:1240] T 4509b76741dc428e9201c70c1658da13 P e61c3a8f61bb48f8a963c9480e53c168 [term 5 FOLLOWER]: Rejecting Update request from peer 0473d2b2d01f4459b1e90fd12cc7840e for earlier term 4. Current term is 5. Ops: []
I20260709 13:06:02.861027 20107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "172b3dd13109415a955b71ac0e9d2234" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:06:03.015993 20104 raft_consensus.cc:2393] T ed7fdbcb96d14d418db9ca90a792588a P 127766fc592545a4997f7790f50f6076 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0473d2b2d01f4459b1e90fd12cc7840e in current term 8: Already voted for candidate e61c3a8f61bb48f8a963c9480e53c168 in this term.
I20260709 13:06:03.113932 20078 leader_election.cc:304] T 96efeaaf1057492490e9a621f37e1a2d P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 127766fc592545a4997f7790f50f6076; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:06:02.796864 19555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dc5b3532fe54f74876d02beffa2c230" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 11 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:06:02.794305 19411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab43d85f64114d4ebf618930e43d9ed0" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
I20260709 13:06:03.116621 19411 raft_consensus.cc:2393] T ab43d85f64114d4ebf618930e43d9ed0 P e5256d91808b47c195bc9b4dbd7f2b87 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 0473d2b2d01f4459b1e90fd12cc7840e in current term 11: Already voted for candidate 127766fc592545a4997f7790f50f6076 in this term.
I20260709 13:06:03.098213 19480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14935b3ddf914369822e4a0547aaa355" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:06:03.117409 20103 raft_consensus.cc:2468] T 7be9efa6559648dbb5a0f7684c4542d1 P 127766fc592545a4997f7790f50f6076 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 11.
I20260709 13:06:02.841698 19558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df751f992649444090e27965eb1af85d" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:06:03.092567 19481 raft_consensus.cc:2468] T 217b5fae677b4971b3bbd2f357a1f7ff P 0473d2b2d01f4459b1e90fd12cc7840e [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 8.
I20260709 13:06:03.118844 19558 raft_consensus.cc:3060] T df751f992649444090e27965eb1af85d P e61c3a8f61bb48f8a963c9480e53c168 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:06:03.127462 20103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab43d85f64114d4ebf618930e43d9ed0" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076"
I20260709 13:06:03.129786 20103 raft_consensus.cc:2393] T ab43d85f64114d4ebf618930e43d9ed0 P 127766fc592545a4997f7790f50f6076 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 0473d2b2d01f4459b1e90fd12cc7840e in current term 11: Already voted for candidate 127766fc592545a4997f7790f50f6076 in this term.
I20260709 13:06:02.774021 23436 raft_consensus.cc:2804] T 7be9efa6559648dbb5a0f7684c4542d1 P 0473d2b2d01f4459b1e90fd12cc7840e [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:06:02.779405 23220 raft_consensus.cc:2804] T b9f0d59553ad444883fcf5b5909f9798 P 0473d2b2d01f4459b1e90fd12cc7840e [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:06:02.777958 23489 raft_consensus.cc:2749] T 1f85fc4b527a48848e5faa083b604e36 P 0473d2b2d01f4459b1e90fd12cc7840e [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 13:06:03.146318 19526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.2:46257, user_credentials={real_user=slave}} blocked reactor thread for 365854us
I20260709 13:06:03.153596 19557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b74109013a140ada21feeef92d6f563" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:06:02.791255 23413 raft_consensus.cc:2804] T 76cb037fc9064d13b59a8969d897ce8c P e61c3a8f61bb48f8a963c9480e53c168 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:06:03.081743 23344 leader_election.cc:290] T 4509b76741dc428e9201c70c1658da13 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 5 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:06:03.166750 19477 raft_consensus.cc:2468] T 1f85fc4b527a48848e5faa083b604e36 P 0473d2b2d01f4459b1e90fd12cc7840e [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 8.
I20260709 13:06:03.155617 20107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9962423cb4e54fcfa5de01daf68a86e7" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:06:02.774164 23351 raft_consensus.cc:515] T edd7d470b5014c9489be7f41f64355c9 P 0473d2b2d01f4459b1e90fd12cc7840e [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:03.080606 23532 leader_election.cc:290] T d1e5873a19244c5ebbcd38e126796ee7 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
W20260709 13:06:03.158619 20078 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.2:46257, user_credentials={real_user=slave}} blocked reactor thread for 44806.8us
I20260709 13:06:02.856431 23433 raft_consensus.cc:493] T 14935b3ddf914369822e4a0547aaa355 P 0473d2b2d01f4459b1e90fd12cc7840e [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:02.866879 23556 raft_consensus.cc:493] T 1a61655d99124a29b486ba4a5b37faea P 0473d2b2d01f4459b1e90fd12cc7840e [term 7 FOLLOWER]: Starting pre-election (detected failure of leader e61c3a8f61bb48f8a963c9480e53c168)
I20260709 13:06:02.860929 23544 raft_consensus.cc:493] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P 127766fc592545a4997f7790f50f6076 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader e5256d91808b47c195bc9b4dbd7f2b87)
I20260709 13:06:03.124708 23492 raft_consensus.cc:3060] T 5ec1c4ce15e04c7e8c283a62179f2a64 P 127766fc592545a4997f7790f50f6076 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:06:03.165748 23420 leader_election.cc:290] T a08760e15aac4630a629431f56024dc8 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:06:03.163144 20111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65d8cb8d6ec64f459d5a47cefab10acf" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076"
I20260709 13:06:02.861958 23368 leader_election.cc:290] T 65d8cb8d6ec64f459d5a47cefab10acf P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 9 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:06:03.150732 23220 raft_consensus.cc:493] T b9f0d59553ad444883fcf5b5909f9798 P 0473d2b2d01f4459b1e90fd12cc7840e [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:03.159384 23545 raft_consensus.cc:2804] T a08760e15aac4630a629431f56024dc8 P e61c3a8f61bb48f8a963c9480e53c168 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:06:03.160465 23436 raft_consensus.cc:697] T 7be9efa6559648dbb5a0f7684c4542d1 P 0473d2b2d01f4459b1e90fd12cc7840e [term 11 LEADER]: Becoming Leader. State: Replica: 0473d2b2d01f4459b1e90fd12cc7840e, State: Running, Role: LEADER
I20260709 13:06:03.159698 23413 raft_consensus.cc:493] T 76cb037fc9064d13b59a8969d897ce8c P e61c3a8f61bb48f8a963c9480e53c168 [term 9 FOLLOWER]: Starting leader election (detected failure of leader e5256d91808b47c195bc9b4dbd7f2b87)
I20260709 13:06:03.027658 23538 raft_consensus.cc:493] T 0e1085d23e8347fbbd5bce7542f4b1f4 P 0473d2b2d01f4459b1e90fd12cc7840e [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:03.170486 23534 raft_consensus.cc:2749] T 96efeaaf1057492490e9a621f37e1a2d P 127766fc592545a4997f7790f50f6076 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:06:03.198985 19558 raft_consensus.cc:2468] T df751f992649444090e27965eb1af85d P e61c3a8f61bb48f8a963c9480e53c168 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 13.
I20260709 13:06:03.134552 23559 raft_consensus.cc:515] T 21e14947d70440f19044d8f75c31e1f9 P 0473d2b2d01f4459b1e90fd12cc7840e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
W20260709 13:06:03.196447 23378 consensus_meta.cc:287] T f93ee515a9c14139bf566522ed8232f3 P 0473d2b2d01f4459b1e90fd12cc7840e: Time spent flushing consensus metadata: real 0.561s	user 0.004s	sys 0.005s
I20260709 13:06:03.170708 23505 consensus_queue.cc:1059] T 48824d5acfbc485ebf8c2d944e7202de P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.029s
I20260709 13:06:03.188694 23344 consensus_queue.cc:1048] T 62c6c134d3d24a1ab144dd9ee6bc3f64 P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.015s
I20260709 13:06:03.212977 19483 raft_consensus.cc:2410] T f93ee515a9c14139bf566522ed8232f3 P 0473d2b2d01f4459b1e90fd12cc7840e [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate e61c3a8f61bb48f8a963c9480e53c168 for term 14 because replica has last-logged OpId of term: 13 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 5.
I20260709 13:06:03.210741 23338 leader_election.cc:290] T 14935b3ddf914369822e4a0547aaa355 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 10 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:06:03.203624 23220 raft_consensus.cc:3060] T b9f0d59553ad444883fcf5b5909f9798 P 0473d2b2d01f4459b1e90fd12cc7840e [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:06:03.214804 23505 raft_consensus.cc:3055] T 48824d5acfbc485ebf8c2d944e7202de P e61c3a8f61bb48f8a963c9480e53c168 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:06:03.215260 23505 raft_consensus.cc:740] T 48824d5acfbc485ebf8c2d944e7202de P e61c3a8f61bb48f8a963c9480e53c168 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: e61c3a8f61bb48f8a963c9480e53c168, State: Running, Role: LEADER
I20260709 13:06:03.216058 23505 consensus_queue.cc:260] T 48824d5acfbc485ebf8c2d944e7202de P e61c3a8f61bb48f8a963c9480e53c168 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:03.217281 23505 raft_consensus.cc:3060] T 48824d5acfbc485ebf8c2d944e7202de P e61c3a8f61bb48f8a963c9480e53c168 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:06:03.196632 23544 raft_consensus.cc:515] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P 127766fc592545a4997f7790f50f6076 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:03.220148 23407 leader_election.cc:290] T 48824d5acfbc485ebf8c2d944e7202de P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 11 election: Requested vote from peers e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:06:03.220575 23544 leader_election.cc:290] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:06:03.221092 19553 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40438 (request call id 2266) took 1208 ms. Trace:
I20260709 13:06:03.221441 19553 rpcz_store.cc:276] 0709 13:06:02.012755 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:02.012868 (+   113us) service_pool.cc:224] Handling call
0709 13:06:03.220904 (+1208036us) spinlock_profiling.cc:243] Waited 252 ms on lock 0x7b540009c4d4. stack: 00007f4a79de9343 00007f4a79de9240 00007f4a797781d4 00007f4a834b6304 00007f4a834b6299 00007f4a7ce71571 00007f4a7cf0c2fa 00007f4a81ecdb17 00007f4a7b4486d4 00007f4a7b448662 00007f4a7b448591 00007f4a7b44850c 00007f4a7b4477c2 00007f4a7b24348c 00007f4a7b2428c6 00007f4a7b24226f
0709 13:06:03.221039 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":578970880}
I20260709 13:06:03.195124 23556 raft_consensus.cc:515] T 1a61655d99124a29b486ba4a5b37faea P 0473d2b2d01f4459b1e90fd12cc7840e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:03.204452 23545 raft_consensus.cc:493] T a08760e15aac4630a629431f56024dc8 P e61c3a8f61bb48f8a963c9480e53c168 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:03.207484 23413 raft_consensus.cc:3060] T 76cb037fc9064d13b59a8969d897ce8c P e61c3a8f61bb48f8a963c9480e53c168 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:06:03.206895 23530 leader_election.cc:290] T e381f1d6b8184797ad142de49be225a8 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:06:03.195266 23433 raft_consensus.cc:515] T 14935b3ddf914369822e4a0547aaa355 P 0473d2b2d01f4459b1e90fd12cc7840e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } attrs { replace: true } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:03.231269 23545 raft_consensus.cc:3060] T a08760e15aac4630a629431f56024dc8 P e61c3a8f61bb48f8a963c9480e53c168 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:06:03.209944 23538 raft_consensus.cc:515] T 0e1085d23e8347fbbd5bce7542f4b1f4 P 0473d2b2d01f4459b1e90fd12cc7840e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:03.251852 19480 raft_consensus.cc:3060] T 14935b3ddf914369822e4a0547aaa355 P 0473d2b2d01f4459b1e90fd12cc7840e [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:06:03.242268 23434 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.604s	user 0.004s	sys 0.011s
I20260709 13:06:03.252326 18300 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:06:03.275581 19556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e5873a19244c5ebbcd38e126796ee7" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
W20260709 13:06:03.276903 19377 connection.cc:256] RPC call timeout handler was delayed by -1.6306625450000638s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20190000000000002s for a response
I20260709 13:06:03.271951 19450 leader_election.cc:304] T df751f992649444090e27965eb1af85d P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
W20260709 13:06:03.263326 23434 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.628s	user 0.004s	sys 0.012s
I20260709 13:06:03.282076 19556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e381f1d6b8184797ad142de49be225a8" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
W20260709 13:06:03.287369 19526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.2:46257, user_credentials={real_user=slave}} blocked reactor thread for 138605us
W20260709 13:06:03.283599 19524 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:03.280716 23456 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.552s	user 0.002s	sys 0.015s
W20260709 13:06:03.293038 19524 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:03.289451 23541 raft_consensus.cc:2804] T df751f992649444090e27965eb1af85d P 0473d2b2d01f4459b1e90fd12cc7840e [term 13 FOLLOWER]: Leader election won for term 13
W20260709 13:06:03.312870 23564 log.cc:927] Time spent T 179fd671030940b4b4a4e24bcc4aba0a P e61c3a8f61bb48f8a963c9480e53c168: Append to log took a long time: real 0.101s	user 0.000s	sys 0.001s
W20260709 13:06:03.288262 23478 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.524s	user 0.014s	sys 0.004s
W20260709 13:06:03.335157 19452 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:03.336155 19556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edd7d470b5014c9489be7f41f64355c9" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 12 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:06:03.290169 23529 leader_election.cc:290] T 21e14947d70440f19044d8f75c31e1f9 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:06:03.343758 19526 leader_election.cc:304] T 0cdf56e38bbc453d9438d359e5a69955 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168; no voters: e5256d91808b47c195bc9b4dbd7f2b87
W20260709 13:06:03.341501 20078 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.2:46257, user_credentials={real_user=slave}} blocked reactor thread for 149157us
I20260709 13:06:03.256052 23436 consensus_queue.cc:237] T 7be9efa6559648dbb5a0f7684c4542d1 P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.7, Last appended by leader: 7, Current term: 11, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } attrs { replace: true } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:03.286959 23440 consensus_queue.cc:1048] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.048s
W20260709 13:06:03.324090 23456 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.596s	user 0.002s	sys 0.015s
I20260709 13:06:03.344861 20078 leader_election.cc:304] T 1efebf73c86e432baa55533136b6e12c P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 127766fc592545a4997f7790f50f6076; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168
W20260709 13:06:03.340740 23478 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.573s	user 0.015s	sys 0.004s
I20260709 13:06:03.323570 23351 leader_election.cc:290] T edd7d470b5014c9489be7f41f64355c9 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
W20260709 13:06:03.353420 19377 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.2:46257, user_credentials={real_user=slave}} blocked reactor thread for 70051us
I20260709 13:06:03.356297 19556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a61655d99124a29b486ba4a5b37faea" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:06:03.347266 23541 raft_consensus.cc:697] T df751f992649444090e27965eb1af85d P 0473d2b2d01f4459b1e90fd12cc7840e [term 13 LEADER]: Becoming Leader. State: Replica: 0473d2b2d01f4459b1e90fd12cc7840e, State: Running, Role: LEADER
I20260709 13:06:03.354568 23580 consensus_queue.cc:1059] T 2b74109013a140ada21feeef92d6f563 P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 }, Status: INVALID_TERM, Last received: 6.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.028s
I20260709 13:06:03.358901 23456 consensus_queue.cc:1048] T 5ec1c4ce15e04c7e8c283a62179f2a64 P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.017s
I20260709 13:06:03.375967 23456 consensus_queue.cc:1243] T 5ec1c4ce15e04c7e8c283a62179f2a64 P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Peer 0473d2b2d01f4459b1e90fd12cc7840e log is divergent from this leader: its last log entry 6.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 13:06:03.353086 23434 raft_consensus.cc:2749] T 1efebf73c86e432baa55533136b6e12c P 127766fc592545a4997f7790f50f6076 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:06:03.378691 19526 leader_election.cc:304] T 7f575b143b844aa096b50997dad3516a P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168; no voters: e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:06:03.380206 23413 raft_consensus.cc:515] T 76cb037fc9064d13b59a8969d897ce8c P e61c3a8f61bb48f8a963c9480e53c168 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
W20260709 13:06:03.363843 23575 log.cc:927] Time spent T 172b3dd13109415a955b71ac0e9d2234 P 0473d2b2d01f4459b1e90fd12cc7840e: Append to log took a long time: real 0.071s	user 0.000s	sys 0.000s
I20260709 13:06:03.382167 23541 consensus_queue.cc:237] T df751f992649444090e27965eb1af85d P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:03.391247 23538 leader_election.cc:290] T 0e1085d23e8347fbbd5bce7542f4b1f4 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:06:03.395552 23433 leader_election.cc:290] T 14935b3ddf914369822e4a0547aaa355 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
W20260709 13:06:03.399382 23574 log.cc:927] Time spent T 309c3ca0ca4b4f3ba129752ea2cb293b P 127766fc592545a4997f7790f50f6076: Append to log took a long time: real 0.056s	user 0.000s	sys 0.000s
W20260709 13:06:03.404762 19404 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52328 (request call id 1911) took 2110 ms (client timeout 2044 ms). Trace:
I20260709 13:06:03.400777 23525 raft_consensus.cc:2804] T 0cdf56e38bbc453d9438d359e5a69955 P e61c3a8f61bb48f8a963c9480e53c168 [term 12 FOLLOWER]: Leader election won for term 12
W20260709 13:06:03.410794 19404 rpcz_store.cc:269] 0709 13:06:01.294112 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:01.455492 (+161380us) service_pool.cc:224] Handling call
0709 13:06:03.404522 (+1949030us) spinlock_profiling.cc:243] Waited 875 ms on lock 0x7b54000b2cd4. stack: 00007f4a79de9343 00007f4a79de9240 00007f4a797781d4 00007f4a834b6304 00007f4a834b6299 00007f4a7ce71571 00007f4a7cf0c2fa 00007f4a81ecdb17 00007f4a7b4486d4 00007f4a7b448662 00007f4a7b448591 00007f4a7b44850c 00007f4a7b4477c2 00007f4a7b24348c 00007f4a7b2428c6 00007f4a7b24226f
0709 13:06:03.404670 (+   148us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2012878720}
I20260709 13:06:03.405833 19480 raft_consensus.cc:2468] T 14935b3ddf914369822e4a0547aaa355 P 0473d2b2d01f4459b1e90fd12cc7840e [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 127766fc592545a4997f7790f50f6076 in term 10.
I20260709 13:06:03.354341 23556 leader_election.cc:290] T 1a61655d99124a29b486ba4a5b37faea P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:06:03.386237 23545 raft_consensus.cc:515] T a08760e15aac4630a629431f56024dc8 P e61c3a8f61bb48f8a963c9480e53c168 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:03.410442 23580 consensus_queue.cc:1048] T 0e1085d23e8347fbbd5bce7542f4b1f4 P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.004s
I20260709 13:06:03.404516 23559 leader_election.cc:290] T 21e14947d70440f19044d8f75c31e1f9 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:06:03.407611 23214 raft_consensus.cc:2804] T 7f575b143b844aa096b50997dad3516a P e61c3a8f61bb48f8a963c9480e53c168 [term 7 FOLLOWER]: Leader election won for term 7
W20260709 13:06:03.475001 19377 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.2:46257, user_credentials={real_user=slave}} blocked reactor thread for 120759us
I20260709 13:06:03.404119 23220 raft_consensus.cc:515] T b9f0d59553ad444883fcf5b5909f9798 P 0473d2b2d01f4459b1e90fd12cc7840e [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:03.476130 19377 leader_election.cc:304] T ab43d85f64114d4ebf618930e43d9ed0 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, 127766fc592545a4997f7790f50f6076
I20260709 13:06:03.453120 23434 raft_consensus.cc:493] T 1f85fc4b527a48848e5faa083b604e36 P 127766fc592545a4997f7790f50f6076 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:03.417598 23525 raft_consensus.cc:697] T 0cdf56e38bbc453d9438d359e5a69955 P e61c3a8f61bb48f8a963c9480e53c168 [term 12 LEADER]: Becoming Leader. State: Replica: e61c3a8f61bb48f8a963c9480e53c168, State: Running, Role: LEADER
I20260709 13:06:03.474912 23214 raft_consensus.cc:697] T 7f575b143b844aa096b50997dad3516a P e61c3a8f61bb48f8a963c9480e53c168 [term 7 LEADER]: Becoming Leader. State: Replica: e61c3a8f61bb48f8a963c9480e53c168, State: Running, Role: LEADER
I20260709 13:06:03.490077 23214 consensus_queue.cc:237] T 7f575b143b844aa096b50997dad3516a P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
W20260709 13:06:03.494061 23567 log.cc:927] Time spent T 1efebf73c86e432baa55533136b6e12c P 0473d2b2d01f4459b1e90fd12cc7840e: Append to log took a long time: real 0.281s	user 0.000s	sys 0.001s
I20260709 13:06:03.495697 19377 leader_election.cc:304] T ef32ce6fdd0e40d382c79974f30295c6 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87; no voters: e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:06:03.497085 19377 leader_election.cc:304] T 172b3dd13109415a955b71ac0e9d2234 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87; no voters: 127766fc592545a4997f7790f50f6076
I20260709 13:06:03.499470 19377 leader_election.cc:304] T ff75a1d4cb1f493db8f71ddc136ba9ab P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:06:03.488301 23585 raft_consensus.cc:2749] T ab43d85f64114d4ebf618930e43d9ed0 P e5256d91808b47c195bc9b4dbd7f2b87 [term 11 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:06:03.501452 23456 raft_consensus.cc:2804] T ef32ce6fdd0e40d382c79974f30295c6 P e5256d91808b47c195bc9b4dbd7f2b87 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:06:03.509212 23456 raft_consensus.cc:493] T ef32ce6fdd0e40d382c79974f30295c6 P e5256d91808b47c195bc9b4dbd7f2b87 [term 12 FOLLOWER]: Starting leader election (detected failure of leader e61c3a8f61bb48f8a963c9480e53c168)
I20260709 13:06:03.509708 23456 raft_consensus.cc:3060] T ef32ce6fdd0e40d382c79974f30295c6 P e5256d91808b47c195bc9b4dbd7f2b87 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:06:03.512164 19556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85c494af21f9457a85da47b9bc70c1fd" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:06:03.512648 19553 raft_consensus.cc:1240] T 76cb037fc9064d13b59a8969d897ce8c P e61c3a8f61bb48f8a963c9480e53c168 [term 10 FOLLOWER]: Rejecting Update request from peer e5256d91808b47c195bc9b4dbd7f2b87 for earlier term 9. Current term is 10. Ops: []
I20260709 13:06:03.512703 19558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a08760e15aac4630a629431f56024dc8" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:06:03.513435 19558 raft_consensus.cc:2368] T a08760e15aac4630a629431f56024dc8 P e61c3a8f61bb48f8a963c9480e53c168 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e5256d91808b47c195bc9b4dbd7f2b87 for earlier term 12. Current term is 13.
I20260709 13:06:03.513547 23476 raft_consensus.cc:3055] T 7f575b143b844aa096b50997dad3516a P e5256d91808b47c195bc9b4dbd7f2b87 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:06:03.514137 23476 raft_consensus.cc:740] T 7f575b143b844aa096b50997dad3516a P e5256d91808b47c195bc9b4dbd7f2b87 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: e5256d91808b47c195bc9b4dbd7f2b87, State: Running, Role: LEADER
W20260709 13:06:03.515447 23577 log.cc:927] Time spent T 2a16f7501e2444fb86d4e2778e734e02 P e5256d91808b47c195bc9b4dbd7f2b87: Append to log took a long time: real 0.107s	user 0.000s	sys 0.001s
I20260709 13:06:03.515225 23476 consensus_queue.cc:260] T 7f575b143b844aa096b50997dad3516a P e5256d91808b47c195bc9b4dbd7f2b87 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:03.516171 19559 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40428 (request call id 2357) took 1281 ms. Trace:
I20260709 13:06:03.501130 23440 raft_consensus.cc:2804] T 172b3dd13109415a955b71ac0e9d2234 P e5256d91808b47c195bc9b4dbd7f2b87 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:06:03.516539 19559 rpcz_store.cc:276] 0709 13:06:02.234973 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:02.235080 (+   107us) service_pool.cc:224] Handling call
0709 13:06:02.265489 (+ 30409us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:03.112471 (+846982us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:03.515947 (+403476us) spinlock_profiling.cc:243] Waited 537 ms on lock 0x7b5400125f54. stack: 00007f4a79de9343 00007f4a79de9240 00007f4a797781d4 00007f4a834b6304 00007f4a834b6299 00007f4a7ce71571 00007f4a7cf08e01 00007f4a7cf0783e 00007f4a81ecc419 00007f4a7b443bd4 00007f4a7b443b62 00007f4a7b443a91 00007f4a7b443a0c 00007f4a7b442cc2 00007f4a7b24348c 00007f4a7b2428c6
0709 13:06:03.516117 (+   170us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1236166528}
W20260709 13:06:03.520588 19375 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:03.521837 19375 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:03.523715 19377 leader_election.cc:304] T e381f1d6b8184797ad142de49be225a8 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:06:03.516453 23476 raft_consensus.cc:3060] T 7f575b143b844aa096b50997dad3516a P e5256d91808b47c195bc9b4dbd7f2b87 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:06:03.539142 23587 raft_consensus.cc:493] T f93ee515a9c14139bf566522ed8232f3 P e5256d91808b47c195bc9b4dbd7f2b87 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:03.506664 23492 raft_consensus.cc:515] T 5ec1c4ce15e04c7e8c283a62179f2a64 P 127766fc592545a4997f7790f50f6076 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:03.539789 23587 raft_consensus.cc:515] T f93ee515a9c14139bf566522ed8232f3 P e5256d91808b47c195bc9b4dbd7f2b87 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:03.541787 23492 leader_election.cc:290] T 5ec1c4ce15e04c7e8c283a62179f2a64 P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 10 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:06:03.542124 23587 leader_election.cc:290] T f93ee515a9c14139bf566522ed8232f3 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:06:03.542870 20112 raft_consensus.cc:1240] T 5ec1c4ce15e04c7e8c283a62179f2a64 P 127766fc592545a4997f7790f50f6076 [term 10 FOLLOWER]: Rejecting Update request from peer e5256d91808b47c195bc9b4dbd7f2b87 for earlier term 9. Current term is 10. Ops: []
I20260709 13:06:03.543860 23525 consensus_queue.cc:237] T 0cdf56e38bbc453d9438d359e5a69955 P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:03.547114 23545 leader_election.cc:290] T a08760e15aac4630a629431f56024dc8 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 13 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:06:03.525146 23585 raft_consensus.cc:2749] T ff75a1d4cb1f493db8f71ddc136ba9ab P e5256d91808b47c195bc9b4dbd7f2b87 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:06:03.518749 23440 raft_consensus.cc:493] T 172b3dd13109415a955b71ac0e9d2234 P e5256d91808b47c195bc9b4dbd7f2b87 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 127766fc592545a4997f7790f50f6076)
I20260709 13:06:03.548655 23440 raft_consensus.cc:3060] T 172b3dd13109415a955b71ac0e9d2234 P e5256d91808b47c195bc9b4dbd7f2b87 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:06:03.549541 23413 leader_election.cc:290] T 76cb037fc9064d13b59a8969d897ce8c P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 10 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:06:03.497008 23434 raft_consensus.cc:515] T 1f85fc4b527a48848e5faa083b604e36 P 127766fc592545a4997f7790f50f6076 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:03.552742 23434 leader_election.cc:290] T 1f85fc4b527a48848e5faa083b604e36 P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321)
I20260709 13:06:03.556468 19479 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58286 (request call id 1963) took 1177 ms. Trace:
I20260709 13:06:03.556901 19479 rpcz_store.cc:276] 0709 13:06:02.378957 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:02.544933 (+165976us) service_pool.cc:224] Handling call
0709 13:06:02.545220 (+   287us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:06:02.616535 (+ 71315us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:02.616577 (+    42us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:06:02.622462 (+  5885us) log.cc:844] Serialized 52 byte log entry
0709 13:06:02.734302 (+111840us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:06:02.747248 (+ 12946us) log.cc:844] Serialized 14 byte log entry
0709 13:06:02.750360 (+  3112us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:02.750431 (+    71us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:03.493473 (+743042us) spinlock_profiling.cc:243] Waited 7.35 ms on lock 0x7b4400022b4c. stack: 00007f4a79de9343 00007f4a79de9240 00007f4a797781d4 00007f4a834b6304 00007f4a834b6299 00007f4a79ca3db1 00007f4a79d41c85 00007f4a79d426a2 00007f4a7cab41db 00007f4a7caafaaf 00007f4a7caa386e 00007f4a7caa2bb6 00007f4a7caa27d8 00007f4a7caac221 00007f4a7caac1d9 00007f4a7caac169
0709 13:06:03.556150 (+ 62677us) raft_consensus.cc:1685] finished
0709 13:06:03.556257 (+   107us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:03.556407 (+   150us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":87958,"prepare.queue_time_us":12795,"prepare.run_cpu_time_us":34,"prepare.run_wall_time_us":35,"raft.queue_time_us":29337,"raft.run_cpu_time_us":171,"raft.run_wall_time_us":21152,"spinlock_wait_cycles":16898304,"thread_start_us":180768,"threads_started":2,"wal-append.queue_time_us":562432}
I20260709 13:06:03.547964 23220 leader_election.cc:290] T b9f0d59553ad444883fcf5b5909f9798 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 11 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:06:03.563201 23434 raft_consensus.cc:493] T 14efcc79969f41babe5529c22d59156d P 127766fc592545a4997f7790f50f6076 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader e5256d91808b47c195bc9b4dbd7f2b87)
I20260709 13:06:03.563515 23547 raft_consensus.cc:493] T 0afb57ae58a24a01850491d69f0213dd P e61c3a8f61bb48f8a963c9480e53c168 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 0473d2b2d01f4459b1e90fd12cc7840e)
I20260709 13:06:03.563939 23434 raft_consensus.cc:515] T 14efcc79969f41babe5529c22d59156d P 127766fc592545a4997f7790f50f6076 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:03.564927 19552 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41504 (request call id 582) took 1335 ms. Trace:
I20260709 13:06:03.565374 19552 rpcz_store.cc:276] 0709 13:06:02.229158 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:02.230522 (+  1364us) service_pool.cc:224] Handling call
0709 13:06:03.564733 (+1334211us) spinlock_profiling.cc:243] Waited 139 ms on lock 0x7b5400126454. stack: 00007f4a79de9343 00007f4a79de9240 00007f4a797781d4 00007f4a834b6304 00007f4a834b6299 00007f4a7ce71571 00007f4a7cf0c2fa 00007f4a81ecdb17 00007f4a7b4486d4 00007f4a7b448662 00007f4a7b448591 00007f4a7b44850c 00007f4a7b4477c2 00007f4a7b24348c 00007f4a7b2428c6 00007f4a7b24226f
0709 13:06:03.564872 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":319803776}
I20260709 13:06:03.567049 23528 raft_consensus.cc:3055] T 775c229504194560ba9589bc2199b089 P 127766fc592545a4997f7790f50f6076 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:06:03.567348 23434 leader_election.cc:290] T 14efcc79969f41babe5529c22d59156d P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:06:03.567494 23528 raft_consensus.cc:740] T 775c229504194560ba9589bc2199b089 P 127766fc592545a4997f7790f50f6076 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 127766fc592545a4997f7790f50f6076, State: Running, Role: LEADER
I20260709 13:06:03.568702 23528 consensus_queue.cc:260] T 775c229504194560ba9589bc2199b089 P 127766fc592545a4997f7790f50f6076 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:03.564007 23547 raft_consensus.cc:515] T 0afb57ae58a24a01850491d69f0213dd P e61c3a8f61bb48f8a963c9480e53c168 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:03.569900 20110 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46422 (request call id 722) took 1440 ms. Trace:
I20260709 13:06:03.571216 19477 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58294 (request call id 2109) took 1330 ms. Trace:
I20260709 13:06:03.571585 19477 rpcz_store.cc:276] 0709 13:06:02.240841 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:02.240965 (+   124us) service_pool.cc:224] Handling call
0709 13:06:03.571057 (+1330092us) spinlock_profiling.cc:243] Waited 897 ms on lock 0x7b540029cf54. stack: 00007f4a79de9343 00007f4a79de9240 00007f4a797781d4 00007f4a834b6304 00007f4a834b6299 00007f4a7ce71571 00007f4a7cf0c2fa 00007f4a81ecdb17 00007f4a7b4486d4 00007f4a7b448662 00007f4a7b448591 00007f4a7b44850c 00007f4a7b4477c2 00007f4a7b24348c 00007f4a7b2428c6 00007f4a7b24226f
0709 13:06:03.571160 (+   103us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2062609664}
I20260709 13:06:03.572315 23585 raft_consensus.cc:2749] T e381f1d6b8184797ad142de49be225a8 P e5256d91808b47c195bc9b4dbd7f2b87 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:06:03.572480 23547 leader_election.cc:290] T 0afb57ae58a24a01850491d69f0213dd P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:06:03.569947 23528 raft_consensus.cc:3060] T 775c229504194560ba9589bc2199b089 P 127766fc592545a4997f7790f50f6076 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:06:03.574761 23456 raft_consensus.cc:515] T ef32ce6fdd0e40d382c79974f30295c6 P e5256d91808b47c195bc9b4dbd7f2b87 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:03.576889 23456 leader_election.cc:290] T ef32ce6fdd0e40d382c79974f30295c6 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 13 election: Requested vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
W20260709 13:06:03.580228 19376 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:03.580873 23587 raft_consensus.cc:493] T 21e14947d70440f19044d8f75c31e1f9 P e5256d91808b47c195bc9b4dbd7f2b87 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader e61c3a8f61bb48f8a963c9480e53c168)
I20260709 13:06:03.570333 20110 rpcz_store.cc:276] 0709 13:06:02.129846 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:02.205095 (+ 75249us) service_pool.cc:224] Handling call
0709 13:06:02.211092 (+  5997us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:06:02.606689 (+395597us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:03.569647 (+962958us) spinlock_profiling.cc:243] Waited 348 ms on lock 0x7b540067be54. stack: 00007f4a79de9343 00007f4a79de9240 00007f4a797781d4 00007f4a834b6304 00007f4a834b6299 00007f4a7ce71571 00007f4a7cf08e01 00007f4a7cf0783e 00007f4a81ecc419 00007f4a7b443bd4 00007f4a7b443b62 00007f4a7b443a91 00007f4a7b443a0c 00007f4a7b442cc2 00007f4a7b24348c 00007f4a7b2428c6
0709 13:06:03.569842 (+   195us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":801304320}
I20260709 13:06:03.583055 23587 raft_consensus.cc:515] T 21e14947d70440f19044d8f75c31e1f9 P e5256d91808b47c195bc9b4dbd7f2b87 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:03.585788 23587 leader_election.cc:290] T 21e14947d70440f19044d8f75c31e1f9 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:06:03.600235 19406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36f6ba92b9ba46babe4ebd6c02e5fbd9" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:06:03.603228 20103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14935b3ddf914369822e4a0547aaa355" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076"
I20260709 13:06:03.603976 20103 raft_consensus.cc:2393] T 14935b3ddf914369822e4a0547aaa355 P 127766fc592545a4997f7790f50f6076 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate e61c3a8f61bb48f8a963c9480e53c168 in current term 10: Already voted for candidate 127766fc592545a4997f7790f50f6076 in this term.
I20260709 13:06:03.605299 20105 raft_consensus.cc:1275] T 70797e5783b5454ab0d0eea663e791e3 P 127766fc592545a4997f7790f50f6076 [term 11 FOLLOWER]: Refusing update from remote peer e61c3a8f61bb48f8a963c9480e53c168: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
W20260709 13:06:03.610612 19449 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.1:40321, user_credentials={real_user=slave}} blocked reactor thread for 847544us
I20260709 13:06:03.612890 19558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21e14947d70440f19044d8f75c31e1f9" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:06:03.613574 19558 raft_consensus.cc:2468] T 21e14947d70440f19044d8f75c31e1f9 P e61c3a8f61bb48f8a963c9480e53c168 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 10.
I20260709 13:06:03.614256 19553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9f0d59553ad444883fcf5b5909f9798" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:06:03.614580 19554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e1085d23e8347fbbd5bce7542f4b1f4" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:06:03.614924 19553 raft_consensus.cc:3060] T b9f0d59553ad444883fcf5b5909f9798 P e61c3a8f61bb48f8a963c9480e53c168 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:06:03.615774 23516 raft_consensus.cc:493] T 2725d2c4cb054f18b0fc8f735c15f6c2 P e61c3a8f61bb48f8a963c9480e53c168 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:03.616354 23516 raft_consensus.cc:515] T 2725d2c4cb054f18b0fc8f735c15f6c2 P e61c3a8f61bb48f8a963c9480e53c168 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:03.619020 19552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14935b3ddf914369822e4a0547aaa355" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:06:03.619717 19406 raft_consensus.cc:1275] T 85c494af21f9457a85da47b9bc70c1fd P e5256d91808b47c195bc9b4dbd7f2b87 [term 8 FOLLOWER]: Refusing update from remote peer 127766fc592545a4997f7790f50f6076: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 13:06:03.619864 19552 raft_consensus.cc:2393] T 14935b3ddf914369822e4a0547aaa355 P e61c3a8f61bb48f8a963c9480e53c168 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0473d2b2d01f4459b1e90fd12cc7840e in current term 10: Already voted for candidate e61c3a8f61bb48f8a963c9480e53c168 in this term.
W20260709 13:06:03.620481 23569 log.cc:927] Time spent T 1f85fc4b527a48848e5faa083b604e36 P e5256d91808b47c195bc9b4dbd7f2b87: Append to log took a long time: real 0.742s	user 0.006s	sys 0.000s
I20260709 13:06:03.621723 19405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14efcc79969f41babe5529c22d59156d" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:06:03.621943 19406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ec1c4ce15e04c7e8c283a62179f2a64" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
I20260709 13:06:03.623724 20076 leader_election.cc:304] T ab43d85f64114d4ebf618930e43d9ed0 P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 127766fc592545a4997f7790f50f6076, e5256d91808b47c195bc9b4dbd7f2b87; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:06:03.625092 23511 raft_consensus.cc:2749] T ab43d85f64114d4ebf618930e43d9ed0 P 127766fc592545a4997f7790f50f6076 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:06:03.618449 23516 leader_election.cc:290] T 2725d2c4cb054f18b0fc8f735c15f6c2 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:06:03.627206 20104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0afb57ae58a24a01850491d69f0213dd" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
W20260709 13:06:03.628129 23557 log.cc:927] Time spent T 65d8cb8d6ec64f459d5a47cefab10acf P 127766fc592545a4997f7790f50f6076: Append to log took a long time: real 0.770s	user 0.000s	sys 0.005s
I20260709 13:06:03.629981 20106 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35874 (request call id 808) took 1209 ms. Trace:
I20260709 13:06:03.630977 23360 raft_consensus.cc:493] T 309c3ca0ca4b4f3ba129752ea2cb293b P e61c3a8f61bb48f8a963c9480e53c168 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:03.630297 20106 rpcz_store.cc:276] 0709 13:06:02.420567 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:02.420746 (+   179us) service_pool.cc:224] Handling call
0709 13:06:02.421191 (+   445us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:02.426878 (+  5687us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:02.426925 (+    47us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:02.444775 (+ 17850us) log.cc:844] Serialized 26 byte log entry
0709 13:06:02.666981 (+222206us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:06:02.667038 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:02.667104 (+    66us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:03.627593 (+960489us) spinlock_profiling.cc:243] Waited 122 ms on lock 0x7b4400022b4c. stack: 00007f4a79de9343 00007f4a79de9240 00007f4a797781d4 00007f4a834b6304 00007f4a834b6299 00007f4a79ca3db1 00007f4a79d41c85 00007f4a79d426a2 00007f4a7cab41db 00007f4a7caafaaf 00007f4a7caa386e 00007f4a7caa2bb6 00007f4a7caa27d8 00007f4a7caac221 00007f4a7caac1d9 00007f4a7caac169
0709 13:06:03.629727 (+  2134us) raft_consensus.cc:1685] finished
0709 13:06:03.629748 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:03.629928 (+   180us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1007,"raft.run_cpu_time_us":133,"raft.run_wall_time_us":7336,"spinlock_wait_cycles":280452480,"thread_start_us":152183,"threads_started":1,"wal-append.queue_time_us":265325}
I20260709 13:06:03.631613 23360 raft_consensus.cc:515] T 309c3ca0ca4b4f3ba129752ea2cb293b P e61c3a8f61bb48f8a963c9480e53c168 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } attrs { replace: true } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:03.632633 19483 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58286 (request call id 1964) took 1253 ms. Trace:
I20260709 13:06:03.632978 19483 rpcz_store.cc:276] 0709 13:06:02.379232 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:02.508122 (+128890us) service_pool.cc:224] Handling call
0709 13:06:03.632451 (+1124329us) spinlock_profiling.cc:243] Waited 613 ms on lock 0x7b54000edb54. stack: 00007f4a79de9343 00007f4a79de9240 00007f4a797781d4 00007f4a834b6304 00007f4a834b6299 00007f4a7ce71571 00007f4a7cf0c2fa 00007f4a81ecdb17 00007f4a7b4486d4 00007f4a7b448662 00007f4a7b448591 00007f4a7b44850c 00007f4a7b4477c2 00007f4a7b24348c 00007f4a7b2428c6 00007f4a7b24226f
0709 13:06:03.632585 (+   134us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1409729792}
W20260709 13:06:03.634341 23504 log.cc:927] Time spent T 62c6c134d3d24a1ab144dd9ee6bc3f64 P 127766fc592545a4997f7790f50f6076: Append to log took a long time: real 1.805s	user 0.008s	sys 0.004s
I20260709 13:06:03.634632 23360 leader_election.cc:290] T 309c3ca0ca4b4f3ba129752ea2cb293b P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:06:03.635617 20109 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46422 (request call id 721) took 2607 ms. Trace:
W20260709 13:06:03.636807 19377 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.2:46257, user_credentials={real_user=slave}} blocked reactor thread for 113158us
I20260709 13:06:03.637413 20105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e1085d23e8347fbbd5bce7542f4b1f4" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:06:03.636396 19404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f85fc4b527a48848e5faa083b604e36" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:06:03.639791 23585 consensus_queue.cc:1048] T 217b5fae677b4971b3bbd2f357a1f7ff P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:06:03.642112 23140 leader_election.cc:290] T ab43d85f64114d4ebf618930e43d9ed0 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 11 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:06:03.642585 23580 consensus_queue.cc:1059] T 96efeaaf1057492490e9a621f37e1a2d P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:06:03.643307 23580 consensus_queue.cc:1243] T 96efeaaf1057492490e9a621f37e1a2d P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Peer 127766fc592545a4997f7790f50f6076 log is divergent from this leader: its last log entry 8.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
I20260709 13:06:03.643833 23343 consensus_queue.cc:1048] T 70797e5783b5454ab0d0eea663e791e3 P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Connected to new peer: Peer: permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:06:03.644276 23529 raft_consensus.cc:3055] T 96efeaaf1057492490e9a621f37e1a2d P e61c3a8f61bb48f8a963c9480e53c168 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:06:03.644665 23529 raft_consensus.cc:740] T 96efeaaf1057492490e9a621f37e1a2d P e61c3a8f61bb48f8a963c9480e53c168 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: e61c3a8f61bb48f8a963c9480e53c168, State: Running, Role: LEADER
I20260709 13:06:03.645416 23529 consensus_queue.cc:260] T 96efeaaf1057492490e9a621f37e1a2d P e61c3a8f61bb48f8a963c9480e53c168 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.9, Last appended by leader: 9, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:03.636938 20109 rpcz_store.cc:276] 0709 13:06:01.028698 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:01.028995 (+   297us) service_pool.cc:224] Handling call
0709 13:06:01.039079 (+ 10084us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:01.039325 (+   246us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:01.039354 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:01.047672 (+  8318us) log.cc:844] Serialized 26 byte log entry
0709 13:06:01.565374 (+517702us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:06:01.565644 (+   270us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:01.565944 (+   300us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:03.633812 (+2067868us) spinlock_profiling.cc:243] Waited 6.03 ms on lock 0x7b4400022b4c. stack: 00007f4a79de9343 00007f4a79de9240 00007f4a797781d4 00007f4a834b6304 00007f4a834b6299 00007f4a79ca3db1 00007f4a79d41c85 00007f4a79d426a2 00007f4a7cab41db 00007f4a7caafaaf 00007f4a7caa386e 00007f4a7caa2bb6 00007f4a7caa27d8 00007f4a7caac221 00007f4a7caac1d9 00007f4a7caac169
0709 13:06:03.635346 (+  1534us) raft_consensus.cc:1685] finished
0709 13:06:03.635365 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:03.635550 (+   185us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":13858048,"thread_start_us":471287,"threads_started":1,"wal-append.queue_time_us":626142}
I20260709 13:06:03.642227 19526 leader_election.cc:304] T 217b5fae677b4971b3bbd2f357a1f7ff P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168; no voters: e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:06:03.648808 23545 raft_consensus.cc:2804] T 217b5fae677b4971b3bbd2f357a1f7ff P e61c3a8f61bb48f8a963c9480e53c168 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:06:03.649330 23465 raft_consensus.cc:3055] T 217b5fae677b4971b3bbd2f357a1f7ff P e5256d91808b47c195bc9b4dbd7f2b87 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:06:03.649720 23465 raft_consensus.cc:740] T 217b5fae677b4971b3bbd2f357a1f7ff P e5256d91808b47c195bc9b4dbd7f2b87 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: e5256d91808b47c195bc9b4dbd7f2b87, State: Running, Role: LEADER
I20260709 13:06:03.649358 23545 raft_consensus.cc:697] T 217b5fae677b4971b3bbd2f357a1f7ff P e61c3a8f61bb48f8a963c9480e53c168 [term 8 LEADER]: Becoming Leader. State: Replica: e61c3a8f61bb48f8a963c9480e53c168, State: Running, Role: LEADER
I20260709 13:06:03.654604 19410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e5873a19244c5ebbcd38e126796ee7" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:06:03.655189 19410 raft_consensus.cc:2468] T d1e5873a19244c5ebbcd38e126796ee7 P e5256d91808b47c195bc9b4dbd7f2b87 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 11.
I20260709 13:06:03.657197 19406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a61655d99124a29b486ba4a5b37faea" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:06:03.657557 19404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edd7d470b5014c9489be7f41f64355c9" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 12 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:06:03.658577 19402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21e14947d70440f19044d8f75c31e1f9" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:06:03.659152 19402 raft_consensus.cc:2468] T 21e14947d70440f19044d8f75c31e1f9 P e5256d91808b47c195bc9b4dbd7f2b87 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 9.
I20260709 13:06:03.659991 19410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e381f1d6b8184797ad142de49be225a8" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:06:03.603978 20110 raft_consensus.cc:1240] T 2a16f7501e2444fb86d4e2778e734e02 P 127766fc592545a4997f7790f50f6076 [term 12 FOLLOWER]: Rejecting Update request from peer e61c3a8f61bb48f8a963c9480e53c168 for earlier term 11. Current term is 12. Ops: []
I20260709 13:06:03.648692 20105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "309c3ca0ca4b4f3ba129752ea2cb293b" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:06:03.664068 20110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14935b3ddf914369822e4a0547aaa355" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:06:03.664809 20110 raft_consensus.cc:2393] T 14935b3ddf914369822e4a0547aaa355 P 127766fc592545a4997f7790f50f6076 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0473d2b2d01f4459b1e90fd12cc7840e in current term 10: Already voted for candidate 127766fc592545a4997f7790f50f6076 in this term.
I20260709 13:06:03.670078 19553 raft_consensus.cc:2468] T b9f0d59553ad444883fcf5b5909f9798 P e61c3a8f61bb48f8a963c9480e53c168 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 11.
I20260709 13:06:03.674983 20106 raft_consensus.cc:1275] T 2a16f7501e2444fb86d4e2778e734e02 P 127766fc592545a4997f7790f50f6076 [term 12 FOLLOWER]: Refusing update from remote peer e5256d91808b47c195bc9b4dbd7f2b87: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:06:03.675902 19402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14935b3ddf914369822e4a0547aaa355" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:06:03.680820 20078 leader_election.cc:304] T 14935b3ddf914369822e4a0547aaa355 P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, 127766fc592545a4997f7790f50f6076, e5256d91808b47c195bc9b4dbd7f2b87; no voters: e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:06:03.682264 23559 raft_consensus.cc:493] T 62c6c134d3d24a1ab144dd9ee6bc3f64 P 0473d2b2d01f4459b1e90fd12cc7840e [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:03.683142 23556 consensus_queue.cc:1059] T 4509b76741dc428e9201c70c1658da13 P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:06:03.683892 19483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e1f505cb0f1427bbd698ac889d80821" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:06:03.684171 19480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1b10566f45d4a7d9029858330e02d5b" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:06:03.683511 19450 leader_election.cc:304] T 21e14947d70440f19044d8f75c31e1f9 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:06:03.684783 19404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9f0d59553ad444883fcf5b5909f9798" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
I20260709 13:06:03.646553 23529 raft_consensus.cc:3060] T 96efeaaf1057492490e9a621f37e1a2d P e61c3a8f61bb48f8a963c9480e53c168 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:06:03.686841 20109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab43d85f64114d4ebf618930e43d9ed0" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076"
I20260709 13:06:03.692603 19486 raft_consensus.cc:1275] T 179fd671030940b4b4a4e24bcc4aba0a P 0473d2b2d01f4459b1e90fd12cc7840e [term 11 FOLLOWER]: Refusing update from remote peer e61c3a8f61bb48f8a963c9480e53c168: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:06:03.641465 23585 consensus_queue.cc:1048] T 46c5bfeecc314717bffe987e6844b6d0 P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.002s
I20260709 13:06:03.693843 19402 raft_consensus.cc:2393] T 14935b3ddf914369822e4a0547aaa355 P e5256d91808b47c195bc9b4dbd7f2b87 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0473d2b2d01f4459b1e90fd12cc7840e in current term 10: Already voted for candidate 127766fc592545a4997f7790f50f6076 in this term.
I20260709 13:06:03.651365 23545 consensus_queue.cc:237] T 217b5fae677b4971b3bbd2f357a1f7ff P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:03.695865 19479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21e14947d70440f19044d8f75c31e1f9" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:06:03.698349 19481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76cb037fc9064d13b59a8969d897ce8c" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:06:03.771488 19477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4509b76741dc428e9201c70c1658da13" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:06:03.775049 19406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e1f505cb0f1427bbd698ac889d80821" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
I20260709 13:06:03.785665 19407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4509b76741dc428e9201c70c1658da13" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
I20260709 13:06:03.801757 19409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65d8cb8d6ec64f459d5a47cefab10acf" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
I20260709 13:06:03.803206 19408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70797e5783b5454ab0d0eea663e791e3" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: true dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
I20260709 13:06:03.810842 19480 raft_consensus.cc:2393] T f1b10566f45d4a7d9029858330e02d5b P 0473d2b2d01f4459b1e90fd12cc7840e [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate e61c3a8f61bb48f8a963c9480e53c168 in current term 12: Already voted for candidate 0473d2b2d01f4459b1e90fd12cc7840e in this term.
I20260709 13:06:03.810120 19404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21e14947d70440f19044d8f75c31e1f9" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:06:03.810942 19411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14935b3ddf914369822e4a0547aaa355" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
I20260709 13:06:03.816309 19404 raft_consensus.cc:2468] T 21e14947d70440f19044d8f75c31e1f9 P e5256d91808b47c195bc9b4dbd7f2b87 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 9.
I20260709 13:06:03.816706 19411 raft_consensus.cc:2393] T 14935b3ddf914369822e4a0547aaa355 P e5256d91808b47c195bc9b4dbd7f2b87 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate e61c3a8f61bb48f8a963c9480e53c168 in current term 10: Already voted for candidate 127766fc592545a4997f7790f50f6076 in this term.
I20260709 13:06:03.816587 19480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0afb57ae58a24a01850491d69f0213dd" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:06:03.817219 19408 raft_consensus.cc:2376] T 70797e5783b5454ab0d0eea663e791e3 P e5256d91808b47c195bc9b4dbd7f2b87 [term 11 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 11. Re-sending same reply.
I20260709 13:06:03.817318 19404 raft_consensus.cc:1240] T ef32ce6fdd0e40d382c79974f30295c6 P e5256d91808b47c195bc9b4dbd7f2b87 [term 13 FOLLOWER]: Rejecting Update request from peer e61c3a8f61bb48f8a963c9480e53c168 for earlier term 12. Current term is 13. Ops: []
I20260709 13:06:03.817648 19480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2725d2c4cb054f18b0fc8f735c15f6c2" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 13 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
W20260709 13:06:03.762455 19523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.4:43121, user_credentials={real_user=slave}} blocked reactor thread for 67215.3us
I20260709 13:06:03.650552 23465 consensus_queue.cc:260] T 217b5fae677b4971b3bbd2f357a1f7ff P e5256d91808b47c195bc9b4dbd7f2b87 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:03.806627 20109 raft_consensus.cc:2393] T ab43d85f64114d4ebf618930e43d9ed0 P 127766fc592545a4997f7790f50f6076 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate e61c3a8f61bb48f8a963c9480e53c168 in current term 11: Already voted for candidate 127766fc592545a4997f7790f50f6076 in this term.
I20260709 13:06:03.687501 23220 raft_consensus.cc:493] T f93ee515a9c14139bf566522ed8232f3 P 0473d2b2d01f4459b1e90fd12cc7840e [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:03.812481 19481 raft_consensus.cc:3060] T 76cb037fc9064d13b59a8969d897ce8c P 0473d2b2d01f4459b1e90fd12cc7840e [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:06:03.812994 19402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a08760e15aac4630a629431f56024dc8" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
I20260709 13:06:03.675381 23515 raft_consensus.cc:493] T bc225c93219c45538b53a1bd3d387e4d P 0473d2b2d01f4459b1e90fd12cc7840e [term 10 FOLLOWER]: Starting pre-election (detected failure of leader e5256d91808b47c195bc9b4dbd7f2b87)
I20260709 13:06:03.811062 19478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a08760e15aac4630a629431f56024dc8" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
W20260709 13:06:03.812943 19374 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.4:43121, user_credentials={real_user=slave}} blocked reactor thread for 124795us
I20260709 13:06:03.764215 19484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14935b3ddf914369822e4a0547aaa355" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:06:03.829025 19484 raft_consensus.cc:2393] T 14935b3ddf914369822e4a0547aaa355 P 0473d2b2d01f4459b1e90fd12cc7840e [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate e61c3a8f61bb48f8a963c9480e53c168 in current term 10: Already voted for candidate 127766fc592545a4997f7790f50f6076 in this term.
I20260709 13:06:03.685667 23489 raft_consensus.cc:493] T 309c3ca0ca4b4f3ba129752ea2cb293b P 0473d2b2d01f4459b1e90fd12cc7840e [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:06:03.819335 19377 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.2:46257, user_credentials={real_user=slave}} blocked reactor thread for 125519us
I20260709 13:06:03.829516 19478 raft_consensus.cc:3060] T a08760e15aac4630a629431f56024dc8 P 0473d2b2d01f4459b1e90fd12cc7840e [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:06:03.830008 19377 leader_election.cc:304] T 2b74109013a140ada21feeef92d6f563 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:06:03.831492 19377 leader_election.cc:304] T b08304a0a02b42d7840c4e8ee9a6bd1a P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:06:03.803855 19479 raft_consensus.cc:2468] T 21e14947d70440f19044d8f75c31e1f9 P 0473d2b2d01f4459b1e90fd12cc7840e [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 10.
I20260709 13:06:03.775854 19405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9f0d59553ad444883fcf5b5909f9798" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:06:03.834358 19477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab43d85f64114d4ebf618930e43d9ed0" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:06:03.762161 23511 raft_consensus.cc:2804] T 14935b3ddf914369822e4a0547aaa355 P 127766fc592545a4997f7790f50f6076 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:06:03.837654 19477 raft_consensus.cc:2393] T ab43d85f64114d4ebf618930e43d9ed0 P 0473d2b2d01f4459b1e90fd12cc7840e [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate e61c3a8f61bb48f8a963c9480e53c168 in current term 11: Already voted for candidate 0473d2b2d01f4459b1e90fd12cc7840e in this term.
I20260709 13:06:03.824375 19402 raft_consensus.cc:3060] T a08760e15aac4630a629431f56024dc8 P e5256d91808b47c195bc9b4dbd7f2b87 [term 11 FOLLOWER]: Advancing to term 13
I20260709 13:06:03.685475 23440 raft_consensus.cc:515] T 172b3dd13109415a955b71ac0e9d2234 P e5256d91808b47c195bc9b4dbd7f2b87 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:03.810556 19483 raft_consensus.cc:3060] T 3e1f505cb0f1427bbd698ac889d80821 P 0473d2b2d01f4459b1e90fd12cc7840e [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:06:03.714634 19449 leader_election.cc:304] T ff9b0eddd810459b82d91c60777c10eb P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e; no voters: 127766fc592545a4997f7790f50f6076, e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:06:03.822604 23456 raft_consensus.cc:493] T 40e1e16737a842ee936002830f36882e P e5256d91808b47c195bc9b4dbd7f2b87 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader e61c3a8f61bb48f8a963c9480e53c168)
I20260709 13:06:03.845487 19406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2725d2c4cb054f18b0fc8f735c15f6c2" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 13 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:06:03.846132 19481 raft_consensus.cc:2468] T 76cb037fc9064d13b59a8969d897ce8c P 0473d2b2d01f4459b1e90fd12cc7840e [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 10.
I20260709 13:06:03.846604 19477 raft_consensus.cc:1240] T 2b74109013a140ada21feeef92d6f563 P 0473d2b2d01f4459b1e90fd12cc7840e [term 7 FOLLOWER]: Rejecting Update request from peer e61c3a8f61bb48f8a963c9480e53c168 for earlier term 6. Current term is 7. Ops: []
I20260709 13:06:03.810424 19486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "309c3ca0ca4b4f3ba129752ea2cb293b" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:06:03.832140 19408 raft_consensus.cc:1275] T 179fd671030940b4b4a4e24bcc4aba0a P e5256d91808b47c195bc9b4dbd7f2b87 [term 11 FOLLOWER]: Refusing update from remote peer e61c3a8f61bb48f8a963c9480e53c168: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:06:03.835696 23465 raft_consensus.cc:3060] T 217b5fae677b4971b3bbd2f357a1f7ff P e5256d91808b47c195bc9b4dbd7f2b87 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:06:03.685611 23492 consensus_queue.cc:1048] T 85c494af21f9457a85da47b9bc70c1fd P 127766fc592545a4997f7790f50f6076 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.143s
I20260709 13:06:03.820580 19404 raft_consensus.cc:1275] T 70797e5783b5454ab0d0eea663e791e3 P e5256d91808b47c195bc9b4dbd7f2b87 [term 11 FOLLOWER]: Refusing update from remote peer e61c3a8f61bb48f8a963c9480e53c168: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 13:06:03.839221 19405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76cb037fc9064d13b59a8969d897ce8c" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
I20260709 13:06:03.856083 19408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "309c3ca0ca4b4f3ba129752ea2cb293b" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:06:03.854533 23316 raft_consensus.cc:3060] T ff9b0eddd810459b82d91c60777c10eb P 0473d2b2d01f4459b1e90fd12cc7840e [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:06:03.857815 23585 raft_consensus.cc:2749] T b08304a0a02b42d7840c4e8ee9a6bd1a P e5256d91808b47c195bc9b4dbd7f2b87 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:06:03.833926 23525 consensus_queue.cc:1059] T 2a16f7501e2444fb86d4e2778e734e02 P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.015s
I20260709 13:06:03.842267 23538 raft_consensus.cc:493] T 179fd671030940b4b4a4e24bcc4aba0a P 0473d2b2d01f4459b1e90fd12cc7840e [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:03.860394 23538 raft_consensus.cc:515] T 179fd671030940b4b4a4e24bcc4aba0a P 0473d2b2d01f4459b1e90fd12cc7840e [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:03.818248 19480 raft_consensus.cc:2468] T 2725d2c4cb054f18b0fc8f735c15f6c2 P 0473d2b2d01f4459b1e90fd12cc7840e [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 12.
I20260709 13:06:03.686415 23443 consensus_queue.cc:1048] T 1dc5b3532fe54f74876d02beffa2c230 P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.140s
I20260709 13:06:03.864799 23316 raft_consensus.cc:2749] T ff9b0eddd810459b82d91c60777c10eb P 0473d2b2d01f4459b1e90fd12cc7840e [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:06:03.834116 23541 raft_consensus.cc:2804] T 21e14947d70440f19044d8f75c31e1f9 P 0473d2b2d01f4459b1e90fd12cc7840e [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:06:03.850183 19406 raft_consensus.cc:1240] T 2a16f7501e2444fb86d4e2778e734e02 P e5256d91808b47c195bc9b4dbd7f2b87 [term 12 LEADER]: Rejecting Update request from peer e61c3a8f61bb48f8a963c9480e53c168 for earlier term 11. Current term is 12. Ops: []
I20260709 13:06:03.829275 23220 raft_consensus.cc:515] T f93ee515a9c14139bf566522ed8232f3 P 0473d2b2d01f4459b1e90fd12cc7840e [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
W20260709 13:06:03.850481 19449 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.4:43121, user_credentials={real_user=slave}} blocked reactor thread for 135989us
I20260709 13:06:03.881947 19449 leader_election.cc:304] T 48824d5acfbc485ebf8c2d944e7202de P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e; no voters: 127766fc592545a4997f7790f50f6076, e61c3a8f61bb48f8a963c9480e53c168
W20260709 13:06:03.812139 19450 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.3:36891, user_credentials={real_user=slave}} blocked reactor thread for 128696us
I20260709 13:06:03.850780 19552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f93ee515a9c14139bf566522ed8232f3" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 15 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:06:03.883373 19552 raft_consensus.cc:2468] T f93ee515a9c14139bf566522ed8232f3 P e61c3a8f61bb48f8a963c9480e53c168 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 14.
I20260709 13:06:03.851670 19551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef32ce6fdd0e40d382c79974f30295c6" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:06:03.845813 23511 raft_consensus.cc:697] T 14935b3ddf914369822e4a0547aaa355 P 127766fc592545a4997f7790f50f6076 [term 10 LEADER]: Becoming Leader. State: Replica: 127766fc592545a4997f7790f50f6076, State: Running, Role: LEADER
I20260709 13:06:03.853184 19554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21e14947d70440f19044d8f75c31e1f9" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:06:03.762254 23559 raft_consensus.cc:515] T 62c6c134d3d24a1ab144dd9ee6bc3f64 P 0473d2b2d01f4459b1e90fd12cc7840e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:03.867177 23440 leader_election.cc:290] T 172b3dd13109415a955b71ac0e9d2234 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 10 election: Requested vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:06:03.867825 20110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "172b3dd13109415a955b71ac0e9d2234" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076"
I20260709 13:06:03.894037 20108 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46422 (request call id 728) took 1290 ms. Trace:
I20260709 13:06:03.894434 19406 raft_consensus.cc:1240] T 172b3dd13109415a955b71ac0e9d2234 P e5256d91808b47c195bc9b4dbd7f2b87 [term 10 FOLLOWER]: Rejecting Update request from peer 127766fc592545a4997f7790f50f6076 for earlier term 9. Current term is 10. Ops: []
I20260709 13:06:03.848187 19478 raft_consensus.cc:2468] T a08760e15aac4630a629431f56024dc8 P 0473d2b2d01f4459b1e90fd12cc7840e [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 13.
I20260709 13:06:03.878198 19523 leader_election.cc:304] T 21e14947d70440f19044d8f75c31e1f9 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:06:03.764282 23594 consensus_queue.cc:1048] T 76cb037fc9064d13b59a8969d897ce8c P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.134s
I20260709 13:06:03.885452 19554 raft_consensus.cc:2468] T 21e14947d70440f19044d8f75c31e1f9 P e61c3a8f61bb48f8a963c9480e53c168 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 10.
I20260709 13:06:03.847894 23592 raft_consensus.cc:2749] T 2b74109013a140ada21feeef92d6f563 P e5256d91808b47c195bc9b4dbd7f2b87 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:06:03.833590 23515 raft_consensus.cc:515] T bc225c93219c45538b53a1bd3d387e4d P 0473d2b2d01f4459b1e90fd12cc7840e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:03.886794 23556 raft_consensus.cc:2749] T 48824d5acfbc485ebf8c2d944e7202de P 0473d2b2d01f4459b1e90fd12cc7840e [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:06:03.891213 23511 consensus_queue.cc:237] T 14935b3ddf914369822e4a0547aaa355 P 127766fc592545a4997f7790f50f6076 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 7, Current term: 10, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } attrs { replace: true } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:03.900281 19523 leader_election.cc:304] T 14935b3ddf914369822e4a0547aaa355 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: e61c3a8f61bb48f8a963c9480e53c168; no voters: 127766fc592545a4997f7790f50f6076, e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:06:03.896286 19450 leader_election.cc:304] T b9f0d59553ad444883fcf5b5909f9798 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:06:03.894500 20108 rpcz_store.cc:276] 0709 13:06:02.603610 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:02.603759 (+   149us) service_pool.cc:224] Handling call
0709 13:06:02.604090 (+   331us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:02.777173 (+173083us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:02.777203 (+    30us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:02.777246 (+    43us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:06:02.777277 (+    31us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:03.893823 (+1116546us) spinlock_profiling.cc:243] Waited 173 ms on lock 0x7b5400661054. stack: 00007f4a79de9343 00007f4a79de9240 00007f4a797781d4 00007f4a834b6304 00007f4a834b6299 00007f4a7ce71571 00007f4a7cf08e01 00007f4a7cf0783e 00007f4a81ecc419 00007f4a7b443bd4 00007f4a7b443b62 00007f4a7b443a91 00007f4a7b443a0c 00007f4a7b442cc2 00007f4a7b24348c 00007f4a7b2428c6
0709 13:06:03.893867 (+    44us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:03.893978 (+   111us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":397581568}
I20260709 13:06:03.875409 23140 raft_consensus.cc:3055] T 2b74109013a140ada21feeef92d6f563 P e61c3a8f61bb48f8a963c9480e53c168 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:06:03.836692 23489 raft_consensus.cc:515] T 309c3ca0ca4b4f3ba129752ea2cb293b P 0473d2b2d01f4459b1e90fd12cc7840e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } attrs { replace: true } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:03.902067 19449 leader_election.cc:304] T 172b3dd13109415a955b71ac0e9d2234 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e; no voters: 127766fc592545a4997f7790f50f6076, e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:06:03.849259 23456 raft_consensus.cc:515] T 40e1e16737a842ee936002830f36882e P e5256d91808b47c195bc9b4dbd7f2b87 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:03.879281 23551 raft_consensus.cc:493] T 46c5bfeecc314717bffe987e6844b6d0 P e61c3a8f61bb48f8a963c9480e53c168 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader e5256d91808b47c195bc9b4dbd7f2b87)
W20260709 13:06:03.974825 20076 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:03.964491 19450 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.3:36891, user_credentials={real_user=slave}} blocked reactor thread for 80738us
W20260709 13:06:03.965552 19523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.1:40321, user_credentials={real_user=slave}} blocked reactor thread for 65368.6us
I20260709 13:06:04.000154 19523 leader_election.cc:304] T 65d8cb8d6ec64f459d5a47cefab10acf P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e61c3a8f61bb48f8a963c9480e53c168; no voters: 127766fc592545a4997f7790f50f6076, e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:06:03.912415 19483 raft_consensus.cc:2468] T 3e1f505cb0f1427bbd698ac889d80821 P 0473d2b2d01f4459b1e90fd12cc7840e [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 11.
I20260709 13:06:03.910945 23516 raft_consensus.cc:2804] T 21e14947d70440f19044d8f75c31e1f9 P e61c3a8f61bb48f8a963c9480e53c168 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:06:03.910688 23399 raft_consensus.cc:493] T 4af19371ea874c09a0a2147040835cbb P 127766fc592545a4997f7790f50f6076 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:04.043640 20112 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35874 (request call id 809) took 1406 ms. Trace:
I20260709 13:06:03.904640 23214 consensus_queue.cc:1059] T ef32ce6fdd0e40d382c79974f30295c6 P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 }, Status: INVALID_TERM, Last received: 12.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.066s
I20260709 13:06:04.040052 19486 raft_consensus.cc:2468] T 309c3ca0ca4b4f3ba129752ea2cb293b P 0473d2b2d01f4459b1e90fd12cc7840e [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 9.
I20260709 13:06:04.027500 23140 raft_consensus.cc:740] T 2b74109013a140ada21feeef92d6f563 P e61c3a8f61bb48f8a963c9480e53c168 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: e61c3a8f61bb48f8a963c9480e53c168, State: Running, Role: LEADER
I20260709 13:06:04.047204 20112 rpcz_store.cc:276] 0709 13:06:02.637117 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:02.637230 (+   113us) service_pool.cc:224] Handling call
0709 13:06:02.637505 (+   275us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:03.543288 (+905783us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:04.043344 (+500056us) spinlock_profiling.cc:243] Waited 905 ms on lock 0x7b54005b95d4. stack: 00007f4a79de9343 00007f4a79de9240 00007f4a797781d4 00007f4a834b6304 00007f4a834b6299 00007f4a7ce71571 00007f4a7cf08e01 00007f4a7cf0783e 00007f4a81ecc419 00007f4a7b443bd4 00007f4a7b443b62 00007f4a7b443a91 00007f4a7b443a0c 00007f4a7b442cc2 00007f4a7b24348c 00007f4a7b2428c6
0709 13:06:04.043569 (+   225us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2081695104}
I20260709 13:06:03.911149 23533 raft_consensus.cc:493] T 4af19371ea874c09a0a2147040835cbb P e61c3a8f61bb48f8a963c9480e53c168 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:03.966768 23344 raft_consensus.cc:2749] T 14935b3ddf914369822e4a0547aaa355 P e61c3a8f61bb48f8a963c9480e53c168 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:06:03.915007 23538 leader_election.cc:290] T 179fd671030940b4b4a4e24bcc4aba0a P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:06:04.025772 23433 raft_consensus.cc:2804] T b9f0d59553ad444883fcf5b5909f9798 P 0473d2b2d01f4459b1e90fd12cc7840e [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:06:04.099164 19402 raft_consensus.cc:2468] T a08760e15aac4630a629431f56024dc8 P e5256d91808b47c195bc9b4dbd7f2b87 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 13.
W20260709 13:06:04.051888 23475 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.187s	user 0.009s	sys 0.005s
I20260709 13:06:03.967657 23414 raft_consensus.cc:2749] T 172b3dd13109415a955b71ac0e9d2234 P 0473d2b2d01f4459b1e90fd12cc7840e [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:06:04.101438 20112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85c494af21f9457a85da47b9bc70c1fd" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:06:03.914013 23528 consensus_queue.cc:1059] T 172b3dd13109415a955b71ac0e9d2234 P 127766fc592545a4997f7790f50f6076 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 }, Status: INVALID_TERM, Last received: 9.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.178s
W20260709 13:06:04.107949 19375 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.3:36891, user_credentials={real_user=slave}} blocked reactor thread for 254848us
W20260709 13:06:04.095132 19377 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.2:46257, user_credentials={real_user=slave}} blocked reactor thread for 263707us
I20260709 13:06:04.144198 19377 leader_election.cc:304] T fa8650e71aa14778b3d73721fc50d9fc P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:06:04.097157 23549 leader_election.cc:290] T 85c494af21f9457a85da47b9bc70c1fd P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
W20260709 13:06:04.107414 23475 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.243s	user 0.009s	sys 0.005s
W20260709 13:06:03.965792 19449 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.4:43121, user_credentials={real_user=slave}} blocked reactor thread for 63836us
I20260709 13:06:04.037427 23551 raft_consensus.cc:515] T 46c5bfeecc314717bffe987e6844b6d0 P e61c3a8f61bb48f8a963c9480e53c168 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:04.101862 23316 raft_consensus.cc:493] T 14efcc79969f41babe5529c22d59156d P 0473d2b2d01f4459b1e90fd12cc7840e [term 10 FOLLOWER]: Starting pre-election (detected failure of leader e5256d91808b47c195bc9b4dbd7f2b87)
I20260709 13:06:04.110327 23214 raft_consensus.cc:2749] T 65d8cb8d6ec64f459d5a47cefab10acf P e61c3a8f61bb48f8a963c9480e53c168 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:06:04.082767 23399 raft_consensus.cc:515] T 4af19371ea874c09a0a2147040835cbb P 127766fc592545a4997f7790f50f6076 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:04.109525 23433 raft_consensus.cc:697] T b9f0d59553ad444883fcf5b5909f9798 P 0473d2b2d01f4459b1e90fd12cc7840e [term 11 LEADER]: Becoming Leader. State: Replica: 0473d2b2d01f4459b1e90fd12cc7840e, State: Running, Role: LEADER
W20260709 13:06:04.183692 19374 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:04.187260 19449 leader_election.cc:304] T ab43d85f64114d4ebf618930e43d9ed0 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e; no voters: 127766fc592545a4997f7790f50f6076, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:06:04.187915 23316 raft_consensus.cc:515] T 14efcc79969f41babe5529c22d59156d P 0473d2b2d01f4459b1e90fd12cc7840e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:04.099733 23533 raft_consensus.cc:515] T 4af19371ea874c09a0a2147040835cbb P e61c3a8f61bb48f8a963c9480e53c168 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:04.203222 23433 consensus_queue.cc:237] T b9f0d59553ad444883fcf5b5909f9798 P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:04.163360 23559 leader_election.cc:290] T 62c6c134d3d24a1ab144dd9ee6bc3f64 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:06:04.113032 23344 raft_consensus.cc:3055] T ef32ce6fdd0e40d382c79974f30295c6 P e61c3a8f61bb48f8a963c9480e53c168 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:06:04.206574 23316 leader_election.cc:290] T 14efcc79969f41babe5529c22d59156d P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:06:04.212750 23475 raft_consensus.cc:2749] T fa8650e71aa14778b3d73721fc50d9fc P e5256d91808b47c195bc9b4dbd7f2b87 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:06:04.214756 23140 consensus_queue.cc:260] T 2b74109013a140ada21feeef92d6f563 P e61c3a8f61bb48f8a963c9480e53c168 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:04.216140 23515 leader_election.cc:290] T bc225c93219c45538b53a1bd3d387e4d P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:06:04.219226 23551 leader_election.cc:290] T 46c5bfeecc314717bffe987e6844b6d0 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:06:04.111641 23585 consensus_queue.cc:1048] T b9f0d59553ad444883fcf5b5909f9798 P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.079s
I20260709 13:06:04.225106 19449 leader_election.cc:304] T ed7fdbcb96d14d418db9ca90a792588a P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e; no voters: 127766fc592545a4997f7790f50f6076, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:06:04.190788 23528 raft_consensus.cc:493] T fa731b585f684a7fb2d106c50f143b83 P 127766fc592545a4997f7790f50f6076 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader e5256d91808b47c195bc9b4dbd7f2b87)
I20260709 13:06:04.247680 19449 leader_election.cc:304] T 0e1085d23e8347fbbd5bce7542f4b1f4 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e; no voters: 127766fc592545a4997f7790f50f6076, e61c3a8f61bb48f8a963c9480e53c168
W20260709 13:06:04.177911 19523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.1:40321, user_credentials={real_user=slave}} blocked reactor thread for 177853us
I20260709 13:06:04.256461 19523 leader_election.cc:304] T b9f0d59553ad444883fcf5b5909f9798 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e61c3a8f61bb48f8a963c9480e53c168; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:06:04.246443 23220 leader_election.cc:290] T f93ee515a9c14139bf566522ed8232f3 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:06:04.261024 23489 leader_election.cc:290] T 309c3ca0ca4b4f3ba129752ea2cb293b P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:06:04.216586 23556 raft_consensus.cc:2749] T ab43d85f64114d4ebf618930e43d9ed0 P 0473d2b2d01f4459b1e90fd12cc7840e [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:06:04.266415 19449 leader_election.cc:304] T 14935b3ddf914369822e4a0547aaa355 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e; no voters: 127766fc592545a4997f7790f50f6076, e61c3a8f61bb48f8a963c9480e53c168
W20260709 13:06:04.266623 19377 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.2:46257, user_credentials={real_user=slave}} blocked reactor thread for 122506us
I20260709 13:06:04.267660 19377 leader_election.cc:400] T 28af091831594f9d8e96482078cc7625 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 10 pre-election: Vote denied by peer 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257) with higher term. Message: Invalid argument: T 28af091831594f9d8e96482078cc7625 P 0473d2b2d01f4459b1e90fd12cc7840e [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e5256d91808b47c195bc9b4dbd7f2b87 for earlier term 10. Current term is 11.
I20260709 13:06:04.268014 19377 leader_election.cc:403] T 28af091831594f9d8e96482078cc7625 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 10 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:06:04.274250 19449 leader_election.cc:304] T 1dc5b3532fe54f74876d02beffa2c230 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e; no voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:06:04.219972 23344 raft_consensus.cc:740] T ef32ce6fdd0e40d382c79974f30295c6 P e61c3a8f61bb48f8a963c9480e53c168 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: e61c3a8f61bb48f8a963c9480e53c168, State: Running, Role: LEADER
I20260709 13:06:04.278841 23551 consensus_queue.cc:1048] T 179fd671030940b4b4a4e24bcc4aba0a P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:06:04.279428 19449 leader_election.cc:304] T 2b74109013a140ada21feeef92d6f563 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e; no voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168
W20260709 13:06:04.289132 19375 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.3:36891, user_credentials={real_user=slave}} blocked reactor thread for 134129us
I20260709 13:06:04.290302 20104 raft_consensus.cc:1275] T ed7fdbcb96d14d418db9ca90a792588a P 127766fc592545a4997f7790f50f6076 [term 8 FOLLOWER]: Refusing update from remote peer e61c3a8f61bb48f8a963c9480e53c168: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:06:04.272708 23492 raft_consensus.cc:493] T ff9b0eddd810459b82d91c60777c10eb P 127766fc592545a4997f7790f50f6076 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:04.272225 23538 raft_consensus.cc:2749] T ed7fdbcb96d14d418db9ca90a792588a P 0473d2b2d01f4459b1e90fd12cc7840e [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 13:06:04.298255 23562 log.cc:927] Time spent T 2a16f7501e2444fb86d4e2778e734e02 P e61c3a8f61bb48f8a963c9480e53c168: Append to log took a long time: real 1.257s	user 0.006s	sys 0.013s
I20260709 13:06:04.298110 23344 consensus_queue.cc:260] T ef32ce6fdd0e40d382c79974f30295c6 P e61c3a8f61bb48f8a963c9480e53c168 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:04.298914 23399 leader_election.cc:290] T 4af19371ea874c09a0a2147040835cbb P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:06:04.299379 23344 raft_consensus.cc:3060] T ef32ce6fdd0e40d382c79974f30295c6 P e61c3a8f61bb48f8a963c9480e53c168 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:06:04.302875 23456 leader_election.cc:290] T 40e1e16737a842ee936002830f36882e P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:06:04.295238 23475 raft_consensus.cc:2749] T 28af091831594f9d8e96482078cc7625 P e5256d91808b47c195bc9b4dbd7f2b87 [term 11 FOLLOWER]: Leader pre-election lost for term 10. Reason: Vote denied by peer 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257) with higher term. Message: Invalid argument: T 28af091831594f9d8e96482078cc7625 P 0473d2b2d01f4459b1e90fd12cc7840e [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e5256d91808b47c195bc9b4dbd7f2b87 for earlier term 10. Current term is 11.
I20260709 13:06:04.272430 23528 raft_consensus.cc:515] T fa731b585f684a7fb2d106c50f143b83 P 127766fc592545a4997f7790f50f6076 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:04.309602 23528 leader_election.cc:290] T fa731b585f684a7fb2d106c50f143b83 P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:06:04.287204 23554 raft_consensus.cc:493] T 6c5eebf646ad445a9d1b1adc319d7b16 P 127766fc592545a4997f7790f50f6076 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader e61c3a8f61bb48f8a963c9480e53c168)
I20260709 13:06:04.310982 23554 raft_consensus.cc:515] T 6c5eebf646ad445a9d1b1adc319d7b16 P 127766fc592545a4997f7790f50f6076 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
W20260709 13:06:04.312070 19377 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.2:46257, user_credentials={real_user=slave}} blocked reactor thread for 44580.2us
I20260709 13:06:04.313031 23554 leader_election.cc:290] T 6c5eebf646ad445a9d1b1adc319d7b16 P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:06:04.313375 19377 leader_election.cc:400] T 1dc5b3532fe54f74876d02beffa2c230 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 10 pre-election: Vote denied by peer 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257) with higher term. Message: Invalid argument: T 1dc5b3532fe54f74876d02beffa2c230 P 0473d2b2d01f4459b1e90fd12cc7840e [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e5256d91808b47c195bc9b4dbd7f2b87 for earlier term 10. Current term is 11.
I20260709 13:06:04.290020 23489 raft_consensus.cc:2749] T 1dc5b3532fe54f74876d02beffa2c230 P 0473d2b2d01f4459b1e90fd12cc7840e [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:06:04.314222 19377 leader_election.cc:400] T df751f992649444090e27965eb1af85d P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 12 pre-election: Vote denied by peer 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257) with higher term. Message: Invalid argument: T df751f992649444090e27965eb1af85d P 0473d2b2d01f4459b1e90fd12cc7840e [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e5256d91808b47c195bc9b4dbd7f2b87 for earlier term 12. Current term is 13.
I20260709 13:06:04.287369 23214 raft_consensus.cc:2749] T b9f0d59553ad444883fcf5b5909f9798 P e61c3a8f61bb48f8a963c9480e53c168 [term 11 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:06:04.315021 23533 leader_election.cc:290] T 4af19371ea874c09a0a2147040835cbb P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:06:04.315604 23492 raft_consensus.cc:515] T ff9b0eddd810459b82d91c60777c10eb P 127766fc592545a4997f7790f50f6076 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:04.317019 19449 leader_election.cc:304] T 9962423cb4e54fcfa5de01daf68a86e7 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e; no voters: 127766fc592545a4997f7790f50f6076, e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:06:04.317754 23492 leader_election.cc:290] T ff9b0eddd810459b82d91c60777c10eb P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:06:04.287676 23220 raft_consensus.cc:2749] T 14935b3ddf914369822e4a0547aaa355 P 0473d2b2d01f4459b1e90fd12cc7840e [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:06:04.318173 23593 consensus_queue.cc:1059] T 0cdf56e38bbc453d9438d359e5a69955 P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:06:04.318539 23559 raft_consensus.cc:2749] T 2b74109013a140ada21feeef92d6f563 P 0473d2b2d01f4459b1e90fd12cc7840e [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:06:04.319377 23609 raft_consensus.cc:3055] T 0cdf56e38bbc453d9438d359e5a69955 P e5256d91808b47c195bc9b4dbd7f2b87 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:06:04.319762 23609 raft_consensus.cc:740] T 0cdf56e38bbc453d9438d359e5a69955 P e5256d91808b47c195bc9b4dbd7f2b87 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: e5256d91808b47c195bc9b4dbd7f2b87, State: Running, Role: LEADER
I20260709 13:06:04.287843 23140 raft_consensus.cc:3060] T 2b74109013a140ada21feeef92d6f563 P e61c3a8f61bb48f8a963c9480e53c168 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:06:04.320626 23609 consensus_queue.cc:260] T 0cdf56e38bbc453d9438d359e5a69955 P e5256d91808b47c195bc9b4dbd7f2b87 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:04.322333 19402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa731b585f684a7fb2d106c50f143b83" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:06:04.322448 19406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff9b0eddd810459b82d91c60777c10eb" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:06:04.323866 19408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4af19371ea874c09a0a2147040835cbb" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:06:04.324410 23316 raft_consensus.cc:2749] T 9962423cb4e54fcfa5de01daf68a86e7 P 0473d2b2d01f4459b1e90fd12cc7840e [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:06:04.324677 19408 raft_consensus.cc:2468] T 4af19371ea874c09a0a2147040835cbb P e5256d91808b47c195bc9b4dbd7f2b87 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 127766fc592545a4997f7790f50f6076 in term 7.
I20260709 13:06:04.325831 23316 raft_consensus.cc:493] T 7f575b143b844aa096b50997dad3516a P 0473d2b2d01f4459b1e90fd12cc7840e [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:04.327580 19449 leader_election.cc:304] T d1e5873a19244c5ebbcd38e126796ee7 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87; no voters: e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:06:04.329066 19449 leader_election.cc:304] T 1a61655d99124a29b486ba4a5b37faea P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e; no voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:06:04.330084 23609 raft_consensus.cc:3060] T 0cdf56e38bbc453d9438d359e5a69955 P e5256d91808b47c195bc9b4dbd7f2b87 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:06:04.329017 23538 raft_consensus.cc:2804] T d1e5873a19244c5ebbcd38e126796ee7 P 0473d2b2d01f4459b1e90fd12cc7840e [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:06:04.331920 20075 leader_election.cc:304] T 4af19371ea874c09a0a2147040835cbb P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 127766fc592545a4997f7790f50f6076, e5256d91808b47c195bc9b4dbd7f2b87; no voters: 
I20260709 13:06:04.332139 23538 raft_consensus.cc:493] T d1e5873a19244c5ebbcd38e126796ee7 P 0473d2b2d01f4459b1e90fd12cc7840e [term 11 FOLLOWER]: Starting leader election (detected failure of leader e61c3a8f61bb48f8a963c9480e53c168)
I20260709 13:06:04.332585 23538 raft_consensus.cc:3060] T d1e5873a19244c5ebbcd38e126796ee7 P 0473d2b2d01f4459b1e90fd12cc7840e [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:06:04.332770 23529 consensus_meta.cc:287] T 96efeaaf1057492490e9a621f37e1a2d P e61c3a8f61bb48f8a963c9480e53c168: Time spent flushing consensus metadata: real 0.523s	user 0.007s	sys 0.001s
I20260709 13:06:04.326447 23316 raft_consensus.cc:515] T 7f575b143b844aa096b50997dad3516a P 0473d2b2d01f4459b1e90fd12cc7840e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:04.334973 23492 raft_consensus.cc:2804] T 4af19371ea874c09a0a2147040835cbb P 127766fc592545a4997f7790f50f6076 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:06:04.335398 23492 raft_consensus.cc:493] T 4af19371ea874c09a0a2147040835cbb P 127766fc592545a4997f7790f50f6076 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:04.335778 23492 raft_consensus.cc:3060] T 4af19371ea874c09a0a2147040835cbb P 127766fc592545a4997f7790f50f6076 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:06:04.340864 19449 leader_election.cc:304] T edd7d470b5014c9489be7f41f64355c9 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e; no voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168
W20260709 13:06:04.343288 19375 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.3:36891, user_credentials={real_user=slave}} blocked reactor thread for 53580.1us
I20260709 13:06:04.348611 19449 leader_election.cc:304] T e381f1d6b8184797ad142de49be225a8 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e; no voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:06:04.353402 23622 raft_consensus.cc:2749] T edd7d470b5014c9489be7f41f64355c9 P 0473d2b2d01f4459b1e90fd12cc7840e [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:06:04.354352 19523 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:04.355187 19523 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:04.356997 19375 leader_election.cc:400] T a08760e15aac4630a629431f56024dc8 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 12 pre-election: Vote denied by peer e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891) with higher term. Message: Invalid argument: T a08760e15aac4630a629431f56024dc8 P e61c3a8f61bb48f8a963c9480e53c168 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e5256d91808b47c195bc9b4dbd7f2b87 for earlier term 12. Current term is 13.
I20260709 13:06:04.357383 19375 leader_election.cc:403] T a08760e15aac4630a629431f56024dc8 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 12 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:06:04.360095 20104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62c6c134d3d24a1ab144dd9ee6bc3f64" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:06:04.360939 19406 raft_consensus.cc:1275] T 7be9efa6559648dbb5a0f7684c4542d1 P e5256d91808b47c195bc9b4dbd7f2b87 [term 11 FOLLOWER]: Refusing update from remote peer 0473d2b2d01f4459b1e90fd12cc7840e: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 13:06:04.361280 19402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "179fd671030940b4b4a4e24bcc4aba0a" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 12 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:06:04.361850 19402 raft_consensus.cc:2468] T 179fd671030940b4b4a4e24bcc4aba0a P e5256d91808b47c195bc9b4dbd7f2b87 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 11.
I20260709 13:06:04.363159 20104 raft_consensus.cc:1275] T 7be9efa6559648dbb5a0f7684c4542d1 P 127766fc592545a4997f7790f50f6076 [term 11 FOLLOWER]: Refusing update from remote peer 0473d2b2d01f4459b1e90fd12cc7840e: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 13:06:04.363852 19404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f93ee515a9c14139bf566522ed8232f3" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 15 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:06:04.364097 20112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "309c3ca0ca4b4f3ba129752ea2cb293b" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:06:04.364432 19404 raft_consensus.cc:2468] T f93ee515a9c14139bf566522ed8232f3 P e5256d91808b47c195bc9b4dbd7f2b87 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 14.
I20260709 13:06:04.362464 19406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14efcc79969f41babe5529c22d59156d" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:06:04.365150 19409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "309c3ca0ca4b4f3ba129752ea2cb293b" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:06:04.365801 19478 raft_consensus.cc:1275] T f1b10566f45d4a7d9029858330e02d5b P 0473d2b2d01f4459b1e90fd12cc7840e [term 12 FOLLOWER]: Refusing update from remote peer e61c3a8f61bb48f8a963c9480e53c168: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:06:04.366149 19375 leader_election.cc:304] T f93ee515a9c14139bf566522ed8232f3 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:06:04.369088 19483 raft_consensus.cc:1240] T 775c229504194560ba9589bc2199b089 P 0473d2b2d01f4459b1e90fd12cc7840e [term 9 FOLLOWER]: Rejecting Update request from peer 127766fc592545a4997f7790f50f6076 for earlier term 8. Current term is 9. Ops: [8.8-8.8]
I20260709 13:06:04.370954 19405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc225c93219c45538b53a1bd3d387e4d" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:06:04.340627 23556 raft_consensus.cc:2749] T 1a61655d99124a29b486ba4a5b37faea P 0473d2b2d01f4459b1e90fd12cc7840e [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:06:04.367655 19375 leader_election.cc:304] T 21e14947d70440f19044d8f75c31e1f9 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:06:04.373603 19481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f85fc4b527a48848e5faa083b604e36" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:06:04.376078 19481 raft_consensus.cc:2468] T 1f85fc4b527a48848e5faa083b604e36 P 0473d2b2d01f4459b1e90fd12cc7840e [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 127766fc592545a4997f7790f50f6076 in term 8.
I20260709 13:06:04.377322 19481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c5eebf646ad445a9d1b1adc319d7b16" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:06:04.372810 19480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36f6ba92b9ba46babe4ebd6c02e5fbd9" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:06:04.374969 19478 raft_consensus.cc:1275] T 28af091831594f9d8e96482078cc7625 P 0473d2b2d01f4459b1e90fd12cc7840e [term 11 FOLLOWER]: Refusing update from remote peer e61c3a8f61bb48f8a963c9480e53c168: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 13:06:04.374488 20112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4af19371ea874c09a0a2147040835cbb" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:06:04.380993 20105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14efcc79969f41babe5529c22d59156d" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:06:04.381639 20105 raft_consensus.cc:2468] T 14efcc79969f41babe5529c22d59156d P 127766fc592545a4997f7790f50f6076 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 10.
I20260709 13:06:04.371953 23414 raft_consensus.cc:493] T 6c5eebf646ad445a9d1b1adc319d7b16 P 0473d2b2d01f4459b1e90fd12cc7840e [term 8 FOLLOWER]: Starting pre-election (detected failure of leader e61c3a8f61bb48f8a963c9480e53c168)
I20260709 13:06:04.383371 23414 raft_consensus.cc:515] T 6c5eebf646ad445a9d1b1adc319d7b16 P 0473d2b2d01f4459b1e90fd12cc7840e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:04.390974 19484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14efcc79969f41babe5529c22d59156d" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:06:04.391618 19484 raft_consensus.cc:2468] T 14efcc79969f41babe5529c22d59156d P 0473d2b2d01f4459b1e90fd12cc7840e [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 127766fc592545a4997f7790f50f6076 in term 10.
W20260709 13:06:04.393927 20076 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.3:36891, user_credentials={real_user=slave}} blocked reactor thread for 99056.3us
I20260709 13:06:04.394228 19481 raft_consensus.cc:2468] T 6c5eebf646ad445a9d1b1adc319d7b16 P 0473d2b2d01f4459b1e90fd12cc7840e [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 127766fc592545a4997f7790f50f6076 in term 8.
I20260709 13:06:04.396311 19553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4af19371ea874c09a0a2147040835cbb" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:06:04.396903 19553 raft_consensus.cc:2468] T 4af19371ea874c09a0a2147040835cbb P e61c3a8f61bb48f8a963c9480e53c168 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 127766fc592545a4997f7790f50f6076 in term 7.
I20260709 13:06:04.397070 19477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ec1c4ce15e04c7e8c283a62179f2a64" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:06:04.397648 19477 raft_consensus.cc:3060] T 5ec1c4ce15e04c7e8c283a62179f2a64 P 0473d2b2d01f4459b1e90fd12cc7840e [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:06:04.396314 19551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c5eebf646ad445a9d1b1adc319d7b16" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:06:04.400645 19523 leader_election.cc:304] T 309c3ca0ca4b4f3ba129752ea2cb293b P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: e61c3a8f61bb48f8a963c9480e53c168; no voters: 127766fc592545a4997f7790f50f6076, e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:06:04.401340 19405 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "21e14947d70440f19044d8f75c31e1f9"
dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
mode: GRACEFUL
new_leader_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
 from {username='slave'} at 127.0.0.1:37312
I20260709 13:06:04.401588 19553 raft_consensus.cc:1240] T b9f0d59553ad444883fcf5b5909f9798 P e61c3a8f61bb48f8a963c9480e53c168 [term 11 FOLLOWER]: Rejecting Update request from peer e5256d91808b47c195bc9b4dbd7f2b87 for earlier term 10. Current term is 11. Ops: [9.6-10.7]
I20260709 13:06:04.401878 19405 raft_consensus.cc:606] T 21e14947d70440f19044d8f75c31e1f9 P e5256d91808b47c195bc9b4dbd7f2b87 [term 9 FOLLOWER]: Received request to transfer leadership to TS e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:06:04.402118 19552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ece3db938bc649d4a40a51522ed5259c" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:06:04.402786 19478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff9b0eddd810459b82d91c60777c10eb" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:06:04.403085 19559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40e1e16737a842ee936002830f36882e" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:06:04.405104 19405 raft_consensus.cc:614] T 21e14947d70440f19044d8f75c31e1f9 P e5256d91808b47c195bc9b4dbd7f2b87 [term 9 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:06:04.360224 23214 raft_consensus.cc:493] T 1dc5b3532fe54f74876d02beffa2c230 P e61c3a8f61bb48f8a963c9480e53c168 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader e5256d91808b47c195bc9b4dbd7f2b87)
I20260709 13:06:04.408097 19554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa731b585f684a7fb2d106c50f143b83" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:06:04.371690 23436 raft_consensus.cc:493] T 2e36a9d6e29c4a7c860cf267efbd4c74 P 0473d2b2d01f4459b1e90fd12cc7840e [term 8 FOLLOWER]: Starting pre-election (detected failure of leader e61c3a8f61bb48f8a963c9480e53c168)
I20260709 13:06:04.360327 23614 raft_consensus.cc:2749] T e381f1d6b8184797ad142de49be225a8 P 0473d2b2d01f4459b1e90fd12cc7840e [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:06:04.370568 23220 raft_consensus.cc:493] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P 0473d2b2d01f4459b1e90fd12cc7840e [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:04.375555 23443 raft_consensus.cc:2804] T f93ee515a9c14139bf566522ed8232f3 P e5256d91808b47c195bc9b4dbd7f2b87 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:06:04.403368 19478 raft_consensus.cc:2468] T ff9b0eddd810459b82d91c60777c10eb P 0473d2b2d01f4459b1e90fd12cc7840e [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 127766fc592545a4997f7790f50f6076 in term 10.
I20260709 13:06:04.372071 23475 raft_consensus.cc:2749] T a08760e15aac4630a629431f56024dc8 P e5256d91808b47c195bc9b4dbd7f2b87 [term 13 FOLLOWER]: Leader pre-election lost for term 12. Reason: Vote denied by peer e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891) with higher term. Message: Invalid argument: T a08760e15aac4630a629431f56024dc8 P e61c3a8f61bb48f8a963c9480e53c168 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e5256d91808b47c195bc9b4dbd7f2b87 for earlier term 12. Current term is 13.
I20260709 13:06:04.408675 19554 raft_consensus.cc:2468] T fa731b585f684a7fb2d106c50f143b83 P e61c3a8f61bb48f8a963c9480e53c168 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 127766fc592545a4997f7790f50f6076 in term 9.
I20260709 13:06:04.406390 19523 leader_election.cc:304] T a08760e15aac4630a629431f56024dc8 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:06:04.405220 19552 raft_consensus.cc:2393] T ece3db938bc649d4a40a51522ed5259c P e61c3a8f61bb48f8a963c9480e53c168 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate e5256d91808b47c195bc9b4dbd7f2b87 in current term 10: Already voted for candidate e61c3a8f61bb48f8a963c9480e53c168 in this term.
I20260709 13:06:04.409678 23580 consensus_queue.cc:1059] T 2a16f7501e2444fb86d4e2778e734e02 P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.004s
I20260709 13:06:04.414207 23580 consensus_queue.cc:1243] T 2a16f7501e2444fb86d4e2778e734e02 P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Peer e5256d91808b47c195bc9b4dbd7f2b87 log is divergent from this leader: its last log entry 12.10 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 8
I20260709 13:06:04.409534 23522 consensus_queue.cc:1048] T 70797e5783b5454ab0d0eea663e791e3 P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.005s
I20260709 13:06:04.414785 23214 raft_consensus.cc:515] T 1dc5b3532fe54f74876d02beffa2c230 P e61c3a8f61bb48f8a963c9480e53c168 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:04.367061 23456 consensus_queue.cc:1059] T 76cb037fc9064d13b59a8969d897ce8c P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 }, Status: INVALID_TERM, Last received: 9.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.042s
I20260709 13:06:04.454275 23456 raft_consensus.cc:3055] T 76cb037fc9064d13b59a8969d897ce8c P e5256d91808b47c195bc9b4dbd7f2b87 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:06:04.454686 23456 raft_consensus.cc:740] T 76cb037fc9064d13b59a8969d897ce8c P e5256d91808b47c195bc9b4dbd7f2b87 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: e5256d91808b47c195bc9b4dbd7f2b87, State: Running, Role: LEADER
I20260709 13:06:04.455552 23456 consensus_queue.cc:260] T 76cb037fc9064d13b59a8969d897ce8c P e5256d91808b47c195bc9b4dbd7f2b87 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:04.456794 23456 raft_consensus.cc:3060] T 76cb037fc9064d13b59a8969d897ce8c P e5256d91808b47c195bc9b4dbd7f2b87 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:06:04.423599 19408 raft_consensus.cc:1240] T 172b3dd13109415a955b71ac0e9d2234 P e5256d91808b47c195bc9b4dbd7f2b87 [term 10 FOLLOWER]: Rejecting Update request from peer 127766fc592545a4997f7790f50f6076 for earlier term 9. Current term is 10. Ops: []
I20260709 13:06:04.423702 20076 leader_election.cc:304] T fa731b585f684a7fb2d106c50f143b83 P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 127766fc592545a4997f7790f50f6076, e61c3a8f61bb48f8a963c9480e53c168; no voters: e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:06:04.426769 23436 raft_consensus.cc:515] T 2e36a9d6e29c4a7c860cf267efbd4c74 P 0473d2b2d01f4459b1e90fd12cc7840e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:04.430977 23538 raft_consensus.cc:515] T d1e5873a19244c5ebbcd38e126796ee7 P 0473d2b2d01f4459b1e90fd12cc7840e [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:04.459826 23624 raft_consensus.cc:2804] T fa731b585f684a7fb2d106c50f143b83 P 127766fc592545a4997f7790f50f6076 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:06:04.460258 23624 raft_consensus.cc:493] T fa731b585f684a7fb2d106c50f143b83 P 127766fc592545a4997f7790f50f6076 [term 9 FOLLOWER]: Starting leader election (detected failure of leader e5256d91808b47c195bc9b4dbd7f2b87)
I20260709 13:06:04.460642 23624 raft_consensus.cc:3060] T fa731b585f684a7fb2d106c50f143b83 P 127766fc592545a4997f7790f50f6076 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:06:04.460953 23436 leader_election.cc:290] T 2e36a9d6e29c4a7c860cf267efbd4c74 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:06:04.432396 23489 raft_consensus.cc:493] T 46c5bfeecc314717bffe987e6844b6d0 P 0473d2b2d01f4459b1e90fd12cc7840e [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:04.421550 23594 raft_consensus.cc:493] T 22196caba61445d3bec98a0aab3c337d P e5256d91808b47c195bc9b4dbd7f2b87 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 0473d2b2d01f4459b1e90fd12cc7840e)
I20260709 13:06:04.439893 19477 raft_consensus.cc:2468] T 5ec1c4ce15e04c7e8c283a62179f2a64 P 0473d2b2d01f4459b1e90fd12cc7840e [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 127766fc592545a4997f7790f50f6076 in term 10.
I20260709 13:06:04.407603 23344 raft_consensus.cc:2749] T 309c3ca0ca4b4f3ba129752ea2cb293b P e61c3a8f61bb48f8a963c9480e53c168 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:06:04.442966 23316 leader_election.cc:290] T 7f575b143b844aa096b50997dad3516a P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:06:04.417251 23620 raft_consensus.cc:2804] T 21e14947d70440f19044d8f75c31e1f9 P e5256d91808b47c195bc9b4dbd7f2b87 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:06:04.422142 23220 raft_consensus.cc:515] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P 0473d2b2d01f4459b1e90fd12cc7840e [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:04.417656 23616 consensus_queue.cc:1048] T 7be9efa6559648dbb5a0f7684c4542d1 P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Connected to new peer: Peer: permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.044s
I20260709 13:06:04.417793 23443 raft_consensus.cc:493] T f93ee515a9c14139bf566522ed8232f3 P e5256d91808b47c195bc9b4dbd7f2b87 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:04.453194 23140 raft_consensus.cc:2804] T a08760e15aac4630a629431f56024dc8 P e61c3a8f61bb48f8a963c9480e53c168 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:06:04.461031 23538 leader_election.cc:290] T d1e5873a19244c5ebbcd38e126796ee7 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 12 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:06:04.432222 23214 leader_election.cc:290] T 1dc5b3532fe54f74876d02beffa2c230 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:06:04.467070 19406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46c5bfeecc314717bffe987e6844b6d0" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 17 candidate_status { last_received { term: 16 index: 7 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:06:04.473423 19411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4af19371ea874c09a0a2147040835cbb" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:06:04.449831 23492 raft_consensus.cc:515] T 4af19371ea874c09a0a2147040835cbb P 127766fc592545a4997f7790f50f6076 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:04.489552 23534 raft_consensus.cc:493] T 833a2f0775ed407a94b8924ce50adb63 P 127766fc592545a4997f7790f50f6076 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader e5256d91808b47c195bc9b4dbd7f2b87)
I20260709 13:06:04.503607 19480 raft_consensus.cc:2468] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P 0473d2b2d01f4459b1e90fd12cc7840e [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 127766fc592545a4997f7790f50f6076 in term 11.
I20260709 13:06:04.490245 19552 raft_consensus.cc:1240] T 3e1f505cb0f1427bbd698ac889d80821 P e61c3a8f61bb48f8a963c9480e53c168 [term 11 FOLLOWER]: Rejecting Update request from peer e5256d91808b47c195bc9b4dbd7f2b87 for earlier term 10. Current term is 11. Ops: []
W20260709 13:06:04.491887 19449 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.1:40321, user_credentials={real_user=slave}} blocked reactor thread for 111377us
I20260709 13:06:04.494776 19411 raft_consensus.cc:2468] T 4af19371ea874c09a0a2147040835cbb P e5256d91808b47c195bc9b4dbd7f2b87 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 7.
I20260709 13:06:04.494985 19408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dc5b3532fe54f74876d02beffa2c230" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:06:04.496112 19406 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2a16f7501e2444fb86d4e2778e734e02"
dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
mode: GRACEFUL
new_leader_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
 from {username='slave'} at 127.0.0.1:37312
I20260709 13:06:04.505543 19449 leader_election.cc:304] T 179fd671030940b4b4a4e24bcc4aba0a P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87; no voters: 
I20260709 13:06:04.506100 19406 raft_consensus.cc:606] T 2a16f7501e2444fb86d4e2778e734e02 P e5256d91808b47c195bc9b4dbd7f2b87 [term 12 LEADER]: Received request to transfer leadership to TS e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:06:04.496762 23214 raft_consensus.cc:493] T bc225c93219c45538b53a1bd3d387e4d P e61c3a8f61bb48f8a963c9480e53c168 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader e5256d91808b47c195bc9b4dbd7f2b87)
I20260709 13:06:04.497308 23505 raft_consensus.cc:493] T fa8650e71aa14778b3d73721fc50d9fc P e61c3a8f61bb48f8a963c9480e53c168 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 0473d2b2d01f4459b1e90fd12cc7840e)
I20260709 13:06:04.492744 23443 raft_consensus.cc:3060] T f93ee515a9c14139bf566522ed8232f3 P e5256d91808b47c195bc9b4dbd7f2b87 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:06:04.474963 23594 raft_consensus.cc:515] T 22196caba61445d3bec98a0aab3c337d P e5256d91808b47c195bc9b4dbd7f2b87 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:04.497946 19477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14935b3ddf914369822e4a0547aaa355" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:06:04.509479 19477 raft_consensus.cc:2368] T 14935b3ddf914369822e4a0547aaa355 P 0473d2b2d01f4459b1e90fd12cc7840e [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e5256d91808b47c195bc9b4dbd7f2b87 for earlier term 9. Current term is 10.
I20260709 13:06:04.467916 23489 raft_consensus.cc:515] T 46c5bfeecc314717bffe987e6844b6d0 P 0473d2b2d01f4459b1e90fd12cc7840e [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:04.497978 23140 raft_consensus.cc:697] T a08760e15aac4630a629431f56024dc8 P e61c3a8f61bb48f8a963c9480e53c168 [term 13 LEADER]: Becoming Leader. State: Replica: e61c3a8f61bb48f8a963c9480e53c168, State: Running, Role: LEADER
I20260709 13:06:04.480716 23620 raft_consensus.cc:493] T 21e14947d70440f19044d8f75c31e1f9 P e5256d91808b47c195bc9b4dbd7f2b87 [term 9 FOLLOWER]: Starting leader election (detected failure of leader e61c3a8f61bb48f8a963c9480e53c168)
I20260709 13:06:04.501011 23533 consensus_queue.cc:1048] T 179fd671030940b4b4a4e24bcc4aba0a P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:06:04.494434 23475 consensus_queue.cc:1059] T b9f0d59553ad444883fcf5b5909f9798 P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.009s
I20260709 13:06:04.502275 19526 leader_election.cc:304] T 0afb57ae58a24a01850491d69f0213dd P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e61c3a8f61bb48f8a963c9480e53c168; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, 127766fc592545a4997f7790f50f6076
I20260709 13:06:04.506919 19449 leader_election.cc:304] T f93ee515a9c14139bf566522ed8232f3 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87; no voters: 
I20260709 13:06:04.505633 19411 raft_consensus.cc:1275] T 7f575b143b844aa096b50997dad3516a P e5256d91808b47c195bc9b4dbd7f2b87 [term 7 FOLLOWER]: Refusing update from remote peer e61c3a8f61bb48f8a963c9480e53c168: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 13:06:04.517802 19449 leader_election.cc:304] T 309c3ca0ca4b4f3ba129752ea2cb293b P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e; no voters: 127766fc592545a4997f7790f50f6076, e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:06:04.518128 19478 raft_consensus.cc:1240] T df751f992649444090e27965eb1af85d P 0473d2b2d01f4459b1e90fd12cc7840e [term 13 LEADER]: Rejecting Update request from peer e5256d91808b47c195bc9b4dbd7f2b87 for earlier term 12. Current term is 13. Ops: []
I20260709 13:06:04.470492 23387 consensus_queue.cc:1059] T 172b3dd13109415a955b71ac0e9d2234 P 127766fc592545a4997f7790f50f6076 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 }, Status: INVALID_TERM, Last received: 9.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.025s
I20260709 13:06:04.505676 19523 leader_election.cc:304] T 4af19371ea874c09a0a2147040835cbb P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:06:04.511217 19484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a61655d99124a29b486ba4a5b37faea" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:06:04.519384 20112 raft_consensus.cc:2393] T 4af19371ea874c09a0a2147040835cbb P 127766fc592545a4997f7790f50f6076 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e61c3a8f61bb48f8a963c9480e53c168 in current term 8: Already voted for candidate 127766fc592545a4997f7790f50f6076 in this term.
I20260709 13:06:04.521628 19526 leader_election.cc:304] T 4509b76741dc428e9201c70c1658da13 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e61c3a8f61bb48f8a963c9480e53c168; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:06:04.523144 19477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86a6797bdfe94fa496c050ceae4bd0d9" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:06:04.521447 19478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff9b0eddd810459b82d91c60777c10eb" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:06:04.526484 19484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1b10566f45d4a7d9029858330e02d5b" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:06:04.509353 23616 raft_consensus.cc:2804] T 179fd671030940b4b4a4e24bcc4aba0a P 0473d2b2d01f4459b1e90fd12cc7840e [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:06:04.527319 19484 raft_consensus.cc:2368] T f1b10566f45d4a7d9029858330e02d5b P 0473d2b2d01f4459b1e90fd12cc7840e [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e5256d91808b47c195bc9b4dbd7f2b87 for earlier term 11. Current term is 12.
I20260709 13:06:04.531852 19484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "179fd671030940b4b4a4e24bcc4aba0a" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:06:04.529315 19526 leader_election.cc:304] T ab43d85f64114d4ebf618930e43d9ed0 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: e61c3a8f61bb48f8a963c9480e53c168; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:06:04.536228 19478 raft_consensus.cc:2468] T ff9b0eddd810459b82d91c60777c10eb P 0473d2b2d01f4459b1e90fd12cc7840e [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 10.
I20260709 13:06:04.530398 23344 raft_consensus.cc:2804] T 4af19371ea874c09a0a2147040835cbb P e61c3a8f61bb48f8a963c9480e53c168 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:06:04.538250 23344 raft_consensus.cc:493] T 4af19371ea874c09a0a2147040835cbb P e61c3a8f61bb48f8a963c9480e53c168 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:04.538609 23344 raft_consensus.cc:3060] T 4af19371ea874c09a0a2147040835cbb P e61c3a8f61bb48f8a963c9480e53c168 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:06:04.526057 23547 raft_consensus.cc:2749] T 0afb57ae58a24a01850491d69f0213dd P e61c3a8f61bb48f8a963c9480e53c168 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:06:04.539891 23585 raft_consensus.cc:3055] T b9f0d59553ad444883fcf5b5909f9798 P e5256d91808b47c195bc9b4dbd7f2b87 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:06:04.540393 23585 raft_consensus.cc:740] T b9f0d59553ad444883fcf5b5909f9798 P e5256d91808b47c195bc9b4dbd7f2b87 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: e5256d91808b47c195bc9b4dbd7f2b87, State: Running, Role: LEADER
I20260709 13:06:04.541239 23585 consensus_queue.cc:260] T b9f0d59553ad444883fcf5b5909f9798 P e5256d91808b47c195bc9b4dbd7f2b87 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:04.511189 23214 raft_consensus.cc:515] T bc225c93219c45538b53a1bd3d387e4d P e61c3a8f61bb48f8a963c9480e53c168 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:04.503192 23534 raft_consensus.cc:515] T 833a2f0775ed407a94b8924ce50adb63 P 127766fc592545a4997f7790f50f6076 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:04.544665 19478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46c5bfeecc314717bffe987e6844b6d0" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 16 candidate_status { last_received { term: 15 index: 6 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:06:04.545542 19478 raft_consensus.cc:2376] T 46c5bfeecc314717bffe987e6844b6d0 P 0473d2b2d01f4459b1e90fd12cc7840e [term 16 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 16. Re-sending same reply.
I20260709 13:06:04.545964 19411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc225c93219c45538b53a1bd3d387e4d" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:06:04.547484 19526 leader_election.cc:304] T 76cb037fc9064d13b59a8969d897ce8c P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168; no voters: e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:06:04.544118 23214 leader_election.cc:290] T bc225c93219c45538b53a1bd3d387e4d P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:06:04.549204 23551 raft_consensus.cc:2804] T 76cb037fc9064d13b59a8969d897ce8c P e61c3a8f61bb48f8a963c9480e53c168 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:06:04.549736 23551 raft_consensus.cc:697] T 76cb037fc9064d13b59a8969d897ce8c P e61c3a8f61bb48f8a963c9480e53c168 [term 10 LEADER]: Becoming Leader. State: Replica: e61c3a8f61bb48f8a963c9480e53c168, State: Running, Role: LEADER
I20260709 13:06:04.550702 23551 consensus_queue.cc:237] T 76cb037fc9064d13b59a8969d897ce8c P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:04.551404 23140 consensus_queue.cc:237] T a08760e15aac4630a629431f56024dc8 P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:04.513352 23505 raft_consensus.cc:515] T fa8650e71aa14778b3d73721fc50d9fc P e61c3a8f61bb48f8a963c9480e53c168 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:04.555441 23505 leader_election.cc:290] T fa8650e71aa14778b3d73721fc50d9fc P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:06:04.522820 23538 raft_consensus.cc:2804] T f93ee515a9c14139bf566522ed8232f3 P 0473d2b2d01f4459b1e90fd12cc7840e [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:06:04.556183 23538 raft_consensus.cc:493] T f93ee515a9c14139bf566522ed8232f3 P 0473d2b2d01f4459b1e90fd12cc7840e [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:04.556581 23538 raft_consensus.cc:3060] T f93ee515a9c14139bf566522ed8232f3 P 0473d2b2d01f4459b1e90fd12cc7840e [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:06:04.557860 23489 leader_election.cc:290] T 46c5bfeecc314717bffe987e6844b6d0 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:06:04.520021 23465 consensus_queue.cc:1059] T 3e1f505cb0f1427bbd698ac889d80821 P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.035s
I20260709 13:06:04.558689 23547 raft_consensus.cc:2749] T ab43d85f64114d4ebf618930e43d9ed0 P e61c3a8f61bb48f8a963c9480e53c168 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:06:04.559135 23465 raft_consensus.cc:3055] T 3e1f505cb0f1427bbd698ac889d80821 P e5256d91808b47c195bc9b4dbd7f2b87 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:06:04.559523 23465 raft_consensus.cc:740] T 3e1f505cb0f1427bbd698ac889d80821 P e5256d91808b47c195bc9b4dbd7f2b87 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: e5256d91808b47c195bc9b4dbd7f2b87, State: Running, Role: LEADER
W20260709 13:06:04.561264 19376 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:04.561947 19478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edd7d470b5014c9489be7f41f64355c9" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 12 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:06:04.562402 19526 leader_election.cc:304] T 2725d2c4cb054f18b0fc8f735c15f6c2 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168; no voters: e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:06:04.563580 19478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef32ce6fdd0e40d382c79974f30295c6" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:06:04.515678 23620 raft_consensus.cc:3060] T 21e14947d70440f19044d8f75c31e1f9 P e5256d91808b47c195bc9b4dbd7f2b87 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:06:04.564778 19477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "309c3ca0ca4b4f3ba129752ea2cb293b" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:06:04.520674 23316 raft_consensus.cc:2749] T 309c3ca0ca4b4f3ba129752ea2cb293b P 0473d2b2d01f4459b1e90fd12cc7840e [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:06:04.560420 23465 consensus_queue.cc:260] T 3e1f505cb0f1427bbd698ac889d80821 P e5256d91808b47c195bc9b4dbd7f2b87 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:04.571843 19526 leader_election.cc:304] T 3e1f505cb0f1427bbd698ac889d80821 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168; no voters: e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:06:04.563071 19298 maintenance_manager.cc:419] P 97750b77d35444acb7791ebf26cc2685: Scheduling FlushMRSOp(00000000000000000000000000000000): perf score=0.033487
I20260709 13:06:04.572207 23214 raft_consensus.cc:2804] T 2725d2c4cb054f18b0fc8f735c15f6c2 P e61c3a8f61bb48f8a963c9480e53c168 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:06:04.509572 23622 consensus_queue.cc:1048] T 7be9efa6559648dbb5a0f7684c4542d1 P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.036s
I20260709 13:06:04.545171 23580 raft_consensus.cc:2749] T 4509b76741dc428e9201c70c1658da13 P e61c3a8f61bb48f8a963c9480e53c168 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:06:04.545457 23616 raft_consensus.cc:493] T 179fd671030940b4b4a4e24bcc4aba0a P 0473d2b2d01f4459b1e90fd12cc7840e [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:04.577527 19478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f93ee515a9c14139bf566522ed8232f3" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 15 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:06:04.578658 19408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa8650e71aa14778b3d73721fc50d9fc" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:06:04.579296 23505 raft_consensus.cc:2804] T 3e1f505cb0f1427bbd698ac889d80821 P e61c3a8f61bb48f8a963c9480e53c168 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:06:04.579974 19477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21e14947d70440f19044d8f75c31e1f9" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:06:04.530634 23522 consensus_queue.cc:1048] T 7f575b143b844aa096b50997dad3516a P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.046s
I20260709 13:06:04.584087 19477 raft_consensus.cc:2393] T 21e14947d70440f19044d8f75c31e1f9 P 0473d2b2d01f4459b1e90fd12cc7840e [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e5256d91808b47c195bc9b4dbd7f2b87 in current term 10: Already voted for candidate 0473d2b2d01f4459b1e90fd12cc7840e in this term.
I20260709 13:06:04.584764 19554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22196caba61445d3bec98a0aab3c337d" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:06:04.578469 23214 raft_consensus.cc:493] T 2725d2c4cb054f18b0fc8f735c15f6c2 P e61c3a8f61bb48f8a963c9480e53c168 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:04.581566 23387 raft_consensus.cc:493] T ed7fdbcb96d14d418db9ca90a792588a P 127766fc592545a4997f7790f50f6076 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:04.583550 23616 raft_consensus.cc:3060] T 179fd671030940b4b4a4e24bcc4aba0a P 0473d2b2d01f4459b1e90fd12cc7840e [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:06:04.594787 19477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40e1e16737a842ee936002830f36882e" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:06:04.582216 23220 leader_election.cc:290] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:06:04.586658 23465 raft_consensus.cc:3060] T 3e1f505cb0f1427bbd698ac889d80821 P e5256d91808b47c195bc9b4dbd7f2b87 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:06:04.597684 19477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "217b5fae677b4971b3bbd2f357a1f7ff" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:06:04.591764 23505 raft_consensus.cc:697] T 3e1f505cb0f1427bbd698ac889d80821 P e61c3a8f61bb48f8a963c9480e53c168 [term 11 LEADER]: Becoming Leader. State: Replica: e61c3a8f61bb48f8a963c9480e53c168, State: Running, Role: LEADER
I20260709 13:06:04.599615 23492 leader_election.cc:290] T 4af19371ea874c09a0a2147040835cbb P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 8 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:06:04.600251 19407 raft_consensus.cc:1275] T 0cdf56e38bbc453d9438d359e5a69955 P e5256d91808b47c195bc9b4dbd7f2b87 [term 12 FOLLOWER]: Refusing update from remote peer e61c3a8f61bb48f8a963c9480e53c168: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:06:04.606992 19477 raft_consensus.cc:2368] T 217b5fae677b4971b3bbd2f357a1f7ff P 0473d2b2d01f4459b1e90fd12cc7840e [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e5256d91808b47c195bc9b4dbd7f2b87 for earlier term 7. Current term is 8.
I20260709 13:06:04.607901 19477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "172b3dd13109415a955b71ac0e9d2234" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:06:04.608426 19477 raft_consensus.cc:3060] T 172b3dd13109415a955b71ac0e9d2234 P 0473d2b2d01f4459b1e90fd12cc7840e [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:06:04.581875 23582 consensus_queue.cc:1048] T f1b10566f45d4a7d9029858330e02d5b P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.013s
I20260709 13:06:04.592833 23214 raft_consensus.cc:3060] T 2725d2c4cb054f18b0fc8f735c15f6c2 P e61c3a8f61bb48f8a963c9480e53c168 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:06:04.688517 19408 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2e36a9d6e29c4a7c860cf267efbd4c74"
dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
mode: GRACEFUL
new_leader_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
 from {username='slave'} at 127.0.0.1:37312
I20260709 13:06:04.689333 19408 raft_consensus.cc:606] T 2e36a9d6e29c4a7c860cf267efbd4c74 P e5256d91808b47c195bc9b4dbd7f2b87 [term 8 FOLLOWER]: Received request to transfer leadership to TS e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:06:04.689739 19408 raft_consensus.cc:614] T 2e36a9d6e29c4a7c860cf267efbd4c74 P e5256d91808b47c195bc9b4dbd7f2b87 [term 8 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:06:04.710420 19554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4af19371ea874c09a0a2147040835cbb" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:06:04.717783 19477 raft_consensus.cc:2468] T 172b3dd13109415a955b71ac0e9d2234 P 0473d2b2d01f4459b1e90fd12cc7840e [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 10.
I20260709 13:06:04.722755 19377 leader_election.cc:400] T 14935b3ddf914369822e4a0547aaa355 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 9 pre-election: Vote denied by peer 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257) with higher term. Message: Invalid argument: T 14935b3ddf914369822e4a0547aaa355 P 0473d2b2d01f4459b1e90fd12cc7840e [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e5256d91808b47c195bc9b4dbd7f2b87 for earlier term 9. Current term is 10.
I20260709 13:06:04.723102 19377 leader_election.cc:403] T 14935b3ddf914369822e4a0547aaa355 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 9 pre-election: Cancelling election due to peer responding with higher term
W20260709 13:06:04.725272 19560 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40428 (request call id 2360) took 2470 ms (client timeout 1892 ms). Trace:
I20260709 13:06:04.727051 19477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e36a9d6e29c4a7c860cf267efbd4c74" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:06:04.728931 19477 raft_consensus.cc:2410] T 2e36a9d6e29c4a7c860cf267efbd4c74 P 0473d2b2d01f4459b1e90fd12cc7840e [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e5256d91808b47c195bc9b4dbd7f2b87 for term 9 because replica has last-logged OpId of term: 8 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
W20260709 13:06:04.728093 19560 rpcz_store.cc:269] 0709 13:06:02.240556 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:02.240672 (+   116us) service_pool.cc:224] Handling call
0709 13:06:04.709621 (+2468949us) spinlock_profiling.cc:243] Waited 517 ms on lock 0x7b54003093d4. stack: 00007f4a79de9343 00007f4a79de9240 00007f4a797781d4 00007f4a834b6304 00007f4a834b6299 00007f4a7ce71571 00007f4a7cf0c2fa 00007f4a81ecdb17 00007f4a7b4486d4 00007f4a7b448662 00007f4a7b448591 00007f4a7b44850c 00007f4a7b4477c2 00007f4a7b24348c 00007f4a7b2428c6 00007f4a7b24226f
0709 13:06:04.709798 (+   177us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1189802752}
I20260709 13:06:04.685985 23580 raft_consensus.cc:493] T 86a6797bdfe94fa496c050ceae4bd0d9 P e61c3a8f61bb48f8a963c9480e53c168 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 0473d2b2d01f4459b1e90fd12cc7840e)
W20260709 13:06:04.741303 23633 log.cc:927] Time spent T a08760e15aac4630a629431f56024dc8 P e61c3a8f61bb48f8a963c9480e53c168: Append to log took a long time: real 0.153s	user 0.000s	sys 0.000s
I20260709 13:06:04.725679 23316 raft_consensus.cc:493] T 775c229504194560ba9589bc2199b089 P 0473d2b2d01f4459b1e90fd12cc7840e [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:04.741894 23316 raft_consensus.cc:515] T 775c229504194560ba9589bc2199b089 P 0473d2b2d01f4459b1e90fd12cc7840e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:04.743947 23316 leader_election.cc:290] T 775c229504194560ba9589bc2199b089 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:06:04.713356 23609 raft_consensus.cc:493] T 4509b76741dc428e9201c70c1658da13 P e5256d91808b47c195bc9b4dbd7f2b87 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 0473d2b2d01f4459b1e90fd12cc7840e)
I20260709 13:06:04.601984 23387 raft_consensus.cc:515] T ed7fdbcb96d14d418db9ca90a792588a P 127766fc592545a4997f7790f50f6076 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
W20260709 13:06:04.752449 19375 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:04.720460 23492 raft_consensus.cc:493] T 0afb57ae58a24a01850491d69f0213dd P 127766fc592545a4997f7790f50f6076 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 0473d2b2d01f4459b1e90fd12cc7840e)
I20260709 13:06:04.762106 20078 leader_election.cc:304] T 1f85fc4b527a48848e5faa083b604e36 P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, 127766fc592545a4997f7790f50f6076; no voters: e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:06:04.763667 20078 leader_election.cc:304] T 14efcc79969f41babe5529c22d59156d P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, 127766fc592545a4997f7790f50f6076; no voters: e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:06:04.727468 23592 raft_consensus.cc:2749] T 14935b3ddf914369822e4a0547aaa355 P e5256d91808b47c195bc9b4dbd7f2b87 [term 10 FOLLOWER]: Leader pre-election lost for term 9. Reason: Vote denied by peer 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257) with higher term. Message: Invalid argument: T 14935b3ddf914369822e4a0547aaa355 P 0473d2b2d01f4459b1e90fd12cc7840e [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e5256d91808b47c195bc9b4dbd7f2b87 for earlier term 9. Current term is 10.
W20260709 13:06:04.752194 23581 log.cc:927] Time spent T 40e1e16737a842ee936002830f36882e P 0473d2b2d01f4459b1e90fd12cc7840e: Append to log took a long time: real 1.394s	user 0.013s	sys 0.000s
I20260709 13:06:04.772746 19477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a08760e15aac4630a629431f56024dc8" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:06:04.773746 19477 raft_consensus.cc:2368] T a08760e15aac4630a629431f56024dc8 P 0473d2b2d01f4459b1e90fd12cc7840e [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e5256d91808b47c195bc9b4dbd7f2b87 for earlier term 12. Current term is 13.
I20260709 13:06:04.749763 23533 raft_consensus.cc:493] T 1efebf73c86e432baa55533136b6e12c P e61c3a8f61bb48f8a963c9480e53c168 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:04.775703 19477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22196caba61445d3bec98a0aab3c337d" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:06:04.786875 19477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e5873a19244c5ebbcd38e126796ee7" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:06:04.787931 19477 raft_consensus.cc:2393] T d1e5873a19244c5ebbcd38e126796ee7 P 0473d2b2d01f4459b1e90fd12cc7840e [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e5256d91808b47c195bc9b4dbd7f2b87 in current term 12: Already voted for candidate 0473d2b2d01f4459b1e90fd12cc7840e in this term.
I20260709 13:06:04.788291 23344 raft_consensus.cc:515] T 4af19371ea874c09a0a2147040835cbb P e61c3a8f61bb48f8a963c9480e53c168 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:04.789397 19477 raft_consensus.cc:1240] T b9f0d59553ad444883fcf5b5909f9798 P 0473d2b2d01f4459b1e90fd12cc7840e [term 11 LEADER]: Rejecting Update request from peer e5256d91808b47c195bc9b4dbd7f2b87 for earlier term 10. Current term is 11. Ops: []
I20260709 13:06:04.789646 19554 raft_consensus.cc:2393] T 4af19371ea874c09a0a2147040835cbb P e61c3a8f61bb48f8a963c9480e53c168 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 127766fc592545a4997f7790f50f6076 in current term 8: Already voted for candidate e61c3a8f61bb48f8a963c9480e53c168 in this term.
I20260709 13:06:04.781149 23533 raft_consensus.cc:515] T 1efebf73c86e432baa55533136b6e12c P e61c3a8f61bb48f8a963c9480e53c168 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:04.792491 23622 raft_consensus.cc:493] T 1efebf73c86e432baa55533136b6e12c P 0473d2b2d01f4459b1e90fd12cc7840e [term 9 FOLLOWER]: Starting pre-election (detected failure of leader e61c3a8f61bb48f8a963c9480e53c168)
I20260709 13:06:04.793345 23533 leader_election.cc:290] T 1efebf73c86e432baa55533136b6e12c P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:06:04.793135 23622 raft_consensus.cc:515] T 1efebf73c86e432baa55533136b6e12c P 0473d2b2d01f4459b1e90fd12cc7840e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:04.776597 23268 raft_consensus.cc:2804] T 1f85fc4b527a48848e5faa083b604e36 P 127766fc592545a4997f7790f50f6076 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:06:04.795224 23268 raft_consensus.cc:493] T 1f85fc4b527a48848e5faa083b604e36 P 127766fc592545a4997f7790f50f6076 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:04.795459 23622 leader_election.cc:290] T 1efebf73c86e432baa55533136b6e12c P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:06:04.795665 23268 raft_consensus.cc:3060] T 1f85fc4b527a48848e5faa083b604e36 P 127766fc592545a4997f7790f50f6076 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:06:04.792537 19477 raft_consensus.cc:1275] T 2725d2c4cb054f18b0fc8f735c15f6c2 P 0473d2b2d01f4459b1e90fd12cc7840e [term 12 FOLLOWER]: Refusing update from remote peer e5256d91808b47c195bc9b4dbd7f2b87: Log matching property violated. Preceding OpId in replica: term: 8 index: 4. Preceding OpId from leader: term: 12 index: 6. (index mismatch)
I20260709 13:06:04.748041 23580 raft_consensus.cc:515] T 86a6797bdfe94fa496c050ceae4bd0d9 P e61c3a8f61bb48f8a963c9480e53c168 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:04.759749 23609 raft_consensus.cc:515] T 4509b76741dc428e9201c70c1658da13 P e5256d91808b47c195bc9b4dbd7f2b87 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:04.815254 23534 leader_election.cc:290] T 833a2f0775ed407a94b8924ce50adb63 P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:06:04.790437 23344 leader_election.cc:290] T 4af19371ea874c09a0a2147040835cbb P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 8 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:06:04.767546 23492 raft_consensus.cc:515] T 0afb57ae58a24a01850491d69f0213dd P 127766fc592545a4997f7790f50f6076 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:04.753896 23505 consensus_queue.cc:237] T 3e1f505cb0f1427bbd698ac889d80821 P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
W20260709 13:06:04.824029 23628 log.cc:927] Time spent T 62c6c134d3d24a1ab144dd9ee6bc3f64 P e61c3a8f61bb48f8a963c9480e53c168: Append to log took a long time: real 0.238s	user 0.000s	sys 0.001s
I20260709 13:06:04.821461 23634 raft_consensus.cc:2804] T 14efcc79969f41babe5529c22d59156d P 127766fc592545a4997f7790f50f6076 [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 13:06:04.844321 20078 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.2:46257, user_credentials={real_user=slave}} blocked reactor thread for 73674.7us
I20260709 13:06:04.845891 20078 leader_election.cc:304] T ff9b0eddd810459b82d91c60777c10eb P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, 127766fc592545a4997f7790f50f6076; no voters: e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:06:04.824014 23214 raft_consensus.cc:515] T 2725d2c4cb054f18b0fc8f735c15f6c2 P e61c3a8f61bb48f8a963c9480e53c168 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
W20260709 13:06:04.859771 23595 log.cc:927] Time spent T df751f992649444090e27965eb1af85d P 0473d2b2d01f4459b1e90fd12cc7840e: Append to log took a long time: real 1.088s	user 0.004s	sys 0.007s
I20260709 13:06:04.862948 20078 leader_election.cc:304] T 5ec1c4ce15e04c7e8c283a62179f2a64 P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, 127766fc592545a4997f7790f50f6076; no voters: e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:06:04.844590 23634 raft_consensus.cc:493] T 14efcc79969f41babe5529c22d59156d P 127766fc592545a4997f7790f50f6076 [term 10 FOLLOWER]: Starting leader election (detected failure of leader e5256d91808b47c195bc9b4dbd7f2b87)
I20260709 13:06:04.875959 19560 raft_consensus.cc:1240] T 2725d2c4cb054f18b0fc8f735c15f6c2 P e61c3a8f61bb48f8a963c9480e53c168 [term 13 FOLLOWER]: Rejecting Update request from peer e5256d91808b47c195bc9b4dbd7f2b87 for earlier term 12. Current term is 13. Ops: []
I20260709 13:06:04.869441 23636 raft_consensus.cc:493] T 7be9efa6559648dbb5a0f7684c4542d1 P 127766fc592545a4997f7790f50f6076 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:04.874037 23634 raft_consensus.cc:3060] T 14efcc79969f41babe5529c22d59156d P 127766fc592545a4997f7790f50f6076 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:06:04.880506 23632 log.cc:927] Time spent T 309c3ca0ca4b4f3ba129752ea2cb293b P e5256d91808b47c195bc9b4dbd7f2b87: Append to log took a long time: real 0.130s	user 0.001s	sys 0.000s
I20260709 13:06:04.891690 23214 leader_election.cc:290] T 2725d2c4cb054f18b0fc8f735c15f6c2 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 13 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:06:04.881536 23645 raft_consensus.cc:2804] T ff9b0eddd810459b82d91c60777c10eb P 127766fc592545a4997f7790f50f6076 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:06:04.896395 23387 leader_election.cc:290] T ed7fdbcb96d14d418db9ca90a792588a P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:06:04.899863 23609 leader_election.cc:290] T 4509b76741dc428e9201c70c1658da13 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:06:04.900525 23580 leader_election.cc:290] T 86a6797bdfe94fa496c050ceae4bd0d9 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:06:04.901472 23443 raft_consensus.cc:515] T f93ee515a9c14139bf566522ed8232f3 P e5256d91808b47c195bc9b4dbd7f2b87 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:04.901201 23268 raft_consensus.cc:515] T 1f85fc4b527a48848e5faa083b604e36 P 127766fc592545a4997f7790f50f6076 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:04.903380 23443 leader_election.cc:290] T f93ee515a9c14139bf566522ed8232f3 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 15 election: Requested vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:06:04.903435 23268 leader_election.cc:290] T 1f85fc4b527a48848e5faa083b604e36 P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 9 election: Requested vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321)
I20260709 13:06:04.905414 23624 raft_consensus.cc:515] T fa731b585f684a7fb2d106c50f143b83 P 127766fc592545a4997f7790f50f6076 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:04.893916 23638 raft_consensus.cc:2804] T 5ec1c4ce15e04c7e8c283a62179f2a64 P 127766fc592545a4997f7790f50f6076 [term 10 FOLLOWER]: Leader election won for term 10
W20260709 13:06:04.898967 23635 log.cc:927] Time spent T 70797e5783b5454ab0d0eea663e791e3 P e5256d91808b47c195bc9b4dbd7f2b87: Append to log took a long time: real 0.051s	user 0.000s	sys 0.001s
I20260709 13:06:04.918987 19410 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49050 (request call id 611) took 1255 ms. Trace:
I20260709 13:06:04.897055 23620 raft_consensus.cc:515] T 21e14947d70440f19044d8f75c31e1f9 P e5256d91808b47c195bc9b4dbd7f2b87 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:04.912657 23516 raft_consensus.cc:493] T 21e14947d70440f19044d8f75c31e1f9 P e61c3a8f61bb48f8a963c9480e53c168 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:04.913559 23538 raft_consensus.cc:515] T f93ee515a9c14139bf566522ed8232f3 P 0473d2b2d01f4459b1e90fd12cc7840e [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:04.923385 19478 raft_consensus.cc:2393] T f93ee515a9c14139bf566522ed8232f3 P 0473d2b2d01f4459b1e90fd12cc7840e [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e5256d91808b47c195bc9b4dbd7f2b87 in current term 15: Already voted for candidate 0473d2b2d01f4459b1e90fd12cc7840e in this term.
I20260709 13:06:04.923349 19479 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58286 (request call id 1988) took 1210 ms. Trace:
I20260709 13:06:04.923859 19479 rpcz_store.cc:276] 0709 13:06:03.713415 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:03.837963 (+124548us) service_pool.cc:224] Handling call
0709 13:06:03.838297 (+   334us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:03.902716 (+ 64419us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:03.902746 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:03.911728 (+  8982us) log.cc:844] Serialized 26 byte log entry
0709 13:06:04.249623 (+337895us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:06:04.249676 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:04.919596 (+669920us) spinlock_profiling.cc:243] Waited 55.6 ms on lock 0x7b5400310454. stack: 00007f4a79de9343 00007f4a79de9240 00007f4a797781d4 00007f4a834b6304 00007f4a834b6299 00007f4a7ce71571 00007f4a7cf08e01 00007f4a7cf0783e 00007f4a81ecc419 00007f4a7b443bd4 00007f4a7b443b62 00007f4a7b443a91 00007f4a7b443a0c 00007f4a7b442cc2 00007f4a7b24348c 00007f4a7b2428c6
0709 13:06:04.919641 (+    45us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:04.919683 (+    42us) raft_consensus.cc:1685] finished
0709 13:06:04.919695 (+    12us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:04.923294 (+  3599us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":8768,"raft.run_cpu_time_us":125,"raft.run_wall_time_us":9165,"spinlock_wait_cycles":127885184,"thread_start_us":168360,"threads_started":1,"wal-append.queue_time_us":301609}
I20260709 13:06:04.925608 23538 leader_election.cc:290] T f93ee515a9c14139bf566522ed8232f3 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 15 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:06:04.895488 23645 raft_consensus.cc:493] T ff9b0eddd810459b82d91c60777c10eb P 127766fc592545a4997f7790f50f6076 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:04.883279 23636 raft_consensus.cc:515] T 7be9efa6559648dbb5a0f7684c4542d1 P 127766fc592545a4997f7790f50f6076 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } attrs { replace: true } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:04.919356 19410 rpcz_store.cc:276] 0709 13:06:03.664041 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:03.666048 (+  2007us) service_pool.cc:224] Handling call
0709 13:06:03.666301 (+   253us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:03.666482 (+   181us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:03.666506 (+    24us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:04.502149 (+835643us) spinlock_profiling.cc:243] Waited 6.86 ms on lock 0x7b2c00032ed8. stack: 00007f4a79de9343 00007f4a79de9240 00007f4a797781d4 00007f4a834b6304 00007f4a834b6299 00007f4a7b801a11 00007f4a7b811372 00007f4a7cf43a01 00007f4a7cf0843a 00007f4a7cf0783e 00007f4a81ecc419 00007f4a7b443bd4 00007f4a7b443b62 00007f4a7b443a91 00007f4a7b443a0c 00007f4a7b442cc2
0709 13:06:04.502550 (+   401us) log.cc:844] Serialized 26 byte log entry
0709 13:06:04.562954 (+ 60404us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:06:04.562986 (+    32us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:04.563048 (+    62us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:04.916113 (+353065us) raft_consensus.cc:1685] finished
0709 13:06:04.916137 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:04.918919 (+  2782us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":15773952,"thread_start_us":49566,"threads_started":1,"wal-append.queue_time_us":207138}
I20260709 13:06:04.926203 23559 raft_consensus.cc:493] T 217b5fae677b4971b3bbd2f357a1f7ff P 0473d2b2d01f4459b1e90fd12cc7840e [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:04.915647 23616 raft_consensus.cc:515] T 179fd671030940b4b4a4e24bcc4aba0a P 0473d2b2d01f4459b1e90fd12cc7840e [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:04.928634 23636 leader_election.cc:290] T 7be9efa6559648dbb5a0f7684c4542d1 P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:06:04.930943 19484 raft_consensus.cc:2368] T 179fd671030940b4b4a4e24bcc4aba0a P 0473d2b2d01f4459b1e90fd12cc7840e [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate e5256d91808b47c195bc9b4dbd7f2b87 for earlier term 10. Current term is 12.
I20260709 13:06:04.925720 19479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed7fdbcb96d14d418db9ca90a792588a" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:06:04.931594 19479 raft_consensus.cc:2468] T ed7fdbcb96d14d418db9ca90a792588a P 0473d2b2d01f4459b1e90fd12cc7840e [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 127766fc592545a4997f7790f50f6076 in term 8.
I20260709 13:06:04.932386 19479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f85fc4b527a48848e5faa083b604e36" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:06:04.932559 20078 leader_election.cc:304] T ed7fdbcb96d14d418db9ca90a792588a P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, 127766fc592545a4997f7790f50f6076; no voters: 
I20260709 13:06:04.932868 19479 raft_consensus.cc:3060] T 1f85fc4b527a48848e5faa083b604e36 P 0473d2b2d01f4459b1e90fd12cc7840e [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:06:04.935559 23636 raft_consensus.cc:2804] T ed7fdbcb96d14d418db9ca90a792588a P 127766fc592545a4997f7790f50f6076 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:06:04.935964 23636 raft_consensus.cc:493] T ed7fdbcb96d14d418db9ca90a792588a P 127766fc592545a4997f7790f50f6076 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:04.936292 23636 raft_consensus.cc:3060] T ed7fdbcb96d14d418db9ca90a792588a P 127766fc592545a4997f7790f50f6076 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:06:04.930876 23559 raft_consensus.cc:515] T 217b5fae677b4971b3bbd2f357a1f7ff P 0473d2b2d01f4459b1e90fd12cc7840e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:04.944720 23559 leader_election.cc:290] T 217b5fae677b4971b3bbd2f357a1f7ff P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:06:04.948137 20105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c5eebf646ad445a9d1b1adc319d7b16" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:06:04.948793 20105 raft_consensus.cc:2468] T 6c5eebf646ad445a9d1b1adc319d7b16 P 127766fc592545a4997f7790f50f6076 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 8.
W20260709 13:06:04.942572 19374 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:04.949642 19406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e5873a19244c5ebbcd38e126796ee7" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
I20260709 13:06:04.950743 20104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36f6ba92b9ba46babe4ebd6c02e5fbd9" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:06:04.951649 20110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1efebf73c86e432baa55533136b6e12c" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:06:04.951900 19449 leader_election.cc:304] T 14efcc79969f41babe5529c22d59156d P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, 127766fc592545a4997f7790f50f6076; no voters: e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:06:04.933398 23516 raft_consensus.cc:3060] T 21e14947d70440f19044d8f75c31e1f9 P e61c3a8f61bb48f8a963c9480e53c168 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:06:04.951119 20108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "775c229504194560ba9589bc2199b089" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 10 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:06:04.952993 19449 leader_election.cc:304] T 6c5eebf646ad445a9d1b1adc319d7b16 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, 127766fc592545a4997f7790f50f6076; no voters: 
I20260709 13:06:04.953140 20108 raft_consensus.cc:2410] T 775c229504194560ba9589bc2199b089 P 127766fc592545a4997f7790f50f6076 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0473d2b2d01f4459b1e90fd12cc7840e for term 10 because replica has last-logged OpId of term: 8 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 7.
W20260709 13:06:04.953326 19374 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:04.953430 20110 raft_consensus.cc:2393] T 1efebf73c86e432baa55533136b6e12c P 127766fc592545a4997f7790f50f6076 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0473d2b2d01f4459b1e90fd12cc7840e in current term 10: Already voted for candidate 127766fc592545a4997f7790f50f6076 in this term.
I20260709 13:06:04.954766 19406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4af19371ea874c09a0a2147040835cbb" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
I20260709 13:06:04.955322 19406 raft_consensus.cc:3060] T 4af19371ea874c09a0a2147040835cbb P e5256d91808b47c195bc9b4dbd7f2b87 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:06:04.958073 19479 raft_consensus.cc:2468] T 1f85fc4b527a48848e5faa083b604e36 P 0473d2b2d01f4459b1e90fd12cc7840e [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 127766fc592545a4997f7790f50f6076 in term 9.
I20260709 13:06:04.958914 20078 leader_election.cc:304] T 1f85fc4b527a48848e5faa083b604e36 P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, 127766fc592545a4997f7790f50f6076; no voters: 
I20260709 13:06:04.959134 19479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7be9efa6559648dbb5a0f7684c4542d1" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:06:04.961175 19410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f575b143b844aa096b50997dad3516a" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 8 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:06:04.962807 19407 raft_consensus.cc:3055] T df751f992649444090e27965eb1af85d P e5256d91808b47c195bc9b4dbd7f2b87 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:06:04.964314 19479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0afb57ae58a24a01850491d69f0213dd" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:06:04.965477 19479 raft_consensus.cc:1240] T 5ec1c4ce15e04c7e8c283a62179f2a64 P 0473d2b2d01f4459b1e90fd12cc7840e [term 10 FOLLOWER]: Rejecting Update request from peer e5256d91808b47c195bc9b4dbd7f2b87 for earlier term 9. Current term is 10. Ops: [7.7-9.8]
I20260709 13:06:04.966265 19479 raft_consensus.cc:1240] T 1f85fc4b527a48848e5faa083b604e36 P 0473d2b2d01f4459b1e90fd12cc7840e [term 9 FOLLOWER]: Rejecting Update request from peer e5256d91808b47c195bc9b4dbd7f2b87 for earlier term 8. Current term is 9. Ops: []
I20260709 13:06:04.967804 19479 raft_consensus.cc:1275] T ff9b0eddd810459b82d91c60777c10eb P 0473d2b2d01f4459b1e90fd12cc7840e [term 10 FOLLOWER]: Refusing update from remote peer e5256d91808b47c195bc9b4dbd7f2b87: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:06:04.963166 19407 raft_consensus.cc:740] T df751f992649444090e27965eb1af85d P e5256d91808b47c195bc9b4dbd7f2b87 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: e5256d91808b47c195bc9b4dbd7f2b87, State: Running, Role: LEADER
I20260709 13:06:04.968844 19479 raft_consensus.cc:1240] T 217b5fae677b4971b3bbd2f357a1f7ff P 0473d2b2d01f4459b1e90fd12cc7840e [term 8 FOLLOWER]: Rejecting Update request from peer e5256d91808b47c195bc9b4dbd7f2b87 for earlier term 7. Current term is 8. Ops: [7.5-7.5]
I20260709 13:06:04.969699 19408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e36a9d6e29c4a7c860cf267efbd4c74" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:06:04.963027 23556 raft_consensus.cc:2804] T 14efcc79969f41babe5529c22d59156d P 0473d2b2d01f4459b1e90fd12cc7840e [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:06:04.942535 23620 leader_election.cc:290] T 21e14947d70440f19044d8f75c31e1f9 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 10 election: Requested vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:06:04.971257 19410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "775c229504194560ba9589bc2199b089" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 10 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:06:04.973948 19406 raft_consensus.cc:2468] T 4af19371ea874c09a0a2147040835cbb P e5256d91808b47c195bc9b4dbd7f2b87 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 127766fc592545a4997f7790f50f6076 in term 8.
I20260709 13:06:04.933710 23616 leader_election.cc:290] T 179fd671030940b4b4a4e24bcc4aba0a P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 12 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:06:04.942342 23638 raft_consensus.cc:697] T 5ec1c4ce15e04c7e8c283a62179f2a64 P 127766fc592545a4997f7790f50f6076 [term 10 LEADER]: Becoming Leader. State: Replica: 127766fc592545a4997f7790f50f6076, State: Running, Role: LEADER
I20260709 13:06:04.968772 19407 consensus_queue.cc:260] T df751f992649444090e27965eb1af85d P e5256d91808b47c195bc9b4dbd7f2b87 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:04.978178 19407 raft_consensus.cc:3060] T df751f992649444090e27965eb1af85d P e5256d91808b47c195bc9b4dbd7f2b87 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:06:04.934863 23645 raft_consensus.cc:3060] T ff9b0eddd810459b82d91c60777c10eb P 127766fc592545a4997f7790f50f6076 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:06:04.955041 23465 raft_consensus.cc:493] T 775c229504194560ba9589bc2199b089 P e5256d91808b47c195bc9b4dbd7f2b87 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 127766fc592545a4997f7790f50f6076)
I20260709 13:06:04.984668 20075 leader_election.cc:304] T 4af19371ea874c09a0a2147040835cbb P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 127766fc592545a4997f7790f50f6076, e5256d91808b47c195bc9b4dbd7f2b87; no voters: 
I20260709 13:06:04.969173 23559 raft_consensus.cc:2804] T 6c5eebf646ad445a9d1b1adc319d7b16 P 0473d2b2d01f4459b1e90fd12cc7840e [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:06:04.962420 23387 raft_consensus.cc:2804] T 1f85fc4b527a48848e5faa083b604e36 P 127766fc592545a4997f7790f50f6076 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:06:04.983661 19406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "833a2f0775ed407a94b8924ce50adb63" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:06:04.988598 19406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f93ee515a9c14139bf566522ed8232f3" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 15 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
I20260709 13:06:04.989274 19406 raft_consensus.cc:2393] T f93ee515a9c14139bf566522ed8232f3 P e5256d91808b47c195bc9b4dbd7f2b87 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 0473d2b2d01f4459b1e90fd12cc7840e in current term 15: Already voted for candidate e5256d91808b47c195bc9b4dbd7f2b87 in this term.
I20260709 13:06:04.990414 19408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f85fc4b527a48848e5faa083b604e36" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
I20260709 13:06:04.990461 19406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7be9efa6559648dbb5a0f7684c4542d1" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:06:04.991333 19406 raft_consensus.cc:2468] T 7be9efa6559648dbb5a0f7684c4542d1 P e5256d91808b47c195bc9b4dbd7f2b87 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 127766fc592545a4997f7790f50f6076 in term 11.
I20260709 13:06:04.974630 23556 raft_consensus.cc:493] T 14efcc79969f41babe5529c22d59156d P 0473d2b2d01f4459b1e90fd12cc7840e [term 10 FOLLOWER]: Starting leader election (detected failure of leader e5256d91808b47c195bc9b4dbd7f2b87)
I20260709 13:06:04.999223 23556 raft_consensus.cc:3060] T 14efcc79969f41babe5529c22d59156d P 0473d2b2d01f4459b1e90fd12cc7840e [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:06:05.000932 23636 raft_consensus.cc:515] T ed7fdbcb96d14d418db9ca90a792588a P 127766fc592545a4997f7790f50f6076 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:05.003137 19408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46c5bfeecc314717bffe987e6844b6d0" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 17 candidate_status { last_received { term: 15 index: 6 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:06:05.003400 23636 leader_election.cc:290] T ed7fdbcb96d14d418db9ca90a792588a P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 9 election: Requested vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
W20260709 13:06:05.003837 23602 log.cc:927] Time spent T 2b74109013a140ada21feeef92d6f563 P e61c3a8f61bb48f8a963c9480e53c168: Append to log took a long time: real 1.159s	user 0.010s	sys 0.014s
I20260709 13:06:05.004526 19408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "179fd671030940b4b4a4e24bcc4aba0a" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 12 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
I20260709 13:06:05.004992 23638 consensus_queue.cc:237] T 5ec1c4ce15e04c7e8c283a62179f2a64 P 127766fc592545a4997f7790f50f6076 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:05.005589 19481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46c5bfeecc314717bffe987e6844b6d0" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 17 candidate_status { last_received { term: 16 index: 7 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:06:05.006517 23378 raft_consensus.cc:3055] T 4509b76741dc428e9201c70c1658da13 P 0473d2b2d01f4459b1e90fd12cc7840e [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:06:05.006887 19481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dc5b3532fe54f74876d02beffa2c230" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:06:05.007618 19481 raft_consensus.cc:2393] T 1dc5b3532fe54f74876d02beffa2c230 P 0473d2b2d01f4459b1e90fd12cc7840e [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e61c3a8f61bb48f8a963c9480e53c168 in current term 11: Already voted for candidate 0473d2b2d01f4459b1e90fd12cc7840e in this term.
I20260709 13:06:05.005589 19408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36f6ba92b9ba46babe4ebd6c02e5fbd9" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:06:05.009598 20078 leader_election.cc:304] T 6c5eebf646ad445a9d1b1adc319d7b16 P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, 127766fc592545a4997f7790f50f6076; no voters: e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:06:04.982688 23622 raft_consensus.cc:493] T ff75a1d4cb1f493db8f71ddc136ba9ab P 0473d2b2d01f4459b1e90fd12cc7840e [term 10 FOLLOWER]: Starting pre-election (detected failure of leader e61c3a8f61bb48f8a963c9480e53c168)
I20260709 13:06:05.026016 23622 raft_consensus.cc:515] T ff75a1d4cb1f493db8f71ddc136ba9ab P 0473d2b2d01f4459b1e90fd12cc7840e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:05.016069 23387 raft_consensus.cc:697] T 1f85fc4b527a48848e5faa083b604e36 P 127766fc592545a4997f7790f50f6076 [term 9 LEADER]: Becoming Leader. State: Replica: 127766fc592545a4997f7790f50f6076, State: Running, Role: LEADER
W20260709 13:06:05.027981 19403 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52328 (request call id 1921) took 2549 ms (client timeout 2144 ms). Trace:
W20260709 13:06:05.028390 19403 rpcz_store.cc:269] 0709 13:06:02.466130 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:02.502100 (+ 35970us) service_pool.cc:224] Handling call
0709 13:06:05.015718 (+2513618us) spinlock_profiling.cc:243] Waited 1.66 s on lock 0x7b54000e6fd4. stack: 00007f4a79de9343 00007f4a79de9240 00007f4a797781d4 00007f4a834b6304 00007f4a834b6299 00007f4a7ce71571 00007f4a7cf0c2fa 00007f4a81ecdb17 00007f4a7b4486d4 00007f4a7b448662 00007f4a7b448591 00007f4a7b44850c 00007f4a7b4477c2 00007f4a7b24348c 00007f4a7b2428c6 00007f4a7b24226f
0709 13:06:05.015842 (+   124us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3826394368}
I20260709 13:06:05.029453 19403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "217b5fae677b4971b3bbd2f357a1f7ff" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:06:05.030215 19403 raft_consensus.cc:2410] T 217b5fae677b4971b3bbd2f357a1f7ff P e5256d91808b47c195bc9b4dbd7f2b87 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0473d2b2d01f4459b1e90fd12cc7840e for term 9 because replica has last-logged OpId of term: 7 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
I20260709 13:06:05.013731 19407 raft_consensus.cc:1275] T df751f992649444090e27965eb1af85d P e5256d91808b47c195bc9b4dbd7f2b87 [term 13 FOLLOWER]: Refusing update from remote peer 0473d2b2d01f4459b1e90fd12cc7840e: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:06:04.987684 23559 raft_consensus.cc:493] T 6c5eebf646ad445a9d1b1adc319d7b16 P 0473d2b2d01f4459b1e90fd12cc7840e [term 8 FOLLOWER]: Starting leader election (detected failure of leader e61c3a8f61bb48f8a963c9480e53c168)
I20260709 13:06:05.008601 23646 raft_consensus.cc:2804] T 4af19371ea874c09a0a2147040835cbb P 127766fc592545a4997f7790f50f6076 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:06:05.052063 23639 raft_consensus.cc:2804] T 6c5eebf646ad445a9d1b1adc319d7b16 P 127766fc592545a4997f7790f50f6076 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:06:05.006902 23378 raft_consensus.cc:740] T 4509b76741dc428e9201c70c1658da13 P 0473d2b2d01f4459b1e90fd12cc7840e [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 0473d2b2d01f4459b1e90fd12cc7840e, State: Running, Role: LEADER
I20260709 13:06:05.075258 23634 raft_consensus.cc:515] T 14efcc79969f41babe5529c22d59156d P 127766fc592545a4997f7790f50f6076 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:05.067862 23639 raft_consensus.cc:493] T 6c5eebf646ad445a9d1b1adc319d7b16 P 127766fc592545a4997f7790f50f6076 [term 8 FOLLOWER]: Starting leader election (detected failure of leader e61c3a8f61bb48f8a963c9480e53c168)
W20260709 13:06:05.103469 19374 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:05.118055 23556 raft_consensus.cc:515] T 14efcc79969f41babe5529c22d59156d P 0473d2b2d01f4459b1e90fd12cc7840e [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:05.115871 23414 leader_election.cc:290] T 6c5eebf646ad445a9d1b1adc319d7b16 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:06:05.116978 23505 raft_consensus.cc:493] T 22196caba61445d3bec98a0aab3c337d P e61c3a8f61bb48f8a963c9480e53c168 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 0473d2b2d01f4459b1e90fd12cc7840e)
I20260709 13:06:05.117630 23541 raft_consensus.cc:493] T 21e14947d70440f19044d8f75c31e1f9 P 0473d2b2d01f4459b1e90fd12cc7840e [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:04.989776 23465 raft_consensus.cc:515] T 775c229504194560ba9589bc2199b089 P e5256d91808b47c195bc9b4dbd7f2b87 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:05.052991 23316 raft_consensus.cc:493] T 28af091831594f9d8e96482078cc7625 P 0473d2b2d01f4459b1e90fd12cc7840e [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:05.056387 23559 raft_consensus.cc:3060] T 6c5eebf646ad445a9d1b1adc319d7b16 P 0473d2b2d01f4459b1e90fd12cc7840e [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:06:05.133934 23505 raft_consensus.cc:515] T 22196caba61445d3bec98a0aab3c337d P e61c3a8f61bb48f8a963c9480e53c168 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:05.144497 20104 raft_consensus.cc:1240] T 14efcc79969f41babe5529c22d59156d P 127766fc592545a4997f7790f50f6076 [term 11 FOLLOWER]: Rejecting Update request from peer e5256d91808b47c195bc9b4dbd7f2b87 for earlier term 10. Current term is 11. Ops: []
I20260709 13:06:05.156967 23622 leader_election.cc:290] T ff75a1d4cb1f493db8f71ddc136ba9ab P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
W20260709 13:06:05.157476 23647 log.cc:927] Time spent T 3e1f505cb0f1427bbd698ac889d80821 P e61c3a8f61bb48f8a963c9480e53c168: Append to log took a long time: real 0.139s	user 0.000s	sys 0.000s
I20260709 13:06:05.159690 19558 raft_consensus.cc:3055] T 2a16f7501e2444fb86d4e2778e734e02 P e61c3a8f61bb48f8a963c9480e53c168 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:06:05.169081 19404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa731b585f684a7fb2d106c50f143b83" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
I20260709 13:06:05.169320 19558 raft_consensus.cc:740] T 2a16f7501e2444fb86d4e2778e734e02 P e61c3a8f61bb48f8a963c9480e53c168 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: e61c3a8f61bb48f8a963c9480e53c168, State: Running, Role: LEADER
I20260709 13:06:05.161164 19410 raft_consensus.cc:2410] T 775c229504194560ba9589bc2199b089 P e5256d91808b47c195bc9b4dbd7f2b87 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0473d2b2d01f4459b1e90fd12cc7840e for term 10 because replica has last-logged OpId of term: 8 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 7.
I20260709 13:06:05.129415 23639 raft_consensus.cc:3060] T 6c5eebf646ad445a9d1b1adc319d7b16 P 127766fc592545a4997f7790f50f6076 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:06:05.027590 23387 consensus_queue.cc:237] T 1f85fc4b527a48848e5faa083b604e36 P 127766fc592545a4997f7790f50f6076 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:05.163015 19481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc225c93219c45538b53a1bd3d387e4d" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:06:05.163280 19480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa8650e71aa14778b3d73721fc50d9fc" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:06:05.171427 19481 raft_consensus.cc:2468] T bc225c93219c45538b53a1bd3d387e4d P 0473d2b2d01f4459b1e90fd12cc7840e [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 10.
I20260709 13:06:05.172231 19481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed7fdbcb96d14d418db9ca90a792588a" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:06:05.172513 19480 raft_consensus.cc:1240] T 1dc5b3532fe54f74876d02beffa2c230 P 0473d2b2d01f4459b1e90fd12cc7840e [term 11 FOLLOWER]: Rejecting Update request from peer e5256d91808b47c195bc9b4dbd7f2b87 for earlier term 10. Current term is 11. Ops: [10.5-10.5]
I20260709 13:06:05.172709 19481 raft_consensus.cc:3060] T ed7fdbcb96d14d418db9ca90a792588a P 0473d2b2d01f4459b1e90fd12cc7840e [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:06:05.173650 19480 raft_consensus.cc:1240] T 0cdf56e38bbc453d9438d359e5a69955 P 0473d2b2d01f4459b1e90fd12cc7840e [term 12 FOLLOWER]: Rejecting Update request from peer e5256d91808b47c195bc9b4dbd7f2b87 for earlier term 11. Current term is 12. Ops: []
I20260709 13:06:05.118875 23646 raft_consensus.cc:697] T 4af19371ea874c09a0a2147040835cbb P 127766fc592545a4997f7790f50f6076 [term 8 LEADER]: Becoming Leader. State: Replica: 127766fc592545a4997f7790f50f6076, State: Running, Role: LEADER
I20260709 13:06:05.181257 19481 raft_consensus.cc:2468] T ed7fdbcb96d14d418db9ca90a792588a P 0473d2b2d01f4459b1e90fd12cc7840e [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 127766fc592545a4997f7790f50f6076 in term 9.
I20260709 13:06:05.143143 23613 raft_consensus.cc:493] T 85c494af21f9457a85da47b9bc70c1fd P e61c3a8f61bb48f8a963c9480e53c168 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 127766fc592545a4997f7790f50f6076)
I20260709 13:06:05.182180 23613 raft_consensus.cc:515] T 85c494af21f9457a85da47b9bc70c1fd P e61c3a8f61bb48f8a963c9480e53c168 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:05.184438 23613 leader_election.cc:290] T 85c494af21f9457a85da47b9bc70c1fd P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:06:05.167387 19408 raft_consensus.cc:1275] T 14935b3ddf914369822e4a0547aaa355 P e5256d91808b47c195bc9b4dbd7f2b87 [term 10 FOLLOWER]: Refusing update from remote peer 127766fc592545a4997f7790f50f6076: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 13:06:05.186329 23268 consensus_queue.cc:1048] T 14935b3ddf914369822e4a0547aaa355 P 127766fc592545a4997f7790f50f6076 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:06:05.187426 23646 consensus_queue.cc:237] T 4af19371ea874c09a0a2147040835cbb P 127766fc592545a4997f7790f50f6076 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:05.188143 23505 leader_election.cc:290] T 22196caba61445d3bec98a0aab3c337d P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:06:05.188448 19481 raft_consensus.cc:1240] T 14efcc79969f41babe5529c22d59156d P 0473d2b2d01f4459b1e90fd12cc7840e [term 11 FOLLOWER]: Rejecting Update request from peer e5256d91808b47c195bc9b4dbd7f2b87 for earlier term 10. Current term is 11. Ops: []
I20260709 13:06:05.189679 19481 raft_consensus.cc:1240] T 3e1f505cb0f1427bbd698ac889d80821 P 0473d2b2d01f4459b1e90fd12cc7840e [term 11 FOLLOWER]: Rejecting Update request from peer e5256d91808b47c195bc9b4dbd7f2b87 for earlier term 10. Current term is 11. Ops: []
W20260709 13:06:05.167836 19376 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:05.191351 19376 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:05.134919 23541 raft_consensus.cc:3060] T 21e14947d70440f19044d8f75c31e1f9 P 0473d2b2d01f4459b1e90fd12cc7840e [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:06:05.161427 23465 leader_election.cc:290] T 775c229504194560ba9589bc2199b089 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:06:05.161435 20112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "775c229504194560ba9589bc2199b089" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:06:05.194130 20112 raft_consensus.cc:2468] T 775c229504194560ba9589bc2199b089 P 127766fc592545a4997f7790f50f6076 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 9.
I20260709 13:06:05.196031 19553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "179fd671030940b4b4a4e24bcc4aba0a" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 12 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:06:05.196941 19559 raft_consensus.cc:1275] T df751f992649444090e27965eb1af85d P e61c3a8f61bb48f8a963c9480e53c168 [term 13 FOLLOWER]: Refusing update from remote peer 0473d2b2d01f4459b1e90fd12cc7840e: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:06:05.197346 19556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62c6c134d3d24a1ab144dd9ee6bc3f64" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:06:05.197835 19408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff75a1d4cb1f493db8f71ddc136ba9ab" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:06:05.178392 19404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14efcc79969f41babe5529c22d59156d" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
I20260709 13:06:05.178972 23636 raft_consensus.cc:493] T 48824d5acfbc485ebf8c2d944e7202de P 127766fc592545a4997f7790f50f6076 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader e61c3a8f61bb48f8a963c9480e53c168)
I20260709 13:06:05.179126 20078 leader_election.cc:304] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, 127766fc592545a4997f7790f50f6076; no voters: e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:06:05.170171 19558 consensus_queue.cc:260] T 2a16f7501e2444fb86d4e2778e734e02 P e61c3a8f61bb48f8a963c9480e53c168 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:05.180737 19480 raft_consensus.cc:1240] T 76cb037fc9064d13b59a8969d897ce8c P 0473d2b2d01f4459b1e90fd12cc7840e [term 10 FOLLOWER]: Rejecting Update request from peer e5256d91808b47c195bc9b4dbd7f2b87 for earlier term 9. Current term is 10. Ops: [9.5-9.5]
I20260709 13:06:05.210907 19480 raft_consensus.cc:1275] T 14935b3ddf914369822e4a0547aaa355 P 0473d2b2d01f4459b1e90fd12cc7840e [term 10 FOLLOWER]: Refusing update from remote peer 127766fc592545a4997f7790f50f6076: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 13:06:05.165748 19449 leader_election.cc:304] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e; no voters: 127766fc592545a4997f7790f50f6076, e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:06:05.174204 23515 raft_consensus.cc:2749] T 0e1085d23e8347fbbd5bce7542f4b1f4 P 0473d2b2d01f4459b1e90fd12cc7840e [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:06:05.167124 19409 raft_consensus.cc:1240] T 172b3dd13109415a955b71ac0e9d2234 P e5256d91808b47c195bc9b4dbd7f2b87 [term 10 FOLLOWER]: Rejecting Update request from peer 127766fc592545a4997f7790f50f6076 for earlier term 9. Current term is 10. Ops: []
I20260709 13:06:05.205084 19551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc225c93219c45538b53a1bd3d387e4d" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
W20260709 13:06:05.218288 19449 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.1:40321, user_credentials={real_user=slave}} blocked reactor thread for 52606.5us
I20260709 13:06:05.219756 19480 raft_consensus.cc:1275] T 7f575b143b844aa096b50997dad3516a P 0473d2b2d01f4459b1e90fd12cc7840e [term 7 FOLLOWER]: Refusing update from remote peer e61c3a8f61bb48f8a963c9480e53c168: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 13:06:05.215267 20078 leader_election.cc:304] T ed7fdbcb96d14d418db9ca90a792588a P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, 127766fc592545a4997f7790f50f6076; no voters: 
I20260709 13:06:05.130833 23516 raft_consensus.cc:515] T 21e14947d70440f19044d8f75c31e1f9 P e61c3a8f61bb48f8a963c9480e53c168 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:05.217593 19551 raft_consensus.cc:2468] T bc225c93219c45538b53a1bd3d387e4d P e61c3a8f61bb48f8a963c9480e53c168 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 10.
I20260709 13:06:05.192773 23585 raft_consensus.cc:3060] T b9f0d59553ad444883fcf5b5909f9798 P e5256d91808b47c195bc9b4dbd7f2b87 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:06:05.224974 19481 raft_consensus.cc:1240] T ed7fdbcb96d14d418db9ca90a792588a P 0473d2b2d01f4459b1e90fd12cc7840e [term 9 FOLLOWER]: Rejecting Update request from peer e61c3a8f61bb48f8a963c9480e53c168 for earlier term 8. Current term is 9. Ops: []
I20260709 13:06:05.224222 19552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f93ee515a9c14139bf566522ed8232f3" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 15 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:06:05.234560 19551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "309c3ca0ca4b4f3ba129752ea2cb293b" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
W20260709 13:06:05.238909 19296 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 309c3ca0ca4b4f3ba129752ea2cb293b with cas_config_opid_index 5: ChangeConfig:REMOVE_PEER failed with leader 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica 0473d2b2d01f4459b1e90fd12cc7840e is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 9 committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } attrs { replace: true } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } } }
I20260709 13:06:05.175046 23624 leader_election.cc:290] T fa731b585f684a7fb2d106c50f143b83 P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 10 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:06:05.221240 23399 raft_consensus.cc:2804] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P 127766fc592545a4997f7790f50f6076 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:06:05.230507 23534 consensus_queue.cc:1059] T 172b3dd13109415a955b71ac0e9d2234 P 127766fc592545a4997f7790f50f6076 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 }, Status: INVALID_TERM, Last received: 9.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.020s
I20260709 13:06:05.247459 23220 consensus_queue.cc:1048] T df751f992649444090e27965eb1af85d P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.018s
I20260709 13:06:05.249326 19481 raft_consensus.cc:1275] T 0cdf56e38bbc453d9438d359e5a69955 P 0473d2b2d01f4459b1e90fd12cc7840e [term 12 FOLLOWER]: Refusing update from remote peer e61c3a8f61bb48f8a963c9480e53c168: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:06:05.250944 23399 raft_consensus.cc:493] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P 127766fc592545a4997f7790f50f6076 [term 11 FOLLOWER]: Starting leader election (detected failure of leader e5256d91808b47c195bc9b4dbd7f2b87)
I20260709 13:06:05.251171 23220 consensus_queue.cc:1243] T df751f992649444090e27965eb1af85d P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Peer e5256d91808b47c195bc9b4dbd7f2b87 log is divergent from this leader: its last log entry 12.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 13:06:05.251421 23399 raft_consensus.cc:3060] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P 127766fc592545a4997f7790f50f6076 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:06:05.165000 23316 raft_consensus.cc:515] T 28af091831594f9d8e96482078cc7625 P 0473d2b2d01f4459b1e90fd12cc7840e [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:05.253710 23316 leader_election.cc:290] T 28af091831594f9d8e96482078cc7625 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:06:05.251019 23624 raft_consensus.cc:2804] T ed7fdbcb96d14d418db9ca90a792588a P 127766fc592545a4997f7790f50f6076 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:06:05.254982 19556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f575b143b844aa096b50997dad3516a" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 8 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:06:05.255353 23639 raft_consensus.cc:515] T 6c5eebf646ad445a9d1b1adc319d7b16 P 127766fc592545a4997f7790f50f6076 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:05.256515 19556 raft_consensus.cc:1275] T b9f0d59553ad444883fcf5b5909f9798 P e61c3a8f61bb48f8a963c9480e53c168 [term 11 FOLLOWER]: Refusing update from remote peer 0473d2b2d01f4459b1e90fd12cc7840e: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:06:05.257459 23639 leader_election.cc:290] T 6c5eebf646ad445a9d1b1adc319d7b16 P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 9 election: Requested vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:06:05.258190 19553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e5873a19244c5ebbcd38e126796ee7" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:06:05.259269 23634 leader_election.cc:290] T 14efcc79969f41babe5529c22d59156d P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 11 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:06:05.163337 23378 consensus_queue.cc:260] T 4509b76741dc428e9201c70c1658da13 P 0473d2b2d01f4459b1e90fd12cc7840e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:05.260382 23378 raft_consensus.cc:3060] T 4509b76741dc428e9201c70c1658da13 P 0473d2b2d01f4459b1e90fd12cc7840e [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:06:05.262840 23616 consensus_queue.cc:1175] T 4509b76741dc428e9201c70c1658da13 P 0473d2b2d01f4459b1e90fd12cc7840e [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" responder_term: 4 status { last_received { term: 4 index: 3 } last_committed_idx: 3 last_received_current_leader { term: 4 index: 3 } }
I20260709 13:06:05.263338 19551 raft_consensus.cc:1275] T 7be9efa6559648dbb5a0f7684c4542d1 P e61c3a8f61bb48f8a963c9480e53c168 [term 11 FOLLOWER]: Refusing update from remote peer 0473d2b2d01f4459b1e90fd12cc7840e: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 13:06:05.264436 19559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e36a9d6e29c4a7c860cf267efbd4c74" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:06:05.265193 19485 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58286 (request call id 1982) took 1568 ms. Trace:
I20260709 13:06:05.265261 23516 leader_election.cc:290] T 21e14947d70440f19044d8f75c31e1f9 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 11 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:06:05.265548 19557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46c5bfeecc314717bffe987e6844b6d0" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 17 candidate_status { last_received { term: 15 index: 6 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:06:05.219002 23505 raft_consensus.cc:493] T 48824d5acfbc485ebf8c2d944e7202de P e61c3a8f61bb48f8a963c9480e53c168 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:05.266479 19557 raft_consensus.cc:2410] T 46c5bfeecc314717bffe987e6844b6d0 P e61c3a8f61bb48f8a963c9480e53c168 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0473d2b2d01f4459b1e90fd12cc7840e for term 17 because replica has last-logged OpId of term: 16 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 6.
I20260709 13:06:05.266554 23505 raft_consensus.cc:515] T 48824d5acfbc485ebf8c2d944e7202de P e61c3a8f61bb48f8a963c9480e53c168 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:05.267524 19555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1b10566f45d4a7d9029858330e02d5b" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:06:05.248507 19552 raft_consensus.cc:2468] T f93ee515a9c14139bf566522ed8232f3 P e61c3a8f61bb48f8a963c9480e53c168 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 14.
I20260709 13:06:05.268730 23505 leader_election.cc:290] T 48824d5acfbc485ebf8c2d944e7202de P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:06:05.266299 19554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c5eebf646ad445a9d1b1adc319d7b16" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:06:05.273540 19377 leader_election.cc:304] T 1a61655d99124a29b486ba4a5b37faea P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:06:05.277374 19409 pending_rounds.cc:85] T df751f992649444090e27965eb1af85d P e5256d91808b47c195bc9b4dbd7f2b87: Aborting all ops after (but not including) 6
I20260709 13:06:05.277735 19409 pending_rounds.cc:107] T df751f992649444090e27965eb1af85d P e5256d91808b47c195bc9b4dbd7f2b87: Aborting uncommitted NO_OP operation due to leader change: 12.7
I20260709 13:06:05.277984 19409 raft_consensus.cc:2889] T df751f992649444090e27965eb1af85d P e5256d91808b47c195bc9b4dbd7f2b87 [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:06:05.279002 19404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28af091831594f9d8e96482078cc7625" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:06:05.279618 19404 raft_consensus.cc:2468] T 28af091831594f9d8e96482078cc7625 P e5256d91808b47c195bc9b4dbd7f2b87 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 11.
I20260709 13:06:05.280557 19552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f93ee515a9c14139bf566522ed8232f3" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 15 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:06:05.281142 19552 raft_consensus.cc:3060] T f93ee515a9c14139bf566522ed8232f3 P e61c3a8f61bb48f8a963c9480e53c168 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:06:05.281291 23556 leader_election.cc:290] T 14efcc79969f41babe5529c22d59156d P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 11 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:06:05.283100 19555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "179fd671030940b4b4a4e24bcc4aba0a" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 12 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:06:05.283291 23594 leader_election.cc:290] T 22196caba61445d3bec98a0aab3c337d P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:06:05.284056 19481 raft_consensus.cc:1240] T 179fd671030940b4b4a4e24bcc4aba0a P 0473d2b2d01f4459b1e90fd12cc7840e [term 12 FOLLOWER]: Rejecting Update request from peer e61c3a8f61bb48f8a963c9480e53c168 for earlier term 11. Current term is 12. Ops: [9.6-11.7]
I20260709 13:06:05.284338 19559 raft_consensus.cc:1240] T 4509b76741dc428e9201c70c1658da13 P e61c3a8f61bb48f8a963c9480e53c168 [term 5 FOLLOWER]: Rejecting Update request from peer 0473d2b2d01f4459b1e90fd12cc7840e for earlier term 4. Current term is 5. Ops: []
I20260709 13:06:05.285454 19554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1efebf73c86e432baa55533136b6e12c" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:06:05.286077 19554 raft_consensus.cc:2468] T 1efebf73c86e432baa55533136b6e12c P e61c3a8f61bb48f8a963c9480e53c168 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 10.
I20260709 13:06:05.287089 19553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28af091831594f9d8e96482078cc7625" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:06:05.287567 23634 raft_consensus.cc:493] T 0e1085d23e8347fbbd5bce7542f4b1f4 P 127766fc592545a4997f7790f50f6076 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader e61c3a8f61bb48f8a963c9480e53c168)
I20260709 13:06:05.288060 23634 raft_consensus.cc:515] T 0e1085d23e8347fbbd5bce7542f4b1f4 P 127766fc592545a4997f7790f50f6076 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:05.288549 23645 raft_consensus.cc:515] T ff9b0eddd810459b82d91c60777c10eb P 127766fc592545a4997f7790f50f6076 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:05.289040 19557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "217b5fae677b4971b3bbd2f357a1f7ff" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:06:05.290145 23634 leader_election.cc:290] T 0e1085d23e8347fbbd5bce7542f4b1f4 P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:06:05.216393 23636 raft_consensus.cc:515] T 48824d5acfbc485ebf8c2d944e7202de P 127766fc592545a4997f7790f50f6076 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:05.265595 19485 rpcz_store.cc:276] 0709 13:06:03.696965 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:03.697080 (+   115us) service_pool.cc:224] Handling call
0709 13:06:03.697377 (+   297us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:03.697778 (+   401us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:03.697817 (+    39us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:03.807857 (+110040us) log.cc:844] Serialized 26 byte log entry
0709 13:06:05.024304 (+1216447us) spinlock_profiling.cc:243] Waited 4.17 ms on lock 0x7b1800350020. stack: 00007f4a79de9343 00007f4a79de9240 00007f4a797781d4 00007f4a834b6304 00007f4a834b6299 00007f4a82ce3de1 00007f4a82cf05b1 00007f4a79dfde07 00007f4a82c58ab9 00007f4a79e1a69b 00007f4a79e1893f 00007f4a79e1ac02 00007f4a7caa220b 00007f4a7caa7d23 00007f4a7caa80d1 00007f4a7cec3a0f
0709 13:06:05.170503 (+146199us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:06:05.170548 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:05.170979 (+   431us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:05.264918 (+ 93939us) raft_consensus.cc:1685] finished
0709 13:06:05.264935 (+    17us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:05.265142 (+   207us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":6254,"raft.queue_time_us":50408,"raft.run_cpu_time_us":88,"raft.run_wall_time_us":9398,"spinlock_wait_cycles":9601792,"thread_start_us":146038,"threads_started":1,"wal-append.queue_time_us":1383656}
I20260709 13:06:05.255049 23624 raft_consensus.cc:697] T ed7fdbcb96d14d418db9ca90a792588a P 127766fc592545a4997f7790f50f6076 [term 9 LEADER]: Becoming Leader. State: Replica: 127766fc592545a4997f7790f50f6076, State: Running, Role: LEADER
I20260709 13:06:05.292757 23636 leader_election.cc:290] T 48824d5acfbc485ebf8c2d944e7202de P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:06:05.290278 20109 raft_consensus.cc:1240] T ff9b0eddd810459b82d91c60777c10eb P 127766fc592545a4997f7790f50f6076 [term 11 FOLLOWER]: Rejecting Update request from peer e5256d91808b47c195bc9b4dbd7f2b87 for earlier term 10. Current term is 11. Ops: []
I20260709 13:06:05.288290 19551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff75a1d4cb1f493db8f71ddc136ba9ab" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:06:05.294605 19449 leader_election.cc:304] T 28af091831594f9d8e96482078cc7625 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87; no voters: 
I20260709 13:06:05.294790 19377 leader_election.cc:304] T 86a6797bdfe94fa496c050ceae4bd0d9 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:06:05.295535 19449 leader_election.cc:304] T 775c229504194560ba9589bc2199b089 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e; no voters: 127766fc592545a4997f7790f50f6076, e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:06:05.296844 19411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14efcc79969f41babe5529c22d59156d" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
I20260709 13:06:05.301875 19374 leader_election.cc:304] T 85c494af21f9457a85da47b9bc70c1fd P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87; no voters: 127766fc592545a4997f7790f50f6076, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:06:05.312902 23443 consensus_queue.cc:1059] T 5ec1c4ce15e04c7e8c283a62179f2a64 P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false }, Status: INVALID_TERM, Last received: 9.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.002s
I20260709 13:06:05.314733 19450 leader_election.cc:304] T 62c6c134d3d24a1ab144dd9ee6bc3f64 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e; no voters: 127766fc592545a4997f7790f50f6076, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:06:05.297101 23316 raft_consensus.cc:2804] T 28af091831594f9d8e96482078cc7625 P 0473d2b2d01f4459b1e90fd12cc7840e [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:06:05.296008 23549 raft_consensus.cc:2749] T 1a61655d99124a29b486ba4a5b37faea P e5256d91808b47c195bc9b4dbd7f2b87 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:06:05.295985 23645 leader_election.cc:290] T ff9b0eddd810459b82d91c60777c10eb P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 11 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:06:05.304890 23324 raft_consensus.cc:3055] T 172b3dd13109415a955b71ac0e9d2234 P 127766fc592545a4997f7790f50f6076 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:06:05.316470 19552 raft_consensus.cc:2468] T f93ee515a9c14139bf566522ed8232f3 P e61c3a8f61bb48f8a963c9480e53c168 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 15.
W20260709 13:06:05.316247 20078 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.2:46257, user_credentials={real_user=slave}} blocked reactor thread for 101060us
I20260709 13:06:05.329658 19377 leader_election.cc:400] T f1b10566f45d4a7d9029858330e02d5b P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 11 pre-election: Vote denied by peer 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257) with higher term. Message: Invalid argument: T f1b10566f45d4a7d9029858330e02d5b P 0473d2b2d01f4459b1e90fd12cc7840e [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e5256d91808b47c195bc9b4dbd7f2b87 for earlier term 11. Current term is 12.
I20260709 13:06:05.330123 19377 leader_election.cc:403] T f1b10566f45d4a7d9029858330e02d5b P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 11 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:06:05.321960 23636 raft_consensus.cc:493] T 70797e5783b5454ab0d0eea663e791e3 P 127766fc592545a4997f7790f50f6076 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader e61c3a8f61bb48f8a963c9480e53c168)
I20260709 13:06:05.315696 23220 raft_consensus.cc:2749] T 775c229504194560ba9589bc2199b089 P 0473d2b2d01f4459b1e90fd12cc7840e [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:06:05.312749 23605 raft_consensus.cc:2749] T 85c494af21f9457a85da47b9bc70c1fd P e5256d91808b47c195bc9b4dbd7f2b87 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:06:05.334625 23645 consensus_queue.cc:1048] T 14935b3ddf914369822e4a0547aaa355 P 127766fc592545a4997f7790f50f6076 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:06:05.334811 23594 raft_consensus.cc:2749] T 86a6797bdfe94fa496c050ceae4bd0d9 P e5256d91808b47c195bc9b4dbd7f2b87 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:06:05.322238 23316 raft_consensus.cc:493] T 28af091831594f9d8e96482078cc7625 P 0473d2b2d01f4459b1e90fd12cc7840e [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:05.338819 23619 raft_consensus.cc:3055] T 5ec1c4ce15e04c7e8c283a62179f2a64 P e5256d91808b47c195bc9b4dbd7f2b87 [term 9 LEADER]: Stepping down as leader of term 9
W20260709 13:06:05.339793 23558 log.cc:927] Time spent T 96efeaaf1057492490e9a621f37e1a2d P 0473d2b2d01f4459b1e90fd12cc7840e: Append to log took a long time: real 2.126s	user 0.010s	sys 0.014s
I20260709 13:06:05.343156 23556 raft_consensus.cc:493] T ef32ce6fdd0e40d382c79974f30295c6 P 0473d2b2d01f4459b1e90fd12cc7840e [term 12 FOLLOWER]: Starting pre-election (detected failure of leader e61c3a8f61bb48f8a963c9480e53c168)
I20260709 13:06:05.331751 23324 raft_consensus.cc:740] T 172b3dd13109415a955b71ac0e9d2234 P 127766fc592545a4997f7790f50f6076 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 127766fc592545a4997f7790f50f6076, State: Running, Role: LEADER
I20260709 13:06:05.322523 23523 consensus_queue.cc:1048] T df751f992649444090e27965eb1af85d P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.022s
I20260709 13:06:05.350004 23316 raft_consensus.cc:3060] T 28af091831594f9d8e96482078cc7625 P 0473d2b2d01f4459b1e90fd12cc7840e [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:06:05.346016 23646 raft_consensus.cc:493] T 96efeaaf1057492490e9a621f37e1a2d P 127766fc592545a4997f7790f50f6076 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:05.324535 23433 raft_consensus.cc:2749] T 62c6c134d3d24a1ab144dd9ee6bc3f64 P 0473d2b2d01f4459b1e90fd12cc7840e [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:06:05.352080 23646 raft_consensus.cc:515] T 96efeaaf1057492490e9a621f37e1a2d P 127766fc592545a4997f7790f50f6076 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:05.353335 23324 consensus_queue.cc:260] T 172b3dd13109415a955b71ac0e9d2234 P 127766fc592545a4997f7790f50f6076 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:05.354192 23646 leader_election.cc:290] T 96efeaaf1057492490e9a621f37e1a2d P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:06:05.354943 23324 raft_consensus.cc:3060] T 172b3dd13109415a955b71ac0e9d2234 P 127766fc592545a4997f7790f50f6076 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:06:05.346354 23636 raft_consensus.cc:515] T 70797e5783b5454ab0d0eea663e791e3 P 127766fc592545a4997f7790f50f6076 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:05.359012 23636 leader_election.cc:290] T 70797e5783b5454ab0d0eea663e791e3 P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:06:05.360008 19482 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58286 (request call id 1962) took 2981 ms. Trace:
I20260709 13:06:05.350524 23619 raft_consensus.cc:740] T 5ec1c4ce15e04c7e8c283a62179f2a64 P e5256d91808b47c195bc9b4dbd7f2b87 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: e5256d91808b47c195bc9b4dbd7f2b87, State: Running, Role: LEADER
I20260709 13:06:05.360457 19482 rpcz_store.cc:276] 0709 13:06:02.378628 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:02.511982 (+133354us) service_pool.cc:224] Handling call
0709 13:06:02.512345 (+   363us) raft_consensus.cc:1471] Updating replica for 3 ops
0709 13:06:02.538827 (+ 26482us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:02.538861 (+    34us) raft_consensus.cc:1539] Triggering prepare for 3 ops
0709 13:06:02.546169 (+  7308us) log.cc:844] Serialized 78 byte log entry
0709 13:06:02.739677 (+193508us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:06:02.779670 (+ 39993us) log.cc:844] Serialized 14 byte log entry
0709 13:06:02.782634 (+  2964us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:02.782726 (+    92us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:05.302506 (+2519780us) spinlock_profiling.cc:243] Waited 12.7 ms on lock 0x7b4400022b4c. stack: 00007f4a79de9343 00007f4a79de9240 00007f4a797781d4 00007f4a834b6304 00007f4a834b6299 00007f4a79ca3db1 00007f4a79d41c85 00007f4a79d426a2 00007f4a7cab41db 00007f4a7caafaaf 00007f4a7caa386e 00007f4a7caa2bb6 00007f4a7caa27d8 00007f4a7caac221 00007f4a7caac1d9 00007f4a7caac169
0709 13:06:05.359642 (+ 57136us) raft_consensus.cc:1685] finished
0709 13:06:05.359763 (+   121us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:05.359941 (+   178us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":27248,"prepare.queue_time_us":101923,"prepare.run_cpu_time_us":33,"prepare.run_wall_time_us":34,"raft.queue_time_us":62256,"raft.run_cpu_time_us":233,"raft.run_wall_time_us":52880,"spinlock_wait_cycles":29230336,"thread_start_us":193053,"threads_started":1,"wal-append.queue_time_us":644760}
I20260709 13:06:05.363016 23619 consensus_queue.cc:260] T 5ec1c4ce15e04c7e8c283a62179f2a64 P e5256d91808b47c195bc9b4dbd7f2b87 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:05.364457 23619 raft_consensus.cc:3060] T 5ec1c4ce15e04c7e8c283a62179f2a64 P e5256d91808b47c195bc9b4dbd7f2b87 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:06:05.366139 20105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14efcc79969f41babe5529c22d59156d" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076"
I20260709 13:06:05.367503 19403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ece3db938bc649d4a40a51522ed5259c" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
I20260709 13:06:05.369235 19404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86a6797bdfe94fa496c050ceae4bd0d9" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:06:05.370092 19404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85c494af21f9457a85da47b9bc70c1fd" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:06:05.370388 19411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4af19371ea874c09a0a2147040835cbb" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
I20260709 13:06:05.370874 19404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22196caba61445d3bec98a0aab3c337d" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:06:05.371628 19408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2725d2c4cb054f18b0fc8f735c15f6c2" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 13 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
I20260709 13:06:05.375028 20106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4af19371ea874c09a0a2147040835cbb" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076"
I20260709 13:06:05.375728 20110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1efebf73c86e432baa55533136b6e12c" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:06:05.377219 20108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85c494af21f9457a85da47b9bc70c1fd" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:06:05.293464 23624 consensus_queue.cc:237] T ed7fdbcb96d14d418db9ca90a792588a P 127766fc592545a4997f7790f50f6076 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:05.313088 23609 consensus_queue.cc:1048] T 2a16f7501e2444fb86d4e2778e734e02 P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Connected to new peer: Peer: permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.021s
I20260709 13:06:05.401420 20112 raft_consensus.cc:1240] T 1f85fc4b527a48848e5faa083b604e36 P 127766fc592545a4997f7790f50f6076 [term 9 LEADER]: Rejecting Update request from peer e5256d91808b47c195bc9b4dbd7f2b87 for earlier term 8. Current term is 9. Ops: []
I20260709 13:06:05.349411 23549 raft_consensus.cc:2749] T f1b10566f45d4a7d9029858330e02d5b P e5256d91808b47c195bc9b4dbd7f2b87 [term 12 FOLLOWER]: Leader pre-election lost for term 11. Reason: Vote denied by peer 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257) with higher term. Message: Invalid argument: T f1b10566f45d4a7d9029858330e02d5b P 0473d2b2d01f4459b1e90fd12cc7840e [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e5256d91808b47c195bc9b4dbd7f2b87 for earlier term 11. Current term is 12.
I20260709 13:06:05.385396 19411 raft_consensus.cc:2393] T 4af19371ea874c09a0a2147040835cbb P e5256d91808b47c195bc9b4dbd7f2b87 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate e61c3a8f61bb48f8a963c9480e53c168 in current term 8: Already voted for candidate 127766fc592545a4997f7790f50f6076 in this term.
I20260709 13:06:05.376531 20110 raft_consensus.cc:2468] T 1efebf73c86e432baa55533136b6e12c P 127766fc592545a4997f7790f50f6076 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 10.
W20260709 13:06:05.387132 19486 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58286 (request call id 1989) took 1673 ms (client timeout 1662 ms). Trace:
W20260709 13:06:05.405543 19486 rpcz_store.cc:269] 0709 13:06:03.713709 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:03.810260 (+ 96551us) service_pool.cc:224] Handling call
0709 13:06:05.386904 (+1576644us) spinlock_profiling.cc:243] Waited 191 ms on lock 0x7b540029d454. stack: 00007f4a79de9343 00007f4a79de9240 00007f4a797781d4 00007f4a834b6304 00007f4a834b6299 00007f4a7ce71571 00007f4a7cf0c2fa 00007f4a81ecdb17 00007f4a7b4486d4 00007f4a7b448662 00007f4a7b448591 00007f4a7b44850c 00007f4a7b4477c2 00007f4a7b24348c 00007f4a7b2428c6 00007f4a7b24226f
0709 13:06:05.387051 (+   147us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":439418112}
I20260709 13:06:05.410725 19411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21e14947d70440f19044d8f75c31e1f9" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
I20260709 13:06:05.411481 19411 raft_consensus.cc:3060] T 21e14947d70440f19044d8f75c31e1f9 P e5256d91808b47c195bc9b4dbd7f2b87 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:06:05.411616 19377 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.2:46257, user_credentials={real_user=slave}} blocked reactor thread for 82163.1us
I20260709 13:06:05.414605 19526 leader_election.cc:304] T 46c5bfeecc314717bffe987e6844b6d0 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e61c3a8f61bb48f8a963c9480e53c168; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:06:05.417256 19377 leader_election.cc:304] T edd7d470b5014c9489be7f41f64355c9 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:06:05.394917 20105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48824d5acfbc485ebf8c2d944e7202de" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:06:05.419034 20105 raft_consensus.cc:2468] T 48824d5acfbc485ebf8c2d944e7202de P 127766fc592545a4997f7790f50f6076 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 10.
I20260709 13:06:05.302969 23541 raft_consensus.cc:515] T 21e14947d70440f19044d8f75c31e1f9 P 0473d2b2d01f4459b1e90fd12cc7840e [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:05.417359 19526 leader_election.cc:304] T 1dc5b3532fe54f74876d02beffa2c230 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e61c3a8f61bb48f8a963c9480e53c168; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:06:05.421775 19408 raft_consensus.cc:1275] T 28af091831594f9d8e96482078cc7625 P e5256d91808b47c195bc9b4dbd7f2b87 [term 11 FOLLOWER]: Refusing update from remote peer e61c3a8f61bb48f8a963c9480e53c168: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
W20260709 13:06:05.393663 19523 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:05.383330 23511 raft_consensus.cc:493] T 62c6c134d3d24a1ab144dd9ee6bc3f64 P 127766fc592545a4997f7790f50f6076 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader e61c3a8f61bb48f8a963c9480e53c168)
I20260709 13:06:05.416337 23516 consensus_queue.cc:1048] T 28af091831594f9d8e96482078cc7625 P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.010s
I20260709 13:06:05.426155 23511 raft_consensus.cc:515] T 62c6c134d3d24a1ab144dd9ee6bc3f64 P 127766fc592545a4997f7790f50f6076 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:05.428372 23511 leader_election.cc:290] T 62c6c134d3d24a1ab144dd9ee6bc3f64 P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:06:05.429211 23434 raft_consensus.cc:493] T ece3db938bc649d4a40a51522ed5259c P 127766fc592545a4997f7790f50f6076 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader e5256d91808b47c195bc9b4dbd7f2b87)
I20260709 13:06:05.422703 23214 raft_consensus.cc:2749] T 46c5bfeecc314717bffe987e6844b6d0 P e61c3a8f61bb48f8a963c9480e53c168 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:06:05.429729 23434 raft_consensus.cc:515] T ece3db938bc649d4a40a51522ed5259c P 127766fc592545a4997f7790f50f6076 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:05.431037 19526 leader_election.cc:304] T bc225c93219c45538b53a1bd3d387e4d P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168; no voters: e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:06:05.431792 23434 leader_election.cc:290] T ece3db938bc649d4a40a51522ed5259c P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:06:05.432145 19526 leader_election.cc:304] T fa8650e71aa14778b3d73721fc50d9fc P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e61c3a8f61bb48f8a963c9480e53c168; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:06:05.433867 23214 raft_consensus.cc:3060] T 1dc5b3532fe54f74876d02beffa2c230 P e61c3a8f61bb48f8a963c9480e53c168 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:06:05.434919 23492 leader_election.cc:290] T 0afb57ae58a24a01850491d69f0213dd P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:06:05.436232 23529 raft_consensus.cc:2804] T bc225c93219c45538b53a1bd3d387e4d P e61c3a8f61bb48f8a963c9480e53c168 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:06:05.436635 23529 raft_consensus.cc:493] T bc225c93219c45538b53a1bd3d387e4d P e61c3a8f61bb48f8a963c9480e53c168 [term 10 FOLLOWER]: Starting leader election (detected failure of leader e5256d91808b47c195bc9b4dbd7f2b87)
I20260709 13:06:05.436980 23529 raft_consensus.cc:3060] T bc225c93219c45538b53a1bd3d387e4d P e61c3a8f61bb48f8a963c9480e53c168 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:06:05.438840 23547 raft_consensus.cc:2749] T fa8650e71aa14778b3d73721fc50d9fc P e61c3a8f61bb48f8a963c9480e53c168 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:06:05.441438 23541 leader_election.cc:290] T 21e14947d70440f19044d8f75c31e1f9 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 11 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:06:05.442399 19405 raft_consensus.cc:1275] T f1b10566f45d4a7d9029858330e02d5b P e5256d91808b47c195bc9b4dbd7f2b87 [term 12 FOLLOWER]: Refusing update from remote peer e61c3a8f61bb48f8a963c9480e53c168: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:06:05.443106 23214 raft_consensus.cc:2749] T 1dc5b3532fe54f74876d02beffa2c230 P e61c3a8f61bb48f8a963c9480e53c168 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:06:05.445550 19483 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39478 (request call id 539) took 1074 ms. Trace:
I20260709 13:06:05.445947 19483 rpcz_store.cc:276] 0709 13:06:04.371621 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:04.371721 (+   100us) service_pool.cc:224] Handling call
0709 13:06:05.389129 (+1017408us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:05.389519 (+   390us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:05.389557 (+    38us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:05.389614 (+    57us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:06:05.389666 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:05.389745 (+    79us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:05.445346 (+ 55601us) spinlock_profiling.cc:243] Waited 1.02 s on lock 0x7b540029d450. stack: 00007f4a79de9343 00007f4a79de9240 00007f4a797781d4 00007f4a834b6304 00007f4a834b6299 00007f4a7ce71571 00007f4a7cf078ad 00007f4a81ecc419 00007f4a7b443bd4 00007f4a7b443b62 00007f4a7b443a91 00007f4a7b443a0c 00007f4a7b442cc2 00007f4a7b24348c 00007f4a7b2428c6 00007f4a7b24226f
0709 13:06:05.445485 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1157,"raft.run_cpu_time_us":158,"raft.run_wall_time_us":8092,"spinlock_wait_cycles":2339167104}
I20260709 13:06:05.385777 23556 raft_consensus.cc:515] T ef32ce6fdd0e40d382c79974f30295c6 P 0473d2b2d01f4459b1e90fd12cc7840e [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:05.449398 23556 leader_election.cc:290] T ef32ce6fdd0e40d382c79974f30295c6 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:06:05.424383 23387 raft_consensus.cc:493] T 2a16f7501e2444fb86d4e2778e734e02 P 127766fc592545a4997f7790f50f6076 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:05.452092 23387 raft_consensus.cc:515] T 2a16f7501e2444fb86d4e2778e734e02 P 127766fc592545a4997f7790f50f6076 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:05.454234 23387 leader_election.cc:290] T 2a16f7501e2444fb86d4e2778e734e02 P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:06:05.459024 19377 leader_election.cc:304] T ef32ce6fdd0e40d382c79974f30295c6 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:06:05.462155 19411 raft_consensus.cc:2468] T 21e14947d70440f19044d8f75c31e1f9 P e5256d91808b47c195bc9b4dbd7f2b87 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 11.
I20260709 13:06:05.462579 19377 leader_election.cc:304] T 309c3ca0ca4b4f3ba129752ea2cb293b P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, 127766fc592545a4997f7790f50f6076
I20260709 13:06:05.472575 19377 leader_election.cc:304] T 40e1e16737a842ee936002830f36882e P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:06:05.474586 19377 leader_election.cc:400] T 217b5fae677b4971b3bbd2f357a1f7ff P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 7 pre-election: Vote denied by peer 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257) with higher term. Message: Invalid argument: T 217b5fae677b4971b3bbd2f357a1f7ff P 0473d2b2d01f4459b1e90fd12cc7840e [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e5256d91808b47c195bc9b4dbd7f2b87 for earlier term 7. Current term is 8.
I20260709 13:06:05.500941 19377 leader_election.cc:304] T 172b3dd13109415a955b71ac0e9d2234 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87; no voters: 127766fc592545a4997f7790f50f6076
I20260709 13:06:05.502077 19377 leader_election.cc:304] T 2e36a9d6e29c4a7c860cf267efbd4c74 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:06:05.503149 19377 leader_election.cc:400] T a08760e15aac4630a629431f56024dc8 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 12 pre-election: Vote denied by peer 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257) with higher term. Message: Invalid argument: T a08760e15aac4630a629431f56024dc8 P 0473d2b2d01f4459b1e90fd12cc7840e [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e5256d91808b47c195bc9b4dbd7f2b87 for earlier term 12. Current term is 13.
I20260709 13:06:05.503909 19377 leader_election.cc:304] T 22196caba61445d3bec98a0aab3c337d P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:06:05.505563 19377 leader_election.cc:304] T d1e5873a19244c5ebbcd38e126796ee7 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:06:05.470592 23620 raft_consensus.cc:2749] T ef32ce6fdd0e40d382c79974f30295c6 P e5256d91808b47c195bc9b4dbd7f2b87 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:06:05.461513 23609 raft_consensus.cc:2749] T edd7d470b5014c9489be7f41f64355c9 P e5256d91808b47c195bc9b4dbd7f2b87 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:06:05.496057 23549 raft_consensus.cc:2749] T 40e1e16737a842ee936002830f36882e P e5256d91808b47c195bc9b4dbd7f2b87 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:06:05.497169 23587 raft_consensus.cc:2749] T 309c3ca0ca4b4f3ba129752ea2cb293b P e5256d91808b47c195bc9b4dbd7f2b87 [term 9 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:06:05.506960 23594 raft_consensus.cc:2749] T 2e36a9d6e29c4a7c860cf267efbd4c74 P e5256d91808b47c195bc9b4dbd7f2b87 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:06:05.512398 23605 raft_consensus.cc:2804] T 172b3dd13109415a955b71ac0e9d2234 P e5256d91808b47c195bc9b4dbd7f2b87 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:06:05.511148 23440 raft_consensus.cc:2749] T 22196caba61445d3bec98a0aab3c337d P e5256d91808b47c195bc9b4dbd7f2b87 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:06:05.529754 23609 raft_consensus.cc:3060] T d1e5873a19244c5ebbcd38e126796ee7 P e5256d91808b47c195bc9b4dbd7f2b87 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:06:05.581945 23655 log.cc:927] Time spent T 309c3ca0ca4b4f3ba129752ea2cb293b P 127766fc592545a4997f7790f50f6076: Append to log took a long time: real 0.056s	user 0.000s	sys 0.001s
W20260709 13:06:05.583415 23653 log.cc:927] Time spent T 1f85fc4b527a48848e5faa083b604e36 P 127766fc592545a4997f7790f50f6076: Append to log took a long time: real 0.059s	user 0.000s	sys 0.000s
I20260709 13:06:05.532680 23605 raft_consensus.cc:697] T 172b3dd13109415a955b71ac0e9d2234 P e5256d91808b47c195bc9b4dbd7f2b87 [term 10 LEADER]: Becoming Leader. State: Replica: e5256d91808b47c195bc9b4dbd7f2b87, State: Running, Role: LEADER
I20260709 13:06:05.532405 23587 consensus_queue.cc:1048] T 2725d2c4cb054f18b0fc8f735c15f6c2 P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.036s
W20260709 13:06:05.593474 19449 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.4:43121, user_credentials={real_user=slave}} blocked reactor thread for 261040us
I20260709 13:06:05.595054 23399 raft_consensus.cc:515] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P 127766fc592545a4997f7790f50f6076 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:05.606190 19407 raft_consensus.cc:1275] T b9f0d59553ad444883fcf5b5909f9798 P e5256d91808b47c195bc9b4dbd7f2b87 [term 11 FOLLOWER]: Refusing update from remote peer 0473d2b2d01f4459b1e90fd12cc7840e: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 11 index: 7. (term mismatch)
I20260709 13:06:05.606629 19407 pending_rounds.cc:85] T b9f0d59553ad444883fcf5b5909f9798 P e5256d91808b47c195bc9b4dbd7f2b87: Aborting all ops after (but not including) 6
I20260709 13:06:05.606855 19407 pending_rounds.cc:107] T b9f0d59553ad444883fcf5b5909f9798 P e5256d91808b47c195bc9b4dbd7f2b87: Aborting uncommitted NO_OP operation due to leader change: 10.7
I20260709 13:06:05.607077 19407 raft_consensus.cc:2889] T b9f0d59553ad444883fcf5b5909f9798 P e5256d91808b47c195bc9b4dbd7f2b87 [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:06:05.607084 23605 consensus_queue.cc:237] T 172b3dd13109415a955b71ac0e9d2234 P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:05.606045 23316 raft_consensus.cc:515] T 28af091831594f9d8e96482078cc7625 P 0473d2b2d01f4459b1e90fd12cc7840e [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:05.613761 23316 leader_election.cc:290] T 28af091831594f9d8e96482078cc7625 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 12 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:06:05.601933 23559 raft_consensus.cc:515] T 6c5eebf646ad445a9d1b1adc319d7b16 P 0473d2b2d01f4459b1e90fd12cc7840e [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:05.621708 19405 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52328 (request call id 1944) took 1156 ms. Trace:
I20260709 13:06:05.631156 19405 rpcz_store.cc:276] 0709 13:06:04.465655 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:04.466479 (+   824us) service_pool.cc:224] Handling call
0709 13:06:05.383876 (+917397us) spinlock_profiling.cc:243] Waited 1.8 ms on lock 0x7b5800183c98. stack: 00007f4a79de9343 00007f4a79de9240 00007f4a797781d4 00007f4a834b6304 00007f4a834b6299 00007f4a79ca3db1 00007f4a79de3e9c 00007f4a79de3a5b 00007f4a82cfcc09 00007f4a81e56ee0 00007f4a81f200ab 00007f4a81f20131 00007f4a81ee1fc0 00007f4a81ecc929 00007f4a81ecc3d2 00007f4a7b443bd4
0709 13:06:05.384106 (+   230us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:05.442802 (+ 58696us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:05.621492 (+178690us) spinlock_profiling.cc:243] Waited 58 ms on lock 0x7b5400063e54. stack: 00007f4a79de9343 00007f4a79de9240 00007f4a797781d4 00007f4a834b6304 00007f4a834b6299 00007f4a7ce71571 00007f4a7cf08e01 00007f4a7cf0783e 00007f4a81ecc419 00007f4a7b443bd4 00007f4a7b443b62 00007f4a7b443a91 00007f4a7b443a0c 00007f4a7b442cc2 00007f4a7b24348c 00007f4a7b2428c6
0709 13:06:05.621653 (+   161us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":137465984}
I20260709 13:06:05.631953 19480 raft_consensus.cc:1240] T 6c5eebf646ad445a9d1b1adc319d7b16 P 0473d2b2d01f4459b1e90fd12cc7840e [term 9 FOLLOWER]: Rejecting Update request from peer e61c3a8f61bb48f8a963c9480e53c168 for earlier term 8. Current term is 9. Ops: []
W20260709 13:06:05.633980 19526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.2:46257, user_credentials={real_user=slave}} blocked reactor thread for 200615us
W20260709 13:06:05.636667 19450 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.3:36891, user_credentials={real_user=slave}} blocked reactor thread for 319996us
I20260709 13:06:05.639477 19450 leader_election.cc:304] T bc225c93219c45538b53a1bd3d387e4d P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168; no voters: e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:06:05.645700 19405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21e14947d70440f19044d8f75c31e1f9" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
I20260709 13:06:05.646755 19405 raft_consensus.cc:2393] T 21e14947d70440f19044d8f75c31e1f9 P e5256d91808b47c195bc9b4dbd7f2b87 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 0473d2b2d01f4459b1e90fd12cc7840e in current term 11: Already voted for candidate e61c3a8f61bb48f8a963c9480e53c168 in this term.
W20260709 13:06:05.648406 19452 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:05.649291 19405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef32ce6fdd0e40d382c79974f30295c6" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:06:05.650971 19558 raft_consensus.cc:3060] T 2a16f7501e2444fb86d4e2778e734e02 P e61c3a8f61bb48f8a963c9480e53c168 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:06:05.654657 19374 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.4:43121, user_credentials={real_user=slave}} blocked reactor thread for 340766us
I20260709 13:06:05.655908 19374 leader_election.cc:304] T 775c229504194560ba9589bc2199b089 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 127766fc592545a4997f7790f50f6076, e5256d91808b47c195bc9b4dbd7f2b87; no voters: 
I20260709 13:06:05.657714 19405 raft_consensus.cc:2393] T ef32ce6fdd0e40d382c79974f30295c6 P e5256d91808b47c195bc9b4dbd7f2b87 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0473d2b2d01f4459b1e90fd12cc7840e in current term 13: Already voted for candidate e5256d91808b47c195bc9b4dbd7f2b87 in this term.
I20260709 13:06:05.666920 19558 raft_consensus.cc:1275] T 2a16f7501e2444fb86d4e2778e734e02 P e61c3a8f61bb48f8a963c9480e53c168 [term 12 FOLLOWER]: Refusing update from remote peer e5256d91808b47c195bc9b4dbd7f2b87: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 12 index: 10. (term mismatch)
I20260709 13:06:05.668633 19558 pending_rounds.cc:85] T 2a16f7501e2444fb86d4e2778e734e02 P e61c3a8f61bb48f8a963c9480e53c168: Aborting all ops after (but not including) 9
I20260709 13:06:05.669330 19558 pending_rounds.cc:107] T 2a16f7501e2444fb86d4e2778e734e02 P e61c3a8f61bb48f8a963c9480e53c168: Aborting uncommitted NO_OP operation due to leader change: 11.10
I20260709 13:06:05.670042 19558 raft_consensus.cc:2889] T 2a16f7501e2444fb86d4e2778e734e02 P e61c3a8f61bb48f8a963c9480e53c168 [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:06:05.671685 19558 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40438 (request call id 2289) took 1820 ms. Trace:
I20260709 13:06:05.672524 19558 rpcz_store.cc:276] 0709 13:06:03.851319 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:03.851539 (+   220us) service_pool.cc:224] Handling call
0709 13:06:03.851838 (+   299us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:05.159596 (+1307758us) spinlock_profiling.cc:243] Waited 7.36 ms on lock 0x7b540028d820. stack: 00007f4a79de9343 00007f4a79de9240 00007f4a797781d4 00007f4a834b6304 00007f4a834b6299 00007f4a7ce71571 00007f4a7ce7fdc0 00007f4a7cf0a1c0 00007f4a7cf0b231 00007f4a7cf07d8f 00007f4a7cf0783e 00007f4a81ecc419 00007f4a7b443bd4 00007f4a7b443b62 00007f4a7b443a91 00007f4a7b443a0c
0709 13:06:05.650516 (+490920us) spinlock_profiling.cc:243] Waited 408 ms on lock 0x7b58005ff6d0. stack: 00007f4a79de9343 00007f4a79de9240 00007f4a797781d4 00007f4a834b6304 00007f4a834b6299 00007f4a7ce71571 00007f4a7ce640aa 00007f4a7cee6447 00007f4a7cefefe7 00007f4a7cf007de 00007f4a7cf0ab49 00007f4a7cf0b416 00007f4a7cf07d8f 00007f4a7cf0783e 00007f4a81ecc419 00007f4a7b443bd4
0709 13:06:05.670899 (+ 20383us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:05.671627 (+   728us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":956351232}
I20260709 13:06:05.654598 19450 leader_election.cc:304] T 7f575b143b844aa096b50997dad3516a P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e; no voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:06:05.627689 23529 raft_consensus.cc:515] T bc225c93219c45538b53a1bd3d387e4d P e61c3a8f61bb48f8a963c9480e53c168 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
W20260709 13:06:05.674556 23638 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.648s	user 0.018s	sys 0.031s
W20260709 13:06:05.676169 23525 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 12 current term: 12 is higher.
I20260709 13:06:05.648633 23615 consensus_queue.cc:1048] T 0cdf56e38bbc453d9438d359e5a69955 P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.033s
I20260709 13:06:05.673595 23663 raft_consensus.cc:2804] T bc225c93219c45538b53a1bd3d387e4d P 0473d2b2d01f4459b1e90fd12cc7840e [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:06:05.678645 23585 raft_consensus.cc:2804] T 775c229504194560ba9589bc2199b089 P e5256d91808b47c195bc9b4dbd7f2b87 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:06:05.701772 23585 raft_consensus.cc:493] T 775c229504194560ba9589bc2199b089 P e5256d91808b47c195bc9b4dbd7f2b87 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 127766fc592545a4997f7790f50f6076)
I20260709 13:06:05.702204 23585 raft_consensus.cc:3060] T 775c229504194560ba9589bc2199b089 P e5256d91808b47c195bc9b4dbd7f2b87 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:06:05.704264 23663 raft_consensus.cc:493] T bc225c93219c45538b53a1bd3d387e4d P 0473d2b2d01f4459b1e90fd12cc7840e [term 10 FOLLOWER]: Starting leader election (detected failure of leader e5256d91808b47c195bc9b4dbd7f2b87)
I20260709 13:06:05.704680 23663 raft_consensus.cc:3060] T bc225c93219c45538b53a1bd3d387e4d P 0473d2b2d01f4459b1e90fd12cc7840e [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:06:05.648106 23505 consensus_queue.cc:1059] T 179fd671030940b4b4a4e24bcc4aba0a P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.034s
I20260709 13:06:05.707113 23505 raft_consensus.cc:3055] T 179fd671030940b4b4a4e24bcc4aba0a P e61c3a8f61bb48f8a963c9480e53c168 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:06:05.707494 23505 raft_consensus.cc:740] T 179fd671030940b4b4a4e24bcc4aba0a P e61c3a8f61bb48f8a963c9480e53c168 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: e61c3a8f61bb48f8a963c9480e53c168, State: Running, Role: LEADER
I20260709 13:06:05.708382 23505 consensus_queue.cc:260] T 179fd671030940b4b4a4e24bcc4aba0a P e61c3a8f61bb48f8a963c9480e53c168 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:05.709636 23505 raft_consensus.cc:3060] T 179fd671030940b4b4a4e24bcc4aba0a P e61c3a8f61bb48f8a963c9480e53c168 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:06:05.674837 23399 leader_election.cc:290] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 12 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:06:05.648488 23545 consensus_queue.cc:1048] T 7f575b143b844aa096b50997dad3516a P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.034s
I20260709 13:06:05.712589 23663 raft_consensus.cc:515] T bc225c93219c45538b53a1bd3d387e4d P 0473d2b2d01f4459b1e90fd12cc7840e [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:05.649042 23580 consensus_queue.cc:1059] T ed7fdbcb96d14d418db9ca90a792588a P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.033s
I20260709 13:06:05.713210 23609 raft_consensus.cc:2749] T d1e5873a19244c5ebbcd38e126796ee7 P e5256d91808b47c195bc9b4dbd7f2b87 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:06:05.713799 23580 raft_consensus.cc:3055] T ed7fdbcb96d14d418db9ca90a792588a P e61c3a8f61bb48f8a963c9480e53c168 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:06:05.714157 23580 raft_consensus.cc:740] T ed7fdbcb96d14d418db9ca90a792588a P e61c3a8f61bb48f8a963c9480e53c168 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: e61c3a8f61bb48f8a963c9480e53c168, State: Running, Role: LEADER
I20260709 13:06:05.714854 23663 leader_election.cc:290] T bc225c93219c45538b53a1bd3d387e4d P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 11 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:06:05.678431 23440 consensus_queue.cc:1059] T ff9b0eddd810459b82d91c60777c10eb P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.037s
I20260709 13:06:05.681818 23594 consensus_queue.cc:1059] T 1f85fc4b527a48848e5faa083b604e36 P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.035s
W20260709 13:06:05.689638 23638 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.663s	user 0.018s	sys 0.031s
I20260709 13:06:05.727646 23559 leader_election.cc:290] T 6c5eebf646ad445a9d1b1adc319d7b16 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 9 election: Requested vote from peers e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:06:05.722980 23580 consensus_queue.cc:260] T ed7fdbcb96d14d418db9ca90a792588a P e61c3a8f61bb48f8a963c9480e53c168 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:05.678534 23620 consensus_queue.cc:1059] T 14efcc79969f41babe5529c22d59156d P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.023s
I20260709 13:06:05.733724 23580 raft_consensus.cc:3060] T ed7fdbcb96d14d418db9ca90a792588a P e61c3a8f61bb48f8a963c9480e53c168 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:06:05.734508 23594 consensus_queue.cc:1243] T 1f85fc4b527a48848e5faa083b604e36 P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Peer 127766fc592545a4997f7790f50f6076 log is divergent from this leader: its last log entry 9.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
I20260709 13:06:05.735097 23619 raft_consensus.cc:3055] T 1f85fc4b527a48848e5faa083b604e36 P e5256d91808b47c195bc9b4dbd7f2b87 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:06:05.735455 23619 raft_consensus.cc:740] T 1f85fc4b527a48848e5faa083b604e36 P e5256d91808b47c195bc9b4dbd7f2b87 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: e5256d91808b47c195bc9b4dbd7f2b87, State: Running, Role: LEADER
I20260709 13:06:05.736266 23619 consensus_queue.cc:260] T 1f85fc4b527a48848e5faa083b604e36 P e5256d91808b47c195bc9b4dbd7f2b87 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:05.737490 23619 raft_consensus.cc:3060] T 1f85fc4b527a48848e5faa083b604e36 P e5256d91808b47c195bc9b4dbd7f2b87 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:06:05.747718 23529 leader_election.cc:290] T bc225c93219c45538b53a1bd3d387e4d P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 11 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:06:05.732761 23609 raft_consensus.cc:3055] T ff9b0eddd810459b82d91c60777c10eb P e5256d91808b47c195bc9b4dbd7f2b87 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:06:05.749369 23609 raft_consensus.cc:740] T ff9b0eddd810459b82d91c60777c10eb P e5256d91808b47c195bc9b4dbd7f2b87 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: e5256d91808b47c195bc9b4dbd7f2b87, State: Running, Role: LEADER
I20260709 13:06:05.752740 23585 raft_consensus.cc:515] T 775c229504194560ba9589bc2199b089 P e5256d91808b47c195bc9b4dbd7f2b87 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:05.752730 23609 consensus_queue.cc:260] T ff9b0eddd810459b82d91c60777c10eb P e5256d91808b47c195bc9b4dbd7f2b87 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:05.754555 23585 leader_election.cc:290] T 775c229504194560ba9589bc2199b089 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 9 election: Requested vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:06:05.755543 23609 raft_consensus.cc:3060] T ff9b0eddd810459b82d91c60777c10eb P e5256d91808b47c195bc9b4dbd7f2b87 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:06:05.677618 19374 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:05.790904 19377 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.2:46257, user_credentials={real_user=slave}} blocked reactor thread for 282383us
W20260709 13:06:05.793813 19523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.4:43121, user_credentials={real_user=slave}} blocked reactor thread for 119208us
W20260709 13:06:05.799638 19449 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:05.803597 19483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f93ee515a9c14139bf566522ed8232f3" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 14 candidate_status { last_received { term: 12 index: 5 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:06:05.804949 23559 raft_consensus.cc:493] T 0cdf56e38bbc453d9438d359e5a69955 P 0473d2b2d01f4459b1e90fd12cc7840e [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:06:05.805403 19450 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.3:36891, user_credentials={real_user=slave}} blocked reactor thread for 150707us
I20260709 13:06:05.805716 19483 raft_consensus.cc:2368] T f93ee515a9c14139bf566522ed8232f3 P 0473d2b2d01f4459b1e90fd12cc7840e [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate e61c3a8f61bb48f8a963c9480e53c168 for earlier term 14. Current term is 15.
I20260709 13:06:05.806409 23559 raft_consensus.cc:515] T 0cdf56e38bbc453d9438d359e5a69955 P 0473d2b2d01f4459b1e90fd12cc7840e [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
W20260709 13:06:05.790565 19374 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:05.811836 23559 leader_election.cc:290] T 0cdf56e38bbc453d9438d359e5a69955 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:06:05.812687 23559 raft_consensus.cc:2749] T 7f575b143b844aa096b50997dad3516a P 0473d2b2d01f4459b1e90fd12cc7840e [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 13:06:05.819240 19374 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:05.820786 19523 leader_election.cc:304] T 1efebf73c86e432baa55533136b6e12c P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 127766fc592545a4997f7790f50f6076, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:06:05.821084 23549 raft_consensus.cc:493] T 0cdf56e38bbc453d9438d359e5a69955 P e5256d91808b47c195bc9b4dbd7f2b87 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:05.822436 23214 raft_consensus.cc:2804] T 1efebf73c86e432baa55533136b6e12c P e61c3a8f61bb48f8a963c9480e53c168 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:06:05.824890 23214 raft_consensus.cc:493] T 1efebf73c86e432baa55533136b6e12c P e61c3a8f61bb48f8a963c9480e53c168 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:05.825277 19523 leader_election.cc:304] T 48824d5acfbc485ebf8c2d944e7202de P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 127766fc592545a4997f7790f50f6076, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:06:05.825495 23214 raft_consensus.cc:3060] T 1efebf73c86e432baa55533136b6e12c P e61c3a8f61bb48f8a963c9480e53c168 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:06:05.822485 19409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff9b0eddd810459b82d91c60777c10eb" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
I20260709 13:06:05.826601 23587 raft_consensus.cc:493] T 217b5fae677b4971b3bbd2f357a1f7ff P e5256d91808b47c195bc9b4dbd7f2b87 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:05.827798 23549 raft_consensus.cc:515] T 0cdf56e38bbc453d9438d359e5a69955 P e5256d91808b47c195bc9b4dbd7f2b87 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:05.827490 19405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70797e5783b5454ab0d0eea663e791e3" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
W20260709 13:06:05.828971 20076 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:05.829422 19402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ece3db938bc649d4a40a51522ed5259c" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:06:05.829177 23587 raft_consensus.cc:515] T 217b5fae677b4971b3bbd2f357a1f7ff P e5256d91808b47c195bc9b4dbd7f2b87 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
W20260709 13:06:05.855645 19525 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:05.859134 19376 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:05.859176 23619 consensus_queue.cc:1059] T 2725d2c4cb054f18b0fc8f735c15f6c2 P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.004s
I20260709 13:06:05.863489 23619 consensus_queue.cc:1048] T 2a16f7501e2444fb86d4e2778e734e02 P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:06:05.865345 23619 raft_consensus.cc:3055] T 2725d2c4cb054f18b0fc8f735c15f6c2 P e5256d91808b47c195bc9b4dbd7f2b87 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:06:05.865715 23619 raft_consensus.cc:740] T 2725d2c4cb054f18b0fc8f735c15f6c2 P e5256d91808b47c195bc9b4dbd7f2b87 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: e5256d91808b47c195bc9b4dbd7f2b87, State: Running, Role: LEADER
I20260709 13:06:05.871367 23619 consensus_queue.cc:260] T 2725d2c4cb054f18b0fc8f735c15f6c2 P e5256d91808b47c195bc9b4dbd7f2b87 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 12.6, Last appended by leader: 6, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:05.872902 23619 raft_consensus.cc:3060] T 2725d2c4cb054f18b0fc8f735c15f6c2 P e5256d91808b47c195bc9b4dbd7f2b87 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:06:05.873189 23587 leader_election.cc:290] T 217b5fae677b4971b3bbd2f357a1f7ff P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:06:05.890910 19486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1efebf73c86e432baa55533136b6e12c" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:06:05.892340 19486 raft_consensus.cc:2468] T 1efebf73c86e432baa55533136b6e12c P 0473d2b2d01f4459b1e90fd12cc7840e [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 9.
I20260709 13:06:05.893991 19482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2725d2c4cb054f18b0fc8f735c15f6c2" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 13 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:06:05.895011 19482 raft_consensus.cc:3060] T 2725d2c4cb054f18b0fc8f735c15f6c2 P 0473d2b2d01f4459b1e90fd12cc7840e [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:06:05.900477 19485 raft_consensus.cc:1275] T 76cb037fc9064d13b59a8969d897ce8c P 0473d2b2d01f4459b1e90fd12cc7840e [term 10 FOLLOWER]: Refusing update from remote peer e61c3a8f61bb48f8a963c9480e53c168: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:06:05.903110 23663 raft_consensus.cc:493] T edd7d470b5014c9489be7f41f64355c9 P 0473d2b2d01f4459b1e90fd12cc7840e [term 11 FOLLOWER]: Starting pre-election (detected failure of leader e61c3a8f61bb48f8a963c9480e53c168)
I20260709 13:06:05.904277 19479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86a6797bdfe94fa496c050ceae4bd0d9" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:06:05.907539 19478 raft_consensus.cc:1240] T d1e5873a19244c5ebbcd38e126796ee7 P 0473d2b2d01f4459b1e90fd12cc7840e [term 12 FOLLOWER]: Rejecting Update request from peer e61c3a8f61bb48f8a963c9480e53c168 for earlier term 11. Current term is 12. Ops: []
I20260709 13:06:05.830382 23622 raft_consensus.cc:2749] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P 0473d2b2d01f4459b1e90fd12cc7840e [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:06:05.904209 23663 raft_consensus.cc:515] T edd7d470b5014c9489be7f41f64355c9 P 0473d2b2d01f4459b1e90fd12cc7840e [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
W20260709 13:06:05.940656 19377 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.2:46257, user_credentials={real_user=slave}} blocked reactor thread for 90161.3us
W20260709 13:06:05.939817 19523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.4:43121, user_credentials={real_user=slave}} blocked reactor thread for 114864us
W20260709 13:06:05.941936 19450 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.3:36891, user_credentials={real_user=slave}} blocked reactor thread for 110873us
I20260709 13:06:05.903074 19481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22196caba61445d3bec98a0aab3c337d" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:06:05.944056 23660 consensus_queue.cc:1048] T b9f0d59553ad444883fcf5b5909f9798 P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:06:05.948375 19560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4509b76741dc428e9201c70c1658da13" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:06:05.949390 19560 raft_consensus.cc:2393] T 4509b76741dc428e9201c70c1658da13 P e61c3a8f61bb48f8a963c9480e53c168 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e5256d91808b47c195bc9b4dbd7f2b87 in current term 5: Already voted for candidate e61c3a8f61bb48f8a963c9480e53c168 in this term.
I20260709 13:06:05.958799 23554 raft_consensus.cc:493] T 65d8cb8d6ec64f459d5a47cefab10acf P 127766fc592545a4997f7790f50f6076 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader e5256d91808b47c195bc9b4dbd7f2b87)
I20260709 13:06:05.959021 23672 raft_consensus.cc:2804] T 48824d5acfbc485ebf8c2d944e7202de P e61c3a8f61bb48f8a963c9480e53c168 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:06:05.959547 23672 raft_consensus.cc:493] T 48824d5acfbc485ebf8c2d944e7202de P e61c3a8f61bb48f8a963c9480e53c168 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:05.959462 23554 raft_consensus.cc:515] T 65d8cb8d6ec64f459d5a47cefab10acf P 127766fc592545a4997f7790f50f6076 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:05.960085 23672 raft_consensus.cc:3060] T 48824d5acfbc485ebf8c2d944e7202de P e61c3a8f61bb48f8a963c9480e53c168 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:06:05.962488 19403 raft_consensus.cc:1217] T 2a16f7501e2444fb86d4e2778e734e02 P e5256d91808b47c195bc9b4dbd7f2b87 [term 12 LEADER]: Deduplicated request from leader. Original: 8.8->[10.9-11.10]   Dedup: 10.9->[11.10-11.10]
I20260709 13:06:05.963150 19403 raft_consensus.cc:1240] T 2a16f7501e2444fb86d4e2778e734e02 P e5256d91808b47c195bc9b4dbd7f2b87 [term 12 LEADER]: Rejecting Update request from peer e61c3a8f61bb48f8a963c9480e53c168 for earlier term 11. Current term is 12. Ops: [10.9-11.10]
I20260709 13:06:05.963619 23554 leader_election.cc:290] T 65d8cb8d6ec64f459d5a47cefab10acf P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:06:05.965278 23516 raft_consensus.cc:493] T df751f992649444090e27965eb1af85d P e61c3a8f61bb48f8a963c9480e53c168 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:05.973269 19450 leader_election.cc:304] T d1e5873a19244c5ebbcd38e126796ee7 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e; no voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:06:05.974367 23585 consensus_queue.cc:1059] T 1dc5b3532fe54f74876d02beffa2c230 P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:06:05.975581 23585 consensus_queue.cc:1059] T 14efcc79969f41babe5529c22d59156d P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:06:05.976895 23585 raft_consensus.cc:3055] T 1dc5b3532fe54f74876d02beffa2c230 P e5256d91808b47c195bc9b4dbd7f2b87 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:06:05.977325 23585 raft_consensus.cc:740] T 1dc5b3532fe54f74876d02beffa2c230 P e5256d91808b47c195bc9b4dbd7f2b87 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: e5256d91808b47c195bc9b4dbd7f2b87, State: Running, Role: LEADER
I20260709 13:06:05.979135 19478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21e14947d70440f19044d8f75c31e1f9" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:06:05.979204 23585 consensus_queue.cc:260] T 1dc5b3532fe54f74876d02beffa2c230 P e5256d91808b47c195bc9b4dbd7f2b87 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.5, Last appended by leader: 5, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:05.980240 19478 raft_consensus.cc:2393] T 21e14947d70440f19044d8f75c31e1f9 P 0473d2b2d01f4459b1e90fd12cc7840e [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate e61c3a8f61bb48f8a963c9480e53c168 in current term 11: Already voted for candidate 0473d2b2d01f4459b1e90fd12cc7840e in this term.
I20260709 13:06:05.980409 19477 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58294 (request call id 2135) took 1420 ms. Trace:
I20260709 13:06:05.981089 23585 raft_consensus.cc:3060] T 1dc5b3532fe54f74876d02beffa2c230 P e5256d91808b47c195bc9b4dbd7f2b87 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:06:05.966150 23516 raft_consensus.cc:515] T df751f992649444090e27965eb1af85d P e61c3a8f61bb48f8a963c9480e53c168 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:05.985389 23516 leader_election.cc:290] T df751f992649444090e27965eb1af85d P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:06:05.980815 19477 rpcz_store.cc:276] 0709 13:06:04.559563 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:04.797871 (+238308us) service_pool.cc:224] Handling call
0709 13:06:05.165347 (+367476us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:05.165652 (+   305us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:05.165679 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:05.169067 (+  3388us) log.cc:844] Serialized 26 byte log entry
0709 13:06:05.461457 (+292390us) spinlock_profiling.cc:243] Waited 3.89 ms on lock 0x7b18003ad7a0. stack: 00007f4a79de9343 00007f4a79de9240 00007f4a797781d4 00007f4a834b6304 00007f4a834b6299 00007f4a82ce3de1 00007f4a82cf05b1 00007f4a79dfde07 00007f4a82c58ab9 00007f4a79e1a69b 00007f4a79e1893f 00007f4a79e1ac02 00007f4a7caa220b 00007f4a7caa7d23 00007f4a7caa80d1 00007f4a7cec3a0f
0709 13:06:05.648380 (+186923us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:06:05.680227 (+ 31847us) log.cc:844] Serialized 14 byte log entry
0709 13:06:05.790942 (+110715us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:05.791161 (+   219us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:05.791337 (+   176us) raft_consensus.cc:1685] finished
0709 13:06:05.791546 (+   209us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:05.980097 (+188551us) spinlock_profiling.cc:243] Waited 367 ms on lock 0x7b540029de50. stack: 00007f4a79de9343 00007f4a79de9240 00007f4a797781d4 00007f4a834b6304 00007f4a834b6299 00007f4a7ce71571 00007f4a7cf078ad 00007f4a81ecc419 00007f4a7b443bd4 00007f4a7b443b62 00007f4a7b443a91 00007f4a7b443a0c 00007f4a7b442cc2 00007f4a7b24348c 00007f4a7b2428c6 00007f4a7b24226f
0709 13:06:05.980225 (+   128us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":109641,"prepare.queue_time_us":31684,"prepare.run_cpu_time_us":54,"prepare.run_wall_time_us":55,"raft.queue_time_us":120910,"raft.run_cpu_time_us":559,"raft.run_wall_time_us":8145,"spinlock_wait_cycles":853266560,"thread_start_us":186707,"threads_started":1,"wal-append.queue_time_us":516045}
I20260709 13:06:05.988742 19305 catalog_manager.cc:5697] T ab43d85f64114d4ebf618930e43d9ed0 P 127766fc592545a4997f7790f50f6076 reported cstate change: term changed from 5 to 8, leader changed from e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3) to 127766fc592545a4997f7790f50f6076 (127.17.223.4). New cstate: current_term: 8 leader_uuid: "127766fc592545a4997f7790f50f6076" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:06:05.991129 19560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f93ee515a9c14139bf566522ed8232f3" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 15 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:06:05.992177 19560 raft_consensus.cc:2393] T f93ee515a9c14139bf566522ed8232f3 P e61c3a8f61bb48f8a963c9480e53c168 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate e5256d91808b47c195bc9b4dbd7f2b87 in current term 15: Already voted for candidate 0473d2b2d01f4459b1e90fd12cc7840e in this term.
I20260709 13:06:05.994323 23663 leader_election.cc:290] T edd7d470b5014c9489be7f41f64355c9 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:06:05.953394 23660 raft_consensus.cc:493] T 9962423cb4e54fcfa5de01daf68a86e7 P 0473d2b2d01f4459b1e90fd12cc7840e [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 127766fc592545a4997f7790f50f6076)
I20260709 13:06:05.997571 19305 catalog_manager.cc:5697] T 0e1085d23e8347fbbd5bce7542f4b1f4 P 127766fc592545a4997f7790f50f6076 reported cstate change: term changed from 4 to 6, leader changed from 127766fc592545a4997f7790f50f6076 (127.17.223.4) to e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3). New cstate: current_term: 6 leader_uuid: "e61c3a8f61bb48f8a963c9480e53c168" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } } }
I20260709 13:06:06.009634 23549 leader_election.cc:290] T 0cdf56e38bbc453d9438d359e5a69955 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
W20260709 13:06:06.040839 19377 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.2:46257, user_credentials={real_user=slave}} blocked reactor thread for 66207.4us
I20260709 13:06:06.042879 23378 raft_consensus.cc:2749] T d1e5873a19244c5ebbcd38e126796ee7 P 0473d2b2d01f4459b1e90fd12cc7840e [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:06:06.043021 19558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed7fdbcb96d14d418db9ca90a792588a" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:06:06.044080 19558 raft_consensus.cc:2410] T ed7fdbcb96d14d418db9ca90a792588a P e61c3a8f61bb48f8a963c9480e53c168 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 127766fc592545a4997f7790f50f6076 for term 9 because replica has last-logged OpId of term: 8 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 7.
I20260709 13:06:06.049114 19560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "833a2f0775ed407a94b8924ce50adb63" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:06:06.049820 19403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a16f7501e2444fb86d4e2778e734e02" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 13 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:06:06.058806 23378 raft_consensus.cc:493] T e381f1d6b8184797ad142de49be225a8 P 0473d2b2d01f4459b1e90fd12cc7840e [term 8 FOLLOWER]: Starting pre-election (detected failure of leader e61c3a8f61bb48f8a963c9480e53c168)
W20260709 13:06:06.059074 19526 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:06.061981 19477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48824d5acfbc485ebf8c2d944e7202de" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:06:06.061529 19558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21e14947d70440f19044d8f75c31e1f9" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:06:06.066779 19551 raft_consensus.cc:1240] T 65d8cb8d6ec64f459d5a47cefab10acf P e61c3a8f61bb48f8a963c9480e53c168 [term 9 FOLLOWER]: Rejecting Update request from peer e5256d91808b47c195bc9b4dbd7f2b87 for earlier term 8. Current term is 9. Ops: []
I20260709 13:06:06.066619 19552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0afb57ae58a24a01850491d69f0213dd" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:06:06.069298 19558 raft_consensus.cc:2368] T 21e14947d70440f19044d8f75c31e1f9 P e61c3a8f61bb48f8a963c9480e53c168 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate e5256d91808b47c195bc9b4dbd7f2b87 for earlier term 10. Current term is 11.
I20260709 13:06:06.059609 23378 raft_consensus.cc:515] T e381f1d6b8184797ad142de49be225a8 P 0473d2b2d01f4459b1e90fd12cc7840e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:06.076401 23378 leader_election.cc:290] T e381f1d6b8184797ad142de49be225a8 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:06:06.080304 19560 raft_consensus.cc:2468] T 833a2f0775ed407a94b8924ce50adb63 P e61c3a8f61bb48f8a963c9480e53c168 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 127766fc592545a4997f7790f50f6076 in term 9.
I20260709 13:06:06.081633 19481 raft_consensus.cc:1275] T 217b5fae677b4971b3bbd2f357a1f7ff P 0473d2b2d01f4459b1e90fd12cc7840e [term 8 FOLLOWER]: Refusing update from remote peer e61c3a8f61bb48f8a963c9480e53c168: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 13:06:06.040109 23660 raft_consensus.cc:515] T 9962423cb4e54fcfa5de01daf68a86e7 P 0473d2b2d01f4459b1e90fd12cc7840e [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:06.094591 19405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36f6ba92b9ba46babe4ebd6c02e5fbd9" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
I20260709 13:06:06.095880 19407 raft_consensus.cc:1275] T 1f85fc4b527a48848e5faa083b604e36 P e5256d91808b47c195bc9b4dbd7f2b87 [term 9 FOLLOWER]: Refusing update from remote peer 127766fc592545a4997f7790f50f6076: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 9 index: 9. (term mismatch)
I20260709 13:06:06.097800 19407 pending_rounds.cc:85] T 1f85fc4b527a48848e5faa083b604e36 P e5256d91808b47c195bc9b4dbd7f2b87: Aborting all ops after (but not including) 8
I20260709 13:06:06.099498 19407 pending_rounds.cc:107] T 1f85fc4b527a48848e5faa083b604e36 P e5256d91808b47c195bc9b4dbd7f2b87: Aborting uncommitted NO_OP operation due to leader change: 8.9
I20260709 13:06:06.104818 19407 raft_consensus.cc:2889] T 1f85fc4b527a48848e5faa083b604e36 P e5256d91808b47c195bc9b4dbd7f2b87 [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:06:06.103148 19377 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.2:46257, user_credentials={real_user=slave}} blocked reactor thread for 48545.9us
I20260709 13:06:06.109859 19560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7be9efa6559648dbb5a0f7684c4542d1" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:06:06.110598 19560 raft_consensus.cc:2468] T 7be9efa6559648dbb5a0f7684c4542d1 P e61c3a8f61bb48f8a963c9480e53c168 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 127766fc592545a4997f7790f50f6076 in term 11.
I20260709 13:06:06.112198 19477 raft_consensus.cc:2468] T 48824d5acfbc485ebf8c2d944e7202de P 0473d2b2d01f4459b1e90fd12cc7840e [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 11.
I20260709 13:06:06.120754 19560 raft_consensus.cc:1275] T 14935b3ddf914369822e4a0547aaa355 P e61c3a8f61bb48f8a963c9480e53c168 [term 10 FOLLOWER]: Refusing update from remote peer 127766fc592545a4997f7790f50f6076: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 13:06:06.119143 19405 raft_consensus.cc:1275] T 4af19371ea874c09a0a2147040835cbb P e5256d91808b47c195bc9b4dbd7f2b87 [term 8 FOLLOWER]: Refusing update from remote peer 127766fc592545a4997f7790f50f6076: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:06:06.124117 19558 raft_consensus.cc:1240] T bc225c93219c45538b53a1bd3d387e4d P e61c3a8f61bb48f8a963c9480e53c168 [term 11 FOLLOWER]: Rejecting Update request from peer e5256d91808b47c195bc9b4dbd7f2b87 for earlier term 10. Current term is 11. Ops: []
I20260709 13:06:06.169982 19407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65d8cb8d6ec64f459d5a47cefab10acf" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:06:06.172246 23585 raft_consensus.cc:493] T ff75a1d4cb1f493db8f71ddc136ba9ab P e5256d91808b47c195bc9b4dbd7f2b87 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader e61c3a8f61bb48f8a963c9480e53c168)
I20260709 13:06:06.173417 23605 raft_consensus.cc:3055] T 14efcc79969f41babe5529c22d59156d P e5256d91808b47c195bc9b4dbd7f2b87 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:06:06.173062 23585 raft_consensus.cc:515] T ff75a1d4cb1f493db8f71ddc136ba9ab P e5256d91808b47c195bc9b4dbd7f2b87 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:06.173838 23605 raft_consensus.cc:740] T 14efcc79969f41babe5529c22d59156d P e5256d91808b47c195bc9b4dbd7f2b87 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: e5256d91808b47c195bc9b4dbd7f2b87, State: Running, Role: LEADER
I20260709 13:06:06.175176 19479 raft_consensus.cc:1275] T a08760e15aac4630a629431f56024dc8 P 0473d2b2d01f4459b1e90fd12cc7840e [term 13 FOLLOWER]: Refusing update from remote peer e61c3a8f61bb48f8a963c9480e53c168: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:06:06.175659 23585 leader_election.cc:290] T ff75a1d4cb1f493db8f71ddc136ba9ab P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:06:06.176558 19560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed7fdbcb96d14d418db9ca90a792588a" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:06:06.177366 19560 raft_consensus.cc:2410] T ed7fdbcb96d14d418db9ca90a792588a P e61c3a8f61bb48f8a963c9480e53c168 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 127766fc592545a4997f7790f50f6076 for term 9 because replica has last-logged OpId of term: 8 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 7.
I20260709 13:06:06.178208 19551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa731b585f684a7fb2d106c50f143b83" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:06:06.178900 19551 raft_consensus.cc:3060] T fa731b585f684a7fb2d106c50f143b83 P e61c3a8f61bb48f8a963c9480e53c168 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:06:06.179011 19377 leader_election.cc:400] T 179fd671030940b4b4a4e24bcc4aba0a P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 10 election: Vote denied by peer 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257) with higher term. Message: Invalid argument: T 179fd671030940b4b4a4e24bcc4aba0a P 0473d2b2d01f4459b1e90fd12cc7840e [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate e5256d91808b47c195bc9b4dbd7f2b87 for earlier term 10. Current term is 12.
I20260709 13:06:06.179220 19557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e1085d23e8347fbbd5bce7542f4b1f4" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:06:06.180601 19553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48824d5acfbc485ebf8c2d944e7202de" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:06:06.181699 19559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62c6c134d3d24a1ab144dd9ee6bc3f64" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:06:06.183099 19552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c5eebf646ad445a9d1b1adc319d7b16" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:06:06.184465 19552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cdf56e38bbc453d9438d359e5a69955" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:06:06.186513 19560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96efeaaf1057492490e9a621f37e1a2d" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 13 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:06:06.187482 19560 raft_consensus.cc:2410] T 96efeaaf1057492490e9a621f37e1a2d P e61c3a8f61bb48f8a963c9480e53c168 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 127766fc592545a4997f7790f50f6076 for term 13 because replica has last-logged OpId of term: 11 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 8.
I20260709 13:06:06.188464 19375 leader_election.cc:400] T 21e14947d70440f19044d8f75c31e1f9 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 10 election: Vote denied by peer e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891) with higher term. Message: Invalid argument: T 21e14947d70440f19044d8f75c31e1f9 P e61c3a8f61bb48f8a963c9480e53c168 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate e5256d91808b47c195bc9b4dbd7f2b87 for earlier term 10. Current term is 11.
I20260709 13:06:06.188845 19375 leader_election.cc:403] T 21e14947d70440f19044d8f75c31e1f9 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 10 election: Cancelling election due to peer responding with higher term
I20260709 13:06:06.190482 19556 raft_consensus.cc:1240] T 1dc5b3532fe54f74876d02beffa2c230 P e61c3a8f61bb48f8a963c9480e53c168 [term 11 FOLLOWER]: Rejecting Update request from peer e5256d91808b47c195bc9b4dbd7f2b87 for earlier term 10. Current term is 11. Ops: []
I20260709 13:06:06.191849 20112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "775c229504194560ba9589bc2199b089" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076"
I20260709 13:06:06.187933 23605 consensus_queue.cc:260] T 14efcc79969f41babe5529c22d59156d P e5256d91808b47c195bc9b4dbd7f2b87 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:06.196026 19478 raft_consensus.cc:1240] T 28af091831594f9d8e96482078cc7625 P 0473d2b2d01f4459b1e90fd12cc7840e [term 12 FOLLOWER]: Rejecting Update request from peer e61c3a8f61bb48f8a963c9480e53c168 for earlier term 11. Current term is 12. Ops: [11.6-11.6]
I20260709 13:06:06.179426 19377 leader_election.cc:403] T 179fd671030940b4b4a4e24bcc4aba0a P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 10 election: Cancelling election due to peer responding with higher term
I20260709 13:06:06.198288 19482 raft_consensus.cc:2468] T 2725d2c4cb054f18b0fc8f735c15f6c2 P 0473d2b2d01f4459b1e90fd12cc7840e [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 13.
W20260709 13:06:06.201344 19450 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.3:36891, user_credentials={real_user=slave}} blocked reactor thread for 228357us
I20260709 13:06:06.240175 19559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "217b5fae677b4971b3bbd2f357a1f7ff" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:06:06.241421 19551 raft_consensus.cc:2468] T fa731b585f684a7fb2d106c50f143b83 P e61c3a8f61bb48f8a963c9480e53c168 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 127766fc592545a4997f7790f50f6076 in term 10.
I20260709 13:06:06.242601 19558 raft_consensus.cc:1240] T fa731b585f684a7fb2d106c50f143b83 P e61c3a8f61bb48f8a963c9480e53c168 [term 10 FOLLOWER]: Rejecting Update request from peer e5256d91808b47c195bc9b4dbd7f2b87 for earlier term 9. Current term is 10. Ops: []
I20260709 13:06:06.239357 19554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70797e5783b5454ab0d0eea663e791e3" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:06:06.256120 19560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ece3db938bc649d4a40a51522ed5259c" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:06:06.257405 19478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc225c93219c45538b53a1bd3d387e4d" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
W20260709 13:06:06.259266 19374 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.4:43121, user_credentials={real_user=slave}} blocked reactor thread for 66382.1us
I20260709 13:06:06.241382 19305 catalog_manager.cc:5697] T 6c5eebf646ad445a9d1b1adc319d7b16 P 127766fc592545a4997f7790f50f6076 reported cstate change: term changed from 4 to 6, leader changed from 127766fc592545a4997f7790f50f6076 (127.17.223.4) to e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3). New cstate: current_term: 6 leader_uuid: "e61c3a8f61bb48f8a963c9480e53c168" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } } }
I20260709 13:06:06.266072 20112 raft_consensus.cc:2468] T 775c229504194560ba9589bc2199b089 P 127766fc592545a4997f7790f50f6076 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 9.
I20260709 13:06:06.249795 19556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff75a1d4cb1f493db8f71ddc136ba9ab" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:06:06.271811 19557 raft_consensus.cc:1275] T ece3db938bc649d4a40a51522ed5259c P e61c3a8f61bb48f8a963c9480e53c168 [term 10 FOLLOWER]: Refusing update from remote peer e5256d91808b47c195bc9b4dbd7f2b87: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 13:06:06.258106 23587 raft_consensus.cc:2749] T 21e14947d70440f19044d8f75c31e1f9 P e5256d91808b47c195bc9b4dbd7f2b87 [term 11 FOLLOWER]: Leader election lost for term 10. Reason: Vote denied by peer e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891) with higher term. Message: Invalid argument: T 21e14947d70440f19044d8f75c31e1f9 P e61c3a8f61bb48f8a963c9480e53c168 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate e5256d91808b47c195bc9b4dbd7f2b87 for earlier term 10. Current term is 11.
I20260709 13:06:06.276984 19554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a16f7501e2444fb86d4e2778e734e02" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 13 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:06:06.286201 23660 leader_election.cc:290] T 9962423cb4e54fcfa5de01daf68a86e7 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:06:06.286010 23638 consensus_queue.cc:1048] T 1f85fc4b527a48848e5faa083b604e36 P 127766fc592545a4997f7790f50f6076 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
W20260709 13:06:06.287479 19377 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.2:46257, user_credentials={real_user=slave}} blocked reactor thread for 108745us
I20260709 13:06:06.289109 23549 raft_consensus.cc:3060] T 179fd671030940b4b4a4e24bcc4aba0a P e5256d91808b47c195bc9b4dbd7f2b87 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:06:06.282661 23378 consensus_queue.cc:1048] T 7be9efa6559648dbb5a0f7684c4542d1 P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.010s
I20260709 13:06:06.293570 23587 consensus_queue.cc:1059] T bc225c93219c45538b53a1bd3d387e4d P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:06:06.251806 23443 consensus_queue.cc:1059] T 65d8cb8d6ec64f459d5a47cefab10acf P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 }, Status: INVALID_TERM, Last received: 8.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.051s
W20260709 13:06:06.300038 20076 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:06.299649 19483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df751f992649444090e27965eb1af85d" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 14 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:06:06.304358 23634 consensus_queue.cc:1048] T 4af19371ea874c09a0a2147040835cbb P 127766fc592545a4997f7790f50f6076 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.030s
I20260709 13:06:06.306173 19484 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "62c6c134d3d24a1ab144dd9ee6bc3f64"
dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
mode: GRACEFUL
new_leader_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
 from {username='slave'} at 127.0.0.1:48168
I20260709 13:06:06.307070 19484 raft_consensus.cc:606] T 62c6c134d3d24a1ab144dd9ee6bc3f64 P 0473d2b2d01f4459b1e90fd12cc7840e [term 10 FOLLOWER]: Received request to transfer leadership to TS e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:06:06.307582 19484 raft_consensus.cc:614] T 62c6c134d3d24a1ab144dd9ee6bc3f64 P 0473d2b2d01f4459b1e90fd12cc7840e [term 10 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:06:06.307003 23622 raft_consensus.cc:2955] T 7be9efa6559648dbb5a0f7684c4542d1 P 0473d2b2d01f4459b1e90fd12cc7840e [term 11 LEADER]: Committing config change with OpId 7.6: config changed from index 4 to 6, 127766fc592545a4997f7790f50f6076 (127.17.223.4) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } attrs { replace: true } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } } }
I20260709 13:06:06.304536 23663 consensus_queue.cc:1048] T b9f0d59553ad444883fcf5b5909f9798 P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:06:06.311178 19450 leader_election.cc:304] T 2e36a9d6e29c4a7c860cf267efbd4c74 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e; no voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:06:06.326073 23665 raft_consensus.cc:493] T 2b74109013a140ada21feeef92d6f563 P e61c3a8f61bb48f8a963c9480e53c168 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:06.326614 23505 raft_consensus.cc:493] T 65d8cb8d6ec64f459d5a47cefab10acf P e61c3a8f61bb48f8a963c9480e53c168 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:06.326799 23665 raft_consensus.cc:515] T 2b74109013a140ada21feeef92d6f563 P e61c3a8f61bb48f8a963c9480e53c168 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:06.327231 23505 raft_consensus.cc:515] T 65d8cb8d6ec64f459d5a47cefab10acf P e61c3a8f61bb48f8a963c9480e53c168 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:06.328182 23486 raft_consensus.cc:493] T ef32ce6fdd0e40d382c79974f30295c6 P e61c3a8f61bb48f8a963c9480e53c168 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:06.328814 23486 raft_consensus.cc:515] T ef32ce6fdd0e40d382c79974f30295c6 P e61c3a8f61bb48f8a963c9480e53c168 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:06.331156 23670 raft_consensus.cc:3055] T bc225c93219c45538b53a1bd3d387e4d P e5256d91808b47c195bc9b4dbd7f2b87 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:06:06.331674 23670 raft_consensus.cc:740] T bc225c93219c45538b53a1bd3d387e4d P e5256d91808b47c195bc9b4dbd7f2b87 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: e5256d91808b47c195bc9b4dbd7f2b87, State: Running, Role: LEADER
I20260709 13:06:06.332319 19478 raft_consensus.cc:1275] T 3e1f505cb0f1427bbd698ac889d80821 P 0473d2b2d01f4459b1e90fd12cc7840e [term 11 FOLLOWER]: Refusing update from remote peer e61c3a8f61bb48f8a963c9480e53c168: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:06:06.332605 23670 consensus_queue.cc:260] T bc225c93219c45538b53a1bd3d387e4d P e5256d91808b47c195bc9b4dbd7f2b87 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:06.331173 19557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65d8cb8d6ec64f459d5a47cefab10acf" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:06:06.339073 19557 raft_consensus.cc:2393] T 65d8cb8d6ec64f459d5a47cefab10acf P e61c3a8f61bb48f8a963c9480e53c168 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 127766fc592545a4997f7790f50f6076 in current term 9: Already voted for candidate e61c3a8f61bb48f8a963c9480e53c168 in this term.
I20260709 13:06:06.318292 23660 raft_consensus.cc:2749] T 2e36a9d6e29c4a7c860cf267efbd4c74 P 0473d2b2d01f4459b1e90fd12cc7840e [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:06:06.334511 23670 raft_consensus.cc:3060] T bc225c93219c45538b53a1bd3d387e4d P e5256d91808b47c195bc9b4dbd7f2b87 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:06:06.346903 23680 log.cc:927] Time spent T 62c6c134d3d24a1ab144dd9ee6bc3f64 P 0473d2b2d01f4459b1e90fd12cc7840e: Append to log took a long time: real 0.050s	user 0.000s	sys 0.001s
I20260709 13:06:06.345736 23585 raft_consensus.cc:493] T 2b74109013a140ada21feeef92d6f563 P e5256d91808b47c195bc9b4dbd7f2b87 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader e61c3a8f61bb48f8a963c9480e53c168)
I20260709 13:06:06.348116 23585 raft_consensus.cc:515] T 2b74109013a140ada21feeef92d6f563 P e5256d91808b47c195bc9b4dbd7f2b87 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:06.350836 19449 leader_election.cc:304] T 14efcc79969f41babe5529c22d59156d P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e; no voters: 127766fc592545a4997f7790f50f6076, e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:06:06.350893 23585 leader_election.cc:290] T 2b74109013a140ada21feeef92d6f563 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:06:06.316103 23440 consensus_queue.cc:1048] T ece3db938bc649d4a40a51522ed5259c P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.027s
W20260709 13:06:06.355245 19450 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.3:36891, user_credentials={real_user=slave}} blocked reactor thread for 70030.2us
W20260709 13:06:06.343227 23214 consensus_meta.cc:287] T 1efebf73c86e432baa55533136b6e12c P e61c3a8f61bb48f8a963c9480e53c168: Time spent flushing consensus metadata: real 0.516s	user 0.012s	sys 0.003s
I20260709 13:06:06.361891 23585 raft_consensus.cc:493] T 70797e5783b5454ab0d0eea663e791e3 P e5256d91808b47c195bc9b4dbd7f2b87 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader e61c3a8f61bb48f8a963c9480e53c168)
I20260709 13:06:06.358418 19558 raft_consensus.cc:1275] T 4af19371ea874c09a0a2147040835cbb P e61c3a8f61bb48f8a963c9480e53c168 [term 8 FOLLOWER]: Refusing update from remote peer 127766fc592545a4997f7790f50f6076: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:06:06.358405 23665 leader_election.cc:290] T 2b74109013a140ada21feeef92d6f563 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:06:06.363229 23605 raft_consensus.cc:3060] T 14efcc79969f41babe5529c22d59156d P e5256d91808b47c195bc9b4dbd7f2b87 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:06:06.391135 23585 raft_consensus.cc:515] T 70797e5783b5454ab0d0eea663e791e3 P e5256d91808b47c195bc9b4dbd7f2b87 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:06.362846 23214 raft_consensus.cc:515] T 1efebf73c86e432baa55533136b6e12c P e61c3a8f61bb48f8a963c9480e53c168 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:06.402380 19405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc225c93219c45538b53a1bd3d387e4d" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
I20260709 13:06:06.410634 19450 leader_election.cc:304] T 46c5bfeecc314717bffe987e6844b6d0 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e; no voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:06:06.408463 23486 leader_election.cc:290] T ef32ce6fdd0e40d382c79974f30295c6 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:06:06.417582 23538 raft_consensus.cc:2749] T 14efcc79969f41babe5529c22d59156d P 0473d2b2d01f4459b1e90fd12cc7840e [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:06:06.418229 19411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28af091831594f9d8e96482078cc7625" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
I20260709 13:06:06.410038 23619 raft_consensus.cc:493] T 76cb037fc9064d13b59a8969d897ce8c P e5256d91808b47c195bc9b4dbd7f2b87 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:06.429445 19411 raft_consensus.cc:3060] T 28af091831594f9d8e96482078cc7625 P e5256d91808b47c195bc9b4dbd7f2b87 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:06:06.429481 19375 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.3:36891, user_credentials={real_user=slave}} blocked reactor thread for 134372us
I20260709 13:06:06.403860 23465 raft_consensus.cc:493] T 7f575b143b844aa096b50997dad3516a P e5256d91808b47c195bc9b4dbd7f2b87 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader e61c3a8f61bb48f8a963c9480e53c168)
I20260709 13:06:06.442258 19558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b74109013a140ada21feeef92d6f563" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:06:06.440567 23505 leader_election.cc:290] T 65d8cb8d6ec64f459d5a47cefab10acf P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:06:06.431495 23486 raft_consensus.cc:493] T ab43d85f64114d4ebf618930e43d9ed0 P e61c3a8f61bb48f8a963c9480e53c168 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:06.442894 19558 raft_consensus.cc:2468] T 2b74109013a140ada21feeef92d6f563 P e61c3a8f61bb48f8a963c9480e53c168 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 7.
I20260709 13:06:06.430387 23660 raft_consensus.cc:2749] T 46c5bfeecc314717bffe987e6844b6d0 P 0473d2b2d01f4459b1e90fd12cc7840e [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:06:06.450075 19526 leader_election.cc:400] T f93ee515a9c14139bf566522ed8232f3 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 14 election: Vote denied by peer 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257) with higher term. Message: Invalid argument: T f93ee515a9c14139bf566522ed8232f3 P 0473d2b2d01f4459b1e90fd12cc7840e [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate e61c3a8f61bb48f8a963c9480e53c168 for earlier term 14. Current term is 15.
I20260709 13:06:06.450591 19526 leader_election.cc:403] T f93ee515a9c14139bf566522ed8232f3 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 14 election: Cancelling election due to peer responding with higher term
I20260709 13:06:06.451789 23214 leader_election.cc:290] T 1efebf73c86e432baa55533136b6e12c P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 11 election: Requested vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:06:06.452142 19410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cdf56e38bbc453d9438d359e5a69955" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:06:06.452699 19404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e381f1d6b8184797ad142de49be225a8" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:06:06.452862 19410 raft_consensus.cc:2468] T 0cdf56e38bbc453d9438d359e5a69955 P e5256d91808b47c195bc9b4dbd7f2b87 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 12.
I20260709 13:06:06.453841 20109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c5eebf646ad445a9d1b1adc319d7b16" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076"
I20260709 13:06:06.454743 20109 raft_consensus.cc:2393] T 6c5eebf646ad445a9d1b1adc319d7b16 P 127766fc592545a4997f7790f50f6076 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 0473d2b2d01f4459b1e90fd12cc7840e in current term 9: Already voted for candidate 127766fc592545a4997f7790f50f6076 in this term.
I20260709 13:06:06.455894 20076 leader_election.cc:304] T 0afb57ae58a24a01850491d69f0213dd P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 127766fc592545a4997f7790f50f6076; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:06:06.457464 20076 leader_election.cc:304] T 833a2f0775ed407a94b8924ce50adb63 P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 127766fc592545a4997f7790f50f6076, e61c3a8f61bb48f8a963c9480e53c168; no voters: e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:06:06.439623 23619 raft_consensus.cc:515] T 76cb037fc9064d13b59a8969d897ce8c P e5256d91808b47c195bc9b4dbd7f2b87 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:06.460683 23619 leader_election.cc:290] T 76cb037fc9064d13b59a8969d897ce8c P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:06:06.461390 20112 raft_consensus.cc:1240] T fa731b585f684a7fb2d106c50f143b83 P 127766fc592545a4997f7790f50f6076 [term 10 FOLLOWER]: Rejecting Update request from peer e5256d91808b47c195bc9b4dbd7f2b87 for earlier term 9. Current term is 10. Ops: []
I20260709 13:06:06.463027 23554 raft_consensus.cc:2749] T 0afb57ae58a24a01850491d69f0213dd P 127766fc592545a4997f7790f50f6076 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:06:06.463778 23554 raft_consensus.cc:2804] T 833a2f0775ed407a94b8924ce50adb63 P 127766fc592545a4997f7790f50f6076 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:06:06.464135 23554 raft_consensus.cc:493] T 833a2f0775ed407a94b8924ce50adb63 P 127766fc592545a4997f7790f50f6076 [term 9 FOLLOWER]: Starting leader election (detected failure of leader e5256d91808b47c195bc9b4dbd7f2b87)
I20260709 13:06:06.464593 23554 raft_consensus.cc:3060] T 833a2f0775ed407a94b8924ce50adb63 P 127766fc592545a4997f7790f50f6076 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:06:06.467238 19406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edd7d470b5014c9489be7f41f64355c9" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 12 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:06:06.467715 20076 leader_election.cc:304] T 7be9efa6559648dbb5a0f7684c4542d1 P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 127766fc592545a4997f7790f50f6076, e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168; no voters: 0473d2b2d01f4459b1e90fd12cc7840e
I20260709 13:06:06.468472 19408 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a08760e15aac4630a629431f56024dc8"
dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
mode: GRACEFUL
new_leader_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
 from {username='slave'} at 127.0.0.1:37312
I20260709 13:06:06.469164 19408 raft_consensus.cc:606] T a08760e15aac4630a629431f56024dc8 P e5256d91808b47c195bc9b4dbd7f2b87 [term 13 FOLLOWER]: Received request to transfer leadership to TS 0473d2b2d01f4459b1e90fd12cc7840e
W20260709 13:06:06.456027 19450 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.3:36891, user_credentials={real_user=slave}} blocked reactor thread for 61804.8us
I20260709 13:06:06.469573 19408 raft_consensus.cc:614] T a08760e15aac4630a629431f56024dc8 P e5256d91808b47c195bc9b4dbd7f2b87 [term 13 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:06:06.470077 19450 leader_election.cc:304] T f1b10566f45d4a7d9029858330e02d5b P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e; no voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:06:06.472977 19450 leader_election.cc:304] T 179fd671030940b4b4a4e24bcc4aba0a P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e; no voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168
W20260709 13:06:06.475186 23679 log.cc:927] Time spent T 14935b3ddf914369822e4a0547aaa355 P e5256d91808b47c195bc9b4dbd7f2b87: Append to log took a long time: real 0.217s	user 0.004s	sys 0.001s
I20260709 13:06:06.475687 23663 raft_consensus.cc:2749] T f1b10566f45d4a7d9029858330e02d5b P 0473d2b2d01f4459b1e90fd12cc7840e [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:06:06.476531 23663 raft_consensus.cc:2749] T 179fd671030940b4b4a4e24bcc4aba0a P 0473d2b2d01f4459b1e90fd12cc7840e [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
W20260709 13:06:06.446583 23609 consensus_meta.cc:287] T ff9b0eddd810459b82d91c60777c10eb P e5256d91808b47c195bc9b4dbd7f2b87: Time spent flushing consensus metadata: real 0.638s	user 0.010s	sys 0.007s
I20260709 13:06:06.479007 23685 raft_consensus.cc:493] T 3e1f505cb0f1427bbd698ac889d80821 P e5256d91808b47c195bc9b4dbd7f2b87 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:06.479533 19409 raft_consensus.cc:2410] T ff9b0eddd810459b82d91c60777c10eb P e5256d91808b47c195bc9b4dbd7f2b87 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 127766fc592545a4997f7790f50f6076 for term 11 because replica has last-logged OpId of term: 10 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 8.
I20260709 13:06:06.479636 23685 raft_consensus.cc:515] T 3e1f505cb0f1427bbd698ac889d80821 P e5256d91808b47c195bc9b4dbd7f2b87 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:06.449723 23465 raft_consensus.cc:515] T 7f575b143b844aa096b50997dad3516a P e5256d91808b47c195bc9b4dbd7f2b87 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:06.481457 23214 consensus_queue.cc:1048] T 0cdf56e38bbc453d9438d359e5a69955 P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:06:06.483701 19523 leader_election.cc:304] T ece3db938bc649d4a40a51522ed5259c P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e61c3a8f61bb48f8a963c9480e53c168; no voters: 127766fc592545a4997f7790f50f6076, e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:06:06.440245 19374 leader_election.cc:304] T 775c229504194560ba9589bc2199b089 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 127766fc592545a4997f7790f50f6076, e5256d91808b47c195bc9b4dbd7f2b87; no voters: 
I20260709 13:06:06.452890 20110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9962423cb4e54fcfa5de01daf68a86e7" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:06:06.524631 19523 leader_election.cc:304] T 85c494af21f9457a85da47b9bc70c1fd P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e61c3a8f61bb48f8a963c9480e53c168; no voters: 127766fc592545a4997f7790f50f6076, e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:06:06.531515 19402 raft_consensus.cc:1275] T 76cb037fc9064d13b59a8969d897ce8c P e5256d91808b47c195bc9b4dbd7f2b87 [term 10 FOLLOWER]: Refusing update from remote peer e61c3a8f61bb48f8a963c9480e53c168: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:06:06.533092 20076 leader_election.cc:304] T fa731b585f684a7fb2d106c50f143b83 P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 127766fc592545a4997f7790f50f6076, e61c3a8f61bb48f8a963c9480e53c168; no voters: e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:06:06.531648 20104 raft_consensus.cc:1240] T 6c5eebf646ad445a9d1b1adc319d7b16 P 127766fc592545a4997f7790f50f6076 [term 9 FOLLOWER]: Rejecting Update request from peer e61c3a8f61bb48f8a963c9480e53c168 for earlier term 8. Current term is 9. Ops: []
I20260709 13:06:06.532234 19406 raft_consensus.cc:2955] T 7be9efa6559648dbb5a0f7684c4542d1 P e5256d91808b47c195bc9b4dbd7f2b87 [term 11 FOLLOWER]: Committing config change with OpId 7.6: config changed from index 4 to 6, 127766fc592545a4997f7790f50f6076 (127.17.223.4) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } attrs { replace: true } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } } }
I20260709 13:06:06.523622 23547 raft_consensus.cc:2749] T ece3db938bc649d4a40a51522ed5259c P e61c3a8f61bb48f8a963c9480e53c168 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:06:06.498178 23534 raft_consensus.cc:2804] T 7be9efa6559648dbb5a0f7684c4542d1 P 127766fc592545a4997f7790f50f6076 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:06:06.534498 23534 raft_consensus.cc:493] T 7be9efa6559648dbb5a0f7684c4542d1 P 127766fc592545a4997f7790f50f6076 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 0473d2b2d01f4459b1e90fd12cc7840e)
I20260709 13:06:06.534922 23534 raft_consensus.cc:3060] T 7be9efa6559648dbb5a0f7684c4542d1 P 127766fc592545a4997f7790f50f6076 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:06:06.543016 19408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9962423cb4e54fcfa5de01daf68a86e7" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:06:06.547314 23585 leader_election.cc:290] T 70797e5783b5454ab0d0eea663e791e3 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:06:06.553112 19410 raft_consensus.cc:1275] T 3e1f505cb0f1427bbd698ac889d80821 P e5256d91808b47c195bc9b4dbd7f2b87 [term 11 FOLLOWER]: Refusing update from remote peer e61c3a8f61bb48f8a963c9480e53c168: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:06:06.557444 23414 raft_consensus.cc:493] T 2b74109013a140ada21feeef92d6f563 P 0473d2b2d01f4459b1e90fd12cc7840e [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:06.558007 23414 raft_consensus.cc:515] T 2b74109013a140ada21feeef92d6f563 P 0473d2b2d01f4459b1e90fd12cc7840e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:06.560329 23414 leader_election.cc:290] T 2b74109013a140ada21feeef92d6f563 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
W20260709 13:06:06.564033 19450 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.3:36891, user_credentials={real_user=slave}} blocked reactor thread for 91208.3us
W20260709 13:06:06.567158 19525 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:06.572414 23665 raft_consensus.cc:2749] T f93ee515a9c14139bf566522ed8232f3 P e61c3a8f61bb48f8a963c9480e53c168 [term 15 FOLLOWER]: Leader election lost for term 14. Reason: Vote denied by peer 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257) with higher term. Message: Invalid argument: T f93ee515a9c14139bf566522ed8232f3 P 0473d2b2d01f4459b1e90fd12cc7840e [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate e61c3a8f61bb48f8a963c9480e53c168 for earlier term 14. Current term is 15.
I20260709 13:06:06.458474 23672 raft_consensus.cc:515] T 48824d5acfbc485ebf8c2d944e7202de P e61c3a8f61bb48f8a963c9480e53c168 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:06.576642 23547 raft_consensus.cc:2749] T 85c494af21f9457a85da47b9bc70c1fd P e61c3a8f61bb48f8a963c9480e53c168 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:06:06.578020 19526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.2:46257, user_credentials={real_user=slave}} blocked reactor thread for 147330us
W20260709 13:06:06.579963 19526 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:06.578192 19553 raft_consensus.cc:2368] T 48824d5acfbc485ebf8c2d944e7202de P e61c3a8f61bb48f8a963c9480e53c168 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 127766fc592545a4997f7790f50f6076 for earlier term 11. Current term is 12.
I20260709 13:06:06.581835 23486 raft_consensus.cc:515] T ab43d85f64114d4ebf618930e43d9ed0 P e61c3a8f61bb48f8a963c9480e53c168 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } attrs { replace: true } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:06.568068 23638 raft_consensus.cc:493] T 172b3dd13109415a955b71ac0e9d2234 P 127766fc592545a4997f7790f50f6076 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:06.583307 23638 raft_consensus.cc:515] T 172b3dd13109415a955b71ac0e9d2234 P 127766fc592545a4997f7790f50f6076 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:06.585592 23638 leader_election.cc:290] T 172b3dd13109415a955b71ac0e9d2234 P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:06:06.585254 23486 leader_election.cc:290] T ab43d85f64114d4ebf618930e43d9ed0 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:06:06.505612 23634 consensus_queue.cc:1048] T 14935b3ddf914369822e4a0547aaa355 P 127766fc592545a4997f7790f50f6076 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.093s
I20260709 13:06:06.613255 23672 leader_election.cc:290] T 48824d5acfbc485ebf8c2d944e7202de P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 12 election: Requested vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:06:06.614961 23505 consensus_queue.cc:1048] T 76cb037fc9064d13b59a8969d897ce8c P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.008s
I20260709 13:06:06.623741 23634 raft_consensus.cc:2804] T fa731b585f684a7fb2d106c50f143b83 P 127766fc592545a4997f7790f50f6076 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:06:06.624435 23634 raft_consensus.cc:697] T fa731b585f684a7fb2d106c50f143b83 P 127766fc592545a4997f7790f50f6076 [term 10 LEADER]: Becoming Leader. State: Replica: 127766fc592545a4997f7790f50f6076, State: Running, Role: LEADER
I20260709 13:06:06.624596 23534 raft_consensus.cc:515] T 7be9efa6559648dbb5a0f7684c4542d1 P 127766fc592545a4997f7790f50f6076 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } attrs { replace: true } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:06.625857 23492 raft_consensus.cc:493] T ab43d85f64114d4ebf618930e43d9ed0 P 127766fc592545a4997f7790f50f6076 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:06.625506 23634 consensus_queue.cc:237] T fa731b585f684a7fb2d106c50f143b83 P 127766fc592545a4997f7790f50f6076 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:06.591403 23465 leader_election.cc:290] T 7f575b143b844aa096b50997dad3516a P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:06:06.610405 19450 leader_election.cc:304] T 1efebf73c86e432baa55533136b6e12c P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168; no voters: 127766fc592545a4997f7790f50f6076
I20260709 13:06:06.626472 23492 raft_consensus.cc:515] T ab43d85f64114d4ebf618930e43d9ed0 P 127766fc592545a4997f7790f50f6076 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } attrs { replace: true } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:06.629274 23414 raft_consensus.cc:2804] T 1efebf73c86e432baa55533136b6e12c P 0473d2b2d01f4459b1e90fd12cc7840e [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:06:06.629658 23414 raft_consensus.cc:493] T 1efebf73c86e432baa55533136b6e12c P 0473d2b2d01f4459b1e90fd12cc7840e [term 9 FOLLOWER]: Starting leader election (detected failure of leader e61c3a8f61bb48f8a963c9480e53c168)
I20260709 13:06:06.630052 23414 raft_consensus.cc:3060] T 1efebf73c86e432baa55533136b6e12c P 0473d2b2d01f4459b1e90fd12cc7840e [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:06:06.505563 23619 raft_consensus.cc:493] T b9f0d59553ad444883fcf5b5909f9798 P e5256d91808b47c195bc9b4dbd7f2b87 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:06.632397 23619 raft_consensus.cc:515] T b9f0d59553ad444883fcf5b5909f9798 P e5256d91808b47c195bc9b4dbd7f2b87 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:06.632907 23534 leader_election.cc:290] T 7be9efa6559648dbb5a0f7684c4542d1 P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 12 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:06:06.607436 23685 leader_election.cc:290] T 3e1f505cb0f1427bbd698ac889d80821 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:06:06.609568 23554 raft_consensus.cc:515] T 833a2f0775ed407a94b8924ce50adb63 P 127766fc592545a4997f7790f50f6076 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:06.598371 19449 leader_election.cc:304] T 0cdf56e38bbc453d9438d359e5a69955 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87; no voters: 
I20260709 13:06:06.610977 19526 leader_election.cc:304] T 86a6797bdfe94fa496c050ceae4bd0d9 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e61c3a8f61bb48f8a963c9480e53c168; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87
W20260709 13:06:06.615633 20076 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.3:36891, user_credentials={real_user=slave}} blocked reactor thread for 82673.5us
I20260709 13:06:06.634438 23619 leader_election.cc:290] T b9f0d59553ad444883fcf5b5909f9798 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:06:06.562891 23549 raft_consensus.cc:2749] T 179fd671030940b4b4a4e24bcc4aba0a P e5256d91808b47c195bc9b4dbd7f2b87 [term 12 FOLLOWER]: Leader election lost for term 10. Reason: Vote denied by peer 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257) with higher term. Message: Invalid argument: T 179fd671030940b4b4a4e24bcc4aba0a P 0473d2b2d01f4459b1e90fd12cc7840e [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate e5256d91808b47c195bc9b4dbd7f2b87 for earlier term 10. Current term is 12.
I20260709 13:06:06.664872 19482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b74109013a140ada21feeef92d6f563" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:06:06.665828 19482 raft_consensus.cc:2468] T 2b74109013a140ada21feeef92d6f563 P 0473d2b2d01f4459b1e90fd12cc7840e [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 7.
I20260709 13:06:06.666883 19483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1efebf73c86e432baa55533136b6e12c" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:06:06.667160 19478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef32ce6fdd0e40d382c79974f30295c6" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:06:06.652000 23663 raft_consensus.cc:2804] T 0cdf56e38bbc453d9438d359e5a69955 P 0473d2b2d01f4459b1e90fd12cc7840e [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:06:06.672987 19478 raft_consensus.cc:2468] T ef32ce6fdd0e40d382c79974f30295c6 P 0473d2b2d01f4459b1e90fd12cc7840e [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 12.
I20260709 13:06:06.684046 20109 raft_consensus.cc:1240] T 7be9efa6559648dbb5a0f7684c4542d1 P 127766fc592545a4997f7790f50f6076 [term 12 FOLLOWER]: Rejecting Update request from peer 0473d2b2d01f4459b1e90fd12cc7840e for earlier term 11. Current term is 12. Ops: []
W20260709 13:06:06.686805 19450 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.3:36891, user_credentials={real_user=slave}} blocked reactor thread for 76537.5us
I20260709 13:06:06.693818 20076 leader_election.cc:304] T 70797e5783b5454ab0d0eea663e791e3 P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 127766fc592545a4997f7790f50f6076; no voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:06:06.685668 23672 raft_consensus.cc:2749] T 86a6797bdfe94fa496c050ceae4bd0d9 P e61c3a8f61bb48f8a963c9480e53c168 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:06:06.684943 23663 raft_consensus.cc:493] T 0cdf56e38bbc453d9438d359e5a69955 P 0473d2b2d01f4459b1e90fd12cc7840e [term 12 FOLLOWER]: Starting leader election (detected failure of leader e61c3a8f61bb48f8a963c9480e53c168)
I20260709 13:06:06.696126 23638 raft_consensus.cc:2749] T 70797e5783b5454ab0d0eea663e791e3 P 127766fc592545a4997f7790f50f6076 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:06:06.700589 23538 consensus_queue.cc:1059] T 7be9efa6559648dbb5a0f7684c4542d1 P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false }, Status: INVALID_TERM, Last received: 11.8, Next index: 9, Last known committed idx: 5, Time since last communication: 0.003s
I20260709 13:06:06.709360 23505 raft_consensus.cc:493] T 0afb57ae58a24a01850491d69f0213dd P e61c3a8f61bb48f8a963c9480e53c168 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 0473d2b2d01f4459b1e90fd12cc7840e)
I20260709 13:06:06.723587 23505 raft_consensus.cc:515] T 0afb57ae58a24a01850491d69f0213dd P e61c3a8f61bb48f8a963c9480e53c168 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:06.725778 23505 leader_election.cc:290] T 0afb57ae58a24a01850491d69f0213dd P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:06:06.714267 23414 raft_consensus.cc:515] T 1efebf73c86e432baa55533136b6e12c P 0473d2b2d01f4459b1e90fd12cc7840e [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:06.700037 23663 raft_consensus.cc:3060] T 0cdf56e38bbc453d9438d359e5a69955 P 0473d2b2d01f4459b1e90fd12cc7840e [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:06:06.729521 19483 raft_consensus.cc:3060] T 1efebf73c86e432baa55533136b6e12c P 0473d2b2d01f4459b1e90fd12cc7840e [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:06:06.732141 20076 leader_election.cc:304] T ece3db938bc649d4a40a51522ed5259c P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 127766fc592545a4997f7790f50f6076; no voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:06:06.733145 23414 leader_election.cc:290] T 1efebf73c86e432baa55533136b6e12c P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 10 election: Requested vote from peers e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:06:06.733341 20076 leader_election.cc:304] T 2a16f7501e2444fb86d4e2778e734e02 P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 127766fc592545a4997f7790f50f6076; no voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:06:06.734109 23534 raft_consensus.cc:2749] T ece3db938bc649d4a40a51522ed5259c P 127766fc592545a4997f7790f50f6076 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:06:06.734763 23534 raft_consensus.cc:2749] T 2a16f7501e2444fb86d4e2778e734e02 P 127766fc592545a4997f7790f50f6076 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:06:06.740558 19523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.1:40321, user_credentials={real_user=slave}} blocked reactor thread for 216044us
W20260709 13:06:06.745568 19374 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.4:43121, user_credentials={real_user=slave}} blocked reactor thread for 309551us
I20260709 13:06:06.745939 19405 raft_consensus.cc:2468] T bc225c93219c45538b53a1bd3d387e4d P e5256d91808b47c195bc9b4dbd7f2b87 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 11.
I20260709 13:06:06.747339 23549 raft_consensus.cc:2804] T 775c229504194560ba9589bc2199b089 P e5256d91808b47c195bc9b4dbd7f2b87 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:06:06.748301 23549 raft_consensus.cc:697] T 775c229504194560ba9589bc2199b089 P e5256d91808b47c195bc9b4dbd7f2b87 [term 9 LEADER]: Becoming Leader. State: Replica: e5256d91808b47c195bc9b4dbd7f2b87, State: Running, Role: LEADER
I20260709 13:06:06.748415 19411 raft_consensus.cc:2468] T 28af091831594f9d8e96482078cc7625 P e5256d91808b47c195bc9b4dbd7f2b87 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 12.
I20260709 13:06:06.749065 19523 leader_election.cc:304] T 4af19371ea874c09a0a2147040835cbb P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e61c3a8f61bb48f8a963c9480e53c168; no voters: 127766fc592545a4997f7790f50f6076, e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:06:06.749436 23549 consensus_queue.cc:237] T 775c229504194560ba9589bc2199b089 P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:06.750910 23672 raft_consensus.cc:2749] T 4af19371ea874c09a0a2147040835cbb P e61c3a8f61bb48f8a963c9480e53c168 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
W20260709 13:06:06.752396 19374 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:06.715497 19526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.2:46257, user_credentials={real_user=slave}} blocked reactor thread for 104628us
I20260709 13:06:06.695847 23378 raft_consensus.cc:493] T 4509b76741dc428e9201c70c1658da13 P 0473d2b2d01f4459b1e90fd12cc7840e [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:06.755496 19483 raft_consensus.cc:2468] T 1efebf73c86e432baa55533136b6e12c P 0473d2b2d01f4459b1e90fd12cc7840e [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 11.
I20260709 13:06:06.755584 23672 consensus_queue.cc:1048] T 28af091831594f9d8e96482078cc7625 P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:06:06.756022 23378 raft_consensus.cc:515] T 4509b76741dc428e9201c70c1658da13 P 0473d2b2d01f4459b1e90fd12cc7840e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:06.721524 19450 leader_election.cc:304] T 217b5fae677b4971b3bbd2f357a1f7ff P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e; no voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:06:06.766023 19526 leader_election.cc:304] T 22196caba61445d3bec98a0aab3c337d P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e61c3a8f61bb48f8a963c9480e53c168; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:06:06.770605 23378 leader_election.cc:290] T 4509b76741dc428e9201c70c1658da13 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:06:06.773967 23695 raft_consensus.cc:2749] T 22196caba61445d3bec98a0aab3c337d P e61c3a8f61bb48f8a963c9480e53c168 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:06:06.776464 23505 consensus_queue.cc:1059] T d1e5873a19244c5ebbcd38e126796ee7 P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 }, Status: INVALID_TERM, Last received: 11.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:06:06.768370 23622 raft_consensus.cc:3055] T 7be9efa6559648dbb5a0f7684c4542d1 P 0473d2b2d01f4459b1e90fd12cc7840e [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:06:06.777729 23554 leader_election.cc:290] T 833a2f0775ed407a94b8924ce50adb63 P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 10 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:06:06.777844 23622 raft_consensus.cc:740] T 7be9efa6559648dbb5a0f7684c4542d1 P 0473d2b2d01f4459b1e90fd12cc7840e [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 0473d2b2d01f4459b1e90fd12cc7840e, State: Running, Role: LEADER
I20260709 13:06:06.778208 23505 raft_consensus.cc:3055] T d1e5873a19244c5ebbcd38e126796ee7 P e61c3a8f61bb48f8a963c9480e53c168 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:06:06.784874 19411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7be9efa6559648dbb5a0f7684c4542d1" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
W20260709 13:06:06.785655 19449 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.4:43121, user_credentials={real_user=slave}} blocked reactor thread for 87662us
I20260709 13:06:06.778880 23619 consensus_queue.cc:1059] T fa731b585f684a7fb2d106c50f143b83 P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false }, Status: INVALID_TERM, Last received: 9.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.010s
I20260709 13:06:06.780860 23505 raft_consensus.cc:740] T d1e5873a19244c5ebbcd38e126796ee7 P e61c3a8f61bb48f8a963c9480e53c168 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: e61c3a8f61bb48f8a963c9480e53c168, State: Running, Role: LEADER
I20260709 13:06:06.782985 23414 raft_consensus.cc:2749] T 217b5fae677b4971b3bbd2f357a1f7ff P 0473d2b2d01f4459b1e90fd12cc7840e [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:06:06.795753 20109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1efebf73c86e432baa55533136b6e12c" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076"
I20260709 13:06:06.796856 20109 raft_consensus.cc:2393] T 1efebf73c86e432baa55533136b6e12c P 127766fc592545a4997f7790f50f6076 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 0473d2b2d01f4459b1e90fd12cc7840e in current term 10: Already voted for candidate 127766fc592545a4997f7790f50f6076 in this term.
W20260709 13:06:06.797902 19450 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.3:36891, user_credentials={real_user=slave}} blocked reactor thread for 76560us
I20260709 13:06:06.798859 19450 leader_election.cc:304] T ff75a1d4cb1f493db8f71ddc136ba9ab P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e; no voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:06:06.791106 23622 consensus_queue.cc:260] T 7be9efa6559648dbb5a0f7684c4542d1 P 0473d2b2d01f4459b1e90fd12cc7840e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } attrs { replace: true } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:06.799641 19523 leader_election.cc:304] T 21e14947d70440f19044d8f75c31e1f9 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:06:06.799849 23622 raft_consensus.cc:3060] T 7be9efa6559648dbb5a0f7684c4542d1 P 0473d2b2d01f4459b1e90fd12cc7840e [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:06:06.800325 19450 leader_election.cc:304] T f93ee515a9c14139bf566522ed8232f3 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168; no voters: e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:06:06.800546 23486 raft_consensus.cc:2804] T 21e14947d70440f19044d8f75c31e1f9 P e61c3a8f61bb48f8a963c9480e53c168 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:06:06.801083 23486 raft_consensus.cc:697] T 21e14947d70440f19044d8f75c31e1f9 P e61c3a8f61bb48f8a963c9480e53c168 [term 11 LEADER]: Becoming Leader. State: Replica: e61c3a8f61bb48f8a963c9480e53c168, State: Running, Role: LEADER
W20260709 13:06:06.803344 19449 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:06.804208 20105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70797e5783b5454ab0d0eea663e791e3" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:06:06.804535 23505 consensus_queue.cc:260] T d1e5873a19244c5ebbcd38e126796ee7 P e61c3a8f61bb48f8a963c9480e53c168 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:06.805778 23505 raft_consensus.cc:3060] T d1e5873a19244c5ebbcd38e126796ee7 P e61c3a8f61bb48f8a963c9480e53c168 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:06:06.809346 23378 raft_consensus.cc:2804] T f93ee515a9c14139bf566522ed8232f3 P 0473d2b2d01f4459b1e90fd12cc7840e [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:06:06.809899 23378 raft_consensus.cc:697] T f93ee515a9c14139bf566522ed8232f3 P 0473d2b2d01f4459b1e90fd12cc7840e [term 15 LEADER]: Becoming Leader. State: Replica: 0473d2b2d01f4459b1e90fd12cc7840e, State: Running, Role: LEADER
I20260709 13:06:06.810832 23378 consensus_queue.cc:237] T f93ee515a9c14139bf566522ed8232f3 P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 13.6, Last appended by leader: 6, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:06.812218 19553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21e14947d70440f19044d8f75c31e1f9" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:06:06.812127 23695 consensus_queue.cc:1048] T f1b10566f45d4a7d9029858330e02d5b P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:06:06.813956 19449 leader_election.cc:304] T 9962423cb4e54fcfa5de01daf68a86e7 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e; no voters: 127766fc592545a4997f7790f50f6076, e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:06:06.802248 23486 consensus_queue.cc:237] T 21e14947d70440f19044d8f75c31e1f9 P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:06.817860 23414 raft_consensus.cc:2749] T ff75a1d4cb1f493db8f71ddc136ba9ab P 0473d2b2d01f4459b1e90fd12cc7840e [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:06:06.818177 19557 raft_consensus.cc:1275] T ed7fdbcb96d14d418db9ca90a792588a P e61c3a8f61bb48f8a963c9480e53c168 [term 9 FOLLOWER]: Refusing update from remote peer 127766fc592545a4997f7790f50f6076: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 8. (term mismatch)
I20260709 13:06:06.840384 19557 pending_rounds.cc:85] T ed7fdbcb96d14d418db9ca90a792588a P e61c3a8f61bb48f8a963c9480e53c168: Aborting all ops after (but not including) 7
I20260709 13:06:06.840744 19557 pending_rounds.cc:107] T ed7fdbcb96d14d418db9ca90a792588a P e61c3a8f61bb48f8a963c9480e53c168: Aborting uncommitted NO_OP operation due to leader change: 8.8
I20260709 13:06:06.841142 19557 raft_consensus.cc:2889] T ed7fdbcb96d14d418db9ca90a792588a P e61c3a8f61bb48f8a963c9480e53c168 [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:06:06.818199 19558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28af091831594f9d8e96482078cc7625" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:06:06.820209 19551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7be9efa6559648dbb5a0f7684c4542d1" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:06:06.818650 23672 consensus_queue.cc:1059] T 6c5eebf646ad445a9d1b1adc319d7b16 P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:06:06.823568 19552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "833a2f0775ed407a94b8924ce50adb63" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:06:06.827291 19556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef32ce6fdd0e40d382c79974f30295c6" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:06:06.830778 23663 raft_consensus.cc:515] T 0cdf56e38bbc453d9438d359e5a69955 P 0473d2b2d01f4459b1e90fd12cc7840e [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:06.832545 19411 raft_consensus.cc:1275] T a08760e15aac4630a629431f56024dc8 P e5256d91808b47c195bc9b4dbd7f2b87 [term 13 FOLLOWER]: Refusing update from remote peer e61c3a8f61bb48f8a963c9480e53c168: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:06:06.826427 19407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b74109013a140ada21feeef92d6f563" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:06:06.840380 19559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc225c93219c45538b53a1bd3d387e4d" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:06:06.842182 19551 raft_consensus.cc:3060] T 7be9efa6559648dbb5a0f7684c4542d1 P e61c3a8f61bb48f8a963c9480e53c168 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:06:06.822000 20076 leader_election.cc:304] T 65d8cb8d6ec64f459d5a47cefab10acf P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 127766fc592545a4997f7790f50f6076; no voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:06:06.842635 20109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65d8cb8d6ec64f459d5a47cefab10acf" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:06:06.853152 19407 raft_consensus.cc:2468] T 2b74109013a140ada21feeef92d6f563 P e5256d91808b47c195bc9b4dbd7f2b87 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 6.
I20260709 13:06:06.844242 20105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1efebf73c86e432baa55533136b6e12c" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076"
W20260709 13:06:06.853838 20076 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:06.853922 20105 raft_consensus.cc:3060] T 1efebf73c86e432baa55533136b6e12c P 127766fc592545a4997f7790f50f6076 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:06:06.846081 20104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab43d85f64114d4ebf618930e43d9ed0" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 12 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:06:06.847497 20110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48824d5acfbc485ebf8c2d944e7202de" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076"
I20260709 13:06:06.848902 19409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc225c93219c45538b53a1bd3d387e4d" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
I20260709 13:06:06.849013 20112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0afb57ae58a24a01850491d69f0213dd" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:06:06.849723 19408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4509b76741dc428e9201c70c1658da13" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:06:06.851737 19556 raft_consensus.cc:2468] T ef32ce6fdd0e40d382c79974f30295c6 P e61c3a8f61bb48f8a963c9480e53c168 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 13.
I20260709 13:06:06.854976 20110 raft_consensus.cc:3060] T 48824d5acfbc485ebf8c2d944e7202de P 127766fc592545a4997f7790f50f6076 [term 10 FOLLOWER]: Advancing to term 12
I20260709 13:06:06.854704 20104 raft_consensus.cc:2468] T ab43d85f64114d4ebf618930e43d9ed0 P 127766fc592545a4997f7790f50f6076 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 11.
I20260709 13:06:06.855207 20112 raft_consensus.cc:2468] T 0afb57ae58a24a01850491d69f0213dd P 127766fc592545a4997f7790f50f6076 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 10.
I20260709 13:06:06.853494 20109 raft_consensus.cc:2468] T 65d8cb8d6ec64f459d5a47cefab10acf P 127766fc592545a4997f7790f50f6076 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 8.
I20260709 13:06:06.858566 19553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c5eebf646ad445a9d1b1adc319d7b16" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:06:06.859632 19559 raft_consensus.cc:2393] T bc225c93219c45538b53a1bd3d387e4d P e61c3a8f61bb48f8a963c9480e53c168 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 0473d2b2d01f4459b1e90fd12cc7840e in current term 11: Already voted for candidate e61c3a8f61bb48f8a963c9480e53c168 in this term.
I20260709 13:06:06.861444 19411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef32ce6fdd0e40d382c79974f30295c6" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
W20260709 13:06:06.864215 19294 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet ab43d85f64114d4ebf618930e43d9ed0 with cas_config_opid_index 5: ChangeConfig:REMOVE_PEER failed with leader e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica e61c3a8f61bb48f8a963c9480e53c168 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 11 committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } attrs { replace: true } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } } }
I20260709 13:06:06.860980 23549 consensus_queue.cc:1059] T fa731b585f684a7fb2d106c50f143b83 P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 }, Status: INVALID_TERM, Last received: 9.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.007s
I20260709 13:06:06.865965 23547 raft_consensus.cc:493] T 96efeaaf1057492490e9a621f37e1a2d P e61c3a8f61bb48f8a963c9480e53c168 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:06.866436 20076 leader_election.cc:400] T 48824d5acfbc485ebf8c2d944e7202de P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 11 pre-election: Vote denied by peer e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891) with higher term. Message: Invalid argument: T 48824d5acfbc485ebf8c2d944e7202de P e61c3a8f61bb48f8a963c9480e53c168 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 127766fc592545a4997f7790f50f6076 for earlier term 11. Current term is 12.
I20260709 13:06:06.866504 19375 leader_election.cc:304] T 2b74109013a140ada21feeef92d6f563 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:06:06.866909 20076 leader_election.cc:403] T 48824d5acfbc485ebf8c2d944e7202de P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 11 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:06:06.872169 23698 raft_consensus.cc:2749] T 9962423cb4e54fcfa5de01daf68a86e7 P 0473d2b2d01f4459b1e90fd12cc7840e [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:06:06.873631 19553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f575b143b844aa096b50997dad3516a" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:06:06.873647 20110 raft_consensus.cc:2468] T 48824d5acfbc485ebf8c2d944e7202de P 127766fc592545a4997f7790f50f6076 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 12.
I20260709 13:06:06.858525 23554 raft_consensus.cc:3060] T 65d8cb8d6ec64f459d5a47cefab10acf P 127766fc592545a4997f7790f50f6076 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:06:06.880254 19408 raft_consensus.cc:2468] T 4509b76741dc428e9201c70c1658da13 P e5256d91808b47c195bc9b4dbd7f2b87 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 4.
I20260709 13:06:06.881700 19407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df751f992649444090e27965eb1af85d" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 14 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:06:06.883978 19411 raft_consensus.cc:2468] T ef32ce6fdd0e40d382c79974f30295c6 P e5256d91808b47c195bc9b4dbd7f2b87 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 13.
I20260709 13:06:06.888370 19552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9f0d59553ad444883fcf5b5909f9798" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:06:06.887043 19559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70797e5783b5454ab0d0eea663e791e3" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:06:06.902282 19557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cdf56e38bbc453d9438d359e5a69955" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:06:06.860671 23624 consensus_queue.cc:1048] T 4af19371ea874c09a0a2147040835cbb P 127766fc592545a4997f7790f50f6076 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.013s
I20260709 13:06:06.870971 23685 raft_consensus.cc:2804] T 2b74109013a140ada21feeef92d6f563 P e5256d91808b47c195bc9b4dbd7f2b87 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:06:06.909148 19556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76cb037fc9064d13b59a8969d897ce8c" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:06:06.910413 19558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e1f505cb0f1427bbd698ac889d80821" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
W20260709 13:06:06.912679 20076 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.3:36891, user_credentials={real_user=slave}} blocked reactor thread for 46393.7us
I20260709 13:06:06.916195 19408 raft_consensus.cc:1275] T 217b5fae677b4971b3bbd2f357a1f7ff P e5256d91808b47c195bc9b4dbd7f2b87 [term 8 FOLLOWER]: Refusing update from remote peer e61c3a8f61bb48f8a963c9480e53c168: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 13:06:06.907503 19552 raft_consensus.cc:2468] T b9f0d59553ad444883fcf5b5909f9798 P e61c3a8f61bb48f8a963c9480e53c168 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 11.
I20260709 13:06:06.899400 23698 raft_consensus.cc:493] T 172b3dd13109415a955b71ac0e9d2234 P 0473d2b2d01f4459b1e90fd12cc7840e [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:06.923372 23708 raft_consensus.cc:2749] T 48824d5acfbc485ebf8c2d944e7202de P 127766fc592545a4997f7790f50f6076 [term 12 FOLLOWER]: Leader pre-election lost for term 11. Reason: Vote denied by peer e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891) with higher term. Message: Invalid argument: T 48824d5acfbc485ebf8c2d944e7202de P e61c3a8f61bb48f8a963c9480e53c168 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 127766fc592545a4997f7790f50f6076 for earlier term 11. Current term is 12.
I20260709 13:06:06.925416 19409 raft_consensus.cc:1240] T d1e5873a19244c5ebbcd38e126796ee7 P e5256d91808b47c195bc9b4dbd7f2b87 [term 12 FOLLOWER]: Rejecting Update request from peer e61c3a8f61bb48f8a963c9480e53c168 for earlier term 11. Current term is 12. Ops: []
W20260709 13:06:06.928223 19526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.2:46257, user_credentials={real_user=slave}} blocked reactor thread for 72737.2us
I20260709 13:06:06.908820 23685 raft_consensus.cc:493] T 2b74109013a140ada21feeef92d6f563 P e5256d91808b47c195bc9b4dbd7f2b87 [term 6 FOLLOWER]: Starting leader election (detected failure of leader e61c3a8f61bb48f8a963c9480e53c168)
I20260709 13:06:06.866446 23547 raft_consensus.cc:515] T 96efeaaf1057492490e9a621f37e1a2d P e61c3a8f61bb48f8a963c9480e53c168 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
W20260709 13:06:06.935817 19523 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:06.936756 23706 log.cc:927] Time spent T 5ec1c4ce15e04c7e8c283a62179f2a64 P 127766fc592545a4997f7790f50f6076: Append to log took a long time: real 0.087s	user 0.001s	sys 0.000s
W20260709 13:06:06.937275 23697 log.cc:927] Time spent T 7f575b143b844aa096b50997dad3516a P e61c3a8f61bb48f8a963c9480e53c168: Append to log took a long time: real 0.078s	user 0.000s	sys 0.001s
I20260709 13:06:06.917321 23549 raft_consensus.cc:493] T 1a61655d99124a29b486ba4a5b37faea P e5256d91808b47c195bc9b4dbd7f2b87 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader e61c3a8f61bb48f8a963c9480e53c168)
I20260709 13:06:06.966396 23712 raft_consensus.cc:493] T ab43d85f64114d4ebf618930e43d9ed0 P 0473d2b2d01f4459b1e90fd12cc7840e [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:06.966915 23712 raft_consensus.cc:515] T ab43d85f64114d4ebf618930e43d9ed0 P 0473d2b2d01f4459b1e90fd12cc7840e [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } attrs { replace: true } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:06.969106 23712 leader_election.cc:290] T ab43d85f64114d4ebf618930e43d9ed0 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:06:06.969596 23712 raft_consensus.cc:493] T 3e1f505cb0f1427bbd698ac889d80821 P 0473d2b2d01f4459b1e90fd12cc7840e [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:06.970175 23712 raft_consensus.cc:515] T 3e1f505cb0f1427bbd698ac889d80821 P 0473d2b2d01f4459b1e90fd12cc7840e [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:06.963254 23714 raft_consensus.cc:493] T 14935b3ddf914369822e4a0547aaa355 P 0473d2b2d01f4459b1e90fd12cc7840e [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:06.963505 19551 raft_consensus.cc:2468] T 7be9efa6559648dbb5a0f7684c4542d1 P e61c3a8f61bb48f8a963c9480e53c168 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 127766fc592545a4997f7790f50f6076 in term 12.
I20260709 13:06:06.973359 23378 raft_consensus.cc:493] T 1dc5b3532fe54f74876d02beffa2c230 P 0473d2b2d01f4459b1e90fd12cc7840e [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:06.974184 23378 raft_consensus.cc:515] T 1dc5b3532fe54f74876d02beffa2c230 P 0473d2b2d01f4459b1e90fd12cc7840e [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
W20260709 13:06:06.975931 23699 log.cc:927] Time spent T fa731b585f684a7fb2d106c50f143b83 P 127766fc592545a4997f7790f50f6076: Append to log took a long time: real 0.075s	user 0.001s	sys 0.000s
I20260709 13:06:06.982311 19558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edd7d470b5014c9489be7f41f64355c9" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 12 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:06:06.947618 23685 raft_consensus.cc:3060] T 2b74109013a140ada21feeef92d6f563 P e5256d91808b47c195bc9b4dbd7f2b87 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:06:06.931447 23695 raft_consensus.cc:493] T b08304a0a02b42d7840c4e8ee9a6bd1a P e61c3a8f61bb48f8a963c9480e53c168 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 0473d2b2d01f4459b1e90fd12cc7840e)
I20260709 13:06:06.991537 23712 leader_election.cc:290] T 3e1f505cb0f1427bbd698ac889d80821 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:06:06.991833 23695 raft_consensus.cc:515] T b08304a0a02b42d7840c4e8ee9a6bd1a P e61c3a8f61bb48f8a963c9480e53c168 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
W20260709 13:06:06.991200 23701 log.cc:927] Time spent T 775c229504194560ba9589bc2199b089 P e5256d91808b47c195bc9b4dbd7f2b87: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
I20260709 13:06:06.949385 23698 raft_consensus.cc:515] T 172b3dd13109415a955b71ac0e9d2234 P 0473d2b2d01f4459b1e90fd12cc7840e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:06.972540 23714 raft_consensus.cc:515] T 14935b3ddf914369822e4a0547aaa355 P 0473d2b2d01f4459b1e90fd12cc7840e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } attrs { replace: true } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
W20260709 13:06:07.019143 19403 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.538s	user 0.023s	sys 0.052s
I20260709 13:06:06.994644 23695 leader_election.cc:290] T b08304a0a02b42d7840c4e8ee9a6bd1a P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
W20260709 13:06:07.080427 19403 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.599s	user 0.023s	sys 0.052s
I20260709 13:06:07.010993 19551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e381f1d6b8184797ad142de49be225a8" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:06:07.093080 19551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4509b76741dc428e9201c70c1658da13" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:06:07.095005 19551 raft_consensus.cc:2468] T 4509b76741dc428e9201c70c1658da13 P e61c3a8f61bb48f8a963c9480e53c168 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 5.
I20260709 13:06:07.053469 23698 leader_election.cc:290] T 172b3dd13109415a955b71ac0e9d2234 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:06:07.115470 23714 leader_election.cc:290] T 14935b3ddf914369822e4a0547aaa355 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:06:07.129822 23378 leader_election.cc:290] T 1dc5b3532fe54f74876d02beffa2c230 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:06:07.136582 19402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "172b3dd13109415a955b71ac0e9d2234" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
W20260709 13:06:07.178606 20078 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.17.223.2:46257 timed out after 1.732s (SENT) [suppressed 13 similar messages]
I20260709 13:06:07.193720 19305 catalog_manager.cc:5697] T ece3db938bc649d4a40a51522ed5259c P 127766fc592545a4997f7790f50f6076 reported cstate change: term changed from 7 to 8, leader changed from 127766fc592545a4997f7790f50f6076 (127.17.223.4) to e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1). New cstate: current_term: 8 leader_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } } }
I20260709 13:06:07.199002 19305 catalog_manager.cc:5697] T 96efeaaf1057492490e9a621f37e1a2d P 127766fc592545a4997f7790f50f6076 reported cstate change: term changed from 4 to 8, leader changed from e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3) to 127766fc592545a4997f7790f50f6076 (127.17.223.4). New cstate: current_term: 8 leader_uuid: "127766fc592545a4997f7790f50f6076" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:06:07.203379 19305 catalog_manager.cc:5697] T 5ec1c4ce15e04c7e8c283a62179f2a64 P 127766fc592545a4997f7790f50f6076 reported cstate change: term changed from 6 to 7, leader changed from 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2) to e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1). New cstate: current_term: 7 leader_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } } }
W20260709 13:06:07.207286 19309 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:44688 (request call id 225) took 25774 ms (client timeout 15000 ms). Trace:
I20260709 13:06:07.205677 19305 catalog_manager.cc:5697] T 85c494af21f9457a85da47b9bc70c1fd P 127766fc592545a4997f7790f50f6076 reported cstate change: term changed from 4 to 6, leader changed from e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1) to 127766fc592545a4997f7790f50f6076 (127.17.223.4). New cstate: current_term: 6 leader_uuid: "127766fc592545a4997f7790f50f6076" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:06:07.207805 19309 rpcz_store.cc:269] 0709 13:05:41.432626 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:41.455594 (+ 22968us) service_pool.cc:224] Handling call
0709 13:06:07.207067 (+25751473us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:06:00.775941 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:06:00.869400 (+ 93459us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:06:00.878071 (+  8671us) write_op.cc:435] Acquired schema lock
0709 13:06:00.882120 (+  4049us) tablet.cc:662] Decoding operations
0709 13:06:01.222352 (+340232us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:06:01.272046 (+ 49694us) write_op.cc:641] Partition lock acquired for write op
0709 13:06:01.283790 (+ 11744us) tablet.cc:685] Acquiring locks for 13 operations
0709 13:06:01.358814 (+ 75024us) tablet.cc:701] Row locks acquired
0709 13:06:01.394193 (+ 35379us) write_op.cc:260] PREPARE: finished
0709 13:06:01.532997 (+138804us) write_op.cc:270] Start()
0709 13:06:01.562734 (+ 29737us) write_op.cc:276] Timestamp: P: 1783602361458803 usec, L: 0
0709 13:06:01.566399 (+  3665us) op_driver.cc:348] REPLICATION: starting
0709 13:06:01.771140 (+204741us) log.cc:844] Serialized 5135 byte log entry
0709 13:06:01.987370 (+216230us) spinlock_profiling.cc:243] Waited 1.81 ms on lock 0x7b4400022b4c. stack: 00007f4a79de9343 00007f4a79de9240 00007f4a797781d4 00007f4a834b6304 00007f4a834b6299 00007f4a79ca3db1 00007f4a79d41c85 00007f4a79d426a2 00007f4a7cab41db 00007f4a7caafaaf 00007f4a79dfe0ac 00007f4a82c58ab9 00007f4a79e1a69b 00007f4a79e1893f 00007f4a79e1ac02 00007f4a7caa220b
0709 13:06:02.576560 (+589190us) spinlock_profiling.cc:243] Waited 29 ms on lock 0x7b54003fb6d4. stack: 00007f4a79de9343 00007f4a79de9240 00007f4a797781d4 00007f4a834b6304 00007f4a834b6299 00007f4a7ce71571 00007f4a7cf03e28 00007f4a8093e581 00007f4a8093dd58 00007f4a809429f1 00007f4a809429a9 00007f4a80942939 00007f4a80942901 00007f4a80941b2d 000000000038f354 000000000038f199
0709 13:06:03.358353 (+781793us) op_driver.cc:464] REPLICATION: finished
0709 13:06:03.577838 (+219485us) write_op.cc:301] APPLY: starting
0709 13:06:03.577962 (+   124us) tablet.cc:1367] starting BulkCheckPresence
0709 13:06:03.578361 (+   399us) tablet.cc:1370] finished BulkCheckPresence
0709 13:06:03.578418 (+    57us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:06:03.582601 (+  4183us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:06:03.583825 (+  1224us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=13
0709 13:06:03.583870 (+    45us) write_op.cc:312] APPLY: finished
0709 13:06:03.584236 (+   366us) log.cc:844] Serialized 95 byte log entry
0709 13:06:03.585060 (+   824us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:06:03.585210 (+   150us) write_op.cc:454] Released schema lock
0709 13:06:03.585279 (+    69us) write_op.cc:341] FINISH: Updating metrics
0709 13:06:03.585727 (+   448us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:06:03.585767 (+    40us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":4257225,"reported_tablets":48,"child_traces":[["op",{"apply.queue_time_us":202977,"apply.run_cpu_time_us":4153,"apply.run_wall_time_us":7850,"num_ops":13,"prepare.queue_time_us":153545,"prepare.run_cpu_time_us":27616,"prepare.run_wall_time_us":1801314,"raft.queue_time_us":406759,"raft.run_cpu_time_us":37905,"raft.run_wall_time_us":238413,"replication_time_us":1768922,"spinlock_wait_cycles":70886016,"thread_start_us":820335,"threads_started":4,"wal-append.queue_time_us":443676,"wal-append.run_cpu_time_us":18793,"wal-append.run_wall_time_us":2311912}]]}
I20260709 13:06:06.930331 23665 consensus_queue.cc:1048] T 217b5fae677b4971b3bbd2f357a1f7ff P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.064s
I20260709 13:06:07.235378 23443 raft_consensus.cc:493] T 40e1e16737a842ee936002830f36882e P e5256d91808b47c195bc9b4dbd7f2b87 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader e61c3a8f61bb48f8a963c9480e53c168)
I20260709 13:06:07.236268 23443 raft_consensus.cc:515] T 40e1e16737a842ee936002830f36882e P e5256d91808b47c195bc9b4dbd7f2b87 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:07.238665 23443 leader_election.cc:290] T 40e1e16737a842ee936002830f36882e P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:06:07.246073 23670 raft_consensus.cc:3055] T fa731b585f684a7fb2d106c50f143b83 P e5256d91808b47c195bc9b4dbd7f2b87 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:06:07.246608 23670 raft_consensus.cc:740] T fa731b585f684a7fb2d106c50f143b83 P e5256d91808b47c195bc9b4dbd7f2b87 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: e5256d91808b47c195bc9b4dbd7f2b87, State: Running, Role: LEADER
I20260709 13:06:07.250916 23670 consensus_queue.cc:260] T fa731b585f684a7fb2d106c50f143b83 P e5256d91808b47c195bc9b4dbd7f2b87 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:07.252862 23670 raft_consensus.cc:3060] T fa731b585f684a7fb2d106c50f143b83 P e5256d91808b47c195bc9b4dbd7f2b87 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:06:07.254889 23725 raft_consensus.cc:493] T 96efeaaf1057492490e9a621f37e1a2d P 0473d2b2d01f4459b1e90fd12cc7840e [term 11 FOLLOWER]: Starting pre-election (detected failure of leader e61c3a8f61bb48f8a963c9480e53c168)
I20260709 13:06:07.255184 23378 raft_consensus.cc:493] T 1f85fc4b527a48848e5faa083b604e36 P 0473d2b2d01f4459b1e90fd12cc7840e [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:07.255577 23725 raft_consensus.cc:515] T 96efeaaf1057492490e9a621f37e1a2d P 0473d2b2d01f4459b1e90fd12cc7840e [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:07.255970 23378 raft_consensus.cc:515] T 1f85fc4b527a48848e5faa083b604e36 P 0473d2b2d01f4459b1e90fd12cc7840e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:07.258193 23725 leader_election.cc:290] T 96efeaaf1057492490e9a621f37e1a2d P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
W20260709 13:06:07.258976 19374 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:07.260898 23378 leader_election.cc:290] T 1f85fc4b527a48848e5faa083b604e36 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:06:07.263065 19479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "775c229504194560ba9589bc2199b089" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:06:07.263821 19479 raft_consensus.cc:2393] T 775c229504194560ba9589bc2199b089 P 0473d2b2d01f4459b1e90fd12cc7840e [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e5256d91808b47c195bc9b4dbd7f2b87 in current term 9: Already voted for candidate 0473d2b2d01f4459b1e90fd12cc7840e in this term.
I20260709 13:06:07.263849 19485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cdf56e38bbc453d9438d359e5a69955" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:06:07.265643 19485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76cb037fc9064d13b59a8969d897ce8c" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:06:07.266227 19485 raft_consensus.cc:2468] T 76cb037fc9064d13b59a8969d897ce8c P 0473d2b2d01f4459b1e90fd12cc7840e [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 10.
I20260709 13:06:07.267028 19485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff9b0eddd810459b82d91c60777c10eb" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:06:07.267544 19485 raft_consensus.cc:3060] T ff9b0eddd810459b82d91c60777c10eb P 0473d2b2d01f4459b1e90fd12cc7840e [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:06:07.270623 19479 raft_consensus.cc:1275] T 172b3dd13109415a955b71ac0e9d2234 P 0473d2b2d01f4459b1e90fd12cc7840e [term 10 FOLLOWER]: Refusing update from remote peer e5256d91808b47c195bc9b4dbd7f2b87: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:06:07.271871 19479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "172b3dd13109415a955b71ac0e9d2234" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:06:07.272567 19479 raft_consensus.cc:2468] T 172b3dd13109415a955b71ac0e9d2234 P 0473d2b2d01f4459b1e90fd12cc7840e [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 127766fc592545a4997f7790f50f6076 in term 10.
I20260709 13:06:07.012138 19553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1efebf73c86e432baa55533136b6e12c" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:06:07.273458 19479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36f6ba92b9ba46babe4ebd6c02e5fbd9" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:06:07.273797 19553 raft_consensus.cc:2368] T 1efebf73c86e432baa55533136b6e12c P e61c3a8f61bb48f8a963c9480e53c168 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 0473d2b2d01f4459b1e90fd12cc7840e for earlier term 10. Current term is 11.
I20260709 13:06:07.274156 19479 raft_consensus.cc:3060] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P 0473d2b2d01f4459b1e90fd12cc7840e [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:06:07.274930 19480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "775c229504194560ba9589bc2199b089" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:06:07.275686 19480 raft_consensus.cc:2393] T 775c229504194560ba9589bc2199b089 P 0473d2b2d01f4459b1e90fd12cc7840e [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate e5256d91808b47c195bc9b4dbd7f2b87 in current term 9: Already voted for candidate 0473d2b2d01f4459b1e90fd12cc7840e in this term.
I20260709 13:06:07.276567 19480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7be9efa6559648dbb5a0f7684c4542d1" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:06:07.012681 23663 leader_election.cc:290] T 0cdf56e38bbc453d9438d359e5a69955 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 13 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:06:07.288136 20078 leader_election.cc:304] T 172b3dd13109415a955b71ac0e9d2234 P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, 127766fc592545a4997f7790f50f6076; no voters: e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:06:07.289295 23711 raft_consensus.cc:2804] T 172b3dd13109415a955b71ac0e9d2234 P 127766fc592545a4997f7790f50f6076 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:06:07.289795 23711 raft_consensus.cc:493] T 172b3dd13109415a955b71ac0e9d2234 P 127766fc592545a4997f7790f50f6076 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:07.290185 23711 raft_consensus.cc:3060] T 172b3dd13109415a955b71ac0e9d2234 P 127766fc592545a4997f7790f50f6076 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:06:07.292204 19450 leader_election.cc:304] T 21e14947d70440f19044d8f75c31e1f9 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e; no voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:06:07.293370 19450 leader_election.cc:304] T ef32ce6fdd0e40d382c79974f30295c6 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168; no voters: e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:06:07.293588 23378 raft_consensus.cc:2749] T 21e14947d70440f19044d8f75c31e1f9 P 0473d2b2d01f4459b1e90fd12cc7840e [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:06:07.294373 23378 raft_consensus.cc:2804] T ef32ce6fdd0e40d382c79974f30295c6 P 0473d2b2d01f4459b1e90fd12cc7840e [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:06:07.294535 19485 raft_consensus.cc:2468] T ff9b0eddd810459b82d91c60777c10eb P 0473d2b2d01f4459b1e90fd12cc7840e [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 127766fc592545a4997f7790f50f6076 in term 11.
I20260709 13:06:07.295115 23378 raft_consensus.cc:493] T ef32ce6fdd0e40d382c79974f30295c6 P 0473d2b2d01f4459b1e90fd12cc7840e [term 12 FOLLOWER]: Starting leader election (detected failure of leader e61c3a8f61bb48f8a963c9480e53c168)
I20260709 13:06:07.295639 23378 raft_consensus.cc:3060] T ef32ce6fdd0e40d382c79974f30295c6 P 0473d2b2d01f4459b1e90fd12cc7840e [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:06:07.295886 19485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff9b0eddd810459b82d91c60777c10eb" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:06:07.038110 23547 leader_election.cc:290] T 96efeaaf1057492490e9a621f37e1a2d P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:06:07.296404 19450 leader_election.cc:304] T 6c5eebf646ad445a9d1b1adc319d7b16 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e; no voters: 127766fc592545a4997f7790f50f6076, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:06:07.297298 23725 raft_consensus.cc:2749] T 6c5eebf646ad445a9d1b1adc319d7b16 P 0473d2b2d01f4459b1e90fd12cc7840e [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:06:07.302928 23711 raft_consensus.cc:515] T 172b3dd13109415a955b71ac0e9d2234 P 127766fc592545a4997f7790f50f6076 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:07.316277 23711 leader_election.cc:290] T 172b3dd13109415a955b71ac0e9d2234 P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 11 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:06:07.304788 23378 raft_consensus.cc:515] T ef32ce6fdd0e40d382c79974f30295c6 P 0473d2b2d01f4459b1e90fd12cc7840e [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
W20260709 13:06:07.317191 19523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.4:43121, user_credentials={real_user=slave}} blocked reactor thread for 330598us
I20260709 13:06:07.327602 19479 raft_consensus.cc:2468] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P 0473d2b2d01f4459b1e90fd12cc7840e [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 127766fc592545a4997f7790f50f6076 in term 12.
I20260709 13:06:07.330245 20078 leader_election.cc:304] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, 127766fc592545a4997f7790f50f6076; no voters: e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:06:07.332026 23711 raft_consensus.cc:2804] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P 127766fc592545a4997f7790f50f6076 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:06:07.332655 23711 raft_consensus.cc:697] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P 127766fc592545a4997f7790f50f6076 [term 12 LEADER]: Becoming Leader. State: Replica: 127766fc592545a4997f7790f50f6076, State: Running, Role: LEADER
I20260709 13:06:07.332279 19483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48824d5acfbc485ebf8c2d944e7202de" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:06:07.333724 19483 raft_consensus.cc:2393] T 48824d5acfbc485ebf8c2d944e7202de P 0473d2b2d01f4459b1e90fd12cc7840e [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 127766fc592545a4997f7790f50f6076 in current term 11: Already voted for candidate 0473d2b2d01f4459b1e90fd12cc7840e in this term.
I20260709 13:06:07.333765 23711 consensus_queue.cc:237] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P 127766fc592545a4997f7790f50f6076 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:07.296481 19485 raft_consensus.cc:2376] T ff9b0eddd810459b82d91c60777c10eb P 0473d2b2d01f4459b1e90fd12cc7840e [term 11 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 127766fc592545a4997f7790f50f6076 in term 11. Re-sending same reply.
I20260709 13:06:07.339861 23619 raft_consensus.cc:493] T a08760e15aac4630a629431f56024dc8 P e5256d91808b47c195bc9b4dbd7f2b87 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:07.342370 23619 raft_consensus.cc:515] T a08760e15aac4630a629431f56024dc8 P e5256d91808b47c195bc9b4dbd7f2b87 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:07.344720 19483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e1085d23e8347fbbd5bce7542f4b1f4" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:06:07.345448 23619 leader_election.cc:290] T a08760e15aac4630a629431f56024dc8 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:06:07.346834 23692 raft_consensus.cc:493] T ab43d85f64114d4ebf618930e43d9ed0 P e5256d91808b47c195bc9b4dbd7f2b87 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:07.347078 19404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b74109013a140ada21feeef92d6f563" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:06:07.347410 23692 raft_consensus.cc:515] T ab43d85f64114d4ebf618930e43d9ed0 P e5256d91808b47c195bc9b4dbd7f2b87 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } attrs { replace: true } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:07.348173 19411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65d8cb8d6ec64f459d5a47cefab10acf" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
W20260709 13:06:07.349601 20076 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:07.349439 19479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48824d5acfbc485ebf8c2d944e7202de" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:06:07.352959 20078 leader_election.cc:304] T ff9b0eddd810459b82d91c60777c10eb P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, 127766fc592545a4997f7790f50f6076; no voters: e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:06:07.353669 19479 raft_consensus.cc:2393] T 48824d5acfbc485ebf8c2d944e7202de P 0473d2b2d01f4459b1e90fd12cc7840e [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 127766fc592545a4997f7790f50f6076 in current term 11: Already voted for candidate 0473d2b2d01f4459b1e90fd12cc7840e in this term.
I20260709 13:06:07.354355 19405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab43d85f64114d4ebf618930e43d9ed0" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 12 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:06:07.356443 19405 raft_consensus.cc:2468] T ab43d85f64114d4ebf618930e43d9ed0 P e5256d91808b47c195bc9b4dbd7f2b87 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 11.
I20260709 13:06:07.357578 19485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e1085d23e8347fbbd5bce7542f4b1f4" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:06:07.359760 23708 raft_consensus.cc:2804] T ff9b0eddd810459b82d91c60777c10eb P 127766fc592545a4997f7790f50f6076 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:06:07.360309 23708 raft_consensus.cc:697] T ff9b0eddd810459b82d91c60777c10eb P 127766fc592545a4997f7790f50f6076 [term 11 LEADER]: Becoming Leader. State: Replica: 127766fc592545a4997f7790f50f6076, State: Running, Role: LEADER
I20260709 13:06:07.361289 23708 consensus_queue.cc:237] T ff9b0eddd810459b82d91c60777c10eb P 127766fc592545a4997f7790f50f6076 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:07.361831 18300 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:06:07.351059 23692 leader_election.cc:290] T ab43d85f64114d4ebf618930e43d9ed0 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:06:07.369057 19479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "172b3dd13109415a955b71ac0e9d2234" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:06:07.369807 19479 raft_consensus.cc:3060] T 172b3dd13109415a955b71ac0e9d2234 P 0473d2b2d01f4459b1e90fd12cc7840e [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:06:07.375432 20078 leader_election.cc:304] T 0e1085d23e8347fbbd5bce7542f4b1f4 P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 127766fc592545a4997f7790f50f6076; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:06:07.371465 18300 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:06:07.377403 19408 raft_consensus.cc:1240] T 28af091831594f9d8e96482078cc7625 P e5256d91808b47c195bc9b4dbd7f2b87 [term 12 FOLLOWER]: Rejecting Update request from peer e61c3a8f61bb48f8a963c9480e53c168 for earlier term 11. Current term is 12. Ops: [11.6-11.6]
I20260709 13:06:07.381284 19375 leader_election.cc:304] T 70797e5783b5454ab0d0eea663e791e3 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87; no voters: 127766fc592545a4997f7790f50f6076, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:06:07.383466 19375 leader_election.cc:304] T b9f0d59553ad444883fcf5b5909f9798 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:06:07.384508 23619 raft_consensus.cc:2804] T b9f0d59553ad444883fcf5b5909f9798 P e5256d91808b47c195bc9b4dbd7f2b87 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:06:07.384934 23619 raft_consensus.cc:493] T b9f0d59553ad444883fcf5b5909f9798 P e5256d91808b47c195bc9b4dbd7f2b87 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 0473d2b2d01f4459b1e90fd12cc7840e)
I20260709 13:06:07.393074 19479 raft_consensus.cc:2468] T 172b3dd13109415a955b71ac0e9d2234 P 0473d2b2d01f4459b1e90fd12cc7840e [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 127766fc592545a4997f7790f50f6076 in term 11.
I20260709 13:06:07.398638 19479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c5eebf646ad445a9d1b1adc319d7b16" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:06:07.399312 19479 raft_consensus.cc:2393] T 6c5eebf646ad445a9d1b1adc319d7b16 P 0473d2b2d01f4459b1e90fd12cc7840e [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 127766fc592545a4997f7790f50f6076 in current term 9: Already voted for candidate 0473d2b2d01f4459b1e90fd12cc7840e in this term.
I20260709 13:06:07.404196 20078 leader_election.cc:304] T 172b3dd13109415a955b71ac0e9d2234 P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, 127766fc592545a4997f7790f50f6076; no voters: 
I20260709 13:06:07.407755 23709 raft_consensus.cc:2804] T 172b3dd13109415a955b71ac0e9d2234 P 127766fc592545a4997f7790f50f6076 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:06:07.408710 23709 raft_consensus.cc:697] T 172b3dd13109415a955b71ac0e9d2234 P 127766fc592545a4997f7790f50f6076 [term 11 LEADER]: Becoming Leader. State: Replica: 127766fc592545a4997f7790f50f6076, State: Running, Role: LEADER
I20260709 13:06:07.391040 23619 raft_consensus.cc:3060] T b9f0d59553ad444883fcf5b5909f9798 P e5256d91808b47c195bc9b4dbd7f2b87 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:06:07.391113 23711 raft_consensus.cc:2749] T 0e1085d23e8347fbbd5bce7542f4b1f4 P 127766fc592545a4997f7790f50f6076 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:06:07.411960 23692 raft_consensus.cc:493] T ff9b0eddd810459b82d91c60777c10eb P e5256d91808b47c195bc9b4dbd7f2b87 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:07.419720 19479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96efeaaf1057492490e9a621f37e1a2d" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 13 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:06:07.420814 19479 raft_consensus.cc:2410] T 96efeaaf1057492490e9a621f37e1a2d P 0473d2b2d01f4459b1e90fd12cc7840e [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 127766fc592545a4997f7790f50f6076 for term 13 because replica has last-logged OpId of term: 11 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 8.
I20260709 13:06:07.422045 23692 raft_consensus.cc:515] T ff9b0eddd810459b82d91c60777c10eb P e5256d91808b47c195bc9b4dbd7f2b87 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:07.423039 19479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62c6c134d3d24a1ab144dd9ee6bc3f64" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:06:07.424669 23692 leader_election.cc:290] T ff9b0eddd810459b82d91c60777c10eb P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:06:07.425282 19479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c5eebf646ad445a9d1b1adc319d7b16" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:06:07.426330 19479 raft_consensus.cc:2393] T 6c5eebf646ad445a9d1b1adc319d7b16 P 0473d2b2d01f4459b1e90fd12cc7840e [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 127766fc592545a4997f7790f50f6076 in current term 9: Already voted for candidate 0473d2b2d01f4459b1e90fd12cc7840e in this term.
I20260709 13:06:07.429700 20078 leader_election.cc:304] T 62c6c134d3d24a1ab144dd9ee6bc3f64 P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 127766fc592545a4997f7790f50f6076; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:06:07.419157 23670 raft_consensus.cc:2749] T 70797e5783b5454ab0d0eea663e791e3 P e5256d91808b47c195bc9b4dbd7f2b87 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:06:07.011889 19552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b74109013a140ada21feeef92d6f563" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:06:07.441884 19552 raft_consensus.cc:2468] T 2b74109013a140ada21feeef92d6f563 P e61c3a8f61bb48f8a963c9480e53c168 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 7.
I20260709 13:06:07.011607 19556 raft_consensus.cc:1240] T 7be9efa6559648dbb5a0f7684c4542d1 P e61c3a8f61bb48f8a963c9480e53c168 [term 12 FOLLOWER]: Rejecting Update request from peer 0473d2b2d01f4459b1e90fd12cc7840e for earlier term 11. Current term is 12. Ops: [9.7-11.8]
I20260709 13:06:07.433521 19479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96efeaaf1057492490e9a621f37e1a2d" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 13 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:06:07.453882 20078 leader_election.cc:304] T 6c5eebf646ad445a9d1b1adc319d7b16 P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 127766fc592545a4997f7790f50f6076; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:06:07.455417 19479 raft_consensus.cc:2410] T 96efeaaf1057492490e9a621f37e1a2d P 0473d2b2d01f4459b1e90fd12cc7840e [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 127766fc592545a4997f7790f50f6076 for term 13 because replica has last-logged OpId of term: 11 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 8.
I20260709 13:06:07.410284 23709 consensus_queue.cc:237] T 172b3dd13109415a955b71ac0e9d2234 P 127766fc592545a4997f7790f50f6076 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:07.452204 23711 raft_consensus.cc:2749] T 62c6c134d3d24a1ab144dd9ee6bc3f64 P 127766fc592545a4997f7790f50f6076 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:06:07.456507 23624 raft_consensus.cc:2749] T 6c5eebf646ad445a9d1b1adc319d7b16 P 127766fc592545a4997f7790f50f6076 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:06:07.459980 19479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b74109013a140ada21feeef92d6f563" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:06:07.462252 19479 raft_consensus.cc:2393] T 2b74109013a140ada21feeef92d6f563 P 0473d2b2d01f4459b1e90fd12cc7840e [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e5256d91808b47c195bc9b4dbd7f2b87 in current term 7: Already voted for candidate 0473d2b2d01f4459b1e90fd12cc7840e in this term.
I20260709 13:06:07.458557 20078 leader_election.cc:304] T 96efeaaf1057492490e9a621f37e1a2d P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 127766fc592545a4997f7790f50f6076; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168
W20260709 13:06:07.463586 19449 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.613s	user 0.004s	sys 0.033s
W20260709 13:06:07.463999 19449 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.613s	user 0.004s	sys 0.033s
I20260709 13:06:07.463855 23624 raft_consensus.cc:2749] T 96efeaaf1057492490e9a621f37e1a2d P 127766fc592545a4997f7790f50f6076 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:06:07.464708 19449 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.1:40321, user_credentials={real_user=slave}} blocked reactor thread for 650778us
I20260709 13:06:07.465518 19449 leader_election.cc:304] T 28af091831594f9d8e96482078cc7625 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87; no voters: e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:06:07.465987 19479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14efcc79969f41babe5529c22d59156d" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:06:07.466492 23725 raft_consensus.cc:2804] T 28af091831594f9d8e96482078cc7625 P 0473d2b2d01f4459b1e90fd12cc7840e [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:06:07.467100 19479 raft_consensus.cc:2393] T 14efcc79969f41babe5529c22d59156d P 0473d2b2d01f4459b1e90fd12cc7840e [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 127766fc592545a4997f7790f50f6076 in current term 11: Already voted for candidate 0473d2b2d01f4459b1e90fd12cc7840e in this term.
I20260709 13:06:07.467227 23725 raft_consensus.cc:697] T 28af091831594f9d8e96482078cc7625 P 0473d2b2d01f4459b1e90fd12cc7840e [term 12 LEADER]: Becoming Leader. State: Replica: 0473d2b2d01f4459b1e90fd12cc7840e, State: Running, Role: LEADER
I20260709 13:06:07.469866 20078 leader_election.cc:304] T 14efcc79969f41babe5529c22d59156d P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 127766fc592545a4997f7790f50f6076; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:06:07.469561 23725 consensus_queue.cc:237] T 28af091831594f9d8e96482078cc7625 P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:07.471235 23624 raft_consensus.cc:2749] T 14efcc79969f41babe5529c22d59156d P 127766fc592545a4997f7790f50f6076 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:06:07.473747 19449 leader_election.cc:304] T 2b74109013a140ada21feeef92d6f563 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87; no voters: 
I20260709 13:06:07.475281 19479 raft_consensus.cc:1240] T 172b3dd13109415a955b71ac0e9d2234 P 0473d2b2d01f4459b1e90fd12cc7840e [term 11 FOLLOWER]: Rejecting Update request from peer 127766fc592545a4997f7790f50f6076 for earlier term 9. Current term is 11. Ops: []
I20260709 13:06:07.475329 19449 leader_election.cc:304] T 4509b76741dc428e9201c70c1658da13 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87; no voters: 
I20260709 13:06:07.478302 23714 raft_consensus.cc:2804] T 2b74109013a140ada21feeef92d6f563 P 0473d2b2d01f4459b1e90fd12cc7840e [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:06:07.494086 23714 raft_consensus.cc:493] T 2b74109013a140ada21feeef92d6f563 P 0473d2b2d01f4459b1e90fd12cc7840e [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:06:07.494365 23731 log.cc:927] Time spent T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P 127766fc592545a4997f7790f50f6076: Append to log took a long time: real 0.059s	user 0.002s	sys 0.000s
I20260709 13:06:07.494506 23714 raft_consensus.cc:3060] T 2b74109013a140ada21feeef92d6f563 P 0473d2b2d01f4459b1e90fd12cc7840e [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:06:07.478216 23698 raft_consensus.cc:2804] T 4509b76741dc428e9201c70c1658da13 P 0473d2b2d01f4459b1e90fd12cc7840e [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:06:07.502965 23698 raft_consensus.cc:493] T 4509b76741dc428e9201c70c1658da13 P 0473d2b2d01f4459b1e90fd12cc7840e [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:07.503342 23698 raft_consensus.cc:3060] T 4509b76741dc428e9201c70c1658da13 P 0473d2b2d01f4459b1e90fd12cc7840e [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:07.504981 19449 leader_election.cc:304] T bc225c93219c45538b53a1bd3d387e4d P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87; no voters: e61c3a8f61bb48f8a963c9480e53c168
W20260709 13:06:07.510258 23705 log.cc:927] Time spent T 309c3ca0ca4b4f3ba129752ea2cb293b P e61c3a8f61bb48f8a963c9480e53c168: Append to log took a long time: real 0.667s	user 0.000s	sys 0.004s
I20260709 13:06:07.510941 23712 raft_consensus.cc:2804] T bc225c93219c45538b53a1bd3d387e4d P 0473d2b2d01f4459b1e90fd12cc7840e [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:06:07.511511 23712 raft_consensus.cc:697] T bc225c93219c45538b53a1bd3d387e4d P 0473d2b2d01f4459b1e90fd12cc7840e [term 11 LEADER]: Becoming Leader. State: Replica: 0473d2b2d01f4459b1e90fd12cc7840e, State: Running, Role: LEADER
I20260709 13:06:07.507332 19479 raft_consensus.cc:1275] T 5ec1c4ce15e04c7e8c283a62179f2a64 P 0473d2b2d01f4459b1e90fd12cc7840e [term 10 FOLLOWER]: Refusing update from remote peer 127766fc592545a4997f7790f50f6076: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 13:06:07.525161 23619 raft_consensus.cc:515] T b9f0d59553ad444883fcf5b5909f9798 P e5256d91808b47c195bc9b4dbd7f2b87 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:07.526484 19481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "217b5fae677b4971b3bbd2f357a1f7ff" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:06:07.527081 19481 raft_consensus.cc:2468] T 217b5fae677b4971b3bbd2f357a1f7ff P 0473d2b2d01f4459b1e90fd12cc7840e [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 8.
I20260709 13:06:07.520525 23443 raft_consensus.cc:493] T 2725d2c4cb054f18b0fc8f735c15f6c2 P e5256d91808b47c195bc9b4dbd7f2b87 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:07.512640 23712 consensus_queue.cc:237] T bc225c93219c45538b53a1bd3d387e4d P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:07.529139 19481 raft_consensus.cc:1275] T ed7fdbcb96d14d418db9ca90a792588a P 0473d2b2d01f4459b1e90fd12cc7840e [term 9 FOLLOWER]: Refusing update from remote peer 127766fc592545a4997f7790f50f6076: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
W20260709 13:06:07.530869 19377 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.2:46257, user_credentials={real_user=slave}} blocked reactor thread for 58378.7us
W20260709 13:06:07.527671 20105 consensus_meta.cc:287] T 1efebf73c86e432baa55533136b6e12c P 127766fc592545a4997f7790f50f6076: Time spent flushing consensus metadata: real 0.672s	user 0.011s	sys 0.003s
I20260709 13:06:07.527104 23708 consensus_queue.cc:1048] T 5ec1c4ce15e04c7e8c283a62179f2a64 P 127766fc592545a4997f7790f50f6076 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 6, Time since last communication: 0.008s
I20260709 13:06:07.535703 23708 consensus_queue.cc:1243] T 5ec1c4ce15e04c7e8c283a62179f2a64 P 127766fc592545a4997f7790f50f6076 [LEADER]: Peer 0473d2b2d01f4459b1e90fd12cc7840e log is divergent from this leader: its last log entry 6.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 13:06:07.536108 20110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab43d85f64114d4ebf618930e43d9ed0" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 12 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:06:07.536711 20110 raft_consensus.cc:2468] T ab43d85f64114d4ebf618930e43d9ed0 P 127766fc592545a4997f7790f50f6076 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 11.
I20260709 13:06:07.537252 23663 raft_consensus.cc:493] T 309c3ca0ca4b4f3ba129752ea2cb293b P 0473d2b2d01f4459b1e90fd12cc7840e [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 127766fc592545a4997f7790f50f6076)
I20260709 13:06:07.537693 23692 raft_consensus.cc:493] T f1b10566f45d4a7d9029858330e02d5b P e5256d91808b47c195bc9b4dbd7f2b87 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:07.537926 19409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14935b3ddf914369822e4a0547aaa355" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:06:07.537809 23663 raft_consensus.cc:515] T 309c3ca0ca4b4f3ba129752ea2cb293b P 0473d2b2d01f4459b1e90fd12cc7840e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } attrs { replace: true } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:07.538259 23692 raft_consensus.cc:515] T f1b10566f45d4a7d9029858330e02d5b P e5256d91808b47c195bc9b4dbd7f2b87 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:07.539194 19409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef32ce6fdd0e40d382c79974f30295c6" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
I20260709 13:06:07.539855 19409 raft_consensus.cc:2393] T ef32ce6fdd0e40d382c79974f30295c6 P e5256d91808b47c195bc9b4dbd7f2b87 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 0473d2b2d01f4459b1e90fd12cc7840e in current term 13: Already voted for candidate e5256d91808b47c195bc9b4dbd7f2b87 in this term.
I20260709 13:06:07.536228 23619 leader_election.cc:290] T b9f0d59553ad444883fcf5b5909f9798 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 12 election: Requested vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:06:07.540551 19409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f85fc4b527a48848e5faa083b604e36" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 10 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:06:07.540957 19408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "172b3dd13109415a955b71ac0e9d2234" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:06:07.542109 20105 raft_consensus.cc:2468] T 1efebf73c86e432baa55533136b6e12c P 127766fc592545a4997f7790f50f6076 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 11.
I20260709 13:06:07.514530 23698 raft_consensus.cc:515] T 4509b76741dc428e9201c70c1658da13 P 0473d2b2d01f4459b1e90fd12cc7840e [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:07.547309 20109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96efeaaf1057492490e9a621f37e1a2d" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:06:07.547915 20109 raft_consensus.cc:2393] T 96efeaaf1057492490e9a621f37e1a2d P 127766fc592545a4997f7790f50f6076 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0473d2b2d01f4459b1e90fd12cc7840e in current term 12: Already voted for candidate 127766fc592545a4997f7790f50f6076 in this term.
I20260709 13:06:07.534592 19479 raft_consensus.cc:1275] T 1f85fc4b527a48848e5faa083b604e36 P 0473d2b2d01f4459b1e90fd12cc7840e [term 9 FOLLOWER]: Refusing update from remote peer 127766fc592545a4997f7790f50f6076: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:06:07.550149 20112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14935b3ddf914369822e4a0547aaa355" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:06:07.550771 20110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "172b3dd13109415a955b71ac0e9d2234" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:06:07.550993 19403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab43d85f64114d4ebf618930e43d9ed0" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 12 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:06:07.551860 19411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e1f505cb0f1427bbd698ac889d80821" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:06:07.552335 19411 raft_consensus.cc:2468] T 3e1f505cb0f1427bbd698ac889d80821 P e5256d91808b47c195bc9b4dbd7f2b87 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 11.
W20260709 13:06:07.552698 19449 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:07.552946 19402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cdf56e38bbc453d9438d359e5a69955" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
I20260709 13:06:07.528613 23587 raft_consensus.cc:3055] T 65d8cb8d6ec64f459d5a47cefab10acf P e5256d91808b47c195bc9b4dbd7f2b87 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:06:07.554338 19407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dc5b3532fe54f74876d02beffa2c230" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 12 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:06:07.551538 19403 raft_consensus.cc:2468] T ab43d85f64114d4ebf618930e43d9ed0 P e5256d91808b47c195bc9b4dbd7f2b87 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 11.
I20260709 13:06:07.556008 19481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e1f505cb0f1427bbd698ac889d80821" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:06:07.556573 19481 raft_consensus.cc:2468] T 3e1f505cb0f1427bbd698ac889d80821 P 0473d2b2d01f4459b1e90fd12cc7840e [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 11.
I20260709 13:06:07.557761 19407 raft_consensus.cc:2410] T 1dc5b3532fe54f74876d02beffa2c230 P e5256d91808b47c195bc9b4dbd7f2b87 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0473d2b2d01f4459b1e90fd12cc7840e for term 12 because replica has last-logged OpId of term: 10 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 4.
I20260709 13:06:07.549654 19479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f575b143b844aa096b50997dad3516a" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:06:07.529822 23443 raft_consensus.cc:515] T 2725d2c4cb054f18b0fc8f735c15f6c2 P e5256d91808b47c195bc9b4dbd7f2b87 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:07.540352 23692 leader_election.cc:290] T f1b10566f45d4a7d9029858330e02d5b P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
W20260709 13:06:07.574574 20077 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.683s	user 0.029s	sys 0.047s
I20260709 13:06:07.559183 19481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9f0d59553ad444883fcf5b5909f9798" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
W20260709 13:06:07.601140 20077 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.710s	user 0.029s	sys 0.055s
I20260709 13:06:07.562398 20110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f85fc4b527a48848e5faa083b604e36" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 10 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:06:07.571907 19477 raft_consensus.cc:1240] T 2725d2c4cb054f18b0fc8f735c15f6c2 P 0473d2b2d01f4459b1e90fd12cc7840e [term 13 FOLLOWER]: Rejecting Update request from peer e5256d91808b47c195bc9b4dbd7f2b87 for earlier term 12. Current term is 13. Ops: [10.5-12.6]
I20260709 13:06:07.567272 19478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4509b76741dc428e9201c70c1658da13" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
W20260709 13:06:07.574046 19559 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.655s	user 0.034s	sys 0.025s
W20260709 13:06:07.607232 19559 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.688s	user 0.039s	sys 0.026s
I20260709 13:06:07.600502 19479 raft_consensus.cc:2468] T 7f575b143b844aa096b50997dad3516a P 0473d2b2d01f4459b1e90fd12cc7840e [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 7.
I20260709 13:06:07.609292 19479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a08760e15aac4630a629431f56024dc8" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:06:07.609992 19479 raft_consensus.cc:2468] T a08760e15aac4630a629431f56024dc8 P 0473d2b2d01f4459b1e90fd12cc7840e [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 13.
I20260709 13:06:07.611579 19479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab43d85f64114d4ebf618930e43d9ed0" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 12 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:06:07.612164 19479 raft_consensus.cc:2468] T ab43d85f64114d4ebf618930e43d9ed0 P 0473d2b2d01f4459b1e90fd12cc7840e [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 11.
I20260709 13:06:07.612767 19478 raft_consensus.cc:2368] T 4509b76741dc428e9201c70c1658da13 P 0473d2b2d01f4459b1e90fd12cc7840e [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e5256d91808b47c195bc9b4dbd7f2b87 for earlier term 5. Current term is 6.
I20260709 13:06:07.608345 23619 raft_consensus.cc:493] T 14935b3ddf914369822e4a0547aaa355 P e5256d91808b47c195bc9b4dbd7f2b87 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 127766fc592545a4997f7790f50f6076)
I20260709 13:06:07.617758 23619 raft_consensus.cc:515] T 14935b3ddf914369822e4a0547aaa355 P e5256d91808b47c195bc9b4dbd7f2b87 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } attrs { replace: true } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:07.618955 20112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab43d85f64114d4ebf618930e43d9ed0" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 12 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:06:07.619570 20112 raft_consensus.cc:2468] T ab43d85f64114d4ebf618930e43d9ed0 P 127766fc592545a4997f7790f50f6076 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 11.
W20260709 13:06:07.620934 23737 log.cc:927] Time spent T 70797e5783b5454ab0d0eea663e791e3 P e5256d91808b47c195bc9b4dbd7f2b87: Append to log took a long time: real 0.116s	user 0.001s	sys 0.000s
I20260709 13:06:07.610726 23709 consensus_queue.cc:1048] T 1f85fc4b527a48848e5faa083b604e36 P 127766fc592545a4997f7790f50f6076 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.013s
I20260709 13:06:07.555250 23587 raft_consensus.cc:740] T 65d8cb8d6ec64f459d5a47cefab10acf P e5256d91808b47c195bc9b4dbd7f2b87 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: e5256d91808b47c195bc9b4dbd7f2b87, State: Running, Role: LEADER
I20260709 13:06:07.625978 23587 consensus_queue.cc:260] T 65d8cb8d6ec64f459d5a47cefab10acf P e5256d91808b47c195bc9b4dbd7f2b87 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 7, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:07.627252 23587 raft_consensus.cc:3060] T 65d8cb8d6ec64f459d5a47cefab10acf P e5256d91808b47c195bc9b4dbd7f2b87 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:06:07.567621 23714 raft_consensus.cc:515] T 2b74109013a140ada21feeef92d6f563 P 0473d2b2d01f4459b1e90fd12cc7840e [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:07.634404 23698 leader_election.cc:290] T 4509b76741dc428e9201c70c1658da13 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 6 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:06:07.636812 23619 leader_election.cc:290] T 14935b3ddf914369822e4a0547aaa355 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:06:07.564466 23708 consensus_queue.cc:1048] T ed7fdbcb96d14d418db9ca90a792588a P 127766fc592545a4997f7790f50f6076 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.075s
I20260709 13:06:07.632754 23714 leader_election.cc:290] T 2b74109013a140ada21feeef92d6f563 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 8 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
W20260709 13:06:07.565889 23735 log.cc:927] Time spent T 7f575b143b844aa096b50997dad3516a P e5256d91808b47c195bc9b4dbd7f2b87: Append to log took a long time: real 0.061s	user 0.000s	sys 0.000s
I20260709 13:06:07.643162 19484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21e14947d70440f19044d8f75c31e1f9" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:06:07.644182 19484 raft_consensus.cc:2368] T 21e14947d70440f19044d8f75c31e1f9 P 0473d2b2d01f4459b1e90fd12cc7840e [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate e5256d91808b47c195bc9b4dbd7f2b87 for earlier term 10. Current term is 11.
W20260709 13:06:07.648311 23622 consensus_meta.cc:287] T 7be9efa6559648dbb5a0f7684c4542d1 P 0473d2b2d01f4459b1e90fd12cc7840e: Time spent flushing consensus metadata: real 0.848s	user 0.010s	sys 0.003s
I20260709 13:06:07.650060 23443 leader_election.cc:290] T 2725d2c4cb054f18b0fc8f735c15f6c2 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:06:07.651914 19484 raft_consensus.cc:1275] T 775c229504194560ba9589bc2199b089 P 0473d2b2d01f4459b1e90fd12cc7840e [term 9 FOLLOWER]: Refusing update from remote peer e5256d91808b47c195bc9b4dbd7f2b87: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:06:07.655997 20110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff9b0eddd810459b82d91c60777c10eb" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:06:07.665082 20110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14935b3ddf914369822e4a0547aaa355" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
W20260709 13:06:07.667833 23554 consensus_meta.cc:287] T 65d8cb8d6ec64f459d5a47cefab10acf P 127766fc592545a4997f7790f50f6076: Time spent flushing consensus metadata: real 0.769s	user 0.009s	sys 0.004s
I20260709 13:06:07.668326 23554 raft_consensus.cc:2749] T 65d8cb8d6ec64f459d5a47cefab10acf P 127766fc592545a4997f7790f50f6076 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:06:07.708843 19486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff75a1d4cb1f493db8f71ddc136ba9ab" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
W20260709 13:06:07.732060 19374 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:07.752477 19375 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:07.825727 19482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f93ee515a9c14139bf566522ed8232f3" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 15 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:06:07.830170 19479 pending_rounds.cc:85] T 5ec1c4ce15e04c7e8c283a62179f2a64 P 0473d2b2d01f4459b1e90fd12cc7840e: Aborting all ops after (but not including) 6
I20260709 13:06:07.830560 19479 pending_rounds.cc:107] T 5ec1c4ce15e04c7e8c283a62179f2a64 P 0473d2b2d01f4459b1e90fd12cc7840e: Aborting uncommitted NO_OP operation due to leader change: 6.7
I20260709 13:06:07.830854 19479 raft_consensus.cc:2889] T 5ec1c4ce15e04c7e8c283a62179f2a64 P 0473d2b2d01f4459b1e90fd12cc7840e [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:06:07.831631 23749 raft_consensus.cc:493] T 0e1085d23e8347fbbd5bce7542f4b1f4 P 0473d2b2d01f4459b1e90fd12cc7840e [term 8 FOLLOWER]: Starting pre-election (detected failure of leader e61c3a8f61bb48f8a963c9480e53c168)
I20260709 13:06:07.832077 23749 raft_consensus.cc:515] T 0e1085d23e8347fbbd5bce7542f4b1f4 P 0473d2b2d01f4459b1e90fd12cc7840e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:07.834314 23749 leader_election.cc:290] T 0e1085d23e8347fbbd5bce7542f4b1f4 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
W20260709 13:06:07.855619 19452 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:07.917136 19480 raft_consensus.cc:2468] T 7be9efa6559648dbb5a0f7684c4542d1 P 0473d2b2d01f4459b1e90fd12cc7840e [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 127766fc592545a4997f7790f50f6076 in term 12.
I20260709 13:06:07.927470 23740 raft_consensus.cc:493] T 62c6c134d3d24a1ab144dd9ee6bc3f64 P 0473d2b2d01f4459b1e90fd12cc7840e [term 10 FOLLOWER]: Starting pre-election (detected failure of leader e61c3a8f61bb48f8a963c9480e53c168)
I20260709 13:06:07.928118 23740 raft_consensus.cc:515] T 62c6c134d3d24a1ab144dd9ee6bc3f64 P 0473d2b2d01f4459b1e90fd12cc7840e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:07.929994 23740 leader_election.cc:290] T 62c6c134d3d24a1ab144dd9ee6bc3f64 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:06:07.941480 23443 raft_consensus.cc:493] T 9962423cb4e54fcfa5de01daf68a86e7 P e5256d91808b47c195bc9b4dbd7f2b87 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 127766fc592545a4997f7790f50f6076)
I20260709 13:06:07.942160 23443 raft_consensus.cc:515] T 9962423cb4e54fcfa5de01daf68a86e7 P e5256d91808b47c195bc9b4dbd7f2b87 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:07.944226 23443 leader_election.cc:290] T 9962423cb4e54fcfa5de01daf68a86e7 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:06:07.947118 23740 raft_consensus.cc:493] T 40e1e16737a842ee936002830f36882e P 0473d2b2d01f4459b1e90fd12cc7840e [term 14 FOLLOWER]: Starting pre-election (detected failure of leader e61c3a8f61bb48f8a963c9480e53c168)
I20260709 13:06:07.947710 23740 raft_consensus.cc:515] T 40e1e16737a842ee936002830f36882e P 0473d2b2d01f4459b1e90fd12cc7840e [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:07.950372 23740 leader_election.cc:290] T 40e1e16737a842ee936002830f36882e P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:06:07.953393 23443 raft_consensus.cc:493] T 1f85fc4b527a48848e5faa083b604e36 P e5256d91808b47c195bc9b4dbd7f2b87 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 127766fc592545a4997f7790f50f6076)
I20260709 13:06:07.954016 23443 raft_consensus.cc:515] T 1f85fc4b527a48848e5faa083b604e36 P e5256d91808b47c195bc9b4dbd7f2b87 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:07.956837 23443 leader_election.cc:290] T 1f85fc4b527a48848e5faa083b604e36 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:06:07.560236 19409 raft_consensus.cc:1240] T b9f0d59553ad444883fcf5b5909f9798 P e5256d91808b47c195bc9b4dbd7f2b87 [term 12 FOLLOWER]: Rejecting Update request from peer 0473d2b2d01f4459b1e90fd12cc7840e for earlier term 11. Current term is 12. Ops: []
I20260709 13:06:07.964407 19477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40e1e16737a842ee936002830f36882e" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:06:07.965142 19477 raft_consensus.cc:2468] T 40e1e16737a842ee936002830f36882e P 0473d2b2d01f4459b1e90fd12cc7840e [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 14.
I20260709 13:06:07.966971 19410 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49050 (request call id 646) took 1213 ms. Trace:
I20260709 13:06:07.967298 19410 rpcz_store.cc:276] 0709 13:06:06.753430 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:07.966348 (+1212918us) service_pool.cc:224] Handling call
0709 13:06:07.966576 (+   228us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:07.966744 (+   168us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:07.966772 (+    28us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:07.966805 (+    33us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:06:07.966823 (+    18us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:07.966859 (+    36us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:07.966932 (+    73us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:07.559715 19402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "309c3ca0ca4b4f3ba129752ea2cb293b" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:06:07.998421 23685 raft_consensus.cc:515] T 2b74109013a140ada21feeef92d6f563 P e5256d91808b47c195bc9b4dbd7f2b87 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:07.999744 19404 raft_consensus.cc:2468] T 2b74109013a140ada21feeef92d6f563 P e5256d91808b47c195bc9b4dbd7f2b87 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 7.
I20260709 13:06:08.003899 23685 leader_election.cc:290] T 2b74109013a140ada21feeef92d6f563 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 7 election: Requested vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
W20260709 13:06:08.011855 19297 tablet_replica.cc:1411] Time spent flushing the Log queue took a long time: real 0.229s	user 0.000s	sys 0.000s
W20260709 13:06:08.019660 19449 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.4:43121, user_credentials={real_user=slave}} blocked reactor thread for 417866us
I20260709 13:06:08.020942 19449 leader_election.cc:304] T 14935b3ddf914369822e4a0547aaa355 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e; no voters: 127766fc592545a4997f7790f50f6076, e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:06:08.022104 19449 leader_election.cc:304] T 1f85fc4b527a48848e5faa083b604e36 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e; no voters: 127766fc592545a4997f7790f50f6076, e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:06:08.023003 23725 raft_consensus.cc:2749] T 14935b3ddf914369822e4a0547aaa355 P 0473d2b2d01f4459b1e90fd12cc7840e [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:06:08.029278 19404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b74109013a140ada21feeef92d6f563" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
I20260709 13:06:08.029897 19404 raft_consensus.cc:3060] T 2b74109013a140ada21feeef92d6f563 P e5256d91808b47c195bc9b4dbd7f2b87 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:06:08.033905 23725 raft_consensus.cc:2749] T 1f85fc4b527a48848e5faa083b604e36 P 0473d2b2d01f4459b1e90fd12cc7840e [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:06:08.040375 19477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff9b0eddd810459b82d91c60777c10eb" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:06:08.041046 19477 raft_consensus.cc:2468] T ff9b0eddd810459b82d91c60777c10eb P 0473d2b2d01f4459b1e90fd12cc7840e [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 11.
I20260709 13:06:08.042918 23465 raft_consensus.cc:493] T e381f1d6b8184797ad142de49be225a8 P e5256d91808b47c195bc9b4dbd7f2b87 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader e61c3a8f61bb48f8a963c9480e53c168)
I20260709 13:06:08.043576 23465 raft_consensus.cc:515] T e381f1d6b8184797ad142de49be225a8 P e5256d91808b47c195bc9b4dbd7f2b87 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
W20260709 13:06:08.045993 19432 debug-util.cc:398] Leaking SignalData structure 0x7b0800193620 after lost signal to thread 18303
W20260709 13:06:08.047644 19432 debug-util.cc:398] Leaking SignalData structure 0x7b08001dd100 after lost signal to thread 19343
W20260709 13:06:08.049571 19432 debug-util.cc:398] Leaking SignalData structure 0x7b0800267960 after lost signal to thread 19435
W20260709 13:06:08.049973 19432 debug-util.cc:398] Leaking SignalData structure 0x7b0800315840 after lost signal to thread 19436
W20260709 13:06:08.051091 19432 debug-util.cc:398] Leaking SignalData structure 0x7b0800381ea0 after lost signal to thread 19510
W20260709 13:06:08.051337 19432 debug-util.cc:398] Leaking SignalData structure 0x7b0800383520 after lost signal to thread 19511
I20260709 13:06:08.053367 23443 raft_consensus.cc:493] T 1dc5b3532fe54f74876d02beffa2c230 P e5256d91808b47c195bc9b4dbd7f2b87 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:08.053936 23443 raft_consensus.cc:515] T 1dc5b3532fe54f74876d02beffa2c230 P e5256d91808b47c195bc9b4dbd7f2b87 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:08.056854 23443 leader_election.cc:290] T 1dc5b3532fe54f74876d02beffa2c230 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:06:08.057421 23443 raft_consensus.cc:493] T 14efcc79969f41babe5529c22d59156d P e5256d91808b47c195bc9b4dbd7f2b87 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:08.057922 23443 raft_consensus.cc:515] T 14efcc79969f41babe5529c22d59156d P e5256d91808b47c195bc9b4dbd7f2b87 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:06.983865 23549 raft_consensus.cc:515] T 1a61655d99124a29b486ba4a5b37faea P e5256d91808b47c195bc9b4dbd7f2b87 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:08.065078 23443 leader_election.cc:290] T 14efcc79969f41babe5529c22d59156d P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:06:08.065702 23443 raft_consensus.cc:493] T edd7d470b5014c9489be7f41f64355c9 P e5256d91808b47c195bc9b4dbd7f2b87 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader e61c3a8f61bb48f8a963c9480e53c168)
I20260709 13:06:08.066200 23443 raft_consensus.cc:515] T edd7d470b5014c9489be7f41f64355c9 P e5256d91808b47c195bc9b4dbd7f2b87 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:08.068465 23443 leader_election.cc:290] T edd7d470b5014c9489be7f41f64355c9 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:06:08.078704 19402 raft_consensus.cc:1275] T f93ee515a9c14139bf566522ed8232f3 P e5256d91808b47c195bc9b4dbd7f2b87 [term 15 FOLLOWER]: Refusing update from remote peer 0473d2b2d01f4459b1e90fd12cc7840e: Log matching property violated. Preceding OpId in replica: term: 13 index: 6. Preceding OpId from leader: term: 15 index: 7. (index mismatch)
I20260709 13:06:08.080238 19411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40e1e16737a842ee936002830f36882e" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:06:08.104137 23663 leader_election.cc:290] T 309c3ca0ca4b4f3ba129752ea2cb293b P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:06:08.105764 19402 raft_consensus.cc:3055] T 172b3dd13109415a955b71ac0e9d2234 P e5256d91808b47c195bc9b4dbd7f2b87 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:06:08.083555 23670 raft_consensus.cc:493] T d1e5873a19244c5ebbcd38e126796ee7 P e5256d91808b47c195bc9b4dbd7f2b87 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:08.106489 23670 raft_consensus.cc:515] T d1e5873a19244c5ebbcd38e126796ee7 P e5256d91808b47c195bc9b4dbd7f2b87 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:08.108560 23670 leader_election.cc:290] T d1e5873a19244c5ebbcd38e126796ee7 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:06:08.089850 23717 raft_consensus.cc:493] T 1a61655d99124a29b486ba4a5b37faea P 0473d2b2d01f4459b1e90fd12cc7840e [term 7 FOLLOWER]: Starting pre-election (detected failure of leader e61c3a8f61bb48f8a963c9480e53c168)
I20260709 13:06:08.062631 23549 leader_election.cc:290] T 1a61655d99124a29b486ba4a5b37faea P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:06:08.109315 23717 raft_consensus.cc:515] T 1a61655d99124a29b486ba4a5b37faea P 0473d2b2d01f4459b1e90fd12cc7840e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:08.109884 19405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4509b76741dc428e9201c70c1658da13" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
I20260709 13:06:08.110508 19405 raft_consensus.cc:3060] T 4509b76741dc428e9201c70c1658da13 P e5256d91808b47c195bc9b4dbd7f2b87 [term 4 FOLLOWER]: Advancing to term 6
I20260709 13:06:08.090593 23714 raft_consensus.cc:493] T d1e5873a19244c5ebbcd38e126796ee7 P 0473d2b2d01f4459b1e90fd12cc7840e [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:08.111836 23714 raft_consensus.cc:515] T d1e5873a19244c5ebbcd38e126796ee7 P 0473d2b2d01f4459b1e90fd12cc7840e [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:08.114320 19402 raft_consensus.cc:740] T 172b3dd13109415a955b71ac0e9d2234 P e5256d91808b47c195bc9b4dbd7f2b87 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: e5256d91808b47c195bc9b4dbd7f2b87, State: Running, Role: LEADER
W20260709 13:06:08.114948 19432 debug-util.cc:398] Leaking SignalData structure 0x7b08003a8ae0 after lost signal to thread 19557
W20260709 13:06:08.115679 19432 debug-util.cc:398] Leaking SignalData structure 0x7b080032a880 after lost signal to thread 19584
W20260709 13:06:08.115937 19432 debug-util.cc:398] Leaking SignalData structure 0x7b08003854a0 after lost signal to thread 19585
I20260709 13:06:08.117027 19402 consensus_queue.cc:260] T 172b3dd13109415a955b71ac0e9d2234 P e5256d91808b47c195bc9b4dbd7f2b87 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:08.118180 19402 raft_consensus.cc:3060] T 172b3dd13109415a955b71ac0e9d2234 P e5256d91808b47c195bc9b4dbd7f2b87 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:06:08.090996 19449 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:08.091421 23492 leader_election.cc:290] T ab43d85f64114d4ebf618930e43d9ed0 P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:06:08.094152 19410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab43d85f64114d4ebf618930e43d9ed0" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 12 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:06:08.120056 19410 raft_consensus.cc:2468] T ab43d85f64114d4ebf618930e43d9ed0 P e5256d91808b47c195bc9b4dbd7f2b87 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 127766fc592545a4997f7790f50f6076 in term 11.
I20260709 13:06:08.094843 19409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "833a2f0775ed407a94b8924ce50adb63" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
I20260709 13:06:08.123903 19410 raft_consensus.cc:1275] T 28af091831594f9d8e96482078cc7625 P e5256d91808b47c195bc9b4dbd7f2b87 [term 12 FOLLOWER]: Refusing update from remote peer 0473d2b2d01f4459b1e90fd12cc7840e: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 12 index: 6. (index mismatch)
I20260709 13:06:08.096880 19403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "172b3dd13109415a955b71ac0e9d2234" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
I20260709 13:06:08.100716 19404 raft_consensus.cc:2468] T 2b74109013a140ada21feeef92d6f563 P e5256d91808b47c195bc9b4dbd7f2b87 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 8.
I20260709 13:06:08.101212 23685 raft_consensus.cc:493] T 2e36a9d6e29c4a7c860cf267efbd4c74 P e5256d91808b47c195bc9b4dbd7f2b87 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader e61c3a8f61bb48f8a963c9480e53c168)
I20260709 13:06:08.126739 23685 raft_consensus.cc:515] T 2e36a9d6e29c4a7c860cf267efbd4c74 P e5256d91808b47c195bc9b4dbd7f2b87 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:08.128901 23685 leader_election.cc:290] T 2e36a9d6e29c4a7c860cf267efbd4c74 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
W20260709 13:06:08.117043 19432 debug-util.cc:398] Leaking SignalData structure 0x7b08003ed8c0 after lost signal to thread 20136
W20260709 13:06:08.129942 19432 debug-util.cc:398] Leaking SignalData structure 0x7b080029f0e0 after lost signal to thread 20137
W20260709 13:06:08.130332 19432 debug-util.cc:398] Leaking SignalData structure 0x7b08001f5040 after lost signal to thread 23505
W20260709 13:06:08.130934 19432 debug-util.cc:398] Leaking SignalData structure 0x7b0800257120 after lost signal to thread 23672
I20260709 13:06:08.081668 23465 leader_election.cc:290] T e381f1d6b8184797ad142de49be225a8 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:06:08.105690 19377 leader_election.cc:304] T 0cdf56e38bbc453d9438d359e5a69955 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:06:08.137583 19377 leader_election.cc:304] T 76cb037fc9064d13b59a8969d897ce8c P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87; no voters: e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:06:08.140057 19377 leader_election.cc:304] T 217b5fae677b4971b3bbd2f357a1f7ff P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87; no voters: e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:06:08.140825 23605 raft_consensus.cc:2749] T 0cdf56e38bbc453d9438d359e5a69955 P e5256d91808b47c195bc9b4dbd7f2b87 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:06:08.141494 23605 raft_consensus.cc:2804] T 76cb037fc9064d13b59a8969d897ce8c P e5256d91808b47c195bc9b4dbd7f2b87 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:06:08.141822 23605 raft_consensus.cc:493] T 76cb037fc9064d13b59a8969d897ce8c P e5256d91808b47c195bc9b4dbd7f2b87 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:08.142150 23605 raft_consensus.cc:3060] T 76cb037fc9064d13b59a8969d897ce8c P e5256d91808b47c195bc9b4dbd7f2b87 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:06:08.142261 23378 leader_election.cc:290] T ef32ce6fdd0e40d382c79974f30295c6 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 13 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:06:08.146888 23619 raft_consensus.cc:2804] T 217b5fae677b4971b3bbd2f357a1f7ff P e5256d91808b47c195bc9b4dbd7f2b87 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:06:08.147403 23619 raft_consensus.cc:493] T 217b5fae677b4971b3bbd2f357a1f7ff P e5256d91808b47c195bc9b4dbd7f2b87 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:08.147761 23619 raft_consensus.cc:3060] T 217b5fae677b4971b3bbd2f357a1f7ff P e5256d91808b47c195bc9b4dbd7f2b87 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:06:08.157601 23360 raft_consensus.cc:3055] T 6c5eebf646ad445a9d1b1adc319d7b16 P e61c3a8f61bb48f8a963c9480e53c168 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:06:08.158118 23360 raft_consensus.cc:740] T 6c5eebf646ad445a9d1b1adc319d7b16 P e61c3a8f61bb48f8a963c9480e53c168 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: e61c3a8f61bb48f8a963c9480e53c168, State: Running, Role: LEADER
I20260709 13:06:08.159050 23360 consensus_queue.cc:260] T 6c5eebf646ad445a9d1b1adc319d7b16 P e61c3a8f61bb48f8a963c9480e53c168 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:08.160554 23360 raft_consensus.cc:3060] T 6c5eebf646ad445a9d1b1adc319d7b16 P e61c3a8f61bb48f8a963c9480e53c168 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:06:08.163802 19404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a61655d99124a29b486ba4a5b37faea" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:06:08.165498 19404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e5873a19244c5ebbcd38e126796ee7" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:06:08.166023 19404 raft_consensus.cc:2468] T d1e5873a19244c5ebbcd38e126796ee7 P e5256d91808b47c195bc9b4dbd7f2b87 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 12.
I20260709 13:06:08.167537 19404 raft_consensus.cc:1275] T bc225c93219c45538b53a1bd3d387e4d P e5256d91808b47c195bc9b4dbd7f2b87 [term 11 FOLLOWER]: Refusing update from remote peer 0473d2b2d01f4459b1e90fd12cc7840e: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
W20260709 13:06:08.173983 19374 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:08.185647 19406 consensus_meta.cc:287] T 7be9efa6559648dbb5a0f7684c4542d1 P e5256d91808b47c195bc9b4dbd7f2b87: Time spent flushing consensus metadata: real 1.651s	user 0.012s	sys 0.004s
I20260709 13:06:08.186744 19402 raft_consensus.cc:1275] T 172b3dd13109415a955b71ac0e9d2234 P e5256d91808b47c195bc9b4dbd7f2b87 [term 11 FOLLOWER]: Refusing update from remote peer 127766fc592545a4997f7790f50f6076: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 11 index: 9. (term mismatch)
I20260709 13:06:08.187206 19402 pending_rounds.cc:85] T 172b3dd13109415a955b71ac0e9d2234 P e5256d91808b47c195bc9b4dbd7f2b87: Aborting all ops after (but not including) 8
I20260709 13:06:08.187490 19402 pending_rounds.cc:107] T 172b3dd13109415a955b71ac0e9d2234 P e5256d91808b47c195bc9b4dbd7f2b87: Aborting uncommitted NO_OP operation due to leader change: 10.9
I20260709 13:06:08.187788 19402 raft_consensus.cc:2889] T 172b3dd13109415a955b71ac0e9d2234 P e5256d91808b47c195bc9b4dbd7f2b87 [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:06:08.195813 19404 raft_consensus.cc:1275] T fa731b585f684a7fb2d106c50f143b83 P e5256d91808b47c195bc9b4dbd7f2b87 [term 10 FOLLOWER]: Refusing update from remote peer 127766fc592545a4997f7790f50f6076: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:06:08.194660 19405 raft_consensus.cc:2468] T 4509b76741dc428e9201c70c1658da13 P e5256d91808b47c195bc9b4dbd7f2b87 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 6.
I20260709 13:06:08.195964 23619 raft_consensus.cc:515] T 217b5fae677b4971b3bbd2f357a1f7ff P e5256d91808b47c195bc9b4dbd7f2b87 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:08.201525 23619 leader_election.cc:290] T 217b5fae677b4971b3bbd2f357a1f7ff P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 9 election: Requested vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
W20260709 13:06:08.216506 19526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.2:46257, user_credentials={real_user=slave}} blocked reactor thread for 1.24013e+06us
I20260709 13:06:08.235893 19406 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52342 (request call id 2462) took 1722 ms. Trace:
I20260709 13:06:08.236413 19406 rpcz_store.cc:276] 0709 13:06:06.506269 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:06.529026 (+ 22757us) service_pool.cc:224] Handling call
0709 13:06:06.531769 (+  2743us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:06.532069 (+   300us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:06:08.186330 (+1654261us) log.cc:844] Serialized 14 byte log entry
0709 13:06:08.227168 (+ 40838us) log.cc:844] Serialized 14 byte log entry
0709 13:06:08.227751 (+   583us) log.cc:844] Serialized 14 byte log entry
0709 13:06:08.228009 (+   258us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:08.228054 (+    45us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:06:08.228097 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:08.228162 (+    65us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:08.228273 (+   111us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":245,"prepare.run_cpu_time_us":53,"prepare.run_wall_time_us":54,"raft.queue_time_us":2414,"raft.run_cpu_time_us":247,"raft.run_wall_time_us":3167,"thread_start_us":27314,"threads_started":1}
I20260709 13:06:08.229140 23443 raft_consensus.cc:493] T 7be9efa6559648dbb5a0f7684c4542d1 P e5256d91808b47c195bc9b4dbd7f2b87 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 0473d2b2d01f4459b1e90fd12cc7840e)
I20260709 13:06:08.232848 23605 raft_consensus.cc:515] T 76cb037fc9064d13b59a8969d897ce8c P e5256d91808b47c195bc9b4dbd7f2b87 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:08.273649 23605 leader_election.cc:290] T 76cb037fc9064d13b59a8969d897ce8c P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 11 election: Requested vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:06:08.225560 23638 consensus_queue.cc:1048] T 172b3dd13109415a955b71ac0e9d2234 P 127766fc592545a4997f7790f50f6076 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.012s
I20260709 13:06:08.231539 19297 maintenance_manager.cc:643] P 97750b77d35444acb7791ebf26cc2685: FlushMRSOp(00000000000000000000000000000000) complete. Timing: real 3.630s	user 0.162s	sys 0.067s Metrics: {"bytes_written":29995,"cfile_init":1,"delete_count":0,"dirs.queue_time_us":145028,"dirs.run_cpu_time_us":342,"dirs.run_wall_time_us":3902,"drs_written":1,"lbm_read_time_us":372,"lbm_reads_lt_1ms":4,"lbm_write_time_us":101035,"lbm_writes_1-10_ms":2,"lbm_writes_10-100_ms":4,"lbm_writes_lt_1ms":28,"peak_mem_usage":0,"reinsert_count":0,"rows_written":63,"thread_start_us":239456,"threads_started":1,"update_count":7}
I20260709 13:06:08.283591 23687 raft_consensus.cc:493] T 85c494af21f9457a85da47b9bc70c1fd P e5256d91808b47c195bc9b4dbd7f2b87 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 127766fc592545a4997f7790f50f6076)
I20260709 13:06:08.284387 23687 raft_consensus.cc:515] T 85c494af21f9457a85da47b9bc70c1fd P e5256d91808b47c195bc9b4dbd7f2b87 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:08.286180 19298 maintenance_manager.cc:419] P 97750b77d35444acb7791ebf26cc2685: Scheduling UndoDeltaBlockGCOp(00000000000000000000000000000000): 9730 bytes on disk
I20260709 13:06:08.225590 23492 consensus_queue.cc:1048] T fa731b585f684a7fb2d106c50f143b83 P 127766fc592545a4997f7790f50f6076 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.013s
I20260709 13:06:08.313097 19377 leader_election.cc:304] T 3e1f505cb0f1427bbd698ac889d80821 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87; no voters: e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:06:08.310568 23443 raft_consensus.cc:515] T 7be9efa6559648dbb5a0f7684c4542d1 P e5256d91808b47c195bc9b4dbd7f2b87 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } attrs { replace: true } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:08.314895 19377 leader_election.cc:304] T 7f575b143b844aa096b50997dad3516a P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87; no voters: e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:06:08.315718 23692 raft_consensus.cc:2804] T 3e1f505cb0f1427bbd698ac889d80821 P e5256d91808b47c195bc9b4dbd7f2b87 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:06:08.316076 19377 leader_election.cc:304] T a08760e15aac4630a629431f56024dc8 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87; no voters: 
I20260709 13:06:08.316102 23692 raft_consensus.cc:493] T 3e1f505cb0f1427bbd698ac889d80821 P e5256d91808b47c195bc9b4dbd7f2b87 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:08.316736 23692 raft_consensus.cc:3060] T 3e1f505cb0f1427bbd698ac889d80821 P e5256d91808b47c195bc9b4dbd7f2b87 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:06:08.316886 23619 raft_consensus.cc:2804] T 7f575b143b844aa096b50997dad3516a P e5256d91808b47c195bc9b4dbd7f2b87 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:06:08.317370 23605 raft_consensus.cc:2804] T a08760e15aac4630a629431f56024dc8 P e5256d91808b47c195bc9b4dbd7f2b87 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:06:08.317399 23619 raft_consensus.cc:493] T 7f575b143b844aa096b50997dad3516a P e5256d91808b47c195bc9b4dbd7f2b87 [term 7 FOLLOWER]: Starting leader election (detected failure of leader e61c3a8f61bb48f8a963c9480e53c168)
I20260709 13:06:08.318019 23605 raft_consensus.cc:493] T a08760e15aac4630a629431f56024dc8 P e5256d91808b47c195bc9b4dbd7f2b87 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:08.318571 23605 raft_consensus.cc:3060] T a08760e15aac4630a629431f56024dc8 P e5256d91808b47c195bc9b4dbd7f2b87 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:06:08.319271 23414 raft_consensus.cc:493] T f1b10566f45d4a7d9029858330e02d5b P 0473d2b2d01f4459b1e90fd12cc7840e [term 12 FOLLOWER]: Starting pre-election (detected failure of leader e61c3a8f61bb48f8a963c9480e53c168)
I20260709 13:06:08.319895 19478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9f0d59553ad444883fcf5b5909f9798" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:06:08.319775 23414 raft_consensus.cc:515] T f1b10566f45d4a7d9029858330e02d5b P 0473d2b2d01f4459b1e90fd12cc7840e [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:08.310976 23740 raft_consensus.cc:493] T 2e36a9d6e29c4a7c860cf267efbd4c74 P 0473d2b2d01f4459b1e90fd12cc7840e [term 8 FOLLOWER]: Starting pre-election (detected failure of leader e61c3a8f61bb48f8a963c9480e53c168)
I20260709 13:06:08.320683 23740 raft_consensus.cc:515] T 2e36a9d6e29c4a7c860cf267efbd4c74 P 0473d2b2d01f4459b1e90fd12cc7840e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:08.321676 19478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1b10566f45d4a7d9029858330e02d5b" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:06:08.321935 23414 leader_election.cc:290] T f1b10566f45d4a7d9029858330e02d5b P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:06:08.322424 19478 raft_consensus.cc:2410] T f1b10566f45d4a7d9029858330e02d5b P 0473d2b2d01f4459b1e90fd12cc7840e [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e5256d91808b47c195bc9b4dbd7f2b87 for term 13 because replica has last-logged OpId of term: 12 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 7.
I20260709 13:06:08.318071 23619 raft_consensus.cc:3060] T 7f575b143b844aa096b50997dad3516a P e5256d91808b47c195bc9b4dbd7f2b87 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:06:08.324373 19406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1b10566f45d4a7d9029858330e02d5b" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:06:08.329562 19483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14935b3ddf914369822e4a0547aaa355" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:06:08.339027 19406 raft_consensus.cc:2468] T f1b10566f45d4a7d9029858330e02d5b P e5256d91808b47c195bc9b4dbd7f2b87 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 12.
I20260709 13:06:08.330894 19297 maintenance_manager.cc:643] P 97750b77d35444acb7791ebf26cc2685: UndoDeltaBlockGCOp(00000000000000000000000000000000) complete. Timing: real 0.035s	user 0.001s	sys 0.001s Metrics: {"cfile_init":1,"lbm_read_time_us":423,"lbm_reads_lt_1ms":4}
W20260709 13:06:08.339927 19375 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:08.322582 23740 leader_election.cc:290] T 2e36a9d6e29c4a7c860cf267efbd4c74 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:06:08.316987 19377 leader_election.cc:304] T ab43d85f64114d4ebf618930e43d9ed0 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, 127766fc592545a4997f7790f50f6076, e5256d91808b47c195bc9b4dbd7f2b87; no voters: 
I20260709 13:06:08.327457 23687 leader_election.cc:290] T 85c494af21f9457a85da47b9bc70c1fd P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:06:08.342469 19481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9962423cb4e54fcfa5de01daf68a86e7" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:06:08.343941 19483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2725d2c4cb054f18b0fc8f735c15f6c2" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:06:08.344762 19483 raft_consensus.cc:2468] T 2725d2c4cb054f18b0fc8f735c15f6c2 P 0473d2b2d01f4459b1e90fd12cc7840e [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 13.
I20260709 13:06:08.345222 23605 raft_consensus.cc:515] T a08760e15aac4630a629431f56024dc8 P e5256d91808b47c195bc9b4dbd7f2b87 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:08.324806 19407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e36a9d6e29c4a7c860cf267efbd4c74" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:06:08.347210 19407 raft_consensus.cc:2468] T 2e36a9d6e29c4a7c860cf267efbd4c74 P e5256d91808b47c195bc9b4dbd7f2b87 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 8.
I20260709 13:06:08.348531 23685 raft_consensus.cc:2804] T ab43d85f64114d4ebf618930e43d9ed0 P e5256d91808b47c195bc9b4dbd7f2b87 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:06:08.349067 23685 raft_consensus.cc:493] T ab43d85f64114d4ebf618930e43d9ed0 P e5256d91808b47c195bc9b4dbd7f2b87 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:08.349514 23685 raft_consensus.cc:3060] T ab43d85f64114d4ebf618930e43d9ed0 P e5256d91808b47c195bc9b4dbd7f2b87 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:06:08.324285 19478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f93ee515a9c14139bf566522ed8232f3" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 15 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:06:08.353344 19485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f85fc4b527a48848e5faa083b604e36" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:06:08.353953 19485 raft_consensus.cc:2468] T 1f85fc4b527a48848e5faa083b604e36 P 0473d2b2d01f4459b1e90fd12cc7840e [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 9.
I20260709 13:06:08.356038 19485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b74109013a140ada21feeef92d6f563" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:06:08.356650 19485 raft_consensus.cc:2368] T 2b74109013a140ada21feeef92d6f563 P 0473d2b2d01f4459b1e90fd12cc7840e [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate e5256d91808b47c195bc9b4dbd7f2b87 for earlier term 7. Current term is 8.
I20260709 13:06:08.356752 19377 leader_election.cc:400] T 21e14947d70440f19044d8f75c31e1f9 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 10 election: Vote denied by peer 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257) with higher term. Message: Invalid argument: T 21e14947d70440f19044d8f75c31e1f9 P 0473d2b2d01f4459b1e90fd12cc7840e [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate e5256d91808b47c195bc9b4dbd7f2b87 for earlier term 10. Current term is 11.
I20260709 13:06:08.358305 19485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e381f1d6b8184797ad142de49be225a8" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:06:08.358925 19485 raft_consensus.cc:2468] T e381f1d6b8184797ad142de49be225a8 P 0473d2b2d01f4459b1e90fd12cc7840e [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 8.
I20260709 13:06:08.362428 19481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edd7d470b5014c9489be7f41f64355c9" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 12 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:06:08.363085 19377 leader_election.cc:304] T ff75a1d4cb1f493db8f71ddc136ba9ab P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:06:08.363176 19481 raft_consensus.cc:2468] T edd7d470b5014c9489be7f41f64355c9 P 0473d2b2d01f4459b1e90fd12cc7840e [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 11.
I20260709 13:06:08.374887 19485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dc5b3532fe54f74876d02beffa2c230" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:06:08.375672 19485 raft_consensus.cc:2468] T 1dc5b3532fe54f74876d02beffa2c230 P 0473d2b2d01f4459b1e90fd12cc7840e [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 11.
I20260709 13:06:08.375957 19481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e36a9d6e29c4a7c860cf267efbd4c74" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:06:08.376737 19481 raft_consensus.cc:2468] T 2e36a9d6e29c4a7c860cf267efbd4c74 P 0473d2b2d01f4459b1e90fd12cc7840e [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 8.
I20260709 13:06:08.377635 19377 leader_election.cc:304] T f93ee515a9c14139bf566522ed8232f3 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:06:08.377826 19479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e5873a19244c5ebbcd38e126796ee7" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:06:08.378887 19479 raft_consensus.cc:2468] T d1e5873a19244c5ebbcd38e126796ee7 P 0473d2b2d01f4459b1e90fd12cc7840e [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 12.
I20260709 13:06:08.380609 19483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a61655d99124a29b486ba4a5b37faea" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:06:08.381402 19483 raft_consensus.cc:2468] T 1a61655d99124a29b486ba4a5b37faea P 0473d2b2d01f4459b1e90fd12cc7840e [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 7.
I20260709 13:06:08.385955 19478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14efcc79969f41babe5529c22d59156d" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:06:08.374466 23687 consensus_queue.cc:1048] T 775c229504194560ba9589bc2199b089 P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.013s
I20260709 13:06:08.377089 23465 raft_consensus.cc:2749] T ff75a1d4cb1f493db8f71ddc136ba9ab P e5256d91808b47c195bc9b4dbd7f2b87 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:06:08.389072 20110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9962423cb4e54fcfa5de01daf68a86e7" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:06:08.386577 19478 raft_consensus.cc:2468] T 14efcc79969f41babe5529c22d59156d P 0473d2b2d01f4459b1e90fd12cc7840e [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 11.
I20260709 13:06:08.391763 20104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "309c3ca0ca4b4f3ba129752ea2cb293b" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:06:08.395215 20109 raft_consensus.cc:1240] T 172b3dd13109415a955b71ac0e9d2234 P 127766fc592545a4997f7790f50f6076 [term 11 LEADER]: Rejecting Update request from peer e5256d91808b47c195bc9b4dbd7f2b87 for earlier term 10. Current term is 11. Ops: []
I20260709 13:06:08.395318 20110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f85fc4b527a48848e5faa083b604e36" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:06:08.402895 20104 raft_consensus.cc:1240] T 833a2f0775ed407a94b8924ce50adb63 P 127766fc592545a4997f7790f50f6076 [term 10 FOLLOWER]: Rejecting Update request from peer e5256d91808b47c195bc9b4dbd7f2b87 for earlier term 9. Current term is 10. Ops: []
I20260709 13:06:08.404598 20109 raft_consensus.cc:1240] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P 127766fc592545a4997f7790f50f6076 [term 12 LEADER]: Rejecting Update request from peer e5256d91808b47c195bc9b4dbd7f2b87 for earlier term 11. Current term is 12. Ops: []
I20260709 13:06:08.405270 20105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62c6c134d3d24a1ab144dd9ee6bc3f64" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:06:08.405895 20105 raft_consensus.cc:2468] T 62c6c134d3d24a1ab144dd9ee6bc3f64 P 127766fc592545a4997f7790f50f6076 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 10.
I20260709 13:06:08.405265 20112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e1085d23e8347fbbd5bce7542f4b1f4" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:06:08.407358 20112 raft_consensus.cc:2468] T 0e1085d23e8347fbbd5bce7542f4b1f4 P 127766fc592545a4997f7790f50f6076 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 8.
I20260709 13:06:08.412963 19480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "217b5fae677b4971b3bbd2f357a1f7ff" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:06:08.413713 19480 raft_consensus.cc:3060] T 217b5fae677b4971b3bbd2f357a1f7ff P 0473d2b2d01f4459b1e90fd12cc7840e [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:06:08.415252 20109 raft_consensus.cc:1275] T 775c229504194560ba9589bc2199b089 P 127766fc592545a4997f7790f50f6076 [term 9 FOLLOWER]: Refusing update from remote peer e5256d91808b47c195bc9b4dbd7f2b87: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:06:08.416240 20104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85c494af21f9457a85da47b9bc70c1fd" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:06:08.410704 19377 leader_election.cc:304] T 40e1e16737a842ee936002830f36882e P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87; no voters: 
I20260709 13:06:08.419647 19449 leader_election.cc:304] T 62c6c134d3d24a1ab144dd9ee6bc3f64 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, 127766fc592545a4997f7790f50f6076; no voters: 
I20260709 13:06:08.421129 19449 leader_election.cc:304] T 0e1085d23e8347fbbd5bce7542f4b1f4 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, 127766fc592545a4997f7790f50f6076; no voters: 
I20260709 13:06:08.424809 23414 raft_consensus.cc:2804] T 62c6c134d3d24a1ab144dd9ee6bc3f64 P 0473d2b2d01f4459b1e90fd12cc7840e [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:06:08.425243 23414 raft_consensus.cc:493] T 62c6c134d3d24a1ab144dd9ee6bc3f64 P 0473d2b2d01f4459b1e90fd12cc7840e [term 10 FOLLOWER]: Starting leader election (detected failure of leader e61c3a8f61bb48f8a963c9480e53c168)
I20260709 13:06:08.425631 23414 raft_consensus.cc:3060] T 62c6c134d3d24a1ab144dd9ee6bc3f64 P 0473d2b2d01f4459b1e90fd12cc7840e [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:06:08.425469 20105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14efcc79969f41babe5529c22d59156d" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:06:08.426307 20105 raft_consensus.cc:2468] T 14efcc79969f41babe5529c22d59156d P 127766fc592545a4997f7790f50f6076 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 11.
I20260709 13:06:08.406431 23549 raft_consensus.cc:2749] T f93ee515a9c14139bf566522ed8232f3 P e5256d91808b47c195bc9b4dbd7f2b87 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:06:08.429795 19478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76cb037fc9064d13b59a8969d897ce8c" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:06:08.430356 19478 raft_consensus.cc:3060] T 76cb037fc9064d13b59a8969d897ce8c P 0473d2b2d01f4459b1e90fd12cc7840e [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:06:08.432284 19374 leader_election.cc:304] T 14efcc79969f41babe5529c22d59156d P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 127766fc592545a4997f7790f50f6076, e5256d91808b47c195bc9b4dbd7f2b87; no voters: 
I20260709 13:06:08.435572 23740 raft_consensus.cc:2804] T 0e1085d23e8347fbbd5bce7542f4b1f4 P 0473d2b2d01f4459b1e90fd12cc7840e [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:06:08.447470 23740 raft_consensus.cc:493] T 0e1085d23e8347fbbd5bce7542f4b1f4 P 0473d2b2d01f4459b1e90fd12cc7840e [term 8 FOLLOWER]: Starting leader election (detected failure of leader e61c3a8f61bb48f8a963c9480e53c168)
I20260709 13:06:08.447968 23740 raft_consensus.cc:3060] T 0e1085d23e8347fbbd5bce7542f4b1f4 P 0473d2b2d01f4459b1e90fd12cc7840e [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:06:08.448045 23465 consensus_queue.cc:1059] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:06:08.448963 23465 consensus_queue.cc:1243] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Peer 127766fc592545a4997f7790f50f6076 log is divergent from this leader: its last log entry 12.11 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 10
I20260709 13:06:08.449407 23465 consensus_queue.cc:1048] T 775c229504194560ba9589bc2199b089 P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Connected to new peer: Peer: permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:06:08.436187 19479 raft_consensus.cc:1275] T ff9b0eddd810459b82d91c60777c10eb P 0473d2b2d01f4459b1e90fd12cc7840e [term 11 FOLLOWER]: Refusing update from remote peer 127766fc592545a4997f7790f50f6076: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 13:06:08.436573 19481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab43d85f64114d4ebf618930e43d9ed0" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 12 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:06:08.435524 19377 leader_election.cc:400] T 4509b76741dc428e9201c70c1658da13 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 5 pre-election: Vote denied by peer 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257) with higher term. Message: Invalid argument: T 4509b76741dc428e9201c70c1658da13 P 0473d2b2d01f4459b1e90fd12cc7840e [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e5256d91808b47c195bc9b4dbd7f2b87 for earlier term 5. Current term is 6.
I20260709 13:06:08.452409 19377 leader_election.cc:403] T 4509b76741dc428e9201c70c1658da13 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 5 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:06:08.437294 19486 raft_consensus.cc:1275] T 172b3dd13109415a955b71ac0e9d2234 P 0473d2b2d01f4459b1e90fd12cc7840e [term 11 FOLLOWER]: Refusing update from remote peer 127766fc592545a4997f7790f50f6076: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 13:06:08.452431 19481 raft_consensus.cc:2468] T ab43d85f64114d4ebf618930e43d9ed0 P 0473d2b2d01f4459b1e90fd12cc7840e [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 127766fc592545a4997f7790f50f6076 in term 11.
W20260709 13:06:08.458061 19452 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:08.458735 19480 raft_consensus.cc:2468] T 217b5fae677b4971b3bbd2f357a1f7ff P 0473d2b2d01f4459b1e90fd12cc7840e [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 9.
I20260709 13:06:08.462459 20078 leader_election.cc:304] T ab43d85f64114d4ebf618930e43d9ed0 P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, 127766fc592545a4997f7790f50f6076, e5256d91808b47c195bc9b4dbd7f2b87; no voters: 
W20260709 13:06:08.464306 20076 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.3:36891, user_credentials={real_user=slave}} blocked reactor thread for 46952.5us
I20260709 13:06:08.464502 19449 leader_election.cc:304] T 172b3dd13109415a955b71ac0e9d2234 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e; no voters: 127766fc592545a4997f7790f50f6076, e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:06:08.466349 19478 raft_consensus.cc:2468] T 76cb037fc9064d13b59a8969d897ce8c P 0473d2b2d01f4459b1e90fd12cc7840e [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 11.
I20260709 13:06:08.467648 19377 leader_election.cc:304] T ff9b0eddd810459b82d91c60777c10eb P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87; no voters: 127766fc592545a4997f7790f50f6076
I20260709 13:06:08.468384 23549 raft_consensus.cc:2749] T 4509b76741dc428e9201c70c1658da13 P e5256d91808b47c195bc9b4dbd7f2b87 [term 6 FOLLOWER]: Leader pre-election lost for term 5. Reason: Vote denied by peer 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257) with higher term. Message: Invalid argument: T 4509b76741dc428e9201c70c1658da13 P 0473d2b2d01f4459b1e90fd12cc7840e [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e5256d91808b47c195bc9b4dbd7f2b87 for earlier term 5. Current term is 6.
I20260709 13:06:08.469098 23692 raft_consensus.cc:515] T 3e1f505cb0f1427bbd698ac889d80821 P e5256d91808b47c195bc9b4dbd7f2b87 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:08.470734 23638 consensus_queue.cc:1048] T ff9b0eddd810459b82d91c60777c10eb P 127766fc592545a4997f7790f50f6076 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:06:08.440152 23587 raft_consensus.cc:2804] T 40e1e16737a842ee936002830f36882e P e5256d91808b47c195bc9b4dbd7f2b87 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:06:08.450861 23670 raft_consensus.cc:3055] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P e5256d91808b47c195bc9b4dbd7f2b87 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:06:08.434338 23717 leader_election.cc:290] T 1a61655d99124a29b486ba4a5b37faea P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:06:08.439850 23714 leader_election.cc:290] T d1e5873a19244c5ebbcd38e126796ee7 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:06:08.463652 23465 raft_consensus.cc:2804] T 14efcc79969f41babe5529c22d59156d P e5256d91808b47c195bc9b4dbd7f2b87 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:06:08.502562 19449 leader_election.cc:304] T 3e1f505cb0f1427bbd698ac889d80821 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87; no voters: 
I20260709 13:06:08.523185 19449 leader_election.cc:304] T ab43d85f64114d4ebf618930e43d9ed0 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, 127766fc592545a4997f7790f50f6076, e5256d91808b47c195bc9b4dbd7f2b87; no voters: 
I20260709 13:06:08.511049 19559 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40438 (request call id 2321) took 1603 ms. Trace:
W20260709 13:06:08.524609 19523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.4:43121, user_credentials={real_user=slave}} blocked reactor thread for 1.17335e+06us
I20260709 13:06:08.525326 19523 leader_election.cc:304] T 65d8cb8d6ec64f459d5a47cefab10acf P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 127766fc592545a4997f7790f50f6076, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:06:08.450748 23687 consensus_queue.cc:1059] T 833a2f0775ed407a94b8924ce50adb63 P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.062s
I20260709 13:06:08.495410 23762 raft_consensus.cc:2804] T ab43d85f64114d4ebf618930e43d9ed0 P 127766fc592545a4997f7790f50f6076 [term 11 FOLLOWER]: Leader pre-election won for term 12
W20260709 13:06:08.538156 19305 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:51954 (request call id 131) took 21737 ms (client timeout 15000 ms). Trace:
I20260709 13:06:08.441789 23685 raft_consensus.cc:515] T ab43d85f64114d4ebf618930e43d9ed0 P e5256d91808b47c195bc9b4dbd7f2b87 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } attrs { replace: true } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:08.523867 19559 rpcz_store.cc:276] 0709 13:06:06.907959 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:06.908179 (+   220us) service_pool.cc:224] Handling call
0709 13:06:06.917483 (+  9304us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:06.917649 (+   166us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 13:06:07.609597 (+691948us) log.cc:844] Serialized 14 byte log entry
0709 13:06:08.510572 (+900975us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:08.510633 (+    61us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:06:08.510728 (+    95us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:08.510809 (+    81us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:08.510941 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":862986,"prepare.queue_time_us":172796,"prepare.run_cpu_time_us":82,"prepare.run_wall_time_us":1392,"thread_start_us":726019,"threads_started":2}
I20260709 13:06:08.501276 23587 raft_consensus.cc:493] T 40e1e16737a842ee936002830f36882e P e5256d91808b47c195bc9b4dbd7f2b87 [term 14 FOLLOWER]: Starting leader election (detected failure of leader e61c3a8f61bb48f8a963c9480e53c168)
I20260709 13:06:08.543979 23587 raft_consensus.cc:3060] T 40e1e16737a842ee936002830f36882e P e5256d91808b47c195bc9b4dbd7f2b87 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:06:08.512630 23712 raft_consensus.cc:2749] T 172b3dd13109415a955b71ac0e9d2234 P 0473d2b2d01f4459b1e90fd12cc7840e [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:06:08.538401 19377 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.2:46257, user_credentials={real_user=slave}} blocked reactor thread for 70862.7us
I20260709 13:06:08.542277 19449 leader_election.cc:304] T 309c3ca0ca4b4f3ba129752ea2cb293b P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e; no voters: 127766fc592545a4997f7790f50f6076, e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:06:08.512959 23670 raft_consensus.cc:740] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P e5256d91808b47c195bc9b4dbd7f2b87 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: e5256d91808b47c195bc9b4dbd7f2b87, State: Running, Role: LEADER
I20260709 13:06:08.527206 23465 raft_consensus.cc:493] T 14efcc79969f41babe5529c22d59156d P e5256d91808b47c195bc9b4dbd7f2b87 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:08.536325 23549 raft_consensus.cc:2804] T ff9b0eddd810459b82d91c60777c10eb P e5256d91808b47c195bc9b4dbd7f2b87 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:06:08.554177 19377 leader_election.cc:304] T 14935b3ddf914369822e4a0547aaa355 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, 127766fc592545a4997f7790f50f6076
I20260709 13:06:08.538825 23714 raft_consensus.cc:2804] T 3e1f505cb0f1427bbd698ac889d80821 P 0473d2b2d01f4459b1e90fd12cc7840e [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:06:08.538623 23717 raft_consensus.cc:2804] T ab43d85f64114d4ebf618930e43d9ed0 P 0473d2b2d01f4459b1e90fd12cc7840e [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:06:08.540040 23762 raft_consensus.cc:493] T ab43d85f64114d4ebf618930e43d9ed0 P 127766fc592545a4997f7790f50f6076 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:08.555940 23465 raft_consensus.cc:3060] T 14efcc79969f41babe5529c22d59156d P e5256d91808b47c195bc9b4dbd7f2b87 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:06:08.559490 23714 raft_consensus.cc:493] T 3e1f505cb0f1427bbd698ac889d80821 P 0473d2b2d01f4459b1e90fd12cc7840e [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:08.558845 23549 raft_consensus.cc:493] T ff9b0eddd810459b82d91c60777c10eb P e5256d91808b47c195bc9b4dbd7f2b87 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:08.560887 23605 leader_election.cc:290] T a08760e15aac4630a629431f56024dc8 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 14 election: Requested vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:06:08.560231 23717 raft_consensus.cc:493] T ab43d85f64114d4ebf618930e43d9ed0 P 0473d2b2d01f4459b1e90fd12cc7840e [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:06:08.540212 19305 rpcz_store.cc:269] 0709 13:05:46.789803 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:46.790086 (+   283us) service_pool.cc:224] Handling call
0709 13:06:08.527426 (+21737340us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:06:07.292793 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:06:07.314905 (+ 22112us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:06:07.314974 (+    69us) write_op.cc:435] Acquired schema lock
0709 13:06:07.314996 (+    22us) tablet.cc:662] Decoding operations
0709 13:06:07.316012 (+  1016us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:06:07.316119 (+   107us) write_op.cc:641] Partition lock acquired for write op
0709 13:06:07.316158 (+    39us) tablet.cc:685] Acquiring locks for 7 operations
0709 13:06:07.316977 (+   819us) tablet.cc:701] Row locks acquired
0709 13:06:07.317029 (+    52us) write_op.cc:260] PREPARE: finished
0709 13:06:07.317221 (+   192us) write_op.cc:270] Start()
0709 13:06:07.317353 (+   132us) write_op.cc:276] Timestamp: P: 1783602367317150 usec, L: 0
0709 13:06:07.317395 (+    42us) op_driver.cc:348] REPLICATION: starting
0709 13:06:07.343257 (+ 25862us) log.cc:844] Serialized 2876 byte log entry
0709 13:06:07.566787 (+223530us) op_driver.cc:464] REPLICATION: finished
0709 13:06:07.670647 (+103860us) write_op.cc:301] APPLY: starting
0709 13:06:07.670789 (+   142us) tablet.cc:1367] starting BulkCheckPresence
0709 13:06:07.671671 (+   882us) tablet.cc:1370] finished BulkCheckPresence
0709 13:06:07.671829 (+   158us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:06:07.672625 (+   796us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:06:07.672961 (+   336us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=14
0709 13:06:07.673044 (+    83us) write_op.cc:312] APPLY: finished
0709 13:06:07.673387 (+   343us) log.cc:844] Serialized 59 byte log entry
0709 13:06:07.673581 (+   194us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:06:07.673694 (+   113us) write_op.cc:454] Released schema lock
0709 13:06:07.673759 (+    65us) write_op.cc:341] FINISH: Updating metrics
0709 13:06:07.674591 (+   832us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:06:07.674634 (+    43us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":1765790,"reported_tablets":20,"spinlock_wait_cycles":34176,"child_traces":[["op",{"apply.queue_time_us":103528,"apply.run_cpu_time_us":3520,"apply.run_wall_time_us":3525,"num_ops":7,"prepare.queue_time_us":58972,"prepare.run_cpu_time_us":13693,"prepare.run_wall_time_us":75842,"raft.queue_time_us":109483,"raft.run_cpu_time_us":24331,"raft.run_wall_time_us":154360,"replication_time_us":210741,"thread_start_us":244794,"threads_started":4,"wal-append.queue_time_us":49594}]]}
I20260709 13:06:08.541049 23414 raft_consensus.cc:515] T 62c6c134d3d24a1ab144dd9ee6bc3f64 P 0473d2b2d01f4459b1e90fd12cc7840e [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:08.549798 23660 consensus_queue.cc:1059] T b9f0d59553ad444883fcf5b5909f9798 P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.027s
I20260709 13:06:08.569173 23762 raft_consensus.cc:3060] T ab43d85f64114d4ebf618930e43d9ed0 P 127766fc592545a4997f7790f50f6076 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:06:08.587093 20075 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.1:40321, user_credentials={real_user=slave}} blocked reactor thread for 241622us
I20260709 13:06:08.595500 20105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7be9efa6559648dbb5a0f7684c4542d1" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:06:08.596244 20105 raft_consensus.cc:2393] T 7be9efa6559648dbb5a0f7684c4542d1 P 127766fc592545a4997f7790f50f6076 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e5256d91808b47c195bc9b4dbd7f2b87 in current term 12: Already voted for candidate 127766fc592545a4997f7790f50f6076 in this term.
I20260709 13:06:08.599136 19377 leader_election.cc:304] T 9962423cb4e54fcfa5de01daf68a86e7 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, 127766fc592545a4997f7790f50f6076
W20260709 13:06:08.613395 19449 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.1:40321, user_credentials={real_user=slave}} blocked reactor thread for 58836.3us
I20260709 13:06:08.617148 23776 raft_consensus.cc:2749] T 14935b3ddf914369822e4a0547aaa355 P e5256d91808b47c195bc9b4dbd7f2b87 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:06:08.584775 23714 raft_consensus.cc:3060] T 3e1f505cb0f1427bbd698ac889d80821 P 0473d2b2d01f4459b1e90fd12cc7840e [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:06:08.622776 19377 leader_election.cc:304] T 2725d2c4cb054f18b0fc8f735c15f6c2 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87; no voters: 
I20260709 13:06:08.585242 23549 raft_consensus.cc:3060] T ff9b0eddd810459b82d91c60777c10eb P e5256d91808b47c195bc9b4dbd7f2b87 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:06:08.588105 23717 raft_consensus.cc:3060] T ab43d85f64114d4ebf618930e43d9ed0 P 0473d2b2d01f4459b1e90fd12cc7840e [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:06:08.585772 23443 leader_election.cc:290] T 7be9efa6559648dbb5a0f7684c4542d1 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:06:08.595084 23712 raft_consensus.cc:2749] T 309c3ca0ca4b4f3ba129752ea2cb293b P 0473d2b2d01f4459b1e90fd12cc7840e [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:06:08.626950 23605 raft_consensus.cc:2749] T 9962423cb4e54fcfa5de01daf68a86e7 P e5256d91808b47c195bc9b4dbd7f2b87 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:06:08.624229 23534 raft_consensus.cc:493] T 48824d5acfbc485ebf8c2d944e7202de P 127766fc592545a4997f7790f50f6076 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:08.628509 19308 catalog_manager.cc:5697] T 14efcc79969f41babe5529c22d59156d P e5256d91808b47c195bc9b4dbd7f2b87 reported cstate change: term changed from 9 to 10, leader changed from 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2) to e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1). New cstate: current_term: 10 leader_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:06:08.648132 19377 leader_election.cc:304] T 1f85fc4b527a48848e5faa083b604e36 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87; no voters: 127766fc592545a4997f7790f50f6076
I20260709 13:06:08.651130 19377 leader_election.cc:400] T 2b74109013a140ada21feeef92d6f563 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 7 election: Vote denied by peer 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257) with higher term. Message: Invalid argument: T 2b74109013a140ada21feeef92d6f563 P 0473d2b2d01f4459b1e90fd12cc7840e [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate e5256d91808b47c195bc9b4dbd7f2b87 for earlier term 7. Current term is 8.
I20260709 13:06:08.651612 19377 leader_election.cc:403] T 2b74109013a140ada21feeef92d6f563 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 7 election: Cancelling election due to peer responding with higher term
I20260709 13:06:08.587975 23670 consensus_queue.cc:260] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P e5256d91808b47c195bc9b4dbd7f2b87 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:08.652340 19377 leader_election.cc:304] T e381f1d6b8184797ad142de49be225a8 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87; no voters: 
I20260709 13:06:08.642398 23772 raft_consensus.cc:2804] T 2725d2c4cb054f18b0fc8f735c15f6c2 P e5256d91808b47c195bc9b4dbd7f2b87 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:06:08.655225 19377 leader_election.cc:304] T edd7d470b5014c9489be7f41f64355c9 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87; no voters: 
I20260709 13:06:08.655997 19554 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40438 (request call id 2319) took 1786 ms. Trace:
I20260709 13:06:08.656486 19377 leader_election.cc:304] T 1dc5b3532fe54f74876d02beffa2c230 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87; no voters: 
I20260709 13:06:08.656421 19554 rpcz_store.cc:276] 0709 13:06:06.869639 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:06.869738 (+    99us) service_pool.cc:224] Handling call
0709 13:06:06.869992 (+   254us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:06.871237 (+  1245us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:06.871261 (+    24us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:06.872535 (+  1274us) log.cc:844] Serialized 26 byte log entry
0709 13:06:06.969852 (+ 97317us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:06:07.212209 (+242357us) log.cc:844] Serialized 14 byte log entry
0709 13:06:08.655715 (+1443506us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:08.655783 (+    68us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:08.655820 (+    37us) raft_consensus.cc:1685] finished
0709 13:06:08.655830 (+    10us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:08.655942 (+   112us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1263614,"prepare.queue_time_us":123978,"prepare.run_cpu_time_us":60,"prepare.run_wall_time_us":1335,"raft.queue_time_us":32842,"raft.run_cpu_time_us":184,"raft.run_wall_time_us":10913,"thread_start_us":520935,"threads_started":3,"wal-append.queue_time_us":97282,"wal-append.run_cpu_time_us":23778,"wal-append.run_wall_time_us":1459465}
I20260709 13:06:08.654471 23443 raft_consensus.cc:2804] T 1f85fc4b527a48848e5faa083b604e36 P e5256d91808b47c195bc9b4dbd7f2b87 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:06:08.648970 23534 raft_consensus.cc:515] T 48824d5acfbc485ebf8c2d944e7202de P 127766fc592545a4997f7790f50f6076 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:08.683250 19308 catalog_manager.cc:5697] T 22196caba61445d3bec98a0aab3c337d P e5256d91808b47c195bc9b4dbd7f2b87 reported cstate change: term changed from 7 to 9. New cstate: current_term: 9 leader_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } }
I20260709 13:06:08.654503 23772 raft_consensus.cc:493] T 2725d2c4cb054f18b0fc8f735c15f6c2 P e5256d91808b47c195bc9b4dbd7f2b87 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:08.653517 23692 leader_election.cc:290] T 3e1f505cb0f1427bbd698ac889d80821 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 12 election: Requested vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:06:08.674686 23709 raft_consensus.cc:493] T 70797e5783b5454ab0d0eea663e791e3 P 127766fc592545a4997f7790f50f6076 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader e61c3a8f61bb48f8a963c9480e53c168)
I20260709 13:06:08.667541 23770 raft_consensus.cc:2749] T 2b74109013a140ada21feeef92d6f563 P e5256d91808b47c195bc9b4dbd7f2b87 [term 8 FOLLOWER]: Leader election lost for term 7. Reason: Vote denied by peer 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257) with higher term. Message: Invalid argument: T 2b74109013a140ada21feeef92d6f563 P 0473d2b2d01f4459b1e90fd12cc7840e [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate e5256d91808b47c195bc9b4dbd7f2b87 for earlier term 7. Current term is 8.
I20260709 13:06:08.697474 19308 catalog_manager.cc:5697] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P e5256d91808b47c195bc9b4dbd7f2b87 reported cstate change: term changed from 9 to 11. New cstate: current_term: 11 leader_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:08.692754 23443 raft_consensus.cc:493] T 1f85fc4b527a48848e5faa083b604e36 P e5256d91808b47c195bc9b4dbd7f2b87 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 127766fc592545a4997f7790f50f6076)
I20260709 13:06:08.701102 23443 raft_consensus.cc:3060] T 1f85fc4b527a48848e5faa083b604e36 P e5256d91808b47c195bc9b4dbd7f2b87 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:06:08.701956 23534 leader_election.cc:290] T 48824d5acfbc485ebf8c2d944e7202de P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:06:08.702783 23378 raft_consensus.cc:3055] T b9f0d59553ad444883fcf5b5909f9798 P 0473d2b2d01f4459b1e90fd12cc7840e [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:06:08.703156 23378 raft_consensus.cc:740] T b9f0d59553ad444883fcf5b5909f9798 P 0473d2b2d01f4459b1e90fd12cc7840e [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 0473d2b2d01f4459b1e90fd12cc7840e, State: Running, Role: LEADER
I20260709 13:06:08.703987 23378 consensus_queue.cc:260] T b9f0d59553ad444883fcf5b5909f9798 P 0473d2b2d01f4459b1e90fd12cc7840e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:08.705108 23378 raft_consensus.cc:3060] T b9f0d59553ad444883fcf5b5909f9798 P 0473d2b2d01f4459b1e90fd12cc7840e [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:06:08.706132 23587 raft_consensus.cc:515] T 40e1e16737a842ee936002830f36882e P e5256d91808b47c195bc9b4dbd7f2b87 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:08.699051 23687 raft_consensus.cc:2804] T edd7d470b5014c9489be7f41f64355c9 P e5256d91808b47c195bc9b4dbd7f2b87 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:06:08.691649 23777 raft_consensus.cc:2804] T e381f1d6b8184797ad142de49be225a8 P e5256d91808b47c195bc9b4dbd7f2b87 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:06:08.697822 23772 raft_consensus.cc:3060] T 2725d2c4cb054f18b0fc8f735c15f6c2 P e5256d91808b47c195bc9b4dbd7f2b87 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:06:08.725033 19308 catalog_manager.cc:5697] T 46c5bfeecc314717bffe987e6844b6d0 P e5256d91808b47c195bc9b4dbd7f2b87 reported cstate change: term changed from 13 to 16, leader changed from 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2) to e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1). New cstate: current_term: 16 leader_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } health_report { overall_health: UNKNOWN } } }
W20260709 13:06:08.722899 23779 log.cc:927] Time spent T 14935b3ddf914369822e4a0547aaa355 P 127766fc592545a4997f7790f50f6076: Append to log took a long time: real 0.050s	user 0.000s	sys 0.008s
W20260709 13:06:08.730551 19450 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.3:36891, user_credentials={real_user=slave}} blocked reactor thread for 256571us
I20260709 13:06:08.734862 18300 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:06:08.723546 23692 raft_consensus.cc:2804] T 1dc5b3532fe54f74876d02beffa2c230 P e5256d91808b47c195bc9b4dbd7f2b87 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:06:08.735642 19308 catalog_manager.cc:5697] T 217b5fae677b4971b3bbd2f357a1f7ff P e5256d91808b47c195bc9b4dbd7f2b87 reported cstate change: term changed from 4 to 7, leader changed from 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2) to e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1). New cstate: current_term: 7 leader_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:08.728096 23777 raft_consensus.cc:493] T e381f1d6b8184797ad142de49be225a8 P e5256d91808b47c195bc9b4dbd7f2b87 [term 8 FOLLOWER]: Starting leader election (detected failure of leader e61c3a8f61bb48f8a963c9480e53c168)
I20260709 13:06:08.697475 23709 raft_consensus.cc:515] T 70797e5783b5454ab0d0eea663e791e3 P 127766fc592545a4997f7790f50f6076 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:08.739702 19308 catalog_manager.cc:5697] T 76cb037fc9064d13b59a8969d897ce8c P e5256d91808b47c195bc9b4dbd7f2b87 reported cstate change: term changed from 7 to 9. New cstate: current_term: 9 leader_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:08.725936 23740 raft_consensus.cc:515] T 0e1085d23e8347fbbd5bce7542f4b1f4 P 0473d2b2d01f4459b1e90fd12cc7840e [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:08.727589 23687 raft_consensus.cc:493] T edd7d470b5014c9489be7f41f64355c9 P e5256d91808b47c195bc9b4dbd7f2b87 [term 11 FOLLOWER]: Starting leader election (detected failure of leader e61c3a8f61bb48f8a963c9480e53c168)
I20260709 13:06:08.738095 23692 raft_consensus.cc:493] T 1dc5b3532fe54f74876d02beffa2c230 P e5256d91808b47c195bc9b4dbd7f2b87 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:06:08.749778 19377 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.2:46257, user_credentials={real_user=slave}} blocked reactor thread for 93397.5us
I20260709 13:06:08.751891 19377 leader_election.cc:304] T 2e36a9d6e29c4a7c860cf267efbd4c74 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87; no voters: 
I20260709 13:06:08.752877 19377 leader_election.cc:304] T d1e5873a19244c5ebbcd38e126796ee7 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87; no voters: 
I20260709 13:06:08.748339 23414 leader_election.cc:290] T 62c6c134d3d24a1ab144dd9ee6bc3f64 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 11 election: Requested vote from peers e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:06:08.741803 23777 raft_consensus.cc:3060] T e381f1d6b8184797ad142de49be225a8 P e5256d91808b47c195bc9b4dbd7f2b87 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:06:08.755388 19308 catalog_manager.cc:5697] T fa731b585f684a7fb2d106c50f143b83 P e5256d91808b47c195bc9b4dbd7f2b87 reported cstate change: term changed from 7 to 9. New cstate: current_term: 9 leader_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:06:08.753629 19377 leader_election.cc:304] T 1a61655d99124a29b486ba4a5b37faea P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87; no voters: 
W20260709 13:06:08.758922 20075 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.1:40321, user_credentials={real_user=slave}} blocked reactor thread for 124986us
I20260709 13:06:08.747246 23685 leader_election.cc:290] T ab43d85f64114d4ebf618930e43d9ed0 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 12 election: Requested vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:06:08.753400 23692 raft_consensus.cc:3060] T 1dc5b3532fe54f74876d02beffa2c230 P e5256d91808b47c195bc9b4dbd7f2b87 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:06:08.736886 23761 consensus_queue.cc:1048] T 172b3dd13109415a955b71ac0e9d2234 P 127766fc592545a4997f7790f50f6076 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.015s
I20260709 13:06:08.750779 23687 raft_consensus.cc:3060] T edd7d470b5014c9489be7f41f64355c9 P e5256d91808b47c195bc9b4dbd7f2b87 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:06:08.763722 19451 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:08.755822 23770 raft_consensus.cc:2804] T 2e36a9d6e29c4a7c860cf267efbd4c74 P e5256d91808b47c195bc9b4dbd7f2b87 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:06:08.753167 23619 raft_consensus.cc:515] T 7f575b143b844aa096b50997dad3516a P e5256d91808b47c195bc9b4dbd7f2b87 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:08.786245 19308 catalog_manager.cc:5697] T 0cdf56e38bbc453d9438d359e5a69955 P e5256d91808b47c195bc9b4dbd7f2b87 reported cstate change: term changed from 9 to 11. New cstate: current_term: 11 leader_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } health_report { overall_health: HEALTHY } } }
I20260709 13:06:08.785908 23770 raft_consensus.cc:493] T 2e36a9d6e29c4a7c860cf267efbd4c74 P e5256d91808b47c195bc9b4dbd7f2b87 [term 8 FOLLOWER]: Starting leader election (detected failure of leader e61c3a8f61bb48f8a963c9480e53c168)
W20260709 13:06:08.888999 19507 debug-util.cc:398] Leaking SignalData structure 0x7b080009de80 after lost signal to thread 18303
I20260709 13:06:08.786032 23443 raft_consensus.cc:515] T 1f85fc4b527a48848e5faa083b604e36 P e5256d91808b47c195bc9b4dbd7f2b87 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
W20260709 13:06:09.002645 19507 debug-util.cc:398] Leaking SignalData structure 0x7b08001a6840 after lost signal to thread 19343
I20260709 13:06:09.002956 23619 leader_election.cc:290] T 7f575b143b844aa096b50997dad3516a P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 8 election: Requested vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:06:09.003327 23443 leader_election.cc:290] T 1f85fc4b527a48848e5faa083b604e36 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 10 election: Requested vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
W20260709 13:06:08.902812 19375 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:09.003916 19507 debug-util.cc:398] Leaking SignalData structure 0x7b0800230060 after lost signal to thread 19435
W20260709 13:06:09.004184 19507 debug-util.cc:398] Leaking SignalData structure 0x7b08002300a0 after lost signal to thread 19436
W20260709 13:06:08.913542 23781 log.cc:927] Time spent T b9f0d59553ad444883fcf5b5909f9798 P e61c3a8f61bb48f8a963c9480e53c168: Append to log took a long time: real 0.068s	user 0.000s	sys 0.000s
W20260709 13:06:08.915359 23783 log.cc:927] Time spent T fa731b585f684a7fb2d106c50f143b83 P e5256d91808b47c195bc9b4dbd7f2b87: Append to log took a long time: real 0.173s	user 0.000s	sys 0.001s
W20260709 13:06:09.005203 19507 debug-util.cc:398] Leaking SignalData structure 0x7b08000caaa0 after lost signal to thread 19510
W20260709 13:06:09.005470 19507 debug-util.cc:398] Leaking SignalData structure 0x7b08002015e0 after lost signal to thread 19511
W20260709 13:06:08.890014 23780 log.cc:927] Time spent T 775c229504194560ba9589bc2199b089 P 127766fc592545a4997f7790f50f6076: Append to log took a long time: real 0.192s	user 0.001s	sys 0.000s
W20260709 13:06:09.005734 19507 debug-util.cc:398] Leaking SignalData structure 0x7b08002015c0 after lost signal to thread 19523
W20260709 13:06:09.006389 19507 debug-util.cc:398] Leaking SignalData structure 0x7b08000b5320 after lost signal to thread 19557
W20260709 13:06:09.007035 19507 debug-util.cc:398] Leaking SignalData structure 0x7b08002d2160 after lost signal to thread 19584
I20260709 13:06:08.785732 23789 raft_consensus.cc:2804] T d1e5873a19244c5ebbcd38e126796ee7 P e5256d91808b47c195bc9b4dbd7f2b87 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:06:09.007616 23789 raft_consensus.cc:493] T d1e5873a19244c5ebbcd38e126796ee7 P e5256d91808b47c195bc9b4dbd7f2b87 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:09.007721 23770 raft_consensus.cc:3060] T 2e36a9d6e29c4a7c860cf267efbd4c74 P e5256d91808b47c195bc9b4dbd7f2b87 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:06:08.991106 23692 raft_consensus.cc:515] T 1dc5b3532fe54f74876d02beffa2c230 P e5256d91808b47c195bc9b4dbd7f2b87 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:08.797360 23786 raft_consensus.cc:493] T ef32ce6fdd0e40d382c79974f30295c6 P e5256d91808b47c195bc9b4dbd7f2b87 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:09.016933 23762 raft_consensus.cc:515] T ab43d85f64114d4ebf618930e43d9ed0 P 127766fc592545a4997f7790f50f6076 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } attrs { replace: true } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:09.029476 19408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab43d85f64114d4ebf618930e43d9ed0" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 12 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
I20260709 13:06:09.030412 23663 consensus_queue.cc:1048] T 28af091831594f9d8e96482078cc7625 P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:06:09.030248 23538 consensus_queue.cc:1048] T f93ee515a9c14139bf566522ed8232f3 P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:06:09.030223 19408 raft_consensus.cc:2393] T ab43d85f64114d4ebf618930e43d9ed0 P e5256d91808b47c195bc9b4dbd7f2b87 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 127766fc592545a4997f7790f50f6076 in current term 12: Already voted for candidate e5256d91808b47c195bc9b4dbd7f2b87 in this term.
I20260709 13:06:09.035301 23717 raft_consensus.cc:515] T ab43d85f64114d4ebf618930e43d9ed0 P 0473d2b2d01f4459b1e90fd12cc7840e [term 12 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } attrs { replace: true } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:09.035707 23770 raft_consensus.cc:515] T 2e36a9d6e29c4a7c860cf267efbd4c74 P e5256d91808b47c195bc9b4dbd7f2b87 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:09.037994 23638 raft_consensus.cc:493] T 0afb57ae58a24a01850491d69f0213dd P 127766fc592545a4997f7790f50f6076 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 0473d2b2d01f4459b1e90fd12cc7840e)
I20260709 13:06:09.000998 23714 raft_consensus.cc:515] T 3e1f505cb0f1427bbd698ac889d80821 P 0473d2b2d01f4459b1e90fd12cc7840e [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:09.039108 23638 raft_consensus.cc:515] T 0afb57ae58a24a01850491d69f0213dd P 127766fc592545a4997f7790f50f6076 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:09.040194 23414 raft_consensus.cc:493] T 46c5bfeecc314717bffe987e6844b6d0 P 0473d2b2d01f4459b1e90fd12cc7840e [term 16 FOLLOWER]: Starting pre-election (detected failure of leader e5256d91808b47c195bc9b4dbd7f2b87)
I20260709 13:06:09.040650 23414 raft_consensus.cc:515] T 46c5bfeecc314717bffe987e6844b6d0 P 0473d2b2d01f4459b1e90fd12cc7840e [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:09.041345 23770 leader_election.cc:290] T 2e36a9d6e29c4a7c860cf267efbd4c74 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 9 election: Requested vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:06:09.042116 23638 leader_election.cc:290] T 0afb57ae58a24a01850491d69f0213dd P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:06:08.998611 23777 raft_consensus.cc:515] T e381f1d6b8184797ad142de49be225a8 P e5256d91808b47c195bc9b4dbd7f2b87 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:08.791515 23685 raft_consensus.cc:2804] T 1a61655d99124a29b486ba4a5b37faea P e5256d91808b47c195bc9b4dbd7f2b87 [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 13:06:09.007269 19507 debug-util.cc:398] Leaking SignalData structure 0x7b080038ad80 after lost signal to thread 19585
I20260709 13:06:09.043292 19485 raft_consensus.cc:1275] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P 0473d2b2d01f4459b1e90fd12cc7840e [term 12 FOLLOWER]: Refusing update from remote peer 127766fc592545a4997f7790f50f6076: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
W20260709 13:06:09.043588 19507 debug-util.cc:398] Leaking SignalData structure 0x7b08003db5e0 after lost signal to thread 20136
W20260709 13:06:09.043888 19507 debug-util.cc:398] Leaking SignalData structure 0x7b08002f3aa0 after lost signal to thread 20137
W20260709 13:06:09.044215 19507 debug-util.cc:398] Leaking SignalData structure 0x7b080027d780 after lost signal to thread 23505
W20260709 13:06:09.044487 19507 debug-util.cc:398] Leaking SignalData structure 0x7b08003d2a40 after lost signal to thread 23547
I20260709 13:06:09.008097 23789 raft_consensus.cc:3060] T d1e5873a19244c5ebbcd38e126796ee7 P e5256d91808b47c195bc9b4dbd7f2b87 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:06:08.988020 23587 leader_election.cc:290] T 40e1e16737a842ee936002830f36882e P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 15 election: Requested vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:06:09.017753 23786 raft_consensus.cc:515] T ef32ce6fdd0e40d382c79974f30295c6 P e5256d91808b47c195bc9b4dbd7f2b87 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:09.045492 19478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48824d5acfbc485ebf8c2d944e7202de" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:06:09.046072 19478 raft_consensus.cc:2468] T 48824d5acfbc485ebf8c2d944e7202de P 0473d2b2d01f4459b1e90fd12cc7840e [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 127766fc592545a4997f7790f50f6076 in term 11.
I20260709 13:06:09.046726 23786 leader_election.cc:290] T ef32ce6fdd0e40d382c79974f30295c6 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:06:09.018882 19404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70797e5783b5454ab0d0eea663e791e3" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:06:09.024963 23692 leader_election.cc:290] T 1dc5b3532fe54f74876d02beffa2c230 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 12 election: Requested vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:06:09.047463 19404 raft_consensus.cc:2468] T 70797e5783b5454ab0d0eea663e791e3 P e5256d91808b47c195bc9b4dbd7f2b87 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 127766fc592545a4997f7790f50f6076 in term 11.
W20260709 13:06:09.030278 19449 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.1:40321, user_credentials={real_user=slave}} blocked reactor thread for 389390us
I20260709 13:06:09.052695 19449 leader_election.cc:304] T 2b74109013a140ada21feeef92d6f563 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87; no voters: 
I20260709 13:06:09.053655 19449 leader_election.cc:304] T d1e5873a19244c5ebbcd38e126796ee7 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87; no voters: 
I20260709 13:06:09.054049 23670 raft_consensus.cc:3060] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P e5256d91808b47c195bc9b4dbd7f2b87 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:06:09.054993 23775 raft_consensus.cc:2804] T 2b74109013a140ada21feeef92d6f563 P 0473d2b2d01f4459b1e90fd12cc7840e [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:06:09.055290 23714 leader_election.cc:290] T 3e1f505cb0f1427bbd698ac889d80821 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 12 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:06:09.055613 23775 raft_consensus.cc:697] T 2b74109013a140ada21feeef92d6f563 P 0473d2b2d01f4459b1e90fd12cc7840e [term 8 LEADER]: Becoming Leader. State: Replica: 0473d2b2d01f4459b1e90fd12cc7840e, State: Running, Role: LEADER
I20260709 13:06:09.055933 23714 raft_consensus.cc:2804] T d1e5873a19244c5ebbcd38e126796ee7 P 0473d2b2d01f4459b1e90fd12cc7840e [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:06:09.056335 23714 raft_consensus.cc:493] T d1e5873a19244c5ebbcd38e126796ee7 P 0473d2b2d01f4459b1e90fd12cc7840e [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:09.011349 23465 raft_consensus.cc:515] T 14efcc79969f41babe5529c22d59156d P e5256d91808b47c195bc9b4dbd7f2b87 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:09.056749 23714 raft_consensus.cc:3060] T d1e5873a19244c5ebbcd38e126796ee7 P 0473d2b2d01f4459b1e90fd12cc7840e [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:06:09.056524 23775 consensus_queue.cc:237] T 2b74109013a140ada21feeef92d6f563 P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:09.058466 23465 leader_election.cc:290] T 14efcc79969f41babe5529c22d59156d P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 12 election: Requested vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:06:09.058851 23753 raft_consensus.cc:3055] T 833a2f0775ed407a94b8924ce50adb63 P e5256d91808b47c195bc9b4dbd7f2b87 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:06:09.059046 23762 leader_election.cc:290] T ab43d85f64114d4ebf618930e43d9ed0 P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 12 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
W20260709 13:06:09.067101 19507 debug-util.cc:398] Leaking SignalData structure 0x7b08002f6820 after lost signal to thread 23672
I20260709 13:06:09.059315 23753 raft_consensus.cc:740] T 833a2f0775ed407a94b8924ce50adb63 P e5256d91808b47c195bc9b4dbd7f2b87 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: e5256d91808b47c195bc9b4dbd7f2b87, State: Running, Role: LEADER
I20260709 13:06:09.074594 19559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40e1e16737a842ee936002830f36882e" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:06:09.074796 23753 consensus_queue.cc:260] T 833a2f0775ed407a94b8924ce50adb63 P e5256d91808b47c195bc9b4dbd7f2b87 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:09.075732 23715 raft_consensus.cc:493] T 833a2f0775ed407a94b8924ce50adb63 P e61c3a8f61bb48f8a963c9480e53c168 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader e5256d91808b47c195bc9b4dbd7f2b87)
I20260709 13:06:09.075999 23753 raft_consensus.cc:3060] T 833a2f0775ed407a94b8924ce50adb63 P e5256d91808b47c195bc9b4dbd7f2b87 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:06:09.038350 19377 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.2:46257, user_credentials={real_user=slave}} blocked reactor thread for 284767us
I20260709 13:06:09.076303 23715 raft_consensus.cc:515] T 833a2f0775ed407a94b8924ce50adb63 P e61c3a8f61bb48f8a963c9480e53c168 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:09.077292 19377 leader_election.cc:304] T 217b5fae677b4971b3bbd2f357a1f7ff P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87; no voters: 
I20260709 13:06:09.078042 23692 raft_consensus.cc:2804] T 217b5fae677b4971b3bbd2f357a1f7ff P e5256d91808b47c195bc9b4dbd7f2b87 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:06:09.078306 23715 leader_election.cc:290] T 833a2f0775ed407a94b8924ce50adb63 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:06:09.078509 23692 raft_consensus.cc:697] T 217b5fae677b4971b3bbd2f357a1f7ff P e5256d91808b47c195bc9b4dbd7f2b87 [term 9 LEADER]: Becoming Leader. State: Replica: e5256d91808b47c195bc9b4dbd7f2b87, State: Running, Role: LEADER
I20260709 13:06:09.030622 23740 leader_election.cc:290] T 0e1085d23e8347fbbd5bce7542f4b1f4 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 9 election: Requested vote from peers e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:06:08.993885 23549 raft_consensus.cc:515] T ff9b0eddd810459b82d91c60777c10eb P e5256d91808b47c195bc9b4dbd7f2b87 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:09.042485 23414 leader_election.cc:290] T 46c5bfeecc314717bffe987e6844b6d0 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:06:09.087498 19559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab43d85f64114d4ebf618930e43d9ed0" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 12 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:06:09.134652 19405 raft_consensus.cc:1240] T ff9b0eddd810459b82d91c60777c10eb P e5256d91808b47c195bc9b4dbd7f2b87 [term 12 FOLLOWER]: Rejecting Update request from peer 127766fc592545a4997f7790f50f6076 for earlier term 11. Current term is 12. Ops: []
I20260709 13:06:09.134821 19559 raft_consensus.cc:2468] T ab43d85f64114d4ebf618930e43d9ed0 P e61c3a8f61bb48f8a963c9480e53c168 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 11.
I20260709 13:06:09.066684 23725 consensus_queue.cc:1048] T bc225c93219c45538b53a1bd3d387e4d P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.069s
I20260709 13:06:09.135785 23549 leader_election.cc:290] T ff9b0eddd810459b82d91c60777c10eb P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 12 election: Requested vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:06:09.136171 19559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62c6c134d3d24a1ab144dd9ee6bc3f64" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:06:09.034684 23709 leader_election.cc:290] T 70797e5783b5454ab0d0eea663e791e3 P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
W20260709 13:06:09.069952 19452 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:09.086894 23778 raft_consensus.cc:493] T 1dc5b3532fe54f74876d02beffa2c230 P e61c3a8f61bb48f8a963c9480e53c168 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:09.137439 19559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a61655d99124a29b486ba4a5b37faea" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:06:09.037983 23717 leader_election.cc:290] T ab43d85f64114d4ebf618930e43d9ed0 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 12 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:06:09.086535 23768 raft_consensus.cc:493] T 14935b3ddf914369822e4a0547aaa355 P e61c3a8f61bb48f8a963c9480e53c168 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 127766fc592545a4997f7790f50f6076)
I20260709 13:06:09.099330 19551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef32ce6fdd0e40d382c79974f30295c6" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:06:09.085101 23756 raft_consensus.cc:493] T fa731b585f684a7fb2d106c50f143b83 P e61c3a8f61bb48f8a963c9480e53c168 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:09.118656 23634 consensus_queue.cc:1048] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P 127766fc592545a4997f7790f50f6076 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.021s
I20260709 13:06:09.138494 19559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dc5b3532fe54f74876d02beffa2c230" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:06:09.138520 23717 raft_consensus.cc:493] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P 0473d2b2d01f4459b1e90fd12cc7840e [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:09.086447 19449 leader_election.cc:304] T 4509b76741dc428e9201c70c1658da13 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87; no voters: 
I20260709 13:06:09.064499 19403 raft_consensus.cc:1275] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P e5256d91808b47c195bc9b4dbd7f2b87 [term 12 FOLLOWER]: Refusing update from remote peer 127766fc592545a4997f7790f50f6076: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 13:06:09.139590 23756 raft_consensus.cc:515] T fa731b585f684a7fb2d106c50f143b83 P e61c3a8f61bb48f8a963c9480e53c168 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:09.138736 23768 raft_consensus.cc:515] T 14935b3ddf914369822e4a0547aaa355 P e61c3a8f61bb48f8a963c9480e53c168 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } attrs { replace: true } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:09.094297 19560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cdf56e38bbc453d9438d359e5a69955" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:06:09.069177 23465 raft_consensus.cc:493] T df751f992649444090e27965eb1af85d P e5256d91808b47c195bc9b4dbd7f2b87 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 0473d2b2d01f4459b1e90fd12cc7840e)
I20260709 13:06:09.087208 23214 raft_consensus.cc:493] T f93ee515a9c14139bf566522ed8232f3 P e61c3a8f61bb48f8a963c9480e53c168 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:09.137908 23692 consensus_queue.cc:237] T 217b5fae677b4971b3bbd2f357a1f7ff P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:09.151101 23756 leader_election.cc:290] T fa731b585f684a7fb2d106c50f143b83 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:06:09.098312 19552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14935b3ddf914369822e4a0547aaa355" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:06:09.151896 23414 raft_consensus.cc:2804] T 4509b76741dc428e9201c70c1658da13 P 0473d2b2d01f4459b1e90fd12cc7840e [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:06:09.085906 23755 consensus_queue.cc:1048] T a08760e15aac4630a629431f56024dc8 P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.056s
I20260709 13:06:09.152447 23685 raft_consensus.cc:493] T 1a61655d99124a29b486ba4a5b37faea P e5256d91808b47c195bc9b4dbd7f2b87 [term 7 FOLLOWER]: Starting leader election (detected failure of leader e61c3a8f61bb48f8a963c9480e53c168)
I20260709 13:06:08.993209 23772 raft_consensus.cc:515] T 2725d2c4cb054f18b0fc8f735c15f6c2 P e5256d91808b47c195bc9b4dbd7f2b87 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:09.080031 19554 raft_consensus.cc:1240] T 65d8cb8d6ec64f459d5a47cefab10acf P e61c3a8f61bb48f8a963c9480e53c168 [term 9 FOLLOWER]: Rejecting Update request from peer e5256d91808b47c195bc9b4dbd7f2b87 for earlier term 8. Current term is 9. Ops: []
I20260709 13:06:09.153784 23665 raft_consensus.cc:2804] T 65d8cb8d6ec64f459d5a47cefab10acf P e61c3a8f61bb48f8a963c9480e53c168 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:06:09.154361 23772 leader_election.cc:290] T 2725d2c4cb054f18b0fc8f735c15f6c2 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 14 election: Requested vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:06:09.154211 19554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4509b76741dc428e9201c70c1658da13" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:06:09.150513 23768 leader_election.cc:290] T 14935b3ddf914369822e4a0547aaa355 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:06:09.147394 23717 raft_consensus.cc:515] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P 0473d2b2d01f4459b1e90fd12cc7840e [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:09.154978 23665 raft_consensus.cc:493] T 65d8cb8d6ec64f459d5a47cefab10acf P e61c3a8f61bb48f8a963c9480e53c168 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:09.155198 19554 raft_consensus.cc:3060] T 4509b76741dc428e9201c70c1658da13 P e61c3a8f61bb48f8a963c9480e53c168 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:09.155436 23665 raft_consensus.cc:3060] T 65d8cb8d6ec64f459d5a47cefab10acf P e61c3a8f61bb48f8a963c9480e53c168 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:06:09.156567 23717 leader_election.cc:290] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:06:09.121769 19555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e1085d23e8347fbbd5bce7542f4b1f4" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:06:09.098656 19553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dc5b3532fe54f74876d02beffa2c230" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 12 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:06:09.086177 23769 raft_consensus.cc:493] T ed7fdbcb96d14d418db9ca90a792588a P e61c3a8f61bb48f8a963c9480e53c168 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:06:09.085807 19523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.4:43121, user_credentials={real_user=slave}} blocked reactor thread for 560473us
I20260709 13:06:09.099011 19558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96efeaaf1057492490e9a621f37e1a2d" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:06:09.084332 19377 leader_election.cc:304] T 76cb037fc9064d13b59a8969d897ce8c P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87; no voters: 
I20260709 13:06:09.146039 19405 raft_consensus.cc:1240] T 1f85fc4b527a48848e5faa083b604e36 P e5256d91808b47c195bc9b4dbd7f2b87 [term 10 FOLLOWER]: Rejecting Update request from peer 127766fc592545a4997f7790f50f6076 for earlier term 9. Current term is 10. Ops: []
I20260709 13:06:09.087806 19557 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40428 (request call id 2416) took 2170 ms. Trace:
I20260709 13:06:09.149374 19560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dc5b3532fe54f74876d02beffa2c230" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:06:09.085518 23505 raft_consensus.cc:493] T 46c5bfeecc314717bffe987e6844b6d0 P e61c3a8f61bb48f8a963c9480e53c168 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader e5256d91808b47c195bc9b4dbd7f2b87)
I20260709 13:06:09.137856 23778 raft_consensus.cc:515] T 1dc5b3532fe54f74876d02beffa2c230 P e61c3a8f61bb48f8a963c9480e53c168 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:09.150936 23214 raft_consensus.cc:515] T f93ee515a9c14139bf566522ed8232f3 P e61c3a8f61bb48f8a963c9480e53c168 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
W20260709 13:06:09.081492 19526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.2:46257, user_credentials={real_user=slave}} blocked reactor thread for 864234us
I20260709 13:06:08.994024 19308 catalog_manager.cc:5697] T 70797e5783b5454ab0d0eea663e791e3 P e5256d91808b47c195bc9b4dbd7f2b87 reported cstate change: term changed from 8 to 10. New cstate: current_term: 10 leader_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:09.152138 19552 raft_consensus.cc:2410] T 14935b3ddf914369822e4a0547aaa355 P e61c3a8f61bb48f8a963c9480e53c168 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0473d2b2d01f4459b1e90fd12cc7840e for term 11 because replica has last-logged OpId of term: 10 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 7.
I20260709 13:06:09.152871 23414 raft_consensus.cc:697] T 4509b76741dc428e9201c70c1658da13 P 0473d2b2d01f4459b1e90fd12cc7840e [term 6 LEADER]: Becoming Leader. State: Replica: 0473d2b2d01f4459b1e90fd12cc7840e, State: Running, Role: LEADER
I20260709 13:06:09.085630 23486 raft_consensus.cc:493] T d1e5873a19244c5ebbcd38e126796ee7 P e61c3a8f61bb48f8a963c9480e53c168 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:09.086887 23547 raft_consensus.cc:493] T ece3db938bc649d4a40a51522ed5259c P e61c3a8f61bb48f8a963c9480e53c168 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader e5256d91808b47c195bc9b4dbd7f2b87)
I20260709 13:06:09.088320 19556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e1f505cb0f1427bbd698ac889d80821" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:06:09.151758 23465 raft_consensus.cc:515] T df751f992649444090e27965eb1af85d P e5256d91808b47c195bc9b4dbd7f2b87 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:09.158617 19551 raft_consensus.cc:2468] T ef32ce6fdd0e40d382c79974f30295c6 P e61c3a8f61bb48f8a963c9480e53c168 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 13.
I20260709 13:06:09.167641 23714 raft_consensus.cc:515] T d1e5873a19244c5ebbcd38e126796ee7 P 0473d2b2d01f4459b1e90fd12cc7840e [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:09.255376 19551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "217b5fae677b4971b3bbd2f357a1f7ff" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:06:09.097096 23687 raft_consensus.cc:515] T edd7d470b5014c9489be7f41f64355c9 P e5256d91808b47c195bc9b4dbd7f2b87 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:09.188362 20104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14efcc79969f41babe5529c22d59156d" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076"
I20260709 13:06:09.285928 20104 raft_consensus.cc:3060] T 14efcc79969f41babe5529c22d59156d P 127766fc592545a4997f7790f50f6076 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:06:09.293957 20104 raft_consensus.cc:2468] T 14efcc79969f41babe5529c22d59156d P 127766fc592545a4997f7790f50f6076 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 12.
I20260709 13:06:09.295469 19374 leader_election.cc:304] T 14efcc79969f41babe5529c22d59156d P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 127766fc592545a4997f7790f50f6076, e5256d91808b47c195bc9b4dbd7f2b87; no voters: 
I20260709 13:06:09.296303 23670 raft_consensus.cc:2804] T 14efcc79969f41babe5529c22d59156d P e5256d91808b47c195bc9b4dbd7f2b87 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:06:09.254971 23665 raft_consensus.cc:515] T 65d8cb8d6ec64f459d5a47cefab10acf P e61c3a8f61bb48f8a963c9480e53c168 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:09.257663 23692 raft_consensus.cc:2804] T 76cb037fc9064d13b59a8969d897ce8c P e5256d91808b47c195bc9b4dbd7f2b87 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:06:09.296780 23670 raft_consensus.cc:697] T 14efcc79969f41babe5529c22d59156d P e5256d91808b47c195bc9b4dbd7f2b87 [term 12 LEADER]: Becoming Leader. State: Replica: e5256d91808b47c195bc9b4dbd7f2b87, State: Running, Role: LEADER
I20260709 13:06:09.297111 23692 raft_consensus.cc:697] T 76cb037fc9064d13b59a8969d897ce8c P e5256d91808b47c195bc9b4dbd7f2b87 [term 11 LEADER]: Becoming Leader. State: Replica: e5256d91808b47c195bc9b4dbd7f2b87, State: Running, Role: LEADER
I20260709 13:06:09.297685 23670 consensus_queue.cc:237] T 14efcc79969f41babe5529c22d59156d P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:09.188369 20105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f85fc4b527a48848e5faa083b604e36" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076"
I20260709 13:06:09.257119 23714 leader_election.cc:290] T d1e5873a19244c5ebbcd38e126796ee7 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 13 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:06:09.263906 19308 catalog_manager.cc:5697] T ff9b0eddd810459b82d91c60777c10eb P e5256d91808b47c195bc9b4dbd7f2b87 reported cstate change: term changed from 4 to 8, leader changed from 127766fc592545a4997f7790f50f6076 (127.17.223.4) to e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1). New cstate: current_term: 8 leader_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:06:09.265961 19552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e36a9d6e29c4a7c860cf267efbd4c74" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:06:09.301807 19552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edd7d470b5014c9489be7f41f64355c9" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 12 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:06:09.239427 19483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0afb57ae58a24a01850491d69f0213dd" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:06:09.304701 23665 leader_election.cc:290] T 65d8cb8d6ec64f459d5a47cefab10acf P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 10 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:06:09.305347 23687 leader_election.cc:290] T edd7d470b5014c9489be7f41f64355c9 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 12 election: Requested vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:06:09.268525 23414 consensus_queue.cc:237] T 4509b76741dc428e9201c70c1658da13 P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:09.269636 23505 raft_consensus.cc:515] T 46c5bfeecc314717bffe987e6844b6d0 P e61c3a8f61bb48f8a963c9480e53c168 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:09.152869 23685 raft_consensus.cc:3060] T 1a61655d99124a29b486ba4a5b37faea P e5256d91808b47c195bc9b4dbd7f2b87 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:06:09.307852 23505 leader_election.cc:290] T 46c5bfeecc314717bffe987e6844b6d0 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:06:09.044219 23777 leader_election.cc:290] T e381f1d6b8184797ad142de49be225a8 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 9 election: Requested vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:06:09.188871 20112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab43d85f64114d4ebf618930e43d9ed0" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 12 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076"
I20260709 13:06:09.315666 20112 raft_consensus.cc:2393] T ab43d85f64114d4ebf618930e43d9ed0 P 127766fc592545a4997f7790f50f6076 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate e5256d91808b47c195bc9b4dbd7f2b87 in current term 12: Already voted for candidate 127766fc592545a4997f7790f50f6076 in this term.
I20260709 13:06:09.180392 20075 leader_election.cc:304] T 70797e5783b5454ab0d0eea663e791e3 P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 127766fc592545a4997f7790f50f6076, e5256d91808b47c195bc9b4dbd7f2b87; no voters: 
I20260709 13:06:09.270792 23486 raft_consensus.cc:515] T d1e5873a19244c5ebbcd38e126796ee7 P e61c3a8f61bb48f8a963c9480e53c168 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:09.262828 19558 raft_consensus.cc:2468] T 96efeaaf1057492490e9a621f37e1a2d P e61c3a8f61bb48f8a963c9480e53c168 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 12.
W20260709 13:06:09.316200 20075 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.1:40321, user_credentials={real_user=slave}} blocked reactor thread for 135886us
I20260709 13:06:09.061403 23789 raft_consensus.cc:515] T d1e5873a19244c5ebbcd38e126796ee7 P e5256d91808b47c195bc9b4dbd7f2b87 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
W20260709 13:06:09.257552 19377 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.2:46257, user_credentials={real_user=slave}} blocked reactor thread for 173303us
I20260709 13:06:09.321098 19552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e381f1d6b8184797ad142de49be225a8" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:06:09.260663 19557 rpcz_store.cc:276] 0709 13:06:06.917774 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:06.917961 (+   187us) service_pool.cc:224] Handling call
0709 13:06:06.932039 (+ 14078us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:06:08.564303 (+1632264us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:08.564345 (+    42us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:06:08.583251 (+ 18906us) log.cc:844] Serialized 52 byte log entry
0709 13:06:08.642487 (+ 59236us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:06:08.787336 (+144849us) log.cc:844] Serialized 14 byte log entry
0709 13:06:09.087436 (+300100us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:09.087530 (+    94us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:09.087583 (+    53us) raft_consensus.cc:1685] finished
0709 13:06:09.087600 (+    17us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:09.087731 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1836078,"prepare.queue_time_us":378256,"prepare.run_cpu_time_us":39,"prepare.run_wall_time_us":41,"raft.queue_time_us":2390771,"raft.run_cpu_time_us":201,"raft.run_wall_time_us":204,"thread_start_us":237414,"threads_started":3,"wal-append.queue_time_us":82815}
I20260709 13:06:09.273070 19480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab43d85f64114d4ebf618930e43d9ed0" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 12 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:06:09.322793 19480 raft_consensus.cc:2393] T ab43d85f64114d4ebf618930e43d9ed0 P 0473d2b2d01f4459b1e90fd12cc7840e [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 127766fc592545a4997f7790f50f6076 in current term 12: Already voted for candidate 0473d2b2d01f4459b1e90fd12cc7840e in this term.
I20260709 13:06:09.274879 19559 raft_consensus.cc:2468] T 1dc5b3532fe54f74876d02beffa2c230 P e61c3a8f61bb48f8a963c9480e53c168 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 11.
I20260709 13:06:09.262154 23778 leader_election.cc:290] T 1dc5b3532fe54f74876d02beffa2c230 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:06:09.276902 19551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e1f505cb0f1427bbd698ac889d80821" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:06:09.165194 20078 leader_election.cc:304] T 48824d5acfbc485ebf8c2d944e7202de P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, 127766fc592545a4997f7790f50f6076; no voters: 
I20260709 13:06:09.262212 23547 raft_consensus.cc:515] T ece3db938bc649d4a40a51522ed5259c P e61c3a8f61bb48f8a963c9480e53c168 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:09.260653 19560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a61655d99124a29b486ba4a5b37faea" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:06:09.298038 23692 consensus_queue.cc:237] T 76cb037fc9064d13b59a8969d897ce8c P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:09.235961 20110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff9b0eddd810459b82d91c60777c10eb" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076"
I20260709 13:06:09.267282 19556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f575b143b844aa096b50997dad3516a" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:06:09.303491 19308 catalog_manager.cc:5697] T f1b10566f45d4a7d9029858330e02d5b P e5256d91808b47c195bc9b4dbd7f2b87 reported cstate change: term changed from 8 to 10, leader changed from e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1) to 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2). New cstate: current_term: 10 leader_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } }
W20260709 13:06:09.146643 19449 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.1:40321, user_credentials={real_user=slave}} blocked reactor thread for 91978.7us
I20260709 13:06:09.336838 19449 leader_election.cc:304] T f1b10566f45d4a7d9029858330e02d5b P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87; no voters: 
I20260709 13:06:09.192497 19554 raft_consensus.cc:2468] T 4509b76741dc428e9201c70c1658da13 P e61c3a8f61bb48f8a963c9480e53c168 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 6.
W20260709 13:06:09.311550 19451 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:09.314440 19523 leader_election.cc:304] T 0afb57ae58a24a01850491d69f0213dd P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 127766fc592545a4997f7790f50f6076, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:06:09.317942 19450 leader_election.cc:304] T 1a61655d99124a29b486ba4a5b37faea P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e; no voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:06:09.338325 19554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edd7d470b5014c9489be7f41f64355c9" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 12 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:06:09.327692 19555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e36a9d6e29c4a7c860cf267efbd4c74" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:06:09.330152 19553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40e1e16737a842ee936002830f36882e" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:06:09.306201 23214 leader_election.cc:290] T f93ee515a9c14139bf566522ed8232f3 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:06:09.339208 19450 leader_election.cc:304] T 0cdf56e38bbc453d9438d359e5a69955 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e; no voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:06:09.332166 19551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7be9efa6559648dbb5a0f7684c4542d1" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:06:09.340983 19551 raft_consensus.cc:2393] T 7be9efa6559648dbb5a0f7684c4542d1 P e61c3a8f61bb48f8a963c9480e53c168 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e5256d91808b47c195bc9b4dbd7f2b87 in current term 12: Already voted for candidate 127766fc592545a4997f7790f50f6076 in this term.
I20260709 13:06:09.341480 19450 leader_election.cc:304] T edd7d470b5014c9489be7f41f64355c9 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e; no voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:06:09.343950 23717 raft_consensus.cc:2749] T 0cdf56e38bbc453d9438d359e5a69955 P 0473d2b2d01f4459b1e90fd12cc7840e [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:06:09.342389 23687 raft_consensus.cc:493] T 21e14947d70440f19044d8f75c31e1f9 P e5256d91808b47c195bc9b4dbd7f2b87 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:09.345024 23486 leader_election.cc:290] T d1e5873a19244c5ebbcd38e126796ee7 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:06:09.344939 23687 raft_consensus.cc:515] T 21e14947d70440f19044d8f75c31e1f9 P e5256d91808b47c195bc9b4dbd7f2b87 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:09.345638 19558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b74109013a140ada21feeef92d6f563" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:06:09.346199 19558 raft_consensus.cc:2468] T 2b74109013a140ada21feeef92d6f563 P e61c3a8f61bb48f8a963c9480e53c168 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 7.
I20260709 13:06:09.347011 19558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e5873a19244c5ebbcd38e126796ee7" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:06:09.347512 19558 raft_consensus.cc:2468] T d1e5873a19244c5ebbcd38e126796ee7 P e61c3a8f61bb48f8a963c9480e53c168 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 12.
I20260709 13:06:09.347687 19450 leader_election.cc:304] T 1dc5b3532fe54f74876d02beffa2c230 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e; no voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:06:09.348278 19558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef32ce6fdd0e40d382c79974f30295c6" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:06:09.348811 19558 raft_consensus.cc:2468] T ef32ce6fdd0e40d382c79974f30295c6 P e61c3a8f61bb48f8a963c9480e53c168 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 13.
I20260709 13:06:09.349499 23740 raft_consensus.cc:2749] T edd7d470b5014c9489be7f41f64355c9 P 0473d2b2d01f4459b1e90fd12cc7840e [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:06:09.355132 19523 leader_election.cc:304] T 48824d5acfbc485ebf8c2d944e7202de P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 127766fc592545a4997f7790f50f6076, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:06:09.357568 19523 leader_election.cc:304] T 1efebf73c86e432baa55533136b6e12c P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 127766fc592545a4997f7790f50f6076, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:06:09.358553 19449 leader_election.cc:304] T 2e36a9d6e29c4a7c860cf267efbd4c74 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87; no voters: 
I20260709 13:06:09.366834 19483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7be9efa6559648dbb5a0f7684c4542d1" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:06:09.372543 20110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96efeaaf1057492490e9a621f37e1a2d" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:06:09.365244 19408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab43d85f64114d4ebf618930e43d9ed0" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 12 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
I20260709 13:06:09.324530 23725 raft_consensus.cc:493] T 179fd671030940b4b4a4e24bcc4aba0a P 0473d2b2d01f4459b1e90fd12cc7840e [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:09.373167 20110 raft_consensus.cc:2468] T 96efeaaf1057492490e9a621f37e1a2d P 127766fc592545a4997f7790f50f6076 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 12.
I20260709 13:06:09.373960 19483 raft_consensus.cc:2393] T 7be9efa6559648dbb5a0f7684c4542d1 P 0473d2b2d01f4459b1e90fd12cc7840e [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e5256d91808b47c195bc9b4dbd7f2b87 in current term 12: Already voted for candidate 127766fc592545a4997f7790f50f6076 in this term.
I20260709 13:06:09.379918 19411 raft_consensus.cc:1240] T e381f1d6b8184797ad142de49be225a8 P e5256d91808b47c195bc9b4dbd7f2b87 [term 9 FOLLOWER]: Rejecting Update request from peer e61c3a8f61bb48f8a963c9480e53c168 for earlier term 8. Current term is 9. Ops: []
I20260709 13:06:09.375638 23465 leader_election.cc:290] T df751f992649444090e27965eb1af85d P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:06:09.375945 19409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "833a2f0775ed407a94b8924ce50adb63" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:06:09.376995 19407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b08304a0a02b42d7840c4e8ee9a6bd1a" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:06:09.323413 23769 raft_consensus.cc:515] T ed7fdbcb96d14d418db9ca90a792588a P e61c3a8f61bb48f8a963c9480e53c168 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:09.376540 23660 raft_consensus.cc:493] T ff75a1d4cb1f493db8f71ddc136ba9ab P 0473d2b2d01f4459b1e90fd12cc7840e [term 10 FOLLOWER]: Starting pre-election (detected failure of leader e61c3a8f61bb48f8a963c9480e53c168)
I20260709 13:06:09.334403 23709 consensus_queue.cc:1059] T 1f85fc4b527a48848e5faa083b604e36 P 127766fc592545a4997f7790f50f6076 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.052s
I20260709 13:06:09.386608 23660 raft_consensus.cc:515] T ff75a1d4cb1f493db8f71ddc136ba9ab P 0473d2b2d01f4459b1e90fd12cc7840e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:09.330248 23638 consensus_queue.cc:1048] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P 127766fc592545a4997f7790f50f6076 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.057s
I20260709 13:06:09.387740 23769 leader_election.cc:290] T ed7fdbcb96d14d418db9ca90a792588a P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:06:09.341048 23775 raft_consensus.cc:2749] T 1a61655d99124a29b486ba4a5b37faea P 0473d2b2d01f4459b1e90fd12cc7840e [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:06:09.388247 23725 raft_consensus.cc:515] T 179fd671030940b4b4a4e24bcc4aba0a P 0473d2b2d01f4459b1e90fd12cc7840e [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:09.388731 23660 leader_election.cc:290] T ff75a1d4cb1f493db8f71ddc136ba9ab P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:06:09.376974 23663 raft_consensus.cc:493] T 6c5eebf646ad445a9d1b1adc319d7b16 P 0473d2b2d01f4459b1e90fd12cc7840e [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:09.357029 23784 raft_consensus.cc:2804] T 70797e5783b5454ab0d0eea663e791e3 P 127766fc592545a4997f7790f50f6076 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:06:09.390075 23784 raft_consensus.cc:493] T 70797e5783b5454ab0d0eea663e791e3 P 127766fc592545a4997f7790f50f6076 [term 11 FOLLOWER]: Starting leader election (detected failure of leader e61c3a8f61bb48f8a963c9480e53c168)
I20260709 13:06:09.377894 23538 raft_consensus.cc:2804] T 2e36a9d6e29c4a7c860cf267efbd4c74 P 0473d2b2d01f4459b1e90fd12cc7840e [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:06:09.390043 23663 raft_consensus.cc:515] T 6c5eebf646ad445a9d1b1adc319d7b16 P 0473d2b2d01f4459b1e90fd12cc7840e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:09.390700 23784 raft_consensus.cc:3060] T 70797e5783b5454ab0d0eea663e791e3 P 127766fc592545a4997f7790f50f6076 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:06:09.390841 23538 raft_consensus.cc:493] T 2e36a9d6e29c4a7c860cf267efbd4c74 P 0473d2b2d01f4459b1e90fd12cc7840e [term 8 FOLLOWER]: Starting leader election (detected failure of leader e61c3a8f61bb48f8a963c9480e53c168)
I20260709 13:06:09.391305 23538 raft_consensus.cc:3060] T 2e36a9d6e29c4a7c860cf267efbd4c74 P 0473d2b2d01f4459b1e90fd12cc7840e [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:06:09.392910 19407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e5873a19244c5ebbcd38e126796ee7" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
I20260709 13:06:09.393625 19407 raft_consensus.cc:2393] T d1e5873a19244c5ebbcd38e126796ee7 P e5256d91808b47c195bc9b4dbd7f2b87 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 0473d2b2d01f4459b1e90fd12cc7840e in current term 13: Already voted for candidate e5256d91808b47c195bc9b4dbd7f2b87 in this term.
I20260709 13:06:09.380846 19409 raft_consensus.cc:2468] T 833a2f0775ed407a94b8924ce50adb63 P e5256d91808b47c195bc9b4dbd7f2b87 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 10.
I20260709 13:06:09.394898 19402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46c5bfeecc314717bffe987e6844b6d0" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 17 candidate_status { last_received { term: 16 index: 7 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:06:09.375568 23492 consensus_queue.cc:1048] T ed7fdbcb96d14d418db9ca90a792588a P 127766fc592545a4997f7790f50f6076 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.020s
I20260709 13:06:09.377449 19478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e1f505cb0f1427bbd698ac889d80821" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:06:09.395892 19478 raft_consensus.cc:2393] T 3e1f505cb0f1427bbd698ac889d80821 P 0473d2b2d01f4459b1e90fd12cc7840e [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate e5256d91808b47c195bc9b4dbd7f2b87 in current term 12: Already voted for candidate 0473d2b2d01f4459b1e90fd12cc7840e in this term.
I20260709 13:06:09.396196 19402 raft_consensus.cc:1240] T edd7d470b5014c9489be7f41f64355c9 P e5256d91808b47c195bc9b4dbd7f2b87 [term 12 FOLLOWER]: Rejecting Update request from peer e61c3a8f61bb48f8a963c9480e53c168 for earlier term 11. Current term is 12. Ops: []
I20260709 13:06:09.380357 23740 raft_consensus.cc:2804] T f1b10566f45d4a7d9029858330e02d5b P 0473d2b2d01f4459b1e90fd12cc7840e [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:06:09.397104 19486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a08760e15aac4630a629431f56024dc8" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:06:09.397233 23740 raft_consensus.cc:493] T f1b10566f45d4a7d9029858330e02d5b P 0473d2b2d01f4459b1e90fd12cc7840e [term 12 FOLLOWER]: Starting leader election (detected failure of leader e61c3a8f61bb48f8a963c9480e53c168)
I20260709 13:06:09.397739 19486 raft_consensus.cc:3060] T a08760e15aac4630a629431f56024dc8 P 0473d2b2d01f4459b1e90fd12cc7840e [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:06:09.378700 19410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e1f505cb0f1427bbd698ac889d80821" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
I20260709 13:06:09.330050 23534 consensus_queue.cc:1059] T ff9b0eddd810459b82d91c60777c10eb P 127766fc592545a4997f7790f50f6076 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.056s
I20260709 13:06:09.385695 23789 leader_election.cc:290] T d1e5873a19244c5ebbcd38e126796ee7 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 13 election: Requested vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:06:09.385691 23665 consensus_queue.cc:1059] T 28af091831594f9d8e96482078cc7625 P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 }, Status: INVALID_TERM, Last received: 9.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:06:09.385535 19308 catalog_manager.cc:5697] T 65d8cb8d6ec64f459d5a47cefab10acf P e5256d91808b47c195bc9b4dbd7f2b87 reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:06:09.386919 23709 raft_consensus.cc:3055] T 1f85fc4b527a48848e5faa083b604e36 P 127766fc592545a4997f7790f50f6076 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:06:09.410349 19410 raft_consensus.cc:2393] T 3e1f505cb0f1427bbd698ac889d80821 P e5256d91808b47c195bc9b4dbd7f2b87 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 0473d2b2d01f4459b1e90fd12cc7840e in current term 12: Already voted for candidate e5256d91808b47c195bc9b4dbd7f2b87 in this term.
I20260709 13:06:09.390363 23725 leader_election.cc:290] T 179fd671030940b4b4a4e24bcc4aba0a P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:06:09.373049 23505 raft_consensus.cc:2804] T 1efebf73c86e432baa55533136b6e12c P e61c3a8f61bb48f8a963c9480e53c168 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:06:09.394390 19407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36f6ba92b9ba46babe4ebd6c02e5fbd9" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:06:09.399032 19559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2725d2c4cb054f18b0fc8f735c15f6c2" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:06:09.408569 19483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40e1e16737a842ee936002830f36882e" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:06:09.379769 19408 raft_consensus.cc:2393] T ab43d85f64114d4ebf618930e43d9ed0 P e5256d91808b47c195bc9b4dbd7f2b87 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 0473d2b2d01f4459b1e90fd12cc7840e in current term 12: Already voted for candidate e5256d91808b47c195bc9b4dbd7f2b87 in this term.
I20260709 13:06:09.423159 19478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab43d85f64114d4ebf618930e43d9ed0" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 12 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:06:09.422577 19411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa731b585f684a7fb2d106c50f143b83" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:06:09.424185 19478 raft_consensus.cc:2393] T ab43d85f64114d4ebf618930e43d9ed0 P 0473d2b2d01f4459b1e90fd12cc7840e [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate e5256d91808b47c195bc9b4dbd7f2b87 in current term 12: Already voted for candidate 0473d2b2d01f4459b1e90fd12cc7840e in this term.
I20260709 13:06:09.411665 23687 leader_election.cc:290] T 21e14947d70440f19044d8f75c31e1f9 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:06:09.425015 19411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dc5b3532fe54f74876d02beffa2c230" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:06:09.425469 20105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14935b3ddf914369822e4a0547aaa355" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:06:09.421929 19559 raft_consensus.cc:2468] T 2725d2c4cb054f18b0fc8f735c15f6c2 P e61c3a8f61bb48f8a963c9480e53c168 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 13.
I20260709 13:06:09.422564 19483 raft_consensus.cc:3060] T 40e1e16737a842ee936002830f36882e P 0473d2b2d01f4459b1e90fd12cc7840e [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:06:09.421195 19407 raft_consensus.cc:2468] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P e5256d91808b47c195bc9b4dbd7f2b87 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 12.
I20260709 13:06:09.397707 23740 raft_consensus.cc:3060] T f1b10566f45d4a7d9029858330e02d5b P 0473d2b2d01f4459b1e90fd12cc7840e [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:06:09.412482 19481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f575b143b844aa096b50997dad3516a" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:06:09.429931 19308 catalog_manager.cc:5697] T ef32ce6fdd0e40d382c79974f30295c6 P e5256d91808b47c195bc9b4dbd7f2b87 reported cstate change: term changed from 5 to 11, leader changed from e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3) to e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1). New cstate: current_term: 11 leader_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:09.431106 19481 raft_consensus.cc:3060] T 7f575b143b844aa096b50997dad3516a P 0473d2b2d01f4459b1e90fd12cc7840e [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:06:09.377929 23547 leader_election.cc:290] T ece3db938bc649d4a40a51522ed5259c P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:06:09.413084 19485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f85fc4b527a48848e5faa083b604e36" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:06:09.413995 19526 leader_election.cc:304] T 2725d2c4cb054f18b0fc8f735c15f6c2 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168; no voters: e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:06:09.372879 23778 raft_consensus.cc:2804] T 48824d5acfbc485ebf8c2d944e7202de P e61c3a8f61bb48f8a963c9480e53c168 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:06:09.361124 23717 raft_consensus.cc:2749] T 1dc5b3532fe54f74876d02beffa2c230 P 0473d2b2d01f4459b1e90fd12cc7840e [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:06:09.420706 20110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "833a2f0775ed407a94b8924ce50adb63" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
W20260709 13:06:09.411580 20076 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.3:36891, user_credentials={real_user=slave}} blocked reactor thread for 51515us
I20260709 13:06:09.372843 23762 raft_consensus.cc:2804] T 48824d5acfbc485ebf8c2d944e7202de P 127766fc592545a4997f7790f50f6076 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:06:09.360478 23214 raft_consensus.cc:2804] T 0afb57ae58a24a01850491d69f0213dd P e61c3a8f61bb48f8a963c9480e53c168 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:06:09.433728 19411 raft_consensus.cc:2393] T 1dc5b3532fe54f74876d02beffa2c230 P e5256d91808b47c195bc9b4dbd7f2b87 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e61c3a8f61bb48f8a963c9480e53c168 in current term 12: Already voted for candidate e5256d91808b47c195bc9b4dbd7f2b87 in this term.
I20260709 13:06:09.435902 19482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dc5b3532fe54f74876d02beffa2c230" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:06:09.436081 19402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14935b3ddf914369822e4a0547aaa355" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:06:09.436506 19560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96efeaaf1057492490e9a621f37e1a2d" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:06:09.437286 20110 raft_consensus.cc:2393] T 833a2f0775ed407a94b8924ce50adb63 P 127766fc592545a4997f7790f50f6076 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e61c3a8f61bb48f8a963c9480e53c168 in current term 10: Already voted for candidate 127766fc592545a4997f7790f50f6076 in this term.
I20260709 13:06:09.438469 19479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e381f1d6b8184797ad142de49be225a8" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:06:09.444095 19449 leader_election.cc:304] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87; no voters: 
I20260709 13:06:09.444694 19479 raft_consensus.cc:3060] T e381f1d6b8184797ad142de49be225a8 P 0473d2b2d01f4459b1e90fd12cc7840e [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:06:09.440346 19485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef32ce6fdd0e40d382c79974f30295c6" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:06:09.445535 19485 raft_consensus.cc:2468] T ef32ce6fdd0e40d382c79974f30295c6 P 0473d2b2d01f4459b1e90fd12cc7840e [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 13.
I20260709 13:06:09.443965 19560 raft_consensus.cc:2468] T 96efeaaf1057492490e9a621f37e1a2d P e61c3a8f61bb48f8a963c9480e53c168 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 12.
I20260709 13:06:09.449872 19478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e36a9d6e29c4a7c860cf267efbd4c74" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:06:09.412875 23709 raft_consensus.cc:740] T 1f85fc4b527a48848e5faa083b604e36 P 127766fc592545a4997f7790f50f6076 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 127766fc592545a4997f7790f50f6076, State: Running, Role: LEADER
I20260709 13:06:09.453382 19402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65d8cb8d6ec64f459d5a47cefab10acf" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
I20260709 13:06:09.455250 19402 raft_consensus.cc:3060] T 65d8cb8d6ec64f459d5a47cefab10acf P e5256d91808b47c195bc9b4dbd7f2b87 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:06:09.425660 23534 consensus_queue.cc:1243] T ff9b0eddd810459b82d91c60777c10eb P 127766fc592545a4997f7790f50f6076 [LEADER]: Peer e5256d91808b47c195bc9b4dbd7f2b87 log is divergent from this leader: its last log entry 10.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 8
I20260709 13:06:09.457626 19405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46c5bfeecc314717bffe987e6844b6d0" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 17 candidate_status { last_received { term: 16 index: 7 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:06:09.458256 19308 catalog_manager.cc:5697] T d1e5873a19244c5ebbcd38e126796ee7 P e5256d91808b47c195bc9b4dbd7f2b87 reported cstate change: term changed from 9 to 11. New cstate: current_term: 11 leader_uuid: "e61c3a8f61bb48f8a963c9480e53c168" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } }
I20260709 13:06:09.458761 19405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f93ee515a9c14139bf566522ed8232f3" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 16 candidate_status { last_received { term: 12 index: 5 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:06:09.460347 20112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa731b585f684a7fb2d106c50f143b83" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:06:09.461225 19405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff75a1d4cb1f493db8f71ddc136ba9ab" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:06:09.461795 19405 raft_consensus.cc:2468] T ff75a1d4cb1f493db8f71ddc136ba9ab P e5256d91808b47c195bc9b4dbd7f2b87 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 10.
W20260709 13:06:09.452566 20078 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.2:46257, user_credentials={real_user=slave}} blocked reactor thread for 287447us
I20260709 13:06:09.453796 19559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef32ce6fdd0e40d382c79974f30295c6" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:06:09.461690 19410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e5873a19244c5ebbcd38e126796ee7" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:06:09.450695 20109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65d8cb8d6ec64f459d5a47cefab10acf" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076"
I20260709 13:06:09.463708 20109 raft_consensus.cc:3060] T 65d8cb8d6ec64f459d5a47cefab10acf P 127766fc592545a4997f7790f50f6076 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:06:09.464144 19560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1efebf73c86e432baa55533136b6e12c" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:06:09.463217 19559 raft_consensus.cc:2376] T ef32ce6fdd0e40d382c79974f30295c6 P e61c3a8f61bb48f8a963c9480e53c168 [term 13 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 13. Re-sending same reply.
I20260709 13:06:09.462540 19411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "179fd671030940b4b4a4e24bcc4aba0a" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 13 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:06:09.463569 19410 raft_consensus.cc:2393] T d1e5873a19244c5ebbcd38e126796ee7 P e5256d91808b47c195bc9b4dbd7f2b87 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e61c3a8f61bb48f8a963c9480e53c168 in current term 13: Already voted for candidate e5256d91808b47c195bc9b4dbd7f2b87 in this term.
I20260709 13:06:09.471706 19483 raft_consensus.cc:2468] T 40e1e16737a842ee936002830f36882e P 0473d2b2d01f4459b1e90fd12cc7840e [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 15.
I20260709 13:06:09.472746 19479 raft_consensus.cc:2468] T e381f1d6b8184797ad142de49be225a8 P 0473d2b2d01f4459b1e90fd12cc7840e [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 9.
I20260709 13:06:09.451692 23587 raft_consensus.cc:493] T 179fd671030940b4b4a4e24bcc4aba0a P e5256d91808b47c195bc9b4dbd7f2b87 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:09.442044 23762 raft_consensus.cc:493] T 48824d5acfbc485ebf8c2d944e7202de P 127766fc592545a4997f7790f50f6076 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:09.448632 23214 raft_consensus.cc:493] T 0afb57ae58a24a01850491d69f0213dd P e61c3a8f61bb48f8a963c9480e53c168 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 0473d2b2d01f4459b1e90fd12cc7840e)
I20260709 13:06:09.453845 23685 raft_consensus.cc:515] T 1a61655d99124a29b486ba4a5b37faea P e5256d91808b47c195bc9b4dbd7f2b87 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:09.498993 19559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85c494af21f9457a85da47b9bc70c1fd" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:06:09.480254 20105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab43d85f64114d4ebf618930e43d9ed0" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 12 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076"
I20260709 13:06:09.481482 20108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36f6ba92b9ba46babe4ebd6c02e5fbd9" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:06:09.482295 20078 leader_election.cc:304] T ab43d85f64114d4ebf618930e43d9ed0 P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 127766fc592545a4997f7790f50f6076; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:06:09.483001 20110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e1085d23e8347fbbd5bce7542f4b1f4" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076"
I20260709 13:06:09.500892 20110 raft_consensus.cc:3060] T 0e1085d23e8347fbbd5bce7542f4b1f4 P 127766fc592545a4997f7790f50f6076 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:06:09.461746 23505 raft_consensus.cc:697] T 1efebf73c86e432baa55533136b6e12c P e61c3a8f61bb48f8a963c9480e53c168 [term 11 LEADER]: Becoming Leader. State: Replica: e61c3a8f61bb48f8a963c9480e53c168, State: Running, Role: LEADER
I20260709 13:06:09.513110 19552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2725d2c4cb054f18b0fc8f735c15f6c2" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
W20260709 13:06:09.485055 19523 connection.cc:256] RPC call timeout handler was delayed by -1.2701841440000408s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1952s for a response
I20260709 13:06:09.485761 23715 raft_consensus.cc:493] T fa8650e71aa14778b3d73721fc50d9fc P e61c3a8f61bb48f8a963c9480e53c168 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 0473d2b2d01f4459b1e90fd12cc7840e)
I20260709 13:06:09.486440 23713 raft_consensus.cc:493] T 85c494af21f9457a85da47b9bc70c1fd P e61c3a8f61bb48f8a963c9480e53c168 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 127766fc592545a4997f7790f50f6076)
I20260709 13:06:09.547864 19484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edd7d470b5014c9489be7f41f64355c9" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 12 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:06:09.548413 19484 raft_consensus.cc:3060] T edd7d470b5014c9489be7f41f64355c9 P 0473d2b2d01f4459b1e90fd12cc7840e [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:06:09.494820 19482 raft_consensus.cc:3060] T 1dc5b3532fe54f74876d02beffa2c230 P 0473d2b2d01f4459b1e90fd12cc7840e [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:06:09.463554 19449 leader_election.cc:304] T ff75a1d4cb1f493db8f71ddc136ba9ab P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87; no voters: 
I20260709 13:06:09.466795 23414 raft_consensus.cc:2804] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P 0473d2b2d01f4459b1e90fd12cc7840e [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:06:09.545594 19450 leader_election.cc:304] T 96efeaaf1057492490e9a621f37e1a2d P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168; no voters: 127766fc592545a4997f7790f50f6076
I20260709 13:06:09.501972 20105 raft_consensus.cc:2393] T ab43d85f64114d4ebf618930e43d9ed0 P 127766fc592545a4997f7790f50f6076 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 0473d2b2d01f4459b1e90fd12cc7840e in current term 12: Already voted for candidate 127766fc592545a4997f7790f50f6076 in this term.
I20260709 13:06:09.503445 20112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62c6c134d3d24a1ab144dd9ee6bc3f64" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076"
I20260709 13:06:09.508355 23685 leader_election.cc:290] T 1a61655d99124a29b486ba4a5b37faea P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 8 election: Requested vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
W20260709 13:06:09.509071 19526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.2:46257, user_credentials={real_user=slave}} blocked reactor thread for 95159.5us
I20260709 13:06:09.483573 23778 raft_consensus.cc:697] T 48824d5acfbc485ebf8c2d944e7202de P e61c3a8f61bb48f8a963c9480e53c168 [term 12 LEADER]: Becoming Leader. State: Replica: e61c3a8f61bb48f8a963c9480e53c168, State: Running, Role: LEADER
I20260709 13:06:09.494639 19551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76cb037fc9064d13b59a8969d897ce8c" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:06:09.501832 23214 raft_consensus.cc:3060] T 0afb57ae58a24a01850491d69f0213dd P e61c3a8f61bb48f8a963c9480e53c168 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:06:09.494015 19308 catalog_manager.cc:5697] T 28af091831594f9d8e96482078cc7625 P e5256d91808b47c195bc9b4dbd7f2b87 reported cstate change: term changed from 8 to 9, leader changed from e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1) to e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3). New cstate: current_term: 9 leader_uuid: "e61c3a8f61bb48f8a963c9480e53c168" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } }
I20260709 13:06:09.524755 19486 raft_consensus.cc:2468] T a08760e15aac4630a629431f56024dc8 P 0473d2b2d01f4459b1e90fd12cc7840e [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 14.
I20260709 13:06:09.579169 19450 leader_election.cc:304] T ef32ce6fdd0e40d382c79974f30295c6 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168; no voters: e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:06:09.527529 23663 leader_election.cc:290] T 6c5eebf646ad445a9d1b1adc319d7b16 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:06:09.496869 23587 raft_consensus.cc:515] T 179fd671030940b4b4a4e24bcc4aba0a P e5256d91808b47c195bc9b4dbd7f2b87 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:09.535897 23769 raft_consensus.cc:3055] T 28af091831594f9d8e96482078cc7625 P e61c3a8f61bb48f8a963c9480e53c168 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:06:09.536465 19477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21e14947d70440f19044d8f75c31e1f9" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:06:09.537892 19556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "309c3ca0ca4b4f3ba129752ea2cb293b" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:06:09.596742 19556 raft_consensus.cc:2410] T 309c3ca0ca4b4f3ba129752ea2cb293b P e61c3a8f61bb48f8a963c9480e53c168 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0473d2b2d01f4459b1e90fd12cc7840e for term 10 because replica has last-logged OpId of term: 9 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 8.
I20260709 13:06:09.538080 19557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40e1e16737a842ee936002830f36882e" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:06:09.538990 19485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2725d2c4cb054f18b0fc8f735c15f6c2" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:06:09.599290 19485 raft_consensus.cc:3060] T 2725d2c4cb054f18b0fc8f735c15f6c2 P 0473d2b2d01f4459b1e90fd12cc7840e [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:06:09.539157 19554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff75a1d4cb1f493db8f71ddc136ba9ab" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:06:09.539856 19553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1b10566f45d4a7d9029858330e02d5b" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:06:09.512990 19375 leader_election.cc:304] T 7be9efa6559648dbb5a0f7684c4542d1 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87; no voters: 127766fc592545a4997f7790f50f6076, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:06:09.549474 20110 raft_consensus.cc:2468] T 0e1085d23e8347fbbd5bce7542f4b1f4 P 127766fc592545a4997f7790f50f6076 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 9.
W20260709 13:06:09.551192 19449 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.1:40321, user_credentials={real_user=slave}} blocked reactor thread for 87721.1us
I20260709 13:06:09.553856 19402 raft_consensus.cc:2468] T 65d8cb8d6ec64f459d5a47cefab10acf P e5256d91808b47c195bc9b4dbd7f2b87 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 10.
I20260709 13:06:09.564076 20109 raft_consensus.cc:2468] T 65d8cb8d6ec64f459d5a47cefab10acf P 127766fc592545a4997f7790f50f6076 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 10.
I20260709 13:06:09.475857 19479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14efcc79969f41babe5529c22d59156d" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:06:09.603507 19479 raft_consensus.cc:3060] T 14efcc79969f41babe5529c22d59156d P 0473d2b2d01f4459b1e90fd12cc7840e [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:06:09.495025 23762 raft_consensus.cc:3060] T 48824d5acfbc485ebf8c2d944e7202de P 127766fc592545a4997f7790f50f6076 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:06:09.572443 19483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff9b0eddd810459b82d91c60777c10eb" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:06:09.483198 23665 raft_consensus.cc:2804] T 2725d2c4cb054f18b0fc8f735c15f6c2 P e61c3a8f61bb48f8a963c9480e53c168 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:06:09.614830 19555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14935b3ddf914369822e4a0547aaa355" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:06:09.615466 19555 raft_consensus.cc:2468] T 14935b3ddf914369822e4a0547aaa355 P e61c3a8f61bb48f8a963c9480e53c168 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 10.
I20260709 13:06:09.570602 23414 raft_consensus.cc:493] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P 0473d2b2d01f4459b1e90fd12cc7840e [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:09.574344 19551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab43d85f64114d4ebf618930e43d9ed0" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 12 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:06:09.616370 19551 raft_consensus.cc:2468] T ab43d85f64114d4ebf618930e43d9ed0 P e61c3a8f61bb48f8a963c9480e53c168 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 127766fc592545a4997f7790f50f6076 in term 11.
I20260709 13:06:09.576649 23378 raft_consensus.cc:2804] T ff75a1d4cb1f493db8f71ddc136ba9ab P 0473d2b2d01f4459b1e90fd12cc7840e [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:06:09.509981 23505 consensus_queue.cc:237] T 1efebf73c86e432baa55533136b6e12c P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:09.595927 19477 raft_consensus.cc:2468] T 21e14947d70440f19044d8f75c31e1f9 P 0473d2b2d01f4459b1e90fd12cc7840e [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 11.
W20260709 13:06:09.607790 19375 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.3:36891, user_credentials={real_user=slave}} blocked reactor thread for 94878.3us
I20260709 13:06:09.611263 19308 catalog_manager.cc:5697] T 7f575b143b844aa096b50997dad3516a P e5256d91808b47c195bc9b4dbd7f2b87 reported cstate change: term changed from 4 to 6, leader changed from 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2) to e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1). New cstate: current_term: 6 leader_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:09.595369 23769 raft_consensus.cc:740] T 28af091831594f9d8e96482078cc7625 P e61c3a8f61bb48f8a963c9480e53c168 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: e61c3a8f61bb48f8a963c9480e53c168, State: Running, Role: LEADER
I20260709 13:06:09.631392 19483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a61655d99124a29b486ba4a5b37faea" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:06:09.632009 19556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0afb57ae58a24a01850491d69f0213dd" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:06:09.617216 19551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62c6c134d3d24a1ab144dd9ee6bc3f64" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:06:09.584534 19558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7be9efa6559648dbb5a0f7684c4542d1" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:06:09.633579 19558 raft_consensus.cc:2376] T 7be9efa6559648dbb5a0f7684c4542d1 P e61c3a8f61bb48f8a963c9480e53c168 [term 12 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 127766fc592545a4997f7790f50f6076 in term 12. Re-sending same reply.
I20260709 13:06:09.634637 19558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e1085d23e8347fbbd5bce7542f4b1f4" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:06:09.632045 19483 raft_consensus.cc:3060] T 1a61655d99124a29b486ba4a5b37faea P 0473d2b2d01f4459b1e90fd12cc7840e [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:06:09.618299 19554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e381f1d6b8184797ad142de49be225a8" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:06:09.619313 19479 raft_consensus.cc:2468] T 14efcc79969f41babe5529c22d59156d P 0473d2b2d01f4459b1e90fd12cc7840e [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 12.
I20260709 13:06:09.621604 19486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df751f992649444090e27965eb1af85d" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:06:09.570421 23634 raft_consensus.cc:493] T 6c5eebf646ad445a9d1b1adc319d7b16 P 127766fc592545a4997f7790f50f6076 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:09.623992 19375 leader_election.cc:304] T ef32ce6fdd0e40d382c79974f30295c6 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:06:09.651970 19553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9f0d59553ad444883fcf5b5909f9798" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:06:09.625897 20109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c5eebf646ad445a9d1b1adc319d7b16" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:06:09.632699 19411 raft_consensus.cc:2410] T 179fd671030940b4b4a4e24bcc4aba0a P e5256d91808b47c195bc9b4dbd7f2b87 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0473d2b2d01f4459b1e90fd12cc7840e for term 13 because replica has last-logged OpId of term: 11 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 5.
I20260709 13:06:09.641196 19523 leader_election.cc:304] T bc225c93219c45538b53a1bd3d387e4d P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e61c3a8f61bb48f8a963c9480e53c168; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:06:09.593258 23725 raft_consensus.cc:2804] T ef32ce6fdd0e40d382c79974f30295c6 P 0473d2b2d01f4459b1e90fd12cc7840e [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:06:09.588697 23717 raft_consensus.cc:2804] T 96efeaaf1057492490e9a621f37e1a2d P 0473d2b2d01f4459b1e90fd12cc7840e [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:06:09.653774 19558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b74109013a140ada21feeef92d6f563" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:06:09.607502 23753 raft_consensus.cc:493] T 65d8cb8d6ec64f459d5a47cefab10acf P e5256d91808b47c195bc9b4dbd7f2b87 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:09.645985 19556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e5873a19244c5ebbcd38e126796ee7" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:06:09.655112 19556 raft_consensus.cc:2468] T d1e5873a19244c5ebbcd38e126796ee7 P e61c3a8f61bb48f8a963c9480e53c168 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 12.
I20260709 13:06:09.656286 19557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14935b3ddf914369822e4a0547aaa355" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:06:09.656637 19554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "833a2f0775ed407a94b8924ce50adb63" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:06:09.657387 19557 raft_consensus.cc:2410] T 14935b3ddf914369822e4a0547aaa355 P e61c3a8f61bb48f8a963c9480e53c168 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0473d2b2d01f4459b1e90fd12cc7840e for term 11 because replica has last-logged OpId of term: 10 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 7.
I20260709 13:06:09.623278 23685 raft_consensus.cc:3060] T 7be9efa6559648dbb5a0f7684c4542d1 P e5256d91808b47c195bc9b4dbd7f2b87 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:06:09.666213 19555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df751f992649444090e27965eb1af85d" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:06:09.669646 19555 raft_consensus.cc:2468] T df751f992649444090e27965eb1af85d P e61c3a8f61bb48f8a963c9480e53c168 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 13.
I20260709 13:06:09.655555 19308 catalog_manager.cc:5697] T 172b3dd13109415a955b71ac0e9d2234 P e5256d91808b47c195bc9b4dbd7f2b87 reported cstate change: term changed from 5 to 8, leader changed from 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2) to e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1). New cstate: current_term: 8 leader_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:06:09.664752 19477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e5873a19244c5ebbcd38e126796ee7" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:06:09.573416 23715 raft_consensus.cc:515] T fa8650e71aa14778b3d73721fc50d9fc P e61c3a8f61bb48f8a963c9480e53c168 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:09.527014 23709 consensus_queue.cc:260] T 1f85fc4b527a48848e5faa083b604e36 P 127766fc592545a4997f7790f50f6076 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:09.689100 19485 raft_consensus.cc:2468] T 2725d2c4cb054f18b0fc8f735c15f6c2 P 0473d2b2d01f4459b1e90fd12cc7840e [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 14.
I20260709 13:06:09.687440 19482 raft_consensus.cc:2468] T 1dc5b3532fe54f74876d02beffa2c230 P 0473d2b2d01f4459b1e90fd12cc7840e [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 12.
I20260709 13:06:09.622061 23414 raft_consensus.cc:3060] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P 0473d2b2d01f4459b1e90fd12cc7840e [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:06:09.671250 19477 raft_consensus.cc:2393] T d1e5873a19244c5ebbcd38e126796ee7 P 0473d2b2d01f4459b1e90fd12cc7840e [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate e5256d91808b47c195bc9b4dbd7f2b87 in current term 13: Already voted for candidate 0473d2b2d01f4459b1e90fd12cc7840e in this term.
I20260709 13:06:09.671451 19553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b74109013a140ada21feeef92d6f563" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:06:09.628655 23378 raft_consensus.cc:493] T ff75a1d4cb1f493db8f71ddc136ba9ab P 0473d2b2d01f4459b1e90fd12cc7840e [term 10 FOLLOWER]: Starting leader election (detected failure of leader e61c3a8f61bb48f8a963c9480e53c168)
I20260709 13:06:09.580937 23713 raft_consensus.cc:515] T 85c494af21f9457a85da47b9bc70c1fd P e61c3a8f61bb48f8a963c9480e53c168 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:09.631261 23538 raft_consensus.cc:515] T 2e36a9d6e29c4a7c860cf267efbd4c74 P 0473d2b2d01f4459b1e90fd12cc7840e [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:09.700842 19551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e381f1d6b8184797ad142de49be225a8" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:06:09.593411 23755 consensus_queue.cc:1048] T a08760e15aac4630a629431f56024dc8 P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.053s
I20260709 13:06:09.588881 23756 consensus_queue.cc:1048] T 76cb037fc9064d13b59a8969d897ce8c P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.054s
I20260709 13:06:09.705116 19556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1b10566f45d4a7d9029858330e02d5b" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:06:09.706888 23808 raft_consensus.cc:2749] T ab43d85f64114d4ebf618930e43d9ed0 P 127766fc592545a4997f7790f50f6076 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:06:09.707597 23704 consensus_queue.cc:1048] T 3e1f505cb0f1427bbd698ac889d80821 P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.120s
I20260709 13:06:09.708002 19484 raft_consensus.cc:2468] T edd7d470b5014c9489be7f41f64355c9 P 0473d2b2d01f4459b1e90fd12cc7840e [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 12.
I20260709 13:06:09.613193 23784 raft_consensus.cc:515] T 70797e5783b5454ab0d0eea663e791e3 P 127766fc592545a4997f7790f50f6076 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:09.718770 19308 catalog_manager.cc:5697] T 3e1f505cb0f1427bbd698ac889d80821 P e5256d91808b47c195bc9b4dbd7f2b87 reported cstate change: term changed from 8 to 10. New cstate: current_term: 10 leader_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:09.750871 23378 raft_consensus.cc:3060] T ff75a1d4cb1f493db8f71ddc136ba9ab P 0473d2b2d01f4459b1e90fd12cc7840e [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:06:09.665061 23714 raft_consensus.cc:493] T 7be9efa6559648dbb5a0f7684c4542d1 P 0473d2b2d01f4459b1e90fd12cc7840e [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:09.665720 23692 raft_consensus.cc:2804] T ef32ce6fdd0e40d382c79974f30295c6 P e5256d91808b47c195bc9b4dbd7f2b87 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:06:09.843566 19551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46c5bfeecc314717bffe987e6844b6d0" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 17 candidate_status { last_received { term: 16 index: 7 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:06:09.844231 19551 raft_consensus.cc:2468] T 46c5bfeecc314717bffe987e6844b6d0 P e61c3a8f61bb48f8a963c9480e53c168 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 16.
I20260709 13:06:09.666356 19483 raft_consensus.cc:2468] T 1a61655d99124a29b486ba4a5b37faea P 0473d2b2d01f4459b1e90fd12cc7840e [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 8.
I20260709 13:06:09.728479 19375 leader_election.cc:304] T b9f0d59553ad444883fcf5b5909f9798 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:06:09.782611 23715 leader_election.cc:290] T fa8650e71aa14778b3d73721fc50d9fc P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:06:09.748025 19553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edd7d470b5014c9489be7f41f64355c9" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 12 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
W20260709 13:06:09.849858 19375 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.3:36891, user_credentials={real_user=slave}} blocked reactor thread for 121452us
I20260709 13:06:09.850523 19553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e5873a19244c5ebbcd38e126796ee7" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:06:09.851047 19375 leader_election.cc:304] T df751f992649444090e27965eb1af85d P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:06:09.851212 19553 raft_consensus.cc:3060] T d1e5873a19244c5ebbcd38e126796ee7 P e61c3a8f61bb48f8a963c9480e53c168 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:06:09.852043 19375 leader_election.cc:304] T f1b10566f45d4a7d9029858330e02d5b P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:06:09.754760 19557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a61655d99124a29b486ba4a5b37faea" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:06:09.756999 19555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e1f505cb0f1427bbd698ac889d80821" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
W20260709 13:06:09.794883 19526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.2:46257, user_credentials={real_user=slave}} blocked reactor thread for 170448us
W20260709 13:06:09.816828 19523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.1:40321, user_credentials={real_user=slave}} blocked reactor thread for 229618us
I20260709 13:06:09.674171 23753 raft_consensus.cc:515] T 65d8cb8d6ec64f459d5a47cefab10acf P e5256d91808b47c195bc9b4dbd7f2b87 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:09.863173 19551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab43d85f64114d4ebf618930e43d9ed0" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 12 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:06:09.863757 19551 raft_consensus.cc:3060] T ab43d85f64114d4ebf618930e43d9ed0 P e61c3a8f61bb48f8a963c9480e53c168 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:06:09.712807 19481 raft_consensus.cc:2468] T 7f575b143b844aa096b50997dad3516a P 0473d2b2d01f4459b1e90fd12cc7840e [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 8.
I20260709 13:06:09.822400 19556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a08760e15aac4630a629431f56024dc8" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:06:09.849231 23692 raft_consensus.cc:493] T ef32ce6fdd0e40d382c79974f30295c6 P e5256d91808b47c195bc9b4dbd7f2b87 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:09.823602 19559 raft_consensus.cc:2468] T 85c494af21f9457a85da47b9bc70c1fd P e61c3a8f61bb48f8a963c9480e53c168 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 8.
I20260709 13:06:09.667670 23634 raft_consensus.cc:515] T 6c5eebf646ad445a9d1b1adc319d7b16 P 127766fc592545a4997f7790f50f6076 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:09.829555 19478 raft_consensus.cc:2393] T 2e36a9d6e29c4a7c860cf267efbd4c74 P 0473d2b2d01f4459b1e90fd12cc7840e [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate e5256d91808b47c195bc9b4dbd7f2b87 in current term 9: Already voted for candidate 0473d2b2d01f4459b1e90fd12cc7840e in this term.
I20260709 13:06:09.831303 19308 catalog_manager.cc:5697] T 1a61655d99124a29b486ba4a5b37faea P e5256d91808b47c195bc9b4dbd7f2b87 reported cstate change: term changed from 5 to 7, leader changed from 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2) to e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3). New cstate: current_term: 7 leader_uuid: "e61c3a8f61bb48f8a963c9480e53c168" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } }
I20260709 13:06:09.655539 23717 raft_consensus.cc:493] T 96efeaaf1057492490e9a621f37e1a2d P 0473d2b2d01f4459b1e90fd12cc7840e [term 11 FOLLOWER]: Starting leader election (detected failure of leader e61c3a8f61bb48f8a963c9480e53c168)
W20260709 13:06:09.846719 19377 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.2:46257, user_credentials={real_user=slave}} blocked reactor thread for 306388us
I20260709 13:06:09.699457 19554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c5eebf646ad445a9d1b1adc319d7b16" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:06:09.860184 19523 leader_election.cc:304] T ef32ce6fdd0e40d382c79974f30295c6 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:06:09.869477 19554 raft_consensus.cc:2468] T 6c5eebf646ad445a9d1b1adc319d7b16 P e61c3a8f61bb48f8a963c9480e53c168 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 9.
I20260709 13:06:09.868783 19377 leader_election.cc:304] T 3e1f505cb0f1427bbd698ac889d80821 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:06:09.873454 19308 catalog_manager.cc:5697] T 5ec1c4ce15e04c7e8c283a62179f2a64 P e5256d91808b47c195bc9b4dbd7f2b87 reported cstate change: term changed from 7 to 9. New cstate: current_term: 9 leader_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:09.875687 19308 catalog_manager.cc:5697] T 14935b3ddf914369822e4a0547aaa355 P e5256d91808b47c195bc9b4dbd7f2b87 reported cstate change: term changed from 6 to 8. New cstate: current_term: 8 leader_uuid: "127766fc592545a4997f7790f50f6076" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } attrs { replace: true } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } } }
I20260709 13:06:09.855630 23777 raft_consensus.cc:2749] T b9f0d59553ad444883fcf5b5909f9798 P e5256d91808b47c195bc9b4dbd7f2b87 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:06:09.877817 19556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e5873a19244c5ebbcd38e126796ee7" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:06:09.857404 23619 raft_consensus.cc:2804] T df751f992649444090e27965eb1af85d P e5256d91808b47c195bc9b4dbd7f2b87 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:06:09.879439 19557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48824d5acfbc485ebf8c2d944e7202de" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:06:09.753006 23778 consensus_queue.cc:237] T 48824d5acfbc485ebf8c2d944e7202de P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:09.879454 19377 leader_election.cc:304] T ab43d85f64114d4ebf618930e43d9ed0 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, 127766fc592545a4997f7790f50f6076
I20260709 13:06:09.864985 23692 raft_consensus.cc:3060] T ef32ce6fdd0e40d382c79974f30295c6 P e5256d91808b47c195bc9b4dbd7f2b87 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:06:09.862757 23465 raft_consensus.cc:2749] T f1b10566f45d4a7d9029858330e02d5b P e5256d91808b47c195bc9b4dbd7f2b87 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:06:09.860028 23715 raft_consensus.cc:2749] T bc225c93219c45538b53a1bd3d387e4d P e61c3a8f61bb48f8a963c9480e53c168 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:06:09.886603 19555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a08760e15aac4630a629431f56024dc8" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:06:09.931908 19555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab43d85f64114d4ebf618930e43d9ed0" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 12 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:06:09.932932 19555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab43d85f64114d4ebf618930e43d9ed0" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 12 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:06:09.933861 19555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21e14947d70440f19044d8f75c31e1f9" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:06:09.889154 19377 leader_election.cc:304] T 1f85fc4b527a48848e5faa083b604e36 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, 127766fc592545a4997f7790f50f6076
W20260709 13:06:09.935341 19377 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.2:46257, user_credentials={real_user=slave}} blocked reactor thread for 46292.8us
I20260709 13:06:09.936010 19375 leader_election.cc:304] T 85c494af21f9457a85da47b9bc70c1fd P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168; no voters: 127766fc592545a4997f7790f50f6076
I20260709 13:06:09.936398 19377 leader_election.cc:304] T 40e1e16737a842ee936002830f36882e P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87; no voters: e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:06:09.937353 19377 leader_election.cc:304] T e381f1d6b8184797ad142de49be225a8 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87; no voters: e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:06:09.890159 20109 raft_consensus.cc:2468] T 6c5eebf646ad445a9d1b1adc319d7b16 P 127766fc592545a4997f7790f50f6076 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 9.
I20260709 13:06:09.895355 19556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e36a9d6e29c4a7c860cf267efbd4c74" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:06:09.939023 23777 raft_consensus.cc:2749] T 1f85fc4b527a48848e5faa083b604e36 P e5256d91808b47c195bc9b4dbd7f2b87 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:06:09.939962 19377 leader_election.cc:304] T a08760e15aac4630a629431f56024dc8 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87; no voters: e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:06:09.895637 19557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70797e5783b5454ab0d0eea663e791e3" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:06:09.896111 23772 raft_consensus.cc:2749] T ab43d85f64114d4ebf618930e43d9ed0 P e5256d91808b47c195bc9b4dbd7f2b87 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:06:09.941752 23772 raft_consensus.cc:2804] T 85c494af21f9457a85da47b9bc70c1fd P e5256d91808b47c195bc9b4dbd7f2b87 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:06:09.942092 23772 raft_consensus.cc:493] T 85c494af21f9457a85da47b9bc70c1fd P e5256d91808b47c195bc9b4dbd7f2b87 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 127766fc592545a4997f7790f50f6076)
I20260709 13:06:09.942409 23772 raft_consensus.cc:3060] T 85c494af21f9457a85da47b9bc70c1fd P e5256d91808b47c195bc9b4dbd7f2b87 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:06:09.944458 23670 raft_consensus.cc:2804] T 40e1e16737a842ee936002830f36882e P e5256d91808b47c195bc9b4dbd7f2b87 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:06:09.945106 23670 raft_consensus.cc:697] T 40e1e16737a842ee936002830f36882e P e5256d91808b47c195bc9b4dbd7f2b87 [term 15 LEADER]: Becoming Leader. State: Replica: e5256d91808b47c195bc9b4dbd7f2b87, State: Running, Role: LEADER
I20260709 13:06:09.945695 23777 raft_consensus.cc:2804] T e381f1d6b8184797ad142de49be225a8 P e5256d91808b47c195bc9b4dbd7f2b87 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:06:09.947541 23687 raft_consensus.cc:2804] T a08760e15aac4630a629431f56024dc8 P e5256d91808b47c195bc9b4dbd7f2b87 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:06:09.948033 23687 raft_consensus.cc:697] T a08760e15aac4630a629431f56024dc8 P e5256d91808b47c195bc9b4dbd7f2b87 [term 14 LEADER]: Becoming Leader. State: Replica: e5256d91808b47c195bc9b4dbd7f2b87, State: Running, Role: LEADER
I20260709 13:06:09.949002 20105 raft_consensus.cc:1275] T 14efcc79969f41babe5529c22d59156d P 127766fc592545a4997f7790f50f6076 [term 12 FOLLOWER]: Refusing update from remote peer e5256d91808b47c195bc9b4dbd7f2b87: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:06:09.946180 23777 raft_consensus.cc:697] T e381f1d6b8184797ad142de49be225a8 P e5256d91808b47c195bc9b4dbd7f2b87 [term 9 LEADER]: Becoming Leader. State: Replica: e5256d91808b47c195bc9b4dbd7f2b87, State: Running, Role: LEADER
I20260709 13:06:09.950109 23777 consensus_queue.cc:237] T e381f1d6b8184797ad142de49be225a8 P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:09.951078 23807 raft_consensus.cc:3055] T ff9b0eddd810459b82d91c60777c10eb P 127766fc592545a4997f7790f50f6076 [term 11 LEADER]: Stepping down as leader of term 11
W20260709 13:06:09.951454 23813 log.cc:927] Time spent T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P e5256d91808b47c195bc9b4dbd7f2b87: Append to log took a long time: real 0.091s	user 0.000s	sys 0.000s
I20260709 13:06:09.897132 23784 leader_election.cc:290] T 70797e5783b5454ab0d0eea663e791e3 P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 12 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:06:09.951462 23807 raft_consensus.cc:740] T ff9b0eddd810459b82d91c60777c10eb P 127766fc592545a4997f7790f50f6076 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 127766fc592545a4997f7790f50f6076, State: Running, Role: LEADER
I20260709 13:06:09.897619 23817 consensus_queue.cc:1048] T 3e1f505cb0f1427bbd698ac889d80821 P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.013s
I20260709 13:06:09.884968 23549 raft_consensus.cc:2749] T 3e1f505cb0f1427bbd698ac889d80821 P e5256d91808b47c195bc9b4dbd7f2b87 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:06:09.953907 23807 consensus_queue.cc:260] T ff9b0eddd810459b82d91c60777c10eb P 127766fc592545a4997f7790f50f6076 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:09.904937 23634 leader_election.cc:290] T 6c5eebf646ad445a9d1b1adc319d7b16 P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:06:09.856097 23714 raft_consensus.cc:515] T 7be9efa6559648dbb5a0f7684c4542d1 P 0473d2b2d01f4459b1e90fd12cc7840e [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } attrs { replace: true } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:09.954948 23807 raft_consensus.cc:3060] T ff9b0eddd810459b82d91c60777c10eb P 127766fc592545a4997f7790f50f6076 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:06:09.956269 23756 raft_consensus.cc:2804] T ef32ce6fdd0e40d382c79974f30295c6 P e61c3a8f61bb48f8a963c9480e53c168 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:06:09.956816 23756 raft_consensus.cc:493] T ef32ce6fdd0e40d382c79974f30295c6 P e61c3a8f61bb48f8a963c9480e53c168 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:09.956975 23714 leader_election.cc:290] T 7be9efa6559648dbb5a0f7684c4542d1 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:06:09.885721 23619 raft_consensus.cc:493] T df751f992649444090e27965eb1af85d P e5256d91808b47c195bc9b4dbd7f2b87 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 0473d2b2d01f4459b1e90fd12cc7840e)
I20260709 13:06:09.957263 23756 raft_consensus.cc:3060] T ef32ce6fdd0e40d382c79974f30295c6 P e61c3a8f61bb48f8a963c9480e53c168 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:06:09.957640 23619 raft_consensus.cc:3060] T df751f992649444090e27965eb1af85d P e5256d91808b47c195bc9b4dbd7f2b87 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:06:09.872643 23717 raft_consensus.cc:3060] T 96efeaaf1057492490e9a621f37e1a2d P 0473d2b2d01f4459b1e90fd12cc7840e [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:06:09.963218 23812 log.cc:927] Time spent T 775c229504194560ba9589bc2199b089 P 0473d2b2d01f4459b1e90fd12cc7840e: Append to log took a long time: real 0.216s	user 0.000s	sys 0.000s
W20260709 13:06:09.966194 23814 log.cc:927] Time spent T f93ee515a9c14139bf566522ed8232f3 P e5256d91808b47c195bc9b4dbd7f2b87: Append to log took a long time: real 0.143s	user 0.000s	sys 0.000s
I20260709 13:06:09.915503 23538 leader_election.cc:290] T 2e36a9d6e29c4a7c860cf267efbd4c74 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 9 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:06:09.759030 23769 consensus_queue.cc:260] T 28af091831594f9d8e96482078cc7625 P e61c3a8f61bb48f8a963c9480e53c168 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 11.6, Last appended by leader: 6, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:09.972000 23769 raft_consensus.cc:3060] T 28af091831594f9d8e96482078cc7625 P e61c3a8f61bb48f8a963c9480e53c168 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:06:09.948899 23687 consensus_queue.cc:237] T a08760e15aac4630a629431f56024dc8 P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:09.916152 19526 leader_election.cc:304] T 2b74109013a140ada21feeef92d6f563 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:06:09.916452 23713 leader_election.cc:290] T 85c494af21f9457a85da47b9bc70c1fd P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
W20260709 13:06:09.975874 19526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.2:46257, user_credentials={real_user=slave}} blocked reactor thread for 59803.9us
I20260709 13:06:09.918046 19551 raft_consensus.cc:2468] T ab43d85f64114d4ebf618930e43d9ed0 P e61c3a8f61bb48f8a963c9480e53c168 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 12.
I20260709 13:06:09.919026 19553 raft_consensus.cc:2468] T d1e5873a19244c5ebbcd38e126796ee7 P e61c3a8f61bb48f8a963c9480e53c168 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 13.
W20260709 13:06:09.922763 23794 log.cc:927] Time spent T 172b3dd13109415a955b71ac0e9d2234 P 0473d2b2d01f4459b1e90fd12cc7840e: Append to log took a long time: real 0.054s	user 0.000s	sys 0.000s
I20260709 13:06:09.883937 19523 leader_election.cc:304] T df751f992649444090e27965eb1af85d P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e61c3a8f61bb48f8a963c9480e53c168; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87
W20260709 13:06:09.928998 23810 log.cc:927] Time spent T bc225c93219c45538b53a1bd3d387e4d P e5256d91808b47c195bc9b4dbd7f2b87: Append to log took a long time: real 0.269s	user 0.000s	sys 0.001s
I20260709 13:06:09.980944 19375 leader_election.cc:304] T d1e5873a19244c5ebbcd38e126796ee7 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:06:09.981853 23549 raft_consensus.cc:2804] T d1e5873a19244c5ebbcd38e126796ee7 P e5256d91808b47c195bc9b4dbd7f2b87 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:06:09.982314 23549 raft_consensus.cc:697] T d1e5873a19244c5ebbcd38e126796ee7 P e5256d91808b47c195bc9b4dbd7f2b87 [term 13 LEADER]: Becoming Leader. State: Replica: e5256d91808b47c195bc9b4dbd7f2b87, State: Running, Role: LEADER
W20260709 13:06:09.982764 19523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.1:40321, user_credentials={real_user=slave}} blocked reactor thread for 98963.9us
I20260709 13:06:09.983301 23549 consensus_queue.cc:237] T d1e5873a19244c5ebbcd38e126796ee7 P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:09.930753 19559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "179fd671030940b4b4a4e24bcc4aba0a" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 13 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:06:09.984534 19559 raft_consensus.cc:2410] T 179fd671030940b4b4a4e24bcc4aba0a P e61c3a8f61bb48f8a963c9480e53c168 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0473d2b2d01f4459b1e90fd12cc7840e for term 13 because replica has last-logged OpId of term: 11 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 5.
I20260709 13:06:09.984889 23730 consensus_queue.cc:1048] T 217b5fae677b4971b3bbd2f357a1f7ff P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:06:09.985495 23587 leader_election.cc:290] T 179fd671030940b4b4a4e24bcc4aba0a P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:06:09.983750 23817 raft_consensus.cc:2749] T df751f992649444090e27965eb1af85d P e61c3a8f61bb48f8a963c9480e53c168 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:06:09.987264 19523 leader_election.cc:304] T ab43d85f64114d4ebf618930e43d9ed0 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 127766fc592545a4997f7790f50f6076, e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:06:09.988252 19555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab43d85f64114d4ebf618930e43d9ed0" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 12 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:06:10.003773 19555 raft_consensus.cc:2393] T ab43d85f64114d4ebf618930e43d9ed0 P e61c3a8f61bb48f8a963c9480e53c168 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate e5256d91808b47c195bc9b4dbd7f2b87 in current term 12: Already voted for candidate 0473d2b2d01f4459b1e90fd12cc7840e in this term.
I20260709 13:06:09.929991 23685 raft_consensus.cc:2749] T 7be9efa6559648dbb5a0f7684c4542d1 P e5256d91808b47c195bc9b4dbd7f2b87 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:06:09.994047 19558 raft_consensus.cc:2468] T 2b74109013a140ada21feeef92d6f563 P e61c3a8f61bb48f8a963c9480e53c168 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 7.
I20260709 13:06:10.006388 19308 catalog_manager.cc:5697] T 833a2f0775ed407a94b8924ce50adb63 P e5256d91808b47c195bc9b4dbd7f2b87 reported cstate change: term changed from 7 to 9. New cstate: current_term: 9 leader_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:10.012138 19558 raft_consensus.cc:1275] T bc225c93219c45538b53a1bd3d387e4d P e61c3a8f61bb48f8a963c9480e53c168 [term 11 FOLLOWER]: Refusing update from remote peer 0473d2b2d01f4459b1e90fd12cc7840e: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:06:10.008512 19555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "179fd671030940b4b4a4e24bcc4aba0a" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
W20260709 13:06:10.019116 20075 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.1:40321, user_credentials={real_user=slave}} blocked reactor thread for 383554us
I20260709 13:06:10.024010 19404 raft_consensus.cc:1240] T ff9b0eddd810459b82d91c60777c10eb P e5256d91808b47c195bc9b4dbd7f2b87 [term 12 FOLLOWER]: Rejecting Update request from peer 127766fc592545a4997f7790f50f6076 for earlier term 11. Current term is 12. Ops: [11.9-11.9]
W20260709 13:06:10.027321 20076 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.3:36891, user_credentials={real_user=slave}} blocked reactor thread for 300082us
W20260709 13:06:10.030440 20075 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:10.030575 19523 leader_election.cc:304] T 833a2f0775ed407a94b8924ce50adb63 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:06:09.946205 23670 consensus_queue.cc:237] T 40e1e16737a842ee936002830f36882e P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 14.7, Last appended by leader: 7, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:10.038161 19403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70797e5783b5454ab0d0eea663e791e3" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
I20260709 13:06:10.043210 19403 raft_consensus.cc:3060] T 70797e5783b5454ab0d0eea663e791e3 P e5256d91808b47c195bc9b4dbd7f2b87 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:06:10.018927 23817 raft_consensus.cc:493] T 179fd671030940b4b4a4e24bcc4aba0a P e61c3a8f61bb48f8a963c9480e53c168 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:10.019369 23713 raft_consensus.cc:2804] T 2b74109013a140ada21feeef92d6f563 P e61c3a8f61bb48f8a963c9480e53c168 [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 13:06:10.052030 20076 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:10.016232 23725 raft_consensus.cc:697] T ef32ce6fdd0e40d382c79974f30295c6 P 0473d2b2d01f4459b1e90fd12cc7840e [term 13 LEADER]: Becoming Leader. State: Replica: 0473d2b2d01f4459b1e90fd12cc7840e, State: Running, Role: LEADER
W20260709 13:06:10.029409 23740 consensus_meta.cc:287] T f1b10566f45d4a7d9029858330e02d5b P 0473d2b2d01f4459b1e90fd12cc7840e: Time spent flushing consensus metadata: real 0.588s	user 0.010s	sys 0.001s
I20260709 13:06:10.060505 19557 raft_consensus.cc:1275] T f93ee515a9c14139bf566522ed8232f3 P e61c3a8f61bb48f8a963c9480e53c168 [term 15 FOLLOWER]: Refusing update from remote peer 0473d2b2d01f4459b1e90fd12cc7840e: Log matching property violated. Preceding OpId in replica: term: 12 index: 5. Preceding OpId from leader: term: 15 index: 7. (index mismatch)
W20260709 13:06:10.062410 19449 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.4:43121, user_credentials={real_user=slave}} blocked reactor thread for 436649us
I20260709 13:06:10.074723 23822 raft_consensus.cc:2764] T ab43d85f64114d4ebf618930e43d9ed0 P e61c3a8f61bb48f8a963c9480e53c168 [term 12 FOLLOWER]: Leader pre-election decision vote started in defunct term 11: won
I20260709 13:06:10.075318 19559 raft_consensus.cc:1275] T fa731b585f684a7fb2d106c50f143b83 P e61c3a8f61bb48f8a963c9480e53c168 [term 10 FOLLOWER]: Refusing update from remote peer 127766fc592545a4997f7790f50f6076: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:06:10.075551 23753 leader_election.cc:290] T 65d8cb8d6ec64f459d5a47cefab10acf P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:06:10.070814 19449 leader_election.cc:304] T ab43d85f64114d4ebf618930e43d9ed0 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e; no voters: 127766fc592545a4997f7790f50f6076, e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:06:10.076041 23822 raft_consensus.cc:2804] T 833a2f0775ed407a94b8924ce50adb63 P e61c3a8f61bb48f8a963c9480e53c168 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:06:10.076411 23822 raft_consensus.cc:493] T 833a2f0775ed407a94b8924ce50adb63 P e61c3a8f61bb48f8a963c9480e53c168 [term 9 FOLLOWER]: Starting leader election (detected failure of leader e5256d91808b47c195bc9b4dbd7f2b87)
I20260709 13:06:10.076763 23822 raft_consensus.cc:3060] T 833a2f0775ed407a94b8924ce50adb63 P e61c3a8f61bb48f8a963c9480e53c168 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:06:10.076894 19449 leader_election.cc:304] T 0e1085d23e8347fbbd5bce7542f4b1f4 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, 127766fc592545a4997f7790f50f6076; no voters: 
I20260709 13:06:10.077761 19449 leader_election.cc:304] T 6c5eebf646ad445a9d1b1adc319d7b16 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, 127766fc592545a4997f7790f50f6076; no voters: 
I20260709 13:06:10.078011 23538 raft_consensus.cc:2749] T ab43d85f64114d4ebf618930e43d9ed0 P 0473d2b2d01f4459b1e90fd12cc7840e [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:06:10.078763 23538 raft_consensus.cc:2804] T 0e1085d23e8347fbbd5bce7542f4b1f4 P 0473d2b2d01f4459b1e90fd12cc7840e [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:06:10.079241 23538 raft_consensus.cc:697] T 0e1085d23e8347fbbd5bce7542f4b1f4 P 0473d2b2d01f4459b1e90fd12cc7840e [term 9 LEADER]: Becoming Leader. State: Replica: 0473d2b2d01f4459b1e90fd12cc7840e, State: Running, Role: LEADER
I20260709 13:06:10.079416 23823 raft_consensus.cc:2804] T 6c5eebf646ad445a9d1b1adc319d7b16 P 0473d2b2d01f4459b1e90fd12cc7840e [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:06:10.079839 23823 raft_consensus.cc:493] T 6c5eebf646ad445a9d1b1adc319d7b16 P 0473d2b2d01f4459b1e90fd12cc7840e [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:10.080166 23823 raft_consensus.cc:3060] T 6c5eebf646ad445a9d1b1adc319d7b16 P 0473d2b2d01f4459b1e90fd12cc7840e [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:06:10.080096 23538 consensus_queue.cc:237] T 0e1085d23e8347fbbd5bce7542f4b1f4 P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:10.081346 23717 raft_consensus.cc:515] T 96efeaaf1057492490e9a621f37e1a2d P 0473d2b2d01f4459b1e90fd12cc7840e [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:10.025996 23665 raft_consensus.cc:697] T 2725d2c4cb054f18b0fc8f735c15f6c2 P e61c3a8f61bb48f8a963c9480e53c168 [term 13 LEADER]: Becoming Leader. State: Replica: e61c3a8f61bb48f8a963c9480e53c168, State: Running, Role: LEADER
I20260709 13:06:10.083139 23725 consensus_queue.cc:237] T ef32ce6fdd0e40d382c79974f30295c6 P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:10.083662 20105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65d8cb8d6ec64f459d5a47cefab10acf" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:06:10.084249 20105 raft_consensus.cc:2468] T 65d8cb8d6ec64f459d5a47cefab10acf P 127766fc592545a4997f7790f50f6076 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 10.
I20260709 13:06:10.084069 23665 consensus_queue.cc:237] T 2725d2c4cb054f18b0fc8f735c15f6c2 P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.5, Last appended by leader: 5, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:10.018383 23605 consensus_queue.cc:1048] T 14efcc79969f41babe5529c22d59156d P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Connected to new peer: Peer: permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.044s
I20260709 13:06:10.086588 19374 leader_election.cc:304] T 65d8cb8d6ec64f459d5a47cefab10acf P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 127766fc592545a4997f7790f50f6076, e5256d91808b47c195bc9b4dbd7f2b87; no voters: 
I20260709 13:06:10.074712 19551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65d8cb8d6ec64f459d5a47cefab10acf" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:06:10.087390 19551 raft_consensus.cc:2468] T 65d8cb8d6ec64f459d5a47cefab10acf P e61c3a8f61bb48f8a963c9480e53c168 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 10.
I20260709 13:06:10.088486 19551 raft_consensus.cc:3060] T 2b74109013a140ada21feeef92d6f563 P e61c3a8f61bb48f8a963c9480e53c168 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:06:10.090736 23740 raft_consensus.cc:515] T f1b10566f45d4a7d9029858330e02d5b P 0473d2b2d01f4459b1e90fd12cc7840e [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:10.091485 19411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e36a9d6e29c4a7c860cf267efbd4c74" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
I20260709 13:06:10.092244 19411 raft_consensus.cc:2393] T 2e36a9d6e29c4a7c860cf267efbd4c74 P e5256d91808b47c195bc9b4dbd7f2b87 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 0473d2b2d01f4459b1e90fd12cc7840e in current term 9: Already voted for candidate e5256d91808b47c195bc9b4dbd7f2b87 in this term.
I20260709 13:06:10.092691 23740 leader_election.cc:290] T f1b10566f45d4a7d9029858330e02d5b P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 13 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:06:10.015230 23762 raft_consensus.cc:515] T 48824d5acfbc485ebf8c2d944e7202de P 127766fc592545a4997f7790f50f6076 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:10.098243 20105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7be9efa6559648dbb5a0f7684c4542d1" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:06:10.098984 20105 raft_consensus.cc:2468] T 7be9efa6559648dbb5a0f7684c4542d1 P 127766fc592545a4997f7790f50f6076 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 12.
I20260709 13:06:10.100265 23378 raft_consensus.cc:515] T ff75a1d4cb1f493db8f71ddc136ba9ab P 0473d2b2d01f4459b1e90fd12cc7840e [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:10.101461 23709 raft_consensus.cc:3060] T 1f85fc4b527a48848e5faa083b604e36 P 127766fc592545a4997f7790f50f6076 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:06:10.104803 23465 raft_consensus.cc:2804] T 65d8cb8d6ec64f459d5a47cefab10acf P e5256d91808b47c195bc9b4dbd7f2b87 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:06:10.105216 23465 raft_consensus.cc:493] T 65d8cb8d6ec64f459d5a47cefab10acf P e5256d91808b47c195bc9b4dbd7f2b87 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:10.105350 19557 raft_consensus.cc:3055] T 217b5fae677b4971b3bbd2f357a1f7ff P e61c3a8f61bb48f8a963c9480e53c168 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:06:10.105755 23465 raft_consensus.cc:3060] T 65d8cb8d6ec64f459d5a47cefab10acf P e5256d91808b47c195bc9b4dbd7f2b87 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:06:10.096576 19406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7be9efa6559648dbb5a0f7684c4542d1" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:06:10.107113 19406 raft_consensus.cc:2468] T 7be9efa6559648dbb5a0f7684c4542d1 P e5256d91808b47c195bc9b4dbd7f2b87 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 12.
I20260709 13:06:10.105796 19557 raft_consensus.cc:740] T 217b5fae677b4971b3bbd2f357a1f7ff P e61c3a8f61bb48f8a963c9480e53c168 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: e61c3a8f61bb48f8a963c9480e53c168, State: Running, Role: LEADER
I20260709 13:06:10.114044 19409 raft_consensus.cc:1275] T 2b74109013a140ada21feeef92d6f563 P e5256d91808b47c195bc9b4dbd7f2b87 [term 8 FOLLOWER]: Refusing update from remote peer 0473d2b2d01f4459b1e90fd12cc7840e: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 13:06:10.102389 23378 leader_election.cc:290] T ff75a1d4cb1f493db8f71ddc136ba9ab P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 11 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:06:10.117048 19551 raft_consensus.cc:1275] T 2b74109013a140ada21feeef92d6f563 P e61c3a8f61bb48f8a963c9480e53c168 [term 8 FOLLOWER]: Refusing update from remote peer 0473d2b2d01f4459b1e90fd12cc7840e: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 13:06:10.123122 19481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0afb57ae58a24a01850491d69f0213dd" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:06:10.124518 19485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96efeaaf1057492490e9a621f37e1a2d" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:06:10.125248 19485 raft_consensus.cc:2468] T 96efeaaf1057492490e9a621f37e1a2d P 0473d2b2d01f4459b1e90fd12cc7840e [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 12.
I20260709 13:06:10.126550 19483 raft_consensus.cc:1240] T 7f575b143b844aa096b50997dad3516a P 0473d2b2d01f4459b1e90fd12cc7840e [term 8 FOLLOWER]: Rejecting Update request from peer e61c3a8f61bb48f8a963c9480e53c168 for earlier term 7. Current term is 8. Ops: []
I20260709 13:06:10.122426 19482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48824d5acfbc485ebf8c2d944e7202de" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:06:10.128260 19482 raft_consensus.cc:3060] T 48824d5acfbc485ebf8c2d944e7202de P 0473d2b2d01f4459b1e90fd12cc7840e [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:06:10.132397 19481 raft_consensus.cc:1240] T 40e1e16737a842ee936002830f36882e P 0473d2b2d01f4459b1e90fd12cc7840e [term 15 FOLLOWER]: Rejecting Update request from peer e61c3a8f61bb48f8a963c9480e53c168 for earlier term 14. Current term is 15. Ops: []
I20260709 13:06:10.133796 19483 raft_consensus.cc:1240] T 217b5fae677b4971b3bbd2f357a1f7ff P 0473d2b2d01f4459b1e90fd12cc7840e [term 9 FOLLOWER]: Rejecting Update request from peer e61c3a8f61bb48f8a963c9480e53c168 for earlier term 8. Current term is 9. Ops: [7.5-8.6]
I20260709 13:06:10.133980 19407 raft_consensus.cc:1275] T 4509b76741dc428e9201c70c1658da13 P e5256d91808b47c195bc9b4dbd7f2b87 [term 6 FOLLOWER]: Refusing update from remote peer 0473d2b2d01f4459b1e90fd12cc7840e: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:06:10.136004 19485 raft_consensus.cc:1240] T e381f1d6b8184797ad142de49be225a8 P 0473d2b2d01f4459b1e90fd12cc7840e [term 9 FOLLOWER]: Rejecting Update request from peer e61c3a8f61bb48f8a963c9480e53c168 for earlier term 8. Current term is 9. Ops: []
I20260709 13:06:10.136914 19486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b08304a0a02b42d7840c4e8ee9a6bd1a" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:06:10.138252 19478 raft_consensus.cc:1240] T 76cb037fc9064d13b59a8969d897ce8c P 0473d2b2d01f4459b1e90fd12cc7840e [term 11 FOLLOWER]: Rejecting Update request from peer e61c3a8f61bb48f8a963c9480e53c168 for earlier term 10. Current term is 11. Ops: [9.5-10.6]
I20260709 13:06:10.137269 19480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab43d85f64114d4ebf618930e43d9ed0" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 12 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:06:10.140496 19484 raft_consensus.cc:1240] T edd7d470b5014c9489be7f41f64355c9 P 0473d2b2d01f4459b1e90fd12cc7840e [term 12 FOLLOWER]: Rejecting Update request from peer e61c3a8f61bb48f8a963c9480e53c168 for earlier term 11. Current term is 12. Ops: []
I20260709 13:06:10.140637 19480 raft_consensus.cc:2393] T ab43d85f64114d4ebf618930e43d9ed0 P 0473d2b2d01f4459b1e90fd12cc7840e [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e61c3a8f61bb48f8a963c9480e53c168 in current term 12: Already voted for candidate 0473d2b2d01f4459b1e90fd12cc7840e in this term.
I20260709 13:06:10.142802 19450 leader_election.cc:304] T 40e1e16737a842ee936002830f36882e P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e; no voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:06:10.144413 19486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14935b3ddf914369822e4a0547aaa355" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:06:10.146960 19483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f93ee515a9c14139bf566522ed8232f3" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 16 candidate_status { last_received { term: 12 index: 5 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:06:10.148355 19482 raft_consensus.cc:2468] T 48824d5acfbc485ebf8c2d944e7202de P 0473d2b2d01f4459b1e90fd12cc7840e [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 12.
I20260709 13:06:10.120596 23713 raft_consensus.cc:493] T 2b74109013a140ada21feeef92d6f563 P e61c3a8f61bb48f8a963c9480e53c168 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:10.151628 19450 leader_election.cc:304] T 62c6c134d3d24a1ab144dd9ee6bc3f64 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e; no voters: 127766fc592545a4997f7790f50f6076, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:06:10.146263 19485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dc5b3532fe54f74876d02beffa2c230" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:06:10.152489 19482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46c5bfeecc314717bffe987e6844b6d0" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 17 candidate_status { last_received { term: 16 index: 7 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:06:10.152881 19485 raft_consensus.cc:2393] T 1dc5b3532fe54f74876d02beffa2c230 P 0473d2b2d01f4459b1e90fd12cc7840e [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e61c3a8f61bb48f8a963c9480e53c168 in current term 12: Already voted for candidate e5256d91808b47c195bc9b4dbd7f2b87 in this term.
I20260709 13:06:10.158077 19450 leader_election.cc:304] T e381f1d6b8184797ad142de49be225a8 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e; no voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:06:10.061744 23817 raft_consensus.cc:515] T 179fd671030940b4b4a4e24bcc4aba0a P e61c3a8f61bb48f8a963c9480e53c168 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:10.162428 19450 leader_election.cc:304] T 46c5bfeecc314717bffe987e6844b6d0 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168; no voters: e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:06:10.141578 19557 consensus_queue.cc:260] T 217b5fae677b4971b3bbd2f357a1f7ff P e61c3a8f61bb48f8a963c9480e53c168 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:10.164563 19484 raft_consensus.cc:1240] T a08760e15aac4630a629431f56024dc8 P 0473d2b2d01f4459b1e90fd12cc7840e [term 14 FOLLOWER]: Rejecting Update request from peer e61c3a8f61bb48f8a963c9480e53c168 for earlier term 13. Current term is 14. Ops: [11.7-13.8]
I20260709 13:06:10.105485 23619 raft_consensus.cc:515] T df751f992649444090e27965eb1af85d P e5256d91808b47c195bc9b4dbd7f2b87 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:10.168242 19450 leader_election.cc:304] T 3e1f505cb0f1427bbd698ac889d80821 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e; no voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:06:10.172413 19557 raft_consensus.cc:3060] T 217b5fae677b4971b3bbd2f357a1f7ff P e61c3a8f61bb48f8a963c9480e53c168 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:06:10.121788 23730 consensus_queue.cc:1059] T e381f1d6b8184797ad142de49be225a8 P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 }, Status: INVALID_TERM, Last received: 8.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.038s
I20260709 13:06:10.173671 19450 leader_election.cc:304] T d1e5873a19244c5ebbcd38e126796ee7 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e; no voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168
W20260709 13:06:10.174437 19377 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.2:46257, user_credentials={real_user=slave}} blocked reactor thread for 234521us
I20260709 13:06:10.178296 19377 leader_election.cc:304] T ff9b0eddd810459b82d91c60777c10eb P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, 127766fc592545a4997f7790f50f6076
I20260709 13:06:10.179450 19482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e5873a19244c5ebbcd38e126796ee7" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:06:10.180387 19482 raft_consensus.cc:2393] T d1e5873a19244c5ebbcd38e126796ee7 P 0473d2b2d01f4459b1e90fd12cc7840e [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e61c3a8f61bb48f8a963c9480e53c168 in current term 13: Already voted for candidate 0473d2b2d01f4459b1e90fd12cc7840e in this term.
I20260709 13:06:10.180994 19551 raft_consensus.cc:3055] T 76cb037fc9064d13b59a8969d897ce8c P e61c3a8f61bb48f8a963c9480e53c168 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:06:10.182703 19551 raft_consensus.cc:740] T 76cb037fc9064d13b59a8969d897ce8c P e61c3a8f61bb48f8a963c9480e53c168 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: e61c3a8f61bb48f8a963c9480e53c168, State: Running, Role: LEADER
I20260709 13:06:10.182142 19377 leader_election.cc:304] T 21e14947d70440f19044d8f75c31e1f9 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87; no voters: e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:06:10.156540 23713 raft_consensus.cc:3060] T 2b74109013a140ada21feeef92d6f563 P e61c3a8f61bb48f8a963c9480e53c168 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:06:10.159292 23378 raft_consensus.cc:2749] T 62c6c134d3d24a1ab144dd9ee6bc3f64 P 0473d2b2d01f4459b1e90fd12cc7840e [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:06:10.190687 19555 raft_consensus.cc:2468] T 179fd671030940b4b4a4e24bcc4aba0a P e61c3a8f61bb48f8a963c9480e53c168 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 12.
I20260709 13:06:10.197700 19485 raft_consensus.cc:1240] T f1b10566f45d4a7d9029858330e02d5b P 0473d2b2d01f4459b1e90fd12cc7840e [term 13 FOLLOWER]: Rejecting Update request from peer e61c3a8f61bb48f8a963c9480e53c168 for earlier term 12. Current term is 13. Ops: []
I20260709 13:06:10.217696 23753 raft_consensus.cc:2804] T 21e14947d70440f19044d8f75c31e1f9 P e5256d91808b47c195bc9b4dbd7f2b87 [term 11 FOLLOWER]: Leader pre-election won for term 12
W20260709 13:06:10.218048 19524 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:10.218293 23660 consensus_queue.cc:1048] T bc225c93219c45538b53a1bd3d387e4d P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:06:10.219439 19484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed7fdbcb96d14d418db9ca90a792588a" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 10 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:06:10.247629 19486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa8650e71aa14778b3d73721fc50d9fc" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:06:10.220266 23820 raft_consensus.cc:2749] T d1e5873a19244c5ebbcd38e126796ee7 P 0473d2b2d01f4459b1e90fd12cc7840e [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:06:10.160048 23819 raft_consensus.cc:2749] T 40e1e16737a842ee936002830f36882e P 0473d2b2d01f4459b1e90fd12cc7840e [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:06:10.249056 23820 consensus_queue.cc:1048] T f93ee515a9c14139bf566522ed8232f3 P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:06:10.249347 23819 consensus_queue.cc:1048] T 2b74109013a140ada21feeef92d6f563 P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:06:10.196725 19377 leader_election.cc:304] T 2725d2c4cb054f18b0fc8f735c15f6c2 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87; no voters: 
I20260709 13:06:10.175887 23663 raft_consensus.cc:2804] T 46c5bfeecc314717bffe987e6844b6d0 P 0473d2b2d01f4459b1e90fd12cc7840e [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:06:10.252771 19482 raft_consensus.cc:1275] T 21e14947d70440f19044d8f75c31e1f9 P 0473d2b2d01f4459b1e90fd12cc7840e [term 11 FOLLOWER]: Refusing update from remote peer e61c3a8f61bb48f8a963c9480e53c168: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
W20260709 13:06:10.250720 19377 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.2:46257, user_credentials={real_user=slave}} blocked reactor thread for 54101.9us
I20260709 13:06:10.169577 23740 raft_consensus.cc:2749] T e381f1d6b8184797ad142de49be225a8 P 0473d2b2d01f4459b1e90fd12cc7840e [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:06:10.176131 23714 raft_consensus.cc:2749] T 3e1f505cb0f1427bbd698ac889d80821 P 0473d2b2d01f4459b1e90fd12cc7840e [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:06:10.185137 23587 raft_consensus.cc:2749] T ff9b0eddd810459b82d91c60777c10eb P e5256d91808b47c195bc9b4dbd7f2b87 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
W20260709 13:06:10.264593 20076 leader_election.cc:336] T 7be9efa6559648dbb5a0f7684c4542d1 P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 12 election: RPC error from VoteRequest() call to peer e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891): Timed out: RequestConsensusVote RPC to 127.17.223.3:36891 timed out after 1.674s (SENT)
I20260709 13:06:10.270236 20076 leader_election.cc:304] T 7be9efa6559648dbb5a0f7684c4542d1 P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, 127766fc592545a4997f7790f50f6076; no voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168
W20260709 13:06:10.251713 23813 log.cc:927] Time spent T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P e5256d91808b47c195bc9b4dbd7f2b87: Append to log took a long time: real 0.069s	user 0.000s	sys 0.000s
W20260709 13:06:10.277758 19523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.1:40321, user_credentials={real_user=slave}} blocked reactor thread for 245994us
I20260709 13:06:10.244441 23753 raft_consensus.cc:493] T 21e14947d70440f19044d8f75c31e1f9 P e5256d91808b47c195bc9b4dbd7f2b87 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:10.195787 23717 leader_election.cc:290] T 96efeaaf1057492490e9a621f37e1a2d P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 12 election: Requested vote from peers e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
W20260709 13:06:10.337010 19523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.1:40321, user_credentials={real_user=slave}} blocked reactor thread for 58398.9us
I20260709 13:06:10.259184 23605 raft_consensus.cc:2804] T 2725d2c4cb054f18b0fc8f735c15f6c2 P e5256d91808b47c195bc9b4dbd7f2b87 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:06:10.352573 23505 raft_consensus.cc:3055] T e381f1d6b8184797ad142de49be225a8 P e61c3a8f61bb48f8a963c9480e53c168 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:06:10.353175 23505 raft_consensus.cc:740] T e381f1d6b8184797ad142de49be225a8 P e61c3a8f61bb48f8a963c9480e53c168 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: e61c3a8f61bb48f8a963c9480e53c168, State: Running, Role: LEADER
W20260709 13:06:10.358949 20076 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.3:36891, user_credentials={real_user=slave}} blocked reactor thread for 94404.6us
I20260709 13:06:10.253024 23663 raft_consensus.cc:493] T 46c5bfeecc314717bffe987e6844b6d0 P 0473d2b2d01f4459b1e90fd12cc7840e [term 16 FOLLOWER]: Starting leader election (detected failure of leader e5256d91808b47c195bc9b4dbd7f2b87)
I20260709 13:06:10.365338 19482 raft_consensus.cc:1240] T ff75a1d4cb1f493db8f71ddc136ba9ab P 0473d2b2d01f4459b1e90fd12cc7840e [term 11 FOLLOWER]: Rejecting Update request from peer e61c3a8f61bb48f8a963c9480e53c168 for earlier term 10. Current term is 11. Ops: []
I20260709 13:06:10.364123 19560 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40428 (request call id 2452) took 1079 ms. Trace:
I20260709 13:06:10.373802 19523 leader_election.cc:304] T 65d8cb8d6ec64f459d5a47cefab10acf P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:06:10.364202 19551 consensus_queue.cc:260] T 76cb037fc9064d13b59a8969d897ce8c P e61c3a8f61bb48f8a963c9480e53c168 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:10.369452 19560 rpcz_store.cc:276] 0709 13:06:09.278502 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:09.463919 (+185417us) service_pool.cc:224] Handling call
0709 13:06:10.358121 (+894202us) spinlock_profiling.cc:243] Waited 675 ms on lock 0x7b540030a2d4. stack: 00007f4a79de9343 00007f4a79de9240 00007f4a797781d4 00007f4a834b6304 00007f4a834b6299 00007f4a7ce71571 00007f4a7cf0c2fa 00007f4a81ecdb17 00007f4a7b4486d4 00007f4a7b448662 00007f4a7b448591 00007f4a7b44850c 00007f4a7b4477c2 00007f4a7b24348c 00007f4a7b2428c6 00007f4a7b24226f
0709 13:06:10.358258 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1552070912}
I20260709 13:06:10.382371 19482 raft_consensus.cc:1240] T 3e1f505cb0f1427bbd698ac889d80821 P 0473d2b2d01f4459b1e90fd12cc7840e [term 12 FOLLOWER]: Rejecting Update request from peer e61c3a8f61bb48f8a963c9480e53c168 for earlier term 11. Current term is 12. Ops: [11.7-11.7]
I20260709 13:06:10.384047 19551 raft_consensus.cc:3060] T 76cb037fc9064d13b59a8969d897ce8c P e61c3a8f61bb48f8a963c9480e53c168 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:06:10.357875 23753 raft_consensus.cc:3060] T 21e14947d70440f19044d8f75c31e1f9 P e5256d91808b47c195bc9b4dbd7f2b87 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:06:10.389420 19450 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.3:36891, user_credentials={real_user=slave}} blocked reactor thread for 168862us
I20260709 13:06:10.378607 19449 leader_election.cc:304] T 179fd671030940b4b4a4e24bcc4aba0a P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e; no voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:06:10.361306 23534 raft_consensus.cc:2749] T 7be9efa6559648dbb5a0f7684c4542d1 P 127766fc592545a4997f7790f50f6076 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:06:10.364151 23605 raft_consensus.cc:697] T 2725d2c4cb054f18b0fc8f735c15f6c2 P e5256d91808b47c195bc9b4dbd7f2b87 [term 14 LEADER]: Becoming Leader. State: Replica: e5256d91808b47c195bc9b4dbd7f2b87, State: Running, Role: LEADER
I20260709 13:06:10.371280 23663 raft_consensus.cc:3060] T 46c5bfeecc314717bffe987e6844b6d0 P 0473d2b2d01f4459b1e90fd12cc7840e [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:06:10.273900 23692 raft_consensus.cc:515] T ef32ce6fdd0e40d382c79974f30295c6 P e5256d91808b47c195bc9b4dbd7f2b87 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:10.362234 23730 consensus_queue.cc:1059] T edd7d470b5014c9489be7f41f64355c9 P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 }, Status: INVALID_TERM, Last received: 11.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.039s
I20260709 13:06:10.394361 23755 raft_consensus.cc:2804] T 65d8cb8d6ec64f459d5a47cefab10acf P e61c3a8f61bb48f8a963c9480e53c168 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:06:10.354457 23505 consensus_queue.cc:260] T e381f1d6b8184797ad142de49be225a8 P e61c3a8f61bb48f8a963c9480e53c168 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
W20260709 13:06:10.402256 23414 consensus_meta.cc:287] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P 0473d2b2d01f4459b1e90fd12cc7840e: Time spent flushing consensus metadata: real 0.646s	user 0.005s	sys 0.005s
I20260709 13:06:10.398741 23740 raft_consensus.cc:2749] T 179fd671030940b4b4a4e24bcc4aba0a P 0473d2b2d01f4459b1e90fd12cc7840e [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:06:10.449766 23772 consensus_meta.cc:287] T 85c494af21f9457a85da47b9bc70c1fd P e5256d91808b47c195bc9b4dbd7f2b87: Time spent flushing consensus metadata: real 0.507s	user 0.004s	sys 0.005s
W20260709 13:06:10.455904 20076 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:10.457046 23414 raft_consensus.cc:515] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P 0473d2b2d01f4459b1e90fd12cc7840e [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:10.469319 23505 raft_consensus.cc:3060] T e381f1d6b8184797ad142de49be225a8 P e61c3a8f61bb48f8a963c9480e53c168 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:06:10.429833 23833 raft_consensus.cc:493] T 0cdf56e38bbc453d9438d359e5a69955 P e5256d91808b47c195bc9b4dbd7f2b87 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader e61c3a8f61bb48f8a963c9480e53c168)
I20260709 13:06:10.504570 23833 raft_consensus.cc:515] T 0cdf56e38bbc453d9438d359e5a69955 P e5256d91808b47c195bc9b4dbd7f2b87 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:10.471866 23663 raft_consensus.cc:515] T 46c5bfeecc314717bffe987e6844b6d0 P 0473d2b2d01f4459b1e90fd12cc7840e [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:10.493284 23772 raft_consensus.cc:515] T 85c494af21f9457a85da47b9bc70c1fd P e5256d91808b47c195bc9b4dbd7f2b87 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:10.508059 19409 raft_consensus.cc:1240] T 85c494af21f9457a85da47b9bc70c1fd P e5256d91808b47c195bc9b4dbd7f2b87 [term 9 FOLLOWER]: Rejecting Update request from peer 127766fc592545a4997f7790f50f6076 for earlier term 8. Current term is 9. Ops: []
I20260709 13:06:10.508363 23663 leader_election.cc:290] T 46c5bfeecc314717bffe987e6844b6d0 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 17 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:06:10.473901 23817 leader_election.cc:290] T 179fd671030940b4b4a4e24bcc4aba0a P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:06:10.509871 23772 leader_election.cc:290] T 85c494af21f9457a85da47b9bc70c1fd P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 9 election: Requested vote from peers e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:06:10.474706 23619 leader_election.cc:290] T df751f992649444090e27965eb1af85d P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 14 election: Requested vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
W20260709 13:06:10.475240 23831 log.cc:927] Time spent T 1efebf73c86e432baa55533136b6e12c P e61c3a8f61bb48f8a963c9480e53c168: Append to log took a long time: real 0.129s	user 0.000s	sys 0.001s
I20260709 13:06:10.425810 23785 raft_consensus.cc:493] T 1efebf73c86e432baa55533136b6e12c P 127766fc592545a4997f7790f50f6076 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:10.495208 23692 leader_election.cc:290] T ef32ce6fdd0e40d382c79974f30295c6 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 14 election: Requested vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
W20260709 13:06:10.475387 23214 consensus_meta.cc:287] T 0afb57ae58a24a01850491d69f0213dd P e61c3a8f61bb48f8a963c9480e53c168: Time spent flushing consensus metadata: real 0.862s	user 0.010s	sys 0.003s
I20260709 13:06:10.473621 23605 consensus_queue.cc:237] T 2725d2c4cb054f18b0fc8f735c15f6c2 P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 12.6, Last appended by leader: 6, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:10.513044 19551 raft_consensus.cc:1275] T 76cb037fc9064d13b59a8969d897ce8c P e61c3a8f61bb48f8a963c9480e53c168 [term 11 FOLLOWER]: Refusing update from remote peer e5256d91808b47c195bc9b4dbd7f2b87: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 6. (term mismatch)
I20260709 13:06:10.541716 19551 pending_rounds.cc:85] T 76cb037fc9064d13b59a8969d897ce8c P e61c3a8f61bb48f8a963c9480e53c168: Aborting all ops after (but not including) 5
I20260709 13:06:10.542155 19551 pending_rounds.cc:107] T 76cb037fc9064d13b59a8969d897ce8c P e61c3a8f61bb48f8a963c9480e53c168: Aborting uncommitted NO_OP operation due to leader change: 10.6
I20260709 13:06:10.542528 19551 raft_consensus.cc:2889] T 76cb037fc9064d13b59a8969d897ce8c P e61c3a8f61bb48f8a963c9480e53c168 [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:06:10.516275 19403 raft_consensus.cc:2468] T 70797e5783b5454ab0d0eea663e791e3 P e5256d91808b47c195bc9b4dbd7f2b87 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 127766fc592545a4997f7790f50f6076 in term 12.
W20260709 13:06:10.528285 19449 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.1:40321, user_credentials={real_user=slave}} blocked reactor thread for 109363us
I20260709 13:06:10.486188 23378 raft_consensus.cc:493] T b9f0d59553ad444883fcf5b5909f9798 P 0473d2b2d01f4459b1e90fd12cc7840e [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:10.529120 19557 raft_consensus.cc:1275] T 217b5fae677b4971b3bbd2f357a1f7ff P e61c3a8f61bb48f8a963c9480e53c168 [term 9 FOLLOWER]: Refusing update from remote peer e5256d91808b47c195bc9b4dbd7f2b87: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 9 index: 6. (term mismatch)
I20260709 13:06:10.545425 19557 pending_rounds.cc:85] T 217b5fae677b4971b3bbd2f357a1f7ff P e61c3a8f61bb48f8a963c9480e53c168: Aborting all ops after (but not including) 5
I20260709 13:06:10.545809 19557 pending_rounds.cc:107] T 217b5fae677b4971b3bbd2f357a1f7ff P e61c3a8f61bb48f8a963c9480e53c168: Aborting uncommitted NO_OP operation due to leader change: 8.6
W20260709 13:06:10.532083 23769 consensus_meta.cc:287] T 28af091831594f9d8e96482078cc7625 P e61c3a8f61bb48f8a963c9480e53c168: Time spent flushing consensus metadata: real 0.560s	user 0.007s	sys 0.003s
I20260709 13:06:10.537251 19479 raft_consensus.cc:1240] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P 0473d2b2d01f4459b1e90fd12cc7840e [term 13 FOLLOWER]: Rejecting Update request from peer 127766fc592545a4997f7790f50f6076 for earlier term 12. Current term is 13. Ops: [12.11-12.11]
I20260709 13:06:10.470170 23823 raft_consensus.cc:515] T 6c5eebf646ad445a9d1b1adc319d7b16 P 0473d2b2d01f4459b1e90fd12cc7840e [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:10.546134 19557 raft_consensus.cc:2889] T 217b5fae677b4971b3bbd2f357a1f7ff P e61c3a8f61bb48f8a963c9480e53c168 [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:06:10.553768 20105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96efeaaf1057492490e9a621f37e1a2d" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076"
I20260709 13:06:10.556406 20105 raft_consensus.cc:2393] T 96efeaaf1057492490e9a621f37e1a2d P 127766fc592545a4997f7790f50f6076 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 0473d2b2d01f4459b1e90fd12cc7840e in current term 12: Already voted for candidate 127766fc592545a4997f7790f50f6076 in this term.
W20260709 13:06:10.556603 19523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.1:40321, user_credentials={real_user=slave}} blocked reactor thread for 178475us
I20260709 13:06:10.558525 19403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ece3db938bc649d4a40a51522ed5259c" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:06:10.620694 19411 raft_consensus.cc:1240] T 76cb037fc9064d13b59a8969d897ce8c P e5256d91808b47c195bc9b4dbd7f2b87 [term 11 LEADER]: Rejecting Update request from peer e61c3a8f61bb48f8a963c9480e53c168 for earlier term 10. Current term is 11. Ops: [10.6-10.6]
I20260709 13:06:10.620762 19553 raft_consensus.cc:1275] T 28af091831594f9d8e96482078cc7625 P e61c3a8f61bb48f8a963c9480e53c168 [term 12 FOLLOWER]: Refusing update from remote peer 0473d2b2d01f4459b1e90fd12cc7840e: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 12 index: 6. (term mismatch)
I20260709 13:06:10.621681 19553 pending_rounds.cc:85] T 28af091831594f9d8e96482078cc7625 P e61c3a8f61bb48f8a963c9480e53c168: Aborting all ops after (but not including) 5
I20260709 13:06:10.621881 19405 raft_consensus.cc:1240] T 1a61655d99124a29b486ba4a5b37faea P e5256d91808b47c195bc9b4dbd7f2b87 [term 8 FOLLOWER]: Rejecting Update request from peer e61c3a8f61bb48f8a963c9480e53c168 for earlier term 7. Current term is 8. Ops: []
I20260709 13:06:10.621944 19553 pending_rounds.cc:107] T 28af091831594f9d8e96482078cc7625 P e61c3a8f61bb48f8a963c9480e53c168: Aborting uncommitted NO_OP operation due to leader change: 11.6
I20260709 13:06:10.601740 19408 raft_consensus.cc:1240] T 217b5fae677b4971b3bbd2f357a1f7ff P e5256d91808b47c195bc9b4dbd7f2b87 [term 9 LEADER]: Rejecting Update request from peer e61c3a8f61bb48f8a963c9480e53c168 for earlier term 8. Current term is 9. Ops: [8.6-8.6]
I20260709 13:06:10.622557 19553 raft_consensus.cc:2889] T 28af091831594f9d8e96482078cc7625 P e61c3a8f61bb48f8a963c9480e53c168 [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:06:10.575985 20076 leader_election.cc:304] T 0afb57ae58a24a01850491d69f0213dd P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 127766fc592545a4997f7790f50f6076; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:06:10.623404 20105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed7fdbcb96d14d418db9ca90a792588a" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 10 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:06:10.624003 19449 leader_election.cc:304] T 7be9efa6559648dbb5a0f7684c4542d1 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, 127766fc592545a4997f7790f50f6076, e5256d91808b47c195bc9b4dbd7f2b87; no voters: 
I20260709 13:06:10.581128 19404 raft_consensus.cc:1240] T a08760e15aac4630a629431f56024dc8 P e5256d91808b47c195bc9b4dbd7f2b87 [term 14 LEADER]: Rejecting Update request from peer e61c3a8f61bb48f8a963c9480e53c168 for earlier term 13. Current term is 14. Ops: [13.8-13.8]
I20260709 13:06:10.625603 23725 raft_consensus.cc:2804] T 7be9efa6559648dbb5a0f7684c4542d1 P 0473d2b2d01f4459b1e90fd12cc7840e [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:06:10.561056 20109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ece3db938bc649d4a40a51522ed5259c" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:06:10.625983 23725 raft_consensus.cc:493] T 7be9efa6559648dbb5a0f7684c4542d1 P 0473d2b2d01f4459b1e90fd12cc7840e [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:10.626346 23725 raft_consensus.cc:3060] T 7be9efa6559648dbb5a0f7684c4542d1 P 0473d2b2d01f4459b1e90fd12cc7840e [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:06:10.626579 19482 raft_consensus.cc:1240] T 0cdf56e38bbc453d9438d359e5a69955 P 0473d2b2d01f4459b1e90fd12cc7840e [term 13 FOLLOWER]: Rejecting Update request from peer e61c3a8f61bb48f8a963c9480e53c168 for earlier term 12. Current term is 13. Ops: []
I20260709 13:06:10.628757 19482 raft_consensus.cc:1240] T 2e36a9d6e29c4a7c860cf267efbd4c74 P 0473d2b2d01f4459b1e90fd12cc7840e [term 9 FOLLOWER]: Rejecting Update request from peer e61c3a8f61bb48f8a963c9480e53c168 for earlier term 8. Current term is 9. Ops: []
I20260709 13:06:10.630191 19485 raft_consensus.cc:1240] T 1a61655d99124a29b486ba4a5b37faea P 0473d2b2d01f4459b1e90fd12cc7840e [term 8 FOLLOWER]: Rejecting Update request from peer e61c3a8f61bb48f8a963c9480e53c168 for earlier term 7. Current term is 8. Ops: []
I20260709 13:06:10.633000 19485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "179fd671030940b4b4a4e24bcc4aba0a" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:06:10.633559 19485 raft_consensus.cc:2468] T 179fd671030940b4b4a4e24bcc4aba0a P 0473d2b2d01f4459b1e90fd12cc7840e [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 12.
I20260709 13:06:10.598627 19402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85c494af21f9457a85da47b9bc70c1fd" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
W20260709 13:06:10.637429 19524 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:10.637988 19524 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:10.542340 23714 consensus_queue.cc:1048] T 2b74109013a140ada21feeef92d6f563 P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.101s
I20260709 13:06:10.538170 23785 raft_consensus.cc:515] T 1efebf73c86e432baa55533136b6e12c P 127766fc592545a4997f7790f50f6076 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:10.641168 23805 raft_consensus.cc:2749] T 0afb57ae58a24a01850491d69f0213dd P 127766fc592545a4997f7790f50f6076 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:06:10.641430 23756 consensus_meta.cc:287] T ef32ce6fdd0e40d382c79974f30295c6 P e61c3a8f61bb48f8a963c9480e53c168: Time spent flushing consensus metadata: real 0.684s	user 0.008s	sys 0.003s
W20260709 13:06:10.639676 20076 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.3:36891, user_credentials={real_user=slave}} blocked reactor thread for 63812.6us
I20260709 13:06:10.651072 23756 raft_consensus.cc:515] T ef32ce6fdd0e40d382c79974f30295c6 P e61c3a8f61bb48f8a963c9480e53c168 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
W20260709 13:06:10.642886 23838 log.cc:927] Time spent T ed7fdbcb96d14d418db9ca90a792588a P e61c3a8f61bb48f8a963c9480e53c168: Append to log took a long time: real 0.078s	user 0.002s	sys 0.002s
I20260709 13:06:10.654505 23756 leader_election.cc:290] T ef32ce6fdd0e40d382c79974f30295c6 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 14 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:06:10.656425 23414 leader_election.cc:290] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 13 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
W20260709 13:06:10.657310 19523 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:10.657415 19526 leader_election.cc:304] T 96efeaaf1057492490e9a621f37e1a2d P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:06:10.657596 19485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef32ce6fdd0e40d382c79974f30295c6" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:06:10.658977 23547 raft_consensus.cc:2804] T 96efeaaf1057492490e9a621f37e1a2d P e61c3a8f61bb48f8a963c9480e53c168 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:06:10.659116 19482 raft_consensus.cc:1275] T 1efebf73c86e432baa55533136b6e12c P 0473d2b2d01f4459b1e90fd12cc7840e [term 11 FOLLOWER]: Refusing update from remote peer e61c3a8f61bb48f8a963c9480e53c168: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:06:10.659366 23547 raft_consensus.cc:493] T 96efeaaf1057492490e9a621f37e1a2d P e61c3a8f61bb48f8a963c9480e53c168 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:10.659716 23547 raft_consensus.cc:3060] T 96efeaaf1057492490e9a621f37e1a2d P e61c3a8f61bb48f8a963c9480e53c168 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:06:10.660280 23665 consensus_queue.cc:1059] T 7f575b143b844aa096b50997dad3516a P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 }, Status: INVALID_TERM, Last received: 7.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:06:10.661454 23704 raft_consensus.cc:3055] T 7f575b143b844aa096b50997dad3516a P e61c3a8f61bb48f8a963c9480e53c168 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:06:10.661810 23704 raft_consensus.cc:740] T 7f575b143b844aa096b50997dad3516a P e61c3a8f61bb48f8a963c9480e53c168 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: e61c3a8f61bb48f8a963c9480e53c168, State: Running, Role: LEADER
I20260709 13:06:10.642808 19407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa8650e71aa14778b3d73721fc50d9fc" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:06:10.647452 19410 raft_consensus.cc:1240] T 3e1f505cb0f1427bbd698ac889d80821 P e5256d91808b47c195bc9b4dbd7f2b87 [term 12 FOLLOWER]: Rejecting Update request from peer e61c3a8f61bb48f8a963c9480e53c168 for earlier term 11. Current term is 12. Ops: [11.7-11.7]
I20260709 13:06:10.664821 20076 leader_election.cc:304] T 833a2f0775ed407a94b8924ce50adb63 P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 127766fc592545a4997f7790f50f6076; no voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:06:10.647650 20105 raft_consensus.cc:1240] T 0e1085d23e8347fbbd5bce7542f4b1f4 P 127766fc592545a4997f7790f50f6076 [term 9 FOLLOWER]: Rejecting Update request from peer e61c3a8f61bb48f8a963c9480e53c168 for earlier term 8. Current term is 9. Ops: []
I20260709 13:06:10.668146 19523 leader_election.cc:304] T 14935b3ddf914369822e4a0547aaa355 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: e61c3a8f61bb48f8a963c9480e53c168; no voters: 127766fc592545a4997f7790f50f6076, e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:06:10.669541 20112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36f6ba92b9ba46babe4ebd6c02e5fbd9" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076"
I20260709 13:06:10.673372 19554 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41504 (request call id 618) took 1130 ms. Trace:
I20260709 13:06:10.673830 19554 rpcz_store.cc:276] 0709 13:06:09.543048 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:10.047124 (+504076us) service_pool.cc:224] Handling call
0709 13:06:10.047395 (+   271us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:10.277267 (+229872us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:10.277314 (+    47us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:10.346285 (+ 68971us) log.cc:844] Serialized 26 byte log entry
0709 13:06:10.405342 (+ 59057us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:06:10.405390 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:10.405474 (+    84us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:10.673122 (+267648us) raft_consensus.cc:1685] finished
0709 13:06:10.673148 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:10.673305 (+   157us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":81866,"raft.run_cpu_time_us":118,"raft.run_wall_time_us":4918,"thread_start_us":244937,"threads_started":2,"wal-append.queue_time_us":247599}
I20260709 13:06:10.679811 19526 leader_election.cc:304] T b08304a0a02b42d7840c4e8ee9a6bd1a P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e61c3a8f61bb48f8a963c9480e53c168; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:06:10.685819 20105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85c494af21f9457a85da47b9bc70c1fd" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:06:10.688738 23828 raft_consensus.cc:2749] T 14935b3ddf914369822e4a0547aaa355 P e61c3a8f61bb48f8a963c9480e53c168 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:06:10.690392 19523 leader_election.cc:304] T fa731b585f684a7fb2d106c50f143b83 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e61c3a8f61bb48f8a963c9480e53c168; no voters: 127766fc592545a4997f7790f50f6076, e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:06:10.693120 19557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70797e5783b5454ab0d0eea663e791e3" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:06:10.693533 19551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c5eebf646ad445a9d1b1adc319d7b16" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:06:10.694087 19555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab43d85f64114d4ebf618930e43d9ed0" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 12 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:06:10.694458 19526 leader_election.cc:304] T f93ee515a9c14139bf566522ed8232f3 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e61c3a8f61bb48f8a963c9480e53c168; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:06:10.695139 19555 raft_consensus.cc:2393] T ab43d85f64114d4ebf618930e43d9ed0 P e61c3a8f61bb48f8a963c9480e53c168 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 127766fc592545a4997f7790f50f6076 in current term 12: Already voted for candidate 0473d2b2d01f4459b1e90fd12cc7840e in this term.
W20260709 13:06:10.666391 23465 consensus_meta.cc:287] T 65d8cb8d6ec64f459d5a47cefab10acf P e5256d91808b47c195bc9b4dbd7f2b87: Time spent flushing consensus metadata: real 0.560s	user 0.011s	sys 0.000s
I20260709 13:06:10.699584 20105 raft_consensus.cc:1275] T 1efebf73c86e432baa55533136b6e12c P 127766fc592545a4997f7790f50f6076 [term 11 FOLLOWER]: Refusing update from remote peer e61c3a8f61bb48f8a963c9480e53c168: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:06:10.555387 23755 raft_consensus.cc:697] T 65d8cb8d6ec64f459d5a47cefab10acf P e61c3a8f61bb48f8a963c9480e53c168 [term 10 LEADER]: Becoming Leader. State: Replica: e61c3a8f61bb48f8a963c9480e53c168, State: Running, Role: LEADER
I20260709 13:06:10.555889 23740 raft_consensus.cc:493] T 5ec1c4ce15e04c7e8c283a62179f2a64 P 0473d2b2d01f4459b1e90fd12cc7840e [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 127766fc592545a4997f7790f50f6076)
I20260709 13:06:10.694126 19551 raft_consensus.cc:2468] T 6c5eebf646ad445a9d1b1adc319d7b16 P e61c3a8f61bb48f8a963c9480e53c168 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 127766fc592545a4997f7790f50f6076 in term 9.
I20260709 13:06:10.706061 23836 raft_consensus.cc:2749] T b08304a0a02b42d7840c4e8ee9a6bd1a P e61c3a8f61bb48f8a963c9480e53c168 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:06:10.711781 23465 raft_consensus.cc:515] T 65d8cb8d6ec64f459d5a47cefab10acf P e5256d91808b47c195bc9b4dbd7f2b87 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:10.713938 23465 leader_election.cc:290] T 65d8cb8d6ec64f459d5a47cefab10acf P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 11 election: Requested vote from peers e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:06:10.714902 20112 raft_consensus.cc:1240] T 70797e5783b5454ab0d0eea663e791e3 P 127766fc592545a4997f7790f50f6076 [term 12 FOLLOWER]: Rejecting Update request from peer e61c3a8f61bb48f8a963c9480e53c168 for earlier term 11. Current term is 12. Ops: []
I20260709 13:06:10.718832 23714 raft_consensus.cc:493] T 309c3ca0ca4b4f3ba129752ea2cb293b P 0473d2b2d01f4459b1e90fd12cc7840e [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 127766fc592545a4997f7790f50f6076)
I20260709 13:06:10.719426 23714 raft_consensus.cc:515] T 309c3ca0ca4b4f3ba129752ea2cb293b P 0473d2b2d01f4459b1e90fd12cc7840e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } attrs { replace: true } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:10.556949 23660 consensus_queue.cc:1048] T 4509b76741dc428e9201c70c1658da13 P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.134s
I20260709 13:06:10.642424 23785 leader_election.cc:290] T 1efebf73c86e432baa55533136b6e12c P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:06:10.545485 23214 raft_consensus.cc:515] T 0afb57ae58a24a01850491d69f0213dd P e61c3a8f61bb48f8a963c9480e53c168 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:10.683525 23784 raft_consensus.cc:2749] T 833a2f0775ed407a94b8924ce50adb63 P 127766fc592545a4997f7790f50f6076 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:06:10.556547 23378 raft_consensus.cc:515] T b9f0d59553ad444883fcf5b5909f9798 P 0473d2b2d01f4459b1e90fd12cc7840e [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:10.663216 23704 consensus_queue.cc:260] T 7f575b143b844aa096b50997dad3516a P e61c3a8f61bb48f8a963c9480e53c168 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 6, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:10.647421 23713 raft_consensus.cc:515] T 2b74109013a140ada21feeef92d6f563 P e61c3a8f61bb48f8a963c9480e53c168 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:10.704777 23756 raft_consensus.cc:2749] T fa731b585f684a7fb2d106c50f143b83 P e61c3a8f61bb48f8a963c9480e53c168 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:06:10.727517 20076 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.3:36891, user_credentials={real_user=slave}} blocked reactor thread for 45264.3us
I20260709 13:06:10.696391 23761 raft_consensus.cc:493] T 775c229504194560ba9589bc2199b089 P 127766fc592545a4997f7790f50f6076 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader e5256d91808b47c195bc9b4dbd7f2b87)
I20260709 13:06:10.740907 19410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff75a1d4cb1f493db8f71ddc136ba9ab" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
I20260709 13:06:10.732813 19558 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40428 (request call id 2457) took 1452 ms. Trace:
I20260709 13:06:10.727243 19526 leader_election.cc:304] T 1dc5b3532fe54f74876d02beffa2c230 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e61c3a8f61bb48f8a963c9480e53c168; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:06:10.687026 23486 consensus_queue.cc:1059] T 40e1e16737a842ee936002830f36882e P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 }, Status: INVALID_TERM, Last received: 14.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.048s
I20260709 13:06:10.745993 19526 leader_election.cc:304] T 46c5bfeecc314717bffe987e6844b6d0 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e61c3a8f61bb48f8a963c9480e53c168; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:06:10.747135 19407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1b10566f45d4a7d9029858330e02d5b" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
I20260709 13:06:10.750350 19559 raft_consensus.cc:1240] T 0afb57ae58a24a01850491d69f0213dd P e61c3a8f61bb48f8a963c9480e53c168 [term 11 FOLLOWER]: Rejecting Update request from peer 0473d2b2d01f4459b1e90fd12cc7840e for earlier term 10. Current term is 11. Ops: []
I20260709 13:06:10.727566 23692 raft_consensus.cc:493] T 4509b76741dc428e9201c70c1658da13 P e5256d91808b47c195bc9b4dbd7f2b87 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:10.749955 20076 leader_election.cc:304] T 6c5eebf646ad445a9d1b1adc319d7b16 P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 127766fc592545a4997f7790f50f6076, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:06:10.744850 19558 rpcz_store.cc:276] 0709 13:06:09.280500 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:10.013190 (+732690us) service_pool.cc:224] Handling call
0709 13:06:10.013504 (+   314us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:10.013746 (+   242us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:06:10.219823 (+206077us) log.cc:844] Serialized 14 byte log entry
0709 13:06:10.403135 (+183312us) log.cc:844] Serialized 14 byte log entry
0709 13:06:10.534424 (+131289us) spinlock_profiling.cc:243] Waited 889 us on lock 0x7b180031f480. stack: 00007f4a79de9343 00007f4a79de9240 00007f4a797781d4 00007f4a834b6304 00007f4a834b6299 00007f4a82ce3de1 00007f4a82cf05b1 00007f4a79d95c0a 00007f4a834d5219 00007f4a79e1da40 00007f4a79e184e4 00007f4a79e18455 00007f4a7cf00060 00007f4a7cf12716 00007f4a7cf23287 00007f4a7cf23208
0709 13:06:10.732401 (+197977us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:10.732455 (+    54us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:06:10.732505 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:10.732569 (+    64us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:10.732741 (+   172us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":320501,"prepare.queue_time_us":446281,"prepare.run_cpu_time_us":66,"prepare.run_wall_time_us":68,"raft.queue_time_us":153117,"raft.run_cpu_time_us":328,"raft.run_wall_time_us":44608,"spinlock_wait_cycles":2045184,"thread_start_us":559625,"threads_started":3,"wal-append.queue_time_us":247712}
I20260709 13:06:10.729774 23836 raft_consensus.cc:2749] T f93ee515a9c14139bf566522ed8232f3 P e61c3a8f61bb48f8a963c9480e53c168 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:06:10.731721 23619 raft_consensus.cc:493] T 2b74109013a140ada21feeef92d6f563 P e5256d91808b47c195bc9b4dbd7f2b87 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:10.771113 19407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46c5bfeecc314717bffe987e6844b6d0" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 17 candidate_status { last_received { term: 16 index: 7 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
I20260709 13:06:10.752070 20112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "309c3ca0ca4b4f3ba129752ea2cb293b" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:06:10.775152 19407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36f6ba92b9ba46babe4ebd6c02e5fbd9" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
I20260709 13:06:10.723009 23769 consensus_queue.cc:1059] T 0e1085d23e8347fbbd5bce7542f4b1f4 P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.025s
I20260709 13:06:10.784953 19409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "309c3ca0ca4b4f3ba129752ea2cb293b" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:06:10.739856 23714 leader_election.cc:290] T 309c3ca0ca4b4f3ba129752ea2cb293b P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
W20260709 13:06:10.789438 19524 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:10.773303 23638 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.667s	user 0.001s	sys 0.025s
I20260709 13:06:10.749603 23704 raft_consensus.cc:3060] T 7f575b143b844aa096b50997dad3516a P e61c3a8f61bb48f8a963c9480e53c168 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:06:10.811267 19556 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41504 (request call id 628) took 1255 ms. Trace:
I20260709 13:06:10.727306 23740 raft_consensus.cc:515] T 5ec1c4ce15e04c7e8c283a62179f2a64 P 0473d2b2d01f4459b1e90fd12cc7840e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
W20260709 13:06:10.831219 19524 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:10.836979 19526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.2:46257, user_credentials={real_user=slave}} blocked reactor thread for 91105.1us
W20260709 13:06:10.826898 23638 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.705s	user 0.001s	sys 0.025s
I20260709 13:06:10.783344 23492 raft_consensus.cc:2804] T 6c5eebf646ad445a9d1b1adc319d7b16 P 127766fc592545a4997f7790f50f6076 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:06:10.841378 19449 leader_election.cc:304] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e; no voters: 127766fc592545a4997f7790f50f6076, e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:06:10.842905 19377 leader_election.cc:304] T edd7d470b5014c9489be7f41f64355c9 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87; no voters: e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:06:10.847235 19551 raft_consensus.cc:1275] T 4509b76741dc428e9201c70c1658da13 P e61c3a8f61bb48f8a963c9480e53c168 [term 6 FOLLOWER]: Refusing update from remote peer 0473d2b2d01f4459b1e90fd12cc7840e: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:06:10.769325 23534 consensus_queue.cc:1048] T fa731b585f684a7fb2d106c50f143b83 P 127766fc592545a4997f7790f50f6076 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.067s
I20260709 13:06:10.851594 19555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef32ce6fdd0e40d382c79974f30295c6" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:06:10.852334 19555 raft_consensus.cc:2393] T ef32ce6fdd0e40d382c79974f30295c6 P e61c3a8f61bb48f8a963c9480e53c168 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate e5256d91808b47c195bc9b4dbd7f2b87 in current term 14: Already voted for candidate e61c3a8f61bb48f8a963c9480e53c168 in this term.
I20260709 13:06:10.859534 19551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96efeaaf1057492490e9a621f37e1a2d" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:06:10.859930 23730 raft_consensus.cc:3055] T 0e1085d23e8347fbbd5bce7542f4b1f4 P e61c3a8f61bb48f8a963c9480e53c168 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:06:10.860378 23730 raft_consensus.cc:740] T 0e1085d23e8347fbbd5bce7542f4b1f4 P e61c3a8f61bb48f8a963c9480e53c168 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: e61c3a8f61bb48f8a963c9480e53c168, State: Running, Role: LEADER
I20260709 13:06:10.861228 23730 consensus_queue.cc:260] T 0e1085d23e8347fbbd5bce7542f4b1f4 P e61c3a8f61bb48f8a963c9480e53c168 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:10.861557 23851 consensus_queue.cc:1048] T 1efebf73c86e432baa55533136b6e12c P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Connected to new peer: Peer: permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.132s
I20260709 13:06:10.861662 19555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7be9efa6559648dbb5a0f7684c4542d1" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:06:10.863039 19555 raft_consensus.cc:2468] T 7be9efa6559648dbb5a0f7684c4542d1 P e61c3a8f61bb48f8a963c9480e53c168 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 12.
I20260709 13:06:10.863853 23823 leader_election.cc:290] T 6c5eebf646ad445a9d1b1adc319d7b16 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 10 election: Requested vote from peers e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:06:10.863855 19555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e36a9d6e29c4a7c860cf267efbd4c74" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:06:10.865056 19555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85c494af21f9457a85da47b9bc70c1fd" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:06:10.865674 19557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df751f992649444090e27965eb1af85d" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:06:10.866552 19555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46c5bfeecc314717bffe987e6844b6d0" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 17 candidate_status { last_received { term: 16 index: 7 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:06:10.866765 19557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff75a1d4cb1f493db8f71ddc136ba9ab" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:06:10.747323 23778 consensus_queue.cc:1059] T 70797e5783b5454ab0d0eea663e791e3 P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false }, Status: INVALID_TERM, Last received: 11.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.074s
I20260709 13:06:10.867797 19557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1b10566f45d4a7d9029858330e02d5b" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:06:10.873991 19377 leader_election.cc:304] T 1a61655d99124a29b486ba4a5b37faea P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87; no voters: e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:06:10.878149 19408 raft_consensus.cc:1240] T 70797e5783b5454ab0d0eea663e791e3 P e5256d91808b47c195bc9b4dbd7f2b87 [term 12 FOLLOWER]: Rejecting Update request from peer e61c3a8f61bb48f8a963c9480e53c168 for earlier term 11. Current term is 12. Ops: []
I20260709 13:06:10.878360 19377 leader_election.cc:304] T 7f575b143b844aa096b50997dad3516a P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87; no voters: e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:06:10.879559 19377 leader_election.cc:304] T 2e36a9d6e29c4a7c860cf267efbd4c74 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:06:10.814913 23756 raft_consensus.cc:2749] T 46c5bfeecc314717bffe987e6844b6d0 P e61c3a8f61bb48f8a963c9480e53c168 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:06:10.880841 19377 leader_election.cc:304] T 1dc5b3532fe54f74876d02beffa2c230 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87; no voters: e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:06:10.801363 23828 raft_consensus.cc:3060] T 1dc5b3532fe54f74876d02beffa2c230 P e61c3a8f61bb48f8a963c9480e53c168 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:06:10.882889 19408 raft_consensus.cc:1240] T 2e36a9d6e29c4a7c860cf267efbd4c74 P e5256d91808b47c195bc9b4dbd7f2b87 [term 9 FOLLOWER]: Rejecting Update request from peer e61c3a8f61bb48f8a963c9480e53c168 for earlier term 8. Current term is 9. Ops: []
I20260709 13:06:10.774654 23692 raft_consensus.cc:515] T 4509b76741dc428e9201c70c1658da13 P e5256d91808b47c195bc9b4dbd7f2b87 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:10.876933 19407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "179fd671030940b4b4a4e24bcc4aba0a" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
W20260709 13:06:10.848730 23807 consensus_meta.cc:287] T ff9b0eddd810459b82d91c60777c10eb P 127766fc592545a4997f7790f50f6076: Time spent flushing consensus metadata: real 0.893s	user 0.012s	sys 0.000s
I20260709 13:06:10.752542 23761 raft_consensus.cc:515] T 775c229504194560ba9589bc2199b089 P 127766fc592545a4997f7790f50f6076 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
W20260709 13:06:10.867882 23810 log.cc:927] Time spent T bc225c93219c45538b53a1bd3d387e4d P e5256d91808b47c195bc9b4dbd7f2b87: Append to log took a long time: real 0.066s	user 0.000s	sys 0.000s
I20260709 13:06:10.835326 19556 rpcz_store.cc:276] 0709 13:06:09.555388 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:10.075432 (+520044us) service_pool.cc:224] Handling call
0709 13:06:10.075731 (+   299us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:10.076041 (+   310us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:10.076070 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:10.076502 (+   432us) log.cc:844] Serialized 26 byte log entry
0709 13:06:10.279163 (+202661us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:06:10.773878 (+494715us) log.cc:844] Serialized 14 byte log entry
0709 13:06:10.801399 (+ 27521us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:10.801481 (+    82us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:10.801523 (+    42us) raft_consensus.cc:1685] finished
0709 13:06:10.801534 (+    11us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:10.811190 (+  9656us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":74378,"prepare.queue_time_us":121742,"prepare.run_cpu_time_us":34,"prepare.run_wall_time_us":35,"raft.queue_time_us":120078,"raft.run_cpu_time_us":100,"raft.run_wall_time_us":5548,"thread_start_us":605950,"threads_started":2,"wal-append.queue_time_us":320761}
I20260709 13:06:10.890336 19410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef32ce6fdd0e40d382c79974f30295c6" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
W20260709 13:06:10.875025 23822 consensus_meta.cc:287] T 833a2f0775ed407a94b8924ce50adb63 P e61c3a8f61bb48f8a963c9480e53c168: Time spent flushing consensus metadata: real 0.798s	user 0.003s	sys 0.008s
I20260709 13:06:10.907290 19410 raft_consensus.cc:2393] T ef32ce6fdd0e40d382c79974f30295c6 P e5256d91808b47c195bc9b4dbd7f2b87 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate e61c3a8f61bb48f8a963c9480e53c168 in current term 14: Already voted for candidate e5256d91808b47c195bc9b4dbd7f2b87 in this term.
I20260709 13:06:10.907181 23822 raft_consensus.cc:515] T 833a2f0775ed407a94b8924ce50adb63 P e61c3a8f61bb48f8a963c9480e53c168 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:10.788164 23619 raft_consensus.cc:515] T 2b74109013a140ada21feeef92d6f563 P e5256d91808b47c195bc9b4dbd7f2b87 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
W20260709 13:06:10.875303 23838 log.cc:927] Time spent T ed7fdbcb96d14d418db9ca90a792588a P e61c3a8f61bb48f8a963c9480e53c168: Append to log took a long time: real 0.073s	user 0.000s	sys 0.000s
I20260709 13:06:10.848179 23492 raft_consensus.cc:493] T 6c5eebf646ad445a9d1b1adc319d7b16 P 127766fc592545a4997f7790f50f6076 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:10.927522 19523 leader_election.cc:304] T ece3db938bc649d4a40a51522ed5259c P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e61c3a8f61bb48f8a963c9480e53c168; no voters: 127766fc592545a4997f7790f50f6076, e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:06:10.867643 23414 raft_consensus.cc:2749] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P 0473d2b2d01f4459b1e90fd12cc7840e [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:06:10.816001 23817 consensus_queue.cc:1059] T edd7d470b5014c9489be7f41f64355c9 P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 }, Status: INVALID_TERM, Last received: 11.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.071s
I20260709 13:06:10.886416 19407 raft_consensus.cc:2468] T 179fd671030940b4b4a4e24bcc4aba0a P e5256d91808b47c195bc9b4dbd7f2b87 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 12.
I20260709 13:06:10.900876 23777 raft_consensus.cc:2804] T 1dc5b3532fe54f74876d02beffa2c230 P e5256d91808b47c195bc9b4dbd7f2b87 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:06:10.885679 23852 raft_consensus.cc:2804] T 7f575b143b844aa096b50997dad3516a P e5256d91808b47c195bc9b4dbd7f2b87 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:06:10.948202 19523 leader_election.cc:304] T 85c494af21f9457a85da47b9bc70c1fd P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e61c3a8f61bb48f8a963c9480e53c168; no voters: 127766fc592545a4997f7790f50f6076, e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:06:10.948122 19375 leader_election.cc:304] T 179fd671030940b4b4a4e24bcc4aba0a P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
W20260709 13:06:10.909561 19526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.2:46257, user_credentials={real_user=slave}} blocked reactor thread for 71021.6us
I20260709 13:06:10.874068 23730 raft_consensus.cc:3060] T 0e1085d23e8347fbbd5bce7542f4b1f4 P e61c3a8f61bb48f8a963c9480e53c168 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:06:10.884429 23772 raft_consensus.cc:2804] T edd7d470b5014c9489be7f41f64355c9 P e5256d91808b47c195bc9b4dbd7f2b87 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:06:10.885679 23465 raft_consensus.cc:2804] T 1a61655d99124a29b486ba4a5b37faea P e5256d91808b47c195bc9b4dbd7f2b87 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:06:10.953274 19526 leader_election.cc:304] T d1e5873a19244c5ebbcd38e126796ee7 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e61c3a8f61bb48f8a963c9480e53c168; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:06:10.949419 23851 raft_consensus.cc:2749] T ece3db938bc649d4a40a51522ed5259c P e61c3a8f61bb48f8a963c9480e53c168 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:06:10.874698 23755 consensus_queue.cc:237] T 65d8cb8d6ec64f459d5a47cefab10acf P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.7, Last appended by leader: 7, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:10.910851 23836 consensus_queue.cc:1059] T a08760e15aac4630a629431f56024dc8 P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.042s
I20260709 13:06:10.958392 23854 raft_consensus.cc:2749] T 2e36a9d6e29c4a7c860cf267efbd4c74 P e5256d91808b47c195bc9b4dbd7f2b87 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:06:10.926796 23819 raft_consensus.cc:493] T 217b5fae677b4971b3bbd2f357a1f7ff P 0473d2b2d01f4459b1e90fd12cc7840e [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:10.959156 23605 raft_consensus.cc:2804] T 179fd671030940b4b4a4e24bcc4aba0a P e5256d91808b47c195bc9b4dbd7f2b87 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:06:10.959518 19558 raft_consensus.cc:1275] T e381f1d6b8184797ad142de49be225a8 P e61c3a8f61bb48f8a963c9480e53c168 [term 9 FOLLOWER]: Refusing update from remote peer e5256d91808b47c195bc9b4dbd7f2b87: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 13:06:10.930290 23492 raft_consensus.cc:3060] T 6c5eebf646ad445a9d1b1adc319d7b16 P 127766fc592545a4997f7790f50f6076 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:06:10.932293 23740 leader_election.cc:290] T 5ec1c4ce15e04c7e8c283a62179f2a64 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:06:10.997635 19484 raft_consensus.cc:1240] T 46c5bfeecc314717bffe987e6844b6d0 P 0473d2b2d01f4459b1e90fd12cc7840e [term 17 FOLLOWER]: Rejecting Update request from peer e5256d91808b47c195bc9b4dbd7f2b87 for earlier term 16. Current term is 17. Ops: []
I20260709 13:06:10.952912 23777 raft_consensus.cc:697] T 1dc5b3532fe54f74876d02beffa2c230 P e5256d91808b47c195bc9b4dbd7f2b87 [term 12 LEADER]: Becoming Leader. State: Replica: e5256d91808b47c195bc9b4dbd7f2b87, State: Running, Role: LEADER
I20260709 13:06:10.964883 19526 leader_election.cc:304] T ed7fdbcb96d14d418db9ca90a792588a P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e61c3a8f61bb48f8a963c9480e53c168; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, 127766fc592545a4997f7790f50f6076
I20260709 13:06:10.963172 23756 raft_consensus.cc:2749] T 85c494af21f9457a85da47b9bc70c1fd P e61c3a8f61bb48f8a963c9480e53c168 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:06:10.973066 23465 raft_consensus.cc:697] T 1a61655d99124a29b486ba4a5b37faea P e5256d91808b47c195bc9b4dbd7f2b87 [term 8 LEADER]: Becoming Leader. State: Replica: e5256d91808b47c195bc9b4dbd7f2b87, State: Running, Role: LEADER
W20260709 13:06:10.979156 23856 log.cc:927] Time spent T 48824d5acfbc485ebf8c2d944e7202de P e61c3a8f61bb48f8a963c9480e53c168: Append to log took a long time: real 0.062s	user 0.000s	sys 0.000s
W20260709 13:06:10.982406 23753 consensus_meta.cc:287] T 21e14947d70440f19044d8f75c31e1f9 P e5256d91808b47c195bc9b4dbd7f2b87: Time spent flushing consensus metadata: real 0.578s	user 0.008s	sys 0.000s
I20260709 13:06:10.984715 19485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "179fd671030940b4b4a4e24bcc4aba0a" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:06:11.011893 19485 raft_consensus.cc:2468] T 179fd671030940b4b4a4e24bcc4aba0a P 0473d2b2d01f4459b1e90fd12cc7840e [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 12.
I20260709 13:06:11.013403 19485 raft_consensus.cc:1275] T e381f1d6b8184797ad142de49be225a8 P 0473d2b2d01f4459b1e90fd12cc7840e [term 9 FOLLOWER]: Refusing update from remote peer e5256d91808b47c195bc9b4dbd7f2b87: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 13:06:10.986055 19483 raft_consensus.cc:1275] T 14efcc79969f41babe5529c22d59156d P 0473d2b2d01f4459b1e90fd12cc7840e [term 12 FOLLOWER]: Refusing update from remote peer e5256d91808b47c195bc9b4dbd7f2b87: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:06:10.994990 19486 raft_consensus.cc:1275] T 76cb037fc9064d13b59a8969d897ce8c P 0473d2b2d01f4459b1e90fd12cc7840e [term 11 FOLLOWER]: Refusing update from remote peer e5256d91808b47c195bc9b4dbd7f2b87: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 13:06:10.913133 23725 raft_consensus.cc:515] T 7be9efa6559648dbb5a0f7684c4542d1 P 0473d2b2d01f4459b1e90fd12cc7840e [term 13 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } attrs { replace: true } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:11.016736 19486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c5eebf646ad445a9d1b1adc319d7b16" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:06:10.951013 23795 raft_consensus.cc:493] T 9962423cb4e54fcfa5de01daf68a86e7 P 0473d2b2d01f4459b1e90fd12cc7840e [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 127766fc592545a4997f7790f50f6076)
I20260709 13:06:10.974332 23852 raft_consensus.cc:697] T 7f575b143b844aa096b50997dad3516a P e5256d91808b47c195bc9b4dbd7f2b87 [term 8 LEADER]: Becoming Leader. State: Replica: e5256d91808b47c195bc9b4dbd7f2b87, State: Running, Role: LEADER
W20260709 13:06:10.973182 23538 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.832s	user 0.045s	sys 0.057s
I20260709 13:06:11.004333 19478 raft_consensus.cc:1275] T d1e5873a19244c5ebbcd38e126796ee7 P 0473d2b2d01f4459b1e90fd12cc7840e [term 13 FOLLOWER]: Refusing update from remote peer e5256d91808b47c195bc9b4dbd7f2b87: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 13 index: 7. (index mismatch)
I20260709 13:06:10.964039 23772 raft_consensus.cc:697] T edd7d470b5014c9489be7f41f64355c9 P e5256d91808b47c195bc9b4dbd7f2b87 [term 12 LEADER]: Becoming Leader. State: Replica: e5256d91808b47c195bc9b4dbd7f2b87, State: Running, Role: LEADER
I20260709 13:06:11.003223 19480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df751f992649444090e27965eb1af85d" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:06:10.964336 23778 consensus_queue.cc:1059] T 1a61655d99124a29b486ba4a5b37faea P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.044s
W20260709 13:06:11.009719 19449 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.1:40321, user_credentials={real_user=slave}} blocked reactor thread for 103432us
I20260709 13:06:11.009893 19484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef32ce6fdd0e40d382c79974f30295c6" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:06:11.010167 19481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cdf56e38bbc453d9438d359e5a69955" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:06:11.024498 19481 raft_consensus.cc:2393] T 0cdf56e38bbc453d9438d359e5a69955 P 0473d2b2d01f4459b1e90fd12cc7840e [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e5256d91808b47c195bc9b4dbd7f2b87 in current term 13: Already voted for candidate 0473d2b2d01f4459b1e90fd12cc7840e in this term.
I20260709 13:06:11.024838 19486 raft_consensus.cc:2393] T 6c5eebf646ad445a9d1b1adc319d7b16 P 0473d2b2d01f4459b1e90fd12cc7840e [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 127766fc592545a4997f7790f50f6076 in current term 10: Already voted for candidate 0473d2b2d01f4459b1e90fd12cc7840e in this term.
I20260709 13:06:10.971515 23505 consensus_queue.cc:1059] T 3e1f505cb0f1427bbd698ac889d80821 P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.040s
I20260709 13:06:10.988565 23605 raft_consensus.cc:493] T 179fd671030940b4b4a4e24bcc4aba0a P e5256d91808b47c195bc9b4dbd7f2b87 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:11.000715 23378 leader_election.cc:290] T b9f0d59553ad444883fcf5b5909f9798 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:06:11.010882 19477 raft_consensus.cc:1275] T a08760e15aac4630a629431f56024dc8 P 0473d2b2d01f4459b1e90fd12cc7840e [term 14 FOLLOWER]: Refusing update from remote peer e5256d91808b47c195bc9b4dbd7f2b87: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 13:06:11.001631 23214 leader_election.cc:290] T 0afb57ae58a24a01850491d69f0213dd P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 11 election: Requested vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:06:10.999509 23863 raft_consensus.cc:2749] T d1e5873a19244c5ebbcd38e126796ee7 P e61c3a8f61bb48f8a963c9480e53c168 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:06:11.026491 19407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ec1c4ce15e04c7e8c283a62179f2a64" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
W20260709 13:06:11.027803 19526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.2:46257, user_credentials={real_user=slave}} blocked reactor thread for 62976.7us
W20260709 13:06:11.020725 23538 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.884s	user 0.045s	sys 0.057s
I20260709 13:06:11.028874 19485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48824d5acfbc485ebf8c2d944e7202de" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:06:11.019400 23753 raft_consensus.cc:515] T 21e14947d70440f19044d8f75c31e1f9 P e5256d91808b47c195bc9b4dbd7f2b87 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:11.032153 19486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1efebf73c86e432baa55533136b6e12c" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 12 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:06:11.037398 19407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9f0d59553ad444883fcf5b5909f9798" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:06:10.995808 23819 raft_consensus.cc:515] T 217b5fae677b4971b3bbd2f357a1f7ff P 0473d2b2d01f4459b1e90fd12cc7840e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:11.035933 19485 raft_consensus.cc:3060] T 48824d5acfbc485ebf8c2d944e7202de P 0473d2b2d01f4459b1e90fd12cc7840e [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:06:11.038049 19407 raft_consensus.cc:2468] T b9f0d59553ad444883fcf5b5909f9798 P e5256d91808b47c195bc9b4dbd7f2b87 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 12.
I20260709 13:06:11.038170 19486 raft_consensus.cc:2410] T 1efebf73c86e432baa55533136b6e12c P 0473d2b2d01f4459b1e90fd12cc7840e [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 127766fc592545a4997f7790f50f6076 for term 12 because replica has last-logged OpId of term: 9 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 8.
I20260709 13:06:11.041153 19449 leader_election.cc:304] T b9f0d59553ad444883fcf5b5909f9798 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87; no voters: 
I20260709 13:06:11.041936 23740 raft_consensus.cc:2804] T b9f0d59553ad444883fcf5b5909f9798 P 0473d2b2d01f4459b1e90fd12cc7840e [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:06:11.042341 23740 raft_consensus.cc:493] T b9f0d59553ad444883fcf5b5909f9798 P 0473d2b2d01f4459b1e90fd12cc7840e [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:11.042743 23740 raft_consensus.cc:3060] T b9f0d59553ad444883fcf5b5909f9798 P 0473d2b2d01f4459b1e90fd12cc7840e [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:06:11.043533 23756 raft_consensus.cc:3055] T 3e1f505cb0f1427bbd698ac889d80821 P e61c3a8f61bb48f8a963c9480e53c168 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:06:11.043929 23756 raft_consensus.cc:740] T 3e1f505cb0f1427bbd698ac889d80821 P e61c3a8f61bb48f8a963c9480e53c168 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: e61c3a8f61bb48f8a963c9480e53c168, State: Running, Role: LEADER
I20260709 13:06:11.044055 23852 consensus_queue.cc:237] T 7f575b143b844aa096b50997dad3516a P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 6, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:11.044690 23753 leader_election.cc:290] T 21e14947d70440f19044d8f75c31e1f9 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 12 election: Requested vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:06:11.044817 23769 raft_consensus.cc:2749] T ed7fdbcb96d14d418db9ca90a792588a P e61c3a8f61bb48f8a963c9480e53c168 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:06:11.038779 23378 raft_consensus.cc:493] T 775c229504194560ba9589bc2199b089 P 0473d2b2d01f4459b1e90fd12cc7840e [term 9 FOLLOWER]: Starting pre-election (detected failure of leader e5256d91808b47c195bc9b4dbd7f2b87)
I20260709 13:06:11.045559 23715 raft_consensus.cc:3055] T 1a61655d99124a29b486ba4a5b37faea P e61c3a8f61bb48f8a963c9480e53c168 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:06:11.045754 23870 raft_consensus.cc:493] T 1f85fc4b527a48848e5faa083b604e36 P 0473d2b2d01f4459b1e90fd12cc7840e [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 127766fc592545a4997f7790f50f6076)
I20260709 13:06:11.045826 23378 raft_consensus.cc:515] T 775c229504194560ba9589bc2199b089 P 0473d2b2d01f4459b1e90fd12cc7840e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:11.046231 23867 consensus_queue.cc:1059] T f1b10566f45d4a7d9029858330e02d5b P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 }, Status: INVALID_TERM, Last received: 12.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:06:11.046455 23870 raft_consensus.cc:515] T 1f85fc4b527a48848e5faa083b604e36 P 0473d2b2d01f4459b1e90fd12cc7840e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:11.047124 23822 leader_election.cc:290] T 833a2f0775ed407a94b8924ce50adb63 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 10 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:06:11.047685 23822 raft_consensus.cc:3055] T f1b10566f45d4a7d9029858330e02d5b P e61c3a8f61bb48f8a963c9480e53c168 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:06:11.048024 23822 raft_consensus.cc:740] T f1b10566f45d4a7d9029858330e02d5b P e61c3a8f61bb48f8a963c9480e53c168 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: e61c3a8f61bb48f8a963c9480e53c168, State: Running, Role: LEADER
I20260709 13:06:11.048069 23378 leader_election.cc:290] T 775c229504194560ba9589bc2199b089 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:06:11.015239 23486 consensus_queue.cc:1059] T a08760e15aac4630a629431f56024dc8 P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.021s
I20260709 13:06:11.050064 19406 raft_consensus.cc:1240] T 21e14947d70440f19044d8f75c31e1f9 P e5256d91808b47c195bc9b4dbd7f2b87 [term 12 FOLLOWER]: Rejecting Update request from peer e61c3a8f61bb48f8a963c9480e53c168 for earlier term 11. Current term is 12. Ops: []
I20260709 13:06:11.030692 23605 raft_consensus.cc:3060] T 179fd671030940b4b4a4e24bcc4aba0a P e5256d91808b47c195bc9b4dbd7f2b87 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:06:11.071756 19485 raft_consensus.cc:2468] T 48824d5acfbc485ebf8c2d944e7202de P 0473d2b2d01f4459b1e90fd12cc7840e [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 127766fc592545a4997f7790f50f6076 in term 13.
W20260709 13:06:11.039114 19523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.1:40321, user_credentials={real_user=slave}} blocked reactor thread for 79373us
I20260709 13:06:11.073009 19523 leader_election.cc:304] T fa8650e71aa14778b3d73721fc50d9fc P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e61c3a8f61bb48f8a963c9480e53c168; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:06:11.049010 23822 consensus_queue.cc:260] T f1b10566f45d4a7d9029858330e02d5b P e61c3a8f61bb48f8a963c9480e53c168 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:11.049804 23715 raft_consensus.cc:740] T 1a61655d99124a29b486ba4a5b37faea P e61c3a8f61bb48f8a963c9480e53c168 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: e61c3a8f61bb48f8a963c9480e53c168, State: Running, Role: LEADER
I20260709 13:06:11.033269 23687 raft_consensus.cc:493] T 833a2f0775ed407a94b8924ce50adb63 P e5256d91808b47c195bc9b4dbd7f2b87 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:11.080596 19482 raft_consensus.cc:1275] T 217b5fae677b4971b3bbd2f357a1f7ff P 0473d2b2d01f4459b1e90fd12cc7840e [term 9 FOLLOWER]: Refusing update from remote peer e5256d91808b47c195bc9b4dbd7f2b87: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
W20260709 13:06:11.078686 19377 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.2:46257, user_credentials={real_user=slave}} blocked reactor thread for 43553.5us
I20260709 13:06:11.072213 23547 raft_consensus.cc:515] T 96efeaaf1057492490e9a621f37e1a2d P e61c3a8f61bb48f8a963c9480e53c168 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
W20260709 13:06:11.082321 19375 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.3:36891, user_credentials={real_user=slave}} blocked reactor thread for 134289us
I20260709 13:06:11.027087 23777 consensus_queue.cc:237] T 1dc5b3532fe54f74876d02beffa2c230 P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.5, Last appended by leader: 5, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
W20260709 13:06:11.092525 23869 log.cc:927] Time spent T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P 127766fc592545a4997f7790f50f6076: Append to log took a long time: real 0.069s	user 0.000s	sys 0.000s
I20260709 13:06:11.039799 23854 consensus_queue.cc:1048] T 14efcc79969f41babe5529c22d59156d P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.057s
I20260709 13:06:11.025542 23795 raft_consensus.cc:515] T 9962423cb4e54fcfa5de01daf68a86e7 P 0473d2b2d01f4459b1e90fd12cc7840e [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:11.108544 19407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "775c229504194560ba9589bc2199b089" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:06:11.051119 23670 consensus_queue.cc:1048] T 76cb037fc9064d13b59a8969d897ce8c P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.048s
I20260709 13:06:11.098284 23214 consensus_queue.cc:1059] T 70797e5783b5454ab0d0eea663e791e3 P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 }, Status: INVALID_TERM, Last received: 11.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.041s
I20260709 13:06:11.080422 23486 consensus_queue.cc:1243] T a08760e15aac4630a629431f56024dc8 P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Peer e5256d91808b47c195bc9b4dbd7f2b87 log is divergent from this leader: its last log entry 14.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
I20260709 13:06:11.112550 19551 raft_consensus.cc:2368] T 96efeaaf1057492490e9a621f37e1a2d P e61c3a8f61bb48f8a963c9480e53c168 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 0473d2b2d01f4459b1e90fd12cc7840e for earlier term 12. Current term is 13.
I20260709 13:06:11.080672 23769 raft_consensus.cc:2749] T fa8650e71aa14778b3d73721fc50d9fc P e61c3a8f61bb48f8a963c9480e53c168 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:06:11.080425 23753 consensus_queue.cc:1048] T e381f1d6b8184797ad142de49be225a8 P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.036s
I20260709 13:06:11.140921 23880 consensus_queue.cc:1048] T 76cb037fc9064d13b59a8969d897ce8c P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:06:11.090745 23465 consensus_queue.cc:237] T 1a61655d99124a29b486ba4a5b37faea P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:11.087062 23876 consensus_queue.cc:1048] T d1e5873a19244c5ebbcd38e126796ee7 P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.054s
I20260709 13:06:11.115449 23854 consensus_queue.cc:1048] T 217b5fae677b4971b3bbd2f357a1f7ff P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.020s
I20260709 13:06:11.135890 23547 leader_election.cc:290] T 96efeaaf1057492490e9a621f37e1a2d P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 13 election: Requested vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:06:11.137811 23725 leader_election.cc:290] T 7be9efa6559648dbb5a0f7684c4542d1 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 13 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:06:11.109544 19557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "309c3ca0ca4b4f3ba129752ea2cb293b" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
W20260709 13:06:11.142709 19526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.2:46257, user_credentials={real_user=slave}} blocked reactor thread for 109572us
I20260709 13:06:11.044728 23756 consensus_queue.cc:260] T 3e1f505cb0f1427bbd698ac889d80821 P e61c3a8f61bb48f8a963c9480e53c168 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:11.115321 23692 leader_election.cc:290] T 4509b76741dc428e9201c70c1658da13 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:06:11.151171 23818 raft_consensus.cc:493] T 1f85fc4b527a48848e5faa083b604e36 P 127766fc592545a4997f7790f50f6076 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:11.153937 19410 raft_consensus.cc:1240] T 7f575b143b844aa096b50997dad3516a P e5256d91808b47c195bc9b4dbd7f2b87 [term 8 LEADER]: Rejecting Update request from peer e61c3a8f61bb48f8a963c9480e53c168 for earlier term 7. Current term is 8. Ops: []
I20260709 13:06:11.134469 23819 leader_election.cc:290] T 217b5fae677b4971b3bbd2f357a1f7ff P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:06:11.111734 23761 leader_election.cc:290] T 775c229504194560ba9589bc2199b089 P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:06:11.155498 19479 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39478 (request call id 596) took 1613 ms. Trace:
I20260709 13:06:11.159601 19411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f85fc4b527a48848e5faa083b604e36" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:06:11.160255 19411 raft_consensus.cc:2393] T 1f85fc4b527a48848e5faa083b604e36 P e5256d91808b47c195bc9b4dbd7f2b87 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0473d2b2d01f4459b1e90fd12cc7840e in current term 10: Already voted for candidate e5256d91808b47c195bc9b4dbd7f2b87 in this term.
I20260709 13:06:11.133255 23870 leader_election.cc:290] T 1f85fc4b527a48848e5faa083b604e36 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:06:11.156610 19557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cdf56e38bbc453d9438d359e5a69955" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:06:11.156194 23547 consensus_queue.cc:1059] T 3e1f505cb0f1427bbd698ac889d80821 P e61c3a8f61bb48f8a963c9480e53c168 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.012s
I20260709 13:06:11.168910 19557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65d8cb8d6ec64f459d5a47cefab10acf" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:06:11.168963 19556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9f0d59553ad444883fcf5b5909f9798" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:06:11.169696 19556 raft_consensus.cc:2468] T b9f0d59553ad444883fcf5b5909f9798 P e61c3a8f61bb48f8a963c9480e53c168 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 11.
I20260709 13:06:11.170013 19557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c5eebf646ad445a9d1b1adc319d7b16" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:06:11.170547 19557 raft_consensus.cc:3060] T 6c5eebf646ad445a9d1b1adc319d7b16 P e61c3a8f61bb48f8a963c9480e53c168 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:06:11.171100 23756 raft_consensus.cc:3060] T 3e1f505cb0f1427bbd698ac889d80821 P e61c3a8f61bb48f8a963c9480e53c168 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:06:11.172237 20104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f85fc4b527a48848e5faa083b604e36" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:06:11.172608 20108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "775c229504194560ba9589bc2199b089" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:06:11.173226 20108 raft_consensus.cc:2468] T 775c229504194560ba9589bc2199b089 P 127766fc592545a4997f7790f50f6076 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 9.
I20260709 13:06:11.173467 20106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7be9efa6559648dbb5a0f7684c4542d1" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076"
I20260709 13:06:11.173913 19559 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40428 (request call id 2465) took 1321 ms. Trace:
I20260709 13:06:11.174010 20106 raft_consensus.cc:3060] T 7be9efa6559648dbb5a0f7684c4542d1 P 127766fc592545a4997f7790f50f6076 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:06:11.098704 23863 consensus_queue.cc:1059] T 2e36a9d6e29c4a7c860cf267efbd4c74 P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.056s
I20260709 13:06:11.174288 19559 rpcz_store.cc:276] 0709 13:06:09.852970 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:10.076916 (+223946us) service_pool.cc:224] Handling call
0709 13:06:10.077174 (+   258us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:10.750825 (+673651us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:11.173707 (+422882us) spinlock_profiling.cc:243] Waited 673 ms on lock 0x7b5400124654. stack: 00007f4a79de9343 00007f4a79de9240 00007f4a797781d4 00007f4a834b6304 00007f4a834b6299 00007f4a7ce71571 00007f4a7cf08e01 00007f4a7cf0783e 00007f4a81ecc419 00007f4a7b443bd4 00007f4a7b443b62 00007f4a7b443a91 00007f4a7b443a0c 00007f4a7b442cc2 00007f4a7b24348c 00007f4a7b2428c6
0709 13:06:11.173862 (+   155us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1547757952}
I20260709 13:06:11.174831 19449 leader_election.cc:304] T 309c3ca0ca4b4f3ba129752ea2cb293b P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e; no voters: 127766fc592545a4997f7790f50f6076, e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:06:11.175344 23863 raft_consensus.cc:3055] T 2e36a9d6e29c4a7c860cf267efbd4c74 P e61c3a8f61bb48f8a963c9480e53c168 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:06:11.175619 23538 raft_consensus.cc:2749] T 309c3ca0ca4b4f3ba129752ea2cb293b P 0473d2b2d01f4459b1e90fd12cc7840e [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:06:11.175733 23863 raft_consensus.cc:740] T 2e36a9d6e29c4a7c860cf267efbd4c74 P e61c3a8f61bb48f8a963c9480e53c168 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: e61c3a8f61bb48f8a963c9480e53c168, State: Running, Role: LEADER
I20260709 13:06:11.176635 23863 consensus_queue.cc:260] T 2e36a9d6e29c4a7c860cf267efbd4c74 P e61c3a8f61bb48f8a963c9480e53c168 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:11.153959 23874 consensus_queue.cc:1059] T ff75a1d4cb1f493db8f71ddc136ba9ab P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.008s
I20260709 13:06:11.154078 23818 raft_consensus.cc:515] T 1f85fc4b527a48848e5faa083b604e36 P 127766fc592545a4997f7790f50f6076 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:11.179668 19556 raft_consensus.cc:1240] T 2b74109013a140ada21feeef92d6f563 P e61c3a8f61bb48f8a963c9480e53c168 [term 9 FOLLOWER]: Rejecting Update request from peer 0473d2b2d01f4459b1e90fd12cc7840e for earlier term 8. Current term is 9. Ops: [8.6-8.6]
I20260709 13:06:11.159797 19479 rpcz_store.cc:276] 0709 13:06:09.542176 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:09.644294 (+102118us) service_pool.cc:224] Handling call
0709 13:06:09.644607 (+   313us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:10.547793 (+903186us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:11.155246 (+607453us) spinlock_profiling.cc:243] Waited 892 ms on lock 0x7b540029de54. stack: 00007f4a79de9343 00007f4a79de9240 00007f4a797781d4 00007f4a834b6304 00007f4a834b6299 00007f4a7ce71571 00007f4a7cf08e01 00007f4a7cf0783e 00007f4a81ecc419 00007f4a7b443bd4 00007f4a7b443b62 00007f4a7b443a91 00007f4a7b443a0c 00007f4a7b442cc2 00007f4a7b24348c 00007f4a7b2428c6
0709 13:06:11.155439 (+   193us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2052351360}
I20260709 13:06:11.089039 23687 raft_consensus.cc:515] T 833a2f0775ed407a94b8924ce50adb63 P e5256d91808b47c195bc9b4dbd7f2b87 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:11.162917 23740 raft_consensus.cc:515] T b9f0d59553ad444883fcf5b5909f9798 P 0473d2b2d01f4459b1e90fd12cc7840e [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:11.106084 23772 consensus_queue.cc:237] T edd7d470b5014c9489be7f41f64355c9 P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 11.5, Last appended by leader: 5, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:11.114625 23873 consensus_queue.cc:1059] T 46c5bfeecc314717bffe987e6844b6d0 P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 }, Status: INVALID_TERM, Last received: 16.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.131s
I20260709 13:06:11.167760 23828 raft_consensus.cc:2749] T 1dc5b3532fe54f74876d02beffa2c230 P e61c3a8f61bb48f8a963c9480e53c168 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:06:11.081983 23715 consensus_queue.cc:260] T 1a61655d99124a29b486ba4a5b37faea P e61c3a8f61bb48f8a963c9480e53c168 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:11.150348 23730 raft_consensus.cc:493] T 28af091831594f9d8e96482078cc7625 P e61c3a8f61bb48f8a963c9480e53c168 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:11.180369 19557 raft_consensus.cc:2468] T 6c5eebf646ad445a9d1b1adc319d7b16 P e61c3a8f61bb48f8a963c9480e53c168 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 10.
I20260709 13:06:11.172299 20105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ec1c4ce15e04c7e8c283a62179f2a64" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
W20260709 13:06:11.182862 19375 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.3:36891, user_credentials={real_user=slave}} blocked reactor thread for 83505.7us
I20260709 13:06:11.183149 19411 raft_consensus.cc:1240] T df751f992649444090e27965eb1af85d P e5256d91808b47c195bc9b4dbd7f2b87 [term 14 FOLLOWER]: Rejecting Update request from peer 0473d2b2d01f4459b1e90fd12cc7840e for earlier term 13. Current term is 14. Ops: []
I20260709 13:06:11.183671 23870 raft_consensus.cc:493] T ed7fdbcb96d14d418db9ca90a792588a P 0473d2b2d01f4459b1e90fd12cc7840e [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 127766fc592545a4997f7790f50f6076)
I20260709 13:06:11.186319 20106 raft_consensus.cc:2468] T 7be9efa6559648dbb5a0f7684c4542d1 P 127766fc592545a4997f7790f50f6076 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 13.
I20260709 13:06:11.187078 20112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c5eebf646ad445a9d1b1adc319d7b16" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076"
I20260709 13:06:11.194183 19449 leader_election.cc:304] T 775c229504194560ba9589bc2199b089 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, 127766fc592545a4997f7790f50f6076; no voters: e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:06:11.196484 20104 raft_consensus.cc:2468] T 1f85fc4b527a48848e5faa083b604e36 P 127766fc592545a4997f7790f50f6076 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 10.
I20260709 13:06:11.197361 23663 raft_consensus.cc:493] T 2725d2c4cb054f18b0fc8f735c15f6c2 P 0473d2b2d01f4459b1e90fd12cc7840e [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:11.197885 23663 raft_consensus.cc:515] T 2725d2c4cb054f18b0fc8f735c15f6c2 P 0473d2b2d01f4459b1e90fd12cc7840e [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:11.152621 23214 consensus_queue.cc:1048] T 21e14947d70440f19044d8f75c31e1f9 P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 4, Time since last communication: 0.035s
I20260709 13:06:11.201567 19449 leader_election.cc:304] T 5ec1c4ce15e04c7e8c283a62179f2a64 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e; no voters: 127766fc592545a4997f7790f50f6076, e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:06:11.183944 23547 raft_consensus.cc:3055] T ff75a1d4cb1f493db8f71ddc136ba9ab P e61c3a8f61bb48f8a963c9480e53c168 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:06:11.199983 19407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "217b5fae677b4971b3bbd2f357a1f7ff" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 10 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:06:11.200774 19408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7be9efa6559648dbb5a0f7684c4542d1" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
I20260709 13:06:11.209856 19375 leader_election.cc:304] T ef32ce6fdd0e40d382c79974f30295c6 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:06:11.210422 19408 raft_consensus.cc:3060] T 7be9efa6559648dbb5a0f7684c4542d1 P e5256d91808b47c195bc9b4dbd7f2b87 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:06:11.211910 23876 raft_consensus.cc:2749] T ef32ce6fdd0e40d382c79974f30295c6 P e5256d91808b47c195bc9b4dbd7f2b87 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:06:11.212419 19375 leader_election.cc:304] T df751f992649444090e27965eb1af85d P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:06:11.213639 19375 leader_election.cc:304] T 0cdf56e38bbc453d9438d359e5a69955 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:06:11.181075 23778 consensus_queue.cc:1059] T 2e36a9d6e29c4a7c860cf267efbd4c74 P e61c3a8f61bb48f8a963c9480e53c168 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.027s
I20260709 13:06:11.194110 23725 raft_consensus.cc:493] T ff9b0eddd810459b82d91c60777c10eb P 0473d2b2d01f4459b1e90fd12cc7840e [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 127766fc592545a4997f7790f50f6076)
I20260709 13:06:11.214841 23692 raft_consensus.cc:2749] T df751f992649444090e27965eb1af85d P e5256d91808b47c195bc9b4dbd7f2b87 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:06:11.214871 23829 raft_consensus.cc:2804] T 775c229504194560ba9589bc2199b089 P 0473d2b2d01f4459b1e90fd12cc7840e [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:06:11.215461 23872 raft_consensus.cc:2749] T 5ec1c4ce15e04c7e8c283a62179f2a64 P 0473d2b2d01f4459b1e90fd12cc7840e [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:06:11.215389 19523 leader_election.cc:304] T 179fd671030940b4b4a4e24bcc4aba0a P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:06:11.182399 23704 consensus_queue.cc:1059] T 0cdf56e38bbc453d9438d359e5a69955 P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 }, Status: INVALID_TERM, Last received: 12.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.025s
I20260709 13:06:11.218900 19556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21e14947d70440f19044d8f75c31e1f9" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:06:11.220238 19557 raft_consensus.cc:1275] T d1e5873a19244c5ebbcd38e126796ee7 P e61c3a8f61bb48f8a963c9480e53c168 [term 13 FOLLOWER]: Refusing update from remote peer e5256d91808b47c195bc9b4dbd7f2b87: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 13 index: 7. (index mismatch)
I20260709 13:06:11.215754 23873 raft_consensus.cc:3060] T 0cdf56e38bbc453d9438d359e5a69955 P e5256d91808b47c195bc9b4dbd7f2b87 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:06:11.230311 20106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9962423cb4e54fcfa5de01daf68a86e7" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:06:11.215723 23829 raft_consensus.cc:493] T 775c229504194560ba9589bc2199b089 P 0473d2b2d01f4459b1e90fd12cc7840e [term 9 FOLLOWER]: Starting leader election (detected failure of leader e5256d91808b47c195bc9b4dbd7f2b87)
I20260709 13:06:11.207851 23547 raft_consensus.cc:740] T ff75a1d4cb1f493db8f71ddc136ba9ab P e61c3a8f61bb48f8a963c9480e53c168 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: e61c3a8f61bb48f8a963c9480e53c168, State: Running, Role: LEADER
I20260709 13:06:11.230823 19559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4509b76741dc428e9201c70c1658da13" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:06:11.210011 23714 raft_consensus.cc:493] T 21e14947d70440f19044d8f75c31e1f9 P 0473d2b2d01f4459b1e90fd12cc7840e [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:11.215056 23795 leader_election.cc:290] T 9962423cb4e54fcfa5de01daf68a86e7 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:06:11.202947 23730 raft_consensus.cc:515] T 28af091831594f9d8e96482078cc7625 P e61c3a8f61bb48f8a963c9480e53c168 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:11.233760 19559 raft_consensus.cc:2468] T 4509b76741dc428e9201c70c1658da13 P e61c3a8f61bb48f8a963c9480e53c168 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 6.
I20260709 13:06:11.238078 23687 leader_election.cc:290] T 833a2f0775ed407a94b8924ce50adb63 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:06:11.239033 23714 raft_consensus.cc:515] T 21e14947d70440f19044d8f75c31e1f9 P 0473d2b2d01f4459b1e90fd12cc7840e [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:11.240386 19407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2725d2c4cb054f18b0fc8f735c15f6c2" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 15 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:06:11.226486 23663 leader_election.cc:290] T 2725d2c4cb054f18b0fc8f735c15f6c2 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:06:11.232864 23819 raft_consensus.cc:493] T 172b3dd13109415a955b71ac0e9d2234 P 0473d2b2d01f4459b1e90fd12cc7840e [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 127766fc592545a4997f7790f50f6076)
I20260709 13:06:11.219496 23725 raft_consensus.cc:515] T ff9b0eddd810459b82d91c60777c10eb P 0473d2b2d01f4459b1e90fd12cc7840e [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:11.245998 23795 consensus_queue.cc:1059] T df751f992649444090e27965eb1af85d P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 }, Status: INVALID_TERM, Last received: 13.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.007s
I20260709 13:06:11.216228 23492 raft_consensus.cc:515] T 6c5eebf646ad445a9d1b1adc319d7b16 P 127766fc592545a4997f7790f50f6076 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:11.216045 23870 raft_consensus.cc:515] T ed7fdbcb96d14d418db9ca90a792588a P 0473d2b2d01f4459b1e90fd12cc7840e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:11.249230 19407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9962423cb4e54fcfa5de01daf68a86e7" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:06:11.233956 23829 raft_consensus.cc:3060] T 775c229504194560ba9589bc2199b089 P 0473d2b2d01f4459b1e90fd12cc7840e [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:06:11.246022 19552 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40438 (request call id 2352) took 2038 ms (client timeout 1922 ms). Trace:
I20260709 13:06:11.250048 19408 raft_consensus.cc:2468] T 7be9efa6559648dbb5a0f7684c4542d1 P e5256d91808b47c195bc9b4dbd7f2b87 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 13.
W20260709 13:06:11.274389 19552 rpcz_store.cc:269] 0709 13:06:09.204453 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:09.493270 (+288817us) service_pool.cc:224] Handling call
0709 13:06:11.241206 (+1747936us) spinlock_profiling.cc:243] Waited 860 ms on lock 0x7b5400124b54. stack: 00007f4a79de9343 00007f4a79de9240 00007f4a797781d4 00007f4a834b6304 00007f4a834b6299 00007f4a7ce71571 00007f4a7cf0c2fa 00007f4a81ecdb17 00007f4a7b4486d4 00007f4a7b448662 00007f4a7b448591 00007f4a7b44850c 00007f4a7b4477c2 00007f4a7b24348c 00007f4a7b2428c6 00007f4a7b24226f
0709 13:06:11.243001 (+  1795us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1978115456}
I20260709 13:06:11.238088 23867 raft_consensus.cc:2804] T 179fd671030940b4b4a4e24bcc4aba0a P e61c3a8f61bb48f8a963c9480e53c168 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:06:11.278111 20112 raft_consensus.cc:2393] T 6c5eebf646ad445a9d1b1adc319d7b16 P 127766fc592545a4997f7790f50f6076 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 0473d2b2d01f4459b1e90fd12cc7840e in current term 10: Already voted for candidate 127766fc592545a4997f7790f50f6076 in this term.
I20260709 13:06:11.253271 23795 raft_consensus.cc:3055] T df751f992649444090e27965eb1af85d P 0473d2b2d01f4459b1e90fd12cc7840e [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:06:11.253257 23725 leader_election.cc:290] T ff9b0eddd810459b82d91c60777c10eb P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:06:11.252229 23730 leader_election.cc:290] T 28af091831594f9d8e96482078cc7625 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:06:11.274168 23818 leader_election.cc:290] T 1f85fc4b527a48848e5faa083b604e36 P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321)
I20260709 13:06:11.248270 23819 raft_consensus.cc:515] T 172b3dd13109415a955b71ac0e9d2234 P 0473d2b2d01f4459b1e90fd12cc7840e [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:11.278041 23867 raft_consensus.cc:493] T 179fd671030940b4b4a4e24bcc4aba0a P e61c3a8f61bb48f8a963c9480e53c168 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:06:11.284736 19375 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.3:36891, user_credentials={real_user=slave}} blocked reactor thread for 66865.2us
I20260709 13:06:11.275460 23605 raft_consensus.cc:515] T 179fd671030940b4b4a4e24bcc4aba0a P e5256d91808b47c195bc9b4dbd7f2b87 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:11.286289 23740 leader_election.cc:290] T b9f0d59553ad444883fcf5b5909f9798 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 13 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:06:11.288522 19552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "833a2f0775ed407a94b8924ce50adb63" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:06:11.289197 19552 raft_consensus.cc:2468] T 833a2f0775ed407a94b8924ce50adb63 P e61c3a8f61bb48f8a963c9480e53c168 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 10.
W20260709 13:06:11.295506 19526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.2:46257, user_credentials={real_user=slave}} blocked reactor thread for 137840us
I20260709 13:06:11.296870 19526 leader_election.cc:304] T ef32ce6fdd0e40d382c79974f30295c6 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e61c3a8f61bb48f8a963c9480e53c168; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87
W20260709 13:06:11.301004 19523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.1:40321, user_credentials={real_user=slave}} blocked reactor thread for 85698.6us
I20260709 13:06:11.301081 23892 consensus_queue.cc:1048] T 1efebf73c86e432baa55533136b6e12c P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.001s
W20260709 13:06:11.302847 19449 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.1:40321, user_credentials={real_user=slave}} blocked reactor thread for 61779.2us
W20260709 13:06:11.304119 19526 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:11.304522 19526 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:11.305325 19552 raft_consensus.cc:3055] T 2725d2c4cb054f18b0fc8f735c15f6c2 P e61c3a8f61bb48f8a963c9480e53c168 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:06:11.305222 20106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff9b0eddd810459b82d91c60777c10eb" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:06:11.305738 19552 raft_consensus.cc:740] T 2725d2c4cb054f18b0fc8f735c15f6c2 P e61c3a8f61bb48f8a963c9480e53c168 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: e61c3a8f61bb48f8a963c9480e53c168, State: Running, Role: LEADER
I20260709 13:06:11.306003 20106 raft_consensus.cc:2468] T ff9b0eddd810459b82d91c60777c10eb P 127766fc592545a4997f7790f50f6076 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 12.
I20260709 13:06:11.306488 19552 consensus_queue.cc:260] T 2725d2c4cb054f18b0fc8f735c15f6c2 P e61c3a8f61bb48f8a963c9480e53c168 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 13.6, Last appended by leader: 6, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:11.307359 19552 raft_consensus.cc:3060] T 2725d2c4cb054f18b0fc8f735c15f6c2 P e61c3a8f61bb48f8a963c9480e53c168 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:06:11.307466 19526 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:11.307585 19411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff9b0eddd810459b82d91c60777c10eb" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:06:11.308477 19411 raft_consensus.cc:2393] T ff9b0eddd810459b82d91c60777c10eb P e5256d91808b47c195bc9b4dbd7f2b87 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0473d2b2d01f4459b1e90fd12cc7840e in current term 12: Already voted for candidate e5256d91808b47c195bc9b4dbd7f2b87 in this term.
I20260709 13:06:11.281986 23795 raft_consensus.cc:740] T df751f992649444090e27965eb1af85d P 0473d2b2d01f4459b1e90fd12cc7840e [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 0473d2b2d01f4459b1e90fd12cc7840e, State: Running, Role: LEADER
I20260709 13:06:11.311884 19482 raft_consensus.cc:1240] T 2725d2c4cb054f18b0fc8f735c15f6c2 P 0473d2b2d01f4459b1e90fd12cc7840e [term 14 FOLLOWER]: Rejecting Update request from peer e61c3a8f61bb48f8a963c9480e53c168 for earlier term 13. Current term is 14. Ops: []
I20260709 13:06:11.312170 19557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48824d5acfbc485ebf8c2d944e7202de" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:06:11.312470 19407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9f0d59553ad444883fcf5b5909f9798" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
I20260709 13:06:11.317977 19407 raft_consensus.cc:3060] T b9f0d59553ad444883fcf5b5909f9798 P e5256d91808b47c195bc9b4dbd7f2b87 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:06:11.312951 19479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0afb57ae58a24a01850491d69f0213dd" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:06:11.313558 19485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96efeaaf1057492490e9a621f37e1a2d" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:06:11.314467 19477 raft_consensus.cc:1240] T 40e1e16737a842ee936002830f36882e P 0473d2b2d01f4459b1e90fd12cc7840e [term 15 FOLLOWER]: Rejecting Update request from peer e61c3a8f61bb48f8a963c9480e53c168 for earlier term 14. Current term is 15. Ops: []
I20260709 13:06:11.315407 19449 leader_election.cc:304] T ff9b0eddd810459b82d91c60777c10eb P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, 127766fc592545a4997f7790f50f6076; no voters: 
I20260709 13:06:11.316963 19486 raft_consensus.cc:1240] T 48824d5acfbc485ebf8c2d944e7202de P 0473d2b2d01f4459b1e90fd12cc7840e [term 13 FOLLOWER]: Rejecting Update request from peer e61c3a8f61bb48f8a963c9480e53c168 for earlier term 12. Current term is 13. Ops: []
I20260709 13:06:11.319198 19485 raft_consensus.cc:3060] T 96efeaaf1057492490e9a621f37e1a2d P 0473d2b2d01f4459b1e90fd12cc7840e [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:06:11.288755 23867 raft_consensus.cc:3060] T 179fd671030940b4b4a4e24bcc4aba0a P e61c3a8f61bb48f8a963c9480e53c168 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:06:11.323117 19449 leader_election.cc:304] T 7be9efa6559648dbb5a0f7684c4542d1 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, 127766fc592545a4997f7790f50f6076, e5256d91808b47c195bc9b4dbd7f2b87; no voters: 
I20260709 13:06:11.329212 23717 raft_consensus.cc:2804] T ff9b0eddd810459b82d91c60777c10eb P 0473d2b2d01f4459b1e90fd12cc7840e [term 11 FOLLOWER]: Leader pre-election won for term 12
W20260709 13:06:11.329599 23844 log.cc:927] Time spent T 0cdf56e38bbc453d9438d359e5a69955 P e61c3a8f61bb48f8a963c9480e53c168: Append to log took a long time: real 0.912s	user 0.003s	sys 0.000s
I20260709 13:06:11.330214 19449 leader_election.cc:304] T 9962423cb4e54fcfa5de01daf68a86e7 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e; no voters: 127766fc592545a4997f7790f50f6076, e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:06:11.330432 23819 leader_election.cc:290] T 172b3dd13109415a955b71ac0e9d2234 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
W20260709 13:06:11.329775 23864 log.cc:927] Time spent T 0e1085d23e8347fbbd5bce7542f4b1f4 P 0473d2b2d01f4459b1e90fd12cc7840e: Append to log took a long time: real 0.317s	user 0.003s	sys 0.000s
I20260709 13:06:11.331791 23870 leader_election.cc:290] T ed7fdbcb96d14d418db9ca90a792588a P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:06:11.332055 23821 raft_consensus.cc:3055] T edd7d470b5014c9489be7f41f64355c9 P e61c3a8f61bb48f8a963c9480e53c168 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:06:11.332346 23870 raft_consensus.cc:2804] T 7be9efa6559648dbb5a0f7684c4542d1 P 0473d2b2d01f4459b1e90fd12cc7840e [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:06:11.332494 23821 raft_consensus.cc:740] T edd7d470b5014c9489be7f41f64355c9 P e61c3a8f61bb48f8a963c9480e53c168 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: e61c3a8f61bb48f8a963c9480e53c168, State: Running, Role: LEADER
I20260709 13:06:11.332902 23870 raft_consensus.cc:697] T 7be9efa6559648dbb5a0f7684c4542d1 P 0473d2b2d01f4459b1e90fd12cc7840e [term 13 LEADER]: Becoming Leader. State: Replica: 0473d2b2d01f4459b1e90fd12cc7840e, State: Running, Role: LEADER
I20260709 13:06:11.333360 23821 consensus_queue.cc:260] T edd7d470b5014c9489be7f41f64355c9 P e61c3a8f61bb48f8a963c9480e53c168 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 11.5, Last appended by leader: 5, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:11.334249 23730 consensus_queue.cc:1059] T 40e1e16737a842ee936002830f36882e P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 }, Status: INVALID_TERM, Last received: 14.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:06:11.334877 23725 raft_consensus.cc:2749] T 9962423cb4e54fcfa5de01daf68a86e7 P 0473d2b2d01f4459b1e90fd12cc7840e [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:06:11.329222 19484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28af091831594f9d8e96482078cc7625" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 13 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:06:11.336699 20106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "172b3dd13109415a955b71ac0e9d2234" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:06:11.339387 20106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed7fdbcb96d14d418db9ca90a792588a" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:06:11.339826 19411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "172b3dd13109415a955b71ac0e9d2234" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:06:11.344180 19449 leader_election.cc:304] T 172b3dd13109415a955b71ac0e9d2234 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e; no voters: 127766fc592545a4997f7790f50f6076, e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:06:11.316602 23486 raft_consensus.cc:2749] T ef32ce6fdd0e40d382c79974f30295c6 P e61c3a8f61bb48f8a963c9480e53c168 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:06:11.344970 23740 raft_consensus.cc:2749] T 172b3dd13109415a955b71ac0e9d2234 P 0473d2b2d01f4459b1e90fd12cc7840e [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:06:11.354785 19557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1efebf73c86e432baa55533136b6e12c" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 12 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:06:11.316486 23762 leader_election.cc:290] T 48824d5acfbc485ebf8c2d944e7202de P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 13 election: Requested vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:06:11.333768 23870 consensus_queue.cc:237] T 7be9efa6559648dbb5a0f7684c4542d1 P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 13, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } attrs { replace: true } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:11.360123 23859 raft_consensus.cc:3055] T 40e1e16737a842ee936002830f36882e P e61c3a8f61bb48f8a963c9480e53c168 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:06:11.360582 23859 raft_consensus.cc:740] T 40e1e16737a842ee936002830f36882e P e61c3a8f61bb48f8a963c9480e53c168 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: e61c3a8f61bb48f8a963c9480e53c168, State: Running, Role: LEADER
I20260709 13:06:11.361446 23859 consensus_queue.cc:260] T 40e1e16737a842ee936002830f36882e P e61c3a8f61bb48f8a963c9480e53c168 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 14.7, Last appended by leader: 7, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:11.365448 23859 raft_consensus.cc:3060] T 40e1e16737a842ee936002830f36882e P e61c3a8f61bb48f8a963c9480e53c168 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:06:11.329677 23717 raft_consensus.cc:493] T ff9b0eddd810459b82d91c60777c10eb P 0473d2b2d01f4459b1e90fd12cc7840e [term 11 FOLLOWER]: Starting leader election (detected failure of leader 127766fc592545a4997f7790f50f6076)
I20260709 13:06:11.366024 19485 raft_consensus.cc:2468] T 96efeaaf1057492490e9a621f37e1a2d P 0473d2b2d01f4459b1e90fd12cc7840e [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 13.
W20260709 13:06:11.386031 19525 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:11.345279 23214 consensus_queue.cc:1059] T 48824d5acfbc485ebf8c2d944e7202de P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.020s
I20260709 13:06:11.391026 20106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85c494af21f9457a85da47b9bc70c1fd" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076"
I20260709 13:06:11.391906 20105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65d8cb8d6ec64f459d5a47cefab10acf" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076"
I20260709 13:06:11.392642 20105 raft_consensus.cc:3060] T 65d8cb8d6ec64f459d5a47cefab10acf P 127766fc592545a4997f7790f50f6076 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:06:11.388724 20075 leader_election.cc:304] T 70797e5783b5454ab0d0eea663e791e3 P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 127766fc592545a4997f7790f50f6076, e5256d91808b47c195bc9b4dbd7f2b87; no voters: e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:06:11.395356 20106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "833a2f0775ed407a94b8924ce50adb63" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:06:11.395955 20106 raft_consensus.cc:2468] T 833a2f0775ed407a94b8924ce50adb63 P 127766fc592545a4997f7790f50f6076 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 10.
I20260709 13:06:11.400846 19407 raft_consensus.cc:2468] T b9f0d59553ad444883fcf5b5909f9798 P e5256d91808b47c195bc9b4dbd7f2b87 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 13.
I20260709 13:06:11.402065 19449 leader_election.cc:304] T b9f0d59553ad444883fcf5b5909f9798 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87; no voters: 
I20260709 13:06:11.370728 23492 leader_election.cc:290] T 6c5eebf646ad445a9d1b1adc319d7b16 P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 10 election: Requested vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:06:11.372121 23605 leader_election.cc:290] T 179fd671030940b4b4a4e24bcc4aba0a P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 13 election: Requested vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:06:11.379685 23717 raft_consensus.cc:3060] T ff9b0eddd810459b82d91c60777c10eb P 0473d2b2d01f4459b1e90fd12cc7840e [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:06:11.397101 23805 raft_consensus.cc:2804] T 70797e5783b5454ab0d0eea663e791e3 P 127766fc592545a4997f7790f50f6076 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:06:11.406617 23795 consensus_queue.cc:260] T df751f992649444090e27965eb1af85d P 0473d2b2d01f4459b1e90fd12cc7840e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:11.401593 23761 consensus_queue.cc:1059] T 85c494af21f9457a85da47b9bc70c1fd P 127766fc592545a4997f7790f50f6076 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 }, Status: INVALID_TERM, Last received: 8.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.013s
I20260709 13:06:11.415275 23795 raft_consensus.cc:3060] T df751f992649444090e27965eb1af85d P 0473d2b2d01f4459b1e90fd12cc7840e [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:06:11.418658 23805 raft_consensus.cc:697] T 70797e5783b5454ab0d0eea663e791e3 P 127766fc592545a4997f7790f50f6076 [term 12 LEADER]: Becoming Leader. State: Replica: 127766fc592545a4997f7790f50f6076, State: Running, Role: LEADER
I20260709 13:06:11.419697 23805 consensus_queue.cc:237] T 70797e5783b5454ab0d0eea663e791e3 P 127766fc592545a4997f7790f50f6076 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:11.422129 23761 raft_consensus.cc:3055] T 85c494af21f9457a85da47b9bc70c1fd P 127766fc592545a4997f7790f50f6076 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:06:11.422592 23761 raft_consensus.cc:740] T 85c494af21f9457a85da47b9bc70c1fd P 127766fc592545a4997f7790f50f6076 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 127766fc592545a4997f7790f50f6076, State: Running, Role: LEADER
I20260709 13:06:11.423534 23761 consensus_queue.cc:260] T 85c494af21f9457a85da47b9bc70c1fd P 127766fc592545a4997f7790f50f6076 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:11.425115 23761 raft_consensus.cc:3060] T 85c494af21f9457a85da47b9bc70c1fd P 127766fc592545a4997f7790f50f6076 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:06:11.435946 19552 raft_consensus.cc:1275] T 2725d2c4cb054f18b0fc8f735c15f6c2 P e61c3a8f61bb48f8a963c9480e53c168 [term 14 FOLLOWER]: Refusing update from remote peer e5256d91808b47c195bc9b4dbd7f2b87: Log matching property violated. Preceding OpId in replica: term: 13 index: 6. Preceding OpId from leader: term: 14 index: 7. (index mismatch)
I20260709 13:06:11.406840 23819 raft_consensus.cc:2804] T b9f0d59553ad444883fcf5b5909f9798 P 0473d2b2d01f4459b1e90fd12cc7840e [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:06:11.404799 23638 raft_consensus.cc:493] T 62c6c134d3d24a1ab144dd9ee6bc3f64 P 127766fc592545a4997f7790f50f6076 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader e61c3a8f61bb48f8a963c9480e53c168)
I20260709 13:06:11.438055 19552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c5eebf646ad445a9d1b1adc319d7b16" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:06:11.455694 19552 raft_consensus.cc:2393] T 6c5eebf646ad445a9d1b1adc319d7b16 P e61c3a8f61bb48f8a963c9480e53c168 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 127766fc592545a4997f7790f50f6076 in current term 10: Already voted for candidate 0473d2b2d01f4459b1e90fd12cc7840e in this term.
I20260709 13:06:11.455291 20105 raft_consensus.cc:2468] T 65d8cb8d6ec64f459d5a47cefab10acf P 127766fc592545a4997f7790f50f6076 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 11.
I20260709 13:06:11.466110 19552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "179fd671030940b4b4a4e24bcc4aba0a" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
W20260709 13:06:11.468310 23843 log.cc:927] Time spent T 2725d2c4cb054f18b0fc8f735c15f6c2 P e61c3a8f61bb48f8a963c9480e53c168: Append to log took a long time: real 0.927s	user 0.004s	sys 0.000s
I20260709 13:06:11.472090 19407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "775c229504194560ba9589bc2199b089" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:06:11.470120 23867 raft_consensus.cc:515] T 179fd671030940b4b4a4e24bcc4aba0a P e61c3a8f61bb48f8a963c9480e53c168 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:11.475514 23867 leader_election.cc:290] T 179fd671030940b4b4a4e24bcc4aba0a P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 13 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:06:11.476305 19552 raft_consensus.cc:2393] T 179fd671030940b4b4a4e24bcc4aba0a P e61c3a8f61bb48f8a963c9480e53c168 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate e5256d91808b47c195bc9b4dbd7f2b87 in current term 13: Already voted for candidate e61c3a8f61bb48f8a963c9480e53c168 in this term.
I20260709 13:06:11.478137 19553 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40428 (request call id 2442) took 2376 ms. Trace:
I20260709 13:06:11.478518 19553 rpcz_store.cc:276] 0709 13:06:09.101682 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:09.979725 (+878043us) service_pool.cc:224] Handling call
0709 13:06:10.042811 (+ 63086us) spinlock_profiling.cc:243] Waited 8.99 ms on lock 0x7b5800003998. stack: 00007f4a79de9343 00007f4a79de9240 00007f4a797781d4 00007f4a834b6304 00007f4a834b6299 00007f4a79ca3db1 00007f4a79de3b71 00007f4a79de3a22 00007f4a82cfcc09 00007f4a81e56ee0 00007f4a81f200ab 00007f4a81f20131 00007f4a81ee1fc0 00007f4a81ecc929 00007f4a81ecc3d2 00007f4a7b443bd4
0709 13:06:10.043019 (+   208us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:10.646853 (+603834us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:11.477893 (+831040us) spinlock_profiling.cc:243] Waited 515 ms on lock 0x7b540030acd4. stack: 00007f4a79de9343 00007f4a79de9240 00007f4a797781d4 00007f4a834b6304 00007f4a834b6299 00007f4a7ce71571 00007f4a7cf08e01 00007f4a7cf0783e 00007f4a81ecc419 00007f4a7b443bd4 00007f4a7b443b62 00007f4a7b443a91 00007f4a7b443a0c 00007f4a7b442cc2 00007f4a7b24348c 00007f4a7b2428c6
0709 13:06:11.478074 (+   181us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1206322304}
I20260709 13:06:11.490579 23665 raft_consensus.cc:3055] T 70797e5783b5454ab0d0eea663e791e3 P e61c3a8f61bb48f8a963c9480e53c168 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:06:11.491070 23665 raft_consensus.cc:740] T 70797e5783b5454ab0d0eea663e791e3 P e61c3a8f61bb48f8a963c9480e53c168 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: e61c3a8f61bb48f8a963c9480e53c168, State: Running, Role: LEADER
I20260709 13:06:11.492087 23665 consensus_queue.cc:260] T 70797e5783b5454ab0d0eea663e791e3 P e61c3a8f61bb48f8a963c9480e53c168 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:11.493180 23665 raft_consensus.cc:3060] T 70797e5783b5454ab0d0eea663e791e3 P e61c3a8f61bb48f8a963c9480e53c168 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:06:11.503506 23884 raft_consensus.cc:3055] T 46c5bfeecc314717bffe987e6844b6d0 P e5256d91808b47c195bc9b4dbd7f2b87 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:06:11.504107 23884 raft_consensus.cc:740] T 46c5bfeecc314717bffe987e6844b6d0 P e5256d91808b47c195bc9b4dbd7f2b87 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: e5256d91808b47c195bc9b4dbd7f2b87, State: Running, Role: LEADER
I20260709 13:06:11.504930 23873 raft_consensus.cc:2749] T 0cdf56e38bbc453d9438d359e5a69955 P e5256d91808b47c195bc9b4dbd7f2b87 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:06:11.453660 23492 raft_consensus.cc:493] T 2a16f7501e2444fb86d4e2778e734e02 P 127766fc592545a4997f7790f50f6076 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader e5256d91808b47c195bc9b4dbd7f2b87)
I20260709 13:06:11.505162 23884 consensus_queue.cc:260] T 46c5bfeecc314717bffe987e6844b6d0 P e5256d91808b47c195bc9b4dbd7f2b87 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 16.7, Last appended by leader: 7, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:11.506336 23492 raft_consensus.cc:515] T 2a16f7501e2444fb86d4e2778e734e02 P 127766fc592545a4997f7790f50f6076 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:11.509583 23492 leader_election.cc:290] T 2a16f7501e2444fb86d4e2778e734e02 P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:06:11.464740 23714 leader_election.cc:290] T 21e14947d70440f19044d8f75c31e1f9 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:06:11.463097 23638 raft_consensus.cc:515] T 62c6c134d3d24a1ab144dd9ee6bc3f64 P 127766fc592545a4997f7790f50f6076 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:11.510489 23547 consensus_queue.cc:260] T ff75a1d4cb1f493db8f71ddc136ba9ab P e61c3a8f61bb48f8a963c9480e53c168 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:11.512079 23547 raft_consensus.cc:3060] T ff75a1d4cb1f493db8f71ddc136ba9ab P e61c3a8f61bb48f8a963c9480e53c168 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:06:11.513064 20077 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:11.513237 23638 leader_election.cc:290] T 62c6c134d3d24a1ab144dd9ee6bc3f64 P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:06:11.462708 23819 raft_consensus.cc:697] T b9f0d59553ad444883fcf5b5909f9798 P 0473d2b2d01f4459b1e90fd12cc7840e [term 13 LEADER]: Becoming Leader. State: Replica: 0473d2b2d01f4459b1e90fd12cc7840e, State: Running, Role: LEADER
I20260709 13:06:11.515691 23819 consensus_queue.cc:237] T b9f0d59553ad444883fcf5b5909f9798 P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:11.523298 23863 raft_consensus.cc:3060] T 2e36a9d6e29c4a7c860cf267efbd4c74 P e61c3a8f61bb48f8a963c9480e53c168 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:06:11.524248 19374 leader_election.cc:304] T 85c494af21f9457a85da47b9bc70c1fd P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87; no voters: 127766fc592545a4997f7790f50f6076, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:06:11.525650 19374 leader_election.cc:304] T 833a2f0775ed407a94b8924ce50adb63 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 127766fc592545a4997f7790f50f6076, e5256d91808b47c195bc9b4dbd7f2b87; no voters: 
I20260709 13:06:11.527490 23874 raft_consensus.cc:3055] T 0cdf56e38bbc453d9438d359e5a69955 P e61c3a8f61bb48f8a963c9480e53c168 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:06:11.527930 23874 raft_consensus.cc:740] T 0cdf56e38bbc453d9438d359e5a69955 P e61c3a8f61bb48f8a963c9480e53c168 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: e61c3a8f61bb48f8a963c9480e53c168, State: Running, Role: LEADER
I20260709 13:06:11.528847 23874 consensus_queue.cc:260] T 0cdf56e38bbc453d9438d359e5a69955 P e61c3a8f61bb48f8a963c9480e53c168 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:11.530097 23874 raft_consensus.cc:3060] T 0cdf56e38bbc453d9438d359e5a69955 P e61c3a8f61bb48f8a963c9480e53c168 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:06:11.514526 23505 raft_consensus.cc:493] T df751f992649444090e27965eb1af85d P e61c3a8f61bb48f8a963c9480e53c168 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 0473d2b2d01f4459b1e90fd12cc7840e)
I20260709 13:06:11.531931 23505 raft_consensus.cc:515] T df751f992649444090e27965eb1af85d P e61c3a8f61bb48f8a963c9480e53c168 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
W20260709 13:06:11.572211 19452 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:11.576145 19449 leader_election.cc:304] T 1f85fc4b527a48848e5faa083b604e36 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, 127766fc592545a4997f7790f50f6076; no voters: e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:06:11.565212 20105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "833a2f0775ed407a94b8924ce50adb63" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076"
I20260709 13:06:11.583911 19404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21e14947d70440f19044d8f75c31e1f9" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:06:11.565619 20108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96efeaaf1057492490e9a621f37e1a2d" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076"
I20260709 13:06:11.585021 20108 raft_consensus.cc:3060] T 96efeaaf1057492490e9a621f37e1a2d P 127766fc592545a4997f7790f50f6076 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:06:11.584923 19374 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.4:43121, user_credentials={real_user=slave}} blocked reactor thread for 59358.6us
I20260709 13:06:11.584153 20105 raft_consensus.cc:2393] T 833a2f0775ed407a94b8924ce50adb63 P 127766fc592545a4997f7790f50f6076 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate e61c3a8f61bb48f8a963c9480e53c168 in current term 10: Already voted for candidate 127766fc592545a4997f7790f50f6076 in this term.
I20260709 13:06:11.566831 20109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0afb57ae58a24a01850491d69f0213dd" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076"
I20260709 13:06:11.566387 20106 raft_consensus.cc:1240] T 48824d5acfbc485ebf8c2d944e7202de P 127766fc592545a4997f7790f50f6076 [term 13 FOLLOWER]: Rejecting Update request from peer e61c3a8f61bb48f8a963c9480e53c168 for earlier term 12. Current term is 13. Ops: []
I20260709 13:06:11.579243 19405 raft_consensus.cc:1240] T 40e1e16737a842ee936002830f36882e P e5256d91808b47c195bc9b4dbd7f2b87 [term 15 LEADER]: Rejecting Update request from peer e61c3a8f61bb48f8a963c9480e53c168 for earlier term 14. Current term is 15. Ops: []
I20260709 13:06:11.547219 19560 raft_consensus.cc:3055] T a08760e15aac4630a629431f56024dc8 P e61c3a8f61bb48f8a963c9480e53c168 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:06:11.579929 19409 raft_consensus.cc:1240] T 0cdf56e38bbc453d9438d359e5a69955 P e5256d91808b47c195bc9b4dbd7f2b87 [term 13 FOLLOWER]: Rejecting Update request from peer e61c3a8f61bb48f8a963c9480e53c168 for earlier term 12. Current term is 13. Ops: []
I20260709 13:06:11.573539 19410 raft_consensus.cc:1240] T ef32ce6fdd0e40d382c79974f30295c6 P e5256d91808b47c195bc9b4dbd7f2b87 [term 14 FOLLOWER]: Rejecting Update request from peer 0473d2b2d01f4459b1e90fd12cc7840e for earlier term 13. Current term is 14. Ops: []
I20260709 13:06:11.589808 19406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "833a2f0775ed407a94b8924ce50adb63" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
I20260709 13:06:11.565651 19402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f85fc4b527a48848e5faa083b604e36" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:06:11.605708 19374 leader_election.cc:304] T 65d8cb8d6ec64f459d5a47cefab10acf P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 127766fc592545a4997f7790f50f6076, e5256d91808b47c195bc9b4dbd7f2b87; no voters: e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:06:11.605846 19402 raft_consensus.cc:2468] T 1f85fc4b527a48848e5faa083b604e36 P e5256d91808b47c195bc9b4dbd7f2b87 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 127766fc592545a4997f7790f50f6076 in term 10.
I20260709 13:06:11.588033 19560 raft_consensus.cc:740] T a08760e15aac4630a629431f56024dc8 P e61c3a8f61bb48f8a963c9480e53c168 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: e61c3a8f61bb48f8a963c9480e53c168, State: Running, Role: LEADER
I20260709 13:06:11.591023 19526 leader_election.cc:304] T 96efeaaf1057492490e9a621f37e1a2d P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:06:11.630491 20108 raft_consensus.cc:2468] T 96efeaaf1057492490e9a621f37e1a2d P 127766fc592545a4997f7790f50f6076 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 13.
I20260709 13:06:11.634464 19551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2725d2c4cb054f18b0fc8f735c15f6c2" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:06:11.651906 19551 raft_consensus.cc:2410] T 2725d2c4cb054f18b0fc8f735c15f6c2 P e61c3a8f61bb48f8a963c9480e53c168 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate e5256d91808b47c195bc9b4dbd7f2b87 for term 14 because replica has last-logged OpId of term: 13 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 6.
I20260709 13:06:11.615900 19404 raft_consensus.cc:2393] T 21e14947d70440f19044d8f75c31e1f9 P e5256d91808b47c195bc9b4dbd7f2b87 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0473d2b2d01f4459b1e90fd12cc7840e in current term 12: Already voted for candidate e5256d91808b47c195bc9b4dbd7f2b87 in this term.
I20260709 13:06:11.626609 19555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b74109013a140ada21feeef92d6f563" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:06:11.651765 19558 raft_consensus.cc:1275] T 40e1e16737a842ee936002830f36882e P e61c3a8f61bb48f8a963c9480e53c168 [term 15 FOLLOWER]: Refusing update from remote peer e5256d91808b47c195bc9b4dbd7f2b87: Log matching property violated. Preceding OpId in replica: term: 14 index: 7. Preceding OpId from leader: term: 15 index: 8. (index mismatch)
I20260709 13:06:11.654167 19555 raft_consensus.cc:2393] T 2b74109013a140ada21feeef92d6f563 P e61c3a8f61bb48f8a963c9480e53c168 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e5256d91808b47c195bc9b4dbd7f2b87 in current term 9: Already voted for candidate e61c3a8f61bb48f8a963c9480e53c168 in this term.
I20260709 13:06:11.656291 19402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a16f7501e2444fb86d4e2778e734e02" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:06:11.660422 19485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "179fd671030940b4b4a4e24bcc4aba0a" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:06:11.661092 19485 raft_consensus.cc:3060] T 179fd671030940b4b4a4e24bcc4aba0a P 0473d2b2d01f4459b1e90fd12cc7840e [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:06:11.665921 19483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df751f992649444090e27965eb1af85d" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:06:11.666915 19483 raft_consensus.cc:2468] T df751f992649444090e27965eb1af85d P 0473d2b2d01f4459b1e90fd12cc7840e [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 14.
I20260709 13:06:11.667029 19523 leader_election.cc:304] T 0afb57ae58a24a01850491d69f0213dd P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e61c3a8f61bb48f8a963c9480e53c168; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, 127766fc592545a4997f7790f50f6076
I20260709 13:06:11.670660 19483 raft_consensus.cc:1240] T 62c6c134d3d24a1ab144dd9ee6bc3f64 P 0473d2b2d01f4459b1e90fd12cc7840e [term 11 FOLLOWER]: Rejecting Update request from peer e61c3a8f61bb48f8a963c9480e53c168 for earlier term 10. Current term is 11. Ops: []
I20260709 13:06:11.675736 19526 leader_election.cc:304] T df751f992649444090e27965eb1af85d P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:06:11.534593 23505 leader_election.cc:290] T df751f992649444090e27965eb1af85d P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:06:11.542975 23687 raft_consensus.cc:2749] T 85c494af21f9457a85da47b9bc70c1fd P e5256d91808b47c195bc9b4dbd7f2b87 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:06:11.550256 23822 raft_consensus.cc:3060] T f1b10566f45d4a7d9029858330e02d5b P e61c3a8f61bb48f8a963c9480e53c168 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:06:11.549438 23414 raft_consensus.cc:493] T 1dc5b3532fe54f74876d02beffa2c230 P 0473d2b2d01f4459b1e90fd12cc7840e [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:11.691812 19485 raft_consensus.cc:2468] T 179fd671030940b4b4a4e24bcc4aba0a P 0473d2b2d01f4459b1e90fd12cc7840e [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 13.
I20260709 13:06:11.688493 19375 leader_election.cc:304] T 4509b76741dc428e9201c70c1658da13 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:06:11.562541 23713 leader_election.cc:290] T 2b74109013a140ada21feeef92d6f563 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 9 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
W20260709 13:06:11.704056 19525 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:11.705724 19478 raft_consensus.cc:1240] T ff75a1d4cb1f493db8f71ddc136ba9ab P 0473d2b2d01f4459b1e90fd12cc7840e [term 11 FOLLOWER]: Rejecting Update request from peer e61c3a8f61bb48f8a963c9480e53c168 for earlier term 10. Current term is 11. Ops: []
I20260709 13:06:11.535846 23619 leader_election.cc:290] T 2b74109013a140ada21feeef92d6f563 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:06:11.556073 23821 raft_consensus.cc:3060] T edd7d470b5014c9489be7f41f64355c9 P e61c3a8f61bb48f8a963c9480e53c168 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:06:11.701926 19484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b74109013a140ada21feeef92d6f563" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:06:11.539098 23833 leader_election.cc:290] T 0cdf56e38bbc453d9438d359e5a69955 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:06:11.543715 23878 raft_consensus.cc:2804] T 833a2f0775ed407a94b8924ce50adb63 P e5256d91808b47c195bc9b4dbd7f2b87 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:06:11.632731 23715 raft_consensus.cc:3060] T 1a61655d99124a29b486ba4a5b37faea P e61c3a8f61bb48f8a963c9480e53c168 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:06:11.638688 23893 raft_consensus.cc:3055] T 48824d5acfbc485ebf8c2d944e7202de P e61c3a8f61bb48f8a963c9480e53c168 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:06:11.641004 23717 raft_consensus.cc:515] T ff9b0eddd810459b82d91c60777c10eb P 0473d2b2d01f4459b1e90fd12cc7840e [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:11.641242 23829 raft_consensus.cc:515] T 775c229504194560ba9589bc2199b089 P 0473d2b2d01f4459b1e90fd12cc7840e [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:11.709321 19450 leader_election.cc:304] T 1efebf73c86e432baa55533136b6e12c P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e; no voters: 127766fc592545a4997f7790f50f6076, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:06:11.709821 19555 raft_consensus.cc:1275] T 1dc5b3532fe54f74876d02beffa2c230 P e61c3a8f61bb48f8a963c9480e53c168 [term 12 FOLLOWER]: Refusing update from remote peer e5256d91808b47c195bc9b4dbd7f2b87: Log matching property violated. Preceding OpId in replica: term: 10 index: 5. Preceding OpId from leader: term: 12 index: 6. (index mismatch)
I20260709 13:06:11.630607 23605 raft_consensus.cc:2804] T 65d8cb8d6ec64f459d5a47cefab10acf P e5256d91808b47c195bc9b4dbd7f2b87 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:06:11.644565 23768 raft_consensus.cc:2804] T 96efeaaf1057492490e9a621f37e1a2d P e61c3a8f61bb48f8a963c9480e53c168 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:06:11.676982 23884 raft_consensus.cc:3060] T 46c5bfeecc314717bffe987e6844b6d0 P e5256d91808b47c195bc9b4dbd7f2b87 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:06:11.712987 23795 raft_consensus.cc:493] T 0cdf56e38bbc453d9438d359e5a69955 P 0473d2b2d01f4459b1e90fd12cc7840e [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:11.687723 23872 raft_consensus.cc:2804] T 1f85fc4b527a48848e5faa083b604e36 P 0473d2b2d01f4459b1e90fd12cc7840e [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:06:11.722350 19410 raft_consensus.cc:1240] T a08760e15aac4630a629431f56024dc8 P e5256d91808b47c195bc9b4dbd7f2b87 [term 14 LEADER]: Rejecting Update request from peer e61c3a8f61bb48f8a963c9480e53c168 for earlier term 13. Current term is 14. Ops: [13.8-13.8]
I20260709 13:06:11.723453 19405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "179fd671030940b4b4a4e24bcc4aba0a" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
I20260709 13:06:11.800745 19526 leader_election.cc:304] T 179fd671030940b4b4a4e24bcc4aba0a P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:06:11.801396 19405 raft_consensus.cc:2393] T 179fd671030940b4b4a4e24bcc4aba0a P e5256d91808b47c195bc9b4dbd7f2b87 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate e61c3a8f61bb48f8a963c9480e53c168 in current term 13: Already voted for candidate e5256d91808b47c195bc9b4dbd7f2b87 in this term.
I20260709 13:06:11.717569 23873 consensus_queue.cc:1048] T e381f1d6b8184797ad142de49be225a8 P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.024s
I20260709 13:06:11.724748 19411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b74109013a140ada21feeef92d6f563" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
W20260709 13:06:11.708092 23902 log.cc:927] Time spent T 21e14947d70440f19044d8f75c31e1f9 P 0473d2b2d01f4459b1e90fd12cc7840e: Append to log took a long time: real 0.099s	user 0.001s	sys 0.000s
I20260709 13:06:11.728273 19404 raft_consensus.cc:1240] T 70797e5783b5454ab0d0eea663e791e3 P e5256d91808b47c195bc9b4dbd7f2b87 [term 12 FOLLOWER]: Rejecting Update request from peer e61c3a8f61bb48f8a963c9480e53c168 for earlier term 11. Current term is 12. Ops: []
I20260709 13:06:11.721035 23687 consensus_queue.cc:1048] T 40e1e16737a842ee936002830f36882e P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.051s
I20260709 13:06:11.713527 23777 raft_consensus.cc:2804] T 4509b76741dc428e9201c70c1658da13 P e5256d91808b47c195bc9b4dbd7f2b87 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:06:11.718446 19407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28af091831594f9d8e96482078cc7625" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 13 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:06:11.718065 23878 raft_consensus.cc:493] T 833a2f0775ed407a94b8924ce50adb63 P e5256d91808b47c195bc9b4dbd7f2b87 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:11.721324 23859 raft_consensus.cc:2804] T df751f992649444090e27965eb1af85d P e61c3a8f61bb48f8a963c9480e53c168 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:06:11.707643 23414 raft_consensus.cc:515] T 1dc5b3532fe54f74876d02beffa2c230 P 0473d2b2d01f4459b1e90fd12cc7840e [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:11.791056 20106 raft_consensus.cc:1240] T 70797e5783b5454ab0d0eea663e791e3 P 127766fc592545a4997f7790f50f6076 [term 12 LEADER]: Rejecting Update request from peer e61c3a8f61bb48f8a963c9480e53c168 for earlier term 11. Current term is 12. Ops: []
I20260709 13:06:11.727753 23893 raft_consensus.cc:740] T 48824d5acfbc485ebf8c2d944e7202de P e61c3a8f61bb48f8a963c9480e53c168 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: e61c3a8f61bb48f8a963c9480e53c168, State: Running, Role: LEADER
I20260709 13:06:11.713363 23465 consensus_queue.cc:1048] T 2725d2c4cb054f18b0fc8f735c15f6c2 P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.026s
W20260709 13:06:11.773928 19450 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.3:36891, user_credentials={real_user=slave}} blocked reactor thread for 64680.6us
I20260709 13:06:11.803014 23870 raft_consensus.cc:2749] T 1efebf73c86e432baa55533136b6e12c P 0473d2b2d01f4459b1e90fd12cc7840e [term 11 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:06:11.809172 23837 raft_consensus.cc:2804] T 179fd671030940b4b4a4e24bcc4aba0a P e61c3a8f61bb48f8a963c9480e53c168 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:06:11.702512 23789 consensus_queue.cc:1048] T d1e5873a19244c5ebbcd38e126796ee7 P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.033s
I20260709 13:06:11.773449 19403 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52342 (request call id 2521) took 1025 ms. Trace:
I20260709 13:06:11.724103 19408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df751f992649444090e27965eb1af85d" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
W20260709 13:06:11.802125 19526 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:11.802600 20075 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.1:40321, user_credentials={real_user=slave}} blocked reactor thread for 274050us
I20260709 13:06:11.855168 19408 raft_consensus.cc:2393] T df751f992649444090e27965eb1af85d P e5256d91808b47c195bc9b4dbd7f2b87 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e61c3a8f61bb48f8a963c9480e53c168 in current term 14: Already voted for candidate e5256d91808b47c195bc9b4dbd7f2b87 in this term.
I20260709 13:06:11.856349 20075 leader_election.cc:304] T 1f85fc4b527a48848e5faa083b604e36 P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 127766fc592545a4997f7790f50f6076, e5256d91808b47c195bc9b4dbd7f2b87; no voters: 
W20260709 13:06:11.829830 23842 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.947s	user 0.009s	sys 0.009s
I20260709 13:06:11.734172 23817 consensus_queue.cc:1059] T 48824d5acfbc485ebf8c2d944e7202de P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.066s
I20260709 13:06:11.735601 23505 consensus_queue.cc:1059] T 21e14947d70440f19044d8f75c31e1f9 P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.068s
I20260709 13:06:11.741627 23872 raft_consensus.cc:493] T 1f85fc4b527a48848e5faa083b604e36 P 0473d2b2d01f4459b1e90fd12cc7840e [term 9 FOLLOWER]: Starting leader election (detected failure of leader 127766fc592545a4997f7790f50f6076)
I20260709 13:06:11.771929 23605 raft_consensus.cc:697] T 65d8cb8d6ec64f459d5a47cefab10acf P e5256d91808b47c195bc9b4dbd7f2b87 [term 11 LEADER]: Becoming Leader. State: Replica: e5256d91808b47c195bc9b4dbd7f2b87, State: Running, Role: LEADER
I20260709 13:06:11.772158 23768 raft_consensus.cc:697] T 96efeaaf1057492490e9a621f37e1a2d P e61c3a8f61bb48f8a963c9480e53c168 [term 13 LEADER]: Becoming Leader. State: Replica: e61c3a8f61bb48f8a963c9480e53c168, State: Running, Role: LEADER
W20260709 13:06:11.790309 19523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.1:40321, user_credentials={real_user=slave}} blocked reactor thread for 46281.6us
I20260709 13:06:11.773450 23795 raft_consensus.cc:515] T 0cdf56e38bbc453d9438d359e5a69955 P 0473d2b2d01f4459b1e90fd12cc7840e [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:11.806514 23777 raft_consensus.cc:493] T 4509b76741dc428e9201c70c1658da13 P e5256d91808b47c195bc9b4dbd7f2b87 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 0473d2b2d01f4459b1e90fd12cc7840e)
W20260709 13:06:11.864130 23842 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.984s	user 0.009s	sys 0.009s
I20260709 13:06:11.729308 19409 raft_consensus.cc:1240] T edd7d470b5014c9489be7f41f64355c9 P e5256d91808b47c195bc9b4dbd7f2b87 [term 12 LEADER]: Rejecting Update request from peer e61c3a8f61bb48f8a963c9480e53c168 for earlier term 11. Current term is 12. Ops: []
I20260709 13:06:11.813645 23859 raft_consensus.cc:493] T df751f992649444090e27965eb1af85d P e61c3a8f61bb48f8a963c9480e53c168 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 0473d2b2d01f4459b1e90fd12cc7840e)
I20260709 13:06:11.800635 23538 consensus_queue.cc:1059] T ef32ce6fdd0e40d382c79974f30295c6 P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.033s
I20260709 13:06:11.828128 23465 consensus_queue.cc:1243] T 2725d2c4cb054f18b0fc8f735c15f6c2 P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Peer e61c3a8f61bb48f8a963c9480e53c168 log is divergent from this leader: its last log entry 13.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 13:06:11.870234 19450 leader_election.cc:304] T 2e36a9d6e29c4a7c860cf267efbd4c74 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e; no voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:06:11.864972 23492 raft_consensus.cc:2804] T 1f85fc4b527a48848e5faa083b604e36 P 127766fc592545a4997f7790f50f6076 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:06:11.881546 19555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a16f7501e2444fb86d4e2778e734e02" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:06:11.865392 23837 raft_consensus.cc:697] T 179fd671030940b4b4a4e24bcc4aba0a P e61c3a8f61bb48f8a963c9480e53c168 [term 13 LEADER]: Becoming Leader. State: Replica: e61c3a8f61bb48f8a963c9480e53c168, State: Running, Role: LEADER
W20260709 13:06:11.871079 19375 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.3:36891, user_credentials={real_user=slave}} blocked reactor thread for 112052us
I20260709 13:06:11.855911 19403 rpcz_store.cc:276] 0709 13:06:10.748027 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:10.748188 (+   161us) service_pool.cc:224] Handling call
0709 13:06:10.750642 (+  2454us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:10.750874 (+   232us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:06:11.373258 (+622384us) spinlock_profiling.cc:243] Waited 15.4 ms on lock 0x7b18000c6340. stack: 00007f4a79de9343 00007f4a79de9240 00007f4a797781d4 00007f4a834b6304 00007f4a834b6299 00007f4a82ce3de1 00007f4a82cf05b1 00007f4a7cab04bc 00007f4a79dfe48b 00007f4a82c58ab9 00007f4a79e1a69b 00007f4a79e1893f 00007f4a79e18455 00007f4a809003c7 00007f4a7cf129a7 00007f4a7cf220bf
0709 13:06:11.373441 (+   183us) log.cc:844] Serialized 14 byte log entry
0709 13:06:11.773021 (+399580us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:11.773090 (+    69us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:06:11.773152 (+    62us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:11.773239 (+    87us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:11.773380 (+   141us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":62013,"prepare.queue_time_us":86241,"prepare.run_cpu_time_us":30,"prepare.run_wall_time_us":31,"raft.queue_time_us":28656,"raft.run_cpu_time_us":89,"raft.run_wall_time_us":12723,"spinlock_wait_cycles":49282048,"thread_start_us":374996,"threads_started":2,"wal-append.queue_time_us":447017}
I20260709 13:06:11.813522 23878 raft_consensus.cc:3060] T 833a2f0775ed407a94b8924ce50adb63 P e5256d91808b47c195bc9b4dbd7f2b87 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:06:11.873446 23777 raft_consensus.cc:3060] T 4509b76741dc428e9201c70c1658da13 P e5256d91808b47c195bc9b4dbd7f2b87 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:06:11.871593 23775 raft_consensus.cc:493] T 40e1e16737a842ee936002830f36882e P 0473d2b2d01f4459b1e90fd12cc7840e [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:11.878738 23859 raft_consensus.cc:3060] T df751f992649444090e27965eb1af85d P e61c3a8f61bb48f8a963c9480e53c168 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:06:11.877733 23868 raft_consensus.cc:2749] T 0afb57ae58a24a01850491d69f0213dd P e61c3a8f61bb48f8a963c9480e53c168 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:06:11.828619 23880 consensus_queue.cc:1048] T 1dc5b3532fe54f74876d02beffa2c230 P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.042s
I20260709 13:06:11.805850 23713 consensus_queue.cc:1059] T 62c6c134d3d24a1ab144dd9ee6bc3f64 P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 }, Status: INVALID_TERM, Last received: 10.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.046s
I20260709 13:06:11.883589 20076 leader_election.cc:304] T 2a16f7501e2444fb86d4e2778e734e02 P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 127766fc592545a4997f7790f50f6076; no voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:06:11.883994 19551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62c6c134d3d24a1ab144dd9ee6bc3f64" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:06:11.884812 23414 leader_election.cc:290] T 1dc5b3532fe54f74876d02beffa2c230 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:06:11.885622 23492 raft_consensus.cc:493] T 1f85fc4b527a48848e5faa083b604e36 P 127766fc592545a4997f7790f50f6076 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:11.885684 23505 raft_consensus.cc:493] T ab43d85f64114d4ebf618930e43d9ed0 P e61c3a8f61bb48f8a963c9480e53c168 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:11.872023 23872 raft_consensus.cc:3060] T 1f85fc4b527a48848e5faa083b604e36 P 0473d2b2d01f4459b1e90fd12cc7840e [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:06:11.890559 19450 leader_election.cc:304] T ff75a1d4cb1f493db8f71ddc136ba9ab P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e; no voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:06:11.870656 19560 consensus_queue.cc:260] T a08760e15aac4630a629431f56024dc8 P e61c3a8f61bb48f8a963c9480e53c168 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:11.893672 19523 leader_election.cc:304] T 28af091831594f9d8e96482078cc7625 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e61c3a8f61bb48f8a963c9480e53c168; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:06:11.893908 19555 raft_consensus.cc:1275] T 7f575b143b844aa096b50997dad3516a P e61c3a8f61bb48f8a963c9480e53c168 [term 8 FOLLOWER]: Refusing update from remote peer e5256d91808b47c195bc9b4dbd7f2b87: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
W20260709 13:06:11.895911 19525 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:11.877019 23768 consensus_queue.cc:237] T 96efeaaf1057492490e9a621f37e1a2d P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.9, Last appended by leader: 9, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
W20260709 13:06:11.899696 23905 log.cc:927] Time spent T 7be9efa6559648dbb5a0f7684c4542d1 P 0473d2b2d01f4459b1e90fd12cc7840e: Append to log took a long time: real 0.109s	user 0.001s	sys 0.000s
I20260709 13:06:11.874003 23819 consensus_queue.cc:1048] T 4509b76741dc428e9201c70c1658da13 P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.025s
W20260709 13:06:11.909988 23906 log.cc:927] Time spent T fa731b585f684a7fb2d106c50f143b83 P e61c3a8f61bb48f8a963c9480e53c168: Append to log took a long time: real 0.207s	user 0.000s	sys 0.001s
I20260709 13:06:11.913579 19450 leader_election.cc:304] T f1b10566f45d4a7d9029858330e02d5b P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e; no voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168
W20260709 13:06:11.913795 19525 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:11.916591 19560 raft_consensus.cc:3060] T a08760e15aac4630a629431f56024dc8 P e61c3a8f61bb48f8a963c9480e53c168 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:06:11.895566 23740 raft_consensus.cc:2749] T 2e36a9d6e29c4a7c860cf267efbd4c74 P 0473d2b2d01f4459b1e90fd12cc7840e [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:06:11.878250 23605 consensus_queue.cc:237] T 65d8cb8d6ec64f459d5a47cefab10acf P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 7, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:11.909973 23492 raft_consensus.cc:3060] T 1f85fc4b527a48848e5faa083b604e36 P 127766fc592545a4997f7790f50f6076 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:06:11.908524 23784 raft_consensus.cc:2749] T 2a16f7501e2444fb86d4e2778e734e02 P 127766fc592545a4997f7790f50f6076 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:06:11.902318 23775 raft_consensus.cc:515] T 40e1e16737a842ee936002830f36882e P 0473d2b2d01f4459b1e90fd12cc7840e [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:11.914883 23660 raft_consensus.cc:2749] T ff75a1d4cb1f493db8f71ddc136ba9ab P 0473d2b2d01f4459b1e90fd12cc7840e [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:06:11.932924 23896 raft_consensus.cc:2749] T f1b10566f45d4a7d9029858330e02d5b P 0473d2b2d01f4459b1e90fd12cc7840e [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:06:11.930259 19450 leader_election.cc:304] T 46c5bfeecc314717bffe987e6844b6d0 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e; no voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:06:11.914959 23717 leader_election.cc:290] T ff9b0eddd810459b82d91c60777c10eb P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 12 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:06:11.951704 19523 leader_election.cc:304] T 2b74109013a140ada21feeef92d6f563 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e61c3a8f61bb48f8a963c9480e53c168; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:06:11.920945 23829 leader_election.cc:290] T 775c229504194560ba9589bc2199b089 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 10 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:06:11.939564 23769 raft_consensus.cc:2749] T 28af091831594f9d8e96482078cc7625 P e61c3a8f61bb48f8a963c9480e53c168 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:06:11.917600 23505 raft_consensus.cc:515] T ab43d85f64114d4ebf618930e43d9ed0 P e61c3a8f61bb48f8a963c9480e53c168 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } attrs { replace: true } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:11.968304 23378 raft_consensus.cc:2749] T 46c5bfeecc314717bffe987e6844b6d0 P 0473d2b2d01f4459b1e90fd12cc7840e [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:06:11.986280 23860 raft_consensus.cc:2749] T 2b74109013a140ada21feeef92d6f563 P e61c3a8f61bb48f8a963c9480e53c168 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:06:11.970261 23538 consensus_queue.cc:1059] T 0afb57ae58a24a01850491d69f0213dd P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.038s
W20260709 13:06:12.043705 19450 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.3:36891, user_credentials={real_user=slave}} blocked reactor thread for 95252.6us
I20260709 13:06:12.045698 23505 leader_election.cc:290] T ab43d85f64114d4ebf618930e43d9ed0 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
W20260709 13:06:12.036999 23915 log.cc:927] Time spent T 76cb037fc9064d13b59a8969d897ce8c P e61c3a8f61bb48f8a963c9480e53c168: Append to log took a long time: real 0.126s	user 0.000s	sys 0.001s
I20260709 13:06:12.055990 20104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab43d85f64114d4ebf618930e43d9ed0" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 13 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:06:11.941357 23837 consensus_queue.cc:237] T 179fd671030940b4b4a4e24bcc4aba0a P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:12.060626 20104 raft_consensus.cc:2468] T ab43d85f64114d4ebf618930e43d9ed0 P 127766fc592545a4997f7790f50f6076 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 12.
I20260709 13:06:12.038297 23795 leader_election.cc:290] T 0cdf56e38bbc453d9438d359e5a69955 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:06:12.067585 19450 leader_election.cc:304] T 6c5eebf646ad445a9d1b1adc319d7b16 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168; no voters: 127766fc592545a4997f7790f50f6076
W20260709 13:06:12.076123 23909 log.cc:927] Time spent T 00000000000000000000000000000000 P 97750b77d35444acb7791ebf26cc2685: Append to log took a long time: real 0.170s	user 0.000s	sys 0.001s
W20260709 13:06:12.083278 23665 consensus_meta.cc:287] T 70797e5783b5454ab0d0eea663e791e3 P e61c3a8f61bb48f8a963c9480e53c168: Time spent flushing consensus metadata: real 0.590s	user 0.013s	sys 0.000s
I20260709 13:06:12.078066 23492 raft_consensus.cc:515] T 1f85fc4b527a48848e5faa083b604e36 P 127766fc592545a4997f7790f50f6076 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
W20260709 13:06:12.086120 23863 consensus_meta.cc:287] T 2e36a9d6e29c4a7c860cf267efbd4c74 P e61c3a8f61bb48f8a963c9480e53c168: Time spent flushing consensus metadata: real 0.562s	user 0.008s	sys 0.002s
W20260709 13:06:12.097436 23914 log.cc:927] Time spent T b9f0d59553ad444883fcf5b5909f9798 P 0473d2b2d01f4459b1e90fd12cc7840e: Append to log took a long time: real 0.197s	user 0.001s	sys 0.001s
I20260709 13:06:12.104281 20112 raft_consensus.cc:1275] T 7be9efa6559648dbb5a0f7684c4542d1 P 127766fc592545a4997f7790f50f6076 [term 13 FOLLOWER]: Refusing update from remote peer 0473d2b2d01f4459b1e90fd12cc7840e: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 13:06:12.105567 20109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "775c229504194560ba9589bc2199b089" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076"
I20260709 13:06:12.115538 19450 leader_election.cc:400] T 96efeaaf1057492490e9a621f37e1a2d P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 12 election: Vote denied by peer e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891) with higher term. Message: Invalid argument: T 96efeaaf1057492490e9a621f37e1a2d P e61c3a8f61bb48f8a963c9480e53c168 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 0473d2b2d01f4459b1e90fd12cc7840e for earlier term 12. Current term is 13.
I20260709 13:06:12.115381 20108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff9b0eddd810459b82d91c60777c10eb" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076"
I20260709 13:06:12.116024 19450 leader_election.cc:403] T 96efeaaf1057492490e9a621f37e1a2d P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 12 election: Cancelling election due to peer responding with higher term
I20260709 13:06:12.129393 20104 raft_consensus.cc:1240] T 65d8cb8d6ec64f459d5a47cefab10acf P 127766fc592545a4997f7790f50f6076 [term 11 FOLLOWER]: Rejecting Update request from peer e61c3a8f61bb48f8a963c9480e53c168 for earlier term 10. Current term is 11. Ops: []
I20260709 13:06:12.099542 23538 raft_consensus.cc:2804] T 6c5eebf646ad445a9d1b1adc319d7b16 P 0473d2b2d01f4459b1e90fd12cc7840e [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:06:12.158249 20108 raft_consensus.cc:2468] T ff9b0eddd810459b82d91c60777c10eb P 127766fc592545a4997f7790f50f6076 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 12.
I20260709 13:06:12.159816 19449 leader_election.cc:304] T ff9b0eddd810459b82d91c60777c10eb P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, 127766fc592545a4997f7790f50f6076; no voters: 
I20260709 13:06:12.108518 23819 raft_consensus.cc:493] T 1a61655d99124a29b486ba4a5b37faea P 0473d2b2d01f4459b1e90fd12cc7840e [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:12.069936 23663 consensus_queue.cc:1059] T 2b74109013a140ada21feeef92d6f563 P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 }, Status: INVALID_TERM, Last received: 6.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.087s
W20260709 13:06:12.156771 23547 consensus_meta.cc:287] T ff75a1d4cb1f493db8f71ddc136ba9ab P e61c3a8f61bb48f8a963c9480e53c168: Time spent flushing consensus metadata: real 0.644s	user 0.012s	sys 0.000s
W20260709 13:06:12.170260 19450 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.3:36891, user_credentials={real_user=slave}} blocked reactor thread for 54870.8us
I20260709 13:06:12.171772 19481 raft_consensus.cc:1240] T 775c229504194560ba9589bc2199b089 P 0473d2b2d01f4459b1e90fd12cc7840e [term 10 FOLLOWER]: Rejecting Update request from peer e5256d91808b47c195bc9b4dbd7f2b87 for earlier term 9. Current term is 10. Ops: []
I20260709 13:06:12.173102 19481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4509b76741dc428e9201c70c1658da13" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:06:12.174702 19481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21e14947d70440f19044d8f75c31e1f9" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:06:12.162489 23538 raft_consensus.cc:697] T 6c5eebf646ad445a9d1b1adc319d7b16 P 0473d2b2d01f4459b1e90fd12cc7840e [term 10 LEADER]: Becoming Leader. State: Replica: 0473d2b2d01f4459b1e90fd12cc7840e, State: Running, Role: LEADER
I20260709 13:06:12.177716 23538 consensus_queue.cc:237] T 6c5eebf646ad445a9d1b1adc319d7b16 P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:12.179402 19486 raft_consensus.cc:1275] T 2725d2c4cb054f18b0fc8f735c15f6c2 P 0473d2b2d01f4459b1e90fd12cc7840e [term 14 FOLLOWER]: Refusing update from remote peer e5256d91808b47c195bc9b4dbd7f2b87: Log matching property violated. Preceding OpId in replica: term: 8 index: 4. Preceding OpId from leader: term: 14 index: 7. (index mismatch)
I20260709 13:06:12.180670 19486 raft_consensus.cc:1275] T 1dc5b3532fe54f74876d02beffa2c230 P 0473d2b2d01f4459b1e90fd12cc7840e [term 12 FOLLOWER]: Refusing update from remote peer e5256d91808b47c195bc9b4dbd7f2b87: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 12 index: 6. (index mismatch)
I20260709 13:06:12.183286 19477 raft_consensus.cc:1275] T 40e1e16737a842ee936002830f36882e P 0473d2b2d01f4459b1e90fd12cc7840e [term 15 FOLLOWER]: Refusing update from remote peer e5256d91808b47c195bc9b4dbd7f2b87: Log matching property violated. Preceding OpId in replica: term: 14 index: 7. Preceding OpId from leader: term: 15 index: 8. (index mismatch)
I20260709 13:06:12.184782 19484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b74109013a140ada21feeef92d6f563" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:06:12.185716 20078 leader_election.cc:304] T 1efebf73c86e432baa55533136b6e12c P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 127766fc592545a4997f7790f50f6076; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:06:12.185885 19482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "179fd671030940b4b4a4e24bcc4aba0a" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:06:12.186539 19482 raft_consensus.cc:2393] T 179fd671030940b4b4a4e24bcc4aba0a P 0473d2b2d01f4459b1e90fd12cc7840e [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate e5256d91808b47c195bc9b4dbd7f2b87 in current term 13: Already voted for candidate e61c3a8f61bb48f8a963c9480e53c168 in this term.
I20260709 13:06:12.186769 19554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7be9efa6559648dbb5a0f7684c4542d1" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:06:12.186936 20078 leader_election.cc:304] T 48824d5acfbc485ebf8c2d944e7202de P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, 127766fc592545a4997f7790f50f6076; no voters: e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:06:12.187505 19554 raft_consensus.cc:3060] T 7be9efa6559648dbb5a0f7684c4542d1 P e61c3a8f61bb48f8a963c9480e53c168 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:06:12.188194 19559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2725d2c4cb054f18b0fc8f735c15f6c2" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 15 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:06:12.188966 19559 raft_consensus.cc:2410] T 2725d2c4cb054f18b0fc8f735c15f6c2 P e61c3a8f61bb48f8a963c9480e53c168 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0473d2b2d01f4459b1e90fd12cc7840e for term 15 because replica has last-logged OpId of term: 13 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 4.
I20260709 13:06:12.188898 19551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed7fdbcb96d14d418db9ca90a792588a" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:06:12.187637 19480 raft_consensus.cc:1275] T 7f575b143b844aa096b50997dad3516a P 0473d2b2d01f4459b1e90fd12cc7840e [term 8 FOLLOWER]: Refusing update from remote peer e5256d91808b47c195bc9b4dbd7f2b87: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260709 13:06:12.189847 19559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cdf56e38bbc453d9438d359e5a69955" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:06:12.190726 19555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9f0d59553ad444883fcf5b5909f9798" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
W20260709 13:06:12.191303 23926 log.cc:927] Time spent T d1e5873a19244c5ebbcd38e126796ee7 P e61c3a8f61bb48f8a963c9480e53c168: Append to log took a long time: real 0.059s	user 0.000s	sys 0.000s
I20260709 13:06:12.191982 19553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21e14947d70440f19044d8f75c31e1f9" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:06:12.193147 19552 raft_consensus.cc:1240] T ef32ce6fdd0e40d382c79974f30295c6 P e61c3a8f61bb48f8a963c9480e53c168 [term 14 FOLLOWER]: Rejecting Update request from peer 0473d2b2d01f4459b1e90fd12cc7840e for earlier term 13. Current term is 14. Ops: []
I20260709 13:06:12.193348 23378 raft_consensus.cc:493] T 7f575b143b844aa096b50997dad3516a P 0473d2b2d01f4459b1e90fd12cc7840e [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:12.195235 19480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f85fc4b527a48848e5faa083b604e36" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:06:12.195353 19558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "217b5fae677b4971b3bbd2f357a1f7ff" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 10 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:06:12.191361 19555 raft_consensus.cc:3060] T b9f0d59553ad444883fcf5b5909f9798 P e61c3a8f61bb48f8a963c9480e53c168 [term 11 FOLLOWER]: Advancing to term 13
I20260709 13:06:12.196328 19486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c5eebf646ad445a9d1b1adc319d7b16" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:06:12.196837 19481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62c6c134d3d24a1ab144dd9ee6bc3f64" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:06:12.189936 19551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dc5b3532fe54f74876d02beffa2c230" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 13 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:06:12.198035 19481 raft_consensus.cc:2393] T 62c6c134d3d24a1ab144dd9ee6bc3f64 P 0473d2b2d01f4459b1e90fd12cc7840e [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 127766fc592545a4997f7790f50f6076 in current term 11: Already voted for candidate 0473d2b2d01f4459b1e90fd12cc7840e in this term.
I20260709 13:06:12.198343 19551 raft_consensus.cc:2410] T 1dc5b3532fe54f74876d02beffa2c230 P e61c3a8f61bb48f8a963c9480e53c168 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0473d2b2d01f4459b1e90fd12cc7840e for term 13 because replica has last-logged OpId of term: 10 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 4.
I20260709 13:06:12.127950 23795 consensus_queue.cc:1048] T 28af091831594f9d8e96482078cc7625 P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.050s
I20260709 13:06:12.197487 19482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "775c229504194560ba9589bc2199b089" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:06:12.209616 19482 raft_consensus.cc:2393] T 775c229504194560ba9589bc2199b089 P 0473d2b2d01f4459b1e90fd12cc7840e [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 127766fc592545a4997f7790f50f6076 in current term 10: Already voted for candidate 0473d2b2d01f4459b1e90fd12cc7840e in this term.
I20260709 13:06:12.162865 23823 raft_consensus.cc:2749] T 96efeaaf1057492490e9a621f37e1a2d P 0473d2b2d01f4459b1e90fd12cc7840e [term 13 FOLLOWER]: Leader election lost for term 12. Reason: Vote denied by peer e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891) with higher term. Message: Invalid argument: T 96efeaaf1057492490e9a621f37e1a2d P e61c3a8f61bb48f8a963c9480e53c168 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 0473d2b2d01f4459b1e90fd12cc7840e for earlier term 12. Current term is 13.
W20260709 13:06:12.174919 23874 consensus_meta.cc:287] T 0cdf56e38bbc453d9438d359e5a69955 P e61c3a8f61bb48f8a963c9480e53c168: Time spent flushing consensus metadata: real 0.644s	user 0.016s	sys 0.003s
I20260709 13:06:12.217170 19484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f85fc4b527a48848e5faa083b604e36" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:06:12.170396 23820 raft_consensus.cc:2804] T ff9b0eddd810459b82d91c60777c10eb P 0473d2b2d01f4459b1e90fd12cc7840e [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:06:12.160817 23819 raft_consensus.cc:515] T 1a61655d99124a29b486ba4a5b37faea P 0473d2b2d01f4459b1e90fd12cc7840e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:12.226011 19450 leader_election.cc:304] T 2725d2c4cb054f18b0fc8f735c15f6c2 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e; no voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:06:12.247779 19450 leader_election.cc:304] T ed7fdbcb96d14d418db9ca90a792588a P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e; no voters: 127766fc592545a4997f7790f50f6076, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:06:12.221669 20078 leader_election.cc:304] T 62c6c134d3d24a1ab144dd9ee6bc3f64 P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 127766fc592545a4997f7790f50f6076; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:06:12.249555 19554 raft_consensus.cc:2468] T 7be9efa6559648dbb5a0f7684c4542d1 P e61c3a8f61bb48f8a963c9480e53c168 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 13.
I20260709 13:06:12.194981 23911 raft_consensus.cc:2749] T 1efebf73c86e432baa55533136b6e12c P 127766fc592545a4997f7790f50f6076 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:06:12.248353 19559 raft_consensus.cc:2468] T 0cdf56e38bbc453d9438d359e5a69955 P e61c3a8f61bb48f8a963c9480e53c168 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 13.
I20260709 13:06:12.193857 23378 raft_consensus.cc:515] T 7f575b143b844aa096b50997dad3516a P 0473d2b2d01f4459b1e90fd12cc7840e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:12.273034 19560 raft_consensus.cc:1275] T a08760e15aac4630a629431f56024dc8 P e61c3a8f61bb48f8a963c9480e53c168 [term 14 FOLLOWER]: Refusing update from remote peer e5256d91808b47c195bc9b4dbd7f2b87: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 14 index: 8. (term mismatch)
I20260709 13:06:12.207746 23761 raft_consensus.cc:2804] T 48824d5acfbc485ebf8c2d944e7202de P 127766fc592545a4997f7790f50f6076 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:06:12.223682 23872 raft_consensus.cc:515] T 1f85fc4b527a48848e5faa083b604e36 P 0473d2b2d01f4459b1e90fd12cc7840e [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:12.286377 19480 raft_consensus.cc:3060] T 1f85fc4b527a48848e5faa083b604e36 P 0473d2b2d01f4459b1e90fd12cc7840e [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:06:12.287521 23872 leader_election.cc:290] T 1f85fc4b527a48848e5faa083b604e36 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 10 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:06:12.288177 23872 raft_consensus.cc:2749] T ed7fdbcb96d14d418db9ca90a792588a P 0473d2b2d01f4459b1e90fd12cc7840e [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:06:12.211592 23768 raft_consensus.cc:493] T 14935b3ddf914369822e4a0547aaa355 P e61c3a8f61bb48f8a963c9480e53c168 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 127766fc592545a4997f7790f50f6076)
I20260709 13:06:12.289191 23768 raft_consensus.cc:515] T 14935b3ddf914369822e4a0547aaa355 P e61c3a8f61bb48f8a963c9480e53c168 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } attrs { replace: true } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:12.292025 23768 leader_election.cc:290] T 14935b3ddf914369822e4a0547aaa355 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:06:12.223989 23775 leader_election.cc:290] T 40e1e16737a842ee936002830f36882e P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:06:12.275884 19551 raft_consensus.cc:1240] T 0afb57ae58a24a01850491d69f0213dd P e61c3a8f61bb48f8a963c9480e53c168 [term 11 FOLLOWER]: Rejecting Update request from peer 0473d2b2d01f4459b1e90fd12cc7840e for earlier term 10. Current term is 11. Ops: []
I20260709 13:06:12.277974 19554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40e1e16737a842ee936002830f36882e" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 16 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:06:12.168431 23927 consensus_queue.cc:1048] T 7be9efa6559648dbb5a0f7684c4542d1 P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Connected to new peer: Peer: permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 5, Time since last communication: 0.056s
I20260709 13:06:12.282114 19560 pending_rounds.cc:85] T a08760e15aac4630a629431f56024dc8 P e61c3a8f61bb48f8a963c9480e53c168: Aborting all ops after (but not including) 7
I20260709 13:06:12.296746 19560 pending_rounds.cc:107] T a08760e15aac4630a629431f56024dc8 P e61c3a8f61bb48f8a963c9480e53c168: Aborting uncommitted NO_OP operation due to leader change: 13.8
I20260709 13:06:12.297047 19560 raft_consensus.cc:2889] T a08760e15aac4630a629431f56024dc8 P e61c3a8f61bb48f8a963c9480e53c168 [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:06:12.207481 23818 consensus_queue.cc:1059] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P 127766fc592545a4997f7790f50f6076 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.067s
W20260709 13:06:12.298512 23923 log.cc:927] Time spent T 14efcc79969f41babe5529c22d59156d P 127766fc592545a4997f7790f50f6076: Append to log took a long time: real 0.130s	user 0.001s	sys 0.000s
I20260709 13:06:12.319402 23784 raft_consensus.cc:3055] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P 127766fc592545a4997f7790f50f6076 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:06:12.319916 23784 raft_consensus.cc:740] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P 127766fc592545a4997f7790f50f6076 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 127766fc592545a4997f7790f50f6076, State: Running, Role: LEADER
W20260709 13:06:12.320104 23908 log.cc:927] Time spent T 217b5fae677b4971b3bbd2f357a1f7ff P e61c3a8f61bb48f8a963c9480e53c168: Append to log took a long time: real 0.459s	user 0.002s	sys 0.000s
I20260709 13:06:12.321005 23784 consensus_queue.cc:260] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P 127766fc592545a4997f7790f50f6076 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
W20260709 13:06:12.318763 23836 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 14 current term: 14 is higher.
I20260709 13:06:12.323985 23819 leader_election.cc:290] T 1a61655d99124a29b486ba4a5b37faea P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:06:12.324380 23870 raft_consensus.cc:3055] T ef32ce6fdd0e40d382c79974f30295c6 P 0473d2b2d01f4459b1e90fd12cc7840e [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:06:12.280640 23663 raft_consensus.cc:2749] T 2725d2c4cb054f18b0fc8f735c15f6c2 P 0473d2b2d01f4459b1e90fd12cc7840e [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:06:12.326386 23761 raft_consensus.cc:697] T 48824d5acfbc485ebf8c2d944e7202de P 127766fc592545a4997f7790f50f6076 [term 13 LEADER]: Becoming Leader. State: Replica: 127766fc592545a4997f7790f50f6076, State: Running, Role: LEADER
I20260709 13:06:12.284061 23820 raft_consensus.cc:697] T ff9b0eddd810459b82d91c60777c10eb P 0473d2b2d01f4459b1e90fd12cc7840e [term 12 LEADER]: Becoming Leader. State: Replica: 0473d2b2d01f4459b1e90fd12cc7840e, State: Running, Role: LEADER
I20260709 13:06:12.316751 23638 raft_consensus.cc:3060] T 62c6c134d3d24a1ab144dd9ee6bc3f64 P 127766fc592545a4997f7790f50f6076 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:06:12.330471 19402 raft_consensus.cc:1240] T 2725d2c4cb054f18b0fc8f735c15f6c2 P e5256d91808b47c195bc9b4dbd7f2b87 [term 14 LEADER]: Rejecting Update request from peer e61c3a8f61bb48f8a963c9480e53c168 for earlier term 13. Current term is 14. Ops: []
I20260709 13:06:12.332679 19556 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40438 (request call id 2376) took 1113 ms. Trace:
I20260709 13:06:12.325611 23378 leader_election.cc:290] T 7f575b143b844aa096b50997dad3516a P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:06:12.345492 19480 raft_consensus.cc:2468] T 1f85fc4b527a48848e5faa083b604e36 P 0473d2b2d01f4459b1e90fd12cc7840e [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 127766fc592545a4997f7790f50f6076 in term 11.
I20260709 13:06:12.344295 19556 rpcz_store.cc:276] 0709 13:06:11.219164 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:11.221909 (+  2745us) service_pool.cc:224] Handling call
0709 13:06:11.222276 (+   367us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:11.344596 (+122320us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:06:11.357757 (+ 13161us) log.cc:844] Serialized 14 byte log entry
0709 13:06:11.736688 (+378931us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:11.739331 (+  2643us) log.cc:844] Serialized 26 byte log entry
0709 13:06:11.739477 (+   146us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:06:11.739511 (+    34us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:11.739572 (+    61us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:12.319808 (+580236us) spinlock_profiling.cc:243] Waited 2.97 ms on lock 0x7b240020d8d8. stack: 00007f4a79de9343 00007f4a79de9240 00007f4a797781d4 00007f4a834b6304 00007f4a834b6299 00007f4a79ca3db1 00007f4a79ca19c4 00007f4a79c9facb 00007f4a79e5adc9 00007f4a79e5aa55 00007f4a79e5a09d 00007f4a7ca8c10e 00007f4a7caa388c 00007f4a7caa2bb6 00007f4a7caa27d8 00007f4a7caac221
0709 13:06:12.332413 (+ 12605us) raft_consensus.cc:1685] finished
0709 13:06:12.332513 (+   100us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:12.332625 (+   112us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":19356,"prepare.queue_time_us":13488,"prepare.run_cpu_time_us":32,"prepare.run_wall_time_us":30,"raft.queue_time_us":26319,"raft.run_cpu_time_us":194,"raft.run_wall_time_us":4334,"spinlock_wait_cycles":6826752,"thread_start_us":460295,"threads_started":2,"wal-append.queue_time_us":438262}
I20260709 13:06:12.347535 19555 raft_consensus.cc:2468] T b9f0d59553ad444883fcf5b5909f9798 P e61c3a8f61bb48f8a963c9480e53c168 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 13.
W20260709 13:06:12.343052 23884 consensus_meta.cc:287] T 46c5bfeecc314717bffe987e6844b6d0 P e5256d91808b47c195bc9b4dbd7f2b87: Time spent flushing consensus metadata: real 0.601s	user 0.005s	sys 0.005s
I20260709 13:06:12.339686 23870 raft_consensus.cc:740] T ef32ce6fdd0e40d382c79974f30295c6 P 0473d2b2d01f4459b1e90fd12cc7840e [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 0473d2b2d01f4459b1e90fd12cc7840e, State: Running, Role: LEADER
I20260709 13:06:12.337836 23859 raft_consensus.cc:515] T df751f992649444090e27965eb1af85d P e61c3a8f61bb48f8a963c9480e53c168 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:12.348608 23784 raft_consensus.cc:3060] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P 127766fc592545a4997f7790f50f6076 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:06:12.387066 23820 consensus_queue.cc:237] T ff9b0eddd810459b82d91c60777c10eb P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:12.343570 23878 raft_consensus.cc:515] T 833a2f0775ed407a94b8924ce50adb63 P e5256d91808b47c195bc9b4dbd7f2b87 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:12.348798 23777 raft_consensus.cc:515] T 4509b76741dc428e9201c70c1658da13 P e5256d91808b47c195bc9b4dbd7f2b87 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:12.405979 19406 raft_consensus.cc:2368] T 833a2f0775ed407a94b8924ce50adb63 P e5256d91808b47c195bc9b4dbd7f2b87 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate e61c3a8f61bb48f8a963c9480e53c168 for earlier term 10. Current term is 11.
I20260709 13:06:12.396126 23859 leader_election.cc:290] T df751f992649444090e27965eb1af85d P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 14 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
W20260709 13:06:12.408520 19450 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.3:36891, user_credentials={real_user=slave}} blocked reactor thread for 160815us
I20260709 13:06:12.409365 19450 leader_election.cc:304] T 21e14947d70440f19044d8f75c31e1f9 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e; no voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:06:12.411139 23663 raft_consensus.cc:3060] T 21e14947d70440f19044d8f75c31e1f9 P 0473d2b2d01f4459b1e90fd12cc7840e [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:06:12.414966 23836 raft_consensus.cc:493] T 46c5bfeecc314717bffe987e6844b6d0 P e61c3a8f61bb48f8a963c9480e53c168 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader e5256d91808b47c195bc9b4dbd7f2b87)
I20260709 13:06:12.415421 19450 leader_election.cc:304] T 217b5fae677b4971b3bbd2f357a1f7ff P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e; no voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:06:12.415545 23836 raft_consensus.cc:515] T 46c5bfeecc314717bffe987e6844b6d0 P e61c3a8f61bb48f8a963c9480e53c168 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:12.416690 23928 raft_consensus.cc:2749] T 217b5fae677b4971b3bbd2f357a1f7ff P 0473d2b2d01f4459b1e90fd12cc7840e [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 13:06:12.420842 20078 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.2:46257, user_credentials={real_user=slave}} blocked reactor thread for 170971us
I20260709 13:06:12.422072 20078 leader_election.cc:304] T 6c5eebf646ad445a9d1b1adc319d7b16 P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 127766fc592545a4997f7790f50f6076; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:06:12.421845 23928 raft_consensus.cc:493] T edd7d470b5014c9489be7f41f64355c9 P 0473d2b2d01f4459b1e90fd12cc7840e [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:12.426730 23928 raft_consensus.cc:515] T edd7d470b5014c9489be7f41f64355c9 P 0473d2b2d01f4459b1e90fd12cc7840e [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:12.438217 23928 leader_election.cc:290] T edd7d470b5014c9489be7f41f64355c9 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:06:12.404215 23761 consensus_queue.cc:237] T 48824d5acfbc485ebf8c2d944e7202de P 127766fc592545a4997f7790f50f6076 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:12.405511 23870 consensus_queue.cc:260] T ef32ce6fdd0e40d382c79974f30295c6 P 0473d2b2d01f4459b1e90fd12cc7840e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:12.463755 23870 raft_consensus.cc:3060] T ef32ce6fdd0e40d382c79974f30295c6 P 0473d2b2d01f4459b1e90fd12cc7840e [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:06:12.465904 18300 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:06:12.431476 23818 raft_consensus.cc:2749] T 6c5eebf646ad445a9d1b1adc319d7b16 P 127766fc592545a4997f7790f50f6076 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:06:12.430832 23847 raft_consensus.cc:493] T 62c6c134d3d24a1ab144dd9ee6bc3f64 P 0473d2b2d01f4459b1e90fd12cc7840e [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:12.430465 23859 raft_consensus.cc:493] T 1a61655d99124a29b486ba4a5b37faea P e61c3a8f61bb48f8a963c9480e53c168 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:12.424028 23929 consensus_queue.cc:1059] T 0afb57ae58a24a01850491d69f0213dd P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.036s
I20260709 13:06:12.475288 23878 leader_election.cc:290] T 833a2f0775ed407a94b8924ce50adb63 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 11 election: Requested vote from peers e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:06:12.477151 23836 leader_election.cc:290] T 46c5bfeecc314717bffe987e6844b6d0 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:06:12.479063 23777 leader_election.cc:290] T 4509b76741dc428e9201c70c1658da13 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 7 election: Requested vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
W20260709 13:06:12.483512 23941 log.cc:927] Time spent T 4509b76741dc428e9201c70c1658da13 P e61c3a8f61bb48f8a963c9480e53c168: Append to log took a long time: real 0.053s	user 0.000s	sys 0.000s
W20260709 13:06:12.491261 19525 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:12.494697 20078 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.2:46257, user_credentials={real_user=slave}} blocked reactor thread for 71509.3us
I20260709 13:06:12.495689 20078 leader_election.cc:304] T 775c229504194560ba9589bc2199b089 P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 127766fc592545a4997f7790f50f6076; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:06:12.501012 20110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f85fc4b527a48848e5faa083b604e36" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076"
I20260709 13:06:12.500283 23807 raft_consensus.cc:3060] T 775c229504194560ba9589bc2199b089 P 127766fc592545a4997f7790f50f6076 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:06:12.501718 20110 raft_consensus.cc:2368] T 1f85fc4b527a48848e5faa083b604e36 P 127766fc592545a4997f7790f50f6076 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 0473d2b2d01f4459b1e90fd12cc7840e for earlier term 10. Current term is 11.
I20260709 13:06:12.503618 19449 leader_election.cc:400] T 1f85fc4b527a48848e5faa083b604e36 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 10 election: Vote denied by peer 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121) with higher term. Message: Invalid argument: T 1f85fc4b527a48848e5faa083b604e36 P 127766fc592545a4997f7790f50f6076 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 0473d2b2d01f4459b1e90fd12cc7840e for earlier term 10. Current term is 11.
I20260709 13:06:12.503903 19449 leader_election.cc:403] T 1f85fc4b527a48848e5faa083b604e36 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 10 election: Cancelling election due to peer responding with higher term
I20260709 13:06:12.501747 20104 raft_consensus.cc:2955] T 7be9efa6559648dbb5a0f7684c4542d1 P 127766fc592545a4997f7790f50f6076 [term 13 FOLLOWER]: Committing config change with OpId 7.6: config changed from index 4 to 6, 127766fc592545a4997f7790f50f6076 (127.17.223.4) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } attrs { replace: true } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } } }
I20260709 13:06:12.508127 23836 raft_consensus.cc:493] T 7f575b143b844aa096b50997dad3516a P e61c3a8f61bb48f8a963c9480e53c168 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:12.508661 23836 raft_consensus.cc:515] T 7f575b143b844aa096b50997dad3516a P e61c3a8f61bb48f8a963c9480e53c168 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:12.487169 23859 raft_consensus.cc:515] T 1a61655d99124a29b486ba4a5b37faea P e61c3a8f61bb48f8a963c9480e53c168 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:12.473950 23847 raft_consensus.cc:515] T 62c6c134d3d24a1ab144dd9ee6bc3f64 P 0473d2b2d01f4459b1e90fd12cc7840e [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:12.514873 23942 raft_consensus.cc:2749] T 1f85fc4b527a48848e5faa083b604e36 P 0473d2b2d01f4459b1e90fd12cc7840e [term 11 FOLLOWER]: Leader election lost for term 10. Reason: Vote denied by peer 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121) with higher term. Message: Invalid argument: T 1f85fc4b527a48848e5faa083b604e36 P 127766fc592545a4997f7790f50f6076 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 0473d2b2d01f4459b1e90fd12cc7840e for earlier term 10. Current term is 11.
I20260709 13:06:12.527094 23836 leader_election.cc:290] T 7f575b143b844aa096b50997dad3516a P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
W20260709 13:06:12.544226 19526 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:12.544768 19482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14935b3ddf914369822e4a0547aaa355" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:06:12.546195 19481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df751f992649444090e27965eb1af85d" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:06:12.547679 19484 raft_consensus.cc:1240] T 48824d5acfbc485ebf8c2d944e7202de P 0473d2b2d01f4459b1e90fd12cc7840e [term 13 FOLLOWER]: Rejecting Update request from peer e61c3a8f61bb48f8a963c9480e53c168 for earlier term 12. Current term is 13. Ops: [12.10-12.10]
W20260709 13:06:12.467701 23538 consensus_queue.cc:1175] T ef32ce6fdd0e40d382c79974f30295c6 P 0473d2b2d01f4459b1e90fd12cc7840e [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "e61c3a8f61bb48f8a963c9480e53c168" responder_term: 14 status { last_received { term: 12 index: 7 } last_committed_idx: 7 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer 0473d2b2d01f4459b1e90fd12cc7840e for earlier term 13. Current term is 14. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 13:06:12.532297 23859 leader_election.cc:290] T 1a61655d99124a29b486ba4a5b37faea P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:06:12.535600 23663 raft_consensus.cc:2749] T 21e14947d70440f19044d8f75c31e1f9 P 0473d2b2d01f4459b1e90fd12cc7840e [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:06:12.516757 23807 raft_consensus.cc:2749] T 775c229504194560ba9589bc2199b089 P 127766fc592545a4997f7790f50f6076 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:06:12.543020 23847 leader_election.cc:290] T 62c6c134d3d24a1ab144dd9ee6bc3f64 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:06:12.543536 19479 raft_consensus.cc:1240] T a08760e15aac4630a629431f56024dc8 P 0473d2b2d01f4459b1e90fd12cc7840e [term 14 FOLLOWER]: Rejecting Update request from peer e61c3a8f61bb48f8a963c9480e53c168 for earlier term 13. Current term is 14. Ops: [11.7-13.8]
I20260709 13:06:12.543619 19478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab43d85f64114d4ebf618930e43d9ed0" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 13 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:06:12.559157 19478 raft_consensus.cc:2468] T ab43d85f64114d4ebf618930e43d9ed0 P 0473d2b2d01f4459b1e90fd12cc7840e [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 12.
I20260709 13:06:12.559432 19477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46c5bfeecc314717bffe987e6844b6d0" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 17 candidate_status { last_received { term: 16 index: 7 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:06:12.550318 19483 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "22196caba61445d3bec98a0aab3c337d"
dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
mode: GRACEFUL
new_leader_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
 from {username='slave'} at 127.0.0.1:48168
I20260709 13:06:12.560462 19477 raft_consensus.cc:2393] T 46c5bfeecc314717bffe987e6844b6d0 P 0473d2b2d01f4459b1e90fd12cc7840e [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e61c3a8f61bb48f8a963c9480e53c168 in current term 17: Already voted for candidate 0473d2b2d01f4459b1e90fd12cc7840e in this term.
I20260709 13:06:12.560797 19483 raft_consensus.cc:606] T 22196caba61445d3bec98a0aab3c337d P 0473d2b2d01f4459b1e90fd12cc7840e [term 9 LEADER]: Received request to transfer leadership to TS e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:06:12.561290 19484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f575b143b844aa096b50997dad3516a" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:06:12.552359 19482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a61655d99124a29b486ba4a5b37faea" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:06:12.562678 19482 raft_consensus.cc:2468] T 1a61655d99124a29b486ba4a5b37faea P 0473d2b2d01f4459b1e90fd12cc7840e [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 8.
W20260709 13:06:12.555423 19451 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:12.559237 23893 consensus_queue.cc:260] T 48824d5acfbc485ebf8c2d944e7202de P e61c3a8f61bb48f8a963c9480e53c168 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:12.565125 23859 consensus_queue.cc:1059] T 48824d5acfbc485ebf8c2d944e7202de P e61c3a8f61bb48f8a963c9480e53c168 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:06:12.562053 19484 raft_consensus.cc:2468] T 7f575b143b844aa096b50997dad3516a P 0473d2b2d01f4459b1e90fd12cc7840e [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 8.
I20260709 13:06:12.567029 19481 raft_consensus.cc:2468] T df751f992649444090e27965eb1af85d P 0473d2b2d01f4459b1e90fd12cc7840e [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 14.
I20260709 13:06:12.567538 19477 raft_consensus.cc:1240] T 21e14947d70440f19044d8f75c31e1f9 P 0473d2b2d01f4459b1e90fd12cc7840e [term 12 FOLLOWER]: Rejecting Update request from peer e61c3a8f61bb48f8a963c9480e53c168 for earlier term 11. Current term is 12. Ops: []
I20260709 13:06:12.569531 19526 leader_election.cc:304] T ab43d85f64114d4ebf618930e43d9ed0 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, 127766fc592545a4997f7790f50f6076, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:06:12.573488 19526 leader_election.cc:304] T 1a61655d99124a29b486ba4a5b37faea P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:06:12.573906 23836 raft_consensus.cc:2804] T ab43d85f64114d4ebf618930e43d9ed0 P e61c3a8f61bb48f8a963c9480e53c168 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:06:12.579493 20108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62c6c134d3d24a1ab144dd9ee6bc3f64" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:06:12.583777 23692 raft_consensus.cc:493] T fa731b585f684a7fb2d106c50f143b83 P e5256d91808b47c195bc9b4dbd7f2b87 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 127766fc592545a4997f7790f50f6076)
I20260709 13:06:12.583932 23859 consensus_queue.cc:1059] T 65d8cb8d6ec64f459d5a47cefab10acf P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:06:12.584374 23692 raft_consensus.cc:515] T fa731b585f684a7fb2d106c50f143b83 P e5256d91808b47c195bc9b4dbd7f2b87 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:12.584797 23859 raft_consensus.cc:3055] T 65d8cb8d6ec64f459d5a47cefab10acf P e61c3a8f61bb48f8a963c9480e53c168 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:06:12.585163 23859 raft_consensus.cc:740] T 65d8cb8d6ec64f459d5a47cefab10acf P e61c3a8f61bb48f8a963c9480e53c168 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: e61c3a8f61bb48f8a963c9480e53c168, State: Running, Role: LEADER
I20260709 13:06:12.585937 23859 consensus_queue.cc:260] T 65d8cb8d6ec64f459d5a47cefab10acf P e61c3a8f61bb48f8a963c9480e53c168 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.8, Last appended by leader: 8, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:12.586853 23883 raft_consensus.cc:493] T 309c3ca0ca4b4f3ba129752ea2cb293b P e5256d91808b47c195bc9b4dbd7f2b87 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 127766fc592545a4997f7790f50f6076)
I20260709 13:06:12.587435 23883 raft_consensus.cc:515] T 309c3ca0ca4b4f3ba129752ea2cb293b P e5256d91808b47c195bc9b4dbd7f2b87 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } attrs { replace: true } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:12.580917 23836 raft_consensus.cc:493] T ab43d85f64114d4ebf618930e43d9ed0 P e61c3a8f61bb48f8a963c9480e53c168 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:12.576706 23768 raft_consensus.cc:2804] T 1a61655d99124a29b486ba4a5b37faea P e61c3a8f61bb48f8a963c9480e53c168 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:06:12.589640 23859 raft_consensus.cc:3060] T 65d8cb8d6ec64f459d5a47cefab10acf P e61c3a8f61bb48f8a963c9480e53c168 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:06:12.589985 23768 raft_consensus.cc:493] T 1a61655d99124a29b486ba4a5b37faea P e61c3a8f61bb48f8a963c9480e53c168 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:12.590409 23768 raft_consensus.cc:3060] T 1a61655d99124a29b486ba4a5b37faea P e61c3a8f61bb48f8a963c9480e53c168 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:06:12.591068 19478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4509b76741dc428e9201c70c1658da13" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:06:12.591816 23492 leader_election.cc:290] T 1f85fc4b527a48848e5faa083b604e36 P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 11 election: Requested vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321)
I20260709 13:06:12.588992 19482 raft_consensus.cc:1275] T edd7d470b5014c9489be7f41f64355c9 P 0473d2b2d01f4459b1e90fd12cc7840e [term 12 FOLLOWER]: Refusing update from remote peer e5256d91808b47c195bc9b4dbd7f2b87: Log matching property violated. Preceding OpId in replica: term: 11 index: 5. Preceding OpId from leader: term: 12 index: 6. (index mismatch)
I20260709 13:06:12.595626 23833 raft_consensus.cc:493] T 3e1f505cb0f1427bbd698ac889d80821 P e5256d91808b47c195bc9b4dbd7f2b87 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:12.596141 23833 raft_consensus.cc:515] T 3e1f505cb0f1427bbd698ac889d80821 P e5256d91808b47c195bc9b4dbd7f2b87 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:12.596604 20109 raft_consensus.cc:1240] T 48824d5acfbc485ebf8c2d944e7202de P 127766fc592545a4997f7790f50f6076 [term 13 LEADER]: Rejecting Update request from peer e61c3a8f61bb48f8a963c9480e53c168 for earlier term 12. Current term is 13. Ops: [12.10-12.10]
I20260709 13:06:12.596966 20106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14935b3ddf914369822e4a0547aaa355" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:06:12.598062 23833 leader_election.cc:290] T 3e1f505cb0f1427bbd698ac889d80821 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:06:12.599583 23918 consensus_queue.cc:1048] T 217b5fae677b4971b3bbd2f357a1f7ff P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:06:12.601135 19523 leader_election.cc:304] T 14935b3ddf914369822e4a0547aaa355 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: e61c3a8f61bb48f8a963c9480e53c168; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, 127766fc592545a4997f7790f50f6076
I20260709 13:06:12.602345 23505 raft_consensus.cc:2749] T 14935b3ddf914369822e4a0547aaa355 P e61c3a8f61bb48f8a963c9480e53c168 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:06:12.601086 23918 consensus_queue.cc:1059] T 775c229504194560ba9589bc2199b089 P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:06:12.603533 23920 raft_consensus.cc:3055] T 775c229504194560ba9589bc2199b089 P e5256d91808b47c195bc9b4dbd7f2b87 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:06:12.603875 23920 raft_consensus.cc:740] T 775c229504194560ba9589bc2199b089 P e5256d91808b47c195bc9b4dbd7f2b87 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: e5256d91808b47c195bc9b4dbd7f2b87, State: Running, Role: LEADER
I20260709 13:06:12.575938 23890 raft_consensus.cc:3055] T 2b74109013a140ada21feeef92d6f563 P 0473d2b2d01f4459b1e90fd12cc7840e [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:06:12.604503 23890 raft_consensus.cc:740] T 2b74109013a140ada21feeef92d6f563 P 0473d2b2d01f4459b1e90fd12cc7840e [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 0473d2b2d01f4459b1e90fd12cc7840e, State: Running, Role: LEADER
I20260709 13:06:12.604592 23920 consensus_queue.cc:260] T 775c229504194560ba9589bc2199b089 P e5256d91808b47c195bc9b4dbd7f2b87 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:12.605377 23890 consensus_queue.cc:260] T 2b74109013a140ada21feeef92d6f563 P 0473d2b2d01f4459b1e90fd12cc7840e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:12.606317 23890 raft_consensus.cc:3060] T 2b74109013a140ada21feeef92d6f563 P 0473d2b2d01f4459b1e90fd12cc7840e [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:06:12.589516 23836 raft_consensus.cc:3060] T ab43d85f64114d4ebf618930e43d9ed0 P e61c3a8f61bb48f8a963c9480e53c168 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:06:12.613529 19436 heartbeater.cc:646] Failed to heartbeat to 127.17.223.62:36283 (2 consecutive failures): Timed out: Failed to send heartbeat to master: TSHeartbeat RPC to 127.17.223.62:36283 timed out after 15.000s (SENT)
I20260709 13:06:12.616206 19409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff9b0eddd810459b82d91c60777c10eb" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
I20260709 13:06:12.617018 19409 raft_consensus.cc:2393] T ff9b0eddd810459b82d91c60777c10eb P e5256d91808b47c195bc9b4dbd7f2b87 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 0473d2b2d01f4459b1e90fd12cc7840e in current term 12: Already voted for candidate e5256d91808b47c195bc9b4dbd7f2b87 in this term.
I20260709 13:06:12.617633 19408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dc5b3532fe54f74876d02beffa2c230" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 13 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:06:12.618923 19411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "775c229504194560ba9589bc2199b089" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
I20260709 13:06:12.598098 20112 raft_consensus.cc:1275] T 96efeaaf1057492490e9a621f37e1a2d P 127766fc592545a4997f7790f50f6076 [term 13 FOLLOWER]: Refusing update from remote peer e61c3a8f61bb48f8a963c9480e53c168: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 13:06:12.622401 23919 raft_consensus.cc:493] T 28af091831594f9d8e96482078cc7625 P e5256d91808b47c195bc9b4dbd7f2b87 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 0473d2b2d01f4459b1e90fd12cc7840e)
W20260709 13:06:12.623389 19375 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.3:36891, user_credentials={real_user=slave}} blocked reactor thread for 693548us
I20260709 13:06:12.629627 19556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4509b76741dc428e9201c70c1658da13" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:06:12.629925 19409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab43d85f64114d4ebf618930e43d9ed0" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 13 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:06:12.630774 19557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "309c3ca0ca4b4f3ba129752ea2cb293b" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:06:12.631453 19558 pending_rounds.cc:85] T 2725d2c4cb054f18b0fc8f735c15f6c2 P e61c3a8f61bb48f8a963c9480e53c168: Aborting all ops after (but not including) 5
I20260709 13:06:12.631546 19408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14935b3ddf914369822e4a0547aaa355" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:06:12.632054 19558 pending_rounds.cc:107] T 2725d2c4cb054f18b0fc8f735c15f6c2 P e61c3a8f61bb48f8a963c9480e53c168: Aborting uncommitted NO_OP operation due to leader change: 13.6
I20260709 13:06:12.631789 19560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa731b585f684a7fb2d106c50f143b83" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:06:12.632429 19558 raft_consensus.cc:2889] T 2725d2c4cb054f18b0fc8f735c15f6c2 P e61c3a8f61bb48f8a963c9480e53c168 [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:06:12.633323 19408 raft_consensus.cc:1240] T 65d8cb8d6ec64f459d5a47cefab10acf P e5256d91808b47c195bc9b4dbd7f2b87 [term 11 LEADER]: Rejecting Update request from peer e61c3a8f61bb48f8a963c9480e53c168 for earlier term 10. Current term is 11. Ops: []
I20260709 13:06:12.635562 19408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df751f992649444090e27965eb1af85d" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
I20260709 13:06:12.636288 19408 raft_consensus.cc:2393] T df751f992649444090e27965eb1af85d P e5256d91808b47c195bc9b4dbd7f2b87 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate e61c3a8f61bb48f8a963c9480e53c168 in current term 14: Already voted for candidate e5256d91808b47c195bc9b4dbd7f2b87 in this term.
I20260709 13:06:12.637064 19410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46c5bfeecc314717bffe987e6844b6d0" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 17 candidate_status { last_received { term: 16 index: 7 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:06:12.638034 19404 raft_consensus.cc:1240] T 21e14947d70440f19044d8f75c31e1f9 P e5256d91808b47c195bc9b4dbd7f2b87 [term 12 FOLLOWER]: Rejecting Update request from peer e61c3a8f61bb48f8a963c9480e53c168 for earlier term 11. Current term is 12. Ops: [11.7-11.7]
I20260709 13:06:12.638302 19410 raft_consensus.cc:2468] T 46c5bfeecc314717bffe987e6844b6d0 P e5256d91808b47c195bc9b4dbd7f2b87 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 17.
I20260709 13:06:12.630467 19409 raft_consensus.cc:2468] T ab43d85f64114d4ebf618930e43d9ed0 P e5256d91808b47c195bc9b4dbd7f2b87 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 12.
I20260709 13:06:12.638974 19560 raft_consensus.cc:1275] T edd7d470b5014c9489be7f41f64355c9 P e61c3a8f61bb48f8a963c9480e53c168 [term 12 FOLLOWER]: Refusing update from remote peer e5256d91808b47c195bc9b4dbd7f2b87: Log matching property violated. Preceding OpId in replica: term: 11 index: 5. Preceding OpId from leader: term: 12 index: 6. (index mismatch)
I20260709 13:06:12.640692 19556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e1f505cb0f1427bbd698ac889d80821" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:06:12.643841 19408 raft_consensus.cc:1240] T ef32ce6fdd0e40d382c79974f30295c6 P e5256d91808b47c195bc9b4dbd7f2b87 [term 14 FOLLOWER]: Rejecting Update request from peer 0473d2b2d01f4459b1e90fd12cc7840e for earlier term 13. Current term is 14. Ops: [13.8-13.8]
I20260709 13:06:12.643990 19556 raft_consensus.cc:2410] T 3e1f505cb0f1427bbd698ac889d80821 P e61c3a8f61bb48f8a963c9480e53c168 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e5256d91808b47c195bc9b4dbd7f2b87 for term 13 because replica has last-logged OpId of term: 11 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 6.
I20260709 13:06:12.645628 19555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "833a2f0775ed407a94b8924ce50adb63" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:06:12.646342 19555 raft_consensus.cc:3060] T 833a2f0775ed407a94b8924ce50adb63 P e61c3a8f61bb48f8a963c9480e53c168 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:06:12.649822 19403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cdf56e38bbc453d9438d359e5a69955" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:06:12.650630 19403 raft_consensus.cc:2468] T 0cdf56e38bbc453d9438d359e5a69955 P e5256d91808b47c195bc9b4dbd7f2b87 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 13.
I20260709 13:06:12.642243 23605 raft_consensus.cc:493] T f1b10566f45d4a7d9029858330e02d5b P e5256d91808b47c195bc9b4dbd7f2b87 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader e61c3a8f61bb48f8a963c9480e53c168)
I20260709 13:06:12.622983 23919 raft_consensus.cc:515] T 28af091831594f9d8e96482078cc7625 P e5256d91808b47c195bc9b4dbd7f2b87 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:12.654901 23605 raft_consensus.cc:515] T f1b10566f45d4a7d9029858330e02d5b P e5256d91808b47c195bc9b4dbd7f2b87 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:12.598591 23833 consensus_queue.cc:1048] T a08760e15aac4630a629431f56024dc8 P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.054s
I20260709 13:06:12.656864 23919 leader_election.cc:290] T 28af091831594f9d8e96482078cc7625 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:06:12.640533 23465 raft_consensus.cc:493] T ff9b0eddd810459b82d91c60777c10eb P e5256d91808b47c195bc9b4dbd7f2b87 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:12.621850 23883 leader_election.cc:290] T 309c3ca0ca4b4f3ba129752ea2cb293b P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:06:12.657562 23465 raft_consensus.cc:515] T ff9b0eddd810459b82d91c60777c10eb P e5256d91808b47c195bc9b4dbd7f2b87 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:12.651917 23854 consensus_queue.cc:1048] T 7f575b143b844aa096b50997dad3516a P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.010s
I20260709 13:06:12.659123 19482 raft_consensus.cc:1275] T 179fd671030940b4b4a4e24bcc4aba0a P 0473d2b2d01f4459b1e90fd12cc7840e [term 13 FOLLOWER]: Refusing update from remote peer e61c3a8f61bb48f8a963c9480e53c168: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:06:12.659629 23465 leader_election.cc:290] T ff9b0eddd810459b82d91c60777c10eb P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:06:12.661582 19409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f85fc4b527a48848e5faa083b604e36" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
I20260709 13:06:12.662349 19409 raft_consensus.cc:2393] T 1f85fc4b527a48848e5faa083b604e36 P e5256d91808b47c195bc9b4dbd7f2b87 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 0473d2b2d01f4459b1e90fd12cc7840e in current term 10: Already voted for candidate e5256d91808b47c195bc9b4dbd7f2b87 in this term.
I20260709 13:06:12.663096 19409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edd7d470b5014c9489be7f41f64355c9" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 13 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:06:12.664134 19410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a61655d99124a29b486ba4a5b37faea" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:06:12.666183 19555 raft_consensus.cc:2468] T 833a2f0775ed407a94b8924ce50adb63 P e61c3a8f61bb48f8a963c9480e53c168 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 11.
I20260709 13:06:12.657040 23605 leader_election.cc:290] T f1b10566f45d4a7d9029858330e02d5b P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:06:12.666972 19403 raft_consensus.cc:1240] T 4509b76741dc428e9201c70c1658da13 P e5256d91808b47c195bc9b4dbd7f2b87 [term 7 FOLLOWER]: Rejecting Update request from peer 0473d2b2d01f4459b1e90fd12cc7840e for earlier term 6. Current term is 7. Ops: []
I20260709 13:06:12.668701 19408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40e1e16737a842ee936002830f36882e" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 16 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:06:12.670085 19403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f575b143b844aa096b50997dad3516a" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:06:12.670945 19404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f575b143b844aa096b50997dad3516a" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:06:12.671888 19407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a61655d99124a29b486ba4a5b37faea" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:06:12.677021 19555 raft_consensus.cc:1275] T b9f0d59553ad444883fcf5b5909f9798 P e61c3a8f61bb48f8a963c9480e53c168 [term 13 FOLLOWER]: Refusing update from remote peer 0473d2b2d01f4459b1e90fd12cc7840e: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:06:12.678079 19449 leader_election.cc:304] T 1dc5b3532fe54f74876d02beffa2c230 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e; no voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:06:12.685573 19560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edd7d470b5014c9489be7f41f64355c9" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 13 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:06:12.687947 19556 raft_consensus.cc:1240] T 2b74109013a140ada21feeef92d6f563 P e61c3a8f61bb48f8a963c9480e53c168 [term 9 FOLLOWER]: Rejecting Update request from peer 0473d2b2d01f4459b1e90fd12cc7840e for earlier term 8. Current term is 9. Ops: [8.6-8.6]
I20260709 13:06:12.687937 19557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62c6c134d3d24a1ab144dd9ee6bc3f64" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:06:12.690114 19557 raft_consensus.cc:1275] T 7be9efa6559648dbb5a0f7684c4542d1 P e61c3a8f61bb48f8a963c9480e53c168 [term 13 FOLLOWER]: Refusing update from remote peer 0473d2b2d01f4459b1e90fd12cc7840e: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 13:06:12.701916 23859 raft_consensus.cc:493] T b08304a0a02b42d7840c4e8ee9a6bd1a P e61c3a8f61bb48f8a963c9480e53c168 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 0473d2b2d01f4459b1e90fd12cc7840e)
I20260709 13:06:12.702787 23859 raft_consensus.cc:515] T b08304a0a02b42d7840c4e8ee9a6bd1a P e61c3a8f61bb48f8a963c9480e53c168 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:12.686445 19560 raft_consensus.cc:2468] T edd7d470b5014c9489be7f41f64355c9 P e61c3a8f61bb48f8a963c9480e53c168 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 12.
W20260709 13:06:12.706478 19377 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.2:46257, user_credentials={real_user=slave}} blocked reactor thread for 119974us
I20260709 13:06:12.707746 23505 raft_consensus.cc:493] T 86a6797bdfe94fa496c050ceae4bd0d9 P e61c3a8f61bb48f8a963c9480e53c168 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 0473d2b2d01f4459b1e90fd12cc7840e)
I20260709 13:06:12.708333 23505 raft_consensus.cc:515] T 86a6797bdfe94fa496c050ceae4bd0d9 P e61c3a8f61bb48f8a963c9480e53c168 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:12.710503 23505 leader_election.cc:290] T 86a6797bdfe94fa496c050ceae4bd0d9 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:06:12.644986 23638 raft_consensus.cc:2749] T 62c6c134d3d24a1ab144dd9ee6bc3f64 P 127766fc592545a4997f7790f50f6076 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:06:12.728303 19555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a61655d99124a29b486ba4a5b37faea" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
W20260709 13:06:12.734234 19452 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:12.728973 19554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f575b143b844aa096b50997dad3516a" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:06:12.730748 23836 raft_consensus.cc:515] T ab43d85f64114d4ebf618930e43d9ed0 P e61c3a8f61bb48f8a963c9480e53c168 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } attrs { replace: true } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
W20260709 13:06:12.731734 23932 log.cc:927] Time spent T 179fd671030940b4b4a4e24bcc4aba0a P e61c3a8f61bb48f8a963c9480e53c168: Append to log took a long time: real 0.348s	user 0.003s	sys 0.000s
I20260709 13:06:12.735133 19554 raft_consensus.cc:2468] T 7f575b143b844aa096b50997dad3516a P e61c3a8f61bb48f8a963c9480e53c168 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 8.
I20260709 13:06:12.733238 19556 raft_consensus.cc:1275] T 6c5eebf646ad445a9d1b1adc319d7b16 P e61c3a8f61bb48f8a963c9480e53c168 [term 10 FOLLOWER]: Refusing update from remote peer 0473d2b2d01f4459b1e90fd12cc7840e: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:06:12.737181 19449 leader_election.cc:304] T 0cdf56e38bbc453d9438d359e5a69955 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87; no voters: 
I20260709 13:06:12.738806 19555 raft_consensus.cc:1240] T 0afb57ae58a24a01850491d69f0213dd P e61c3a8f61bb48f8a963c9480e53c168 [term 11 FOLLOWER]: Rejecting Update request from peer 0473d2b2d01f4459b1e90fd12cc7840e for earlier term 10. Current term is 11. Ops: []
I20260709 13:06:12.741195 19377 leader_election.cc:304] T 2b74109013a140ada21feeef92d6f563 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:06:12.741925 23505 raft_consensus.cc:493] T 2e36a9d6e29c4a7c860cf267efbd4c74 P e61c3a8f61bb48f8a963c9480e53c168 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:12.742143 23884 consensus_queue.cc:1048] T edd7d470b5014c9489be7f41f64355c9 P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:06:12.742432 23505 raft_consensus.cc:515] T 2e36a9d6e29c4a7c860cf267efbd4c74 P e61c3a8f61bb48f8a963c9480e53c168 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:12.743527 23884 consensus_queue.cc:1048] T 2725d2c4cb054f18b0fc8f735c15f6c2 P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:06:12.744692 23505 leader_election.cc:290] T 2e36a9d6e29c4a7c860cf267efbd4c74 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:06:12.745051 23918 consensus_queue.cc:1048] T 1dc5b3532fe54f74876d02beffa2c230 P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:06:12.745235 23884 consensus_queue.cc:1048] T 40e1e16737a842ee936002830f36882e P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:06:12.748410 19375 leader_election.cc:304] T 833a2f0775ed407a94b8924ce50adb63 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:06:12.750425 23854 raft_consensus.cc:2804] T 833a2f0775ed407a94b8924ce50adb63 P e5256d91808b47c195bc9b4dbd7f2b87 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:06:12.750916 23854 raft_consensus.cc:697] T 833a2f0775ed407a94b8924ce50adb63 P e5256d91808b47c195bc9b4dbd7f2b87 [term 11 LEADER]: Becoming Leader. State: Replica: e5256d91808b47c195bc9b4dbd7f2b87, State: Running, Role: LEADER
I20260709 13:06:12.751791 23854 consensus_queue.cc:237] T 833a2f0775ed407a94b8924ce50adb63 P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:12.752650 19551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1b10566f45d4a7d9029858330e02d5b" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:06:12.753280 19551 raft_consensus.cc:2468] T f1b10566f45d4a7d9029858330e02d5b P e61c3a8f61bb48f8a963c9480e53c168 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 13.
I20260709 13:06:12.755615 19523 leader_election.cc:304] T 46c5bfeecc314717bffe987e6844b6d0 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168; no voters: 0473d2b2d01f4459b1e90fd12cc7840e
I20260709 13:06:12.756690 20108 raft_consensus.cc:2468] T 62c6c134d3d24a1ab144dd9ee6bc3f64 P 127766fc592545a4997f7790f50f6076 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 11.
I20260709 13:06:12.756906 19557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28af091831594f9d8e96482078cc7625" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:06:12.760890 19405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86a6797bdfe94fa496c050ceae4bd0d9" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:06:12.761269 19407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e36a9d6e29c4a7c860cf267efbd4c74" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:06:12.761826 19407 raft_consensus.cc:2468] T 2e36a9d6e29c4a7c860cf267efbd4c74 P e5256d91808b47c195bc9b4dbd7f2b87 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 9.
I20260709 13:06:12.761396 19375 leader_election.cc:304] T f1b10566f45d4a7d9029858330e02d5b P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
W20260709 13:06:12.765865 19525 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:12.771263 23870 consensus_queue.cc:1059] T 4509b76741dc428e9201c70c1658da13 P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:06:12.772174 23870 consensus_queue.cc:1048] T 7be9efa6559648dbb5a0f7684c4542d1 P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:06:12.773756 23713 raft_consensus.cc:2804] T 46c5bfeecc314717bffe987e6844b6d0 P e61c3a8f61bb48f8a963c9480e53c168 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:06:12.774096 23870 raft_consensus.cc:3055] T 4509b76741dc428e9201c70c1658da13 P 0473d2b2d01f4459b1e90fd12cc7840e [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:06:12.774327 23713 raft_consensus.cc:493] T 46c5bfeecc314717bffe987e6844b6d0 P e61c3a8f61bb48f8a963c9480e53c168 [term 16 FOLLOWER]: Starting leader election (detected failure of leader e5256d91808b47c195bc9b4dbd7f2b87)
I20260709 13:06:12.774946 23713 raft_consensus.cc:3060] T 46c5bfeecc314717bffe987e6844b6d0 P e61c3a8f61bb48f8a963c9480e53c168 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:06:12.776842 19402 raft_consensus.cc:1275] T 179fd671030940b4b4a4e24bcc4aba0a P e5256d91808b47c195bc9b4dbd7f2b87 [term 13 FOLLOWER]: Refusing update from remote peer e61c3a8f61bb48f8a963c9480e53c168: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:06:12.765998 19450 leader_election.cc:304] T edd7d470b5014c9489be7f41f64355c9 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168; no voters: e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:06:12.757743 19557 raft_consensus.cc:2468] T 28af091831594f9d8e96482078cc7625 P e61c3a8f61bb48f8a963c9480e53c168 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 12.
I20260709 13:06:12.781777 19450 leader_election.cc:304] T 1a61655d99124a29b486ba4a5b37faea P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e; no voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:06:12.765394 19449 leader_election.cc:304] T 40e1e16737a842ee936002830f36882e P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e; no voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:06:12.786105 19526 leader_election.cc:304] T 7f575b143b844aa096b50997dad3516a P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168; no voters: e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:06:12.787523 19405 raft_consensus.cc:1275] T b9f0d59553ad444883fcf5b5909f9798 P e5256d91808b47c195bc9b4dbd7f2b87 [term 13 FOLLOWER]: Refusing update from remote peer 0473d2b2d01f4459b1e90fd12cc7840e: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:06:12.788241 19404 raft_consensus.cc:1240] T 4509b76741dc428e9201c70c1658da13 P e5256d91808b47c195bc9b4dbd7f2b87 [term 7 FOLLOWER]: Rejecting Update request from peer 0473d2b2d01f4459b1e90fd12cc7840e for earlier term 6. Current term is 7. Ops: []
I20260709 13:06:12.739599 23928 raft_consensus.cc:493] T 3e1f505cb0f1427bbd698ac889d80821 P 0473d2b2d01f4459b1e90fd12cc7840e [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:12.797785 23928 raft_consensus.cc:515] T 3e1f505cb0f1427bbd698ac889d80821 P 0473d2b2d01f4459b1e90fd12cc7840e [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:12.799782 23928 leader_election.cc:290] T 3e1f505cb0f1427bbd698ac889d80821 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:06:12.735988 23824 raft_consensus.cc:2749] T 1dc5b3532fe54f74876d02beffa2c230 P 0473d2b2d01f4459b1e90fd12cc7840e [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:06:12.792505 19450 leader_election.cc:304] T 7f575b143b844aa096b50997dad3516a P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168; no voters: e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:06:12.804008 20104 raft_consensus.cc:1275] T 6c5eebf646ad445a9d1b1adc319d7b16 P 127766fc592545a4997f7790f50f6076 [term 10 FOLLOWER]: Refusing update from remote peer 0473d2b2d01f4459b1e90fd12cc7840e: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:06:12.789878 19523 leader_election.cc:304] T 2e36a9d6e29c4a7c860cf267efbd4c74 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:06:12.793707 19483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86a6797bdfe94fa496c050ceae4bd0d9" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:06:12.704051 23619 consensus_queue.cc:1048] T a08760e15aac4630a629431f56024dc8 P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.081s
I20260709 13:06:12.795403 19478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e36a9d6e29c4a7c860cf267efbd4c74" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:06:12.797232 23945 raft_consensus.cc:2749] T 1a61655d99124a29b486ba4a5b37faea P 0473d2b2d01f4459b1e90fd12cc7840e [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:06:12.784173 23883 raft_consensus.cc:2804] T f1b10566f45d4a7d9029858330e02d5b P e5256d91808b47c195bc9b4dbd7f2b87 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:06:12.774578 23870 raft_consensus.cc:740] T 4509b76741dc428e9201c70c1658da13 P 0473d2b2d01f4459b1e90fd12cc7840e [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 0473d2b2d01f4459b1e90fd12cc7840e, State: Running, Role: LEADER
I20260709 13:06:12.806434 19402 raft_consensus.cc:1275] T 7be9efa6559648dbb5a0f7684c4542d1 P e5256d91808b47c195bc9b4dbd7f2b87 [term 13 FOLLOWER]: Refusing update from remote peer 0473d2b2d01f4459b1e90fd12cc7840e: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 13:06:12.785064 23829 raft_consensus.cc:2804] T 0cdf56e38bbc453d9438d359e5a69955 P 0473d2b2d01f4459b1e90fd12cc7840e [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:06:12.766702 23918 raft_consensus.cc:3060] T 2b74109013a140ada21feeef92d6f563 P e5256d91808b47c195bc9b4dbd7f2b87 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:06:12.814424 20075 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:12.805204 19375 leader_election.cc:304] T 28af091831594f9d8e96482078cc7625 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:06:12.790762 23847 raft_consensus.cc:2804] T edd7d470b5014c9489be7f41f64355c9 P 0473d2b2d01f4459b1e90fd12cc7840e [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:06:12.791216 23896 raft_consensus.cc:2749] T 40e1e16737a842ee936002830f36882e P 0473d2b2d01f4459b1e90fd12cc7840e [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:06:12.755589 23944 consensus_queue.cc:1048] T b9f0d59553ad444883fcf5b5909f9798 P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.051s
I20260709 13:06:12.781576 23901 consensus_queue.cc:1059] T 21e14947d70440f19044d8f75c31e1f9 P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.047s
I20260709 13:06:12.807307 23819 raft_consensus.cc:2804] T 7f575b143b844aa096b50997dad3516a P 0473d2b2d01f4459b1e90fd12cc7840e [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:06:12.840212 23870 consensus_queue.cc:260] T 4509b76741dc428e9201c70c1658da13 P 0473d2b2d01f4459b1e90fd12cc7840e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:12.841825 23870 raft_consensus.cc:3060] T 4509b76741dc428e9201c70c1658da13 P 0473d2b2d01f4459b1e90fd12cc7840e [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:06:12.843601 23414 raft_consensus.cc:3055] T 0afb57ae58a24a01850491d69f0213dd P 0473d2b2d01f4459b1e90fd12cc7840e [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:06:12.843992 23414 raft_consensus.cc:740] T 0afb57ae58a24a01850491d69f0213dd P 0473d2b2d01f4459b1e90fd12cc7840e [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 0473d2b2d01f4459b1e90fd12cc7840e, State: Running, Role: LEADER
I20260709 13:06:12.844787 23414 consensus_queue.cc:260] T 0afb57ae58a24a01850491d69f0213dd P 0473d2b2d01f4459b1e90fd12cc7840e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:12.854820 23874 raft_consensus.cc:2804] T 2e36a9d6e29c4a7c860cf267efbd4c74 P e61c3a8f61bb48f8a963c9480e53c168 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:06:12.855283 23874 raft_consensus.cc:493] T 2e36a9d6e29c4a7c860cf267efbd4c74 P e61c3a8f61bb48f8a963c9480e53c168 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:12.855631 23874 raft_consensus.cc:3060] T 2e36a9d6e29c4a7c860cf267efbd4c74 P e61c3a8f61bb48f8a963c9480e53c168 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:06:12.859484 23859 leader_election.cc:290] T b08304a0a02b42d7840c4e8ee9a6bd1a P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:06:12.860337 23859 consensus_queue.cc:1048] T 179fd671030940b4b4a4e24bcc4aba0a P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:06:12.832829 23829 raft_consensus.cc:493] T 0cdf56e38bbc453d9438d359e5a69955 P 0473d2b2d01f4459b1e90fd12cc7840e [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:12.863233 23829 raft_consensus.cc:3060] T 0cdf56e38bbc453d9438d359e5a69955 P 0473d2b2d01f4459b1e90fd12cc7840e [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:06:12.863600 23893 raft_consensus.cc:3060] T 48824d5acfbc485ebf8c2d944e7202de P e61c3a8f61bb48f8a963c9480e53c168 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:06:12.834551 23605 raft_consensus.cc:2804] T 28af091831594f9d8e96482078cc7625 P e5256d91808b47c195bc9b4dbd7f2b87 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:06:12.865162 23605 raft_consensus.cc:493] T 28af091831594f9d8e96482078cc7625 P e5256d91808b47c195bc9b4dbd7f2b87 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 0473d2b2d01f4459b1e90fd12cc7840e)
I20260709 13:06:12.865533 23605 raft_consensus.cc:3060] T 28af091831594f9d8e96482078cc7625 P e5256d91808b47c195bc9b4dbd7f2b87 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:06:12.828341 23883 raft_consensus.cc:493] T f1b10566f45d4a7d9029858330e02d5b P e5256d91808b47c195bc9b4dbd7f2b87 [term 12 FOLLOWER]: Starting leader election (detected failure of leader e61c3a8f61bb48f8a963c9480e53c168)
I20260709 13:06:12.868871 23692 leader_election.cc:290] T fa731b585f684a7fb2d106c50f143b83 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:06:12.869074 23883 raft_consensus.cc:3060] T f1b10566f45d4a7d9029858330e02d5b P e5256d91808b47c195bc9b4dbd7f2b87 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:06:12.869936 19406 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52328 (request call id 2022) took 1292 ms (client timeout 1704 ms). Trace:
W20260709 13:06:12.870319 19406 rpcz_store.cc:269] 0709 13:06:11.577959 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:11.589508 (+ 11549us) service_pool.cc:224] Handling call
0709 13:06:12.869696 (+1280188us) spinlock_profiling.cc:243] Waited 815 ms on lock 0x7b5400184554. stack: 00007f4a79de9343 00007f4a79de9240 00007f4a797781d4 00007f4a834b6304 00007f4a834b6299 00007f4a7ce71571 00007f4a7cf0c2fa 00007f4a81ecdb17 00007f4a7b4486d4 00007f4a7b448662 00007f4a7b448591 00007f4a7b44850c 00007f4a7b4477c2 00007f4a7b24348c 00007f4a7b2428c6 00007f4a7b24226f
0709 13:06:12.869853 (+   157us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1874776448}
I20260709 13:06:12.875864 23836 leader_election.cc:290] T ab43d85f64114d4ebf618930e43d9ed0 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 13 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:06:12.876459 23836 raft_consensus.cc:493] T 6c5eebf646ad445a9d1b1adc319d7b16 P e61c3a8f61bb48f8a963c9480e53c168 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:12.876858 23836 raft_consensus.cc:515] T 6c5eebf646ad445a9d1b1adc319d7b16 P e61c3a8f61bb48f8a963c9480e53c168 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:12.877445 19555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e1f505cb0f1427bbd698ac889d80821" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:06:12.878260 19555 raft_consensus.cc:2410] T 3e1f505cb0f1427bbd698ac889d80821 P e61c3a8f61bb48f8a963c9480e53c168 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0473d2b2d01f4459b1e90fd12cc7840e for term 13 because replica has last-logged OpId of term: 11 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 6.
I20260709 13:06:12.878615 23819 raft_consensus.cc:493] T 7f575b143b844aa096b50997dad3516a P 0473d2b2d01f4459b1e90fd12cc7840e [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:12.879056 23819 raft_consensus.cc:3060] T 7f575b143b844aa096b50997dad3516a P 0473d2b2d01f4459b1e90fd12cc7840e [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:06:12.885861 23817 raft_consensus.cc:3055] T 62c6c134d3d24a1ab144dd9ee6bc3f64 P e61c3a8f61bb48f8a963c9480e53c168 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:06:12.886293 23817 raft_consensus.cc:740] T 62c6c134d3d24a1ab144dd9ee6bc3f64 P e61c3a8f61bb48f8a963c9480e53c168 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: e61c3a8f61bb48f8a963c9480e53c168, State: Running, Role: LEADER
I20260709 13:06:12.886943 23755 consensus_queue.cc:1059] T 21e14947d70440f19044d8f75c31e1f9 P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:06:12.887128 23817 consensus_queue.cc:260] T 62c6c134d3d24a1ab144dd9ee6bc3f64 P e61c3a8f61bb48f8a963c9480e53c168 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:12.888298 23817 raft_consensus.cc:3060] T 62c6c134d3d24a1ab144dd9ee6bc3f64 P e61c3a8f61bb48f8a963c9480e53c168 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:06:12.892447 23936 log.cc:927] Time spent T 76cb037fc9064d13b59a8969d897ce8c P 0473d2b2d01f4459b1e90fd12cc7840e: Append to log took a long time: real 0.501s	user 0.003s	sys 0.000s
I20260709 13:06:12.906926 23730 raft_consensus.cc:3055] T 21e14947d70440f19044d8f75c31e1f9 P e61c3a8f61bb48f8a963c9480e53c168 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:06:12.907415 23730 raft_consensus.cc:740] T 21e14947d70440f19044d8f75c31e1f9 P e61c3a8f61bb48f8a963c9480e53c168 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: e61c3a8f61bb48f8a963c9480e53c168, State: Running, Role: LEADER
I20260709 13:06:12.908233 23730 consensus_queue.cc:260] T 21e14947d70440f19044d8f75c31e1f9 P e61c3a8f61bb48f8a963c9480e53c168 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
W20260709 13:06:12.909286 23954 log.cc:927] Time spent T 0e1085d23e8347fbbd5bce7542f4b1f4 P 0473d2b2d01f4459b1e90fd12cc7840e: Append to log took a long time: real 0.169s	user 0.000s	sys 0.003s
I20260709 13:06:12.825623 23768 raft_consensus.cc:515] T 1a61655d99124a29b486ba4a5b37faea P e61c3a8f61bb48f8a963c9480e53c168 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:12.913247 19552 raft_consensus.cc:1240] T 1a61655d99124a29b486ba4a5b37faea P e61c3a8f61bb48f8a963c9480e53c168 [term 9 FOLLOWER]: Rejecting Update request from peer e5256d91808b47c195bc9b4dbd7f2b87 for earlier term 8. Current term is 9. Ops: []
I20260709 13:06:12.916675 20110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "833a2f0775ed407a94b8924ce50adb63" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076"
I20260709 13:06:12.917582 20110 raft_consensus.cc:3060] T 833a2f0775ed407a94b8924ce50adb63 P 127766fc592545a4997f7790f50f6076 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:06:12.923398 19407 raft_consensus.cc:1275] T 70797e5783b5454ab0d0eea663e791e3 P e5256d91808b47c195bc9b4dbd7f2b87 [term 12 FOLLOWER]: Refusing update from remote peer 127766fc592545a4997f7790f50f6076: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:06:12.914129 19478 raft_consensus.cc:2468] T 2e36a9d6e29c4a7c860cf267efbd4c74 P 0473d2b2d01f4459b1e90fd12cc7840e [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 9.
I20260709 13:06:12.941850 20106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa731b585f684a7fb2d106c50f143b83" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:06:12.833570 23847 raft_consensus.cc:493] T edd7d470b5014c9489be7f41f64355c9 P 0473d2b2d01f4459b1e90fd12cc7840e [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:12.825992 23884 raft_consensus.cc:493] T df751f992649444090e27965eb1af85d P e5256d91808b47c195bc9b4dbd7f2b87 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:12.943797 20109 raft_consensus.cc:1240] T 775c229504194560ba9589bc2199b089 P 127766fc592545a4997f7790f50f6076 [term 10 FOLLOWER]: Rejecting Update request from peer e5256d91808b47c195bc9b4dbd7f2b87 for earlier term 9. Current term is 10. Ops: []
I20260709 13:06:12.945384 20078 leader_election.cc:304] T 1f85fc4b527a48848e5faa083b604e36 P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, 127766fc592545a4997f7790f50f6076; no voters: 
I20260709 13:06:12.944126 20112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "309c3ca0ca4b4f3ba129752ea2cb293b" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:06:12.948290 23638 raft_consensus.cc:2804] T 1f85fc4b527a48848e5faa083b604e36 P 127766fc592545a4997f7790f50f6076 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:06:12.948812 23638 raft_consensus.cc:697] T 1f85fc4b527a48848e5faa083b604e36 P 127766fc592545a4997f7790f50f6076 [term 11 LEADER]: Becoming Leader. State: Replica: 127766fc592545a4997f7790f50f6076, State: Running, Role: LEADER
I20260709 13:06:12.949644 23638 consensus_queue.cc:237] T 1f85fc4b527a48848e5faa083b604e36 P 127766fc592545a4997f7790f50f6076 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
W20260709 13:06:12.951732 19377 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.2:46257, user_credentials={real_user=slave}} blocked reactor thread for 210585us
I20260709 13:06:12.952687 19377 leader_election.cc:304] T 179fd671030940b4b4a4e24bcc4aba0a P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:06:12.954372 19377 leader_election.cc:304] T 21e14947d70440f19044d8f75c31e1f9 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:06:12.953228 20110 raft_consensus.cc:2468] T 833a2f0775ed407a94b8924ce50adb63 P 127766fc592545a4997f7790f50f6076 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 11.
W20260709 13:06:12.956776 19526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.2:46257, user_credentials={real_user=slave}} blocked reactor thread for 164300us
I20260709 13:06:12.957713 19526 leader_election.cc:304] T df751f992649444090e27965eb1af85d P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168; no voters: e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:06:12.932559 23762 raft_consensus.cc:493] T ece3db938bc649d4a40a51522ed5259c P 127766fc592545a4997f7790f50f6076 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader e5256d91808b47c195bc9b4dbd7f2b87)
I20260709 13:06:12.886477 23819 raft_consensus.cc:515] T 7f575b143b844aa096b50997dad3516a P 0473d2b2d01f4459b1e90fd12cc7840e [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:12.971078 19406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f85fc4b527a48848e5faa083b604e36" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
I20260709 13:06:12.978767 19374 leader_election.cc:304] T fa731b585f684a7fb2d106c50f143b83 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87; no voters: 127766fc592545a4997f7790f50f6076, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:06:12.935876 23692 raft_consensus.cc:493] T 5ec1c4ce15e04c7e8c283a62179f2a64 P e5256d91808b47c195bc9b4dbd7f2b87 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 127766fc592545a4997f7790f50f6076)
I20260709 13:06:12.944113 23847 raft_consensus.cc:3060] T edd7d470b5014c9489be7f41f64355c9 P 0473d2b2d01f4459b1e90fd12cc7840e [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:06:12.998005 19406 raft_consensus.cc:3060] T 1f85fc4b527a48848e5faa083b604e36 P e5256d91808b47c195bc9b4dbd7f2b87 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:06:12.998127 20112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff9b0eddd810459b82d91c60777c10eb" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:06:12.999749 20112 raft_consensus.cc:2410] T ff9b0eddd810459b82d91c60777c10eb P 127766fc592545a4997f7790f50f6076 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e5256d91808b47c195bc9b4dbd7f2b87 for term 13 because replica has last-logged OpId of term: 11 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 9.
I20260709 13:06:12.967384 23911 raft_consensus.cc:493] T 85c494af21f9457a85da47b9bc70c1fd P 127766fc592545a4997f7790f50f6076 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:13.003706 23768 leader_election.cc:290] T 1a61655d99124a29b486ba4a5b37faea P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 9 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:06:13.004317 23768 consensus_queue.cc:1048] T 179fd671030940b4b4a4e24bcc4aba0a P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:06:13.005260 23761 consensus_queue.cc:1048] T 70797e5783b5454ab0d0eea663e791e3 P 127766fc592545a4997f7790f50f6076 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:06:12.964741 23921 raft_consensus.cc:2749] T 179fd671030940b4b4a4e24bcc4aba0a P e5256d91808b47c195bc9b4dbd7f2b87 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:06:12.965875 23872 consensus_queue.cc:1048] T 6c5eebf646ad445a9d1b1adc319d7b16 P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.049s
I20260709 13:06:13.015655 23836 leader_election.cc:290] T 6c5eebf646ad445a9d1b1adc319d7b16 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:06:12.965689 23725 consensus_queue.cc:1059] T 0afb57ae58a24a01850491d69f0213dd P 0473d2b2d01f4459b1e90fd12cc7840e [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.051s
I20260709 13:06:12.968209 23619 consensus_queue.cc:1048] T 7f575b143b844aa096b50997dad3516a P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.049s
I20260709 13:06:13.003398 23911 raft_consensus.cc:515] T 85c494af21f9457a85da47b9bc70c1fd P 127766fc592545a4997f7790f50f6076 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:13.021334 19481 raft_consensus.cc:1275] T 48824d5acfbc485ebf8c2d944e7202de P 0473d2b2d01f4459b1e90fd12cc7840e [term 13 FOLLOWER]: Refusing update from remote peer 127766fc592545a4997f7790f50f6076: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 13:06:12.982050 23901 raft_consensus.cc:2804] T df751f992649444090e27965eb1af85d P e61c3a8f61bb48f8a963c9480e53c168 [term 14 FOLLOWER]: Leader election won for term 14
W20260709 13:06:13.026822 19523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.1:40321, user_credentials={real_user=slave}} blocked reactor thread for 215836us
W20260709 13:06:13.026973 19374 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.4:43121, user_credentials={real_user=slave}} blocked reactor thread for 48279.1us
I20260709 13:06:13.027993 19374 leader_election.cc:304] T 309c3ca0ca4b4f3ba129752ea2cb293b P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87; no voters: 127766fc592545a4997f7790f50f6076, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:06:13.028576 19404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b08304a0a02b42d7840c4e8ee9a6bd1a" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:06:13.029490 19407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab43d85f64114d4ebf618930e43d9ed0" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 13 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
I20260709 13:06:13.030105 19407 raft_consensus.cc:3060] T ab43d85f64114d4ebf618930e43d9ed0 P e5256d91808b47c195bc9b4dbd7f2b87 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:06:12.946619 23884 raft_consensus.cc:515] T df751f992649444090e27965eb1af85d P e5256d91808b47c195bc9b4dbd7f2b87 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:13.039746 19377 leader_election.cc:304] T 4509b76741dc428e9201c70c1658da13 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:06:13.040107 19404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a61655d99124a29b486ba4a5b37faea" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
W20260709 13:06:13.034871 19449 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.4:43121, user_credentials={real_user=slave}} blocked reactor thread for 208456us
I20260709 13:06:13.002293 23772 raft_consensus.cc:2749] T 21e14947d70440f19044d8f75c31e1f9 P e5256d91808b47c195bc9b4dbd7f2b87 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:06:13.076511 19404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e1f505cb0f1427bbd698ac889d80821" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:06:13.077314 19404 raft_consensus.cc:2468] T 3e1f505cb0f1427bbd698ac889d80821 P e5256d91808b47c195bc9b4dbd7f2b87 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 12.
W20260709 13:06:13.068850 19524 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:13.074162 20112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab43d85f64114d4ebf618930e43d9ed0" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 13 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076"
I20260709 13:06:13.078402 20112 raft_consensus.cc:3060] T ab43d85f64114d4ebf618930e43d9ed0 P 127766fc592545a4997f7790f50f6076 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:06:13.080015 19526 leader_election.cc:304] T 86a6797bdfe94fa496c050ceae4bd0d9 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e61c3a8f61bb48f8a963c9480e53c168; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:06:13.082195 20106 raft_consensus.cc:1275] T 65d8cb8d6ec64f459d5a47cefab10acf P 127766fc592545a4997f7790f50f6076 [term 11 FOLLOWER]: Refusing update from remote peer e5256d91808b47c195bc9b4dbd7f2b87: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
W20260709 13:06:13.079490 19524 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:13.086906 19407 raft_consensus.cc:2468] T ab43d85f64114d4ebf618930e43d9ed0 P e5256d91808b47c195bc9b4dbd7f2b87 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 13.
I20260709 13:06:13.090108 20106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c5eebf646ad445a9d1b1adc319d7b16" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:06:13.034587 23854 raft_consensus.cc:2749] T fa731b585f684a7fb2d106c50f143b83 P e5256d91808b47c195bc9b4dbd7f2b87 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:06:12.997380 23762 raft_consensus.cc:515] T ece3db938bc649d4a40a51522ed5259c P 127766fc592545a4997f7790f50f6076 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:13.098600 19406 raft_consensus.cc:2468] T 1f85fc4b527a48848e5faa083b604e36 P e5256d91808b47c195bc9b4dbd7f2b87 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 127766fc592545a4997f7790f50f6076 in term 11.
I20260709 13:06:13.091899 20106 raft_consensus.cc:2468] T 6c5eebf646ad445a9d1b1adc319d7b16 P 127766fc592545a4997f7790f50f6076 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 10.
I20260709 13:06:13.018306 23692 raft_consensus.cc:515] T 5ec1c4ce15e04c7e8c283a62179f2a64 P e5256d91808b47c195bc9b4dbd7f2b87 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:13.043344 23619 raft_consensus.cc:2749] T 309c3ca0ca4b4f3ba129752ea2cb293b P e5256d91808b47c195bc9b4dbd7f2b87 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:06:13.039646 19557 raft_consensus.cc:2955] T 7be9efa6559648dbb5a0f7684c4542d1 P e61c3a8f61bb48f8a963c9480e53c168 [term 13 FOLLOWER]: Committing config change with OpId 7.6: config changed from index 4 to 6, 127766fc592545a4997f7790f50f6076 (127.17.223.4) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } attrs { replace: true } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } } }
I20260709 13:06:13.031708 23805 consensus_queue.cc:1048] T 48824d5acfbc485ebf8c2d944e7202de P 127766fc592545a4997f7790f50f6076 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.070s
I20260709 13:06:13.081784 23777 raft_consensus.cc:2749] T 4509b76741dc428e9201c70c1658da13 P e5256d91808b47c195bc9b4dbd7f2b87 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:06:13.075927 23784 raft_consensus.cc:493] T 14efcc79969f41babe5529c22d59156d P 127766fc592545a4997f7790f50f6076 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader e5256d91808b47c195bc9b4dbd7f2b87)
I20260709 13:06:13.091339 23901 raft_consensus.cc:697] T df751f992649444090e27965eb1af85d P e61c3a8f61bb48f8a963c9480e53c168 [term 14 LEADER]: Becoming Leader. State: Replica: e61c3a8f61bb48f8a963c9480e53c168, State: Running, Role: LEADER
I20260709 13:06:13.103391 23768 raft_consensus.cc:493] T a08760e15aac4630a629431f56024dc8 P e61c3a8f61bb48f8a963c9480e53c168 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:13.127954 23817 raft_consensus.cc:2749] T 86a6797bdfe94fa496c050ceae4bd0d9 P e61c3a8f61bb48f8a963c9480e53c168 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:06:13.128731 23807 raft_consensus.cc:493] T 65d8cb8d6ec64f459d5a47cefab10acf P 127766fc592545a4997f7790f50f6076 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:13.129307 23918 raft_consensus.cc:2749] T 2b74109013a140ada21feeef92d6f563 P e5256d91808b47c195bc9b4dbd7f2b87 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:06:13.130239 23713 raft_consensus.cc:515] T 46c5bfeecc314717bffe987e6844b6d0 P e61c3a8f61bb48f8a963c9480e53c168 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:13.123217 23505 raft_consensus.cc:2804] T 7f575b143b844aa096b50997dad3516a P e61c3a8f61bb48f8a963c9480e53c168 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:06:13.131502 23784 raft_consensus.cc:515] T 14efcc79969f41babe5529c22d59156d P 127766fc592545a4997f7790f50f6076 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:13.106967 23836 raft_consensus.cc:493] T ff75a1d4cb1f493db8f71ddc136ba9ab P e61c3a8f61bb48f8a963c9480e53c168 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:06:13.139268 19376 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:13.080965 23872 consensus_queue.cc:1048] T 6c5eebf646ad445a9d1b1adc319d7b16 P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Connected to new peer: Peer: permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.043s
I20260709 13:06:13.113019 23971 raft_consensus.cc:493] T 3e1f505cb0f1427bbd698ac889d80821 P e61c3a8f61bb48f8a963c9480e53c168 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:13.092555 23465 consensus_queue.cc:1048] T edd7d470b5014c9489be7f41f64355c9 P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.034s
I20260709 13:06:13.152717 20112 raft_consensus.cc:2468] T ab43d85f64114d4ebf618930e43d9ed0 P 127766fc592545a4997f7790f50f6076 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 13.
I20260709 13:06:13.139927 23975 raft_consensus.cc:493] T fa731b585f684a7fb2d106c50f143b83 P e61c3a8f61bb48f8a963c9480e53c168 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 127766fc592545a4997f7790f50f6076)
W20260709 13:06:13.165891 19375 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.3:36891, user_credentials={real_user=slave}} blocked reactor thread for 127322us
I20260709 13:06:13.144444 23768 raft_consensus.cc:515] T a08760e15aac4630a629431f56024dc8 P e61c3a8f61bb48f8a963c9480e53c168 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
W20260709 13:06:13.248760 19374 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.4:43121, user_credentials={real_user=slave}} blocked reactor thread for 143187us
I20260709 13:06:13.167313 23973 raft_consensus.cc:493] T 85c494af21f9457a85da47b9bc70c1fd P e61c3a8f61bb48f8a963c9480e53c168 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 127766fc592545a4997f7790f50f6076)
I20260709 13:06:13.153949 23807 raft_consensus.cc:515] T 65d8cb8d6ec64f459d5a47cefab10acf P 127766fc592545a4997f7790f50f6076 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:13.141806 23901 consensus_queue.cc:237] T df751f992649444090e27965eb1af85d P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:13.178411 23836 raft_consensus.cc:515] T ff75a1d4cb1f493db8f71ddc136ba9ab P e61c3a8f61bb48f8a963c9480e53c168 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:13.285480 19523 leader_election.cc:304] T 6c5eebf646ad445a9d1b1adc319d7b16 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 127766fc592545a4997f7790f50f6076, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:06:13.163015 23772 consensus_queue.cc:1048] T 65d8cb8d6ec64f459d5a47cefab10acf P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Connected to new peer: Peer: permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.108s
I20260709 13:06:13.200317 23883 raft_consensus.cc:515] T f1b10566f45d4a7d9029858330e02d5b P e5256d91808b47c195bc9b4dbd7f2b87 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:13.291419 19523 leader_election.cc:400] T 833a2f0775ed407a94b8924ce50adb63 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 10 election: Vote denied by peer e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321) with higher term. Message: Invalid argument: T 833a2f0775ed407a94b8924ce50adb63 P e5256d91808b47c195bc9b4dbd7f2b87 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate e61c3a8f61bb48f8a963c9480e53c168 for earlier term 10. Current term is 11.
I20260709 13:06:13.296183 19523 leader_election.cc:403] T 833a2f0775ed407a94b8924ce50adb63 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 10 election: Cancelling election due to peer responding with higher term
W20260709 13:06:13.283437 23980 log.cc:927] Time spent T 2725d2c4cb054f18b0fc8f735c15f6c2 P e5256d91808b47c195bc9b4dbd7f2b87: Append to log took a long time: real 0.060s	user 0.000s	sys 0.000s
I20260709 13:06:13.293870 19406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ece3db938bc649d4a40a51522ed5259c" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:06:13.297895 19523 leader_election.cc:304] T ab43d85f64114d4ebf618930e43d9ed0 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 127766fc592545a4997f7790f50f6076, e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:06:13.293391 19404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85c494af21f9457a85da47b9bc70c1fd" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:06:13.301973 19404 raft_consensus.cc:2468] T 85c494af21f9457a85da47b9bc70c1fd P e5256d91808b47c195bc9b4dbd7f2b87 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 127766fc592545a4997f7790f50f6076 in term 9.
I20260709 13:06:13.285104 23911 leader_election.cc:290] T 85c494af21f9457a85da47b9bc70c1fd P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:06:13.304445 20075 leader_election.cc:304] T 85c494af21f9457a85da47b9bc70c1fd P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 127766fc592545a4997f7790f50f6076, e5256d91808b47c195bc9b4dbd7f2b87; no voters: 
I20260709 13:06:13.304643 23762 leader_election.cc:290] T ece3db938bc649d4a40a51522ed5259c P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:06:13.305229 23762 raft_consensus.cc:2804] T 85c494af21f9457a85da47b9bc70c1fd P 127766fc592545a4997f7790f50f6076 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:06:13.305622 23762 raft_consensus.cc:493] T 85c494af21f9457a85da47b9bc70c1fd P 127766fc592545a4997f7790f50f6076 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:13.305963 23762 raft_consensus.cc:3060] T 85c494af21f9457a85da47b9bc70c1fd P 127766fc592545a4997f7790f50f6076 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:06:13.273368 23819 leader_election.cc:290] T 7f575b143b844aa096b50997dad3516a P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 9 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:06:13.273016 23921 raft_consensus.cc:493] T ff75a1d4cb1f493db8f71ddc136ba9ab P e5256d91808b47c195bc9b4dbd7f2b87 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader e61c3a8f61bb48f8a963c9480e53c168)
I20260709 13:06:13.309680 19551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85c494af21f9457a85da47b9bc70c1fd" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
W20260709 13:06:13.306924 19377 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.2:46257, user_credentials={real_user=slave}} blocked reactor thread for 232674us
I20260709 13:06:13.190922 23971 raft_consensus.cc:515] T 3e1f505cb0f1427bbd698ac889d80821 P e61c3a8f61bb48f8a963c9480e53c168 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:13.199657 23975 raft_consensus.cc:515] T fa731b585f684a7fb2d106c50f143b83 P e61c3a8f61bb48f8a963c9480e53c168 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:13.252494 23973 raft_consensus.cc:515] T 85c494af21f9457a85da47b9bc70c1fd P e61c3a8f61bb48f8a963c9480e53c168 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
W20260709 13:06:13.331475 23970 log.cc:927] Time spent T 833a2f0775ed407a94b8924ce50adb63 P e5256d91808b47c195bc9b4dbd7f2b87: Append to log took a long time: real 0.136s	user 0.000s	sys 0.000s
W20260709 13:06:13.333458 19450 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:13.333904 19558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ece3db938bc649d4a40a51522ed5259c" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:06:13.367417 19481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e1f505cb0f1427bbd698ac889d80821" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:06:13.368201 19481 raft_consensus.cc:2468] T 3e1f505cb0f1427bbd698ac889d80821 P 0473d2b2d01f4459b1e90fd12cc7840e [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 12.
I20260709 13:06:13.369549 19480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1b10566f45d4a7d9029858330e02d5b" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:06:13.370532 19480 raft_consensus.cc:2393] T f1b10566f45d4a7d9029858330e02d5b P 0473d2b2d01f4459b1e90fd12cc7840e [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e5256d91808b47c195bc9b4dbd7f2b87 in current term 13: Already voted for candidate 0473d2b2d01f4459b1e90fd12cc7840e in this term.
I20260709 13:06:13.371460 19483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff9b0eddd810459b82d91c60777c10eb" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:06:13.346928 23692 leader_election.cc:290] T 5ec1c4ce15e04c7e8c283a62179f2a64 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:06:13.348054 20112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ec1c4ce15e04c7e8c283a62179f2a64" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:06:13.300120 23817 raft_consensus.cc:2804] T 6c5eebf646ad445a9d1b1adc319d7b16 P e61c3a8f61bb48f8a963c9480e53c168 [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 13:06:13.350651 19451 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:13.351749 19404 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2725d2c4cb054f18b0fc8f735c15f6c2"
dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
mode: GRACEFUL
new_leader_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
 from {username='slave'} at 127.0.0.1:37312
I20260709 13:06:13.389444 19404 raft_consensus.cc:606] T 2725d2c4cb054f18b0fc8f735c15f6c2 P e5256d91808b47c195bc9b4dbd7f2b87 [term 14 LEADER]: Received request to transfer leadership to TS e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:06:13.300660 23884 leader_election.cc:290] T df751f992649444090e27965eb1af85d P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:06:13.379431 19481 raft_consensus.cc:1275] T 1a61655d99124a29b486ba4a5b37faea P 0473d2b2d01f4459b1e90fd12cc7840e [term 8 FOLLOWER]: Refusing update from remote peer e5256d91808b47c195bc9b4dbd7f2b87: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 13:06:13.392894 19481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ec1c4ce15e04c7e8c283a62179f2a64" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:06:13.392992 19484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "309c3ca0ca4b4f3ba129752ea2cb293b" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:06:13.381735 19377 leader_election.cc:304] T 3e1f505cb0f1427bbd698ac889d80821 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87; no voters: e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:06:13.306870 23977 consensus_queue.cc:1048] T 96efeaaf1057492490e9a621f37e1a2d P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Connected to new peer: Peer: permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 7, Time since last communication: 0.091s
I20260709 13:06:13.384946 19558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f575b143b844aa096b50997dad3516a" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:06:13.386351 19483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df751f992649444090e27965eb1af85d" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:06:13.397430 19551 raft_consensus.cc:2468] T 85c494af21f9457a85da47b9bc70c1fd P e61c3a8f61bb48f8a963c9480e53c168 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 127766fc592545a4997f7790f50f6076 in term 8.
I20260709 13:06:13.394433 19481 raft_consensus.cc:1240] T 7f575b143b844aa096b50997dad3516a P 0473d2b2d01f4459b1e90fd12cc7840e [term 9 FOLLOWER]: Rejecting Update request from peer e5256d91808b47c195bc9b4dbd7f2b87 for earlier term 8. Current term is 9. Ops: [8.7-8.7]
I20260709 13:06:13.397940 19483 raft_consensus.cc:2468] T df751f992649444090e27965eb1af85d P 0473d2b2d01f4459b1e90fd12cc7840e [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 14.
I20260709 13:06:13.402086 19377 leader_election.cc:304] T ff9b0eddd810459b82d91c60777c10eb P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, 127766fc592545a4997f7790f50f6076
I20260709 13:06:13.407428 19377 leader_election.cc:304] T df751f992649444090e27965eb1af85d P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87; no voters: 
I20260709 13:06:13.391877 23817 raft_consensus.cc:493] T 6c5eebf646ad445a9d1b1adc319d7b16 P e61c3a8f61bb48f8a963c9480e53c168 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 0473d2b2d01f4459b1e90fd12cc7840e)
I20260709 13:06:13.320072 23921 raft_consensus.cc:515] T ff75a1d4cb1f493db8f71ddc136ba9ab P e5256d91808b47c195bc9b4dbd7f2b87 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:13.400738 23977 consensus_queue.cc:1243] T 96efeaaf1057492490e9a621f37e1a2d P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Peer 127766fc592545a4997f7790f50f6076 log is divergent from this leader: its last log entry 8.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
I20260709 13:06:13.394521 19485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28af091831594f9d8e96482078cc7625" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:06:13.404095 23884 raft_consensus.cc:2804] T 3e1f505cb0f1427bbd698ac889d80821 P e5256d91808b47c195bc9b4dbd7f2b87 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:06:13.402989 23989 raft_consensus.cc:2749] T 833a2f0775ed407a94b8924ce50adb63 P e61c3a8f61bb48f8a963c9480e53c168 [term 11 FOLLOWER]: Leader election lost for term 10. Reason: Vote denied by peer e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321) with higher term. Message: Invalid argument: T 833a2f0775ed407a94b8924ce50adb63 P e5256d91808b47c195bc9b4dbd7f2b87 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate e61c3a8f61bb48f8a963c9480e53c168 for earlier term 10. Current term is 11.
I20260709 13:06:13.407171 23465 raft_consensus.cc:2749] T ff9b0eddd810459b82d91c60777c10eb P e5256d91808b47c195bc9b4dbd7f2b87 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:06:13.405722 23985 consensus_queue.cc:1059] T 7f575b143b844aa096b50997dad3516a P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 }, Status: INVALID_TERM, Last received: 7.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.020s
I20260709 13:06:13.413617 23692 raft_consensus.cc:2804] T df751f992649444090e27965eb1af85d P e5256d91808b47c195bc9b4dbd7f2b87 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:06:13.425664 23755 raft_consensus.cc:2804] T ab43d85f64114d4ebf618930e43d9ed0 P e61c3a8f61bb48f8a963c9480e53c168 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:06:13.431880 23828 raft_consensus.cc:493] T 70797e5783b5454ab0d0eea663e791e3 P e61c3a8f61bb48f8a963c9480e53c168 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:13.451673 19560 raft_consensus.cc:1275] T 65d8cb8d6ec64f459d5a47cefab10acf P e61c3a8f61bb48f8a963c9480e53c168 [term 11 FOLLOWER]: Refusing update from remote peer e5256d91808b47c195bc9b4dbd7f2b87: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 11 index: 8. (term mismatch)
W20260709 13:06:13.424918 23978 log.cc:927] Time spent T edd7d470b5014c9489be7f41f64355c9 P e61c3a8f61bb48f8a963c9480e53c168: Append to log took a long time: real 0.058s	user 0.001s	sys 0.000s
I20260709 13:06:13.446053 20076 leader_election.cc:304] T ece3db938bc649d4a40a51522ed5259c P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 127766fc592545a4997f7790f50f6076; no voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:06:13.428666 19403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65d8cb8d6ec64f459d5a47cefab10acf" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 12 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:06:13.434342 23414 raft_consensus.cc:3060] T 0afb57ae58a24a01850491d69f0213dd P 0473d2b2d01f4459b1e90fd12cc7840e [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:06:13.444857 23971 leader_election.cc:290] T 3e1f505cb0f1427bbd698ac889d80821 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:06:13.432602 19374 leader_election.cc:304] T 5ec1c4ce15e04c7e8c283a62179f2a64 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, 127766fc592545a4997f7790f50f6076
W20260709 13:06:13.569068 19374 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.4:43121, user_credentials={real_user=slave}} blocked reactor thread for 136571us
I20260709 13:06:13.422552 23784 leader_election.cc:290] T 14efcc79969f41babe5529c22d59156d P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:06:13.451406 23884 raft_consensus.cc:493] T 3e1f505cb0f1427bbd698ac889d80821 P e5256d91808b47c195bc9b4dbd7f2b87 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:13.426607 19404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14efcc79969f41babe5529c22d59156d" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:06:13.416182 23713 leader_election.cc:290] T 46c5bfeecc314717bffe987e6844b6d0 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 17 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
W20260709 13:06:13.427482 23983 log.cc:927] Time spent T 1f85fc4b527a48848e5faa083b604e36 P 127766fc592545a4997f7790f50f6076: Append to log took a long time: real 0.154s	user 0.001s	sys 0.000s
W20260709 13:06:13.449709 23966 log.cc:927] Time spent T 76cb037fc9064d13b59a8969d897ce8c P e5256d91808b47c195bc9b4dbd7f2b87: Append to log took a long time: real 0.707s	user 0.004s	sys 0.000s
I20260709 13:06:13.409226 23878 consensus_queue.cc:1048] T 1a61655d99124a29b486ba4a5b37faea P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.057s
W20260709 13:06:13.464311 23605 consensus_meta.cc:287] T 28af091831594f9d8e96482078cc7625 P e5256d91808b47c195bc9b4dbd7f2b87: Time spent flushing consensus metadata: real 0.587s	user 0.009s	sys 0.002s
I20260709 13:06:13.470590 19560 pending_rounds.cc:85] T 65d8cb8d6ec64f459d5a47cefab10acf P e61c3a8f61bb48f8a963c9480e53c168: Aborting all ops after (but not including) 7
I20260709 13:06:13.636880 19560 pending_rounds.cc:107] T 65d8cb8d6ec64f459d5a47cefab10acf P e61c3a8f61bb48f8a963c9480e53c168: Aborting uncommitted NO_OP operation due to leader change: 10.8
I20260709 13:06:13.637277 19560 raft_consensus.cc:2889] T 65d8cb8d6ec64f459d5a47cefab10acf P e61c3a8f61bb48f8a963c9480e53c168 [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:06:13.597702 23960 log.cc:927] Time spent T 2725d2c4cb054f18b0fc8f735c15f6c2 P e61c3a8f61bb48f8a963c9480e53c168: Append to log took a long time: real 0.136s	user 0.000s	sys 0.001s
I20260709 13:06:13.638362 19553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65d8cb8d6ec64f459d5a47cefab10acf" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 12 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:06:13.639091 19553 raft_consensus.cc:2468] T 65d8cb8d6ec64f459d5a47cefab10acf P e61c3a8f61bb48f8a963c9480e53c168 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 127766fc592545a4997f7790f50f6076 in term 11.
I20260709 13:06:13.471166 20112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa731b585f684a7fb2d106c50f143b83" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:06:13.428927 23920 raft_consensus.cc:3060] T 775c229504194560ba9589bc2199b089 P e5256d91808b47c195bc9b4dbd7f2b87 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:06:13.405527 23762 raft_consensus.cc:515] T 85c494af21f9457a85da47b9bc70c1fd P 127766fc592545a4997f7790f50f6076 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:13.426735 23505 raft_consensus.cc:493] T 7f575b143b844aa096b50997dad3516a P e61c3a8f61bb48f8a963c9480e53c168 [term 8 FOLLOWER]: Starting leader election (detected failure of leader e5256d91808b47c195bc9b4dbd7f2b87)
I20260709 13:06:13.416673 23817 raft_consensus.cc:3060] T 6c5eebf646ad445a9d1b1adc319d7b16 P e61c3a8f61bb48f8a963c9480e53c168 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:06:13.449064 23975 leader_election.cc:290] T fa731b585f684a7fb2d106c50f143b83 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:06:13.468856 23692 raft_consensus.cc:493] T df751f992649444090e27965eb1af85d P e5256d91808b47c195bc9b4dbd7f2b87 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:13.568261 23911 raft_consensus.cc:2749] T ece3db938bc649d4a40a51522ed5259c P 127766fc592545a4997f7790f50f6076 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:06:13.471742 23883 leader_election.cc:290] T f1b10566f45d4a7d9029858330e02d5b P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 13 election: Requested vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
W20260709 13:06:13.522341 19524 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:13.706585 19524 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:13.706981 19552 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40438 (request call id 2394) took 1078 ms. Trace:
I20260709 13:06:13.707405 19552 rpcz_store.cc:276] 0709 13:06:12.628617 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:12.628732 (+   115us) service_pool.cc:224] Handling call
0709 13:06:12.649784 (+ 21052us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:12.913620 (+263836us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:13.706767 (+793147us) spinlock_profiling.cc:243] Waited 263 ms on lock 0x7b540029bdd4. stack: 00007f4a79de9343 00007f4a79de9240 00007f4a797781d4 00007f4a834b6304 00007f4a834b6299 00007f4a7ce71571 00007f4a7cf08e01 00007f4a7cf0783e 00007f4a81ecc419 00007f4a7b443bd4 00007f4a7b443b62 00007f4a7b443a91 00007f4a7b443a0c 00007f4a7b442cc2 00007f4a7b24348c 00007f4a7b2428c6
0709 13:06:13.706927 (+   160us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":605541120}
I20260709 13:06:13.646111 20076 leader_election.cc:304] T 65d8cb8d6ec64f459d5a47cefab10acf P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 127766fc592545a4997f7790f50f6076, e61c3a8f61bb48f8a963c9480e53c168; no voters: e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:06:13.603545 23884 raft_consensus.cc:3060] T 3e1f505cb0f1427bbd698ac889d80821 P e5256d91808b47c195bc9b4dbd7f2b87 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:06:13.600847 23755 raft_consensus.cc:697] T ab43d85f64114d4ebf618930e43d9ed0 P e61c3a8f61bb48f8a963c9480e53c168 [term 13 LEADER]: Becoming Leader. State: Replica: e61c3a8f61bb48f8a963c9480e53c168, State: Running, Role: LEADER
W20260709 13:06:13.690454 19377 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:13.597285 23919 raft_consensus.cc:3055] T 7f575b143b844aa096b50997dad3516a P e5256d91808b47c195bc9b4dbd7f2b87 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:06:13.570462 23768 leader_election.cc:290] T a08760e15aac4630a629431f56024dc8 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:06:13.616159 23807 leader_election.cc:290] T 65d8cb8d6ec64f459d5a47cefab10acf P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:06:13.709877 23987 raft_consensus.cc:2749] T 5ec1c4ce15e04c7e8c283a62179f2a64 P e5256d91808b47c195bc9b4dbd7f2b87 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:06:13.696273 23505 raft_consensus.cc:3060] T 7f575b143b844aa096b50997dad3516a P e61c3a8f61bb48f8a963c9480e53c168 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:06:13.688563 23795 raft_consensus.cc:493] T ef32ce6fdd0e40d382c79974f30295c6 P 0473d2b2d01f4459b1e90fd12cc7840e [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:13.642371 23605 raft_consensus.cc:515] T 28af091831594f9d8e96482078cc7625 P e5256d91808b47c195bc9b4dbd7f2b87 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:13.689211 23836 leader_election.cc:290] T ff75a1d4cb1f493db8f71ddc136ba9ab P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:06:13.715286 20112 pending_rounds.cc:85] T 96efeaaf1057492490e9a621f37e1a2d P 127766fc592545a4997f7790f50f6076: Aborting all ops after (but not including) 7
I20260709 13:06:13.740844 20112 pending_rounds.cc:107] T 96efeaaf1057492490e9a621f37e1a2d P 127766fc592545a4997f7790f50f6076: Aborting uncommitted NO_OP operation due to leader change: 8.8
I20260709 13:06:13.741192 20112 raft_consensus.cc:2889] T 96efeaaf1057492490e9a621f37e1a2d P 127766fc592545a4997f7790f50f6076 [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:06:13.707259 23692 raft_consensus.cc:3060] T df751f992649444090e27965eb1af85d P e5256d91808b47c195bc9b4dbd7f2b87 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:06:13.714257 23755 consensus_queue.cc:237] T ab43d85f64114d4ebf618930e43d9ed0 P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 13, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } attrs { replace: true } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:13.728286 23713 raft_consensus.cc:493] T 4509b76741dc428e9201c70c1658da13 P e61c3a8f61bb48f8a963c9480e53c168 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 0473d2b2d01f4459b1e90fd12cc7840e)
I20260709 13:06:13.568846 23828 raft_consensus.cc:515] T 70797e5783b5454ab0d0eea663e791e3 P e61c3a8f61bb48f8a963c9480e53c168 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:13.726750 23911 raft_consensus.cc:2804] T 65d8cb8d6ec64f459d5a47cefab10acf P 127766fc592545a4997f7790f50f6076 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:06:13.733326 23761 raft_consensus.cc:493] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P 127766fc592545a4997f7790f50f6076 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:13.757735 19407 raft_consensus.cc:1240] T 28af091831594f9d8e96482078cc7625 P e5256d91808b47c195bc9b4dbd7f2b87 [term 13 FOLLOWER]: Rejecting Update request from peer 0473d2b2d01f4459b1e90fd12cc7840e for earlier term 12. Current term is 13. Ops: []
I20260709 13:06:13.720616 23919 raft_consensus.cc:740] T 7f575b143b844aa096b50997dad3516a P e5256d91808b47c195bc9b4dbd7f2b87 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: e5256d91808b47c195bc9b4dbd7f2b87, State: Running, Role: LEADER
I20260709 13:06:13.747262 23971 raft_consensus.cc:493] T 2b74109013a140ada21feeef92d6f563 P e61c3a8f61bb48f8a963c9480e53c168 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:13.743649 23768 raft_consensus.cc:493] T f93ee515a9c14139bf566522ed8232f3 P e61c3a8f61bb48f8a963c9480e53c168 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 0473d2b2d01f4459b1e90fd12cc7840e)
I20260709 13:06:13.772656 23933 raft_consensus.cc:493] T 76cb037fc9064d13b59a8969d897ce8c P 0473d2b2d01f4459b1e90fd12cc7840e [term 11 FOLLOWER]: Starting pre-election (detected failure of leader e5256d91808b47c195bc9b4dbd7f2b87)
I20260709 13:06:13.773371 23933 raft_consensus.cc:515] T 76cb037fc9064d13b59a8969d897ce8c P 0473d2b2d01f4459b1e90fd12cc7840e [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:13.774420 23919 consensus_queue.cc:260] T 7f575b143b844aa096b50997dad3516a P e5256d91808b47c195bc9b4dbd7f2b87 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.7, Last appended by leader: 7, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:13.775878 23933 leader_election.cc:290] T 76cb037fc9064d13b59a8969d897ce8c P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:06:13.776039 23919 raft_consensus.cc:3060] T 7f575b143b844aa096b50997dad3516a P e5256d91808b47c195bc9b4dbd7f2b87 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:06:13.776584 23995 raft_consensus.cc:493] T ef32ce6fdd0e40d382c79974f30295c6 P e61c3a8f61bb48f8a963c9480e53c168 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:13.777218 23995 raft_consensus.cc:515] T ef32ce6fdd0e40d382c79974f30295c6 P e61c3a8f61bb48f8a963c9480e53c168 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:13.780047 19559 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40428 (request call id 2493) took 1596 ms. Trace:
W20260709 13:06:13.780896 23993 log.cc:927] Time spent T 70797e5783b5454ab0d0eea663e791e3 P e5256d91808b47c195bc9b4dbd7f2b87: Append to log took a long time: real 0.139s	user 0.000s	sys 0.001s
I20260709 13:06:13.783244 23921 leader_election.cc:290] T ff75a1d4cb1f493db8f71ddc136ba9ab P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:06:13.784315 19478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1b10566f45d4a7d9029858330e02d5b" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:06:13.785290 19478 raft_consensus.cc:2393] T f1b10566f45d4a7d9029858330e02d5b P 0473d2b2d01f4459b1e90fd12cc7840e [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate e5256d91808b47c195bc9b4dbd7f2b87 in current term 13: Already voted for candidate 0473d2b2d01f4459b1e90fd12cc7840e in this term.
I20260709 13:06:13.786073 19478 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "309c3ca0ca4b4f3ba129752ea2cb293b"
dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
mode: GRACEFUL
new_leader_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
 from {username='slave'} at 127.0.0.1:48168
I20260709 13:06:13.798211 19553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1b10566f45d4a7d9029858330e02d5b" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:06:13.800459 19552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff75a1d4cb1f493db8f71ddc136ba9ab" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:06:13.801105 19552 raft_consensus.cc:2468] T ff75a1d4cb1f493db8f71ddc136ba9ab P e61c3a8f61bb48f8a963c9480e53c168 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 11.
I20260709 13:06:13.805603 19449 leader_election.cc:304] T 3e1f505cb0f1427bbd698ac889d80821 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87; no voters: e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:06:13.807224 23538 consensus_queue.cc:1048] T b9f0d59553ad444883fcf5b5909f9798 P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:06:13.809029 23538 consensus_queue.cc:1048] T 7be9efa6559648dbb5a0f7684c4542d1 P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:06:13.810345 23538 raft_consensus.cc:2804] T 3e1f505cb0f1427bbd698ac889d80821 P 0473d2b2d01f4459b1e90fd12cc7840e [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:06:13.810837 23538 raft_consensus.cc:493] T 3e1f505cb0f1427bbd698ac889d80821 P 0473d2b2d01f4459b1e90fd12cc7840e [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:13.811192 23538 raft_consensus.cc:3060] T 3e1f505cb0f1427bbd698ac889d80821 P 0473d2b2d01f4459b1e90fd12cc7840e [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:06:13.811612 23730 raft_consensus.cc:3060] T 21e14947d70440f19044d8f75c31e1f9 P e61c3a8f61bb48f8a963c9480e53c168 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:06:13.814288 23938 log.cc:927] Time spent T 6c5eebf646ad445a9d1b1adc319d7b16 P 0473d2b2d01f4459b1e90fd12cc7840e: Append to log took a long time: real 1.398s	user 0.000s	sys 0.010s
I20260709 13:06:13.814921 19553 raft_consensus.cc:2468] T f1b10566f45d4a7d9029858330e02d5b P e61c3a8f61bb48f8a963c9480e53c168 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 13.
I20260709 13:06:13.816792 19560 raft_consensus.cc:1275] T 70797e5783b5454ab0d0eea663e791e3 P e61c3a8f61bb48f8a963c9480e53c168 [term 12 FOLLOWER]: Refusing update from remote peer 127766fc592545a4997f7790f50f6076: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:06:13.819068 19557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df751f992649444090e27965eb1af85d" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:06:13.759188 23973 leader_election.cc:290] T 85c494af21f9457a85da47b9bc70c1fd P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
W20260709 13:06:13.822700 23893 consensus_meta.cc:287] T 48824d5acfbc485ebf8c2d944e7202de P e61c3a8f61bb48f8a963c9480e53c168: Time spent flushing consensus metadata: real 0.959s	user 0.008s	sys 0.003s
I20260709 13:06:13.824543 23828 leader_election.cc:290] T 70797e5783b5454ab0d0eea663e791e3 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:06:13.825191 23768 raft_consensus.cc:515] T f93ee515a9c14139bf566522ed8232f3 P e61c3a8f61bb48f8a963c9480e53c168 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:13.780539 19559 rpcz_store.cc:276] 0709 13:06:12.183451 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:12.189632 (+  6181us) service_pool.cc:224] Handling call
0709 13:06:13.779832 (+1590200us) spinlock_profiling.cc:243] Waited 57.8 ms on lock 0x7b540012af54. stack: 00007f4a79de9343 00007f4a79de9240 00007f4a797781d4 00007f4a834b6304 00007f4a834b6299 00007f4a7ce71571 00007f4a7cf0c2fa 00007f4a81ecdb17 00007f4a7b4486d4 00007f4a7b448662 00007f4a7b448591 00007f4a7b44850c 00007f4a7b4477c2 00007f4a7b24348c 00007f4a7b2428c6 00007f4a7b24226f
0709 13:06:13.779972 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":133047552}
I20260709 13:06:13.740348 23795 raft_consensus.cc:515] T ef32ce6fdd0e40d382c79974f30295c6 P 0473d2b2d01f4459b1e90fd12cc7840e [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:13.826948 23975 raft_consensus.cc:493] T 48824d5acfbc485ebf8c2d944e7202de P e61c3a8f61bb48f8a963c9480e53c168 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:13.826165 23538 raft_consensus.cc:515] T 3e1f505cb0f1427bbd698ac889d80821 P 0473d2b2d01f4459b1e90fd12cc7840e [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
W20260709 13:06:13.850231 19449 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.1:40321, user_credentials={real_user=slave}} blocked reactor thread for 43531us
I20260709 13:06:13.757179 23713 raft_consensus.cc:515] T 4509b76741dc428e9201c70c1658da13 P e61c3a8f61bb48f8a963c9480e53c168 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:13.830317 23995 leader_election.cc:290] T ef32ce6fdd0e40d382c79974f30295c6 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:06:13.786664 19478 raft_consensus.cc:606] T 309c3ca0ca4b4f3ba129752ea2cb293b P 0473d2b2d01f4459b1e90fd12cc7840e [term 9 FOLLOWER]: Received request to transfer leadership to TS e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:06:13.869055 19478 raft_consensus.cc:614] T 309c3ca0ca4b4f3ba129752ea2cb293b P 0473d2b2d01f4459b1e90fd12cc7840e [term 9 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:06:13.862071 19405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f575b143b844aa096b50997dad3516a" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
I20260709 13:06:13.863613 19403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76cb037fc9064d13b59a8969d897ce8c" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:06:13.861418 20105 raft_consensus.cc:1275] T ff9b0eddd810459b82d91c60777c10eb P 127766fc592545a4997f7790f50f6076 [term 12 FOLLOWER]: Refusing update from remote peer 0473d2b2d01f4459b1e90fd12cc7840e: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:06:13.870658 19552 raft_consensus.cc:1275] T 833a2f0775ed407a94b8924ce50adb63 P e61c3a8f61bb48f8a963c9480e53c168 [term 11 FOLLOWER]: Refusing update from remote peer e5256d91808b47c195bc9b4dbd7f2b87: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:06:13.769276 23761 raft_consensus.cc:515] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P 127766fc592545a4997f7790f50f6076 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:13.888119 23714 raft_consensus.cc:493] T 96efeaaf1057492490e9a621f37e1a2d P 0473d2b2d01f4459b1e90fd12cc7840e [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:13.889402 23713 leader_election.cc:290] T 4509b76741dc428e9201c70c1658da13 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:06:13.899411 19403 raft_consensus.cc:1275] T ff9b0eddd810459b82d91c60777c10eb P e5256d91808b47c195bc9b4dbd7f2b87 [term 12 FOLLOWER]: Refusing update from remote peer 0473d2b2d01f4459b1e90fd12cc7840e: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
W20260709 13:06:13.911281 23874 consensus_meta.cc:287] T 2e36a9d6e29c4a7c860cf267efbd4c74 P e61c3a8f61bb48f8a963c9480e53c168: Time spent flushing consensus metadata: real 1.055s	user 0.012s	sys 0.001s
I20260709 13:06:13.827111 23971 raft_consensus.cc:515] T 2b74109013a140ada21feeef92d6f563 P e61c3a8f61bb48f8a963c9480e53c168 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:13.919533 19405 raft_consensus.cc:2410] T 7f575b143b844aa096b50997dad3516a P e5256d91808b47c195bc9b4dbd7f2b87 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 0473d2b2d01f4459b1e90fd12cc7840e for term 9 because replica has last-logged OpId of term: 8 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 6.
I20260709 13:06:13.915453 23874 raft_consensus.cc:515] T 2e36a9d6e29c4a7c860cf267efbd4c74 P e61c3a8f61bb48f8a963c9480e53c168 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:13.933424 23874 leader_election.cc:290] T 2e36a9d6e29c4a7c860cf267efbd4c74 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 10 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:06:13.894340 23918 raft_consensus.cc:493] T ef32ce6fdd0e40d382c79974f30295c6 P e5256d91808b47c195bc9b4dbd7f2b87 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:13.853080 23975 raft_consensus.cc:515] T 48824d5acfbc485ebf8c2d944e7202de P e61c3a8f61bb48f8a963c9480e53c168 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
W20260709 13:06:14.047170 19486 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.663s	user 0.013s	sys 0.017s
W20260709 13:06:14.050233 19486 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.666s	user 0.013s	sys 0.017s
W20260709 13:06:14.061565 20076 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.3:36891, user_credentials={real_user=slave}} blocked reactor thread for 415542us
I20260709 13:06:14.038060 19478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b08304a0a02b42d7840c4e8ee9a6bd1a" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
W20260709 13:06:14.039063 23997 log.cc:927] Time spent T d1e5873a19244c5ebbcd38e126796ee7 P e61c3a8f61bb48f8a963c9480e53c168: Append to log took a long time: real 0.217s	user 0.000s	sys 0.001s
I20260709 13:06:13.917150 23979 consensus_queue.cc:1048] T ff9b0eddd810459b82d91c60777c10eb P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Connected to new peer: Peer: permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.124s
I20260709 13:06:14.022468 23859 raft_consensus.cc:493] T 0cdf56e38bbc453d9438d359e5a69955 P e61c3a8f61bb48f8a963c9480e53c168 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:14.086195 19552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85c494af21f9457a85da47b9bc70c1fd" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:06:14.088048 23873 consensus_queue.cc:1048] T 65d8cb8d6ec64f459d5a47cefab10acf P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:06:14.088357 19478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a61655d99124a29b486ba4a5b37faea" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:06:14.088642 19481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e1f505cb0f1427bbd698ac889d80821" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:06:14.090512 23833 consensus_queue.cc:1059] T 1a61655d99124a29b486ba4a5b37faea P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:06:14.092671 23880 raft_consensus.cc:993] T 2725d2c4cb054f18b0fc8f735c15f6c2 P e5256d91808b47c195bc9b4dbd7f2b87: : Instructing follower e61c3a8f61bb48f8a963c9480e53c168 to start an election
I20260709 13:06:14.099758 19375 leader_election.cc:304] T ff75a1d4cb1f493db8f71ddc136ba9ab P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:06:13.919211 23714 raft_consensus.cc:515] T 96efeaaf1057492490e9a621f37e1a2d P 0473d2b2d01f4459b1e90fd12cc7840e [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:14.110013 19478 raft_consensus.cc:3060] T 1a61655d99124a29b486ba4a5b37faea P 0473d2b2d01f4459b1e90fd12cc7840e [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:06:14.135766 19481 raft_consensus.cc:2393] T 3e1f505cb0f1427bbd698ac889d80821 P 0473d2b2d01f4459b1e90fd12cc7840e [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e61c3a8f61bb48f8a963c9480e53c168 in current term 13: Already voted for candidate 0473d2b2d01f4459b1e90fd12cc7840e in this term.
I20260709 13:06:14.048555 23762 leader_election.cc:290] T 85c494af21f9457a85da47b9bc70c1fd P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 10 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:06:14.142475 19481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46c5bfeecc314717bffe987e6844b6d0" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 17 candidate_status { last_received { term: 16 index: 7 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:06:14.143507 19481 raft_consensus.cc:2393] T 46c5bfeecc314717bffe987e6844b6d0 P 0473d2b2d01f4459b1e90fd12cc7840e [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate e61c3a8f61bb48f8a963c9480e53c168 in current term 17: Already voted for candidate 0473d2b2d01f4459b1e90fd12cc7840e in this term.
I20260709 13:06:14.144428 19481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4509b76741dc428e9201c70c1658da13" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:06:14.145102 19481 raft_consensus.cc:2468] T 4509b76741dc428e9201c70c1658da13 P 0473d2b2d01f4459b1e90fd12cc7840e [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 7.
I20260709 13:06:14.035921 23874 raft_consensus.cc:493] T 0afb57ae58a24a01850491d69f0213dd P e61c3a8f61bb48f8a963c9480e53c168 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:14.145965 19481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a08760e15aac4630a629431f56024dc8" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 15 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:06:14.160017 20110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85c494af21f9457a85da47b9bc70c1fd" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:06:14.160801 20110 raft_consensus.cc:2368] T 85c494af21f9457a85da47b9bc70c1fd P 127766fc592545a4997f7790f50f6076 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e61c3a8f61bb48f8a963c9480e53c168 for earlier term 9. Current term is 10.
I20260709 13:06:14.147527 20105 raft_consensus.cc:1275] T 833a2f0775ed407a94b8924ce50adb63 P 127766fc592545a4997f7790f50f6076 [term 11 FOLLOWER]: Refusing update from remote peer e5256d91808b47c195bc9b4dbd7f2b87: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:06:14.158943 19402 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "36f6ba92b9ba46babe4ebd6c02e5fbd9"
dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
mode: GRACEFUL
new_leader_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
 from {username='slave'} at 127.0.0.1:37312
I20260709 13:06:14.161144 19481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff75a1d4cb1f493db8f71ddc136ba9ab" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:06:14.162187 19402 raft_consensus.cc:606] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P e5256d91808b47c195bc9b4dbd7f2b87 [term 12 FOLLOWER]: Received request to transfer leadership to TS 0473d2b2d01f4459b1e90fd12cc7840e
I20260709 13:06:14.162245 19481 raft_consensus.cc:2468] T ff75a1d4cb1f493db8f71ddc136ba9ab P 0473d2b2d01f4459b1e90fd12cc7840e [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 11.
I20260709 13:06:14.162642 19402 raft_consensus.cc:614] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P e5256d91808b47c195bc9b4dbd7f2b87 [term 12 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:06:14.163125 19481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c5eebf646ad445a9d1b1adc319d7b16" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:06:14.184091 19481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef32ce6fdd0e40d382c79974f30295c6" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
W20260709 13:06:14.186462 23999 log.cc:927] Time spent T 65d8cb8d6ec64f459d5a47cefab10acf P 127766fc592545a4997f7790f50f6076: Append to log took a long time: real 0.101s	user 0.000s	sys 0.000s
I20260709 13:06:14.139977 23859 raft_consensus.cc:515] T 0cdf56e38bbc453d9438d359e5a69955 P e61c3a8f61bb48f8a963c9480e53c168 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:14.191217 19477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab43d85f64114d4ebf618930e43d9ed0" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 13 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:06:14.191989 19477 raft_consensus.cc:3060] T ab43d85f64114d4ebf618930e43d9ed0 P 0473d2b2d01f4459b1e90fd12cc7840e [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:06:14.193019 23859 leader_election.cc:290] T 0cdf56e38bbc453d9438d359e5a69955 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
W20260709 13:06:14.194526 19375 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.3:36891, user_credentials={real_user=slave}} blocked reactor thread for 94882.7us
I20260709 13:06:14.194844 19481 raft_consensus.cc:2410] T ef32ce6fdd0e40d382c79974f30295c6 P 0473d2b2d01f4459b1e90fd12cc7840e [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e61c3a8f61bb48f8a963c9480e53c168 for term 15 because replica has last-logged OpId of term: 13 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 7.
I20260709 13:06:14.103720 23638 raft_consensus.cc:493] T ff9b0eddd810459b82d91c60777c10eb P 127766fc592545a4997f7790f50f6076 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:14.100630 23768 leader_election.cc:290] T f93ee515a9c14139bf566522ed8232f3 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:06:14.197939 20106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70797e5783b5454ab0d0eea663e791e3" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:06:14.198976 19523 leader_election.cc:400] T 85c494af21f9457a85da47b9bc70c1fd P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 9 pre-election: Vote denied by peer 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121) with higher term. Message: Invalid argument: T 85c494af21f9457a85da47b9bc70c1fd P 127766fc592545a4997f7790f50f6076 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e61c3a8f61bb48f8a963c9480e53c168 for earlier term 9. Current term is 10.
I20260709 13:06:14.238729 19523 leader_election.cc:403] T 85c494af21f9457a85da47b9bc70c1fd P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 9 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:06:14.202879 23919 raft_consensus.cc:1081] T 2725d2c4cb054f18b0fc8f735c15f6c2 P e5256d91808b47c195bc9b4dbd7f2b87 [term 14 LEADER]: Signalling peer e61c3a8f61bb48f8a963c9480e53c168 to start an election
I20260709 13:06:14.203042 23872 raft_consensus.cc:493] T f1b10566f45d4a7d9029858330e02d5b P 0473d2b2d01f4459b1e90fd12cc7840e [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:14.204376 23687 raft_consensus.cc:2804] T ff75a1d4cb1f493db8f71ddc136ba9ab P e5256d91808b47c195bc9b4dbd7f2b87 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:06:14.206796 24001 raft_consensus.cc:493] T 2a16f7501e2444fb86d4e2778e734e02 P e61c3a8f61bb48f8a963c9480e53c168 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader e5256d91808b47c195bc9b4dbd7f2b87)
I20260709 13:06:14.208122 23795 leader_election.cc:290] T ef32ce6fdd0e40d382c79974f30295c6 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:06:14.164234 23605 leader_election.cc:290] T 28af091831594f9d8e96482078cc7625 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 13 election: Requested vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:06:14.209275 23817 raft_consensus.cc:515] T 6c5eebf646ad445a9d1b1adc319d7b16 P e61c3a8f61bb48f8a963c9480e53c168 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:14.210458 23833 raft_consensus.cc:3055] T 1a61655d99124a29b486ba4a5b37faea P e5256d91808b47c195bc9b4dbd7f2b87 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:06:14.210740 19477 raft_consensus.cc:2468] T ab43d85f64114d4ebf618930e43d9ed0 P 0473d2b2d01f4459b1e90fd12cc7840e [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 13.
W20260709 13:06:14.212332 24002 log.cc:927] Time spent T 2725d2c4cb054f18b0fc8f735c15f6c2 P 0473d2b2d01f4459b1e90fd12cc7840e: Append to log took a long time: real 0.165s	user 0.000s	sys 0.001s
I20260709 13:06:14.214067 23944 raft_consensus.cc:993] T 22196caba61445d3bec98a0aab3c337d P 0473d2b2d01f4459b1e90fd12cc7840e: : Instructing follower e61c3a8f61bb48f8a963c9480e53c168 to start an election
I20260709 13:06:14.061195 23918 raft_consensus.cc:515] T ef32ce6fdd0e40d382c79974f30295c6 P e5256d91808b47c195bc9b4dbd7f2b87 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:14.229254 23933 raft_consensus.cc:493] T 9962423cb4e54fcfa5de01daf68a86e7 P 0473d2b2d01f4459b1e90fd12cc7840e [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 127766fc592545a4997f7790f50f6076)
I20260709 13:06:14.185110 23874 raft_consensus.cc:515] T 0afb57ae58a24a01850491d69f0213dd P e61c3a8f61bb48f8a963c9480e53c168 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
W20260709 13:06:14.242523 19524 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:14.242848 20104 raft_consensus.cc:1240] T 62c6c134d3d24a1ab144dd9ee6bc3f64 P 127766fc592545a4997f7790f50f6076 [term 11 FOLLOWER]: Rejecting Update request from peer e61c3a8f61bb48f8a963c9480e53c168 for earlier term 10. Current term is 11. Ops: []
I20260709 13:06:14.146349 23998 raft_consensus.cc:493] T 1dc5b3532fe54f74876d02beffa2c230 P e61c3a8f61bb48f8a963c9480e53c168 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader e5256d91808b47c195bc9b4dbd7f2b87)
W20260709 13:06:14.246573 20108 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46436 (request call id 694) took 1668 ms (client timeout 1518 ms). Trace:
W20260709 13:06:14.249047 19523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.4:43121, user_credentials={real_user=slave}} blocked reactor thread for 50258.7us
W20260709 13:06:14.264334 23829 consensus_meta.cc:287] T 0cdf56e38bbc453d9438d359e5a69955 P 0473d2b2d01f4459b1e90fd12cc7840e: Time spent flushing consensus metadata: real 1.401s	user 0.006s	sys 0.007s
W20260709 13:06:14.056077 23847 consensus_meta.cc:287] T edd7d470b5014c9489be7f41f64355c9 P 0473d2b2d01f4459b1e90fd12cc7840e: Time spent flushing consensus metadata: real 1.031s	user 0.010s	sys 0.010s
I20260709 13:06:14.267280 19478 raft_consensus.cc:2468] T 1a61655d99124a29b486ba4a5b37faea P 0473d2b2d01f4459b1e90fd12cc7840e [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 9.
I20260709 13:06:14.293752 23829 raft_consensus.cc:515] T 0cdf56e38bbc453d9438d359e5a69955 P 0473d2b2d01f4459b1e90fd12cc7840e [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:14.239953 23859 raft_consensus.cc:493] T fa8650e71aa14778b3d73721fc50d9fc P e61c3a8f61bb48f8a963c9480e53c168 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 0473d2b2d01f4459b1e90fd12cc7840e)
I20260709 13:06:14.295040 23859 raft_consensus.cc:515] T fa8650e71aa14778b3d73721fc50d9fc P e61c3a8f61bb48f8a963c9480e53c168 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:14.297253 23859 leader_election.cc:290] T fa8650e71aa14778b3d73721fc50d9fc P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:06:14.295048 23740 raft_consensus.cc:1081] T 22196caba61445d3bec98a0aab3c337d P 0473d2b2d01f4459b1e90fd12cc7840e [term 9 LEADER]: Signalling peer e61c3a8f61bb48f8a963c9480e53c168 to start an election
I20260709 13:06:14.298827 23538 leader_election.cc:290] T 3e1f505cb0f1427bbd698ac889d80821 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 13 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:06:14.298884 23998 raft_consensus.cc:515] T 1dc5b3532fe54f74876d02beffa2c230 P e61c3a8f61bb48f8a963c9480e53c168 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:14.301069 23998 leader_election.cc:290] T 1dc5b3532fe54f74876d02beffa2c230 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:06:14.253773 23833 raft_consensus.cc:740] T 1a61655d99124a29b486ba4a5b37faea P e5256d91808b47c195bc9b4dbd7f2b87 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: e5256d91808b47c195bc9b4dbd7f2b87, State: Running, Role: LEADER
I20260709 13:06:14.302300 23833 consensus_queue.cc:260] T 1a61655d99124a29b486ba4a5b37faea P e5256d91808b47c195bc9b4dbd7f2b87 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:14.303510 23833 raft_consensus.cc:3060] T 1a61655d99124a29b486ba4a5b37faea P e5256d91808b47c195bc9b4dbd7f2b87 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:06:14.305269 23817 leader_election.cc:290] T 6c5eebf646ad445a9d1b1adc319d7b16 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 11 election: Requested vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:06:14.305871 24010 consensus_queue.cc:1048] T 70797e5783b5454ab0d0eea663e791e3 P 127766fc592545a4997f7790f50f6076 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:06:14.248677 23872 raft_consensus.cc:515] T f1b10566f45d4a7d9029858330e02d5b P 0473d2b2d01f4459b1e90fd12cc7840e [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
W20260709 13:06:14.308272 23884 consensus_meta.cc:287] T 3e1f505cb0f1427bbd698ac889d80821 P e5256d91808b47c195bc9b4dbd7f2b87: Time spent flushing consensus metadata: real 0.598s	user 0.004s	sys 0.006s
I20260709 13:06:14.308648 23884 raft_consensus.cc:515] T 3e1f505cb0f1427bbd698ac889d80821 P e5256d91808b47c195bc9b4dbd7f2b87 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:14.309155 23872 leader_election.cc:290] T f1b10566f45d4a7d9029858330e02d5b P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:06:14.284308 23933 raft_consensus.cc:515] T 9962423cb4e54fcfa5de01daf68a86e7 P 0473d2b2d01f4459b1e90fd12cc7840e [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:14.243184 23692 raft_consensus.cc:515] T df751f992649444090e27965eb1af85d P e5256d91808b47c195bc9b4dbd7f2b87 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:14.252439 24001 raft_consensus.cc:515] T 2a16f7501e2444fb86d4e2778e734e02 P e61c3a8f61bb48f8a963c9480e53c168 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:14.244272 23638 raft_consensus.cc:515] T ff9b0eddd810459b82d91c60777c10eb P 127766fc592545a4997f7790f50f6076 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:14.334684 20106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c5eebf646ad445a9d1b1adc319d7b16" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076"
I20260709 13:06:14.303563 23919 consensus_queue.cc:1048] T 833a2f0775ed407a94b8924ce50adb63 P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Connected to new peer: Peer: permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.033s
I20260709 13:06:14.336980 23911 raft_consensus.cc:493] T 65d8cb8d6ec64f459d5a47cefab10acf P 127766fc592545a4997f7790f50f6076 [term 11 FOLLOWER]: Starting leader election (detected failure of leader e5256d91808b47c195bc9b4dbd7f2b87)
I20260709 13:06:14.337459 23911 raft_consensus.cc:3060] T 65d8cb8d6ec64f459d5a47cefab10acf P 127766fc592545a4997f7790f50f6076 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:06:14.312887 23761 leader_election.cc:290] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:06:14.340183 23714 leader_election.cc:290] T 96efeaaf1057492490e9a621f37e1a2d P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:06:14.345774 19407 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52342 (request call id 2579) took 1172 ms. Trace:
I20260709 13:06:14.346350 19554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76cb037fc9064d13b59a8969d897ce8c" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
W20260709 13:06:14.355521 19449 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.1:40321, user_credentials={real_user=slave}} blocked reactor thread for 441625us
I20260709 13:06:14.356518 19551 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41504 (request call id 654) took 1066 ms. Trace:
I20260709 13:06:14.356876 19551 rpcz_store.cc:276] 0709 13:06:13.290282 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:13.309433 (+ 19151us) service_pool.cc:224] Handling call
0709 13:06:14.356374 (+1046941us) spinlock_profiling.cc:243] Waited 84.1 ms on lock 0x7b5400319cd4. stack: 00007f4a79de9343 00007f4a79de9240 00007f4a797781d4 00007f4a834b6304 00007f4a834b6299 00007f4a7ce71571 00007f4a7cf0c2fa 00007f4a81ecdb17 00007f4a7b4486d4 00007f4a7b448662 00007f4a7b448591 00007f4a7b44850c 00007f4a7b4477c2 00007f4a7b24348c 00007f4a7b2428c6 00007f4a7b24226f
0709 13:06:14.356469 (+    95us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":193453440}
I20260709 13:06:14.315687 23971 leader_election.cc:290] T 2b74109013a140ada21feeef92d6f563 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:06:14.247102 23687 raft_consensus.cc:493] T ff75a1d4cb1f493db8f71ddc136ba9ab P e5256d91808b47c195bc9b4dbd7f2b87 [term 10 FOLLOWER]: Starting leader election (detected failure of leader e61c3a8f61bb48f8a963c9480e53c168)
W20260709 13:06:14.250910 19484 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.513s	user 0.010s	sys 0.035s
W20260709 13:06:14.284693 20108 rpcz_store.cc:269] 0709 13:06:12.574647 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:12.574808 (+   161us) service_pool.cc:224] Handling call
0709 13:06:14.242541 (+1667733us) spinlock_profiling.cc:243] Waited 176 ms on lock 0x7b540064fad4. stack: 00007f4a79de9343 00007f4a79de9240 00007f4a797781d4 00007f4a834b6304 00007f4a834b6299 00007f4a7ce71571 00007f4a7cf0c2fa 00007f4a81ecdb17 00007f4a7b4486d4 00007f4a7b448662 00007f4a7b448591 00007f4a7b44850c 00007f4a7b4477c2 00007f4a7b24348c 00007f4a7b2428c6 00007f4a7b24226f
0709 13:06:14.242664 (+   123us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":403653376}
I20260709 13:06:14.252867 23893 raft_consensus.cc:3060] T 85c494af21f9457a85da47b9bc70c1fd P e61c3a8f61bb48f8a963c9480e53c168 [term 8 FOLLOWER]: Advancing to term 10
I20260709 13:06:14.346164 19407 rpcz_store.cc:276] 0709 13:06:13.173142 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:13.173260 (+   118us) service_pool.cc:224] Handling call
0709 13:06:13.173475 (+   215us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:13.758274 (+584799us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:14.345583 (+587309us) spinlock_profiling.cc:243] Waited 584 ms on lock 0x7b54000e74d4. stack: 00007f4a79de9343 00007f4a79de9240 00007f4a797781d4 00007f4a834b6304 00007f4a834b6299 00007f4a7ce71571 00007f4a7cf08e01 00007f4a7cf0783e 00007f4a81ecc419 00007f4a7b443bd4 00007f4a7b443b62 00007f4a7b443a91 00007f4a7b443a0c 00007f4a7b442cc2 00007f4a7b24348c 00007f4a7b2428c6
0709 13:06:14.345722 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1343181056}
W20260709 13:06:14.363989 19484 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.627s	user 0.010s	sys 0.035s
W20260709 13:06:14.245566 23920 consensus_meta.cc:287] T 775c229504194560ba9589bc2199b089 P e5256d91808b47c195bc9b4dbd7f2b87: Time spent flushing consensus metadata: real 0.597s	user 0.007s	sys 0.003s
I20260709 13:06:14.368132 19557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cdf56e38bbc453d9438d359e5a69955" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:06:14.368696 19557 raft_consensus.cc:3060] T 0cdf56e38bbc453d9438d359e5a69955 P e61c3a8f61bb48f8a963c9480e53c168 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:06:14.370922 19553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef32ce6fdd0e40d382c79974f30295c6" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:06:14.371495 19553 raft_consensus.cc:2468] T ef32ce6fdd0e40d382c79974f30295c6 P e61c3a8f61bb48f8a963c9480e53c168 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 14.
I20260709 13:06:14.379650 20103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0afb57ae58a24a01850491d69f0213dd" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:06:14.381407 23692 leader_election.cc:290] T df751f992649444090e27965eb1af85d P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 15 election: Requested vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
W20260709 13:06:14.381996 24012 log.cc:927] Time spent T 1dc5b3532fe54f74876d02beffa2c230 P 0473d2b2d01f4459b1e90fd12cc7840e: Append to log took a long time: real 0.075s	user 0.001s	sys 0.000s
W20260709 13:06:14.366741 24007 log.cc:927] Time spent T a08760e15aac4630a629431f56024dc8 P 0473d2b2d01f4459b1e90fd12cc7840e: Append to log took a long time: real 0.054s	user 0.000s	sys 0.001s
I20260709 13:06:14.325850 23918 leader_election.cc:290] T ef32ce6fdd0e40d382c79974f30295c6 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:06:14.323967 23874 leader_election.cc:290] T 0afb57ae58a24a01850491d69f0213dd P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:06:14.385968 23687 raft_consensus.cc:3060] T ff75a1d4cb1f493db8f71ddc136ba9ab P e5256d91808b47c195bc9b4dbd7f2b87 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:06:14.381944 23920 raft_consensus.cc:493] T 46c5bfeecc314717bffe987e6844b6d0 P e5256d91808b47c195bc9b4dbd7f2b87 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:14.392758 19482 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58294 (request call id 2242) took 1027 ms. Trace:
I20260709 13:06:14.393369 19553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e1f505cb0f1427bbd698ac889d80821" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:06:14.394097 19553 raft_consensus.cc:3060] T 3e1f505cb0f1427bbd698ac889d80821 P e61c3a8f61bb48f8a963c9480e53c168 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:06:14.396059 19411 raft_consensus.cc:2468] T 775c229504194560ba9589bc2199b089 P e5256d91808b47c195bc9b4dbd7f2b87 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 10.
I20260709 13:06:14.397576 19554 raft_consensus.cc:1275] T 48824d5acfbc485ebf8c2d944e7202de P e61c3a8f61bb48f8a963c9480e53c168 [term 13 FOLLOWER]: Refusing update from remote peer 127766fc592545a4997f7790f50f6076: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 13 index: 10. (term mismatch)
I20260709 13:06:14.397668 19484 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58294 (request call id 2249) took 1020 ms. Trace:
I20260709 13:06:14.398007 19554 pending_rounds.cc:85] T 48824d5acfbc485ebf8c2d944e7202de P e61c3a8f61bb48f8a963c9480e53c168: Aborting all ops after (but not including) 9
I20260709 13:06:14.398375 19554 pending_rounds.cc:107] T 48824d5acfbc485ebf8c2d944e7202de P e61c3a8f61bb48f8a963c9480e53c168: Aborting uncommitted NO_OP operation due to leader change: 12.10
W20260709 13:06:14.322319 23414 consensus_meta.cc:287] T 0afb57ae58a24a01850491d69f0213dd P 0473d2b2d01f4459b1e90fd12cc7840e: Time spent flushing consensus metadata: real 0.724s	user 0.010s	sys 0.000s
I20260709 13:06:14.398617 19554 raft_consensus.cc:2889] T 48824d5acfbc485ebf8c2d944e7202de P e61c3a8f61bb48f8a963c9480e53c168 [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:06:14.396871 23755 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.583s	user 0.033s	sys 0.065s
W20260709 13:06:14.322319 23730 consensus_meta.cc:287] T 21e14947d70440f19044d8f75c31e1f9 P e61c3a8f61bb48f8a963c9480e53c168: Time spent flushing consensus metadata: real 0.510s	user 0.006s	sys 0.001s
I20260709 13:06:14.403820 19554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1b10566f45d4a7d9029858330e02d5b" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:06:14.406728 19554 raft_consensus.cc:2468] T f1b10566f45d4a7d9029858330e02d5b P e61c3a8f61bb48f8a963c9480e53c168 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 13.
I20260709 13:06:14.409932 19554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96efeaaf1057492490e9a621f37e1a2d" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:06:14.310609 23884 leader_election.cc:290] T 3e1f505cb0f1427bbd698ac889d80821 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 13 election: Requested vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:06:14.398049 19484 rpcz_store.cc:276] 0709 13:06:13.377153 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:13.393843 (+ 16690us) service_pool.cc:224] Handling call
0709 13:06:13.408391 (+ 14548us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:13.408566 (+   175us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:06:13.735975 (+327409us) log.cc:844] Serialized 14 byte log entry
0709 13:06:14.397323 (+661348us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:14.397376 (+    53us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:06:14.397420 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:14.397502 (+    82us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:14.397617 (+   115us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":180400,"prepare.queue_time_us":613900,"prepare.run_cpu_time_us":49,"prepare.run_wall_time_us":51,"thread_start_us":940158,"threads_started":2}
W20260709 13:06:14.318396 23505 consensus_meta.cc:287] T 7f575b143b844aa096b50997dad3516a P e61c3a8f61bb48f8a963c9480e53c168: Time spent flushing consensus metadata: real 0.579s	user 0.006s	sys 0.001s
W20260709 13:06:14.415217 19406 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.501s	user 0.009s	sys 0.010s
I20260709 13:06:14.393216 19482 rpcz_store.cc:276] 0709 13:06:13.365592 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:13.365754 (+   162us) service_pool.cc:224] Handling call
0709 13:06:13.382992 (+ 17238us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:06:13.400538 (+ 17546us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:13.400568 (+    30us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:06:13.407990 (+  7422us) log.cc:844] Serialized 52 byte log entry
0709 13:06:13.836586 (+428596us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:06:14.284618 (+448032us) log.cc:844] Serialized 14 byte log entry
0709 13:06:14.290901 (+  6283us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:14.290969 (+    68us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:14.392559 (+101590us) raft_consensus.cc:1685] finished
0709 13:06:14.392577 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:14.392705 (+   128us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":17319,"prepare.queue_time_us":392957,"prepare.run_cpu_time_us":24,"prepare.run_wall_time_us":24,"raft.queue_time_us":57017,"raft.run_cpu_time_us":181,"raft.run_wall_time_us":2643,"thread_start_us":805861,"threads_started":2,"wal-append.queue_time_us":866747}
W20260709 13:06:14.430343 19483 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.684s	user 0.014s	sys 0.069s
W20260709 13:06:14.406740 23755 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.593s	user 0.033s	sys 0.066s
I20260709 13:06:14.311468 23933 leader_election.cc:290] T 9962423cb4e54fcfa5de01daf68a86e7 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
W20260709 13:06:14.441861 19483 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.703s	user 0.014s	sys 0.070s
I20260709 13:06:14.417225 19557 raft_consensus.cc:2468] T 0cdf56e38bbc453d9438d359e5a69955 P e61c3a8f61bb48f8a963c9480e53c168 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 14.
I20260709 13:06:14.440585 19556 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "22196caba61445d3bec98a0aab3c337d"
dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
 from {username='slave'} at 127.0.0.1:40428
I20260709 13:06:14.429105 23795 raft_consensus.cc:493] T 48824d5acfbc485ebf8c2d944e7202de P 0473d2b2d01f4459b1e90fd12cc7840e [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:06:14.424281 23945 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.553s	user 0.008s	sys 0.012s
W20260709 13:06:14.448441 19406 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.534s	user 0.009s	sys 0.010s
I20260709 13:06:14.460039 19480 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58294 (request call id 2246) took 1093 ms. Trace:
I20260709 13:06:14.409181 23920 raft_consensus.cc:515] T 46c5bfeecc314717bffe987e6844b6d0 P e5256d91808b47c195bc9b4dbd7f2b87 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
W20260709 13:06:14.464874 19479 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.697s	user 0.034s	sys 0.017s
W20260709 13:06:14.475888 19479 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.708s	user 0.034s	sys 0.017s
I20260709 13:06:14.440207 24010 consensus_queue.cc:1048] T 48824d5acfbc485ebf8c2d944e7202de P 127766fc592545a4997f7790f50f6076 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.030s
I20260709 13:06:14.442369 23979 raft_consensus.cc:493] T 2b74109013a140ada21feeef92d6f563 P 0473d2b2d01f4459b1e90fd12cc7840e [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:14.489377 23979 raft_consensus.cc:515] T 2b74109013a140ada21feeef92d6f563 P 0473d2b2d01f4459b1e90fd12cc7840e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:14.469067 23975 leader_election.cc:290] T 48824d5acfbc485ebf8c2d944e7202de P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:06:14.460551 23896 raft_consensus.cc:493] T 309c3ca0ca4b4f3ba129752ea2cb293b P 0473d2b2d01f4459b1e90fd12cc7840e [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 127766fc592545a4997f7790f50f6076)
I20260709 13:06:14.474078 19482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28af091831594f9d8e96482078cc7625" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:06:14.461045 19556 raft_consensus.cc:493] T 22196caba61445d3bec98a0aab3c337d P e61c3a8f61bb48f8a963c9480e53c168 [term 9 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:06:14.512485 19556 raft_consensus.cc:3060] T 22196caba61445d3bec98a0aab3c337d P e61c3a8f61bb48f8a963c9480e53c168 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:06:14.474946 20108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48824d5acfbc485ebf8c2d944e7202de" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:06:14.444751 23820 raft_consensus.cc:493] T 46c5bfeecc314717bffe987e6844b6d0 P 0473d2b2d01f4459b1e90fd12cc7840e [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:14.447996 19553 raft_consensus.cc:2410] T 3e1f505cb0f1427bbd698ac889d80821 P e61c3a8f61bb48f8a963c9480e53c168 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 0473d2b2d01f4459b1e90fd12cc7840e for term 13 because replica has last-logged OpId of term: 11 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 6.
I20260709 13:06:14.462944 23973 raft_consensus.cc:493] T 21e14947d70440f19044d8f75c31e1f9 P e61c3a8f61bb48f8a963c9480e53c168 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:14.484154 23920 leader_election.cc:290] T 46c5bfeecc314717bffe987e6844b6d0 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:06:14.441952 23505 raft_consensus.cc:515] T 7f575b143b844aa096b50997dad3516a P e61c3a8f61bb48f8a963c9480e53c168 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:14.398720 23847 raft_consensus.cc:515] T edd7d470b5014c9489be7f41f64355c9 P 0473d2b2d01f4459b1e90fd12cc7840e [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:14.471431 19480 rpcz_store.cc:276] 0709 13:06:13.376074 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:13.378046 (+  1972us) service_pool.cc:224] Handling call
0709 13:06:13.378438 (+   392us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:13.437349 (+ 58911us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:13.437390 (+    41us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:13.437915 (+   525us) log.cc:844] Serialized 26 byte log entry
0709 13:06:13.760048 (+322133us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:06:14.242914 (+482866us) log.cc:844] Serialized 14 byte log entry
0709 13:06:14.243237 (+   323us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:14.444264 (+201027us) spinlock_profiling.cc:243] Waited 58.5 ms on lock 0x7b5400148554. stack: 00007f4a79de9343 00007f4a79de9240 00007f4a797781d4 00007f4a834b6304 00007f4a834b6299 00007f4a7ce71571 00007f4a7cf08e01 00007f4a7cf0783e 00007f4a81ecc419 00007f4a7b443bd4 00007f4a7b443b62 00007f4a7b443a91 00007f4a7b443a0c 00007f4a7b442cc2 00007f4a7b24348c 00007f4a7b2428c6
0709 13:06:14.444329 (+    65us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:14.444388 (+    59us) raft_consensus.cc:1685] finished
0709 13:06:14.459838 (+ 15450us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:14.459984 (+   146us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":23437,"prepare.queue_time_us":469165,"prepare.run_cpu_time_us":29,"prepare.run_wall_time_us":31,"raft.queue_time_us":1254,"raft.run_cpu_time_us":333,"raft.run_wall_time_us":32953,"spinlock_wait_cycles":134496640,"thread_start_us":792057,"threads_started":2,"wal-append.queue_time_us":725783}
W20260709 13:06:14.471266 23945 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.609s	user 0.009s	sys 0.012s
I20260709 13:06:14.460618 23872 raft_consensus.cc:493] T 5ec1c4ce15e04c7e8c283a62179f2a64 P 0473d2b2d01f4459b1e90fd12cc7840e [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 127766fc592545a4997f7790f50f6076)
I20260709 13:06:14.464598 23933 consensus_queue.cc:1048] T ff9b0eddd810459b82d91c60777c10eb P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.048s
I20260709 13:06:14.549322 19480 raft_consensus.cc:1275] T 96efeaaf1057492490e9a621f37e1a2d P 0473d2b2d01f4459b1e90fd12cc7840e [term 13 FOLLOWER]: Refusing update from remote peer e61c3a8f61bb48f8a963c9480e53c168: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 13:06:14.551352 19486 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58294 (request call id 2245) took 1185 ms. Trace:
I20260709 13:06:14.552639 19482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff75a1d4cb1f493db8f71ddc136ba9ab" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:06:14.553469 19482 raft_consensus.cc:2393] T ff75a1d4cb1f493db8f71ddc136ba9ab P 0473d2b2d01f4459b1e90fd12cc7840e [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e5256d91808b47c195bc9b4dbd7f2b87 in current term 11: Already voted for candidate 0473d2b2d01f4459b1e90fd12cc7840e in this term.
I20260709 13:06:14.554831 19480 raft_consensus.cc:1240] T 1a61655d99124a29b486ba4a5b37faea P 0473d2b2d01f4459b1e90fd12cc7840e [term 9 FOLLOWER]: Rejecting Update request from peer e5256d91808b47c195bc9b4dbd7f2b87 for earlier term 8. Current term is 9. Ops: [8.6-8.6]
I20260709 13:06:14.472106 23795 raft_consensus.cc:515] T 48824d5acfbc485ebf8c2d944e7202de P 0473d2b2d01f4459b1e90fd12cc7840e [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:14.556690 19485 raft_consensus.cc:1240] T edd7d470b5014c9489be7f41f64355c9 P 0473d2b2d01f4459b1e90fd12cc7840e [term 13 FOLLOWER]: Rejecting Update request from peer e5256d91808b47c195bc9b4dbd7f2b87 for earlier term 12. Current term is 13. Ops: [12.6-12.6]
I20260709 13:06:14.539083 23975 raft_consensus.cc:493] T 7be9efa6559648dbb5a0f7684c4542d1 P e61c3a8f61bb48f8a963c9480e53c168 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 0473d2b2d01f4459b1e90fd12cc7840e)
I20260709 13:06:14.552824 23933 consensus_queue.cc:1243] T ff9b0eddd810459b82d91c60777c10eb P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Peer e5256d91808b47c195bc9b4dbd7f2b87 log is divergent from this leader: its last log entry 10.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 8
W20260709 13:06:14.577342 19375 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.3:36891, user_credentials={real_user=slave}} blocked reactor thread for 381949us
I20260709 13:06:14.512660 23911 raft_consensus.cc:515] T 65d8cb8d6ec64f459d5a47cefab10acf P 127766fc592545a4997f7790f50f6076 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:14.551831 19486 rpcz_store.cc:276] 0709 13:06:13.366383 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:13.366483 (+   100us) service_pool.cc:224] Handling call
0709 13:06:13.366774 (+   291us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:06:13.367097 (+   323us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:13.367124 (+    27us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:06:13.383480 (+ 16356us) log.cc:844] Serialized 52 byte log entry
0709 13:06:14.050789 (+667309us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:06:14.548853 (+498064us) log.cc:844] Serialized 14 byte log entry
0709 13:06:14.549125 (+   272us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:14.551062 (+  1937us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:14.551117 (+    55us) raft_consensus.cc:1685] finished
0709 13:06:14.551134 (+    17us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:14.551288 (+   154us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":7478,"prepare.queue_time_us":178908,"prepare.run_cpu_time_us":28,"prepare.run_wall_time_us":28,"raft.queue_time_us":20357,"raft.run_cpu_time_us":122,"raft.run_wall_time_us":5672,"thread_start_us":1128189,"threads_started":2,"wal-append.queue_time_us":872957}
I20260709 13:06:14.542302 23973 raft_consensus.cc:515] T 21e14947d70440f19044d8f75c31e1f9 P e61c3a8f61bb48f8a963c9480e53c168 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:14.540577 23820 raft_consensus.cc:515] T 46c5bfeecc314717bffe987e6844b6d0 P 0473d2b2d01f4459b1e90fd12cc7840e [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:14.583940 19375 leader_election.cc:304] T f1b10566f45d4a7d9029858330e02d5b P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:06:14.535356 23896 raft_consensus.cc:515] T 309c3ca0ca4b4f3ba129752ea2cb293b P 0473d2b2d01f4459b1e90fd12cc7840e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } attrs { replace: true } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
W20260709 13:06:14.589007 19374 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.4:43121, user_credentials={real_user=slave}} blocked reactor thread for 383070us
I20260709 13:06:14.580708 23944 raft_consensus.cc:493] T 0afb57ae58a24a01850491d69f0213dd P 0473d2b2d01f4459b1e90fd12cc7840e [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:14.554958 23872 raft_consensus.cc:515] T 5ec1c4ce15e04c7e8c283a62179f2a64 P 0473d2b2d01f4459b1e90fd12cc7840e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:14.580330 23805 raft_consensus.cc:493] T 2a16f7501e2444fb86d4e2778e734e02 P 127766fc592545a4997f7790f50f6076 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader e5256d91808b47c195bc9b4dbd7f2b87)
W20260709 13:06:14.632633 19526 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.17.223.2:46257 timed out after 1.664s (SENT) [suppressed 16 similar messages]
I20260709 13:06:14.634073 19407 raft_consensus.cc:1275] T 1f85fc4b527a48848e5faa083b604e36 P e5256d91808b47c195bc9b4dbd7f2b87 [term 11 FOLLOWER]: Refusing update from remote peer 127766fc592545a4997f7790f50f6076: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:06:14.645336 19405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46c5bfeecc314717bffe987e6844b6d0" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 17 candidate_status { last_received { term: 16 index: 7 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
I20260709 13:06:14.647205 19409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36f6ba92b9ba46babe4ebd6c02e5fbd9" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:06:14.647877 19409 raft_consensus.cc:2468] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P e5256d91808b47c195bc9b4dbd7f2b87 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 127766fc592545a4997f7790f50f6076 in term 12.
I20260709 13:06:14.614527 23920 raft_consensus.cc:2804] T f1b10566f45d4a7d9029858330e02d5b P e5256d91808b47c195bc9b4dbd7f2b87 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:06:14.577499 23975 raft_consensus.cc:515] T 7be9efa6559648dbb5a0f7684c4542d1 P e61c3a8f61bb48f8a963c9480e53c168 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } attrs { replace: true } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:14.614645 23950 raft_consensus.cc:493] T 0e1085d23e8347fbbd5bce7542f4b1f4 P 127766fc592545a4997f7790f50f6076 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 0473d2b2d01f4459b1e90fd12cc7840e)
I20260709 13:06:14.652078 19410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a08760e15aac4630a629431f56024dc8" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 15 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:06:14.653646 19402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85c494af21f9457a85da47b9bc70c1fd" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
I20260709 13:06:14.648586 19403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e1f505cb0f1427bbd698ac889d80821" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:06:14.664448 23777 consensus_queue.cc:1048] T 833a2f0775ed407a94b8924ce50adb63 P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.012s
I20260709 13:06:14.685684 19402 raft_consensus.cc:3060] T 85c494af21f9457a85da47b9bc70c1fd P e5256d91808b47c195bc9b4dbd7f2b87 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:06:14.687189 19410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff75a1d4cb1f493db8f71ddc136ba9ab" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:06:14.684352 19555 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40438 (request call id 2410) took 1576 ms. Trace:
I20260709 13:06:14.688074 19403 raft_consensus.cc:2393] T 3e1f505cb0f1427bbd698ac889d80821 P e5256d91808b47c195bc9b4dbd7f2b87 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e61c3a8f61bb48f8a963c9480e53c168 in current term 13: Already voted for candidate e5256d91808b47c195bc9b4dbd7f2b87 in this term.
W20260709 13:06:14.693630 19450 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.3:36891, user_credentials={real_user=slave}} blocked reactor thread for 258554us
I20260709 13:06:14.696307 19477 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58294 (request call id 2255) took 1315 ms. Trace:
I20260709 13:06:14.697036 19407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa731b585f684a7fb2d106c50f143b83" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:06:14.696796 19477 rpcz_store.cc:276] 0709 13:06:13.381091 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:14.275424 (+894333us) service_pool.cc:224] Handling call
0709 13:06:14.275790 (+   366us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:14.275974 (+   184us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:06:14.276213 (+   239us) log.cc:844] Serialized 14 byte log entry
0709 13:06:14.695848 (+419635us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:14.695923 (+    75us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:06:14.695995 (+    72us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:14.696084 (+    89us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:14.696240 (+   156us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":106,"prepare.run_cpu_time_us":31,"prepare.run_wall_time_us":31,"thread_start_us":414780,"threads_started":1}
W20260709 13:06:14.695242 19449 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.1:40321, user_credentials={real_user=slave}} blocked reactor thread for 337490us
I20260709 13:06:14.688112 19556 raft_consensus.cc:515] T 22196caba61445d3bec98a0aab3c337d P e61c3a8f61bb48f8a963c9480e53c168 [term 10 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:14.699086 19449 leader_election.cc:304] T 7f575b143b844aa096b50997dad3516a P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e; no voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:06:14.653506 23893 raft_consensus.cc:2749] T 85c494af21f9457a85da47b9bc70c1fd P e61c3a8f61bb48f8a963c9480e53c168 [term 10 FOLLOWER]: Leader pre-election lost for term 9. Reason: Vote denied by peer 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121) with higher term. Message: Invalid argument: T 85c494af21f9457a85da47b9bc70c1fd P 127766fc592545a4997f7790f50f6076 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e61c3a8f61bb48f8a963c9480e53c168 for earlier term 9. Current term is 10.
I20260709 13:06:14.668591 24024 raft_consensus.cc:493] T 1f85fc4b527a48848e5faa083b604e36 P 0473d2b2d01f4459b1e90fd12cc7840e [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:14.666571 23872 leader_election.cc:290] T 5ec1c4ce15e04c7e8c283a62179f2a64 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:06:14.667413 23505 leader_election.cc:290] T 7f575b143b844aa096b50997dad3516a P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 9 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:06:14.624734 23944 raft_consensus.cc:515] T 0afb57ae58a24a01850491d69f0213dd P 0473d2b2d01f4459b1e90fd12cc7840e [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:14.648465 23979 leader_election.cc:290] T 2b74109013a140ada21feeef92d6f563 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:06:14.739521 19407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85c494af21f9457a85da47b9bc70c1fd" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:06:14.692643 19555 rpcz_store.cc:276] 0709 13:06:13.107890 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:13.109432 (+  1542us) service_pool.cc:224] Handling call
0709 13:06:13.109790 (+   358us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:13.110026 (+   236us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:06:13.110324 (+   298us) log.cc:844] Serialized 14 byte log entry
0709 13:06:14.235017 (+1124693us) spinlock_profiling.cc:243] Waited 1.38 ms on lock 0x7b18000f7420. stack: 00007f4a79de9343 00007f4a79de9240 00007f4a797781d4 00007f4a834b6304 00007f4a834b6299 00007f4a82ce3de1 00007f4a82cf05b1 00007f4a79dfde07 00007f4a82c58ab9 00007f4a79e1a69b 00007f4a79e1893f 00007f4a79e18455 00007f4a7cf00060 00007f4a7cf12716 00007f4a7cf23287 00007f4a7cf23208
0709 13:06:14.683911 (+448894us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:14.683980 (+    69us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:06:14.684046 (+    66us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:14.684136 (+    90us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:14.684282 (+   146us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":22359,"prepare.queue_time_us":133,"prepare.run_cpu_time_us":46,"prepare.run_wall_time_us":2204,"raft.queue_time_us":89439,"raft.run_cpu_time_us":154,"raft.run_wall_time_us":49490,"spinlock_wait_cycles":3179264,"thread_start_us":448730,"threads_started":1}
I20260709 13:06:14.740085 19556 leader_election.cc:290] T 22196caba61445d3bec98a0aab3c337d P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 10 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:06:14.745783 19408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef32ce6fdd0e40d382c79974f30295c6" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:06:14.748533 19408 raft_consensus.cc:2468] T ef32ce6fdd0e40d382c79974f30295c6 P e5256d91808b47c195bc9b4dbd7f2b87 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 14.
I20260709 13:06:14.716289 19405 raft_consensus.cc:2468] T 46c5bfeecc314717bffe987e6844b6d0 P e5256d91808b47c195bc9b4dbd7f2b87 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 17.
I20260709 13:06:14.751886 19402 raft_consensus.cc:2468] T 85c494af21f9457a85da47b9bc70c1fd P e5256d91808b47c195bc9b4dbd7f2b87 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 127766fc592545a4997f7790f50f6076 in term 10.
I20260709 13:06:14.640326 23805 raft_consensus.cc:515] T 2a16f7501e2444fb86d4e2778e734e02 P 127766fc592545a4997f7790f50f6076 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:14.673992 23762 consensus_queue.cc:1048] T 1f85fc4b527a48848e5faa083b604e36 P 127766fc592545a4997f7790f50f6076 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.065s
I20260709 13:06:14.707578 23833 raft_consensus.cc:493] T b08304a0a02b42d7840c4e8ee9a6bd1a P e5256d91808b47c195bc9b4dbd7f2b87 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 0473d2b2d01f4459b1e90fd12cc7840e)
I20260709 13:06:14.689340 23755 raft_consensus.cc:493] T 217b5fae677b4971b3bbd2f357a1f7ff P e61c3a8f61bb48f8a963c9480e53c168 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader e5256d91808b47c195bc9b4dbd7f2b87)
I20260709 13:06:14.783970 20105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9962423cb4e54fcfa5de01daf68a86e7" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:06:14.690470 23687 raft_consensus.cc:515] T ff75a1d4cb1f493db8f71ddc136ba9ab P e5256d91808b47c195bc9b4dbd7f2b87 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:14.788136 20110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96efeaaf1057492490e9a621f37e1a2d" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:06:14.711454 23740 raft_consensus.cc:2749] T 7f575b143b844aa096b50997dad3516a P 0473d2b2d01f4459b1e90fd12cc7840e [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
W20260709 13:06:14.814146 19524 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:14.718086 23920 raft_consensus.cc:697] T f1b10566f45d4a7d9029858330e02d5b P e5256d91808b47c195bc9b4dbd7f2b87 [term 13 LEADER]: Becoming Leader. State: Replica: e5256d91808b47c195bc9b4dbd7f2b87, State: Running, Role: LEADER
W20260709 13:06:14.785930 23993 log.cc:927] Time spent T 70797e5783b5454ab0d0eea663e791e3 P e5256d91808b47c195bc9b4dbd7f2b87: Append to log took a long time: real 0.066s	user 0.000s	sys 0.000s
I20260709 13:06:14.693460 23950 raft_consensus.cc:515] T 0e1085d23e8347fbbd5bce7542f4b1f4 P 127766fc592545a4997f7790f50f6076 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:14.790580 19483 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58294 (request call id 2252) took 1410 ms. Trace:
I20260709 13:06:14.822867 19410 raft_consensus.cc:2468] T ff75a1d4cb1f493db8f71ddc136ba9ab P e5256d91808b47c195bc9b4dbd7f2b87 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 11.
I20260709 13:06:14.823482 19402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4509b76741dc428e9201c70c1658da13" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:06:14.837018 19402 raft_consensus.cc:2393] T 4509b76741dc428e9201c70c1658da13 P e5256d91808b47c195bc9b4dbd7f2b87 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e61c3a8f61bb48f8a963c9480e53c168 in current term 7: Already voted for candidate e5256d91808b47c195bc9b4dbd7f2b87 in this term.
I20260709 13:06:14.785835 23768 raft_consensus.cc:493] T 62c6c134d3d24a1ab144dd9ee6bc3f64 P e61c3a8f61bb48f8a963c9480e53c168 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:14.745770 23823 consensus_queue.cc:1059] T 28af091831594f9d8e96482078cc7625 P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 }, Status: INVALID_TERM, Last received: 12.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.075s
I20260709 13:06:14.837918 19483 rpcz_store.cc:276] 0709 13:06:13.380088 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:13.406786 (+ 26698us) service_pool.cc:224] Handling call
0709 13:06:13.407065 (+   279us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:13.407251 (+   186us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:06:13.738617 (+331366us) log.cc:844] Serialized 14 byte log entry
0709 13:06:14.788489 (+1049872us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:14.788538 (+    49us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:06:14.788595 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:14.788655 (+    60us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:14.790524 (+  1869us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":109279,"prepare.queue_time_us":636680,"prepare.run_cpu_time_us":46,"prepare.run_wall_time_us":4146,"raft.queue_time_us":12035,"raft.run_cpu_time_us":131,"raft.run_wall_time_us":2675,"spinlock_wait_cycles":31630208,"thread_start_us":1358192,"threads_started":3,"wal-append.queue_time_us":881129}
I20260709 13:06:14.794148 23847 leader_election.cc:290] T edd7d470b5014c9489be7f41f64355c9 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 13 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:06:14.794099 23973 leader_election.cc:290] T 21e14947d70440f19044d8f75c31e1f9 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
W20260709 13:06:14.854872 19526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.2:46257, user_credentials={real_user=slave}} blocked reactor thread for 222262us
I20260709 13:06:14.854954 23768 raft_consensus.cc:515] T 62c6c134d3d24a1ab144dd9ee6bc3f64 P e61c3a8f61bb48f8a963c9480e53c168 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:14.859134 23945 raft_consensus.cc:493] T 172b3dd13109415a955b71ac0e9d2234 P 0473d2b2d01f4459b1e90fd12cc7840e [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 127766fc592545a4997f7790f50f6076)
I20260709 13:06:14.859660 23973 raft_consensus.cc:493] T d1e5873a19244c5ebbcd38e126796ee7 P e61c3a8f61bb48f8a963c9480e53c168 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader e5256d91808b47c195bc9b4dbd7f2b87)
I20260709 13:06:14.860165 23973 raft_consensus.cc:515] T d1e5873a19244c5ebbcd38e126796ee7 P e61c3a8f61bb48f8a963c9480e53c168 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:14.747576 24024 raft_consensus.cc:515] T 1f85fc4b527a48848e5faa083b604e36 P 0473d2b2d01f4459b1e90fd12cc7840e [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:14.860637 23768 leader_election.cc:290] T 62c6c134d3d24a1ab144dd9ee6bc3f64 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:06:14.862069 23973 leader_election.cc:290] T d1e5873a19244c5ebbcd38e126796ee7 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:06:14.862332 24024 leader_election.cc:290] T 1f85fc4b527a48848e5faa083b604e36 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:06:14.859674 23945 raft_consensus.cc:515] T 172b3dd13109415a955b71ac0e9d2234 P 0473d2b2d01f4459b1e90fd12cc7840e [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:14.863404 23896 leader_election.cc:290] T 309c3ca0ca4b4f3ba129752ea2cb293b P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:06:14.863796 23805 leader_election.cc:290] T 2a16f7501e2444fb86d4e2778e734e02 P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:06:14.794057 23833 raft_consensus.cc:515] T b08304a0a02b42d7840c4e8ee9a6bd1a P e5256d91808b47c195bc9b4dbd7f2b87 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:14.864537 20103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ec1c4ce15e04c7e8c283a62179f2a64" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:06:14.864678 23945 leader_election.cc:290] T 172b3dd13109415a955b71ac0e9d2234 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:06:14.866055 23833 leader_election.cc:290] T b08304a0a02b42d7840c4e8ee9a6bd1a P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:06:14.867122 19526 leader_election.cc:304] T 4509b76741dc428e9201c70c1658da13 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:06:14.867921 23973 raft_consensus.cc:2804] T 4509b76741dc428e9201c70c1658da13 P e61c3a8f61bb48f8a963c9480e53c168 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:06:14.868325 23973 raft_consensus.cc:493] T 4509b76741dc428e9201c70c1658da13 P e61c3a8f61bb48f8a963c9480e53c168 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 0473d2b2d01f4459b1e90fd12cc7840e)
I20260709 13:06:14.868703 23973 raft_consensus.cc:3060] T 4509b76741dc428e9201c70c1658da13 P e61c3a8f61bb48f8a963c9480e53c168 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:06:14.871335 24022 log.cc:927] Time spent T 6c5eebf646ad445a9d1b1adc319d7b16 P 127766fc592545a4997f7790f50f6076: Append to log took a long time: real 0.289s	user 0.000s	sys 0.000s
I20260709 13:06:14.872751 23950 leader_election.cc:290] T 0e1085d23e8347fbbd5bce7542f4b1f4 P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:06:14.873127 23944 leader_election.cc:290] T 0afb57ae58a24a01850491d69f0213dd P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:06:14.823248 23714 raft_consensus.cc:493] T 21e14947d70440f19044d8f75c31e1f9 P 0473d2b2d01f4459b1e90fd12cc7840e [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:14.875026 23920 consensus_queue.cc:237] T f1b10566f45d4a7d9029858330e02d5b P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:14.875731 23687 leader_election.cc:290] T ff75a1d4cb1f493db8f71ddc136ba9ab P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 11 election: Requested vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:06:14.876475 23945 raft_consensus.cc:3055] T 28af091831594f9d8e96482078cc7625 P 0473d2b2d01f4459b1e90fd12cc7840e [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:06:14.876806 19558 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40438 (request call id 2412) took 1768 ms. Trace:
I20260709 13:06:14.876896 23945 raft_consensus.cc:740] T 28af091831594f9d8e96482078cc7625 P 0473d2b2d01f4459b1e90fd12cc7840e [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 0473d2b2d01f4459b1e90fd12cc7840e, State: Running, Role: LEADER
I20260709 13:06:14.877230 19558 rpcz_store.cc:276] 0709 13:06:13.108508 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:13.401116 (+292608us) service_pool.cc:224] Handling call
0709 13:06:13.401388 (+   272us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:13.833381 (+431993us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:13.833429 (+    48us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:14.097189 (+263760us) spinlock_profiling.cc:243] Waited 5.27 ms on lock 0x7b2c00078318. stack: 00007f4a79de9343 00007f4a79de9240 00007f4a797781d4 00007f4a834b6304 00007f4a834b6299 00007f4a7b801a11 00007f4a7b811372 00007f4a7cf43a01 00007f4a7cf0843a 00007f4a7cf0783e 00007f4a81ecc419 00007f4a7b443bd4 00007f4a7b443b62 00007f4a7b443a91 00007f4a7b443a0c 00007f4a7b442cc2
0709 13:06:14.097609 (+   420us) log.cc:844] Serialized 26 byte log entry
0709 13:06:14.574642 (+477033us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:06:14.574701 (+    59us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:14.574777 (+    76us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:14.876506 (+301729us) raft_consensus.cc:1685] finished
0709 13:06:14.876533 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:14.876750 (+   217us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":195873,"raft.run_cpu_time_us":150,"raft.run_wall_time_us":33306,"spinlock_wait_cycles":12113280,"thread_start_us":907698,"threads_started":2,"wal-append.queue_time_us":649514}
I20260709 13:06:14.879312 24024 raft_consensus.cc:493] T 1dc5b3532fe54f74876d02beffa2c230 P 0473d2b2d01f4459b1e90fd12cc7840e [term 12 FOLLOWER]: Starting pre-election (detected failure of leader e5256d91808b47c195bc9b4dbd7f2b87)
I20260709 13:06:14.879599 20109 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46436 (request call id 699) took 1017 ms. Trace:
I20260709 13:06:14.879840 24024 raft_consensus.cc:515] T 1dc5b3532fe54f74876d02beffa2c230 P 0473d2b2d01f4459b1e90fd12cc7840e [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:14.880029 20109 rpcz_store.cc:276] 0709 13:06:13.862603 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:13.864070 (+  1467us) service_pool.cc:224] Handling call
0709 13:06:13.864379 (+   309us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:13.864730 (+   351us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:13.864756 (+    26us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:13.865201 (+   445us) log.cc:844] Serialized 26 byte log entry
0709 13:06:14.277874 (+412673us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:06:14.277931 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:14.278014 (+    83us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:14.879416 (+601402us) raft_consensus.cc:1685] finished
0709 13:06:14.879433 (+    17us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:14.879547 (+   114us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":2352,"raft.run_cpu_time_us":93,"raft.run_wall_time_us":95,"thread_start_us":393278,"threads_started":1,"wal-append.queue_time_us":679851}
I20260709 13:06:14.845839 23795 leader_election.cc:290] T 48824d5acfbc485ebf8c2d944e7202de P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:06:14.857760 23847 raft_consensus.cc:493] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P 0473d2b2d01f4459b1e90fd12cc7840e [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:14.850776 23911 leader_election.cc:290] T 65d8cb8d6ec64f459d5a47cefab10acf P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 12 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:06:14.882721 19526 leader_election.cc:304] T ff75a1d4cb1f493db8f71ddc136ba9ab P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:06:14.835790 24001 leader_election.cc:290] T 2a16f7501e2444fb86d4e2778e734e02 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:06:14.814188 23755 raft_consensus.cc:515] T 217b5fae677b4971b3bbd2f357a1f7ff P e61c3a8f61bb48f8a963c9480e53c168 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
W20260709 13:06:14.889207 19450 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.3:36891, user_credentials={real_user=slave}} blocked reactor thread for 149271us
I20260709 13:06:14.908061 19450 leader_election.cc:304] T 76cb037fc9064d13b59a8969d897ce8c P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e; no voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:06:14.906311 19402 raft_consensus.cc:1240] T df751f992649444090e27965eb1af85d P e5256d91808b47c195bc9b4dbd7f2b87 [term 15 FOLLOWER]: Rejecting Update request from peer e61c3a8f61bb48f8a963c9480e53c168 for earlier term 14. Current term is 15. Ops: []
W20260709 13:06:15.072997 19450 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.3:36891, user_credentials={real_user=slave}} blocked reactor thread for 163802us
I20260709 13:06:14.874354 23714 raft_consensus.cc:515] T 21e14947d70440f19044d8f75c31e1f9 P 0473d2b2d01f4459b1e90fd12cc7840e [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
W20260709 13:06:15.072958 20075 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.1:40321, user_credentials={real_user=slave}} blocked reactor thread for 399882us
I20260709 13:06:15.075825 20075 leader_election.cc:304] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 127766fc592545a4997f7790f50f6076, e5256d91808b47c195bc9b4dbd7f2b87; no voters: 
I20260709 13:06:15.077319 19450 leader_election.cc:304] T ef32ce6fdd0e40d382c79974f30295c6 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:06:14.884917 24024 leader_election.cc:290] T 1dc5b3532fe54f74876d02beffa2c230 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:06:14.905524 24036 raft_consensus.cc:2804] T ff75a1d4cb1f493db8f71ddc136ba9ab P e61c3a8f61bb48f8a963c9480e53c168 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:06:15.083194 20075 leader_election.cc:304] T 85c494af21f9457a85da47b9bc70c1fd P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 127766fc592545a4997f7790f50f6076, e5256d91808b47c195bc9b4dbd7f2b87; no voters: e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:06:15.086850 19450 leader_election.cc:304] T f1b10566f45d4a7d9029858330e02d5b P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:06:15.087379 19402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f93ee515a9c14139bf566522ed8232f3" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 16 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:06:15.095991 19449 leader_election.cc:304] T 62c6c134d3d24a1ab144dd9ee6bc3f64 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, 127766fc592545a4997f7790f50f6076; no voters: e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:06:14.902661 23795 raft_consensus.cc:493] T a08760e15aac4630a629431f56024dc8 P 0473d2b2d01f4459b1e90fd12cc7840e [term 14 FOLLOWER]: Starting pre-election (detected failure of leader e5256d91808b47c195bc9b4dbd7f2b87)
I20260709 13:06:15.085863 19526 leader_election.cc:304] T 1a61655d99124a29b486ba4a5b37faea P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168; no voters: e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:06:15.078467 23896 raft_consensus.cc:2749] T 76cb037fc9064d13b59a8969d897ce8c P 0473d2b2d01f4459b1e90fd12cc7840e [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:06:14.878616 23945 consensus_queue.cc:260] T 28af091831594f9d8e96482078cc7625 P 0473d2b2d01f4459b1e90fd12cc7840e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.6, Last appended by leader: 6, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:15.090400 19450 leader_election.cc:304] T 0cdf56e38bbc453d9438d359e5a69955 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:06:14.888940 23973 raft_consensus.cc:515] T 4509b76741dc428e9201c70c1658da13 P e61c3a8f61bb48f8a963c9480e53c168 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:15.099686 19449 leader_election.cc:304] T 96efeaaf1057492490e9a621f37e1a2d P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e; no voters: 127766fc592545a4997f7790f50f6076, e61c3a8f61bb48f8a963c9480e53c168
W20260709 13:06:15.098995 24026 log.cc:927] Time spent T 7be9efa6559648dbb5a0f7684c4542d1 P e5256d91808b47c195bc9b4dbd7f2b87: Append to log took a long time: real 0.460s	user 0.000s	sys 0.001s
I20260709 13:06:14.901821 23847 raft_consensus.cc:515] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P 0473d2b2d01f4459b1e90fd12cc7840e [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:15.125643 19404 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52342 (request call id 2587) took 1259 ms. Trace:
I20260709 13:06:15.125790 23847 leader_election.cc:290] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:06:15.126977 23896 raft_consensus.cc:2804] T 0cdf56e38bbc453d9438d359e5a69955 P 0473d2b2d01f4459b1e90fd12cc7840e [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:06:15.126070 19404 rpcz_store.cc:276] 0709 13:06:13.865970 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:13.866093 (+   123us) service_pool.cc:224] Handling call
0709 13:06:13.866325 (+   232us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:13.914298 (+ 47973us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:13.914327 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:13.928656 (+ 14329us) log.cc:844] Serialized 26 byte log entry
0709 13:06:14.419963 (+491307us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:06:14.420791 (+   828us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:14.421184 (+   393us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:15.125411 (+704227us) raft_consensus.cc:1685] finished
0709 13:06:15.125434 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:15.125580 (+   146us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":47647,"raft.queue_time_us":48141,"spinlock_wait_cycles":32806656,"thread_start_us":490922,"threads_started":1,"wal-append.queue_time_us":657142}
I20260709 13:06:15.127493 23896 raft_consensus.cc:697] T 0cdf56e38bbc453d9438d359e5a69955 P 0473d2b2d01f4459b1e90fd12cc7840e [term 14 LEADER]: Becoming Leader. State: Replica: 0473d2b2d01f4459b1e90fd12cc7840e, State: Running, Role: LEADER
I20260709 13:06:15.128495 23896 consensus_queue.cc:237] T 0cdf56e38bbc453d9438d359e5a69955 P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
W20260709 13:06:15.130447 24034 log.cc:927] Time spent T 76cb037fc9064d13b59a8969d897ce8c P 0473d2b2d01f4459b1e90fd12cc7840e: Append to log took a long time: real 0.057s	user 0.000s	sys 0.000s
I20260709 13:06:15.131798 23768 consensus_queue.cc:1048] T 96efeaaf1057492490e9a621f37e1a2d P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:06:15.131886 19408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa8650e71aa14778b3d73721fc50d9fc" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:06:15.132781 19408 raft_consensus.cc:2468] T fa8650e71aa14778b3d73721fc50d9fc P e5256d91808b47c195bc9b4dbd7f2b87 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 11.
I20260709 13:06:15.111550 24001 raft_consensus.cc:2804] T 1a61655d99124a29b486ba4a5b37faea P e61c3a8f61bb48f8a963c9480e53c168 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:06:15.133924 23762 raft_consensus.cc:493] T 775c229504194560ba9589bc2199b089 P 127766fc592545a4997f7790f50f6076 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:15.134099 19408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dc5b3532fe54f74876d02beffa2c230" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:06:15.134447 23762 raft_consensus.cc:515] T 775c229504194560ba9589bc2199b089 P 127766fc592545a4997f7790f50f6076 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:15.098397 23805 raft_consensus.cc:2804] T 85c494af21f9457a85da47b9bc70c1fd P 127766fc592545a4997f7790f50f6076 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:06:15.136633 19523 leader_election.cc:304] T a08760e15aac4630a629431f56024dc8 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e61c3a8f61bb48f8a963c9480e53c168; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:06:15.137079 23805 raft_consensus.cc:697] T 85c494af21f9457a85da47b9bc70c1fd P 127766fc592545a4997f7790f50f6076 [term 10 LEADER]: Becoming Leader. State: Replica: 127766fc592545a4997f7790f50f6076, State: Running, Role: LEADER
I20260709 13:06:15.137951 23805 consensus_queue.cc:237] T 85c494af21f9457a85da47b9bc70c1fd P 127766fc592545a4997f7790f50f6076 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:15.139700 19558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28af091831594f9d8e96482078cc7625" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:06:15.141753 19556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e1f505cb0f1427bbd698ac889d80821" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:06:15.142051 19555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef32ce6fdd0e40d382c79974f30295c6" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:06:15.142365 19485 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58294 (request call id 2254) took 1761 ms. Trace:
I20260709 13:06:15.142508 19556 raft_consensus.cc:2410] T 3e1f505cb0f1427bbd698ac889d80821 P e61c3a8f61bb48f8a963c9480e53c168 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate e5256d91808b47c195bc9b4dbd7f2b87 for term 13 because replica has last-logged OpId of term: 11 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 6.
I20260709 13:06:15.142608 19555 raft_consensus.cc:2468] T ef32ce6fdd0e40d382c79974f30295c6 P e61c3a8f61bb48f8a963c9480e53c168 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 14.
I20260709 13:06:15.142798 19485 rpcz_store.cc:276] 0709 13:06:13.380780 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:13.855693 (+474913us) service_pool.cc:224] Handling call
0709 13:06:13.896548 (+ 40855us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:14.558469 (+661921us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:15.142151 (+583682us) spinlock_profiling.cc:243] Waited 660 ms on lock 0x7b5400223b54. stack: 00007f4a79de9343 00007f4a79de9240 00007f4a797781d4 00007f4a834b6304 00007f4a834b6299 00007f4a7ce71571 00007f4a7cf08e01 00007f4a7cf0783e 00007f4a81ecc419 00007f4a7b443bd4 00007f4a7b443b62 00007f4a7b443a91 00007f4a7b443a0c 00007f4a7b442cc2 00007f4a7b24348c 00007f4a7b2428c6
0709 13:06:15.142310 (+   159us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1517682432}
I20260709 13:06:15.143335 19556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46c5bfeecc314717bffe987e6844b6d0" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 18 candidate_status { last_received { term: 16 index: 7 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:06:15.143930 19556 raft_consensus.cc:2468] T 46c5bfeecc314717bffe987e6844b6d0 P e61c3a8f61bb48f8a963c9480e53c168 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 17.
I20260709 13:06:15.144469 19553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df751f992649444090e27965eb1af85d" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:06:15.145489 19558 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "2725d2c4cb054f18b0fc8f735c15f6c2"
dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
 from {username='slave'} at 127.0.0.1:40438
I20260709 13:06:15.146046 19558 raft_consensus.cc:493] T 2725d2c4cb054f18b0fc8f735c15f6c2 P e61c3a8f61bb48f8a963c9480e53c168 [term 14 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:06:15.146426 19558 raft_consensus.cc:3060] T 2725d2c4cb054f18b0fc8f735c15f6c2 P e61c3a8f61bb48f8a963c9480e53c168 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:06:15.108601 23795 raft_consensus.cc:515] T a08760e15aac4630a629431f56024dc8 P 0473d2b2d01f4459b1e90fd12cc7840e [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:15.086344 23911 raft_consensus.cc:2804] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P 127766fc592545a4997f7790f50f6076 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:06:15.099578 23944 raft_consensus.cc:2804] T ef32ce6fdd0e40d382c79974f30295c6 P 0473d2b2d01f4459b1e90fd12cc7840e [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:06:15.149605 23829 leader_election.cc:290] T 0cdf56e38bbc453d9438d359e5a69955 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 14 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:06:15.132998 19405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b74109013a140ada21feeef92d6f563" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 10 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:06:15.160526 19405 raft_consensus.cc:2410] T 2b74109013a140ada21feeef92d6f563 P e5256d91808b47c195bc9b4dbd7f2b87 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e61c3a8f61bb48f8a963c9480e53c168 for term 10 because replica has last-logged OpId of term: 8 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 5.
W20260709 13:06:15.106349 24018 log.cc:927] Time spent T ab43d85f64114d4ebf618930e43d9ed0 P e61c3a8f61bb48f8a963c9480e53c168: Append to log took a long time: real 0.486s	user 0.001s	sys 0.001s
I20260709 13:06:15.116988 24046 raft_consensus.cc:2804] T 62c6c134d3d24a1ab144dd9ee6bc3f64 P 0473d2b2d01f4459b1e90fd12cc7840e [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:06:15.152148 19402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e36a9d6e29c4a7c860cf267efbd4c74" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
I20260709 13:06:15.152767 19404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cdf56e38bbc453d9438d359e5a69955" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:06:15.086953 24036 raft_consensus.cc:493] T ff75a1d4cb1f493db8f71ddc136ba9ab P e61c3a8f61bb48f8a963c9480e53c168 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:15.148729 23638 leader_election.cc:290] T ff9b0eddd810459b82d91c60777c10eb P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:06:15.155082 19555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b08304a0a02b42d7840c4e8ee9a6bd1a" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:06:15.180543 19477 raft_consensus.cc:1275] T 1f85fc4b527a48848e5faa083b604e36 P 0473d2b2d01f4459b1e90fd12cc7840e [term 11 FOLLOWER]: Refusing update from remote peer 127766fc592545a4997f7790f50f6076: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:06:15.136656 23762 leader_election.cc:290] T 775c229504194560ba9589bc2199b089 P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:06:15.156402 19556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff75a1d4cb1f493db8f71ddc136ba9ab" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:06:15.103233 24040 raft_consensus.cc:493] T e381f1d6b8184797ad142de49be225a8 P 0473d2b2d01f4459b1e90fd12cc7840e [term 9 FOLLOWER]: Starting pre-election (detected failure of leader e5256d91808b47c195bc9b4dbd7f2b87)
I20260709 13:06:15.102895 24041 raft_consensus.cc:2804] T f1b10566f45d4a7d9029858330e02d5b P 0473d2b2d01f4459b1e90fd12cc7840e [term 13 FOLLOWER]: Leader pre-election won for term 14
W20260709 13:06:15.151343 24021 log.cc:927] Time spent T b9f0d59553ad444883fcf5b5909f9798 P 0473d2b2d01f4459b1e90fd12cc7840e: Append to log took a long time: real 0.418s	user 0.000s	sys 0.001s
I20260709 13:06:15.172778 19402 raft_consensus.cc:3060] T 2e36a9d6e29c4a7c860cf267efbd4c74 P e5256d91808b47c195bc9b4dbd7f2b87 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:06:15.173102 19404 raft_consensus.cc:2468] T 0cdf56e38bbc453d9438d359e5a69955 P e5256d91808b47c195bc9b4dbd7f2b87 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 13.
I20260709 13:06:15.176462 19523 leader_election.cc:304] T 3e1f505cb0f1427bbd698ac889d80821 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e61c3a8f61bb48f8a963c9480e53c168; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:06:15.181632 19555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e1085d23e8347fbbd5bce7542f4b1f4" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:06:15.223798 19555 raft_consensus.cc:2468] T 0e1085d23e8347fbbd5bce7542f4b1f4 P e61c3a8f61bb48f8a963c9480e53c168 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 127766fc592545a4997f7790f50f6076 in term 9.
I20260709 13:06:15.224653 19555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a16f7501e2444fb86d4e2778e734e02" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
W20260709 13:06:15.155282 19449 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.4:43121, user_credentials={real_user=slave}} blocked reactor thread for 55689.1us
I20260709 13:06:15.187515 19407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70797e5783b5454ab0d0eea663e791e3" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:06:15.157122 23911 raft_consensus.cc:493] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P 127766fc592545a4997f7790f50f6076 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:15.159731 23979 raft_consensus.cc:2749] T 96efeaaf1057492490e9a621f37e1a2d P 0473d2b2d01f4459b1e90fd12cc7840e [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:06:15.161327 23944 raft_consensus.cc:493] T ef32ce6fdd0e40d382c79974f30295c6 P 0473d2b2d01f4459b1e90fd12cc7840e [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:15.159276 24001 raft_consensus.cc:697] T 1a61655d99124a29b486ba4a5b37faea P e61c3a8f61bb48f8a963c9480e53c168 [term 9 LEADER]: Becoming Leader. State: Replica: e61c3a8f61bb48f8a963c9480e53c168, State: Running, Role: LEADER
I20260709 13:06:15.206522 19485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14efcc79969f41babe5529c22d59156d" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:06:15.207288 23714 leader_election.cc:290] T 21e14947d70440f19044d8f75c31e1f9 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:06:15.171880 24046 raft_consensus.cc:493] T 62c6c134d3d24a1ab144dd9ee6bc3f64 P 0473d2b2d01f4459b1e90fd12cc7840e [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:15.211211 23973 leader_election.cc:290] T 4509b76741dc428e9201c70c1658da13 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 7 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:06:15.178161 23874 raft_consensus.cc:2749] T a08760e15aac4630a629431f56024dc8 P e61c3a8f61bb48f8a963c9480e53c168 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:06:15.225580 19558 raft_consensus.cc:515] T 2725d2c4cb054f18b0fc8f735c15f6c2 P e61c3a8f61bb48f8a963c9480e53c168 [term 15 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:15.228652 19402 raft_consensus.cc:2468] T 2e36a9d6e29c4a7c860cf267efbd4c74 P e5256d91808b47c195bc9b4dbd7f2b87 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 10.
I20260709 13:06:15.231537 19481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e36a9d6e29c4a7c860cf267efbd4c74" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:06:15.243314 19482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dc5b3532fe54f74876d02beffa2c230" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:06:15.243660 19481 raft_consensus.cc:3060] T 2e36a9d6e29c4a7c860cf267efbd4c74 P 0473d2b2d01f4459b1e90fd12cc7840e [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:06:15.232208 19486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cdf56e38bbc453d9438d359e5a69955" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:06:15.220834 24041 raft_consensus.cc:493] T f1b10566f45d4a7d9029858330e02d5b P 0473d2b2d01f4459b1e90fd12cc7840e [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:15.244903 19486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f575b143b844aa096b50997dad3516a" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:06:15.230211 23795 leader_election.cc:290] T a08760e15aac4630a629431f56024dc8 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:06:15.246997 19486 raft_consensus.cc:2393] T 7f575b143b844aa096b50997dad3516a P 0473d2b2d01f4459b1e90fd12cc7840e [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate e61c3a8f61bb48f8a963c9480e53c168 in current term 9: Already voted for candidate 0473d2b2d01f4459b1e90fd12cc7840e in this term.
I20260709 13:06:15.247901 19486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22196caba61445d3bec98a0aab3c337d" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: true dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:06:15.248504 19486 raft_consensus.cc:3055] T 22196caba61445d3bec98a0aab3c337d P 0473d2b2d01f4459b1e90fd12cc7840e [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:06:15.248838 19486 raft_consensus.cc:740] T 22196caba61445d3bec98a0aab3c337d P 0473d2b2d01f4459b1e90fd12cc7840e [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 0473d2b2d01f4459b1e90fd12cc7840e, State: Running, Role: LEADER
I20260709 13:06:15.235525 19485 raft_consensus.cc:2468] T 14efcc79969f41babe5529c22d59156d P 0473d2b2d01f4459b1e90fd12cc7840e [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 127766fc592545a4997f7790f50f6076 in term 12.
I20260709 13:06:15.236779 19555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65d8cb8d6ec64f459d5a47cefab10acf" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:06:15.238416 19477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c5eebf646ad445a9d1b1adc319d7b16" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:06:15.164693 23945 raft_consensus.cc:3060] T 28af091831594f9d8e96482078cc7625 P 0473d2b2d01f4459b1e90fd12cc7840e [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:06:15.237659 23505 raft_consensus.cc:2749] T 3e1f505cb0f1427bbd698ac889d80821 P e61c3a8f61bb48f8a963c9480e53c168 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:06:15.243955 19482 raft_consensus.cc:2468] T 1dc5b3532fe54f74876d02beffa2c230 P 0473d2b2d01f4459b1e90fd12cc7840e [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 12.
I20260709 13:06:15.229480 23911 raft_consensus.cc:3060] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P 127766fc592545a4997f7790f50f6076 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:06:15.249632 19486 consensus_queue.cc:260] T 22196caba61445d3bec98a0aab3c337d P 0473d2b2d01f4459b1e90fd12cc7840e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
W20260709 13:06:15.233470 19523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.1:40321, user_credentials={real_user=slave}} blocked reactor thread for 57122.5us
I20260709 13:06:15.236124 23944 raft_consensus.cc:3060] T ef32ce6fdd0e40d382c79974f30295c6 P 0473d2b2d01f4459b1e90fd12cc7840e [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:06:15.234191 19483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f93ee515a9c14139bf566522ed8232f3" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 16 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:06:15.262180 19485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36f6ba92b9ba46babe4ebd6c02e5fbd9" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:06:15.262992 19485 raft_consensus.cc:2468] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P 0473d2b2d01f4459b1e90fd12cc7840e [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 127766fc592545a4997f7790f50f6076 in term 13.
I20260709 13:06:15.253580 19477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21e14947d70440f19044d8f75c31e1f9" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:06:15.263293 19483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48824d5acfbc485ebf8c2d944e7202de" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:06:15.263980 19477 raft_consensus.cc:2468] T 21e14947d70440f19044d8f75c31e1f9 P 0473d2b2d01f4459b1e90fd12cc7840e [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 12.
I20260709 13:06:15.264070 19483 raft_consensus.cc:2468] T 48824d5acfbc485ebf8c2d944e7202de P 0473d2b2d01f4459b1e90fd12cc7840e [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 13.
I20260709 13:06:15.253897 19558 leader_election.cc:290] T 2725d2c4cb054f18b0fc8f735c15f6c2 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 15 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:06:15.237941 23768 raft_consensus.cc:493] T bc225c93219c45538b53a1bd3d387e4d P e61c3a8f61bb48f8a963c9480e53c168 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 0473d2b2d01f4459b1e90fd12cc7840e)
I20260709 13:06:15.229936 24040 raft_consensus.cc:515] T e381f1d6b8184797ad142de49be225a8 P 0473d2b2d01f4459b1e90fd12cc7840e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:15.245947 24041 raft_consensus.cc:3060] T f1b10566f45d4a7d9029858330e02d5b P 0473d2b2d01f4459b1e90fd12cc7840e [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:06:15.241957 24046 raft_consensus.cc:3060] T 62c6c134d3d24a1ab144dd9ee6bc3f64 P 0473d2b2d01f4459b1e90fd12cc7840e [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:06:15.256042 24001 consensus_queue.cc:237] T 1a61655d99124a29b486ba4a5b37faea P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
W20260709 13:06:15.257819 24042 log.cc:927] Time spent T 179fd671030940b4b4a4e24bcc4aba0a P 0473d2b2d01f4459b1e90fd12cc7840e: Append to log took a long time: real 0.095s	user 0.000s	sys 0.000s
I20260709 13:06:15.245503 23893 raft_consensus.cc:493] T 2725d2c4cb054f18b0fc8f735c15f6c2 P e61c3a8f61bb48f8a963c9480e53c168 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:15.184489 24036 raft_consensus.cc:3060] T ff75a1d4cb1f493db8f71ddc136ba9ab P e61c3a8f61bb48f8a963c9480e53c168 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:06:15.232414 19480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa8650e71aa14778b3d73721fc50d9fc" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:06:15.261291 19523 leader_election.cc:304] T ef32ce6fdd0e40d382c79974f30295c6 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168; no voters: 0473d2b2d01f4459b1e90fd12cc7840e
I20260709 13:06:15.258769 23975 leader_election.cc:290] T 7be9efa6559648dbb5a0f7684c4542d1 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:06:15.276571 19477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e1085d23e8347fbbd5bce7542f4b1f4" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:06:15.303761 19552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b74109013a140ada21feeef92d6f563" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:06:15.304733 19482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0afb57ae58a24a01850491d69f0213dd" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
W20260709 13:06:15.289371 24015 log.cc:927] Time spent T d1e5873a19244c5ebbcd38e126796ee7 P 0473d2b2d01f4459b1e90fd12cc7840e: Append to log took a long time: real 0.600s	user 0.004s	sys 0.000s
I20260709 13:06:15.305241 19552 raft_consensus.cc:2468] T 2b74109013a140ada21feeef92d6f563 P e61c3a8f61bb48f8a963c9480e53c168 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 9.
I20260709 13:06:15.305179 19477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b08304a0a02b42d7840c4e8ee9a6bd1a" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:06:15.275243 19485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b74109013a140ada21feeef92d6f563" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 10 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:06:15.307538 19485 raft_consensus.cc:2410] T 2b74109013a140ada21feeef92d6f563 P 0473d2b2d01f4459b1e90fd12cc7840e [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e61c3a8f61bb48f8a963c9480e53c168 for term 10 because replica has last-logged OpId of term: 8 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 5.
I20260709 13:06:15.288309 19486 raft_consensus.cc:3060] T 22196caba61445d3bec98a0aab3c337d P 0473d2b2d01f4459b1e90fd12cc7840e [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:06:15.292879 19483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62c6c134d3d24a1ab144dd9ee6bc3f64" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:06:15.301195 19555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edd7d470b5014c9489be7f41f64355c9" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 13 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:06:15.309320 19477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e5873a19244c5ebbcd38e126796ee7" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:06:15.310184 19477 raft_consensus.cc:2468] T d1e5873a19244c5ebbcd38e126796ee7 P 0473d2b2d01f4459b1e90fd12cc7840e [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 13.
I20260709 13:06:15.301584 19558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48824d5acfbc485ebf8c2d944e7202de" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 14 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:06:15.303468 19480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff9b0eddd810459b82d91c60777c10eb" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:06:15.303671 19523 leader_election.cc:304] T 46c5bfeecc314717bffe987e6844b6d0 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168; no voters: 0473d2b2d01f4459b1e90fd12cc7840e
I20260709 13:06:15.311939 19480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "775c229504194560ba9589bc2199b089" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:06:15.312711 19480 raft_consensus.cc:2468] T 775c229504194560ba9589bc2199b089 P 0473d2b2d01f4459b1e90fd12cc7840e [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 127766fc592545a4997f7790f50f6076 in term 10.
I20260709 13:06:15.317677 19558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dc5b3532fe54f74876d02beffa2c230" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:06:15.305315 19482 raft_consensus.cc:2468] T 0afb57ae58a24a01850491d69f0213dd P 0473d2b2d01f4459b1e90fd12cc7840e [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 11.
I20260709 13:06:15.320603 19477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4509b76741dc428e9201c70c1658da13" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:06:15.321923 19558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0afb57ae58a24a01850491d69f0213dd" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:06:15.322731 19558 raft_consensus.cc:2468] T 0afb57ae58a24a01850491d69f0213dd P e61c3a8f61bb48f8a963c9480e53c168 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 11.
I20260709 13:06:15.323994 19558 raft_consensus.cc:1240] T 6c5eebf646ad445a9d1b1adc319d7b16 P e61c3a8f61bb48f8a963c9480e53c168 [term 11 FOLLOWER]: Rejecting Update request from peer 0473d2b2d01f4459b1e90fd12cc7840e for earlier term 10. Current term is 11. Ops: []
I20260709 13:06:15.331598 19481 raft_consensus.cc:2468] T 2e36a9d6e29c4a7c860cf267efbd4c74 P 0473d2b2d01f4459b1e90fd12cc7840e [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 10.
I20260709 13:06:15.331900 19485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7be9efa6559648dbb5a0f7684c4542d1" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:06:15.333312 20078 leader_election.cc:304] T 14efcc79969f41babe5529c22d59156d P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, 127766fc592545a4997f7790f50f6076; no voters: e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:06:15.296644 24040 leader_election.cc:290] T e381f1d6b8184797ad142de49be225a8 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:06:15.348039 19485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2725d2c4cb054f18b0fc8f735c15f6c2" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: true dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:06:15.353154 19486 raft_consensus.cc:2468] T 22196caba61445d3bec98a0aab3c337d P 0473d2b2d01f4459b1e90fd12cc7840e [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 10.
I20260709 13:06:15.327145 23975 raft_consensus.cc:493] T ece3db938bc649d4a40a51522ed5259c P e61c3a8f61bb48f8a963c9480e53c168 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader e5256d91808b47c195bc9b4dbd7f2b87)
I20260709 13:06:15.355429 23975 raft_consensus.cc:515] T ece3db938bc649d4a40a51522ed5259c P e61c3a8f61bb48f8a963c9480e53c168 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:15.357638 23975 leader_election.cc:290] T ece3db938bc649d4a40a51522ed5259c P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:06:15.338950 23505 raft_consensus.cc:2804] T 46c5bfeecc314717bffe987e6844b6d0 P e61c3a8f61bb48f8a963c9480e53c168 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:06:15.358556 23505 raft_consensus.cc:697] T 46c5bfeecc314717bffe987e6844b6d0 P e61c3a8f61bb48f8a963c9480e53c168 [term 17 LEADER]: Becoming Leader. State: Replica: e61c3a8f61bb48f8a963c9480e53c168, State: Running, Role: LEADER
I20260709 13:06:15.359762 23505 consensus_queue.cc:237] T 46c5bfeecc314717bffe987e6844b6d0 P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 16.7, Last appended by leader: 7, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:15.365623 19552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "309c3ca0ca4b4f3ba129752ea2cb293b" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
W20260709 13:06:15.366262 19524 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:15.366837 19552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21e14947d70440f19044d8f75c31e1f9" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:06:15.367434 19552 raft_consensus.cc:2468] T 21e14947d70440f19044d8f75c31e1f9 P e61c3a8f61bb48f8a963c9480e53c168 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 12.
I20260709 13:06:15.368525 19558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a08760e15aac4630a629431f56024dc8" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:06:15.368662 19552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e381f1d6b8184797ad142de49be225a8" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:06:15.369103 19558 raft_consensus.cc:2468] T a08760e15aac4630a629431f56024dc8 P e61c3a8f61bb48f8a963c9480e53c168 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 14.
I20260709 13:06:15.353200 19450 leader_election.cc:304] T 2b74109013a140ada21feeef92d6f563 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:06:15.324713 23901 raft_consensus.cc:2804] T ef32ce6fdd0e40d382c79974f30295c6 P e61c3a8f61bb48f8a963c9480e53c168 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:06:15.287132 23768 raft_consensus.cc:515] T bc225c93219c45538b53a1bd3d387e4d P e61c3a8f61bb48f8a963c9480e53c168 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:15.405807 23872 raft_consensus.cc:2804] T 2b74109013a140ada21feeef92d6f563 P 0473d2b2d01f4459b1e90fd12cc7840e [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 13:06:15.405681 19450 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.3:36891, user_credentials={real_user=slave}} blocked reactor thread for 52552.7us
I20260709 13:06:15.295038 23893 raft_consensus.cc:515] T 2725d2c4cb054f18b0fc8f735c15f6c2 P e61c3a8f61bb48f8a963c9480e53c168 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:15.342864 23874 consensus_queue.cc:1059] T df751f992649444090e27965eb1af85d P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.081s
I20260709 13:06:15.369167 19552 raft_consensus.cc:2468] T e381f1d6b8184797ad142de49be225a8 P e61c3a8f61bb48f8a963c9480e53c168 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 9.
I20260709 13:06:15.438984 23973 raft_consensus.cc:493] T e381f1d6b8184797ad142de49be225a8 P e61c3a8f61bb48f8a963c9480e53c168 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader e5256d91808b47c195bc9b4dbd7f2b87)
W20260709 13:06:15.428099 20076 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.3:36891, user_credentials={real_user=slave}} blocked reactor thread for 259757us
W20260709 13:06:15.405207 23818 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.559s	user 0.010s	sys 0.010s
I20260709 13:06:15.443291 19450 leader_election.cc:304] T 0afb57ae58a24a01850491d69f0213dd P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:06:15.445694 19477 raft_consensus.cc:2468] T 4509b76741dc428e9201c70c1658da13 P 0473d2b2d01f4459b1e90fd12cc7840e [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 7.
W20260709 13:06:15.410199 23920 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.532s	user 0.061s	sys 0.097s
I20260709 13:06:15.407320 23901 raft_consensus.cc:493] T ef32ce6fdd0e40d382c79974f30295c6 P e61c3a8f61bb48f8a963c9480e53c168 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:15.445541 20076 leader_election.cc:304] T 0e1085d23e8347fbbd5bce7542f4b1f4 P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 127766fc592545a4997f7790f50f6076, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:06:15.454070 19450 leader_election.cc:304] T 21e14947d70440f19044d8f75c31e1f9 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:06:15.408752 23872 raft_consensus.cc:493] T 2b74109013a140ada21feeef92d6f563 P 0473d2b2d01f4459b1e90fd12cc7840e [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:06:15.442965 23818 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.602s	user 0.011s	sys 0.010s
I20260709 13:06:15.463707 20110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a16f7501e2444fb86d4e2778e734e02" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:06:15.441171 24048 raft_consensus.cc:2804] T 14efcc79969f41babe5529c22d59156d P 127766fc592545a4997f7790f50f6076 [term 12 FOLLOWER]: Leader pre-election won for term 13
W20260709 13:06:15.467694 19484 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.673s	user 0.000s	sys 0.016s
I20260709 13:06:15.440474 23973 raft_consensus.cc:515] T e381f1d6b8184797ad142de49be225a8 P e61c3a8f61bb48f8a963c9480e53c168 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
W20260709 13:06:15.460219 23920 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.582s	user 0.072s	sys 0.099s
W20260709 13:06:15.468730 19484 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.676s	user 0.000s	sys 0.016s
I20260709 13:06:15.426345 23762 consensus_queue.cc:1048] T 1f85fc4b527a48848e5faa083b604e36 P 127766fc592545a4997f7790f50f6076 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.036s
I20260709 13:06:15.455024 24040 raft_consensus.cc:2804] T 0afb57ae58a24a01850491d69f0213dd P 0473d2b2d01f4459b1e90fd12cc7840e [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:06:15.479734 20112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62c6c134d3d24a1ab144dd9ee6bc3f64" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:06:15.479987 20110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7be9efa6559648dbb5a0f7684c4542d1" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:06:15.480434 20112 raft_consensus.cc:2468] T 62c6c134d3d24a1ab144dd9ee6bc3f64 P 127766fc592545a4997f7790f50f6076 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 11.
I20260709 13:06:15.464370 23901 raft_consensus.cc:3060] T ef32ce6fdd0e40d382c79974f30295c6 P e61c3a8f61bb48f8a963c9480e53c168 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:06:15.464752 23872 raft_consensus.cc:3060] T 2b74109013a140ada21feeef92d6f563 P 0473d2b2d01f4459b1e90fd12cc7840e [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:06:15.463193 19450 leader_election.cc:304] T a08760e15aac4630a629431f56024dc8 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:06:15.483997 20112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ece3db938bc649d4a40a51522ed5259c" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:06:15.467550 24054 raft_consensus.cc:2804] T 21e14947d70440f19044d8f75c31e1f9 P 0473d2b2d01f4459b1e90fd12cc7840e [term 12 FOLLOWER]: Leader pre-election won for term 13
W20260709 13:06:15.465219 23878 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.583s	user 0.000s	sys 0.017s
I20260709 13:06:15.460129 23829 consensus_queue.cc:1059] T 6c5eebf646ad445a9d1b1adc319d7b16 P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.019s
I20260709 13:06:15.468647 24048 raft_consensus.cc:493] T 14efcc79969f41babe5529c22d59156d P 127766fc592545a4997f7790f50f6076 [term 12 FOLLOWER]: Starting leader election (detected failure of leader e5256d91808b47c195bc9b4dbd7f2b87)
W20260709 13:06:15.535056 19450 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.3:36891, user_credentials={real_user=slave}} blocked reactor thread for 72123.3us
I20260709 13:06:15.536959 19450 leader_election.cc:304] T e381f1d6b8184797ad142de49be225a8 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
W20260709 13:06:15.545277 19523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.4:43121, user_credentials={real_user=slave}} blocked reactor thread for 60376.3us
I20260709 13:06:15.548286 19523 leader_election.cc:304] T 62c6c134d3d24a1ab144dd9ee6bc3f64 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 127766fc592545a4997f7790f50f6076, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:06:15.553126 19484 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58286 (request call id 2094) took 1696 ms. Trace:
I20260709 13:06:15.479876 23818 raft_consensus.cc:493] T 0afb57ae58a24a01850491d69f0213dd P 127766fc592545a4997f7790f50f6076 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 0473d2b2d01f4459b1e90fd12cc7840e)
W20260709 13:06:15.557047 19449 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.1:40321, user_credentials={real_user=slave}} blocked reactor thread for 159350us
I20260709 13:06:15.553608 19484 rpcz_store.cc:276] 0709 13:06:13.857185 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:14.411910 (+554725us) service_pool.cc:224] Handling call
0709 13:06:14.446381 (+ 34471us) raft_consensus.cc:1471] Updating replica for 3 ops
0709 13:06:14.460855 (+ 14474us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:14.460885 (+    30us) raft_consensus.cc:1539] Triggering prepare for 3 ops
0709 13:06:14.463109 (+  2224us) log.cc:844] Serialized 78 byte log entry
0709 13:06:14.747866 (+284757us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:06:14.787341 (+ 39475us) log.cc:844] Serialized 14 byte log entry
0709 13:06:15.549893 (+762552us) log.cc:844] Serialized 14 byte log entry
0709 13:06:15.552754 (+  2861us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:15.552833 (+    79us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:15.552874 (+    41us) raft_consensus.cc:1685] finished
0709 13:06:15.552885 (+    11us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:15.553058 (+   173us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":20462,"prepare.queue_time_us":37562,"prepare.run_cpu_time_us":36,"prepare.run_wall_time_us":39,"raft.queue_time_us":90588,"raft.run_cpu_time_us":229,"raft.run_wall_time_us":3875,"thread_start_us":1020311,"threads_started":3,"wal-append.queue_time_us":606086}
I20260709 13:06:15.481782 24040 raft_consensus.cc:493] T 0afb57ae58a24a01850491d69f0213dd P 0473d2b2d01f4459b1e90fd12cc7840e [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:06:15.534998 23878 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.653s	user 0.006s	sys 0.020s
I20260709 13:06:15.555720 23805 raft_consensus.cc:2804] T 0e1085d23e8347fbbd5bce7542f4b1f4 P 127766fc592545a4997f7790f50f6076 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:06:15.561273 24040 raft_consensus.cc:3060] T 0afb57ae58a24a01850491d69f0213dd P 0473d2b2d01f4459b1e90fd12cc7840e [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:06:15.547257 24055 raft_consensus.cc:2804] T e381f1d6b8184797ad142de49be225a8 P 0473d2b2d01f4459b1e90fd12cc7840e [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:06:15.562064 23818 raft_consensus.cc:515] T 0afb57ae58a24a01850491d69f0213dd P 127766fc592545a4997f7790f50f6076 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:15.571194 24055 raft_consensus.cc:493] T e381f1d6b8184797ad142de49be225a8 P 0473d2b2d01f4459b1e90fd12cc7840e [term 9 FOLLOWER]: Starting leader election (detected failure of leader e5256d91808b47c195bc9b4dbd7f2b87)
I20260709 13:06:15.571614 24055 raft_consensus.cc:3060] T e381f1d6b8184797ad142de49be225a8 P 0473d2b2d01f4459b1e90fd12cc7840e [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:06:15.572793 23818 leader_election.cc:290] T 0afb57ae58a24a01850491d69f0213dd P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:06:15.545969 23928 raft_consensus.cc:2804] T a08760e15aac4630a629431f56024dc8 P 0473d2b2d01f4459b1e90fd12cc7840e [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:06:15.534826 24054 raft_consensus.cc:493] T 21e14947d70440f19044d8f75c31e1f9 P 0473d2b2d01f4459b1e90fd12cc7840e [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:15.542567 24048 raft_consensus.cc:3060] T 14efcc79969f41babe5529c22d59156d P 127766fc592545a4997f7790f50f6076 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:06:15.574322 20076 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.3:36891, user_credentials={real_user=slave}} blocked reactor thread for 111141us
W20260709 13:06:15.582566 24051 log.cc:927] Time spent T edd7d470b5014c9489be7f41f64355c9 P e5256d91808b47c195bc9b4dbd7f2b87: Append to log took a long time: real 0.099s	user 0.000s	sys 0.000s
I20260709 13:06:15.575376 23928 raft_consensus.cc:493] T a08760e15aac4630a629431f56024dc8 P 0473d2b2d01f4459b1e90fd12cc7840e [term 14 FOLLOWER]: Starting leader election (detected failure of leader e5256d91808b47c195bc9b4dbd7f2b87)
I20260709 13:06:15.583838 23928 raft_consensus.cc:3060] T a08760e15aac4630a629431f56024dc8 P 0473d2b2d01f4459b1e90fd12cc7840e [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:06:15.576339 19526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.2:46257, user_credentials={real_user=slave}} blocked reactor thread for 193841us
I20260709 13:06:15.586956 19484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc225c93219c45538b53a1bd3d387e4d" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:06:15.589440 19526 leader_election.cc:304] T 6c5eebf646ad445a9d1b1adc319d7b16 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e61c3a8f61bb48f8a963c9480e53c168; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, 127766fc592545a4997f7790f50f6076
W20260709 13:06:15.590523 24044 log.cc:927] Time spent T b9f0d59553ad444883fcf5b5909f9798 P e5256d91808b47c195bc9b4dbd7f2b87: Append to log took a long time: real 0.504s	user 0.000s	sys 0.001s
W20260709 13:06:15.593518 24058 log.cc:927] Time spent T 70797e5783b5454ab0d0eea663e791e3 P 127766fc592545a4997f7790f50f6076: Append to log took a long time: real 0.149s	user 0.001s	sys 0.000s
I20260709 13:06:15.561789 23805 raft_consensus.cc:493] T 0e1085d23e8347fbbd5bce7542f4b1f4 P 127766fc592545a4997f7790f50f6076 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 0473d2b2d01f4459b1e90fd12cc7840e)
I20260709 13:06:15.595074 23805 raft_consensus.cc:3060] T 0e1085d23e8347fbbd5bce7542f4b1f4 P 127766fc592545a4997f7790f50f6076 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:06:15.578380 24054 raft_consensus.cc:3060] T 21e14947d70440f19044d8f75c31e1f9 P 0473d2b2d01f4459b1e90fd12cc7840e [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:06:15.608616 24052 log.cc:927] Time spent T 179fd671030940b4b4a4e24bcc4aba0a P e5256d91808b47c195bc9b4dbd7f2b87: Append to log took a long time: real 0.184s	user 0.001s	sys 0.000s
I20260709 13:06:15.581527 23768 leader_election.cc:290] T bc225c93219c45538b53a1bd3d387e4d P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
W20260709 13:06:15.626933 20078 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.2:46257, user_credentials={real_user=slave}} blocked reactor thread for 273045us
I20260709 13:06:15.632772 19551 raft_consensus.cc:1240] T 6c5eebf646ad445a9d1b1adc319d7b16 P e61c3a8f61bb48f8a963c9480e53c168 [term 11 FOLLOWER]: Rejecting Update request from peer 0473d2b2d01f4459b1e90fd12cc7840e for earlier term 10. Current term is 11. Ops: []
W20260709 13:06:15.624627 24059 log.cc:927] Time spent T 7be9efa6559648dbb5a0f7684c4542d1 P 0473d2b2d01f4459b1e90fd12cc7840e: Append to log took a long time: real 0.184s	user 0.000s	sys 0.001s
I20260709 13:06:15.640995 20108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48824d5acfbc485ebf8c2d944e7202de" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 14 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:06:15.640985 20104 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46422 (request call id 781) took 2753 ms. Trace:
I20260709 13:06:15.641808 20104 rpcz_store.cc:276] 0709 13:06:12.883552 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:12.884940 (+  1388us) service_pool.cc:224] Handling call
0709 13:06:14.242681 (+1357741us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:14.282917 (+ 40236us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:15.636656 (+1353739us) spinlock_profiling.cc:243] Waited 1.36 s on lock 0x7b540064fad0. stack: 00007f4a79de9343 00007f4a79de9240 00007f4a797781d4 00007f4a834b6304 00007f4a834b6299 00007f4a7ce71571 00007f4a7cf078ad 00007f4a81ecc419 00007f4a7b443bd4 00007f4a7b443b62 00007f4a7b443a91 00007f4a7b443a0c 00007f4a7b442cc2 00007f4a7b24348c 00007f4a7b2428c6 00007f4a7b24226f
0709 13:06:15.636794 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3121741056}
I20260709 13:06:15.646620 19551 raft_consensus.cc:1275] T 0cdf56e38bbc453d9438d359e5a69955 P e61c3a8f61bb48f8a963c9480e53c168 [term 14 FOLLOWER]: Refusing update from remote peer 0473d2b2d01f4459b1e90fd12cc7840e: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
W20260709 13:06:15.648999 19411 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52342 (request call id 2561) took 3033 ms (client timeout 2128 ms). Trace:
I20260709 13:06:15.649250 19479 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58294 (request call id 2244) took 2277 ms. Trace:
W20260709 13:06:15.649509 19411 rpcz_store.cc:269] 0709 13:06:12.608908 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:12.618692 (+  9784us) service_pool.cc:224] Handling call
0709 13:06:15.641757 (+3023065us) spinlock_profiling.cc:243] Waited 1.76 s on lock 0x7b540019f854. stack: 00007f4a79de9343 00007f4a79de9240 00007f4a797781d4 00007f4a834b6304 00007f4a834b6299 00007f4a7ce71571 00007f4a7cf0c2fa 00007f4a81ecdb17 00007f4a7b4486d4 00007f4a7b448662 00007f4a7b448591 00007f4a7b44850c 00007f4a7b4477c2 00007f4a7b24348c 00007f4a7b2428c6 00007f4a7b24226f
0709 13:06:15.641853 (+    96us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4054566656}
I20260709 13:06:15.630232 24062 raft_consensus.cc:493] T 96efeaaf1057492490e9a621f37e1a2d P 127766fc592545a4997f7790f50f6076 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader e61c3a8f61bb48f8a963c9480e53c168)
I20260709 13:06:15.656093 20108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f85fc4b527a48848e5faa083b604e36" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:06:15.650022 19479 rpcz_store.cc:276] 0709 13:06:13.366102 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:13.372333 (+  6231us) service_pool.cc:224] Handling call
0709 13:06:13.372730 (+   397us) raft_consensus.cc:1471] Updating replica for 3 ops
0709 13:06:13.373191 (+   461us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:13.373229 (+    38us) raft_consensus.cc:1539] Triggering prepare for 3 ops
0709 13:06:13.373987 (+   758us) log.cc:844] Serialized 78 byte log entry
0709 13:06:13.721100 (+347113us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:06:14.225176 (+504076us) spinlock_profiling.cc:243] Waited 3.61 ms on lock 0x7b48001ec258. stack: 00007f4a79de9343 00007f4a79de9240 00007f4a797781d4 00007f4a834b6304 00007f4a834b6299 00007f4a81e31aa1 00007f4a81e28b37 00007f4a81e289ca 00007f4a81f2026f 00007f4a81f1ff37 00007f4a81f3455c 00007f4a81f34508 00007f4a81f34488 00007f4a81f34443 00007f4a81f336ec 00007f4a80e5da96
0709 13:06:14.477026 (+251850us) log.cc:844] Serialized 14 byte log entry
0709 13:06:15.643041 (+1166015us) spinlock_profiling.cc:243] Waited 24.3 ms on lock 0x7b54000d28a0. stack: 00007f4a79de9343 00007f4a79de9240 00007f4a797781d4 00007f4a834b6304 00007f4a834b6299 00007f4a7ce71571 00007f4a7ce83733 00007f4a7cf08dbf 00007f4a7cf0783e 00007f4a81ecc419 00007f4a7b443bd4 00007f4a7b443b62 00007f4a7b443a91 00007f4a7b443a0c 00007f4a7b442cc2 00007f4a7b24348c
0709 13:06:15.643114 (+    73us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:15.643209 (+    95us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:15.643259 (+    50us) raft_consensus.cc:1685] finished
0709 13:06:15.643276 (+    17us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:15.643440 (+   164us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":908,"prepare.queue_time_us":507916,"prepare.run_cpu_time_us":22,"prepare.run_wall_time_us":23,"raft.queue_time_us":19394,"raft.run_cpu_time_us":13606,"raft.run_wall_time_us":834193,"spinlock_wait_cycles":64168576,"thread_start_us":1020917,"threads_started":2,"wal-append.queue_time_us":477555,"wal-append.run_cpu_time_us":14074,"wal-append.run_wall_time_us":1608432}
I20260709 13:06:15.647284 23740 raft_consensus.cc:493] T 2725d2c4cb054f18b0fc8f735c15f6c2 P 0473d2b2d01f4459b1e90fd12cc7840e [term 14 FOLLOWER]: Starting pre-election (detected failure of leader e5256d91808b47c195bc9b4dbd7f2b87)
I20260709 13:06:15.664947 20104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "309c3ca0ca4b4f3ba129752ea2cb293b" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:06:15.675657 19479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e1f505cb0f1427bbd698ac889d80821" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:06:15.684356 19479 raft_consensus.cc:2393] T 3e1f505cb0f1427bbd698ac889d80821 P 0473d2b2d01f4459b1e90fd12cc7840e [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate e5256d91808b47c195bc9b4dbd7f2b87 in current term 13: Already voted for candidate 0473d2b2d01f4459b1e90fd12cc7840e in this term.
I20260709 13:06:15.690647 19478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef32ce6fdd0e40d382c79974f30295c6" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:06:15.693197 19484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df751f992649444090e27965eb1af85d" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:06:15.695590 19484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46c5bfeecc314717bffe987e6844b6d0" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 18 candidate_status { last_received { term: 16 index: 7 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:06:15.661235 23874 raft_consensus.cc:2804] T 62c6c134d3d24a1ab144dd9ee6bc3f64 P e61c3a8f61bb48f8a963c9480e53c168 [term 11 FOLLOWER]: Leader pre-election won for term 12
W20260709 13:06:15.671801 24060 log.cc:927] Time spent T f1b10566f45d4a7d9029858330e02d5b P e5256d91808b47c195bc9b4dbd7f2b87: Append to log took a long time: real 0.090s	user 0.000s	sys 0.001s
I20260709 13:06:15.644670 23911 raft_consensus.cc:515] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P 127766fc592545a4997f7790f50f6076 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:15.642243 24040 raft_consensus.cc:515] T 0afb57ae58a24a01850491d69f0213dd P 0473d2b2d01f4459b1e90fd12cc7840e [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:15.696246 19484 raft_consensus.cc:2468] T 46c5bfeecc314717bffe987e6844b6d0 P 0473d2b2d01f4459b1e90fd12cc7840e [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 17.
I20260709 13:06:15.698882 19479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b08304a0a02b42d7840c4e8ee9a6bd1a" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:06:15.648798 24046 raft_consensus.cc:515] T 62c6c134d3d24a1ab144dd9ee6bc3f64 P 0473d2b2d01f4459b1e90fd12cc7840e [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:15.706877 19479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff75a1d4cb1f493db8f71ddc136ba9ab" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:06:15.708792 19479 raft_consensus.cc:2393] T ff75a1d4cb1f493db8f71ddc136ba9ab P 0473d2b2d01f4459b1e90fd12cc7840e [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate e5256d91808b47c195bc9b4dbd7f2b87 in current term 11: Already voted for candidate 0473d2b2d01f4459b1e90fd12cc7840e in this term.
I20260709 13:06:15.701553 20104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "172b3dd13109415a955b71ac0e9d2234" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
W20260709 13:06:15.695653 24069 log.cc:927] Time spent T ff9b0eddd810459b82d91c60777c10eb P 127766fc592545a4997f7790f50f6076: Append to log took a long time: real 0.079s	user 0.000s	sys 0.001s
I20260709 13:06:15.696166 23893 leader_election.cc:290] T 2725d2c4cb054f18b0fc8f735c15f6c2 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:06:15.699844 23874 raft_consensus.cc:493] T 62c6c134d3d24a1ab144dd9ee6bc3f64 P e61c3a8f61bb48f8a963c9480e53c168 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:15.726298 20106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0afb57ae58a24a01850491d69f0213dd" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:06:15.726891 20106 raft_consensus.cc:2468] T 0afb57ae58a24a01850491d69f0213dd P 127766fc592545a4997f7790f50f6076 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 10.
I20260709 13:06:15.661149 24062 raft_consensus.cc:515] T 96efeaaf1057492490e9a621f37e1a2d P 127766fc592545a4997f7790f50f6076 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:15.680684 23740 raft_consensus.cc:515] T 2725d2c4cb054f18b0fc8f735c15f6c2 P 0473d2b2d01f4459b1e90fd12cc7840e [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:15.790449 19552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0afb57ae58a24a01850491d69f0213dd" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:06:15.792528 19552 raft_consensus.cc:3060] T 0afb57ae58a24a01850491d69f0213dd P e61c3a8f61bb48f8a963c9480e53c168 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:06:15.729524 19449 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:15.759320 19409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65d8cb8d6ec64f459d5a47cefab10acf" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
I20260709 13:06:15.795246 19449 leader_election.cc:304] T 48824d5acfbc485ebf8c2d944e7202de P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e; no voters: 127766fc592545a4997f7790f50f6076, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:06:15.732306 19483 raft_consensus.cc:2393] T 62c6c134d3d24a1ab144dd9ee6bc3f64 P 0473d2b2d01f4459b1e90fd12cc7840e [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e61c3a8f61bb48f8a963c9480e53c168 in current term 12: Already voted for candidate 0473d2b2d01f4459b1e90fd12cc7840e in this term.
I20260709 13:06:15.729148 23945 consensus_queue.cc:1059] T 6c5eebf646ad445a9d1b1adc319d7b16 P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.004s
W20260709 13:06:15.732744 24070 log.cc:927] Time spent T 833a2f0775ed407a94b8924ce50adb63 P e61c3a8f61bb48f8a963c9480e53c168: Append to log took a long time: real 0.103s	user 0.001s	sys 0.000s
I20260709 13:06:15.733578 23979 consensus_queue.cc:1048] T 0cdf56e38bbc453d9438d359e5a69955 P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:06:15.734099 23820 leader_election.cc:290] T 46c5bfeecc314717bffe987e6844b6d0 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:06:15.736297 19551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46c5bfeecc314717bffe987e6844b6d0" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 18 candidate_status { last_received { term: 16 index: 7 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:06:15.739319 23714 raft_consensus.cc:3055] T 6c5eebf646ad445a9d1b1adc319d7b16 P 0473d2b2d01f4459b1e90fd12cc7840e [term 10 LEADER]: Stepping down as leader of term 10
W20260709 13:06:15.743126 24064 log.cc:927] Time spent T 65d8cb8d6ec64f459d5a47cefab10acf P e5256d91808b47c195bc9b4dbd7f2b87: Append to log took a long time: real 0.117s	user 0.000s	sys 0.000s
I20260709 13:06:15.744668 23973 leader_election.cc:290] T e381f1d6b8184797ad142de49be225a8 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:06:15.748014 23805 raft_consensus.cc:515] T 0e1085d23e8347fbbd5bce7542f4b1f4 P 127766fc592545a4997f7790f50f6076 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
W20260709 13:06:15.751044 19376 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:15.813143 19410 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52328 (request call id 2051) took 1160 ms. Trace:
I20260709 13:06:15.813643 19410 rpcz_store.cc:276] 0709 13:06:14.652924 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:14.686880 (+ 33956us) service_pool.cc:224] Handling call
0709 13:06:15.812958 (+1126078us) spinlock_profiling.cc:243] Waited 132 ms on lock 0x7b540019ee54. stack: 00007f4a79de9343 00007f4a79de9240 00007f4a797781d4 00007f4a834b6304 00007f4a834b6299 00007f4a7ce71571 00007f4a7cf0c2fa 00007f4a81ecdb17 00007f4a7b4486d4 00007f4a7b448662 00007f4a7b448591 00007f4a7b44850c 00007f4a7b4477c2 00007f4a7b24348c 00007f4a7b2428c6 00007f4a7b24226f
0709 13:06:15.813078 (+   120us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":302637312}
I20260709 13:06:15.759052 19411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff9b0eddd810459b82d91c60777c10eb" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:06:15.814894 19411 raft_consensus.cc:2468] T ff9b0eddd810459b82d91c60777c10eb P e5256d91808b47c195bc9b4dbd7f2b87 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 127766fc592545a4997f7790f50f6076 in term 12.
I20260709 13:06:15.773303 19402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a16f7501e2444fb86d4e2778e734e02" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:06:15.775068 19405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "775c229504194560ba9589bc2199b089" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:06:15.771836 20108 raft_consensus.cc:1240] T 65d8cb8d6ec64f459d5a47cefab10acf P 127766fc592545a4997f7790f50f6076 [term 12 FOLLOWER]: Rejecting Update request from peer e5256d91808b47c195bc9b4dbd7f2b87 for earlier term 11. Current term is 12. Ops: []
I20260709 13:06:15.756553 23944 raft_consensus.cc:515] T ef32ce6fdd0e40d382c79974f30295c6 P 0473d2b2d01f4459b1e90fd12cc7840e [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:15.704602 24075 raft_consensus.cc:2749] T 6c5eebf646ad445a9d1b1adc319d7b16 P e61c3a8f61bb48f8a963c9480e53c168 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:06:15.791317 19480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0afb57ae58a24a01850491d69f0213dd" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:06:15.750227 19403 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49050 (request call id 731) took 1095 ms. Trace:
I20260709 13:06:15.798703 19555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62c6c134d3d24a1ab144dd9ee6bc3f64" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:06:15.800206 20106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36f6ba92b9ba46babe4ebd6c02e5fbd9" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:06:15.821115 19449 leader_election.cc:304] T 309c3ca0ca4b4f3ba129752ea2cb293b P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e; no voters: 127766fc592545a4997f7790f50f6076, e61c3a8f61bb48f8a963c9480e53c168
W20260709 13:06:15.801952 19523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.4:43121, user_credentials={real_user=slave}} blocked reactor thread for 253736us
I20260709 13:06:15.728225 23874 raft_consensus.cc:3060] T 62c6c134d3d24a1ab144dd9ee6bc3f64 P e61c3a8f61bb48f8a963c9480e53c168 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:06:15.808719 19526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.2:46257, user_credentials={real_user=slave}} blocked reactor thread for 219341us
I20260709 13:06:15.755306 24033 raft_consensus.cc:493] T fa8650e71aa14778b3d73721fc50d9fc P e5256d91808b47c195bc9b4dbd7f2b87 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 0473d2b2d01f4459b1e90fd12cc7840e)
I20260709 13:06:15.818213 19405 raft_consensus.cc:2468] T 775c229504194560ba9589bc2199b089 P e5256d91808b47c195bc9b4dbd7f2b87 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 127766fc592545a4997f7790f50f6076 in term 10.
I20260709 13:06:15.760016 24040 leader_election.cc:290] T 0afb57ae58a24a01850491d69f0213dd P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 12 election: Requested vote from peers e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:06:15.748700 24046 leader_election.cc:290] T 62c6c134d3d24a1ab144dd9ee6bc3f64 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 12 election: Requested vote from peers e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:06:15.821149 19480 raft_consensus.cc:2368] T 0afb57ae58a24a01850491d69f0213dd P 0473d2b2d01f4459b1e90fd12cc7840e [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 127766fc592545a4997f7790f50f6076 for earlier term 11. Current term is 12.
I20260709 13:06:15.838845 24063 raft_consensus.cc:493] T 40e1e16737a842ee936002830f36882e P 0473d2b2d01f4459b1e90fd12cc7840e [term 15 FOLLOWER]: Starting pre-election (detected failure of leader e5256d91808b47c195bc9b4dbd7f2b87)
I20260709 13:06:15.839380 24063 raft_consensus.cc:515] T 40e1e16737a842ee936002830f36882e P 0473d2b2d01f4459b1e90fd12cc7840e [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:15.840124 23833 raft_consensus.cc:493] T 86a6797bdfe94fa496c050ceae4bd0d9 P e5256d91808b47c195bc9b4dbd7f2b87 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 0473d2b2d01f4459b1e90fd12cc7840e)
I20260709 13:06:15.840657 23833 raft_consensus.cc:515] T 86a6797bdfe94fa496c050ceae4bd0d9 P e5256d91808b47c195bc9b4dbd7f2b87 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:15.841444 24063 leader_election.cc:290] T 40e1e16737a842ee936002830f36882e P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:06:15.821861 20106 raft_consensus.cc:2393] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P 127766fc592545a4997f7790f50f6076 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0473d2b2d01f4459b1e90fd12cc7840e in current term 14: Already voted for candidate 127766fc592545a4997f7790f50f6076 in this term.
I20260709 13:06:15.821259 19403 rpcz_store.cc:276] 0709 13:06:14.654662 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:14.691540 (+ 36878us) service_pool.cc:224] Handling call
0709 13:06:14.691849 (+   309us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:14.692175 (+   326us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 13:06:14.692456 (+   281us) log.cc:844] Serialized 14 byte log entry
0709 13:06:15.749780 (+1057324us) spinlock_profiling.cc:243] Waited 26 ms on lock 0x7b1800366a60. stack: 00007f4a79de9343 00007f4a79de9240 00007f4a797781d4 00007f4a834b6304 00007f4a834b6299 00007f4a82ce3de1 00007f4a82cf05b1 00007f4a79d95c0a 00007f4a834d5219 00007f4a79e1da40 00007f4a79e184e4 00007f4a79e18455 00007f4a7cf00060 00007f4a7cf12716 00007f4a7cf23287 00007f4a7cf23208
0709 13:06:15.749919 (+   139us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:15.749966 (+    47us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:06:15.750011 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:15.750072 (+    61us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:15.750176 (+   104us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":20118,"prepare.queue_time_us":98,"prepare.run_cpu_time_us":34,"prepare.run_wall_time_us":35,"raft.queue_time_us":1057921,"raft.run_cpu_time_us":48,"raft.run_wall_time_us":48,"spinlock_wait_cycles":59801856}
I20260709 13:06:15.795830 23755 leader_election.cc:290] T 217b5fae677b4971b3bbd2f357a1f7ff P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:06:15.852625 19551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40e1e16737a842ee936002830f36882e" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:06:15.858907 19411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e1f505cb0f1427bbd698ac889d80821" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
I20260709 13:06:15.851087 19409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cdf56e38bbc453d9438d359e5a69955" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
I20260709 13:06:15.873610 19411 raft_consensus.cc:2393] T 3e1f505cb0f1427bbd698ac889d80821 P e5256d91808b47c195bc9b4dbd7f2b87 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 0473d2b2d01f4459b1e90fd12cc7840e in current term 13: Already voted for candidate e5256d91808b47c195bc9b4dbd7f2b87 in this term.
I20260709 13:06:15.873762 19409 raft_consensus.cc:3060] T 0cdf56e38bbc453d9438d359e5a69955 P e5256d91808b47c195bc9b4dbd7f2b87 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:06:15.851058 19405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef32ce6fdd0e40d382c79974f30295c6" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:06:15.876317 19405 raft_consensus.cc:2468] T ef32ce6fdd0e40d382c79974f30295c6 P e5256d91808b47c195bc9b4dbd7f2b87 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 14.
I20260709 13:06:15.883061 19557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef32ce6fdd0e40d382c79974f30295c6" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:06:15.882148 19552 raft_consensus.cc:2468] T 0afb57ae58a24a01850491d69f0213dd P e61c3a8f61bb48f8a963c9480e53c168 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 12.
I20260709 13:06:15.826805 19526 leader_election.cc:304] T 1dc5b3532fe54f74876d02beffa2c230 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:06:15.801115 23713 raft_consensus.cc:493] T 4af19371ea874c09a0a2147040835cbb P e61c3a8f61bb48f8a963c9480e53c168 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 127766fc592545a4997f7790f50f6076)
I20260709 13:06:15.885530 19411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1b10566f45d4a7d9029858330e02d5b" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:06:15.808243 23538 raft_consensus.cc:493] T 217b5fae677b4971b3bbd2f357a1f7ff P 0473d2b2d01f4459b1e90fd12cc7840e [term 9 FOLLOWER]: Starting pre-election (detected failure of leader e5256d91808b47c195bc9b4dbd7f2b87)
I20260709 13:06:15.799307 23883 raft_consensus.cc:493] T bc225c93219c45538b53a1bd3d387e4d P e5256d91808b47c195bc9b4dbd7f2b87 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 0473d2b2d01f4459b1e90fd12cc7840e)
I20260709 13:06:15.809415 23714 raft_consensus.cc:740] T 6c5eebf646ad445a9d1b1adc319d7b16 P 0473d2b2d01f4459b1e90fd12cc7840e [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 0473d2b2d01f4459b1e90fd12cc7840e, State: Running, Role: LEADER
W20260709 13:06:15.837291 24071 log.cc:927] Time spent T 48824d5acfbc485ebf8c2d944e7202de P 127766fc592545a4997f7790f50f6076: Append to log took a long time: real 0.162s	user 0.001s	sys 0.000s
I20260709 13:06:15.845306 20078 leader_election.cc:304] T 775c229504194560ba9589bc2199b089 P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, 127766fc592545a4997f7790f50f6076; no voters: 
I20260709 13:06:15.848590 19478 raft_consensus.cc:2393] T ef32ce6fdd0e40d382c79974f30295c6 P 0473d2b2d01f4459b1e90fd12cc7840e [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e5256d91808b47c195bc9b4dbd7f2b87 in current term 15: Already voted for candidate 0473d2b2d01f4459b1e90fd12cc7840e in this term.
I20260709 13:06:15.887629 19450 leader_election.cc:304] T 0afb57ae58a24a01850491d69f0213dd P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:06:15.888283 19405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9962423cb4e54fcfa5de01daf68a86e7" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:06:15.753849 24054 raft_consensus.cc:515] T 21e14947d70440f19044d8f75c31e1f9 P 0473d2b2d01f4459b1e90fd12cc7840e [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:15.829262 23870 raft_consensus.cc:2749] T 48824d5acfbc485ebf8c2d944e7202de P 0473d2b2d01f4459b1e90fd12cc7840e [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:06:15.890559 19374 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.4:43121, user_credentials={real_user=slave}} blocked reactor thread for 78498.4us
I20260709 13:06:15.893702 19552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0afb57ae58a24a01850491d69f0213dd" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:06:15.920326 19552 raft_consensus.cc:2368] T 0afb57ae58a24a01850491d69f0213dd P e61c3a8f61bb48f8a963c9480e53c168 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 127766fc592545a4997f7790f50f6076 for earlier term 11. Current term is 12.
I20260709 13:06:15.920269 19559 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40428 (request call id 2526) took 1579 ms. Trace:
I20260709 13:06:15.751436 24041 raft_consensus.cc:515] T f1b10566f45d4a7d9029858330e02d5b P 0473d2b2d01f4459b1e90fd12cc7840e [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:15.796608 23901 raft_consensus.cc:515] T ef32ce6fdd0e40d382c79974f30295c6 P e61c3a8f61bb48f8a963c9480e53c168 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
W20260709 13:06:15.890095 19375 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.3:36891, user_credentials={real_user=slave}} blocked reactor thread for 131416us
W20260709 13:06:15.916076 19526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.2:46257, user_credentials={real_user=slave}} blocked reactor thread for 89388.1us
I20260709 13:06:15.842447 24062 leader_election.cc:290] T 96efeaaf1057492490e9a621f37e1a2d P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:06:15.842811 23687 raft_consensus.cc:493] T 4509b76741dc428e9201c70c1658da13 P e5256d91808b47c195bc9b4dbd7f2b87 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:15.842532 23833 leader_election.cc:290] T 86a6797bdfe94fa496c050ceae4bd0d9 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
W20260709 13:06:15.919430 20078 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.2:46257, user_credentials={real_user=slave}} blocked reactor thread for 74182.6us
I20260709 13:06:15.834086 24024 raft_consensus.cc:2749] T 309c3ca0ca4b4f3ba129752ea2cb293b P 0473d2b2d01f4459b1e90fd12cc7840e [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:06:15.921175 19405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b74109013a140ada21feeef92d6f563" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:06:15.920774 19559 rpcz_store.cc:276] 0709 13:06:14.341324 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:14.344453 (+  3129us) service_pool.cc:224] Handling call
0709 13:06:14.344713 (+   260us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:14.344912 (+   199us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:06:14.682917 (+338005us) log.cc:844] Serialized 14 byte log entry
0709 13:06:15.628429 (+945512us) spinlock_profiling.cc:243] Waited 23.5 ms on lock 0x7b18003fe740. stack: 00007f4a79de9343 00007f4a79de9240 00007f4a797781d4 00007f4a834b6304 00007f4a834b6299 00007f4a82ce3de1 00007f4a82cf05b1 00007f4a7cab04bc 00007f4a79dfe48b 00007f4a82c58ab9 00007f4a79e1a69b 00007f4a79e1893f 00007f4a79e1ac02 00007f4a7caa220b 00007f4a7caa7d23 00007f4a7caa823a
0709 13:06:15.763031 (+134602us) spinlock_profiling.cc:243] Waited 3.33 ms on lock 0x7b480002f658. stack: 00007f4a79de9343 00007f4a79de9240 00007f4a797781d4 00007f4a834b6304 00007f4a834b6299 00007f4a81e31aa1 00007f4a81e28b37 00007f4a81e289ca 00007f4a81f2026f 00007f4a81f1ff37 00007f4a81f3455c 00007f4a81f34508 00007f4a81f34488 00007f4a81f34443 00007f4a81f336ec 00007f4a80e5da96
0709 13:06:15.919972 (+156941us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:15.920022 (+    50us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:06:15.920066 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:15.920123 (+    57us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:15.920221 (+    98us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":495924,"prepare.run_cpu_time_us":43,"prepare.run_wall_time_us":43,"raft.queue_time_us":76161,"raft.run_cpu_time_us":1432,"raft.run_wall_time_us":57397,"spinlock_wait_cycles":61792256,"thread_start_us":753209,"threads_started":3,"wal-append.queue_time_us":425116}
I20260709 13:06:15.923687 23784 raft_consensus.cc:2804] T 775c229504194560ba9589bc2199b089 P 127766fc592545a4997f7790f50f6076 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:06:15.925917 19377 leader_election.cc:304] T 46c5bfeecc314717bffe987e6844b6d0 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87; no voters: 
I20260709 13:06:15.848248 23944 leader_election.cc:290] T ef32ce6fdd0e40d382c79974f30295c6 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 15 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:06:15.919134 23896 raft_consensus.cc:2804] T 0afb57ae58a24a01850491d69f0213dd P 0473d2b2d01f4459b1e90fd12cc7840e [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:06:15.849119 23805 leader_election.cc:290] T 0e1085d23e8347fbbd5bce7542f4b1f4 P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 10 election: Requested vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:06:15.849319 23777 raft_consensus.cc:493] T 7f575b143b844aa096b50997dad3516a P e5256d91808b47c195bc9b4dbd7f2b87 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:15.849789 23985 raft_consensus.cc:493] T f93ee515a9c14139bf566522ed8232f3 P e5256d91808b47c195bc9b4dbd7f2b87 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 0473d2b2d01f4459b1e90fd12cc7840e)
I20260709 13:06:15.847883 24073 raft_consensus.cc:493] T ece3db938bc649d4a40a51522ed5259c P 127766fc592545a4997f7790f50f6076 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader e5256d91808b47c195bc9b4dbd7f2b87)
I20260709 13:06:15.931221 19375 leader_election.cc:304] T 28af091831594f9d8e96482078cc7625 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:06:15.932049 19526 leader_election.cc:304] T f93ee515a9c14139bf566522ed8232f3 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e61c3a8f61bb48f8a963c9480e53c168; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:06:15.822315 24036 raft_consensus.cc:515] T ff75a1d4cb1f493db8f71ddc136ba9ab P e61c3a8f61bb48f8a963c9480e53c168 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:15.886566 23974 raft_consensus.cc:3055] T df751f992649444090e27965eb1af85d P e61c3a8f61bb48f8a963c9480e53c168 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:06:15.849627 24031 raft_consensus.cc:493] T 2b74109013a140ada21feeef92d6f563 P e5256d91808b47c195bc9b4dbd7f2b87 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:15.960691 19557 raft_consensus.cc:2393] T ef32ce6fdd0e40d382c79974f30295c6 P e61c3a8f61bb48f8a963c9480e53c168 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 0473d2b2d01f4459b1e90fd12cc7840e in current term 15: Already voted for candidate e61c3a8f61bb48f8a963c9480e53c168 in this term.
I20260709 13:06:15.995131 19408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edd7d470b5014c9489be7f41f64355c9" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 13 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
I20260709 13:06:15.849752 23928 raft_consensus.cc:515] T a08760e15aac4630a629431f56024dc8 P 0473d2b2d01f4459b1e90fd12cc7840e [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:15.927832 19411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ec1c4ce15e04c7e8c283a62179f2a64" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:06:15.849270 23872 raft_consensus.cc:515] T 2b74109013a140ada21feeef92d6f563 P 0473d2b2d01f4459b1e90fd12cc7840e [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:16.005935 20078 leader_election.cc:400] T 0afb57ae58a24a01850491d69f0213dd P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 11 pre-election: Vote denied by peer 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257) with higher term. Message: Invalid argument: T 0afb57ae58a24a01850491d69f0213dd P 0473d2b2d01f4459b1e90fd12cc7840e [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 127766fc592545a4997f7790f50f6076 for earlier term 11. Current term is 12.
I20260709 13:06:16.006335 20078 leader_election.cc:403] T 0afb57ae58a24a01850491d69f0213dd P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 11 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:06:15.925804 23755 raft_consensus.cc:2804] T 1dc5b3532fe54f74876d02beffa2c230 P e61c3a8f61bb48f8a963c9480e53c168 [term 12 FOLLOWER]: Leader pre-election won for term 13
W20260709 13:06:15.991181 19377 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.2:46257, user_credentials={real_user=slave}} blocked reactor thread for 65339.7us
I20260709 13:06:15.962710 23873 consensus_queue.cc:1059] T edd7d470b5014c9489be7f41f64355c9 P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 }, Status: INVALID_TERM, Last received: 11.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.011s
I20260709 13:06:15.996011 20075 leader_election.cc:304] T 65d8cb8d6ec64f459d5a47cefab10acf P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 127766fc592545a4997f7790f50f6076; no voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:06:16.011665 19483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86a6797bdfe94fa496c050ceae4bd0d9" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:06:16.012187 20075 leader_election.cc:304] T ff9b0eddd810459b82d91c60777c10eb P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 127766fc592545a4997f7790f50f6076, e5256d91808b47c195bc9b4dbd7f2b87; no voters: 0473d2b2d01f4459b1e90fd12cc7840e
W20260709 13:06:15.996263 19526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.2:46257, user_credentials={real_user=slave}} blocked reactor thread for 64292.4us
I20260709 13:06:16.014439 19404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "309c3ca0ca4b4f3ba129752ea2cb293b" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:06:16.015249 19526 leader_election.cc:304] T 21e14947d70440f19044d8f75c31e1f9 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
W20260709 13:06:15.996038 19375 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.3:36891, user_credentials={real_user=slave}} blocked reactor thread for 64909.1us
I20260709 13:06:16.008314 19411 pending_rounds.cc:85] T ff9b0eddd810459b82d91c60777c10eb P e5256d91808b47c195bc9b4dbd7f2b87: Aborting all ops after (but not including) 8
I20260709 13:06:16.016590 19411 pending_rounds.cc:107] T ff9b0eddd810459b82d91c60777c10eb P e5256d91808b47c195bc9b4dbd7f2b87: Aborting uncommitted NO_OP operation due to leader change: 10.9
I20260709 13:06:16.016937 19411 raft_consensus.cc:2889] T ff9b0eddd810459b82d91c60777c10eb P e5256d91808b47c195bc9b4dbd7f2b87 [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:06:15.962356 23901 leader_election.cc:290] T ef32ce6fdd0e40d382c79974f30295c6 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 15 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:06:15.961328 23933 raft_consensus.cc:493] T 179fd671030940b4b4a4e24bcc4aba0a P 0473d2b2d01f4459b1e90fd12cc7840e [term 13 FOLLOWER]: Starting pre-election (detected failure of leader e61c3a8f61bb48f8a963c9480e53c168)
I20260709 13:06:15.915406 23538 raft_consensus.cc:515] T 217b5fae677b4971b3bbd2f357a1f7ff P 0473d2b2d01f4459b1e90fd12cc7840e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:15.978513 23784 raft_consensus.cc:493] T 775c229504194560ba9589bc2199b089 P 127766fc592545a4997f7790f50f6076 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:15.967654 24084 raft_consensus.cc:493] T 28af091831594f9d8e96482078cc7625 P e61c3a8f61bb48f8a963c9480e53c168 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 0473d2b2d01f4459b1e90fd12cc7840e)
I20260709 13:06:16.020066 23638 raft_consensus.cc:2749] T 65d8cb8d6ec64f459d5a47cefab10acf P 127766fc592545a4997f7790f50f6076 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:06:16.004783 23880 raft_consensus.cc:2749] T 28af091831594f9d8e96482078cc7625 P e5256d91808b47c195bc9b4dbd7f2b87 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:06:16.008630 23896 raft_consensus.cc:697] T 0afb57ae58a24a01850491d69f0213dd P 0473d2b2d01f4459b1e90fd12cc7840e [term 12 LEADER]: Becoming Leader. State: Replica: 0473d2b2d01f4459b1e90fd12cc7840e, State: Running, Role: LEADER
I20260709 13:06:16.001420 24073 raft_consensus.cc:515] T ece3db938bc649d4a40a51522ed5259c P 127766fc592545a4997f7790f50f6076 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:16.023857 23872 leader_election.cc:290] T 2b74109013a140ada21feeef92d6f563 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 10 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:06:16.024391 23605 raft_consensus.cc:3055] T edd7d470b5014c9489be7f41f64355c9 P e5256d91808b47c195bc9b4dbd7f2b87 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:06:16.024871 24032 consensus_queue.cc:1059] T 65d8cb8d6ec64f459d5a47cefab10acf P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false }, Status: INVALID_TERM, Last received: 11.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.030s
I20260709 13:06:15.846766 24033 raft_consensus.cc:515] T fa8650e71aa14778b3d73721fc50d9fc P e5256d91808b47c195bc9b4dbd7f2b87 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:16.026563 19556 raft_consensus.cc:2368] T ff75a1d4cb1f493db8f71ddc136ba9ab P e61c3a8f61bb48f8a963c9480e53c168 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate e5256d91808b47c195bc9b4dbd7f2b87 for earlier term 11. Current term is 12.
I20260709 13:06:16.027633 19408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46c5bfeecc314717bffe987e6844b6d0" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 18 candidate_status { last_received { term: 16 index: 7 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:06:16.029532 19484 raft_consensus.cc:1240] T a08760e15aac4630a629431f56024dc8 P 0473d2b2d01f4459b1e90fd12cc7840e [term 15 FOLLOWER]: Rejecting Update request from peer e5256d91808b47c195bc9b4dbd7f2b87 for earlier term 14. Current term is 15. Ops: []
I20260709 13:06:16.003643 23714 consensus_queue.cc:260] T 6c5eebf646ad445a9d1b1adc319d7b16 P 0473d2b2d01f4459b1e90fd12cc7840e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:15.919358 23713 raft_consensus.cc:515] T 4af19371ea874c09a0a2147040835cbb P e61c3a8f61bb48f8a963c9480e53c168 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
W20260709 13:06:16.077085 24055 consensus_meta.cc:287] T e381f1d6b8184797ad142de49be225a8 P 0473d2b2d01f4459b1e90fd12cc7840e: Time spent flushing consensus metadata: real 0.505s	user 0.010s	sys 0.000s
I20260709 13:06:16.001718 23974 raft_consensus.cc:740] T df751f992649444090e27965eb1af85d P e61c3a8f61bb48f8a963c9480e53c168 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: e61c3a8f61bb48f8a963c9480e53c168, State: Running, Role: LEADER
I20260709 13:06:16.087590 23974 consensus_queue.cc:260] T df751f992649444090e27965eb1af85d P e61c3a8f61bb48f8a963c9480e53c168 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.9, Last appended by leader: 9, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:16.088893 23974 raft_consensus.cc:3060] T df751f992649444090e27965eb1af85d P e61c3a8f61bb48f8a963c9480e53c168 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:06:16.005446 23973 raft_consensus.cc:2749] T f93ee515a9c14139bf566522ed8232f3 P e61c3a8f61bb48f8a963c9480e53c168 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:06:16.033118 19479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96efeaaf1057492490e9a621f37e1a2d" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:06:16.036238 20106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62c6c134d3d24a1ab144dd9ee6bc3f64" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076"
I20260709 13:06:16.091214 20106 raft_consensus.cc:3060] T 62c6c134d3d24a1ab144dd9ee6bc3f64 P 127766fc592545a4997f7790f50f6076 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:06:16.037340 20112 raft_consensus.cc:1240] T 0e1085d23e8347fbbd5bce7542f4b1f4 P 127766fc592545a4997f7790f50f6076 [term 10 FOLLOWER]: Rejecting Update request from peer 0473d2b2d01f4459b1e90fd12cc7840e for earlier term 9. Current term is 10. Ops: []
I20260709 13:06:15.973259 23687 raft_consensus.cc:515] T 4509b76741dc428e9201c70c1658da13 P e5256d91808b47c195bc9b4dbd7f2b87 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:15.919607 23883 raft_consensus.cc:515] T bc225c93219c45538b53a1bd3d387e4d P e5256d91808b47c195bc9b4dbd7f2b87 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:16.005152 24031 raft_consensus.cc:515] T 2b74109013a140ada21feeef92d6f563 P e5256d91808b47c195bc9b4dbd7f2b87 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:16.046516 19554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96efeaaf1057492490e9a621f37e1a2d" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:06:16.046908 20105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0afb57ae58a24a01850491d69f0213dd" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076"
I20260709 13:06:16.049588 19485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36f6ba92b9ba46babe4ebd6c02e5fbd9" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:06:16.103298 19485 raft_consensus.cc:3060] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P 0473d2b2d01f4459b1e90fd12cc7840e [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:06:16.049722 19478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e1085d23e8347fbbd5bce7542f4b1f4" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:06:16.032090 19526 leader_election.cc:304] T 48824d5acfbc485ebf8c2d944e7202de P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168; no voters: 127766fc592545a4997f7790f50f6076
I20260709 13:06:16.018715 23755 raft_consensus.cc:493] T 1dc5b3532fe54f74876d02beffa2c230 P e61c3a8f61bb48f8a963c9480e53c168 [term 12 FOLLOWER]: Starting leader election (detected failure of leader e5256d91808b47c195bc9b4dbd7f2b87)
I20260709 13:06:16.013705 20075 leader_election.cc:304] T 2a16f7501e2444fb86d4e2778e734e02 P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 127766fc592545a4997f7790f50f6076; no voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:06:15.995029 23777 raft_consensus.cc:515] T 7f575b143b844aa096b50997dad3516a P e5256d91808b47c195bc9b4dbd7f2b87 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:16.032861 23761 raft_consensus.cc:2804] T ff9b0eddd810459b82d91c60777c10eb P 127766fc592545a4997f7790f50f6076 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:06:16.112792 23874 raft_consensus.cc:515] T 62c6c134d3d24a1ab144dd9ee6bc3f64 P e61c3a8f61bb48f8a963c9480e53c168 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:16.113901 24089 raft_consensus.cc:2804] T 48824d5acfbc485ebf8c2d944e7202de P e61c3a8f61bb48f8a963c9480e53c168 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:06:16.095173 23880 raft_consensus.cc:3055] T 65d8cb8d6ec64f459d5a47cefab10acf P e5256d91808b47c195bc9b4dbd7f2b87 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:06:16.115024 19555 raft_consensus.cc:2393] T 62c6c134d3d24a1ab144dd9ee6bc3f64 P e61c3a8f61bb48f8a963c9480e53c168 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 0473d2b2d01f4459b1e90fd12cc7840e in current term 12: Already voted for candidate e61c3a8f61bb48f8a963c9480e53c168 in this term.
I20260709 13:06:16.115082 23880 raft_consensus.cc:740] T 65d8cb8d6ec64f459d5a47cefab10acf P e5256d91808b47c195bc9b4dbd7f2b87 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: e5256d91808b47c195bc9b4dbd7f2b87, State: Running, Role: LEADER
I20260709 13:06:16.112829 23761 raft_consensus.cc:493] T ff9b0eddd810459b82d91c60777c10eb P 127766fc592545a4997f7790f50f6076 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 0473d2b2d01f4459b1e90fd12cc7840e)
I20260709 13:06:16.116148 23761 raft_consensus.cc:3060] T ff9b0eddd810459b82d91c60777c10eb P 127766fc592545a4997f7790f50f6076 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:06:16.116374 23880 consensus_queue.cc:260] T 65d8cb8d6ec64f459d5a47cefab10acf P e5256d91808b47c195bc9b4dbd7f2b87 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:16.118074 23880 raft_consensus.cc:3060] T 65d8cb8d6ec64f459d5a47cefab10acf P e5256d91808b47c195bc9b4dbd7f2b87 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:06:16.065384 24084 raft_consensus.cc:515] T 28af091831594f9d8e96482078cc7625 P e61c3a8f61bb48f8a963c9480e53c168 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:16.122570 23740 leader_election.cc:290] T 2725d2c4cb054f18b0fc8f735c15f6c2 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:06:16.095542 24055 raft_consensus.cc:515] T e381f1d6b8184797ad142de49be225a8 P 0473d2b2d01f4459b1e90fd12cc7840e [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:16.124995 24055 leader_election.cc:290] T e381f1d6b8184797ad142de49be225a8 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 10 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:06:16.045639 23911 leader_election.cc:290] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 14 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:06:16.001199 23985 raft_consensus.cc:515] T f93ee515a9c14139bf566522ed8232f3 P e5256d91808b47c195bc9b4dbd7f2b87 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:16.001027 23919 raft_consensus.cc:2804] T 46c5bfeecc314717bffe987e6844b6d0 P e5256d91808b47c195bc9b4dbd7f2b87 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:06:16.126386 23919 raft_consensus.cc:493] T 46c5bfeecc314717bffe987e6844b6d0 P e5256d91808b47c195bc9b4dbd7f2b87 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:16.126802 23919 raft_consensus.cc:3060] T 46c5bfeecc314717bffe987e6844b6d0 P e5256d91808b47c195bc9b4dbd7f2b87 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:06:16.127633 23985 leader_election.cc:290] T f93ee515a9c14139bf566522ed8232f3 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:06:16.127898 24073 leader_election.cc:290] T ece3db938bc649d4a40a51522ed5259c P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:06:16.045073 23933 raft_consensus.cc:515] T 179fd671030940b4b4a4e24bcc4aba0a P 0473d2b2d01f4459b1e90fd12cc7840e [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:16.031096 24075 raft_consensus.cc:2804] T 21e14947d70440f19044d8f75c31e1f9 P e61c3a8f61bb48f8a963c9480e53c168 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:06:16.130580 23874 leader_election.cc:290] T 62c6c134d3d24a1ab144dd9ee6bc3f64 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 12 election: Requested vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
W20260709 13:06:16.086427 24090 log.cc:927] Time spent T 1a61655d99124a29b486ba4a5b37faea P e61c3a8f61bb48f8a963c9480e53c168: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
I20260709 13:06:16.131502 23933 leader_election.cc:290] T 179fd671030940b4b4a4e24bcc4aba0a P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
W20260709 13:06:16.107702 20075 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.1:40321, user_credentials={real_user=slave}} blocked reactor thread for 94103.8us
I20260709 13:06:16.133363 23713 leader_election.cc:290] T 4af19371ea874c09a0a2147040835cbb P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
W20260709 13:06:16.109380 19526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.2:46257, user_credentials={real_user=slave}} blocked reactor thread for 77367.1us
I20260709 13:06:16.134763 19526 leader_election.cc:304] T b08304a0a02b42d7840c4e8ee9a6bd1a P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e61c3a8f61bb48f8a963c9480e53c168; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:06:16.135798 19526 leader_election.cc:304] T d1e5873a19244c5ebbcd38e126796ee7 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:06:16.111143 24061 raft_consensus.cc:3060] T 0afb57ae58a24a01850491d69f0213dd P 127766fc592545a4997f7790f50f6076 [term 10 FOLLOWER]: Advancing to term 12
W20260709 13:06:16.111189 24085 log.cc:927] Time spent T 65d8cb8d6ec64f459d5a47cefab10acf P e61c3a8f61bb48f8a963c9480e53c168: Append to log took a long time: real 0.245s	user 0.000s	sys 0.001s
I20260709 13:06:16.111936 24041 leader_election.cc:290] T f1b10566f45d4a7d9029858330e02d5b P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 14 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:06:16.112309 23777 leader_election.cc:290] T 7f575b143b844aa096b50997dad3516a P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:06:16.114480 24089 raft_consensus.cc:493] T 48824d5acfbc485ebf8c2d944e7202de P e61c3a8f61bb48f8a963c9480e53c168 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 127766fc592545a4997f7790f50f6076)
I20260709 13:06:16.058584 23784 raft_consensus.cc:3060] T 775c229504194560ba9589bc2199b089 P 127766fc592545a4997f7790f50f6076 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:06:16.155733 24089 raft_consensus.cc:3060] T 48824d5acfbc485ebf8c2d944e7202de P e61c3a8f61bb48f8a963c9480e53c168 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:06:16.157882 19485 raft_consensus.cc:2468] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P 0473d2b2d01f4459b1e90fd12cc7840e [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 127766fc592545a4997f7790f50f6076 in term 14.
I20260709 13:06:16.076711 20076 leader_election.cc:400] T 0afb57ae58a24a01850491d69f0213dd P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 11 pre-election: Vote denied by peer e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891) with higher term. Message: Invalid argument: T 0afb57ae58a24a01850491d69f0213dd P e61c3a8f61bb48f8a963c9480e53c168 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 127766fc592545a4997f7790f50f6076 for earlier term 11. Current term is 12.
W20260709 13:06:16.159140 20076 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.3:36891, user_credentials={real_user=slave}} blocked reactor thread for 82567.3us
I20260709 13:06:16.160346 24031 leader_election.cc:290] T 2b74109013a140ada21feeef92d6f563 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:06:16.161401 23761 raft_consensus.cc:515] T ff9b0eddd810459b82d91c60777c10eb P 127766fc592545a4997f7790f50f6076 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:16.162137 24033 leader_election.cc:290] T fa8650e71aa14778b3d73721fc50d9fc P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:06:16.162606 24073 raft_consensus.cc:493] T 833a2f0775ed407a94b8924ce50adb63 P 127766fc592545a4997f7790f50f6076 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader e5256d91808b47c195bc9b4dbd7f2b87)
I20260709 13:06:16.162462 23784 raft_consensus.cc:515] T 775c229504194560ba9589bc2199b089 P 127766fc592545a4997f7790f50f6076 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:16.163174 24073 raft_consensus.cc:515] T 833a2f0775ed407a94b8924ce50adb63 P 127766fc592545a4997f7790f50f6076 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:16.163775 23687 leader_election.cc:290] T 4509b76741dc428e9201c70c1658da13 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:06:16.164623 23784 leader_election.cc:290] T 775c229504194560ba9589bc2199b089 P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 11 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:06:16.165258 24073 leader_election.cc:290] T 833a2f0775ed407a94b8924ce50adb63 P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:06:16.162492 20110 raft_consensus.cc:1240] T ff9b0eddd810459b82d91c60777c10eb P 127766fc592545a4997f7790f50f6076 [term 13 FOLLOWER]: Rejecting Update request from peer 0473d2b2d01f4459b1e90fd12cc7840e for earlier term 12. Current term is 13. Ops: []
I20260709 13:06:16.124585 23896 consensus_queue.cc:237] T 0afb57ae58a24a01850491d69f0213dd P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
W20260709 13:06:16.125941 24097 log.cc:927] Time spent T edd7d470b5014c9489be7f41f64355c9 P e61c3a8f61bb48f8a963c9480e53c168: Append to log took a long time: real 0.054s	user 0.001s	sys 0.000s
I20260709 13:06:16.129666 24084 leader_election.cc:290] T 28af091831594f9d8e96482078cc7625 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:06:16.130852 24075 raft_consensus.cc:493] T 21e14947d70440f19044d8f75c31e1f9 P e61c3a8f61bb48f8a963c9480e53c168 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:16.079384 23605 raft_consensus.cc:740] T edd7d470b5014c9489be7f41f64355c9 P e5256d91808b47c195bc9b4dbd7f2b87 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: e5256d91808b47c195bc9b4dbd7f2b87, State: Running, Role: LEADER
I20260709 13:06:16.137430 19526 leader_election.cc:304] T 0afb57ae58a24a01850491d69f0213dd P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168; no voters: 127766fc592545a4997f7790f50f6076
I20260709 13:06:16.078490 19551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e1085d23e8347fbbd5bce7542f4b1f4" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:06:16.154294 20106 raft_consensus.cc:2468] T 62c6c134d3d24a1ab144dd9ee6bc3f64 P 127766fc592545a4997f7790f50f6076 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 12.
I20260709 13:06:16.113227 24011 raft_consensus.cc:2749] T 2a16f7501e2444fb86d4e2778e734e02 P 127766fc592545a4997f7790f50f6076 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:06:16.107594 23928 leader_election.cc:290] T a08760e15aac4630a629431f56024dc8 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 15 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:06:16.109367 23755 raft_consensus.cc:3060] T 1dc5b3532fe54f74876d02beffa2c230 P e61c3a8f61bb48f8a963c9480e53c168 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:06:16.173365 19526 leader_election.cc:304] T 2e36a9d6e29c4a7c860cf267efbd4c74 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:06:16.153573 23874 raft_consensus.cc:2804] T d1e5873a19244c5ebbcd38e126796ee7 P e61c3a8f61bb48f8a963c9480e53c168 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:06:16.172048 24054 leader_election.cc:290] T 21e14947d70440f19044d8f75c31e1f9 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 13 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:06:16.147302 24001 raft_consensus.cc:2749] T b08304a0a02b42d7840c4e8ee9a6bd1a P e61c3a8f61bb48f8a963c9480e53c168 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:06:16.102602 24024 consensus_queue.cc:1059] T 0e1085d23e8347fbbd5bce7542f4b1f4 P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.051s
I20260709 13:06:16.203015 24084 raft_consensus.cc:2764] T 0afb57ae58a24a01850491d69f0213dd P e61c3a8f61bb48f8a963c9480e53c168 [term 12 FOLLOWER]: Leader pre-election decision vote started in defunct term 11: won
I20260709 13:06:16.172446 24075 raft_consensus.cc:3060] T 21e14947d70440f19044d8f75c31e1f9 P e61c3a8f61bb48f8a963c9480e53c168 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:06:16.206792 23874 raft_consensus.cc:493] T d1e5873a19244c5ebbcd38e126796ee7 P e61c3a8f61bb48f8a963c9480e53c168 [term 13 FOLLOWER]: Starting leader election (detected failure of leader e5256d91808b47c195bc9b4dbd7f2b87)
I20260709 13:06:16.172140 23919 raft_consensus.cc:515] T 46c5bfeecc314717bffe987e6844b6d0 P e5256d91808b47c195bc9b4dbd7f2b87 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:16.212327 24036 leader_election.cc:290] T ff75a1d4cb1f493db8f71ddc136ba9ab P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 12 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:06:16.219583 23883 leader_election.cc:290] T bc225c93219c45538b53a1bd3d387e4d P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:06:16.220559 23874 raft_consensus.cc:3060] T d1e5873a19244c5ebbcd38e126796ee7 P e61c3a8f61bb48f8a963c9480e53c168 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:06:16.228919 24048 consensus_meta.cc:287] T 14efcc79969f41babe5529c22d59156d P 127766fc592545a4997f7790f50f6076: Time spent flushing consensus metadata: real 0.632s	user 0.002s	sys 0.008s
I20260709 13:06:16.229482 24048 raft_consensus.cc:515] T 14efcc79969f41babe5529c22d59156d P 127766fc592545a4997f7790f50f6076 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:16.026516 19375 leader_election.cc:304] T 3e1f505cb0f1427bbd698ac889d80821 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168
W20260709 13:06:16.289295 19375 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.3:36891, user_credentials={real_user=slave}} blocked reactor thread for 262663us
I20260709 13:06:16.291047 19375 leader_election.cc:304] T ef32ce6fdd0e40d382c79974f30295c6 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:06:16.034515 19404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f85fc4b527a48848e5faa083b604e36" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:06:16.292908 19405 raft_consensus.cc:2468] T 2b74109013a140ada21feeef92d6f563 P e5256d91808b47c195bc9b4dbd7f2b87 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 9.
I20260709 13:06:16.294962 19408 raft_consensus.cc:2393] T 46c5bfeecc314717bffe987e6844b6d0 P e5256d91808b47c195bc9b4dbd7f2b87 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0473d2b2d01f4459b1e90fd12cc7840e in current term 18: Already voted for candidate e5256d91808b47c195bc9b4dbd7f2b87 in this term.
I20260709 13:06:16.295920 19404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef32ce6fdd0e40d382c79974f30295c6" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
I20260709 13:06:16.295571 19407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a08760e15aac4630a629431f56024dc8" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:06:16.093035 19409 raft_consensus.cc:2468] T 0cdf56e38bbc453d9438d359e5a69955 P e5256d91808b47c195bc9b4dbd7f2b87 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 14.
I20260709 13:06:16.297051 19404 raft_consensus.cc:3060] T ef32ce6fdd0e40d382c79974f30295c6 P e5256d91808b47c195bc9b4dbd7f2b87 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:06:16.298175 19409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "172b3dd13109415a955b71ac0e9d2234" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:06:16.299958 19409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40e1e16737a842ee936002830f36882e" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:06:16.300292 19406 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52342 (request call id 2586) took 2435 ms. Trace:
I20260709 13:06:16.301481 19409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a08760e15aac4630a629431f56024dc8" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
I20260709 13:06:16.303244 19409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36f6ba92b9ba46babe4ebd6c02e5fbd9" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
I20260709 13:06:16.305238 19409 raft_consensus.cc:3060] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P e5256d91808b47c195bc9b4dbd7f2b87 [term 12 FOLLOWER]: Advancing to term 14
W20260709 13:06:16.308337 19452 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:16.300856 19406 rpcz_store.cc:276] 0709 13:06:13.865120 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:13.865231 (+   111us) service_pool.cc:224] Handling call
0709 13:06:13.865530 (+   299us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:13.914130 (+ 48600us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:06:14.479587 (+565457us) log.cc:844] Serialized 14 byte log entry
0709 13:06:15.589958 (+1110371us) spinlock_profiling.cc:243] Waited 2.84 ms on lock 0x7b4400022b4c. stack: 00007f4a79de9343 00007f4a79de9240 00007f4a797781d4 00007f4a834b6304 00007f4a834b6299 00007f4a79ca3db1 00007f4a79d41c85 00007f4a79d426a2 00007f4a7cab41db 00007f4a7caafaaf 00007f4a7caa386e 00007f4a7caa2bb6 00007f4a7caa27d8 00007f4a7caac221 00007f4a7caac1d9 00007f4a7caac169
0709 13:06:15.751264 (+161306us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:15.751719 (+   455us) log.cc:844] Serialized 26 byte log entry
0709 13:06:15.751886 (+   167us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:06:15.977286 (+225400us) log.cc:844] Serialized 14 byte log entry
0709 13:06:16.299363 (+322077us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:16.299563 (+   200us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:16.299793 (+   230us) raft_consensus.cc:1685] finished
0709 13:06:16.299823 (+    30us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:16.300076 (+   253us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1057177,"prepare.queue_time_us":722405,"prepare.run_cpu_time_us":65,"prepare.run_wall_time_us":67,"raft.queue_time_us":1080600,"raft.run_cpu_time_us":379,"raft.run_wall_time_us":19699,"spinlock_wait_cycles":6530304,"thread_start_us":1354399,"threads_started":4,"wal-append.queue_time_us":408258}
I20260709 13:06:16.312111 19481 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58286 (request call id 2120) took 1015 ms. Trace:
I20260709 13:06:16.312253 19483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f93ee515a9c14139bf566522ed8232f3" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 16 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:06:16.312494 19406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36f6ba92b9ba46babe4ebd6c02e5fbd9" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:06:16.314056 19406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dc5b3532fe54f74876d02beffa2c230" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:06:16.314165 19483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc225c93219c45538b53a1bd3d387e4d" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:06:16.312659 19481 rpcz_store.cc:276] 0709 13:06:15.296383 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:15.332527 (+ 36144us) service_pool.cc:224] Handling call
0709 13:06:15.332813 (+   286us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:15.398435 (+ 65622us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:06:15.769139 (+370704us) spinlock_profiling.cc:243] Waited 1.64 ms on lock 0x7b180001fcc0. stack: 00007f4a79de9343 00007f4a79de9240 00007f4a797781d4 00007f4a834b6304 00007f4a834b6299 00007f4a82ce3de1 00007f4a82cf05b1 00007f4a79dfde07 00007f4a82c58ab9 00007f4a79e1a69b 00007f4a79e1893f 00007f4a79e18455 00007f4a809003c7 00007f4a7cf129a7 00007f4a7cf220bf 00007f4a7cf22038
0709 13:06:15.932864 (+163725us) log.cc:844] Serialized 14 byte log entry
0709 13:06:16.061103 (+128239us) log.cc:844] Serialized 14 byte log entry
0709 13:06:16.061535 (+   432us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:16.064173 (+  2638us) log.cc:844] Serialized 26 byte log entry
0709 13:06:16.064312 (+   139us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:06:16.075187 (+ 10875us) log.cc:844] Serialized 14 byte log entry
0709 13:06:16.077977 (+  2790us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:16.082236 (+  4259us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:16.311549 (+229313us) raft_consensus.cc:1685] finished
0709 13:06:16.311584 (+    35us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:16.311894 (+   310us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":65143,"prepare.queue_time_us":315064,"prepare.run_cpu_time_us":142,"prepare.run_wall_time_us":8816,"raft.queue_time_us":71894,"raft.run_cpu_time_us":277,"raft.run_wall_time_us":10378,"spinlock_wait_cycles":17687296,"thread_start_us":290457,"threads_started":2,"wal-append.queue_time_us":240125}
I20260709 13:06:16.315886 19483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4509b76741dc428e9201c70c1658da13" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:06:16.317065 19483 raft_consensus.cc:2468] T 4509b76741dc428e9201c70c1658da13 P 0473d2b2d01f4459b1e90fd12cc7840e [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 7.
I20260709 13:06:16.310943 19477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa8650e71aa14778b3d73721fc50d9fc" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:06:16.310945 19479 raft_consensus.cc:1240] T f1b10566f45d4a7d9029858330e02d5b P 0473d2b2d01f4459b1e90fd12cc7840e [term 14 FOLLOWER]: Rejecting Update request from peer e5256d91808b47c195bc9b4dbd7f2b87 for earlier term 13. Current term is 14. Ops: []
I20260709 13:06:16.304524 19407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "833a2f0775ed407a94b8924ce50adb63" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:06:16.319957 19407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "179fd671030940b4b4a4e24bcc4aba0a" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:06:16.321017 19485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f575b143b844aa096b50997dad3516a" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:06:16.321900 19406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2725d2c4cb054f18b0fc8f735c15f6c2" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:06:16.322297 19485 raft_consensus.cc:2468] T 7f575b143b844aa096b50997dad3516a P 0473d2b2d01f4459b1e90fd12cc7840e [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 9.
I20260709 13:06:16.323879 19486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b74109013a140ada21feeef92d6f563" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:06:16.324999 19486 raft_consensus.cc:2393] T 2b74109013a140ada21feeef92d6f563 P 0473d2b2d01f4459b1e90fd12cc7840e [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e5256d91808b47c195bc9b4dbd7f2b87 in current term 10: Already voted for candidate 0473d2b2d01f4459b1e90fd12cc7840e in this term.
I20260709 13:06:16.320979 19407 raft_consensus.cc:2468] T 179fd671030940b4b4a4e24bcc4aba0a P e5256d91808b47c195bc9b4dbd7f2b87 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 13.
I20260709 13:06:16.327628 19406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b74109013a140ada21feeef92d6f563" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
I20260709 13:06:16.336514 19560 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40438 (request call id 2427) took 1195 ms. Trace:
I20260709 13:06:16.218739 23538 leader_election.cc:290] T 217b5fae677b4971b3bbd2f357a1f7ff P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:06:16.343250 19554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1b10566f45d4a7d9029858330e02d5b" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:06:16.344165 19554 raft_consensus.cc:3060] T f1b10566f45d4a7d9029858330e02d5b P e61c3a8f61bb48f8a963c9480e53c168 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:06:16.345016 19402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e381f1d6b8184797ad142de49be225a8" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:06:16.217986 23605 consensus_queue.cc:260] T edd7d470b5014c9489be7f41f64355c9 P e5256d91808b47c195bc9b4dbd7f2b87 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.6, Last appended by leader: 6, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:16.346660 19402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "775c229504194560ba9589bc2199b089" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
W20260709 13:06:16.348147 19526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.2:46257, user_credentials={real_user=slave}} blocked reactor thread for 174690us
I20260709 13:06:16.343271 19551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a08760e15aac4630a629431f56024dc8" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:06:16.348779 24036 raft_consensus.cc:2804] T 2e36a9d6e29c4a7c860cf267efbd4c74 P e61c3a8f61bb48f8a963c9480e53c168 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:06:16.366711 19402 raft_consensus.cc:2376] T 775c229504194560ba9589bc2199b089 P e5256d91808b47c195bc9b4dbd7f2b87 [term 10 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 10. Re-sending same reply.
I20260709 13:06:16.347381 19559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b74109013a140ada21feeef92d6f563" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:06:16.368227 19551 raft_consensus.cc:3060] T a08760e15aac4630a629431f56024dc8 P e61c3a8f61bb48f8a963c9480e53c168 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:06:16.370795 23987 raft_consensus.cc:493] T b9f0d59553ad444883fcf5b5909f9798 P e5256d91808b47c195bc9b4dbd7f2b87 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 0473d2b2d01f4459b1e90fd12cc7840e)
I20260709 13:06:16.372005 19402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ece3db938bc649d4a40a51522ed5259c" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:06:16.371834 23987 raft_consensus.cc:515] T b9f0d59553ad444883fcf5b5909f9798 P e5256d91808b47c195bc9b4dbd7f2b87 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:16.373531 19402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "775c229504194560ba9589bc2199b089" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
I20260709 13:06:16.374189 19402 raft_consensus.cc:3060] T 775c229504194560ba9589bc2199b089 P e5256d91808b47c195bc9b4dbd7f2b87 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:06:16.374924 19407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21e14947d70440f19044d8f75c31e1f9" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
I20260709 13:06:16.375777 19407 raft_consensus.cc:3060] T 21e14947d70440f19044d8f75c31e1f9 P e5256d91808b47c195bc9b4dbd7f2b87 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:06:16.374941 19375 leader_election.cc:304] T df751f992649444090e27965eb1af85d P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:06:16.378875 23883 raft_consensus.cc:2749] T 3e1f505cb0f1427bbd698ac889d80821 P e5256d91808b47c195bc9b4dbd7f2b87 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:06:16.379619 19375 leader_election.cc:304] T b08304a0a02b42d7840c4e8ee9a6bd1a P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:06:16.379850 23883 raft_consensus.cc:2749] T df751f992649444090e27965eb1af85d P e5256d91808b47c195bc9b4dbd7f2b87 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:06:16.380100 19406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e381f1d6b8184797ad142de49be225a8" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
I20260709 13:06:16.381390 19406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21e14947d70440f19044d8f75c31e1f9" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:06:16.382177 19479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "775c229504194560ba9589bc2199b089" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:06:16.347944 23919 leader_election.cc:290] T 46c5bfeecc314717bffe987e6844b6d0 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 18 election: Requested vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:06:16.382933 19479 raft_consensus.cc:3060] T 775c229504194560ba9589bc2199b089 P 0473d2b2d01f4459b1e90fd12cc7840e [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:06:16.382637 19406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1b10566f45d4a7d9029858330e02d5b" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
I20260709 13:06:16.387398 19377 leader_election.cc:304] T 4509b76741dc428e9201c70c1658da13 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87; no voters: 
I20260709 13:06:16.389740 19377 leader_election.cc:304] T 7f575b143b844aa096b50997dad3516a P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87; no voters: 
I20260709 13:06:16.390763 24048 leader_election.cc:290] T 14efcc79969f41babe5529c22d59156d P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 13 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:06:16.391294 19486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46c5bfeecc314717bffe987e6844b6d0" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 18 candidate_status { last_received { term: 16 index: 7 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:06:16.392238 19486 raft_consensus.cc:3060] T 46c5bfeecc314717bffe987e6844b6d0 P 0473d2b2d01f4459b1e90fd12cc7840e [term 17 FOLLOWER]: Advancing to term 18
W20260709 13:06:16.401157 19376 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:16.407058 24036 raft_consensus.cc:697] T 2e36a9d6e29c4a7c860cf267efbd4c74 P e61c3a8f61bb48f8a963c9480e53c168 [term 10 LEADER]: Becoming Leader. State: Replica: e61c3a8f61bb48f8a963c9480e53c168, State: Running, Role: LEADER
I20260709 13:06:16.409224 19556 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40438 (request call id 2437) took 1253 ms. Trace:
I20260709 13:06:16.408772 24036 consensus_queue.cc:237] T 2e36a9d6e29c4a7c860cf267efbd4c74 P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:16.409660 19556 rpcz_store.cc:276] 0709 13:06:15.156076 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:15.156197 (+   121us) service_pool.cc:224] Handling call
0709 13:06:16.408762 (+1252565us) spinlock_profiling.cc:243] Waited 829 ms on lock 0x7b540002f8d4. stack: 00007f4a79de9343 00007f4a79de9240 00007f4a797781d4 00007f4a834b6304 00007f4a834b6299 00007f4a7ce71571 00007f4a7cf0c2fa 00007f4a81ecdb17 00007f4a7b4486d4 00007f4a7b448662 00007f4a7b448591 00007f4a7b44850c 00007f4a7b4477c2 00007f4a7b24348c 00007f4a7b2428c6 00007f4a7b24226f
0709 13:06:16.409026 (+   264us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1906969984}
I20260709 13:06:16.337162 19560 rpcz_store.cc:276] 0709 13:06:15.141124 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:15.143579 (+  2455us) service_pool.cc:224] Handling call
0709 13:06:15.143875 (+   296us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:15.164642 (+ 20767us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:06:15.203268 (+ 38626us) log.cc:844] Serialized 14 byte log entry
0709 13:06:15.572912 (+369644us) spinlock_profiling.cc:243] Waited 17.9 ms on lock 0x7b18003a6f60. stack: 00007f4a79de9343 00007f4a79de9240 00007f4a797781d4 00007f4a834b6304 00007f4a834b6299 00007f4a82ce3de1 00007f4a82cf05b1 00007f4a79dfde07 00007f4a82c58ab9 00007f4a79e1a69b 00007f4a79e1893f 00007f4a79e1ac02 00007f4a7caa220b 00007f4a7caa7d23 00007f4a7caa823a 00007f4a7cf12a2a
0709 13:06:15.708864 (+135952us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:15.719118 (+ 10254us) log.cc:844] Serialized 26 byte log entry
0709 13:06:15.719291 (+   173us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:06:15.719336 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:15.719420 (+    84us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:16.335750 (+616330us) raft_consensus.cc:1685] finished
0709 13:06:16.335928 (+   178us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:16.336241 (+   313us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":56407,"prepare.queue_time_us":51584,"prepare.run_cpu_time_us":35,"prepare.run_wall_time_us":36,"raft.queue_time_us":34757,"raft.run_cpu_time_us":281,"raft.run_wall_time_us":44643,"spinlock_wait_cycles":41171200,"thread_start_us":130742,"threads_started":1,"wal-append.queue_time_us":600449}
W20260709 13:06:16.426358 19523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.1:40321, user_credentials={real_user=slave}} blocked reactor thread for 351911us
I20260709 13:06:16.424237 23919 consensus_queue.cc:1059] T f1b10566f45d4a7d9029858330e02d5b P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:06:16.454712 19404 raft_consensus.cc:2468] T ef32ce6fdd0e40d382c79974f30295c6 P e5256d91808b47c195bc9b4dbd7f2b87 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 15.
I20260709 13:06:16.457783 19554 raft_consensus.cc:2468] T f1b10566f45d4a7d9029858330e02d5b P e61c3a8f61bb48f8a963c9480e53c168 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 14.
I20260709 13:06:16.447952 19526 leader_election.cc:304] T 7be9efa6559648dbb5a0f7684c4542d1 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: e61c3a8f61bb48f8a963c9480e53c168; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, 127766fc592545a4997f7790f50f6076
I20260709 13:06:16.461269 19479 raft_consensus.cc:2468] T 775c229504194560ba9589bc2199b089 P 0473d2b2d01f4459b1e90fd12cc7840e [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 127766fc592545a4997f7790f50f6076 in term 11.
I20260709 13:06:16.447952 23854 raft_consensus.cc:2804] T 7f575b143b844aa096b50997dad3516a P e5256d91808b47c195bc9b4dbd7f2b87 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:06:16.465890 23854 raft_consensus.cc:493] T 7f575b143b844aa096b50997dad3516a P e5256d91808b47c195bc9b4dbd7f2b87 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:16.466362 23854 raft_consensus.cc:3060] T 7f575b143b844aa096b50997dad3516a P e5256d91808b47c195bc9b4dbd7f2b87 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:06:16.467916 19557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2725d2c4cb054f18b0fc8f735c15f6c2" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:06:16.468964 19557 raft_consensus.cc:2393] T 2725d2c4cb054f18b0fc8f735c15f6c2 P e61c3a8f61bb48f8a963c9480e53c168 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0473d2b2d01f4459b1e90fd12cc7840e in current term 15: Already voted for candidate e61c3a8f61bb48f8a963c9480e53c168 in this term.
I20260709 13:06:16.469622 24029 raft_consensus.cc:2764] T ef32ce6fdd0e40d382c79974f30295c6 P e5256d91808b47c195bc9b4dbd7f2b87 [term 15 FOLLOWER]: Leader pre-election decision vote started in defunct term 14: won
I20260709 13:06:16.476065 19406 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "76cb037fc9064d13b59a8969d897ce8c"
dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
mode: GRACEFUL
new_leader_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
 from {username='slave'} at 127.0.0.1:37312
I20260709 13:06:16.476941 19406 raft_consensus.cc:606] T 76cb037fc9064d13b59a8969d897ce8c P e5256d91808b47c195bc9b4dbd7f2b87 [term 11 LEADER]: Received request to transfer leadership to TS e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:06:16.478596 19407 raft_consensus.cc:2468] T 21e14947d70440f19044d8f75c31e1f9 P e5256d91808b47c195bc9b4dbd7f2b87 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 13.
I20260709 13:06:16.481154 23987 leader_election.cc:290] T b9f0d59553ad444883fcf5b5909f9798 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:06:16.480994 23854 raft_consensus.cc:515] T 7f575b143b844aa096b50997dad3516a P e5256d91808b47c195bc9b4dbd7f2b87 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:16.483932 23854 leader_election.cc:290] T 7f575b143b844aa096b50997dad3516a P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 10 election: Requested vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:06:16.488794 19554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e381f1d6b8184797ad142de49be225a8" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:06:16.489609 19554 raft_consensus.cc:3060] T e381f1d6b8184797ad142de49be225a8 P e61c3a8f61bb48f8a963c9480e53c168 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:06:16.490623 23928 raft_consensus.cc:3055] T 0e1085d23e8347fbbd5bce7542f4b1f4 P 0473d2b2d01f4459b1e90fd12cc7840e [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:06:16.491074 23928 raft_consensus.cc:740] T 0e1085d23e8347fbbd5bce7542f4b1f4 P 0473d2b2d01f4459b1e90fd12cc7840e [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 0473d2b2d01f4459b1e90fd12cc7840e, State: Running, Role: LEADER
I20260709 13:06:16.492316 23928 consensus_queue.cc:260] T 0e1085d23e8347fbbd5bce7542f4b1f4 P 0473d2b2d01f4459b1e90fd12cc7840e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:16.493742 23928 raft_consensus.cc:3060] T 0e1085d23e8347fbbd5bce7542f4b1f4 P 0473d2b2d01f4459b1e90fd12cc7840e [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:06:16.457204 23883 raft_consensus.cc:2749] T b08304a0a02b42d7840c4e8ee9a6bd1a P e5256d91808b47c195bc9b4dbd7f2b87 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:06:16.502980 19559 raft_consensus.cc:3060] T 2b74109013a140ada21feeef92d6f563 P e61c3a8f61bb48f8a963c9480e53c168 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:06:16.503309 19551 raft_consensus.cc:2468] T a08760e15aac4630a629431f56024dc8 P e61c3a8f61bb48f8a963c9480e53c168 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 15.
I20260709 13:06:16.511951 23714 raft_consensus.cc:3060] T 6c5eebf646ad445a9d1b1adc319d7b16 P 0473d2b2d01f4459b1e90fd12cc7840e [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:06:16.514945 23538 raft_consensus.cc:493] T 1a61655d99124a29b486ba4a5b37faea P 0473d2b2d01f4459b1e90fd12cc7840e [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:16.515770 23538 raft_consensus.cc:515] T 1a61655d99124a29b486ba4a5b37faea P 0473d2b2d01f4459b1e90fd12cc7840e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:16.520010 19554 raft_consensus.cc:2468] T e381f1d6b8184797ad142de49be225a8 P e61c3a8f61bb48f8a963c9480e53c168 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 10.
W20260709 13:06:16.522354 19526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.2:46257, user_credentials={real_user=slave}} blocked reactor thread for 75851.7us
I20260709 13:06:16.522277 19407 raft_consensus.cc:1275] T 85c494af21f9457a85da47b9bc70c1fd P e5256d91808b47c195bc9b4dbd7f2b87 [term 10 FOLLOWER]: Refusing update from remote peer 127766fc592545a4997f7790f50f6076: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 13:06:16.518554 23538 leader_election.cc:290] T 1a61655d99124a29b486ba4a5b37faea P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:06:16.526000 24108 raft_consensus.cc:2804] T 4509b76741dc428e9201c70c1658da13 P e5256d91808b47c195bc9b4dbd7f2b87 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:06:16.546550 19560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "179fd671030940b4b4a4e24bcc4aba0a" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:06:16.526190 24084 raft_consensus.cc:2749] T 7be9efa6559648dbb5a0f7684c4542d1 P e61c3a8f61bb48f8a963c9480e53c168 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:06:16.547319 19449 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.1:40321, user_credentials={real_user=slave}} blocked reactor thread for 149787us
I20260709 13:06:16.538029 24108 raft_consensus.cc:493] T 4509b76741dc428e9201c70c1658da13 P e5256d91808b47c195bc9b4dbd7f2b87 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:16.552686 19551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21e14947d70440f19044d8f75c31e1f9" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:06:16.556447 23878 raft_consensus.cc:3055] T f1b10566f45d4a7d9029858330e02d5b P e5256d91808b47c195bc9b4dbd7f2b87 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:06:16.556933 23878 raft_consensus.cc:740] T f1b10566f45d4a7d9029858330e02d5b P e5256d91808b47c195bc9b4dbd7f2b87 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: e5256d91808b47c195bc9b4dbd7f2b87, State: Running, Role: LEADER
I20260709 13:06:16.558118 23878 consensus_queue.cc:260] T f1b10566f45d4a7d9029858330e02d5b P e5256d91808b47c195bc9b4dbd7f2b87 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.9, Last appended by leader: 9, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:16.559602 23878 raft_consensus.cc:3060] T f1b10566f45d4a7d9029858330e02d5b P e5256d91808b47c195bc9b4dbd7f2b87 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:06:16.560330 19403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14efcc79969f41babe5529c22d59156d" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
I20260709 13:06:16.562455 19406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff9b0eddd810459b82d91c60777c10eb" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
I20260709 13:06:16.566774 18300 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:06:16.578819 19402 raft_consensus.cc:2468] T 775c229504194560ba9589bc2199b089 P e5256d91808b47c195bc9b4dbd7f2b87 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 127766fc592545a4997f7790f50f6076 in term 11.
I20260709 13:06:16.553766 24108 raft_consensus.cc:3060] T 4509b76741dc428e9201c70c1658da13 P e5256d91808b47c195bc9b4dbd7f2b87 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:06:16.554397 19526 leader_election.cc:304] T 22196caba61445d3bec98a0aab3c337d P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:06:16.585585 23761 leader_election.cc:290] T ff9b0eddd810459b82d91c60777c10eb P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 13 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:06:16.591799 19554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "217b5fae677b4971b3bbd2f357a1f7ff" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:06:16.596489 19481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f575b143b844aa096b50997dad3516a" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:06:16.597064 19481 raft_consensus.cc:3060] T 7f575b143b844aa096b50997dad3516a P 0473d2b2d01f4459b1e90fd12cc7840e [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:06:16.602959 23605 raft_consensus.cc:3060] T edd7d470b5014c9489be7f41f64355c9 P e5256d91808b47c195bc9b4dbd7f2b87 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:06:16.552217 23883 consensus_queue.cc:1059] T a08760e15aac4630a629431f56024dc8 P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 }, Status: INVALID_TERM, Last received: 14.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.051s
I20260709 13:06:16.621493 24084 raft_consensus.cc:2804] T 22196caba61445d3bec98a0aab3c337d P e61c3a8f61bb48f8a963c9480e53c168 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:06:16.622253 24084 raft_consensus.cc:697] T 22196caba61445d3bec98a0aab3c337d P e61c3a8f61bb48f8a963c9480e53c168 [term 10 LEADER]: Becoming Leader. State: Replica: e61c3a8f61bb48f8a963c9480e53c168, State: Running, Role: LEADER
W20260709 13:06:16.618808 19526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.2:46257, user_credentials={real_user=slave}} blocked reactor thread for 82515.3us
I20260709 13:06:16.629628 19402 raft_consensus.cc:1275] T 0cdf56e38bbc453d9438d359e5a69955 P e5256d91808b47c195bc9b4dbd7f2b87 [term 14 FOLLOWER]: Refusing update from remote peer 0473d2b2d01f4459b1e90fd12cc7840e: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 13:06:16.629931 19554 raft_consensus.cc:2468] T 217b5fae677b4971b3bbd2f357a1f7ff P e61c3a8f61bb48f8a963c9480e53c168 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 9.
I20260709 13:06:16.633600 24061 raft_consensus.cc:2749] T 0afb57ae58a24a01850491d69f0213dd P 127766fc592545a4997f7790f50f6076 [term 12 FOLLOWER]: Leader pre-election lost for term 11. Reason: Vote denied by peer 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257) with higher term. Message: Invalid argument: T 0afb57ae58a24a01850491d69f0213dd P 0473d2b2d01f4459b1e90fd12cc7840e [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 127766fc592545a4997f7790f50f6076 for earlier term 11. Current term is 12.
I20260709 13:06:16.637414 19478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9f0d59553ad444883fcf5b5909f9798" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:06:16.648540 19479 raft_consensus.cc:1240] T e381f1d6b8184797ad142de49be225a8 P 0473d2b2d01f4459b1e90fd12cc7840e [term 10 FOLLOWER]: Rejecting Update request from peer e5256d91808b47c195bc9b4dbd7f2b87 for earlier term 9. Current term is 10. Ops: []
I20260709 13:06:16.652088 19409 raft_consensus.cc:2468] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P e5256d91808b47c195bc9b4dbd7f2b87 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 127766fc592545a4997f7790f50f6076 in term 14.
W20260709 13:06:16.671309 24111 log.cc:927] Time spent T 1dc5b3532fe54f74876d02beffa2c230 P 0473d2b2d01f4459b1e90fd12cc7840e: Append to log took a long time: real 0.080s	user 0.001s	sys 0.000s
I20260709 13:06:16.672418 23883 consensus_queue.cc:1059] T e381f1d6b8184797ad142de49be225a8 P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 }, Status: INVALID_TERM, Last received: 9.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:06:16.674059 23883 raft_consensus.cc:3055] T e381f1d6b8184797ad142de49be225a8 P e5256d91808b47c195bc9b4dbd7f2b87 [term 9 LEADER]: Stepping down as leader of term 9
W20260709 13:06:16.677284 19523 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:16.679999 19450 leader_election.cc:304] T f1b10566f45d4a7d9029858330e02d5b P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:06:16.681391 23740 raft_consensus.cc:2804] T f1b10566f45d4a7d9029858330e02d5b P 0473d2b2d01f4459b1e90fd12cc7840e [term 14 FOLLOWER]: Leader election won for term 14
W20260709 13:06:16.682062 20078 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.2:46257, user_credentials={real_user=slave}} blocked reactor thread for 51700us
I20260709 13:06:16.683866 19552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a61655d99124a29b486ba4a5b37faea" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:06:16.674572 23883 raft_consensus.cc:740] T e381f1d6b8184797ad142de49be225a8 P e5256d91808b47c195bc9b4dbd7f2b87 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: e5256d91808b47c195bc9b4dbd7f2b87, State: Running, Role: LEADER
I20260709 13:06:16.681828 19450 leader_election.cc:304] T a08760e15aac4630a629431f56024dc8 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:06:16.633991 23874 raft_consensus.cc:515] T d1e5873a19244c5ebbcd38e126796ee7 P e61c3a8f61bb48f8a963c9480e53c168 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:16.694933 24084 consensus_queue.cc:237] T 22196caba61445d3bec98a0aab3c337d P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
W20260709 13:06:16.709280 19526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.2:46257, user_credentials={real_user=slave}} blocked reactor thread for 60877.5us
I20260709 13:06:16.714699 19486 raft_consensus.cc:2468] T 46c5bfeecc314717bffe987e6844b6d0 P 0473d2b2d01f4459b1e90fd12cc7840e [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 18.
I20260709 13:06:16.715234 19559 raft_consensus.cc:2468] T 2b74109013a140ada21feeef92d6f563 P e61c3a8f61bb48f8a963c9480e53c168 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 10.
I20260709 13:06:16.729177 19554 raft_consensus.cc:1240] T 6c5eebf646ad445a9d1b1adc319d7b16 P e61c3a8f61bb48f8a963c9480e53c168 [term 11 FOLLOWER]: Rejecting Update request from peer 0473d2b2d01f4459b1e90fd12cc7840e for earlier term 10. Current term is 11. Ops: []
W20260709 13:06:16.730852 24089 consensus_meta.cc:287] T 48824d5acfbc485ebf8c2d944e7202de P e61c3a8f61bb48f8a963c9480e53c168: Time spent flushing consensus metadata: real 0.575s	user 0.005s	sys 0.013s
I20260709 13:06:16.733633 19450 leader_election.cc:304] T e381f1d6b8184797ad142de49be225a8 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:06:16.708190 23740 raft_consensus.cc:697] T f1b10566f45d4a7d9029858330e02d5b P 0473d2b2d01f4459b1e90fd12cc7840e [term 14 LEADER]: Becoming Leader. State: Replica: 0473d2b2d01f4459b1e90fd12cc7840e, State: Running, Role: LEADER
I20260709 13:06:16.738967 24046 raft_consensus.cc:2804] T a08760e15aac4630a629431f56024dc8 P 0473d2b2d01f4459b1e90fd12cc7840e [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:06:16.739692 24046 raft_consensus.cc:697] T a08760e15aac4630a629431f56024dc8 P 0473d2b2d01f4459b1e90fd12cc7840e [term 15 LEADER]: Becoming Leader. State: Replica: 0473d2b2d01f4459b1e90fd12cc7840e, State: Running, Role: LEADER
I20260709 13:06:16.740797 24046 consensus_queue.cc:237] T a08760e15aac4630a629431f56024dc8 P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 14.8, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:16.743259 20110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62c6c134d3d24a1ab144dd9ee6bc3f64" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076"
I20260709 13:06:16.744154 20110 raft_consensus.cc:2393] T 62c6c134d3d24a1ab144dd9ee6bc3f64 P 127766fc592545a4997f7790f50f6076 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate e61c3a8f61bb48f8a963c9480e53c168 in current term 12: Already voted for candidate 0473d2b2d01f4459b1e90fd12cc7840e in this term.
W20260709 13:06:16.744432 24110 log.cc:927] Time spent T 2725d2c4cb054f18b0fc8f735c15f6c2 P 0473d2b2d01f4459b1e90fd12cc7840e: Append to log took a long time: real 0.132s	user 0.000s	sys 0.001s
I20260709 13:06:16.745424 20105 raft_consensus.cc:2468] T 0afb57ae58a24a01850491d69f0213dd P 127766fc592545a4997f7790f50f6076 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 12.
I20260709 13:06:16.746887 24001 raft_consensus.cc:493] T 85c494af21f9457a85da47b9bc70c1fd P e61c3a8f61bb48f8a963c9480e53c168 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:16.747447 24001 raft_consensus.cc:515] T 85c494af21f9457a85da47b9bc70c1fd P e61c3a8f61bb48f8a963c9480e53c168 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:16.749686 24001 leader_election.cc:290] T 85c494af21f9457a85da47b9bc70c1fd P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
W20260709 13:06:16.752367 19377 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:16.727454 20078 leader_election.cc:304] T 0e1085d23e8347fbbd5bce7542f4b1f4 P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 127766fc592545a4997f7790f50f6076; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:06:16.738651 23740 consensus_queue.cc:237] T f1b10566f45d4a7d9029858330e02d5b P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:16.730594 23538 raft_consensus.cc:493] T 28af091831594f9d8e96482078cc7625 P 0473d2b2d01f4459b1e90fd12cc7840e [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:16.765888 23538 raft_consensus.cc:515] T 28af091831594f9d8e96482078cc7625 P 0473d2b2d01f4459b1e90fd12cc7840e [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:16.771090 20106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4af19371ea874c09a0a2147040835cbb" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:06:16.772730 19411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "217b5fae677b4971b3bbd2f357a1f7ff" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
W20260709 13:06:16.779081 19450 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.3:36891, user_credentials={real_user=slave}} blocked reactor thread for 60860.8us
I20260709 13:06:16.783449 24055 raft_consensus.cc:2804] T e381f1d6b8184797ad142de49be225a8 P 0473d2b2d01f4459b1e90fd12cc7840e [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:06:16.746218 23883 consensus_queue.cc:260] T e381f1d6b8184797ad142de49be225a8 P e5256d91808b47c195bc9b4dbd7f2b87 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:16.788916 19405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9962423cb4e54fcfa5de01daf68a86e7" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:06:16.750438 24108 raft_consensus.cc:515] T 4509b76741dc428e9201c70c1658da13 P e5256d91808b47c195bc9b4dbd7f2b87 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:16.731429 24089 raft_consensus.cc:515] T 48824d5acfbc485ebf8c2d944e7202de P e61c3a8f61bb48f8a963c9480e53c168 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:16.794616 19449 leader_election.cc:304] T 3e1f505cb0f1427bbd698ac889d80821 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e; no voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:06:16.799762 19526 leader_election.cc:304] T 4509b76741dc428e9201c70c1658da13 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:06:16.806703 23933 raft_consensus.cc:493] T ab43d85f64114d4ebf618930e43d9ed0 P 0473d2b2d01f4459b1e90fd12cc7840e [term 13 FOLLOWER]: Starting pre-election (detected failure of leader e61c3a8f61bb48f8a963c9480e53c168)
I20260709 13:06:16.807139 24024 raft_consensus.cc:493] T df751f992649444090e27965eb1af85d P 0473d2b2d01f4459b1e90fd12cc7840e [term 14 FOLLOWER]: Starting pre-election (detected failure of leader e61c3a8f61bb48f8a963c9480e53c168)
I20260709 13:06:16.807473 23933 raft_consensus.cc:515] T ab43d85f64114d4ebf618930e43d9ed0 P 0473d2b2d01f4459b1e90fd12cc7840e [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } attrs { replace: true } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:16.808089 24024 raft_consensus.cc:515] T df751f992649444090e27965eb1af85d P 0473d2b2d01f4459b1e90fd12cc7840e [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
W20260709 13:06:16.813349 20078 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.2:46257, user_credentials={real_user=slave}} blocked reactor thread for 90571.7us
I20260709 13:06:16.799240 24055 raft_consensus.cc:697] T e381f1d6b8184797ad142de49be225a8 P 0473d2b2d01f4459b1e90fd12cc7840e [term 10 LEADER]: Becoming Leader. State: Replica: 0473d2b2d01f4459b1e90fd12cc7840e, State: Running, Role: LEADER
I20260709 13:06:16.818657 23933 leader_election.cc:290] T ab43d85f64114d4ebf618930e43d9ed0 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
W20260709 13:06:16.824263 24075 consensus_meta.cc:287] T 21e14947d70440f19044d8f75c31e1f9 P e61c3a8f61bb48f8a963c9480e53c168: Time spent flushing consensus metadata: real 0.533s	user 0.011s	sys 0.000s
I20260709 13:06:16.803875 24108 leader_election.cc:290] T 4509b76741dc428e9201c70c1658da13 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 8 election: Requested vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:06:16.875305 24031 raft_consensus.cc:493] T 1a61655d99124a29b486ba4a5b37faea P e5256d91808b47c195bc9b4dbd7f2b87 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:16.876015 24031 raft_consensus.cc:515] T 1a61655d99124a29b486ba4a5b37faea P e5256d91808b47c195bc9b4dbd7f2b87 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
W20260709 13:06:16.827702 23755 consensus_meta.cc:287] T 1dc5b3532fe54f74876d02beffa2c230 P e61c3a8f61bb48f8a963c9480e53c168: Time spent flushing consensus metadata: real 0.615s	user 0.012s	sys 0.000s
I20260709 13:06:16.830706 20078 leader_election.cc:304] T 96efeaaf1057492490e9a621f37e1a2d P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 127766fc592545a4997f7790f50f6076; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168
W20260709 13:06:16.831213 19449 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.1:40321, user_credentials={real_user=slave}} blocked reactor thread for 46624.3us
I20260709 13:06:16.831589 23714 raft_consensus.cc:2749] T 3e1f505cb0f1427bbd698ac889d80821 P 0473d2b2d01f4459b1e90fd12cc7840e [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:06:16.832973 19450 leader_election.cc:304] T 217b5fae677b4971b3bbd2f357a1f7ff P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:06:16.838848 24024 leader_election.cc:290] T df751f992649444090e27965eb1af85d P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:06:16.839306 20075 leader_election.cc:304] T 775c229504194560ba9589bc2199b089 P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 127766fc592545a4997f7790f50f6076, e5256d91808b47c195bc9b4dbd7f2b87; no voters: 
I20260709 13:06:16.849190 18300 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:06:16.863744 24089 leader_election.cc:290] T 48824d5acfbc485ebf8c2d944e7202de P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 14 election: Requested vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
W20260709 13:06:16.864995 23880 consensus_meta.cc:287] T 65d8cb8d6ec64f459d5a47cefab10acf P e5256d91808b47c195bc9b4dbd7f2b87: Time spent flushing consensus metadata: real 0.746s	user 0.009s	sys 0.009s
I20260709 13:06:16.865739 23883 raft_consensus.cc:3060] T e381f1d6b8184797ad142de49be225a8 P e5256d91808b47c195bc9b4dbd7f2b87 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:06:16.867584 19404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef32ce6fdd0e40d382c79974f30295c6" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:06:16.873339 19407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f575b143b844aa096b50997dad3516a" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
I20260709 13:06:16.878521 23974 raft_consensus.cc:493] T edd7d470b5014c9489be7f41f64355c9 P e61c3a8f61bb48f8a963c9480e53c168 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader e5256d91808b47c195bc9b4dbd7f2b87)
I20260709 13:06:16.880716 19409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21e14947d70440f19044d8f75c31e1f9" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:06:16.895893 19409 raft_consensus.cc:2393] T 21e14947d70440f19044d8f75c31e1f9 P e5256d91808b47c195bc9b4dbd7f2b87 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e61c3a8f61bb48f8a963c9480e53c168 in current term 13: Already voted for candidate 0473d2b2d01f4459b1e90fd12cc7840e in this term.
I20260709 13:06:16.886840 19408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a16f7501e2444fb86d4e2778e734e02" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
W20260709 13:06:16.892221 19450 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.3:36891, user_credentials={real_user=slave}} blocked reactor thread for 59391.6us
I20260709 13:06:16.893669 19407 raft_consensus.cc:2368] T 7f575b143b844aa096b50997dad3516a P e5256d91808b47c195bc9b4dbd7f2b87 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate e61c3a8f61bb48f8a963c9480e53c168 for earlier term 9. Current term is 10.
I20260709 13:06:16.891357 24036 raft_consensus.cc:2804] T 4509b76741dc428e9201c70c1658da13 P e61c3a8f61bb48f8a963c9480e53c168 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:06:16.894197 19405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22196caba61445d3bec98a0aab3c337d" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: true dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
I20260709 13:06:16.879290 24073 raft_consensus.cc:2749] T 0e1085d23e8347fbbd5bce7542f4b1f4 P 127766fc592545a4997f7790f50f6076 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:06:16.900285 19450 leader_election.cc:304] T 2b74109013a140ada21feeef92d6f563 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:06:16.900525 19405 raft_consensus.cc:3060] T 22196caba61445d3bec98a0aab3c337d P e5256d91808b47c195bc9b4dbd7f2b87 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:06:16.900884 19411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7be9efa6559648dbb5a0f7684c4542d1" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:06:16.902117 20105 raft_consensus.cc:1240] T 14efcc79969f41babe5529c22d59156d P 127766fc592545a4997f7790f50f6076 [term 13 FOLLOWER]: Rejecting Update request from peer e5256d91808b47c195bc9b4dbd7f2b87 for earlier term 12. Current term is 13. Ops: []
W20260709 13:06:16.903839 20075 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.1:40321, user_credentials={real_user=slave}} blocked reactor thread for 196046us
I20260709 13:06:16.906525 23805 raft_consensus.cc:2804] T 775c229504194560ba9589bc2199b089 P 127766fc592545a4997f7790f50f6076 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:06:16.907326 24024 raft_consensus.cc:2804] T 217b5fae677b4971b3bbd2f357a1f7ff P 0473d2b2d01f4459b1e90fd12cc7840e [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:06:16.907881 24024 raft_consensus.cc:493] T 217b5fae677b4971b3bbd2f357a1f7ff P 0473d2b2d01f4459b1e90fd12cc7840e [term 9 FOLLOWER]: Starting leader election (detected failure of leader e5256d91808b47c195bc9b4dbd7f2b87)
I20260709 13:06:16.908412 24024 raft_consensus.cc:3060] T 217b5fae677b4971b3bbd2f357a1f7ff P 0473d2b2d01f4459b1e90fd12cc7840e [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:06:16.910507 19406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e5873a19244c5ebbcd38e126796ee7" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:06:16.880511 23755 raft_consensus.cc:515] T 1dc5b3532fe54f74876d02beffa2c230 P e61c3a8f61bb48f8a963c9480e53c168 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:16.912746 23755 leader_election.cc:290] T 1dc5b3532fe54f74876d02beffa2c230 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 13 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:06:16.913403 23755 raft_consensus.cc:493] T 76cb037fc9064d13b59a8969d897ce8c P e61c3a8f61bb48f8a963c9480e53c168 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader e5256d91808b47c195bc9b4dbd7f2b87)
I20260709 13:06:16.913986 23755 raft_consensus.cc:515] T 76cb037fc9064d13b59a8969d897ce8c P e61c3a8f61bb48f8a963c9480e53c168 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
W20260709 13:06:16.915162 19452 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:16.915795 23714 raft_consensus.cc:493] T 96efeaaf1057492490e9a621f37e1a2d P 0473d2b2d01f4459b1e90fd12cc7840e [term 13 FOLLOWER]: Starting pre-election (detected failure of leader e61c3a8f61bb48f8a963c9480e53c168)
I20260709 13:06:16.916373 23714 raft_consensus.cc:515] T 96efeaaf1057492490e9a621f37e1a2d P 0473d2b2d01f4459b1e90fd12cc7840e [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:16.920156 23755 leader_election.cc:290] T 76cb037fc9064d13b59a8969d897ce8c P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:06:16.920286 24055 consensus_queue.cc:237] T e381f1d6b8184797ad142de49be225a8 P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:16.925848 23933 raft_consensus.cc:2804] T 2b74109013a140ada21feeef92d6f563 P 0473d2b2d01f4459b1e90fd12cc7840e [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:06:16.926496 23933 raft_consensus.cc:697] T 2b74109013a140ada21feeef92d6f563 P 0473d2b2d01f4459b1e90fd12cc7840e [term 10 LEADER]: Becoming Leader. State: Replica: 0473d2b2d01f4459b1e90fd12cc7840e, State: Running, Role: LEADER
I20260709 13:06:16.927603 23933 consensus_queue.cc:237] T 2b74109013a140ada21feeef92d6f563 P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:16.928022 19552 raft_consensus.cc:1275] T 0afb57ae58a24a01850491d69f0213dd P e61c3a8f61bb48f8a963c9480e53c168 [term 12 FOLLOWER]: Refusing update from remote peer 0473d2b2d01f4459b1e90fd12cc7840e: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:06:16.930742 23974 raft_consensus.cc:515] T edd7d470b5014c9489be7f41f64355c9 P e61c3a8f61bb48f8a963c9480e53c168 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:16.931797 19449 leader_election.cc:304] T edd7d470b5014c9489be7f41f64355c9 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e; no voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:06:16.932158 24024 raft_consensus.cc:515] T 217b5fae677b4971b3bbd2f357a1f7ff P 0473d2b2d01f4459b1e90fd12cc7840e [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:16.932996 23974 leader_election.cc:290] T edd7d470b5014c9489be7f41f64355c9 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:06:16.936586 24054 raft_consensus.cc:2749] T edd7d470b5014c9489be7f41f64355c9 P 0473d2b2d01f4459b1e90fd12cc7840e [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:06:16.938017 23880 consensus_queue.cc:1059] T 14efcc79969f41babe5529c22d59156d P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false }, Status: INVALID_TERM, Last received: 12.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
W20260709 13:06:16.938870 24114 log.cc:927] Time spent T 833a2f0775ed407a94b8924ce50adb63 P e5256d91808b47c195bc9b4dbd7f2b87: Append to log took a long time: real 0.271s	user 0.002s	sys 0.000s
I20260709 13:06:16.939620 23874 leader_election.cc:290] T d1e5873a19244c5ebbcd38e126796ee7 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 14 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:06:16.942751 19377 leader_election.cc:304] T 46c5bfeecc314717bffe987e6844b6d0 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87; no voters: 
I20260709 13:06:16.939678 23687 raft_consensus.cc:3055] T 14efcc79969f41babe5529c22d59156d P e5256d91808b47c195bc9b4dbd7f2b87 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:06:16.947012 19479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4509b76741dc428e9201c70c1658da13" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:06:16.938800 24024 leader_election.cc:290] T 217b5fae677b4971b3bbd2f357a1f7ff P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 10 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:06:16.950738 19479 raft_consensus.cc:3060] T 4509b76741dc428e9201c70c1658da13 P 0473d2b2d01f4459b1e90fd12cc7840e [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:06:16.890301 24031 leader_election.cc:290] T 1a61655d99124a29b486ba4a5b37faea P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:06:16.952244 19408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa731b585f684a7fb2d106c50f143b83" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:06:16.955224 19559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab43d85f64114d4ebf618930e43d9ed0" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 14 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:06:16.934418 19449 leader_election.cc:304] T 1f85fc4b527a48848e5faa083b604e36 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e; no voters: 127766fc592545a4997f7790f50f6076, e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:06:16.957072 19553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96efeaaf1057492490e9a621f37e1a2d" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:06:16.957255 24031 raft_consensus.cc:2804] T 46c5bfeecc314717bffe987e6844b6d0 P e5256d91808b47c195bc9b4dbd7f2b87 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:06:16.963965 19486 raft_consensus.cc:1240] T 217b5fae677b4971b3bbd2f357a1f7ff P 0473d2b2d01f4459b1e90fd12cc7840e [term 10 FOLLOWER]: Rejecting Update request from peer e5256d91808b47c195bc9b4dbd7f2b87 for earlier term 9. Current term is 10. Ops: []
I20260709 13:06:16.881455 24075 raft_consensus.cc:515] T 21e14947d70440f19044d8f75c31e1f9 P e61c3a8f61bb48f8a963c9480e53c168 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:16.918584 23714 leader_election.cc:290] T 96efeaaf1057492490e9a621f37e1a2d P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:06:16.942816 24081 raft_consensus.cc:2749] T 96efeaaf1057492490e9a621f37e1a2d P 127766fc592545a4997f7790f50f6076 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:06:16.968549 19481 raft_consensus.cc:2468] T 7f575b143b844aa096b50997dad3516a P 0473d2b2d01f4459b1e90fd12cc7840e [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 10.
I20260709 13:06:16.969316 24024 raft_consensus.cc:2749] T 1f85fc4b527a48848e5faa083b604e36 P 0473d2b2d01f4459b1e90fd12cc7840e [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:06:16.971289 19556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df751f992649444090e27965eb1af85d" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:06:16.950356 23687 raft_consensus.cc:740] T 14efcc79969f41babe5529c22d59156d P e5256d91808b47c195bc9b4dbd7f2b87 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: e5256d91808b47c195bc9b4dbd7f2b87, State: Running, Role: LEADER
I20260709 13:06:17.005890 19552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28af091831594f9d8e96482078cc7625" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
W20260709 13:06:17.006090 20078 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.2:46257, user_credentials={real_user=slave}} blocked reactor thread for 175588us
I20260709 13:06:17.007637 19556 raft_consensus.cc:2410] T df751f992649444090e27965eb1af85d P e61c3a8f61bb48f8a963c9480e53c168 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0473d2b2d01f4459b1e90fd12cc7840e for term 15 because replica has last-logged OpId of term: 14 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 8.
I20260709 13:06:17.008172 19478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a61655d99124a29b486ba4a5b37faea" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:06:17.006033 19553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "217b5fae677b4971b3bbd2f357a1f7ff" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:06:17.009876 19552 raft_consensus.cc:2468] T 28af091831594f9d8e96482078cc7625 P e61c3a8f61bb48f8a963c9480e53c168 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 12.
I20260709 13:06:17.009963 19553 raft_consensus.cc:3060] T 217b5fae677b4971b3bbd2f357a1f7ff P e61c3a8f61bb48f8a963c9480e53c168 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:06:17.010471 19482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14efcc79969f41babe5529c22d59156d" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:06:17.011026 23687 consensus_queue.cc:260] T 14efcc79969f41babe5529c22d59156d P e5256d91808b47c195bc9b4dbd7f2b87 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:17.013191 20078 leader_election.cc:304] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, 127766fc592545a4997f7790f50f6076; no voters: 
W20260709 13:06:17.013661 19376 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:17.014019 19406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2725d2c4cb054f18b0fc8f735c15f6c2" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: true dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
I20260709 13:06:17.014518 23538 leader_election.cc:290] T 28af091831594f9d8e96482078cc7625 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:06:17.022989 19408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4509b76741dc428e9201c70c1658da13" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
I20260709 13:06:17.047698 19377 leader_election.cc:304] T 7f575b143b844aa096b50997dad3516a P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87; no voters: 
I20260709 13:06:17.008885 19478 raft_consensus.cc:2468] T 1a61655d99124a29b486ba4a5b37faea P 0473d2b2d01f4459b1e90fd12cc7840e [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 9.
I20260709 13:06:16.963048 24031 raft_consensus.cc:697] T 46c5bfeecc314717bffe987e6844b6d0 P e5256d91808b47c195bc9b4dbd7f2b87 [term 18 LEADER]: Becoming Leader. State: Replica: e5256d91808b47c195bc9b4dbd7f2b87, State: Running, Role: LEADER
I20260709 13:06:17.051304 19551 raft_consensus.cc:2393] T 21e14947d70440f19044d8f75c31e1f9 P e61c3a8f61bb48f8a963c9480e53c168 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 0473d2b2d01f4459b1e90fd12cc7840e in current term 13: Already voted for candidate e61c3a8f61bb48f8a963c9480e53c168 in this term.
I20260709 13:06:17.051678 19408 raft_consensus.cc:2368] T 4509b76741dc428e9201c70c1658da13 P e5256d91808b47c195bc9b4dbd7f2b87 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate e61c3a8f61bb48f8a963c9480e53c168 for earlier term 7. Current term is 8.
I20260709 13:06:17.052368 19553 raft_consensus.cc:2468] T 217b5fae677b4971b3bbd2f357a1f7ff P e61c3a8f61bb48f8a963c9480e53c168 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 10.
W20260709 13:06:17.058761 20078 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.2:46257, user_credentials={real_user=slave}} blocked reactor thread for 45711.5us
W20260709 13:06:17.060534 19526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.2:46257, user_credentials={real_user=slave}} blocked reactor thread for 251574us
I20260709 13:06:17.062546 19407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ece3db938bc649d4a40a51522ed5259c" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:06:17.080871 19523 leader_election.cc:304] T fa8650e71aa14778b3d73721fc50d9fc P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168; no voters: 0473d2b2d01f4459b1e90fd12cc7840e
I20260709 13:06:17.001822 23928 consensus_queue.cc:1048] T 0afb57ae58a24a01850491d69f0213dd P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.059s
W20260709 13:06:17.081712 19449 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.1:40321, user_credentials={real_user=slave}} blocked reactor thread for 147372us
I20260709 13:06:17.050318 23874 raft_consensus.cc:493] T 40e1e16737a842ee936002830f36882e P e61c3a8f61bb48f8a963c9480e53c168 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader e5256d91808b47c195bc9b4dbd7f2b87)
I20260709 13:06:17.087868 19407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc225c93219c45538b53a1bd3d387e4d" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:06:17.059914 24048 raft_consensus.cc:493] T 1efebf73c86e432baa55533136b6e12c P 127766fc592545a4997f7790f50f6076 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader e61c3a8f61bb48f8a963c9480e53c168)
I20260709 13:06:17.094034 19479 raft_consensus.cc:2468] T 4509b76741dc428e9201c70c1658da13 P 0473d2b2d01f4459b1e90fd12cc7840e [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 8.
I20260709 13:06:17.080914 23538 raft_consensus.cc:493] T 6c5eebf646ad445a9d1b1adc319d7b16 P 0473d2b2d01f4459b1e90fd12cc7840e [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:06:17.088315 23878 consensus_meta.cc:287] T f1b10566f45d4a7d9029858330e02d5b P e5256d91808b47c195bc9b4dbd7f2b87: Time spent flushing consensus metadata: real 0.528s	user 0.009s	sys 0.005s
I20260709 13:06:17.084775 24081 raft_consensus.cc:2804] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P 127766fc592545a4997f7790f50f6076 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:06:17.100447 19408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70797e5783b5454ab0d0eea663e791e3" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:06:17.103991 23873 raft_consensus.cc:2804] T 7f575b143b844aa096b50997dad3516a P e5256d91808b47c195bc9b4dbd7f2b87 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:06:17.104076 19449 leader_election.cc:304] T 172b3dd13109415a955b71ac0e9d2234 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e; no voters: 127766fc592545a4997f7790f50f6076, e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:06:17.104803 23873 raft_consensus.cc:697] T 7f575b143b844aa096b50997dad3516a P e5256d91808b47c195bc9b4dbd7f2b87 [term 10 LEADER]: Becoming Leader. State: Replica: e5256d91808b47c195bc9b4dbd7f2b87, State: Running, Role: LEADER
I20260709 13:06:17.108116 24081 raft_consensus.cc:697] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P 127766fc592545a4997f7790f50f6076 [term 14 LEADER]: Becoming Leader. State: Replica: 127766fc592545a4997f7790f50f6076, State: Running, Role: LEADER
I20260709 13:06:17.109383 24081 consensus_queue.cc:237] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P 127766fc592545a4997f7790f50f6076 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:17.111388 19407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2725d2c4cb054f18b0fc8f735c15f6c2" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 16 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:06:17.106177 24106 consensus_queue.cc:1059] T 217b5fae677b4971b3bbd2f357a1f7ff P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.063s
I20260709 13:06:17.114310 24106 raft_consensus.cc:3055] T 217b5fae677b4971b3bbd2f357a1f7ff P e5256d91808b47c195bc9b4dbd7f2b87 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:06:17.114754 24106 raft_consensus.cc:740] T 217b5fae677b4971b3bbd2f357a1f7ff P e5256d91808b47c195bc9b4dbd7f2b87 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: e5256d91808b47c195bc9b4dbd7f2b87, State: Running, Role: LEADER
I20260709 13:06:17.115809 24106 consensus_queue.cc:260] T 217b5fae677b4971b3bbd2f357a1f7ff P e5256d91808b47c195bc9b4dbd7f2b87 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:17.117278 24106 raft_consensus.cc:3060] T 217b5fae677b4971b3bbd2f357a1f7ff P e5256d91808b47c195bc9b4dbd7f2b87 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:06:17.118983 19404 raft_consensus.cc:2376] T ef32ce6fdd0e40d382c79974f30295c6 P e5256d91808b47c195bc9b4dbd7f2b87 [term 15 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 15. Re-sending same reply.
I20260709 13:06:17.119647 24119 raft_consensus.cc:2804] T fa8650e71aa14778b3d73721fc50d9fc P e61c3a8f61bb48f8a963c9480e53c168 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:06:17.120182 19411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "217b5fae677b4971b3bbd2f357a1f7ff" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:06:17.123824 24031 consensus_queue.cc:237] T 46c5bfeecc314717bffe987e6844b6d0 P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 16.7, Last appended by leader: 7, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:17.106097 19449 leader_election.cc:304] T 40e1e16737a842ee936002830f36882e P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e; no voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:06:17.126065 24048 raft_consensus.cc:515] T 1efebf73c86e432baa55533136b6e12c P 127766fc592545a4997f7790f50f6076 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:17.120128 24119 raft_consensus.cc:493] T fa8650e71aa14778b3d73721fc50d9fc P e61c3a8f61bb48f8a963c9480e53c168 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 0473d2b2d01f4459b1e90fd12cc7840e)
I20260709 13:06:17.141253 19407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e381f1d6b8184797ad142de49be225a8" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:06:17.099575 23874 raft_consensus.cc:515] T 40e1e16737a842ee936002830f36882e P e61c3a8f61bb48f8a963c9480e53c168 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:17.151314 19408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef32ce6fdd0e40d382c79974f30295c6" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
W20260709 13:06:17.146729 20075 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.1:40321, user_credentials={real_user=slave}} blocked reactor thread for 240753us
I20260709 13:06:17.102480 23538 raft_consensus.cc:515] T 6c5eebf646ad445a9d1b1adc319d7b16 P 0473d2b2d01f4459b1e90fd12cc7840e [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:17.143097 24046 raft_consensus.cc:2749] T 172b3dd13109415a955b71ac0e9d2234 P 0473d2b2d01f4459b1e90fd12cc7840e [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:06:17.146850 24119 raft_consensus.cc:3060] T fa8650e71aa14778b3d73721fc50d9fc P e61c3a8f61bb48f8a963c9480e53c168 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:06:17.168509 19409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff75a1d4cb1f493db8f71ddc136ba9ab" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:06:17.145478 24024 raft_consensus.cc:2749] T 40e1e16737a842ee936002830f36882e P 0473d2b2d01f4459b1e90fd12cc7840e [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:06:17.148952 23805 raft_consensus.cc:697] T 775c229504194560ba9589bc2199b089 P 127766fc592545a4997f7790f50f6076 [term 11 LEADER]: Becoming Leader. State: Replica: 127766fc592545a4997f7790f50f6076, State: Running, Role: LEADER
I20260709 13:06:17.161688 24036 raft_consensus.cc:697] T 4509b76741dc428e9201c70c1658da13 P e61c3a8f61bb48f8a963c9480e53c168 [term 7 LEADER]: Becoming Leader. State: Replica: e61c3a8f61bb48f8a963c9480e53c168, State: Running, Role: LEADER
W20260709 13:06:17.179567 19523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.1:40321, user_credentials={real_user=slave}} blocked reactor thread for 119610us
I20260709 13:06:17.106087 23873 consensus_queue.cc:237] T 7f575b143b844aa096b50997dad3516a P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.7, Last appended by leader: 7, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:17.177148 19408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cdf56e38bbc453d9438d359e5a69955" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:06:17.187382 19409 raft_consensus.cc:2468] T ff75a1d4cb1f493db8f71ddc136ba9ab P e5256d91808b47c195bc9b4dbd7f2b87 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 11.
I20260709 13:06:17.177712 24075 leader_election.cc:290] T 21e14947d70440f19044d8f75c31e1f9 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 13 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:06:17.200573 19408 raft_consensus.cc:2393] T 0cdf56e38bbc453d9438d359e5a69955 P e5256d91808b47c195bc9b4dbd7f2b87 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e61c3a8f61bb48f8a963c9480e53c168 in current term 14: Already voted for candidate 0473d2b2d01f4459b1e90fd12cc7840e in this term.
I20260709 13:06:17.204727 19409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28af091831594f9d8e96482078cc7625" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:06:17.200284 24128 raft_consensus.cc:493] T 3e1f505cb0f1427bbd698ac889d80821 P e61c3a8f61bb48f8a963c9480e53c168 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:17.206339 24048 leader_election.cc:290] T 1efebf73c86e432baa55533136b6e12c P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:06:17.206018 24128 raft_consensus.cc:515] T 3e1f505cb0f1427bbd698ac889d80821 P e61c3a8f61bb48f8a963c9480e53c168 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:17.208510 24128 leader_election.cc:290] T 3e1f505cb0f1427bbd698ac889d80821 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:06:17.208214 24036 consensus_queue.cc:237] T 4509b76741dc428e9201c70c1658da13 P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:17.211746 23805 consensus_queue.cc:237] T 775c229504194560ba9589bc2199b089 P 127766fc592545a4997f7790f50f6076 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:17.223232 20106 raft_consensus.cc:1240] T 0e1085d23e8347fbbd5bce7542f4b1f4 P 127766fc592545a4997f7790f50f6076 [term 10 FOLLOWER]: Rejecting Update request from peer 0473d2b2d01f4459b1e90fd12cc7840e for earlier term 9. Current term is 10. Ops: []
I20260709 13:06:17.232306 23538 leader_election.cc:290] T 6c5eebf646ad445a9d1b1adc319d7b16 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
W20260709 13:06:17.249060 19449 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.1:40321, user_credentials={real_user=slave}} blocked reactor thread for 143110us
I20260709 13:06:17.258764 19408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4af19371ea874c09a0a2147040835cbb" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:06:17.261817 19410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a61655d99124a29b486ba4a5b37faea" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:06:17.262740 19410 raft_consensus.cc:2410] T 1a61655d99124a29b486ba4a5b37faea P e5256d91808b47c195bc9b4dbd7f2b87 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0473d2b2d01f4459b1e90fd12cc7840e for term 10 because replica has last-logged OpId of term: 8 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 5.
I20260709 13:06:17.263029 19557 raft_consensus.cc:1240] T d1e5873a19244c5ebbcd38e126796ee7 P e61c3a8f61bb48f8a963c9480e53c168 [term 14 FOLLOWER]: Rejecting Update request from peer e5256d91808b47c195bc9b4dbd7f2b87 for earlier term 13. Current term is 14. Ops: []
I20260709 13:06:17.263621 19556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86a6797bdfe94fa496c050ceae4bd0d9" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:06:17.263985 19557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f575b143b844aa096b50997dad3516a" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:06:17.264657 19557 raft_consensus.cc:2468] T 7f575b143b844aa096b50997dad3516a P e61c3a8f61bb48f8a963c9480e53c168 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 9.
I20260709 13:06:17.264894 19556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f93ee515a9c14139bf566522ed8232f3" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 16 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:06:17.265429 19557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa8650e71aa14778b3d73721fc50d9fc" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:06:17.265945 19556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46c5bfeecc314717bffe987e6844b6d0" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 18 candidate_status { last_received { term: 16 index: 7 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:06:17.267275 19559 raft_consensus.cc:1240] T a08760e15aac4630a629431f56024dc8 P e61c3a8f61bb48f8a963c9480e53c168 [term 15 FOLLOWER]: Rejecting Update request from peer e5256d91808b47c195bc9b4dbd7f2b87 for earlier term 14. Current term is 15. Ops: []
I20260709 13:06:17.268364 19559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b74109013a140ada21feeef92d6f563" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:06:17.269115 19559 raft_consensus.cc:2393] T 2b74109013a140ada21feeef92d6f563 P e61c3a8f61bb48f8a963c9480e53c168 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e5256d91808b47c195bc9b4dbd7f2b87 in current term 10: Already voted for candidate 0473d2b2d01f4459b1e90fd12cc7840e in this term.
I20260709 13:06:17.269917 19559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4509b76741dc428e9201c70c1658da13" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:06:17.247382 24033 raft_consensus.cc:3055] T a08760e15aac4630a629431f56024dc8 P e5256d91808b47c195bc9b4dbd7f2b87 [term 14 LEADER]: Stepping down as leader of term 14
W20260709 13:06:17.277070 19523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.1:40321, user_credentials={real_user=slave}} blocked reactor thread for 85384.8us
I20260709 13:06:17.266498 19557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc225c93219c45538b53a1bd3d387e4d" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:06:17.287302 19409 raft_consensus.cc:2393] T 28af091831594f9d8e96482078cc7625 P e5256d91808b47c195bc9b4dbd7f2b87 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e61c3a8f61bb48f8a963c9480e53c168 in current term 13: Already voted for candidate e5256d91808b47c195bc9b4dbd7f2b87 in this term.
I20260709 13:06:17.280054 24033 raft_consensus.cc:740] T a08760e15aac4630a629431f56024dc8 P e5256d91808b47c195bc9b4dbd7f2b87 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: e5256d91808b47c195bc9b4dbd7f2b87, State: Running, Role: LEADER
I20260709 13:06:17.290141 24033 consensus_queue.cc:260] T a08760e15aac4630a629431f56024dc8 P e5256d91808b47c195bc9b4dbd7f2b87 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:17.291301 24033 raft_consensus.cc:3060] T a08760e15aac4630a629431f56024dc8 P e5256d91808b47c195bc9b4dbd7f2b87 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:06:17.296011 23918 raft_consensus.cc:493] T 5ec1c4ce15e04c7e8c283a62179f2a64 P e5256d91808b47c195bc9b4dbd7f2b87 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 127766fc592545a4997f7790f50f6076)
I20260709 13:06:17.297071 23687 raft_consensus.cc:3060] T 14efcc79969f41babe5529c22d59156d P e5256d91808b47c195bc9b4dbd7f2b87 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:06:17.296643 23918 raft_consensus.cc:515] T 5ec1c4ce15e04c7e8c283a62179f2a64 P e5256d91808b47c195bc9b4dbd7f2b87 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:17.298702 24048 consensus_queue.cc:1048] T 85c494af21f9457a85da47b9bc70c1fd P 127766fc592545a4997f7790f50f6076 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.014s
I20260709 13:06:17.304446 20078 leader_election.cc:304] T 14efcc79969f41babe5529c22d59156d P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 127766fc592545a4997f7790f50f6076; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:06:17.304718 23919 raft_consensus.cc:493] T 309c3ca0ca4b4f3ba129752ea2cb293b P e5256d91808b47c195bc9b4dbd7f2b87 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 127766fc592545a4997f7790f50f6076)
I20260709 13:06:17.305275 23919 raft_consensus.cc:515] T 309c3ca0ca4b4f3ba129752ea2cb293b P e5256d91808b47c195bc9b4dbd7f2b87 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } attrs { replace: true } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:17.310822 19406 raft_consensus.cc:3055] T 2725d2c4cb054f18b0fc8f735c15f6c2 P e5256d91808b47c195bc9b4dbd7f2b87 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:06:17.311206 19406 raft_consensus.cc:740] T 2725d2c4cb054f18b0fc8f735c15f6c2 P e5256d91808b47c195bc9b4dbd7f2b87 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: e5256d91808b47c195bc9b4dbd7f2b87, State: Running, Role: LEADER
I20260709 13:06:17.311919 19406 consensus_queue.cc:260] T 2725d2c4cb054f18b0fc8f735c15f6c2 P e5256d91808b47c195bc9b4dbd7f2b87 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 14.7, Last appended by leader: 7, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:17.312342 23919 leader_election.cc:290] T 309c3ca0ca4b4f3ba129752ea2cb293b P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:06:17.312827 19406 raft_consensus.cc:3060] T 2725d2c4cb054f18b0fc8f735c15f6c2 P e5256d91808b47c195bc9b4dbd7f2b87 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:06:17.316035 19523 leader_election.cc:304] T 2b74109013a140ada21feeef92d6f563 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e61c3a8f61bb48f8a963c9480e53c168; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:06:17.317035 24089 raft_consensus.cc:2749] T 2b74109013a140ada21feeef92d6f563 P e61c3a8f61bb48f8a963c9480e53c168 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:06:17.326231 19402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff75a1d4cb1f493db8f71ddc136ba9ab" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
I20260709 13:06:17.327162 19402 raft_consensus.cc:3060] T ff75a1d4cb1f493db8f71ddc136ba9ab P e5256d91808b47c195bc9b4dbd7f2b87 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:06:17.328948 19377 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:17.331387 19559 raft_consensus.cc:1240] T f1b10566f45d4a7d9029858330e02d5b P e61c3a8f61bb48f8a963c9480e53c168 [term 14 FOLLOWER]: Rejecting Update request from peer e5256d91808b47c195bc9b4dbd7f2b87 for earlier term 13. Current term is 14. Ops: []
I20260709 13:06:17.336218 23874 leader_election.cc:290] T 40e1e16737a842ee936002830f36882e P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:06:17.338621 24048 raft_consensus.cc:2749] T 14efcc79969f41babe5529c22d59156d P 127766fc592545a4997f7790f50f6076 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:06:17.347433 19409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e36a9d6e29c4a7c860cf267efbd4c74" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
I20260709 13:06:17.348291 19409 raft_consensus.cc:2376] T 2e36a9d6e29c4a7c860cf267efbd4c74 P e5256d91808b47c195bc9b4dbd7f2b87 [term 10 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 10. Re-sending same reply.
W20260709 13:06:17.360630 19449 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.1:40321, user_credentials={real_user=slave}} blocked reactor thread for 72540.6us
W20260709 13:06:17.361375 19523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.1:40321, user_credentials={real_user=slave}} blocked reactor thread for 45503.4us
I20260709 13:06:17.362003 19377 leader_election.cc:304] T 1a61655d99124a29b486ba4a5b37faea P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87; no voters: 
I20260709 13:06:17.374439 19377 leader_election.cc:304] T 4509b76741dc428e9201c70c1658da13 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87; no voters: 
I20260709 13:06:17.381721 19557 raft_consensus.cc:1240] T 217b5fae677b4971b3bbd2f357a1f7ff P e61c3a8f61bb48f8a963c9480e53c168 [term 10 FOLLOWER]: Rejecting Update request from peer e5256d91808b47c195bc9b4dbd7f2b87 for earlier term 9. Current term is 10. Ops: []
I20260709 13:06:17.382701 19560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c5eebf646ad445a9d1b1adc319d7b16" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:06:17.383322 19560 raft_consensus.cc:2468] T 6c5eebf646ad445a9d1b1adc319d7b16 P e61c3a8f61bb48f8a963c9480e53c168 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 11.
I20260709 13:06:17.384168 19552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9f0d59553ad444883fcf5b5909f9798" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:06:17.386304 19405 raft_consensus.cc:2468] T 22196caba61445d3bec98a0aab3c337d P e5256d91808b47c195bc9b4dbd7f2b87 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 10.
I20260709 13:06:17.387223 19559 raft_consensus.cc:1240] T 1dc5b3532fe54f74876d02beffa2c230 P e61c3a8f61bb48f8a963c9480e53c168 [term 13 FOLLOWER]: Rejecting Update request from peer e5256d91808b47c195bc9b4dbd7f2b87 for earlier term 12. Current term is 13. Ops: []
I20260709 13:06:17.385932 20106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "309c3ca0ca4b4f3ba129752ea2cb293b" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:06:17.391201 19551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f575b143b844aa096b50997dad3516a" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:06:17.391768 19551 raft_consensus.cc:3060] T 7f575b143b844aa096b50997dad3516a P e61c3a8f61bb48f8a963c9480e53c168 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:06:17.379561 23605 raft_consensus.cc:2804] T 1a61655d99124a29b486ba4a5b37faea P e5256d91808b47c195bc9b4dbd7f2b87 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:06:17.397619 23919 raft_consensus.cc:2804] T 4509b76741dc428e9201c70c1658da13 P e5256d91808b47c195bc9b4dbd7f2b87 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:06:17.403724 19481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1efebf73c86e432baa55533136b6e12c" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:06:17.409119 19560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a61655d99124a29b486ba4a5b37faea" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:06:17.411499 23919 raft_consensus.cc:697] T 4509b76741dc428e9201c70c1658da13 P e5256d91808b47c195bc9b4dbd7f2b87 [term 8 LEADER]: Becoming Leader. State: Replica: e5256d91808b47c195bc9b4dbd7f2b87, State: Running, Role: LEADER
I20260709 13:06:17.411734 19480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff9b0eddd810459b82d91c60777c10eb" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:06:17.412156 19552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "309c3ca0ca4b4f3ba129752ea2cb293b" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:06:17.412835 19552 raft_consensus.cc:2468] T 309c3ca0ca4b4f3ba129752ea2cb293b P e61c3a8f61bb48f8a963c9480e53c168 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 9.
I20260709 13:06:17.412883 19411 raft_consensus.cc:2468] T 217b5fae677b4971b3bbd2f357a1f7ff P e5256d91808b47c195bc9b4dbd7f2b87 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 10.
I20260709 13:06:17.413389 19481 raft_consensus.cc:2468] T 1efebf73c86e432baa55533136b6e12c P 0473d2b2d01f4459b1e90fd12cc7840e [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 127766fc592545a4997f7790f50f6076 in term 11.
I20260709 13:06:17.413758 19558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4509b76741dc428e9201c70c1658da13" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:06:17.418622 19479 raft_consensus.cc:1240] T a08760e15aac4630a629431f56024dc8 P 0473d2b2d01f4459b1e90fd12cc7840e [term 15 LEADER]: Rejecting Update request from peer e5256d91808b47c195bc9b4dbd7f2b87 for earlier term 14. Current term is 15. Ops: []
I20260709 13:06:17.427273 19449 leader_election.cc:304] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e; no voters: 127766fc592545a4997f7790f50f6076, e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:06:17.428735 19449 leader_election.cc:304] T 1dc5b3532fe54f74876d02beffa2c230 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e; no voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:06:17.429878 19449 leader_election.cc:304] T 2725d2c4cb054f18b0fc8f735c15f6c2 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e; no voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:06:17.430197 24046 raft_consensus.cc:2749] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P 0473d2b2d01f4459b1e90fd12cc7840e [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:06:17.412534 23919 consensus_queue.cc:237] T 4509b76741dc428e9201c70c1658da13 P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:17.392489 23761 raft_consensus.cc:493] T ab43d85f64114d4ebf618930e43d9ed0 P 127766fc592545a4997f7790f50f6076 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader e61c3a8f61bb48f8a963c9480e53c168)
I20260709 13:06:17.442009 23761 raft_consensus.cc:515] T ab43d85f64114d4ebf618930e43d9ed0 P 127766fc592545a4997f7790f50f6076 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } attrs { replace: true } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:17.442430 23465 raft_consensus.cc:493] T edd7d470b5014c9489be7f41f64355c9 P e5256d91808b47c195bc9b4dbd7f2b87 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:17.443120 23465 raft_consensus.cc:515] T edd7d470b5014c9489be7f41f64355c9 P e5256d91808b47c195bc9b4dbd7f2b87 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
W20260709 13:06:17.445173 19452 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:17.446808 23465 leader_election.cc:290] T edd7d470b5014c9489be7f41f64355c9 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:06:17.452430 19523 leader_election.cc:400] T 7f575b143b844aa096b50997dad3516a P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 9 election: Vote denied by peer e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321) with higher term. Message: Invalid argument: T 7f575b143b844aa096b50997dad3516a P e5256d91808b47c195bc9b4dbd7f2b87 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate e61c3a8f61bb48f8a963c9480e53c168 for earlier term 9. Current term is 10.
I20260709 13:06:17.452823 19523 leader_election.cc:403] T 7f575b143b844aa096b50997dad3516a P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 9 election: Cancelling election due to peer responding with higher term
I20260709 13:06:17.454185 19557 raft_consensus.cc:1240] T 2725d2c4cb054f18b0fc8f735c15f6c2 P e61c3a8f61bb48f8a963c9480e53c168 [term 15 FOLLOWER]: Rejecting Update request from peer e5256d91808b47c195bc9b4dbd7f2b87 for earlier term 14. Current term is 15. Ops: []
I20260709 13:06:17.455940 24127 raft_consensus.cc:493] T 6c5eebf646ad445a9d1b1adc319d7b16 P 127766fc592545a4997f7790f50f6076 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 0473d2b2d01f4459b1e90fd12cc7840e)
I20260709 13:06:17.456511 24127 raft_consensus.cc:515] T 6c5eebf646ad445a9d1b1adc319d7b16 P 127766fc592545a4997f7790f50f6076 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:17.406757 23605 raft_consensus.cc:493] T 1a61655d99124a29b486ba4a5b37faea P e5256d91808b47c195bc9b4dbd7f2b87 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:17.459297 23605 raft_consensus.cc:3060] T 1a61655d99124a29b486ba4a5b37faea P e5256d91808b47c195bc9b4dbd7f2b87 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:06:17.439451 24055 raft_consensus.cc:2749] T 1dc5b3532fe54f74876d02beffa2c230 P 0473d2b2d01f4459b1e90fd12cc7840e [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:06:17.473043 19402 raft_consensus.cc:2468] T ff75a1d4cb1f493db8f71ddc136ba9ab P e5256d91808b47c195bc9b4dbd7f2b87 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 12.
I20260709 13:06:17.440258 19375 leader_election.cc:400] T ff75a1d4cb1f493db8f71ddc136ba9ab P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 11 election: Vote denied by peer e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891) with higher term. Message: Invalid argument: T ff75a1d4cb1f493db8f71ddc136ba9ab P e61c3a8f61bb48f8a963c9480e53c168 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate e5256d91808b47c195bc9b4dbd7f2b87 for earlier term 11. Current term is 12.
I20260709 13:06:17.528203 19375 leader_election.cc:403] T ff75a1d4cb1f493db8f71ddc136ba9ab P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 11 election: Cancelling election due to peer responding with higher term
I20260709 13:06:17.484970 19449 leader_election.cc:304] T 179fd671030940b4b4a4e24bcc4aba0a P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87; no voters: e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:06:17.467444 24046 raft_consensus.cc:3060] T 2725d2c4cb054f18b0fc8f735c15f6c2 P 0473d2b2d01f4459b1e90fd12cc7840e [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:06:17.494395 19377 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:17.535856 19377 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:17.482365 23878 raft_consensus.cc:493] T 2e36a9d6e29c4a7c860cf267efbd4c74 P e5256d91808b47c195bc9b4dbd7f2b87 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:06:17.502779 23883 consensus_meta.cc:287] T e381f1d6b8184797ad142de49be225a8 P e5256d91808b47c195bc9b4dbd7f2b87: Time spent flushing consensus metadata: real 0.605s	user 0.008s	sys 0.004s
I20260709 13:06:17.503156 24127 leader_election.cc:290] T 6c5eebf646ad445a9d1b1adc319d7b16 P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:06:17.474598 23761 leader_election.cc:290] T ab43d85f64114d4ebf618930e43d9ed0 P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:06:17.499269 19523 leader_election.cc:304] T 2a16f7501e2444fb86d4e2778e734e02 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e61c3a8f61bb48f8a963c9480e53c168; no voters: 127766fc592545a4997f7790f50f6076, e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:06:17.552011 19551 raft_consensus.cc:2468] T 7f575b143b844aa096b50997dad3516a P e61c3a8f61bb48f8a963c9480e53c168 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 10.
I20260709 13:06:17.561619 19479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "309c3ca0ca4b4f3ba129752ea2cb293b" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:06:17.566617 19407 raft_consensus.cc:2468] T e381f1d6b8184797ad142de49be225a8 P e5256d91808b47c195bc9b4dbd7f2b87 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 10.
W20260709 13:06:17.568142 19376 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:17.574966 19376 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:17.555609 19450 leader_election.cc:304] T 28af091831594f9d8e96482078cc7625 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:06:17.578042 19450 leader_election.cc:304] T 217b5fae677b4971b3bbd2f357a1f7ff P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:06:17.564452 24033 raft_consensus.cc:493] T 85c494af21f9457a85da47b9bc70c1fd P e5256d91808b47c195bc9b4dbd7f2b87 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:17.567637 23880 raft_consensus.cc:2749] T ff75a1d4cb1f493db8f71ddc136ba9ab P e5256d91808b47c195bc9b4dbd7f2b87 [term 12 FOLLOWER]: Leader election lost for term 11. Reason: Vote denied by peer e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891) with higher term. Message: Invalid argument: T ff75a1d4cb1f493db8f71ddc136ba9ab P e61c3a8f61bb48f8a963c9480e53c168 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate e5256d91808b47c195bc9b4dbd7f2b87 for earlier term 11. Current term is 12.
I20260709 13:06:17.568899 24024 raft_consensus.cc:2804] T 179fd671030940b4b4a4e24bcc4aba0a P 0473d2b2d01f4459b1e90fd12cc7840e [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:06:17.539053 23974 raft_consensus.cc:493] T 14935b3ddf914369822e4a0547aaa355 P e61c3a8f61bb48f8a963c9480e53c168 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 127766fc592545a4997f7790f50f6076)
W20260709 13:06:17.579900 19449 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.1:40321, user_credentials={real_user=slave}} blocked reactor thread for 95048.4us
I20260709 13:06:17.573463 23874 raft_consensus.cc:2749] T 2a16f7501e2444fb86d4e2778e734e02 P e61c3a8f61bb48f8a963c9480e53c168 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:06:17.567684 23918 leader_election.cc:290] T 5ec1c4ce15e04c7e8c283a62179f2a64 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:06:17.570839 23687 raft_consensus.cc:493] T ff9b0eddd810459b82d91c60777c10eb P e5256d91808b47c195bc9b4dbd7f2b87 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 0473d2b2d01f4459b1e90fd12cc7840e)
I20260709 13:06:17.563494 23878 raft_consensus.cc:515] T 2e36a9d6e29c4a7c860cf267efbd4c74 P e5256d91808b47c195bc9b4dbd7f2b87 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:17.581852 23933 raft_consensus.cc:2804] T 28af091831594f9d8e96482078cc7625 P 0473d2b2d01f4459b1e90fd12cc7840e [term 13 FOLLOWER]: Leader pre-election won for term 14
W20260709 13:06:17.607790 19375 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.3:36891, user_credentials={real_user=slave}} blocked reactor thread for 221362us
I20260709 13:06:17.589075 23740 raft_consensus.cc:2804] T 217b5fae677b4971b3bbd2f357a1f7ff P 0473d2b2d01f4459b1e90fd12cc7840e [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:06:17.589617 24024 raft_consensus.cc:493] T 179fd671030940b4b4a4e24bcc4aba0a P 0473d2b2d01f4459b1e90fd12cc7840e [term 13 FOLLOWER]: Starting leader election (detected failure of leader e61c3a8f61bb48f8a963c9480e53c168)
I20260709 13:06:17.617940 19402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab43d85f64114d4ebf618930e43d9ed0" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:06:17.620091 19450 leader_election.cc:304] T 6c5eebf646ad445a9d1b1adc319d7b16 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
W20260709 13:06:17.620105 19523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.1:40321, user_credentials={real_user=slave}} blocked reactor thread for 152994us
I20260709 13:06:17.609760 24031 raft_consensus.cc:493] T 65d8cb8d6ec64f459d5a47cefab10acf P e5256d91808b47c195bc9b4dbd7f2b87 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:17.612051 23933 raft_consensus.cc:493] T 28af091831594f9d8e96482078cc7625 P 0473d2b2d01f4459b1e90fd12cc7840e [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:17.627152 19560 raft_consensus.cc:1275] T f1b10566f45d4a7d9029858330e02d5b P e61c3a8f61bb48f8a963c9480e53c168 [term 14 FOLLOWER]: Refusing update from remote peer 0473d2b2d01f4459b1e90fd12cc7840e: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 13:06:17.622852 19402 raft_consensus.cc:2468] T ab43d85f64114d4ebf618930e43d9ed0 P e5256d91808b47c195bc9b4dbd7f2b87 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 127766fc592545a4997f7790f50f6076 in term 13.
I20260709 13:06:17.639616 19479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab43d85f64114d4ebf618930e43d9ed0" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:06:17.640535 19479 raft_consensus.cc:2468] T ab43d85f64114d4ebf618930e43d9ed0 P 0473d2b2d01f4459b1e90fd12cc7840e [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 127766fc592545a4997f7790f50f6076 in term 13.
I20260709 13:06:17.631954 19375 leader_election.cc:304] T 86a6797bdfe94fa496c050ceae4bd0d9 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:06:17.641594 19481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c5eebf646ad445a9d1b1adc319d7b16" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:06:17.643419 19554 raft_consensus.cc:1275] T e381f1d6b8184797ad142de49be225a8 P e61c3a8f61bb48f8a963c9480e53c168 [term 10 FOLLOWER]: Refusing update from remote peer 0473d2b2d01f4459b1e90fd12cc7840e: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 13:06:17.644938 24120 raft_consensus.cc:2749] T 7f575b143b844aa096b50997dad3516a P e61c3a8f61bb48f8a963c9480e53c168 [term 10 FOLLOWER]: Leader election lost for term 9. Reason: Vote denied by peer e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321) with higher term. Message: Invalid argument: T 7f575b143b844aa096b50997dad3516a P e5256d91808b47c195bc9b4dbd7f2b87 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate e61c3a8f61bb48f8a963c9480e53c168 for earlier term 9. Current term is 10.
I20260709 13:06:17.645025 19484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edd7d470b5014c9489be7f41f64355c9" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:06:17.645733 19484 raft_consensus.cc:2468] T edd7d470b5014c9489be7f41f64355c9 P 0473d2b2d01f4459b1e90fd12cc7840e [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 13.
I20260709 13:06:17.645800 19480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ec1c4ce15e04c7e8c283a62179f2a64" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:06:17.646049 24036 raft_consensus.cc:493] T ed7fdbcb96d14d418db9ca90a792588a P e61c3a8f61bb48f8a963c9480e53c168 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 127766fc592545a4997f7790f50f6076)
I20260709 13:06:17.646651 23795 raft_consensus.cc:493] T 48824d5acfbc485ebf8c2d944e7202de P 0473d2b2d01f4459b1e90fd12cc7840e [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 127766fc592545a4997f7790f50f6076)
I20260709 13:06:17.646704 24036 raft_consensus.cc:515] T ed7fdbcb96d14d418db9ca90a792588a P e61c3a8f61bb48f8a963c9480e53c168 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:17.647576 19557 raft_consensus.cc:1275] T 2b74109013a140ada21feeef92d6f563 P e61c3a8f61bb48f8a963c9480e53c168 [term 10 FOLLOWER]: Refusing update from remote peer 0473d2b2d01f4459b1e90fd12cc7840e: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:06:17.647385 23795 raft_consensus.cc:515] T 48824d5acfbc485ebf8c2d944e7202de P 0473d2b2d01f4459b1e90fd12cc7840e [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:17.649102 24036 leader_election.cc:290] T ed7fdbcb96d14d418db9ca90a792588a P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:06:17.645056 20110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ec1c4ce15e04c7e8c283a62179f2a64" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:06:17.630250 23928 raft_consensus.cc:2804] T 6c5eebf646ad445a9d1b1adc319d7b16 P 0473d2b2d01f4459b1e90fd12cc7840e [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:06:17.650892 23928 raft_consensus.cc:493] T 6c5eebf646ad445a9d1b1adc319d7b16 P 0473d2b2d01f4459b1e90fd12cc7840e [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:17.651264 23928 raft_consensus.cc:3060] T 6c5eebf646ad445a9d1b1adc319d7b16 P 0473d2b2d01f4459b1e90fd12cc7840e [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:06:17.619191 24024 raft_consensus.cc:3060] T 179fd671030940b4b4a4e24bcc4aba0a P 0473d2b2d01f4459b1e90fd12cc7840e [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:06:17.639695 23933 raft_consensus.cc:3060] T 28af091831594f9d8e96482078cc7625 P 0473d2b2d01f4459b1e90fd12cc7840e [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:06:17.673892 23883 raft_consensus.cc:2749] T 86a6797bdfe94fa496c050ceae4bd0d9 P e5256d91808b47c195bc9b4dbd7f2b87 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:06:17.679113 19406 raft_consensus.cc:2468] T 2725d2c4cb054f18b0fc8f735c15f6c2 P e5256d91808b47c195bc9b4dbd7f2b87 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 15.
I20260709 13:06:17.683079 19523 leader_election.cc:304] T fa731b585f684a7fb2d106c50f143b83 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e61c3a8f61bb48f8a963c9480e53c168; no voters: 127766fc592545a4997f7790f50f6076, e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:06:17.616346 24033 raft_consensus.cc:515] T 85c494af21f9457a85da47b9bc70c1fd P e5256d91808b47c195bc9b4dbd7f2b87 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:17.683216 19377 leader_election.cc:304] T 309c3ca0ca4b4f3ba129752ea2cb293b P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, 127766fc592545a4997f7790f50f6076
I20260709 13:06:17.689031 20078 leader_election.cc:304] T ff9b0eddd810459b82d91c60777c10eb P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 127766fc592545a4997f7790f50f6076; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:06:17.630187 23880 consensus_queue.cc:1059] T d1e5873a19244c5ebbcd38e126796ee7 P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 }, Status: INVALID_TERM, Last received: 13.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.046s
I20260709 13:06:17.622979 23687 raft_consensus.cc:515] T ff9b0eddd810459b82d91c60777c10eb P e5256d91808b47c195bc9b4dbd7f2b87 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:17.622087 23974 raft_consensus.cc:515] T 14935b3ddf914369822e4a0547aaa355 P e61c3a8f61bb48f8a963c9480e53c168 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } attrs { replace: true } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
W20260709 13:06:17.710757 19375 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.3:36891, user_credentials={real_user=slave}} blocked reactor thread for 86203.2us
I20260709 13:06:17.631284 24031 raft_consensus.cc:515] T 65d8cb8d6ec64f459d5a47cefab10acf P e5256d91808b47c195bc9b4dbd7f2b87 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
W20260709 13:06:17.690966 24140 log.cc:927] Time spent T 46c5bfeecc314717bffe987e6844b6d0 P e5256d91808b47c195bc9b4dbd7f2b87: Append to log took a long time: real 0.082s	user 0.000s	sys 0.001s
I20260709 13:06:17.715732 20078 leader_election.cc:304] T 1efebf73c86e432baa55533136b6e12c P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, 127766fc592545a4997f7790f50f6076; no voters: 
W20260709 13:06:17.720428 19374 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:17.724189 23928 raft_consensus.cc:515] T 6c5eebf646ad445a9d1b1adc319d7b16 P 0473d2b2d01f4459b1e90fd12cc7840e [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:17.725456 19481 raft_consensus.cc:2368] T 6c5eebf646ad445a9d1b1adc319d7b16 P 0473d2b2d01f4459b1e90fd12cc7840e [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 127766fc592545a4997f7790f50f6076 for earlier term 11. Current term is 12.
I20260709 13:06:17.725955 23873 raft_consensus.cc:2749] T 309c3ca0ca4b4f3ba129752ea2cb293b P e5256d91808b47c195bc9b4dbd7f2b87 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:06:17.714329 24128 raft_consensus.cc:2749] T fa731b585f684a7fb2d106c50f143b83 P e61c3a8f61bb48f8a963c9480e53c168 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:06:17.727095 24048 raft_consensus.cc:2749] T ff9b0eddd810459b82d91c60777c10eb P 127766fc592545a4997f7790f50f6076 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:06:17.727368 19402 raft_consensus.cc:1275] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P e5256d91808b47c195bc9b4dbd7f2b87 [term 14 FOLLOWER]: Refusing update from remote peer 127766fc592545a4997f7790f50f6076: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 13:06:17.669088 24055 consensus_queue.cc:1048] T f1b10566f45d4a7d9029858330e02d5b P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.044s
W20260709 13:06:17.736572 19449 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.1:40321, user_credentials={real_user=slave}} blocked reactor thread for 81277.6us
I20260709 13:06:17.743060 24136 raft_consensus.cc:2804] T 1efebf73c86e432baa55533136b6e12c P 127766fc592545a4997f7790f50f6076 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:06:17.743654 24136 raft_consensus.cc:493] T 1efebf73c86e432baa55533136b6e12c P 127766fc592545a4997f7790f50f6076 [term 11 FOLLOWER]: Starting leader election (detected failure of leader e61c3a8f61bb48f8a963c9480e53c168)
I20260709 13:06:17.744094 24136 raft_consensus.cc:3060] T 1efebf73c86e432baa55533136b6e12c P 127766fc592545a4997f7790f50f6076 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:06:17.750792 24041 consensus_queue.cc:1048] T e381f1d6b8184797ad142de49be225a8 P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.071s
I20260709 13:06:17.752739 24041 raft_consensus.cc:493] T ff75a1d4cb1f493db8f71ddc136ba9ab P 0473d2b2d01f4459b1e90fd12cc7840e [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:17.753297 24041 raft_consensus.cc:515] T ff75a1d4cb1f493db8f71ddc136ba9ab P 0473d2b2d01f4459b1e90fd12cc7840e [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:17.759586 19449 leader_election.cc:304] T 775c229504194560ba9589bc2199b089 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87; no voters: 127766fc592545a4997f7790f50f6076
I20260709 13:06:17.762885 23795 leader_election.cc:290] T 48824d5acfbc485ebf8c2d944e7202de P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:06:17.763693 23795 raft_consensus.cc:2764] T 775c229504194560ba9589bc2199b089 P 0473d2b2d01f4459b1e90fd12cc7840e [term 11 FOLLOWER]: Leader election decision vote started in defunct term 10: won
I20260709 13:06:17.684365 23605 raft_consensus.cc:515] T 1a61655d99124a29b486ba4a5b37faea P e5256d91808b47c195bc9b4dbd7f2b87 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:17.766811 24048 consensus_queue.cc:1048] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P 127766fc592545a4997f7790f50f6076 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:06:17.772926 23928 leader_election.cc:290] T 6c5eebf646ad445a9d1b1adc319d7b16 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 12 election: Requested vote from peers e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
W20260709 13:06:17.774226 19523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.1:40321, user_credentials={real_user=slave}} blocked reactor thread for 104118us
I20260709 13:06:17.776161 24031 leader_election.cc:290] T 65d8cb8d6ec64f459d5a47cefab10acf P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:06:17.777136 23605 leader_election.cc:290] T 1a61655d99124a29b486ba4a5b37faea P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 10 election: Requested vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:06:17.778303 23878 leader_election.cc:290] T 2e36a9d6e29c4a7c860cf267efbd4c74 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:06:17.776467 19306 catalog_manager.cc:5697] T 62c6c134d3d24a1ab144dd9ee6bc3f64 P e61c3a8f61bb48f8a963c9480e53c168 reported cstate change: term changed from 8 to 10, leader changed from 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2) to e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3). New cstate: current_term: 10 leader_uuid: "e61c3a8f61bb48f8a963c9480e53c168" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:17.782250 19306 catalog_manager.cc:5697] T 40e1e16737a842ee936002830f36882e P e61c3a8f61bb48f8a963c9480e53c168 reported cstate change: term changed from 9 to 14, leader changed from e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1) to e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3). New cstate: current_term: 14 leader_uuid: "e61c3a8f61bb48f8a963c9480e53c168" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } health_report { overall_health: HEALTHY } } }
I20260709 13:06:17.783120 19523 leader_election.cc:400] T 4509b76741dc428e9201c70c1658da13 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 7 election: Vote denied by peer e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321) with higher term. Message: Invalid argument: T 4509b76741dc428e9201c70c1658da13 P e5256d91808b47c195bc9b4dbd7f2b87 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate e61c3a8f61bb48f8a963c9480e53c168 for earlier term 7. Current term is 8.
I20260709 13:06:17.784238 19523 leader_election.cc:304] T ece3db938bc649d4a40a51522ed5259c P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e61c3a8f61bb48f8a963c9480e53c168; no voters: 127766fc592545a4997f7790f50f6076, e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:06:17.785239 24089 raft_consensus.cc:2749] T ece3db938bc649d4a40a51522ed5259c P e61c3a8f61bb48f8a963c9480e53c168 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:06:17.786561 19523 leader_election.cc:304] T bc225c93219c45538b53a1bd3d387e4d P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e61c3a8f61bb48f8a963c9480e53c168; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:06:17.784197 19306 catalog_manager.cc:5697] T 2e36a9d6e29c4a7c860cf267efbd4c74 P e61c3a8f61bb48f8a963c9480e53c168 reported cstate change: term changed from 6 to 8, leader changed from e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1) to e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3). New cstate: current_term: 8 leader_uuid: "e61c3a8f61bb48f8a963c9480e53c168" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } health_report { overall_health: HEALTHY } } }
W20260709 13:06:17.786927 19308 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:44676 (request call id 222) took 20589 ms (client timeout 15000 ms). Trace:
W20260709 13:06:17.791980 24119 consensus_meta.cc:287] T fa8650e71aa14778b3d73721fc50d9fc P e61c3a8f61bb48f8a963c9480e53c168: Time spent flushing consensus metadata: real 0.613s	user 0.008s	sys 0.004s
I20260709 13:06:17.792388 24119 raft_consensus.cc:515] T fa8650e71aa14778b3d73721fc50d9fc P e61c3a8f61bb48f8a963c9480e53c168 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:17.789417 19306 catalog_manager.cc:5697] T ff75a1d4cb1f493db8f71ddc136ba9ab P e61c3a8f61bb48f8a963c9480e53c168 reported cstate change: term changed from 6 to 10. New cstate: current_term: 10 leader_uuid: "e61c3a8f61bb48f8a963c9480e53c168" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } health_report { overall_health: HEALTHY } } }
I20260709 13:06:17.795118 19306 catalog_manager.cc:5697] T e381f1d6b8184797ad142de49be225a8 P e61c3a8f61bb48f8a963c9480e53c168 reported cstate change: term changed from 5 to 8, leader changed from 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2) to e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3). New cstate: current_term: 8 leader_uuid: "e61c3a8f61bb48f8a963c9480e53c168" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } health_report { overall_health: HEALTHY } } }
I20260709 13:06:17.804612 23687 leader_election.cc:290] T ff9b0eddd810459b82d91c60777c10eb P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:06:17.808044 23974 leader_election.cc:290] T 14935b3ddf914369822e4a0547aaa355 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:06:17.819772 20110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65d8cb8d6ec64f459d5a47cefab10acf" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
W20260709 13:06:17.790069 19308 rpcz_store.cc:269] 0709 13:05:57.197830 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:57.198152 (+   322us) service_pool.cc:224] Handling call
0709 13:06:17.786690 (+20588538us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:06:10.435047 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:06:10.470549 (+ 35502us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:06:10.470601 (+    52us) write_op.cc:435] Acquired schema lock
0709 13:06:10.470628 (+    27us) tablet.cc:662] Decoding operations
0709 13:06:10.719673 (+249045us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:06:10.719748 (+    75us) write_op.cc:641] Partition lock acquired for write op
0709 13:06:10.719780 (+    32us) tablet.cc:685] Acquiring locks for 22 operations
0709 13:06:10.721414 (+  1634us) tablet.cc:701] Row locks acquired
0709 13:06:10.721434 (+    20us) write_op.cc:260] PREPARE: finished
0709 13:06:10.721588 (+   154us) write_op.cc:270] Start()
0709 13:06:10.721709 (+   121us) write_op.cc:276] Timestamp: P: 1783602370721534 usec, L: 0
0709 13:06:10.721732 (+    23us) op_driver.cc:348] REPLICATION: starting
0709 13:06:10.834876 (+113144us) log.cc:844] Serialized 8636 byte log entry
0709 13:06:11.482038 (+647162us) spinlock_profiling.cc:243] Waited 3.63 ms on lock 0x7b4400022b4c. stack: 00007f4a79de9343 00007f4a79de9240 00007f4a797781d4 00007f4a834b6304 00007f4a834b6299 00007f4a79ca3db1 00007f4a79d41c85 00007f4a79d426a2 00007f4a7cab41db 00007f4a7caafaaf 00007f4a79dfe0ac 00007f4a82c58ab9 00007f4a79e1a69b 00007f4a79e1893f 00007f4a79e1ac02 00007f4a7caa220b
0709 13:06:12.326779 (+844741us) op_driver.cc:464] REPLICATION: finished
0709 13:06:12.410502 (+ 83723us) write_op.cc:301] APPLY: starting
0709 13:06:12.410601 (+    99us) tablet.cc:1367] starting BulkCheckPresence
0709 13:06:12.465906 (+ 55305us) tablet.cc:1370] finished BulkCheckPresence
0709 13:06:12.465938 (+    32us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:06:12.731859 (+265921us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:06:12.732195 (+   336us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=44,key_file_lookups=44,delta_file_lookups=44,mrs_lookups=0
0709 13:06:12.732267 (+    72us) write_op.cc:312] APPLY: finished
0709 13:06:12.742481 (+ 10214us) log.cc:844] Serialized 196 byte log entry
0709 13:06:12.742652 (+   171us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:06:12.743191 (+   539us) write_op.cc:454] Released schema lock
0709 13:06:12.743260 (+    69us) write_op.cc:341] FINISH: Updating metrics
0709 13:06:12.743653 (+   393us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:06:12.743683 (+    30us) write_op.cc:454] Released schema lock
0709 13:06:12.867161 (+123478us) spinlock_profiling.cc:243] Waited 10.8 ms on lock 0x7b54003fb6d4. stack: 00007f4a79de9343 00007f4a79de9240 00007f4a797781d4 00007f4a834b6304 00007f4a834b6299 00007f4a7ce71571 00007f4a7cf0532a 00007f4a7ce8af14 00007f4a7ce8aec3 00007f4a7ce8ae38 00007f4a7ce8adf3 00007f4a7ce8a0dc 00007f4a7ceb3e16 00007f4a7ce9bcbb 00007f4a7ce8639d 00007f4a7ce89d75
Metrics: {"mutex_wait_us":44884,"reported_tablets":51,"child_traces":[["op",{"apply.queue_time_us":83473,"apply.run_cpu_time_us":34591,"apply.run_wall_time_us":333134,"cfile_cache_hit":86,"cfile_cache_hit_bytes":89870,"cfile_cache_miss":4,"cfile_cache_miss_bytes":6217,"cfile_init":2,"lbm_read_time_us":9098,"lbm_reads_1-10_ms":2,"lbm_reads_lt_1ms":10,"num_ops":22,"prepare.queue_time_us":252854,"prepare.run_cpu_time_us":27647,"prepare.run_wall_time_us":1442820,"raft.queue_time_us":98478,"raft.run_cpu_time_us":11956,"raft.run_wall_time_us":665930,"replication_time_us":1549388,"spinlock_wait_cycles":33147008,"thread_start_us":1369685,"threads_started":4,"wal-append.queue_time_us":1050963,"wal-append.run_cpu_time_us":15346,"wal-append.run_wall_time_us":1860587}]]}
I20260709 13:06:17.820536 20110 raft_consensus.cc:2468] T 65d8cb8d6ec64f459d5a47cefab10acf P 127766fc592545a4997f7790f50f6076 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 12.
I20260709 13:06:17.825461 19306 catalog_manager.cc:5697] T 96efeaaf1057492490e9a621f37e1a2d P e61c3a8f61bb48f8a963c9480e53c168 reported cstate change: term changed from 8 to 11, leader changed from 127766fc592545a4997f7790f50f6076 (127.17.223.4) to e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3). New cstate: current_term: 11 leader_uuid: "e61c3a8f61bb48f8a963c9480e53c168" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:17.837119 24041 leader_election.cc:290] T ff75a1d4cb1f493db8f71ddc136ba9ab P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:06:17.840291 24033 leader_election.cc:290] T 85c494af21f9457a85da47b9bc70c1fd P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
W20260709 13:06:17.840916 19375 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.3:36891, user_credentials={real_user=slave}} blocked reactor thread for 126943us
W20260709 13:06:17.841895 19449 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.1:40321, user_credentials={real_user=slave}} blocked reactor thread for 73631.4us
I20260709 13:06:17.842644 19449 leader_election.cc:304] T ef32ce6fdd0e40d382c79974f30295c6 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87; no voters: e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:06:17.843896 19449 leader_election.cc:304] T 21e14947d70440f19044d8f75c31e1f9 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87; no voters: e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:06:17.844664 24055 raft_consensus.cc:2804] T ef32ce6fdd0e40d382c79974f30295c6 P 0473d2b2d01f4459b1e90fd12cc7840e [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:06:17.845197 24055 raft_consensus.cc:697] T ef32ce6fdd0e40d382c79974f30295c6 P 0473d2b2d01f4459b1e90fd12cc7840e [term 15 LEADER]: Becoming Leader. State: Replica: 0473d2b2d01f4459b1e90fd12cc7840e, State: Running, Role: LEADER
I20260709 13:06:17.846064 24055 consensus_queue.cc:237] T ef32ce6fdd0e40d382c79974f30295c6 P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.8, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:17.846571 23928 raft_consensus.cc:2804] T 21e14947d70440f19044d8f75c31e1f9 P 0473d2b2d01f4459b1e90fd12cc7840e [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:06:17.847092 23928 raft_consensus.cc:697] T 21e14947d70440f19044d8f75c31e1f9 P 0473d2b2d01f4459b1e90fd12cc7840e [term 13 LEADER]: Becoming Leader. State: Replica: 0473d2b2d01f4459b1e90fd12cc7840e, State: Running, Role: LEADER
I20260709 13:06:17.848105 23928 consensus_queue.cc:237] T 21e14947d70440f19044d8f75c31e1f9 P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:17.850127 20110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff9b0eddd810459b82d91c60777c10eb" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:06:17.851121 20110 raft_consensus.cc:2393] T ff9b0eddd810459b82d91c60777c10eb P 127766fc592545a4997f7790f50f6076 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e5256d91808b47c195bc9b4dbd7f2b87 in current term 13: Already voted for candidate 127766fc592545a4997f7790f50f6076 in this term.
I20260709 13:06:17.861236 19375 leader_election.cc:304] T f93ee515a9c14139bf566522ed8232f3 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:06:17.833048 19306 catalog_manager.cc:5697] T 6c5eebf646ad445a9d1b1adc319d7b16 P e61c3a8f61bb48f8a963c9480e53c168 reported cstate change: term changed from 6 to 8. New cstate: current_term: 8 leader_uuid: "e61c3a8f61bb48f8a963c9480e53c168" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:06:17.868057 24089 raft_consensus.cc:2749] T bc225c93219c45538b53a1bd3d387e4d P e61c3a8f61bb48f8a963c9480e53c168 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:06:17.868695 20110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85c494af21f9457a85da47b9bc70c1fd" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:06:17.870427 19403 raft_consensus.cc:1275] T 775c229504194560ba9589bc2199b089 P e5256d91808b47c195bc9b4dbd7f2b87 [term 11 FOLLOWER]: Refusing update from remote peer 127766fc592545a4997f7790f50f6076: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:06:17.872996 19306 catalog_manager.cc:5697] T 1efebf73c86e432baa55533136b6e12c P e61c3a8f61bb48f8a963c9480e53c168 reported cstate change: term changed from 5 to 9, leader changed from 127766fc592545a4997f7790f50f6076 (127.17.223.4) to e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3). New cstate: current_term: 9 leader_uuid: "e61c3a8f61bb48f8a963c9480e53c168" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 13:06:17.882280 19377 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:17.891119 19523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.1:40321, user_credentials={real_user=slave}} blocked reactor thread for 104627us
I20260709 13:06:17.798555 24046 raft_consensus.cc:2749] T 2725d2c4cb054f18b0fc8f735c15f6c2 P 0473d2b2d01f4459b1e90fd12cc7840e [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:06:17.911633 24119 leader_election.cc:290] T fa8650e71aa14778b3d73721fc50d9fc P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 12 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:06:17.922245 23795 raft_consensus.cc:493] T ed7fdbcb96d14d418db9ca90a792588a P 0473d2b2d01f4459b1e90fd12cc7840e [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 127766fc592545a4997f7790f50f6076)
W20260709 13:06:17.923650 19375 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.3:36891, user_credentials={real_user=slave}} blocked reactor thread for 82061.5us
I20260709 13:06:17.736006 23919 raft_consensus.cc:3055] T d1e5873a19244c5ebbcd38e126796ee7 P e5256d91808b47c195bc9b4dbd7f2b87 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:06:17.855814 19374 leader_election.cc:304] T 65d8cb8d6ec64f459d5a47cefab10acf P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 127766fc592545a4997f7790f50f6076, e5256d91808b47c195bc9b4dbd7f2b87; no voters: 
I20260709 13:06:17.927235 23605 raft_consensus.cc:2749] T f93ee515a9c14139bf566522ed8232f3 P e5256d91808b47c195bc9b4dbd7f2b87 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 13:06:17.933518 19452 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:17.937973 19450 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.3:36891, user_credentials={real_user=slave}} blocked reactor thread for 273367us
I20260709 13:06:17.937554 23740 raft_consensus.cc:697] T 217b5fae677b4971b3bbd2f357a1f7ff P 0473d2b2d01f4459b1e90fd12cc7840e [term 10 LEADER]: Becoming Leader. State: Replica: 0473d2b2d01f4459b1e90fd12cc7840e, State: Running, Role: LEADER
I20260709 13:06:17.964632 24046 consensus_queue.cc:1048] T 0cdf56e38bbc453d9438d359e5a69955 P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:06:17.965219 23740 consensus_queue.cc:237] T 217b5fae677b4971b3bbd2f357a1f7ff P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
W20260709 13:06:17.970000 19374 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.4:43121, user_credentials={real_user=slave}} blocked reactor thread for 114287us
I20260709 13:06:17.971246 19375 leader_election.cc:304] T fa8650e71aa14778b3d73721fc50d9fc P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:06:17.974468 19482 raft_consensus.cc:1240] T 2725d2c4cb054f18b0fc8f735c15f6c2 P 0473d2b2d01f4459b1e90fd12cc7840e [term 15 FOLLOWER]: Rejecting Update request from peer e5256d91808b47c195bc9b4dbd7f2b87 for earlier term 14. Current term is 15. Ops: []
W20260709 13:06:17.980424 19449 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.1:40321, user_credentials={real_user=slave}} blocked reactor thread for 50916.5us
I20260709 13:06:17.959945 23919 raft_consensus.cc:740] T d1e5873a19244c5ebbcd38e126796ee7 P e5256d91808b47c195bc9b4dbd7f2b87 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: e5256d91808b47c195bc9b4dbd7f2b87, State: Running, Role: LEADER
I20260709 13:06:17.977396 23687 raft_consensus.cc:2804] T 65d8cb8d6ec64f459d5a47cefab10acf P e5256d91808b47c195bc9b4dbd7f2b87 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:06:17.956614 24024 raft_consensus.cc:515] T 179fd671030940b4b4a4e24bcc4aba0a P 0473d2b2d01f4459b1e90fd12cc7840e [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:17.980324 24119 raft_consensus.cc:493] T df751f992649444090e27965eb1af85d P e61c3a8f61bb48f8a963c9480e53c168 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:18.003185 19306 catalog_manager.cc:5697] T edd7d470b5014c9489be7f41f64355c9 P e61c3a8f61bb48f8a963c9480e53c168 reported cstate change: term changed from 8 to 11, leader changed from 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2) to e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3). New cstate: current_term: 11 leader_uuid: "e61c3a8f61bb48f8a963c9480e53c168" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } health_report { overall_health: HEALTHY } } }
I20260709 13:06:17.960880 23933 raft_consensus.cc:515] T 28af091831594f9d8e96482078cc7625 P 0473d2b2d01f4459b1e90fd12cc7840e [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:18.007517 19306 catalog_manager.cc:5697] T a08760e15aac4630a629431f56024dc8 P e61c3a8f61bb48f8a963c9480e53c168 reported cstate change: term changed from 5 to 11, leader changed from e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1) to e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3). New cstate: current_term: 11 leader_uuid: "e61c3a8f61bb48f8a963c9480e53c168" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } health_report { overall_health: HEALTHY } } }
I20260709 13:06:18.009737 19306 catalog_manager.cc:5697] T 2b74109013a140ada21feeef92d6f563 P e61c3a8f61bb48f8a963c9480e53c168 reported cstate change: term changed from 5 to 6, leader changed from e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1) to e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3). New cstate: current_term: 6 leader_uuid: "e61c3a8f61bb48f8a963c9480e53c168" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } health_report { overall_health: HEALTHY } } }
I20260709 13:06:18.010980 19523 leader_election.cc:304] T 70797e5783b5454ab0d0eea663e791e3 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e61c3a8f61bb48f8a963c9480e53c168; no voters: 127766fc592545a4997f7790f50f6076, e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:06:17.985977 23880 raft_consensus.cc:2749] T fa8650e71aa14778b3d73721fc50d9fc P e5256d91808b47c195bc9b4dbd7f2b87 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:06:18.013091 19375 leader_election.cc:304] T 2b74109013a140ada21feeef92d6f563 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:06:17.995288 23687 raft_consensus.cc:493] T 65d8cb8d6ec64f459d5a47cefab10acf P e5256d91808b47c195bc9b4dbd7f2b87 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:18.008872 18300 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:06:17.981194 23795 raft_consensus.cc:515] T ed7fdbcb96d14d418db9ca90a792588a P 0473d2b2d01f4459b1e90fd12cc7840e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:18.021700 19306 catalog_manager.cc:5697] T 48824d5acfbc485ebf8c2d944e7202de P e61c3a8f61bb48f8a963c9480e53c168 reported cstate change: term changed from 8 to 10, leader changed from 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2) to e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3). New cstate: current_term: 10 leader_uuid: "e61c3a8f61bb48f8a963c9480e53c168" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:18.019289 23687 raft_consensus.cc:3060] T 65d8cb8d6ec64f459d5a47cefab10acf P e5256d91808b47c195bc9b4dbd7f2b87 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:06:18.024644 24089 raft_consensus.cc:2749] T 70797e5783b5454ab0d0eea663e791e3 P e61c3a8f61bb48f8a963c9480e53c168 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:06:18.018375 24147 consensus_queue.cc:1048] T 2b74109013a140ada21feeef92d6f563 P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.019s
I20260709 13:06:18.007966 24119 raft_consensus.cc:515] T df751f992649444090e27965eb1af85d P e61c3a8f61bb48f8a963c9480e53c168 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:18.037829 24119 leader_election.cc:290] T df751f992649444090e27965eb1af85d P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:06:17.983862 24048 consensus_queue.cc:1048] T 775c229504194560ba9589bc2199b089 P 127766fc592545a4997f7790f50f6076 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.042s
I20260709 13:06:18.032498 19306 catalog_manager.cc:5697] T 179fd671030940b4b4a4e24bcc4aba0a P e61c3a8f61bb48f8a963c9480e53c168 reported cstate change: term changed from 8 to 9, leader changed from 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2) to e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3). New cstate: current_term: 9 leader_uuid: "e61c3a8f61bb48f8a963c9480e53c168" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } health_report { overall_health: HEALTHY } } }
I20260709 13:06:18.046756 23928 raft_consensus.cc:493] T 0e1085d23e8347fbbd5bce7542f4b1f4 P 0473d2b2d01f4459b1e90fd12cc7840e [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:18.047374 23928 raft_consensus.cc:515] T 0e1085d23e8347fbbd5bce7542f4b1f4 P 0473d2b2d01f4459b1e90fd12cc7840e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:18.049479 23928 leader_election.cc:290] T 0e1085d23e8347fbbd5bce7542f4b1f4 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:06:18.043215 24136 raft_consensus.cc:515] T 1efebf73c86e432baa55533136b6e12c P 127766fc592545a4997f7790f50f6076 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:18.051789 24136 leader_election.cc:290] T 1efebf73c86e432baa55533136b6e12c P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 12 election: Requested vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:06:18.029983 24033 raft_consensus.cc:3060] T 2b74109013a140ada21feeef92d6f563 P e5256d91808b47c195bc9b4dbd7f2b87 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:06:18.044574 19449 leader_election.cc:304] T 9962423cb4e54fcfa5de01daf68a86e7 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e; no voters: 127766fc592545a4997f7790f50f6076, e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:06:18.057190 19523 leader_election.cc:304] T 0cdf56e38bbc453d9438d359e5a69955 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e61c3a8f61bb48f8a963c9480e53c168; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87
W20260709 13:06:18.059015 19450 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.3:36891, user_credentials={real_user=slave}} blocked reactor thread for 86778.6us
I20260709 13:06:18.062346 19375 leader_election.cc:304] T bc225c93219c45538b53a1bd3d387e4d P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:06:18.062713 20078 leader_election.cc:304] T ab43d85f64114d4ebf618930e43d9ed0 P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, 127766fc592545a4997f7790f50f6076, e5256d91808b47c195bc9b4dbd7f2b87; no voters: 
I20260709 13:06:18.073119 24148 raft_consensus.cc:2749] T 9962423cb4e54fcfa5de01daf68a86e7 P 0473d2b2d01f4459b1e90fd12cc7840e [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:06:18.073684 23878 raft_consensus.cc:493] T 7be9efa6559648dbb5a0f7684c4542d1 P e5256d91808b47c195bc9b4dbd7f2b87 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 0473d2b2d01f4459b1e90fd12cc7840e)
I20260709 13:06:18.055739 23919 consensus_queue.cc:260] T d1e5873a19244c5ebbcd38e126796ee7 P e5256d91808b47c195bc9b4dbd7f2b87 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:18.074283 23878 raft_consensus.cc:515] T 7be9efa6559648dbb5a0f7684c4542d1 P e5256d91808b47c195bc9b4dbd7f2b87 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } attrs { replace: true } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:18.075489 23687 raft_consensus.cc:515] T 65d8cb8d6ec64f459d5a47cefab10acf P e5256d91808b47c195bc9b4dbd7f2b87 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:18.066987 23918 raft_consensus.cc:2749] T bc225c93219c45538b53a1bd3d387e4d P e5256d91808b47c195bc9b4dbd7f2b87 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:06:18.061563 24119 raft_consensus.cc:2749] T 0cdf56e38bbc453d9438d359e5a69955 P e61c3a8f61bb48f8a963c9480e53c168 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:06:18.065600 24136 raft_consensus.cc:2804] T ab43d85f64114d4ebf618930e43d9ed0 P 127766fc592545a4997f7790f50f6076 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:06:18.088081 19377 leader_election.cc:304] T edd7d470b5014c9489be7f41f64355c9 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87; no voters: 
I20260709 13:06:18.089893 19377 leader_election.cc:304] T 5ec1c4ce15e04c7e8c283a62179f2a64 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, 127766fc592545a4997f7790f50f6076
I20260709 13:06:18.092350 20110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7be9efa6559648dbb5a0f7684c4542d1" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
W20260709 13:06:18.104682 19523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.1:40321, user_credentials={real_user=slave}} blocked reactor thread for 47586us
I20260709 13:06:18.105738 19375 leader_election.cc:304] T b9f0d59553ad444883fcf5b5909f9798 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:06:18.106168 20105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65d8cb8d6ec64f459d5a47cefab10acf" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076"
I20260709 13:06:18.108253 20105 raft_consensus.cc:3060] T 65d8cb8d6ec64f459d5a47cefab10acf P 127766fc592545a4997f7790f50f6076 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:06:18.092135 19449 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.1:40321, user_credentials={real_user=slave}} blocked reactor thread for 47634.1us
I20260709 13:06:18.091892 23918 raft_consensus.cc:2804] T edd7d470b5014c9489be7f41f64355c9 P e5256d91808b47c195bc9b4dbd7f2b87 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:06:18.110878 19555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48824d5acfbc485ebf8c2d944e7202de" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:06:18.111562 19556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "833a2f0775ed407a94b8924ce50adb63" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:06:18.111975 23795 leader_election.cc:290] T ed7fdbcb96d14d418db9ca90a792588a P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:06:18.143488 20078 leader_election.cc:400] T 6c5eebf646ad445a9d1b1adc319d7b16 P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 11 pre-election: Vote denied by peer 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257) with higher term. Message: Invalid argument: T 6c5eebf646ad445a9d1b1adc319d7b16 P 0473d2b2d01f4459b1e90fd12cc7840e [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 127766fc592545a4997f7790f50f6076 for earlier term 11. Current term is 12.
I20260709 13:06:18.143890 20078 leader_election.cc:403] T 6c5eebf646ad445a9d1b1adc319d7b16 P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 11 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:06:18.112949 23687 leader_election.cc:290] T 65d8cb8d6ec64f459d5a47cefab10acf P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 13 election: Requested vote from peers e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:06:18.113101 19558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ece3db938bc649d4a40a51522ed5259c" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:06:18.113449 24024 leader_election.cc:290] T 179fd671030940b4b4a4e24bcc4aba0a P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 14 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:06:18.114712 23933 leader_election.cc:290] T 28af091831594f9d8e96482078cc7625 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 14 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:06:18.091092 23919 raft_consensus.cc:3060] T d1e5873a19244c5ebbcd38e126796ee7 P e5256d91808b47c195bc9b4dbd7f2b87 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:06:18.118986 23878 leader_election.cc:290] T 7be9efa6559648dbb5a0f7684c4542d1 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:06:18.119328 19554 raft_consensus.cc:1240] T 48824d5acfbc485ebf8c2d944e7202de P e61c3a8f61bb48f8a963c9480e53c168 [term 14 FOLLOWER]: Rejecting Update request from peer 127766fc592545a4997f7790f50f6076 for earlier term 13. Current term is 14. Ops: []
I20260709 13:06:18.125226 24033 raft_consensus.cc:2749] T 2b74109013a140ada21feeef92d6f563 P e5256d91808b47c195bc9b4dbd7f2b87 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:06:18.126718 24031 raft_consensus.cc:2749] T 5ec1c4ce15e04c7e8c283a62179f2a64 P e5256d91808b47c195bc9b4dbd7f2b87 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:06:18.127108 23605 consensus_queue.cc:1059] T 1dc5b3532fe54f74876d02beffa2c230 P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 }, Status: INVALID_TERM, Last received: 12.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:06:18.087417 24136 raft_consensus.cc:493] T ab43d85f64114d4ebf618930e43d9ed0 P 127766fc592545a4997f7790f50f6076 [term 13 FOLLOWER]: Starting leader election (detected failure of leader e61c3a8f61bb48f8a963c9480e53c168)
I20260709 13:06:18.181255 24136 raft_consensus.cc:3060] T ab43d85f64114d4ebf618930e43d9ed0 P 127766fc592545a4997f7790f50f6076 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:06:18.112493 19557 raft_consensus.cc:1275] T 85c494af21f9457a85da47b9bc70c1fd P e61c3a8f61bb48f8a963c9480e53c168 [term 10 FOLLOWER]: Refusing update from remote peer 127766fc592545a4997f7790f50f6076: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 13:06:18.161041 19482 raft_consensus.cc:1275] T 46c5bfeecc314717bffe987e6844b6d0 P 0473d2b2d01f4459b1e90fd12cc7840e [term 18 FOLLOWER]: Refusing update from remote peer e5256d91808b47c195bc9b4dbd7f2b87: Log matching property violated. Preceding OpId in replica: term: 16 index: 7. Preceding OpId from leader: term: 18 index: 8. (index mismatch)
I20260709 13:06:18.161203 19481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a61655d99124a29b486ba4a5b37faea" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:06:18.183274 23795 raft_consensus.cc:493] T 14935b3ddf914369822e4a0547aaa355 P 0473d2b2d01f4459b1e90fd12cc7840e [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 127766fc592545a4997f7790f50f6076)
I20260709 13:06:18.161885 19553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c5eebf646ad445a9d1b1adc319d7b16" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:06:18.183435 19481 raft_consensus.cc:3060] T 1a61655d99124a29b486ba4a5b37faea P 0473d2b2d01f4459b1e90fd12cc7840e [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:06:18.183931 19553 raft_consensus.cc:3060] T 6c5eebf646ad445a9d1b1adc319d7b16 P e61c3a8f61bb48f8a963c9480e53c168 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:06:18.183887 23795 raft_consensus.cc:515] T 14935b3ddf914369822e4a0547aaa355 P 0473d2b2d01f4459b1e90fd12cc7840e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } attrs { replace: true } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:18.165575 20105 raft_consensus.cc:2468] T 65d8cb8d6ec64f459d5a47cefab10acf P 127766fc592545a4997f7790f50f6076 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 13.
I20260709 13:06:18.153906 24141 raft_consensus.cc:3060] T 6c5eebf646ad445a9d1b1adc319d7b16 P 127766fc592545a4997f7790f50f6076 [term 10 FOLLOWER]: Advancing to term 12
I20260709 13:06:18.142982 23918 raft_consensus.cc:493] T edd7d470b5014c9489be7f41f64355c9 P e5256d91808b47c195bc9b4dbd7f2b87 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:18.188843 23918 raft_consensus.cc:3060] T edd7d470b5014c9489be7f41f64355c9 P e5256d91808b47c195bc9b4dbd7f2b87 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:06:18.190299 19481 raft_consensus.cc:2468] T 1a61655d99124a29b486ba4a5b37faea P 0473d2b2d01f4459b1e90fd12cc7840e [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 10.
I20260709 13:06:18.191011 19553 raft_consensus.cc:2468] T 6c5eebf646ad445a9d1b1adc319d7b16 P e61c3a8f61bb48f8a963c9480e53c168 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 12.
I20260709 13:06:18.194732 24141 raft_consensus.cc:2749] T 6c5eebf646ad445a9d1b1adc319d7b16 P 127766fc592545a4997f7790f50f6076 [term 12 FOLLOWER]: Leader pre-election lost for term 11. Reason: Vote denied by peer 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257) with higher term. Message: Invalid argument: T 6c5eebf646ad445a9d1b1adc319d7b16 P 0473d2b2d01f4459b1e90fd12cc7840e [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 127766fc592545a4997f7790f50f6076 for earlier term 11. Current term is 12.
I20260709 13:06:18.198329 24136 raft_consensus.cc:515] T ab43d85f64114d4ebf618930e43d9ed0 P 127766fc592545a4997f7790f50f6076 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } attrs { replace: true } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:18.198976 19558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff75a1d4cb1f493db8f71ddc136ba9ab" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:06:18.199736 19558 raft_consensus.cc:2393] T ff75a1d4cb1f493db8f71ddc136ba9ab P e61c3a8f61bb48f8a963c9480e53c168 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0473d2b2d01f4459b1e90fd12cc7840e in current term 12: Already voted for candidate e61c3a8f61bb48f8a963c9480e53c168 in this term.
I20260709 13:06:18.171541 19484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff9b0eddd810459b82d91c60777c10eb" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:06:18.172547 19479 raft_consensus.cc:1275] T 7f575b143b844aa096b50997dad3516a P 0473d2b2d01f4459b1e90fd12cc7840e [term 10 FOLLOWER]: Refusing update from remote peer e5256d91808b47c195bc9b4dbd7f2b87: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 13:06:18.175139 19551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1efebf73c86e432baa55533136b6e12c" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:06:18.161885 19480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e36a9d6e29c4a7c860cf267efbd4c74" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:06:18.202067 19480 raft_consensus.cc:2468] T 2e36a9d6e29c4a7c860cf267efbd4c74 P 0473d2b2d01f4459b1e90fd12cc7840e [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 10.
I20260709 13:06:18.210747 19479 raft_consensus.cc:1275] T 4509b76741dc428e9201c70c1658da13 P 0473d2b2d01f4459b1e90fd12cc7840e [term 8 FOLLOWER]: Refusing update from remote peer e5256d91808b47c195bc9b4dbd7f2b87: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
W20260709 13:06:18.212217 19375 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.3:36891, user_credentials={real_user=slave}} blocked reactor thread for 51756us
I20260709 13:06:18.155130 23880 raft_consensus.cc:2749] T b9f0d59553ad444883fcf5b5909f9798 P e5256d91808b47c195bc9b4dbd7f2b87 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:06:18.227680 19480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7be9efa6559648dbb5a0f7684c4542d1" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:06:18.224929 19557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e1085d23e8347fbbd5bce7542f4b1f4" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:06:18.229964 19557 raft_consensus.cc:2468] T 0e1085d23e8347fbbd5bce7542f4b1f4 P e61c3a8f61bb48f8a963c9480e53c168 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 9.
I20260709 13:06:18.203655 23795 leader_election.cc:290] T 14935b3ddf914369822e4a0547aaa355 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
W20260709 13:06:18.235225 20076 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.3:36891, user_credentials={real_user=slave}} blocked reactor thread for 120561us
I20260709 13:06:18.237159 19449 leader_election.cc:304] T 46c5bfeecc314717bffe987e6844b6d0 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e; no voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:06:18.238018 23928 raft_consensus.cc:2749] T 46c5bfeecc314717bffe987e6844b6d0 P 0473d2b2d01f4459b1e90fd12cc7840e [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:06:18.238543 19449 leader_election.cc:304] T 1a61655d99124a29b486ba4a5b37faea P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e; no voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:06:18.240341 19449 leader_election.cc:304] T 62c6c134d3d24a1ab144dd9ee6bc3f64 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, 127766fc592545a4997f7790f50f6076; no voters: e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:06:18.247855 19557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab43d85f64114d4ebf618930e43d9ed0" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:06:18.227927 24089 raft_consensus.cc:493] T 65d8cb8d6ec64f459d5a47cefab10acf P e61c3a8f61bb48f8a963c9480e53c168 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader e5256d91808b47c195bc9b4dbd7f2b87)
I20260709 13:06:18.255285 19486 raft_consensus.cc:1275] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P 0473d2b2d01f4459b1e90fd12cc7840e [term 14 FOLLOWER]: Refusing update from remote peer 127766fc592545a4997f7790f50f6076: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 13:06:18.244081 24024 raft_consensus.cc:2749] T 1a61655d99124a29b486ba4a5b37faea P 0473d2b2d01f4459b1e90fd12cc7840e [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:06:18.261547 19557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c5eebf646ad445a9d1b1adc319d7b16" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:06:18.262410 19481 raft_consensus.cc:1275] T 775c229504194560ba9589bc2199b089 P 0473d2b2d01f4459b1e90fd12cc7840e [term 11 FOLLOWER]: Refusing update from remote peer 127766fc592545a4997f7790f50f6076: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:06:18.265111 19557 raft_consensus.cc:2368] T 6c5eebf646ad445a9d1b1adc319d7b16 P e61c3a8f61bb48f8a963c9480e53c168 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 127766fc592545a4997f7790f50f6076 for earlier term 11. Current term is 12.
I20260709 13:06:18.257880 23795 raft_consensus.cc:2804] T 62c6c134d3d24a1ab144dd9ee6bc3f64 P 0473d2b2d01f4459b1e90fd12cc7840e [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:06:18.260507 24089 raft_consensus.cc:515] T 65d8cb8d6ec64f459d5a47cefab10acf P e61c3a8f61bb48f8a963c9480e53c168 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:18.272966 23918 raft_consensus.cc:515] T edd7d470b5014c9489be7f41f64355c9 P e5256d91808b47c195bc9b4dbd7f2b87 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:18.276029 23883 raft_consensus.cc:3055] T 1dc5b3532fe54f74876d02beffa2c230 P e5256d91808b47c195bc9b4dbd7f2b87 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:06:18.276438 23883 raft_consensus.cc:740] T 1dc5b3532fe54f74876d02beffa2c230 P e5256d91808b47c195bc9b4dbd7f2b87 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: e5256d91808b47c195bc9b4dbd7f2b87, State: Running, Role: LEADER
I20260709 13:06:18.277204 23883 consensus_queue.cc:260] T 1dc5b3532fe54f74876d02beffa2c230 P e5256d91808b47c195bc9b4dbd7f2b87 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.6, Last appended by leader: 6, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:18.279047 23795 raft_consensus.cc:697] T 62c6c134d3d24a1ab144dd9ee6bc3f64 P 0473d2b2d01f4459b1e90fd12cc7840e [term 12 LEADER]: Becoming Leader. State: Replica: 0473d2b2d01f4459b1e90fd12cc7840e, State: Running, Role: LEADER
I20260709 13:06:18.279384 23918 leader_election.cc:290] T edd7d470b5014c9489be7f41f64355c9 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 14 election: Requested vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:06:18.280009 23795 consensus_queue.cc:237] T 62c6c134d3d24a1ab144dd9ee6bc3f64 P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:18.280478 19486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1efebf73c86e432baa55533136b6e12c" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:06:18.281070 19486 raft_consensus.cc:3060] T 1efebf73c86e432baa55533136b6e12c P 0473d2b2d01f4459b1e90fd12cc7840e [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:06:18.284283 20076 leader_election.cc:304] T ece3db938bc649d4a40a51522ed5259c P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 127766fc592545a4997f7790f50f6076; no voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:06:18.288067 24127 raft_consensus.cc:2749] T ece3db938bc649d4a40a51522ed5259c P 127766fc592545a4997f7790f50f6076 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:06:18.290737 23933 consensus_queue.cc:1059] T ff9b0eddd810459b82d91c60777c10eb P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false }, Status: INVALID_TERM, Last received: 12.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:06:18.292718 19377 leader_election.cc:304] T 1a61655d99124a29b486ba4a5b37faea P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87; no voters: 
I20260709 13:06:18.294167 19377 leader_election.cc:304] T 2e36a9d6e29c4a7c860cf267efbd4c74 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87; no voters: 
I20260709 13:06:18.291636 23740 raft_consensus.cc:3055] T ff9b0eddd810459b82d91c60777c10eb P 0473d2b2d01f4459b1e90fd12cc7840e [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:06:18.296936 23740 raft_consensus.cc:740] T ff9b0eddd810459b82d91c60777c10eb P 0473d2b2d01f4459b1e90fd12cc7840e [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 0473d2b2d01f4459b1e90fd12cc7840e, State: Running, Role: LEADER
I20260709 13:06:18.297896 23605 consensus_queue.cc:1048] T 7f575b143b844aa096b50997dad3516a P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:06:18.297868 23740 consensus_queue.cc:260] T ff9b0eddd810459b82d91c60777c10eb P 0473d2b2d01f4459b1e90fd12cc7840e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:18.298863 24033 raft_consensus.cc:2804] T 2e36a9d6e29c4a7c860cf267efbd4c74 P e5256d91808b47c195bc9b4dbd7f2b87 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:06:18.299165 23740 raft_consensus.cc:3060] T ff9b0eddd810459b82d91c60777c10eb P 0473d2b2d01f4459b1e90fd12cc7840e [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:06:18.299309 24033 raft_consensus.cc:493] T 2e36a9d6e29c4a7c860cf267efbd4c74 P e5256d91808b47c195bc9b4dbd7f2b87 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:18.299687 24033 raft_consensus.cc:3060] T 2e36a9d6e29c4a7c860cf267efbd4c74 P e5256d91808b47c195bc9b4dbd7f2b87 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:06:18.300001 19556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65d8cb8d6ec64f459d5a47cefab10acf" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:06:18.300582 19556 raft_consensus.cc:2468] T 65d8cb8d6ec64f459d5a47cefab10acf P e61c3a8f61bb48f8a963c9480e53c168 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 11.
I20260709 13:06:18.301566 19556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7be9efa6559648dbb5a0f7684c4542d1" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:06:18.301748 19486 raft_consensus.cc:2468] T 1efebf73c86e432baa55533136b6e12c P 0473d2b2d01f4459b1e90fd12cc7840e [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 127766fc592545a4997f7790f50f6076 in term 12.
I20260709 13:06:18.302986 19551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a61655d99124a29b486ba4a5b37faea" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:06:18.303639 24061 consensus_queue.cc:1048] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P 127766fc592545a4997f7790f50f6076 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:06:18.304198 19559 raft_consensus.cc:1275] T 7f575b143b844aa096b50997dad3516a P e61c3a8f61bb48f8a963c9480e53c168 [term 10 FOLLOWER]: Refusing update from remote peer e5256d91808b47c195bc9b4dbd7f2b87: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 13:06:18.304340 19555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e36a9d6e29c4a7c860cf267efbd4c74" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:06:18.305060 23880 raft_consensus.cc:2804] T 1a61655d99124a29b486ba4a5b37faea P e5256d91808b47c195bc9b4dbd7f2b87 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:06:18.305574 19553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85c494af21f9457a85da47b9bc70c1fd" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:06:18.306201 19553 raft_consensus.cc:2468] T 85c494af21f9457a85da47b9bc70c1fd P e61c3a8f61bb48f8a963c9480e53c168 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 10.
I20260709 13:06:18.303671 20110 raft_consensus.cc:1240] T ab43d85f64114d4ebf618930e43d9ed0 P 127766fc592545a4997f7790f50f6076 [term 14 FOLLOWER]: Rejecting Update request from peer e61c3a8f61bb48f8a963c9480e53c168 for earlier term 13. Current term is 14. Ops: []
I20260709 13:06:18.307297 19554 raft_consensus.cc:3055] T 4509b76741dc428e9201c70c1658da13 P e61c3a8f61bb48f8a963c9480e53c168 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:06:18.307636 19554 raft_consensus.cc:740] T 4509b76741dc428e9201c70c1658da13 P e61c3a8f61bb48f8a963c9480e53c168 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: e61c3a8f61bb48f8a963c9480e53c168, State: Running, Role: LEADER
I20260709 13:06:18.308349 19554 consensus_queue.cc:260] T 4509b76741dc428e9201c70c1658da13 P e61c3a8f61bb48f8a963c9480e53c168 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:18.309355 19554 raft_consensus.cc:3060] T 4509b76741dc428e9201c70c1658da13 P e61c3a8f61bb48f8a963c9480e53c168 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:06:18.311359 19406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab43d85f64114d4ebf618930e43d9ed0" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
I20260709 13:06:18.311928 19406 raft_consensus.cc:3060] T ab43d85f64114d4ebf618930e43d9ed0 P e5256d91808b47c195bc9b4dbd7f2b87 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:06:18.302593 19556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65d8cb8d6ec64f459d5a47cefab10acf" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:06:18.302856 23687 consensus_queue.cc:1048] T 4509b76741dc428e9201c70c1658da13 P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:06:18.312474 19560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed7fdbcb96d14d418db9ca90a792588a" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:06:18.314540 19374 leader_election.cc:304] T 65d8cb8d6ec64f459d5a47cefab10acf P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 127766fc592545a4997f7790f50f6076, e5256d91808b47c195bc9b4dbd7f2b87; no voters: 
I20260709 13:06:18.313166 19556 raft_consensus.cc:3060] T 65d8cb8d6ec64f459d5a47cefab10acf P e61c3a8f61bb48f8a963c9480e53c168 [term 11 FOLLOWER]: Advancing to term 13
I20260709 13:06:18.302924 20105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85c494af21f9457a85da47b9bc70c1fd" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:06:18.316776 19450 leader_election.cc:304] T 6c5eebf646ad445a9d1b1adc319d7b16 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:06:18.314913 19377 leader_election.cc:304] T ff9b0eddd810459b82d91c60777c10eb P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, 127766fc592545a4997f7790f50f6076
I20260709 13:06:18.278522 23883 raft_consensus.cc:3060] T 1dc5b3532fe54f74876d02beffa2c230 P e5256d91808b47c195bc9b4dbd7f2b87 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:06:18.312064 19523 connection.cc:256] RPC call timeout handler was delayed by -1.578572468999937s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1674s for a response
I20260709 13:06:18.326617 19555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "179fd671030940b4b4a4e24bcc4aba0a" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
W20260709 13:06:18.327049 19523 connection.cc:256] RPC call timeout handler was delayed by -1.1346223769999142s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1986s for a response
I20260709 13:06:18.328327 19551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28af091831594f9d8e96482078cc7625" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:06:18.328985 19551 raft_consensus.cc:3060] T 28af091831594f9d8e96482078cc7625 P e61c3a8f61bb48f8a963c9480e53c168 [term 12 FOLLOWER]: Advancing to term 14
I20260709 13:06:18.311156 23918 consensus_queue.cc:1048] T 46c5bfeecc314717bffe987e6844b6d0 P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.019s
I20260709 13:06:18.318893 24029 raft_consensus.cc:493] T 28af091831594f9d8e96482078cc7625 P e5256d91808b47c195bc9b4dbd7f2b87 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:18.332049 24029 raft_consensus.cc:515] T 28af091831594f9d8e96482078cc7625 P e5256d91808b47c195bc9b4dbd7f2b87 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:18.332559 20106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed7fdbcb96d14d418db9ca90a792588a" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:06:18.333541 24089 leader_election.cc:290] T 65d8cb8d6ec64f459d5a47cefab10acf P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:06:18.305567 23880 raft_consensus.cc:697] T 1a61655d99124a29b486ba4a5b37faea P e5256d91808b47c195bc9b4dbd7f2b87 [term 10 LEADER]: Becoming Leader. State: Replica: e5256d91808b47c195bc9b4dbd7f2b87, State: Running, Role: LEADER
I20260709 13:06:18.333984 20104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14935b3ddf914369822e4a0547aaa355" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:06:18.326217 24031 raft_consensus.cc:493] T 179fd671030940b4b4a4e24bcc4aba0a P e5256d91808b47c195bc9b4dbd7f2b87 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader e61c3a8f61bb48f8a963c9480e53c168)
I20260709 13:06:18.335031 19407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28af091831594f9d8e96482078cc7625" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:06:18.334789 23880 consensus_queue.cc:237] T 1a61655d99124a29b486ba4a5b37faea P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:18.335325 24031 raft_consensus.cc:515] T 179fd671030940b4b4a4e24bcc4aba0a P e5256d91808b47c195bc9b4dbd7f2b87 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:18.337584 24031 leader_election.cc:290] T 179fd671030940b4b4a4e24bcc4aba0a P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:06:18.340193 19404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df751f992649444090e27965eb1af85d" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:06:18.341017 19404 raft_consensus.cc:2393] T df751f992649444090e27965eb1af85d P e5256d91808b47c195bc9b4dbd7f2b87 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0473d2b2d01f4459b1e90fd12cc7840e in current term 15: Already voted for candidate e5256d91808b47c195bc9b4dbd7f2b87 in this term.
I20260709 13:06:18.335625 19407 raft_consensus.cc:2468] T 28af091831594f9d8e96482078cc7625 P e5256d91808b47c195bc9b4dbd7f2b87 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 13.
I20260709 13:06:18.342011 19404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff75a1d4cb1f493db8f71ddc136ba9ab" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:06:18.343025 19410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "217b5fae677b4971b3bbd2f357a1f7ff" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
I20260709 13:06:18.343235 20112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96efeaaf1057492490e9a621f37e1a2d" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:06:18.343827 20112 raft_consensus.cc:2468] T 96efeaaf1057492490e9a621f37e1a2d P 127766fc592545a4997f7790f50f6076 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 13.
I20260709 13:06:18.325065 24024 raft_consensus.cc:2804] T 6c5eebf646ad445a9d1b1adc319d7b16 P 0473d2b2d01f4459b1e90fd12cc7840e [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:06:18.344561 24024 raft_consensus.cc:697] T 6c5eebf646ad445a9d1b1adc319d7b16 P 0473d2b2d01f4459b1e90fd12cc7840e [term 12 LEADER]: Becoming Leader. State: Replica: 0473d2b2d01f4459b1e90fd12cc7840e, State: Running, Role: LEADER
I20260709 13:06:18.328195 19558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edd7d470b5014c9489be7f41f64355c9" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:06:18.346184 19404 raft_consensus.cc:2393] T ff75a1d4cb1f493db8f71ddc136ba9ab P e5256d91808b47c195bc9b4dbd7f2b87 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0473d2b2d01f4459b1e90fd12cc7840e in current term 12: Already voted for candidate e61c3a8f61bb48f8a963c9480e53c168 in this term.
I20260709 13:06:18.346253 19559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14935b3ddf914369822e4a0547aaa355" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:06:18.328847 19377 leader_election.cc:304] T 7be9efa6559648dbb5a0f7684c4542d1 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, 127766fc592545a4997f7790f50f6076
I20260709 13:06:18.353835 19406 raft_consensus.cc:2468] T ab43d85f64114d4ebf618930e43d9ed0 P e5256d91808b47c195bc9b4dbd7f2b87 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 127766fc592545a4997f7790f50f6076 in term 14.
I20260709 13:06:18.345455 19558 raft_consensus.cc:2468] T edd7d470b5014c9489be7f41f64355c9 P e61c3a8f61bb48f8a963c9480e53c168 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 12.
I20260709 13:06:18.359328 19523 leader_election.cc:304] T 4af19371ea874c09a0a2147040835cbb P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e61c3a8f61bb48f8a963c9480e53c168; no voters: 127766fc592545a4997f7790f50f6076, e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:06:18.363374 20105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48824d5acfbc485ebf8c2d944e7202de" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076"
I20260709 13:06:18.365790 19551 raft_consensus.cc:2468] T 28af091831594f9d8e96482078cc7625 P e61c3a8f61bb48f8a963c9480e53c168 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 14.
I20260709 13:06:18.368147 19554 raft_consensus.cc:1275] T 4509b76741dc428e9201c70c1658da13 P e61c3a8f61bb48f8a963c9480e53c168 [term 8 FOLLOWER]: Refusing update from remote peer e5256d91808b47c195bc9b4dbd7f2b87: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 5. (term mismatch)
I20260709 13:06:18.368590 19554 pending_rounds.cc:85] T 4509b76741dc428e9201c70c1658da13 P e61c3a8f61bb48f8a963c9480e53c168: Aborting all ops after (but not including) 4
I20260709 13:06:18.371804 20110 raft_consensus.cc:1240] T 1efebf73c86e432baa55533136b6e12c P 127766fc592545a4997f7790f50f6076 [term 12 FOLLOWER]: Rejecting Update request from peer e61c3a8f61bb48f8a963c9480e53c168 for earlier term 11. Current term is 12. Ops: []
I20260709 13:06:18.373128 19450 leader_election.cc:304] T 0e1085d23e8347fbbd5bce7542f4b1f4 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:06:18.374845 19555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edd7d470b5014c9489be7f41f64355c9" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:06:18.375386 19555 raft_consensus.cc:3060] T edd7d470b5014c9489be7f41f64355c9 P e61c3a8f61bb48f8a963c9480e53c168 [term 12 FOLLOWER]: Advancing to term 14
I20260709 13:06:18.374343 19406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28af091831594f9d8e96482078cc7625" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
I20260709 13:06:18.376251 19406 raft_consensus.cc:3060] T 28af091831594f9d8e96482078cc7625 P e5256d91808b47c195bc9b4dbd7f2b87 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:06:18.378557 20104 raft_consensus.cc:1275] T 0afb57ae58a24a01850491d69f0213dd P 127766fc592545a4997f7790f50f6076 [term 12 FOLLOWER]: Refusing update from remote peer 0473d2b2d01f4459b1e90fd12cc7840e: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:06:18.379947 20104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14935b3ddf914369822e4a0547aaa355" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:06:18.381484 20112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c5eebf646ad445a9d1b1adc319d7b16" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:06:18.382148 20112 raft_consensus.cc:2468] T 6c5eebf646ad445a9d1b1adc319d7b16 P 127766fc592545a4997f7790f50f6076 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 12.
I20260709 13:06:18.383343 20111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c5eebf646ad445a9d1b1adc319d7b16" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076"
I20260709 13:06:18.387310 20108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48824d5acfbc485ebf8c2d944e7202de" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:06:18.387439 20109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e1085d23e8347fbbd5bce7542f4b1f4" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:06:18.388053 20109 raft_consensus.cc:2468] T 0e1085d23e8347fbbd5bce7542f4b1f4 P 127766fc592545a4997f7790f50f6076 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 10.
I20260709 13:06:18.388716 19403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab43d85f64114d4ebf618930e43d9ed0" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 14 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:06:18.389392 19403 raft_consensus.cc:2393] T ab43d85f64114d4ebf618930e43d9ed0 P e5256d91808b47c195bc9b4dbd7f2b87 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0473d2b2d01f4459b1e90fd12cc7840e in current term 14: Already voted for candidate 127766fc592545a4997f7790f50f6076 in this term.
I20260709 13:06:18.368827 19554 pending_rounds.cc:107] T 4509b76741dc428e9201c70c1658da13 P e61c3a8f61bb48f8a963c9480e53c168: Aborting uncommitted NO_OP operation due to leader change: 7.5
I20260709 13:06:18.390548 19554 raft_consensus.cc:2889] T 4509b76741dc428e9201c70c1658da13 P e61c3a8f61bb48f8a963c9480e53c168 [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:06:18.380865 20106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab43d85f64114d4ebf618930e43d9ed0" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 14 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:06:18.391709 20106 raft_consensus.cc:2393] T ab43d85f64114d4ebf618930e43d9ed0 P 127766fc592545a4997f7790f50f6076 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0473d2b2d01f4459b1e90fd12cc7840e in current term 14: Already voted for candidate 127766fc592545a4997f7790f50f6076 in this term.
I20260709 13:06:18.398175 19411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ec1c4ce15e04c7e8c283a62179f2a64" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
W20260709 13:06:18.399294 19377 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.2:46257, user_credentials={real_user=slave}} blocked reactor thread for 70521.3us
I20260709 13:06:18.401054 19375 leader_election.cc:304] T 85c494af21f9457a85da47b9bc70c1fd P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168; no voters: 127766fc592545a4997f7790f50f6076
I20260709 13:06:18.334013 24029 leader_election.cc:290] T 28af091831594f9d8e96482078cc7625 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:06:18.408924 19408 raft_consensus.cc:1275] T f1b10566f45d4a7d9029858330e02d5b P e5256d91808b47c195bc9b4dbd7f2b87 [term 14 FOLLOWER]: Refusing update from remote peer 0473d2b2d01f4459b1e90fd12cc7840e: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 14 index: 9. (term mismatch)
I20260709 13:06:18.421754 19554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "179fd671030940b4b4a4e24bcc4aba0a" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:06:18.419126 19486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2725d2c4cb054f18b0fc8f735c15f6c2" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 16 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:06:18.427348 19408 pending_rounds.cc:85] T f1b10566f45d4a7d9029858330e02d5b P e5256d91808b47c195bc9b4dbd7f2b87: Aborting all ops after (but not including) 8
I20260709 13:06:18.427698 19408 pending_rounds.cc:107] T f1b10566f45d4a7d9029858330e02d5b P e5256d91808b47c195bc9b4dbd7f2b87: Aborting uncommitted NO_OP operation due to leader change: 13.9
I20260709 13:06:18.428000 19408 raft_consensus.cc:2889] T f1b10566f45d4a7d9029858330e02d5b P e5256d91808b47c195bc9b4dbd7f2b87 [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:06:18.429311 19551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28af091831594f9d8e96482078cc7625" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:06:18.430024 19551 raft_consensus.cc:2393] T 28af091831594f9d8e96482078cc7625 P e61c3a8f61bb48f8a963c9480e53c168 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e5256d91808b47c195bc9b4dbd7f2b87 in current term 14: Already voted for candidate 0473d2b2d01f4459b1e90fd12cc7840e in this term.
W20260709 13:06:18.432792 19523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.4:43121, user_credentials={real_user=slave}} blocked reactor thread for 73556.9us
I20260709 13:06:18.327884 24141 consensus_queue.cc:1059] T 48824d5acfbc485ebf8c2d944e7202de P 127766fc592545a4997f7790f50f6076 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 }, Status: INVALID_TERM, Last received: 13.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.079s
I20260709 13:06:18.443517 19405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "179fd671030940b4b4a4e24bcc4aba0a" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
I20260709 13:06:18.444370 19405 raft_consensus.cc:3060] T 179fd671030940b4b4a4e24bcc4aba0a P e5256d91808b47c195bc9b4dbd7f2b87 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:06:18.445679 19411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14935b3ddf914369822e4a0547aaa355" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:06:18.412096 24136 leader_election.cc:290] T ab43d85f64114d4ebf618930e43d9ed0 P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 14 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:06:18.396781 24119 raft_consensus.cc:2749] T 4af19371ea874c09a0a2147040835cbb P e61c3a8f61bb48f8a963c9480e53c168 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:06:18.453855 19406 raft_consensus.cc:2468] T 28af091831594f9d8e96482078cc7625 P e5256d91808b47c195bc9b4dbd7f2b87 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 14.
I20260709 13:06:18.408644 23605 raft_consensus.cc:2749] T 7be9efa6559648dbb5a0f7684c4542d1 P e5256d91808b47c195bc9b4dbd7f2b87 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:06:18.364804 24048 consensus_queue.cc:1048] T 85c494af21f9457a85da47b9bc70c1fd P 127766fc592545a4997f7790f50f6076 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.068s
I20260709 13:06:18.409752 23974 raft_consensus.cc:493] T a08760e15aac4630a629431f56024dc8 P e61c3a8f61bb48f8a963c9480e53c168 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:18.410476 24148 raft_consensus.cc:2804] T 0e1085d23e8347fbbd5bce7542f4b1f4 P 0473d2b2d01f4459b1e90fd12cc7840e [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:06:18.458719 19486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e381f1d6b8184797ad142de49be225a8" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:06:18.462195 19409 raft_consensus.cc:1275] T e381f1d6b8184797ad142de49be225a8 P e5256d91808b47c195bc9b4dbd7f2b87 [term 10 FOLLOWER]: Refusing update from remote peer 0473d2b2d01f4459b1e90fd12cc7840e: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 13:06:18.478217 19406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76cb037fc9064d13b59a8969d897ce8c" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
W20260709 13:06:18.465886 19374 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.4:43121, user_credentials={real_user=slave}} blocked reactor thread for 151409us
I20260709 13:06:18.456910 24029 raft_consensus.cc:2804] T 85c494af21f9457a85da47b9bc70c1fd P e5256d91808b47c195bc9b4dbd7f2b87 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:06:18.484925 20111 raft_consensus.cc:2468] T 6c5eebf646ad445a9d1b1adc319d7b16 P 127766fc592545a4997f7790f50f6076 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 12.
I20260709 13:06:18.487049 24144 consensus_queue.cc:1048] T 775c229504194560ba9589bc2199b089 P 127766fc592545a4997f7790f50f6076 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.181s
I20260709 13:06:18.489934 24162 raft_consensus.cc:3060] T ff9b0eddd810459b82d91c60777c10eb P e5256d91808b47c195bc9b4dbd7f2b87 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:06:18.494726 24163 raft_consensus.cc:2804] T 65d8cb8d6ec64f459d5a47cefab10acf P e5256d91808b47c195bc9b4dbd7f2b87 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:06:18.432214 23687 consensus_queue.cc:1048] T 7f575b143b844aa096b50997dad3516a P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.034s
I20260709 13:06:18.499966 19411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa8650e71aa14778b3d73721fc50d9fc" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
I20260709 13:06:18.465410 24148 raft_consensus.cc:493] T 0e1085d23e8347fbbd5bce7542f4b1f4 P 0473d2b2d01f4459b1e90fd12cc7840e [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:18.500699 19486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "217b5fae677b4971b3bbd2f357a1f7ff" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:06:18.455165 24089 consensus_queue.cc:1059] T ab43d85f64114d4ebf618930e43d9ed0 P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false }, Status: INVALID_TERM, Last received: 13.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.041s
I20260709 13:06:18.475632 23878 raft_consensus.cc:493] T 775c229504194560ba9589bc2199b089 P e5256d91808b47c195bc9b4dbd7f2b87 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 127766fc592545a4997f7790f50f6076)
I20260709 13:06:18.505093 24163 raft_consensus.cc:697] T 65d8cb8d6ec64f459d5a47cefab10acf P e5256d91808b47c195bc9b4dbd7f2b87 [term 13 LEADER]: Becoming Leader. State: Replica: e5256d91808b47c195bc9b4dbd7f2b87, State: Running, Role: LEADER
I20260709 13:06:18.483599 23974 raft_consensus.cc:515] T a08760e15aac4630a629431f56024dc8 P e61c3a8f61bb48f8a963c9480e53c168 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:18.521204 19402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40e1e16737a842ee936002830f36882e" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:06:18.526999 19408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21e14947d70440f19044d8f75c31e1f9" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
I20260709 13:06:18.593971 19408 raft_consensus.cc:2393] T 21e14947d70440f19044d8f75c31e1f9 P e5256d91808b47c195bc9b4dbd7f2b87 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate e61c3a8f61bb48f8a963c9480e53c168 in current term 13: Already voted for candidate 0473d2b2d01f4459b1e90fd12cc7840e in this term.
I20260709 13:06:18.530325 19478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62c6c134d3d24a1ab144dd9ee6bc3f64" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:06:18.532483 19485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff75a1d4cb1f493db8f71ddc136ba9ab" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:06:18.533138 19477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48824d5acfbc485ebf8c2d944e7202de" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:06:18.533977 19483 raft_consensus.cc:1240] T 179fd671030940b4b4a4e24bcc4aba0a P 0473d2b2d01f4459b1e90fd12cc7840e [term 14 FOLLOWER]: Rejecting Update request from peer e61c3a8f61bb48f8a963c9480e53c168 for earlier term 13. Current term is 14. Ops: []
I20260709 13:06:18.534049 19556 raft_consensus.cc:2468] T 65d8cb8d6ec64f459d5a47cefab10acf P e61c3a8f61bb48f8a963c9480e53c168 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 13.
I20260709 13:06:18.594563 19485 raft_consensus.cc:3060] T ff75a1d4cb1f493db8f71ddc136ba9ab P 0473d2b2d01f4459b1e90fd12cc7840e [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:06:18.535106 19479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef32ce6fdd0e40d382c79974f30295c6" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:06:18.595026 19486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76cb037fc9064d13b59a8969d897ce8c" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:06:18.536253 19481 raft_consensus.cc:1240] T 46c5bfeecc314717bffe987e6844b6d0 P 0473d2b2d01f4459b1e90fd12cc7840e [term 18 FOLLOWER]: Rejecting Update request from peer e61c3a8f61bb48f8a963c9480e53c168 for earlier term 17. Current term is 18. Ops: []
I20260709 13:06:18.595865 19479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21e14947d70440f19044d8f75c31e1f9" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:06:18.596513 19481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edd7d470b5014c9489be7f41f64355c9" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:06:18.596925 19479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e5873a19244c5ebbcd38e126796ee7" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:06:18.597268 19481 raft_consensus.cc:2393] T edd7d470b5014c9489be7f41f64355c9 P 0473d2b2d01f4459b1e90fd12cc7840e [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e61c3a8f61bb48f8a963c9480e53c168 in current term 13: Already voted for candidate 0473d2b2d01f4459b1e90fd12cc7840e in this term.
W20260709 13:06:18.597481 19450 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.3:36891, user_credentials={real_user=slave}} blocked reactor thread for 189678us
I20260709 13:06:18.537004 19484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28af091831594f9d8e96482078cc7625" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:06:18.502851 19405 raft_consensus.cc:2468] T 179fd671030940b4b4a4e24bcc4aba0a P e5256d91808b47c195bc9b4dbd7f2b87 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 14.
I20260709 13:06:18.542819 20103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed7fdbcb96d14d418db9ca90a792588a" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
W20260709 13:06:18.556139 19525 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:18.495826 24029 raft_consensus.cc:493] T 85c494af21f9457a85da47b9bc70c1fd P e5256d91808b47c195bc9b4dbd7f2b87 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 127766fc592545a4997f7790f50f6076)
I20260709 13:06:18.585574 19410 raft_consensus.cc:2468] T 217b5fae677b4971b3bbd2f357a1f7ff P e5256d91808b47c195bc9b4dbd7f2b87 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 10.
I20260709 13:06:18.599717 19479 raft_consensus.cc:3060] T d1e5873a19244c5ebbcd38e126796ee7 P 0473d2b2d01f4459b1e90fd12cc7840e [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:06:18.598070 19481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e1f505cb0f1427bbd698ac889d80821" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:06:18.592322 19555 raft_consensus.cc:2468] T edd7d470b5014c9489be7f41f64355c9 P e61c3a8f61bb48f8a963c9480e53c168 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 14.
I20260709 13:06:18.601934 19484 raft_consensus.cc:2368] T 28af091831594f9d8e96482078cc7625 P 0473d2b2d01f4459b1e90fd12cc7840e [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e61c3a8f61bb48f8a963c9480e53c168 for earlier term 13. Current term is 14.
I20260709 13:06:18.602485 19405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e1f505cb0f1427bbd698ac889d80821" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:06:18.603159 19405 raft_consensus.cc:2468] T 3e1f505cb0f1427bbd698ac889d80821 P e5256d91808b47c195bc9b4dbd7f2b87 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 13.
I20260709 13:06:18.605270 19410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df751f992649444090e27965eb1af85d" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:06:18.605858 19410 raft_consensus.cc:2468] T df751f992649444090e27965eb1af85d P e5256d91808b47c195bc9b4dbd7f2b87 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 15.
W20260709 13:06:18.607367 24166 log.cc:927] Time spent T 85c494af21f9457a85da47b9bc70c1fd P 127766fc592545a4997f7790f50f6076: Append to log took a long time: real 0.096s	user 0.000s	sys 0.000s
I20260709 13:06:18.609242 19402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14935b3ddf914369822e4a0547aaa355" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:06:18.609493 19477 raft_consensus.cc:1240] T 1a61655d99124a29b486ba4a5b37faea P 0473d2b2d01f4459b1e90fd12cc7840e [term 10 FOLLOWER]: Rejecting Update request from peer e61c3a8f61bb48f8a963c9480e53c168 for earlier term 9. Current term is 10. Ops: []
I20260709 13:06:18.610864 24163 consensus_queue.cc:237] T 65d8cb8d6ec64f459d5a47cefab10acf P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:18.615454 19555 raft_consensus.cc:3055] T 46c5bfeecc314717bffe987e6844b6d0 P e61c3a8f61bb48f8a963c9480e53c168 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:06:18.615833 19555 raft_consensus.cc:740] T 46c5bfeecc314717bffe987e6844b6d0 P e61c3a8f61bb48f8a963c9480e53c168 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: e61c3a8f61bb48f8a963c9480e53c168, State: Running, Role: LEADER
I20260709 13:06:18.584139 24148 raft_consensus.cc:3060] T 0e1085d23e8347fbbd5bce7542f4b1f4 P 0473d2b2d01f4459b1e90fd12cc7840e [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:06:18.630919 19411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edd7d470b5014c9489be7f41f64355c9" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:06:18.632561 19409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e5873a19244c5ebbcd38e126796ee7" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
I20260709 13:06:18.590550 23919 raft_consensus.cc:493] T 14efcc79969f41babe5529c22d59156d P e5256d91808b47c195bc9b4dbd7f2b87 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:18.637167 19477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40e1e16737a842ee936002830f36882e" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:06:18.640056 19481 raft_consensus.cc:2468] T 3e1f505cb0f1427bbd698ac889d80821 P 0473d2b2d01f4459b1e90fd12cc7840e [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 13.
I20260709 13:06:18.641578 19478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dc5b3532fe54f74876d02beffa2c230" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:06:18.642166 19478 raft_consensus.cc:3060] T 1dc5b3532fe54f74876d02beffa2c230 P 0473d2b2d01f4459b1e90fd12cc7840e [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:06:18.645229 19411 raft_consensus.cc:2368] T edd7d470b5014c9489be7f41f64355c9 P e5256d91808b47c195bc9b4dbd7f2b87 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e61c3a8f61bb48f8a963c9480e53c168 for earlier term 13. Current term is 14.
I20260709 13:06:18.629034 19555 consensus_queue.cc:260] T 46c5bfeecc314717bffe987e6844b6d0 P e61c3a8f61bb48f8a963c9480e53c168 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 17.8, Last appended by leader: 8, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:18.603374 24029 raft_consensus.cc:3060] T 85c494af21f9457a85da47b9bc70c1fd P e5256d91808b47c195bc9b4dbd7f2b87 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:06:18.641358 19450 leader_election.cc:304] T 28af091831594f9d8e96482078cc7625 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:06:18.602491 23918 raft_consensus.cc:493] T f1b10566f45d4a7d9029858330e02d5b P e5256d91808b47c195bc9b4dbd7f2b87 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:18.623448 23974 leader_election.cc:290] T a08760e15aac4630a629431f56024dc8 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:06:18.598439 23878 raft_consensus.cc:515] T 775c229504194560ba9589bc2199b089 P e5256d91808b47c195bc9b4dbd7f2b87 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:18.647300 23919 raft_consensus.cc:515] T 14efcc79969f41babe5529c22d59156d P e5256d91808b47c195bc9b4dbd7f2b87 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:18.676138 19408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85c494af21f9457a85da47b9bc70c1fd" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:06:18.661542 19555 raft_consensus.cc:3060] T 46c5bfeecc314717bffe987e6844b6d0 P e61c3a8f61bb48f8a963c9480e53c168 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:06:18.648427 19483 raft_consensus.cc:1240] T 1efebf73c86e432baa55533136b6e12c P 0473d2b2d01f4459b1e90fd12cc7840e [term 12 FOLLOWER]: Rejecting Update request from peer e61c3a8f61bb48f8a963c9480e53c168 for earlier term 11. Current term is 12. Ops: []
I20260709 13:06:18.476473 24024 consensus_queue.cc:237] T 6c5eebf646ad445a9d1b1adc319d7b16 P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:18.681087 19403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dc5b3532fe54f74876d02beffa2c230" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
I20260709 13:06:18.684275 19554 raft_consensus.cc:1275] T 21e14947d70440f19044d8f75c31e1f9 P e61c3a8f61bb48f8a963c9480e53c168 [term 13 FOLLOWER]: Refusing update from remote peer 0473d2b2d01f4459b1e90fd12cc7840e: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:06:18.671145 19481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab43d85f64114d4ebf618930e43d9ed0" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:06:18.686311 19552 raft_consensus.cc:1275] T ef32ce6fdd0e40d382c79974f30295c6 P e61c3a8f61bb48f8a963c9480e53c168 [term 15 FOLLOWER]: Refusing update from remote peer 0473d2b2d01f4459b1e90fd12cc7840e: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 13:06:18.686784 19556 raft_consensus.cc:1240] T fa8650e71aa14778b3d73721fc50d9fc P e61c3a8f61bb48f8a963c9480e53c168 [term 12 FOLLOWER]: Rejecting Update request from peer 0473d2b2d01f4459b1e90fd12cc7840e for earlier term 11. Current term is 12. Ops: []
I20260709 13:06:18.687680 19551 raft_consensus.cc:1275] T 217b5fae677b4971b3bbd2f357a1f7ff P e61c3a8f61bb48f8a963c9480e53c168 [term 10 FOLLOWER]: Refusing update from remote peer 0473d2b2d01f4459b1e90fd12cc7840e: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:06:18.674811 19411 raft_consensus.cc:1275] T 21e14947d70440f19044d8f75c31e1f9 P e5256d91808b47c195bc9b4dbd7f2b87 [term 13 FOLLOWER]: Refusing update from remote peer 0473d2b2d01f4459b1e90fd12cc7840e: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:06:18.690474 19485 raft_consensus.cc:2468] T ff75a1d4cb1f493db8f71ddc136ba9ab P 0473d2b2d01f4459b1e90fd12cc7840e [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 12.
I20260709 13:06:18.691323 19485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28af091831594f9d8e96482078cc7625" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:06:18.672135 24055 raft_consensus.cc:2804] T 28af091831594f9d8e96482078cc7625 P 0473d2b2d01f4459b1e90fd12cc7840e [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:06:18.694106 19481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "179fd671030940b4b4a4e24bcc4aba0a" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:06:18.696831 19481 raft_consensus.cc:2393] T 179fd671030940b4b4a4e24bcc4aba0a P 0473d2b2d01f4459b1e90fd12cc7840e [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e5256d91808b47c195bc9b4dbd7f2b87 in current term 14: Already voted for candidate 0473d2b2d01f4459b1e90fd12cc7840e in this term.
I20260709 13:06:18.693531 19479 raft_consensus.cc:2468] T d1e5873a19244c5ebbcd38e126796ee7 P 0473d2b2d01f4459b1e90fd12cc7840e [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 14.
I20260709 13:06:18.694191 19409 raft_consensus.cc:2468] T d1e5873a19244c5ebbcd38e126796ee7 P e5256d91808b47c195bc9b4dbd7f2b87 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 14.
I20260709 13:06:18.695188 19411 raft_consensus.cc:1240] T 1a61655d99124a29b486ba4a5b37faea P e5256d91808b47c195bc9b4dbd7f2b87 [term 10 LEADER]: Rejecting Update request from peer e61c3a8f61bb48f8a963c9480e53c168 for earlier term 9. Current term is 10. Ops: []
I20260709 13:06:18.698091 19479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed7fdbcb96d14d418db9ca90a792588a" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:06:18.698768 19409 raft_consensus.cc:1240] T 179fd671030940b4b4a4e24bcc4aba0a P e5256d91808b47c195bc9b4dbd7f2b87 [term 14 FOLLOWER]: Rejecting Update request from peer e61c3a8f61bb48f8a963c9480e53c168 for earlier term 13. Current term is 14. Ops: []
I20260709 13:06:18.697288 19483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edd7d470b5014c9489be7f41f64355c9" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:06:18.701787 19483 raft_consensus.cc:3060] T edd7d470b5014c9489be7f41f64355c9 P 0473d2b2d01f4459b1e90fd12cc7840e [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:06:18.701910 19555 raft_consensus.cc:1275] T 46c5bfeecc314717bffe987e6844b6d0 P e61c3a8f61bb48f8a963c9480e53c168 [term 18 FOLLOWER]: Refusing update from remote peer e5256d91808b47c195bc9b4dbd7f2b87: Log matching property violated. Preceding OpId in replica: term: 17 index: 8. Preceding OpId from leader: term: 18 index: 8. (term mismatch)
I20260709 13:06:18.702286 19555 pending_rounds.cc:85] T 46c5bfeecc314717bffe987e6844b6d0 P e61c3a8f61bb48f8a963c9480e53c168: Aborting all ops after (but not including) 7
I20260709 13:06:18.702486 19555 pending_rounds.cc:107] T 46c5bfeecc314717bffe987e6844b6d0 P e61c3a8f61bb48f8a963c9480e53c168: Aborting uncommitted NO_OP operation due to leader change: 17.8
I20260709 13:06:18.702721 19555 raft_consensus.cc:2889] T 46c5bfeecc314717bffe987e6844b6d0 P e61c3a8f61bb48f8a963c9480e53c168 [term 18 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:06:18.705084 19411 raft_consensus.cc:1275] T 22196caba61445d3bec98a0aab3c337d P e5256d91808b47c195bc9b4dbd7f2b87 [term 10 FOLLOWER]: Refusing update from remote peer e61c3a8f61bb48f8a963c9480e53c168: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:06:18.707307 19408 raft_consensus.cc:1240] T 46c5bfeecc314717bffe987e6844b6d0 P e5256d91808b47c195bc9b4dbd7f2b87 [term 18 LEADER]: Rejecting Update request from peer e61c3a8f61bb48f8a963c9480e53c168 for earlier term 17. Current term is 18. Ops: []
I20260709 13:06:18.707788 24033 raft_consensus.cc:515] T 2e36a9d6e29c4a7c860cf267efbd4c74 P e5256d91808b47c195bc9b4dbd7f2b87 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:18.708726 19408 raft_consensus.cc:1240] T 4509b76741dc428e9201c70c1658da13 P e5256d91808b47c195bc9b4dbd7f2b87 [term 8 LEADER]: Rejecting Update request from peer e61c3a8f61bb48f8a963c9480e53c168 for earlier term 7. Current term is 8. Ops: []
I20260709 13:06:18.710008 24033 leader_election.cc:290] T 2e36a9d6e29c4a7c860cf267efbd4c74 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 11 election: Requested vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:06:18.710209 19409 raft_consensus.cc:1240] T ab43d85f64114d4ebf618930e43d9ed0 P e5256d91808b47c195bc9b4dbd7f2b87 [term 14 FOLLOWER]: Rejecting Update request from peer e61c3a8f61bb48f8a963c9480e53c168 for earlier term 13. Current term is 14. Ops: [13.7-13.7]
I20260709 13:06:18.718297 19478 raft_consensus.cc:2468] T 1dc5b3532fe54f74876d02beffa2c230 P 0473d2b2d01f4459b1e90fd12cc7840e [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 13.
W20260709 13:06:18.727218 24174 log.cc:927] Time spent T df751f992649444090e27965eb1af85d P 0473d2b2d01f4459b1e90fd12cc7840e: Append to log took a long time: real 0.068s	user 0.000s	sys 0.000s
I20260709 13:06:18.729496 19480 raft_consensus.cc:1275] T 2e36a9d6e29c4a7c860cf267efbd4c74 P 0473d2b2d01f4459b1e90fd12cc7840e [term 10 FOLLOWER]: Refusing update from remote peer e61c3a8f61bb48f8a963c9480e53c168: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:06:18.739710 19477 raft_consensus.cc:1275] T 22196caba61445d3bec98a0aab3c337d P 0473d2b2d01f4459b1e90fd12cc7840e [term 10 FOLLOWER]: Refusing update from remote peer e61c3a8f61bb48f8a963c9480e53c168: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
W20260709 13:06:18.741680 19523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.4:43121, user_credentials={real_user=slave}} blocked reactor thread for 308045us
I20260709 13:06:18.693876 23974 raft_consensus.cc:493] T b08304a0a02b42d7840c4e8ee9a6bd1a P e61c3a8f61bb48f8a963c9480e53c168 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 0473d2b2d01f4459b1e90fd12cc7840e)
I20260709 13:06:18.672433 23918 raft_consensus.cc:515] T f1b10566f45d4a7d9029858330e02d5b P e5256d91808b47c195bc9b4dbd7f2b87 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:18.726218 24029 raft_consensus.cc:515] T 85c494af21f9457a85da47b9bc70c1fd P e5256d91808b47c195bc9b4dbd7f2b87 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
W20260709 13:06:18.776630 19450 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.3:36891, user_credentials={real_user=slave}} blocked reactor thread for 75848.1us
I20260709 13:06:18.774267 19478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa8650e71aa14778b3d73721fc50d9fc" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:06:18.775729 23974 raft_consensus.cc:515] T b08304a0a02b42d7840c4e8ee9a6bd1a P e61c3a8f61bb48f8a963c9480e53c168 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:18.781473 19477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14935b3ddf914369822e4a0547aaa355" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:06:18.782555 19480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df751f992649444090e27965eb1af85d" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:06:18.796665 19411 raft_consensus.cc:1240] T 85c494af21f9457a85da47b9bc70c1fd P e5256d91808b47c195bc9b4dbd7f2b87 [term 11 FOLLOWER]: Rejecting Update request from peer 127766fc592545a4997f7790f50f6076 for earlier term 10. Current term is 11. Ops: []
I20260709 13:06:18.784014 24055 raft_consensus.cc:697] T 28af091831594f9d8e96482078cc7625 P 0473d2b2d01f4459b1e90fd12cc7840e [term 14 LEADER]: Becoming Leader. State: Replica: 0473d2b2d01f4459b1e90fd12cc7840e, State: Running, Role: LEADER
W20260709 13:06:18.804977 20078 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.2:46257, user_credentials={real_user=slave}} blocked reactor thread for 145841us
W20260709 13:06:18.807379 19525 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:18.807667 20078 leader_election.cc:304] T 1efebf73c86e432baa55533136b6e12c P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, 127766fc592545a4997f7790f50f6076; no voters: 
I20260709 13:06:18.810495 19526 leader_election.cc:304] T 2725d2c4cb054f18b0fc8f735c15f6c2 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e61c3a8f61bb48f8a963c9480e53c168; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:06:18.802794 24147 consensus_queue.cc:1048] T 21e14947d70440f19044d8f75c31e1f9 P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.013s
I20260709 13:06:18.816958 24183 consensus_queue.cc:1059] T fa8650e71aa14778b3d73721fc50d9fc P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 }, Status: INVALID_TERM, Last received: 11.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.014s
I20260709 13:06:18.833158 24141 raft_consensus.cc:2804] T 1efebf73c86e432baa55533136b6e12c P 127766fc592545a4997f7790f50f6076 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:06:18.833849 24188 raft_consensus.cc:2749] T 2725d2c4cb054f18b0fc8f735c15f6c2 P e61c3a8f61bb48f8a963c9480e53c168 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:06:18.813028 24180 consensus_queue.cc:1059] T 1efebf73c86e432baa55533136b6e12c P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.021s
I20260709 13:06:18.820430 19523 leader_election.cc:304] T 217b5fae677b4971b3bbd2f357a1f7ff P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:06:18.839572 19449 leader_election.cc:304] T 96efeaaf1057492490e9a621f37e1a2d P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, 127766fc592545a4997f7790f50f6076; no voters: e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:06:18.853135 19449 leader_election.cc:304] T 14935b3ddf914369822e4a0547aaa355 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e; no voters: 127766fc592545a4997f7790f50f6076, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:06:18.856709 19449 leader_election.cc:304] T 48824d5acfbc485ebf8c2d944e7202de P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e; no voters: 127766fc592545a4997f7790f50f6076, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:06:18.857049 23795 raft_consensus.cc:2804] T 96efeaaf1057492490e9a621f37e1a2d P 0473d2b2d01f4459b1e90fd12cc7840e [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:06:18.858577 23795 raft_consensus.cc:493] T 96efeaaf1057492490e9a621f37e1a2d P 0473d2b2d01f4459b1e90fd12cc7840e [term 13 FOLLOWER]: Starting leader election (detected failure of leader e61c3a8f61bb48f8a963c9480e53c168)
I20260709 13:06:18.858722 23918 leader_election.cc:290] T f1b10566f45d4a7d9029858330e02d5b P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:06:18.859015 23795 raft_consensus.cc:3060] T 96efeaaf1057492490e9a621f37e1a2d P 0473d2b2d01f4459b1e90fd12cc7840e [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:06:18.860160 24183 raft_consensus.cc:2749] T 14935b3ddf914369822e4a0547aaa355 P 0473d2b2d01f4459b1e90fd12cc7840e [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:06:18.860878 24183 raft_consensus.cc:2749] T 48824d5acfbc485ebf8c2d944e7202de P 0473d2b2d01f4459b1e90fd12cc7840e [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:06:18.863262 19449 leader_election.cc:304] T ab43d85f64114d4ebf618930e43d9ed0 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e; no voters: 127766fc592545a4997f7790f50f6076, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:06:18.850061 24162 raft_consensus.cc:2749] T ff9b0eddd810459b82d91c60777c10eb P e5256d91808b47c195bc9b4dbd7f2b87 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:06:18.836706 24046 consensus_queue.cc:1048] T 217b5fae677b4971b3bbd2f357a1f7ff P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.021s
I20260709 13:06:18.851078 24141 raft_consensus.cc:697] T 1efebf73c86e432baa55533136b6e12c P 127766fc592545a4997f7790f50f6076 [term 12 LEADER]: Becoming Leader. State: Replica: 127766fc592545a4997f7790f50f6076, State: Running, Role: LEADER
I20260709 13:06:18.873708 19449 leader_election.cc:304] T ed7fdbcb96d14d418db9ca90a792588a P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e; no voters: 127766fc592545a4997f7790f50f6076, e61c3a8f61bb48f8a963c9480e53c168
W20260709 13:06:18.877197 20078 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.2:46257, user_credentials={real_user=slave}} blocked reactor thread for 69703.7us
I20260709 13:06:18.879683 19449 leader_election.cc:304] T df751f992649444090e27965eb1af85d P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e; no voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:06:18.854646 24055 consensus_queue.cc:237] T 28af091831594f9d8e96482078cc7625 P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.6, Last appended by leader: 6, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:18.883572 19404 raft_consensus.cc:1240] T ff9b0eddd810459b82d91c60777c10eb P e5256d91808b47c195bc9b4dbd7f2b87 [term 13 FOLLOWER]: Rejecting Update request from peer 0473d2b2d01f4459b1e90fd12cc7840e for earlier term 12. Current term is 13. Ops: []
I20260709 13:06:18.862097 23919 leader_election.cc:290] T 14efcc79969f41babe5529c22d59156d P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:06:18.872722 24183 raft_consensus.cc:3060] T ab43d85f64114d4ebf618930e43d9ed0 P 0473d2b2d01f4459b1e90fd12cc7840e [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:06:18.888666 24147 raft_consensus.cc:2749] T ed7fdbcb96d14d418db9ca90a792588a P 0473d2b2d01f4459b1e90fd12cc7840e [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 13:06:18.924892 19523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.1:40321, user_credentials={real_user=slave}} blocked reactor thread for 104537us
I20260709 13:06:18.889462 23974 leader_election.cc:290] T b08304a0a02b42d7840c4e8ee9a6bd1a P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:06:18.872118 24153 consensus_queue.cc:1048] T 0afb57ae58a24a01850491d69f0213dd P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Connected to new peer: Peer: permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.061s
I20260709 13:06:18.929658 19523 leader_election.cc:304] T ff75a1d4cb1f493db8f71ddc136ba9ab P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:06:18.926434 24180 raft_consensus.cc:2764] T 217b5fae677b4971b3bbd2f357a1f7ff P e61c3a8f61bb48f8a963c9480e53c168 [term 10 FOLLOWER]: Leader pre-election decision vote started in defunct term 9: won
I20260709 13:06:18.937871 19483 raft_consensus.cc:2468] T edd7d470b5014c9489be7f41f64355c9 P 0473d2b2d01f4459b1e90fd12cc7840e [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 14.
I20260709 13:06:18.920754 23919 raft_consensus.cc:493] T 22196caba61445d3bec98a0aab3c337d P e5256d91808b47c195bc9b4dbd7f2b87 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:18.920380 24029 leader_election.cc:290] T 85c494af21f9457a85da47b9bc70c1fd P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 11 election: Requested vote from peers e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
W20260709 13:06:18.943929 19449 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.1:40321, user_credentials={real_user=slave}} blocked reactor thread for 61374.8us
I20260709 13:06:18.945255 19449 leader_election.cc:304] T ff75a1d4cb1f493db8f71ddc136ba9ab P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e; no voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:06:18.927162 24191 raft_consensus.cc:493] T 0afb57ae58a24a01850491d69f0213dd P 127766fc592545a4997f7790f50f6076 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:18.927419 24192 raft_consensus.cc:3060] T df751f992649444090e27965eb1af85d P 0473d2b2d01f4459b1e90fd12cc7840e [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:06:18.958734 24196 raft_consensus.cc:2749] T ff75a1d4cb1f493db8f71ddc136ba9ab P 0473d2b2d01f4459b1e90fd12cc7840e [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:06:18.961028 24126 raft_consensus.cc:3055] T 48824d5acfbc485ebf8c2d944e7202de P 127766fc592545a4997f7790f50f6076 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:06:18.961484 24126 raft_consensus.cc:740] T 48824d5acfbc485ebf8c2d944e7202de P 127766fc592545a4997f7790f50f6076 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 127766fc592545a4997f7790f50f6076, State: Running, Role: LEADER
I20260709 13:06:18.962329 19403 raft_consensus.cc:2468] T 1dc5b3532fe54f74876d02beffa2c230 P e5256d91808b47c195bc9b4dbd7f2b87 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 13.
I20260709 13:06:18.948372 23919 raft_consensus.cc:515] T 22196caba61445d3bec98a0aab3c337d P e5256d91808b47c195bc9b4dbd7f2b87 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:18.964545 23919 leader_election.cc:290] T 22196caba61445d3bec98a0aab3c337d P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
W20260709 13:06:18.971029 19523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.1:40321, user_credentials={real_user=slave}} blocked reactor thread for 44082.8us
I20260709 13:06:18.971634 19523 leader_election.cc:304] T e381f1d6b8184797ad142de49be225a8 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168; no voters: 0473d2b2d01f4459b1e90fd12cc7840e
I20260709 13:06:18.976074 19449 leader_election.cc:304] T 5ec1c4ce15e04c7e8c283a62179f2a64 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e; no voters: 127766fc592545a4997f7790f50f6076, e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:06:18.976883 24198 raft_consensus.cc:2804] T ff75a1d4cb1f493db8f71ddc136ba9ab P e61c3a8f61bb48f8a963c9480e53c168 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:06:18.962363 24126 consensus_queue.cc:260] T 48824d5acfbc485ebf8c2d944e7202de P 127766fc592545a4997f7790f50f6076 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:18.977501 24198 raft_consensus.cc:697] T ff75a1d4cb1f493db8f71ddc136ba9ab P e61c3a8f61bb48f8a963c9480e53c168 [term 12 LEADER]: Becoming Leader. State: Replica: e61c3a8f61bb48f8a963c9480e53c168, State: Running, Role: LEADER
I20260709 13:06:18.978044 24126 raft_consensus.cc:3060] T 48824d5acfbc485ebf8c2d944e7202de P 127766fc592545a4997f7790f50f6076 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:06:18.978480 24198 consensus_queue.cc:237] T ff75a1d4cb1f493db8f71ddc136ba9ab P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:18.957581 24191 raft_consensus.cc:515] T 0afb57ae58a24a01850491d69f0213dd P 127766fc592545a4997f7790f50f6076 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:18.983357 24191 leader_election.cc:290] T 0afb57ae58a24a01850491d69f0213dd P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:06:18.988140 19523 leader_election.cc:304] T 2725d2c4cb054f18b0fc8f735c15f6c2 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168; no voters: 0473d2b2d01f4459b1e90fd12cc7840e
I20260709 13:06:18.990872 24153 raft_consensus.cc:2749] T 5ec1c4ce15e04c7e8c283a62179f2a64 P 0473d2b2d01f4459b1e90fd12cc7840e [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:06:18.993366 24089 raft_consensus.cc:2804] T 2725d2c4cb054f18b0fc8f735c15f6c2 P e61c3a8f61bb48f8a963c9480e53c168 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:06:18.993917 24089 raft_consensus.cc:697] T 2725d2c4cb054f18b0fc8f735c15f6c2 P e61c3a8f61bb48f8a963c9480e53c168 [term 15 LEADER]: Becoming Leader. State: Replica: e61c3a8f61bb48f8a963c9480e53c168, State: Running, Role: LEADER
I20260709 13:06:18.975729 24180 raft_consensus.cc:2764] T e381f1d6b8184797ad142de49be225a8 P e61c3a8f61bb48f8a963c9480e53c168 [term 10 FOLLOWER]: Leader pre-election decision vote started in defunct term 9: won
I20260709 13:06:19.006354 24089 consensus_queue.cc:237] T 2725d2c4cb054f18b0fc8f735c15f6c2 P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 14.7, Last appended by leader: 7, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:19.008628 23878 leader_election.cc:290] T 775c229504194560ba9589bc2199b089 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:06:18.970373 24141 consensus_queue.cc:237] T 1efebf73c86e432baa55533136b6e12c P 127766fc592545a4997f7790f50f6076 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:19.006354 24119 raft_consensus.cc:3055] T ab43d85f64114d4ebf618930e43d9ed0 P e61c3a8f61bb48f8a963c9480e53c168 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:06:19.020444 19555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1efebf73c86e432baa55533136b6e12c" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:06:19.020737 24119 raft_consensus.cc:740] T ab43d85f64114d4ebf618930e43d9ed0 P e61c3a8f61bb48f8a963c9480e53c168 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: e61c3a8f61bb48f8a963c9480e53c168, State: Running, Role: LEADER
I20260709 13:06:19.021751 19551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "833a2f0775ed407a94b8924ce50adb63" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:06:19.022390 19551 raft_consensus.cc:2468] T 833a2f0775ed407a94b8924ce50adb63 P e61c3a8f61bb48f8a963c9480e53c168 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 127766fc592545a4997f7790f50f6076 in term 11.
I20260709 13:06:19.023691 19555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab43d85f64114d4ebf618930e43d9ed0" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:06:19.027230 20103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65d8cb8d6ec64f459d5a47cefab10acf" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:06:19.027884 20103 raft_consensus.cc:2368] T 65d8cb8d6ec64f459d5a47cefab10acf P 127766fc592545a4997f7790f50f6076 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e61c3a8f61bb48f8a963c9480e53c168 for earlier term 12. Current term is 13.
W20260709 13:06:19.036020 19449 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.1:40321, user_credentials={real_user=slave}} blocked reactor thread for 66200.9us
W20260709 13:06:19.027879 19523 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:19.039422 19523 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:19.040081 19523 leader_election.cc:400] T 65d8cb8d6ec64f459d5a47cefab10acf P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 12 pre-election: Vote denied by peer 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121) with higher term. Message: Invalid argument: T 65d8cb8d6ec64f459d5a47cefab10acf P 127766fc592545a4997f7790f50f6076 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e61c3a8f61bb48f8a963c9480e53c168 for earlier term 12. Current term is 13.
I20260709 13:06:19.040362 19523 leader_election.cc:403] T 65d8cb8d6ec64f459d5a47cefab10acf P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 12 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:06:19.040936 24180 raft_consensus.cc:2749] T 65d8cb8d6ec64f459d5a47cefab10acf P e61c3a8f61bb48f8a963c9480e53c168 [term 13 FOLLOWER]: Leader pre-election lost for term 12. Reason: Vote denied by peer 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121) with higher term. Message: Invalid argument: T 65d8cb8d6ec64f459d5a47cefab10acf P 127766fc592545a4997f7790f50f6076 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e61c3a8f61bb48f8a963c9480e53c168 for earlier term 12. Current term is 13.
I20260709 13:06:19.021744 24119 consensus_queue.cc:260] T ab43d85f64114d4ebf618930e43d9ed0 P e61c3a8f61bb48f8a963c9480e53c168 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 13.7, Last appended by leader: 7, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } attrs { replace: true } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:19.041910 24119 raft_consensus.cc:3060] T ab43d85f64114d4ebf618930e43d9ed0 P e61c3a8f61bb48f8a963c9480e53c168 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:06:19.040450 19449 leader_election.cc:304] T 179fd671030940b4b4a4e24bcc4aba0a P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87; no voters: e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:06:19.035413 24048 raft_consensus.cc:493] T 14efcc79969f41babe5529c22d59156d P 127766fc592545a4997f7790f50f6076 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:06:19.064750 19525 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:19.076695 24201 consensus_queue.cc:1048] T 21e14947d70440f19044d8f75c31e1f9 P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:06:19.082728 19403 raft_consensus.cc:1275] T 217b5fae677b4971b3bbd2f357a1f7ff P e5256d91808b47c195bc9b4dbd7f2b87 [term 10 FOLLOWER]: Refusing update from remote peer 0473d2b2d01f4459b1e90fd12cc7840e: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:06:19.087028 24061 raft_consensus.cc:493] T 62c6c134d3d24a1ab144dd9ee6bc3f64 P 127766fc592545a4997f7790f50f6076 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:19.087493 19403 raft_consensus.cc:1275] T 2b74109013a140ada21feeef92d6f563 P e5256d91808b47c195bc9b4dbd7f2b87 [term 10 FOLLOWER]: Refusing update from remote peer 0473d2b2d01f4459b1e90fd12cc7840e: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:06:19.087610 24061 raft_consensus.cc:515] T 62c6c134d3d24a1ab144dd9ee6bc3f64 P 127766fc592545a4997f7790f50f6076 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:19.090121 24061 leader_election.cc:290] T 62c6c134d3d24a1ab144dd9ee6bc3f64 P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:06:19.043160 24041 consensus_queue.cc:1048] T f1b10566f45d4a7d9029858330e02d5b P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.039s
I20260709 13:06:19.093447 23795 raft_consensus.cc:515] T 96efeaaf1057492490e9a621f37e1a2d P 0473d2b2d01f4459b1e90fd12cc7840e [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:19.096414 23795 leader_election.cc:290] T 96efeaaf1057492490e9a621f37e1a2d P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 14 election: Requested vote from peers e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:06:19.046202 24055 consensus_queue.cc:1048] T e381f1d6b8184797ad142de49be225a8 P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.013s
W20260709 13:06:19.106006 19449 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:19.109001 19486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a08760e15aac4630a629431f56024dc8" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:06:19.082692 24176 raft_consensus.cc:2804] T 179fd671030940b4b4a4e24bcc4aba0a P 0473d2b2d01f4459b1e90fd12cc7840e [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:06:19.106983 24147 raft_consensus.cc:493] T 22196caba61445d3bec98a0aab3c337d P 0473d2b2d01f4459b1e90fd12cc7840e [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:19.111085 24176 raft_consensus.cc:697] T 179fd671030940b4b4a4e24bcc4aba0a P 0473d2b2d01f4459b1e90fd12cc7840e [term 14 LEADER]: Becoming Leader. State: Replica: 0473d2b2d01f4459b1e90fd12cc7840e, State: Running, Role: LEADER
I20260709 13:06:19.111225 24147 raft_consensus.cc:515] T 22196caba61445d3bec98a0aab3c337d P 0473d2b2d01f4459b1e90fd12cc7840e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:19.111995 24176 consensus_queue.cc:237] T 179fd671030940b4b4a4e24bcc4aba0a P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:19.113284 24147 leader_election.cc:290] T 22196caba61445d3bec98a0aab3c337d P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:06:19.093745 24048 raft_consensus.cc:515] T 14efcc79969f41babe5529c22d59156d P 127766fc592545a4997f7790f50f6076 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:19.112465 24192 raft_consensus.cc:2749] T df751f992649444090e27965eb1af85d P 0473d2b2d01f4459b1e90fd12cc7840e [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:06:19.098654 24183 raft_consensus.cc:2749] T ab43d85f64114d4ebf618930e43d9ed0 P 0473d2b2d01f4459b1e90fd12cc7840e [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:06:19.144718 20103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96efeaaf1057492490e9a621f37e1a2d" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076"
I20260709 13:06:19.151355 19406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22196caba61445d3bec98a0aab3c337d" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:06:19.151975 19406 raft_consensus.cc:2468] T 22196caba61445d3bec98a0aab3c337d P e5256d91808b47c195bc9b4dbd7f2b87 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 10.
I20260709 13:06:19.151523 19408 raft_consensus.cc:1275] T ef32ce6fdd0e40d382c79974f30295c6 P e5256d91808b47c195bc9b4dbd7f2b87 [term 15 FOLLOWER]: Refusing update from remote peer 0473d2b2d01f4459b1e90fd12cc7840e: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 13:06:19.171573 19449 leader_election.cc:304] T 22196caba61445d3bec98a0aab3c337d P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87; no voters: 
I20260709 13:06:19.169683 24183 consensus_queue.cc:1048] T 2b74109013a140ada21feeef92d6f563 P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.004s
W20260709 13:06:19.173528 24205 log.cc:927] Time spent T 28af091831594f9d8e96482078cc7625 P 0473d2b2d01f4459b1e90fd12cc7840e: Append to log took a long time: real 0.053s	user 0.000s	sys 0.000s
W20260709 13:06:19.172209 24148 consensus_meta.cc:287] T 0e1085d23e8347fbbd5bce7542f4b1f4 P 0473d2b2d01f4459b1e90fd12cc7840e: Time spent flushing consensus metadata: real 0.527s	user 0.011s	sys 0.000s
I20260709 13:06:19.179122 24148 raft_consensus.cc:515] T 0e1085d23e8347fbbd5bce7542f4b1f4 P 0473d2b2d01f4459b1e90fd12cc7840e [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:19.166288 24024 consensus_queue.cc:1048] T 217b5fae677b4971b3bbd2f357a1f7ff P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.018s
I20260709 13:06:19.193068 24048 leader_election.cc:290] T 14efcc79969f41babe5529c22d59156d P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:06:19.187404 24148 leader_election.cc:290] T 0e1085d23e8347fbbd5bce7542f4b1f4 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 11 election: Requested vote from peers e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:06:19.211668 23919 consensus_queue.cc:1048] T 4509b76741dc428e9201c70c1658da13 P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:06:19.212128 19375 leader_election.cc:304] T edd7d470b5014c9489be7f41f64355c9 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:06:19.213117 24029 raft_consensus.cc:2804] T edd7d470b5014c9489be7f41f64355c9 P e5256d91808b47c195bc9b4dbd7f2b87 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:06:19.213586 24029 raft_consensus.cc:697] T edd7d470b5014c9489be7f41f64355c9 P e5256d91808b47c195bc9b4dbd7f2b87 [term 14 LEADER]: Becoming Leader. State: Replica: e5256d91808b47c195bc9b4dbd7f2b87, State: Running, Role: LEADER
I20260709 13:06:19.214398 24029 consensus_queue.cc:237] T edd7d470b5014c9489be7f41f64355c9 P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.6, Last appended by leader: 6, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:19.214993 23918 raft_consensus.cc:493] T ff75a1d4cb1f493db8f71ddc136ba9ab P e5256d91808b47c195bc9b4dbd7f2b87 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:19.215471 23918 raft_consensus.cc:515] T ff75a1d4cb1f493db8f71ddc136ba9ab P e5256d91808b47c195bc9b4dbd7f2b87 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:19.216565 24162 consensus_queue.cc:1048] T 46c5bfeecc314717bffe987e6844b6d0 P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:06:19.217517 23918 leader_election.cc:290] T ff75a1d4cb1f493db8f71ddc136ba9ab P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:06:19.217594 19523 leader_election.cc:304] T 14935b3ddf914369822e4a0547aaa355 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: e61c3a8f61bb48f8a963c9480e53c168; no voters: 127766fc592545a4997f7790f50f6076, e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:06:19.218876 19523 leader_election.cc:304] T df751f992649444090e27965eb1af85d P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:06:19.219640 24198 raft_consensus.cc:2749] T 14935b3ddf914369822e4a0547aaa355 P e61c3a8f61bb48f8a963c9480e53c168 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:06:19.220327 24198 raft_consensus.cc:2804] T df751f992649444090e27965eb1af85d P e61c3a8f61bb48f8a963c9480e53c168 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:06:19.220705 24198 raft_consensus.cc:493] T df751f992649444090e27965eb1af85d P e61c3a8f61bb48f8a963c9480e53c168 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:19.221045 24198 raft_consensus.cc:3060] T df751f992649444090e27965eb1af85d P e61c3a8f61bb48f8a963c9480e53c168 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:06:19.221644 20103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14efcc79969f41babe5529c22d59156d" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:06:19.222254 20103 raft_consensus.cc:2468] T 14efcc79969f41babe5529c22d59156d P 127766fc592545a4997f7790f50f6076 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 13.
I20260709 13:06:19.222700 19377 leader_election.cc:304] T 179fd671030940b4b4a4e24bcc4aba0a P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:06:19.223134 20110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85c494af21f9457a85da47b9bc70c1fd" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076"
I20260709 13:06:19.223948 24162 raft_consensus.cc:2749] T 179fd671030940b4b4a4e24bcc4aba0a P e5256d91808b47c195bc9b4dbd7f2b87 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:06:19.224251 20106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "775c229504194560ba9589bc2199b089" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:06:19.228111 24144 consensus_queue.cc:1059] T 85c494af21f9457a85da47b9bc70c1fd P 127766fc592545a4997f7790f50f6076 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 }, Status: INVALID_TERM, Last received: 10.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:06:19.228881 24144 raft_consensus.cc:3055] T 85c494af21f9457a85da47b9bc70c1fd P 127766fc592545a4997f7790f50f6076 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:06:19.229218 24144 raft_consensus.cc:740] T 85c494af21f9457a85da47b9bc70c1fd P 127766fc592545a4997f7790f50f6076 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 127766fc592545a4997f7790f50f6076, State: Running, Role: LEADER
I20260709 13:06:19.229753 24187 raft_consensus.cc:3055] T fa8650e71aa14778b3d73721fc50d9fc P 0473d2b2d01f4459b1e90fd12cc7840e [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:06:19.230109 24187 raft_consensus.cc:740] T fa8650e71aa14778b3d73721fc50d9fc P 0473d2b2d01f4459b1e90fd12cc7840e [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 0473d2b2d01f4459b1e90fd12cc7840e, State: Running, Role: LEADER
I20260709 13:06:19.230937 24187 consensus_queue.cc:260] T fa8650e71aa14778b3d73721fc50d9fc P 0473d2b2d01f4459b1e90fd12cc7840e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:19.231980 20076 leader_election.cc:400] T 6c5eebf646ad445a9d1b1adc319d7b16 P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 11 pre-election: Vote denied by peer e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891) with higher term. Message: Invalid argument: T 6c5eebf646ad445a9d1b1adc319d7b16 P e61c3a8f61bb48f8a963c9480e53c168 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 127766fc592545a4997f7790f50f6076 for earlier term 11. Current term is 12.
I20260709 13:06:19.232076 24187 raft_consensus.cc:3060] T fa8650e71aa14778b3d73721fc50d9fc P 0473d2b2d01f4459b1e90fd12cc7840e [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:06:19.232820 24144 consensus_queue.cc:260] T 85c494af21f9457a85da47b9bc70c1fd P 127766fc592545a4997f7790f50f6076 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:19.235679 19523 leader_election.cc:304] T 3e1f505cb0f1427bbd698ac889d80821 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:06:19.238811 24089 raft_consensus.cc:2804] T 3e1f505cb0f1427bbd698ac889d80821 P e61c3a8f61bb48f8a963c9480e53c168 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:06:19.239245 24089 raft_consensus.cc:493] T 3e1f505cb0f1427bbd698ac889d80821 P e61c3a8f61bb48f8a963c9480e53c168 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:19.239632 24089 raft_consensus.cc:3060] T 3e1f505cb0f1427bbd698ac889d80821 P e61c3a8f61bb48f8a963c9480e53c168 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:06:19.240545 24144 raft_consensus.cc:3060] T 85c494af21f9457a85da47b9bc70c1fd P 127766fc592545a4997f7790f50f6076 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:06:19.243204 19525 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:19.253176 19554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96efeaaf1057492490e9a621f37e1a2d" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:06:19.254343 19559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22196caba61445d3bec98a0aab3c337d" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:06:19.255330 19560 raft_consensus.cc:3055] T 1a61655d99124a29b486ba4a5b37faea P e61c3a8f61bb48f8a963c9480e53c168 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:06:19.255571 19554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e36a9d6e29c4a7c860cf267efbd4c74" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:06:19.255839 19560 raft_consensus.cc:740] T 1a61655d99124a29b486ba4a5b37faea P e61c3a8f61bb48f8a963c9480e53c168 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: e61c3a8f61bb48f8a963c9480e53c168, State: Running, Role: LEADER
I20260709 13:06:19.257477 19404 raft_consensus.cc:1240] T 2e36a9d6e29c4a7c860cf267efbd4c74 P e5256d91808b47c195bc9b4dbd7f2b87 [term 11 FOLLOWER]: Rejecting Update request from peer e61c3a8f61bb48f8a963c9480e53c168 for earlier term 10. Current term is 11. Ops: []
I20260709 13:06:19.259160 24188 raft_consensus.cc:3055] T 1efebf73c86e432baa55533136b6e12c P e61c3a8f61bb48f8a963c9480e53c168 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:06:19.259313 19558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85c494af21f9457a85da47b9bc70c1fd" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:06:19.259430 19559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1b10566f45d4a7d9029858330e02d5b" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:06:19.260663 19558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22196caba61445d3bec98a0aab3c337d" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
W20260709 13:06:19.260885 19526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.2:46257, user_credentials={real_user=slave}} blocked reactor thread for 425688us
W20260709 13:06:19.263214 20075 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:19.263659 20076 leader_election.cc:304] T 833a2f0775ed407a94b8924ce50adb63 P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 127766fc592545a4997f7790f50f6076, e61c3a8f61bb48f8a963c9480e53c168; no voters: e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:06:19.241240 19523 leader_election.cc:400] T edd7d470b5014c9489be7f41f64355c9 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 13 pre-election: Vote denied by peer e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321) with higher term. Message: Invalid argument: T edd7d470b5014c9489be7f41f64355c9 P e5256d91808b47c195bc9b4dbd7f2b87 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e61c3a8f61bb48f8a963c9480e53c168 for earlier term 13. Current term is 14.
I20260709 13:06:19.261600 19526 leader_election.cc:304] T ef32ce6fdd0e40d382c79974f30295c6 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e61c3a8f61bb48f8a963c9480e53c168; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:06:19.264284 19523 leader_election.cc:403] T edd7d470b5014c9489be7f41f64355c9 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 13 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:06:19.264277 19554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff75a1d4cb1f493db8f71ddc136ba9ab" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:06:19.268733 19555 raft_consensus.cc:2468] T ab43d85f64114d4ebf618930e43d9ed0 P e61c3a8f61bb48f8a963c9480e53c168 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 127766fc592545a4997f7790f50f6076 in term 14.
W20260709 13:06:19.269531 19449 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.1:40321, user_credentials={real_user=slave}} blocked reactor thread for 98524.9us
I20260709 13:06:19.265007 19560 consensus_queue.cc:260] T 1a61655d99124a29b486ba4a5b37faea P e61c3a8f61bb48f8a963c9480e53c168 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:19.277962 19485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e36a9d6e29c4a7c860cf267efbd4c74" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:06:19.278554 19485 raft_consensus.cc:3060] T 2e36a9d6e29c4a7c860cf267efbd4c74 P 0473d2b2d01f4459b1e90fd12cc7840e [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:06:19.278789 19486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14efcc79969f41babe5529c22d59156d" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:06:19.273638 19377 leader_election.cc:304] T 28af091831594f9d8e96482078cc7625 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:06:19.273742 19558 raft_consensus.cc:1240] T fa8650e71aa14778b3d73721fc50d9fc P e61c3a8f61bb48f8a963c9480e53c168 [term 12 FOLLOWER]: Rejecting Update request from peer 0473d2b2d01f4459b1e90fd12cc7840e for earlier term 11. Current term is 12. Ops: []
I20260709 13:06:19.274400 19402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65d8cb8d6ec64f459d5a47cefab10acf" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:06:19.262682 24188 raft_consensus.cc:740] T 1efebf73c86e432baa55533136b6e12c P e61c3a8f61bb48f8a963c9480e53c168 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: e61c3a8f61bb48f8a963c9480e53c168, State: Running, Role: LEADER
I20260709 13:06:19.275094 19483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1b10566f45d4a7d9029858330e02d5b" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:06:19.275776 19557 raft_consensus.cc:1275] T a08760e15aac4630a629431f56024dc8 P e61c3a8f61bb48f8a963c9480e53c168 [term 15 FOLLOWER]: Refusing update from remote peer 0473d2b2d01f4459b1e90fd12cc7840e: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 13:06:19.282931 19557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e1085d23e8347fbbd5bce7542f4b1f4" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:06:19.283538 19557 raft_consensus.cc:3060] T 0e1085d23e8347fbbd5bce7542f4b1f4 P e61c3a8f61bb48f8a963c9480e53c168 [term 9 FOLLOWER]: Advancing to term 11
I20260709 13:06:19.276322 19410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b08304a0a02b42d7840c4e8ee9a6bd1a" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:06:19.277014 19404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a08760e15aac4630a629431f56024dc8" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:06:19.285158 19404 raft_consensus.cc:2468] T a08760e15aac4630a629431f56024dc8 P e5256d91808b47c195bc9b4dbd7f2b87 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 15.
I20260709 13:06:19.277755 19554 raft_consensus.cc:1240] T 48824d5acfbc485ebf8c2d944e7202de P e61c3a8f61bb48f8a963c9480e53c168 [term 14 FOLLOWER]: Rejecting Update request from peer 127766fc592545a4997f7790f50f6076 for earlier term 13. Current term is 14. Ops: []
I20260709 13:06:19.279541 19486 raft_consensus.cc:2468] T 14efcc79969f41babe5529c22d59156d P 0473d2b2d01f4459b1e90fd12cc7840e [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 12.
I20260709 13:06:19.281008 19560 raft_consensus.cc:3060] T 1a61655d99124a29b486ba4a5b37faea P e61c3a8f61bb48f8a963c9480e53c168 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:06:19.286650 19481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "775c229504194560ba9589bc2199b089" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:06:19.288641 19523 leader_election.cc:304] T 85c494af21f9457a85da47b9bc70c1fd P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e61c3a8f61bb48f8a963c9480e53c168; no voters: 127766fc592545a4997f7790f50f6076, e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:06:19.290870 19523 leader_election.cc:304] T d1e5873a19244c5ebbcd38e126796ee7 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:06:19.293092 19486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff75a1d4cb1f493db8f71ddc136ba9ab" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:06:19.293844 19486 raft_consensus.cc:2468] T ff75a1d4cb1f493db8f71ddc136ba9ab P 0473d2b2d01f4459b1e90fd12cc7840e [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 12.
I20260709 13:06:19.296669 19484 raft_consensus.cc:1275] T 1a61655d99124a29b486ba4a5b37faea P 0473d2b2d01f4459b1e90fd12cc7840e [term 10 FOLLOWER]: Refusing update from remote peer e5256d91808b47c195bc9b4dbd7f2b87: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:06:19.296895 19554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62c6c134d3d24a1ab144dd9ee6bc3f64" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:06:19.297521 19554 raft_consensus.cc:2468] T 62c6c134d3d24a1ab144dd9ee6bc3f64 P e61c3a8f61bb48f8a963c9480e53c168 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 127766fc592545a4997f7790f50f6076 in term 12.
I20260709 13:06:19.299721 19377 leader_election.cc:304] T f1b10566f45d4a7d9029858330e02d5b P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:06:19.300019 20106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e1085d23e8347fbbd5bce7542f4b1f4" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076"
I20260709 13:06:19.300560 20106 raft_consensus.cc:3060] T 0e1085d23e8347fbbd5bce7542f4b1f4 P 127766fc592545a4997f7790f50f6076 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:06:19.273005 23538 raft_consensus.cc:2804] T 22196caba61445d3bec98a0aab3c337d P 0473d2b2d01f4459b1e90fd12cc7840e [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:06:19.287333 24148 consensus_queue.cc:1048] T ef32ce6fdd0e40d382c79974f30295c6 P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.016s
I20260709 13:06:19.303031 23878 raft_consensus.cc:2749] T 28af091831594f9d8e96482078cc7625 P e5256d91808b47c195bc9b4dbd7f2b87 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:06:19.302871 23538 raft_consensus.cc:493] T 22196caba61445d3bec98a0aab3c337d P 0473d2b2d01f4459b1e90fd12cc7840e [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:19.306882 23538 raft_consensus.cc:3060] T 22196caba61445d3bec98a0aab3c337d P 0473d2b2d01f4459b1e90fd12cc7840e [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:06:19.275887 24126 raft_consensus.cc:2804] T 833a2f0775ed407a94b8924ce50adb63 P 127766fc592545a4997f7790f50f6076 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:06:19.310957 24126 raft_consensus.cc:493] T 833a2f0775ed407a94b8924ce50adb63 P 127766fc592545a4997f7790f50f6076 [term 11 FOLLOWER]: Starting leader election (detected failure of leader e5256d91808b47c195bc9b4dbd7f2b87)
I20260709 13:06:19.311338 24126 raft_consensus.cc:3060] T 833a2f0775ed407a94b8924ce50adb63 P 127766fc592545a4997f7790f50f6076 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:06:19.277820 24180 raft_consensus.cc:2749] T ef32ce6fdd0e40d382c79974f30295c6 P e61c3a8f61bb48f8a963c9480e53c168 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:06:19.288015 23974 raft_consensus.cc:2749] T edd7d470b5014c9489be7f41f64355c9 P e61c3a8f61bb48f8a963c9480e53c168 [term 14 FOLLOWER]: Leader pre-election lost for term 13. Reason: Vote denied by peer e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321) with higher term. Message: Invalid argument: T edd7d470b5014c9489be7f41f64355c9 P e5256d91808b47c195bc9b4dbd7f2b87 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e61c3a8f61bb48f8a963c9480e53c168 for earlier term 13. Current term is 14.
I20260709 13:06:19.319468 24199 raft_consensus.cc:2804] T d1e5873a19244c5ebbcd38e126796ee7 P e61c3a8f61bb48f8a963c9480e53c168 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:06:19.320017 24199 raft_consensus.cc:697] T d1e5873a19244c5ebbcd38e126796ee7 P e61c3a8f61bb48f8a963c9480e53c168 [term 14 LEADER]: Becoming Leader. State: Replica: e61c3a8f61bb48f8a963c9480e53c168, State: Running, Role: LEADER
I20260709 13:06:19.320077 19526 leader_election.cc:304] T 21e14947d70440f19044d8f75c31e1f9 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e61c3a8f61bb48f8a963c9480e53c168; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:06:19.325508 19483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22196caba61445d3bec98a0aab3c337d" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:06:19.324296 19377 leader_election.cc:304] T 14efcc79969f41babe5529c22d59156d P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87; no voters: 
I20260709 13:06:19.288555 19558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0afb57ae58a24a01850491d69f0213dd" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:06:19.324337 19557 raft_consensus.cc:2468] T 0e1085d23e8347fbbd5bce7542f4b1f4 P e61c3a8f61bb48f8a963c9480e53c168 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 11.
I20260709 13:06:19.327656 23883 raft_consensus.cc:2749] T f1b10566f45d4a7d9029858330e02d5b P e5256d91808b47c195bc9b4dbd7f2b87 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:06:19.324505 24199 consensus_queue.cc:237] T d1e5873a19244c5ebbcd38e126796ee7 P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:19.337769 19485 raft_consensus.cc:2468] T 2e36a9d6e29c4a7c860cf267efbd4c74 P 0473d2b2d01f4459b1e90fd12cc7840e [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 11.
I20260709 13:06:19.339843 19560 raft_consensus.cc:1275] T 1a61655d99124a29b486ba4a5b37faea P e61c3a8f61bb48f8a963c9480e53c168 [term 10 FOLLOWER]: Refusing update from remote peer e5256d91808b47c195bc9b4dbd7f2b87: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:06:19.340090 19377 leader_election.cc:304] T ff75a1d4cb1f493db8f71ddc136ba9ab P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87; no voters: e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:06:19.341306 20106 raft_consensus.cc:2468] T 0e1085d23e8347fbbd5bce7542f4b1f4 P 127766fc592545a4997f7790f50f6076 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 11.
I20260709 13:06:19.343200 19449 leader_election.cc:304] T 0e1085d23e8347fbbd5bce7542f4b1f4 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, 127766fc592545a4997f7790f50f6076; no voters: 
I20260709 13:06:19.321910 24119 raft_consensus.cc:2749] T 85c494af21f9457a85da47b9bc70c1fd P e61c3a8f61bb48f8a963c9480e53c168 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:06:19.406584 19410 raft_consensus.cc:1275] T a08760e15aac4630a629431f56024dc8 P e5256d91808b47c195bc9b4dbd7f2b87 [term 15 FOLLOWER]: Refusing update from remote peer 0473d2b2d01f4459b1e90fd12cc7840e: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 13:06:19.376703 24180 raft_consensus.cc:2749] T 21e14947d70440f19044d8f75c31e1f9 P e61c3a8f61bb48f8a963c9480e53c168 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
W20260709 13:06:19.418162 19523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.1:40321, user_credentials={real_user=slave}} blocked reactor thread for 127358us
I20260709 13:06:19.368435 24147 raft_consensus.cc:2804] T 0e1085d23e8347fbbd5bce7542f4b1f4 P 0473d2b2d01f4459b1e90fd12cc7840e [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:06:19.368156 23918 raft_consensus.cc:2804] T 14efcc79969f41babe5529c22d59156d P e5256d91808b47c195bc9b4dbd7f2b87 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:06:19.368352 24162 raft_consensus.cc:2804] T ff75a1d4cb1f493db8f71ddc136ba9ab P e5256d91808b47c195bc9b4dbd7f2b87 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:06:19.447309 19450 leader_election.cc:304] T 96efeaaf1057492490e9a621f37e1a2d P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e; no voters: 127766fc592545a4997f7790f50f6076, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:06:19.448585 19523 leader_election.cc:304] T 1dc5b3532fe54f74876d02beffa2c230 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
W20260709 13:06:19.460861 24215 log.cc:927] Time spent T f1b10566f45d4a7d9029858330e02d5b P e5256d91808b47c195bc9b4dbd7f2b87: Append to log took a long time: real 0.126s	user 0.000s	sys 0.001s
I20260709 13:06:19.460523 23974 consensus_queue.cc:1048] T 22196caba61445d3bec98a0aab3c337d P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.015s
W20260709 13:06:19.444782 19526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.2:46257, user_credentials={real_user=slave}} blocked reactor thread for 124771us
I20260709 13:06:19.466388 19523 leader_election.cc:304] T a08760e15aac4630a629431f56024dc8 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:06:19.405167 23878 consensus_queue.cc:1048] T 1a61655d99124a29b486ba4a5b37faea P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.036s
I20260709 13:06:19.439849 23918 raft_consensus.cc:493] T 14efcc79969f41babe5529c22d59156d P e5256d91808b47c195bc9b4dbd7f2b87 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:19.440083 24162 raft_consensus.cc:493] T ff75a1d4cb1f493db8f71ddc136ba9ab P e5256d91808b47c195bc9b4dbd7f2b87 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:19.478094 23974 raft_consensus.cc:2804] T 1dc5b3532fe54f74876d02beffa2c230 P e61c3a8f61bb48f8a963c9480e53c168 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:06:19.436821 24187 consensus_queue.cc:1048] T ef32ce6fdd0e40d382c79974f30295c6 P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.039s
I20260709 13:06:19.444594 24147 raft_consensus.cc:697] T 0e1085d23e8347fbbd5bce7542f4b1f4 P 0473d2b2d01f4459b1e90fd12cc7840e [term 11 LEADER]: Becoming Leader. State: Replica: 0473d2b2d01f4459b1e90fd12cc7840e, State: Running, Role: LEADER
I20260709 13:06:19.502064 24162 raft_consensus.cc:3060] T ff75a1d4cb1f493db8f71ddc136ba9ab P e5256d91808b47c195bc9b4dbd7f2b87 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:06:19.441282 24119 consensus_queue.cc:1059] T 179fd671030940b4b4a4e24bcc4aba0a P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 }, Status: INVALID_TERM, Last received: 13.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.039s
I20260709 13:06:19.515659 24147 consensus_queue.cc:237] T 0e1085d23e8347fbbd5bce7542f4b1f4 P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:19.482137 19526 leader_election.cc:304] T 62c6c134d3d24a1ab144dd9ee6bc3f64 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e61c3a8f61bb48f8a963c9480e53c168; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, 127766fc592545a4997f7790f50f6076
W20260709 13:06:19.519305 19450 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.3:36891, user_credentials={real_user=slave}} blocked reactor thread for 50063.5us
I20260709 13:06:19.450809 24198 raft_consensus.cc:515] T df751f992649444090e27965eb1af85d P e61c3a8f61bb48f8a963c9480e53c168 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:19.540688 24198 leader_election.cc:290] T df751f992649444090e27965eb1af85d P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 16 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:06:19.541325 24198 consensus_queue.cc:1059] T 2e36a9d6e29c4a7c860cf267efbd4c74 P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:06:19.542400 24198 raft_consensus.cc:2804] T a08760e15aac4630a629431f56024dc8 P e61c3a8f61bb48f8a963c9480e53c168 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:06:19.542781 24198 raft_consensus.cc:493] T a08760e15aac4630a629431f56024dc8 P e61c3a8f61bb48f8a963c9480e53c168 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:19.543114 24198 raft_consensus.cc:3060] T a08760e15aac4630a629431f56024dc8 P e61c3a8f61bb48f8a963c9480e53c168 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:06:19.478861 23878 consensus_queue.cc:1243] T 1a61655d99124a29b486ba4a5b37faea P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Peer e61c3a8f61bb48f8a963c9480e53c168 log is divergent from this leader: its last log entry 9.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 13:06:19.535672 20106 raft_consensus.cc:1275] T 62c6c134d3d24a1ab144dd9ee6bc3f64 P 127766fc592545a4997f7790f50f6076 [term 12 FOLLOWER]: Refusing update from remote peer 0473d2b2d01f4459b1e90fd12cc7840e: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 13:06:19.551548 24198 raft_consensus.cc:515] T a08760e15aac4630a629431f56024dc8 P e61c3a8f61bb48f8a963c9480e53c168 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:19.555059 24198 leader_election.cc:290] T a08760e15aac4630a629431f56024dc8 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 16 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:06:19.555665 24198 raft_consensus.cc:2749] T 62c6c134d3d24a1ab144dd9ee6bc3f64 P e61c3a8f61bb48f8a963c9480e53c168 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:06:19.470085 24055 consensus_queue.cc:1048] T a08760e15aac4630a629431f56024dc8 P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.054s
I20260709 13:06:19.499423 24201 raft_consensus.cc:2749] T 96efeaaf1057492490e9a621f37e1a2d P 0473d2b2d01f4459b1e90fd12cc7840e [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:06:19.499650 23918 raft_consensus.cc:3060] T 14efcc79969f41babe5529c22d59156d P e5256d91808b47c195bc9b4dbd7f2b87 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:06:19.537324 20077 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:19.574224 19481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62c6c134d3d24a1ab144dd9ee6bc3f64" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:06:19.596542 19479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0afb57ae58a24a01850491d69f0213dd" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:06:19.599436 20110 raft_consensus.cc:1275] T 6c5eebf646ad445a9d1b1adc319d7b16 P 127766fc592545a4997f7790f50f6076 [term 12 FOLLOWER]: Refusing update from remote peer 0473d2b2d01f4459b1e90fd12cc7840e: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:06:19.599964 19553 pending_rounds.cc:85] T 1a61655d99124a29b486ba4a5b37faea P e61c3a8f61bb48f8a963c9480e53c168: Aborting all ops after (but not including) 5
I20260709 13:06:19.600267 19553 pending_rounds.cc:107] T 1a61655d99124a29b486ba4a5b37faea P e61c3a8f61bb48f8a963c9480e53c168: Aborting uncommitted NO_OP operation due to leader change: 9.6
I20260709 13:06:19.600493 19553 raft_consensus.cc:2889] T 1a61655d99124a29b486ba4a5b37faea P e61c3a8f61bb48f8a963c9480e53c168 [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:06:19.602999 19555 raft_consensus.cc:1275] T 6c5eebf646ad445a9d1b1adc319d7b16 P e61c3a8f61bb48f8a963c9480e53c168 [term 12 FOLLOWER]: Refusing update from remote peer 0473d2b2d01f4459b1e90fd12cc7840e: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:06:19.605847 19410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14efcc79969f41babe5529c22d59156d" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:06:19.592345 19374 leader_election.cc:304] T 85c494af21f9457a85da47b9bc70c1fd P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87; no voters: 127766fc592545a4997f7790f50f6076, e61c3a8f61bb48f8a963c9480e53c168
W20260709 13:06:19.607439 19526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.2:46257, user_credentials={real_user=slave}} blocked reactor thread for 125276us
I20260709 13:06:19.609361 19485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14efcc79969f41babe5529c22d59156d" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:06:19.610039 19485 raft_consensus.cc:2468] T 14efcc79969f41babe5529c22d59156d P 0473d2b2d01f4459b1e90fd12cc7840e [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 127766fc592545a4997f7790f50f6076 in term 12.
I20260709 13:06:19.551826 24126 raft_consensus.cc:515] T 833a2f0775ed407a94b8924ce50adb63 P 127766fc592545a4997f7790f50f6076 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:19.550529 23538 raft_consensus.cc:515] T 22196caba61445d3bec98a0aab3c337d P 0473d2b2d01f4459b1e90fd12cc7840e [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:19.620636 23538 leader_election.cc:290] T 22196caba61445d3bec98a0aab3c337d P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 11 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:06:19.613416 19554 raft_consensus.cc:1275] T 62c6c134d3d24a1ab144dd9ee6bc3f64 P e61c3a8f61bb48f8a963c9480e53c168 [term 12 FOLLOWER]: Refusing update from remote peer 0473d2b2d01f4459b1e90fd12cc7840e: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 13:06:19.623577 19483 raft_consensus.cc:2393] T 22196caba61445d3bec98a0aab3c337d P 0473d2b2d01f4459b1e90fd12cc7840e [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e5256d91808b47c195bc9b4dbd7f2b87 in current term 11: Already voted for candidate 0473d2b2d01f4459b1e90fd12cc7840e in this term.
W20260709 13:06:19.637527 19523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.1:40321, user_credentials={real_user=slave}} blocked reactor thread for 171228us
I20260709 13:06:19.639137 20076 leader_election.cc:304] T 62c6c134d3d24a1ab144dd9ee6bc3f64 P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 127766fc592545a4997f7790f50f6076, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:06:19.598659 23974 raft_consensus.cc:697] T 1dc5b3532fe54f74876d02beffa2c230 P e61c3a8f61bb48f8a963c9480e53c168 [term 13 LEADER]: Becoming Leader. State: Replica: e61c3a8f61bb48f8a963c9480e53c168, State: Running, Role: LEADER
I20260709 13:06:19.640837 19377 leader_election.cc:304] T 2e36a9d6e29c4a7c860cf267efbd4c74 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87; no voters: e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:06:19.644011 19526 leader_election.cc:304] T 76cb037fc9064d13b59a8969d897ce8c P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e61c3a8f61bb48f8a963c9480e53c168; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:06:19.646140 19406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df751f992649444090e27965eb1af85d" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
I20260709 13:06:19.646870 19406 raft_consensus.cc:3060] T df751f992649444090e27965eb1af85d P e5256d91808b47c195bc9b4dbd7f2b87 [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:06:19.636952 19374 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.4:43121, user_credentials={real_user=slave}} blocked reactor thread for 44648us
I20260709 13:06:19.647634 19374 leader_election.cc:304] T 775c229504194560ba9589bc2199b089 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, 127766fc592545a4997f7790f50f6076
I20260709 13:06:19.650877 19478 raft_consensus.cc:1275] T 1efebf73c86e432baa55533136b6e12c P 0473d2b2d01f4459b1e90fd12cc7840e [term 12 FOLLOWER]: Refusing update from remote peer 127766fc592545a4997f7790f50f6076: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 13:06:19.592412 24192 consensus_queue.cc:1048] T a08760e15aac4630a629431f56024dc8 P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.070s
I20260709 13:06:19.595814 24154 consensus_queue.cc:1048] T 62c6c134d3d24a1ab144dd9ee6bc3f64 P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Connected to new peer: Peer: permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.051s
I20260709 13:06:19.644299 24226 raft_consensus.cc:3055] T 2e36a9d6e29c4a7c860cf267efbd4c74 P e61c3a8f61bb48f8a963c9480e53c168 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:06:19.667152 19406 raft_consensus.cc:2468] T df751f992649444090e27965eb1af85d P e5256d91808b47c195bc9b4dbd7f2b87 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 16.
W20260709 13:06:19.652904 19523 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:19.609306 24169 consensus_queue.cc:1048] T 1a61655d99124a29b486ba4a5b37faea P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.043s
I20260709 13:06:19.644811 24061 raft_consensus.cc:2804] T 62c6c134d3d24a1ab144dd9ee6bc3f64 P 127766fc592545a4997f7790f50f6076 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:06:19.686122 19406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a08760e15aac4630a629431f56024dc8" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
I20260709 13:06:19.692380 19406 raft_consensus.cc:3060] T a08760e15aac4630a629431f56024dc8 P e5256d91808b47c195bc9b4dbd7f2b87 [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:06:19.688452 19526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.2:46257, user_credentials={real_user=slave}} blocked reactor thread for 44497.1us
I20260709 13:06:19.695238 19526 leader_election.cc:304] T 48824d5acfbc485ebf8c2d944e7202de P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e61c3a8f61bb48f8a963c9480e53c168; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, 127766fc592545a4997f7790f50f6076
W20260709 13:06:19.689508 20076 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.3:36891, user_credentials={real_user=slave}} blocked reactor thread for 44515.2us
I20260709 13:06:19.648650 23919 raft_consensus.cc:2749] T 85c494af21f9457a85da47b9bc70c1fd P e5256d91808b47c195bc9b4dbd7f2b87 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
W20260709 13:06:19.699813 19523 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:19.642836 23538 consensus_queue.cc:1048] T 6c5eebf646ad445a9d1b1adc319d7b16 P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Connected to new peer: Peer: permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.042s
I20260709 13:06:19.707549 19406 raft_consensus.cc:2468] T a08760e15aac4630a629431f56024dc8 P e5256d91808b47c195bc9b4dbd7f2b87 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 16.
I20260709 13:06:19.693570 24061 raft_consensus.cc:493] T 62c6c134d3d24a1ab144dd9ee6bc3f64 P 127766fc592545a4997f7790f50f6076 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:19.691565 24226 raft_consensus.cc:740] T 2e36a9d6e29c4a7c860cf267efbd4c74 P e61c3a8f61bb48f8a963c9480e53c168 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: e61c3a8f61bb48f8a963c9480e53c168, State: Running, Role: LEADER
I20260709 13:06:19.718931 19523 leader_election.cc:304] T df751f992649444090e27965eb1af85d P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:06:19.697814 24119 consensus_queue.cc:1059] T 179fd671030940b4b4a4e24bcc4aba0a P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 }, Status: INVALID_TERM, Last received: 13.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.025s
I20260709 13:06:19.714018 23878 raft_consensus.cc:2749] T 775c229504194560ba9589bc2199b089 P e5256d91808b47c195bc9b4dbd7f2b87 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:06:19.712594 24238 raft_consensus.cc:2749] T 76cb037fc9064d13b59a8969d897ce8c P e61c3a8f61bb48f8a963c9480e53c168 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:06:19.719098 24061 raft_consensus.cc:3060] T 62c6c134d3d24a1ab144dd9ee6bc3f64 P 127766fc592545a4997f7790f50f6076 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:06:19.666482 24188 consensus_queue.cc:260] T 1efebf73c86e432baa55533136b6e12c P e61c3a8f61bb48f8a963c9480e53c168 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:19.752753 24188 raft_consensus.cc:3060] T 1efebf73c86e432baa55533136b6e12c P e61c3a8f61bb48f8a963c9480e53c168 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:06:19.710919 24089 raft_consensus.cc:515] T 3e1f505cb0f1427bbd698ac889d80821 P e61c3a8f61bb48f8a963c9480e53c168 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:19.759512 24238 raft_consensus.cc:2804] T df751f992649444090e27965eb1af85d P e61c3a8f61bb48f8a963c9480e53c168 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:06:19.760157 24238 raft_consensus.cc:697] T df751f992649444090e27965eb1af85d P e61c3a8f61bb48f8a963c9480e53c168 [term 16 LEADER]: Becoming Leader. State: Replica: e61c3a8f61bb48f8a963c9480e53c168, State: Running, Role: LEADER
W20260709 13:06:19.761622 20075 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.1:40321, user_credentials={real_user=slave}} blocked reactor thread for 167087us
W20260709 13:06:19.751327 24217 log.cc:927] Time spent T 65d8cb8d6ec64f459d5a47cefab10acf P e5256d91808b47c195bc9b4dbd7f2b87: Append to log took a long time: real 0.269s	user 0.001s	sys 0.000s
W20260709 13:06:19.798341 19374 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.4:43121, user_credentials={real_user=slave}} blocked reactor thread for 150769us
I20260709 13:06:19.788252 24236 raft_consensus.cc:2749] T 48824d5acfbc485ebf8c2d944e7202de P e61c3a8f61bb48f8a963c9480e53c168 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:06:19.726846 23974 consensus_queue.cc:237] T 1dc5b3532fe54f74876d02beffa2c230 P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.6, Last appended by leader: 6, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:19.825820 19408 raft_consensus.cc:1275] T 2725d2c4cb054f18b0fc8f735c15f6c2 P e5256d91808b47c195bc9b4dbd7f2b87 [term 15 FOLLOWER]: Refusing update from remote peer e61c3a8f61bb48f8a963c9480e53c168: Log matching property violated. Preceding OpId in replica: term: 14 index: 7. Preceding OpId from leader: term: 15 index: 8. (index mismatch)
W20260709 13:06:19.810381 19526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.2:46257, user_credentials={real_user=slave}} blocked reactor thread for 115211us
I20260709 13:06:19.842005 19526 leader_election.cc:400] T 28af091831594f9d8e96482078cc7625 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 13 pre-election: Vote denied by peer 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257) with higher term. Message: Invalid argument: T 28af091831594f9d8e96482078cc7625 P 0473d2b2d01f4459b1e90fd12cc7840e [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e61c3a8f61bb48f8a963c9480e53c168 for earlier term 13. Current term is 14.
I20260709 13:06:19.856056 19526 leader_election.cc:403] T 28af091831594f9d8e96482078cc7625 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 13 pre-election: Cancelling election due to peer responding with higher term
W20260709 13:06:19.858227 20076 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.3:36891, user_credentials={real_user=slave}} blocked reactor thread for 150019us
I20260709 13:06:19.860754 20076 leader_election.cc:304] T ab43d85f64114d4ebf618930e43d9ed0 P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 127766fc592545a4997f7790f50f6076, e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168; no voters: 0473d2b2d01f4459b1e90fd12cc7840e
W20260709 13:06:19.877053 24220 log.cc:927] Time spent T 7f575b143b844aa096b50997dad3516a P e61c3a8f61bb48f8a963c9480e53c168: Append to log took a long time: real 0.093s	user 0.000s	sys 0.006s
W20260709 13:06:19.879370 24230 log.cc:927] Time spent T edd7d470b5014c9489be7f41f64355c9 P e5256d91808b47c195bc9b4dbd7f2b87: Append to log took a long time: real 0.126s	user 0.000s	sys 0.001s
I20260709 13:06:19.859582 24126 leader_election.cc:290] T 833a2f0775ed407a94b8924ce50adb63 P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 12 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
W20260709 13:06:19.880971 24237 log.cc:927] Time spent T 46c5bfeecc314717bffe987e6844b6d0 P e61c3a8f61bb48f8a963c9480e53c168: Append to log took a long time: real 0.135s	user 0.001s	sys 0.000s
W20260709 13:06:19.882874 24225 log.cc:927] Time spent T 4509b76741dc428e9201c70c1658da13 P e5256d91808b47c195bc9b4dbd7f2b87: Append to log took a long time: real 0.245s	user 0.001s	sys 0.000s
W20260709 13:06:19.883458 24218 log.cc:927] Time spent T 179fd671030940b4b4a4e24bcc4aba0a P 0473d2b2d01f4459b1e90fd12cc7840e: Append to log took a long time: real 0.256s	user 0.001s	sys 0.000s
I20260709 13:06:19.862138 24235 raft_consensus.cc:2749] T 28af091831594f9d8e96482078cc7625 P e61c3a8f61bb48f8a963c9480e53c168 [term 14 FOLLOWER]: Leader pre-election lost for term 13. Reason: Vote denied by peer 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257) with higher term. Message: Invalid argument: T 28af091831594f9d8e96482078cc7625 P 0473d2b2d01f4459b1e90fd12cc7840e [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e61c3a8f61bb48f8a963c9480e53c168 for earlier term 13. Current term is 14.
W20260709 13:06:19.885675 24228 log.cc:927] Time spent T 217b5fae677b4971b3bbd2f357a1f7ff P e61c3a8f61bb48f8a963c9480e53c168: Append to log took a long time: real 0.213s	user 0.000s	sys 0.002s
W20260709 13:06:19.891026 24224 log.cc:927] Time spent T 4509b76741dc428e9201c70c1658da13 P e61c3a8f61bb48f8a963c9480e53c168: Append to log took a long time: real 0.193s	user 0.000s	sys 0.001s
I20260709 13:06:19.821902 24229 raft_consensus.cc:2804] T 2e36a9d6e29c4a7c860cf267efbd4c74 P e5256d91808b47c195bc9b4dbd7f2b87 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:06:19.880846 24126 raft_consensus.cc:2804] T ab43d85f64114d4ebf618930e43d9ed0 P 127766fc592545a4997f7790f50f6076 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:06:19.897754 19559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "833a2f0775ed407a94b8924ce50adb63" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:06:19.856808 24169 raft_consensus.cc:493] T 0cdf56e38bbc453d9438d359e5a69955 P e5256d91808b47c195bc9b4dbd7f2b87 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 0473d2b2d01f4459b1e90fd12cc7840e)
W20260709 13:06:19.931366 19526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.2:46257, user_credentials={real_user=slave}} blocked reactor thread for 71009.7us
I20260709 13:06:19.932873 19526 leader_election.cc:304] T 40e1e16737a842ee936002830f36882e P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e61c3a8f61bb48f8a963c9480e53c168; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:06:19.937951 24246 raft_consensus.cc:2749] T 40e1e16737a842ee936002830f36882e P e61c3a8f61bb48f8a963c9480e53c168 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:06:19.946413 24126 raft_consensus.cc:697] T ab43d85f64114d4ebf618930e43d9ed0 P 127766fc592545a4997f7790f50f6076 [term 14 LEADER]: Becoming Leader. State: Replica: 127766fc592545a4997f7790f50f6076, State: Running, Role: LEADER
I20260709 13:06:19.947184 24229 raft_consensus.cc:697] T 2e36a9d6e29c4a7c860cf267efbd4c74 P e5256d91808b47c195bc9b4dbd7f2b87 [term 11 LEADER]: Becoming Leader. State: Replica: e5256d91808b47c195bc9b4dbd7f2b87, State: Running, Role: LEADER
I20260709 13:06:19.947798 24126 consensus_queue.cc:237] T ab43d85f64114d4ebf618930e43d9ed0 P 127766fc592545a4997f7790f50f6076 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 13.7, Last appended by leader: 7, Current term: 14, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } attrs { replace: true } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:19.948171 24229 consensus_queue.cc:237] T 2e36a9d6e29c4a7c860cf267efbd4c74 P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:19.953799 23918 raft_consensus.cc:515] T 14efcc79969f41babe5529c22d59156d P e5256d91808b47c195bc9b4dbd7f2b87 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:19.961012 19526 leader_election.cc:304] T ed7fdbcb96d14d418db9ca90a792588a P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e61c3a8f61bb48f8a963c9480e53c168; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, 127766fc592545a4997f7790f50f6076
I20260709 13:06:19.998322 19410 raft_consensus.cc:2393] T 14efcc79969f41babe5529c22d59156d P e5256d91808b47c195bc9b4dbd7f2b87 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 127766fc592545a4997f7790f50f6076 in current term 14: Already voted for candidate e5256d91808b47c195bc9b4dbd7f2b87 in this term.
W20260709 13:06:19.999308 20075 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.1:40321, user_credentials={real_user=slave}} blocked reactor thread for 222812us
I20260709 13:06:20.001631 19409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e1f505cb0f1427bbd698ac889d80821" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
I20260709 13:06:20.002350 19409 raft_consensus.cc:3060] T 3e1f505cb0f1427bbd698ac889d80821 P e5256d91808b47c195bc9b4dbd7f2b87 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:06:19.995709 24246 raft_consensus.cc:2749] T ed7fdbcb96d14d418db9ca90a792588a P e61c3a8f61bb48f8a963c9480e53c168 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:06:20.007583 19411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "833a2f0775ed407a94b8924ce50adb63" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
I20260709 13:06:20.016132 24236 consensus_queue.cc:1048] T 22196caba61445d3bec98a0aab3c337d P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:06:20.017807 19526 leader_election.cc:304] T fa8650e71aa14778b3d73721fc50d9fc P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e61c3a8f61bb48f8a963c9480e53c168; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:06:19.936086 24169 raft_consensus.cc:515] T 0cdf56e38bbc453d9438d359e5a69955 P e5256d91808b47c195bc9b4dbd7f2b87 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:20.043807 24089 leader_election.cc:290] T 3e1f505cb0f1427bbd698ac889d80821 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 14 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:06:20.044981 24173 raft_consensus.cc:493] T 2725d2c4cb054f18b0fc8f735c15f6c2 P 0473d2b2d01f4459b1e90fd12cc7840e [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:20.084640 24173 raft_consensus.cc:515] T 2725d2c4cb054f18b0fc8f735c15f6c2 P 0473d2b2d01f4459b1e90fd12cc7840e [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:20.045984 23795 raft_consensus.cc:493] T ff9b0eddd810459b82d91c60777c10eb P 0473d2b2d01f4459b1e90fd12cc7840e [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:20.086983 23795 raft_consensus.cc:515] T ff9b0eddd810459b82d91c60777c10eb P 0473d2b2d01f4459b1e90fd12cc7840e [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:20.089512 23795 leader_election.cc:290] T ff9b0eddd810459b82d91c60777c10eb P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:06:20.049114 23918 leader_election.cc:290] T 14efcc79969f41babe5529c22d59156d P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 14 election: Requested vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:06:20.056241 24169 leader_election.cc:290] T 0cdf56e38bbc453d9438d359e5a69955 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:06:20.057111 19411 raft_consensus.cc:1275] T d1e5873a19244c5ebbcd38e126796ee7 P e5256d91808b47c195bc9b4dbd7f2b87 [term 14 FOLLOWER]: Refusing update from remote peer e61c3a8f61bb48f8a963c9480e53c168: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 13:06:20.018466 24199 consensus_queue.cc:1048] T 2e36a9d6e29c4a7c860cf267efbd4c74 P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.040s
I20260709 13:06:20.092276 19411 raft_consensus.cc:1240] T 179fd671030940b4b4a4e24bcc4aba0a P e5256d91808b47c195bc9b4dbd7f2b87 [term 14 FOLLOWER]: Rejecting Update request from peer e61c3a8f61bb48f8a963c9480e53c168 for earlier term 13. Current term is 14. Ops: []
I20260709 13:06:20.042384 24240 raft_consensus.cc:493] T 0afb57ae58a24a01850491d69f0213dd P e61c3a8f61bb48f8a963c9480e53c168 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 0473d2b2d01f4459b1e90fd12cc7840e)
I20260709 13:06:20.092826 24240 raft_consensus.cc:515] T 0afb57ae58a24a01850491d69f0213dd P e61c3a8f61bb48f8a963c9480e53c168 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:20.095785 24240 leader_election.cc:290] T 0afb57ae58a24a01850491d69f0213dd P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:06:19.858636 24238 consensus_queue.cc:237] T df751f992649444090e27965eb1af85d P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.9, Last appended by leader: 9, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:20.024834 24119 raft_consensus.cc:2749] T fa8650e71aa14778b3d73721fc50d9fc P e61c3a8f61bb48f8a963c9480e53c168 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:06:20.101982 24173 leader_election.cc:290] T 2725d2c4cb054f18b0fc8f735c15f6c2 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:06:20.114616 19554 raft_consensus.cc:1275] T 1efebf73c86e432baa55533136b6e12c P e61c3a8f61bb48f8a963c9480e53c168 [term 12 FOLLOWER]: Refusing update from remote peer 127766fc592545a4997f7790f50f6076: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 13:06:20.126796 24061 raft_consensus.cc:515] T 62c6c134d3d24a1ab144dd9ee6bc3f64 P 127766fc592545a4997f7790f50f6076 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
W20260709 13:06:20.128324 24162 consensus_meta.cc:287] T ff75a1d4cb1f493db8f71ddc136ba9ab P e5256d91808b47c195bc9b4dbd7f2b87: Time spent flushing consensus metadata: real 0.592s	user 0.005s	sys 0.007s
I20260709 13:06:20.143301 19409 raft_consensus.cc:2468] T 3e1f505cb0f1427bbd698ac889d80821 P e5256d91808b47c195bc9b4dbd7f2b87 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 14.
I20260709 13:06:20.155620 24226 consensus_queue.cc:260] T 2e36a9d6e29c4a7c860cf267efbd4c74 P e61c3a8f61bb48f8a963c9480e53c168 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:20.162012 24227 raft_consensus.cc:3055] T 179fd671030940b4b4a4e24bcc4aba0a P e61c3a8f61bb48f8a963c9480e53c168 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:06:20.165952 20078 leader_election.cc:304] T 0afb57ae58a24a01850491d69f0213dd P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 127766fc592545a4997f7790f50f6076; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:06:20.167294 19559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22196caba61445d3bec98a0aab3c337d" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
W20260709 13:06:20.175464 19404 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.514s	user 0.002s	sys 0.032s
W20260709 13:06:20.178318 19404 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.517s	user 0.002s	sys 0.032s
I20260709 13:06:20.180589 19408 raft_consensus.cc:1240] T 2e36a9d6e29c4a7c860cf267efbd4c74 P e5256d91808b47c195bc9b4dbd7f2b87 [term 11 LEADER]: Rejecting Update request from peer e61c3a8f61bb48f8a963c9480e53c168 for earlier term 10. Current term is 11. Ops: [10.6-10.6]
I20260709 13:06:20.186621 19377 leader_election.cc:304] T 22196caba61445d3bec98a0aab3c337d P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:06:20.188508 19405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22196caba61445d3bec98a0aab3c337d" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
I20260709 13:06:20.193204 20110 raft_consensus.cc:1240] T 62c6c134d3d24a1ab144dd9ee6bc3f64 P 127766fc592545a4997f7790f50f6076 [term 13 FOLLOWER]: Rejecting Update request from peer 0473d2b2d01f4459b1e90fd12cc7840e for earlier term 12. Current term is 13. Ops: [12.11-12.11]
I20260709 13:06:20.176910 24227 raft_consensus.cc:740] T 179fd671030940b4b4a4e24bcc4aba0a P e61c3a8f61bb48f8a963c9480e53c168 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: e61c3a8f61bb48f8a963c9480e53c168, State: Running, Role: LEADER
I20260709 13:06:20.207283 24229 raft_consensus.cc:3060] T 22196caba61445d3bec98a0aab3c337d P e5256d91808b47c195bc9b4dbd7f2b87 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:06:20.208596 24190 raft_consensus.cc:493] T 65d8cb8d6ec64f459d5a47cefab10acf P 127766fc592545a4997f7790f50f6076 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:20.192917 24226 raft_consensus.cc:3060] T 2e36a9d6e29c4a7c860cf267efbd4c74 P e61c3a8f61bb48f8a963c9480e53c168 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:06:20.199908 24255 raft_consensus.cc:493] T 2725d2c4cb054f18b0fc8f735c15f6c2 P e5256d91808b47c195bc9b4dbd7f2b87 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:20.192344 24173 raft_consensus.cc:493] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P 0473d2b2d01f4459b1e90fd12cc7840e [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 127766fc592545a4997f7790f50f6076)
W20260709 13:06:20.225234 20078 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.2:46257, user_credentials={real_user=slave}} blocked reactor thread for 59381.6us
I20260709 13:06:20.226033 20078 leader_election.cc:304] T 14efcc79969f41babe5529c22d59156d P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, 127766fc592545a4997f7790f50f6076; no voters: 
I20260709 13:06:20.229674 20106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0afb57ae58a24a01850491d69f0213dd" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:06:20.232071 20106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14efcc79969f41babe5529c22d59156d" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076"
I20260709 13:06:20.232600 20106 raft_consensus.cc:3060] T 14efcc79969f41babe5529c22d59156d P 127766fc592545a4997f7790f50f6076 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:06:20.178694 24162 raft_consensus.cc:515] T ff75a1d4cb1f493db8f71ddc136ba9ab P e5256d91808b47c195bc9b4dbd7f2b87 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:20.240793 19556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2725d2c4cb054f18b0fc8f735c15f6c2" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 16 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:06:20.242172 20103 raft_consensus.cc:1240] T 833a2f0775ed407a94b8924ce50adb63 P 127766fc592545a4997f7790f50f6076 [term 12 FOLLOWER]: Rejecting Update request from peer e5256d91808b47c195bc9b4dbd7f2b87 for earlier term 11. Current term is 12. Ops: []
I20260709 13:06:20.219841 23928 consensus_queue.cc:1048] T 6c5eebf646ad445a9d1b1adc319d7b16 P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.020s
I20260709 13:06:20.243300 24259 raft_consensus.cc:493] T 40e1e16737a842ee936002830f36882e P 0473d2b2d01f4459b1e90fd12cc7840e [term 15 FOLLOWER]: Starting pre-election (detected failure of leader e5256d91808b47c195bc9b4dbd7f2b87)
I20260709 13:06:20.218534 24255 raft_consensus.cc:515] T 2725d2c4cb054f18b0fc8f735c15f6c2 P e5256d91808b47c195bc9b4dbd7f2b87 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:20.256896 24259 raft_consensus.cc:515] T 40e1e16737a842ee936002830f36882e P 0473d2b2d01f4459b1e90fd12cc7840e [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:20.263036 24257 consensus_queue.cc:1059] T 833a2f0775ed407a94b8924ce50adb63 P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:06:20.264432 24257 raft_consensus.cc:3055] T 833a2f0775ed407a94b8924ce50adb63 P e5256d91808b47c195bc9b4dbd7f2b87 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:06:20.264878 24257 raft_consensus.cc:740] T 833a2f0775ed407a94b8924ce50adb63 P e5256d91808b47c195bc9b4dbd7f2b87 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: e5256d91808b47c195bc9b4dbd7f2b87, State: Running, Role: LEADER
I20260709 13:06:20.266497 19552 raft_consensus.cc:1275] T 28af091831594f9d8e96482078cc7625 P e61c3a8f61bb48f8a963c9480e53c168 [term 14 FOLLOWER]: Refusing update from remote peer 0473d2b2d01f4459b1e90fd12cc7840e: Log matching property violated. Preceding OpId in replica: term: 12 index: 6. Preceding OpId from leader: term: 14 index: 7. (index mismatch)
I20260709 13:06:20.247025 24239 consensus_queue.cc:1048] T 62c6c134d3d24a1ab144dd9ee6bc3f64 P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.018s
I20260709 13:06:20.267804 19482 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58294 (request call id 2313) took 1593 ms. Trace:
I20260709 13:06:20.251873 19403 raft_consensus.cc:1240] T ff75a1d4cb1f493db8f71ddc136ba9ab P e5256d91808b47c195bc9b4dbd7f2b87 [term 13 FOLLOWER]: Rejecting Update request from peer e61c3a8f61bb48f8a963c9480e53c168 for earlier term 12. Current term is 13. Ops: []
I20260709 13:06:20.268278 19482 rpcz_store.cc:276] 0709 13:06:18.674553 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:18.705334 (+ 30781us) service_pool.cc:224] Handling call
0709 13:06:18.705614 (+   280us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:06:18.872793 (+167179us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:06:19.273651 (+400858us) spinlock_profiling.cc:243] Waited 2.74 ms on lock 0x7b1800085b40. stack: 00007f4a79de9343 00007f4a79de9240 00007f4a797781d4 00007f4a834b6304 00007f4a834b6299 00007f4a82ce3de1 00007f4a82cf05b1 00007f4a79dfde07 00007f4a82c58ab9 00007f4a79e1a69b 00007f4a79e1893f 00007f4a79e18455 00007f4a809003c7 00007f4a7cf129a7 00007f4a7cf220bf 00007f4a7cf22038
0709 13:06:19.477104 (+203453us) log.cc:844] Serialized 14 byte log entry
0709 13:06:20.168102 (+690998us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:06:20.177545 (+  9443us) log.cc:844] Serialized 52 byte log entry
0709 13:06:20.177761 (+   216us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:06:20.177813 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:20.177901 (+    88us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:20.267406 (+ 89505us) raft_consensus.cc:1685] finished
0709 13:06:20.267526 (+   120us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:20.267700 (+   174us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":107824,"prepare.queue_time_us":12476,"prepare.run_cpu_time_us":36,"prepare.run_wall_time_us":37,"raft.queue_time_us":161133,"raft.run_cpu_time_us":285,"raft.run_wall_time_us":27403,"spinlock_wait_cycles":6309248,"thread_start_us":922415,"threads_started":4,"wal-append.queue_time_us":315208}
I20260709 13:06:20.271275 24255 leader_election.cc:290] T 2725d2c4cb054f18b0fc8f735c15f6c2 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:06:20.242857 24227 consensus_queue.cc:260] T 179fd671030940b4b4a4e24bcc4aba0a P e61c3a8f61bb48f8a963c9480e53c168 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:20.272629 24227 raft_consensus.cc:3060] T 179fd671030940b4b4a4e24bcc4aba0a P e61c3a8f61bb48f8a963c9480e53c168 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:06:20.218189 24190 raft_consensus.cc:515] T 65d8cb8d6ec64f459d5a47cefab10acf P 127766fc592545a4997f7790f50f6076 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:20.275319 24061 leader_election.cc:290] T 62c6c134d3d24a1ab144dd9ee6bc3f64 P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 13 election: Requested vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
W20260709 13:06:20.276233 24221 log.cc:927] Time spent T f1b10566f45d4a7d9029858330e02d5b P 0473d2b2d01f4459b1e90fd12cc7840e: Append to log took a long time: real 0.799s	user 0.006s	sys 0.004s
I20260709 13:06:20.224676 23974 raft_consensus.cc:493] T f93ee515a9c14139bf566522ed8232f3 P e61c3a8f61bb48f8a963c9480e53c168 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 0473d2b2d01f4459b1e90fd12cc7840e)
I20260709 13:06:20.277575 19556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62c6c134d3d24a1ab144dd9ee6bc3f64" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:06:20.224937 24173 raft_consensus.cc:515] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P 0473d2b2d01f4459b1e90fd12cc7840e [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:20.278249 19556 raft_consensus.cc:3060] T 62c6c134d3d24a1ab144dd9ee6bc3f64 P e61c3a8f61bb48f8a963c9480e53c168 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:06:20.265875 24257 consensus_queue.cc:260] T 833a2f0775ed407a94b8924ce50adb63 P e5256d91808b47c195bc9b4dbd7f2b87 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:20.277310 23974 raft_consensus.cc:515] T f93ee515a9c14139bf566522ed8232f3 P e61c3a8f61bb48f8a963c9480e53c168 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:20.279672 24257 raft_consensus.cc:3060] T 833a2f0775ed407a94b8924ce50adb63 P e5256d91808b47c195bc9b4dbd7f2b87 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:06:20.280369 24172 raft_consensus.cc:2749] T 0afb57ae58a24a01850491d69f0213dd P 127766fc592545a4997f7790f50f6076 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:06:20.296418 20106 raft_consensus.cc:2468] T 14efcc79969f41babe5529c22d59156d P 127766fc592545a4997f7790f50f6076 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 14.
W20260709 13:06:20.297700 20078 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.2:46257, user_credentials={real_user=slave}} blocked reactor thread for 46846us
I20260709 13:06:20.301653 19374 leader_election.cc:304] T 14efcc79969f41babe5529c22d59156d P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 127766fc592545a4997f7790f50f6076, e5256d91808b47c195bc9b4dbd7f2b87; no voters: 
I20260709 13:06:20.301911 24190 leader_election.cc:290] T 65d8cb8d6ec64f459d5a47cefab10acf P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:06:20.305969 24259 leader_election.cc:290] T 40e1e16737a842ee936002830f36882e P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:06:20.314832 24255 raft_consensus.cc:2804] T 14efcc79969f41babe5529c22d59156d P e5256d91808b47c195bc9b4dbd7f2b87 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:06:20.315596 24255 raft_consensus.cc:697] T 14efcc79969f41babe5529c22d59156d P e5256d91808b47c195bc9b4dbd7f2b87 [term 14 LEADER]: Becoming Leader. State: Replica: e5256d91808b47c195bc9b4dbd7f2b87, State: Running, Role: LEADER
W20260709 13:06:20.316107 24232 log.cc:927] Time spent T 65d8cb8d6ec64f459d5a47cefab10acf P e61c3a8f61bb48f8a963c9480e53c168: Append to log took a long time: real 0.515s	user 0.000s	sys 0.008s
I20260709 13:06:20.316474 24255 consensus_queue.cc:237] T 14efcc79969f41babe5529c22d59156d P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:20.318948 24267 raft_consensus.cc:2764] T 14efcc79969f41babe5529c22d59156d P 127766fc592545a4997f7790f50f6076 [term 14 FOLLOWER]: Leader pre-election decision vote started in defunct term 13: won
I20260709 13:06:20.319501 24173 leader_election.cc:290] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:06:20.304033 19552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65d8cb8d6ec64f459d5a47cefab10acf" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:06:20.335446 19556 raft_consensus.cc:2468] T 62c6c134d3d24a1ab144dd9ee6bc3f64 P e61c3a8f61bb48f8a963c9480e53c168 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 127766fc592545a4997f7790f50f6076 in term 13.
I20260709 13:06:20.336750 20110 raft_consensus.cc:1275] T 65d8cb8d6ec64f459d5a47cefab10acf P 127766fc592545a4997f7790f50f6076 [term 13 FOLLOWER]: Refusing update from remote peer e5256d91808b47c195bc9b4dbd7f2b87: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 13:06:20.337567 20076 leader_election.cc:304] T 62c6c134d3d24a1ab144dd9ee6bc3f64 P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 127766fc592545a4997f7790f50f6076, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:06:20.344578 20075 leader_election.cc:304] T 833a2f0775ed407a94b8924ce50adb63 P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 127766fc592545a4997f7790f50f6076; no voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:06:20.355432 19409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65d8cb8d6ec64f459d5a47cefab10acf" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:06:20.357460 24162 leader_election.cc:290] T ff75a1d4cb1f493db8f71ddc136ba9ab P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 13 election: Requested vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:06:20.359210 23974 leader_election.cc:290] T f93ee515a9c14139bf566522ed8232f3 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:06:20.366984 24277 raft_consensus.cc:493] T ff9b0eddd810459b82d91c60777c10eb P 127766fc592545a4997f7790f50f6076 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:20.367751 24277 raft_consensus.cc:515] T ff9b0eddd810459b82d91c60777c10eb P 127766fc592545a4997f7790f50f6076 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:20.369043 24172 raft_consensus.cc:2804] T 62c6c134d3d24a1ab144dd9ee6bc3f64 P 127766fc592545a4997f7790f50f6076 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:06:20.369542 24172 raft_consensus.cc:697] T 62c6c134d3d24a1ab144dd9ee6bc3f64 P 127766fc592545a4997f7790f50f6076 [term 13 LEADER]: Becoming Leader. State: Replica: 127766fc592545a4997f7790f50f6076, State: Running, Role: LEADER
I20260709 13:06:20.370390 24172 consensus_queue.cc:237] T 62c6c134d3d24a1ab144dd9ee6bc3f64 P 127766fc592545a4997f7790f50f6076 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:20.371299 19409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f93ee515a9c14139bf566522ed8232f3" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 16 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:06:20.388460 24266 raft_consensus.cc:2749] T 833a2f0775ed407a94b8924ce50adb63 P 127766fc592545a4997f7790f50f6076 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
W20260709 13:06:20.403784 19523 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:20.422420 19450 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.3:36891, user_credentials={real_user=slave}} blocked reactor thread for 186397us
I20260709 13:06:20.425288 24285 raft_consensus.cc:493] T 7be9efa6559648dbb5a0f7684c4542d1 P 127766fc592545a4997f7790f50f6076 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 0473d2b2d01f4459b1e90fd12cc7840e)
I20260709 13:06:20.425925 24285 raft_consensus.cc:515] T 7be9efa6559648dbb5a0f7684c4542d1 P 127766fc592545a4997f7790f50f6076 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } attrs { replace: true } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:20.427199 19555 raft_consensus.cc:1240] T 62c6c134d3d24a1ab144dd9ee6bc3f64 P e61c3a8f61bb48f8a963c9480e53c168 [term 13 FOLLOWER]: Rejecting Update request from peer 0473d2b2d01f4459b1e90fd12cc7840e for earlier term 12. Current term is 13. Ops: [12.11-12.11]
W20260709 13:06:20.429435 24269 log.cc:927] Time spent T df751f992649444090e27965eb1af85d P e61c3a8f61bb48f8a963c9480e53c168: Append to log took a long time: real 0.174s	user 0.003s	sys 0.000s
I20260709 13:06:20.431469 19555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40e1e16737a842ee936002830f36882e" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:06:20.431941 24285 leader_election.cc:290] T 7be9efa6559648dbb5a0f7684c4542d1 P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:06:20.433976 19560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7be9efa6559648dbb5a0f7684c4542d1" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:06:20.436920 24254 consensus_queue.cc:1048] T 1efebf73c86e432baa55533136b6e12c P 127766fc592545a4997f7790f50f6076 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.104s
I20260709 13:06:20.437894 19555 raft_consensus.cc:1240] T a08760e15aac4630a629431f56024dc8 P e61c3a8f61bb48f8a963c9480e53c168 [term 16 FOLLOWER]: Rejecting Update request from peer 0473d2b2d01f4459b1e90fd12cc7840e for earlier term 15. Current term is 16. Ops: [15.9-15.9]
I20260709 13:06:20.441351 19409 raft_consensus.cc:1275] T 1dc5b3532fe54f74876d02beffa2c230 P e5256d91808b47c195bc9b4dbd7f2b87 [term 13 FOLLOWER]: Refusing update from remote peer e61c3a8f61bb48f8a963c9480e53c168: Log matching property violated. Preceding OpId in replica: term: 12 index: 6. Preceding OpId from leader: term: 13 index: 7. (index mismatch)
I20260709 13:06:20.445401 24229 raft_consensus.cc:2749] T 22196caba61445d3bec98a0aab3c337d P e5256d91808b47c195bc9b4dbd7f2b87 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:06:20.446789 20103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff9b0eddd810459b82d91c60777c10eb" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:06:20.447538 20103 raft_consensus.cc:2468] T ff9b0eddd810459b82d91c60777c10eb P 127766fc592545a4997f7790f50f6076 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 13.
I20260709 13:06:20.448518 20105 raft_consensus.cc:1275] T 0e1085d23e8347fbbd5bce7542f4b1f4 P 127766fc592545a4997f7790f50f6076 [term 11 FOLLOWER]: Refusing update from remote peer 0473d2b2d01f4459b1e90fd12cc7840e: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:06:20.448925 19402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2725d2c4cb054f18b0fc8f735c15f6c2" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 16 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:06:20.450174 20103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36f6ba92b9ba46babe4ebd6c02e5fbd9" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:06:20.449498 19402 raft_consensus.cc:2468] T 2725d2c4cb054f18b0fc8f735c15f6c2 P e5256d91808b47c195bc9b4dbd7f2b87 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 15.
I20260709 13:06:20.457773 19482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14efcc79969f41babe5529c22d59156d" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:06:20.458472 19482 raft_consensus.cc:3060] T 14efcc79969f41babe5529c22d59156d P 0473d2b2d01f4459b1e90fd12cc7840e [term 12 FOLLOWER]: Advancing to term 14
I20260709 13:06:20.460011 19479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cdf56e38bbc453d9438d359e5a69955" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:06:20.460781 19481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2725d2c4cb054f18b0fc8f735c15f6c2" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 16 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:06:20.461556 19481 raft_consensus.cc:2468] T 2725d2c4cb054f18b0fc8f735c15f6c2 P 0473d2b2d01f4459b1e90fd12cc7840e [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 15.
I20260709 13:06:20.464438 19402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40e1e16737a842ee936002830f36882e" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:06:20.423692 24226 raft_consensus.cc:493] T 6c5eebf646ad445a9d1b1adc319d7b16 P e61c3a8f61bb48f8a963c9480e53c168 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:06:20.470898 19525 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:20.474347 19404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff9b0eddd810459b82d91c60777c10eb" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:06:20.476181 19409 raft_consensus.cc:1275] T 179fd671030940b4b4a4e24bcc4aba0a P e5256d91808b47c195bc9b4dbd7f2b87 [term 14 FOLLOWER]: Refusing update from remote peer 0473d2b2d01f4459b1e90fd12cc7840e: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 13:06:20.478199 19481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff75a1d4cb1f493db8f71ddc136ba9ab" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:06:20.478992 19481 raft_consensus.cc:3060] T ff75a1d4cb1f493db8f71ddc136ba9ab P 0473d2b2d01f4459b1e90fd12cc7840e [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:06:20.475196 19404 raft_consensus.cc:2468] T ff9b0eddd810459b82d91c60777c10eb P e5256d91808b47c195bc9b4dbd7f2b87 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 13.
I20260709 13:06:20.491891 19481 raft_consensus.cc:2468] T ff75a1d4cb1f493db8f71ddc136ba9ab P 0473d2b2d01f4459b1e90fd12cc7840e [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 13.
W20260709 13:06:20.494820 24270 log.cc:927] Time spent T 46c5bfeecc314717bffe987e6844b6d0 P 0473d2b2d01f4459b1e90fd12cc7840e: Append to log took a long time: real 0.160s	user 0.000s	sys 0.001s
I20260709 13:06:20.497534 24229 raft_consensus.cc:493] T ab43d85f64114d4ebf618930e43d9ed0 P e5256d91808b47c195bc9b4dbd7f2b87 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:20.498154 24229 raft_consensus.cc:515] T ab43d85f64114d4ebf618930e43d9ed0 P e5256d91808b47c195bc9b4dbd7f2b87 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } attrs { replace: true } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:20.500988 24229 leader_election.cc:290] T ab43d85f64114d4ebf618930e43d9ed0 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:06:20.502755 19556 raft_consensus.cc:1275] T 179fd671030940b4b4a4e24bcc4aba0a P e61c3a8f61bb48f8a963c9480e53c168 [term 14 FOLLOWER]: Refusing update from remote peer 0473d2b2d01f4459b1e90fd12cc7840e: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 13:06:20.503502 24277 leader_election.cc:290] T ff9b0eddd810459b82d91c60777c10eb P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:06:20.463125 24196 raft_consensus.cc:493] T 7f575b143b844aa096b50997dad3516a P 0473d2b2d01f4459b1e90fd12cc7840e [term 10 FOLLOWER]: Starting pre-election (detected failure of leader e5256d91808b47c195bc9b4dbd7f2b87)
I20260709 13:06:20.504442 19483 raft_consensus.cc:1275] T edd7d470b5014c9489be7f41f64355c9 P 0473d2b2d01f4459b1e90fd12cc7840e [term 14 FOLLOWER]: Refusing update from remote peer e5256d91808b47c195bc9b4dbd7f2b87: Log matching property violated. Preceding OpId in replica: term: 11 index: 5. Preceding OpId from leader: term: 14 index: 7. (index mismatch)
I20260709 13:06:20.510960 19409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36f6ba92b9ba46babe4ebd6c02e5fbd9" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:06:20.514595 19402 raft_consensus.cc:1240] T a08760e15aac4630a629431f56024dc8 P e5256d91808b47c195bc9b4dbd7f2b87 [term 16 FOLLOWER]: Rejecting Update request from peer 0473d2b2d01f4459b1e90fd12cc7840e for earlier term 15. Current term is 16. Ops: [15.9-15.9]
I20260709 13:06:20.506745 19481 raft_consensus.cc:1275] T 2725d2c4cb054f18b0fc8f735c15f6c2 P 0473d2b2d01f4459b1e90fd12cc7840e [term 15 FOLLOWER]: Refusing update from remote peer e61c3a8f61bb48f8a963c9480e53c168: Log matching property violated. Preceding OpId in replica: term: 14 index: 7. Preceding OpId from leader: term: 15 index: 8. (index mismatch)
I20260709 13:06:20.506824 19484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e1f505cb0f1427bbd698ac889d80821" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:06:20.522127 19484 raft_consensus.cc:3060] T 3e1f505cb0f1427bbd698ac889d80821 P 0473d2b2d01f4459b1e90fd12cc7840e [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:06:20.508467 19449 leader_election.cc:304] T ff9b0eddd810459b82d91c60777c10eb P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, 127766fc592545a4997f7790f50f6076; no voters: 
I20260709 13:06:20.521572 19480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df751f992649444090e27965eb1af85d" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:06:20.509178 19478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b08304a0a02b42d7840c4e8ee9a6bd1a" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:06:20.523568 19480 raft_consensus.cc:3060] T df751f992649444090e27965eb1af85d P 0473d2b2d01f4459b1e90fd12cc7840e [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:06:20.473896 24048 consensus_queue.cc:1048] T 1efebf73c86e432baa55533136b6e12c P 127766fc592545a4997f7790f50f6076 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.045s
I20260709 13:06:20.523053 19483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0afb57ae58a24a01850491d69f0213dd" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:06:20.517755 19477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a08760e15aac4630a629431f56024dc8" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:06:20.523945 19409 raft_consensus.cc:1275] T 28af091831594f9d8e96482078cc7625 P e5256d91808b47c195bc9b4dbd7f2b87 [term 14 FOLLOWER]: Refusing update from remote peer 0473d2b2d01f4459b1e90fd12cc7840e: Log matching property violated. Preceding OpId in replica: term: 12 index: 6. Preceding OpId from leader: term: 14 index: 7. (index mismatch)
I20260709 13:06:20.526080 19481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7be9efa6559648dbb5a0f7684c4542d1" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:06:20.509197 24055 raft_consensus.cc:493] T 1efebf73c86e432baa55533136b6e12c P 0473d2b2d01f4459b1e90fd12cc7840e [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:20.530627 19485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f93ee515a9c14139bf566522ed8232f3" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 16 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:06:20.485538 24226 raft_consensus.cc:515] T 6c5eebf646ad445a9d1b1adc319d7b16 P e61c3a8f61bb48f8a963c9480e53c168 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:20.533545 19481 raft_consensus.cc:1240] T 2e36a9d6e29c4a7c860cf267efbd4c74 P 0473d2b2d01f4459b1e90fd12cc7840e [term 11 FOLLOWER]: Rejecting Update request from peer e61c3a8f61bb48f8a963c9480e53c168 for earlier term 10. Current term is 11. Ops: [10.6-10.6]
I20260709 13:06:20.544546 19483 raft_consensus.cc:1240] T 22196caba61445d3bec98a0aab3c337d P 0473d2b2d01f4459b1e90fd12cc7840e [term 11 FOLLOWER]: Rejecting Update request from peer e61c3a8f61bb48f8a963c9480e53c168 for earlier term 10. Current term is 11. Ops: [10.7-10.7]
I20260709 13:06:20.545958 19483 raft_consensus.cc:1275] T 1dc5b3532fe54f74876d02beffa2c230 P 0473d2b2d01f4459b1e90fd12cc7840e [term 13 FOLLOWER]: Refusing update from remote peer e61c3a8f61bb48f8a963c9480e53c168: Log matching property violated. Preceding OpId in replica: term: 12 index: 6. Preceding OpId from leader: term: 13 index: 7. (index mismatch)
I20260709 13:06:20.546835 24282 consensus_queue.cc:1059] T 62c6c134d3d24a1ab144dd9ee6bc3f64 P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false }, Status: INVALID_TERM, Last received: 10.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.024s
I20260709 13:06:20.547634 24281 raft_consensus.cc:2804] T ff9b0eddd810459b82d91c60777c10eb P 0473d2b2d01f4459b1e90fd12cc7840e [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:06:20.548043 24281 raft_consensus.cc:493] T ff9b0eddd810459b82d91c60777c10eb P 0473d2b2d01f4459b1e90fd12cc7840e [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:20.548364 24281 raft_consensus.cc:3060] T ff9b0eddd810459b82d91c60777c10eb P 0473d2b2d01f4459b1e90fd12cc7840e [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:06:20.550912 19478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62c6c134d3d24a1ab144dd9ee6bc3f64" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
W20260709 13:06:20.553386 19523 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:20.554262 19483 raft_consensus.cc:1240] T 96efeaaf1057492490e9a621f37e1a2d P 0473d2b2d01f4459b1e90fd12cc7840e [term 14 FOLLOWER]: Rejecting Update request from peer e61c3a8f61bb48f8a963c9480e53c168 for earlier term 13. Current term is 14. Ops: []
I20260709 13:06:20.556268 19477 raft_consensus.cc:1240] T ff75a1d4cb1f493db8f71ddc136ba9ab P 0473d2b2d01f4459b1e90fd12cc7840e [term 13 FOLLOWER]: Rejecting Update request from peer e61c3a8f61bb48f8a963c9480e53c168 for earlier term 12. Current term is 13. Ops: []
I20260709 13:06:20.558219 19485 raft_consensus.cc:1240] T 179fd671030940b4b4a4e24bcc4aba0a P 0473d2b2d01f4459b1e90fd12cc7840e [term 14 LEADER]: Rejecting Update request from peer e61c3a8f61bb48f8a963c9480e53c168 for earlier term 13. Current term is 14. Ops: []
I20260709 13:06:20.531620 24183 raft_consensus.cc:493] T fa8650e71aa14778b3d73721fc50d9fc P 0473d2b2d01f4459b1e90fd12cc7840e [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:20.524010 24255 raft_consensus.cc:493] T 1dc5b3532fe54f74876d02beffa2c230 P e5256d91808b47c195bc9b4dbd7f2b87 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:20.568455 19482 raft_consensus.cc:2468] T 14efcc79969f41babe5529c22d59156d P 0473d2b2d01f4459b1e90fd12cc7840e [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 14.
I20260709 13:06:20.567778 19481 raft_consensus.cc:1275] T d1e5873a19244c5ebbcd38e126796ee7 P 0473d2b2d01f4459b1e90fd12cc7840e [term 14 FOLLOWER]: Refusing update from remote peer e61c3a8f61bb48f8a963c9480e53c168: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 13:06:20.516413 24196 raft_consensus.cc:515] T 7f575b143b844aa096b50997dad3516a P 0473d2b2d01f4459b1e90fd12cc7840e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:20.536443 24192 consensus_queue.cc:1048] T 0e1085d23e8347fbbd5bce7542f4b1f4 P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Connected to new peer: Peer: permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.039s
W20260709 13:06:20.582927 19524 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:20.585566 24176 consensus_queue.cc:1048] T 28af091831594f9d8e96482078cc7625 P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:06:20.535784 18300 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:06:20.588408 24281 raft_consensus.cc:515] T ff9b0eddd810459b82d91c60777c10eb P 0473d2b2d01f4459b1e90fd12cc7840e [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:20.590459 24281 leader_election.cc:290] T ff9b0eddd810459b82d91c60777c10eb P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 14 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:06:20.591691 24041 raft_consensus.cc:3055] T 62c6c134d3d24a1ab144dd9ee6bc3f64 P 0473d2b2d01f4459b1e90fd12cc7840e [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:06:20.592093 24041 raft_consensus.cc:740] T 62c6c134d3d24a1ab144dd9ee6bc3f64 P 0473d2b2d01f4459b1e90fd12cc7840e [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 0473d2b2d01f4459b1e90fd12cc7840e, State: Running, Role: LEADER
I20260709 13:06:20.592964 24041 consensus_queue.cc:260] T 62c6c134d3d24a1ab144dd9ee6bc3f64 P 0473d2b2d01f4459b1e90fd12cc7840e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:20.594144 24041 raft_consensus.cc:3060] T 62c6c134d3d24a1ab144dd9ee6bc3f64 P 0473d2b2d01f4459b1e90fd12cc7840e [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:06:20.599068 24196 leader_election.cc:290] T 7f575b143b844aa096b50997dad3516a P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:06:20.535745 24055 raft_consensus.cc:515] T 1efebf73c86e432baa55533136b6e12c P 0473d2b2d01f4459b1e90fd12cc7840e [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:20.610049 19410 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49050 (request call id 793) took 1047 ms. Trace:
I20260709 13:06:20.610443 19410 rpcz_store.cc:276] 0709 13:06:19.562783 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:19.562911 (+   128us) service_pool.cc:224] Handling call
0709 13:06:20.609859 (+1046948us) spinlock_profiling.cc:243] Waited 392 ms on lock 0x7b5400064354. stack: 00007f4a79de9343 00007f4a79de9240 00007f4a797781d4 00007f4a834b6304 00007f4a834b6299 00007f4a7ce71571 00007f4a7cf0c2fa 00007f4a81ecdb17 00007f4a7b4486d4 00007f4a7b448662 00007f4a7b448591 00007f4a7b44850c 00007f4a7b4477c2 00007f4a7b24348c 00007f4a7b2428c6 00007f4a7b24226f
0709 13:06:20.609989 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":900694784}
W20260709 13:06:20.647780 19450 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.3:36891, user_credentials={real_user=slave}} blocked reactor thread for 66500us
I20260709 13:06:20.673660 19403 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52328 (request call id 2109) took 1023 ms. Trace:
W20260709 13:06:20.676503 19374 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:20.678992 20078 leader_election.cc:304] T 7be9efa6559648dbb5a0f7684c4542d1 P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 127766fc592545a4997f7790f50f6076; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:06:20.690502 19554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f575b143b844aa096b50997dad3516a" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:06:20.674103 19403 rpcz_store.cc:276] 0709 13:06:19.650292 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:19.708029 (+ 57737us) service_pool.cc:224] Handling call
0709 13:06:19.708337 (+   308us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:20.268785 (+560448us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:20.673433 (+404648us) spinlock_profiling.cc:243] Waited 543 ms on lock 0x7b540019ee54. stack: 00007f4a79de9343 00007f4a79de9240 00007f4a797781d4 00007f4a834b6304 00007f4a834b6299 00007f4a7ce71571 00007f4a7cf08e01 00007f4a7cf0783e 00007f4a81ecc419 00007f4a7b443bd4 00007f4a7b443b62 00007f4a7b443a91 00007f4a7b443a0c 00007f4a7b442cc2 00007f4a7b24348c 00007f4a7b2428c6
0709 13:06:20.673600 (+   167us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1249585408}
W20260709 13:06:20.701694 19449 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.1:40321, user_credentials={real_user=slave}} blocked reactor thread for 96436us
I20260709 13:06:20.697301 19377 leader_election.cc:304] T 2725d2c4cb054f18b0fc8f735c15f6c2 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87; no voters: 
I20260709 13:06:20.574100 24183 raft_consensus.cc:515] T fa8650e71aa14778b3d73721fc50d9fc P 0473d2b2d01f4459b1e90fd12cc7840e [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:20.719484 19478 raft_consensus.cc:1275] T 2e36a9d6e29c4a7c860cf267efbd4c74 P 0473d2b2d01f4459b1e90fd12cc7840e [term 11 FOLLOWER]: Refusing update from remote peer e5256d91808b47c195bc9b4dbd7f2b87: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 13:06:20.632177 24061 raft_consensus.cc:493] T 85c494af21f9457a85da47b9bc70c1fd P 127766fc592545a4997f7790f50f6076 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:20.721490 19483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab43d85f64114d4ebf618930e43d9ed0" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 15 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:06:20.725379 19483 raft_consensus.cc:2410] T ab43d85f64114d4ebf618930e43d9ed0 P 0473d2b2d01f4459b1e90fd12cc7840e [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e5256d91808b47c195bc9b4dbd7f2b87 for term 15 because replica has last-logged OpId of term: 13 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 6.
I20260709 13:06:20.727399 20103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab43d85f64114d4ebf618930e43d9ed0" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 15 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:06:20.631923 24227 raft_consensus.cc:493] T 70797e5783b5454ab0d0eea663e791e3 P e61c3a8f61bb48f8a963c9480e53c168 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 127766fc592545a4997f7790f50f6076)
I20260709 13:06:20.576166 24255 raft_consensus.cc:515] T 1dc5b3532fe54f74876d02beffa2c230 P e5256d91808b47c195bc9b4dbd7f2b87 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:20.720721 19485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff9b0eddd810459b82d91c60777c10eb" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:06:20.736905 19449 leader_election.cc:304] T 22196caba61445d3bec98a0aab3c337d P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e; no voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168
W20260709 13:06:20.712510 24245 log.cc:927] Time spent T 7f575b143b844aa096b50997dad3516a P 0473d2b2d01f4459b1e90fd12cc7840e: Append to log took a long time: real 0.066s	user 0.000s	sys 0.000s
I20260709 13:06:20.703150 24229 raft_consensus.cc:493] T d1e5873a19244c5ebbcd38e126796ee7 P e5256d91808b47c195bc9b4dbd7f2b87 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:20.744750 19485 raft_consensus.cc:2393] T ff9b0eddd810459b82d91c60777c10eb P 0473d2b2d01f4459b1e90fd12cc7840e [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 127766fc592545a4997f7790f50f6076 in current term 14: Already voted for candidate 0473d2b2d01f4459b1e90fd12cc7840e in this term.
I20260709 13:06:20.738343 19551 raft_consensus.cc:1275] T 0e1085d23e8347fbbd5bce7542f4b1f4 P e61c3a8f61bb48f8a963c9480e53c168 [term 11 FOLLOWER]: Refusing update from remote peer 0473d2b2d01f4459b1e90fd12cc7840e: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:06:20.746531 19449 leader_election.cc:304] T 2725d2c4cb054f18b0fc8f735c15f6c2 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87; no voters: e61c3a8f61bb48f8a963c9480e53c168
W20260709 13:06:20.749922 20075 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.1:40321, user_credentials={real_user=slave}} blocked reactor thread for 69300.2us
I20260709 13:06:20.750741 20075 leader_election.cc:304] T 65d8cb8d6ec64f459d5a47cefab10acf P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 127766fc592545a4997f7790f50f6076; no voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:06:20.752616 19403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7be9efa6559648dbb5a0f7684c4542d1" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:06:20.749979 24260 raft_consensus.cc:2749] T 22196caba61445d3bec98a0aab3c337d P 0473d2b2d01f4459b1e90fd12cc7840e [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:06:20.724572 24285 raft_consensus.cc:2749] T 7be9efa6559648dbb5a0f7684c4542d1 P 127766fc592545a4997f7790f50f6076 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:06:20.735289 24266 raft_consensus.cc:493] T 48824d5acfbc485ebf8c2d944e7202de P 127766fc592545a4997f7790f50f6076 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:20.736078 24163 raft_consensus.cc:2804] T 2725d2c4cb054f18b0fc8f735c15f6c2 P e5256d91808b47c195bc9b4dbd7f2b87 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:06:20.703476 24282 consensus_queue.cc:1059] T a08760e15aac4630a629431f56024dc8 P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 }, Status: INVALID_TERM, Last received: 14.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.048s
I20260709 13:06:20.736040 24238 raft_consensus.cc:493] T 7f575b143b844aa096b50997dad3516a P e61c3a8f61bb48f8a963c9480e53c168 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader e5256d91808b47c195bc9b4dbd7f2b87)
I20260709 13:06:20.735503 24267 raft_consensus.cc:493] T ece3db938bc649d4a40a51522ed5259c P 127766fc592545a4997f7790f50f6076 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader e5256d91808b47c195bc9b4dbd7f2b87)
I20260709 13:06:20.775027 19408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff9b0eddd810459b82d91c60777c10eb" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:06:20.782428 19408 raft_consensus.cc:2468] T ff9b0eddd810459b82d91c60777c10eb P e5256d91808b47c195bc9b4dbd7f2b87 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 127766fc592545a4997f7790f50f6076 in term 13.
I20260709 13:06:20.777109 19410 raft_consensus.cc:1275] T ab43d85f64114d4ebf618930e43d9ed0 P e5256d91808b47c195bc9b4dbd7f2b87 [term 14 FOLLOWER]: Refusing update from remote peer 127766fc592545a4997f7790f50f6076: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 13:06:20.745949 24033 raft_consensus.cc:493] T 1f85fc4b527a48848e5faa083b604e36 P e5256d91808b47c195bc9b4dbd7f2b87 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 127766fc592545a4997f7790f50f6076)
I20260709 13:06:20.754419 23918 raft_consensus.cc:493] T 70797e5783b5454ab0d0eea663e791e3 P e5256d91808b47c195bc9b4dbd7f2b87 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 127766fc592545a4997f7790f50f6076)
I20260709 13:06:20.755196 24229 raft_consensus.cc:515] T d1e5873a19244c5ebbcd38e126796ee7 P e5256d91808b47c195bc9b4dbd7f2b87 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:20.769112 24254 raft_consensus.cc:2749] T 65d8cb8d6ec64f459d5a47cefab10acf P 127766fc592545a4997f7790f50f6076 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:06:20.795619 19449 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.1:40321, user_credentials={real_user=slave}} blocked reactor thread for 49164.1us
I20260709 13:06:20.771490 23928 raft_consensus.cc:493] T d1e5873a19244c5ebbcd38e126796ee7 P 0473d2b2d01f4459b1e90fd12cc7840e [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:20.740360 24061 raft_consensus.cc:515] T 85c494af21f9457a85da47b9bc70c1fd P 127766fc592545a4997f7790f50f6076 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:20.775224 24163 raft_consensus.cc:493] T 2725d2c4cb054f18b0fc8f735c15f6c2 P e5256d91808b47c195bc9b4dbd7f2b87 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:20.747057 24227 raft_consensus.cc:515] T 70797e5783b5454ab0d0eea663e791e3 P e61c3a8f61bb48f8a963c9480e53c168 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:20.808959 19449 leader_election.cc:304] T 40e1e16737a842ee936002830f36882e P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e; no voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:06:20.804876 24282 raft_consensus.cc:3055] T a08760e15aac4630a629431f56024dc8 P 0473d2b2d01f4459b1e90fd12cc7840e [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:06:20.800004 24252 raft_consensus.cc:493] T fa8650e71aa14778b3d73721fc50d9fc P e5256d91808b47c195bc9b4dbd7f2b87 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 0473d2b2d01f4459b1e90fd12cc7840e)
I20260709 13:06:20.802350 23933 raft_consensus.cc:2804] T 2725d2c4cb054f18b0fc8f735c15f6c2 P 0473d2b2d01f4459b1e90fd12cc7840e [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:06:20.819454 19449 leader_election.cc:304] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e; no voters: 127766fc592545a4997f7790f50f6076, e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:06:20.808596 24163 raft_consensus.cc:3060] T 2725d2c4cb054f18b0fc8f735c15f6c2 P e5256d91808b47c195bc9b4dbd7f2b87 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:06:20.783893 24266 raft_consensus.cc:515] T 48824d5acfbc485ebf8c2d944e7202de P 127766fc592545a4997f7790f50f6076 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
W20260709 13:06:20.822124 19377 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.2:46257, user_credentials={real_user=slave}} blocked reactor thread for 70233.8us
I20260709 13:06:20.810621 23974 raft_consensus.cc:493] T ab43d85f64114d4ebf618930e43d9ed0 P e61c3a8f61bb48f8a963c9480e53c168 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:06:20.825466 20075 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.1:40321, user_credentials={real_user=slave}} blocked reactor thread for 69205.2us
I20260709 13:06:20.812383 24260 raft_consensus.cc:493] T ab43d85f64114d4ebf618930e43d9ed0 P 0473d2b2d01f4459b1e90fd12cc7840e [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:20.810906 24226 leader_election.cc:290] T 6c5eebf646ad445a9d1b1adc319d7b16 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:06:20.792071 24238 raft_consensus.cc:515] T 7f575b143b844aa096b50997dad3516a P e61c3a8f61bb48f8a963c9480e53c168 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:20.827085 19377 leader_election.cc:304] T ff75a1d4cb1f493db8f71ddc136ba9ab P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87; no voters: 
I20260709 13:06:20.791909 24267 raft_consensus.cc:515] T ece3db938bc649d4a40a51522ed5259c P 127766fc592545a4997f7790f50f6076 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:20.798107 24033 raft_consensus.cc:515] T 1f85fc4b527a48848e5faa083b604e36 P e5256d91808b47c195bc9b4dbd7f2b87 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:20.815479 24282 raft_consensus.cc:740] T a08760e15aac4630a629431f56024dc8 P 0473d2b2d01f4459b1e90fd12cc7840e [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 0473d2b2d01f4459b1e90fd12cc7840e, State: Running, Role: LEADER
I20260709 13:06:20.803741 23918 raft_consensus.cc:515] T 70797e5783b5454ab0d0eea663e791e3 P e5256d91808b47c195bc9b4dbd7f2b87 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:20.805962 23928 raft_consensus.cc:515] T d1e5873a19244c5ebbcd38e126796ee7 P 0473d2b2d01f4459b1e90fd12cc7840e [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:20.817345 23538 raft_consensus.cc:2749] T 40e1e16737a842ee936002830f36882e P 0473d2b2d01f4459b1e90fd12cc7840e [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:06:20.835176 19480 raft_consensus.cc:2468] T df751f992649444090e27965eb1af85d P 0473d2b2d01f4459b1e90fd12cc7840e [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 16.
I20260709 13:06:20.821137 23933 raft_consensus.cc:493] T 2725d2c4cb054f18b0fc8f735c15f6c2 P 0473d2b2d01f4459b1e90fd12cc7840e [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:20.841351 20075 leader_election.cc:304] T ff9b0eddd810459b82d91c60777c10eb P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 127766fc592545a4997f7790f50f6076, e5256d91808b47c195bc9b4dbd7f2b87; no voters: 
I20260709 13:06:20.844026 19377 leader_election.cc:304] T ab43d85f64114d4ebf618930e43d9ed0 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, 127766fc592545a4997f7790f50f6076
I20260709 13:06:20.815989 24192 consensus_queue.cc:1048] T 179fd671030940b4b4a4e24bcc4aba0a P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.021s
I20260709 13:06:20.827409 24188 raft_consensus.cc:493] T 46c5bfeecc314717bffe987e6844b6d0 P e61c3a8f61bb48f8a963c9480e53c168 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader e5256d91808b47c195bc9b4dbd7f2b87)
I20260709 13:06:20.855187 19484 raft_consensus.cc:2468] T 3e1f505cb0f1427bbd698ac889d80821 P 0473d2b2d01f4459b1e90fd12cc7840e [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 14.
I20260709 13:06:20.822855 24162 consensus_queue.cc:1048] T 65d8cb8d6ec64f459d5a47cefab10acf P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Connected to new peer: Peer: permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.022s
I20260709 13:06:20.841084 24169 raft_consensus.cc:2804] T ff75a1d4cb1f493db8f71ddc136ba9ab P e5256d91808b47c195bc9b4dbd7f2b87 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:06:20.878140 19560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cdf56e38bbc453d9438d359e5a69955" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:06:20.847013 23933 raft_consensus.cc:3060] T 2725d2c4cb054f18b0fc8f735c15f6c2 P 0473d2b2d01f4459b1e90fd12cc7840e [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:06:20.821941 24252 raft_consensus.cc:515] T fa8650e71aa14778b3d73721fc50d9fc P e5256d91808b47c195bc9b4dbd7f2b87 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:20.841778 24294 raft_consensus.cc:2749] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P 0473d2b2d01f4459b1e90fd12cc7840e [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:06:20.859062 24278 raft_consensus.cc:2804] T ff9b0eddd810459b82d91c60777c10eb P 127766fc592545a4997f7790f50f6076 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:06:20.888619 23928 leader_election.cc:290] T d1e5873a19244c5ebbcd38e126796ee7 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:06:20.905221 19554 raft_consensus.cc:1275] T edd7d470b5014c9489be7f41f64355c9 P e61c3a8f61bb48f8a963c9480e53c168 [term 14 FOLLOWER]: Refusing update from remote peer e5256d91808b47c195bc9b4dbd7f2b87: Log matching property violated. Preceding OpId in replica: term: 12 index: 6. Preceding OpId from leader: term: 14 index: 7. (index mismatch)
W20260709 13:06:20.891723 19449 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.1:40321, user_credentials={real_user=slave}} blocked reactor thread for 63656.5us
I20260709 13:06:20.896497 20110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70797e5783b5454ab0d0eea663e791e3" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:06:20.886993 23918 leader_election.cc:290] T 70797e5783b5454ab0d0eea663e791e3 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:06:20.898783 19523 leader_election.cc:304] T a08760e15aac4630a629431f56024dc8 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:06:20.900496 24236 raft_consensus.cc:493] T b9f0d59553ad444883fcf5b5909f9798 P e61c3a8f61bb48f8a963c9480e53c168 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 0473d2b2d01f4459b1e90fd12cc7840e)
I20260709 13:06:20.836297 23974 raft_consensus.cc:515] T ab43d85f64114d4ebf618930e43d9ed0 P e61c3a8f61bb48f8a963c9480e53c168 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } attrs { replace: true } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:20.906980 20105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c5eebf646ad445a9d1b1adc319d7b16" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:06:20.877679 24055 leader_election.cc:290] T 1efebf73c86e432baa55533136b6e12c P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:06:20.903681 24227 leader_election.cc:290] T 70797e5783b5454ab0d0eea663e791e3 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:06:20.919437 24238 leader_election.cc:290] T 7f575b143b844aa096b50997dad3516a P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:06:20.840771 24260 raft_consensus.cc:515] T ab43d85f64114d4ebf618930e43d9ed0 P 0473d2b2d01f4459b1e90fd12cc7840e [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } attrs { replace: true } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:20.919610 24266 leader_election.cc:290] T 48824d5acfbc485ebf8c2d944e7202de P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:06:20.897159 24282 consensus_queue.cc:260] T a08760e15aac4630a629431f56024dc8 P 0473d2b2d01f4459b1e90fd12cc7840e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 15.9, Last appended by leader: 9, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
W20260709 13:06:20.920289 24291 log.cc:927] Time spent T 1a61655d99124a29b486ba4a5b37faea P 0473d2b2d01f4459b1e90fd12cc7840e: Append to log took a long time: real 0.132s	user 0.001s	sys 0.000s
W20260709 13:06:20.921146 24293 log.cc:927] Time spent T 7f575b143b844aa096b50997dad3516a P e5256d91808b47c195bc9b4dbd7f2b87: Append to log took a long time: real 0.078s	user 0.000s	sys 0.000s
I20260709 13:06:20.859015 24144 consensus_queue.cc:1048] T ab43d85f64114d4ebf618930e43d9ed0 P 127766fc592545a4997f7790f50f6076 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.050s
I20260709 13:06:20.900128 24183 leader_election.cc:290] T fa8650e71aa14778b3d73721fc50d9fc P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:06:20.927162 19560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2725d2c4cb054f18b0fc8f735c15f6c2" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 16 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:06:20.906098 24278 raft_consensus.cc:493] T ff9b0eddd810459b82d91c60777c10eb P 127766fc592545a4997f7790f50f6076 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:06:20.912849 24286 log.cc:927] Time spent T 62c6c134d3d24a1ab144dd9ee6bc3f64 P 127766fc592545a4997f7790f50f6076: Append to log took a long time: real 0.352s	user 0.002s	sys 0.002s
I20260709 13:06:20.936309 19558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff75a1d4cb1f493db8f71ddc136ba9ab" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:06:20.922609 24304 raft_consensus.cc:2749] T ab43d85f64114d4ebf618930e43d9ed0 P e5256d91808b47c195bc9b4dbd7f2b87 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:06:20.939205 19411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85c494af21f9457a85da47b9bc70c1fd" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:06:20.922705 24196 consensus_queue.cc:1048] T 28af091831594f9d8e96482078cc7625 P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.026s
I20260709 13:06:20.915081 24235 raft_consensus.cc:2804] T a08760e15aac4630a629431f56024dc8 P e61c3a8f61bb48f8a963c9480e53c168 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:06:20.864065 24188 raft_consensus.cc:515] T 46c5bfeecc314717bffe987e6844b6d0 P e61c3a8f61bb48f8a963c9480e53c168 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:20.945832 19406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff9b0eddd810459b82d91c60777c10eb" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
I20260709 13:06:20.965364 19406 raft_consensus.cc:3060] T ff9b0eddd810459b82d91c60777c10eb P e5256d91808b47c195bc9b4dbd7f2b87 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:06:20.946444 19410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f575b143b844aa096b50997dad3516a" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:06:20.917750 24255 leader_election.cc:290] T 1dc5b3532fe54f74876d02beffa2c230 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:06:20.955775 20106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1efebf73c86e432baa55533136b6e12c" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:06:20.924340 24229 leader_election.cc:290] T d1e5873a19244c5ebbcd38e126796ee7 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:06:20.956384 19405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e5873a19244c5ebbcd38e126796ee7" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:06:20.971174 19405 raft_consensus.cc:2468] T d1e5873a19244c5ebbcd38e126796ee7 P e5256d91808b47c195bc9b4dbd7f2b87 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 14.
I20260709 13:06:20.973551 19405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ece3db938bc649d4a40a51522ed5259c" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:06:20.976967 19406 raft_consensus.cc:2468] T ff9b0eddd810459b82d91c60777c10eb P e5256d91808b47c195bc9b4dbd7f2b87 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 14.
W20260709 13:06:20.941066 19377 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.2:46257, user_credentials={real_user=slave}} blocked reactor thread for 97120.8us
I20260709 13:06:20.962103 20105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff9b0eddd810459b82d91c60777c10eb" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076"
I20260709 13:06:20.917322 23918 consensus_queue.cc:1048] T 2e36a9d6e29c4a7c860cf267efbd4c74 P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.036s
I20260709 13:06:20.961897 19411 raft_consensus.cc:2468] T 85c494af21f9457a85da47b9bc70c1fd P e5256d91808b47c195bc9b4dbd7f2b87 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 127766fc592545a4997f7790f50f6076 in term 11.
I20260709 13:06:20.967819 19407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa8650e71aa14778b3d73721fc50d9fc" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
W20260709 13:06:20.968667 19449 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:20.944058 24061 leader_election.cc:290] T 85c494af21f9457a85da47b9bc70c1fd P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:06:20.958094 24278 raft_consensus.cc:3060] T ff9b0eddd810459b82d91c60777c10eb P 127766fc592545a4997f7790f50f6076 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:06:20.978469 19407 raft_consensus.cc:2468] T fa8650e71aa14778b3d73721fc50d9fc P e5256d91808b47c195bc9b4dbd7f2b87 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 11.
I20260709 13:06:20.979951 19484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c5eebf646ad445a9d1b1adc319d7b16" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
W20260709 13:06:20.952937 23538 consensus_queue.cc:1175] T a08760e15aac4630a629431f56024dc8 P 0473d2b2d01f4459b1e90fd12cc7840e [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" responder_term: 16 status { last_received { term: 14 index: 8 } last_committed_idx: 8 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer 0473d2b2d01f4459b1e90fd12cc7840e for earlier term 15. Current term is 16. Ops: [15.9-15.9]" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 13:06:20.979912 19479 raft_consensus.cc:1275] T df751f992649444090e27965eb1af85d P 0473d2b2d01f4459b1e90fd12cc7840e [term 16 FOLLOWER]: Refusing update from remote peer e61c3a8f61bb48f8a963c9480e53c168: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 13:06:20.935096 24227 consensus_queue.cc:1048] T 2725d2c4cb054f18b0fc8f735c15f6c2 P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.029s
I20260709 13:06:20.987872 24255 raft_consensus.cc:493] T f93ee515a9c14139bf566522ed8232f3 P e5256d91808b47c195bc9b4dbd7f2b87 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 0473d2b2d01f4459b1e90fd12cc7840e)
I20260709 13:06:20.988667 24255 raft_consensus.cc:515] T f93ee515a9c14139bf566522ed8232f3 P e5256d91808b47c195bc9b4dbd7f2b87 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:20.989125 24227 consensus_queue.cc:1048] T d1e5873a19244c5ebbcd38e126796ee7 P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:06:20.990513 23974 leader_election.cc:290] T ab43d85f64114d4ebf618930e43d9ed0 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:06:20.990921 24238 consensus_queue.cc:1048] T 2725d2c4cb054f18b0fc8f735c15f6c2 P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:06:20.965126 24162 raft_consensus.cc:493] T 21e14947d70440f19044d8f75c31e1f9 P e5256d91808b47c195bc9b4dbd7f2b87 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 0473d2b2d01f4459b1e90fd12cc7840e)
W20260709 13:06:20.991287 24295 log.cc:927] Time spent T 1efebf73c86e432baa55533136b6e12c P e61c3a8f61bb48f8a963c9480e53c168: Append to log took a long time: real 0.061s	user 0.000s	sys 0.000s
I20260709 13:06:20.987911 19557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70797e5783b5454ab0d0eea663e791e3" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:06:20.992502 19557 raft_consensus.cc:2468] T 70797e5783b5454ab0d0eea663e791e3 P e61c3a8f61bb48f8a963c9480e53c168 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 12.
I20260709 13:06:20.962543 24282 raft_consensus.cc:3060] T a08760e15aac4630a629431f56024dc8 P 0473d2b2d01f4459b1e90fd12cc7840e [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:06:20.995080 19560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab43d85f64114d4ebf618930e43d9ed0" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 15 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:06:20.995851 19560 raft_consensus.cc:2410] T ab43d85f64114d4ebf618930e43d9ed0 P e61c3a8f61bb48f8a963c9480e53c168 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e5256d91808b47c195bc9b4dbd7f2b87 for term 15 because replica has last-logged OpId of term: 13 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 6.
I20260709 13:06:20.970022 24024 raft_consensus.cc:493] T 1dc5b3532fe54f74876d02beffa2c230 P 0473d2b2d01f4459b1e90fd12cc7840e [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:20.999065 24304 raft_consensus.cc:493] T 2b74109013a140ada21feeef92d6f563 P e5256d91808b47c195bc9b4dbd7f2b87 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 0473d2b2d01f4459b1e90fd12cc7840e)
I20260709 13:06:20.999728 24304 raft_consensus.cc:515] T 2b74109013a140ada21feeef92d6f563 P e5256d91808b47c195bc9b4dbd7f2b87 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:21.002197 24304 leader_election.cc:290] T 2b74109013a140ada21feeef92d6f563 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:06:20.916735 24297 consensus_queue.cc:1048] T edd7d470b5014c9489be7f41f64355c9 P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.059s
I20260709 13:06:20.985360 20075 leader_election.cc:304] T 85c494af21f9457a85da47b9bc70c1fd P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 127766fc592545a4997f7790f50f6076, e5256d91808b47c195bc9b4dbd7f2b87; no voters: 
I20260709 13:06:20.999068 24024 raft_consensus.cc:515] T 1dc5b3532fe54f74876d02beffa2c230 P 0473d2b2d01f4459b1e90fd12cc7840e [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:21.006023 24260 leader_election.cc:290] T ab43d85f64114d4ebf618930e43d9ed0 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:06:21.006114 24024 leader_election.cc:290] T 1dc5b3532fe54f74876d02beffa2c230 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
W20260709 13:06:20.983301 19526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.2:46257, user_credentials={real_user=slave}} blocked reactor thread for 69196.1us
W20260709 13:06:21.007778 24300 log.cc:927] Time spent T 28af091831594f9d8e96482078cc7625 P e61c3a8f61bb48f8a963c9480e53c168: Append to log took a long time: real 0.069s	user 0.000s	sys 0.001s
I20260709 13:06:21.007961 19526 leader_election.cc:304] T b08304a0a02b42d7840c4e8ee9a6bd1a P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e61c3a8f61bb48f8a963c9480e53c168; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:06:21.009224 19526 leader_election.cc:304] T 0afb57ae58a24a01850491d69f0213dd P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e61c3a8f61bb48f8a963c9480e53c168; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, 127766fc592545a4997f7790f50f6076
I20260709 13:06:21.010629 24252 leader_election.cc:290] T fa8650e71aa14778b3d73721fc50d9fc P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:06:21.012055 24267 leader_election.cc:290] T ece3db938bc649d4a40a51522ed5259c P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:06:20.991693 24162 raft_consensus.cc:515] T 21e14947d70440f19044d8f75c31e1f9 P e5256d91808b47c195bc9b4dbd7f2b87 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:21.014134 24188 leader_election.cc:290] T 46c5bfeecc314717bffe987e6844b6d0 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:06:21.014320 24162 leader_election.cc:290] T 21e14947d70440f19044d8f75c31e1f9 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:06:21.014714 24188 raft_consensus.cc:2749] T b08304a0a02b42d7840c4e8ee9a6bd1a P e61c3a8f61bb48f8a963c9480e53c168 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:06:21.004285 24280 raft_consensus.cc:2804] T 85c494af21f9457a85da47b9bc70c1fd P 127766fc592545a4997f7790f50f6076 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:06:21.015707 24280 raft_consensus.cc:493] T 85c494af21f9457a85da47b9bc70c1fd P 127766fc592545a4997f7790f50f6076 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:21.016093 24280 raft_consensus.cc:3060] T 85c494af21f9457a85da47b9bc70c1fd P 127766fc592545a4997f7790f50f6076 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:06:21.024075 19554 raft_consensus.cc:1275] T 2e36a9d6e29c4a7c860cf267efbd4c74 P e61c3a8f61bb48f8a963c9480e53c168 [term 11 FOLLOWER]: Refusing update from remote peer e5256d91808b47c195bc9b4dbd7f2b87: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 6. (term mismatch)
I20260709 13:06:21.024482 19554 pending_rounds.cc:85] T 2e36a9d6e29c4a7c860cf267efbd4c74 P e61c3a8f61bb48f8a963c9480e53c168: Aborting all ops after (but not including) 5
I20260709 13:06:21.024704 19554 pending_rounds.cc:107] T 2e36a9d6e29c4a7c860cf267efbd4c74 P e61c3a8f61bb48f8a963c9480e53c168: Aborting uncommitted NO_OP operation due to leader change: 10.6
I20260709 13:06:21.024940 19554 raft_consensus.cc:2889] T 2e36a9d6e29c4a7c860cf267efbd4c74 P e61c3a8f61bb48f8a963c9480e53c168 [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:06:20.917850 24236 raft_consensus.cc:515] T b9f0d59553ad444883fcf5b5909f9798 P e61c3a8f61bb48f8a963c9480e53c168 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:21.015341 24188 raft_consensus.cc:2749] T 0afb57ae58a24a01850491d69f0213dd P e61c3a8f61bb48f8a963c9480e53c168 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:06:21.034968 19449 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.4:43121, user_credentials={real_user=slave}} blocked reactor thread for 52516.7us
I20260709 13:06:21.052055 24169 raft_consensus.cc:697] T ff75a1d4cb1f493db8f71ddc136ba9ab P e5256d91808b47c195bc9b4dbd7f2b87 [term 13 LEADER]: Becoming Leader. State: Replica: e5256d91808b47c195bc9b4dbd7f2b87, State: Running, Role: LEADER
I20260709 13:06:21.052644 24235 raft_consensus.cc:697] T a08760e15aac4630a629431f56024dc8 P e61c3a8f61bb48f8a963c9480e53c168 [term 16 LEADER]: Becoming Leader. State: Replica: e61c3a8f61bb48f8a963c9480e53c168, State: Running, Role: LEADER
I20260709 13:06:21.053289 24315 raft_consensus.cc:493] T ece3db938bc649d4a40a51522ed5259c P e61c3a8f61bb48f8a963c9480e53c168 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader e5256d91808b47c195bc9b4dbd7f2b87)
I20260709 13:06:21.053732 24307 consensus_queue.cc:1059] T 22196caba61445d3bec98a0aab3c337d P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
W20260709 13:06:21.059944 19523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.1:40321, user_credentials={real_user=slave}} blocked reactor thread for 116341us
I20260709 13:06:21.060860 19523 leader_election.cc:304] T 3e1f505cb0f1427bbd698ac889d80821 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:06:21.061929 19523 leader_election.cc:304] T f93ee515a9c14139bf566522ed8232f3 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e61c3a8f61bb48f8a963c9480e53c168; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:06:21.045521 24304 raft_consensus.cc:493] T 179fd671030940b4b4a4e24bcc4aba0a P e5256d91808b47c195bc9b4dbd7f2b87 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:21.080168 19403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab43d85f64114d4ebf618930e43d9ed0" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:06:21.081037 19403 raft_consensus.cc:2468] T ab43d85f64114d4ebf618930e43d9ed0 P e5256d91808b47c195bc9b4dbd7f2b87 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 14.
I20260709 13:06:21.082216 20106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab43d85f64114d4ebf618930e43d9ed0" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:06:21.088528 19410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dc5b3532fe54f74876d02beffa2c230" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:06:21.073405 24304 raft_consensus.cc:515] T 179fd671030940b4b4a4e24bcc4aba0a P e5256d91808b47c195bc9b4dbd7f2b87 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:21.055646 24163 raft_consensus.cc:515] T 2725d2c4cb054f18b0fc8f735c15f6c2 P e5256d91808b47c195bc9b4dbd7f2b87 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:21.099123 24236 leader_election.cc:290] T b9f0d59553ad444883fcf5b5909f9798 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:06:21.100113 24236 raft_consensus.cc:2804] T 3e1f505cb0f1427bbd698ac889d80821 P e61c3a8f61bb48f8a963c9480e53c168 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:06:21.100586 24163 leader_election.cc:290] T 2725d2c4cb054f18b0fc8f735c15f6c2 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 16 election: Requested vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:06:21.073766 24307 consensus_queue.cc:1048] T 1dc5b3532fe54f74876d02beffa2c230 P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.028s
I20260709 13:06:21.102787 24307 raft_consensus.cc:2749] T f93ee515a9c14139bf566522ed8232f3 P e61c3a8f61bb48f8a963c9480e53c168 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:06:21.103516 24307 consensus_queue.cc:1048] T 1dc5b3532fe54f74876d02beffa2c230 P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:06:21.054972 24169 consensus_queue.cc:237] T ff75a1d4cb1f493db8f71ddc136ba9ab P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:21.107074 24235 consensus_queue.cc:237] T a08760e15aac4630a629431f56024dc8 P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 14.8, Last appended by leader: 8, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:21.109373 23933 raft_consensus.cc:515] T 2725d2c4cb054f18b0fc8f735c15f6c2 P 0473d2b2d01f4459b1e90fd12cc7840e [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:21.089371 19410 raft_consensus.cc:2468] T 1dc5b3532fe54f74876d02beffa2c230 P e5256d91808b47c195bc9b4dbd7f2b87 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 13.
I20260709 13:06:21.095278 24304 leader_election.cc:290] T 179fd671030940b4b4a4e24bcc4aba0a P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:06:21.075667 24255 leader_election.cc:290] T f93ee515a9c14139bf566522ed8232f3 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
W20260709 13:06:21.185077 19449 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.1:40321, user_credentials={real_user=slave}} blocked reactor thread for 93618.3us
I20260709 13:06:21.186322 19449 leader_election.cc:304] T d1e5873a19244c5ebbcd38e126796ee7 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87; no voters: 
I20260709 13:06:21.191502 23974 raft_consensus.cc:493] T 21e14947d70440f19044d8f75c31e1f9 P e61c3a8f61bb48f8a963c9480e53c168 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 0473d2b2d01f4459b1e90fd12cc7840e)
I20260709 13:06:21.192135 23974 raft_consensus.cc:515] T 21e14947d70440f19044d8f75c31e1f9 P e61c3a8f61bb48f8a963c9480e53c168 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:21.100620 24236 raft_consensus.cc:697] T 3e1f505cb0f1427bbd698ac889d80821 P e61c3a8f61bb48f8a963c9480e53c168 [term 14 LEADER]: Becoming Leader. State: Replica: e61c3a8f61bb48f8a963c9480e53c168, State: Running, Role: LEADER
I20260709 13:06:21.085880 24188 consensus_queue.cc:1059] T 96efeaaf1057492490e9a621f37e1a2d P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 }, Status: INVALID_TERM, Last received: 13.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.103s
I20260709 13:06:21.111611 23918 raft_consensus.cc:493] T ef32ce6fdd0e40d382c79974f30295c6 P e5256d91808b47c195bc9b4dbd7f2b87 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 0473d2b2d01f4459b1e90fd12cc7840e)
I20260709 13:06:21.195842 19554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dc5b3532fe54f74876d02beffa2c230" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:06:21.196271 19405 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "21e14947d70440f19044d8f75c31e1f9"
dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
mode: GRACEFUL
new_leader_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
 from {username='slave'} at 127.0.0.1:37312
I20260709 13:06:21.200598 19555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b74109013a140ada21feeef92d6f563" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:06:21.070793 24315 raft_consensus.cc:515] T ece3db938bc649d4a40a51522ed5259c P e61c3a8f61bb48f8a963c9480e53c168 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:21.201138 19405 raft_consensus.cc:606] T 21e14947d70440f19044d8f75c31e1f9 P e5256d91808b47c195bc9b4dbd7f2b87 [term 13 FOLLOWER]: Received request to transfer leadership to TS 0473d2b2d01f4459b1e90fd12cc7840e
I20260709 13:06:21.201520 19405 raft_consensus.cc:614] T 21e14947d70440f19044d8f75c31e1f9 P e5256d91808b47c195bc9b4dbd7f2b87 [term 13 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:06:21.139672 24163 raft_consensus.cc:493] T 86a6797bdfe94fa496c050ceae4bd0d9 P e5256d91808b47c195bc9b4dbd7f2b87 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 0473d2b2d01f4459b1e90fd12cc7840e)
I20260709 13:06:21.204207 19557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f93ee515a9c14139bf566522ed8232f3" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 16 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
W20260709 13:06:21.207594 19523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.1:40321, user_credentials={real_user=slave}} blocked reactor thread for 135896us
I20260709 13:06:21.221961 19449 leader_election.cc:304] T ff9b0eddd810459b82d91c60777c10eb P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87; no voters: 
I20260709 13:06:21.224812 19551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e5873a19244c5ebbcd38e126796ee7" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:06:21.257411 19556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2725d2c4cb054f18b0fc8f735c15f6c2" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 16 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:06:21.258652 19559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21e14947d70440f19044d8f75c31e1f9" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:06:21.259433 19559 raft_consensus.cc:2468] T 21e14947d70440f19044d8f75c31e1f9 P e61c3a8f61bb48f8a963c9480e53c168 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 13.
I20260709 13:06:21.260489 19560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa8650e71aa14778b3d73721fc50d9fc" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:06:21.261459 19560 raft_consensus.cc:2393] T fa8650e71aa14778b3d73721fc50d9fc P e61c3a8f61bb48f8a963c9480e53c168 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e5256d91808b47c195bc9b4dbd7f2b87 in current term 12: Already voted for candidate e61c3a8f61bb48f8a963c9480e53c168 in this term.
I20260709 13:06:21.257496 19375 leader_election.cc:304] T 0cdf56e38bbc453d9438d359e5a69955 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:06:21.204787 19558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "179fd671030940b4b4a4e24bcc4aba0a" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:06:21.267447 19558 raft_consensus.cc:2468] T 179fd671030940b4b4a4e24bcc4aba0a P e61c3a8f61bb48f8a963c9480e53c168 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 14.
I20260709 13:06:21.268453 24310 raft_consensus.cc:3055] T 22196caba61445d3bec98a0aab3c337d P e61c3a8f61bb48f8a963c9480e53c168 [term 10 LEADER]: Stepping down as leader of term 10
W20260709 13:06:21.256965 24308 log.cc:927] Time spent T 6c5eebf646ad445a9d1b1adc319d7b16 P e61c3a8f61bb48f8a963c9480e53c168: Append to log took a long time: real 0.060s	user 0.001s	sys 0.000s
W20260709 13:06:21.275071 19449 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.1:40321, user_credentials={real_user=slave}} blocked reactor thread for 53212.2us
I20260709 13:06:21.275345 24260 raft_consensus.cc:2804] T d1e5873a19244c5ebbcd38e126796ee7 P 0473d2b2d01f4459b1e90fd12cc7840e [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:06:21.218827 24147 raft_consensus.cc:493] T 309c3ca0ca4b4f3ba129752ea2cb293b P 0473d2b2d01f4459b1e90fd12cc7840e [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 127766fc592545a4997f7790f50f6076)
I20260709 13:06:21.276648 24260 raft_consensus.cc:493] T d1e5873a19244c5ebbcd38e126796ee7 P 0473d2b2d01f4459b1e90fd12cc7840e [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:21.275537 24162 raft_consensus.cc:2749] T 0cdf56e38bbc453d9438d359e5a69955 P e5256d91808b47c195bc9b4dbd7f2b87 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:06:21.224151 24196 raft_consensus.cc:493] T 172b3dd13109415a955b71ac0e9d2234 P 0473d2b2d01f4459b1e90fd12cc7840e [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 127766fc592545a4997f7790f50f6076)
I20260709 13:06:21.294832 23933 leader_election.cc:290] T 2725d2c4cb054f18b0fc8f735c15f6c2 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 16 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:06:21.295760 24313 consensus_queue.cc:1048] T edd7d470b5014c9489be7f41f64355c9 P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:06:21.294065 24196 raft_consensus.cc:515] T 172b3dd13109415a955b71ac0e9d2234 P 0473d2b2d01f4459b1e90fd12cc7840e [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:21.271461 24310 raft_consensus.cc:740] T 22196caba61445d3bec98a0aab3c337d P e61c3a8f61bb48f8a963c9480e53c168 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: e61c3a8f61bb48f8a963c9480e53c168, State: Running, Role: LEADER
I20260709 13:06:21.300621 24315 leader_election.cc:290] T ece3db938bc649d4a40a51522ed5259c P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:06:21.300303 24310 consensus_queue.cc:260] T 22196caba61445d3bec98a0aab3c337d P e61c3a8f61bb48f8a963c9480e53c168 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:21.301153 24196 leader_election.cc:290] T 172b3dd13109415a955b71ac0e9d2234 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:06:21.301358 24310 raft_consensus.cc:3060] T 22196caba61445d3bec98a0aab3c337d P e61c3a8f61bb48f8a963c9480e53c168 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:06:21.301505 24315 raft_consensus.cc:3055] T 96efeaaf1057492490e9a621f37e1a2d P e61c3a8f61bb48f8a963c9480e53c168 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:06:21.301919 24315 raft_consensus.cc:740] T 96efeaaf1057492490e9a621f37e1a2d P e61c3a8f61bb48f8a963c9480e53c168 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: e61c3a8f61bb48f8a963c9480e53c168, State: Running, Role: LEADER
I20260709 13:06:21.292773 24260 raft_consensus.cc:3060] T d1e5873a19244c5ebbcd38e126796ee7 P 0473d2b2d01f4459b1e90fd12cc7840e [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:06:21.306002 24236 consensus_queue.cc:237] T 3e1f505cb0f1427bbd698ac889d80821 P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.7, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:21.283146 24320 raft_consensus.cc:493] T e381f1d6b8184797ad142de49be225a8 P e5256d91808b47c195bc9b4dbd7f2b87 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 0473d2b2d01f4459b1e90fd12cc7840e)
W20260709 13:06:21.309783 19526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.2:46257, user_credentials={real_user=slave}} blocked reactor thread for 277854us
I20260709 13:06:21.308529 19405 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2a16f7501e2444fb86d4e2778e734e02"
dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
mode: GRACEFUL
new_leader_uuid: "127766fc592545a4997f7790f50f6076"
 from {username='slave'} at 127.0.0.1:37312
I20260709 13:06:21.310722 19405 raft_consensus.cc:606] T 2a16f7501e2444fb86d4e2778e734e02 P e5256d91808b47c195bc9b4dbd7f2b87 [term 12 LEADER]: Received request to transfer leadership to TS 127766fc592545a4997f7790f50f6076
I20260709 13:06:21.206894 23918 raft_consensus.cc:515] T ef32ce6fdd0e40d382c79974f30295c6 P e5256d91808b47c195bc9b4dbd7f2b87 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:21.225126 24163 raft_consensus.cc:515] T 86a6797bdfe94fa496c050ceae4bd0d9 P e5256d91808b47c195bc9b4dbd7f2b87 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:21.278779 24183 raft_consensus.cc:2804] T ff9b0eddd810459b82d91c60777c10eb P 0473d2b2d01f4459b1e90fd12cc7840e [term 14 FOLLOWER]: Leader election won for term 14
W20260709 13:06:21.326419 19449 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.1:40321, user_credentials={real_user=slave}} blocked reactor thread for 50308us
I20260709 13:06:21.327304 19449 leader_election.cc:304] T fa8650e71aa14778b3d73721fc50d9fc P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87; no voters: 
W20260709 13:06:21.339900 19523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.1:40321, user_credentials={real_user=slave}} blocked reactor thread for 131442us
I20260709 13:06:21.346064 24317 consensus_queue.cc:1059] T ff75a1d4cb1f493db8f71ddc136ba9ab P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:06:21.346473 20103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70797e5783b5454ab0d0eea663e791e3" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:06:21.348387 19449 leader_election.cc:304] T 1dc5b3532fe54f74876d02beffa2c230 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87; no voters: 
W20260709 13:06:21.418481 19449 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.1:40321, user_credentials={real_user=slave}} blocked reactor thread for 70166.7us
I20260709 13:06:21.418663 20106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab43d85f64114d4ebf618930e43d9ed0" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:06:21.419716 19486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f575b143b844aa096b50997dad3516a" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:06:21.421767 20106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ece3db938bc649d4a40a51522ed5259c" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:06:21.422097 19479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab43d85f64114d4ebf618930e43d9ed0" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:06:21.422760 19479 raft_consensus.cc:2468] T ab43d85f64114d4ebf618930e43d9ed0 P 0473d2b2d01f4459b1e90fd12cc7840e [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 14.
I20260709 13:06:21.425802 19479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46c5bfeecc314717bffe987e6844b6d0" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 19 candidate_status { last_received { term: 18 index: 8 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:06:21.429536 19479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9f0d59553ad444883fcf5b5909f9798" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:06:21.293435 24147 raft_consensus.cc:515] T 309c3ca0ca4b4f3ba129752ea2cb293b P 0473d2b2d01f4459b1e90fd12cc7840e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } attrs { replace: true } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:21.433235 19558 raft_consensus.cc:1275] T ab43d85f64114d4ebf618930e43d9ed0 P e61c3a8f61bb48f8a963c9480e53c168 [term 14 FOLLOWER]: Refusing update from remote peer 127766fc592545a4997f7790f50f6076: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 13:06:21.433750 19555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85c494af21f9457a85da47b9bc70c1fd" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:06:21.434619 19552 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40428 (request call id 2654) took 1009 ms. Trace:
I20260709 13:06:21.436347 19555 raft_consensus.cc:2468] T 85c494af21f9457a85da47b9bc70c1fd P e61c3a8f61bb48f8a963c9480e53c168 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 127766fc592545a4997f7790f50f6076 in term 10.
I20260709 13:06:21.436792 19552 rpcz_store.cc:276] 0709 13:06:20.425321 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:20.425473 (+   152us) service_pool.cc:224] Handling call
0709 13:06:20.425774 (+   301us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:20.569828 (+144054us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:06:20.713511 (+143683us) log.cc:844] Serialized 14 byte log entry
0709 13:06:21.195703 (+482192us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:21.196132 (+   429us) log.cc:844] Serialized 26 byte log entry
0709 13:06:21.196298 (+   166us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:06:21.196348 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:21.429093 (+232745us) spinlock_profiling.cc:243] Waited 144 ms on lock 0x7b540012b454. stack: 00007f4a79de9343 00007f4a79de9240 00007f4a797781d4 00007f4a834b6304 00007f4a834b6299 00007f4a7ce71571 00007f4a7cf08e01 00007f4a7cf0783e 00007f4a81ecc419 00007f4a7b443bd4 00007f4a7b443b62 00007f4a7b443a91 00007f4a7b443a0c 00007f4a7b442cc2 00007f4a7b24348c 00007f4a7b2428c6
0709 13:06:21.429142 (+    49us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:21.429201 (+    59us) raft_consensus.cc:1685] finished
0709 13:06:21.434427 (+  5226us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:21.434560 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":208667,"prepare.run_cpu_time_us":59,"prepare.run_wall_time_us":5787,"raft.queue_time_us":29219,"raft.run_cpu_time_us":167,"raft.run_wall_time_us":2456,"spinlock_wait_cycles":330167680,"thread_start_us":559199,"threads_started":3,"wal-append.queue_time_us":270730}
I20260709 13:06:21.486001 19551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48824d5acfbc485ebf8c2d944e7202de" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:06:21.490238 19551 raft_consensus.cc:2468] T 48824d5acfbc485ebf8c2d944e7202de P e61c3a8f61bb48f8a963c9480e53c168 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 127766fc592545a4997f7790f50f6076 in term 14.
I20260709 13:06:21.490567 19479 raft_consensus.cc:1240] T 2725d2c4cb054f18b0fc8f735c15f6c2 P 0473d2b2d01f4459b1e90fd12cc7840e [term 16 FOLLOWER]: Rejecting Update request from peer e61c3a8f61bb48f8a963c9480e53c168 for earlier term 15. Current term is 16. Ops: [15.8-15.8]
I20260709 13:06:21.323935 24278 raft_consensus.cc:515] T ff9b0eddd810459b82d91c60777c10eb P 127766fc592545a4997f7790f50f6076 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:21.325718 24315 consensus_queue.cc:260] T 96efeaaf1057492490e9a621f37e1a2d P e61c3a8f61bb48f8a963c9480e53c168 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:21.484472 19486 raft_consensus.cc:1240] T 22196caba61445d3bec98a0aab3c337d P 0473d2b2d01f4459b1e90fd12cc7840e [term 11 FOLLOWER]: Rejecting Update request from peer e61c3a8f61bb48f8a963c9480e53c168 for earlier term 10. Current term is 11. Ops: [10.7-10.7]
I20260709 13:06:21.490799 19480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21e14947d70440f19044d8f75c31e1f9" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:06:21.432508 24183 raft_consensus.cc:697] T ff9b0eddd810459b82d91c60777c10eb P 0473d2b2d01f4459b1e90fd12cc7840e [term 14 LEADER]: Becoming Leader. State: Replica: 0473d2b2d01f4459b1e90fd12cc7840e, State: Running, Role: LEADER
W20260709 13:06:21.491408 19374 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.4:43121, user_credentials={real_user=slave}} blocked reactor thread for 212747us
I20260709 13:06:21.424996 24274 raft_consensus.cc:2804] T fa8650e71aa14778b3d73721fc50d9fc P 0473d2b2d01f4459b1e90fd12cc7840e [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:06:21.441871 23974 leader_election.cc:290] T 21e14947d70440f19044d8f75c31e1f9 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:06:21.502630 24321 raft_consensus.cc:493] T edd7d470b5014c9489be7f41f64355c9 P e61c3a8f61bb48f8a963c9480e53c168 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:21.510615 19523 leader_election.cc:304] T 6c5eebf646ad445a9d1b1adc319d7b16 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e61c3a8f61bb48f8a963c9480e53c168; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, 127766fc592545a4997f7790f50f6076
I20260709 13:06:21.505119 19560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ece3db938bc649d4a40a51522ed5259c" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:06:21.323484 24320 raft_consensus.cc:515] T e381f1d6b8184797ad142de49be225a8 P e5256d91808b47c195bc9b4dbd7f2b87 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:21.513181 20105 raft_consensus.cc:2393] T ff9b0eddd810459b82d91c60777c10eb P 127766fc592545a4997f7790f50f6076 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 0473d2b2d01f4459b1e90fd12cc7840e in current term 14: Already voted for candidate 127766fc592545a4997f7790f50f6076 in this term.
I20260709 13:06:21.488940 24055 raft_consensus.cc:493] T 48824d5acfbc485ebf8c2d944e7202de P 0473d2b2d01f4459b1e90fd12cc7840e [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 127766fc592545a4997f7790f50f6076)
I20260709 13:06:21.502940 24275 raft_consensus.cc:2804] T 1dc5b3532fe54f74876d02beffa2c230 P 0473d2b2d01f4459b1e90fd12cc7840e [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:06:21.517616 19551 raft_consensus.cc:1275] T 62c6c134d3d24a1ab144dd9ee6bc3f64 P e61c3a8f61bb48f8a963c9480e53c168 [term 13 FOLLOWER]: Refusing update from remote peer 127766fc592545a4997f7790f50f6076: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
W20260709 13:06:21.563403 19523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.4:43121, user_credentials={real_user=slave}} blocked reactor thread for 52847.3us
I20260709 13:06:21.506412 24274 raft_consensus.cc:493] T fa8650e71aa14778b3d73721fc50d9fc P 0473d2b2d01f4459b1e90fd12cc7840e [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:21.491662 24280 raft_consensus.cc:515] T 85c494af21f9457a85da47b9bc70c1fd P 127766fc592545a4997f7790f50f6076 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:21.521884 24275 raft_consensus.cc:493] T 1dc5b3532fe54f74876d02beffa2c230 P 0473d2b2d01f4459b1e90fd12cc7840e [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:21.558975 24327 raft_consensus.cc:493] T 85c494af21f9457a85da47b9bc70c1fd P e61c3a8f61bb48f8a963c9480e53c168 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 127766fc592545a4997f7790f50f6076)
I20260709 13:06:21.576682 24315 raft_consensus.cc:3060] T 96efeaaf1057492490e9a621f37e1a2d P e61c3a8f61bb48f8a963c9480e53c168 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:06:21.595218 24274 raft_consensus.cc:3060] T fa8650e71aa14778b3d73721fc50d9fc P 0473d2b2d01f4459b1e90fd12cc7840e [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:06:21.562650 24055 raft_consensus.cc:515] T 48824d5acfbc485ebf8c2d944e7202de P 0473d2b2d01f4459b1e90fd12cc7840e [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:21.603700 24324 consensus_queue.cc:1048] T d1e5873a19244c5ebbcd38e126796ee7 P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.165s
I20260709 13:06:21.601220 24275 raft_consensus.cc:3060] T 1dc5b3532fe54f74876d02beffa2c230 P 0473d2b2d01f4459b1e90fd12cc7840e [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:06:21.516476 24321 raft_consensus.cc:515] T edd7d470b5014c9489be7f41f64355c9 P e61c3a8f61bb48f8a963c9480e53c168 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:21.600888 24183 consensus_queue.cc:237] T ff9b0eddd810459b82d91c60777c10eb P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:21.627830 24318 consensus_queue.cc:1048] T df751f992649444090e27965eb1af85d P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.138s
W20260709 13:06:21.635437 24319 log.cc:927] Time spent T 46c5bfeecc314717bffe987e6844b6d0 P e61c3a8f61bb48f8a963c9480e53c168: Append to log took a long time: real 0.141s	user 0.000s	sys 0.001s
I20260709 13:06:21.640383 24321 leader_election.cc:290] T edd7d470b5014c9489be7f41f64355c9 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
W20260709 13:06:21.647156 24328 log.cc:927] Time spent T ff75a1d4cb1f493db8f71ddc136ba9ab P e5256d91808b47c195bc9b4dbd7f2b87: Append to log took a long time: real 0.087s	user 0.000s	sys 0.000s
I20260709 13:06:21.610363 24327 raft_consensus.cc:515] T 85c494af21f9457a85da47b9bc70c1fd P e61c3a8f61bb48f8a963c9480e53c168 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:21.656271 24327 leader_election.cc:290] T 85c494af21f9457a85da47b9bc70c1fd P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:06:21.656798 24310 raft_consensus.cc:493] T 2e36a9d6e29c4a7c860cf267efbd4c74 P e61c3a8f61bb48f8a963c9480e53c168 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:21.657289 24310 raft_consensus.cc:515] T 2e36a9d6e29c4a7c860cf267efbd4c74 P e61c3a8f61bb48f8a963c9480e53c168 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:21.659476 24310 leader_election.cc:290] T 2e36a9d6e29c4a7c860cf267efbd4c74 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:06:21.620949 23918 leader_election.cc:290] T ef32ce6fdd0e40d382c79974f30295c6 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
W20260709 13:06:21.649012 24323 log.cc:927] Time spent T 22196caba61445d3bec98a0aab3c337d P e61c3a8f61bb48f8a963c9480e53c168: Append to log took a long time: real 0.277s	user 0.000s	sys 0.001s
W20260709 13:06:21.689762 19526 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:21.670461 24327 raft_consensus.cc:493] T 0e1085d23e8347fbbd5bce7542f4b1f4 P e61c3a8f61bb48f8a963c9480e53c168 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:06:21.674026 24316 log.cc:927] Time spent T 0e1085d23e8347fbbd5bce7542f4b1f4 P 127766fc592545a4997f7790f50f6076: Append to log took a long time: real 0.242s	user 0.000s	sys 0.001s
I20260709 13:06:21.667685 23538 raft_consensus.cc:493] T 46c5bfeecc314717bffe987e6844b6d0 P 0473d2b2d01f4459b1e90fd12cc7840e [term 18 FOLLOWER]: Starting pre-election (detected failure of leader e5256d91808b47c195bc9b4dbd7f2b87)
I20260709 13:06:21.668211 24318 raft_consensus.cc:2749] T 6c5eebf646ad445a9d1b1adc319d7b16 P e61c3a8f61bb48f8a963c9480e53c168 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:06:21.676204 24321 raft_consensus.cc:493] T 86a6797bdfe94fa496c050ceae4bd0d9 P e61c3a8f61bb48f8a963c9480e53c168 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 0473d2b2d01f4459b1e90fd12cc7840e)
I20260709 13:06:21.776829 23918 raft_consensus.cc:493] T 833a2f0775ed407a94b8924ce50adb63 P e5256d91808b47c195bc9b4dbd7f2b87 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:21.784653 24327 raft_consensus.cc:515] T 0e1085d23e8347fbbd5bce7542f4b1f4 P e61c3a8f61bb48f8a963c9480e53c168 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:21.794710 24278 leader_election.cc:290] T ff9b0eddd810459b82d91c60777c10eb P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 14 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:06:21.817715 24318 raft_consensus.cc:493] T ef32ce6fdd0e40d382c79974f30295c6 P e61c3a8f61bb48f8a963c9480e53c168 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 0473d2b2d01f4459b1e90fd12cc7840e)
I20260709 13:06:21.818290 24318 raft_consensus.cc:515] T ef32ce6fdd0e40d382c79974f30295c6 P e61c3a8f61bb48f8a963c9480e53c168 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:21.820441 24318 leader_election.cc:290] T ef32ce6fdd0e40d382c79974f30295c6 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:06:21.824844 20103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e1085d23e8347fbbd5bce7542f4b1f4" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:06:21.793809 23538 raft_consensus.cc:515] T 46c5bfeecc314717bffe987e6844b6d0 P 0473d2b2d01f4459b1e90fd12cc7840e [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:21.809227 24327 leader_election.cc:290] T 0e1085d23e8347fbbd5bce7542f4b1f4 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
W20260709 13:06:21.834370 20076 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.3:36891, user_credentials={real_user=slave}} blocked reactor thread for 267343us
I20260709 13:06:21.836298 20076 leader_election.cc:304] T 48824d5acfbc485ebf8c2d944e7202de P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 127766fc592545a4997f7790f50f6076, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:06:21.837343 20076 leader_election.cc:304] T ece3db938bc649d4a40a51522ed5259c P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 127766fc592545a4997f7790f50f6076; no voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:06:21.796870 24321 raft_consensus.cc:515] T 86a6797bdfe94fa496c050ceae4bd0d9 P e61c3a8f61bb48f8a963c9480e53c168 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:21.842993 20111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85c494af21f9457a85da47b9bc70c1fd" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:06:21.844388 20111 raft_consensus.cc:2368] T 85c494af21f9457a85da47b9bc70c1fd P 127766fc592545a4997f7790f50f6076 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e61c3a8f61bb48f8a963c9480e53c168 for earlier term 11. Current term is 12.
I20260709 13:06:21.802178 23918 raft_consensus.cc:515] T 833a2f0775ed407a94b8924ce50adb63 P e5256d91808b47c195bc9b4dbd7f2b87 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:21.835207 24320 leader_election.cc:290] T e381f1d6b8184797ad142de49be225a8 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:06:21.851205 19523 leader_election.cc:400] T 85c494af21f9457a85da47b9bc70c1fd P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 11 pre-election: Vote denied by peer 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121) with higher term. Message: Invalid argument: T 85c494af21f9457a85da47b9bc70c1fd P 127766fc592545a4997f7790f50f6076 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e61c3a8f61bb48f8a963c9480e53c168 for earlier term 11. Current term is 12.
I20260709 13:06:21.851563 19523 leader_election.cc:403] T 85c494af21f9457a85da47b9bc70c1fd P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 11 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:06:21.843528 24048 raft_consensus.cc:2804] T 48824d5acfbc485ebf8c2d944e7202de P 127766fc592545a4997f7790f50f6076 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:06:21.841988 24147 leader_election.cc:290] T 309c3ca0ca4b4f3ba129752ea2cb293b P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:06:21.845140 24331 raft_consensus.cc:493] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P e5256d91808b47c195bc9b4dbd7f2b87 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 127766fc592545a4997f7790f50f6076)
I20260709 13:06:21.860280 24033 leader_election.cc:290] T 1f85fc4b527a48848e5faa083b604e36 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:06:21.845177 23538 leader_election.cc:290] T 46c5bfeecc314717bffe987e6844b6d0 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:06:21.863592 19559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85c494af21f9457a85da47b9bc70c1fd" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:06:21.844610 24280 leader_election.cc:290] T 85c494af21f9457a85da47b9bc70c1fd P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 12 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:06:21.839855 24253 consensus_queue.cc:1048] T ab43d85f64114d4ebf618930e43d9ed0 P 127766fc592545a4997f7790f50f6076 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.011s
I20260709 13:06:21.847913 24126 raft_consensus.cc:2749] T ece3db938bc649d4a40a51522ed5259c P 127766fc592545a4997f7790f50f6076 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:06:21.858609 24048 raft_consensus.cc:493] T 48824d5acfbc485ebf8c2d944e7202de P 127766fc592545a4997f7790f50f6076 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:21.858932 24238 raft_consensus.cc:3060] T 85c494af21f9457a85da47b9bc70c1fd P e61c3a8f61bb48f8a963c9480e53c168 [term 10 FOLLOWER]: Advancing to term 12
I20260709 13:06:21.853629 24055 leader_election.cc:290] T 48824d5acfbc485ebf8c2d944e7202de P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:06:21.853010 24061 consensus_queue.cc:1048] T 62c6c134d3d24a1ab144dd9ee6bc3f64 P 127766fc592545a4997f7790f50f6076 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.028s
I20260709 13:06:21.868311 24327 raft_consensus.cc:493] T 7be9efa6559648dbb5a0f7684c4542d1 P e61c3a8f61bb48f8a963c9480e53c168 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 0473d2b2d01f4459b1e90fd12cc7840e)
I20260709 13:06:21.887979 20111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f85fc4b527a48848e5faa083b604e36" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:06:21.873049 24318 raft_consensus.cc:493] T e381f1d6b8184797ad142de49be225a8 P e61c3a8f61bb48f8a963c9480e53c168 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 0473d2b2d01f4459b1e90fd12cc7840e)
I20260709 13:06:21.878948 24048 raft_consensus.cc:3060] T 48824d5acfbc485ebf8c2d944e7202de P 127766fc592545a4997f7790f50f6076 [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:06:21.910810 19524 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:21.895653 24329 log.cc:927] Time spent T a08760e15aac4630a629431f56024dc8 P e61c3a8f61bb48f8a963c9480e53c168: Append to log took a long time: real 0.223s	user 0.001s	sys 0.000s
I20260709 13:06:21.875165 24331 raft_consensus.cc:515] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P e5256d91808b47c195bc9b4dbd7f2b87 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:21.941110 19450 leader_election.cc:304] T 7f575b143b844aa096b50997dad3516a P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e; no voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:06:21.905678 24055 raft_consensus.cc:493] T 62c6c134d3d24a1ab144dd9ee6bc3f64 P 0473d2b2d01f4459b1e90fd12cc7840e [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:21.948647 23538 raft_consensus.cc:2749] T 7f575b143b844aa096b50997dad3516a P 0473d2b2d01f4459b1e90fd12cc7840e [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:06:21.945935 24183 raft_consensus.cc:493] T 96efeaaf1057492490e9a621f37e1a2d P 0473d2b2d01f4459b1e90fd12cc7840e [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:21.965768 24322 consensus_queue.cc:1059] T ff75a1d4cb1f493db8f71ddc136ba9ab P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:06:21.966722 19552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1efebf73c86e432baa55533136b6e12c" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:06:21.987649 19552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa8650e71aa14778b3d73721fc50d9fc" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:06:21.907330 24318 raft_consensus.cc:515] T e381f1d6b8184797ad142de49be225a8 P e61c3a8f61bb48f8a963c9480e53c168 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:21.988238 19552 raft_consensus.cc:2468] T fa8650e71aa14778b3d73721fc50d9fc P e61c3a8f61bb48f8a963c9480e53c168 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 12.
I20260709 13:06:21.985559 19560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e5873a19244c5ebbcd38e126796ee7" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:06:21.950537 24046 consensus_queue.cc:1048] T 179fd671030940b4b4a4e24bcc4aba0a P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.031s
I20260709 13:06:21.954166 24055 raft_consensus.cc:515] T 62c6c134d3d24a1ab144dd9ee6bc3f64 P 0473d2b2d01f4459b1e90fd12cc7840e [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:21.905979 24327 raft_consensus.cc:515] T 7be9efa6559648dbb5a0f7684c4542d1 P e61c3a8f61bb48f8a963c9480e53c168 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } attrs { replace: true } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:21.991993 24163 leader_election.cc:290] T 86a6797bdfe94fa496c050ceae4bd0d9 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:06:21.992010 24331 leader_election.cc:290] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:06:21.949072 24338 raft_consensus.cc:493] T f1b10566f45d4a7d9029858330e02d5b P e61c3a8f61bb48f8a963c9480e53c168 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 0473d2b2d01f4459b1e90fd12cc7840e)
I20260709 13:06:21.999526 20111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36f6ba92b9ba46babe4ebd6c02e5fbd9" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:06:21.971771 24321 leader_election.cc:290] T 86a6797bdfe94fa496c050ceae4bd0d9 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:06:21.954058 24147 consensus_queue.cc:1048] T 0e1085d23e8347fbbd5bce7542f4b1f4 P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.043s
I20260709 13:06:22.004446 19552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab43d85f64114d4ebf618930e43d9ed0" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:06:21.996721 24253 raft_consensus.cc:493] T 833a2f0775ed407a94b8924ce50adb63 P 127766fc592545a4997f7790f50f6076 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:22.022837 20110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "833a2f0775ed407a94b8924ce50adb63" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:06:22.033021 19552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dc5b3532fe54f74876d02beffa2c230" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:06:22.025137 23918 leader_election.cc:290] T 833a2f0775ed407a94b8924ce50adb63 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:06:21.995914 24183 raft_consensus.cc:515] T 96efeaaf1057492490e9a621f37e1a2d P 0473d2b2d01f4459b1e90fd12cc7840e [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
W20260709 13:06:22.074923 19525 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:22.083879 19477 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39478 (request call id 693) took 1563 ms. Trace:
I20260709 13:06:22.085932 19478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f93ee515a9c14139bf566522ed8232f3" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 16 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:06:22.055358 24046 raft_consensus.cc:493] T ed7fdbcb96d14d418db9ca90a792588a P 0473d2b2d01f4459b1e90fd12cc7840e [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 127766fc592545a4997f7790f50f6076)
I20260709 13:06:22.088155 19483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f85fc4b527a48848e5faa083b604e36" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:06:22.088785 19483 raft_consensus.cc:2468] T 1f85fc4b527a48848e5faa083b604e36 P 0473d2b2d01f4459b1e90fd12cc7840e [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 11.
I20260709 13:06:22.090022 19552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2725d2c4cb054f18b0fc8f735c15f6c2" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 16 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:06:22.091357 19485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e5873a19244c5ebbcd38e126796ee7" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:06:22.023298 24338 raft_consensus.cc:515] T f1b10566f45d4a7d9029858330e02d5b P e61c3a8f61bb48f8a963c9480e53c168 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:22.093156 19479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dc5b3532fe54f74876d02beffa2c230" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:06:22.086238 19477 rpcz_store.cc:276] 0709 13:06:20.520621 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:20.561344 (+ 40723us) service_pool.cc:224] Handling call
0709 13:06:20.561687 (+   343us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:20.768754 (+207067us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:20.768783 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:20.790183 (+ 21400us) log.cc:844] Serialized 26 byte log entry
0709 13:06:20.846795 (+ 56612us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:06:20.846847 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:22.062263 (+1215416us) spinlock_profiling.cc:243] Waited 146 ms on lock 0x7b5400148f54. stack: 00007f4a79de9343 00007f4a79de9240 00007f4a797781d4 00007f4a834b6304 00007f4a834b6299 00007f4a7ce71571 00007f4a7cf08e01 00007f4a7cf0783e 00007f4a81ecc419 00007f4a7b443bd4 00007f4a7b443b62 00007f4a7b443a91 00007f4a7b443a0c 00007f4a7b442cc2 00007f4a7b24348c 00007f4a7b2428c6
0709 13:06:22.062313 (+    50us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:22.062356 (+    43us) raft_consensus.cc:1685] finished
0709 13:06:22.062372 (+    16us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:22.083796 (+ 21424us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":74762,"raft.queue_time_us":63652,"raft.run_cpu_time_us":114,"raft.run_wall_time_us":7028,"spinlock_wait_cycles":336823168,"thread_start_us":19236,"threads_started":1,"wal-append.queue_time_us":133495,"wal-append.run_cpu_time_us":1584,"wal-append.run_wall_time_us":1062533}
I20260709 13:06:22.100935 19481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21e14947d70440f19044d8f75c31e1f9" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:06:22.086748 23538 raft_consensus.cc:493] T 4509b76741dc428e9201c70c1658da13 P 0473d2b2d01f4459b1e90fd12cc7840e [term 8 FOLLOWER]: Starting pre-election (detected failure of leader e5256d91808b47c195bc9b4dbd7f2b87)
I20260709 13:06:22.036368 24253 raft_consensus.cc:515] T 833a2f0775ed407a94b8924ce50adb63 P 127766fc592545a4997f7790f50f6076 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:22.102186 19481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "179fd671030940b4b4a4e24bcc4aba0a" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:06:22.089975 23933 raft_consensus.cc:493] T 5ec1c4ce15e04c7e8c283a62179f2a64 P 0473d2b2d01f4459b1e90fd12cc7840e [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 127766fc592545a4997f7790f50f6076)
I20260709 13:06:22.105149 19477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b74109013a140ada21feeef92d6f563" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:06:22.105031 19481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2725d2c4cb054f18b0fc8f735c15f6c2" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 16 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:06:22.106623 19481 raft_consensus.cc:2393] T 2725d2c4cb054f18b0fc8f735c15f6c2 P 0473d2b2d01f4459b1e90fd12cc7840e [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate e5256d91808b47c195bc9b4dbd7f2b87 in current term 16: Already voted for candidate 0473d2b2d01f4459b1e90fd12cc7840e in this term.
I20260709 13:06:22.108332 19552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "309c3ca0ca4b4f3ba129752ea2cb293b" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:06:22.110335 19483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa8650e71aa14778b3d73721fc50d9fc" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:06:22.094651 24153 raft_consensus.cc:493] T 1a61655d99124a29b486ba4a5b37faea P 0473d2b2d01f4459b1e90fd12cc7840e [term 10 FOLLOWER]: Starting pre-election (detected failure of leader e5256d91808b47c195bc9b4dbd7f2b87)
I20260709 13:06:22.113020 19481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36f6ba92b9ba46babe4ebd6c02e5fbd9" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:06:22.113647 19405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff9b0eddd810459b82d91c60777c10eb" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
I20260709 13:06:22.117841 19479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e381f1d6b8184797ad142de49be225a8" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:06:22.118921 19481 raft_consensus.cc:2468] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P 0473d2b2d01f4459b1e90fd12cc7840e [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 14.
I20260709 13:06:22.088419 24275 raft_consensus.cc:515] T 1dc5b3532fe54f74876d02beffa2c230 P 0473d2b2d01f4459b1e90fd12cc7840e [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:22.119895 19481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef32ce6fdd0e40d382c79974f30295c6" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:06:22.119751 20110 raft_consensus.cc:2468] T 833a2f0775ed407a94b8924ce50adb63 P 127766fc592545a4997f7790f50f6076 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 12.
I20260709 13:06:22.121793 19552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48824d5acfbc485ebf8c2d944e7202de" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:06:22.125133 19552 raft_consensus.cc:2393] T 48824d5acfbc485ebf8c2d944e7202de P e61c3a8f61bb48f8a963c9480e53c168 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0473d2b2d01f4459b1e90fd12cc7840e in current term 14: Already voted for candidate e61c3a8f61bb48f8a963c9480e53c168 in this term.
I20260709 13:06:22.125178 19405 raft_consensus.cc:2393] T ff9b0eddd810459b82d91c60777c10eb P e5256d91808b47c195bc9b4dbd7f2b87 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 127766fc592545a4997f7790f50f6076 in current term 14: Already voted for candidate 0473d2b2d01f4459b1e90fd12cc7840e in this term.
I20260709 13:06:22.089920 24046 raft_consensus.cc:515] T ed7fdbcb96d14d418db9ca90a792588a P 0473d2b2d01f4459b1e90fd12cc7840e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:22.130720 19477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86a6797bdfe94fa496c050ceae4bd0d9" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:06:22.128167 19409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85c494af21f9457a85da47b9bc70c1fd" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
I20260709 13:06:22.131654 19409 raft_consensus.cc:3060] T 85c494af21f9457a85da47b9bc70c1fd P e5256d91808b47c195bc9b4dbd7f2b87 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:06:22.117883 24260 consensus_meta.cc:287] T d1e5873a19244c5ebbcd38e126796ee7 P 0473d2b2d01f4459b1e90fd12cc7840e: Time spent flushing consensus metadata: real 0.811s	user 0.010s	sys 0.002s
I20260709 13:06:22.141222 19409 raft_consensus.cc:2468] T 85c494af21f9457a85da47b9bc70c1fd P e5256d91808b47c195bc9b4dbd7f2b87 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 127766fc592545a4997f7790f50f6076 in term 12.
I20260709 13:06:22.107577 24055 leader_election.cc:290] T 62c6c134d3d24a1ab144dd9ee6bc3f64 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:06:22.150952 20075 leader_election.cc:304] T 85c494af21f9457a85da47b9bc70c1fd P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 127766fc592545a4997f7790f50f6076, e5256d91808b47c195bc9b4dbd7f2b87; no voters: 
I20260709 13:06:22.157791 19484 raft_consensus.cc:1240] T 1dc5b3532fe54f74876d02beffa2c230 P 0473d2b2d01f4459b1e90fd12cc7840e [term 14 FOLLOWER]: Rejecting Update request from peer e61c3a8f61bb48f8a963c9480e53c168 for earlier term 13. Current term is 14. Ops: [13.7-13.7]
I20260709 13:06:22.162387 19477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48824d5acfbc485ebf8c2d944e7202de" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:06:22.163082 19477 raft_consensus.cc:2468] T 48824d5acfbc485ebf8c2d944e7202de P 0473d2b2d01f4459b1e90fd12cc7840e [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 127766fc592545a4997f7790f50f6076 in term 13.
I20260709 13:06:22.169749 24169 raft_consensus.cc:993] T 2a16f7501e2444fb86d4e2778e734e02 P e5256d91808b47c195bc9b4dbd7f2b87: : Instructing follower 127766fc592545a4997f7790f50f6076 to start an election
I20260709 13:06:22.170282 24169 raft_consensus.cc:1081] T 2a16f7501e2444fb86d4e2778e734e02 P e5256d91808b47c195bc9b4dbd7f2b87 [term 12 LEADER]: Signalling peer 127766fc592545a4997f7790f50f6076 to start an election
I20260709 13:06:22.170387 24266 raft_consensus.cc:493] T 14efcc79969f41babe5529c22d59156d P 127766fc592545a4997f7790f50f6076 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:22.171116 24266 raft_consensus.cc:515] T 14efcc79969f41babe5529c22d59156d P 127766fc592545a4997f7790f50f6076 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:22.172513 20111 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "2a16f7501e2444fb86d4e2778e734e02"
dest_uuid: "127766fc592545a4997f7790f50f6076"
 from {username='slave'} at 127.0.0.1:35874
I20260709 13:06:22.173069 20111 raft_consensus.cc:493] T 2a16f7501e2444fb86d4e2778e734e02 P 127766fc592545a4997f7790f50f6076 [term 12 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:06:22.173234 24266 leader_election.cc:290] T 14efcc79969f41babe5529c22d59156d P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:06:22.173422 20111 raft_consensus.cc:3060] T 2a16f7501e2444fb86d4e2778e734e02 P 127766fc592545a4997f7790f50f6076 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:06:22.173906 19409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14efcc79969f41babe5529c22d59156d" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:06:22.182262 19480 raft_consensus.cc:1275] T 14efcc79969f41babe5529c22d59156d P 0473d2b2d01f4459b1e90fd12cc7840e [term 14 FOLLOWER]: Refusing update from remote peer e5256d91808b47c195bc9b4dbd7f2b87: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 13:06:22.183456 24046 leader_election.cc:290] T ed7fdbcb96d14d418db9ca90a792588a P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
W20260709 13:06:22.184388 24339 log.cc:927] Time spent T 3e1f505cb0f1427bbd698ac889d80821 P e61c3a8f61bb48f8a963c9480e53c168: Append to log took a long time: real 0.094s	user 0.000s	sys 0.000s
W20260709 13:06:22.184883 24344 log.cc:927] Time spent T 6c5eebf646ad445a9d1b1adc319d7b16 P 0473d2b2d01f4459b1e90fd12cc7840e: Append to log took a long time: real 0.083s	user 0.000s	sys 0.000s
W20260709 13:06:22.186081 24350 log.cc:927] Time spent T ab43d85f64114d4ebf618930e43d9ed0 P e61c3a8f61bb48f8a963c9480e53c168: Append to log took a long time: real 0.060s	user 0.000s	sys 0.001s
I20260709 13:06:22.186749 24253 leader_election.cc:290] T 833a2f0775ed407a94b8924ce50adb63 P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:06:22.188091 24327 leader_election.cc:290] T 7be9efa6559648dbb5a0f7684c4542d1 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:06:22.187490 19409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "833a2f0775ed407a94b8924ce50adb63" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:06:22.189677 19409 raft_consensus.cc:2468] T 833a2f0775ed407a94b8924ce50adb63 P e5256d91808b47c195bc9b4dbd7f2b87 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 127766fc592545a4997f7790f50f6076 in term 12.
I20260709 13:06:22.190861 20075 leader_election.cc:304] T 833a2f0775ed407a94b8924ce50adb63 P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 127766fc592545a4997f7790f50f6076, e5256d91808b47c195bc9b4dbd7f2b87; no voters: 
I20260709 13:06:22.157107 24260 raft_consensus.cc:515] T d1e5873a19244c5ebbcd38e126796ee7 P 0473d2b2d01f4459b1e90fd12cc7840e [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:22.191823 24253 raft_consensus.cc:2804] T 833a2f0775ed407a94b8924ce50adb63 P 127766fc592545a4997f7790f50f6076 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:06:22.192230 24253 raft_consensus.cc:493] T 833a2f0775ed407a94b8924ce50adb63 P 127766fc592545a4997f7790f50f6076 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:22.192551 24253 raft_consensus.cc:3060] T 833a2f0775ed407a94b8924ce50adb63 P 127766fc592545a4997f7790f50f6076 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:06:22.192909 24260 leader_election.cc:290] T d1e5873a19244c5ebbcd38e126796ee7 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 15 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:06:22.193476 24238 raft_consensus.cc:2749] T 85c494af21f9457a85da47b9bc70c1fd P e61c3a8f61bb48f8a963c9480e53c168 [term 12 FOLLOWER]: Leader pre-election lost for term 11. Reason: Vote denied by peer 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121) with higher term. Message: Invalid argument: T 85c494af21f9457a85da47b9bc70c1fd P 127766fc592545a4997f7790f50f6076 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e61c3a8f61bb48f8a963c9480e53c168 for earlier term 11. Current term is 12.
I20260709 13:06:22.194984 19485 raft_consensus.cc:2393] T d1e5873a19244c5ebbcd38e126796ee7 P 0473d2b2d01f4459b1e90fd12cc7840e [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e5256d91808b47c195bc9b4dbd7f2b87 in current term 15: Already voted for candidate 0473d2b2d01f4459b1e90fd12cc7840e in this term.
I20260709 13:06:22.195822 24338 leader_election.cc:290] T f1b10566f45d4a7d9029858330e02d5b P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:06:22.196743 19552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46c5bfeecc314717bffe987e6844b6d0" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 19 candidate_status { last_received { term: 18 index: 8 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:06:22.198926 24275 leader_election.cc:290] T 1dc5b3532fe54f74876d02beffa2c230 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 14 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:06:22.199506 24183 leader_election.cc:290] T 96efeaaf1057492490e9a621f37e1a2d P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:06:22.199859 24318 leader_election.cc:290] T e381f1d6b8184797ad142de49be225a8 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:06:22.105573 23538 raft_consensus.cc:515] T 4509b76741dc428e9201c70c1658da13 P 0473d2b2d01f4459b1e90fd12cc7840e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:22.159727 24242 raft_consensus.cc:2804] T 85c494af21f9457a85da47b9bc70c1fd P 127766fc592545a4997f7790f50f6076 [term 12 FOLLOWER]: Leader election won for term 12
W20260709 13:06:22.191365 24315 consensus_meta.cc:287] T 96efeaaf1057492490e9a621f37e1a2d P e61c3a8f61bb48f8a963c9480e53c168: Time spent flushing consensus metadata: real 0.579s	user 0.010s	sys 0.000s
I20260709 13:06:22.206605 20111 raft_consensus.cc:515] T 2a16f7501e2444fb86d4e2778e734e02 P 127766fc592545a4997f7790f50f6076 [term 13 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:22.213056 19559 raft_consensus.cc:2468] T 85c494af21f9457a85da47b9bc70c1fd P e61c3a8f61bb48f8a963c9480e53c168 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 127766fc592545a4997f7790f50f6076 in term 12.
I20260709 13:06:22.111418 23933 raft_consensus.cc:515] T 5ec1c4ce15e04c7e8c283a62179f2a64 P 0473d2b2d01f4459b1e90fd12cc7840e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:22.203096 19480 raft_consensus.cc:1275] T ab43d85f64114d4ebf618930e43d9ed0 P 0473d2b2d01f4459b1e90fd12cc7840e [term 14 FOLLOWER]: Refusing update from remote peer 127766fc592545a4997f7790f50f6076: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 13:06:22.207506 19450 leader_election.cc:304] T 1efebf73c86e432baa55533136b6e12c P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e; no voters: 127766fc592545a4997f7790f50f6076, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:06:22.212544 19556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "833a2f0775ed407a94b8924ce50adb63" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:06:22.214942 20103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7be9efa6559648dbb5a0f7684c4542d1" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:06:22.217818 19450 leader_election.cc:304] T ab43d85f64114d4ebf618930e43d9ed0 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87; no voters: 127766fc592545a4997f7790f50f6076, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:06:22.201607 24242 raft_consensus.cc:697] T 85c494af21f9457a85da47b9bc70c1fd P 127766fc592545a4997f7790f50f6076 [term 12 LEADER]: Becoming Leader. State: Replica: 127766fc592545a4997f7790f50f6076, State: Running, Role: LEADER
I20260709 13:06:22.120889 24153 raft_consensus.cc:515] T 1a61655d99124a29b486ba4a5b37faea P 0473d2b2d01f4459b1e90fd12cc7840e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
W20260709 13:06:22.216001 24274 consensus_meta.cc:287] T fa8650e71aa14778b3d73721fc50d9fc P 0473d2b2d01f4459b1e90fd12cc7840e: Time spent flushing consensus metadata: real 0.600s	user 0.005s	sys 0.005s
I20260709 13:06:22.198437 24048 raft_consensus.cc:515] T 48824d5acfbc485ebf8c2d944e7202de P 127766fc592545a4997f7790f50f6076 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:22.215764 24275 raft_consensus.cc:493] T 14935b3ddf914369822e4a0547aaa355 P 0473d2b2d01f4459b1e90fd12cc7840e [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 127766fc592545a4997f7790f50f6076)
I20260709 13:06:22.216202 24260 raft_consensus.cc:2749] T 1efebf73c86e432baa55533136b6e12c P 0473d2b2d01f4459b1e90fd12cc7840e [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:06:22.235006 19409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a16f7501e2444fb86d4e2778e734e02" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: true dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
I20260709 13:06:22.237182 19409 raft_consensus.cc:3055] T 2a16f7501e2444fb86d4e2778e734e02 P e5256d91808b47c195bc9b4dbd7f2b87 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:06:22.237629 19409 raft_consensus.cc:740] T 2a16f7501e2444fb86d4e2778e734e02 P e5256d91808b47c195bc9b4dbd7f2b87 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: e5256d91808b47c195bc9b4dbd7f2b87, State: Running, Role: LEADER
I20260709 13:06:22.238528 19409 consensus_queue.cc:260] T 2a16f7501e2444fb86d4e2778e734e02 P e5256d91808b47c195bc9b4dbd7f2b87 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:22.243152 19409 raft_consensus.cc:3060] T 2a16f7501e2444fb86d4e2778e734e02 P e5256d91808b47c195bc9b4dbd7f2b87 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:06:22.231701 24046 raft_consensus.cc:2749] T ab43d85f64114d4ebf618930e43d9ed0 P 0473d2b2d01f4459b1e90fd12cc7840e [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:06:22.258576 23974 raft_consensus.cc:3055] T ff75a1d4cb1f493db8f71ddc136ba9ab P e61c3a8f61bb48f8a963c9480e53c168 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:06:22.259145 23974 raft_consensus.cc:740] T ff75a1d4cb1f493db8f71ddc136ba9ab P e61c3a8f61bb48f8a963c9480e53c168 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: e61c3a8f61bb48f8a963c9480e53c168, State: Running, Role: LEADER
I20260709 13:06:22.260033 23974 consensus_queue.cc:260] T ff75a1d4cb1f493db8f71ddc136ba9ab P e61c3a8f61bb48f8a963c9480e53c168 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:22.261093 23974 raft_consensus.cc:3060] T ff75a1d4cb1f493db8f71ddc136ba9ab P e61c3a8f61bb48f8a963c9480e53c168 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:06:22.264899 20111 leader_election.cc:290] T 2a16f7501e2444fb86d4e2778e734e02 P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 13 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:06:22.273866 19409 raft_consensus.cc:2468] T 2a16f7501e2444fb86d4e2778e734e02 P e5256d91808b47c195bc9b4dbd7f2b87 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 127766fc592545a4997f7790f50f6076 in term 13.
I20260709 13:06:22.277037 20075 leader_election.cc:304] T 2a16f7501e2444fb86d4e2778e734e02 P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 127766fc592545a4997f7790f50f6076, e5256d91808b47c195bc9b4dbd7f2b87; no voters: 
W20260709 13:06:22.330366 19525 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:22.233417 24274 raft_consensus.cc:515] T fa8650e71aa14778b3d73721fc50d9fc P 0473d2b2d01f4459b1e90fd12cc7840e [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
W20260709 13:06:22.436333 20075 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.1:40321, user_credentials={real_user=slave}} blocked reactor thread for 159392us
I20260709 13:06:22.429472 24242 consensus_queue.cc:237] T 85c494af21f9457a85da47b9bc70c1fd P 127766fc592545a4997f7790f50f6076 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:22.435148 24048 leader_election.cc:290] T 48824d5acfbc485ebf8c2d944e7202de P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 15 election: Requested vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:06:22.447034 24299 raft_consensus.cc:493] T 0afb57ae58a24a01850491d69f0213dd P 127766fc592545a4997f7790f50f6076 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 0473d2b2d01f4459b1e90fd12cc7840e)
I20260709 13:06:22.447865 24299 raft_consensus.cc:515] T 0afb57ae58a24a01850491d69f0213dd P 127766fc592545a4997f7790f50f6076 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:22.270751 23538 leader_election.cc:290] T 4509b76741dc428e9201c70c1658da13 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:06:22.242650 24275 raft_consensus.cc:515] T 14935b3ddf914369822e4a0547aaa355 P 0473d2b2d01f4459b1e90fd12cc7840e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } attrs { replace: true } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:22.470220 19483 raft_consensus.cc:2368] T fa8650e71aa14778b3d73721fc50d9fc P 0473d2b2d01f4459b1e90fd12cc7840e [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e5256d91808b47c195bc9b4dbd7f2b87 for earlier term 12. Current term is 13.
W20260709 13:06:22.470887 19525 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:22.437546 24315 raft_consensus.cc:493] T 40e1e16737a842ee936002830f36882e P e61c3a8f61bb48f8a963c9480e53c168 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader e5256d91808b47c195bc9b4dbd7f2b87)
W20260709 13:06:22.478895 24347 log.cc:927] Time spent T 28af091831594f9d8e96482078cc7625 P 0473d2b2d01f4459b1e90fd12cc7840e: Append to log took a long time: real 0.210s	user 0.001s	sys 0.000s
I20260709 13:06:22.497920 23933 leader_election.cc:290] T 5ec1c4ce15e04c7e8c283a62179f2a64 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:06:22.474794 24238 raft_consensus.cc:493] T 76cb037fc9064d13b59a8969d897ce8c P e61c3a8f61bb48f8a963c9480e53c168 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader e5256d91808b47c195bc9b4dbd7f2b87)
I20260709 13:06:22.476819 24141 raft_consensus.cc:493] T 65d8cb8d6ec64f459d5a47cefab10acf P 127766fc592545a4997f7790f50f6076 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader e5256d91808b47c195bc9b4dbd7f2b87)
I20260709 13:06:22.460325 24278 raft_consensus.cc:2804] T 2a16f7501e2444fb86d4e2778e734e02 P 127766fc592545a4997f7790f50f6076 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:06:22.460152 24153 leader_election.cc:290] T 1a61655d99124a29b486ba4a5b37faea P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:06:22.459435 24253 raft_consensus.cc:515] T 833a2f0775ed407a94b8924ce50adb63 P 127766fc592545a4997f7790f50f6076 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:22.460649 24126 raft_consensus.cc:493] T 7be9efa6559648dbb5a0f7684c4542d1 P 127766fc592545a4997f7790f50f6076 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 0473d2b2d01f4459b1e90fd12cc7840e)
I20260709 13:06:22.460513 24299 leader_election.cc:290] T 0afb57ae58a24a01850491d69f0213dd P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:06:22.555061 19555 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2b74109013a140ada21feeef92d6f563"
dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
mode: GRACEFUL
new_leader_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
 from {username='slave'} at 127.0.0.1:39264
I20260709 13:06:22.555999 19555 raft_consensus.cc:606] T 2b74109013a140ada21feeef92d6f563 P e61c3a8f61bb48f8a963c9480e53c168 [term 10 FOLLOWER]: Received request to transfer leadership to TS 0473d2b2d01f4459b1e90fd12cc7840e
I20260709 13:06:22.556418 19555 raft_consensus.cc:614] T 2b74109013a140ada21feeef92d6f563 P e61c3a8f61bb48f8a963c9480e53c168 [term 10 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:06:22.564072 24275 leader_election.cc:290] T 14935b3ddf914369822e4a0547aaa355 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:06:22.565871 24274 leader_election.cc:290] T fa8650e71aa14778b3d73721fc50d9fc P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 13 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:06:22.544697 24141 raft_consensus.cc:515] T 65d8cb8d6ec64f459d5a47cefab10acf P 127766fc592545a4997f7790f50f6076 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:22.569440 24141 leader_election.cc:290] T 65d8cb8d6ec64f459d5a47cefab10acf P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:06:22.542804 24238 raft_consensus.cc:515] T 76cb037fc9064d13b59a8969d897ce8c P e61c3a8f61bb48f8a963c9480e53c168 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:22.573282 24238 leader_election.cc:290] T 76cb037fc9064d13b59a8969d897ce8c P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:06:22.575492 24253 leader_election.cc:290] T 833a2f0775ed407a94b8924ce50adb63 P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 13 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:06:22.522820 24315 raft_consensus.cc:515] T 40e1e16737a842ee936002830f36882e P e61c3a8f61bb48f8a963c9480e53c168 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:22.614173 24315 leader_election.cc:290] T 40e1e16737a842ee936002830f36882e P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:06:22.548038 24126 raft_consensus.cc:515] T 7be9efa6559648dbb5a0f7684c4542d1 P 127766fc592545a4997f7790f50f6076 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } attrs { replace: true } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:22.603435 19409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65d8cb8d6ec64f459d5a47cefab10acf" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:06:22.603830 19407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "833a2f0775ed407a94b8924ce50adb63" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
I20260709 13:06:22.617040 19407 raft_consensus.cc:3060] T 833a2f0775ed407a94b8924ce50adb63 P e5256d91808b47c195bc9b4dbd7f2b87 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:06:22.607574 24229 raft_consensus.cc:493] T 22196caba61445d3bec98a0aab3c337d P e5256d91808b47c195bc9b4dbd7f2b87 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:22.622201 24229 raft_consensus.cc:515] T 22196caba61445d3bec98a0aab3c337d P e5256d91808b47c195bc9b4dbd7f2b87 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:22.625146 24229 leader_election.cc:290] T 22196caba61445d3bec98a0aab3c337d P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:06:22.632304 24126 leader_election.cc:290] T 7be9efa6559648dbb5a0f7684c4542d1 P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:06:22.637519 24229 raft_consensus.cc:493] T ab43d85f64114d4ebf618930e43d9ed0 P e5256d91808b47c195bc9b4dbd7f2b87 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 127766fc592545a4997f7790f50f6076)
I20260709 13:06:22.638446 24229 raft_consensus.cc:515] T ab43d85f64114d4ebf618930e43d9ed0 P e5256d91808b47c195bc9b4dbd7f2b87 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } attrs { replace: true } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:22.683985 19409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7be9efa6559648dbb5a0f7684c4542d1" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:06:22.684929 19409 raft_consensus.cc:2468] T 7be9efa6559648dbb5a0f7684c4542d1 P e5256d91808b47c195bc9b4dbd7f2b87 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 127766fc592545a4997f7790f50f6076 in term 13.
I20260709 13:06:22.695333 24278 raft_consensus.cc:697] T 2a16f7501e2444fb86d4e2778e734e02 P 127766fc592545a4997f7790f50f6076 [term 13 LEADER]: Becoming Leader. State: Replica: 127766fc592545a4997f7790f50f6076, State: Running, Role: LEADER
I20260709 13:06:22.697212 24278 consensus_queue.cc:237] T 2a16f7501e2444fb86d4e2778e734e02 P 127766fc592545a4997f7790f50f6076 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:22.749380 24229 leader_election.cc:290] T ab43d85f64114d4ebf618930e43d9ed0 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:06:22.751487 20111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab43d85f64114d4ebf618930e43d9ed0" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:06:22.754346 19407 raft_consensus.cc:2468] T 833a2f0775ed407a94b8924ce50adb63 P e5256d91808b47c195bc9b4dbd7f2b87 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 127766fc592545a4997f7790f50f6076 in term 13.
W20260709 13:06:22.772814 20105 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46436 (request call id 744) took 1827 ms (client timeout 1750 ms). Trace:
W20260709 13:06:22.773376 20105 rpcz_store.cc:269] 0709 13:06:20.945265 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:20.945410 (+   145us) service_pool.cc:224] Handling call
0709 13:06:22.772454 (+1827044us) spinlock_profiling.cc:243] Waited 531 ms on lock 0x7b5400507654. stack: 00007f4a79de9343 00007f4a79de9240 00007f4a797781d4 00007f4a834b6304 00007f4a834b6299 00007f4a7ce71571 00007f4a7cf0c2fa 00007f4a81ecdb17 00007f4a7b4486d4 00007f4a7b448662 00007f4a7b448591 00007f4a7b44850c 00007f4a7b4477c2 00007f4a7b24348c 00007f4a7b2428c6 00007f4a7b24226f
0709 13:06:22.772662 (+   208us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1220971776}
I20260709 13:06:22.781715 24141 raft_consensus.cc:493] T 96efeaaf1057492490e9a621f37e1a2d P 127766fc592545a4997f7790f50f6076 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader e61c3a8f61bb48f8a963c9480e53c168)
I20260709 13:06:22.782236 24141 raft_consensus.cc:515] T 96efeaaf1057492490e9a621f37e1a2d P 127766fc592545a4997f7790f50f6076 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:22.784240 24141 leader_election.cc:290] T 96efeaaf1057492490e9a621f37e1a2d P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:06:22.785919 24238 raft_consensus.cc:493] T 833a2f0775ed407a94b8924ce50adb63 P e61c3a8f61bb48f8a963c9480e53c168 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader e5256d91808b47c195bc9b4dbd7f2b87)
I20260709 13:06:22.786635 24238 raft_consensus.cc:515] T 833a2f0775ed407a94b8924ce50adb63 P e61c3a8f61bb48f8a963c9480e53c168 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:22.787480 24126 raft_consensus.cc:493] T 6c5eebf646ad445a9d1b1adc319d7b16 P 127766fc592545a4997f7790f50f6076 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 0473d2b2d01f4459b1e90fd12cc7840e)
I20260709 13:06:22.788129 24126 raft_consensus.cc:515] T 6c5eebf646ad445a9d1b1adc319d7b16 P 127766fc592545a4997f7790f50f6076 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:22.788587 24275 raft_consensus.cc:493] T 3e1f505cb0f1427bbd698ac889d80821 P 0473d2b2d01f4459b1e90fd12cc7840e [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:22.789009 24238 leader_election.cc:290] T 833a2f0775ed407a94b8924ce50adb63 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:06:22.789501 24238 raft_consensus.cc:493] T 217b5fae677b4971b3bbd2f357a1f7ff P e61c3a8f61bb48f8a963c9480e53c168 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 0473d2b2d01f4459b1e90fd12cc7840e)
I20260709 13:06:22.789324 24275 raft_consensus.cc:515] T 3e1f505cb0f1427bbd698ac889d80821 P 0473d2b2d01f4459b1e90fd12cc7840e [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:22.789978 24238 raft_consensus.cc:515] T 217b5fae677b4971b3bbd2f357a1f7ff P e61c3a8f61bb48f8a963c9480e53c168 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:22.790545 24126 leader_election.cc:290] T 6c5eebf646ad445a9d1b1adc319d7b16 P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:06:22.791332 24275 leader_election.cc:290] T 3e1f505cb0f1427bbd698ac889d80821 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:06:22.795037 24238 leader_election.cc:290] T 217b5fae677b4971b3bbd2f357a1f7ff P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:06:22.797492 19406 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52342 (request call id 2688) took 1719 ms. Trace:
I20260709 13:06:22.798357 24257 raft_consensus.cc:493] T 3e1f505cb0f1427bbd698ac889d80821 P e5256d91808b47c195bc9b4dbd7f2b87 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:22.805272 24257 raft_consensus.cc:515] T 3e1f505cb0f1427bbd698ac889d80821 P e5256d91808b47c195bc9b4dbd7f2b87 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:22.801262 24229 raft_consensus.cc:493] T b08304a0a02b42d7840c4e8ee9a6bd1a P e5256d91808b47c195bc9b4dbd7f2b87 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 0473d2b2d01f4459b1e90fd12cc7840e)
I20260709 13:06:22.807252 24229 raft_consensus.cc:515] T b08304a0a02b42d7840c4e8ee9a6bd1a P e5256d91808b47c195bc9b4dbd7f2b87 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
W20260709 13:06:22.799743 24190 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.547s	user 0.074s	sys 0.164s
W20260709 13:06:22.809348 24190 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.557s	user 0.074s	sys 0.165s
I20260709 13:06:22.809947 20105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "833a2f0775ed407a94b8924ce50adb63" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:06:22.798028 19406 rpcz_store.cc:276] 0709 13:06:21.078211 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:21.079241 (+  1030us) service_pool.cc:224] Handling call
0709 13:06:21.079654 (+   413us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:21.098206 (+ 18552us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:06:21.098239 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:21.175213 (+ 76974us) log.cc:844] Serialized 26 byte log entry
0709 13:06:21.257948 (+ 82735us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:06:21.258076 (+   128us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:22.775917 (+1517841us) spinlock_profiling.cc:243] Waited 6.2 ms on lock 0x7b4800002958. stack: 00007f4a79de9343 00007f4a79de9240 00007f4a797781d4 00007f4a834b6304 00007f4a834b6299 00007f4a81e31aa1 00007f4a81e28b37 00007f4a81e289ca 00007f4a81f2026f 00007f4a81f1ff37 00007f4a81f3455c 00007f4a81f34508 00007f4a81f34488 00007f4a81f34443 00007f4a81f336ec 00007f4a80e5da96
0709 13:06:22.797088 (+ 21171us) spinlock_profiling.cc:243] Waited 16.5 ms on lock 0x7b54000b40d4. stack: 00007f4a79de9343 00007f4a79de9240 00007f4a797781d4 00007f4a834b6304 00007f4a834b6299 00007f4a7ce71571 00007f4a7cf08e01 00007f4a7cf0783e 00007f4a81ecc419 00007f4a7b443bd4 00007f4a7b443b62 00007f4a7b443a91 00007f4a7b443a0c 00007f4a7b442cc2 00007f4a7b24348c 00007f4a7b2428c6
0709 13:06:22.797147 (+    59us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:22.797217 (+    70us) raft_consensus.cc:1685] finished
0709 13:06:22.797235 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:22.797382 (+   147us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1634,"raft.queue_time_us":2171,"raft.run_cpu_time_us":56409,"raft.run_wall_time_us":1664007,"spinlock_wait_cycles":52139648,"thread_start_us":59657,"threads_started":1,"wal-append.queue_time_us":97192,"wal-append.run_cpu_time_us":1599,"wal-append.run_wall_time_us":1149488}
I20260709 13:06:22.815847 20075 leader_election.cc:304] T 833a2f0775ed407a94b8924ce50adb63 P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 127766fc592545a4997f7790f50f6076, e5256d91808b47c195bc9b4dbd7f2b87; no voters: 
I20260709 13:06:22.823374 24061 raft_consensus.cc:2804] T 833a2f0775ed407a94b8924ce50adb63 P 127766fc592545a4997f7790f50f6076 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:06:22.823518 24253 consensus_queue.cc:1048] T ab43d85f64114d4ebf618930e43d9ed0 P 127766fc592545a4997f7790f50f6076 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.006s
I20260709 13:06:22.836213 19484 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58286 (request call id 2176) took 1405 ms. Trace:
I20260709 13:06:22.836804 19484 rpcz_store.cc:276] 0709 13:06:21.430454 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:21.430582 (+   128us) service_pool.cc:224] Handling call
0709 13:06:21.430888 (+   306us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:22.158206 (+727318us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:22.835869 (+677663us) spinlock_profiling.cc:243] Waited 727 ms on lock 0x7b5400224554. stack: 00007f4a79de9343 00007f4a79de9240 00007f4a797781d4 00007f4a834b6304 00007f4a834b6299 00007f4a7ce71571 00007f4a7cf08e01 00007f4a7cf0783e 00007f4a81ecc419 00007f4a7b443bd4 00007f4a7b443b62 00007f4a7b443a91 00007f4a7b443a0c 00007f4a7b442cc2 00007f4a7b24348c 00007f4a7b2428c6
0709 13:06:22.836133 (+   264us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1671194368}
I20260709 13:06:22.845512 20111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "172b3dd13109415a955b71ac0e9d2234" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:06:22.849869 24361 raft_consensus.cc:493] T bc225c93219c45538b53a1bd3d387e4d P e5256d91808b47c195bc9b4dbd7f2b87 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 0473d2b2d01f4459b1e90fd12cc7840e)
W20260709 13:06:22.856132 24353 log.cc:927] Time spent T 1efebf73c86e432baa55533136b6e12c P e61c3a8f61bb48f8a963c9480e53c168: Append to log took a long time: real 0.405s	user 0.010s	sys 0.001s
I20260709 13:06:22.827291 24257 leader_election.cc:290] T 3e1f505cb0f1427bbd698ac889d80821 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:06:22.843560 24061 raft_consensus.cc:697] T 833a2f0775ed407a94b8924ce50adb63 P 127766fc592545a4997f7790f50f6076 [term 13 LEADER]: Becoming Leader. State: Replica: 127766fc592545a4997f7790f50f6076, State: Running, Role: LEADER
I20260709 13:06:22.864928 24362 raft_consensus.cc:493] T 28af091831594f9d8e96482078cc7625 P e5256d91808b47c195bc9b4dbd7f2b87 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 0473d2b2d01f4459b1e90fd12cc7840e)
W20260709 13:06:22.877271 19525 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:22.883097 20111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "309c3ca0ca4b4f3ba129752ea2cb293b" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:06:22.883380 24235 consensus_queue.cc:1059] T 1dc5b3532fe54f74876d02beffa2c230 P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 }, Status: INVALID_TERM, Last received: 12.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:06:22.876626 24183 raft_consensus.cc:493] T 22196caba61445d3bec98a0aab3c337d P 0473d2b2d01f4459b1e90fd12cc7840e [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:22.884364 24183 raft_consensus.cc:515] T 22196caba61445d3bec98a0aab3c337d P 0473d2b2d01f4459b1e90fd12cc7840e [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:22.884960 24061 consensus_queue.cc:237] T 833a2f0775ed407a94b8924ce50adb63 P 127766fc592545a4997f7790f50f6076 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:22.886379 24183 leader_election.cc:290] T 22196caba61445d3bec98a0aab3c337d P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:06:22.881218 24310 consensus_queue.cc:1059] T 2725d2c4cb054f18b0fc8f735c15f6c2 P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 }, Status: INVALID_TERM, Last received: 14.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.013s
I20260709 13:06:22.894194 24235 raft_consensus.cc:3055] T 1dc5b3532fe54f74876d02beffa2c230 P e61c3a8f61bb48f8a963c9480e53c168 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:06:22.861526 24229 leader_election.cc:290] T b08304a0a02b42d7840c4e8ee9a6bd1a P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:06:22.850584 24361 raft_consensus.cc:515] T bc225c93219c45538b53a1bd3d387e4d P e5256d91808b47c195bc9b4dbd7f2b87 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:22.894589 24310 raft_consensus.cc:3055] T 2725d2c4cb054f18b0fc8f735c15f6c2 P e61c3a8f61bb48f8a963c9480e53c168 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:06:22.878763 24055 raft_consensus.cc:493] T 9962423cb4e54fcfa5de01daf68a86e7 P 0473d2b2d01f4459b1e90fd12cc7840e [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 127766fc592545a4997f7790f50f6076)
I20260709 13:06:22.908344 20111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48824d5acfbc485ebf8c2d944e7202de" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:06:22.908569 19377 leader_election.cc:304] T 1f85fc4b527a48848e5faa083b604e36 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87; no voters: 127766fc592545a4997f7790f50f6076
I20260709 13:06:22.909062 20111 raft_consensus.cc:2368] T 48824d5acfbc485ebf8c2d944e7202de P 127766fc592545a4997f7790f50f6076 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0473d2b2d01f4459b1e90fd12cc7840e for earlier term 14. Current term is 15.
I20260709 13:06:22.894646 24235 raft_consensus.cc:740] T 1dc5b3532fe54f74876d02beffa2c230 P e61c3a8f61bb48f8a963c9480e53c168 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: e61c3a8f61bb48f8a963c9480e53c168, State: Running, Role: LEADER
I20260709 13:06:22.910442 19406 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "36f6ba92b9ba46babe4ebd6c02e5fbd9"
dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
mode: GRACEFUL
new_leader_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
 from {username='slave'} at 127.0.0.1:37312
W20260709 13:06:22.916436 19375 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.626s	user 0.011s	sys 0.019s
I20260709 13:06:22.928013 19406 raft_consensus.cc:606] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P e5256d91808b47c195bc9b4dbd7f2b87 [term 14 FOLLOWER]: Received request to transfer leadership to TS 0473d2b2d01f4459b1e90fd12cc7840e
I20260709 13:06:22.928382 19406 raft_consensus.cc:614] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P e5256d91808b47c195bc9b4dbd7f2b87 [term 14 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:06:22.913231 19478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edd7d470b5014c9489be7f41f64355c9" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 15 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:06:22.932154 19482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e36a9d6e29c4a7c860cf267efbd4c74" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 12 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
W20260709 13:06:22.932943 19375 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.643s	user 0.015s	sys 0.019s
W20260709 13:06:22.933480 19375 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.3:36891, user_credentials={real_user=slave}} blocked reactor thread for 1.64344e+06us
I20260709 13:06:22.876127 24257 raft_consensus.cc:493] T 4af19371ea874c09a0a2147040835cbb P e5256d91808b47c195bc9b4dbd7f2b87 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 127766fc592545a4997f7790f50f6076)
I20260709 13:06:22.907050 24310 raft_consensus.cc:740] T 2725d2c4cb054f18b0fc8f735c15f6c2 P e61c3a8f61bb48f8a963c9480e53c168 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: e61c3a8f61bb48f8a963c9480e53c168, State: Running, Role: LEADER
I20260709 13:06:22.941500 20111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62c6c134d3d24a1ab144dd9ee6bc3f64" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:06:22.941825 19377 leader_election.cc:304] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87; no voters: 127766fc592545a4997f7790f50f6076
I20260709 13:06:22.939848 19375 leader_election.cc:304] T 70797e5783b5454ab0d0eea663e791e3 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168; no voters: 127766fc592545a4997f7790f50f6076
I20260709 13:06:22.941602 19486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7be9efa6559648dbb5a0f7684c4542d1" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:06:22.941437 19478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef32ce6fdd0e40d382c79974f30295c6" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:06:22.889464 24362 raft_consensus.cc:515] T 28af091831594f9d8e96482078cc7625 P e5256d91808b47c195bc9b4dbd7f2b87 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:22.945137 19480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e1085d23e8347fbbd5bce7542f4b1f4" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:06:22.947856 19480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1b10566f45d4a7d9029858330e02d5b" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:06:22.949306 19480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86a6797bdfe94fa496c050ceae4bd0d9" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:06:22.945643 20110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed7fdbcb96d14d418db9ca90a792588a" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:06:22.952809 19480 raft_consensus.cc:1275] T 3e1f505cb0f1427bbd698ac889d80821 P 0473d2b2d01f4459b1e90fd12cc7840e [term 14 FOLLOWER]: Refusing update from remote peer e61c3a8f61bb48f8a963c9480e53c168: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 13:06:22.954083 24227 raft_consensus.cc:493] T 179fd671030940b4b4a4e24bcc4aba0a P e61c3a8f61bb48f8a963c9480e53c168 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:22.954644 24227 raft_consensus.cc:515] T 179fd671030940b4b4a4e24bcc4aba0a P e61c3a8f61bb48f8a963c9480e53c168 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:22.956796 24227 leader_election.cc:290] T 179fd671030940b4b4a4e24bcc4aba0a P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:06:22.943962 24338 raft_consensus.cc:493] T fa731b585f684a7fb2d106c50f143b83 P e61c3a8f61bb48f8a963c9480e53c168 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 127766fc592545a4997f7790f50f6076)
I20260709 13:06:22.959174 24338 raft_consensus.cc:515] T fa731b585f684a7fb2d106c50f143b83 P e61c3a8f61bb48f8a963c9480e53c168 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:22.961447 24338 leader_election.cc:290] T fa731b585f684a7fb2d106c50f143b83 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:06:22.964305 19486 raft_consensus.cc:1275] T ff75a1d4cb1f493db8f71ddc136ba9ab P 0473d2b2d01f4459b1e90fd12cc7840e [term 13 FOLLOWER]: Refusing update from remote peer e5256d91808b47c195bc9b4dbd7f2b87: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 13 index: 7. (index mismatch)
I20260709 13:06:22.965322 19486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab43d85f64114d4ebf618930e43d9ed0" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:06:22.965886 19486 raft_consensus.cc:2468] T ab43d85f64114d4ebf618930e43d9ed0 P 0473d2b2d01f4459b1e90fd12cc7840e [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 14.
I20260709 13:06:22.966663 19486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14efcc79969f41babe5529c22d59156d" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:06:22.967785 19486 raft_consensus.cc:2468] T 14efcc79969f41babe5529c22d59156d P 0473d2b2d01f4459b1e90fd12cc7840e [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 127766fc592545a4997f7790f50f6076 in term 14.
I20260709 13:06:22.968644 19486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22196caba61445d3bec98a0aab3c337d" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:06:22.969223 19486 raft_consensus.cc:2468] T 22196caba61445d3bec98a0aab3c337d P 0473d2b2d01f4459b1e90fd12cc7840e [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 11.
I20260709 13:06:22.970021 19486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff9b0eddd810459b82d91c60777c10eb" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:06:22.971267 20110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96efeaaf1057492490e9a621f37e1a2d" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:06:22.971884 20110 raft_consensus.cc:2468] T 96efeaaf1057492490e9a621f37e1a2d P 127766fc592545a4997f7790f50f6076 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 13.
I20260709 13:06:22.971982 20103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14935b3ddf914369822e4a0547aaa355" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:06:22.972802 20111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ec1c4ce15e04c7e8c283a62179f2a64" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:06:22.974334 19486 raft_consensus.cc:1275] T 62c6c134d3d24a1ab144dd9ee6bc3f64 P 0473d2b2d01f4459b1e90fd12cc7840e [term 13 FOLLOWER]: Refusing update from remote peer 127766fc592545a4997f7790f50f6076: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 13 index: 11. (term mismatch)
I20260709 13:06:22.974836 19486 pending_rounds.cc:85] T 62c6c134d3d24a1ab144dd9ee6bc3f64 P 0473d2b2d01f4459b1e90fd12cc7840e: Aborting all ops after (but not including) 10
I20260709 13:06:22.975307 19486 pending_rounds.cc:107] T 62c6c134d3d24a1ab144dd9ee6bc3f64 P 0473d2b2d01f4459b1e90fd12cc7840e: Aborting uncommitted NO_OP operation due to leader change: 12.11
I20260709 13:06:22.975644 19486 raft_consensus.cc:2889] T 62c6c134d3d24a1ab144dd9ee6bc3f64 P 0473d2b2d01f4459b1e90fd12cc7840e [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:06:22.977206 19478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0afb57ae58a24a01850491d69f0213dd" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:06:22.981247 19486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e381f1d6b8184797ad142de49be225a8" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:06:22.981937 19554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a16f7501e2444fb86d4e2778e734e02" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: true dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:06:22.982491 19554 raft_consensus.cc:3060] T 2a16f7501e2444fb86d4e2778e734e02 P e61c3a8f61bb48f8a963c9480e53c168 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:06:22.986060 19478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48824d5acfbc485ebf8c2d944e7202de" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:06:22.987818 19486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7be9efa6559648dbb5a0f7684c4542d1" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:06:22.986716 19478 raft_consensus.cc:3060] T 48824d5acfbc485ebf8c2d944e7202de P 0473d2b2d01f4459b1e90fd12cc7840e [term 13 FOLLOWER]: Advancing to term 15
I20260709 13:06:22.993544 19486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "217b5fae677b4971b3bbd2f357a1f7ff" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:06:22.994974 19486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96efeaaf1057492490e9a621f37e1a2d" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:06:22.996837 19559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48824d5acfbc485ebf8c2d944e7202de" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:06:22.997473 19553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0afb57ae58a24a01850491d69f0213dd" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:06:22.999552 20078 leader_election.cc:304] T 14efcc79969f41babe5529c22d59156d P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, 127766fc592545a4997f7790f50f6076; no voters: e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:06:23.000130 19559 raft_consensus.cc:3060] T 48824d5acfbc485ebf8c2d944e7202de P e61c3a8f61bb48f8a963c9480e53c168 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:06:22.989965 24370 raft_consensus.cc:2804] T 1f85fc4b527a48848e5faa083b604e36 P e5256d91808b47c195bc9b4dbd7f2b87 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:06:23.002729 19553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65d8cb8d6ec64f459d5a47cefab10acf" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:06:23.003299 19553 raft_consensus.cc:2468] T 65d8cb8d6ec64f459d5a47cefab10acf P e61c3a8f61bb48f8a963c9480e53c168 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 127766fc592545a4997f7790f50f6076 in term 13.
I20260709 13:06:23.003504 19486 raft_consensus.cc:2393] T 96efeaaf1057492490e9a621f37e1a2d P 0473d2b2d01f4459b1e90fd12cc7840e [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 127766fc592545a4997f7790f50f6076 in current term 14: Already voted for candidate 0473d2b2d01f4459b1e90fd12cc7840e in this term.
I20260709 13:06:23.005048 20078 leader_election.cc:304] T ff9b0eddd810459b82d91c60777c10eb P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 127766fc592545a4997f7790f50f6076; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87
W20260709 13:06:23.006609 19375 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.3:36891, user_credentials={real_user=slave}} blocked reactor thread for 66860.8us
I20260709 13:06:23.007120 19526 leader_election.cc:304] T 0e1085d23e8347fbbd5bce7542f4b1f4 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e61c3a8f61bb48f8a963c9480e53c168; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, 127766fc592545a4997f7790f50f6076
I20260709 13:06:23.008622 19526 leader_election.cc:304] T 7be9efa6559648dbb5a0f7684c4542d1 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: e61c3a8f61bb48f8a963c9480e53c168; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, 127766fc592545a4997f7790f50f6076
I20260709 13:06:23.008917 19449 leader_election.cc:304] T 309c3ca0ca4b4f3ba129752ea2cb293b P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e; no voters: 127766fc592545a4997f7790f50f6076, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:06:23.012894 19486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "179fd671030940b4b4a4e24bcc4aba0a" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:06:22.916831 24055 raft_consensus.cc:515] T 9962423cb4e54fcfa5de01daf68a86e7 P 0473d2b2d01f4459b1e90fd12cc7840e [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:23.014464 19449 leader_election.cc:400] T 48824d5acfbc485ebf8c2d944e7202de P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 14 pre-election: Vote denied by peer 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121) with higher term. Message: Invalid argument: T 48824d5acfbc485ebf8c2d944e7202de P 127766fc592545a4997f7790f50f6076 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0473d2b2d01f4459b1e90fd12cc7840e for earlier term 14. Current term is 15.
I20260709 13:06:23.017694 19553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "833a2f0775ed407a94b8924ce50adb63" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:06:23.018759 19553 raft_consensus.cc:3060] T 833a2f0775ed407a94b8924ce50adb63 P e61c3a8f61bb48f8a963c9480e53c168 [term 11 FOLLOWER]: Advancing to term 13
W20260709 13:06:22.996803 24359 log.cc:927] Time spent T 85c494af21f9457a85da47b9bc70c1fd P 127766fc592545a4997f7790f50f6076: Append to log took a long time: real 0.179s	user 0.001s	sys 0.000s
I20260709 13:06:23.019470 19486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c5eebf646ad445a9d1b1adc319d7b16" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:06:22.947141 24257 raft_consensus.cc:515] T 4af19371ea874c09a0a2147040835cbb P e5256d91808b47c195bc9b4dbd7f2b87 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:23.112598 19554 raft_consensus.cc:2468] T 2a16f7501e2444fb86d4e2778e734e02 P e61c3a8f61bb48f8a963c9480e53c168 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 127766fc592545a4997f7790f50f6076 in term 13.
W20260709 13:06:23.138386 19377 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.2:46257, user_credentials={real_user=slave}} blocked reactor thread for 196620us
I20260709 13:06:23.017808 19559 raft_consensus.cc:2468] T 48824d5acfbc485ebf8c2d944e7202de P e61c3a8f61bb48f8a963c9480e53c168 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 127766fc592545a4997f7790f50f6076 in term 15.
I20260709 13:06:23.020030 19449 leader_election.cc:403] T 48824d5acfbc485ebf8c2d944e7202de P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 14 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:06:23.021440 19481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40e1e16737a842ee936002830f36882e" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:06:23.170845 19481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76cb037fc9064d13b59a8969d897ce8c" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
W20260709 13:06:23.172747 24356 log.cc:927] Time spent T 62c6c134d3d24a1ab144dd9ee6bc3f64 P 127766fc592545a4997f7790f50f6076: Append to log took a long time: real 0.902s	user 0.004s	sys 0.007s
I20260709 13:06:23.016841 24227 raft_consensus.cc:2749] T 7be9efa6559648dbb5a0f7684c4542d1 P e61c3a8f61bb48f8a963c9480e53c168 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:06:23.176729 24361 leader_election.cc:290] T bc225c93219c45538b53a1bd3d387e4d P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:06:23.177433 24227 raft_consensus.cc:493] T 22196caba61445d3bec98a0aab3c337d P e61c3a8f61bb48f8a963c9480e53c168 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:23.177475 24361 consensus_queue.cc:1048] T 2e36a9d6e29c4a7c860cf267efbd4c74 P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:06:23.178161 24227 raft_consensus.cc:515] T 22196caba61445d3bec98a0aab3c337d P e61c3a8f61bb48f8a963c9480e53c168 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:23.016654 24238 raft_consensus.cc:2749] T 0e1085d23e8347fbbd5bce7542f4b1f4 P e61c3a8f61bb48f8a963c9480e53c168 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:06:23.017016 24141 raft_consensus.cc:2804] T 14efcc79969f41babe5529c22d59156d P 127766fc592545a4997f7790f50f6076 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:06:23.181542 20111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa731b585f684a7fb2d106c50f143b83" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:06:23.183693 19374 leader_election.cc:304] T 833a2f0775ed407a94b8924ce50adb63 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 127766fc592545a4997f7790f50f6076, e5256d91808b47c195bc9b4dbd7f2b87; no voters: 
I20260709 13:06:23.183840 24366 raft_consensus.cc:493] T 217b5fae677b4971b3bbd2f357a1f7ff P e5256d91808b47c195bc9b4dbd7f2b87 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 0473d2b2d01f4459b1e90fd12cc7840e)
I20260709 13:06:23.184443 24366 raft_consensus.cc:515] T 217b5fae677b4971b3bbd2f357a1f7ff P e5256d91808b47c195bc9b4dbd7f2b87 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:23.186926 24374 consensus_queue.cc:1048] T 14efcc79969f41babe5529c22d59156d P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:06:23.176903 24313 raft_consensus.cc:2804] T 70797e5783b5454ab0d0eea663e791e3 P e5256d91808b47c195bc9b4dbd7f2b87 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:06:23.021694 24306 consensus_queue.cc:1048] T 3e1f505cb0f1427bbd698ac889d80821 P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.166s
I20260709 13:06:23.188133 24313 raft_consensus.cc:493] T 70797e5783b5454ab0d0eea663e791e3 P e5256d91808b47c195bc9b4dbd7f2b87 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 127766fc592545a4997f7790f50f6076)
I20260709 13:06:23.188556 24313 raft_consensus.cc:3060] T 70797e5783b5454ab0d0eea663e791e3 P e5256d91808b47c195bc9b4dbd7f2b87 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:06:23.187615 24141 raft_consensus.cc:493] T 14efcc79969f41babe5529c22d59156d P 127766fc592545a4997f7790f50f6076 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:06:23.154809 24350 log.cc:927] Time spent T ab43d85f64114d4ebf618930e43d9ed0 P e61c3a8f61bb48f8a963c9480e53c168: Append to log took a long time: real 0.098s	user 0.001s	sys 0.000s
I20260709 13:06:23.189568 19560 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40428 (request call id 2676) took 1152 ms. Trace:
I20260709 13:06:23.189966 19560 rpcz_store.cc:276] 0709 13:06:22.037714 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:22.037825 (+   111us) service_pool.cc:224] Handling call
0709 13:06:22.039930 (+  2105us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:22.107075 (+ 67145us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:22.107095 (+    20us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:22.107119 (+    24us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:06:22.107137 (+    18us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:23.189339 (+1082202us) spinlock_profiling.cc:243] Waited 67 ms on lock 0x7b54003093d4. stack: 00007f4a79de9343 00007f4a79de9240 00007f4a797781d4 00007f4a834b6304 00007f4a834b6299 00007f4a7ce71571 00007f4a7cf08e01 00007f4a7cf0783e 00007f4a81ecc419 00007f4a7b443bd4 00007f4a7b443b62 00007f4a7b443a91 00007f4a7b443a0c 00007f4a7b442cc2 00007f4a7b24348c 00007f4a7b2428c6
0709 13:06:23.189401 (+    62us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:23.189515 (+   114us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":154054016}
I20260709 13:06:23.010795 24266 raft_consensus.cc:2749] T ff9b0eddd810459b82d91c60777c10eb P 127766fc592545a4997f7790f50f6076 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:06:23.031912 19558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7be9efa6559648dbb5a0f7684c4542d1" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:06:23.052523 19555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c5eebf646ad445a9d1b1adc319d7b16" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:06:23.119076 20076 leader_election.cc:304] T 0afb57ae58a24a01850491d69f0213dd P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 127766fc592545a4997f7790f50f6076; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168
W20260709 13:06:23.125581 19523 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.17.223.1:40321 timed out after 1.684s (SENT) [suppressed 10 similar messages]
W20260709 13:06:23.204300 19449 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.4:43121, user_credentials={real_user=slave}} blocked reactor thread for 189947us
I20260709 13:06:23.228468 19449 leader_election.cc:304] T 96efeaaf1057492490e9a621f37e1a2d P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, 127766fc592545a4997f7790f50f6076; no voters: 
I20260709 13:06:23.229216 19555 raft_consensus.cc:2468] T 6c5eebf646ad445a9d1b1adc319d7b16 P e61c3a8f61bb48f8a963c9480e53c168 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 127766fc592545a4997f7790f50f6076 in term 12.
I20260709 13:06:23.189231 24141 raft_consensus.cc:3060] T 14efcc79969f41babe5529c22d59156d P 127766fc592545a4997f7790f50f6076 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:06:23.135784 19478 raft_consensus.cc:2468] T 48824d5acfbc485ebf8c2d944e7202de P 0473d2b2d01f4459b1e90fd12cc7840e [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 127766fc592545a4997f7790f50f6076 in term 15.
I20260709 13:06:23.128640 19551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96efeaaf1057492490e9a621f37e1a2d" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
W20260709 13:06:23.147797 24351 log.cc:927] Time spent T ef32ce6fdd0e40d382c79974f30295c6 P e61c3a8f61bb48f8a963c9480e53c168: Append to log took a long time: real 0.879s	user 0.007s	sys 0.003s
I20260709 13:06:23.236052 19551 raft_consensus.cc:2468] T 96efeaaf1057492490e9a621f37e1a2d P e61c3a8f61bb48f8a963c9480e53c168 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 127766fc592545a4997f7790f50f6076 in term 14.
W20260709 13:06:23.232050 20076 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.3:36891, user_credentials={real_user=slave}} blocked reactor thread for 113090us
I20260709 13:06:23.239183 24276 raft_consensus.cc:2804] T 96efeaaf1057492490e9a621f37e1a2d P 0473d2b2d01f4459b1e90fd12cc7840e [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:06:23.239833 24276 raft_consensus.cc:493] T 96efeaaf1057492490e9a621f37e1a2d P 0473d2b2d01f4459b1e90fd12cc7840e [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:23.240248 24276 raft_consensus.cc:3060] T 96efeaaf1057492490e9a621f37e1a2d P 0473d2b2d01f4459b1e90fd12cc7840e [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:06:23.005203 24370 raft_consensus.cc:493] T 1f85fc4b527a48848e5faa083b604e36 P e5256d91808b47c195bc9b4dbd7f2b87 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 127766fc592545a4997f7790f50f6076)
I20260709 13:06:23.253427 20078 leader_election.cc:304] T 48824d5acfbc485ebf8c2d944e7202de P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, 127766fc592545a4997f7790f50f6076; no voters: 
I20260709 13:06:23.254698 24370 raft_consensus.cc:3060] T 1f85fc4b527a48848e5faa083b604e36 P e5256d91808b47c195bc9b4dbd7f2b87 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:06:23.022174 24275 raft_consensus.cc:2749] T 309c3ca0ca4b4f3ba129752ea2cb293b P 0473d2b2d01f4459b1e90fd12cc7840e [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:06:23.148142 24055 leader_election.cc:290] T 9962423cb4e54fcfa5de01daf68a86e7 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:06:23.115301 24373 raft_consensus.cc:2804] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P e5256d91808b47c195bc9b4dbd7f2b87 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:06:23.115710 24274 raft_consensus.cc:493] T a08760e15aac4630a629431f56024dc8 P 0473d2b2d01f4459b1e90fd12cc7840e [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:23.186532 24366 leader_election.cc:290] T 217b5fae677b4971b3bbd2f357a1f7ff P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
W20260709 13:06:23.263558 19375 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.3:36891, user_credentials={real_user=slave}} blocked reactor thread for 247731us
I20260709 13:06:23.204839 24372 raft_consensus.cc:2764] T 833a2f0775ed407a94b8924ce50adb63 P e5256d91808b47c195bc9b4dbd7f2b87 [term 13 FOLLOWER]: Leader pre-election decision vote started in defunct term 12: won
I20260709 13:06:23.137005 24315 raft_consensus.cc:493] T 14935b3ddf914369822e4a0547aaa355 P e61c3a8f61bb48f8a963c9480e53c168 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 127766fc592545a4997f7790f50f6076)
W20260709 13:06:23.283365 19377 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.2:46257, user_credentials={real_user=slave}} blocked reactor thread for 113913us
I20260709 13:06:23.264482 20076 leader_election.cc:304] T 65d8cb8d6ec64f459d5a47cefab10acf P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 127766fc592545a4997f7790f50f6076, e61c3a8f61bb48f8a963c9480e53c168; no voters: e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:06:23.270191 19553 raft_consensus.cc:2468] T 833a2f0775ed407a94b8924ce50adb63 P e61c3a8f61bb48f8a963c9480e53c168 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 127766fc592545a4997f7790f50f6076 in term 13.
I20260709 13:06:23.201484 24227 leader_election.cc:290] T 22196caba61445d3bec98a0aab3c337d P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:06:23.125933 24307 raft_consensus.cc:493] T 4af19371ea874c09a0a2147040835cbb P e61c3a8f61bb48f8a963c9480e53c168 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 127766fc592545a4997f7790f50f6076)
I20260709 13:06:23.290769 24307 raft_consensus.cc:515] T 4af19371ea874c09a0a2147040835cbb P e61c3a8f61bb48f8a963c9480e53c168 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:23.292711 19377 leader_election.cc:304] T 22196caba61445d3bec98a0aab3c337d P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87; no voters: 
I20260709 13:06:23.001667 24235 consensus_queue.cc:260] T 1dc5b3532fe54f74876d02beffa2c230 P e61c3a8f61bb48f8a963c9480e53c168 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 13.7, Last appended by leader: 7, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:23.250183 24276 raft_consensus.cc:515] T 96efeaaf1057492490e9a621f37e1a2d P 0473d2b2d01f4459b1e90fd12cc7840e [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
W20260709 13:06:23.259527 24367 log.cc:927] Time spent T ab43d85f64114d4ebf618930e43d9ed0 P e5256d91808b47c195bc9b4dbd7f2b87: Append to log took a long time: real 0.140s	user 0.000s	sys 0.001s
I20260709 13:06:23.252899 23933 raft_consensus.cc:2749] T 48824d5acfbc485ebf8c2d944e7202de P 0473d2b2d01f4459b1e90fd12cc7840e [term 15 FOLLOWER]: Leader pre-election lost for term 14. Reason: Vote denied by peer 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121) with higher term. Message: Invalid argument: T 48824d5acfbc485ebf8c2d944e7202de P 127766fc592545a4997f7790f50f6076 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0473d2b2d01f4459b1e90fd12cc7840e for earlier term 14. Current term is 15.
I20260709 13:06:23.270380 24373 raft_consensus.cc:493] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P e5256d91808b47c195bc9b4dbd7f2b87 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 127766fc592545a4997f7790f50f6076)
I20260709 13:06:23.018786 24310 consensus_queue.cc:260] T 2725d2c4cb054f18b0fc8f735c15f6c2 P e61c3a8f61bb48f8a963c9480e53c168 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 15.8, Last appended by leader: 8, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:23.041541 24278 consensus_queue.cc:1048] T 62c6c134d3d24a1ab144dd9ee6bc3f64 P 127766fc592545a4997f7790f50f6076 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.248s
I20260709 13:06:23.274176 19375 leader_election.cc:304] T 1dc5b3532fe54f74876d02beffa2c230 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:06:23.252189 24248 raft_consensus.cc:2749] T 0afb57ae58a24a01850491d69f0213dd P 127766fc592545a4997f7790f50f6076 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:06:23.294003 24307 leader_election.cc:290] T 4af19371ea874c09a0a2147040835cbb P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:06:23.281270 24048 raft_consensus.cc:2804] T 48824d5acfbc485ebf8c2d944e7202de P 127766fc592545a4997f7790f50f6076 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:06:23.315193 24253 raft_consensus.cc:2804] T 65d8cb8d6ec64f459d5a47cefab10acf P 127766fc592545a4997f7790f50f6076 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:06:23.323472 24310 raft_consensus.cc:3060] T 2725d2c4cb054f18b0fc8f735c15f6c2 P e61c3a8f61bb48f8a963c9480e53c168 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:06:23.276461 24274 raft_consensus.cc:515] T a08760e15aac4630a629431f56024dc8 P 0473d2b2d01f4459b1e90fd12cc7840e [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:23.347241 19482 raft_consensus.cc:1240] T d1e5873a19244c5ebbcd38e126796ee7 P 0473d2b2d01f4459b1e90fd12cc7840e [term 15 FOLLOWER]: Rejecting Update request from peer e61c3a8f61bb48f8a963c9480e53c168 for earlier term 14. Current term is 15. Ops: [14.8-14.8]
I20260709 13:06:23.311146 19480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22196caba61445d3bec98a0aab3c337d" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:06:23.348474 19480 raft_consensus.cc:2468] T 22196caba61445d3bec98a0aab3c337d P 0473d2b2d01f4459b1e90fd12cc7840e [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 11.
W20260709 13:06:23.331919 24375 log.cc:927] Time spent T 0e1085d23e8347fbbd5bce7542f4b1f4 P 127766fc592545a4997f7790f50f6076: Append to log took a long time: real 0.156s	user 0.004s	sys 0.000s
I20260709 13:06:23.332147 24276 leader_election.cc:290] T 96efeaaf1057492490e9a621f37e1a2d P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 15 election: Requested vote from peers e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:06:23.314851 24373 raft_consensus.cc:3060] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P e5256d91808b47c195bc9b4dbd7f2b87 [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:06:23.342154 20076 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.3:36891, user_credentials={real_user=slave}} blocked reactor thread for 49713.3us
W20260709 13:06:23.349861 19524 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:23.361634 19524 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:23.362159 19524 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:23.365435 19555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62c6c134d3d24a1ab144dd9ee6bc3f64" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:06:23.366195 19526 leader_election.cc:304] T 22196caba61445d3bec98a0aab3c337d P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:06:23.351451 19485 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58294 (request call id 2337) took 1262 ms. Trace:
W20260709 13:06:23.367022 19375 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.3:36891, user_credentials={real_user=slave}} blocked reactor thread for 92927.1us
I20260709 13:06:23.368799 19557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dc5b3532fe54f74876d02beffa2c230" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:06:23.373853 19408 raft_consensus.cc:1275] T 2a16f7501e2444fb86d4e2778e734e02 P e5256d91808b47c195bc9b4dbd7f2b87 [term 13 FOLLOWER]: Refusing update from remote peer 127766fc592545a4997f7790f50f6076: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:06:23.361946 19477 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58294 (request call id 2348) took 1259 ms. Trace:
I20260709 13:06:23.367113 19485 rpcz_store.cc:276] 0709 13:06:22.084864 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:22.084971 (+   107us) service_pool.cc:224] Handling call
0709 13:06:23.346886 (+1261915us) spinlock_profiling.cc:243] Waited 103 ms on lock 0x7b54000a9e54. stack: 00007f4a79de9343 00007f4a79de9240 00007f4a797781d4 00007f4a834b6304 00007f4a834b6299 00007f4a7ce71571 00007f4a7cf0c2fa 00007f4a81ecdb17 00007f4a7b4486d4 00007f4a7b448662 00007f4a7b448591 00007f4a7b44850c 00007f4a7b4477c2 00007f4a7b24348c 00007f4a7b2428c6 00007f4a7b24226f
0709 13:06:23.347027 (+   141us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":236633472}
I20260709 13:06:23.375535 19477 rpcz_store.cc:276] 0709 13:06:22.102263 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:22.163706 (+ 61443us) service_pool.cc:224] Handling call
0709 13:06:22.163975 (+   269us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:22.203562 (+ 39587us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:22.203606 (+    44us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:22.203659 (+    53us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:06:22.203712 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:23.361606 (+1157894us) spinlock_profiling.cc:243] Waited 39.4 ms on lock 0x7b54002b89d4. stack: 00007f4a79de9343 00007f4a79de9240 00007f4a797781d4 00007f4a834b6304 00007f4a834b6299 00007f4a7ce71571 00007f4a7cf08e01 00007f4a7cf0783e 00007f4a81ecc419 00007f4a7b443bd4 00007f4a7b443b62 00007f4a7b443a91 00007f4a7b443a0c 00007f4a7b442cc2 00007f4a7b24348c 00007f4a7b2428c6
0709 13:06:23.361674 (+    68us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:23.361854 (+   180us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":90627840}
I20260709 13:06:23.301676 24315 raft_consensus.cc:515] T 14935b3ddf914369822e4a0547aaa355 P e61c3a8f61bb48f8a963c9480e53c168 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } attrs { replace: true } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:23.340104 24253 raft_consensus.cc:493] T 65d8cb8d6ec64f459d5a47cefab10acf P 127766fc592545a4997f7790f50f6076 [term 13 FOLLOWER]: Starting leader election (detected failure of leader e5256d91808b47c195bc9b4dbd7f2b87)
I20260709 13:06:23.386454 19555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa8650e71aa14778b3d73721fc50d9fc" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:06:23.382599 19486 raft_consensus.cc:1275] T a08760e15aac4630a629431f56024dc8 P 0473d2b2d01f4459b1e90fd12cc7840e [term 16 FOLLOWER]: Refusing update from remote peer e61c3a8f61bb48f8a963c9480e53c168: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 16 index: 9. (term mismatch)
W20260709 13:06:23.389209 19377 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.2:46257, user_credentials={real_user=slave}} blocked reactor thread for 96550.8us
I20260709 13:06:23.393352 19552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed7fdbcb96d14d418db9ca90a792588a" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:06:23.393980 19375 leader_election.cc:304] T f93ee515a9c14139bf566522ed8232f3 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:06:23.350060 24362 leader_election.cc:290] T 28af091831594f9d8e96482078cc7625 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:06:23.349974 24048 raft_consensus.cc:697] T 48824d5acfbc485ebf8c2d944e7202de P 127766fc592545a4997f7790f50f6076 [term 15 LEADER]: Becoming Leader. State: Replica: 127766fc592545a4997f7790f50f6076, State: Running, Role: LEADER
I20260709 13:06:23.395926 19556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e5873a19244c5ebbcd38e126796ee7" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:06:23.391697 19555 raft_consensus.cc:3060] T fa8650e71aa14778b3d73721fc50d9fc P e61c3a8f61bb48f8a963c9480e53c168 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:06:23.391916 19486 pending_rounds.cc:85] T a08760e15aac4630a629431f56024dc8 P 0473d2b2d01f4459b1e90fd12cc7840e: Aborting all ops after (but not including) 8
I20260709 13:06:23.537351 24274 leader_election.cc:290] T a08760e15aac4630a629431f56024dc8 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:06:23.390523 24389 consensus_queue.cc:1048] T ff75a1d4cb1f493db8f71ddc136ba9ab P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.071s
I20260709 13:06:23.363343 24380 raft_consensus.cc:493] T 4509b76741dc428e9201c70c1658da13 P e61c3a8f61bb48f8a963c9480e53c168 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader e5256d91808b47c195bc9b4dbd7f2b87)
I20260709 13:06:23.395455 24382 raft_consensus.cc:2749] T 1dc5b3532fe54f74876d02beffa2c230 P e5256d91808b47c195bc9b4dbd7f2b87 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:06:23.537565 19375 leader_election.cc:304] T 2b74109013a140ada21feeef92d6f563 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:06:23.381980 24374 raft_consensus.cc:2804] T 22196caba61445d3bec98a0aab3c337d P e5256d91808b47c195bc9b4dbd7f2b87 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:06:23.392953 24253 raft_consensus.cc:3060] T 65d8cb8d6ec64f459d5a47cefab10acf P 127766fc592545a4997f7790f50f6076 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:06:23.439141 24385 log.cc:927] Time spent T ab43d85f64114d4ebf618930e43d9ed0 P 0473d2b2d01f4459b1e90fd12cc7840e: Append to log took a long time: real 0.114s	user 0.000s	sys 0.001s
I20260709 13:06:23.588057 24362 raft_consensus.cc:2749] T f93ee515a9c14139bf566522ed8232f3 P e5256d91808b47c195bc9b4dbd7f2b87 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 13:06:23.565820 20078 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.2:46257, user_credentials={real_user=slave}} blocked reactor thread for 274954us
W20260709 13:06:23.484073 19525 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:23.426285 19552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a61655d99124a29b486ba4a5b37faea" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:06:23.471894 19556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4509b76741dc428e9201c70c1658da13" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:06:23.375469 24227 raft_consensus.cc:493] T 1a61655d99124a29b486ba4a5b37faea P e61c3a8f61bb48f8a963c9480e53c168 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader e5256d91808b47c195bc9b4dbd7f2b87)
I20260709 13:06:23.382057 24238 raft_consensus.cc:2804] T 22196caba61445d3bec98a0aab3c337d P e61c3a8f61bb48f8a963c9480e53c168 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:06:23.351948 24307 raft_consensus.cc:493] T 28af091831594f9d8e96482078cc7625 P e61c3a8f61bb48f8a963c9480e53c168 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 0473d2b2d01f4459b1e90fd12cc7840e)
I20260709 13:06:23.601269 19408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "172b3dd13109415a955b71ac0e9d2234" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:06:23.603466 19409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "309c3ca0ca4b4f3ba129752ea2cb293b" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:06:23.604056 19486 pending_rounds.cc:107] T a08760e15aac4630a629431f56024dc8 P 0473d2b2d01f4459b1e90fd12cc7840e: Aborting uncommitted NO_OP operation due to leader change: 15.9
I20260709 13:06:23.607431 19402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46c5bfeecc314717bffe987e6844b6d0" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 19 candidate_status { last_received { term: 18 index: 8 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:06:23.609277 19407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2725d2c4cb054f18b0fc8f735c15f6c2" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 16 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
I20260709 13:06:23.724329 19486 raft_consensus.cc:2889] T a08760e15aac4630a629431f56024dc8 P 0473d2b2d01f4459b1e90fd12cc7840e [term 16 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:06:23.724771 19407 raft_consensus.cc:2393] T 2725d2c4cb054f18b0fc8f735c15f6c2 P e5256d91808b47c195bc9b4dbd7f2b87 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 0473d2b2d01f4459b1e90fd12cc7840e in current term 16: Already voted for candidate e5256d91808b47c195bc9b4dbd7f2b87 in this term.
W20260709 13:06:23.622917 19523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.1:40321, user_credentials={real_user=slave}} blocked reactor thread for 497346us
W20260709 13:06:23.629292 19483 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58294 (request call id 2343) took 1529 ms (client timeout 1870 ms). Trace:
W20260709 13:06:23.725287 19483 rpcz_store.cc:269] 0709 13:06:22.099983 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:22.100107 (+   124us) service_pool.cc:224] Handling call
0709 13:06:23.629108 (+1529001us) spinlock_profiling.cc:243] Waited 359 ms on lock 0x7b5400221d54. stack: 00007f4a79de9343 00007f4a79de9240 00007f4a797781d4 00007f4a834b6304 00007f4a834b6299 00007f4a7ce71571 00007f4a7cf0c2fa 00007f4a81ecdb17 00007f4a7b4486d4 00007f4a7b448662 00007f4a7b448591 00007f4a7b44850c 00007f4a7b4477c2 00007f4a7b24348c 00007f4a7b2428c6 00007f4a7b24226f
0709 13:06:23.629240 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":826066176}
W20260709 13:06:23.595899 24371 log.cc:927] Time spent T df751f992649444090e27965eb1af85d P 0473d2b2d01f4459b1e90fd12cc7840e: Append to log took a long time: real 0.257s	user 0.006s	sys 0.000s
W20260709 13:06:23.630122 19375 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.3:36891, user_credentials={real_user=slave}} blocked reactor thread for 92635.8us
I20260709 13:06:23.727388 19375 leader_election.cc:304] T 21e14947d70440f19044d8f75c31e1f9 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168; no voters: 0473d2b2d01f4459b1e90fd12cc7840e
I20260709 13:06:23.728463 19375 leader_election.cc:304] T 2725d2c4cb054f18b0fc8f735c15f6c2 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:06:23.696568 19411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4509b76741dc428e9201c70c1658da13" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:06:23.731073 19411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa8650e71aa14778b3d73721fc50d9fc" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
I20260709 13:06:23.731791 19411 raft_consensus.cc:3060] T fa8650e71aa14778b3d73721fc50d9fc P e5256d91808b47c195bc9b4dbd7f2b87 [term 11 FOLLOWER]: Advancing to term 13
I20260709 13:06:23.718214 19555 raft_consensus.cc:2468] T fa8650e71aa14778b3d73721fc50d9fc P e61c3a8f61bb48f8a963c9480e53c168 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 13.
W20260709 13:06:23.718829 19377 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.2:46257, user_credentials={real_user=slave}} blocked reactor thread for 130587us
I20260709 13:06:23.735684 19555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14935b3ddf914369822e4a0547aaa355" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:06:23.736465 19555 raft_consensus.cc:2468] T 14935b3ddf914369822e4a0547aaa355 P e61c3a8f61bb48f8a963c9480e53c168 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 10.
I20260709 13:06:23.737545 19555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22196caba61445d3bec98a0aab3c337d" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:06:23.740447 19404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a61655d99124a29b486ba4a5b37faea" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:06:23.629995 24257 leader_election.cc:290] T 4af19371ea874c09a0a2147040835cbb P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:06:23.596135 24306 consensus_queue.cc:1059] T d1e5873a19244c5ebbcd38e126796ee7 P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 }, Status: INVALID_TERM, Last received: 13.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.117s
I20260709 13:06:23.693351 24305 raft_consensus.cc:2749] T 2b74109013a140ada21feeef92d6f563 P e5256d91808b47c195bc9b4dbd7f2b87 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:06:23.694809 24318 raft_consensus.cc:493] T 0afb57ae58a24a01850491d69f0213dd P e61c3a8f61bb48f8a963c9480e53c168 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 0473d2b2d01f4459b1e90fd12cc7840e)
W20260709 13:06:23.721392 19450 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.3:36891, user_credentials={real_user=slave}} blocked reactor thread for 372765us
I20260709 13:06:23.746711 24338 raft_consensus.cc:493] T f93ee515a9c14139bf566522ed8232f3 P e61c3a8f61bb48f8a963c9480e53c168 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 0473d2b2d01f4459b1e90fd12cc7840e)
I20260709 13:06:23.747628 24321 raft_consensus.cc:493] T ff75a1d4cb1f493db8f71ddc136ba9ab P e61c3a8f61bb48f8a963c9480e53c168 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:23.781968 19554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96efeaaf1057492490e9a621f37e1a2d" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:06:23.796036 19554 raft_consensus.cc:2468] T 96efeaaf1057492490e9a621f37e1a2d P e61c3a8f61bb48f8a963c9480e53c168 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 14.
I20260709 13:06:23.687638 24374 raft_consensus.cc:493] T 22196caba61445d3bec98a0aab3c337d P e5256d91808b47c195bc9b4dbd7f2b87 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:23.744812 24307 raft_consensus.cc:515] T 28af091831594f9d8e96482078cc7625 P e61c3a8f61bb48f8a963c9480e53c168 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:23.800072 19404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9962423cb4e54fcfa5de01daf68a86e7" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:06:23.813853 19554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96efeaaf1057492490e9a621f37e1a2d" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:06:23.789279 24322 raft_consensus.cc:493] T 1efebf73c86e432baa55533136b6e12c P e61c3a8f61bb48f8a963c9480e53c168 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 127766fc592545a4997f7790f50f6076)
I20260709 13:06:23.836694 19559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e1f505cb0f1427bbd698ac889d80821" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 15 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:06:23.845793 24235 raft_consensus.cc:3060] T 1dc5b3532fe54f74876d02beffa2c230 P e61c3a8f61bb48f8a963c9480e53c168 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:06:23.848716 19405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e5873a19244c5ebbcd38e126796ee7" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
I20260709 13:06:23.881754 19405 raft_consensus.cc:3060] T d1e5873a19244c5ebbcd38e126796ee7 P e5256d91808b47c195bc9b4dbd7f2b87 [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:06:23.851373 19449 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.1:40321, user_credentials={real_user=slave}} blocked reactor thread for 262369us
I20260709 13:06:23.812070 24374 raft_consensus.cc:3060] T 22196caba61445d3bec98a0aab3c337d P e5256d91808b47c195bc9b4dbd7f2b87 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:06:23.858882 20075 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.1:40321, user_credentials={real_user=slave}} blocked reactor thread for 354926us
I20260709 13:06:23.858909 19407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22196caba61445d3bec98a0aab3c337d" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:06:23.793360 24362 raft_consensus.cc:2749] T 2725d2c4cb054f18b0fc8f735c15f6c2 P e5256d91808b47c195bc9b4dbd7f2b87 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:06:23.741407 24227 raft_consensus.cc:515] T 1a61655d99124a29b486ba4a5b37faea P e61c3a8f61bb48f8a963c9480e53c168 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:23.863659 19554 raft_consensus.cc:3060] T 96efeaaf1057492490e9a621f37e1a2d P e61c3a8f61bb48f8a963c9480e53c168 [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:06:23.866132 24385 log.cc:927] Time spent T ab43d85f64114d4ebf618930e43d9ed0 P 0473d2b2d01f4459b1e90fd12cc7840e: Append to log took a long time: real 0.069s	user 0.000s	sys 0.001s
I20260709 13:06:23.693647 24380 raft_consensus.cc:515] T 4509b76741dc428e9201c70c1658da13 P e61c3a8f61bb48f8a963c9480e53c168 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:23.724542 24238 raft_consensus.cc:493] T 22196caba61445d3bec98a0aab3c337d P e61c3a8f61bb48f8a963c9480e53c168 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:23.885802 19450 leader_election.cc:304] T 62c6c134d3d24a1ab144dd9ee6bc3f64 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e; no voters: 127766fc592545a4997f7790f50f6076, e61c3a8f61bb48f8a963c9480e53c168
W20260709 13:06:23.866546 19375 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.3:36891, user_credentials={real_user=slave}} blocked reactor thread for 138139us
I20260709 13:06:23.916429 19375 leader_election.cc:304] T 179fd671030940b4b4a4e24bcc4aba0a P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168; no voters: 0473d2b2d01f4459b1e90fd12cc7840e
I20260709 13:06:23.811220 24321 raft_consensus.cc:515] T ff75a1d4cb1f493db8f71ddc136ba9ab P e61c3a8f61bb48f8a963c9480e53c168 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:23.740157 24048 consensus_queue.cc:237] T 48824d5acfbc485ebf8c2d944e7202de P 127766fc592545a4997f7790f50f6076 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:23.803512 24318 raft_consensus.cc:515] T 0afb57ae58a24a01850491d69f0213dd P e61c3a8f61bb48f8a963c9480e53c168 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:23.810870 24338 raft_consensus.cc:515] T f93ee515a9c14139bf566522ed8232f3 P e61c3a8f61bb48f8a963c9480e53c168 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:23.925675 19552 raft_consensus.cc:2468] T 1a61655d99124a29b486ba4a5b37faea P e61c3a8f61bb48f8a963c9480e53c168 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 10.
I20260709 13:06:23.911108 24153 raft_consensus.cc:493] T edd7d470b5014c9489be7f41f64355c9 P 0473d2b2d01f4459b1e90fd12cc7840e [term 14 FOLLOWER]: Starting pre-election (detected failure of leader e5256d91808b47c195bc9b4dbd7f2b87)
I20260709 13:06:23.930742 19556 raft_consensus.cc:2468] T 4509b76741dc428e9201c70c1658da13 P e61c3a8f61bb48f8a963c9480e53c168 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 8.
I20260709 13:06:23.935406 19405 raft_consensus.cc:2468] T d1e5873a19244c5ebbcd38e126796ee7 P e5256d91808b47c195bc9b4dbd7f2b87 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 15.
I20260709 13:06:23.937815 19405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46c5bfeecc314717bffe987e6844b6d0" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 19 candidate_status { last_received { term: 18 index: 8 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:06:23.916131 24306 raft_consensus.cc:3055] T d1e5873a19244c5ebbcd38e126796ee7 P e61c3a8f61bb48f8a963c9480e53c168 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:06:23.939519 19405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70797e5783b5454ab0d0eea663e791e3" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:06:23.918119 24238 raft_consensus.cc:3060] T 22196caba61445d3bec98a0aab3c337d P e61c3a8f61bb48f8a963c9480e53c168 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:06:23.917837 24274 raft_consensus.cc:493] T 2e36a9d6e29c4a7c860cf267efbd4c74 P 0473d2b2d01f4459b1e90fd12cc7840e [term 11 FOLLOWER]: Starting pre-election (detected failure of leader e5256d91808b47c195bc9b4dbd7f2b87)
I20260709 13:06:23.883682 24322 raft_consensus.cc:515] T 1efebf73c86e432baa55533136b6e12c P e61c3a8f61bb48f8a963c9480e53c168 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:23.964843 19403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a08760e15aac4630a629431f56024dc8" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:06:23.968704 19403 raft_consensus.cc:2468] T a08760e15aac4630a629431f56024dc8 P e5256d91808b47c195bc9b4dbd7f2b87 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 16.
I20260709 13:06:23.927114 24372 raft_consensus.cc:2804] T 179fd671030940b4b4a4e24bcc4aba0a P e5256d91808b47c195bc9b4dbd7f2b87 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:06:23.975123 20076 leader_election.cc:304] T 6c5eebf646ad445a9d1b1adc319d7b16 P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 127766fc592545a4997f7790f50f6076, e61c3a8f61bb48f8a963c9480e53c168; no voters: 0473d2b2d01f4459b1e90fd12cc7840e
I20260709 13:06:23.976466 19554 raft_consensus.cc:2468] T 96efeaaf1057492490e9a621f37e1a2d P e61c3a8f61bb48f8a963c9480e53c168 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 15.
I20260709 13:06:23.925254 24362 raft_consensus.cc:493] T 0cdf56e38bbc453d9438d359e5a69955 P e5256d91808b47c195bc9b4dbd7f2b87 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 0473d2b2d01f4459b1e90fd12cc7840e)
I20260709 13:06:23.980293 19411 raft_consensus.cc:2468] T fa8650e71aa14778b3d73721fc50d9fc P e5256d91808b47c195bc9b4dbd7f2b87 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 13.
I20260709 13:06:23.930531 24275 raft_consensus.cc:493] T 76cb037fc9064d13b59a8969d897ce8c P 0473d2b2d01f4459b1e90fd12cc7840e [term 11 FOLLOWER]: Starting pre-election (detected failure of leader e5256d91808b47c195bc9b4dbd7f2b87)
W20260709 13:06:23.956419 24373 consensus_meta.cc:287] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P e5256d91808b47c195bc9b4dbd7f2b87: Time spent flushing consensus metadata: real 0.565s	user 0.008s	sys 0.002s
I20260709 13:06:23.945494 23933 raft_consensus.cc:2749] T 62c6c134d3d24a1ab144dd9ee6bc3f64 P 0473d2b2d01f4459b1e90fd12cc7840e [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:06:23.973595 24310 consensus_meta.cc:287] T 2725d2c4cb054f18b0fc8f735c15f6c2 P e61c3a8f61bb48f8a963c9480e53c168: Time spent flushing consensus metadata: real 0.623s	user 0.010s	sys 0.003s
I20260709 13:06:23.944170 24306 raft_consensus.cc:740] T d1e5873a19244c5ebbcd38e126796ee7 P e61c3a8f61bb48f8a963c9480e53c168 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: e61c3a8f61bb48f8a963c9480e53c168, State: Running, Role: LEADER
I20260709 13:06:23.995487 19403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14935b3ddf914369822e4a0547aaa355" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:06:23.998399 19405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ec1c4ce15e04c7e8c283a62179f2a64" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
W20260709 13:06:23.985450 24141 consensus_meta.cc:287] T 14efcc79969f41babe5529c22d59156d P 127766fc592545a4997f7790f50f6076: Time spent flushing consensus metadata: real 0.724s	user 0.011s	sys 0.003s
W20260709 13:06:23.985236 24313 consensus_meta.cc:287] T 70797e5783b5454ab0d0eea663e791e3 P e5256d91808b47c195bc9b4dbd7f2b87: Time spent flushing consensus metadata: real 0.796s	user 0.012s	sys 0.000s
I20260709 13:06:24.000990 19481 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39478 (request call id 715) took 1009 ms. Trace:
I20260709 13:06:24.002327 20076 leader_election.cc:304] T 7be9efa6559648dbb5a0f7684c4542d1 P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 127766fc592545a4997f7790f50f6076, e5256d91808b47c195bc9b4dbd7f2b87; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168
W20260709 13:06:23.989002 24370 consensus_meta.cc:287] T 1f85fc4b527a48848e5faa083b604e36 P e5256d91808b47c195bc9b4dbd7f2b87: Time spent flushing consensus metadata: real 0.730s	user 0.010s	sys 0.003s
I20260709 13:06:24.005620 19481 rpcz_store.cc:276] 0709 13:06:22.991969 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:23.175925 (+183956us) service_pool.cc:224] Handling call
0709 13:06:23.176176 (+   251us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:23.192519 (+ 16343us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:06:23.257332 (+ 64813us) log.cc:844] Serialized 14 byte log entry
0709 13:06:23.311825 (+ 54493us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:23.316328 (+  4503us) log.cc:844] Serialized 26 byte log entry
0709 13:06:23.335049 (+ 18721us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:06:23.335296 (+   247us) log.cc:844] Serialized 14 byte log entry
0709 13:06:23.335479 (+   183us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:23.335554 (+    75us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:24.000738 (+665184us) raft_consensus.cc:1685] finished
0709 13:06:24.000765 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:24.000921 (+   156us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3654,"prepare.queue_time_us":66228,"prepare.run_cpu_time_us":94,"prepare.run_wall_time_us":5341,"raft.queue_time_us":8404,"raft.run_cpu_time_us":303,"raft.run_wall_time_us":3108,"thread_start_us":49163,"threads_started":1,"wal-append.queue_time_us":67049}
W20260709 13:06:23.988302 24379 log.cc:927] Time spent T 1a61655d99124a29b486ba4a5b37faea P 0473d2b2d01f4459b1e90fd12cc7840e: Append to log took a long time: real 0.232s	user 0.000s	sys 0.000s
I20260709 13:06:24.014281 19403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ece3db938bc649d4a40a51522ed5259c" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:06:23.980674 24372 raft_consensus.cc:493] T 179fd671030940b4b4a4e24bcc4aba0a P e5256d91808b47c195bc9b4dbd7f2b87 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 0473d2b2d01f4459b1e90fd12cc7840e)
I20260709 13:06:24.008404 20076 leader_election.cc:304] T 96efeaaf1057492490e9a621f37e1a2d P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 127766fc592545a4997f7790f50f6076, e61c3a8f61bb48f8a963c9480e53c168; no voters: 0473d2b2d01f4459b1e90fd12cc7840e
I20260709 13:06:24.010061 20103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96efeaaf1057492490e9a621f37e1a2d" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076"
W20260709 13:06:23.995810 24396 log.cc:927] Time spent T 3e1f505cb0f1427bbd698ac889d80821 P 0473d2b2d01f4459b1e90fd12cc7840e: Append to log took a long time: real 0.217s	user 0.001s	sys 0.000s
I20260709 13:06:24.011436 20106 raft_consensus.cc:1275] T ff9b0eddd810459b82d91c60777c10eb P 127766fc592545a4997f7790f50f6076 [term 14 FOLLOWER]: Refusing update from remote peer 0473d2b2d01f4459b1e90fd12cc7840e: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 13:06:23.946890 24153 raft_consensus.cc:515] T edd7d470b5014c9489be7f41f64355c9 P 0473d2b2d01f4459b1e90fd12cc7840e [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:24.015853 19405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21e14947d70440f19044d8f75c31e1f9" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:06:24.018603 20103 raft_consensus.cc:3060] T 96efeaaf1057492490e9a621f37e1a2d P 127766fc592545a4997f7790f50f6076 [term 13 FOLLOWER]: Advancing to term 15
W20260709 13:06:24.023859 19450 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.3:36891, user_credentials={real_user=slave}} blocked reactor thread for 138124us
I20260709 13:06:24.026652 19450 leader_election.cc:304] T ed7fdbcb96d14d418db9ca90a792588a P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e; no voters: 127766fc592545a4997f7790f50f6076, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:06:24.000639 24387 raft_consensus.cc:493] T 40e1e16737a842ee936002830f36882e P 0473d2b2d01f4459b1e90fd12cc7840e [term 15 FOLLOWER]: Starting pre-election (detected failure of leader e5256d91808b47c195bc9b4dbd7f2b87)
I20260709 13:06:24.029361 20105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9962423cb4e54fcfa5de01daf68a86e7" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:06:23.983846 24274 raft_consensus.cc:515] T 2e36a9d6e29c4a7c860cf267efbd4c74 P 0473d2b2d01f4459b1e90fd12cc7840e [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:24.013545 24313 raft_consensus.cc:515] T 70797e5783b5454ab0d0eea663e791e3 P e5256d91808b47c195bc9b4dbd7f2b87 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
W20260709 13:06:24.038895 24400 log.cc:927] Time spent T 6c5eebf646ad445a9d1b1adc319d7b16 P e61c3a8f61bb48f8a963c9480e53c168: Append to log took a long time: real 0.068s	user 0.001s	sys 0.000s
I20260709 13:06:24.039609 24153 leader_election.cc:290] T edd7d470b5014c9489be7f41f64355c9 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:06:24.041108 19405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab43d85f64114d4ebf618930e43d9ed0" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:06:24.014535 24399 raft_consensus.cc:493] T b08304a0a02b42d7840c4e8ee9a6bd1a P e61c3a8f61bb48f8a963c9480e53c168 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 0473d2b2d01f4459b1e90fd12cc7840e)
I20260709 13:06:24.044502 24338 leader_election.cc:290] T f93ee515a9c14139bf566522ed8232f3 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:06:24.016466 24370 raft_consensus.cc:515] T 1f85fc4b527a48848e5faa083b604e36 P e5256d91808b47c195bc9b4dbd7f2b87 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:23.995692 24391 consensus_queue.cc:1048] T 2a16f7501e2444fb86d4e2778e734e02 P 127766fc592545a4997f7790f50f6076 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.133s
W20260709 13:06:24.046831 24398 log.cc:927] Time spent T 179fd671030940b4b4a4e24bcc4aba0a P e61c3a8f61bb48f8a963c9480e53c168: Append to log took a long time: real 0.423s	user 0.006s	sys 0.007s
I20260709 13:06:24.048077 24322 leader_election.cc:290] T 1efebf73c86e432baa55533136b6e12c P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:06:24.009081 24267 raft_consensus.cc:2804] T 6c5eebf646ad445a9d1b1adc319d7b16 P 127766fc592545a4997f7790f50f6076 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:06:24.048637 24419 raft_consensus.cc:493] T 0cdf56e38bbc453d9438d359e5a69955 P e61c3a8f61bb48f8a963c9480e53c168 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 0473d2b2d01f4459b1e90fd12cc7840e)
I20260709 13:06:24.008992 24141 raft_consensus.cc:515] T 14efcc79969f41babe5529c22d59156d P 127766fc592545a4997f7790f50f6076 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:24.019335 19411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9f0d59553ad444883fcf5b5909f9798" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:06:24.052532 19403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f575b143b844aa096b50997dad3516a" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:06:23.985113 24362 raft_consensus.cc:515] T 0cdf56e38bbc453d9438d359e5a69955 P e5256d91808b47c195bc9b4dbd7f2b87 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:24.008738 24310 raft_consensus.cc:493] T 2b74109013a140ada21feeef92d6f563 P e61c3a8f61bb48f8a963c9480e53c168 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 0473d2b2d01f4459b1e90fd12cc7840e)
I20260709 13:06:24.020942 24372 raft_consensus.cc:3060] T 179fd671030940b4b4a4e24bcc4aba0a P e5256d91808b47c195bc9b4dbd7f2b87 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:06:23.997988 24275 raft_consensus.cc:515] T 76cb037fc9064d13b59a8969d897ce8c P 0473d2b2d01f4459b1e90fd12cc7840e [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:23.993399 24373 raft_consensus.cc:515] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P e5256d91808b47c195bc9b4dbd7f2b87 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:24.086161 24399 raft_consensus.cc:515] T b08304a0a02b42d7840c4e8ee9a6bd1a P e61c3a8f61bb48f8a963c9480e53c168 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:24.115234 24321 leader_election.cc:290] T ff75a1d4cb1f493db8f71ddc136ba9ab P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
W20260709 13:06:24.089840 19524 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:24.058738 24384 raft_consensus.cc:2749] T 7be9efa6559648dbb5a0f7684c4542d1 P 127766fc592545a4997f7790f50f6076 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:06:24.050815 24387 raft_consensus.cc:515] T 40e1e16737a842ee936002830f36882e P 0473d2b2d01f4459b1e90fd12cc7840e [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:24.101291 19405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dc5b3532fe54f74876d02beffa2c230" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
I20260709 13:06:24.107182 19403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e36a9d6e29c4a7c860cf267efbd4c74" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 12 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:06:24.099525 24322 raft_consensus.cc:493] T 309c3ca0ca4b4f3ba129752ea2cb293b P e61c3a8f61bb48f8a963c9480e53c168 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 127766fc592545a4997f7790f50f6076)
I20260709 13:06:24.109161 24362 leader_election.cc:290] T 0cdf56e38bbc453d9438d359e5a69955 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:06:24.101871 24414 raft_consensus.cc:493] T bc225c93219c45538b53a1bd3d387e4d P e61c3a8f61bb48f8a963c9480e53c168 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 0473d2b2d01f4459b1e90fd12cc7840e)
I20260709 13:06:24.088694 19406 raft_consensus.cc:1240] T 70797e5783b5454ab0d0eea663e791e3 P e5256d91808b47c195bc9b4dbd7f2b87 [term 13 FOLLOWER]: Rejecting Update request from peer 127766fc592545a4997f7790f50f6076 for earlier term 12. Current term is 13. Ops: []
I20260709 13:06:24.116242 20103 raft_consensus.cc:2468] T 96efeaaf1057492490e9a621f37e1a2d P 127766fc592545a4997f7790f50f6076 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 15.
I20260709 13:06:24.149979 19558 raft_consensus.cc:1275] T 2a16f7501e2444fb86d4e2778e734e02 P e61c3a8f61bb48f8a963c9480e53c168 [term 13 FOLLOWER]: Refusing update from remote peer 127766fc592545a4997f7790f50f6076: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:06:24.099488 19411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85c494af21f9457a85da47b9bc70c1fd" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:06:24.170770 19411 raft_consensus.cc:2368] T 85c494af21f9457a85da47b9bc70c1fd P e5256d91808b47c195bc9b4dbd7f2b87 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e61c3a8f61bb48f8a963c9480e53c168 for earlier term 11. Current term is 12.
I20260709 13:06:24.168347 19405 raft_consensus.cc:3060] T 1dc5b3532fe54f74876d02beffa2c230 P e5256d91808b47c195bc9b4dbd7f2b87 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:06:24.166342 24321 raft_consensus.cc:493] T ed7fdbcb96d14d418db9ca90a792588a P e61c3a8f61bb48f8a963c9480e53c168 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 127766fc592545a4997f7790f50f6076)
I20260709 13:06:24.171615 19411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edd7d470b5014c9489be7f41f64355c9" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 15 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:06:24.172842 19408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e1f505cb0f1427bbd698ac889d80821" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 15 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:06:24.173379 19408 raft_consensus.cc:2468] T 3e1f505cb0f1427bbd698ac889d80821 P e5256d91808b47c195bc9b4dbd7f2b87 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 14.
I20260709 13:06:24.173162 24321 raft_consensus.cc:515] T ed7fdbcb96d14d418db9ca90a792588a P e61c3a8f61bb48f8a963c9480e53c168 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:24.173730 19411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef32ce6fdd0e40d382c79974f30295c6" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:06:24.174166 19408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86a6797bdfe94fa496c050ceae4bd0d9" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:06:24.174758 19411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e381f1d6b8184797ad142de49be225a8" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:06:24.175324 19411 raft_consensus.cc:2468] T e381f1d6b8184797ad142de49be225a8 P e5256d91808b47c195bc9b4dbd7f2b87 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 10.
I20260709 13:06:24.175689 24321 leader_election.cc:290] T ed7fdbcb96d14d418db9ca90a792588a P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:06:24.176074 19411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1b10566f45d4a7d9029858330e02d5b" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:06:24.137501 24373 leader_election.cc:290] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 15 election: Requested vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:06:24.137323 24399 leader_election.cc:290] T b08304a0a02b42d7840c4e8ee9a6bd1a P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
W20260709 13:06:24.176582 19526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.2:46257, user_credentials={real_user=slave}} blocked reactor thread for 88484.3us
I20260709 13:06:24.182806 24280 raft_consensus.cc:2764] T 96efeaaf1057492490e9a621f37e1a2d P 127766fc592545a4997f7790f50f6076 [term 15 FOLLOWER]: Leader pre-election decision vote started in defunct term 13: won
I20260709 13:06:24.189299 19408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7be9efa6559648dbb5a0f7684c4542d1" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:06:24.064611 24306 consensus_queue.cc:260] T d1e5873a19244c5ebbcd38e126796ee7 P e61c3a8f61bb48f8a963c9480e53c168 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 14.8, Last appended by leader: 8, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
W20260709 13:06:24.187372 19449 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.1:40321, user_credentials={real_user=slave}} blocked reactor thread for 163041us
I20260709 13:06:24.188175 19411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40e1e16737a842ee936002830f36882e" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:06:24.187980 19558 raft_consensus.cc:1275] T 85c494af21f9457a85da47b9bc70c1fd P e61c3a8f61bb48f8a963c9480e53c168 [term 12 FOLLOWER]: Refusing update from remote peer 127766fc592545a4997f7790f50f6076: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
W20260709 13:06:24.192359 19524 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:24.192966 19524 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:24.193439 19524 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:24.213600 19410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "833a2f0775ed407a94b8924ce50adb63" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:06:24.215441 19411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76cb037fc9064d13b59a8969d897ce8c" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:06:24.092865 24267 raft_consensus.cc:493] T 6c5eebf646ad445a9d1b1adc319d7b16 P 127766fc592545a4997f7790f50f6076 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 0473d2b2d01f4459b1e90fd12cc7840e)
I20260709 13:06:24.090997 24338 raft_consensus.cc:493] T 62c6c134d3d24a1ab144dd9ee6bc3f64 P e61c3a8f61bb48f8a963c9480e53c168 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 127766fc592545a4997f7790f50f6076)
I20260709 13:06:24.137977 24183 raft_consensus.cc:2749] T ed7fdbcb96d14d418db9ca90a792588a P 0473d2b2d01f4459b1e90fd12cc7840e [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 13:06:24.187510 24395 log.cc:927] Time spent T 1efebf73c86e432baa55533136b6e12c P 0473d2b2d01f4459b1e90fd12cc7840e: Append to log took a long time: real 0.278s	user 0.000s	sys 0.001s
I20260709 13:06:24.241516 19408 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "46c5bfeecc314717bffe987e6844b6d0"
dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
mode: GRACEFUL
new_leader_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
 from {username='slave'} at 127.0.0.1:37312
I20260709 13:06:24.102454 24315 leader_election.cc:290] T 14935b3ddf914369822e4a0547aaa355 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:06:24.231535 19403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "217b5fae677b4971b3bbd2f357a1f7ff" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:06:24.243084 19408 raft_consensus.cc:606] T 46c5bfeecc314717bffe987e6844b6d0 P e5256d91808b47c195bc9b4dbd7f2b87 [term 18 LEADER]: Received request to transfer leadership to TS 0473d2b2d01f4459b1e90fd12cc7840e
I20260709 13:06:24.218291 19410 raft_consensus.cc:2368] T 833a2f0775ed407a94b8924ce50adb63 P e5256d91808b47c195bc9b4dbd7f2b87 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e61c3a8f61bb48f8a963c9480e53c168 for earlier term 12. Current term is 13.
I20260709 13:06:24.243257 19403 raft_consensus.cc:2468] T 217b5fae677b4971b3bbd2f357a1f7ff P e5256d91808b47c195bc9b4dbd7f2b87 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 10.
W20260709 13:06:24.242167 19450 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.3:36891, user_credentials={real_user=slave}} blocked reactor thread for 215558us
I20260709 13:06:24.245087 19403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2725d2c4cb054f18b0fc8f735c15f6c2" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 16 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
I20260709 13:06:24.115669 24310 raft_consensus.cc:515] T 2b74109013a140ada21feeef92d6f563 P e61c3a8f61bb48f8a963c9480e53c168 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:24.244400 19450 leader_election.cc:304] T fa8650e71aa14778b3d73721fc50d9fc P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:06:24.255898 19403 raft_consensus.cc:2393] T 2725d2c4cb054f18b0fc8f735c15f6c2 P e5256d91808b47c195bc9b4dbd7f2b87 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 0473d2b2d01f4459b1e90fd12cc7840e in current term 16: Already voted for candidate e5256d91808b47c195bc9b4dbd7f2b87 in this term.
W20260709 13:06:24.255707 19526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.2:46257, user_credentials={real_user=slave}} blocked reactor thread for 69600.5us
I20260709 13:06:24.246898 19410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "172b3dd13109415a955b71ac0e9d2234" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:06:24.247020 19411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "179fd671030940b4b4a4e24bcc4aba0a" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:06:24.265574 19405 raft_consensus.cc:2468] T 1dc5b3532fe54f74876d02beffa2c230 P e5256d91808b47c195bc9b4dbd7f2b87 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 14.
I20260709 13:06:24.266878 19405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa731b585f684a7fb2d106c50f143b83" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:06:24.267926 19560 raft_consensus.cc:1275] T 833a2f0775ed407a94b8924ce50adb63 P e61c3a8f61bb48f8a963c9480e53c168 [term 13 FOLLOWER]: Refusing update from remote peer 127766fc592545a4997f7790f50f6076: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:06:24.272264 19486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f93ee515a9c14139bf566522ed8232f3" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 16 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:06:24.273414 19477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4509b76741dc428e9201c70c1658da13" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:06:24.273983 19477 raft_consensus.cc:2468] T 4509b76741dc428e9201c70c1658da13 P 0473d2b2d01f4459b1e90fd12cc7840e [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 8.
I20260709 13:06:24.271796 19482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed7fdbcb96d14d418db9ca90a792588a" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:06:24.274209 19481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14935b3ddf914369822e4a0547aaa355" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:06:24.225636 24267 raft_consensus.cc:3060] T 6c5eebf646ad445a9d1b1adc319d7b16 P 127766fc592545a4997f7790f50f6076 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:06:24.270753 19484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1efebf73c86e432baa55533136b6e12c" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:06:24.275061 19410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22196caba61445d3bec98a0aab3c337d" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:06:24.280520 24426 raft_consensus.cc:2804] T fa8650e71aa14778b3d73721fc50d9fc P 0473d2b2d01f4459b1e90fd12cc7840e [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:06:24.280565 19483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0afb57ae58a24a01850491d69f0213dd" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:06:24.245822 24380 leader_election.cc:290] T 4509b76741dc428e9201c70c1658da13 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:06:24.218128 24394 raft_consensus.cc:2804] T 21e14947d70440f19044d8f75c31e1f9 P e5256d91808b47c195bc9b4dbd7f2b87 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:06:24.105020 24419 raft_consensus.cc:515] T 0cdf56e38bbc453d9438d359e5a69955 P e61c3a8f61bb48f8a963c9480e53c168 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
W20260709 13:06:24.275703 20077 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.535s	user 0.027s	sys 0.027s
I20260709 13:06:24.283766 19408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edd7d470b5014c9489be7f41f64355c9" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:06:24.262331 24306 raft_consensus.cc:3060] T d1e5873a19244c5ebbcd38e126796ee7 P e61c3a8f61bb48f8a963c9480e53c168 [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:06:24.288460 20077 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.548s	user 0.027s	sys 0.027s
I20260709 13:06:24.288532 19479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff75a1d4cb1f493db8f71ddc136ba9ab" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:06:24.288229 19485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b08304a0a02b42d7840c4e8ee9a6bd1a" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:06:24.293390 19479 raft_consensus.cc:2468] T ff75a1d4cb1f493db8f71ddc136ba9ab P 0473d2b2d01f4459b1e90fd12cc7840e [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 13.
I20260709 13:06:24.291129 19410 raft_consensus.cc:1275] T ff9b0eddd810459b82d91c60777c10eb P e5256d91808b47c195bc9b4dbd7f2b87 [term 14 FOLLOWER]: Refusing update from remote peer 0473d2b2d01f4459b1e90fd12cc7840e: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 13:06:24.216073 24322 raft_consensus.cc:515] T 309c3ca0ca4b4f3ba129752ea2cb293b P e61c3a8f61bb48f8a963c9480e53c168 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } attrs { replace: true } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:24.292532 19403 raft_consensus.cc:1275] T 833a2f0775ed407a94b8924ce50adb63 P e5256d91808b47c195bc9b4dbd7f2b87 [term 13 FOLLOWER]: Refusing update from remote peer 127766fc592545a4997f7790f50f6076: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:06:24.293807 24426 raft_consensus.cc:697] T fa8650e71aa14778b3d73721fc50d9fc P 0473d2b2d01f4459b1e90fd12cc7840e [term 13 LEADER]: Becoming Leader. State: Replica: 0473d2b2d01f4459b1e90fd12cc7840e, State: Running, Role: LEADER
I20260709 13:06:24.295555 20103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4af19371ea874c09a0a2147040835cbb" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:06:24.300448 19557 raft_consensus.cc:2410] T 1dc5b3532fe54f74876d02beffa2c230 P e61c3a8f61bb48f8a963c9480e53c168 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 0473d2b2d01f4459b1e90fd12cc7840e for term 14 because replica has last-logged OpId of term: 13 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 6.
I20260709 13:06:24.295948 19408 raft_consensus.cc:1275] T 85c494af21f9457a85da47b9bc70c1fd P e5256d91808b47c195bc9b4dbd7f2b87 [term 12 FOLLOWER]: Refusing update from remote peer 127766fc592545a4997f7790f50f6076: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 13:06:24.310266 19410 raft_consensus.cc:1275] T df751f992649444090e27965eb1af85d P e5256d91808b47c195bc9b4dbd7f2b87 [term 16 FOLLOWER]: Refusing update from remote peer e61c3a8f61bb48f8a963c9480e53c168: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 13:06:24.310510 20103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36f6ba92b9ba46babe4ebd6c02e5fbd9" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076"
I20260709 13:06:24.313400 19405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4af19371ea874c09a0a2147040835cbb" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:06:24.315361 24413 consensus_queue.cc:1048] T 833a2f0775ed407a94b8924ce50adb63 P 127766fc592545a4997f7790f50f6076 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:06:24.317780 19403 raft_consensus.cc:1240] T 1f85fc4b527a48848e5faa083b604e36 P e5256d91808b47c195bc9b4dbd7f2b87 [term 12 FOLLOWER]: Rejecting Update request from peer 127766fc592545a4997f7790f50f6076 for earlier term 11. Current term is 12. Ops: []
W20260709 13:06:24.318497 19450 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.3:36891, user_credentials={real_user=slave}} blocked reactor thread for 53405.7us
I20260709 13:06:24.318724 20103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f85fc4b527a48848e5faa083b604e36" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076"
I20260709 13:06:24.320706 20103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4af19371ea874c09a0a2147040835cbb" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:06:24.320925 20106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1efebf73c86e432baa55533136b6e12c" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:06:24.323467 19410 raft_consensus.cc:1240] T d1e5873a19244c5ebbcd38e126796ee7 P e5256d91808b47c195bc9b4dbd7f2b87 [term 15 FOLLOWER]: Rejecting Update request from peer e61c3a8f61bb48f8a963c9480e53c168 for earlier term 14. Current term is 15. Ops: [14.8-14.8]
I20260709 13:06:24.188517 24414 raft_consensus.cc:515] T bc225c93219c45538b53a1bd3d387e4d P e61c3a8f61bb48f8a963c9480e53c168 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:24.289193 24370 leader_election.cc:290] T 1f85fc4b527a48848e5faa083b604e36 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 12 election: Requested vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:06:24.240731 24338 raft_consensus.cc:515] T 62c6c134d3d24a1ab144dd9ee6bc3f64 P e61c3a8f61bb48f8a963c9480e53c168 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:24.333745 19405 raft_consensus.cc:1240] T 2725d2c4cb054f18b0fc8f735c15f6c2 P e5256d91808b47c195bc9b4dbd7f2b87 [term 16 FOLLOWER]: Rejecting Update request from peer e61c3a8f61bb48f8a963c9480e53c168 for earlier term 15. Current term is 16. Ops: [15.8-15.8]
I20260709 13:06:24.329698 19410 raft_consensus.cc:1240] T 1dc5b3532fe54f74876d02beffa2c230 P e5256d91808b47c195bc9b4dbd7f2b87 [term 14 FOLLOWER]: Rejecting Update request from peer e61c3a8f61bb48f8a963c9480e53c168 for earlier term 13. Current term is 14. Ops: [13.7-13.7]
I20260709 13:06:24.332506 19408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14935b3ddf914369822e4a0547aaa355" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:06:24.299373 24275 leader_election.cc:290] T 76cb037fc9064d13b59a8969d897ce8c P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:06:24.300431 24394 raft_consensus.cc:493] T 21e14947d70440f19044d8f75c31e1f9 P e5256d91808b47c195bc9b4dbd7f2b87 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 0473d2b2d01f4459b1e90fd12cc7840e)
I20260709 13:06:24.345322 19403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46c5bfeecc314717bffe987e6844b6d0" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 19 candidate_status { last_received { term: 18 index: 8 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:06:24.316812 24322 leader_election.cc:290] T 309c3ca0ca4b4f3ba129752ea2cb293b P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:06:24.347366 19410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f93ee515a9c14139bf566522ed8232f3" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 16 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:06:24.352289 19405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14efcc79969f41babe5529c22d59156d" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
I20260709 13:06:24.353863 19403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70797e5783b5454ab0d0eea663e791e3" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:06:24.298955 24419 leader_election.cc:290] T 0cdf56e38bbc453d9438d359e5a69955 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:06:24.359458 24422 raft_consensus.cc:493] T 7f575b143b844aa096b50997dad3516a P 0473d2b2d01f4459b1e90fd12cc7840e [term 10 FOLLOWER]: Starting pre-election (detected failure of leader e5256d91808b47c195bc9b4dbd7f2b87)
I20260709 13:06:24.361545 19410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21e14947d70440f19044d8f75c31e1f9" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
W20260709 13:06:24.364329 24425 log.cc:927] Time spent T 48824d5acfbc485ebf8c2d944e7202de P 127766fc592545a4997f7790f50f6076: Append to log took a long time: real 0.078s	user 0.000s	sys 0.000s
I20260709 13:06:24.364023 24374 raft_consensus.cc:515] T 22196caba61445d3bec98a0aab3c337d P e5256d91808b47c195bc9b4dbd7f2b87 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:24.396073 19407 raft_consensus.cc:2393] T 22196caba61445d3bec98a0aab3c337d P e5256d91808b47c195bc9b4dbd7f2b87 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0473d2b2d01f4459b1e90fd12cc7840e in current term 12: Already voted for candidate e5256d91808b47c195bc9b4dbd7f2b87 in this term.
I20260709 13:06:24.366413 24414 leader_election.cc:290] T bc225c93219c45538b53a1bd3d387e4d P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:06:24.293993 24409 consensus_queue.cc:1048] T a08760e15aac4630a629431f56024dc8 P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.075s
I20260709 13:06:24.367182 24141 leader_election.cc:290] T 14efcc79969f41babe5529c22d59156d P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 15 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:06:24.353037 24394 raft_consensus.cc:3060] T 21e14947d70440f19044d8f75c31e1f9 P e5256d91808b47c195bc9b4dbd7f2b87 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:06:24.337895 24421 raft_consensus.cc:493] T 1f85fc4b527a48848e5faa083b604e36 P 0473d2b2d01f4459b1e90fd12cc7840e [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 127766fc592545a4997f7790f50f6076)
I20260709 13:06:24.369055 19405 raft_consensus.cc:1275] T 3e1f505cb0f1427bbd698ac889d80821 P e5256d91808b47c195bc9b4dbd7f2b87 [term 14 FOLLOWER]: Refusing update from remote peer e61c3a8f61bb48f8a963c9480e53c168: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 13:06:24.381494 24227 leader_election.cc:290] T 1a61655d99124a29b486ba4a5b37faea P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:06:24.297252 24426 consensus_queue.cc:237] T fa8650e71aa14778b3d73721fc50d9fc P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:24.384245 19553 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40428 (request call id 2687) took 1021 ms. Trace:
I20260709 13:06:24.393198 24422 raft_consensus.cc:515] T 7f575b143b844aa096b50997dad3516a P 0473d2b2d01f4459b1e90fd12cc7840e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:24.418112 24422 leader_election.cc:290] T 7f575b143b844aa096b50997dad3516a P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
W20260709 13:06:24.401582 24377 log.cc:927] Time spent T 0e1085d23e8347fbbd5bce7542f4b1f4 P 0473d2b2d01f4459b1e90fd12cc7840e: Append to log took a long time: real 1.170s	user 0.006s	sys 0.007s
I20260709 13:06:24.394299 24338 leader_election.cc:290] T 62c6c134d3d24a1ab144dd9ee6bc3f64 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:06:24.398013 19558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86a6797bdfe94fa496c050ceae4bd0d9" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:06:24.425449 24310 leader_election.cc:290] T 2b74109013a140ada21feeef92d6f563 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:06:24.426232 19558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc225c93219c45538b53a1bd3d387e4d" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:06:24.427326 19558 raft_consensus.cc:2468] T bc225c93219c45538b53a1bd3d387e4d P e61c3a8f61bb48f8a963c9480e53c168 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 11.
I20260709 13:06:24.428747 19558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b08304a0a02b42d7840c4e8ee9a6bd1a" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:06:24.439110 24387 leader_election.cc:290] T 40e1e16737a842ee936002830f36882e P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:06:24.430333 19558 raft_consensus.cc:2468] T b08304a0a02b42d7840c4e8ee9a6bd1a P e61c3a8f61bb48f8a963c9480e53c168 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 12.
I20260709 13:06:24.398597 19409 raft_consensus.cc:1275] T a08760e15aac4630a629431f56024dc8 P e5256d91808b47c195bc9b4dbd7f2b87 [term 16 FOLLOWER]: Refusing update from remote peer e61c3a8f61bb48f8a963c9480e53c168: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
I20260709 13:06:24.400403 19410 raft_consensus.cc:1240] T ff75a1d4cb1f493db8f71ddc136ba9ab P e5256d91808b47c195bc9b4dbd7f2b87 [term 13 LEADER]: Rejecting Update request from peer e61c3a8f61bb48f8a963c9480e53c168 for earlier term 12. Current term is 13. Ops: [12.7-12.7]
I20260709 13:06:24.376994 24238 raft_consensus.cc:515] T 22196caba61445d3bec98a0aab3c337d P e61c3a8f61bb48f8a963c9480e53c168 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:24.408835 24421 raft_consensus.cc:515] T 1f85fc4b527a48848e5faa083b604e36 P 0473d2b2d01f4459b1e90fd12cc7840e [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:24.485211 19558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "833a2f0775ed407a94b8924ce50adb63" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:06:24.416005 19553 rpcz_store.cc:276] 0709 13:06:23.362926 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:23.364375 (+  1449us) service_pool.cc:224] Handling call
0709 13:06:23.364636 (+   261us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:23.914259 (+549623us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:06:23.941037 (+ 26778us) log.cc:844] Serialized 14 byte log entry
0709 13:06:24.177146 (+236109us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:24.177202 (+    56us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:06:24.177253 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:24.384023 (+206770us) spinlock_profiling.cc:243] Waited 549 ms on lock 0x7b540030acd4. stack: 00007f4a79de9343 00007f4a79de9240 00007f4a797781d4 00007f4a834b6304 00007f4a834b6299 00007f4a7ce71571 00007f4a7cf08e01 00007f4a7cf0783e 00007f4a81ecc419 00007f4a7b443bd4 00007f4a7b443b62 00007f4a7b443a91 00007f4a7b443a0c 00007f4a7b442cc2 00007f4a7b24348c 00007f4a7b2428c6
0709 13:06:24.384069 (+    46us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:24.384193 (+   124us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":40040,"prepare.queue_time_us":15715,"prepare.run_cpu_time_us":56,"prepare.run_wall_time_us":6520,"raft.queue_time_us":162106,"raft.run_cpu_time_us":198,"raft.run_wall_time_us":20603,"spinlock_wait_cycles":1302739840,"thread_start_us":214623,"threads_started":2,"wal-append.queue_time_us":198490}
I20260709 13:06:24.488251 19553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "217b5fae677b4971b3bbd2f357a1f7ff" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:06:24.489466 19553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edd7d470b5014c9489be7f41f64355c9" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:06:24.490021 19553 raft_consensus.cc:2468] T edd7d470b5014c9489be7f41f64355c9 P e61c3a8f61bb48f8a963c9480e53c168 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 14.
I20260709 13:06:24.483143 19409 raft_consensus.cc:1240] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P e5256d91808b47c195bc9b4dbd7f2b87 [term 15 FOLLOWER]: Rejecting Update request from peer 127766fc592545a4997f7790f50f6076 for earlier term 14. Current term is 15. Ops: []
I20260709 13:06:24.411087 24374 leader_election.cc:290] T 22196caba61445d3bec98a0aab3c337d P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 12 election: Requested vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:06:24.491331 19558 raft_consensus.cc:2393] T 833a2f0775ed407a94b8924ce50adb63 P e61c3a8f61bb48f8a963c9480e53c168 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e5256d91808b47c195bc9b4dbd7f2b87 in current term 13: Already voted for candidate 127766fc592545a4997f7790f50f6076 in this term.
I20260709 13:06:24.485996 24409 raft_consensus.cc:493] T 1dc5b3532fe54f74876d02beffa2c230 P e61c3a8f61bb48f8a963c9480e53c168 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:24.495136 24409 raft_consensus.cc:515] T 1dc5b3532fe54f74876d02beffa2c230 P e61c3a8f61bb48f8a963c9480e53c168 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:24.497414 24409 leader_election.cc:290] T 1dc5b3532fe54f74876d02beffa2c230 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:06:24.500649 19553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e381f1d6b8184797ad142de49be225a8" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:06:24.501381 19553 raft_consensus.cc:2468] T e381f1d6b8184797ad142de49be225a8 P e61c3a8f61bb48f8a963c9480e53c168 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 10.
I20260709 13:06:24.502367 19553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76cb037fc9064d13b59a8969d897ce8c" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:06:24.503155 19553 raft_consensus.cc:2468] T 76cb037fc9064d13b59a8969d897ce8c P e61c3a8f61bb48f8a963c9480e53c168 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 11.
I20260709 13:06:24.504532 19553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef32ce6fdd0e40d382c79974f30295c6" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:06:24.505175 19553 raft_consensus.cc:2468] T ef32ce6fdd0e40d382c79974f30295c6 P e61c3a8f61bb48f8a963c9480e53c168 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 15.
I20260709 13:06:24.506090 19553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab43d85f64114d4ebf618930e43d9ed0" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:06:24.508186 19551 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40428 (request call id 2702) took 1136 ms. Trace:
I20260709 13:06:24.512709 19557 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40428 (request call id 2694) took 1144 ms. Trace:
I20260709 13:06:24.499511 19558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28af091831594f9d8e96482078cc7625" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:06:24.515875 19558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22196caba61445d3bec98a0aab3c337d" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:06:24.523840 19558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e1f505cb0f1427bbd698ac889d80821" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 15 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:06:24.508736 19551 rpcz_store.cc:276] 0709 13:06:23.371289 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:24.012793 (+641504us) service_pool.cc:224] Handling call
0709 13:06:24.033708 (+ 20915us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:24.285972 (+252264us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:24.286018 (+    46us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:24.286073 (+    55us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:06:24.286120 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:24.507879 (+221759us) spinlock_profiling.cc:243] Waited 252 ms on lock 0x7b540014a854. stack: 00007f4a79de9343 00007f4a79de9240 00007f4a797781d4 00007f4a834b6304 00007f4a834b6299 00007f4a7ce71571 00007f4a7cf08e01 00007f4a7cf0783e 00007f4a81ecc419 00007f4a7b443bd4 00007f4a7b443b62 00007f4a7b443a91 00007f4a7b443a0c 00007f4a7b442cc2 00007f4a7b24348c 00007f4a7b2428c6
0709 13:06:24.507945 (+    66us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:24.508110 (+   165us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":579531648}
I20260709 13:06:24.513249 19557 rpcz_store.cc:276] 0709 13:06:23.368488 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:23.368591 (+   103us) service_pool.cc:224] Handling call
0709 13:06:24.512455 (+1143864us) spinlock_profiling.cc:243] Waited 931 ms on lock 0x7b5400342954. stack: 00007f4a79de9343 00007f4a79de9240 00007f4a797781d4 00007f4a834b6304 00007f4a834b6299 00007f4a7ce71571 00007f4a7cf0c2fa 00007f4a81ecdb17 00007f4a7b4486d4 00007f4a7b448662 00007f4a7b448591 00007f4a7b44850c 00007f4a7b4477c2 00007f4a7b24348c 00007f4a7b2428c6 00007f4a7b24226f
0709 13:06:24.512634 (+   179us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2140726016}
I20260709 13:06:24.527083 19555 raft_consensus.cc:2393] T 22196caba61445d3bec98a0aab3c337d P e61c3a8f61bb48f8a963c9480e53c168 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0473d2b2d01f4459b1e90fd12cc7840e in current term 12: Already voted for candidate e61c3a8f61bb48f8a963c9480e53c168 in this term.
I20260709 13:06:24.528013 19560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4af19371ea874c09a0a2147040835cbb" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:06:24.507781 24387 raft_consensus.cc:493] T df751f992649444090e27965eb1af85d P 0473d2b2d01f4459b1e90fd12cc7840e [term 16 FOLLOWER]: Starting pre-election (detected failure of leader e61c3a8f61bb48f8a963c9480e53c168)
I20260709 13:06:24.486558 24372 raft_consensus.cc:515] T 179fd671030940b4b4a4e24bcc4aba0a P e5256d91808b47c195bc9b4dbd7f2b87 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:24.566015 19551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cdf56e38bbc453d9438d359e5a69955" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:06:24.573925 19411 raft_consensus.cc:2393] T 179fd671030940b4b4a4e24bcc4aba0a P e5256d91808b47c195bc9b4dbd7f2b87 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e61c3a8f61bb48f8a963c9480e53c168 in current term 15: Already voted for candidate e5256d91808b47c195bc9b4dbd7f2b87 in this term.
I20260709 13:06:24.547114 24411 raft_consensus.cc:493] T ff9b0eddd810459b82d91c60777c10eb P e5256d91808b47c195bc9b4dbd7f2b87 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:24.566556 24318 leader_election.cc:290] T 0afb57ae58a24a01850491d69f0213dd P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:06:24.565191 24387 raft_consensus.cc:515] T df751f992649444090e27965eb1af85d P 0473d2b2d01f4459b1e90fd12cc7840e [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:24.600095 19560 raft_consensus.cc:1275] T ff75a1d4cb1f493db8f71ddc136ba9ab P e61c3a8f61bb48f8a963c9480e53c168 [term 13 FOLLOWER]: Refusing update from remote peer e5256d91808b47c195bc9b4dbd7f2b87: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 13 index: 7. (term mismatch)
I20260709 13:06:24.604573 19560 pending_rounds.cc:85] T ff75a1d4cb1f493db8f71ddc136ba9ab P e61c3a8f61bb48f8a963c9480e53c168: Aborting all ops after (but not including) 6
I20260709 13:06:24.604902 19560 pending_rounds.cc:107] T ff75a1d4cb1f493db8f71ddc136ba9ab P e61c3a8f61bb48f8a963c9480e53c168: Aborting uncommitted NO_OP operation due to leader change: 12.7
I20260709 13:06:24.605201 19560 raft_consensus.cc:2889] T ff75a1d4cb1f493db8f71ddc136ba9ab P e61c3a8f61bb48f8a963c9480e53c168 [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:06:24.602967 24415 log.cc:927] Time spent T ef32ce6fdd0e40d382c79974f30295c6 P e5256d91808b47c195bc9b4dbd7f2b87: Append to log took a long time: real 0.257s	user 0.000s	sys 0.002s
I20260709 13:06:24.619792 19404 raft_consensus.cc:1240] T 22196caba61445d3bec98a0aab3c337d P e5256d91808b47c195bc9b4dbd7f2b87 [term 12 FOLLOWER]: Rejecting Update request from peer e61c3a8f61bb48f8a963c9480e53c168 for earlier term 10. Current term is 12. Ops: []
I20260709 13:06:24.583189 24411 raft_consensus.cc:515] T ff9b0eddd810459b82d91c60777c10eb P e5256d91808b47c195bc9b4dbd7f2b87 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:24.623806 19551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70797e5783b5454ab0d0eea663e791e3" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:06:24.633647 24387 leader_election.cc:290] T df751f992649444090e27965eb1af85d P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:06:24.642234 24413 consensus_queue.cc:1048] T 85c494af21f9457a85da47b9bc70c1fd P 127766fc592545a4997f7790f50f6076 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:06:24.643059 24238 leader_election.cc:290] T 22196caba61445d3bec98a0aab3c337d P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 12 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
W20260709 13:06:24.632268 24253 consensus_meta.cc:287] T 65d8cb8d6ec64f459d5a47cefab10acf P 127766fc592545a4997f7790f50f6076: Time spent flushing consensus metadata: real 0.910s	user 0.009s	sys 0.004s
I20260709 13:06:24.664916 24372 leader_election.cc:290] T 179fd671030940b4b4a4e24bcc4aba0a P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 15 election: Requested vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:06:24.661499 24421 leader_election.cc:290] T 1f85fc4b527a48848e5faa083b604e36 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:06:24.659586 24238 raft_consensus.cc:493] T 2725d2c4cb054f18b0fc8f735c15f6c2 P e61c3a8f61bb48f8a963c9480e53c168 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:24.666806 24238 raft_consensus.cc:515] T 2725d2c4cb054f18b0fc8f735c15f6c2 P e61c3a8f61bb48f8a963c9480e53c168 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:24.668917 24238 leader_election.cc:290] T 2725d2c4cb054f18b0fc8f735c15f6c2 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:06:24.669406 19559 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40428 (request call id 2698) took 1299 ms. Trace:
I20260709 13:06:24.669798 19559 rpcz_store.cc:276] 0709 13:06:23.370358 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:23.924960 (+554602us) service_pool.cc:224] Handling call
0709 13:06:23.955441 (+ 30481us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:23.963964 (+  8523us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:23.964013 (+    49us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:23.964076 (+    63us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:06:23.964133 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:24.669169 (+705036us) spinlock_profiling.cc:243] Waited 8.23 ms on lock 0x7b5400124654. stack: 00007f4a79de9343 00007f4a79de9240 00007f4a797781d4 00007f4a834b6304 00007f4a834b6299 00007f4a7ce71571 00007f4a7cf08e01 00007f4a7cf0783e 00007f4a81ecc419 00007f4a7b443bd4 00007f4a7b443b62 00007f4a7b443a91 00007f4a7b443a0c 00007f4a7b442cc2 00007f4a7b24348c 00007f4a7b2428c6
0709 13:06:24.669218 (+    49us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:24.669342 (+   124us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":18925952}
I20260709 13:06:24.657447 24394 raft_consensus.cc:515] T 21e14947d70440f19044d8f75c31e1f9 P e5256d91808b47c195bc9b4dbd7f2b87 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
W20260709 13:06:24.647413 24388 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.898s	user 0.038s	sys 0.056s
W20260709 13:06:24.671388 24388 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.922s	user 0.038s	sys 0.057s
W20260709 13:06:24.668859 19556 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40428 (request call id 2696) took 1299 ms (client timeout 1646 ms). Trace:
W20260709 13:06:24.678794 19556 rpcz_store.cc:269] 0709 13:06:23.369882 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:23.411911 (+ 42029us) service_pool.cc:224] Handling call
0709 13:06:24.668679 (+1256768us) spinlock_profiling.cc:243] Waited 218 ms on lock 0x7b5400125f54. stack: 00007f4a79de9343 00007f4a79de9240 00007f4a797781d4 00007f4a834b6304 00007f4a834b6299 00007f4a7ce71571 00007f4a7cf0c2fa 00007f4a81ecdb17 00007f4a7b4486d4 00007f4a7b448662 00007f4a7b448591 00007f4a7b44850c 00007f4a7b4477c2 00007f4a7b24348c 00007f4a7b2428c6 00007f4a7b24226f
0709 13:06:24.668800 (+   121us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":501512064}
I20260709 13:06:24.679514 24274 leader_election.cc:290] T 2e36a9d6e29c4a7c860cf267efbd4c74 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:06:24.680135 24274 raft_consensus.cc:493] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P 0473d2b2d01f4459b1e90fd12cc7840e [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 127766fc592545a4997f7790f50f6076)
I20260709 13:06:24.680611 24274 raft_consensus.cc:515] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P 0473d2b2d01f4459b1e90fd12cc7840e [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:24.685519 20106 raft_consensus.cc:1240] T 14efcc79969f41babe5529c22d59156d P 127766fc592545a4997f7790f50f6076 [term 15 FOLLOWER]: Rejecting Update request from peer e5256d91808b47c195bc9b4dbd7f2b87 for earlier term 14. Current term is 15. Ops: []
I20260709 13:06:24.640496 24313 leader_election.cc:290] T 70797e5783b5454ab0d0eea663e791e3 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 13 election: Requested vote from peers e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:06:24.687202 24313 consensus_queue.cc:1059] T 14efcc79969f41babe5529c22d59156d P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:06:24.687922 20105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70797e5783b5454ab0d0eea663e791e3" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076"
I20260709 13:06:24.688699 24393 raft_consensus.cc:3055] T 14efcc79969f41babe5529c22d59156d P e5256d91808b47c195bc9b4dbd7f2b87 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:06:24.689054 24393 raft_consensus.cc:740] T 14efcc79969f41babe5529c22d59156d P e5256d91808b47c195bc9b4dbd7f2b87 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: e5256d91808b47c195bc9b4dbd7f2b87, State: Running, Role: LEADER
I20260709 13:06:24.689046 24267 raft_consensus.cc:515] T 6c5eebf646ad445a9d1b1adc319d7b16 P 127766fc592545a4997f7790f50f6076 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:24.690191 24393 consensus_queue.cc:260] T 14efcc79969f41babe5529c22d59156d P e5256d91808b47c195bc9b4dbd7f2b87 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.11, Last appended by leader: 11, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:24.692466 24267 leader_election.cc:290] T 6c5eebf646ad445a9d1b1adc319d7b16 P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 13 election: Requested vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:06:24.691442 24393 raft_consensus.cc:3060] T 14efcc79969f41babe5529c22d59156d P e5256d91808b47c195bc9b4dbd7f2b87 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:06:24.698618 24394 leader_election.cc:290] T 21e14947d70440f19044d8f75c31e1f9 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 14 election: Requested vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:06:24.694619 19406 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49050 (request call id 842) took 1502 ms. Trace:
I20260709 13:06:24.659246 24253 raft_consensus.cc:515] T 65d8cb8d6ec64f459d5a47cefab10acf P 127766fc592545a4997f7790f50f6076 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:24.703949 20103 raft_consensus.cc:1240] T 65d8cb8d6ec64f459d5a47cefab10acf P 127766fc592545a4997f7790f50f6076 [term 14 FOLLOWER]: Rejecting Update request from peer e5256d91808b47c195bc9b4dbd7f2b87 for earlier term 13. Current term is 14. Ops: []
I20260709 13:06:24.696592 19551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22196caba61445d3bec98a0aab3c337d" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:06:24.706290 24276 raft_consensus.cc:493] T 1efebf73c86e432baa55533136b6e12c P 0473d2b2d01f4459b1e90fd12cc7840e [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 127766fc592545a4997f7790f50f6076)
I20260709 13:06:24.649070 24413 consensus_queue.cc:1059] T 1f85fc4b527a48848e5faa083b604e36 P 127766fc592545a4997f7790f50f6076 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.047s
I20260709 13:06:24.702821 19406 rpcz_store.cc:276] 0709 13:06:23.192531 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:23.193205 (+   674us) service_pool.cc:224] Handling call
0709 13:06:23.193556 (+   351us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:24.169788 (+976232us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:24.694357 (+524569us) spinlock_profiling.cc:243] Waited 895 ms on lock 0x7b54000b2cd4. stack: 00007f4a79de9343 00007f4a79de9240 00007f4a797781d4 00007f4a834b6304 00007f4a834b6299 00007f4a7ce71571 00007f4a7cf08e01 00007f4a7cf0783e 00007f4a81ecc419 00007f4a7b443bd4 00007f4a7b443b62 00007f4a7b443a91 00007f4a7b443a0c 00007f4a7b442cc2 00007f4a7b24348c 00007f4a7b2428c6
0709 13:06:24.694547 (+   190us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2058119552}
I20260709 13:06:24.708451 19477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14efcc79969f41babe5529c22d59156d" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:06:24.711266 19482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b08304a0a02b42d7840c4e8ee9a6bd1a" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:06:24.711764 19480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "217b5fae677b4971b3bbd2f357a1f7ff" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:06:24.717470 19555 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40428 (request call id 2708) took 1057 ms. Trace:
I20260709 13:06:24.712246 19484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e1f505cb0f1427bbd698ac889d80821" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 15 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:06:24.714176 24253 leader_election.cc:290] T 65d8cb8d6ec64f459d5a47cefab10acf P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 14 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:06:24.717048 19480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28af091831594f9d8e96482078cc7625" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:06:24.722051 19483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc225c93219c45538b53a1bd3d387e4d" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:06:24.717939 19555 rpcz_store.cc:276] 0709 13:06:23.660626 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:23.737248 (+ 76622us) service_pool.cc:224] Handling call
0709 13:06:24.717244 (+979996us) spinlock_profiling.cc:243] Waited 788 ms on lock 0x7b54003098d4. stack: 00007f4a79de9343 00007f4a79de9240 00007f4a797781d4 00007f4a834b6304 00007f4a834b6299 00007f4a7ce71571 00007f4a7cf0c2fa 00007f4a81ecdb17 00007f4a7b4486d4 00007f4a7b448662 00007f4a7b448591 00007f4a7b44850c 00007f4a7b4477c2 00007f4a7b24348c 00007f4a7b2428c6 00007f4a7b24226f
0709 13:06:24.717391 (+   147us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1813342976}
I20260709 13:06:24.726738 19557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21e14947d70440f19044d8f75c31e1f9" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:06:24.727320 19557 raft_consensus.cc:3060] T 21e14947d70440f19044d8f75c31e1f9 P e61c3a8f61bb48f8a963c9480e53c168 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:06:24.728709 19375 leader_election.cc:304] T 86a6797bdfe94fa496c050ceae4bd0d9 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:06:24.730392 19375 leader_election.cc:304] T bc225c93219c45538b53a1bd3d387e4d P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
W20260709 13:06:24.739578 19377 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.2:46257, user_credentials={real_user=slave}} blocked reactor thread for 196193us
I20260709 13:06:24.732674 19375 leader_election.cc:304] T b08304a0a02b42d7840c4e8ee9a6bd1a P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:06:24.742794 19375 leader_election.cc:304] T e381f1d6b8184797ad142de49be225a8 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168; no voters: 0473d2b2d01f4459b1e90fd12cc7840e
W20260709 13:06:24.727926 24424 log.cc:927] Time spent T 28af091831594f9d8e96482078cc7625 P e61c3a8f61bb48f8a963c9480e53c168: Append to log took a long time: real 0.498s	user 0.000s	sys 0.008s
W20260709 13:06:24.757704 19524 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:24.758311 19524 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:24.758658 19524 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:24.758558 19406 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "fa731b585f684a7fb2d106c50f143b83"
dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
mode: GRACEFUL
new_leader_uuid: "127766fc592545a4997f7790f50f6076"
 from {username='slave'} at 127.0.0.1:37312
I20260709 13:06:24.759161 19406 raft_consensus.cc:606] T fa731b585f684a7fb2d106c50f143b83 P e5256d91808b47c195bc9b4dbd7f2b87 [term 10 FOLLOWER]: Received request to transfer leadership to TS 127766fc592545a4997f7790f50f6076
I20260709 13:06:24.759578 19406 raft_consensus.cc:614] T fa731b585f684a7fb2d106c50f143b83 P e5256d91808b47c195bc9b4dbd7f2b87 [term 10 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:06:24.751402 24313 raft_consensus.cc:2804] T b08304a0a02b42d7840c4e8ee9a6bd1a P e5256d91808b47c195bc9b4dbd7f2b87 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:06:24.753227 19375 leader_election.cc:304] T ef32ce6fdd0e40d382c79974f30295c6 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168; no voters: 0473d2b2d01f4459b1e90fd12cc7840e
I20260709 13:06:24.716221 24276 raft_consensus.cc:515] T 1efebf73c86e432baa55533136b6e12c P 0473d2b2d01f4459b1e90fd12cc7840e [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:24.768177 19554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a08760e15aac4630a629431f56024dc8" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:06:24.769093 24276 leader_election.cc:290] T 1efebf73c86e432baa55533136b6e12c P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
W20260709 13:06:24.769932 24392 log.cc:927] Time spent T 6c5eebf646ad445a9d1b1adc319d7b16 P 127766fc592545a4997f7790f50f6076: Append to log took a long time: real 1.029s	user 0.003s	sys 0.007s
I20260709 13:06:24.770784 24274 leader_election.cc:290] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:06:24.740723 24394 raft_consensus.cc:2804] T bc225c93219c45538b53a1bd3d387e4d P e5256d91808b47c195bc9b4dbd7f2b87 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:06:24.771126 19477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa8650e71aa14778b3d73721fc50d9fc" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:06:24.771441 24394 raft_consensus.cc:493] T bc225c93219c45538b53a1bd3d387e4d P e5256d91808b47c195bc9b4dbd7f2b87 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 0473d2b2d01f4459b1e90fd12cc7840e)
I20260709 13:06:24.771888 24394 raft_consensus.cc:3060] T bc225c93219c45538b53a1bd3d387e4d P e5256d91808b47c195bc9b4dbd7f2b87 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:06:24.772933 19477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cdf56e38bbc453d9438d359e5a69955" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:06:24.738701 24362 raft_consensus.cc:2749] T 86a6797bdfe94fa496c050ceae4bd0d9 P e5256d91808b47c195bc9b4dbd7f2b87 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:06:24.775640 20075 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.1:40321, user_credentials={real_user=slave}} blocked reactor thread for 128048us
I20260709 13:06:24.782800 19557 raft_consensus.cc:2468] T 21e14947d70440f19044d8f75c31e1f9 P e61c3a8f61bb48f8a963c9480e53c168 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 14.
I20260709 13:06:24.784394 18300 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 13:06:24.787587 19477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36f6ba92b9ba46babe4ebd6c02e5fbd9" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:06:24.788918 24412 raft_consensus.cc:2804] T ef32ce6fdd0e40d382c79974f30295c6 P e5256d91808b47c195bc9b4dbd7f2b87 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:06:24.789353 24412 raft_consensus.cc:493] T ef32ce6fdd0e40d382c79974f30295c6 P e5256d91808b47c195bc9b4dbd7f2b87 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 0473d2b2d01f4459b1e90fd12cc7840e)
I20260709 13:06:24.789729 24412 raft_consensus.cc:3060] T ef32ce6fdd0e40d382c79974f30295c6 P e5256d91808b47c195bc9b4dbd7f2b87 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:06:24.789830 19375 leader_election.cc:304] T ab43d85f64114d4ebf618930e43d9ed0 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87; no voters: 127766fc592545a4997f7790f50f6076, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:06:24.790776 24393 raft_consensus.cc:493] T 85c494af21f9457a85da47b9bc70c1fd P e5256d91808b47c195bc9b4dbd7f2b87 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:24.791306 24393 raft_consensus.cc:515] T 85c494af21f9457a85da47b9bc70c1fd P e5256d91808b47c195bc9b4dbd7f2b87 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:24.791584 19375 leader_election.cc:304] T 4af19371ea874c09a0a2147040835cbb P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87; no voters: 127766fc592545a4997f7790f50f6076, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:06:24.792486 24370 raft_consensus.cc:493] T 9962423cb4e54fcfa5de01daf68a86e7 P e5256d91808b47c195bc9b4dbd7f2b87 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 127766fc592545a4997f7790f50f6076)
W20260709 13:06:24.795591 19524 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:24.797209 19526 leader_election.cc:304] T 4509b76741dc428e9201c70c1658da13 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:06:24.797380 19406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76cb037fc9064d13b59a8969d897ce8c" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:06:24.798981 19483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e5873a19244c5ebbcd38e126796ee7" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:06:24.799049 19408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e36a9d6e29c4a7c860cf267efbd4c74" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:06:24.758384 24372 raft_consensus.cc:2804] T e381f1d6b8184797ad142de49be225a8 P e5256d91808b47c195bc9b4dbd7f2b87 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:06:24.799814 19478 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58286 (request call id 2197) took 1499 ms. Trace:
I20260709 13:06:24.799818 19483 raft_consensus.cc:2393] T d1e5873a19244c5ebbcd38e126796ee7 P 0473d2b2d01f4459b1e90fd12cc7840e [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e5256d91808b47c195bc9b4dbd7f2b87 in current term 15: Already voted for candidate 0473d2b2d01f4459b1e90fd12cc7840e in this term.
I20260709 13:06:24.800443 19478 rpcz_store.cc:276] 0709 13:06:23.299965 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:23.300067 (+   102us) service_pool.cc:224] Handling call
0709 13:06:23.300453 (+   386us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:06:23.307729 (+  7276us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:23.307759 (+    30us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:06:23.308350 (+   591us) log.cc:844] Serialized 52 byte log entry
0709 13:06:23.597559 (+289209us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:06:23.597614 (+    55us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:23.597704 (+    90us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:23.839263 (+241559us) spinlock_profiling.cc:243] Waited 4.2 ms on lock 0x7b4400022b4c. stack: 00007f4a79de9343 00007f4a79de9240 00007f4a797781d4 00007f4a834b6304 00007f4a834b6299 00007f4a79ca3db1 00007f4a79d41c85 00007f4a79d426a2 00007f4a7cab41db 00007f4a7caafaaf 00007f4a7caa386e 00007f4a7caa2bb6 00007f4a7caa27d8 00007f4a7caac221 00007f4a7caac1d9 00007f4a7caac169
0709 13:06:24.726294 (+887031us) spinlock_profiling.cc:243] Waited 5.61 ms on lock 0x7b2400275dc8. stack: 00007f4a79de9343 00007f4a79de9240 00007f4a797781d4 00007f4a834b6304 00007f4a834b6299 00007f4a79ca3db1 00007f4a79ca19c4 00007f4a79c9facb 00007f4a79e5adc9 00007f4a79e5aa55 00007f4a79e59fb0 00007f4a7cad0488 00007f4a7cad0be8 00007f4a7caa8398 00007f4a7caa376a 00007f4a7caa2bb6
0709 13:06:24.799628 (+ 73334us) raft_consensus.cc:1685] finished
0709 13:06:24.799648 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:24.799765 (+   117us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1490,"raft.queue_time_us":7174,"raft.run_cpu_time_us":145,"raft.run_wall_time_us":8763,"spinlock_wait_cycles":22555776,"thread_start_us":249855,"threads_started":1,"wal-append.queue_time_us":303577}
I20260709 13:06:24.803296 20103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f85fc4b527a48848e5faa083b604e36" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:06:24.762707 24313 raft_consensus.cc:493] T b08304a0a02b42d7840c4e8ee9a6bd1a P e5256d91808b47c195bc9b4dbd7f2b87 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 0473d2b2d01f4459b1e90fd12cc7840e)
I20260709 13:06:24.827875 20105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36f6ba92b9ba46babe4ebd6c02e5fbd9" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:06:24.836898 20106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1efebf73c86e432baa55533136b6e12c" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:06:24.837742 19526 leader_election.cc:304] T ff75a1d4cb1f493db8f71ddc136ba9ab P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:06:24.839769 19406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f575b143b844aa096b50997dad3516a" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:06:24.841566 19478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22196caba61445d3bec98a0aab3c337d" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:06:24.842332 19478 raft_consensus.cc:3060] T 22196caba61445d3bec98a0aab3c337d P 0473d2b2d01f4459b1e90fd12cc7840e [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:06:24.802752 24373 raft_consensus.cc:2749] T ab43d85f64114d4ebf618930e43d9ed0 P e5256d91808b47c195bc9b4dbd7f2b87 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:06:24.860014 19483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f85fc4b527a48848e5faa083b604e36" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:06:24.793129 24370 raft_consensus.cc:515] T 9962423cb4e54fcfa5de01daf68a86e7 P e5256d91808b47c195bc9b4dbd7f2b87 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:24.803077 24372 raft_consensus.cc:493] T e381f1d6b8184797ad142de49be225a8 P e5256d91808b47c195bc9b4dbd7f2b87 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 0473d2b2d01f4459b1e90fd12cc7840e)
I20260709 13:06:24.860126 19408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40e1e16737a842ee936002830f36882e" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:06:24.827164 24445 raft_consensus.cc:2749] T 4af19371ea874c09a0a2147040835cbb P e5256d91808b47c195bc9b4dbd7f2b87 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:06:24.877916 24372 raft_consensus.cc:3060] T e381f1d6b8184797ad142de49be225a8 P e5256d91808b47c195bc9b4dbd7f2b87 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:06:24.879209 24370 leader_election.cc:290] T 9962423cb4e54fcfa5de01daf68a86e7 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:06:24.920212 19554 raft_consensus.cc:1240] T 21e14947d70440f19044d8f75c31e1f9 P e61c3a8f61bb48f8a963c9480e53c168 [term 14 FOLLOWER]: Rejecting Update request from peer 0473d2b2d01f4459b1e90fd12cc7840e for earlier term 13. Current term is 14. Ops: []
I20260709 13:06:24.920918 19556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f575b143b844aa096b50997dad3516a" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:06:24.921406 19554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e36a9d6e29c4a7c860cf267efbd4c74" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:06:24.879715 24238 raft_consensus.cc:493] T 2a16f7501e2444fb86d4e2778e734e02 P e61c3a8f61bb48f8a963c9480e53c168 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:24.922122 19559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df751f992649444090e27965eb1af85d" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:06:24.922250 19552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40e1e16737a842ee936002830f36882e" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:06:24.922544 24238 raft_consensus.cc:515] T 2a16f7501e2444fb86d4e2778e734e02 P e61c3a8f61bb48f8a963c9480e53c168 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:24.876812 24446 consensus_queue.cc:1059] T 65d8cb8d6ec64f459d5a47cefab10acf P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false }, Status: INVALID_TERM, Last received: 13.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.024s
I20260709 13:06:24.834169 24313 raft_consensus.cc:3060] T b08304a0a02b42d7840c4e8ee9a6bd1a P e5256d91808b47c195bc9b4dbd7f2b87 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:06:24.924808 24238 leader_election.cc:290] T 2a16f7501e2444fb86d4e2778e734e02 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:06:24.886795 24318 raft_consensus.cc:2804] T ff75a1d4cb1f493db8f71ddc136ba9ab P e61c3a8f61bb48f8a963c9480e53c168 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:06:24.926855 24318 raft_consensus.cc:493] T ff75a1d4cb1f493db8f71ddc136ba9ab P e61c3a8f61bb48f8a963c9480e53c168 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:24.927229 24318 raft_consensus.cc:3060] T ff75a1d4cb1f493db8f71ddc136ba9ab P e61c3a8f61bb48f8a963c9480e53c168 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:06:24.927034 19483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "179fd671030940b4b4a4e24bcc4aba0a" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:06:24.928109 24412 raft_consensus.cc:515] T ef32ce6fdd0e40d382c79974f30295c6 P e5256d91808b47c195bc9b4dbd7f2b87 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:24.930258 24412 leader_election.cc:290] T ef32ce6fdd0e40d382c79974f30295c6 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 16 election: Requested vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:06:24.833722 24278 consensus_queue.cc:1059] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P 127766fc592545a4997f7790f50f6076 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 }, Status: INVALID_TERM, Last received: 14.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.055s
I20260709 13:06:24.890985 19555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "179fd671030940b4b4a4e24bcc4aba0a" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:06:24.905470 19403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f85fc4b527a48848e5faa083b604e36" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:06:24.931463 19403 raft_consensus.cc:2393] T 1f85fc4b527a48848e5faa083b604e36 P e5256d91808b47c195bc9b4dbd7f2b87 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0473d2b2d01f4459b1e90fd12cc7840e in current term 12: Already voted for candidate e5256d91808b47c195bc9b4dbd7f2b87 in this term.
I20260709 13:06:24.931527 24278 raft_consensus.cc:3055] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P 127766fc592545a4997f7790f50f6076 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:06:24.932098 24278 raft_consensus.cc:740] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P 127766fc592545a4997f7790f50f6076 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 127766fc592545a4997f7790f50f6076, State: Running, Role: LEADER
I20260709 13:06:24.933060 24278 consensus_queue.cc:260] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P 127766fc592545a4997f7790f50f6076 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
W20260709 13:06:24.935128 24272 consensus_queue.cc:1175] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P 127766fc592545a4997f7790f50f6076 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" responder_term: 14 status { last_received { term: 14 index: 12 } last_committed_idx: 12 last_received_current_leader { term: 14 index: 12 } }
I20260709 13:06:24.934520 24278 raft_consensus.cc:3060] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P 127766fc592545a4997f7790f50f6076 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:06:24.830646 24306 raft_consensus.cc:2804] T 4509b76741dc428e9201c70c1658da13 P e61c3a8f61bb48f8a963c9480e53c168 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:06:24.943372 24306 raft_consensus.cc:493] T 4509b76741dc428e9201c70c1658da13 P e61c3a8f61bb48f8a963c9480e53c168 [term 8 FOLLOWER]: Starting leader election (detected failure of leader e5256d91808b47c195bc9b4dbd7f2b87)
I20260709 13:06:24.910506 24373 raft_consensus.cc:493] T fa731b585f684a7fb2d106c50f143b83 P e5256d91808b47c195bc9b4dbd7f2b87 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 127766fc592545a4997f7790f50f6076)
I20260709 13:06:24.944182 24373 raft_consensus.cc:515] T fa731b585f684a7fb2d106c50f143b83 P e5256d91808b47c195bc9b4dbd7f2b87 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:24.945523 24411 leader_election.cc:290] T ff9b0eddd810459b82d91c60777c10eb P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:06:24.911042 24362 raft_consensus.cc:493] T 775c229504194560ba9589bc2199b089 P e5256d91808b47c195bc9b4dbd7f2b87 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 127766fc592545a4997f7790f50f6076)
I20260709 13:06:24.907606 19485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff9b0eddd810459b82d91c60777c10eb" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:06:24.838943 24393 leader_election.cc:290] T 85c494af21f9457a85da47b9bc70c1fd P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:06:24.915227 19482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21e14947d70440f19044d8f75c31e1f9" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:06:24.947031 24362 raft_consensus.cc:515] T 775c229504194560ba9589bc2199b089 P e5256d91808b47c195bc9b4dbd7f2b87 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:24.915544 19477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9962423cb4e54fcfa5de01daf68a86e7" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:06:24.948316 19477 raft_consensus.cc:2468] T 9962423cb4e54fcfa5de01daf68a86e7 P 0473d2b2d01f4459b1e90fd12cc7840e [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 11.
W20260709 13:06:24.948660 24429 log.cc:927] Time spent T 21e14947d70440f19044d8f75c31e1f9 P e5256d91808b47c195bc9b4dbd7f2b87: Append to log took a long time: real 0.153s	user 0.007s	sys 0.003s
I20260709 13:06:24.949383 24362 leader_election.cc:290] T 775c229504194560ba9589bc2199b089 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:06:24.911875 24445 raft_consensus.cc:493] T df751f992649444090e27965eb1af85d P e5256d91808b47c195bc9b4dbd7f2b87 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:24.950344 24445 raft_consensus.cc:515] T df751f992649444090e27965eb1af85d P e5256d91808b47c195bc9b4dbd7f2b87 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:24.952844 24445 leader_election.cc:290] T df751f992649444090e27965eb1af85d P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:06:24.953552 24306 raft_consensus.cc:3060] T 4509b76741dc428e9201c70c1658da13 P e61c3a8f61bb48f8a963c9480e53c168 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:06:24.943425 24338 raft_consensus.cc:493] T 6c5eebf646ad445a9d1b1adc319d7b16 P e61c3a8f61bb48f8a963c9480e53c168 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 0473d2b2d01f4459b1e90fd12cc7840e)
I20260709 13:06:24.916756 19406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36f6ba92b9ba46babe4ebd6c02e5fbd9" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:06:24.918658 19377 leader_election.cc:304] T 217b5fae677b4971b3bbd2f357a1f7ff P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:06:24.954217 24338 raft_consensus.cc:515] T 6c5eebf646ad445a9d1b1adc319d7b16 P e61c3a8f61bb48f8a963c9480e53c168 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:24.956480 24338 leader_election.cc:290] T 6c5eebf646ad445a9d1b1adc319d7b16 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:06:24.952553 20106 consensus_queue.cc:237] T ab43d85f64114d4ebf618930e43d9ed0 P 127766fc592545a4997f7790f50f6076 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:24.957005 19406 raft_consensus.cc:2393] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P e5256d91808b47c195bc9b4dbd7f2b87 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0473d2b2d01f4459b1e90fd12cc7840e in current term 15: Already voted for candidate e5256d91808b47c195bc9b4dbd7f2b87 in this term.
I20260709 13:06:24.957418 24373 leader_election.cc:290] T fa731b585f684a7fb2d106c50f143b83 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:06:24.958103 24373 raft_consensus.cc:2749] T 217b5fae677b4971b3bbd2f357a1f7ff P e5256d91808b47c195bc9b4dbd7f2b87 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:06:24.958860 20105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14935b3ddf914369822e4a0547aaa355" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:06:24.959956 19404 raft_consensus.cc:1240] T 179fd671030940b4b4a4e24bcc4aba0a P e5256d91808b47c195bc9b4dbd7f2b87 [term 15 FOLLOWER]: Rejecting Update request from peer 0473d2b2d01f4459b1e90fd12cc7840e for earlier term 14. Current term is 15. Ops: []
I20260709 13:06:24.930787 24412 raft_consensus.cc:3055] T 65d8cb8d6ec64f459d5a47cefab10acf P e5256d91808b47c195bc9b4dbd7f2b87 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:06:24.962147 19553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1efebf73c86e432baa55533136b6e12c" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:06:24.957057 24313 raft_consensus.cc:515] T b08304a0a02b42d7840c4e8ee9a6bd1a P e5256d91808b47c195bc9b4dbd7f2b87 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:24.962973 19377 leader_election.cc:304] T 3e1f505cb0f1427bbd698ac889d80821 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:06:24.963599 20103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed7fdbcb96d14d418db9ca90a792588a" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:06:24.963996 20105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0afb57ae58a24a01850491d69f0213dd" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:06:24.964926 19408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df751f992649444090e27965eb1af85d" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:06:24.976497 19408 raft_consensus.cc:2468] T df751f992649444090e27965eb1af85d P e5256d91808b47c195bc9b4dbd7f2b87 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 16.
I20260709 13:06:24.971873 19450 leader_election.cc:304] T 96efeaaf1057492490e9a621f37e1a2d P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:06:24.968056 20078 leader_election.cc:304] T 14efcc79969f41babe5529c22d59156d P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 127766fc592545a4997f7790f50f6076; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:06:24.988353 19377 leader_election.cc:304] T 28af091831594f9d8e96482078cc7625 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:06:24.992532 19478 raft_consensus.cc:2468] T 22196caba61445d3bec98a0aab3c337d P 0473d2b2d01f4459b1e90fd12cc7840e [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 12.
I20260709 13:06:24.950295 24318 raft_consensus.cc:515] T ff75a1d4cb1f493db8f71ddc136ba9ab P e61c3a8f61bb48f8a963c9480e53c168 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:24.988210 19450 leader_election.cc:304] T 1a61655d99124a29b486ba4a5b37faea P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168; no voters: e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:06:25.002027 20103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "309c3ca0ca4b4f3ba129752ea2cb293b" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:06:24.996760 24373 raft_consensus.cc:2749] T 3e1f505cb0f1427bbd698ac889d80821 P e5256d91808b47c195bc9b4dbd7f2b87 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:06:24.965512 24412 raft_consensus.cc:740] T 65d8cb8d6ec64f459d5a47cefab10acf P e5256d91808b47c195bc9b4dbd7f2b87 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: e5256d91808b47c195bc9b4dbd7f2b87, State: Running, Role: LEADER
I20260709 13:06:25.010820 24307 leader_election.cc:290] T 28af091831594f9d8e96482078cc7625 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:06:25.010937 24413 consensus_queue.cc:1048] T 2a16f7501e2444fb86d4e2778e734e02 P 127766fc592545a4997f7790f50f6076 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:06:25.012481 24242 raft_consensus.cc:2749] T 14efcc79969f41babe5529c22d59156d P 127766fc592545a4997f7790f50f6076 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:06:25.013036 24267 raft_consensus.cc:3055] T 1f85fc4b527a48848e5faa083b604e36 P 127766fc592545a4997f7790f50f6076 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:06:24.986390 24055 raft_consensus.cc:2804] T 96efeaaf1057492490e9a621f37e1a2d P 0473d2b2d01f4459b1e90fd12cc7840e [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:06:25.018543 20103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62c6c134d3d24a1ab144dd9ee6bc3f64" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:06:25.015591 19377 leader_election.cc:304] T fa8650e71aa14778b3d73721fc50d9fc P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:06:25.015666 19407 raft_consensus.cc:1240] T b08304a0a02b42d7840c4e8ee9a6bd1a P e5256d91808b47c195bc9b4dbd7f2b87 [term 13 FOLLOWER]: Rejecting Update request from peer 0473d2b2d01f4459b1e90fd12cc7840e for earlier term 12. Current term is 13. Ops: []
I20260709 13:06:24.983485 24394 raft_consensus.cc:515] T bc225c93219c45538b53a1bd3d387e4d P e5256d91808b47c195bc9b4dbd7f2b87 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:25.013530 24445 raft_consensus.cc:2749] T 28af091831594f9d8e96482078cc7625 P e5256d91808b47c195bc9b4dbd7f2b87 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:06:25.030243 24055 raft_consensus.cc:697] T 96efeaaf1057492490e9a621f37e1a2d P 0473d2b2d01f4459b1e90fd12cc7840e [term 15 LEADER]: Becoming Leader. State: Replica: 0473d2b2d01f4459b1e90fd12cc7840e, State: Running, Role: LEADER
I20260709 13:06:25.054441 20105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c5eebf646ad445a9d1b1adc319d7b16" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:06:25.022007 24397 raft_consensus.cc:2804] T 1a61655d99124a29b486ba4a5b37faea P 0473d2b2d01f4459b1e90fd12cc7840e [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:06:25.056056 24397 raft_consensus.cc:493] T 1a61655d99124a29b486ba4a5b37faea P 0473d2b2d01f4459b1e90fd12cc7840e [term 10 FOLLOWER]: Starting leader election (detected failure of leader e5256d91808b47c195bc9b4dbd7f2b87)
I20260709 13:06:25.056457 24397 raft_consensus.cc:3060] T 1a61655d99124a29b486ba4a5b37faea P 0473d2b2d01f4459b1e90fd12cc7840e [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:06:25.033278 24373 raft_consensus.cc:2749] T fa8650e71aa14778b3d73721fc50d9fc P e5256d91808b47c195bc9b4dbd7f2b87 [term 13 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:06:25.021292 24141 consensus_queue.cc:1048] T 85c494af21f9457a85da47b9bc70c1fd P 127766fc592545a4997f7790f50f6076 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.014s
W20260709 13:06:25.066330 19306 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:44698 (request call id 232) took 23071 ms (client timeout 15000 ms). Trace:
I20260709 13:06:25.040412 18300 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:06:25.044004 24372 raft_consensus.cc:515] T e381f1d6b8184797ad142de49be225a8 P e5256d91808b47c195bc9b4dbd7f2b87 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:25.075753 19405 raft_consensus.cc:1240] T bc225c93219c45538b53a1bd3d387e4d P e5256d91808b47c195bc9b4dbd7f2b87 [term 12 FOLLOWER]: Rejecting Update request from peer 0473d2b2d01f4459b1e90fd12cc7840e for earlier term 11. Current term is 12. Ops: []
I20260709 13:06:25.076145 24394 leader_election.cc:290] T bc225c93219c45538b53a1bd3d387e4d P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 12 election: Requested vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:06:25.046949 24433 consensus_queue.cc:1048] T 833a2f0775ed407a94b8924ce50adb63 P 127766fc592545a4997f7790f50f6076 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
W20260709 13:06:25.078622 19374 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.4:43121, user_credentials={real_user=slave}} blocked reactor thread for 280301us
I20260709 13:06:25.049280 19377 leader_election.cc:304] T 0cdf56e38bbc453d9438d359e5a69955 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:06:25.023017 24267 raft_consensus.cc:740] T 1f85fc4b527a48848e5faa083b604e36 P 127766fc592545a4997f7790f50f6076 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 127766fc592545a4997f7790f50f6076, State: Running, Role: LEADER
I20260709 13:06:25.071209 20105 raft_consensus.cc:2393] T 6c5eebf646ad445a9d1b1adc319d7b16 P 127766fc592545a4997f7790f50f6076 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e61c3a8f61bb48f8a963c9480e53c168 in current term 13: Already voted for candidate 127766fc592545a4997f7790f50f6076 in this term.
I20260709 13:06:25.072559 24318 leader_election.cc:290] T ff75a1d4cb1f493db8f71ddc136ba9ab P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 14 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:06:25.073475 24412 consensus_queue.cc:260] T 65d8cb8d6ec64f459d5a47cefab10acf P e5256d91808b47c195bc9b4dbd7f2b87 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:25.094725 24412 raft_consensus.cc:3060] T 65d8cb8d6ec64f459d5a47cefab10acf P e5256d91808b47c195bc9b4dbd7f2b87 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:06:25.094885 24055 consensus_queue.cc:237] T 96efeaaf1057492490e9a621f37e1a2d P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:25.055400 19450 leader_election.cc:304] T edd7d470b5014c9489be7f41f64355c9 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:06:25.099088 20111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff9b0eddd810459b82d91c60777c10eb" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
W20260709 13:06:25.099335 19450 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.3:36891, user_credentials={real_user=slave}} blocked reactor thread for 44006.9us
I20260709 13:06:25.051092 20103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a16f7501e2444fb86d4e2778e734e02" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
W20260709 13:06:25.099707 19377 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.2:46257, user_credentials={real_user=slave}} blocked reactor thread for 50510.2us
I20260709 13:06:25.099977 19450 leader_election.cc:304] T 76cb037fc9064d13b59a8969d897ce8c P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:06:25.099702 20111 raft_consensus.cc:2468] T ff9b0eddd810459b82d91c60777c10eb P 127766fc592545a4997f7790f50f6076 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 14.
I20260709 13:06:25.100487 19377 leader_election.cc:304] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, 127766fc592545a4997f7790f50f6076
I20260709 13:06:25.076711 24372 leader_election.cc:290] T e381f1d6b8184797ad142de49be225a8 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 11 election: Requested vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:06:25.103806 20105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9962423cb4e54fcfa5de01daf68a86e7" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:06:25.109201 19377 leader_election.cc:304] T d1e5873a19244c5ebbcd38e126796ee7 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:06:25.109767 20103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa731b585f684a7fb2d106c50f143b83" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:06:25.109201 20105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "775c229504194560ba9589bc2199b089" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:06:25.070272 19307 catalog_manager.cc:5697] T 309c3ca0ca4b4f3ba129752ea2cb293b P 0473d2b2d01f4459b1e90fd12cc7840e reported cstate change: term changed from 7 to 9, leader changed from 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2) to 127766fc592545a4997f7790f50f6076 (127.17.223.4). New cstate: current_term: 9 leader_uuid: "127766fc592545a4997f7790f50f6076" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } attrs { replace: true } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } } }
I20260709 13:06:25.127703 20111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85c494af21f9457a85da47b9bc70c1fd" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:06:25.130352 19377 leader_election.cc:304] T 1f85fc4b527a48848e5faa083b604e36 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, 127766fc592545a4997f7790f50f6076
I20260709 13:06:25.107963 24183 raft_consensus.cc:2804] T edd7d470b5014c9489be7f41f64355c9 P 0473d2b2d01f4459b1e90fd12cc7840e [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:06:25.150831 24183 raft_consensus.cc:493] T edd7d470b5014c9489be7f41f64355c9 P 0473d2b2d01f4459b1e90fd12cc7840e [term 14 FOLLOWER]: Starting leader election (detected failure of leader e5256d91808b47c195bc9b4dbd7f2b87)
I20260709 13:06:25.151292 24183 raft_consensus.cc:3060] T edd7d470b5014c9489be7f41f64355c9 P 0473d2b2d01f4459b1e90fd12cc7840e [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:06:25.109261 24421 raft_consensus.cc:2804] T 76cb037fc9064d13b59a8969d897ce8c P 0473d2b2d01f4459b1e90fd12cc7840e [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:06:25.152076 24421 raft_consensus.cc:493] T 76cb037fc9064d13b59a8969d897ce8c P 0473d2b2d01f4459b1e90fd12cc7840e [term 11 FOLLOWER]: Starting leader election (detected failure of leader e5256d91808b47c195bc9b4dbd7f2b87)
I20260709 13:06:25.152462 24421 raft_consensus.cc:3060] T 76cb037fc9064d13b59a8969d897ce8c P 0473d2b2d01f4459b1e90fd12cc7840e [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:06:25.153895 24313 leader_election.cc:290] T b08304a0a02b42d7840c4e8ee9a6bd1a P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 13 election: Requested vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:06:25.156905 24397 raft_consensus.cc:515] T 1a61655d99124a29b486ba4a5b37faea P 0473d2b2d01f4459b1e90fd12cc7840e [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:25.127209 24373 raft_consensus.cc:2749] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P e5256d91808b47c195bc9b4dbd7f2b87 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:06:25.159663 24393 raft_consensus.cc:993] T 46c5bfeecc314717bffe987e6844b6d0 P e5256d91808b47c195bc9b4dbd7f2b87: : Instructing follower 0473d2b2d01f4459b1e90fd12cc7840e to start an election
I20260709 13:06:25.160121 24393 raft_consensus.cc:1081] T 46c5bfeecc314717bffe987e6844b6d0 P e5256d91808b47c195bc9b4dbd7f2b87 [term 18 LEADER]: Signalling peer 0473d2b2d01f4459b1e90fd12cc7840e to start an election
I20260709 13:06:25.161876 24445 raft_consensus.cc:2749] T d1e5873a19244c5ebbcd38e126796ee7 P e5256d91808b47c195bc9b4dbd7f2b87 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:06:25.126525 24306 raft_consensus.cc:515] T 4509b76741dc428e9201c70c1658da13 P e61c3a8f61bb48f8a963c9480e53c168 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:25.142139 19408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65d8cb8d6ec64f459d5a47cefab10acf" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
I20260709 13:06:25.092727 24267 consensus_queue.cc:260] T 1f85fc4b527a48848e5faa083b604e36 P 127766fc592545a4997f7790f50f6076 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:25.109311 24411 raft_consensus.cc:2749] T 0cdf56e38bbc453d9438d359e5a69955 P e5256d91808b47c195bc9b4dbd7f2b87 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:06:25.103065 24299 consensus_queue.cc:1059] T 70797e5783b5454ab0d0eea663e791e3 P 127766fc592545a4997f7790f50f6076 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 }, Status: INVALID_TERM, Last received: 12.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.038s
I20260709 13:06:25.167259 19406 raft_consensus.cc:1240] T 1f85fc4b527a48848e5faa083b604e36 P e5256d91808b47c195bc9b4dbd7f2b87 [term 12 FOLLOWER]: Rejecting Update request from peer 127766fc592545a4997f7790f50f6076 for earlier term 11. Current term is 12. Ops: []
W20260709 13:06:25.087770 19306 rpcz_store.cc:269] 0709 13:06:01.995061 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:01.995205 (+   144us) service_pool.cc:224] Handling call
0709 13:06:03.587216 (+1592011us) spinlock_profiling.cc:243] Waited 203 ms on lock 0x7b54003fb6d4. stack: 00007f4a79de9343 00007f4a79de9240 00007f4a797781d4 00007f4a834b6304 00007f4a834b6299 00007f4a7ce72090 00007f4a7cf10f3a 00007f4a82cc71cc 00007f4a82dc537e 00007f4a812862a4 00007f4a81286232 00007f4a81286161 00007f4a812860dc 00007f4a81285392 00007f4a7b24348c 00007f4a7b2428c6
0709 13:06:25.066256 (+21479040us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:06:18.306900 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:06:18.307557 (+   657us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:06:18.307610 (+    53us) write_op.cc:435] Acquired schema lock
0709 13:06:18.307633 (+    23us) tablet.cc:662] Decoding operations
0709 13:06:18.308820 (+  1187us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:06:18.308943 (+   123us) write_op.cc:641] Partition lock acquired for write op
0709 13:06:18.308978 (+    35us) tablet.cc:685] Acquiring locks for 13 operations
0709 13:06:18.310180 (+  1202us) tablet.cc:701] Row locks acquired
0709 13:06:18.310226 (+    46us) write_op.cc:260] PREPARE: finished
0709 13:06:18.310377 (+   151us) write_op.cc:270] Start()
0709 13:06:18.310524 (+   147us) write_op.cc:276] Timestamp: P: 1783602378310315 usec, L: 0
0709 13:06:18.310559 (+    35us) op_driver.cc:348] REPLICATION: starting
0709 13:06:18.463395 (+152836us) log.cc:844] Serialized 5130 byte log entry
0709 13:06:18.927491 (+464096us) op_driver.cc:464] REPLICATION: finished
0709 13:06:19.054931 (+127440us) write_op.cc:301] APPLY: starting
0709 13:06:19.068487 (+ 13556us) tablet.cc:1367] starting BulkCheckPresence
0709 13:06:19.077701 (+  9214us) tablet.cc:1370] finished BulkCheckPresence
0709 13:06:19.077845 (+   144us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:06:19.177751 (+ 99906us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:06:19.178070 (+   319us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=26,key_file_lookups=26,delta_file_lookups=26,mrs_lookups=0
0709 13:06:19.178131 (+    61us) write_op.cc:312] APPLY: finished
0709 13:06:19.178516 (+   385us) log.cc:844] Serialized 121 byte log entry
0709 13:06:19.186997 (+  8481us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:06:19.190851 (+  3854us) write_op.cc:454] Released schema lock
0709 13:06:19.190940 (+    89us) write_op.cc:341] FINISH: Updating metrics
0709 13:06:19.214228 (+ 23288us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:06:19.214261 (+    33us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":160137,"reported_tablets":51,"spinlock_wait_cycles":467710848,"child_traces":[["op",{"apply.queue_time_us":93444,"apply.run_cpu_time_us":17748,"apply.run_wall_time_us":168800,"cfile_cache_hit":54,"cfile_cache_hit_bytes":58467,"num_ops":13,"prepare.queue_time_us":140033,"prepare.run_cpu_time_us":7078,"prepare.run_wall_time_us":310247,"raft.queue_time_us":262009,"raft.run_cpu_time_us":15692,"raft.run_wall_time_us":137788,"replication_time_us":577869,"thread_start_us":389103,"threads_started":4,"wal-append.queue_time_us":113515,"wal-append.run_cpu_time_us":31406,"wal-append.run_wall_time_us":1570873}]]}
I20260709 13:06:25.170239 24190 raft_consensus.cc:3055] T 70797e5783b5454ab0d0eea663e791e3 P 127766fc592545a4997f7790f50f6076 [term 12 LEADER]: Stepping down as leader of term 12
W20260709 13:06:25.177618 19449 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.1:40321, user_credentials={real_user=slave}} blocked reactor thread for 361292us
I20260709 13:06:25.172740 24267 raft_consensus.cc:3060] T 1f85fc4b527a48848e5faa083b604e36 P 127766fc592545a4997f7790f50f6076 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:06:25.176177 19377 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.2:46257, user_credentials={real_user=slave}} blocked reactor thread for 45923.8us
W20260709 13:06:25.185209 19377 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:25.187089 19377 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:25.187988 19375 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.3:36891, user_credentials={real_user=slave}} blocked reactor thread for 350998us
I20260709 13:06:25.176496 24446 raft_consensus.cc:2749] T 1f85fc4b527a48848e5faa083b604e36 P e5256d91808b47c195bc9b4dbd7f2b87 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:06:25.176692 24190 raft_consensus.cc:740] T 70797e5783b5454ab0d0eea663e791e3 P 127766fc592545a4997f7790f50f6076 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 127766fc592545a4997f7790f50f6076, State: Running, Role: LEADER
I20260709 13:06:25.189848 19375 leader_election.cc:304] T 70797e5783b5454ab0d0eea663e791e3 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87; no voters: 127766fc592545a4997f7790f50f6076, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:06:25.208611 19375 leader_election.cc:304] T 21e14947d70440f19044d8f75c31e1f9 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:06:25.209525 24412 raft_consensus.cc:2804] T 21e14947d70440f19044d8f75c31e1f9 P e5256d91808b47c195bc9b4dbd7f2b87 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:06:25.210115 24412 raft_consensus.cc:697] T 21e14947d70440f19044d8f75c31e1f9 P e5256d91808b47c195bc9b4dbd7f2b87 [term 14 LEADER]: Becoming Leader. State: Replica: e5256d91808b47c195bc9b4dbd7f2b87, State: Running, Role: LEADER
I20260709 13:06:25.210983 24412 consensus_queue.cc:237] T 21e14947d70440f19044d8f75c31e1f9 P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:25.212411 19558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85c494af21f9457a85da47b9bc70c1fd" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:06:25.212980 19558 raft_consensus.cc:2468] T 85c494af21f9457a85da47b9bc70c1fd P e61c3a8f61bb48f8a963c9480e53c168 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 12.
I20260709 13:06:25.215308 19555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc225c93219c45538b53a1bd3d387e4d" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:06:25.216234 19551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa731b585f684a7fb2d106c50f143b83" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:06:25.217020 19551 raft_consensus.cc:2468] T fa731b585f684a7fb2d106c50f143b83 P e61c3a8f61bb48f8a963c9480e53c168 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 10.
I20260709 13:06:25.218096 19553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df751f992649444090e27965eb1af85d" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 17 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:06:25.218888 19403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e381f1d6b8184797ad142de49be225a8" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:06:25.219506 19552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e381f1d6b8184797ad142de49be225a8" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:06:25.222385 19404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff75a1d4cb1f493db8f71ddc136ba9ab" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:06:25.223603 19403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a61655d99124a29b486ba4a5b37faea" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:06:25.226877 19558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef32ce6fdd0e40d382c79974f30295c6" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:06:25.229044 19477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "309c3ca0ca4b4f3ba129752ea2cb293b" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:06:25.230145 19484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b74109013a140ada21feeef92d6f563" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:06:25.236433 19409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef32ce6fdd0e40d382c79974f30295c6" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:06:25.237782 19403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b08304a0a02b42d7840c4e8ee9a6bd1a" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:06:25.238168 19481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cdf56e38bbc453d9438d359e5a69955" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:06:25.238940 19402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4509b76741dc428e9201c70c1658da13" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:06:25.239776 19403 raft_consensus.cc:2393] T b08304a0a02b42d7840c4e8ee9a6bd1a P e5256d91808b47c195bc9b4dbd7f2b87 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e61c3a8f61bb48f8a963c9480e53c168 in current term 13: Already voted for candidate e5256d91808b47c195bc9b4dbd7f2b87 in this term.
I20260709 13:06:25.240300 19482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc225c93219c45538b53a1bd3d387e4d" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:06:25.241035 19484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dc5b3532fe54f74876d02beffa2c230" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:06:25.241453 19404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28af091831594f9d8e96482078cc7625" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:06:25.241763 19484 raft_consensus.cc:2468] T 1dc5b3532fe54f74876d02beffa2c230 P 0473d2b2d01f4459b1e90fd12cc7840e [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 14.
I20260709 13:06:25.242352 19409 raft_consensus.cc:2393] T ef32ce6fdd0e40d382c79974f30295c6 P e5256d91808b47c195bc9b4dbd7f2b87 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e61c3a8f61bb48f8a963c9480e53c168 in current term 16: Already voted for candidate e5256d91808b47c195bc9b4dbd7f2b87 in this term.
I20260709 13:06:25.243141 19409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cdf56e38bbc453d9438d359e5a69955" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:06:25.243557 19484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22196caba61445d3bec98a0aab3c337d" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:06:25.244444 19484 raft_consensus.cc:2393] T 22196caba61445d3bec98a0aab3c337d P 0473d2b2d01f4459b1e90fd12cc7840e [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate e61c3a8f61bb48f8a963c9480e53c168 in current term 12: Already voted for candidate e5256d91808b47c195bc9b4dbd7f2b87 in this term.
I20260709 13:06:25.244325 19409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85c494af21f9457a85da47b9bc70c1fd" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:06:25.247066 19484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c5eebf646ad445a9d1b1adc319d7b16" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:06:25.248457 19484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28af091831594f9d8e96482078cc7625" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:06:25.250098 19374 leader_election.cc:304] T ff9b0eddd810459b82d91c60777c10eb P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 127766fc592545a4997f7790f50f6076, e5256d91808b47c195bc9b4dbd7f2b87; no voters: 
I20260709 13:06:25.251830 19559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b08304a0a02b42d7840c4e8ee9a6bd1a" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
W20260709 13:06:25.253559 19524 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:25.254156 19524 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:25.277552 19483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62c6c134d3d24a1ab144dd9ee6bc3f64" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:06:25.277755 19485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a61655d99124a29b486ba4a5b37faea" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:06:25.283223 19410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e36a9d6e29c4a7c860cf267efbd4c74" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 12 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:06:25.246574 19307 catalog_manager.cc:5697] T fa8650e71aa14778b3d73721fc50d9fc P 0473d2b2d01f4459b1e90fd12cc7840e reported cstate change: term changed from 9 to 11. New cstate: current_term: 11 leader_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } health_report { overall_health: HEALTHY } } }
I20260709 13:06:25.311909 19479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2725d2c4cb054f18b0fc8f735c15f6c2" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
W20260709 13:06:25.338079 19523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.1:40321, user_credentials={real_user=slave}} blocked reactor thread for 284568us
I20260709 13:06:25.285198 24397 leader_election.cc:290] T 1a61655d99124a29b486ba4a5b37faea P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 11 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
W20260709 13:06:25.411371 24454 log.cc:927] Time spent T ff75a1d4cb1f493db8f71ddc136ba9ab P 0473d2b2d01f4459b1e90fd12cc7840e: Append to log took a long time: real 0.164s	user 0.000s	sys 0.000s
I20260709 13:06:25.546536 19408 raft_consensus.cc:2468] T 65d8cb8d6ec64f459d5a47cefab10acf P e5256d91808b47c195bc9b4dbd7f2b87 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 127766fc592545a4997f7790f50f6076 in term 14.
I20260709 13:06:25.313215 24190 consensus_queue.cc:260] T 70797e5783b5454ab0d0eea663e791e3 P 127766fc592545a4997f7790f50f6076 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
W20260709 13:06:25.434499 19450 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.3:36891, user_credentials={real_user=slave}} blocked reactor thread for 303629us
I20260709 13:06:25.253424 24387 consensus_queue.cc:1048] T ff9b0eddd810459b82d91c60777c10eb P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Connected to new peer: Peer: permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.085s
I20260709 13:06:25.201121 24305 consensus_queue.cc:1048] T ff75a1d4cb1f493db8f71ddc136ba9ab P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.049s
W20260709 13:06:25.524375 20075 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.1:40321, user_credentials={real_user=slave}} blocked reactor thread for 245847us
I20260709 13:06:25.524982 19483 raft_consensus.cc:2468] T 62c6c134d3d24a1ab144dd9ee6bc3f64 P 0473d2b2d01f4459b1e90fd12cc7840e [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 13.
I20260709 13:06:25.526207 19484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff75a1d4cb1f493db8f71ddc136ba9ab" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 14 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:06:25.206315 24446 raft_consensus.cc:2749] T 70797e5783b5454ab0d0eea663e791e3 P e5256d91808b47c195bc9b4dbd7f2b87 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
W20260709 13:06:25.527504 19374 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.4:43121, user_credentials={real_user=slave}} blocked reactor thread for 275291us
I20260709 13:06:25.529722 19409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab43d85f64114d4ebf618930e43d9ed0" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:06:25.531162 19479 raft_consensus.cc:2468] T 2725d2c4cb054f18b0fc8f735c15f6c2 P 0473d2b2d01f4459b1e90fd12cc7840e [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 16.
W20260709 13:06:25.531852 19523 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:25.533413 19524 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:25.571616 19524 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:25.576753 19552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c5eebf646ad445a9d1b1adc319d7b16" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:06:25.577530 19552 raft_consensus.cc:3060] T 6c5eebf646ad445a9d1b1adc319d7b16 P e61c3a8f61bb48f8a963c9480e53c168 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:06:25.578516 19553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65d8cb8d6ec64f459d5a47cefab10acf" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:06:25.531805 19560 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40438 (request call id 2536) took 1006 ms. Trace:
I20260709 13:06:25.539083 19404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "309c3ca0ca4b4f3ba129752ea2cb293b" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:06:25.579380 19560 rpcz_store.cc:276] 0709 13:06:24.525844 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:24.606436 (+ 80592us) service_pool.cc:224] Handling call
0709 13:06:24.618692 (+ 12256us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:24.619194 (+   502us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:24.619234 (+    40us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:24.620228 (+   994us) log.cc:844] Serialized 26 byte log entry
0709 13:06:24.967054 (+346826us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:06:25.209011 (+241957us) log.cc:844] Serialized 14 byte log entry
0709 13:06:25.251514 (+ 42503us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:25.252292 (+   778us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:25.252347 (+    55us) raft_consensus.cc:1685] finished
0709 13:06:25.252359 (+    12us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:25.531730 (+279371us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":20735,"raft.run_cpu_time_us":20679,"raft.run_wall_time_us":263238,"thread_start_us":568978,"threads_started":2,"wal-append.queue_time_us":467879}
I20260709 13:06:25.539227 24318 raft_consensus.cc:493] T 48824d5acfbc485ebf8c2d944e7202de P e61c3a8f61bb48f8a963c9480e53c168 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:25.540370 19402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f575b143b844aa096b50997dad3516a" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:06:25.541074 19403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ece3db938bc649d4a40a51522ed5259c" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:06:25.565176 19410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9f0d59553ad444883fcf5b5909f9798" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:06:25.554484 19375 leader_election.cc:304] T 85c494af21f9457a85da47b9bc70c1fd P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:06:25.584184 19409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2725d2c4cb054f18b0fc8f735c15f6c2" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:06:25.569455 19307 catalog_manager.cc:5697] T b08304a0a02b42d7840c4e8ee9a6bd1a P 0473d2b2d01f4459b1e90fd12cc7840e reported cstate change: term changed from 9 to 12. New cstate: current_term: 12 leader_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } health_report { overall_health: HEALTHY } } }
I20260709 13:06:25.584856 19409 raft_consensus.cc:2468] T 2725d2c4cb054f18b0fc8f735c15f6c2 P e5256d91808b47c195bc9b4dbd7f2b87 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 16.
I20260709 13:06:25.539577 24412 raft_consensus.cc:2804] T ff9b0eddd810459b82d91c60777c10eb P e5256d91808b47c195bc9b4dbd7f2b87 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:06:25.595034 19375 leader_election.cc:304] T fa731b585f684a7fb2d106c50f143b83 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168; no voters: 127766fc592545a4997f7790f50f6076
I20260709 13:06:25.596554 19307 catalog_manager.cc:5697] T ef32ce6fdd0e40d382c79974f30295c6 P 0473d2b2d01f4459b1e90fd12cc7840e reported cstate change: term changed from 11 to 12, leader changed from e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1) to e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3). New cstate: current_term: 12 leader_uuid: "e61c3a8f61bb48f8a963c9480e53c168" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } }
I20260709 13:06:25.585680 19409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b74109013a140ada21feeef92d6f563" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:06:25.598749 19409 raft_consensus.cc:2468] T 2b74109013a140ada21feeef92d6f563 P e5256d91808b47c195bc9b4dbd7f2b87 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 10.
I20260709 13:06:25.539532 24253 raft_consensus.cc:493] T 0e1085d23e8347fbbd5bce7542f4b1f4 P 127766fc592545a4997f7790f50f6076 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 0473d2b2d01f4459b1e90fd12cc7840e)
I20260709 13:06:25.587539 19403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dc5b3532fe54f74876d02beffa2c230" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:06:25.602706 19404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22196caba61445d3bec98a0aab3c337d" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
I20260709 13:06:25.607621 19553 raft_consensus.cc:1275] T ab43d85f64114d4ebf618930e43d9ed0 P e61c3a8f61bb48f8a963c9480e53c168 [term 14 FOLLOWER]: Refusing update from remote peer 127766fc592545a4997f7790f50f6076: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 13:06:25.610538 19411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a16f7501e2444fb86d4e2778e734e02" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:06:25.613379 19523 leader_election.cc:304] T 40e1e16737a842ee936002830f36882e P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e61c3a8f61bb48f8a963c9480e53c168; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87
W20260709 13:06:25.614223 20075 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.1:40321, user_credentials={real_user=slave}} blocked reactor thread for 49306us
I20260709 13:06:25.603031 19403 raft_consensus.cc:2468] T 1dc5b3532fe54f74876d02beffa2c230 P e5256d91808b47c195bc9b4dbd7f2b87 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 14.
W20260709 13:06:25.617676 20078 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:25.629778 19404 raft_consensus.cc:2393] T 22196caba61445d3bec98a0aab3c337d P e5256d91808b47c195bc9b4dbd7f2b87 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate e61c3a8f61bb48f8a963c9480e53c168 in current term 12: Already voted for candidate e5256d91808b47c195bc9b4dbd7f2b87 in this term.
I20260709 13:06:25.631939 19409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc225c93219c45538b53a1bd3d387e4d" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:06:25.638048 19403 raft_consensus.cc:1275] T fa8650e71aa14778b3d73721fc50d9fc P e5256d91808b47c195bc9b4dbd7f2b87 [term 13 FOLLOWER]: Refusing update from remote peer 0473d2b2d01f4459b1e90fd12cc7840e: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 13 index: 7. (index mismatch)
I20260709 13:06:25.640511 19404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a61655d99124a29b486ba4a5b37faea" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
I20260709 13:06:25.641829 19409 raft_consensus.cc:2393] T bc225c93219c45538b53a1bd3d387e4d P e5256d91808b47c195bc9b4dbd7f2b87 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e61c3a8f61bb48f8a963c9480e53c168 in current term 12: Already voted for candidate e5256d91808b47c195bc9b4dbd7f2b87 in this term.
I20260709 13:06:25.594074 24412 raft_consensus.cc:493] T ff9b0eddd810459b82d91c60777c10eb P e5256d91808b47c195bc9b4dbd7f2b87 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:25.613008 24388 raft_consensus.cc:2804] T 85c494af21f9457a85da47b9bc70c1fd P e5256d91808b47c195bc9b4dbd7f2b87 [term 12 FOLLOWER]: Leader pre-election won for term 13
W20260709 13:06:25.635035 24443 log.cc:927] Time spent T 2a16f7501e2444fb86d4e2778e734e02 P e5256d91808b47c195bc9b4dbd7f2b87: Append to log took a long time: real 0.070s	user 0.000s	sys 0.000s
I20260709 13:06:25.628286 24458 raft_consensus.cc:2804] T fa731b585f684a7fb2d106c50f143b83 P e5256d91808b47c195bc9b4dbd7f2b87 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:06:25.650408 19307 catalog_manager.cc:5697] T b9f0d59553ad444883fcf5b5909f9798 P 0473d2b2d01f4459b1e90fd12cc7840e reported cstate change: term changed from 8 to 11, leader changed from e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3) to 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2). New cstate: current_term: 11 leader_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:25.593089 24183 raft_consensus.cc:515] T edd7d470b5014c9489be7f41f64355c9 P 0473d2b2d01f4459b1e90fd12cc7840e [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:25.600955 24318 raft_consensus.cc:515] T 48824d5acfbc485ebf8c2d944e7202de P e61c3a8f61bb48f8a963c9480e53c168 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:25.628547 24253 raft_consensus.cc:515] T 0e1085d23e8347fbbd5bce7542f4b1f4 P 127766fc592545a4997f7790f50f6076 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
W20260709 13:06:25.674614 19377 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:25.655045 24190 raft_consensus.cc:3060] T 70797e5783b5454ab0d0eea663e791e3 P 127766fc592545a4997f7790f50f6076 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:06:25.654836 24412 raft_consensus.cc:3060] T ff9b0eddd810459b82d91c60777c10eb P e5256d91808b47c195bc9b4dbd7f2b87 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:06:25.657052 24388 raft_consensus.cc:493] T 85c494af21f9457a85da47b9bc70c1fd P e5256d91808b47c195bc9b4dbd7f2b87 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 127766fc592545a4997f7790f50f6076)
I20260709 13:06:25.659178 24411 raft_consensus.cc:493] T a08760e15aac4630a629431f56024dc8 P e5256d91808b47c195bc9b4dbd7f2b87 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:25.658740 24458 raft_consensus.cc:493] T fa731b585f684a7fb2d106c50f143b83 P e5256d91808b47c195bc9b4dbd7f2b87 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 127766fc592545a4997f7790f50f6076)
I20260709 13:06:25.699910 19558 raft_consensus.cc:1275] T 48824d5acfbc485ebf8c2d944e7202de P e61c3a8f61bb48f8a963c9480e53c168 [term 15 FOLLOWER]: Refusing update from remote peer 127766fc592545a4997f7790f50f6076: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 13:06:25.690656 19307 catalog_manager.cc:5697] T 7be9efa6559648dbb5a0f7684c4542d1 P 0473d2b2d01f4459b1e90fd12cc7840e reported cstate change: term changed from 7 to 11, leader changed from e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3) to 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2), now has a pending config: VOTER e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1), VOTER 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2), VOTER e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3), VOTER 127766fc592545a4997f7790f50f6076 (127.17.223.4). New cstate: current_term: 11 leader_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: NON_VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: true } health_report { overall_health: UNKNOWN } } } pending_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } attrs { replace: true } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } } }
W20260709 13:06:25.693758 24267 consensus_meta.cc:287] T 1f85fc4b527a48848e5faa083b604e36 P 127766fc592545a4997f7790f50f6076: Time spent flushing consensus metadata: real 0.511s	user 0.006s	sys 0.007s
I20260709 13:06:25.702410 19307 catalog_manager.cc:5697] T 0e1085d23e8347fbbd5bce7542f4b1f4 P 0473d2b2d01f4459b1e90fd12cc7840e reported cstate change: term changed from 6 to 8. New cstate: current_term: 8 leader_uuid: "e61c3a8f61bb48f8a963c9480e53c168" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } } }
I20260709 13:06:25.708425 20106 raft_consensus.cc:1240] T 6c5eebf646ad445a9d1b1adc319d7b16 P 127766fc592545a4997f7790f50f6076 [term 13 FOLLOWER]: Rejecting Update request from peer 0473d2b2d01f4459b1e90fd12cc7840e for earlier term 12. Current term is 13. Ops: []
I20260709 13:06:25.694872 24388 raft_consensus.cc:3060] T 85c494af21f9457a85da47b9bc70c1fd P e5256d91808b47c195bc9b4dbd7f2b87 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:06:25.697356 24458 raft_consensus.cc:3060] T fa731b585f684a7fb2d106c50f143b83 P e5256d91808b47c195bc9b4dbd7f2b87 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:06:25.727257 19524 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:25.727733 19449 leader_election.cc:304] T a08760e15aac4630a629431f56024dc8 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87; no voters: 
I20260709 13:06:25.728843 19449 leader_election.cc:304] T 3e1f505cb0f1427bbd698ac889d80821 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87; no voters: e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:06:25.736608 19552 raft_consensus.cc:2468] T 6c5eebf646ad445a9d1b1adc319d7b16 P e61c3a8f61bb48f8a963c9480e53c168 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 127766fc592545a4997f7790f50f6076 in term 13.
I20260709 13:06:25.698907 24411 raft_consensus.cc:515] T a08760e15aac4630a629431f56024dc8 P e5256d91808b47c195bc9b4dbd7f2b87 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
W20260709 13:06:25.734767 24461 log.cc:927] Time spent T ab43d85f64114d4ebf618930e43d9ed0 P 127766fc592545a4997f7790f50f6076: Append to log took a long time: real 0.211s	user 0.000s	sys 0.001s
I20260709 13:06:25.722918 24387 raft_consensus.cc:493] T ab43d85f64114d4ebf618930e43d9ed0 P 0473d2b2d01f4459b1e90fd12cc7840e [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 127766fc592545a4997f7790f50f6076)
I20260709 13:06:25.722467 24306 leader_election.cc:290] T 4509b76741dc428e9201c70c1658da13 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 9 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
W20260709 13:06:25.744140 24421 consensus_meta.cc:287] T 76cb037fc9064d13b59a8969d897ce8c P 0473d2b2d01f4459b1e90fd12cc7840e: Time spent flushing consensus metadata: real 0.591s	user 0.012s	sys 0.005s
I20260709 13:06:25.742658 24276 raft_consensus.cc:2804] T a08760e15aac4630a629431f56024dc8 P 0473d2b2d01f4459b1e90fd12cc7840e [term 16 FOLLOWER]: Leader pre-election won for term 17
W20260709 13:06:25.767037 19450 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.3:36891, user_credentials={real_user=slave}} blocked reactor thread for 207018us
I20260709 13:06:25.769292 19307 catalog_manager.cc:5697] T 172b3dd13109415a955b71ac0e9d2234 P 0473d2b2d01f4459b1e90fd12cc7840e reported cstate change: term changed from 8 to 9, leader changed from e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1) to 127766fc592545a4997f7790f50f6076 (127.17.223.4). New cstate: current_term: 9 leader_uuid: "127766fc592545a4997f7790f50f6076" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } } }
I20260709 13:06:25.745707 24481 raft_consensus.cc:493] T 0e1085d23e8347fbbd5bce7542f4b1f4 P e61c3a8f61bb48f8a963c9480e53c168 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 0473d2b2d01f4459b1e90fd12cc7840e)
I20260709 13:06:25.756656 24466 raft_consensus.cc:2804] T 3e1f505cb0f1427bbd698ac889d80821 P 0473d2b2d01f4459b1e90fd12cc7840e [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:06:25.776419 19450 leader_election.cc:304] T 1efebf73c86e432baa55533136b6e12c P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e; no voters: 127766fc592545a4997f7790f50f6076, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:06:25.777455 20075 leader_election.cc:304] T 65d8cb8d6ec64f459d5a47cefab10acf P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 127766fc592545a4997f7790f50f6076, e5256d91808b47c195bc9b4dbd7f2b87; no voters: 
W20260709 13:06:25.787189 19523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.1:40321, user_credentials={real_user=slave}} blocked reactor thread for 173956us
I20260709 13:06:25.789374 19523 leader_election.cc:304] T 76cb037fc9064d13b59a8969d897ce8c P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e61c3a8f61bb48f8a963c9480e53c168; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:06:25.790407 19523 leader_election.cc:304] T 217b5fae677b4971b3bbd2f357a1f7ff P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168; no voters: 0473d2b2d01f4459b1e90fd12cc7840e
I20260709 13:06:25.764015 24276 raft_consensus.cc:493] T a08760e15aac4630a629431f56024dc8 P 0473d2b2d01f4459b1e90fd12cc7840e [term 16 FOLLOWER]: Starting leader election (detected failure of leader e61c3a8f61bb48f8a963c9480e53c168)
I20260709 13:06:25.812080 19307 catalog_manager.cc:5697] T 0afb57ae58a24a01850491d69f0213dd P 0473d2b2d01f4459b1e90fd12cc7840e reported cstate change: term changed from 7 to 10, leader changed from 127766fc592545a4997f7790f50f6076 (127.17.223.4) to 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2). New cstate: current_term: 10 leader_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:06:25.816660 19523 leader_election.cc:400] T 833a2f0775ed407a94b8924ce50adb63 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 12 pre-election: Vote denied by peer e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321) with higher term. Message: Invalid argument: T 833a2f0775ed407a94b8924ce50adb63 P e5256d91808b47c195bc9b4dbd7f2b87 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e61c3a8f61bb48f8a963c9480e53c168 for earlier term 12. Current term is 13.
I20260709 13:06:25.817010 19523 leader_election.cc:403] T 833a2f0775ed407a94b8924ce50adb63 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 12 pre-election: Cancelling election due to peer responding with higher term
W20260709 13:06:25.820078 19450 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.3:36891, user_credentials={real_user=slave}} blocked reactor thread for 43740.8us
I20260709 13:06:25.824352 19377 leader_election.cc:304] T 179fd671030940b4b4a4e24bcc4aba0a P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168
W20260709 13:06:25.826835 19524 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:25.827433 19523 leader_election.cc:304] T fa731b585f684a7fb2d106c50f143b83 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e61c3a8f61bb48f8a963c9480e53c168; no voters: 127766fc592545a4997f7790f50f6076, e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:06:25.826839 19480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef32ce6fdd0e40d382c79974f30295c6" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:06:25.833153 19557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4509b76741dc428e9201c70c1658da13" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:06:25.775673 24476 raft_consensus.cc:2749] T 40e1e16737a842ee936002830f36882e P e61c3a8f61bb48f8a963c9480e53c168 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:06:25.763526 24421 raft_consensus.cc:515] T 76cb037fc9064d13b59a8969d897ce8c P 0473d2b2d01f4459b1e90fd12cc7840e [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:25.838395 19307 catalog_manager.cc:5697] T 86a6797bdfe94fa496c050ceae4bd0d9 P 0473d2b2d01f4459b1e90fd12cc7840e reported cstate change: term changed from 4 to 10, leader changed from e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3) to 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2). New cstate: current_term: 10 leader_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } health_report { overall_health: HEALTHY } } }
I20260709 13:06:25.837945 19556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a61655d99124a29b486ba4a5b37faea" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:06:25.803409 24466 raft_consensus.cc:493] T 3e1f505cb0f1427bbd698ac889d80821 P 0473d2b2d01f4459b1e90fd12cc7840e [term 14 FOLLOWER]: Starting leader election (detected failure of leader e61c3a8f61bb48f8a963c9480e53c168)
W20260709 13:06:25.818046 24464 log.cc:927] Time spent T 96efeaaf1057492490e9a621f37e1a2d P 0473d2b2d01f4459b1e90fd12cc7840e: Append to log took a long time: real 0.162s	user 0.000s	sys 0.001s
I20260709 13:06:25.753364 24387 raft_consensus.cc:515] T ab43d85f64114d4ebf618930e43d9ed0 P 0473d2b2d01f4459b1e90fd12cc7840e [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } attrs { replace: true } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:25.834916 24397 raft_consensus.cc:2749] T 1efebf73c86e432baa55533136b6e12c P 0473d2b2d01f4459b1e90fd12cc7840e [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:06:25.855190 19560 raft_consensus.cc:1240] T 6c5eebf646ad445a9d1b1adc319d7b16 P e61c3a8f61bb48f8a963c9480e53c168 [term 13 FOLLOWER]: Rejecting Update request from peer 0473d2b2d01f4459b1e90fd12cc7840e for earlier term 12. Current term is 13. Ops: []
I20260709 13:06:25.820750 24276 raft_consensus.cc:3060] T a08760e15aac4630a629431f56024dc8 P 0473d2b2d01f4459b1e90fd12cc7840e [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:06:25.826325 19377 leader_election.cc:304] T 9962423cb4e54fcfa5de01daf68a86e7 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87; no voters: 127766fc592545a4997f7790f50f6076
W20260709 13:06:25.857517 19449 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.1:40321, user_credentials={real_user=slave}} blocked reactor thread for 114952us
I20260709 13:06:25.823647 24306 raft_consensus.cc:493] T fa8650e71aa14778b3d73721fc50d9fc P e61c3a8f61bb48f8a963c9480e53c168 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:06:25.856431 20075 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.1:40321, user_credentials={real_user=slave}} blocked reactor thread for 79070.8us
I20260709 13:06:25.859515 19480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "775c229504194560ba9589bc2199b089" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:06:25.860960 19479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df751f992649444090e27965eb1af85d" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 17 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:06:25.862038 19484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc225c93219c45538b53a1bd3d387e4d" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:06:25.882035 19484 raft_consensus.cc:1240] T 1a61655d99124a29b486ba4a5b37faea P 0473d2b2d01f4459b1e90fd12cc7840e [term 11 FOLLOWER]: Rejecting Update request from peer e5256d91808b47c195bc9b4dbd7f2b87 for earlier term 10. Current term is 11. Ops: []
I20260709 13:06:25.862645 19483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e381f1d6b8184797ad142de49be225a8" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:06:25.776777 24390 raft_consensus.cc:493] T 0afb57ae58a24a01850491d69f0213dd P 127766fc592545a4997f7790f50f6076 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 0473d2b2d01f4459b1e90fd12cc7840e)
I20260709 13:06:25.834051 24372 raft_consensus.cc:493] T f93ee515a9c14139bf566522ed8232f3 P e5256d91808b47c195bc9b4dbd7f2b87 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 0473d2b2d01f4459b1e90fd12cc7840e)
I20260709 13:06:25.870316 19477 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "46c5bfeecc314717bffe987e6844b6d0"
dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
 from {username='slave'} at 127.0.0.1:58294
I20260709 13:06:25.870954 19482 raft_consensus.cc:1240] T 76cb037fc9064d13b59a8969d897ce8c P 0473d2b2d01f4459b1e90fd12cc7840e [term 12 FOLLOWER]: Rejecting Update request from peer e5256d91808b47c195bc9b4dbd7f2b87 for earlier term 11. Current term is 12. Ops: []
W20260709 13:06:25.874488 19377 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.2:46257, user_credentials={real_user=slave}} blocked reactor thread for 48233.4us
I20260709 13:06:25.885460 19477 raft_consensus.cc:493] T 46c5bfeecc314717bffe987e6844b6d0 P 0473d2b2d01f4459b1e90fd12cc7840e [term 18 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:06:25.875662 19307 catalog_manager.cc:5697] T df751f992649444090e27965eb1af85d P 0473d2b2d01f4459b1e90fd12cc7840e reported cstate change: term changed from 5 to 13, leader changed from e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3) to 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2). New cstate: current_term: 13 leader_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:25.781423 24481 raft_consensus.cc:515] T 0e1085d23e8347fbbd5bce7542f4b1f4 P e61c3a8f61bb48f8a963c9480e53c168 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:25.847456 24183 leader_election.cc:290] T edd7d470b5014c9489be7f41f64355c9 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 15 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:06:25.874969 19449 leader_election.cc:304] T 1dc5b3532fe54f74876d02beffa2c230 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87; no voters: e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:06:25.883615 19483 raft_consensus.cc:1240] T edd7d470b5014c9489be7f41f64355c9 P 0473d2b2d01f4459b1e90fd12cc7840e [term 15 FOLLOWER]: Rejecting Update request from peer e5256d91808b47c195bc9b4dbd7f2b87 for earlier term 14. Current term is 15. Ops: []
I20260709 13:06:25.884074 19485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b08304a0a02b42d7840c4e8ee9a6bd1a" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:06:25.884749 19481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c5eebf646ad445a9d1b1adc319d7b16" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:06:25.885802 19477 raft_consensus.cc:3060] T 46c5bfeecc314717bffe987e6844b6d0 P 0473d2b2d01f4459b1e90fd12cc7840e [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:06:25.885792 19377 leader_election.cc:304] T 22196caba61445d3bec98a0aab3c337d P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87; no voters: e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:06:25.858220 24466 raft_consensus.cc:3060] T 3e1f505cb0f1427bbd698ac889d80821 P 0473d2b2d01f4459b1e90fd12cc7840e [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:06:25.905879 19560 raft_consensus.cc:1275] T 96efeaaf1057492490e9a621f37e1a2d P e61c3a8f61bb48f8a963c9480e53c168 [term 15 FOLLOWER]: Refusing update from remote peer 0473d2b2d01f4459b1e90fd12cc7840e: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 13:06:25.891398 24494 raft_consensus.cc:2749] T fa731b585f684a7fb2d106c50f143b83 P e61c3a8f61bb48f8a963c9480e53c168 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:06:25.891963 19526 leader_election.cc:304] T 1dc5b3532fe54f74876d02beffa2c230 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:06:25.893227 19484 raft_consensus.cc:1275] T 48824d5acfbc485ebf8c2d944e7202de P 0473d2b2d01f4459b1e90fd12cc7840e [term 15 FOLLOWER]: Refusing update from remote peer 127766fc592545a4997f7790f50f6076: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 13:06:25.899636 19483 raft_consensus.cc:1275] T ab43d85f64114d4ebf618930e43d9ed0 P 0473d2b2d01f4459b1e90fd12cc7840e [term 14 FOLLOWER]: Refusing update from remote peer 127766fc592545a4997f7790f50f6076: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 13:06:25.849444 24487 raft_consensus.cc:2749] T 179fd671030940b4b4a4e24bcc4aba0a P e5256d91808b47c195bc9b4dbd7f2b87 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
W20260709 13:06:25.868637 24467 log.cc:927] Time spent T 85c494af21f9457a85da47b9bc70c1fd P e5256d91808b47c195bc9b4dbd7f2b87: Append to log took a long time: real 0.174s	user 0.001s	sys 0.001s
I20260709 13:06:25.907588 19449 leader_election.cc:304] T 172b3dd13109415a955b71ac0e9d2234 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e; no voters: 127766fc592545a4997f7790f50f6076, e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:06:25.911473 24497 consensus_queue.cc:1048] T df751f992649444090e27965eb1af85d P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:06:25.871794 24318 leader_election.cc:290] T 48824d5acfbc485ebf8c2d944e7202de P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:06:25.877579 24476 raft_consensus.cc:2804] T 217b5fae677b4971b3bbd2f357a1f7ff P e61c3a8f61bb48f8a963c9480e53c168 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:06:25.872030 24484 raft_consensus.cc:2749] T 76cb037fc9064d13b59a8969d897ce8c P e61c3a8f61bb48f8a963c9480e53c168 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:06:25.933018 19554 raft_consensus.cc:1240] T ff75a1d4cb1f493db8f71ddc136ba9ab P e61c3a8f61bb48f8a963c9480e53c168 [term 14 FOLLOWER]: Rejecting Update request from peer e5256d91808b47c195bc9b4dbd7f2b87 for earlier term 13. Current term is 14. Ops: [13.7-13.7]
I20260709 13:06:25.868222 24478 consensus_queue.cc:1059] T 21e14947d70440f19044d8f75c31e1f9 P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 }, Status: INVALID_TERM, Last received: 13.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.051s
I20260709 13:06:25.906306 24305 raft_consensus.cc:2804] T 22196caba61445d3bec98a0aab3c337d P e5256d91808b47c195bc9b4dbd7f2b87 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:06:25.885752 24457 raft_consensus.cc:2804] T 9962423cb4e54fcfa5de01daf68a86e7 P e5256d91808b47c195bc9b4dbd7f2b87 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:06:25.940989 19560 raft_consensus.cc:1240] T 4509b76741dc428e9201c70c1658da13 P e61c3a8f61bb48f8a963c9480e53c168 [term 9 FOLLOWER]: Rejecting Update request from peer e5256d91808b47c195bc9b4dbd7f2b87 for earlier term 8. Current term is 9. Ops: []
I20260709 13:06:25.902138 24482 raft_consensus.cc:2804] T 65d8cb8d6ec64f459d5a47cefab10acf P 127766fc592545a4997f7790f50f6076 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:06:25.914992 24393 raft_consensus.cc:493] T 14efcc79969f41babe5529c22d59156d P e5256d91808b47c195bc9b4dbd7f2b87 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:25.930176 24183 raft_consensus.cc:2804] T 1dc5b3532fe54f74876d02beffa2c230 P 0473d2b2d01f4459b1e90fd12cc7840e [term 14 FOLLOWER]: Leader election won for term 14
W20260709 13:06:25.943586 19526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.2:46257, user_credentials={real_user=slave}} blocked reactor thread for 51688.2us
I20260709 13:06:25.900004 24306 raft_consensus.cc:515] T fa8650e71aa14778b3d73721fc50d9fc P e61c3a8f61bb48f8a963c9480e53c168 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:25.929895 24476 raft_consensus.cc:493] T 217b5fae677b4971b3bbd2f357a1f7ff P e61c3a8f61bb48f8a963c9480e53c168 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 0473d2b2d01f4459b1e90fd12cc7840e)
I20260709 13:06:25.904898 24372 raft_consensus.cc:515] T f93ee515a9c14139bf566522ed8232f3 P e5256d91808b47c195bc9b4dbd7f2b87 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:25.947571 19449 leader_election.cc:304] T 2725d2c4cb054f18b0fc8f735c15f6c2 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e; no voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:06:25.948283 19483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e1085d23e8347fbbd5bce7542f4b1f4" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
W20260709 13:06:25.949218 19524 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:25.949357 19523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.1:40321, user_credentials={real_user=slave}} blocked reactor thread for 94456.9us
I20260709 13:06:25.956329 19523 leader_election.cc:304] T 14935b3ddf914369822e4a0547aaa355 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: e61c3a8f61bb48f8a963c9480e53c168; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87
W20260709 13:06:25.944499 24475 log.cc:927] Time spent T df751f992649444090e27965eb1af85d P 0473d2b2d01f4459b1e90fd12cc7840e: Append to log took a long time: real 0.192s	user 0.000s	sys 0.001s
I20260709 13:06:25.936403 24492 raft_consensus.cc:493] T 172b3dd13109415a955b71ac0e9d2234 P e5256d91808b47c195bc9b4dbd7f2b87 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 127766fc592545a4997f7790f50f6076)
I20260709 13:06:25.942842 24484 raft_consensus.cc:2804] T 1dc5b3532fe54f74876d02beffa2c230 P e61c3a8f61bb48f8a963c9480e53c168 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:06:25.974346 19557 raft_consensus.cc:1275] T fa8650e71aa14778b3d73721fc50d9fc P e61c3a8f61bb48f8a963c9480e53c168 [term 13 FOLLOWER]: Refusing update from remote peer 0473d2b2d01f4459b1e90fd12cc7840e: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 13 index: 7. (index mismatch)
I20260709 13:06:25.901899 24390 raft_consensus.cc:515] T 0afb57ae58a24a01850491d69f0213dd P 127766fc592545a4997f7790f50f6076 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:25.943512 24457 raft_consensus.cc:493] T 9962423cb4e54fcfa5de01daf68a86e7 P e5256d91808b47c195bc9b4dbd7f2b87 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 127766fc592545a4997f7790f50f6076)
W20260709 13:06:25.966114 24477 log.cc:927] Time spent T a08760e15aac4630a629431f56024dc8 P 0473d2b2d01f4459b1e90fd12cc7840e: Append to log took a long time: real 0.119s	user 0.000s	sys 0.001s
I20260709 13:06:25.967787 24372 leader_election.cc:290] T f93ee515a9c14139bf566522ed8232f3 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:06:25.969261 24183 raft_consensus.cc:697] T 1dc5b3532fe54f74876d02beffa2c230 P 0473d2b2d01f4459b1e90fd12cc7840e [term 14 LEADER]: Becoming Leader. State: Replica: 0473d2b2d01f4459b1e90fd12cc7840e, State: Running, Role: LEADER
I20260709 13:06:25.953197 24485 raft_consensus.cc:493] T 48824d5acfbc485ebf8c2d944e7202de P 0473d2b2d01f4459b1e90fd12cc7840e [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:06:26.013790 24472 log.cc:927] Time spent T 833a2f0775ed407a94b8924ce50adb63 P 127766fc592545a4997f7790f50f6076: Append to log took a long time: real 0.362s	user 0.002s	sys 0.000s
I20260709 13:06:25.970839 24397 raft_consensus.cc:2749] T 2725d2c4cb054f18b0fc8f735c15f6c2 P 0473d2b2d01f4459b1e90fd12cc7840e [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:06:25.972572 24253 leader_election.cc:290] T 0e1085d23e8347fbbd5bce7542f4b1f4 P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:06:25.945693 24305 raft_consensus.cc:697] T 22196caba61445d3bec98a0aab3c337d P e5256d91808b47c195bc9b4dbd7f2b87 [term 12 LEADER]: Becoming Leader. State: Replica: e5256d91808b47c195bc9b4dbd7f2b87, State: Running, Role: LEADER
I20260709 13:06:25.987160 19556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edd7d470b5014c9489be7f41f64355c9" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:06:25.983731 19523 leader_election.cc:304] T 46c5bfeecc314717bffe987e6844b6d0 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e61c3a8f61bb48f8a963c9480e53c168; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87
W20260709 13:06:26.005510 20078 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.2:46257, user_credentials={real_user=slave}} blocked reactor thread for 48647.7us
I20260709 13:06:26.232434 24504 raft_consensus.cc:2749] T 14935b3ddf914369822e4a0547aaa355 P e61c3a8f61bb48f8a963c9480e53c168 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:06:25.957638 24486 raft_consensus.cc:2749] T 833a2f0775ed407a94b8924ce50adb63 P e61c3a8f61bb48f8a963c9480e53c168 [term 13 FOLLOWER]: Leader pre-election lost for term 12. Reason: Vote denied by peer e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321) with higher term. Message: Invalid argument: T 833a2f0775ed407a94b8924ce50adb63 P e5256d91808b47c195bc9b4dbd7f2b87 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e61c3a8f61bb48f8a963c9480e53c168 for earlier term 12. Current term is 13.
I20260709 13:06:26.227521 24466 raft_consensus.cc:515] T 3e1f505cb0f1427bbd698ac889d80821 P 0473d2b2d01f4459b1e90fd12cc7840e [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:26.345916 24466 leader_election.cc:290] T 3e1f505cb0f1427bbd698ac889d80821 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 15 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:06:26.238929 19405 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49050 (request call id 860) took 1107 ms. Trace:
I20260709 13:06:26.346577 19405 rpcz_store.cc:276] 0709 13:06:25.131458 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:25.131607 (+   149us) service_pool.cc:224] Handling call
0709 13:06:25.143055 (+ 11448us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:25.143492 (+   437us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 13:06:25.168780 (+ 25288us) log.cc:844] Serialized 14 byte log entry
0709 13:06:25.532007 (+363227us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:25.532543 (+   536us) log.cc:844] Serialized 26 byte log entry
0709 13:06:25.532711 (+   168us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:06:25.532755 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:25.532839 (+    84us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:26.238744 (+705905us) raft_consensus.cc:1685] finished
0709 13:06:26.238764 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:26.238879 (+   115us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":12969,"prepare.queue_time_us":26397,"prepare.run_cpu_time_us":33,"prepare.run_wall_time_us":34,"raft.queue_time_us":143095,"raft.run_cpu_time_us":187,"raft.run_wall_time_us":12122,"thread_start_us":226133,"threads_started":1,"wal-append.queue_time_us":502530}
I20260709 13:06:26.237895 19559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a08760e15aac4630a629431f56024dc8" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:06:25.957417 23933 raft_consensus.cc:2749] T 172b3dd13109415a955b71ac0e9d2234 P 0473d2b2d01f4459b1e90fd12cc7840e [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:06:25.957377 24476 raft_consensus.cc:3060] T 217b5fae677b4971b3bbd2f357a1f7ff P e61c3a8f61bb48f8a963c9480e53c168 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:06:26.003214 24055 consensus_queue.cc:1048] T ff9b0eddd810459b82d91c60777c10eb P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.036s
I20260709 13:06:25.974484 24484 raft_consensus.cc:493] T 1dc5b3532fe54f74876d02beffa2c230 P e61c3a8f61bb48f8a963c9480e53c168 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:26.355758 24484 raft_consensus.cc:3060] T 1dc5b3532fe54f74876d02beffa2c230 P e61c3a8f61bb48f8a963c9480e53c168 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:06:25.953408 24481 leader_election.cc:290] T 0e1085d23e8347fbbd5bce7542f4b1f4 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:06:25.986794 24492 raft_consensus.cc:515] T 172b3dd13109415a955b71ac0e9d2234 P e5256d91808b47c195bc9b4dbd7f2b87 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
W20260709 13:06:26.018936 19524 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:26.233561 24485 raft_consensus.cc:515] T 48824d5acfbc485ebf8c2d944e7202de P 0473d2b2d01f4459b1e90fd12cc7840e [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:25.974321 24411 leader_election.cc:290] T a08760e15aac4630a629431f56024dc8 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:06:25.947337 24393 raft_consensus.cc:515] T 14efcc79969f41babe5529c22d59156d P e5256d91808b47c195bc9b4dbd7f2b87 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:26.251978 19551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f93ee515a9c14139bf566522ed8232f3" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 16 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:06:26.230573 24387 leader_election.cc:290] T ab43d85f64114d4ebf618930e43d9ed0 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
W20260709 13:06:26.181843 19450 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.3:36891, user_credentials={real_user=slave}} blocked reactor thread for 216542us
I20260709 13:06:26.363993 19450 leader_election.cc:304] T 4509b76741dc428e9201c70c1658da13 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e; no voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168
W20260709 13:06:26.233178 24190 consensus_meta.cc:287] T 70797e5783b5454ab0d0eea663e791e3 P 127766fc592545a4997f7790f50f6076: Time spent flushing consensus metadata: real 0.539s	user 0.011s	sys 0.003s
I20260709 13:06:26.254853 19477 raft_consensus.cc:515] T 46c5bfeecc314717bffe987e6844b6d0 P 0473d2b2d01f4459b1e90fd12cc7840e [term 19 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:26.342111 24276 raft_consensus.cc:515] T a08760e15aac4630a629431f56024dc8 P 0473d2b2d01f4459b1e90fd12cc7840e [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:26.383062 19477 leader_election.cc:290] T 46c5bfeecc314717bffe987e6844b6d0 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 19 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
W20260709 13:06:26.331354 19449 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.1:40321, user_credentials={real_user=slave}} blocked reactor thread for 357941us
W20260709 13:06:26.332834 19375 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.3:36891, user_credentials={real_user=slave}} blocked reactor thread for 79171.9us
W20260709 13:06:26.333889 20078 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:26.229471 24388 consensus_meta.cc:287] T 85c494af21f9457a85da47b9bc70c1fd P e5256d91808b47c195bc9b4dbd7f2b87: Time spent flushing consensus metadata: real 0.508s	user 0.003s	sys 0.015s
I20260709 13:06:26.262765 24373 consensus_queue.cc:1059] T ff75a1d4cb1f493db8f71ddc136ba9ab P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.076s
I20260709 13:06:26.010468 24457 raft_consensus.cc:3060] T 9962423cb4e54fcfa5de01daf68a86e7 P e5256d91808b47c195bc9b4dbd7f2b87 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:06:26.323455 24390 leader_election.cc:290] T 0afb57ae58a24a01850491d69f0213dd P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:06:26.390379 20106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "172b3dd13109415a955b71ac0e9d2234" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:06:26.392443 19551 raft_consensus.cc:1275] T 21e14947d70440f19044d8f75c31e1f9 P e61c3a8f61bb48f8a963c9480e53c168 [term 14 FOLLOWER]: Refusing update from remote peer e5256d91808b47c195bc9b4dbd7f2b87: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 13:06:26.384141 24497 raft_consensus.cc:2749] T 46c5bfeecc314717bffe987e6844b6d0 P e61c3a8f61bb48f8a963c9480e53c168 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:06:26.376606 24481 raft_consensus.cc:493] T 65d8cb8d6ec64f459d5a47cefab10acf P e61c3a8f61bb48f8a963c9480e53c168 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader e5256d91808b47c195bc9b4dbd7f2b87)
I20260709 13:06:26.323602 24183 consensus_queue.cc:237] T 1dc5b3532fe54f74876d02beffa2c230 P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.6, Last appended by leader: 6, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:26.395401 24507 raft_consensus.cc:493] T 86a6797bdfe94fa496c050ceae4bd0d9 P e5256d91808b47c195bc9b4dbd7f2b87 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 0473d2b2d01f4459b1e90fd12cc7840e)
I20260709 13:06:26.396143 24485 leader_election.cc:290] T 48824d5acfbc485ebf8c2d944e7202de P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:06:26.387737 24492 leader_election.cc:290] T 172b3dd13109415a955b71ac0e9d2234 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:06:26.378396 24495 raft_consensus.cc:493] T 96efeaaf1057492490e9a621f37e1a2d P e61c3a8f61bb48f8a963c9480e53c168 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:26.400261 19449 leader_election.cc:304] T 2e36a9d6e29c4a7c860cf267efbd4c74 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e; no voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:06:26.391780 23933 raft_consensus.cc:2749] T 4509b76741dc428e9201c70c1658da13 P 0473d2b2d01f4459b1e90fd12cc7840e [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:06:26.404556 24278 raft_consensus.cc:493] T 1f85fc4b527a48848e5faa083b604e36 P 127766fc592545a4997f7790f50f6076 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:06:26.417078 24458 consensus_meta.cc:287] T fa731b585f684a7fb2d106c50f143b83 P e5256d91808b47c195bc9b4dbd7f2b87: Time spent flushing consensus metadata: real 0.683s	user 0.005s	sys 0.008s
I20260709 13:06:26.414624 24482 raft_consensus.cc:697] T 65d8cb8d6ec64f459d5a47cefab10acf P 127766fc592545a4997f7790f50f6076 [term 14 LEADER]: Becoming Leader. State: Replica: 127766fc592545a4997f7790f50f6076, State: Running, Role: LEADER
I20260709 13:06:26.398236 24388 raft_consensus.cc:515] T 85c494af21f9457a85da47b9bc70c1fd P e5256d91808b47c195bc9b4dbd7f2b87 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:26.406828 24481 raft_consensus.cc:515] T 65d8cb8d6ec64f459d5a47cefab10acf P e61c3a8f61bb48f8a963c9480e53c168 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:26.412139 24190 consensus_queue.cc:1048] T 48824d5acfbc485ebf8c2d944e7202de P 127766fc592545a4997f7790f50f6076 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.019s
I20260709 13:06:26.413198 24479 consensus_queue.cc:1059] T 6c5eebf646ad445a9d1b1adc319d7b16 P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 }, Status: INVALID_TERM, Last received: 12.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.022s
I20260709 13:06:26.415392 24390 consensus_queue.cc:1048] T ab43d85f64114d4ebf618930e43d9ed0 P 127766fc592545a4997f7790f50f6076 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.018s
I20260709 13:06:26.450158 24276 leader_election.cc:290] T a08760e15aac4630a629431f56024dc8 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 17 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:06:26.433359 24387 raft_consensus.cc:2749] T 2e36a9d6e29c4a7c860cf267efbd4c74 P 0473d2b2d01f4459b1e90fd12cc7840e [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:06:26.411551 24507 raft_consensus.cc:515] T 86a6797bdfe94fa496c050ceae4bd0d9 P e5256d91808b47c195bc9b4dbd7f2b87 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:26.468130 24507 leader_election.cc:290] T 86a6797bdfe94fa496c050ceae4bd0d9 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:06:26.447492 24413 raft_consensus.cc:493] T 7be9efa6559648dbb5a0f7684c4542d1 P 127766fc592545a4997f7790f50f6076 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 0473d2b2d01f4459b1e90fd12cc7840e)
I20260709 13:06:26.425068 24422 consensus_queue.cc:1048] T 96efeaaf1057492490e9a621f37e1a2d P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.018s
I20260709 13:06:26.469197 24413 raft_consensus.cc:515] T 7be9efa6559648dbb5a0f7684c4542d1 P 127766fc592545a4997f7790f50f6076 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } attrs { replace: true } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:26.472582 24481 leader_election.cc:290] T 65d8cb8d6ec64f459d5a47cefab10acf P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:06:26.475874 24482 consensus_queue.cc:237] T 65d8cb8d6ec64f459d5a47cefab10acf P 127766fc592545a4997f7790f50f6076 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:26.435349 24458 raft_consensus.cc:515] T fa731b585f684a7fb2d106c50f143b83 P e5256d91808b47c195bc9b4dbd7f2b87 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:26.421293 24305 consensus_queue.cc:237] T 22196caba61445d3bec98a0aab3c337d P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:26.479593 24458 leader_election.cc:290] T fa731b585f684a7fb2d106c50f143b83 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 11 election: Requested vote from peers e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:06:26.427614 24278 raft_consensus.cc:515] T 1f85fc4b527a48848e5faa083b604e36 P 127766fc592545a4997f7790f50f6076 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:26.481320 24388 leader_election.cc:290] T 85c494af21f9457a85da47b9bc70c1fd P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 13 election: Requested vote from peers e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:06:26.481694 24278 leader_election.cc:290] T 1f85fc4b527a48848e5faa083b604e36 P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321)
I20260709 13:06:26.443516 24306 leader_election.cc:290] T fa8650e71aa14778b3d73721fc50d9fc P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:06:26.419138 24495 raft_consensus.cc:515] T 96efeaaf1057492490e9a621f37e1a2d P e61c3a8f61bb48f8a963c9480e53c168 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:26.499820 24413 leader_election.cc:290] T 7be9efa6559648dbb5a0f7684c4542d1 P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
W20260709 13:06:26.497298 24412 consensus_meta.cc:287] T ff9b0eddd810459b82d91c60777c10eb P e5256d91808b47c195bc9b4dbd7f2b87: Time spent flushing consensus metadata: real 0.800s	user 0.011s	sys 0.009s
I20260709 13:06:26.509677 24505 raft_consensus.cc:3055] T 6c5eebf646ad445a9d1b1adc319d7b16 P 0473d2b2d01f4459b1e90fd12cc7840e [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:06:26.509346 24412 raft_consensus.cc:515] T ff9b0eddd810459b82d91c60777c10eb P e5256d91808b47c195bc9b4dbd7f2b87 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:26.510205 24505 raft_consensus.cc:740] T 6c5eebf646ad445a9d1b1adc319d7b16 P 0473d2b2d01f4459b1e90fd12cc7840e [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 0473d2b2d01f4459b1e90fd12cc7840e, State: Running, Role: LEADER
I20260709 13:06:26.511303 24505 consensus_queue.cc:260] T 6c5eebf646ad445a9d1b1adc319d7b16 P 0473d2b2d01f4459b1e90fd12cc7840e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:26.512205 24412 leader_election.cc:290] T ff9b0eddd810459b82d91c60777c10eb P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 15 election: Requested vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:06:26.512777 24505 raft_consensus.cc:3060] T 6c5eebf646ad445a9d1b1adc319d7b16 P 0473d2b2d01f4459b1e90fd12cc7840e [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:06:26.493748 24393 leader_election.cc:290] T 14efcc79969f41babe5529c22d59156d P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
W20260709 13:06:26.507099 24493 log.cc:927] Time spent T 833a2f0775ed407a94b8924ce50adb63 P e61c3a8f61bb48f8a963c9480e53c168: Append to log took a long time: real 0.278s	user 0.002s	sys 0.002s
I20260709 13:06:26.506255 24495 leader_election.cc:290] T 96efeaaf1057492490e9a621f37e1a2d P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:06:26.514220 24476 raft_consensus.cc:515] T 217b5fae677b4971b3bbd2f357a1f7ff P e61c3a8f61bb48f8a963c9480e53c168 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:26.527860 24421 leader_election.cc:290] T 76cb037fc9064d13b59a8969d897ce8c P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 12 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:06:26.527848 24476 leader_election.cc:290] T 217b5fae677b4971b3bbd2f357a1f7ff P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 11 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:06:26.530277 24484 raft_consensus.cc:515] T 1dc5b3532fe54f74876d02beffa2c230 P e61c3a8f61bb48f8a963c9480e53c168 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:26.533285 24484 leader_election.cc:290] T 1dc5b3532fe54f74876d02beffa2c230 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 15 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:06:26.601545 19405 raft_consensus.cc:1240] T 85c494af21f9457a85da47b9bc70c1fd P e5256d91808b47c195bc9b4dbd7f2b87 [term 13 FOLLOWER]: Rejecting Update request from peer 127766fc592545a4997f7790f50f6076 for earlier term 12. Current term is 13. Ops: []
W20260709 13:06:26.603366 19449 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.1:40321, user_credentials={real_user=slave}} blocked reactor thread for 204510us
I20260709 13:06:26.601570 19409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f85fc4b527a48848e5faa083b604e36" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:06:26.608445 19409 raft_consensus.cc:2468] T 1f85fc4b527a48848e5faa083b604e36 P e5256d91808b47c195bc9b4dbd7f2b87 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 127766fc592545a4997f7790f50f6076 in term 12.
I20260709 13:06:26.608881 19449 leader_election.cc:304] T 7f575b143b844aa096b50997dad3516a P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e; no voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:06:26.609266 19480 raft_consensus.cc:3055] T 21e14947d70440f19044d8f75c31e1f9 P 0473d2b2d01f4459b1e90fd12cc7840e [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:06:26.609741 19480 raft_consensus.cc:740] T 21e14947d70440f19044d8f75c31e1f9 P 0473d2b2d01f4459b1e90fd12cc7840e [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 0473d2b2d01f4459b1e90fd12cc7840e, State: Running, Role: LEADER
I20260709 13:06:26.610641 19408 raft_consensus.cc:1240] T fa731b585f684a7fb2d106c50f143b83 P e5256d91808b47c195bc9b4dbd7f2b87 [term 11 FOLLOWER]: Rejecting Update request from peer 127766fc592545a4997f7790f50f6076 for earlier term 10. Current term is 11. Ops: []
I20260709 13:06:26.611742 19449 leader_election.cc:304] T 40e1e16737a842ee936002830f36882e P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e; no voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:06:26.611635 19480 consensus_queue.cc:260] T 21e14947d70440f19044d8f75c31e1f9 P 0473d2b2d01f4459b1e90fd12cc7840e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:26.613592 19480 raft_consensus.cc:3060] T 21e14947d70440f19044d8f75c31e1f9 P 0473d2b2d01f4459b1e90fd12cc7840e [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:06:26.614068 19411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7be9efa6559648dbb5a0f7684c4542d1" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:06:26.614988 19449 leader_election.cc:304] T 1f85fc4b527a48848e5faa083b604e36 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e; no voters: 127766fc592545a4997f7790f50f6076, e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:06:26.615152 19411 raft_consensus.cc:2468] T 7be9efa6559648dbb5a0f7684c4542d1 P e5256d91808b47c195bc9b4dbd7f2b87 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 127766fc592545a4997f7790f50f6076 in term 13.
W20260709 13:06:26.601696 19450 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.3:36891, user_credentials={real_user=slave}} blocked reactor thread for 180204us
I20260709 13:06:26.622746 19486 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58286 (request call id 2213) took 1392 ms. Trace:
I20260709 13:06:26.623257 19486 rpcz_store.cc:276] 0709 13:06:25.230110 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:25.234822 (+  4712us) service_pool.cc:224] Handling call
0709 13:06:25.235102 (+   280us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:25.527213 (+292111us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:06:25.529025 (+  1812us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:25.530149 (+  1124us) log.cc:844] Serialized 26 byte log entry
0709 13:06:25.690737 (+160588us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:06:25.691848 (+  1111us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:25.692126 (+   278us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:26.516115 (+823989us) spinlock_profiling.cc:243] Waited 4.96 ms on lock 0x7b2400275ca8. stack: 00007f4a79de9343 00007f4a79de9240 00007f4a797781d4 00007f4a834b6304 00007f4a834b6299 00007f4a79ca3db1 00007f4a79ca19c4 00007f4a79c9facb 00007f4a79e5adc9 00007f4a79e5aa55 00007f4a79e59fb0 00007f4a7cad0488 00007f4a7cad0be8 00007f4a7caa8398 00007f4a7caa376a 00007f4a7caa2bb6
0709 13:06:26.621935 (+105820us) raft_consensus.cc:1685] finished
0709 13:06:26.621978 (+    43us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:26.622427 (+   449us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":4383,"raft.queue_time_us":316606,"raft.run_cpu_time_us":122,"raft.run_wall_time_us":10424,"spinlock_wait_cycles":11402112,"thread_start_us":317826,"threads_started":2,"wal-append.queue_time_us":272226}
I20260709 13:06:26.628716 19449 leader_election.cc:304] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e; no voters: 127766fc592545a4997f7790f50f6076, e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:06:26.630991 19449 leader_election.cc:304] T df751f992649444090e27965eb1af85d P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87; no voters: e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:06:26.635280 19449 leader_election.cc:304] T 1a61655d99124a29b486ba4a5b37faea P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e; no voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:06:26.637144 19377 leader_election.cc:304] T ef32ce6fdd0e40d382c79974f30295c6 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168
W20260709 13:06:26.639390 19524 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:26.640863 19523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.1:40321, user_credentials={real_user=slave}} blocked reactor thread for 657832us
I20260709 13:06:26.642532 19523 leader_election.cc:304] T f93ee515a9c14139bf566522ed8232f3 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e61c3a8f61bb48f8a963c9480e53c168; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:06:26.649235 19551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85c494af21f9457a85da47b9bc70c1fd" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:06:26.650305 19552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46c5bfeecc314717bffe987e6844b6d0" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 19 candidate_status { last_received { term: 18 index: 8 } } ignore_live_leader: true dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:06:26.651119 19552 raft_consensus.cc:3060] T 46c5bfeecc314717bffe987e6844b6d0 P e61c3a8f61bb48f8a963c9480e53c168 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:06:26.651008 19551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a08760e15aac4630a629431f56024dc8" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:06:26.652658 19523 leader_election.cc:304] T 21e14947d70440f19044d8f75c31e1f9 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e61c3a8f61bb48f8a963c9480e53c168; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:06:26.653380 19551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76cb037fc9064d13b59a8969d897ce8c" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:06:26.655764 19551 raft_consensus.cc:1240] T 21e14947d70440f19044d8f75c31e1f9 P e61c3a8f61bb48f8a963c9480e53c168 [term 14 FOLLOWER]: Rejecting Update request from peer 0473d2b2d01f4459b1e90fd12cc7840e for earlier term 13. Current term is 14. Ops: []
I20260709 13:06:26.656338 19523 leader_election.cc:304] T 70797e5783b5454ab0d0eea663e791e3 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e61c3a8f61bb48f8a963c9480e53c168; no voters: 127766fc592545a4997f7790f50f6076, e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:06:26.661972 19557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa731b585f684a7fb2d106c50f143b83" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:06:26.664410 19558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab43d85f64114d4ebf618930e43d9ed0" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:06:26.665542 19554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48824d5acfbc485ebf8c2d944e7202de" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 16 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:06:26.666543 19554 raft_consensus.cc:2468] T 48824d5acfbc485ebf8c2d944e7202de P e61c3a8f61bb48f8a963c9480e53c168 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 15.
I20260709 13:06:26.667117 24476 raft_consensus.cc:2749] T f93ee515a9c14139bf566522ed8232f3 P e61c3a8f61bb48f8a963c9480e53c168 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:06:26.667986 19555 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41504 (request call id 763) took 1078 ms. Trace:
I20260709 13:06:26.667868 24362 consensus_queue.cc:1059] T 4509b76741dc428e9201c70c1658da13 P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:06:26.668468 24476 raft_consensus.cc:2749] T 21e14947d70440f19044d8f75c31e1f9 P e61c3a8f61bb48f8a963c9480e53c168 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:06:26.669374 24476 raft_consensus.cc:2749] T 70797e5783b5454ab0d0eea663e791e3 P e61c3a8f61bb48f8a963c9480e53c168 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:06:26.670034 19559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86a6797bdfe94fa496c050ceae4bd0d9" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:06:26.671022 19377 leader_election.cc:304] T 775c229504194560ba9589bc2199b089 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, 127766fc592545a4997f7790f50f6076
I20260709 13:06:26.671521 24370 consensus_queue.cc:1048] T 21e14947d70440f19044d8f75c31e1f9 P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:06:26.673887 19377 leader_election.cc:304] T bc225c93219c45538b53a1bd3d387e4d P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:06:26.674556 24372 raft_consensus.cc:493] T f1b10566f45d4a7d9029858330e02d5b P e5256d91808b47c195bc9b4dbd7f2b87 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 0473d2b2d01f4459b1e90fd12cc7840e)
I20260709 13:06:26.675644 24372 raft_consensus.cc:515] T f1b10566f45d4a7d9029858330e02d5b P e5256d91808b47c195bc9b4dbd7f2b87 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:26.676683 24388 raft_consensus.cc:2749] T ef32ce6fdd0e40d382c79974f30295c6 P e5256d91808b47c195bc9b4dbd7f2b87 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:06:26.665560 19558 raft_consensus.cc:2468] T ab43d85f64114d4ebf618930e43d9ed0 P e61c3a8f61bb48f8a963c9480e53c168 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 14.
I20260709 13:06:26.688895 19552 raft_consensus.cc:2468] T 46c5bfeecc314717bffe987e6844b6d0 P e61c3a8f61bb48f8a963c9480e53c168 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 19.
I20260709 13:06:26.694864 19480 raft_consensus.cc:1275] T 21e14947d70440f19044d8f75c31e1f9 P 0473d2b2d01f4459b1e90fd12cc7840e [term 14 FOLLOWER]: Refusing update from remote peer e5256d91808b47c195bc9b4dbd7f2b87: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 13:06:26.700057 24411 raft_consensus.cc:3055] T 4509b76741dc428e9201c70c1658da13 P e5256d91808b47c195bc9b4dbd7f2b87 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:06:26.700667 24411 raft_consensus.cc:740] T 4509b76741dc428e9201c70c1658da13 P e5256d91808b47c195bc9b4dbd7f2b87 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: e5256d91808b47c195bc9b4dbd7f2b87, State: Running, Role: LEADER
I20260709 13:06:26.704613 24394 raft_consensus.cc:493] T b9f0d59553ad444883fcf5b5909f9798 P e5256d91808b47c195bc9b4dbd7f2b87 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 0473d2b2d01f4459b1e90fd12cc7840e)
W20260709 13:06:26.705199 19523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.1:40321, user_credentials={real_user=slave}} blocked reactor thread for 49075.8us
I20260709 13:06:26.705250 20105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff9b0eddd810459b82d91c60777c10eb" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076"
I20260709 13:06:26.705588 24394 raft_consensus.cc:515] T b9f0d59553ad444883fcf5b5909f9798 P e5256d91808b47c195bc9b4dbd7f2b87 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:26.706401 20105 raft_consensus.cc:3060] T ff9b0eddd810459b82d91c60777c10eb P 127766fc592545a4997f7790f50f6076 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:06:26.707243 24422 raft_consensus.cc:2749] T 7f575b143b844aa096b50997dad3516a P 0473d2b2d01f4459b1e90fd12cc7840e [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:06:26.707789 24465 raft_consensus.cc:2749] T 40e1e16737a842ee936002830f36882e P 0473d2b2d01f4459b1e90fd12cc7840e [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:06:26.708427 24394 leader_election.cc:290] T b9f0d59553ad444883fcf5b5909f9798 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:06:26.708226 24494 consensus_queue.cc:1048] T 3e1f505cb0f1427bbd698ac889d80821 P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:06:26.711174 24466 raft_consensus.cc:3060] T 1f85fc4b527a48848e5faa083b604e36 P 0473d2b2d01f4459b1e90fd12cc7840e [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:06:26.711402 24387 raft_consensus.cc:2804] T df751f992649444090e27965eb1af85d P 0473d2b2d01f4459b1e90fd12cc7840e [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:06:26.712030 24387 raft_consensus.cc:493] T df751f992649444090e27965eb1af85d P 0473d2b2d01f4459b1e90fd12cc7840e [term 16 FOLLOWER]: Starting leader election (detected failure of leader e61c3a8f61bb48f8a963c9480e53c168)
I20260709 13:06:26.712499 24387 raft_consensus.cc:3060] T df751f992649444090e27965eb1af85d P 0473d2b2d01f4459b1e90fd12cc7840e [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:06:26.712738 24474 consensus_queue.cc:1059] T b08304a0a02b42d7840c4e8ee9a6bd1a P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 }, Status: INVALID_TERM, Last received: 12.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:06:26.714277 24474 raft_consensus.cc:2749] T 1a61655d99124a29b486ba4a5b37faea P 0473d2b2d01f4459b1e90fd12cc7840e [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:06:26.715118 24485 consensus_queue.cc:1048] T fa8650e71aa14778b3d73721fc50d9fc P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:06:26.716821 24397 raft_consensus.cc:3055] T b08304a0a02b42d7840c4e8ee9a6bd1a P 0473d2b2d01f4459b1e90fd12cc7840e [term 12 LEADER]: Stepping down as leader of term 12
W20260709 13:06:26.716981 24490 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 14 current term: 14 is higher.
I20260709 13:06:26.717316 24397 raft_consensus.cc:740] T b08304a0a02b42d7840c4e8ee9a6bd1a P 0473d2b2d01f4459b1e90fd12cc7840e [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 0473d2b2d01f4459b1e90fd12cc7840e, State: Running, Role: LEADER
I20260709 13:06:26.718900 20103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14efcc79969f41babe5529c22d59156d" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:06:26.719863 20103 raft_consensus.cc:2468] T 14efcc79969f41babe5529c22d59156d P 127766fc592545a4997f7790f50f6076 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 15.
I20260709 13:06:26.720319 19556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e1f505cb0f1427bbd698ac889d80821" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:06:26.721329 20075 leader_election.cc:304] T 1f85fc4b527a48848e5faa083b604e36 P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 127766fc592545a4997f7790f50f6076, e5256d91808b47c195bc9b4dbd7f2b87; no voters: 
I20260709 13:06:26.721472 20111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85c494af21f9457a85da47b9bc70c1fd" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076"
I20260709 13:06:26.723613 24372 leader_election.cc:290] T f1b10566f45d4a7d9029858330e02d5b P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:06:26.711695 24473 consensus_queue.cc:1059] T 179fd671030940b4b4a4e24bcc4aba0a P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 }, Status: INVALID_TERM, Last received: 14.9, Next index: 10, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:06:26.723505 20106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa731b585f684a7fb2d106c50f143b83" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076"
I20260709 13:06:26.712805 24276 consensus_queue.cc:1059] T bc225c93219c45538b53a1bd3d387e4d P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
W20260709 13:06:26.730216 19377 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.2:46257, user_credentials={real_user=slave}} blocked reactor thread for 56634us
I20260709 13:06:26.702121 24411 consensus_queue.cc:260] T 4509b76741dc428e9201c70c1658da13 P e5256d91808b47c195bc9b4dbd7f2b87 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:26.731158 24457 raft_consensus.cc:515] T 9962423cb4e54fcfa5de01daf68a86e7 P e5256d91808b47c195bc9b4dbd7f2b87 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:26.732162 19377 leader_election.cc:304] T e381f1d6b8184797ad142de49be225a8 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:06:26.733543 19407 raft_consensus.cc:1240] T 9962423cb4e54fcfa5de01daf68a86e7 P e5256d91808b47c195bc9b4dbd7f2b87 [term 12 FOLLOWER]: Rejecting Update request from peer 127766fc592545a4997f7790f50f6076 for earlier term 11. Current term is 12. Ops: []
W20260709 13:06:26.735284 19450 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:26.734439 24374 raft_consensus.cc:2749] T bc225c93219c45538b53a1bd3d387e4d P e5256d91808b47c195bc9b4dbd7f2b87 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:06:26.748400 24397 consensus_queue.cc:260] T b08304a0a02b42d7840c4e8ee9a6bd1a P 0473d2b2d01f4459b1e90fd12cc7840e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:26.749382 24492 raft_consensus.cc:2749] T e381f1d6b8184797ad142de49be225a8 P e5256d91808b47c195bc9b4dbd7f2b87 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:06:26.752367 24362 raft_consensus.cc:493] T 217b5fae677b4971b3bbd2f357a1f7ff P e5256d91808b47c195bc9b4dbd7f2b87 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 0473d2b2d01f4459b1e90fd12cc7840e)
I20260709 13:06:26.773736 24397 raft_consensus.cc:3060] T b08304a0a02b42d7840c4e8ee9a6bd1a P 0473d2b2d01f4459b1e90fd12cc7840e [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:06:26.774312 24362 raft_consensus.cc:515] T 217b5fae677b4971b3bbd2f357a1f7ff P e5256d91808b47c195bc9b4dbd7f2b87 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:26.776872 24362 leader_election.cc:290] T 217b5fae677b4971b3bbd2f357a1f7ff P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:06:26.753083 24388 raft_consensus.cc:493] T 3e1f505cb0f1427bbd698ac889d80821 P e5256d91808b47c195bc9b4dbd7f2b87 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:26.777743 24388 raft_consensus.cc:515] T 3e1f505cb0f1427bbd698ac889d80821 P e5256d91808b47c195bc9b4dbd7f2b87 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:26.778331 24276 raft_consensus.cc:3055] T bc225c93219c45538b53a1bd3d387e4d P 0473d2b2d01f4459b1e90fd12cc7840e [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:06:26.778831 24276 raft_consensus.cc:740] T bc225c93219c45538b53a1bd3d387e4d P 0473d2b2d01f4459b1e90fd12cc7840e [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 0473d2b2d01f4459b1e90fd12cc7840e, State: Running, Role: LEADER
I20260709 13:06:26.754474 19377 leader_election.cc:304] T df751f992649444090e27965eb1af85d P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:06:26.780015 24276 consensus_queue.cc:260] T bc225c93219c45538b53a1bd3d387e4d P 0473d2b2d01f4459b1e90fd12cc7840e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:26.783140 24370 raft_consensus.cc:2749] T df751f992649444090e27965eb1af85d P e5256d91808b47c195bc9b4dbd7f2b87 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:06:26.784646 24370 consensus_queue.cc:1059] T 1a61655d99124a29b486ba4a5b37faea P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:06:26.787427 24141 consensus_queue.cc:1059] T fa731b585f684a7fb2d106c50f143b83 P 127766fc592545a4997f7790f50f6076 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:06:26.788251 24370 raft_consensus.cc:3055] T 1a61655d99124a29b486ba4a5b37faea P e5256d91808b47c195bc9b4dbd7f2b87 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:06:26.788739 24370 raft_consensus.cc:740] T 1a61655d99124a29b486ba4a5b37faea P e5256d91808b47c195bc9b4dbd7f2b87 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: e5256d91808b47c195bc9b4dbd7f2b87, State: Running, Role: LEADER
I20260709 13:06:26.789104 24190 raft_consensus.cc:3055] T fa731b585f684a7fb2d106c50f143b83 P 127766fc592545a4997f7790f50f6076 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:06:26.757706 19374 leader_election.cc:304] T 14efcc79969f41babe5529c22d59156d P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 127766fc592545a4997f7790f50f6076, e5256d91808b47c195bc9b4dbd7f2b87; no voters: 
I20260709 13:06:26.789558 24190 raft_consensus.cc:740] T fa731b585f684a7fb2d106c50f143b83 P 127766fc592545a4997f7790f50f6076 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 127766fc592545a4997f7790f50f6076, State: Running, Role: LEADER
I20260709 13:06:26.754952 24412 raft_consensus.cc:2749] T 775c229504194560ba9589bc2199b089 P e5256d91808b47c195bc9b4dbd7f2b87 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:06:26.734509 24457 leader_election.cc:290] T 9962423cb4e54fcfa5de01daf68a86e7 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 12 election: Requested vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:06:26.711225 24471 raft_consensus.cc:3060] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P 0473d2b2d01f4459b1e90fd12cc7840e [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:06:26.791023 19556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1b10566f45d4a7d9029858330e02d5b" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:06:26.790840 24190 consensus_queue.cc:260] T fa731b585f684a7fb2d106c50f143b83 P 127766fc592545a4997f7790f50f6076 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:26.739434 24473 raft_consensus.cc:3055] T 179fd671030940b4b4a4e24bcc4aba0a P 0473d2b2d01f4459b1e90fd12cc7840e [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:06:26.791939 19377 leader_election.cc:304] T b08304a0a02b42d7840c4e8ee9a6bd1a P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:06:26.792430 24473 raft_consensus.cc:740] T 179fd671030940b4b4a4e24bcc4aba0a P 0473d2b2d01f4459b1e90fd12cc7840e [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 0473d2b2d01f4459b1e90fd12cc7840e, State: Running, Role: LEADER
I20260709 13:06:26.792972 24492 consensus_queue.cc:1059] T edd7d470b5014c9489be7f41f64355c9 P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 }, Status: INVALID_TERM, Last received: 14.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:06:26.793697 24473 consensus_queue.cc:260] T 179fd671030940b4b4a4e24bcc4aba0a P 0473d2b2d01f4459b1e90fd12cc7840e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:26.764518 24517 consensus_queue.cc:1048] T a08760e15aac4630a629431f56024dc8 P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:06:26.795089 24492 raft_consensus.cc:2749] T b08304a0a02b42d7840c4e8ee9a6bd1a P e5256d91808b47c195bc9b4dbd7f2b87 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:06:26.766068 19523 leader_election.cc:304] T 179fd671030940b4b4a4e24bcc4aba0a P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e61c3a8f61bb48f8a963c9480e53c168; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:06:26.796258 24492 raft_consensus.cc:3055] T edd7d470b5014c9489be7f41f64355c9 P e5256d91808b47c195bc9b4dbd7f2b87 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:06:26.796751 24492 raft_consensus.cc:740] T edd7d470b5014c9489be7f41f64355c9 P e5256d91808b47c195bc9b4dbd7f2b87 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: e5256d91808b47c195bc9b4dbd7f2b87, State: Running, Role: LEADER
I20260709 13:06:26.797657 19523 leader_election.cc:304] T e381f1d6b8184797ad142de49be225a8 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e61c3a8f61bb48f8a963c9480e53c168; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:06:26.767401 19552 raft_consensus.cc:1240] T ff75a1d4cb1f493db8f71ddc136ba9ab P e61c3a8f61bb48f8a963c9480e53c168 [term 14 FOLLOWER]: Rejecting Update request from peer e5256d91808b47c195bc9b4dbd7f2b87 for earlier term 13. Current term is 14. Ops: [13.7-13.7]
I20260709 13:06:26.768277 19560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9f0d59553ad444883fcf5b5909f9798" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:06:26.668432 19555 rpcz_store.cc:276] 0709 13:06:25.589575 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:25.589716 (+   141us) service_pool.cc:224] Handling call
0709 13:06:25.590118 (+   402us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:25.677372 (+ 87254us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:25.677430 (+    58us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:25.677901 (+   471us) log.cc:844] Serialized 26 byte log entry
0709 13:06:25.945440 (+267539us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:06:25.945730 (+   290us) log.cc:844] Serialized 14 byte log entry
0709 13:06:25.954381 (+  8651us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:25.954452 (+    71us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:26.478507 (+524055us) spinlock_profiling.cc:243] Waited 3.52 ms on lock 0x7b18000f1e40. stack: 00007f4a79de9343 00007f4a79de9240 00007f4a797781d4 00007f4a834b6304 00007f4a834b6299 00007f4a82ce3de1 00007f4a82cf05b1 00007f4a79e1b3f3 00007f4a79e1d7c1 00007f4a79e1d779 00007f4a79e1d709 00007f4a79e1d6d1 00007f4a79e1c9cd 000000000038f354 000000000038f199 00007f4a79dfe83a
0709 13:06:26.506433 (+ 27926us) spinlock_profiling.cc:243] Waited 43.7 ms on lock 0x7b4400022b4c. stack: 00007f4a79de9343 00007f4a79de9240 00007f4a797781d4 00007f4a834b6304 00007f4a834b6299 00007f4a79ca3db1 00007f4a79d41c85 00007f4a79d426a2 00007f4a7cab41db 00007f4a7caafaaf 00007f4a7caa386e 00007f4a7caa2bb6 00007f4a7caa27d8 00007f4a7caac221 00007f4a7caac1d9 00007f4a7caac169
0709 13:06:26.667494 (+161061us) raft_consensus.cc:1685] finished
0709 13:06:26.667540 (+    46us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:26.667789 (+   249us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":11097,"prepare.queue_time_us":92,"prepare.run_cpu_time_us":56,"prepare.run_wall_time_us":4294,"raft.queue_time_us":182686,"raft.run_cpu_time_us":232,"raft.run_wall_time_us":12769,"spinlock_wait_cycles":108497536,"thread_start_us":354048,"threads_started":2,"wal-append.queue_time_us":336913}
I20260709 13:06:26.769613 24253 raft_consensus.cc:2804] T 1f85fc4b527a48848e5faa083b604e36 P 127766fc592545a4997f7790f50f6076 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:06:26.790375 19374 leader_election.cc:304] T 85c494af21f9457a85da47b9bc70c1fd P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87; no voters: 127766fc592545a4997f7790f50f6076, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:06:26.732024 24411 raft_consensus.cc:3060] T 4509b76741dc428e9201c70c1658da13 P e5256d91808b47c195bc9b4dbd7f2b87 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:06:26.788937 19553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "217b5fae677b4971b3bbd2f357a1f7ff" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:06:26.763041 24433 consensus_queue.cc:1059] T 85c494af21f9457a85da47b9bc70c1fd P 127766fc592545a4997f7790f50f6076 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 }, Status: INVALID_TERM, Last received: 12.11, Next index: 12, Last known committed idx: 10, Time since last communication: 0.001s
W20260709 13:06:26.809221 19449 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.1:40321, user_credentials={real_user=slave}} blocked reactor thread for 171244us
I20260709 13:06:26.799209 24388 leader_election.cc:290] T 3e1f505cb0f1427bbd698ac889d80821 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:06:26.790354 24393 raft_consensus.cc:2804] T 14efcc79969f41babe5529c22d59156d P e5256d91808b47c195bc9b4dbd7f2b87 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:06:26.814529 20106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9962423cb4e54fcfa5de01daf68a86e7" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076"
I20260709 13:06:26.810715 20105 raft_consensus.cc:2468] T ff9b0eddd810459b82d91c60777c10eb P 127766fc592545a4997f7790f50f6076 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 15.
I20260709 13:06:26.817288 19552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e1f505cb0f1427bbd698ac889d80821" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 15 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:06:26.798727 24494 raft_consensus.cc:3060] T 179fd671030940b4b4a4e24bcc4aba0a P e61c3a8f61bb48f8a963c9480e53c168 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:06:26.806123 24253 raft_consensus.cc:493] T 1f85fc4b527a48848e5faa083b604e36 P 127766fc592545a4997f7790f50f6076 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:26.807369 24517 raft_consensus.cc:2749] T e381f1d6b8184797ad142de49be225a8 P e61c3a8f61bb48f8a963c9480e53c168 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:06:26.836395 24387 raft_consensus.cc:515] T df751f992649444090e27965eb1af85d P 0473d2b2d01f4459b1e90fd12cc7840e [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:26.827193 24473 raft_consensus.cc:3060] T 179fd671030940b4b4a4e24bcc4aba0a P 0473d2b2d01f4459b1e90fd12cc7840e [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:06:26.841038 24466 raft_consensus.cc:2749] T 1f85fc4b527a48848e5faa083b604e36 P 0473d2b2d01f4459b1e90fd12cc7840e [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:06:26.842842 19452 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:26.843530 19452 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:26.814554 24393 raft_consensus.cc:493] T 14efcc79969f41babe5529c22d59156d P e5256d91808b47c195bc9b4dbd7f2b87 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:26.846998 24393 raft_consensus.cc:3060] T 14efcc79969f41babe5529c22d59156d P e5256d91808b47c195bc9b4dbd7f2b87 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:06:26.851001 24190 raft_consensus.cc:3060] T fa731b585f684a7fb2d106c50f143b83 P 127766fc592545a4997f7790f50f6076 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:06:26.855680 19377 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.2:46257, user_credentials={real_user=slave}} blocked reactor thread for 63959.6us
I20260709 13:06:26.859923 24141 raft_consensus.cc:3055] T 85c494af21f9457a85da47b9bc70c1fd P 127766fc592545a4997f7790f50f6076 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:06:26.860550 24141 raft_consensus.cc:740] T 85c494af21f9457a85da47b9bc70c1fd P 127766fc592545a4997f7790f50f6076 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 127766fc592545a4997f7790f50f6076, State: Running, Role: LEADER
I20260709 13:06:26.862196 24141 consensus_queue.cc:260] T 85c494af21f9457a85da47b9bc70c1fd P 127766fc592545a4997f7790f50f6076 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:26.864063 19480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a08760e15aac4630a629431f56024dc8" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:06:26.864141 24474 raft_consensus.cc:493] T 14efcc79969f41babe5529c22d59156d P 0473d2b2d01f4459b1e90fd12cc7840e [term 14 FOLLOWER]: Starting pre-election (detected failure of leader e5256d91808b47c195bc9b4dbd7f2b87)
I20260709 13:06:26.864935 24474 raft_consensus.cc:515] T 14efcc79969f41babe5529c22d59156d P 0473d2b2d01f4459b1e90fd12cc7840e [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:26.865833 19482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f93ee515a9c14139bf566522ed8232f3" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 16 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:06:26.867347 19477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "172b3dd13109415a955b71ac0e9d2234" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:06:26.868299 19477 raft_consensus.cc:2468] T 172b3dd13109415a955b71ac0e9d2234 P 0473d2b2d01f4459b1e90fd12cc7840e [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 11.
I20260709 13:06:26.869735 24487 raft_consensus.cc:3055] T ff75a1d4cb1f493db8f71ddc136ba9ab P e5256d91808b47c195bc9b4dbd7f2b87 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:06:26.870302 24487 raft_consensus.cc:740] T ff75a1d4cb1f493db8f71ddc136ba9ab P e5256d91808b47c195bc9b4dbd7f2b87 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: e5256d91808b47c195bc9b4dbd7f2b87, State: Running, Role: LEADER
I20260709 13:06:26.871889 24487 consensus_queue.cc:260] T ff75a1d4cb1f493db8f71ddc136ba9ab P e5256d91808b47c195bc9b4dbd7f2b87 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:26.872731 19484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff9b0eddd810459b82d91c60777c10eb" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:06:26.873382 24487 raft_consensus.cc:3060] T ff75a1d4cb1f493db8f71ddc136ba9ab P e5256d91808b47c195bc9b4dbd7f2b87 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:06:26.869763 19479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86a6797bdfe94fa496c050ceae4bd0d9" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:06:26.870442 19483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14efcc79969f41babe5529c22d59156d" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:06:26.875602 19483 raft_consensus.cc:2468] T 14efcc79969f41babe5529c22d59156d P 0473d2b2d01f4459b1e90fd12cc7840e [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 14.
I20260709 13:06:26.879282 24388 consensus_queue.cc:1059] T 76cb037fc9064d13b59a8969d897ce8c P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 }, Status: INVALID_TERM, Last received: 11.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:06:26.798328 24492 consensus_queue.cc:260] T edd7d470b5014c9489be7f41f64355c9 P e5256d91808b47c195bc9b4dbd7f2b87 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 14.7, Last appended by leader: 7, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:26.879282 24433 raft_consensus.cc:493] T 70797e5783b5454ab0d0eea663e791e3 P 127766fc592545a4997f7790f50f6076 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:26.881045 24433 raft_consensus.cc:515] T 70797e5783b5454ab0d0eea663e791e3 P 127766fc592545a4997f7790f50f6076 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:26.882040 24141 raft_consensus.cc:3060] T 85c494af21f9457a85da47b9bc70c1fd P 127766fc592545a4997f7790f50f6076 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:06:26.881444 24492 raft_consensus.cc:3060] T edd7d470b5014c9489be7f41f64355c9 P e5256d91808b47c195bc9b4dbd7f2b87 [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:06:26.882899 19526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.2:46257, user_credentials={real_user=slave}} blocked reactor thread for 71153.6us
I20260709 13:06:26.825048 24457 raft_consensus.cc:2749] T 85c494af21f9457a85da47b9bc70c1fd P e5256d91808b47c195bc9b4dbd7f2b87 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
W20260709 13:06:26.888243 19374 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.4:43121, user_credentials={real_user=slave}} blocked reactor thread for 97978.1us
I20260709 13:06:26.891325 19374 leader_election.cc:304] T fa731b585f684a7fb2d106c50f143b83 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87; no voters: 127766fc592545a4997f7790f50f6076, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:06:26.892911 19374 leader_election.cc:304] T ff9b0eddd810459b82d91c60777c10eb P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 127766fc592545a4997f7790f50f6076, e5256d91808b47c195bc9b4dbd7f2b87; no voters: 
I20260709 13:06:26.893152 24457 raft_consensus.cc:2749] T fa731b585f684a7fb2d106c50f143b83 P e5256d91808b47c195bc9b4dbd7f2b87 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
W20260709 13:06:26.893846 19523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.1:40321, user_credentials={real_user=slave}} blocked reactor thread for 96339.4us
I20260709 13:06:26.895880 19523 leader_election.cc:304] T 1a61655d99124a29b486ba4a5b37faea P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e61c3a8f61bb48f8a963c9480e53c168; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:06:26.896358 24474 leader_election.cc:290] T 14efcc79969f41babe5529c22d59156d P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:06:26.896957 24484 raft_consensus.cc:2749] T 1a61655d99124a29b486ba4a5b37faea P e61c3a8f61bb48f8a963c9480e53c168 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:06:26.898948 19523 leader_election.cc:304] T ef32ce6fdd0e40d382c79974f30295c6 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e61c3a8f61bb48f8a963c9480e53c168; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:06:26.789870 24370 consensus_queue.cc:260] T 1a61655d99124a29b486ba4a5b37faea P e5256d91808b47c195bc9b4dbd7f2b87 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:26.831580 24253 raft_consensus.cc:3060] T 1f85fc4b527a48848e5faa083b604e36 P 127766fc592545a4997f7790f50f6076 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:06:26.901638 19407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa8650e71aa14778b3d73721fc50d9fc" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
I20260709 13:06:26.904136 19411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9962423cb4e54fcfa5de01daf68a86e7" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:06:26.905793 19408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22196caba61445d3bec98a0aab3c337d" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
W20260709 13:06:26.906786 20075 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:26.911376 19411 raft_consensus.cc:2393] T 9962423cb4e54fcfa5de01daf68a86e7 P e5256d91808b47c195bc9b4dbd7f2b87 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0473d2b2d01f4459b1e90fd12cc7840e in current term 12: Already voted for candidate e5256d91808b47c195bc9b4dbd7f2b87 in this term.
I20260709 13:06:26.885979 24276 raft_consensus.cc:3060] T bc225c93219c45538b53a1bd3d387e4d P 0473d2b2d01f4459b1e90fd12cc7840e [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:06:26.916466 19409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edd7d470b5014c9489be7f41f64355c9" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
I20260709 13:06:26.917753 19406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46c5bfeecc314717bffe987e6844b6d0" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 19 candidate_status { last_received { term: 18 index: 8 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:06:26.917948 19407 raft_consensus.cc:2376] T fa8650e71aa14778b3d73721fc50d9fc P e5256d91808b47c195bc9b4dbd7f2b87 [term 13 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 13. Re-sending same reply.
I20260709 13:06:26.918237 19483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0afb57ae58a24a01850491d69f0213dd" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:06:26.917793 24305 raft_consensus.cc:2804] T ff9b0eddd810459b82d91c60777c10eb P e5256d91808b47c195bc9b4dbd7f2b87 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:06:26.919255 24370 raft_consensus.cc:3060] T 1a61655d99124a29b486ba4a5b37faea P e5256d91808b47c195bc9b4dbd7f2b87 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:06:26.919400 24305 raft_consensus.cc:697] T ff9b0eddd810459b82d91c60777c10eb P e5256d91808b47c195bc9b4dbd7f2b87 [term 15 LEADER]: Becoming Leader. State: Replica: e5256d91808b47c195bc9b4dbd7f2b87, State: Running, Role: LEADER
I20260709 13:06:26.920418 24374 raft_consensus.cc:3055] T 76cb037fc9064d13b59a8969d897ce8c P e5256d91808b47c195bc9b4dbd7f2b87 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:06:26.920840 24374 raft_consensus.cc:740] T 76cb037fc9064d13b59a8969d897ce8c P e5256d91808b47c195bc9b4dbd7f2b87 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: e5256d91808b47c195bc9b4dbd7f2b87, State: Running, Role: LEADER
I20260709 13:06:26.920722 24305 consensus_queue.cc:237] T ff9b0eddd810459b82d91c60777c10eb P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.10, Last appended by leader: 10, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:26.921959 24374 consensus_queue.cc:260] T 76cb037fc9064d13b59a8969d897ce8c P e5256d91808b47c195bc9b4dbd7f2b87 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:26.929438 19402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e5873a19244c5ebbcd38e126796ee7" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
I20260709 13:06:26.929894 24471 raft_consensus.cc:2749] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P 0473d2b2d01f4459b1e90fd12cc7840e [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:06:26.930128 19405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14935b3ddf914369822e4a0547aaa355" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:06:26.930975 19410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ec1c4ce15e04c7e8c283a62179f2a64" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
W20260709 13:06:26.931092 20076 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.3:36891, user_credentials={real_user=slave}} blocked reactor thread for 106457us
I20260709 13:06:26.931808 19403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "309c3ca0ca4b4f3ba129752ea2cb293b" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:06:26.932214 24190 consensus_queue.cc:1059] T 9962423cb4e54fcfa5de01daf68a86e7 P 127766fc592545a4997f7790f50f6076 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:06:26.937500 24484 raft_consensus.cc:3060] T ef32ce6fdd0e40d382c79974f30295c6 P e61c3a8f61bb48f8a963c9480e53c168 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:06:26.943085 18300 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:06:26.951972 24433 leader_election.cc:290] T 70797e5783b5454ab0d0eea663e791e3 P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:06:26.957015 24388 raft_consensus.cc:493] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P e5256d91808b47c195bc9b4dbd7f2b87 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:26.958000 24388 raft_consensus.cc:515] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P e5256d91808b47c195bc9b4dbd7f2b87 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:26.949481 19402 raft_consensus.cc:2376] T d1e5873a19244c5ebbcd38e126796ee7 P e5256d91808b47c195bc9b4dbd7f2b87 [term 15 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 15. Re-sending same reply.
I20260709 13:06:26.978024 19484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f85fc4b527a48848e5faa083b604e36" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:06:26.978704 19484 raft_consensus.cc:2468] T 1f85fc4b527a48848e5faa083b604e36 P 0473d2b2d01f4459b1e90fd12cc7840e [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 127766fc592545a4997f7790f50f6076 in term 12.
I20260709 13:06:26.981248 19477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7be9efa6559648dbb5a0f7684c4542d1" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:06:26.993109 19407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76cb037fc9064d13b59a8969d897ce8c" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
W20260709 13:06:26.995033 19523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.1:40321, user_credentials={real_user=slave}} blocked reactor thread for 96224.8us
I20260709 13:06:26.995987 19523 leader_election.cc:304] T 0cdf56e38bbc453d9438d359e5a69955 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e61c3a8f61bb48f8a963c9480e53c168; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:06:26.999179 24517 raft_consensus.cc:2749] T 0cdf56e38bbc453d9438d359e5a69955 P e61c3a8f61bb48f8a963c9480e53c168 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:06:26.998448 19523 leader_election.cc:304] T 28af091831594f9d8e96482078cc7625 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e61c3a8f61bb48f8a963c9480e53c168; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:06:27.009548 19405 raft_consensus.cc:1240] T ef32ce6fdd0e40d382c79974f30295c6 P e5256d91808b47c195bc9b4dbd7f2b87 [term 16 FOLLOWER]: Rejecting Update request from peer 0473d2b2d01f4459b1e90fd12cc7840e for earlier term 15. Current term is 16. Ops: []
I20260709 13:06:27.010568 19411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab43d85f64114d4ebf618930e43d9ed0" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:06:27.016969 19559 raft_consensus.cc:1240] T 46c5bfeecc314717bffe987e6844b6d0 P e61c3a8f61bb48f8a963c9480e53c168 [term 19 FOLLOWER]: Rejecting Update request from peer e5256d91808b47c195bc9b4dbd7f2b87 for earlier term 18. Current term is 19. Ops: []
I20260709 13:06:27.010847 24362 raft_consensus.cc:493] T d1e5873a19244c5ebbcd38e126796ee7 P e5256d91808b47c195bc9b4dbd7f2b87 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:27.020030 19404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e1f505cb0f1427bbd698ac889d80821" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
I20260709 13:06:27.022382 19404 raft_consensus.cc:3060] T 3e1f505cb0f1427bbd698ac889d80821 P e5256d91808b47c195bc9b4dbd7f2b87 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:06:27.022092 24362 raft_consensus.cc:515] T d1e5873a19244c5ebbcd38e126796ee7 P e5256d91808b47c195bc9b4dbd7f2b87 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:27.023214 24499 raft_consensus.cc:493] T 96efeaaf1057492490e9a621f37e1a2d P 127766fc592545a4997f7790f50f6076 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:27.024513 24362 leader_election.cc:290] T d1e5873a19244c5ebbcd38e126796ee7 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:06:27.026763 24517 raft_consensus.cc:2749] T 28af091831594f9d8e96482078cc7625 P e61c3a8f61bb48f8a963c9480e53c168 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:06:27.031013 19411 raft_consensus.cc:2468] T ab43d85f64114d4ebf618930e43d9ed0 P e5256d91808b47c195bc9b4dbd7f2b87 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 14.
I20260709 13:06:27.032277 24411 consensus_queue.cc:1048] T 21e14947d70440f19044d8f75c31e1f9 P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:06:27.034307 24484 raft_consensus.cc:2749] T ef32ce6fdd0e40d382c79974f30295c6 P e61c3a8f61bb48f8a963c9480e53c168 [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:06:27.035226 19552 raft_consensus.cc:1240] T ef32ce6fdd0e40d382c79974f30295c6 P e61c3a8f61bb48f8a963c9480e53c168 [term 16 FOLLOWER]: Rejecting Update request from peer 0473d2b2d01f4459b1e90fd12cc7840e for earlier term 15. Current term is 16. Ops: []
I20260709 13:06:27.035748 24374 raft_consensus.cc:3060] T 76cb037fc9064d13b59a8969d897ce8c P e5256d91808b47c195bc9b4dbd7f2b87 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:06:27.037251 19449 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:27.040577 19486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48824d5acfbc485ebf8c2d944e7202de" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 16 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:06:27.040519 24253 raft_consensus.cc:515] T 1f85fc4b527a48848e5faa083b604e36 P 127766fc592545a4997f7790f50f6076 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:27.042824 19486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e1085d23e8347fbbd5bce7542f4b1f4" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:06:27.043241 19481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62c6c134d3d24a1ab144dd9ee6bc3f64" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:06:27.050536 19480 raft_consensus.cc:1240] T 3e1f505cb0f1427bbd698ac889d80821 P 0473d2b2d01f4459b1e90fd12cc7840e [term 15 FOLLOWER]: Rejecting Update request from peer e61c3a8f61bb48f8a963c9480e53c168 for earlier term 14. Current term is 15. Ops: []
I20260709 13:06:27.061961 19377 leader_election.cc:304] T a08760e15aac4630a629431f56024dc8 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:06:27.068118 19404 raft_consensus.cc:2468] T 3e1f505cb0f1427bbd698ac889d80821 P e5256d91808b47c195bc9b4dbd7f2b87 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 15.
I20260709 13:06:27.068393 19411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46c5bfeecc314717bffe987e6844b6d0" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 19 candidate_status { last_received { term: 18 index: 8 } } ignore_live_leader: true dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
I20260709 13:06:27.071110 19483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4509b76741dc428e9201c70c1658da13" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:06:27.073379 19405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a08760e15aac4630a629431f56024dc8" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
I20260709 13:06:27.085014 19555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e5873a19244c5ebbcd38e126796ee7" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 16 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:06:27.023813 24499 raft_consensus.cc:515] T 96efeaaf1057492490e9a621f37e1a2d P 127766fc592545a4997f7790f50f6076 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:27.069034 24494 raft_consensus.cc:2749] T 179fd671030940b4b4a4e24bcc4aba0a P e61c3a8f61bb48f8a963c9480e53c168 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:06:27.092559 19480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa8650e71aa14778b3d73721fc50d9fc" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:06:27.078341 24457 raft_consensus.cc:2749] T a08760e15aac4630a629431f56024dc8 P e5256d91808b47c195bc9b4dbd7f2b87 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 13:06:27.094718 20078 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.2:46257, user_credentials={real_user=slave}} blocked reactor thread for 63779.7us
I20260709 13:06:27.097862 19483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96efeaaf1057492490e9a621f37e1a2d" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 16 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:06:27.083878 24253 leader_election.cc:290] T 1f85fc4b527a48848e5faa083b604e36 P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 13 election: Requested vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321)
I20260709 13:06:27.072045 24362 consensus_queue.cc:1059] T 46c5bfeecc314717bffe987e6844b6d0 P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 }, Status: INVALID_TERM, Last received: 18.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.024s
I20260709 13:06:27.106909 19450 leader_election.cc:304] T 48824d5acfbc485ebf8c2d944e7202de P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:06:27.101614 19481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2725d2c4cb054f18b0fc8f735c15f6c2" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:06:27.110263 19555 raft_consensus.cc:2410] T d1e5873a19244c5ebbcd38e126796ee7 P e61c3a8f61bb48f8a963c9480e53c168 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e5256d91808b47c195bc9b4dbd7f2b87 for term 16 because replica has last-logged OpId of term: 14 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 7.
I20260709 13:06:27.111502 19556 raft_consensus.cc:1240] T 217b5fae677b4971b3bbd2f357a1f7ff P e61c3a8f61bb48f8a963c9480e53c168 [term 11 FOLLOWER]: Rejecting Update request from peer 0473d2b2d01f4459b1e90fd12cc7840e for earlier term 10. Current term is 11. Ops: []
I20260709 13:06:27.111749 19486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "217b5fae677b4971b3bbd2f357a1f7ff" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
W20260709 13:06:27.115837 19523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.1:40321, user_credentials={real_user=slave}} blocked reactor thread for 117505us
I20260709 13:06:27.127287 20106 raft_consensus.cc:1240] T ff9b0eddd810459b82d91c60777c10eb P 127766fc592545a4997f7790f50f6076 [term 15 FOLLOWER]: Rejecting Update request from peer 0473d2b2d01f4459b1e90fd12cc7840e for earlier term 14. Current term is 15. Ops: [14.11-14.11]
W20260709 13:06:27.128780 20075 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:27.096875 24471 consensus_queue.cc:1048] T fa8650e71aa14778b3d73721fc50d9fc P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.026s
I20260709 13:06:27.115499 24370 raft_consensus.cc:493] T 28af091831594f9d8e96482078cc7625 P e5256d91808b47c195bc9b4dbd7f2b87 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 0473d2b2d01f4459b1e90fd12cc7840e)
I20260709 13:06:27.128686 19483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dc5b3532fe54f74876d02beffa2c230" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:06:27.125342 19481 raft_consensus.cc:2468] T 2725d2c4cb054f18b0fc8f735c15f6c2 P 0473d2b2d01f4459b1e90fd12cc7840e [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 16.
I20260709 13:06:27.131522 19556 raft_consensus.cc:1275] T 22196caba61445d3bec98a0aab3c337d P e61c3a8f61bb48f8a963c9480e53c168 [term 12 FOLLOWER]: Refusing update from remote peer e5256d91808b47c195bc9b4dbd7f2b87: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:06:27.130740 19405 raft_consensus.cc:3060] T a08760e15aac4630a629431f56024dc8 P e5256d91808b47c195bc9b4dbd7f2b87 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:06:27.168062 19408 raft_consensus.cc:1240] T ff9b0eddd810459b82d91c60777c10eb P e5256d91808b47c195bc9b4dbd7f2b87 [term 15 LEADER]: Rejecting Update request from peer 0473d2b2d01f4459b1e90fd12cc7840e for earlier term 14. Current term is 15. Ops: [14.11-14.11]
I20260709 13:06:27.168407 19410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70797e5783b5454ab0d0eea663e791e3" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:06:27.123764 24397 raft_consensus.cc:2804] T 48824d5acfbc485ebf8c2d944e7202de P 0473d2b2d01f4459b1e90fd12cc7840e [term 15 FOLLOWER]: Leader pre-election won for term 16
W20260709 13:06:27.173751 19450 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.3:36891, user_credentials={real_user=slave}} blocked reactor thread for 45390.7us
I20260709 13:06:27.170857 19410 raft_consensus.cc:2468] T 70797e5783b5454ab0d0eea663e791e3 P e5256d91808b47c195bc9b4dbd7f2b87 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 127766fc592545a4997f7790f50f6076 in term 13.
I20260709 13:06:27.176427 19479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff75a1d4cb1f493db8f71ddc136ba9ab" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 14 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:06:27.177136 19408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f85fc4b527a48848e5faa083b604e36" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
I20260709 13:06:27.177590 19408 raft_consensus.cc:3060] T 1f85fc4b527a48848e5faa083b604e36 P e5256d91808b47c195bc9b4dbd7f2b87 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:06:27.168671 24482 raft_consensus.cc:3055] T 9962423cb4e54fcfa5de01daf68a86e7 P 127766fc592545a4997f7790f50f6076 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:06:27.179724 19377 leader_election.cc:304] T 172b3dd13109415a955b71ac0e9d2234 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87; no voters: 127766fc592545a4997f7790f50f6076
I20260709 13:06:27.167711 24393 raft_consensus.cc:515] T 14efcc79969f41babe5529c22d59156d P e5256d91808b47c195bc9b4dbd7f2b87 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:27.186887 19403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14efcc79969f41babe5529c22d59156d" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:06:27.156064 24388 leader_election.cc:290] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:06:27.174840 24387 leader_election.cc:290] T df751f992649444090e27965eb1af85d P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 17 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:06:27.199828 24362 raft_consensus.cc:493] T 2b74109013a140ada21feeef92d6f563 P e5256d91808b47c195bc9b4dbd7f2b87 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 0473d2b2d01f4459b1e90fd12cc7840e)
I20260709 13:06:27.179239 19450 leader_election.cc:304] T 46c5bfeecc314717bffe987e6844b6d0 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:06:27.207894 19405 raft_consensus.cc:2468] T a08760e15aac4630a629431f56024dc8 P e5256d91808b47c195bc9b4dbd7f2b87 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 17.
I20260709 13:06:27.202854 24484 consensus_queue.cc:1059] T 3e1f505cb0f1427bbd698ac889d80821 P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 }, Status: INVALID_TERM, Last received: 14.8, Next index: 9, Last known committed idx: 6, Time since last communication: 0.004s
I20260709 13:06:27.211479 19407 raft_consensus.cc:2468] T 76cb037fc9064d13b59a8969d897ce8c P e5256d91808b47c195bc9b4dbd7f2b87 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 12.
I20260709 13:06:27.211272 19449 leader_election.cc:304] T 9962423cb4e54fcfa5de01daf68a86e7 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e; no voters: 127766fc592545a4997f7790f50f6076, e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:06:27.158111 24499 leader_election.cc:290] T 96efeaaf1057492490e9a621f37e1a2d P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:06:27.173062 24397 raft_consensus.cc:493] T 48824d5acfbc485ebf8c2d944e7202de P 0473d2b2d01f4459b1e90fd12cc7840e [term 15 FOLLOWER]: Starting leader election (detected failure of leader 127766fc592545a4997f7790f50f6076)
I20260709 13:06:27.211534 24509 raft_consensus.cc:493] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P 127766fc592545a4997f7790f50f6076 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:27.215826 24509 raft_consensus.cc:515] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P 127766fc592545a4997f7790f50f6076 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:27.216673 24484 raft_consensus.cc:3055] T 3e1f505cb0f1427bbd698ac889d80821 P e61c3a8f61bb48f8a963c9480e53c168 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:06:27.217095 24484 raft_consensus.cc:740] T 3e1f505cb0f1427bbd698ac889d80821 P e61c3a8f61bb48f8a963c9480e53c168 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: e61c3a8f61bb48f8a963c9480e53c168, State: Running, Role: LEADER
I20260709 13:06:27.218114 24484 consensus_queue.cc:260] T 3e1f505cb0f1427bbd698ac889d80821 P e61c3a8f61bb48f8a963c9480e53c168 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:27.219292 24484 raft_consensus.cc:3060] T 3e1f505cb0f1427bbd698ac889d80821 P e61c3a8f61bb48f8a963c9480e53c168 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:06:27.222373 19411 raft_consensus.cc:3055] T 46c5bfeecc314717bffe987e6844b6d0 P e5256d91808b47c195bc9b4dbd7f2b87 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:06:27.222786 19411 raft_consensus.cc:740] T 46c5bfeecc314717bffe987e6844b6d0 P e5256d91808b47c195bc9b4dbd7f2b87 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: e5256d91808b47c195bc9b4dbd7f2b87, State: Running, Role: LEADER
I20260709 13:06:27.215845 20105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab43d85f64114d4ebf618930e43d9ed0" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:06:27.226030 19403 raft_consensus.cc:2368] T 14efcc79969f41babe5529c22d59156d P e5256d91808b47c195bc9b4dbd7f2b87 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0473d2b2d01f4459b1e90fd12cc7840e for earlier term 15. Current term is 16.
I20260709 13:06:27.223554 19411 consensus_queue.cc:260] T 46c5bfeecc314717bffe987e6844b6d0 P e5256d91808b47c195bc9b4dbd7f2b87 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 18.8, Last appended by leader: 8, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:27.207080 24482 raft_consensus.cc:740] T 9962423cb4e54fcfa5de01daf68a86e7 P 127766fc592545a4997f7790f50f6076 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 127766fc592545a4997f7790f50f6076, State: Running, Role: LEADER
W20260709 13:06:27.228385 19450 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.3:36891, user_credentials={real_user=slave}} blocked reactor thread for 53898.3us
I20260709 13:06:27.229817 19409 raft_consensus.cc:2468] T edd7d470b5014c9489be7f41f64355c9 P e5256d91808b47c195bc9b4dbd7f2b87 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 15.
W20260709 13:06:27.230497 19452 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:27.236742 19410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df751f992649444090e27965eb1af85d" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
I20260709 13:06:27.228183 24393 leader_election.cc:290] T 14efcc79969f41babe5529c22d59156d P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 16 election: Requested vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:06:27.225037 24397 raft_consensus.cc:3060] T 48824d5acfbc485ebf8c2d944e7202de P 0473d2b2d01f4459b1e90fd12cc7840e [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:06:27.218130 24509 leader_election.cc:290] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:06:27.228925 24374 raft_consensus.cc:2804] T 172b3dd13109415a955b71ac0e9d2234 P e5256d91808b47c195bc9b4dbd7f2b87 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:06:27.228193 24479 raft_consensus.cc:3060] T 9962423cb4e54fcfa5de01daf68a86e7 P 0473d2b2d01f4459b1e90fd12cc7840e [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:06:27.240423 19377 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.2:46257, user_credentials={real_user=slave}} blocked reactor thread for 116261us
I20260709 13:06:27.239562 19410 raft_consensus.cc:3060] T df751f992649444090e27965eb1af85d P e5256d91808b47c195bc9b4dbd7f2b87 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:06:27.213006 24370 raft_consensus.cc:515] T 28af091831594f9d8e96482078cc7625 P e5256d91808b47c195bc9b4dbd7f2b87 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:27.233491 24362 raft_consensus.cc:515] T 2b74109013a140ada21feeef92d6f563 P e5256d91808b47c195bc9b4dbd7f2b87 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:27.233619 24485 raft_consensus.cc:2804] T 46c5bfeecc314717bffe987e6844b6d0 P 0473d2b2d01f4459b1e90fd12cc7840e [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:06:27.243664 19526 leader_election.cc:304] T 2725d2c4cb054f18b0fc8f735c15f6c2 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:06:27.244710 19377 leader_election.cc:304] T 86a6797bdfe94fa496c050ceae4bd0d9 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168
W20260709 13:06:27.247011 19449 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.1:40321, user_credentials={real_user=slave}} blocked reactor thread for 62729.6us
W20260709 13:06:27.248116 19524 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:27.249996 20105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48824d5acfbc485ebf8c2d944e7202de" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 16 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:06:27.251175 19449 leader_election.cc:304] T 22196caba61445d3bec98a0aab3c337d P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e; no voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:06:27.251307 24362 leader_election.cc:290] T 2b74109013a140ada21feeef92d6f563 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:06:27.255043 19411 raft_consensus.cc:3060] T 46c5bfeecc314717bffe987e6844b6d0 P e5256d91808b47c195bc9b4dbd7f2b87 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:06:27.240657 24374 raft_consensus.cc:493] T 172b3dd13109415a955b71ac0e9d2234 P e5256d91808b47c195bc9b4dbd7f2b87 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 127766fc592545a4997f7790f50f6076)
W20260709 13:06:27.264678 19523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.1:40321, user_credentials={real_user=slave}} blocked reactor thread for 91749.1us
I20260709 13:06:27.267557 24516 raft_consensus.cc:493] T 85c494af21f9457a85da47b9bc70c1fd P e61c3a8f61bb48f8a963c9480e53c168 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 127766fc592545a4997f7790f50f6076)
I20260709 13:06:27.270242 19552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b74109013a140ada21feeef92d6f563" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:06:27.258625 24494 raft_consensus.cc:2804] T 2725d2c4cb054f18b0fc8f735c15f6c2 P e61c3a8f61bb48f8a963c9480e53c168 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:06:27.265614 24362 raft_consensus.cc:2749] T 86a6797bdfe94fa496c050ceae4bd0d9 P e5256d91808b47c195bc9b4dbd7f2b87 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:06:27.257141 24485 raft_consensus.cc:697] T 46c5bfeecc314717bffe987e6844b6d0 P 0473d2b2d01f4459b1e90fd12cc7840e [term 19 LEADER]: Becoming Leader. State: Replica: 0473d2b2d01f4459b1e90fd12cc7840e, State: Running, Role: LEADER
I20260709 13:06:27.265362 24374 raft_consensus.cc:3060] T 172b3dd13109415a955b71ac0e9d2234 P e5256d91808b47c195bc9b4dbd7f2b87 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:06:27.275712 24494 raft_consensus.cc:493] T 2725d2c4cb054f18b0fc8f735c15f6c2 P e61c3a8f61bb48f8a963c9480e53c168 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:27.284355 20105 raft_consensus.cc:1275] T 96efeaaf1057492490e9a621f37e1a2d P 127766fc592545a4997f7790f50f6076 [term 15 FOLLOWER]: Refusing update from remote peer 0473d2b2d01f4459b1e90fd12cc7840e: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 13:06:27.293555 19523 leader_election.cc:304] T 2e36a9d6e29c4a7c860cf267efbd4c74 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e61c3a8f61bb48f8a963c9480e53c168; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:06:27.294085 19408 raft_consensus.cc:2468] T 1f85fc4b527a48848e5faa083b604e36 P e5256d91808b47c195bc9b4dbd7f2b87 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 127766fc592545a4997f7790f50f6076 in term 13.
I20260709 13:06:27.282584 24471 raft_consensus.cc:2749] T 22196caba61445d3bec98a0aab3c337d P 0473d2b2d01f4459b1e90fd12cc7840e [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:06:27.295878 19406 raft_consensus.cc:1240] T 21e14947d70440f19044d8f75c31e1f9 P e5256d91808b47c195bc9b4dbd7f2b87 [term 14 LEADER]: Rejecting Update request from peer 0473d2b2d01f4459b1e90fd12cc7840e for earlier term 13. Current term is 14. Ops: []
I20260709 13:06:27.298002 19377 leader_election.cc:304] T f93ee515a9c14139bf566522ed8232f3 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:06:27.290174 24494 raft_consensus.cc:3060] T 2725d2c4cb054f18b0fc8f735c15f6c2 P e61c3a8f61bb48f8a963c9480e53c168 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:06:27.303368 19479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9f0d59553ad444883fcf5b5909f9798" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:06:27.304159 19407 raft_consensus.cc:1240] T e381f1d6b8184797ad142de49be225a8 P e5256d91808b47c195bc9b4dbd7f2b87 [term 11 FOLLOWER]: Rejecting Update request from peer 0473d2b2d01f4459b1e90fd12cc7840e for earlier term 10. Current term is 11. Ops: []
W20260709 13:06:27.304174 19449 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.1:40321, user_credentials={real_user=slave}} blocked reactor thread for 56470.6us
I20260709 13:06:27.304665 20105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14efcc79969f41babe5529c22d59156d" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:06:27.306985 20105 raft_consensus.cc:2393] T 14efcc79969f41babe5529c22d59156d P 127766fc592545a4997f7790f50f6076 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0473d2b2d01f4459b1e90fd12cc7840e in current term 15: Already voted for candidate 127766fc592545a4997f7790f50f6076 in this term.
I20260709 13:06:27.291018 24474 consensus_queue.cc:1059] T 217b5fae677b4971b3bbd2f357a1f7ff P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.005s
I20260709 13:06:27.309505 19486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "217b5fae677b4971b3bbd2f357a1f7ff" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:06:27.311412 24478 consensus_queue.cc:1059] T ef32ce6fdd0e40d382c79974f30295c6 P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 }, Status: INVALID_TERM, Last received: 15.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.006s
I20260709 13:06:27.312278 19481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1b10566f45d4a7d9029858330e02d5b" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:06:27.312961 24485 consensus_queue.cc:237] T 46c5bfeecc314717bffe987e6844b6d0 P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 18.8, Last appended by leader: 8, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:27.314939 19483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9962423cb4e54fcfa5de01daf68a86e7" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:06:27.316249 19484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36f6ba92b9ba46babe4ebd6c02e5fbd9" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:06:27.316843 19484 raft_consensus.cc:2468] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P 0473d2b2d01f4459b1e90fd12cc7840e [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 15.
I20260709 13:06:27.317734 19485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e5873a19244c5ebbcd38e126796ee7" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 16 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:06:27.318333 19485 raft_consensus.cc:2468] T d1e5873a19244c5ebbcd38e126796ee7 P 0473d2b2d01f4459b1e90fd12cc7840e [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 15.
I20260709 13:06:27.277220 24516 raft_consensus.cc:515] T 85c494af21f9457a85da47b9bc70c1fd P e61c3a8f61bb48f8a963c9480e53c168 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:27.319792 19482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e1f505cb0f1427bbd698ac889d80821" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 15 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:06:27.321098 19477 raft_consensus.cc:1275] T 22196caba61445d3bec98a0aab3c337d P 0473d2b2d01f4459b1e90fd12cc7840e [term 12 FOLLOWER]: Refusing update from remote peer e5256d91808b47c195bc9b4dbd7f2b87: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:06:27.321506 19482 raft_consensus.cc:2393] T 3e1f505cb0f1427bbd698ac889d80821 P 0473d2b2d01f4459b1e90fd12cc7840e [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e5256d91808b47c195bc9b4dbd7f2b87 in current term 15: Already voted for candidate 0473d2b2d01f4459b1e90fd12cc7840e in this term.
I20260709 13:06:27.333226 19449 leader_election.cc:304] T 46c5bfeecc314717bffe987e6844b6d0 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e; no voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:06:27.336974 19410 raft_consensus.cc:2468] T df751f992649444090e27965eb1af85d P e5256d91808b47c195bc9b4dbd7f2b87 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 17.
I20260709 13:06:27.345014 19552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df751f992649444090e27965eb1af85d" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
W20260709 13:06:27.346163 19377 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.2:46257, user_credentials={real_user=slave}} blocked reactor thread for 48237.1us
I20260709 13:06:27.319732 24362 raft_consensus.cc:2749] T f93ee515a9c14139bf566522ed8232f3 P e5256d91808b47c195bc9b4dbd7f2b87 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:06:27.374387 24516 leader_election.cc:290] T 85c494af21f9457a85da47b9bc70c1fd P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
W20260709 13:06:27.375245 19449 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.1:40321, user_credentials={real_user=slave}} blocked reactor thread for 68412.4us
I20260709 13:06:27.376807 19449 leader_election.cc:304] T 14935b3ddf914369822e4a0547aaa355 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168; no voters: 127766fc592545a4997f7790f50f6076, e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:06:27.377820 24397 raft_consensus.cc:515] T 48824d5acfbc485ebf8c2d944e7202de P 0473d2b2d01f4459b1e90fd12cc7840e [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:27.379137 24422 raft_consensus.cc:2749] T 14935b3ddf914369822e4a0547aaa355 P 0473d2b2d01f4459b1e90fd12cc7840e [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:06:27.384819 24508 raft_consensus.cc:3055] T ef32ce6fdd0e40d382c79974f30295c6 P 0473d2b2d01f4459b1e90fd12cc7840e [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:06:27.385280 24508 raft_consensus.cc:740] T ef32ce6fdd0e40d382c79974f30295c6 P 0473d2b2d01f4459b1e90fd12cc7840e [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 0473d2b2d01f4459b1e90fd12cc7840e, State: Running, Role: LEADER
I20260709 13:06:27.385771 24397 leader_election.cc:290] T 48824d5acfbc485ebf8c2d944e7202de P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 16 election: Requested vote from peers e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:06:27.389511 24370 leader_election.cc:290] T 28af091831594f9d8e96482078cc7625 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:06:27.308614 24482 consensus_queue.cc:260] T 9962423cb4e54fcfa5de01daf68a86e7 P 127766fc592545a4997f7790f50f6076 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:27.400982 20105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36f6ba92b9ba46babe4ebd6c02e5fbd9" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:06:27.401613 20105 raft_consensus.cc:2468] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P 127766fc592545a4997f7790f50f6076 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 15.
I20260709 13:06:27.402410 19410 raft_consensus.cc:1275] T 65d8cb8d6ec64f459d5a47cefab10acf P e5256d91808b47c195bc9b4dbd7f2b87 [term 14 FOLLOWER]: Refusing update from remote peer 127766fc592545a4997f7790f50f6076: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 13:06:27.403157 20111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14efcc79969f41babe5529c22d59156d" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076"
I20260709 13:06:27.403910 20111 raft_consensus.cc:3060] T 14efcc79969f41babe5529c22d59156d P 127766fc592545a4997f7790f50f6076 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:06:27.405905 24479 raft_consensus.cc:2749] T 9962423cb4e54fcfa5de01daf68a86e7 P 0473d2b2d01f4459b1e90fd12cc7840e [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:06:27.407655 20075 leader_election.cc:304] T 70797e5783b5454ab0d0eea663e791e3 P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 127766fc592545a4997f7790f50f6076, e5256d91808b47c195bc9b4dbd7f2b87; no voters: 
I20260709 13:06:27.408468 20075 leader_election.cc:304] T 1f85fc4b527a48848e5faa083b604e36 P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 127766fc592545a4997f7790f50f6076, e5256d91808b47c195bc9b4dbd7f2b87; no voters: 
I20260709 13:06:27.409610 19555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28af091831594f9d8e96482078cc7625" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:06:27.410195 19555 raft_consensus.cc:2468] T 28af091831594f9d8e96482078cc7625 P e61c3a8f61bb48f8a963c9480e53c168 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 14.
I20260709 13:06:27.378351 19449 leader_election.cc:304] T 5ec1c4ce15e04c7e8c283a62179f2a64 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e; no voters: 127766fc592545a4997f7790f50f6076, e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:06:27.412518 19449 leader_election.cc:304] T d1e5873a19244c5ebbcd38e126796ee7 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87; no voters: e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:06:27.413054 24479 raft_consensus.cc:2749] T 5ec1c4ce15e04c7e8c283a62179f2a64 P 0473d2b2d01f4459b1e90fd12cc7840e [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:06:27.414119 24479 raft_consensus.cc:2804] T d1e5873a19244c5ebbcd38e126796ee7 P 0473d2b2d01f4459b1e90fd12cc7840e [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:06:27.414599 24479 raft_consensus.cc:697] T d1e5873a19244c5ebbcd38e126796ee7 P 0473d2b2d01f4459b1e90fd12cc7840e [term 15 LEADER]: Becoming Leader. State: Replica: 0473d2b2d01f4459b1e90fd12cc7840e, State: Running, Role: LEADER
I20260709 13:06:27.414954 24299 raft_consensus.cc:2804] T 70797e5783b5454ab0d0eea663e791e3 P 127766fc592545a4997f7790f50f6076 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:06:27.415370 24299 raft_consensus.cc:493] T 70797e5783b5454ab0d0eea663e791e3 P 127766fc592545a4997f7790f50f6076 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:27.415701 24397 raft_consensus.cc:493] T 62c6c134d3d24a1ab144dd9ee6bc3f64 P 0473d2b2d01f4459b1e90fd12cc7840e [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 127766fc592545a4997f7790f50f6076)
I20260709 13:06:27.415558 24479 consensus_queue.cc:237] T d1e5873a19244c5ebbcd38e126796ee7 P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:27.416543 24397 raft_consensus.cc:515] T 62c6c134d3d24a1ab144dd9ee6bc3f64 P 0473d2b2d01f4459b1e90fd12cc7840e [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:27.417390 24190 raft_consensus.cc:2804] T 1f85fc4b527a48848e5faa083b604e36 P 127766fc592545a4997f7790f50f6076 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:06:27.417985 24190 raft_consensus.cc:697] T 1f85fc4b527a48848e5faa083b604e36 P 127766fc592545a4997f7790f50f6076 [term 13 LEADER]: Becoming Leader. State: Replica: 127766fc592545a4997f7790f50f6076, State: Running, Role: LEADER
I20260709 13:06:27.419365 24541 raft_consensus.cc:2749] T 2e36a9d6e29c4a7c860cf267efbd4c74 P e61c3a8f61bb48f8a963c9480e53c168 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:06:27.415721 24299 raft_consensus.cc:3060] T 70797e5783b5454ab0d0eea663e791e3 P 127766fc592545a4997f7790f50f6076 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:06:27.422933 20078 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.2:46257, user_credentials={real_user=slave}} blocked reactor thread for 69211.2us
I20260709 13:06:27.427528 19449 leader_election.cc:304] T ab43d85f64114d4ebf618930e43d9ed0 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:06:27.428339 24478 raft_consensus.cc:2804] T ab43d85f64114d4ebf618930e43d9ed0 P 0473d2b2d01f4459b1e90fd12cc7840e [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:06:27.428725 24478 raft_consensus.cc:493] T ab43d85f64114d4ebf618930e43d9ed0 P 0473d2b2d01f4459b1e90fd12cc7840e [term 14 FOLLOWER]: Starting leader election (detected failure of leader 127766fc592545a4997f7790f50f6076)
I20260709 13:06:27.429101 24478 raft_consensus.cc:3060] T ab43d85f64114d4ebf618930e43d9ed0 P 0473d2b2d01f4459b1e90fd12cc7840e [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:06:27.432536 19480 raft_consensus.cc:1240] T 9962423cb4e54fcfa5de01daf68a86e7 P 0473d2b2d01f4459b1e90fd12cc7840e [term 12 FOLLOWER]: Rejecting Update request from peer 127766fc592545a4997f7790f50f6076 for earlier term 11. Current term is 12. Ops: []
I20260709 13:06:27.432869 19375 leader_election.cc:304] T 28af091831594f9d8e96482078cc7625 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:06:27.432957 19477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96efeaaf1057492490e9a621f37e1a2d" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 16 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:06:27.433571 19486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36f6ba92b9ba46babe4ebd6c02e5fbd9" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:06:27.427390 24509 raft_consensus.cc:2955] T ab43d85f64114d4ebf618930e43d9ed0 P 127766fc592545a4997f7790f50f6076 [term 14 LEADER]: Committing config change with OpId 14.9: config changed from index 5 to 9, VOTER e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1) evicted. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } } }
I20260709 13:06:27.434162 19486 raft_consensus.cc:2468] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P 0473d2b2d01f4459b1e90fd12cc7840e [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 127766fc592545a4997f7790f50f6076 in term 15.
I20260709 13:06:27.434607 24362 consensus_queue.cc:1048] T 22196caba61445d3bec98a0aab3c337d P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:06:27.436553 24362 raft_consensus.cc:2804] T 28af091831594f9d8e96482078cc7625 P e5256d91808b47c195bc9b4dbd7f2b87 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:06:27.436833 19482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f85fc4b527a48848e5faa083b604e36" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:06:27.437593 19482 raft_consensus.cc:3060] T 1f85fc4b527a48848e5faa083b604e36 P 0473d2b2d01f4459b1e90fd12cc7840e [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:06:27.438411 24530 raft_consensus.cc:3055] T 217b5fae677b4971b3bbd2f357a1f7ff P 0473d2b2d01f4459b1e90fd12cc7840e [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:06:27.438819 24530 raft_consensus.cc:740] T 217b5fae677b4971b3bbd2f357a1f7ff P 0473d2b2d01f4459b1e90fd12cc7840e [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 0473d2b2d01f4459b1e90fd12cc7840e, State: Running, Role: LEADER
I20260709 13:06:27.439901 24397 leader_election.cc:290] T 62c6c134d3d24a1ab144dd9ee6bc3f64 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:06:27.439689 24530 consensus_queue.cc:260] T 217b5fae677b4971b3bbd2f357a1f7ff P 0473d2b2d01f4459b1e90fd12cc7840e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:27.440899 24530 raft_consensus.cc:3060] T 217b5fae677b4971b3bbd2f357a1f7ff P 0473d2b2d01f4459b1e90fd12cc7840e [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:06:27.445658 19449 leader_election.cc:304] T 3e1f505cb0f1427bbd698ac889d80821 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87; no voters: e61c3a8f61bb48f8a963c9480e53c168
W20260709 13:06:27.446573 20075 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:27.419008 24190 consensus_queue.cc:237] T 1f85fc4b527a48848e5faa083b604e36 P 127766fc592545a4997f7790f50f6076 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
W20260709 13:06:27.457058 19377 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.2:46257, user_credentials={real_user=slave}} blocked reactor thread for 101412us
I20260709 13:06:27.457252 19411 raft_consensus.cc:2468] T 46c5bfeecc314717bffe987e6844b6d0 P e5256d91808b47c195bc9b4dbd7f2b87 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 19.
I20260709 13:06:27.457895 19377 leader_election.cc:304] T b9f0d59553ad444883fcf5b5909f9798 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168
W20260709 13:06:27.449060 19450 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:27.460731 19377 leader_election.cc:304] T f1b10566f45d4a7d9029858330e02d5b P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:06:27.467770 19407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36f6ba92b9ba46babe4ebd6c02e5fbd9" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:06:27.467864 19377 leader_election.cc:304] T 9962423cb4e54fcfa5de01daf68a86e7 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, 127766fc592545a4997f7790f50f6076
I20260709 13:06:27.468509 19407 raft_consensus.cc:2468] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P e5256d91808b47c195bc9b4dbd7f2b87 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 127766fc592545a4997f7790f50f6076 in term 15.
I20260709 13:06:27.453521 19482 raft_consensus.cc:2468] T 1f85fc4b527a48848e5faa083b604e36 P 0473d2b2d01f4459b1e90fd12cc7840e [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 127766fc592545a4997f7790f50f6076 in term 13.
W20260709 13:06:27.475117 20078 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:27.472842 24422 raft_consensus.cc:493] T ed7fdbcb96d14d418db9ca90a792588a P 0473d2b2d01f4459b1e90fd12cc7840e [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 127766fc592545a4997f7790f50f6076)
I20260709 13:06:27.471798 19554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48824d5acfbc485ebf8c2d944e7202de" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:06:27.476557 19377 leader_election.cc:304] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87; no voters: 
I20260709 13:06:27.476792 19554 raft_consensus.cc:3060] T 48824d5acfbc485ebf8c2d944e7202de P e61c3a8f61bb48f8a963c9480e53c168 [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:06:27.466857 24372 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 19 current term: 19 is higher.
I20260709 13:06:27.477835 19377 leader_election.cc:304] T d1e5873a19244c5ebbcd38e126796ee7 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87; no voters: e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:06:27.480331 19552 raft_consensus.cc:1240] T 1dc5b3532fe54f74876d02beffa2c230 P e61c3a8f61bb48f8a963c9480e53c168 [term 15 FOLLOWER]: Rejecting Update request from peer 0473d2b2d01f4459b1e90fd12cc7840e for earlier term 14. Current term is 15. Ops: []
I20260709 13:06:27.436877 24362 raft_consensus.cc:493] T 28af091831594f9d8e96482078cc7625 P e5256d91808b47c195bc9b4dbd7f2b87 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 0473d2b2d01f4459b1e90fd12cc7840e)
I20260709 13:06:27.386101 24508 consensus_queue.cc:260] T ef32ce6fdd0e40d382c79974f30295c6 P 0473d2b2d01f4459b1e90fd12cc7840e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:27.483790 19377 leader_election.cc:304] T 217b5fae677b4971b3bbd2f357a1f7ff P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168
W20260709 13:06:27.485272 19523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.1:40321, user_credentials={real_user=slave}} blocked reactor thread for 206630us
I20260709 13:06:27.470904 24388 raft_consensus.cc:2749] T f1b10566f45d4a7d9029858330e02d5b P e5256d91808b47c195bc9b4dbd7f2b87 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:06:27.471119 24370 raft_consensus.cc:2749] T b9f0d59553ad444883fcf5b5909f9798 P e5256d91808b47c195bc9b4dbd7f2b87 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:06:27.487802 19523 leader_election.cc:304] T b08304a0a02b42d7840c4e8ee9a6bd1a P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e61c3a8f61bb48f8a963c9480e53c168; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:06:27.477665 24397 raft_consensus.cc:2804] T 3e1f505cb0f1427bbd698ac889d80821 P 0473d2b2d01f4459b1e90fd12cc7840e [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:06:27.481397 24305 raft_consensus.cc:2749] T 9962423cb4e54fcfa5de01daf68a86e7 P e5256d91808b47c195bc9b4dbd7f2b87 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:06:27.482570 24411 raft_consensus.cc:2804] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P e5256d91808b47c195bc9b4dbd7f2b87 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:06:27.461881 24374 raft_consensus.cc:515] T 172b3dd13109415a955b71ac0e9d2234 P e5256d91808b47c195bc9b4dbd7f2b87 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:27.483428 24362 raft_consensus.cc:3060] T 28af091831594f9d8e96482078cc7625 P e5256d91808b47c195bc9b4dbd7f2b87 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:06:27.487317 24412 raft_consensus.cc:2804] T d1e5873a19244c5ebbcd38e126796ee7 P e5256d91808b47c195bc9b4dbd7f2b87 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:06:27.516733 19485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b74109013a140ada21feeef92d6f563" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:06:27.498016 24474 raft_consensus.cc:2749] T 46c5bfeecc314717bffe987e6844b6d0 P 0473d2b2d01f4459b1e90fd12cc7840e [term 19 LEADER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:06:27.517690 20078 leader_election.cc:304] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, 127766fc592545a4997f7790f50f6076; no voters: 
I20260709 13:06:27.492766 24457 raft_consensus.cc:2749] T 217b5fae677b4971b3bbd2f357a1f7ff P e5256d91808b47c195bc9b4dbd7f2b87 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:06:27.537153 19377 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.2:46257, user_credentials={real_user=slave}} blocked reactor thread for 47407.6us
I20260709 13:06:27.489694 24471 consensus_queue.cc:1059] T ef32ce6fdd0e40d382c79974f30295c6 P 0473d2b2d01f4459b1e90fd12cc7840e [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 }, Status: INVALID_TERM, Last received: 15.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.031s
I20260709 13:06:27.538503 19406 raft_consensus.cc:1240] T 172b3dd13109415a955b71ac0e9d2234 P e5256d91808b47c195bc9b4dbd7f2b87 [term 12 FOLLOWER]: Rejecting Update request from peer 127766fc592545a4997f7790f50f6076 for earlier term 11. Current term is 12. Ops: []
I20260709 13:06:27.511292 24411 raft_consensus.cc:493] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P e5256d91808b47c195bc9b4dbd7f2b87 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:27.540045 19486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14efcc79969f41babe5529c22d59156d" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:06:27.543380 19486 raft_consensus.cc:3060] T 14efcc79969f41babe5529c22d59156d P 0473d2b2d01f4459b1e90fd12cc7840e [term 14 FOLLOWER]: Advancing to term 16
I20260709 13:06:27.515933 24412 raft_consensus.cc:493] T d1e5873a19244c5ebbcd38e126796ee7 P e5256d91808b47c195bc9b4dbd7f2b87 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:27.539391 19377 leader_election.cc:304] T 3e1f505cb0f1427bbd698ac889d80821 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:06:27.541126 19552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62c6c134d3d24a1ab144dd9ee6bc3f64" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:06:27.547655 19479 raft_consensus.cc:1240] T 48824d5acfbc485ebf8c2d944e7202de P 0473d2b2d01f4459b1e90fd12cc7840e [term 16 FOLLOWER]: Rejecting Update request from peer 127766fc592545a4997f7790f50f6076 for earlier term 15. Current term is 16. Ops: []
I20260709 13:06:27.501900 24393 consensus_queue.cc:1048] T 22196caba61445d3bec98a0aab3c337d P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.036s
I20260709 13:06:27.547868 19552 raft_consensus.cc:2468] T 62c6c134d3d24a1ab144dd9ee6bc3f64 P e61c3a8f61bb48f8a963c9480e53c168 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 13.
I20260709 13:06:27.538960 24141 raft_consensus.cc:2804] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P 127766fc592545a4997f7790f50f6076 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:06:27.545133 24411 raft_consensus.cc:3060] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P e5256d91808b47c195bc9b4dbd7f2b87 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:06:27.558869 24543 raft_consensus.cc:3060] T b08304a0a02b42d7840c4e8ee9a6bd1a P e61c3a8f61bb48f8a963c9480e53c168 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:06:27.560004 24457 raft_consensus.cc:2749] T 3e1f505cb0f1427bbd698ac889d80821 P e5256d91808b47c195bc9b4dbd7f2b87 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:06:27.511996 24422 raft_consensus.cc:515] T ed7fdbcb96d14d418db9ca90a792588a P 0473d2b2d01f4459b1e90fd12cc7840e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:27.549993 24412 raft_consensus.cc:3060] T d1e5873a19244c5ebbcd38e126796ee7 P e5256d91808b47c195bc9b4dbd7f2b87 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:06:27.571336 20111 raft_consensus.cc:2468] T 14efcc79969f41babe5529c22d59156d P 127766fc592545a4997f7790f50f6076 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 16.
I20260709 13:06:27.571672 19523 leader_election.cc:304] T ece3db938bc649d4a40a51522ed5259c P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e61c3a8f61bb48f8a963c9480e53c168; no voters: 127766fc592545a4997f7790f50f6076, e5256d91808b47c195bc9b4dbd7f2b87
W20260709 13:06:27.589985 19450 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.3:36891, user_credentials={real_user=slave}} blocked reactor thread for 67423.7us
I20260709 13:06:27.594523 19377 leader_election.cc:304] T 2b74109013a140ada21feeef92d6f563 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:06:27.561482 24141 raft_consensus.cc:493] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P 127766fc592545a4997f7790f50f6076 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:27.599640 19450 leader_election.cc:304] T 62c6c134d3d24a1ab144dd9ee6bc3f64 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:06:27.594435 19374 leader_election.cc:304] T 14efcc79969f41babe5529c22d59156d P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 127766fc592545a4997f7790f50f6076, e5256d91808b47c195bc9b4dbd7f2b87; no voters: 
I20260709 13:06:27.549739 24276 consensus_queue.cc:1059] T 1dc5b3532fe54f74876d02beffa2c230 P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.042s
I20260709 13:06:27.593683 24397 raft_consensus.cc:697] T 3e1f505cb0f1427bbd698ac889d80821 P 0473d2b2d01f4459b1e90fd12cc7840e [term 15 LEADER]: Becoming Leader. State: Replica: 0473d2b2d01f4459b1e90fd12cc7840e, State: Running, Role: LEADER
I20260709 13:06:27.605564 19479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28af091831594f9d8e96482078cc7625" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:06:27.606138 24559 raft_consensus.cc:2804] T 62c6c134d3d24a1ab144dd9ee6bc3f64 P 0473d2b2d01f4459b1e90fd12cc7840e [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:06:27.606628 24384 consensus_queue.cc:1059] T 48824d5acfbc485ebf8c2d944e7202de P 127766fc592545a4997f7790f50f6076 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 }, Status: INVALID_TERM, Last received: 15.11, Next index: 12, Last known committed idx: 10, Time since last communication: 0.005s
I20260709 13:06:27.608570 24551 raft_consensus.cc:2804] T 14efcc79969f41babe5529c22d59156d P e5256d91808b47c195bc9b4dbd7f2b87 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:06:27.602581 24457 raft_consensus.cc:2749] T 2b74109013a140ada21feeef92d6f563 P e5256d91808b47c195bc9b4dbd7f2b87 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:06:27.612155 24422 leader_election.cc:290] T ed7fdbcb96d14d418db9ca90a792588a P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:06:27.612680 19555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed7fdbcb96d14d418db9ca90a792588a" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:06:27.613292 24374 leader_election.cc:290] T 172b3dd13109415a955b71ac0e9d2234 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 12 election: Requested vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:06:27.613987 24499 consensus_queue.cc:1048] T 65d8cb8d6ec64f459d5a47cefab10acf P 127766fc592545a4997f7790f50f6076 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
W20260709 13:06:27.606027 19523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.1:40321, user_credentials={real_user=slave}} blocked reactor thread for 56709.8us
I20260709 13:06:27.618395 19485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "172b3dd13109415a955b71ac0e9d2234" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:06:27.637542 20111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "172b3dd13109415a955b71ac0e9d2234" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076"
I20260709 13:06:27.602548 24141 raft_consensus.cc:3060] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P 127766fc592545a4997f7790f50f6076 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:06:27.606235 24545 raft_consensus.cc:2749] T ece3db938bc649d4a40a51522ed5259c P e61c3a8f61bb48f8a963c9480e53c168 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:06:27.648479 20106 raft_consensus.cc:1275] T ff9b0eddd810459b82d91c60777c10eb P 127766fc592545a4997f7790f50f6076 [term 15 FOLLOWER]: Refusing update from remote peer e5256d91808b47c195bc9b4dbd7f2b87: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 13:06:27.650978 19555 raft_consensus.cc:2468] T ed7fdbcb96d14d418db9ca90a792588a P e61c3a8f61bb48f8a963c9480e53c168 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 9.
I20260709 13:06:27.617496 24559 raft_consensus.cc:493] T 62c6c134d3d24a1ab144dd9ee6bc3f64 P 0473d2b2d01f4459b1e90fd12cc7840e [term 13 FOLLOWER]: Starting leader election (detected failure of leader 127766fc592545a4997f7790f50f6076)
I20260709 13:06:27.665769 19523 leader_election.cc:304] T ab43d85f64114d4ebf618930e43d9ed0 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168; no voters: 127766fc592545a4997f7790f50f6076, e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:06:27.638077 24276 consensus_queue.cc:1243] T 1dc5b3532fe54f74876d02beffa2c230 P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Peer e61c3a8f61bb48f8a963c9480e53c168 log is divergent from this leader: its last log entry 13.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 13:06:27.654016 24551 raft_consensus.cc:697] T 14efcc79969f41babe5529c22d59156d P e5256d91808b47c195bc9b4dbd7f2b87 [term 16 LEADER]: Becoming Leader. State: Replica: e5256d91808b47c195bc9b4dbd7f2b87, State: Running, Role: LEADER
I20260709 13:06:27.664381 24559 raft_consensus.cc:3060] T 62c6c134d3d24a1ab144dd9ee6bc3f64 P 0473d2b2d01f4459b1e90fd12cc7840e [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:06:27.682060 24555 raft_consensus.cc:493] T 65d8cb8d6ec64f459d5a47cefab10acf P e5256d91808b47c195bc9b4dbd7f2b87 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:27.682188 24362 raft_consensus.cc:515] T 28af091831594f9d8e96482078cc7625 P e5256d91808b47c195bc9b4dbd7f2b87 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:27.682705 24555 raft_consensus.cc:515] T 65d8cb8d6ec64f459d5a47cefab10acf P e5256d91808b47c195bc9b4dbd7f2b87 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:27.684604 24362 leader_election.cc:290] T 28af091831594f9d8e96482078cc7625 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 15 election: Requested vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:06:27.684891 24555 leader_election.cc:290] T 65d8cb8d6ec64f459d5a47cefab10acf P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:06:27.686787 19559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65d8cb8d6ec64f459d5a47cefab10acf" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:06:27.687202 19555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28af091831594f9d8e96482078cc7625" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:06:27.687585 19559 raft_consensus.cc:2468] T 65d8cb8d6ec64f459d5a47cefab10acf P e61c3a8f61bb48f8a963c9480e53c168 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 13.
I20260709 13:06:27.687872 19555 raft_consensus.cc:3060] T 28af091831594f9d8e96482078cc7625 P e61c3a8f61bb48f8a963c9480e53c168 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:06:27.688819 24508 raft_consensus.cc:3060] T ef32ce6fdd0e40d382c79974f30295c6 P 0473d2b2d01f4459b1e90fd12cc7840e [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:06:27.690950 19484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28af091831594f9d8e96482078cc7625" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:06:27.691862 19450 leader_election.cc:304] T ed7fdbcb96d14d418db9ca90a792588a P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:06:27.693223 24553 raft_consensus.cc:2804] T ed7fdbcb96d14d418db9ca90a792588a P 0473d2b2d01f4459b1e90fd12cc7840e [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:06:27.693154 24478 raft_consensus.cc:515] T ab43d85f64114d4ebf618930e43d9ed0 P 0473d2b2d01f4459b1e90fd12cc7840e [term 15 FOLLOWER]: Starting leader election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:27.693729 24553 raft_consensus.cc:493] T ed7fdbcb96d14d418db9ca90a792588a P 0473d2b2d01f4459b1e90fd12cc7840e [term 9 FOLLOWER]: Starting leader election (detected failure of leader 127766fc592545a4997f7790f50f6076)
I20260709 13:06:27.694114 24553 raft_consensus.cc:3060] T ed7fdbcb96d14d418db9ca90a792588a P 0473d2b2d01f4459b1e90fd12cc7840e [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:06:27.694305 19480 raft_consensus.cc:1240] T ab43d85f64114d4ebf618930e43d9ed0 P 0473d2b2d01f4459b1e90fd12cc7840e [term 15 FOLLOWER]: Rejecting Update request from peer 127766fc592545a4997f7790f50f6076 for earlier term 14. Current term is 15. Ops: []
I20260709 13:06:27.699158 24397 consensus_queue.cc:237] T 3e1f505cb0f1427bbd698ac889d80821 P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 14.8, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
W20260709 13:06:27.705101 24542 log.cc:927] Time spent T fa8650e71aa14778b3d73721fc50d9fc P e5256d91808b47c195bc9b4dbd7f2b87: Append to log took a long time: real 0.152s	user 0.000s	sys 0.000s
I20260709 13:06:27.687248 19479 raft_consensus.cc:3055] T ff9b0eddd810459b82d91c60777c10eb P 0473d2b2d01f4459b1e90fd12cc7840e [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:06:27.706552 19479 raft_consensus.cc:740] T ff9b0eddd810459b82d91c60777c10eb P 0473d2b2d01f4459b1e90fd12cc7840e [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 0473d2b2d01f4459b1e90fd12cc7840e, State: Running, Role: LEADER
I20260709 13:06:27.698462 24478 leader_election.cc:290] T ab43d85f64114d4ebf618930e43d9ed0 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 15 election: Requested vote from peers e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:06:27.680573 24516 raft_consensus.cc:2749] T ab43d85f64114d4ebf618930e43d9ed0 P e61c3a8f61bb48f8a963c9480e53c168 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:06:27.674094 24253 raft_consensus.cc:3055] T 48824d5acfbc485ebf8c2d944e7202de P 127766fc592545a4997f7790f50f6076 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:06:27.719110 24253 raft_consensus.cc:740] T 48824d5acfbc485ebf8c2d944e7202de P 127766fc592545a4997f7790f50f6076 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 127766fc592545a4997f7790f50f6076, State: Running, Role: LEADER
I20260709 13:06:27.719432 24551 consensus_queue.cc:237] T 14efcc79969f41babe5529c22d59156d P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.11, Last appended by leader: 11, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:27.720244 24253 consensus_queue.cc:260] T 48824d5acfbc485ebf8c2d944e7202de P 127766fc592545a4997f7790f50f6076 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.11, Last appended by leader: 11, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:27.721589 24253 raft_consensus.cc:3060] T 48824d5acfbc485ebf8c2d944e7202de P 127766fc592545a4997f7790f50f6076 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:06:27.671866 24482 raft_consensus.cc:3060] T 9962423cb4e54fcfa5de01daf68a86e7 P 127766fc592545a4997f7790f50f6076 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:06:27.719163 24473 raft_consensus.cc:3055] T 1dc5b3532fe54f74876d02beffa2c230 P 0473d2b2d01f4459b1e90fd12cc7840e [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:06:27.715724 19375 leader_election.cc:304] T 65d8cb8d6ec64f459d5a47cefab10acf P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:06:27.725524 19555 raft_consensus.cc:2468] T 28af091831594f9d8e96482078cc7625 P e61c3a8f61bb48f8a963c9480e53c168 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 15.
I20260709 13:06:27.731564 19375 leader_election.cc:304] T 28af091831594f9d8e96482078cc7625 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:06:27.742779 24299 raft_consensus.cc:515] T 70797e5783b5454ab0d0eea663e791e3 P 127766fc592545a4997f7790f50f6076 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
W20260709 13:06:27.745587 24540 log.cc:927] Time spent T a08760e15aac4630a629431f56024dc8 P e61c3a8f61bb48f8a963c9480e53c168: Append to log took a long time: real 0.053s	user 0.000s	sys 0.000s
W20260709 13:06:27.765645 19449 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.1:40321, user_credentials={real_user=slave}} blocked reactor thread for 282202us
W20260709 13:06:27.768154 20075 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.1:40321, user_credentials={real_user=slave}} blocked reactor thread for 153812us
I20260709 13:06:27.770879 19406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70797e5783b5454ab0d0eea663e791e3" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
I20260709 13:06:27.771443 19406 raft_consensus.cc:3060] T 70797e5783b5454ab0d0eea663e791e3 P e5256d91808b47c195bc9b4dbd7f2b87 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:06:27.778139 19406 raft_consensus.cc:2468] T 70797e5783b5454ab0d0eea663e791e3 P e5256d91808b47c195bc9b4dbd7f2b87 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 127766fc592545a4997f7790f50f6076 in term 14.
I20260709 13:06:27.778416 19374 leader_election.cc:304] T 172b3dd13109415a955b71ac0e9d2234 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, 127766fc592545a4997f7790f50f6076
I20260709 13:06:27.780448 24394 consensus_queue.cc:1048] T ff9b0eddd810459b82d91c60777c10eb P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Connected to new peer: Peer: permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:06:27.782624 24507 raft_consensus.cc:2749] T 172b3dd13109415a955b71ac0e9d2234 P e5256d91808b47c195bc9b4dbd7f2b87 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
W20260709 13:06:27.783600 20075 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:27.784330 24499 consensus_queue.cc:1059] T 172b3dd13109415a955b71ac0e9d2234 P 127766fc592545a4997f7790f50f6076 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 }, Status: INVALID_TERM, Last received: 11.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:06:27.785454 24413 raft_consensus.cc:3055] T 172b3dd13109415a955b71ac0e9d2234 P 127766fc592545a4997f7790f50f6076 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:06:27.785794 24413 raft_consensus.cc:740] T 172b3dd13109415a955b71ac0e9d2234 P 127766fc592545a4997f7790f50f6076 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 127766fc592545a4997f7790f50f6076, State: Running, Role: LEADER
I20260709 13:06:27.786808 20111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65d8cb8d6ec64f459d5a47cefab10acf" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:06:27.786686 24413 consensus_queue.cc:260] T 172b3dd13109415a955b71ac0e9d2234 P 127766fc592545a4997f7790f50f6076 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:27.787429 20075 leader_election.cc:304] T 70797e5783b5454ab0d0eea663e791e3 P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 127766fc592545a4997f7790f50f6076, e5256d91808b47c195bc9b4dbd7f2b87; no voters: 
I20260709 13:06:27.788132 24413 raft_consensus.cc:3060] T 172b3dd13109415a955b71ac0e9d2234 P 127766fc592545a4997f7790f50f6076 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:06:27.788287 24483 raft_consensus.cc:2804] T 70797e5783b5454ab0d0eea663e791e3 P 127766fc592545a4997f7790f50f6076 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:06:27.788875 24483 raft_consensus.cc:697] T 70797e5783b5454ab0d0eea663e791e3 P 127766fc592545a4997f7790f50f6076 [term 14 LEADER]: Becoming Leader. State: Replica: 127766fc592545a4997f7790f50f6076, State: Running, Role: LEADER
I20260709 13:06:27.789750 24483 consensus_queue.cc:237] T 70797e5783b5454ab0d0eea663e791e3 P 127766fc592545a4997f7790f50f6076 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
W20260709 13:06:27.795186 19524 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:27.751363 24457 raft_consensus.cc:2804] T 65d8cb8d6ec64f459d5a47cefab10acf P e5256d91808b47c195bc9b4dbd7f2b87 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:06:27.730199 24473 raft_consensus.cc:740] T 1dc5b3532fe54f74876d02beffa2c230 P 0473d2b2d01f4459b1e90fd12cc7840e [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 0473d2b2d01f4459b1e90fd12cc7840e, State: Running, Role: LEADER
I20260709 13:06:27.754413 24299 leader_election.cc:290] T 70797e5783b5454ab0d0eea663e791e3 P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 14 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:06:27.759608 24374 raft_consensus.cc:2804] T 28af091831594f9d8e96482078cc7625 P e5256d91808b47c195bc9b4dbd7f2b87 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:06:27.765094 19479 consensus_queue.cc:260] T ff9b0eddd810459b82d91c60777c10eb P 0473d2b2d01f4459b1e90fd12cc7840e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.11, Last appended by leader: 11, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:27.812357 19449 leader_election.cc:304] T 76cb037fc9064d13b59a8969d897ce8c P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87; no voters: e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:06:27.805403 24457 raft_consensus.cc:493] T 65d8cb8d6ec64f459d5a47cefab10acf P e5256d91808b47c195bc9b4dbd7f2b87 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:27.865084 24471 consensus_queue.cc:1059] T ff9b0eddd810459b82d91c60777c10eb P 0473d2b2d01f4459b1e90fd12cc7840e [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 }, Status: INVALID_TERM, Last received: 12.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:06:27.836113 24374 raft_consensus.cc:697] T 28af091831594f9d8e96482078cc7625 P e5256d91808b47c195bc9b4dbd7f2b87 [term 15 LEADER]: Becoming Leader. State: Replica: e5256d91808b47c195bc9b4dbd7f2b87, State: Running, Role: LEADER
I20260709 13:06:27.866927 24141 raft_consensus.cc:515] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P 127766fc592545a4997f7790f50f6076 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
W20260709 13:06:27.843924 24494 consensus_meta.cc:287] T 2725d2c4cb054f18b0fc8f735c15f6c2 P e61c3a8f61bb48f8a963c9480e53c168: Time spent flushing consensus metadata: real 0.529s	user 0.000s	sys 0.010s
W20260709 13:06:27.874977 19523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.1:40321, user_credentials={real_user=slave}} blocked reactor thread for 209285us
W20260709 13:06:27.886842 24562 log.cc:927] Time spent T 21e14947d70440f19044d8f75c31e1f9 P 0473d2b2d01f4459b1e90fd12cc7840e: Append to log took a long time: real 0.064s	user 0.000s	sys 0.000s
W20260709 13:06:27.891120 19450 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.3:36891, user_credentials={real_user=slave}} blocked reactor thread for 62982.1us
I20260709 13:06:27.891325 24473 consensus_queue.cc:260] T 1dc5b3532fe54f74876d02beffa2c230 P 0473d2b2d01f4459b1e90fd12cc7840e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 14.7, Last appended by leader: 7, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
W20260709 13:06:27.892021 19449 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.1:40321, user_credentials={real_user=slave}} blocked reactor thread for 79791.4us
W20260709 13:06:27.893121 19452 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:27.893762 24485 raft_consensus.cc:2804] T 76cb037fc9064d13b59a8969d897ce8c P 0473d2b2d01f4459b1e90fd12cc7840e [term 12 FOLLOWER]: Leader election won for term 12
W20260709 13:06:27.906765 19450 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:27.907924 19554 raft_consensus.cc:2468] T 48824d5acfbc485ebf8c2d944e7202de P e61c3a8f61bb48f8a963c9480e53c168 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 16.
I20260709 13:06:27.908470 19486 raft_consensus.cc:2468] T 14efcc79969f41babe5529c22d59156d P 0473d2b2d01f4459b1e90fd12cc7840e [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 16.
I20260709 13:06:27.915562 24471 consensus_queue.cc:1243] T ff9b0eddd810459b82d91c60777c10eb P 0473d2b2d01f4459b1e90fd12cc7840e [NON_LEADER]: Peer e5256d91808b47c195bc9b4dbd7f2b87 log is divergent from this leader: its last log entry 15.11 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 9
I20260709 13:06:27.916591 24374 consensus_queue.cc:237] T 28af091831594f9d8e96482078cc7625 P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 14.7, Last appended by leader: 7, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:27.920804 19479 raft_consensus.cc:3060] T ff9b0eddd810459b82d91c60777c10eb P 0473d2b2d01f4459b1e90fd12cc7840e [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:06:27.921043 24141 leader_election.cc:290] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 16 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:06:27.921578 24411 raft_consensus.cc:515] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P e5256d91808b47c195bc9b4dbd7f2b87 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:27.900671 24457 raft_consensus.cc:3060] T 65d8cb8d6ec64f459d5a47cefab10acf P e5256d91808b47c195bc9b4dbd7f2b87 [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:06:27.926575 19450 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:27.929040 24384 consensus_queue.cc:1059] T ab43d85f64114d4ebf618930e43d9ed0 P 127766fc592545a4997f7790f50f6076 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 }, Status: INVALID_TERM, Last received: 14.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:06:27.931264 24473 raft_consensus.cc:3060] T 1dc5b3532fe54f74876d02beffa2c230 P 0473d2b2d01f4459b1e90fd12cc7840e [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:06:27.935118 19411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36f6ba92b9ba46babe4ebd6c02e5fbd9" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
I20260709 13:06:27.935835 19411 raft_consensus.cc:2393] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P e5256d91808b47c195bc9b4dbd7f2b87 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 127766fc592545a4997f7790f50f6076 in current term 16: Already voted for candidate e5256d91808b47c195bc9b4dbd7f2b87 in this term.
I20260709 13:06:27.910974 24484 raft_consensus.cc:493] T fa731b585f684a7fb2d106c50f143b83 P e61c3a8f61bb48f8a963c9480e53c168 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 127766fc592545a4997f7790f50f6076)
I20260709 13:06:27.936851 24484 raft_consensus.cc:515] T fa731b585f684a7fb2d106c50f143b83 P e61c3a8f61bb48f8a963c9480e53c168 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:27.938905 24484 leader_election.cc:290] T fa731b585f684a7fb2d106c50f143b83 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:06:27.939409 24412 raft_consensus.cc:515] T d1e5873a19244c5ebbcd38e126796ee7 P e5256d91808b47c195bc9b4dbd7f2b87 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:27.941437 24412 leader_election.cc:290] T d1e5873a19244c5ebbcd38e126796ee7 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 16 election: Requested vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
W20260709 13:06:27.942114 24530 consensus_meta.cc:287] T 217b5fae677b4971b3bbd2f357a1f7ff P 0473d2b2d01f4459b1e90fd12cc7840e: Time spent flushing consensus metadata: real 0.501s	user 0.007s	sys 0.004s
I20260709 13:06:27.944175 24543 raft_consensus.cc:2749] T b08304a0a02b42d7840c4e8ee9a6bd1a P e61c3a8f61bb48f8a963c9480e53c168 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:06:27.909214 24509 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.ChangeConfig from 127.0.0.1:40508 (request call id 0) took 2949 ms. Trace:
I20260709 13:06:27.945652 24509 rpcz_store.cc:276] 0709 13:06:24.946623 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:24.950796 (+  4173us) service_pool.cc:224] Handling call
0709 13:06:24.979348 (+ 28552us) log.cc:844] Serialized 494 byte log entry
0709 13:06:27.867700 (+2888352us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":11717,"raft.run_cpu_time_us":1278,"raft.run_wall_time_us":1279,"thread_start_us":216183,"threads_started":1,"wal-append.queue_time_us":544327,"wal-append.run_cpu_time_us":3235,"wal-append.run_wall_time_us":1303111}
I20260709 13:06:27.948030 24509 raft_consensus.cc:3055] T ab43d85f64114d4ebf618930e43d9ed0 P 127766fc592545a4997f7790f50f6076 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:06:27.948127 24411 leader_election.cc:290] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 16 election: Requested vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:06:27.948390 24509 raft_consensus.cc:740] T ab43d85f64114d4ebf618930e43d9ed0 P 127766fc592545a4997f7790f50f6076 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 127766fc592545a4997f7790f50f6076, State: Running, Role: LEADER
I20260709 13:06:27.950044 19523 leader_election.cc:304] T 309c3ca0ca4b4f3ba129752ea2cb293b P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: e61c3a8f61bb48f8a963c9480e53c168; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:06:27.951135 19523 leader_election.cc:304] T b9f0d59553ad444883fcf5b5909f9798 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e61c3a8f61bb48f8a963c9480e53c168; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:06:27.952518 19523 leader_election.cc:304] T 7f575b143b844aa096b50997dad3516a P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e61c3a8f61bb48f8a963c9480e53c168; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:06:27.953310 24517 raft_consensus.cc:2749] T 309c3ca0ca4b4f3ba129752ea2cb293b P e61c3a8f61bb48f8a963c9480e53c168 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:06:27.953001 24457 raft_consensus.cc:515] T 65d8cb8d6ec64f459d5a47cefab10acf P e5256d91808b47c195bc9b4dbd7f2b87 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:27.953830 19523 leader_election.cc:304] T 2b74109013a140ada21feeef92d6f563 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168; no voters: 0473d2b2d01f4459b1e90fd12cc7840e
I20260709 13:06:27.954032 24517 raft_consensus.cc:2749] T b9f0d59553ad444883fcf5b5909f9798 P e61c3a8f61bb48f8a963c9480e53c168 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:06:27.954181 19407 raft_consensus.cc:1240] T 65d8cb8d6ec64f459d5a47cefab10acf P e5256d91808b47c195bc9b4dbd7f2b87 [term 15 FOLLOWER]: Rejecting Update request from peer 127766fc592545a4997f7790f50f6076 for earlier term 14. Current term is 15. Ops: [14.10-14.10]
I20260709 13:06:27.898211 24516 raft_consensus.cc:493] T 14935b3ddf914369822e4a0547aaa355 P e61c3a8f61bb48f8a963c9480e53c168 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 127766fc592545a4997f7790f50f6076)
I20260709 13:06:27.976613 19486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36f6ba92b9ba46babe4ebd6c02e5fbd9" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:06:27.977561 19486 raft_consensus.cc:3060] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P 0473d2b2d01f4459b1e90fd12cc7840e [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:06:27.981755 19559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab43d85f64114d4ebf618930e43d9ed0" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:06:27.982347 19559 raft_consensus.cc:3060] T ab43d85f64114d4ebf618930e43d9ed0 P e61c3a8f61bb48f8a963c9480e53c168 [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:06:27.983644 19449 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.1:40321, user_credentials={real_user=slave}} blocked reactor thread for 46908.5us
I20260709 13:06:27.985023 20106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36f6ba92b9ba46babe4ebd6c02e5fbd9" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076"
I20260709 13:06:27.985509 19482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36f6ba92b9ba46babe4ebd6c02e5fbd9" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:06:27.982234 19556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e5873a19244c5ebbcd38e126796ee7" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 16 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:06:27.986452 19556 raft_consensus.cc:3060] T d1e5873a19244c5ebbcd38e126796ee7 P e61c3a8f61bb48f8a963c9480e53c168 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:06:27.968966 24545 raft_consensus.cc:2749] T 7f575b143b844aa096b50997dad3516a P e61c3a8f61bb48f8a963c9480e53c168 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:06:27.987419 20106 raft_consensus.cc:2393] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P 127766fc592545a4997f7790f50f6076 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate e5256d91808b47c195bc9b4dbd7f2b87 in current term 16: Already voted for candidate 127766fc592545a4997f7790f50f6076 in this term.
I20260709 13:06:27.971937 24517 raft_consensus.cc:2804] T 2b74109013a140ada21feeef92d6f563 P e61c3a8f61bb48f8a963c9480e53c168 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:06:27.993111 19449 leader_election.cc:400] T 14efcc79969f41babe5529c22d59156d P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 15 pre-election: Vote denied by peer e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321) with higher term. Message: Invalid argument: T 14efcc79969f41babe5529c22d59156d P e5256d91808b47c195bc9b4dbd7f2b87 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0473d2b2d01f4459b1e90fd12cc7840e for earlier term 15. Current term is 16.
I20260709 13:06:27.993492 19449 leader_election.cc:403] T 14efcc79969f41babe5529c22d59156d P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 15 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:06:27.910065 24494 raft_consensus.cc:515] T 2725d2c4cb054f18b0fc8f735c15f6c2 P e61c3a8f61bb48f8a963c9480e53c168 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:27.995560 19486 raft_consensus.cc:2468] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P 0473d2b2d01f4459b1e90fd12cc7840e [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 127766fc592545a4997f7790f50f6076 in term 16.
I20260709 13:06:27.996766 20078 leader_election.cc:304] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, 127766fc592545a4997f7790f50f6076; no voters: e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:06:27.982734 24507 raft_consensus.cc:493] T 179fd671030940b4b4a4e24bcc4aba0a P e5256d91808b47c195bc9b4dbd7f2b87 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:27.982844 24541 raft_consensus.cc:493] T 833a2f0775ed407a94b8924ce50adb63 P e61c3a8f61bb48f8a963c9480e53c168 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 127766fc592545a4997f7790f50f6076)
I20260709 13:06:28.002213 19482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e5873a19244c5ebbcd38e126796ee7" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 16 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:06:27.990808 24485 raft_consensus.cc:697] T 76cb037fc9064d13b59a8969d897ce8c P 0473d2b2d01f4459b1e90fd12cc7840e [term 12 LEADER]: Becoming Leader. State: Replica: 0473d2b2d01f4459b1e90fd12cc7840e, State: Running, Role: LEADER
I20260709 13:06:27.997541 19449 leader_election.cc:304] T df751f992649444090e27965eb1af85d P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87; no voters: e61c3a8f61bb48f8a963c9480e53c168
W20260709 13:06:28.009552 20075 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:28.011327 19449 leader_election.cc:304] T a08760e15aac4630a629431f56024dc8 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87; no voters: e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:06:27.994387 24517 raft_consensus.cc:493] T 2b74109013a140ada21feeef92d6f563 P e61c3a8f61bb48f8a963c9480e53c168 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 0473d2b2d01f4459b1e90fd12cc7840e)
I20260709 13:06:28.014264 19374 leader_election.cc:304] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, 127766fc592545a4997f7790f50f6076
I20260709 13:06:28.019373 24567 consensus_queue.cc:1059] T 65d8cb8d6ec64f459d5a47cefab10acf P 127766fc592545a4997f7790f50f6076 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 }, Status: INVALID_TERM, Last received: 13.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.040s
I20260709 13:06:28.020361 24567 raft_consensus.cc:3055] T 65d8cb8d6ec64f459d5a47cefab10acf P 127766fc592545a4997f7790f50f6076 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:06:28.020694 24567 raft_consensus.cc:740] T 65d8cb8d6ec64f459d5a47cefab10acf P 127766fc592545a4997f7790f50f6076 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 127766fc592545a4997f7790f50f6076, State: Running, Role: LEADER
I20260709 13:06:28.021533 24567 consensus_queue.cc:260] T 65d8cb8d6ec64f459d5a47cefab10acf P 127766fc592545a4997f7790f50f6076 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.10, Last appended by leader: 10, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:28.007390 24483 raft_consensus.cc:2804] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P 127766fc592545a4997f7790f50f6076 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:06:27.998380 24471 raft_consensus.cc:2749] T 14efcc79969f41babe5529c22d59156d P 0473d2b2d01f4459b1e90fd12cc7840e [term 16 FOLLOWER]: Leader pre-election lost for term 15. Reason: Vote denied by peer e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321) with higher term. Message: Invalid argument: T 14efcc79969f41babe5529c22d59156d P e5256d91808b47c195bc9b4dbd7f2b87 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0473d2b2d01f4459b1e90fd12cc7840e for earlier term 15. Current term is 16.
W20260709 13:06:28.027940 20078 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:28.042282 19555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65d8cb8d6ec64f459d5a47cefab10acf" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:06:28.042817 19555 raft_consensus.cc:3060] T 65d8cb8d6ec64f459d5a47cefab10acf P e61c3a8f61bb48f8a963c9480e53c168 [term 13 FOLLOWER]: Advancing to term 15
I20260709 13:06:28.022655 24567 raft_consensus.cc:3060] T 65d8cb8d6ec64f459d5a47cefab10acf P 127766fc592545a4997f7790f50f6076 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:06:28.043673 19293 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet ab43d85f64114d4ebf618930e43d9ed0 with cas_config_opid_index 5: ChangeConfig:REMOVE_PEER succeeded (attempt 12)
I20260709 13:06:28.044993 24474 raft_consensus.cc:2804] T a08760e15aac4630a629431f56024dc8 P 0473d2b2d01f4459b1e90fd12cc7840e [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:06:28.045568 24474 raft_consensus.cc:697] T a08760e15aac4630a629431f56024dc8 P 0473d2b2d01f4459b1e90fd12cc7840e [term 17 LEADER]: Becoming Leader. State: Replica: 0473d2b2d01f4459b1e90fd12cc7840e, State: Running, Role: LEADER
I20260709 13:06:28.046428 24474 consensus_queue.cc:237] T a08760e15aac4630a629431f56024dc8 P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 16.9, Last appended by leader: 9, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:28.046799 24564 consensus_queue.cc:1059] T e381f1d6b8184797ad142de49be225a8 P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 }, Status: INVALID_TERM, Last received: 10.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.046s
I20260709 13:06:28.005817 24551 raft_consensus.cc:493] T 4509b76741dc428e9201c70c1658da13 P e5256d91808b47c195bc9b4dbd7f2b87 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:06:28.048982 19523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.1:40321, user_credentials={real_user=slave}} blocked reactor thread for 95229.6us
I20260709 13:06:27.983282 24553 raft_consensus.cc:515] T ed7fdbcb96d14d418db9ca90a792588a P 0473d2b2d01f4459b1e90fd12cc7840e [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
W20260709 13:06:28.055332 24569 log.cc:927] Time spent T ff9b0eddd810459b82d91c60777c10eb P 127766fc592545a4997f7790f50f6076: Append to log took a long time: real 0.055s	user 0.001s	sys 0.000s
I20260709 13:06:28.027094 24517 raft_consensus.cc:3060] T 2b74109013a140ada21feeef92d6f563 P e61c3a8f61bb48f8a963c9480e53c168 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:06:28.023458 24457 leader_election.cc:290] T 65d8cb8d6ec64f459d5a47cefab10acf P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 15 election: Requested vote from peers e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:06:28.025533 24483 raft_consensus.cc:697] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P 127766fc592545a4997f7790f50f6076 [term 16 LEADER]: Becoming Leader. State: Replica: 127766fc592545a4997f7790f50f6076, State: Running, Role: LEADER
I20260709 13:06:28.043479 24508 raft_consensus.cc:2804] T df751f992649444090e27965eb1af85d P 0473d2b2d01f4459b1e90fd12cc7840e [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:06:28.085436 19484 raft_consensus.cc:1240] T ed7fdbcb96d14d418db9ca90a792588a P 0473d2b2d01f4459b1e90fd12cc7840e [term 10 FOLLOWER]: Rejecting Update request from peer 127766fc592545a4997f7790f50f6076 for earlier term 9. Current term is 10. Ops: []
I20260709 13:06:28.092034 24553 leader_election.cc:290] T ed7fdbcb96d14d418db9ca90a792588a P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 10 election: Requested vote from peers e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:06:28.094941 24485 consensus_queue.cc:237] T 76cb037fc9064d13b59a8969d897ce8c P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:28.003976 24516 raft_consensus.cc:515] T 14935b3ddf914369822e4a0547aaa355 P e61c3a8f61bb48f8a963c9480e53c168 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } attrs { replace: true } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
W20260709 13:06:28.083046 19450 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.3:36891, user_credentials={real_user=slave}} blocked reactor thread for 65909.9us
I20260709 13:06:28.060093 24551 raft_consensus.cc:515] T 4509b76741dc428e9201c70c1658da13 P e5256d91808b47c195bc9b4dbd7f2b87 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:28.103638 24494 leader_election.cc:290] T 2725d2c4cb054f18b0fc8f735c15f6c2 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 17 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:06:28.041654 24507 raft_consensus.cc:515] T 179fd671030940b4b4a4e24bcc4aba0a P e5256d91808b47c195bc9b4dbd7f2b87 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:28.056654 24370 raft_consensus.cc:2749] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P e5256d91808b47c195bc9b4dbd7f2b87 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:06:28.109333 20106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65d8cb8d6ec64f459d5a47cefab10acf" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076"
I20260709 13:06:28.114883 24559 raft_consensus.cc:515] T 62c6c134d3d24a1ab144dd9ee6bc3f64 P 0473d2b2d01f4459b1e90fd12cc7840e [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:27.995682 24509 consensus_queue.cc:260] T ab43d85f64114d4ebf618930e43d9ed0 P 127766fc592545a4997f7790f50f6076 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:28.122021 19479 raft_consensus.cc:1275] T ff9b0eddd810459b82d91c60777c10eb P 0473d2b2d01f4459b1e90fd12cc7840e [term 15 FOLLOWER]: Refusing update from remote peer e5256d91808b47c195bc9b4dbd7f2b87: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 15 index: 11. (term mismatch)
I20260709 13:06:28.123474 19479 pending_rounds.cc:85] T ff9b0eddd810459b82d91c60777c10eb P 0473d2b2d01f4459b1e90fd12cc7840e: Aborting all ops after (but not including) 10
W20260709 13:06:28.123852 20076 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.3:36891, user_credentials={real_user=slave}} blocked reactor thread for 128647us
I20260709 13:06:28.127336 19450 leader_election.cc:304] T 48824d5acfbc485ebf8c2d944e7202de P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:06:28.131352 19555 raft_consensus.cc:2468] T 65d8cb8d6ec64f459d5a47cefab10acf P e61c3a8f61bb48f8a963c9480e53c168 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 15.
I20260709 13:06:28.099486 24305 raft_consensus.cc:493] T 1a61655d99124a29b486ba4a5b37faea P e5256d91808b47c195bc9b4dbd7f2b87 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:28.139953 19556 raft_consensus.cc:2410] T d1e5873a19244c5ebbcd38e126796ee7 P e61c3a8f61bb48f8a963c9480e53c168 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate e5256d91808b47c195bc9b4dbd7f2b87 for term 16 because replica has last-logged OpId of term: 14 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 7.
I20260709 13:06:28.123826 19479 pending_rounds.cc:107] T ff9b0eddd810459b82d91c60777c10eb P 0473d2b2d01f4459b1e90fd12cc7840e: Aborting uncommitted NO_OP operation due to leader change: 14.11
I20260709 13:06:28.140708 19479 raft_consensus.cc:2889] T ff9b0eddd810459b82d91c60777c10eb P 0473d2b2d01f4459b1e90fd12cc7840e [term 15 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:06:28.145288 19480 raft_consensus.cc:1240] T 62c6c134d3d24a1ab144dd9ee6bc3f64 P 0473d2b2d01f4459b1e90fd12cc7840e [term 14 FOLLOWER]: Rejecting Update request from peer 127766fc592545a4997f7790f50f6076 for earlier term 13. Current term is 14. Ops: []
I20260709 13:06:28.146028 19553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed7fdbcb96d14d418db9ca90a792588a" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:06:28.148820 19553 raft_consensus.cc:3060] T ed7fdbcb96d14d418db9ca90a792588a P e61c3a8f61bb48f8a963c9480e53c168 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:06:28.068842 24541 raft_consensus.cc:515] T 833a2f0775ed407a94b8924ce50adb63 P e61c3a8f61bb48f8a963c9480e53c168 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:28.154023 19552 raft_consensus.cc:1275] T 46c5bfeecc314717bffe987e6844b6d0 P e61c3a8f61bb48f8a963c9480e53c168 [term 19 FOLLOWER]: Refusing update from remote peer 0473d2b2d01f4459b1e90fd12cc7840e: Log matching property violated. Preceding OpId in replica: term: 18 index: 8. Preceding OpId from leader: term: 19 index: 9. (index mismatch)
I20260709 13:06:28.154551 24541 leader_election.cc:290] T 833a2f0775ed407a94b8924ce50adb63 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:06:28.136921 24471 raft_consensus.cc:2804] T 48824d5acfbc485ebf8c2d944e7202de P 0473d2b2d01f4459b1e90fd12cc7840e [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:06:28.159664 19523 leader_election.cc:304] T 22196caba61445d3bec98a0aab3c337d P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e61c3a8f61bb48f8a963c9480e53c168; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:06:28.161465 19523 leader_election.cc:304] T bc225c93219c45538b53a1bd3d387e4d P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e61c3a8f61bb48f8a963c9480e53c168; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:06:28.165007 24516 leader_election.cc:290] T 14935b3ddf914369822e4a0547aaa355 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:06:28.165827 24516 raft_consensus.cc:2749] T 22196caba61445d3bec98a0aab3c337d P e61c3a8f61bb48f8a963c9480e53c168 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:06:28.123164 24508 raft_consensus.cc:697] T df751f992649444090e27965eb1af85d P 0473d2b2d01f4459b1e90fd12cc7840e [term 17 LEADER]: Becoming Leader. State: Replica: 0473d2b2d01f4459b1e90fd12cc7840e, State: Running, Role: LEADER
I20260709 13:06:28.188446 19553 raft_consensus.cc:2468] T ed7fdbcb96d14d418db9ca90a792588a P e61c3a8f61bb48f8a963c9480e53c168 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 10.
I20260709 13:06:28.193019 19559 raft_consensus.cc:2468] T ab43d85f64114d4ebf618930e43d9ed0 P e61c3a8f61bb48f8a963c9480e53c168 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 15.
W20260709 13:06:28.201139 20076 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:28.115464 24483 consensus_queue.cc:237] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P 127766fc592545a4997f7790f50f6076 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:28.202663 19406 raft_consensus.cc:1275] T 1f85fc4b527a48848e5faa083b604e36 P e5256d91808b47c195bc9b4dbd7f2b87 [term 13 FOLLOWER]: Refusing update from remote peer 127766fc592545a4997f7790f50f6076: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
W20260709 13:06:28.204139 19524 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:28.166646 24516 raft_consensus.cc:3060] T bc225c93219c45538b53a1bd3d387e4d P e61c3a8f61bb48f8a963c9480e53c168 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:06:28.138094 24517 raft_consensus.cc:515] T 2b74109013a140ada21feeef92d6f563 P e61c3a8f61bb48f8a963c9480e53c168 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
W20260709 13:06:28.207286 19449 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.1:40321, user_credentials={real_user=slave}} blocked reactor thread for 196059us
I20260709 13:06:28.169006 24509 raft_consensus.cc:3060] T ab43d85f64114d4ebf618930e43d9ed0 P 127766fc592545a4997f7790f50f6076 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:06:28.208056 19449 leader_election.cc:304] T edd7d470b5014c9489be7f41f64355c9 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87; no voters: e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:06:28.195250 24471 raft_consensus.cc:697] T 48824d5acfbc485ebf8c2d944e7202de P 0473d2b2d01f4459b1e90fd12cc7840e [term 16 LEADER]: Becoming Leader. State: Replica: 0473d2b2d01f4459b1e90fd12cc7840e, State: Running, Role: LEADER
I20260709 13:06:28.173238 24507 leader_election.cc:290] T 179fd671030940b4b4a4e24bcc4aba0a P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:06:28.201514 24422 raft_consensus.cc:493] T 4509b76741dc428e9201c70c1658da13 P 0473d2b2d01f4459b1e90fd12cc7840e [term 8 FOLLOWER]: Starting pre-election (detected failure of leader e5256d91808b47c195bc9b4dbd7f2b87)
I20260709 13:06:28.148698 24305 raft_consensus.cc:515] T 1a61655d99124a29b486ba4a5b37faea P e5256d91808b47c195bc9b4dbd7f2b87 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:28.220569 19554 raft_consensus.cc:1240] T 2b74109013a140ada21feeef92d6f563 P e61c3a8f61bb48f8a963c9480e53c168 [term 11 FOLLOWER]: Rejecting Update request from peer 0473d2b2d01f4459b1e90fd12cc7840e for earlier term 10. Current term is 11. Ops: []
I20260709 13:06:28.221328 19479 raft_consensus.cc:1275] T 1f85fc4b527a48848e5faa083b604e36 P 0473d2b2d01f4459b1e90fd12cc7840e [term 13 FOLLOWER]: Refusing update from remote peer 127766fc592545a4997f7790f50f6076: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:06:28.230800 19523 leader_election.cc:304] T 4af19371ea874c09a0a2147040835cbb P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e61c3a8f61bb48f8a963c9480e53c168; no voters: 127766fc592545a4997f7790f50f6076, e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:06:28.231719 24543 raft_consensus.cc:2749] T 4af19371ea874c09a0a2147040835cbb P e61c3a8f61bb48f8a963c9480e53c168 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:06:28.232343 19523 leader_election.cc:304] T 1efebf73c86e432baa55533136b6e12c P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e61c3a8f61bb48f8a963c9480e53c168; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, 127766fc592545a4997f7790f50f6076
I20260709 13:06:28.233616 24543 raft_consensus.cc:2749] T 1efebf73c86e432baa55533136b6e12c P e61c3a8f61bb48f8a963c9480e53c168 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:06:28.213263 24384 consensus_queue.cc:1048] T 1f85fc4b527a48848e5faa083b604e36 P 127766fc592545a4997f7790f50f6076 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.008s
I20260709 13:06:28.235154 24412 raft_consensus.cc:493] T ff75a1d4cb1f493db8f71ddc136ba9ab P e5256d91808b47c195bc9b4dbd7f2b87 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:28.236475 24412 raft_consensus.cc:515] T ff75a1d4cb1f493db8f71ddc136ba9ab P e5256d91808b47c195bc9b4dbd7f2b87 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:28.239228 24397 raft_consensus.cc:3055] T e381f1d6b8184797ad142de49be225a8 P 0473d2b2d01f4459b1e90fd12cc7840e [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:06:28.239637 24397 raft_consensus.cc:740] T e381f1d6b8184797ad142de49be225a8 P 0473d2b2d01f4459b1e90fd12cc7840e [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 0473d2b2d01f4459b1e90fd12cc7840e, State: Running, Role: LEADER
I20260709 13:06:28.240489 24397 consensus_queue.cc:260] T e381f1d6b8184797ad142de49be225a8 P 0473d2b2d01f4459b1e90fd12cc7840e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:28.234617 19523 leader_election.cc:304] T ed7fdbcb96d14d418db9ca90a792588a P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e61c3a8f61bb48f8a963c9480e53c168; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, 127766fc592545a4997f7790f50f6076
I20260709 13:06:28.242012 24384 raft_consensus.cc:493] T fa731b585f684a7fb2d106c50f143b83 P 127766fc592545a4997f7790f50f6076 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:28.254806 24412 leader_election.cc:290] T ff75a1d4cb1f493db8f71ddc136ba9ab P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
W20260709 13:06:28.302376 19449 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.1:40321, user_credentials={real_user=slave}} blocked reactor thread for 94395us
I20260709 13:06:28.213760 24555 consensus_queue.cc:1048] T ff9b0eddd810459b82d91c60777c10eb P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.039s
I20260709 13:06:28.321870 19482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2725d2c4cb054f18b0fc8f735c15f6c2" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
W20260709 13:06:28.306238 19450 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.3:36891, user_credentials={real_user=slave}} blocked reactor thread for 52797us
I20260709 13:06:28.322664 19482 raft_consensus.cc:3060] T 2725d2c4cb054f18b0fc8f735c15f6c2 P 0473d2b2d01f4459b1e90fd12cc7840e [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:06:28.323196 19450 leader_election.cc:304] T ed7fdbcb96d14d418db9ca90a792588a P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:06:28.324101 19450 leader_election.cc:304] T ab43d85f64114d4ebf618930e43d9ed0 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:06:28.306366 24541 raft_consensus.cc:493] T 76cb037fc9064d13b59a8969d897ce8c P e61c3a8f61bb48f8a963c9480e53c168 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader e5256d91808b47c195bc9b4dbd7f2b87)
I20260709 13:06:28.326529 24141 consensus_queue.cc:1048] T 1f85fc4b527a48848e5faa083b604e36 P 127766fc592545a4997f7790f50f6076 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:06:28.326920 24541 raft_consensus.cc:515] T 76cb037fc9064d13b59a8969d897ce8c P e61c3a8f61bb48f8a963c9480e53c168 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:28.327898 19477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14935b3ddf914369822e4a0547aaa355" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:06:28.328212 24141 consensus_queue.cc:1059] T 62c6c134d3d24a1ab144dd9ee6bc3f64 P 127766fc592545a4997f7790f50f6076 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 }, Status: INVALID_TERM, Last received: 13.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:06:28.328902 24541 leader_election.cc:290] T 76cb037fc9064d13b59a8969d897ce8c P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:06:28.329226 24141 raft_consensus.cc:3055] T 62c6c134d3d24a1ab144dd9ee6bc3f64 P 127766fc592545a4997f7790f50f6076 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:06:28.329581 24141 raft_consensus.cc:740] T 62c6c134d3d24a1ab144dd9ee6bc3f64 P 127766fc592545a4997f7790f50f6076 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 127766fc592545a4997f7790f50f6076, State: Running, Role: LEADER
I20260709 13:06:28.330440 24276 raft_consensus.cc:2804] T ed7fdbcb96d14d418db9ca90a792588a P 0473d2b2d01f4459b1e90fd12cc7840e [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:06:28.331064 24276 raft_consensus.cc:697] T ed7fdbcb96d14d418db9ca90a792588a P 0473d2b2d01f4459b1e90fd12cc7840e [term 10 LEADER]: Becoming Leader. State: Replica: 0473d2b2d01f4459b1e90fd12cc7840e, State: Running, Role: LEADER
I20260709 13:06:28.331192 24576 raft_consensus.cc:2804] T ab43d85f64114d4ebf618930e43d9ed0 P 0473d2b2d01f4459b1e90fd12cc7840e [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:06:28.331755 24576 raft_consensus.cc:697] T ab43d85f64114d4ebf618930e43d9ed0 P 0473d2b2d01f4459b1e90fd12cc7840e [term 15 LEADER]: Becoming Leader. State: Replica: 0473d2b2d01f4459b1e90fd12cc7840e, State: Running, Role: LEADER
I20260709 13:06:28.332327 19559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62c6c134d3d24a1ab144dd9ee6bc3f64" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:06:28.332010 24276 consensus_queue.cc:237] T ed7fdbcb96d14d418db9ca90a792588a P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:28.332907 19559 raft_consensus.cc:3060] T 62c6c134d3d24a1ab144dd9ee6bc3f64 P e61c3a8f61bb48f8a963c9480e53c168 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:06:28.332613 24576 consensus_queue.cc:237] T ab43d85f64114d4ebf618930e43d9ed0 P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.9, Last appended by leader: 9, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:28.335005 19483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "179fd671030940b4b4a4e24bcc4aba0a" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:06:28.335628 19483 raft_consensus.cc:2468] T 179fd671030940b4b4a4e24bcc4aba0a P 0473d2b2d01f4459b1e90fd12cc7840e [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 15.
I20260709 13:06:28.338459 19481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff75a1d4cb1f493db8f71ddc136ba9ab" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:06:28.341404 19486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b74109013a140ada21feeef92d6f563" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:06:28.343529 20111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48824d5acfbc485ebf8c2d944e7202de" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076"
I20260709 13:06:28.344139 20105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62c6c134d3d24a1ab144dd9ee6bc3f64" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:06:28.345302 20110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab43d85f64114d4ebf618930e43d9ed0" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076"
I20260709 13:06:28.345482 20109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed7fdbcb96d14d418db9ca90a792588a" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076"
I20260709 13:06:28.330402 24141 consensus_queue.cc:260] T 62c6c134d3d24a1ab144dd9ee6bc3f64 P 127766fc592545a4997f7790f50f6076 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:28.309147 24551 leader_election.cc:290] T 4509b76741dc428e9201c70c1658da13 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:06:28.306275 24478 raft_consensus.cc:2804] T edd7d470b5014c9489be7f41f64355c9 P 0473d2b2d01f4459b1e90fd12cc7840e [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:06:28.306223 24543 raft_consensus.cc:2749] T ed7fdbcb96d14d418db9ca90a792588a P e61c3a8f61bb48f8a963c9480e53c168 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:06:28.223328 24474 consensus_queue.cc:1048] T 46c5bfeecc314717bffe987e6844b6d0 P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.071s
I20260709 13:06:28.307525 24517 leader_election.cc:290] T 2b74109013a140ada21feeef92d6f563 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 11 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:06:28.293246 24422 raft_consensus.cc:515] T 4509b76741dc428e9201c70c1658da13 P 0473d2b2d01f4459b1e90fd12cc7840e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:28.310909 24305 leader_election.cc:290] T 1a61655d99124a29b486ba4a5b37faea P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
W20260709 13:06:28.312583 19523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.4:43121, user_credentials={real_user=slave}} blocked reactor thread for 78071us
I20260709 13:06:28.350152 19523 leader_election.cc:304] T 0afb57ae58a24a01850491d69f0213dd P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e61c3a8f61bb48f8a963c9480e53c168; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, 127766fc592545a4997f7790f50f6076
I20260709 13:06:28.350495 24422 leader_election.cc:290] T 4509b76741dc428e9201c70c1658da13 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
W20260709 13:06:28.311759 24569 log.cc:927] Time spent T ff9b0eddd810459b82d91c60777c10eb P 127766fc592545a4997f7790f50f6076: Append to log took a long time: real 0.057s	user 0.001s	sys 0.000s
I20260709 13:06:28.351163 19482 raft_consensus.cc:2468] T 2725d2c4cb054f18b0fc8f735c15f6c2 P 0473d2b2d01f4459b1e90fd12cc7840e [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 17.
I20260709 13:06:28.351969 19559 raft_consensus.cc:2468] T 62c6c134d3d24a1ab144dd9ee6bc3f64 P e61c3a8f61bb48f8a963c9480e53c168 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 14.
I20260709 13:06:28.352239 19523 leader_election.cc:304] T 62c6c134d3d24a1ab144dd9ee6bc3f64 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e61c3a8f61bb48f8a963c9480e53c168; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, 127766fc592545a4997f7790f50f6076
I20260709 13:06:28.353119 24543 raft_consensus.cc:2749] T 0afb57ae58a24a01850491d69f0213dd P e61c3a8f61bb48f8a963c9480e53c168 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:06:28.353952 24543 raft_consensus.cc:2749] T 62c6c134d3d24a1ab144dd9ee6bc3f64 P e61c3a8f61bb48f8a963c9480e53c168 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:06:28.315503 24516 raft_consensus.cc:2749] T bc225c93219c45538b53a1bd3d387e4d P e61c3a8f61bb48f8a963c9480e53c168 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:06:28.357059 19404 raft_consensus.cc:1240] T d1e5873a19244c5ebbcd38e126796ee7 P e5256d91808b47c195bc9b4dbd7f2b87 [term 16 FOLLOWER]: Rejecting Update request from peer 0473d2b2d01f4459b1e90fd12cc7840e for earlier term 15. Current term is 16. Ops: []
I20260709 13:06:28.358521 19409 raft_consensus.cc:1275] T 46c5bfeecc314717bffe987e6844b6d0 P e5256d91808b47c195bc9b4dbd7f2b87 [term 19 FOLLOWER]: Refusing update from remote peer 0473d2b2d01f4459b1e90fd12cc7840e: Log matching property violated. Preceding OpId in replica: term: 18 index: 8. Preceding OpId from leader: term: 19 index: 9. (index mismatch)
I20260709 13:06:28.317929 20106 raft_consensus.cc:2410] T 65d8cb8d6ec64f459d5a47cefab10acf P 127766fc592545a4997f7790f50f6076 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate e5256d91808b47c195bc9b4dbd7f2b87 for term 15 because replica has last-logged OpId of term: 14 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 9.
I20260709 13:06:28.303095 24508 consensus_queue.cc:237] T df751f992649444090e27965eb1af85d P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:28.306398 24384 raft_consensus.cc:515] T fa731b585f684a7fb2d106c50f143b83 P 127766fc592545a4997f7790f50f6076 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:28.347047 20103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed7fdbcb96d14d418db9ca90a792588a" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:06:28.348465 24141 raft_consensus.cc:3060] T 62c6c134d3d24a1ab144dd9ee6bc3f64 P 127766fc592545a4997f7790f50f6076 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:06:28.349483 19479 raft_consensus.cc:1240] T a08760e15aac4630a629431f56024dc8 P 0473d2b2d01f4459b1e90fd12cc7840e [term 17 LEADER]: Rejecting Update request from peer e61c3a8f61bb48f8a963c9480e53c168 for earlier term 16. Current term is 17. Ops: []
I20260709 13:06:28.300436 24471 consensus_queue.cc:237] T 48824d5acfbc485ebf8c2d944e7202de P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.11, Last appended by leader: 11, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:28.359345 20111 raft_consensus.cc:2468] T 48824d5acfbc485ebf8c2d944e7202de P 127766fc592545a4997f7790f50f6076 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 16.
I20260709 13:06:28.363915 19377 leader_election.cc:304] T 179fd671030940b4b4a4e24bcc4aba0a P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87; no voters: 
I20260709 13:06:28.350147 24374 raft_consensus.cc:493] T 1dc5b3532fe54f74876d02beffa2c230 P e5256d91808b47c195bc9b4dbd7f2b87 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:28.364971 20110 raft_consensus.cc:2468] T ab43d85f64114d4ebf618930e43d9ed0 P 127766fc592545a4997f7790f50f6076 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 15.
W20260709 13:06:28.346954 24579 log.cc:927] Time spent T a08760e15aac4630a629431f56024dc8 P 0473d2b2d01f4459b1e90fd12cc7840e: Append to log took a long time: real 0.122s	user 0.001s	sys 0.000s
W20260709 13:06:28.371510 20075 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:28.378746 19559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4509b76741dc428e9201c70c1658da13" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
W20260709 13:06:28.382342 19449 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:28.373780 24478 raft_consensus.cc:697] T edd7d470b5014c9489be7f41f64355c9 P 0473d2b2d01f4459b1e90fd12cc7840e [term 15 LEADER]: Becoming Leader. State: Replica: 0473d2b2d01f4459b1e90fd12cc7840e, State: Running, Role: LEADER
I20260709 13:06:28.383756 19559 raft_consensus.cc:2393] T 4509b76741dc428e9201c70c1658da13 P e61c3a8f61bb48f8a963c9480e53c168 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0473d2b2d01f4459b1e90fd12cc7840e in current term 9: Already voted for candidate e61c3a8f61bb48f8a963c9480e53c168 in this term.
I20260709 13:06:28.383653 19523 leader_election.cc:304] T 6c5eebf646ad445a9d1b1adc319d7b16 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e61c3a8f61bb48f8a963c9480e53c168; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, 127766fc592545a4997f7790f50f6076
I20260709 13:06:28.384467 24478 consensus_queue.cc:237] T edd7d470b5014c9489be7f41f64355c9 P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 14.7, Last appended by leader: 7, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:28.384961 19523 leader_election.cc:304] T 2a16f7501e2444fb86d4e2778e734e02 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e61c3a8f61bb48f8a963c9480e53c168; no voters: 127766fc592545a4997f7790f50f6076, e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:06:28.386838 24516 raft_consensus.cc:2749] T 6c5eebf646ad445a9d1b1adc319d7b16 P e61c3a8f61bb48f8a963c9480e53c168 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:06:28.386884 24374 raft_consensus.cc:515] T 1dc5b3532fe54f74876d02beffa2c230 P e5256d91808b47c195bc9b4dbd7f2b87 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:28.387696 24516 raft_consensus.cc:2749] T 2a16f7501e2444fb86d4e2778e734e02 P e61c3a8f61bb48f8a963c9480e53c168 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:06:28.389119 24374 leader_election.cc:290] T 1dc5b3532fe54f74876d02beffa2c230 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:06:28.398523 24384 leader_election.cc:290] T fa731b585f684a7fb2d106c50f143b83 P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:06:28.375522 24555 raft_consensus.cc:493] T ef32ce6fdd0e40d382c79974f30295c6 P e5256d91808b47c195bc9b4dbd7f2b87 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:28.401093 24555 raft_consensus.cc:515] T ef32ce6fdd0e40d382c79974f30295c6 P e5256d91808b47c195bc9b4dbd7f2b87 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:28.401473 20103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48824d5acfbc485ebf8c2d944e7202de" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 16 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:06:28.402384 20103 raft_consensus.cc:2393] T 48824d5acfbc485ebf8c2d944e7202de P 127766fc592545a4997f7790f50f6076 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e61c3a8f61bb48f8a963c9480e53c168 in current term 16: Already voted for candidate 0473d2b2d01f4459b1e90fd12cc7840e in this term.
I20260709 13:06:28.403227 24555 leader_election.cc:290] T ef32ce6fdd0e40d382c79974f30295c6 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:06:28.403481 24517 raft_consensus.cc:493] T 3e1f505cb0f1427bbd698ac889d80821 P e61c3a8f61bb48f8a963c9480e53c168 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:28.404029 24517 raft_consensus.cc:515] T 3e1f505cb0f1427bbd698ac889d80821 P e61c3a8f61bb48f8a963c9480e53c168 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:28.406105 24517 leader_election.cc:290] T 3e1f505cb0f1427bbd698ac889d80821 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
W20260709 13:06:28.406518 24580 log.cc:927] Time spent T fa8650e71aa14778b3d73721fc50d9fc P 0473d2b2d01f4459b1e90fd12cc7840e: Append to log took a long time: real 0.100s	user 0.003s	sys 0.000s
I20260709 13:06:28.407755 20103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e1085d23e8347fbbd5bce7542f4b1f4" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:06:28.409214 24559 leader_election.cc:290] T 62c6c134d3d24a1ab144dd9ee6bc3f64 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 14 election: Requested vote from peers e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:06:28.409850 24412 raft_consensus.cc:2804] T 179fd671030940b4b4a4e24bcc4aba0a P e5256d91808b47c195bc9b4dbd7f2b87 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:06:28.410312 24412 raft_consensus.cc:493] T 179fd671030940b4b4a4e24bcc4aba0a P e5256d91808b47c195bc9b4dbd7f2b87 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:28.410692 24412 raft_consensus.cc:3060] T 179fd671030940b4b4a4e24bcc4aba0a P e5256d91808b47c195bc9b4dbd7f2b87 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:06:28.414556 19406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff75a1d4cb1f493db8f71ddc136ba9ab" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 14 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
I20260709 13:06:28.416981 19559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff75a1d4cb1f493db8f71ddc136ba9ab" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:06:28.417240 19406 raft_consensus.cc:2410] T ff75a1d4cb1f493db8f71ddc136ba9ab P e5256d91808b47c195bc9b4dbd7f2b87 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate e61c3a8f61bb48f8a963c9480e53c168 for term 14 because replica has last-logged OpId of term: 13 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 6.
I20260709 13:06:28.417608 19559 raft_consensus.cc:2468] T ff75a1d4cb1f493db8f71ddc136ba9ab P e61c3a8f61bb48f8a963c9480e53c168 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 14.
I20260709 13:06:28.418186 19560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "179fd671030940b4b4a4e24bcc4aba0a" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:06:28.418897 19553 raft_consensus.cc:1275] T 28af091831594f9d8e96482078cc7625 P e61c3a8f61bb48f8a963c9480e53c168 [term 15 FOLLOWER]: Refusing update from remote peer e5256d91808b47c195bc9b4dbd7f2b87: Log matching property violated. Preceding OpId in replica: term: 14 index: 7. Preceding OpId from leader: term: 15 index: 8. (index mismatch)
I20260709 13:06:28.419024 19556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4509b76741dc428e9201c70c1658da13" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:06:28.419661 19556 raft_consensus.cc:2468] T 4509b76741dc428e9201c70c1658da13 P e61c3a8f61bb48f8a963c9480e53c168 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 9.
I20260709 13:06:28.420568 19551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a61655d99124a29b486ba4a5b37faea" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:06:28.421206 19551 raft_consensus.cc:2468] T 1a61655d99124a29b486ba4a5b37faea P e61c3a8f61bb48f8a963c9480e53c168 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 10.
I20260709 13:06:28.422116 19552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dc5b3532fe54f74876d02beffa2c230" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 15 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:06:28.422840 19552 raft_consensus.cc:2393] T 1dc5b3532fe54f74876d02beffa2c230 P e61c3a8f61bb48f8a963c9480e53c168 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e5256d91808b47c195bc9b4dbd7f2b87 in current term 15: Already voted for candidate e61c3a8f61bb48f8a963c9480e53c168 in this term.
I20260709 13:06:28.423605 19558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef32ce6fdd0e40d382c79974f30295c6" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:06:28.427306 19406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1b10566f45d4a7d9029858330e02d5b" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:06:28.424284 19558 raft_consensus.cc:2468] T ef32ce6fdd0e40d382c79974f30295c6 P e61c3a8f61bb48f8a963c9480e53c168 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 16.
I20260709 13:06:28.430042 19405 raft_consensus.cc:1275] T 70797e5783b5454ab0d0eea663e791e3 P e5256d91808b47c195bc9b4dbd7f2b87 [term 14 FOLLOWER]: Refusing update from remote peer 127766fc592545a4997f7790f50f6076: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 13:06:28.424958 19560 raft_consensus.cc:2468] T 179fd671030940b4b4a4e24bcc4aba0a P e61c3a8f61bb48f8a963c9480e53c168 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 15.
I20260709 13:06:28.432613 19405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa731b585f684a7fb2d106c50f143b83" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:06:28.433192 19405 raft_consensus.cc:2468] T fa731b585f684a7fb2d106c50f143b83 P e5256d91808b47c195bc9b4dbd7f2b87 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 127766fc592545a4997f7790f50f6076 in term 11.
I20260709 13:06:28.435457 19410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86a6797bdfe94fa496c050ceae4bd0d9" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:06:28.434823 19402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4509b76741dc428e9201c70c1658da13" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
I20260709 13:06:28.465152 19410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edd7d470b5014c9489be7f41f64355c9" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 15 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:06:28.465939 19410 raft_consensus.cc:2393] T edd7d470b5014c9489be7f41f64355c9 P e5256d91808b47c195bc9b4dbd7f2b87 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e61c3a8f61bb48f8a963c9480e53c168 in current term 15: Already voted for candidate 0473d2b2d01f4459b1e90fd12cc7840e in this term.
W20260709 13:06:28.437796 20076 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.17.223.3:36891 timed out after 2.083s (SENT) [suppressed 32 similar messages]
I20260709 13:06:28.468255 19405 raft_consensus.cc:1240] T df751f992649444090e27965eb1af85d P e5256d91808b47c195bc9b4dbd7f2b87 [term 17 FOLLOWER]: Rejecting Update request from peer e61c3a8f61bb48f8a963c9480e53c168 for earlier term 16. Current term is 17. Ops: [14.9-16.10]
I20260709 13:06:28.438941 24573 raft_consensus.cc:493] T b08304a0a02b42d7840c4e8ee9a6bd1a P 0473d2b2d01f4459b1e90fd12cc7840e [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:28.475383 20103 raft_consensus.cc:1275] T 14efcc79969f41babe5529c22d59156d P 127766fc592545a4997f7790f50f6076 [term 16 FOLLOWER]: Refusing update from remote peer e5256d91808b47c195bc9b4dbd7f2b87: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 13:06:28.475871 20075 leader_election.cc:304] T fa731b585f684a7fb2d106c50f143b83 P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 127766fc592545a4997f7790f50f6076, e5256d91808b47c195bc9b4dbd7f2b87; no voters: 
I20260709 13:06:28.519455 24567 raft_consensus.cc:2804] T fa731b585f684a7fb2d106c50f143b83 P 127766fc592545a4997f7790f50f6076 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:06:28.519834 24567 raft_consensus.cc:493] T fa731b585f684a7fb2d106c50f143b83 P 127766fc592545a4997f7790f50f6076 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:28.520210 24567 raft_consensus.cc:3060] T fa731b585f684a7fb2d106c50f143b83 P 127766fc592545a4997f7790f50f6076 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:06:28.530153 24253 raft_consensus.cc:493] T 85c494af21f9457a85da47b9bc70c1fd P 127766fc592545a4997f7790f50f6076 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:28.475728 24413 consensus_queue.cc:1048] T 70797e5783b5454ab0d0eea663e791e3 P 127766fc592545a4997f7790f50f6076 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:06:28.476074 20105 raft_consensus.cc:2468] T 62c6c134d3d24a1ab144dd9ee6bc3f64 P 127766fc592545a4997f7790f50f6076 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 14.
I20260709 13:06:28.531644 19375 leader_election.cc:304] T 65d8cb8d6ec64f459d5a47cefab10acf P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:06:28.479346 24554 raft_consensus.cc:493] T 6c5eebf646ad445a9d1b1adc319d7b16 P 0473d2b2d01f4459b1e90fd12cc7840e [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:28.479549 24473 raft_consensus.cc:493] T ff75a1d4cb1f493db8f71ddc136ba9ab P 0473d2b2d01f4459b1e90fd12cc7840e [term 13 FOLLOWER]: Starting pre-election (detected failure of leader e5256d91808b47c195bc9b4dbd7f2b87)
I20260709 13:06:28.480302 24374 raft_consensus.cc:493] T bc225c93219c45538b53a1bd3d387e4d P e5256d91808b47c195bc9b4dbd7f2b87 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:06:28.483409 19449 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.4:43121, user_credentials={real_user=slave}} blocked reactor thread for 44135.1us
I20260709 13:06:28.440183 18300 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:06:28.484560 20111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65d8cb8d6ec64f459d5a47cefab10acf" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:06:28.486222 19484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a61655d99124a29b486ba4a5b37faea" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:06:28.486912 19480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dc5b3532fe54f74876d02beffa2c230" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 15 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:06:28.534946 20111 raft_consensus.cc:2368] T 65d8cb8d6ec64f459d5a47cefab10acf P 127766fc592545a4997f7790f50f6076 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e61c3a8f61bb48f8a963c9480e53c168 for earlier term 14. Current term is 15.
I20260709 13:06:28.535230 19480 raft_consensus.cc:2410] T 1dc5b3532fe54f74876d02beffa2c230 P 0473d2b2d01f4459b1e90fd12cc7840e [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e5256d91808b47c195bc9b4dbd7f2b87 for term 15 because replica has last-logged OpId of term: 14 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 6.
I20260709 13:06:28.490532 19485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef32ce6fdd0e40d382c79974f30295c6" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:06:28.491894 19483 raft_consensus.cc:1275] T 14efcc79969f41babe5529c22d59156d P 0473d2b2d01f4459b1e90fd12cc7840e [term 16 FOLLOWER]: Refusing update from remote peer e5256d91808b47c195bc9b4dbd7f2b87: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 13:06:28.536273 19375 leader_election.cc:304] T d1e5873a19244c5ebbcd38e126796ee7 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:06:28.492029 19482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4509b76741dc428e9201c70c1658da13" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:06:28.492504 19478 raft_consensus.cc:3055] T 28af091831594f9d8e96482078cc7625 P 0473d2b2d01f4459b1e90fd12cc7840e [term 14 LEADER]: Stepping down as leader of term 14
W20260709 13:06:28.494431 24581 log.cc:927] Time spent T ff9b0eddd810459b82d91c60777c10eb P e5256d91808b47c195bc9b4dbd7f2b87: Append to log took a long time: real 0.241s	user 0.000s	sys 0.009s
I20260709 13:06:28.497740 19410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa8650e71aa14778b3d73721fc50d9fc" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:06:28.536113 19485 raft_consensus.cc:2468] T ef32ce6fdd0e40d382c79974f30295c6 P 0473d2b2d01f4459b1e90fd12cc7840e [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 16.
I20260709 13:06:28.537289 19482 raft_consensus.cc:2468] T 4509b76741dc428e9201c70c1658da13 P 0473d2b2d01f4459b1e90fd12cc7840e [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 8.
I20260709 13:06:28.501014 19450 leader_election.cc:304] T 62c6c134d3d24a1ab144dd9ee6bc3f64 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:06:28.502780 19405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65d8cb8d6ec64f459d5a47cefab10acf" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:06:28.511616 19305 catalog_manager.cc:5697] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P e5256d91808b47c195bc9b4dbd7f2b87 reported cstate change: term changed from 11 to 14, leader changed from e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1) to 127766fc592545a4997f7790f50f6076 (127.17.223.4). New cstate: current_term: 14 leader_uuid: "127766fc592545a4997f7790f50f6076" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } } }
I20260709 13:06:28.515782 24397 raft_consensus.cc:3060] T e381f1d6b8184797ad142de49be225a8 P 0473d2b2d01f4459b1e90fd12cc7840e [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:06:28.537251 19484 raft_consensus.cc:2468] T 1a61655d99124a29b486ba4a5b37faea P 0473d2b2d01f4459b1e90fd12cc7840e [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 11.
I20260709 13:06:28.537611 19478 raft_consensus.cc:740] T 28af091831594f9d8e96482078cc7625 P 0473d2b2d01f4459b1e90fd12cc7840e [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 0473d2b2d01f4459b1e90fd12cc7840e, State: Running, Role: LEADER
I20260709 13:06:28.502269 24412 raft_consensus.cc:515] T 179fd671030940b4b4a4e24bcc4aba0a P e5256d91808b47c195bc9b4dbd7f2b87 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:28.546242 19305 catalog_manager.cc:5697] T 46c5bfeecc314717bffe987e6844b6d0 P e5256d91808b47c195bc9b4dbd7f2b87 reported cstate change: term changed from 16 to 18. New cstate: current_term: 18 leader_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:28.544813 19375 leader_election.cc:304] T ff75a1d4cb1f493db8f71ddc136ba9ab P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168; no voters: 0473d2b2d01f4459b1e90fd12cc7840e
I20260709 13:06:28.552155 20111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96efeaaf1057492490e9a621f37e1a2d" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 16 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:06:28.555949 20111 raft_consensus.cc:2468] T 96efeaaf1057492490e9a621f37e1a2d P 127766fc592545a4997f7790f50f6076 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 15.
I20260709 13:06:28.534209 24305 raft_consensus.cc:2804] T 65d8cb8d6ec64f459d5a47cefab10acf P e5256d91808b47c195bc9b4dbd7f2b87 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:06:28.530828 24253 raft_consensus.cc:515] T 85c494af21f9457a85da47b9bc70c1fd P 127766fc592545a4997f7790f50f6076 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:28.557507 19560 raft_consensus.cc:1240] T 28af091831594f9d8e96482078cc7625 P e61c3a8f61bb48f8a963c9480e53c168 [term 15 FOLLOWER]: Rejecting Update request from peer 0473d2b2d01f4459b1e90fd12cc7840e for earlier term 14. Current term is 15. Ops: []
I20260709 13:06:28.560282 19375 leader_election.cc:304] T 4509b76741dc428e9201c70c1658da13 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:06:28.517796 24573 raft_consensus.cc:515] T b08304a0a02b42d7840c4e8ee9a6bd1a P 0473d2b2d01f4459b1e90fd12cc7840e [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:28.568950 20106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa731b585f684a7fb2d106c50f143b83" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:06:28.571100 19375 leader_election.cc:304] T 1a61655d99124a29b486ba4a5b37faea P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:06:28.571527 19377 leader_election.cc:304] T ef32ce6fdd0e40d382c79974f30295c6 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87; no voters: 
I20260709 13:06:28.544472 24471 raft_consensus.cc:2804] T 62c6c134d3d24a1ab144dd9ee6bc3f64 P 0473d2b2d01f4459b1e90fd12cc7840e [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:06:28.568054 19551 raft_consensus.cc:1275] T 3e1f505cb0f1427bbd698ac889d80821 P e61c3a8f61bb48f8a963c9480e53c168 [term 15 FOLLOWER]: Refusing update from remote peer 0473d2b2d01f4459b1e90fd12cc7840e: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 13:06:28.568809 24577 raft_consensus.cc:493] T bc225c93219c45538b53a1bd3d387e4d P 0473d2b2d01f4459b1e90fd12cc7840e [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:28.574101 24384 raft_consensus.cc:493] T 9962423cb4e54fcfa5de01daf68a86e7 P 127766fc592545a4997f7790f50f6076 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:28.574446 20109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14935b3ddf914369822e4a0547aaa355" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:06:28.574568 20110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "833a2f0775ed407a94b8924ce50adb63" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:06:28.575306 24305 raft_consensus.cc:697] T 65d8cb8d6ec64f459d5a47cefab10acf P e5256d91808b47c195bc9b4dbd7f2b87 [term 15 LEADER]: Becoming Leader. State: Replica: e5256d91808b47c195bc9b4dbd7f2b87, State: Running, Role: LEADER
I20260709 13:06:28.575757 24483 consensus_queue.cc:1059] T ed7fdbcb96d14d418db9ca90a792588a P 127766fc592545a4997f7790f50f6076 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 }, Status: INVALID_TERM, Last received: 9.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:06:28.610365 19556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b08304a0a02b42d7840c4e8ee9a6bd1a" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:06:28.551174 24555 raft_consensus.cc:2749] T d1e5873a19244c5ebbcd38e126796ee7 P e5256d91808b47c195bc9b4dbd7f2b87 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:06:28.586505 24573 leader_election.cc:290] T b08304a0a02b42d7840c4e8ee9a6bd1a P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:06:28.616500 19409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85c494af21f9457a85da47b9bc70c1fd" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:06:28.617094 19409 raft_consensus.cc:2468] T 85c494af21f9457a85da47b9bc70c1fd P e5256d91808b47c195bc9b4dbd7f2b87 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 127766fc592545a4997f7790f50f6076 in term 13.
I20260709 13:06:28.587965 24253 leader_election.cc:290] T 85c494af21f9457a85da47b9bc70c1fd P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
W20260709 13:06:28.589170 19451 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:28.589670 19478 consensus_queue.cc:260] T 28af091831594f9d8e96482078cc7625 P 0473d2b2d01f4459b1e90fd12cc7840e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 14.7, Last appended by leader: 7, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:28.591300 24485 consensus_queue.cc:1048] T 96efeaaf1057492490e9a621f37e1a2d P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Connected to new peer: Peer: permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:06:28.592895 24372 raft_consensus.cc:2804] T ef32ce6fdd0e40d382c79974f30295c6 P e5256d91808b47c195bc9b4dbd7f2b87 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:06:28.593468 19526 leader_election.cc:304] T 2725d2c4cb054f18b0fc8f735c15f6c2 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:06:28.535977 24554 raft_consensus.cc:515] T 6c5eebf646ad445a9d1b1adc319d7b16 P 0473d2b2d01f4459b1e90fd12cc7840e [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:28.639074 19484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76cb037fc9064d13b59a8969d897ce8c" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:06:28.594072 19411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4509b76741dc428e9201c70c1658da13" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:06:28.556921 24393 consensus_queue.cc:1048] T 14efcc79969f41babe5529c22d59156d P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Connected to new peer: Peer: permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.040s
I20260709 13:06:28.598088 24508 consensus_queue.cc:1059] T d1e5873a19244c5ebbcd38e126796ee7 P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:06:28.599212 19408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b08304a0a02b42d7840c4e8ee9a6bd1a" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:06:28.604238 19375 leader_election.cc:304] T 1dc5b3532fe54f74876d02beffa2c230 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:06:28.611537 24411 raft_consensus.cc:2804] T 1a61655d99124a29b486ba4a5b37faea P e5256d91808b47c195bc9b4dbd7f2b87 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:06:28.551122 24374 raft_consensus.cc:515] T bc225c93219c45538b53a1bd3d387e4d P e5256d91808b47c195bc9b4dbd7f2b87 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:28.611125 19556 raft_consensus.cc:2468] T b08304a0a02b42d7840c4e8ee9a6bd1a P e61c3a8f61bb48f8a963c9480e53c168 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 13.
I20260709 13:06:28.583971 20103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85c494af21f9457a85da47b9bc70c1fd" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
W20260709 13:06:28.612205 19524 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:28.613698 19551 raft_consensus.cc:3055] T a08760e15aac4630a629431f56024dc8 P e61c3a8f61bb48f8a963c9480e53c168 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:06:28.541501 24473 raft_consensus.cc:515] T ff75a1d4cb1f493db8f71ddc136ba9ab P 0473d2b2d01f4459b1e90fd12cc7840e [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:28.567385 24457 raft_consensus.cc:2804] T ff75a1d4cb1f493db8f71ddc136ba9ab P e5256d91808b47c195bc9b4dbd7f2b87 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:06:28.615406 24545 raft_consensus.cc:493] T d1e5873a19244c5ebbcd38e126796ee7 P e61c3a8f61bb48f8a963c9480e53c168 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:28.615321 19305 catalog_manager.cc:5697] T 40e1e16737a842ee936002830f36882e P e5256d91808b47c195bc9b4dbd7f2b87 reported cstate change: term changed from 14 to 15, leader changed from e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3) to e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1). New cstate: current_term: 15 leader_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } health_report { overall_health: HEALTHY } } }
I20260709 13:06:28.615178 24384 raft_consensus.cc:515] T 9962423cb4e54fcfa5de01daf68a86e7 P 127766fc592545a4997f7790f50f6076 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
W20260709 13:06:28.642863 19526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.2:46257, user_credentials={real_user=slave}} blocked reactor thread for 49470.1us
I20260709 13:06:28.643461 24517 raft_consensus.cc:2804] T 2725d2c4cb054f18b0fc8f735c15f6c2 P e61c3a8f61bb48f8a963c9480e53c168 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:06:28.627276 24559 consensus_queue.cc:1059] T 28af091831594f9d8e96482078cc7625 P 0473d2b2d01f4459b1e90fd12cc7840e [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 }, Status: INVALID_TERM, Last received: 14.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.017s
I20260709 13:06:28.644402 24305 consensus_queue.cc:237] T 65d8cb8d6ec64f459d5a47cefab10acf P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:28.645082 24555 raft_consensus.cc:3060] T 1dc5b3532fe54f74876d02beffa2c230 P e5256d91808b47c195bc9b4dbd7f2b87 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:06:28.646394 24412 leader_election.cc:290] T 179fd671030940b4b4a4e24bcc4aba0a P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 16 election: Requested vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:06:28.646872 19485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e1f505cb0f1427bbd698ac889d80821" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:06:28.572443 24553 consensus_queue.cc:1059] T 2b74109013a140ada21feeef92d6f563 P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.056s
I20260709 13:06:28.567276 24507 consensus_queue.cc:1048] T 28af091831594f9d8e96482078cc7625 P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.059s
I20260709 13:06:28.647431 19408 raft_consensus.cc:2468] T b08304a0a02b42d7840c4e8ee9a6bd1a P e5256d91808b47c195bc9b4dbd7f2b87 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 13.
I20260709 13:06:28.639689 24372 raft_consensus.cc:493] T ef32ce6fdd0e40d382c79974f30295c6 P e5256d91808b47c195bc9b4dbd7f2b87 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:28.649216 19403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dc5b3532fe54f74876d02beffa2c230" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
I20260709 13:06:28.609598 19402 raft_consensus.cc:2468] T 4509b76741dc428e9201c70c1658da13 P e5256d91808b47c195bc9b4dbd7f2b87 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 9.
W20260709 13:06:28.651367 19307 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:44688 (request call id 226) took 22220 ms (client timeout 15000 ms). Trace:
I20260709 13:06:28.652118 19409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2725d2c4cb054f18b0fc8f735c15f6c2" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
I20260709 13:06:28.652330 20075 leader_election.cc:304] T 85c494af21f9457a85da47b9bc70c1fd P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 127766fc592545a4997f7790f50f6076, e5256d91808b47c195bc9b4dbd7f2b87; no voters: 
I20260709 13:06:28.613018 24577 raft_consensus.cc:515] T bc225c93219c45538b53a1bd3d387e4d P 0473d2b2d01f4459b1e90fd12cc7840e [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:28.653976 19558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "179fd671030940b4b4a4e24bcc4aba0a" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:06:28.657979 19551 raft_consensus.cc:740] T a08760e15aac4630a629431f56024dc8 P e61c3a8f61bb48f8a963c9480e53c168 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: e61c3a8f61bb48f8a963c9480e53c168, State: Running, Role: LEADER
I20260709 13:06:28.656409 20103 raft_consensus.cc:2468] T 85c494af21f9457a85da47b9bc70c1fd P 127766fc592545a4997f7790f50f6076 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 13.
I20260709 13:06:28.624075 20105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62c6c134d3d24a1ab144dd9ee6bc3f64" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076"
I20260709 13:06:28.660370 19407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "217b5fae677b4971b3bbd2f357a1f7ff" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
I20260709 13:06:28.660349 24276 consensus_queue.cc:1048] T 3e1f505cb0f1427bbd698ac889d80821 P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.035s
I20260709 13:06:28.610288 24530 consensus_queue.cc:1048] T 46c5bfeecc314717bffe987e6844b6d0 P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.049s
I20260709 13:06:28.665421 19406 raft_consensus.cc:1275] T 76cb037fc9064d13b59a8969d897ce8c P e5256d91808b47c195bc9b4dbd7f2b87 [term 12 FOLLOWER]: Refusing update from remote peer 0473d2b2d01f4459b1e90fd12cc7840e: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:06:28.662353 24457 raft_consensus.cc:493] T ff75a1d4cb1f493db8f71ddc136ba9ab P e5256d91808b47c195bc9b4dbd7f2b87 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:28.668115 19556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e1085d23e8347fbbd5bce7542f4b1f4" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:06:28.617805 24471 raft_consensus.cc:697] T 62c6c134d3d24a1ab144dd9ee6bc3f64 P 0473d2b2d01f4459b1e90fd12cc7840e [term 14 LEADER]: Becoming Leader. State: Replica: 0473d2b2d01f4459b1e90fd12cc7840e, State: Running, Role: LEADER
I20260709 13:06:28.664040 19305 catalog_manager.cc:5697] T 7be9efa6559648dbb5a0f7684c4542d1 P e5256d91808b47c195bc9b4dbd7f2b87 reported cstate change: config changed from index 4 to 6, term changed from 11 to 13, 127766fc592545a4997f7790f50f6076 (127.17.223.4) changed from NON_VOTER to VOTER, no longer has a pending config: VOTER e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1), VOTER 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2), VOTER e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3), VOTER 127766fc592545a4997f7790f50f6076 (127.17.223.4). New cstate: current_term: 13 leader_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } attrs { replace: true } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } } }
I20260709 13:06:28.671521 24517 raft_consensus.cc:697] T 2725d2c4cb054f18b0fc8f735c15f6c2 P e61c3a8f61bb48f8a963c9480e53c168 [term 17 LEADER]: Becoming Leader. State: Replica: e61c3a8f61bb48f8a963c9480e53c168, State: Running, Role: LEADER
I20260709 13:06:28.671977 24543 consensus_queue.cc:1059] T a08760e15aac4630a629431f56024dc8 P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 }, Status: INVALID_TERM, Last received: 16.9, Next index: 10, Last known committed idx: 7, Time since last communication: 0.004s
I20260709 13:06:28.672639 24384 leader_election.cc:290] T 9962423cb4e54fcfa5de01daf68a86e7 P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:06:28.659763 24411 raft_consensus.cc:493] T 1a61655d99124a29b486ba4a5b37faea P e5256d91808b47c195bc9b4dbd7f2b87 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:28.688894 19552 raft_consensus.cc:1240] T ed7fdbcb96d14d418db9ca90a792588a P e61c3a8f61bb48f8a963c9480e53c168 [term 10 FOLLOWER]: Rejecting Update request from peer 127766fc592545a4997f7790f50f6076 for earlier term 9. Current term is 10. Ops: []
I20260709 13:06:28.690300 19411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b74109013a140ada21feeef92d6f563" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
I20260709 13:06:28.712427 19408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85c494af21f9457a85da47b9bc70c1fd" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:06:28.752213 19408 raft_consensus.cc:2393] T 85c494af21f9457a85da47b9bc70c1fd P e5256d91808b47c195bc9b4dbd7f2b87 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e61c3a8f61bb48f8a963c9480e53c168 in current term 13: Already voted for candidate e5256d91808b47c195bc9b4dbd7f2b87 in this term.
I20260709 13:06:28.725679 19558 raft_consensus.cc:3060] T 179fd671030940b4b4a4e24bcc4aba0a P e61c3a8f61bb48f8a963c9480e53c168 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:06:28.727838 19560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0afb57ae58a24a01850491d69f0213dd" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
W20260709 13:06:28.728142 20075 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.1:40321, user_credentials={real_user=slave}} blocked reactor thread for 75864.2us
I20260709 13:06:28.736462 19409 raft_consensus.cc:3060] T 2725d2c4cb054f18b0fc8f735c15f6c2 P e5256d91808b47c195bc9b4dbd7f2b87 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:06:28.737341 19407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "833a2f0775ed407a94b8924ce50adb63" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:06:28.712205 24372 raft_consensus.cc:3060] T ef32ce6fdd0e40d382c79974f30295c6 P e5256d91808b47c195bc9b4dbd7f2b87 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:06:28.743988 19556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7be9efa6559648dbb5a0f7684c4542d1" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:06:28.723629 24394 raft_consensus.cc:2804] T 4509b76741dc428e9201c70c1658da13 P e5256d91808b47c195bc9b4dbd7f2b87 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:06:28.737499 24516 raft_consensus.cc:493] T 70797e5783b5454ab0d0eea663e791e3 P e61c3a8f61bb48f8a963c9480e53c168 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 127766fc592545a4997f7790f50f6076)
I20260709 13:06:28.689922 24362 consensus_queue.cc:1048] T 14efcc79969f41babe5529c22d59156d P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.050s
I20260709 13:06:28.750972 20105 raft_consensus.cc:2468] T 62c6c134d3d24a1ab144dd9ee6bc3f64 P 127766fc592545a4997f7790f50f6076 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 14.
I20260709 13:06:28.769089 19407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9962423cb4e54fcfa5de01daf68a86e7" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:06:28.745641 24550 raft_consensus.cc:493] T e381f1d6b8184797ad142de49be225a8 P e5256d91808b47c195bc9b4dbd7f2b87 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:28.712313 19402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76cb037fc9064d13b59a8969d897ce8c" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:06:28.772886 19402 raft_consensus.cc:2393] T 76cb037fc9064d13b59a8969d897ce8c P e5256d91808b47c195bc9b4dbd7f2b87 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e61c3a8f61bb48f8a963c9480e53c168 in current term 12: Already voted for candidate 0473d2b2d01f4459b1e90fd12cc7840e in this term.
I20260709 13:06:28.741233 24509 raft_consensus.cc:2804] T 85c494af21f9457a85da47b9bc70c1fd P 127766fc592545a4997f7790f50f6076 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:06:28.741101 24457 raft_consensus.cc:3060] T ff75a1d4cb1f493db8f71ddc136ba9ab P e5256d91808b47c195bc9b4dbd7f2b87 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:06:28.757681 19556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70797e5783b5454ab0d0eea663e791e3" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:06:28.666134 24545 raft_consensus.cc:515] T d1e5873a19244c5ebbcd38e126796ee7 P e61c3a8f61bb48f8a963c9480e53c168 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
W20260709 13:06:28.766268 20075 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:28.757862 24543 consensus_queue.cc:1243] T a08760e15aac4630a629431f56024dc8 P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Peer 0473d2b2d01f4459b1e90fd12cc7840e log is divergent from this leader: its last log entry 17.10 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
I20260709 13:06:28.746877 19305 catalog_manager.cc:5697] T 76cb037fc9064d13b59a8969d897ce8c P e5256d91808b47c195bc9b4dbd7f2b87 reported cstate change: term changed from 9 to 11. New cstate: current_term: 11 leader_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } health_report { overall_health: HEALTHY } } }
I20260709 13:06:28.769105 19406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa731b585f684a7fb2d106c50f143b83" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:06:28.754830 24411 raft_consensus.cc:3060] T 1a61655d99124a29b486ba4a5b37faea P e5256d91808b47c195bc9b4dbd7f2b87 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:06:28.776510 19450 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.3:36891, user_credentials={real_user=slave}} blocked reactor thread for 116632us
I20260709 13:06:28.776024 19552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c5eebf646ad445a9d1b1adc319d7b16" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:06:28.769754 19407 raft_consensus.cc:2468] T 9962423cb4e54fcfa5de01daf68a86e7 P e5256d91808b47c195bc9b4dbd7f2b87 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 127766fc592545a4997f7790f50f6076 in term 12.
I20260709 13:06:28.782277 19478 raft_consensus.cc:3060] T 28af091831594f9d8e96482078cc7625 P 0473d2b2d01f4459b1e90fd12cc7840e [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:06:28.785979 19406 raft_consensus.cc:2393] T fa731b585f684a7fb2d106c50f143b83 P e5256d91808b47c195bc9b4dbd7f2b87 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e61c3a8f61bb48f8a963c9480e53c168 in current term 11: Already voted for candidate e5256d91808b47c195bc9b4dbd7f2b87 in this term.
I20260709 13:06:28.779016 24516 raft_consensus.cc:515] T 70797e5783b5454ab0d0eea663e791e3 P e61c3a8f61bb48f8a963c9480e53c168 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:28.787295 19406 raft_consensus.cc:1240] T 3e1f505cb0f1427bbd698ac889d80821 P e5256d91808b47c195bc9b4dbd7f2b87 [term 15 FOLLOWER]: Rejecting Update request from peer e61c3a8f61bb48f8a963c9480e53c168 for earlier term 14. Current term is 15. Ops: [11.7-14.8]
I20260709 13:06:28.787002 24517 consensus_queue.cc:237] T 2725d2c4cb054f18b0fc8f735c15f6c2 P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 15.8, Last appended by leader: 8, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:28.788628 24516 leader_election.cc:290] T 70797e5783b5454ab0d0eea663e791e3 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:06:28.793322 24545 leader_election.cc:290] T d1e5873a19244c5ebbcd38e126796ee7 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:06:28.794909 19556 raft_consensus.cc:2468] T 70797e5783b5454ab0d0eea663e791e3 P e61c3a8f61bb48f8a963c9480e53c168 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 127766fc592545a4997f7790f50f6076 in term 12.
W20260709 13:06:28.795295 24590 log.cc:927] Time spent T edd7d470b5014c9489be7f41f64355c9 P 0473d2b2d01f4459b1e90fd12cc7840e: Append to log took a long time: real 0.083s	user 0.000s	sys 0.000s
I20260709 13:06:28.795495 19552 raft_consensus.cc:2376] T 6c5eebf646ad445a9d1b1adc319d7b16 P e61c3a8f61bb48f8a963c9480e53c168 [term 13 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 127766fc592545a4997f7790f50f6076 in term 13. Re-sending same reply.
I20260709 13:06:28.796500 19478 raft_consensus.cc:1275] T 28af091831594f9d8e96482078cc7625 P 0473d2b2d01f4459b1e90fd12cc7840e [term 15 FOLLOWER]: Refusing update from remote peer e5256d91808b47c195bc9b4dbd7f2b87: Log matching property violated. Preceding OpId in replica: term: 14 index: 7. Preceding OpId from leader: term: 15 index: 8. (index mismatch)
W20260709 13:06:28.796758 24593 log.cc:927] Time spent T ed7fdbcb96d14d418db9ca90a792588a P 0473d2b2d01f4459b1e90fd12cc7840e: Append to log took a long time: real 0.064s	user 0.000s	sys 0.000s
I20260709 13:06:28.798911 20075 leader_election.cc:304] T 9962423cb4e54fcfa5de01daf68a86e7 P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 127766fc592545a4997f7790f50f6076, e5256d91808b47c195bc9b4dbd7f2b87; no voters: 
I20260709 13:06:28.788653 19406 raft_consensus.cc:1240] T a08760e15aac4630a629431f56024dc8 P e5256d91808b47c195bc9b4dbd7f2b87 [term 17 FOLLOWER]: Rejecting Update request from peer e61c3a8f61bb48f8a963c9480e53c168 for earlier term 16. Current term is 17. Ops: [16.9-16.9]
I20260709 13:06:28.805390 19409 raft_consensus.cc:2468] T 2725d2c4cb054f18b0fc8f735c15f6c2 P e5256d91808b47c195bc9b4dbd7f2b87 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 17.
I20260709 13:06:28.805104 19558 raft_consensus.cc:2468] T 179fd671030940b4b4a4e24bcc4aba0a P e61c3a8f61bb48f8a963c9480e53c168 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 16.
I20260709 13:06:28.811127 24471 consensus_queue.cc:237] T 62c6c134d3d24a1ab144dd9ee6bc3f64 P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:28.812548 24387 raft_consensus.cc:3055] T d1e5873a19244c5ebbcd38e126796ee7 P 0473d2b2d01f4459b1e90fd12cc7840e [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:06:28.805970 24384 raft_consensus.cc:2804] T 9962423cb4e54fcfa5de01daf68a86e7 P 127766fc592545a4997f7790f50f6076 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:06:28.831559 19407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff75a1d4cb1f493db8f71ddc136ba9ab" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:06:28.775276 24509 raft_consensus.cc:493] T 85c494af21f9457a85da47b9bc70c1fd P 127766fc592545a4997f7790f50f6076 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:28.815281 19305 catalog_manager.cc:5697] T fa731b585f684a7fb2d106c50f143b83 P e5256d91808b47c195bc9b4dbd7f2b87 reported cstate change: term changed from 9 to 10, leader changed from e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1) to 127766fc592545a4997f7790f50f6076 (127.17.223.4). New cstate: current_term: 10 leader_uuid: "127766fc592545a4997f7790f50f6076" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } } }
I20260709 13:06:28.833406 24509 raft_consensus.cc:3060] T 85c494af21f9457a85da47b9bc70c1fd P 127766fc592545a4997f7790f50f6076 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:06:28.834280 19485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e5873a19244c5ebbcd38e126796ee7" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:06:28.835950 24473 leader_election.cc:290] T ff75a1d4cb1f493db8f71ddc136ba9ab P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:06:28.820372 19552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65d8cb8d6ec64f459d5a47cefab10acf" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:06:28.820959 19553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96efeaaf1057492490e9a621f37e1a2d" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 16 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:06:28.826962 19375 leader_election.cc:304] T 179fd671030940b4b4a4e24bcc4aba0a P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:06:28.837790 19555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7be9efa6559648dbb5a0f7684c4542d1" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:06:28.839092 19555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0afb57ae58a24a01850491d69f0213dd" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:06:28.834512 19305 catalog_manager.cc:5697] T 70797e5783b5454ab0d0eea663e791e3 P e5256d91808b47c195bc9b4dbd7f2b87 reported cstate change: term changed from 10 to 12, leader changed from e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1) to 127766fc592545a4997f7790f50f6076 (127.17.223.4). New cstate: current_term: 12 leader_uuid: "127766fc592545a4997f7790f50f6076" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } } }
I20260709 13:06:28.823614 24374 leader_election.cc:290] T bc225c93219c45538b53a1bd3d387e4d P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:06:28.824605 19557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e1085d23e8347fbbd5bce7542f4b1f4" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:06:28.825304 19411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14935b3ddf914369822e4a0547aaa355" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:06:28.828843 20105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70797e5783b5454ab0d0eea663e791e3" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:06:28.831696 24384 raft_consensus.cc:493] T 9962423cb4e54fcfa5de01daf68a86e7 P 127766fc592545a4997f7790f50f6076 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:28.837807 19449 leader_election.cc:304] T 4509b76741dc428e9201c70c1658da13 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e; no voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:06:28.852465 19406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc225c93219c45538b53a1bd3d387e4d" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:06:28.825976 19450 leader_election.cc:304] T b08304a0a02b42d7840c4e8ee9a6bd1a P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:06:28.853268 19409 raft_consensus.cc:1275] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P e5256d91808b47c195bc9b4dbd7f2b87 [term 16 FOLLOWER]: Refusing update from remote peer 127766fc592545a4997f7790f50f6076: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 13:06:28.837872 19553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85c494af21f9457a85da47b9bc70c1fd" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:06:28.821570 19559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70797e5783b5454ab0d0eea663e791e3" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:06:28.824003 19554 raft_consensus.cc:1240] T 65d8cb8d6ec64f459d5a47cefab10acf P e61c3a8f61bb48f8a963c9480e53c168 [term 15 FOLLOWER]: Rejecting Update request from peer 127766fc592545a4997f7790f50f6076 for earlier term 14. Current term is 15. Ops: []
I20260709 13:06:28.855127 19553 raft_consensus.cc:2468] T 85c494af21f9457a85da47b9bc70c1fd P e61c3a8f61bb48f8a963c9480e53c168 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 127766fc592545a4997f7790f50f6076 in term 12.
I20260709 13:06:28.858803 19553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc225c93219c45538b53a1bd3d387e4d" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:06:28.859525 19553 raft_consensus.cc:2468] T bc225c93219c45538b53a1bd3d387e4d P e61c3a8f61bb48f8a963c9480e53c168 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 12.
I20260709 13:06:28.861311 19305 catalog_manager.cc:5697] T ff9b0eddd810459b82d91c60777c10eb P e5256d91808b47c195bc9b4dbd7f2b87 reported cstate change: term changed from 8 to 12, leader changed from e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1) to 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2). New cstate: current_term: 12 leader_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } } }
I20260709 13:06:28.862317 19558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa731b585f684a7fb2d106c50f143b83" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:06:28.862903 19558 raft_consensus.cc:2468] T fa731b585f684a7fb2d106c50f143b83 P e61c3a8f61bb48f8a963c9480e53c168 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 127766fc592545a4997f7790f50f6076 in term 10.
I20260709 13:06:28.853299 19406 raft_consensus.cc:2468] T bc225c93219c45538b53a1bd3d387e4d P e5256d91808b47c195bc9b4dbd7f2b87 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 12.
I20260709 13:06:28.864770 19406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70797e5783b5454ab0d0eea663e791e3" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:06:28.864938 20110 raft_consensus.cc:3055] T ed7fdbcb96d14d418db9ca90a792588a P 127766fc592545a4997f7790f50f6076 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:06:28.865265 20110 raft_consensus.cc:740] T ed7fdbcb96d14d418db9ca90a792588a P 127766fc592545a4997f7790f50f6076 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 127766fc592545a4997f7790f50f6076, State: Running, Role: LEADER
I20260709 13:06:28.865878 19406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e5873a19244c5ebbcd38e126796ee7" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:06:28.865994 20110 consensus_queue.cc:260] T ed7fdbcb96d14d418db9ca90a792588a P 127766fc592545a4997f7790f50f6076 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:28.866446 19406 raft_consensus.cc:2468] T d1e5873a19244c5ebbcd38e126796ee7 P e5256d91808b47c195bc9b4dbd7f2b87 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 16.
I20260709 13:06:28.867261 20110 raft_consensus.cc:3060] T ed7fdbcb96d14d418db9ca90a792588a P 127766fc592545a4997f7790f50f6076 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:06:28.867501 19406 raft_consensus.cc:1275] T 3e1f505cb0f1427bbd698ac889d80821 P e5256d91808b47c195bc9b4dbd7f2b87 [term 15 FOLLOWER]: Refusing update from remote peer 0473d2b2d01f4459b1e90fd12cc7840e: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 13:06:28.869304 24394 raft_consensus.cc:493] T 4509b76741dc428e9201c70c1658da13 P e5256d91808b47c195bc9b4dbd7f2b87 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:28.869735 24394 raft_consensus.cc:3060] T 4509b76741dc428e9201c70c1658da13 P e5256d91808b47c195bc9b4dbd7f2b87 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:06:28.871189 19449 leader_election.cc:304] T bc225c93219c45538b53a1bd3d387e4d P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87; no voters: 
I20260709 13:06:28.872824 24549 raft_consensus.cc:2804] T bc225c93219c45538b53a1bd3d387e4d P 0473d2b2d01f4459b1e90fd12cc7840e [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:06:28.873198 24549 raft_consensus.cc:493] T bc225c93219c45538b53a1bd3d387e4d P 0473d2b2d01f4459b1e90fd12cc7840e [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:28.873502 24549 raft_consensus.cc:3060] T bc225c93219c45538b53a1bd3d387e4d P 0473d2b2d01f4459b1e90fd12cc7840e [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:06:28.873875 24576 consensus_queue.cc:1048] T 3e1f505cb0f1427bbd698ac889d80821 P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:06:28.875217 20103 raft_consensus.cc:1275] T 48824d5acfbc485ebf8c2d944e7202de P 127766fc592545a4997f7790f50f6076 [term 16 FOLLOWER]: Refusing update from remote peer 0473d2b2d01f4459b1e90fd12cc7840e: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 13:06:28.874914 19375 leader_election.cc:304] T bc225c93219c45538b53a1bd3d387e4d P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:06:28.877140 24370 raft_consensus.cc:2804] T bc225c93219c45538b53a1bd3d387e4d P e5256d91808b47c195bc9b4dbd7f2b87 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:06:28.877650 24370 raft_consensus.cc:493] T bc225c93219c45538b53a1bd3d387e4d P e5256d91808b47c195bc9b4dbd7f2b87 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:28.878072 24370 raft_consensus.cc:3060] T bc225c93219c45538b53a1bd3d387e4d P e5256d91808b47c195bc9b4dbd7f2b87 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:06:28.883262 24558 raft_consensus.cc:2804] T b08304a0a02b42d7840c4e8ee9a6bd1a P 0473d2b2d01f4459b1e90fd12cc7840e [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:06:28.883872 24558 raft_consensus.cc:493] T b08304a0a02b42d7840c4e8ee9a6bd1a P 0473d2b2d01f4459b1e90fd12cc7840e [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:28.883630 24394 raft_consensus.cc:515] T 4509b76741dc428e9201c70c1658da13 P e5256d91808b47c195bc9b4dbd7f2b87 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:28.884238 19555 raft_consensus.cc:3060] T 70797e5783b5454ab0d0eea663e791e3 P e61c3a8f61bb48f8a963c9480e53c168 [term 12 FOLLOWER]: Advancing to term 14
I20260709 13:06:28.884356 24558 raft_consensus.cc:3060] T b08304a0a02b42d7840c4e8ee9a6bd1a P 0473d2b2d01f4459b1e90fd12cc7840e [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:06:28.886467 19404 raft_consensus.cc:1240] T 28af091831594f9d8e96482078cc7625 P e5256d91808b47c195bc9b4dbd7f2b87 [term 15 LEADER]: Rejecting Update request from peer 0473d2b2d01f4459b1e90fd12cc7840e for earlier term 14. Current term is 15. Ops: []
W20260709 13:06:28.893356 19450 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.3:36891, user_credentials={real_user=slave}} blocked reactor thread for 107337us
I20260709 13:06:28.895346 24554 leader_election.cc:290] T 6c5eebf646ad445a9d1b1adc319d7b16 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:06:28.896376 20110 raft_consensus.cc:1275] T ed7fdbcb96d14d418db9ca90a792588a P 127766fc592545a4997f7790f50f6076 [term 10 FOLLOWER]: Refusing update from remote peer 0473d2b2d01f4459b1e90fd12cc7840e: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
W20260709 13:06:28.897096 24141 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 10 current term: 10 is higher.
I20260709 13:06:28.897753 19408 raft_consensus.cc:1275] T a08760e15aac4630a629431f56024dc8 P e5256d91808b47c195bc9b4dbd7f2b87 [term 17 FOLLOWER]: Refusing update from remote peer 0473d2b2d01f4459b1e90fd12cc7840e: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
I20260709 13:06:28.893507 24370 raft_consensus.cc:515] T bc225c93219c45538b53a1bd3d387e4d P e5256d91808b47c195bc9b4dbd7f2b87 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:28.900305 24564 consensus_queue.cc:1048] T 48824d5acfbc485ebf8c2d944e7202de P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Connected to new peer: Peer: permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:06:28.903033 24276 consensus_queue.cc:1048] T a08760e15aac4630a629431f56024dc8 P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:06:28.902470 24564 consensus_queue.cc:1048] T ed7fdbcb96d14d418db9ca90a792588a P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Connected to new peer: Peer: permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:06:28.910082 19558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc225c93219c45538b53a1bd3d387e4d" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:06:28.910528 19552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c5eebf646ad445a9d1b1adc319d7b16" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:06:28.911170 19552 raft_consensus.cc:2468] T 6c5eebf646ad445a9d1b1adc319d7b16 P e61c3a8f61bb48f8a963c9480e53c168 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 13.
I20260709 13:06:28.912039 19552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc225c93219c45538b53a1bd3d387e4d" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:06:28.912576 19552 raft_consensus.cc:2468] T bc225c93219c45538b53a1bd3d387e4d P e61c3a8f61bb48f8a963c9480e53c168 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 12.
I20260709 13:06:28.911245 19553 raft_consensus.cc:1240] T d1e5873a19244c5ebbcd38e126796ee7 P e61c3a8f61bb48f8a963c9480e53c168 [term 16 FOLLOWER]: Rejecting Update request from peer 0473d2b2d01f4459b1e90fd12cc7840e for earlier term 15. Current term is 16. Ops: []
I20260709 13:06:28.914366 24412 consensus_queue.cc:1048] T 28af091831594f9d8e96482078cc7625 P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:06:28.915614 19553 raft_consensus.cc:3060] T edd7d470b5014c9489be7f41f64355c9 P e61c3a8f61bb48f8a963c9480e53c168 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:06:28.915762 19478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "179fd671030940b4b4a4e24bcc4aba0a" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:06:28.916306 19478 raft_consensus.cc:3060] T 179fd671030940b4b4a4e24bcc4aba0a P 0473d2b2d01f4459b1e90fd12cc7840e [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:06:28.918963 19557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff75a1d4cb1f493db8f71ddc136ba9ab" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:06:28.919653 19557 raft_consensus.cc:2393] T ff75a1d4cb1f493db8f71ddc136ba9ab P e61c3a8f61bb48f8a963c9480e53c168 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0473d2b2d01f4459b1e90fd12cc7840e in current term 14: Already voted for candidate e61c3a8f61bb48f8a963c9480e53c168 in this term.
I20260709 13:06:28.920590 19552 raft_consensus.cc:3060] T 76cb037fc9064d13b59a8969d897ce8c P e61c3a8f61bb48f8a963c9480e53c168 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:06:28.925140 24370 leader_election.cc:290] T bc225c93219c45538b53a1bd3d387e4d P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 13 election: Requested vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:06:28.925931 19478 raft_consensus.cc:2468] T 179fd671030940b4b4a4e24bcc4aba0a P 0473d2b2d01f4459b1e90fd12cc7840e [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 16.
I20260709 13:06:28.893100 19555 raft_consensus.cc:1275] T 70797e5783b5454ab0d0eea663e791e3 P e61c3a8f61bb48f8a963c9480e53c168 [term 14 FOLLOWER]: Refusing update from remote peer 127766fc592545a4997f7790f50f6076: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 13:06:28.933099 19479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc225c93219c45538b53a1bd3d387e4d" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:06:28.934854 19482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc225c93219c45538b53a1bd3d387e4d" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:06:28.935492 19484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4509b76741dc428e9201c70c1658da13" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:06:28.935843 19553 raft_consensus.cc:1275] T edd7d470b5014c9489be7f41f64355c9 P e61c3a8f61bb48f8a963c9480e53c168 [term 15 FOLLOWER]: Refusing update from remote peer 0473d2b2d01f4459b1e90fd12cc7840e: Log matching property violated. Preceding OpId in replica: term: 14 index: 7. Preceding OpId from leader: term: 15 index: 8. (index mismatch)
I20260709 13:06:28.938978 19552 raft_consensus.cc:1275] T 76cb037fc9064d13b59a8969d897ce8c P e61c3a8f61bb48f8a963c9480e53c168 [term 12 FOLLOWER]: Refusing update from remote peer 0473d2b2d01f4459b1e90fd12cc7840e: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:06:28.941336 19483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9962423cb4e54fcfa5de01daf68a86e7" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:06:28.942081 19483 raft_consensus.cc:2468] T 9962423cb4e54fcfa5de01daf68a86e7 P 0473d2b2d01f4459b1e90fd12cc7840e [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 127766fc592545a4997f7790f50f6076 in term 12.
I20260709 13:06:28.942312 19523 leader_election.cc:304] T ff75a1d4cb1f493db8f71ddc136ba9ab P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e61c3a8f61bb48f8a963c9480e53c168; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:06:28.946709 19305 catalog_manager.cc:5697] T ab43d85f64114d4ebf618930e43d9ed0 P e5256d91808b47c195bc9b4dbd7f2b87 reported cstate change: term changed from 8 to 13, leader changed from 127766fc592545a4997f7790f50f6076 (127.17.223.4) to e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3). New cstate: current_term: 13 leader_uuid: "e61c3a8f61bb48f8a963c9480e53c168" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } attrs { replace: true } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } } }
I20260709 13:06:28.814277 24567 raft_consensus.cc:515] T fa731b585f684a7fb2d106c50f143b83 P 127766fc592545a4997f7790f50f6076 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
W20260709 13:06:28.948315 20075 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.1:40321, user_credentials={real_user=slave}} blocked reactor thread for 107476us
I20260709 13:06:28.949980 20110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c5eebf646ad445a9d1b1adc319d7b16" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:06:28.779420 24550 raft_consensus.cc:515] T e381f1d6b8184797ad142de49be225a8 P e5256d91808b47c195bc9b4dbd7f2b87 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:28.837291 24387 raft_consensus.cc:740] T d1e5873a19244c5ebbcd38e126796ee7 P 0473d2b2d01f4459b1e90fd12cc7840e [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 0473d2b2d01f4459b1e90fd12cc7840e, State: Running, Role: LEADER
I20260709 13:06:28.956106 19377 leader_election.cc:304] T bc225c93219c45538b53a1bd3d387e4d P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:06:28.956075 19411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e1f505cb0f1427bbd698ac889d80821" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:06:28.944721 20076 leader_election.cc:304] T 6c5eebf646ad445a9d1b1adc319d7b16 P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 127766fc592545a4997f7790f50f6076, e61c3a8f61bb48f8a963c9480e53c168; no voters: 0473d2b2d01f4459b1e90fd12cc7840e
I20260709 13:06:28.957867 20110 raft_consensus.cc:2468] T 6c5eebf646ad445a9d1b1adc319d7b16 P 127766fc592545a4997f7790f50f6076 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 13.
I20260709 13:06:28.861333 24384 raft_consensus.cc:3060] T 9962423cb4e54fcfa5de01daf68a86e7 P 127766fc592545a4997f7790f50f6076 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:06:28.967237 19305 catalog_manager.cc:5697] T f93ee515a9c14139bf566522ed8232f3 P e5256d91808b47c195bc9b4dbd7f2b87 reported cstate change: term changed from 9 to 15, leader changed from e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3) to 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2). New cstate: current_term: 15 leader_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } }
I20260709 13:06:28.943470 24374 raft_consensus.cc:2804] T 179fd671030940b4b4a4e24bcc4aba0a P e5256d91808b47c195bc9b4dbd7f2b87 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:06:28.950475 24473 raft_consensus.cc:3060] T 4509b76741dc428e9201c70c1658da13 P 0473d2b2d01f4459b1e90fd12cc7840e [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:06:28.697470 19307 rpcz_store.cc:269] 0709 13:06:06.434105 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:06.449537 (+ 15432us) service_pool.cc:224] Handling call
0709 13:06:28.651124 (+22201587us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:06:26.492188 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:06:26.498971 (+  6783us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:06:26.499010 (+    39us) write_op.cc:435] Acquired schema lock
0709 13:06:26.499028 (+    18us) tablet.cc:662] Decoding operations
0709 13:06:26.500048 (+  1020us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:06:26.500106 (+    58us) write_op.cc:641] Partition lock acquired for write op
0709 13:06:26.500136 (+    30us) tablet.cc:685] Acquiring locks for 11 operations
0709 13:06:26.501827 (+  1691us) tablet.cc:701] Row locks acquired
0709 13:06:26.501848 (+    21us) write_op.cc:260] PREPARE: finished
0709 13:06:26.501993 (+   145us) write_op.cc:270] Start()
0709 13:06:26.502087 (+    94us) write_op.cc:276] Timestamp: P: 1783602386501948 usec, L: 0
0709 13:06:26.502101 (+    14us) op_driver.cc:348] REPLICATION: starting
0709 13:06:26.505447 (+  3346us) log.cc:844] Serialized 4735 byte log entry
0709 13:06:26.756572 (+251125us) spinlock_profiling.cc:243] Waited 6.39 ms on lock 0x7b1800168e80. stack: 00007f4a79de9343 00007f4a79de9240 00007f4a797781d4 00007f4a834b6304 00007f4a834b6299 00007f4a82ce3de1 00007f4a82cf05b1 00007f4a7cab04bc 00007f4a79dfe48b 00007f4a82c58ab9 00007f4a79e1a69b 00007f4a79e1893f 00007f4a79e18455 00007f4a7ce85190 00007f4a7ce7eae7 00007f4a7ce7ddd9
0709 13:06:26.747086 (+ -9486us) op_driver.cc:464] REPLICATION: finished
0709 13:06:26.937537 (+190451us) write_op.cc:301] APPLY: starting
0709 13:06:26.937651 (+   114us) tablet.cc:1367] starting BulkCheckPresence
0709 13:06:27.187415 (+249764us) tablet.cc:1370] finished BulkCheckPresence
0709 13:06:27.187459 (+    44us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:06:27.326182 (+138723us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:06:27.326518 (+   336us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=22,key_file_lookups=22,delta_file_lookups=22,mrs_lookups=0
0709 13:06:27.326582 (+    64us) write_op.cc:312] APPLY: finished
0709 13:06:27.327364 (+   782us) log.cc:844] Serialized 105 byte log entry
0709 13:06:27.327605 (+   241us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:06:27.327918 (+   313us) write_op.cc:454] Released schema lock
0709 13:06:27.327995 (+    77us) write_op.cc:341] FINISH: Updating metrics
0709 13:06:27.328986 (+   991us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:06:27.329020 (+    34us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":240101,"reported_tablets":51,"child_traces":[["op",{"apply.queue_time_us":138314,"apply.run_cpu_time_us":25933,"apply.run_wall_time_us":391442,"cfile_cache_hit":46,"cfile_cache_hit_bytes":50107,"num_ops":11,"prepare.queue_time_us":510045,"prepare.run_cpu_time_us":5161,"prepare.run_wall_time_us":53505,"raft.queue_time_us":973,"raft.run_cpu_time_us":16709,"raft.run_wall_time_us":398970,"replication_time_us":42882,"spinlock_wait_cycles":14697728,"thread_start_us":765945,"threads_started":4,"wal-append.queue_time_us":32856,"wal-append.run_cpu_time_us":8504,"wal-append.run_wall_time_us":1792307}]]}
I20260709 13:06:28.969921 19551 consensus_queue.cc:260] T a08760e15aac4630a629431f56024dc8 P e61c3a8f61bb48f8a963c9480e53c168 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.9, Last appended by leader: 9, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:29.009740 19450 leader_election.cc:304] T 6c5eebf646ad445a9d1b1adc319d7b16 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:06:29.011600 19554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4509b76741dc428e9201c70c1658da13" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:06:29.012214 19554 raft_consensus.cc:3060] T 4509b76741dc428e9201c70c1658da13 P e61c3a8f61bb48f8a963c9480e53c168 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:06:29.015687 20106 raft_consensus.cc:2368] T fa731b585f684a7fb2d106c50f143b83 P 127766fc592545a4997f7790f50f6076 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e61c3a8f61bb48f8a963c9480e53c168 for earlier term 11. Current term is 12.
I20260709 13:06:28.948961 24478 consensus_queue.cc:1048] T 76cb037fc9064d13b59a8969d897ce8c P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.059s
I20260709 13:06:28.968806 24305 raft_consensus.cc:2749] T bc225c93219c45538b53a1bd3d387e4d P e5256d91808b47c195bc9b4dbd7f2b87 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:06:29.024374 19523 leader_election.cc:304] T f1b10566f45d4a7d9029858330e02d5b P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e61c3a8f61bb48f8a963c9480e53c168; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:06:28.841361 19402 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2a16f7501e2444fb86d4e2778e734e02"
dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
mode: GRACEFUL
new_leader_uuid: "127766fc592545a4997f7790f50f6076"
 from {username='slave'} at 127.0.0.1:37312
W20260709 13:06:29.038167 19524 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:29.038205 19402 raft_consensus.cc:606] T 2a16f7501e2444fb86d4e2778e734e02 P e5256d91808b47c195bc9b4dbd7f2b87 [term 13 FOLLOWER]: Received request to transfer leadership to TS 127766fc592545a4997f7790f50f6076
I20260709 13:06:29.039260 19402 raft_consensus.cc:614] T 2a16f7501e2444fb86d4e2778e734e02 P e5256d91808b47c195bc9b4dbd7f2b87 [term 13 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:06:28.974988 24516 raft_consensus.cc:2749] T ff75a1d4cb1f493db8f71ddc136ba9ab P e61c3a8f61bb48f8a963c9480e53c168 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
W20260709 13:06:29.042276 20076 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.3:36891, user_credentials={real_user=slave}} blocked reactor thread for 205498us
W20260709 13:06:29.073971 20076 leader_election.cc:336] T 65d8cb8d6ec64f459d5a47cefab10acf P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 14 election: RPC error from VoteRequest() call to peer e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891): Timed out: RequestConsensusVote RPC to 127.17.223.3:36891 timed out after 1.842s (SENT)
I20260709 13:06:29.082880 19305 catalog_manager.cc:5697] T 2a16f7501e2444fb86d4e2778e734e02 P e5256d91808b47c195bc9b4dbd7f2b87 reported cstate change: term changed from 8 to 12. New cstate: current_term: 12 leader_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:06:28.974232 24394 leader_election.cc:290] T 4509b76741dc428e9201c70c1658da13 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 10 election: Requested vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:06:29.030530 19554 raft_consensus.cc:2468] T 4509b76741dc428e9201c70c1658da13 P e61c3a8f61bb48f8a963c9480e53c168 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 10.
I20260709 13:06:29.096369 19305 catalog_manager.cc:5697] T b9f0d59553ad444883fcf5b5909f9798 P e5256d91808b47c195bc9b4dbd7f2b87 reported cstate change: term changed from 11 to 13. New cstate: current_term: 13 leader_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } }
I20260709 13:06:29.019752 24374 raft_consensus.cc:697] T 179fd671030940b4b4a4e24bcc4aba0a P e5256d91808b47c195bc9b4dbd7f2b87 [term 16 LEADER]: Becoming Leader. State: Replica: e5256d91808b47c195bc9b4dbd7f2b87, State: Running, Role: LEADER
I20260709 13:06:29.101483 19375 leader_election.cc:304] T 4509b76741dc428e9201c70c1658da13 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:06:29.037758 24422 raft_consensus.cc:2804] T 6c5eebf646ad445a9d1b1adc319d7b16 P 0473d2b2d01f4459b1e90fd12cc7840e [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:06:29.081636 24370 raft_consensus.cc:493] T edd7d470b5014c9489be7f41f64355c9 P e5256d91808b47c195bc9b4dbd7f2b87 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:29.043123 24141 raft_consensus.cc:2804] T 6c5eebf646ad445a9d1b1adc319d7b16 P 127766fc592545a4997f7790f50f6076 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:06:29.112428 19305 catalog_manager.cc:5697] T 4af19371ea874c09a0a2147040835cbb P e5256d91808b47c195bc9b4dbd7f2b87 reported cstate change: term changed from 5 to 8, leader changed from e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1) to 127766fc592545a4997f7790f50f6076 (127.17.223.4). New cstate: current_term: 8 leader_uuid: "127766fc592545a4997f7790f50f6076" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } } }
I20260709 13:06:29.127797 19305 catalog_manager.cc:5697] T bc225c93219c45538b53a1bd3d387e4d P e5256d91808b47c195bc9b4dbd7f2b87 reported cstate change: term changed from 10 to 11, leader changed from e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1) to 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2). New cstate: current_term: 11 leader_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } }
I20260709 13:06:29.105687 24422 raft_consensus.cc:493] T 6c5eebf646ad445a9d1b1adc319d7b16 P 0473d2b2d01f4459b1e90fd12cc7840e [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:29.114642 24394 raft_consensus.cc:2804] T 4509b76741dc428e9201c70c1658da13 P e5256d91808b47c195bc9b4dbd7f2b87 [term 10 FOLLOWER]: Leader election won for term 10
W20260709 13:06:29.146661 19523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.1:40321, user_credentials={real_user=slave}} blocked reactor thread for 177180us
I20260709 13:06:29.148382 19523 leader_election.cc:304] T 86a6797bdfe94fa496c050ceae4bd0d9 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e61c3a8f61bb48f8a963c9480e53c168; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:06:29.149535 19305 catalog_manager.cc:5697] T 7f575b143b844aa096b50997dad3516a P e5256d91808b47c195bc9b4dbd7f2b87 reported cstate change: term changed from 6 to 10. New cstate: current_term: 10 leader_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:29.152976 19481 raft_consensus.cc:1240] T df751f992649444090e27965eb1af85d P 0473d2b2d01f4459b1e90fd12cc7840e [term 17 LEADER]: Rejecting Update request from peer e61c3a8f61bb48f8a963c9480e53c168 for earlier term 16. Current term is 17. Ops: []
I20260709 13:06:29.137933 24422 raft_consensus.cc:3060] T 6c5eebf646ad445a9d1b1adc319d7b16 P 0473d2b2d01f4459b1e90fd12cc7840e [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:06:29.151319 24141 raft_consensus.cc:697] T 6c5eebf646ad445a9d1b1adc319d7b16 P 127766fc592545a4997f7790f50f6076 [term 13 LEADER]: Becoming Leader. State: Replica: 127766fc592545a4997f7790f50f6076, State: Running, Role: LEADER
I20260709 13:06:29.162245 19559 raft_consensus.cc:1275] T 65d8cb8d6ec64f459d5a47cefab10acf P e61c3a8f61bb48f8a963c9480e53c168 [term 15 FOLLOWER]: Refusing update from remote peer e5256d91808b47c195bc9b4dbd7f2b87: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 13:06:29.163268 24577 leader_election.cc:290] T bc225c93219c45538b53a1bd3d387e4d P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:06:29.163456 24411 raft_consensus.cc:515] T 1a61655d99124a29b486ba4a5b37faea P e5256d91808b47c195bc9b4dbd7f2b87 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:29.098913 24387 consensus_queue.cc:260] T d1e5873a19244c5ebbcd38e126796ee7 P 0473d2b2d01f4459b1e90fd12cc7840e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 15.8, Last appended by leader: 8, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:29.126911 24370 raft_consensus.cc:515] T edd7d470b5014c9489be7f41f64355c9 P e5256d91808b47c195bc9b4dbd7f2b87 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:29.171778 24516 raft_consensus.cc:2749] T 86a6797bdfe94fa496c050ceae4bd0d9 P e61c3a8f61bb48f8a963c9480e53c168 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:06:29.183059 19408 raft_consensus.cc:1275] T df751f992649444090e27965eb1af85d P e5256d91808b47c195bc9b4dbd7f2b87 [term 17 FOLLOWER]: Refusing update from remote peer 0473d2b2d01f4459b1e90fd12cc7840e: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
W20260709 13:06:29.194516 19523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.1:40321, user_credentials={real_user=slave}} blocked reactor thread for 46257.6us
I20260709 13:06:29.178615 19305 catalog_manager.cc:5697] T 179fd671030940b4b4a4e24bcc4aba0a P e5256d91808b47c195bc9b4dbd7f2b87 reported cstate change: term changed from 9 to 13. New cstate: current_term: 13 leader_uuid: "e61c3a8f61bb48f8a963c9480e53c168" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } }
I20260709 13:06:29.182598 19411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa731b585f684a7fb2d106c50f143b83" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
I20260709 13:06:29.235615 19411 raft_consensus.cc:3060] T fa731b585f684a7fb2d106c50f143b83 P e5256d91808b47c195bc9b4dbd7f2b87 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:06:29.211588 19402 raft_consensus.cc:1275] T edd7d470b5014c9489be7f41f64355c9 P e5256d91808b47c195bc9b4dbd7f2b87 [term 15 FOLLOWER]: Refusing update from remote peer 0473d2b2d01f4459b1e90fd12cc7840e: Log matching property violated. Preceding OpId in replica: term: 14 index: 7. Preceding OpId from leader: term: 15 index: 8. (index mismatch)
I20260709 13:06:29.237632 19305 catalog_manager.cc:5697] T 172b3dd13109415a955b71ac0e9d2234 P e5256d91808b47c195bc9b4dbd7f2b87 reported cstate change: term changed from 9 to 11. New cstate: current_term: 11 leader_uuid: "127766fc592545a4997f7790f50f6076" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } } }
I20260709 13:06:29.237816 24141 consensus_queue.cc:237] T 6c5eebf646ad445a9d1b1adc319d7b16 P 127766fc592545a4997f7790f50f6076 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:29.238901 19409 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3e1f505cb0f1427bbd698ac889d80821"
dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
mode: GRACEFUL
new_leader_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
 from {username='slave'} at 127.0.0.1:37312
I20260709 13:06:29.239519 19409 raft_consensus.cc:606] T 3e1f505cb0f1427bbd698ac889d80821 P e5256d91808b47c195bc9b4dbd7f2b87 [term 15 FOLLOWER]: Received request to transfer leadership to TS 0473d2b2d01f4459b1e90fd12cc7840e
I20260709 13:06:29.238976 19305 catalog_manager.cc:5697] T 1f85fc4b527a48848e5faa083b604e36 P e5256d91808b47c195bc9b4dbd7f2b87 reported cstate change: term changed from 5 to 11. New cstate: current_term: 11 leader_uuid: "127766fc592545a4997f7790f50f6076" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } } }
I20260709 13:06:29.239852 19409 raft_consensus.cc:614] T 3e1f505cb0f1427bbd698ac889d80821 P e5256d91808b47c195bc9b4dbd7f2b87 [term 15 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:06:29.240901 19305 catalog_manager.cc:5697] T 5ec1c4ce15e04c7e8c283a62179f2a64 P e5256d91808b47c195bc9b4dbd7f2b87 reported cstate change: term changed from 9 to 10, leader changed from e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1) to 127766fc592545a4997f7790f50f6076 (127.17.223.4). New cstate: current_term: 10 leader_uuid: "127766fc592545a4997f7790f50f6076" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } } }
I20260709 13:06:29.210997 24473 raft_consensus.cc:2749] T 4509b76741dc428e9201c70c1658da13 P 0473d2b2d01f4459b1e90fd12cc7840e [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:06:29.246224 19305 catalog_manager.cc:5697] T 14935b3ddf914369822e4a0547aaa355 P e5256d91808b47c195bc9b4dbd7f2b87 reported cstate change: term changed from 8 to 10. New cstate: current_term: 10 leader_uuid: "127766fc592545a4997f7790f50f6076" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } attrs { replace: true } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } } }
I20260709 13:06:29.186599 24372 raft_consensus.cc:515] T ef32ce6fdd0e40d382c79974f30295c6 P e5256d91808b47c195bc9b4dbd7f2b87 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:29.251171 24372 leader_election.cc:290] T ef32ce6fdd0e40d382c79974f30295c6 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 17 election: Requested vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:06:29.244858 24541 consensus_queue.cc:1059] T df751f992649444090e27965eb1af85d P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 }, Status: INVALID_TERM, Last received: 13.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.010s
I20260709 13:06:29.252106 24541 raft_consensus.cc:3055] T df751f992649444090e27965eb1af85d P e61c3a8f61bb48f8a963c9480e53c168 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:06:29.252418 24541 raft_consensus.cc:740] T df751f992649444090e27965eb1af85d P e61c3a8f61bb48f8a963c9480e53c168 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: e61c3a8f61bb48f8a963c9480e53c168, State: Running, Role: LEADER
I20260709 13:06:29.253207 24541 consensus_queue.cc:260] T df751f992649444090e27965eb1af85d P e61c3a8f61bb48f8a963c9480e53c168 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:29.255402 19484 raft_consensus.cc:3060] T 4509b76741dc428e9201c70c1658da13 P 0473d2b2d01f4459b1e90fd12cc7840e [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:06:29.260509 24555 consensus_meta.cc:287] T 1dc5b3532fe54f74876d02beffa2c230 P e5256d91808b47c195bc9b4dbd7f2b87: Time spent flushing consensus metadata: real 0.569s	user 0.006s	sys 0.002s
I20260709 13:06:29.254436 24541 raft_consensus.cc:3060] T df751f992649444090e27965eb1af85d P e61c3a8f61bb48f8a963c9480e53c168 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:06:29.193255 24596 consensus_queue.cc:1048] T 65d8cb8d6ec64f459d5a47cefab10acf P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.077s
I20260709 13:06:29.263666 19559 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "40e1e16737a842ee936002830f36882e"
dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
mode: GRACEFUL
new_leader_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
 from {username='slave'} at 127.0.0.1:39264
I20260709 13:06:29.182420 24601 raft_consensus.cc:2749] T f1b10566f45d4a7d9029858330e02d5b P e61c3a8f61bb48f8a963c9480e53c168 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:06:29.232633 24374 consensus_queue.cc:237] T 179fd671030940b4b4a4e24bcc4aba0a P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 14.9, Last appended by leader: 9, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:29.193723 24387 raft_consensus.cc:3060] T d1e5873a19244c5ebbcd38e126796ee7 P 0473d2b2d01f4459b1e90fd12cc7840e [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:06:29.209501 24485 raft_consensus.cc:3055] T 2b74109013a140ada21feeef92d6f563 P 0473d2b2d01f4459b1e90fd12cc7840e [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:06:29.275072 19559 raft_consensus.cc:606] T 40e1e16737a842ee936002830f36882e P e61c3a8f61bb48f8a963c9480e53c168 [term 15 FOLLOWER]: Received request to transfer leadership to TS 0473d2b2d01f4459b1e90fd12cc7840e
I20260709 13:06:29.315231 19559 raft_consensus.cc:614] T 40e1e16737a842ee936002830f36882e P e61c3a8f61bb48f8a963c9480e53c168 [term 15 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:06:29.270541 24305 raft_consensus.cc:493] T df751f992649444090e27965eb1af85d P e5256d91808b47c195bc9b4dbd7f2b87 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:29.292644 24457 raft_consensus.cc:515] T ff75a1d4cb1f493db8f71ddc136ba9ab P e5256d91808b47c195bc9b4dbd7f2b87 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:29.316820 24305 raft_consensus.cc:515] T df751f992649444090e27965eb1af85d P e5256d91808b47c195bc9b4dbd7f2b87 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:29.318641 24457 leader_election.cc:290] T ff75a1d4cb1f493db8f71ddc136ba9ab P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 15 election: Requested vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:06:29.319371 24305 leader_election.cc:290] T df751f992649444090e27965eb1af85d P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:06:29.261090 24555 raft_consensus.cc:2749] T 1dc5b3532fe54f74876d02beffa2c230 P e5256d91808b47c195bc9b4dbd7f2b87 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:06:29.278124 19523 leader_election.cc:304] T edd7d470b5014c9489be7f41f64355c9 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e61c3a8f61bb48f8a963c9480e53c168; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:06:29.294528 24549 raft_consensus.cc:515] T bc225c93219c45538b53a1bd3d387e4d P 0473d2b2d01f4459b1e90fd12cc7840e [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
W20260709 13:06:29.320863 19523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.1:40321, user_credentials={real_user=slave}} blocked reactor thread for 85952.3us
I20260709 13:06:29.321539 19523 leader_election.cc:304] T fa8650e71aa14778b3d73721fc50d9fc P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e61c3a8f61bb48f8a963c9480e53c168; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:06:29.321897 24549 leader_election.cc:290] T bc225c93219c45538b53a1bd3d387e4d P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 13 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:06:29.295492 24384 raft_consensus.cc:515] T 9962423cb4e54fcfa5de01daf68a86e7 P 127766fc592545a4997f7790f50f6076 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:29.324458 24384 leader_election.cc:290] T 9962423cb4e54fcfa5de01daf68a86e7 P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 13 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:06:29.296936 24558 raft_consensus.cc:515] T b08304a0a02b42d7840c4e8ee9a6bd1a P 0473d2b2d01f4459b1e90fd12cc7840e [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:29.326627 24558 leader_election.cc:290] T b08304a0a02b42d7840c4e8ee9a6bd1a P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 14 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:06:29.327056 19479 raft_consensus.cc:2393] T bc225c93219c45538b53a1bd3d387e4d P 0473d2b2d01f4459b1e90fd12cc7840e [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e5256d91808b47c195bc9b4dbd7f2b87 in current term 13: Already voted for candidate 0473d2b2d01f4459b1e90fd12cc7840e in this term.
I20260709 13:06:29.327423 24601 raft_consensus.cc:2749] T edd7d470b5014c9489be7f41f64355c9 P e61c3a8f61bb48f8a963c9480e53c168 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:06:29.271014 24394 raft_consensus.cc:697] T 4509b76741dc428e9201c70c1658da13 P e5256d91808b47c195bc9b4dbd7f2b87 [term 10 LEADER]: Becoming Leader. State: Replica: e5256d91808b47c195bc9b4dbd7f2b87, State: Running, Role: LEADER
I20260709 13:06:29.328111 24601 raft_consensus.cc:2749] T fa8650e71aa14778b3d73721fc50d9fc P e61c3a8f61bb48f8a963c9480e53c168 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:06:29.329097 19523 leader_election.cc:304] T 4509b76741dc428e9201c70c1658da13 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168; no voters: 0473d2b2d01f4459b1e90fd12cc7840e
I20260709 13:06:29.328784 24394 consensus_queue.cc:237] T 4509b76741dc428e9201c70c1658da13 P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:29.330305 19523 leader_election.cc:304] T 217b5fae677b4971b3bbd2f357a1f7ff P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e61c3a8f61bb48f8a963c9480e53c168; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:06:29.331005 19407 raft_consensus.cc:2368] T ff75a1d4cb1f493db8f71ddc136ba9ab P e5256d91808b47c195bc9b4dbd7f2b87 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0473d2b2d01f4459b1e90fd12cc7840e for earlier term 14. Current term is 15.
I20260709 13:06:29.331509 24601 raft_consensus.cc:2749] T 217b5fae677b4971b3bbd2f357a1f7ff P e61c3a8f61bb48f8a963c9480e53c168 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:06:29.301855 19484 raft_consensus.cc:2468] T 4509b76741dc428e9201c70c1658da13 P 0473d2b2d01f4459b1e90fd12cc7840e [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 10.
I20260709 13:06:29.302244 24411 leader_election.cc:290] T 1a61655d99124a29b486ba4a5b37faea P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 12 election: Requested vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:06:29.351657 19406 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "46c5bfeecc314717bffe987e6844b6d0"
dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
mode: GRACEFUL
new_leader_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
 from {username='slave'} at 127.0.0.1:37312
I20260709 13:06:29.352398 19406 raft_consensus.cc:606] T 46c5bfeecc314717bffe987e6844b6d0 P e5256d91808b47c195bc9b4dbd7f2b87 [term 19 FOLLOWER]: Received request to transfer leadership to TS 0473d2b2d01f4459b1e90fd12cc7840e
I20260709 13:06:29.352519 19523 leader_election.cc:304] T 2b74109013a140ada21feeef92d6f563 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e61c3a8f61bb48f8a963c9480e53c168; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:06:29.352847 19406 raft_consensus.cc:614] T 46c5bfeecc314717bffe987e6844b6d0 P e5256d91808b47c195bc9b4dbd7f2b87 [term 19 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:06:29.353835 19523 leader_election.cc:304] T 76cb037fc9064d13b59a8969d897ce8c P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e61c3a8f61bb48f8a963c9480e53c168; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:06:29.354911 24601 raft_consensus.cc:2749] T 2b74109013a140ada21feeef92d6f563 P e61c3a8f61bb48f8a963c9480e53c168 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:06:29.203595 24610 consensus_queue.cc:1048] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P 127766fc592545a4997f7790f50f6076 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.103s
I20260709 13:06:29.315142 24485 raft_consensus.cc:740] T 2b74109013a140ada21feeef92d6f563 P 0473d2b2d01f4459b1e90fd12cc7840e [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 0473d2b2d01f4459b1e90fd12cc7840e, State: Running, Role: LEADER
I20260709 13:06:29.331063 24517 raft_consensus.cc:2764] T 4509b76741dc428e9201c70c1658da13 P e61c3a8f61bb48f8a963c9480e53c168 [term 10 FOLLOWER]: Leader election decision vote started in defunct term 9: won
I20260709 13:06:29.295364 19305 catalog_manager.cc:5697] T ece3db938bc649d4a40a51522ed5259c P e5256d91808b47c195bc9b4dbd7f2b87 reported cstate change: term changed from 8 to 10. New cstate: current_term: 10 leader_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:06:29.358139 19305 catalog_manager.cc:5697] T 1dc5b3532fe54f74876d02beffa2c230 P e5256d91808b47c195bc9b4dbd7f2b87 reported cstate change: term changed from 6 to 12, leader changed from 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2) to e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1). New cstate: current_term: 12 leader_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } health_report { overall_health: HEALTHY } } }
I20260709 13:06:29.304224 24370 leader_election.cc:290] T edd7d470b5014c9489be7f41f64355c9 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:06:29.347306 19403 raft_consensus.cc:2468] T 1dc5b3532fe54f74876d02beffa2c230 P e5256d91808b47c195bc9b4dbd7f2b87 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 15.
W20260709 13:06:29.341943 24509 consensus_meta.cc:287] T 85c494af21f9457a85da47b9bc70c1fd P 127766fc592545a4997f7790f50f6076: Time spent flushing consensus metadata: real 0.508s	user 0.009s	sys 0.000s
W20260709 13:06:29.360915 20078 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.2:46257, user_credentials={real_user=slave}} blocked reactor thread for 447706us
I20260709 13:06:29.362634 19523 leader_election.cc:304] T 14935b3ddf914369822e4a0547aaa355 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: e61c3a8f61bb48f8a963c9480e53c168; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:06:29.355577 24601 raft_consensus.cc:2749] T 76cb037fc9064d13b59a8969d897ce8c P e61c3a8f61bb48f8a963c9480e53c168 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:06:29.363742 19305 catalog_manager.cc:5697] T 4509b76741dc428e9201c70c1658da13 P e5256d91808b47c195bc9b4dbd7f2b87 reported cstate change: term changed from 4 to 8, leader changed from 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2) to e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1). New cstate: current_term: 8 leader_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } health_report { overall_health: UNKNOWN } } }
W20260709 13:06:29.364248 19450 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.3:36891, user_credentials={real_user=slave}} blocked reactor thread for 329043us
I20260709 13:06:29.370247 19406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc225c93219c45538b53a1bd3d387e4d" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
I20260709 13:06:29.371196 19404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b08304a0a02b42d7840c4e8ee9a6bd1a" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
I20260709 13:06:29.371816 19482 raft_consensus.cc:1275] T 2725d2c4cb054f18b0fc8f735c15f6c2 P 0473d2b2d01f4459b1e90fd12cc7840e [term 17 FOLLOWER]: Refusing update from remote peer e61c3a8f61bb48f8a963c9480e53c168: Log matching property violated. Preceding OpId in replica: term: 14 index: 7. Preceding OpId from leader: term: 17 index: 9. (index mismatch)
I20260709 13:06:29.371827 19404 raft_consensus.cc:3060] T b08304a0a02b42d7840c4e8ee9a6bd1a P e5256d91808b47c195bc9b4dbd7f2b87 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:06:29.373610 19406 raft_consensus.cc:2393] T bc225c93219c45538b53a1bd3d387e4d P e5256d91808b47c195bc9b4dbd7f2b87 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 0473d2b2d01f4459b1e90fd12cc7840e in current term 13: Already voted for candidate e5256d91808b47c195bc9b4dbd7f2b87 in this term.
I20260709 13:06:29.374228 19411 raft_consensus.cc:2468] T fa731b585f684a7fb2d106c50f143b83 P e5256d91808b47c195bc9b4dbd7f2b87 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 127766fc592545a4997f7790f50f6076 in term 12.
I20260709 13:06:29.378150 19305 catalog_manager.cc:5697] T 833a2f0775ed407a94b8924ce50adb63 P e5256d91808b47c195bc9b4dbd7f2b87 reported cstate change: term changed from 9 to 11. New cstate: current_term: 11 leader_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:06:29.379551 19523 leader_election.cc:304] T d1e5873a19244c5ebbcd38e126796ee7 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168; no voters: 0473d2b2d01f4459b1e90fd12cc7840e
W20260709 13:06:29.375428 20075 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.1:40321, user_credentials={real_user=slave}} blocked reactor thread for 202301us
I20260709 13:06:29.390570 20109 raft_consensus.cc:1275] T ab43d85f64114d4ebf618930e43d9ed0 P 127766fc592545a4997f7790f50f6076 [term 15 FOLLOWER]: Refusing update from remote peer 0473d2b2d01f4459b1e90fd12cc7840e: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 13:06:29.398073 19409 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "76cb037fc9064d13b59a8969d897ce8c"
dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
mode: GRACEFUL
new_leader_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
 from {username='slave'} at 127.0.0.1:37312
I20260709 13:06:29.366122 24541 consensus_queue.cc:1059] T a08760e15aac4630a629431f56024dc8 P e61c3a8f61bb48f8a963c9480e53c168 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 }, Status: INVALID_TERM, Last received: 14.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.028s
I20260709 13:06:29.401398 20075 leader_election.cc:304] T fa731b585f684a7fb2d106c50f143b83 P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 127766fc592545a4997f7790f50f6076, e5256d91808b47c195bc9b4dbd7f2b87; no voters: 
I20260709 13:06:29.386319 24543 raft_consensus.cc:2749] T 14935b3ddf914369822e4a0547aaa355 P e61c3a8f61bb48f8a963c9480e53c168 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:06:29.366362 24509 raft_consensus.cc:515] T 85c494af21f9457a85da47b9bc70c1fd P 127766fc592545a4997f7790f50f6076 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:29.392263 24601 raft_consensus.cc:2804] T d1e5873a19244c5ebbcd38e126796ee7 P e61c3a8f61bb48f8a963c9480e53c168 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:06:29.435904 19404 raft_consensus.cc:2468] T b08304a0a02b42d7840c4e8ee9a6bd1a P e5256d91808b47c195bc9b4dbd7f2b87 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 14.
I20260709 13:06:29.388736 24422 raft_consensus.cc:515] T 6c5eebf646ad445a9d1b1adc319d7b16 P 0473d2b2d01f4459b1e90fd12cc7840e [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:29.446403 19559 raft_consensus.cc:1275] T ab43d85f64114d4ebf618930e43d9ed0 P e61c3a8f61bb48f8a963c9480e53c168 [term 15 FOLLOWER]: Refusing update from remote peer 0473d2b2d01f4459b1e90fd12cc7840e: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 13:06:29.456067 19556 raft_consensus.cc:1275] T df751f992649444090e27965eb1af85d P e61c3a8f61bb48f8a963c9480e53c168 [term 17 FOLLOWER]: Refusing update from remote peer 0473d2b2d01f4459b1e90fd12cc7840e: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 13:06:29.457695 19560 raft_consensus.cc:1275] T ed7fdbcb96d14d418db9ca90a792588a P e61c3a8f61bb48f8a963c9480e53c168 [term 10 FOLLOWER]: Refusing update from remote peer 0473d2b2d01f4459b1e90fd12cc7840e: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:06:29.460348 24422 leader_election.cc:290] T 6c5eebf646ad445a9d1b1adc319d7b16 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 14 election: Requested vote from peers e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:06:29.417155 24473 consensus_queue.cc:1048] T edd7d470b5014c9489be7f41f64355c9 P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.044s
I20260709 13:06:29.403889 24623 consensus_queue.cc:1048] T df751f992649444090e27965eb1af85d P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 8, Time since last communication: 0.063s
I20260709 13:06:29.464010 19559 raft_consensus.cc:1275] T 48824d5acfbc485ebf8c2d944e7202de P e61c3a8f61bb48f8a963c9480e53c168 [term 16 FOLLOWER]: Refusing update from remote peer 0473d2b2d01f4459b1e90fd12cc7840e: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 13:06:29.472712 19552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b08304a0a02b42d7840c4e8ee9a6bd1a" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:06:29.473326 19552 raft_consensus.cc:3060] T b08304a0a02b42d7840c4e8ee9a6bd1a P e61c3a8f61bb48f8a963c9480e53c168 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:06:29.439898 24517 consensus_queue.cc:1048] T 2725d2c4cb054f18b0fc8f735c15f6c2 P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.035s
I20260709 13:06:29.475425 19555 raft_consensus.cc:1240] T 2b74109013a140ada21feeef92d6f563 P e61c3a8f61bb48f8a963c9480e53c168 [term 11 FOLLOWER]: Rejecting Update request from peer 0473d2b2d01f4459b1e90fd12cc7840e for earlier term 10. Current term is 11. Ops: []
I20260709 13:06:29.477202 19553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc225c93219c45538b53a1bd3d387e4d" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:06:29.477748 19553 raft_consensus.cc:3060] T bc225c93219c45538b53a1bd3d387e4d P e61c3a8f61bb48f8a963c9480e53c168 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:06:29.439235 24466 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.541s	user 0.014s	sys 0.033s
I20260709 13:06:29.483960 19555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e381f1d6b8184797ad142de49be225a8" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:06:29.488981 19554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a61655d99124a29b486ba4a5b37faea" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:06:29.507148 19554 raft_consensus.cc:3060] T 1a61655d99124a29b486ba4a5b37faea P e61c3a8f61bb48f8a963c9480e53c168 [term 10 FOLLOWER]: Advancing to term 12
I20260709 13:06:29.491323 19559 raft_consensus.cc:1275] T 62c6c134d3d24a1ab144dd9ee6bc3f64 P e61c3a8f61bb48f8a963c9480e53c168 [term 14 FOLLOWER]: Refusing update from remote peer 0473d2b2d01f4459b1e90fd12cc7840e: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 13:06:29.430922 24577 consensus_queue.cc:1048] T 76cb037fc9064d13b59a8969d897ce8c P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.074s
I20260709 13:06:29.430244 24601 raft_consensus.cc:493] T d1e5873a19244c5ebbcd38e126796ee7 P e61c3a8f61bb48f8a963c9480e53c168 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:29.510901 19560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef32ce6fdd0e40d382c79974f30295c6" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:06:29.515602 19559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff75a1d4cb1f493db8f71ddc136ba9ab" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:06:29.524750 19559 raft_consensus.cc:3060] T ff75a1d4cb1f493db8f71ddc136ba9ab P e61c3a8f61bb48f8a963c9480e53c168 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:06:29.521493 19552 raft_consensus.cc:2468] T b08304a0a02b42d7840c4e8ee9a6bd1a P e61c3a8f61bb48f8a963c9480e53c168 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 14.
I20260709 13:06:29.527457 19553 raft_consensus.cc:2468] T bc225c93219c45538b53a1bd3d387e4d P e61c3a8f61bb48f8a963c9480e53c168 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 13.
I20260709 13:06:29.528474 19555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df751f992649444090e27965eb1af85d" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 18 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:06:29.531361 19558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edd7d470b5014c9489be7f41f64355c9" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 16 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:06:29.524647 19560 raft_consensus.cc:3060] T ef32ce6fdd0e40d382c79974f30295c6 P e61c3a8f61bb48f8a963c9480e53c168 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:06:29.537523 19555 raft_consensus.cc:2410] T df751f992649444090e27965eb1af85d P e61c3a8f61bb48f8a963c9480e53c168 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e5256d91808b47c195bc9b4dbd7f2b87 for term 18 because replica has last-logged OpId of term: 16 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 8.
W20260709 13:06:29.506721 24466 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.609s	user 0.014s	sys 0.033s
I20260709 13:06:29.573472 19558 raft_consensus.cc:2468] T edd7d470b5014c9489be7f41f64355c9 P e61c3a8f61bb48f8a963c9480e53c168 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 15.
I20260709 13:06:29.613898 19409 raft_consensus.cc:606] T 76cb037fc9064d13b59a8969d897ce8c P e5256d91808b47c195bc9b4dbd7f2b87 [term 12 FOLLOWER]: Received request to transfer leadership to TS 0473d2b2d01f4459b1e90fd12cc7840e
I20260709 13:06:29.614359 19409 raft_consensus.cc:614] T 76cb037fc9064d13b59a8969d897ce8c P e5256d91808b47c195bc9b4dbd7f2b87 [term 12 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:06:29.599545 24370 raft_consensus.cc:493] T 217b5fae677b4971b3bbd2f357a1f7ff P e5256d91808b47c195bc9b4dbd7f2b87 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 0473d2b2d01f4459b1e90fd12cc7840e)
I20260709 13:06:29.615000 24370 raft_consensus.cc:515] T 217b5fae677b4971b3bbd2f357a1f7ff P e5256d91808b47c195bc9b4dbd7f2b87 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:29.618463 24370 leader_election.cc:290] T 217b5fae677b4971b3bbd2f357a1f7ff P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:06:29.529435 24422 raft_consensus.cc:493] T 172b3dd13109415a955b71ac0e9d2234 P 0473d2b2d01f4459b1e90fd12cc7840e [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 127766fc592545a4997f7790f50f6076)
W20260709 13:06:29.623369 20078 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.2:46257, user_credentials={real_user=slave}} blocked reactor thread for 230227us
I20260709 13:06:29.527931 24601 raft_consensus.cc:3060] T d1e5873a19244c5ebbcd38e126796ee7 P e61c3a8f61bb48f8a963c9480e53c168 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:06:29.552366 24413 raft_consensus.cc:493] T 65d8cb8d6ec64f459d5a47cefab10acf P 127766fc592545a4997f7790f50f6076 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:29.553313 24141 raft_consensus.cc:2804] T fa731b585f684a7fb2d106c50f143b83 P 127766fc592545a4997f7790f50f6076 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:06:29.610334 19554 raft_consensus.cc:2468] T 1a61655d99124a29b486ba4a5b37faea P e61c3a8f61bb48f8a963c9480e53c168 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 12.
I20260709 13:06:29.650010 19480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e381f1d6b8184797ad142de49be225a8" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:06:29.650313 19477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef32ce6fdd0e40d382c79974f30295c6" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:06:29.650890 19477 raft_consensus.cc:3060] T ef32ce6fdd0e40d382c79974f30295c6 P 0473d2b2d01f4459b1e90fd12cc7840e [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:06:29.650959 19480 raft_consensus.cc:2468] T e381f1d6b8184797ad142de49be225a8 P 0473d2b2d01f4459b1e90fd12cc7840e [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 11.
I20260709 13:06:29.640002 19559 raft_consensus.cc:2468] T ff75a1d4cb1f493db8f71ddc136ba9ab P e61c3a8f61bb48f8a963c9480e53c168 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 15.
I20260709 13:06:29.642817 20109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c5eebf646ad445a9d1b1adc319d7b16" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076"
I20260709 13:06:29.642923 20110 raft_consensus.cc:1275] T 62c6c134d3d24a1ab144dd9ee6bc3f64 P 127766fc592545a4997f7790f50f6076 [term 14 FOLLOWER]: Refusing update from remote peer 0473d2b2d01f4459b1e90fd12cc7840e: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 13:06:29.645527 19375 leader_election.cc:304] T edd7d470b5014c9489be7f41f64355c9 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:06:29.657658 19558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "217b5fae677b4971b3bbd2f357a1f7ff" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:06:29.658406 19558 raft_consensus.cc:2393] T 217b5fae677b4971b3bbd2f357a1f7ff P e61c3a8f61bb48f8a963c9480e53c168 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e5256d91808b47c195bc9b4dbd7f2b87 in current term 11: Already voted for candidate e61c3a8f61bb48f8a963c9480e53c168 in this term.
I20260709 13:06:29.438963 24485 consensus_queue.cc:260] T 2b74109013a140ada21feeef92d6f563 P 0473d2b2d01f4459b1e90fd12cc7840e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:29.659624 24485 raft_consensus.cc:3060] T 2b74109013a140ada21feeef92d6f563 P 0473d2b2d01f4459b1e90fd12cc7840e [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:06:29.663311 24141 raft_consensus.cc:697] T fa731b585f684a7fb2d106c50f143b83 P 127766fc592545a4997f7790f50f6076 [term 12 LEADER]: Becoming Leader. State: Replica: 127766fc592545a4997f7790f50f6076, State: Running, Role: LEADER
I20260709 13:06:29.664155 19481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9962423cb4e54fcfa5de01daf68a86e7" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:06:29.664242 24141 consensus_queue.cc:237] T fa731b585f684a7fb2d106c50f143b83 P 127766fc592545a4997f7790f50f6076 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:29.664805 19481 raft_consensus.cc:3060] T 9962423cb4e54fcfa5de01daf68a86e7 P 0473d2b2d01f4459b1e90fd12cc7840e [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:06:29.666872 24413 raft_consensus.cc:515] T 65d8cb8d6ec64f459d5a47cefab10acf P 127766fc592545a4997f7790f50f6076 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:29.671893 19551 raft_consensus.cc:3060] T a08760e15aac4630a629431f56024dc8 P e61c3a8f61bb48f8a963c9480e53c168 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:06:29.679188 24612 raft_consensus.cc:493] T 172b3dd13109415a955b71ac0e9d2234 P 127766fc592545a4997f7790f50f6076 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:29.679772 24612 raft_consensus.cc:515] T 172b3dd13109415a955b71ac0e9d2234 P 127766fc592545a4997f7790f50f6076 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:29.681799 19449 leader_election.cc:304] T b08304a0a02b42d7840c4e8ee9a6bd1a P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87; no voters: 
I20260709 13:06:29.667258 19479 raft_consensus.cc:1275] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P 0473d2b2d01f4459b1e90fd12cc7840e [term 16 FOLLOWER]: Refusing update from remote peer 127766fc592545a4997f7790f50f6076: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 13:06:29.686928 19477 raft_consensus.cc:2468] T ef32ce6fdd0e40d382c79974f30295c6 P 0473d2b2d01f4459b1e90fd12cc7840e [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 17.
W20260709 13:06:29.690047 19375 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.3:36891, user_credentials={real_user=slave}} blocked reactor thread for 44586.8us
W20260709 13:06:29.693428 20075 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.1:40321, user_credentials={real_user=slave}} blocked reactor thread for 292975us
I20260709 13:06:29.625635 24530 raft_consensus.cc:493] T 217b5fae677b4971b3bbd2f357a1f7ff P 0473d2b2d01f4459b1e90fd12cc7840e [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:29.713795 19375 leader_election.cc:304] T 1a61655d99124a29b486ba4a5b37faea P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:06:29.714661 19375 leader_election.cc:304] T ff75a1d4cb1f493db8f71ddc136ba9ab P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
W20260709 13:06:29.715044 20075 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:29.647162 24558 raft_consensus.cc:476] T 46c5bfeecc314717bffe987e6844b6d0 P 0473d2b2d01f4459b1e90fd12cc7840e [term 19 LEADER]: Not starting pre-election -- already a leader
I20260709 13:06:29.644791 24543 raft_consensus.cc:493] T 7f575b143b844aa096b50997dad3516a P e61c3a8f61bb48f8a963c9480e53c168 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader e5256d91808b47c195bc9b4dbd7f2b87)
W20260709 13:06:29.765527 19449 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.1:40321, user_credentials={real_user=slave}} blocked reactor thread for 82859.4us
W20260709 13:06:29.713519 24615 log.cc:927] Time spent T 28af091831594f9d8e96482078cc7625 P e61c3a8f61bb48f8a963c9480e53c168: Append to log took a long time: real 0.065s	user 0.000s	sys 0.000s
I20260709 13:06:29.771528 19477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a61655d99124a29b486ba4a5b37faea" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:06:29.774451 19449 leader_election.cc:400] T ff75a1d4cb1f493db8f71ddc136ba9ab P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 14 pre-election: Vote denied by peer e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321) with higher term. Message: Invalid argument: T ff75a1d4cb1f493db8f71ddc136ba9ab P e5256d91808b47c195bc9b4dbd7f2b87 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0473d2b2d01f4459b1e90fd12cc7840e for earlier term 14. Current term is 15.
I20260709 13:06:29.777421 19449 leader_election.cc:403] T ff75a1d4cb1f493db8f71ddc136ba9ab P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 14 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:06:29.777491 19477 raft_consensus.cc:3060] T 1a61655d99124a29b486ba4a5b37faea P 0473d2b2d01f4459b1e90fd12cc7840e [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:06:29.712522 24466 raft_consensus.cc:2804] T b08304a0a02b42d7840c4e8ee9a6bd1a P 0473d2b2d01f4459b1e90fd12cc7840e [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:06:29.728386 24305 raft_consensus.cc:493] T 172b3dd13109415a955b71ac0e9d2234 P e5256d91808b47c195bc9b4dbd7f2b87 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:29.644853 24422 raft_consensus.cc:515] T 172b3dd13109415a955b71ac0e9d2234 P 0473d2b2d01f4459b1e90fd12cc7840e [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
W20260709 13:06:29.814482 19523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.1:40321, user_credentials={real_user=slave}} blocked reactor thread for 434958us
I20260709 13:06:29.816826 19479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edd7d470b5014c9489be7f41f64355c9" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 16 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:06:29.819566 19479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff75a1d4cb1f493db8f71ddc136ba9ab" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:06:29.820006 19486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df751f992649444090e27965eb1af85d" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 18 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:06:29.824091 19486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "217b5fae677b4971b3bbd2f357a1f7ff" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:06:29.793994 19477 raft_consensus.cc:2468] T 1a61655d99124a29b486ba4a5b37faea P 0473d2b2d01f4459b1e90fd12cc7840e [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 12.
I20260709 13:06:29.826032 19558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c5eebf646ad445a9d1b1adc319d7b16" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:06:29.826771 19558 raft_consensus.cc:3060] T 6c5eebf646ad445a9d1b1adc319d7b16 P e61c3a8f61bb48f8a963c9480e53c168 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:06:29.771761 24457 raft_consensus.cc:2804] T 1a61655d99124a29b486ba4a5b37faea P e5256d91808b47c195bc9b4dbd7f2b87 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:06:29.841708 19558 raft_consensus.cc:2468] T 6c5eebf646ad445a9d1b1adc319d7b16 P e61c3a8f61bb48f8a963c9480e53c168 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 14.
I20260709 13:06:29.775760 24372 raft_consensus.cc:2804] T ff75a1d4cb1f493db8f71ddc136ba9ab P e5256d91808b47c195bc9b4dbd7f2b87 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:06:29.849686 19523 leader_election.cc:304] T 3e1f505cb0f1427bbd698ac889d80821 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e61c3a8f61bb48f8a963c9480e53c168; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:06:29.850045 19551 raft_consensus.cc:1275] T a08760e15aac4630a629431f56024dc8 P e61c3a8f61bb48f8a963c9480e53c168 [term 17 FOLLOWER]: Refusing update from remote peer 0473d2b2d01f4459b1e90fd12cc7840e: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
W20260709 13:06:29.851075 19449 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.1:40321, user_credentials={real_user=slave}} blocked reactor thread for 55156.7us
I20260709 13:06:29.764367 24530 raft_consensus.cc:515] T 217b5fae677b4971b3bbd2f357a1f7ff P 0473d2b2d01f4459b1e90fd12cc7840e [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:29.855108 19523 leader_election.cc:304] T 1dc5b3532fe54f74876d02beffa2c230 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168; no voters: 0473d2b2d01f4459b1e90fd12cc7840e
W20260709 13:06:29.859668 19452 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:29.859269 19551 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40428 (request call id 2803) took 1252 ms. Trace:
I20260709 13:06:29.861388 19551 rpcz_store.cc:276] 0709 13:06:28.607098 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:28.613336 (+  6238us) service_pool.cc:224] Handling call
0709 13:06:28.613593 (+   257us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:28.960382 (+346789us) spinlock_profiling.cc:243] Waited 54 ms on lock 0x7b54003771a0. stack: 00007f4a79de9343 00007f4a79de9240 00007f4a797781d4 00007f4a834b6304 00007f4a834b6299 00007f4a7ce71571 00007f4a7ce8606f 00007f4a7cefef60 00007f4a7cf007de 00007f4a7cf0ab49 00007f4a7cf0b416 00007f4a7cf07d8f 00007f4a7cf0783e 00007f4a81ecc419 00007f4a7b443bd4 00007f4a7b443b62
0709 13:06:29.671479 (+711097us) spinlock_profiling.cc:243] Waited 661 ms on lock 0x7b580095a2d0. stack: 00007f4a79de9343 00007f4a79de9240 00007f4a797781d4 00007f4a834b6304 00007f4a834b6299 00007f4a7ce71571 00007f4a7ce640aa 00007f4a7cee6447 00007f4a7cefefe7 00007f4a7cf007de 00007f4a7cf0ab49 00007f4a7cf0b416 00007f4a7cf07d8f 00007f4a7cf0783e 00007f4a81ecc419 00007f4a7b443bd4
0709 13:06:29.850554 (+179075us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:29.859183 (+  8629us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1644083328}
I20260709 13:06:29.771111 24577 consensus_queue.cc:1048] T edd7d470b5014c9489be7f41f64355c9 P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.074s
I20260709 13:06:29.816809 24387 raft_consensus.cc:3060] T ff75a1d4cb1f493db8f71ddc136ba9ab P 0473d2b2d01f4459b1e90fd12cc7840e [term 13 FOLLOWER]: Advancing to term 15
W20260709 13:06:29.851370 24607 log.cc:927] Time spent T a08760e15aac4630a629431f56024dc8 P e5256d91808b47c195bc9b4dbd7f2b87: Append to log took a long time: real 0.068s	user 0.000s	sys 0.000s
I20260709 13:06:29.779316 24543 raft_consensus.cc:515] T 7f575b143b844aa096b50997dad3516a P e61c3a8f61bb48f8a963c9480e53c168 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
W20260709 13:06:29.917524 19523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.1:40321, user_credentials={real_user=slave}} blocked reactor thread for 62532.2us
I20260709 13:06:29.917080 19486 raft_consensus.cc:2468] T 217b5fae677b4971b3bbd2f357a1f7ff P 0473d2b2d01f4459b1e90fd12cc7840e [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 11.
I20260709 13:06:29.850988 24466 raft_consensus.cc:697] T b08304a0a02b42d7840c4e8ee9a6bd1a P 0473d2b2d01f4459b1e90fd12cc7840e [term 14 LEADER]: Becoming Leader. State: Replica: 0473d2b2d01f4459b1e90fd12cc7840e, State: Running, Role: LEADER
I20260709 13:06:29.920717 19411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9962423cb4e54fcfa5de01daf68a86e7" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
I20260709 13:06:29.926229 19411 raft_consensus.cc:3060] T 9962423cb4e54fcfa5de01daf68a86e7 P e5256d91808b47c195bc9b4dbd7f2b87 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:06:29.923694 20076 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.3:36891, user_credentials={real_user=slave}} blocked reactor thread for 233789us
I20260709 13:06:29.931628 19523 leader_election.cc:304] T 48824d5acfbc485ebf8c2d944e7202de P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e61c3a8f61bb48f8a963c9480e53c168; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, 127766fc592545a4997f7790f50f6076
I20260709 13:06:29.938840 19402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "172b3dd13109415a955b71ac0e9d2234" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:06:29.854637 24596 raft_consensus.cc:493] T ab43d85f64114d4ebf618930e43d9ed0 P e5256d91808b47c195bc9b4dbd7f2b87 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 127766fc592545a4997f7790f50f6076)
I20260709 13:06:29.866874 24457 raft_consensus.cc:697] T 1a61655d99124a29b486ba4a5b37faea P e5256d91808b47c195bc9b4dbd7f2b87 [term 12 LEADER]: Becoming Leader. State: Replica: e5256d91808b47c195bc9b4dbd7f2b87, State: Running, Role: LEADER
I20260709 13:06:29.867187 24372 raft_consensus.cc:697] T ff75a1d4cb1f493db8f71ddc136ba9ab P e5256d91808b47c195bc9b4dbd7f2b87 [term 15 LEADER]: Becoming Leader. State: Replica: e5256d91808b47c195bc9b4dbd7f2b87, State: Running, Role: LEADER
I20260709 13:06:29.949064 19411 raft_consensus.cc:2468] T 9962423cb4e54fcfa5de01daf68a86e7 P e5256d91808b47c195bc9b4dbd7f2b87 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 127766fc592545a4997f7790f50f6076 in term 13.
I20260709 13:06:29.906566 24545 raft_consensus.cc:2804] T 1dc5b3532fe54f74876d02beffa2c230 P e61c3a8f61bb48f8a963c9480e53c168 [term 15 FOLLOWER]: Leader election won for term 15
W20260709 13:06:29.958031 24627 log.cc:927] Time spent T 6c5eebf646ad445a9d1b1adc319d7b16 P 127766fc592545a4997f7790f50f6076: Append to log took a long time: real 0.186s	user 0.000s	sys 0.000s
W20260709 13:06:29.960140 24631 log.cc:927] Time spent T 4509b76741dc428e9201c70c1658da13 P e5256d91808b47c195bc9b4dbd7f2b87: Append to log took a long time: real 0.120s	user 0.000s	sys 0.000s
I20260709 13:06:29.961304 24621 raft_consensus.cc:2804] T edd7d470b5014c9489be7f41f64355c9 P e5256d91808b47c195bc9b4dbd7f2b87 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:06:29.961871 24621 raft_consensus.cc:493] T edd7d470b5014c9489be7f41f64355c9 P e5256d91808b47c195bc9b4dbd7f2b87 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:29.962284 24621 raft_consensus.cc:3060] T edd7d470b5014c9489be7f41f64355c9 P e5256d91808b47c195bc9b4dbd7f2b87 [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:06:29.962738 24625 log.cc:927] Time spent T 46c5bfeecc314717bffe987e6844b6d0 P 0473d2b2d01f4459b1e90fd12cc7840e: Append to log took a long time: real 0.318s	user 0.000s	sys 0.001s
W20260709 13:06:29.966740 24618 log.cc:927] Time spent T 48824d5acfbc485ebf8c2d944e7202de P 127766fc592545a4997f7790f50f6076: Append to log took a long time: real 0.327s	user 0.001s	sys 0.000s
W20260709 13:06:29.967345 24628 log.cc:927] Time spent T 76cb037fc9064d13b59a8969d897ce8c P e5256d91808b47c195bc9b4dbd7f2b87: Append to log took a long time: real 0.123s	user 0.000s	sys 0.000s
I20260709 13:06:29.969110 24545 raft_consensus.cc:697] T 1dc5b3532fe54f74876d02beffa2c230 P e61c3a8f61bb48f8a963c9480e53c168 [term 15 LEADER]: Becoming Leader. State: Replica: e61c3a8f61bb48f8a963c9480e53c168, State: Running, Role: LEADER
I20260709 13:06:29.970278 24545 consensus_queue.cc:237] T 1dc5b3532fe54f74876d02beffa2c230 P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 13.7, Last appended by leader: 7, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:29.975018 24543 leader_election.cc:290] T 7f575b143b844aa096b50997dad3516a P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:06:29.937513 24478 consensus_queue.cc:1048] T ab43d85f64114d4ebf618930e43d9ed0 P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.039s
I20260709 13:06:29.845577 24305 raft_consensus.cc:515] T 172b3dd13109415a955b71ac0e9d2234 P e5256d91808b47c195bc9b4dbd7f2b87 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:29.981392 24305 leader_election.cc:290] T 172b3dd13109415a955b71ac0e9d2234 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:06:29.982355 24633 raft_consensus.cc:2749] T 48824d5acfbc485ebf8c2d944e7202de P e61c3a8f61bb48f8a963c9480e53c168 [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:06:29.983696 24457 consensus_queue.cc:237] T 1a61655d99124a29b486ba4a5b37faea P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
W20260709 13:06:29.989188 24602 log.cc:927] Time spent T 2725d2c4cb054f18b0fc8f735c15f6c2 P e61c3a8f61bb48f8a963c9480e53c168: Append to log took a long time: real 0.793s	user 0.006s	sys 0.009s
I20260709 13:06:29.990999 24372 consensus_queue.cc:237] T ff75a1d4cb1f493db8f71ddc136ba9ab P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:29.996295 19402 raft_consensus.cc:2468] T 172b3dd13109415a955b71ac0e9d2234 P e5256d91808b47c195bc9b4dbd7f2b87 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 127766fc592545a4997f7790f50f6076 in term 12.
I20260709 13:06:29.998847 20109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "172b3dd13109415a955b71ac0e9d2234" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:06:29.913997 24509 leader_election.cc:290] T 85c494af21f9457a85da47b9bc70c1fd P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 14 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:06:29.999650 20109 raft_consensus.cc:2468] T 172b3dd13109415a955b71ac0e9d2234 P 127766fc592545a4997f7790f50f6076 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 12.
W20260709 13:06:30.008514 19523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.4:43121, user_credentials={real_user=slave}} blocked reactor thread for 77000.6us
I20260709 13:06:30.008823 19374 leader_election.cc:304] T 172b3dd13109415a955b71ac0e9d2234 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 127766fc592545a4997f7790f50f6076, e5256d91808b47c195bc9b4dbd7f2b87; no voters: 
I20260709 13:06:30.006338 19405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65d8cb8d6ec64f459d5a47cefab10acf" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:06:30.009503 19523 leader_election.cc:304] T 0e1085d23e8347fbbd5bce7542f4b1f4 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e61c3a8f61bb48f8a963c9480e53c168; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, 127766fc592545a4997f7790f50f6076
I20260709 13:06:30.027881 24305 raft_consensus.cc:2804] T 172b3dd13109415a955b71ac0e9d2234 P e5256d91808b47c195bc9b4dbd7f2b87 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:06:30.028465 24305 raft_consensus.cc:493] T 172b3dd13109415a955b71ac0e9d2234 P e5256d91808b47c195bc9b4dbd7f2b87 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:30.028875 24305 raft_consensus.cc:3060] T 172b3dd13109415a955b71ac0e9d2234 P e5256d91808b47c195bc9b4dbd7f2b87 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:06:30.044086 24507 raft_consensus.cc:493] T 833a2f0775ed407a94b8924ce50adb63 P e5256d91808b47c195bc9b4dbd7f2b87 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 127766fc592545a4997f7790f50f6076)
I20260709 13:06:30.045001 24507 raft_consensus.cc:515] T 833a2f0775ed407a94b8924ce50adb63 P e5256d91808b47c195bc9b4dbd7f2b87 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:30.045912 24517 raft_consensus.cc:2749] T 0e1085d23e8347fbbd5bce7542f4b1f4 P e61c3a8f61bb48f8a963c9480e53c168 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:06:30.049489 24466 consensus_queue.cc:237] T b08304a0a02b42d7840c4e8ee9a6bd1a P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:30.005560 20103 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46436 (request call id 789) took 1091 ms. Trace:
I20260709 13:06:30.054450 19523 leader_election.cc:400] T 65d8cb8d6ec64f459d5a47cefab10acf P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 14 pre-election: Vote denied by peer 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121) with higher term. Message: Invalid argument: T 65d8cb8d6ec64f459d5a47cefab10acf P 127766fc592545a4997f7790f50f6076 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e61c3a8f61bb48f8a963c9480e53c168 for earlier term 14. Current term is 15.
I20260709 13:06:30.055792 19523 leader_election.cc:403] T 65d8cb8d6ec64f459d5a47cefab10acf P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 14 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:06:30.063282 19411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85c494af21f9457a85da47b9bc70c1fd" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
I20260709 13:06:30.065748 19481 raft_consensus.cc:2468] T 9962423cb4e54fcfa5de01daf68a86e7 P 0473d2b2d01f4459b1e90fd12cc7840e [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 127766fc592545a4997f7790f50f6076 in term 13.
I20260709 13:06:30.064101 19411 raft_consensus.cc:3060] T 85c494af21f9457a85da47b9bc70c1fd P e5256d91808b47c195bc9b4dbd7f2b87 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:06:30.055112 20103 rpcz_store.cc:276] 0709 13:06:28.906123 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:28.906255 (+   132us) service_pool.cc:224] Handling call
0709 13:06:28.906542 (+   287us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:29.131178 (+224636us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:29.131206 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:29.156323 (+ 25117us) log.cc:844] Serialized 26 byte log entry
0709 13:06:29.377068 (+220745us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:06:29.377118 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:29.377197 (+    79us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:29.995590 (+618393us) raft_consensus.cc:1685] finished
0709 13:06:29.995619 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:29.997098 (+  1479us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":47993,"raft.queue_time_us":101095,"raft.run_cpu_time_us":112,"raft.run_wall_time_us":11891,"thread_start_us":397854,"threads_started":2,"wal-append.queue_time_us":357556}
I20260709 13:06:29.938177 24482 consensus_queue.cc:1048] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P 127766fc592545a4997f7790f50f6076 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.127s
I20260709 13:06:30.049520 24567 leader_election.cc:290] T fa731b585f684a7fb2d106c50f143b83 P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 12 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
W20260709 13:06:30.068075 24607 log.cc:927] Time spent T a08760e15aac4630a629431f56024dc8 P e5256d91808b47c195bc9b4dbd7f2b87: Append to log took a long time: real 0.068s	user 0.000s	sys 0.000s
I20260709 13:06:30.061026 24517 raft_consensus.cc:2749] T 65d8cb8d6ec64f459d5a47cefab10acf P e61c3a8f61bb48f8a963c9480e53c168 [term 15 FOLLOWER]: Leader pre-election lost for term 14. Reason: Vote denied by peer 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121) with higher term. Message: Invalid argument: T 65d8cb8d6ec64f459d5a47cefab10acf P 127766fc592545a4997f7790f50f6076 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e61c3a8f61bb48f8a963c9480e53c168 for earlier term 14. Current term is 15.
W20260709 13:06:30.102207 19523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.4:43121, user_credentials={real_user=slave}} blocked reactor thread for 54692.2us
I20260709 13:06:30.102995 19523 leader_election.cc:304] T 96efeaaf1057492490e9a621f37e1a2d P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 127766fc592545a4997f7790f50f6076, e61c3a8f61bb48f8a963c9480e53c168; no voters: 0473d2b2d01f4459b1e90fd12cc7840e
I20260709 13:06:30.104091 24601 raft_consensus.cc:515] T d1e5873a19244c5ebbcd38e126796ee7 P e61c3a8f61bb48f8a963c9480e53c168 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
W20260709 13:06:30.105049 19450 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.3:36891, user_credentials={real_user=slave}} blocked reactor thread for 197836us
W20260709 13:06:30.074891 19449 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.4:43121, user_credentials={real_user=slave}} blocked reactor thread for 223152us
I20260709 13:06:30.074680 24530 leader_election.cc:290] T 217b5fae677b4971b3bbd2f357a1f7ff P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:06:30.123811 19411 raft_consensus.cc:2468] T 85c494af21f9457a85da47b9bc70c1fd P e5256d91808b47c195bc9b4dbd7f2b87 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 127766fc592545a4997f7790f50f6076 in term 14.
I20260709 13:06:30.079648 24543 raft_consensus.cc:493] T e381f1d6b8184797ad142de49be225a8 P e61c3a8f61bb48f8a963c9480e53c168 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 0473d2b2d01f4459b1e90fd12cc7840e)
I20260709 13:06:30.099604 24422 leader_election.cc:290] T 172b3dd13109415a955b71ac0e9d2234 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:06:30.004014 24596 raft_consensus.cc:515] T ab43d85f64114d4ebf618930e43d9ed0 P e5256d91808b47c195bc9b4dbd7f2b87 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } attrs { replace: true } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:30.205523 24543 raft_consensus.cc:515] T e381f1d6b8184797ad142de49be225a8 P e61c3a8f61bb48f8a963c9480e53c168 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:30.077611 24633 raft_consensus.cc:493] T f93ee515a9c14139bf566522ed8232f3 P e61c3a8f61bb48f8a963c9480e53c168 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 0473d2b2d01f4459b1e90fd12cc7840e)
I20260709 13:06:30.215978 20103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab43d85f64114d4ebf618930e43d9ed0" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:06:30.218017 20103 raft_consensus.cc:1813] T ab43d85f64114d4ebf618930e43d9ed0 P 127766fc592545a4997f7790f50f6076 [term 15 FOLLOWER]: Handling vote request from an unknown peer e5256d91808b47c195bc9b4dbd7f2b87
W20260709 13:06:30.218348 19450 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.3:36891, user_credentials={real_user=slave}} blocked reactor thread for 62104.4us
I20260709 13:06:30.218624 20103 raft_consensus.cc:2393] T ab43d85f64114d4ebf618930e43d9ed0 P 127766fc592545a4997f7790f50f6076 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e5256d91808b47c195bc9b4dbd7f2b87 in current term 15: Already voted for candidate 0473d2b2d01f4459b1e90fd12cc7840e in this term.
W20260709 13:06:30.216240 19449 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.4:43121, user_credentials={real_user=slave}} blocked reactor thread for 78505.8us
W20260709 13:06:30.196862 24606 log.cc:927] Time spent T 3e1f505cb0f1427bbd698ac889d80821 P e5256d91808b47c195bc9b4dbd7f2b87: Append to log took a long time: real 0.091s	user 0.000s	sys 0.000s
I20260709 13:06:30.210527 24516 raft_consensus.cc:2749] T 3e1f505cb0f1427bbd698ac889d80821 P e61c3a8f61bb48f8a963c9480e53c168 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 13:06:30.236330 20076 leader_election.cc:336] T 0e1085d23e8347fbbd5bce7542f4b1f4 P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891): Timed out: RequestConsensusVote RPC to 127.17.223.3:36891 timed out after 2.048s (SENT)
I20260709 13:06:30.280378 20076 leader_election.cc:304] T 0e1085d23e8347fbbd5bce7542f4b1f4 P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 127766fc592545a4997f7790f50f6076; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168
W20260709 13:06:30.223707 24609 log.cc:927] Time spent T 3e1f505cb0f1427bbd698ac889d80821 P e61c3a8f61bb48f8a963c9480e53c168: Append to log took a long time: real 0.084s	user 0.000s	sys 0.000s
I20260709 13:06:30.155161 24577 consensus_queue.cc:1048] T df751f992649444090e27965eb1af85d P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.079s
I20260709 13:06:30.217037 24596 leader_election.cc:290] T ab43d85f64114d4ebf618930e43d9ed0 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:06:30.209997 24558 consensus_queue.cc:1048] T ed7fdbcb96d14d418db9ca90a792588a P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.050s
I20260709 13:06:30.210722 24554 consensus_queue.cc:1048] T ab43d85f64114d4ebf618930e43d9ed0 P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Connected to new peer: Peer: permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.078s
I20260709 13:06:30.277153 24517 raft_consensus.cc:2804] T 96efeaaf1057492490e9a621f37e1a2d P e61c3a8f61bb48f8a963c9480e53c168 [term 15 FOLLOWER]: Leader pre-election won for term 16
W20260709 13:06:30.327150 19523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.4:43121, user_credentials={real_user=slave}} blocked reactor thread for 224220us
W20260709 13:06:30.329334 20075 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:30.329586 19560 consensus_meta.cc:287] T ef32ce6fdd0e40d382c79974f30295c6 P e61c3a8f61bb48f8a963c9480e53c168: Time spent flushing consensus metadata: real 0.735s	user 0.010s	sys 0.000s
I20260709 13:06:30.330010 19560 raft_consensus.cc:2468] T ef32ce6fdd0e40d382c79974f30295c6 P e61c3a8f61bb48f8a963c9480e53c168 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 17.
I20260709 13:06:30.330932 19523 leader_election.cc:304] T 833a2f0775ed407a94b8924ce50adb63 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e61c3a8f61bb48f8a963c9480e53c168; no voters: 127766fc592545a4997f7790f50f6076, e5256d91808b47c195bc9b4dbd7f2b87
W20260709 13:06:30.338315 20076 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.3:36891, user_credentials={real_user=slave}} blocked reactor thread for 102011us
I20260709 13:06:30.298020 24507 leader_election.cc:290] T 833a2f0775ed407a94b8924ce50adb63 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:06:30.300921 24567 raft_consensus.cc:2749] T 0e1085d23e8347fbbd5bce7542f4b1f4 P 127766fc592545a4997f7790f50f6076 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:06:30.352873 19449 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.4:43121, user_credentials={real_user=slave}} blocked reactor thread for 119950us
I20260709 13:06:30.222848 24633 raft_consensus.cc:515] T f93ee515a9c14139bf566522ed8232f3 P e61c3a8f61bb48f8a963c9480e53c168 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:30.334149 24611 raft_consensus.cc:493] T ab43d85f64114d4ebf618930e43d9ed0 P 127766fc592545a4997f7790f50f6076 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:06:30.369434 24485 consensus_meta.cc:287] T 2b74109013a140ada21feeef92d6f563 P 0473d2b2d01f4459b1e90fd12cc7840e: Time spent flushing consensus metadata: real 0.709s	user 0.004s	sys 0.008s
W20260709 13:06:30.373410 19450 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.3:36891, user_credentials={real_user=slave}} blocked reactor thread for 151905us
W20260709 13:06:30.377825 19452 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:30.324307 24517 raft_consensus.cc:493] T 96efeaaf1057492490e9a621f37e1a2d P e61c3a8f61bb48f8a963c9480e53c168 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 0473d2b2d01f4459b1e90fd12cc7840e)
I20260709 13:06:30.403941 19377 leader_election.cc:304] T e381f1d6b8184797ad142de49be225a8 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87; no voters: e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:06:30.407133 19481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f575b143b844aa096b50997dad3516a" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:06:30.400641 20103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "172b3dd13109415a955b71ac0e9d2234" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:06:30.408644 20103 raft_consensus.cc:2468] T 172b3dd13109415a955b71ac0e9d2234 P 127766fc592545a4997f7790f50f6076 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 12.
I20260709 13:06:30.421401 19449 leader_election.cc:304] T 172b3dd13109415a955b71ac0e9d2234 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, 127766fc592545a4997f7790f50f6076; no voters: 
I20260709 13:06:30.436004 19478 raft_consensus.cc:1217] T a08760e15aac4630a629431f56024dc8 P 0473d2b2d01f4459b1e90fd12cc7840e [term 17 LEADER]: Deduplicated request from leader. Original: 11.7->[14.8-16.9]   Dedup: 16.9->[]
I20260709 13:06:30.436738 19478 raft_consensus.cc:1240] T a08760e15aac4630a629431f56024dc8 P 0473d2b2d01f4459b1e90fd12cc7840e [term 17 LEADER]: Rejecting Update request from peer e61c3a8f61bb48f8a963c9480e53c168 for earlier term 16. Current term is 17. Ops: [14.8-16.9]
I20260709 13:06:30.400435 24517 raft_consensus.cc:3060] T 96efeaaf1057492490e9a621f37e1a2d P e61c3a8f61bb48f8a963c9480e53c168 [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:06:30.418887 24606 log.cc:927] Time spent T 3e1f505cb0f1427bbd698ac889d80821 P e5256d91808b47c195bc9b4dbd7f2b87: Append to log took a long time: real 0.056s	user 0.000s	sys 0.000s
W20260709 13:06:30.447072 19523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.4:43121, user_credentials={real_user=slave}} blocked reactor thread for 116436us
I20260709 13:06:30.412804 24558 raft_consensus.cc:493] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P 0473d2b2d01f4459b1e90fd12cc7840e [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:30.448920 19523 leader_election.cc:304] T 85c494af21f9457a85da47b9bc70c1fd P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 127766fc592545a4997f7790f50f6076, e61c3a8f61bb48f8a963c9480e53c168; no voters: e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:06:30.401129 24507 raft_consensus.cc:493] T f93ee515a9c14139bf566522ed8232f3 P e5256d91808b47c195bc9b4dbd7f2b87 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 0473d2b2d01f4459b1e90fd12cc7840e)
I20260709 13:06:30.401377 24372 raft_consensus.cc:493] T 70797e5783b5454ab0d0eea663e791e3 P e5256d91808b47c195bc9b4dbd7f2b87 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 127766fc592545a4997f7790f50f6076)
I20260709 13:06:30.455869 24545 raft_consensus.cc:493] T 4af19371ea874c09a0a2147040835cbb P e61c3a8f61bb48f8a963c9480e53c168 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 127766fc592545a4997f7790f50f6076)
I20260709 13:06:30.461414 24545 raft_consensus.cc:515] T 4af19371ea874c09a0a2147040835cbb P e61c3a8f61bb48f8a963c9480e53c168 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:30.463232 24599 consensus_queue.cc:1048] T 62c6c134d3d24a1ab144dd9ee6bc3f64 P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Connected to new peer: Peer: permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.126s
W20260709 13:06:30.465158 24646 log.cc:927] Time spent T 3e1f505cb0f1427bbd698ac889d80821 P 0473d2b2d01f4459b1e90fd12cc7840e: Append to log took a long time: real 0.254s	user 0.001s	sys 0.000s
I20260709 13:06:30.423413 24621 raft_consensus.cc:515] T edd7d470b5014c9489be7f41f64355c9 P e5256d91808b47c195bc9b4dbd7f2b87 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:30.466471 24652 raft_consensus.cc:493] T d1e5873a19244c5ebbcd38e126796ee7 P 0473d2b2d01f4459b1e90fd12cc7840e [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:30.467033 24652 raft_consensus.cc:515] T d1e5873a19244c5ebbcd38e126796ee7 P 0473d2b2d01f4459b1e90fd12cc7840e [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:30.457839 24558 raft_consensus.cc:515] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P 0473d2b2d01f4459b1e90fd12cc7840e [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
W20260709 13:06:30.469360 24644 log.cc:927] Time spent T 2725d2c4cb054f18b0fc8f735c15f6c2 P 0473d2b2d01f4459b1e90fd12cc7840e: Append to log took a long time: real 0.250s	user 0.000s	sys 0.001s
I20260709 13:06:30.471439 24621 leader_election.cc:290] T edd7d470b5014c9489be7f41f64355c9 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 16 election: Requested vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:06:30.471832 24666 raft_consensus.cc:2804] T e381f1d6b8184797ad142de49be225a8 P e5256d91808b47c195bc9b4dbd7f2b87 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:06:30.473986 24666 raft_consensus.cc:493] T e381f1d6b8184797ad142de49be225a8 P e5256d91808b47c195bc9b4dbd7f2b87 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:30.456103 24601 leader_election.cc:290] T d1e5873a19244c5ebbcd38e126796ee7 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 17 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
W20260709 13:06:30.494616 20075 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.1:40321, user_credentials={real_user=slave}} blocked reactor thread for 153650us
I20260709 13:06:30.382275 24611 raft_consensus.cc:515] T ab43d85f64114d4ebf618930e43d9ed0 P 127766fc592545a4997f7790f50f6076 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:30.474457 24666 raft_consensus.cc:3060] T e381f1d6b8184797ad142de49be225a8 P e5256d91808b47c195bc9b4dbd7f2b87 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:06:30.517803 19523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.4:43121, user_credentials={real_user=slave}} blocked reactor thread for 68956.4us
I20260709 13:06:30.521062 19523 leader_election.cc:304] T 70797e5783b5454ab0d0eea663e791e3 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e61c3a8f61bb48f8a963c9480e53c168; no voters: 127766fc592545a4997f7790f50f6076, e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:06:30.525945 24545 leader_election.cc:290] T 4af19371ea874c09a0a2147040835cbb P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:06:30.522022 24276 raft_consensus.cc:2804] T 172b3dd13109415a955b71ac0e9d2234 P 0473d2b2d01f4459b1e90fd12cc7840e [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:06:30.526629 24545 raft_consensus.cc:493] T ab43d85f64114d4ebf618930e43d9ed0 P e61c3a8f61bb48f8a963c9480e53c168 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:30.527271 24545 raft_consensus.cc:515] T ab43d85f64114d4ebf618930e43d9ed0 P e61c3a8f61bb48f8a963c9480e53c168 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } attrs { replace: true } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
W20260709 13:06:30.529208 24387 consensus_meta.cc:287] T ff75a1d4cb1f493db8f71ddc136ba9ab P 0473d2b2d01f4459b1e90fd12cc7840e: Time spent flushing consensus metadata: real 0.622s	user 0.009s	sys 0.000s
I20260709 13:06:30.529801 24387 raft_consensus.cc:2749] T ff75a1d4cb1f493db8f71ddc136ba9ab P 0473d2b2d01f4459b1e90fd12cc7840e [term 15 FOLLOWER]: Leader pre-election lost for term 14. Reason: Vote denied by peer e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321) with higher term. Message: Invalid argument: T ff75a1d4cb1f493db8f71ddc136ba9ab P e5256d91808b47c195bc9b4dbd7f2b87 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0473d2b2d01f4459b1e90fd12cc7840e for earlier term 14. Current term is 15.
I20260709 13:06:30.529970 24545 leader_election.cc:290] T ab43d85f64114d4ebf618930e43d9ed0 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:06:30.530563 24545 raft_consensus.cc:493] T 2a16f7501e2444fb86d4e2778e734e02 P e61c3a8f61bb48f8a963c9480e53c168 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 127766fc592545a4997f7790f50f6076)
W20260709 13:06:30.531728 24659 log.cc:927] Time spent T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P e5256d91808b47c195bc9b4dbd7f2b87: Append to log took a long time: real 0.149s	user 0.000s	sys 0.000s
I20260709 13:06:30.532537 19556 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40438 (request call id 2625) took 1050 ms. Trace:
I20260709 13:06:30.531335 24545 raft_consensus.cc:515] T 2a16f7501e2444fb86d4e2778e734e02 P e61c3a8f61bb48f8a963c9480e53c168 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:30.532902 19556 rpcz_store.cc:276] 0709 13:06:29.481662 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:29.481971 (+   309us) service_pool.cc:224] Handling call
0709 13:06:29.482231 (+   260us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:29.511676 (+ 29445us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:29.511723 (+    47us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:29.525179 (+ 13456us) log.cc:844] Serialized 26 byte log entry
0709 13:06:29.864993 (+339814us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:06:29.865052 (+    59us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:29.865146 (+    94us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:30.532336 (+667190us) raft_consensus.cc:1685] finished
0709 13:06:30.532354 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:30.532483 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":29171,"raft.run_cpu_time_us":115,"raft.run_wall_time_us":11819,"thread_start_us":239080,"threads_started":1,"wal-append.queue_time_us":924815}
I20260709 13:06:30.535655 24545 leader_election.cc:290] T 2a16f7501e2444fb86d4e2778e734e02 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:06:30.537868 19479 raft_consensus.cc:2468] T ff75a1d4cb1f493db8f71ddc136ba9ab P 0473d2b2d01f4459b1e90fd12cc7840e [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 15.
I20260709 13:06:30.539444 24545 raft_consensus.cc:493] T 179fd671030940b4b4a4e24bcc4aba0a P e61c3a8f61bb48f8a963c9480e53c168 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:30.540978 24545 raft_consensus.cc:515] T 179fd671030940b4b4a4e24bcc4aba0a P e61c3a8f61bb48f8a963c9480e53c168 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:30.547221 24633 leader_election.cc:290] T f93ee515a9c14139bf566522ed8232f3 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:06:30.547768 24633 raft_consensus.cc:493] T 22196caba61445d3bec98a0aab3c337d P e61c3a8f61bb48f8a963c9480e53c168 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader e5256d91808b47c195bc9b4dbd7f2b87)
I20260709 13:06:30.547905 24678 raft_consensus.cc:2749] T 833a2f0775ed407a94b8924ce50adb63 P e61c3a8f61bb48f8a963c9480e53c168 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:06:30.548354 24633 raft_consensus.cc:515] T 22196caba61445d3bec98a0aab3c337d P e61c3a8f61bb48f8a963c9480e53c168 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:30.548825 24678 raft_consensus.cc:2804] T 85c494af21f9457a85da47b9bc70c1fd P e61c3a8f61bb48f8a963c9480e53c168 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:06:30.549275 24678 raft_consensus.cc:493] T 85c494af21f9457a85da47b9bc70c1fd P e61c3a8f61bb48f8a963c9480e53c168 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 127766fc592545a4997f7790f50f6076)
I20260709 13:06:30.549727 24678 raft_consensus.cc:3060] T 85c494af21f9457a85da47b9bc70c1fd P e61c3a8f61bb48f8a963c9480e53c168 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:06:30.526717 24276 raft_consensus.cc:493] T 172b3dd13109415a955b71ac0e9d2234 P 0473d2b2d01f4459b1e90fd12cc7840e [term 11 FOLLOWER]: Starting leader election (detected failure of leader 127766fc592545a4997f7790f50f6076)
I20260709 13:06:30.519848 24601 raft_consensus.cc:493] T 309c3ca0ca4b4f3ba129752ea2cb293b P e61c3a8f61bb48f8a963c9480e53c168 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 127766fc592545a4997f7790f50f6076)
I20260709 13:06:30.510426 24507 raft_consensus.cc:515] T f93ee515a9c14139bf566522ed8232f3 P e5256d91808b47c195bc9b4dbd7f2b87 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:30.543100 24669 consensus_queue.cc:1048] T 48824d5acfbc485ebf8c2d944e7202de P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.040s
I20260709 13:06:30.543659 19523 leader_election.cc:400] T fa731b585f684a7fb2d106c50f143b83 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 11 pre-election: Vote denied by peer 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121) with higher term. Message: Invalid argument: T fa731b585f684a7fb2d106c50f143b83 P 127766fc592545a4997f7790f50f6076 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e61c3a8f61bb48f8a963c9480e53c168 for earlier term 11. Current term is 12.
I20260709 13:06:30.507325 24372 raft_consensus.cc:515] T 70797e5783b5454ab0d0eea663e791e3 P e5256d91808b47c195bc9b4dbd7f2b87 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:30.508700 20075 leader_election.cc:304] T 9962423cb4e54fcfa5de01daf68a86e7 P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 127766fc592545a4997f7790f50f6076, e5256d91808b47c195bc9b4dbd7f2b87; no voters: 
I20260709 13:06:30.571069 19523 leader_election.cc:403] T fa731b585f684a7fb2d106c50f143b83 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 11 pre-election: Cancelling election due to peer responding with higher term
W20260709 13:06:30.573489 20075 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.1:40321, user_credentials={real_user=slave}} blocked reactor thread for 65093.8us
I20260709 13:06:30.616542 19482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e5873a19244c5ebbcd38e126796ee7" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:06:30.617223 19482 raft_consensus.cc:3060] T d1e5873a19244c5ebbcd38e126796ee7 P 0473d2b2d01f4459b1e90fd12cc7840e [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:06:30.617223 19523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.4:43121, user_credentials={real_user=slave}} blocked reactor thread for 73720.4us
I20260709 13:06:30.618462 20075 leader_election.cc:304] T 85c494af21f9457a85da47b9bc70c1fd P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 127766fc592545a4997f7790f50f6076, e5256d91808b47c195bc9b4dbd7f2b87; no voters: 
I20260709 13:06:30.618949 19557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70797e5783b5454ab0d0eea663e791e3" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:06:30.619349 19484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab43d85f64114d4ebf618930e43d9ed0" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:06:30.620528 19560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa731b585f684a7fb2d106c50f143b83" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
W20260709 13:06:30.556559 24619 log.cc:927] Time spent T ed7fdbcb96d14d418db9ca90a792588a P 127766fc592545a4997f7790f50f6076: Append to log took a long time: real 1.052s	user 0.014s	sys 0.000s
I20260709 13:06:30.624788 24141 raft_consensus.cc:493] T ece3db938bc649d4a40a51522ed5259c P 127766fc592545a4997f7790f50f6076 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader e5256d91808b47c195bc9b4dbd7f2b87)
I20260709 13:06:30.625602 20103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "833a2f0775ed407a94b8924ce50adb63" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
W20260709 13:06:30.568904 24660 log.cc:927] Time spent T ff75a1d4cb1f493db8f71ddc136ba9ab P e5256d91808b47c195bc9b4dbd7f2b87: Append to log took a long time: real 0.220s	user 0.000s	sys 0.001s
I20260709 13:06:30.628007 19481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "179fd671030940b4b4a4e24bcc4aba0a" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 17 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:06:30.642441 19481 raft_consensus.cc:2468] T 179fd671030940b4b4a4e24bcc4aba0a P 0473d2b2d01f4459b1e90fd12cc7840e [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 16.
I20260709 13:06:30.629272 19484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22196caba61445d3bec98a0aab3c337d" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:06:30.643754 19484 raft_consensus.cc:2468] T 22196caba61445d3bec98a0aab3c337d P 0473d2b2d01f4459b1e90fd12cc7840e [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 12.
I20260709 13:06:30.629890 19558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85c494af21f9457a85da47b9bc70c1fd" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:06:30.630031 19555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96efeaaf1057492490e9a621f37e1a2d" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 16 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:06:30.635782 19404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f575b143b844aa096b50997dad3516a" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:06:30.636328 19409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4af19371ea874c09a0a2147040835cbb" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:06:30.646389 19405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab43d85f64114d4ebf618930e43d9ed0" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:06:30.647553 19408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f93ee515a9c14139bf566522ed8232f3" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 16 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:06:30.648131 19408 raft_consensus.cc:2468] T f93ee515a9c14139bf566522ed8232f3 P e5256d91808b47c195bc9b4dbd7f2b87 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 15.
I20260709 13:06:30.636428 19411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e5873a19244c5ebbcd38e126796ee7" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
I20260709 13:06:30.550537 24633 leader_election.cc:290] T 22196caba61445d3bec98a0aab3c337d P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:06:30.563258 24276 raft_consensus.cc:3060] T 172b3dd13109415a955b71ac0e9d2234 P 0473d2b2d01f4459b1e90fd12cc7840e [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:06:30.615782 24305 consensus_meta.cc:287] T 172b3dd13109415a955b71ac0e9d2234 P e5256d91808b47c195bc9b4dbd7f2b87: Time spent flushing consensus metadata: real 0.586s	user 0.009s	sys 0.004s
I20260709 13:06:30.639640 19478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f93ee515a9c14139bf566522ed8232f3" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 16 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:06:30.552798 24663 raft_consensus.cc:2749] T 70797e5783b5454ab0d0eea663e791e3 P e61c3a8f61bb48f8a963c9480e53c168 [term 14 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:06:30.649008 19411 raft_consensus.cc:3060] T d1e5873a19244c5ebbcd38e126796ee7 P e5256d91808b47c195bc9b4dbd7f2b87 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:06:30.655747 20109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab43d85f64114d4ebf618930e43d9ed0" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:06:30.656523 20109 raft_consensus.cc:2410] T ab43d85f64114d4ebf618930e43d9ed0 P 127766fc592545a4997f7790f50f6076 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e61c3a8f61bb48f8a963c9480e53c168 for term 16 because replica has last-logged OpId of term: 14 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 8.
I20260709 13:06:30.550573 24545 leader_election.cc:290] T 179fd671030940b4b4a4e24bcc4aba0a P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:06:30.672152 20075 leader_election.cc:304] T 172b3dd13109415a955b71ac0e9d2234 P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 127766fc592545a4997f7790f50f6076, e5256d91808b47c195bc9b4dbd7f2b87; no voters: 
I20260709 13:06:30.571877 24372 leader_election.cc:290] T 70797e5783b5454ab0d0eea663e791e3 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:06:30.681612 20109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a16f7501e2444fb86d4e2778e734e02" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:06:30.647018 19405 raft_consensus.cc:2468] T ab43d85f64114d4ebf618930e43d9ed0 P e5256d91808b47c195bc9b4dbd7f2b87 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 14.
I20260709 13:06:30.650760 19402 raft_consensus.cc:1275] T 2725d2c4cb054f18b0fc8f735c15f6c2 P e5256d91808b47c195bc9b4dbd7f2b87 [term 17 FOLLOWER]: Refusing update from remote peer e61c3a8f61bb48f8a963c9480e53c168: Log matching property violated. Preceding OpId in replica: term: 14 index: 7. Preceding OpId from leader: term: 17 index: 9. (index mismatch)
I20260709 13:06:30.651288 19409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "179fd671030940b4b4a4e24bcc4aba0a" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 17 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:06:30.556806 24599 raft_consensus.cc:493] T 28af091831594f9d8e96482078cc7625 P 0473d2b2d01f4459b1e90fd12cc7840e [term 15 FOLLOWER]: Starting pre-election (detected failure of leader e5256d91808b47c195bc9b4dbd7f2b87)
I20260709 13:06:30.616984 24567 raft_consensus.cc:2804] T 9962423cb4e54fcfa5de01daf68a86e7 P 127766fc592545a4997f7790f50f6076 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:06:30.557765 24661 raft_consensus.cc:493] T 2b74109013a140ada21feeef92d6f563 P e5256d91808b47c195bc9b4dbd7f2b87 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 0473d2b2d01f4459b1e90fd12cc7840e)
I20260709 13:06:30.658995 24565 raft_consensus.cc:2804] T 85c494af21f9457a85da47b9bc70c1fd P 127766fc592545a4997f7790f50f6076 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:06:30.659547 20106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4af19371ea874c09a0a2147040835cbb" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:06:30.660662 24666 raft_consensus.cc:515] T e381f1d6b8184797ad142de49be225a8 P e5256d91808b47c195bc9b4dbd7f2b87 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:30.661056 19481 raft_consensus.cc:1275] T 1dc5b3532fe54f74876d02beffa2c230 P 0473d2b2d01f4459b1e90fd12cc7840e [term 15 FOLLOWER]: Refusing update from remote peer e61c3a8f61bb48f8a963c9480e53c168: Log matching property violated. Preceding OpId in replica: term: 14 index: 7. Preceding OpId from leader: term: 15 index: 8. (index mismatch)
I20260709 13:06:30.661725 19482 raft_consensus.cc:2410] T d1e5873a19244c5ebbcd38e126796ee7 P 0473d2b2d01f4459b1e90fd12cc7840e [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate e61c3a8f61bb48f8a963c9480e53c168 for term 17 because replica has last-logged OpId of term: 15 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 8.
I20260709 13:06:30.662953 24305 raft_consensus.cc:515] T 172b3dd13109415a955b71ac0e9d2234 P e5256d91808b47c195bc9b4dbd7f2b87 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:30.665632 24652 leader_election.cc:290] T d1e5873a19244c5ebbcd38e126796ee7 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:06:30.666272 24665 raft_consensus.cc:3060] T fa731b585f684a7fb2d106c50f143b83 P e61c3a8f61bb48f8a963c9480e53c168 [term 10 FOLLOWER]: Advancing to term 12
I20260709 13:06:30.568029 24611 leader_election.cc:290] T ab43d85f64114d4ebf618930e43d9ed0 P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:06:30.666981 19406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a16f7501e2444fb86d4e2778e734e02" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:06:30.667542 19407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e381f1d6b8184797ad142de49be225a8" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:06:30.649992 24551 raft_consensus.cc:493] T 46c5bfeecc314717bffe987e6844b6d0 P e5256d91808b47c195bc9b4dbd7f2b87 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 0473d2b2d01f4459b1e90fd12cc7840e)
I20260709 13:06:30.672226 19404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22196caba61445d3bec98a0aab3c337d" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:06:30.566727 24507 leader_election.cc:290] T f93ee515a9c14139bf566522ed8232f3 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:06:30.670399 24558 leader_election.cc:290] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:06:30.553541 24517 raft_consensus.cc:515] T 96efeaaf1057492490e9a621f37e1a2d P e61c3a8f61bb48f8a963c9480e53c168 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:30.556974 24577 consensus_queue.cc:1048] T 62c6c134d3d24a1ab144dd9ee6bc3f64 P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.095s
I20260709 13:06:30.690403 19557 raft_consensus.cc:2468] T 70797e5783b5454ab0d0eea663e791e3 P e61c3a8f61bb48f8a963c9480e53c168 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 127766fc592545a4997f7790f50f6076 in term 14.
I20260709 13:06:30.691298 20110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70797e5783b5454ab0d0eea663e791e3" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:06:30.687053 19484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e381f1d6b8184797ad142de49be225a8" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:06:30.728010 19484 raft_consensus.cc:2468] T e381f1d6b8184797ad142de49be225a8 P 0473d2b2d01f4459b1e90fd12cc7840e [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 11.
I20260709 13:06:30.653370 24543 leader_election.cc:290] T e381f1d6b8184797ad142de49be225a8 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:06:30.564254 24601 raft_consensus.cc:515] T 309c3ca0ca4b4f3ba129752ea2cb293b P e61c3a8f61bb48f8a963c9480e53c168 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } attrs { replace: true } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:30.671123 24633 raft_consensus.cc:493] T ed7fdbcb96d14d418db9ca90a792588a P e61c3a8f61bb48f8a963c9480e53c168 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:06:30.651927 24466 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.598s	user 0.013s	sys 0.033s
I20260709 13:06:30.702455 19411 raft_consensus.cc:2468] T d1e5873a19244c5ebbcd38e126796ee7 P e5256d91808b47c195bc9b4dbd7f2b87 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 17.
I20260709 13:06:30.710093 19408 raft_consensus.cc:1275] T fa731b585f684a7fb2d106c50f143b83 P e5256d91808b47c195bc9b4dbd7f2b87 [term 12 FOLLOWER]: Refusing update from remote peer 127766fc592545a4997f7790f50f6076: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:06:30.686173 24545 raft_consensus.cc:493] T a08760e15aac4630a629431f56024dc8 P e61c3a8f61bb48f8a963c9480e53c168 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:30.713536 20111 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46436 (request call id 790) took 1805 ms. Trace:
I20260709 13:06:30.718621 24626 raft_consensus.cc:2804] T 172b3dd13109415a955b71ac0e9d2234 P 127766fc592545a4997f7790f50f6076 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:06:30.703140 24662 raft_consensus.cc:493] T 46c5bfeecc314717bffe987e6844b6d0 P e61c3a8f61bb48f8a963c9480e53c168 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 0473d2b2d01f4459b1e90fd12cc7840e)
I20260709 13:06:30.724016 19407 raft_consensus.cc:2368] T e381f1d6b8184797ad142de49be225a8 P e5256d91808b47c195bc9b4dbd7f2b87 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e61c3a8f61bb48f8a963c9480e53c168 for earlier term 11. Current term is 12.
I20260709 13:06:30.650583 24141 raft_consensus.cc:515] T ece3db938bc649d4a40a51522ed5259c P 127766fc592545a4997f7790f50f6076 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:30.704116 24567 raft_consensus.cc:697] T 9962423cb4e54fcfa5de01daf68a86e7 P 127766fc592545a4997f7790f50f6076 [term 13 LEADER]: Becoming Leader. State: Replica: 127766fc592545a4997f7790f50f6076, State: Running, Role: LEADER
W20260709 13:06:30.714102 19450 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.3:36891, user_credentials={real_user=slave}} blocked reactor thread for 272719us
I20260709 13:06:30.800006 24567 consensus_queue.cc:237] T 9962423cb4e54fcfa5de01daf68a86e7 P 127766fc592545a4997f7790f50f6076 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:30.800494 19450 leader_election.cc:304] T bc225c93219c45538b53a1bd3d387e4d P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168; no voters: e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:06:30.714321 24565 raft_consensus.cc:697] T 85c494af21f9457a85da47b9bc70c1fd P 127766fc592545a4997f7790f50f6076 [term 14 LEADER]: Becoming Leader. State: Replica: 127766fc592545a4997f7790f50f6076, State: Running, Role: LEADER
I20260709 13:06:30.735903 19403 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52342 (request call id 2804) took 1044 ms. Trace:
W20260709 13:06:30.735927 19377 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.2:46257, user_credentials={real_user=slave}} blocked reactor thread for 330592us
I20260709 13:06:30.732975 20111 rpcz_store.cc:276] 0709 13:06:28.908236 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:28.908348 (+   112us) service_pool.cc:224] Handling call
0709 13:06:28.908627 (+   279us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:29.121781 (+213154us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:29.121826 (+    45us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:29.135223 (+ 13397us) log.cc:844] Serialized 26 byte log entry
0709 13:06:29.375957 (+240734us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:06:29.376005 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:29.376087 (+    82us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:30.555848 (+1179761us) spinlock_profiling.cc:243] Waited 9.21 ms on lock 0x7b4400022b4c. stack: 00007f4a79de9343 00007f4a79de9240 00007f4a797781d4 00007f4a834b6304 00007f4a834b6299 00007f4a79ca3db1 00007f4a79d41c85 00007f4a79d426a2 00007f4a7cab41db 00007f4a7caafaaf 00007f4a7caa386e 00007f4a7caa2bb6 00007f4a7caa27d8 00007f4a7caac221 00007f4a7caac1d9 00007f4a7caac169
0709 13:06:30.706893 (+151045us) raft_consensus.cc:1685] finished
0709 13:06:30.706924 (+    31us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:30.713454 (+  6530us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":44912,"raft.queue_time_us":114717,"raft.run_cpu_time_us":140,"raft.run_wall_time_us":7592,"spinlock_wait_cycles":21184896,"thread_start_us":378621,"threads_started":2,"wal-append.queue_time_us":358495}
I20260709 13:06:30.744047 24517 leader_election.cc:290] T 96efeaaf1057492490e9a621f37e1a2d P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 16 election: Requested vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:06:30.744477 24682 raft_consensus.cc:493] T 2a16f7501e2444fb86d4e2778e734e02 P e5256d91808b47c195bc9b4dbd7f2b87 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 127766fc592545a4997f7790f50f6076)
I20260709 13:06:30.744264 24276 raft_consensus.cc:515] T 172b3dd13109415a955b71ac0e9d2234 P 0473d2b2d01f4459b1e90fd12cc7840e [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:30.737782 24626 raft_consensus.cc:493] T 172b3dd13109415a955b71ac0e9d2234 P 127766fc592545a4997f7790f50f6076 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:30.726147 24551 raft_consensus.cc:515] T 46c5bfeecc314717bffe987e6844b6d0 P e5256d91808b47c195bc9b4dbd7f2b87 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:30.746454 19484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96efeaaf1057492490e9a621f37e1a2d" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:06:30.807017 19450 leader_election.cc:304] T 6c5eebf646ad445a9d1b1adc319d7b16 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168; no voters: 127766fc592545a4997f7790f50f6076
I20260709 13:06:30.749897 24666 leader_election.cc:290] T e381f1d6b8184797ad142de49be225a8 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 12 election: Requested vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:06:30.756119 20109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36f6ba92b9ba46babe4ebd6c02e5fbd9" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 17 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:06:30.756322 19526 leader_election.cc:304] T ab43d85f64114d4ebf618930e43d9ed0 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: e61c3a8f61bb48f8a963c9480e53c168; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, 127766fc592545a4997f7790f50f6076
W20260709 13:06:30.757623 20076 leader_election.cc:336] T 7be9efa6559648dbb5a0f7684c4542d1 P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891): Timed out: RequestConsensusVote RPC to 127.17.223.3:36891 timed out after 1.680s (SENT)
I20260709 13:06:30.817966 20076 leader_election.cc:304] T 7be9efa6559648dbb5a0f7684c4542d1 P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 127766fc592545a4997f7790f50f6076, e5256d91808b47c195bc9b4dbd7f2b87; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:06:30.760540 19554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70797e5783b5454ab0d0eea663e791e3" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:06:30.760895 20105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96efeaaf1057492490e9a621f37e1a2d" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076"
I20260709 13:06:30.761178 19555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa731b585f684a7fb2d106c50f143b83" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:06:30.761806 19553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab43d85f64114d4ebf618930e43d9ed0" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
W20260709 13:06:30.732682 24466 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.679s	user 0.013s	sys 0.034s
I20260709 13:06:30.735430 24633 raft_consensus.cc:515] T ed7fdbcb96d14d418db9ca90a792588a P e61c3a8f61bb48f8a963c9480e53c168 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:30.766564 24662 raft_consensus.cc:515] T 46c5bfeecc314717bffe987e6844b6d0 P e61c3a8f61bb48f8a963c9480e53c168 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:30.735992 24545 raft_consensus.cc:515] T a08760e15aac4630a629431f56024dc8 P e61c3a8f61bb48f8a963c9480e53c168 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:30.773092 24680 raft_consensus.cc:493] T 40e1e16737a842ee936002830f36882e P e61c3a8f61bb48f8a963c9480e53c168 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader e5256d91808b47c195bc9b4dbd7f2b87)
I20260709 13:06:30.776551 24601 leader_election.cc:290] T 309c3ca0ca4b4f3ba129752ea2cb293b P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:06:30.777455 19411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "309c3ca0ca4b4f3ba129752ea2cb293b" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:06:30.777585 20112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "309c3ca0ca4b4f3ba129752ea2cb293b" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:06:30.792789 24550 leader_election.cc:290] T e381f1d6b8184797ad142de49be225a8 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:06:30.796332 24413 leader_election.cc:290] T 65d8cb8d6ec64f459d5a47cefab10acf P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:06:30.802307 19403 rpcz_store.cc:276] 0709 13:06:29.691299 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:29.691408 (+   109us) service_pool.cc:224] Handling call
0709 13:06:29.691755 (+   347us) raft_consensus.cc:1471] Updating replica for 3 ops
0709 13:06:30.099748 (+407993us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:30.099779 (+    31us) raft_consensus.cc:1539] Triggering prepare for 3 ops
0709 13:06:30.116778 (+ 16999us) log.cc:844] Serialized 78 byte log entry
0709 13:06:30.416056 (+299278us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:06:30.732003 (+315947us) log.cc:844] Serialized 14 byte log entry
0709 13:06:30.735273 (+  3270us) log.cc:844] Serialized 14 byte log entry
0709 13:06:30.735491 (+   218us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:30.735572 (+    81us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:30.735630 (+    58us) raft_consensus.cc:1685] finished
0709 13:06:30.735649 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:30.735830 (+   181us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":79440,"prepare.queue_time_us":117554,"prepare.run_cpu_time_us":25,"prepare.run_wall_time_us":26,"raft.queue_time_us":154822,"raft.run_cpu_time_us":105,"raft.run_wall_time_us":14666,"spinlock_wait_cycles":125529856,"thread_start_us":804812,"threads_started":3,"wal-append.queue_time_us":405383}
I20260709 13:06:30.815699 24626 raft_consensus.cc:3060] T 172b3dd13109415a955b71ac0e9d2234 P 127766fc592545a4997f7790f50f6076 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:06:30.693264 24599 raft_consensus.cc:515] T 28af091831594f9d8e96482078cc7625 P 0473d2b2d01f4459b1e90fd12cc7840e [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:30.820055 19553 raft_consensus.cc:2468] T ab43d85f64114d4ebf618930e43d9ed0 P e61c3a8f61bb48f8a963c9480e53c168 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 127766fc592545a4997f7790f50f6076 in term 15.
I20260709 13:06:30.850414 19553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e5873a19244c5ebbcd38e126796ee7" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:06:30.851398 19553 raft_consensus.cc:2393] T d1e5873a19244c5ebbcd38e126796ee7 P e61c3a8f61bb48f8a963c9480e53c168 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0473d2b2d01f4459b1e90fd12cc7840e in current term 17: Already voted for candidate e61c3a8f61bb48f8a963c9480e53c168 in this term.
I20260709 13:06:30.705036 24661 raft_consensus.cc:515] T 2b74109013a140ada21feeef92d6f563 P e5256d91808b47c195bc9b4dbd7f2b87 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
W20260709 13:06:30.824453 19526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.2:46257, user_credentials={real_user=slave}} blocked reactor thread for 68215.4us
I20260709 13:06:30.802886 19377 leader_election.cc:304] T ef32ce6fdd0e40d382c79974f30295c6 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87; no voters: 
I20260709 13:06:30.858486 19526 leader_election.cc:304] T 179fd671030940b4b4a4e24bcc4aba0a P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:06:30.844316 19554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "217b5fae677b4971b3bbd2f357a1f7ff" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:06:30.815229 24663 raft_consensus.cc:493] T df751f992649444090e27965eb1af85d P e61c3a8f61bb48f8a963c9480e53c168 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:30.859311 19554 raft_consensus.cc:2468] T 217b5fae677b4971b3bbd2f357a1f7ff P e61c3a8f61bb48f8a963c9480e53c168 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 11.
W20260709 13:06:30.858613 19377 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.2:46257, user_credentials={real_user=slave}} blocked reactor thread for 55793.1us
I20260709 13:06:30.863688 19377 leader_election.cc:304] T df751f992649444090e27965eb1af85d P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:06:30.833638 24530 raft_consensus.cc:2804] T 6c5eebf646ad445a9d1b1adc319d7b16 P 0473d2b2d01f4459b1e90fd12cc7840e [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:06:30.834275 24517 raft_consensus.cc:493] T 62c6c134d3d24a1ab144dd9ee6bc3f64 P e61c3a8f61bb48f8a963c9480e53c168 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:30.857008 24680 raft_consensus.cc:515] T 40e1e16737a842ee936002830f36882e P e61c3a8f61bb48f8a963c9480e53c168 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:30.895639 24517 raft_consensus.cc:515] T 62c6c134d3d24a1ab144dd9ee6bc3f64 P e61c3a8f61bb48f8a963c9480e53c168 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
W20260709 13:06:30.918746 20076 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.3:36891, user_credentials={real_user=slave}} blocked reactor thread for 161141us
I20260709 13:06:30.861495 24666 raft_consensus.cc:2804] T ef32ce6fdd0e40d382c79974f30295c6 P e5256d91808b47c195bc9b4dbd7f2b87 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:06:30.835250 24397 consensus_queue.cc:1048] T a08760e15aac4630a629431f56024dc8 P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.044s
I20260709 13:06:30.858317 24601 raft_consensus.cc:493] T 7be9efa6559648dbb5a0f7684c4542d1 P e61c3a8f61bb48f8a963c9480e53c168 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 0473d2b2d01f4459b1e90fd12cc7840e)
I20260709 13:06:30.920483 19403 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ff9b0eddd810459b82d91c60777c10eb"
dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
mode: GRACEFUL
new_leader_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
 from {username='slave'} at 127.0.0.1:37312
I20260709 13:06:30.934635 19403 raft_consensus.cc:606] T ff9b0eddd810459b82d91c60777c10eb P e5256d91808b47c195bc9b4dbd7f2b87 [term 15 LEADER]: Received request to transfer leadership to TS 0473d2b2d01f4459b1e90fd12cc7840e
I20260709 13:06:30.858631 24611 raft_consensus.cc:2749] T 7be9efa6559648dbb5a0f7684c4542d1 P 127766fc592545a4997f7790f50f6076 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:06:30.815577 24678 raft_consensus.cc:515] T 85c494af21f9457a85da47b9bc70c1fd P e61c3a8f61bb48f8a963c9480e53c168 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:30.928285 20076 leader_election.cc:304] T 0afb57ae58a24a01850491d69f0213dd P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 127766fc592545a4997f7790f50f6076; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:06:30.930282 24681 raft_consensus.cc:493] T 1dc5b3532fe54f74876d02beffa2c230 P 0473d2b2d01f4459b1e90fd12cc7840e [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:30.931102 24545 leader_election.cc:290] T a08760e15aac4630a629431f56024dc8 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:06:30.931874 19411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a08760e15aac4630a629431f56024dc8" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:06:30.878572 24550 raft_consensus.cc:2749] T df751f992649444090e27965eb1af85d P e5256d91808b47c195bc9b4dbd7f2b87 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:06:30.937306 24681 raft_consensus.cc:515] T 1dc5b3532fe54f74876d02beffa2c230 P 0473d2b2d01f4459b1e90fd12cc7840e [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:30.942903 20112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "172b3dd13109415a955b71ac0e9d2234" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076"
I20260709 13:06:30.946699 19403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46c5bfeecc314717bffe987e6844b6d0" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 20 candidate_status { last_received { term: 19 index: 9 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:06:30.947472 19403 raft_consensus.cc:2468] T 46c5bfeecc314717bffe987e6844b6d0 P e5256d91808b47c195bc9b4dbd7f2b87 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 19.
I20260709 13:06:30.821764 24682 raft_consensus.cc:515] T 2a16f7501e2444fb86d4e2778e734e02 P e5256d91808b47c195bc9b4dbd7f2b87 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:30.952152 19558 raft_consensus.cc:3060] T 85c494af21f9457a85da47b9bc70c1fd P e61c3a8f61bb48f8a963c9480e53c168 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:06:30.937897 24617 raft_consensus.cc:2804] T bc225c93219c45538b53a1bd3d387e4d P 0473d2b2d01f4459b1e90fd12cc7840e [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:06:30.958096 19558 raft_consensus.cc:2468] T 85c494af21f9457a85da47b9bc70c1fd P e61c3a8f61bb48f8a963c9480e53c168 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 127766fc592545a4997f7790f50f6076 in term 14.
I20260709 13:06:30.952072 18300 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 13:06:30.935853 24276 leader_election.cc:290] T 172b3dd13109415a955b71ac0e9d2234 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 12 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:06:30.937780 24530 raft_consensus.cc:697] T 6c5eebf646ad445a9d1b1adc319d7b16 P 0473d2b2d01f4459b1e90fd12cc7840e [term 14 LEADER]: Becoming Leader. State: Replica: 0473d2b2d01f4459b1e90fd12cc7840e, State: Running, Role: LEADER
I20260709 13:06:30.963907 19403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40e1e16737a842ee936002830f36882e" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:06:30.941879 24665 raft_consensus.cc:2749] T fa731b585f684a7fb2d106c50f143b83 P e61c3a8f61bb48f8a963c9480e53c168 [term 12 FOLLOWER]: Leader pre-election lost for term 11. Reason: Vote denied by peer 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121) with higher term. Message: Invalid argument: T fa731b585f684a7fb2d106c50f143b83 P 127766fc592545a4997f7790f50f6076 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e61c3a8f61bb48f8a963c9480e53c168 for earlier term 11. Current term is 12.
I20260709 13:06:30.939373 24666 raft_consensus.cc:697] T ef32ce6fdd0e40d382c79974f30295c6 P e5256d91808b47c195bc9b4dbd7f2b87 [term 17 LEADER]: Becoming Leader. State: Replica: e5256d91808b47c195bc9b4dbd7f2b87, State: Running, Role: LEADER
I20260709 13:06:30.965706 19406 raft_consensus.cc:2468] T 2a16f7501e2444fb86d4e2778e734e02 P e5256d91808b47c195bc9b4dbd7f2b87 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 13.
I20260709 13:06:30.961791 18300 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:06:30.948804 24680 leader_election.cc:290] T 40e1e16737a842ee936002830f36882e P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:06:30.951604 24413 raft_consensus.cc:2749] T 0afb57ae58a24a01850491d69f0213dd P 127766fc592545a4997f7790f50f6076 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:06:30.864356 24663 raft_consensus.cc:515] T df751f992649444090e27965eb1af85d P e61c3a8f61bb48f8a963c9480e53c168 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
W20260709 13:06:30.993414 19525 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.766s	user 0.010s	sys 0.047s
W20260709 13:06:30.993866 19525 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.797s	user 0.010s	sys 0.047s
I20260709 13:06:30.985620 24686 raft_consensus.cc:2804] T 179fd671030940b4b4a4e24bcc4aba0a P e61c3a8f61bb48f8a963c9480e53c168 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:06:30.994856 24678 leader_election.cc:290] T 85c494af21f9457a85da47b9bc70c1fd P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 13 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:06:30.994951 24686 raft_consensus.cc:493] T 179fd671030940b4b4a4e24bcc4aba0a P e61c3a8f61bb48f8a963c9480e53c168 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:30.995468 24686 raft_consensus.cc:3060] T 179fd671030940b4b4a4e24bcc4aba0a P e61c3a8f61bb48f8a963c9480e53c168 [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:06:31.012255 20075 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.1:40321, user_credentials={real_user=slave}} blocked reactor thread for 297258us
I20260709 13:06:30.893445 24565 consensus_queue.cc:237] T 85c494af21f9457a85da47b9bc70c1fd P 127766fc592545a4997f7790f50f6076 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:30.977447 24141 leader_election.cc:290] T ece3db938bc649d4a40a51522ed5259c P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:06:30.947196 24601 raft_consensus.cc:515] T 7be9efa6559648dbb5a0f7684c4542d1 P e61c3a8f61bb48f8a963c9480e53c168 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } attrs { replace: true } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:30.981560 24617 raft_consensus.cc:697] T bc225c93219c45538b53a1bd3d387e4d P 0473d2b2d01f4459b1e90fd12cc7840e [term 13 LEADER]: Becoming Leader. State: Replica: 0473d2b2d01f4459b1e90fd12cc7840e, State: Running, Role: LEADER
I20260709 13:06:31.020243 19403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85c494af21f9457a85da47b9bc70c1fd" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
I20260709 13:06:31.030920 19403 raft_consensus.cc:2368] T 85c494af21f9457a85da47b9bc70c1fd P e5256d91808b47c195bc9b4dbd7f2b87 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate e61c3a8f61bb48f8a963c9480e53c168 for earlier term 13. Current term is 14.
I20260709 13:06:30.980692 24662 leader_election.cc:290] T 46c5bfeecc314717bffe987e6844b6d0 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:06:31.022558 19560 raft_consensus.cc:2468] T fa731b585f684a7fb2d106c50f143b83 P e61c3a8f61bb48f8a963c9480e53c168 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 127766fc592545a4997f7790f50f6076 in term 12.
I20260709 13:06:30.995481 24678 raft_consensus.cc:493] T 4509b76741dc428e9201c70c1658da13 P e61c3a8f61bb48f8a963c9480e53c168 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:06:31.036149 24677 log.cc:927] Time spent T b08304a0a02b42d7840c4e8ee9a6bd1a P 0473d2b2d01f4459b1e90fd12cc7840e: Append to log took a long time: real 0.098s	user 0.000s	sys 0.000s
I20260709 13:06:31.036870 24678 raft_consensus.cc:515] T 4509b76741dc428e9201c70c1658da13 P e61c3a8f61bb48f8a963c9480e53c168 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:31.038975 24666 consensus_queue.cc:237] T ef32ce6fdd0e40d382c79974f30295c6 P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:31.041411 24530 consensus_queue.cc:237] T 6c5eebf646ad445a9d1b1adc319d7b16 P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:31.043098 24551 leader_election.cc:290] T 46c5bfeecc314717bffe987e6844b6d0 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:06:31.042263 24626 raft_consensus.cc:515] T 172b3dd13109415a955b71ac0e9d2234 P 127766fc592545a4997f7790f50f6076 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:31.051967 24682 leader_election.cc:290] T 2a16f7501e2444fb86d4e2778e734e02 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:06:31.069654 20112 raft_consensus.cc:2368] T 172b3dd13109415a955b71ac0e9d2234 P 127766fc592545a4997f7790f50f6076 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 0473d2b2d01f4459b1e90fd12cc7840e for earlier term 12. Current term is 13.
I20260709 13:06:31.084676 19403 raft_consensus.cc:1275] T 1dc5b3532fe54f74876d02beffa2c230 P e5256d91808b47c195bc9b4dbd7f2b87 [term 15 FOLLOWER]: Refusing update from remote peer e61c3a8f61bb48f8a963c9480e53c168: Log matching property violated. Preceding OpId in replica: term: 12 index: 6. Preceding OpId from leader: term: 15 index: 8. (index mismatch)
I20260709 13:06:31.053248 24626 leader_election.cc:290] T 172b3dd13109415a955b71ac0e9d2234 P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 13 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:06:31.056967 24517 leader_election.cc:290] T 62c6c134d3d24a1ab144dd9ee6bc3f64 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:06:31.178627 24696 raft_consensus.cc:493] T 21e14947d70440f19044d8f75c31e1f9 P e61c3a8f61bb48f8a963c9480e53c168 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader e5256d91808b47c195bc9b4dbd7f2b87)
I20260709 13:06:31.179271 24696 raft_consensus.cc:515] T 21e14947d70440f19044d8f75c31e1f9 P e61c3a8f61bb48f8a963c9480e53c168 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:31.182329 24696 leader_election.cc:290] T 21e14947d70440f19044d8f75c31e1f9 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:06:31.074378 24633 leader_election.cc:290] T ed7fdbcb96d14d418db9ca90a792588a P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:06:31.169886 24654 raft_consensus.cc:493] T 5ec1c4ce15e04c7e8c283a62179f2a64 P 0473d2b2d01f4459b1e90fd12cc7840e [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 127766fc592545a4997f7790f50f6076)
I20260709 13:06:31.169014 24612 leader_election.cc:290] T 172b3dd13109415a955b71ac0e9d2234 P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:06:31.173805 24554 raft_consensus.cc:493] T 40e1e16737a842ee936002830f36882e P 0473d2b2d01f4459b1e90fd12cc7840e [term 15 FOLLOWER]: Starting pre-election (detected failure of leader e5256d91808b47c195bc9b4dbd7f2b87)
I20260709 13:06:31.195324 24577 raft_consensus.cc:493] T 1efebf73c86e432baa55533136b6e12c P 0473d2b2d01f4459b1e90fd12cc7840e [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 127766fc592545a4997f7790f50f6076)
I20260709 13:06:31.208235 24397 raft_consensus.cc:493] T 2e36a9d6e29c4a7c860cf267efbd4c74 P 0473d2b2d01f4459b1e90fd12cc7840e [term 11 FOLLOWER]: Starting pre-election (detected failure of leader e5256d91808b47c195bc9b4dbd7f2b87)
I20260709 13:06:31.038550 24617 consensus_queue.cc:237] T bc225c93219c45538b53a1bd3d387e4d P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:31.222458 24661 leader_election.cc:290] T 2b74109013a140ada21feeef92d6f563 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
W20260709 13:06:31.240700 19526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.2:46257, user_credentials={real_user=slave}} blocked reactor thread for 382251us
I20260709 13:06:31.243151 19526 leader_election.cc:304] T 22196caba61445d3bec98a0aab3c337d P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:06:31.214056 24554 raft_consensus.cc:515] T 40e1e16737a842ee936002830f36882e P 0473d2b2d01f4459b1e90fd12cc7840e [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:31.213776 24654 raft_consensus.cc:515] T 5ec1c4ce15e04c7e8c283a62179f2a64 P 0473d2b2d01f4459b1e90fd12cc7840e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:31.224027 24577 raft_consensus.cc:515] T 1efebf73c86e432baa55533136b6e12c P 0473d2b2d01f4459b1e90fd12cc7840e [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:31.259740 19558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab43d85f64114d4ebf618930e43d9ed0" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:06:31.262164 19375 leader_election.cc:304] T ab43d85f64114d4ebf618930e43d9ed0 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87; no voters: 127766fc592545a4997f7790f50f6076, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:06:31.267716 19558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "833a2f0775ed407a94b8924ce50adb63" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:06:31.237195 24397 raft_consensus.cc:515] T 2e36a9d6e29c4a7c860cf267efbd4c74 P 0473d2b2d01f4459b1e90fd12cc7840e [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:31.281925 19375 leader_election.cc:304] T 833a2f0775ed407a94b8924ce50adb63 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87; no voters: 127766fc592545a4997f7790f50f6076, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:06:31.255349 24633 raft_consensus.cc:2804] T 22196caba61445d3bec98a0aab3c337d P e61c3a8f61bb48f8a963c9480e53c168 [term 12 FOLLOWER]: Leader pre-election won for term 13
W20260709 13:06:31.286782 24697 log.cc:927] Time spent T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P 127766fc592545a4997f7790f50f6076: Append to log took a long time: real 0.051s	user 0.001s	sys 0.000s
I20260709 13:06:31.258008 24558 raft_consensus.cc:493] T 21e14947d70440f19044d8f75c31e1f9 P 0473d2b2d01f4459b1e90fd12cc7840e [term 14 FOLLOWER]: Starting pre-election (detected failure of leader e5256d91808b47c195bc9b4dbd7f2b87)
I20260709 13:06:31.292694 19526 leader_election.cc:304] T e381f1d6b8184797ad142de49be225a8 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:06:31.272070 24661 raft_consensus.cc:3060] T ab43d85f64114d4ebf618930e43d9ed0 P e5256d91808b47c195bc9b4dbd7f2b87 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:06:31.269820 24553 raft_consensus.cc:493] T 775c229504194560ba9589bc2199b089 P 0473d2b2d01f4459b1e90fd12cc7840e [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 127766fc592545a4997f7790f50f6076)
I20260709 13:06:31.269651 24595 raft_consensus.cc:493] T 3e1f505cb0f1427bbd698ac889d80821 P e5256d91808b47c195bc9b4dbd7f2b87 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 0473d2b2d01f4459b1e90fd12cc7840e)
I20260709 13:06:31.273130 24479 raft_consensus.cc:493] T 1f85fc4b527a48848e5faa083b604e36 P 0473d2b2d01f4459b1e90fd12cc7840e [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 127766fc592545a4997f7790f50f6076)
I20260709 13:06:31.284174 24682 raft_consensus.cc:2749] T 833a2f0775ed407a94b8924ce50adb63 P e5256d91808b47c195bc9b4dbd7f2b87 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:06:31.266350 24517 consensus_queue.cc:1048] T 1dc5b3532fe54f74876d02beffa2c230 P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.028s
I20260709 13:06:31.288486 24633 raft_consensus.cc:493] T 22196caba61445d3bec98a0aab3c337d P e61c3a8f61bb48f8a963c9480e53c168 [term 12 FOLLOWER]: Starting leader election (detected failure of leader e5256d91808b47c195bc9b4dbd7f2b87)
W20260709 13:06:31.299516 19377 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.2:46257, user_credentials={real_user=slave}} blocked reactor thread for 232615us
I20260709 13:06:31.364694 19485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a08760e15aac4630a629431f56024dc8" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:06:31.364883 19483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "309c3ca0ca4b4f3ba129752ea2cb293b" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:06:31.365001 19482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40e1e16737a842ee936002830f36882e" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:06:31.365687 19482 raft_consensus.cc:2468] T 40e1e16737a842ee936002830f36882e P 0473d2b2d01f4459b1e90fd12cc7840e [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 15.
I20260709 13:06:31.366747 19481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62c6c134d3d24a1ab144dd9ee6bc3f64" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:06:31.365427 19483 raft_consensus.cc:2468] T 309c3ca0ca4b4f3ba129752ea2cb293b P 0473d2b2d01f4459b1e90fd12cc7840e [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 9.
I20260709 13:06:31.433164 19483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed7fdbcb96d14d418db9ca90a792588a" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:06:31.438953 19483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21e14947d70440f19044d8f75c31e1f9" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:06:31.299829 24517 consensus_queue.cc:1243] T 1dc5b3532fe54f74876d02beffa2c230 P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Peer 0473d2b2d01f4459b1e90fd12cc7840e log is divergent from this leader: its last log entry 14.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 13:06:31.298941 24696 raft_consensus.cc:2804] T e381f1d6b8184797ad142de49be225a8 P e61c3a8f61bb48f8a963c9480e53c168 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:06:31.444542 19481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7be9efa6559648dbb5a0f7684c4542d1" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:06:31.297600 24479 raft_consensus.cc:515] T 1f85fc4b527a48848e5faa083b604e36 P 0473d2b2d01f4459b1e90fd12cc7840e [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:31.447163 19478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46c5bfeecc314717bffe987e6844b6d0" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 20 candidate_status { last_received { term: 19 index: 9 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:06:31.300974 24633 raft_consensus.cc:3060] T 22196caba61445d3bec98a0aab3c337d P e61c3a8f61bb48f8a963c9480e53c168 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:06:31.299484 24553 raft_consensus.cc:515] T 775c229504194560ba9589bc2199b089 P 0473d2b2d01f4459b1e90fd12cc7840e [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:31.295113 24558 raft_consensus.cc:515] T 21e14947d70440f19044d8f75c31e1f9 P 0473d2b2d01f4459b1e90fd12cc7840e [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:31.297710 24595 raft_consensus.cc:515] T 3e1f505cb0f1427bbd698ac889d80821 P e5256d91808b47c195bc9b4dbd7f2b87 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:31.431099 24362 raft_consensus.cc:493] T 86a6797bdfe94fa496c050ceae4bd0d9 P e5256d91808b47c195bc9b4dbd7f2b87 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 0473d2b2d01f4459b1e90fd12cc7840e)
I20260709 13:06:31.431361 24550 raft_consensus.cc:493] T b9f0d59553ad444883fcf5b5909f9798 P e5256d91808b47c195bc9b4dbd7f2b87 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 0473d2b2d01f4459b1e90fd12cc7840e)
I20260709 13:06:31.438330 24411 raft_consensus.cc:493] T fa8650e71aa14778b3d73721fc50d9fc P e5256d91808b47c195bc9b4dbd7f2b87 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 0473d2b2d01f4459b1e90fd12cc7840e)
I20260709 13:06:31.438225 24671 raft_consensus.cc:493] T ff9b0eddd810459b82d91c60777c10eb P 0473d2b2d01f4459b1e90fd12cc7840e [term 15 FOLLOWER]: Starting pre-election (detected failure of leader e5256d91808b47c195bc9b4dbd7f2b87)
I20260709 13:06:31.453496 24543 raft_consensus.cc:493] T 2e36a9d6e29c4a7c860cf267efbd4c74 P e61c3a8f61bb48f8a963c9480e53c168 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader e5256d91808b47c195bc9b4dbd7f2b87)
I20260709 13:06:31.453019 24696 raft_consensus.cc:493] T e381f1d6b8184797ad142de49be225a8 P e61c3a8f61bb48f8a963c9480e53c168 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 0473d2b2d01f4459b1e90fd12cc7840e)
I20260709 13:06:31.481513 19483 raft_consensus.cc:2468] T 21e14947d70440f19044d8f75c31e1f9 P 0473d2b2d01f4459b1e90fd12cc7840e [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 14.
W20260709 13:06:31.471875 24689 log.cc:927] Time spent T 00000000000000000000000000000000 P 97750b77d35444acb7791ebf26cc2685: Append to log took a long time: real 0.453s	user 0.001s	sys 0.003s
I20260709 13:06:31.456535 24700 raft_consensus.cc:493] T 0cdf56e38bbc453d9438d359e5a69955 P e61c3a8f61bb48f8a963c9480e53c168 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 0473d2b2d01f4459b1e90fd12cc7840e)
I20260709 13:06:31.464986 24601 leader_election.cc:290] T 7be9efa6559648dbb5a0f7684c4542d1 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:06:31.464287 24665 raft_consensus.cc:493] T b9f0d59553ad444883fcf5b5909f9798 P e61c3a8f61bb48f8a963c9480e53c168 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 0473d2b2d01f4459b1e90fd12cc7840e)
I20260709 13:06:31.471325 24680 raft_consensus.cc:493] T 86a6797bdfe94fa496c050ceae4bd0d9 P e61c3a8f61bb48f8a963c9480e53c168 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 0473d2b2d01f4459b1e90fd12cc7840e)
I20260709 13:06:31.464564 24699 raft_consensus.cc:493] T fa8650e71aa14778b3d73721fc50d9fc P e61c3a8f61bb48f8a963c9480e53c168 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 0473d2b2d01f4459b1e90fd12cc7840e)
I20260709 13:06:31.486091 24671 raft_consensus.cc:515] T ff9b0eddd810459b82d91c60777c10eb P 0473d2b2d01f4459b1e90fd12cc7840e [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:31.487673 24662 raft_consensus.cc:493] T 28af091831594f9d8e96482078cc7625 P e61c3a8f61bb48f8a963c9480e53c168 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader e5256d91808b47c195bc9b4dbd7f2b87)
I20260709 13:06:31.488015 24696 raft_consensus.cc:3060] T e381f1d6b8184797ad142de49be225a8 P e61c3a8f61bb48f8a963c9480e53c168 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:06:31.480144 24550 raft_consensus.cc:515] T b9f0d59553ad444883fcf5b5909f9798 P e5256d91808b47c195bc9b4dbd7f2b87 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:31.482017 24411 raft_consensus.cc:515] T fa8650e71aa14778b3d73721fc50d9fc P e5256d91808b47c195bc9b4dbd7f2b87 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
W20260709 13:06:31.514845 19524 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.596s	user 0.043s	sys 0.070s
W20260709 13:06:31.517198 19524 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.598s	user 0.043s	sys 0.070s
I20260709 13:06:31.484464 24362 raft_consensus.cc:515] T 86a6797bdfe94fa496c050ceae4bd0d9 P e5256d91808b47c195bc9b4dbd7f2b87 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:31.508833 24554 leader_election.cc:290] T 40e1e16737a842ee936002830f36882e P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:06:31.520536 24601 raft_consensus.cc:493] T f1b10566f45d4a7d9029858330e02d5b P e61c3a8f61bb48f8a963c9480e53c168 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 0473d2b2d01f4459b1e90fd12cc7840e)
I20260709 13:06:31.532263 19523 leader_election.cc:304] T 4af19371ea874c09a0a2147040835cbb P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e61c3a8f61bb48f8a963c9480e53c168; no voters: 127766fc592545a4997f7790f50f6076, e5256d91808b47c195bc9b4dbd7f2b87
W20260709 13:06:31.538105 20076 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.3:36891, user_credentials={real_user=slave}} blocked reactor thread for 582948us
I20260709 13:06:31.561177 20076 leader_election.cc:304] T 96efeaaf1057492490e9a621f37e1a2d P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 127766fc592545a4997f7790f50f6076; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:06:31.539011 24611 consensus_queue.cc:1048] T 70797e5783b5454ab0d0eea663e791e3 P 127766fc592545a4997f7790f50f6076 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
W20260709 13:06:31.541420 20075 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:31.544721 19479 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58294 (request call id 2461) took 1750 ms (client timeout 1733 ms). Trace:
I20260709 13:06:31.547376 24551 raft_consensus.cc:493] T 0cdf56e38bbc453d9438d359e5a69955 P e5256d91808b47c195bc9b4dbd7f2b87 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 0473d2b2d01f4459b1e90fd12cc7840e)
I20260709 13:06:31.550311 24479 leader_election.cc:290] T 1f85fc4b527a48848e5faa083b604e36 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:06:31.550459 24663 leader_election.cc:290] T df751f992649444090e27965eb1af85d P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:06:31.582626 24663 raft_consensus.cc:493] T 2b74109013a140ada21feeef92d6f563 P e61c3a8f61bb48f8a963c9480e53c168 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:31.583390 20076 leader_election.cc:304] T ab43d85f64114d4ebf618930e43d9ed0 P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 127766fc592545a4997f7790f50f6076, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:06:31.490887 24543 raft_consensus.cc:515] T 2e36a9d6e29c4a7c860cf267efbd4c74 P e61c3a8f61bb48f8a963c9480e53c168 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:31.585731 24543 leader_election.cc:290] T 2e36a9d6e29c4a7c860cf267efbd4c74 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:06:31.586236 24543 raft_consensus.cc:493] T 6c5eebf646ad445a9d1b1adc319d7b16 P e61c3a8f61bb48f8a963c9480e53c168 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:06:31.564957 19479 rpcz_store.cc:269] 0709 13:06:29.819161 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:29.819316 (+   155us) service_pool.cc:224] Handling call
0709 13:06:31.544495 (+1725179us) spinlock_profiling.cc:243] Waited 710 ms on lock 0x7b5400222c54. stack: 00007f4a79de9343 00007f4a79de9240 00007f4a797781d4 00007f4a834b6304 00007f4a834b6299 00007f4a7ce71571 00007f4a7cf0c2fa 00007f4a81ecdb17 00007f4a7b4486d4 00007f4a7b448662 00007f4a7b448591 00007f4a7b44850c 00007f4a7b4477c2 00007f4a7b24348c 00007f4a7b2428c6 00007f4a7b24226f
0709 13:06:31.544618 (+   123us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1633689472}
I20260709 13:06:31.551079 24553 leader_election.cc:290] T 775c229504194560ba9589bc2199b089 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:06:31.580214 24626 raft_consensus.cc:493] T ff9b0eddd810459b82d91c60777c10eb P 127766fc592545a4997f7790f50f6076 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader e5256d91808b47c195bc9b4dbd7f2b87)
I20260709 13:06:31.587793 24626 raft_consensus.cc:515] T ff9b0eddd810459b82d91c60777c10eb P 127766fc592545a4997f7790f50f6076 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:31.590413 24626 leader_election.cc:290] T ff9b0eddd810459b82d91c60777c10eb P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:06:31.592186 24543 raft_consensus.cc:515] T 6c5eebf646ad445a9d1b1adc319d7b16 P e61c3a8f61bb48f8a963c9480e53c168 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
W20260709 13:06:31.582072 24649 log.cc:927] Time spent T edd7d470b5014c9489be7f41f64355c9 P e61c3a8f61bb48f8a963c9480e53c168: Append to log took a long time: real 1.180s	user 0.004s	sys 0.000s
I20260709 13:06:31.583205 24663 raft_consensus.cc:515] T 2b74109013a140ada21feeef92d6f563 P e61c3a8f61bb48f8a963c9480e53c168 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:31.597038 19559 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40428 (request call id 2830) took 1770 ms. Trace:
I20260709 13:06:31.597517 24663 leader_election.cc:290] T 2b74109013a140ada21feeef92d6f563 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:06:31.598124 24543 leader_election.cc:290] T 6c5eebf646ad445a9d1b1adc319d7b16 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:06:31.598227 24663 raft_consensus.cc:2749] T 4af19371ea874c09a0a2147040835cbb P e61c3a8f61bb48f8a963c9480e53c168 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:06:31.598858 24612 raft_consensus.cc:2804] T ab43d85f64114d4ebf618930e43d9ed0 P 127766fc592545a4997f7790f50f6076 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:06:31.598939 24601 raft_consensus.cc:515] T f1b10566f45d4a7d9029858330e02d5b P e61c3a8f61bb48f8a963c9480e53c168 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:31.599550 24612 raft_consensus.cc:493] T ab43d85f64114d4ebf618930e43d9ed0 P 127766fc592545a4997f7790f50f6076 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 0473d2b2d01f4459b1e90fd12cc7840e)
I20260709 13:06:31.600063 24612 raft_consensus.cc:3060] T ab43d85f64114d4ebf618930e43d9ed0 P 127766fc592545a4997f7790f50f6076 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:06:31.601366 24601 leader_election.cc:290] T f1b10566f45d4a7d9029858330e02d5b P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:06:31.601552 20105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "172b3dd13109415a955b71ac0e9d2234" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076"
I20260709 13:06:31.602638 20103 raft_consensus.cc:1275] T 65d8cb8d6ec64f459d5a47cefab10acf P 127766fc592545a4997f7790f50f6076 [term 15 FOLLOWER]: Refusing update from remote peer e5256d91808b47c195bc9b4dbd7f2b87: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 15 index: 10. (term mismatch)
I20260709 13:06:31.603058 20103 pending_rounds.cc:85] T 65d8cb8d6ec64f459d5a47cefab10acf P 127766fc592545a4997f7790f50f6076: Aborting all ops after (but not including) 9
I20260709 13:06:31.603493 20103 pending_rounds.cc:107] T 65d8cb8d6ec64f459d5a47cefab10acf P 127766fc592545a4997f7790f50f6076: Aborting uncommitted NO_OP operation due to leader change: 14.10
I20260709 13:06:31.603753 20103 raft_consensus.cc:2889] T 65d8cb8d6ec64f459d5a47cefab10acf P 127766fc592545a4997f7790f50f6076 [term 15 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:06:31.563032 24695 log.cc:927] Time spent T ab43d85f64114d4ebf618930e43d9ed0 P 127766fc592545a4997f7790f50f6076: Append to log took a long time: real 0.269s	user 0.000s	sys 0.001s
W20260709 13:06:31.608515 24703 log.cc:927] Time spent T 76cb037fc9064d13b59a8969d897ce8c P 0473d2b2d01f4459b1e90fd12cc7840e: Append to log took a long time: real 0.123s	user 0.000s	sys 0.000s
I20260709 13:06:31.520949 24397 leader_election.cc:290] T 2e36a9d6e29c4a7c860cf267efbd4c74 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:06:31.519352 24517 raft_consensus.cc:493] T 0afb57ae58a24a01850491d69f0213dd P e61c3a8f61bb48f8a963c9480e53c168 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 0473d2b2d01f4459b1e90fd12cc7840e)
I20260709 13:06:31.609839 24517 raft_consensus.cc:515] T 0afb57ae58a24a01850491d69f0213dd P e61c3a8f61bb48f8a963c9480e53c168 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:31.611567 20104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85c494af21f9457a85da47b9bc70c1fd" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076"
I20260709 13:06:31.612188 24517 leader_election.cc:290] T 0afb57ae58a24a01850491d69f0213dd P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:06:31.593001 24411 leader_election.cc:290] T fa8650e71aa14778b3d73721fc50d9fc P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
W20260709 13:06:31.591250 24701 log.cc:927] Time spent T ed7fdbcb96d14d418db9ca90a792588a P e61c3a8f61bb48f8a963c9480e53c168: Append to log took a long time: real 0.292s	user 0.000s	sys 0.001s
W20260709 13:06:31.612643 20076 leader_election.cc:336] T 70797e5783b5454ab0d0eea663e791e3 P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891): Timed out: RequestConsensusVote RPC to 127.17.223.3:36891 timed out after 1.799s (SENT)
I20260709 13:06:31.614153 24654 leader_election.cc:290] T 5ec1c4ce15e04c7e8c283a62179f2a64 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:06:31.580613 24551 raft_consensus.cc:515] T 0cdf56e38bbc453d9438d359e5a69955 P e5256d91808b47c195bc9b4dbd7f2b87 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:31.617928 19555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f93ee515a9c14139bf566522ed8232f3" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 16 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:06:31.619030 20111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a16f7501e2444fb86d4e2778e734e02" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:06:31.620103 19555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70797e5783b5454ab0d0eea663e791e3" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:06:31.602991 24558 leader_election.cc:290] T 21e14947d70440f19044d8f75c31e1f9 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:06:31.594888 24595 leader_election.cc:290] T 3e1f505cb0f1427bbd698ac889d80821 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:06:31.621704 19555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edd7d470b5014c9489be7f41f64355c9" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 16 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:06:31.494990 24665 raft_consensus.cc:515] T b9f0d59553ad444883fcf5b5909f9798 P e61c3a8f61bb48f8a963c9480e53c168 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:31.579701 24629 consensus_queue.cc:1048] T fa731b585f684a7fb2d106c50f143b83 P 127766fc592545a4997f7790f50f6076 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:06:31.593721 24681 leader_election.cc:290] T 1dc5b3532fe54f74876d02beffa2c230 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:06:31.597494 19559 rpcz_store.cc:276] 0709 13:06:29.826847 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:29.826976 (+   129us) service_pool.cc:224] Handling call
0709 13:06:29.827258 (+   282us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:29.827581 (+   323us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:29.827610 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:29.828056 (+   446us) log.cc:844] Serialized 26 byte log entry
0709 13:06:29.918945 (+ 90889us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:06:29.919021 (+    76us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:29.919148 (+   127us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:31.581368 (+1662220us) spinlock_profiling.cc:243] Waited 6.17 ms on lock 0x7b4400022b4c. stack: 00007f4a79de9343 00007f4a79de9240 00007f4a797781d4 00007f4a834b6304 00007f4a834b6299 00007f4a79ca3db1 00007f4a79d41c85 00007f4a79d426a2 00007f4a7cab41db 00007f4a7caafaaf 00007f4a7caa386e 00007f4a7caa2bb6 00007f4a7caa27d8 00007f4a7caac221 00007f4a7caac1d9 00007f4a7caac169
0709 13:06:31.596711 (+ 15343us) raft_consensus.cc:1685] finished
0709 13:06:31.596737 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:31.596974 (+   237us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1252,"raft.run_cpu_time_us":79,"raft.run_wall_time_us":80,"spinlock_wait_cycles":14185728,"thread_start_us":87835,"threads_started":1,"wal-append.queue_time_us":480501}
I20260709 13:06:31.640095 19559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b74109013a140ada21feeef92d6f563" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:06:31.640872 19559 raft_consensus.cc:2393] T 2b74109013a140ada21feeef92d6f563 P e61c3a8f61bb48f8a963c9480e53c168 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e5256d91808b47c195bc9b4dbd7f2b87 in current term 11: Already voted for candidate e61c3a8f61bb48f8a963c9480e53c168 in this term.
I20260709 13:06:31.494490 24700 raft_consensus.cc:515] T 0cdf56e38bbc453d9438d359e5a69955 P e61c3a8f61bb48f8a963c9480e53c168 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:31.496848 24680 raft_consensus.cc:515] T 86a6797bdfe94fa496c050ceae4bd0d9 P e61c3a8f61bb48f8a963c9480e53c168 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:31.634317 19555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a16f7501e2444fb86d4e2778e734e02" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:06:31.638440 20104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62c6c134d3d24a1ab144dd9ee6bc3f64" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:06:31.517962 24577 leader_election.cc:290] T 1efebf73c86e432baa55533136b6e12c P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:06:31.513413 24662 raft_consensus.cc:515] T 28af091831594f9d8e96482078cc7625 P e61c3a8f61bb48f8a963c9480e53c168 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:31.644585 19526 leader_election.cc:304] T 40e1e16737a842ee936002830f36882e P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:06:31.647967 19555 raft_consensus.cc:2468] T 2a16f7501e2444fb86d4e2778e734e02 P e61c3a8f61bb48f8a963c9480e53c168 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 13.
I20260709 13:06:31.500584 24699 raft_consensus.cc:515] T fa8650e71aa14778b3d73721fc50d9fc P e61c3a8f61bb48f8a963c9480e53c168 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:31.623180 24482 raft_consensus.cc:2749] T 96efeaaf1057492490e9a621f37e1a2d P 127766fc592545a4997f7790f50f6076 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:06:31.657740 19559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa8650e71aa14778b3d73721fc50d9fc" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:06:31.630108 24517 raft_consensus.cc:493] T ece3db938bc649d4a40a51522ed5259c P e61c3a8f61bb48f8a963c9480e53c168 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader e5256d91808b47c195bc9b4dbd7f2b87)
I20260709 13:06:31.651873 19555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e1f505cb0f1427bbd698ac889d80821" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:06:31.649660 24545 raft_consensus.cc:2749] T ab43d85f64114d4ebf618930e43d9ed0 P e61c3a8f61bb48f8a963c9480e53c168 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:06:31.668484 19375 leader_election.cc:304] T 70797e5783b5454ab0d0eea663e791e3 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87; no voters: 127766fc592545a4997f7790f50f6076, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:06:31.680063 19559 raft_consensus.cc:2468] T fa8650e71aa14778b3d73721fc50d9fc P e61c3a8f61bb48f8a963c9480e53c168 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 13.
I20260709 13:06:31.661828 19555 raft_consensus.cc:2468] T 3e1f505cb0f1427bbd698ac889d80821 P e61c3a8f61bb48f8a963c9480e53c168 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 15.
I20260709 13:06:31.655241 24411 raft_consensus.cc:493] T 309c3ca0ca4b4f3ba129752ea2cb293b P e5256d91808b47c195bc9b4dbd7f2b87 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 127766fc592545a4997f7790f50f6076)
I20260709 13:06:31.694646 19555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46c5bfeecc314717bffe987e6844b6d0" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 20 candidate_status { last_received { term: 19 index: 9 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:06:31.684206 19375 leader_election.cc:304] T 2a16f7501e2444fb86d4e2778e734e02 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:06:31.695394 19555 raft_consensus.cc:2468] T 46c5bfeecc314717bffe987e6844b6d0 P e61c3a8f61bb48f8a963c9480e53c168 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 19.
I20260709 13:06:31.701385 19375 leader_election.cc:304] T 3e1f505cb0f1427bbd698ac889d80821 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:06:31.702316 24702 raft_consensus.cc:2804] T 40e1e16737a842ee936002830f36882e P e61c3a8f61bb48f8a963c9480e53c168 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:06:31.703233 24599 leader_election.cc:290] T 28af091831594f9d8e96482078cc7625 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:06:31.704068 24699 leader_election.cc:290] T fa8650e71aa14778b3d73721fc50d9fc P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:06:31.718807 24702 raft_consensus.cc:493] T 40e1e16737a842ee936002830f36882e P e61c3a8f61bb48f8a963c9480e53c168 [term 15 FOLLOWER]: Starting leader election (detected failure of leader e5256d91808b47c195bc9b4dbd7f2b87)
I20260709 13:06:31.708760 24662 leader_election.cc:290] T 28af091831594f9d8e96482078cc7625 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:06:31.709781 24687 raft_consensus.cc:493] T 14935b3ddf914369822e4a0547aaa355 P e61c3a8f61bb48f8a963c9480e53c168 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 127766fc592545a4997f7790f50f6076)
I20260709 13:06:31.710498 24700 leader_election.cc:290] T 0cdf56e38bbc453d9438d359e5a69955 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
W20260709 13:06:31.712679 19486 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58294 (request call id 2464) took 1889 ms (client timeout 2392 ms). Trace:
W20260709 13:06:31.737031 19486 rpcz_store.cc:269] 0709 13:06:29.823719 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:29.823840 (+   121us) service_pool.cc:224] Handling call
0709 13:06:31.712457 (+1888617us) spinlock_profiling.cc:243] Waited 92.3 ms on lock 0x7b5400221854. stack: 00007f4a79de9343 00007f4a79de9240 00007f4a797781d4 00007f4a834b6304 00007f4a834b6299 00007f4a7ce71571 00007f4a7cf0c2fa 00007f4a81ecdb17 00007f4a7b4486d4 00007f4a7b448662 00007f4a7b448591 00007f4a7b44850c 00007f4a7b4477c2 00007f4a7b24348c 00007f4a7b2428c6 00007f4a7b24226f
0709 13:06:31.712613 (+   156us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":212266880}
I20260709 13:06:31.714987 24597 raft_consensus.cc:2804] T 2a16f7501e2444fb86d4e2778e734e02 P e5256d91808b47c195bc9b4dbd7f2b87 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:06:31.715190 24645 raft_consensus.cc:2749] T 70797e5783b5454ab0d0eea663e791e3 P e5256d91808b47c195bc9b4dbd7f2b87 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:06:31.697285 24676 raft_consensus.cc:493] T 7be9efa6559648dbb5a0f7684c4542d1 P e5256d91808b47c195bc9b4dbd7f2b87 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 0473d2b2d01f4459b1e90fd12cc7840e)
W20260709 13:06:31.706990 24707 log.cc:927] Time spent T 65d8cb8d6ec64f459d5a47cefab10acf P e5256d91808b47c195bc9b4dbd7f2b87: Append to log took a long time: real 0.187s	user 0.000s	sys 0.001s
I20260709 13:06:31.727455 19555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e381f1d6b8184797ad142de49be225a8" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:06:31.706437 24678 leader_election.cc:290] T 4509b76741dc428e9201c70c1658da13 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:06:31.650183 24612 raft_consensus.cc:515] T ab43d85f64114d4ebf618930e43d9ed0 P 127766fc592545a4997f7790f50f6076 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:31.739776 19375 leader_election.cc:304] T 46c5bfeecc314717bffe987e6844b6d0 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
W20260709 13:06:31.718195 24686 consensus_meta.cc:287] T 179fd671030940b4b4a4e24bcc4aba0a P e61c3a8f61bb48f8a963c9480e53c168: Time spent flushing consensus metadata: real 0.722s	user 0.012s	sys 0.001s
I20260709 13:06:31.680613 24517 raft_consensus.cc:515] T ece3db938bc649d4a40a51522ed5259c P e61c3a8f61bb48f8a963c9480e53c168 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:31.760362 24507 raft_consensus.cc:2804] T 46c5bfeecc314717bffe987e6844b6d0 P e5256d91808b47c195bc9b4dbd7f2b87 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:06:31.762791 24596 raft_consensus.cc:493] T 1f85fc4b527a48848e5faa083b604e36 P e5256d91808b47c195bc9b4dbd7f2b87 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 127766fc592545a4997f7790f50f6076)
I20260709 13:06:31.763098 19554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cdf56e38bbc453d9438d359e5a69955" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:06:31.739498 24597 raft_consensus.cc:493] T 2a16f7501e2444fb86d4e2778e734e02 P e5256d91808b47c195bc9b4dbd7f2b87 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 127766fc592545a4997f7790f50f6076)
I20260709 13:06:31.771122 19554 raft_consensus.cc:2468] T 0cdf56e38bbc453d9438d359e5a69955 P e61c3a8f61bb48f8a963c9480e53c168 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 14.
I20260709 13:06:31.735426 24702 raft_consensus.cc:3060] T 40e1e16737a842ee936002830f36882e P e61c3a8f61bb48f8a963c9480e53c168 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:06:31.755355 24700 raft_consensus.cc:493] T bc225c93219c45538b53a1bd3d387e4d P e61c3a8f61bb48f8a963c9480e53c168 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:31.774447 19375 leader_election.cc:304] T 0cdf56e38bbc453d9438d359e5a69955 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:06:31.744006 24551 leader_election.cc:290] T 0cdf56e38bbc453d9438d359e5a69955 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:06:31.790441 20109 raft_consensus.cc:3055] T 6c5eebf646ad445a9d1b1adc319d7b16 P 127766fc592545a4997f7790f50f6076 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:06:31.791047 20109 raft_consensus.cc:740] T 6c5eebf646ad445a9d1b1adc319d7b16 P 127766fc592545a4997f7790f50f6076 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 127766fc592545a4997f7790f50f6076, State: Running, Role: LEADER
I20260709 13:06:31.734578 24411 raft_consensus.cc:515] T 309c3ca0ca4b4f3ba129752ea2cb293b P e5256d91808b47c195bc9b4dbd7f2b87 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } attrs { replace: true } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
W20260709 13:06:31.823863 19523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.1:40321, user_credentials={real_user=slave}} blocked reactor thread for 291724us
I20260709 13:06:31.769001 24507 raft_consensus.cc:493] T 46c5bfeecc314717bffe987e6844b6d0 P e5256d91808b47c195bc9b4dbd7f2b87 [term 19 FOLLOWER]: Starting leader election (detected failure of leader 0473d2b2d01f4459b1e90fd12cc7840e)
I20260709 13:06:31.827550 19403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df751f992649444090e27965eb1af85d" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:06:31.774317 24597 raft_consensus.cc:3060] T 2a16f7501e2444fb86d4e2778e734e02 P e5256d91808b47c195bc9b4dbd7f2b87 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:06:31.830122 19411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21e14947d70440f19044d8f75c31e1f9" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:06:31.830228 19404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7be9efa6559648dbb5a0f7684c4542d1" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:06:31.832656 19403 raft_consensus.cc:2410] T df751f992649444090e27965eb1af85d P e5256d91808b47c195bc9b4dbd7f2b87 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e61c3a8f61bb48f8a963c9480e53c168 for term 18 because replica has last-logged OpId of term: 17 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 10.
I20260709 13:06:31.830945 19402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e36a9d6e29c4a7c860cf267efbd4c74" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:06:31.837543 19402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ece3db938bc649d4a40a51522ed5259c" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:06:31.833489 19410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1b10566f45d4a7d9029858330e02d5b" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:06:31.838300 19410 raft_consensus.cc:2468] T f1b10566f45d4a7d9029858330e02d5b P e5256d91808b47c195bc9b4dbd7f2b87 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 14.
I20260709 13:06:31.834079 20103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0afb57ae58a24a01850491d69f0213dd" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:06:31.834715 19523 leader_election.cc:304] T 96efeaaf1057492490e9a621f37e1a2d P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e61c3a8f61bb48f8a963c9480e53c168; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, 127766fc592545a4997f7790f50f6076
I20260709 13:06:31.834759 19409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b74109013a140ada21feeef92d6f563" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:06:31.839287 19409 raft_consensus.cc:2468] T 2b74109013a140ada21feeef92d6f563 P e5256d91808b47c195bc9b4dbd7f2b87 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 10.
I20260709 13:06:31.839519 19410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9f0d59553ad444883fcf5b5909f9798" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:06:31.840111 19410 raft_consensus.cc:2468] T b9f0d59553ad444883fcf5b5909f9798 P e5256d91808b47c195bc9b4dbd7f2b87 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 13.
I20260709 13:06:31.840970 19410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa8650e71aa14778b3d73721fc50d9fc" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:06:31.842021 19403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28af091831594f9d8e96482078cc7625" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:06:31.741925 24687 raft_consensus.cc:515] T 14935b3ddf914369822e4a0547aaa355 P e61c3a8f61bb48f8a963c9480e53c168 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } attrs { replace: true } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:31.821120 20109 consensus_queue.cc:260] T 6c5eebf646ad445a9d1b1adc319d7b16 P 127766fc592545a4997f7790f50f6076 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:31.841451 19410 raft_consensus.cc:2468] T fa8650e71aa14778b3d73721fc50d9fc P e5256d91808b47c195bc9b4dbd7f2b87 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 13.
I20260709 13:06:31.871740 20104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed7fdbcb96d14d418db9ca90a792588a" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:06:31.876968 20109 raft_consensus.cc:3060] T 6c5eebf646ad445a9d1b1adc319d7b16 P 127766fc592545a4997f7790f50f6076 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:06:31.848299 19409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cdf56e38bbc453d9438d359e5a69955" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:06:31.847733 19407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4509b76741dc428e9201c70c1658da13" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:06:31.880095 20111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7be9efa6559648dbb5a0f7684c4542d1" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:06:31.793927 24645 raft_consensus.cc:2804] T 0cdf56e38bbc453d9438d359e5a69955 P e5256d91808b47c195bc9b4dbd7f2b87 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:06:31.881493 20112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1efebf73c86e432baa55533136b6e12c" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:06:31.881800 19403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "172b3dd13109415a955b71ac0e9d2234" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
W20260709 13:06:31.884143 19523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.4:43121, user_credentials={real_user=slave}} blocked reactor thread for 49557.2us
I20260709 13:06:31.887212 20110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c5eebf646ad445a9d1b1adc319d7b16" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:06:31.887524 19523 leader_election.cc:304] T 62c6c134d3d24a1ab144dd9ee6bc3f64 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e61c3a8f61bb48f8a963c9480e53c168; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, 127766fc592545a4997f7790f50f6076
I20260709 13:06:31.773917 24596 raft_consensus.cc:515] T 1f85fc4b527a48848e5faa083b604e36 P e5256d91808b47c195bc9b4dbd7f2b87 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
W20260709 13:06:31.836063 24706 log.cc:927] Time spent T 48824d5acfbc485ebf8c2d944e7202de P e61c3a8f61bb48f8a963c9480e53c168: Append to log took a long time: real 0.061s	user 0.000s	sys 0.000s
I20260709 13:06:31.890120 19523 leader_election.cc:304] T f93ee515a9c14139bf566522ed8232f3 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168; no voters: 0473d2b2d01f4459b1e90fd12cc7840e
I20260709 13:06:31.769431 24686 raft_consensus.cc:515] T 179fd671030940b4b4a4e24bcc4aba0a P e61c3a8f61bb48f8a963c9480e53c168 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:31.835517 24507 raft_consensus.cc:3060] T 46c5bfeecc314717bffe987e6844b6d0 P e5256d91808b47c195bc9b4dbd7f2b87 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:06:31.899833 20107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ec1c4ce15e04c7e8c283a62179f2a64" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:06:31.891422 24545 raft_consensus.cc:2749] T 96efeaaf1057492490e9a621f37e1a2d P e61c3a8f61bb48f8a963c9480e53c168 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
W20260709 13:06:31.901067 24708 log.cc:927] Time spent T 62c6c134d3d24a1ab144dd9ee6bc3f64 P e61c3a8f61bb48f8a963c9480e53c168: Append to log took a long time: real 0.204s	user 0.001s	sys 0.000s
I20260709 13:06:31.901597 24686 leader_election.cc:290] T 179fd671030940b4b4a4e24bcc4aba0a P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 17 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:06:31.901654 20103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f85fc4b527a48848e5faa083b604e36" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:06:31.902997 19558 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40428 (request call id 2843) took 1045 ms. Trace:
W20260709 13:06:31.903350 24614 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 2.291s	user 0.011s	sys 0.031s
W20260709 13:06:31.903823 24614 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 2.463s	user 0.011s	sys 0.031s
I20260709 13:06:31.904958 24710 raft_consensus.cc:493] T ff75a1d4cb1f493db8f71ddc136ba9ab P e61c3a8f61bb48f8a963c9480e53c168 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:31.903484 19558 rpcz_store.cc:276] 0709 13:06:30.857641 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:31.288907 (+431266us) service_pool.cc:224] Handling call
0709 13:06:31.289158 (+   251us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:31.289450 (+   292us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:31.289477 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:31.294104 (+  4627us) log.cc:844] Serialized 26 byte log entry
0709 13:06:31.495315 (+201211us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:06:31.495355 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:31.495421 (+    66us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:31.902737 (+407316us) raft_consensus.cc:1685] finished
0709 13:06:31.902760 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:31.902931 (+   171us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":100,"raft.run_cpu_time_us":114,"raft.run_wall_time_us":2393,"thread_start_us":141530,"threads_started":1,"wal-append.queue_time_us":356439}
I20260709 13:06:31.828999 24551 raft_consensus.cc:493] T 76cb037fc9064d13b59a8969d897ce8c P e5256d91808b47c195bc9b4dbd7f2b87 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 0473d2b2d01f4459b1e90fd12cc7840e)
I20260709 13:06:31.893719 19402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff9b0eddd810459b82d91c60777c10eb" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:06:31.894119 24633 raft_consensus.cc:515] T 22196caba61445d3bec98a0aab3c337d P e61c3a8f61bb48f8a963c9480e53c168 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:31.896420 19403 raft_consensus.cc:2393] T 172b3dd13109415a955b71ac0e9d2234 P e5256d91808b47c195bc9b4dbd7f2b87 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 127766fc592545a4997f7790f50f6076 in current term 13: Already voted for candidate e5256d91808b47c195bc9b4dbd7f2b87 in this term.
I20260709 13:06:31.833662 24662 raft_consensus.cc:493] T 76cb037fc9064d13b59a8969d897ce8c P e61c3a8f61bb48f8a963c9480e53c168 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 0473d2b2d01f4459b1e90fd12cc7840e)
I20260709 13:06:31.877426 24362 leader_election.cc:290] T 86a6797bdfe94fa496c050ceae4bd0d9 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:06:31.906337 19558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ece3db938bc649d4a40a51522ed5259c" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:06:31.793612 24700 raft_consensus.cc:515] T bc225c93219c45538b53a1bd3d387e4d P e61c3a8f61bb48f8a963c9480e53c168 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:31.879762 24699 raft_consensus.cc:493] T 65d8cb8d6ec64f459d5a47cefab10acf P e61c3a8f61bb48f8a963c9480e53c168 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader e5256d91808b47c195bc9b4dbd7f2b87)
I20260709 13:06:31.939266 24699 raft_consensus.cc:515] T 65d8cb8d6ec64f459d5a47cefab10acf P e61c3a8f61bb48f8a963c9480e53c168 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:31.843245 24550 leader_election.cc:290] T b9f0d59553ad444883fcf5b5909f9798 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:06:31.909403 19523 leader_election.cc:304] T 7f575b143b844aa096b50997dad3516a P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e61c3a8f61bb48f8a963c9480e53c168; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:06:31.847744 24617 raft_consensus.cc:493] T 14efcc79969f41babe5529c22d59156d P 0473d2b2d01f4459b1e90fd12cc7840e [term 16 FOLLOWER]: Starting pre-election (detected failure of leader e5256d91808b47c195bc9b4dbd7f2b87)
I20260709 13:06:31.882529 24671 leader_election.cc:290] T ff9b0eddd810459b82d91c60777c10eb P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:06:31.915171 19558 raft_consensus.cc:2468] T ece3db938bc649d4a40a51522ed5259c P e61c3a8f61bb48f8a963c9480e53c168 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 127766fc592545a4997f7790f50f6076 in term 10.
I20260709 13:06:31.916088 20104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "775c229504194560ba9589bc2199b089" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:06:31.917945 24620 raft_consensus.cc:2804] T 3e1f505cb0f1427bbd698ac889d80821 P e5256d91808b47c195bc9b4dbd7f2b87 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:06:31.905467 24710 raft_consensus.cc:515] T ff75a1d4cb1f493db8f71ddc136ba9ab P e61c3a8f61bb48f8a963c9480e53c168 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:31.888370 24645 raft_consensus.cc:493] T 0cdf56e38bbc453d9438d359e5a69955 P e5256d91808b47c195bc9b4dbd7f2b87 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 0473d2b2d01f4459b1e90fd12cc7840e)
I20260709 13:06:31.896759 24601 raft_consensus.cc:2749] T 62c6c134d3d24a1ab144dd9ee6bc3f64 P e61c3a8f61bb48f8a963c9480e53c168 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:06:31.909971 24686 raft_consensus.cc:2804] T f93ee515a9c14139bf566522ed8232f3 P e61c3a8f61bb48f8a963c9480e53c168 [term 15 FOLLOWER]: Leader pre-election won for term 16
W20260709 13:06:31.942005 20076 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.3:36891, user_credentials={real_user=slave}} blocked reactor thread for 185905us
I20260709 13:06:31.948856 19558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65d8cb8d6ec64f459d5a47cefab10acf" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:06:31.968314 19558 raft_consensus.cc:2410] T 65d8cb8d6ec64f459d5a47cefab10acf P e61c3a8f61bb48f8a963c9480e53c168 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 127766fc592545a4997f7790f50f6076 for term 16 because replica has last-logged OpId of term: 15 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 10.
I20260709 13:06:31.891063 24665 leader_election.cc:290] T b9f0d59553ad444883fcf5b5909f9798 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
W20260709 13:06:31.968837 19374 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.4:43121, user_credentials={real_user=slave}} blocked reactor thread for 73409.6us
W20260709 13:06:31.969198 24706 log.cc:927] Time spent T 48824d5acfbc485ebf8c2d944e7202de P e61c3a8f61bb48f8a963c9480e53c168: Append to log took a long time: real 0.055s	user 0.000s	sys 0.000s
I20260709 13:06:31.966572 24645 raft_consensus.cc:3060] T 0cdf56e38bbc453d9438d359e5a69955 P e5256d91808b47c195bc9b4dbd7f2b87 [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:06:31.973670 19523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.1:40321, user_credentials={real_user=slave}} blocked reactor thread for 64353.5us
I20260709 13:06:31.950630 24620 raft_consensus.cc:493] T 3e1f505cb0f1427bbd698ac889d80821 P e5256d91808b47c195bc9b4dbd7f2b87 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 0473d2b2d01f4459b1e90fd12cc7840e)
I20260709 13:06:31.912357 24551 raft_consensus.cc:515] T 76cb037fc9064d13b59a8969d897ce8c P e5256d91808b47c195bc9b4dbd7f2b87 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:31.976306 24665 raft_consensus.cc:2749] T 7f575b143b844aa096b50997dad3516a P e61c3a8f61bb48f8a963c9480e53c168 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:06:31.982870 24411 leader_election.cc:290] T 309c3ca0ca4b4f3ba129752ea2cb293b P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:06:31.987731 24478 raft_consensus.cc:493] T 2b74109013a140ada21feeef92d6f563 P 0473d2b2d01f4459b1e90fd12cc7840e [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:31.988197 24559 raft_consensus.cc:493] T 1a61655d99124a29b486ba4a5b37faea P 0473d2b2d01f4459b1e90fd12cc7840e [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:31.988880 19486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "172b3dd13109415a955b71ac0e9d2234" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:06:32.041319 19486 raft_consensus.cc:2468] T 172b3dd13109415a955b71ac0e9d2234 P 0473d2b2d01f4459b1e90fd12cc7840e [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 12.
I20260709 13:06:32.041342 19553 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40428 (request call id 2840) took 1194 ms. Trace:
I20260709 13:06:31.989699 19484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab43d85f64114d4ebf618930e43d9ed0" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:06:31.990736 19481 raft_consensus.cc:1275] T ff75a1d4cb1f493db8f71ddc136ba9ab P 0473d2b2d01f4459b1e90fd12cc7840e [term 15 FOLLOWER]: Refusing update from remote peer e5256d91808b47c195bc9b4dbd7f2b87: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 15 index: 8. (index mismatch)
I20260709 13:06:31.967496 24680 leader_election.cc:290] T 86a6797bdfe94fa496c050ceae4bd0d9 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:06:31.773535 24676 raft_consensus.cc:515] T 7be9efa6559648dbb5a0f7684c4542d1 P e5256d91808b47c195bc9b4dbd7f2b87 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } attrs { replace: true } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:31.967680 24686 raft_consensus.cc:493] T f93ee515a9c14139bf566522ed8232f3 P e61c3a8f61bb48f8a963c9480e53c168 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 0473d2b2d01f4459b1e90fd12cc7840e)
I20260709 13:06:32.045995 19482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f93ee515a9c14139bf566522ed8232f3" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 16 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:06:31.990844 19479 raft_consensus.cc:1275] T 179fd671030940b4b4a4e24bcc4aba0a P 0473d2b2d01f4459b1e90fd12cc7840e [term 16 FOLLOWER]: Refusing update from remote peer e5256d91808b47c195bc9b4dbd7f2b87: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 13:06:31.942325 24662 raft_consensus.cc:515] T 76cb037fc9064d13b59a8969d897ce8c P e61c3a8f61bb48f8a963c9480e53c168 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
W20260709 13:06:32.032176 24661 consensus_meta.cc:287] T ab43d85f64114d4ebf618930e43d9ed0 P e5256d91808b47c195bc9b4dbd7f2b87: Time spent flushing consensus metadata: real 0.735s	user 0.008s	sys 0.003s
W20260709 13:06:32.029152 24716 log.cc:927] Time spent T bc225c93219c45538b53a1bd3d387e4d P 0473d2b2d01f4459b1e90fd12cc7840e: Append to log took a long time: real 0.057s	user 0.000s	sys 0.000s
I20260709 13:06:31.967356 24617 raft_consensus.cc:515] T 14efcc79969f41babe5529c22d59156d P 0473d2b2d01f4459b1e90fd12cc7840e [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:32.042553 19553 rpcz_store.cc:276] 0709 13:06:30.847179 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:30.854655 (+  7476us) service_pool.cc:224] Handling call
0709 13:06:30.855015 (+   360us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:06:30.860812 (+  5797us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:30.860845 (+    33us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:06:30.875109 (+ 14264us) log.cc:844] Serialized 52 byte log entry
0709 13:06:31.300202 (+425093us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:06:31.442462 (+142260us) log.cc:844] Serialized 14 byte log entry
0709 13:06:31.454586 (+ 12124us) log.cc:844] Serialized 14 byte log entry
0709 13:06:31.454798 (+   212us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:31.454884 (+    86us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:31.606454 (+151570us) spinlock_profiling.cc:243] Waited 4.42 ms on lock 0x7b180002db80. stack: 00007f4a79de9343 00007f4a79de9240 00007f4a797781d4 00007f4a834b6304 00007f4a834b6299 00007f4a82ce3de1 00007f4a82cf05b1 00007f4a79e1b557 00007f4a79e1d7c1 00007f4a79e1d779 00007f4a79e1d709 00007f4a79e1d6d1 00007f4a79e1c9cd 000000000038f354 000000000038f199 00007f4a79dfe83a
0709 13:06:32.041132 (+434678us) raft_consensus.cc:1685] finished
0709 13:06:32.041157 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:32.041289 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":17363,"prepare.queue_time_us":146345,"prepare.run_cpu_time_us":35,"prepare.run_wall_time_us":3243,"raft.queue_time_us":121631,"raft.run_cpu_time_us":534,"raft.run_wall_time_us":56430,"spinlock_wait_cycles":25191936,"thread_start_us":372817,"threads_started":1,"wal-append.queue_time_us":570872}
I20260709 13:06:31.990876 19485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e381f1d6b8184797ad142de49be225a8" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:06:32.056573 19485 raft_consensus.cc:3060] T e381f1d6b8184797ad142de49be225a8 P 0473d2b2d01f4459b1e90fd12cc7840e [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:06:32.047020 19404 raft_consensus.cc:2468] T 7be9efa6559648dbb5a0f7684c4542d1 P e5256d91808b47c195bc9b4dbd7f2b87 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 13.
I20260709 13:06:32.032437 24700 leader_election.cc:290] T bc225c93219c45538b53a1bd3d387e4d P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:06:32.041785 24699 leader_election.cc:290] T 65d8cb8d6ec64f459d5a47cefab10acf P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:06:32.060283 19553 raft_consensus.cc:1240] T 22196caba61445d3bec98a0aab3c337d P e61c3a8f61bb48f8a963c9480e53c168 [term 13 FOLLOWER]: Rejecting Update request from peer e5256d91808b47c195bc9b4dbd7f2b87 for earlier term 12. Current term is 13. Ops: []
I20260709 13:06:32.060911 19553 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40438 (request call id 2635) took 1065 ms. Trace:
I20260709 13:06:32.061209 19553 rpcz_store.cc:276] 0709 13:06:30.995465 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:32.059819 (+1064354us) service_pool.cc:224] Handling call
0709 13:06:32.060103 (+   284us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:32.060690 (+   587us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:32.060862 (+   172us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:32.061642 19523 leader_election.cc:304] T d1e5873a19244c5ebbcd38e126796ee7 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168; no voters: 0473d2b2d01f4459b1e90fd12cc7840e
I20260709 13:06:32.062814 19523 leader_election.cc:304] T 309c3ca0ca4b4f3ba129752ea2cb293b P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168; no voters: 127766fc592545a4997f7790f50f6076, e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:06:32.064512 19523 leader_election.cc:304] T a08760e15aac4630a629431f56024dc8 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e61c3a8f61bb48f8a963c9480e53c168; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:06:32.040477 24620 raft_consensus.cc:3060] T 3e1f505cb0f1427bbd698ac889d80821 P e5256d91808b47c195bc9b4dbd7f2b87 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:06:32.045472 24559 raft_consensus.cc:515] T 1a61655d99124a29b486ba4a5b37faea P 0473d2b2d01f4459b1e90fd12cc7840e [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:32.049124 24411 consensus_queue.cc:1048] T 65d8cb8d6ec64f459d5a47cefab10acf P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Connected to new peer: Peer: permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.005s
I20260709 13:06:32.055817 19479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff75a1d4cb1f493db8f71ddc136ba9ab" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:06:32.029765 24722 raft_consensus.cc:493] T 2725d2c4cb054f18b0fc8f735c15f6c2 P e5256d91808b47c195bc9b4dbd7f2b87 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:32.044134 24478 raft_consensus.cc:515] T 2b74109013a140ada21feeef92d6f563 P 0473d2b2d01f4459b1e90fd12cc7840e [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:32.067557 19403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "217b5fae677b4971b3bbd2f357a1f7ff" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:06:32.048447 24686 raft_consensus.cc:3060] T f93ee515a9c14139bf566522ed8232f3 P e61c3a8f61bb48f8a963c9480e53c168 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:06:32.048362 24713 raft_consensus.cc:493] T bc225c93219c45538b53a1bd3d387e4d P e5256d91808b47c195bc9b4dbd7f2b87 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:32.072145 19479 raft_consensus.cc:2376] T ff75a1d4cb1f493db8f71ddc136ba9ab P 0473d2b2d01f4459b1e90fd12cc7840e [term 15 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 15. Re-sending same reply.
I20260709 13:06:32.083818 19479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa8650e71aa14778b3d73721fc50d9fc" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:06:32.085646 19553 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40438 (request call id 2636) took 1089 ms. Trace:
I20260709 13:06:32.086117 19405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e5873a19244c5ebbcd38e126796ee7" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:06:32.086194 19553 rpcz_store.cc:276] 0709 13:06:30.995730 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:32.061928 (+1066198us) service_pool.cc:224] Handling call
0709 13:06:32.084959 (+ 23031us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:32.085211 (+   252us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:32.085252 (+    41us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:32.085320 (+    68us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:06:32.085376 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:32.085448 (+    72us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:32.085574 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:32.089169 19405 raft_consensus.cc:2393] T d1e5873a19244c5ebbcd38e126796ee7 P e5256d91808b47c195bc9b4dbd7f2b87 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0473d2b2d01f4459b1e90fd12cc7840e in current term 17: Already voted for candidate e61c3a8f61bb48f8a963c9480e53c168 in this term.
I20260709 13:06:32.071825 24665 raft_consensus.cc:2804] T d1e5873a19244c5ebbcd38e126796ee7 P e61c3a8f61bb48f8a963c9480e53c168 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:06:32.055583 24661 raft_consensus.cc:2749] T ab43d85f64114d4ebf618930e43d9ed0 P e5256d91808b47c195bc9b4dbd7f2b87 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 13:06:32.060519 24696 consensus_meta.cc:287] T e381f1d6b8184797ad142de49be225a8 P e61c3a8f61bb48f8a963c9480e53c168: Time spent flushing consensus metadata: real 0.537s	user 0.009s	sys 0.002s
I20260709 13:06:32.077244 19403 raft_consensus.cc:2468] T 217b5fae677b4971b3bbd2f357a1f7ff P e5256d91808b47c195bc9b4dbd7f2b87 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 10.
I20260709 13:06:32.082118 19484 raft_consensus.cc:1275] T 4509b76741dc428e9201c70c1658da13 P 0473d2b2d01f4459b1e90fd12cc7840e [term 10 FOLLOWER]: Refusing update from remote peer e5256d91808b47c195bc9b4dbd7f2b87: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:06:32.090822 19479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e1f505cb0f1427bbd698ac889d80821" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:06:32.055857 24680 consensus_queue.cc:1048] T 2725d2c4cb054f18b0fc8f735c15f6c2 P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.025s
I20260709 13:06:32.109908 19411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36f6ba92b9ba46babe4ebd6c02e5fbd9" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 17 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:06:32.069304 24393 raft_consensus.cc:493] T a08760e15aac4630a629431f56024dc8 P e5256d91808b47c195bc9b4dbd7f2b87 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 0473d2b2d01f4459b1e90fd12cc7840e)
I20260709 13:06:32.072046 24700 raft_consensus.cc:2749] T 309c3ca0ca4b4f3ba129752ea2cb293b P e61c3a8f61bb48f8a963c9480e53c168 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:06:32.073415 19523 leader_election.cc:304] T 46c5bfeecc314717bffe987e6844b6d0 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168; no voters: 0473d2b2d01f4459b1e90fd12cc7840e
I20260709 13:06:32.075579 24699 raft_consensus.cc:2749] T a08760e15aac4630a629431f56024dc8 P e61c3a8f61bb48f8a963c9480e53c168 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:06:32.069625 24517 leader_election.cc:290] T ece3db938bc649d4a40a51522ed5259c P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:06:32.094949 19405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "172b3dd13109415a955b71ac0e9d2234" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
I20260709 13:06:32.144980 19405 raft_consensus.cc:2368] T 172b3dd13109415a955b71ac0e9d2234 P e5256d91808b47c195bc9b4dbd7f2b87 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 0473d2b2d01f4459b1e90fd12cc7840e for earlier term 12. Current term is 13.
I20260709 13:06:32.137560 19408 raft_consensus.cc:1240] T edd7d470b5014c9489be7f41f64355c9 P e5256d91808b47c195bc9b4dbd7f2b87 [term 16 FOLLOWER]: Rejecting Update request from peer 0473d2b2d01f4459b1e90fd12cc7840e for earlier term 15. Current term is 16. Ops: [15.8-15.8]
W20260709 13:06:32.140012 19523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.1:40321, user_credentials={real_user=slave}} blocked reactor thread for 66769.8us
W20260709 13:06:32.140836 19557 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41504 (request call id 786) took 1501 ms (client timeout 1799 ms). Trace:
I20260709 13:06:32.225970 19408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dc5b3532fe54f74876d02beffa2c230" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 16 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:06:32.140460 19485 raft_consensus.cc:2468] T e381f1d6b8184797ad142de49be225a8 P 0473d2b2d01f4459b1e90fd12cc7840e [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 12.
W20260709 13:06:32.080873 24567 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.043s	user 0.005s	sys 0.024s
I20260709 13:06:32.151474 19403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28af091831594f9d8e96482078cc7625" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:06:32.116240 19404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "172b3dd13109415a955b71ac0e9d2234" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:06:32.156211 19479 raft_consensus.cc:1275] T 1a61655d99124a29b486ba4a5b37faea P 0473d2b2d01f4459b1e90fd12cc7840e [term 12 FOLLOWER]: Refusing update from remote peer e5256d91808b47c195bc9b4dbd7f2b87: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:06:32.156906 19484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cdf56e38bbc453d9438d359e5a69955" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:06:32.230831 19523 leader_election.cc:400] T 85c494af21f9457a85da47b9bc70c1fd P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 13 election: Vote denied by peer e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321) with higher term. Message: Invalid argument: T 85c494af21f9457a85da47b9bc70c1fd P e5256d91808b47c195bc9b4dbd7f2b87 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate e61c3a8f61bb48f8a963c9480e53c168 for earlier term 13. Current term is 14.
I20260709 13:06:32.231132 19523 leader_election.cc:403] T 85c494af21f9457a85da47b9bc70c1fd P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 13 election: Cancelling election due to peer responding with higher term
I20260709 13:06:32.231485 19404 raft_consensus.cc:2368] T 172b3dd13109415a955b71ac0e9d2234 P e5256d91808b47c195bc9b4dbd7f2b87 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0473d2b2d01f4459b1e90fd12cc7840e for earlier term 12. Current term is 13.
I20260709 13:06:32.109052 24612 leader_election.cc:290] T ab43d85f64114d4ebf618930e43d9ed0 P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 16 election: Requested vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:06:32.215442 24482 raft_consensus.cc:493] T 14efcc79969f41babe5529c22d59156d P 127766fc592545a4997f7790f50f6076 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader e5256d91808b47c195bc9b4dbd7f2b87)
W20260709 13:06:32.229635 19374 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.4:43121, user_credentials={real_user=slave}} blocked reactor thread for 255570us
I20260709 13:06:32.111195 24720 raft_consensus.cc:493] T 1dc5b3532fe54f74876d02beffa2c230 P e5256d91808b47c195bc9b4dbd7f2b87 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:06:32.226295 19557 rpcz_store.cc:269] 0709 13:06:30.618595 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:30.618739 (+   144us) service_pool.cc:224] Handling call
0709 13:06:32.119687 (+1500948us) spinlock_profiling.cc:243] Waited 68.7 ms on lock 0x7b54002e90d4. stack: 00007f4a79de9343 00007f4a79de9240 00007f4a797781d4 00007f4a834b6304 00007f4a834b6299 00007f4a7ce71571 00007f4a7cf0c2fa 00007f4a81ecdb17 00007f4a7b4486d4 00007f4a7b448662 00007f4a7b448591 00007f4a7b44850c 00007f4a7b4477c2 00007f4a7b24348c 00007f4a7b2428c6 00007f4a7b24226f
0709 13:06:32.119780 (+    93us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":157903232}
I20260709 13:06:32.244084 19553 raft_consensus.cc:1240] T 179fd671030940b4b4a4e24bcc4aba0a P e61c3a8f61bb48f8a963c9480e53c168 [term 17 FOLLOWER]: Rejecting Update request from peer e5256d91808b47c195bc9b4dbd7f2b87 for earlier term 16. Current term is 17. Ops: []
I20260709 13:06:32.250733 19405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40e1e16737a842ee936002830f36882e" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:06:32.246153 19479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9f0d59553ad444883fcf5b5909f9798" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:06:32.107326 24662 leader_election.cc:290] T 76cb037fc9064d13b59a8969d897ce8c P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:06:32.251585 19553 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40438 (request call id 2639) took 1255 ms. Trace:
I20260709 13:06:32.079789 24722 raft_consensus.cc:515] T 2725d2c4cb054f18b0fc8f735c15f6c2 P e5256d91808b47c195bc9b4dbd7f2b87 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:32.271588 19553 rpcz_store.cc:276] 0709 13:06:30.996432 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:32.142797 (+1146365us) service_pool.cc:224] Handling call
0709 13:06:32.243859 (+101062us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:32.251269 (+  7410us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:32.251515 (+   246us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:32.272104 19523 leader_election.cc:400] T e381f1d6b8184797ad142de49be225a8 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 11 pre-election: Vote denied by peer e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321) with higher term. Message: Invalid argument: T e381f1d6b8184797ad142de49be225a8 P e5256d91808b47c195bc9b4dbd7f2b87 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e61c3a8f61bb48f8a963c9480e53c168 for earlier term 11. Current term is 12.
I20260709 13:06:32.140964 24696 raft_consensus.cc:515] T e381f1d6b8184797ad142de49be225a8 P e61c3a8f61bb48f8a963c9480e53c168 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:32.222105 24516 raft_consensus.cc:2804] T 46c5bfeecc314717bffe987e6844b6d0 P e61c3a8f61bb48f8a963c9480e53c168 [term 19 FOLLOWER]: Leader pre-election won for term 20
W20260709 13:06:32.229693 24567 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.192s	user 0.006s	sys 0.024s
I20260709 13:06:32.215792 24478 leader_election.cc:290] T 2b74109013a140ada21feeef92d6f563 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:06:32.259929 19556 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41504 (request call id 789) took 1638 ms. Trace:
I20260709 13:06:32.286181 19556 rpcz_store.cc:276] 0709 13:06:30.621472 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:30.621585 (+   113us) service_pool.cc:224] Handling call
0709 13:06:30.650117 (+ 28532us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:30.762373 (+112256us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:30.762403 (+    30us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:30.762441 (+    38us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:06:30.762471 (+    30us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:32.259669 (+1497198us) spinlock_profiling.cc:243] Waited 112 ms on lock 0x7b540012a554. stack: 00007f4a79de9343 00007f4a79de9240 00007f4a797781d4 00007f4a834b6304 00007f4a834b6299 00007f4a7ce71571 00007f4a7cf08e01 00007f4a7cf0783e 00007f4a81ecc419 00007f4a7b443bd4 00007f4a7b443b62 00007f4a7b443a91 00007f4a7b443a0c 00007f4a7b442cc2 00007f4a7b24348c 00007f4a7b2428c6
0709 13:06:32.259728 (+    59us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:32.259865 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":257745280}
I20260709 13:06:32.215310 24393 raft_consensus.cc:515] T a08760e15aac4630a629431f56024dc8 P e5256d91808b47c195bc9b4dbd7f2b87 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:32.266703 19411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e36a9d6e29c4a7c860cf267efbd4c74" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:06:32.108533 24617 leader_election.cc:290] T 14efcc79969f41babe5529c22d59156d P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:06:32.229249 24633 leader_election.cc:290] T 22196caba61445d3bec98a0aab3c337d P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 13 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:06:32.234279 24665 raft_consensus.cc:697] T d1e5873a19244c5ebbcd38e126796ee7 P e61c3a8f61bb48f8a963c9480e53c168 [term 17 LEADER]: Becoming Leader. State: Replica: e61c3a8f61bb48f8a963c9480e53c168, State: Running, Role: LEADER
I20260709 13:06:32.241726 24482 raft_consensus.cc:515] T 14efcc79969f41babe5529c22d59156d P 127766fc592545a4997f7790f50f6076 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:32.280668 19523 leader_election.cc:304] T ed7fdbcb96d14d418db9ca90a792588a P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e61c3a8f61bb48f8a963c9480e53c168; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, 127766fc592545a4997f7790f50f6076
I20260709 13:06:32.259454 24715 raft_consensus.cc:493] T 1a61655d99124a29b486ba4a5b37faea P e61c3a8f61bb48f8a963c9480e53c168 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:32.285159 20109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ece3db938bc649d4a40a51522ed5259c" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:06:32.302889 20109 raft_consensus.cc:2468] T ece3db938bc649d4a40a51522ed5259c P 127766fc592545a4997f7790f50f6076 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 10.
I20260709 13:06:32.089397 24713 raft_consensus.cc:515] T bc225c93219c45538b53a1bd3d387e4d P e5256d91808b47c195bc9b4dbd7f2b87 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:32.289119 19405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ec1c4ce15e04c7e8c283a62179f2a64" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:06:32.255405 24596 leader_election.cc:290] T 1f85fc4b527a48848e5faa083b604e36 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:06:32.250285 24699 raft_consensus.cc:2749] T 85c494af21f9457a85da47b9bc70c1fd P e61c3a8f61bb48f8a963c9480e53c168 [term 14 FOLLOWER]: Leader election lost for term 13. Reason: Vote denied by peer e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321) with higher term. Message: Invalid argument: T 85c494af21f9457a85da47b9bc70c1fd P e5256d91808b47c195bc9b4dbd7f2b87 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate e61c3a8f61bb48f8a963c9480e53c168 for earlier term 13. Current term is 14.
I20260709 13:06:32.279201 24700 consensus_queue.cc:1048] T 1dc5b3532fe54f74876d02beffa2c230 P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.021s
I20260709 13:06:32.294981 19555 raft_consensus.cc:3060] T e381f1d6b8184797ad142de49be225a8 P e61c3a8f61bb48f8a963c9480e53c168 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:06:32.299119 19557 raft_consensus.cc:1275] T ff75a1d4cb1f493db8f71ddc136ba9ab P e61c3a8f61bb48f8a963c9480e53c168 [term 15 FOLLOWER]: Refusing update from remote peer e5256d91808b47c195bc9b4dbd7f2b87: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 15 index: 8. (index mismatch)
I20260709 13:06:32.280910 24516 raft_consensus.cc:493] T 46c5bfeecc314717bffe987e6844b6d0 P e61c3a8f61bb48f8a963c9480e53c168 [term 19 FOLLOWER]: Starting leader election (detected failure of leader 0473d2b2d01f4459b1e90fd12cc7840e)
I20260709 13:06:32.303977 19403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "775c229504194560ba9589bc2199b089" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:06:32.304301 19523 leader_election.cc:304] T 7be9efa6559648dbb5a0f7684c4542d1 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: e61c3a8f61bb48f8a963c9480e53c168; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, 127766fc592545a4997f7790f50f6076
I20260709 13:06:32.290339 20108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65d8cb8d6ec64f459d5a47cefab10acf" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:06:32.255528 24720 raft_consensus.cc:515] T 1dc5b3532fe54f74876d02beffa2c230 P e5256d91808b47c195bc9b4dbd7f2b87 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:32.321792 19403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f85fc4b527a48848e5faa083b604e36" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:06:32.323213 19404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff9b0eddd810459b82d91c60777c10eb" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:06:32.316191 20108 raft_consensus.cc:2468] T 65d8cb8d6ec64f459d5a47cefab10acf P 127766fc592545a4997f7790f50f6076 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 15.
I20260709 13:06:32.290892 24507 raft_consensus.cc:515] T 46c5bfeecc314717bffe987e6844b6d0 P e5256d91808b47c195bc9b4dbd7f2b87 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:32.326938 19481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab43d85f64114d4ebf618930e43d9ed0" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:06:32.328027 19405 raft_consensus.cc:1240] T 46c5bfeecc314717bffe987e6844b6d0 P e5256d91808b47c195bc9b4dbd7f2b87 [term 20 FOLLOWER]: Rejecting Update request from peer 0473d2b2d01f4459b1e90fd12cc7840e for earlier term 19. Current term is 20. Ops: []
I20260709 13:06:32.303185 24680 raft_consensus.cc:2749] T ed7fdbcb96d14d418db9ca90a792588a P e61c3a8f61bb48f8a963c9480e53c168 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:06:32.306282 24559 leader_election.cc:290] T 1a61655d99124a29b486ba4a5b37faea P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:06:32.330899 19411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21e14947d70440f19044d8f75c31e1f9" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:06:32.317898 19523 leader_election.cc:304] T ece3db938bc649d4a40a51522ed5259c P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 127766fc592545a4997f7790f50f6076, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:06:32.337937 19555 raft_consensus.cc:2468] T e381f1d6b8184797ad142de49be225a8 P e61c3a8f61bb48f8a963c9480e53c168 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 12.
I20260709 13:06:32.341125 19481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "172b3dd13109415a955b71ac0e9d2234" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:06:32.341859 19481 raft_consensus.cc:3060] T 172b3dd13109415a955b71ac0e9d2234 P 0473d2b2d01f4459b1e90fd12cc7840e [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:06:32.315598 24516 raft_consensus.cc:3060] T 46c5bfeecc314717bffe987e6844b6d0 P e61c3a8f61bb48f8a963c9480e53c168 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:06:32.343564 19523 leader_election.cc:304] T 65d8cb8d6ec64f459d5a47cefab10acf P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 127766fc592545a4997f7790f50f6076, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:06:32.344082 19408 raft_consensus.cc:2468] T 1dc5b3532fe54f74876d02beffa2c230 P e5256d91808b47c195bc9b4dbd7f2b87 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 15.
I20260709 13:06:32.313920 24551 leader_election.cc:290] T 76cb037fc9064d13b59a8969d897ce8c P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:06:32.342724 24699 raft_consensus.cc:2804] T ece3db938bc649d4a40a51522ed5259c P e61c3a8f61bb48f8a963c9480e53c168 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:06:32.351166 24699 raft_consensus.cc:493] T ece3db938bc649d4a40a51522ed5259c P e61c3a8f61bb48f8a963c9480e53c168 [term 10 FOLLOWER]: Starting leader election (detected failure of leader e5256d91808b47c195bc9b4dbd7f2b87)
I20260709 13:06:32.351531 24699 raft_consensus.cc:3060] T ece3db938bc649d4a40a51522ed5259c P e61c3a8f61bb48f8a963c9480e53c168 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:06:32.352178 24722 leader_election.cc:290] T 2725d2c4cb054f18b0fc8f735c15f6c2 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:06:32.304814 24715 raft_consensus.cc:515] T 1a61655d99124a29b486ba4a5b37faea P e61c3a8f61bb48f8a963c9480e53c168 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:32.356067 24680 raft_consensus.cc:493] T 0e1085d23e8347fbbd5bce7542f4b1f4 P e61c3a8f61bb48f8a963c9480e53c168 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 0473d2b2d01f4459b1e90fd12cc7840e)
I20260709 13:06:32.356608 24680 raft_consensus.cc:515] T 0e1085d23e8347fbbd5bce7542f4b1f4 P e61c3a8f61bb48f8a963c9480e53c168 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:32.357393 24715 leader_election.cc:290] T 1a61655d99124a29b486ba4a5b37faea P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:06:32.357713 24482 leader_election.cc:290] T 14efcc79969f41babe5529c22d59156d P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:06:32.329223 24517 raft_consensus.cc:2749] T 7be9efa6559648dbb5a0f7684c4542d1 P e61c3a8f61bb48f8a963c9480e53c168 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:06:32.358577 24680 leader_election.cc:290] T 0e1085d23e8347fbbd5bce7542f4b1f4 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:06:32.362815 20108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e1085d23e8347fbbd5bce7542f4b1f4" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:06:32.368707 24507 leader_election.cc:290] T 46c5bfeecc314717bffe987e6844b6d0 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 20 election: Requested vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:06:32.371061 19557 raft_consensus.cc:1275] T 1a61655d99124a29b486ba4a5b37faea P e61c3a8f61bb48f8a963c9480e53c168 [term 12 FOLLOWER]: Refusing update from remote peer e5256d91808b47c195bc9b4dbd7f2b87: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:06:32.348650 24710 leader_election.cc:290] T ff75a1d4cb1f493db8f71ddc136ba9ab P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
W20260709 13:06:32.386188 24597 consensus_meta.cc:287] T 2a16f7501e2444fb86d4e2778e734e02 P e5256d91808b47c195bc9b4dbd7f2b87: Time spent flushing consensus metadata: real 0.510s	user 0.005s	sys 0.003s
I20260709 13:06:32.388399 24713 leader_election.cc:290] T bc225c93219c45538b53a1bd3d387e4d P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:06:32.388804 19523 leader_election.cc:304] T f1b10566f45d4a7d9029858330e02d5b P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:06:32.389926 19523 leader_election.cc:304] T 2b74109013a140ada21feeef92d6f563 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:06:32.390509 24720 leader_election.cc:290] T 1dc5b3532fe54f74876d02beffa2c230 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:06:32.390868 24710 raft_consensus.cc:2804] T f1b10566f45d4a7d9029858330e02d5b P e61c3a8f61bb48f8a963c9480e53c168 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:06:32.391399 24710 raft_consensus.cc:493] T f1b10566f45d4a7d9029858330e02d5b P e61c3a8f61bb48f8a963c9480e53c168 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 0473d2b2d01f4459b1e90fd12cc7840e)
I20260709 13:06:32.391975 24710 raft_consensus.cc:3060] T f1b10566f45d4a7d9029858330e02d5b P e61c3a8f61bb48f8a963c9480e53c168 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:06:32.391496 24665 consensus_queue.cc:237] T d1e5873a19244c5ebbcd38e126796ee7 P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 14.8, Last appended by leader: 8, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:32.392232 24678 raft_consensus.cc:2804] T 2b74109013a140ada21feeef92d6f563 P e61c3a8f61bb48f8a963c9480e53c168 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:06:32.392766 24678 raft_consensus.cc:493] T 2b74109013a140ada21feeef92d6f563 P e61c3a8f61bb48f8a963c9480e53c168 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:32.393134 24678 raft_consensus.cc:3060] T 2b74109013a140ada21feeef92d6f563 P e61c3a8f61bb48f8a963c9480e53c168 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:06:32.356609 24393 leader_election.cc:290] T a08760e15aac4630a629431f56024dc8 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:06:32.415647 19523 leader_election.cc:304] T b9f0d59553ad444883fcf5b5909f9798 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:06:32.418099 19523 leader_election.cc:304] T fa8650e71aa14778b3d73721fc50d9fc P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:06:32.405112 24517 raft_consensus.cc:493] T 70797e5783b5454ab0d0eea663e791e3 P e61c3a8f61bb48f8a963c9480e53c168 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:32.421007 19404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86a6797bdfe94fa496c050ceae4bd0d9" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:06:32.421617 19404 raft_consensus.cc:2468] T 86a6797bdfe94fa496c050ceae4bd0d9 P e5256d91808b47c195bc9b4dbd7f2b87 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 10.
I20260709 13:06:32.424612 20076 leader_election.cc:304] T ece3db938bc649d4a40a51522ed5259c P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 127766fc592545a4997f7790f50f6076, e61c3a8f61bb48f8a963c9480e53c168; no voters: e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:06:32.425570 19481 raft_consensus.cc:2468] T 172b3dd13109415a955b71ac0e9d2234 P 0473d2b2d01f4459b1e90fd12cc7840e [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 127766fc592545a4997f7790f50f6076 in term 13.
I20260709 13:06:32.432768 19404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ece3db938bc649d4a40a51522ed5259c" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:06:32.418565 24676 leader_election.cc:290] T 7be9efa6559648dbb5a0f7684c4542d1 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:06:32.435716 19481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab43d85f64114d4ebf618930e43d9ed0" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:06:32.420717 24700 raft_consensus.cc:2804] T b9f0d59553ad444883fcf5b5909f9798 P e61c3a8f61bb48f8a963c9480e53c168 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:06:32.446300 19481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e36a9d6e29c4a7c860cf267efbd4c74" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:06:32.447057 19481 raft_consensus.cc:2468] T 2e36a9d6e29c4a7c860cf267efbd4c74 P 0473d2b2d01f4459b1e90fd12cc7840e [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 11.
I20260709 13:06:32.423262 24680 raft_consensus.cc:2804] T fa8650e71aa14778b3d73721fc50d9fc P e61c3a8f61bb48f8a963c9480e53c168 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:06:32.444819 19450 leader_election.cc:304] T 217b5fae677b4971b3bbd2f357a1f7ff P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:06:32.448118 19481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "172b3dd13109415a955b71ac0e9d2234" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:06:32.448732 24479 raft_consensus.cc:2804] T 217b5fae677b4971b3bbd2f357a1f7ff P 0473d2b2d01f4459b1e90fd12cc7840e [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:06:32.425997 24478 raft_consensus.cc:493] T 179fd671030940b4b4a4e24bcc4aba0a P 0473d2b2d01f4459b1e90fd12cc7840e [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:32.419091 24597 raft_consensus.cc:515] T 2a16f7501e2444fb86d4e2778e734e02 P e5256d91808b47c195bc9b4dbd7f2b87 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:32.470180 19485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab43d85f64114d4ebf618930e43d9ed0" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:06:32.471221 19485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14efcc79969f41babe5529c22d59156d" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:06:32.471293 24597 leader_election.cc:290] T 2a16f7501e2444fb86d4e2778e734e02 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 14 election: Requested vote from peers e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:06:32.432649 24422 raft_consensus.cc:493] T 7f575b143b844aa096b50997dad3516a P 0473d2b2d01f4459b1e90fd12cc7840e [term 10 FOLLOWER]: Starting pre-election (detected failure of leader e5256d91808b47c195bc9b4dbd7f2b87)
I20260709 13:06:32.472146 19485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff9b0eddd810459b82d91c60777c10eb" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:06:32.472047 24422 raft_consensus.cc:515] T 7f575b143b844aa096b50997dad3516a P 0473d2b2d01f4459b1e90fd12cc7840e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:32.472738 19485 raft_consensus.cc:2468] T ff9b0eddd810459b82d91c60777c10eb P 0473d2b2d01f4459b1e90fd12cc7840e [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 127766fc592545a4997f7790f50f6076 in term 15.
I20260709 13:06:32.473481 19485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa8650e71aa14778b3d73721fc50d9fc" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:06:32.474043 24422 leader_election.cc:290] T 7f575b143b844aa096b50997dad3516a P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:06:32.446372 24696 leader_election.cc:290] T e381f1d6b8184797ad142de49be225a8 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 11 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:06:32.474382 19485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df751f992649444090e27965eb1af85d" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:06:32.474617 24597 consensus_queue.cc:1059] T 22196caba61445d3bec98a0aab3c337d P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 }, Status: INVALID_TERM, Last received: 12.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:06:32.475620 24597 raft_consensus.cc:3055] T 22196caba61445d3bec98a0aab3c337d P e5256d91808b47c195bc9b4dbd7f2b87 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:06:32.452562 24479 raft_consensus.cc:493] T 217b5fae677b4971b3bbd2f357a1f7ff P 0473d2b2d01f4459b1e90fd12cc7840e [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:32.476231 24710 raft_consensus.cc:515] T f1b10566f45d4a7d9029858330e02d5b P e61c3a8f61bb48f8a963c9480e53c168 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:32.476953 24597 raft_consensus.cc:740] T 22196caba61445d3bec98a0aab3c337d P e5256d91808b47c195bc9b4dbd7f2b87 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: e5256d91808b47c195bc9b4dbd7f2b87, State: Running, Role: LEADER
I20260709 13:06:32.477838 24597 consensus_queue.cc:260] T 22196caba61445d3bec98a0aab3c337d P e5256d91808b47c195bc9b4dbd7f2b87 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:32.443843 24700 raft_consensus.cc:493] T b9f0d59553ad444883fcf5b5909f9798 P e61c3a8f61bb48f8a963c9480e53c168 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 0473d2b2d01f4459b1e90fd12cc7840e)
I20260709 13:06:32.480687 24700 raft_consensus.cc:3060] T b9f0d59553ad444883fcf5b5909f9798 P e61c3a8f61bb48f8a963c9480e53c168 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:06:32.482749 24686 raft_consensus.cc:515] T f93ee515a9c14139bf566522ed8232f3 P e61c3a8f61bb48f8a963c9480e53c168 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:32.484886 24686 leader_election.cc:290] T f93ee515a9c14139bf566522ed8232f3 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 16 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:06:32.426072 24517 raft_consensus.cc:515] T 70797e5783b5454ab0d0eea663e791e3 P e61c3a8f61bb48f8a963c9480e53c168 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:32.488282 24517 leader_election.cc:290] T 70797e5783b5454ab0d0eea663e791e3 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:06:32.450243 24680 raft_consensus.cc:493] T fa8650e71aa14778b3d73721fc50d9fc P e61c3a8f61bb48f8a963c9480e53c168 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 0473d2b2d01f4459b1e90fd12cc7840e)
I20260709 13:06:32.489066 24680 raft_consensus.cc:3060] T fa8650e71aa14778b3d73721fc50d9fc P e61c3a8f61bb48f8a963c9480e53c168 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:06:32.432874 24671 raft_consensus.cc:493] T ef32ce6fdd0e40d382c79974f30295c6 P 0473d2b2d01f4459b1e90fd12cc7840e [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:32.490931 24671 raft_consensus.cc:515] T ef32ce6fdd0e40d382c79974f30295c6 P 0473d2b2d01f4459b1e90fd12cc7840e [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:32.492870 24671 leader_election.cc:290] T ef32ce6fdd0e40d382c79974f30295c6 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:06:32.499171 24597 raft_consensus.cc:3060] T 22196caba61445d3bec98a0aab3c337d P e5256d91808b47c195bc9b4dbd7f2b87 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:06:32.451498 20076 leader_election.cc:304] T 65d8cb8d6ec64f459d5a47cefab10acf P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 127766fc592545a4997f7790f50f6076; no voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:06:32.465492 19407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22196caba61445d3bec98a0aab3c337d" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
I20260709 13:06:32.502537 24672 raft_consensus.cc:2749] T 65d8cb8d6ec64f459d5a47cefab10acf P 127766fc592545a4997f7790f50f6076 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:06:32.457451 24620 raft_consensus.cc:515] T 3e1f505cb0f1427bbd698ac889d80821 P e5256d91808b47c195bc9b4dbd7f2b87 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:32.467594 24478 raft_consensus.cc:515] T 179fd671030940b4b4a4e24bcc4aba0a P 0473d2b2d01f4459b1e90fd12cc7840e [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:32.475658 19485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1b10566f45d4a7d9029858330e02d5b" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:06:32.504449 19485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0afb57ae58a24a01850491d69f0213dd" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:06:32.504653 24620 leader_election.cc:290] T 3e1f505cb0f1427bbd698ac889d80821 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 16 election: Requested vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:06:32.504922 24478 leader_election.cc:290] T 179fd671030940b4b4a4e24bcc4aba0a P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:06:32.466480 19404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76cb037fc9064d13b59a8969d897ce8c" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:06:32.479878 24516 raft_consensus.cc:515] T 46c5bfeecc314717bffe987e6844b6d0 P e61c3a8f61bb48f8a963c9480e53c168 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:32.505860 19404 raft_consensus.cc:2468] T 76cb037fc9064d13b59a8969d897ce8c P e5256d91808b47c195bc9b4dbd7f2b87 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 12.
I20260709 13:06:32.506803 19404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e381f1d6b8184797ad142de49be225a8" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
I20260709 13:06:32.507447 19404 raft_consensus.cc:2368] T e381f1d6b8184797ad142de49be225a8 P e5256d91808b47c195bc9b4dbd7f2b87 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate e61c3a8f61bb48f8a963c9480e53c168 for earlier term 11. Current term is 12.
I20260709 13:06:32.507584 24516 leader_election.cc:290] T 46c5bfeecc314717bffe987e6844b6d0 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 20 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:06:32.508131 19404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14935b3ddf914369822e4a0547aaa355" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:06:32.509181 19404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff75a1d4cb1f493db8f71ddc136ba9ab" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 16 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:06:32.509727 24700 raft_consensus.cc:515] T b9f0d59553ad444883fcf5b5909f9798 P e61c3a8f61bb48f8a963c9480e53c168 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:32.510149 19404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc225c93219c45538b53a1bd3d387e4d" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:06:32.460611 24305 leader_election.cc:290] T 172b3dd13109415a955b71ac0e9d2234 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 13 election: Requested vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:06:32.505580 19485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c5eebf646ad445a9d1b1adc319d7b16" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:06:32.511586 19485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b74109013a140ada21feeef92d6f563" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:06:32.512169 19485 raft_consensus.cc:2468] T 2b74109013a140ada21feeef92d6f563 P 0473d2b2d01f4459b1e90fd12cc7840e [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 11.
I20260709 13:06:32.450764 19481 raft_consensus.cc:2376] T 172b3dd13109415a955b71ac0e9d2234 P 0473d2b2d01f4459b1e90fd12cc7840e [term 13 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 127766fc592545a4997f7790f50f6076 in term 13. Re-sending same reply.
I20260709 13:06:32.476562 24479 raft_consensus.cc:3060] T 217b5fae677b4971b3bbd2f357a1f7ff P 0473d2b2d01f4459b1e90fd12cc7840e [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:06:32.442525 24482 raft_consensus.cc:2804] T ece3db938bc649d4a40a51522ed5259c P 127766fc592545a4997f7790f50f6076 [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 13:06:32.502705 20076 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.3:36891, user_credentials={real_user=slave}} blocked reactor thread for 51270.4us
I20260709 13:06:32.488201 24699 raft_consensus.cc:515] T ece3db938bc649d4a40a51522ed5259c P e61c3a8f61bb48f8a963c9480e53c168 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:32.494217 24678 raft_consensus.cc:515] T 2b74109013a140ada21feeef92d6f563 P e61c3a8f61bb48f8a963c9480e53c168 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:32.545796 19485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4509b76741dc428e9201c70c1658da13" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
W20260709 13:06:32.547932 24702 consensus_meta.cc:287] T 40e1e16737a842ee936002830f36882e P e61c3a8f61bb48f8a963c9480e53c168: Time spent flushing consensus metadata: real 0.701s	user 0.010s	sys 0.000s
I20260709 13:06:32.548792 19559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa731b585f684a7fb2d106c50f143b83" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:06:32.524452 24482 raft_consensus.cc:493] T ece3db938bc649d4a40a51522ed5259c P 127766fc592545a4997f7790f50f6076 [term 10 FOLLOWER]: Starting leader election (detected failure of leader e5256d91808b47c195bc9b4dbd7f2b87)
I20260709 13:06:32.551115 19406 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52328 (request call id 2203) took 1905 ms. Trace:
I20260709 13:06:32.517058 24710 leader_election.cc:290] T f1b10566f45d4a7d9029858330e02d5b P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 15 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:06:32.553112 19485 raft_consensus.cc:2468] T 4509b76741dc428e9201c70c1658da13 P 0473d2b2d01f4459b1e90fd12cc7840e [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 10.
I20260709 13:06:32.555070 19406 rpcz_store.cc:276] 0709 13:06:30.645502 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:30.647284 (+  1782us) service_pool.cc:224] Handling call
0709 13:06:32.550941 (+1903657us) spinlock_profiling.cc:243] Waited 253 ms on lock 0x7b5400249354. stack: 00007f4a79de9343 00007f4a79de9240 00007f4a797781d4 00007f4a834b6304 00007f4a834b6299 00007f4a7ce71571 00007f4a7cf0c2fa 00007f4a81ecdb17 00007f4a7b4486d4 00007f4a7b448662 00007f4a7b448591 00007f4a7b44850c 00007f4a7b4477c2 00007f4a7b24348c 00007f4a7b2428c6 00007f4a7b24226f
0709 13:06:32.551037 (+    96us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":582238592}
I20260709 13:06:32.561193 24700 leader_election.cc:290] T b9f0d59553ad444883fcf5b5909f9798 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 14 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:06:32.561918 24633 raft_consensus.cc:2804] T 65d8cb8d6ec64f459d5a47cefab10acf P e61c3a8f61bb48f8a963c9480e53c168 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:06:32.564158 24633 raft_consensus.cc:493] T 65d8cb8d6ec64f459d5a47cefab10acf P e61c3a8f61bb48f8a963c9480e53c168 [term 15 FOLLOWER]: Starting leader election (detected failure of leader e5256d91808b47c195bc9b4dbd7f2b87)
I20260709 13:06:32.564694 24633 raft_consensus.cc:3060] T 65d8cb8d6ec64f459d5a47cefab10acf P e61c3a8f61bb48f8a963c9480e53c168 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:06:32.568708 24479 raft_consensus.cc:515] T 217b5fae677b4971b3bbd2f357a1f7ff P 0473d2b2d01f4459b1e90fd12cc7840e [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:32.556430 24482 raft_consensus.cc:3060] T ece3db938bc649d4a40a51522ed5259c P 127766fc592545a4997f7790f50f6076 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:06:32.558821 24680 raft_consensus.cc:515] T fa8650e71aa14778b3d73721fc50d9fc P e61c3a8f61bb48f8a963c9480e53c168 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:32.576085 19480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "172b3dd13109415a955b71ac0e9d2234" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:06:32.576520 19554 raft_consensus.cc:1240] T fa8650e71aa14778b3d73721fc50d9fc P e61c3a8f61bb48f8a963c9480e53c168 [term 14 FOLLOWER]: Rejecting Update request from peer 0473d2b2d01f4459b1e90fd12cc7840e for earlier term 13. Current term is 14. Ops: []
I20260709 13:06:32.576836 19480 raft_consensus.cc:2393] T 172b3dd13109415a955b71ac0e9d2234 P 0473d2b2d01f4459b1e90fd12cc7840e [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate e5256d91808b47c195bc9b4dbd7f2b87 in current term 13: Already voted for candidate 127766fc592545a4997f7790f50f6076 in this term.
I20260709 13:06:32.577982 24680 leader_election.cc:290] T fa8650e71aa14778b3d73721fc50d9fc P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 14 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:06:32.552191 19404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "179fd671030940b4b4a4e24bcc4aba0a" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 17 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
I20260709 13:06:32.580475 19406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a61655d99124a29b486ba4a5b37faea" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:06:32.585790 19480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28af091831594f9d8e96482078cc7625" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
W20260709 13:06:32.587019 24693 log.cc:927] Time spent T 62c6c134d3d24a1ab144dd9ee6bc3f64 P 127766fc592545a4997f7790f50f6076: Append to log took a long time: real 1.546s	user 0.001s	sys 0.016s
I20260709 13:06:32.589208 19559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28af091831594f9d8e96482078cc7625" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:06:32.589831 19559 raft_consensus.cc:2468] T 28af091831594f9d8e96482078cc7625 P e61c3a8f61bb48f8a963c9480e53c168 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 15.
I20260709 13:06:32.595625 19481 pending_rounds.cc:85] T 1dc5b3532fe54f74876d02beffa2c230 P 0473d2b2d01f4459b1e90fd12cc7840e: Aborting all ops after (but not including) 6
I20260709 13:06:32.597498 19481 pending_rounds.cc:107] T 1dc5b3532fe54f74876d02beffa2c230 P 0473d2b2d01f4459b1e90fd12cc7840e: Aborting uncommitted NO_OP operation due to leader change: 14.7
I20260709 13:06:32.598449 19481 raft_consensus.cc:2889] T 1dc5b3532fe54f74876d02beffa2c230 P 0473d2b2d01f4459b1e90fd12cc7840e [term 15 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:06:32.599727 19406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65d8cb8d6ec64f459d5a47cefab10acf" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:06:32.602336 19553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab43d85f64114d4ebf618930e43d9ed0" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:06:32.604507 19480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cdf56e38bbc453d9438d359e5a69955" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
W20260709 13:06:32.605842 19450 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.3:36891, user_credentials={real_user=slave}} blocked reactor thread for 157611us
I20260709 13:06:32.630194 19559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b74109013a140ada21feeef92d6f563" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:06:32.557696 24702 raft_consensus.cc:515] T 40e1e16737a842ee936002830f36882e P e61c3a8f61bb48f8a963c9480e53c168 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:32.631309 19559 raft_consensus.cc:2393] T 2b74109013a140ada21feeef92d6f563 P e61c3a8f61bb48f8a963c9480e53c168 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0473d2b2d01f4459b1e90fd12cc7840e in current term 12: Already voted for candidate e61c3a8f61bb48f8a963c9480e53c168 in this term.
I20260709 13:06:32.601006 24479 leader_election.cc:290] T 217b5fae677b4971b3bbd2f357a1f7ff P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 12 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:06:32.634886 19480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9f0d59553ad444883fcf5b5909f9798" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
W20260709 13:06:32.605170 24645 consensus_meta.cc:287] T 0cdf56e38bbc453d9438d359e5a69955 P e5256d91808b47c195bc9b4dbd7f2b87: Time spent flushing consensus metadata: real 0.623s	user 0.007s	sys 0.003s
I20260709 13:06:32.636312 20106 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46436 (request call id 800) took 1881 ms. Trace:
W20260709 13:06:32.641011 19560 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41504 (request call id 788) took 2020 ms (client timeout 1616 ms). Trace:
I20260709 13:06:32.641258 19551 raft_consensus.cc:1275] T fa731b585f684a7fb2d106c50f143b83 P e61c3a8f61bb48f8a963c9480e53c168 [term 12 FOLLOWER]: Refusing update from remote peer 127766fc592545a4997f7790f50f6076: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:06:32.640066 19450 leader_election.cc:304] T 28af091831594f9d8e96482078cc7625 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:06:32.753557 19479 raft_consensus.cc:1240] T 6c5eebf646ad445a9d1b1adc319d7b16 P 0473d2b2d01f4459b1e90fd12cc7840e [term 14 LEADER]: Rejecting Update request from peer 127766fc592545a4997f7790f50f6076 for earlier term 13. Current term is 14. Ops: []
W20260709 13:06:32.758234 19450 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.3:36891, user_credentials={real_user=slave}} blocked reactor thread for 118242us
I20260709 13:06:32.636799 20106 rpcz_store.cc:276] 0709 13:06:30.755385 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:30.756800 (+  1415us) service_pool.cc:224] Handling call
0709 13:06:30.757116 (+   316us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:30.757501 (+   385us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:30.757528 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:30.757962 (+   434us) log.cc:844] Serialized 26 byte log entry
0709 13:06:30.955180 (+197218us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:06:30.955220 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:30.955281 (+    61us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:32.584150 (+1628869us) spinlock_profiling.cc:243] Waited 16.3 ms on lock 0x7b4400022b4c. stack: 00007f4a79de9343 00007f4a79de9240 00007f4a797781d4 00007f4a834b6304 00007f4a834b6299 00007f4a79ca3db1 00007f4a79d41c85 00007f4a79d426a2 00007f4a7cab41db 00007f4a7caafaaf 00007f4a7caa386e 00007f4a7caa2bb6 00007f4a7caa27d8 00007f4a7caac221 00007f4a7caac1d9 00007f4a7caac169
0709 13:06:32.634065 (+ 49915us) raft_consensus.cc:1685] finished
0709 13:06:32.634084 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:32.636232 (+  2148us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":2673,"raft.run_cpu_time_us":73,"raft.run_wall_time_us":74,"spinlock_wait_cycles":37593344,"thread_start_us":196842,"threads_started":1,"wal-append.queue_time_us":275524}
I20260709 13:06:32.759752 19480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "179fd671030940b4b4a4e24bcc4aba0a" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 17 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:06:32.656406 19486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b74109013a140ada21feeef92d6f563" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:06:32.762770 19480 raft_consensus.cc:3060] T 179fd671030940b4b4a4e24bcc4aba0a P 0473d2b2d01f4459b1e90fd12cc7840e [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:06:32.760356 19553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1efebf73c86e432baa55533136b6e12c" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:06:32.763058 19486 raft_consensus.cc:2468] T 2b74109013a140ada21feeef92d6f563 P 0473d2b2d01f4459b1e90fd12cc7840e [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 11.
I20260709 13:06:32.763442 19553 raft_consensus.cc:2468] T 1efebf73c86e432baa55533136b6e12c P e61c3a8f61bb48f8a963c9480e53c168 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 12.
I20260709 13:06:32.717146 19483 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58286 (request call id 2258) took 1278 ms. Trace:
I20260709 13:06:32.663609 19556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dc5b3532fe54f74876d02beffa2c230" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 16 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:06:32.647143 19558 raft_consensus.cc:1240] T 40e1e16737a842ee936002830f36882e P e61c3a8f61bb48f8a963c9480e53c168 [term 16 FOLLOWER]: Rejecting Update request from peer e5256d91808b47c195bc9b4dbd7f2b87 for earlier term 15. Current term is 16. Ops: []
I20260709 13:06:32.677910 19559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40e1e16737a842ee936002830f36882e" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
W20260709 13:06:32.641386 19560 rpcz_store.cc:269] 0709 13:06:30.620212 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:30.620311 (+    99us) service_pool.cc:224] Handling call
0709 13:06:32.640829 (+2020518us) spinlock_profiling.cc:243] Waited 378 ms on lock 0x7b540032b754. stack: 00007f4a79de9343 00007f4a79de9240 00007f4a797781d4 00007f4a834b6304 00007f4a834b6299 00007f4a7ce71571 00007f4a7cf0c2fa 00007f4a81ecdb17 00007f4a7b4486d4 00007f4a7b448662 00007f4a7b448591 00007f4a7b44850c 00007f4a7b4477c2 00007f4a7b24348c 00007f4a7b2428c6 00007f4a7b24226f
0709 13:06:32.640950 (+   121us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":869122944}
I20260709 13:06:32.764077 19483 rpcz_store.cc:276] 0709 13:06:31.438495 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:31.438624 (+   129us) service_pool.cc:224] Handling call
0709 13:06:32.715957 (+1277333us) spinlock_profiling.cc:243] Waited 41.8 ms on lock 0x7b540035d9d4. stack: 00007f4a79de9343 00007f4a79de9240 00007f4a797781d4 00007f4a834b6304 00007f4a834b6299 00007f4a7ce71571 00007f4a7cf0c2fa 00007f4a81ecdb17 00007f4a7b4486d4 00007f4a7b448662 00007f4a7b448591 00007f4a7b44850c 00007f4a7b4477c2 00007f4a7b24348c 00007f4a7b2428c6 00007f4a7b24226f
0709 13:06:32.717072 (+  1115us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":96095488}
I20260709 13:06:32.772606 19407 raft_consensus.cc:2468] T 22196caba61445d3bec98a0aab3c337d P e5256d91808b47c195bc9b4dbd7f2b87 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 13.
I20260709 13:06:32.772814 19486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86a6797bdfe94fa496c050ceae4bd0d9" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:06:32.775120 20078 leader_election.cc:304] T ff9b0eddd810459b82d91c60777c10eb P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, 127766fc592545a4997f7790f50f6076; no voters: 
I20260709 13:06:32.779222 19560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21e14947d70440f19044d8f75c31e1f9" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:06:32.781332 19377 leader_election.cc:304] T 217b5fae677b4971b3bbd2f357a1f7ff P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87; no voters: e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:06:32.782330 20107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "309c3ca0ca4b4f3ba129752ea2cb293b" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:06:32.783818 19485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "309c3ca0ca4b4f3ba129752ea2cb293b" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:06:32.783324 19483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86a6797bdfe94fa496c050ceae4bd0d9" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
W20260709 13:06:32.660813 24711 log.cc:927] Time spent T df751f992649444090e27965eb1af85d P e61c3a8f61bb48f8a963c9480e53c168: Append to log took a long time: real 0.822s	user 0.000s	sys 0.012s
I20260709 13:06:32.787451 19484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46c5bfeecc314717bffe987e6844b6d0" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 20 candidate_status { last_received { term: 19 index: 9 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:06:32.788508 19484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f85fc4b527a48848e5faa083b604e36" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
W20260709 13:06:32.654716 24721 log.cc:927] Time spent T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P e5256d91808b47c195bc9b4dbd7f2b87: Append to log took a long time: real 0.410s	user 0.004s	sys 0.000s
I20260709 13:06:32.786868 19486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76cb037fc9064d13b59a8969d897ce8c" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:06:32.717474 24699 leader_election.cc:290] T ece3db938bc649d4a40a51522ed5259c P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 11 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:06:32.640151 24645 raft_consensus.cc:515] T 0cdf56e38bbc453d9438d359e5a69955 P e5256d91808b47c195bc9b4dbd7f2b87 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
W20260709 13:06:32.919194 19375 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:32.788815 19483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a08760e15aac4630a629431f56024dc8" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:06:32.815812 19480 raft_consensus.cc:2468] T 179fd671030940b4b4a4e24bcc4aba0a P 0473d2b2d01f4459b1e90fd12cc7840e [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 17.
I20260709 13:06:32.713743 24700 raft_consensus.cc:493] T 217b5fae677b4971b3bbd2f357a1f7ff P e61c3a8f61bb48f8a963c9480e53c168 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:33.340389 24700 raft_consensus.cc:515] T 217b5fae677b4971b3bbd2f357a1f7ff P e61c3a8f61bb48f8a963c9480e53c168 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:32.786885 24624 raft_consensus.cc:2804] T ff9b0eddd810459b82d91c60777c10eb P 127766fc592545a4997f7790f50f6076 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:06:32.811237 20109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7be9efa6559648dbb5a0f7684c4542d1" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
W20260709 13:06:33.342775 19377 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.2:46257, user_credentials={real_user=slave}} blocked reactor thread for 561468us
I20260709 13:06:33.349046 20109 raft_consensus.cc:2468] T 7be9efa6559648dbb5a0f7684c4542d1 P 127766fc592545a4997f7790f50f6076 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 13.
I20260709 13:06:32.940846 19478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edd7d470b5014c9489be7f41f64355c9" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 16 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:06:32.887547 19552 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40428 (request call id 2837) took 2041 ms. Trace:
I20260709 13:06:33.377605 19552 rpcz_store.cc:276] 0709 13:06:30.846268 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:30.846387 (+   119us) service_pool.cc:224] Handling call
0709 13:06:30.864079 (+ 17692us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:31.024330 (+160251us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:31.024378 (+    48us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:31.032648 (+  8270us) log.cc:844] Serialized 26 byte log entry
0709 13:06:31.644651 (+612003us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:06:31.644698 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:31.713575 (+ 68877us) spinlock_profiling.cc:243] Waited 154 ms on lock 0x7b54002f12d4. stack: 00007f4a79de9343 00007f4a79de9240 00007f4a797781d4 00007f4a834b6304 00007f4a834b6299 00007f4a7ce71571 00007f4a7cf08e01 00007f4a7cf0783e 00007f4a81ecc419 00007f4a7b443bd4 00007f4a7b443b62 00007f4a7b443a91 00007f4a7b443a0c 00007f4a7b442cc2 00007f4a7b24348c 00007f4a7b2428c6
0709 13:06:31.713634 (+    59us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:32.660222 (+946588us) spinlock_profiling.cc:243] Waited 34.5 ms on lock 0x7b4400022b4c. stack: 00007f4a79de9343 00007f4a79de9240 00007f4a797781d4 00007f4a834b6304 00007f4a834b6299 00007f4a79ca3db1 00007f4a79d41c85 00007f4a79d426a2 00007f4a7cab41db 00007f4a7caafaaf 00007f4a7caa386e 00007f4a7caa2bb6 00007f4a7caa27d8 00007f4a7caac221 00007f4a7caac1d9 00007f4a7caac169
0709 13:06:32.887325 (+227103us) raft_consensus.cc:1685] finished
0709 13:06:32.887348 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:32.887477 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":98287,"raft.queue_time_us":6419,"raft.run_cpu_time_us":218,"raft.run_wall_time_us":11204,"spinlock_wait_cycles":433872128,"thread_start_us":478981,"threads_started":1,"wal-append.queue_time_us":696698}
I20260709 13:06:32.782405 24661 raft_consensus.cc:493] T 9962423cb4e54fcfa5de01daf68a86e7 P e5256d91808b47c195bc9b4dbd7f2b87 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:32.869624 24559 raft_consensus.cc:493] T 2725d2c4cb054f18b0fc8f735c15f6c2 P 0473d2b2d01f4459b1e90fd12cc7840e [term 17 FOLLOWER]: Starting pre-election (detected failure of leader e61c3a8f61bb48f8a963c9480e53c168)
I20260709 13:06:32.950269 19555 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40438 (request call id 2646) took 1412 ms. Trace:
I20260709 13:06:32.785226 24734 raft_consensus.cc:2804] T 28af091831594f9d8e96482078cc7625 P 0473d2b2d01f4459b1e90fd12cc7840e [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:06:33.400235 19555 rpcz_store.cc:276] 0709 13:06:31.537449 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:31.726820 (+189371us) service_pool.cc:224] Handling call
0709 13:06:32.950054 (+1223234us) spinlock_profiling.cc:243] Waited 538 ms on lock 0x7b540009c9d4. stack: 00007f4a79de9343 00007f4a79de9240 00007f4a797781d4 00007f4a834b6304 00007f4a834b6299 00007f4a7ce71571 00007f4a7cf0c2fa 00007f4a81ecdb17 00007f4a7b4486d4 00007f4a7b448662 00007f4a7b448591 00007f4a7b44850c 00007f4a7b4477c2 00007f4a7b24348c 00007f4a7b2428c6 00007f4a7b24226f
0709 13:06:32.950189 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1236973440}
I20260709 13:06:32.870345 24551 raft_consensus.cc:2804] T 217b5fae677b4971b3bbd2f357a1f7ff P e5256d91808b47c195bc9b4dbd7f2b87 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:06:32.856413 20105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a16f7501e2444fb86d4e2778e734e02" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076"
I20260709 13:06:32.677063 24482 raft_consensus.cc:515] T ece3db938bc649d4a40a51522ed5259c P 127766fc592545a4997f7790f50f6076 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:32.832821 24687 leader_election.cc:290] T 14935b3ddf914369822e4a0547aaa355 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:06:33.358959 24545 raft_consensus.cc:493] T 833a2f0775ed407a94b8924ce50adb63 P e61c3a8f61bb48f8a963c9480e53c168 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 127766fc592545a4997f7790f50f6076)
W20260709 13:06:33.072340 24735 log.cc:927] Time spent T d1e5873a19244c5ebbcd38e126796ee7 P e61c3a8f61bb48f8a963c9480e53c168: Append to log took a long time: real 0.165s	user 0.000s	sys 0.000s
I20260709 13:06:32.937718 18300 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 13:06:33.361968 19404 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.514s	user 0.002s	sys 0.002s
I20260709 13:06:33.363310 19409 raft_consensus.cc:2393] T 0cdf56e38bbc453d9438d359e5a69955 P e5256d91808b47c195bc9b4dbd7f2b87 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e61c3a8f61bb48f8a963c9480e53c168 in current term 15: Already voted for candidate e5256d91808b47c195bc9b4dbd7f2b87 in this term.
I20260709 13:06:33.363772 24457 raft_consensus.cc:493] T d1e5873a19244c5ebbcd38e126796ee7 P e5256d91808b47c195bc9b4dbd7f2b87 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:33.364684 24678 leader_election.cc:290] T 2b74109013a140ada21feeef92d6f563 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 12 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
W20260709 13:06:33.032315 24740 log.cc:927] Time spent T 2725d2c4cb054f18b0fc8f735c15f6c2 P e5256d91808b47c195bc9b4dbd7f2b87: Append to log took a long time: real 0.198s	user 0.000s	sys 0.001s
I20260709 13:06:33.365414 19485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7be9efa6559648dbb5a0f7684c4542d1" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:06:32.812034 20110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f85fc4b527a48848e5faa083b604e36" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
W20260709 13:06:33.369297 20075 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:32.863855 19553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e36a9d6e29c4a7c860cf267efbd4c74" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:06:32.782269 24682 raft_consensus.cc:493] T df751f992649444090e27965eb1af85d P e5256d91808b47c195bc9b4dbd7f2b87 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 0473d2b2d01f4459b1e90fd12cc7840e)
I20260709 13:06:32.943782 19554 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40428 (request call id 2844) took 2082 ms. Trace:
I20260709 13:06:33.380422 19377 leader_election.cc:304] T f93ee515a9c14139bf566522ed8232f3 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:06:33.434760 19485 raft_consensus.cc:1275] T ef32ce6fdd0e40d382c79974f30295c6 P 0473d2b2d01f4459b1e90fd12cc7840e [term 17 FOLLOWER]: Refusing update from remote peer e5256d91808b47c195bc9b4dbd7f2b87: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
I20260709 13:06:32.941988 19551 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41504 (request call id 796) took 2181 ms. Trace:
I20260709 13:06:33.435295 19551 rpcz_store.cc:276] 0709 13:06:30.760222 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:30.760348 (+   126us) service_pool.cc:224] Handling call
0709 13:06:32.640953 (+1880605us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:32.758146 (+117193us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:32.941743 (+183597us) spinlock_profiling.cc:243] Waited 1.88 s on lock 0x7b540032b750. stack: 00007f4a79de9343 00007f4a79de9240 00007f4a797781d4 00007f4a834b6304 00007f4a834b6299 00007f4a7ce71571 00007f4a7cf078ad 00007f4a81ecc419 00007f4a7b443bd4 00007f4a7b443b62 00007f4a7b443a91 00007f4a7b443a0c 00007f4a7b442cc2 00007f4a7b24348c 00007f4a7b2428c6 00007f4a7b24226f
0709 13:06:32.941900 (+   157us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4324240768}
I20260709 13:06:33.384390 19480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2725d2c4cb054f18b0fc8f735c15f6c2" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 18 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:06:33.384806 19484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc225c93219c45538b53a1bd3d387e4d" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:06:32.951020 19477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46c5bfeecc314717bffe987e6844b6d0" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 20 candidate_status { last_received { term: 19 index: 9 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:06:33.437099 19477 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58294 (request call id 2473) took 1447 ms. Trace:
I20260709 13:06:33.437454 19477 rpcz_store.cc:276] 0709 13:06:31.989872 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:31.991686 (+  1814us) service_pool.cc:224] Handling call
0709 13:06:32.950835 (+959149us) spinlock_profiling.cc:243] Waited 3.63 ms on lock 0x7b58001b9998. stack: 00007f4a79de9343 00007f4a79de9240 00007f4a797781d4 00007f4a834b6304 00007f4a834b6299 00007f4a79ca3db1 00007f4a79de3b71 00007f4a79de3a22 00007f4a82cfcc09 00007f4a81e56ee0 00007f4a81f200ab 00007f4a81f20131 00007f4a81ece0a0 00007f4a81ecd984 00007f4a7b4486d4 00007f4a7b448662
0709 13:06:33.437044 (+486209us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":8344448}
I20260709 13:06:33.399667 24643 raft_consensus.cc:493] T 833a2f0775ed407a94b8924ce50adb63 P e5256d91808b47c195bc9b4dbd7f2b87 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 127766fc592545a4997f7790f50f6076)
I20260709 13:06:33.389062 19478 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58294 (request call id 2468) took 1400 ms. Trace:
I20260709 13:06:32.682964 24422 raft_consensus.cc:2955] T ab43d85f64114d4ebf618930e43d9ed0 P 0473d2b2d01f4459b1e90fd12cc7840e [term 15 LEADER]: Committing config change with OpId 14.9: config changed from index 5 to 9, VOTER e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1) evicted. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } } }
I20260709 13:06:33.052663 24610 raft_consensus.cc:493] T 48824d5acfbc485ebf8c2d944e7202de P 127766fc592545a4997f7790f50f6076 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 0473d2b2d01f4459b1e90fd12cc7840e)
I20260709 13:06:33.413188 19483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14935b3ddf914369822e4a0547aaa355" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:06:32.812368 24595 raft_consensus.cc:493] T 85c494af21f9457a85da47b9bc70c1fd P e5256d91808b47c195bc9b4dbd7f2b87 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:33.417215 19555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef32ce6fdd0e40d382c79974f30295c6" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 18 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:06:33.448014 19555 raft_consensus.cc:2468] T ef32ce6fdd0e40d382c79974f30295c6 P e61c3a8f61bb48f8a963c9480e53c168 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 17.
I20260709 13:06:33.403283 24734 raft_consensus.cc:493] T 28af091831594f9d8e96482078cc7625 P 0473d2b2d01f4459b1e90fd12cc7840e [term 15 FOLLOWER]: Starting leader election (detected failure of leader e5256d91808b47c195bc9b4dbd7f2b87)
I20260709 13:06:33.449231 19555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f575b143b844aa096b50997dad3516a" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
W20260709 13:06:33.418350 19404 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.605s	user 0.003s	sys 0.002s
I20260709 13:06:33.439968 19553 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40428 (request call id 2855) took 1008 ms. Trace:
W20260709 13:06:33.431095 24478 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.573s	user 0.001s	sys 0.018s
I20260709 13:06:33.450441 19553 rpcz_store.cc:276] 0709 13:06:32.431827 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:32.788345 (+356518us) service_pool.cc:224] Handling call
0709 13:06:33.439909 (+651564us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:06:33.450763 24478 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.604s	user 0.002s	sys 0.018s
I20260709 13:06:33.451540 19553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a61655d99124a29b486ba4a5b37faea" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:06:33.403890 24551 raft_consensus.cc:493] T 217b5fae677b4971b3bbd2f357a1f7ff P e5256d91808b47c195bc9b4dbd7f2b87 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 0473d2b2d01f4459b1e90fd12cc7840e)
I20260709 13:06:33.414170 24466 raft_consensus.cc:493] T 9962423cb4e54fcfa5de01daf68a86e7 P 0473d2b2d01f4459b1e90fd12cc7840e [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:33.443233 20106 raft_consensus.cc:1240] T ece3db938bc649d4a40a51522ed5259c P 127766fc592545a4997f7790f50f6076 [term 11 FOLLOWER]: Rejecting Update request from peer e5256d91808b47c195bc9b4dbd7f2b87 for earlier term 10. Current term is 11. Ops: []
W20260709 13:06:33.443969 20075 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:33.434429 19554 rpcz_store.cc:276] 0709 13:06:30.863040 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:31.777571 (+914531us) service_pool.cc:224] Handling call
0709 13:06:32.548188 (+770617us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:32.576886 (+ 28698us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:32.578506 (+  1620us) spinlock_profiling.cc:243] Waited 28.1 ms on lock 0x7b54002e8bd4. stack: 00007f4a79de9343 00007f4a79de9240 00007f4a797781d4 00007f4a834b6304 00007f4a834b6299 00007f4a7ce71571 00007f4a7cf08e01 00007f4a7cf0783e 00007f4a81ecc419 00007f4a7b443bd4 00007f4a7b443b62 00007f4a7b443a91 00007f4a7b443a0c 00007f4a7b442cc2 00007f4a7b24348c 00007f4a7b2428c6
0709 13:06:32.943581 (+365075us) spinlock_profiling.cc:243] Waited 720 ms on lock 0x7b54002e8bd0. stack: 00007f4a79de9343 00007f4a79de9240 00007f4a797781d4 00007f4a834b6304 00007f4a834b6299 00007f4a7ce71571 00007f4a7cf078ad 00007f4a81ecc419 00007f4a7b443bd4 00007f4a7b443b62 00007f4a7b443a91 00007f4a7b443a0c 00007f4a7b442cc2 00007f4a7b24348c 00007f4a7b2428c6 00007f4a7b24226f
0709 13:06:32.943721 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1720021120}
I20260709 13:06:33.438413 19478 rpcz_store.cc:276] 0709 13:06:31.988480 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:31.991073 (+  2593us) service_pool.cc:224] Handling call
0709 13:06:32.940661 (+949588us) spinlock_profiling.cc:243] Waited 3.66 ms on lock 0x7b58001b9998. stack: 00007f4a79de9343 00007f4a79de9240 00007f4a797781d4 00007f4a834b6304 00007f4a834b6299 00007f4a79ca3db1 00007f4a79de3b71 00007f4a79de3a22 00007f4a82cfcc09 00007f4a81e56ee0 00007f4a81f200ab 00007f4a81f20131 00007f4a81ece0a0 00007f4a81ecd984 00007f4a7b4486d4 00007f4a7b448662
0709 13:06:33.388966 (+448305us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":8408960}
I20260709 13:06:33.445261 19552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "179fd671030940b4b4a4e24bcc4aba0a" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 17 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:06:32.924093 24633 raft_consensus.cc:515] T 65d8cb8d6ec64f459d5a47cefab10acf P e61c3a8f61bb48f8a963c9480e53c168 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:32.882200 24394 consensus_queue.cc:1059] T 179fd671030940b4b4a4e24bcc4aba0a P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.550s
I20260709 13:06:33.375571 24624 raft_consensus.cc:493] T ff9b0eddd810459b82d91c60777c10eb P 127766fc592545a4997f7790f50f6076 [term 15 FOLLOWER]: Starting leader election (detected failure of leader e5256d91808b47c195bc9b4dbd7f2b87)
I20260709 13:06:33.457368 19552 raft_consensus.cc:2393] T 179fd671030940b4b4a4e24bcc4aba0a P e61c3a8f61bb48f8a963c9480e53c168 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0473d2b2d01f4459b1e90fd12cc7840e in current term 17: Already voted for candidate e61c3a8f61bb48f8a963c9480e53c168 in this term.
I20260709 13:06:33.399454 24555 consensus_queue.cc:1048] T ff75a1d4cb1f493db8f71ddc136ba9ab P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.043s
I20260709 13:06:33.409078 24559 raft_consensus.cc:515] T 2725d2c4cb054f18b0fc8f735c15f6c2 P 0473d2b2d01f4459b1e90fd12cc7840e [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:33.403836 24661 raft_consensus.cc:515] T 9962423cb4e54fcfa5de01daf68a86e7 P e5256d91808b47c195bc9b4dbd7f2b87 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:33.467331 19411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14efcc79969f41babe5529c22d59156d" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:06:33.455088 24678 raft_consensus.cc:493] T fa731b585f684a7fb2d106c50f143b83 P e61c3a8f61bb48f8a963c9480e53c168 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:33.455381 24551 raft_consensus.cc:3060] T 217b5fae677b4971b3bbd2f357a1f7ff P e5256d91808b47c195bc9b4dbd7f2b87 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:06:33.470815 19554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76cb037fc9064d13b59a8969d897ce8c" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:06:33.473138 19554 raft_consensus.cc:2468] T 76cb037fc9064d13b59a8969d897ce8c P e61c3a8f61bb48f8a963c9480e53c168 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 12.
I20260709 13:06:33.430115 24545 raft_consensus.cc:515] T 833a2f0775ed407a94b8924ce50adb63 P e61c3a8f61bb48f8a963c9480e53c168 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:33.455760 24734 raft_consensus.cc:3060] T 28af091831594f9d8e96482078cc7625 P 0473d2b2d01f4459b1e90fd12cc7840e [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:06:33.443069 24682 raft_consensus.cc:515] T df751f992649444090e27965eb1af85d P e5256d91808b47c195bc9b4dbd7f2b87 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:33.475274 19554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "309c3ca0ca4b4f3ba129752ea2cb293b" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:06:33.480939 19552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46c5bfeecc314717bffe987e6844b6d0" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 20 candidate_status { last_received { term: 19 index: 9 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:06:33.481488 19554 raft_consensus.cc:2468] T 309c3ca0ca4b4f3ba129752ea2cb293b P e61c3a8f61bb48f8a963c9480e53c168 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 9.
I20260709 13:06:33.481791 19552 raft_consensus.cc:2393] T 46c5bfeecc314717bffe987e6844b6d0 P e61c3a8f61bb48f8a963c9480e53c168 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate e5256d91808b47c195bc9b4dbd7f2b87 in current term 20: Already voted for candidate e61c3a8f61bb48f8a963c9480e53c168 in this term.
W20260709 13:06:33.476074 24739 log.cc:927] Time spent T 1dc5b3532fe54f74876d02beffa2c230 P 0473d2b2d01f4459b1e90fd12cc7840e: Append to log took a long time: real 0.177s	user 0.000s	sys 0.001s
I20260709 13:06:33.439374 24457 raft_consensus.cc:515] T d1e5873a19244c5ebbcd38e126796ee7 P e5256d91808b47c195bc9b4dbd7f2b87 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:33.479103 19480 raft_consensus.cc:2410] T 2725d2c4cb054f18b0fc8f735c15f6c2 P 0473d2b2d01f4459b1e90fd12cc7840e [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e5256d91808b47c195bc9b4dbd7f2b87 for term 18 because replica has last-logged OpId of term: 17 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 7.
I20260709 13:06:33.462831 24362 raft_consensus.cc:493] T 775c229504194560ba9589bc2199b089 P e5256d91808b47c195bc9b4dbd7f2b87 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 127766fc592545a4997f7790f50f6076)
I20260709 13:06:33.464797 24624 raft_consensus.cc:3060] T ff9b0eddd810459b82d91c60777c10eb P 127766fc592545a4997f7790f50f6076 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:06:33.465472 24597 raft_consensus.cc:2749] T f93ee515a9c14139bf566522ed8232f3 P e5256d91808b47c195bc9b4dbd7f2b87 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:06:33.449672 24643 raft_consensus.cc:515] T 833a2f0775ed407a94b8924ce50adb63 P e5256d91808b47c195bc9b4dbd7f2b87 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:33.455283 24595 raft_consensus.cc:515] T 85c494af21f9457a85da47b9bc70c1fd P e5256d91808b47c195bc9b4dbd7f2b87 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:33.498028 19554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a16f7501e2444fb86d4e2778e734e02" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:06:33.503463 19554 raft_consensus.cc:3060] T 2a16f7501e2444fb86d4e2778e734e02 P e61c3a8f61bb48f8a963c9480e53c168 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:06:33.452679 24610 raft_consensus.cc:515] T 48824d5acfbc485ebf8c2d944e7202de P 127766fc592545a4997f7790f50f6076 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:33.459573 24466 raft_consensus.cc:515] T 9962423cb4e54fcfa5de01daf68a86e7 P 0473d2b2d01f4459b1e90fd12cc7840e [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
W20260709 13:06:33.465862 24671 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.594s	user 0.020s	sys 0.030s
I20260709 13:06:33.502203 19552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e1f505cb0f1427bbd698ac889d80821" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:06:33.508950 19552 raft_consensus.cc:3060] T 3e1f505cb0f1427bbd698ac889d80821 P e61c3a8f61bb48f8a963c9480e53c168 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:06:33.472985 24394 raft_consensus.cc:493] T 14935b3ddf914369822e4a0547aaa355 P e5256d91808b47c195bc9b4dbd7f2b87 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 127766fc592545a4997f7790f50f6076)
W20260709 13:06:33.505962 19377 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.2:46257, user_credentials={real_user=slave}} blocked reactor thread for 125635us
I20260709 13:06:33.510746 19405 raft_consensus.cc:1275] T 85c494af21f9457a85da47b9bc70c1fd P e5256d91808b47c195bc9b4dbd7f2b87 [term 14 FOLLOWER]: Refusing update from remote peer 127766fc592545a4997f7790f50f6076: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 13:06:33.514457 19481 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58286 (request call id 2260) took 1086 ms. Trace:
I20260709 13:06:33.514887 19481 rpcz_store.cc:276] 0709 13:06:32.428499 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:32.525767 (+ 97268us) service_pool.cc:224] Handling call
0709 13:06:32.595419 (+ 69652us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:06:32.608345 (+ 12926us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:32.608374 (+    29us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:06:32.609119 (+   745us) log.cc:844] Serialized 52 byte log entry
0709 13:06:32.810135 (+201016us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:06:32.810194 (+    59us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:32.810287 (+    93us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:33.514236 (+703949us) raft_consensus.cc:1685] finished
0709 13:06:33.514258 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:33.514397 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":21486,"raft.run_cpu_time_us":87,"raft.run_wall_time_us":2516,"thread_start_us":173424,"threads_started":1,"wal-append.queue_time_us":584984}
I20260709 13:06:33.517647 24545 leader_election.cc:290] T 833a2f0775ed407a94b8924ce50adb63 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:06:33.519228 24559 leader_election.cc:290] T 2725d2c4cb054f18b0fc8f735c15f6c2 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:06:33.519881 24645 leader_election.cc:290] T 0cdf56e38bbc453d9438d359e5a69955 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 15 election: Requested vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:06:33.521209 24482 leader_election.cc:290] T ece3db938bc649d4a40a51522ed5259c P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 11 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:06:33.522342 24394 raft_consensus.cc:515] T 14935b3ddf914369822e4a0547aaa355 P e5256d91808b47c195bc9b4dbd7f2b87 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } attrs { replace: true } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:33.525290 24394 leader_election.cc:290] T 14935b3ddf914369822e4a0547aaa355 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:06:33.535281 24555 raft_consensus.cc:3055] T 179fd671030940b4b4a4e24bcc4aba0a P e5256d91808b47c195bc9b4dbd7f2b87 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:06:33.535760 24555 raft_consensus.cc:740] T 179fd671030940b4b4a4e24bcc4aba0a P e5256d91808b47c195bc9b4dbd7f2b87 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: e5256d91808b47c195bc9b4dbd7f2b87, State: Running, Role: LEADER
I20260709 13:06:33.536597 24555 consensus_queue.cc:260] T 179fd671030940b4b4a4e24bcc4aba0a P e5256d91808b47c195bc9b4dbd7f2b87 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 16.10, Last appended by leader: 10, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:33.537350 24645 raft_consensus.cc:493] T 4af19371ea874c09a0a2147040835cbb P e5256d91808b47c195bc9b4dbd7f2b87 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 127766fc592545a4997f7790f50f6076)
I20260709 13:06:33.537947 24555 raft_consensus.cc:3060] T 179fd671030940b4b4a4e24bcc4aba0a P e5256d91808b47c195bc9b4dbd7f2b87 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:06:33.537874 24645 raft_consensus.cc:515] T 4af19371ea874c09a0a2147040835cbb P e5256d91808b47c195bc9b4dbd7f2b87 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:33.539952 24661 leader_election.cc:290] T 9962423cb4e54fcfa5de01daf68a86e7 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:06:33.540758 24661 consensus_queue.cc:1048] T 4509b76741dc428e9201c70c1658da13 P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:06:33.541397 24394 consensus_queue.cc:1048] T 1a61655d99124a29b486ba4a5b37faea P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:06:33.540954 24645 leader_election.cc:290] T 4af19371ea874c09a0a2147040835cbb P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:06:33.543706 24595 leader_election.cc:290] T 85c494af21f9457a85da47b9bc70c1fd P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:06:33.479805 24678 raft_consensus.cc:515] T fa731b585f684a7fb2d106c50f143b83 P e61c3a8f61bb48f8a963c9480e53c168 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
W20260709 13:06:33.547443 24671 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.683s	user 0.020s	sys 0.030s
W20260709 13:06:33.578836 19375 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.3:36891, user_credentials={real_user=slave}} blocked reactor thread for 179644us
I20260709 13:06:33.579150 19551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "217b5fae677b4971b3bbd2f357a1f7ff" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:06:33.579931 19551 raft_consensus.cc:3060] T 217b5fae677b4971b3bbd2f357a1f7ff P e61c3a8f61bb48f8a963c9480e53c168 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:06:33.501678 24362 raft_consensus.cc:515] T 775c229504194560ba9589bc2199b089 P e5256d91808b47c195bc9b4dbd7f2b87 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:33.578729 24482 raft_consensus.cc:493] T 96efeaaf1057492490e9a621f37e1a2d P 127766fc592545a4997f7790f50f6076 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 0473d2b2d01f4459b1e90fd12cc7840e)
I20260709 13:06:33.587123 24482 raft_consensus.cc:515] T 96efeaaf1057492490e9a621f37e1a2d P 127766fc592545a4997f7790f50f6076 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
W20260709 13:06:33.588565 20076 leader_election.cc:336] T fa731b585f684a7fb2d106c50f143b83 P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 12 election: RPC error from VoteRequest() call to peer e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891): Timed out: RequestConsensusVote RPC to 127.17.223.3:36891 timed out after 1.616s (SENT)
I20260709 13:06:33.589200 19554 raft_consensus.cc:2468] T 2a16f7501e2444fb86d4e2778e734e02 P e61c3a8f61bb48f8a963c9480e53c168 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 14.
I20260709 13:06:33.589324 19410 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49050 (request call id 957) took 1688 ms. Trace:
I20260709 13:06:33.559769 24750 raft_consensus.cc:493] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P e5256d91808b47c195bc9b4dbd7f2b87 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 127766fc592545a4997f7790f50f6076)
I20260709 13:06:33.590234 19552 raft_consensus.cc:2468] T 3e1f505cb0f1427bbd698ac889d80821 P e61c3a8f61bb48f8a963c9480e53c168 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 16.
I20260709 13:06:33.554546 24555 raft_consensus.cc:493] T 70797e5783b5454ab0d0eea663e791e3 P e5256d91808b47c195bc9b4dbd7f2b87 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 127766fc592545a4997f7790f50f6076)
I20260709 13:06:33.565794 24702 leader_election.cc:290] T 40e1e16737a842ee936002830f36882e P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 16 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:06:33.591631 19410 rpcz_store.cc:276] 0709 13:06:31.893567 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:31.894471 (+   904us) service_pool.cc:224] Handling call
0709 13:06:31.894882 (+   411us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:31.915405 (+ 20523us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:31.915433 (+    28us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:31.915484 (+    51us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:06:31.915535 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:33.582135 (+1666600us) spinlock_profiling.cc:243] Waited 20.3 ms on lock 0x7b5400195854. stack: 00007f4a79de9343 00007f4a79de9240 00007f4a797781d4 00007f4a834b6304 00007f4a834b6299 00007f4a7ce71571 00007f4a7cf08e01 00007f4a7cf0783e 00007f4a81ecc419 00007f4a7b443bd4 00007f4a7b443b62 00007f4a7b443a91 00007f4a7b443a0c 00007f4a7b442cc2 00007f4a7b24348c 00007f4a7b2428c6
0709 13:06:33.582184 (+    49us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:33.582310 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":46758272}
I20260709 13:06:33.582036 24643 leader_election.cc:290] T 833a2f0775ed407a94b8924ce50adb63 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:06:33.598625 19375 leader_election.cc:304] T fa8650e71aa14778b3d73721fc50d9fc P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168; no voters: 0473d2b2d01f4459b1e90fd12cc7840e
W20260709 13:06:33.598762 19377 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.2:46257, user_credentials={real_user=slave}} blocked reactor thread for 61804.3us
I20260709 13:06:33.606163 19403 raft_consensus.cc:1240] T 2a16f7501e2444fb86d4e2778e734e02 P e5256d91808b47c195bc9b4dbd7f2b87 [term 14 FOLLOWER]: Rejecting Update request from peer 127766fc592545a4997f7790f50f6076 for earlier term 13. Current term is 14. Ops: []
I20260709 13:06:33.600023 19377 leader_election.cc:304] T e381f1d6b8184797ad142de49be225a8 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87; no voters: 
I20260709 13:06:33.608937 19554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a08760e15aac4630a629431f56024dc8" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:06:33.609288 19552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86a6797bdfe94fa496c050ceae4bd0d9" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:06:33.609642 19554 raft_consensus.cc:2468] T a08760e15aac4630a629431f56024dc8 P e61c3a8f61bb48f8a963c9480e53c168 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 17.
I20260709 13:06:33.609916 19552 raft_consensus.cc:2468] T 86a6797bdfe94fa496c050ceae4bd0d9 P e61c3a8f61bb48f8a963c9480e53c168 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 10.
I20260709 13:06:33.611449 24752 raft_consensus.cc:2804] T e381f1d6b8184797ad142de49be225a8 P e5256d91808b47c195bc9b4dbd7f2b87 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:06:33.611984 24752 raft_consensus.cc:697] T e381f1d6b8184797ad142de49be225a8 P e5256d91808b47c195bc9b4dbd7f2b87 [term 12 LEADER]: Becoming Leader. State: Replica: e5256d91808b47c195bc9b4dbd7f2b87, State: Running, Role: LEADER
I20260709 13:06:33.612838 24752 consensus_queue.cc:237] T e381f1d6b8184797ad142de49be225a8 P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:33.617460 24482 leader_election.cc:290] T 96efeaaf1057492490e9a621f37e1a2d P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:06:33.620807 19554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9f0d59553ad444883fcf5b5909f9798" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:06:33.621538 19554 raft_consensus.cc:2393] T b9f0d59553ad444883fcf5b5909f9798 P e61c3a8f61bb48f8a963c9480e53c168 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e5256d91808b47c195bc9b4dbd7f2b87 in current term 14: Already voted for candidate e61c3a8f61bb48f8a963c9480e53c168 in this term.
I20260709 13:06:33.604866 24643 raft_consensus.cc:2804] T fa8650e71aa14778b3d73721fc50d9fc P e5256d91808b47c195bc9b4dbd7f2b87 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:06:33.623054 24643 raft_consensus.cc:493] T fa8650e71aa14778b3d73721fc50d9fc P e5256d91808b47c195bc9b4dbd7f2b87 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 0473d2b2d01f4459b1e90fd12cc7840e)
I20260709 13:06:33.623461 24643 raft_consensus.cc:3060] T fa8650e71aa14778b3d73721fc50d9fc P e5256d91808b47c195bc9b4dbd7f2b87 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:06:33.623581 24702 raft_consensus.cc:493] T 62c6c134d3d24a1ab144dd9ee6bc3f64 P e61c3a8f61bb48f8a963c9480e53c168 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 0473d2b2d01f4459b1e90fd12cc7840e)
I20260709 13:06:33.624154 24702 raft_consensus.cc:515] T 62c6c134d3d24a1ab144dd9ee6bc3f64 P e61c3a8f61bb48f8a963c9480e53c168 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:33.626117 24702 leader_election.cc:290] T 62c6c134d3d24a1ab144dd9ee6bc3f64 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:06:33.629194 24551 raft_consensus.cc:515] T 217b5fae677b4971b3bbd2f357a1f7ff P e5256d91808b47c195bc9b4dbd7f2b87 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:33.630899 19554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7be9efa6559648dbb5a0f7684c4542d1" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:06:33.631505 19554 raft_consensus.cc:2468] T 7be9efa6559648dbb5a0f7684c4542d1 P e61c3a8f61bb48f8a963c9480e53c168 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 13.
I20260709 13:06:33.632707 19554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc225c93219c45538b53a1bd3d387e4d" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:06:33.633219 19554 raft_consensus.cc:2468] T bc225c93219c45538b53a1bd3d387e4d P e61c3a8f61bb48f8a963c9480e53c168 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 13.
I20260709 13:06:33.636019 19551 raft_consensus.cc:2468] T 217b5fae677b4971b3bbd2f357a1f7ff P e61c3a8f61bb48f8a963c9480e53c168 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 12.
I20260709 13:06:33.637220 19377 leader_election.cc:304] T 172b3dd13109415a955b71ac0e9d2234 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, 127766fc592545a4997f7790f50f6076
I20260709 13:06:33.599388 24555 raft_consensus.cc:515] T 70797e5783b5454ab0d0eea663e791e3 P e5256d91808b47c195bc9b4dbd7f2b87 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:33.641860 24555 leader_election.cc:290] T 70797e5783b5454ab0d0eea663e791e3 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:06:33.642812 24702 raft_consensus.cc:493] T 48824d5acfbc485ebf8c2d944e7202de P e61c3a8f61bb48f8a963c9480e53c168 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 0473d2b2d01f4459b1e90fd12cc7840e)
I20260709 13:06:33.643324 24702 raft_consensus.cc:515] T 48824d5acfbc485ebf8c2d944e7202de P e61c3a8f61bb48f8a963c9480e53c168 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:33.643536 24640 raft_consensus.cc:493] T ed7fdbcb96d14d418db9ca90a792588a P 127766fc592545a4997f7790f50f6076 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 0473d2b2d01f4459b1e90fd12cc7840e)
I20260709 13:06:33.644745 19551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2725d2c4cb054f18b0fc8f735c15f6c2" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 18 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:06:33.647245 19557 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40438 (request call id 2654) took 1885 ms. Trace:
I20260709 13:06:33.647701 19557 rpcz_store.cc:276] 0709 13:06:31.761703 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:32.315526 (+553823us) service_pool.cc:224] Handling call
0709 13:06:32.315813 (+   287us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:32.371558 (+ 55745us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:33.642570 (+1271012us) spinlock_profiling.cc:243] Waited 54.8 ms on lock 0x7b540029bdd4. stack: 00007f4a79de9343 00007f4a79de9240 00007f4a797781d4 00007f4a834b6304 00007f4a834b6299 00007f4a7ce71571 00007f4a7cf08e01 00007f4a7cf0783e 00007f4a81ecc419 00007f4a7b443bd4 00007f4a7b443b62 00007f4a7b443a91 00007f4a7b443a0c 00007f4a7b442cc2 00007f4a7b24348c 00007f4a7b2428c6
0709 13:06:33.647187 (+  4617us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":126149888}
I20260709 13:06:33.603313 24597 consensus_queue.cc:1048] T ff75a1d4cb1f493db8f71ddc136ba9ab P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.046s
I20260709 13:06:33.664443 19556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dc5b3532fe54f74876d02beffa2c230" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 16 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:06:33.647161 24545 raft_consensus.cc:493] T 4af19371ea874c09a0a2147040835cbb P e61c3a8f61bb48f8a963c9480e53c168 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 127766fc592545a4997f7790f50f6076)
I20260709 13:06:33.665895 19556 raft_consensus.cc:1240] T 6c5eebf646ad445a9d1b1adc319d7b16 P e61c3a8f61bb48f8a963c9480e53c168 [term 14 FOLLOWER]: Rejecting Update request from peer 127766fc592545a4997f7790f50f6076 for earlier term 13. Current term is 14. Ops: []
I20260709 13:06:33.665766 24545 raft_consensus.cc:515] T 4af19371ea874c09a0a2147040835cbb P e61c3a8f61bb48f8a963c9480e53c168 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:33.667320 24466 leader_election.cc:290] T 9962423cb4e54fcfa5de01daf68a86e7 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:06:33.649134 24633 leader_election.cc:290] T 65d8cb8d6ec64f459d5a47cefab10acf P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 16 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:06:33.667981 24545 leader_election.cc:290] T 4af19371ea874c09a0a2147040835cbb P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:06:33.671725 24610 leader_election.cc:290] T 48824d5acfbc485ebf8c2d944e7202de P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:06:33.672804 24678 leader_election.cc:290] T fa731b585f684a7fb2d106c50f143b83 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:06:33.596547 24750 raft_consensus.cc:515] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P e5256d91808b47c195bc9b4dbd7f2b87 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:33.660773 24640 raft_consensus.cc:515] T ed7fdbcb96d14d418db9ca90a792588a P 127766fc592545a4997f7790f50f6076 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:33.675019 24750 leader_election.cc:290] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:06:33.676276 24640 leader_election.cc:290] T ed7fdbcb96d14d418db9ca90a792588a P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:06:33.678814 19553 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41504 (request call id 800) took 1789 ms. Trace:
I20260709 13:06:33.679180 19553 rpcz_store.cc:276] 0709 13:06:31.889390 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:33.677968 (+1788578us) service_pool.cc:224] Handling call
0709 13:06:33.678273 (+   305us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:33.678469 (+   196us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:33.678495 (+    26us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:33.678536 (+    41us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:06:33.678567 (+    31us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:33.678617 (+    50us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:33.678759 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:33.680743 24731 raft_consensus.cc:493] T 6c5eebf646ad445a9d1b1adc319d7b16 P 127766fc592545a4997f7790f50f6076 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 0473d2b2d01f4459b1e90fd12cc7840e)
I20260709 13:06:33.681291 24731 raft_consensus.cc:515] T 6c5eebf646ad445a9d1b1adc319d7b16 P 127766fc592545a4997f7790f50f6076 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:33.682633 20108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9962423cb4e54fcfa5de01daf68a86e7" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:06:33.682978 20103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14935b3ddf914369822e4a0547aaa355" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:06:33.684615 24702 leader_election.cc:290] T 48824d5acfbc485ebf8c2d944e7202de P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:06:33.685393 20103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4af19371ea874c09a0a2147040835cbb" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:06:33.686245 19557 raft_consensus.cc:1240] T 2a16f7501e2444fb86d4e2778e734e02 P e61c3a8f61bb48f8a963c9480e53c168 [term 14 FOLLOWER]: Rejecting Update request from peer 127766fc592545a4997f7790f50f6076 for earlier term 13. Current term is 14. Ops: []
I20260709 13:06:33.686874 19557 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41504 (request call id 803) took 1371 ms. Trace:
I20260709 13:06:33.687073 19481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22196caba61445d3bec98a0aab3c337d" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:06:33.687235 19557 rpcz_store.cc:276] 0709 13:06:32.315981 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:33.685829 (+1369848us) service_pool.cc:224] Handling call
0709 13:06:33.686090 (+   261us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:33.686598 (+   508us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:33.686820 (+   222us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:33.688854 19483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff75a1d4cb1f493db8f71ddc136ba9ab" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 16 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:06:33.689137 19557 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41504 (request call id 805) took 1372 ms. Trace:
I20260709 13:06:33.689735 19483 raft_consensus.cc:2410] T ff75a1d4cb1f493db8f71ddc136ba9ab P 0473d2b2d01f4459b1e90fd12cc7840e [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e61c3a8f61bb48f8a963c9480e53c168 for term 16 because replica has last-logged OpId of term: 13 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 6.
I20260709 13:06:33.691040 19482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc225c93219c45538b53a1bd3d387e4d" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:06:33.691504 24731 leader_election.cc:290] T 6c5eebf646ad445a9d1b1adc319d7b16 P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:06:33.692013 24731 raft_consensus.cc:493] T 0afb57ae58a24a01850491d69f0213dd P 127766fc592545a4997f7790f50f6076 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 0473d2b2d01f4459b1e90fd12cc7840e)
I20260709 13:06:33.692399 19479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76cb037fc9064d13b59a8969d897ce8c" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:06:33.692770 24482 raft_consensus.cc:493] T 0e1085d23e8347fbbd5bce7542f4b1f4 P 127766fc592545a4997f7790f50f6076 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 0473d2b2d01f4459b1e90fd12cc7840e)
I20260709 13:06:33.693300 24482 raft_consensus.cc:515] T 0e1085d23e8347fbbd5bce7542f4b1f4 P 127766fc592545a4997f7790f50f6076 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:33.693991 24643 raft_consensus.cc:515] T fa8650e71aa14778b3d73721fc50d9fc P e5256d91808b47c195bc9b4dbd7f2b87 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:33.695261 19477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f93ee515a9c14139bf566522ed8232f3" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 16 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:06:33.695319 20108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85c494af21f9457a85da47b9bc70c1fd" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:06:33.695508 19484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46c5bfeecc314717bffe987e6844b6d0" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 20 candidate_status { last_received { term: 19 index: 9 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:06:33.696099 24482 leader_election.cc:290] T 0e1085d23e8347fbbd5bce7542f4b1f4 P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:06:33.666515 19556 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41504 (request call id 798) took 1777 ms. Trace:
I20260709 13:06:33.680771 19553 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41504 (request call id 802) took 1790 ms. Trace:
I20260709 13:06:33.692497 24731 raft_consensus.cc:515] T 0afb57ae58a24a01850491d69f0213dd P 127766fc592545a4997f7790f50f6076 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:33.726540 19477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa8650e71aa14778b3d73721fc50d9fc" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:06:33.697115 19479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a61655d99124a29b486ba4a5b37faea" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:06:33.737775 19482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e1085d23e8347fbbd5bce7542f4b1f4" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:06:33.768949 19483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e381f1d6b8184797ad142de49be225a8" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:06:33.769093 19479 raft_consensus.cc:2468] T 1a61655d99124a29b486ba4a5b37faea P 0473d2b2d01f4459b1e90fd12cc7840e [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 12.
I20260709 13:06:33.767786 19481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1b10566f45d4a7d9029858330e02d5b" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:06:33.768222 19556 rpcz_store.cc:276] 0709 13:06:31.888903 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:33.665445 (+1776542us) service_pool.cc:224] Handling call
0709 13:06:33.665737 (+   292us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:33.666303 (+   566us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:33.666467 (+   164us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:33.769320 19553 rpcz_store.cc:276] 0709 13:06:31.889871 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:33.680034 (+1790163us) service_pool.cc:224] Handling call
0709 13:06:33.680325 (+   291us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:33.680482 (+   157us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:33.680508 (+    26us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:33.680548 (+    40us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:06:33.680577 (+    29us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:33.680630 (+    53us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:33.680723 (+    93us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:33.769053 19485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b74109013a140ada21feeef92d6f563" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:06:33.689559 19557 rpcz_store.cc:276] 0709 13:06:32.316509 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:33.688088 (+1371579us) service_pool.cc:224] Handling call
0709 13:06:33.688632 (+   544us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:33.688819 (+   187us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:33.688847 (+    28us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:33.688895 (+    48us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:06:33.688930 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:33.688986 (+    56us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:33.689085 (+    99us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:33.771049 19485 raft_consensus.cc:3060] T 2b74109013a140ada21feeef92d6f563 P 0473d2b2d01f4459b1e90fd12cc7840e [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:06:33.772379 19484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9f0d59553ad444883fcf5b5909f9798" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:06:33.649232 24362 leader_election.cc:290] T 775c229504194560ba9589bc2199b089 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:06:33.775693 19483 raft_consensus.cc:2368] T e381f1d6b8184797ad142de49be225a8 P 0473d2b2d01f4459b1e90fd12cc7840e [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate e61c3a8f61bb48f8a963c9480e53c168 for earlier term 11. Current term is 12.
I20260709 13:06:33.647647 24555 raft_consensus.cc:2749] T 172b3dd13109415a955b71ac0e9d2234 P e5256d91808b47c195bc9b4dbd7f2b87 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:06:33.804316 24551 leader_election.cc:290] T 217b5fae677b4971b3bbd2f357a1f7ff P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 11 election: Requested vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:06:33.804723 19484 raft_consensus.cc:1275] T d1e5873a19244c5ebbcd38e126796ee7 P 0473d2b2d01f4459b1e90fd12cc7840e [term 17 FOLLOWER]: Refusing update from remote peer e61c3a8f61bb48f8a963c9480e53c168: Log matching property violated. Preceding OpId in replica: term: 15 index: 8. Preceding OpId from leader: term: 17 index: 9. (index mismatch)
I20260709 13:06:33.805361 19482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48824d5acfbc485ebf8c2d944e7202de" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:06:33.807233 19449 leader_election.cc:400] T 172b3dd13109415a955b71ac0e9d2234 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 12 election: Vote denied by peer 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121) with higher term. Message: Invalid argument: T 172b3dd13109415a955b71ac0e9d2234 P 127766fc592545a4997f7790f50f6076 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 0473d2b2d01f4459b1e90fd12cc7840e for earlier term 12. Current term is 13.
I20260709 13:06:33.807550 19449 leader_election.cc:403] T 172b3dd13109415a955b71ac0e9d2234 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 12 election: Cancelling election due to peer responding with higher term
I20260709 13:06:33.694619 24624 raft_consensus.cc:515] T ff9b0eddd810459b82d91c60777c10eb P 127766fc592545a4997f7790f50f6076 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:33.781497 19477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40e1e16737a842ee936002830f36882e" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:06:33.782559 19556 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40428 (request call id 2845) took 1404 ms. Trace:
I20260709 13:06:33.785621 24734 raft_consensus.cc:515] T 28af091831594f9d8e96482078cc7625 P 0473d2b2d01f4459b1e90fd12cc7840e [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
W20260709 13:06:33.799130 19526 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.17.223.2:46257 timed out after 1.548s (SENT) [suppressed 10 similar messages]
I20260709 13:06:33.804756 19481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62c6c134d3d24a1ab144dd9ee6bc3f64" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:06:33.803107 19557 raft_consensus.cc:1240] T f1b10566f45d4a7d9029858330e02d5b P e61c3a8f61bb48f8a963c9480e53c168 [term 15 FOLLOWER]: Rejecting Update request from peer 0473d2b2d01f4459b1e90fd12cc7840e for earlier term 14. Current term is 15. Ops: []
I20260709 13:06:33.811506 19485 raft_consensus.cc:2468] T 2b74109013a140ada21feeef92d6f563 P 0473d2b2d01f4459b1e90fd12cc7840e [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 12.
I20260709 13:06:33.773855 24643 leader_election.cc:290] T fa8650e71aa14778b3d73721fc50d9fc P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 14 election: Requested vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:06:33.808048 20108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70797e5783b5454ab0d0eea663e791e3" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:06:33.842115 19553 raft_consensus.cc:1240] T 96efeaaf1057492490e9a621f37e1a2d P e61c3a8f61bb48f8a963c9480e53c168 [term 16 FOLLOWER]: Rejecting Update request from peer 0473d2b2d01f4459b1e90fd12cc7840e for earlier term 15. Current term is 16. Ops: []
I20260709 13:06:33.842716 19553 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40428 (request call id 2846) took 1464 ms. Trace:
I20260709 13:06:33.843041 19553 rpcz_store.cc:276] 0709 13:06:32.378487 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:33.770808 (+1392321us) service_pool.cc:224] Handling call
0709 13:06:33.841956 (+ 71148us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:33.842487 (+   531us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:33.842641 (+   154us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:33.811014 20076 leader_election.cc:304] T ab43d85f64114d4ebf618930e43d9ed0 P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 127766fc592545a4997f7790f50f6076; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:06:33.844751 19556 rpcz_store.cc:276] 0709 13:06:32.378112 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:33.770658 (+1392546us) service_pool.cc:224] Handling call
0709 13:06:33.782092 (+ 11434us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:33.782265 (+   173us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:33.782292 (+    27us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:33.782331 (+    39us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:06:33.782364 (+    33us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:33.782415 (+    51us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:33.782510 (+    95us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:06:33.779358 20075 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.1:40321, user_credentials={real_user=slave}} blocked reactor thread for 117388us
I20260709 13:06:33.840636 19523 leader_election.cc:304] T 86a6797bdfe94fa496c050ceae4bd0d9 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:06:33.809759 20103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ece3db938bc649d4a40a51522ed5259c" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076"
I20260709 13:06:33.841537 19557 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40428 (request call id 2847) took 1462 ms. Trace:
I20260709 13:06:33.847020 20108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65d8cb8d6ec64f459d5a47cefab10acf" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076"
I20260709 13:06:33.848178 19523 leader_election.cc:304] T 76cb037fc9064d13b59a8969d897ce8c P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:06:33.848037 20112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62c6c134d3d24a1ab144dd9ee6bc3f64" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:06:33.849839 19523 leader_election.cc:400] T e381f1d6b8184797ad142de49be225a8 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 11 election: Vote denied by peer e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321) with higher term. Message: Invalid argument: T e381f1d6b8184797ad142de49be225a8 P e5256d91808b47c195bc9b4dbd7f2b87 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate e61c3a8f61bb48f8a963c9480e53c168 for earlier term 11. Current term is 12.
I20260709 13:06:33.850291 19523 leader_election.cc:403] T e381f1d6b8184797ad142de49be225a8 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 11 election: Cancelling election due to peer responding with higher term
I20260709 13:06:33.848774 20110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14935b3ddf914369822e4a0547aaa355" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:06:33.846812 19557 rpcz_store.cc:276] 0709 13:06:32.378807 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:33.771720 (+1392913us) service_pool.cc:224] Handling call
0709 13:06:33.802937 (+ 31217us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:33.841309 (+ 38372us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:33.841488 (+   179us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:33.852600 20105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "833a2f0775ed407a94b8924ce50adb63" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:06:33.854101 24747 raft_consensus.cc:2804] T 76cb037fc9064d13b59a8969d897ce8c P e61c3a8f61bb48f8a963c9480e53c168 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:06:33.854126 24687 raft_consensus.cc:2749] T e381f1d6b8184797ad142de49be225a8 P e61c3a8f61bb48f8a963c9480e53c168 [term 12 FOLLOWER]: Leader election lost for term 11. Reason: Vote denied by peer e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321) with higher term. Message: Invalid argument: T e381f1d6b8184797ad142de49be225a8 P e5256d91808b47c195bc9b4dbd7f2b87 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate e61c3a8f61bb48f8a963c9480e53c168 for earlier term 11. Current term is 12.
I20260709 13:06:33.854817 24747 raft_consensus.cc:493] T 76cb037fc9064d13b59a8969d897ce8c P e61c3a8f61bb48f8a963c9480e53c168 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 0473d2b2d01f4459b1e90fd12cc7840e)
I20260709 13:06:33.855252 24747 raft_consensus.cc:3060] T 76cb037fc9064d13b59a8969d897ce8c P e61c3a8f61bb48f8a963c9480e53c168 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:06:33.856235 19410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b74109013a140ada21feeef92d6f563" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:06:33.856772 19411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14efcc79969f41babe5529c22d59156d" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:06:33.857085 19403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a61655d99124a29b486ba4a5b37faea" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:06:33.842835 24545 raft_consensus.cc:493] T 7f575b143b844aa096b50997dad3516a P e61c3a8f61bb48f8a963c9480e53c168 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader e5256d91808b47c195bc9b4dbd7f2b87)
I20260709 13:06:33.858443 24545 raft_consensus.cc:515] T 7f575b143b844aa096b50997dad3516a P e61c3a8f61bb48f8a963c9480e53c168 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:33.859110 20105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff9b0eddd810459b82d91c60777c10eb" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:06:33.860594 20112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14efcc79969f41babe5529c22d59156d" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:06:33.856802 19410 raft_consensus.cc:2468] T 2b74109013a140ada21feeef92d6f563 P e5256d91808b47c195bc9b4dbd7f2b87 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 10.
I20260709 13:06:33.857976 19411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f575b143b844aa096b50997dad3516a" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:06:33.860702 24545 leader_election.cc:290] T 7f575b143b844aa096b50997dad3516a P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:06:33.816817 24752 raft_consensus.cc:493] T f1b10566f45d4a7d9029858330e02d5b P e5256d91808b47c195bc9b4dbd7f2b87 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 0473d2b2d01f4459b1e90fd12cc7840e)
I20260709 13:06:33.865981 24752 raft_consensus.cc:515] T f1b10566f45d4a7d9029858330e02d5b P e5256d91808b47c195bc9b4dbd7f2b87 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:33.867687 19403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "217b5fae677b4971b3bbd2f357a1f7ff" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
I20260709 13:06:33.868240 19403 raft_consensus.cc:3060] T 217b5fae677b4971b3bbd2f357a1f7ff P e5256d91808b47c195bc9b4dbd7f2b87 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:06:33.870816 19411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef32ce6fdd0e40d382c79974f30295c6" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 18 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:06:33.871277 19523 leader_election.cc:304] T 2a16f7501e2444fb86d4e2778e734e02 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168; no voters: 127766fc592545a4997f7790f50f6076
I20260709 13:06:33.875895 19411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2725d2c4cb054f18b0fc8f735c15f6c2" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:06:33.883708 19410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "179fd671030940b4b4a4e24bcc4aba0a" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 17 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:06:33.838459 24702 raft_consensus.cc:493] T b08304a0a02b42d7840c4e8ee9a6bd1a P e61c3a8f61bb48f8a963c9480e53c168 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:33.884527 19410 raft_consensus.cc:2410] T 179fd671030940b4b4a4e24bcc4aba0a P e5256d91808b47c195bc9b4dbd7f2b87 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0473d2b2d01f4459b1e90fd12cc7840e for term 17 because replica has last-logged OpId of term: 16 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 9.
I20260709 13:06:33.884243 19556 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40428 (request call id 2850) took 1504 ms. Trace:
I20260709 13:06:33.885164 19556 rpcz_store.cc:276] 0709 13:06:32.379681 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:33.846848 (+1467167us) service_pool.cc:224] Handling call
0709 13:06:33.883696 (+ 36848us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:33.883885 (+   189us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:33.883911 (+    26us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:33.883950 (+    39us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:06:33.883991 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:33.884061 (+    70us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:33.884180 (+   119us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:33.838375 24678 raft_consensus.cc:493] T edd7d470b5014c9489be7f41f64355c9 P e61c3a8f61bb48f8a963c9480e53c168 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 0473d2b2d01f4459b1e90fd12cc7840e)
I20260709 13:06:33.841703 24573 raft_consensus.cc:2749] T 172b3dd13109415a955b71ac0e9d2234 P 0473d2b2d01f4459b1e90fd12cc7840e [term 13 FOLLOWER]: Leader election lost for term 12. Reason: Vote denied by peer 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121) with higher term. Message: Invalid argument: T 172b3dd13109415a955b71ac0e9d2234 P 127766fc592545a4997f7790f50f6076 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 0473d2b2d01f4459b1e90fd12cc7840e for earlier term 12. Current term is 13.
I20260709 13:06:33.866858 24759 raft_consensus.cc:2749] T ab43d85f64114d4ebf618930e43d9ed0 P 127766fc592545a4997f7790f50f6076 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:06:33.852140 24633 raft_consensus.cc:2804] T 86a6797bdfe94fa496c050ceae4bd0d9 P e61c3a8f61bb48f8a963c9480e53c168 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:06:33.888175 20075 leader_election.cc:304] T 14efcc79969f41babe5529c22d59156d P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 127766fc592545a4997f7790f50f6076; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:06:33.896623 19556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e1085d23e8347fbbd5bce7542f4b1f4" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:06:33.897344 19556 raft_consensus.cc:2468] T 0e1085d23e8347fbbd5bce7542f4b1f4 P e61c3a8f61bb48f8a963c9480e53c168 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 127766fc592545a4997f7790f50f6076 in term 11.
I20260709 13:06:33.897599 20112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48824d5acfbc485ebf8c2d944e7202de" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:06:33.890343 19557 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40428 (request call id 2851) took 1472 ms. Trace:
I20260709 13:06:33.898787 19557 rpcz_store.cc:276] 0709 13:06:32.417612 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:33.851438 (+1433826us) service_pool.cc:224] Handling call
0709 13:06:33.887134 (+ 35696us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:33.890039 (+  2905us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:33.890068 (+    29us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:33.890110 (+    42us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:06:33.890138 (+    28us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:33.890189 (+    51us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:33.890293 (+   104us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:06:33.890856 19526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.2:46257, user_credentials={real_user=slave}} blocked reactor thread for 91766.3us
I20260709 13:06:33.890957 20108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa731b585f684a7fb2d106c50f143b83" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:06:33.894086 20110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9962423cb4e54fcfa5de01daf68a86e7" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:06:33.889519 19410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9962423cb4e54fcfa5de01daf68a86e7" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:06:33.894928 20105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4af19371ea874c09a0a2147040835cbb" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:06:33.900698 19523 leader_election.cc:304] T 14935b3ddf914369822e4a0547aaa355 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: e61c3a8f61bb48f8a963c9480e53c168; no voters: 127766fc592545a4997f7790f50f6076, e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:06:33.886785 24545 raft_consensus.cc:2764] T 2a16f7501e2444fb86d4e2778e734e02 P e61c3a8f61bb48f8a963c9480e53c168 [term 14 FOLLOWER]: Leader pre-election decision vote started in defunct term 13: won
I20260709 13:06:33.898216 20112 raft_consensus.cc:2468] T 48824d5acfbc485ebf8c2d944e7202de P 127766fc592545a4997f7790f50f6076 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 16.
I20260709 13:06:33.887535 24478 raft_consensus.cc:493] T e381f1d6b8184797ad142de49be225a8 P 0473d2b2d01f4459b1e90fd12cc7840e [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:33.912853 19523 leader_election.cc:304] T 48824d5acfbc485ebf8c2d944e7202de P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 127766fc592545a4997f7790f50f6076, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:06:33.899638 24482 consensus_queue.cc:1059] T 2a16f7501e2444fb86d4e2778e734e02 P 127766fc592545a4997f7790f50f6076 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 }, Status: INVALID_TERM, Last received: 13.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.016s
I20260709 13:06:33.892206 24702 raft_consensus.cc:515] T b08304a0a02b42d7840c4e8ee9a6bd1a P e61c3a8f61bb48f8a963c9480e53c168 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:33.914353 24759 raft_consensus.cc:2749] T 14efcc79969f41babe5529c22d59156d P 127766fc592545a4997f7790f50f6076 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:06:33.914789 24624 leader_election.cc:290] T ff9b0eddd810459b82d91c60777c10eb P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 16 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:06:33.916172 24752 leader_election.cc:290] T f1b10566f45d4a7d9029858330e02d5b P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:06:33.916513 24734 leader_election.cc:290] T 28af091831594f9d8e96482078cc7625 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 16 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:06:33.889571 24758 consensus_queue.cc:1048] T fa731b585f684a7fb2d106c50f143b83 P 127766fc592545a4997f7790f50f6076 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.064s
I20260709 13:06:33.935349 19405 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49050 (request call id 960) took 1158 ms. Trace:
I20260709 13:06:33.936617 19404 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52328 (request call id 2233) took 1513 ms. Trace:
W20260709 13:06:33.978344 20075 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.1:40321, user_credentials={real_user=slave}} blocked reactor thread for 90266.3us
W20260709 13:06:33.938040 19408 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52342 (request call id 2823) took 1712 ms (client timeout 1772 ms). Trace:
W20260709 13:06:33.979153 19408 rpcz_store.cc:269] 0709 13:06:32.225593 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:32.225755 (+   162us) service_pool.cc:224] Handling call
0709 13:06:33.937831 (+1712076us) spinlock_profiling.cc:243] Waited 117 ms on lock 0x7b5400249d54. stack: 00007f4a79de9343 00007f4a79de9240 00007f4a797781d4 00007f4a834b6304 00007f4a834b6299 00007f4a7ce71571 00007f4a7cf0c2fa 00007f4a81ecdb17 00007f4a7b4486d4 00007f4a7b448662 00007f4a7b448591 00007f4a7b44850c 00007f4a7b4477c2 00007f4a7b24348c 00007f4a7b2428c6 00007f4a7b24226f
0709 13:06:33.937973 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":270216064}
I20260709 13:06:33.940178 19557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c5eebf646ad445a9d1b1adc319d7b16" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:06:33.981675 19526 leader_election.cc:304] T 6c5eebf646ad445a9d1b1adc319d7b16 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e61c3a8f61bb48f8a963c9480e53c168; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, 127766fc592545a4997f7790f50f6076
I20260709 13:06:33.911818 24687 raft_consensus.cc:2749] T 14935b3ddf914369822e4a0547aaa355 P e61c3a8f61bb48f8a963c9480e53c168 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:06:33.900142 24633 raft_consensus.cc:493] T 86a6797bdfe94fa496c050ceae4bd0d9 P e61c3a8f61bb48f8a963c9480e53c168 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 0473d2b2d01f4459b1e90fd12cc7840e)
I20260709 13:06:33.977444 19405 rpcz_store.cc:276] 0709 13:06:32.777073 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:32.940976 (+163903us) service_pool.cc:224] Handling call
0709 13:06:32.941275 (+   299us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:33.511147 (+569872us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:33.935112 (+423965us) spinlock_profiling.cc:243] Waited 569 ms on lock 0x7b5400065c54. stack: 00007f4a79de9343 00007f4a79de9240 00007f4a797781d4 00007f4a834b6304 00007f4a834b6299 00007f4a7ce71571 00007f4a7cf08e01 00007f4a7cf0783e 00007f4a81ecc419 00007f4a7b443bd4 00007f4a7b443b62 00007f4a7b443a91 00007f4a7b443a0c 00007f4a7b442cc2 00007f4a7b24348c 00007f4a7b2428c6
0709 13:06:33.935286 (+   174us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1308852096}
I20260709 13:06:33.942368 19403 raft_consensus.cc:2468] T 217b5fae677b4971b3bbd2f357a1f7ff P e5256d91808b47c195bc9b4dbd7f2b87 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 12.
I20260709 13:06:33.980839 19557 raft_consensus.cc:2468] T 6c5eebf646ad445a9d1b1adc319d7b16 P e61c3a8f61bb48f8a963c9480e53c168 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 127766fc592545a4997f7790f50f6076 in term 14.
I20260709 13:06:33.985877 19556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ece3db938bc649d4a40a51522ed5259c" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:06:33.986809 19556 raft_consensus.cc:2393] T ece3db938bc649d4a40a51522ed5259c P e61c3a8f61bb48f8a963c9480e53c168 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 127766fc592545a4997f7790f50f6076 in current term 11: Already voted for candidate e61c3a8f61bb48f8a963c9480e53c168 in this term.
I20260709 13:06:33.978390 19404 rpcz_store.cc:276] 0709 13:06:32.422929 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:32.590913 (+167984us) service_pool.cc:224] Handling call
0709 13:06:32.591225 (+   312us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:06:32.591614 (+   389us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:32.591642 (+    28us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:06:32.629890 (+ 38248us) log.cc:844] Serialized 52 byte log entry
0709 13:06:32.776536 (+146646us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:06:33.452852 (+676316us) log.cc:844] Serialized 14 byte log entry
0709 13:06:33.502617 (+ 49765us) log.cc:844] Serialized 14 byte log entry
0709 13:06:33.635060 (+132443us) spinlock_profiling.cc:243] Waited 1.18 ms on lock 0x7b1800287da0. stack: 00007f4a79de9343 00007f4a79de9240 00007f4a797781d4 00007f4a834b6304 00007f4a834b6299 00007f4a82ce3de1 00007f4a82cf05b1 00007f4a79de92a6 00007f4a79de9240 00007f4a797781d4 00007f4a834b6304 00007f4a834b6299 00007f4a7ce71571 00007f4a7ce83733 00007f4a7cf08dbf 00007f4a7cf0783e
0709 13:06:33.936138 (+301078us) spinlock_profiling.cc:243] Waited 2.31 ms on lock 0x7b54002ac9a0. stack: 00007f4a79de9343 00007f4a79de9240 00007f4a797781d4 00007f4a834b6304 00007f4a834b6299 00007f4a7ce71571 00007f4a7ce83733 00007f4a7cf08dbf 00007f4a7cf0783e 00007f4a81ecc419 00007f4a7b443bd4 00007f4a7b443b62 00007f4a7b443a91 00007f4a7b443a0c 00007f4a7b442cc2 00007f4a7b24348c
0709 13:06:33.936201 (+    63us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:33.936305 (+   104us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:33.936363 (+    58us) raft_consensus.cc:1685] finished
0709 13:06:33.936381 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:33.936548 (+   167us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":604827,"prepare.run_cpu_time_us":72,"prepare.run_wall_time_us":74,"raft.queue_time_us":104396,"raft.run_cpu_time_us":328,"raft.run_wall_time_us":44301,"spinlock_wait_cycles":8028288,"thread_start_us":796986,"threads_started":3,"wal-append.queue_time_us":197151}
I20260709 13:06:33.894028 24678 raft_consensus.cc:515] T edd7d470b5014c9489be7f41f64355c9 P e61c3a8f61bb48f8a963c9480e53c168 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:33.949856 24545 raft_consensus.cc:2804] T 48824d5acfbc485ebf8c2d944e7202de P e61c3a8f61bb48f8a963c9480e53c168 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:06:33.980490 24640 raft_consensus.cc:3055] T 2a16f7501e2444fb86d4e2778e734e02 P 127766fc592545a4997f7790f50f6076 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:06:33.992775 24633 raft_consensus.cc:3060] T 86a6797bdfe94fa496c050ceae4bd0d9 P e61c3a8f61bb48f8a963c9480e53c168 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:06:33.984051 24482 raft_consensus.cc:493] T 62c6c134d3d24a1ab144dd9ee6bc3f64 P 127766fc592545a4997f7790f50f6076 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 0473d2b2d01f4459b1e90fd12cc7840e)
I20260709 13:06:33.941372 24478 raft_consensus.cc:515] T e381f1d6b8184797ad142de49be225a8 P 0473d2b2d01f4459b1e90fd12cc7840e [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
W20260709 13:06:34.008890 20076 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.3:36891, user_credentials={real_user=slave}} blocked reactor thread for 112407us
W20260709 13:06:34.009846 19407 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52328 (request call id 2230) took 1592 ms (client timeout 1976 ms). Trace:
I20260709 13:06:34.011703 20076 leader_election.cc:304] T 0e1085d23e8347fbbd5bce7542f4b1f4 P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 127766fc592545a4997f7790f50f6076, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:06:34.011828 19557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed7fdbcb96d14d418db9ca90a792588a" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:06:34.013239 19559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48824d5acfbc485ebf8c2d944e7202de" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:06:34.013936 20076 leader_election.cc:304] T 6c5eebf646ad445a9d1b1adc319d7b16 P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 127766fc592545a4997f7790f50f6076, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
W20260709 13:06:34.010257 19407 rpcz_store.cc:269] 0709 13:06:32.417785 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:32.445395 (+ 27610us) service_pool.cc:224] Handling call
0709 13:06:34.009683 (+1564288us) spinlock_profiling.cc:243] Waited 179 ms on lock 0x7b5400195d54. stack: 00007f4a79de9343 00007f4a79de9240 00007f4a797781d4 00007f4a834b6304 00007f4a834b6299 00007f4a7ce71571 00007f4a7cf0c2fa 00007f4a81ecdb17 00007f4a7b4486d4 00007f4a7b448662 00007f4a7b448591 00007f4a7b44850c 00007f4a7b4477c2 00007f4a7b24348c 00007f4a7b2428c6 00007f4a7b24226f
0709 13:06:34.009795 (+   112us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":412093696}
I20260709 13:06:33.999310 24545 raft_consensus.cc:493] T 48824d5acfbc485ebf8c2d944e7202de P e61c3a8f61bb48f8a963c9480e53c168 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 0473d2b2d01f4459b1e90fd12cc7840e)
I20260709 13:06:34.003242 24687 raft_consensus.cc:2749] T 6c5eebf646ad445a9d1b1adc319d7b16 P e61c3a8f61bb48f8a963c9480e53c168 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:06:34.020324 24457 leader_election.cc:290] T d1e5873a19244c5ebbcd38e126796ee7 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:06:34.005713 24640 raft_consensus.cc:740] T 2a16f7501e2444fb86d4e2778e734e02 P 127766fc592545a4997f7790f50f6076 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 127766fc592545a4997f7790f50f6076, State: Running, Role: LEADER
I20260709 13:06:34.015460 24766 raft_consensus.cc:2804] T 0e1085d23e8347fbbd5bce7542f4b1f4 P 127766fc592545a4997f7790f50f6076 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:06:34.016855 24767 raft_consensus.cc:2804] T 6c5eebf646ad445a9d1b1adc319d7b16 P 127766fc592545a4997f7790f50f6076 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:06:34.016980 19560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96efeaaf1057492490e9a621f37e1a2d" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:06:34.040320 19560 raft_consensus.cc:2393] T 96efeaaf1057492490e9a621f37e1a2d P e61c3a8f61bb48f8a963c9480e53c168 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 127766fc592545a4997f7790f50f6076 in current term 16: Already voted for candidate e61c3a8f61bb48f8a963c9480e53c168 in this term.
I20260709 13:06:34.018337 19554 raft_consensus.cc:1240] T 3e1f505cb0f1427bbd698ac889d80821 P e61c3a8f61bb48f8a963c9480e53c168 [term 16 FOLLOWER]: Rejecting Update request from peer 0473d2b2d01f4459b1e90fd12cc7840e for earlier term 15. Current term is 16. Ops: []
I20260709 13:06:34.041035 19554 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40428 (request call id 2852) took 1622 ms. Trace:
I20260709 13:06:34.041577 19554 rpcz_store.cc:276] 0709 13:06:32.419064 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:34.017915 (+1598851us) service_pool.cc:224] Handling call
0709 13:06:34.018181 (+   266us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:34.040769 (+ 22588us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:34.040980 (+   211us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:34.042394 24731 leader_election.cc:290] T 0afb57ae58a24a01850491d69f0213dd P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:06:34.043133 19554 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41504 (request call id 807) took 1618 ms. Trace:
I20260709 13:06:34.039988 24767 raft_consensus.cc:493] T 6c5eebf646ad445a9d1b1adc319d7b16 P 127766fc592545a4997f7790f50f6076 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 0473d2b2d01f4459b1e90fd12cc7840e)
W20260709 13:06:34.043813 19375 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.3:36891, user_credentials={real_user=slave}} blocked reactor thread for 442902us
I20260709 13:06:34.044008 24767 raft_consensus.cc:3060] T 6c5eebf646ad445a9d1b1adc319d7b16 P 127766fc592545a4997f7790f50f6076 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:06:34.019722 24678 leader_election.cc:290] T edd7d470b5014c9489be7f41f64355c9 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
W20260709 13:06:34.007071 19449 connection.cc:256] RPC call timeout handler was delayed by -1.7426015649999727s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15080000000000002s for a response
W20260709 13:06:34.048080 19449 connection.cc:256] RPC call timeout handler was delayed by -1.674242874000015s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1976s for a response
I20260709 13:06:34.044569 19560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0afb57ae58a24a01850491d69f0213dd" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:06:34.012415 19557 raft_consensus.cc:2468] T ed7fdbcb96d14d418db9ca90a792588a P e61c3a8f61bb48f8a963c9480e53c168 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 127766fc592545a4997f7790f50f6076 in term 10.
I20260709 13:06:34.041736 19558 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40438 (request call id 2634) took 3046 ms. Trace:
I20260709 13:06:34.049204 19558 rpcz_store.cc:276] 0709 13:06:30.995190 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:31.972433 (+977243us) service_pool.cc:224] Handling call
0709 13:06:31.972758 (+   325us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:32.764855 (+792097us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:34.041531 (+1276676us) spinlock_profiling.cc:243] Waited 674 ms on lock 0x7b54000df554. stack: 00007f4a79de9343 00007f4a79de9240 00007f4a797781d4 00007f4a834b6304 00007f4a834b6299 00007f4a7ce71571 00007f4a7cf08e01 00007f4a7cf0783e 00007f4a81ecc419 00007f4a7b443bd4 00007f4a7b443b62 00007f4a7b443a91 00007f4a7b443a0c 00007f4a7b442cc2 00007f4a7b24348c 00007f4a7b2428c6
0709 13:06:34.041686 (+   155us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1550374784}
I20260709 13:06:34.050060 19560 raft_consensus.cc:1240] T 46c5bfeecc314717bffe987e6844b6d0 P e61c3a8f61bb48f8a963c9480e53c168 [term 20 FOLLOWER]: Rejecting Update request from peer 0473d2b2d01f4459b1e90fd12cc7840e for earlier term 19. Current term is 20. Ops: []
I20260709 13:06:34.007457 24734 raft_consensus.cc:493] T ff75a1d4cb1f493db8f71ddc136ba9ab P 0473d2b2d01f4459b1e90fd12cc7840e [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:34.043491 19554 rpcz_store.cc:276] 0709 13:06:32.424668 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:34.042334 (+1617666us) service_pool.cc:224] Handling call
0709 13:06:34.042652 (+   318us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:34.042851 (+   199us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:34.042876 (+    25us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:34.042918 (+    42us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:06:34.042952 (+    34us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:34.043000 (+    48us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:34.043086 (+    86us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:06:34.048427 19449 connection.cc:256] RPC call timeout handler was delayed by -1.4951015650000272s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17830000000000001s for a response
I20260709 13:06:34.050835 19558 raft_consensus.cc:1240] T b9f0d59553ad444883fcf5b5909f9798 P e61c3a8f61bb48f8a963c9480e53c168 [term 14 FOLLOWER]: Rejecting Update request from peer 0473d2b2d01f4459b1e90fd12cc7840e for earlier term 13. Current term is 14. Ops: []
W20260709 13:06:34.056178 19449 connection.cc:256] RPC call timeout handler was delayed by -1.4922879139999168s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1584s for a response
I20260709 13:06:34.044572 19375 leader_election.cc:304] T 76cb037fc9064d13b59a8969d897ce8c P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:06:34.035787 24545 raft_consensus.cc:3060] T 48824d5acfbc485ebf8c2d944e7202de P e61c3a8f61bb48f8a963c9480e53c168 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:06:34.048173 19402 raft_consensus.cc:1240] T 0cdf56e38bbc453d9438d359e5a69955 P e5256d91808b47c195bc9b4dbd7f2b87 [term 15 FOLLOWER]: Rejecting Update request from peer 0473d2b2d01f4459b1e90fd12cc7840e for earlier term 14. Current term is 15. Ops: []
I20260709 13:06:34.053567 19557 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40428 (request call id 2858) took 1601 ms. Trace:
W20260709 13:06:34.056488 19449 connection.cc:256] RPC call timeout handler was delayed by -1.4336107760000232s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15760000000000002s for a response
I20260709 13:06:34.050868 19560 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40428 (request call id 2859) took 1583 ms. Trace:
W20260709 13:06:34.060288 19449 connection.cc:256] RPC call timeout handler was delayed by -1.429442874000074s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.22480000000000003s for a response
W20260709 13:06:34.057999 19409 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52328 (request call id 2222) took 2212 ms (client timeout 1814 ms). Trace:
I20260709 13:06:34.060215 19560 rpcz_store.cc:276] 0709 13:06:32.467048 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:34.049493 (+1582445us) service_pool.cc:224] Handling call
0709 13:06:34.049839 (+   346us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:34.050564 (+   725us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:34.050806 (+   242us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:34.060238 19557 rpcz_store.cc:276] 0709 13:06:32.451920 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:34.049391 (+1597471us) service_pool.cc:224] Handling call
0709 13:06:34.053052 (+  3661us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:34.053291 (+   239us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:34.053317 (+    26us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:34.053354 (+    37us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:06:34.053383 (+    29us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:34.053431 (+    48us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:34.053521 (+    90us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":2255}
W20260709 13:06:34.061087 19449 connection.cc:256] RPC call timeout handler was delayed by -1.2001212290000467s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17720000000000002s for a response
I20260709 13:06:34.056496 19558 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40428 (request call id 2860) took 1539 ms. Trace:
I20260709 13:06:34.062837 19558 rpcz_store.cc:276] 0709 13:06:32.516863 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:34.050257 (+1533394us) service_pool.cc:224] Handling call
0709 13:06:34.050583 (+   326us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:34.056275 (+  5692us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:34.056450 (+   175us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:34.059137 19375 leader_election.cc:304] T 2a16f7501e2444fb86d4e2778e734e02 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:06:34.064992 19449 leader_election.cc:304] T d1e5873a19244c5ebbcd38e126796ee7 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e; no voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:06:34.064996 19375 leader_election.cc:304] T 3e1f505cb0f1427bbd698ac889d80821 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:06:34.038436 24766 raft_consensus.cc:493] T 0e1085d23e8347fbbd5bce7542f4b1f4 P 127766fc592545a4997f7790f50f6076 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 0473d2b2d01f4459b1e90fd12cc7840e)
I20260709 13:06:34.046386 24687 raft_consensus.cc:493] T 96efeaaf1057492490e9a621f37e1a2d P e61c3a8f61bb48f8a963c9480e53c168 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:34.067529 19375 leader_election.cc:304] T a08760e15aac4630a629431f56024dc8 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:06:34.064160 24551 raft_consensus.cc:2804] T 76cb037fc9064d13b59a8969d897ce8c P e5256d91808b47c195bc9b4dbd7f2b87 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:06:34.071099 24555 raft_consensus.cc:2804] T a08760e15aac4630a629431f56024dc8 P e5256d91808b47c195bc9b4dbd7f2b87 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:06:34.015029 24482 raft_consensus.cc:515] T 62c6c134d3d24a1ab144dd9ee6bc3f64 P 127766fc592545a4997f7790f50f6076 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:34.072722 19375 leader_election.cc:304] T b9f0d59553ad444883fcf5b5909f9798 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168
W20260709 13:06:34.074158 19377 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.2:46257, user_credentials={real_user=slave}} blocked reactor thread for 223987us
W20260709 13:06:34.061303 19409 rpcz_store.cc:269] 0709 13:06:31.835180 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:31.839925 (+  4745us) service_pool.cc:224] Handling call
0709 13:06:34.047230 (+2207305us) spinlock_profiling.cc:243] Waited 1.48 s on lock 0x7b5400064d54. stack: 00007f4a79de9343 00007f4a79de9240 00007f4a797781d4 00007f4a834b6304 00007f4a834b6299 00007f4a7ce71571 00007f4a7cf0c2fa 00007f4a81ecdb17 00007f4a7b4486d4 00007f4a7b448662 00007f4a7b448591 00007f4a7b44850c 00007f4a7b4477c2 00007f4a7b24348c 00007f4a7b2428c6 00007f4a7b24226f
0709 13:06:34.047405 (+   175us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3414243712}
I20260709 13:06:34.073417 19449 leader_election.cc:304] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e; no voters: 127766fc592545a4997f7790f50f6076, e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:06:34.071261 24551 raft_consensus.cc:493] T 76cb037fc9064d13b59a8969d897ce8c P e5256d91808b47c195bc9b4dbd7f2b87 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 0473d2b2d01f4459b1e90fd12cc7840e)
I20260709 13:06:34.141268 24551 raft_consensus.cc:3060] T 76cb037fc9064d13b59a8969d897ce8c P e5256d91808b47c195bc9b4dbd7f2b87 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:06:34.141317 24362 raft_consensus.cc:3060] T b9f0d59553ad444883fcf5b5909f9798 P e5256d91808b47c195bc9b4dbd7f2b87 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:06:34.142052 24764 log.cc:927] Time spent T 65d8cb8d6ec64f459d5a47cefab10acf P 127766fc592545a4997f7790f50f6076: Append to log took a long time: real 0.102s	user 0.000s	sys 0.000s
I20260709 13:06:34.138265 24761 raft_consensus.cc:2749] T d1e5873a19244c5ebbcd38e126796ee7 P 0473d2b2d01f4459b1e90fd12cc7840e [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:06:34.144052 19555 raft_consensus.cc:2955] T ab43d85f64114d4ebf618930e43d9ed0 P e61c3a8f61bb48f8a963c9480e53c168 [term 15 FOLLOWER]: Committing config change with OpId 14.9: config changed from index 5 to 9, VOTER e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1) evicted. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } } }
I20260709 13:06:34.071503 24643 raft_consensus.cc:2804] T 3e1f505cb0f1427bbd698ac889d80821 P e5256d91808b47c195bc9b4dbd7f2b87 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:06:34.147276 24643 raft_consensus.cc:697] T 3e1f505cb0f1427bbd698ac889d80821 P e5256d91808b47c195bc9b4dbd7f2b87 [term 16 LEADER]: Becoming Leader. State: Replica: e5256d91808b47c195bc9b4dbd7f2b87, State: Running, Role: LEADER
W20260709 13:06:34.140725 19375 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.3:36891, user_credentials={real_user=slave}} blocked reactor thread for 69981.3us
I20260709 13:06:34.068617 24752 raft_consensus.cc:2804] T 2a16f7501e2444fb86d4e2778e734e02 P e5256d91808b47c195bc9b4dbd7f2b87 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:06:34.158511 24752 raft_consensus.cc:697] T 2a16f7501e2444fb86d4e2778e734e02 P e5256d91808b47c195bc9b4dbd7f2b87 [term 14 LEADER]: Becoming Leader. State: Replica: e5256d91808b47c195bc9b4dbd7f2b87, State: Running, Role: LEADER
I20260709 13:06:34.159436 24752 consensus_queue.cc:237] T 2a16f7501e2444fb86d4e2778e734e02 P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
W20260709 13:06:34.163507 19375 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:34.071890 24766 raft_consensus.cc:3060] T 0e1085d23e8347fbbd5bce7542f4b1f4 P 127766fc592545a4997f7790f50f6076 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:06:34.075182 24555 raft_consensus.cc:493] T a08760e15aac4630a629431f56024dc8 P e5256d91808b47c195bc9b4dbd7f2b87 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 0473d2b2d01f4459b1e90fd12cc7840e)
I20260709 13:06:34.062707 24734 raft_consensus.cc:515] T ff75a1d4cb1f493db8f71ddc136ba9ab P 0473d2b2d01f4459b1e90fd12cc7840e [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
W20260709 13:06:34.171936 19449 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.1:40321, user_credentials={real_user=slave}} blocked reactor thread for 98574.7us
I20260709 13:06:34.167441 19407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f93ee515a9c14139bf566522ed8232f3" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 16 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
I20260709 13:06:34.172677 19407 raft_consensus.cc:3060] T f93ee515a9c14139bf566522ed8232f3 P e5256d91808b47c195bc9b4dbd7f2b87 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:06:34.169021 19403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46c5bfeecc314717bffe987e6844b6d0" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 20 candidate_status { last_received { term: 19 index: 9 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
I20260709 13:06:34.173383 19408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa8650e71aa14778b3d73721fc50d9fc" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
I20260709 13:06:34.173954 19403 raft_consensus.cc:2393] T 46c5bfeecc314717bffe987e6844b6d0 P e5256d91808b47c195bc9b4dbd7f2b87 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate e61c3a8f61bb48f8a963c9480e53c168 in current term 20: Already voted for candidate e5256d91808b47c195bc9b4dbd7f2b87 in this term.
I20260709 13:06:34.174043 19408 raft_consensus.cc:2393] T fa8650e71aa14778b3d73721fc50d9fc P e5256d91808b47c195bc9b4dbd7f2b87 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate e61c3a8f61bb48f8a963c9480e53c168 in current term 14: Already voted for candidate e5256d91808b47c195bc9b4dbd7f2b87 in this term.
I20260709 13:06:34.170384 19405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9f0d59553ad444883fcf5b5909f9798" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
I20260709 13:06:34.163164 19523 leader_election.cc:304] T 22196caba61445d3bec98a0aab3c337d P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:06:34.175674 19411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b74109013a140ada21feeef92d6f563" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
I20260709 13:06:34.176395 19411 raft_consensus.cc:3060] T 2b74109013a140ada21feeef92d6f563 P e5256d91808b47c195bc9b4dbd7f2b87 [term 10 FOLLOWER]: Advancing to term 12
I20260709 13:06:34.177052 19553 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40428 (request call id 2848) took 1798 ms. Trace:
I20260709 13:06:34.191303 19554 raft_consensus.cc:1275] T b08304a0a02b42d7840c4e8ee9a6bd1a P e61c3a8f61bb48f8a963c9480e53c168 [term 14 FOLLOWER]: Refusing update from remote peer 0473d2b2d01f4459b1e90fd12cc7840e: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 13:06:34.192394 19554 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40428 (request call id 2863) took 1428 ms. Trace:
I20260709 13:06:34.192827 19554 rpcz_store.cc:276] 0709 13:06:32.764093 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:34.062523 (+1298430us) service_pool.cc:224] Handling call
0709 13:06:34.190827 (+128304us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:34.192060 (+  1233us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:34.192324 (+   264us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:34.177541 19553 rpcz_store.cc:276] 0709 13:06:32.379093 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:33.846798 (+1467705us) service_pool.cc:224] Handling call
0709 13:06:33.887484 (+ 40686us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:33.887897 (+   413us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:33.887935 (+    38us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:33.892107 (+  4172us) log.cc:844] Serialized 26 byte log entry
0709 13:06:33.983899 (+ 91792us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:06:34.139935 (+156036us) log.cc:844] Serialized 14 byte log entry
0709 13:06:34.176676 (+ 36741us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:34.176770 (+    94us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:34.176817 (+    47us) raft_consensus.cc:1685] finished
0709 13:06:34.176834 (+    17us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:34.176978 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":696,"raft.run_cpu_time_us":120,"raft.run_wall_time_us":6018,"thread_start_us":246596,"threads_started":2,"wal-append.queue_time_us":86439}
I20260709 13:06:34.238440 19403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "217b5fae677b4971b3bbd2f357a1f7ff" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:06:34.241127 19408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40e1e16737a842ee936002830f36882e" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
I20260709 13:06:34.243580 19449 leader_election.cc:400] T 172b3dd13109415a955b71ac0e9d2234 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 12 election: Vote denied by peer e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321) with higher term. Message: Invalid argument: T 172b3dd13109415a955b71ac0e9d2234 P e5256d91808b47c195bc9b4dbd7f2b87 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 0473d2b2d01f4459b1e90fd12cc7840e for earlier term 12. Current term is 13.
I20260709 13:06:34.245118 19449 leader_election.cc:400] T 172b3dd13109415a955b71ac0e9d2234 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 12 pre-election: Vote denied by peer e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321) with higher term. Message: Invalid argument: T 172b3dd13109415a955b71ac0e9d2234 P e5256d91808b47c195bc9b4dbd7f2b87 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0473d2b2d01f4459b1e90fd12cc7840e for earlier term 12. Current term is 13.
I20260709 13:06:34.212960 19409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1b10566f45d4a7d9029858330e02d5b" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
I20260709 13:06:34.248790 19409 raft_consensus.cc:3060] T f1b10566f45d4a7d9029858330e02d5b P e5256d91808b47c195bc9b4dbd7f2b87 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:06:34.239584 19403 raft_consensus.cc:2393] T 217b5fae677b4971b3bbd2f357a1f7ff P e5256d91808b47c195bc9b4dbd7f2b87 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e61c3a8f61bb48f8a963c9480e53c168 in current term 12: Already voted for candidate 0473d2b2d01f4459b1e90fd12cc7840e in this term.
I20260709 13:06:34.250912 19408 raft_consensus.cc:1275] T d1e5873a19244c5ebbcd38e126796ee7 P e5256d91808b47c195bc9b4dbd7f2b87 [term 17 FOLLOWER]: Refusing update from remote peer e61c3a8f61bb48f8a963c9480e53c168: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 17 index: 9. (index mismatch)
I20260709 13:06:34.251063 19404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70797e5783b5454ab0d0eea663e791e3" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:06:34.252094 19404 raft_consensus.cc:2410] T 70797e5783b5454ab0d0eea663e791e3 P e5256d91808b47c195bc9b4dbd7f2b87 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e61c3a8f61bb48f8a963c9480e53c168 for term 15 because replica has last-logged OpId of term: 14 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 10.
I20260709 13:06:34.253088 19403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "833a2f0775ed407a94b8924ce50adb63" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:06:34.139096 24687 raft_consensus.cc:515] T 96efeaaf1057492490e9a621f37e1a2d P e61c3a8f61bb48f8a963c9480e53c168 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:34.257376 19449 leader_election.cc:304] T 5ec1c4ce15e04c7e8c283a62179f2a64 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e; no voters: 127766fc592545a4997f7790f50f6076, e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:06:34.257819 19410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ece3db938bc649d4a40a51522ed5259c" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
I20260709 13:06:34.148092 24643 consensus_queue.cc:237] T 3e1f505cb0f1427bbd698ac889d80821 P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:34.210462 24555 raft_consensus.cc:3060] T a08760e15aac4630a629431f56024dc8 P e5256d91808b47c195bc9b4dbd7f2b87 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:06:34.214359 24678 raft_consensus.cc:2804] T 22196caba61445d3bec98a0aab3c337d P e61c3a8f61bb48f8a963c9480e53c168 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:06:34.285089 19411 raft_consensus.cc:2468] T 2b74109013a140ada21feeef92d6f563 P e5256d91808b47c195bc9b4dbd7f2b87 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 12.
W20260709 13:06:34.294414 19526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.2:46257, user_credentials={real_user=slave}} blocked reactor thread for 312851us
I20260709 13:06:34.295846 19526 leader_election.cc:304] T 179fd671030940b4b4a4e24bcc4aba0a P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168; no voters: e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:06:34.297164 19477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e1f505cb0f1427bbd698ac889d80821" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:06:34.298393 19477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df751f992649444090e27965eb1af85d" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:06:34.299113 19485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cdf56e38bbc453d9438d359e5a69955" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:06:34.300493 19482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e5873a19244c5ebbcd38e126796ee7" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 18 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:06:34.301525 19482 raft_consensus.cc:2410] T d1e5873a19244c5ebbcd38e126796ee7 P 0473d2b2d01f4459b1e90fd12cc7840e [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e5256d91808b47c195bc9b4dbd7f2b87 for term 18 because replica has last-logged OpId of term: 15 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 7.
I20260709 13:06:34.289227 19408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f575b143b844aa096b50997dad3516a" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:06:34.292538 19480 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58294 (request call id 2495) took 1507 ms. Trace:
I20260709 13:06:34.213941 24768 raft_consensus.cc:2749] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P 0473d2b2d01f4459b1e90fd12cc7840e [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:06:34.304143 19409 raft_consensus.cc:2468] T f1b10566f45d4a7d9029858330e02d5b P e5256d91808b47c195bc9b4dbd7f2b87 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 15.
I20260709 13:06:34.247463 24482 leader_election.cc:290] T 62c6c134d3d24a1ab144dd9ee6bc3f64 P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:06:34.303017 19480 rpcz_store.cc:276] 0709 13:06:32.785383 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:33.384060 (+598677us) service_pool.cc:224] Handling call
0709 13:06:34.292275 (+908215us) spinlock_profiling.cc:243] Waited 42.5 ms on lock 0x7b54003e8fd4. stack: 00007f4a79de9343 00007f4a79de9240 00007f4a797781d4 00007f4a834b6304 00007f4a834b6299 00007f4a7ce71571 00007f4a7cf0c2fa 00007f4a81ecdb17 00007f4a7b4486d4 00007f4a7b448662 00007f4a7b448591 00007f4a7b44850c 00007f4a7b4477c2 00007f4a7b24348c 00007f4a7b2428c6 00007f4a7b24226f
0709 13:06:34.292469 (+   194us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":97759104}
I20260709 13:06:34.306775 19479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "775c229504194560ba9589bc2199b089" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:06:34.313151 19479 raft_consensus.cc:2468] T 775c229504194560ba9589bc2199b089 P 0473d2b2d01f4459b1e90fd12cc7840e [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 11.
I20260709 13:06:34.307108 19407 raft_consensus.cc:2468] T f93ee515a9c14139bf566522ed8232f3 P e5256d91808b47c195bc9b4dbd7f2b87 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 16.
I20260709 13:06:34.307829 19484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14935b3ddf914369822e4a0547aaa355" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:06:34.314420 19484 raft_consensus.cc:2468] T 14935b3ddf914369822e4a0547aaa355 P 0473d2b2d01f4459b1e90fd12cc7840e [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 10.
I20260709 13:06:34.308132 19486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dc5b3532fe54f74876d02beffa2c230" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 16 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:06:34.309626 19404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4af19371ea874c09a0a2147040835cbb" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:06:34.310448 19482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9962423cb4e54fcfa5de01daf68a86e7" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:06:34.316457 19482 raft_consensus.cc:2468] T 9962423cb4e54fcfa5de01daf68a86e7 P 0473d2b2d01f4459b1e90fd12cc7840e [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 13.
I20260709 13:06:34.261071 19403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65d8cb8d6ec64f459d5a47cefab10acf" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
I20260709 13:06:34.317085 19410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa731b585f684a7fb2d106c50f143b83" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:06:34.317708 19554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa8650e71aa14778b3d73721fc50d9fc" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:06:34.318138 19410 raft_consensus.cc:2410] T fa731b585f684a7fb2d106c50f143b83 P e5256d91808b47c195bc9b4dbd7f2b87 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e61c3a8f61bb48f8a963c9480e53c168 for term 13 because replica has last-logged OpId of term: 12 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 9.
I20260709 13:06:34.318408 19554 raft_consensus.cc:2393] T fa8650e71aa14778b3d73721fc50d9fc P e61c3a8f61bb48f8a963c9480e53c168 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate e5256d91808b47c195bc9b4dbd7f2b87 in current term 14: Already voted for candidate e61c3a8f61bb48f8a963c9480e53c168 in this term.
I20260709 13:06:34.312288 19375 leader_election.cc:304] T 86a6797bdfe94fa496c050ceae4bd0d9 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:06:34.324082 19375 leader_election.cc:304] T bc225c93219c45538b53a1bd3d387e4d P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:06:34.325433 19481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab43d85f64114d4ebf618930e43d9ed0" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:06:34.326184 19551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "833a2f0775ed407a94b8924ce50adb63" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:06:34.325435 19552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cdf56e38bbc453d9438d359e5a69955" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:06:34.322548 19486 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58294 (request call id 2500) took 1497 ms. Trace:
I20260709 13:06:34.328557 19486 rpcz_store.cc:276] 0709 13:06:32.824992 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:34.307858 (+1482866us) service_pool.cc:224] Handling call
0709 13:06:34.322478 (+ 14620us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:34.337648 19486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36f6ba92b9ba46babe4ebd6c02e5fbd9" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:06:34.338276 19486 raft_consensus.cc:2468] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P 0473d2b2d01f4459b1e90fd12cc7840e [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 16.
I20260709 13:06:34.259285 24466 consensus_queue.cc:1059] T edd7d470b5014c9489be7f41f64355c9 P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 }, Status: INVALID_TERM, Last received: 14.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.063s
I20260709 13:06:34.303756 24362 raft_consensus.cc:2749] T b9f0d59553ad444883fcf5b5909f9798 P e5256d91808b47c195bc9b4dbd7f2b87 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:06:34.348399 19523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.1:40321, user_credentials={real_user=slave}} blocked reactor thread for 57286.5us
W20260709 13:06:34.354909 20075 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:34.355010 19523 leader_election.cc:304] T 833a2f0775ed407a94b8924ce50adb63 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e61c3a8f61bb48f8a963c9480e53c168; no voters: 127766fc592545a4997f7790f50f6076, e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:06:34.363031 19486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa8650e71aa14778b3d73721fc50d9fc" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:06:34.336229 24372 raft_consensus.cc:2804] T 86a6797bdfe94fa496c050ceae4bd0d9 P e5256d91808b47c195bc9b4dbd7f2b87 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:06:34.341956 24457 raft_consensus.cc:2804] T bc225c93219c45538b53a1bd3d387e4d P e5256d91808b47c195bc9b4dbd7f2b87 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:06:34.341912 24768 raft_consensus.cc:2749] T 5ec1c4ce15e04c7e8c283a62179f2a64 P 0473d2b2d01f4459b1e90fd12cc7840e [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:06:34.376962 19554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85c494af21f9457a85da47b9bc70c1fd" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:06:34.381877 19554 raft_consensus.cc:2468] T 85c494af21f9457a85da47b9bc70c1fd P e61c3a8f61bb48f8a963c9480e53c168 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 14.
I20260709 13:06:34.383651 19523 leader_election.cc:304] T ece3db938bc649d4a40a51522ed5259c P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e61c3a8f61bb48f8a963c9480e53c168; no voters: 127766fc592545a4997f7790f50f6076, e5256d91808b47c195bc9b4dbd7f2b87
W20260709 13:06:34.386744 19449 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.1:40321, user_credentials={real_user=slave}} blocked reactor thread for 129498us
I20260709 13:06:34.387498 19449 leader_election.cc:304] T 775c229504194560ba9589bc2199b089 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e; no voters: 127766fc592545a4997f7790f50f6076, e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:06:34.345685 24597 consensus_queue.cc:1059] T 40e1e16737a842ee936002830f36882e P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 }, Status: INVALID_TERM, Last received: 15.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.042s
I20260709 13:06:34.291967 24640 consensus_queue.cc:260] T 2a16f7501e2444fb86d4e2778e734e02 P 127766fc592545a4997f7790f50f6076 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:34.349996 24756 consensus_queue.cc:1048] T 1a61655d99124a29b486ba4a5b37faea P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.050s
W20260709 13:06:34.459534 19523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.1:40321, user_credentials={real_user=slave}} blocked reactor thread for 76007.8us
I20260709 13:06:34.490629 19523 leader_election.cc:304] T 70797e5783b5454ab0d0eea663e791e3 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e61c3a8f61bb48f8a963c9480e53c168; no voters: 127766fc592545a4997f7790f50f6076, e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:06:34.428159 19554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1b10566f45d4a7d9029858330e02d5b" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
W20260709 13:06:34.459374 19449 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.1:40321, user_credentials={real_user=slave}} blocked reactor thread for 71960.5us
I20260709 13:06:34.492715 19554 raft_consensus.cc:2393] T f1b10566f45d4a7d9029858330e02d5b P e61c3a8f61bb48f8a963c9480e53c168 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e5256d91808b47c195bc9b4dbd7f2b87 in current term 15: Already voted for candidate e61c3a8f61bb48f8a963c9480e53c168 in this term.
I20260709 13:06:34.493121 19449 leader_election.cc:304] T 1f85fc4b527a48848e5faa083b604e36 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e; no voters: 127766fc592545a4997f7790f50f6076, e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:06:34.494954 20112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "775c229504194560ba9589bc2199b089" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:06:34.491775 19523 leader_election.cc:304] T 2b74109013a140ada21feeef92d6f563 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:06:34.416002 19482 raft_consensus.cc:1240] T 28af091831594f9d8e96482078cc7625 P 0473d2b2d01f4459b1e90fd12cc7840e [term 16 FOLLOWER]: Rejecting Update request from peer e5256d91808b47c195bc9b4dbd7f2b87 for earlier term 15. Current term is 16. Ops: []
I20260709 13:06:34.396090 19481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "217b5fae677b4971b3bbd2f357a1f7ff" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:06:34.499487 19481 raft_consensus.cc:2368] T 217b5fae677b4971b3bbd2f357a1f7ff P 0473d2b2d01f4459b1e90fd12cc7840e [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate e5256d91808b47c195bc9b4dbd7f2b87 for earlier term 11. Current term is 12.
I20260709 13:06:34.503543 19484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1b10566f45d4a7d9029858330e02d5b" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:06:34.497788 19523 leader_election.cc:304] T f1b10566f45d4a7d9029858330e02d5b P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:06:34.505226 19405 raft_consensus.cc:2468] T b9f0d59553ad444883fcf5b5909f9798 P e5256d91808b47c195bc9b4dbd7f2b87 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 14.
I20260709 13:06:34.425824 19555 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40428 (request call id 2871) took 1540 ms. Trace:
I20260709 13:06:34.381155 24372 raft_consensus.cc:493] T 86a6797bdfe94fa496c050ceae4bd0d9 P e5256d91808b47c195bc9b4dbd7f2b87 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 0473d2b2d01f4459b1e90fd12cc7840e)
I20260709 13:06:34.383791 24457 raft_consensus.cc:493] T bc225c93219c45538b53a1bd3d387e4d P e5256d91808b47c195bc9b4dbd7f2b87 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 0473d2b2d01f4459b1e90fd12cc7840e)
I20260709 13:06:34.384323 24478 leader_election.cc:290] T e381f1d6b8184797ad142de49be225a8 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
W20260709 13:06:34.451140 24736 log.cc:927] Time spent T 6c5eebf646ad445a9d1b1adc319d7b16 P 0473d2b2d01f4459b1e90fd12cc7840e: Append to log took a long time: real 1.236s	user 0.001s	sys 0.016s
I20260709 13:06:34.535540 20110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70797e5783b5454ab0d0eea663e791e3" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:06:34.452482 24782 raft_consensus.cc:3055] T edd7d470b5014c9489be7f41f64355c9 P 0473d2b2d01f4459b1e90fd12cc7840e [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:06:34.537811 19554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df751f992649444090e27965eb1af85d" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:06:34.543272 24782 raft_consensus.cc:740] T edd7d470b5014c9489be7f41f64355c9 P 0473d2b2d01f4459b1e90fd12cc7840e [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 0473d2b2d01f4459b1e90fd12cc7840e, State: Running, Role: LEADER
I20260709 13:06:34.543741 19554 raft_consensus.cc:2468] T df751f992649444090e27965eb1af85d P e61c3a8f61bb48f8a963c9480e53c168 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 17.
I20260709 13:06:34.544202 24782 consensus_queue.cc:260] T edd7d470b5014c9489be7f41f64355c9 P 0473d2b2d01f4459b1e90fd12cc7840e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.8, Last appended by leader: 8, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:34.544687 19554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e5873a19244c5ebbcd38e126796ee7" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 18 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:06:34.391525 24702 leader_election.cc:290] T b08304a0a02b42d7840c4e8ee9a6bd1a P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:06:34.545639 19402 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52342 (request call id 2810) took 2471 ms. Trace:
I20260709 13:06:34.545778 19554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70797e5783b5454ab0d0eea663e791e3" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:06:34.546233 24702 raft_consensus.cc:2749] T 70797e5783b5454ab0d0eea663e791e3 P e61c3a8f61bb48f8a963c9480e53c168 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:06:34.546053 19402 rpcz_store.cc:276] 0709 13:06:32.061218 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:32.063144 (+  1926us) service_pool.cc:224] Handling call
0709 13:06:34.047944 (+1984800us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:34.063151 (+ 15207us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:34.532428 (+469277us) spinlock_profiling.cc:243] Waited 1.98 s on lock 0x7b5400064d50. stack: 00007f4a79de9343 00007f4a79de9240 00007f4a797781d4 00007f4a834b6304 00007f4a834b6299 00007f4a7ce71571 00007f4a7cf078ad 00007f4a81ecc419 00007f4a7b443bd4 00007f4a7b443b62 00007f4a7b443a91 00007f4a7b443a0c 00007f4a7b442cc2 00007f4a7b24348c 00007f4a7b2428c6 00007f4a7b24226f
0709 13:06:34.532569 (+   141us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4563856768}
I20260709 13:06:34.547302 24702 raft_consensus.cc:2804] T 2b74109013a140ada21feeef92d6f563 P e61c3a8f61bb48f8a963c9480e53c168 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:06:34.547823 24702 raft_consensus.cc:697] T 2b74109013a140ada21feeef92d6f563 P e61c3a8f61bb48f8a963c9480e53c168 [term 12 LEADER]: Becoming Leader. State: Replica: e61c3a8f61bb48f8a963c9480e53c168, State: Running, Role: LEADER
I20260709 13:06:34.534575 20108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96efeaaf1057492490e9a621f37e1a2d" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:06:34.451892 24687 leader_election.cc:290] T 96efeaaf1057492490e9a621f37e1a2d P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:06:34.423020 24771 raft_consensus.cc:2804] T 179fd671030940b4b4a4e24bcc4aba0a P e61c3a8f61bb48f8a963c9480e53c168 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:06:34.452308 24700 leader_election.cc:290] T 217b5fae677b4971b3bbd2f357a1f7ff P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:06:34.531040 19556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "217b5fae677b4971b3bbd2f357a1f7ff" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:06:34.569274 19556 raft_consensus.cc:2368] T 217b5fae677b4971b3bbd2f357a1f7ff P e61c3a8f61bb48f8a963c9480e53c168 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate e5256d91808b47c195bc9b4dbd7f2b87 for earlier term 11. Current term is 12.
W20260709 13:06:34.549757 19449 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.1:40321, user_credentials={real_user=slave}} blocked reactor thread for 56717.5us
I20260709 13:06:34.550511 19554 raft_consensus.cc:2468] T 70797e5783b5454ab0d0eea663e791e3 P e61c3a8f61bb48f8a963c9480e53c168 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 14.
I20260709 13:06:34.508657 19555 rpcz_store.cc:276] 0709 13:06:32.885960 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:34.143402 (+1257442us) service_pool.cc:224] Handling call
0709 13:06:34.143720 (+   318us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:34.143944 (+   224us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 13:06:34.156210 (+ 12266us) log.cc:844] Serialized 14 byte log entry
0709 13:06:34.425311 (+269101us) log.cc:844] Serialized 14 byte log entry
0709 13:06:34.425480 (+   169us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:34.425530 (+    50us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:06:34.425581 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:34.425652 (+    71us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:34.425771 (+   119us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":16571,"prepare.queue_time_us":15904,"prepare.run_cpu_time_us":41,"prepare.run_wall_time_us":42,"raft.queue_time_us":113417,"raft.run_cpu_time_us":62,"raft.run_wall_time_us":62,"spinlock_wait_cycles":14417792,"thread_start_us":228609,"threads_started":2,"wal-append.queue_time_us":196228}
I20260709 13:06:34.511423 20112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36f6ba92b9ba46babe4ebd6c02e5fbd9" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:06:34.459529 19552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4af19371ea874c09a0a2147040835cbb" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:06:34.588382 19552 raft_consensus.cc:1275] T ef32ce6fdd0e40d382c79974f30295c6 P e61c3a8f61bb48f8a963c9480e53c168 [term 17 FOLLOWER]: Refusing update from remote peer e5256d91808b47c195bc9b4dbd7f2b87: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
I20260709 13:06:34.588991 19552 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40438 (request call id 2670) took 1088 ms. Trace:
I20260709 13:06:34.589345 19552 rpcz_store.cc:276] 0709 13:06:33.500658 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:34.587753 (+1087095us) service_pool.cc:224] Handling call
0709 13:06:34.588025 (+   272us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:34.588753 (+   728us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:34.588938 (+   185us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:34.455248 19551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14935b3ddf914369822e4a0547aaa355" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:06:34.537065 24781 raft_consensus.cc:2749] T ece3db938bc649d4a40a51522ed5259c P e61c3a8f61bb48f8a963c9480e53c168 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:06:34.545490 24782 raft_consensus.cc:3060] T edd7d470b5014c9489be7f41f64355c9 P 0473d2b2d01f4459b1e90fd12cc7840e [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:06:34.532725 20104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "833a2f0775ed407a94b8924ce50adb63" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:06:34.451143 24761 raft_consensus.cc:2749] T 775c229504194560ba9589bc2199b089 P 0473d2b2d01f4459b1e90fd12cc7840e [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:06:34.435802 24785 consensus_queue.cc:1048] T d1e5873a19244c5ebbcd38e126796ee7 P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.172s
I20260709 13:06:34.530411 24372 raft_consensus.cc:3060] T 86a6797bdfe94fa496c050ceae4bd0d9 P e5256d91808b47c195bc9b4dbd7f2b87 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:06:34.529870 24457 raft_consensus.cc:3060] T bc225c93219c45538b53a1bd3d387e4d P e5256d91808b47c195bc9b4dbd7f2b87 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:06:34.550150 19450 leader_election.cc:304] T 1efebf73c86e432baa55533136b6e12c P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168; no voters: 127766fc592545a4997f7790f50f6076
I20260709 13:06:34.595569 19481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b74109013a140ada21feeef92d6f563" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:06:34.611285 19481 raft_consensus.cc:2368] T 2b74109013a140ada21feeef92d6f563 P 0473d2b2d01f4459b1e90fd12cc7840e [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e5256d91808b47c195bc9b4dbd7f2b87 for earlier term 11. Current term is 12.
I20260709 13:06:34.598340 19449 leader_election.cc:304] T 2b74109013a140ada21feeef92d6f563 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87; no voters: e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:06:34.598563 19555 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40438 (request call id 2660) took 1144 ms. Trace:
I20260709 13:06:34.425012 24789 raft_consensus.cc:2749] T 833a2f0775ed407a94b8924ce50adb63 P e61c3a8f61bb48f8a963c9480e53c168 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:06:34.395989 24678 raft_consensus.cc:697] T 22196caba61445d3bec98a0aab3c337d P e61c3a8f61bb48f8a963c9480e53c168 [term 13 LEADER]: Becoming Leader. State: Replica: e61c3a8f61bb48f8a963c9480e53c168, State: Running, Role: LEADER
I20260709 13:06:34.612803 19555 rpcz_store.cc:276] 0709 13:06:33.453678 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:34.586534 (+1132856us) service_pool.cc:224] Handling call
0709 13:06:34.586877 (+   343us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:34.587062 (+   185us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:34.598279 (+ 11217us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:34.598324 (+    45us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:06:34.598360 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:34.598415 (+    55us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:34.598512 (+    97us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:34.616775 19552 raft_consensus.cc:1275] T 85c494af21f9457a85da47b9bc70c1fd P e61c3a8f61bb48f8a963c9480e53c168 [term 14 FOLLOWER]: Refusing update from remote peer 127766fc592545a4997f7790f50f6076: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 13:06:34.583729 24687 raft_consensus.cc:2804] T f1b10566f45d4a7d9029858330e02d5b P e61c3a8f61bb48f8a963c9480e53c168 [term 15 FOLLOWER]: Leader election won for term 15
W20260709 13:06:34.692466 19450 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.3:36891, user_credentials={real_user=slave}} blocked reactor thread for 142378us
I20260709 13:06:34.692773 19449 leader_election.cc:304] T 1dc5b3532fe54f74876d02beffa2c230 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87; no voters: 
I20260709 13:06:34.453279 24682 leader_election.cc:290] T df751f992649444090e27965eb1af85d P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:06:34.567819 24671 raft_consensus.cc:2749] T 1f85fc4b527a48848e5faa083b604e36 P 0473d2b2d01f4459b1e90fd12cc7840e [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:06:34.642498 24771 raft_consensus.cc:697] T 179fd671030940b4b4a4e24bcc4aba0a P e61c3a8f61bb48f8a963c9480e53c168 [term 17 LEADER]: Becoming Leader. State: Replica: e61c3a8f61bb48f8a963c9480e53c168, State: Running, Role: LEADER
I20260709 13:06:34.644944 24678 consensus_queue.cc:237] T 22196caba61445d3bec98a0aab3c337d P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:34.575311 24691 consensus_queue.cc:1059] T 2a16f7501e2444fb86d4e2778e734e02 P 127766fc592545a4997f7790f50f6076 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 }, Status: INVALID_TERM, Last received: 13.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.076s
I20260709 13:06:34.657658 24766 raft_consensus.cc:515] T 0e1085d23e8347fbbd5bce7542f4b1f4 P 127766fc592545a4997f7790f50f6076 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:34.659216 19558 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40428 (request call id 2870) took 1825 ms. Trace:
I20260709 13:06:34.665335 24362 raft_consensus.cc:3055] T 40e1e16737a842ee936002830f36882e P e5256d91808b47c195bc9b4dbd7f2b87 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:06:34.608278 24793 consensus_queue.cc:1059] T 46c5bfeecc314717bffe987e6844b6d0 P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 }, Status: INVALID_TERM, Last received: 19.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.059s
I20260709 13:06:34.667207 24776 raft_consensus.cc:2804] T 1efebf73c86e432baa55533136b6e12c P 0473d2b2d01f4459b1e90fd12cc7840e [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:06:34.669817 19553 raft_consensus.cc:1240] T ece3db938bc649d4a40a51522ed5259c P e61c3a8f61bb48f8a963c9480e53c168 [term 11 FOLLOWER]: Rejecting Update request from peer e5256d91808b47c195bc9b4dbd7f2b87 for earlier term 10. Current term is 11. Ops: []
I20260709 13:06:34.673772 20106 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35874 (request call id 976) took 1902 ms. Trace:
I20260709 13:06:34.676952 24555 raft_consensus.cc:515] T a08760e15aac4630a629431f56024dc8 P e5256d91808b47c195bc9b4dbd7f2b87 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:34.677538 19406 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52328 (request call id 2236) took 2204 ms. Trace:
I20260709 13:06:34.715772 19406 rpcz_store.cc:276] 0709 13:06:32.472872 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:32.632711 (+159839us) service_pool.cc:224] Handling call
0709 13:06:33.938178 (+1305467us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:06:33.938657 (+   479us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:33.938722 (+    65us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:06:33.941588 (+  2866us) log.cc:844] Serialized 52 byte log entry
0709 13:06:34.238373 (+296785us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:06:34.238419 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:34.238483 (+    64us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:34.251255 (+ 12772us) raft_consensus.cc:1685] finished
0709 13:06:34.251275 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:34.677158 (+425883us) spinlock_profiling.cc:243] Waited 1.3 s on lock 0x7b5400249d50. stack: 00007f4a79de9343 00007f4a79de9240 00007f4a797781d4 00007f4a834b6304 00007f4a834b6299 00007f4a7ce71571 00007f4a7cf078ad 00007f4a81ecc419 00007f4a7b443bd4 00007f4a7b443b62 00007f4a7b443a91 00007f4a7b443a0c 00007f4a7b442cc2 00007f4a7b24348c 00007f4a7b2428c6 00007f4a7b24226f
0709 13:06:34.677457 (+   299us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":896,"raft.queue_time_us":1253,"raft.run_cpu_time_us":116,"raft.run_wall_time_us":10834,"spinlock_wait_cycles":2998556544,"thread_start_us":236281,"threads_started":1,"wal-append.queue_time_us":255529}
I20260709 13:06:34.688025 19556 raft_consensus.cc:1275] T 4509b76741dc428e9201c70c1658da13 P e61c3a8f61bb48f8a963c9480e53c168 [term 10 FOLLOWER]: Refusing update from remote peer e5256d91808b47c195bc9b4dbd7f2b87: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:06:34.553795 24734 leader_election.cc:290] T ff75a1d4cb1f493db8f71ddc136ba9ab P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:06:34.690410 20076 leader_election.cc:304] T ed7fdbcb96d14d418db9ca90a792588a P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 127766fc592545a4997f7790f50f6076, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:06:34.693374 19450 leader_election.cc:304] T 40e1e16737a842ee936002830f36882e P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e; no voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:06:34.661820 24372 raft_consensus.cc:515] T 86a6797bdfe94fa496c050ceae4bd0d9 P e5256d91808b47c195bc9b4dbd7f2b87 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
W20260709 13:06:34.700157 19526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.2:46257, user_credentials={real_user=slave}} blocked reactor thread for 404358us
I20260709 13:06:34.702242 20106 rpcz_store.cc:276] 0709 13:06:32.771660 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:32.771971 (+   311us) service_pool.cc:224] Handling call
0709 13:06:32.780797 (+  8826us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:33.456336 (+675539us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:34.673400 (+1217064us) spinlock_profiling.cc:243] Waited 658 ms on lock 0x7b540036d3d4. stack: 00007f4a79de9343 00007f4a79de9240 00007f4a797781d4 00007f4a834b6304 00007f4a834b6299 00007f4a7ce71571 00007f4a7cf08e01 00007f4a7cf0783e 00007f4a81ecc419 00007f4a7b443bd4 00007f4a7b443b62 00007f4a7b443a91 00007f4a7b443a0c 00007f4a7b442cc2 00007f4a7b24348c 00007f4a7b2428c6
0709 13:06:34.673693 (+   293us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1513274752}
W20260709 13:06:34.702940 20078 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:34.641047 24466 raft_consensus.cc:2764] T 2b74109013a140ada21feeef92d6f563 P 0473d2b2d01f4459b1e90fd12cc7840e [term 12 FOLLOWER]: Leader pre-election decision vote started in defunct term 11: won
I20260709 13:06:34.719084 19556 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40438 (request call id 2659) took 1265 ms. Trace:
I20260709 13:06:34.717607 19449 leader_election.cc:304] T 217b5fae677b4971b3bbd2f357a1f7ff P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87; no voters: 
I20260709 13:06:34.724141 24597 raft_consensus.cc:493] T ab43d85f64114d4ebf618930e43d9ed0 P e5256d91808b47c195bc9b4dbd7f2b87 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:34.738531 24555 leader_election.cc:290] T a08760e15aac4630a629431f56024dc8 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 18 election: Requested vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:06:34.738415 19556 rpcz_store.cc:276] 0709 13:06:33.453377 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:34.569898 (+1116521us) service_pool.cc:224] Handling call
0709 13:06:34.687651 (+117753us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:34.718844 (+ 31193us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:34.719033 (+   189us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:34.739328 24276 raft_consensus.cc:2749] T 40e1e16737a842ee936002830f36882e P 0473d2b2d01f4459b1e90fd12cc7840e [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:06:34.739033 24597 raft_consensus.cc:515] T ab43d85f64114d4ebf618930e43d9ed0 P e5256d91808b47c195bc9b4dbd7f2b87 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } attrs { replace: true } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:34.741427 24372 leader_election.cc:290] T 86a6797bdfe94fa496c050ceae4bd0d9 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 11 election: Requested vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:06:34.701610 19558 rpcz_store.cc:276] 0709 13:06:32.834716 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:34.063564 (+1228848us) service_pool.cc:224] Handling call
0709 13:06:34.063821 (+   257us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:34.063997 (+   176us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:06:34.263108 (+199111us) log.cc:844] Serialized 14 byte log entry
0709 13:06:34.658844 (+395736us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:34.658896 (+    52us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:06:34.658939 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:34.659021 (+    82us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:34.659146 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":83717,"prepare.queue_time_us":280235,"prepare.run_cpu_time_us":54,"prepare.run_wall_time_us":55,"raft.queue_time_us":149531,"raft.run_cpu_time_us":164,"raft.run_wall_time_us":7735,"thread_start_us":515425,"threads_started":3,"wal-append.queue_time_us":376146}
I20260709 13:06:34.730402 19402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ece3db938bc649d4a40a51522ed5259c" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
I20260709 13:06:34.548820 24702 consensus_queue.cc:237] T 2b74109013a140ada21feeef92d6f563 P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:34.729774 19450 leader_election.cc:304] T 21e14947d70440f19044d8f75c31e1f9 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e; no voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:06:34.733830 19526 leader_election.cc:304] T ff75a1d4cb1f493db8f71ddc136ba9ab P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e61c3a8f61bb48f8a963c9480e53c168; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:06:34.743372 19553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62c6c134d3d24a1ab144dd9ee6bc3f64" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:06:34.744689 19406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff9b0eddd810459b82d91c60777c10eb" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
I20260709 13:06:34.746717 19526 leader_election.cc:304] T bc225c93219c45538b53a1bd3d387e4d P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e61c3a8f61bb48f8a963c9480e53c168; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:06:34.701685 24687 raft_consensus.cc:697] T f1b10566f45d4a7d9029858330e02d5b P e61c3a8f61bb48f8a963c9480e53c168 [term 15 LEADER]: Becoming Leader. State: Replica: e61c3a8f61bb48f8a963c9480e53c168, State: Running, Role: LEADER
I20260709 13:06:34.748492 19526 leader_election.cc:304] T 46c5bfeecc314717bffe987e6844b6d0 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e61c3a8f61bb48f8a963c9480e53c168; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:06:34.748524 19374 leader_election.cc:304] T 7be9efa6559648dbb5a0f7684c4542d1 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 127766fc592545a4997f7790f50f6076, e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:06:34.704630 24776 raft_consensus.cc:493] T 1efebf73c86e432baa55533136b6e12c P 0473d2b2d01f4459b1e90fd12cc7840e [term 12 FOLLOWER]: Starting leader election (detected failure of leader 127766fc592545a4997f7790f50f6076)
I20260709 13:06:34.703794 24362 raft_consensus.cc:740] T 40e1e16737a842ee936002830f36882e P e5256d91808b47c195bc9b4dbd7f2b87 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: e5256d91808b47c195bc9b4dbd7f2b87, State: Running, Role: LEADER
W20260709 13:06:34.733343 24747 consensus_meta.cc:287] T 76cb037fc9064d13b59a8969d897ce8c P e61c3a8f61bb48f8a963c9480e53c168: Time spent flushing consensus metadata: real 0.878s	user 0.009s	sys 0.002s
I20260709 13:06:34.730978 24559 raft_consensus.cc:2804] T 1dc5b3532fe54f74876d02beffa2c230 P 0473d2b2d01f4459b1e90fd12cc7840e [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:06:34.716647 24682 raft_consensus.cc:493] T fa731b585f684a7fb2d106c50f143b83 P e5256d91808b47c195bc9b4dbd7f2b87 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 127766fc592545a4997f7790f50f6076)
I20260709 13:06:34.762769 19526 leader_election.cc:304] T 1a61655d99124a29b486ba4a5b37faea P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168; no voters: e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:06:34.763885 19526 leader_election.cc:304] T 0e1085d23e8347fbbd5bce7542f4b1f4 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e61c3a8f61bb48f8a963c9480e53c168; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, 127766fc592545a4997f7790f50f6076
I20260709 13:06:34.741840 24597 leader_election.cc:290] T ab43d85f64114d4ebf618930e43d9ed0 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:06:34.738768 24758 raft_consensus.cc:2804] T ed7fdbcb96d14d418db9ca90a792588a P 127766fc592545a4997f7790f50f6076 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:06:34.764786 19450 leader_election.cc:304] T ef32ce6fdd0e40d382c79974f30295c6 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168; no voters: e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:06:34.773265 24795 raft_consensus.cc:2804] T 1a61655d99124a29b486ba4a5b37faea P e61c3a8f61bb48f8a963c9480e53c168 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:06:34.773388 20112 raft_consensus.cc:1240] T ab43d85f64114d4ebf618930e43d9ed0 P 127766fc592545a4997f7790f50f6076 [term 16 FOLLOWER]: Rejecting Update request from peer 0473d2b2d01f4459b1e90fd12cc7840e for earlier term 15. Current term is 16. Ops: []
I20260709 13:06:34.773698 24791 raft_consensus.cc:2749] T 0e1085d23e8347fbbd5bce7542f4b1f4 P e61c3a8f61bb48f8a963c9480e53c168 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:06:34.773975 24796 raft_consensus.cc:2749] T 21e14947d70440f19044d8f75c31e1f9 P 0473d2b2d01f4459b1e90fd12cc7840e [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 13:06:34.775170 19451 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:34.789674 19560 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40428 (request call id 2868) took 1982 ms. Trace:
I20260709 13:06:34.754838 24776 raft_consensus.cc:3060] T 1efebf73c86e432baa55533136b6e12c P 0473d2b2d01f4459b1e90fd12cc7840e [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:06:34.791364 24766 leader_election.cc:290] T 0e1085d23e8347fbbd5bce7542f4b1f4 P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 12 election: Requested vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:06:34.765277 24747 raft_consensus.cc:515] T 76cb037fc9064d13b59a8969d897ce8c P e61c3a8f61bb48f8a963c9480e53c168 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:34.794345 24747 leader_election.cc:290] T 76cb037fc9064d13b59a8969d897ce8c P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 13 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
W20260709 13:06:34.795346 24551 consensus_meta.cc:287] T 76cb037fc9064d13b59a8969d897ce8c P e5256d91808b47c195bc9b4dbd7f2b87: Time spent flushing consensus metadata: real 0.653s	user 0.013s	sys 0.000s
I20260709 13:06:34.795755 24551 raft_consensus.cc:515] T 76cb037fc9064d13b59a8969d897ce8c P e5256d91808b47c195bc9b4dbd7f2b87 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:34.797855 24551 leader_election.cc:290] T 76cb037fc9064d13b59a8969d897ce8c P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 13 election: Requested vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:06:34.798740 19478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f575b143b844aa096b50997dad3516a" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:06:34.799360 19478 raft_consensus.cc:2468] T 7f575b143b844aa096b50997dad3516a P 0473d2b2d01f4459b1e90fd12cc7840e [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 10.
W20260709 13:06:34.801745 24767 consensus_meta.cc:287] T 6c5eebf646ad445a9d1b1adc319d7b16 P 127766fc592545a4997f7790f50f6076: Time spent flushing consensus metadata: real 0.757s	user 0.010s	sys 0.001s
I20260709 13:06:34.775386 19526 leader_election.cc:304] T fa8650e71aa14778b3d73721fc50d9fc P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e61c3a8f61bb48f8a963c9480e53c168; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:06:34.804836 19526 leader_election.cc:400] T e381f1d6b8184797ad142de49be225a8 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 11 election: Vote denied by peer 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257) with higher term. Message: Invalid argument: T e381f1d6b8184797ad142de49be225a8 P 0473d2b2d01f4459b1e90fd12cc7840e [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate e61c3a8f61bb48f8a963c9480e53c168 for earlier term 11. Current term is 12.
I20260709 13:06:34.806154 19526 leader_election.cc:304] T 62c6c134d3d24a1ab144dd9ee6bc3f64 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e61c3a8f61bb48f8a963c9480e53c168; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, 127766fc592545a4997f7790f50f6076
I20260709 13:06:34.749213 24789 raft_consensus.cc:2749] T bc225c93219c45538b53a1bd3d387e4d P e61c3a8f61bb48f8a963c9480e53c168 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:06:34.764405 24555 raft_consensus.cc:2804] T 7be9efa6559648dbb5a0f7684c4542d1 P e5256d91808b47c195bc9b4dbd7f2b87 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:06:34.806977 24555 raft_consensus.cc:493] T 7be9efa6559648dbb5a0f7684c4542d1 P e5256d91808b47c195bc9b4dbd7f2b87 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 0473d2b2d01f4459b1e90fd12cc7840e)
I20260709 13:06:34.807215 24796 raft_consensus.cc:2804] T ef32ce6fdd0e40d382c79974f30295c6 P 0473d2b2d01f4459b1e90fd12cc7840e [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:06:34.783905 19449 leader_election.cc:304] T ff9b0eddd810459b82d91c60777c10eb P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e; no voters: 127766fc592545a4997f7790f50f6076, e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:06:34.776479 24781 raft_consensus.cc:2749] T 46c5bfeecc314717bffe987e6844b6d0 P e61c3a8f61bb48f8a963c9480e53c168 [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 13:06:34.807715 24796 raft_consensus.cc:493] T ef32ce6fdd0e40d382c79974f30295c6 P 0473d2b2d01f4459b1e90fd12cc7840e [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:34.808228 24796 raft_consensus.cc:3060] T ef32ce6fdd0e40d382c79974f30295c6 P 0473d2b2d01f4459b1e90fd12cc7840e [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:06:34.808619 19449 leader_election.cc:304] T 14efcc79969f41babe5529c22d59156d P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e; no voters: 127766fc592545a4997f7790f50f6076, e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:06:34.810005 19449 leader_election.cc:304] T 9962423cb4e54fcfa5de01daf68a86e7 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e; no voters: 127766fc592545a4997f7790f50f6076, e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:06:34.810962 19523 leader_election.cc:304] T 4af19371ea874c09a0a2147040835cbb P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e61c3a8f61bb48f8a963c9480e53c168; no voters: 127766fc592545a4997f7790f50f6076, e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:06:34.811194 24466 raft_consensus.cc:2749] T ff9b0eddd810459b82d91c60777c10eb P 0473d2b2d01f4459b1e90fd12cc7840e [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:06:34.811791 24797 raft_consensus.cc:2749] T 14efcc79969f41babe5529c22d59156d P 0473d2b2d01f4459b1e90fd12cc7840e [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:06:34.785931 24687 consensus_queue.cc:237] T f1b10566f45d4a7d9029858330e02d5b P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:34.812427 24466 raft_consensus.cc:2749] T 9962423cb4e54fcfa5de01daf68a86e7 P 0473d2b2d01f4459b1e90fd12cc7840e [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:06:34.751351 24691 consensus_queue.cc:1048] T 85c494af21f9457a85da47b9bc70c1fd P 127766fc592545a4997f7790f50f6076 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.035s
I20260709 13:06:34.787002 20110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab43d85f64114d4ebf618930e43d9ed0" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:06:34.814862 20110 raft_consensus.cc:1813] T ab43d85f64114d4ebf618930e43d9ed0 P 127766fc592545a4997f7790f50f6076 [term 16 FOLLOWER]: Handling vote request from an unknown peer e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:06:34.778329 24734 raft_consensus.cc:2804] T 217b5fae677b4971b3bbd2f357a1f7ff P 0473d2b2d01f4459b1e90fd12cc7840e [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:06:34.815351 20110 raft_consensus.cc:2393] T ab43d85f64114d4ebf618930e43d9ed0 P 127766fc592545a4997f7790f50f6076 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e5256d91808b47c195bc9b4dbd7f2b87 in current term 16: Already voted for candidate 127766fc592545a4997f7790f50f6076 in this term.
I20260709 13:06:34.803864 19450 leader_election.cc:304] T 2e36a9d6e29c4a7c860cf267efbd4c74 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e; no voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:06:34.816325 19526 leader_election.cc:304] T 40e1e16737a842ee936002830f36882e P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e61c3a8f61bb48f8a963c9480e53c168; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87
W20260709 13:06:34.810222 19375 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:34.790055 19560 rpcz_store.cc:276] 0709 13:06:32.807304 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:34.061704 (+1254400us) service_pool.cc:224] Handling call
0709 13:06:34.061975 (+   271us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:34.062157 (+   182us) raft_consensus.cc:1534] Early marking committed up to index 12
0709 13:06:34.240723 (+178566us) log.cc:844] Serialized 14 byte log entry
0709 13:06:34.789214 (+548491us) spinlock_profiling.cc:243] Waited 1.37 ms on lock 0x7b18001cbca0. stack: 00007f4a79de9343 00007f4a79de9240 00007f4a797781d4 00007f4a834b6304 00007f4a834b6299 00007f4a82ce3de1 00007f4a82cf05b1 00007f4a7cab04bc 00007f4a79dfe48b 00007f4a82c58ab9 00007f4a79e1a69b 00007f4a79e1893f 00007f4a79e18455 00007f4a7cf00060 00007f4a7cf12716 00007f4a7cf23287
0709 13:06:34.789335 (+   121us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:34.789393 (+    58us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:06:34.789450 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:34.789517 (+    67us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:34.789624 (+   107us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":265905,"prepare.run_cpu_time_us":62,"prepare.run_wall_time_us":63,"raft.queue_time_us":111753,"raft.run_cpu_time_us":138,"raft.run_wall_time_us":1615,"spinlock_wait_cycles":3157248,"thread_start_us":224994,"threads_started":3,"wal-append.queue_time_us":136300}
I20260709 13:06:34.841112 19402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76cb037fc9064d13b59a8969d897ce8c" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
I20260709 13:06:34.841265 19375 leader_election.cc:304] T 833a2f0775ed407a94b8924ce50adb63 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87; no voters: 127766fc592545a4997f7790f50f6076, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:06:34.764595 24559 raft_consensus.cc:493] T 1dc5b3532fe54f74876d02beffa2c230 P 0473d2b2d01f4459b1e90fd12cc7840e [term 15 FOLLOWER]: Starting leader election (detected failure of leader e61c3a8f61bb48f8a963c9480e53c168)
I20260709 13:06:34.807451 24555 raft_consensus.cc:3060] T 7be9efa6559648dbb5a0f7684c4542d1 P e5256d91808b47c195bc9b4dbd7f2b87 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:06:34.842836 19450 leader_election.cc:304] T 7f575b143b844aa096b50997dad3516a P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e; no voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:06:34.843084 19523 leader_election.cc:304] T 65d8cb8d6ec64f459d5a47cefab10acf P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e61c3a8f61bb48f8a963c9480e53c168; no voters: 127766fc592545a4997f7790f50f6076, e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:06:34.845112 19407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edd7d470b5014c9489be7f41f64355c9" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:06:34.854621 19407 raft_consensus.cc:2393] T edd7d470b5014c9489be7f41f64355c9 P e5256d91808b47c195bc9b4dbd7f2b87 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e61c3a8f61bb48f8a963c9480e53c168 in current term 16: Already voted for candidate e5256d91808b47c195bc9b4dbd7f2b87 in this term.
W20260709 13:06:34.836567 20075 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.1:40321, user_credentials={real_user=slave}} blocked reactor thread for 288353us
I20260709 13:06:34.840085 19405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cdf56e38bbc453d9438d359e5a69955" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:06:34.851576 19402 raft_consensus.cc:2393] T 76cb037fc9064d13b59a8969d897ce8c P e5256d91808b47c195bc9b4dbd7f2b87 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate e61c3a8f61bb48f8a963c9480e53c168 in current term 13: Already voted for candidate e5256d91808b47c195bc9b4dbd7f2b87 in this term.
I20260709 13:06:34.855718 19405 raft_consensus.cc:2393] T 0cdf56e38bbc453d9438d359e5a69955 P e5256d91808b47c195bc9b4dbd7f2b87 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e61c3a8f61bb48f8a963c9480e53c168 in current term 15: Already voted for candidate e5256d91808b47c195bc9b4dbd7f2b87 in this term.
I20260709 13:06:34.846030 19403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b08304a0a02b42d7840c4e8ee9a6bd1a" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:06:34.859356 19557 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40428 (request call id 2869) took 2048 ms. Trace:
I20260709 13:06:34.778754 24795 raft_consensus.cc:493] T 1a61655d99124a29b486ba4a5b37faea P e61c3a8f61bb48f8a963c9480e53c168 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:34.776049 24758 raft_consensus.cc:493] T ed7fdbcb96d14d418db9ca90a792588a P 127766fc592545a4997f7790f50f6076 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 0473d2b2d01f4459b1e90fd12cc7840e)
I20260709 13:06:34.802211 24767 raft_consensus.cc:515] T 6c5eebf646ad445a9d1b1adc319d7b16 P 127766fc592545a4997f7790f50f6076 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:34.865908 19450 leader_election.cc:304] T 1a61655d99124a29b486ba4a5b37faea P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e; no voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:06:34.864200 24806 consensus_queue.cc:1048] T 85c494af21f9457a85da47b9bc70c1fd P 127766fc592545a4997f7790f50f6076 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.006s
I20260709 13:06:34.856817 24362 consensus_queue.cc:260] T 40e1e16737a842ee936002830f36882e P e5256d91808b47c195bc9b4dbd7f2b87 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.8, Last appended by leader: 8, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:34.879603 19375 leader_election.cc:304] T 85c494af21f9457a85da47b9bc70c1fd P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168; no voters: 127766fc592545a4997f7790f50f6076
I20260709 13:06:34.880340 20110 raft_consensus.cc:1240] T 0e1085d23e8347fbbd5bce7542f4b1f4 P 127766fc592545a4997f7790f50f6076 [term 12 FOLLOWER]: Rejecting Update request from peer 0473d2b2d01f4459b1e90fd12cc7840e for earlier term 11. Current term is 12. Ops: []
I20260709 13:06:34.853451 24752 raft_consensus.cc:493] T 22196caba61445d3bec98a0aab3c337d P e5256d91808b47c195bc9b4dbd7f2b87 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:06:34.857245 24545 consensus_meta.cc:287] T 48824d5acfbc485ebf8c2d944e7202de P e61c3a8f61bb48f8a963c9480e53c168: Time spent flushing consensus metadata: real 0.784s	user 0.010s	sys 0.001s
I20260709 13:06:34.873064 19450 leader_election.cc:304] T 179fd671030940b4b4a4e24bcc4aba0a P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e; no voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:06:34.868680 20075 leader_election.cc:304] T ece3db938bc649d4a40a51522ed5259c P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 127766fc592545a4997f7790f50f6076; no voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168
W20260709 13:06:34.895473 20075 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:34.858039 24559 raft_consensus.cc:3060] T 1dc5b3532fe54f74876d02beffa2c230 P 0473d2b2d01f4459b1e90fd12cc7840e [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:06:34.851850 24785 raft_consensus.cc:2749] T 62c6c134d3d24a1ab144dd9ee6bc3f64 P e61c3a8f61bb48f8a963c9480e53c168 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:06:34.871840 19523 leader_election.cc:304] T f93ee515a9c14139bf566522ed8232f3 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168; no voters: 0473d2b2d01f4459b1e90fd12cc7840e
I20260709 13:06:34.859738 19557 rpcz_store.cc:276] 0709 13:06:32.811328 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:34.062363 (+1251035us) service_pool.cc:224] Handling call
0709 13:06:34.071694 (+  9331us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:34.071915 (+   221us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:06:34.320536 (+248621us) log.cc:844] Serialized 14 byte log entry
0709 13:06:34.813156 (+492620us) spinlock_profiling.cc:243] Waited 4.82 ms on lock 0x7b1800309940. stack: 00007f4a79de9343 00007f4a79de9240 00007f4a797781d4 00007f4a834b6304 00007f4a834b6299 00007f4a82ce3de1 00007f4a82cf05b1 00007f4a7cab04bc 00007f4a79dfe48b 00007f4a82c58ab9 00007f4a79e1a69b 00007f4a79e1893f 00007f4a79e1ac02 00007f4a7caa220b 00007f4a7caa7d23 00007f4a7caa823a
0709 13:06:34.859043 (+ 45887us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:34.859094 (+    51us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:06:34.859145 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:34.859207 (+    62us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:34.859307 (+   100us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":138670,"prepare.queue_time_us":275653,"prepare.run_cpu_time_us":43,"prepare.run_wall_time_us":45,"spinlock_wait_cycles":11091200,"thread_start_us":356498,"threads_started":2,"wal-append.queue_time_us":169801}
I20260709 13:06:34.779958 24597 consensus_queue.cc:1059] T ece3db938bc649d4a40a51522ed5259c P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false }, Status: INVALID_TERM, Last received: 10.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.092s
I20260709 13:06:34.861378 24471 consensus_queue.cc:1059] T fa8650e71aa14778b3d73721fc50d9fc P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 }, Status: INVALID_TERM, Last received: 13.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.022s
I20260709 13:06:34.776731 24682 raft_consensus.cc:515] T fa731b585f684a7fb2d106c50f143b83 P e5256d91808b47c195bc9b4dbd7f2b87 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:34.868363 24795 raft_consensus.cc:3060] T 1a61655d99124a29b486ba4a5b37faea P e61c3a8f61bb48f8a963c9480e53c168 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:06:34.785020 24771 consensus_queue.cc:237] T 179fd671030940b4b4a4e24bcc4aba0a P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:34.857719 24781 raft_consensus.cc:2749] T 4af19371ea874c09a0a2147040835cbb P e61c3a8f61bb48f8a963c9480e53c168 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:06:34.856015 24671 raft_consensus.cc:2749] T 2e36a9d6e29c4a7c860cf267efbd4c74 P 0473d2b2d01f4459b1e90fd12cc7840e [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:06:34.840337 24789 consensus_queue.cc:1048] T d1e5873a19244c5ebbcd38e126796ee7 P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.046s
I20260709 13:06:34.837500 24794 raft_consensus.cc:2749] T fa8650e71aa14778b3d73721fc50d9fc P e61c3a8f61bb48f8a963c9480e53c168 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:06:34.882196 19553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a08760e15aac4630a629431f56024dc8" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:06:34.882521 19558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86a6797bdfe94fa496c050ceae4bd0d9" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:06:34.884994 19556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab43d85f64114d4ebf618930e43d9ed0" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
W20260709 13:06:34.872044 24633 consensus_meta.cc:287] T 86a6797bdfe94fa496c050ceae4bd0d9 P e61c3a8f61bb48f8a963c9480e53c168: Time spent flushing consensus metadata: real 0.835s	user 0.010s	sys 0.001s
I20260709 13:06:34.864588 24756 raft_consensus.cc:2749] T 833a2f0775ed407a94b8924ce50adb63 P e5256d91808b47c195bc9b4dbd7f2b87 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:06:34.864374 24791 raft_consensus.cc:2749] T 40e1e16737a842ee936002830f36882e P e61c3a8f61bb48f8a963c9480e53c168 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:06:34.889320 20104 raft_consensus.cc:1240] T 6c5eebf646ad445a9d1b1adc319d7b16 P 127766fc592545a4997f7790f50f6076 [term 15 FOLLOWER]: Rejecting Update request from peer 0473d2b2d01f4459b1e90fd12cc7840e for earlier term 14. Current term is 15. Ops: [14.11-14.11]
I20260709 13:06:34.880250 24362 raft_consensus.cc:3060] T 40e1e16737a842ee936002830f36882e P e5256d91808b47c195bc9b4dbd7f2b87 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:06:34.886170 24776 raft_consensus.cc:515] T 1efebf73c86e432baa55533136b6e12c P 0473d2b2d01f4459b1e90fd12cc7840e [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:34.871287 24758 raft_consensus.cc:3060] T ed7fdbcb96d14d418db9ca90a792588a P 127766fc592545a4997f7790f50f6076 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:06:34.864919 24734 raft_consensus.cc:697] T 217b5fae677b4971b3bbd2f357a1f7ff P 0473d2b2d01f4459b1e90fd12cc7840e [term 12 LEADER]: Becoming Leader. State: Replica: 0473d2b2d01f4459b1e90fd12cc7840e, State: Running, Role: LEADER
I20260709 13:06:34.870743 24478 consensus_queue.cc:1059] T ab43d85f64114d4ebf618930e43d9ed0 P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false }, Status: INVALID_TERM, Last received: 15.10, Next index: 11, Last known committed idx: 8, Time since last communication: 0.004s
I20260709 13:06:34.868263 24684 raft_consensus.cc:493] T b08304a0a02b42d7840c4e8ee9a6bd1a P e5256d91808b47c195bc9b4dbd7f2b87 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 0473d2b2d01f4459b1e90fd12cc7840e)
I20260709 13:06:34.912974 19523 leader_election.cc:304] T fa731b585f684a7fb2d106c50f143b83 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e61c3a8f61bb48f8a963c9480e53c168; no voters: 127766fc592545a4997f7790f50f6076, e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:06:34.881999 24787 raft_consensus.cc:2749] T 65d8cb8d6ec64f459d5a47cefab10acf P e61c3a8f61bb48f8a963c9480e53c168 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:06:34.955303 19560 raft_consensus.cc:1240] T 65d8cb8d6ec64f459d5a47cefab10acf P e61c3a8f61bb48f8a963c9480e53c168 [term 16 FOLLOWER]: Rejecting Update request from peer e5256d91808b47c195bc9b4dbd7f2b87 for earlier term 15. Current term is 16. Ops: []
I20260709 13:06:34.889050 24753 raft_consensus.cc:2749] T 7f575b143b844aa096b50997dad3516a P 0473d2b2d01f4459b1e90fd12cc7840e [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:06:34.888516 24551 raft_consensus.cc:2804] T 85c494af21f9457a85da47b9bc70c1fd P e5256d91808b47c195bc9b4dbd7f2b87 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:06:34.963652 19554 raft_consensus.cc:1240] T 40e1e16737a842ee936002830f36882e P e61c3a8f61bb48f8a963c9480e53c168 [term 16 FOLLOWER]: Rejecting Update request from peer e5256d91808b47c195bc9b4dbd7f2b87 for earlier term 15. Current term is 16. Ops: []
W20260709 13:06:34.945704 19526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.2:46257, user_credentials={real_user=slave}} blocked reactor thread for 88718.4us
W20260709 13:06:34.947259 19375 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.3:36891, user_credentials={real_user=slave}} blocked reactor thread for 67732.5us
I20260709 13:06:34.907124 24806 raft_consensus.cc:2749] T ece3db938bc649d4a40a51522ed5259c P 127766fc592545a4997f7790f50f6076 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:06:34.931565 24747 raft_consensus.cc:2804] T f93ee515a9c14139bf566522ed8232f3 P e61c3a8f61bb48f8a963c9480e53c168 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:06:34.965538 19526 leader_election.cc:304] T 7f575b143b844aa096b50997dad3516a P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168; no voters: e5256d91808b47c195bc9b4dbd7f2b87
W20260709 13:06:34.956775 19523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.1:40321, user_credentials={real_user=slave}} blocked reactor thread for 43919.7us
I20260709 13:06:34.949673 19557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76cb037fc9064d13b59a8969d897ce8c" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:06:34.967265 19557 raft_consensus.cc:2393] T 76cb037fc9064d13b59a8969d897ce8c P e61c3a8f61bb48f8a963c9480e53c168 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate e5256d91808b47c195bc9b4dbd7f2b87 in current term 13: Already voted for candidate e61c3a8f61bb48f8a963c9480e53c168 in this term.
I20260709 13:06:34.960023 19553 raft_consensus.cc:1275] T e381f1d6b8184797ad142de49be225a8 P e61c3a8f61bb48f8a963c9480e53c168 [term 12 FOLLOWER]: Refusing update from remote peer e5256d91808b47c195bc9b4dbd7f2b87: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 13:06:34.908964 24761 raft_consensus.cc:2749] T 179fd671030940b4b4a4e24bcc4aba0a P 0473d2b2d01f4459b1e90fd12cc7840e [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:06:34.965780 19375 leader_election.cc:304] T df751f992649444090e27965eb1af85d P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:06:34.944295 24789 consensus_queue.cc:1243] T d1e5873a19244c5ebbcd38e126796ee7 P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Peer 0473d2b2d01f4459b1e90fd12cc7840e log is divergent from this leader: its last log entry 15.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
I20260709 13:06:34.974911 19375 leader_election.cc:400] T 217b5fae677b4971b3bbd2f357a1f7ff P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 11 election: Vote denied by peer e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891) with higher term. Message: Invalid argument: T 217b5fae677b4971b3bbd2f357a1f7ff P e61c3a8f61bb48f8a963c9480e53c168 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate e5256d91808b47c195bc9b4dbd7f2b87 for earlier term 11. Current term is 12.
I20260709 13:06:34.888363 24457 raft_consensus.cc:515] T bc225c93219c45538b53a1bd3d387e4d P e5256d91808b47c195bc9b4dbd7f2b87 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:34.905800 24545 raft_consensus.cc:515] T 48824d5acfbc485ebf8c2d944e7202de P e61c3a8f61bb48f8a963c9480e53c168 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:34.896800 24752 raft_consensus.cc:515] T 22196caba61445d3bec98a0aab3c337d P e5256d91808b47c195bc9b4dbd7f2b87 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:34.907544 24797 consensus_queue.cc:1059] T 0e1085d23e8347fbbd5bce7542f4b1f4 P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.064s
I20260709 13:06:34.976176 19375 leader_election.cc:403] T 217b5fae677b4971b3bbd2f357a1f7ff P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 11 election: Cancelling election due to peer responding with higher term
I20260709 13:06:34.948977 24790 raft_consensus.cc:2749] T ff75a1d4cb1f493db8f71ddc136ba9ab P e61c3a8f61bb48f8a963c9480e53c168 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:06:34.923151 24466 consensus_queue.cc:1059] T 96efeaaf1057492490e9a621f37e1a2d P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 }, Status: INVALID_TERM, Last received: 15.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.056s
W20260709 13:06:35.015816 19449 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.4:43121, user_credentials={real_user=slave}} blocked reactor thread for 48288.1us
W20260709 13:06:35.020044 19526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.2:46257, user_credentials={real_user=slave}} blocked reactor thread for 54596.6us
I20260709 13:06:34.961561 24781 raft_consensus.cc:2749] T fa731b585f684a7fb2d106c50f143b83 P e61c3a8f61bb48f8a963c9480e53c168 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:06:34.990636 19523 leader_election.cc:304] T b9f0d59553ad444883fcf5b5909f9798 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168; no voters: 0473d2b2d01f4459b1e90fd12cc7840e
W20260709 13:06:35.065442 19523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.1:40321, user_credentials={real_user=slave}} blocked reactor thread for 74932.5us
I20260709 13:06:35.018188 19375 leader_election.cc:304] T 4af19371ea874c09a0a2147040835cbb P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87; no voters: 127766fc592545a4997f7790f50f6076, e61c3a8f61bb48f8a963c9480e53c168
W20260709 13:06:35.069818 24777 log.cc:927] Time spent T ab43d85f64114d4ebf618930e43d9ed0 P e61c3a8f61bb48f8a963c9480e53c168: Append to log took a long time: real 0.676s	user 0.002s	sys 0.000s
W20260709 13:06:35.019752 19450 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.3:36891, user_credentials={real_user=slave}} blocked reactor thread for 45921.6us
I20260709 13:06:35.070374 19558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c5eebf646ad445a9d1b1adc319d7b16" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:06:34.974020 24776 leader_election.cc:290] T 1efebf73c86e432baa55533136b6e12c P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 13 election: Requested vote from peers e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:06:35.051013 19559 raft_consensus.cc:2393] T 48824d5acfbc485ebf8c2d944e7202de P e61c3a8f61bb48f8a963c9480e53c168 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 127766fc592545a4997f7790f50f6076 in current term 17: Already voted for candidate e61c3a8f61bb48f8a963c9480e53c168 in this term.
W20260709 13:06:35.072117 19375 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.3:36891, user_credentials={real_user=slave}} blocked reactor thread for 53980.6us
I20260709 13:06:35.076169 19375 leader_election.cc:304] T 14935b3ddf914369822e4a0547aaa355 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87; no voters: 127766fc592545a4997f7790f50f6076, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:06:34.969162 24551 raft_consensus.cc:493] T 85c494af21f9457a85da47b9bc70c1fd P e5256d91808b47c195bc9b4dbd7f2b87 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:34.975584 24671 raft_consensus.cc:3055] T ab43d85f64114d4ebf618930e43d9ed0 P 0473d2b2d01f4459b1e90fd12cc7840e [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:06:34.978835 24597 raft_consensus.cc:2804] T df751f992649444090e27965eb1af85d P e5256d91808b47c195bc9b4dbd7f2b87 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:06:34.957490 24633 raft_consensus.cc:515] T 86a6797bdfe94fa496c050ceae4bd0d9 P e61c3a8f61bb48f8a963c9480e53c168 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:34.954496 24684 raft_consensus.cc:515] T b08304a0a02b42d7840c4e8ee9a6bd1a P e5256d91808b47c195bc9b4dbd7f2b87 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:35.057889 20110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1efebf73c86e432baa55533136b6e12c" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076"
I20260709 13:06:34.954211 24734 consensus_queue.cc:237] T 217b5fae677b4971b3bbd2f357a1f7ff P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
W20260709 13:06:35.059418 19376 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:35.020397 24643 raft_consensus.cc:2749] T 217b5fae677b4971b3bbd2f357a1f7ff P e5256d91808b47c195bc9b4dbd7f2b87 [term 12 FOLLOWER]: Leader election lost for term 11. Reason: Vote denied by peer e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891) with higher term. Message: Invalid argument: T 217b5fae677b4971b3bbd2f357a1f7ff P e61c3a8f61bb48f8a963c9480e53c168 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate e5256d91808b47c195bc9b4dbd7f2b87 for earlier term 11. Current term is 12.
I20260709 13:06:35.047175 24794 raft_consensus.cc:2804] T 7f575b143b844aa096b50997dad3516a P e61c3a8f61bb48f8a963c9480e53c168 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:06:34.971005 24783 consensus_queue.cc:1059] T f1b10566f45d4a7d9029858330e02d5b P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 }, Status: INVALID_TERM, Last received: 14.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.112s
I20260709 13:06:35.062908 24796 raft_consensus.cc:515] T ef32ce6fdd0e40d382c79974f30295c6 P 0473d2b2d01f4459b1e90fd12cc7840e [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:35.064072 24758 raft_consensus.cc:515] T ed7fdbcb96d14d418db9ca90a792588a P 127766fc592545a4997f7790f50f6076 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:34.988161 24747 raft_consensus.cc:697] T f93ee515a9c14139bf566522ed8232f3 P e61c3a8f61bb48f8a963c9480e53c168 [term 16 LEADER]: Becoming Leader. State: Replica: e61c3a8f61bb48f8a963c9480e53c168, State: Running, Role: LEADER
I20260709 13:06:35.073858 19560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e1085d23e8347fbbd5bce7542f4b1f4" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:06:35.133800 19560 raft_consensus.cc:3060] T 0e1085d23e8347fbbd5bce7542f4b1f4 P e61c3a8f61bb48f8a963c9480e53c168 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:06:35.079397 19485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9f0d59553ad444883fcf5b5909f9798" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
W20260709 13:06:35.135370 19375 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.3:36891, user_credentials={real_user=slave}} blocked reactor thread for 51532.2us
I20260709 13:06:35.135738 19485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edd7d470b5014c9489be7f41f64355c9" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:06:35.136456 19485 raft_consensus.cc:2468] T edd7d470b5014c9489be7f41f64355c9 P 0473d2b2d01f4459b1e90fd12cc7840e [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 16.
I20260709 13:06:35.082965 24756 raft_consensus.cc:2749] T 4af19371ea874c09a0a2147040835cbb P e5256d91808b47c195bc9b4dbd7f2b87 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:06:35.081363 19480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28af091831594f9d8e96482078cc7625" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:06:35.100031 24786 consensus_queue.cc:1059] T 46c5bfeecc314717bffe987e6844b6d0 P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 }, Status: INVALID_TERM, Last received: 19.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.050s
I20260709 13:06:35.081507 19479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df751f992649444090e27965eb1af85d" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:06:35.140733 19480 raft_consensus.cc:2393] T 28af091831594f9d8e96482078cc7625 P 0473d2b2d01f4459b1e90fd12cc7840e [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e61c3a8f61bb48f8a963c9480e53c168 in current term 16: Already voted for candidate 0473d2b2d01f4459b1e90fd12cc7840e in this term.
I20260709 13:06:35.089402 24597 raft_consensus.cc:493] T df751f992649444090e27965eb1af85d P e5256d91808b47c195bc9b4dbd7f2b87 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 0473d2b2d01f4459b1e90fd12cc7840e)
W20260709 13:06:35.154249 19374 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:35.080242 19483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cdf56e38bbc453d9438d359e5a69955" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:06:35.083427 24700 raft_consensus.cc:2804] T b9f0d59553ad444883fcf5b5909f9798 P e61c3a8f61bb48f8a963c9480e53c168 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:06:35.096664 19481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86a6797bdfe94fa496c050ceae4bd0d9" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:06:35.096276 19478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e36a9d6e29c4a7c860cf267efbd4c74" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:06:35.071372 24767 leader_election.cc:290] T 6c5eebf646ad445a9d1b1adc319d7b16 P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 15 election: Requested vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:06:35.047998 24573 consensus_queue.cc:1059] T 3e1f505cb0f1427bbd698ac889d80821 P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 }, Status: INVALID_TERM, Last received: 15.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.042s
I20260709 13:06:35.137688 19485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76cb037fc9064d13b59a8969d897ce8c" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:06:35.175369 20112 raft_consensus.cc:1240] T ed7fdbcb96d14d418db9ca90a792588a P 127766fc592545a4997f7790f50f6076 [term 11 FOLLOWER]: Rejecting Update request from peer 0473d2b2d01f4459b1e90fd12cc7840e for earlier term 10. Current term is 11. Ops: []
I20260709 13:06:35.087294 24671 raft_consensus.cc:740] T ab43d85f64114d4ebf618930e43d9ed0 P 0473d2b2d01f4459b1e90fd12cc7840e [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 0473d2b2d01f4459b1e90fd12cc7840e, State: Running, Role: LEADER
I20260709 13:06:35.139513 19403 raft_consensus.cc:2468] T b08304a0a02b42d7840c4e8ee9a6bd1a P e5256d91808b47c195bc9b4dbd7f2b87 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 14.
W20260709 13:06:35.141494 19450 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.3:36891, user_credentials={real_user=slave}} blocked reactor thread for 49863.4us
I20260709 13:06:35.087090 24551 raft_consensus.cc:3060] T 85c494af21f9457a85da47b9bc70c1fd P e5256d91808b47c195bc9b4dbd7f2b87 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:06:35.144550 19526 leader_election.cc:304] T edd7d470b5014c9489be7f41f64355c9 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168; no voters: e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:06:35.085422 19484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa8650e71aa14778b3d73721fc50d9fc" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:06:35.146232 19480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1b10566f45d4a7d9029858330e02d5b" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:06:35.087011 24394 consensus_queue.cc:1048] T ef32ce6fdd0e40d382c79974f30295c6 P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.052s
I20260709 13:06:35.198474 19479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21e14947d70440f19044d8f75c31e1f9" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:06:35.147830 24684 leader_election.cc:290] T b08304a0a02b42d7840c4e8ee9a6bd1a P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:06:35.150333 24752 leader_election.cc:290] T 22196caba61445d3bec98a0aab3c337d P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:06:35.152623 24796 leader_election.cc:290] T ef32ce6fdd0e40d382c79974f30295c6 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 18 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:06:35.095819 24813 raft_consensus.cc:2749] T 14935b3ddf914369822e4a0547aaa355 P e5256d91808b47c195bc9b4dbd7f2b87 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:06:35.080840 19482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4509b76741dc428e9201c70c1658da13" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:06:35.174810 19483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0afb57ae58a24a01850491d69f0213dd" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:06:35.134541 24794 raft_consensus.cc:493] T 7f575b143b844aa096b50997dad3516a P e61c3a8f61bb48f8a963c9480e53c168 [term 10 FOLLOWER]: Starting leader election (detected failure of leader e5256d91808b47c195bc9b4dbd7f2b87)
I20260709 13:06:35.160669 24597 raft_consensus.cc:3060] T df751f992649444090e27965eb1af85d P e5256d91808b47c195bc9b4dbd7f2b87 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:06:35.091976 24652 consensus_queue.cc:1059] T 0cdf56e38bbc453d9438d359e5a69955 P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 }, Status: INVALID_TERM, Last received: 14.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.086s
I20260709 13:06:35.199193 19479 raft_consensus.cc:2468] T 21e14947d70440f19044d8f75c31e1f9 P 0473d2b2d01f4459b1e90fd12cc7840e [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 14.
I20260709 13:06:35.202764 19560 raft_consensus.cc:2468] T 0e1085d23e8347fbbd5bce7542f4b1f4 P e61c3a8f61bb48f8a963c9480e53c168 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 127766fc592545a4997f7790f50f6076 in term 12.
W20260709 13:06:35.206338 24807 log.cc:927] Time spent T ff75a1d4cb1f493db8f71ddc136ba9ab P e61c3a8f61bb48f8a963c9480e53c168: Append to log took a long time: real 0.135s	user 0.001s	sys 0.000s
I20260709 13:06:35.211062 24545 leader_election.cc:290] T 48824d5acfbc485ebf8c2d944e7202de P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 17 election: Requested vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:06:35.211669 24682 leader_election.cc:290] T fa731b585f684a7fb2d106c50f143b83 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:06:35.184837 24753 raft_consensus.cc:3055] T f1b10566f45d4a7d9029858330e02d5b P 0473d2b2d01f4459b1e90fd12cc7840e [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:06:35.159715 24761 consensus_queue.cc:1059] T b9f0d59553ad444883fcf5b5909f9798 P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 }, Status: INVALID_TERM, Last received: 13.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.053s
W20260709 13:06:35.212687 24817 log.cc:927] Time spent T 70797e5783b5454ab0d0eea663e791e3 P e61c3a8f61bb48f8a963c9480e53c168: Append to log took a long time: real 0.077s	user 0.001s	sys 0.000s
I20260709 13:06:35.214488 24783 raft_consensus.cc:3055] T 3e1f505cb0f1427bbd698ac889d80821 P 0473d2b2d01f4459b1e90fd12cc7840e [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:06:35.216727 24555 raft_consensus.cc:515] T 7be9efa6559648dbb5a0f7684c4542d1 P e5256d91808b47c195bc9b4dbd7f2b87 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } attrs { replace: true } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:35.185536 24789 raft_consensus.cc:493] T 3e1f505cb0f1427bbd698ac889d80821 P e61c3a8f61bb48f8a963c9480e53c168 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:35.194684 24700 raft_consensus.cc:697] T b9f0d59553ad444883fcf5b5909f9798 P e61c3a8f61bb48f8a963c9480e53c168 [term 14 LEADER]: Becoming Leader. State: Replica: e61c3a8f61bb48f8a963c9480e53c168, State: Running, Role: LEADER
I20260709 13:06:35.218894 20110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa731b585f684a7fb2d106c50f143b83" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:06:35.219067 19481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "217b5fae677b4971b3bbd2f357a1f7ff" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:06:35.201347 24466 consensus_queue.cc:1048] T b08304a0a02b42d7840c4e8ee9a6bd1a P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.018s
I20260709 13:06:35.220005 24825 consensus_queue.cc:1059] T ece3db938bc649d4a40a51522ed5259c P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 }, Status: INVALID_TERM, Last received: 10.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.018s
I20260709 13:06:35.220353 24457 leader_election.cc:290] T bc225c93219c45538b53a1bd3d387e4d P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 14 election: Requested vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:06:35.220890 24478 raft_consensus.cc:3055] T 96efeaaf1057492490e9a621f37e1a2d P 0473d2b2d01f4459b1e90fd12cc7840e [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:06:35.209196 24559 raft_consensus.cc:515] T 1dc5b3532fe54f74876d02beffa2c230 P 0473d2b2d01f4459b1e90fd12cc7840e [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:35.211700 24633 leader_election.cc:290] T 86a6797bdfe94fa496c050ceae4bd0d9 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 11 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:06:35.223798 20106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48824d5acfbc485ebf8c2d944e7202de" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076"
W20260709 13:06:35.229768 19526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.2:46257, user_credentials={real_user=slave}} blocked reactor thread for 85338.9us
I20260709 13:06:35.234659 19483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b08304a0a02b42d7840c4e8ee9a6bd1a" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:06:35.238461 19486 pending_rounds.cc:85] T d1e5873a19244c5ebbcd38e126796ee7 P 0473d2b2d01f4459b1e90fd12cc7840e: Aborting all ops after (but not including) 7
I20260709 13:06:35.237605 20076 leader_election.cc:304] T 0e1085d23e8347fbbd5bce7542f4b1f4 P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 127766fc592545a4997f7790f50f6076, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:06:35.320184 19486 pending_rounds.cc:107] T d1e5873a19244c5ebbcd38e126796ee7 P 0473d2b2d01f4459b1e90fd12cc7840e: Aborting uncommitted NO_OP operation due to leader change: 15.8
I20260709 13:06:35.320015 19526 leader_election.cc:304] T 28af091831594f9d8e96482078cc7625 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e61c3a8f61bb48f8a963c9480e53c168; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87
W20260709 13:06:35.240072 19377 leader_election.cc:336] T ab43d85f64114d4ebf618930e43d9ed0 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257): Timed out: RequestConsensusVote RPC to 127.17.223.2:46257 timed out after 1.534s (SENT)
W20260709 13:06:35.321610 19377 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.2:46257, user_credentials={real_user=slave}} blocked reactor thread for 81591us
I20260709 13:06:35.321801 19526 leader_election.cc:304] T df751f992649444090e27965eb1af85d P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e61c3a8f61bb48f8a963c9480e53c168; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:06:35.241670 24753 raft_consensus.cc:740] T f1b10566f45d4a7d9029858330e02d5b P 0473d2b2d01f4459b1e90fd12cc7840e [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 0473d2b2d01f4459b1e90fd12cc7840e, State: Running, Role: LEADER
I20260709 13:06:35.302213 24640 raft_consensus.cc:3060] T 2a16f7501e2444fb86d4e2778e734e02 P 127766fc592545a4997f7790f50f6076 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:06:35.303401 24758 leader_election.cc:290] T ed7fdbcb96d14d418db9ca90a792588a P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 11 election: Requested vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:06:35.234884 24794 raft_consensus.cc:3060] T 7f575b143b844aa096b50997dad3516a P e61c3a8f61bb48f8a963c9480e53c168 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:06:35.239391 24812 raft_consensus.cc:2804] T edd7d470b5014c9489be7f41f64355c9 P e61c3a8f61bb48f8a963c9480e53c168 [term 15 FOLLOWER]: Leader pre-election won for term 16
W20260709 13:06:35.310387 19450 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.3:36891, user_credentials={real_user=slave}} blocked reactor thread for 109777us
I20260709 13:06:35.140686 24747 consensus_queue.cc:237] T f93ee515a9c14139bf566522ed8232f3 P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 15.7, Last appended by leader: 7, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:35.351033 24812 raft_consensus.cc:493] T edd7d470b5014c9489be7f41f64355c9 P e61c3a8f61bb48f8a963c9480e53c168 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 0473d2b2d01f4459b1e90fd12cc7840e)
I20260709 13:06:35.351568 24812 raft_consensus.cc:3060] T edd7d470b5014c9489be7f41f64355c9 P e61c3a8f61bb48f8a963c9480e53c168 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:06:35.352057 24559 leader_election.cc:290] T 1dc5b3532fe54f74876d02beffa2c230 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 16 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:06:35.320614 19486 raft_consensus.cc:2889] T d1e5873a19244c5ebbcd38e126796ee7 P 0473d2b2d01f4459b1e90fd12cc7840e [term 17 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:06:35.320452 20076 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.3:36891, user_credentials={real_user=slave}} blocked reactor thread for 82962us
I20260709 13:06:35.354429 19479 raft_consensus.cc:1240] T 1dc5b3532fe54f74876d02beffa2c230 P 0473d2b2d01f4459b1e90fd12cc7840e [term 16 FOLLOWER]: Rejecting Update request from peer e61c3a8f61bb48f8a963c9480e53c168 for earlier term 15. Current term is 16. Ops: []
I20260709 13:06:35.314210 24783 raft_consensus.cc:740] T 3e1f505cb0f1427bbd698ac889d80821 P 0473d2b2d01f4459b1e90fd12cc7840e [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 0473d2b2d01f4459b1e90fd12cc7840e, State: Running, Role: LEADER
W20260709 13:06:35.383111 20075 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:35.406255 19556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28af091831594f9d8e96482078cc7625" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:06:35.323276 24478 raft_consensus.cc:740] T 96efeaaf1057492490e9a621f37e1a2d P 0473d2b2d01f4459b1e90fd12cc7840e [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 0473d2b2d01f4459b1e90fd12cc7840e, State: Running, Role: LEADER
I20260709 13:06:35.325450 24691 raft_consensus.cc:2804] T 0e1085d23e8347fbbd5bce7542f4b1f4 P 127766fc592545a4997f7790f50f6076 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:06:35.326648 19526 leader_election.cc:304] T 0cdf56e38bbc453d9438d359e5a69955 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e61c3a8f61bb48f8a963c9480e53c168; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:06:35.309788 24793 raft_consensus.cc:2749] T 1a61655d99124a29b486ba4a5b37faea P 0473d2b2d01f4459b1e90fd12cc7840e [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:06:35.354140 24633 raft_consensus.cc:2749] T df751f992649444090e27965eb1af85d P e61c3a8f61bb48f8a963c9480e53c168 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 13:06:35.282193 19375 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.3:36891, user_credentials={real_user=slave}} blocked reactor thread for 127610us
I20260709 13:06:35.408077 19558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e381f1d6b8184797ad142de49be225a8" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:06:35.410195 19557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2725d2c4cb054f18b0fc8f735c15f6c2" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:06:35.410753 24763 raft_consensus.cc:3055] T fa8650e71aa14778b3d73721fc50d9fc P 0473d2b2d01f4459b1e90fd12cc7840e [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:06:35.413576 19556 raft_consensus.cc:1275] T bc225c93219c45538b53a1bd3d387e4d P e61c3a8f61bb48f8a963c9480e53c168 [term 13 FOLLOWER]: Refusing update from remote peer 0473d2b2d01f4459b1e90fd12cc7840e: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:06:35.329761 24791 raft_consensus.cc:3060] T 28af091831594f9d8e96482078cc7625 P e61c3a8f61bb48f8a963c9480e53c168 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:06:35.407662 19553 raft_consensus.cc:1240] T 76cb037fc9064d13b59a8969d897ce8c P e61c3a8f61bb48f8a963c9480e53c168 [term 13 FOLLOWER]: Rejecting Update request from peer 0473d2b2d01f4459b1e90fd12cc7840e for earlier term 12. Current term is 13. Ops: []
W20260709 13:06:35.420461 19526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.2:46257, user_credentials={real_user=slave}} blocked reactor thread for 93967.5us
I20260709 13:06:35.440866 19558 raft_consensus.cc:2468] T e381f1d6b8184797ad142de49be225a8 P e61c3a8f61bb48f8a963c9480e53c168 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 12.
I20260709 13:06:35.441110 19375 leader_election.cc:304] T 70797e5783b5454ab0d0eea663e791e3 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168; no voters: 127766fc592545a4997f7790f50f6076
I20260709 13:06:35.463168 19557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef32ce6fdd0e40d382c79974f30295c6" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 18 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:06:35.463737 19557 raft_consensus.cc:3060] T ef32ce6fdd0e40d382c79974f30295c6 P e61c3a8f61bb48f8a963c9480e53c168 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:06:35.467362 19553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff75a1d4cb1f493db8f71ddc136ba9ab" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 16 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:06:35.468592 19553 raft_consensus.cc:1240] T 0e1085d23e8347fbbd5bce7542f4b1f4 P e61c3a8f61bb48f8a963c9480e53c168 [term 12 FOLLOWER]: Rejecting Update request from peer 0473d2b2d01f4459b1e90fd12cc7840e for earlier term 11. Current term is 12. Ops: []
I20260709 13:06:35.470201 24758 raft_consensus.cc:493] T 2a16f7501e2444fb86d4e2778e734e02 P 127766fc592545a4997f7790f50f6076 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:35.322502 24789 raft_consensus.cc:515] T 3e1f505cb0f1427bbd698ac889d80821 P e61c3a8f61bb48f8a963c9480e53c168 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:35.470746 24758 raft_consensus.cc:515] T 2a16f7501e2444fb86d4e2778e734e02 P 127766fc592545a4997f7790f50f6076 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:35.458423 24372 consensus_queue.cc:1048] T 4509b76741dc428e9201c70c1658da13 P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.013s
I20260709 13:06:35.472404 24789 leader_election.cc:290] T 3e1f505cb0f1427bbd698ac889d80821 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:06:35.351101 24700 consensus_queue.cc:237] T b9f0d59553ad444883fcf5b5909f9798 P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
W20260709 13:06:35.456786 19377 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.2:46257, user_credentials={real_user=slave}} blocked reactor thread for 66800.1us
I20260709 13:06:35.322862 24551 raft_consensus.cc:515] T 85c494af21f9457a85da47b9bc70c1fd P e5256d91808b47c195bc9b4dbd7f2b87 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:35.474242 19557 raft_consensus.cc:2468] T ef32ce6fdd0e40d382c79974f30295c6 P e61c3a8f61bb48f8a963c9480e53c168 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 18.
I20260709 13:06:35.474891 19404 raft_consensus.cc:1240] T 85c494af21f9457a85da47b9bc70c1fd P e5256d91808b47c195bc9b4dbd7f2b87 [term 15 FOLLOWER]: Rejecting Update request from peer 127766fc592545a4997f7790f50f6076 for earlier term 14. Current term is 15. Ops: [14.12-14.12]
I20260709 13:06:35.456406 24763 raft_consensus.cc:740] T fa8650e71aa14778b3d73721fc50d9fc P 0473d2b2d01f4459b1e90fd12cc7840e [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 0473d2b2d01f4459b1e90fd12cc7840e, State: Running, Role: LEADER
W20260709 13:06:35.456489 24817 log.cc:927] Time spent T 70797e5783b5454ab0d0eea663e791e3 P e61c3a8f61bb48f8a963c9480e53c168: Append to log took a long time: real 0.073s	user 0.000s	sys 0.000s
I20260709 13:06:35.475898 19556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dc5b3532fe54f74876d02beffa2c230" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:06:35.476075 24763 consensus_queue.cc:260] T fa8650e71aa14778b3d73721fc50d9fc P 0473d2b2d01f4459b1e90fd12cc7840e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:35.477072 24763 raft_consensus.cc:3060] T fa8650e71aa14778b3d73721fc50d9fc P 0473d2b2d01f4459b1e90fd12cc7840e [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:06:35.477185 19556 raft_consensus.cc:1240] T fa8650e71aa14778b3d73721fc50d9fc P e61c3a8f61bb48f8a963c9480e53c168 [term 14 FOLLOWER]: Rejecting Update request from peer 0473d2b2d01f4459b1e90fd12cc7840e for earlier term 13. Current term is 14. Ops: []
I20260709 13:06:35.483161 19558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1efebf73c86e432baa55533136b6e12c" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:06:35.455240 24761 raft_consensus.cc:493] T 22196caba61445d3bec98a0aab3c337d P 0473d2b2d01f4459b1e90fd12cc7840e [term 12 FOLLOWER]: Starting pre-election (detected failure of leader e5256d91808b47c195bc9b4dbd7f2b87)
I20260709 13:06:35.466055 24794 raft_consensus.cc:515] T 7f575b143b844aa096b50997dad3516a P e61c3a8f61bb48f8a963c9480e53c168 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
W20260709 13:06:35.488436 19375 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.3:36891, user_credentials={real_user=slave}} blocked reactor thread for 47396.9us
W20260709 13:06:35.479840 24807 log.cc:927] Time spent T ff75a1d4cb1f493db8f71ddc136ba9ab P e61c3a8f61bb48f8a963c9480e53c168: Append to log took a long time: real 0.107s	user 0.000s	sys 0.000s
I20260709 13:06:35.439785 24678 raft_consensus.cc:3060] T 0cdf56e38bbc453d9438d359e5a69955 P e61c3a8f61bb48f8a963c9480e53c168 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:06:35.457634 24787 raft_consensus.cc:493] T a08760e15aac4630a629431f56024dc8 P e61c3a8f61bb48f8a963c9480e53c168 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 0473d2b2d01f4459b1e90fd12cc7840e)
I20260709 13:06:35.457408 24691 raft_consensus.cc:697] T 0e1085d23e8347fbbd5bce7542f4b1f4 P 127766fc592545a4997f7790f50f6076 [term 12 LEADER]: Becoming Leader. State: Replica: 127766fc592545a4997f7790f50f6076, State: Running, Role: LEADER
I20260709 13:06:35.494547 19375 leader_election.cc:304] T ab43d85f64114d4ebf618930e43d9ed0 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87; no voters: 127766fc592545a4997f7790f50f6076, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:06:35.508528 19552 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40438 (request call id 2680) took 1349 ms. Trace:
I20260709 13:06:35.499083 24478 consensus_queue.cc:260] T 96efeaaf1057492490e9a621f37e1a2d P 0473d2b2d01f4459b1e90fd12cc7840e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.11, Last appended by leader: 11, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:35.510847 20106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85c494af21f9457a85da47b9bc70c1fd" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076"
I20260709 13:06:35.511003 24780 raft_consensus.cc:3055] T 46c5bfeecc314717bffe987e6844b6d0 P 0473d2b2d01f4459b1e90fd12cc7840e [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:06:35.511435 24780 raft_consensus.cc:740] T 46c5bfeecc314717bffe987e6844b6d0 P 0473d2b2d01f4459b1e90fd12cc7840e [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 0473d2b2d01f4459b1e90fd12cc7840e, State: Running, Role: LEADER
I20260709 13:06:35.512096 24276 raft_consensus.cc:3055] T 0e1085d23e8347fbbd5bce7542f4b1f4 P 0473d2b2d01f4459b1e90fd12cc7840e [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:06:35.512514 24276 raft_consensus.cc:740] T 0e1085d23e8347fbbd5bce7542f4b1f4 P 0473d2b2d01f4459b1e90fd12cc7840e [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 0473d2b2d01f4459b1e90fd12cc7840e, State: Running, Role: LEADER
I20260709 13:06:35.512223 24780 consensus_queue.cc:260] T 46c5bfeecc314717bffe987e6844b6d0 P 0473d2b2d01f4459b1e90fd12cc7840e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 19.9, Last appended by leader: 9, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:35.513540 19551 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41504 (request call id 811) took 1638 ms. Trace:
I20260709 13:06:35.513255 24276 consensus_queue.cc:260] T 0e1085d23e8347fbbd5bce7542f4b1f4 P 0473d2b2d01f4459b1e90fd12cc7840e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:35.513918 19551 rpcz_store.cc:276] 0709 13:06:33.878641 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:34.592029 (+713388us) service_pool.cc:224] Handling call
0709 13:06:34.814635 (+222606us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:34.853611 (+ 38976us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:34.853653 (+    42us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:34.868792 (+ 15139us) log.cc:844] Serialized 26 byte log entry
0709 13:06:34.974463 (+105671us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:06:35.054385 (+ 79922us) log.cc:844] Serialized 14 byte log entry
0709 13:06:35.054954 (+   569us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:35.055059 (+   105us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:35.476123 (+421064us) raft_consensus.cc:1685] finished
0709 13:06:35.476142 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:35.513398 (+ 37256us) spinlock_profiling.cc:243] Waited 219 ms on lock 0x7b54002e90d0. stack: 00007f4a79de9343 00007f4a79de9240 00007f4a797781d4 00007f4a834b6304 00007f4a834b6299 00007f4a7ce71571 00007f4a7cf078ad 00007f4a81ecc419 00007f4a7b443bd4 00007f4a7b443b62 00007f4a7b443a91 00007f4a7b443a0c 00007f4a7b442cc2 00007f4a7b24348c 00007f4a7b2428c6 00007f4a7b24226f
0709 13:06:35.513491 (+    93us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":38565,"prepare.queue_time_us":83206,"prepare.run_cpu_time_us":32,"prepare.run_wall_time_us":33,"raft.queue_time_us":44721,"raft.run_cpu_time_us":217,"raft.run_wall_time_us":6376,"spinlock_wait_cycles":502753664,"thread_start_us":64286,"threads_started":1,"wal-append.queue_time_us":245589}
I20260709 13:06:35.520037 24555 leader_election.cc:290] T 7be9efa6559648dbb5a0f7684c4542d1 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 14 election: Requested vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:06:35.491565 24761 raft_consensus.cc:515] T 22196caba61445d3bec98a0aab3c337d P 0473d2b2d01f4459b1e90fd12cc7840e [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:35.523804 24761 leader_election.cc:290] T 22196caba61445d3bec98a0aab3c337d P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:06:35.511018 24478 raft_consensus.cc:3060] T 96efeaaf1057492490e9a621f37e1a2d P 0473d2b2d01f4459b1e90fd12cc7840e [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:06:35.527014 20106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7be9efa6559648dbb5a0f7684c4542d1" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076"
I20260709 13:06:35.508915 19552 rpcz_store.cc:276] 0709 13:06:34.159331 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:34.658911 (+499580us) service_pool.cc:224] Handling call
0709 13:06:34.664277 (+  5366us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:06:34.689606 (+ 25329us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:34.689639 (+    33us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:06:34.690258 (+   619us) log.cc:844] Serialized 52 byte log entry
0709 13:06:34.890685 (+200427us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:06:34.909309 (+ 18624us) log.cc:844] Serialized 14 byte log entry
0709 13:06:34.913764 (+  4455us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:34.913852 (+    88us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:35.508315 (+594463us) raft_consensus.cc:1685] finished
0709 13:06:35.508333 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:35.508474 (+   141us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2526,"prepare.queue_time_us":18320,"prepare.run_cpu_time_us":57,"prepare.run_wall_time_us":12494,"raft.queue_time_us":28829,"raft.run_cpu_time_us":230,"raft.run_wall_time_us":23667,"spinlock_wait_cycles":347520,"thread_start_us":199964,"threads_started":1,"wal-append.queue_time_us":272382}
I20260709 13:06:35.531591 19526 leader_election.cc:304] T 2e36a9d6e29c4a7c860cf267efbd4c74 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e61c3a8f61bb48f8a963c9480e53c168; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:06:35.531702 24671 consensus_queue.cc:260] T ab43d85f64114d4ebf618930e43d9ed0 P 0473d2b2d01f4459b1e90fd12cc7840e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:35.503950 24823 raft_consensus.cc:2804] T 70797e5783b5454ab0d0eea663e791e3 P e5256d91808b47c195bc9b4dbd7f2b87 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:06:35.519977 24482 consensus_queue.cc:1059] T 85c494af21f9457a85da47b9bc70c1fd P 127766fc592545a4997f7790f50f6076 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 }, Status: INVALID_TERM, Last received: 12.11, Next index: 12, Last known committed idx: 10, Time since last communication: 0.013s
I20260709 13:06:35.533550 19526 leader_election.cc:304] T 76cb037fc9064d13b59a8969d897ce8c P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e61c3a8f61bb48f8a963c9480e53c168; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:06:35.533739 24482 raft_consensus.cc:3055] T 85c494af21f9457a85da47b9bc70c1fd P 127766fc592545a4997f7790f50f6076 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:06:35.533104 24823 raft_consensus.cc:493] T 70797e5783b5454ab0d0eea663e791e3 P e5256d91808b47c195bc9b4dbd7f2b87 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 127766fc592545a4997f7790f50f6076)
I20260709 13:06:35.536267 19526 leader_election.cc:304] T 0afb57ae58a24a01850491d69f0213dd P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e61c3a8f61bb48f8a963c9480e53c168; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, 127766fc592545a4997f7790f50f6076
I20260709 13:06:35.534142 24482 raft_consensus.cc:740] T 85c494af21f9457a85da47b9bc70c1fd P 127766fc592545a4997f7790f50f6076 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 127766fc592545a4997f7790f50f6076, State: Running, Role: LEADER
I20260709 13:06:35.538811 19483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48824d5acfbc485ebf8c2d944e7202de" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:06:35.575698 19481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86a6797bdfe94fa496c050ceae4bd0d9" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:06:35.577195 24826 raft_consensus.cc:3060] T ab43d85f64114d4ebf618930e43d9ed0 P e5256d91808b47c195bc9b4dbd7f2b87 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:06:35.539058 24823 raft_consensus.cc:3060] T 70797e5783b5454ab0d0eea663e791e3 P e5256d91808b47c195bc9b4dbd7f2b87 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:06:35.576329 24756 consensus_queue.cc:1048] T e381f1d6b8184797ad142de49be225a8 P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
W20260709 13:06:35.582239 19526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.2:46257, user_credentials={real_user=slave}} blocked reactor thread for 46033.1us
I20260709 13:06:35.587273 19483 raft_consensus.cc:3060] T 22196caba61445d3bec98a0aab3c337d P 0473d2b2d01f4459b1e90fd12cc7840e [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:06:35.590276 19526 leader_election.cc:304] T 4509b76741dc428e9201c70c1658da13 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e61c3a8f61bb48f8a963c9480e53c168; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:06:35.504249 24551 leader_election.cc:290] T 85c494af21f9457a85da47b9bc70c1fd P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 15 election: Requested vote from peers e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
W20260709 13:06:35.594659 19377 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.2:46257, user_credentials={real_user=slave}} blocked reactor thread for 90279.3us
I20260709 13:06:35.513566 24780 raft_consensus.cc:3060] T 46c5bfeecc314717bffe987e6844b6d0 P 0473d2b2d01f4459b1e90fd12cc7840e [term 19 FOLLOWER]: Advancing to term 20
W20260709 13:06:35.595605 19375 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.3:36891, user_credentials={real_user=slave}} blocked reactor thread for 50485.3us
I20260709 13:06:35.599084 19560 raft_consensus.cc:1240] T f93ee515a9c14139bf566522ed8232f3 P e61c3a8f61bb48f8a963c9480e53c168 [term 16 LEADER]: Rejecting Update request from peer 0473d2b2d01f4459b1e90fd12cc7840e for earlier term 15. Current term is 16. Ops: []
I20260709 13:06:35.601789 19552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b08304a0a02b42d7840c4e8ee9a6bd1a" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:06:35.602602 19552 raft_consensus.cc:2468] T b08304a0a02b42d7840c4e8ee9a6bd1a P e61c3a8f61bb48f8a963c9480e53c168 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 14.
I20260709 13:06:35.539866 24633 raft_consensus.cc:2749] T 2e36a9d6e29c4a7c860cf267efbd4c74 P e61c3a8f61bb48f8a963c9480e53c168 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:06:35.607352 19552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22196caba61445d3bec98a0aab3c337d" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
W20260709 13:06:35.608718 19449 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:35.581987 24785 raft_consensus.cc:2749] T 76cb037fc9064d13b59a8969d897ce8c P e61c3a8f61bb48f8a963c9480e53c168 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:06:35.586158 24789 raft_consensus.cc:2749] T 0afb57ae58a24a01850491d69f0213dd P e61c3a8f61bb48f8a963c9480e53c168 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:06:35.582049 24771 raft_consensus.cc:493] T 1efebf73c86e432baa55533136b6e12c P e61c3a8f61bb48f8a963c9480e53c168 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 127766fc592545a4997f7790f50f6076)
I20260709 13:06:35.611199 19551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa731b585f684a7fb2d106c50f143b83" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:06:35.611703 19558 raft_consensus.cc:1275] T 2a16f7501e2444fb86d4e2778e734e02 P e61c3a8f61bb48f8a963c9480e53c168 [term 14 FOLLOWER]: Refusing update from remote peer e5256d91808b47c195bc9b4dbd7f2b87: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 13:06:35.619480 19552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc225c93219c45538b53a1bd3d387e4d" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:06:35.622253 19377 leader_election.cc:304] T 0cdf56e38bbc453d9438d359e5a69955 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:06:35.625965 19377 leader_election.cc:304] T d1e5873a19244c5ebbcd38e126796ee7 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:06:35.626827 24372 raft_consensus.cc:2749] T d1e5873a19244c5ebbcd38e126796ee7 P e5256d91808b47c195bc9b4dbd7f2b87 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:06:35.493350 24753 consensus_queue.cc:260] T f1b10566f45d4a7d9029858330e02d5b P 0473d2b2d01f4459b1e90fd12cc7840e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:35.625993 24551 raft_consensus.cc:2749] T 0cdf56e38bbc453d9438d359e5a69955 P e5256d91808b47c195bc9b4dbd7f2b87 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:06:35.628691 24794 leader_election.cc:290] T 7f575b143b844aa096b50997dad3516a P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 11 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:06:35.631707 19477 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58294 (request call id 2511) took 1324 ms. Trace:
I20260709 13:06:35.631248 19377 leader_election.cc:304] T 9962423cb4e54fcfa5de01daf68a86e7 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87; no voters: 127766fc592545a4997f7790f50f6076
I20260709 13:06:35.635490 24555 raft_consensus.cc:2804] T 9962423cb4e54fcfa5de01daf68a86e7 P e5256d91808b47c195bc9b4dbd7f2b87 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:06:35.635906 24555 raft_consensus.cc:493] T 9962423cb4e54fcfa5de01daf68a86e7 P e5256d91808b47c195bc9b4dbd7f2b87 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 127766fc592545a4997f7790f50f6076)
I20260709 13:06:35.636270 24555 raft_consensus.cc:3060] T 9962423cb4e54fcfa5de01daf68a86e7 P e5256d91808b47c195bc9b4dbd7f2b87 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:06:35.641109 19478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e1f505cb0f1427bbd698ac889d80821" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:06:35.634861 19552 raft_consensus.cc:3060] T bc225c93219c45538b53a1bd3d387e4d P e61c3a8f61bb48f8a963c9480e53c168 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:06:35.634958 24482 consensus_queue.cc:260] T 85c494af21f9457a85da47b9bc70c1fd P 127766fc592545a4997f7790f50f6076 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.12, Last appended by leader: 12, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:35.643365 24482 raft_consensus.cc:3060] T 85c494af21f9457a85da47b9bc70c1fd P 127766fc592545a4997f7790f50f6076 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:06:35.650785 24691 consensus_queue.cc:237] T 0e1085d23e8347fbbd5bce7542f4b1f4 P 127766fc592545a4997f7790f50f6076 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:35.651379 19377 leader_election.cc:304] T 1dc5b3532fe54f74876d02beffa2c230 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:06:35.652089 24825 raft_consensus.cc:2749] T 1dc5b3532fe54f74876d02beffa2c230 P e5256d91808b47c195bc9b4dbd7f2b87 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:06:35.653295 19377 leader_election.cc:304] T fa8650e71aa14778b3d73721fc50d9fc P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:06:35.653527 24573 raft_consensus.cc:3055] T 0cdf56e38bbc453d9438d359e5a69955 P 0473d2b2d01f4459b1e90fd12cc7840e [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:06:35.653998 24573 raft_consensus.cc:740] T 0cdf56e38bbc453d9438d359e5a69955 P 0473d2b2d01f4459b1e90fd12cc7840e [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 0473d2b2d01f4459b1e90fd12cc7840e, State: Running, Role: LEADER
W20260709 13:06:35.623916 24795 consensus_meta.cc:287] T 1a61655d99124a29b486ba4a5b37faea P e61c3a8f61bb48f8a963c9480e53c168: Time spent flushing consensus metadata: real 0.674s	user 0.010s	sys 0.000s
I20260709 13:06:35.656701 24795 raft_consensus.cc:515] T 1a61655d99124a29b486ba4a5b37faea P e61c3a8f61bb48f8a963c9480e53c168 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:35.658890 19555 raft_consensus.cc:1240] T 1a61655d99124a29b486ba4a5b37faea P e61c3a8f61bb48f8a963c9480e53c168 [term 13 FOLLOWER]: Rejecting Update request from peer e5256d91808b47c195bc9b4dbd7f2b87 for earlier term 12. Current term is 13. Ops: [12.8-12.8]
I20260709 13:06:35.660135 24791 raft_consensus.cc:2749] T 28af091831594f9d8e96482078cc7625 P e61c3a8f61bb48f8a963c9480e53c168 [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:06:35.609349 24824 consensus_queue.cc:1048] T ef32ce6fdd0e40d382c79974f30295c6 P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.064s
I20260709 13:06:35.663328 19551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85c494af21f9457a85da47b9bc70c1fd" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:06:35.632047 19477 rpcz_store.cc:276] 0709 13:06:34.308949 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:34.313337 (+  4388us) service_pool.cc:224] Handling call
0709 13:06:34.313646 (+   309us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:34.988501 (+674855us) spinlock_profiling.cc:243] Waited 3.73 ms on lock 0x7b180034f960. stack: 00007f4a79de9343 00007f4a79de9240 00007f4a797781d4 00007f4a834b6304 00007f4a834b6299 00007f4a82ce3de1 00007f4a82cf05b1 00007f4a7cab04bc 00007f4a79dfe48b 00007f4a82c58ab9 00007f4a79e1a69b 00007f4a79e1893f 00007f4a79e18455 00007f4a7cf00060 00007f4a7cf00bfb 00007f4a7cf0b64b
0709 13:06:34.988641 (+   140us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:34.988677 (+    36us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:35.047526 (+ 58849us) log.cc:844] Serialized 26 byte log entry
0709 13:06:35.306904 (+259378us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:06:35.306941 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:35.307716 (+   775us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:35.631438 (+323722us) raft_consensus.cc:1685] finished
0709 13:06:35.631456 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:35.631649 (+   193us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":48723,"raft.queue_time_us":72860,"raft.run_cpu_time_us":79,"raft.run_wall_time_us":2214,"spinlock_wait_cycles":8570624,"thread_start_us":351351,"threads_started":2,"wal-append.queue_time_us":423044}
I20260709 13:06:35.663944 19551 raft_consensus.cc:3060] T 85c494af21f9457a85da47b9bc70c1fd P e61c3a8f61bb48f8a963c9480e53c168 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:06:35.502535 24787 raft_consensus.cc:515] T a08760e15aac4630a629431f56024dc8 P e61c3a8f61bb48f8a963c9480e53c168 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:35.588569 24545 raft_consensus.cc:493] T ed7fdbcb96d14d418db9ca90a792588a P e61c3a8f61bb48f8a963c9480e53c168 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 0473d2b2d01f4459b1e90fd12cc7840e)
I20260709 13:06:35.669410 19483 raft_consensus.cc:1275] T 22196caba61445d3bec98a0aab3c337d P 0473d2b2d01f4459b1e90fd12cc7840e [term 13 FOLLOWER]: Refusing update from remote peer e61c3a8f61bb48f8a963c9480e53c168: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
W20260709 13:06:35.676765 19374 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:35.681922 19377 leader_election.cc:304] T f1b10566f45d4a7d9029858330e02d5b P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:06:35.610133 24700 raft_consensus.cc:2749] T 4509b76741dc428e9201c70c1658da13 P e61c3a8f61bb48f8a963c9480e53c168 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:06:35.670610 24795 leader_election.cc:290] T 1a61655d99124a29b486ba4a5b37faea P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 13 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:06:35.673018 24825 raft_consensus.cc:2749] T fa8650e71aa14778b3d73721fc50d9fc P e5256d91808b47c195bc9b4dbd7f2b87 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:06:35.689802 19551 raft_consensus.cc:2468] T 85c494af21f9457a85da47b9bc70c1fd P e61c3a8f61bb48f8a963c9480e53c168 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 15.
I20260709 13:06:35.599161 24813 consensus_queue.cc:1059] T 65d8cb8d6ec64f459d5a47cefab10acf P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 }, Status: INVALID_TERM, Last received: 15.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.082s
W20260709 13:06:35.697487 19526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.2:46257, user_credentials={real_user=slave}} blocked reactor thread for 107283us
I20260709 13:06:35.700700 19526 leader_election.cc:304] T 21e14947d70440f19044d8f75c31e1f9 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168; no voters: e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:06:35.694711 19377 leader_election.cc:400] T 217b5fae677b4971b3bbd2f357a1f7ff P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 11 election: Vote denied by peer 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257) with higher term. Message: Invalid argument: T 217b5fae677b4971b3bbd2f357a1f7ff P 0473d2b2d01f4459b1e90fd12cc7840e [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate e5256d91808b47c195bc9b4dbd7f2b87 for earlier term 11. Current term is 12.
I20260709 13:06:35.699249 19523 leader_election.cc:304] T b08304a0a02b42d7840c4e8ee9a6bd1a P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:06:35.696250 19551 raft_consensus.cc:1240] T 7f575b143b844aa096b50997dad3516a P e61c3a8f61bb48f8a963c9480e53c168 [term 11 FOLLOWER]: Rejecting Update request from peer e5256d91808b47c195bc9b4dbd7f2b87 for earlier term 10. Current term is 11. Ops: []
I20260709 13:06:35.712946 19551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7be9efa6559648dbb5a0f7684c4542d1" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:06:35.715034 19551 raft_consensus.cc:1240] T ef32ce6fdd0e40d382c79974f30295c6 P e61c3a8f61bb48f8a963c9480e53c168 [term 18 FOLLOWER]: Rejecting Update request from peer e5256d91808b47c195bc9b4dbd7f2b87 for earlier term 17. Current term is 18. Ops: [17.10-17.10]
I20260709 13:06:35.716464 19526 leader_election.cc:304] T 217b5fae677b4971b3bbd2f357a1f7ff P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e61c3a8f61bb48f8a963c9480e53c168; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:06:35.702400 24798 raft_consensus.cc:3055] T ece3db938bc649d4a40a51522ed5259c P e5256d91808b47c195bc9b4dbd7f2b87 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:06:35.722396 19377 leader_election.cc:400] T 2b74109013a140ada21feeef92d6f563 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 11 pre-election: Vote denied by peer 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257) with higher term. Message: Invalid argument: T 2b74109013a140ada21feeef92d6f563 P 0473d2b2d01f4459b1e90fd12cc7840e [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e5256d91808b47c195bc9b4dbd7f2b87 for earlier term 11. Current term is 12.
I20260709 13:06:35.722815 24702 raft_consensus.cc:2804] T 21e14947d70440f19044d8f75c31e1f9 P e61c3a8f61bb48f8a963c9480e53c168 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:06:35.723254 24790 raft_consensus.cc:2804] T b08304a0a02b42d7840c4e8ee9a6bd1a P e61c3a8f61bb48f8a963c9480e53c168 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:06:35.671854 24545 raft_consensus.cc:515] T ed7fdbcb96d14d418db9ca90a792588a P e61c3a8f61bb48f8a963c9480e53c168 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:35.692955 24372 raft_consensus.cc:2749] T f1b10566f45d4a7d9029858330e02d5b P e5256d91808b47c195bc9b4dbd7f2b87 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:06:35.745165 19406 raft_consensus.cc:1275] T 2b74109013a140ada21feeef92d6f563 P e5256d91808b47c195bc9b4dbd7f2b87 [term 12 FOLLOWER]: Refusing update from remote peer e61c3a8f61bb48f8a963c9480e53c168: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:06:35.724720 19377 leader_election.cc:403] T 2b74109013a140ada21feeef92d6f563 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 11 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:06:35.670737 24771 raft_consensus.cc:515] T 1efebf73c86e432baa55533136b6e12c P e61c3a8f61bb48f8a963c9480e53c168 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:35.750142 24545 leader_election.cc:290] T ed7fdbcb96d14d418db9ca90a792588a P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:06:35.750926 19556 raft_consensus.cc:1240] T 28af091831594f9d8e96482078cc7625 P e61c3a8f61bb48f8a963c9480e53c168 [term 16 FOLLOWER]: Rejecting Update request from peer e5256d91808b47c195bc9b4dbd7f2b87 for earlier term 15. Current term is 16. Ops: []
I20260709 13:06:35.751271 24771 leader_election.cc:290] T 1efebf73c86e432baa55533136b6e12c P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:06:35.671799 24597 raft_consensus.cc:515] T df751f992649444090e27965eb1af85d P e5256d91808b47c195bc9b4dbd7f2b87 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:35.752071 19410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e1f505cb0f1427bbd698ac889d80821" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:06:35.753425 24597 leader_election.cc:290] T df751f992649444090e27965eb1af85d P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 18 election: Requested vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:06:35.753667 20112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed7fdbcb96d14d418db9ca90a792588a" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:06:35.754578 20112 raft_consensus.cc:2393] T ed7fdbcb96d14d418db9ca90a792588a P 127766fc592545a4997f7790f50f6076 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e61c3a8f61bb48f8a963c9480e53c168 in current term 11: Already voted for candidate 127766fc592545a4997f7790f50f6076 in this term.
I20260709 13:06:35.755357 20106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1efebf73c86e432baa55533136b6e12c" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:06:35.688454 19552 raft_consensus.cc:2468] T bc225c93219c45538b53a1bd3d387e4d P e61c3a8f61bb48f8a963c9480e53c168 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 14.
I20260709 13:06:35.733759 19407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86a6797bdfe94fa496c050ceae4bd0d9" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
I20260709 13:06:35.684494 24824 consensus_queue.cc:1059] T 28af091831594f9d8e96482078cc7625 P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 }, Status: INVALID_TERM, Last received: 15.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.016s
I20260709 13:06:35.741849 19409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f575b143b844aa096b50997dad3516a" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
I20260709 13:06:35.742810 19404 raft_consensus.cc:1275] T 22196caba61445d3bec98a0aab3c337d P e5256d91808b47c195bc9b4dbd7f2b87 [term 13 FOLLOWER]: Refusing update from remote peer e61c3a8f61bb48f8a963c9480e53c168: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 13:06:35.756237 24555 raft_consensus.cc:515] T 9962423cb4e54fcfa5de01daf68a86e7 P e5256d91808b47c195bc9b4dbd7f2b87 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:35.756901 19407 raft_consensus.cc:2393] T 86a6797bdfe94fa496c050ceae4bd0d9 P e5256d91808b47c195bc9b4dbd7f2b87 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate e61c3a8f61bb48f8a963c9480e53c168 in current term 11: Already voted for candidate e5256d91808b47c195bc9b4dbd7f2b87 in this term.
I20260709 13:06:35.671984 24573 consensus_queue.cc:260] T 0cdf56e38bbc453d9438d359e5a69955 P 0473d2b2d01f4459b1e90fd12cc7840e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:35.757896 24573 raft_consensus.cc:3060] T 0cdf56e38bbc453d9438d359e5a69955 P 0473d2b2d01f4459b1e90fd12cc7840e [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:06:35.759526 20106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9962423cb4e54fcfa5de01daf68a86e7" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076"
I20260709 13:06:35.761534 24823 raft_consensus.cc:515] T 70797e5783b5454ab0d0eea663e791e3 P e5256d91808b47c195bc9b4dbd7f2b87 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:35.724205 24825 raft_consensus.cc:493] T 179fd671030940b4b4a4e24bcc4aba0a P e5256d91808b47c195bc9b4dbd7f2b87 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:35.762907 19403 raft_consensus.cc:1240] T 70797e5783b5454ab0d0eea663e791e3 P e5256d91808b47c195bc9b4dbd7f2b87 [term 15 FOLLOWER]: Rejecting Update request from peer 127766fc592545a4997f7790f50f6076 for earlier term 14. Current term is 15. Ops: []
I20260709 13:06:35.747694 24700 raft_consensus.cc:2749] T 217b5fae677b4971b3bbd2f357a1f7ff P e61c3a8f61bb48f8a963c9480e53c168 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:06:35.762625 24825 raft_consensus.cc:515] T 179fd671030940b4b4a4e24bcc4aba0a P e5256d91808b47c195bc9b4dbd7f2b87 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:35.767261 24813 raft_consensus.cc:2749] T 2b74109013a140ada21feeef92d6f563 P e5256d91808b47c195bc9b4dbd7f2b87 [term 12 FOLLOWER]: Leader pre-election lost for term 11. Reason: Vote denied by peer 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257) with higher term. Message: Invalid argument: T 2b74109013a140ada21feeef92d6f563 P 0473d2b2d01f4459b1e90fd12cc7840e [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e5256d91808b47c195bc9b4dbd7f2b87 for earlier term 11. Current term is 12.
I20260709 13:06:35.767625 24824 raft_consensus.cc:3055] T 28af091831594f9d8e96482078cc7625 P e5256d91808b47c195bc9b4dbd7f2b87 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:06:35.767987 24824 raft_consensus.cc:740] T 28af091831594f9d8e96482078cc7625 P e5256d91808b47c195bc9b4dbd7f2b87 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: e5256d91808b47c195bc9b4dbd7f2b87, State: Running, Role: LEADER
I20260709 13:06:35.736790 24702 raft_consensus.cc:493] T 21e14947d70440f19044d8f75c31e1f9 P e61c3a8f61bb48f8a963c9480e53c168 [term 14 FOLLOWER]: Starting leader election (detected failure of leader e5256d91808b47c195bc9b4dbd7f2b87)
I20260709 13:06:35.768567 24702 raft_consensus.cc:3060] T 21e14947d70440f19044d8f75c31e1f9 P e61c3a8f61bb48f8a963c9480e53c168 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:06:35.768783 24824 consensus_queue.cc:260] T 28af091831594f9d8e96482078cc7625 P e5256d91808b47c195bc9b4dbd7f2b87 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.8, Last appended by leader: 8, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:35.770025 24824 raft_consensus.cc:3060] T 28af091831594f9d8e96482078cc7625 P e5256d91808b47c195bc9b4dbd7f2b87 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:06:35.770344 19482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96efeaaf1057492490e9a621f37e1a2d" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:06:35.770998 19482 raft_consensus.cc:2468] T 96efeaaf1057492490e9a621f37e1a2d P 0473d2b2d01f4459b1e90fd12cc7840e [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 16.
I20260709 13:06:35.724481 24798 raft_consensus.cc:740] T ece3db938bc649d4a40a51522ed5259c P e5256d91808b47c195bc9b4dbd7f2b87 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: e5256d91808b47c195bc9b4dbd7f2b87, State: Running, Role: LEADER
I20260709 13:06:35.772586 24276 raft_consensus.cc:3060] T 0e1085d23e8347fbbd5bce7542f4b1f4 P 0473d2b2d01f4459b1e90fd12cc7840e [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:06:35.772904 24678 raft_consensus.cc:2749] T 0cdf56e38bbc453d9438d359e5a69955 P e61c3a8f61bb48f8a963c9480e53c168 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:06:35.736624 24790 raft_consensus.cc:493] T b08304a0a02b42d7840c4e8ee9a6bd1a P e61c3a8f61bb48f8a963c9480e53c168 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:35.773650 24790 raft_consensus.cc:3060] T b08304a0a02b42d7840c4e8ee9a6bd1a P e61c3a8f61bb48f8a963c9480e53c168 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:06:35.772933 24798 consensus_queue.cc:260] T ece3db938bc649d4a40a51522ed5259c P e5256d91808b47c195bc9b4dbd7f2b87 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:35.781415 24826 raft_consensus.cc:2749] T ab43d85f64114d4ebf618930e43d9ed0 P e5256d91808b47c195bc9b4dbd7f2b87 [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:06:35.765405 24812 raft_consensus.cc:515] T edd7d470b5014c9489be7f41f64355c9 P e61c3a8f61bb48f8a963c9480e53c168 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:35.784178 24812 leader_election.cc:290] T edd7d470b5014c9489be7f41f64355c9 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 16 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:06:35.785476 24787 leader_election.cc:290] T a08760e15aac4630a629431f56024dc8 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:06:35.787829 19408 raft_consensus.cc:1275] T 179fd671030940b4b4a4e24bcc4aba0a P e5256d91808b47c195bc9b4dbd7f2b87 [term 17 FOLLOWER]: Refusing update from remote peer e61c3a8f61bb48f8a963c9480e53c168: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 17 index: 10. (term mismatch)
I20260709 13:06:35.788324 19408 pending_rounds.cc:85] T 179fd671030940b4b4a4e24bcc4aba0a P e5256d91808b47c195bc9b4dbd7f2b87: Aborting all ops after (but not including) 9
I20260709 13:06:35.788602 19408 pending_rounds.cc:107] T 179fd671030940b4b4a4e24bcc4aba0a P e5256d91808b47c195bc9b4dbd7f2b87: Aborting uncommitted NO_OP operation due to leader change: 16.10
I20260709 13:06:35.788905 19408 raft_consensus.cc:2889] T 179fd671030940b4b4a4e24bcc4aba0a P e5256d91808b47c195bc9b4dbd7f2b87 [term 17 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:06:35.790584 19406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a61655d99124a29b486ba4a5b37faea" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
I20260709 13:06:35.792749 19404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edd7d470b5014c9489be7f41f64355c9" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
I20260709 13:06:35.793496 19405 raft_consensus.cc:1275] T f1b10566f45d4a7d9029858330e02d5b P e5256d91808b47c195bc9b4dbd7f2b87 [term 15 FOLLOWER]: Refusing update from remote peer e61c3a8f61bb48f8a963c9480e53c168: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 13:06:35.793638 19404 raft_consensus.cc:2393] T edd7d470b5014c9489be7f41f64355c9 P e5256d91808b47c195bc9b4dbd7f2b87 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate e61c3a8f61bb48f8a963c9480e53c168 in current term 16: Already voted for candidate e5256d91808b47c195bc9b4dbd7f2b87 in this term.
W20260709 13:06:35.794646 19377 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.2:46257, user_credentials={real_user=slave}} blocked reactor thread for 72532.6us
I20260709 13:06:35.758426 24555 leader_election.cc:290] T 9962423cb4e54fcfa5de01daf68a86e7 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 14 election: Requested vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:06:35.809845 24790 raft_consensus.cc:515] T b08304a0a02b42d7840c4e8ee9a6bd1a P e61c3a8f61bb48f8a963c9480e53c168 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:35.806038 19406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a08760e15aac4630a629431f56024dc8" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:06:35.825255 19406 raft_consensus.cc:2393] T a08760e15aac4630a629431f56024dc8 P e5256d91808b47c195bc9b4dbd7f2b87 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e61c3a8f61bb48f8a963c9480e53c168 in current term 18: Already voted for candidate e5256d91808b47c195bc9b4dbd7f2b87 in this term.
I20260709 13:06:35.810931 19552 raft_consensus.cc:1275] T 3e1f505cb0f1427bbd698ac889d80821 P e61c3a8f61bb48f8a963c9480e53c168 [term 16 FOLLOWER]: Refusing update from remote peer e5256d91808b47c195bc9b4dbd7f2b87: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 13:06:35.826318 19552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70797e5783b5454ab0d0eea663e791e3" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:06:35.827548 19552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df751f992649444090e27965eb1af85d" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
W20260709 13:06:35.811260 24829 log.cc:927] Time spent T 217b5fae677b4971b3bbd2f357a1f7ff P 0473d2b2d01f4459b1e90fd12cc7840e: Append to log took a long time: real 0.213s	user 0.000s	sys 0.000s
I20260709 13:06:35.816229 24825 leader_election.cc:290] T 179fd671030940b4b4a4e24bcc4aba0a P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:06:35.804956 24823 leader_election.cc:290] T 70797e5783b5454ab0d0eea663e791e3 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 15 election: Requested vote from peers e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:06:35.829069 19523 leader_election.cc:304] T 86a6797bdfe94fa496c050ceae4bd0d9 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e61c3a8f61bb48f8a963c9480e53c168; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:06:35.833365 24780 raft_consensus.cc:493] T 309c3ca0ca4b4f3ba129752ea2cb293b P 0473d2b2d01f4459b1e90fd12cc7840e [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 127766fc592545a4997f7790f50f6076)
I20260709 13:06:35.833927 24780 raft_consensus.cc:515] T 309c3ca0ca4b4f3ba129752ea2cb293b P 0473d2b2d01f4459b1e90fd12cc7840e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } attrs { replace: true } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:35.834237 19484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "172b3dd13109415a955b71ac0e9d2234" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:06:35.835040 19484 raft_consensus.cc:2376] T 172b3dd13109415a955b71ac0e9d2234 P 0473d2b2d01f4459b1e90fd12cc7840e [term 13 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 127766fc592545a4997f7790f50f6076 in term 13. Re-sending same reply.
I20260709 13:06:35.835534 19477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96efeaaf1057492490e9a621f37e1a2d" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:06:35.836198 19477 raft_consensus.cc:2468] T 96efeaaf1057492490e9a621f37e1a2d P 0473d2b2d01f4459b1e90fd12cc7840e [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 127766fc592545a4997f7790f50f6076 in term 16.
I20260709 13:06:35.840991 20112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70797e5783b5454ab0d0eea663e791e3" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076"
I20260709 13:06:35.851361 19483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed7fdbcb96d14d418db9ca90a792588a" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:06:35.852604 19482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c5eebf646ad445a9d1b1adc319d7b16" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:06:35.853149 19477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0afb57ae58a24a01850491d69f0213dd" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:06:35.853492 19486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff9b0eddd810459b82d91c60777c10eb" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:06:35.854030 19486 raft_consensus.cc:3060] T ff9b0eddd810459b82d91c60777c10eb P 0473d2b2d01f4459b1e90fd12cc7840e [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:06:35.856175 19482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e1085d23e8347fbbd5bce7542f4b1f4" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:06:35.855203 19479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48824d5acfbc485ebf8c2d944e7202de" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:06:35.865907 19484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e1085d23e8347fbbd5bce7542f4b1f4" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:06:35.871042 19477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c5eebf646ad445a9d1b1adc319d7b16" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:06:35.901767 19477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76cb037fc9064d13b59a8969d897ce8c" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
W20260709 13:06:35.904112 19377 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:35.906997 19477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86a6797bdfe94fa496c050ceae4bd0d9" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:06:35.908203 19477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e1f505cb0f1427bbd698ac889d80821" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
W20260709 13:06:35.873128 20075 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:35.919239 19477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc225c93219c45538b53a1bd3d387e4d" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:06:35.888401 19479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76cb037fc9064d13b59a8969d897ce8c" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:06:35.892966 19484 raft_consensus.cc:1275] T e381f1d6b8184797ad142de49be225a8 P 0473d2b2d01f4459b1e90fd12cc7840e [term 12 FOLLOWER]: Refusing update from remote peer e5256d91808b47c195bc9b4dbd7f2b87: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 13:06:35.861644 24678 raft_consensus.cc:2749] T 86a6797bdfe94fa496c050ceae4bd0d9 P e61c3a8f61bb48f8a963c9480e53c168 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:06:35.924674 19477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22196caba61445d3bec98a0aab3c337d" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:06:35.928478 19408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a16f7501e2444fb86d4e2778e734e02" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:06:35.887777 19375 leader_election.cc:304] T b08304a0a02b42d7840c4e8ee9a6bd1a P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:06:35.929534 19477 raft_consensus.cc:2468] T 22196caba61445d3bec98a0aab3c337d P 0473d2b2d01f4459b1e90fd12cc7840e [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 13.
I20260709 13:06:35.930570 19477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46c5bfeecc314717bffe987e6844b6d0" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 20 candidate_status { last_received { term: 19 index: 9 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
W20260709 13:06:35.937265 19375 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.3:36891, user_credentials={real_user=slave}} blocked reactor thread for 49566.9us
I20260709 13:06:35.939409 19552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "179fd671030940b4b4a4e24bcc4aba0a" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:06:35.872540 19483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62c6c134d3d24a1ab144dd9ee6bc3f64" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:06:35.957949 19486 raft_consensus.cc:2468] T ff9b0eddd810459b82d91c60777c10eb P 0473d2b2d01f4459b1e90fd12cc7840e [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 127766fc592545a4997f7790f50f6076 in term 16.
W20260709 13:06:35.958649 19452 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:35.982288 19452 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:35.981583 20076 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.3:36891, user_credentials={real_user=slave}} blocked reactor thread for 169700us
I20260709 13:06:35.982510 19486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a08760e15aac4630a629431f56024dc8" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:06:35.867199 24771 raft_consensus.cc:493] T 2a16f7501e2444fb86d4e2778e734e02 P e61c3a8f61bb48f8a963c9480e53c168 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:35.849910 24787 consensus_queue.cc:1048] T 22196caba61445d3bec98a0aab3c337d P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.063s
I20260709 13:06:35.980160 20108 raft_consensus.cc:1240] T 0e1085d23e8347fbbd5bce7542f4b1f4 P 127766fc592545a4997f7790f50f6076 [term 12 LEADER]: Rejecting Update request from peer 0473d2b2d01f4459b1e90fd12cc7840e for earlier term 11. Current term is 12. Ops: []
I20260709 13:06:35.885504 24758 leader_election.cc:290] T 2a16f7501e2444fb86d4e2778e734e02 P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:06:35.992210 19484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "309c3ca0ca4b4f3ba129752ea2cb293b" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:06:35.994398 19408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b08304a0a02b42d7840c4e8ee9a6bd1a" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
I20260709 13:06:35.990195 19483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f85fc4b527a48848e5faa083b604e36" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:06:35.983543 19486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46c5bfeecc314717bffe987e6844b6d0" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 20 candidate_status { last_received { term: 19 index: 9 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:06:36.009616 19484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36f6ba92b9ba46babe4ebd6c02e5fbd9" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:06:36.010076 19479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b08304a0a02b42d7840c4e8ee9a6bd1a" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
W20260709 13:06:36.016113 19451 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:36.011777 19477 raft_consensus.cc:2468] T 46c5bfeecc314717bffe987e6844b6d0 P 0473d2b2d01f4459b1e90fd12cc7840e [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 20.
I20260709 13:06:36.017428 19477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edd7d470b5014c9489be7f41f64355c9" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 16 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:06:36.018397 19477 raft_consensus.cc:2410] T edd7d470b5014c9489be7f41f64355c9 P 0473d2b2d01f4459b1e90fd12cc7840e [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate e5256d91808b47c195bc9b4dbd7f2b87 for term 16 because replica has last-logged OpId of term: 15 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 7.
I20260709 13:06:35.987694 24824 raft_consensus.cc:2804] T b08304a0a02b42d7840c4e8ee9a6bd1a P e5256d91808b47c195bc9b4dbd7f2b87 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:06:36.020814 19402 raft_consensus.cc:1275] T b9f0d59553ad444883fcf5b5909f9798 P e5256d91808b47c195bc9b4dbd7f2b87 [term 14 FOLLOWER]: Refusing update from remote peer e61c3a8f61bb48f8a963c9480e53c168: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 13:06:35.868234 24700 consensus_queue.cc:1048] T 2b74109013a140ada21feeef92d6f563 P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.135s
I20260709 13:06:35.879076 24837 consensus_queue.cc:1048] T f1b10566f45d4a7d9029858330e02d5b P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.134s
I20260709 13:06:36.041440 19483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "775c229504194560ba9589bc2199b089" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:06:36.043151 19483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc225c93219c45538b53a1bd3d387e4d" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:06:36.044517 19483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab43d85f64114d4ebf618930e43d9ed0" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:06:36.041544 19477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a08760e15aac4630a629431f56024dc8" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:06:36.004228 24838 raft_consensus.cc:493] T ab43d85f64114d4ebf618930e43d9ed0 P e61c3a8f61bb48f8a963c9480e53c168 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 0473d2b2d01f4459b1e90fd12cc7840e)
I20260709 13:06:35.999650 24795 consensus_queue.cc:1048] T 179fd671030940b4b4a4e24bcc4aba0a P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 7, Time since last communication: 0.045s
I20260709 13:06:36.033816 24824 raft_consensus.cc:493] T b08304a0a02b42d7840c4e8ee9a6bd1a P e5256d91808b47c195bc9b4dbd7f2b87 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 0473d2b2d01f4459b1e90fd12cc7840e)
I20260709 13:06:36.002544 24771 raft_consensus.cc:515] T 2a16f7501e2444fb86d4e2778e734e02 P e61c3a8f61bb48f8a963c9480e53c168 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:36.064328 19560 raft_consensus.cc:1240] T 3e1f505cb0f1427bbd698ac889d80821 P e61c3a8f61bb48f8a963c9480e53c168 [term 16 FOLLOWER]: Rejecting Update request from peer 0473d2b2d01f4459b1e90fd12cc7840e for earlier term 15. Current term is 16. Ops: []
I20260709 13:06:36.068849 19560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22196caba61445d3bec98a0aab3c337d" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
W20260709 13:06:36.064766 20078 leader_election.cc:336] T 172b3dd13109415a955b71ac0e9d2234 P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 13 election: RPC error from VoteRequest() call to peer 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257): Timed out: RequestConsensusVote RPC to 127.17.223.2:46257 timed out after 1.654s (SENT)
I20260709 13:06:36.070087 20078 leader_election.cc:304] T 172b3dd13109415a955b71ac0e9d2234 P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 127766fc592545a4997f7790f50f6076; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:06:36.071235 19560 raft_consensus.cc:1240] T b08304a0a02b42d7840c4e8ee9a6bd1a P e61c3a8f61bb48f8a963c9480e53c168 [term 15 FOLLOWER]: Rejecting Update request from peer 0473d2b2d01f4459b1e90fd12cc7840e for earlier term 14. Current term is 15. Ops: [14.9-14.9]
I20260709 13:06:36.048857 24780 leader_election.cc:290] T 309c3ca0ca4b4f3ba129752ea2cb293b P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:06:36.072405 19560 raft_consensus.cc:1240] T 0cdf56e38bbc453d9438d359e5a69955 P e61c3a8f61bb48f8a963c9480e53c168 [term 15 FOLLOWER]: Rejecting Update request from peer 0473d2b2d01f4459b1e90fd12cc7840e for earlier term 14. Current term is 15. Ops: []
I20260709 13:06:36.076254 19523 leader_election.cc:304] T 48824d5acfbc485ebf8c2d944e7202de P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e61c3a8f61bb48f8a963c9480e53c168; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, 127766fc592545a4997f7790f50f6076
I20260709 13:06:36.077283 20106 raft_consensus.cc:1240] T ece3db938bc649d4a40a51522ed5259c P 127766fc592545a4997f7790f50f6076 [term 11 FOLLOWER]: Rejecting Update request from peer e5256d91808b47c195bc9b4dbd7f2b87 for earlier term 10. Current term is 11. Ops: []
I20260709 13:06:36.086580 24457 raft_consensus.cc:493] T 172b3dd13109415a955b71ac0e9d2234 P e5256d91808b47c195bc9b4dbd7f2b87 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:36.090978 19374 leader_election.cc:304] T fa731b585f684a7fb2d106c50f143b83 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87; no voters: 127766fc592545a4997f7790f50f6076, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:06:36.114444 24457 raft_consensus.cc:515] T 172b3dd13109415a955b71ac0e9d2234 P e5256d91808b47c195bc9b4dbd7f2b87 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:36.116845 24457 leader_election.cc:290] T 172b3dd13109415a955b71ac0e9d2234 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:06:36.117452 24457 raft_consensus.cc:2749] T fa731b585f684a7fb2d106c50f143b83 P e5256d91808b47c195bc9b4dbd7f2b87 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:06:36.118255 20110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "172b3dd13109415a955b71ac0e9d2234" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:06:36.121407 24771 leader_election.cc:290] T 2a16f7501e2444fb86d4e2778e734e02 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:06:36.122006 24771 raft_consensus.cc:2749] T 48824d5acfbc485ebf8c2d944e7202de P e61c3a8f61bb48f8a963c9480e53c168 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:06:36.061546 24824 raft_consensus.cc:3060] T b08304a0a02b42d7840c4e8ee9a6bd1a P e5256d91808b47c195bc9b4dbd7f2b87 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:06:36.128564 24806 raft_consensus.cc:2749] T 172b3dd13109415a955b71ac0e9d2234 P 127766fc592545a4997f7790f50f6076 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:06:36.129338 20110 raft_consensus.cc:2468] T 172b3dd13109415a955b71ac0e9d2234 P 127766fc592545a4997f7790f50f6076 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 13.
I20260709 13:06:36.039801 24781 consensus_queue.cc:1048] T b9f0d59553ad444883fcf5b5909f9798 P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.023s
I20260709 13:06:36.101590 24756 raft_consensus.cc:3055] T 65d8cb8d6ec64f459d5a47cefab10acf P e5256d91808b47c195bc9b4dbd7f2b87 [term 15 LEADER]: Stepping down as leader of term 15
W20260709 13:06:36.102334 24840 log.cc:927] Time spent T ff75a1d4cb1f493db8f71ddc136ba9ab P e5256d91808b47c195bc9b4dbd7f2b87: Append to log took a long time: real 0.078s	user 0.000s	sys 0.001s
I20260709 13:06:36.102716 24798 raft_consensus.cc:3060] T ece3db938bc649d4a40a51522ed5259c P e5256d91808b47c195bc9b4dbd7f2b87 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:06:36.104415 19526 leader_election.cc:304] T 96efeaaf1057492490e9a621f37e1a2d P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168; no voters: 127766fc592545a4997f7790f50f6076
I20260709 13:06:36.106439 24791 consensus_queue.cc:1059] T 1dc5b3532fe54f74876d02beffa2c230 P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 }, Status: INVALID_TERM, Last received: 15.8, Next index: 9, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:06:36.107070 24789 consensus_queue.cc:1048] T 22196caba61445d3bec98a0aab3c337d P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:06:36.046504 19477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2725d2c4cb054f18b0fc8f735c15f6c2" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 18 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:06:36.054876 24790 leader_election.cc:290] T b08304a0a02b42d7840c4e8ee9a6bd1a P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 15 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
W20260709 13:06:36.109964 20078 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.2:46257, user_credentials={real_user=slave}} blocked reactor thread for 45220.9us
W20260709 13:06:36.110716 19449 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:36.156725 19477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9962423cb4e54fcfa5de01daf68a86e7" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:06:36.136787 19405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a16f7501e2444fb86d4e2778e734e02" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:06:36.138131 19406 raft_consensus.cc:1275] T f93ee515a9c14139bf566522ed8232f3 P e5256d91808b47c195bc9b4dbd7f2b87 [term 16 FOLLOWER]: Refusing update from remote peer e61c3a8f61bb48f8a963c9480e53c168: Log matching property violated. Preceding OpId in replica: term: 15 index: 7. Preceding OpId from leader: term: 16 index: 8. (index mismatch)
I20260709 13:06:36.112341 19560 raft_consensus.cc:1240] T 86a6797bdfe94fa496c050ceae4bd0d9 P e61c3a8f61bb48f8a963c9480e53c168 [term 11 FOLLOWER]: Rejecting Update request from peer 0473d2b2d01f4459b1e90fd12cc7840e for earlier term 10. Current term is 11. Ops: []
I20260709 13:06:36.141368 20104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a16f7501e2444fb86d4e2778e734e02" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:06:36.159246 20104 raft_consensus.cc:2468] T 2a16f7501e2444fb86d4e2778e734e02 P 127766fc592545a4997f7790f50f6076 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 14.
I20260709 13:06:36.159339 24796 consensus_queue.cc:1059] T 6c5eebf646ad445a9d1b1adc319d7b16 P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false }, Status: INVALID_TERM, Last received: 12.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:06:36.160033 24796 consensus_queue.cc:1243] T 6c5eebf646ad445a9d1b1adc319d7b16 P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Peer 127766fc592545a4997f7790f50f6076 log is divergent from this leader: its last log entry 13.11 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 10
I20260709 13:06:36.160497 24796 consensus_queue.cc:1059] T ed7fdbcb96d14d418db9ca90a792588a P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:06:36.152957 19553 raft_consensus.cc:1240] T 48824d5acfbc485ebf8c2d944e7202de P e61c3a8f61bb48f8a963c9480e53c168 [term 17 FOLLOWER]: Rejecting Update request from peer 0473d2b2d01f4459b1e90fd12cc7840e for earlier term 16. Current term is 17. Ops: []
W20260709 13:06:36.151154 19526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.2:46257, user_credentials={real_user=slave}} blocked reactor thread for 46817.6us
I20260709 13:06:36.110105 19377 leader_election.cc:304] T 76cb037fc9064d13b59a8969d897ce8c P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:06:36.164773 19477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "179fd671030940b4b4a4e24bcc4aba0a" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:06:36.160569 19523 leader_election.cc:304] T 2a16f7501e2444fb86d4e2778e734e02 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 127766fc592545a4997f7790f50f6076, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:06:36.054102 24838 raft_consensus.cc:515] T ab43d85f64114d4ebf618930e43d9ed0 P e61c3a8f61bb48f8a963c9480e53c168 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:36.157613 19551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "309c3ca0ca4b4f3ba129752ea2cb293b" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
W20260709 13:06:36.166141 19559 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41504 (request call id 812) took 2273 ms (client timeout 2125 ms). Trace:
W20260709 13:06:36.177928 19450 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:36.169565 19377 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.2:46257, user_credentials={real_user=slave}} blocked reactor thread for 59543us
I20260709 13:06:36.175246 19482 raft_consensus.cc:2468] T 0e1085d23e8347fbbd5bce7542f4b1f4 P 0473d2b2d01f4459b1e90fd12cc7840e [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 127766fc592545a4997f7790f50f6076 in term 12.
I20260709 13:06:36.141326 24756 raft_consensus.cc:740] T 65d8cb8d6ec64f459d5a47cefab10acf P e5256d91808b47c195bc9b4dbd7f2b87 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: e5256d91808b47c195bc9b4dbd7f2b87, State: Running, Role: LEADER
I20260709 13:06:36.177210 19551 raft_consensus.cc:2468] T 309c3ca0ca4b4f3ba129752ea2cb293b P e61c3a8f61bb48f8a963c9480e53c168 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 9.
I20260709 13:06:36.168690 19485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df751f992649444090e27965eb1af85d" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:06:36.219144 19485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edd7d470b5014c9489be7f41f64355c9" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
W20260709 13:06:36.177757 19559 rpcz_store.cc:269] 0709 13:06:33.879001 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:34.005943 (+126942us) service_pool.cc:224] Handling call
0709 13:06:36.152331 (+2146388us) spinlock_profiling.cc:243] Waited 1.04 s on lock 0x7b54000f0fd4. stack: 00007f4a79de9343 00007f4a79de9240 00007f4a797781d4 00007f4a834b6304 00007f4a834b6299 00007f4a7ce71571 00007f4a7cf0c2fa 00007f4a81ecdb17 00007f4a7b4486d4 00007f4a7b448662 00007f4a7b448591 00007f4a7b44850c 00007f4a7b4477c2 00007f4a7b24348c 00007f4a7b2428c6 00007f4a7b24226f
0709 13:06:36.152503 (+   172us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2384573184}
I20260709 13:06:36.162488 24796 raft_consensus.cc:3055] T 6c5eebf646ad445a9d1b1adc319d7b16 P 0473d2b2d01f4459b1e90fd12cc7840e [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:06:36.220875 20104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "309c3ca0ca4b4f3ba129752ea2cb293b" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:06:36.184108 19377 leader_election.cc:304] T 86a6797bdfe94fa496c050ceae4bd0d9 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:06:36.165355 19477 raft_consensus.cc:2468] T 179fd671030940b4b4a4e24bcc4aba0a P 0473d2b2d01f4459b1e90fd12cc7840e [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 17.
I20260709 13:06:36.223367 19477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b08304a0a02b42d7840c4e8ee9a6bd1a" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
W20260709 13:06:36.224172 19450 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.3:36891, user_credentials={real_user=slave}} blocked reactor thread for 45706.7us
I20260709 13:06:36.228582 19377 leader_election.cc:304] T 22196caba61445d3bec98a0aab3c337d P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87; no voters: e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:06:36.163566 24761 raft_consensus.cc:3055] T ed7fdbcb96d14d418db9ca90a792588a P 0473d2b2d01f4459b1e90fd12cc7840e [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:06:36.236268 19450 leader_election.cc:304] T 2725d2c4cb054f18b0fc8f735c15f6c2 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e; no voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:06:36.208863 24781 raft_consensus.cc:2804] T 2a16f7501e2444fb86d4e2778e734e02 P e61c3a8f61bb48f8a963c9480e53c168 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:06:36.267339 19477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1efebf73c86e432baa55533136b6e12c" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:06:36.185071 24790 raft_consensus.cc:2804] T 96efeaaf1057492490e9a621f37e1a2d P e61c3a8f61bb48f8a963c9480e53c168 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:06:36.225847 24753 raft_consensus.cc:3060] T f1b10566f45d4a7d9029858330e02d5b P 0473d2b2d01f4459b1e90fd12cc7840e [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:06:36.277580 20078 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.2:46257, user_credentials={real_user=slave}} blocked reactor thread for 45200.7us
I20260709 13:06:36.163683 24702 raft_consensus.cc:515] T 21e14947d70440f19044d8f75c31e1f9 P e61c3a8f61bb48f8a963c9480e53c168 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:36.226642 24796 raft_consensus.cc:740] T 6c5eebf646ad445a9d1b1adc319d7b16 P 0473d2b2d01f4459b1e90fd12cc7840e [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 0473d2b2d01f4459b1e90fd12cc7840e, State: Running, Role: LEADER
I20260709 13:06:36.232107 24457 raft_consensus.cc:2749] T 86a6797bdfe94fa496c050ceae4bd0d9 P e5256d91808b47c195bc9b4dbd7f2b87 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:06:36.285369 19477 raft_consensus.cc:2393] T 1efebf73c86e432baa55533136b6e12c P 0473d2b2d01f4459b1e90fd12cc7840e [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e61c3a8f61bb48f8a963c9480e53c168 in current term 13: Already voted for candidate 0473d2b2d01f4459b1e90fd12cc7840e in this term.
I20260709 13:06:36.182034 24682 raft_consensus.cc:2749] T 76cb037fc9064d13b59a8969d897ce8c P e5256d91808b47c195bc9b4dbd7f2b87 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:06:36.190809 24555 raft_consensus.cc:493] T 40e1e16737a842ee936002830f36882e P e5256d91808b47c195bc9b4dbd7f2b87 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:06:36.314147 24841 log.cc:927] Time spent T 0e1085d23e8347fbbd5bce7542f4b1f4 P 127766fc592545a4997f7790f50f6076: Append to log took a long time: real 0.268s	user 0.001s	sys 0.000s
I20260709 13:06:36.313851 24555 raft_consensus.cc:515] T 40e1e16737a842ee936002830f36882e P e5256d91808b47c195bc9b4dbd7f2b87 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:36.316821 19405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21e14947d70440f19044d8f75c31e1f9" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
I20260709 13:06:36.316123 24555 leader_election.cc:290] T 40e1e16737a842ee936002830f36882e P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
W20260709 13:06:36.290002 19376 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.192s	user 0.005s	sys 0.039s
W20260709 13:06:36.317988 19376 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.220s	user 0.005s	sys 0.039s
I20260709 13:06:36.319296 19410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28af091831594f9d8e96482078cc7625" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
I20260709 13:06:36.319823 19411 raft_consensus.cc:1240] T 76cb037fc9064d13b59a8969d897ce8c P e5256d91808b47c195bc9b4dbd7f2b87 [term 13 FOLLOWER]: Rejecting Update request from peer 0473d2b2d01f4459b1e90fd12cc7840e for earlier term 12. Current term is 13. Ops: []
I20260709 13:06:36.320713 19411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e381f1d6b8184797ad142de49be225a8" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:06:36.321647 19411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff75a1d4cb1f493db8f71ddc136ba9ab" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 16 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:06:36.322244 19480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a61655d99124a29b486ba4a5b37faea" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:06:36.233999 24761 raft_consensus.cc:740] T ed7fdbcb96d14d418db9ca90a792588a P 0473d2b2d01f4459b1e90fd12cc7840e [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 0473d2b2d01f4459b1e90fd12cc7840e, State: Running, Role: LEADER
I20260709 13:06:36.290923 20078 leader_election.cc:304] T 6c5eebf646ad445a9d1b1adc319d7b16 P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 127766fc592545a4997f7790f50f6076; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:06:36.295037 19485 raft_consensus.cc:2468] T edd7d470b5014c9489be7f41f64355c9 P 0473d2b2d01f4459b1e90fd12cc7840e [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 16.
I20260709 13:06:36.296574 19526 leader_election.cc:304] T 1efebf73c86e432baa55533136b6e12c P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e61c3a8f61bb48f8a963c9480e53c168; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, 127766fc592545a4997f7790f50f6076
I20260709 13:06:36.323426 19405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef32ce6fdd0e40d382c79974f30295c6" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 18 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
I20260709 13:06:36.298749 24827 raft_consensus.cc:3055] T b9f0d59553ad444883fcf5b5909f9798 P 0473d2b2d01f4459b1e90fd12cc7840e [term 13 LEADER]: Stepping down as leader of term 13
W20260709 13:06:36.299183 24845 log.cc:927] Time spent T 9962423cb4e54fcfa5de01daf68a86e7 P 127766fc592545a4997f7790f50f6076: Append to log took a long time: real 0.064s	user 0.000s	sys 0.000s
I20260709 13:06:36.299449 19555 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40438 (request call id 2686) took 1421 ms. Trace:
I20260709 13:06:36.334082 19555 rpcz_store.cc:276] 0709 13:06:34.878296 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:34.883957 (+  5661us) service_pool.cc:224] Handling call
0709 13:06:34.884255 (+   298us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:35.659231 (+774976us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:36.299260 (+640029us) spinlock_profiling.cc:243] Waited 774 ms on lock 0x7b540029bdd4. stack: 00007f4a79de9343 00007f4a79de9240 00007f4a797781d4 00007f4a834b6304 00007f4a834b6299 00007f4a7ce71571 00007f4a7cf08e01 00007f4a7cf0783e 00007f4a81ecc419 00007f4a7b443bd4 00007f4a7b443b62 00007f4a7b443a91 00007f4a7b443a0c 00007f4a7b442cc2 00007f4a7b24348c 00007f4a7b2428c6
0709 13:06:36.299399 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1780993792}
W20260709 13:06:36.299628 24846 log.cc:927] Time spent T 1dc5b3532fe54f74876d02beffa2c230 P e5256d91808b47c195bc9b4dbd7f2b87: Append to log took a long time: real 0.241s	user 0.000s	sys 0.001s
W20260709 13:06:36.299468 20077 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:36.301764 19479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7be9efa6559648dbb5a0f7684c4542d1" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:06:36.233744 24551 consensus_queue.cc:1048] T e381f1d6b8184797ad142de49be225a8 P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.058s
I20260709 13:06:36.302809 19486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86a6797bdfe94fa496c050ceae4bd0d9" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:06:36.304332 24702 leader_election.cc:290] T 21e14947d70440f19044d8f75c31e1f9 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 15 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:06:36.304850 19556 raft_consensus.cc:1240] T 21e14947d70440f19044d8f75c31e1f9 P e61c3a8f61bb48f8a963c9480e53c168 [term 15 FOLLOWER]: Rejecting Update request from peer e5256d91808b47c195bc9b4dbd7f2b87 for earlier term 14. Current term is 15. Ops: []
I20260709 13:06:36.305565 24796 consensus_queue.cc:260] T 6c5eebf646ad445a9d1b1adc319d7b16 P 0473d2b2d01f4459b1e90fd12cc7840e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.11, Last appended by leader: 11, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:36.306711 19477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f575b143b844aa096b50997dad3516a" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:06:36.284780 24781 raft_consensus.cc:493] T 2a16f7501e2444fb86d4e2778e734e02 P e61c3a8f61bb48f8a963c9480e53c168 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:36.291683 24790 raft_consensus.cc:493] T 96efeaaf1057492490e9a621f37e1a2d P e61c3a8f61bb48f8a963c9480e53c168 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:36.307365 19484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7be9efa6559648dbb5a0f7684c4542d1" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:06:36.310715 19481 raft_consensus.cc:1275] T f1b10566f45d4a7d9029858330e02d5b P 0473d2b2d01f4459b1e90fd12cc7840e [term 15 FOLLOWER]: Refusing update from remote peer e61c3a8f61bb48f8a963c9480e53c168: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 13:06:36.253513 19377 leader_election.cc:304] T a08760e15aac4630a629431f56024dc8 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:06:36.248862 19450 leader_election.cc:304] T e381f1d6b8184797ad142de49be225a8 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:06:36.290392 24821 raft_consensus.cc:2804] T 22196caba61445d3bec98a0aab3c337d P e5256d91808b47c195bc9b4dbd7f2b87 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:06:36.261775 24786 consensus_queue.cc:1048] T bc225c93219c45538b53a1bd3d387e4d P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.033s
I20260709 13:06:36.322594 19411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dc5b3532fe54f74876d02beffa2c230" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
I20260709 13:06:36.287986 24756 consensus_queue.cc:260] T 65d8cb8d6ec64f459d5a47cefab10acf P e5256d91808b47c195bc9b4dbd7f2b87 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:36.332634 19526 leader_election.cc:304] T edd7d470b5014c9489be7f41f64355c9 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168; no voters: e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:06:36.335417 19480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21e14947d70440f19044d8f75c31e1f9" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:06:36.337416 19410 raft_consensus.cc:2468] T 28af091831594f9d8e96482078cc7625 P e5256d91808b47c195bc9b4dbd7f2b87 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 16.
I20260709 13:06:36.286367 24471 raft_consensus.cc:493] T 4509b76741dc428e9201c70c1658da13 P 0473d2b2d01f4459b1e90fd12cc7840e [term 10 FOLLOWER]: Starting pre-election (detected failure of leader e5256d91808b47c195bc9b4dbd7f2b87)
I20260709 13:06:36.286265 24783 consensus_queue.cc:260] T 3e1f505cb0f1427bbd698ac889d80821 P 0473d2b2d01f4459b1e90fd12cc7840e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:36.340468 19405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22196caba61445d3bec98a0aab3c337d" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:06:36.284078 24839 raft_consensus.cc:2749] T 2725d2c4cb054f18b0fc8f735c15f6c2 P 0473d2b2d01f4459b1e90fd12cc7840e [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:06:36.392882 19480 raft_consensus.cc:3060] T 21e14947d70440f19044d8f75c31e1f9 P 0473d2b2d01f4459b1e90fd12cc7840e [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:06:36.379011 19486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a08760e15aac4630a629431f56024dc8" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
W20260709 13:06:36.394429 19450 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.3:36891, user_credentials={real_user=slave}} blocked reactor thread for 145568us
I20260709 13:06:36.396988 19450 leader_election.cc:304] T ef32ce6fdd0e40d382c79974f30295c6 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
W20260709 13:06:36.397353 19526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.2:46257, user_credentials={real_user=slave}} blocked reactor thread for 64810.7us
I20260709 13:06:36.398809 19526 leader_election.cc:304] T 1a61655d99124a29b486ba4a5b37faea P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e61c3a8f61bb48f8a963c9480e53c168; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87
W20260709 13:06:36.360198 19452 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:36.400059 19377 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.2:46257, user_credentials={real_user=slave}} blocked reactor thread for 168969us
I20260709 13:06:36.324497 24827 raft_consensus.cc:740] T b9f0d59553ad444883fcf5b5909f9798 P 0473d2b2d01f4459b1e90fd12cc7840e [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 0473d2b2d01f4459b1e90fd12cc7840e, State: Running, Role: LEADER
I20260709 13:06:36.401070 19410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "309c3ca0ca4b4f3ba129752ea2cb293b" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:06:36.352936 19485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed7fdbcb96d14d418db9ca90a792588a" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:06:36.401458 19405 raft_consensus.cc:1240] T df751f992649444090e27965eb1af85d P e5256d91808b47c195bc9b4dbd7f2b87 [term 18 FOLLOWER]: Rejecting Update request from peer 0473d2b2d01f4459b1e90fd12cc7840e for earlier term 17. Current term is 18. Ops: []
I20260709 13:06:36.406040 19410 raft_consensus.cc:2468] T 309c3ca0ca4b4f3ba129752ea2cb293b P e5256d91808b47c195bc9b4dbd7f2b87 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 9.
W20260709 13:06:36.402040 19452 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:36.407356 19410 raft_consensus.cc:1240] T f93ee515a9c14139bf566522ed8232f3 P e5256d91808b47c195bc9b4dbd7f2b87 [term 16 FOLLOWER]: Rejecting Update request from peer 0473d2b2d01f4459b1e90fd12cc7840e for earlier term 15. Current term is 16. Ops: []
I20260709 13:06:36.407428 19405 raft_consensus.cc:1240] T 7be9efa6559648dbb5a0f7684c4542d1 P e5256d91808b47c195bc9b4dbd7f2b87 [term 14 FOLLOWER]: Rejecting Update request from peer 0473d2b2d01f4459b1e90fd12cc7840e for earlier term 13. Current term is 14. Ops: []
I20260709 13:06:36.409509 19410 raft_consensus.cc:1240] T bc225c93219c45538b53a1bd3d387e4d P e5256d91808b47c195bc9b4dbd7f2b87 [term 14 FOLLOWER]: Rejecting Update request from peer 0473d2b2d01f4459b1e90fd12cc7840e for earlier term 13. Current term is 14. Ops: [13.8-13.8]
I20260709 13:06:36.338548 24806 raft_consensus.cc:2749] T 6c5eebf646ad445a9d1b1adc319d7b16 P 127766fc592545a4997f7790f50f6076 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:06:36.417951 20104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab43d85f64114d4ebf618930e43d9ed0" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:06:36.419175 20104 raft_consensus.cc:2393] T ab43d85f64114d4ebf618930e43d9ed0 P 127766fc592545a4997f7790f50f6076 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e61c3a8f61bb48f8a963c9480e53c168 in current term 16: Already voted for candidate 127766fc592545a4997f7790f50f6076 in this term.
W20260709 13:06:36.379011 24850 log.cc:927] Time spent T e381f1d6b8184797ad142de49be225a8 P e61c3a8f61bb48f8a963c9480e53c168: Append to log took a long time: real 0.094s	user 0.000s	sys 0.000s
I20260709 13:06:36.410866 19410 raft_consensus.cc:1240] T 3e1f505cb0f1427bbd698ac889d80821 P e5256d91808b47c195bc9b4dbd7f2b87 [term 16 LEADER]: Rejecting Update request from peer 0473d2b2d01f4459b1e90fd12cc7840e for earlier term 15. Current term is 16. Ops: []
I20260709 13:06:36.398847 24790 raft_consensus.cc:3060] T 96efeaaf1057492490e9a621f37e1a2d P e61c3a8f61bb48f8a963c9480e53c168 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:06:36.333732 24837 raft_consensus.cc:3060] T 1efebf73c86e432baa55533136b6e12c P e61c3a8f61bb48f8a963c9480e53c168 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:06:36.414436 19452 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:36.416196 19480 raft_consensus.cc:2468] T 21e14947d70440f19044d8f75c31e1f9 P 0473d2b2d01f4459b1e90fd12cc7840e [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 15.
I20260709 13:06:36.418908 19450 leader_election.cc:304] T 1efebf73c86e432baa55533136b6e12c P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e; no voters: 127766fc592545a4997f7790f50f6076, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:06:36.371508 24838 leader_election.cc:290] T ab43d85f64114d4ebf618930e43d9ed0 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:06:36.402128 19377 leader_election.cc:304] T 309c3ca0ca4b4f3ba129752ea2cb293b P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, 127766fc592545a4997f7790f50f6076
I20260709 13:06:36.365530 24700 raft_consensus.cc:493] T 70797e5783b5454ab0d0eea663e791e3 P e61c3a8f61bb48f8a963c9480e53c168 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 127766fc592545a4997f7790f50f6076)
I20260709 13:06:36.400544 24478 raft_consensus.cc:2804] T e381f1d6b8184797ad142de49be225a8 P 0473d2b2d01f4459b1e90fd12cc7840e [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:06:36.424711 19410 raft_consensus.cc:1240] T 86a6797bdfe94fa496c050ceae4bd0d9 P e5256d91808b47c195bc9b4dbd7f2b87 [term 11 FOLLOWER]: Rejecting Update request from peer 0473d2b2d01f4459b1e90fd12cc7840e for earlier term 10. Current term is 11. Ops: []
I20260709 13:06:36.404729 24457 raft_consensus.cc:2749] T a08760e15aac4630a629431f56024dc8 P e5256d91808b47c195bc9b4dbd7f2b87 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:06:36.412184 24812 raft_consensus.cc:2804] T edd7d470b5014c9489be7f41f64355c9 P e61c3a8f61bb48f8a963c9480e53c168 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:06:36.380420 24753 consensus_queue.cc:1059] T 76cb037fc9064d13b59a8969d897ce8c P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 }, Status: INVALID_TERM, Last received: 12.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.037s
I20260709 13:06:36.405640 24781 raft_consensus.cc:3060] T 2a16f7501e2444fb86d4e2778e734e02 P e61c3a8f61bb48f8a963c9480e53c168 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:06:36.436206 19410 raft_consensus.cc:1240] T fa8650e71aa14778b3d73721fc50d9fc P e5256d91808b47c195bc9b4dbd7f2b87 [term 14 FOLLOWER]: Rejecting Update request from peer 0473d2b2d01f4459b1e90fd12cc7840e for earlier term 13. Current term is 14. Ops: []
I20260709 13:06:36.402393 19477 raft_consensus.cc:3060] T 7f575b143b844aa096b50997dad3516a P 0473d2b2d01f4459b1e90fd12cc7840e [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:06:36.437680 19377 leader_election.cc:304] T 46c5bfeecc314717bffe987e6844b6d0 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87; no voters: e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:06:36.438163 24825 raft_consensus.cc:2749] T 309c3ca0ca4b4f3ba129752ea2cb293b P e5256d91808b47c195bc9b4dbd7f2b87 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:06:36.444846 19377 leader_election.cc:304] T edd7d470b5014c9489be7f41f64355c9 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:06:36.435779 24756 raft_consensus.cc:3060] T 65d8cb8d6ec64f459d5a47cefab10acf P e5256d91808b47c195bc9b4dbd7f2b87 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:06:36.411820 24789 raft_consensus.cc:2749] T 1a61655d99124a29b486ba4a5b37faea P e61c3a8f61bb48f8a963c9480e53c168 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:06:36.411448 24783 raft_consensus.cc:3060] T 3e1f505cb0f1427bbd698ac889d80821 P 0473d2b2d01f4459b1e90fd12cc7840e [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:06:36.428856 24796 raft_consensus.cc:3060] T 6c5eebf646ad445a9d1b1adc319d7b16 P 0473d2b2d01f4459b1e90fd12cc7840e [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:06:36.400727 24471 raft_consensus.cc:515] T 4509b76741dc428e9201c70c1658da13 P 0473d2b2d01f4459b1e90fd12cc7840e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:36.435793 24700 raft_consensus.cc:515] T 70797e5783b5454ab0d0eea663e791e3 P e61c3a8f61bb48f8a963c9480e53c168 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:36.458824 19552 raft_consensus.cc:1240] T b9f0d59553ad444883fcf5b5909f9798 P e61c3a8f61bb48f8a963c9480e53c168 [term 14 LEADER]: Rejecting Update request from peer 0473d2b2d01f4459b1e90fd12cc7840e for earlier term 13. Current term is 14. Ops: []
I20260709 13:06:36.459196 24700 leader_election.cc:290] T 70797e5783b5454ab0d0eea663e791e3 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
W20260709 13:06:36.447189 19451 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:36.419482 24839 raft_consensus.cc:2804] T ef32ce6fdd0e40d382c79974f30295c6 P 0473d2b2d01f4459b1e90fd12cc7840e [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:06:36.448792 19377 leader_election.cc:304] T 1f85fc4b527a48848e5faa083b604e36 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, 127766fc592545a4997f7790f50f6076
I20260709 13:06:36.438629 24478 raft_consensus.cc:493] T e381f1d6b8184797ad142de49be225a8 P 0473d2b2d01f4459b1e90fd12cc7840e [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:36.452399 19477 raft_consensus.cc:2468] T 7f575b143b844aa096b50997dad3516a P 0473d2b2d01f4459b1e90fd12cc7840e [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 11.
I20260709 13:06:36.461081 24478 raft_consensus.cc:3060] T e381f1d6b8184797ad142de49be225a8 P 0473d2b2d01f4459b1e90fd12cc7840e [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:06:36.461853 19477 raft_consensus.cc:1275] T 179fd671030940b4b4a4e24bcc4aba0a P 0473d2b2d01f4459b1e90fd12cc7840e [term 17 FOLLOWER]: Refusing update from remote peer e61c3a8f61bb48f8a963c9480e53c168: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
W20260709 13:06:36.452571 20075 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.1:40321, user_credentials={real_user=slave}} blocked reactor thread for 172275us
I20260709 13:06:36.453048 19555 raft_consensus.cc:1240] T 85c494af21f9457a85da47b9bc70c1fd P e61c3a8f61bb48f8a963c9480e53c168 [term 15 FOLLOWER]: Rejecting Update request from peer 127766fc592545a4997f7790f50f6076 for earlier term 14. Current term is 15. Ops: [14.12-14.12]
I20260709 13:06:36.463562 19375 leader_election.cc:304] T 85c494af21f9457a85da47b9bc70c1fd P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168; no voters: 127766fc592545a4997f7790f50f6076
I20260709 13:06:36.464114 19374 leader_election.cc:304] T 172b3dd13109415a955b71ac0e9d2234 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 127766fc592545a4997f7790f50f6076, e5256d91808b47c195bc9b4dbd7f2b87; no voters: 
I20260709 13:06:36.440882 24573 raft_consensus.cc:2749] T 1efebf73c86e432baa55533136b6e12c P 0473d2b2d01f4459b1e90fd12cc7840e [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:06:36.342253 24761 consensus_queue.cc:260] T ed7fdbcb96d14d418db9ca90a792588a P 0473d2b2d01f4459b1e90fd12cc7840e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:36.465978 19410 raft_consensus.cc:1275] T 217b5fae677b4971b3bbd2f357a1f7ff P e5256d91808b47c195bc9b4dbd7f2b87 [term 12 FOLLOWER]: Refusing update from remote peer 0473d2b2d01f4459b1e90fd12cc7840e: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:06:36.459370 19479 raft_consensus.cc:1275] T 2b74109013a140ada21feeef92d6f563 P 0473d2b2d01f4459b1e90fd12cc7840e [term 12 FOLLOWER]: Refusing update from remote peer e61c3a8f61bb48f8a963c9480e53c168: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:06:36.466775 19377 leader_election.cc:304] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, 127766fc592545a4997f7790f50f6076
I20260709 13:06:36.468755 20104 raft_consensus.cc:1275] T 2a16f7501e2444fb86d4e2778e734e02 P 127766fc592545a4997f7790f50f6076 [term 14 FOLLOWER]: Refusing update from remote peer e5256d91808b47c195bc9b4dbd7f2b87: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 13:06:36.443259 24812 raft_consensus.cc:697] T edd7d470b5014c9489be7f41f64355c9 P e61c3a8f61bb48f8a963c9480e53c168 [term 16 LEADER]: Becoming Leader. State: Replica: e61c3a8f61bb48f8a963c9480e53c168, State: Running, Role: LEADER
I20260709 13:06:36.470898 19375 leader_election.cc:304] T 7be9efa6559648dbb5a0f7684c4542d1 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87; no voters: 127766fc592545a4997f7790f50f6076, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:06:36.451298 24457 raft_consensus.cc:2804] T 46c5bfeecc314717bffe987e6844b6d0 P e5256d91808b47c195bc9b4dbd7f2b87 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:06:36.471451 19377 leader_election.cc:304] T 775c229504194560ba9589bc2199b089 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, 127766fc592545a4997f7790f50f6076
I20260709 13:06:36.455034 24372 raft_consensus.cc:2749] T edd7d470b5014c9489be7f41f64355c9 P e5256d91808b47c195bc9b4dbd7f2b87 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:06:36.475999 19554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed7fdbcb96d14d418db9ca90a792588a" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:06:36.477159 19555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a16f7501e2444fb86d4e2778e734e02" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:06:36.475062 24825 consensus_queue.cc:1059] T 7f575b143b844aa096b50997dad3516a P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 }, Status: INVALID_TERM, Last received: 10.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.005s
I20260709 13:06:36.480778 24551 raft_consensus.cc:2749] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P e5256d91808b47c195bc9b4dbd7f2b87 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:06:36.483980 24671 raft_consensus.cc:3060] T ab43d85f64114d4ebf618930e43d9ed0 P 0473d2b2d01f4459b1e90fd12cc7840e [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:06:36.485615 19409 raft_consensus.cc:1240] T a08760e15aac4630a629431f56024dc8 P e5256d91808b47c195bc9b4dbd7f2b87 [term 18 FOLLOWER]: Rejecting Update request from peer 0473d2b2d01f4459b1e90fd12cc7840e for earlier term 17. Current term is 18. Ops: []
I20260709 13:06:36.491968 24471 leader_election.cc:290] T 4509b76741dc428e9201c70c1658da13 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:06:36.493402 24626 consensus_queue.cc:1059] T 70797e5783b5454ab0d0eea663e791e3 P 127766fc592545a4997f7790f50f6076 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 }, Status: INVALID_TERM, Last received: 14.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:06:36.494519 24626 raft_consensus.cc:3055] T 70797e5783b5454ab0d0eea663e791e3 P 127766fc592545a4997f7790f50f6076 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:06:36.495019 24626 raft_consensus.cc:740] T 70797e5783b5454ab0d0eea663e791e3 P 127766fc592545a4997f7790f50f6076 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 127766fc592545a4997f7790f50f6076, State: Running, Role: LEADER
I20260709 13:06:36.473482 24823 raft_consensus.cc:2804] T 172b3dd13109415a955b71ac0e9d2234 P e5256d91808b47c195bc9b4dbd7f2b87 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:06:36.499038 24823 raft_consensus.cc:493] T 172b3dd13109415a955b71ac0e9d2234 P e5256d91808b47c195bc9b4dbd7f2b87 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:36.499377 24823 raft_consensus.cc:3060] T 172b3dd13109415a955b71ac0e9d2234 P e5256d91808b47c195bc9b4dbd7f2b87 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:06:36.451516 24753 consensus_queue.cc:1059] T f93ee515a9c14139bf566522ed8232f3 P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 }, Status: INVALID_TERM, Last received: 15.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.024s
I20260709 13:06:36.503026 24753 consensus_queue.cc:1243] T f93ee515a9c14139bf566522ed8232f3 P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Peer e61c3a8f61bb48f8a963c9480e53c168 log is divergent from this leader: its last log entry 16.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
I20260709 13:06:36.504105 24761 raft_consensus.cc:3060] T ed7fdbcb96d14d418db9ca90a792588a P 0473d2b2d01f4459b1e90fd12cc7840e [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:06:36.506973 24457 raft_consensus.cc:697] T 46c5bfeecc314717bffe987e6844b6d0 P e5256d91808b47c195bc9b4dbd7f2b87 [term 20 LEADER]: Becoming Leader. State: Replica: e5256d91808b47c195bc9b4dbd7f2b87, State: Running, Role: LEADER
I20260709 13:06:36.507812 24457 consensus_queue.cc:237] T 46c5bfeecc314717bffe987e6844b6d0 P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 19.9, Last appended by leader: 9, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:36.511270 19405 raft_consensus.cc:1240] T f1b10566f45d4a7d9029858330e02d5b P e5256d91808b47c195bc9b4dbd7f2b87 [term 15 FOLLOWER]: Rejecting Update request from peer 0473d2b2d01f4459b1e90fd12cc7840e for earlier term 14. Current term is 15. Ops: []
I20260709 13:06:36.445658 24763 consensus_queue.cc:1059] T 76cb037fc9064d13b59a8969d897ce8c P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 }, Status: INVALID_TERM, Last received: 12.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.027s
W20260709 13:06:36.523782 19450 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.3:36891, user_credentials={real_user=slave}} blocked reactor thread for 91295.3us
I20260709 13:06:36.469950 24643 raft_consensus.cc:2749] T 1f85fc4b527a48848e5faa083b604e36 P e5256d91808b47c195bc9b4dbd7f2b87 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:06:36.525825 19556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48824d5acfbc485ebf8c2d944e7202de" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:06:36.526888 19556 raft_consensus.cc:2393] T 48824d5acfbc485ebf8c2d944e7202de P e61c3a8f61bb48f8a963c9480e53c168 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 127766fc592545a4997f7790f50f6076 in current term 17: Already voted for candidate e61c3a8f61bb48f8a963c9480e53c168 in this term.
I20260709 13:06:36.529595 20104 raft_consensus.cc:1240] T ff9b0eddd810459b82d91c60777c10eb P 127766fc592545a4997f7790f50f6076 [term 16 FOLLOWER]: Rejecting Update request from peer e5256d91808b47c195bc9b4dbd7f2b87 for earlier term 15. Current term is 16. Ops: []
I20260709 13:06:36.473847 24826 raft_consensus.cc:2804] T 85c494af21f9457a85da47b9bc70c1fd P e5256d91808b47c195bc9b4dbd7f2b87 [term 15 FOLLOWER]: Leader election won for term 15
W20260709 13:06:36.534476 19449 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.1:40321, user_credentials={real_user=slave}} blocked reactor thread for 188497us
I20260709 13:06:36.536429 19449 leader_election.cc:304] T ff75a1d4cb1f493db8f71ddc136ba9ab P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e; no voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:06:36.539252 19556 raft_consensus.cc:1275] T 0e1085d23e8347fbbd5bce7542f4b1f4 P e61c3a8f61bb48f8a963c9480e53c168 [term 12 FOLLOWER]: Refusing update from remote peer 127766fc592545a4997f7790f50f6076: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 13:06:36.531584 24682 raft_consensus.cc:2749] T 775c229504194560ba9589bc2199b089 P e5256d91808b47c195bc9b4dbd7f2b87 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:06:36.496107 24626 consensus_queue.cc:260] T 70797e5783b5454ab0d0eea663e791e3 P 127766fc592545a4997f7790f50f6076 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:36.545104 19449 leader_election.cc:304] T 28af091831594f9d8e96482078cc7625 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87; no voters: e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:06:36.531188 24700 raft_consensus.cc:493] T 46c5bfeecc314717bffe987e6844b6d0 P e61c3a8f61bb48f8a963c9480e53c168 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:36.522825 24813 raft_consensus.cc:2749] T 7be9efa6559648dbb5a0f7684c4542d1 P e5256d91808b47c195bc9b4dbd7f2b87 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:06:36.522980 24276 raft_consensus.cc:493] T 2b74109013a140ada21feeef92d6f563 P 0473d2b2d01f4459b1e90fd12cc7840e [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:36.550125 20104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70797e5783b5454ab0d0eea663e791e3" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:06:36.472239 24555 consensus_queue.cc:1048] T 2a16f7501e2444fb86d4e2778e734e02 P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.061s
W20260709 13:06:36.551980 19377 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.2:46257, user_credentials={real_user=slave}} blocked reactor thread for 80592.1us
I20260709 13:06:36.506214 24478 raft_consensus.cc:515] T e381f1d6b8184797ad142de49be225a8 P 0473d2b2d01f4459b1e90fd12cc7840e [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:36.558406 24863 raft_consensus.cc:2804] T 28af091831594f9d8e96482078cc7625 P 0473d2b2d01f4459b1e90fd12cc7840e [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:06:36.450418 24827 consensus_queue.cc:260] T b9f0d59553ad444883fcf5b5909f9798 P 0473d2b2d01f4459b1e90fd12cc7840e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:36.555878 24867 consensus_queue.cc:1059] T ff9b0eddd810459b82d91c60777c10eb P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false }, Status: INVALID_TERM, Last received: 15.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:06:36.562597 19449 leader_election.cc:304] T 1dc5b3532fe54f74876d02beffa2c230 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e; no voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168
W20260709 13:06:36.564069 19377 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:36.561537 19375 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.3:36891, user_credentials={real_user=slave}} blocked reactor thread for 54595us
I20260709 13:06:36.571956 19449 leader_election.cc:304] T 22196caba61445d3bec98a0aab3c337d P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e; no voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:06:36.546979 24786 raft_consensus.cc:2749] T ff75a1d4cb1f493db8f71ddc136ba9ab P 0473d2b2d01f4459b1e90fd12cc7840e [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:06:36.546409 24826 raft_consensus.cc:697] T 85c494af21f9457a85da47b9bc70c1fd P e5256d91808b47c195bc9b4dbd7f2b87 [term 15 LEADER]: Becoming Leader. State: Replica: e5256d91808b47c195bc9b4dbd7f2b87, State: Running, Role: LEADER
I20260709 13:06:36.538062 24798 consensus_queue.cc:1059] T ef32ce6fdd0e40d382c79974f30295c6 P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 }, Status: INVALID_TERM, Last received: 15.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.031s
I20260709 13:06:36.571125 24626 raft_consensus.cc:3060] T 70797e5783b5454ab0d0eea663e791e3 P 127766fc592545a4997f7790f50f6076 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:06:36.579314 19477 raft_consensus.cc:3055] T f93ee515a9c14139bf566522ed8232f3 P 0473d2b2d01f4459b1e90fd12cc7840e [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:06:36.582893 24827 raft_consensus.cc:3060] T b9f0d59553ad444883fcf5b5909f9798 P 0473d2b2d01f4459b1e90fd12cc7840e [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:06:36.573585 24597 consensus_queue.cc:1048] T 2a16f7501e2444fb86d4e2778e734e02 P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Connected to new peer: Peer: permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.013s
I20260709 13:06:36.584894 24825 raft_consensus.cc:493] T f93ee515a9c14139bf566522ed8232f3 P e5256d91808b47c195bc9b4dbd7f2b87 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:36.588896 24795 raft_consensus.cc:3055] T 1dc5b3532fe54f74876d02beffa2c230 P e61c3a8f61bb48f8a963c9480e53c168 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:06:36.588927 19478 raft_consensus.cc:2468] T 3e1f505cb0f1427bbd698ac889d80821 P 0473d2b2d01f4459b1e90fd12cc7840e [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 16.
I20260709 13:06:36.597748 19477 raft_consensus.cc:740] T f93ee515a9c14139bf566522ed8232f3 P 0473d2b2d01f4459b1e90fd12cc7840e [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 0473d2b2d01f4459b1e90fd12cc7840e, State: Running, Role: LEADER
I20260709 13:06:36.540719 24861 consensus_queue.cc:1059] T b08304a0a02b42d7840c4e8ee9a6bd1a P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 }, Status: INVALID_TERM, Last received: 12.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.034s
I20260709 13:06:36.607105 24795 raft_consensus.cc:740] T 1dc5b3532fe54f74876d02beffa2c230 P e61c3a8f61bb48f8a963c9480e53c168 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: e61c3a8f61bb48f8a963c9480e53c168, State: Running, Role: LEADER
I20260709 13:06:36.621927 24861 raft_consensus.cc:3055] T b08304a0a02b42d7840c4e8ee9a6bd1a P 0473d2b2d01f4459b1e90fd12cc7840e [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:06:36.622315 24861 raft_consensus.cc:740] T b08304a0a02b42d7840c4e8ee9a6bd1a P 0473d2b2d01f4459b1e90fd12cc7840e [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 0473d2b2d01f4459b1e90fd12cc7840e, State: Running, Role: LEADER
I20260709 13:06:36.622177 24795 consensus_queue.cc:260] T 1dc5b3532fe54f74876d02beffa2c230 P e61c3a8f61bb48f8a963c9480e53c168 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.8, Last appended by leader: 8, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:36.623512 24795 raft_consensus.cc:3060] T 1dc5b3532fe54f74876d02beffa2c230 P e61c3a8f61bb48f8a963c9480e53c168 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:06:36.623191 24861 consensus_queue.cc:260] T b08304a0a02b42d7840c4e8ee9a6bd1a P 0473d2b2d01f4459b1e90fd12cc7840e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.9, Last appended by leader: 9, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:36.624477 24861 raft_consensus.cc:3060] T b08304a0a02b42d7840c4e8ee9a6bd1a P 0473d2b2d01f4459b1e90fd12cc7840e [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:06:36.624917 24372 raft_consensus.cc:3055] T 7f575b143b844aa096b50997dad3516a P e5256d91808b47c195bc9b4dbd7f2b87 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:06:36.625314 24372 raft_consensus.cc:740] T 7f575b143b844aa096b50997dad3516a P e5256d91808b47c195bc9b4dbd7f2b87 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: e5256d91808b47c195bc9b4dbd7f2b87, State: Running, Role: LEADER
W20260709 13:06:36.626161 24824 consensus_meta.cc:287] T b08304a0a02b42d7840c4e8ee9a6bd1a P e5256d91808b47c195bc9b4dbd7f2b87: Time spent flushing consensus metadata: real 0.503s	user 0.005s	sys 0.004s
I20260709 13:06:36.612092 24786 raft_consensus.cc:493] T f1b10566f45d4a7d9029858330e02d5b P 0473d2b2d01f4459b1e90fd12cc7840e [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:36.626719 24824 raft_consensus.cc:515] T b08304a0a02b42d7840c4e8ee9a6bd1a P e5256d91808b47c195bc9b4dbd7f2b87 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:36.627147 24786 raft_consensus.cc:515] T f1b10566f45d4a7d9029858330e02d5b P 0473d2b2d01f4459b1e90fd12cc7840e [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:36.628903 24824 leader_election.cc:290] T b08304a0a02b42d7840c4e8ee9a6bd1a P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 15 election: Requested vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:06:36.629197 24786 leader_election.cc:290] T f1b10566f45d4a7d9029858330e02d5b P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:06:36.629630 19408 raft_consensus.cc:2393] T b08304a0a02b42d7840c4e8ee9a6bd1a P e5256d91808b47c195bc9b4dbd7f2b87 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate e61c3a8f61bb48f8a963c9480e53c168 in current term 15: Already voted for candidate e5256d91808b47c195bc9b4dbd7f2b87 in this term.
I20260709 13:06:36.614801 24859 consensus_queue.cc:1048] T 0e1085d23e8347fbbd5bce7542f4b1f4 P 127766fc592545a4997f7790f50f6076 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.010s
I20260709 13:06:36.605748 19477 consensus_queue.cc:260] T f93ee515a9c14139bf566522ed8232f3 P 0473d2b2d01f4459b1e90fd12cc7840e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 15.7, Last appended by leader: 7, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:36.631266 19477 raft_consensus.cc:3060] T f93ee515a9c14139bf566522ed8232f3 P 0473d2b2d01f4459b1e90fd12cc7840e [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:06:36.616418 24478 leader_election.cc:290] T e381f1d6b8184797ad142de49be225a8 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 13 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:06:36.616868 24798 raft_consensus.cc:3055] T ef32ce6fdd0e40d382c79974f30295c6 P e5256d91808b47c195bc9b4dbd7f2b87 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:06:36.632054 24798 raft_consensus.cc:740] T ef32ce6fdd0e40d382c79974f30295c6 P e5256d91808b47c195bc9b4dbd7f2b87 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: e5256d91808b47c195bc9b4dbd7f2b87, State: Running, Role: LEADER
I20260709 13:06:36.632138 24825 raft_consensus.cc:515] T f93ee515a9c14139bf566522ed8232f3 P e5256d91808b47c195bc9b4dbd7f2b87 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:36.632907 24798 consensus_queue.cc:260] T ef32ce6fdd0e40d382c79974f30295c6 P e5256d91808b47c195bc9b4dbd7f2b87 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 17.10, Last appended by leader: 10, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:36.634047 24798 raft_consensus.cc:3060] T ef32ce6fdd0e40d382c79974f30295c6 P e5256d91808b47c195bc9b4dbd7f2b87 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:06:36.617277 24789 raft_consensus.cc:493] T ece3db938bc649d4a40a51522ed5259c P e61c3a8f61bb48f8a963c9480e53c168 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:36.635213 24789 raft_consensus.cc:515] T ece3db938bc649d4a40a51522ed5259c P e61c3a8f61bb48f8a963c9480e53c168 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:36.604583 24780 raft_consensus.cc:2749] T 22196caba61445d3bec98a0aab3c337d P 0473d2b2d01f4459b1e90fd12cc7840e [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:06:36.637156 24789 leader_election.cc:290] T ece3db938bc649d4a40a51522ed5259c P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
W20260709 13:06:36.603011 24856 log.cc:927] Time spent T 4509b76741dc428e9201c70c1658da13 P e5256d91808b47c195bc9b4dbd7f2b87: Append to log took a long time: real 0.092s	user 0.000s	sys 0.001s
I20260709 13:06:36.619892 19402 raft_consensus.cc:1240] T b9f0d59553ad444883fcf5b5909f9798 P e5256d91808b47c195bc9b4dbd7f2b87 [term 14 FOLLOWER]: Rejecting Update request from peer 0473d2b2d01f4459b1e90fd12cc7840e for earlier term 13. Current term is 14. Ops: []
I20260709 13:06:36.639066 20106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ece3db938bc649d4a40a51522ed5259c" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:06:36.639182 24826 consensus_queue.cc:237] T 85c494af21f9457a85da47b9bc70c1fd P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.11, Last appended by leader: 11, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:36.640746 24813 raft_consensus.cc:3055] T ff9b0eddd810459b82d91c60777c10eb P e5256d91808b47c195bc9b4dbd7f2b87 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:06:36.641132 24813 raft_consensus.cc:740] T ff9b0eddd810459b82d91c60777c10eb P e5256d91808b47c195bc9b4dbd7f2b87 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: e5256d91808b47c195bc9b4dbd7f2b87, State: Running, Role: LEADER
I20260709 13:06:36.641901 24813 consensus_queue.cc:260] T ff9b0eddd810459b82d91c60777c10eb P e5256d91808b47c195bc9b4dbd7f2b87 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.11, Last appended by leader: 11, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:36.643610 24821 raft_consensus.cc:493] T 22196caba61445d3bec98a0aab3c337d P e5256d91808b47c195bc9b4dbd7f2b87 [term 13 FOLLOWER]: Starting leader election (detected failure of leader e61c3a8f61bb48f8a963c9480e53c168)
I20260709 13:06:36.644055 19478 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58286 (request call id 2317) took 1055 ms. Trace:
I20260709 13:06:36.644064 24821 raft_consensus.cc:3060] T 22196caba61445d3bec98a0aab3c337d P e5256d91808b47c195bc9b4dbd7f2b87 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:06:36.644476 19478 rpcz_store.cc:276] 0709 13:06:35.588382 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:35.605693 (+ 17311us) service_pool.cc:224] Handling call
0709 13:06:36.643876 (+1038183us) spinlock_profiling.cc:243] Waited 947 ms on lock 0x7b540030cad4. stack: 00007f4a79de9343 00007f4a79de9240 00007f4a797781d4 00007f4a834b6304 00007f4a834b6299 00007f4a7ce71571 00007f4a7cf0c2fa 00007f4a81ecdb17 00007f4a7b4486d4 00007f4a7b448662 00007f4a7b448591 00007f4a7b44850c 00007f4a7b4477c2 00007f4a7b24348c 00007f4a7b2428c6 00007f4a7b24226f
0709 13:06:36.643994 (+   118us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2178297728}
I20260709 13:06:36.559402 24700 raft_consensus.cc:515] T 46c5bfeecc314717bffe987e6844b6d0 P e61c3a8f61bb48f8a963c9480e53c168 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:36.644330 19486 raft_consensus.cc:1275] T 3e1f505cb0f1427bbd698ac889d80821 P 0473d2b2d01f4459b1e90fd12cc7840e [term 16 FOLLOWER]: Refusing update from remote peer e5256d91808b47c195bc9b4dbd7f2b87: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 13:06:36.647238 24573 raft_consensus.cc:3055] T 76cb037fc9064d13b59a8969d897ce8c P 0473d2b2d01f4459b1e90fd12cc7840e [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:06:36.647662 24700 leader_election.cc:290] T 46c5bfeecc314717bffe987e6844b6d0 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:06:36.648957 19485 raft_consensus.cc:2468] T ed7fdbcb96d14d418db9ca90a792588a P 0473d2b2d01f4459b1e90fd12cc7840e [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 11.
I20260709 13:06:36.592556 24812 consensus_queue.cc:237] T edd7d470b5014c9489be7f41f64355c9 P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.8, Last appended by leader: 8, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:36.571545 24838 raft_consensus.cc:493] T 14935b3ddf914369822e4a0547aaa355 P e61c3a8f61bb48f8a963c9480e53c168 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 127766fc592545a4997f7790f50f6076)
I20260709 13:06:36.589089 24783 raft_consensus.cc:2749] T 1dc5b3532fe54f74876d02beffa2c230 P 0473d2b2d01f4459b1e90fd12cc7840e [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:06:36.639683 20106 raft_consensus.cc:2468] T ece3db938bc649d4a40a51522ed5259c P 127766fc592545a4997f7790f50f6076 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 11.
I20260709 13:06:36.571054 19375 leader_election.cc:304] T bc225c93219c45538b53a1bd3d387e4d P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168; no voters: 0473d2b2d01f4459b1e90fd12cc7840e
I20260709 13:06:36.566642 24276 raft_consensus.cc:515] T 2b74109013a140ada21feeef92d6f563 P 0473d2b2d01f4459b1e90fd12cc7840e [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
W20260709 13:06:36.668237 19375 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.3:36891, user_credentials={real_user=slave}} blocked reactor thread for 97252.2us
I20260709 13:06:36.669368 19477 raft_consensus.cc:1275] T f93ee515a9c14139bf566522ed8232f3 P 0473d2b2d01f4459b1e90fd12cc7840e [term 16 FOLLOWER]: Refusing update from remote peer e61c3a8f61bb48f8a963c9480e53c168: Log matching property violated. Preceding OpId in replica: term: 15 index: 7. Preceding OpId from leader: term: 16 index: 8. (index mismatch)
I20260709 13:06:36.674193 19411 raft_consensus.cc:1240] T b08304a0a02b42d7840c4e8ee9a6bd1a P e5256d91808b47c195bc9b4dbd7f2b87 [term 15 FOLLOWER]: Rejecting Update request from peer 0473d2b2d01f4459b1e90fd12cc7840e for earlier term 14. Current term is 15. Ops: [14.9-14.9]
I20260709 13:06:36.667133 19523 leader_election.cc:304] T ece3db938bc649d4a40a51522ed5259c P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 127766fc592545a4997f7790f50f6076, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:06:36.690706 19375 leader_election.cc:304] T 70797e5783b5454ab0d0eea663e791e3 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87; no voters: 127766fc592545a4997f7790f50f6076, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:06:36.626106 24372 consensus_queue.cc:260] T 7f575b143b844aa096b50997dad3516a P e5256d91808b47c195bc9b4dbd7f2b87 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:36.634261 24781 raft_consensus.cc:515] T 2a16f7501e2444fb86d4e2778e734e02 P e61c3a8f61bb48f8a963c9480e53c168 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:36.634297 24825 leader_election.cc:290] T f93ee515a9c14139bf566522ed8232f3 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:06:36.647672 24573 raft_consensus.cc:740] T 76cb037fc9064d13b59a8969d897ce8c P 0473d2b2d01f4459b1e90fd12cc7840e [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 0473d2b2d01f4459b1e90fd12cc7840e, State: Running, Role: LEADER
I20260709 13:06:36.690826 24789 raft_consensus.cc:2804] T ece3db938bc649d4a40a51522ed5259c P e61c3a8f61bb48f8a963c9480e53c168 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:06:36.691524 24813 raft_consensus.cc:3060] T ff9b0eddd810459b82d91c60777c10eb P e5256d91808b47c195bc9b4dbd7f2b87 [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:06:36.692178 24782 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 16 current term: 16 is higher.
I20260709 13:06:36.687645 24551 raft_consensus.cc:2804] T bc225c93219c45538b53a1bd3d387e4d P e5256d91808b47c195bc9b4dbd7f2b87 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:06:36.700826 24457 raft_consensus.cc:2749] T 70797e5783b5454ab0d0eea663e791e3 P e5256d91808b47c195bc9b4dbd7f2b87 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:06:36.709669 19555 raft_consensus.cc:2393] T 2a16f7501e2444fb86d4e2778e734e02 P e61c3a8f61bb48f8a963c9480e53c168 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 127766fc592545a4997f7790f50f6076 in current term 15: Already voted for candidate e61c3a8f61bb48f8a963c9480e53c168 in this term.
I20260709 13:06:36.689627 24790 raft_consensus.cc:515] T 96efeaaf1057492490e9a621f37e1a2d P e61c3a8f61bb48f8a963c9480e53c168 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:36.695362 24824 consensus_queue.cc:1048] T 3e1f505cb0f1427bbd698ac889d80821 P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.017s
I20260709 13:06:36.730880 24573 consensus_queue.cc:260] T 76cb037fc9064d13b59a8969d897ce8c P 0473d2b2d01f4459b1e90fd12cc7840e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:36.718358 24859 raft_consensus.cc:493] T 14efcc79969f41babe5529c22d59156d P 127766fc592545a4997f7790f50f6076 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader e5256d91808b47c195bc9b4dbd7f2b87)
I20260709 13:06:36.704319 24789 raft_consensus.cc:493] T ece3db938bc649d4a40a51522ed5259c P e61c3a8f61bb48f8a963c9480e53c168 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:36.688202 24838 raft_consensus.cc:515] T 14935b3ddf914369822e4a0547aaa355 P e61c3a8f61bb48f8a963c9480e53c168 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } attrs { replace: true } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:36.695240 24863 raft_consensus.cc:697] T 28af091831594f9d8e96482078cc7625 P 0473d2b2d01f4459b1e90fd12cc7840e [term 16 LEADER]: Becoming Leader. State: Replica: 0473d2b2d01f4459b1e90fd12cc7840e, State: Running, Role: LEADER
W20260709 13:06:36.696031 19449 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.1:40321, user_credentials={real_user=slave}} blocked reactor thread for 124151us
I20260709 13:06:36.703627 24867 consensus_queue.cc:1059] T 1a61655d99124a29b486ba4a5b37faea P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.030s
W20260709 13:06:36.749993 19451 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:36.754714 19376 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:36.751667 24859 raft_consensus.cc:515] T 14efcc79969f41babe5529c22d59156d P 127766fc592545a4997f7790f50f6076 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:36.748908 24789 raft_consensus.cc:3060] T ece3db938bc649d4a40a51522ed5259c P e61c3a8f61bb48f8a963c9480e53c168 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:06:36.787482 19450 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.3:36891, user_credentials={real_user=slave}} blocked reactor thread for 234018us
W20260709 13:06:36.800715 19449 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.1:40321, user_credentials={real_user=slave}} blocked reactor thread for 44028us
W20260709 13:06:36.805966 20075 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.1:40321, user_credentials={real_user=slave}} blocked reactor thread for 49662.6us
W20260709 13:06:36.752261 24869 log.cc:927] Time spent T 22196caba61445d3bec98a0aab3c337d P 0473d2b2d01f4459b1e90fd12cc7840e: Append to log took a long time: real 0.068s	user 0.001s	sys 0.000s
I20260709 13:06:36.749761 24372 raft_consensus.cc:3060] T 7f575b143b844aa096b50997dad3516a P e5256d91808b47c195bc9b4dbd7f2b87 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:06:36.809738 19450 leader_election.cc:304] T 309c3ca0ca4b4f3ba129752ea2cb293b P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168; no voters: 127766fc592545a4997f7790f50f6076
I20260709 13:06:36.812451 24783 consensus_queue.cc:1059] T 86a6797bdfe94fa496c050ceae4bd0d9 P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 }, Status: INVALID_TERM, Last received: 10.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.005s
I20260709 13:06:36.815654 24783 raft_consensus.cc:3055] T 86a6797bdfe94fa496c050ceae4bd0d9 P 0473d2b2d01f4459b1e90fd12cc7840e [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:06:36.816008 24783 raft_consensus.cc:740] T 86a6797bdfe94fa496c050ceae4bd0d9 P 0473d2b2d01f4459b1e90fd12cc7840e [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 0473d2b2d01f4459b1e90fd12cc7840e, State: Running, Role: LEADER
I20260709 13:06:36.816850 24783 consensus_queue.cc:260] T 86a6797bdfe94fa496c050ceae4bd0d9 P 0473d2b2d01f4459b1e90fd12cc7840e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.5, Last appended by leader: 5, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:36.817975 24783 raft_consensus.cc:3060] T 86a6797bdfe94fa496c050ceae4bd0d9 P 0473d2b2d01f4459b1e90fd12cc7840e [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:06:36.818020 20104 raft_consensus.cc:2468] T 70797e5783b5454ab0d0eea663e791e3 P 127766fc592545a4997f7790f50f6076 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 15.
I20260709 13:06:36.813395 24482 raft_consensus.cc:493] T ab43d85f64114d4ebf618930e43d9ed0 P 127766fc592545a4997f7790f50f6076 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:36.819473 24482 raft_consensus.cc:515] T ab43d85f64114d4ebf618930e43d9ed0 P 127766fc592545a4997f7790f50f6076 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:36.820087 24859 leader_election.cc:290] T 14efcc79969f41babe5529c22d59156d P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:06:36.813480 24837 raft_consensus.cc:2749] T 1efebf73c86e432baa55533136b6e12c P e61c3a8f61bb48f8a963c9480e53c168 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:06:36.821547 24482 leader_election.cc:290] T ab43d85f64114d4ebf618930e43d9ed0 P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:06:36.814847 24763 raft_consensus.cc:2804] T 309c3ca0ca4b4f3ba129752ea2cb293b P 0473d2b2d01f4459b1e90fd12cc7840e [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:06:36.822716 24763 raft_consensus.cc:493] T 309c3ca0ca4b4f3ba129752ea2cb293b P 0473d2b2d01f4459b1e90fd12cc7840e [term 9 FOLLOWER]: Starting leader election (detected failure of leader 127766fc592545a4997f7790f50f6076)
I20260709 13:06:36.823113 19558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab43d85f64114d4ebf618930e43d9ed0" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:06:36.823468 19557 raft_consensus.cc:1240] T 1efebf73c86e432baa55533136b6e12c P e61c3a8f61bb48f8a963c9480e53c168 [term 13 FOLLOWER]: Rejecting Update request from peer 127766fc592545a4997f7790f50f6076 for earlier term 12. Current term is 13. Ops: []
I20260709 13:06:36.823736 19558 raft_consensus.cc:2468] T ab43d85f64114d4ebf618930e43d9ed0 P e61c3a8f61bb48f8a963c9480e53c168 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 127766fc592545a4997f7790f50f6076 in term 15.
I20260709 13:06:36.809700 24643 consensus_queue.cc:1059] T 21e14947d70440f19044d8f75c31e1f9 P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 }, Status: INVALID_TERM, Last received: 14.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.015s
I20260709 13:06:36.824852 20076 leader_election.cc:304] T ab43d85f64114d4ebf618930e43d9ed0 P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 127766fc592545a4997f7790f50f6076, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:06:36.755690 24839 raft_consensus.cc:697] T ef32ce6fdd0e40d382c79974f30295c6 P 0473d2b2d01f4459b1e90fd12cc7840e [term 18 LEADER]: Becoming Leader. State: Replica: 0473d2b2d01f4459b1e90fd12cc7840e, State: Running, Role: LEADER
I20260709 13:06:36.804802 24700 raft_consensus.cc:493] T 65d8cb8d6ec64f459d5a47cefab10acf P e61c3a8f61bb48f8a963c9480e53c168 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:36.842021 19483 raft_consensus.cc:1813] T ab43d85f64114d4ebf618930e43d9ed0 P 0473d2b2d01f4459b1e90fd12cc7840e [term 16 FOLLOWER]: Handling vote request from an unknown peer e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:06:36.843446 19483 raft_consensus.cc:2410] T ab43d85f64114d4ebf618930e43d9ed0 P 0473d2b2d01f4459b1e90fd12cc7840e [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e5256d91808b47c195bc9b4dbd7f2b87 for term 16 because replica has last-logged OpId of term: 15 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 8.
I20260709 13:06:36.832544 24629 raft_consensus.cc:2804] T ab43d85f64114d4ebf618930e43d9ed0 P 127766fc592545a4997f7790f50f6076 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:06:36.846071 19411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14efcc79969f41babe5529c22d59156d" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:06:36.846469 19486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff9b0eddd810459b82d91c60777c10eb" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:06:36.853346 19486 raft_consensus.cc:2376] T ff9b0eddd810459b82d91c60777c10eb P 0473d2b2d01f4459b1e90fd12cc7840e [term 16 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 127766fc592545a4997f7790f50f6076 in term 16. Re-sending same reply.
I20260709 13:06:36.854861 19486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0afb57ae58a24a01850491d69f0213dd" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:06:36.856076 19486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48824d5acfbc485ebf8c2d944e7202de" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:06:36.857417 19486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96efeaaf1057492490e9a621f37e1a2d" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:06:36.858098 19486 raft_consensus.cc:2468] T 96efeaaf1057492490e9a621f37e1a2d P 0473d2b2d01f4459b1e90fd12cc7840e [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 127766fc592545a4997f7790f50f6076 in term 16.
I20260709 13:06:36.846834 19477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62c6c134d3d24a1ab144dd9ee6bc3f64" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:06:36.847788 19482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed7fdbcb96d14d418db9ca90a792588a" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:06:36.861632 19482 raft_consensus.cc:2468] T ed7fdbcb96d14d418db9ca90a792588a P 0473d2b2d01f4459b1e90fd12cc7840e [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 127766fc592545a4997f7790f50f6076 in term 11.
I20260709 13:06:36.809540 24573 raft_consensus.cc:3060] T 76cb037fc9064d13b59a8969d897ce8c P 0473d2b2d01f4459b1e90fd12cc7840e [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:06:36.863389 19482 raft_consensus.cc:1275] T 0e1085d23e8347fbbd5bce7542f4b1f4 P 0473d2b2d01f4459b1e90fd12cc7840e [term 12 FOLLOWER]: Refusing update from remote peer 127766fc592545a4997f7790f50f6076: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 13:06:36.823114 24763 raft_consensus.cc:3060] T 309c3ca0ca4b4f3ba129752ea2cb293b P 0473d2b2d01f4459b1e90fd12cc7840e [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:06:36.868902 19478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c5eebf646ad445a9d1b1adc319d7b16" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:06:36.869834 19478 raft_consensus.cc:2410] T 6c5eebf646ad445a9d1b1adc319d7b16 P 0473d2b2d01f4459b1e90fd12cc7840e [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 127766fc592545a4997f7790f50f6076 for term 15 because replica has last-logged OpId of term: 14 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 11.
I20260709 13:06:36.871250 19485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e1085d23e8347fbbd5bce7542f4b1f4" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:06:36.871846 19485 raft_consensus.cc:2376] T 0e1085d23e8347fbbd5bce7542f4b1f4 P 0473d2b2d01f4459b1e90fd12cc7840e [term 12 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 127766fc592545a4997f7790f50f6076 in term 12. Re-sending same reply.
I20260709 13:06:36.872977 19481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed7fdbcb96d14d418db9ca90a792588a" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:06:36.809254 24871 consensus_queue.cc:1059] T df751f992649444090e27965eb1af85d P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 }, Status: INVALID_TERM, Last received: 17.11, Next index: 12, Last known committed idx: 10, Time since last communication: 0.049s
I20260709 13:06:36.811496 24823 raft_consensus.cc:515] T 172b3dd13109415a955b71ac0e9d2234 P e5256d91808b47c195bc9b4dbd7f2b87 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:36.852347 24629 raft_consensus.cc:493] T ab43d85f64114d4ebf618930e43d9ed0 P 127766fc592545a4997f7790f50f6076 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:36.882449 19486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14efcc79969f41babe5529c22d59156d" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:06:36.884604 19377 leader_election.cc:304] T 2725d2c4cb054f18b0fc8f735c15f6c2 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:06:36.887840 19486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab43d85f64114d4ebf618930e43d9ed0" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:06:36.889582 24457 raft_consensus.cc:2749] T 2725d2c4cb054f18b0fc8f735c15f6c2 P e5256d91808b47c195bc9b4dbd7f2b87 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:06:36.890008 19377 leader_election.cc:304] T 9962423cb4e54fcfa5de01daf68a86e7 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, 127766fc592545a4997f7790f50f6076
I20260709 13:06:36.891242 19377 leader_election.cc:304] T df751f992649444090e27965eb1af85d P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:06:36.891690 19523 leader_election.cc:304] T 70797e5783b5454ab0d0eea663e791e3 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 127766fc592545a4997f7790f50f6076, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:06:36.892258 19377 leader_election.cc:304] T 179fd671030940b4b4a4e24bcc4aba0a P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87; no voters: e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:06:36.892534 24837 raft_consensus.cc:2804] T 70797e5783b5454ab0d0eea663e791e3 P e61c3a8f61bb48f8a963c9480e53c168 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:06:36.892985 24837 raft_consensus.cc:493] T 70797e5783b5454ab0d0eea663e791e3 P e61c3a8f61bb48f8a963c9480e53c168 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 127766fc592545a4997f7790f50f6076)
I20260709 13:06:36.893205 24756 raft_consensus.cc:2749] T 9962423cb4e54fcfa5de01daf68a86e7 P e5256d91808b47c195bc9b4dbd7f2b87 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:06:36.893383 24837 raft_consensus.cc:3060] T 70797e5783b5454ab0d0eea663e791e3 P e61c3a8f61bb48f8a963c9480e53c168 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:06:36.893888 24756 raft_consensus.cc:2749] T df751f992649444090e27965eb1af85d P e5256d91808b47c195bc9b4dbd7f2b87 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:06:36.894120 24871 consensus_queue.cc:1048] T 217b5fae677b4971b3bbd2f357a1f7ff P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:06:36.894555 24756 raft_consensus.cc:2804] T 179fd671030940b4b4a4e24bcc4aba0a P e5256d91808b47c195bc9b4dbd7f2b87 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:06:36.894748 19558 raft_consensus.cc:1275] T 217b5fae677b4971b3bbd2f357a1f7ff P e61c3a8f61bb48f8a963c9480e53c168 [term 12 FOLLOWER]: Refusing update from remote peer 0473d2b2d01f4459b1e90fd12cc7840e: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:06:36.894987 24756 raft_consensus.cc:493] T 179fd671030940b4b4a4e24bcc4aba0a P e5256d91808b47c195bc9b4dbd7f2b87 [term 17 FOLLOWER]: Starting leader election (detected failure of leader e61c3a8f61bb48f8a963c9480e53c168)
I20260709 13:06:36.895390 24756 raft_consensus.cc:3060] T 179fd671030940b4b4a4e24bcc4aba0a P e5256d91808b47c195bc9b4dbd7f2b87 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:06:36.894845 24753 raft_consensus.cc:3055] T df751f992649444090e27965eb1af85d P 0473d2b2d01f4459b1e90fd12cc7840e [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:06:36.897594 24753 raft_consensus.cc:740] T df751f992649444090e27965eb1af85d P 0473d2b2d01f4459b1e90fd12cc7840e [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 0473d2b2d01f4459b1e90fd12cc7840e, State: Running, Role: LEADER
I20260709 13:06:36.898408 24753 consensus_queue.cc:260] T df751f992649444090e27965eb1af85d P 0473d2b2d01f4459b1e90fd12cc7840e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.11, Last appended by leader: 11, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:36.899627 24753 raft_consensus.cc:3060] T df751f992649444090e27965eb1af85d P 0473d2b2d01f4459b1e90fd12cc7840e [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:06:36.900648 19411 raft_consensus.cc:1240] T 9962423cb4e54fcfa5de01daf68a86e7 P e5256d91808b47c195bc9b4dbd7f2b87 [term 14 FOLLOWER]: Rejecting Update request from peer 127766fc592545a4997f7790f50f6076 for earlier term 13. Current term is 14. Ops: []
I20260709 13:06:36.902503 24626 consensus_queue.cc:1059] T 9962423cb4e54fcfa5de01daf68a86e7 P 127766fc592545a4997f7790f50f6076 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 }, Status: INVALID_TERM, Last received: 13.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:06:36.892998 19481 raft_consensus.cc:2468] T ed7fdbcb96d14d418db9ca90a792588a P 0473d2b2d01f4459b1e90fd12cc7840e [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 127766fc592545a4997f7790f50f6076 in term 11.
I20260709 13:06:36.903337 24626 raft_consensus.cc:3055] T 9962423cb4e54fcfa5de01daf68a86e7 P 127766fc592545a4997f7790f50f6076 [term 13 LEADER]: Stepping down as leader of term 13
W20260709 13:06:36.903168 24874 consensus_queue.cc:1175] T df751f992649444090e27965eb1af85d P 0473d2b2d01f4459b1e90fd12cc7840e [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "e61c3a8f61bb48f8a963c9480e53c168" responder_term: 17 status { last_received { term: 17 index: 11 } last_committed_idx: 11 last_received_current_leader { term: 17 index: 11 } }
I20260709 13:06:36.906081 19558 raft_consensus.cc:1240] T bc225c93219c45538b53a1bd3d387e4d P e61c3a8f61bb48f8a963c9480e53c168 [term 14 FOLLOWER]: Rejecting Update request from peer 0473d2b2d01f4459b1e90fd12cc7840e for earlier term 13. Current term is 14. Ops: [13.8-13.8]
W20260709 13:06:36.906635 19375 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.3:36891, user_credentials={real_user=slave}} blocked reactor thread for 197946us
I20260709 13:06:36.914271 19558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4509b76741dc428e9201c70c1658da13" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:06:36.915242 20078 leader_election.cc:304] T ff9b0eddd810459b82d91c60777c10eb P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, 127766fc592545a4997f7790f50f6076; no voters: e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:06:36.915947 19553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e381f1d6b8184797ad142de49be225a8" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:06:36.936359 19485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e1085d23e8347fbbd5bce7542f4b1f4" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:06:36.937228 19485 raft_consensus.cc:2376] T 0e1085d23e8347fbbd5bce7542f4b1f4 P 0473d2b2d01f4459b1e90fd12cc7840e [term 12 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 127766fc592545a4997f7790f50f6076 in term 12. Re-sending same reply.
I20260709 13:06:36.938580 20078 leader_election.cc:304] T 0afb57ae58a24a01850491d69f0213dd P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 127766fc592545a4997f7790f50f6076; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:06:36.939913 19526 leader_election.cc:304] T a08760e15aac4630a629431f56024dc8 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e61c3a8f61bb48f8a963c9480e53c168; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:06:36.848413 24700 raft_consensus.cc:515] T 65d8cb8d6ec64f459d5a47cefab10acf P e61c3a8f61bb48f8a963c9480e53c168 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:36.941139 19558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b74109013a140ada21feeef92d6f563" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:06:36.944583 19402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1b10566f45d4a7d9029858330e02d5b" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:06:36.903759 24626 raft_consensus.cc:740] T 9962423cb4e54fcfa5de01daf68a86e7 P 127766fc592545a4997f7790f50f6076 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 127766fc592545a4997f7790f50f6076, State: Running, Role: LEADER
I20260709 13:06:36.941550 19411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4509b76741dc428e9201c70c1658da13" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:06:36.946180 19559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1b10566f45d4a7d9029858330e02d5b" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:06:36.945444 24766 raft_consensus.cc:2804] T ff9b0eddd810459b82d91c60777c10eb P 127766fc592545a4997f7790f50f6076 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:06:36.948264 24766 raft_consensus.cc:697] T ff9b0eddd810459b82d91c60777c10eb P 127766fc592545a4997f7790f50f6076 [term 16 LEADER]: Becoming Leader. State: Replica: 127766fc592545a4997f7790f50f6076, State: Running, Role: LEADER
I20260709 13:06:36.943907 19408 raft_consensus.cc:1240] T 76cb037fc9064d13b59a8969d897ce8c P e5256d91808b47c195bc9b4dbd7f2b87 [term 13 FOLLOWER]: Rejecting Update request from peer 0473d2b2d01f4459b1e90fd12cc7840e for earlier term 12. Current term is 13. Ops: []
I20260709 13:06:36.943300 19409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e381f1d6b8184797ad142de49be225a8" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
I20260709 13:06:36.905433 24629 raft_consensus.cc:3060] T ab43d85f64114d4ebf618930e43d9ed0 P 127766fc592545a4997f7790f50f6076 [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:06:36.950321 19376 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:36.951807 20078 leader_election.cc:304] T 48824d5acfbc485ebf8c2d944e7202de P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 127766fc592545a4997f7790f50f6076; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:06:36.954826 19486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40e1e16737a842ee936002830f36882e" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:06:36.963227 19486 raft_consensus.cc:2468] T 40e1e16737a842ee936002830f36882e P 0473d2b2d01f4459b1e90fd12cc7840e [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 15.
I20260709 13:06:36.964062 19486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b08304a0a02b42d7840c4e8ee9a6bd1a" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
W20260709 13:06:36.966991 19449 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:36.969678 19485 raft_consensus.cc:1240] T 21e14947d70440f19044d8f75c31e1f9 P 0473d2b2d01f4459b1e90fd12cc7840e [term 15 FOLLOWER]: Rejecting Update request from peer e5256d91808b47c195bc9b4dbd7f2b87 for earlier term 14. Current term is 15. Ops: []
I20260709 13:06:36.866580 24821 raft_consensus.cc:515] T 22196caba61445d3bec98a0aab3c337d P e5256d91808b47c195bc9b4dbd7f2b87 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:36.943697 24691 raft_consensus.cc:2749] T 0afb57ae58a24a01850491d69f0213dd P 127766fc592545a4997f7790f50f6076 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:06:36.879249 24671 consensus_queue.cc:1059] T bc225c93219c45538b53a1bd3d387e4d P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.072s
I20260709 13:06:36.950876 24790 leader_election.cc:290] T 96efeaaf1057492490e9a621f37e1a2d P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 17 election: Requested vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:06:36.916873 24702 raft_consensus.cc:493] T 7be9efa6559648dbb5a0f7684c4542d1 P e61c3a8f61bb48f8a963c9480e53c168 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 0473d2b2d01f4459b1e90fd12cc7840e)
I20260709 13:06:36.980659 20078 leader_election.cc:304] T 62c6c134d3d24a1ab144dd9ee6bc3f64 P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 127766fc592545a4997f7790f50f6076; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:06:36.997489 19485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f93ee515a9c14139bf566522ed8232f3" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 17 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:06:37.002161 19485 raft_consensus.cc:2468] T f93ee515a9c14139bf566522ed8232f3 P 0473d2b2d01f4459b1e90fd12cc7840e [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 16.
I20260709 13:06:36.988834 24700 leader_election.cc:290] T 65d8cb8d6ec64f459d5a47cefab10acf P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:06:37.003384 19485 raft_consensus.cc:1240] T e381f1d6b8184797ad142de49be225a8 P 0473d2b2d01f4459b1e90fd12cc7840e [term 13 FOLLOWER]: Rejecting Update request from peer e5256d91808b47c195bc9b4dbd7f2b87 for earlier term 12. Current term is 13. Ops: [12.9-12.9]
I20260709 13:06:36.876569 24875 consensus_queue.cc:1059] T 7be9efa6559648dbb5a0f7684c4542d1 P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } attrs { replace: true }, Status: INVALID_TERM, Last received: 13.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.113s
I20260709 13:06:37.004520 19485 raft_consensus.cc:1240] T ff9b0eddd810459b82d91c60777c10eb P 0473d2b2d01f4459b1e90fd12cc7840e [term 16 FOLLOWER]: Rejecting Update request from peer e5256d91808b47c195bc9b4dbd7f2b87 for earlier term 15. Current term is 16. Ops: []
W20260709 13:06:36.983533 19526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.2:46257, user_credentials={real_user=slave}} blocked reactor thread for 43700.1us
I20260709 13:06:36.957186 24478 raft_consensus.cc:493] T 172b3dd13109415a955b71ac0e9d2234 P 0473d2b2d01f4459b1e90fd12cc7840e [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:36.874738 24876 consensus_queue.cc:1059] T 48824d5acfbc485ebf8c2d944e7202de P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 }, Status: INVALID_TERM, Last received: 16.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.102s
W20260709 13:06:37.005251 19526 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:37.005293 24478 raft_consensus.cc:515] T 172b3dd13109415a955b71ac0e9d2234 P 0473d2b2d01f4459b1e90fd12cc7840e [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:36.918104 24871 consensus_queue.cc:1059] T a08760e15aac4630a629431f56024dc8 P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 }, Status: INVALID_TERM, Last received: 17.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.081s
I20260709 13:06:37.006774 24871 raft_consensus.cc:3055] T a08760e15aac4630a629431f56024dc8 P 0473d2b2d01f4459b1e90fd12cc7840e [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:06:37.007143 24871 raft_consensus.cc:740] T a08760e15aac4630a629431f56024dc8 P 0473d2b2d01f4459b1e90fd12cc7840e [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 0473d2b2d01f4459b1e90fd12cc7840e, State: Running, Role: LEADER
I20260709 13:06:37.007639 24478 leader_election.cc:290] T 172b3dd13109415a955b71ac0e9d2234 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:06:36.978837 24786 consensus_queue.cc:1048] T 217b5fae677b4971b3bbd2f357a1f7ff P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.008s
I20260709 13:06:37.007983 24871 consensus_queue.cc:260] T a08760e15aac4630a629431f56024dc8 P 0473d2b2d01f4459b1e90fd12cc7840e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.10, Last appended by leader: 10, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:37.008911 24700 raft_consensus.cc:493] T df751f992649444090e27965eb1af85d P e61c3a8f61bb48f8a963c9480e53c168 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 0473d2b2d01f4459b1e90fd12cc7840e)
I20260709 13:06:37.009112 24630 raft_consensus.cc:3060] T 48824d5acfbc485ebf8c2d944e7202de P 127766fc592545a4997f7790f50f6076 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:06:37.009462 24700 raft_consensus.cc:515] T df751f992649444090e27965eb1af85d P e61c3a8f61bb48f8a963c9480e53c168 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:36.998059 24823 leader_election.cc:290] T 172b3dd13109415a955b71ac0e9d2234 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 14 election: Requested vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:06:36.992324 19486 raft_consensus.cc:2410] T b08304a0a02b42d7840c4e8ee9a6bd1a P 0473d2b2d01f4459b1e90fd12cc7840e [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate e5256d91808b47c195bc9b4dbd7f2b87 for term 15 because replica has last-logged OpId of term: 14 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 8.
I20260709 13:06:37.011636 24700 leader_election.cc:290] T df751f992649444090e27965eb1af85d P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:06:37.012393 19526 leader_election.cc:304] T 21e14947d70440f19044d8f75c31e1f9 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:06:37.013111 24700 raft_consensus.cc:2804] T 21e14947d70440f19044d8f75c31e1f9 P e61c3a8f61bb48f8a963c9480e53c168 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:06:36.998253 24756 raft_consensus.cc:515] T 179fd671030940b4b4a4e24bcc4aba0a P e5256d91808b47c195bc9b4dbd7f2b87 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:37.013736 24700 raft_consensus.cc:697] T 21e14947d70440f19044d8f75c31e1f9 P e61c3a8f61bb48f8a963c9480e53c168 [term 15 LEADER]: Becoming Leader. State: Replica: e61c3a8f61bb48f8a963c9480e53c168, State: Running, Role: LEADER
I20260709 13:06:37.013572 24629 raft_consensus.cc:515] T ab43d85f64114d4ebf618930e43d9ed0 P 127766fc592545a4997f7790f50f6076 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:37.014735 24700 consensus_queue.cc:237] T 21e14947d70440f19044d8f75c31e1f9 P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:37.015327 24756 leader_election.cc:290] T 179fd671030940b4b4a4e24bcc4aba0a P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 18 election: Requested vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:06:37.015666 24629 leader_election.cc:290] T ab43d85f64114d4ebf618930e43d9ed0 P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 17 election: Requested vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:06:37.000545 24796 consensus_queue.cc:1059] T bc225c93219c45538b53a1bd3d387e4d P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.017s
I20260709 13:06:36.992901 24837 raft_consensus.cc:515] T 70797e5783b5454ab0d0eea663e791e3 P e61c3a8f61bb48f8a963c9480e53c168 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:37.017894 24789 raft_consensus.cc:515] T ece3db938bc649d4a40a51522ed5259c P e61c3a8f61bb48f8a963c9480e53c168 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:36.956277 24781 leader_election.cc:290] T 2a16f7501e2444fb86d4e2778e734e02 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 15 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:06:37.018425 19526 leader_election.cc:304] T 7f575b143b844aa096b50997dad3516a P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168; no voters: e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:06:37.019402 24837 leader_election.cc:290] T 70797e5783b5454ab0d0eea663e791e3 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 15 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:06:37.019647 24781 raft_consensus.cc:2804] T 7f575b143b844aa096b50997dad3516a P e61c3a8f61bb48f8a963c9480e53c168 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:06:37.020372 24781 raft_consensus.cc:697] T 7f575b143b844aa096b50997dad3516a P e61c3a8f61bb48f8a963c9480e53c168 [term 11 LEADER]: Becoming Leader. State: Replica: e61c3a8f61bb48f8a963c9480e53c168, State: Running, Role: LEADER
I20260709 13:06:36.996915 24763 raft_consensus.cc:515] T 309c3ca0ca4b4f3ba129752ea2cb293b P 0473d2b2d01f4459b1e90fd12cc7840e [term 10 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } attrs { replace: true } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:37.022068 24838 leader_election.cc:290] T 14935b3ddf914369822e4a0547aaa355 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:06:37.021575 24781 consensus_queue.cc:237] T 7f575b143b844aa096b50997dad3516a P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:36.861547 24863 consensus_queue.cc:237] T 28af091831594f9d8e96482078cc7625 P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.8, Last appended by leader: 8, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
W20260709 13:06:37.027601 19523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.1:40321, user_credentials={real_user=slave}} blocked reactor thread for 117283us
I20260709 13:06:37.005724 24876 raft_consensus.cc:3055] T 48824d5acfbc485ebf8c2d944e7202de P 0473d2b2d01f4459b1e90fd12cc7840e [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:06:37.004808 24875 raft_consensus.cc:3055] T 7be9efa6559648dbb5a0f7684c4542d1 P 0473d2b2d01f4459b1e90fd12cc7840e [term 13 LEADER]: Stepping down as leader of term 13
W20260709 13:06:36.996340 24865 log.cc:927] Time spent T fa731b585f684a7fb2d106c50f143b83 P e61c3a8f61bb48f8a963c9480e53c168: Append to log took a long time: real 0.141s	user 0.000s	sys 0.000s
I20260709 13:06:37.029670 20104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96efeaaf1057492490e9a621f37e1a2d" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076"
I20260709 13:06:37.039403 20104 raft_consensus.cc:3060] T 96efeaaf1057492490e9a621f37e1a2d P 127766fc592545a4997f7790f50f6076 [term 15 FOLLOWER]: Advancing to term 17
W20260709 13:06:36.989048 24877 log.cc:927] Time spent T 85c494af21f9457a85da47b9bc70c1fd P e5256d91808b47c195bc9b4dbd7f2b87: Append to log took a long time: real 0.105s	user 0.000s	sys 0.000s
I20260709 13:06:36.995822 24790 raft_consensus.cc:3060] T a08760e15aac4630a629431f56024dc8 P e61c3a8f61bb48f8a963c9480e53c168 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:06:36.995317 24671 raft_consensus.cc:493] T ab43d85f64114d4ebf618930e43d9ed0 P 0473d2b2d01f4459b1e90fd12cc7840e [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:37.027627 24629 raft_consensus.cc:2749] T 62c6c134d3d24a1ab144dd9ee6bc3f64 P 127766fc592545a4997f7790f50f6076 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:06:37.133072 19408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b74109013a140ada21feeef92d6f563" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:06:37.212291 24867 raft_consensus.cc:493] T ece3db938bc649d4a40a51522ed5259c P e5256d91808b47c195bc9b4dbd7f2b87 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:37.213018 19479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46c5bfeecc314717bffe987e6844b6d0" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 21 candidate_status { last_received { term: 19 index: 9 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:06:37.213320 24867 raft_consensus.cc:515] T ece3db938bc649d4a40a51522ed5259c P e5256d91808b47c195bc9b4dbd7f2b87 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:37.214152 19479 raft_consensus.cc:2468] T 46c5bfeecc314717bffe987e6844b6d0 P 0473d2b2d01f4459b1e90fd12cc7840e [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 20.
I20260709 13:06:37.135021 19411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ece3db938bc649d4a40a51522ed5259c" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:06:37.215693 19411 raft_consensus.cc:2468] T ece3db938bc649d4a40a51522ed5259c P e5256d91808b47c195bc9b4dbd7f2b87 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 11.
I20260709 13:06:37.215930 19479 raft_consensus.cc:1240] T 1dc5b3532fe54f74876d02beffa2c230 P 0473d2b2d01f4459b1e90fd12cc7840e [term 16 FOLLOWER]: Rejecting Update request from peer e61c3a8f61bb48f8a963c9480e53c168 for earlier term 15. Current term is 16. Ops: []
I20260709 13:06:37.136999 19403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a16f7501e2444fb86d4e2778e734e02" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
I20260709 13:06:37.137495 19406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46c5bfeecc314717bffe987e6844b6d0" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 21 candidate_status { last_received { term: 19 index: 9 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:06:37.221180 20106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a16f7501e2444fb86d4e2778e734e02" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076"
I20260709 13:06:37.152339 19410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "172b3dd13109415a955b71ac0e9d2234" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:06:37.222190 20106 raft_consensus.cc:3060] T 2a16f7501e2444fb86d4e2778e734e02 P 127766fc592545a4997f7790f50f6076 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:06:37.222945 19410 raft_consensus.cc:2393] T 172b3dd13109415a955b71ac0e9d2234 P e5256d91808b47c195bc9b4dbd7f2b87 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0473d2b2d01f4459b1e90fd12cc7840e in current term 14: Already voted for candidate e5256d91808b47c195bc9b4dbd7f2b87 in this term.
I20260709 13:06:37.223333 20110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65d8cb8d6ec64f459d5a47cefab10acf" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:06:37.224402 20110 raft_consensus.cc:2468] T 65d8cb8d6ec64f459d5a47cefab10acf P 127766fc592545a4997f7790f50f6076 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 15.
I20260709 13:06:37.153898 19405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "309c3ca0ca4b4f3ba129752ea2cb293b" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
W20260709 13:06:37.159236 19450 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.3:36891, user_credentials={real_user=slave}} blocked reactor thread for 188397us
I20260709 13:06:36.998973 19478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "172b3dd13109415a955b71ac0e9d2234" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:06:37.227341 24756 consensus_queue.cc:1048] T 3e1f505cb0f1427bbd698ac889d80821 P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:06:37.227702 19478 raft_consensus.cc:2468] T 172b3dd13109415a955b71ac0e9d2234 P 0473d2b2d01f4459b1e90fd12cc7840e [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 13.
I20260709 13:06:37.227775 19450 leader_election.cc:304] T 4509b76741dc428e9201c70c1658da13 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e; no voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:06:37.167745 19482 raft_consensus.cc:1240] T 309c3ca0ca4b4f3ba129752ea2cb293b P 0473d2b2d01f4459b1e90fd12cc7840e [term 10 FOLLOWER]: Rejecting Update request from peer 127766fc592545a4997f7790f50f6076 for earlier term 9. Current term is 10. Ops: []
I20260709 13:06:37.169481 19477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96efeaaf1057492490e9a621f37e1a2d" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:06:37.177461 19485 raft_consensus.cc:1275] T b9f0d59553ad444883fcf5b5909f9798 P 0473d2b2d01f4459b1e90fd12cc7840e [term 14 FOLLOWER]: Refusing update from remote peer e61c3a8f61bb48f8a963c9480e53c168: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 13:06:37.024996 20078 leader_election.cc:304] T 96efeaaf1057492490e9a621f37e1a2d P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, 127766fc592545a4997f7790f50f6076; no voters: e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:06:37.234409 20108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70797e5783b5454ab0d0eea663e791e3" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076"
W20260709 13:06:37.236507 20078 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.2:46257, user_credentials={real_user=slave}} blocked reactor thread for 211447us
I20260709 13:06:37.025125 19526 leader_election.cc:304] T 3e1f505cb0f1427bbd698ac889d80821 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168; no voters: e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:06:36.986327 24551 raft_consensus.cc:697] T bc225c93219c45538b53a1bd3d387e4d P e5256d91808b47c195bc9b4dbd7f2b87 [term 14 LEADER]: Becoming Leader. State: Replica: e5256d91808b47c195bc9b4dbd7f2b87, State: Running, Role: LEADER
I20260709 13:06:37.239152 19553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b08304a0a02b42d7840c4e8ee9a6bd1a" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:06:37.240175 19553 raft_consensus.cc:2393] T b08304a0a02b42d7840c4e8ee9a6bd1a P e61c3a8f61bb48f8a963c9480e53c168 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate e5256d91808b47c195bc9b4dbd7f2b87 in current term 15: Already voted for candidate e61c3a8f61bb48f8a963c9480e53c168 in this term.
I20260709 13:06:37.240007 24551 consensus_queue.cc:237] T bc225c93219c45538b53a1bd3d387e4d P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:37.241358 19553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "179fd671030940b4b4a4e24bcc4aba0a" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:06:37.182942 19552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f93ee515a9c14139bf566522ed8232f3" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 17 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:06:37.184482 19556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40e1e16737a842ee936002830f36882e" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:06:37.243824 19556 raft_consensus.cc:2468] T 40e1e16737a842ee936002830f36882e P e61c3a8f61bb48f8a963c9480e53c168 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 16.
I20260709 13:06:37.052539 24671 raft_consensus.cc:515] T ab43d85f64114d4ebf618930e43d9ed0 P 0473d2b2d01f4459b1e90fd12cc7840e [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:37.184942 24573 raft_consensus.cc:3055] T bc225c93219c45538b53a1bd3d387e4d P 0473d2b2d01f4459b1e90fd12cc7840e [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:06:37.244652 24573 raft_consensus.cc:740] T bc225c93219c45538b53a1bd3d387e4d P 0473d2b2d01f4459b1e90fd12cc7840e [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 0473d2b2d01f4459b1e90fd12cc7840e, State: Running, Role: LEADER
I20260709 13:06:37.245007 19409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65d8cb8d6ec64f459d5a47cefab10acf" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:06:37.245898 19409 raft_consensus.cc:2468] T 65d8cb8d6ec64f459d5a47cefab10acf P e5256d91808b47c195bc9b4dbd7f2b87 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 16.
I20260709 13:06:37.034528 24702 raft_consensus.cc:515] T 7be9efa6559648dbb5a0f7684c4542d1 P e61c3a8f61bb48f8a963c9480e53c168 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } attrs { replace: true } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:37.258285 19483 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58294 (request call id 2523) took 1376 ms. Trace:
I20260709 13:06:37.258809 19483 rpcz_store.cc:276] 0709 13:06:35.881356 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:36.044266 (+162910us) service_pool.cc:224] Handling call
0709 13:06:37.257830 (+1213564us) spinlock_profiling.cc:243] Waited 797 ms on lock 0x7b5400224a54. stack: 00007f4a79de9343 00007f4a79de9240 00007f4a797781d4 00007f4a834b6304 00007f4a834b6299 00007f4a7ce71571 00007f4a7cf0c2fa 00007f4a81ecdb17 00007f4a7b4486d4 00007f4a7b448662 00007f4a7b448591 00007f4a7b44850c 00007f4a7b4477c2 00007f4a7b24348c 00007f4a7b2428c6 00007f4a7b24226f
0709 13:06:37.258058 (+   228us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1832113536}
I20260709 13:06:37.259922 24702 leader_election.cc:290] T 7be9efa6559648dbb5a0f7684c4542d1 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:06:37.261706 19405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14935b3ddf914369822e4a0547aaa355" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:06:35.899236 18300 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:06:37.263223 19480 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58294 (request call id 2548) took 1200 ms. Trace:
I20260709 13:06:37.265169 19375 leader_election.cc:304] T 40e1e16737a842ee936002830f36882e P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:06:37.263841 19480 rpcz_store.cc:276] 0709 13:06:36.062983 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:36.430486 (+367503us) service_pool.cc:224] Handling call
0709 13:06:36.430870 (+   384us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:36.475275 (+ 44405us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:06:36.533262 (+ 57987us) log.cc:844] Serialized 14 byte log entry
0709 13:06:36.800894 (+267632us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:36.800952 (+    58us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:06:36.801005 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:37.262644 (+461639us) spinlock_profiling.cc:243] Waited 44.2 ms on lock 0x7b54002b89d4. stack: 00007f4a79de9343 00007f4a79de9240 00007f4a797781d4 00007f4a834b6304 00007f4a834b6299 00007f4a7ce71571 00007f4a7cf08e01 00007f4a7cf0783e 00007f4a81ecc419 00007f4a7b443bd4 00007f4a7b443b62 00007f4a7b443a91 00007f4a7b443a0c 00007f4a7b442cc2 00007f4a7b24348c 00007f4a7b2428c6
0709 13:06:37.262738 (+    94us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:37.263013 (+   275us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":49076,"prepare.run_cpu_time_us":42,"prepare.run_wall_time_us":43,"raft.queue_time_us":5222,"raft.run_cpu_time_us":243,"raft.run_wall_time_us":15480,"spinlock_wait_cycles":101620480,"thread_start_us":265901,"threads_started":1,"wal-append.queue_time_us":341291}
I20260709 13:06:37.271529 19450 leader_election.cc:304] T e381f1d6b8184797ad142de49be225a8 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e; no voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:06:37.272861 24597 raft_consensus.cc:493] T 1dc5b3532fe54f74876d02beffa2c230 P e5256d91808b47c195bc9b4dbd7f2b87 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader e61c3a8f61bb48f8a963c9480e53c168)
I20260709 13:06:37.273875 19557 raft_consensus.cc:1240] T 2a16f7501e2444fb86d4e2778e734e02 P e61c3a8f61bb48f8a963c9480e53c168 [term 15 FOLLOWER]: Rejecting Update request from peer e5256d91808b47c195bc9b4dbd7f2b87 for earlier term 14. Current term is 15. Ops: [14.12-14.12]
I20260709 13:06:37.273789 24597 raft_consensus.cc:515] T 1dc5b3532fe54f74876d02beffa2c230 P e5256d91808b47c195bc9b4dbd7f2b87 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:37.059201 24763 leader_election.cc:290] T 309c3ca0ca4b4f3ba129752ea2cb293b P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 10 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:06:36.986950 24766 consensus_queue.cc:237] T ff9b0eddd810459b82d91c60777c10eb P 127766fc592545a4997f7790f50f6076 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.11, Last appended by leader: 11, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:37.265458 19306 catalog_manager.cc:5697] T 48824d5acfbc485ebf8c2d944e7202de P 127766fc592545a4997f7790f50f6076 reported cstate change: term changed from 10 to 15, leader changed from e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3) to 127766fc592545a4997f7790f50f6076 (127.17.223.4). New cstate: current_term: 15 leader_uuid: "127766fc592545a4997f7790f50f6076" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:06:37.280550 20105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "172b3dd13109415a955b71ac0e9d2234" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076"
I20260709 13:06:37.056070 24789 leader_election.cc:290] T ece3db938bc649d4a40a51522ed5259c P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 12 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:06:37.281476 20105 raft_consensus.cc:3060] T 172b3dd13109415a955b71ac0e9d2234 P 127766fc592545a4997f7790f50f6076 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:06:37.282353 20110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14935b3ddf914369822e4a0547aaa355" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:06:37.071018 24790 raft_consensus.cc:2749] T a08760e15aac4630a629431f56024dc8 P e61c3a8f61bb48f8a963c9480e53c168 [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:06:36.990392 24821 leader_election.cc:290] T 22196caba61445d3bec98a0aab3c337d P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 14 election: Requested vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:06:37.034125 24837 consensus_queue.cc:1048] T 179fd671030940b4b4a4e24bcc4aba0a P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.019s
I20260709 13:06:37.036058 24838 consensus_queue.cc:1048] T 2b74109013a140ada21feeef92d6f563 P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.017s
I20260709 13:06:36.938841 24839 consensus_queue.cc:237] T ef32ce6fdd0e40d382c79974f30295c6 P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:37.286618 20109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ece3db938bc649d4a40a51522ed5259c" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076"
I20260709 13:06:37.036931 24875 raft_consensus.cc:740] T 7be9efa6559648dbb5a0f7684c4542d1 P 0473d2b2d01f4459b1e90fd12cc7840e [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 0473d2b2d01f4459b1e90fd12cc7840e, State: Running, Role: LEADER
I20260709 13:06:37.035498 24876 raft_consensus.cc:740] T 48824d5acfbc485ebf8c2d944e7202de P 0473d2b2d01f4459b1e90fd12cc7840e [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 0473d2b2d01f4459b1e90fd12cc7840e, State: Running, Role: LEADER
I20260709 13:06:37.303369 24597 leader_election.cc:290] T 1dc5b3532fe54f74876d02beffa2c230 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:06:37.304458 24876 consensus_queue.cc:260] T 48824d5acfbc485ebf8c2d944e7202de P 0473d2b2d01f4459b1e90fd12cc7840e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.12, Last appended by leader: 12, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:37.309772 24630 raft_consensus.cc:2749] T 48824d5acfbc485ebf8c2d944e7202de P 127766fc592545a4997f7790f50f6076 [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:06:37.313032 19555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22196caba61445d3bec98a0aab3c337d" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:06:37.313879 24867 leader_election.cc:290] T ece3db938bc649d4a40a51522ed5259c P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:06:37.053982 24887 consensus_queue.cc:1048] T f1b10566f45d4a7d9029858330e02d5b P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:06:37.315333 24824 raft_consensus.cc:3055] T 1a61655d99124a29b486ba4a5b37faea P e5256d91808b47c195bc9b4dbd7f2b87 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:06:37.315914 24824 raft_consensus.cc:740] T 1a61655d99124a29b486ba4a5b37faea P e5256d91808b47c195bc9b4dbd7f2b87 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: e5256d91808b47c195bc9b4dbd7f2b87, State: Running, Role: LEADER
I20260709 13:06:37.317418 24824 consensus_queue.cc:260] T 1a61655d99124a29b486ba4a5b37faea P e5256d91808b47c195bc9b4dbd7f2b87 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:37.319628 24824 raft_consensus.cc:3060] T 1a61655d99124a29b486ba4a5b37faea P e5256d91808b47c195bc9b4dbd7f2b87 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:06:37.320173 24866 raft_consensus.cc:3055] T 21e14947d70440f19044d8f75c31e1f9 P e5256d91808b47c195bc9b4dbd7f2b87 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:06:37.320677 24866 raft_consensus.cc:740] T 21e14947d70440f19044d8f75c31e1f9 P e5256d91808b47c195bc9b4dbd7f2b87 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: e5256d91808b47c195bc9b4dbd7f2b87, State: Running, Role: LEADER
I20260709 13:06:37.325031 24871 raft_consensus.cc:3060] T a08760e15aac4630a629431f56024dc8 P 0473d2b2d01f4459b1e90fd12cc7840e [term 17 FOLLOWER]: Advancing to term 18
W20260709 13:06:37.331753 24880 log.cc:927] Time spent T 0e1085d23e8347fbbd5bce7542f4b1f4 P e61c3a8f61bb48f8a963c9480e53c168: Append to log took a long time: real 0.444s	user 0.003s	sys 0.000s
I20260709 13:06:37.337525 24372 raft_consensus.cc:493] T d1e5873a19244c5ebbcd38e126796ee7 P e5256d91808b47c195bc9b4dbd7f2b87 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader e61c3a8f61bb48f8a963c9480e53c168)
I20260709 13:06:37.338497 24372 raft_consensus.cc:515] T d1e5873a19244c5ebbcd38e126796ee7 P e5256d91808b47c195bc9b4dbd7f2b87 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:37.132869 19402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70797e5783b5454ab0d0eea663e791e3" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:06:37.232295 24780 raft_consensus.cc:2749] T 4509b76741dc428e9201c70c1658da13 P 0473d2b2d01f4459b1e90fd12cc7840e [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:06:37.233019 19477 raft_consensus.cc:3060] T 96efeaaf1057492490e9a621f37e1a2d P 0473d2b2d01f4459b1e90fd12cc7840e [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:06:37.342312 19402 raft_consensus.cc:2393] T 70797e5783b5454ab0d0eea663e791e3 P e5256d91808b47c195bc9b4dbd7f2b87 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e61c3a8f61bb48f8a963c9480e53c168 in current term 15: Already voted for candidate e5256d91808b47c195bc9b4dbd7f2b87 in this term.
I20260709 13:06:37.246121 24573 consensus_queue.cc:260] T bc225c93219c45538b53a1bd3d387e4d P 0473d2b2d01f4459b1e90fd12cc7840e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:37.253333 19409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df751f992649444090e27965eb1af85d" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:06:37.344767 19409 raft_consensus.cc:2393] T df751f992649444090e27965eb1af85d P e5256d91808b47c195bc9b4dbd7f2b87 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e61c3a8f61bb48f8a963c9480e53c168 in current term 18: Already voted for candidate e5256d91808b47c195bc9b4dbd7f2b87 in this term.
I20260709 13:06:37.273017 24798 raft_consensus.cc:2804] T 40e1e16737a842ee936002830f36882e P e5256d91808b47c195bc9b4dbd7f2b87 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:06:37.345633 24798 raft_consensus.cc:493] T 40e1e16737a842ee936002830f36882e P e5256d91808b47c195bc9b4dbd7f2b87 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:37.346088 24798 raft_consensus.cc:3060] T 40e1e16737a842ee936002830f36882e P e5256d91808b47c195bc9b4dbd7f2b87 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:06:37.034072 24731 consensus_queue.cc:1048] T 0e1085d23e8347fbbd5bce7542f4b1f4 P 127766fc592545a4997f7790f50f6076 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.019s
I20260709 13:06:37.275303 19408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70797e5783b5454ab0d0eea663e791e3" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
I20260709 13:06:37.348831 19408 raft_consensus.cc:2393] T 70797e5783b5454ab0d0eea663e791e3 P e5256d91808b47c195bc9b4dbd7f2b87 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate e61c3a8f61bb48f8a963c9480e53c168 in current term 15: Already voted for candidate e5256d91808b47c195bc9b4dbd7f2b87 in this term.
I20260709 13:06:37.348192 24875 consensus_queue.cc:260] T 7be9efa6559648dbb5a0f7684c4542d1 P 0473d2b2d01f4459b1e90fd12cc7840e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } attrs { replace: true } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:37.285537 20103 raft_consensus.cc:1275] T 85c494af21f9457a85da47b9bc70c1fd P 127766fc592545a4997f7790f50f6076 [term 15 FOLLOWER]: Refusing update from remote peer e5256d91808b47c195bc9b4dbd7f2b87: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 15 index: 12. (term mismatch)
I20260709 13:06:37.246575 24671 leader_election.cc:290] T ab43d85f64114d4ebf618930e43d9ed0 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
W20260709 13:06:37.276818 19526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.2:46257, user_credentials={real_user=slave}} blocked reactor thread for 250718us
I20260709 13:06:37.349774 24702 consensus_queue.cc:1048] T f93ee515a9c14139bf566522ed8232f3 P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:06:37.276818 24700 raft_consensus.cc:2804] T 3e1f505cb0f1427bbd698ac889d80821 P e61c3a8f61bb48f8a963c9480e53c168 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:06:37.352466 24700 raft_consensus.cc:493] T 3e1f505cb0f1427bbd698ac889d80821 P e61c3a8f61bb48f8a963c9480e53c168 [term 16 FOLLOWER]: Starting leader election (detected failure of leader e5256d91808b47c195bc9b4dbd7f2b87)
I20260709 13:06:37.352526 24783 raft_consensus.cc:2749] T e381f1d6b8184797ad142de49be225a8 P 0473d2b2d01f4459b1e90fd12cc7840e [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:06:37.353006 24700 raft_consensus.cc:3060] T 3e1f505cb0f1427bbd698ac889d80821 P e61c3a8f61bb48f8a963c9480e53c168 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:06:37.354615 19556 raft_consensus.cc:1275] T 85c494af21f9457a85da47b9bc70c1fd P e61c3a8f61bb48f8a963c9480e53c168 [term 15 FOLLOWER]: Refusing update from remote peer e5256d91808b47c195bc9b4dbd7f2b87: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 13:06:37.299856 20109 raft_consensus.cc:3060] T ece3db938bc649d4a40a51522ed5259c P 127766fc592545a4997f7790f50f6076 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:06:37.300971 19557 raft_consensus.cc:1275] T 46c5bfeecc314717bffe987e6844b6d0 P e61c3a8f61bb48f8a963c9480e53c168 [term 20 FOLLOWER]: Refusing update from remote peer e5256d91808b47c195bc9b4dbd7f2b87: Log matching property violated. Preceding OpId in replica: term: 19 index: 9. Preceding OpId from leader: term: 20 index: 10. (index mismatch)
W20260709 13:06:37.301718 19376 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:37.349478 20103 pending_rounds.cc:85] T 85c494af21f9457a85da47b9bc70c1fd P 127766fc592545a4997f7790f50f6076: Aborting all ops after (but not including) 11
I20260709 13:06:37.359011 19526 leader_election.cc:304] T ed7fdbcb96d14d418db9ca90a792588a P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168; no voters: 127766fc592545a4997f7790f50f6076
I20260709 13:06:37.367188 20110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7be9efa6559648dbb5a0f7684c4542d1" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:06:37.358655 20103 pending_rounds.cc:107] T 85c494af21f9457a85da47b9bc70c1fd P 127766fc592545a4997f7790f50f6076: Aborting uncommitted NO_OP operation due to leader change: 14.12
I20260709 13:06:37.369310 20103 raft_consensus.cc:2889] T 85c494af21f9457a85da47b9bc70c1fd P 127766fc592545a4997f7790f50f6076 [term 15 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:06:37.322088 24866 consensus_queue.cc:260] T 21e14947d70440f19044d8f75c31e1f9 P e5256d91808b47c195bc9b4dbd7f2b87 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:37.375051 20111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ece3db938bc649d4a40a51522ed5259c" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:06:37.376605 20106 raft_consensus.cc:2468] T 2a16f7501e2444fb86d4e2778e734e02 P 127766fc592545a4997f7790f50f6076 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 15.
W20260709 13:06:37.379191 20078 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.2:46257, user_credentials={real_user=slave}} blocked reactor thread for 141730us
I20260709 13:06:37.380976 20108 raft_consensus.cc:2468] T 70797e5783b5454ab0d0eea663e791e3 P 127766fc592545a4997f7790f50f6076 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 15.
I20260709 13:06:37.387243 20104 raft_consensus.cc:2468] T 96efeaaf1057492490e9a621f37e1a2d P 127766fc592545a4997f7790f50f6076 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 17.
W20260709 13:06:37.394239 19449 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.1:40321, user_credentials={real_user=slave}} blocked reactor thread for 48110.1us
I20260709 13:06:37.394702 24629 raft_consensus.cc:2764] T 96efeaaf1057492490e9a621f37e1a2d P 127766fc592545a4997f7790f50f6076 [term 17 FOLLOWER]: Leader pre-election decision vote started in defunct term 15: won
I20260709 13:06:37.395553 19559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ece3db938bc649d4a40a51522ed5259c" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:06:37.396322 19559 raft_consensus.cc:2393] T ece3db938bc649d4a40a51522ed5259c P e61c3a8f61bb48f8a963c9480e53c168 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e5256d91808b47c195bc9b4dbd7f2b87 in current term 12: Already voted for candidate e61c3a8f61bb48f8a963c9480e53c168 in this term.
I20260709 13:06:37.396762 19449 leader_election.cc:304] T 2b74109013a140ada21feeef92d6f563 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e; no voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:06:37.400074 24573 raft_consensus.cc:3060] T bc225c93219c45538b53a1bd3d387e4d P 0473d2b2d01f4459b1e90fd12cc7840e [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:06:37.397128 20112 raft_consensus.cc:1240] T 2a16f7501e2444fb86d4e2778e734e02 P 127766fc592545a4997f7790f50f6076 [term 15 FOLLOWER]: Rejecting Update request from peer e5256d91808b47c195bc9b4dbd7f2b87 for earlier term 14. Current term is 15. Ops: [14.12-14.12]
I20260709 13:06:37.406553 20105 raft_consensus.cc:2468] T 172b3dd13109415a955b71ac0e9d2234 P 127766fc592545a4997f7790f50f6076 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 14.
I20260709 13:06:37.409970 24756 raft_consensus.cc:493] T 0cdf56e38bbc453d9438d359e5a69955 P e5256d91808b47c195bc9b4dbd7f2b87 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:37.410739 24756 raft_consensus.cc:515] T 0cdf56e38bbc453d9438d359e5a69955 P e5256d91808b47c195bc9b4dbd7f2b87 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:37.413857 19556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dc5b3532fe54f74876d02beffa2c230" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:06:37.429556 19484 raft_consensus.cc:1240] T ef32ce6fdd0e40d382c79974f30295c6 P 0473d2b2d01f4459b1e90fd12cc7840e [term 18 LEADER]: Rejecting Update request from peer e5256d91808b47c195bc9b4dbd7f2b87 for earlier term 17. Current term is 18. Ops: [17.10-17.10]
I20260709 13:06:37.426777 19556 raft_consensus.cc:2468] T 1dc5b3532fe54f74876d02beffa2c230 P e61c3a8f61bb48f8a963c9480e53c168 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 16.
I20260709 13:06:37.428485 20109 raft_consensus.cc:2468] T ece3db938bc649d4a40a51522ed5259c P 127766fc592545a4997f7790f50f6076 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 12.
I20260709 13:06:37.433722 24887 raft_consensus.cc:2804] T ed7fdbcb96d14d418db9ca90a792588a P e61c3a8f61bb48f8a963c9480e53c168 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:06:37.434263 24887 raft_consensus.cc:493] T ed7fdbcb96d14d418db9ca90a792588a P e61c3a8f61bb48f8a963c9480e53c168 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 0473d2b2d01f4459b1e90fd12cc7840e)
I20260709 13:06:37.434638 24887 raft_consensus.cc:3060] T ed7fdbcb96d14d418db9ca90a792588a P e61c3a8f61bb48f8a963c9480e53c168 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:06:37.439913 24866 raft_consensus.cc:3060] T 21e14947d70440f19044d8f75c31e1f9 P e5256d91808b47c195bc9b4dbd7f2b87 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:06:37.440237 24276 leader_election.cc:290] T 2b74109013a140ada21feeef92d6f563 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
W20260709 13:06:37.443498 19523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.1:40321, user_credentials={real_user=slave}} blocked reactor thread for 49199.6us
I20260709 13:06:37.449719 19523 leader_election.cc:304] T b08304a0a02b42d7840c4e8ee9a6bd1a P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e61c3a8f61bb48f8a963c9480e53c168; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:06:37.421231 24372 leader_election.cc:290] T d1e5873a19244c5ebbcd38e126796ee7 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:06:37.337584 24626 consensus_queue.cc:260] T 9962423cb4e54fcfa5de01daf68a86e7 P 127766fc592545a4997f7790f50f6076 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:37.442554 19486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab43d85f64114d4ebf618930e43d9ed0" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:06:37.473654 19477 raft_consensus.cc:2468] T 96efeaaf1057492490e9a621f37e1a2d P 0473d2b2d01f4459b1e90fd12cc7840e [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 17.
W20260709 13:06:37.481405 19451 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:37.488435 19486 raft_consensus.cc:2468] T ab43d85f64114d4ebf618930e43d9ed0 P 0473d2b2d01f4459b1e90fd12cc7840e [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 16.
I20260709 13:06:37.432364 24812 raft_consensus.cc:493] T 6c5eebf646ad445a9d1b1adc319d7b16 P e61c3a8f61bb48f8a963c9480e53c168 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 0473d2b2d01f4459b1e90fd12cc7840e)
I20260709 13:06:37.479602 24626 raft_consensus.cc:3060] T 9962423cb4e54fcfa5de01daf68a86e7 P 127766fc592545a4997f7790f50f6076 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:06:37.476263 24876 raft_consensus.cc:3060] T 48824d5acfbc485ebf8c2d944e7202de P 0473d2b2d01f4459b1e90fd12cc7840e [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:06:37.484247 24276 raft_consensus.cc:2749] T 2b74109013a140ada21feeef92d6f563 P 0473d2b2d01f4459b1e90fd12cc7840e [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:06:37.510514 24790 raft_consensus.cc:2749] T b08304a0a02b42d7840c4e8ee9a6bd1a P e61c3a8f61bb48f8a963c9480e53c168 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
W20260709 13:06:37.519834 19377 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.2:46257, user_credentials={real_user=slave}} blocked reactor thread for 48043.3us
W20260709 13:06:37.525287 19449 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.1:40321, user_credentials={real_user=slave}} blocked reactor thread for 128672us
I20260709 13:06:37.546825 20076 leader_election.cc:304] T 2a16f7501e2444fb86d4e2778e734e02 P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 127766fc592545a4997f7790f50f6076; no voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168
W20260709 13:06:37.548622 20076 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.3:36891, user_credentials={real_user=slave}} blocked reactor thread for 51084.1us
W20260709 13:06:37.550488 20078 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.2:46257, user_credentials={real_user=slave}} blocked reactor thread for 123938us
I20260709 13:06:37.566931 24471 raft_consensus.cc:493] T fa8650e71aa14778b3d73721fc50d9fc P 0473d2b2d01f4459b1e90fd12cc7840e [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:37.568029 24471 raft_consensus.cc:515] T fa8650e71aa14778b3d73721fc50d9fc P 0473d2b2d01f4459b1e90fd12cc7840e [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
W20260709 13:06:37.566839 19376 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:37.572474 19410 raft_consensus.cc:1240] T 7be9efa6559648dbb5a0f7684c4542d1 P e5256d91808b47c195bc9b4dbd7f2b87 [term 14 FOLLOWER]: Rejecting Update request from peer 0473d2b2d01f4459b1e90fd12cc7840e for earlier term 13. Current term is 14. Ops: []
I20260709 13:06:37.566008 24887 raft_consensus.cc:515] T ed7fdbcb96d14d418db9ca90a792588a P e61c3a8f61bb48f8a963c9480e53c168 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:37.575222 24471 leader_election.cc:290] T fa8650e71aa14778b3d73721fc50d9fc P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
W20260709 13:06:37.579983 19526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.2:46257, user_credentials={real_user=slave}} blocked reactor thread for 229510us
I20260709 13:06:37.534505 19374 leader_election.cc:304] T 172b3dd13109415a955b71ac0e9d2234 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 127766fc592545a4997f7790f50f6076, e5256d91808b47c195bc9b4dbd7f2b87; no voters: 
W20260709 13:06:37.591758 19523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.1:40321, user_credentials={real_user=slave}} blocked reactor thread for 142183us
I20260709 13:06:37.584640 24630 consensus_queue.cc:1059] T 1efebf73c86e432baa55533136b6e12c P 127766fc592545a4997f7790f50f6076 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 }, Status: INVALID_TERM, Last received: 12.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.019s
I20260709 13:06:37.584739 24756 leader_election.cc:290] T 0cdf56e38bbc453d9438d359e5a69955 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:06:37.536384 24812 raft_consensus.cc:515] T 6c5eebf646ad445a9d1b1adc319d7b16 P e61c3a8f61bb48f8a963c9480e53c168 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:37.604930 24766 raft_consensus.cc:3055] T 1efebf73c86e432baa55533136b6e12c P 127766fc592545a4997f7790f50f6076 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:06:37.605553 24766 raft_consensus.cc:740] T 1efebf73c86e432baa55533136b6e12c P 127766fc592545a4997f7790f50f6076 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 127766fc592545a4997f7790f50f6076, State: Running, Role: LEADER
W20260709 13:06:37.607190 19374 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.4:43121, user_credentials={real_user=slave}} blocked reactor thread for 190982us
I20260709 13:06:37.611654 24821 raft_consensus.cc:2804] T 172b3dd13109415a955b71ac0e9d2234 P e5256d91808b47c195bc9b4dbd7f2b87 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:06:37.612349 24821 raft_consensus.cc:697] T 172b3dd13109415a955b71ac0e9d2234 P e5256d91808b47c195bc9b4dbd7f2b87 [term 14 LEADER]: Becoming Leader. State: Replica: e5256d91808b47c195bc9b4dbd7f2b87, State: Running, Role: LEADER
I20260709 13:06:37.613413 24821 consensus_queue.cc:237] T 172b3dd13109415a955b71ac0e9d2234 P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
W20260709 13:06:37.614344 24899 log.cc:927] Time spent T 3e1f505cb0f1427bbd698ac889d80821 P e61c3a8f61bb48f8a963c9480e53c168: Append to log took a long time: real 0.358s	user 0.000s	sys 0.003s
I20260709 13:06:37.614949 24824 consensus_queue.cc:1059] T 2a16f7501e2444fb86d4e2778e734e02 P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false }, Status: INVALID_TERM, Last received: 13.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:06:37.615953 19377 leader_election.cc:304] T f93ee515a9c14139bf566522ed8232f3 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87; no voters: e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:06:37.616120 24372 raft_consensus.cc:493] T fa8650e71aa14778b3d73721fc50d9fc P e5256d91808b47c195bc9b4dbd7f2b87 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:37.616364 24824 raft_consensus.cc:3055] T 2a16f7501e2444fb86d4e2778e734e02 P e5256d91808b47c195bc9b4dbd7f2b87 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:06:37.617007 24825 raft_consensus.cc:2804] T f93ee515a9c14139bf566522ed8232f3 P e5256d91808b47c195bc9b4dbd7f2b87 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:06:37.616771 24824 raft_consensus.cc:740] T 2a16f7501e2444fb86d4e2778e734e02 P e5256d91808b47c195bc9b4dbd7f2b87 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: e5256d91808b47c195bc9b4dbd7f2b87, State: Running, Role: LEADER
I20260709 13:06:37.616757 24372 raft_consensus.cc:515] T fa8650e71aa14778b3d73721fc50d9fc P e5256d91808b47c195bc9b4dbd7f2b87 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
W20260709 13:06:37.617925 24902 log.cc:927] Time spent T ff9b0eddd810459b82d91c60777c10eb P 127766fc592545a4997f7790f50f6076: Append to log took a long time: real 0.142s	user 0.003s	sys 0.000s
I20260709 13:06:37.618762 24824 consensus_queue.cc:260] T 2a16f7501e2444fb86d4e2778e734e02 P e5256d91808b47c195bc9b4dbd7f2b87 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.12, Last appended by leader: 12, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:37.620239 24824 raft_consensus.cc:3060] T 2a16f7501e2444fb86d4e2778e734e02 P e5256d91808b47c195bc9b4dbd7f2b87 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:06:37.620592 24372 leader_election.cc:290] T fa8650e71aa14778b3d73721fc50d9fc P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:06:37.617525 24825 raft_consensus.cc:493] T f93ee515a9c14139bf566522ed8232f3 P e5256d91808b47c195bc9b4dbd7f2b87 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:37.621307 24825 raft_consensus.cc:3060] T f93ee515a9c14139bf566522ed8232f3 P e5256d91808b47c195bc9b4dbd7f2b87 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:06:37.623131 19484 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58294 (request call id 2543) took 1592 ms. Trace:
I20260709 13:06:37.623536 19484 rpcz_store.cc:276] 0709 13:06:36.030911 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:36.416864 (+385953us) service_pool.cc:224] Handling call
0709 13:06:36.422083 (+  5219us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:37.430143 (+1008060us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:37.622804 (+192661us) spinlock_profiling.cc:243] Waited 1.01 s on lock 0x7b54000a9454. stack: 00007f4a79de9343 00007f4a79de9240 00007f4a797781d4 00007f4a834b6304 00007f4a834b6299 00007f4a7ce71571 00007f4a7cf08e01 00007f4a7cf0783e 00007f4a81ecc419 00007f4a7b443bd4 00007f4a7b443b62 00007f4a7b443a91 00007f4a7b443a0c 00007f4a7b442cc2 00007f4a7b24348c 00007f4a7b2428c6
0709 13:06:37.623038 (+   234us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2315410816}
I20260709 13:06:37.625718 24766 consensus_queue.cc:260] T 1efebf73c86e432baa55533136b6e12c P 127766fc592545a4997f7790f50f6076 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:37.627406 24766 raft_consensus.cc:3060] T 1efebf73c86e432baa55533136b6e12c P 127766fc592545a4997f7790f50f6076 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:06:37.626143 24875 raft_consensus.cc:3060] T 7be9efa6559648dbb5a0f7684c4542d1 P 0473d2b2d01f4459b1e90fd12cc7840e [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:06:37.635008 24758 raft_consensus.cc:493] T 85c494af21f9457a85da47b9bc70c1fd P 127766fc592545a4997f7790f50f6076 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:37.635841 24898 raft_consensus.cc:493] T 5ec1c4ce15e04c7e8c283a62179f2a64 P 0473d2b2d01f4459b1e90fd12cc7840e [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 127766fc592545a4997f7790f50f6076)
I20260709 13:06:37.635756 24758 raft_consensus.cc:515] T 85c494af21f9457a85da47b9bc70c1fd P 127766fc592545a4997f7790f50f6076 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:37.636575 24898 raft_consensus.cc:515] T 5ec1c4ce15e04c7e8c283a62179f2a64 P 0473d2b2d01f4459b1e90fd12cc7840e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:37.639896 24758 leader_election.cc:290] T 85c494af21f9457a85da47b9bc70c1fd P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:06:37.640569 24758 raft_consensus.cc:493] T 7be9efa6559648dbb5a0f7684c4542d1 P 127766fc592545a4997f7790f50f6076 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 0473d2b2d01f4459b1e90fd12cc7840e)
I20260709 13:06:37.605279 24691 raft_consensus.cc:2749] T 2a16f7501e2444fb86d4e2778e734e02 P 127766fc592545a4997f7790f50f6076 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:06:37.645707 19409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ec1c4ce15e04c7e8c283a62179f2a64" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:06:37.646800 19554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab43d85f64114d4ebf618930e43d9ed0" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:06:37.647712 19484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22196caba61445d3bec98a0aab3c337d" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:06:37.648041 19486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "172b3dd13109415a955b71ac0e9d2234" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:06:37.648399 19551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "309c3ca0ca4b4f3ba129752ea2cb293b" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:06:37.648623 19486 raft_consensus.cc:3060] T 172b3dd13109415a955b71ac0e9d2234 P 0473d2b2d01f4459b1e90fd12cc7840e [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:06:37.649035 19477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "179fd671030940b4b4a4e24bcc4aba0a" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:06:37.649608 19477 raft_consensus.cc:3060] T 179fd671030940b4b4a4e24bcc4aba0a P 0473d2b2d01f4459b1e90fd12cc7840e [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:06:37.650097 19482 raft_consensus.cc:1275] T 46c5bfeecc314717bffe987e6844b6d0 P 0473d2b2d01f4459b1e90fd12cc7840e [term 20 FOLLOWER]: Refusing update from remote peer e5256d91808b47c195bc9b4dbd7f2b87: Log matching property violated. Preceding OpId in replica: term: 19 index: 9. Preceding OpId from leader: term: 20 index: 10. (index mismatch)
I20260709 13:06:37.651029 24892 raft_consensus.cc:493] T 0cdf56e38bbc453d9438d359e5a69955 P 0473d2b2d01f4459b1e90fd12cc7840e [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:37.651683 24892 raft_consensus.cc:515] T 0cdf56e38bbc453d9438d359e5a69955 P 0473d2b2d01f4459b1e90fd12cc7840e [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
W20260709 13:06:37.652122 24909 log.cc:927] Time spent T bc225c93219c45538b53a1bd3d387e4d P e5256d91808b47c195bc9b4dbd7f2b87: Append to log took a long time: real 0.101s	user 0.001s	sys 0.000s
I20260709 13:06:37.663368 19477 raft_consensus.cc:2468] T 179fd671030940b4b4a4e24bcc4aba0a P 0473d2b2d01f4459b1e90fd12cc7840e [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 18.
I20260709 13:06:37.607282 24812 leader_election.cc:290] T 6c5eebf646ad445a9d1b1adc319d7b16 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:06:37.663627 19410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa8650e71aa14778b3d73721fc50d9fc" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:06:37.668324 19409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85c494af21f9457a85da47b9bc70c1fd" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 16 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:06:37.666859 19410 raft_consensus.cc:2468] T fa8650e71aa14778b3d73721fc50d9fc P e5256d91808b47c195bc9b4dbd7f2b87 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 14.
W20260709 13:06:37.660972 24895 log.cc:927] Time spent T 7f575b143b844aa096b50997dad3516a P e61c3a8f61bb48f8a963c9480e53c168: Append to log took a long time: real 0.345s	user 0.001s	sys 0.003s
W20260709 13:06:37.674599 19377 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.2:46257, user_credentials={real_user=slave}} blocked reactor thread for 59312.4us
I20260709 13:06:37.678334 19482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dc5b3532fe54f74876d02beffa2c230" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:06:37.679149 19482 raft_consensus.cc:2393] T 1dc5b3532fe54f74876d02beffa2c230 P 0473d2b2d01f4459b1e90fd12cc7840e [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e5256d91808b47c195bc9b4dbd7f2b87 in current term 16: Already voted for candidate 0473d2b2d01f4459b1e90fd12cc7840e in this term.
I20260709 13:06:37.683213 19402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cdf56e38bbc453d9438d359e5a69955" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:06:37.685859 19402 raft_consensus.cc:2468] T 0cdf56e38bbc453d9438d359e5a69955 P e5256d91808b47c195bc9b4dbd7f2b87 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 15.
I20260709 13:06:37.688478 19449 leader_election.cc:304] T fa8650e71aa14778b3d73721fc50d9fc P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87; no voters: 
I20260709 13:06:37.684158 20078 leader_election.cc:304] T 14efcc79969f41babe5529c22d59156d P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 127766fc592545a4997f7790f50f6076; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:06:37.661178 24372 consensus_queue.cc:1048] T 85c494af21f9457a85da47b9bc70c1fd P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Connected to new peer: Peer: permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.025s
I20260709 13:06:37.671615 24551 raft_consensus.cc:493] T f1b10566f45d4a7d9029858330e02d5b P e5256d91808b47c195bc9b4dbd7f2b87 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader e61c3a8f61bb48f8a963c9480e53c168)
I20260709 13:06:37.677083 24898 leader_election.cc:290] T 5ec1c4ce15e04c7e8c283a62179f2a64 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:06:37.696944 19405 raft_consensus.cc:1275] T 28af091831594f9d8e96482078cc7625 P e5256d91808b47c195bc9b4dbd7f2b87 [term 16 FOLLOWER]: Refusing update from remote peer 0473d2b2d01f4459b1e90fd12cc7840e: Log matching property violated. Preceding OpId in replica: term: 15 index: 8. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
I20260709 13:06:37.699422 19482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e5873a19244c5ebbcd38e126796ee7" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:06:37.692346 24276 raft_consensus.cc:2804] T fa8650e71aa14778b3d73721fc50d9fc P 0473d2b2d01f4459b1e90fd12cc7840e [term 14 FOLLOWER]: Leader pre-election won for term 15
W20260709 13:06:37.701371 19451 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:37.693005 24892 leader_election.cc:290] T 0cdf56e38bbc453d9438d359e5a69955 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:06:37.701715 19449 leader_election.cc:304] T 0cdf56e38bbc453d9438d359e5a69955 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87; no voters: 
I20260709 13:06:37.707598 19406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ece3db938bc649d4a40a51522ed5259c" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
I20260709 13:06:37.708175 19406 raft_consensus.cc:3060] T ece3db938bc649d4a40a51522ed5259c P e5256d91808b47c195bc9b4dbd7f2b87 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:06:37.706740 24824 consensus_queue.cc:1059] T e381f1d6b8184797ad142de49be225a8 P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 }, Status: INVALID_TERM, Last received: 10.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.003s
I20260709 13:06:37.704277 24691 raft_consensus.cc:2749] T 14efcc79969f41babe5529c22d59156d P 127766fc592545a4997f7790f50f6076 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:06:37.710058 24824 raft_consensus.cc:3055] T e381f1d6b8184797ad142de49be225a8 P e5256d91808b47c195bc9b4dbd7f2b87 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:06:37.710427 24824 raft_consensus.cc:740] T e381f1d6b8184797ad142de49be225a8 P e5256d91808b47c195bc9b4dbd7f2b87 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: e5256d91808b47c195bc9b4dbd7f2b87, State: Running, Role: LEADER
I20260709 13:06:37.681529 24758 raft_consensus.cc:515] T 7be9efa6559648dbb5a0f7684c4542d1 P 127766fc592545a4997f7790f50f6076 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } attrs { replace: true } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:37.713714 24824 consensus_queue.cc:260] T e381f1d6b8184797ad142de49be225a8 P e5256d91808b47c195bc9b4dbd7f2b87 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:37.704423 24276 raft_consensus.cc:493] T fa8650e71aa14778b3d73721fc50d9fc P 0473d2b2d01f4459b1e90fd12cc7840e [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:37.723284 19409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7be9efa6559648dbb5a0f7684c4542d1" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:06:37.712944 24898 raft_consensus.cc:2804] T 0cdf56e38bbc453d9438d359e5a69955 P 0473d2b2d01f4459b1e90fd12cc7840e [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:06:37.724466 24276 raft_consensus.cc:3060] T fa8650e71aa14778b3d73721fc50d9fc P 0473d2b2d01f4459b1e90fd12cc7840e [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:06:37.731421 24891 consensus_queue.cc:1048] T 28af091831594f9d8e96482078cc7625 P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.009s
I20260709 13:06:37.736794 19409 raft_consensus.cc:2393] T 7be9efa6559648dbb5a0f7684c4542d1 P e5256d91808b47c195bc9b4dbd7f2b87 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e61c3a8f61bb48f8a963c9480e53c168 in current term 14: Already voted for candidate e5256d91808b47c195bc9b4dbd7f2b87 in this term.
W20260709 13:06:37.735929 24903 log.cc:927] Time spent T 4509b76741dc428e9201c70c1658da13 P e61c3a8f61bb48f8a963c9480e53c168: Append to log took a long time: real 0.198s	user 0.000s	sys 0.001s
I20260709 13:06:37.738611 19526 leader_election.cc:304] T 46c5bfeecc314717bffe987e6844b6d0 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:06:37.745262 24798 raft_consensus.cc:515] T 40e1e16737a842ee936002830f36882e P e5256d91808b47c195bc9b4dbd7f2b87 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:37.748282 19486 raft_consensus.cc:2468] T 172b3dd13109415a955b71ac0e9d2234 P 0473d2b2d01f4459b1e90fd12cc7840e [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 14.
W20260709 13:06:37.748863 20078 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.2:46257, user_credentials={real_user=slave}} blocked reactor thread for 83192.2us
I20260709 13:06:37.727525 24898 raft_consensus.cc:493] T 0cdf56e38bbc453d9438d359e5a69955 P 0473d2b2d01f4459b1e90fd12cc7840e [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:37.751775 19375 leader_election.cc:304] T ece3db938bc649d4a40a51522ed5259c P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87; no voters: 127766fc592545a4997f7790f50f6076, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:06:37.765039 19306 catalog_manager.cc:5697] T ab43d85f64114d4ebf618930e43d9ed0 P 127766fc592545a4997f7790f50f6076 reported cstate change: term changed from 13 to 14, leader changed from e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3) to 127766fc592545a4997f7790f50f6076 (127.17.223.4), now has a pending config: VOTER 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2), VOTER e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3), VOTER 127766fc592545a4997f7790f50f6076 (127.17.223.4). New cstate: current_term: 14 leader_uuid: "127766fc592545a4997f7790f50f6076" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } attrs { replace: true } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } health_report { overall_health: HEALTHY } } } pending_config { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } } }
W20260709 13:06:37.774060 24904 log.cc:927] Time spent T ef32ce6fdd0e40d382c79974f30295c6 P 0473d2b2d01f4459b1e90fd12cc7840e: Append to log took a long time: real 0.198s	user 0.002s	sys 0.000s
I20260709 13:06:37.727213 24887 leader_election.cc:290] T ed7fdbcb96d14d418db9ca90a792588a P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 11 election: Requested vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:06:37.771836 24838 raft_consensus.cc:493] T fa8650e71aa14778b3d73721fc50d9fc P e61c3a8f61bb48f8a963c9480e53c168 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:37.765297 19526 leader_election.cc:304] T 96efeaaf1057492490e9a621f37e1a2d P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:06:37.750658 24867 consensus_queue.cc:1048] T 85c494af21f9457a85da47b9bc70c1fd P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:06:37.765267 24812 raft_consensus.cc:2804] T 46c5bfeecc314717bffe987e6844b6d0 P e61c3a8f61bb48f8a963c9480e53c168 [term 20 FOLLOWER]: Leader pre-election won for term 21
W20260709 13:06:37.768561 19305 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:44676 (request call id 223) took 18608 ms (client timeout 15000 ms). Trace:
I20260709 13:06:37.790632 19406 raft_consensus.cc:2468] T ece3db938bc649d4a40a51522ed5259c P e5256d91808b47c195bc9b4dbd7f2b87 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 12.
I20260709 13:06:37.726969 24795 consensus_queue.cc:1048] T f93ee515a9c14139bf566522ed8232f3 P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.084s
I20260709 13:06:37.765820 24888 consensus_queue.cc:1048] T b9f0d59553ad444883fcf5b5909f9798 P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:06:37.752600 24756 consensus_queue.cc:1048] T 46c5bfeecc314717bffe987e6844b6d0 P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.002s
I20260709 13:06:37.721550 24551 raft_consensus.cc:515] T f1b10566f45d4a7d9029858330e02d5b P e5256d91808b47c195bc9b4dbd7f2b87 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
W20260709 13:06:37.783726 24907 log.cc:927] Time spent T 179fd671030940b4b4a4e24bcc4aba0a P e61c3a8f61bb48f8a963c9480e53c168: Append to log took a long time: real 0.226s	user 0.002s	sys 0.000s
I20260709 13:06:37.776665 24825 raft_consensus.cc:515] T f93ee515a9c14139bf566522ed8232f3 P e5256d91808b47c195bc9b4dbd7f2b87 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:37.784898 24898 raft_consensus.cc:3060] T 0cdf56e38bbc453d9438d359e5a69955 P 0473d2b2d01f4459b1e90fd12cc7840e [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:06:37.802901 19306 catalog_manager.cc:5697] T 1efebf73c86e432baa55533136b6e12c P 127766fc592545a4997f7790f50f6076 reported cstate change: term changed from 9 to 12, leader changed from e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3) to 127766fc592545a4997f7790f50f6076 (127.17.223.4). New cstate: current_term: 12 leader_uuid: "127766fc592545a4997f7790f50f6076" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:06:37.807077 19482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cdf56e38bbc453d9438d359e5a69955" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:06:37.788947 24812 raft_consensus.cc:493] T 46c5bfeecc314717bffe987e6844b6d0 P e61c3a8f61bb48f8a963c9480e53c168 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:37.800088 24823 raft_consensus.cc:2749] T ece3db938bc649d4a40a51522ed5259c P e5256d91808b47c195bc9b4dbd7f2b87 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:06:37.815761 19375 leader_election.cc:304] T 1dc5b3532fe54f74876d02beffa2c230 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:06:37.802906 24824 raft_consensus.cc:3060] T e381f1d6b8184797ad142de49be225a8 P e5256d91808b47c195bc9b4dbd7f2b87 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:06:37.820070 24887 raft_consensus.cc:2804] T 96efeaaf1057492490e9a621f37e1a2d P e61c3a8f61bb48f8a963c9480e53c168 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:06:37.786540 24700 raft_consensus.cc:515] T 3e1f505cb0f1427bbd698ac889d80821 P e61c3a8f61bb48f8a963c9480e53c168 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
W20260709 13:06:37.822311 19523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.1:40321, user_credentials={real_user=slave}} blocked reactor thread for 96321.3us
I20260709 13:06:37.823846 19560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa8650e71aa14778b3d73721fc50d9fc" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:06:37.824000 19558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cdf56e38bbc453d9438d359e5a69955" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:06:37.824714 19558 raft_consensus.cc:2468] T 0cdf56e38bbc453d9438d359e5a69955 P e61c3a8f61bb48f8a963c9480e53c168 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 15.
W20260709 13:06:37.825345 24908 log.cc:927] Time spent T 2b74109013a140ada21feeef92d6f563 P e61c3a8f61bb48f8a963c9480e53c168: Append to log took a long time: real 0.107s	user 0.000s	sys 0.001s
I20260709 13:06:37.825867 19405 raft_consensus.cc:1275] T ff9b0eddd810459b82d91c60777c10eb P e5256d91808b47c195bc9b4dbd7f2b87 [term 16 FOLLOWER]: Refusing update from remote peer 127766fc592545a4997f7790f50f6076: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
W20260709 13:06:37.826771 20077 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:37.828168 19523 leader_election.cc:304] T 65d8cb8d6ec64f459d5a47cefab10acf P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
W20260709 13:06:37.829217 24905 log.cc:927] Time spent T 217b5fae677b4971b3bbd2f357a1f7ff P 0473d2b2d01f4459b1e90fd12cc7840e: Append to log took a long time: real 0.270s	user 0.000s	sys 0.004s
I20260709 13:06:37.830066 24861 raft_consensus.cc:493] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P 0473d2b2d01f4459b1e90fd12cc7840e [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 127766fc592545a4997f7790f50f6076)
I20260709 13:06:37.830700 24861 raft_consensus.cc:515] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P 0473d2b2d01f4459b1e90fd12cc7840e [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:37.832159 24758 leader_election.cc:290] T 7be9efa6559648dbb5a0f7684c4542d1 P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:06:37.832985 24861 leader_election.cc:290] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:06:37.834203 24825 leader_election.cc:290] T f93ee515a9c14139bf566522ed8232f3 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 17 election: Requested vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:06:37.835894 24798 leader_election.cc:290] T 40e1e16737a842ee936002830f36882e P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 17 election: Requested vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:06:37.838891 24887 raft_consensus.cc:697] T 96efeaaf1057492490e9a621f37e1a2d P e61c3a8f61bb48f8a963c9480e53c168 [term 17 LEADER]: Becoming Leader. State: Replica: e61c3a8f61bb48f8a963c9480e53c168, State: Running, Role: LEADER
W20260709 13:06:37.790206 19305 rpcz_store.cc:269] 0709 13:06:19.159563 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:19.163100 (+  3537us) service_pool.cc:224] Handling call
0709 13:06:37.768312 (+18605212us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:06:30.136195 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:06:30.450151 (+313956us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:06:30.471475 (+ 21324us) write_op.cc:435] Acquired schema lock
0709 13:06:30.471503 (+    28us) tablet.cc:662] Decoding operations
0709 13:06:30.473520 (+  2017us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:06:30.473618 (+    98us) write_op.cc:641] Partition lock acquired for write op
0709 13:06:30.473645 (+    27us) tablet.cc:685] Acquiring locks for 24 operations
0709 13:06:30.667424 (+193779us) tablet.cc:701] Row locks acquired
0709 13:06:30.667489 (+    65us) write_op.cc:260] PREPARE: finished
0709 13:06:30.667650 (+   161us) write_op.cc:270] Start()
0709 13:06:30.667800 (+   150us) write_op.cc:276] Timestamp: P: 1783602390667586 usec, L: 0
0709 13:06:30.667821 (+    21us) op_driver.cc:348] REPLICATION: starting
0709 13:06:30.668533 (+   712us) log.cc:844] Serialized 9506 byte log entry
0709 13:06:31.916253 (+1247720us) op_driver.cc:464] REPLICATION: finished
0709 13:06:32.088552 (+172299us) write_op.cc:301] APPLY: starting
0709 13:06:32.092146 (+  3594us) tablet.cc:1367] starting BulkCheckPresence
0709 13:06:32.440760 (+348614us) tablet.cc:1370] finished BulkCheckPresence
0709 13:06:32.440854 (+    94us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:06:32.903964 (+463110us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:06:32.904301 (+   337us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=48,key_file_lookups=48,delta_file_lookups=48,mrs_lookups=0
0709 13:06:32.904346 (+    45us) write_op.cc:312] APPLY: finished
0709 13:06:32.904805 (+   459us) log.cc:844] Serialized 212 byte log entry
0709 13:06:33.464011 (+559206us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:06:33.468576 (+  4565us) write_op.cc:454] Released schema lock
0709 13:06:33.474907 (+  6331us) write_op.cc:341] FINISH: Updating metrics
0709 13:06:33.508692 (+ 33785us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:06:33.511352 (+  2660us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":651373,"reported_tablets":51,"child_traces":[["op",{"apply.queue_time_us":157455,"apply.run_cpu_time_us":69297,"apply.run_wall_time_us":1420771,"cfile_cache_hit":98,"cfile_cache_hit_bytes":104447,"num_ops":24,"prepare.queue_time_us":581960,"prepare.run_cpu_time_us":47898,"prepare.run_wall_time_us":761129,"raft.queue_time_us":294450,"raft.run_cpu_time_us":26655,"raft.run_wall_time_us":111818,"replication_time_us":1248278,"thread_start_us":760507,"threads_started":5,"wal-append.queue_time_us":874911,"wal-append.run_cpu_time_us":51662,"wal-append.run_wall_time_us":2960802}]]}
I20260709 13:06:37.839923 24887 consensus_queue.cc:237] T 96efeaaf1057492490e9a621f37e1a2d P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.11, Last appended by leader: 11, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:37.843431 19406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7be9efa6559648dbb5a0f7684c4542d1" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:06:37.812364 24812 raft_consensus.cc:3060] T 46c5bfeecc314717bffe987e6844b6d0 P e61c3a8f61bb48f8a963c9480e53c168 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:06:37.844369 19406 raft_consensus.cc:2393] T 7be9efa6559648dbb5a0f7684c4542d1 P e5256d91808b47c195bc9b4dbd7f2b87 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 127766fc592545a4997f7790f50f6076 in current term 14: Already voted for candidate e5256d91808b47c195bc9b4dbd7f2b87 in this term.
I20260709 13:06:37.844231 19377 leader_election.cc:304] T b08304a0a02b42d7840c4e8ee9a6bd1a P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:06:37.846549 19526 leader_election.cc:304] T ab43d85f64114d4ebf618930e43d9ed0 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168; no voters: 127766fc592545a4997f7790f50f6076
I20260709 13:06:37.789816 24838 raft_consensus.cc:515] T fa8650e71aa14778b3d73721fc50d9fc P e61c3a8f61bb48f8a963c9480e53c168 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:37.820840 24372 raft_consensus.cc:2804] T 1dc5b3532fe54f74876d02beffa2c230 P e5256d91808b47c195bc9b4dbd7f2b87 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:06:37.856568 19405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36f6ba92b9ba46babe4ebd6c02e5fbd9" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:06:37.856637 19306 catalog_manager.cc:5697] T 62c6c134d3d24a1ab144dd9ee6bc3f64 P 127766fc592545a4997f7790f50f6076 reported cstate change: term changed from 10 to 13, leader changed from e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3) to 127766fc592545a4997f7790f50f6076 (127.17.223.4). New cstate: current_term: 13 leader_uuid: "127766fc592545a4997f7790f50f6076" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:06:37.857607 24837 raft_consensus.cc:2804] T 65d8cb8d6ec64f459d5a47cefab10acf P e61c3a8f61bb48f8a963c9480e53c168 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:06:37.865417 24837 raft_consensus.cc:493] T 65d8cb8d6ec64f459d5a47cefab10acf P e61c3a8f61bb48f8a963c9480e53c168 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:37.865818 24837 raft_consensus.cc:3060] T 65d8cb8d6ec64f459d5a47cefab10acf P e61c3a8f61bb48f8a963c9480e53c168 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:06:37.866611 24838 leader_election.cc:290] T fa8650e71aa14778b3d73721fc50d9fc P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:06:37.869886 24859 consensus_queue.cc:1048] T ff9b0eddd810459b82d91c60777c10eb P 127766fc592545a4997f7790f50f6076 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
W20260709 13:06:37.870514 19526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.2:46257, user_credentials={real_user=slave}} blocked reactor thread for 50963.5us
I20260709 13:06:37.874410 24866 raft_consensus.cc:2749] T b08304a0a02b42d7840c4e8ee9a6bd1a P e5256d91808b47c195bc9b4dbd7f2b87 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
W20260709 13:06:37.874984 20078 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.2:46257, user_credentials={real_user=slave}} blocked reactor thread for 73813.8us
W20260709 13:06:37.876361 19377 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.2:46257, user_credentials={real_user=slave}} blocked reactor thread for 59193.6us
I20260709 13:06:37.861003 19450 leader_election.cc:304] T f1b10566f45d4a7d9029858330e02d5b P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e; no voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:06:37.861270 19560 raft_consensus.cc:2468] T fa8650e71aa14778b3d73721fc50d9fc P e61c3a8f61bb48f8a963c9480e53c168 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 14.
W20260709 13:06:37.880910 19523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.1:40321, user_credentials={real_user=slave}} blocked reactor thread for 51469.2us
W20260709 13:06:37.883126 19375 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:37.884356 19486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df751f992649444090e27965eb1af85d" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:06:37.883261 19553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa8650e71aa14778b3d73721fc50d9fc" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:06:37.855036 24372 raft_consensus.cc:493] T 1dc5b3532fe54f74876d02beffa2c230 P e5256d91808b47c195bc9b4dbd7f2b87 [term 15 FOLLOWER]: Starting leader election (detected failure of leader e61c3a8f61bb48f8a963c9480e53c168)
W20260709 13:06:37.887522 24906 log.cc:927] Time spent T f1b10566f45d4a7d9029858330e02d5b P e61c3a8f61bb48f8a963c9480e53c168: Append to log took a long time: real 0.151s	user 0.001s	sys 0.000s
I20260709 13:06:37.888069 19559 raft_consensus.cc:1275] T bc225c93219c45538b53a1bd3d387e4d P e61c3a8f61bb48f8a963c9480e53c168 [term 14 FOLLOWER]: Refusing update from remote peer e5256d91808b47c195bc9b4dbd7f2b87: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 13:06:37.889163 19551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e5873a19244c5ebbcd38e126796ee7" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:06:37.889671 24756 raft_consensus.cc:493] T 2b74109013a140ada21feeef92d6f563 P e5256d91808b47c195bc9b4dbd7f2b87 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader e61c3a8f61bb48f8a963c9480e53c168)
I20260709 13:06:37.890393 19481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14935b3ddf914369822e4a0547aaa355" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:06:37.890302 24756 raft_consensus.cc:515] T 2b74109013a140ada21feeef92d6f563 P e5256d91808b47c195bc9b4dbd7f2b87 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:37.891986 19483 raft_consensus.cc:1240] T 179fd671030940b4b4a4e24bcc4aba0a P 0473d2b2d01f4459b1e90fd12cc7840e [term 18 FOLLOWER]: Rejecting Update request from peer e61c3a8f61bb48f8a963c9480e53c168 for earlier term 17. Current term is 18. Ops: [17.10-17.10]
I20260709 13:06:37.892421 24756 leader_election.cc:290] T 2b74109013a140ada21feeef92d6f563 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
W20260709 13:06:37.896375 24871 consensus_meta.cc:287] T a08760e15aac4630a629431f56024dc8 P 0473d2b2d01f4459b1e90fd12cc7840e: Time spent flushing consensus metadata: real 0.571s	user 0.009s	sys 0.006s
I20260709 13:06:37.897917 19558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cdf56e38bbc453d9438d359e5a69955" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:06:37.898768 19558 raft_consensus.cc:2468] T 0cdf56e38bbc453d9438d359e5a69955 P e61c3a8f61bb48f8a963c9480e53c168 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 15.
I20260709 13:06:37.898737 19306 catalog_manager.cc:5697] T 775c229504194560ba9589bc2199b089 P 127766fc592545a4997f7790f50f6076 reported cstate change: term changed from 6 to 11. New cstate: current_term: 11 leader_uuid: "127766fc592545a4997f7790f50f6076" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:06:37.900194 24372 raft_consensus.cc:3060] T 1dc5b3532fe54f74876d02beffa2c230 P e5256d91808b47c195bc9b4dbd7f2b87 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:06:37.905367 24795 raft_consensus.cc:2804] T ab43d85f64114d4ebf618930e43d9ed0 P e61c3a8f61bb48f8a963c9480e53c168 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:06:37.912271 24795 raft_consensus.cc:493] T ab43d85f64114d4ebf618930e43d9ed0 P e61c3a8f61bb48f8a963c9480e53c168 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 0473d2b2d01f4459b1e90fd12cc7840e)
I20260709 13:06:37.912688 24795 raft_consensus.cc:3060] T ab43d85f64114d4ebf618930e43d9ed0 P e61c3a8f61bb48f8a963c9480e53c168 [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:06:37.902024 24912 log.cc:927] Time spent T 22196caba61445d3bec98a0aab3c337d P e61c3a8f61bb48f8a963c9480e53c168: Append to log took a long time: real 0.109s	user 0.000s	sys 0.001s
I20260709 13:06:37.901859 19481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c5eebf646ad445a9d1b1adc319d7b16" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:06:37.914767 19481 raft_consensus.cc:2468] T 6c5eebf646ad445a9d1b1adc319d7b16 P 0473d2b2d01f4459b1e90fd12cc7840e [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 15.
I20260709 13:06:37.901517 24781 raft_consensus.cc:493] T 28af091831594f9d8e96482078cc7625 P e61c3a8f61bb48f8a963c9480e53c168 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:37.919324 24781 raft_consensus.cc:515] T 28af091831594f9d8e96482078cc7625 P e61c3a8f61bb48f8a963c9480e53c168 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:37.920578 19554 raft_consensus.cc:1275] T 28af091831594f9d8e96482078cc7625 P e61c3a8f61bb48f8a963c9480e53c168 [term 16 FOLLOWER]: Refusing update from remote peer 0473d2b2d01f4459b1e90fd12cc7840e: Log matching property violated. Preceding OpId in replica: term: 15 index: 8. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
W20260709 13:06:37.923126 24910 log.cc:927] Time spent T b9f0d59553ad444883fcf5b5909f9798 P e61c3a8f61bb48f8a963c9480e53c168: Append to log took a long time: real 0.175s	user 0.001s	sys 0.000s
I20260709 13:06:37.929059 19481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed7fdbcb96d14d418db9ca90a792588a" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:06:37.930080 19481 raft_consensus.cc:2393] T ed7fdbcb96d14d418db9ca90a792588a P 0473d2b2d01f4459b1e90fd12cc7840e [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate e61c3a8f61bb48f8a963c9480e53c168 in current term 11: Already voted for candidate 127766fc592545a4997f7790f50f6076 in this term.
I20260709 13:06:37.929143 20078 leader_election.cc:304] T ed7fdbcb96d14d418db9ca90a792588a P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, 127766fc592545a4997f7790f50f6076; no voters: e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:06:37.931216 19484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7be9efa6559648dbb5a0f7684c4542d1" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:06:37.933629 19558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f93ee515a9c14139bf566522ed8232f3" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 17 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:06:37.932065 19484 raft_consensus.cc:2468] T 7be9efa6559648dbb5a0f7684c4542d1 P 0473d2b2d01f4459b1e90fd12cc7840e [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 14.
I20260709 13:06:37.936293 19553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40e1e16737a842ee936002830f36882e" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:06:37.936978 19553 raft_consensus.cc:3060] T 40e1e16737a842ee936002830f36882e P e61c3a8f61bb48f8a963c9480e53c168 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:06:37.901479 19486 raft_consensus.cc:2468] T df751f992649444090e27965eb1af85d P 0473d2b2d01f4459b1e90fd12cc7840e [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 18.
I20260709 13:06:37.940161 19480 raft_consensus.cc:1275] T edd7d470b5014c9489be7f41f64355c9 P 0473d2b2d01f4459b1e90fd12cc7840e [term 16 FOLLOWER]: Refusing update from remote peer e61c3a8f61bb48f8a963c9480e53c168: Log matching property violated. Preceding OpId in replica: term: 15 index: 8. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
W20260709 13:06:37.947777 19450 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.3:36891, user_credentials={real_user=slave}} blocked reactor thread for 94142.6us
I20260709 13:06:37.903986 24866 raft_consensus.cc:493] T b9f0d59553ad444883fcf5b5909f9798 P e5256d91808b47c195bc9b4dbd7f2b87 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader e61c3a8f61bb48f8a963c9480e53c168)
I20260709 13:06:37.953155 24859 raft_consensus.cc:2804] T ed7fdbcb96d14d418db9ca90a792588a P 127766fc592545a4997f7790f50f6076 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:06:37.955448 24551 leader_election.cc:290] T f1b10566f45d4a7d9029858330e02d5b P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:06:37.957825 19560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b74109013a140ada21feeef92d6f563" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:06:37.958588 19559 raft_consensus.cc:1240] T 3e1f505cb0f1427bbd698ac889d80821 P e61c3a8f61bb48f8a963c9480e53c168 [term 17 FOLLOWER]: Rejecting Update request from peer e5256d91808b47c195bc9b4dbd7f2b87 for earlier term 16. Current term is 17. Ops: []
I20260709 13:06:37.959193 24790 raft_consensus.cc:493] T 833a2f0775ed407a94b8924ce50adb63 P e61c3a8f61bb48f8a963c9480e53c168 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 127766fc592545a4997f7790f50f6076)
I20260709 13:06:37.959853 24790 raft_consensus.cc:515] T 833a2f0775ed407a94b8924ce50adb63 P e61c3a8f61bb48f8a963c9480e53c168 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:37.960384 24838 raft_consensus.cc:493] T 309c3ca0ca4b4f3ba129752ea2cb293b P e61c3a8f61bb48f8a963c9480e53c168 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 127766fc592545a4997f7790f50f6076)
I20260709 13:06:37.961004 24838 raft_consensus.cc:515] T 309c3ca0ca4b4f3ba129752ea2cb293b P e61c3a8f61bb48f8a963c9480e53c168 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } attrs { replace: true } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:37.962172 24790 leader_election.cc:290] T 833a2f0775ed407a94b8924ce50adb63 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:06:37.963346 24700 leader_election.cc:290] T 3e1f505cb0f1427bbd698ac889d80821 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 17 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:06:37.964057 24700 raft_consensus.cc:493] T fa731b585f684a7fb2d106c50f143b83 P e61c3a8f61bb48f8a963c9480e53c168 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 127766fc592545a4997f7790f50f6076)
I20260709 13:06:37.964777 19375 leader_election.cc:304] T 0cdf56e38bbc453d9438d359e5a69955 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:06:37.964638 24700 raft_consensus.cc:515] T fa731b585f684a7fb2d106c50f143b83 P e61c3a8f61bb48f8a963c9480e53c168 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:37.965497 24597 consensus_queue.cc:1048] T bc225c93219c45538b53a1bd3d387e4d P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:06:37.943653 19523 leader_election.cc:304] T ece3db938bc649d4a40a51522ed5259c P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:06:37.935555 24471 raft_consensus.cc:493] T b9f0d59553ad444883fcf5b5909f9798 P 0473d2b2d01f4459b1e90fd12cc7840e [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:06:37.970701 19376 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:37.983916 19559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1b10566f45d4a7d9029858330e02d5b" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:06:37.987378 19481 raft_consensus.cc:1275] T 21e14947d70440f19044d8f75c31e1f9 P 0473d2b2d01f4459b1e90fd12cc7840e [term 15 FOLLOWER]: Refusing update from remote peer e61c3a8f61bb48f8a963c9480e53c168: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 13:06:37.966889 24597 raft_consensus.cc:2804] T 0cdf56e38bbc453d9438d359e5a69955 P e5256d91808b47c195bc9b4dbd7f2b87 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:06:38.005046 19306 catalog_manager.cc:5697] T 0e1085d23e8347fbbd5bce7542f4b1f4 P 127766fc592545a4997f7790f50f6076 reported cstate change: term changed from 8 to 11, leader changed from e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3) to 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2). New cstate: current_term: 11 leader_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } } }
I20260709 13:06:37.973867 24859 raft_consensus.cc:697] T ed7fdbcb96d14d418db9ca90a792588a P 127766fc592545a4997f7790f50f6076 [term 11 LEADER]: Becoming Leader. State: Replica: 127766fc592545a4997f7790f50f6076, State: Running, Role: LEADER
I20260709 13:06:38.016482 19410 raft_consensus.cc:1240] T f93ee515a9c14139bf566522ed8232f3 P e5256d91808b47c195bc9b4dbd7f2b87 [term 17 FOLLOWER]: Rejecting Update request from peer e61c3a8f61bb48f8a963c9480e53c168 for earlier term 16. Current term is 17. Ops: [16.8-16.8]
I20260709 13:06:38.017524 19450 leader_election.cc:304] T 309c3ca0ca4b4f3ba129752ea2cb293b P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e; no voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:06:37.997510 24790 raft_consensus.cc:2804] T ece3db938bc649d4a40a51522ed5259c P e61c3a8f61bb48f8a963c9480e53c168 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:06:38.027340 24790 raft_consensus.cc:697] T ece3db938bc649d4a40a51522ed5259c P e61c3a8f61bb48f8a963c9480e53c168 [term 12 LEADER]: Becoming Leader. State: Replica: e61c3a8f61bb48f8a963c9480e53c168, State: Running, Role: LEADER
I20260709 13:06:38.028291 24790 consensus_queue.cc:237] T ece3db938bc649d4a40a51522ed5259c P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:38.029099 19485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e1f505cb0f1427bbd698ac889d80821" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:06:38.035302 24812 raft_consensus.cc:515] T 46c5bfeecc314717bffe987e6844b6d0 P e61c3a8f61bb48f8a963c9480e53c168 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:38.038637 24859 consensus_queue.cc:237] T ed7fdbcb96d14d418db9ca90a792588a P 127766fc592545a4997f7790f50f6076 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:38.041081 19554 raft_consensus.cc:1240] T 46c5bfeecc314717bffe987e6844b6d0 P e61c3a8f61bb48f8a963c9480e53c168 [term 21 FOLLOWER]: Rejecting Update request from peer e5256d91808b47c195bc9b4dbd7f2b87 for earlier term 20. Current term is 21. Ops: [20.10-20.10]
I20260709 13:06:38.003630 24597 raft_consensus.cc:493] T 0cdf56e38bbc453d9438d359e5a69955 P e5256d91808b47c195bc9b4dbd7f2b87 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:38.023309 19306 catalog_manager.cc:5697] T 0afb57ae58a24a01850491d69f0213dd P 127766fc592545a4997f7790f50f6076 reported cstate change: term changed from 10 to 12. New cstate: current_term: 12 leader_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } } }
I20260709 13:06:37.987973 24798 consensus_queue.cc:1059] T 3e1f505cb0f1427bbd698ac889d80821 P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 }, Status: INVALID_TERM, Last received: 16.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.039s
W20260709 13:06:38.026726 19377 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.2:46257, user_credentials={real_user=slave}} blocked reactor thread for 80346.5us
I20260709 13:06:37.976570 24758 consensus_queue.cc:1059] T 309c3ca0ca4b4f3ba129752ea2cb293b P 127766fc592545a4997f7790f50f6076 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.035s
I20260709 13:06:38.064392 19553 raft_consensus.cc:2468] T 40e1e16737a842ee936002830f36882e P e61c3a8f61bb48f8a963c9480e53c168 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 17.
I20260709 13:06:38.065754 19402 raft_consensus.cc:1275] T edd7d470b5014c9489be7f41f64355c9 P e5256d91808b47c195bc9b4dbd7f2b87 [term 16 FOLLOWER]: Refusing update from remote peer e61c3a8f61bb48f8a963c9480e53c168: Log matching property violated. Preceding OpId in replica: term: 14 index: 7. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
I20260709 13:06:38.067067 19406 raft_consensus.cc:1275] T 21e14947d70440f19044d8f75c31e1f9 P e5256d91808b47c195bc9b4dbd7f2b87 [term 15 FOLLOWER]: Refusing update from remote peer e61c3a8f61bb48f8a963c9480e53c168: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 13:06:38.069415 19406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa8650e71aa14778b3d73721fc50d9fc" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:06:38.070237 19406 raft_consensus.cc:2468] T fa8650e71aa14778b3d73721fc50d9fc P e5256d91808b47c195bc9b4dbd7f2b87 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 14.
W20260709 13:06:38.071656 19450 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.3:36891, user_credentials={real_user=slave}} blocked reactor thread for 61587.3us
I20260709 13:06:38.025952 24898 raft_consensus.cc:515] T 0cdf56e38bbc453d9438d359e5a69955 P 0473d2b2d01f4459b1e90fd12cc7840e [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:38.047250 19526 leader_election.cc:304] T 14935b3ddf914369822e4a0547aaa355 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: e61c3a8f61bb48f8a963c9480e53c168; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:06:38.066569 20112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed7fdbcb96d14d418db9ca90a792588a" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076"
I20260709 13:06:38.074448 19481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa8650e71aa14778b3d73721fc50d9fc" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:06:38.076437 19405 raft_consensus.cc:1240] T 22196caba61445d3bec98a0aab3c337d P e5256d91808b47c195bc9b4dbd7f2b87 [term 14 FOLLOWER]: Rejecting Update request from peer e61c3a8f61bb48f8a963c9480e53c168 for earlier term 13. Current term is 14. Ops: []
I20260709 13:06:38.046507 24597 raft_consensus.cc:3060] T 0cdf56e38bbc453d9438d359e5a69955 P e5256d91808b47c195bc9b4dbd7f2b87 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:06:38.003005 24471 raft_consensus.cc:515] T b9f0d59553ad444883fcf5b5909f9798 P 0473d2b2d01f4459b1e90fd12cc7840e [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:38.078926 20105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c5eebf646ad445a9d1b1adc319d7b16" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:06:38.002907 24866 raft_consensus.cc:515] T b9f0d59553ad444883fcf5b5909f9798 P e5256d91808b47c195bc9b4dbd7f2b87 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:38.046703 24871 raft_consensus.cc:493] T d1e5873a19244c5ebbcd38e126796ee7 P 0473d2b2d01f4459b1e90fd12cc7840e [term 17 FOLLOWER]: Starting pre-election (detected failure of leader e61c3a8f61bb48f8a963c9480e53c168)
I20260709 13:06:38.080355 19411 raft_consensus.cc:1240] T 179fd671030940b4b4a4e24bcc4aba0a P e5256d91808b47c195bc9b4dbd7f2b87 [term 18 FOLLOWER]: Rejecting Update request from peer e61c3a8f61bb48f8a963c9480e53c168 for earlier term 17. Current term is 18. Ops: []
I20260709 13:06:38.076023 19306 catalog_manager.cc:5697] T 2a16f7501e2444fb86d4e2778e734e02 P 127766fc592545a4997f7790f50f6076 reported cstate change: term changed from 12 to 13, leader changed from e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1) to 127766fc592545a4997f7790f50f6076 (127.17.223.4). New cstate: current_term: 13 leader_uuid: "127766fc592545a4997f7790f50f6076" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:06:38.068018 24876 raft_consensus.cc:2749] T f1b10566f45d4a7d9029858330e02d5b P 0473d2b2d01f4459b1e90fd12cc7840e [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:06:38.087556 19482 raft_consensus.cc:2393] T 0cdf56e38bbc453d9438d359e5a69955 P 0473d2b2d01f4459b1e90fd12cc7840e [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e5256d91808b47c195bc9b4dbd7f2b87 in current term 16: Already voted for candidate 0473d2b2d01f4459b1e90fd12cc7840e in this term.
I20260709 13:06:38.091187 19526 leader_election.cc:304] T 6c5eebf646ad445a9d1b1adc319d7b16 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
W20260709 13:06:38.093410 19451 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:38.094514 19405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "833a2f0775ed407a94b8924ce50adb63" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:06:38.095782 19486 raft_consensus.cc:1275] T 7f575b143b844aa096b50997dad3516a P 0473d2b2d01f4459b1e90fd12cc7840e [term 11 FOLLOWER]: Refusing update from remote peer e61c3a8f61bb48f8a963c9480e53c168: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 13:06:38.098199 19526 leader_election.cc:304] T df751f992649444090e27965eb1af85d P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168; no voters: e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:06:38.082593 24861 raft_consensus.cc:2749] T 309c3ca0ca4b4f3ba129752ea2cb293b P 0473d2b2d01f4459b1e90fd12cc7840e [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:06:38.104151 19403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa731b585f684a7fb2d106c50f143b83" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:06:38.104897 20105 raft_consensus.cc:2393] T 6c5eebf646ad445a9d1b1adc319d7b16 P 127766fc592545a4997f7790f50f6076 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e61c3a8f61bb48f8a963c9480e53c168 in current term 15: Already voted for candidate 127766fc592545a4997f7790f50f6076 in this term.
I20260709 13:06:38.106168 19407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e1f505cb0f1427bbd698ac889d80821" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
I20260709 13:06:38.111359 24838 leader_election.cc:290] T 309c3ca0ca4b4f3ba129752ea2cb293b P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:06:38.115357 19306 catalog_manager.cc:5697] T 65d8cb8d6ec64f459d5a47cefab10acf P 127766fc592545a4997f7790f50f6076 reported cstate change: term changed from 6 to 13. New cstate: current_term: 13 leader_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } } }
I20260709 13:06:38.117125 19306 catalog_manager.cc:5697] T 833a2f0775ed407a94b8924ce50adb63 P 127766fc592545a4997f7790f50f6076 reported cstate change: term changed from 11 to 13, leader changed from e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1) to 127766fc592545a4997f7790f50f6076 (127.17.223.4). New cstate: current_term: 13 leader_uuid: "127766fc592545a4997f7790f50f6076" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:06:38.117704 24837 raft_consensus.cc:515] T 65d8cb8d6ec64f459d5a47cefab10acf P e61c3a8f61bb48f8a963c9480e53c168 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:38.119976 20109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "172b3dd13109415a955b71ac0e9d2234" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:06:38.120798 20109 raft_consensus.cc:2393] T 172b3dd13109415a955b71ac0e9d2234 P 127766fc592545a4997f7790f50f6076 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0473d2b2d01f4459b1e90fd12cc7840e in current term 14: Already voted for candidate e5256d91808b47c195bc9b4dbd7f2b87 in this term.
I20260709 13:06:38.122328 20111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36f6ba92b9ba46babe4ebd6c02e5fbd9" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:06:38.123266 20104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "309c3ca0ca4b4f3ba129752ea2cb293b" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076"
I20260709 13:06:38.124130 19449 leader_election.cc:304] T 172b3dd13109415a955b71ac0e9d2234 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e; no voters: 127766fc592545a4997f7790f50f6076, e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:06:38.124466 20106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab43d85f64114d4ebf618930e43d9ed0" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:06:38.125216 20106 raft_consensus.cc:2393] T ab43d85f64114d4ebf618930e43d9ed0 P 127766fc592545a4997f7790f50f6076 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0473d2b2d01f4459b1e90fd12cc7840e in current term 17: Already voted for candidate 127766fc592545a4997f7790f50f6076 in this term.
I20260709 13:06:38.135066 24892 raft_consensus.cc:493] T b08304a0a02b42d7840c4e8ee9a6bd1a P 0473d2b2d01f4459b1e90fd12cc7840e [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:38.135876 24892 raft_consensus.cc:515] T b08304a0a02b42d7840c4e8ee9a6bd1a P 0473d2b2d01f4459b1e90fd12cc7840e [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:38.137600 24700 leader_election.cc:290] T fa731b585f684a7fb2d106c50f143b83 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:06:38.136129 19377 leader_election.cc:304] T 22196caba61445d3bec98a0aab3c337d P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:06:38.138363 24892 leader_election.cc:290] T b08304a0a02b42d7840c4e8ee9a6bd1a P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
W20260709 13:06:38.144145 19526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.2:46257, user_credentials={real_user=slave}} blocked reactor thread for 46032.4us
I20260709 13:06:38.144771 19377 leader_election.cc:304] T 179fd671030940b4b4a4e24bcc4aba0a P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87; no voters: e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:06:38.144973 20105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ec1c4ce15e04c7e8c283a62179f2a64" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
W20260709 13:06:38.145903 24915 log.cc:927] Time spent T 85c494af21f9457a85da47b9bc70c1fd P 127766fc592545a4997f7790f50f6076: Append to log took a long time: real 0.104s	user 0.001s	sys 0.000s
I20260709 13:06:38.146333 24551 raft_consensus.cc:2749] T 22196caba61445d3bec98a0aab3c337d P e5256d91808b47c195bc9b4dbd7f2b87 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:06:38.147054 24821 consensus_queue.cc:1048] T 46c5bfeecc314717bffe987e6844b6d0 P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:06:38.148393 24821 raft_consensus.cc:2804] T 179fd671030940b4b4a4e24bcc4aba0a P e5256d91808b47c195bc9b4dbd7f2b87 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:06:38.148905 24821 raft_consensus.cc:697] T 179fd671030940b4b4a4e24bcc4aba0a P e5256d91808b47c195bc9b4dbd7f2b87 [term 18 LEADER]: Becoming Leader. State: Replica: e5256d91808b47c195bc9b4dbd7f2b87, State: Running, Role: LEADER
I20260709 13:06:38.149871 24821 consensus_queue.cc:237] T 179fd671030940b4b4a4e24bcc4aba0a P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 17.10, Last appended by leader: 10, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
W20260709 13:06:38.152366 24913 log.cc:927] Time spent T 217b5fae677b4971b3bbd2f357a1f7ff P e61c3a8f61bb48f8a963c9480e53c168: Append to log took a long time: real 0.287s	user 0.000s	sys 0.002s
I20260709 13:06:38.152751 24700 raft_consensus.cc:2804] T df751f992649444090e27965eb1af85d P e61c3a8f61bb48f8a963c9480e53c168 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:06:38.152848 24838 consensus_queue.cc:1048] T 21e14947d70440f19044d8f75c31e1f9 P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:06:38.153942 19377 leader_election.cc:304] T d1e5873a19244c5ebbcd38e126796ee7 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:06:38.095135 24888 raft_consensus.cc:2749] T 14935b3ddf914369822e4a0547aaa355 P e61c3a8f61bb48f8a963c9480e53c168 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:06:38.145622 24789 consensus_queue.cc:1048] T edd7d470b5014c9489be7f41f64355c9 P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:06:38.168866 24892 raft_consensus.cc:2749] T 172b3dd13109415a955b71ac0e9d2234 P 0473d2b2d01f4459b1e90fd12cc7840e [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:06:38.170430 19450 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.3:36891, user_credentials={real_user=slave}} blocked reactor thread for 88965.7us
I20260709 13:06:38.097903 24891 consensus_queue.cc:1048] T 28af091831594f9d8e96482078cc7625 P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.062s
I20260709 13:06:38.179757 19553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b08304a0a02b42d7840c4e8ee9a6bd1a" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:06:38.101423 24887 raft_consensus.cc:2804] T 6c5eebf646ad445a9d1b1adc319d7b16 P e61c3a8f61bb48f8a963c9480e53c168 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:06:38.185492 19553 raft_consensus.cc:2468] T b08304a0a02b42d7840c4e8ee9a6bd1a P e61c3a8f61bb48f8a963c9480e53c168 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 15.
I20260709 13:06:38.181202 19484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab43d85f64114d4ebf618930e43d9ed0" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:06:38.186250 19484 raft_consensus.cc:3060] T ab43d85f64114d4ebf618930e43d9ed0 P 0473d2b2d01f4459b1e90fd12cc7840e [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:06:38.098937 24702 consensus_queue.cc:1059] T 179fd671030940b4b4a4e24bcc4aba0a P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 }, Status: INVALID_TERM, Last received: 14.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.070s
W20260709 13:06:38.189340 19449 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.4:43121, user_credentials={real_user=slave}} blocked reactor thread for 65307.7us
I20260709 13:06:38.128939 24871 raft_consensus.cc:515] T d1e5873a19244c5ebbcd38e126796ee7 P 0473d2b2d01f4459b1e90fd12cc7840e [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
W20260709 13:06:38.232926 19526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.2:46257, user_credentials={real_user=slave}} blocked reactor thread for 84861.6us
I20260709 13:06:38.157426 24700 raft_consensus.cc:493] T df751f992649444090e27965eb1af85d P e61c3a8f61bb48f8a963c9480e53c168 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 0473d2b2d01f4459b1e90fd12cc7840e)
I20260709 13:06:38.172302 24756 raft_consensus.cc:2749] T d1e5873a19244c5ebbcd38e126796ee7 P e5256d91808b47c195bc9b4dbd7f2b87 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:06:38.184582 24892 raft_consensus.cc:493] T 0e1085d23e8347fbbd5bce7542f4b1f4 P 0473d2b2d01f4459b1e90fd12cc7840e [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:38.250159 19306 catalog_manager.cc:5697] T ed7fdbcb96d14d418db9ca90a792588a P 127766fc592545a4997f7790f50f6076 reported cstate change: term changed from 4 to 9, leader changed from e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3) to 127766fc592545a4997f7790f50f6076 (127.17.223.4). New cstate: current_term: 9 leader_uuid: "127766fc592545a4997f7790f50f6076" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:06:38.251629 24798 raft_consensus.cc:493] T 5ec1c4ce15e04c7e8c283a62179f2a64 P e5256d91808b47c195bc9b4dbd7f2b87 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 127766fc592545a4997f7790f50f6076)
I20260709 13:06:38.187876 24887 raft_consensus.cc:493] T 6c5eebf646ad445a9d1b1adc319d7b16 P e61c3a8f61bb48f8a963c9480e53c168 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 0473d2b2d01f4459b1e90fd12cc7840e)
I20260709 13:06:38.262616 19405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cdf56e38bbc453d9438d359e5a69955" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
I20260709 13:06:38.269356 19409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b08304a0a02b42d7840c4e8ee9a6bd1a" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:06:38.270053 19556 raft_consensus.cc:1275] T ef32ce6fdd0e40d382c79974f30295c6 P e61c3a8f61bb48f8a963c9480e53c168 [term 18 FOLLOWER]: Refusing update from remote peer 0473d2b2d01f4459b1e90fd12cc7840e: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 18 index: 10. (index mismatch)
I20260709 13:06:38.246634 24700 raft_consensus.cc:3060] T df751f992649444090e27965eb1af85d P e61c3a8f61bb48f8a963c9480e53c168 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:06:38.275851 19449 leader_election.cc:304] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e; no voters: 127766fc592545a4997f7790f50f6076, e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:06:38.230389 24276 raft_consensus.cc:515] T fa8650e71aa14778b3d73721fc50d9fc P 0473d2b2d01f4459b1e90fd12cc7840e [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:38.275616 19306 catalog_manager.cc:5697] T 85c494af21f9457a85da47b9bc70c1fd P 127766fc592545a4997f7790f50f6076 reported cstate change: term changed from 6 to 12. New cstate: current_term: 12 leader_uuid: "127766fc592545a4997f7790f50f6076" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:06:38.265915 24887 raft_consensus.cc:3060] T 6c5eebf646ad445a9d1b1adc319d7b16 P e61c3a8f61bb48f8a963c9480e53c168 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:06:38.302974 19409 raft_consensus.cc:2468] T b08304a0a02b42d7840c4e8ee9a6bd1a P e5256d91808b47c195bc9b4dbd7f2b87 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 15.
I20260709 13:06:38.316951 24871 leader_election.cc:290] T d1e5873a19244c5ebbcd38e126796ee7 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:06:38.317619 24871 raft_consensus.cc:493] T edd7d470b5014c9489be7f41f64355c9 P 0473d2b2d01f4459b1e90fd12cc7840e [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:38.323292 19486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7be9efa6559648dbb5a0f7684c4542d1" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:06:38.323982 19486 raft_consensus.cc:2468] T 7be9efa6559648dbb5a0f7684c4542d1 P 0473d2b2d01f4459b1e90fd12cc7840e [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 127766fc592545a4997f7790f50f6076 in term 14.
I20260709 13:06:38.324836 19486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40e1e16737a842ee936002830f36882e" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:06:38.325489 19486 raft_consensus.cc:3060] T 40e1e16737a842ee936002830f36882e P 0473d2b2d01f4459b1e90fd12cc7840e [term 15 FOLLOWER]: Advancing to term 17
I20260709 13:06:38.326635 24837 leader_election.cc:290] T 65d8cb8d6ec64f459d5a47cefab10acf P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 17 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:06:38.328084 24276 leader_election.cc:290] T fa8650e71aa14778b3d73721fc50d9fc P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 15 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:06:38.328233 24861 raft_consensus.cc:2749] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P 0473d2b2d01f4459b1e90fd12cc7840e [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:06:38.328735 24276 raft_consensus.cc:493] T 1dc5b3532fe54f74876d02beffa2c230 P 0473d2b2d01f4459b1e90fd12cc7840e [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:38.329263 24276 raft_consensus.cc:515] T 1dc5b3532fe54f74876d02beffa2c230 P 0473d2b2d01f4459b1e90fd12cc7840e [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:38.336134 19481 raft_consensus.cc:2393] T fa8650e71aa14778b3d73721fc50d9fc P 0473d2b2d01f4459b1e90fd12cc7840e [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e61c3a8f61bb48f8a963c9480e53c168 in current term 15: Already voted for candidate 0473d2b2d01f4459b1e90fd12cc7840e in this term.
I20260709 13:06:38.318130 24871 raft_consensus.cc:515] T edd7d470b5014c9489be7f41f64355c9 P 0473d2b2d01f4459b1e90fd12cc7840e [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:38.345345 19484 raft_consensus.cc:2468] T ab43d85f64114d4ebf618930e43d9ed0 P 0473d2b2d01f4459b1e90fd12cc7840e [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 127766fc592545a4997f7790f50f6076 in term 17.
I20260709 13:06:38.278610 24825 raft_consensus.cc:493] T 76cb037fc9064d13b59a8969d897ce8c P e5256d91808b47c195bc9b4dbd7f2b87 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:06:38.356478 19449 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.4:43121, user_credentials={real_user=slave}} blocked reactor thread for 80865.7us
I20260709 13:06:38.355101 19478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f93ee515a9c14139bf566522ed8232f3" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 17 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:06:38.269618 24798 raft_consensus.cc:515] T 5ec1c4ce15e04c7e8c283a62179f2a64 P e5256d91808b47c195bc9b4dbd7f2b87 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:38.363045 19484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b74109013a140ada21feeef92d6f563" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:06:38.278331 24892 raft_consensus.cc:515] T 0e1085d23e8347fbbd5bce7542f4b1f4 P 0473d2b2d01f4459b1e90fd12cc7840e [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:38.394280 19486 raft_consensus.cc:2468] T 40e1e16737a842ee936002830f36882e P 0473d2b2d01f4459b1e90fd12cc7840e [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 17.
I20260709 13:06:38.293627 24838 consensus_queue.cc:1048] T 7f575b143b844aa096b50997dad3516a P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.073s
I20260709 13:06:38.395637 19449 leader_election.cc:304] T ab43d85f64114d4ebf618930e43d9ed0 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e; no voters: 127766fc592545a4997f7790f50f6076, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:06:38.397902 19484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa8650e71aa14778b3d73721fc50d9fc" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
W20260709 13:06:38.399297 19526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.2:46257, user_credentials={real_user=slave}} blocked reactor thread for 125039us
I20260709 13:06:38.317694 24372 raft_consensus.cc:515] T 1dc5b3532fe54f74876d02beffa2c230 P e5256d91808b47c195bc9b4dbd7f2b87 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:38.403455 19478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1b10566f45d4a7d9029858330e02d5b" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:06:38.404906 19449 leader_election.cc:304] T 5ec1c4ce15e04c7e8c283a62179f2a64 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e; no voters: 127766fc592545a4997f7790f50f6076, e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:06:38.374807 24866 leader_election.cc:290] T b9f0d59553ad444883fcf5b5909f9798 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:06:38.346410 24795 raft_consensus.cc:515] T ab43d85f64114d4ebf618930e43d9ed0 P e61c3a8f61bb48f8a963c9480e53c168 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
W20260709 13:06:38.410024 24919 log.cc:927] Time spent T 172b3dd13109415a955b71ac0e9d2234 P e5256d91808b47c195bc9b4dbd7f2b87: Append to log took a long time: real 0.099s	user 0.001s	sys 0.000s
I20260709 13:06:38.367298 24825 raft_consensus.cc:515] T 76cb037fc9064d13b59a8969d897ce8c P e5256d91808b47c195bc9b4dbd7f2b87 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:38.398761 24471 leader_election.cc:290] T b9f0d59553ad444883fcf5b5909f9798 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:06:38.410276 24837 raft_consensus.cc:493] T 4af19371ea874c09a0a2147040835cbb P e61c3a8f61bb48f8a963c9480e53c168 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 127766fc592545a4997f7790f50f6076)
I20260709 13:06:38.415318 24871 leader_election.cc:290] T edd7d470b5014c9489be7f41f64355c9 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:06:38.423938 24861 raft_consensus.cc:493] T 1f85fc4b527a48848e5faa083b604e36 P 0473d2b2d01f4459b1e90fd12cc7840e [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 127766fc592545a4997f7790f50f6076)
I20260709 13:06:38.424613 24861 raft_consensus.cc:515] T 1f85fc4b527a48848e5faa083b604e36 P 0473d2b2d01f4459b1e90fd12cc7840e [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:38.426079 24926 raft_consensus.cc:2749] T 5ec1c4ce15e04c7e8c283a62179f2a64 P 0473d2b2d01f4459b1e90fd12cc7840e [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:06:38.426873 24861 leader_election.cc:290] T 1f85fc4b527a48848e5faa083b604e36 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
W20260709 13:06:38.427338 24921 log.cc:927] Time spent T 2b74109013a140ada21feeef92d6f563 P 0473d2b2d01f4459b1e90fd12cc7840e: Append to log took a long time: real 0.148s	user 0.000s	sys 0.001s
I20260709 13:06:38.431299 19478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9f0d59553ad444883fcf5b5909f9798" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:06:38.431646 19483 raft_consensus.cc:1275] T bc225c93219c45538b53a1bd3d387e4d P 0473d2b2d01f4459b1e90fd12cc7840e [term 14 FOLLOWER]: Refusing update from remote peer e5256d91808b47c195bc9b4dbd7f2b87: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 14 index: 8. (term mismatch)
I20260709 13:06:38.431991 19483 pending_rounds.cc:85] T bc225c93219c45538b53a1bd3d387e4d P 0473d2b2d01f4459b1e90fd12cc7840e: Aborting all ops after (but not including) 7
I20260709 13:06:38.432209 19483 pending_rounds.cc:107] T bc225c93219c45538b53a1bd3d387e4d P 0473d2b2d01f4459b1e90fd12cc7840e: Aborting uncommitted NO_OP operation due to leader change: 13.8
I20260709 13:06:38.432449 19483 raft_consensus.cc:2889] T bc225c93219c45538b53a1bd3d387e4d P 0473d2b2d01f4459b1e90fd12cc7840e [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:06:38.433895 24781 leader_election.cc:290] T 28af091831594f9d8e96482078cc7625 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:06:38.408373 24939 raft_consensus.cc:2749] T ab43d85f64114d4ebf618930e43d9ed0 P 0473d2b2d01f4459b1e90fd12cc7840e [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:06:38.443077 24898 leader_election.cc:290] T 0cdf56e38bbc453d9438d359e5a69955 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 16 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:06:38.413851 24276 leader_election.cc:290] T 1dc5b3532fe54f74876d02beffa2c230 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:06:38.458947 19409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9f0d59553ad444883fcf5b5909f9798" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:06:38.457065 24551 raft_consensus.cc:493] T 7f575b143b844aa096b50997dad3516a P e5256d91808b47c195bc9b4dbd7f2b87 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:38.484192 24551 raft_consensus.cc:515] T 7f575b143b844aa096b50997dad3516a P e5256d91808b47c195bc9b4dbd7f2b87 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
W20260709 13:06:38.459844 24824 consensus_meta.cc:287] T e381f1d6b8184797ad142de49be225a8 P e5256d91808b47c195bc9b4dbd7f2b87: Time spent flushing consensus metadata: real 0.614s	user 0.010s	sys 0.000s
I20260709 13:06:38.465044 19557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85c494af21f9457a85da47b9bc70c1fd" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 16 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:06:38.464744 24936 raft_consensus.cc:493] T 76cb037fc9064d13b59a8969d897ce8c P e61c3a8f61bb48f8a963c9480e53c168 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:38.467734 19554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab43d85f64114d4ebf618930e43d9ed0" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:06:38.444105 24789 raft_consensus.cc:493] T ef32ce6fdd0e40d382c79974f30295c6 P e61c3a8f61bb48f8a963c9480e53c168 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:38.476145 24892 leader_election.cc:290] T 0e1085d23e8347fbbd5bce7542f4b1f4 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:06:38.477717 24597 raft_consensus.cc:515] T 0cdf56e38bbc453d9438d359e5a69955 P e5256d91808b47c195bc9b4dbd7f2b87 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:38.478777 19377 leader_election.cc:304] T f93ee515a9c14139bf566522ed8232f3 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:06:38.479417 24941 raft_consensus.cc:493] T edd7d470b5014c9489be7f41f64355c9 P e5256d91808b47c195bc9b4dbd7f2b87 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:38.479522 24867 raft_consensus.cc:3055] T 3e1f505cb0f1427bbd698ac889d80821 P e5256d91808b47c195bc9b4dbd7f2b87 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:06:38.443856 24837 raft_consensus.cc:515] T 4af19371ea874c09a0a2147040835cbb P e61c3a8f61bb48f8a963c9480e53c168 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:38.491060 19484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28af091831594f9d8e96482078cc7625" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:06:38.529125 19405 raft_consensus.cc:2393] T 0cdf56e38bbc453d9438d359e5a69955 P e5256d91808b47c195bc9b4dbd7f2b87 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 0473d2b2d01f4459b1e90fd12cc7840e in current term 16: Already voted for candidate e5256d91808b47c195bc9b4dbd7f2b87 in this term.
I20260709 13:06:38.491886 19552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7be9efa6559648dbb5a0f7684c4542d1" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:06:38.502596 19479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "309c3ca0ca4b4f3ba129752ea2cb293b" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:06:38.531859 19479 raft_consensus.cc:2393] T 309c3ca0ca4b4f3ba129752ea2cb293b P 0473d2b2d01f4459b1e90fd12cc7840e [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e61c3a8f61bb48f8a963c9480e53c168 in current term 10: Already voted for candidate 0473d2b2d01f4459b1e90fd12cc7840e in this term.
I20260709 13:06:38.479523 24812 leader_election.cc:290] T 46c5bfeecc314717bffe987e6844b6d0 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 21 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:06:38.514034 19554 raft_consensus.cc:3060] T ab43d85f64114d4ebf618930e43d9ed0 P e61c3a8f61bb48f8a963c9480e53c168 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:06:38.535483 19523 leader_election.cc:304] T 70797e5783b5454ab0d0eea663e791e3 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 127766fc592545a4997f7790f50f6076, e61c3a8f61bb48f8a963c9480e53c168; no voters: e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:06:38.536700 19523 leader_election.cc:304] T 7be9efa6559648dbb5a0f7684c4542d1 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168; no voters: 127766fc592545a4997f7790f50f6076, e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:06:38.537803 19523 leader_election.cc:304] T 2a16f7501e2444fb86d4e2778e734e02 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 127766fc592545a4997f7790f50f6076, e61c3a8f61bb48f8a963c9480e53c168; no voters: e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:06:38.538558 24931 raft_consensus.cc:2804] T 70797e5783b5454ab0d0eea663e791e3 P e61c3a8f61bb48f8a963c9480e53c168 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:06:38.486361 24887 raft_consensus.cc:515] T 6c5eebf646ad445a9d1b1adc319d7b16 P e61c3a8f61bb48f8a963c9480e53c168 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:38.539052 24931 raft_consensus.cc:697] T 70797e5783b5454ab0d0eea663e791e3 P e61c3a8f61bb48f8a963c9480e53c168 [term 15 LEADER]: Becoming Leader. State: Replica: e61c3a8f61bb48f8a963c9480e53c168, State: Running, Role: LEADER
I20260709 13:06:38.539956 24931 consensus_queue.cc:237] T 70797e5783b5454ab0d0eea663e791e3 P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:38.540496 24887 leader_election.cc:290] T 6c5eebf646ad445a9d1b1adc319d7b16 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 15 election: Requested vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:06:38.541116 24887 raft_consensus.cc:3060] T 7be9efa6559648dbb5a0f7684c4542d1 P e61c3a8f61bb48f8a963c9480e53c168 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:06:38.542449 24702 raft_consensus.cc:2804] T 2a16f7501e2444fb86d4e2778e734e02 P e61c3a8f61bb48f8a963c9480e53c168 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:06:38.542987 24898 raft_consensus.cc:493] T 7f575b143b844aa096b50997dad3516a P 0473d2b2d01f4459b1e90fd12cc7840e [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:38.543651 19484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46c5bfeecc314717bffe987e6844b6d0" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 21 candidate_status { last_received { term: 19 index: 9 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:06:38.519364 19559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa8650e71aa14778b3d73721fc50d9fc" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:06:38.544770 19559 raft_consensus.cc:3060] T fa8650e71aa14778b3d73721fc50d9fc P e61c3a8f61bb48f8a963c9480e53c168 [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:06:38.544808 20076 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:38.522282 19556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9f0d59553ad444883fcf5b5909f9798" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:06:38.524380 19409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e5873a19244c5ebbcd38e126796ee7" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
W20260709 13:06:38.524372 19377 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.2:46257, user_credentials={real_user=slave}} blocked reactor thread for 45724.2us
I20260709 13:06:38.521895 19551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e5873a19244c5ebbcd38e126796ee7" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:06:38.486169 24551 leader_election.cc:290] T 7f575b143b844aa096b50997dad3516a P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:06:38.522969 19560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dc5b3532fe54f74876d02beffa2c230" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:06:38.546818 19377 leader_election.cc:304] T 2b74109013a140ada21feeef92d6f563 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:06:38.528782 24941 raft_consensus.cc:515] T edd7d470b5014c9489be7f41f64355c9 P e5256d91808b47c195bc9b4dbd7f2b87 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:38.529045 19411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa8650e71aa14778b3d73721fc50d9fc" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
I20260709 13:06:38.547988 19411 raft_consensus.cc:3060] T fa8650e71aa14778b3d73721fc50d9fc P e5256d91808b47c195bc9b4dbd7f2b87 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:06:38.547492 19560 raft_consensus.cc:2468] T 1dc5b3532fe54f74876d02beffa2c230 P e61c3a8f61bb48f8a963c9480e53c168 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 16.
I20260709 13:06:38.519050 24936 raft_consensus.cc:515] T 76cb037fc9064d13b59a8969d897ce8c P e61c3a8f61bb48f8a963c9480e53c168 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:38.529699 19557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edd7d470b5014c9489be7f41f64355c9" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:06:38.528792 24789 raft_consensus.cc:515] T ef32ce6fdd0e40d382c79974f30295c6 P e61c3a8f61bb48f8a963c9480e53c168 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:38.530078 24597 leader_election.cc:290] T 0cdf56e38bbc453d9438d359e5a69955 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 16 election: Requested vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:06:38.526034 24573 raft_consensus.cc:493] T 9962423cb4e54fcfa5de01daf68a86e7 P 0473d2b2d01f4459b1e90fd12cc7840e [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 127766fc592545a4997f7790f50f6076)
I20260709 13:06:38.491789 19410 raft_consensus.cc:1275] T ef32ce6fdd0e40d382c79974f30295c6 P e5256d91808b47c195bc9b4dbd7f2b87 [term 18 FOLLOWER]: Refusing update from remote peer 0473d2b2d01f4459b1e90fd12cc7840e: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 18 index: 10. (term mismatch)
I20260709 13:06:38.532935 19449 leader_election.cc:304] T b08304a0a02b42d7840c4e8ee9a6bd1a P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87; no voters: 
I20260709 13:06:38.530685 24824 raft_consensus.cc:2749] T f93ee515a9c14139bf566522ed8232f3 P e5256d91808b47c195bc9b4dbd7f2b87 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:06:38.533856 19406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dc5b3532fe54f74876d02beffa2c230" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:06:38.552886 19406 raft_consensus.cc:2468] T 1dc5b3532fe54f74876d02beffa2c230 P e5256d91808b47c195bc9b4dbd7f2b87 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 16.
I20260709 13:06:38.554399 19484 raft_consensus.cc:1275] T 96efeaaf1057492490e9a621f37e1a2d P 0473d2b2d01f4459b1e90fd12cc7840e [term 17 FOLLOWER]: Refusing update from remote peer e61c3a8f61bb48f8a963c9480e53c168: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
I20260709 13:06:38.516773 24891 raft_consensus.cc:493] T 1efebf73c86e432baa55533136b6e12c P 0473d2b2d01f4459b1e90fd12cc7840e [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:38.507253 24866 raft_consensus.cc:493] T a08760e15aac4630a629431f56024dc8 P e5256d91808b47c195bc9b4dbd7f2b87 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:38.555815 19484 raft_consensus.cc:1240] T 179fd671030940b4b4a4e24bcc4aba0a P 0473d2b2d01f4459b1e90fd12cc7840e [term 18 FOLLOWER]: Rejecting Update request from peer e61c3a8f61bb48f8a963c9480e53c168 for earlier term 17. Current term is 18. Ops: [17.10-17.10]
I20260709 13:06:38.543467 24898 raft_consensus.cc:515] T 7f575b143b844aa096b50997dad3516a P 0473d2b2d01f4459b1e90fd12cc7840e [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:38.552397 19410 pending_rounds.cc:85] T ef32ce6fdd0e40d382c79974f30295c6 P e5256d91808b47c195bc9b4dbd7f2b87: Aborting all ops after (but not including) 9
I20260709 13:06:38.565075 19410 pending_rounds.cc:107] T ef32ce6fdd0e40d382c79974f30295c6 P e5256d91808b47c195bc9b4dbd7f2b87: Aborting uncommitted NO_OP operation due to leader change: 17.10
I20260709 13:06:38.565418 19410 raft_consensus.cc:2889] T ef32ce6fdd0e40d382c79974f30295c6 P e5256d91808b47c195bc9b4dbd7f2b87 [term 18 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:06:38.557567 19554 raft_consensus.cc:2468] T ab43d85f64114d4ebf618930e43d9ed0 P e61c3a8f61bb48f8a963c9480e53c168 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 127766fc592545a4997f7790f50f6076 in term 17.
I20260709 13:06:38.526067 24867 raft_consensus.cc:740] T 3e1f505cb0f1427bbd698ac889d80821 P e5256d91808b47c195bc9b4dbd7f2b87 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: e5256d91808b47c195bc9b4dbd7f2b87, State: Running, Role: LEADER
I20260709 13:06:38.543026 24702 raft_consensus.cc:697] T 2a16f7501e2444fb86d4e2778e734e02 P e61c3a8f61bb48f8a963c9480e53c168 [term 15 LEADER]: Becoming Leader. State: Replica: e61c3a8f61bb48f8a963c9480e53c168, State: Running, Role: LEADER
I20260709 13:06:38.567833 24837 leader_election.cc:290] T 4af19371ea874c09a0a2147040835cbb P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:06:38.564057 24930 raft_consensus.cc:2804] T b08304a0a02b42d7840c4e8ee9a6bd1a P 0473d2b2d01f4459b1e90fd12cc7840e [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:06:38.568768 24930 raft_consensus.cc:493] T b08304a0a02b42d7840c4e8ee9a6bd1a P 0473d2b2d01f4459b1e90fd12cc7840e [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:38.531422 24276 raft_consensus.cc:493] T a08760e15aac4630a629431f56024dc8 P 0473d2b2d01f4459b1e90fd12cc7840e [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:38.560107 24926 raft_consensus.cc:493] T 775c229504194560ba9589bc2199b089 P 0473d2b2d01f4459b1e90fd12cc7840e [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 127766fc592545a4997f7790f50f6076)
I20260709 13:06:38.569458 24276 raft_consensus.cc:515] T a08760e15aac4630a629431f56024dc8 P 0473d2b2d01f4459b1e90fd12cc7840e [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:38.569694 24926 raft_consensus.cc:515] T 775c229504194560ba9589bc2199b089 P 0473d2b2d01f4459b1e90fd12cc7840e [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:38.571575 24276 leader_election.cc:290] T a08760e15aac4630a629431f56024dc8 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:06:38.573009 24898 leader_election.cc:290] T 7f575b143b844aa096b50997dad3516a P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:06:38.568778 24702 consensus_queue.cc:237] T 2a16f7501e2444fb86d4e2778e734e02 P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:38.560446 24573 raft_consensus.cc:515] T 9962423cb4e54fcfa5de01daf68a86e7 P 0473d2b2d01f4459b1e90fd12cc7840e [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:38.574931 19409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edd7d470b5014c9489be7f41f64355c9" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:06:38.576259 24573 leader_election.cc:290] T 9962423cb4e54fcfa5de01daf68a86e7 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:06:38.567863 24867 consensus_queue.cc:260] T 3e1f505cb0f1427bbd698ac889d80821 P e5256d91808b47c195bc9b4dbd7f2b87 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:38.579193 24867 raft_consensus.cc:3060] T 3e1f505cb0f1427bbd698ac889d80821 P e5256d91808b47c195bc9b4dbd7f2b87 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:06:38.579974 24936 leader_election.cc:290] T 76cb037fc9064d13b59a8969d897ce8c P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:06:38.582701 24898 raft_consensus.cc:493] T 1a61655d99124a29b486ba4a5b37faea P 0473d2b2d01f4459b1e90fd12cc7840e [term 12 FOLLOWER]: Starting pre-election (detected failure of leader e5256d91808b47c195bc9b4dbd7f2b87)
I20260709 13:06:38.583256 24898 raft_consensus.cc:515] T 1a61655d99124a29b486ba4a5b37faea P 0473d2b2d01f4459b1e90fd12cc7840e [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:38.606158 19409 raft_consensus.cc:2468] T edd7d470b5014c9489be7f41f64355c9 P e5256d91808b47c195bc9b4dbd7f2b87 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 16.
I20260709 13:06:38.616677 19559 raft_consensus.cc:2468] T fa8650e71aa14778b3d73721fc50d9fc P e61c3a8f61bb48f8a963c9480e53c168 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 15.
I20260709 13:06:38.569165 24930 raft_consensus.cc:3060] T b08304a0a02b42d7840c4e8ee9a6bd1a P 0473d2b2d01f4459b1e90fd12cc7840e [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:06:38.625734 19556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cdf56e38bbc453d9438d359e5a69955" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:06:38.628454 19556 raft_consensus.cc:3060] T 0cdf56e38bbc453d9438d359e5a69955 P e61c3a8f61bb48f8a963c9480e53c168 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:06:38.571591 24926 leader_election.cc:290] T 775c229504194560ba9589bc2199b089 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:06:38.585887 24551 raft_consensus.cc:493] T ef32ce6fdd0e40d382c79974f30295c6 P e5256d91808b47c195bc9b4dbd7f2b87 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:38.606225 24891 raft_consensus.cc:515] T 1efebf73c86e432baa55533136b6e12c P 0473d2b2d01f4459b1e90fd12cc7840e [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:38.633594 24888 consensus_queue.cc:1048] T 96efeaaf1057492490e9a621f37e1a2d P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:06:38.636538 24372 leader_election.cc:290] T 1dc5b3532fe54f74876d02beffa2c230 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 16 election: Requested vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:06:38.585163 24898 leader_election.cc:290] T 1a61655d99124a29b486ba4a5b37faea P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:06:38.647491 24551 raft_consensus.cc:515] T ef32ce6fdd0e40d382c79974f30295c6 P e5256d91808b47c195bc9b4dbd7f2b87 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:38.622428 24276 raft_consensus.cc:493] T 86a6797bdfe94fa496c050ceae4bd0d9 P 0473d2b2d01f4459b1e90fd12cc7840e [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:38.607050 24942 raft_consensus.cc:2749] T 2b74109013a140ada21feeef92d6f563 P e5256d91808b47c195bc9b4dbd7f2b87 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:06:38.606163 24866 raft_consensus.cc:515] T a08760e15aac4630a629431f56024dc8 P e5256d91808b47c195bc9b4dbd7f2b87 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:38.693521 19553 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2e36a9d6e29c4a7c860cf267efbd4c74"
dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
mode: GRACEFUL
new_leader_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
 from {username='slave'} at 127.0.0.1:39264
I20260709 13:06:38.694625 19553 raft_consensus.cc:606] T 2e36a9d6e29c4a7c860cf267efbd4c74 P e61c3a8f61bb48f8a963c9480e53c168 [term 11 FOLLOWER]: Received request to transfer leadership to TS e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:06:38.695076 19553 raft_consensus.cc:614] T 2e36a9d6e29c4a7c860cf267efbd4c74 P e61c3a8f61bb48f8a963c9480e53c168 [term 11 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 13:06:38.702682 20075 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.1:40321, user_credentials={real_user=slave}} blocked reactor thread for 95570.4us
I20260709 13:06:38.679816 24276 raft_consensus.cc:515] T 86a6797bdfe94fa496c050ceae4bd0d9 P 0473d2b2d01f4459b1e90fd12cc7840e [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:38.679813 24837 raft_consensus.cc:493] T 1a61655d99124a29b486ba4a5b37faea P e61c3a8f61bb48f8a963c9480e53c168 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:38.744665 19485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c5eebf646ad445a9d1b1adc319d7b16" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:06:38.745687 19484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76cb037fc9064d13b59a8969d897ce8c" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:06:38.746352 19484 raft_consensus.cc:2468] T 76cb037fc9064d13b59a8969d897ce8c P 0473d2b2d01f4459b1e90fd12cc7840e [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 13.
I20260709 13:06:38.746605 24888 consensus_queue.cc:1059] T 179fd671030940b4b4a4e24bcc4aba0a P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 }, Status: INVALID_TERM, Last received: 14.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:06:38.747222 19484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab43d85f64114d4ebf618930e43d9ed0" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
W20260709 13:06:38.749823 20075 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:38.755807 19484 raft_consensus.cc:2368] T ab43d85f64114d4ebf618930e43d9ed0 P 0473d2b2d01f4459b1e90fd12cc7840e [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate e61c3a8f61bb48f8a963c9480e53c168 for earlier term 16. Current term is 17.
I20260709 13:06:38.767328 19559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e1085d23e8347fbbd5bce7542f4b1f4" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:06:38.771857 19375 leader_election.cc:304] T 40e1e16737a842ee936002830f36882e P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
W20260709 13:06:38.767820 24922 log.cc:927] Time spent T 85c494af21f9457a85da47b9bc70c1fd P e61c3a8f61bb48f8a963c9480e53c168: Append to log took a long time: real 0.718s	user 0.004s	sys 0.000s
I20260709 13:06:38.770237 24946 raft_consensus.cc:493] T 9962423cb4e54fcfa5de01daf68a86e7 P 127766fc592545a4997f7790f50f6076 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:38.796494 24795 leader_election.cc:290] T ab43d85f64114d4ebf618930e43d9ed0 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 16 election: Requested vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:06:38.780148 24276 leader_election.cc:290] T 86a6797bdfe94fa496c050ceae4bd0d9 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:06:38.784679 19405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f85fc4b527a48848e5faa083b604e36" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:06:38.791738 24941 leader_election.cc:290] T edd7d470b5014c9489be7f41f64355c9 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:06:38.794008 24866 leader_election.cc:290] T a08760e15aac4630a629431f56024dc8 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
W20260709 13:06:38.797122 19523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.4:43121, user_credentials={real_user=slave}} blocked reactor thread for 244896us
I20260709 13:06:38.778915 24891 leader_election.cc:290] T 1efebf73c86e432baa55533136b6e12c P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:06:38.809087 19554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cdf56e38bbc453d9438d359e5a69955" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:06:38.810819 19411 raft_consensus.cc:2468] T fa8650e71aa14778b3d73721fc50d9fc P e5256d91808b47c195bc9b4dbd7f2b87 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 15.
I20260709 13:06:38.755553 24892 raft_consensus.cc:493] T 76cb037fc9064d13b59a8969d897ce8c P 0473d2b2d01f4459b1e90fd12cc7840e [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:38.815145 19556 raft_consensus.cc:2468] T 0cdf56e38bbc453d9438d359e5a69955 P e61c3a8f61bb48f8a963c9480e53c168 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 16.
I20260709 13:06:38.803601 20103 consensus_queue.cc:237] T 309c3ca0ca4b4f3ba129752ea2cb293b P 127766fc592545a4997f7790f50f6076 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:38.820427 19560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dc5b3532fe54f74876d02beffa2c230" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:06:38.800005 24372 raft_consensus.cc:2804] T 40e1e16737a842ee936002830f36882e P e5256d91808b47c195bc9b4dbd7f2b87 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:06:38.837422 20105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "833a2f0775ed407a94b8924ce50adb63" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:06:38.823356 19553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f575b143b844aa096b50997dad3516a" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:06:38.829778 19559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9f0d59553ad444883fcf5b5909f9798" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:06:38.834839 19405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a08760e15aac4630a629431f56024dc8" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:06:38.836541 19523 leader_election.cc:304] T ed7fdbcb96d14d418db9ca90a792588a P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e61c3a8f61bb48f8a963c9480e53c168; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, 127766fc592545a4997f7790f50f6076
I20260709 13:06:38.841392 19551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86a6797bdfe94fa496c050ceae4bd0d9" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:06:38.842085 19551 raft_consensus.cc:2468] T 86a6797bdfe94fa496c050ceae4bd0d9 P e61c3a8f61bb48f8a963c9480e53c168 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 11.
I20260709 13:06:38.845444 24887 raft_consensus.cc:2749] T 7be9efa6559648dbb5a0f7684c4542d1 P e61c3a8f61bb48f8a963c9480e53c168 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:06:38.846839 19559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f575b143b844aa096b50997dad3516a" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:06:38.832167 24867 raft_consensus.cc:493] T 7be9efa6559648dbb5a0f7684c4542d1 P e5256d91808b47c195bc9b4dbd7f2b87 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:38.848006 19559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1efebf73c86e432baa55533136b6e12c" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:06:38.848660 19559 raft_consensus.cc:2468] T 1efebf73c86e432baa55533136b6e12c P e61c3a8f61bb48f8a963c9480e53c168 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 13.
I20260709 13:06:38.841449 19407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "775c229504194560ba9589bc2199b089" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:06:38.849280 19526 leader_election.cc:304] T 76cb037fc9064d13b59a8969d897ce8c P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:06:38.850134 19552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a08760e15aac4630a629431f56024dc8" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:06:38.850761 19552 raft_consensus.cc:2468] T a08760e15aac4630a629431f56024dc8 P e61c3a8f61bb48f8a963c9480e53c168 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 18.
I20260709 13:06:38.851403 24898 consensus_queue.cc:1048] T ef32ce6fdd0e40d382c79974f30295c6 P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:06:38.852474 24798 leader_election.cc:290] T 5ec1c4ce15e04c7e8c283a62179f2a64 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:06:38.852880 24949 raft_consensus.cc:493] T 6c5eebf646ad445a9d1b1adc319d7b16 P 127766fc592545a4997f7790f50f6076 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:38.853358 24949 raft_consensus.cc:515] T 6c5eebf646ad445a9d1b1adc319d7b16 P 127766fc592545a4997f7790f50f6076 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:38.855201 24790 raft_consensus.cc:3055] T 179fd671030940b4b4a4e24bcc4aba0a P e61c3a8f61bb48f8a963c9480e53c168 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:06:38.855576 24790 raft_consensus.cc:740] T 179fd671030940b4b4a4e24bcc4aba0a P e61c3a8f61bb48f8a963c9480e53c168 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: e61c3a8f61bb48f8a963c9480e53c168, State: Running, Role: LEADER
I20260709 13:06:38.856177 24824 raft_consensus.cc:493] T 21e14947d70440f19044d8f75c31e1f9 P e5256d91808b47c195bc9b4dbd7f2b87 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:38.800805 24756 consensus_queue.cc:1059] T 46c5bfeecc314717bffe987e6844b6d0 P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 }, Status: INVALID_TERM, Last received: 19.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.034s
I20260709 13:06:38.820408 24936 raft_consensus.cc:493] T e381f1d6b8184797ad142de49be225a8 P e61c3a8f61bb48f8a963c9480e53c168 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader e5256d91808b47c195bc9b4dbd7f2b87)
I20260709 13:06:38.840101 19405 raft_consensus.cc:2468] T a08760e15aac4630a629431f56024dc8 P e5256d91808b47c195bc9b4dbd7f2b87 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 18.
W20260709 13:06:38.865761 19377 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.2:46257, user_credentials={real_user=slave}} blocked reactor thread for 319000us
I20260709 13:06:38.866932 19377 leader_election.cc:304] T fa8650e71aa14778b3d73721fc50d9fc P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:06:38.860743 19450 leader_election.cc:304] T 1dc5b3532fe54f74876d02beffa2c230 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:06:38.803171 24837 raft_consensus.cc:515] T 1a61655d99124a29b486ba4a5b37faea P e61c3a8f61bb48f8a963c9480e53c168 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:38.871073 19485 raft_consensus.cc:2468] T 6c5eebf646ad445a9d1b1adc319d7b16 P 0473d2b2d01f4459b1e90fd12cc7840e [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 15.
I20260709 13:06:38.856675 24824 raft_consensus.cc:515] T 21e14947d70440f19044d8f75c31e1f9 P e5256d91808b47c195bc9b4dbd7f2b87 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:38.857573 24795 raft_consensus.cc:2804] T 76cb037fc9064d13b59a8969d897ce8c P e61c3a8f61bb48f8a963c9480e53c168 [term 13 FOLLOWER]: Leader pre-election won for term 14
W20260709 13:06:38.846897 24700 consensus_meta.cc:287] T df751f992649444090e27965eb1af85d P e61c3a8f61bb48f8a963c9480e53c168: Time spent flushing consensus metadata: real 0.540s	user 0.013s	sys 0.005s
I20260709 13:06:38.847690 24867 raft_consensus.cc:515] T 7be9efa6559648dbb5a0f7684c4542d1 P e5256d91808b47c195bc9b4dbd7f2b87 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } attrs { replace: true } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:38.813675 24875 raft_consensus.cc:493] T 2e36a9d6e29c4a7c860cf267efbd4c74 P 0473d2b2d01f4459b1e90fd12cc7840e [term 11 FOLLOWER]: Starting pre-election (detected failure of leader e5256d91808b47c195bc9b4dbd7f2b87)
I20260709 13:06:38.856552 24790 consensus_queue.cc:260] T 179fd671030940b4b4a4e24bcc4aba0a P e61c3a8f61bb48f8a963c9480e53c168 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.10, Last appended by leader: 10, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:38.897424 19450 leader_election.cc:304] T fa8650e71aa14778b3d73721fc50d9fc P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:06:38.899078 20076 leader_election.cc:304] T 85c494af21f9457a85da47b9bc70c1fd P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 127766fc592545a4997f7790f50f6076; no voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:06:38.881100 24887 raft_consensus.cc:2749] T ed7fdbcb96d14d418db9ca90a792588a P e61c3a8f61bb48f8a963c9480e53c168 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:06:38.906345 19377 leader_election.cc:304] T f1b10566f45d4a7d9029858330e02d5b P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:06:38.859205 24789 leader_election.cc:290] T ef32ce6fdd0e40d382c79974f30295c6 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:06:38.818013 24946 raft_consensus.cc:515] T 9962423cb4e54fcfa5de01daf68a86e7 P 127766fc592545a4997f7790f50f6076 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:38.902381 20076 leader_election.cc:304] T 7be9efa6559648dbb5a0f7684c4542d1 P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 127766fc592545a4997f7790f50f6076; no voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:06:38.870808 24372 raft_consensus.cc:697] T 40e1e16737a842ee936002830f36882e P e5256d91808b47c195bc9b4dbd7f2b87 [term 17 LEADER]: Becoming Leader. State: Replica: e5256d91808b47c195bc9b4dbd7f2b87, State: Running, Role: LEADER
I20260709 13:06:38.902845 24926 raft_consensus.cc:2804] T 1dc5b3532fe54f74876d02beffa2c230 P 0473d2b2d01f4459b1e90fd12cc7840e [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:06:38.888506 24795 raft_consensus.cc:493] T 76cb037fc9064d13b59a8969d897ce8c P e61c3a8f61bb48f8a963c9480e53c168 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:38.936482 20104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e1085d23e8347fbbd5bce7542f4b1f4" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:06:38.936996 20106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f85fc4b527a48848e5faa083b604e36" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:06:38.897382 24276 raft_consensus.cc:493] T 48824d5acfbc485ebf8c2d944e7202de P 0473d2b2d01f4459b1e90fd12cc7840e [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:38.905598 24876 raft_consensus.cc:2804] T fa8650e71aa14778b3d73721fc50d9fc P 0473d2b2d01f4459b1e90fd12cc7840e [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:06:38.907196 24629 raft_consensus.cc:2749] T 85c494af21f9457a85da47b9bc70c1fd P 127766fc592545a4997f7790f50f6076 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:06:38.894964 24700 raft_consensus.cc:515] T df751f992649444090e27965eb1af85d P e61c3a8f61bb48f8a963c9480e53c168 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:38.887650 24936 raft_consensus.cc:515] T e381f1d6b8184797ad142de49be225a8 P e61c3a8f61bb48f8a963c9480e53c168 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:38.886981 24892 raft_consensus.cc:515] T 76cb037fc9064d13b59a8969d897ce8c P 0473d2b2d01f4459b1e90fd12cc7840e [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:38.901252 24943 raft_consensus.cc:493] T ff9b0eddd810459b82d91c60777c10eb P 0473d2b2d01f4459b1e90fd12cc7840e [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:38.906453 24838 raft_consensus.cc:493] T 0e1085d23e8347fbbd5bce7542f4b1f4 P e61c3a8f61bb48f8a963c9480e53c168 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 127766fc592545a4997f7790f50f6076)
I20260709 13:06:38.949826 20076 leader_election.cc:304] T ab43d85f64114d4ebf618930e43d9ed0 P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 127766fc592545a4997f7790f50f6076, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:06:38.909478 19450 leader_election.cc:304] T 86a6797bdfe94fa496c050ceae4bd0d9 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:06:38.927192 24866 raft_consensus.cc:2749] T fa8650e71aa14778b3d73721fc50d9fc P e5256d91808b47c195bc9b4dbd7f2b87 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 13:06:39.011211 19450 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.3:36891, user_credentials={real_user=slave}} blocked reactor thread for 101794us
I20260709 13:06:38.938300 24790 raft_consensus.cc:3060] T 179fd671030940b4b4a4e24bcc4aba0a P e61c3a8f61bb48f8a963c9480e53c168 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:06:39.010470 19477 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58286 (request call id 2348) took 1059 ms. Trace:
W20260709 13:06:39.036178 19523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.1:40321, user_credentials={real_user=slave}} blocked reactor thread for 59028.7us
I20260709 13:06:39.038959 19477 rpcz_store.cc:276] 0709 13:06:37.967901 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:37.969431 (+  1530us) service_pool.cc:224] Handling call
0709 13:06:37.980948 (+ 11517us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:38.234186 (+253238us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:38.234236 (+    50us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:38.252017 (+ 17781us) log.cc:844] Serialized 26 byte log entry
0709 13:06:38.352080 (+100063us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:06:38.354641 (+  2561us) log.cc:844] Serialized 14 byte log entry
0709 13:06:38.355237 (+   596us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:38.953195 (+597958us) spinlock_profiling.cc:243] Waited 116 ms on lock 0x7b54003e94d4. stack: 00007f4a79de9343 00007f4a79de9240 00007f4a797781d4 00007f4a834b6304 00007f4a834b6299 00007f4a7ce71571 00007f4a7cf08e01 00007f4a7cf0783e 00007f4a81ecc419 00007f4a7b443bd4 00007f4a7b443b62 00007f4a7b443a91 00007f4a7b443a0c 00007f4a7b442cc2 00007f4a7b24348c 00007f4a7b2428c6
0709 13:06:38.953263 (+    68us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:38.953323 (+    60us) raft_consensus.cc:1685] finished
0709 13:06:39.010244 (+ 56921us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:39.010403 (+   159us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":47912,"prepare.queue_time_us":5430,"prepare.run_cpu_time_us":59,"prepare.run_wall_time_us":12661,"raft.queue_time_us":85799,"raft.run_cpu_time_us":346,"raft.run_wall_time_us":25923,"spinlock_wait_cycles":268555904,"thread_start_us":79933,"threads_started":2,"wal-append.queue_time_us":209171}
W20260709 13:06:39.047897 19377 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.2:46257, user_credentials={real_user=slave}} blocked reactor thread for 104539us
I20260709 13:06:39.049499 19450 leader_election.cc:304] T 1efebf73c86e432baa55533136b6e12c P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:06:38.946231 24795 raft_consensus.cc:3060] T 76cb037fc9064d13b59a8969d897ce8c P e61c3a8f61bb48f8a963c9480e53c168 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:06:38.946084 24926 raft_consensus.cc:493] T 1dc5b3532fe54f74876d02beffa2c230 P 0473d2b2d01f4459b1e90fd12cc7840e [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:06:39.047993 20076 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.3:36891, user_credentials={real_user=slave}} blocked reactor thread for 104511us
I20260709 13:06:38.927670 24875 raft_consensus.cc:515] T 2e36a9d6e29c4a7c860cf267efbd4c74 P 0473d2b2d01f4459b1e90fd12cc7840e [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:38.954880 24766 raft_consensus.cc:3060] T 7be9efa6559648dbb5a0f7684c4542d1 P 127766fc592545a4997f7790f50f6076 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:06:39.070689 19482 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58294 (request call id 2567) took 1351 ms (client timeout 1555 ms). Trace:
W20260709 13:06:39.076952 19482 rpcz_store.cc:269] 0709 13:06:37.718967 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:37.799017 (+ 80050us) service_pool.cc:224] Handling call
0709 13:06:39.070461 (+1271444us) spinlock_profiling.cc:243] Waited 280 ms on lock 0x7b54002b7fd4. stack: 00007f4a79de9343 00007f4a79de9240 00007f4a797781d4 00007f4a834b6304 00007f4a834b6299 00007f4a7ce71571 00007f4a7cf0c2fa 00007f4a81ecdb17 00007f4a7b4486d4 00007f4a7b448662 00007f4a7b448591 00007f4a7b44850c 00007f4a7b4477c2 00007f4a7b24348c 00007f4a7b2428c6 00007f4a7b24226f
0709 13:06:39.070610 (+   149us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":643015424}
I20260709 13:06:39.082898 19556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edd7d470b5014c9489be7f41f64355c9" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 17 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:06:39.080404 24876 raft_consensus.cc:697] T fa8650e71aa14778b3d73721fc50d9fc P 0473d2b2d01f4459b1e90fd12cc7840e [term 15 LEADER]: Becoming Leader. State: Replica: 0473d2b2d01f4459b1e90fd12cc7840e, State: Running, Role: LEADER
I20260709 13:06:39.144984 19405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "309c3ca0ca4b4f3ba129752ea2cb293b" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:06:39.145340 19407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46c5bfeecc314717bffe987e6844b6d0" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 21 candidate_status { last_received { term: 19 index: 9 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
I20260709 13:06:39.159338 24932 raft_consensus.cc:2804] T 1efebf73c86e432baa55533136b6e12c P 0473d2b2d01f4459b1e90fd12cc7840e [term 13 FOLLOWER]: Leader pre-election won for term 14
W20260709 13:06:39.160898 24956 log.cc:927] Time spent T 21e14947d70440f19044d8f75c31e1f9 P 0473d2b2d01f4459b1e90fd12cc7840e: Append to log took a long time: real 0.109s	user 0.000s	sys 0.000s
I20260709 13:06:39.157927 24372 consensus_queue.cc:237] T 40e1e16737a842ee936002830f36882e P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.8, Last appended by leader: 8, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:39.171497 19485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76cb037fc9064d13b59a8969d897ce8c" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:06:39.172436 19551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a61655d99124a29b486ba4a5b37faea" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:06:39.048135 24952 raft_consensus.cc:2749] T f1b10566f45d4a7d9029858330e02d5b P e5256d91808b47c195bc9b4dbd7f2b87 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:06:39.059723 24926 raft_consensus.cc:3060] T 1dc5b3532fe54f74876d02beffa2c230 P 0473d2b2d01f4459b1e90fd12cc7840e [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:06:39.172883 24943 raft_consensus.cc:515] T ff9b0eddd810459b82d91c60777c10eb P 0473d2b2d01f4459b1e90fd12cc7840e [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:39.197139 19558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a08760e15aac4630a629431f56024dc8" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:06:39.195873 19406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76cb037fc9064d13b59a8969d897ce8c" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:06:39.243434 19558 raft_consensus.cc:2468] T a08760e15aac4630a629431f56024dc8 P e61c3a8f61bb48f8a963c9480e53c168 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 18.
I20260709 13:06:39.164445 24891 raft_consensus.cc:2804] T 86a6797bdfe94fa496c050ceae4bd0d9 P 0473d2b2d01f4459b1e90fd12cc7840e [term 11 FOLLOWER]: Leader pre-election won for term 12
W20260709 13:06:39.186896 24960 log.cc:927] Time spent T 7f575b143b844aa096b50997dad3516a P 0473d2b2d01f4459b1e90fd12cc7840e: Append to log took a long time: real 0.125s	user 0.001s	sys 0.000s
I20260709 13:06:39.254987 19404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef32ce6fdd0e40d382c79974f30295c6" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 19 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
W20260709 13:06:39.204514 24927 log.cc:927] Time spent T bc225c93219c45538b53a1bd3d387e4d P e61c3a8f61bb48f8a963c9480e53c168: Append to log took a long time: real 0.125s	user 0.000s	sys 0.001s
W20260709 13:06:39.205551 24953 log.cc:927] Time spent T 179fd671030940b4b4a4e24bcc4aba0a P e5256d91808b47c195bc9b4dbd7f2b87: Append to log took a long time: real 0.262s	user 0.001s	sys 0.000s
I20260709 13:06:39.216513 24551 leader_election.cc:290] T ef32ce6fdd0e40d382c79974f30295c6 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
W20260709 13:06:39.258826 19374 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:39.259498 24943 leader_election.cc:290] T ff9b0eddd810459b82d91c60777c10eb P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:06:39.260020 24943 raft_consensus.cc:493] T ed7fdbcb96d14d418db9ca90a792588a P 0473d2b2d01f4459b1e90fd12cc7840e [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:39.260458 24943 raft_consensus.cc:515] T ed7fdbcb96d14d418db9ca90a792588a P 0473d2b2d01f4459b1e90fd12cc7840e [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:39.261655 19481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edd7d470b5014c9489be7f41f64355c9" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 17 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:06:39.262360 24943 leader_election.cc:290] T ed7fdbcb96d14d418db9ca90a792588a P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:06:38.956526 24276 raft_consensus.cc:515] T 48824d5acfbc485ebf8c2d944e7202de P 0473d2b2d01f4459b1e90fd12cc7840e [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:39.326535 24276 leader_election.cc:290] T 48824d5acfbc485ebf8c2d944e7202de P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:06:39.071698 24859 raft_consensus.cc:2804] T ab43d85f64114d4ebf618930e43d9ed0 P 127766fc592545a4997f7790f50f6076 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:06:39.208258 24866 raft_consensus.cc:493] T 86a6797bdfe94fa496c050ceae4bd0d9 P e5256d91808b47c195bc9b4dbd7f2b87 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:39.081153 24887 consensus_queue.cc:1048] T edd7d470b5014c9489be7f41f64355c9 P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.122s
I20260709 13:06:39.053124 24789 consensus_queue.cc:1059] T f93ee515a9c14139bf566522ed8232f3 P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 }, Status: INVALID_TERM, Last received: 15.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.122s
I20260709 13:06:39.328032 24866 raft_consensus.cc:515] T 86a6797bdfe94fa496c050ceae4bd0d9 P e5256d91808b47c195bc9b4dbd7f2b87 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:39.053768 24935 consensus_queue.cc:1048] T bc225c93219c45538b53a1bd3d387e4d P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.167s
I20260709 13:06:39.063642 24758 raft_consensus.cc:493] T 96efeaaf1057492490e9a621f37e1a2d P 127766fc592545a4997f7790f50f6076 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:39.186421 19480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ec1c4ce15e04c7e8c283a62179f2a64" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:06:39.241827 19410 raft_consensus.cc:1275] T 7f575b143b844aa096b50997dad3516a P e5256d91808b47c195bc9b4dbd7f2b87 [term 11 FOLLOWER]: Refusing update from remote peer e61c3a8f61bb48f8a963c9480e53c168: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 13:06:39.187212 19484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f575b143b844aa096b50997dad3516a" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:06:39.243944 19406 raft_consensus.cc:2468] T 76cb037fc9064d13b59a8969d897ce8c P e5256d91808b47c195bc9b4dbd7f2b87 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 13.
I20260709 13:06:39.177850 19485 raft_consensus.cc:2468] T 76cb037fc9064d13b59a8969d897ce8c P 0473d2b2d01f4459b1e90fd12cc7840e [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 13.
I20260709 13:06:39.186421 19409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28af091831594f9d8e96482078cc7625" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:06:39.187139 20111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "775c229504194560ba9589bc2199b089" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:06:39.188340 19403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4af19371ea874c09a0a2147040835cbb" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:06:39.188446 19551 raft_consensus.cc:2393] T 1a61655d99124a29b486ba4a5b37faea P e61c3a8f61bb48f8a963c9480e53c168 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0473d2b2d01f4459b1e90fd12cc7840e in current term 13: Already voted for candidate e61c3a8f61bb48f8a963c9480e53c168 in this term.
I20260709 13:06:39.245682 19477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cdf56e38bbc453d9438d359e5a69955" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:06:39.187332 19402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65d8cb8d6ec64f459d5a47cefab10acf" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
I20260709 13:06:39.188769 24597 raft_consensus.cc:493] T 70797e5783b5454ab0d0eea663e791e3 P e5256d91808b47c195bc9b4dbd7f2b87 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:39.189216 24898 raft_consensus.cc:493] T bc225c93219c45538b53a1bd3d387e4d P 0473d2b2d01f4459b1e90fd12cc7840e [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:06:39.195442 24958 log.cc:927] Time spent T edd7d470b5014c9489be7f41f64355c9 P 0473d2b2d01f4459b1e90fd12cc7840e: Append to log took a long time: real 0.252s	user 0.000s	sys 0.000s
I20260709 13:06:39.256124 19404 raft_consensus.cc:2468] T ef32ce6fdd0e40d382c79974f30295c6 P e5256d91808b47c195bc9b4dbd7f2b87 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 18.
I20260709 13:06:39.256876 24825 leader_election.cc:290] T 76cb037fc9064d13b59a8969d897ce8c P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:06:39.262862 19481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a08760e15aac4630a629431f56024dc8" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:06:39.057773 24838 raft_consensus.cc:515] T 0e1085d23e8347fbbd5bce7542f4b1f4 P e61c3a8f61bb48f8a963c9480e53c168 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:39.265515 24949 leader_election.cc:290] T 6c5eebf646ad445a9d1b1adc319d7b16 P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:06:39.261673 19375 leader_election.cc:304] T b9f0d59553ad444883fcf5b5909f9798 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:06:39.255206 24823 raft_consensus.cc:3055] T 46c5bfeecc314717bffe987e6844b6d0 P e5256d91808b47c195bc9b4dbd7f2b87 [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:06:39.188186 24876 consensus_queue.cc:237] T fa8650e71aa14778b3d73721fc50d9fc P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:39.255218 24891 raft_consensus.cc:493] T 86a6797bdfe94fa496c050ceae4bd0d9 P 0473d2b2d01f4459b1e90fd12cc7840e [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:39.268884 19555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed7fdbcb96d14d418db9ca90a792588a" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:06:39.370549 19408 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52328 (request call id 2297) took 1327 ms. Trace:
I20260709 13:06:39.269109 24867 leader_election.cc:290] T 7be9efa6559648dbb5a0f7684c4542d1 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:06:39.269454 19450 leader_election.cc:304] T a08760e15aac4630a629431f56024dc8 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:06:39.270419 24824 leader_election.cc:290] T 21e14947d70440f19044d8f75c31e1f9 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:06:39.272753 24875 leader_election.cc:290] T 2e36a9d6e29c4a7c860cf267efbd4c74 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:06:39.274269 24892 leader_election.cc:290] T 76cb037fc9064d13b59a8969d897ce8c P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:06:39.276265 19483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef32ce6fdd0e40d382c79974f30295c6" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 19 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:06:39.277585 24837 leader_election.cc:290] T 1a61655d99124a29b486ba4a5b37faea P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:06:39.060418 24930 raft_consensus.cc:515] T b08304a0a02b42d7840c4e8ee9a6bd1a P 0473d2b2d01f4459b1e90fd12cc7840e [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
W20260709 13:06:39.278854 24957 log.cc:927] Time spent T 70797e5783b5454ab0d0eea663e791e3 P e61c3a8f61bb48f8a963c9480e53c168: Append to log took a long time: real 0.081s	user 0.000s	sys 0.002s
I20260709 13:06:39.288552 19449 leader_election.cc:304] T b9f0d59553ad444883fcf5b5909f9798 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e; no voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:06:39.306488 24700 leader_election.cc:290] T df751f992649444090e27965eb1af85d P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 18 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:06:39.308348 24936 leader_election.cc:290] T e381f1d6b8184797ad142de49be225a8 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:06:39.177726 24932 raft_consensus.cc:493] T 1efebf73c86e432baa55533136b6e12c P 0473d2b2d01f4459b1e90fd12cc7840e [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:39.311486 19482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dc5b3532fe54f74876d02beffa2c230" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:06:39.336860 19560 raft_consensus.cc:2468] T 1dc5b3532fe54f74876d02beffa2c230 P e61c3a8f61bb48f8a963c9480e53c168 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 16.
I20260709 13:06:39.338007 20105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9962423cb4e54fcfa5de01daf68a86e7" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:06:39.083963 24781 consensus_queue.cc:1048] T 21e14947d70440f19044d8f75c31e1f9 P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.120s
W20260709 13:06:39.339457 19523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.1:40321, user_credentials={real_user=slave}} blocked reactor thread for 277739us
I20260709 13:06:39.457607 20105 raft_consensus.cc:2468] T 9962423cb4e54fcfa5de01daf68a86e7 P 127766fc592545a4997f7790f50f6076 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 14.
I20260709 13:06:39.458321 19523 leader_election.cc:304] T fa8650e71aa14778b3d73721fc50d9fc P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168; no voters: 0473d2b2d01f4459b1e90fd12cc7840e
I20260709 13:06:39.349334 19402 raft_consensus.cc:3060] T 65d8cb8d6ec64f459d5a47cefab10acf P e5256d91808b47c195bc9b4dbd7f2b87 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:06:39.351248 19406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86a6797bdfe94fa496c050ceae4bd0d9" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:06:39.460568 19406 raft_consensus.cc:2468] T 86a6797bdfe94fa496c050ceae4bd0d9 P e5256d91808b47c195bc9b4dbd7f2b87 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 11.
I20260709 13:06:39.358191 19481 raft_consensus.cc:2468] T a08760e15aac4630a629431f56024dc8 P 0473d2b2d01f4459b1e90fd12cc7840e [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 18.
I20260709 13:06:39.342923 24887 raft_consensus.cc:3055] T f93ee515a9c14139bf566522ed8232f3 P e61c3a8f61bb48f8a963c9480e53c168 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:06:39.370745 19484 raft_consensus.cc:1275] T 179fd671030940b4b4a4e24bcc4aba0a P 0473d2b2d01f4459b1e90fd12cc7840e [term 18 FOLLOWER]: Refusing update from remote peer e5256d91808b47c195bc9b4dbd7f2b87: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
I20260709 13:06:39.371004 19555 raft_consensus.cc:2468] T ed7fdbcb96d14d418db9ca90a792588a P e61c3a8f61bb48f8a963c9480e53c168 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 11.
W20260709 13:06:39.370909 19375 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.3:36891, user_credentials={real_user=slave}} blocked reactor thread for 109307us
I20260709 13:06:39.372449 19409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a61655d99124a29b486ba4a5b37faea" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:06:39.357216 24898 raft_consensus.cc:515] T bc225c93219c45538b53a1bd3d387e4d P 0473d2b2d01f4459b1e90fd12cc7840e [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:39.372777 24731 raft_consensus.cc:493] T 48824d5acfbc485ebf8c2d944e7202de P 127766fc592545a4997f7790f50f6076 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:39.374185 24825 raft_consensus.cc:2749] T b9f0d59553ad444883fcf5b5909f9798 P e5256d91808b47c195bc9b4dbd7f2b87 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:06:39.374596 19480 raft_consensus.cc:1240] T 309c3ca0ca4b4f3ba129752ea2cb293b P 0473d2b2d01f4459b1e90fd12cc7840e [term 10 FOLLOWER]: Rejecting Update request from peer 127766fc592545a4997f7790f50f6076 for earlier term 9. Current term is 10. Ops: []
I20260709 13:06:39.350903 24758 raft_consensus.cc:515] T 96efeaaf1057492490e9a621f37e1a2d P 127766fc592545a4997f7790f50f6076 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:39.374985 19479 raft_consensus.cc:1275] T ff9b0eddd810459b82d91c60777c10eb P 0473d2b2d01f4459b1e90fd12cc7840e [term 16 FOLLOWER]: Refusing update from remote peer 127766fc592545a4997f7790f50f6076: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 13:06:39.376169 24838 leader_election.cc:290] T 0e1085d23e8347fbbd5bce7542f4b1f4 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:06:39.365613 24691 raft_consensus.cc:493] T 1efebf73c86e432baa55533136b6e12c P 127766fc592545a4997f7790f50f6076 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:39.376502 19485 raft_consensus.cc:1275] T ed7fdbcb96d14d418db9ca90a792588a P 0473d2b2d01f4459b1e90fd12cc7840e [term 11 FOLLOWER]: Refusing update from remote peer 127766fc592545a4997f7790f50f6076: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:06:39.370399 24823 raft_consensus.cc:740] T 46c5bfeecc314717bffe987e6844b6d0 P e5256d91808b47c195bc9b4dbd7f2b87 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: e5256d91808b47c195bc9b4dbd7f2b87, State: Running, Role: LEADER
I20260709 13:06:39.374981 24482 raft_consensus.cc:3055] T 309c3ca0ca4b4f3ba129752ea2cb293b P 127766fc592545a4997f7790f50f6076 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:06:39.376927 24866 leader_election.cc:290] T 86a6797bdfe94fa496c050ceae4bd0d9 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
W20260709 13:06:39.380479 19450 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.3:36891, user_credentials={real_user=slave}} blocked reactor thread for 111094us
I20260709 13:06:39.381733 19405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9962423cb4e54fcfa5de01daf68a86e7" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
W20260709 13:06:39.414882 19377 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.17.223.2:46257 timed out after 1.555s (SENT) [suppressed 36 similar messages]
I20260709 13:06:39.415588 19411 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3e1f505cb0f1427bbd698ac889d80821"
dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
mode: GRACEFUL
new_leader_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
 from {username='slave'} at 127.0.0.1:37312
I20260709 13:06:39.416007 19526 leader_election.cc:400] T ab43d85f64114d4ebf618930e43d9ed0 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 16 election: Vote denied by peer 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257) with higher term. Message: Invalid argument: T ab43d85f64114d4ebf618930e43d9ed0 P 0473d2b2d01f4459b1e90fd12cc7840e [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate e61c3a8f61bb48f8a963c9480e53c168 for earlier term 16. Current term is 17.
I20260709 13:06:39.429868 19407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f575b143b844aa096b50997dad3516a" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
W20260709 13:06:39.442836 24962 log.cc:927] Time spent T f93ee515a9c14139bf566522ed8232f3 P e61c3a8f61bb48f8a963c9480e53c168: Append to log took a long time: real 0.065s	user 0.000s	sys 0.001s
I20260709 13:06:39.378353 24891 raft_consensus.cc:3060] T 86a6797bdfe94fa496c050ceae4bd0d9 P 0473d2b2d01f4459b1e90fd12cc7840e [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:06:39.481217 19407 raft_consensus.cc:2468] T 7f575b143b844aa096b50997dad3516a P e5256d91808b47c195bc9b4dbd7f2b87 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 11.
I20260709 13:06:39.482132 19526 leader_election.cc:403] T ab43d85f64114d4ebf618930e43d9ed0 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 16 election: Cancelling election due to peer responding with higher term
W20260709 13:06:39.446130 20078 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.2:46257, user_credentials={real_user=slave}} blocked reactor thread for 78847us
I20260709 13:06:39.485895 24949 raft_consensus.cc:493] T 65d8cb8d6ec64f459d5a47cefab10acf P 127766fc592545a4997f7790f50f6076 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader e5256d91808b47c195bc9b4dbd7f2b87)
I20260709 13:06:39.353780 24597 raft_consensus.cc:515] T 70797e5783b5454ab0d0eea663e791e3 P e5256d91808b47c195bc9b4dbd7f2b87 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:39.486388 24949 raft_consensus.cc:515] T 65d8cb8d6ec64f459d5a47cefab10acf P 127766fc592545a4997f7790f50f6076 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:39.488198 24597 leader_election.cc:290] T 70797e5783b5454ab0d0eea663e791e3 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:06:39.488453 24949 leader_election.cc:290] T 65d8cb8d6ec64f459d5a47cefab10acf P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:06:39.448020 24946 leader_election.cc:290] T 9962423cb4e54fcfa5de01daf68a86e7 P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:06:39.450098 24766 raft_consensus.cc:2749] T 7be9efa6559648dbb5a0f7684c4542d1 P 127766fc592545a4997f7790f50f6076 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:06:39.489019 20105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1efebf73c86e432baa55533136b6e12c" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
W20260709 13:06:39.455789 19449 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.1:40321, user_credentials={real_user=slave}} blocked reactor thread for 167334us
I20260709 13:06:39.348917 19477 raft_consensus.cc:2393] T 0cdf56e38bbc453d9438d359e5a69955 P 0473d2b2d01f4459b1e90fd12cc7840e [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate e5256d91808b47c195bc9b4dbd7f2b87 in current term 16: Already voted for candidate 0473d2b2d01f4459b1e90fd12cc7840e in this term.
I20260709 13:06:39.466797 19409 raft_consensus.cc:2468] T 1a61655d99124a29b486ba4a5b37faea P e5256d91808b47c195bc9b4dbd7f2b87 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 13.
I20260709 13:06:39.490428 19449 leader_election.cc:304] T d1e5873a19244c5ebbcd38e126796ee7 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e; no voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:06:39.370957 19408 rpcz_store.cc:276] 0709 13:06:38.040271 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:38.046917 (+  6646us) service_pool.cc:224] Handling call
0709 13:06:38.064435 (+ 17518us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:38.139379 (+ 74944us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:06:38.175863 (+ 36484us) log.cc:844] Serialized 14 byte log entry
0709 13:06:38.648463 (+472600us) spinlock_profiling.cc:243] Waited 5.76 ms on lock 0x7b1800219b20. stack: 00007f4a79de9343 00007f4a79de9240 00007f4a797781d4 00007f4a834b6304 00007f4a834b6299 00007f4a82ce3de1 00007f4a82cf05b1 00007f4a79dfde07 00007f4a82c58ab9 00007f4a79e1a69b 00007f4a79e1893f 00007f4a79e1ac02 00007f4a7caa220b 00007f4a7caa7d23 00007f4a7caa823a 00007f4a7cf12a2a
0709 13:06:39.051066 (+402603us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:39.051117 (+    51us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:06:39.051178 (+    61us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:39.367050 (+315872us) spinlock_profiling.cc:243] Waited 32.5 ms on lock 0x7b540023a354. stack: 00007f4a79de9343 00007f4a79de9240 00007f4a797781d4 00007f4a834b6304 00007f4a834b6299 00007f4a7ce71571 00007f4a7cf08e01 00007f4a7cf0783e 00007f4a81ecc419 00007f4a7b443bd4 00007f4a7b443b62 00007f4a7b443a91 00007f4a7b443a0c 00007f4a7b442cc2 00007f4a7b24348c 00007f4a7b2428c6
0709 13:06:39.367094 (+    44us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:39.367197 (+   103us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":17870,"prepare.queue_time_us":18817,"prepare.run_cpu_time_us":63,"prepare.run_wall_time_us":3052,"raft.queue_time_us":10344,"raft.run_cpu_time_us":158,"raft.run_wall_time_us":13596,"spinlock_wait_cycles":88046720,"thread_start_us":399806,"threads_started":1}
W20260709 13:06:39.466951 20075 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:39.481043 19411 raft_consensus.cc:606] T 3e1f505cb0f1427bbd698ac889d80821 P e5256d91808b47c195bc9b4dbd7f2b87 [term 17 FOLLOWER]: Received request to transfer leadership to TS 0473d2b2d01f4459b1e90fd12cc7840e
I20260709 13:06:39.495354 19411 raft_consensus.cc:614] T 3e1f505cb0f1427bbd698ac889d80821 P e5256d91808b47c195bc9b4dbd7f2b87 [term 17 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:06:39.480052 19375 leader_election.cc:304] T a08760e15aac4630a629431f56024dc8 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:06:39.498839 19375 leader_election.cc:304] T 1dc5b3532fe54f74876d02beffa2c230 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
W20260709 13:06:39.501943 19523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.1:40321, user_credentials={real_user=slave}} blocked reactor thread for 43714.9us
I20260709 13:06:39.456905 24892 raft_consensus.cc:2749] T b9f0d59553ad444883fcf5b5909f9798 P 0473d2b2d01f4459b1e90fd12cc7840e [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:06:39.503257 19560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76cb037fc9064d13b59a8969d897ce8c" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:06:39.500500 19450 leader_election.cc:304] T 0cdf56e38bbc453d9438d359e5a69955 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
W20260709 13:06:39.505684 19526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.2:46257, user_credentials={real_user=slave}} blocked reactor thread for 89953.3us
I20260709 13:06:39.460649 24932 raft_consensus.cc:3060] T 1efebf73c86e432baa55533136b6e12c P 0473d2b2d01f4459b1e90fd12cc7840e [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:06:39.506181 19523 leader_election.cc:304] T 3e1f505cb0f1427bbd698ac889d80821 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e61c3a8f61bb48f8a963c9480e53c168; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:06:39.465899 24573 raft_consensus.cc:2804] T a08760e15aac4630a629431f56024dc8 P 0473d2b2d01f4459b1e90fd12cc7840e [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:06:39.510222 19405 raft_consensus.cc:2393] T 9962423cb4e54fcfa5de01daf68a86e7 P e5256d91808b47c195bc9b4dbd7f2b87 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0473d2b2d01f4459b1e90fd12cc7840e in current term 14: Already voted for candidate e5256d91808b47c195bc9b4dbd7f2b87 in this term.
I20260709 13:06:39.453297 24795 raft_consensus.cc:515] T 76cb037fc9064d13b59a8969d897ce8c P e61c3a8f61bb48f8a963c9480e53c168 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:39.505347 24875 raft_consensus.cc:493] T e381f1d6b8184797ad142de49be225a8 P 0473d2b2d01f4459b1e90fd12cc7840e [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:39.465862 24887 raft_consensus.cc:740] T f93ee515a9c14139bf566522ed8232f3 P e61c3a8f61bb48f8a963c9480e53c168 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: e61c3a8f61bb48f8a963c9480e53c168, State: Running, Role: LEADER
I20260709 13:06:39.467624 24852 raft_consensus.cc:493] T 70797e5783b5454ab0d0eea663e791e3 P 127766fc592545a4997f7790f50f6076 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:39.513351 19555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef32ce6fdd0e40d382c79974f30295c6" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 19 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:06:39.498829 24482 raft_consensus.cc:740] T 309c3ca0ca4b4f3ba129752ea2cb293b P 127766fc592545a4997f7790f50f6076 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 127766fc592545a4997f7790f50f6076, State: Running, Role: LEADER
I20260709 13:06:39.468353 24789 consensus_queue.cc:1059] T 22196caba61445d3bec98a0aab3c337d P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 }, Status: INVALID_TERM, Last received: 13.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.047s
I20260709 13:06:39.519729 19557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7be9efa6559648dbb5a0f7684c4542d1" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:06:39.521747 19523 leader_election.cc:304] T 46c5bfeecc314717bffe987e6844b6d0 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e61c3a8f61bb48f8a963c9480e53c168; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:06:39.505383 24838 raft_consensus.cc:2764] T fa8650e71aa14778b3d73721fc50d9fc P e61c3a8f61bb48f8a963c9480e53c168 [term 15 FOLLOWER]: Leader pre-election decision vote started in defunct term 14: won
I20260709 13:06:39.526619 19557 raft_consensus.cc:2468] T 7be9efa6559648dbb5a0f7684c4542d1 P e61c3a8f61bb48f8a963c9480e53c168 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 14.
I20260709 13:06:39.526876 19551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21e14947d70440f19044d8f75c31e1f9" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:06:39.509929 24866 raft_consensus.cc:2804] T a08760e15aac4630a629431f56024dc8 P e5256d91808b47c195bc9b4dbd7f2b87 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:06:39.529111 19560 raft_consensus.cc:2393] T 76cb037fc9064d13b59a8969d897ce8c P e61c3a8f61bb48f8a963c9480e53c168 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e5256d91808b47c195bc9b4dbd7f2b87 in current term 14: Already voted for candidate e61c3a8f61bb48f8a963c9480e53c168 in this term.
I20260709 13:06:39.509023 24821 raft_consensus.cc:2804] T 1dc5b3532fe54f74876d02beffa2c230 P e5256d91808b47c195bc9b4dbd7f2b87 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:06:39.511859 24888 raft_consensus.cc:2749] T ab43d85f64114d4ebf618930e43d9ed0 P e61c3a8f61bb48f8a963c9480e53c168 [term 17 FOLLOWER]: Leader election lost for term 16. Reason: Vote denied by peer 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257) with higher term. Message: Invalid argument: T ab43d85f64114d4ebf618930e43d9ed0 P 0473d2b2d01f4459b1e90fd12cc7840e [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate e61c3a8f61bb48f8a963c9480e53c168 for earlier term 16. Current term is 17.
I20260709 13:06:39.530581 19523 leader_election.cc:304] T 309c3ca0ca4b4f3ba129752ea2cb293b P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: e61c3a8f61bb48f8a963c9480e53c168; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:06:39.532534 19558 raft_consensus.cc:1240] T 46c5bfeecc314717bffe987e6844b6d0 P e61c3a8f61bb48f8a963c9480e53c168 [term 21 FOLLOWER]: Rejecting Update request from peer e5256d91808b47c195bc9b4dbd7f2b87 for earlier term 20. Current term is 21. Ops: [20.10-20.10]
I20260709 13:06:39.511409 24276 raft_consensus.cc:2749] T d1e5873a19244c5ebbcd38e126796ee7 P 0473d2b2d01f4459b1e90fd12cc7840e [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:06:39.530411 19410 raft_consensus.cc:1275] T 309c3ca0ca4b4f3ba129752ea2cb293b P e5256d91808b47c195bc9b4dbd7f2b87 [term 9 FOLLOWER]: Refusing update from remote peer 127766fc592545a4997f7790f50f6076: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
I20260709 13:06:39.514742 24837 raft_consensus.cc:2749] T 3e1f505cb0f1427bbd698ac889d80821 P e61c3a8f61bb48f8a963c9480e53c168 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:06:39.513186 24939 raft_consensus.cc:2804] T 0cdf56e38bbc453d9438d359e5a69955 P 0473d2b2d01f4459b1e90fd12cc7840e [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:06:39.546289 19556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86a6797bdfe94fa496c050ceae4bd0d9" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:06:39.512817 24971 raft_consensus.cc:493] T 22196caba61445d3bec98a0aab3c337d P 0473d2b2d01f4459b1e90fd12cc7840e [term 13 FOLLOWER]: Starting pre-election (detected failure of leader e61c3a8f61bb48f8a963c9480e53c168)
I20260709 13:06:39.563609 19556 raft_consensus.cc:2468] T 86a6797bdfe94fa496c050ceae4bd0d9 P e61c3a8f61bb48f8a963c9480e53c168 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 11.
I20260709 13:06:39.567353 19409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9962423cb4e54fcfa5de01daf68a86e7" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:06:39.498413 24731 raft_consensus.cc:515] T 48824d5acfbc485ebf8c2d944e7202de P 127766fc592545a4997f7790f50f6076 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:39.570365 19559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70797e5783b5454ab0d0eea663e791e3" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:06:39.569069 19409 raft_consensus.cc:2468] T 9962423cb4e54fcfa5de01daf68a86e7 P e5256d91808b47c195bc9b4dbd7f2b87 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 127766fc592545a4997f7790f50f6076 in term 14.
I20260709 13:06:39.570379 19407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65d8cb8d6ec64f459d5a47cefab10acf" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:06:39.531173 24866 raft_consensus.cc:493] T a08760e15aac4630a629431f56024dc8 P e5256d91808b47c195bc9b4dbd7f2b87 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:39.534785 24859 raft_consensus.cc:697] T ab43d85f64114d4ebf618930e43d9ed0 P 127766fc592545a4997f7790f50f6076 [term 17 LEADER]: Becoming Leader. State: Replica: 127766fc592545a4997f7790f50f6076, State: Running, Role: LEADER
I20260709 13:06:39.572821 19523 leader_election.cc:304] T 28af091831594f9d8e96482078cc7625 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e61c3a8f61bb48f8a963c9480e53c168; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:06:39.579663 20075 leader_election.cc:304] T 9962423cb4e54fcfa5de01daf68a86e7 P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 127766fc592545a4997f7790f50f6076, e5256d91808b47c195bc9b4dbd7f2b87; no voters: 
W20260709 13:06:39.584858 19450 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.3:36891, user_credentials={real_user=slave}} blocked reactor thread for 80176.1us
I20260709 13:06:39.502199 24691 raft_consensus.cc:515] T 1efebf73c86e432baa55533136b6e12c P 127766fc592545a4997f7790f50f6076 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
W20260709 13:06:39.590803 19449 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.1:40321, user_credentials={real_user=slave}} blocked reactor thread for 86055.9us
W20260709 13:06:39.569391 24790 consensus_meta.cc:287] T 179fd671030940b4b4a4e24bcc4aba0a P e61c3a8f61bb48f8a963c9480e53c168: Time spent flushing consensus metadata: real 0.519s	user 0.009s	sys 0.003s
I20260709 13:06:39.519781 24875 raft_consensus.cc:515] T e381f1d6b8184797ad142de49be225a8 P 0473d2b2d01f4459b1e90fd12cc7840e [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:39.594266 19523 leader_election.cc:304] T ef32ce6fdd0e40d382c79974f30295c6 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:06:39.564661 24931 raft_consensus.cc:2749] T 46c5bfeecc314717bffe987e6844b6d0 P e61c3a8f61bb48f8a963c9480e53c168 [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 13:06:39.566700 24963 raft_consensus.cc:493] T 2a16f7501e2444fb86d4e2778e734e02 P 127766fc592545a4997f7790f50f6076 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:39.525552 24852 raft_consensus.cc:515] T 70797e5783b5454ab0d0eea663e791e3 P 127766fc592545a4997f7790f50f6076 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:39.570611 24838 raft_consensus.cc:3060] T 309c3ca0ca4b4f3ba129752ea2cb293b P e61c3a8f61bb48f8a963c9480e53c168 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:06:39.590157 19450 leader_election.cc:304] T ed7fdbcb96d14d418db9ca90a792588a P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:06:39.572832 24821 raft_consensus.cc:697] T 1dc5b3532fe54f74876d02beffa2c230 P e5256d91808b47c195bc9b4dbd7f2b87 [term 16 LEADER]: Becoming Leader. State: Replica: e5256d91808b47c195bc9b4dbd7f2b87, State: Running, Role: LEADER
I20260709 13:06:39.602998 19554 raft_consensus.cc:1275] T 179fd671030940b4b4a4e24bcc4aba0a P e61c3a8f61bb48f8a963c9480e53c168 [term 18 FOLLOWER]: Refusing update from remote peer e5256d91808b47c195bc9b4dbd7f2b87: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
I20260709 13:06:39.603930 24837 raft_consensus.cc:2749] T 28af091831594f9d8e96482078cc7625 P e61c3a8f61bb48f8a963c9480e53c168 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:06:39.580833 24939 raft_consensus.cc:697] T 0cdf56e38bbc453d9438d359e5a69955 P 0473d2b2d01f4459b1e90fd12cc7840e [term 16 LEADER]: Becoming Leader. State: Replica: 0473d2b2d01f4459b1e90fd12cc7840e, State: Running, Role: LEADER
I20260709 13:06:39.587319 24866 raft_consensus.cc:3060] T a08760e15aac4630a629431f56024dc8 P e5256d91808b47c195bc9b4dbd7f2b87 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:06:39.614290 20105 raft_consensus.cc:2468] T 1efebf73c86e432baa55533136b6e12c P 127766fc592545a4997f7790f50f6076 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 13.
I20260709 13:06:39.573689 24876 consensus_queue.cc:1048] T ef32ce6fdd0e40d382c79974f30295c6 P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.042s
I20260709 13:06:39.608630 24789 raft_consensus.cc:2804] T ef32ce6fdd0e40d382c79974f30295c6 P e61c3a8f61bb48f8a963c9480e53c168 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:06:39.631405 19486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c5eebf646ad445a9d1b1adc319d7b16" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:06:39.632956 19557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e36a9d6e29c4a7c860cf267efbd4c74" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:06:39.605427 24700 consensus_queue.cc:1048] T 7f575b143b844aa096b50997dad3516a P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.020s
I20260709 13:06:39.613648 24482 consensus_queue.cc:260] T 309c3ca0ca4b4f3ba129752ea2cb293b P 127766fc592545a4997f7790f50f6076 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.10, Last appended by leader: 10, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:39.639081 19551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76cb037fc9064d13b59a8969d897ce8c" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:06:39.694295 19486 raft_consensus.cc:2410] T 6c5eebf646ad445a9d1b1adc319d7b16 P 0473d2b2d01f4459b1e90fd12cc7840e [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 127766fc592545a4997f7790f50f6076 for term 16 because replica has last-logged OpId of term: 14 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 11.
I20260709 13:06:39.640434 19556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48824d5acfbc485ebf8c2d944e7202de" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:06:39.619120 24941 raft_consensus.cc:493] T 2725d2c4cb054f18b0fc8f735c15f6c2 P e5256d91808b47c195bc9b4dbd7f2b87 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader e61c3a8f61bb48f8a963c9480e53c168)
I20260709 13:06:39.694980 19556 raft_consensus.cc:2468] T 48824d5acfbc485ebf8c2d944e7202de P e61c3a8f61bb48f8a963c9480e53c168 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 17.
I20260709 13:06:39.695057 19555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc225c93219c45538b53a1bd3d387e4d" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 15 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:06:39.641191 24898 leader_election.cc:290] T bc225c93219c45538b53a1bd3d387e4d P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:06:39.641952 24795 leader_election.cc:290] T 76cb037fc9064d13b59a8969d897ce8c P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 14 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:06:39.574360 24971 raft_consensus.cc:515] T 22196caba61445d3bec98a0aab3c337d P 0473d2b2d01f4459b1e90fd12cc7840e [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:39.619771 24887 consensus_queue.cc:260] T f93ee515a9c14139bf566522ed8232f3 P e61c3a8f61bb48f8a963c9480e53c168 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 16.8, Last appended by leader: 8, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
W20260709 13:06:39.647701 24969 log.cc:927] Time spent T 309c3ca0ca4b4f3ba129752ea2cb293b P 127766fc592545a4997f7790f50f6076: Append to log took a long time: real 0.074s	user 0.000s	sys 0.000s
I20260709 13:06:39.649274 24597 raft_consensus.cc:493] T df751f992649444090e27965eb1af85d P e5256d91808b47c195bc9b4dbd7f2b87 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:39.653492 24983 raft_consensus.cc:2804] T ed7fdbcb96d14d418db9ca90a792588a P 0473d2b2d01f4459b1e90fd12cc7840e [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:06:39.654812 24926 raft_consensus.cc:515] T 1dc5b3532fe54f74876d02beffa2c230 P 0473d2b2d01f4459b1e90fd12cc7840e [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:39.656081 19375 leader_election.cc:304] T 86a6797bdfe94fa496c050ceae4bd0d9 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:06:39.684612 19477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9962423cb4e54fcfa5de01daf68a86e7" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:06:39.721252 19479 raft_consensus.cc:1240] T 309c3ca0ca4b4f3ba129752ea2cb293b P 0473d2b2d01f4459b1e90fd12cc7840e [term 10 FOLLOWER]: Rejecting Update request from peer 127766fc592545a4997f7790f50f6076 for earlier term 9. Current term is 10. Ops: []
I20260709 13:06:39.721881 19477 raft_consensus.cc:2468] T 9962423cb4e54fcfa5de01daf68a86e7 P 0473d2b2d01f4459b1e90fd12cc7840e [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 127766fc592545a4997f7790f50f6076 in term 13.
I20260709 13:06:39.659997 24859 consensus_queue.cc:237] T ab43d85f64114d4ebf618930e43d9ed0 P 127766fc592545a4997f7790f50f6076 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.10, Last appended by leader: 10, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:39.689450 19484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7be9efa6559648dbb5a0f7684c4542d1" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:06:39.636492 24972 raft_consensus.cc:493] T 9962423cb4e54fcfa5de01daf68a86e7 P e5256d91808b47c195bc9b4dbd7f2b87 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:39.694614 19551 raft_consensus.cc:2393] T 76cb037fc9064d13b59a8969d897ce8c P e61c3a8f61bb48f8a963c9480e53c168 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0473d2b2d01f4459b1e90fd12cc7840e in current term 14: Already voted for candidate e61c3a8f61bb48f8a963c9480e53c168 in this term.
I20260709 13:06:39.698848 19481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21e14947d70440f19044d8f75c31e1f9" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:06:39.647746 24573 raft_consensus.cc:493] T a08760e15aac4630a629431f56024dc8 P 0473d2b2d01f4459b1e90fd12cc7840e [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:39.622301 24975 raft_consensus.cc:2804] T 9962423cb4e54fcfa5de01daf68a86e7 P 127766fc592545a4997f7790f50f6076 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:06:39.723384 19484 raft_consensus.cc:2468] T 7be9efa6559648dbb5a0f7684c4542d1 P 0473d2b2d01f4459b1e90fd12cc7840e [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 14.
I20260709 13:06:39.584992 24823 consensus_queue.cc:260] T 46c5bfeecc314717bffe987e6844b6d0 P e5256d91808b47c195bc9b4dbd7f2b87 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 20.10, Last appended by leader: 10, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
W20260709 13:06:39.727916 19375 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.3:36891, user_credentials={real_user=slave}} blocked reactor thread for 71886.7us
W20260709 13:06:39.729138 19377 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.2:46257, user_credentials={real_user=slave}} blocked reactor thread for 314279us
W20260709 13:06:39.735442 20075 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.1:40321, user_credentials={real_user=slave}} blocked reactor thread for 155853us
I20260709 13:06:39.701519 19402 raft_consensus.cc:2468] T 65d8cb8d6ec64f459d5a47cefab10acf P e5256d91808b47c195bc9b4dbd7f2b87 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 17.
I20260709 13:06:39.614053 24963 raft_consensus.cc:515] T 2a16f7501e2444fb86d4e2778e734e02 P 127766fc592545a4997f7790f50f6076 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:39.692492 24789 raft_consensus.cc:493] T ef32ce6fdd0e40d382c79974f30295c6 P e61c3a8f61bb48f8a963c9480e53c168 [term 18 FOLLOWER]: Starting leader election (detected failure of leader 0473d2b2d01f4459b1e90fd12cc7840e)
I20260709 13:06:39.741029 19485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86a6797bdfe94fa496c050ceae4bd0d9" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:06:39.771978 19482 raft_consensus.cc:2368] T 1dc5b3532fe54f74876d02beffa2c230 P 0473d2b2d01f4459b1e90fd12cc7840e [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate e5256d91808b47c195bc9b4dbd7f2b87 for earlier term 16. Current term is 17.
I20260709 13:06:39.700714 24626 consensus_queue.cc:1048] T 309c3ca0ca4b4f3ba129752ea2cb293b P 127766fc592545a4997f7790f50f6076 [NON_LEADER]: Connected to new peer: Peer: permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.047s
I20260709 13:06:39.720575 24983 raft_consensus.cc:493] T ed7fdbcb96d14d418db9ca90a792588a P 0473d2b2d01f4459b1e90fd12cc7840e [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:06:39.772374 19523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.1:40321, user_credentials={real_user=slave}} blocked reactor thread for 170833us
I20260709 13:06:39.691385 24949 consensus_queue.cc:1048] T ed7fdbcb96d14d418db9ca90a792588a P 127766fc592545a4997f7790f50f6076 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.045s
I20260709 13:06:39.726653 24824 raft_consensus.cc:493] T 3e1f505cb0f1427bbd698ac889d80821 P e5256d91808b47c195bc9b4dbd7f2b87 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:39.776346 19377 leader_election.cc:304] T edd7d470b5014c9489be7f41f64355c9 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:06:39.734977 24867 raft_consensus.cc:2804] T 86a6797bdfe94fa496c050ceae4bd0d9 P e5256d91808b47c195bc9b4dbd7f2b87 [term 11 FOLLOWER]: Leader pre-election won for term 12
W20260709 13:06:39.781852 19449 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.1:40321, user_credentials={real_user=slave}} blocked reactor thread for 190084us
I20260709 13:06:39.737267 24573 raft_consensus.cc:3060] T a08760e15aac4630a629431f56024dc8 P 0473d2b2d01f4459b1e90fd12cc7840e [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:06:39.704210 24941 raft_consensus.cc:515] T 2725d2c4cb054f18b0fc8f735c15f6c2 P e5256d91808b47c195bc9b4dbd7f2b87 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:39.784219 19560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c5eebf646ad445a9d1b1adc319d7b16" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:06:39.737547 24975 raft_consensus.cc:493] T 9962423cb4e54fcfa5de01daf68a86e7 P 127766fc592545a4997f7790f50f6076 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:39.787142 19560 raft_consensus.cc:2410] T 6c5eebf646ad445a9d1b1adc319d7b16 P e61c3a8f61bb48f8a963c9480e53c168 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 127766fc592545a4997f7790f50f6076 for term 16 because replica has last-logged OpId of term: 14 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 11.
I20260709 13:06:39.773679 24789 raft_consensus.cc:3060] T ef32ce6fdd0e40d382c79974f30295c6 P e61c3a8f61bb48f8a963c9480e53c168 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:06:39.726344 24891 raft_consensus.cc:515] T 86a6797bdfe94fa496c050ceae4bd0d9 P 0473d2b2d01f4459b1e90fd12cc7840e [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:39.788980 19556 raft_consensus.cc:1275] T ed7fdbcb96d14d418db9ca90a792588a P e61c3a8f61bb48f8a963c9480e53c168 [term 11 FOLLOWER]: Refusing update from remote peer 127766fc592545a4997f7790f50f6076: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:06:39.777432 24758 leader_election.cc:290] T 96efeaaf1057492490e9a621f37e1a2d P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:06:39.796996 20103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ec1c4ce15e04c7e8c283a62179f2a64" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:06:39.796037 19449 leader_election.cc:304] T edd7d470b5014c9489be7f41f64355c9 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87; no voters: e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:06:39.777797 24942 raft_consensus.cc:493] T 309c3ca0ca4b4f3ba129752ea2cb293b P e5256d91808b47c195bc9b4dbd7f2b87 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 127766fc592545a4997f7790f50f6076)
I20260709 13:06:39.780767 24983 raft_consensus.cc:3060] T ed7fdbcb96d14d418db9ca90a792588a P 0473d2b2d01f4459b1e90fd12cc7840e [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:06:39.807143 20112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70797e5783b5454ab0d0eea663e791e3" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:06:39.810851 19449 leader_election.cc:304] T 7f575b143b844aa096b50997dad3516a P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87; no voters: e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:06:39.811367 20112 raft_consensus.cc:2468] T 70797e5783b5454ab0d0eea663e791e3 P 127766fc592545a4997f7790f50f6076 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 15.
I20260709 13:06:39.808082 20104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7be9efa6559648dbb5a0f7684c4542d1" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:06:39.812428 20104 raft_consensus.cc:2468] T 7be9efa6559648dbb5a0f7684c4542d1 P 127766fc592545a4997f7790f50f6076 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 14.
I20260709 13:06:39.782874 24867 raft_consensus.cc:493] T 86a6797bdfe94fa496c050ceae4bd0d9 P e5256d91808b47c195bc9b4dbd7f2b87 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:39.728833 24597 raft_consensus.cc:515] T df751f992649444090e27965eb1af85d P e5256d91808b47c195bc9b4dbd7f2b87 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:39.743446 24825 consensus_queue.cc:1059] T 46c5bfeecc314717bffe987e6844b6d0 P e5256d91808b47c195bc9b4dbd7f2b87 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 }, Status: INVALID_TERM, Last received: 19.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.059s
I20260709 13:06:39.819765 20111 raft_consensus.cc:1275] T 172b3dd13109415a955b71ac0e9d2234 P 127766fc592545a4997f7790f50f6076 [term 14 FOLLOWER]: Refusing update from remote peer e5256d91808b47c195bc9b4dbd7f2b87: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 13:06:39.823552 19485 raft_consensus.cc:2393] T 86a6797bdfe94fa496c050ceae4bd0d9 P 0473d2b2d01f4459b1e90fd12cc7840e [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e5256d91808b47c195bc9b4dbd7f2b87 in current term 12: Already voted for candidate 0473d2b2d01f4459b1e90fd12cc7840e in this term.
I20260709 13:06:39.796761 24975 raft_consensus.cc:3060] T 9962423cb4e54fcfa5de01daf68a86e7 P 127766fc592545a4997f7790f50f6076 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:06:39.826649 20106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa731b585f684a7fb2d106c50f143b83" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:06:39.827008 24372 raft_consensus.cc:493] T e381f1d6b8184797ad142de49be225a8 P e5256d91808b47c195bc9b4dbd7f2b87 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:39.830927 24372 raft_consensus.cc:515] T e381f1d6b8184797ad142de49be225a8 P e5256d91808b47c195bc9b4dbd7f2b87 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:39.833014 24372 leader_election.cc:290] T e381f1d6b8184797ad142de49be225a8 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:06:39.738282 24972 raft_consensus.cc:515] T 9962423cb4e54fcfa5de01daf68a86e7 P e5256d91808b47c195bc9b4dbd7f2b87 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:39.833952 19484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96efeaaf1057492490e9a621f37e1a2d" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 18 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:06:39.834273 24973 consensus_queue.cc:1048] T ff9b0eddd810459b82d91c60777c10eb P 127766fc592545a4997f7790f50f6076 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.131s
I20260709 13:06:39.835712 24972 leader_election.cc:290] T 9962423cb4e54fcfa5de01daf68a86e7 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:06:39.835932 20076 leader_election.cc:304] T 6c5eebf646ad445a9d1b1adc319d7b16 P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 127766fc592545a4997f7790f50f6076; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:06:39.836670 20111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65d8cb8d6ec64f459d5a47cefab10acf" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076"
I20260709 13:06:39.837167 20104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c5eebf646ad445a9d1b1adc319d7b16" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076"
I20260709 13:06:39.837987 20104 raft_consensus.cc:2393] T 6c5eebf646ad445a9d1b1adc319d7b16 P 127766fc592545a4997f7790f50f6076 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate e61c3a8f61bb48f8a963c9480e53c168 in current term 15: Already voted for candidate 127766fc592545a4997f7790f50f6076 in this term.
I20260709 13:06:39.838858 20107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e1085d23e8347fbbd5bce7542f4b1f4" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
W20260709 13:06:39.839273 24977 log.cc:927] Time spent T ef32ce6fdd0e40d382c79974f30295c6 P e61c3a8f61bb48f8a963c9480e53c168: Append to log took a long time: real 0.142s	user 0.001s	sys 0.000s
I20260709 13:06:39.839671 24981 raft_consensus.cc:2749] T 6c5eebf646ad445a9d1b1adc319d7b16 P 127766fc592545a4997f7790f50f6076 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:06:39.838950 20112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4af19371ea874c09a0a2147040835cbb" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:06:39.840407 24964 raft_consensus.cc:493] T 2a16f7501e2444fb86d4e2778e734e02 P e5256d91808b47c195bc9b4dbd7f2b87 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:06:39.840776 24980 log.cc:927] Time spent T fa8650e71aa14778b3d73721fc50d9fc P 0473d2b2d01f4459b1e90fd12cc7840e: Append to log took a long time: real 0.101s	user 0.000s	sys 0.000s
I20260709 13:06:39.840939 24964 raft_consensus.cc:515] T 2a16f7501e2444fb86d4e2778e734e02 P e5256d91808b47c195bc9b4dbd7f2b87 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:39.841693 20104 raft_consensus.cc:1275] T 2a16f7501e2444fb86d4e2778e734e02 P 127766fc592545a4997f7790f50f6076 [term 15 FOLLOWER]: Refusing update from remote peer e61c3a8f61bb48f8a963c9480e53c168: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 13:06:39.842056 19402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70797e5783b5454ab0d0eea663e791e3" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:06:39.837244 20111 raft_consensus.cc:3060] T 65d8cb8d6ec64f459d5a47cefab10acf P 127766fc592545a4997f7790f50f6076 [term 15 FOLLOWER]: Advancing to term 17
I20260709 13:06:39.842633 19402 raft_consensus.cc:2468] T 70797e5783b5454ab0d0eea663e791e3 P e5256d91808b47c195bc9b4dbd7f2b87 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 127766fc592545a4997f7790f50f6076 in term 15.
I20260709 13:06:39.842840 24942 raft_consensus.cc:515] T 309c3ca0ca4b4f3ba129752ea2cb293b P e5256d91808b47c195bc9b4dbd7f2b87 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } attrs { replace: true } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:39.725841 24939 consensus_queue.cc:237] T 0cdf56e38bbc453d9438d359e5a69955 P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
W20260709 13:06:39.845585 24976 log.cc:927] Time spent T 40e1e16737a842ee936002830f36882e P e5256d91808b47c195bc9b4dbd7f2b87: Append to log took a long time: real 0.226s	user 0.000s	sys 0.000s
I20260709 13:06:39.845821 24942 leader_election.cc:290] T 309c3ca0ca4b4f3ba129752ea2cb293b P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:06:39.840718 20106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "309c3ca0ca4b4f3ba129752ea2cb293b" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:06:39.847713 24891 leader_election.cc:290] T 86a6797bdfe94fa496c050ceae4bd0d9 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 12 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:06:39.822161 24898 raft_consensus.cc:2804] T 7f575b143b844aa096b50997dad3516a P 0473d2b2d01f4459b1e90fd12cc7840e [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:06:39.848562 24898 raft_consensus.cc:493] T 7f575b143b844aa096b50997dad3516a P 0473d2b2d01f4459b1e90fd12cc7840e [term 11 FOLLOWER]: Starting leader election (detected failure of leader e61c3a8f61bb48f8a963c9480e53c168)
I20260709 13:06:39.848920 24898 raft_consensus.cc:3060] T 7f575b143b844aa096b50997dad3516a P 0473d2b2d01f4459b1e90fd12cc7840e [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:06:39.849279 24758 consensus_queue.cc:1048] T ed7fdbcb96d14d418db9ca90a792588a P 127766fc592545a4997f7790f50f6076 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:06:39.810684 24798 raft_consensus.cc:2749] T edd7d470b5014c9489be7f41f64355c9 P e5256d91808b47c195bc9b4dbd7f2b87 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:06:39.852209 24926 leader_election.cc:290] T 1dc5b3532fe54f74876d02beffa2c230 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 17 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:06:39.839843 20110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab43d85f64114d4ebf618930e43d9ed0" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076"
I20260709 13:06:39.855350 24936 raft_consensus.cc:493] T b08304a0a02b42d7840c4e8ee9a6bd1a P e61c3a8f61bb48f8a963c9480e53c168 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:39.855839 24936 raft_consensus.cc:515] T b08304a0a02b42d7840c4e8ee9a6bd1a P e61c3a8f61bb48f8a963c9480e53c168 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:39.784407 24824 raft_consensus.cc:515] T 3e1f505cb0f1427bbd698ac889d80821 P e5256d91808b47c195bc9b4dbd7f2b87 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:39.857885 24824 leader_election.cc:290] T 3e1f505cb0f1427bbd698ac889d80821 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:06:39.858146 24936 leader_election.cc:290] T b08304a0a02b42d7840c4e8ee9a6bd1a P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:06:39.858352 19556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65d8cb8d6ec64f459d5a47cefab10acf" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:06:39.860695 24691 leader_election.cc:290] T 1efebf73c86e432baa55533136b6e12c P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:06:39.866197 24702 raft_consensus.cc:3055] T 22196caba61445d3bec98a0aab3c337d P e61c3a8f61bb48f8a963c9480e53c168 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:06:39.866642 24702 raft_consensus.cc:740] T 22196caba61445d3bec98a0aab3c337d P e61c3a8f61bb48f8a963c9480e53c168 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: e61c3a8f61bb48f8a963c9480e53c168, State: Running, Role: LEADER
I20260709 13:06:39.866864 19556 raft_consensus.cc:2368] T 65d8cb8d6ec64f459d5a47cefab10acf P e61c3a8f61bb48f8a963c9480e53c168 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 127766fc592545a4997f7790f50f6076 for earlier term 16. Current term is 17.
I20260709 13:06:39.867445 24702 consensus_queue.cc:260] T 22196caba61445d3bec98a0aab3c337d P e61c3a8f61bb48f8a963c9480e53c168 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:39.868621 24702 raft_consensus.cc:3060] T 22196caba61445d3bec98a0aab3c337d P e61c3a8f61bb48f8a963c9480e53c168 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:06:39.871589 24963 leader_election.cc:290] T 2a16f7501e2444fb86d4e2778e734e02 P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:06:39.871660 24731 leader_election.cc:290] T 48824d5acfbc485ebf8c2d944e7202de P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:06:39.872255 24866 raft_consensus.cc:515] T a08760e15aac4630a629431f56024dc8 P e5256d91808b47c195bc9b4dbd7f2b87 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:39.873903 19374 leader_election.cc:304] T 70797e5783b5454ab0d0eea663e791e3 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 127766fc592545a4997f7790f50f6076, e5256d91808b47c195bc9b4dbd7f2b87; no voters: e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:06:39.874076 24941 leader_election.cc:290] T 2725d2c4cb054f18b0fc8f735c15f6c2 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:06:39.874275 24866 leader_election.cc:290] T a08760e15aac4630a629431f56024dc8 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 19 election: Requested vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:06:39.871734 20075 leader_election.cc:304] T 70797e5783b5454ab0d0eea663e791e3 P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 127766fc592545a4997f7790f50f6076, e5256d91808b47c195bc9b4dbd7f2b87; no voters: 
W20260709 13:06:39.858994 19523 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:39.878650 24823 raft_consensus.cc:3060] T 46c5bfeecc314717bffe987e6844b6d0 P e5256d91808b47c195bc9b4dbd7f2b87 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:06:39.879644 24482 raft_consensus.cc:3060] T 309c3ca0ca4b4f3ba129752ea2cb293b P 127766fc592545a4997f7790f50f6076 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:06:39.879575 24932 raft_consensus.cc:515] T 1efebf73c86e432baa55533136b6e12c P 0473d2b2d01f4459b1e90fd12cc7840e [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:39.881855 24932 leader_election.cc:290] T 1efebf73c86e432baa55533136b6e12c P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 14 election: Requested vote from peers e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:06:39.814203 24986 raft_consensus.cc:2804] T edd7d470b5014c9489be7f41f64355c9 P 0473d2b2d01f4459b1e90fd12cc7840e [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:06:39.883030 24986 raft_consensus.cc:493] T edd7d470b5014c9489be7f41f64355c9 P 0473d2b2d01f4459b1e90fd12cc7840e [term 16 FOLLOWER]: Starting leader election (detected failure of leader e61c3a8f61bb48f8a963c9480e53c168)
I20260709 13:06:39.883397 24986 raft_consensus.cc:3060] T edd7d470b5014c9489be7f41f64355c9 P 0473d2b2d01f4459b1e90fd12cc7840e [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:06:39.834120 19450 leader_election.cc:304] T 48824d5acfbc485ebf8c2d944e7202de P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
W20260709 13:06:39.885574 19450 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.3:36891, user_credentials={real_user=slave}} blocked reactor thread for 51527.7us
I20260709 13:06:39.816794 24867 raft_consensus.cc:3060] T 86a6797bdfe94fa496c050ceae4bd0d9 P e5256d91808b47c195bc9b4dbd7f2b87 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:06:39.839395 20103 raft_consensus.cc:1275] T ece3db938bc649d4a40a51522ed5259c P 127766fc592545a4997f7790f50f6076 [term 12 FOLLOWER]: Refusing update from remote peer e61c3a8f61bb48f8a963c9480e53c168: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 13:06:39.841651 24597 leader_election.cc:290] T df751f992649444090e27965eb1af85d P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:06:39.889036 19483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1efebf73c86e432baa55533136b6e12c" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:06:39.892235 19483 raft_consensus.cc:2393] T 1efebf73c86e432baa55533136b6e12c P 0473d2b2d01f4459b1e90fd12cc7840e [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 127766fc592545a4997f7790f50f6076 in current term 14: Already voted for candidate 0473d2b2d01f4459b1e90fd12cc7840e in this term.
I20260709 13:06:39.892598 19486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48824d5acfbc485ebf8c2d944e7202de" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:06:39.894147 24852 leader_election.cc:290] T 70797e5783b5454ab0d0eea663e791e3 P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:06:39.895303 19374 leader_election.cc:304] T 7be9efa6559648dbb5a0f7684c4542d1 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 127766fc592545a4997f7790f50f6076, e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:06:39.896381 24798 raft_consensus.cc:2804] T 70797e5783b5454ab0d0eea663e791e3 P e5256d91808b47c195bc9b4dbd7f2b87 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:06:39.896687 24930 leader_election.cc:290] T b08304a0a02b42d7840c4e8ee9a6bd1a P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 16 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:06:39.896642 19523 leader_election.cc:304] T 833a2f0775ed407a94b8924ce50adb63 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e61c3a8f61bb48f8a963c9480e53c168; no voters: 127766fc592545a4997f7790f50f6076, e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:06:39.897147 24941 raft_consensus.cc:2804] T 7be9efa6559648dbb5a0f7684c4542d1 P e5256d91808b47c195bc9b4dbd7f2b87 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:06:39.854239 20111 raft_consensus.cc:2468] T 65d8cb8d6ec64f459d5a47cefab10acf P 127766fc592545a4997f7790f50f6076 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 17.
I20260709 13:06:39.897642 24941 raft_consensus.cc:493] T 7be9efa6559648dbb5a0f7684c4542d1 P e5256d91808b47c195bc9b4dbd7f2b87 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:39.897389 24972 consensus_queue.cc:1048] T 172b3dd13109415a955b71ac0e9d2234 P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Connected to new peer: Peer: permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:06:39.898020 24941 raft_consensus.cc:3060] T 7be9efa6559648dbb5a0f7684c4542d1 P e5256d91808b47c195bc9b4dbd7f2b87 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:06:39.898159 24971 leader_election.cc:290] T 22196caba61445d3bec98a0aab3c337d P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:06:39.898154 24936 raft_consensus.cc:2749] T 833a2f0775ed407a94b8924ce50adb63 P e61c3a8f61bb48f8a963c9480e53c168 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:06:39.898953 24798 raft_consensus.cc:493] T 70797e5783b5454ab0d0eea663e791e3 P e5256d91808b47c195bc9b4dbd7f2b87 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:39.899405 24798 raft_consensus.cc:3060] T 70797e5783b5454ab0d0eea663e791e3 P e5256d91808b47c195bc9b4dbd7f2b87 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:06:39.783329 24821 consensus_queue.cc:237] T 1dc5b3532fe54f74876d02beffa2c230 P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.8, Last appended by leader: 8, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:39.900988 19523 leader_election.cc:304] T fa731b585f684a7fb2d106c50f143b83 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e61c3a8f61bb48f8a963c9480e53c168; no voters: 127766fc592545a4997f7790f50f6076, e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:06:39.889725 24926 raft_consensus.cc:2804] T 48824d5acfbc485ebf8c2d944e7202de P 0473d2b2d01f4459b1e90fd12cc7840e [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:06:39.901925 24926 raft_consensus.cc:493] T 48824d5acfbc485ebf8c2d944e7202de P 0473d2b2d01f4459b1e90fd12cc7840e [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:39.902278 24926 raft_consensus.cc:3060] T 48824d5acfbc485ebf8c2d944e7202de P 0473d2b2d01f4459b1e90fd12cc7840e [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:06:39.903170 24936 raft_consensus.cc:2749] T fa731b585f684a7fb2d106c50f143b83 P e61c3a8f61bb48f8a963c9480e53c168 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:06:39.904966 19523 leader_election.cc:304] T 4af19371ea874c09a0a2147040835cbb P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e61c3a8f61bb48f8a963c9480e53c168; no voters: 127766fc592545a4997f7790f50f6076, e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:06:39.907061 19553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b08304a0a02b42d7840c4e8ee9a6bd1a" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:06:39.907619 19553 raft_consensus.cc:3060] T b08304a0a02b42d7840c4e8ee9a6bd1a P e61c3a8f61bb48f8a963c9480e53c168 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:06:39.843578 20108 raft_consensus.cc:1275] T 70797e5783b5454ab0d0eea663e791e3 P 127766fc592545a4997f7790f50f6076 [term 15 FOLLOWER]: Refusing update from remote peer e61c3a8f61bb48f8a963c9480e53c168: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 13:06:39.916560 19449 leader_election.cc:304] T 1a61655d99124a29b486ba4a5b37faea P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87; no voters: e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:06:39.842581 20109 raft_consensus.cc:1275] T 96efeaaf1057492490e9a621f37e1a2d P 127766fc592545a4997f7790f50f6076 [term 17 FOLLOWER]: Refusing update from remote peer e61c3a8f61bb48f8a963c9480e53c168: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
W20260709 13:06:39.896835 19374 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:39.921468 19556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dc5b3532fe54f74876d02beffa2c230" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:06:39.922223 19556 raft_consensus.cc:3060] T 1dc5b3532fe54f74876d02beffa2c230 P e61c3a8f61bb48f8a963c9480e53c168 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:06:39.933960 20111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "309c3ca0ca4b4f3ba129752ea2cb293b" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:06:39.935667 19523 leader_election.cc:304] T 65d8cb8d6ec64f459d5a47cefab10acf P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 127766fc592545a4997f7790f50f6076, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:06:39.936970 20108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9962423cb4e54fcfa5de01daf68a86e7" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:06:39.936980 19559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86a6797bdfe94fa496c050ceae4bd0d9" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:06:39.945788 19559 raft_consensus.cc:3060] T 86a6797bdfe94fa496c050ceae4bd0d9 P e61c3a8f61bb48f8a963c9480e53c168 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:06:39.945605 19526 leader_election.cc:304] T 6c5eebf646ad445a9d1b1adc319d7b16 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168; no voters: 127766fc592545a4997f7790f50f6076
I20260709 13:06:39.946346 19553 raft_consensus.cc:2468] T b08304a0a02b42d7840c4e8ee9a6bd1a P e61c3a8f61bb48f8a963c9480e53c168 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 16.
I20260709 13:06:39.948081 19402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a16f7501e2444fb86d4e2778e734e02" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:06:39.952610 19402 raft_consensus.cc:2410] T 2a16f7501e2444fb86d4e2778e734e02 P e5256d91808b47c195bc9b4dbd7f2b87 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 127766fc592545a4997f7790f50f6076 for term 16 because replica has last-logged OpId of term: 14 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 11.
I20260709 13:06:39.953207 19411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff9b0eddd810459b82d91c60777c10eb" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:06:39.954919 19409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e36a9d6e29c4a7c860cf267efbd4c74" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:06:39.959995 20076 leader_election.cc:400] T 65d8cb8d6ec64f459d5a47cefab10acf P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 16 pre-election: Vote denied by peer e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891) with higher term. Message: Invalid argument: T 65d8cb8d6ec64f459d5a47cefab10acf P e61c3a8f61bb48f8a963c9480e53c168 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 127766fc592545a4997f7790f50f6076 for earlier term 16. Current term is 17.
I20260709 13:06:39.960462 20076 leader_election.cc:403] T 65d8cb8d6ec64f459d5a47cefab10acf P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 16 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:06:39.931820 24758 raft_consensus.cc:2804] T 70797e5783b5454ab0d0eea663e791e3 P 127766fc592545a4997f7790f50f6076 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:06:39.950587 24990 raft_consensus.cc:493] T 46c5bfeecc314717bffe987e6844b6d0 P 0473d2b2d01f4459b1e90fd12cc7840e [term 20 FOLLOWER]: Starting pre-election (detected failure of leader e5256d91808b47c195bc9b4dbd7f2b87)
I20260709 13:06:39.963922 20110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed7fdbcb96d14d418db9ca90a792588a" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:06:39.966801 24875 leader_election.cc:290] T e381f1d6b8184797ad142de49be225a8 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:06:39.938542 24798 raft_consensus.cc:515] T 70797e5783b5454ab0d0eea663e791e3 P e5256d91808b47c195bc9b4dbd7f2b87 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:40.001796 19551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96efeaaf1057492490e9a621f37e1a2d" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 18 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:06:39.967649 20109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48824d5acfbc485ebf8c2d944e7202de" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
W20260709 13:06:39.970570 24979 log.cc:927] Time spent T 3e1f505cb0f1427bbd698ac889d80821 P 0473d2b2d01f4459b1e90fd12cc7840e: Append to log took a long time: real 0.311s	user 0.002s	sys 0.000s
I20260709 13:06:40.008877 20109 raft_consensus.cc:2468] T 48824d5acfbc485ebf8c2d944e7202de P 127766fc592545a4997f7790f50f6076 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 17.
I20260709 13:06:39.981146 24941 raft_consensus.cc:515] T 7be9efa6559648dbb5a0f7684c4542d1 P e5256d91808b47c195bc9b4dbd7f2b87 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } attrs { replace: true } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:39.976418 24983 raft_consensus.cc:515] T ed7fdbcb96d14d418db9ca90a792588a P 0473d2b2d01f4459b1e90fd12cc7840e [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:39.931334 24936 raft_consensus.cc:2749] T 4af19371ea874c09a0a2147040835cbb P e61c3a8f61bb48f8a963c9480e53c168 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:06:39.946446 24837 consensus_queue.cc:1048] T ece3db938bc649d4a40a51522ed5259c P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Connected to new peer: Peer: permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.031s
I20260709 13:06:40.024910 19554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1efebf73c86e432baa55533136b6e12c" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:06:39.979915 19411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b08304a0a02b42d7840c4e8ee9a6bd1a" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
I20260709 13:06:40.025601 19411 raft_consensus.cc:3060] T b08304a0a02b42d7840c4e8ee9a6bd1a P e5256d91808b47c195bc9b4dbd7f2b87 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:06:39.980158 19404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dc5b3532fe54f74876d02beffa2c230" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
I20260709 13:06:39.980305 24971 raft_consensus.cc:493] T 14935b3ddf914369822e4a0547aaa355 P 0473d2b2d01f4459b1e90fd12cc7840e [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 127766fc592545a4997f7790f50f6076)
I20260709 13:06:39.980572 19405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86a6797bdfe94fa496c050ceae4bd0d9" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
I20260709 13:06:39.982929 24892 raft_consensus.cc:493] T 172b3dd13109415a955b71ac0e9d2234 P 0473d2b2d01f4459b1e90fd12cc7840e [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:39.985275 24276 raft_consensus.cc:493] T 309c3ca0ca4b4f3ba129752ea2cb293b P 0473d2b2d01f4459b1e90fd12cc7840e [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:39.981168 19406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22196caba61445d3bec98a0aab3c337d" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:06:40.029000 19406 raft_consensus.cc:2393] T 22196caba61445d3bec98a0aab3c337d P e5256d91808b47c195bc9b4dbd7f2b87 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0473d2b2d01f4459b1e90fd12cc7840e in current term 14: Already voted for candidate e5256d91808b47c195bc9b4dbd7f2b87 in this term.
I20260709 13:06:39.941676 24789 raft_consensus.cc:515] T ef32ce6fdd0e40d382c79974f30295c6 P e61c3a8f61bb48f8a963c9480e53c168 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:39.987490 19407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76cb037fc9064d13b59a8969d897ce8c" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:06:39.934864 24702 consensus_queue.cc:1048] T 2a16f7501e2444fb86d4e2778e734e02 P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Connected to new peer: Peer: permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.053s
I20260709 13:06:40.030450 19479 raft_consensus.cc:1240] T ed7fdbcb96d14d418db9ca90a792588a P 0473d2b2d01f4459b1e90fd12cc7840e [term 12 FOLLOWER]: Rejecting Update request from peer 127766fc592545a4997f7790f50f6076 for earlier term 11. Current term is 12. Ops: [11.10-11.10]
I20260709 13:06:40.030491 19407 raft_consensus.cc:2468] T 76cb037fc9064d13b59a8969d897ce8c P e5256d91808b47c195bc9b4dbd7f2b87 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 13.
I20260709 13:06:39.993784 19559 raft_consensus.cc:2468] T 86a6797bdfe94fa496c050ceae4bd0d9 P e61c3a8f61bb48f8a963c9480e53c168 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 12.
I20260709 13:06:39.937417 24943 raft_consensus.cc:2804] T 1a61655d99124a29b486ba4a5b37faea P 0473d2b2d01f4459b1e90fd12cc7840e [term 12 FOLLOWER]: Leader pre-election won for term 13
W20260709 13:06:40.001463 19377 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.2:46257, user_credentials={real_user=slave}} blocked reactor thread for 225149us
I20260709 13:06:40.004436 19556 raft_consensus.cc:2468] T 1dc5b3532fe54f74876d02beffa2c230 P e61c3a8f61bb48f8a963c9480e53c168 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 17.
I20260709 13:06:39.975772 20104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1efebf73c86e432baa55533136b6e12c" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076"
W20260709 13:06:40.028275 19375 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.3:36891, user_credentials={real_user=slave}} blocked reactor thread for 230297us
I20260709 13:06:40.033651 20104 raft_consensus.cc:3060] T 1efebf73c86e432baa55533136b6e12c P 127766fc592545a4997f7790f50f6076 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:06:40.022643 24973 raft_consensus.cc:2749] T 65d8cb8d6ec64f459d5a47cefab10acf P 127766fc592545a4997f7790f50f6076 [term 17 FOLLOWER]: Leader pre-election lost for term 16. Reason: Vote denied by peer e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891) with higher term. Message: Invalid argument: T 65d8cb8d6ec64f459d5a47cefab10acf P e61c3a8f61bb48f8a963c9480e53c168 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 127766fc592545a4997f7790f50f6076 for earlier term 16. Current term is 17.
W20260709 13:06:40.016616 20076 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.3:36891, user_credentials={real_user=slave}} blocked reactor thread for 58052.3us
I20260709 13:06:40.019599 19408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e381f1d6b8184797ad142de49be225a8" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 14 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:06:40.019961 19557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22196caba61445d3bec98a0aab3c337d" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:06:39.970170 24926 raft_consensus.cc:515] T 48824d5acfbc485ebf8c2d944e7202de P 0473d2b2d01f4459b1e90fd12cc7840e [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:39.966830 24931 consensus_queue.cc:1048] T 70797e5783b5454ab0d0eea663e791e3 P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Connected to new peer: Peer: permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.071s
I20260709 13:06:39.956204 24790 raft_consensus.cc:2804] T 65d8cb8d6ec64f459d5a47cefab10acf P e61c3a8f61bb48f8a963c9480e53c168 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:06:40.023242 19551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e381f1d6b8184797ad142de49be225a8" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 14 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:06:39.979076 19410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc225c93219c45538b53a1bd3d387e4d" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 15 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:06:40.026479 19554 raft_consensus.cc:2468] T 1efebf73c86e432baa55533136b6e12c P e61c3a8f61bb48f8a963c9480e53c168 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 127766fc592545a4997f7790f50f6076 in term 13.
I20260709 13:06:40.040206 19551 raft_consensus.cc:2410] T e381f1d6b8184797ad142de49be225a8 P e61c3a8f61bb48f8a963c9480e53c168 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0473d2b2d01f4459b1e90fd12cc7840e for term 14 because replica has last-logged OpId of term: 12 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 8.
I20260709 13:06:40.041380 19408 raft_consensus.cc:2410] T e381f1d6b8184797ad142de49be225a8 P e5256d91808b47c195bc9b4dbd7f2b87 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0473d2b2d01f4459b1e90fd12cc7840e for term 14 because replica has last-logged OpId of term: 12 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 8.
I20260709 13:06:40.017884 19450 leader_election.cc:304] T b08304a0a02b42d7840c4e8ee9a6bd1a P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:06:39.988001 19552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1efebf73c86e432baa55533136b6e12c" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:06:40.042761 19552 raft_consensus.cc:3060] T 1efebf73c86e432baa55533136b6e12c P e61c3a8f61bb48f8a963c9480e53c168 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:06:40.012389 20111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff9b0eddd810459b82d91c60777c10eb" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:06:39.966815 24970 consensus_queue.cc:1048] T 96efeaaf1057492490e9a621f37e1a2d P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Connected to new peer: Peer: permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.062s
I20260709 13:06:40.036912 19377 leader_election.cc:304] T 76cb037fc9064d13b59a8969d897ce8c P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87; no voters: e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:06:40.053457 19560 raft_consensus.cc:1240] T ef32ce6fdd0e40d382c79974f30295c6 P e61c3a8f61bb48f8a963c9480e53c168 [term 19 FOLLOWER]: Rejecting Update request from peer 0473d2b2d01f4459b1e90fd12cc7840e for earlier term 18. Current term is 19. Ops: []
I20260709 13:06:40.036970 19557 raft_consensus.cc:2468] T 22196caba61445d3bec98a0aab3c337d P e61c3a8f61bb48f8a963c9480e53c168 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 14.
I20260709 13:06:40.053460 19377 leader_election.cc:304] T 7f575b143b844aa096b50997dad3516a P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:06:39.985757 19449 leader_election.cc:304] T 0e1085d23e8347fbbd5bce7542f4b1f4 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e; no voters: 127766fc592545a4997f7790f50f6076, e61c3a8f61bb48f8a963c9480e53c168
W20260709 13:06:40.055968 19449 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.4:43121, user_credentials={real_user=slave}} blocked reactor thread for 70293.9us
I20260709 13:06:40.056682 19449 leader_election.cc:304] T 1f85fc4b527a48848e5faa083b604e36 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e; no voters: 127766fc592545a4997f7790f50f6076, e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:06:40.056748 19377 leader_election.cc:304] T 5ec1c4ce15e04c7e8c283a62179f2a64 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, 127766fc592545a4997f7790f50f6076
I20260709 13:06:40.047328 20076 leader_election.cc:304] T 96efeaaf1057492490e9a621f37e1a2d P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 127766fc592545a4997f7790f50f6076; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:06:40.033520 24887 raft_consensus.cc:3060] T f93ee515a9c14139bf566522ed8232f3 P e61c3a8f61bb48f8a963c9480e53c168 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:06:40.060595 19557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a16f7501e2444fb86d4e2778e734e02" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:06:40.061655 24866 raft_consensus.cc:2749] T 7f575b143b844aa096b50997dad3516a P e5256d91808b47c195bc9b4dbd7f2b87 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:06:40.061808 24629 raft_consensus.cc:2749] T 96efeaaf1057492490e9a621f37e1a2d P 127766fc592545a4997f7790f50f6076 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:06:40.034480 24276 raft_consensus.cc:515] T 309c3ca0ca4b4f3ba129752ea2cb293b P 0473d2b2d01f4459b1e90fd12cc7840e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } attrs { replace: true } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:40.032956 24892 raft_consensus.cc:515] T 172b3dd13109415a955b71ac0e9d2234 P 0473d2b2d01f4459b1e90fd12cc7840e [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:40.032801 24943 raft_consensus.cc:493] T 1a61655d99124a29b486ba4a5b37faea P 0473d2b2d01f4459b1e90fd12cc7840e [term 12 FOLLOWER]: Starting leader election (detected failure of leader e5256d91808b47c195bc9b4dbd7f2b87)
I20260709 13:06:40.079458 20106 raft_consensus.cc:1813] T 309c3ca0ca4b4f3ba129752ea2cb293b P 127766fc592545a4997f7790f50f6076 [term 10 FOLLOWER]: Handling vote request from an unknown peer e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:06:40.080199 20106 raft_consensus.cc:2410] T 309c3ca0ca4b4f3ba129752ea2cb293b P 127766fc592545a4997f7790f50f6076 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e61c3a8f61bb48f8a963c9480e53c168 for term 10 because replica has last-logged OpId of term: 9 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 9.
W20260709 13:06:40.071419 19450 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.3:36891, user_credentials={real_user=slave}} blocked reactor thread for 53613us
I20260709 13:06:40.080343 19486 raft_consensus.cc:2393] T 48824d5acfbc485ebf8c2d944e7202de P 0473d2b2d01f4459b1e90fd12cc7840e [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 127766fc592545a4997f7790f50f6076 in current term 18: Already voted for candidate 0473d2b2d01f4459b1e90fd12cc7840e in this term.
I20260709 13:06:40.015585 24990 raft_consensus.cc:515] T 46c5bfeecc314717bffe987e6844b6d0 P 0473d2b2d01f4459b1e90fd12cc7840e [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:40.035626 24989 raft_consensus.cc:2804] T 6c5eebf646ad445a9d1b1adc319d7b16 P e61c3a8f61bb48f8a963c9480e53c168 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:06:40.076483 24975 raft_consensus.cc:515] T 9962423cb4e54fcfa5de01daf68a86e7 P 127766fc592545a4997f7790f50f6076 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:40.057049 19551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70797e5783b5454ab0d0eea663e791e3" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:06:40.080298 19449 leader_election.cc:304] T 775c229504194560ba9589bc2199b089 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e; no voters: 127766fc592545a4997f7790f50f6076, e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:06:40.027976 24867 raft_consensus.cc:515] T 86a6797bdfe94fa496c050ceae4bd0d9 P e5256d91808b47c195bc9b4dbd7f2b87 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:40.068488 20104 raft_consensus.cc:2468] T 1efebf73c86e432baa55533136b6e12c P 127766fc592545a4997f7790f50f6076 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 14.
I20260709 13:06:40.090198 19449 leader_election.cc:304] T 9962423cb4e54fcfa5de01daf68a86e7 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, 127766fc592545a4997f7790f50f6076; no voters: e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:06:40.053040 24838 raft_consensus.cc:2749] T 309c3ca0ca4b4f3ba129752ea2cb293b P e61c3a8f61bb48f8a963c9480e53c168 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:06:40.098977 19411 raft_consensus.cc:2468] T b08304a0a02b42d7840c4e8ee9a6bd1a P e5256d91808b47c195bc9b4dbd7f2b87 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 16.
I20260709 13:06:40.099911 19552 raft_consensus.cc:2468] T 1efebf73c86e432baa55533136b6e12c P e61c3a8f61bb48f8a963c9480e53c168 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 14.
I20260709 13:06:40.109025 19377 leader_election.cc:304] T ef32ce6fdd0e40d382c79974f30295c6 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:06:40.157582 19554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48824d5acfbc485ebf8c2d944e7202de" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:06:40.059072 24597 raft_consensus.cc:2804] T 76cb037fc9064d13b59a8969d897ce8c P e5256d91808b47c195bc9b4dbd7f2b87 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:06:40.067442 24939 raft_consensus.cc:2749] T 0e1085d23e8347fbbd5bce7542f4b1f4 P 0473d2b2d01f4459b1e90fd12cc7840e [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:06:40.032076 24971 raft_consensus.cc:515] T 14935b3ddf914369822e4a0547aaa355 P 0473d2b2d01f4459b1e90fd12cc7840e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } attrs { replace: true } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:40.212018 20108 raft_consensus.cc:2393] T 9962423cb4e54fcfa5de01daf68a86e7 P 127766fc592545a4997f7790f50f6076 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e5256d91808b47c195bc9b4dbd7f2b87 in current term 15: Already voted for candidate 127766fc592545a4997f7790f50f6076 in this term.
I20260709 13:06:40.212711 19405 raft_consensus.cc:2393] T 86a6797bdfe94fa496c050ceae4bd0d9 P e5256d91808b47c195bc9b4dbd7f2b87 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 0473d2b2d01f4459b1e90fd12cc7840e in current term 12: Already voted for candidate e5256d91808b47c195bc9b4dbd7f2b87 in this term.
I20260709 13:06:40.080420 24985 raft_consensus.cc:2749] T 1f85fc4b527a48848e5faa083b604e36 P 0473d2b2d01f4459b1e90fd12cc7840e [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:06:40.087430 24943 raft_consensus.cc:3060] T 1a61655d99124a29b486ba4a5b37faea P 0473d2b2d01f4459b1e90fd12cc7840e [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:06:40.069600 24823 raft_consensus.cc:2749] T 5ec1c4ce15e04c7e8c283a62179f2a64 P e5256d91808b47c195bc9b4dbd7f2b87 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:06:40.216216 19554 raft_consensus.cc:2468] T 48824d5acfbc485ebf8c2d944e7202de P e61c3a8f61bb48f8a963c9480e53c168 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 127766fc592545a4997f7790f50f6076 in term 17.
W20260709 13:06:40.248952 19377 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.2:46257, user_credentials={real_user=slave}} blocked reactor thread for 140039us
I20260709 13:06:40.157264 24989 raft_consensus.cc:697] T 6c5eebf646ad445a9d1b1adc319d7b16 P e61c3a8f61bb48f8a963c9480e53c168 [term 15 LEADER]: Becoming Leader. State: Replica: e61c3a8f61bb48f8a963c9480e53c168, State: Running, Role: LEADER
I20260709 13:06:40.087841 24875 raft_consensus.cc:2804] T b08304a0a02b42d7840c4e8ee9a6bd1a P 0473d2b2d01f4459b1e90fd12cc7840e [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:06:40.089216 24930 raft_consensus.cc:493] T f1b10566f45d4a7d9029858330e02d5b P 0473d2b2d01f4459b1e90fd12cc7840e [term 15 FOLLOWER]: Starting pre-election (detected failure of leader e61c3a8f61bb48f8a963c9480e53c168)
I20260709 13:06:40.161085 24891 raft_consensus.cc:2749] T 775c229504194560ba9589bc2199b089 P 0473d2b2d01f4459b1e90fd12cc7840e [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:06:40.265987 19377 leader_election.cc:304] T 0cdf56e38bbc453d9438d359e5a69955 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:06:40.282253 19377 leader_election.cc:304] T 21e14947d70440f19044d8f75c31e1f9 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:06:40.216295 24597 raft_consensus.cc:493] T 76cb037fc9064d13b59a8969d897ce8c P e5256d91808b47c195bc9b4dbd7f2b87 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:40.288673 19377 leader_election.cc:400] T 1dc5b3532fe54f74876d02beffa2c230 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 16 election: Vote denied by peer 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257) with higher term. Message: Invalid argument: T 1dc5b3532fe54f74876d02beffa2c230 P 0473d2b2d01f4459b1e90fd12cc7840e [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate e5256d91808b47c195bc9b4dbd7f2b87 for earlier term 16. Current term is 17.
I20260709 13:06:40.299010 24702 raft_consensus.cc:493] T 179fd671030940b4b4a4e24bcc4aba0a P e61c3a8f61bb48f8a963c9480e53c168 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:40.248581 24790 raft_consensus.cc:697] T 65d8cb8d6ec64f459d5a47cefab10acf P e61c3a8f61bb48f8a963c9480e53c168 [term 17 LEADER]: Becoming Leader. State: Replica: e61c3a8f61bb48f8a963c9480e53c168, State: Running, Role: LEADER
I20260709 13:06:40.311728 19554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed7fdbcb96d14d418db9ca90a792588a" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:06:40.259491 24995 raft_consensus.cc:2749] T ef32ce6fdd0e40d382c79974f30295c6 P e5256d91808b47c195bc9b4dbd7f2b87 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:06:40.276994 24932 raft_consensus.cc:493] T 2725d2c4cb054f18b0fc8f735c15f6c2 P 0473d2b2d01f4459b1e90fd12cc7840e [term 17 FOLLOWER]: Starting pre-election (detected failure of leader e61c3a8f61bb48f8a963c9480e53c168)
I20260709 13:06:40.298395 24597 raft_consensus.cc:3060] T 76cb037fc9064d13b59a8969d897ce8c P e5256d91808b47c195bc9b4dbd7f2b87 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:06:40.335019 19449 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.4:43121, user_credentials={real_user=slave}} blocked reactor thread for 244907us
I20260709 13:06:40.297046 24824 raft_consensus.cc:2749] T 21e14947d70440f19044d8f75c31e1f9 P e5256d91808b47c195bc9b4dbd7f2b87 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:06:40.273738 24821 consensus_queue.cc:1048] T 179fd671030940b4b4a4e24bcc4aba0a P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.058s
I20260709 13:06:40.299630 24702 raft_consensus.cc:515] T 179fd671030940b4b4a4e24bcc4aba0a P e61c3a8f61bb48f8a963c9480e53c168 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:40.301306 24982 raft_consensus.cc:2804] T 9962423cb4e54fcfa5de01daf68a86e7 P 0473d2b2d01f4459b1e90fd12cc7840e [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:06:40.301160 24875 raft_consensus.cc:697] T b08304a0a02b42d7840c4e8ee9a6bd1a P 0473d2b2d01f4459b1e90fd12cc7840e [term 16 LEADER]: Becoming Leader. State: Replica: 0473d2b2d01f4459b1e90fd12cc7840e, State: Running, Role: LEADER
I20260709 13:06:40.347427 19554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df751f992649444090e27965eb1af85d" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:06:40.417743 19554 raft_consensus.cc:2468] T df751f992649444090e27965eb1af85d P e61c3a8f61bb48f8a963c9480e53c168 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 18.
I20260709 13:06:40.349556 19556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e381f1d6b8184797ad142de49be225a8" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:06:40.418731 19556 raft_consensus.cc:2468] T e381f1d6b8184797ad142de49be225a8 P e61c3a8f61bb48f8a963c9480e53c168 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 12.
W20260709 13:06:40.396996 24998 log.cc:927] Time spent T 0cdf56e38bbc453d9438d359e5a69955 P 0473d2b2d01f4459b1e90fd12cc7840e: Append to log took a long time: real 0.074s	user 0.000s	sys 0.001s
I20260709 13:06:40.293725 24942 raft_consensus.cc:2749] T 0cdf56e38bbc453d9438d359e5a69955 P e5256d91808b47c195bc9b4dbd7f2b87 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:06:40.344632 19449 leader_election.cc:304] T 1efebf73c86e432baa55533136b6e12c P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, 127766fc592545a4997f7790f50f6076; no voters: 
I20260709 13:06:40.427309 19556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2725d2c4cb054f18b0fc8f735c15f6c2" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:06:40.332767 24891 raft_consensus.cc:493] T f93ee515a9c14139bf566522ed8232f3 P 0473d2b2d01f4459b1e90fd12cc7840e [term 16 FOLLOWER]: Starting pre-election (detected failure of leader e61c3a8f61bb48f8a963c9480e53c168)
W20260709 13:06:40.427348 19449 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.4:43121, user_credentials={real_user=slave}} blocked reactor thread for 82786.2us
I20260709 13:06:40.428691 19559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "309c3ca0ca4b4f3ba129752ea2cb293b" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:06:40.429284 19559 raft_consensus.cc:2468] T 309c3ca0ca4b4f3ba129752ea2cb293b P e61c3a8f61bb48f8a963c9480e53c168 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 10.
I20260709 13:06:40.429625 19486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef32ce6fdd0e40d382c79974f30295c6" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 19 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:06:40.301044 24930 raft_consensus.cc:515] T f1b10566f45d4a7d9029858330e02d5b P 0473d2b2d01f4459b1e90fd12cc7840e [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:40.326370 24963 consensus_queue.cc:1059] T ed7fdbcb96d14d418db9ca90a792588a P 127766fc592545a4997f7790f50f6076 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.091s
I20260709 13:06:40.434563 19558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e1f505cb0f1427bbd698ac889d80821" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:06:40.437196 19477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76cb037fc9064d13b59a8969d897ce8c" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:06:40.398164 24985 raft_consensus.cc:493] T df751f992649444090e27965eb1af85d P 0473d2b2d01f4459b1e90fd12cc7840e [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:40.442523 19477 raft_consensus.cc:3060] T 76cb037fc9064d13b59a8969d897ce8c P 0473d2b2d01f4459b1e90fd12cc7840e [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:06:40.443166 24789 leader_election.cc:290] T ef32ce6fdd0e40d382c79974f30295c6 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 19 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:06:40.444088 24867 leader_election.cc:290] T 86a6797bdfe94fa496c050ceae4bd0d9 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 12 election: Requested vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:06:40.445230 24990 leader_election.cc:290] T 46c5bfeecc314717bffe987e6844b6d0 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:06:40.446543 24990 raft_consensus.cc:493] T 96efeaaf1057492490e9a621f37e1a2d P 0473d2b2d01f4459b1e90fd12cc7840e [term 17 FOLLOWER]: Starting pre-election (detected failure of leader e61c3a8f61bb48f8a963c9480e53c168)
I20260709 13:06:40.447037 24990 raft_consensus.cc:515] T 96efeaaf1057492490e9a621f37e1a2d P 0473d2b2d01f4459b1e90fd12cc7840e [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:40.447402 19481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e1085d23e8347fbbd5bce7542f4b1f4" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:06:40.447074 19483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e381f1d6b8184797ad142de49be225a8" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:06:40.449142 24926 leader_election.cc:290] T 48824d5acfbc485ebf8c2d944e7202de P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 18 election: Requested vote from peers e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:06:40.449451 19483 raft_consensus.cc:2393] T e381f1d6b8184797ad142de49be225a8 P 0473d2b2d01f4459b1e90fd12cc7840e [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e61c3a8f61bb48f8a963c9480e53c168 in current term 13: Already voted for candidate 0473d2b2d01f4459b1e90fd12cc7840e in this term.
W20260709 13:06:40.450289 25000 log.cc:927] Time spent T ef32ce6fdd0e40d382c79974f30295c6 P 0473d2b2d01f4459b1e90fd12cc7840e: Append to log took a long time: real 0.132s	user 0.000s	sys 0.000s
I20260709 13:06:40.450614 24926 raft_consensus.cc:2804] T 1efebf73c86e432baa55533136b6e12c P 0473d2b2d01f4459b1e90fd12cc7840e [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:06:40.451254 24926 raft_consensus.cc:697] T 1efebf73c86e432baa55533136b6e12c P 0473d2b2d01f4459b1e90fd12cc7840e [term 14 LEADER]: Becoming Leader. State: Replica: 0473d2b2d01f4459b1e90fd12cc7840e, State: Running, Role: LEADER
I20260709 13:06:40.450982 24985 raft_consensus.cc:515] T df751f992649444090e27965eb1af85d P 0473d2b2d01f4459b1e90fd12cc7840e [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:40.452194 24926 consensus_queue.cc:237] T 1efebf73c86e432baa55533136b6e12c P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:40.453147 24985 leader_election.cc:290] T df751f992649444090e27965eb1af85d P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:06:40.442515 19558 raft_consensus.cc:2468] T 3e1f505cb0f1427bbd698ac889d80821 P e61c3a8f61bb48f8a963c9480e53c168 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 17.
I20260709 13:06:40.468474 19477 raft_consensus.cc:2468] T 76cb037fc9064d13b59a8969d897ce8c P 0473d2b2d01f4459b1e90fd12cc7840e [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 14.
I20260709 13:06:40.476392 19482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df751f992649444090e27965eb1af85d" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:06:40.480005 19559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a08760e15aac4630a629431f56024dc8" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:06:40.480767 19559 raft_consensus.cc:3060] T a08760e15aac4630a629431f56024dc8 P e61c3a8f61bb48f8a963c9480e53c168 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:06:40.484823 19480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a61655d99124a29b486ba4a5b37faea" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 14 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:06:40.417201 24982 raft_consensus.cc:493] T 9962423cb4e54fcfa5de01daf68a86e7 P 0473d2b2d01f4459b1e90fd12cc7840e [term 13 FOLLOWER]: Starting leader election (detected failure of leader 127766fc592545a4997f7790f50f6076)
I20260709 13:06:40.425745 24983 leader_election.cc:290] T ed7fdbcb96d14d418db9ca90a792588a P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 12 election: Requested vote from peers e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:06:40.489837 19484 raft_consensus.cc:1275] T 172b3dd13109415a955b71ac0e9d2234 P 0473d2b2d01f4459b1e90fd12cc7840e [term 14 FOLLOWER]: Refusing update from remote peer e5256d91808b47c195bc9b4dbd7f2b87: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 13:06:40.486377 19556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a16f7501e2444fb86d4e2778e734e02" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:06:40.496261 19560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70797e5783b5454ab0d0eea663e791e3" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:06:40.498714 19484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e381f1d6b8184797ad142de49be225a8" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:06:40.440480 24995 raft_consensus.cc:493] T 22196caba61445d3bec98a0aab3c337d P e5256d91808b47c195bc9b4dbd7f2b87 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:40.499387 19484 raft_consensus.cc:2468] T e381f1d6b8184797ad142de49be225a8 P 0473d2b2d01f4459b1e90fd12cc7840e [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 13.
I20260709 13:06:40.407249 24932 raft_consensus.cc:515] T 2725d2c4cb054f18b0fc8f735c15f6c2 P 0473d2b2d01f4459b1e90fd12cc7840e [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:40.513101 19485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b08304a0a02b42d7840c4e8ee9a6bd1a" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 16 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:06:40.513473 19559 raft_consensus.cc:2468] T a08760e15aac4630a629431f56024dc8 P e61c3a8f61bb48f8a963c9480e53c168 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 19.
I20260709 13:06:40.515375 19483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cdf56e38bbc453d9438d359e5a69955" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:06:40.494119 24982 raft_consensus.cc:3060] T 9962423cb4e54fcfa5de01daf68a86e7 P 0473d2b2d01f4459b1e90fd12cc7840e [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:06:40.579037 19404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "309c3ca0ca4b4f3ba129752ea2cb293b" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:06:40.524405 24983 raft_consensus.cc:493] T 179fd671030940b4b4a4e24bcc4aba0a P 0473d2b2d01f4459b1e90fd12cc7840e [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:40.579677 19404 raft_consensus.cc:2468] T 309c3ca0ca4b4f3ba129752ea2cb293b P e5256d91808b47c195bc9b4dbd7f2b87 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 9.
I20260709 13:06:40.579902 24983 raft_consensus.cc:515] T 179fd671030940b4b4a4e24bcc4aba0a P 0473d2b2d01f4459b1e90fd12cc7840e [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
W20260709 13:06:40.594846 24986 consensus_meta.cc:287] T edd7d470b5014c9489be7f41f64355c9 P 0473d2b2d01f4459b1e90fd12cc7840e: Time spent flushing consensus metadata: real 0.711s	user 0.010s	sys 0.000s
I20260709 13:06:40.595446 24986 raft_consensus.cc:515] T edd7d470b5014c9489be7f41f64355c9 P 0473d2b2d01f4459b1e90fd12cc7840e [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:40.598163 24986 leader_election.cc:290] T edd7d470b5014c9489be7f41f64355c9 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 17 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:06:40.521044 24995 raft_consensus.cc:515] T 22196caba61445d3bec98a0aab3c337d P e5256d91808b47c195bc9b4dbd7f2b87 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:40.586795 24971 leader_election.cc:290] T 14935b3ddf914369822e4a0547aaa355 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
W20260709 13:06:40.615371 24898 consensus_meta.cc:287] T 7f575b143b844aa096b50997dad3516a P 0473d2b2d01f4459b1e90fd12cc7840e: Time spent flushing consensus metadata: real 0.766s	user 0.005s	sys 0.005s
I20260709 13:06:40.615952 24898 raft_consensus.cc:515] T 7f575b143b844aa096b50997dad3516a P 0473d2b2d01f4459b1e90fd12cc7840e [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:40.619953 19557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46c5bfeecc314717bffe987e6844b6d0" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 21 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:06:40.531296 19481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9962423cb4e54fcfa5de01daf68a86e7" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:06:40.508481 24731 raft_consensus.cc:493] T 0afb57ae58a24a01850491d69f0213dd P 127766fc592545a4997f7790f50f6076 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 0473d2b2d01f4459b1e90fd12cc7840e)
I20260709 13:06:40.533535 20111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed7fdbcb96d14d418db9ca90a792588a" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076"
I20260709 13:06:40.536471 20110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48824d5acfbc485ebf8c2d944e7202de" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076"
I20260709 13:06:40.540055 20105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "172b3dd13109415a955b71ac0e9d2234" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 15 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:06:40.540446 24972 raft_consensus.cc:493] T 217b5fae677b4971b3bbd2f357a1f7ff P e5256d91808b47c195bc9b4dbd7f2b87 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 0473d2b2d01f4459b1e90fd12cc7840e)
I20260709 13:06:40.541399 19449 leader_election.cc:304] T ff9b0eddd810459b82d91c60777c10eb P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e; no voters: 127766fc592545a4997f7790f50f6076, e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:06:40.541839 24996 raft_consensus.cc:493] T 28af091831594f9d8e96482078cc7625 P e5256d91808b47c195bc9b4dbd7f2b87 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 0473d2b2d01f4459b1e90fd12cc7840e)
I20260709 13:06:40.659487 19551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14935b3ddf914369822e4a0547aaa355" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:06:40.662336 20112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7be9efa6559648dbb5a0f7684c4542d1" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076"
I20260709 13:06:40.544898 19408 raft_consensus.cc:1275] T fa8650e71aa14778b3d73721fc50d9fc P e5256d91808b47c195bc9b4dbd7f2b87 [term 15 FOLLOWER]: Refusing update from remote peer 0473d2b2d01f4459b1e90fd12cc7840e: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 15 index: 8. (index mismatch)
I20260709 13:06:40.663201 20112 raft_consensus.cc:3060] T 7be9efa6559648dbb5a0f7684c4542d1 P 127766fc592545a4997f7790f50f6076 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:06:40.547516 19411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "172b3dd13109415a955b71ac0e9d2234" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 15 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
W20260709 13:06:40.548446 25005 log.cc:927] Time spent T 1dc5b3532fe54f74876d02beffa2c230 P e5256d91808b47c195bc9b4dbd7f2b87: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
I20260709 13:06:40.551082 19484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df751f992649444090e27965eb1af85d" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:06:40.669049 19551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "179fd671030940b4b4a4e24bcc4aba0a" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 19 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:06:40.670190 19551 raft_consensus.cc:2410] T 179fd671030940b4b4a4e24bcc4aba0a P e61c3a8f61bb48f8a963c9480e53c168 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0473d2b2d01f4459b1e90fd12cc7840e for term 19 because replica has last-logged OpId of term: 17 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 9.
I20260709 13:06:40.552891 25012 raft_consensus.cc:493] T 21e14947d70440f19044d8f75c31e1f9 P 0473d2b2d01f4459b1e90fd12cc7840e [term 15 FOLLOWER]: Starting pre-election (detected failure of leader e61c3a8f61bb48f8a963c9480e53c168)
I20260709 13:06:40.559864 24941 leader_election.cc:290] T 7be9efa6559648dbb5a0f7684c4542d1 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 15 election: Requested vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:06:40.562842 24975 leader_election.cc:290] T 9962423cb4e54fcfa5de01daf68a86e7 P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 15 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:06:40.493287 24964 leader_election.cc:290] T 2a16f7501e2444fb86d4e2778e734e02 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:06:40.566282 19405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46c5bfeecc314717bffe987e6844b6d0" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 21 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:06:40.566831 19479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "309c3ca0ca4b4f3ba129752ea2cb293b" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:06:40.683440 19405 raft_consensus.cc:2468] T 46c5bfeecc314717bffe987e6844b6d0 P e5256d91808b47c195bc9b4dbd7f2b87 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 21.
I20260709 13:06:40.683763 19479 raft_consensus.cc:2393] T 309c3ca0ca4b4f3ba129752ea2cb293b P 0473d2b2d01f4459b1e90fd12cc7840e [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e5256d91808b47c195bc9b4dbd7f2b87 in current term 10: Already voted for candidate 0473d2b2d01f4459b1e90fd12cc7840e in this term.
I20260709 13:06:40.683620 19484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2725d2c4cb054f18b0fc8f735c15f6c2" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:06:40.507509 24790 consensus_queue.cc:237] T 65d8cb8d6ec64f459d5a47cefab10acf P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:40.567510 19410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df751f992649444090e27965eb1af85d" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:06:40.567891 24990 leader_election.cc:290] T 96efeaaf1057492490e9a621f37e1a2d P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:06:40.618508 24898 leader_election.cc:290] T 7f575b143b844aa096b50997dad3516a P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 12 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:06:40.572469 24702 leader_election.cc:290] T 179fd671030940b4b4a4e24bcc4aba0a P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:06:40.550486 24798 leader_election.cc:290] T 70797e5783b5454ab0d0eea663e791e3 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 16 election: Requested vote from peers e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:06:40.494364 24989 consensus_queue.cc:237] T 6c5eebf646ad445a9d1b1adc319d7b16 P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.11, Last appended by leader: 11, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:40.436005 24891 raft_consensus.cc:515] T f93ee515a9c14139bf566522ed8232f3 P 0473d2b2d01f4459b1e90fd12cc7840e [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:40.631438 19552 raft_consensus.cc:1275] T fa8650e71aa14778b3d73721fc50d9fc P e61c3a8f61bb48f8a963c9480e53c168 [term 15 FOLLOWER]: Refusing update from remote peer 0473d2b2d01f4459b1e90fd12cc7840e: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 15 index: 8. (index mismatch)
I20260709 13:06:40.656685 20110 raft_consensus.cc:3060] T 48824d5acfbc485ebf8c2d944e7202de P 127766fc592545a4997f7790f50f6076 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:06:40.625483 19560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48824d5acfbc485ebf8c2d944e7202de" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:06:40.701205 19560 raft_consensus.cc:3060] T 48824d5acfbc485ebf8c2d944e7202de P e61c3a8f61bb48f8a963c9480e53c168 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:06:40.626660 19555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df751f992649444090e27965eb1af85d" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:06:40.654912 19556 raft_consensus.cc:1275] T 0cdf56e38bbc453d9438d359e5a69955 P e61c3a8f61bb48f8a963c9480e53c168 [term 16 FOLLOWER]: Refusing update from remote peer 0473d2b2d01f4459b1e90fd12cc7840e: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 13:06:40.662400 20106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a16f7501e2444fb86d4e2778e734e02" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:06:40.703157 20106 raft_consensus.cc:2468] T 2a16f7501e2444fb86d4e2778e734e02 P 127766fc592545a4997f7790f50f6076 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 15.
W20260709 13:06:40.543320 24994 log.cc:927] Time spent T bc225c93219c45538b53a1bd3d387e4d P 0473d2b2d01f4459b1e90fd12cc7840e: Append to log took a long time: real 0.202s	user 0.000s	sys 0.000s
I20260709 13:06:40.664985 19482 raft_consensus.cc:2468] T df751f992649444090e27965eb1af85d P 0473d2b2d01f4459b1e90fd12cc7840e [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 18.
I20260709 13:06:40.627130 19554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96efeaaf1057492490e9a621f37e1a2d" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:06:40.625571 19450 leader_election.cc:304] T 86a6797bdfe94fa496c050ceae4bd0d9 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:06:40.701766 19555 raft_consensus.cc:2468] T df751f992649444090e27965eb1af85d P e61c3a8f61bb48f8a963c9480e53c168 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 18.
W20260709 13:06:40.675511 19449 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.1:40321, user_credentials={real_user=slave}} blocked reactor thread for 134197us
I20260709 13:06:40.682961 20109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70797e5783b5454ab0d0eea663e791e3" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076"
I20260709 13:06:40.705497 20109 raft_consensus.cc:3060] T 70797e5783b5454ab0d0eea663e791e3 P 127766fc592545a4997f7790f50f6076 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:06:40.684410 19479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a08760e15aac4630a629431f56024dc8" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:06:40.685097 19483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e1f505cb0f1427bbd698ac889d80821" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:06:40.687992 19410 raft_consensus.cc:2468] T df751f992649444090e27965eb1af85d P e5256d91808b47c195bc9b4dbd7f2b87 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 18.
I20260709 13:06:40.570415 24875 consensus_queue.cc:237] T b08304a0a02b42d7840c4e8ee9a6bd1a P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.9, Last appended by leader: 9, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:40.623950 24892 leader_election.cc:290] T 172b3dd13109415a955b71ac0e9d2234 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:06:40.690363 19484 raft_consensus.cc:1240] T 7f575b143b844aa096b50997dad3516a P 0473d2b2d01f4459b1e90fd12cc7840e [term 12 FOLLOWER]: Rejecting Update request from peer e61c3a8f61bb48f8a963c9480e53c168 for earlier term 11. Current term is 12. Ops: []
I20260709 13:06:40.582500 24983 leader_election.cc:290] T 179fd671030940b4b4a4e24bcc4aba0a P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:06:40.691524 19553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edd7d470b5014c9489be7f41f64355c9" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:06:40.658522 24995 leader_election.cc:290] T 22196caba61445d3bec98a0aab3c337d P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:06:40.654422 24971 raft_consensus.cc:493] T 2b74109013a140ada21feeef92d6f563 P 0473d2b2d01f4459b1e90fd12cc7840e [term 12 FOLLOWER]: Starting pre-election (detected failure of leader e61c3a8f61bb48f8a963c9480e53c168)
I20260709 13:06:40.695222 19404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a61655d99124a29b486ba4a5b37faea" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 14 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:06:40.738152 19404 raft_consensus.cc:2410] T 1a61655d99124a29b486ba4a5b37faea P e5256d91808b47c195bc9b4dbd7f2b87 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e61c3a8f61bb48f8a963c9480e53c168 for term 14 because replica has last-logged OpId of term: 12 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 7.
I20260709 13:06:40.695950 19406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e381f1d6b8184797ad142de49be225a8" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:06:40.657434 19557 raft_consensus.cc:2393] T 46c5bfeecc314717bffe987e6844b6d0 P e61c3a8f61bb48f8a963c9480e53c168 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0473d2b2d01f4459b1e90fd12cc7840e in current term 21: Already voted for candidate e61c3a8f61bb48f8a963c9480e53c168 in this term.
I20260709 13:06:40.724232 19410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76cb037fc9064d13b59a8969d897ce8c" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
I20260709 13:06:40.688040 24876 raft_consensus.cc:2749] T ff9b0eddd810459b82d91c60777c10eb P 0473d2b2d01f4459b1e90fd12cc7840e [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:06:40.725255 19407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df751f992649444090e27965eb1af85d" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
I20260709 13:06:40.740038 19407 raft_consensus.cc:2393] T df751f992649444090e27965eb1af85d P e5256d91808b47c195bc9b4dbd7f2b87 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate e61c3a8f61bb48f8a963c9480e53c168 in current term 18: Already voted for candidate e5256d91808b47c195bc9b4dbd7f2b87 in this term.
I20260709 13:06:40.726785 19449 leader_election.cc:304] T 2e36a9d6e29c4a7c860cf267efbd4c74 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e; no voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:06:40.727245 19408 raft_consensus.cc:1275] T ece3db938bc649d4a40a51522ed5259c P e5256d91808b47c195bc9b4dbd7f2b87 [term 12 FOLLOWER]: Refusing update from remote peer e61c3a8f61bb48f8a963c9480e53c168: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
W20260709 13:06:40.733968 19450 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.3:36891, user_credentials={real_user=slave}} blocked reactor thread for 108471us
I20260709 13:06:40.742065 19450 leader_election.cc:304] T 1dc5b3532fe54f74876d02beffa2c230 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:06:40.734650 20109 raft_consensus.cc:2468] T 70797e5783b5454ab0d0eea663e791e3 P 127766fc592545a4997f7790f50f6076 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 16.
I20260709 13:06:40.724278 19483 raft_consensus.cc:2468] T 3e1f505cb0f1427bbd698ac889d80821 P 0473d2b2d01f4459b1e90fd12cc7840e [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 16.
I20260709 13:06:40.679370 24972 raft_consensus.cc:515] T 217b5fae677b4971b3bbd2f357a1f7ff P e5256d91808b47c195bc9b4dbd7f2b87 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:40.733237 19374 leader_election.cc:304] T 2a16f7501e2444fb86d4e2778e734e02 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 127766fc592545a4997f7790f50f6076, e5256d91808b47c195bc9b4dbd7f2b87; no voters: 
W20260709 13:06:40.744735 19377 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:40.738610 19406 raft_consensus.cc:2468] T e381f1d6b8184797ad142de49be225a8 P e5256d91808b47c195bc9b4dbd7f2b87 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 13.
I20260709 13:06:40.667256 24731 raft_consensus.cc:515] T 0afb57ae58a24a01850491d69f0213dd P 127766fc592545a4997f7790f50f6076 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:40.768927 24983 raft_consensus.cc:2804] T 1dc5b3532fe54f74876d02beffa2c230 P 0473d2b2d01f4459b1e90fd12cc7840e [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:06:40.769465 24983 raft_consensus.cc:697] T 1dc5b3532fe54f74876d02beffa2c230 P 0473d2b2d01f4459b1e90fd12cc7840e [term 17 LEADER]: Becoming Leader. State: Replica: 0473d2b2d01f4459b1e90fd12cc7840e, State: Running, Role: LEADER
I20260709 13:06:40.751957 24932 leader_election.cc:290] T 2725d2c4cb054f18b0fc8f735c15f6c2 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:06:40.754729 19408 raft_consensus.cc:1240] T 70797e5783b5454ab0d0eea663e791e3 P e5256d91808b47c195bc9b4dbd7f2b87 [term 16 FOLLOWER]: Rejecting Update request from peer e61c3a8f61bb48f8a963c9480e53c168 for earlier term 15. Current term is 16. Ops: []
I20260709 13:06:40.770220 24971 raft_consensus.cc:515] T 2b74109013a140ada21feeef92d6f563 P 0473d2b2d01f4459b1e90fd12cc7840e [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:40.770269 24983 consensus_queue.cc:237] T 1dc5b3532fe54f74876d02beffa2c230 P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 15.8, Last appended by leader: 8, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:40.743764 24276 leader_election.cc:290] T 309c3ca0ca4b4f3ba129752ea2cb293b P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:06:40.766494 24972 leader_election.cc:290] T 217b5fae677b4971b3bbd2f357a1f7ff P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:06:40.772627 24971 leader_election.cc:290] T 2b74109013a140ada21feeef92d6f563 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:06:40.687527 25012 raft_consensus.cc:515] T 21e14947d70440f19044d8f75c31e1f9 P 0473d2b2d01f4459b1e90fd12cc7840e [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:40.775012 25012 leader_election.cc:290] T 21e14947d70440f19044d8f75c31e1f9 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
W20260709 13:06:40.775614 19523 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:40.776468 24758 raft_consensus.cc:493] T 70797e5783b5454ab0d0eea663e791e3 P 127766fc592545a4997f7790f50f6076 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:40.776907 24758 raft_consensus.cc:3060] T 70797e5783b5454ab0d0eea663e791e3 P 127766fc592545a4997f7790f50f6076 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:06:40.778060 20110 raft_consensus.cc:2468] T 48824d5acfbc485ebf8c2d944e7202de P 127766fc592545a4997f7790f50f6076 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 18.
I20260709 13:06:40.686857 24996 raft_consensus.cc:515] T 28af091831594f9d8e96482078cc7625 P e5256d91808b47c195bc9b4dbd7f2b87 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:40.755836 24982 raft_consensus.cc:515] T 9962423cb4e54fcfa5de01daf68a86e7 P 0473d2b2d01f4459b1e90fd12cc7840e [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
W20260709 13:06:40.792893 19449 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.1:40321, user_credentials={real_user=slave}} blocked reactor thread for 66244.6us
I20260709 13:06:40.745713 19374 leader_election.cc:304] T 70797e5783b5454ab0d0eea663e791e3 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 127766fc592545a4997f7790f50f6076, e5256d91808b47c195bc9b4dbd7f2b87; no voters: 
I20260709 13:06:40.759907 24597 raft_consensus.cc:515] T 76cb037fc9064d13b59a8969d897ce8c P e5256d91808b47c195bc9b4dbd7f2b87 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
W20260709 13:06:40.760389 24573 consensus_meta.cc:287] T a08760e15aac4630a629431f56024dc8 P 0473d2b2d01f4459b1e90fd12cc7840e: Time spent flushing consensus metadata: real 0.954s	user 0.003s	sys 0.007s
I20260709 13:06:40.761958 20076 leader_election.cc:304] T 1efebf73c86e432baa55533136b6e12c P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 127766fc592545a4997f7790f50f6076, e61c3a8f61bb48f8a963c9480e53c168; no voters: 0473d2b2d01f4459b1e90fd12cc7840e
I20260709 13:06:40.763072 24866 raft_consensus.cc:2804] T 2a16f7501e2444fb86d4e2778e734e02 P e5256d91808b47c195bc9b4dbd7f2b87 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:06:40.765089 24824 raft_consensus.cc:493] T f93ee515a9c14139bf566522ed8232f3 P e5256d91808b47c195bc9b4dbd7f2b87 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:40.765630 19377 leader_election.cc:304] T e381f1d6b8184797ad142de49be225a8 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87; no voters: 
W20260709 13:06:40.806207 20076 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.3:36891, user_credentials={real_user=slave}} blocked reactor thread for 44329.6us
I20260709 13:06:40.807169 20076 leader_election.cc:304] T 2a16f7501e2444fb86d4e2778e734e02 P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 127766fc592545a4997f7790f50f6076; no voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:06:40.736949 24892 raft_consensus.cc:2804] T 86a6797bdfe94fa496c050ceae4bd0d9 P 0473d2b2d01f4459b1e90fd12cc7840e [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:06:40.766076 24935 raft_consensus.cc:493] T ece3db938bc649d4a40a51522ed5259c P e5256d91808b47c195bc9b4dbd7f2b87 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:40.813970 24935 raft_consensus.cc:515] T ece3db938bc649d4a40a51522ed5259c P e5256d91808b47c195bc9b4dbd7f2b87 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:40.814649 24996 leader_election.cc:290] T 28af091831594f9d8e96482078cc7625 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:06:40.816174 24935 leader_election.cc:290] T ece3db938bc649d4a40a51522ed5259c P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:06:40.809614 24946 raft_consensus.cc:2764] T 1efebf73c86e432baa55533136b6e12c P 127766fc592545a4997f7790f50f6076 [term 14 FOLLOWER]: Leader pre-election decision vote started in defunct term 13: won
I20260709 13:06:40.766315 24949 raft_consensus.cc:493] T 62c6c134d3d24a1ab144dd9ee6bc3f64 P 127766fc592545a4997f7790f50f6076 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 0473d2b2d01f4459b1e90fd12cc7840e)
I20260709 13:06:40.766680 24702 raft_consensus.cc:493] T 2e36a9d6e29c4a7c860cf267efbd4c74 P e61c3a8f61bb48f8a963c9480e53c168 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader e5256d91808b47c195bc9b4dbd7f2b87)
I20260709 13:06:40.765661 19526 leader_election.cc:304] T 0e1085d23e8347fbbd5bce7542f4b1f4 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e61c3a8f61bb48f8a963c9480e53c168; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, 127766fc592545a4997f7790f50f6076
W20260709 13:06:40.826433 19526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.2:46257, user_credentials={real_user=slave}} blocked reactor thread for 60829.4us
I20260709 13:06:40.770622 24731 leader_election.cc:290] T 0afb57ae58a24a01850491d69f0213dd P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:06:40.767990 19407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b08304a0a02b42d7840c4e8ee9a6bd1a" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 16 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:06:40.768365 19450 leader_election.cc:304] T 22196caba61445d3bec98a0aab3c337d P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:06:40.786360 19560 raft_consensus.cc:2468] T 48824d5acfbc485ebf8c2d944e7202de P e61c3a8f61bb48f8a963c9480e53c168 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 18.
I20260709 13:06:40.792007 20112 raft_consensus.cc:2468] T 7be9efa6559648dbb5a0f7684c4542d1 P 127766fc592545a4997f7790f50f6076 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 15.
I20260709 13:06:40.830719 19407 raft_consensus.cc:2393] T b08304a0a02b42d7840c4e8ee9a6bd1a P e5256d91808b47c195bc9b4dbd7f2b87 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e61c3a8f61bb48f8a963c9480e53c168 in current term 16: Already voted for candidate 0473d2b2d01f4459b1e90fd12cc7840e in this term.
W20260709 13:06:40.794133 19374 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.4:43121, user_credentials={real_user=slave}} blocked reactor thread for 48491.3us
I20260709 13:06:40.832782 19410 raft_consensus.cc:2393] T 76cb037fc9064d13b59a8969d897ce8c P e5256d91808b47c195bc9b4dbd7f2b87 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate e61c3a8f61bb48f8a963c9480e53c168 in current term 14: Already voted for candidate e5256d91808b47c195bc9b4dbd7f2b87 in this term.
W20260709 13:06:40.810031 24994 log.cc:927] Time spent T bc225c93219c45538b53a1bd3d387e4d P 0473d2b2d01f4459b1e90fd12cc7840e: Append to log took a long time: real 0.068s	user 0.000s	sys 0.000s
I20260709 13:06:40.810527 19408 raft_consensus.cc:1275] T 2a16f7501e2444fb86d4e2778e734e02 P e5256d91808b47c195bc9b4dbd7f2b87 [term 15 FOLLOWER]: Refusing update from remote peer e61c3a8f61bb48f8a963c9480e53c168: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 15 index: 12. (term mismatch)
I20260709 13:06:40.809106 24573 raft_consensus.cc:515] T a08760e15aac4630a629431f56024dc8 P 0473d2b2d01f4459b1e90fd12cc7840e [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
W20260709 13:06:40.887918 19450 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.3:36891, user_credentials={real_user=slave}} blocked reactor thread for 119618us
I20260709 13:06:40.813344 24892 raft_consensus.cc:697] T 86a6797bdfe94fa496c050ceae4bd0d9 P 0473d2b2d01f4459b1e90fd12cc7840e [term 12 LEADER]: Becoming Leader. State: Replica: 0473d2b2d01f4459b1e90fd12cc7840e, State: Running, Role: LEADER
W20260709 13:06:40.818150 19377 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.2:46257, user_credentials={real_user=slave}} blocked reactor thread for 52582.9us
I20260709 13:06:40.827536 19481 raft_consensus.cc:2468] T 9962423cb4e54fcfa5de01daf68a86e7 P 0473d2b2d01f4459b1e90fd12cc7840e [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 14.
I20260709 13:06:40.766636 24798 consensus_queue.cc:1048] T 172b3dd13109415a955b71ac0e9d2234 P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:06:40.899459 19405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef32ce6fdd0e40d382c79974f30295c6" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
I20260709 13:06:40.834388 20076 leader_election.cc:304] T 48824d5acfbc485ebf8c2d944e7202de P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 127766fc592545a4997f7790f50f6076, e61c3a8f61bb48f8a963c9480e53c168; no voters: 0473d2b2d01f4459b1e90fd12cc7840e
I20260709 13:06:40.800026 19554 raft_consensus.cc:1275] T ab43d85f64114d4ebf618930e43d9ed0 P e61c3a8f61bb48f8a963c9480e53c168 [term 17 FOLLOWER]: Refusing update from remote peer 127766fc592545a4997f7790f50f6076: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 13:06:40.883092 19408 pending_rounds.cc:85] T 2a16f7501e2444fb86d4e2778e734e02 P e5256d91808b47c195bc9b4dbd7f2b87: Aborting all ops after (but not including) 11
I20260709 13:06:40.901257 19408 pending_rounds.cc:107] T 2a16f7501e2444fb86d4e2778e734e02 P e5256d91808b47c195bc9b4dbd7f2b87: Aborting uncommitted NO_OP operation due to leader change: 14.12
I20260709 13:06:40.901513 19408 raft_consensus.cc:2889] T 2a16f7501e2444fb86d4e2778e734e02 P e5256d91808b47c195bc9b4dbd7f2b87 [term 15 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:06:40.801177 24972 raft_consensus.cc:2804] T 70797e5783b5454ab0d0eea663e791e3 P e5256d91808b47c195bc9b4dbd7f2b87 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:06:40.802131 25012 raft_consensus.cc:2749] T 2e36a9d6e29c4a7c860cf267efbd4c74 P 0473d2b2d01f4459b1e90fd12cc7840e [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:06:40.801590 24887 raft_consensus.cc:493] T ff75a1d4cb1f493db8f71ddc136ba9ab P e61c3a8f61bb48f8a963c9480e53c168 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader e5256d91808b47c195bc9b4dbd7f2b87)
W20260709 13:06:40.828441 25004 log.cc:927] Time spent T ef32ce6fdd0e40d382c79974f30295c6 P e5256d91808b47c195bc9b4dbd7f2b87: Append to log took a long time: real 0.394s	user 0.000s	sys 0.001s
I20260709 13:06:40.899025 20112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ece3db938bc649d4a40a51522ed5259c" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:06:40.827862 19526 leader_election.cc:304] T 76cb037fc9064d13b59a8969d897ce8c P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:06:40.832763 24837 raft_consensus.cc:2749] T 0e1085d23e8347fbbd5bce7542f4b1f4 P e61c3a8f61bb48f8a963c9480e53c168 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:06:40.903903 24276 raft_consensus.cc:493] T 6c5eebf646ad445a9d1b1adc319d7b16 P 0473d2b2d01f4459b1e90fd12cc7840e [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:40.829895 24996 raft_consensus.cc:2804] T e381f1d6b8184797ad142de49be225a8 P e5256d91808b47c195bc9b4dbd7f2b87 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:06:40.883885 24935 raft_consensus.cc:493] T 2b74109013a140ada21feeef92d6f563 P e5256d91808b47c195bc9b4dbd7f2b87 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader e61c3a8f61bb48f8a963c9480e53c168)
I20260709 13:06:40.914755 19479 raft_consensus.cc:2393] T a08760e15aac4630a629431f56024dc8 P 0473d2b2d01f4459b1e90fd12cc7840e [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate e5256d91808b47c195bc9b4dbd7f2b87 in current term 19: Already voted for candidate 0473d2b2d01f4459b1e90fd12cc7840e in this term.
W20260709 13:06:40.919464 19526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.2:46257, user_credentials={real_user=slave}} blocked reactor thread for 91695.1us
W20260709 13:06:40.906076 20076 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.3:36891, user_credentials={real_user=slave}} blocked reactor thread for 71762.7us
I20260709 13:06:40.918138 19478 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58294 (request call id 2592) took 1232 ms. Trace:
I20260709 13:06:40.943674 19478 rpcz_store.cc:276] 0709 13:06:39.686043 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:39.686143 (+   100us) service_pool.cc:224] Handling call
0709 13:06:39.697397 (+ 11254us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:39.714557 (+ 17160us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:39.714612 (+    55us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:39.734342 (+ 19730us) log.cc:844] Serialized 26 byte log entry
0709 13:06:40.079203 (+344861us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:06:40.158969 (+ 79766us) log.cc:844] Serialized 14 byte log entry
0709 13:06:40.470745 (+311776us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:40.470848 (+   103us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:40.917933 (+447085us) raft_consensus.cc:1685] finished
0709 13:06:40.917953 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:40.918083 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":67036,"prepare.queue_time_us":79870,"prepare.run_cpu_time_us":57,"prepare.run_wall_time_us":7824,"raft.queue_time_us":179345,"raft.run_cpu_time_us":297,"raft.run_wall_time_us":19642,"thread_start_us":561576,"threads_started":2,"wal-append.queue_time_us":496594}
I20260709 13:06:40.917801 24731 raft_consensus.cc:2764] T 48824d5acfbc485ebf8c2d944e7202de P 127766fc592545a4997f7790f50f6076 [term 18 FOLLOWER]: Leader pre-election decision vote started in defunct term 17: won
I20260709 13:06:40.923736 19450 leader_election.cc:304] T df751f992649444090e27965eb1af85d P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:06:40.948230 24982 leader_election.cc:290] T 9962423cb4e54fcfa5de01daf68a86e7 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 14 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:06:40.948230 19450 leader_election.cc:304] T 48824d5acfbc485ebf8c2d944e7202de P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:06:40.949079 24982 raft_consensus.cc:2804] T df751f992649444090e27965eb1af85d P 0473d2b2d01f4459b1e90fd12cc7840e [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:06:40.949435 24982 raft_consensus.cc:493] T df751f992649444090e27965eb1af85d P 0473d2b2d01f4459b1e90fd12cc7840e [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:40.949761 24982 raft_consensus.cc:3060] T df751f992649444090e27965eb1af85d P 0473d2b2d01f4459b1e90fd12cc7840e [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:06:40.951004 19485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9962423cb4e54fcfa5de01daf68a86e7" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:06:40.951566 19485 raft_consensus.cc:3060] T 9962423cb4e54fcfa5de01daf68a86e7 P 0473d2b2d01f4459b1e90fd12cc7840e [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:06:40.952075 24852 consensus_queue.cc:1048] T ab43d85f64114d4ebf618930e43d9ed0 P 127766fc592545a4997f7790f50f6076 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:06:40.955677 19553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b74109013a140ada21feeef92d6f563" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:06:40.956207 19557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f575b143b844aa096b50997dad3516a" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:06:40.956910 19552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a08760e15aac4630a629431f56024dc8" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:06:40.957464 19555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21e14947d70440f19044d8f75c31e1f9" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:06:40.957798 19552 raft_consensus.cc:2393] T a08760e15aac4630a629431f56024dc8 P e61c3a8f61bb48f8a963c9480e53c168 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 0473d2b2d01f4459b1e90fd12cc7840e in current term 19: Already voted for candidate e5256d91808b47c195bc9b4dbd7f2b87 in this term.
I20260709 13:06:40.817497 24824 raft_consensus.cc:515] T f93ee515a9c14139bf566522ed8232f3 P e5256d91808b47c195bc9b4dbd7f2b87 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:40.928321 24990 consensus_queue.cc:1048] T fa8650e71aa14778b3d73721fc50d9fc P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:06:40.930472 24573 leader_election.cc:290] T a08760e15aac4630a629431f56024dc8 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 19 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:06:40.931289 24891 leader_election.cc:290] T f93ee515a9c14139bf566522ed8232f3 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:06:40.931725 24876 consensus_queue.cc:1048] T 0cdf56e38bbc453d9438d359e5a69955 P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:06:40.922776 24972 raft_consensus.cc:697] T 70797e5783b5454ab0d0eea663e791e3 P e5256d91808b47c195bc9b4dbd7f2b87 [term 16 LEADER]: Becoming Leader. State: Replica: e5256d91808b47c195bc9b4dbd7f2b87, State: Running, Role: LEADER
I20260709 13:06:40.960513 19377 leader_election.cc:304] T 309c3ca0ca4b4f3ba129752ea2cb293b P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, 127766fc592545a4997f7790f50f6076
I20260709 13:06:40.961910 19554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "309c3ca0ca4b4f3ba129752ea2cb293b" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:06:40.962917 19481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7be9efa6559648dbb5a0f7684c4542d1" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:06:40.963287 19486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86a6797bdfe94fa496c050ceae4bd0d9" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:06:40.976776 19481 raft_consensus.cc:3060] T 7be9efa6559648dbb5a0f7684c4542d1 P 0473d2b2d01f4459b1e90fd12cc7840e [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:06:40.966116 19485 raft_consensus.cc:2468] T 9962423cb4e54fcfa5de01daf68a86e7 P 0473d2b2d01f4459b1e90fd12cc7840e [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 127766fc592545a4997f7790f50f6076 in term 15.
I20260709 13:06:40.832571 24702 raft_consensus.cc:515] T 2e36a9d6e29c4a7c860cf267efbd4c74 P e61c3a8f61bb48f8a963c9480e53c168 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:40.968484 19484 raft_consensus.cc:1275] T 40e1e16737a842ee936002830f36882e P 0473d2b2d01f4459b1e90fd12cc7840e [term 17 FOLLOWER]: Refusing update from remote peer e5256d91808b47c195bc9b4dbd7f2b87: Log matching property violated. Preceding OpId in replica: term: 15 index: 8. Preceding OpId from leader: term: 17 index: 9. (index mismatch)
I20260709 13:06:40.968443 19560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2725d2c4cb054f18b0fc8f735c15f6c2" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:06:40.913419 24926 raft_consensus.cc:2804] T 22196caba61445d3bec98a0aab3c337d P 0473d2b2d01f4459b1e90fd12cc7840e [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:06:40.825896 24949 raft_consensus.cc:515] T 62c6c134d3d24a1ab144dd9ee6bc3f64 P 127766fc592545a4997f7790f50f6076 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:40.917362 24866 raft_consensus.cc:493] T 2a16f7501e2444fb86d4e2778e734e02 P e5256d91808b47c195bc9b4dbd7f2b87 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:40.973755 19555 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6c5eebf646ad445a9d1b1adc319d7b16"
dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
mode: GRACEFUL
new_leader_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
 from {username='slave'} at 127.0.0.1:39264
I20260709 13:06:40.926100 24936 raft_consensus.cc:2804] T 76cb037fc9064d13b59a8969d897ce8c P e61c3a8f61bb48f8a963c9480e53c168 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:06:40.975668 19558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f93ee515a9c14139bf566522ed8232f3" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:06:40.979492 19556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0afb57ae58a24a01850491d69f0213dd" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:06:41.001484 19484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "217b5fae677b4971b3bbd2f357a1f7ff" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:06:40.976085 19554 raft_consensus.cc:2468] T 309c3ca0ca4b4f3ba129752ea2cb293b P e61c3a8f61bb48f8a963c9480e53c168 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 10.
I20260709 13:06:40.957683 24996 raft_consensus.cc:493] T e381f1d6b8184797ad142de49be225a8 P e5256d91808b47c195bc9b4dbd7f2b87 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:40.982110 19486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76cb037fc9064d13b59a8969d897ce8c" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:06:41.003189 19478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28af091831594f9d8e96482078cc7625" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:06:41.004810 19478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22196caba61445d3bec98a0aab3c337d" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:06:40.967901 25018 raft_consensus.cc:2804] T 48824d5acfbc485ebf8c2d944e7202de P 0473d2b2d01f4459b1e90fd12cc7840e [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:06:41.000692 19377 leader_election.cc:304] T 3e1f505cb0f1427bbd698ac889d80821 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87; no voters: 
I20260709 13:06:41.007225 19405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "179fd671030940b4b4a4e24bcc4aba0a" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:06:41.010991 19486 raft_consensus.cc:2393] T 76cb037fc9064d13b59a8969d897ce8c P 0473d2b2d01f4459b1e90fd12cc7840e [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate e5256d91808b47c195bc9b4dbd7f2b87 in current term 14: Already voted for candidate e61c3a8f61bb48f8a963c9480e53c168 in this term.
I20260709 13:06:40.971642 24932 raft_consensus.cc:493] T ff75a1d4cb1f493db8f71ddc136ba9ab P 0473d2b2d01f4459b1e90fd12cc7840e [term 15 FOLLOWER]: Starting pre-election (detected failure of leader e5256d91808b47c195bc9b4dbd7f2b87)
I20260709 13:06:40.921788 24887 raft_consensus.cc:515] T ff75a1d4cb1f493db8f71ddc136ba9ab P e61c3a8f61bb48f8a963c9480e53c168 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:40.920686 24875 consensus_queue.cc:1059] T ef32ce6fdd0e40d382c79974f30295c6 P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 }, Status: INVALID_TERM, Last received: 18.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.058s
I20260709 13:06:41.018643 19555 raft_consensus.cc:606] T 6c5eebf646ad445a9d1b1adc319d7b16 P e61c3a8f61bb48f8a963c9480e53c168 [term 15 LEADER]: Received request to transfer leadership to TS 0473d2b2d01f4459b1e90fd12cc7840e
I20260709 13:06:40.981577 24941 raft_consensus.cc:3060] T 309c3ca0ca4b4f3ba129752ea2cb293b P e5256d91808b47c195bc9b4dbd7f2b87 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:06:40.981456 24812 raft_consensus.cc:493] T f93ee515a9c14139bf566522ed8232f3 P e61c3a8f61bb48f8a963c9480e53c168 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:40.965566 24276 raft_consensus.cc:515] T 6c5eebf646ad445a9d1b1adc319d7b16 P 0473d2b2d01f4459b1e90fd12cc7840e [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:40.966481 24935 raft_consensus.cc:515] T 2b74109013a140ada21feeef92d6f563 P e5256d91808b47c195bc9b4dbd7f2b87 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:41.000221 24926 raft_consensus.cc:493] T 22196caba61445d3bec98a0aab3c337d P 0473d2b2d01f4459b1e90fd12cc7840e [term 13 FOLLOWER]: Starting leader election (detected failure of leader e61c3a8f61bb48f8a963c9480e53c168)
I20260709 13:06:41.009088 24996 raft_consensus.cc:3060] T e381f1d6b8184797ad142de49be225a8 P e5256d91808b47c195bc9b4dbd7f2b87 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:06:41.006505 24866 raft_consensus.cc:3060] T 2a16f7501e2444fb86d4e2778e734e02 P e5256d91808b47c195bc9b4dbd7f2b87 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:06:41.049350 24887 leader_election.cc:290] T ff75a1d4cb1f493db8f71ddc136ba9ab P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:06:41.050875 24972 consensus_queue.cc:237] T 70797e5783b5454ab0d0eea663e791e3 P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:41.051728 24825 consensus_queue.cc:1048] T 179fd671030940b4b4a4e24bcc4aba0a P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:06:41.059643 24824 leader_election.cc:290] T f93ee515a9c14139bf566522ed8232f3 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:06:41.040782 24898 raft_consensus.cc:3055] T ef32ce6fdd0e40d382c79974f30295c6 P 0473d2b2d01f4459b1e90fd12cc7840e [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:06:41.065482 24898 raft_consensus.cc:740] T ef32ce6fdd0e40d382c79974f30295c6 P 0473d2b2d01f4459b1e90fd12cc7840e [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 0473d2b2d01f4459b1e90fd12cc7840e, State: Running, Role: LEADER
I20260709 13:06:41.066780 24898 consensus_queue.cc:260] T ef32ce6fdd0e40d382c79974f30295c6 P 0473d2b2d01f4459b1e90fd12cc7840e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 18.10, Last appended by leader: 10, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:41.068545 24898 raft_consensus.cc:3060] T ef32ce6fdd0e40d382c79974f30295c6 P 0473d2b2d01f4459b1e90fd12cc7840e [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:06:41.025069 24597 leader_election.cc:290] T 76cb037fc9064d13b59a8969d897ce8c P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 14 election: Requested vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:06:41.028985 25018 raft_consensus.cc:697] T 48824d5acfbc485ebf8c2d944e7202de P 0473d2b2d01f4459b1e90fd12cc7840e [term 18 LEADER]: Becoming Leader. State: Replica: 0473d2b2d01f4459b1e90fd12cc7840e, State: Running, Role: LEADER
I20260709 13:06:41.072883 25018 consensus_queue.cc:237] T 48824d5acfbc485ebf8c2d944e7202de P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.12, Last appended by leader: 12, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:41.073652 19409 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52342 (request call id 2901) took 1094 ms. Trace:
I20260709 13:06:41.074226 19409 rpcz_store.cc:276] 0709 13:06:39.979023 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:39.981264 (+  2241us) service_pool.cc:224] Handling call
0709 13:06:39.981557 (+   293us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:39.981924 (+   367us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:39.981949 (+    25us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:39.982402 (+   453us) log.cc:844] Serialized 26 byte log entry
0709 13:06:40.207615 (+225213us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:06:40.207655 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:40.207758 (+   103us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:41.060254 (+852496us) raft_consensus.cc:1685] finished
0709 13:06:41.060292 (+    38us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:41.073567 (+ 13275us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":494,"raft.run_cpu_time_us":92,"raft.run_wall_time_us":92,"thread_start_us":223427,"threads_started":1,"wal-append.queue_time_us":338181}
I20260709 13:06:41.030748 24995 raft_consensus.cc:2804] T 3e1f505cb0f1427bbd698ac889d80821 P e5256d91808b47c195bc9b4dbd7f2b87 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:06:41.077065 24995 raft_consensus.cc:493] T 3e1f505cb0f1427bbd698ac889d80821 P e5256d91808b47c195bc9b4dbd7f2b87 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:41.077634 24995 raft_consensus.cc:3060] T 3e1f505cb0f1427bbd698ac889d80821 P e5256d91808b47c195bc9b4dbd7f2b87 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:06:41.080720 24935 leader_election.cc:290] T 2b74109013a140ada21feeef92d6f563 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:06:41.039434 24932 raft_consensus.cc:515] T ff75a1d4cb1f493db8f71ddc136ba9ab P 0473d2b2d01f4459b1e90fd12cc7840e [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:41.085065 24932 leader_election.cc:290] T ff75a1d4cb1f493db8f71ddc136ba9ab P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:06:41.085810 24758 raft_consensus.cc:515] T 70797e5783b5454ab0d0eea663e791e3 P 127766fc592545a4997f7790f50f6076 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
W20260709 13:06:41.089849 19449 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.1:40321, user_credentials={real_user=slave}} blocked reactor thread for 296266us
I20260709 13:06:41.091919 19449 leader_election.cc:304] T 76cb037fc9064d13b59a8969d897ce8c P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87; no voters: e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:06:41.111023 20108 raft_consensus.cc:1240] T 70797e5783b5454ab0d0eea663e791e3 P 127766fc592545a4997f7790f50f6076 [term 17 FOLLOWER]: Rejecting Update request from peer e61c3a8f61bb48f8a963c9480e53c168 for earlier term 15. Current term is 17. Ops: [15.12-15.12]
I20260709 13:06:41.063484 24926 raft_consensus.cc:3060] T 22196caba61445d3bec98a0aab3c337d P 0473d2b2d01f4459b1e90fd12cc7840e [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:06:41.124390 19449 leader_election.cc:304] T bc225c93219c45538b53a1bd3d387e4d P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e; no voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:06:41.044139 24812 raft_consensus.cc:515] T f93ee515a9c14139bf566522ed8232f3 P e61c3a8f61bb48f8a963c9480e53c168 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:41.064180 24702 leader_election.cc:290] T 2e36a9d6e29c4a7c860cf267efbd4c74 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
W20260709 13:06:41.101205 24943 consensus_meta.cc:287] T 1a61655d99124a29b486ba4a5b37faea P 0473d2b2d01f4459b1e90fd12cc7840e: Time spent flushing consensus metadata: real 0.814s	user 0.007s	sys 0.003s
I20260709 13:06:41.023411 24892 consensus_queue.cc:237] T 86a6797bdfe94fa496c050ceae4bd0d9 P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.5, Last appended by leader: 5, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
W20260709 13:06:41.121902 25028 log.cc:927] Time spent T edd7d470b5014c9489be7f41f64355c9 P e5256d91808b47c195bc9b4dbd7f2b87: Append to log took a long time: real 0.051s	user 0.000s	sys 0.005s
I20260709 13:06:41.131083 19449 leader_election.cc:304] T e381f1d6b8184797ad142de49be225a8 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e; no voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:06:41.100847 24936 raft_consensus.cc:697] T 76cb037fc9064d13b59a8969d897ce8c P e61c3a8f61bb48f8a963c9480e53c168 [term 14 LEADER]: Becoming Leader. State: Replica: e61c3a8f61bb48f8a963c9480e53c168, State: Running, Role: LEADER
I20260709 13:06:41.108317 24932 raft_consensus.cc:2764] T 76cb037fc9064d13b59a8969d897ce8c P 0473d2b2d01f4459b1e90fd12cc7840e [term 14 FOLLOWER]: Leader pre-election decision vote started in defunct term 13: won
I20260709 13:06:41.127895 24790 raft_consensus.cc:493] T 85c494af21f9457a85da47b9bc70c1fd P e61c3a8f61bb48f8a963c9480e53c168 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader e5256d91808b47c195bc9b4dbd7f2b87)
I20260709 13:06:41.130751 24573 raft_consensus.cc:2749] T bc225c93219c45538b53a1bd3d387e4d P 0473d2b2d01f4459b1e90fd12cc7840e [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:06:41.136385 24758 leader_election.cc:290] T 70797e5783b5454ab0d0eea663e791e3 P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 17 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:06:41.126017 24941 raft_consensus.cc:2749] T 309c3ca0ca4b4f3ba129752ea2cb293b P e5256d91808b47c195bc9b4dbd7f2b87 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 13:06:41.126086 25007 log.cc:927] Time spent T 172b3dd13109415a955b71ac0e9d2234 P 127766fc592545a4997f7790f50f6076: Append to log took a long time: real 0.392s	user 0.003s	sys 0.004s
I20260709 13:06:41.143941 19552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70797e5783b5454ab0d0eea663e791e3" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 17 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:06:41.109882 24946 raft_consensus.cc:2749] T 2a16f7501e2444fb86d4e2778e734e02 P 127766fc592545a4997f7790f50f6076 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 13:06:41.157848 19377 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.2:46257, user_credentials={real_user=slave}} blocked reactor thread for 157041us
I20260709 13:06:41.190780 19377 leader_election.cc:304] T 9962423cb4e54fcfa5de01daf68a86e7 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87; no voters: 127766fc592545a4997f7790f50f6076
I20260709 13:06:41.160773 19558 raft_consensus.cc:2468] T f93ee515a9c14139bf566522ed8232f3 P e61c3a8f61bb48f8a963c9480e53c168 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 17.
W20260709 13:06:41.159403 25029 log.cc:927] Time spent T 96efeaaf1057492490e9a621f37e1a2d P e61c3a8f61bb48f8a963c9480e53c168: Append to log took a long time: real 0.076s	user 0.001s	sys 0.004s
W20260709 13:06:41.185973 19526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.2:46257, user_credentials={real_user=slave}} blocked reactor thread for 211738us
I20260709 13:06:41.187533 19477 raft_consensus.cc:1240] T 1dc5b3532fe54f74876d02beffa2c230 P 0473d2b2d01f4459b1e90fd12cc7840e [term 17 LEADER]: Rejecting Update request from peer e5256d91808b47c195bc9b4dbd7f2b87 for earlier term 16. Current term is 17. Ops: []
W20260709 13:06:41.180512 25031 log.cc:927] Time spent T 7f575b143b844aa096b50997dad3516a P e5256d91808b47c195bc9b4dbd7f2b87: Append to log took a long time: real 0.108s	user 0.009s	sys 0.007s
I20260709 13:06:41.206985 24949 leader_election.cc:290] T 62c6c134d3d24a1ab144dd9ee6bc3f64 P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:06:41.209746 24996 raft_consensus.cc:515] T e381f1d6b8184797ad142de49be225a8 P e5256d91808b47c195bc9b4dbd7f2b87 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:41.210721 24629 raft_consensus.cc:3055] T ed7fdbcb96d14d418db9ca90a792588a P 127766fc592545a4997f7790f50f6076 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:06:41.211097 24629 raft_consensus.cc:740] T ed7fdbcb96d14d418db9ca90a792588a P 127766fc592545a4997f7790f50f6076 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 127766fc592545a4997f7790f50f6076, State: Running, Role: LEADER
I20260709 13:06:41.211876 24629 consensus_queue.cc:260] T ed7fdbcb96d14d418db9ca90a792588a P 127766fc592545a4997f7790f50f6076 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:41.213083 24629 raft_consensus.cc:3060] T ed7fdbcb96d14d418db9ca90a792588a P 127766fc592545a4997f7790f50f6076 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:06:41.215273 24276 leader_election.cc:290] T 6c5eebf646ad445a9d1b1adc319d7b16 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:06:41.187024 19449 leader_election.cc:304] T 46c5bfeecc314717bffe987e6844b6d0 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87; no voters: e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:06:41.216378 24936 consensus_queue.cc:237] T 76cb037fc9064d13b59a8969d897ce8c P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.7, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:41.185776 24790 raft_consensus.cc:515] T 85c494af21f9457a85da47b9bc70c1fd P e61c3a8f61bb48f8a963c9480e53c168 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:41.218950 24597 raft_consensus.cc:2804] T 9962423cb4e54fcfa5de01daf68a86e7 P e5256d91808b47c195bc9b4dbd7f2b87 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:06:41.219385 24597 raft_consensus.cc:493] T 9962423cb4e54fcfa5de01daf68a86e7 P e5256d91808b47c195bc9b4dbd7f2b87 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:41.219206 24935 consensus_queue.cc:1048] T 40e1e16737a842ee936002830f36882e P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:06:41.219796 24597 raft_consensus.cc:3060] T 9962423cb4e54fcfa5de01daf68a86e7 P e5256d91808b47c195bc9b4dbd7f2b87 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:06:41.219993 24990 raft_consensus.cc:2804] T 46c5bfeecc314717bffe987e6844b6d0 P 0473d2b2d01f4459b1e90fd12cc7840e [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:06:41.220405 24990 raft_consensus.cc:493] T 46c5bfeecc314717bffe987e6844b6d0 P 0473d2b2d01f4459b1e90fd12cc7840e [term 20 FOLLOWER]: Starting leader election (detected failure of leader e5256d91808b47c195bc9b4dbd7f2b87)
I20260709 13:06:41.220778 24990 raft_consensus.cc:3060] T 46c5bfeecc314717bffe987e6844b6d0 P 0473d2b2d01f4459b1e90fd12cc7840e [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:06:41.225325 19486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62c6c134d3d24a1ab144dd9ee6bc3f64" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:06:41.194491 24932 consensus_queue.cc:1048] T fa8650e71aa14778b3d73721fc50d9fc P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.032s
I20260709 13:06:41.226271 19552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62c6c134d3d24a1ab144dd9ee6bc3f64" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:06:41.202486 20103 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35874 (request call id 1019) took 1280 ms. Trace:
I20260709 13:06:41.204028 24812 leader_election.cc:290] T f93ee515a9c14139bf566522ed8232f3 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:06:41.205443 24930 leader_election.cc:290] T f1b10566f45d4a7d9029858330e02d5b P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:06:41.180457 24891 raft_consensus.cc:2749] T e381f1d6b8184797ad142de49be225a8 P 0473d2b2d01f4459b1e90fd12cc7840e [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:06:41.158505 24943 raft_consensus.cc:515] T 1a61655d99124a29b486ba4a5b37faea P 0473d2b2d01f4459b1e90fd12cc7840e [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:41.243557 24876 raft_consensus.cc:493] T ab43d85f64114d4ebf618930e43d9ed0 P 0473d2b2d01f4459b1e90fd12cc7840e [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:41.247455 24876 raft_consensus.cc:515] T ab43d85f64114d4ebf618930e43d9ed0 P 0473d2b2d01f4459b1e90fd12cc7840e [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:41.248095 20108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96efeaaf1057492490e9a621f37e1a2d" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:06:41.248705 20108 raft_consensus.cc:2468] T 96efeaaf1057492490e9a621f37e1a2d P 127766fc592545a4997f7790f50f6076 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 17.
I20260709 13:06:41.249651 24876 leader_election.cc:290] T ab43d85f64114d4ebf618930e43d9ed0 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:06:41.252310 19405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f575b143b844aa096b50997dad3516a" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
I20260709 13:06:41.210112 24866 raft_consensus.cc:515] T 2a16f7501e2444fb86d4e2778e734e02 P e5256d91808b47c195bc9b4dbd7f2b87 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:41.227029 19408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14935b3ddf914369822e4a0547aaa355" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:06:41.230052 19404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "179fd671030940b4b4a4e24bcc4aba0a" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 19 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:06:41.233991 19403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1b10566f45d4a7d9029858330e02d5b" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:06:41.231573 19410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edd7d470b5014c9489be7f41f64355c9" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
I20260709 13:06:41.238955 19409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2725d2c4cb054f18b0fc8f735c15f6c2" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:06:41.231694 20103 rpcz_store.cc:276] 0709 13:06:39.922052 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:39.926310 (+  4258us) service_pool.cc:224] Handling call
0709 13:06:39.946846 (+ 20536us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:39.957026 (+ 10180us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:39.957056 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:39.989281 (+ 32225us) log.cc:844] Serialized 26 byte log entry
0709 13:06:40.266878 (+277597us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:06:40.266921 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:40.267002 (+    81us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:41.076750 (+809748us) spinlock_profiling.cc:243] Waited 59.4 ms on lock 0x7b4400022b4c. stack: 00007f4a79de9343 00007f4a79de9240 00007f4a797781d4 00007f4a834b6304 00007f4a834b6299 00007f4a79ca3db1 00007f4a79d41c85 00007f4a79d426a2 00007f4a7cab41db 00007f4a7caafaaf 00007f4a7caa386e 00007f4a7caa2bb6 00007f4a7caa27d8 00007f4a7caac221 00007f4a7caac1d9 00007f4a7caac169
0709 13:06:41.202178 (+125428us) raft_consensus.cc:1685] finished
0709 13:06:41.202215 (+    37us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:41.202412 (+   197us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":37120,"raft.queue_time_us":9902,"raft.run_cpu_time_us":88,"raft.run_wall_time_us":4158,"spinlock_wait_cycles":136609536,"thread_start_us":262310,"threads_started":1,"wal-append.queue_time_us":690289}
I20260709 13:06:41.235409 19481 raft_consensus.cc:2468] T 7be9efa6559648dbb5a0f7684c4542d1 P 0473d2b2d01f4459b1e90fd12cc7840e [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 15.
I20260709 13:06:41.262409 19481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef32ce6fdd0e40d382c79974f30295c6" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:06:41.242683 19411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b74109013a140ada21feeef92d6f563" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:06:41.233626 19526 leader_election.cc:304] T df751f992649444090e27965eb1af85d P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:06:41.254348 19406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a08760e15aac4630a629431f56024dc8" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
I20260709 13:06:41.226637 19486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0afb57ae58a24a01850491d69f0213dd" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:06:41.257498 19407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21e14947d70440f19044d8f75c31e1f9" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:06:41.264808 19484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e36a9d6e29c4a7c860cf267efbd4c74" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:06:41.258090 19402 raft_consensus.cc:1275] T 0cdf56e38bbc453d9438d359e5a69955 P e5256d91808b47c195bc9b4dbd7f2b87 [term 16 FOLLOWER]: Refusing update from remote peer 0473d2b2d01f4459b1e90fd12cc7840e: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 13:06:41.265576 20104 raft_consensus.cc:1275] T 1efebf73c86e432baa55533136b6e12c P 127766fc592545a4997f7790f50f6076 [term 14 FOLLOWER]: Refusing update from remote peer 0473d2b2d01f4459b1e90fd12cc7840e: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 13:06:41.267920 19406 raft_consensus.cc:2393] T a08760e15aac4630a629431f56024dc8 P e5256d91808b47c195bc9b4dbd7f2b87 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 0473d2b2d01f4459b1e90fd12cc7840e in current term 19: Already voted for candidate e5256d91808b47c195bc9b4dbd7f2b87 in this term.
I20260709 13:06:41.268982 19484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff75a1d4cb1f493db8f71ddc136ba9ab" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:06:41.269270 20104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c5eebf646ad445a9d1b1adc319d7b16" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:06:41.269572 19484 raft_consensus.cc:2468] T ff75a1d4cb1f493db8f71ddc136ba9ab P 0473d2b2d01f4459b1e90fd12cc7840e [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 15.
I20260709 13:06:41.269825 20104 raft_consensus.cc:2468] T 6c5eebf646ad445a9d1b1adc319d7b16 P 127766fc592545a4997f7790f50f6076 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 15.
I20260709 13:06:41.271355 19486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b74109013a140ada21feeef92d6f563" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:06:41.271831 19486 raft_consensus.cc:2468] T 2b74109013a140ada21feeef92d6f563 P 0473d2b2d01f4459b1e90fd12cc7840e [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 12.
I20260709 13:06:41.272495 19486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f93ee515a9c14139bf566522ed8232f3" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 18 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:06:41.273154 19486 raft_consensus.cc:2410] T f93ee515a9c14139bf566522ed8232f3 P 0473d2b2d01f4459b1e90fd12cc7840e [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e5256d91808b47c195bc9b4dbd7f2b87 for term 18 because replica has last-logged OpId of term: 16 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 7.
I20260709 13:06:41.282975 24935 raft_consensus.cc:493] T ff9b0eddd810459b82d91c60777c10eb P e5256d91808b47c195bc9b4dbd7f2b87 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 127766fc592545a4997f7790f50f6076)
I20260709 13:06:41.284072 20112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "309c3ca0ca4b4f3ba129752ea2cb293b" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:06:41.291199 20110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9962423cb4e54fcfa5de01daf68a86e7" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076"
I20260709 13:06:41.292202 20110 raft_consensus.cc:2368] T 9962423cb4e54fcfa5de01daf68a86e7 P 127766fc592545a4997f7790f50f6076 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 0473d2b2d01f4459b1e90fd12cc7840e for earlier term 14. Current term is 15.
I20260709 13:06:41.201264 24995 raft_consensus.cc:515] T 3e1f505cb0f1427bbd698ac889d80821 P e5256d91808b47c195bc9b4dbd7f2b87 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:41.295332 19484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "179fd671030940b4b4a4e24bcc4aba0a" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:06:41.296628 19480 raft_consensus.cc:2410] T 1a61655d99124a29b486ba4a5b37faea P 0473d2b2d01f4459b1e90fd12cc7840e [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e61c3a8f61bb48f8a963c9480e53c168 for term 14 because replica has last-logged OpId of term: 12 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 7.
I20260709 13:06:41.253357 24626 raft_consensus.cc:493] T 309c3ca0ca4b4f3ba129752ea2cb293b P 127766fc592545a4997f7790f50f6076 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:41.308358 19484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f93ee515a9c14139bf566522ed8232f3" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 18 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:06:41.313406 19526 leader_election.cc:304] T ff75a1d4cb1f493db8f71ddc136ba9ab P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:06:41.298434 20108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14935b3ddf914369822e4a0547aaa355" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:06:41.313454 19449 leader_election.cc:304] T 14935b3ddf914369822e4a0547aaa355 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e; no voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:06:41.316232 19408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f93ee515a9c14139bf566522ed8232f3" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:06:41.315938 19449 leader_election.cc:304] T ed7fdbcb96d14d418db9ca90a792588a P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e; no voters: 127766fc592545a4997f7790f50f6076, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:06:41.317071 19408 raft_consensus.cc:2393] T f93ee515a9c14139bf566522ed8232f3 P e5256d91808b47c195bc9b4dbd7f2b87 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0473d2b2d01f4459b1e90fd12cc7840e in current term 17: Already voted for candidate e5256d91808b47c195bc9b4dbd7f2b87 in this term.
I20260709 13:06:41.312276 19484 raft_consensus.cc:2468] T f93ee515a9c14139bf566522ed8232f3 P 0473d2b2d01f4459b1e90fd12cc7840e [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 16.
I20260709 13:06:41.318115 19481 raft_consensus.cc:2468] T ef32ce6fdd0e40d382c79974f30295c6 P 0473d2b2d01f4459b1e90fd12cc7840e [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 19.
W20260709 13:06:41.294567 19375 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.3:36891, user_credentials={real_user=slave}} blocked reactor thread for 261913us
I20260709 13:06:41.320175 19449 leader_election.cc:304] T 172b3dd13109415a955b71ac0e9d2234 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e; no voters: 127766fc592545a4997f7790f50f6076, e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:06:41.318588 19484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a61655d99124a29b486ba4a5b37faea" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 14 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:06:41.285017 24989 raft_consensus.cc:2804] T df751f992649444090e27965eb1af85d P e61c3a8f61bb48f8a963c9480e53c168 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:06:41.322291 19486 raft_consensus.cc:1240] T ed7fdbcb96d14d418db9ca90a792588a P 0473d2b2d01f4459b1e90fd12cc7840e [term 12 FOLLOWER]: Rejecting Update request from peer 127766fc592545a4997f7790f50f6076 for earlier term 11. Current term is 12. Ops: [11.10-11.10]
I20260709 13:06:41.243633 24931 consensus_queue.cc:1059] T 70797e5783b5454ab0d0eea663e791e3 P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false }, Status: INVALID_TERM, Last received: 14.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.055s
I20260709 13:06:41.323967 19375 leader_election.cc:304] T df751f992649444090e27965eb1af85d P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168; no voters: 0473d2b2d01f4459b1e90fd12cc7840e
W20260709 13:06:41.391145 19375 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.3:36891, user_credentials={real_user=slave}} blocked reactor thread for 67251.4us
I20260709 13:06:41.391295 24824 raft_consensus.cc:2804] T df751f992649444090e27965eb1af85d P e5256d91808b47c195bc9b4dbd7f2b87 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:06:41.391846 24824 raft_consensus.cc:493] T df751f992649444090e27965eb1af85d P e5256d91808b47c195bc9b4dbd7f2b87 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:41.392254 24824 raft_consensus.cc:3060] T df751f992649444090e27965eb1af85d P e5256d91808b47c195bc9b4dbd7f2b87 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:06:41.393255 19375 leader_election.cc:304] T 2725d2c4cb054f18b0fc8f735c15f6c2 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:06:41.394232 24942 raft_consensus.cc:493] T fa731b585f684a7fb2d106c50f143b83 P e5256d91808b47c195bc9b4dbd7f2b87 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 127766fc592545a4997f7790f50f6076)
I20260709 13:06:41.394732 24942 raft_consensus.cc:515] T fa731b585f684a7fb2d106c50f143b83 P e5256d91808b47c195bc9b4dbd7f2b87 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:41.394979 25020 raft_consensus.cc:2749] T 2725d2c4cb054f18b0fc8f735c15f6c2 P e5256d91808b47c195bc9b4dbd7f2b87 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:06:41.396056 24970 raft_consensus.cc:493] T 40e1e16737a842ee936002830f36882e P e61c3a8f61bb48f8a963c9480e53c168 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:41.396507 24970 raft_consensus.cc:515] T 40e1e16737a842ee936002830f36882e P e61c3a8f61bb48f8a963c9480e53c168 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:41.396893 24942 leader_election.cc:290] T fa731b585f684a7fb2d106c50f143b83 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:06:41.398093 20110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa731b585f684a7fb2d106c50f143b83" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
W20260709 13:06:41.401043 25033 log.cc:927] Time spent T 6c5eebf646ad445a9d1b1adc319d7b16 P e61c3a8f61bb48f8a963c9480e53c168: Append to log took a long time: real 0.262s	user 0.002s	sys 0.000s
I20260709 13:06:41.319134 24983 raft_consensus.cc:2749] T 14935b3ddf914369822e4a0547aaa355 P 0473d2b2d01f4459b1e90fd12cc7840e [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:06:41.344858 20103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab43d85f64114d4ebf618930e43d9ed0" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 18 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
W20260709 13:06:41.372907 20076 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:41.293162 25038 raft_consensus.cc:493] T ab43d85f64114d4ebf618930e43d9ed0 P e5256d91808b47c195bc9b4dbd7f2b87 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:41.405892 25038 raft_consensus.cc:515] T ab43d85f64114d4ebf618930e43d9ed0 P e5256d91808b47c195bc9b4dbd7f2b87 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } attrs { replace: true } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:41.319700 24837 raft_consensus.cc:2804] T ff75a1d4cb1f493db8f71ddc136ba9ab P e61c3a8f61bb48f8a963c9480e53c168 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:06:41.407281 24837 raft_consensus.cc:493] T ff75a1d4cb1f493db8f71ddc136ba9ab P e61c3a8f61bb48f8a963c9480e53c168 [term 15 FOLLOWER]: Starting leader election (detected failure of leader e5256d91808b47c195bc9b4dbd7f2b87)
I20260709 13:06:41.407678 24837 raft_consensus.cc:3060] T ff75a1d4cb1f493db8f71ddc136ba9ab P e61c3a8f61bb48f8a963c9480e53c168 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:06:41.407853 19479 raft_consensus.cc:1240] T edd7d470b5014c9489be7f41f64355c9 P 0473d2b2d01f4459b1e90fd12cc7840e [term 17 FOLLOWER]: Rejecting Update request from peer e61c3a8f61bb48f8a963c9480e53c168 for earlier term 16. Current term is 17. Ops: []
I20260709 13:06:41.377678 19486 raft_consensus.cc:1275] T ab43d85f64114d4ebf618930e43d9ed0 P 0473d2b2d01f4459b1e90fd12cc7840e [term 17 FOLLOWER]: Refusing update from remote peer 127766fc592545a4997f7790f50f6076: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 13:06:41.283589 24935 raft_consensus.cc:515] T ff9b0eddd810459b82d91c60777c10eb P e5256d91808b47c195bc9b4dbd7f2b87 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
W20260709 13:06:41.380857 19449 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.4:43121, user_credentials={real_user=slave}} blocked reactor thread for 58055.4us
W20260709 13:06:41.384449 25021 log.cc:927] Time spent T edd7d470b5014c9489be7f41f64355c9 P e61c3a8f61bb48f8a963c9480e53c168: Append to log took a long time: real 0.616s	user 0.003s	sys 0.000s
I20260709 13:06:41.320309 24626 raft_consensus.cc:515] T 309c3ca0ca4b4f3ba129752ea2cb293b P 127766fc592545a4997f7790f50f6076 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:41.385857 19408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff75a1d4cb1f493db8f71ddc136ba9ab" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:06:41.431084 19375 leader_election.cc:304] T a08760e15aac4630a629431f56024dc8 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:06:41.543591 20104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab43d85f64114d4ebf618930e43d9ed0" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:06:41.540035 19449 leader_election.cc:304] T 96efeaaf1057492490e9a621f37e1a2d P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, 127766fc592545a4997f7790f50f6076; no voters: e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:06:41.285192 24781 consensus_queue.cc:1059] T 7f575b143b844aa096b50997dad3516a P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 }, Status: INVALID_TERM, Last received: 11.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.040s
I20260709 13:06:41.562879 19486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab43d85f64114d4ebf618930e43d9ed0" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:06:41.565541 19486 raft_consensus.cc:1813] T ab43d85f64114d4ebf618930e43d9ed0 P 0473d2b2d01f4459b1e90fd12cc7840e [term 17 FOLLOWER]: Handling vote request from an unknown peer e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:06:41.558421 19449 leader_election.cc:304] T 6c5eebf646ad445a9d1b1adc319d7b16 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, 127766fc592545a4997f7790f50f6076; no voters: 
I20260709 13:06:41.568490 19486 raft_consensus.cc:2393] T ab43d85f64114d4ebf618930e43d9ed0 P 0473d2b2d01f4459b1e90fd12cc7840e [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e5256d91808b47c195bc9b4dbd7f2b87 in current term 17: Already voted for candidate 127766fc592545a4997f7790f50f6076 in this term.
I20260709 13:06:41.330335 24790 leader_election.cc:290] T 85c494af21f9457a85da47b9bc70c1fd P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:06:41.573626 20112 raft_consensus.cc:2410] T 309c3ca0ca4b4f3ba129752ea2cb293b P 127766fc592545a4997f7790f50f6076 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0473d2b2d01f4459b1e90fd12cc7840e for term 11 because replica has last-logged OpId of term: 9 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 9.
I20260709 13:06:41.409052 25038 leader_election.cc:290] T ab43d85f64114d4ebf618930e43d9ed0 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:06:41.433964 24970 leader_election.cc:290] T 40e1e16737a842ee936002830f36882e P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:06:41.548485 24898 raft_consensus.cc:2749] T ed7fdbcb96d14d418db9ca90a792588a P 0473d2b2d01f4459b1e90fd12cc7840e [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:06:41.583570 19408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9962423cb4e54fcfa5de01daf68a86e7" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
W20260709 13:06:41.572753 24982 consensus_meta.cc:287] T df751f992649444090e27965eb1af85d P 0473d2b2d01f4459b1e90fd12cc7840e: Time spent flushing consensus metadata: real 0.623s	user 0.010s	sys 0.000s
I20260709 13:06:41.559549 24989 raft_consensus.cc:697] T df751f992649444090e27965eb1af85d P e61c3a8f61bb48f8a963c9480e53c168 [term 18 LEADER]: Becoming Leader. State: Replica: e61c3a8f61bb48f8a963c9480e53c168, State: Running, Role: LEADER
I20260709 13:06:41.577759 24875 raft_consensus.cc:2804] T 6c5eebf646ad445a9d1b1adc319d7b16 P 0473d2b2d01f4459b1e90fd12cc7840e [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:06:41.625380 24935 leader_election.cc:290] T ff9b0eddd810459b82d91c60777c10eb P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:06:41.626812 24875 raft_consensus.cc:493] T 6c5eebf646ad445a9d1b1adc319d7b16 P 0473d2b2d01f4459b1e90fd12cc7840e [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:41.627331 24875 raft_consensus.cc:3060] T 6c5eebf646ad445a9d1b1adc319d7b16 P 0473d2b2d01f4459b1e90fd12cc7840e [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:06:41.627679 24995 leader_election.cc:290] T 3e1f505cb0f1427bbd698ac889d80821 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 18 election: Requested vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:06:41.585366 25038 raft_consensus.cc:493] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P e5256d91808b47c195bc9b4dbd7f2b87 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 127766fc592545a4997f7790f50f6076)
I20260709 13:06:41.631070 25038 raft_consensus.cc:515] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P e5256d91808b47c195bc9b4dbd7f2b87 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:41.563376 24276 consensus_queue.cc:1048] T 1efebf73c86e432baa55533136b6e12c P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Connected to new peer: Peer: permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.048s
I20260709 13:06:41.618602 24982 raft_consensus.cc:515] T df751f992649444090e27965eb1af85d P 0473d2b2d01f4459b1e90fd12cc7840e [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:41.623051 25039 raft_consensus.cc:2804] T a08760e15aac4630a629431f56024dc8 P e5256d91808b47c195bc9b4dbd7f2b87 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:06:41.606114 24573 raft_consensus.cc:2749] T 172b3dd13109415a955b71ac0e9d2234 P 0473d2b2d01f4459b1e90fd12cc7840e [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:06:41.704366 19404 raft_consensus.cc:1275] T b08304a0a02b42d7840c4e8ee9a6bd1a P e5256d91808b47c195bc9b4dbd7f2b87 [term 16 FOLLOWER]: Refusing update from remote peer 0473d2b2d01f4459b1e90fd12cc7840e: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
W20260709 13:06:41.698427 25030 log.cc:927] Time spent T ece3db938bc649d4a40a51522ed5259c P 127766fc592545a4997f7790f50f6076: Append to log took a long time: real 0.065s	user 0.000s	sys 0.000s
I20260709 13:06:41.724009 19482 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58286 (request call id 2383) took 1193 ms. Trace:
I20260709 13:06:41.724529 19482 rpcz_store.cc:276] 0709 13:06:40.531058 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:40.704428 (+173370us) service_pool.cc:224] Handling call
0709 13:06:40.723731 (+ 19303us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:40.800015 (+ 76284us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 13:06:40.820224 (+ 20209us) log.cc:844] Serialized 14 byte log entry
0709 13:06:41.078162 (+257938us) spinlock_profiling.cc:243] Waited 5.82 ms on lock 0x7b18002147e0. stack: 00007f4a79de9343 00007f4a79de9240 00007f4a797781d4 00007f4a834b6304 00007f4a834b6299 00007f4a82ce3de1 00007f4a82cf05b1 00007f4a79dfde07 00007f4a82c58ab9 00007f4a79e1a69b 00007f4a79e1893f 00007f4a79e1ac02 00007f4a7caa220b 00007f4a7caa7d23 00007f4a7caa823a 00007f4a7cf12a2a
0709 13:06:41.545373 (+467211us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:41.545441 (+    68us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:06:41.545500 (+    59us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:41.723783 (+178283us) spinlock_profiling.cc:243] Waited 75.9 ms on lock 0x7b540035d9d4. stack: 00007f4a79de9343 00007f4a79de9240 00007f4a797781d4 00007f4a834b6304 00007f4a834b6299 00007f4a7ce71571 00007f4a7cf08e01 00007f4a7cf0783e 00007f4a81ecc419 00007f4a7b443bd4 00007f4a7b443b62 00007f4a7b443a91 00007f4a7b443a0c 00007f4a7b442cc2 00007f4a7b24348c 00007f4a7b2428c6
0709 13:06:41.723832 (+    49us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:41.723956 (+   124us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":106566,"prepare.queue_time_us":20076,"prepare.run_cpu_time_us":57,"prepare.run_wall_time_us":51036,"raft.queue_time_us":107010,"raft.run_cpu_time_us":128,"raft.run_wall_time_us":6450,"spinlock_wait_cycles":187971200,"thread_start_us":360348,"threads_started":1}
I20260709 13:06:41.704929 24996 leader_election.cc:290] T e381f1d6b8184797ad142de49be225a8 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 14 election: Requested vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:06:41.699924 25039 raft_consensus.cc:697] T a08760e15aac4630a629431f56024dc8 P e5256d91808b47c195bc9b4dbd7f2b87 [term 19 LEADER]: Becoming Leader. State: Replica: e5256d91808b47c195bc9b4dbd7f2b87, State: Running, Role: LEADER
W20260709 13:06:41.714962 24972 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.627s	user 0.020s	sys 0.012s
I20260709 13:06:41.758945 19482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff9b0eddd810459b82d91c60777c10eb" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
W20260709 13:06:41.750397 24972 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.662s	user 0.020s	sys 0.012s
I20260709 13:06:41.780640 19482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e381f1d6b8184797ad142de49be225a8" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:06:41.781334 19482 raft_consensus.cc:3060] T e381f1d6b8184797ad142de49be225a8 P 0473d2b2d01f4459b1e90fd12cc7840e [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:06:41.780655 19449 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.4:43121, user_credentials={real_user=slave}} blocked reactor thread for 222319us
I20260709 13:06:41.782508 19449 leader_election.cc:400] T 9962423cb4e54fcfa5de01daf68a86e7 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 14 election: Vote denied by peer 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121) with higher term. Message: Invalid argument: T 9962423cb4e54fcfa5de01daf68a86e7 P 127766fc592545a4997f7790f50f6076 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 0473d2b2d01f4459b1e90fd12cc7840e for earlier term 14. Current term is 15.
I20260709 13:06:41.782819 19449 leader_election.cc:403] T 9962423cb4e54fcfa5de01daf68a86e7 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 14 election: Cancelling election due to peer responding with higher term
I20260709 13:06:41.780645 24700 raft_consensus.cc:493] T 22196caba61445d3bec98a0aab3c337d P e61c3a8f61bb48f8a963c9480e53c168 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:41.794948 24700 raft_consensus.cc:515] T 22196caba61445d3bec98a0aab3c337d P e61c3a8f61bb48f8a963c9480e53c168 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:41.804797 19526 leader_election.cc:304] T f93ee515a9c14139bf566522ed8232f3 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
W20260709 13:06:41.804402 24990 consensus_meta.cc:287] T 46c5bfeecc314717bffe987e6844b6d0 P 0473d2b2d01f4459b1e90fd12cc7840e: Time spent flushing consensus metadata: real 0.583s	user 0.008s	sys 0.003s
I20260709 13:06:41.834261 19482 raft_consensus.cc:2468] T e381f1d6b8184797ad142de49be225a8 P 0473d2b2d01f4459b1e90fd12cc7840e [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 14.
I20260709 13:06:41.800294 24898 raft_consensus.cc:2749] T 9962423cb4e54fcfa5de01daf68a86e7 P 0473d2b2d01f4459b1e90fd12cc7840e [term 15 FOLLOWER]: Leader election lost for term 14. Reason: Vote denied by peer 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121) with higher term. Message: Invalid argument: T 9962423cb4e54fcfa5de01daf68a86e7 P 127766fc592545a4997f7790f50f6076 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 0473d2b2d01f4459b1e90fd12cc7840e for earlier term 14. Current term is 15.
I20260709 13:06:41.835881 24936 consensus_queue.cc:1059] T edd7d470b5014c9489be7f41f64355c9 P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 }, Status: INVALID_TERM, Last received: 16.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.006s
W20260709 13:06:41.838618 25042 log.cc:927] Time spent T 48824d5acfbc485ebf8c2d944e7202de P 0473d2b2d01f4459b1e90fd12cc7840e: Append to log took a long time: real 0.111s	user 0.000s	sys 0.001s
I20260709 13:06:41.839857 25039 consensus_queue.cc:237] T a08760e15aac4630a629431f56024dc8 P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.10, Last appended by leader: 10, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:41.840737 19484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36f6ba92b9ba46babe4ebd6c02e5fbd9" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:06:41.841452 19484 raft_consensus.cc:2468] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P 0473d2b2d01f4459b1e90fd12cc7840e [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 16.
I20260709 13:06:41.842792 24990 raft_consensus.cc:515] T 46c5bfeecc314717bffe987e6844b6d0 P 0473d2b2d01f4459b1e90fd12cc7840e [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:41.843942 24931 raft_consensus.cc:3055] T edd7d470b5014c9489be7f41f64355c9 P e61c3a8f61bb48f8a963c9480e53c168 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:06:41.844485 24931 raft_consensus.cc:740] T edd7d470b5014c9489be7f41f64355c9 P e61c3a8f61bb48f8a963c9480e53c168 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: e61c3a8f61bb48f8a963c9480e53c168, State: Running, Role: LEADER
W20260709 13:06:41.845237 25043 log.cc:927] Time spent T ece3db938bc649d4a40a51522ed5259c P e61c3a8f61bb48f8a963c9480e53c168: Append to log took a long time: real 0.061s	user 0.000s	sys 0.001s
I20260709 13:06:41.847730 24972 raft_consensus.cc:493] T 1f85fc4b527a48848e5faa083b604e36 P e5256d91808b47c195bc9b4dbd7f2b87 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 127766fc592545a4997f7790f50f6076)
I20260709 13:06:41.848368 24972 raft_consensus.cc:515] T 1f85fc4b527a48848e5faa083b604e36 P e5256d91808b47c195bc9b4dbd7f2b87 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:41.748883 24989 consensus_queue.cc:237] T df751f992649444090e27965eb1af85d P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.11, Last appended by leader: 11, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:41.865924 24982 leader_election.cc:290] T df751f992649444090e27965eb1af85d P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 19 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:06:41.881561 20112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85c494af21f9457a85da47b9bc70c1fd" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:06:41.881970 24824 raft_consensus.cc:515] T df751f992649444090e27965eb1af85d P e5256d91808b47c195bc9b4dbd7f2b87 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:41.883387 19409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a61655d99124a29b486ba4a5b37faea" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
I20260709 13:06:41.887671 19482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e1f505cb0f1427bbd698ac889d80821" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:06:41.813421 24702 raft_consensus.cc:2804] T f93ee515a9c14139bf566522ed8232f3 P e61c3a8f61bb48f8a963c9480e53c168 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:06:41.892827 19484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f85fc4b527a48848e5faa083b604e36" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:06:41.806834 24700 leader_election.cc:290] T 22196caba61445d3bec98a0aab3c337d P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:06:41.895524 19484 raft_consensus.cc:2468] T 1f85fc4b527a48848e5faa083b604e36 P 0473d2b2d01f4459b1e90fd12cc7840e [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 13.
I20260709 13:06:41.896806 20112 raft_consensus.cc:1240] T 70797e5783b5454ab0d0eea663e791e3 P 127766fc592545a4997f7790f50f6076 [term 17 FOLLOWER]: Rejecting Update request from peer e61c3a8f61bb48f8a963c9480e53c168 for earlier term 15. Current term is 17. Ops: [15.12-15.12]
I20260709 13:06:41.812511 25038 leader_election.cc:290] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
W20260709 13:06:41.922281 25040 log.cc:927] Time spent T 179fd671030940b4b4a4e24bcc4aba0a P 0473d2b2d01f4459b1e90fd12cc7840e: Append to log took a long time: real 0.203s	user 0.000s	sys 0.002s
I20260709 13:06:41.894042 24702 raft_consensus.cc:493] T f93ee515a9c14139bf566522ed8232f3 P e61c3a8f61bb48f8a963c9480e53c168 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:41.897944 24972 leader_election.cc:290] T 1f85fc4b527a48848e5faa083b604e36 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
W20260709 13:06:41.906253 24629 consensus_meta.cc:287] T ed7fdbcb96d14d418db9ca90a792588a P 127766fc592545a4997f7790f50f6076: Time spent flushing consensus metadata: real 0.693s	user 0.013s	sys 0.000s
I20260709 13:06:41.867354 24626 leader_election.cc:290] T 309c3ca0ca4b4f3ba129752ea2cb293b P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:06:41.909448 24824 leader_election.cc:290] T df751f992649444090e27965eb1af85d P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 19 election: Requested vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:06:41.882599 24875 raft_consensus.cc:515] T 6c5eebf646ad445a9d1b1adc319d7b16 P 0473d2b2d01f4459b1e90fd12cc7840e [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
W20260709 13:06:41.916023 24837 consensus_meta.cc:287] T ff75a1d4cb1f493db8f71ddc136ba9ab P e61c3a8f61bb48f8a963c9480e53c168: Time spent flushing consensus metadata: real 0.508s	user 0.009s	sys 0.002s
W20260709 13:06:41.916705 25017 log.cc:927] Time spent T 21e14947d70440f19044d8f75c31e1f9 P e61c3a8f61bb48f8a963c9480e53c168: Append to log took a long time: real 1.177s	user 0.011s	sys 0.005s
W20260709 13:06:41.919381 25046 log.cc:927] Time spent T 172b3dd13109415a955b71ac0e9d2234 P 0473d2b2d01f4459b1e90fd12cc7840e: Append to log took a long time: real 0.109s	user 0.000s	sys 0.000s
I20260709 13:06:41.845976 24931 consensus_queue.cc:260] T edd7d470b5014c9489be7f41f64355c9 P e61c3a8f61bb48f8a963c9480e53c168 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.9, Last appended by leader: 9, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
W20260709 13:06:41.897648 24597 consensus_meta.cc:287] T 9962423cb4e54fcfa5de01daf68a86e7 P e5256d91808b47c195bc9b4dbd7f2b87: Time spent flushing consensus metadata: real 0.677s	user 0.006s	sys 0.006s
I20260709 13:06:41.890172 19482 raft_consensus.cc:3060] T 3e1f505cb0f1427bbd698ac889d80821 P 0473d2b2d01f4459b1e90fd12cc7840e [term 16 FOLLOWER]: Advancing to term 18
I20260709 13:06:41.932934 19409 raft_consensus.cc:2468] T 1a61655d99124a29b486ba4a5b37faea P e5256d91808b47c195bc9b4dbd7f2b87 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 13.
W20260709 13:06:41.924430 24926 consensus_meta.cc:287] T 22196caba61445d3bec98a0aab3c337d P 0473d2b2d01f4459b1e90fd12cc7840e: Time spent flushing consensus metadata: real 0.768s	user 0.008s	sys 0.002s
I20260709 13:06:41.933485 24702 raft_consensus.cc:3060] T f93ee515a9c14139bf566522ed8232f3 P e61c3a8f61bb48f8a963c9480e53c168 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:06:41.948870 24931 raft_consensus.cc:3060] T edd7d470b5014c9489be7f41f64355c9 P e61c3a8f61bb48f8a963c9480e53c168 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:06:41.950039 24875 leader_election.cc:290] T 6c5eebf646ad445a9d1b1adc319d7b16 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 16 election: Requested vote from peers e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:06:41.939961 24837 raft_consensus.cc:515] T ff75a1d4cb1f493db8f71ddc136ba9ab P e61c3a8f61bb48f8a963c9480e53c168 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:41.953341 24990 leader_election.cc:290] T 46c5bfeecc314717bffe987e6844b6d0 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 21 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:06:41.953457 24837 leader_election.cc:290] T ff75a1d4cb1f493db8f71ddc136ba9ab P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 16 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
W20260709 13:06:41.972040 20076 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:41.995139 20112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff9b0eddd810459b82d91c60777c10eb" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:06:41.995184 20103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36f6ba92b9ba46babe4ebd6c02e5fbd9" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:06:41.998229 25038 raft_consensus.cc:493] T 775c229504194560ba9589bc2199b089 P e5256d91808b47c195bc9b4dbd7f2b87 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 127766fc592545a4997f7790f50f6076)
I20260709 13:06:41.998989 25038 raft_consensus.cc:515] T 775c229504194560ba9589bc2199b089 P e5256d91808b47c195bc9b4dbd7f2b87 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:41.999943 20110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f85fc4b527a48848e5faa083b604e36" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:06:42.004515 20111 raft_consensus.cc:1240] T 70797e5783b5454ab0d0eea663e791e3 P 127766fc592545a4997f7790f50f6076 [term 17 FOLLOWER]: Rejecting Update request from peer e5256d91808b47c195bc9b4dbd7f2b87 for earlier term 16. Current term is 17. Ops: []
I20260709 13:06:41.944137 24597 raft_consensus.cc:515] T 9962423cb4e54fcfa5de01daf68a86e7 P e5256d91808b47c195bc9b4dbd7f2b87 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:42.010293 19483 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58294 (request call id 2607) took 1044 ms. Trace:
I20260709 13:06:41.944859 24926 raft_consensus.cc:515] T 22196caba61445d3bec98a0aab3c337d P 0473d2b2d01f4459b1e90fd12cc7840e [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:41.988564 24824 raft_consensus.cc:493] T 14935b3ddf914369822e4a0547aaa355 P e5256d91808b47c195bc9b4dbd7f2b87 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 127766fc592545a4997f7790f50f6076)
I20260709 13:06:42.008358 25038 leader_election.cc:290] T 775c229504194560ba9589bc2199b089 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:06:41.995937 24837 raft_consensus.cc:493] T bc225c93219c45538b53a1bd3d387e4d P e61c3a8f61bb48f8a963c9480e53c168 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader e5256d91808b47c195bc9b4dbd7f2b87)
I20260709 13:06:42.019184 24837 raft_consensus.cc:515] T bc225c93219c45538b53a1bd3d387e4d P e61c3a8f61bb48f8a963c9480e53c168 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:42.021790 24837 leader_election.cc:290] T bc225c93219c45538b53a1bd3d387e4d P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:06:42.010768 19483 rpcz_store.cc:276] 0709 13:06:40.966133 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:40.966248 (+   115us) service_pool.cc:224] Handling call
0709 13:06:40.977749 (+ 11501us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:06:40.978105 (+   356us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:40.978138 (+    33us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:06:41.005855 (+ 27717us) log.cc:844] Serialized 52 byte log entry
0709 13:06:41.268605 (+262750us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:06:41.268660 (+    55us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:41.268764 (+   104us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:41.921734 (+652970us) spinlock_profiling.cc:243] Waited 3.24 ms on lock 0x7b4400022b4c. stack: 00007f4a79de9343 00007f4a79de9240 00007f4a797781d4 00007f4a834b6304 00007f4a834b6299 00007f4a79ca3db1 00007f4a79d41c85 00007f4a79d426a2 00007f4a7cab41db 00007f4a7caafaaf 00007f4a7caa386e 00007f4a7caa2bb6 00007f4a7caa27d8 00007f4a7caac221 00007f4a7caac1d9 00007f4a7caac169
0709 13:06:42.003765 (+ 82031us) raft_consensus.cc:1685] finished
0709 13:06:42.003797 (+    32us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:42.010200 (+  6403us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":829,"raft.run_cpu_time_us":152,"raft.run_wall_time_us":25229,"spinlock_wait_cycles":7444352,"thread_start_us":209551,"threads_started":1,"wal-append.queue_time_us":587953}
I20260709 13:06:42.017489 19411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9962423cb4e54fcfa5de01daf68a86e7" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
I20260709 13:06:42.006249 25052 raft_consensus.cc:493] T 7be9efa6559648dbb5a0f7684c4542d1 P e61c3a8f61bb48f8a963c9480e53c168 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:06:42.034116 19375 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.3:36891, user_credentials={real_user=slave}} blocked reactor thread for 603095us
I20260709 13:06:42.034173 19408 raft_consensus.cc:2368] T 9962423cb4e54fcfa5de01daf68a86e7 P e5256d91808b47c195bc9b4dbd7f2b87 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 0473d2b2d01f4459b1e90fd12cc7840e for earlier term 14. Current term is 15.
I20260709 13:06:42.037240 19555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86a6797bdfe94fa496c050ceae4bd0d9" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:06:42.038249 19555 raft_consensus.cc:2393] T 86a6797bdfe94fa496c050ceae4bd0d9 P e61c3a8f61bb48f8a963c9480e53c168 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate e5256d91808b47c195bc9b4dbd7f2b87 in current term 12: Already voted for candidate 0473d2b2d01f4459b1e90fd12cc7840e in this term.
I20260709 13:06:42.039014 19554 raft_consensus.cc:1240] T ff75a1d4cb1f493db8f71ddc136ba9ab P e61c3a8f61bb48f8a963c9480e53c168 [term 16 FOLLOWER]: Rejecting Update request from peer e5256d91808b47c195bc9b4dbd7f2b87 for earlier term 15. Current term is 16. Ops: []
I20260709 13:06:42.043771 19554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7be9efa6559648dbb5a0f7684c4542d1" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:06:42.044552 19482 raft_consensus.cc:2468] T 3e1f505cb0f1427bbd698ac889d80821 P 0473d2b2d01f4459b1e90fd12cc7840e [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 18.
I20260709 13:06:42.050103 19556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "217b5fae677b4971b3bbd2f357a1f7ff" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:06:42.048112 19555 raft_consensus.cc:1240] T 1dc5b3532fe54f74876d02beffa2c230 P e61c3a8f61bb48f8a963c9480e53c168 [term 17 FOLLOWER]: Rejecting Update request from peer e5256d91808b47c195bc9b4dbd7f2b87 for earlier term 16. Current term is 17. Ops: []
I20260709 13:06:42.052774 19552 raft_consensus.cc:1275] T 40e1e16737a842ee936002830f36882e P e61c3a8f61bb48f8a963c9480e53c168 [term 17 FOLLOWER]: Refusing update from remote peer e5256d91808b47c195bc9b4dbd7f2b87: Log matching property violated. Preceding OpId in replica: term: 15 index: 8. Preceding OpId from leader: term: 17 index: 9. (index mismatch)
I20260709 13:06:42.053711 19557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28af091831594f9d8e96482078cc7625" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:06:42.037472 24971 raft_consensus.cc:2804] T 96efeaaf1057492490e9a621f37e1a2d P 0473d2b2d01f4459b1e90fd12cc7840e [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:06:42.063896 19411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70797e5783b5454ab0d0eea663e791e3" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 17 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
I20260709 13:06:42.064452 19555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ece3db938bc649d4a40a51522ed5259c" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:06:42.066869 19557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76cb037fc9064d13b59a8969d897ce8c" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:06:42.068886 19560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22196caba61445d3bec98a0aab3c337d" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:06:42.069437 19560 raft_consensus.cc:2468] T 22196caba61445d3bec98a0aab3c337d P e61c3a8f61bb48f8a963c9480e53c168 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 14.
I20260709 13:06:42.071833 19557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b74109013a140ada21feeef92d6f563" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:06:42.073417 19555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f93ee515a9c14139bf566522ed8232f3" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 18 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:06:42.076432 19411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "309c3ca0ca4b4f3ba129752ea2cb293b" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:06:42.077175 19411 raft_consensus.cc:2468] T 309c3ca0ca4b4f3ba129752ea2cb293b P e5256d91808b47c195bc9b4dbd7f2b87 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 127766fc592545a4997f7790f50f6076 in term 10.
I20260709 13:06:42.028762 24824 raft_consensus.cc:515] T 14935b3ddf914369822e4a0547aaa355 P e5256d91808b47c195bc9b4dbd7f2b87 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } attrs { replace: true } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:42.086959 19558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab43d85f64114d4ebf618930e43d9ed0" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:06:42.087332 19557 raft_consensus.cc:3055] T 70797e5783b5454ab0d0eea663e791e3 P e61c3a8f61bb48f8a963c9480e53c168 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:06:42.087817 19557 raft_consensus.cc:740] T 70797e5783b5454ab0d0eea663e791e3 P e61c3a8f61bb48f8a963c9480e53c168 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: e61c3a8f61bb48f8a963c9480e53c168, State: Running, Role: LEADER
I20260709 13:06:42.090360 19552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e1f505cb0f1427bbd698ac889d80821" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:06:42.091082 19552 raft_consensus.cc:3060] T 3e1f505cb0f1427bbd698ac889d80821 P e61c3a8f61bb48f8a963c9480e53c168 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:06:42.090967 19553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e381f1d6b8184797ad142de49be225a8" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:06:42.091984 19553 raft_consensus.cc:3060] T e381f1d6b8184797ad142de49be225a8 P e61c3a8f61bb48f8a963c9480e53c168 [term 12 FOLLOWER]: Advancing to term 14
I20260709 13:06:42.093554 19560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa731b585f684a7fb2d106c50f143b83" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:06:42.096503 19450 leader_election.cc:304] T 309c3ca0ca4b4f3ba129752ea2cb293b P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:06:42.097558 19450 leader_election.cc:304] T f93ee515a9c14139bf566522ed8232f3 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:06:42.037686 25052 raft_consensus.cc:515] T 7be9efa6559648dbb5a0f7684c4542d1 P e61c3a8f61bb48f8a963c9480e53c168 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } attrs { replace: true } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
W20260709 13:06:42.099231 19523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.1:40321, user_credentials={real_user=slave}} blocked reactor thread for 229017us
I20260709 13:06:42.090339 19557 consensus_queue.cc:260] T 70797e5783b5454ab0d0eea663e791e3 P e61c3a8f61bb48f8a963c9480e53c168 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.12, Last appended by leader: 12, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:42.103080 20103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "775c229504194560ba9589bc2199b089" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:06:42.103274 19557 raft_consensus.cc:3060] T 70797e5783b5454ab0d0eea663e791e3 P e61c3a8f61bb48f8a963c9480e53c168 [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:06:42.103412 19523 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:42.119411 19553 raft_consensus.cc:2468] T e381f1d6b8184797ad142de49be225a8 P e61c3a8f61bb48f8a963c9480e53c168 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 14.
I20260709 13:06:42.111764 19552 raft_consensus.cc:2468] T 3e1f505cb0f1427bbd698ac889d80821 P e61c3a8f61bb48f8a963c9480e53c168 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 18.
I20260709 13:06:42.124858 24852 raft_consensus.cc:493] T 65d8cb8d6ec64f459d5a47cefab10acf P 127766fc592545a4997f7790f50f6076 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:42.125476 24852 raft_consensus.cc:515] T 65d8cb8d6ec64f459d5a47cefab10acf P 127766fc592545a4997f7790f50f6076 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:42.127624 24852 leader_election.cc:290] T 65d8cb8d6ec64f459d5a47cefab10acf P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:06:42.128600 24597 leader_election.cc:290] T 9962423cb4e54fcfa5de01daf68a86e7 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 15 election: Requested vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
W20260709 13:06:42.135919 25060 log.cc:927] Time spent T 86a6797bdfe94fa496c050ceae4bd0d9 P 0473d2b2d01f4459b1e90fd12cc7840e: Append to log took a long time: real 0.066s	user 0.000s	sys 0.000s
I20260709 13:06:42.137234 24812 raft_consensus.cc:493] T 4af19371ea874c09a0a2147040835cbb P e61c3a8f61bb48f8a963c9480e53c168 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 127766fc592545a4997f7790f50f6076)
I20260709 13:06:42.137863 24812 raft_consensus.cc:515] T 4af19371ea874c09a0a2147040835cbb P e61c3a8f61bb48f8a963c9480e53c168 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:42.140027 24812 leader_election.cc:290] T 4af19371ea874c09a0a2147040835cbb P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:06:42.140084 20075 leader_election.cc:304] T 70797e5783b5454ab0d0eea663e791e3 P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 127766fc592545a4997f7790f50f6076; no voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:06:42.143298 24946 raft_consensus.cc:2749] T 70797e5783b5454ab0d0eea663e791e3 P 127766fc592545a4997f7790f50f6076 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:06:42.144333 20075 leader_election.cc:304] T 309c3ca0ca4b4f3ba129752ea2cb293b P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 127766fc592545a4997f7790f50f6076, e5256d91808b47c195bc9b4dbd7f2b87; no voters: 
I20260709 13:06:42.144384 24700 raft_consensus.cc:493] T 62c6c134d3d24a1ab144dd9ee6bc3f64 P e61c3a8f61bb48f8a963c9480e53c168 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 0473d2b2d01f4459b1e90fd12cc7840e)
I20260709 13:06:42.144927 24824 leader_election.cc:290] T 14935b3ddf914369822e4a0547aaa355 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:06:42.144987 24700 raft_consensus.cc:515] T 62c6c134d3d24a1ab144dd9ee6bc3f64 P e61c3a8f61bb48f8a963c9480e53c168 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:42.146872 24936 raft_consensus.cc:493] T 4509b76741dc428e9201c70c1658da13 P e61c3a8f61bb48f8a963c9480e53c168 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader e5256d91808b47c195bc9b4dbd7f2b87)
I20260709 13:06:42.147454 24936 raft_consensus.cc:515] T 4509b76741dc428e9201c70c1658da13 P e61c3a8f61bb48f8a963c9480e53c168 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:42.150100 19554 raft_consensus.cc:3060] T 7be9efa6559648dbb5a0f7684c4542d1 P e61c3a8f61bb48f8a963c9480e53c168 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:06:42.101717 25062 raft_consensus.cc:2804] T 309c3ca0ca4b4f3ba129752ea2cb293b P 0473d2b2d01f4459b1e90fd12cc7840e [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:06:42.101902 25063 raft_consensus.cc:2804] T f93ee515a9c14139bf566522ed8232f3 P 0473d2b2d01f4459b1e90fd12cc7840e [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:06:42.159330 19560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff75a1d4cb1f493db8f71ddc136ba9ab" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:06:42.160081 19560 raft_consensus.cc:2393] T ff75a1d4cb1f493db8f71ddc136ba9ab P e61c3a8f61bb48f8a963c9480e53c168 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0473d2b2d01f4459b1e90fd12cc7840e in current term 16: Already voted for candidate e61c3a8f61bb48f8a963c9480e53c168 in this term.
I20260709 13:06:42.157029 19404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65d8cb8d6ec64f459d5a47cefab10acf" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 18 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:06:42.157608 20104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14935b3ddf914369822e4a0547aaa355" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:06:42.160646 19404 raft_consensus.cc:2468] T 65d8cb8d6ec64f459d5a47cefab10acf P e5256d91808b47c195bc9b4dbd7f2b87 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 127766fc592545a4997f7790f50f6076 in term 17.
I20260709 13:06:42.103660 24837 raft_consensus.cc:493] T 833a2f0775ed407a94b8924ce50adb63 P e61c3a8f61bb48f8a963c9480e53c168 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 127766fc592545a4997f7790f50f6076)
I20260709 13:06:42.162365 20075 leader_election.cc:304] T 65d8cb8d6ec64f459d5a47cefab10acf P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 127766fc592545a4997f7790f50f6076, e5256d91808b47c195bc9b4dbd7f2b87; no voters: 
I20260709 13:06:42.164279 20103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9962423cb4e54fcfa5de01daf68a86e7" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076"
I20260709 13:06:42.164893 20103 raft_consensus.cc:2393] T 9962423cb4e54fcfa5de01daf68a86e7 P 127766fc592545a4997f7790f50f6076 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate e5256d91808b47c195bc9b4dbd7f2b87 in current term 15: Already voted for candidate 127766fc592545a4997f7790f50f6076 in this term.
I20260709 13:06:42.169875 19482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22196caba61445d3bec98a0aab3c337d" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:06:42.170783 19482 raft_consensus.cc:2468] T 22196caba61445d3bec98a0aab3c337d P 0473d2b2d01f4459b1e90fd12cc7840e [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 14.
I20260709 13:06:42.179612 19449 leader_election.cc:304] T 179fd671030940b4b4a4e24bcc4aba0a P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e; no voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:06:42.180771 19409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22196caba61445d3bec98a0aab3c337d" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
I20260709 13:06:42.181445 19409 raft_consensus.cc:2393] T 22196caba61445d3bec98a0aab3c337d P e5256d91808b47c195bc9b4dbd7f2b87 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 0473d2b2d01f4459b1e90fd12cc7840e in current term 14: Already voted for candidate e5256d91808b47c195bc9b4dbd7f2b87 in this term.
I20260709 13:06:42.182174 19411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46c5bfeecc314717bffe987e6844b6d0" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 21 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
I20260709 13:06:42.163214 24837 raft_consensus.cc:515] T 833a2f0775ed407a94b8924ce50adb63 P e61c3a8f61bb48f8a963c9480e53c168 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:42.187984 19404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df751f992649444090e27965eb1af85d" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
I20260709 13:06:42.191273 19554 raft_consensus.cc:2468] T 7be9efa6559648dbb5a0f7684c4542d1 P e61c3a8f61bb48f8a963c9480e53c168 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 15.
I20260709 13:06:42.195302 19477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df751f992649444090e27965eb1af85d" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:06:42.203027 19477 raft_consensus.cc:2393] T df751f992649444090e27965eb1af85d P 0473d2b2d01f4459b1e90fd12cc7840e [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate e5256d91808b47c195bc9b4dbd7f2b87 in current term 19: Already voted for candidate 0473d2b2d01f4459b1e90fd12cc7840e in this term.
I20260709 13:06:42.196405 19481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14935b3ddf914369822e4a0547aaa355" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:06:42.196666 19478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9962423cb4e54fcfa5de01daf68a86e7" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:06:42.197121 19449 leader_election.cc:304] T a08760e15aac4630a629431f56024dc8 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e; no voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:06:42.206296 19485 raft_consensus.cc:1240] T 6c5eebf646ad445a9d1b1adc319d7b16 P 0473d2b2d01f4459b1e90fd12cc7840e [term 16 FOLLOWER]: Rejecting Update request from peer e61c3a8f61bb48f8a963c9480e53c168 for earlier term 15. Current term is 16. Ops: []
I20260709 13:06:42.188511 24852 raft_consensus.cc:2804] T 65d8cb8d6ec64f459d5a47cefab10acf P 127766fc592545a4997f7790f50f6076 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:06:42.204418 19478 raft_consensus.cc:2393] T 9962423cb4e54fcfa5de01daf68a86e7 P 0473d2b2d01f4459b1e90fd12cc7840e [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate e5256d91808b47c195bc9b4dbd7f2b87 in current term 15: Already voted for candidate 127766fc592545a4997f7790f50f6076 in this term.
I20260709 13:06:42.158769 24946 raft_consensus.cc:2804] T 309c3ca0ca4b4f3ba129752ea2cb293b P 127766fc592545a4997f7790f50f6076 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:06:42.205413 19560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1b10566f45d4a7d9029858330e02d5b" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:06:42.208273 19404 raft_consensus.cc:2393] T df751f992649444090e27965eb1af85d P e5256d91808b47c195bc9b4dbd7f2b87 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 0473d2b2d01f4459b1e90fd12cc7840e in current term 19: Already voted for candidate e5256d91808b47c195bc9b4dbd7f2b87 in this term.
I20260709 13:06:42.208942 19486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40e1e16737a842ee936002830f36882e" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 18 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:06:42.211056 19377 leader_election.cc:304] T 7be9efa6559648dbb5a0f7684c4542d1 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, 127766fc592545a4997f7790f50f6076, e5256d91808b47c195bc9b4dbd7f2b87; no voters: 
I20260709 13:06:42.218106 19483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "775c229504194560ba9589bc2199b089" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:06:42.165730 25063 raft_consensus.cc:493] T f93ee515a9c14139bf566522ed8232f3 P 0473d2b2d01f4459b1e90fd12cc7840e [term 16 FOLLOWER]: Starting leader election (detected failure of leader e61c3a8f61bb48f8a963c9480e53c168)
I20260709 13:06:42.204728 25057 raft_consensus.cc:2749] T 179fd671030940b4b4a4e24bcc4aba0a P 0473d2b2d01f4459b1e90fd12cc7840e [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:06:42.221179 24926 leader_election.cc:290] T 22196caba61445d3bec98a0aab3c337d P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 14 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:06:42.217967 24898 raft_consensus.cc:2749] T a08760e15aac4630a629431f56024dc8 P 0473d2b2d01f4459b1e90fd12cc7840e [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:06:42.218739 24946 raft_consensus.cc:493] T 309c3ca0ca4b4f3ba129752ea2cb293b P 127766fc592545a4997f7790f50f6076 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:42.227475 24946 raft_consensus.cc:3060] T 309c3ca0ca4b4f3ba129752ea2cb293b P 127766fc592545a4997f7790f50f6076 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:06:42.229718 25070 log.cc:927] Time spent T a08760e15aac4630a629431f56024dc8 P e5256d91808b47c195bc9b4dbd7f2b87: Append to log took a long time: real 0.071s	user 0.000s	sys 0.000s
I20260709 13:06:42.186892 24812 raft_consensus.cc:493] T 86a6797bdfe94fa496c050ceae4bd0d9 P e61c3a8f61bb48f8a963c9480e53c168 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:42.231484 19560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df751f992649444090e27965eb1af85d" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:06:42.232973 19560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a61655d99124a29b486ba4a5b37faea" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:06:42.233777 19560 raft_consensus.cc:2393] T 1a61655d99124a29b486ba4a5b37faea P e61c3a8f61bb48f8a963c9480e53c168 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 0473d2b2d01f4459b1e90fd12cc7840e in current term 13: Already voted for candidate e61c3a8f61bb48f8a963c9480e53c168 in this term.
I20260709 13:06:42.234606 19560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c5eebf646ad445a9d1b1adc319d7b16" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:06:42.236539 25052 leader_election.cc:290] T 7be9efa6559648dbb5a0f7684c4542d1 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:06:42.236984 19560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c5eebf646ad445a9d1b1adc319d7b16" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:06:42.211403 19449 leader_election.cc:304] T 7f575b143b844aa096b50997dad3516a P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e; no voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:06:42.165592 25062 raft_consensus.cc:493] T 309c3ca0ca4b4f3ba129752ea2cb293b P 0473d2b2d01f4459b1e90fd12cc7840e [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:42.231321 24812 raft_consensus.cc:515] T 86a6797bdfe94fa496c050ceae4bd0d9 P e61c3a8f61bb48f8a963c9480e53c168 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:42.217204 19377 leader_election.cc:304] T 2b74109013a140ada21feeef92d6f563 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87; no voters: 
I20260709 13:06:42.245468 19449 leader_election.cc:304] T edd7d470b5014c9489be7f41f64355c9 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e; no voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:06:42.246295 20109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4af19371ea874c09a0a2147040835cbb" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:06:42.249470 19449 leader_election.cc:304] T 2725d2c4cb054f18b0fc8f735c15f6c2 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e; no voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:06:42.249105 19377 leader_election.cc:304] T ab43d85f64114d4ebf618930e43d9ed0 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, 127766fc592545a4997f7790f50f6076
I20260709 13:06:42.252678 20104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7be9efa6559648dbb5a0f7684c4542d1" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:06:42.252902 19377 leader_election.cc:304] T ff9b0eddd810459b82d91c60777c10eb P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, 127766fc592545a4997f7790f50f6076
I20260709 13:06:42.237394 25067 raft_consensus.cc:2804] T 7be9efa6559648dbb5a0f7684c4542d1 P e5256d91808b47c195bc9b4dbd7f2b87 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:06:42.211958 24852 raft_consensus.cc:493] T 65d8cb8d6ec64f459d5a47cefab10acf P 127766fc592545a4997f7790f50f6076 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:42.191102 24597 consensus_queue.cc:1059] T 70797e5783b5454ab0d0eea663e791e3 P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.059s
I20260709 13:06:42.253809 20104 raft_consensus.cc:2393] T 7be9efa6559648dbb5a0f7684c4542d1 P 127766fc592545a4997f7790f50f6076 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e61c3a8f61bb48f8a963c9480e53c168 in current term 15: Already voted for candidate e5256d91808b47c195bc9b4dbd7f2b87 in this term.
I20260709 13:06:42.271976 19377 leader_election.cc:304] T e381f1d6b8184797ad142de49be225a8 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87; no voters: 
I20260709 13:06:42.257121 19449 leader_election.cc:304] T 2b74109013a140ada21feeef92d6f563 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e; no voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:06:42.273836 19560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46c5bfeecc314717bffe987e6844b6d0" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 21 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:06:42.279434 19450 leader_election.cc:304] T f1b10566f45d4a7d9029858330e02d5b P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e; no voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:06:42.271476 24700 leader_election.cc:290] T 62c6c134d3d24a1ab144dd9ee6bc3f64 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:06:42.279798 19377 leader_election.cc:304] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87; no voters: 127766fc592545a4997f7790f50f6076
I20260709 13:06:42.279810 19560 raft_consensus.cc:2393] T 46c5bfeecc314717bffe987e6844b6d0 P e61c3a8f61bb48f8a963c9480e53c168 [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate 0473d2b2d01f4459b1e90fd12cc7840e in current term 21: Already voted for candidate e61c3a8f61bb48f8a963c9480e53c168 in this term.
I20260709 13:06:42.280278 24852 raft_consensus.cc:3060] T 65d8cb8d6ec64f459d5a47cefab10acf P 127766fc592545a4997f7790f50f6076 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:06:42.280419 25018 raft_consensus.cc:2749] T 2b74109013a140ada21feeef92d6f563 P 0473d2b2d01f4459b1e90fd12cc7840e [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:06:42.242023 25039 raft_consensus.cc:493] T ef32ce6fdd0e40d382c79974f30295c6 P e5256d91808b47c195bc9b4dbd7f2b87 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 0473d2b2d01f4459b1e90fd12cc7840e)
I20260709 13:06:42.242877 24626 raft_consensus.cc:493] T 14efcc79969f41babe5529c22d59156d P 127766fc592545a4997f7790f50f6076 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader e5256d91808b47c195bc9b4dbd7f2b87)
I20260709 13:06:42.283895 25052 raft_consensus.cc:493] T 0afb57ae58a24a01850491d69f0213dd P e61c3a8f61bb48f8a963c9480e53c168 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 0473d2b2d01f4459b1e90fd12cc7840e)
I20260709 13:06:42.249954 24926 raft_consensus.cc:2749] T edd7d470b5014c9489be7f41f64355c9 P 0473d2b2d01f4459b1e90fd12cc7840e [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:06:42.272718 24982 raft_consensus.cc:2749] T 2725d2c4cb054f18b0fc8f735c15f6c2 P 0473d2b2d01f4459b1e90fd12cc7840e [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:06:42.281073 25050 raft_consensus.cc:493] T 1dc5b3532fe54f74876d02beffa2c230 P e61c3a8f61bb48f8a963c9480e53c168 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:42.286819 24983 raft_consensus.cc:2749] T f1b10566f45d4a7d9029858330e02d5b P 0473d2b2d01f4459b1e90fd12cc7840e [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:06:42.341652 19449 leader_election.cc:304] T 21e14947d70440f19044d8f75c31e1f9 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e; no voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:06:42.289304 24866 leader_election.cc:290] T 2a16f7501e2444fb86d4e2778e734e02 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 16 election: Requested vote from peers e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:06:42.248219 24936 leader_election.cc:290] T 4509b76741dc428e9201c70c1658da13 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:06:42.291962 19554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22196caba61445d3bec98a0aab3c337d" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
W20260709 13:06:42.293905 25072 log.cc:927] Time spent T 00000000000000000000000000000000 P 97750b77d35444acb7791ebf26cc2685: Append to log took a long time: real 0.071s	user 0.000s	sys 0.000s
I20260709 13:06:42.303610 24702 raft_consensus.cc:515] T f93ee515a9c14139bf566522ed8232f3 P e61c3a8f61bb48f8a963c9480e53c168 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:42.250020 25038 raft_consensus.cc:2804] T 2b74109013a140ada21feeef92d6f563 P e5256d91808b47c195bc9b4dbd7f2b87 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:06:42.247753 25062 raft_consensus.cc:3060] T 309c3ca0ca4b4f3ba129752ea2cb293b P 0473d2b2d01f4459b1e90fd12cc7840e [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:06:42.269582 24972 raft_consensus.cc:2749] T ff9b0eddd810459b82d91c60777c10eb P e5256d91808b47c195bc9b4dbd7f2b87 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:06:42.353121 24943 leader_election.cc:290] T 1a61655d99124a29b486ba4a5b37faea P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 13 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:06:42.353766 25038 raft_consensus.cc:493] T 2b74109013a140ada21feeef92d6f563 P e5256d91808b47c195bc9b4dbd7f2b87 [term 12 FOLLOWER]: Starting leader election (detected failure of leader e61c3a8f61bb48f8a963c9480e53c168)
I20260709 13:06:42.354167 25038 raft_consensus.cc:3060] T 2b74109013a140ada21feeef92d6f563 P e5256d91808b47c195bc9b4dbd7f2b87 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:06:42.278597 19411 raft_consensus.cc:2468] T 46c5bfeecc314717bffe987e6844b6d0 P e5256d91808b47c195bc9b4dbd7f2b87 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 21.
I20260709 13:06:42.243091 25063 raft_consensus.cc:3060] T f93ee515a9c14139bf566522ed8232f3 P 0473d2b2d01f4459b1e90fd12cc7840e [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:06:42.306517 20111 raft_consensus.cc:1275] T 6c5eebf646ad445a9d1b1adc319d7b16 P 127766fc592545a4997f7790f50f6076 [term 15 FOLLOWER]: Refusing update from remote peer e61c3a8f61bb48f8a963c9480e53c168: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
W20260709 13:06:42.283329 19480 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58286 (request call id 2373) took 1853 ms (client timeout 1559 ms). Trace:
W20260709 13:06:42.358603 19480 rpcz_store.cc:269] 0709 13:06:40.429502 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:40.430749 (+  1247us) service_pool.cc:224] Handling call
0709 13:06:42.283125 (+1852376us) spinlock_profiling.cc:243] Waited 809 ms on lock 0x7b5400223154. stack: 00007f4a79de9343 00007f4a79de9240 00007f4a797781d4 00007f4a834b6304 00007f4a834b6299 00007f4a7ce71571 00007f4a7cf0c2fa 00007f4a81ecdb17 00007f4a7b4486d4 00007f4a7b448662 00007f4a7b448591 00007f4a7b44850c 00007f4a7b4477c2 00007f4a7b24348c 00007f4a7b2428c6 00007f4a7b24226f
0709 13:06:42.283259 (+   134us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1859968384}
I20260709 13:06:42.347687 25052 raft_consensus.cc:515] T 0afb57ae58a24a01850491d69f0213dd P e61c3a8f61bb48f8a963c9480e53c168 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:42.360915 25052 leader_election.cc:290] T 0afb57ae58a24a01850491d69f0213dd P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:06:42.269215 25057 consensus_queue.cc:1048] T 0cdf56e38bbc453d9438d359e5a69955 P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.089s
W20260709 13:06:42.284731 25054 log.cc:927] Time spent T 172b3dd13109415a955b71ac0e9d2234 P e5256d91808b47c195bc9b4dbd7f2b87: Append to log took a long time: real 0.272s	user 0.000s	sys 0.001s
I20260709 13:06:42.365425 19554 raft_consensus.cc:2468] T 22196caba61445d3bec98a0aab3c337d P e61c3a8f61bb48f8a963c9480e53c168 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 14.
I20260709 13:06:42.365509 19402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40e1e16737a842ee936002830f36882e" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 18 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:06:42.365765 19407 raft_consensus.cc:1275] T 65d8cb8d6ec64f459d5a47cefab10acf P e5256d91808b47c195bc9b4dbd7f2b87 [term 17 FOLLOWER]: Refusing update from remote peer e61c3a8f61bb48f8a963c9480e53c168: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 13:06:42.272640 24825 raft_consensus.cc:3060] T ab43d85f64114d4ebf618930e43d9ed0 P e5256d91808b47c195bc9b4dbd7f2b87 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:06:42.307157 24824 raft_consensus.cc:2804] T e381f1d6b8184797ad142de49be225a8 P e5256d91808b47c195bc9b4dbd7f2b87 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:06:42.391073 24824 raft_consensus.cc:697] T e381f1d6b8184797ad142de49be225a8 P e5256d91808b47c195bc9b4dbd7f2b87 [term 14 LEADER]: Becoming Leader. State: Replica: e5256d91808b47c195bc9b4dbd7f2b87, State: Running, Role: LEADER
I20260709 13:06:42.392032 24824 consensus_queue.cc:237] T e381f1d6b8184797ad142de49be225a8 P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:42.395300 24971 raft_consensus.cc:493] T 96efeaaf1057492490e9a621f37e1a2d P 0473d2b2d01f4459b1e90fd12cc7840e [term 17 FOLLOWER]: Starting leader election (detected failure of leader e61c3a8f61bb48f8a963c9480e53c168)
I20260709 13:06:42.395787 24971 raft_consensus.cc:3060] T 96efeaaf1057492490e9a621f37e1a2d P 0473d2b2d01f4459b1e90fd12cc7840e [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:06:42.397711 25061 raft_consensus.cc:3055] T 70797e5783b5454ab0d0eea663e791e3 P e5256d91808b47c195bc9b4dbd7f2b87 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:06:42.398097 25061 raft_consensus.cc:740] T 70797e5783b5454ab0d0eea663e791e3 P e5256d91808b47c195bc9b4dbd7f2b87 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: e5256d91808b47c195bc9b4dbd7f2b87, State: Running, Role: LEADER
I20260709 13:06:42.335511 25039 raft_consensus.cc:515] T ef32ce6fdd0e40d382c79974f30295c6 P e5256d91808b47c195bc9b4dbd7f2b87 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:42.398864 25061 consensus_queue.cc:260] T 70797e5783b5454ab0d0eea663e791e3 P e5256d91808b47c195bc9b4dbd7f2b87 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.12, Last appended by leader: 12, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:42.400012 25061 raft_consensus.cc:3060] T 70797e5783b5454ab0d0eea663e791e3 P e5256d91808b47c195bc9b4dbd7f2b87 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:06:42.400939 25039 leader_election.cc:290] T ef32ce6fdd0e40d382c79974f30295c6 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:06:42.402956 19558 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e381f1d6b8184797ad142de49be225a8"
dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
mode: GRACEFUL
new_leader_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
 from {username='slave'} at 127.0.0.1:39264
I20260709 13:06:42.403590 19558 raft_consensus.cc:606] T e381f1d6b8184797ad142de49be225a8 P e61c3a8f61bb48f8a963c9480e53c168 [term 14 FOLLOWER]: Received request to transfer leadership to TS 0473d2b2d01f4459b1e90fd12cc7840e
I20260709 13:06:42.403934 19558 raft_consensus.cc:614] T e381f1d6b8184797ad142de49be225a8 P e61c3a8f61bb48f8a963c9480e53c168 [term 14 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:06:42.405360 19558 raft_consensus.cc:1275] T 48824d5acfbc485ebf8c2d944e7202de P e61c3a8f61bb48f8a963c9480e53c168 [term 18 FOLLOWER]: Refusing update from remote peer 0473d2b2d01f4459b1e90fd12cc7840e: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 18 index: 13. (index mismatch)
I20260709 13:06:42.366214 24946 raft_consensus.cc:515] T 309c3ca0ca4b4f3ba129752ea2cb293b P 127766fc592545a4997f7790f50f6076 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:42.412353 24946 leader_election.cc:290] T 309c3ca0ca4b4f3ba129752ea2cb293b P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 11 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:06:42.422502 19526 leader_election.cc:304] T ef32ce6fdd0e40d382c79974f30295c6 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:06:42.423599 24888 raft_consensus.cc:2804] T ef32ce6fdd0e40d382c79974f30295c6 P e61c3a8f61bb48f8a963c9480e53c168 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:06:42.424114 24888 raft_consensus.cc:697] T ef32ce6fdd0e40d382c79974f30295c6 P e61c3a8f61bb48f8a963c9480e53c168 [term 19 LEADER]: Becoming Leader. State: Replica: e61c3a8f61bb48f8a963c9480e53c168, State: Running, Role: LEADER
I20260709 13:06:42.424996 24888 consensus_queue.cc:237] T ef32ce6fdd0e40d382c79974f30295c6 P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 18.10, Last appended by leader: 10, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:42.430567 25062 raft_consensus.cc:515] T 309c3ca0ca4b4f3ba129752ea2cb293b P 0473d2b2d01f4459b1e90fd12cc7840e [term 11 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } attrs { replace: true } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:42.433218 25062 leader_election.cc:290] T 309c3ca0ca4b4f3ba129752ea2cb293b P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 11 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:06:42.338750 19557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab43d85f64114d4ebf618930e43d9ed0" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 18 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:06:42.348058 19560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65d8cb8d6ec64f459d5a47cefab10acf" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 18 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:06:42.349412 19409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff75a1d4cb1f493db8f71ddc136ba9ab" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:06:42.351122 24790 raft_consensus.cc:3060] T 70797e5783b5454ab0d0eea663e791e3 P e61c3a8f61bb48f8a963c9480e53c168 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:06:42.351363 19404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e36a9d6e29c4a7c860cf267efbd4c74" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:06:42.354071 19408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f93ee515a9c14139bf566522ed8232f3" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 18 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
W20260709 13:06:42.328298 19377 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.2:46257, user_credentials={real_user=slave}} blocked reactor thread for 48564.1us
I20260709 13:06:42.247886 24898 raft_consensus.cc:2749] T 7f575b143b844aa096b50997dad3516a P 0473d2b2d01f4459b1e90fd12cc7840e [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:06:42.338632 24964 raft_consensus.cc:2804] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P e5256d91808b47c195bc9b4dbd7f2b87 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:06:42.467767 19555 raft_consensus.cc:2393] T f93ee515a9c14139bf566522ed8232f3 P e61c3a8f61bb48f8a963c9480e53c168 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e5256d91808b47c195bc9b4dbd7f2b87 in current term 18: Already voted for candidate e61c3a8f61bb48f8a963c9480e53c168 in this term.
I20260709 13:06:42.366739 19554 raft_consensus.cc:1275] T 1efebf73c86e432baa55533136b6e12c P e61c3a8f61bb48f8a963c9480e53c168 [term 14 FOLLOWER]: Refusing update from remote peer 0473d2b2d01f4459b1e90fd12cc7840e: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 13:06:42.344044 25050 raft_consensus.cc:515] T 1dc5b3532fe54f74876d02beffa2c230 P e61c3a8f61bb48f8a963c9480e53c168 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:42.346257 25018 raft_consensus.cc:2749] T 21e14947d70440f19044d8f75c31e1f9 P 0473d2b2d01f4459b1e90fd12cc7840e [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:06:42.367964 25052 raft_consensus.cc:493] T 217b5fae677b4971b3bbd2f357a1f7ff P e61c3a8f61bb48f8a963c9480e53c168 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 0473d2b2d01f4459b1e90fd12cc7840e)
I20260709 13:06:42.365810 24837 leader_election.cc:290] T 833a2f0775ed407a94b8924ce50adb63 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:06:42.371292 19523 leader_election.cc:304] T b08304a0a02b42d7840c4e8ee9a6bd1a P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e61c3a8f61bb48f8a963c9480e53c168; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87
W20260709 13:06:42.469447 19523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.1:40321, user_credentials={real_user=slave}} blocked reactor thread for 98233us
I20260709 13:06:42.371788 19449 leader_election.cc:304] T ff75a1d4cb1f493db8f71ddc136ba9ab P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e; no voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:06:42.343683 24700 consensus_queue.cc:1048] T ece3db938bc649d4a40a51522ed5259c P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.031s
I20260709 13:06:42.339614 24626 raft_consensus.cc:515] T 14efcc79969f41babe5529c22d59156d P 127766fc592545a4997f7790f50f6076 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:42.376765 24812 leader_election.cc:290] T 86a6797bdfe94fa496c050ceae4bd0d9 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:06:42.470891 19523 leader_election.cc:304] T 179fd671030940b4b4a4e24bcc4aba0a P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e61c3a8f61bb48f8a963c9480e53c168; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:06:42.438540 24866 consensus_queue.cc:1059] T 1dc5b3532fe54f74876d02beffa2c230 P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:06:42.439378 19377 leader_election.cc:304] T 1f85fc4b527a48848e5faa083b604e36 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87; no voters: 127766fc592545a4997f7790f50f6076
I20260709 13:06:42.441920 19556 raft_consensus.cc:1275] T 86a6797bdfe94fa496c050ceae4bd0d9 P e61c3a8f61bb48f8a963c9480e53c168 [term 12 FOLLOWER]: Refusing update from remote peer 0473d2b2d01f4459b1e90fd12cc7840e: Log matching property violated. Preceding OpId in replica: term: 10 index: 5. Preceding OpId from leader: term: 12 index: 6. (index mismatch)
I20260709 13:06:42.445930 20078 leader_election.cc:304] T 9962423cb4e54fcfa5de01daf68a86e7 P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, 127766fc592545a4997f7790f50f6076; no voters: e5256d91808b47c195bc9b4dbd7f2b87
W20260709 13:06:42.446781 20076 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:42.451079 19409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22196caba61445d3bec98a0aab3c337d" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:06:42.478494 19409 raft_consensus.cc:2468] T 22196caba61445d3bec98a0aab3c337d P e5256d91808b47c195bc9b4dbd7f2b87 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 14.
I20260709 13:06:42.479415 19409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "309c3ca0ca4b4f3ba129752ea2cb293b" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
I20260709 13:06:42.480114 19409 raft_consensus.cc:3060] T 309c3ca0ca4b4f3ba129752ea2cb293b P e5256d91808b47c195bc9b4dbd7f2b87 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:06:42.453079 19402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff75a1d4cb1f493db8f71ddc136ba9ab" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
I20260709 13:06:42.453413 19407 raft_consensus.cc:1275] T 76cb037fc9064d13b59a8969d897ce8c P e5256d91808b47c195bc9b4dbd7f2b87 [term 14 FOLLOWER]: Refusing update from remote peer e61c3a8f61bb48f8a963c9480e53c168: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 13:06:42.453907 20108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a16f7501e2444fb86d4e2778e734e02" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076"
I20260709 13:06:42.454118 19405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc225c93219c45538b53a1bd3d387e4d" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:06:42.454921 19403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4af19371ea874c09a0a2147040835cbb" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:06:42.455696 19410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4509b76741dc428e9201c70c1658da13" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:06:42.456435 19406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a61655d99124a29b486ba4a5b37faea" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 14 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:06:42.457980 19404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7be9efa6559648dbb5a0f7684c4542d1" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:06:42.437312 19408 raft_consensus.cc:2468] T f93ee515a9c14139bf566522ed8232f3 P e5256d91808b47c195bc9b4dbd7f2b87 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 17.
I20260709 13:06:42.331784 25067 raft_consensus.cc:697] T 7be9efa6559648dbb5a0f7684c4542d1 P e5256d91808b47c195bc9b4dbd7f2b87 [term 15 LEADER]: Becoming Leader. State: Replica: e5256d91808b47c195bc9b4dbd7f2b87, State: Running, Role: LEADER
W20260709 13:06:42.473758 19449 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.1:40321, user_credentials={real_user=slave}} blocked reactor thread for 102043us
I20260709 13:06:42.475020 19411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85c494af21f9457a85da47b9bc70c1fd" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:06:42.379367 24970 raft_consensus.cc:3055] T 7f575b143b844aa096b50997dad3516a P e61c3a8f61bb48f8a963c9480e53c168 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:06:42.485857 19406 raft_consensus.cc:2410] T 1a61655d99124a29b486ba4a5b37faea P e5256d91808b47c195bc9b4dbd7f2b87 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e61c3a8f61bb48f8a963c9480e53c168 for term 14 because replica has last-logged OpId of term: 12 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 7.
W20260709 13:06:42.522480 20078 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.2:46257, user_credentials={real_user=slave}} blocked reactor thread for 44733.6us
I20260709 13:06:42.526630 19559 raft_consensus.cc:1275] T 1dc5b3532fe54f74876d02beffa2c230 P e61c3a8f61bb48f8a963c9480e53c168 [term 17 FOLLOWER]: Refusing update from remote peer 0473d2b2d01f4459b1e90fd12cc7840e: Log matching property violated. Preceding OpId in replica: term: 15 index: 8. Preceding OpId from leader: term: 17 index: 9. (index mismatch)
I20260709 13:06:42.528333 24990 consensus_queue.cc:1048] T b08304a0a02b42d7840c4e8ee9a6bd1a P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:06:42.472647 25077 raft_consensus.cc:493] T 1efebf73c86e432baa55533136b6e12c P 127766fc592545a4997f7790f50f6076 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:42.528424 19449 leader_election.cc:304] T 1a61655d99124a29b486ba4a5b37faea P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87; no voters: 
I20260709 13:06:42.534117 19449 leader_election.cc:400] T 9962423cb4e54fcfa5de01daf68a86e7 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 14 election: Vote denied by peer e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321) with higher term. Message: Invalid argument: T 9962423cb4e54fcfa5de01daf68a86e7 P e5256d91808b47c195bc9b4dbd7f2b87 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 0473d2b2d01f4459b1e90fd12cc7840e for earlier term 14. Current term is 15.
I20260709 13:06:42.474117 24964 raft_consensus.cc:493] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P e5256d91808b47c195bc9b4dbd7f2b87 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 127766fc592545a4997f7790f50f6076)
I20260709 13:06:42.535502 19449 leader_election.cc:304] T 46c5bfeecc314717bffe987e6844b6d0 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87; no voters: 
I20260709 13:06:42.481225 25062 raft_consensus.cc:3060] T ff75a1d4cb1f493db8f71ddc136ba9ab P 0473d2b2d01f4459b1e90fd12cc7840e [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:06:42.474375 24931 raft_consensus.cc:493] T 1efebf73c86e432baa55533136b6e12c P e61c3a8f61bb48f8a963c9480e53c168 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:42.535006 20078 leader_election.cc:304] T 62c6c134d3d24a1ab144dd9ee6bc3f64 P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 127766fc592545a4997f7790f50f6076; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:06:42.536368 19560 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ed7fdbcb96d14d418db9ca90a792588a"
dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
mode: GRACEFUL
new_leader_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
 from {username='slave'} at 127.0.0.1:39264
I20260709 13:06:42.472966 24781 raft_consensus.cc:2749] T b08304a0a02b42d7840c4e8ee9a6bd1a P e61c3a8f61bb48f8a963c9480e53c168 [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:06:42.586086 19484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86a6797bdfe94fa496c050ceae4bd0d9" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 13 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
W20260709 13:06:42.534230 19450 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.3:36891, user_credentials={real_user=slave}} blocked reactor thread for 254847us
I20260709 13:06:42.544947 19478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff75a1d4cb1f493db8f71ddc136ba9ab" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:06:42.545923 19410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "309c3ca0ca4b4f3ba129752ea2cb293b" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
I20260709 13:06:42.547489 19477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7be9efa6559648dbb5a0f7684c4542d1" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:06:42.600754 19450 leader_election.cc:304] T df751f992649444090e27965eb1af85d P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e; no voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:06:42.548120 19481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4509b76741dc428e9201c70c1658da13" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:06:42.601111 19477 raft_consensus.cc:2393] T 7be9efa6559648dbb5a0f7684c4542d1 P 0473d2b2d01f4459b1e90fd12cc7840e [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e61c3a8f61bb48f8a963c9480e53c168 in current term 15: Already voted for candidate e5256d91808b47c195bc9b4dbd7f2b87 in this term.
I20260709 13:06:42.547820 19526 leader_election.cc:304] T 22196caba61445d3bec98a0aab3c337d P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
W20260709 13:06:42.577415 19375 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.3:36891, user_credentials={real_user=slave}} blocked reactor thread for 93284.7us
I20260709 13:06:42.607329 19375 leader_election.cc:304] T 86a6797bdfe94fa496c050ceae4bd0d9 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168
W20260709 13:06:42.607671 20078 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.2:46257, user_credentials={real_user=slave}} blocked reactor thread for 72736.5us
I20260709 13:06:42.485471 24898 raft_consensus.cc:493] T 5ec1c4ce15e04c7e8c283a62179f2a64 P 0473d2b2d01f4459b1e90fd12cc7840e [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 127766fc592545a4997f7790f50f6076)
I20260709 13:06:42.522480 25020 raft_consensus.cc:2804] T 1f85fc4b527a48848e5faa083b604e36 P e5256d91808b47c195bc9b4dbd7f2b87 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:06:42.625341 19482 raft_consensus.cc:1240] T 7f575b143b844aa096b50997dad3516a P 0473d2b2d01f4459b1e90fd12cc7840e [term 12 FOLLOWER]: Rejecting Update request from peer e61c3a8f61bb48f8a963c9480e53c168 for earlier term 11. Current term is 12. Ops: []
I20260709 13:06:42.487317 24989 raft_consensus.cc:2749] T 179fd671030940b4b4a4e24bcc4aba0a P e61c3a8f61bb48f8a963c9480e53c168 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:06:42.627357 19483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc225c93219c45538b53a1bd3d387e4d" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:06:42.612900 19450 leader_election.cc:304] T 22196caba61445d3bec98a0aab3c337d P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168; no voters: e5256d91808b47c195bc9b4dbd7f2b87
W20260709 13:06:42.614430 19377 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.2:46257, user_credentials={real_user=slave}} blocked reactor thread for 135871us
I20260709 13:06:42.625162 19485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62c6c134d3d24a1ab144dd9ee6bc3f64" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:06:42.630507 19377 leader_election.cc:304] T 3e1f505cb0f1427bbd698ac889d80821 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87; no voters: 
I20260709 13:06:42.568002 19479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0afb57ae58a24a01850491d69f0213dd" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:06:42.670784 19559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df751f992649444090e27965eb1af85d" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:06:42.672039 19555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14935b3ddf914369822e4a0547aaa355" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:06:42.672220 19554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef32ce6fdd0e40d382c79974f30295c6" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:06:42.673390 24629 raft_consensus.cc:493] T ed7fdbcb96d14d418db9ca90a792588a P 127766fc592545a4997f7790f50f6076 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:42.673990 24629 raft_consensus.cc:515] T ed7fdbcb96d14d418db9ca90a792588a P 127766fc592545a4997f7790f50f6076 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
W20260709 13:06:42.613258 19526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.2:46257, user_credentials={real_user=slave}} blocked reactor thread for 65518.8us
I20260709 13:06:42.525542 24812 raft_consensus.cc:493] T ed7fdbcb96d14d418db9ca90a792588a P e61c3a8f61bb48f8a963c9480e53c168 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 127766fc592545a4997f7790f50f6076)
I20260709 13:06:42.675815 24812 raft_consensus.cc:515] T ed7fdbcb96d14d418db9ca90a792588a P e61c3a8f61bb48f8a963c9480e53c168 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:42.676353 24629 leader_election.cc:290] T ed7fdbcb96d14d418db9ca90a792588a P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:06:42.678081 24812 leader_election.cc:290] T ed7fdbcb96d14d418db9ca90a792588a P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:06:42.678510 19560 raft_consensus.cc:606] T ed7fdbcb96d14d418db9ca90a792588a P e61c3a8f61bb48f8a963c9480e53c168 [term 11 FOLLOWER]: Received request to transfer leadership to TS 0473d2b2d01f4459b1e90fd12cc7840e
I20260709 13:06:42.678887 19560 raft_consensus.cc:614] T ed7fdbcb96d14d418db9ca90a792588a P e61c3a8f61bb48f8a963c9480e53c168 [term 11 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:06:42.476263 25052 raft_consensus.cc:515] T 217b5fae677b4971b3bbd2f357a1f7ff P e61c3a8f61bb48f8a963c9480e53c168 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:42.549062 24892 raft_consensus.cc:2804] T 1a61655d99124a29b486ba4a5b37faea P 0473d2b2d01f4459b1e90fd12cc7840e [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:06:42.598618 24982 raft_consensus.cc:2804] T 46c5bfeecc314717bffe987e6844b6d0 P 0473d2b2d01f4459b1e90fd12cc7840e [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:06:42.535498 24992 raft_consensus.cc:2804] T 9962423cb4e54fcfa5de01daf68a86e7 P 127766fc592545a4997f7790f50f6076 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:06:42.688396 19409 raft_consensus.cc:2468] T 309c3ca0ca4b4f3ba129752ea2cb293b P e5256d91808b47c195bc9b4dbd7f2b87 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 127766fc592545a4997f7790f50f6076 in term 11.
I20260709 13:06:42.714457 24992 raft_consensus.cc:697] T 9962423cb4e54fcfa5de01daf68a86e7 P 127766fc592545a4997f7790f50f6076 [term 15 LEADER]: Becoming Leader. State: Replica: 127766fc592545a4997f7790f50f6076, State: Running, Role: LEADER
I20260709 13:06:42.716456 24992 consensus_queue.cc:237] T 9962423cb4e54fcfa5de01daf68a86e7 P 127766fc592545a4997f7790f50f6076 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:42.549636 25077 raft_consensus.cc:515] T 1efebf73c86e432baa55533136b6e12c P 127766fc592545a4997f7790f50f6076 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:42.632786 25020 raft_consensus.cc:493] T 1f85fc4b527a48848e5faa083b604e36 P e5256d91808b47c195bc9b4dbd7f2b87 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 127766fc592545a4997f7790f50f6076)
I20260709 13:06:42.724957 25020 raft_consensus.cc:3060] T 1f85fc4b527a48848e5faa083b604e36 P e5256d91808b47c195bc9b4dbd7f2b87 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:06:42.725169 19557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a16f7501e2444fb86d4e2778e734e02" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:06:42.664343 24898 raft_consensus.cc:515] T 5ec1c4ce15e04c7e8c283a62179f2a64 P 0473d2b2d01f4459b1e90fd12cc7840e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:42.678838 25076 raft_consensus.cc:493] T ece3db938bc649d4a40a51522ed5259c P 127766fc592545a4997f7790f50f6076 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader e61c3a8f61bb48f8a963c9480e53c168)
I20260709 13:06:42.734797 25051 raft_consensus.cc:2804] T 22196caba61445d3bec98a0aab3c337d P e61c3a8f61bb48f8a963c9480e53c168 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:06:42.735285 25051 raft_consensus.cc:493] T 22196caba61445d3bec98a0aab3c337d P e61c3a8f61bb48f8a963c9480e53c168 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:42.735738 25051 raft_consensus.cc:3060] T 22196caba61445d3bec98a0aab3c337d P e61c3a8f61bb48f8a963c9480e53c168 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:06:42.734984 25076 raft_consensus.cc:515] T ece3db938bc649d4a40a51522ed5259c P 127766fc592545a4997f7790f50f6076 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:42.628774 25075 raft_consensus.cc:2749] T 62c6c134d3d24a1ab144dd9ee6bc3f64 P 127766fc592545a4997f7790f50f6076 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:06:42.740235 24972 consensus_queue.cc:1059] T ff75a1d4cb1f493db8f71ddc136ba9ab P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 }, Status: INVALID_TERM, Last received: 15.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:06:42.739845 24892 raft_consensus.cc:697] T 1a61655d99124a29b486ba4a5b37faea P 0473d2b2d01f4459b1e90fd12cc7840e [term 13 LEADER]: Becoming Leader. State: Replica: 0473d2b2d01f4459b1e90fd12cc7840e, State: Running, Role: LEADER
I20260709 13:06:42.742362 25050 leader_election.cc:290] T 1dc5b3532fe54f74876d02beffa2c230 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:06:42.742726 24892 consensus_queue.cc:237] T 1a61655d99124a29b486ba4a5b37faea P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:42.526510 25038 raft_consensus.cc:515] T 2b74109013a140ada21feeef92d6f563 P e5256d91808b47c195bc9b4dbd7f2b87 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:42.548882 24964 raft_consensus.cc:3060] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P e5256d91808b47c195bc9b4dbd7f2b87 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:06:42.532694 24970 raft_consensus.cc:740] T 7f575b143b844aa096b50997dad3516a P e61c3a8f61bb48f8a963c9480e53c168 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: e61c3a8f61bb48f8a963c9480e53c168, State: Running, Role: LEADER
W20260709 13:06:42.666296 19450 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.3:36891, user_credentials={real_user=slave}} blocked reactor thread for 53517.2us
I20260709 13:06:42.724072 25077 leader_election.cc:290] T 1efebf73c86e432baa55533136b6e12c P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:06:42.706418 19305 catalog_manager.cc:5697] T 14efcc79969f41babe5529c22d59156d P e5256d91808b47c195bc9b4dbd7f2b87 reported cstate change: term changed from 10 to 16. New cstate: current_term: 16 leader_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:06:42.710641 24825 raft_consensus.cc:2749] T ab43d85f64114d4ebf618930e43d9ed0 P e5256d91808b47c195bc9b4dbd7f2b87 [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:06:42.811928 19305 catalog_manager.cc:5697] T 2725d2c4cb054f18b0fc8f735c15f6c2 P e5256d91808b47c195bc9b4dbd7f2b87 reported cstate change: term changed from 8 to 17, leader changed from e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1) to e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3). New cstate: current_term: 17 leader_uuid: "e61c3a8f61bb48f8a963c9480e53c168" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } }
I20260709 13:06:42.733695 24898 leader_election.cc:290] T 5ec1c4ce15e04c7e8c283a62179f2a64 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
W20260709 13:06:42.794512 19523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.1:40321, user_credentials={real_user=slave}} blocked reactor thread for 307266us
I20260709 13:06:42.680423 20078 leader_election.cc:304] T 0afb57ae58a24a01850491d69f0213dd P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 127766fc592545a4997f7790f50f6076; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168
W20260709 13:06:42.813629 19377 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.2:46257, user_credentials={real_user=slave}} blocked reactor thread for 182143us
I20260709 13:06:42.633334 25057 raft_consensus.cc:2749] T df751f992649444090e27965eb1af85d P 0473d2b2d01f4459b1e90fd12cc7840e [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:06:42.665663 24931 raft_consensus.cc:515] T 1efebf73c86e432baa55533136b6e12c P e61c3a8f61bb48f8a963c9480e53c168 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:42.755250 24875 raft_consensus.cc:493] T 4509b76741dc428e9201c70c1658da13 P 0473d2b2d01f4459b1e90fd12cc7840e [term 10 FOLLOWER]: Starting pre-election (detected failure of leader e5256d91808b47c195bc9b4dbd7f2b87)
I20260709 13:06:42.822340 19305 catalog_manager.cc:5697] T 85c494af21f9457a85da47b9bc70c1fd P e5256d91808b47c195bc9b4dbd7f2b87 reported cstate change: term changed from 12 to 15, leader changed from 127766fc592545a4997f7790f50f6076 (127.17.223.4) to e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1). New cstate: current_term: 15 leader_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:06:42.681360 24983 raft_consensus.cc:2804] T 22196caba61445d3bec98a0aab3c337d P 0473d2b2d01f4459b1e90fd12cc7840e [term 14 FOLLOWER]: Leader election won for term 14
W20260709 13:06:42.831823 20078 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.2:46257, user_credentials={real_user=slave}} blocked reactor thread for 164678us
I20260709 13:06:42.809609 24798 raft_consensus.cc:2749] T 86a6797bdfe94fa496c050ceae4bd0d9 P e5256d91808b47c195bc9b4dbd7f2b87 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:06:42.810071 24932 raft_consensus.cc:493] T 14efcc79969f41babe5529c22d59156d P 0473d2b2d01f4459b1e90fd12cc7840e [term 16 FOLLOWER]: Starting pre-election (detected failure of leader e5256d91808b47c195bc9b4dbd7f2b87)
I20260709 13:06:42.809888 25018 raft_consensus.cc:493] T 0e1085d23e8347fbbd5bce7542f4b1f4 P 0473d2b2d01f4459b1e90fd12cc7840e [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 127766fc592545a4997f7790f50f6076)
I20260709 13:06:42.846529 19377 leader_election.cc:304] T 14935b3ddf914369822e4a0547aaa355 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, 127766fc592545a4997f7790f50f6076
W20260709 13:06:42.846998 19306 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:51954 (request call id 133) took 17163 ms (client timeout 15000 ms). Trace:
I20260709 13:06:42.847702 19377 leader_election.cc:304] T 9962423cb4e54fcfa5de01daf68a86e7 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, 127766fc592545a4997f7790f50f6076
I20260709 13:06:42.848065 19557 raft_consensus.cc:1275] T b08304a0a02b42d7840c4e8ee9a6bd1a P e61c3a8f61bb48f8a963c9480e53c168 [term 16 FOLLOWER]: Refusing update from remote peer 0473d2b2d01f4459b1e90fd12cc7840e: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 13:06:42.849502 19554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "309c3ca0ca4b4f3ba129752ea2cb293b" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:06:42.849879 24825 raft_consensus.cc:3055] T ff75a1d4cb1f493db8f71ddc136ba9ab P e5256d91808b47c195bc9b4dbd7f2b87 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:06:42.850023 19554 raft_consensus.cc:3060] T 309c3ca0ca4b4f3ba129752ea2cb293b P e61c3a8f61bb48f8a963c9480e53c168 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:06:42.850328 24825 raft_consensus.cc:740] T ff75a1d4cb1f493db8f71ddc136ba9ab P e5256d91808b47c195bc9b4dbd7f2b87 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: e5256d91808b47c195bc9b4dbd7f2b87, State: Running, Role: LEADER
I20260709 13:06:42.851234 24825 consensus_queue.cc:260] T ff75a1d4cb1f493db8f71ddc136ba9ab P e5256d91808b47c195bc9b4dbd7f2b87 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.8, Last appended by leader: 8, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:42.852458 24825 raft_consensus.cc:3060] T ff75a1d4cb1f493db8f71ddc136ba9ab P e5256d91808b47c195bc9b4dbd7f2b87 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:06:42.857573 25094 raft_consensus.cc:2749] T 14935b3ddf914369822e4a0547aaa355 P e5256d91808b47c195bc9b4dbd7f2b87 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:06:42.847383 19306 rpcz_store.cc:269] 0709 13:06:25.673825 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:25.678441 (+  4616us) service_pool.cc:224] Handling call
0709 13:06:42.832745 (+17154304us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:06:38.648165 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:06:38.688200 (+ 40035us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:06:38.688280 (+    80us) write_op.cc:435] Acquired schema lock
0709 13:06:38.688309 (+    29us) tablet.cc:662] Decoding operations
0709 13:06:38.689873 (+  1564us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:06:38.689995 (+   122us) write_op.cc:641] Partition lock acquired for write op
0709 13:06:38.690035 (+    40us) tablet.cc:685] Acquiring locks for 12 operations
0709 13:06:38.937659 (+247624us) tablet.cc:701] Row locks acquired
0709 13:06:38.949344 (+ 11685us) write_op.cc:260] PREPARE: finished
0709 13:06:39.101736 (+152392us) write_op.cc:270] Start()
0709 13:06:39.321038 (+219302us) write_op.cc:276] Timestamp: P: 1783602399073057 usec, L: 0
0709 13:06:39.321108 (+    70us) op_driver.cc:348] REPLICATION: starting
0709 13:06:39.322390 (+  1282us) log.cc:844] Serialized 4957 byte log entry
0709 13:06:39.910706 (+588316us) spinlock_profiling.cc:243] Waited 1.8 ms on lock 0x7b18000bf440. stack: 00007f4a79de9343 00007f4a79de9240 00007f4a797781d4 00007f4a834b6304 00007f4a834b6299 00007f4a82ce3de1 00007f4a82cf05b1 00007f4a79e1b3f3 00007f4a79e1d7c1 00007f4a79e1d779 00007f4a79e1d709 00007f4a79e1d6d1 00007f4a79e1c9cd 000000000038f354 000000000038f199 00007f4a79dfe83a
0709 13:06:40.439902 (+529196us) op_driver.cc:464] REPLICATION: finished
0709 13:06:40.912216 (+472314us) write_op.cc:301] APPLY: starting
0709 13:06:40.912327 (+   111us) tablet.cc:1367] starting BulkCheckPresence
0709 13:06:41.278905 (+366578us) tablet.cc:1370] finished BulkCheckPresence
0709 13:06:41.278978 (+    73us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:06:41.903940 (+624962us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:06:41.904392 (+   452us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=24,key_file_lookups=24,delta_file_lookups=24,mrs_lookups=0
0709 13:06:41.904475 (+    83us) write_op.cc:312] APPLY: finished
0709 13:06:41.950902 (+ 46427us) log.cc:844] Serialized 113 byte log entry
0709 13:06:42.101104 (+150202us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:06:42.121496 (+ 20392us) write_op.cc:454] Released schema lock
0709 13:06:42.158078 (+ 36582us) write_op.cc:341] FINISH: Updating metrics
0709 13:06:42.237403 (+ 79325us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:06:42.242725 (+  5322us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":1161115,"reported_tablets":28,"child_traces":[["op",{"apply.queue_time_us":378806,"apply.run_cpu_time_us":39191,"apply.run_wall_time_us":1324438,"cfile_cache_hit":50,"cfile_cache_hit_bytes":54287,"num_ops":12,"prepare.queue_time_us":165745,"prepare.run_cpu_time_us":25953,"prepare.run_wall_time_us":937323,"raft.queue_time_us":414444,"raft.run_cpu_time_us":116220,"raft.run_wall_time_us":359025,"replication_time_us":1076781,"spinlock_wait_cycles":4129664,"thread_start_us":900080,"threads_started":5,"wal-append.queue_time_us":539478,"wal-append.run_cpu_time_us":22557,"wal-append.run_wall_time_us":1248537}]]}
I20260709 13:06:42.848906 19377 leader_election.cc:304] T 775c229504194560ba9589bc2199b089 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, 127766fc592545a4997f7790f50f6076
I20260709 13:06:42.858597 25094 raft_consensus.cc:2749] T 9962423cb4e54fcfa5de01daf68a86e7 P e5256d91808b47c195bc9b4dbd7f2b87 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:06:42.829855 24982 raft_consensus.cc:697] T 46c5bfeecc314717bffe987e6844b6d0 P 0473d2b2d01f4459b1e90fd12cc7840e [term 21 LEADER]: Becoming Leader. State: Replica: 0473d2b2d01f4459b1e90fd12cc7840e, State: Running, Role: LEADER
I20260709 13:06:42.794777 24936 consensus_queue.cc:1059] T 6c5eebf646ad445a9d1b1adc319d7b16 P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.038s
I20260709 13:06:42.844363 19305 catalog_manager.cc:5697] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P e5256d91808b47c195bc9b4dbd7f2b87 reported cstate change: term changed from 14 to 16. New cstate: current_term: 16 leader_uuid: "127766fc592545a4997f7790f50f6076" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } } }
I20260709 13:06:42.870062 19554 raft_consensus.cc:2468] T 309c3ca0ca4b4f3ba129752ea2cb293b P e61c3a8f61bb48f8a963c9480e53c168 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 11.
I20260709 13:06:42.876696 19305 catalog_manager.cc:5697] T 40e1e16737a842ee936002830f36882e P e5256d91808b47c195bc9b4dbd7f2b87 reported cstate change: term changed from 15 to 17. New cstate: current_term: 17 leader_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:42.841017 25077 raft_consensus.cc:2749] T 0afb57ae58a24a01850491d69f0213dd P 127766fc592545a4997f7790f50f6076 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:06:42.739831 25067 consensus_queue.cc:237] T 7be9efa6559648dbb5a0f7684c4542d1 P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 15, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } attrs { replace: true } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:42.822413 24866 consensus_queue.cc:1243] T 1dc5b3532fe54f74876d02beffa2c230 P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Peer 0473d2b2d01f4459b1e90fd12cc7840e log is divergent from this leader: its last log entry 17.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 13:06:42.863197 24626 leader_election.cc:290] T 14efcc79969f41babe5529c22d59156d P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:06:42.888103 19305 catalog_manager.cc:5697] T 217b5fae677b4971b3bbd2f357a1f7ff P e5256d91808b47c195bc9b4dbd7f2b87 reported cstate change: term changed from 7 to 12, leader changed from e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1) to 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2). New cstate: current_term: 12 leader_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } }
I20260709 13:06:42.890230 19305 catalog_manager.cc:5697] T fa731b585f684a7fb2d106c50f143b83 P e5256d91808b47c195bc9b4dbd7f2b87 reported cstate change: term changed from 10 to 12. New cstate: current_term: 12 leader_uuid: "127766fc592545a4997f7790f50f6076" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } } }
I20260709 13:06:42.894075 19305 catalog_manager.cc:5697] T ff75a1d4cb1f493db8f71ddc136ba9ab P e5256d91808b47c195bc9b4dbd7f2b87 reported cstate change: term changed from 10 to 15, leader changed from e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3) to e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1). New cstate: current_term: 15 leader_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } health_report { overall_health: HEALTHY } } }
I20260709 13:06:42.876847 24926 raft_consensus.cc:493] T ff9b0eddd810459b82d91c60777c10eb P 0473d2b2d01f4459b1e90fd12cc7840e [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 127766fc592545a4997f7790f50f6076)
I20260709 13:06:42.865216 25085 raft_consensus.cc:2804] T 3e1f505cb0f1427bbd698ac889d80821 P e5256d91808b47c195bc9b4dbd7f2b87 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:06:42.896436 19305 catalog_manager.cc:5697] T ff9b0eddd810459b82d91c60777c10eb P e5256d91808b47c195bc9b4dbd7f2b87 reported cstate change: term changed from 12 to 16, leader changed from 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2) to 127766fc592545a4997f7790f50f6076 (127.17.223.4). New cstate: current_term: 16 leader_uuid: "127766fc592545a4997f7790f50f6076" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } } }
I20260709 13:06:42.901425 20108 raft_consensus.cc:1275] T 48824d5acfbc485ebf8c2d944e7202de P 127766fc592545a4997f7790f50f6076 [term 18 FOLLOWER]: Refusing update from remote peer 0473d2b2d01f4459b1e90fd12cc7840e: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 18 index: 13. (index mismatch)
I20260709 13:06:42.889240 24798 raft_consensus.cc:2749] T 775c229504194560ba9589bc2199b089 P e5256d91808b47c195bc9b4dbd7f2b87 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:06:42.913327 19402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ec1c4ce15e04c7e8c283a62179f2a64" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:06:42.885637 25076 leader_election.cc:290] T ece3db938bc649d4a40a51522ed5259c P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:06:42.902998 19305 catalog_manager.cc:5697] T f1b10566f45d4a7d9029858330e02d5b P e5256d91808b47c195bc9b4dbd7f2b87 reported cstate change: term changed from 10 to 15, leader changed from 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2) to e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3). New cstate: current_term: 15 leader_uuid: "e61c3a8f61bb48f8a963c9480e53c168" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } }
W20260709 13:06:42.899636 24852 consensus_meta.cc:287] T 65d8cb8d6ec64f459d5a47cefab10acf P 127766fc592545a4997f7790f50f6076: Time spent flushing consensus metadata: real 0.565s	user 0.006s	sys 0.003s
I20260709 13:06:42.883483 24983 raft_consensus.cc:697] T 22196caba61445d3bec98a0aab3c337d P 0473d2b2d01f4459b1e90fd12cc7840e [term 14 LEADER]: Becoming Leader. State: Replica: 0473d2b2d01f4459b1e90fd12cc7840e, State: Running, Role: LEADER
I20260709 13:06:42.864485 24875 raft_consensus.cc:515] T 4509b76741dc428e9201c70c1658da13 P 0473d2b2d01f4459b1e90fd12cc7840e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:42.891294 24702 leader_election.cc:290] T f93ee515a9c14139bf566522ed8232f3 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 18 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:06:42.915740 19305 catalog_manager.cc:5697] T 2b74109013a140ada21feeef92d6f563 P e5256d91808b47c195bc9b4dbd7f2b87 reported cstate change: term changed from 6 to 12. New cstate: current_term: 12 leader_uuid: "e61c3a8f61bb48f8a963c9480e53c168" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } }
I20260709 13:06:42.885303 25071 consensus_queue.cc:1048] T ab43d85f64114d4ebf618930e43d9ed0 P 127766fc592545a4997f7790f50f6076 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.014s
I20260709 13:06:42.918267 20104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "309c3ca0ca4b4f3ba129752ea2cb293b" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076"
W20260709 13:06:42.909749 19374 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:42.917579 19523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.1:40321, user_credentials={real_user=slave}} blocked reactor thread for 89923us
I20260709 13:06:42.881439 24990 consensus_queue.cc:1048] T 48824d5acfbc485ebf8c2d944e7202de P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.021s
I20260709 13:06:42.925835 20109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ec1c4ce15e04c7e8c283a62179f2a64" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:06:42.879030 24932 raft_consensus.cc:515] T 14efcc79969f41babe5529c22d59156d P 0473d2b2d01f4459b1e90fd12cc7840e [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:42.937505 20104 raft_consensus.cc:2393] T 309c3ca0ca4b4f3ba129752ea2cb293b P 127766fc592545a4997f7790f50f6076 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 0473d2b2d01f4459b1e90fd12cc7840e in current term 11: Already voted for candidate 127766fc592545a4997f7790f50f6076 in this term.
I20260709 13:06:42.888223 24898 consensus_queue.cc:1048] T 1efebf73c86e432baa55533136b6e12c P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.029s
I20260709 13:06:42.944861 19523 leader_election.cc:304] T 40e1e16737a842ee936002830f36882e P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e61c3a8f61bb48f8a963c9480e53c168; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:06:42.938583 19305 catalog_manager.cc:5697] T 65d8cb8d6ec64f459d5a47cefab10acf P e5256d91808b47c195bc9b4dbd7f2b87 reported cstate change: term changed from 13 to 15. New cstate: current_term: 15 leader_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:06:42.878261 25018 raft_consensus.cc:515] T 0e1085d23e8347fbbd5bce7542f4b1f4 P 0473d2b2d01f4459b1e90fd12cc7840e [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:42.899392 24866 raft_consensus.cc:493] T b9f0d59553ad444883fcf5b5909f9798 P e5256d91808b47c195bc9b4dbd7f2b87 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader e61c3a8f61bb48f8a963c9480e53c168)
I20260709 13:06:42.942688 20108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c5eebf646ad445a9d1b1adc319d7b16" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076"
I20260709 13:06:42.901454 25091 raft_consensus.cc:493] T edd7d470b5014c9489be7f41f64355c9 P e5256d91808b47c195bc9b4dbd7f2b87 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader e61c3a8f61bb48f8a963c9480e53c168)
I20260709 13:06:42.908221 24943 raft_consensus.cc:493] T 775c229504194560ba9589bc2199b089 P 0473d2b2d01f4459b1e90fd12cc7840e [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 127766fc592545a4997f7790f50f6076)
I20260709 13:06:42.911384 24573 raft_consensus.cc:493] T 2e36a9d6e29c4a7c860cf267efbd4c74 P 0473d2b2d01f4459b1e90fd12cc7840e [term 11 FOLLOWER]: Starting pre-election (detected failure of leader e5256d91808b47c195bc9b4dbd7f2b87)
I20260709 13:06:42.916999 24982 consensus_queue.cc:237] T 46c5bfeecc314717bffe987e6844b6d0 P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 20.10, Last appended by leader: 10, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:42.964468 25038 leader_election.cc:290] T 2b74109013a140ada21feeef92d6f563 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 13 election: Requested vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:06:42.988444 19409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ece3db938bc649d4a40a51522ed5259c" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:06:42.989210 19409 raft_consensus.cc:2468] T ece3db938bc649d4a40a51522ed5259c P e5256d91808b47c195bc9b4dbd7f2b87 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 127766fc592545a4997f7790f50f6076 in term 12.
I20260709 13:06:42.965015 24932 leader_election.cc:290] T 14efcc79969f41babe5529c22d59156d P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:06:42.908846 24996 raft_consensus.cc:493] T d1e5873a19244c5ebbcd38e126796ee7 P e5256d91808b47c195bc9b4dbd7f2b87 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader e61c3a8f61bb48f8a963c9480e53c168)
I20260709 13:06:42.968731 20108 raft_consensus.cc:3060] T 6c5eebf646ad445a9d1b1adc319d7b16 P 127766fc592545a4997f7790f50f6076 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:06:42.902542 25087 raft_consensus.cc:3055] T 6c5eebf646ad445a9d1b1adc319d7b16 P e61c3a8f61bb48f8a963c9480e53c168 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:06:42.950940 19305 catalog_manager.cc:5697] T 2a16f7501e2444fb86d4e2778e734e02 P e5256d91808b47c195bc9b4dbd7f2b87 reported cstate change: term changed from 13 to 14, leader changed from 127766fc592545a4997f7790f50f6076 (127.17.223.4) to e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1). New cstate: current_term: 14 leader_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:43.009529 19305 catalog_manager.cc:5697] T b9f0d59553ad444883fcf5b5909f9798 P e5256d91808b47c195bc9b4dbd7f2b87 reported cstate change: term changed from 13 to 14, leader changed from 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2) to e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3). New cstate: current_term: 14 leader_uuid: "e61c3a8f61bb48f8a963c9480e53c168" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } }
I20260709 13:06:43.011591 19305 catalog_manager.cc:5697] T d1e5873a19244c5ebbcd38e126796ee7 P e5256d91808b47c195bc9b4dbd7f2b87 reported cstate change: term changed from 11 to 17. New cstate: current_term: 17 leader_uuid: "e61c3a8f61bb48f8a963c9480e53c168" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } }
I20260709 13:06:42.895042 25057 consensus_queue.cc:1048] T 86a6797bdfe94fa496c050ceae4bd0d9 P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.047s
W20260709 13:06:42.987596 19450 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.3:36891, user_credentials={real_user=slave}} blocked reactor thread for 103447us
W20260709 13:06:42.968603 25063 consensus_meta.cc:287] T f93ee515a9c14139bf566522ed8232f3 P 0473d2b2d01f4459b1e90fd12cc7840e: Time spent flushing consensus metadata: real 0.596s	user 0.006s	sys 0.002s
I20260709 13:06:42.909657 24926 raft_consensus.cc:515] T ff9b0eddd810459b82d91c60777c10eb P 0473d2b2d01f4459b1e90fd12cc7840e [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:43.021441 19305 catalog_manager.cc:5697] T bc225c93219c45538b53a1bd3d387e4d P e5256d91808b47c195bc9b4dbd7f2b87 reported cstate change: term changed from 11 to 14, leader changed from 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2) to e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1). New cstate: current_term: 14 leader_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:43.019026 19409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14efcc79969f41babe5529c22d59156d" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:06:42.988521 24990 raft_consensus.cc:493] T ef32ce6fdd0e40d382c79974f30295c6 P 0473d2b2d01f4459b1e90fd12cc7840e [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:43.030834 19305 catalog_manager.cc:5697] T 1f85fc4b527a48848e5faa083b604e36 P e5256d91808b47c195bc9b4dbd7f2b87 reported cstate change: term changed from 11 to 13. New cstate: current_term: 13 leader_uuid: "127766fc592545a4997f7790f50f6076" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } } }
I20260709 13:06:43.032827 19305 catalog_manager.cc:5697] T 3e1f505cb0f1427bbd698ac889d80821 P e5256d91808b47c195bc9b4dbd7f2b87 reported cstate change: term changed from 10 to 16. New cstate: current_term: 16 leader_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:43.034459 19305 catalog_manager.cc:5697] T 1a61655d99124a29b486ba4a5b37faea P e5256d91808b47c195bc9b4dbd7f2b87 reported cstate change: term changed from 7 to 12, leader changed from e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3) to e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1). New cstate: current_term: 12 leader_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:43.037972 19305 catalog_manager.cc:5697] T 2e36a9d6e29c4a7c860cf267efbd4c74 P e5256d91808b47c195bc9b4dbd7f2b87 reported cstate change: term changed from 8 to 11, leader changed from e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3) to e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1). New cstate: current_term: 11 leader_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } health_report { overall_health: HEALTHY } } }
I20260709 13:06:43.050598 19305 catalog_manager.cc:5697] T 4509b76741dc428e9201c70c1658da13 P e5256d91808b47c195bc9b4dbd7f2b87 reported cstate change: term changed from 8 to 10. New cstate: current_term: 10 leader_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } health_report { overall_health: UNKNOWN } } }
W20260709 13:06:43.014961 24971 consensus_meta.cc:287] T 96efeaaf1057492490e9a621f37e1a2d P 0473d2b2d01f4459b1e90fd12cc7840e: Time spent flushing consensus metadata: real 0.619s	user 0.007s	sys 0.004s
I20260709 13:06:42.941110 24852 raft_consensus.cc:515] T 65d8cb8d6ec64f459d5a47cefab10acf P 127766fc592545a4997f7790f50f6076 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:42.967414 24936 consensus_queue.cc:1048] T 2a16f7501e2444fb86d4e2778e734e02 P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.058s
I20260709 13:06:43.008548 25087 raft_consensus.cc:740] T 6c5eebf646ad445a9d1b1adc319d7b16 P e61c3a8f61bb48f8a963c9480e53c168 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: e61c3a8f61bb48f8a963c9480e53c168, State: Running, Role: LEADER
I20260709 13:06:42.988401 24866 raft_consensus.cc:515] T b9f0d59553ad444883fcf5b5909f9798 P e5256d91808b47c195bc9b4dbd7f2b87 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:43.026804 25038 raft_consensus.cc:493] T f1b10566f45d4a7d9029858330e02d5b P e5256d91808b47c195bc9b4dbd7f2b87 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader e61c3a8f61bb48f8a963c9480e53c168)
I20260709 13:06:43.002977 24702 consensus_queue.cc:1048] T 65d8cb8d6ec64f459d5a47cefab10acf P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.085s
I20260709 13:06:43.002998 24943 raft_consensus.cc:515] T 775c229504194560ba9589bc2199b089 P 0473d2b2d01f4459b1e90fd12cc7840e [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:42.998426 24573 raft_consensus.cc:515] T 2e36a9d6e29c4a7c860cf267efbd4c74 P 0473d2b2d01f4459b1e90fd12cc7840e [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:43.064780 25085 raft_consensus.cc:697] T 3e1f505cb0f1427bbd698ac889d80821 P e5256d91808b47c195bc9b4dbd7f2b87 [term 18 LEADER]: Becoming Leader. State: Replica: e5256d91808b47c195bc9b4dbd7f2b87, State: Running, Role: LEADER
I20260709 13:06:43.000452 25091 raft_consensus.cc:515] T edd7d470b5014c9489be7f41f64355c9 P e5256d91808b47c195bc9b4dbd7f2b87 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:43.011029 24996 raft_consensus.cc:515] T d1e5873a19244c5ebbcd38e126796ee7 P e5256d91808b47c195bc9b4dbd7f2b87 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:43.143097 20103 raft_consensus.cc:1240] T 65d8cb8d6ec64f459d5a47cefab10acf P 127766fc592545a4997f7790f50f6076 [term 18 FOLLOWER]: Rejecting Update request from peer e61c3a8f61bb48f8a963c9480e53c168 for earlier term 17. Current term is 18. Ops: []
I20260709 13:06:43.025815 25063 raft_consensus.cc:515] T f93ee515a9c14139bf566522ed8232f3 P 0473d2b2d01f4459b1e90fd12cc7840e [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:43.146703 24852 leader_election.cc:290] T 65d8cb8d6ec64f459d5a47cefab10acf P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 18 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
W20260709 13:06:43.123013 24790 consensus_meta.cc:287] T 70797e5783b5454ab0d0eea663e791e3 P e61c3a8f61bb48f8a963c9480e53c168: Time spent flushing consensus metadata: real 0.656s	user 0.003s	sys 0.007s
I20260709 13:06:43.084188 24990 raft_consensus.cc:515] T ef32ce6fdd0e40d382c79974f30295c6 P 0473d2b2d01f4459b1e90fd12cc7840e [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:43.153090 20108 raft_consensus.cc:2468] T 6c5eebf646ad445a9d1b1adc319d7b16 P 127766fc592545a4997f7790f50f6076 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 16.
W20260709 13:06:43.153781 19450 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.3:36891, user_credentials={real_user=slave}} blocked reactor thread for 138389us
I20260709 13:06:43.123715 25098 raft_consensus.cc:493] T 76cb037fc9064d13b59a8969d897ce8c P 0473d2b2d01f4459b1e90fd12cc7840e [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:43.162324 19479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "309c3ca0ca4b4f3ba129752ea2cb293b" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:06:43.163017 19479 raft_consensus.cc:2393] T 309c3ca0ca4b4f3ba129752ea2cb293b P 0473d2b2d01f4459b1e90fd12cc7840e [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 127766fc592545a4997f7790f50f6076 in current term 11: Already voted for candidate 0473d2b2d01f4459b1e90fd12cc7840e in this term.
I20260709 13:06:43.164283 19481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14efcc79969f41babe5529c22d59156d" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:06:43.165002 19481 raft_consensus.cc:2468] T 14efcc79969f41babe5529c22d59156d P 0473d2b2d01f4459b1e90fd12cc7840e [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 127766fc592545a4997f7790f50f6076 in term 16.
I20260709 13:06:43.165997 19481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b74109013a140ada21feeef92d6f563" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:06:43.161638 19477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "309c3ca0ca4b4f3ba129752ea2cb293b" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:06:43.169044 19555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ece3db938bc649d4a40a51522ed5259c" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:06:43.195777 19551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed7fdbcb96d14d418db9ca90a792588a" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:06:43.196673 19551 raft_consensus.cc:2468] T ed7fdbcb96d14d418db9ca90a792588a P e61c3a8f61bb48f8a963c9480e53c168 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 127766fc592545a4997f7790f50f6076 in term 11.
I20260709 13:06:43.202049 19557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1efebf73c86e432baa55533136b6e12c" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:06:43.204141 19485 raft_consensus.cc:1275] T a08760e15aac4630a629431f56024dc8 P 0473d2b2d01f4459b1e90fd12cc7840e [term 19 FOLLOWER]: Refusing update from remote peer e5256d91808b47c195bc9b4dbd7f2b87: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 19 index: 11. (index mismatch)
I20260709 13:06:43.205440 19483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1efebf73c86e432baa55533136b6e12c" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:06:43.206483 19480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef32ce6fdd0e40d382c79974f30295c6" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:06:43.213164 19486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed7fdbcb96d14d418db9ca90a792588a" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:06:43.129025 25038 raft_consensus.cc:515] T f1b10566f45d4a7d9029858330e02d5b P e5256d91808b47c195bc9b4dbd7f2b87 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:43.091977 24971 raft_consensus.cc:515] T 96efeaaf1057492490e9a621f37e1a2d P 0473d2b2d01f4459b1e90fd12cc7840e [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
W20260709 13:06:43.217583 19449 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.4:43121, user_credentials={real_user=slave}} blocked reactor thread for 66189.4us
I20260709 13:06:43.149693 24898 consensus_queue.cc:1048] T b08304a0a02b42d7840c4e8ee9a6bd1a P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.064s
I20260709 13:06:43.156015 24932 raft_consensus.cc:493] T 14935b3ddf914369822e4a0547aaa355 P 0473d2b2d01f4459b1e90fd12cc7840e [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 127766fc592545a4997f7790f50f6076)
I20260709 13:06:43.213883 19486 raft_consensus.cc:2468] T ed7fdbcb96d14d418db9ca90a792588a P 0473d2b2d01f4459b1e90fd12cc7840e [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 127766fc592545a4997f7790f50f6076 in term 12.
I20260709 13:06:43.223429 19480 raft_consensus.cc:2393] T ef32ce6fdd0e40d382c79974f30295c6 P 0473d2b2d01f4459b1e90fd12cc7840e [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e5256d91808b47c195bc9b4dbd7f2b87 in current term 19: Already voted for candidate e61c3a8f61bb48f8a963c9480e53c168 in this term.
I20260709 13:06:43.223457 19449 leader_election.cc:304] T ab43d85f64114d4ebf618930e43d9ed0 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e; no voters: 127766fc592545a4997f7790f50f6076, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:06:43.241767 19477 raft_consensus.cc:2393] T 309c3ca0ca4b4f3ba129752ea2cb293b P 0473d2b2d01f4459b1e90fd12cc7840e [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 127766fc592545a4997f7790f50f6076 in current term 11: Already voted for candidate 0473d2b2d01f4459b1e90fd12cc7840e in this term.
I20260709 13:06:43.144022 24983 consensus_queue.cc:237] T 22196caba61445d3bec98a0aab3c337d P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
W20260709 13:06:43.156972 19375 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.3:36891, user_credentials={real_user=slave}} blocked reactor thread for 549697us
I20260709 13:06:43.259624 25108 consensus_queue.cc:1048] T 48824d5acfbc485ebf8c2d944e7202de P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Connected to new peer: Peer: permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:06:43.247161 25106 raft_consensus.cc:2749] T ab43d85f64114d4ebf618930e43d9ed0 P 0473d2b2d01f4459b1e90fd12cc7840e [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:06:43.234198 25086 raft_consensus.cc:2749] T 40e1e16737a842ee936002830f36882e P e61c3a8f61bb48f8a963c9480e53c168 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:06:43.264326 19557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65d8cb8d6ec64f459d5a47cefab10acf" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 18 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:06:43.229784 24798 consensus_queue.cc:1048] T a08760e15aac4630a629431f56024dc8 P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.019s
I20260709 13:06:43.192713 25098 raft_consensus.cc:515] T 76cb037fc9064d13b59a8969d897ce8c P 0473d2b2d01f4459b1e90fd12cc7840e [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:43.271988 25096 raft_consensus.cc:493] T a08760e15aac4630a629431f56024dc8 P e61c3a8f61bb48f8a963c9480e53c168 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:43.268805 20076 leader_election.cc:304] T ed7fdbcb96d14d418db9ca90a792588a P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 127766fc592545a4997f7790f50f6076, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
W20260709 13:06:43.321714 20076 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.3:36891, user_credentials={real_user=slave}} blocked reactor thread for 53000.4us
W20260709 13:06:43.285333 25083 log.cc:927] Time spent T e381f1d6b8184797ad142de49be225a8 P e5256d91808b47c195bc9b4dbd7f2b87: Append to log took a long time: real 0.420s	user 0.000s	sys 0.002s
I20260709 13:06:43.296721 20112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62c6c134d3d24a1ab144dd9ee6bc3f64" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:06:43.297508 20107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0afb57ae58a24a01850491d69f0213dd" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:06:43.308758 20103 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46422 (request call id 903) took 1062 ms. Trace:
I20260709 13:06:43.331791 20103 rpcz_store.cc:276] 0709 13:06:42.246334 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:42.246474 (+   140us) service_pool.cc:224] Handling call
0709 13:06:42.269942 (+ 23468us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:43.145718 (+875776us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:43.308487 (+162769us) spinlock_profiling.cc:243] Waited 857 ms on lock 0x7b540036fe54. stack: 00007f4a79de9343 00007f4a79de9240 00007f4a797781d4 00007f4a834b6304 00007f4a834b6299 00007f4a7ce71571 00007f4a7cf08e01 00007f4a7cf0783e 00007f4a81ecc419 00007f4a7b443bd4 00007f4a7b443b62 00007f4a7b443a91 00007f4a7b443a0c 00007f4a7b442cc2 00007f4a7b24348c 00007f4a7b2428c6
0709 13:06:43.308688 (+   201us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1971599232}
I20260709 13:06:43.310197 19407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65d8cb8d6ec64f459d5a47cefab10acf" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 18 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
I20260709 13:06:43.333647 19407 raft_consensus.cc:3060] T 65d8cb8d6ec64f459d5a47cefab10acf P e5256d91808b47c195bc9b4dbd7f2b87 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:06:43.315022 19485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9f0d59553ad444883fcf5b5909f9798" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:06:43.230559 25085 consensus_queue.cc:237] T 3e1f505cb0f1427bbd698ac889d80821 P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:43.190161 25087 consensus_queue.cc:260] T 6c5eebf646ad445a9d1b1adc319d7b16 P e61c3a8f61bb48f8a963c9480e53c168 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.12, Last appended by leader: 12, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
W20260709 13:06:43.339578 19375 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.3:36891, user_credentials={real_user=slave}} blocked reactor thread for 84371.5us
I20260709 13:06:43.340432 20075 leader_election.cc:304] T 309c3ca0ca4b4f3ba129752ea2cb293b P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 127766fc592545a4997f7790f50f6076, e5256d91808b47c195bc9b4dbd7f2b87; no voters: 
I20260709 13:06:43.349524 19375 leader_election.cc:304] T 217b5fae677b4971b3bbd2f357a1f7ff P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:06:43.235355 24932 raft_consensus.cc:515] T 14935b3ddf914369822e4a0547aaa355 P 0473d2b2d01f4459b1e90fd12cc7840e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } attrs { replace: true } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:43.148095 25097 consensus_queue.cc:1048] T 1dc5b3532fe54f74876d02beffa2c230 P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.130s
I20260709 13:06:43.360497 25093 consensus_queue.cc:1059] T 1dc5b3532fe54f74876d02beffa2c230 P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:06:43.391866 20105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "833a2f0775ed407a94b8924ce50adb63" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:06:43.361703 19375 leader_election.cc:304] T 28af091831594f9d8e96482078cc7625 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:06:43.394289 19375 leader_election.cc:304] T ece3db938bc649d4a40a51522ed5259c P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87; no voters: 127766fc592545a4997f7790f50f6076, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:06:43.395234 19486 raft_consensus.cc:1275] T e381f1d6b8184797ad142de49be225a8 P 0473d2b2d01f4459b1e90fd12cc7840e [term 14 FOLLOWER]: Refusing update from remote peer e5256d91808b47c195bc9b4dbd7f2b87: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 13:06:43.390040 25107 raft_consensus.cc:493] T d1e5873a19244c5ebbcd38e126796ee7 P 0473d2b2d01f4459b1e90fd12cc7840e [term 17 FOLLOWER]: Starting pre-election (detected failure of leader e61c3a8f61bb48f8a963c9480e53c168)
I20260709 13:06:43.398635 25107 raft_consensus.cc:515] T d1e5873a19244c5ebbcd38e126796ee7 P 0473d2b2d01f4459b1e90fd12cc7840e [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:43.400331 25100 consensus_queue.cc:1048] T 40e1e16737a842ee936002830f36882e P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.049s
I20260709 13:06:43.401746 24626 raft_consensus.cc:2804] T 309c3ca0ca4b4f3ba129752ea2cb293b P 127766fc592545a4997f7790f50f6076 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:06:43.402235 24626 raft_consensus.cc:697] T 309c3ca0ca4b4f3ba129752ea2cb293b P 127766fc592545a4997f7790f50f6076 [term 11 LEADER]: Becoming Leader. State: Replica: 127766fc592545a4997f7790f50f6076, State: Running, Role: LEADER
I20260709 13:06:43.403030 24626 consensus_queue.cc:237] T 309c3ca0ca4b4f3ba129752ea2cb293b P 127766fc592545a4997f7790f50f6076 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.10, Last appended by leader: 10, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:43.406064 20107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed7fdbcb96d14d418db9ca90a792588a" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:06:43.411239 25063 leader_election.cc:290] T f93ee515a9c14139bf566522ed8232f3 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 17 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:06:43.324611 25091 leader_election.cc:290] T edd7d470b5014c9489be7f41f64355c9 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:06:43.239902 25051 raft_consensus.cc:515] T 22196caba61445d3bec98a0aab3c337d P e61c3a8f61bb48f8a963c9480e53c168 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
W20260709 13:06:43.317062 25088 log.cc:927] Time spent T ef32ce6fdd0e40d382c79974f30295c6 P e61c3a8f61bb48f8a963c9480e53c168: Append to log took a long time: real 0.231s	user 0.001s	sys 0.000s
I20260709 13:06:43.387156 19477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e5873a19244c5ebbcd38e126796ee7" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:06:43.435041 19477 raft_consensus.cc:2468] T d1e5873a19244c5ebbcd38e126796ee7 P 0473d2b2d01f4459b1e90fd12cc7840e [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 17.
I20260709 13:06:43.325160 24875 leader_election.cc:290] T 4509b76741dc428e9201c70c1658da13 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:06:43.400681 25107 leader_election.cc:290] T d1e5873a19244c5ebbcd38e126796ee7 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
W20260709 13:06:43.379539 19526 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.677s	user 0.011s	sys 0.007s
I20260709 13:06:43.384253 19485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edd7d470b5014c9489be7f41f64355c9" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:06:43.459853 19559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4509b76741dc428e9201c70c1658da13" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
W20260709 13:06:43.459888 19526 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.757s	user 0.011s	sys 0.007s
W20260709 13:06:43.460872 19526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.2:46257, user_credentials={real_user=slave}} blocked reactor thread for 758241us
I20260709 13:06:43.461404 19559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f93ee515a9c14139bf566522ed8232f3" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:06:43.462294 19559 raft_consensus.cc:2368] T f93ee515a9c14139bf566522ed8232f3 P e61c3a8f61bb48f8a963c9480e53c168 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 0473d2b2d01f4459b1e90fd12cc7840e for earlier term 17. Current term is 18.
I20260709 13:06:43.420944 19375 leader_election.cc:304] T 22196caba61445d3bec98a0aab3c337d P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168; no voters: 0473d2b2d01f4459b1e90fd12cc7840e
I20260709 13:06:43.428450 25052 leader_election.cc:290] T 217b5fae677b4971b3bbd2f357a1f7ff P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
W20260709 13:06:43.429844 25080 log.cc:927] Time spent T fa8650e71aa14778b3d73721fc50d9fc P e61c3a8f61bb48f8a963c9480e53c168: Append to log took a long time: real 0.618s	user 0.000s	sys 0.001s
I20260709 13:06:43.431209 25071 raft_consensus.cc:493] T 7be9efa6559648dbb5a0f7684c4542d1 P 127766fc592545a4997f7790f50f6076 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:43.499624 19556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef32ce6fdd0e40d382c79974f30295c6" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:06:43.432962 25090 raft_consensus.cc:2749] T 28af091831594f9d8e96482078cc7625 P e5256d91808b47c195bc9b4dbd7f2b87 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:06:43.352550 25075 raft_consensus.cc:2804] T ed7fdbcb96d14d418db9ca90a792588a P 127766fc592545a4997f7790f50f6076 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:06:43.436517 19407 raft_consensus.cc:2468] T 65d8cb8d6ec64f459d5a47cefab10acf P e5256d91808b47c195bc9b4dbd7f2b87 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 127766fc592545a4997f7790f50f6076 in term 18.
I20260709 13:06:43.437299 19557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e1085d23e8347fbbd5bce7542f4b1f4" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:06:43.326092 24990 leader_election.cc:290] T ef32ce6fdd0e40d382c79974f30295c6 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:06:43.314579 24931 leader_election.cc:290] T 1efebf73c86e432baa55533136b6e12c P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
W20260709 13:06:43.456346 19523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.1:40321, user_credentials={real_user=slave}} blocked reactor thread for 201140us
I20260709 13:06:43.351284 24482 raft_consensus.cc:493] T 2a16f7501e2444fb86d4e2778e734e02 P 127766fc592545a4997f7790f50f6076 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader e61c3a8f61bb48f8a963c9480e53c168)
I20260709 13:06:43.352797 25094 raft_consensus.cc:2749] T 217b5fae677b4971b3bbd2f357a1f7ff P e5256d91808b47c195bc9b4dbd7f2b87 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:06:43.464566 19450 leader_election.cc:400] T f93ee515a9c14139bf566522ed8232f3 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 17 election: Vote denied by peer e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891) with higher term. Message: Invalid argument: T f93ee515a9c14139bf566522ed8232f3 P e61c3a8f61bb48f8a963c9480e53c168 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 0473d2b2d01f4459b1e90fd12cc7840e for earlier term 17. Current term is 18.
I20260709 13:06:43.530303 19450 leader_election.cc:403] T f93ee515a9c14139bf566522ed8232f3 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 17 election: Cancelling election due to peer responding with higher term
I20260709 13:06:43.465879 19555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e5873a19244c5ebbcd38e126796ee7" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:06:43.461720 19526 leader_election.cc:304] T 7be9efa6559648dbb5a0f7684c4542d1 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: e61c3a8f61bb48f8a963c9480e53c168; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, 127766fc592545a4997f7790f50f6076
I20260709 13:06:43.470292 24866 leader_election.cc:290] T b9f0d59553ad444883fcf5b5909f9798 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:06:43.501981 24926 leader_election.cc:290] T ff9b0eddd810459b82d91c60777c10eb P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
W20260709 13:06:43.382136 24790 consensus_queue.cc:1175] T 6c5eebf646ad445a9d1b1adc319d7b16 P e61c3a8f61bb48f8a963c9480e53c168 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "127766fc592545a4997f7790f50f6076" responder_term: 15 status { last_received { term: 13 index: 11 } last_committed_idx: 10 error { code: PRECEDING_ENTRY_DIDNT_MATCH status { code: ILLEGAL_STATE message: "Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)" } } last_received_current_leader { term: 0 index: 0 } }
W20260709 13:06:43.505053 20075 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.1:40321, user_credentials={real_user=slave}} blocked reactor thread for 164735us
I20260709 13:06:43.325242 25096 raft_consensus.cc:515] T a08760e15aac4630a629431f56024dc8 P e61c3a8f61bb48f8a963c9480e53c168 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:43.693027 19407 raft_consensus.cc:1275] T 86a6797bdfe94fa496c050ceae4bd0d9 P e5256d91808b47c195bc9b4dbd7f2b87 [term 12 FOLLOWER]: Refusing update from remote peer 0473d2b2d01f4459b1e90fd12cc7840e: Log matching property violated. Preceding OpId in replica: term: 10 index: 5. Preceding OpId from leader: term: 12 index: 6. (index mismatch)
I20260709 13:06:43.693367 19408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14efcc79969f41babe5529c22d59156d" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
W20260709 13:06:43.518600 19375 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.3:36891, user_credentials={real_user=slave}} blocked reactor thread for 97741.7us
I20260709 13:06:43.699508 19375 leader_election.cc:304] T 76cb037fc9064d13b59a8969d897ce8c P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:06:43.701108 19375 leader_election.cc:304] T fa731b585f684a7fb2d106c50f143b83 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87; no voters: 127766fc592545a4997f7790f50f6076, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:06:43.463588 25100 raft_consensus.cc:2749] T ece3db938bc649d4a40a51522ed5259c P e5256d91808b47c195bc9b4dbd7f2b87 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:06:43.466089 19485 raft_consensus.cc:2393] T edd7d470b5014c9489be7f41f64355c9 P 0473d2b2d01f4459b1e90fd12cc7840e [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e5256d91808b47c195bc9b4dbd7f2b87 in current term 17: Already voted for candidate 0473d2b2d01f4459b1e90fd12cc7840e in this term.
I20260709 13:06:43.622417 25089 raft_consensus.cc:493] T 0cdf56e38bbc453d9438d359e5a69955 P e5256d91808b47c195bc9b4dbd7f2b87 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 0473d2b2d01f4459b1e90fd12cc7840e)
I20260709 13:06:43.719936 19375 leader_election.cc:304] T f93ee515a9c14139bf566522ed8232f3 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:06:43.721138 19375 leader_election.cc:304] T df751f992649444090e27965eb1af85d P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168
W20260709 13:06:43.530977 19526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.2:46257, user_credentials={real_user=slave}} blocked reactor thread for 69327.9us
W20260709 13:06:43.474618 19449 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.4:43121, user_credentials={real_user=slave}} blocked reactor thread for 238980us
I20260709 13:06:43.497921 19558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96efeaaf1057492490e9a621f37e1a2d" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
W20260709 13:06:43.533012 19450 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.3:36891, user_credentials={real_user=slave}} blocked reactor thread for 68575.2us
I20260709 13:06:43.538057 24990 raft_consensus.cc:3060] T f93ee515a9c14139bf566522ed8232f3 P 0473d2b2d01f4459b1e90fd12cc7840e [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:06:43.540243 25098 leader_election.cc:290] T 76cb037fc9064d13b59a8969d897ce8c P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:06:43.541121 19552 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40428 (request call id 2973) took 1419 ms. Trace:
I20260709 13:06:43.736321 19552 rpcz_store.cc:276] 0709 13:06:42.121953 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:42.123114 (+  1161us) service_pool.cc:224] Handling call
0709 13:06:42.123445 (+   331us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:42.155960 (+ 32515us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:42.155991 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:42.156443 (+   452us) log.cc:844] Serialized 26 byte log entry
0709 13:06:42.378984 (+222541us) spinlock_profiling.cc:243] Waited 14.7 ms on lock 0x7b1800059ce0. stack: 00007f4a79de9343 00007f4a79de9240 00007f4a797781d4 00007f4a834b6304 00007f4a834b6299 00007f4a82ce3de1 00007f4a82cf05b1 00007f4a79dfde07 00007f4a82c58ab9 00007f4a79e1a69b 00007f4a79e1893f 00007f4a79e1ac02 00007f4a7caa220b 00007f4a7caa7d23 00007f4a7caa80d1 00007f4a7cec3a0f
0709 13:06:42.548057 (+169073us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:06:42.548094 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:42.548154 (+    60us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:43.429257 (+881103us) spinlock_profiling.cc:243] Waited 8.98 ms on lock 0x7b4400022b4c. stack: 00007f4a79de9343 00007f4a79de9240 00007f4a797781d4 00007f4a834b6304 00007f4a834b6299 00007f4a79ca3db1 00007f4a79d41c85 00007f4a79d426a2 00007f4a7cab41db 00007f4a7caafaaf 00007f4a7caa386e 00007f4a7caa2bb6 00007f4a7caa27d8 00007f4a7caac221 00007f4a7caac1d9 00007f4a7caac169
0709 13:06:43.540896 (+111639us) raft_consensus.cc:1685] finished
0709 13:06:43.540916 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:43.541042 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":55012,"raft.queue_time_us":28610,"raft.run_cpu_time_us":124,"raft.run_wall_time_us":5063,"spinlock_wait_cycles":54380800,"thread_start_us":168901,"threads_started":1,"wal-append.queue_time_us":462818}
I20260709 13:06:43.542567 24932 leader_election.cc:290] T 14935b3ddf914369822e4a0547aaa355 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
W20260709 13:06:43.545150 25081 log.cc:927] Time spent T 0cdf56e38bbc453d9438d359e5a69955 P e61c3a8f61bb48f8a963c9480e53c168: Append to log took a long time: real 0.602s	user 0.003s	sys 0.003s
W20260709 13:06:43.548185 19374 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:43.553460 25018 leader_election.cc:290] T 0e1085d23e8347fbbd5bce7542f4b1f4 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:06:43.740142 19408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef32ce6fdd0e40d382c79974f30295c6" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:06:43.561417 24943 leader_election.cc:290] T 775c229504194560ba9589bc2199b089 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:06:43.532859 24482 raft_consensus.cc:515] T 2a16f7501e2444fb86d4e2778e734e02 P 127766fc592545a4997f7790f50f6076 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:43.740921 19408 raft_consensus.cc:2468] T ef32ce6fdd0e40d382c79974f30295c6 P e5256d91808b47c195bc9b4dbd7f2b87 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 18.
I20260709 13:06:43.742976 24482 leader_election.cc:290] T 2a16f7501e2444fb86d4e2778e734e02 P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:06:43.532970 24931 raft_consensus.cc:2749] T 7be9efa6559648dbb5a0f7684c4542d1 P e61c3a8f61bb48f8a963c9480e53c168 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:06:43.562980 19404 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52328 (request call id 2346) took 1108 ms. Trace:
I20260709 13:06:43.565201 25086 raft_consensus.cc:493] T 46c5bfeecc314717bffe987e6844b6d0 P e61c3a8f61bb48f8a963c9480e53c168 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:43.526988 25084 raft_consensus.cc:2804] T 22196caba61445d3bec98a0aab3c337d P e5256d91808b47c195bc9b4dbd7f2b87 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:06:43.745735 25084 raft_consensus.cc:493] T 22196caba61445d3bec98a0aab3c337d P e5256d91808b47c195bc9b4dbd7f2b87 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:43.745512 25086 raft_consensus.cc:515] T 46c5bfeecc314717bffe987e6844b6d0 P e61c3a8f61bb48f8a963c9480e53c168 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:43.746116 25084 raft_consensus.cc:3060] T 22196caba61445d3bec98a0aab3c337d P e5256d91808b47c195bc9b4dbd7f2b87 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:06:43.566922 24971 leader_election.cc:290] T 96efeaaf1057492490e9a621f37e1a2d P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 18 election: Requested vote from peers e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:06:43.568768 25058 consensus_queue.cc:1059] T 65d8cb8d6ec64f459d5a47cefab10acf P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:06:43.527112 25091 consensus_queue.cc:1048] T e381f1d6b8184797ad142de49be225a8 P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.048s
I20260709 13:06:43.572345 25038 leader_election.cc:290] T f1b10566f45d4a7d9029858330e02d5b P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:06:43.512424 24573 leader_election.cc:290] T 2e36a9d6e29c4a7c860cf267efbd4c74 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:06:43.512925 24996 leader_election.cc:290] T d1e5873a19244c5ebbcd38e126796ee7 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
W20260709 13:06:43.623473 25020 consensus_meta.cc:287] T 1f85fc4b527a48848e5faa083b604e36 P e5256d91808b47c195bc9b4dbd7f2b87: Time spent flushing consensus metadata: real 0.898s	user 0.011s	sys 0.000s
I20260709 13:06:43.752458 25020 raft_consensus.cc:515] T 1f85fc4b527a48848e5faa083b604e36 P e5256d91808b47c195bc9b4dbd7f2b87 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:43.745329 19404 rpcz_store.cc:276] 0709 13:06:42.454735 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:42.457674 (+  2939us) service_pool.cc:224] Handling call
0709 13:06:43.562774 (+1105100us) spinlock_profiling.cc:243] Waited 895 ms on lock 0x7b54001d9f54. stack: 00007f4a79de9343 00007f4a79de9240 00007f4a797781d4 00007f4a834b6304 00007f4a834b6299 00007f4a7ce71571 00007f4a7cf0c2fa 00007f4a81ecdb17 00007f4a7b4486d4 00007f4a7b448662 00007f4a7b448591 00007f4a7b44850c 00007f4a7b4477c2 00007f4a7b24348c 00007f4a7b2428c6 00007f4a7b24226f
0709 13:06:43.562897 (+   123us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2057728768}
I20260709 13:06:43.532186 25121 raft_consensus.cc:493] T edd7d470b5014c9489be7f41f64355c9 P e61c3a8f61bb48f8a963c9480e53c168 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:43.756264 25121 raft_consensus.cc:515] T edd7d470b5014c9489be7f41f64355c9 P e61c3a8f61bb48f8a963c9480e53c168 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:43.759689 25020 leader_election.cc:290] T 1f85fc4b527a48848e5faa083b604e36 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 14 election: Requested vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
W20260709 13:06:43.570659 25062 consensus_meta.cc:287] T ff75a1d4cb1f493db8f71ddc136ba9ab P 0473d2b2d01f4459b1e90fd12cc7840e: Time spent flushing consensus metadata: real 0.941s	user 0.008s	sys 0.003s
I20260709 13:06:43.761942 25062 raft_consensus.cc:2749] T ff75a1d4cb1f493db8f71ddc136ba9ab P 0473d2b2d01f4459b1e90fd12cc7840e [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:06:43.763547 19482 raft_consensus.cc:1240] T ff75a1d4cb1f493db8f71ddc136ba9ab P 0473d2b2d01f4459b1e90fd12cc7840e [term 16 FOLLOWER]: Rejecting Update request from peer e5256d91808b47c195bc9b4dbd7f2b87 for earlier term 15. Current term is 16. Ops: []
I20260709 13:06:43.764073 25121 leader_election.cc:290] T edd7d470b5014c9489be7f41f64355c9 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:06:43.508390 25075 raft_consensus.cc:493] T ed7fdbcb96d14d418db9ca90a792588a P 127766fc592545a4997f7790f50f6076 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:43.774932 25075 raft_consensus.cc:3060] T ed7fdbcb96d14d418db9ca90a792588a P 127766fc592545a4997f7790f50f6076 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:06:43.525533 25061 consensus_meta.cc:287] T 70797e5783b5454ab0d0eea663e791e3 P e5256d91808b47c195bc9b4dbd7f2b87: Time spent flushing consensus metadata: real 1.125s	user 0.010s	sys 0.003s
I20260709 13:06:43.687649 20104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1efebf73c86e432baa55533136b6e12c" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:06:43.513441 25071 raft_consensus.cc:515] T 7be9efa6559648dbb5a0f7684c4542d1 P 127766fc592545a4997f7790f50f6076 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } attrs { replace: true } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:43.780980 20105 raft_consensus.cc:1275] T 7be9efa6559648dbb5a0f7684c4542d1 P 127766fc592545a4997f7790f50f6076 [term 15 FOLLOWER]: Refusing update from remote peer e5256d91808b47c195bc9b4dbd7f2b87: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 13:06:43.730559 19554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e36a9d6e29c4a7c860cf267efbd4c74" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:06:43.787432 19554 raft_consensus.cc:2468] T 2e36a9d6e29c4a7c860cf267efbd4c74 P e61c3a8f61bb48f8a963c9480e53c168 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 11.
I20260709 13:06:43.730718 19375 leader_election.cc:304] T 2a16f7501e2444fb86d4e2778e734e02 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87; no voters: 127766fc592545a4997f7790f50f6076, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:06:43.733748 19557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14935b3ddf914369822e4a0547aaa355" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:06:43.735574 19526 leader_election.cc:304] T 62c6c134d3d24a1ab144dd9ee6bc3f64 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e61c3a8f61bb48f8a963c9480e53c168; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, 127766fc592545a4997f7790f50f6076
I20260709 13:06:43.737744 19409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff9b0eddd810459b82d91c60777c10eb" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:06:43.557114 24970 consensus_queue.cc:260] T 7f575b143b844aa096b50997dad3516a P e61c3a8f61bb48f8a963c9480e53c168 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:43.740916 19553 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40428 (request call id 2974) took 1618 ms. Trace:
I20260709 13:06:43.793465 19404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "775c229504194560ba9589bc2199b089" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:06:43.723847 24825 raft_consensus.cc:2749] T fa731b585f684a7fb2d106c50f143b83 P e5256d91808b47c195bc9b4dbd7f2b87 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:06:43.725521 24866 raft_consensus.cc:2749] T 76cb037fc9064d13b59a8969d897ce8c P e5256d91808b47c195bc9b4dbd7f2b87 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:06:43.789086 19555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76cb037fc9064d13b59a8969d897ce8c" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:06:43.789422 19407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4509b76741dc428e9201c70c1658da13" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:06:43.790954 24930 raft_consensus.cc:493] T 172b3dd13109415a955b71ac0e9d2234 P 0473d2b2d01f4459b1e90fd12cc7840e [term 14 FOLLOWER]: Starting pre-election (detected failure of leader e5256d91808b47c195bc9b4dbd7f2b87)
W20260709 13:06:43.792641 20075 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.1:40321, user_credentials={real_user=slave}} blocked reactor thread for 73152.2us
I20260709 13:06:43.716900 24946 raft_consensus.cc:493] T 48824d5acfbc485ebf8c2d944e7202de P 127766fc592545a4997f7790f50f6076 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:43.793761 19553 rpcz_store.cc:276] 0709 13:06:42.122229 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:42.122341 (+   112us) service_pool.cc:224] Handling call
0709 13:06:42.122774 (+   433us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:42.169307 (+ 46533us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:42.169365 (+    58us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:42.188264 (+ 18899us) log.cc:844] Serialized 26 byte log entry
0709 13:06:42.387354 (+199090us) spinlock_profiling.cc:243] Waited 13.3 ms on lock 0x7b18003aec40. stack: 00007f4a79de9343 00007f4a79de9240 00007f4a797781d4 00007f4a834b6304 00007f4a834b6299 00007f4a82ce3de1 00007f4a82cf05b1 00007f4a79dfde07 00007f4a82c58ab9 00007f4a79e1a69b 00007f4a79e1893f 00007f4a79e1ac02 00007f4a7caa220b 00007f4a7caa7d23 00007f4a7caa80d1 00007f4a7cec3a0f
0709 13:06:42.650511 (+263157us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:06:42.650551 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:42.650616 (+    65us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:43.544562 (+893946us) spinlock_profiling.cc:243] Waited 13.1 ms on lock 0x7b4400022b4c. stack: 00007f4a79de9343 00007f4a79de9240 00007f4a797781d4 00007f4a834b6304 00007f4a834b6299 00007f4a79ca3db1 00007f4a79d41c85 00007f4a79d426a2 00007f4a7cab41db 00007f4a7caafaaf 00007f4a7caa386e 00007f4a7caa2bb6 00007f4a7caa27d8 00007f4a7caac221 00007f4a7caac1d9 00007f4a7caac169
0709 13:06:43.740729 (+196167us) raft_consensus.cc:1685] finished
0709 13:06:43.740750 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:43.740865 (+   115us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":14046,"raft.queue_time_us":38462,"raft.run_cpu_time_us":134,"raft.run_wall_time_us":9946,"spinlock_wait_cycles":60822784,"thread_start_us":262974,"threads_started":1,"wal-append.queue_time_us":665554}
W20260709 13:06:43.799991 19377 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.2:46257, user_credentials={real_user=slave}} blocked reactor thread for 361018us
W20260709 13:06:43.800988 19375 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.3:36891, user_credentials={real_user=slave}} blocked reactor thread for 70363.1us
I20260709 13:06:43.800638 20075 leader_election.cc:304] T ece3db938bc649d4a40a51522ed5259c P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 127766fc592545a4997f7790f50f6076, e5256d91808b47c195bc9b4dbd7f2b87; no voters: e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:06:43.805589 19404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f93ee515a9c14139bf566522ed8232f3" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
I20260709 13:06:43.808805 19557 raft_consensus.cc:1275] T e381f1d6b8184797ad142de49be225a8 P e61c3a8f61bb48f8a963c9480e53c168 [term 14 FOLLOWER]: Refusing update from remote peer e5256d91808b47c195bc9b4dbd7f2b87: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 13:06:43.809841 19553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b74109013a140ada21feeef92d6f563" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:06:43.810985 19553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9f0d59553ad444883fcf5b5909f9798" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:06:43.813143 19479 raft_consensus.cc:1275] T 7be9efa6559648dbb5a0f7684c4542d1 P 0473d2b2d01f4459b1e90fd12cc7840e [term 15 FOLLOWER]: Refusing update from remote peer e5256d91808b47c195bc9b4dbd7f2b87: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 13:06:43.814131 19485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1b10566f45d4a7d9029858330e02d5b" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:06:43.814824 19485 raft_consensus.cc:2468] T f1b10566f45d4a7d9029858330e02d5b P 0473d2b2d01f4459b1e90fd12cc7840e [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 15.
I20260709 13:06:43.816367 20104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f85fc4b527a48848e5faa083b604e36" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076"
W20260709 13:06:43.816491 20078 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.2:46257, user_credentials={real_user=slave}} blocked reactor thread for 464301us
I20260709 13:06:43.817184 20078 leader_election.cc:304] T 14efcc79969f41babe5529c22d59156d P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, 127766fc592545a4997f7790f50f6076; no voters: 
I20260709 13:06:43.819043 19557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e5873a19244c5ebbcd38e126796ee7" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
W20260709 13:06:43.821458 19526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.2:46257, user_credentials={real_user=slave}} blocked reactor thread for 85942.3us
I20260709 13:06:43.825261 20078 leader_election.cc:304] T 1efebf73c86e432baa55533136b6e12c P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 127766fc592545a4997f7790f50f6076; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:06:43.827231 19409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e5873a19244c5ebbcd38e126796ee7" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:06:43.827461 19557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1b10566f45d4a7d9029858330e02d5b" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:06:43.828088 19409 raft_consensus.cc:2468] T d1e5873a19244c5ebbcd38e126796ee7 P e5256d91808b47c195bc9b4dbd7f2b87 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 17.
I20260709 13:06:43.798336 25067 raft_consensus.cc:3060] T f93ee515a9c14139bf566522ed8232f3 P e5256d91808b47c195bc9b4dbd7f2b87 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:06:43.830062 19407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e36a9d6e29c4a7c860cf267efbd4c74" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
W20260709 13:06:43.815616 24964 consensus_meta.cc:287] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P e5256d91808b47c195bc9b4dbd7f2b87: Time spent flushing consensus metadata: real 1.004s	user 0.011s	sys 0.000s
I20260709 13:06:43.831106 19477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f85fc4b527a48848e5faa083b604e36" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:06:43.837675 19408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df751f992649444090e27965eb1af85d" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
I20260709 13:06:43.837930 19409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76cb037fc9064d13b59a8969d897ce8c" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
I20260709 13:06:43.849723 19409 raft_consensus.cc:2393] T 76cb037fc9064d13b59a8969d897ce8c P e5256d91808b47c195bc9b4dbd7f2b87 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate e61c3a8f61bb48f8a963c9480e53c168 in current term 14: Already voted for candidate e5256d91808b47c195bc9b4dbd7f2b87 in this term.
I20260709 13:06:43.850654 19409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "217b5fae677b4971b3bbd2f357a1f7ff" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:06:43.851926 19409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76cb037fc9064d13b59a8969d897ce8c" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:06:43.838264 19410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "833a2f0775ed407a94b8924ce50adb63" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:06:43.853719 19410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f93ee515a9c14139bf566522ed8232f3" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 18 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
I20260709 13:06:43.814344 24970 raft_consensus.cc:3060] T 7f575b143b844aa096b50997dad3516a P e61c3a8f61bb48f8a963c9480e53c168 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:06:43.798148 25100 raft_consensus.cc:2749] T df751f992649444090e27965eb1af85d P e5256d91808b47c195bc9b4dbd7f2b87 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:06:43.838898 19405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86a6797bdfe94fa496c050ceae4bd0d9" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 13 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:06:43.856774 19406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dc5b3532fe54f74876d02beffa2c230" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 18 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:06:43.862581 19405 raft_consensus.cc:2468] T 86a6797bdfe94fa496c050ceae4bd0d9 P e5256d91808b47c195bc9b4dbd7f2b87 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 12.
I20260709 13:06:43.852519 19409 raft_consensus.cc:2468] T 76cb037fc9064d13b59a8969d897ce8c P e5256d91808b47c195bc9b4dbd7f2b87 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 14.
I20260709 13:06:43.814855 25061 raft_consensus.cc:2749] T 2a16f7501e2444fb86d4e2778e734e02 P e5256d91808b47c195bc9b4dbd7f2b87 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:06:43.825644 24700 raft_consensus.cc:2749] T 62c6c134d3d24a1ab144dd9ee6bc3f64 P e61c3a8f61bb48f8a963c9480e53c168 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:06:43.731447 25089 raft_consensus.cc:515] T 0cdf56e38bbc453d9438d359e5a69955 P e5256d91808b47c195bc9b4dbd7f2b87 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:43.835620 24626 raft_consensus.cc:2804] T ece3db938bc649d4a40a51522ed5259c P 127766fc592545a4997f7790f50f6076 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:06:43.870836 19407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e381f1d6b8184797ad142de49be225a8" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:06:43.840106 24482 raft_consensus.cc:2804] T 14efcc79969f41babe5529c22d59156d P 127766fc592545a4997f7790f50f6076 [term 16 FOLLOWER]: Leader pre-election won for term 17
W20260709 13:06:43.803843 24837 consensus_queue.cc:1175] T 7f575b143b844aa096b50997dad3516a P e61c3a8f61bb48f8a963c9480e53c168 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" responder_term: 12 status { last_received { term: 11 index: 9 } last_committed_idx: 8 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer e61c3a8f61bb48f8a963c9480e53c168 for earlier term 11. Current term is 12. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 13:06:43.862006 25094 raft_consensus.cc:493] T 4af19371ea874c09a0a2147040835cbb P e5256d91808b47c195bc9b4dbd7f2b87 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 127766fc592545a4997f7790f50f6076)
I20260709 13:06:43.890978 19408 raft_consensus.cc:2368] T df751f992649444090e27965eb1af85d P e5256d91808b47c195bc9b4dbd7f2b87 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate e61c3a8f61bb48f8a963c9480e53c168 for earlier term 18. Current term is 19.
I20260709 13:06:43.901623 19403 raft_consensus.cc:3055] T 1dc5b3532fe54f74876d02beffa2c230 P e5256d91808b47c195bc9b4dbd7f2b87 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:06:43.823561 24946 raft_consensus.cc:515] T 48824d5acfbc485ebf8c2d944e7202de P 127766fc592545a4997f7790f50f6076 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:43.860039 25105 raft_consensus.cc:493] T 7f575b143b844aa096b50997dad3516a P e5256d91808b47c195bc9b4dbd7f2b87 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader e61c3a8f61bb48f8a963c9480e53c168)
I20260709 13:06:43.904208 19449 leader_election.cc:304] T 5ec1c4ce15e04c7e8c283a62179f2a64 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e; no voters: 127766fc592545a4997f7790f50f6076, e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:06:43.871569 25125 raft_consensus.cc:2749] T 1efebf73c86e432baa55533136b6e12c P 127766fc592545a4997f7790f50f6076 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 13:06:43.889657 19375 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.3:36891, user_credentials={real_user=slave}} blocked reactor thread for 44974.3us
I20260709 13:06:43.916527 19375 leader_election.cc:304] T 2b74109013a140ada21feeef92d6f563 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:06:43.815236 24930 raft_consensus.cc:515] T 172b3dd13109415a955b71ac0e9d2234 P 0473d2b2d01f4459b1e90fd12cc7840e [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:43.870797 24996 raft_consensus.cc:493] T 2725d2c4cb054f18b0fc8f735c15f6c2 P e5256d91808b47c195bc9b4dbd7f2b87 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader e61c3a8f61bb48f8a963c9480e53c168)
I20260709 13:06:43.872139 25051 leader_election.cc:290] T 22196caba61445d3bec98a0aab3c337d P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 15 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:06:43.892300 24825 raft_consensus.cc:493] T 46c5bfeecc314717bffe987e6844b6d0 P e5256d91808b47c195bc9b4dbd7f2b87 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:43.892272 24626 raft_consensus.cc:493] T ece3db938bc649d4a40a51522ed5259c P 127766fc592545a4997f7790f50f6076 [term 12 FOLLOWER]: Starting leader election (detected failure of leader e61c3a8f61bb48f8a963c9480e53c168)
W20260709 13:06:43.913048 19524 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:43.908681 19403 raft_consensus.cc:740] T 1dc5b3532fe54f74876d02beffa2c230 P e5256d91808b47c195bc9b4dbd7f2b87 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: e5256d91808b47c195bc9b4dbd7f2b87, State: Running, Role: LEADER
I20260709 13:06:43.889364 24824 raft_consensus.cc:493] T 21e14947d70440f19044d8f75c31e1f9 P e5256d91808b47c195bc9b4dbd7f2b87 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader e61c3a8f61bb48f8a963c9480e53c168)
I20260709 13:06:43.926384 25100 raft_consensus.cc:2749] T 2b74109013a140ada21feeef92d6f563 P e5256d91808b47c195bc9b4dbd7f2b87 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
W20260709 13:06:43.929811 19524 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:43.930994 20078 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.2:46257, user_credentials={real_user=slave}} blocked reactor thread for 105805us
W20260709 13:06:43.919965 19526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.2:46257, user_credentials={real_user=slave}} blocked reactor thread for 97633.1us
W20260709 13:06:43.914109 25130 log.cc:927] Time spent T 46c5bfeecc314717bffe987e6844b6d0 P 0473d2b2d01f4459b1e90fd12cc7840e: Append to log took a long time: real 0.058s	user 0.000s	sys 0.000s
I20260709 13:06:43.902930 24482 raft_consensus.cc:493] T 14efcc79969f41babe5529c22d59156d P 127766fc592545a4997f7790f50f6076 [term 16 FOLLOWER]: Starting leader election (detected failure of leader e5256d91808b47c195bc9b4dbd7f2b87)
I20260709 13:06:43.858253 24964 raft_consensus.cc:515] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P e5256d91808b47c195bc9b4dbd7f2b87 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:43.918946 19449 leader_election.cc:304] T 309c3ca0ca4b4f3ba129752ea2cb293b P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168; no voters: 127766fc592545a4997f7790f50f6076, e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:06:43.940871 19377 leader_election.cc:304] T d1e5873a19244c5ebbcd38e126796ee7 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87; no voters: 
I20260709 13:06:43.941982 19449 leader_election.cc:304] T 6c5eebf646ad445a9d1b1adc319d7b16 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, 127766fc592545a4997f7790f50f6076; no voters: e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:06:43.942175 19377 leader_election.cc:304] T ef32ce6fdd0e40d382c79974f30295c6 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:06:43.912112 19407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14935b3ddf914369822e4a0547aaa355" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:06:43.925518 19411 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52342 (request call id 2934) took 1381 ms. Trace:
I20260709 13:06:43.927006 19375 leader_election.cc:304] T b9f0d59553ad444883fcf5b5909f9798 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:06:43.928930 19403 consensus_queue.cc:260] T 1dc5b3532fe54f74876d02beffa2c230 P e5256d91808b47c195bc9b4dbd7f2b87 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 16.9, Last appended by leader: 9, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:43.900550 25018 consensus_queue.cc:1048] T 86a6797bdfe94fa496c050ceae4bd0d9 P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.028s
I20260709 13:06:43.880751 25084 raft_consensus.cc:515] T 22196caba61445d3bec98a0aab3c337d P e5256d91808b47c195bc9b4dbd7f2b87 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:43.942848 19411 rpcz_store.cc:276] 0709 13:06:42.543647 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:42.543851 (+   204us) service_pool.cc:224] Handling call
0709 13:06:42.631324 (+ 87473us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:43.289231 (+657907us) spinlock_profiling.cc:243] Waited 5.01 ms on lock 0x7b18004364e0. stack: 00007f4a79de9343 00007f4a79de9240 00007f4a797781d4 00007f4a834b6304 00007f4a834b6299 00007f4a82ce3de1 00007f4a82cf05b1 00007f4a7cab04bc 00007f4a79dfe48b 00007f4a82c58ab9 00007f4a79e1a69b 00007f4a79e1893f 00007f4a79e18455 00007f4a7cf00060 00007f4a7cf00bfb 00007f4a7cf0b64b
0709 13:06:43.289377 (+   146us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:43.289404 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:43.289945 (+   541us) log.cc:844] Serialized 26 byte log entry
0709 13:06:43.609600 (+319655us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:06:43.609664 (+    64us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:43.609781 (+   117us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:43.915754 (+305973us) raft_consensus.cc:1685] finished
0709 13:06:43.915780 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:43.925436 (+  9656us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":148,"raft.queue_time_us":190440,"raft.run_cpu_time_us":213,"raft.run_wall_time_us":37650,"spinlock_wait_cycles":11532672,"thread_start_us":563261,"threads_started":2,"wal-append.queue_time_us":549906}
I20260709 13:06:43.944428 19403 raft_consensus.cc:3060] T 1dc5b3532fe54f74876d02beffa2c230 P e5256d91808b47c195bc9b4dbd7f2b87 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:06:43.954249 20104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14efcc79969f41babe5529c22d59156d" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:06:43.945798 19526 leader_election.cc:304] T 0afb57ae58a24a01850491d69f0213dd P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e61c3a8f61bb48f8a963c9480e53c168; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, 127766fc592545a4997f7790f50f6076
I20260709 13:06:43.956027 25058 raft_consensus.cc:2749] T 0afb57ae58a24a01850491d69f0213dd P e61c3a8f61bb48f8a963c9480e53c168 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:06:43.957330 18300 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
W20260709 13:06:43.946941 20075 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.1:40321, user_credentials={real_user=slave}} blocked reactor thread for 121007us
W20260709 13:06:43.951162 20076 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:43.943986 19377 leader_election.cc:304] T f1b10566f45d4a7d9029858330e02d5b P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87; no voters: 
I20260709 13:06:43.959452 20075 leader_election.cc:304] T 65d8cb8d6ec64f459d5a47cefab10acf P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 127766fc592545a4997f7790f50f6076, e5256d91808b47c195bc9b4dbd7f2b87; no voters: e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:06:43.959753 18300 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:06:43.960975 19449 leader_election.cc:304] T ef32ce6fdd0e40d382c79974f30295c6 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87; no voters: e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:06:43.961583 20104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14935b3ddf914369822e4a0547aaa355" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:06:43.906116 25102 consensus_queue.cc:1048] T e381f1d6b8184797ad142de49be225a8 P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.028s
I20260709 13:06:43.963615 19407 raft_consensus.cc:1240] T 65d8cb8d6ec64f459d5a47cefab10acf P e5256d91808b47c195bc9b4dbd7f2b87 [term 18 FOLLOWER]: Rejecting Update request from peer e61c3a8f61bb48f8a963c9480e53c168 for earlier term 17. Current term is 18. Ops: [17.11-17.11]
I20260709 13:06:43.931440 24626 raft_consensus.cc:3060] T ece3db938bc649d4a40a51522ed5259c P 127766fc592545a4997f7790f50f6076 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:06:44.026388 19449 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.1:40321, user_credentials={real_user=slave}} blocked reactor thread for 65521.5us
I20260709 13:06:43.933800 25012 raft_consensus.cc:2749] T 5ec1c4ce15e04c7e8c283a62179f2a64 P 0473d2b2d01f4459b1e90fd12cc7840e [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:06:44.037778 19402 raft_consensus.cc:1240] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P e5256d91808b47c195bc9b4dbd7f2b87 [term 17 FOLLOWER]: Rejecting Update request from peer 127766fc592545a4997f7790f50f6076 for earlier term 16. Current term is 17. Ops: []
W20260709 13:06:44.038520 19377 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.2:46257, user_credentials={real_user=slave}} blocked reactor thread for 94595.5us
I20260709 13:06:44.039228 19377 leader_election.cc:304] T 1f85fc4b527a48848e5faa083b604e36 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, 127766fc592545a4997f7790f50f6076
I20260709 13:06:44.039299 19449 leader_election.cc:304] T 4509b76741dc428e9201c70c1658da13 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e; no voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168
W20260709 13:06:44.040513 19375 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.3:36891, user_credentials={real_user=slave}} blocked reactor thread for 113606us
I20260709 13:06:43.934122 24702 raft_consensus.cc:493] T 0e1085d23e8347fbbd5bce7542f4b1f4 P e61c3a8f61bb48f8a963c9480e53c168 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 127766fc592545a4997f7790f50f6076)
I20260709 13:06:43.940971 24482 raft_consensus.cc:3060] T 14efcc79969f41babe5529c22d59156d P 127766fc592545a4997f7790f50f6076 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:06:44.046559 20104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96efeaaf1057492490e9a621f37e1a2d" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076"
I20260709 13:06:44.052075 19449 leader_election.cc:304] T d1e5873a19244c5ebbcd38e126796ee7 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87; no voters: e61c3a8f61bb48f8a963c9480e53c168
W20260709 13:06:44.054980 19526 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:44.055860 19526 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:44.056726 20076 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:43.963303 25061 raft_consensus.cc:2804] T d1e5873a19244c5ebbcd38e126796ee7 P e5256d91808b47c195bc9b4dbd7f2b87 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:06:43.963331 24891 raft_consensus.cc:2749] T 309c3ca0ca4b4f3ba129752ea2cb293b P 0473d2b2d01f4459b1e90fd12cc7840e [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:06:43.928759 24996 raft_consensus.cc:515] T 2725d2c4cb054f18b0fc8f735c15f6c2 P e5256d91808b47c195bc9b4dbd7f2b87 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:43.931180 24825 raft_consensus.cc:515] T 46c5bfeecc314717bffe987e6844b6d0 P e5256d91808b47c195bc9b4dbd7f2b87 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:44.059548 19449 leader_election.cc:304] T 76cb037fc9064d13b59a8969d897ce8c P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87; no voters: 
I20260709 13:06:44.088292 24825 leader_election.cc:290] T 46c5bfeecc314717bffe987e6844b6d0 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:06:44.088793 24825 raft_consensus.cc:493] T 5ec1c4ce15e04c7e8c283a62179f2a64 P e5256d91808b47c195bc9b4dbd7f2b87 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 127766fc592545a4997f7790f50f6076)
I20260709 13:06:44.021154 25097 raft_consensus.cc:2804] T 6c5eebf646ad445a9d1b1adc319d7b16 P 0473d2b2d01f4459b1e90fd12cc7840e [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:06:44.089272 24825 raft_consensus.cc:515] T 5ec1c4ce15e04c7e8c283a62179f2a64 P e5256d91808b47c195bc9b4dbd7f2b87 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
W20260709 13:06:44.049515 25129 log.cc:927] Time spent T fa8650e71aa14778b3d73721fc50d9fc P 0473d2b2d01f4459b1e90fd12cc7840e: Append to log took a long time: real 0.324s	user 0.001s	sys 0.000s
I20260709 13:06:44.095654 20103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff9b0eddd810459b82d91c60777c10eb" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:06:43.914784 25094 raft_consensus.cc:515] T 4af19371ea874c09a0a2147040835cbb P e5256d91808b47c195bc9b4dbd7f2b87 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:43.937510 24824 raft_consensus.cc:515] T 21e14947d70440f19044d8f75c31e1f9 P e5256d91808b47c195bc9b4dbd7f2b87 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:44.047060 24875 raft_consensus.cc:2804] T ef32ce6fdd0e40d382c79974f30295c6 P 0473d2b2d01f4459b1e90fd12cc7840e [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:06:44.042840 25020 raft_consensus.cc:2749] T b9f0d59553ad444883fcf5b5909f9798 P e5256d91808b47c195bc9b4dbd7f2b87 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:06:44.110214 19411 raft_consensus.cc:1240] T 2a16f7501e2444fb86d4e2778e734e02 P e5256d91808b47c195bc9b4dbd7f2b87 [term 16 FOLLOWER]: Rejecting Update request from peer e61c3a8f61bb48f8a963c9480e53c168 for earlier term 15. Current term is 16. Ops: [15.12-15.12]
I20260709 13:06:44.043823 25090 raft_consensus.cc:2749] T 1f85fc4b527a48848e5faa083b604e36 P e5256d91808b47c195bc9b4dbd7f2b87 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:06:44.038791 25086 leader_election.cc:290] T 46c5bfeecc314717bffe987e6844b6d0 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:06:44.048666 25100 raft_consensus.cc:2804] T f1b10566f45d4a7d9029858330e02d5b P e5256d91808b47c195bc9b4dbd7f2b87 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:06:44.113903 20110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14935b3ddf914369822e4a0547aaa355" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:06:44.049779 25085 raft_consensus.cc:493] T 70797e5783b5454ab0d0eea663e791e3 P e5256d91808b47c195bc9b4dbd7f2b87 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:44.116271 20103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e1085d23e8347fbbd5bce7542f4b1f4" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:06:44.020476 25039 consensus_queue.cc:1048] T 7be9efa6559648dbb5a0f7684c4542d1 P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.077s
I20260709 13:06:44.121461 19403 raft_consensus.cc:1275] T 1dc5b3532fe54f74876d02beffa2c230 P e5256d91808b47c195bc9b4dbd7f2b87 [term 17 FOLLOWER]: Refusing update from remote peer 0473d2b2d01f4459b1e90fd12cc7840e: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 17 index: 9. (term mismatch)
I20260709 13:06:44.095024 24982 raft_consensus.cc:2804] T d1e5873a19244c5ebbcd38e126796ee7 P 0473d2b2d01f4459b1e90fd12cc7840e [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:06:44.088286 24996 leader_election.cc:290] T 2725d2c4cb054f18b0fc8f735c15f6c2 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:06:43.919662 25105 raft_consensus.cc:515] T 7f575b143b844aa096b50997dad3516a P e5256d91808b47c195bc9b4dbd7f2b87 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:44.083299 24926 raft_consensus.cc:2749] T 4509b76741dc428e9201c70c1658da13 P 0473d2b2d01f4459b1e90fd12cc7840e [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:06:44.085171 25061 raft_consensus.cc:493] T d1e5873a19244c5ebbcd38e126796ee7 P e5256d91808b47c195bc9b4dbd7f2b87 [term 17 FOLLOWER]: Starting leader election (detected failure of leader e61c3a8f61bb48f8a963c9480e53c168)
I20260709 13:06:44.119562 24573 raft_consensus.cc:2804] T 76cb037fc9064d13b59a8969d897ce8c P 0473d2b2d01f4459b1e90fd12cc7840e [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:06:44.119736 24891 raft_consensus.cc:493] T 9962423cb4e54fcfa5de01daf68a86e7 P 0473d2b2d01f4459b1e90fd12cc7840e [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:44.118505 24875 raft_consensus.cc:493] T ef32ce6fdd0e40d382c79974f30295c6 P 0473d2b2d01f4459b1e90fd12cc7840e [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:44.128518 19403 pending_rounds.cc:85] T 1dc5b3532fe54f74876d02beffa2c230 P e5256d91808b47c195bc9b4dbd7f2b87: Aborting all ops after (but not including) 8
I20260709 13:06:44.178309 19403 pending_rounds.cc:107] T 1dc5b3532fe54f74876d02beffa2c230 P e5256d91808b47c195bc9b4dbd7f2b87: Aborting uncommitted NO_OP operation due to leader change: 16.9
I20260709 13:06:44.178974 19403 raft_consensus.cc:2889] T 1dc5b3532fe54f74876d02beffa2c230 P e5256d91808b47c195bc9b4dbd7f2b87 [term 17 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:06:44.120721 25093 raft_consensus.cc:493] T ff9b0eddd810459b82d91c60777c10eb P e5256d91808b47c195bc9b4dbd7f2b87 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 127766fc592545a4997f7790f50f6076)
I20260709 13:06:44.060276 24702 raft_consensus.cc:515] T 0e1085d23e8347fbbd5bce7542f4b1f4 P e61c3a8f61bb48f8a963c9480e53c168 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:44.179929 19403 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52342 (request call id 2935) took 1636 ms. Trace:
I20260709 13:06:44.174049 20103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "775c229504194560ba9589bc2199b089" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:06:44.127095 24700 raft_consensus.cc:493] T 70797e5783b5454ab0d0eea663e791e3 P e61c3a8f61bb48f8a963c9480e53c168 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:44.129926 25100 raft_consensus.cc:493] T f1b10566f45d4a7d9029858330e02d5b P e5256d91808b47c195bc9b4dbd7f2b87 [term 15 FOLLOWER]: Starting leader election (detected failure of leader e61c3a8f61bb48f8a963c9480e53c168)
I20260709 13:06:44.182166 19403 rpcz_store.cc:276] 0709 13:06:42.543984 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:42.544104 (+   120us) service_pool.cc:224] Handling call
0709 13:06:42.544450 (+   346us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:43.901545 (+1357095us) spinlock_profiling.cc:243] Waited 344 ms on lock 0x7b54000b93a0. stack: 00007f4a79de9343 00007f4a79de9240 00007f4a797781d4 00007f4a834b6304 00007f4a834b6299 00007f4a7ce71571 00007f4a7ce7fdc0 00007f4a7cf0a1c0 00007f4a7cf0b231 00007f4a7cf07d8f 00007f4a7cf0783e 00007f4a81ecc419 00007f4a7b443bd4 00007f4a7b443b62 00007f4a7b443a91 00007f4a7b443a0c
0709 13:06:44.179612 (+278067us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:44.179855 (+   243us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":792200576}
I20260709 13:06:44.186429 19481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed7fdbcb96d14d418db9ca90a792588a" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:06:44.191140 19481 raft_consensus.cc:2393] T ed7fdbcb96d14d418db9ca90a792588a P 0473d2b2d01f4459b1e90fd12cc7840e [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e61c3a8f61bb48f8a963c9480e53c168 in current term 12: Already voted for candidate 0473d2b2d01f4459b1e90fd12cc7840e in this term.
I20260709 13:06:44.187341 19479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dc5b3532fe54f74876d02beffa2c230" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 18 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:06:44.150746 24982 raft_consensus.cc:493] T d1e5873a19244c5ebbcd38e126796ee7 P 0473d2b2d01f4459b1e90fd12cc7840e [term 17 FOLLOWER]: Starting leader election (detected failure of leader e61c3a8f61bb48f8a963c9480e53c168)
I20260709 13:06:44.169838 25061 raft_consensus.cc:3060] T d1e5873a19244c5ebbcd38e126796ee7 P e5256d91808b47c195bc9b4dbd7f2b87 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:06:44.193223 25100 raft_consensus.cc:3060] T f1b10566f45d4a7d9029858330e02d5b P e5256d91808b47c195bc9b4dbd7f2b87 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:06:44.203835 19479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "217b5fae677b4971b3bbd2f357a1f7ff" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:06:44.179143 24573 raft_consensus.cc:493] T 76cb037fc9064d13b59a8969d897ce8c P 0473d2b2d01f4459b1e90fd12cc7840e [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:44.217159 19481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f93ee515a9c14139bf566522ed8232f3" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 18 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:06:44.218585 19479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1efebf73c86e432baa55533136b6e12c" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
W20260709 13:06:44.196797 20075 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.1:40321, user_credentials={real_user=slave}} blocked reactor thread for 237420us
I20260709 13:06:44.181743 24875 raft_consensus.cc:3060] T ef32ce6fdd0e40d382c79974f30295c6 P 0473d2b2d01f4459b1e90fd12cc7840e [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:06:44.227465 19486 raft_consensus.cc:1240] T 96efeaaf1057492490e9a621f37e1a2d P 0473d2b2d01f4459b1e90fd12cc7840e [term 18 FOLLOWER]: Rejecting Update request from peer e61c3a8f61bb48f8a963c9480e53c168 for earlier term 17. Current term is 18. Ops: []
W20260709 13:06:44.191409 24972 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 17 current term: 17 is higher.
I20260709 13:06:44.149926 25085 raft_consensus.cc:515] T 70797e5783b5454ab0d0eea663e791e3 P e5256d91808b47c195bc9b4dbd7f2b87 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:44.183801 25071 leader_election.cc:290] T 7be9efa6559648dbb5a0f7684c4542d1 P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:06:44.244124 24825 leader_election.cc:290] T 5ec1c4ce15e04c7e8c283a62179f2a64 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:06:44.245102 25140 raft_consensus.cc:493] T 70797e5783b5454ab0d0eea663e791e3 P 127766fc592545a4997f7790f50f6076 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:44.253163 25140 raft_consensus.cc:515] T 70797e5783b5454ab0d0eea663e791e3 P 127766fc592545a4997f7790f50f6076 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
W20260709 13:06:44.254603 25143 log.cc:927] Time spent T 1dc5b3532fe54f74876d02beffa2c230 P e61c3a8f61bb48f8a963c9480e53c168: Append to log took a long time: real 0.137s	user 0.000s	sys 0.001s
I20260709 13:06:44.255374 25140 leader_election.cc:290] T 70797e5783b5454ab0d0eea663e791e3 P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:06:44.256456 25133 raft_consensus.cc:2804] T 65d8cb8d6ec64f459d5a47cefab10acf P 127766fc592545a4997f7790f50f6076 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:06:44.258899 19552 raft_consensus.cc:1240] T 1dc5b3532fe54f74876d02beffa2c230 P e61c3a8f61bb48f8a963c9480e53c168 [term 17 FOLLOWER]: Rejecting Update request from peer e5256d91808b47c195bc9b4dbd7f2b87 for earlier term 16. Current term is 17. Ops: [16.9-16.9]
I20260709 13:06:44.196413 24982 raft_consensus.cc:3060] T d1e5873a19244c5ebbcd38e126796ee7 P 0473d2b2d01f4459b1e90fd12cc7840e [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:06:44.195075 25097 raft_consensus.cc:697] T 6c5eebf646ad445a9d1b1adc319d7b16 P 0473d2b2d01f4459b1e90fd12cc7840e [term 16 LEADER]: Becoming Leader. State: Replica: 0473d2b2d01f4459b1e90fd12cc7840e, State: Running, Role: LEADER
I20260709 13:06:44.283941 19449 leader_election.cc:304] T 14efcc79969f41babe5529c22d59156d P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e; no voters: 127766fc592545a4997f7790f50f6076, e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:06:44.197387 25125 raft_consensus.cc:493] T 172b3dd13109415a955b71ac0e9d2234 P 127766fc592545a4997f7790f50f6076 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader e5256d91808b47c195bc9b4dbd7f2b87)
I20260709 13:06:44.232215 24573 raft_consensus.cc:3060] T 76cb037fc9064d13b59a8969d897ce8c P 0473d2b2d01f4459b1e90fd12cc7840e [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:06:44.288892 19559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46c5bfeecc314717bffe987e6844b6d0" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 22 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:06:44.292035 19559 raft_consensus.cc:2468] T 46c5bfeecc314717bffe987e6844b6d0 P e61c3a8f61bb48f8a963c9480e53c168 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 21.
I20260709 13:06:44.292861 19559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2725d2c4cb054f18b0fc8f735c15f6c2" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:06:44.292963 19449 leader_election.cc:304] T ff9b0eddd810459b82d91c60777c10eb P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e; no voters: 127766fc592545a4997f7790f50f6076, e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:06:44.181921 24891 raft_consensus.cc:515] T 9962423cb4e54fcfa5de01daf68a86e7 P 0473d2b2d01f4459b1e90fd12cc7840e [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:44.194376 24700 raft_consensus.cc:515] T 70797e5783b5454ab0d0eea663e791e3 P e61c3a8f61bb48f8a963c9480e53c168 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:44.257210 25133 raft_consensus.cc:697] T 65d8cb8d6ec64f459d5a47cefab10acf P 127766fc592545a4997f7790f50f6076 [term 18 LEADER]: Becoming Leader. State: Replica: 127766fc592545a4997f7790f50f6076, State: Running, Role: LEADER
I20260709 13:06:44.257474 25056 raft_consensus.cc:3060] T ef32ce6fdd0e40d382c79974f30295c6 P e5256d91808b47c195bc9b4dbd7f2b87 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:06:44.308185 19449 leader_election.cc:304] T 14935b3ddf914369822e4a0547aaa355 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e; no voters: 127766fc592545a4997f7790f50f6076, e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:06:44.304594 19403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a16f7501e2444fb86d4e2778e734e02" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:06:44.315804 19403 raft_consensus.cc:2393] T 2a16f7501e2444fb86d4e2778e734e02 P e5256d91808b47c195bc9b4dbd7f2b87 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 127766fc592545a4997f7790f50f6076 in current term 16: Already voted for candidate e5256d91808b47c195bc9b4dbd7f2b87 in this term.
I20260709 13:06:44.192827 25093 raft_consensus.cc:515] T ff9b0eddd810459b82d91c60777c10eb P e5256d91808b47c195bc9b4dbd7f2b87 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:44.312909 19484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22196caba61445d3bec98a0aab3c337d" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:06:44.314695 20110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ec1c4ce15e04c7e8c283a62179f2a64" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
W20260709 13:06:44.315105 19524 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:44.296388 24943 raft_consensus.cc:2749] T 14efcc79969f41babe5529c22d59156d P 0473d2b2d01f4459b1e90fd12cc7840e [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:06:44.318321 19449 leader_election.cc:304] T 0e1085d23e8347fbbd5bce7542f4b1f4 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e; no voters: 127766fc592545a4997f7790f50f6076, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:06:44.325488 19403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7be9efa6559648dbb5a0f7684c4542d1" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:06:44.297185 24930 leader_election.cc:290] T 172b3dd13109415a955b71ac0e9d2234 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:06:44.291136 24946 leader_election.cc:290] T 48824d5acfbc485ebf8c2d944e7202de P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:06:44.323418 19484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edd7d470b5014c9489be7f41f64355c9" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:06:44.328856 19449 leader_election.cc:304] T 775c229504194560ba9589bc2199b089 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e; no voters: 127766fc592545a4997f7790f50f6076, e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:06:44.331122 19484 raft_consensus.cc:2468] T edd7d470b5014c9489be7f41f64355c9 P 0473d2b2d01f4459b1e90fd12cc7840e [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 17.
I20260709 13:06:44.306877 25051 raft_consensus.cc:493] T 3e1f505cb0f1427bbd698ac889d80821 P e61c3a8f61bb48f8a963c9480e53c168 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:44.303020 25155 raft_consensus.cc:493] T 21e14947d70440f19044d8f75c31e1f9 P 0473d2b2d01f4459b1e90fd12cc7840e [term 15 FOLLOWER]: Starting pre-election (detected failure of leader e61c3a8f61bb48f8a963c9480e53c168)
I20260709 13:06:44.313643 24926 raft_consensus.cc:2749] T ff9b0eddd810459b82d91c60777c10eb P 0473d2b2d01f4459b1e90fd12cc7840e [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:06:44.344424 19526 leader_election.cc:304] T edd7d470b5014c9489be7f41f64355c9 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:06:44.317575 24964 leader_election.cc:290] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 17 election: Requested vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
W20260709 13:06:44.355041 25132 log.cc:927] Time spent T 48824d5acfbc485ebf8c2d944e7202de P e61c3a8f61bb48f8a963c9480e53c168: Append to log took a long time: real 0.378s	user 0.000s	sys 0.001s
W20260709 13:06:44.424737 25067 consensus_meta.cc:287] T f93ee515a9c14139bf566522ed8232f3 P e5256d91808b47c195bc9b4dbd7f2b87: Time spent flushing consensus metadata: real 0.568s	user 0.006s	sys 0.003s
I20260709 13:06:44.425158 25067 raft_consensus.cc:2749] T f93ee515a9c14139bf566522ed8232f3 P e5256d91808b47c195bc9b4dbd7f2b87 [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:06:44.425285 19556 raft_consensus.cc:1240] T 22196caba61445d3bec98a0aab3c337d P e61c3a8f61bb48f8a963c9480e53c168 [term 15 FOLLOWER]: Rejecting Update request from peer 0473d2b2d01f4459b1e90fd12cc7840e for earlier term 14. Current term is 15. Ops: []
W20260709 13:06:44.367449 25147 log.cc:927] Time spent T 1efebf73c86e432baa55533136b6e12c P 0473d2b2d01f4459b1e90fd12cc7840e: Append to log took a long time: real 0.060s	user 0.000s	sys 0.000s
W20260709 13:06:44.377467 25142 log.cc:927] Time spent T 179fd671030940b4b4a4e24bcc4aba0a P 0473d2b2d01f4459b1e90fd12cc7840e: Append to log took a long time: real 0.145s	user 0.000s	sys 0.000s
I20260709 13:06:44.321537 25084 leader_election.cc:290] T 22196caba61445d3bec98a0aab3c337d P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 15 election: Requested vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:06:44.425318 19478 raft_consensus.cc:1217] T 1dc5b3532fe54f74876d02beffa2c230 P 0473d2b2d01f4459b1e90fd12cc7840e [term 17 LEADER]: Deduplicated request from leader. Original: 12.6->[13.7-16.9]   Dedup: 15.8->[16.9-16.9]
I20260709 13:06:44.394956 24891 leader_election.cc:290] T 9962423cb4e54fcfa5de01daf68a86e7 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:06:44.330251 25063 raft_consensus.cc:2749] T 0e1085d23e8347fbbd5bce7542f4b1f4 P 0473d2b2d01f4459b1e90fd12cc7840e [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:06:44.395792 25146 log.cc:927] Time spent T ece3db938bc649d4a40a51522ed5259c P e5256d91808b47c195bc9b4dbd7f2b87: Append to log took a long time: real 0.150s	user 0.000s	sys 0.001s
W20260709 13:06:44.396194 25137 log.cc:927] Time spent T 86a6797bdfe94fa496c050ceae4bd0d9 P e61c3a8f61bb48f8a963c9480e53c168: Append to log took a long time: real 0.291s	user 0.000s	sys 0.002s
I20260709 13:06:44.397583 24700 leader_election.cc:290] T 70797e5783b5454ab0d0eea663e791e3 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
W20260709 13:06:44.397769 25149 log.cc:927] Time spent T 96efeaaf1057492490e9a621f37e1a2d P 127766fc592545a4997f7790f50f6076: Append to log took a long time: real 0.247s	user 0.000s	sys 0.001s
I20260709 13:06:44.398305 20110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "172b3dd13109415a955b71ac0e9d2234" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:06:44.324302 24898 raft_consensus.cc:2749] T 14935b3ddf914369822e4a0547aaa355 P 0473d2b2d01f4459b1e90fd12cc7840e [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:06:44.368212 25138 consensus_queue.cc:1059] T 96efeaaf1057492490e9a621f37e1a2d P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 }, Status: INVALID_TERM, Last received: 17.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.047s
I20260709 13:06:44.349303 24930 raft_consensus.cc:2749] T 775c229504194560ba9589bc2199b089 P 0473d2b2d01f4459b1e90fd12cc7840e [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:06:44.399266 25087 raft_consensus.cc:3060] T 6c5eebf646ad445a9d1b1adc319d7b16 P e61c3a8f61bb48f8a963c9480e53c168 [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:06:44.399535 25148 log.cc:927] Time spent T 00000000000000000000000000000000 P 97750b77d35444acb7791ebf26cc2685: Append to log took a long time: real 0.140s	user 0.001s	sys 0.001s
I20260709 13:06:44.400223 25100 raft_consensus.cc:515] T f1b10566f45d4a7d9029858330e02d5b P e5256d91808b47c195bc9b4dbd7f2b87 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:44.430383 24983 raft_consensus.cc:493] T 2725d2c4cb054f18b0fc8f735c15f6c2 P 0473d2b2d01f4459b1e90fd12cc7840e [term 17 FOLLOWER]: Starting pre-election (detected failure of leader e61c3a8f61bb48f8a963c9480e53c168)
I20260709 13:06:44.330248 25127 raft_consensus.cc:493] T 1a61655d99124a29b486ba4a5b37faea P e5256d91808b47c195bc9b4dbd7f2b87 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:44.406092 19484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46c5bfeecc314717bffe987e6844b6d0" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 22 candidate_status { last_received { term: 19 index: 9 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:06:44.414609 24482 raft_consensus.cc:515] T 14efcc79969f41babe5529c22d59156d P 127766fc592545a4997f7790f50f6076 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:44.424774 19560 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40428 (request call id 2994) took 1267 ms. Trace:
W20260709 13:06:44.428122 19524 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:44.383566 25058 raft_consensus.cc:2804] T edd7d470b5014c9489be7f41f64355c9 P e61c3a8f61bb48f8a963c9480e53c168 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:06:44.460846 19560 rpcz_store.cc:276] 0709 13:06:43.157502 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:43.157729 (+   227us) service_pool.cc:224] Handling call
0709 13:06:43.158091 (+   362us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:43.207817 (+ 49726us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:43.207868 (+    51us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:43.554208 (+346340us) spinlock_profiling.cc:243] Waited 2.15 ms on lock 0x7b2c00078318. stack: 00007f4a79de9343 00007f4a79de9240 00007f4a797781d4 00007f4a834b6304 00007f4a834b6299 00007f4a7b801a11 00007f4a7b811372 00007f4a7cf43a01 00007f4a7cf0843a 00007f4a7cf0783e 00007f4a81ecc419 00007f4a7b443bd4 00007f4a7b443b62 00007f4a7b443a91 00007f4a7b443a0c 00007f4a7b442cc2
0709 13:06:43.554596 (+   388us) log.cc:844] Serialized 26 byte log entry
0709 13:06:43.796664 (+242068us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:06:43.796703 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:43.796767 (+    64us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:44.424487 (+627720us) raft_consensus.cc:1685] finished
0709 13:06:44.424510 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:44.424717 (+   207us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1144,"raft.queue_time_us":30567,"raft.run_cpu_time_us":111,"raft.run_wall_time_us":19129,"spinlock_wait_cycles":4945664,"thread_start_us":241658,"threads_started":1,"wal-append.queue_time_us":332249}
I20260709 13:06:44.463071 19560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4af19371ea874c09a0a2147040835cbb" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:06:44.438464 25090 raft_consensus.cc:493] T ff75a1d4cb1f493db8f71ddc136ba9ab P e5256d91808b47c195bc9b4dbd7f2b87 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:06:44.430033 19376 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:44.430267 19404 raft_consensus.cc:2368] T f93ee515a9c14139bf566522ed8232f3 P e5256d91808b47c195bc9b4dbd7f2b87 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 0473d2b2d01f4459b1e90fd12cc7840e for earlier term 17. Current term is 18.
I20260709 13:06:44.430608 19478 raft_consensus.cc:1240] T 1dc5b3532fe54f74876d02beffa2c230 P 0473d2b2d01f4459b1e90fd12cc7840e [term 17 LEADER]: Rejecting Update request from peer e5256d91808b47c195bc9b4dbd7f2b87 for earlier term 16. Current term is 17. Ops: [13.7-16.9]
I20260709 13:06:44.436005 19403 raft_consensus.cc:1275] T 9962423cb4e54fcfa5de01daf68a86e7 P e5256d91808b47c195bc9b4dbd7f2b87 [term 15 FOLLOWER]: Refusing update from remote peer 127766fc592545a4997f7790f50f6076: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 13:06:44.437122 20105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9962423cb4e54fcfa5de01daf68a86e7" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:06:44.427969 25018 raft_consensus.cc:493] T 3e1f505cb0f1427bbd698ac889d80821 P 0473d2b2d01f4459b1e90fd12cc7840e [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:44.297417 25125 raft_consensus.cc:515] T 172b3dd13109415a955b71ac0e9d2234 P 127766fc592545a4997f7790f50f6076 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:44.443878 25085 leader_election.cc:290] T 70797e5783b5454ab0d0eea663e791e3 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:06:44.444236 25093 leader_election.cc:290] T ff9b0eddd810459b82d91c60777c10eb P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:06:44.445961 25138 raft_consensus.cc:3055] T 96efeaaf1057492490e9a621f37e1a2d P e61c3a8f61bb48f8a963c9480e53c168 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:06:44.430936 24926 raft_consensus.cc:493] T 2b74109013a140ada21feeef92d6f563 P 0473d2b2d01f4459b1e90fd12cc7840e [term 12 FOLLOWER]: Starting pre-election (detected failure of leader e61c3a8f61bb48f8a963c9480e53c168)
I20260709 13:06:44.440073 25094 leader_election.cc:290] T 4af19371ea874c09a0a2147040835cbb P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:06:44.348824 25051 raft_consensus.cc:515] T 3e1f505cb0f1427bbd698ac889d80821 P e61c3a8f61bb48f8a963c9480e53c168 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:44.488479 24626 raft_consensus.cc:515] T ece3db938bc649d4a40a51522ed5259c P 127766fc592545a4997f7790f50f6076 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:44.489708 25051 leader_election.cc:290] T 3e1f505cb0f1427bbd698ac889d80821 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:06:44.430802 24932 raft_consensus.cc:493] T 7f575b143b844aa096b50997dad3516a P 0473d2b2d01f4459b1e90fd12cc7840e [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:06:44.452529 19375 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:44.464066 19560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22196caba61445d3bec98a0aab3c337d" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:06:44.490772 24626 leader_election.cc:290] T ece3db938bc649d4a40a51522ed5259c P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 13 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:06:44.490980 19560 raft_consensus.cc:2393] T 22196caba61445d3bec98a0aab3c337d P e61c3a8f61bb48f8a963c9480e53c168 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate e5256d91808b47c195bc9b4dbd7f2b87 in current term 15: Already voted for candidate e61c3a8f61bb48f8a963c9480e53c168 in this term.
I20260709 13:06:44.491937 25125 leader_election.cc:290] T 172b3dd13109415a955b71ac0e9d2234 P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:06:44.492007 19560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21e14947d70440f19044d8f75c31e1f9" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:06:44.493737 19375 leader_election.cc:304] T 46c5bfeecc314717bffe987e6844b6d0 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:06:44.494026 19560 raft_consensus.cc:1275] T 46c5bfeecc314717bffe987e6844b6d0 P e61c3a8f61bb48f8a963c9480e53c168 [term 21 FOLLOWER]: Refusing update from remote peer 0473d2b2d01f4459b1e90fd12cc7840e: Log matching property violated. Preceding OpId in replica: term: 19 index: 9. Preceding OpId from leader: term: 21 index: 11. (index mismatch)
I20260709 13:06:44.490361 24932 raft_consensus.cc:515] T 7f575b143b844aa096b50997dad3516a P 0473d2b2d01f4459b1e90fd12cc7840e [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:44.498116 24932 leader_election.cc:290] T 7f575b143b844aa096b50997dad3516a P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:06:44.464819 25058 raft_consensus.cc:493] T edd7d470b5014c9489be7f41f64355c9 P e61c3a8f61bb48f8a963c9480e53c168 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:44.470492 19484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e1085d23e8347fbbd5bce7542f4b1f4" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:06:44.474507 19403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70797e5783b5454ab0d0eea663e791e3" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 18 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
W20260709 13:06:44.416260 19523 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.17.223.1:40321 timed out after 1.670s (SENT) [suppressed 9 similar messages]
I20260709 13:06:44.500751 20110 raft_consensus.cc:2468] T 172b3dd13109415a955b71ac0e9d2234 P 127766fc592545a4997f7790f50f6076 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 14.
W20260709 13:06:44.502036 19374 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:44.406625 25155 raft_consensus.cc:515] T 21e14947d70440f19044d8f75c31e1f9 P 0473d2b2d01f4459b1e90fd12cc7840e [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:44.512465 19403 raft_consensus.cc:2410] T 70797e5783b5454ab0d0eea663e791e3 P e5256d91808b47c195bc9b4dbd7f2b87 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 127766fc592545a4997f7790f50f6076 for term 18 because replica has last-logged OpId of term: 16 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 11.
I20260709 13:06:44.512384 19560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cdf56e38bbc453d9438d359e5a69955" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:06:44.513501 19410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9962423cb4e54fcfa5de01daf68a86e7" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:06:44.516573 19410 raft_consensus.cc:2468] T 9962423cb4e54fcfa5de01daf68a86e7 P e5256d91808b47c195bc9b4dbd7f2b87 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 15.
I20260709 13:06:44.517393 19410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85c494af21f9457a85da47b9bc70c1fd" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
W20260709 13:06:44.479542 24970 consensus_meta.cc:287] T 7f575b143b844aa096b50997dad3516a P e61c3a8f61bb48f8a963c9480e53c168: Time spent flushing consensus metadata: real 0.606s	user 0.006s	sys 0.003s
I20260709 13:06:44.455813 25108 consensus_queue.cc:1048] T 1dc5b3532fe54f74876d02beffa2c230 P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.030s
I20260709 13:06:44.521016 19560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70797e5783b5454ab0d0eea663e791e3" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:06:44.480767 25138 raft_consensus.cc:740] T 96efeaaf1057492490e9a621f37e1a2d P e61c3a8f61bb48f8a963c9480e53c168 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: e61c3a8f61bb48f8a963c9480e53c168, State: Running, Role: LEADER
I20260709 13:06:44.518368 19449 leader_election.cc:304] T 9962423cb4e54fcfa5de01daf68a86e7 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87; no voters: 127766fc592545a4997f7790f50f6076
W20260709 13:06:44.503814 24990 consensus_meta.cc:287] T f93ee515a9c14139bf566522ed8232f3 P 0473d2b2d01f4459b1e90fd12cc7840e: Time spent flushing consensus metadata: real 0.769s	user 0.005s	sys 0.005s
I20260709 13:06:44.521705 19560 raft_consensus.cc:2468] T 70797e5783b5454ab0d0eea663e791e3 P e61c3a8f61bb48f8a963c9480e53c168 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 17.
I20260709 13:06:44.514984 19484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e1f505cb0f1427bbd698ac889d80821" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 19 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:06:44.462976 24983 raft_consensus.cc:515] T 2725d2c4cb054f18b0fc8f735c15f6c2 P 0473d2b2d01f4459b1e90fd12cc7840e [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:44.439484 25097 consensus_queue.cc:237] T 6c5eebf646ad445a9d1b1adc319d7b16 P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.11, Last appended by leader: 11, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:44.528034 19375 leader_election.cc:304] T 70797e5783b5454ab0d0eea663e791e3 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:06:44.528551 19410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22196caba61445d3bec98a0aab3c337d" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
I20260709 13:06:44.530181 19551 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40428 (request call id 2998) took 1093 ms. Trace:
I20260709 13:06:44.530252 19410 raft_consensus.cc:2393] T 22196caba61445d3bec98a0aab3c337d P e5256d91808b47c195bc9b4dbd7f2b87 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate e61c3a8f61bb48f8a963c9480e53c168 in current term 15: Already voted for candidate e5256d91808b47c195bc9b4dbd7f2b87 in this term.
I20260709 13:06:44.511140 25058 raft_consensus.cc:3060] T edd7d470b5014c9489be7f41f64355c9 P e61c3a8f61bb48f8a963c9480e53c168 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:06:44.499218 24926 raft_consensus.cc:515] T 2b74109013a140ada21feeef92d6f563 P 0473d2b2d01f4459b1e90fd12cc7840e [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:44.536893 19410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70797e5783b5454ab0d0eea663e791e3" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 18 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:06:44.476999 25018 raft_consensus.cc:515] T 3e1f505cb0f1427bbd698ac889d80821 P 0473d2b2d01f4459b1e90fd12cc7840e [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:44.556016 19403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "172b3dd13109415a955b71ac0e9d2234" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:06:44.475154 25127 raft_consensus.cc:515] T 1a61655d99124a29b486ba4a5b37faea P e5256d91808b47c195bc9b4dbd7f2b87 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:44.455116 25133 consensus_queue.cc:237] T 65d8cb8d6ec64f459d5a47cefab10acf P 127766fc592545a4997f7790f50f6076 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:44.531867 24930 raft_consensus.cc:2804] T 9962423cb4e54fcfa5de01daf68a86e7 P 0473d2b2d01f4459b1e90fd12cc7840e [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:06:44.531561 24990 raft_consensus.cc:2749] T f93ee515a9c14139bf566522ed8232f3 P 0473d2b2d01f4459b1e90fd12cc7840e [term 18 FOLLOWER]: Leader election lost for term 17. Reason: Vote denied by peer e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891) with higher term. Message: Invalid argument: T f93ee515a9c14139bf566522ed8232f3 P e61c3a8f61bb48f8a963c9480e53c168 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 0473d2b2d01f4459b1e90fd12cc7840e for earlier term 17. Current term is 18.
I20260709 13:06:44.543552 19560 raft_consensus.cc:1275] T 3e1f505cb0f1427bbd698ac889d80821 P e61c3a8f61bb48f8a963c9480e53c168 [term 18 FOLLOWER]: Refusing update from remote peer e5256d91808b47c195bc9b4dbd7f2b87: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
I20260709 13:06:44.546846 25063 raft_consensus.cc:493] T df751f992649444090e27965eb1af85d P 0473d2b2d01f4459b1e90fd12cc7840e [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:44.547026 25121 raft_consensus.cc:3055] T 65d8cb8d6ec64f459d5a47cefab10acf P e61c3a8f61bb48f8a963c9480e53c168 [term 17 LEADER]: Stepping down as leader of term 17
W20260709 13:06:44.550055 20076 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:44.511307 24852 consensus_queue.cc:1048] T 9962423cb4e54fcfa5de01daf68a86e7 P 127766fc592545a4997f7790f50f6076 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.023s
I20260709 13:06:44.530447 19551 rpcz_store.cc:276] 0709 13:06:43.437243 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:43.438708 (+  1465us) service_pool.cc:224] Handling call
0709 13:06:43.500961 (+ 62253us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:43.501358 (+   397us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:43.501387 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:43.528989 (+ 27602us) log.cc:844] Serialized 26 byte log entry
0709 13:06:43.890152 (+361163us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:06:43.890191 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:43.890269 (+    78us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:44.530033 (+639764us) raft_consensus.cc:1685] finished
0709 13:06:44.530045 (+    12us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:44.530133 (+    88us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":3863,"raft.run_cpu_time_us":117,"raft.run_wall_time_us":6952,"thread_start_us":158847,"threads_started":1,"wal-append.queue_time_us":310156}
I20260709 13:06:44.519064 24964 raft_consensus.cc:493] T fa8650e71aa14778b3d73721fc50d9fc P e5256d91808b47c195bc9b4dbd7f2b87 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 0473d2b2d01f4459b1e90fd12cc7840e)
I20260709 13:06:44.540104 25084 raft_consensus.cc:2804] T 70797e5783b5454ab0d0eea663e791e3 P e5256d91808b47c195bc9b4dbd7f2b87 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:06:44.572911 19484 raft_consensus.cc:2468] T 3e1f505cb0f1427bbd698ac889d80821 P 0473d2b2d01f4459b1e90fd12cc7840e [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 18.
W20260709 13:06:44.572526 20076 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:44.573834 19410 raft_consensus.cc:2410] T 70797e5783b5454ab0d0eea663e791e3 P e5256d91808b47c195bc9b4dbd7f2b87 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e61c3a8f61bb48f8a963c9480e53c168 for term 18 because replica has last-logged OpId of term: 16 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 12.
I20260709 13:06:44.560613 24930 raft_consensus.cc:493] T 9962423cb4e54fcfa5de01daf68a86e7 P 0473d2b2d01f4459b1e90fd12cc7840e [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:06:44.586491 25075 consensus_meta.cc:287] T ed7fdbcb96d14d418db9ca90a792588a P 127766fc592545a4997f7790f50f6076: Time spent flushing consensus metadata: real 0.810s	user 0.011s	sys 0.001s
I20260709 13:06:44.586964 25075 raft_consensus.cc:515] T ed7fdbcb96d14d418db9ca90a792588a P 127766fc592545a4997f7790f50f6076 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:44.579650 24964 raft_consensus.cc:515] T fa8650e71aa14778b3d73721fc50d9fc P e5256d91808b47c195bc9b4dbd7f2b87 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:44.594753 25100 leader_election.cc:290] T f1b10566f45d4a7d9029858330e02d5b P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 16 election: Requested vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:06:44.580205 25138 consensus_queue.cc:260] T 96efeaaf1057492490e9a621f37e1a2d P e61c3a8f61bb48f8a963c9480e53c168 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 17.12, Last appended by leader: 12, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:44.601840 20107 raft_consensus.cc:2368] T ed7fdbcb96d14d418db9ca90a792588a P 127766fc592545a4997f7790f50f6076 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e61c3a8f61bb48f8a963c9480e53c168 for earlier term 12. Current term is 13.
I20260709 13:06:44.572974 25063 raft_consensus.cc:515] T df751f992649444090e27965eb1af85d P 0473d2b2d01f4459b1e90fd12cc7840e [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:44.568331 25056 raft_consensus.cc:2749] T ef32ce6fdd0e40d382c79974f30295c6 P e5256d91808b47c195bc9b4dbd7f2b87 [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:06:44.601831 25138 raft_consensus.cc:3060] T 96efeaaf1057492490e9a621f37e1a2d P e61c3a8f61bb48f8a963c9480e53c168 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:06:44.605634 19407 raft_consensus.cc:1275] T ef32ce6fdd0e40d382c79974f30295c6 P e5256d91808b47c195bc9b4dbd7f2b87 [term 19 FOLLOWER]: Refusing update from remote peer e61c3a8f61bb48f8a963c9480e53c168: Log matching property violated. Preceding OpId in replica: term: 18 index: 10. Preceding OpId from leader: term: 19 index: 11. (index mismatch)
I20260709 13:06:44.578123 25084 raft_consensus.cc:493] T 70797e5783b5454ab0d0eea663e791e3 P e5256d91808b47c195bc9b4dbd7f2b87 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:44.606091 25084 raft_consensus.cc:3060] T 70797e5783b5454ab0d0eea663e791e3 P e5256d91808b47c195bc9b4dbd7f2b87 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:06:44.603924 24930 raft_consensus.cc:3060] T 9962423cb4e54fcfa5de01daf68a86e7 P 0473d2b2d01f4459b1e90fd12cc7840e [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:06:44.560007 20106 consensus_queue.cc:237] T 14935b3ddf914369822e4a0547aaa355 P 127766fc592545a4997f7790f50f6076 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 7, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:44.476480 25090 raft_consensus.cc:515] T ff75a1d4cb1f493db8f71ddc136ba9ab P e5256d91808b47c195bc9b4dbd7f2b87 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:44.523334 25038 raft_consensus.cc:493] T 14935b3ddf914369822e4a0547aaa355 P e5256d91808b47c195bc9b4dbd7f2b87 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 127766fc592545a4997f7790f50f6076)
I20260709 13:06:44.534000 25155 leader_election.cc:290] T 21e14947d70440f19044d8f75c31e1f9 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:06:44.569742 19403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e36a9d6e29c4a7c860cf267efbd4c74" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:06:44.611384 19402 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49050 (request call id 1069) took 1672 ms. Trace:
I20260709 13:06:44.606204 25152 consensus_queue.cc:1048] T 3e1f505cb0f1427bbd698ac889d80821 P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.034s
I20260709 13:06:44.611868 19402 rpcz_store.cc:276] 0709 13:06:42.939074 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:42.939203 (+   129us) service_pool.cc:224] Handling call
0709 13:06:42.939492 (+   289us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:44.038215 (+1098723us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:44.611109 (+572894us) spinlock_profiling.cc:243] Waited 1.1 s on lock 0x7b54002ef254. stack: 00007f4a79de9343 00007f4a79de9240 00007f4a797781d4 00007f4a834b6304 00007f4a834b6299 00007f4a7ce71571 00007f4a7cf08e01 00007f4a7cf0783e 00007f4a81ecc419 00007f4a7b443bd4 00007f4a7b443b62 00007f4a7b443a91 00007f4a7b443a0c 00007f4a7b442cc2 00007f4a7b24348c 00007f4a7b2428c6
0709 13:06:44.611319 (+   210us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2525442816}
I20260709 13:06:44.615864 19553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1b10566f45d4a7d9029858330e02d5b" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:06:44.569448 25121 raft_consensus.cc:740] T 65d8cb8d6ec64f459d5a47cefab10acf P e61c3a8f61bb48f8a963c9480e53c168 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: e61c3a8f61bb48f8a963c9480e53c168, State: Running, Role: LEADER
I20260709 13:06:44.623620 19402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "172b3dd13109415a955b71ac0e9d2234" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:06:44.622581 25156 raft_consensus.cc:493] T b08304a0a02b42d7840c4e8ee9a6bd1a P e5256d91808b47c195bc9b4dbd7f2b87 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 0473d2b2d01f4459b1e90fd12cc7840e)
I20260709 13:06:44.619240 19450 leader_election.cc:304] T 96efeaaf1057492490e9a621f37e1a2d P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e; no voters: 127766fc592545a4997f7790f50f6076, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:06:44.628125 19402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ece3db938bc649d4a40a51522ed5259c" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
W20260709 13:06:44.557708 19523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.1:40321, user_credentials={real_user=slave}} blocked reactor thread for 141472us
W20260709 13:06:44.629608 19523 leader_election.cc:336] T 1a61655d99124a29b486ba4a5b37faea P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321): Timed out: RequestConsensusVote RPC to 127.17.223.1:40321 timed out after 1.559s (SENT)
I20260709 13:06:44.630923 19523 leader_election.cc:304] T 1a61655d99124a29b486ba4a5b37faea P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e61c3a8f61bb48f8a963c9480e53c168; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:06:44.572432 25125 raft_consensus.cc:493] T 62c6c134d3d24a1ab144dd9ee6bc3f64 P 127766fc592545a4997f7790f50f6076 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 0473d2b2d01f4459b1e90fd12cc7840e)
W20260709 13:06:44.633400 19523 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:44.634749 19403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f93ee515a9c14139bf566522ed8232f3" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 18 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:06:44.635577 19450 leader_election.cc:304] T 2e36a9d6e29c4a7c860cf267efbd4c74 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168; no voters: e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:06:44.635854 19403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14efcc79969f41babe5529c22d59156d" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
I20260709 13:06:44.636667 25018 leader_election.cc:290] T 3e1f505cb0f1427bbd698ac889d80821 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:06:44.636970 19403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edd7d470b5014c9489be7f41f64355c9" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:06:44.637589 19403 raft_consensus.cc:2468] T edd7d470b5014c9489be7f41f64355c9 P e5256d91808b47c195bc9b4dbd7f2b87 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 16.
I20260709 13:06:44.639037 19402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21e14947d70440f19044d8f75c31e1f9" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:06:44.638377 19403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a08760e15aac4630a629431f56024dc8" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 20 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:06:44.643744 19481 raft_consensus.cc:2468] T f93ee515a9c14139bf566522ed8232f3 P 0473d2b2d01f4459b1e90fd12cc7840e [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 18.
I20260709 13:06:44.646126 19523 leader_election.cc:304] T bc225c93219c45538b53a1bd3d387e4d P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e61c3a8f61bb48f8a963c9480e53c168; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:06:44.648563 19523 leader_election.cc:304] T 4af19371ea874c09a0a2147040835cbb P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e61c3a8f61bb48f8a963c9480e53c168; no voters: 127766fc592545a4997f7790f50f6076, e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:06:44.623931 25075 leader_election.cc:290] T ed7fdbcb96d14d418db9ca90a792588a P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 13 election: Requested vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:06:44.632965 25108 raft_consensus.cc:2749] T 96efeaaf1057492490e9a621f37e1a2d P 0473d2b2d01f4459b1e90fd12cc7840e [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:06:44.652842 19523 leader_election.cc:304] T ff75a1d4cb1f493db8f71ddc136ba9ab P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e61c3a8f61bb48f8a963c9480e53c168; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:06:44.656021 19403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46c5bfeecc314717bffe987e6844b6d0" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 22 candidate_status { last_received { term: 19 index: 9 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:06:44.627674 25156 raft_consensus.cc:515] T b08304a0a02b42d7840c4e8ee9a6bd1a P e5256d91808b47c195bc9b4dbd7f2b87 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:44.641098 24970 raft_consensus.cc:2749] T 1a61655d99124a29b486ba4a5b37faea P e61c3a8f61bb48f8a963c9480e53c168 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:06:44.648358 24990 raft_consensus.cc:2804] T 2e36a9d6e29c4a7c860cf267efbd4c74 P 0473d2b2d01f4459b1e90fd12cc7840e [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:06:44.645025 25051 raft_consensus.cc:493] T 7f575b143b844aa096b50997dad3516a P e61c3a8f61bb48f8a963c9480e53c168 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:44.666700 19523 leader_election.cc:304] T 4509b76741dc428e9201c70c1658da13 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e61c3a8f61bb48f8a963c9480e53c168; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:06:44.668547 19483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "172b3dd13109415a955b71ac0e9d2234" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:06:44.627717 25121 consensus_queue.cc:260] T 65d8cb8d6ec64f459d5a47cefab10acf P e61c3a8f61bb48f8a963c9480e53c168 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.11, Last appended by leader: 11, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
W20260709 13:06:44.681116 19526 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:44.648505 24700 raft_consensus.cc:493] T fa8650e71aa14778b3d73721fc50d9fc P e61c3a8f61bb48f8a963c9480e53c168 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 0473d2b2d01f4459b1e90fd12cc7840e)
I20260709 13:06:44.638377 25061 raft_consensus.cc:515] T d1e5873a19244c5ebbcd38e126796ee7 P e5256d91808b47c195bc9b4dbd7f2b87 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:44.622975 25038 raft_consensus.cc:515] T 14935b3ddf914369822e4a0547aaa355 P e5256d91808b47c195bc9b4dbd7f2b87 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } attrs { replace: true } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:44.735167 19483 raft_consensus.cc:2468] T 172b3dd13109415a955b71ac0e9d2234 P 0473d2b2d01f4459b1e90fd12cc7840e [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 127766fc592545a4997f7790f50f6076 in term 14.
I20260709 13:06:44.641271 24626 consensus_queue.cc:1059] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P 127766fc592545a4997f7790f50f6076 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 }, Status: INVALID_TERM, Last received: 16.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.024s
I20260709 13:06:44.651989 25165 raft_consensus.cc:493] T 6c5eebf646ad445a9d1b1adc319d7b16 P e61c3a8f61bb48f8a963c9480e53c168 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:44.654217 24790 raft_consensus.cc:2749] T 4af19371ea874c09a0a2147040835cbb P e61c3a8f61bb48f8a963c9480e53c168 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:06:44.652881 25052 raft_consensus.cc:2749] T bc225c93219c45538b53a1bd3d387e4d P e61c3a8f61bb48f8a963c9480e53c168 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:06:44.662721 25085 raft_consensus.cc:2804] T 46c5bfeecc314717bffe987e6844b6d0 P e5256d91808b47c195bc9b4dbd7f2b87 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:06:44.827065 24931 raft_consensus.cc:2749] T 4509b76741dc428e9201c70c1658da13 P e61c3a8f61bb48f8a963c9480e53c168 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:06:44.803587 24700 raft_consensus.cc:515] T fa8650e71aa14778b3d73721fc50d9fc P e61c3a8f61bb48f8a963c9480e53c168 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:44.825409 20111 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46436 (request call id 871) took 1930 ms. Trace:
I20260709 13:06:44.848085 20111 rpcz_store.cc:276] 0709 13:06:42.894914 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:42.895020 (+   106us) service_pool.cc:224] Handling call
0709 13:06:42.908120 (+ 13100us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:43.402884 (+494764us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:43.402920 (+    36us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:43.402965 (+    45us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:06:43.403004 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:44.825153 (+1422149us) spinlock_profiling.cc:243] Waited 494 ms on lock 0x7b54004f74d4. stack: 00007f4a79de9343 00007f4a79de9240 00007f4a797781d4 00007f4a834b6304 00007f4a834b6299 00007f4a7ce71571 00007f4a7cf08e01 00007f4a7cf0783e 00007f4a81ecc419 00007f4a7b443bd4 00007f4a7b443b62 00007f4a7b443a91 00007f4a7b443a0c 00007f4a7b442cc2 00007f4a7b24348c 00007f4a7b2428c6
0709 13:06:44.825208 (+    55us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:44.825348 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1137340160}
I20260709 13:06:44.849306 24700 leader_election.cc:290] T fa8650e71aa14778b3d73721fc50d9fc P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:06:44.806126 25063 leader_election.cc:290] T df751f992649444090e27965eb1af85d P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:06:44.827471 19557 raft_consensus.cc:1275] T 7be9efa6559648dbb5a0f7684c4542d1 P e61c3a8f61bb48f8a963c9480e53c168 [term 15 FOLLOWER]: Refusing update from remote peer e5256d91808b47c195bc9b4dbd7f2b87: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 13:06:44.851346 19407 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52328 (request call id 2364) took 1007 ms. Trace:
I20260709 13:06:44.851752 19557 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40438 (request call id 2806) took 1043 ms. Trace:
I20260709 13:06:44.851692 19407 rpcz_store.cc:276] 0709 13:06:43.843935 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:44.024989 (+181054us) service_pool.cc:224] Handling call
0709 13:06:44.025320 (+   331us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:44.605970 (+580650us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:44.851120 (+245150us) spinlock_profiling.cc:243] Waited 567 ms on lock 0x7b54001ff4d4. stack: 00007f4a79de9343 00007f4a79de9240 00007f4a797781d4 00007f4a834b6304 00007f4a834b6299 00007f4a7ce71571 00007f4a7cf08e01 00007f4a7cf0783e 00007f4a81ecc419 00007f4a7b443bd4 00007f4a7b443b62 00007f4a7b443a91 00007f4a7b443a0c 00007f4a7b442cc2 00007f4a7b24348c 00007f4a7b2428c6
0709 13:06:44.851289 (+   169us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1304422272}
I20260709 13:06:44.852128 19557 rpcz_store.cc:276] 0709 13:06:43.807951 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:43.828652 (+ 20701us) service_pool.cc:224] Handling call
0709 13:06:43.846837 (+ 18185us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:44.851036 (+1004199us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:44.851556 (+   520us) spinlock_profiling.cc:243] Waited 980 ms on lock 0x7b540002eed4. stack: 00007f4a79de9343 00007f4a79de9240 00007f4a797781d4 00007f4a834b6304 00007f4a834b6299 00007f4a7ce71571 00007f4a7cf08e01 00007f4a7cf0783e 00007f4a81ecc419 00007f4a7b443bd4 00007f4a7b443b62 00007f4a7b443a91 00007f4a7b443a0c 00007f4a7b442cc2 00007f4a7b24348c 00007f4a7b2428c6
0709 13:06:44.851698 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2254425344}
I20260709 13:06:44.852705 25061 leader_election.cc:290] T d1e5873a19244c5ebbcd38e126796ee7 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 18 election: Requested vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
W20260709 13:06:44.855700 24573 consensus_meta.cc:287] T 76cb037fc9064d13b59a8969d897ce8c P 0473d2b2d01f4459b1e90fd12cc7840e: Time spent flushing consensus metadata: real 0.549s	user 0.011s	sys 0.000s
I20260709 13:06:44.856133 24573 raft_consensus.cc:515] T 76cb037fc9064d13b59a8969d897ce8c P 0473d2b2d01f4459b1e90fd12cc7840e [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:44.857741 19485 raft_consensus.cc:1240] T 76cb037fc9064d13b59a8969d897ce8c P 0473d2b2d01f4459b1e90fd12cc7840e [term 15 FOLLOWER]: Rejecting Update request from peer e61c3a8f61bb48f8a963c9480e53c168 for earlier term 14. Current term is 15. Ops: []
I20260709 13:06:44.858217 24573 leader_election.cc:290] T 76cb037fc9064d13b59a8969d897ce8c P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 15 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:06:44.858707 25038 leader_election.cc:290] T 14935b3ddf914369822e4a0547aaa355 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:06:44.858824 25091 raft_consensus.cc:493] T 775c229504194560ba9589bc2199b089 P e5256d91808b47c195bc9b4dbd7f2b87 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 127766fc592545a4997f7790f50f6076)
I20260709 13:06:44.859428 25091 raft_consensus.cc:515] T 775c229504194560ba9589bc2199b089 P e5256d91808b47c195bc9b4dbd7f2b87 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:44.859586 25165 raft_consensus.cc:515] T 6c5eebf646ad445a9d1b1adc319d7b16 P e61c3a8f61bb48f8a963c9480e53c168 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:44.861557 25091 leader_election.cc:290] T 775c229504194560ba9589bc2199b089 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:06:44.822106 25163 consensus_queue.cc:1048] T 76cb037fc9064d13b59a8969d897ce8c P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.198s
I20260709 13:06:44.863407 19555 raft_consensus.cc:1275] T a08760e15aac4630a629431f56024dc8 P e61c3a8f61bb48f8a963c9480e53c168 [term 19 FOLLOWER]: Refusing update from remote peer e5256d91808b47c195bc9b4dbd7f2b87: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 19 index: 11. (index mismatch)
I20260709 13:06:44.864051 19555 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40438 (request call id 2800) took 1057 ms. Trace:
I20260709 13:06:44.864346 19555 rpcz_store.cc:276] 0709 13:06:43.806315 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:43.808088 (+  1773us) service_pool.cc:224] Handling call
0709 13:06:44.862929 (+1054841us) spinlock_profiling.cc:243] Waited 16.8 ms on lock 0x7b5800003998. stack: 00007f4a79de9343 00007f4a79de9240 00007f4a797781d4 00007f4a834b6304 00007f4a834b6299 00007f4a79ca3db1 00007f4a79de3b71 00007f4a79de3a22 00007f4a82cfcc09 00007f4a81e56ee0 00007f4a81f200ab 00007f4a81f20131 00007f4a81ee1fc0 00007f4a81ecc929 00007f4a81ecc3d2 00007f4a7b443bd4
0709 13:06:44.863108 (+   179us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:44.863798 (+   690us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:44.863986 (+   188us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":38691712}
W20260709 13:06:44.865890 24982 consensus_meta.cc:287] T d1e5873a19244c5ebbcd38e126796ee7 P 0473d2b2d01f4459b1e90fd12cc7840e: Time spent flushing consensus metadata: real 0.560s	user 0.006s	sys 0.003s
I20260709 13:06:44.641360 25125 raft_consensus.cc:515] T 62c6c134d3d24a1ab144dd9ee6bc3f64 P 127766fc592545a4997f7790f50f6076 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:44.868434 25125 leader_election.cc:290] T 62c6c134d3d24a1ab144dd9ee6bc3f64 P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:06:44.666329 24482 leader_election.cc:290] T 14efcc79969f41babe5529c22d59156d P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 17 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:06:44.651753 24875 raft_consensus.cc:515] T ef32ce6fdd0e40d382c79974f30295c6 P 0473d2b2d01f4459b1e90fd12cc7840e [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:44.869063 24983 leader_election.cc:290] T 2725d2c4cb054f18b0fc8f735c15f6c2 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:06:44.870869 19479 raft_consensus.cc:1240] T ef32ce6fdd0e40d382c79974f30295c6 P 0473d2b2d01f4459b1e90fd12cc7840e [term 20 FOLLOWER]: Rejecting Update request from peer e61c3a8f61bb48f8a963c9480e53c168 for earlier term 19. Current term is 20. Ops: []
I20260709 13:06:44.870427 24875 leader_election.cc:290] T ef32ce6fdd0e40d382c79974f30295c6 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 20 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:06:44.872159 20111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36f6ba92b9ba46babe4ebd6c02e5fbd9" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076"
I20260709 13:06:44.827654 19483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7be9efa6559648dbb5a0f7684c4542d1" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:06:44.863407 19411 raft_consensus.cc:1275] T 309c3ca0ca4b4f3ba129752ea2cb293b P e5256d91808b47c195bc9b4dbd7f2b87 [term 11 FOLLOWER]: Refusing update from remote peer 127766fc592545a4997f7790f50f6076: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 13:06:44.873231 19483 raft_consensus.cc:2468] T 7be9efa6559648dbb5a0f7684c4542d1 P 0473d2b2d01f4459b1e90fd12cc7840e [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 127766fc592545a4997f7790f50f6076 in term 15.
I20260709 13:06:44.873983 19483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa8650e71aa14778b3d73721fc50d9fc" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:06:44.874948 19483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21e14947d70440f19044d8f75c31e1f9" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:06:44.821277 25154 consensus_queue.cc:1059] T 22196caba61445d3bec98a0aab3c337d P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.210s
I20260709 13:06:44.875506 19483 raft_consensus.cc:2468] T 21e14947d70440f19044d8f75c31e1f9 P 0473d2b2d01f4459b1e90fd12cc7840e [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 15.
I20260709 13:06:44.826977 25075 raft_consensus.cc:493] T 85c494af21f9457a85da47b9bc70c1fd P 127766fc592545a4997f7790f50f6076 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader e5256d91808b47c195bc9b4dbd7f2b87)
I20260709 13:06:44.876616 20111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4af19371ea874c09a0a2147040835cbb" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:06:44.662293 25153 raft_consensus.cc:2749] T ff75a1d4cb1f493db8f71ddc136ba9ab P e61c3a8f61bb48f8a963c9480e53c168 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:06:44.732867 24990 raft_consensus.cc:493] T 2e36a9d6e29c4a7c860cf267efbd4c74 P 0473d2b2d01f4459b1e90fd12cc7840e [term 11 FOLLOWER]: Starting leader election (detected failure of leader e5256d91808b47c195bc9b4dbd7f2b87)
I20260709 13:06:44.929764 19553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa8650e71aa14778b3d73721fc50d9fc" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:06:44.896433 19557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff75a1d4cb1f493db8f71ddc136ba9ab" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:06:44.932096 19553 raft_consensus.cc:2468] T fa8650e71aa14778b3d73721fc50d9fc P e61c3a8f61bb48f8a963c9480e53c168 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 15.
W20260709 13:06:44.932622 19523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.1:40321, user_credentials={real_user=slave}} blocked reactor thread for 266048us
I20260709 13:06:44.935216 19523 leader_election.cc:304] T 217b5fae677b4971b3bbd2f357a1f7ff P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e61c3a8f61bb48f8a963c9480e53c168; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:06:44.937711 20111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70797e5783b5454ab0d0eea663e791e3" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
W20260709 13:06:44.938230 20075 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.1:40321, user_credentials={real_user=slave}} blocked reactor thread for 44091.2us
I20260709 13:06:44.938480 20111 raft_consensus.cc:2468] T 70797e5783b5454ab0d0eea663e791e3 P 127766fc592545a4997f7790f50f6076 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 17.
I20260709 13:06:44.940408 19553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e5873a19244c5ebbcd38e126796ee7" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
W20260709 13:06:44.941238 19374 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.4:43121, user_credentials={real_user=slave}} blocked reactor thread for 47733.5us
W20260709 13:06:44.941874 19374 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:44.942062 19483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36f6ba92b9ba46babe4ebd6c02e5fbd9" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:06:44.942807 19483 raft_consensus.cc:3060] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P 0473d2b2d01f4459b1e90fd12cc7840e [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:06:44.944492 19557 raft_consensus.cc:2468] T ff75a1d4cb1f493db8f71ddc136ba9ab P e61c3a8f61bb48f8a963c9480e53c168 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 16.
I20260709 13:06:44.945181 20111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff9b0eddd810459b82d91c60777c10eb" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:06:44.947218 20111 raft_consensus.cc:1240] T 14efcc79969f41babe5529c22d59156d P 127766fc592545a4997f7790f50f6076 [term 17 FOLLOWER]: Rejecting Update request from peer e5256d91808b47c195bc9b4dbd7f2b87 for earlier term 16. Current term is 17. Ops: []
I20260709 13:06:44.947360 20105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14935b3ddf914369822e4a0547aaa355" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:06:44.947726 20109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "775c229504194560ba9589bc2199b089" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:06:44.830725 25127 leader_election.cc:290] T 1a61655d99124a29b486ba4a5b37faea P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:06:44.967005 19555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a61655d99124a29b486ba4a5b37faea" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:06:44.970443 19553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14935b3ddf914369822e4a0547aaa355" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:06:44.948729 19523 leader_election.cc:304] T 833a2f0775ed407a94b8924ce50adb63 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e61c3a8f61bb48f8a963c9480e53c168; no voters: 127766fc592545a4997f7790f50f6076, e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:06:44.949846 19374 leader_election.cc:304] T 4af19371ea874c09a0a2147040835cbb P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87; no voters: 127766fc592545a4997f7790f50f6076, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:06:44.971101 19555 raft_consensus.cc:2468] T 1a61655d99124a29b486ba4a5b37faea P e61c3a8f61bb48f8a963c9480e53c168 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 13.
I20260709 13:06:44.966200 19556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b08304a0a02b42d7840c4e8ee9a6bd1a" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:06:44.948758 20105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e1085d23e8347fbbd5bce7542f4b1f4" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:06:44.972644 19375 leader_election.cc:304] T fa8650e71aa14778b3d73721fc50d9fc P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:06:44.862459 25165 leader_election.cc:290] T 6c5eebf646ad445a9d1b1adc319d7b16 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:06:44.843397 24626 raft_consensus.cc:3055] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P 127766fc592545a4997f7790f50f6076 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:06:44.844170 24964 leader_election.cc:290] T fa8650e71aa14778b3d73721fc50d9fc P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:06:44.974032 25061 raft_consensus.cc:493] T 833a2f0775ed407a94b8924ce50adb63 P e5256d91808b47c195bc9b4dbd7f2b87 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 127766fc592545a4997f7790f50f6076)
I20260709 13:06:44.809718 25121 raft_consensus.cc:3060] T 65d8cb8d6ec64f459d5a47cefab10acf P e61c3a8f61bb48f8a963c9480e53c168 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:06:44.840332 25156 leader_election.cc:290] T b08304a0a02b42d7840c4e8ee9a6bd1a P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:06:44.804987 24970 raft_consensus.cc:493] T 28af091831594f9d8e96482078cc7625 P e61c3a8f61bb48f8a963c9480e53c168 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 0473d2b2d01f4459b1e90fd12cc7840e)
I20260709 13:06:44.949133 20109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70797e5783b5454ab0d0eea663e791e3" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 18 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:06:44.981208 20109 raft_consensus.cc:2468] T 70797e5783b5454ab0d0eea663e791e3 P 127766fc592545a4997f7790f50f6076 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 17.
I20260709 13:06:44.937381 25097 raft_consensus.cc:493] T bc225c93219c45538b53a1bd3d387e4d P 0473d2b2d01f4459b1e90fd12cc7840e [term 14 FOLLOWER]: Starting pre-election (detected failure of leader e5256d91808b47c195bc9b4dbd7f2b87)
I20260709 13:06:44.979741 19375 leader_election.cc:304] T 1a61655d99124a29b486ba4a5b37faea P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:06:44.739122 25051 raft_consensus.cc:515] T 7f575b143b844aa096b50997dad3516a P e61c3a8f61bb48f8a963c9480e53c168 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:44.937453 24990 raft_consensus.cc:3060] T 2e36a9d6e29c4a7c860cf267efbd4c74 P 0473d2b2d01f4459b1e90fd12cc7840e [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:06:44.980615 25165 raft_consensus.cc:2749] T 833a2f0775ed407a94b8924ce50adb63 P e61c3a8f61bb48f8a963c9480e53c168 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:06:44.983672 25084 raft_consensus.cc:515] T 70797e5783b5454ab0d0eea663e791e3 P e5256d91808b47c195bc9b4dbd7f2b87 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:44.866422 24982 raft_consensus.cc:515] T d1e5873a19244c5ebbcd38e126796ee7 P 0473d2b2d01f4459b1e90fd12cc7840e [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:44.956856 24930 raft_consensus.cc:515] T 9962423cb4e54fcfa5de01daf68a86e7 P 0473d2b2d01f4459b1e90fd12cc7840e [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:44.930460 25075 raft_consensus.cc:515] T 85c494af21f9457a85da47b9bc70c1fd P 127766fc592545a4997f7790f50f6076 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:44.979439 25127 raft_consensus.cc:2804] T fa8650e71aa14778b3d73721fc50d9fc P e5256d91808b47c195bc9b4dbd7f2b87 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:06:44.987938 24970 raft_consensus.cc:515] T 28af091831594f9d8e96482078cc7625 P e61c3a8f61bb48f8a963c9480e53c168 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:44.974608 25018 raft_consensus.cc:493] T 40e1e16737a842ee936002830f36882e P 0473d2b2d01f4459b1e90fd12cc7840e [term 17 FOLLOWER]: Starting pre-election (detected failure of leader e5256d91808b47c195bc9b4dbd7f2b87)
I20260709 13:06:44.990986 25105 leader_election.cc:290] T 7f575b143b844aa096b50997dad3516a P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:06:44.977772 24996 consensus_queue.cc:1048] T a08760e15aac4630a629431f56024dc8 P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.016s
I20260709 13:06:44.992564 25058 raft_consensus.cc:515] T edd7d470b5014c9489be7f41f64355c9 P e61c3a8f61bb48f8a963c9480e53c168 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:44.952466 25086 raft_consensus.cc:2749] T 217b5fae677b4971b3bbd2f357a1f7ff P e61c3a8f61bb48f8a963c9480e53c168 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:06:44.967619 25125 raft_consensus.cc:493] T 0afb57ae58a24a01850491d69f0213dd P 127766fc592545a4997f7790f50f6076 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 0473d2b2d01f4459b1e90fd12cc7840e)
I20260709 13:06:44.980304 19523 leader_election.cc:304] T 1dc5b3532fe54f74876d02beffa2c230 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e61c3a8f61bb48f8a963c9480e53c168; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:06:44.998317 19483 raft_consensus.cc:2468] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P 0473d2b2d01f4459b1e90fd12cc7840e [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 17.
I20260709 13:06:45.020023 19483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c5eebf646ad445a9d1b1adc319d7b16" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:06:44.975075 24626 raft_consensus.cc:740] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P 127766fc592545a4997f7790f50f6076 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 127766fc592545a4997f7790f50f6076, State: Running, Role: LEADER
I20260709 13:06:44.936599 24482 consensus_queue.cc:1048] T 309c3ca0ca4b4f3ba129752ea2cb293b P 127766fc592545a4997f7790f50f6076 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.045s
W20260709 13:06:44.999753 19374 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.4:43121, user_credentials={real_user=slave}} blocked reactor thread for 49987.6us
I20260709 13:06:44.950662 25038 consensus_queue.cc:1048] T 7be9efa6559648dbb5a0f7684c4542d1 P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.057s
I20260709 13:06:45.015796 20103 raft_consensus.cc:1240] T 65d8cb8d6ec64f459d5a47cefab10acf P 127766fc592545a4997f7790f50f6076 [term 18 LEADER]: Rejecting Update request from peer e61c3a8f61bb48f8a963c9480e53c168 for earlier term 17. Current term is 18. Ops: [17.11-17.11]
I20260709 13:06:45.000835 25056 raft_consensus.cc:2804] T 1a61655d99124a29b486ba4a5b37faea P e5256d91808b47c195bc9b4dbd7f2b87 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:06:45.001389 25156 raft_consensus.cc:2749] T 4af19371ea874c09a0a2147040835cbb P e5256d91808b47c195bc9b4dbd7f2b87 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:06:45.021827 19477 raft_consensus.cc:1240] T d1e5873a19244c5ebbcd38e126796ee7 P 0473d2b2d01f4459b1e90fd12cc7840e [term 18 FOLLOWER]: Rejecting Update request from peer e61c3a8f61bb48f8a963c9480e53c168 for earlier term 17. Current term is 18. Ops: []
I20260709 13:06:45.022899 18300 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 13:06:45.024307 19523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.1:40321, user_credentials={real_user=slave}} blocked reactor thread for 44083.2us
I20260709 13:06:44.999907 25097 raft_consensus.cc:515] T bc225c93219c45538b53a1bd3d387e4d P 0473d2b2d01f4459b1e90fd12cc7840e [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:45.014550 25127 raft_consensus.cc:493] T fa8650e71aa14778b3d73721fc50d9fc P e5256d91808b47c195bc9b4dbd7f2b87 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 0473d2b2d01f4459b1e90fd12cc7840e)
I20260709 13:06:45.031072 19483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ec1c4ce15e04c7e8c283a62179f2a64" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:06:45.074663 19483 raft_consensus.cc:2468] T 5ec1c4ce15e04c7e8c283a62179f2a64 P 0473d2b2d01f4459b1e90fd12cc7840e [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 10.
I20260709 13:06:45.075753 19483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46c5bfeecc314717bffe987e6844b6d0" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 22 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:06:45.075848 19406 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52328 (request call id 2357) took 1234 ms. Trace:
I20260709 13:06:45.076836 19483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2725d2c4cb054f18b0fc8f735c15f6c2" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:06:45.077468 19483 raft_consensus.cc:2468] T 2725d2c4cb054f18b0fc8f735c15f6c2 P 0473d2b2d01f4459b1e90fd12cc7840e [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 17.
I20260709 13:06:45.078249 19483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f575b143b844aa096b50997dad3516a" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:06:45.032886 25051 leader_election.cc:290] T 7f575b143b844aa096b50997dad3516a P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
W20260709 13:06:45.030737 20076 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:45.079623 25058 leader_election.cc:290] T edd7d470b5014c9489be7f41f64355c9 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 18 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:06:45.076421 19406 rpcz_store.cc:276] 0709 13:06:43.841928 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:43.879151 (+ 37223us) service_pool.cc:224] Handling call
0709 13:06:43.901310 (+ 22159us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:44.148804 (+247494us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 13:06:44.265265 (+116461us) log.cc:844] Serialized 14 byte log entry
0709 13:06:44.455203 (+189938us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:44.455274 (+    71us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:06:44.455355 (+    81us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:45.075546 (+620191us) spinlock_profiling.cc:243] Waited 247 ms on lock 0x7b5400196754. stack: 00007f4a79de9343 00007f4a79de9240 00007f4a797781d4 00007f4a834b6304 00007f4a834b6299 00007f4a7ce71571 00007f4a7cf08e01 00007f4a7cf0783e 00007f4a81ecc419 00007f4a7b443bd4 00007f4a7b443b62 00007f4a7b443a91 00007f4a7b443a0c 00007f4a7b442cc2 00007f4a7b24348c 00007f4a7b2428c6
0709 13:06:45.075617 (+    71us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:45.075775 (+   158us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":9,"prepare.queue_time_us":183125,"prepare.run_cpu_time_us":1016,"prepare.run_wall_time_us":18666,"raft.queue_time_us":4002,"raft.run_cpu_time_us":115,"raft.run_wall_time_us":10431,"spinlock_wait_cycles":568699136,"thread_start_us":280082,"threads_started":2,"wal-append.queue_time_us":261576}
I20260709 13:06:45.081951 19483 raft_consensus.cc:2468] T 7f575b143b844aa096b50997dad3516a P 0473d2b2d01f4459b1e90fd12cc7840e [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 12.
I20260709 13:06:45.083573 19483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48824d5acfbc485ebf8c2d944e7202de" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 19 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:06:45.009119 25061 raft_consensus.cc:515] T 833a2f0775ed407a94b8924ce50adb63 P e5256d91808b47c195bc9b4dbd7f2b87 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:45.084744 19483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22196caba61445d3bec98a0aab3c337d" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:06:45.086199 19483 raft_consensus.cc:1240] T df751f992649444090e27965eb1af85d P 0473d2b2d01f4459b1e90fd12cc7840e [term 19 FOLLOWER]: Rejecting Update request from peer e61c3a8f61bb48f8a963c9480e53c168 for earlier term 18. Current term is 19. Ops: []
I20260709 13:06:45.027702 25125 raft_consensus.cc:515] T 0afb57ae58a24a01850491d69f0213dd P 127766fc592545a4997f7790f50f6076 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:45.087282 20109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "833a2f0775ed407a94b8924ce50adb63" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:06:45.018787 25018 raft_consensus.cc:515] T 40e1e16737a842ee936002830f36882e P 0473d2b2d01f4459b1e90fd12cc7840e [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:45.089704 25018 leader_election.cc:290] T 40e1e16737a842ee936002830f36882e P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:06:45.027796 25056 raft_consensus.cc:493] T 1a61655d99124a29b486ba4a5b37faea P e5256d91808b47c195bc9b4dbd7f2b87 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:45.090360 25056 raft_consensus.cc:3060] T 1a61655d99124a29b486ba4a5b37faea P e5256d91808b47c195bc9b4dbd7f2b87 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:06:45.028530 25091 consensus_queue.cc:1059] T 14efcc79969f41babe5529c22d59156d P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false }, Status: INVALID_TERM, Last received: 16.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.044s
I20260709 13:06:45.029628 25185 raft_consensus.cc:2749] T 1dc5b3532fe54f74876d02beffa2c230 P e61c3a8f61bb48f8a963c9480e53c168 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 13:06:45.048928 19524 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:45.092792 19523 leader_election.cc:304] T 86a6797bdfe94fa496c050ceae4bd0d9 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168; no voters: 0473d2b2d01f4459b1e90fd12cc7840e
W20260709 13:06:45.094097 25182 log.cc:927] Time spent T 179fd671030940b4b4a4e24bcc4aba0a P e61c3a8f61bb48f8a963c9480e53c168: Append to log took a long time: real 0.055s	user 0.000s	sys 0.000s
W20260709 13:06:45.099359 19524 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:45.030459 25152 consensus_queue.cc:1048] T 7be9efa6559648dbb5a0f7684c4542d1 P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Connected to new peer: Peer: permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.045s
I20260709 13:06:45.086279 25061 leader_election.cc:290] T 833a2f0775ed407a94b8924ce50adb63 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:06:45.091270 25127 raft_consensus.cc:3060] T fa8650e71aa14778b3d73721fc50d9fc P e5256d91808b47c195bc9b4dbd7f2b87 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:06:45.105166 19483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edd7d470b5014c9489be7f41f64355c9" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:06:45.105922 19483 raft_consensus.cc:3060] T edd7d470b5014c9489be7f41f64355c9 P 0473d2b2d01f4459b1e90fd12cc7840e [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:06:45.106416 19523 leader_election.cc:304] T e381f1d6b8184797ad142de49be225a8 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e61c3a8f61bb48f8a963c9480e53c168; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87
W20260709 13:06:45.106801 19450 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.3:36891, user_credentials={real_user=slave}} blocked reactor thread for 453095us
I20260709 13:06:45.103658 25058 raft_consensus.cc:2804] T 86a6797bdfe94fa496c050ceae4bd0d9 P e61c3a8f61bb48f8a963c9480e53c168 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:06:45.105192 24626 consensus_queue.cc:260] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P 127766fc592545a4997f7790f50f6076 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.13, Last appended by leader: 13, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:45.111436 25075 leader_election.cc:290] T 85c494af21f9457a85da47b9bc70c1fd P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:06:45.127619 25097 leader_election.cc:290] T bc225c93219c45538b53a1bd3d387e4d P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:06:45.111898 25086 raft_consensus.cc:2749] T e381f1d6b8184797ad142de49be225a8 P e61c3a8f61bb48f8a963c9480e53c168 [term 14 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:06:45.116966 19526 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:45.134328 24626 raft_consensus.cc:3060] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P 127766fc592545a4997f7790f50f6076 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:06:45.125902 24970 leader_election.cc:290] T 28af091831594f9d8e96482078cc7625 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:06:45.125236 25084 leader_election.cc:290] T 70797e5783b5454ab0d0eea663e791e3 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 18 election: Requested vote from peers e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:06:45.126267 24982 leader_election.cc:290] T d1e5873a19244c5ebbcd38e126796ee7 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 18 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:06:45.129889 19483 raft_consensus.cc:2468] T edd7d470b5014c9489be7f41f64355c9 P 0473d2b2d01f4459b1e90fd12cc7840e [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 18.
I20260709 13:06:45.122937 25096 leader_election.cc:290] T a08760e15aac4630a629431f56024dc8 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:06:45.132678 20109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70797e5783b5454ab0d0eea663e791e3" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076"
I20260709 13:06:45.132074 25058 raft_consensus.cc:493] T 86a6797bdfe94fa496c050ceae4bd0d9 P e61c3a8f61bb48f8a963c9480e53c168 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 0473d2b2d01f4459b1e90fd12cc7840e)
I20260709 13:06:45.141388 20109 raft_consensus.cc:3060] T 70797e5783b5454ab0d0eea663e791e3 P 127766fc592545a4997f7790f50f6076 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:06:45.139282 19523 leader_election.cc:304] T 85c494af21f9457a85da47b9bc70c1fd P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e61c3a8f61bb48f8a963c9480e53c168; no voters: 127766fc592545a4997f7790f50f6076, e5256d91808b47c195bc9b4dbd7f2b87
W20260709 13:06:45.146193 20107 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46422 (request call id 910) took 1748 ms (client timeout 1598 ms). Trace:
W20260709 13:06:45.148042 20107 rpcz_store.cc:269] 0709 13:06:43.390788 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:43.390903 (+   115us) service_pool.cc:224] Handling call
0709 13:06:45.138732 (+1747829us) spinlock_profiling.cc:243] Waited 1.19 s on lock 0x7b54005082d4. stack: 00007f4a79de9343 00007f4a79de9240 00007f4a797781d4 00007f4a834b6304 00007f4a834b6299 00007f4a7ce71571 00007f4a7cf0c2fa 00007f4a81ecdb17 00007f4a7b4486d4 00007f4a7b448662 00007f4a7b448591 00007f4a7b44850c 00007f4a7b4477c2 00007f4a7b24348c 00007f4a7b2428c6 00007f4a7b24226f
0709 13:06:45.138854 (+   122us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2748376448}
I20260709 13:06:45.155738 19554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21e14947d70440f19044d8f75c31e1f9" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:06:45.170568 19377 leader_election.cc:304] T 21e14947d70440f19044d8f75c31e1f9 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87; no voters: e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:06:45.148588 19523 leader_election.cc:304] T 22196caba61445d3bec98a0aab3c337d P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e61c3a8f61bb48f8a963c9480e53c168; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:06:45.173034 19377 leader_election.cc:304] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87; no voters: 127766fc592545a4997f7790f50f6076
I20260709 13:06:45.145131 19483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28af091831594f9d8e96482078cc7625" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:06:45.144093 19481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a08760e15aac4630a629431f56024dc8" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 20 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:06:45.179726 19523 leader_election.cc:304] T 2e36a9d6e29c4a7c860cf267efbd4c74 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e61c3a8f61bb48f8a963c9480e53c168; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:06:45.180612 19554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e1f505cb0f1427bbd698ac889d80821" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 19 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:06:45.181964 19523 leader_election.cc:304] T 46c5bfeecc314717bffe987e6844b6d0 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e61c3a8f61bb48f8a963c9480e53c168; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:06:45.168630 20078 leader_election.cc:304] T 172b3dd13109415a955b71ac0e9d2234 P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, 127766fc592545a4997f7790f50f6076; no voters: e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:06:45.182662 19481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed7fdbcb96d14d418db9ca90a792588a" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:06:45.182899 19450 leader_election.cc:304] T 21e14947d70440f19044d8f75c31e1f9 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e; no voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:06:45.183209 19481 raft_consensus.cc:3060] T ed7fdbcb96d14d418db9ca90a792588a P 0473d2b2d01f4459b1e90fd12cc7840e [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:06:45.178956 25096 raft_consensus.cc:2749] T 85c494af21f9457a85da47b9bc70c1fd P e61c3a8f61bb48f8a963c9480e53c168 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:06:45.184654 25093 raft_consensus.cc:2804] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P e5256d91808b47c195bc9b4dbd7f2b87 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:06:45.185201 25093 raft_consensus.cc:697] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P e5256d91808b47c195bc9b4dbd7f2b87 [term 17 LEADER]: Becoming Leader. State: Replica: e5256d91808b47c195bc9b4dbd7f2b87, State: Running, Role: LEADER
I20260709 13:06:45.186291 19559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f575b143b844aa096b50997dad3516a" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:06:45.191149 19559 raft_consensus.cc:2468] T 7f575b143b844aa096b50997dad3516a P e61c3a8f61bb48f8a963c9480e53c168 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 12.
I20260709 13:06:45.191998 19559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76cb037fc9064d13b59a8969d897ce8c" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:06:45.192991 19559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef32ce6fdd0e40d382c79974f30295c6" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:06:45.194005 19559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40e1e16737a842ee936002830f36882e" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:06:45.194619 25133 raft_consensus.cc:2804] T 172b3dd13109415a955b71ac0e9d2234 P 127766fc592545a4997f7790f50f6076 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:06:45.131620 25165 consensus_queue.cc:1059] T 2a16f7501e2444fb86d4e2778e734e02 P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 }, Status: INVALID_TERM, Last received: 13.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.042s
I20260709 13:06:45.195118 25133 raft_consensus.cc:493] T 172b3dd13109415a955b71ac0e9d2234 P 127766fc592545a4997f7790f50f6076 [term 14 FOLLOWER]: Starting leader election (detected failure of leader e5256d91808b47c195bc9b4dbd7f2b87)
I20260709 13:06:45.195190 24970 raft_consensus.cc:2749] T 2e36a9d6e29c4a7c860cf267efbd4c74 P e61c3a8f61bb48f8a963c9480e53c168 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:06:45.195494 25165 raft_consensus.cc:3055] T 2a16f7501e2444fb86d4e2778e734e02 P e61c3a8f61bb48f8a963c9480e53c168 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:06:45.195611 25133 raft_consensus.cc:3060] T 172b3dd13109415a955b71ac0e9d2234 P 127766fc592545a4997f7790f50f6076 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:06:45.195969 25165 raft_consensus.cc:740] T 2a16f7501e2444fb86d4e2778e734e02 P e61c3a8f61bb48f8a963c9480e53c168 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: e61c3a8f61bb48f8a963c9480e53c168, State: Running, Role: LEADER
I20260709 13:06:45.196242 19559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e5873a19244c5ebbcd38e126796ee7" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:06:45.196851 25165 consensus_queue.cc:260] T 2a16f7501e2444fb86d4e2778e734e02 P e61c3a8f61bb48f8a963c9480e53c168 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:45.198028 25165 raft_consensus.cc:3060] T 2a16f7501e2444fb86d4e2778e734e02 P e61c3a8f61bb48f8a963c9480e53c168 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:06:45.186776 25185 raft_consensus.cc:2749] T 22196caba61445d3bec98a0aab3c337d P e61c3a8f61bb48f8a963c9480e53c168 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:06:45.186143 25093 consensus_queue.cc:237] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.13, Last appended by leader: 13, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:45.188848 24990 raft_consensus.cc:515] T 2e36a9d6e29c4a7c860cf267efbd4c74 P 0473d2b2d01f4459b1e90fd12cc7840e [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:45.200834 24990 leader_election.cc:290] T 2e36a9d6e29c4a7c860cf267efbd4c74 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 12 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:06:45.189741 24982 raft_consensus.cc:2749] T 21e14947d70440f19044d8f75c31e1f9 P 0473d2b2d01f4459b1e90fd12cc7840e [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:06:45.178830 25094 raft_consensus.cc:2804] T 21e14947d70440f19044d8f75c31e1f9 P e5256d91808b47c195bc9b4dbd7f2b87 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:06:45.139663 25097 consensus_queue.cc:1048] T 46c5bfeecc314717bffe987e6844b6d0 P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.055s
I20260709 13:06:45.202100 25094 raft_consensus.cc:493] T 21e14947d70440f19044d8f75c31e1f9 P e5256d91808b47c195bc9b4dbd7f2b87 [term 15 FOLLOWER]: Starting leader election (detected failure of leader e61c3a8f61bb48f8a963c9480e53c168)
I20260709 13:06:45.202636 25094 raft_consensus.cc:3060] T 21e14947d70440f19044d8f75c31e1f9 P e5256d91808b47c195bc9b4dbd7f2b87 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:06:45.197247 19559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc225c93219c45538b53a1bd3d387e4d" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:06:45.198737 24970 raft_consensus.cc:2749] T 46c5bfeecc314717bffe987e6844b6d0 P e61c3a8f61bb48f8a963c9480e53c168 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:06:45.186914 24930 leader_election.cc:290] T 9962423cb4e54fcfa5de01daf68a86e7 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 16 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:06:45.203625 25127 raft_consensus.cc:515] T fa8650e71aa14778b3d73721fc50d9fc P e5256d91808b47c195bc9b4dbd7f2b87 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:45.204284 19559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed7fdbcb96d14d418db9ca90a792588a" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:06:45.204798 19559 raft_consensus.cc:3060] T ed7fdbcb96d14d418db9ca90a792588a P e61c3a8f61bb48f8a963c9480e53c168 [term 11 FOLLOWER]: Advancing to term 13
I20260709 13:06:45.190095 25056 raft_consensus.cc:515] T 1a61655d99124a29b486ba4a5b37faea P e5256d91808b47c195bc9b4dbd7f2b87 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:45.205647 19555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df751f992649444090e27965eb1af85d" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 20 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:06:45.207087 25056 leader_election.cc:290] T 1a61655d99124a29b486ba4a5b37faea P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 14 election: Requested vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:06:45.207721 19403 raft_consensus.cc:1240] T 1a61655d99124a29b486ba4a5b37faea P e5256d91808b47c195bc9b4dbd7f2b87 [term 14 FOLLOWER]: Rejecting Update request from peer 0473d2b2d01f4459b1e90fd12cc7840e for earlier term 13. Current term is 14. Ops: []
I20260709 13:06:45.208313 19523 leader_election.cc:304] T 1efebf73c86e432baa55533136b6e12c P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e61c3a8f61bb48f8a963c9480e53c168; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, 127766fc592545a4997f7790f50f6076
I20260709 13:06:45.209100 24970 raft_consensus.cc:2749] T 1efebf73c86e432baa55533136b6e12c P e61c3a8f61bb48f8a963c9480e53c168 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:06:45.209807 25125 leader_election.cc:290] T 0afb57ae58a24a01850491d69f0213dd P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:06:45.210558 19523 leader_election.cc:304] T 0e1085d23e8347fbbd5bce7542f4b1f4 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e61c3a8f61bb48f8a963c9480e53c168; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, 127766fc592545a4997f7790f50f6076
I20260709 13:06:45.211313 24970 raft_consensus.cc:2749] T 0e1085d23e8347fbbd5bce7542f4b1f4 P e61c3a8f61bb48f8a963c9480e53c168 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:06:45.212080 19523 leader_election.cc:304] T 70797e5783b5454ab0d0eea663e791e3 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 127766fc592545a4997f7790f50f6076, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
W20260709 13:06:45.213693 25135 log.cc:927] Time spent T 22196caba61445d3bec98a0aab3c337d P 0473d2b2d01f4459b1e90fd12cc7840e: Append to log took a long time: real 1.305s	user 0.002s	sys 0.000s
W20260709 13:06:45.214293 20078 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.2:46257, user_credentials={real_user=slave}} blocked reactor thread for 45789.9us
I20260709 13:06:45.216419 19555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62c6c134d3d24a1ab144dd9ee6bc3f64" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:06:45.220803 19559 raft_consensus.cc:2468] T ed7fdbcb96d14d418db9ca90a792588a P e61c3a8f61bb48f8a963c9480e53c168 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 127766fc592545a4997f7790f50f6076 in term 13.
I20260709 13:06:45.225800 19559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ece3db938bc649d4a40a51522ed5259c" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:06:45.221103 20109 raft_consensus.cc:2468] T 70797e5783b5454ab0d0eea663e791e3 P 127766fc592545a4997f7790f50f6076 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 18.
I20260709 13:06:45.223119 19403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85c494af21f9457a85da47b9bc70c1fd" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:06:45.174237 19377 leader_election.cc:304] T 5ec1c4ce15e04c7e8c283a62179f2a64 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87; no voters: 127766fc592545a4997f7790f50f6076
W20260709 13:06:45.227811 19377 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.2:46257, user_credentials={real_user=slave}} blocked reactor thread for 53683.2us
I20260709 13:06:45.229388 19377 leader_election.cc:304] T 2725d2c4cb054f18b0fc8f735c15f6c2 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87; no voters: e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:06:45.224364 19481 raft_consensus.cc:2468] T ed7fdbcb96d14d418db9ca90a792588a P 0473d2b2d01f4459b1e90fd12cc7840e [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 127766fc592545a4997f7790f50f6076 in term 13.
W20260709 13:06:45.232478 20075 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:45.225114 19555 raft_consensus.cc:2468] T 62c6c134d3d24a1ab144dd9ee6bc3f64 P e61c3a8f61bb48f8a963c9480e53c168 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 127766fc592545a4997f7790f50f6076 in term 14.
I20260709 13:06:45.217374 19450 leader_election.cc:304] T 7f575b143b844aa096b50997dad3516a P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:06:45.234478 19377 leader_election.cc:304] T 22196caba61445d3bec98a0aab3c337d P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:06:45.143744 25058 raft_consensus.cc:3060] T 86a6797bdfe94fa496c050ceae4bd0d9 P e61c3a8f61bb48f8a963c9480e53c168 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:06:45.236048 19483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0afb57ae58a24a01850491d69f0213dd" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:06:45.205657 25127 leader_election.cc:290] T fa8650e71aa14778b3d73721fc50d9fc P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 16 election: Requested vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:06:45.223881 25125 raft_consensus.cc:493] T 96efeaaf1057492490e9a621f37e1a2d P 127766fc592545a4997f7790f50f6076 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader e61c3a8f61bb48f8a963c9480e53c168)
I20260709 13:06:45.244750 25125 raft_consensus.cc:515] T 96efeaaf1057492490e9a621f37e1a2d P 127766fc592545a4997f7790f50f6076 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:45.236851 24970 raft_consensus.cc:2804] T 70797e5783b5454ab0d0eea663e791e3 P e61c3a8f61bb48f8a963c9480e53c168 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:06:45.247539 24970 raft_consensus.cc:493] T 70797e5783b5454ab0d0eea663e791e3 P e61c3a8f61bb48f8a963c9480e53c168 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:45.247969 24970 raft_consensus.cc:3060] T 70797e5783b5454ab0d0eea663e791e3 P e61c3a8f61bb48f8a963c9480e53c168 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:06:45.236418 25056 raft_consensus.cc:2804] T 5ec1c4ce15e04c7e8c283a62179f2a64 P e5256d91808b47c195bc9b4dbd7f2b87 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:06:45.248481 25056 raft_consensus.cc:493] T 5ec1c4ce15e04c7e8c283a62179f2a64 P e5256d91808b47c195bc9b4dbd7f2b87 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 127766fc592545a4997f7790f50f6076)
I20260709 13:06:45.248872 25056 raft_consensus.cc:3060] T 5ec1c4ce15e04c7e8c283a62179f2a64 P e5256d91808b47c195bc9b4dbd7f2b87 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:06:45.242784 24972 raft_consensus.cc:2804] T 2725d2c4cb054f18b0fc8f735c15f6c2 P e5256d91808b47c195bc9b4dbd7f2b87 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:06:45.250761 24972 raft_consensus.cc:493] T 2725d2c4cb054f18b0fc8f735c15f6c2 P e5256d91808b47c195bc9b4dbd7f2b87 [term 17 FOLLOWER]: Starting leader election (detected failure of leader e61c3a8f61bb48f8a963c9480e53c168)
I20260709 13:06:45.251121 24972 raft_consensus.cc:3060] T 2725d2c4cb054f18b0fc8f735c15f6c2 P e5256d91808b47c195bc9b4dbd7f2b87 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:06:45.252840 19526 leader_election.cc:304] T 7f575b143b844aa096b50997dad3516a P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:06:45.236528 19403 raft_consensus.cc:1240] T 22196caba61445d3bec98a0aab3c337d P e5256d91808b47c195bc9b4dbd7f2b87 [term 15 FOLLOWER]: Rejecting Update request from peer 0473d2b2d01f4459b1e90fd12cc7840e for earlier term 14. Current term is 15. Ops: []
I20260709 13:06:45.236996 19481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62c6c134d3d24a1ab144dd9ee6bc3f64" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:06:45.237576 20078 leader_election.cc:304] T ed7fdbcb96d14d418db9ca90a792588a P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, 127766fc592545a4997f7790f50f6076; no voters: 
I20260709 13:06:45.239449 20107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c5eebf646ad445a9d1b1adc319d7b16" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:06:45.240852 25121 raft_consensus.cc:493] T 14935b3ddf914369822e4a0547aaa355 P e61c3a8f61bb48f8a963c9480e53c168 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 127766fc592545a4997f7790f50f6076)
I20260709 13:06:45.259052 19555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85c494af21f9457a85da47b9bc70c1fd" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:06:45.259984 19559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7be9efa6559648dbb5a0f7684c4542d1" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:06:45.260795 19559 raft_consensus.cc:2468] T 7be9efa6559648dbb5a0f7684c4542d1 P e61c3a8f61bb48f8a963c9480e53c168 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 127766fc592545a4997f7790f50f6076 in term 15.
I20260709 13:06:45.241345 19523 leader_election.cc:400] T ed7fdbcb96d14d418db9ca90a792588a P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 12 pre-election: Vote denied by peer 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121) with higher term. Message: Invalid argument: T ed7fdbcb96d14d418db9ca90a792588a P 127766fc592545a4997f7790f50f6076 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e61c3a8f61bb48f8a963c9480e53c168 for earlier term 12. Current term is 13.
I20260709 13:06:45.267314 19523 leader_election.cc:403] T ed7fdbcb96d14d418db9ca90a792588a P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 12 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:06:45.242141 19554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0afb57ae58a24a01850491d69f0213dd" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:06:45.145831 24702 leader_election.cc:290] T 0e1085d23e8347fbbd5bce7542f4b1f4 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:06:45.256775 20105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9962423cb4e54fcfa5de01daf68a86e7" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076"
I20260709 13:06:45.255945 20107 raft_consensus.cc:2468] T 6c5eebf646ad445a9d1b1adc319d7b16 P 127766fc592545a4997f7790f50f6076 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 16.
I20260709 13:06:45.268273 19526 leader_election.cc:304] T edd7d470b5014c9489be7f41f64355c9 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:06:45.269367 19403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa8650e71aa14778b3d73721fc50d9fc" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:06:45.272606 19526 leader_election.cc:304] T f93ee515a9c14139bf566522ed8232f3 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168; no voters: e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:06:45.275748 19526 leader_election.cc:304] T a08760e15aac4630a629431f56024dc8 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e61c3a8f61bb48f8a963c9480e53c168; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:06:45.277561 19403 raft_consensus.cc:2393] T fa8650e71aa14778b3d73721fc50d9fc P e5256d91808b47c195bc9b4dbd7f2b87 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e61c3a8f61bb48f8a963c9480e53c168 in current term 16: Already voted for candidate e5256d91808b47c195bc9b4dbd7f2b87 in this term.
I20260709 13:06:45.281610 19403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22196caba61445d3bec98a0aab3c337d" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:06:45.283242 19555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e36a9d6e29c4a7c860cf267efbd4c74" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:06:45.283680 19554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2725d2c4cb054f18b0fc8f735c15f6c2" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:06:45.270725 25086 raft_consensus.cc:2804] T 7f575b143b844aa096b50997dad3516a P e61c3a8f61bb48f8a963c9480e53c168 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:06:45.269989 25188 raft_consensus.cc:2804] T 7f575b143b844aa096b50997dad3516a P 0473d2b2d01f4459b1e90fd12cc7840e [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:06:45.267431 25075 raft_consensus.cc:2804] T ed7fdbcb96d14d418db9ca90a792588a P 127766fc592545a4997f7790f50f6076 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:06:45.286903 19559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a16f7501e2444fb86d4e2778e734e02" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:06:45.271451 25091 raft_consensus.cc:2749] T 22196caba61445d3bec98a0aab3c337d P e5256d91808b47c195bc9b4dbd7f2b87 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:06:45.285377 19483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14efcc79969f41babe5529c22d59156d" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:06:45.278842 25052 raft_consensus.cc:2749] T ed7fdbcb96d14d418db9ca90a792588a P e61c3a8f61bb48f8a963c9480e53c168 [term 13 FOLLOWER]: Leader pre-election lost for term 12. Reason: Vote denied by peer 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121) with higher term. Message: Invalid argument: T ed7fdbcb96d14d418db9ca90a792588a P 127766fc592545a4997f7790f50f6076 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e61c3a8f61bb48f8a963c9480e53c168 for earlier term 12. Current term is 13.
I20260709 13:06:45.279070 24983 raft_consensus.cc:493] T e381f1d6b8184797ad142de49be225a8 P 0473d2b2d01f4459b1e90fd12cc7840e [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:45.291692 19483 raft_consensus.cc:3060] T 14efcc79969f41babe5529c22d59156d P 0473d2b2d01f4459b1e90fd12cc7840e [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:06:45.278637 25183 raft_consensus.cc:2804] T edd7d470b5014c9489be7f41f64355c9 P e61c3a8f61bb48f8a963c9480e53c168 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:06:45.296901 25125 leader_election.cc:290] T 96efeaaf1057492490e9a621f37e1a2d P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:06:45.296983 25183 raft_consensus.cc:697] T edd7d470b5014c9489be7f41f64355c9 P e61c3a8f61bb48f8a963c9480e53c168 [term 18 LEADER]: Becoming Leader. State: Replica: e61c3a8f61bb48f8a963c9480e53c168, State: Running, Role: LEADER
I20260709 13:06:45.298269 25183 consensus_queue.cc:237] T edd7d470b5014c9489be7f41f64355c9 P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.9, Last appended by leader: 9, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:45.299772 25094 raft_consensus.cc:515] T 21e14947d70440f19044d8f75c31e1f9 P e5256d91808b47c195bc9b4dbd7f2b87 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
W20260709 13:06:45.301014 19376 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:45.280021 25095 raft_consensus.cc:2804] T f93ee515a9c14139bf566522ed8232f3 P e61c3a8f61bb48f8a963c9480e53c168 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:06:45.278492 24982 raft_consensus.cc:493] T 1f85fc4b527a48848e5faa083b604e36 P 0473d2b2d01f4459b1e90fd12cc7840e [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 127766fc592545a4997f7790f50f6076)
I20260709 13:06:45.275367 25096 consensus_queue.cc:1059] T df751f992649444090e27965eb1af85d P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.019s
I20260709 13:06:45.302186 24982 raft_consensus.cc:515] T 1f85fc4b527a48848e5faa083b604e36 P 0473d2b2d01f4459b1e90fd12cc7840e [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:45.302807 24983 raft_consensus.cc:515] T e381f1d6b8184797ad142de49be225a8 P 0473d2b2d01f4459b1e90fd12cc7840e [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:45.304276 24982 leader_election.cc:290] T 1f85fc4b527a48848e5faa083b604e36 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:06:45.304764 24983 leader_election.cc:290] T e381f1d6b8184797ad142de49be225a8 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:06:45.305181 20112 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46422 (request call id 909) took 1951 ms. Trace:
I20260709 13:06:45.305511 20112 rpcz_store.cc:276] 0709 13:06:43.353397 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:43.353551 (+   154us) service_pool.cc:224] Handling call
0709 13:06:43.390287 (+ 36736us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:43.744131 (+353844us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:43.744175 (+    44us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:43.744232 (+    57us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:06:43.744278 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:45.304955 (+1560677us) spinlock_profiling.cc:243] Waited 354 ms on lock 0x7b54005555d4. stack: 00007f4a79de9343 00007f4a79de9240 00007f4a797781d4 00007f4a834b6304 00007f4a834b6299 00007f4a7ce71571 00007f4a7cf08e01 00007f4a7cf0783e 00007f4a81ecc419 00007f4a7b443bd4 00007f4a7b443b62 00007f4a7b443a91 00007f4a7b443a0c 00007f4a7b442cc2 00007f4a7b24348c 00007f4a7b2428c6
0709 13:06:45.304999 (+    44us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:45.305130 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":813235968}
I20260709 13:06:45.287693 25086 raft_consensus.cc:493] T 7f575b143b844aa096b50997dad3516a P e61c3a8f61bb48f8a963c9480e53c168 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:45.306949 25086 raft_consensus.cc:3060] T 7f575b143b844aa096b50997dad3516a P e61c3a8f61bb48f8a963c9480e53c168 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:06:45.306996 19482 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58294 (request call id 2635) took 2142 ms. Trace:
I20260709 13:06:45.307507 19482 rpcz_store.cc:276] 0709 13:06:43.164635 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:43.164748 (+   113us) service_pool.cc:224] Handling call
0709 13:06:43.200946 (+ 36198us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:43.763937 (+562991us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:45.306761 (+1542824us) spinlock_profiling.cc:243] Waited 562 ms on lock 0x7b5400222c54. stack: 00007f4a79de9343 00007f4a79de9240 00007f4a797781d4 00007f4a834b6304 00007f4a834b6299 00007f4a7ce71571 00007f4a7cf08e01 00007f4a7cf0783e 00007f4a81ecc419 00007f4a7b443bd4 00007f4a7b443b62 00007f4a7b443a91 00007f4a7b443a0c 00007f4a7b442cc2 00007f4a7b24348c 00007f4a7b2428c6
0709 13:06:45.306914 (+   153us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1293440256}
I20260709 13:06:45.307068 24700 raft_consensus.cc:3055] T df751f992649444090e27965eb1af85d P e61c3a8f61bb48f8a963c9480e53c168 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:06:45.308540 24700 raft_consensus.cc:740] T df751f992649444090e27965eb1af85d P e61c3a8f61bb48f8a963c9480e53c168 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: e61c3a8f61bb48f8a963c9480e53c168, State: Running, Role: LEADER
I20260709 13:06:45.308765 19482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96efeaaf1057492490e9a621f37e1a2d" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:06:45.309530 19482 raft_consensus.cc:2393] T 96efeaaf1057492490e9a621f37e1a2d P 0473d2b2d01f4459b1e90fd12cc7840e [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 127766fc592545a4997f7790f50f6076 in current term 18: Already voted for candidate 0473d2b2d01f4459b1e90fd12cc7840e in this term.
I20260709 13:06:45.311103 25108 consensus_queue.cc:1059] T 22196caba61445d3bec98a0aab3c337d P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:06:45.306232 24983 consensus_queue.cc:1059] T 1a61655d99124a29b486ba4a5b37faea P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:06:45.317435 24990 raft_consensus.cc:3055] T 1a61655d99124a29b486ba4a5b37faea P 0473d2b2d01f4459b1e90fd12cc7840e [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:06:45.317894 24990 raft_consensus.cc:740] T 1a61655d99124a29b486ba4a5b37faea P 0473d2b2d01f4459b1e90fd12cc7840e [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 0473d2b2d01f4459b1e90fd12cc7840e, State: Running, Role: LEADER
I20260709 13:06:45.318363 19477 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58286 (request call id 2412) took 1132 ms. Trace:
I20260709 13:06:45.318735 19477 rpcz_store.cc:276] 0709 13:06:44.186358 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:44.186492 (+   134us) service_pool.cc:224] Handling call
0709 13:06:44.200055 (+ 13563us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:45.036350 (+836295us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:45.318145 (+281795us) spinlock_profiling.cc:243] Waited 820 ms on lock 0x7b54000a9e54. stack: 00007f4a79de9343 00007f4a79de9240 00007f4a797781d4 00007f4a834b6304 00007f4a834b6299 00007f4a7ce71571 00007f4a7cf08e01 00007f4a7cf0783e 00007f4a81ecc419 00007f4a7b443bd4 00007f4a7b443b62 00007f4a7b443a91 00007f4a7b443a0c 00007f4a7b442cc2 00007f4a7b24348c 00007f4a7b2428c6
0709 13:06:45.318311 (+   166us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1886540672}
I20260709 13:06:45.319471 19554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48824d5acfbc485ebf8c2d944e7202de" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 19 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:06:45.320075 19477 raft_consensus.cc:1240] T 9962423cb4e54fcfa5de01daf68a86e7 P 0473d2b2d01f4459b1e90fd12cc7840e [term 16 FOLLOWER]: Rejecting Update request from peer 127766fc592545a4997f7790f50f6076 for earlier term 15. Current term is 16. Ops: []
I20260709 13:06:45.320905 19554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70797e5783b5454ab0d0eea663e791e3" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 18 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:06:45.301932 25095 raft_consensus.cc:697] T f93ee515a9c14139bf566522ed8232f3 P e61c3a8f61bb48f8a963c9480e53c168 [term 18 LEADER]: Becoming Leader. State: Replica: e61c3a8f61bb48f8a963c9480e53c168, State: Running, Role: LEADER
I20260709 13:06:45.324049 19555 raft_consensus.cc:1275] T 1a61655d99124a29b486ba4a5b37faea P e61c3a8f61bb48f8a963c9480e53c168 [term 13 FOLLOWER]: Refusing update from remote peer 0473d2b2d01f4459b1e90fd12cc7840e: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 13:06:45.323750 25095 consensus_queue.cc:237] T f93ee515a9c14139bf566522ed8232f3 P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 16.8, Last appended by leader: 8, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:45.310539 19482 raft_consensus.cc:1240] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P 0473d2b2d01f4459b1e90fd12cc7840e [term 17 FOLLOWER]: Rejecting Update request from peer 127766fc592545a4997f7790f50f6076 for earlier term 16. Current term is 17. Ops: []
I20260709 13:06:45.327548 19483 raft_consensus.cc:2468] T 14efcc79969f41babe5529c22d59156d P 0473d2b2d01f4459b1e90fd12cc7840e [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 127766fc592545a4997f7790f50f6076 in term 17.
I20260709 13:06:45.274123 25121 raft_consensus.cc:515] T 14935b3ddf914369822e4a0547aaa355 P e61c3a8f61bb48f8a963c9480e53c168 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } attrs { replace: true } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:45.320924 24700 consensus_queue.cc:260] T df751f992649444090e27965eb1af85d P e61c3a8f61bb48f8a963c9480e53c168 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.12, Last appended by leader: 12, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:45.332592 20107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f85fc4b527a48848e5faa083b604e36" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:06:45.332959 24700 raft_consensus.cc:3060] T df751f992649444090e27965eb1af85d P e61c3a8f61bb48f8a963c9480e53c168 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:06:45.329085 19403 raft_consensus.cc:2393] T 22196caba61445d3bec98a0aab3c337d P e5256d91808b47c195bc9b4dbd7f2b87 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e61c3a8f61bb48f8a963c9480e53c168 in current term 15: Already voted for candidate e5256d91808b47c195bc9b4dbd7f2b87 in this term.
I20260709 13:06:45.285188 24790 raft_consensus.cc:2749] T a08760e15aac4630a629431f56024dc8 P e61c3a8f61bb48f8a963c9480e53c168 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
W20260709 13:06:45.331672 19526 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:45.291368 25188 raft_consensus.cc:493] T 7f575b143b844aa096b50997dad3516a P 0473d2b2d01f4459b1e90fd12cc7840e [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:45.336717 25188 raft_consensus.cc:3060] T 7f575b143b844aa096b50997dad3516a P 0473d2b2d01f4459b1e90fd12cc7840e [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:06:45.342406 19374 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:45.341229 25097 raft_consensus.cc:493] T a08760e15aac4630a629431f56024dc8 P 0473d2b2d01f4459b1e90fd12cc7840e [term 19 FOLLOWER]: Starting pre-election (detected failure of leader e5256d91808b47c195bc9b4dbd7f2b87)
I20260709 13:06:45.347437 25097 raft_consensus.cc:515] T a08760e15aac4630a629431f56024dc8 P 0473d2b2d01f4459b1e90fd12cc7840e [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:45.350061 25097 leader_election.cc:290] T a08760e15aac4630a629431f56024dc8 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:06:45.301903 25094 leader_election.cc:290] T 21e14947d70440f19044d8f75c31e1f9 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 16 election: Requested vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:06:45.344014 19482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14935b3ddf914369822e4a0547aaa355" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:06:45.324934 25075 raft_consensus.cc:697] T ed7fdbcb96d14d418db9ca90a792588a P 127766fc592545a4997f7790f50f6076 [term 13 LEADER]: Becoming Leader. State: Replica: 127766fc592545a4997f7790f50f6076, State: Running, Role: LEADER
I20260709 13:06:45.358489 19482 raft_consensus.cc:1275] T 309c3ca0ca4b4f3ba129752ea2cb293b P 0473d2b2d01f4459b1e90fd12cc7840e [term 11 FOLLOWER]: Refusing update from remote peer 127766fc592545a4997f7790f50f6076: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 13:06:45.333793 25121 leader_election.cc:290] T 14935b3ddf914369822e4a0547aaa355 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:06:45.340545 25185 raft_consensus.cc:493] T fa731b585f684a7fb2d106c50f143b83 P e61c3a8f61bb48f8a963c9480e53c168 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 127766fc592545a4997f7790f50f6076)
I20260709 13:06:45.339646 25051 consensus_queue.cc:1059] T d1e5873a19244c5ebbcd38e126796ee7 P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 }, Status: INVALID_TERM, Last received: 17.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.052s
I20260709 13:06:45.318753 24990 consensus_queue.cc:260] T 1a61655d99124a29b486ba4a5b37faea P 0473d2b2d01f4459b1e90fd12cc7840e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.9, Last appended by leader: 9, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
W20260709 13:06:45.786495 19526 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:45.366449 19482 raft_consensus.cc:1275] T 14935b3ddf914369822e4a0547aaa355 P 0473d2b2d01f4459b1e90fd12cc7840e [term 10 FOLLOWER]: Refusing update from remote peer 127766fc592545a4997f7790f50f6076: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
W20260709 13:06:45.724385 20075 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:45.793260 19376 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:45.710721 19559 raft_consensus.cc:2468] T 2a16f7501e2444fb86d4e2778e734e02 P e61c3a8f61bb48f8a963c9480e53c168 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 127766fc592545a4997f7790f50f6076 in term 16.
W20260709 13:06:45.485911 19523 leader_election.cc:336] T df751f992649444090e27965eb1af85d P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 18 election: RPC error from VoteRequest() call to peer e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321): Timed out: RequestConsensusVote RPC to 127.17.223.1:40321 timed out after 2.157s (SENT)
W20260709 13:06:45.800303 19523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.1:40321, user_credentials={real_user=slave}} blocked reactor thread for 314425us
I20260709 13:06:45.801555 19558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edd7d470b5014c9489be7f41f64355c9" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
W20260709 13:06:45.814039 20110 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46436 (request call id 884) took 1467 ms (client timeout 1631 ms). Trace:
W20260709 13:06:45.814528 20110 rpcz_store.cc:269] 0709 13:06:44.346407 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:44.346518 (+   111us) service_pool.cc:224] Handling call
0709 13:06:45.813824 (+1467306us) spinlock_profiling.cc:243] Waited 61.3 ms on lock 0x7b540003bbd4. stack: 00007f4a79de9343 00007f4a79de9240 00007f4a797781d4 00007f4a834b6304 00007f4a834b6299 00007f4a7ce71571 00007f4a7cf0c2fa 00007f4a81ecdb17 00007f4a7b4486d4 00007f4a7b448662 00007f4a7b448591 00007f4a7b44850c 00007f4a7b4477c2 00007f4a7b24348c 00007f4a7b2428c6 00007f4a7b24226f
0709 13:06:45.813972 (+   148us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":141027072}
I20260709 13:06:45.352581 25093 raft_consensus.cc:493] T 1dc5b3532fe54f74876d02beffa2c230 P e5256d91808b47c195bc9b4dbd7f2b87 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:45.813463 25185 raft_consensus.cc:515] T fa731b585f684a7fb2d106c50f143b83 P e61c3a8f61bb48f8a963c9480e53c168 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:45.819046 25093 raft_consensus.cc:515] T 1dc5b3532fe54f74876d02beffa2c230 P e5256d91808b47c195bc9b4dbd7f2b87 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:45.821311 25093 leader_election.cc:290] T 1dc5b3532fe54f74876d02beffa2c230 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:06:45.821350 25185 leader_election.cc:290] T fa731b585f684a7fb2d106c50f143b83 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:06:45.359164 24932 raft_consensus.cc:493] T 179fd671030940b4b4a4e24bcc4aba0a P 0473d2b2d01f4459b1e90fd12cc7840e [term 18 FOLLOWER]: Starting pre-election (detected failure of leader e5256d91808b47c195bc9b4dbd7f2b87)
W20260709 13:06:45.816102 19558 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40438 (request call id 2802) took 2005 ms (client timeout 2118 ms). Trace:
W20260709 13:06:45.417656 25192 log.cc:927] Time spent T a08760e15aac4630a629431f56024dc8 P e5256d91808b47c195bc9b4dbd7f2b87: Append to log took a long time: real 0.093s	user 0.000s	sys 0.000s
W20260709 13:06:45.823940 19558 rpcz_store.cc:269] 0709 13:06:43.806891 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:43.807025 (+   134us) service_pool.cc:224] Handling call
0709 13:06:45.801372 (+1994347us) spinlock_profiling.cc:243] Waited 10.3 ms on lock 0x7b5800003998. stack: 00007f4a79de9343 00007f4a79de9240 00007f4a797781d4 00007f4a834b6304 00007f4a834b6299 00007f4a79ca3db1 00007f4a79de3b71 00007f4a79de3a22 00007f4a82cfcc09 00007f4a81e56ee0 00007f4a81f200ab 00007f4a81f20131 00007f4a81ece0a0 00007f4a81ecd984 00007f4a7b4486d4 00007f4a7b448662
0709 13:06:45.812029 (+ 10657us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":23801088}
I20260709 13:06:45.345968 24972 raft_consensus.cc:515] T 2725d2c4cb054f18b0fc8f735c15f6c2 P e5256d91808b47c195bc9b4dbd7f2b87 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
W20260709 13:06:45.831979 19449 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.1:40321, user_credentials={real_user=slave}} blocked reactor thread for 251274us
W20260709 13:06:45.827265 19551 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.534s	user 0.010s	sys 0.039s
I20260709 13:06:45.386421 25089 leader_election.cc:290] T 0cdf56e38bbc453d9438d359e5a69955 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:06:45.685804 25094 raft_consensus.cc:493] T ece3db938bc649d4a40a51522ed5259c P e5256d91808b47c195bc9b4dbd7f2b87 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader e61c3a8f61bb48f8a963c9480e53c168)
W20260709 13:06:45.837157 19551 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.545s	user 0.011s	sys 0.040s
I20260709 13:06:45.340330 25133 raft_consensus.cc:515] T 172b3dd13109415a955b71ac0e9d2234 P 127766fc592545a4997f7790f50f6076 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:45.418533 24970 raft_consensus.cc:515] T 70797e5783b5454ab0d0eea663e791e3 P e61c3a8f61bb48f8a963c9480e53c168 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:45.850929 19551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b74109013a140ada21feeef92d6f563" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:06:45.826728 25185 raft_consensus.cc:3055] T d1e5873a19244c5ebbcd38e126796ee7 P e61c3a8f61bb48f8a963c9480e53c168 [term 17 LEADER]: Stepping down as leader of term 17
W20260709 13:06:45.829929 25056 consensus_meta.cc:287] T 5ec1c4ce15e04c7e8c283a62179f2a64 P e5256d91808b47c195bc9b4dbd7f2b87: Time spent flushing consensus metadata: real 0.567s	user 0.020s	sys 0.000s
I20260709 13:06:45.826125 25165 raft_consensus.cc:493] T 40e1e16737a842ee936002830f36882e P e61c3a8f61bb48f8a963c9480e53c168 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader e5256d91808b47c195bc9b4dbd7f2b87)
I20260709 13:06:45.454216 25086 raft_consensus.cc:515] T 7f575b143b844aa096b50997dad3516a P e61c3a8f61bb48f8a963c9480e53c168 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:45.823199 25078 consensus_queue.cc:1048] T 1a61655d99124a29b486ba4a5b37faea P 0473d2b2d01f4459b1e90fd12cc7840e [NON_LEADER]: Connected to new peer: Peer: permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.034s
I20260709 13:06:45.822578 24932 raft_consensus.cc:515] T 179fd671030940b4b4a4e24bcc4aba0a P 0473d2b2d01f4459b1e90fd12cc7840e [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:45.860783 19551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a08760e15aac4630a629431f56024dc8" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:06:45.609380 25188 raft_consensus.cc:515] T 7f575b143b844aa096b50997dad3516a P 0473d2b2d01f4459b1e90fd12cc7840e [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
W20260709 13:06:45.849720 25095 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.516s	user 0.014s	sys 0.021s
I20260709 13:06:45.863960 20106 raft_consensus.cc:1240] T 172b3dd13109415a955b71ac0e9d2234 P 127766fc592545a4997f7790f50f6076 [term 15 FOLLOWER]: Rejecting Update request from peer e5256d91808b47c195bc9b4dbd7f2b87 for earlier term 14. Current term is 15. Ops: []
I20260709 13:06:45.849715 25097 raft_consensus.cc:493] T ff75a1d4cb1f493db8f71ddc136ba9ab P 0473d2b2d01f4459b1e90fd12cc7840e [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:45.846000 25051 raft_consensus.cc:493] T 48824d5acfbc485ebf8c2d944e7202de P e61c3a8f61bb48f8a963c9480e53c168 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 0473d2b2d01f4459b1e90fd12cc7840e)
I20260709 13:06:45.452034 25075 consensus_queue.cc:237] T ed7fdbcb96d14d418db9ca90a792588a P 127766fc592545a4997f7790f50f6076 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:45.865468 19554 raft_consensus.cc:2393] T 70797e5783b5454ab0d0eea663e791e3 P e61c3a8f61bb48f8a963c9480e53c168 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 127766fc592545a4997f7790f50f6076 in current term 18: Already voted for candidate e61c3a8f61bb48f8a963c9480e53c168 in this term.
I20260709 13:06:45.863979 19551 raft_consensus.cc:2468] T a08760e15aac4630a629431f56024dc8 P e61c3a8f61bb48f8a963c9480e53c168 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 19.
I20260709 13:06:45.855947 25185 raft_consensus.cc:740] T d1e5873a19244c5ebbcd38e126796ee7 P e61c3a8f61bb48f8a963c9480e53c168 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: e61c3a8f61bb48f8a963c9480e53c168, State: Running, Role: LEADER
W20260709 13:06:45.895488 19408 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52328 (request call id 2349) took 2058 ms (client timeout 2157 ms). Trace:
I20260709 13:06:45.895226 19558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e381f1d6b8184797ad142de49be225a8" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 15 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
W20260709 13:06:45.897696 19408 rpcz_store.cc:269] 0709 13:06:43.837350 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:43.837453 (+   103us) service_pool.cc:224] Handling call
0709 13:06:45.870364 (+2032911us) spinlock_profiling.cc:243] Waited 41.5 ms on lock 0x7b54000e6ad4. stack: 00007f4a79de9343 00007f4a79de9240 00007f4a797781d4 00007f4a834b6304 00007f4a834b6299 00007f4a7ce71571 00007f4a7cf0c2fa 00007f4a81ecdb17 00007f4a7b4486d4 00007f4a7b448662 00007f4a7b448591 00007f4a7b44850c 00007f4a7b4477c2 00007f4a7b24348c 00007f4a7b2428c6 00007f4a7b24226f
0709 13:06:45.895416 (+ 25052us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":95356672}
I20260709 13:06:45.871411 19478 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58294 (request call id 2641) took 2669 ms. Trace:
I20260709 13:06:45.870740 19405 raft_consensus.cc:1240] T df751f992649444090e27965eb1af85d P e5256d91808b47c195bc9b4dbd7f2b87 [term 19 FOLLOWER]: Rejecting Update request from peer e61c3a8f61bb48f8a963c9480e53c168 for earlier term 18. Current term is 19. Ops: []
W20260709 13:06:45.875000 19526 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:45.898476 19478 rpcz_store.cc:276] 0709 13:06:43.201907 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:43.211526 (+  9619us) service_pool.cc:224] Handling call
0709 13:06:43.212168 (+   642us) raft_consensus.cc:1471] Updating replica for 3 ops
0709 13:06:44.425121 (+1212953us) spinlock_profiling.cc:243] Waited 207 ms on lock 0x7b54000dd2a0. stack: 00007f4a79de9343 00007f4a79de9240 00007f4a797781d4 00007f4a834b6304 00007f4a834b6299 00007f4a7ce71571 00007f4a7ce7fdc0 00007f4a7cf0a1c0 00007f4a7cf0b231 00007f4a7cf07d8f 00007f4a7cf0783e 00007f4a81ecc419 00007f4a7b443bd4 00007f4a7b443b62 00007f4a7b443a91 00007f4a7b443a0c
0709 13:06:44.471693 (+ 46572us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:45.870641 (+1398948us) spinlock_profiling.cc:243] Waited 52.5 ms on lock 0x7b54000dd2a0. stack: 00007f4a79de9343 00007f4a79de9240 00007f4a797781d4 00007f4a834b6304 00007f4a834b6299 00007f4a7ce71571 00007f4a7ce7fdc0 00007f4a7cf0ba02 00007f4a7cf07dd6 00007f4a7cf0783e 00007f4a81ecc419 00007f4a7b443bd4 00007f4a7b443b62 00007f4a7b443a91 00007f4a7b443a0c 00007f4a7b442cc2
0709 13:06:45.871336 (+   695us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":596942464}
I20260709 13:06:45.898897 19408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df751f992649444090e27965eb1af85d" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 20 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:06:45.899933 19407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e1f505cb0f1427bbd698ac889d80821" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 19 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:06:45.851405 25094 raft_consensus.cc:515] T ece3db938bc649d4a40a51522ed5259c P e5256d91808b47c195bc9b4dbd7f2b87 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:45.905702 19407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14935b3ddf914369822e4a0547aaa355" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:06:45.907879 19407 raft_consensus.cc:2468] T 14935b3ddf914369822e4a0547aaa355 P e5256d91808b47c195bc9b4dbd7f2b87 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 10.
I20260709 13:06:45.909531 25086 leader_election.cc:290] T 7f575b143b844aa096b50997dad3516a P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 13 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:06:45.912714 19408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f85fc4b527a48848e5faa083b604e36" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:06:45.912993 19558 raft_consensus.cc:1275] T 14935b3ddf914369822e4a0547aaa355 P e61c3a8f61bb48f8a963c9480e53c168 [term 10 FOLLOWER]: Refusing update from remote peer 127766fc592545a4997f7790f50f6076: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:06:45.914173 19407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28af091831594f9d8e96482078cc7625" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:06:45.914794 19407 raft_consensus.cc:2468] T 28af091831594f9d8e96482078cc7625 P e5256d91808b47c195bc9b4dbd7f2b87 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 16.
I20260709 13:06:45.915479 19407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40e1e16737a842ee936002830f36882e" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:06:45.894948 25051 raft_consensus.cc:515] T 48824d5acfbc485ebf8c2d944e7202de P e61c3a8f61bb48f8a963c9480e53c168 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:45.921183 19408 raft_consensus.cc:2393] T 1f85fc4b527a48848e5faa083b604e36 P e5256d91808b47c195bc9b4dbd7f2b87 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0473d2b2d01f4459b1e90fd12cc7840e in current term 14: Already voted for candidate e5256d91808b47c195bc9b4dbd7f2b87 in this term.
I20260709 13:06:45.922089 19408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76cb037fc9064d13b59a8969d897ce8c" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
I20260709 13:06:45.922603 19408 raft_consensus.cc:3060] T 76cb037fc9064d13b59a8969d897ce8c P e5256d91808b47c195bc9b4dbd7f2b87 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:06:45.926095 19407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef32ce6fdd0e40d382c79974f30295c6" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
I20260709 13:06:45.927346 19407 raft_consensus.cc:3060] T ef32ce6fdd0e40d382c79974f30295c6 P e5256d91808b47c195bc9b4dbd7f2b87 [term 19 FOLLOWER]: Advancing to term 20
W20260709 13:06:45.869980 25095 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.536s	user 0.014s	sys 0.022s
W20260709 13:06:45.910188 25058 consensus_meta.cc:287] T 86a6797bdfe94fa496c050ceae4bd0d9 P e61c3a8f61bb48f8a963c9480e53c168: Time spent flushing consensus metadata: real 0.642s	user 0.005s	sys 0.006s
I20260709 13:06:45.863449 25165 raft_consensus.cc:515] T 40e1e16737a842ee936002830f36882e P e61c3a8f61bb48f8a963c9480e53c168 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:45.904788 24866 raft_consensus.cc:493] T 217b5fae677b4971b3bbd2f357a1f7ff P e5256d91808b47c195bc9b4dbd7f2b87 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 0473d2b2d01f4459b1e90fd12cc7840e)
I20260709 13:06:45.934368 24866 raft_consensus.cc:515] T 217b5fae677b4971b3bbd2f357a1f7ff P e5256d91808b47c195bc9b4dbd7f2b87 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:45.935886 25100 raft_consensus.cc:3055] T 14efcc79969f41babe5529c22d59156d P e5256d91808b47c195bc9b4dbd7f2b87 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:06:45.936318 25100 raft_consensus.cc:740] T 14efcc79969f41babe5529c22d59156d P e5256d91808b47c195bc9b4dbd7f2b87 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: e5256d91808b47c195bc9b4dbd7f2b87, State: Running, Role: LEADER
I20260709 13:06:45.936733 24866 leader_election.cc:290] T 217b5fae677b4971b3bbd2f357a1f7ff P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:06:45.937160 25100 consensus_queue.cc:260] T 14efcc79969f41babe5529c22d59156d P e5256d91808b47c195bc9b4dbd7f2b87 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.12, Last appended by leader: 12, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:45.871654 25090 leader_election.cc:290] T ff75a1d4cb1f493db8f71ddc136ba9ab P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:06:45.938759 19485 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58286 (request call id 2413) took 1752 ms. Trace:
I20260709 13:06:45.939693 24824 leader_election.cc:290] T 21e14947d70440f19044d8f75c31e1f9 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:06:45.939947 24972 leader_election.cc:290] T 2725d2c4cb054f18b0fc8f735c15f6c2 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 18 election: Requested vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:06:45.941203 19403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e5873a19244c5ebbcd38e126796ee7" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
I20260709 13:06:45.964632 19403 raft_consensus.cc:2393] T d1e5873a19244c5ebbcd38e126796ee7 P e5256d91808b47c195bc9b4dbd7f2b87 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 0473d2b2d01f4459b1e90fd12cc7840e in current term 18: Already voted for candidate e5256d91808b47c195bc9b4dbd7f2b87 in this term.
I20260709 13:06:45.965834 19403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b74109013a140ada21feeef92d6f563" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:06:45.941288 24970 leader_election.cc:290] T 70797e5783b5454ab0d0eea663e791e3 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 18 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
W20260709 13:06:45.942160 25198 log.cc:927] Time spent T 1dc5b3532fe54f74876d02beffa2c230 P e61c3a8f61bb48f8a963c9480e53c168: Append to log took a long time: real 0.073s	user 0.000s	sys 0.000s
I20260709 13:06:45.943080 25133 leader_election.cc:290] T 172b3dd13109415a955b71ac0e9d2234 P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 15 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:06:45.861107 25056 raft_consensus.cc:515] T 5ec1c4ce15e04c7e8c283a62179f2a64 P e5256d91808b47c195bc9b4dbd7f2b87 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:45.922591 25051 leader_election.cc:290] T 48824d5acfbc485ebf8c2d944e7202de P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:06:45.868767 25097 raft_consensus.cc:515] T ff75a1d4cb1f493db8f71ddc136ba9ab P 0473d2b2d01f4459b1e90fd12cc7840e [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:45.947439 19485 rpcz_store.cc:276] 0709 13:06:44.186653 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:44.186907 (+   254us) service_pool.cc:224] Handling call
0709 13:06:44.187168 (+   261us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:44.858101 (+670933us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:45.938483 (+1080382us) spinlock_profiling.cc:243] Waited 670 ms on lock 0x7b5400149454. stack: 00007f4a79de9343 00007f4a79de9240 00007f4a797781d4 00007f4a834b6304 00007f4a834b6299 00007f4a7ce71571 00007f4a7cf08e01 00007f4a7cf0783e 00007f4a81ecc419 00007f4a7b443bd4 00007f4a7b443b62 00007f4a7b443a91 00007f4a7b443a0c 00007f4a7b442cc2 00007f4a7b24348c 00007f4a7b2428c6
0709 13:06:45.938701 (+   218us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1541785984}
I20260709 13:06:45.972640 19403 raft_consensus.cc:2393] T 2b74109013a140ada21feeef92d6f563 P e5256d91808b47c195bc9b4dbd7f2b87 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0473d2b2d01f4459b1e90fd12cc7840e in current term 13: Already voted for candidate e5256d91808b47c195bc9b4dbd7f2b87 in this term.
I20260709 13:06:45.974603 25094 leader_election.cc:290] T ece3db938bc649d4a40a51522ed5259c P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:06:45.975801 25056 leader_election.cc:290] T 5ec1c4ce15e04c7e8c283a62179f2a64 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 11 election: Requested vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:06:45.978147 19559 raft_consensus.cc:1275] T 6c5eebf646ad445a9d1b1adc319d7b16 P e61c3a8f61bb48f8a963c9480e53c168 [term 16 FOLLOWER]: Refusing update from remote peer 0473d2b2d01f4459b1e90fd12cc7840e: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 16 index: 12. (term mismatch)
I20260709 13:06:45.993106 19559 pending_rounds.cc:85] T 6c5eebf646ad445a9d1b1adc319d7b16 P e61c3a8f61bb48f8a963c9480e53c168: Aborting all ops after (but not including) 11
I20260709 13:06:45.993453 19559 pending_rounds.cc:107] T 6c5eebf646ad445a9d1b1adc319d7b16 P e61c3a8f61bb48f8a963c9480e53c168: Aborting uncommitted NO_OP operation due to leader change: 15.12
I20260709 13:06:45.993727 19559 raft_consensus.cc:2889] T 6c5eebf646ad445a9d1b1adc319d7b16 P e61c3a8f61bb48f8a963c9480e53c168 [term 16 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:06:45.992089 19403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f575b143b844aa096b50997dad3516a" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:06:45.979650 19402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f575b143b844aa096b50997dad3516a" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:06:45.982476 19408 raft_consensus.cc:2468] T 76cb037fc9064d13b59a8969d897ce8c P e5256d91808b47c195bc9b4dbd7f2b87 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 15.
I20260709 13:06:45.990525 19555 raft_consensus.cc:1240] T 22196caba61445d3bec98a0aab3c337d P e61c3a8f61bb48f8a963c9480e53c168 [term 15 FOLLOWER]: Rejecting Update request from peer 0473d2b2d01f4459b1e90fd12cc7840e for earlier term 14. Current term is 15. Ops: [14.10-14.10]
I20260709 13:06:45.995123 19407 raft_consensus.cc:2468] T ef32ce6fdd0e40d382c79974f30295c6 P e5256d91808b47c195bc9b4dbd7f2b87 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 20.
I20260709 13:06:45.996052 19408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edd7d470b5014c9489be7f41f64355c9" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
I20260709 13:06:45.997040 19402 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52342 (request call id 2961) took 1496 ms. Trace:
I20260709 13:06:46.000440 19402 rpcz_store.cc:276] 0709 13:06:44.500504 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:44.653727 (+153223us) service_pool.cc:224] Handling call
0709 13:06:45.979503 (+1325776us) spinlock_profiling.cc:243] Waited 3.9 ms on lock 0x7b5800183c98. stack: 00007f4a79de9343 00007f4a79de9240 00007f4a797781d4 00007f4a834b6304 00007f4a834b6299 00007f4a79ca3db1 00007f4a79de3b71 00007f4a79de3a22 00007f4a82cfcc09 00007f4a81e56ee0 00007f4a81f200ab 00007f4a81f20131 00007f4a81ece0a0 00007f4a81ecd984 00007f4a7b4486d4 00007f4a7b448662
0709 13:06:45.996980 (+ 17477us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":8967040}
I20260709 13:06:46.000938 19407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc225c93219c45538b53a1bd3d387e4d" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:06:45.998133 19403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2725d2c4cb054f18b0fc8f735c15f6c2" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:06:45.972719 25154 raft_consensus.cc:3055] T 22196caba61445d3bec98a0aab3c337d P 0473d2b2d01f4459b1e90fd12cc7840e [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:06:46.002458 19403 raft_consensus.cc:2393] T 2725d2c4cb054f18b0fc8f735c15f6c2 P e5256d91808b47c195bc9b4dbd7f2b87 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0473d2b2d01f4459b1e90fd12cc7840e in current term 18: Already voted for candidate e5256d91808b47c195bc9b4dbd7f2b87 in this term.
I20260709 13:06:46.002482 19408 raft_consensus.cc:3060] T edd7d470b5014c9489be7f41f64355c9 P e5256d91808b47c195bc9b4dbd7f2b87 [term 16 FOLLOWER]: Advancing to term 18
I20260709 13:06:46.001982 19407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e36a9d6e29c4a7c860cf267efbd4c74" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
I20260709 13:06:45.945956 25058 raft_consensus.cc:515] T 86a6797bdfe94fa496c050ceae4bd0d9 P e61c3a8f61bb48f8a963c9480e53c168 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:46.015053 19402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a08760e15aac4630a629431f56024dc8" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:06:45.998121 25100 raft_consensus.cc:3060] T 14efcc79969f41babe5529c22d59156d P e5256d91808b47c195bc9b4dbd7f2b87 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:06:45.966919 25185 consensus_queue.cc:260] T d1e5873a19244c5ebbcd38e126796ee7 P e61c3a8f61bb48f8a963c9480e53c168 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 17.9, Last appended by leader: 9, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:46.019640 19407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa731b585f684a7fb2d106c50f143b83" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:06:46.019459 19408 raft_consensus.cc:2468] T edd7d470b5014c9489be7f41f64355c9 P e5256d91808b47c195bc9b4dbd7f2b87 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 18.
I20260709 13:06:46.022178 19402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e381f1d6b8184797ad142de49be225a8" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 15 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:06:46.024029 19407 raft_consensus.cc:2468] T fa731b585f684a7fb2d106c50f143b83 P e5256d91808b47c195bc9b4dbd7f2b87 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 12.
I20260709 13:06:46.025134 19407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e1f505cb0f1427bbd698ac889d80821" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 19 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:06:46.025557 19402 raft_consensus.cc:1240] T fa8650e71aa14778b3d73721fc50d9fc P e5256d91808b47c195bc9b4dbd7f2b87 [term 16 FOLLOWER]: Rejecting Update request from peer 0473d2b2d01f4459b1e90fd12cc7840e for earlier term 15. Current term is 16. Ops: []
I20260709 13:06:46.026149 19402 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52342 (request call id 2960) took 1556 ms. Trace:
I20260709 13:06:46.026376 19407 raft_consensus.cc:1240] T 1f85fc4b527a48848e5faa083b604e36 P e5256d91808b47c195bc9b4dbd7f2b87 [term 14 FOLLOWER]: Rejecting Update request from peer 127766fc592545a4997f7790f50f6076 for earlier term 13. Current term is 14. Ops: []
I20260709 13:06:46.026422 19402 rpcz_store.cc:276] 0709 13:06:44.469846 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:46.025159 (+1555313us) service_pool.cc:224] Handling call
0709 13:06:46.025404 (+   245us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:46.025943 (+   539us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:46.026102 (+   159us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:46.027212 19407 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49050 (request call id 1085) took 1555 ms. Trace:
I20260709 13:06:46.027779 19402 raft_consensus.cc:1240] T 2b74109013a140ada21feeef92d6f563 P e5256d91808b47c195bc9b4dbd7f2b87 [term 13 FOLLOWER]: Rejecting Update request from peer e61c3a8f61bb48f8a963c9480e53c168 for earlier term 12. Current term is 13. Ops: []
I20260709 13:06:46.027554 19407 rpcz_store.cc:276] 0709 13:06:44.472116 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:46.025951 (+1553835us) service_pool.cc:224] Handling call
0709 13:06:46.026217 (+   266us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:46.026987 (+   770us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:46.027165 (+   178us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:46.028530 19402 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52328 (request call id 2373) took 1535 ms. Trace:
I20260709 13:06:46.029245 19407 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49050 (request call id 1086) took 1528 ms. Trace:
I20260709 13:06:46.029650 19402 rpcz_store.cc:276] 0709 13:06:44.493197 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:46.027400 (+1534203us) service_pool.cc:224] Handling call
0709 13:06:46.027629 (+   229us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:46.028337 (+   708us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:46.028488 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:46.029994 19407 rpcz_store.cc:276] 0709 13:06:44.500516 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:46.028527 (+1528011us) service_pool.cc:224] Handling call
0709 13:06:46.028773 (+   246us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:46.028932 (+   159us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:46.028963 (+    31us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:46.029005 (+    42us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:06:46.029054 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:46.029105 (+    51us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:46.029198 (+    93us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:46.030881 19408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9962423cb4e54fcfa5de01daf68a86e7" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
I20260709 13:06:46.031708 19408 raft_consensus.cc:3060] T 9962423cb4e54fcfa5de01daf68a86e7 P e5256d91808b47c195bc9b4dbd7f2b87 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:06:46.033073 19407 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49050 (request call id 1089) took 1482 ms. Trace:
I20260709 13:06:46.034210 19407 rpcz_store.cc:276] 0709 13:06:44.550986 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:46.031609 (+1480623us) service_pool.cc:224] Handling call
0709 13:06:46.031865 (+   256us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:46.032748 (+   883us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:46.032777 (+    29us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:46.032822 (+    45us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:06:46.032856 (+    34us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:46.032912 (+    56us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:46.033016 (+   104us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:46.036310 25058 leader_election.cc:290] T 86a6797bdfe94fa496c050ceae4bd0d9 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 13 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:06:46.037982 25085 raft_consensus.cc:493] T 46c5bfeecc314717bffe987e6844b6d0 P e5256d91808b47c195bc9b4dbd7f2b87 [term 21 FOLLOWER]: Starting leader election (detected failure of leader 0473d2b2d01f4459b1e90fd12cc7840e)
I20260709 13:06:46.038496 25085 raft_consensus.cc:3060] T 46c5bfeecc314717bffe987e6844b6d0 P e5256d91808b47c195bc9b4dbd7f2b87 [term 21 FOLLOWER]: Advancing to term 22
W20260709 13:06:46.045511 24700 consensus_meta.cc:287] T df751f992649444090e27965eb1af85d P e61c3a8f61bb48f8a963c9480e53c168: Time spent flushing consensus metadata: real 0.712s	user 0.003s	sys 0.007s
I20260709 13:06:46.038093 19560 raft_consensus.cc:1240] T 86a6797bdfe94fa496c050ceae4bd0d9 P e61c3a8f61bb48f8a963c9480e53c168 [term 13 FOLLOWER]: Rejecting Update request from peer 0473d2b2d01f4459b1e90fd12cc7840e for earlier term 12. Current term is 13. Ops: []
I20260709 13:06:46.052525 19408 raft_consensus.cc:2468] T 9962423cb4e54fcfa5de01daf68a86e7 P e5256d91808b47c195bc9b4dbd7f2b87 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 16.
I20260709 13:06:46.059314 19408 raft_consensus.cc:1240] T 9962423cb4e54fcfa5de01daf68a86e7 P e5256d91808b47c195bc9b4dbd7f2b87 [term 16 FOLLOWER]: Rejecting Update request from peer 127766fc592545a4997f7790f50f6076 for earlier term 15. Current term is 16. Ops: [15.12-15.12]
I20260709 13:06:46.062682 19408 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49050 (request call id 1091) took 1475 ms. Trace:
I20260709 13:06:46.007086 25154 raft_consensus.cc:740] T 22196caba61445d3bec98a0aab3c337d P 0473d2b2d01f4459b1e90fd12cc7840e [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 0473d2b2d01f4459b1e90fd12cc7840e, State: Running, Role: LEADER
I20260709 13:06:46.065660 25154 consensus_queue.cc:260] T 22196caba61445d3bec98a0aab3c337d P 0473d2b2d01f4459b1e90fd12cc7840e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.10, Last appended by leader: 10, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:46.066743 25154 raft_consensus.cc:3060] T 22196caba61445d3bec98a0aab3c337d P 0473d2b2d01f4459b1e90fd12cc7840e [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:06:46.068131 19408 rpcz_store.cc:276] 0709 13:06:44.587046 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:46.058595 (+1471549us) service_pool.cc:224] Handling call
0709 13:06:46.059011 (+   416us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:46.062338 (+  3327us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:46.062584 (+   246us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:46.046725 24932 leader_election.cc:290] T 179fd671030940b4b4a4e24bcc4aba0a P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:06:46.089478 19408 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49050 (request call id 1093) took 1196 ms. Trace:
I20260709 13:06:46.089915 19408 rpcz_store.cc:276] 0709 13:06:44.892936 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:46.088708 (+1195772us) service_pool.cc:224] Handling call
0709 13:06:46.088990 (+   282us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:46.089152 (+   162us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:46.089175 (+    23us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:46.089237 (+    62us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:06:46.089266 (+    29us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:46.089317 (+    51us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:46.089424 (+   107us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:06:46.091454 19477 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.750s	user 0.000s	sys 0.007s
W20260709 13:06:46.091790 19477 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.750s	user 0.000s	sys 0.007s
I20260709 13:06:46.092440 19477 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58294 (request call id 2653) took 1533 ms. Trace:
I20260709 13:06:46.092773 19477 rpcz_store.cc:276] 0709 13:06:44.559295 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:45.325372 (+766077us) service_pool.cc:224] Handling call
0709 13:06:45.326633 (+  1261us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:45.326824 (+   191us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 13:06:45.341506 (+ 14682us) log.cc:844] Serialized 14 byte log entry
0709 13:06:46.092155 (+750649us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:46.092200 (+    45us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:06:46.092238 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:46.092295 (+    57us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:46.092392 (+    97us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":15327,"prepare.run_cpu_time_us":43,"prepare.run_wall_time_us":45,"thread_start_us":750332,"threads_started":1,"wal-append.queue_time_us":723715}
I20260709 13:06:46.096505 19559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "179fd671030940b4b4a4e24bcc4aba0a" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:06:46.097091 19559 raft_consensus.cc:2468] T 179fd671030940b4b4a4e24bcc4aba0a P e61c3a8f61bb48f8a963c9480e53c168 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 18.
W20260709 13:06:46.089143 19375 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.3:36891, user_credentials={real_user=slave}} blocked reactor thread for 165820us
I20260709 13:06:46.102072 20110 raft_consensus.cc:1275] T 6c5eebf646ad445a9d1b1adc319d7b16 P 127766fc592545a4997f7790f50f6076 [term 16 FOLLOWER]: Refusing update from remote peer 0473d2b2d01f4459b1e90fd12cc7840e: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 13:06:46.102909 19405 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52328 (request call id 2358) took 2260 ms. Trace:
I20260709 13:06:46.103425 25165 leader_election.cc:290] T 40e1e16737a842ee936002830f36882e P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:06:46.104183 19409 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52328 (request call id 2362) took 2260 ms. Trace:
I20260709 13:06:46.104552 19409 rpcz_store.cc:276] 0709 13:06:43.843352 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:43.885560 (+ 42208us) service_pool.cc:224] Handling call
0709 13:06:43.885864 (+   304us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:44.187053 (+301189us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:06:44.245476 (+ 58423us) log.cc:844] Serialized 14 byte log entry
0709 13:06:44.437170 (+191694us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:44.437275 (+   105us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:06:44.437343 (+    68us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:46.103942 (+1666599us) spinlock_profiling.cc:243] Waited 301 ms on lock 0x7b54000b36d4. stack: 00007f4a79de9343 00007f4a79de9240 00007f4a797781d4 00007f4a834b6304 00007f4a834b6299 00007f4a7ce71571 00007f4a7cf08e01 00007f4a7cf0783e 00007f4a81ecc419 00007f4a7b443bd4 00007f4a7b443b62 00007f4a7b443a91 00007f4a7b443a0c 00007f4a7b442cc2 00007f4a7b24348c 00007f4a7b2428c6
0709 13:06:46.103995 (+    53us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:46.104127 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":9063,"prepare.queue_time_us":162056,"prepare.run_cpu_time_us":740,"prepare.run_wall_time_us":13909,"raft.queue_time_us":10894,"raft.run_cpu_time_us":122,"raft.run_wall_time_us":2981,"spinlock_wait_cycles":692199296,"thread_start_us":228365,"threads_started":2,"wal-append.queue_time_us":226765,"wal-append.run_cpu_time_us":1243,"wal-append.run_wall_time_us":1066117}
I20260709 13:06:46.107882 19409 raft_consensus.cc:1240] T 76cb037fc9064d13b59a8969d897ce8c P e5256d91808b47c195bc9b4dbd7f2b87 [term 15 FOLLOWER]: Rejecting Update request from peer e61c3a8f61bb48f8a963c9480e53c168 for earlier term 14. Current term is 15. Ops: [14.8-14.8]
I20260709 13:06:46.110090 19409 raft_consensus.cc:1240] T 2725d2c4cb054f18b0fc8f735c15f6c2 P e5256d91808b47c195bc9b4dbd7f2b87 [term 18 FOLLOWER]: Rejecting Update request from peer e61c3a8f61bb48f8a963c9480e53c168 for earlier term 17. Current term is 18. Ops: []
I20260709 13:06:46.103279 19405 rpcz_store.cc:276] 0709 13:06:43.842223 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:43.883178 (+ 40955us) service_pool.cc:224] Handling call
0709 13:06:45.870521 (+1987343us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:45.906599 (+ 36078us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:46.102715 (+196116us) spinlock_profiling.cc:243] Waited 1.99 s on lock 0x7b54000e6ad0. stack: 00007f4a79de9343 00007f4a79de9240 00007f4a797781d4 00007f4a834b6304 00007f4a834b6299 00007f4a7ce71571 00007f4a7cf078ad 00007f4a81ecc419 00007f4a7b443bd4 00007f4a7b443b62 00007f4a7b443a91 00007f4a7b443a0c 00007f4a7b442cc2 00007f4a7b24348c 00007f4a7b2428c6 00007f4a7b24226f
0709 13:06:46.102834 (+   119us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4569678720}
W20260709 13:06:46.122344 19410 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52328 (request call id 2374) took 1628 ms (client timeout 1696 ms). Trace:
W20260709 13:06:46.122493 19449 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.4:43121, user_credentials={real_user=slave}} blocked reactor thread for 217891us
I20260709 13:06:46.125739 19403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f575b143b844aa096b50997dad3516a" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
I20260709 13:06:46.125792 19449 leader_election.cc:304] T 172b3dd13109415a955b71ac0e9d2234 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, 127766fc592545a4997f7790f50f6076; no voters: e5256d91808b47c195bc9b4dbd7f2b87
W20260709 13:06:46.128943 19557 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40438 (request call id 2826) took 1235 ms (client timeout 1528 ms). Trace:
W20260709 13:06:46.129451 19557 rpcz_store.cc:269] 0709 13:06:44.893323 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:44.896201 (+  2878us) service_pool.cc:224] Handling call
0709 13:06:46.128782 (+1232581us) spinlock_profiling.cc:243] Waited 12.4 ms on lock 0x7b540002f8d4. stack: 00007f4a79de9343 00007f4a79de9240 00007f4a797781d4 00007f4a834b6304 00007f4a834b6299 00007f4a7ce71571 00007f4a7cf0c2fa 00007f4a81ecdb17 00007f4a7b4486d4 00007f4a7b448662 00007f4a7b448591 00007f4a7b44850c 00007f4a7b4477c2 00007f4a7b24348c 00007f4a7b2428c6 00007f4a7b24226f
0709 13:06:46.128891 (+   109us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":28580608}
I20260709 13:06:46.126538 19403 raft_consensus.cc:3060] T 7f575b143b844aa096b50997dad3516a P e5256d91808b47c195bc9b4dbd7f2b87 [term 11 FOLLOWER]: Advancing to term 13
I20260709 13:06:46.037565 19407 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49050 (request call id 1090) took 1486 ms. Trace:
I20260709 13:06:46.137198 19407 rpcz_store.cc:276] 0709 13:06:44.551316 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:46.036018 (+1484702us) service_pool.cc:224] Handling call
0709 13:06:46.037110 (+  1092us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:46.037275 (+   165us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:46.037303 (+    28us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:46.037342 (+    39us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:06:46.037370 (+    28us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:46.037419 (+    49us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:46.037520 (+   101us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:06:46.122874 19410 rpcz_store.cc:269] 0709 13:06:44.493421 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:44.536592 (+ 43171us) service_pool.cc:224] Handling call
0709 13:06:46.122111 (+1585519us) spinlock_profiling.cc:243] Waited 33.8 ms on lock 0x7b54000b2cd4. stack: 00007f4a79de9343 00007f4a79de9240 00007f4a797781d4 00007f4a834b6304 00007f4a834b6299 00007f4a7ce71571 00007f4a7cf0c2fa 00007f4a81ecdb17 00007f4a7b4486d4 00007f4a7b448662 00007f4a7b448591 00007f4a7b44850c 00007f4a7b4477c2 00007f4a7b24348c 00007f4a7b2428c6 00007f4a7b24226f
0709 13:06:46.122271 (+   160us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":77669248}
I20260709 13:06:46.146780 19410 raft_consensus.cc:1240] T 22196caba61445d3bec98a0aab3c337d P e5256d91808b47c195bc9b4dbd7f2b87 [term 15 FOLLOWER]: Rejecting Update request from peer 0473d2b2d01f4459b1e90fd12cc7840e for earlier term 14. Current term is 15. Ops: [14.10-14.10]
W20260709 13:06:46.153106 19449 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:46.154878 19477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48824d5acfbc485ebf8c2d944e7202de" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:06:46.157860 19477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86a6797bdfe94fa496c050ceae4bd0d9" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:06:46.118932 25185 raft_consensus.cc:3060] T d1e5873a19244c5ebbcd38e126796ee7 P e61c3a8f61bb48f8a963c9480e53c168 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:06:46.163859 20078 leader_election.cc:304] T 14efcc79969f41babe5529c22d59156d P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, 127766fc592545a4997f7790f50f6076; no voters: e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:06:46.165096 19557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f575b143b844aa096b50997dad3516a" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:06:46.168478 19410 raft_consensus.cc:1240] T f1b10566f45d4a7d9029858330e02d5b P e5256d91808b47c195bc9b4dbd7f2b87 [term 16 FOLLOWER]: Rejecting Update request from peer e61c3a8f61bb48f8a963c9480e53c168 for earlier term 15. Current term is 16. Ops: []
I20260709 13:06:46.172267 19557 raft_consensus.cc:2393] T 7f575b143b844aa096b50997dad3516a P e61c3a8f61bb48f8a963c9480e53c168 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 0473d2b2d01f4459b1e90fd12cc7840e in current term 13: Already voted for candidate e61c3a8f61bb48f8a963c9480e53c168 in this term.
I20260709 13:06:46.177074 19449 leader_election.cc:304] T 3e1f505cb0f1427bbd698ac889d80821 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e; no voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:06:46.142089 19407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70797e5783b5454ab0d0eea663e791e3" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 18 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
I20260709 13:06:46.178381 19407 raft_consensus.cc:2393] T 70797e5783b5454ab0d0eea663e791e3 P e5256d91808b47c195bc9b4dbd7f2b87 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate e61c3a8f61bb48f8a963c9480e53c168 in current term 18: Already voted for candidate e5256d91808b47c195bc9b4dbd7f2b87 in this term.
I20260709 13:06:46.178511 19410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86a6797bdfe94fa496c050ceae4bd0d9" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
I20260709 13:06:46.181198 19410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f93ee515a9c14139bf566522ed8232f3" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
I20260709 13:06:46.181257 19407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "179fd671030940b4b4a4e24bcc4aba0a" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:06:46.116613 25211 consensus_queue.cc:1059] T 9962423cb4e54fcfa5de01daf68a86e7 P 127766fc592545a4997f7790f50f6076 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.069s
I20260709 13:06:46.183169 19480 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58286 (request call id 2425) took 1837 ms. Trace:
I20260709 13:06:46.183054 19410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f575b143b844aa096b50997dad3516a" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
I20260709 13:06:46.185773 19480 rpcz_store.cc:276] 0709 13:06:44.345418 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:44.475638 (+130220us) service_pool.cc:224] Handling call
0709 13:06:44.499143 (+ 23505us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:44.570566 (+ 71423us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:44.570619 (+    53us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:44.570659 (+    40us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:06:44.570711 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:46.182956 (+1612245us) spinlock_profiling.cc:243] Waited 71.2 ms on lock 0x7b5400225454. stack: 00007f4a79de9343 00007f4a79de9240 00007f4a797781d4 00007f4a834b6304 00007f4a834b6299 00007f4a7ce71571 00007f4a7cf08e01 00007f4a7cf0783e 00007f4a81ecc419 00007f4a7b443bd4 00007f4a7b443b62 00007f4a7b443a91 00007f4a7b443a0c 00007f4a7b442cc2 00007f4a7b24348c 00007f4a7b2428c6
0709 13:06:46.183007 (+    51us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:46.183121 (+   114us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":163831040}
I20260709 13:06:46.179502 19485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40e1e16737a842ee936002830f36882e" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:06:46.144104 25188 leader_election.cc:290] T 7f575b143b844aa096b50997dad3516a P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 13 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
W20260709 13:06:46.189781 19374 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:46.187377 19485 raft_consensus.cc:2468] T 40e1e16737a842ee936002830f36882e P 0473d2b2d01f4459b1e90fd12cc7840e [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 17.
I20260709 13:06:46.166797 24932 raft_consensus.cc:2804] T 172b3dd13109415a955b71ac0e9d2234 P 0473d2b2d01f4459b1e90fd12cc7840e [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:06:46.190755 19407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40e1e16737a842ee936002830f36882e" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:06:46.182653 19486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f575b143b844aa096b50997dad3516a" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
W20260709 13:06:46.194332 19377 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.2:46257, user_credentials={real_user=slave}} blocked reactor thread for 350737us
I20260709 13:06:46.195056 19486 raft_consensus.cc:2393] T 7f575b143b844aa096b50997dad3516a P 0473d2b2d01f4459b1e90fd12cc7840e [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate e61c3a8f61bb48f8a963c9480e53c168 in current term 13: Already voted for candidate 0473d2b2d01f4459b1e90fd12cc7840e in this term.
I20260709 13:06:46.181999 19403 raft_consensus.cc:2468] T 7f575b143b844aa096b50997dad3516a P e5256d91808b47c195bc9b4dbd7f2b87 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 13.
I20260709 13:06:46.166796 25096 consensus_queue.cc:1059] T 76cb037fc9064d13b59a8969d897ce8c P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.027s
I20260709 13:06:46.201452 19410 raft_consensus.cc:1240] T 5ec1c4ce15e04c7e8c283a62179f2a64 P e5256d91808b47c195bc9b4dbd7f2b87 [term 11 FOLLOWER]: Rejecting Update request from peer 127766fc592545a4997f7790f50f6076 for earlier term 10. Current term is 11. Ops: []
W20260709 13:06:46.193866 25199 log.cc:927] Time spent T 0cdf56e38bbc453d9438d359e5a69955 P e61c3a8f61bb48f8a963c9480e53c168: Append to log took a long time: real 0.210s	user 0.000s	sys 0.001s
I20260709 13:06:46.204299 19449 leader_election.cc:304] T df751f992649444090e27965eb1af85d P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e; no voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:06:46.205119 19479 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58286 (request call id 2418) took 2017 ms. Trace:
I20260709 13:06:46.206334 19449 leader_election.cc:304] T 1f85fc4b527a48848e5faa083b604e36 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e; no voters: 127766fc592545a4997f7790f50f6076, e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:06:46.208165 19407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "172b3dd13109415a955b71ac0e9d2234" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
I20260709 13:06:46.205611 19479 rpcz_store.cc:276] 0709 13:06:44.187803 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:44.234329 (+ 46526us) service_pool.cc:224] Handling call
0709 13:06:44.234520 (+   191us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:44.871255 (+636735us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:46.204837 (+1333582us) spinlock_profiling.cc:243] Waited 636 ms on lock 0x7b54000a9454. stack: 00007f4a79de9343 00007f4a79de9240 00007f4a797781d4 00007f4a834b6304 00007f4a834b6299 00007f4a7ce71571 00007f4a7cf08e01 00007f4a7cf0783e 00007f4a81ecc419 00007f4a7b443bd4 00007f4a7b443b62 00007f4a7b443a91 00007f4a7b443a0c 00007f4a7b442cc2 00007f4a7b24348c 00007f4a7b2428c6
0709 13:06:46.205048 (+   211us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1463038336}
I20260709 13:06:46.212975 19449 leader_election.cc:304] T 40e1e16737a842ee936002830f36882e P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e; no voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:06:46.194389 24932 raft_consensus.cc:493] T 172b3dd13109415a955b71ac0e9d2234 P 0473d2b2d01f4459b1e90fd12cc7840e [term 14 FOLLOWER]: Starting leader election (detected failure of leader e5256d91808b47c195bc9b4dbd7f2b87)
I20260709 13:06:46.216709 24930 raft_consensus.cc:2749] T 40e1e16737a842ee936002830f36882e P 0473d2b2d01f4459b1e90fd12cc7840e [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:06:46.218291 19449 leader_election.cc:304] T d1e5873a19244c5ebbcd38e126796ee7 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e; no voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:06:46.198518 25076 raft_consensus.cc:2804] T 14efcc79969f41babe5529c22d59156d P 127766fc592545a4997f7790f50f6076 [term 17 FOLLOWER]: Leader election won for term 17
W20260709 13:06:46.220655 20078 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.2:46257, user_credentials={real_user=slave}} blocked reactor thread for 56866.3us
I20260709 13:06:46.206825 25188 raft_consensus.cc:2749] T 3e1f505cb0f1427bbd698ac889d80821 P 0473d2b2d01f4459b1e90fd12cc7840e [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:06:46.215201 25154 raft_consensus.cc:2749] T df751f992649444090e27965eb1af85d P 0473d2b2d01f4459b1e90fd12cc7840e [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
W20260709 13:06:46.233592 20075 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.1:40321, user_credentials={real_user=slave}} blocked reactor thread for 44789.2us
W20260709 13:06:46.234766 19523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.1:40321, user_credentials={real_user=slave}} blocked reactor thread for 118989us
I20260709 13:06:46.233105 19449 leader_election.cc:304] T 76cb037fc9064d13b59a8969d897ce8c P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87; no voters: e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:06:46.219610 24932 raft_consensus.cc:3060] T 172b3dd13109415a955b71ac0e9d2234 P 0473d2b2d01f4459b1e90fd12cc7840e [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:06:46.236546 19449 leader_election.cc:304] T ef32ce6fdd0e40d382c79974f30295c6 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87; no voters: e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:06:46.219980 25097 leader_election.cc:290] T ff75a1d4cb1f493db8f71ddc136ba9ab P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:06:46.235664 25063 raft_consensus.cc:2804] T 76cb037fc9064d13b59a8969d897ce8c P 0473d2b2d01f4459b1e90fd12cc7840e [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:06:46.219532 25210 raft_consensus.cc:3060] T 1f85fc4b527a48848e5faa083b604e36 P 0473d2b2d01f4459b1e90fd12cc7840e [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:06:46.248488 19484 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58286 (request call id 2430) took 1758 ms. Trace:
I20260709 13:06:46.248888 19484 rpcz_store.cc:276] 0709 13:06:44.490371 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:44.511119 (+ 20748us) service_pool.cc:224] Handling call
0709 13:06:46.248322 (+1737203us) spinlock_profiling.cc:243] Waited 45 ms on lock 0x7b540030cad4. stack: 00007f4a79de9343 00007f4a79de9240 00007f4a797781d4 00007f4a834b6304 00007f4a834b6299 00007f4a7ce71571 00007f4a7cf0c2fa 00007f4a81ecdb17 00007f4a7b4486d4 00007f4a7b448662 00007f4a7b448591 00007f4a7b44850c 00007f4a7b4477c2 00007f4a7b24348c 00007f4a7b2428c6 00007f4a7b24226f
0709 13:06:46.248424 (+   102us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":103599872}
W20260709 13:06:46.237246 25201 log.cc:927] Time spent T 86a6797bdfe94fa496c050ceae4bd0d9 P e5256d91808b47c195bc9b4dbd7f2b87: Append to log took a long time: real 0.216s	user 0.000s	sys 0.001s
I20260709 13:06:46.232656 24930 raft_consensus.cc:2749] T d1e5873a19244c5ebbcd38e126796ee7 P 0473d2b2d01f4459b1e90fd12cc7840e [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:06:46.228396 25211 consensus_queue.cc:1059] T 1f85fc4b527a48848e5faa083b604e36 P 127766fc592545a4997f7790f50f6076 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 }, Status: INVALID_TERM, Last received: 13.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.018s
I20260709 13:06:46.245255 19402 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52342 (request call id 2962) took 1709 ms. Trace:
I20260709 13:06:46.255481 19402 rpcz_store.cc:276] 0709 13:06:44.535665 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:46.030476 (+1494811us) service_pool.cc:224] Handling call
0709 13:06:46.030733 (+   257us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:46.030923 (+   190us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 13:06:46.198871 (+167948us) log.cc:844] Serialized 14 byte log entry
0709 13:06:46.244905 (+ 46034us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:46.244959 (+    54us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:06:46.245005 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:46.245068 (+    63us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:46.245198 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":183277,"prepare.run_cpu_time_us":45,"prepare.run_wall_time_us":46,"raft.queue_time_us":2400,"raft.run_cpu_time_us":111,"raft.run_wall_time_us":5152,"thread_start_us":213263,"threads_started":2}
I20260709 13:06:46.280038 19403 raft_consensus.cc:1275] T f93ee515a9c14139bf566522ed8232f3 P e5256d91808b47c195bc9b4dbd7f2b87 [term 18 FOLLOWER]: Refusing update from remote peer e61c3a8f61bb48f8a963c9480e53c168: Log matching property violated. Preceding OpId in replica: term: 15 index: 7. Preceding OpId from leader: term: 16 index: 8. (index mismatch)
I20260709 13:06:46.253491 25063 raft_consensus.cc:697] T 76cb037fc9064d13b59a8969d897ce8c P 0473d2b2d01f4459b1e90fd12cc7840e [term 15 LEADER]: Becoming Leader. State: Replica: 0473d2b2d01f4459b1e90fd12cc7840e, State: Running, Role: LEADER
I20260709 13:06:46.286758 24926 leader_election.cc:290] T 2b74109013a140ada21feeef92d6f563 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
W20260709 13:06:46.279965 19449 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.1:40321, user_credentials={real_user=slave}} blocked reactor thread for 44065.2us
I20260709 13:06:46.289144 19449 leader_election.cc:304] T bc225c93219c45538b53a1bd3d387e4d P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e; no voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168
W20260709 13:06:46.290546 25206 log.cc:927] Time spent T f93ee515a9c14139bf566522ed8232f3 P e61c3a8f61bb48f8a963c9480e53c168: Append to log took a long time: real 0.350s	user 0.002s	sys 0.000s
I20260709 13:06:46.291025 19375 leader_election.cc:304] T 14935b3ddf914369822e4a0547aaa355 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87; no voters: 127766fc592545a4997f7790f50f6076, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:06:46.290436 19449 leader_election.cc:304] T 2e36a9d6e29c4a7c860cf267efbd4c74 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e; no voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:06:46.298811 25208 raft_consensus.cc:2749] T 14935b3ddf914369822e4a0547aaa355 P e5256d91808b47c195bc9b4dbd7f2b87 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:06:46.299343 24930 raft_consensus.cc:2749] T bc225c93219c45538b53a1bd3d387e4d P 0473d2b2d01f4459b1e90fd12cc7840e [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:06:46.300007 24930 raft_consensus.cc:2749] T 2e36a9d6e29c4a7c860cf267efbd4c74 P 0473d2b2d01f4459b1e90fd12cc7840e [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:06:46.299942 19449 leader_election.cc:304] T 2725d2c4cb054f18b0fc8f735c15f6c2 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e; no voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:06:46.301254 24990 raft_consensus.cc:3060] T 1a61655d99124a29b486ba4a5b37faea P 0473d2b2d01f4459b1e90fd12cc7840e [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:06:46.301877 24930 raft_consensus.cc:3060] T 2725d2c4cb054f18b0fc8f735c15f6c2 P 0473d2b2d01f4459b1e90fd12cc7840e [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:06:46.302851 25097 consensus_queue.cc:1059] T fa8650e71aa14778b3d73721fc50d9fc P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 }, Status: INVALID_TERM, Last received: 15.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:06:46.304064 25154 raft_consensus.cc:3055] T fa8650e71aa14778b3d73721fc50d9fc P 0473d2b2d01f4459b1e90fd12cc7840e [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:06:46.304522 25154 raft_consensus.cc:740] T fa8650e71aa14778b3d73721fc50d9fc P 0473d2b2d01f4459b1e90fd12cc7840e [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 0473d2b2d01f4459b1e90fd12cc7840e, State: Running, Role: LEADER
I20260709 13:06:46.305473 25154 consensus_queue.cc:260] T fa8650e71aa14778b3d73721fc50d9fc P 0473d2b2d01f4459b1e90fd12cc7840e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.8, Last appended by leader: 8, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
W20260709 13:06:46.271088 25200 log.cc:927] Time spent T edd7d470b5014c9489be7f41f64355c9 P e61c3a8f61bb48f8a963c9480e53c168: Append to log took a long time: real 0.341s	user 0.006s	sys 0.000s
W20260709 13:06:46.308058 19404 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52342 (request call id 2948) took 2478 ms (client timeout 1855 ms). Trace:
W20260709 13:06:46.308400 19404 rpcz_store.cc:269] 0709 13:06:43.805007 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:43.805294 (+   287us) service_pool.cc:224] Handling call
0709 13:06:46.279550 (+2474256us) spinlock_profiling.cc:243] Waited 621 ms on lock 0x7b54000e65d4. stack: 00007f4a79de9343 00007f4a79de9240 00007f4a797781d4 00007f4a834b6304 00007f4a834b6299 00007f4a7ce71571 00007f4a7cf0c2fa 00007f4a81ecdb17 00007f4a7b4486d4 00007f4a7b448662 00007f4a7b448591 00007f4a7b44850c 00007f4a7b4477c2 00007f4a7b24348c 00007f4a7b2428c6 00007f4a7b24226f
0709 13:06:46.281049 (+  1499us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1427846400}
W20260709 13:06:46.309527 20076 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.3:36891, user_credentials={real_user=slave}} blocked reactor thread for 1.06893e+06us
I20260709 13:06:46.308478 19449 leader_election.cc:304] T 9962423cb4e54fcfa5de01daf68a86e7 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87; no voters: 127766fc592545a4997f7790f50f6076
I20260709 13:06:46.293037 19375 leader_election.cc:304] T ff75a1d4cb1f493db8f71ddc136ba9ab P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:06:46.315440 19557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "833a2f0775ed407a94b8924ce50adb63" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:06:46.315958 19559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70797e5783b5454ab0d0eea663e791e3" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:06:46.316640 19559 raft_consensus.cc:2393] T 70797e5783b5454ab0d0eea663e791e3 P e61c3a8f61bb48f8a963c9480e53c168 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate e5256d91808b47c195bc9b4dbd7f2b87 in current term 18: Already voted for candidate e61c3a8f61bb48f8a963c9480e53c168 in this term.
I20260709 13:06:46.320161 19402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70797e5783b5454ab0d0eea663e791e3" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 18 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:06:46.320931 19402 raft_consensus.cc:2393] T 70797e5783b5454ab0d0eea663e791e3 P e5256d91808b47c195bc9b4dbd7f2b87 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e61c3a8f61bb48f8a963c9480e53c168 in current term 18: Already voted for candidate e5256d91808b47c195bc9b4dbd7f2b87 in this term.
I20260709 13:06:46.278308 24964 raft_consensus.cc:493] T 1f85fc4b527a48848e5faa083b604e36 P e5256d91808b47c195bc9b4dbd7f2b87 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:46.322664 20076 leader_election.cc:304] T ece3db938bc649d4a40a51522ed5259c P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 127766fc592545a4997f7790f50f6076; no voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:06:46.333262 25076 raft_consensus.cc:697] T 14efcc79969f41babe5529c22d59156d P 127766fc592545a4997f7790f50f6076 [term 17 LEADER]: Becoming Leader. State: Replica: 127766fc592545a4997f7790f50f6076, State: Running, Role: LEADER
I20260709 13:06:46.335063 19557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa8650e71aa14778b3d73721fc50d9fc" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:06:46.337970 19523 leader_election.cc:304] T fa8650e71aa14778b3d73721fc50d9fc P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e61c3a8f61bb48f8a963c9480e53c168; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:06:46.338582 19557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a61655d99124a29b486ba4a5b37faea" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:06:46.337320 19411 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52342 (request call id 2954) took 1869 ms. Trace:
I20260709 13:06:46.339200 19557 raft_consensus.cc:3060] T 1a61655d99124a29b486ba4a5b37faea P e61c3a8f61bb48f8a963c9480e53c168 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:06:46.339593 19523 leader_election.cc:304] T 28af091831594f9d8e96482078cc7625 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168; no voters: 0473d2b2d01f4459b1e90fd12cc7840e
I20260709 13:06:46.284034 25188 raft_consensus.cc:2804] T ef32ce6fdd0e40d382c79974f30295c6 P 0473d2b2d01f4459b1e90fd12cc7840e [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:06:46.340696 19559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21e14947d70440f19044d8f75c31e1f9" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:06:46.339304 19411 rpcz_store.cc:276] 0709 13:06:44.468192 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:44.874554 (+406362us) service_pool.cc:224] Handling call
0709 13:06:44.874843 (+   289us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:44.875009 (+   166us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 13:06:44.877549 (+  2540us) log.cc:844] Serialized 14 byte log entry
0709 13:06:46.307756 (+1430207us) spinlock_profiling.cc:243] Waited 5.68 ms on lock 0x7b1800454a80. stack: 00007f4a79de9343 00007f4a79de9240 00007f4a797781d4 00007f4a834b6304 00007f4a834b6299 00007f4a82ce3de1 00007f4a82cf05b1 00007f4a79dfde07 00007f4a82c58ab9 00007f4a79e1a69b 00007f4a79e1893f 00007f4a79e1ac02 00007f4a7caa220b 00007f4a7caa7d23 00007f4a7caa823a 00007f4a7cf12a2a
0709 13:06:46.336785 (+ 29029us) log.cc:844] Serialized 14 byte log entry
0709 13:06:46.336967 (+   182us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:46.337019 (+    52us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:06:46.337073 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:46.337140 (+    67us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:46.337265 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":811,"prepare.run_cpu_time_us":76,"prepare.run_wall_time_us":11296,"raft.queue_time_us":399,"spinlock_wait_cycles":19370624,"thread_start_us":28584,"threads_started":1,"wal-append.queue_time_us":1456257}
I20260709 13:06:46.344872 19558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f575b143b844aa096b50997dad3516a" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
W20260709 13:06:46.340828 20075 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.1:40321, user_credentials={real_user=slave}} blocked reactor thread for 106367us
I20260709 13:06:46.346426 19558 raft_consensus.cc:2368] T 7f575b143b844aa096b50997dad3516a P e61c3a8f61bb48f8a963c9480e53c168 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e5256d91808b47c195bc9b4dbd7f2b87 for earlier term 12. Current term is 13.
I20260709 13:06:46.349740 25163 raft_consensus.cc:3060] T fa8650e71aa14778b3d73721fc50d9fc P e61c3a8f61bb48f8a963c9480e53c168 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:06:46.274571 25085 raft_consensus.cc:515] T 46c5bfeecc314717bffe987e6844b6d0 P e5256d91808b47c195bc9b4dbd7f2b87 [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:46.353075 19523 leader_election.cc:304] T fa731b585f684a7fb2d106c50f143b83 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:06:46.354856 19560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dc5b3532fe54f74876d02beffa2c230" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 18 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:06:46.355877 19406 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52342 (request call id 2955) took 1887 ms. Trace:
I20260709 13:06:46.356329 19406 rpcz_store.cc:276] 0709 13:06:44.468444 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:45.081040 (+612596us) service_pool.cc:224] Handling call
0709 13:06:45.081576 (+   536us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:45.082759 (+  1183us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:45.082793 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:45.312869 (+230076us) spinlock_profiling.cc:243] Waited 23 ms on lock 0x7b2c00032ed8. stack: 00007f4a79de9343 00007f4a79de9240 00007f4a797781d4 00007f4a834b6304 00007f4a834b6299 00007f4a7b801a11 00007f4a7b811372 00007f4a7cf43a01 00007f4a7cf0843a 00007f4a7cf0783e 00007f4a81ecc419 00007f4a7b443bd4 00007f4a7b443b62 00007f4a7b443a91 00007f4a7b443a0c 00007f4a7b442cc2
0709 13:06:45.313224 (+   355us) log.cc:844] Serialized 26 byte log entry
0709 13:06:45.612791 (+299567us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:06:45.612840 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:45.612946 (+   106us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:46.355584 (+742638us) raft_consensus.cc:1685] finished
0709 13:06:46.355612 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:46.355823 (+   211us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":645,"raft.run_cpu_time_us":88,"raft.run_wall_time_us":89,"spinlock_wait_cycles":52811520,"thread_start_us":298356,"threads_started":1,"wal-append.queue_time_us":633614}
I20260709 13:06:46.283586 25063 consensus_queue.cc:237] T 76cb037fc9064d13b59a8969d897ce8c P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:46.332424 25039 raft_consensus.cc:2804] T ff75a1d4cb1f493db8f71ddc136ba9ab P e5256d91808b47c195bc9b4dbd7f2b87 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:06:46.337414 25165 consensus_queue.cc:1048] T ef32ce6fdd0e40d382c79974f30295c6 P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.029s
I20260709 13:06:46.343091 25154 raft_consensus.cc:3060] T fa8650e71aa14778b3d73721fc50d9fc P 0473d2b2d01f4459b1e90fd12cc7840e [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:06:46.363811 19560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2725d2c4cb054f18b0fc8f735c15f6c2" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:06:46.334894 25078 raft_consensus.cc:2804] T 9962423cb4e54fcfa5de01daf68a86e7 P 0473d2b2d01f4459b1e90fd12cc7840e [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:06:46.365186 19553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ece3db938bc649d4a40a51522ed5259c" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:06:46.365382 20076 leader_election.cc:304] T 62c6c134d3d24a1ab144dd9ee6bc3f64 P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 127766fc592545a4997f7790f50f6076, e61c3a8f61bb48f8a963c9480e53c168; no voters: 0473d2b2d01f4459b1e90fd12cc7840e
I20260709 13:06:46.338414 24964 raft_consensus.cc:515] T 1f85fc4b527a48848e5faa083b604e36 P e5256d91808b47c195bc9b4dbd7f2b87 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:46.374097 25087 consensus_queue.cc:1059] T 2b74109013a140ada21feeef92d6f563 P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 }, Status: INVALID_TERM, Last received: 12.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:06:46.367538 24702 raft_consensus.cc:2804] T fa731b585f684a7fb2d106c50f143b83 P e61c3a8f61bb48f8a963c9480e53c168 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:06:46.376394 25096 consensus_queue.cc:1059] T 2725d2c4cb054f18b0fc8f735c15f6c2 P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 }, Status: INVALID_TERM, Last received: 17.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:06:46.377460 19523 leader_election.cc:304] T 7f575b143b844aa096b50997dad3516a P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:06:46.378089 25051 consensus_queue.cc:1059] T f1b10566f45d4a7d9029858330e02d5b P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 }, Status: INVALID_TERM, Last received: 15.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:06:46.378986 19558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "217b5fae677b4971b3bbd2f357a1f7ff" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:06:46.343798 25221 consensus_queue.cc:1048] T 309c3ca0ca4b4f3ba129752ea2cb293b P 127766fc592545a4997f7790f50f6076 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.045s
I20260709 13:06:46.383018 24926 raft_consensus.cc:493] T 96efeaaf1057492490e9a621f37e1a2d P 0473d2b2d01f4459b1e90fd12cc7840e [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:46.383598 19409 raft_consensus.cc:1240] T 46c5bfeecc314717bffe987e6844b6d0 P e5256d91808b47c195bc9b4dbd7f2b87 [term 22 FOLLOWER]: Rejecting Update request from peer 0473d2b2d01f4459b1e90fd12cc7840e for earlier term 21. Current term is 22. Ops: [21.11-21.11]
I20260709 13:06:46.384253 24930 raft_consensus.cc:2749] T 2725d2c4cb054f18b0fc8f735c15f6c2 P 0473d2b2d01f4459b1e90fd12cc7840e [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:06:46.367789 25039 raft_consensus.cc:493] T ff75a1d4cb1f493db8f71ddc136ba9ab P e5256d91808b47c195bc9b4dbd7f2b87 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:06:46.374661 19452 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:46.384868 25085 leader_election.cc:290] T 46c5bfeecc314717bffe987e6844b6d0 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 22 election: Requested vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:06:46.382462 19555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edd7d470b5014c9489be7f41f64355c9" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:06:46.386997 19375 leader_election.cc:304] T 833a2f0775ed407a94b8924ce50adb63 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87; no voters: 127766fc592545a4997f7790f50f6076, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:06:46.420286 24702 raft_consensus.cc:493] T fa731b585f684a7fb2d106c50f143b83 P e61c3a8f61bb48f8a963c9480e53c168 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 127766fc592545a4997f7790f50f6076)
I20260709 13:06:46.393038 19557 raft_consensus.cc:2468] T 1a61655d99124a29b486ba4a5b37faea P e61c3a8f61bb48f8a963c9480e53c168 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 14.
W20260709 13:06:46.395120 19526 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:46.434026 19553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46c5bfeecc314717bffe987e6844b6d0" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 22 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
W20260709 13:06:46.438084 19449 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.1:40321, user_credentials={real_user=slave}} blocked reactor thread for 121318us
I20260709 13:06:46.364077 25058 raft_consensus.cc:2804] T 28af091831594f9d8e96482078cc7625 P e61c3a8f61bb48f8a963c9480e53c168 [term 16 FOLLOWER]: Leader pre-election won for term 17
W20260709 13:06:46.442546 19375 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.3:36891, user_credentials={real_user=slave}} blocked reactor thread for 55606.3us
I20260709 13:06:46.446033 19374 leader_election.cc:304] T 70797e5783b5454ab0d0eea663e791e3 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 127766fc592545a4997f7790f50f6076, e5256d91808b47c195bc9b4dbd7f2b87; no voters: e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:06:46.449272 19375 leader_election.cc:400] T 7f575b143b844aa096b50997dad3516a P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 12 pre-election: Vote denied by peer e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891) with higher term. Message: Invalid argument: T 7f575b143b844aa096b50997dad3516a P e61c3a8f61bb48f8a963c9480e53c168 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e5256d91808b47c195bc9b4dbd7f2b87 for earlier term 12. Current term is 13.
I20260709 13:06:46.450803 19375 leader_election.cc:403] T 7f575b143b844aa096b50997dad3516a P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 12 pre-election: Cancelling election due to peer responding with higher term
W20260709 13:06:46.450086 19523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.1:40321, user_credentials={real_user=slave}} blocked reactor thread for 72694.8us
I20260709 13:06:46.441237 25039 raft_consensus.cc:3060] T ff75a1d4cb1f493db8f71ddc136ba9ab P e5256d91808b47c195bc9b4dbd7f2b87 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:06:46.425263 25225 raft_consensus.cc:2749] T ece3db938bc649d4a40a51522ed5259c P 127766fc592545a4997f7790f50f6076 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:06:46.448140 25100 raft_consensus.cc:2749] T 833a2f0775ed407a94b8924ce50adb63 P e5256d91808b47c195bc9b4dbd7f2b87 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:06:46.463255 20078 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.2:46257, user_credentials={real_user=slave}} blocked reactor thread for 215137us
I20260709 13:06:46.390787 25138 consensus_queue.cc:1059] T 76cb037fc9064d13b59a8969d897ce8c P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 }, Status: INVALID_TERM, Last received: 12.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.064s
I20260709 13:06:46.445338 24702 raft_consensus.cc:3060] T fa731b585f684a7fb2d106c50f143b83 P e61c3a8f61bb48f8a963c9480e53c168 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:06:46.435097 24926 raft_consensus.cc:515] T 96efeaaf1057492490e9a621f37e1a2d P 0473d2b2d01f4459b1e90fd12cc7840e [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
W20260709 13:06:46.467796 19449 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:46.447336 25211 consensus_queue.cc:1059] T 9962423cb4e54fcfa5de01daf68a86e7 P 127766fc592545a4997f7790f50f6076 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 }, Status: INVALID_TERM, Last received: 13.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.031s
I20260709 13:06:46.462661 20103 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46422 (request call id 915) took 1515 ms. Trace:
I20260709 13:06:46.504707 20103 rpcz_store.cc:276] 0709 13:06:44.947677 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:44.947793 (+   116us) service_pool.cc:224] Handling call
0709 13:06:44.948087 (+   294us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:45.027551 (+ 79464us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:46.459678 (+1432127us) spinlock_profiling.cc:243] Waited 67.3 ms on lock 0x7b540036fe54. stack: 00007f4a79de9343 00007f4a79de9240 00007f4a797781d4 00007f4a834b6304 00007f4a834b6299 00007f4a7ce71571 00007f4a7cf08e01 00007f4a7cf0783e 00007f4a81ecc419 00007f4a7b443bd4 00007f4a7b443b62 00007f4a7b443a91 00007f4a7b443a0c 00007f4a7b442cc2 00007f4a7b24348c 00007f4a7b2428c6
0709 13:06:46.462600 (+  2922us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":154790784}
I20260709 13:06:46.390604 24932 raft_consensus.cc:515] T 172b3dd13109415a955b71ac0e9d2234 P 0473d2b2d01f4459b1e90fd12cc7840e [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:46.444707 25058 raft_consensus.cc:493] T 28af091831594f9d8e96482078cc7625 P e61c3a8f61bb48f8a963c9480e53c168 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 0473d2b2d01f4459b1e90fd12cc7840e)
I20260709 13:06:46.511027 25058 raft_consensus.cc:3060] T 28af091831594f9d8e96482078cc7625 P e61c3a8f61bb48f8a963c9480e53c168 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:06:46.512454 19551 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40428 (request call id 3033) took 1295 ms. Trace:
I20260709 13:06:46.512960 25210 raft_consensus.cc:2749] T 1f85fc4b527a48848e5faa083b604e36 P 0473d2b2d01f4459b1e90fd12cc7840e [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:06:46.513338 25188 raft_consensus.cc:697] T ef32ce6fdd0e40d382c79974f30295c6 P 0473d2b2d01f4459b1e90fd12cc7840e [term 20 LEADER]: Becoming Leader. State: Replica: 0473d2b2d01f4459b1e90fd12cc7840e, State: Running, Role: LEADER
I20260709 13:06:46.514256 25188 consensus_queue.cc:237] T ef32ce6fdd0e40d382c79974f30295c6 P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 18.10, Last appended by leader: 10, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
W20260709 13:06:46.515080 19450 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:46.516562 25220 raft_consensus.cc:3055] T 1f85fc4b527a48848e5faa083b604e36 P 127766fc592545a4997f7790f50f6076 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:06:46.516352 24702 raft_consensus.cc:515] T fa731b585f684a7fb2d106c50f143b83 P e61c3a8f61bb48f8a963c9480e53c168 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:46.517064 25220 raft_consensus.cc:740] T 1f85fc4b527a48848e5faa083b604e36 P 127766fc592545a4997f7790f50f6076 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 127766fc592545a4997f7790f50f6076, State: Running, Role: LEADER
I20260709 13:06:46.518381 19450 leader_election.cc:304] T 2b74109013a140ada21feeef92d6f563 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e; no voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:06:46.518687 24702 leader_election.cc:290] T fa731b585f684a7fb2d106c50f143b83 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 13 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:06:46.519435 25231 raft_consensus.cc:493] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P 0473d2b2d01f4459b1e90fd12cc7840e [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:46.520131 25231 raft_consensus.cc:515] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P 0473d2b2d01f4459b1e90fd12cc7840e [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:46.522511 19409 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52342 (request call id 2979) took 1158 ms. Trace:
I20260709 13:06:46.522939 19409 rpcz_store.cc:276] 0709 13:06:45.364553 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:46.114095 (+749542us) service_pool.cc:224] Handling call
0709 13:06:46.114344 (+   249us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:46.427382 (+313038us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:46.522246 (+ 94864us) spinlock_profiling.cc:243] Waited 269 ms on lock 0x7b5400239e54. stack: 00007f4a79de9343 00007f4a79de9240 00007f4a797781d4 00007f4a834b6304 00007f4a834b6299 00007f4a7ce71571 00007f4a7cf08e01 00007f4a7cf0783e 00007f4a81ecc419 00007f4a7b443bd4 00007f4a7b443b62 00007f4a7b443a91 00007f4a7b443a0c 00007f4a7b442cc2 00007f4a7b24348c 00007f4a7b2428c6
0709 13:06:46.522449 (+   203us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":618734336}
I20260709 13:06:46.524294 25210 raft_consensus.cc:3060] T 2b74109013a140ada21feeef92d6f563 P 0473d2b2d01f4459b1e90fd12cc7840e [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:06:46.495036 25224 raft_consensus.cc:2804] T 62c6c134d3d24a1ab144dd9ee6bc3f64 P 127766fc592545a4997f7790f50f6076 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:06:46.482916 19483 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58294 (request call id 2661) took 1896 ms. Trace:
I20260709 13:06:46.512907 19551 rpcz_store.cc:276] 0709 13:06:45.217399 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:45.911707 (+694308us) service_pool.cc:224] Handling call
0709 13:06:45.911980 (+   273us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:06:45.927483 (+ 15503us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:45.927513 (+    30us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:06:45.928109 (+   596us) log.cc:844] Serialized 52 byte log entry
0709 13:06:46.179150 (+251041us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:06:46.215646 (+ 36496us) log.cc:844] Serialized 14 byte log entry
0709 13:06:46.511653 (+296007us) spinlock_profiling.cc:243] Waited 3.84 ms on lock 0x7b18000c9b20. stack: 00007f4a79de9343 00007f4a79de9240 00007f4a797781d4 00007f4a834b6304 00007f4a834b6299 00007f4a82ce3de1 00007f4a82cf05b1 00007f4a79d95c0a 00007f4a834d5219 00007f4a7cabed70 00007f4a7cab2293 00007f4a7caa7cea 00007f4a7caa823a 00007f4a7cf12a2a 00007f4a7cf220bf 00007f4a7cf22038
0709 13:06:46.511975 (+   322us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:46.512057 (+    82us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:46.512107 (+    50us) raft_consensus.cc:1685] finished
0709 13:06:46.512201 (+    94us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:46.512367 (+   166us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":254666,"prepare.queue_time_us":26772,"prepare.run_cpu_time_us":41,"prepare.run_wall_time_us":42,"raft.queue_time_us":13583,"raft.run_cpu_time_us":192,"raft.run_wall_time_us":4086,"spinlock_wait_cycles":8831232,"thread_start_us":197894,"threads_started":1,"wal-append.queue_time_us":255639}
I20260709 13:06:46.422832 25227 consensus_queue.cc:1048] T 14935b3ddf914369822e4a0547aaa355 P 127766fc592545a4997f7790f50f6076 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.059s
I20260709 13:06:46.461313 24970 raft_consensus.cc:2804] T 7f575b143b844aa096b50997dad3516a P e61c3a8f61bb48f8a963c9480e53c168 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:06:46.452436 25078 raft_consensus.cc:697] T 9962423cb4e54fcfa5de01daf68a86e7 P 0473d2b2d01f4459b1e90fd12cc7840e [term 16 LEADER]: Becoming Leader. State: Replica: 0473d2b2d01f4459b1e90fd12cc7840e, State: Running, Role: LEADER
I20260709 13:06:46.492421 24700 raft_consensus.cc:3055] T 76cb037fc9064d13b59a8969d897ce8c P e61c3a8f61bb48f8a963c9480e53c168 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:06:46.459715 25094 raft_consensus.cc:2804] T 70797e5783b5454ab0d0eea663e791e3 P e5256d91808b47c195bc9b4dbd7f2b87 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:06:46.476528 19375 leader_election.cc:304] T 1a61655d99124a29b486ba4a5b37faea P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:06:46.334280 25076 consensus_queue.cc:237] T 14efcc79969f41babe5529c22d59156d P 127766fc592545a4997f7790f50f6076 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.12, Last appended by leader: 12, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:46.470418 25086 raft_consensus.cc:493] T 309c3ca0ca4b4f3ba129752ea2cb293b P e61c3a8f61bb48f8a963c9480e53c168 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:46.503211 19484 raft_consensus.cc:1240] T 2725d2c4cb054f18b0fc8f735c15f6c2 P 0473d2b2d01f4459b1e90fd12cc7840e [term 18 FOLLOWER]: Rejecting Update request from peer e61c3a8f61bb48f8a963c9480e53c168 for earlier term 17. Current term is 18. Ops: []
I20260709 13:06:46.468685 19526 leader_election.cc:304] T 86a6797bdfe94fa496c050ceae4bd0d9 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e61c3a8f61bb48f8a963c9480e53c168; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:06:46.528420 19409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff75a1d4cb1f493db8f71ddc136ba9ab" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:06:46.533982 19411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36f6ba92b9ba46babe4ebd6c02e5fbd9" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:06:46.475318 24972 raft_consensus.cc:2749] T 7f575b143b844aa096b50997dad3516a P e5256d91808b47c195bc9b4dbd7f2b87 [term 13 FOLLOWER]: Leader pre-election lost for term 12. Reason: Vote denied by peer e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891) with higher term. Message: Invalid argument: T 7f575b143b844aa096b50997dad3516a P e61c3a8f61bb48f8a963c9480e53c168 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e5256d91808b47c195bc9b4dbd7f2b87 for earlier term 12. Current term is 13.
W20260709 13:06:46.531780 19524 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:46.491900 24964 leader_election.cc:290] T 1f85fc4b527a48848e5faa083b604e36 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:06:46.535637 19483 rpcz_store.cc:276] 0709 13:06:44.586439 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:45.329628 (+743189us) service_pool.cc:224] Handling call
0709 13:06:45.336897 (+  7269us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:45.337206 (+   309us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:45.337247 (+    41us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:45.337690 (+   443us) log.cc:844] Serialized 26 byte log entry
0709 13:06:46.482293 (+1144603us) spinlock_profiling.cc:243] Waited 3.35 ms on lock 0x7b18003eaac0. stack: 00007f4a79de9343 00007f4a79de9240 00007f4a797781d4 00007f4a834b6304 00007f4a834b6299 00007f4a82ce3de1 00007f4a82cf05b1 00007f4a7cab04bc 00007f4a79dfe48b 00007f4a82c58ab9 00007f4a79e1a69b 00007f4a79e1893f 00007f4a79e1ac02 00007f4a7caa220b 00007f4a7caa7d23 00007f4a7caa80d1
0709 13:06:46.482456 (+   163us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:06:46.482497 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:46.482580 (+    83us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:46.482627 (+    47us) raft_consensus.cc:1685] finished
0709 13:06:46.482641 (+    14us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:46.482855 (+   214us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3769,"raft.queue_time_us":6634,"raft.run_cpu_time_us":129,"raft.run_wall_time_us":8923,"spinlock_wait_cycles":7703296,"thread_start_us":43470,"threads_started":1,"wal-append.queue_time_us":520818}
I20260709 13:06:46.464406 25127 consensus_queue.cc:1059] T 172b3dd13109415a955b71ac0e9d2234 P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false }, Status: INVALID_TERM, Last received: 14.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.042s
W20260709 13:06:46.541127 20075 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.1:40321, user_credentials={real_user=slave}} blocked reactor thread for 175083us
I20260709 13:06:46.546098 20109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14935b3ddf914369822e4a0547aaa355" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:06:46.587787 20108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ec1c4ce15e04c7e8c283a62179f2a64" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076"
I20260709 13:06:46.547580 20110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa731b585f684a7fb2d106c50f143b83" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:06:46.548909 20105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48824d5acfbc485ebf8c2d944e7202de" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:06:46.551609 20111 raft_consensus.cc:1275] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P 127766fc592545a4997f7790f50f6076 [term 17 FOLLOWER]: Refusing update from remote peer e5256d91808b47c195bc9b4dbd7f2b87: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 17 index: 14. (index mismatch)
I20260709 13:06:46.588816 19551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff75a1d4cb1f493db8f71ddc136ba9ab" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:06:46.552680 20104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ece3db938bc649d4a40a51522ed5259c" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:06:46.589500 19551 raft_consensus.cc:2468] T ff75a1d4cb1f493db8f71ddc136ba9ab P e61c3a8f61bb48f8a963c9480e53c168 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 16.
I20260709 13:06:46.555627 20106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36f6ba92b9ba46babe4ebd6c02e5fbd9" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:06:46.590204 20106 raft_consensus.cc:2468] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P 127766fc592545a4997f7790f50f6076 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 17.
W20260709 13:06:46.556048 20076 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.3:36891, user_credentials={real_user=slave}} blocked reactor thread for 190731us
I20260709 13:06:46.518177 25220 consensus_queue.cc:260] T 1f85fc4b527a48848e5faa083b604e36 P 127766fc592545a4997f7790f50f6076 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:46.587217 20107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70797e5783b5454ab0d0eea663e791e3" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 18 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076"
I20260709 13:06:46.536310 25224 raft_consensus.cc:493] T 62c6c134d3d24a1ab144dd9ee6bc3f64 P 127766fc592545a4997f7790f50f6076 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 0473d2b2d01f4459b1e90fd12cc7840e)
I20260709 13:06:46.535063 25231 leader_election.cc:290] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:06:46.600579 20076 leader_election.cc:304] T 7be9efa6559648dbb5a0f7684c4542d1 P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, 127766fc592545a4997f7790f50f6076, e61c3a8f61bb48f8a963c9480e53c168; no voters: e5256d91808b47c195bc9b4dbd7f2b87
W20260709 13:06:46.564338 19375 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.3:36891, user_credentials={real_user=slave}} blocked reactor thread for 87897us
I20260709 13:06:46.597867 20109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f85fc4b527a48848e5faa083b604e36" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:06:46.601790 20107 raft_consensus.cc:2393] T 70797e5783b5454ab0d0eea663e791e3 P 127766fc592545a4997f7790f50f6076 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate e61c3a8f61bb48f8a963c9480e53c168 in current term 18: Already voted for candidate e5256d91808b47c195bc9b4dbd7f2b87 in this term.
I20260709 13:06:46.556836 24700 raft_consensus.cc:740] T 76cb037fc9064d13b59a8969d897ce8c P e61c3a8f61bb48f8a963c9480e53c168 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: e61c3a8f61bb48f8a963c9480e53c168, State: Running, Role: LEADER
I20260709 13:06:46.592744 20104 raft_consensus.cc:2393] T ece3db938bc649d4a40a51522ed5259c P 127766fc592545a4997f7790f50f6076 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e5256d91808b47c195bc9b4dbd7f2b87 in current term 13: Already voted for candidate 127766fc592545a4997f7790f50f6076 in this term.
I20260709 13:06:46.602788 19375 leader_election.cc:304] T edd7d470b5014c9489be7f41f64355c9 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:06:46.516569 25237 consensus_queue.cc:1048] T 6c5eebf646ad445a9d1b1adc319d7b16 P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Connected to new peer: Peer: permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.070s
I20260709 13:06:46.582894 25056 raft_consensus.cc:2804] T 1a61655d99124a29b486ba4a5b37faea P e5256d91808b47c195bc9b4dbd7f2b87 [term 14 FOLLOWER]: Leader election won for term 14
W20260709 13:06:46.598487 19526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.2:46257, user_credentials={real_user=slave}} blocked reactor thread for 129880us
I20260709 13:06:46.626914 19526 leader_election.cc:304] T 40e1e16737a842ee936002830f36882e P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168; no voters: e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:06:46.604084 19411 raft_consensus.cc:1275] T 65d8cb8d6ec64f459d5a47cefab10acf P e5256d91808b47c195bc9b4dbd7f2b87 [term 18 FOLLOWER]: Refusing update from remote peer 127766fc592545a4997f7790f50f6076: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
W20260709 13:06:46.605790 19375 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:46.588406 19450 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.3:36891, user_credentials={real_user=slave}} blocked reactor thread for 70107.3us
I20260709 13:06:46.590943 25094 raft_consensus.cc:697] T 70797e5783b5454ab0d0eea663e791e3 P e5256d91808b47c195bc9b4dbd7f2b87 [term 18 LEADER]: Becoming Leader. State: Replica: e5256d91808b47c195bc9b4dbd7f2b87, State: Running, Role: LEADER
I20260709 13:06:46.562614 24970 raft_consensus.cc:697] T 7f575b143b844aa096b50997dad3516a P e61c3a8f61bb48f8a963c9480e53c168 [term 13 LEADER]: Becoming Leader. State: Replica: e61c3a8f61bb48f8a963c9480e53c168, State: Running, Role: LEADER
I20260709 13:06:46.634378 20076 leader_election.cc:304] T 0afb57ae58a24a01850491d69f0213dd P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 127766fc592545a4997f7790f50f6076; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:06:46.625787 25237 consensus_queue.cc:1243] T 6c5eebf646ad445a9d1b1adc319d7b16 P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Peer 127766fc592545a4997f7790f50f6076 log is divergent from this leader: its last log entry 13.11 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 10
I20260709 13:06:46.629719 19450 leader_election.cc:304] T e381f1d6b8184797ad142de49be225a8 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e; no voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:06:46.643918 20076 leader_election.cc:304] T 85c494af21f9457a85da47b9bc70c1fd P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 127766fc592545a4997f7790f50f6076; no voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168
W20260709 13:06:46.598857 25157 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.666s	user 0.000s	sys 0.012s
I20260709 13:06:46.603298 25224 raft_consensus.cc:3060] T 62c6c134d3d24a1ab144dd9ee6bc3f64 P 127766fc592545a4997f7790f50f6076 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:06:46.604190 24990 consensus_queue.cc:1059] T 46c5bfeecc314717bffe987e6844b6d0 P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 }, Status: INVALID_TERM, Last received: 20.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.041s
I20260709 13:06:46.595924 24824 consensus_queue.cc:1048] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Connected to new peer: Peer: permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.040s
I20260709 13:06:46.624130 25233 consensus_queue.cc:1059] T 5ec1c4ce15e04c7e8c283a62179f2a64 P 127766fc592545a4997f7790f50f6076 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.059s
I20260709 13:06:46.642230 25089 raft_consensus.cc:493] T 65d8cb8d6ec64f459d5a47cefab10acf P e5256d91808b47c195bc9b4dbd7f2b87 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:06:46.663193 25157 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.732s	user 0.002s	sys 0.012s
I20260709 13:06:46.663415 25089 raft_consensus.cc:515] T 65d8cb8d6ec64f459d5a47cefab10acf P e5256d91808b47c195bc9b4dbd7f2b87 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:46.647261 25094 consensus_queue.cc:237] T 70797e5783b5454ab0d0eea663e791e3 P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.12, Last appended by leader: 12, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:46.665529 25089 leader_election.cc:290] T 65d8cb8d6ec64f459d5a47cefab10acf P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:06:46.645242 25138 raft_consensus.cc:2804] T 40e1e16737a842ee936002830f36882e P e61c3a8f61bb48f8a963c9480e53c168 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:06:46.666165 25138 raft_consensus.cc:493] T 40e1e16737a842ee936002830f36882e P e61c3a8f61bb48f8a963c9480e53c168 [term 17 FOLLOWER]: Starting leader election (detected failure of leader e5256d91808b47c195bc9b4dbd7f2b87)
I20260709 13:06:46.666607 25138 raft_consensus.cc:3060] T 40e1e16737a842ee936002830f36882e P e61c3a8f61bb48f8a963c9480e53c168 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:06:46.666850 24926 leader_election.cc:290] T 96efeaaf1057492490e9a621f37e1a2d P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:06:46.659523 25185 raft_consensus.cc:493] T 96efeaaf1057492490e9a621f37e1a2d P e61c3a8f61bb48f8a963c9480e53c168 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:46.629550 19526 leader_election.cc:304] T 3e1f505cb0f1427bbd698ac889d80821 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168; no voters: e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:06:46.668772 25051 raft_consensus.cc:2804] T 3e1f505cb0f1427bbd698ac889d80821 P e61c3a8f61bb48f8a963c9480e53c168 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:06:46.669224 25051 raft_consensus.cc:493] T 3e1f505cb0f1427bbd698ac889d80821 P e61c3a8f61bb48f8a963c9480e53c168 [term 18 FOLLOWER]: Starting leader election (detected failure of leader e5256d91808b47c195bc9b4dbd7f2b87)
I20260709 13:06:46.669648 25051 raft_consensus.cc:3060] T 3e1f505cb0f1427bbd698ac889d80821 P e61c3a8f61bb48f8a963c9480e53c168 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:06:46.647694 25225 raft_consensus.cc:2749] T 0afb57ae58a24a01850491d69f0213dd P 127766fc592545a4997f7790f50f6076 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:06:46.671164 24990 raft_consensus.cc:3055] T 46c5bfeecc314717bffe987e6844b6d0 P 0473d2b2d01f4459b1e90fd12cc7840e [term 21 LEADER]: Stepping down as leader of term 21
I20260709 13:06:46.671608 24990 raft_consensus.cc:740] T 46c5bfeecc314717bffe987e6844b6d0 P 0473d2b2d01f4459b1e90fd12cc7840e [term 21 LEADER]: Becoming Follower/Learner. State: Replica: 0473d2b2d01f4459b1e90fd12cc7840e, State: Running, Role: LEADER
I20260709 13:06:46.672611 24990 consensus_queue.cc:260] T 46c5bfeecc314717bffe987e6844b6d0 P 0473d2b2d01f4459b1e90fd12cc7840e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 21.11, Last appended by leader: 11, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:46.672880 25058 raft_consensus.cc:515] T 28af091831594f9d8e96482078cc7625 P e61c3a8f61bb48f8a963c9480e53c168 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:46.673484 25233 raft_consensus.cc:3055] T 5ec1c4ce15e04c7e8c283a62179f2a64 P 127766fc592545a4997f7790f50f6076 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:06:46.673827 25233 raft_consensus.cc:740] T 5ec1c4ce15e04c7e8c283a62179f2a64 P 127766fc592545a4997f7790f50f6076 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 127766fc592545a4997f7790f50f6076, State: Running, Role: LEADER
I20260709 13:06:46.673887 24990 raft_consensus.cc:3060] T 46c5bfeecc314717bffe987e6844b6d0 P 0473d2b2d01f4459b1e90fd12cc7840e [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:06:46.628639 25063 raft_consensus.cc:493] T ff9b0eddd810459b82d91c60777c10eb P 0473d2b2d01f4459b1e90fd12cc7840e [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 127766fc592545a4997f7790f50f6076)
I20260709 13:06:46.674638 25233 consensus_queue.cc:260] T 5ec1c4ce15e04c7e8c283a62179f2a64 P 127766fc592545a4997f7790f50f6076 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:46.675021 25063 raft_consensus.cc:515] T ff9b0eddd810459b82d91c60777c10eb P 0473d2b2d01f4459b1e90fd12cc7840e [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:46.668287 25185 raft_consensus.cc:515] T 96efeaaf1057492490e9a621f37e1a2d P e61c3a8f61bb48f8a963c9480e53c168 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:46.677597 25063 leader_election.cc:290] T ff9b0eddd810459b82d91c60777c10eb P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:06:46.678248 25185 leader_election.cc:290] T 96efeaaf1057492490e9a621f37e1a2d P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:06:46.647723 24970 consensus_queue.cc:237] T 7f575b143b844aa096b50997dad3516a P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
W20260709 13:06:46.679013 19526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.2:46257, user_credentials={real_user=slave}} blocked reactor thread for 49533.6us
I20260709 13:06:46.682756 19556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65d8cb8d6ec64f459d5a47cefab10acf" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 19 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:06:46.683866 19556 raft_consensus.cc:2410] T 65d8cb8d6ec64f459d5a47cefab10acf P e61c3a8f61bb48f8a963c9480e53c168 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e5256d91808b47c195bc9b4dbd7f2b87 for term 19 because replica has last-logged OpId of term: 17 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 10.
W20260709 13:06:46.684855 19450 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.3:36891, user_credentials={real_user=slave}} blocked reactor thread for 55217.8us
I20260709 13:06:46.668219 25078 consensus_queue.cc:237] T 9962423cb4e54fcfa5de01daf68a86e7 P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:46.604051 25087 raft_consensus.cc:2749] T 86a6797bdfe94fa496c050ceae4bd0d9 P e61c3a8f61bb48f8a963c9480e53c168 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:06:46.608232 25100 raft_consensus.cc:2749] T edd7d470b5014c9489be7f41f64355c9 P e5256d91808b47c195bc9b4dbd7f2b87 [term 18 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:06:46.685863 19450 leader_election.cc:304] T a08760e15aac4630a629431f56024dc8 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168; no voters: e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:06:46.580199 25086 raft_consensus.cc:515] T 309c3ca0ca4b4f3ba129752ea2cb293b P e61c3a8f61bb48f8a963c9480e53c168 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } attrs { replace: true } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:46.689561 20110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65d8cb8d6ec64f459d5a47cefab10acf" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 19 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
W20260709 13:06:46.691905 20076 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.3:36891, user_credentials={real_user=slave}} blocked reactor thread for 48105.3us
I20260709 13:06:46.693642 20076 leader_election.cc:304] T 48824d5acfbc485ebf8c2d944e7202de P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 127766fc592545a4997f7790f50f6076; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168
W20260709 13:06:46.695667 20075 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.1:40321, user_credentials={real_user=slave}} blocked reactor thread for 49844.6us
I20260709 13:06:46.698246 25063 raft_consensus.cc:2749] T e381f1d6b8184797ad142de49be225a8 P 0473d2b2d01f4459b1e90fd12cc7840e [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:06:46.700456 25086 leader_election.cc:290] T 309c3ca0ca4b4f3ba129752ea2cb293b P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:06:46.701566 25220 raft_consensus.cc:3060] T 1f85fc4b527a48848e5faa083b604e36 P 127766fc592545a4997f7790f50f6076 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:06:46.704408 25229 log.cc:927] Time spent T b08304a0a02b42d7840c4e8ee9a6bd1a P e5256d91808b47c195bc9b4dbd7f2b87: Append to log took a long time: real 0.370s	user 0.003s	sys 0.000s
I20260709 13:06:46.662886 25246 raft_consensus.cc:493] T 14935b3ddf914369822e4a0547aaa355 P 0473d2b2d01f4459b1e90fd12cc7840e [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 127766fc592545a4997f7790f50f6076)
I20260709 13:06:46.715447 25246 raft_consensus.cc:515] T 14935b3ddf914369822e4a0547aaa355 P 0473d2b2d01f4459b1e90fd12cc7840e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } attrs { replace: true } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:46.658861 25165 consensus_queue.cc:1059] T ef32ce6fdd0e40d382c79974f30295c6 P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.060s
I20260709 13:06:46.719676 25165 raft_consensus.cc:3055] T ef32ce6fdd0e40d382c79974f30295c6 P e61c3a8f61bb48f8a963c9480e53c168 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:06:46.720031 25165 raft_consensus.cc:740] T ef32ce6fdd0e40d382c79974f30295c6 P e61c3a8f61bb48f8a963c9480e53c168 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: e61c3a8f61bb48f8a963c9480e53c168, State: Running, Role: LEADER
I20260709 13:06:46.720851 25165 consensus_queue.cc:260] T ef32ce6fdd0e40d382c79974f30295c6 P e61c3a8f61bb48f8a963c9480e53c168 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 19.11, Last appended by leader: 11, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:46.721975 25165 raft_consensus.cc:3060] T ef32ce6fdd0e40d382c79974f30295c6 P e61c3a8f61bb48f8a963c9480e53c168 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:06:46.723035 25246 leader_election.cc:290] T 14935b3ddf914369822e4a0547aaa355 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:06:46.707171 24930 raft_consensus.cc:2804] T a08760e15aac4630a629431f56024dc8 P 0473d2b2d01f4459b1e90fd12cc7840e [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:06:46.709774 19450 leader_election.cc:304] T 179fd671030940b4b4a4e24bcc4aba0a P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168; no voters: e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:06:46.726506 19450 leader_election.cc:304] T 7f575b143b844aa096b50997dad3516a P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e; no voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:06:46.710945 24982 consensus_queue.cc:1048] T 6c5eebf646ad445a9d1b1adc319d7b16 P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:06:46.651122 24700 consensus_queue.cc:260] T 76cb037fc9064d13b59a8969d897ce8c P e61c3a8f61bb48f8a963c9480e53c168 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 14.8, Last appended by leader: 8, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:46.693030 24932 leader_election.cc:290] T 172b3dd13109415a955b71ac0e9d2234 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 15 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:06:46.706593 25133 raft_consensus.cc:3055] T 9962423cb4e54fcfa5de01daf68a86e7 P 127766fc592545a4997f7790f50f6076 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:06:46.730540 25133 raft_consensus.cc:740] T 9962423cb4e54fcfa5de01daf68a86e7 P 127766fc592545a4997f7790f50f6076 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 127766fc592545a4997f7790f50f6076, State: Running, Role: LEADER
W20260709 13:06:46.705482 25222 log.cc:927] Time spent T 0cdf56e38bbc453d9438d359e5a69955 P e5256d91808b47c195bc9b4dbd7f2b87: Append to log took a long time: real 0.350s	user 0.000s	sys 0.001s
I20260709 13:06:46.736238 19450 leader_election.cc:304] T ff75a1d4cb1f493db8f71ddc136ba9ab P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:06:46.643023 25056 raft_consensus.cc:697] T 1a61655d99124a29b486ba4a5b37faea P e5256d91808b47c195bc9b4dbd7f2b87 [term 14 LEADER]: Becoming Leader. State: Replica: e5256d91808b47c195bc9b4dbd7f2b87, State: Running, Role: LEADER
I20260709 13:06:46.693780 25225 raft_consensus.cc:2749] T 85c494af21f9457a85da47b9bc70c1fd P 127766fc592545a4997f7790f50f6076 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:06:46.766445 19484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "172b3dd13109415a955b71ac0e9d2234" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:06:46.771293 19523 leader_election.cc:304] T 6c5eebf646ad445a9d1b1adc319d7b16 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 127766fc592545a4997f7790f50f6076, e61c3a8f61bb48f8a963c9480e53c168; no voters: 0473d2b2d01f4459b1e90fd12cc7840e
I20260709 13:06:46.731185 25245 raft_consensus.cc:2804] T 179fd671030940b4b4a4e24bcc4aba0a P 0473d2b2d01f4459b1e90fd12cc7840e [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:06:46.728767 24930 raft_consensus.cc:493] T a08760e15aac4630a629431f56024dc8 P 0473d2b2d01f4459b1e90fd12cc7840e [term 19 FOLLOWER]: Starting leader election (detected failure of leader e5256d91808b47c195bc9b4dbd7f2b87)
I20260709 13:06:46.734519 25063 raft_consensus.cc:2749] T 7f575b143b844aa096b50997dad3516a P 0473d2b2d01f4459b1e90fd12cc7840e [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
W20260709 13:06:46.775530 19449 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.1:40321, user_credentials={real_user=slave}} blocked reactor thread for 237330us
I20260709 13:06:46.737664 25227 raft_consensus.cc:2749] T 48824d5acfbc485ebf8c2d944e7202de P 127766fc592545a4997f7790f50f6076 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:06:46.783794 19484 raft_consensus.cc:1275] T 3e1f505cb0f1427bbd698ac889d80821 P 0473d2b2d01f4459b1e90fd12cc7840e [term 18 FOLLOWER]: Refusing update from remote peer e5256d91808b47c195bc9b4dbd7f2b87: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
I20260709 13:06:46.678597 25051 raft_consensus.cc:515] T 3e1f505cb0f1427bbd698ac889d80821 P e61c3a8f61bb48f8a963c9480e53c168 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:46.773056 24932 raft_consensus.cc:2804] T ff75a1d4cb1f493db8f71ddc136ba9ab P 0473d2b2d01f4459b1e90fd12cc7840e [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:06:46.737376 25211 consensus_queue.cc:1048] T 65d8cb8d6ec64f459d5a47cefab10acf P 127766fc592545a4997f7790f50f6076 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.042s
I20260709 13:06:46.782236 19477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff9b0eddd810459b82d91c60777c10eb" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:06:46.792549 20110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96efeaaf1057492490e9a621f37e1a2d" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:06:46.787106 19411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "172b3dd13109415a955b71ac0e9d2234" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
I20260709 13:06:46.789347 19480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cdf56e38bbc453d9438d359e5a69955" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:06:46.793481 20110 raft_consensus.cc:2468] T 96efeaaf1057492490e9a621f37e1a2d P 127766fc592545a4997f7790f50f6076 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 17.
I20260709 13:06:46.772534 25096 raft_consensus.cc:493] T 65d8cb8d6ec64f459d5a47cefab10acf P e61c3a8f61bb48f8a963c9480e53c168 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:46.744496 25246 consensus_queue.cc:1059] T 86a6797bdfe94fa496c050ceae4bd0d9 P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 }, Status: INVALID_TERM, Last received: 12.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.037s
W20260709 13:06:46.790999 20076 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.3:36891, user_credentials={real_user=slave}} blocked reactor thread for 60086.8us
I20260709 13:06:46.765744 25236 raft_consensus.cc:2804] T 7be9efa6559648dbb5a0f7684c4542d1 P 127766fc592545a4997f7790f50f6076 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:06:46.792881 19402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff9b0eddd810459b82d91c60777c10eb" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:06:46.795239 20110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff9b0eddd810459b82d91c60777c10eb" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:06:46.779667 25245 raft_consensus.cc:493] T 179fd671030940b4b4a4e24bcc4aba0a P 0473d2b2d01f4459b1e90fd12cc7840e [term 18 FOLLOWER]: Starting leader election (detected failure of leader e5256d91808b47c195bc9b4dbd7f2b87)
I20260709 13:06:46.784448 19523 leader_election.cc:304] T 14935b3ddf914369822e4a0547aaa355 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, 127766fc592545a4997f7790f50f6076
I20260709 13:06:46.782748 25244 raft_consensus.cc:2804] T 6c5eebf646ad445a9d1b1adc319d7b16 P e61c3a8f61bb48f8a963c9480e53c168 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:06:46.820611 25244 raft_consensus.cc:493] T 6c5eebf646ad445a9d1b1adc319d7b16 P e61c3a8f61bb48f8a963c9480e53c168 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:46.807165 25096 raft_consensus.cc:515] T 65d8cb8d6ec64f459d5a47cefab10acf P e61c3a8f61bb48f8a963c9480e53c168 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:46.820998 25244 raft_consensus.cc:3060] T 6c5eebf646ad445a9d1b1adc319d7b16 P e61c3a8f61bb48f8a963c9480e53c168 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:06:46.821987 19481 raft_consensus.cc:1275] T edd7d470b5014c9489be7f41f64355c9 P 0473d2b2d01f4459b1e90fd12cc7840e [term 18 FOLLOWER]: Refusing update from remote peer e61c3a8f61bb48f8a963c9480e53c168: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 18 index: 10. (index mismatch)
I20260709 13:06:46.822540 25096 leader_election.cc:290] T 65d8cb8d6ec64f459d5a47cefab10acf P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:06:46.824162 19481 raft_consensus.cc:1275] T f93ee515a9c14139bf566522ed8232f3 P 0473d2b2d01f4459b1e90fd12cc7840e [term 18 FOLLOWER]: Refusing update from remote peer e61c3a8f61bb48f8a963c9480e53c168: Log matching property violated. Preceding OpId in replica: term: 16 index: 8. Preceding OpId from leader: term: 18 index: 9. (index mismatch)
I20260709 13:06:46.782846 24930 raft_consensus.cc:3060] T a08760e15aac4630a629431f56024dc8 P 0473d2b2d01f4459b1e90fd12cc7840e [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:06:46.809568 20106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "172b3dd13109415a955b71ac0e9d2234" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076"
I20260709 13:06:46.826170 19481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96efeaaf1057492490e9a621f37e1a2d" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:06:46.794781 19486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f575b143b844aa096b50997dad3516a" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:06:46.810200 19404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14935b3ddf914369822e4a0547aaa355" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:06:46.773361 25039 raft_consensus.cc:515] T ff75a1d4cb1f493db8f71ddc136ba9ab P e5256d91808b47c195bc9b4dbd7f2b87 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:46.810200 19478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1b10566f45d4a7d9029858330e02d5b" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:06:46.813720 19484 raft_consensus.cc:1240] T 14efcc79969f41babe5529c22d59156d P 0473d2b2d01f4459b1e90fd12cc7840e [term 17 FOLLOWER]: Rejecting Update request from peer e5256d91808b47c195bc9b4dbd7f2b87 for earlier term 16. Current term is 17. Ops: []
I20260709 13:06:46.827054 19404 raft_consensus.cc:2468] T 14935b3ddf914369822e4a0547aaa355 P e5256d91808b47c195bc9b4dbd7f2b87 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 10.
I20260709 13:06:46.813798 20076 leader_election.cc:304] T 2a16f7501e2444fb86d4e2778e734e02 P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 127766fc592545a4997f7790f50f6076, e61c3a8f61bb48f8a963c9480e53c168; no voters: e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:06:46.830057 19482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "309c3ca0ca4b4f3ba129752ea2cb293b" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:06:46.830462 19449 leader_election.cc:304] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, 127766fc592545a4997f7790f50f6076; no voters: 
I20260709 13:06:46.817448 19523 leader_election.cc:304] T 48824d5acfbc485ebf8c2d944e7202de P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e61c3a8f61bb48f8a963c9480e53c168; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, 127766fc592545a4997f7790f50f6076
I20260709 13:06:46.790719 24932 raft_consensus.cc:493] T ff75a1d4cb1f493db8f71ddc136ba9ab P 0473d2b2d01f4459b1e90fd12cc7840e [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:46.826467 20106 raft_consensus.cc:2393] T 172b3dd13109415a955b71ac0e9d2234 P 127766fc592545a4997f7790f50f6076 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 0473d2b2d01f4459b1e90fd12cc7840e in current term 15: Already voted for candidate 127766fc592545a4997f7790f50f6076 in this term.
I20260709 13:06:46.812839 19477 raft_consensus.cc:1240] T 2e36a9d6e29c4a7c860cf267efbd4c74 P 0473d2b2d01f4459b1e90fd12cc7840e [term 12 FOLLOWER]: Rejecting Update request from peer e5256d91808b47c195bc9b4dbd7f2b87 for earlier term 11. Current term is 12. Ops: []
I20260709 13:06:46.827423 19481 raft_consensus.cc:2468] T 96efeaaf1057492490e9a621f37e1a2d P 0473d2b2d01f4459b1e90fd12cc7840e [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 18.
I20260709 13:06:46.793797 25210 raft_consensus.cc:2749] T 2b74109013a140ada21feeef92d6f563 P 0473d2b2d01f4459b1e90fd12cc7840e [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:06:46.828982 19486 raft_consensus.cc:2368] T 7f575b143b844aa096b50997dad3516a P 0473d2b2d01f4459b1e90fd12cc7840e [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e5256d91808b47c195bc9b4dbd7f2b87 for earlier term 12. Current term is 13.
I20260709 13:06:46.833635 19523 leader_election.cc:304] T 70797e5783b5454ab0d0eea663e791e3 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e61c3a8f61bb48f8a963c9480e53c168; no voters: 127766fc592545a4997f7790f50f6076, e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:06:46.843465 20109 raft_consensus.cc:2468] T 1f85fc4b527a48848e5faa083b604e36 P 127766fc592545a4997f7790f50f6076 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 14.
I20260709 13:06:46.844961 19559 raft_consensus.cc:1240] T 3e1f505cb0f1427bbd698ac889d80821 P e61c3a8f61bb48f8a963c9480e53c168 [term 19 FOLLOWER]: Rejecting Update request from peer e5256d91808b47c195bc9b4dbd7f2b87 for earlier term 18. Current term is 19. Ops: []
I20260709 13:06:46.845289 20076 leader_election.cc:304] T 70797e5783b5454ab0d0eea663e791e3 P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 127766fc592545a4997f7790f50f6076; no voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:06:46.849833 19409 raft_consensus.cc:2393] T ff75a1d4cb1f493db8f71ddc136ba9ab P e5256d91808b47c195bc9b4dbd7f2b87 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0473d2b2d01f4459b1e90fd12cc7840e in current term 17: Already voted for candidate e5256d91808b47c195bc9b4dbd7f2b87 in this term.
I20260709 13:06:46.825809 25245 raft_consensus.cc:3060] T 179fd671030940b4b4a4e24bcc4aba0a P 0473d2b2d01f4459b1e90fd12cc7840e [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:06:46.852694 19486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff75a1d4cb1f493db8f71ddc136ba9ab" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:06:46.825788 25185 raft_consensus.cc:2749] T 14935b3ddf914369822e4a0547aaa355 P e61c3a8f61bb48f8a963c9480e53c168 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:06:46.782786 25133 consensus_queue.cc:260] T 9962423cb4e54fcfa5de01daf68a86e7 P 127766fc592545a4997f7790f50f6076 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.12, Last appended by leader: 12, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:46.828624 25097 raft_consensus.cc:493] T 775c229504194560ba9589bc2199b089 P 0473d2b2d01f4459b1e90fd12cc7840e [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 127766fc592545a4997f7790f50f6076)
I20260709 13:06:46.838918 25249 consensus_queue.cc:1059] T 2725d2c4cb054f18b0fc8f735c15f6c2 P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 }, Status: INVALID_TERM, Last received: 17.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.062s
I20260709 13:06:46.918955 20078 leader_election.cc:304] T 172b3dd13109415a955b71ac0e9d2234 P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 127766fc592545a4997f7790f50f6076; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:06:46.892257 19482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e5873a19244c5ebbcd38e126796ee7" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:06:46.842852 24932 raft_consensus.cc:3060] T ff75a1d4cb1f493db8f71ddc136ba9ab P 0473d2b2d01f4459b1e90fd12cc7840e [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:06:46.835919 25076 consensus_queue.cc:1048] T 14935b3ddf914369822e4a0547aaa355 P 127766fc592545a4997f7790f50f6076 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.078s
I20260709 13:06:46.879220 19478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b08304a0a02b42d7840c4e8ee9a6bd1a" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:06:46.877921 20110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14935b3ddf914369822e4a0547aaa355" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:06:46.914211 25097 raft_consensus.cc:515] T 775c229504194560ba9589bc2199b089 P 0473d2b2d01f4459b1e90fd12cc7840e [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
W20260709 13:06:46.915252 19523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.4:43121, user_credentials={real_user=slave}} blocked reactor thread for 81712.6us
I20260709 13:06:46.918890 25240 raft_consensus.cc:493] T 7be9efa6559648dbb5a0f7684c4542d1 P 0473d2b2d01f4459b1e90fd12cc7840e [term 15 FOLLOWER]: Starting pre-election (detected failure of leader e5256d91808b47c195bc9b4dbd7f2b87)
I20260709 13:06:46.816195 25056 consensus_queue.cc:237] T 1a61655d99124a29b486ba4a5b37faea P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:46.864427 19477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a61655d99124a29b486ba4a5b37faea" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:06:46.872008 25253 raft_consensus.cc:2804] T 2a16f7501e2444fb86d4e2778e734e02 P 127766fc592545a4997f7790f50f6076 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:06:46.934620 19560 raft_consensus.cc:1240] T 28af091831594f9d8e96482078cc7625 P e61c3a8f61bb48f8a963c9480e53c168 [term 17 FOLLOWER]: Rejecting Update request from peer 0473d2b2d01f4459b1e90fd12cc7840e for earlier term 16. Current term is 17. Ops: []
I20260709 13:06:46.923065 19558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14935b3ddf914369822e4a0547aaa355" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:06:46.863796 19484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa8650e71aa14778b3d73721fc50d9fc" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:06:46.836833 25096 raft_consensus.cc:2749] T 48824d5acfbc485ebf8c2d944e7202de P e61c3a8f61bb48f8a963c9480e53c168 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:06:46.840692 25241 raft_consensus.cc:493] T df751f992649444090e27965eb1af85d P e61c3a8f61bb48f8a963c9480e53c168 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:46.844785 24702 raft_consensus.cc:2749] T 70797e5783b5454ab0d0eea663e791e3 P e61c3a8f61bb48f8a963c9480e53c168 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:06:46.959298 19482 raft_consensus.cc:2393] T d1e5873a19244c5ebbcd38e126796ee7 P 0473d2b2d01f4459b1e90fd12cc7840e [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate e5256d91808b47c195bc9b4dbd7f2b87 in current term 18: Already voted for candidate 0473d2b2d01f4459b1e90fd12cc7840e in this term.
I20260709 13:06:46.962514 19559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96efeaaf1057492490e9a621f37e1a2d" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:06:46.953732 19377 leader_election.cc:304] T 0cdf56e38bbc453d9438d359e5a69955 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:06:46.854226 25246 raft_consensus.cc:2804] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P 0473d2b2d01f4459b1e90fd12cc7840e [term 17 FOLLOWER]: Leader pre-election won for term 18
W20260709 13:06:46.955956 25218 log.cc:927] Time spent T 1dc5b3532fe54f74876d02beffa2c230 P e5256d91808b47c195bc9b4dbd7f2b87: Append to log took a long time: real 0.056s	user 0.000s	sys 0.000s
W20260709 13:06:46.962255 19449 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.4:43121, user_credentials={real_user=slave}} blocked reactor thread for 130602us
I20260709 13:06:46.962402 19478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dc5b3532fe54f74876d02beffa2c230" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 18 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:06:47.007777 19478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "775c229504194560ba9589bc2199b089" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:06:46.993781 19482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46c5bfeecc314717bffe987e6844b6d0" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 22 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:06:46.878264 25075 raft_consensus.cc:2749] T 70797e5783b5454ab0d0eea663e791e3 P 127766fc592545a4997f7790f50f6076 [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:06:46.994450 19559 raft_consensus.cc:2468] T 96efeaaf1057492490e9a621f37e1a2d P e61c3a8f61bb48f8a963c9480e53c168 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 18.
I20260709 13:06:47.009021 25246 raft_consensus.cc:493] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P 0473d2b2d01f4459b1e90fd12cc7840e [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:47.009539 25246 raft_consensus.cc:3060] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P 0473d2b2d01f4459b1e90fd12cc7840e [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:06:47.011773 25244 raft_consensus.cc:515] T 6c5eebf646ad445a9d1b1adc319d7b16 P e61c3a8f61bb48f8a963c9480e53c168 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:47.013960 25244 leader_election.cc:290] T 6c5eebf646ad445a9d1b1adc319d7b16 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 17 election: Requested vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
W20260709 13:06:47.015084 25252 log.cc:927] Time spent T 14efcc79969f41babe5529c22d59156d P 127766fc592545a4997f7790f50f6076: Append to log took a long time: real 0.060s	user 0.000s	sys 0.000s
I20260709 13:06:46.962792 25185 raft_consensus.cc:493] T ed7fdbcb96d14d418db9ca90a792588a P e61c3a8f61bb48f8a963c9480e53c168 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:47.016605 25094 raft_consensus.cc:2749] T 0cdf56e38bbc453d9438d359e5a69955 P e5256d91808b47c195bc9b4dbd7f2b87 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:06:46.992415 19558 raft_consensus.cc:2468] T 14935b3ddf914369822e4a0547aaa355 P e61c3a8f61bb48f8a963c9480e53c168 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 10.
I20260709 13:06:47.016845 25185 raft_consensus.cc:515] T ed7fdbcb96d14d418db9ca90a792588a P e61c3a8f61bb48f8a963c9480e53c168 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:46.991842 25253 raft_consensus.cc:493] T 2a16f7501e2444fb86d4e2778e734e02 P 127766fc592545a4997f7790f50f6076 [term 15 FOLLOWER]: Starting leader election (detected failure of leader e61c3a8f61bb48f8a963c9480e53c168)
I20260709 13:06:47.020788 25253 raft_consensus.cc:3060] T 2a16f7501e2444fb86d4e2778e734e02 P 127766fc592545a4997f7790f50f6076 [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:06:47.023118 25242 log.cc:927] Time spent T e381f1d6b8184797ad142de49be225a8 P e61c3a8f61bb48f8a963c9480e53c168: Append to log took a long time: real 0.226s	user 0.001s	sys 0.000s
I20260709 13:06:47.023088 25097 leader_election.cc:290] T 775c229504194560ba9589bc2199b089 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:06:46.992853 25133 raft_consensus.cc:3060] T 9962423cb4e54fcfa5de01daf68a86e7 P 127766fc592545a4997f7790f50f6076 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:06:47.026968 19478 raft_consensus.cc:2468] T 775c229504194560ba9589bc2199b089 P 0473d2b2d01f4459b1e90fd12cc7840e [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 11.
I20260709 13:06:46.997718 25241 raft_consensus.cc:515] T df751f992649444090e27965eb1af85d P e61c3a8f61bb48f8a963c9480e53c168 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:47.032407 25265 raft_consensus.cc:493] T 5ec1c4ce15e04c7e8c283a62179f2a64 P 0473d2b2d01f4459b1e90fd12cc7840e [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 127766fc592545a4997f7790f50f6076)
W20260709 13:06:47.033298 19525 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:47.032955 25265 raft_consensus.cc:515] T 5ec1c4ce15e04c7e8c283a62179f2a64 P 0473d2b2d01f4459b1e90fd12cc7840e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
W20260709 13:06:47.034431 25248 log.cc:927] Time spent T 7be9efa6559648dbb5a0f7684c4542d1 P 127766fc592545a4997f7790f50f6076: Append to log took a long time: real 0.142s	user 0.000s	sys 0.000s
I20260709 13:06:47.034902 25058 leader_election.cc:290] T 28af091831594f9d8e96482078cc7625 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 17 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:06:47.036653 24837 raft_consensus.cc:3055] T 2b74109013a140ada21feeef92d6f563 P e61c3a8f61bb48f8a963c9480e53c168 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:06:47.037005 24837 raft_consensus.cc:740] T 2b74109013a140ada21feeef92d6f563 P e61c3a8f61bb48f8a963c9480e53c168 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: e61c3a8f61bb48f8a963c9480e53c168, State: Running, Role: LEADER
I20260709 13:06:47.037772 24837 consensus_queue.cc:260] T 2b74109013a140ada21feeef92d6f563 P e61c3a8f61bb48f8a963c9480e53c168 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:47.040359 25260 consensus_queue.cc:1059] T 28af091831594f9d8e96482078cc7625 P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 }, Status: INVALID_TERM, Last received: 16.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:06:47.006388 25063 raft_consensus.cc:493] T 4509b76741dc428e9201c70c1658da13 P 0473d2b2d01f4459b1e90fd12cc7840e [term 10 FOLLOWER]: Starting pre-election (detected failure of leader e5256d91808b47c195bc9b4dbd7f2b87)
I20260709 13:06:47.041396 25260 raft_consensus.cc:3055] T 28af091831594f9d8e96482078cc7625 P 0473d2b2d01f4459b1e90fd12cc7840e [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:06:47.041756 25260 raft_consensus.cc:740] T 28af091831594f9d8e96482078cc7625 P 0473d2b2d01f4459b1e90fd12cc7840e [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 0473d2b2d01f4459b1e90fd12cc7840e, State: Running, Role: LEADER
I20260709 13:06:47.041793 25063 raft_consensus.cc:515] T 4509b76741dc428e9201c70c1658da13 P 0473d2b2d01f4459b1e90fd12cc7840e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:47.047312 25260 consensus_queue.cc:260] T 28af091831594f9d8e96482078cc7625 P 0473d2b2d01f4459b1e90fd12cc7840e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.9, Last appended by leader: 9, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:47.051079 25260 raft_consensus.cc:3060] T 28af091831594f9d8e96482078cc7625 P 0473d2b2d01f4459b1e90fd12cc7840e [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:06:47.004285 19377 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.2:46257, user_credentials={real_user=slave}} blocked reactor thread for 50652.2us
I20260709 13:06:47.055336 19377 leader_election.cc:304] T ff9b0eddd810459b82d91c60777c10eb P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, 127766fc592545a4997f7790f50f6076
I20260709 13:06:47.051600 25051 leader_election.cc:290] T 3e1f505cb0f1427bbd698ac889d80821 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 19 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:06:47.007107 19449 leader_election.cc:304] T 96efeaaf1057492490e9a621f37e1a2d P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, 127766fc592545a4997f7790f50f6076; no voters: 
I20260709 13:06:46.853869 25250 raft_consensus.cc:493] T ab43d85f64114d4ebf618930e43d9ed0 P 0473d2b2d01f4459b1e90fd12cc7840e [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 127766fc592545a4997f7790f50f6076)
I20260709 13:06:46.992448 19477 raft_consensus.cc:2410] T 1a61655d99124a29b486ba4a5b37faea P 0473d2b2d01f4459b1e90fd12cc7840e [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e5256d91808b47c195bc9b4dbd7f2b87 for term 14 because replica has last-logged OpId of term: 13 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 8.
W20260709 13:06:47.077003 19449 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.4:43121, user_credentials={real_user=slave}} blocked reactor thread for 70011.5us
I20260709 13:06:46.955716 25225 raft_consensus.cc:2749] T 172b3dd13109415a955b71ac0e9d2234 P 127766fc592545a4997f7790f50f6076 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:06:47.083141 20110 raft_consensus.cc:1240] T 172b3dd13109415a955b71ac0e9d2234 P 127766fc592545a4997f7790f50f6076 [term 15 FOLLOWER]: Rejecting Update request from peer e5256d91808b47c195bc9b4dbd7f2b87 for earlier term 14. Current term is 15. Ops: []
I20260709 13:06:46.888311 25207 consensus_queue.cc:1059] T 3e1f505cb0f1427bbd698ac889d80821 P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 }, Status: INVALID_TERM, Last received: 18.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.169s
W20260709 13:06:47.076282 25239 log.cc:927] Time spent T 3e1f505cb0f1427bbd698ac889d80821 P e61c3a8f61bb48f8a963c9480e53c168: Append to log took a long time: real 0.296s	user 0.000s	sys 0.001s
W20260709 13:06:47.097692 20075 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:47.097039 19477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21e14947d70440f19044d8f75c31e1f9" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:06:47.077268 24837 raft_consensus.cc:3060] T 2b74109013a140ada21feeef92d6f563 P e61c3a8f61bb48f8a963c9480e53c168 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:06:47.106779 19374 leader_election.cc:304] T ece3db938bc649d4a40a51522ed5259c P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87; no voters: 127766fc592545a4997f7790f50f6076, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:06:47.075805 25085 raft_consensus.cc:493] T 22196caba61445d3bec98a0aab3c337d P e5256d91808b47c195bc9b4dbd7f2b87 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:47.083244 25097 raft_consensus.cc:2804] T 96efeaaf1057492490e9a621f37e1a2d P 0473d2b2d01f4459b1e90fd12cc7840e [term 18 FOLLOWER]: Leader pre-election won for term 19
W20260709 13:06:47.126844 25257 log.cc:927] Time spent T 309c3ca0ca4b4f3ba129752ea2cb293b P 0473d2b2d01f4459b1e90fd12cc7840e: Append to log took a long time: real 0.095s	user 0.001s	sys 0.000s
I20260709 13:06:47.123200 25089 consensus_queue.cc:1048] T 3e1f505cb0f1427bbd698ac889d80821 P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.004s
I20260709 13:06:47.127750 24982 raft_consensus.cc:493] T 1a61655d99124a29b486ba4a5b37faea P 0473d2b2d01f4459b1e90fd12cc7840e [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:47.143935 24982 raft_consensus.cc:515] T 1a61655d99124a29b486ba4a5b37faea P 0473d2b2d01f4459b1e90fd12cc7840e [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:47.127995 25183 raft_consensus.cc:3055] T f1b10566f45d4a7d9029858330e02d5b P e61c3a8f61bb48f8a963c9480e53c168 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:06:47.080812 25127 raft_consensus.cc:2749] T ff9b0eddd810459b82d91c60777c10eb P e5256d91808b47c195bc9b4dbd7f2b87 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:06:47.131657 24930 raft_consensus.cc:515] T a08760e15aac4630a629431f56024dc8 P 0473d2b2d01f4459b1e90fd12cc7840e [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:47.133070 25207 raft_consensus.cc:3060] T ece3db938bc649d4a40a51522ed5259c P e5256d91808b47c195bc9b4dbd7f2b87 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:06:47.153599 24930 leader_election.cc:290] T a08760e15aac4630a629431f56024dc8 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 20 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
W20260709 13:06:47.155156 19450 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.3:36891, user_credentials={real_user=slave}} blocked reactor thread for 115008us
I20260709 13:06:47.155349 25245 raft_consensus.cc:515] T 179fd671030940b4b4a4e24bcc4aba0a P 0473d2b2d01f4459b1e90fd12cc7840e [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:47.138902 25097 raft_consensus.cc:493] T 96efeaaf1057492490e9a621f37e1a2d P 0473d2b2d01f4459b1e90fd12cc7840e [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:47.156711 25063 leader_election.cc:290] T 4509b76741dc428e9201c70c1658da13 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:06:47.141808 25085 raft_consensus.cc:515] T 22196caba61445d3bec98a0aab3c337d P e5256d91808b47c195bc9b4dbd7f2b87 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:47.092730 25250 raft_consensus.cc:515] T ab43d85f64114d4ebf618930e43d9ed0 P 0473d2b2d01f4459b1e90fd12cc7840e [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:47.144635 19479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a61655d99124a29b486ba4a5b37faea" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:06:47.145387 19477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ec1c4ce15e04c7e8c283a62179f2a64" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:06:47.145838 19374 leader_election.cc:304] T 65d8cb8d6ec64f459d5a47cefab10acf P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87; no voters: 127766fc592545a4997f7790f50f6076, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:06:47.165931 19479 raft_consensus.cc:2410] T 1a61655d99124a29b486ba4a5b37faea P 0473d2b2d01f4459b1e90fd12cc7840e [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate e5256d91808b47c195bc9b4dbd7f2b87 for term 14 because replica has last-logged OpId of term: 13 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 8.
W20260709 13:06:47.146001 19377 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.2:46257, user_credentials={real_user=slave}} blocked reactor thread for 90776.2us
I20260709 13:06:47.146718 25183 raft_consensus.cc:740] T f1b10566f45d4a7d9029858330e02d5b P e61c3a8f61bb48f8a963c9480e53c168 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: e61c3a8f61bb48f8a963c9480e53c168, State: Running, Role: LEADER
W20260709 13:06:47.151927 19526 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:47.152670 25246 raft_consensus.cc:515] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P 0473d2b2d01f4459b1e90fd12cc7840e [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:47.153295 24982 leader_election.cc:290] T 1a61655d99124a29b486ba4a5b37faea P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:06:47.156880 25097 raft_consensus.cc:3060] T 96efeaaf1057492490e9a621f37e1a2d P 0473d2b2d01f4459b1e90fd12cc7840e [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:06:47.157462 25245 leader_election.cc:290] T 179fd671030940b4b4a4e24bcc4aba0a P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 19 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:06:47.158054 24891 raft_consensus.cc:493] T f93ee515a9c14139bf566522ed8232f3 P 0473d2b2d01f4459b1e90fd12cc7840e [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:06:47.146095 19449 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.4:43121, user_credentials={real_user=slave}} blocked reactor thread for 63544.4us
I20260709 13:06:47.139072 19483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14935b3ddf914369822e4a0547aaa355" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:06:47.167264 19377 leader_election.cc:304] T f1b10566f45d4a7d9029858330e02d5b P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:06:47.167838 19477 raft_consensus.cc:3060] T 5ec1c4ce15e04c7e8c283a62179f2a64 P 0473d2b2d01f4459b1e90fd12cc7840e [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:06:47.169188 19485 raft_consensus.cc:1240] T 9962423cb4e54fcfa5de01daf68a86e7 P 0473d2b2d01f4459b1e90fd12cc7840e [term 16 LEADER]: Rejecting Update request from peer 127766fc592545a4997f7790f50f6076 for earlier term 15. Current term is 16. Ops: [15.12-15.12]
I20260709 13:06:47.172564 19479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "217b5fae677b4971b3bbd2f357a1f7ff" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
W20260709 13:06:47.174132 20078 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.2:46257, user_credentials={real_user=slave}} blocked reactor thread for 214966us
I20260709 13:06:47.179930 19479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f85fc4b527a48848e5faa083b604e36" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:06:47.180497 19479 raft_consensus.cc:2468] T 1f85fc4b527a48848e5faa083b604e36 P 0473d2b2d01f4459b1e90fd12cc7840e [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 14.
I20260709 13:06:47.181267 19479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2725d2c4cb054f18b0fc8f735c15f6c2" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:06:47.069373 25240 raft_consensus.cc:515] T 7be9efa6559648dbb5a0f7684c4542d1 P 0473d2b2d01f4459b1e90fd12cc7840e [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } attrs { replace: true } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:47.183317 19449 leader_election.cc:304] T 172b3dd13109415a955b71ac0e9d2234 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e; no voters: 127766fc592545a4997f7790f50f6076, e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:06:47.191363 19377 leader_election.cc:400] T 7f575b143b844aa096b50997dad3516a P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 12 pre-election: Vote denied by peer 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257) with higher term. Message: Invalid argument: T 7f575b143b844aa096b50997dad3516a P 0473d2b2d01f4459b1e90fd12cc7840e [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e5256d91808b47c195bc9b4dbd7f2b87 for earlier term 12. Current term is 13.
I20260709 13:06:47.192255 19377 leader_election.cc:304] T b08304a0a02b42d7840c4e8ee9a6bd1a P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:06:47.194223 25241 leader_election.cc:290] T df751f992649444090e27965eb1af85d P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:06:47.196205 19449 leader_election.cc:304] T ff9b0eddd810459b82d91c60777c10eb P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e; no voters: 127766fc592545a4997f7790f50f6076, e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:06:47.165499 25210 raft_consensus.cc:493] T edd7d470b5014c9489be7f41f64355c9 P 0473d2b2d01f4459b1e90fd12cc7840e [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:06:47.199622 19375 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.3:36891, user_credentials={real_user=slave}} blocked reactor thread for 243460us
I20260709 13:06:47.170840 25127 raft_consensus.cc:2749] T 65d8cb8d6ec64f459d5a47cefab10acf P e5256d91808b47c195bc9b4dbd7f2b87 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:06:47.203657 19479 raft_consensus.cc:1240] T a08760e15aac4630a629431f56024dc8 P 0473d2b2d01f4459b1e90fd12cc7840e [term 20 FOLLOWER]: Rejecting Update request from peer e5256d91808b47c195bc9b4dbd7f2b87 for earlier term 19. Current term is 20. Ops: []
I20260709 13:06:47.207305 19479 raft_consensus.cc:1240] T 179fd671030940b4b4a4e24bcc4aba0a P 0473d2b2d01f4459b1e90fd12cc7840e [term 19 FOLLOWER]: Rejecting Update request from peer e5256d91808b47c195bc9b4dbd7f2b87 for earlier term 18. Current term is 19. Ops: []
I20260709 13:06:47.211647 19483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa8650e71aa14778b3d73721fc50d9fc" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:06:47.172732 25039 leader_election.cc:290] T ff75a1d4cb1f493db8f71ddc136ba9ab P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 17 election: Requested vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:06:47.173933 25185 leader_election.cc:290] T ed7fdbcb96d14d418db9ca90a792588a P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
W20260709 13:06:47.201402 25163 consensus_meta.cc:287] T fa8650e71aa14778b3d73721fc50d9fc P e61c3a8f61bb48f8a963c9480e53c168: Time spent flushing consensus metadata: real 0.851s	user 0.008s	sys 0.012s
I20260709 13:06:47.186540 24891 raft_consensus.cc:515] T f93ee515a9c14139bf566522ed8232f3 P 0473d2b2d01f4459b1e90fd12cc7840e [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:47.220973 19554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff75a1d4cb1f493db8f71ddc136ba9ab" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:06:47.224536 19554 raft_consensus.cc:3060] T ff75a1d4cb1f493db8f71ddc136ba9ab P e61c3a8f61bb48f8a963c9480e53c168 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:06:47.225085 19526 leader_election.cc:304] T 96efeaaf1057492490e9a621f37e1a2d P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:06:47.199120 25245 raft_consensus.cc:2749] T 172b3dd13109415a955b71ac0e9d2234 P 0473d2b2d01f4459b1e90fd12cc7840e [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:06:47.230639 19477 raft_consensus.cc:2468] T 5ec1c4ce15e04c7e8c283a62179f2a64 P 0473d2b2d01f4459b1e90fd12cc7840e [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 11.
I20260709 13:06:47.233785 25183 consensus_queue.cc:260] T f1b10566f45d4a7d9029858330e02d5b P e61c3a8f61bb48f8a963c9480e53c168 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:47.235718 25183 raft_consensus.cc:3060] T f1b10566f45d4a7d9029858330e02d5b P e61c3a8f61bb48f8a963c9480e53c168 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:06:47.240574 19483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e1f505cb0f1427bbd698ac889d80821" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:06:47.241321 19483 raft_consensus.cc:3060] T 3e1f505cb0f1427bbd698ac889d80821 P 0473d2b2d01f4459b1e90fd12cc7840e [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:06:47.205016 25063 raft_consensus.cc:2749] T ff9b0eddd810459b82d91c60777c10eb P 0473d2b2d01f4459b1e90fd12cc7840e [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:06:47.206307 25075 raft_consensus.cc:493] T 6c5eebf646ad445a9d1b1adc319d7b16 P 127766fc592545a4997f7790f50f6076 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:47.239279 20107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "775c229504194560ba9589bc2199b089" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
W20260709 13:06:47.252405 19374 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.4:43121, user_credentials={real_user=slave}} blocked reactor thread for 106637us
W20260709 13:06:47.252883 19377 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.2:46257, user_credentials={real_user=slave}} blocked reactor thread for 60703.4us
I20260709 13:06:47.255062 19377 leader_election.cc:304] T d1e5873a19244c5ebbcd38e126796ee7 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:06:47.258817 19377 leader_election.cc:304] T 1dc5b3532fe54f74876d02beffa2c230 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:06:47.271106 19377 leader_election.cc:304] T 21e14947d70440f19044d8f75c31e1f9 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:06:47.205142 25210 raft_consensus.cc:515] T edd7d470b5014c9489be7f41f64355c9 P 0473d2b2d01f4459b1e90fd12cc7840e [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:47.232568 25163 raft_consensus.cc:2749] T fa8650e71aa14778b3d73721fc50d9fc P e61c3a8f61bb48f8a963c9480e53c168 [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:06:47.243098 25039 raft_consensus.cc:2749] T f1b10566f45d4a7d9029858330e02d5b P e5256d91808b47c195bc9b4dbd7f2b87 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:06:47.238631 25185 raft_consensus.cc:2804] T 96efeaaf1057492490e9a621f37e1a2d P e61c3a8f61bb48f8a963c9480e53c168 [term 18 FOLLOWER]: Leader pre-election won for term 19
W20260709 13:06:47.242784 25095 consensus_queue.cc:1175] T f1b10566f45d4a7d9029858330e02d5b P e61c3a8f61bb48f8a963c9480e53c168 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" responder_term: 15 status { last_received { term: 15 index: 10 } last_committed_idx: 10 last_received_current_leader { term: 15 index: 10 } }
I20260709 13:06:47.224539 25241 consensus_queue.cc:1048] T f93ee515a9c14139bf566522ed8232f3 P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.050s
I20260709 13:06:47.224071 25086 consensus_queue.cc:1048] T edd7d470b5014c9489be7f41f64355c9 P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.051s
I20260709 13:06:47.297578 20107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ec1c4ce15e04c7e8c283a62179f2a64" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:06:47.246417 25127 consensus_queue.cc:1059] T 2e36a9d6e29c4a7c860cf267efbd4c74 P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 }, Status: INVALID_TERM, Last received: 11.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.043s
I20260709 13:06:47.285241 25265 leader_election.cc:290] T 5ec1c4ce15e04c7e8c283a62179f2a64 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:06:47.286396 25185 raft_consensus.cc:493] T 96efeaaf1057492490e9a621f37e1a2d P e61c3a8f61bb48f8a963c9480e53c168 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:06:47.312167 25217 log.cc:927] Time spent T 309c3ca0ca4b4f3ba129752ea2cb293b P e5256d91808b47c195bc9b4dbd7f2b87: Append to log took a long time: real 0.981s	user 0.004s	sys 0.001s
I20260709 13:06:47.312107 19554 raft_consensus.cc:2468] T ff75a1d4cb1f493db8f71ddc136ba9ab P e61c3a8f61bb48f8a963c9480e53c168 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 17.
I20260709 13:06:47.311380 19483 raft_consensus.cc:2468] T 3e1f505cb0f1427bbd698ac889d80821 P 0473d2b2d01f4459b1e90fd12cc7840e [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 19.
W20260709 13:06:47.300478 25138 consensus_meta.cc:287] T 40e1e16737a842ee936002830f36882e P e61c3a8f61bb48f8a963c9480e53c168: Time spent flushing consensus metadata: real 0.633s	user 0.013s	sys 0.003s
I20260709 13:06:47.312484 25240 leader_election.cc:290] T 7be9efa6559648dbb5a0f7684c4542d1 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:06:47.252734 25075 raft_consensus.cc:515] T 6c5eebf646ad445a9d1b1adc319d7b16 P 127766fc592545a4997f7790f50f6076 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:47.319020 19483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c5eebf646ad445a9d1b1adc319d7b16" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 17 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:06:47.327651 20112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7be9efa6559648dbb5a0f7684c4542d1" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:06:47.329306 25276 raft_consensus.cc:2749] T d1e5873a19244c5ebbcd38e126796ee7 P e5256d91808b47c195bc9b4dbd7f2b87 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:06:47.329936 25276 raft_consensus.cc:2749] T 1dc5b3532fe54f74876d02beffa2c230 P e5256d91808b47c195bc9b4dbd7f2b87 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:06:47.330476 25276 raft_consensus.cc:2749] T 21e14947d70440f19044d8f75c31e1f9 P e5256d91808b47c195bc9b4dbd7f2b87 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:06:47.330978 25276 raft_consensus.cc:493] T 2b74109013a140ada21feeef92d6f563 P e5256d91808b47c195bc9b4dbd7f2b87 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:47.331357 25276 raft_consensus.cc:515] T 2b74109013a140ada21feeef92d6f563 P e5256d91808b47c195bc9b4dbd7f2b87 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:47.331713 24891 leader_election.cc:290] T f93ee515a9c14139bf566522ed8232f3 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:06:47.312717 25225 raft_consensus.cc:2955] T 309c3ca0ca4b4f3ba129752ea2cb293b P 127766fc592545a4997f7790f50f6076 [term 11 LEADER]: Committing config change with OpId 9.10: config changed from index 5 to 10, VOTER e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3) evicted. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } } }
I20260709 13:06:47.335762 25210 leader_election.cc:290] T edd7d470b5014c9489be7f41f64355c9 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:06:47.336884 25250 leader_election.cc:290] T ab43d85f64114d4ebf618930e43d9ed0 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
W20260709 13:06:47.339636 25154 consensus_meta.cc:287] T fa8650e71aa14778b3d73721fc50d9fc P 0473d2b2d01f4459b1e90fd12cc7840e: Time spent flushing consensus metadata: real 0.917s	user 0.014s	sys 0.002s
I20260709 13:06:47.340471 19484 raft_consensus.cc:2468] T fa8650e71aa14778b3d73721fc50d9fc P 0473d2b2d01f4459b1e90fd12cc7840e [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 16.
I20260709 13:06:47.319499 25085 leader_election.cc:290] T 22196caba61445d3bec98a0aab3c337d P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
W20260709 13:06:47.342022 24990 consensus_meta.cc:287] T 46c5bfeecc314717bffe987e6844b6d0 P 0473d2b2d01f4459b1e90fd12cc7840e: Time spent flushing consensus metadata: real 0.668s	user 0.004s	sys 0.016s
I20260709 13:06:47.292491 25271 raft_consensus.cc:2749] T b08304a0a02b42d7840c4e8ee9a6bd1a P e5256d91808b47c195bc9b4dbd7f2b87 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:06:47.342648 25253 raft_consensus.cc:515] T 2a16f7501e2444fb86d4e2778e734e02 P 127766fc592545a4997f7790f50f6076 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
W20260709 13:06:47.348737 25254 log.cc:927] Time spent T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P 127766fc592545a4997f7790f50f6076: Append to log took a long time: real 0.485s	user 0.002s	sys 0.000s
I20260709 13:06:47.342893 19482 raft_consensus.cc:2410] T 46c5bfeecc314717bffe987e6844b6d0 P 0473d2b2d01f4459b1e90fd12cc7840e [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate e5256d91808b47c195bc9b4dbd7f2b87 for term 22 because replica has last-logged OpId of term: 21 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 20 index: 10.
I20260709 13:06:47.296613 25262 raft_consensus.cc:2955] T 14935b3ddf914369822e4a0547aaa355 P 127766fc592545a4997f7790f50f6076 [term 10 LEADER]: Committing config change with OpId 10.9: config changed from index 4 to 9, VOTER e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1) evicted. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } } }
I20260709 13:06:47.352819 19482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df751f992649444090e27965eb1af85d" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:06:47.355919 19482 raft_consensus.cc:2468] T df751f992649444090e27965eb1af85d P 0473d2b2d01f4459b1e90fd12cc7840e [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 19.
I20260709 13:06:47.346608 19483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed7fdbcb96d14d418db9ca90a792588a" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:06:47.357357 19482 raft_consensus.cc:1240] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P 0473d2b2d01f4459b1e90fd12cc7840e [term 18 FOLLOWER]: Rejecting Update request from peer e5256d91808b47c195bc9b4dbd7f2b87 for earlier term 17. Current term is 18. Ops: []
I20260709 13:06:47.357760 19483 raft_consensus.cc:2468] T ed7fdbcb96d14d418db9ca90a792588a P 0473d2b2d01f4459b1e90fd12cc7840e [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 13.
I20260709 13:06:47.358213 25253 leader_election.cc:290] T 2a16f7501e2444fb86d4e2778e734e02 P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 16 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:06:47.344820 20104 pending_rounds.cc:85] T 6c5eebf646ad445a9d1b1adc319d7b16 P 127766fc592545a4997f7790f50f6076: Aborting all ops after (but not including) 10
W20260709 13:06:47.324730 25165 consensus_meta.cc:287] T ef32ce6fdd0e40d382c79974f30295c6 P e61c3a8f61bb48f8a963c9480e53c168: Time spent flushing consensus metadata: real 0.602s	user 0.015s	sys 0.001s
W20260709 13:06:47.325876 25224 consensus_meta.cc:287] T 62c6c134d3d24a1ab144dd9ee6bc3f64 P 127766fc592545a4997f7790f50f6076: Time spent flushing consensus metadata: real 0.660s	user 0.012s	sys 0.002s
I20260709 13:06:47.319151 25185 raft_consensus.cc:3060] T 96efeaaf1057492490e9a621f37e1a2d P e61c3a8f61bb48f8a963c9480e53c168 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:06:47.362644 20104 pending_rounds.cc:107] T 6c5eebf646ad445a9d1b1adc319d7b16 P 127766fc592545a4997f7790f50f6076: Aborting uncommitted NO_OP operation due to leader change: 13.11
I20260709 13:06:47.367726 20104 raft_consensus.cc:2889] T 6c5eebf646ad445a9d1b1adc319d7b16 P 127766fc592545a4997f7790f50f6076 [term 16 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:06:47.371366 25236 raft_consensus.cc:493] T 7be9efa6559648dbb5a0f7684c4542d1 P 127766fc592545a4997f7790f50f6076 [term 15 FOLLOWER]: Starting leader election (detected failure of leader e5256d91808b47c195bc9b4dbd7f2b87)
I20260709 13:06:47.372043 25236 raft_consensus.cc:3060] T 7be9efa6559648dbb5a0f7684c4542d1 P 127766fc592545a4997f7790f50f6076 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:06:47.346469 25276 leader_election.cc:290] T 2b74109013a140ada21feeef92d6f563 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:06:47.344619 25075 leader_election.cc:290] T 6c5eebf646ad445a9d1b1adc319d7b16 P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:06:47.389765 25233 raft_consensus.cc:3060] T 5ec1c4ce15e04c7e8c283a62179f2a64 P 127766fc592545a4997f7790f50f6076 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:06:47.390727 25052 raft_consensus.cc:3055] T 2725d2c4cb054f18b0fc8f735c15f6c2 P e61c3a8f61bb48f8a963c9480e53c168 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:06:47.369306 25224 raft_consensus.cc:515] T 62c6c134d3d24a1ab144dd9ee6bc3f64 P 127766fc592545a4997f7790f50f6076 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:47.395033 25085 raft_consensus.cc:3055] T 2e36a9d6e29c4a7c860cf267efbd4c74 P e5256d91808b47c195bc9b4dbd7f2b87 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:06:47.362110 25207 raft_consensus.cc:2749] T ece3db938bc649d4a40a51522ed5259c P e5256d91808b47c195bc9b4dbd7f2b87 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:06:47.396088 25094 raft_consensus.cc:3055] T 3e1f505cb0f1427bbd698ac889d80821 P e5256d91808b47c195bc9b4dbd7f2b87 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:06:47.355259 25138 raft_consensus.cc:515] T 40e1e16737a842ee936002830f36882e P e61c3a8f61bb48f8a963c9480e53c168 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:47.361137 24932 raft_consensus.cc:515] T ff75a1d4cb1f493db8f71ddc136ba9ab P 0473d2b2d01f4459b1e90fd12cc7840e [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:47.397287 25052 raft_consensus.cc:740] T 2725d2c4cb054f18b0fc8f735c15f6c2 P e61c3a8f61bb48f8a963c9480e53c168 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: e61c3a8f61bb48f8a963c9480e53c168, State: Running, Role: LEADER
I20260709 13:06:47.404718 25094 raft_consensus.cc:740] T 3e1f505cb0f1427bbd698ac889d80821 P e5256d91808b47c195bc9b4dbd7f2b87 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: e5256d91808b47c195bc9b4dbd7f2b87, State: Running, Role: LEADER
I20260709 13:06:47.410858 25052 consensus_queue.cc:260] T 2725d2c4cb054f18b0fc8f735c15f6c2 P e61c3a8f61bb48f8a963c9480e53c168 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 17.9, Last appended by leader: 9, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:47.411437 25224 leader_election.cc:290] T 62c6c134d3d24a1ab144dd9ee6bc3f64 P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 15 election: Requested vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:06:47.411114 25094 consensus_queue.cc:260] T 3e1f505cb0f1427bbd698ac889d80821 P e5256d91808b47c195bc9b4dbd7f2b87 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.11, Last appended by leader: 11, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:47.412771 25094 raft_consensus.cc:3060] T 3e1f505cb0f1427bbd698ac889d80821 P e5256d91808b47c195bc9b4dbd7f2b87 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:06:47.413338 25138 leader_election.cc:290] T 40e1e16737a842ee936002830f36882e P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 18 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:06:47.411878 25052 raft_consensus.cc:3060] T 2725d2c4cb054f18b0fc8f735c15f6c2 P e61c3a8f61bb48f8a963c9480e53c168 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:06:47.400475 25085 raft_consensus.cc:740] T 2e36a9d6e29c4a7c860cf267efbd4c74 P e5256d91808b47c195bc9b4dbd7f2b87 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: e5256d91808b47c195bc9b4dbd7f2b87, State: Running, Role: LEADER
I20260709 13:06:47.416672 25085 consensus_queue.cc:260] T 2e36a9d6e29c4a7c860cf267efbd4c74 P e5256d91808b47c195bc9b4dbd7f2b87 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:47.418236 25085 raft_consensus.cc:3060] T 2e36a9d6e29c4a7c860cf267efbd4c74 P e5256d91808b47c195bc9b4dbd7f2b87 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:06:47.428645 25262 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.ChangeConfig from 127.0.0.1:40508 (request call id 2) took 4497 ms. Trace:
I20260709 13:06:47.358422 19480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c5eebf646ad445a9d1b1adc319d7b16" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 17 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
W20260709 13:06:47.472043 19525 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:47.455368 19451 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:47.486884 20103 raft_consensus.cc:1240] T 62c6c134d3d24a1ab144dd9ee6bc3f64 P 127766fc592545a4997f7790f50f6076 [term 15 FOLLOWER]: Rejecting Update request from peer 0473d2b2d01f4459b1e90fd12cc7840e for earlier term 14. Current term is 15. Ops: []
I20260709 13:06:47.502218 24932 leader_election.cc:290] T ff75a1d4cb1f493db8f71ddc136ba9ab P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 17 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:06:47.515673 19477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62c6c134d3d24a1ab144dd9ee6bc3f64" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:06:47.503219 19486 raft_consensus.cc:2393] T ff75a1d4cb1f493db8f71ddc136ba9ab P 0473d2b2d01f4459b1e90fd12cc7840e [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e5256d91808b47c195bc9b4dbd7f2b87 in current term 17: Already voted for candidate 0473d2b2d01f4459b1e90fd12cc7840e in this term.
I20260709 13:06:47.490285 19480 raft_consensus.cc:1240] T 2b74109013a140ada21feeef92d6f563 P 0473d2b2d01f4459b1e90fd12cc7840e [term 13 FOLLOWER]: Rejecting Update request from peer e61c3a8f61bb48f8a963c9480e53c168 for earlier term 12. Current term is 13. Ops: []
I20260709 13:06:47.481201 19374 leader_election.cc:304] T 1f85fc4b527a48848e5faa083b604e36 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 127766fc592545a4997f7790f50f6076, e5256d91808b47c195bc9b4dbd7f2b87; no voters: 
I20260709 13:06:47.485754 20107 raft_consensus.cc:2468] T 5ec1c4ce15e04c7e8c283a62179f2a64 P 127766fc592545a4997f7790f50f6076 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 11.
I20260709 13:06:47.518224 19478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40e1e16737a842ee936002830f36882e" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:06:47.465601 19411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a16f7501e2444fb86d4e2778e734e02" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
I20260709 13:06:47.453222 19408 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49050 (request call id 1094) took 2417 ms. Trace:
I20260709 13:06:47.546386 24702 raft_consensus.cc:493] T d1e5873a19244c5ebbcd38e126796ee7 P e61c3a8f61bb48f8a963c9480e53c168 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:47.547479 24702 raft_consensus.cc:515] T d1e5873a19244c5ebbcd38e126796ee7 P e61c3a8f61bb48f8a963c9480e53c168 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:47.551088 25241 raft_consensus.cc:493] T 0e1085d23e8347fbbd5bce7542f4b1f4 P e61c3a8f61bb48f8a963c9480e53c168 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 127766fc592545a4997f7790f50f6076)
I20260709 13:06:47.552765 25165 raft_consensus.cc:493] T 46c5bfeecc314717bffe987e6844b6d0 P e61c3a8f61bb48f8a963c9480e53c168 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 0473d2b2d01f4459b1e90fd12cc7840e)
I20260709 13:06:47.552067 19477 raft_consensus.cc:2955] T 14935b3ddf914369822e4a0547aaa355 P 0473d2b2d01f4459b1e90fd12cc7840e [term 10 FOLLOWER]: Committing config change with OpId 10.9: config changed from index 4 to 9, VOTER e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1) evicted. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } } }
I20260709 13:06:47.553807 25165 raft_consensus.cc:515] T 46c5bfeecc314717bffe987e6844b6d0 P e61c3a8f61bb48f8a963c9480e53c168 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
W20260709 13:06:47.458317 19377 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.2:46257, user_credentials={real_user=slave}} blocked reactor thread for 187143us
I20260709 13:06:47.556057 25086 raft_consensus.cc:493] T b08304a0a02b42d7840c4e8ee9a6bd1a P e61c3a8f61bb48f8a963c9480e53c168 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 0473d2b2d01f4459b1e90fd12cc7840e)
I20260709 13:06:47.556947 25086 raft_consensus.cc:515] T b08304a0a02b42d7840c4e8ee9a6bd1a P e61c3a8f61bb48f8a963c9480e53c168 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:47.557763 24932 raft_consensus.cc:493] T 22196caba61445d3bec98a0aab3c337d P 0473d2b2d01f4459b1e90fd12cc7840e [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:47.558005 19377 leader_election.cc:304] T 217b5fae677b4971b3bbd2f357a1f7ff P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:06:47.558426 24932 raft_consensus.cc:515] T 22196caba61445d3bec98a0aab3c337d P 0473d2b2d01f4459b1e90fd12cc7840e [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:47.429220 25262 rpcz_store.cc:276] 0709 13:06:42.930997 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:42.931109 (+   112us) service_pool.cc:224] Handling call
0709 13:06:43.564426 (+633317us) spinlock_profiling.cc:243] Waited 19.5 ms on lock 0x7b54004171a0. stack: 00007f4a79de9343 00007f4a79de9240 00007f4a797781d4 00007f4a834b6304 00007f4a834b6299 00007f4a7ce71571 00007f4a7ce85520 00007f4a7cf0eb42 00007f4a7cf0d800 00007f4a7cf069fa 00007f4a81ece4c9 00007f4a7b44ac54 00007f4a7b44abe2 00007f4a7b44ab11 00007f4a7b44aa8c 00007f4a7b449d42
0709 13:06:43.855381 (+290955us) spinlock_profiling.cc:243] Waited 16.4 ms on lock 0x7b5800679ad0. stack: 00007f4a79de9343 00007f4a79de9240 00007f4a797781d4 00007f4a834b6304 00007f4a834b6299 00007f4a7ce71571 00007f4a7ce640aa 00007f4a7cee6447 00007f4a7cf0370a 00007f4a7cf0476a 00007f4a7cf0391b 00007f4a7cf0f03c 00007f4a7cf0e6b3 00007f4a7cf069fa 00007f4a81ece4c9 00007f4a7b44ac54
0709 13:06:44.542622 (+687241us) spinlock_profiling.cc:243] Waited 38.1 ms on lock 0x7b54004171a0. stack: 00007f4a79de9343 00007f4a79de9240 00007f4a797781d4 00007f4a834b6304 00007f4a834b6299 00007f4a7ce71571 00007f4a7ce7da1d 00007f4a7ce641a4 00007f4a7cee6447 00007f4a7cf0370a 00007f4a7cf0476a 00007f4a7cf0391b 00007f4a7cf0f03c 00007f4a7cf0e6b3 00007f4a7cf069fa 00007f4a81ece4c9
0709 13:06:44.610195 (+ 67573us) log.cc:844] Serialized 494 byte log entry
0709 13:06:45.142071 (+531876us) spinlock_profiling.cc:243] Waited 9.12 ms on lock 0x7b180044a280. stack: 00007f4a79de9343 00007f4a79de9240 00007f4a797781d4 00007f4a834b6304 00007f4a834b6299 00007f4a82ce3de1 00007f4a82cf05b1 00007f4a79d95c0a 00007f4a834d5219 00007f4a79e1da40 00007f4a79e184e4 00007f4a79e18455 00007f4a7ce61b0b 00007f4a7cee6b63 00007f4a7cf0e752 00007f4a7cf069fa
0709 13:06:45.314003 (+171932us) spinlock_profiling.cc:243] Waited 1.08 ms on lock 0x7b54004171a0. stack: 00007f4a79de9343 00007f4a79de9240 00007f4a797781d4 00007f4a834b6304 00007f4a834b6299 00007f4a7ce71571 00007f4a7ce7ddbe 00007f4a7ce88930 00007f4a7ce888d8 00007f4a7ce88858 00007f4a7ce88813 00007f4a7ce87a9c 00007f4a82d73626 00007f4a82d6ddd8 00007f4a7cec47cb 00007f4a7cec72c0
0709 13:06:47.428459 (+2114456us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":44504,"raft.queue_time_us":134261,"raft.run_cpu_time_us":980,"raft.run_wall_time_us":87062,"spinlock_wait_cycles":193782656,"thread_start_us":399155,"threads_started":1,"wal-append.queue_time_us":406504,"wal-append.run_cpu_time_us":3843,"wal-append.run_wall_time_us":1314104}
I20260709 13:06:47.567306 19293 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 14935b3ddf914369822e4a0547aaa355 with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:06:47.567693 24964 raft_consensus.cc:3055] T 172b3dd13109415a955b71ac0e9d2234 P e5256d91808b47c195bc9b4dbd7f2b87 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:06:47.568154 24964 raft_consensus.cc:740] T 172b3dd13109415a955b71ac0e9d2234 P e5256d91808b47c195bc9b4dbd7f2b87 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: e5256d91808b47c195bc9b4dbd7f2b87, State: Running, Role: LEADER
I20260709 13:06:47.563297 24932 leader_election.cc:290] T 22196caba61445d3bec98a0aab3c337d P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:06:47.571408 19411 raft_consensus.cc:2393] T 2a16f7501e2444fb86d4e2778e734e02 P e5256d91808b47c195bc9b4dbd7f2b87 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 127766fc592545a4997f7790f50f6076 in current term 16: Already voted for candidate e5256d91808b47c195bc9b4dbd7f2b87 in this term.
I20260709 13:06:47.552112 25241 raft_consensus.cc:515] T 0e1085d23e8347fbbd5bce7542f4b1f4 P e61c3a8f61bb48f8a963c9480e53c168 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:47.516628 25183 raft_consensus.cc:493] T 833a2f0775ed407a94b8924ce50adb63 P e61c3a8f61bb48f8a963c9480e53c168 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 127766fc592545a4997f7790f50f6076)
I20260709 13:06:47.579838 25183 raft_consensus.cc:515] T 833a2f0775ed407a94b8924ce50adb63 P e61c3a8f61bb48f8a963c9480e53c168 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:47.580986 25165 leader_election.cc:290] T 46c5bfeecc314717bffe987e6844b6d0 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:06:47.582131 25241 leader_election.cc:290] T 0e1085d23e8347fbbd5bce7542f4b1f4 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:06:47.582636 25086 leader_election.cc:290] T b08304a0a02b42d7840c4e8ee9a6bd1a P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:06:47.544028 19408 rpcz_store.cc:276] 0709 13:06:45.035688 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:46.091451 (+1055763us) service_pool.cc:224] Handling call
0709 13:06:46.092239 (+   788us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:06:46.092914 (+   675us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:46.092941 (+    27us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:06:46.110762 (+ 17821us) log.cc:844] Serialized 520 byte log entry
0709 13:06:46.228988 (+118226us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:06:46.229047 (+    59us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:46.229145 (+    98us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:47.211324 (+982179us) spinlock_profiling.cc:243] Waited 8.08 ms on lock 0x7b4400022b4c. stack: 00007f4a79de9343 00007f4a79de9240 00007f4a797781d4 00007f4a834b6304 00007f4a834b6299 00007f4a79ca3db1 00007f4a79d41c85 00007f4a79d426a2 00007f4a7cab41db 00007f4a7caafaaf 00007f4a7caa386e 00007f4a7caa2bb6 00007f4a7caa27d8 00007f4a7caac221 00007f4a7caac1d9 00007f4a7caac169
0709 13:06:47.452066 (+240742us) raft_consensus.cc:1685] finished
0709 13:06:47.452150 (+    84us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:47.452846 (+   696us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":137,"raft.run_cpu_time_us":113,"raft.run_wall_time_us":3730,"spinlock_wait_cycles":18591488,"thread_start_us":117784,"threads_started":1,"wal-append.queue_time_us":142243}
I20260709 13:06:47.508368 25089 consensus_queue.cc:1059] T 172b3dd13109415a955b71ac0e9d2234 P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false }, Status: INVALID_TERM, Last received: 14.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.078s
I20260709 13:06:47.586709 25093 raft_consensus.cc:2804] T 1f85fc4b527a48848e5faa083b604e36 P e5256d91808b47c195bc9b4dbd7f2b87 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:06:47.587296 25093 raft_consensus.cc:493] T 1f85fc4b527a48848e5faa083b604e36 P e5256d91808b47c195bc9b4dbd7f2b87 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:47.587829 25093 raft_consensus.cc:3060] T 1f85fc4b527a48848e5faa083b604e36 P e5256d91808b47c195bc9b4dbd7f2b87 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:06:47.591231 25039 raft_consensus.cc:2749] T 217b5fae677b4971b3bbd2f357a1f7ff P e5256d91808b47c195bc9b4dbd7f2b87 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:06:47.592010 19524 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:47.592463 19524 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:47.592854 19524 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:47.595458 19558 raft_consensus.cc:1240] T 6c5eebf646ad445a9d1b1adc319d7b16 P e61c3a8f61bb48f8a963c9480e53c168 [term 17 FOLLOWER]: Rejecting Update request from peer 0473d2b2d01f4459b1e90fd12cc7840e for earlier term 16. Current term is 17. Ops: [16.12-16.12]
I20260709 13:06:47.595674 19478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46c5bfeecc314717bffe987e6844b6d0" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 22 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:06:47.596563 19478 raft_consensus.cc:2468] T 46c5bfeecc314717bffe987e6844b6d0 P 0473d2b2d01f4459b1e90fd12cc7840e [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 22.
I20260709 13:06:47.597656 19478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e1085d23e8347fbbd5bce7542f4b1f4" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:06:47.598326 19558 raft_consensus.cc:1240] T 86a6797bdfe94fa496c050ceae4bd0d9 P e61c3a8f61bb48f8a963c9480e53c168 [term 13 FOLLOWER]: Rejecting Update request from peer 0473d2b2d01f4459b1e90fd12cc7840e for earlier term 12. Current term is 13. Ops: []
I20260709 13:06:47.516149 25138 raft_consensus.cc:493] T ab43d85f64114d4ebf618930e43d9ed0 P e61c3a8f61bb48f8a963c9480e53c168 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 127766fc592545a4997f7790f50f6076)
I20260709 13:06:47.599233 25138 raft_consensus.cc:515] T ab43d85f64114d4ebf618930e43d9ed0 P e61c3a8f61bb48f8a963c9480e53c168 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:47.601878 25138 leader_election.cc:290] T ab43d85f64114d4ebf618930e43d9ed0 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:06:47.583388 24702 leader_election.cc:290] T d1e5873a19244c5ebbcd38e126796ee7 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
W20260709 13:06:47.583076 19374 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.4:43121, user_credentials={real_user=slave}} blocked reactor thread for 102228us
I20260709 13:06:47.582435 25183 leader_election.cc:290] T 833a2f0775ed407a94b8924ce50adb63 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:06:47.605077 19482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e5873a19244c5ebbcd38e126796ee7" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:06:47.605825 19482 raft_consensus.cc:2468] T d1e5873a19244c5ebbcd38e126796ee7 P 0473d2b2d01f4459b1e90fd12cc7840e [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 18.
I20260709 13:06:47.606137 19481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28af091831594f9d8e96482078cc7625" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:06:47.607435 19479 raft_consensus.cc:1275] T 14efcc79969f41babe5529c22d59156d P 0473d2b2d01f4459b1e90fd12cc7840e [term 17 FOLLOWER]: Refusing update from remote peer 127766fc592545a4997f7790f50f6076: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 13:06:47.505852 25097 raft_consensus.cc:515] T 96efeaaf1057492490e9a621f37e1a2d P 0473d2b2d01f4459b1e90fd12cc7840e [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
W20260709 13:06:47.622805 19377 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.2:46257, user_credentials={real_user=slave}} blocked reactor thread for 64966.9us
I20260709 13:06:47.626199 19377 leader_election.cc:304] T 2725d2c4cb054f18b0fc8f735c15f6c2 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:06:47.619633 19478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b08304a0a02b42d7840c4e8ee9a6bd1a" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:06:47.627931 19478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab43d85f64114d4ebf618930e43d9ed0" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:06:47.628638 20110 raft_consensus.cc:1240] T ece3db938bc649d4a40a51522ed5259c P 127766fc592545a4997f7790f50f6076 [term 13 FOLLOWER]: Rejecting Update request from peer e61c3a8f61bb48f8a963c9480e53c168 for earlier term 12. Current term is 13. Ops: []
I20260709 13:06:47.631215 20105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa731b585f684a7fb2d106c50f143b83" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076"
I20260709 13:06:47.639532 25097 leader_election.cc:290] T 96efeaaf1057492490e9a621f37e1a2d P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 19 election: Requested vote from peers e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
W20260709 13:06:47.643972 25293 log.cc:927] Time spent T 6c5eebf646ad445a9d1b1adc319d7b16 P 127766fc592545a4997f7790f50f6076: Append to log took a long time: real 0.116s	user 0.000s	sys 0.001s
I20260709 13:06:47.622282 25185 raft_consensus.cc:515] T 96efeaaf1057492490e9a621f37e1a2d P e61c3a8f61bb48f8a963c9480e53c168 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:47.651880 19478 raft_consensus.cc:1275] T 7f575b143b844aa096b50997dad3516a P 0473d2b2d01f4459b1e90fd12cc7840e [term 13 FOLLOWER]: Refusing update from remote peer e61c3a8f61bb48f8a963c9480e53c168: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 13:06:47.646906 19483 raft_consensus.cc:1275] T ed7fdbcb96d14d418db9ca90a792588a P 0473d2b2d01f4459b1e90fd12cc7840e [term 13 FOLLOWER]: Refusing update from remote peer 127766fc592545a4997f7790f50f6076: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:06:47.646289 25093 raft_consensus.cc:515] T 1f85fc4b527a48848e5faa083b604e36 P e5256d91808b47c195bc9b4dbd7f2b87 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:47.657341 25093 leader_election.cc:290] T 1f85fc4b527a48848e5faa083b604e36 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 15 election: Requested vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:06:47.659440 24964 consensus_queue.cc:260] T 172b3dd13109415a955b71ac0e9d2234 P e5256d91808b47c195bc9b4dbd7f2b87 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:47.659337 19481 raft_consensus.cc:2468] T 28af091831594f9d8e96482078cc7625 P 0473d2b2d01f4459b1e90fd12cc7840e [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 17.
I20260709 13:06:47.653916 25185 leader_election.cc:290] T 96efeaaf1057492490e9a621f37e1a2d P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 19 election: Requested vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:06:47.667315 19477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96efeaaf1057492490e9a621f37e1a2d" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:06:47.669312 19477 raft_consensus.cc:2393] T 96efeaaf1057492490e9a621f37e1a2d P 0473d2b2d01f4459b1e90fd12cc7840e [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate e61c3a8f61bb48f8a963c9480e53c168 in current term 19: Already voted for candidate 0473d2b2d01f4459b1e90fd12cc7840e in this term.
I20260709 13:06:47.675153 20105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96efeaaf1057492490e9a621f37e1a2d" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:06:47.681628 19558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a61655d99124a29b486ba4a5b37faea" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
W20260709 13:06:47.725347 20075 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:47.677378 25093 raft_consensus.cc:2749] T 2725d2c4cb054f18b0fc8f735c15f6c2 P e5256d91808b47c195bc9b4dbd7f2b87 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:06:47.735355 25246 leader_election.cc:290] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 18 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
W20260709 13:06:47.736064 19526 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:47.736354 19560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22196caba61445d3bec98a0aab3c337d" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:06:47.737142 19560 raft_consensus.cc:2468] T 22196caba61445d3bec98a0aab3c337d P e61c3a8f61bb48f8a963c9480e53c168 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 15.
I20260709 13:06:47.737552 19526 leader_election.cc:304] T 3e1f505cb0f1427bbd698ac889d80821 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:06:47.732494 20105 raft_consensus.cc:2468] T 96efeaaf1057492490e9a621f37e1a2d P 127766fc592545a4997f7790f50f6076 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 17.
I20260709 13:06:47.743427 19559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a08760e15aac4630a629431f56024dc8" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:06:47.759708 25292 raft_consensus.cc:493] T b9f0d59553ad444883fcf5b5909f9798 P e5256d91808b47c195bc9b4dbd7f2b87 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader e61c3a8f61bb48f8a963c9480e53c168)
I20260709 13:06:47.760553 25292 raft_consensus.cc:515] T b9f0d59553ad444883fcf5b5909f9798 P e5256d91808b47c195bc9b4dbd7f2b87 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:47.762923 25292 leader_election.cc:290] T b9f0d59553ad444883fcf5b5909f9798 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:06:47.765089 25237 raft_consensus.cc:3055] T 86a6797bdfe94fa496c050ceae4bd0d9 P 0473d2b2d01f4459b1e90fd12cc7840e [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:06:47.765518 25237 raft_consensus.cc:740] T 86a6797bdfe94fa496c050ceae4bd0d9 P 0473d2b2d01f4459b1e90fd12cc7840e [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 0473d2b2d01f4459b1e90fd12cc7840e, State: Running, Role: LEADER
I20260709 13:06:47.768113 19560 raft_consensus.cc:1240] T 40e1e16737a842ee936002830f36882e P e61c3a8f61bb48f8a963c9480e53c168 [term 18 FOLLOWER]: Rejecting Update request from peer e5256d91808b47c195bc9b4dbd7f2b87 for earlier term 17. Current term is 18. Ops: []
I20260709 13:06:47.769099 19404 raft_consensus.cc:1240] T ef32ce6fdd0e40d382c79974f30295c6 P e5256d91808b47c195bc9b4dbd7f2b87 [term 20 FOLLOWER]: Rejecting Update request from peer e61c3a8f61bb48f8a963c9480e53c168 for earlier term 19. Current term is 20. Ops: [19.11-19.11]
I20260709 13:06:47.769589 19409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa731b585f684a7fb2d106c50f143b83" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
I20260709 13:06:47.769932 19485 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39478 (request call id 904) took 1005 ms. Trace:
I20260709 13:06:47.770717 19403 raft_consensus.cc:1240] T ece3db938bc649d4a40a51522ed5259c P e5256d91808b47c195bc9b4dbd7f2b87 [term 13 FOLLOWER]: Rejecting Update request from peer e61c3a8f61bb48f8a963c9480e53c168 for earlier term 12. Current term is 13. Ops: []
I20260709 13:06:47.762920 20104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "309c3ca0ca4b4f3ba129752ea2cb293b" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
W20260709 13:06:47.776587 19526 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:47.778028 20104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f85fc4b527a48848e5faa083b604e36" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076"
I20260709 13:06:47.778791 20104 raft_consensus.cc:3060] T 1f85fc4b527a48848e5faa083b604e36 P 127766fc592545a4997f7790f50f6076 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:06:47.779167 19409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28af091831594f9d8e96482078cc7625" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
I20260709 13:06:47.779889 19409 raft_consensus.cc:3060] T 28af091831594f9d8e96482078cc7625 P e5256d91808b47c195bc9b4dbd7f2b87 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:06:47.783519 19403 raft_consensus.cc:1275] T edd7d470b5014c9489be7f41f64355c9 P e5256d91808b47c195bc9b4dbd7f2b87 [term 18 FOLLOWER]: Refusing update from remote peer e61c3a8f61bb48f8a963c9480e53c168: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 18 index: 10. (index mismatch)
I20260709 13:06:47.752189 19406 raft_consensus.cc:2955] T 309c3ca0ca4b4f3ba129752ea2cb293b P e5256d91808b47c195bc9b4dbd7f2b87 [term 11 FOLLOWER]: Committing config change with OpId 9.10: config changed from index 5 to 10, VOTER e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3) evicted. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } } }
I20260709 13:06:47.785754 19404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "309c3ca0ca4b4f3ba129752ea2cb293b" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:06:47.786077 25244 raft_consensus.cc:2804] T 3e1f505cb0f1427bbd698ac889d80821 P e61c3a8f61bb48f8a963c9480e53c168 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:06:47.766656 25237 consensus_queue.cc:260] T 86a6797bdfe94fa496c050ceae4bd0d9 P 0473d2b2d01f4459b1e90fd12cc7840e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.6, Last appended by leader: 6, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:47.770289 19485 rpcz_store.cc:276] 0709 13:06:46.763908 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:46.764044 (+   136us) service_pool.cc:224] Handling call
0709 13:06:46.764431 (+   387us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:47.179045 (+414614us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:47.769413 (+590368us) spinlock_profiling.cc:243] Waited 404 ms on lock 0x7b540035d4d4. stack: 00007f4a79de9343 00007f4a79de9240 00007f4a797781d4 00007f4a834b6304 00007f4a834b6299 00007f4a7ce71571 00007f4a7cf08e01 00007f4a7cf0783e 00007f4a81ecc419 00007f4a7b443bd4 00007f4a7b443b62 00007f4a7b443a91 00007f4a7b443a0c 00007f4a7b442cc2 00007f4a7b24348c 00007f4a7b2428c6
0709 13:06:47.769731 (+   318us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":930037632}
I20260709 13:06:47.791426 19558 raft_consensus.cc:2468] T 1a61655d99124a29b486ba4a5b37faea P e61c3a8f61bb48f8a963c9480e53c168 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 14.
I20260709 13:06:47.792691 19408 raft_consensus.cc:1275] T 14efcc79969f41babe5529c22d59156d P e5256d91808b47c195bc9b4dbd7f2b87 [term 17 FOLLOWER]: Refusing update from remote peer 127766fc592545a4997f7790f50f6076: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 13:06:47.774520 19375 leader_election.cc:304] T ff75a1d4cb1f493db8f71ddc136ba9ab P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:06:47.797936 19526 leader_election.cc:304] T df751f992649444090e27965eb1af85d P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:06:47.788925 25244 raft_consensus.cc:697] T 3e1f505cb0f1427bbd698ac889d80821 P e61c3a8f61bb48f8a963c9480e53c168 [term 19 LEADER]: Becoming Leader. State: Replica: e61c3a8f61bb48f8a963c9480e53c168, State: Running, Role: LEADER
I20260709 13:06:47.800990 19480 raft_consensus.cc:1240] T 2725d2c4cb054f18b0fc8f735c15f6c2 P 0473d2b2d01f4459b1e90fd12cc7840e [term 18 FOLLOWER]: Rejecting Update request from peer e61c3a8f61bb48f8a963c9480e53c168 for earlier term 17. Current term is 18. Ops: []
I20260709 13:06:47.802184 20103 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46436 (request call id 895) took 1289 ms. Trace:
I20260709 13:06:47.801858 25244 consensus_queue.cc:237] T 3e1f505cb0f1427bbd698ac889d80821 P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.11, Last appended by leader: 11, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:47.794633 19551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4509b76741dc428e9201c70c1658da13" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
W20260709 13:06:47.803457 19377 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.2:46257, user_credentials={real_user=slave}} blocked reactor thread for 177426us
I20260709 13:06:47.802533 20103 rpcz_store.cc:276] 0709 13:06:46.512326 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:46.512449 (+   123us) service_pool.cc:224] Handling call
0709 13:06:46.512734 (+   285us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:47.544412 (+1031678us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:47.800290 (+255878us) spinlock_profiling.cc:243] Waited 973 ms on lock 0x7b540064fad4. stack: 00007f4a79de9343 00007f4a79de9240 00007f4a797781d4 00007f4a834b6304 00007f4a834b6299 00007f4a7ce71571 00007f4a7cf08e01 00007f4a7cf0783e 00007f4a81ecc419 00007f4a7b443bd4 00007f4a7b443b62 00007f4a7b443a91 00007f4a7b443a0c 00007f4a7b442cc2 00007f4a7b24348c 00007f4a7b2428c6
0709 13:06:47.802105 (+  1815us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2238897920}
I20260709 13:06:47.810401 19552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f93ee515a9c14139bf566522ed8232f3" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 19 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:06:47.811059 19560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7be9efa6559648dbb5a0f7684c4542d1" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:06:47.811491 25221 consensus_queue.cc:1048] T 14efcc79969f41babe5529c22d59156d P 127766fc592545a4997f7790f50f6076 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:06:47.812461 24824 raft_consensus.cc:2804] T ff75a1d4cb1f493db8f71ddc136ba9ab P e5256d91808b47c195bc9b4dbd7f2b87 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:06:47.813077 24824 raft_consensus.cc:697] T ff75a1d4cb1f493db8f71ddc136ba9ab P e5256d91808b47c195bc9b4dbd7f2b87 [term 17 LEADER]: Becoming Leader. State: Replica: e5256d91808b47c195bc9b4dbd7f2b87, State: Running, Role: LEADER
I20260709 13:06:47.813352 19553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edd7d470b5014c9489be7f41f64355c9" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 19 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:06:47.814016 19554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "179fd671030940b4b4a4e24bcc4aba0a" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:06:47.814291 24824 consensus_queue.cc:237] T ff75a1d4cb1f493db8f71ddc136ba9ab P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.8, Last appended by leader: 8, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:47.814956 19555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab43d85f64114d4ebf618930e43d9ed0" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
W20260709 13:06:47.815266 25296 log.cc:927] Time spent T f93ee515a9c14139bf566522ed8232f3 P 0473d2b2d01f4459b1e90fd12cc7840e: Append to log took a long time: real 0.053s	user 0.000s	sys 0.001s
I20260709 13:06:47.815640 19555 raft_consensus.cc:2468] T ab43d85f64114d4ebf618930e43d9ed0 P e61c3a8f61bb48f8a963c9480e53c168 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 17.
I20260709 13:06:47.816094 19377 leader_election.cc:304] T fa8650e71aa14778b3d73721fc50d9fc P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:06:47.817818 19377 leader_election.cc:304] T 5ec1c4ce15e04c7e8c283a62179f2a64 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87; no voters: 127766fc592545a4997f7790f50f6076
I20260709 13:06:47.818631 25292 consensus_queue.cc:1059] T a08760e15aac4630a629431f56024dc8 P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 }, Status: INVALID_TERM, Last received: 19.11, Next index: 12, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:06:47.818816 25093 consensus_queue.cc:1059] T 179fd671030940b4b4a4e24bcc4aba0a P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 }, Status: INVALID_TERM, Last received: 18.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:06:47.819643 25085 raft_consensus.cc:2749] T fa8650e71aa14778b3d73721fc50d9fc P e5256d91808b47c195bc9b4dbd7f2b87 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:06:47.820125 25093 raft_consensus.cc:2804] T 5ec1c4ce15e04c7e8c283a62179f2a64 P e5256d91808b47c195bc9b4dbd7f2b87 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:06:47.820634 25089 raft_consensus.cc:3055] T 179fd671030940b4b4a4e24bcc4aba0a P e5256d91808b47c195bc9b4dbd7f2b87 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:06:47.820181 25236 raft_consensus.cc:515] T 7be9efa6559648dbb5a0f7684c4542d1 P 127766fc592545a4997f7790f50f6076 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } attrs { replace: true } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:47.821089 25089 raft_consensus.cc:740] T 179fd671030940b4b4a4e24bcc4aba0a P e5256d91808b47c195bc9b4dbd7f2b87 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: e5256d91808b47c195bc9b4dbd7f2b87, State: Running, Role: LEADER
I20260709 13:06:47.822098 25089 consensus_queue.cc:260] T 179fd671030940b4b4a4e24bcc4aba0a P e5256d91808b47c195bc9b4dbd7f2b87 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.11, Last appended by leader: 11, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:47.823660 25089 raft_consensus.cc:3060] T 179fd671030940b4b4a4e24bcc4aba0a P e5256d91808b47c195bc9b4dbd7f2b87 [term 18 FOLLOWER]: Advancing to term 19
W20260709 13:06:47.810410 25297 log.cc:927] Time spent T edd7d470b5014c9489be7f41f64355c9 P 0473d2b2d01f4459b1e90fd12cc7840e: Append to log took a long time: real 0.070s	user 0.001s	sys 0.000s
I20260709 13:06:47.826126 19559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b74109013a140ada21feeef92d6f563" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
W20260709 13:06:47.828003 19526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.2:46257, user_credentials={real_user=slave}} blocked reactor thread for 50460.3us
I20260709 13:06:47.800027 24964 raft_consensus.cc:3060] T 172b3dd13109415a955b71ac0e9d2234 P e5256d91808b47c195bc9b4dbd7f2b87 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:06:47.835350 20109 raft_consensus.cc:1240] T 7be9efa6559648dbb5a0f7684c4542d1 P 127766fc592545a4997f7790f50f6076 [term 16 FOLLOWER]: Rejecting Update request from peer e5256d91808b47c195bc9b4dbd7f2b87 for earlier term 15. Current term is 16. Ops: []
I20260709 13:06:47.836251 20104 raft_consensus.cc:2468] T 1f85fc4b527a48848e5faa083b604e36 P 127766fc592545a4997f7790f50f6076 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 15.
I20260709 13:06:47.837410 20103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65d8cb8d6ec64f459d5a47cefab10acf" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:06:47.845854 19551 raft_consensus.cc:1275] T 65d8cb8d6ec64f459d5a47cefab10acf P e61c3a8f61bb48f8a963c9480e53c168 [term 18 FOLLOWER]: Refusing update from remote peer 127766fc592545a4997f7790f50f6076: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 18 index: 11. (term mismatch)
I20260709 13:06:47.846282 19551 pending_rounds.cc:85] T 65d8cb8d6ec64f459d5a47cefab10acf P e61c3a8f61bb48f8a963c9480e53c168: Aborting all ops after (but not including) 10
I20260709 13:06:47.846527 19551 pending_rounds.cc:107] T 65d8cb8d6ec64f459d5a47cefab10acf P e61c3a8f61bb48f8a963c9480e53c168: Aborting uncommitted NO_OP operation due to leader change: 17.11
I20260709 13:06:47.846832 19551 raft_consensus.cc:2889] T 65d8cb8d6ec64f459d5a47cefab10acf P e61c3a8f61bb48f8a963c9480e53c168 [term 18 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:06:47.847283 25237 raft_consensus.cc:3060] T 86a6797bdfe94fa496c050ceae4bd0d9 P 0473d2b2d01f4459b1e90fd12cc7840e [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:06:47.847119 19554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96efeaaf1057492490e9a621f37e1a2d" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:06:47.848500 19554 raft_consensus.cc:2368] T 96efeaaf1057492490e9a621f37e1a2d P e61c3a8f61bb48f8a963c9480e53c168 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 127766fc592545a4997f7790f50f6076 for earlier term 18. Current term is 19.
I20260709 13:06:47.820987 25093 raft_consensus.cc:697] T 5ec1c4ce15e04c7e8c283a62179f2a64 P e5256d91808b47c195bc9b4dbd7f2b87 [term 11 LEADER]: Becoming Leader. State: Replica: e5256d91808b47c195bc9b4dbd7f2b87, State: Running, Role: LEADER
I20260709 13:06:47.849208 25244 raft_consensus.cc:493] T 0cdf56e38bbc453d9438d359e5a69955 P e61c3a8f61bb48f8a963c9480e53c168 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 0473d2b2d01f4459b1e90fd12cc7840e)
I20260709 13:06:47.849907 25244 raft_consensus.cc:515] T 0cdf56e38bbc453d9438d359e5a69955 P e61c3a8f61bb48f8a963c9480e53c168 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:47.848930 24700 raft_consensus.cc:3060] T 76cb037fc9064d13b59a8969d897ce8c P e61c3a8f61bb48f8a963c9480e53c168 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:06:47.852252 20107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e1085d23e8347fbbd5bce7542f4b1f4" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:06:47.853749 20110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab43d85f64114d4ebf618930e43d9ed0" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:06:47.854022 20105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "833a2f0775ed407a94b8924ce50adb63" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
W20260709 13:06:47.855495 19450 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:47.856290 19555 raft_consensus.cc:1275] T ed7fdbcb96d14d418db9ca90a792588a P e61c3a8f61bb48f8a963c9480e53c168 [term 13 FOLLOWER]: Refusing update from remote peer 127766fc592545a4997f7790f50f6076: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:06:47.857818 19403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "775c229504194560ba9589bc2199b089" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:06:47.858407 19560 raft_consensus.cc:1240] T fa731b585f684a7fb2d106c50f143b83 P e61c3a8f61bb48f8a963c9480e53c168 [term 13 FOLLOWER]: Rejecting Update request from peer 127766fc592545a4997f7790f50f6076 for earlier term 12. Current term is 13. Ops: []
I20260709 13:06:47.860543 19405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a61655d99124a29b486ba4a5b37faea" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:06:47.861035 25236 leader_election.cc:290] T 7be9efa6559648dbb5a0f7684c4542d1 P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 16 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:06:47.860859 25232 consensus_queue.cc:1048] T 14efcc79969f41babe5529c22d59156d P 127766fc592545a4997f7790f50f6076 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:06:47.862051 19407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a08760e15aac4630a629431f56024dc8" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
I20260709 13:06:47.862288 19375 leader_election.cc:304] T 22196caba61445d3bec98a0aab3c337d P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
W20260709 13:06:47.863107 19375 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.3:36891, user_credentials={real_user=slave}} blocked reactor thread for 55323.5us
I20260709 13:06:47.863610 19410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "179fd671030940b4b4a4e24bcc4aba0a" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
I20260709 13:06:47.864588 25276 raft_consensus.cc:2804] T 22196caba61445d3bec98a0aab3c337d P e5256d91808b47c195bc9b4dbd7f2b87 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:06:47.864971 25276 raft_consensus.cc:493] T 22196caba61445d3bec98a0aab3c337d P e5256d91808b47c195bc9b4dbd7f2b87 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:47.865302 25276 raft_consensus.cc:3060] T 22196caba61445d3bec98a0aab3c337d P e5256d91808b47c195bc9b4dbd7f2b87 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:06:47.866019 20103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c5eebf646ad445a9d1b1adc319d7b16" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 17 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076"
I20260709 13:06:47.866990 24972 consensus_queue.cc:1059] T 40e1e16737a842ee936002830f36882e P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 }, Status: INVALID_TERM, Last received: 17.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:06:47.867988 24972 raft_consensus.cc:3055] T 40e1e16737a842ee936002830f36882e P e5256d91808b47c195bc9b4dbd7f2b87 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:06:47.868372 24972 raft_consensus.cc:740] T 40e1e16737a842ee936002830f36882e P e5256d91808b47c195bc9b4dbd7f2b87 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: e5256d91808b47c195bc9b4dbd7f2b87, State: Running, Role: LEADER
I20260709 13:06:47.869052 19407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ec1c4ce15e04c7e8c283a62179f2a64" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:06:47.869303 24972 consensus_queue.cc:260] T 40e1e16737a842ee936002830f36882e P e5256d91808b47c195bc9b4dbd7f2b87 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 17.9, Last appended by leader: 9, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:47.870441 19405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7be9efa6559648dbb5a0f7684c4542d1" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:06:47.873339 19402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f93ee515a9c14139bf566522ed8232f3" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 19 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:06:47.863528 25223 consensus_queue.cc:1048] T ed7fdbcb96d14d418db9ca90a792588a P 127766fc592545a4997f7790f50f6076 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:06:47.872611 25244 leader_election.cc:290] T 0cdf56e38bbc453d9438d359e5a69955 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:06:47.874356 19554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a16f7501e2444fb86d4e2778e734e02" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:06:47.875790 19407 raft_consensus.cc:1275] T 76cb037fc9064d13b59a8969d897ce8c P e5256d91808b47c195bc9b4dbd7f2b87 [term 15 FOLLOWER]: Refusing update from remote peer 0473d2b2d01f4459b1e90fd12cc7840e: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 15 index: 8. (index mismatch)
I20260709 13:06:47.876492 19553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c5eebf646ad445a9d1b1adc319d7b16" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 17 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:06:47.877314 19553 raft_consensus.cc:2393] T 6c5eebf646ad445a9d1b1adc319d7b16 P e61c3a8f61bb48f8a963c9480e53c168 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 127766fc592545a4997f7790f50f6076 in current term 17: Already voted for candidate e61c3a8f61bb48f8a963c9480e53c168 in this term.
I20260709 13:06:47.872630 19559 raft_consensus.cc:2468] T 2b74109013a140ada21feeef92d6f563 P e61c3a8f61bb48f8a963c9480e53c168 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 13.
I20260709 13:06:47.878300 19405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36f6ba92b9ba46babe4ebd6c02e5fbd9" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
I20260709 13:06:47.850077 25093 consensus_queue.cc:237] T 5ec1c4ce15e04c7e8c283a62179f2a64 P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:47.874187 19402 raft_consensus.cc:2468] T f93ee515a9c14139bf566522ed8232f3 P e5256d91808b47c195bc9b4dbd7f2b87 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 18.
I20260709 13:06:47.879508 24972 raft_consensus.cc:3060] T 40e1e16737a842ee936002830f36882e P e5256d91808b47c195bc9b4dbd7f2b87 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:06:47.847208 25185 raft_consensus.cc:2804] T df751f992649444090e27965eb1af85d P e61c3a8f61bb48f8a963c9480e53c168 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:06:47.882856 25185 raft_consensus.cc:493] T df751f992649444090e27965eb1af85d P e61c3a8f61bb48f8a963c9480e53c168 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:47.883263 25185 raft_consensus.cc:3060] T df751f992649444090e27965eb1af85d P e61c3a8f61bb48f8a963c9480e53c168 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:06:47.884395 19552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9f0d59553ad444883fcf5b5909f9798" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:06:47.885514 19552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62c6c134d3d24a1ab144dd9ee6bc3f64" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:06:47.890340 19402 raft_consensus.cc:1240] T 2b74109013a140ada21feeef92d6f563 P e5256d91808b47c195bc9b4dbd7f2b87 [term 13 FOLLOWER]: Rejecting Update request from peer e61c3a8f61bb48f8a963c9480e53c168 for earlier term 12. Current term is 13. Ops: []
I20260709 13:06:47.890661 20076 leader_election.cc:400] T 96efeaaf1057492490e9a621f37e1a2d P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 18 pre-election: Vote denied by peer e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891) with higher term. Message: Invalid argument: T 96efeaaf1057492490e9a621f37e1a2d P e61c3a8f61bb48f8a963c9480e53c168 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 127766fc592545a4997f7790f50f6076 for earlier term 18. Current term is 19.
I20260709 13:06:47.890846 25285 consensus_queue.cc:1048] T 65d8cb8d6ec64f459d5a47cefab10acf P 127766fc592545a4997f7790f50f6076 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:06:47.894767 19402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65d8cb8d6ec64f459d5a47cefab10acf" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:06:47.899230 19555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7be9efa6559648dbb5a0f7684c4542d1" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:06:47.900004 19402 raft_consensus.cc:1240] T 2725d2c4cb054f18b0fc8f735c15f6c2 P e5256d91808b47c195bc9b4dbd7f2b87 [term 18 FOLLOWER]: Rejecting Update request from peer e61c3a8f61bb48f8a963c9480e53c168 for earlier term 17. Current term is 18. Ops: []
I20260709 13:06:47.900440 19555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff75a1d4cb1f493db8f71ddc136ba9ab" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:06:47.901747 20103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96efeaaf1057492490e9a621f37e1a2d" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076"
I20260709 13:06:47.902405 20103 raft_consensus.cc:3060] T 96efeaaf1057492490e9a621f37e1a2d P 127766fc592545a4997f7790f50f6076 [term 17 FOLLOWER]: Advancing to term 19
I20260709 13:06:47.905347 19526 leader_election.cc:304] T ed7fdbcb96d14d418db9ca90a792588a P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
W20260709 13:06:47.906059 19526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.2:46257, user_credentials={real_user=slave}} blocked reactor thread for 66340.8us
I20260709 13:06:47.906173 25244 raft_consensus.cc:2804] T ed7fdbcb96d14d418db9ca90a792588a P e61c3a8f61bb48f8a963c9480e53c168 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:06:47.906693 25244 raft_consensus.cc:493] T ed7fdbcb96d14d418db9ca90a792588a P e61c3a8f61bb48f8a963c9480e53c168 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:47.907148 25244 raft_consensus.cc:3060] T ed7fdbcb96d14d418db9ca90a792588a P e61c3a8f61bb48f8a963c9480e53c168 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:06:47.891359 20076 leader_election.cc:403] T 96efeaaf1057492490e9a621f37e1a2d P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 18 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:06:47.911778 19407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edd7d470b5014c9489be7f41f64355c9" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 19 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:06:47.913352 19403 raft_consensus.cc:1240] T 21e14947d70440f19044d8f75c31e1f9 P e5256d91808b47c195bc9b4dbd7f2b87 [term 16 FOLLOWER]: Rejecting Update request from peer e61c3a8f61bb48f8a963c9480e53c168 for earlier term 15. Current term is 16. Ops: []
I20260709 13:06:47.912428 19407 raft_consensus.cc:2468] T edd7d470b5014c9489be7f41f64355c9 P e5256d91808b47c195bc9b4dbd7f2b87 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 18.
I20260709 13:06:47.914228 19450 leader_election.cc:304] T 14935b3ddf914369822e4a0547aaa355 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168; no voters: 127766fc592545a4997f7790f50f6076
I20260709 13:06:47.931859 25261 raft_consensus.cc:2804] T 14935b3ddf914369822e4a0547aaa355 P 0473d2b2d01f4459b1e90fd12cc7840e [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:06:47.932332 25261 raft_consensus.cc:493] T 14935b3ddf914369822e4a0547aaa355 P 0473d2b2d01f4459b1e90fd12cc7840e [term 10 FOLLOWER]: Starting leader election (detected failure of leader 127766fc592545a4997f7790f50f6076)
I20260709 13:06:47.932735 25261 raft_consensus.cc:3060] T 14935b3ddf914369822e4a0547aaa355 P 0473d2b2d01f4459b1e90fd12cc7840e [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:06:47.934585 19525 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:47.934904 25246 consensus_queue.cc:1059] T 6c5eebf646ad445a9d1b1adc319d7b16 P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 }, Status: INVALID_TERM, Last received: 14.11, Next index: 12, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:06:47.935817 25246 raft_consensus.cc:3055] T 6c5eebf646ad445a9d1b1adc319d7b16 P 0473d2b2d01f4459b1e90fd12cc7840e [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:06:47.936196 25246 raft_consensus.cc:740] T 6c5eebf646ad445a9d1b1adc319d7b16 P 0473d2b2d01f4459b1e90fd12cc7840e [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 0473d2b2d01f4459b1e90fd12cc7840e, State: Running, Role: LEADER
I20260709 13:06:47.937243 25246 consensus_queue.cc:260] T 6c5eebf646ad445a9d1b1adc319d7b16 P 0473d2b2d01f4459b1e90fd12cc7840e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.12, Last appended by leader: 12, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:47.915548 25052 consensus_queue.cc:1059] T ece3db938bc649d4a40a51522ed5259c P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false }, Status: INVALID_TERM, Last received: 12.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:06:47.938477 19411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4509b76741dc428e9201c70c1658da13" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:06:47.939154 25052 raft_consensus.cc:3055] T ece3db938bc649d4a40a51522ed5259c P e61c3a8f61bb48f8a963c9480e53c168 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:06:47.939481 25052 raft_consensus.cc:740] T ece3db938bc649d4a40a51522ed5259c P e61c3a8f61bb48f8a963c9480e53c168 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: e61c3a8f61bb48f8a963c9480e53c168, State: Running, Role: LEADER
I20260709 13:06:47.939651 19411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46c5bfeecc314717bffe987e6844b6d0" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 22 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:06:47.940475 19411 raft_consensus.cc:2393] T 46c5bfeecc314717bffe987e6844b6d0 P e5256d91808b47c195bc9b4dbd7f2b87 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e61c3a8f61bb48f8a963c9480e53c168 in current term 22: Already voted for candidate e5256d91808b47c195bc9b4dbd7f2b87 in this term.
I20260709 13:06:47.940392 25052 consensus_queue.cc:260] T ece3db938bc649d4a40a51522ed5259c P e61c3a8f61bb48f8a963c9480e53c168 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:47.941284 19411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e5873a19244c5ebbcd38e126796ee7" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:06:47.941673 25052 raft_consensus.cc:3060] T ece3db938bc649d4a40a51522ed5259c P e61c3a8f61bb48f8a963c9480e53c168 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:06:47.942903 25246 raft_consensus.cc:3060] T 6c5eebf646ad445a9d1b1adc319d7b16 P 0473d2b2d01f4459b1e90fd12cc7840e [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:06:47.886611 19552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22196caba61445d3bec98a0aab3c337d" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:06:47.945104 19552 raft_consensus.cc:2468] T 22196caba61445d3bec98a0aab3c337d P e61c3a8f61bb48f8a963c9480e53c168 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 15.
I20260709 13:06:47.902305 19377 leader_election.cc:304] T 46c5bfeecc314717bffe987e6844b6d0 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168
W20260709 13:06:47.947605 19377 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.2:46257, user_credentials={real_user=slave}} blocked reactor thread for 45433us
I20260709 13:06:47.949347 25056 raft_consensus.cc:2749] T 46c5bfeecc314717bffe987e6844b6d0 P e5256d91808b47c195bc9b4dbd7f2b87 [term 22 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
I20260709 13:06:47.949776 19377 leader_election.cc:304] T 775c229504194560ba9589bc2199b089 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87; no voters: 127766fc592545a4997f7790f50f6076
I20260709 13:06:47.950032 25056 consensus_queue.cc:1059] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 }, Status: INVALID_TERM, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
W20260709 13:06:47.921911 19451 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:47.950965 25056 raft_consensus.cc:2804] T 775c229504194560ba9589bc2199b089 P e5256d91808b47c195bc9b4dbd7f2b87 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:06:47.951203 25090 raft_consensus.cc:3055] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P e5256d91808b47c195bc9b4dbd7f2b87 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:06:47.951373 25056 raft_consensus.cc:493] T 775c229504194560ba9589bc2199b089 P e5256d91808b47c195bc9b4dbd7f2b87 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 127766fc592545a4997f7790f50f6076)
I20260709 13:06:47.951602 25090 raft_consensus.cc:740] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P e5256d91808b47c195bc9b4dbd7f2b87 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: e5256d91808b47c195bc9b4dbd7f2b87, State: Running, Role: LEADER
I20260709 13:06:47.951822 25056 raft_consensus.cc:3060] T 775c229504194560ba9589bc2199b089 P e5256d91808b47c195bc9b4dbd7f2b87 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:06:47.952481 25090 consensus_queue.cc:260] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P e5256d91808b47c195bc9b4dbd7f2b87 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 17.14, Last appended by leader: 14, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:47.953958 25090 raft_consensus.cc:3060] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P e5256d91808b47c195bc9b4dbd7f2b87 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:06:47.956239 20105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab43d85f64114d4ebf618930e43d9ed0" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:06:47.958041 20107 raft_consensus.cc:1275] T 9962423cb4e54fcfa5de01daf68a86e7 P 127766fc592545a4997f7790f50f6076 [term 16 FOLLOWER]: Refusing update from remote peer 0473d2b2d01f4459b1e90fd12cc7840e: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 16 index: 12. (term mismatch)
I20260709 13:06:47.958405 20107 pending_rounds.cc:85] T 9962423cb4e54fcfa5de01daf68a86e7 P 127766fc592545a4997f7790f50f6076: Aborting all ops after (but not including) 11
I20260709 13:06:47.958688 20107 pending_rounds.cc:107] T 9962423cb4e54fcfa5de01daf68a86e7 P 127766fc592545a4997f7790f50f6076: Aborting uncommitted NO_OP operation due to leader change: 15.12
I20260709 13:06:47.958954 20107 raft_consensus.cc:2889] T 9962423cb4e54fcfa5de01daf68a86e7 P 127766fc592545a4997f7790f50f6076 [term 16 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:06:47.960651 19374 leader_election.cc:304] T 1f85fc4b527a48848e5faa083b604e36 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 127766fc592545a4997f7790f50f6076, e5256d91808b47c195bc9b4dbd7f2b87; no voters: 
I20260709 13:06:47.921115 19551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96efeaaf1057492490e9a621f37e1a2d" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:06:47.925952 25285 consensus_queue.cc:1048] T ed7fdbcb96d14d418db9ca90a792588a P 127766fc592545a4997f7790f50f6076 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:06:47.927966 19403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df751f992649444090e27965eb1af85d" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:06:47.928427 25221 consensus_queue.cc:1059] T fa731b585f684a7fb2d106c50f143b83 P 127766fc592545a4997f7790f50f6076 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 }, Status: INVALID_TERM, Last received: 12.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:06:47.935040 19526 leader_election.cc:304] T 46c5bfeecc314717bffe987e6844b6d0 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:06:47.942955 20104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed7fdbcb96d14d418db9ca90a792588a" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:06:47.915056 19405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e1f505cb0f1427bbd698ac889d80821" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
I20260709 13:06:47.921931 19402 raft_consensus.cc:1240] T f1b10566f45d4a7d9029858330e02d5b P e5256d91808b47c195bc9b4dbd7f2b87 [term 16 FOLLOWER]: Rejecting Update request from peer e61c3a8f61bb48f8a963c9480e53c168 for earlier term 15. Current term is 16. Ops: []
I20260709 13:06:47.962906 19551 raft_consensus.cc:2393] T 96efeaaf1057492490e9a621f37e1a2d P e61c3a8f61bb48f8a963c9480e53c168 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 0473d2b2d01f4459b1e90fd12cc7840e in current term 19: Already voted for candidate e61c3a8f61bb48f8a963c9480e53c168 in this term.
I20260709 13:06:47.975801 19554 raft_consensus.cc:2468] T 2a16f7501e2444fb86d4e2778e734e02 P e61c3a8f61bb48f8a963c9480e53c168 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 127766fc592545a4997f7790f50f6076 in term 16.
W20260709 13:06:47.978071 19524 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:47.979964 20103 raft_consensus.cc:2468] T 96efeaaf1057492490e9a621f37e1a2d P 127766fc592545a4997f7790f50f6076 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 19.
I20260709 13:06:47.963553 19403 raft_consensus.cc:2468] T df751f992649444090e27965eb1af85d P e5256d91808b47c195bc9b4dbd7f2b87 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 19.
I20260709 13:06:47.965903 19526 leader_election.cc:304] T d1e5873a19244c5ebbcd38e126796ee7 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:06:47.985142 25284 raft_consensus.cc:2804] T 1f85fc4b527a48848e5faa083b604e36 P e5256d91808b47c195bc9b4dbd7f2b87 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:06:47.965070 24702 raft_consensus.cc:2804] T 46c5bfeecc314717bffe987e6844b6d0 P e61c3a8f61bb48f8a963c9480e53c168 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:06:47.987226 19555 raft_consensus.cc:2393] T ff75a1d4cb1f493db8f71ddc136ba9ab P e61c3a8f61bb48f8a963c9480e53c168 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 0473d2b2d01f4459b1e90fd12cc7840e in current term 17: Already voted for candidate e5256d91808b47c195bc9b4dbd7f2b87 in this term.
W20260709 13:06:47.962255 25227 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.513s	user 0.006s	sys 0.014s
I20260709 13:06:48.001971 19409 raft_consensus.cc:2468] T 28af091831594f9d8e96482078cc7625 P e5256d91808b47c195bc9b4dbd7f2b87 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 17.
I20260709 13:06:48.003211 19404 raft_consensus.cc:1240] T 28af091831594f9d8e96482078cc7625 P e5256d91808b47c195bc9b4dbd7f2b87 [term 17 FOLLOWER]: Rejecting Update request from peer 0473d2b2d01f4459b1e90fd12cc7840e for earlier term 16. Current term is 17. Ops: []
I20260709 13:06:47.941952 19411 raft_consensus.cc:2468] T d1e5873a19244c5ebbcd38e126796ee7 P e5256d91808b47c195bc9b4dbd7f2b87 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 18.
I20260709 13:06:47.997628 25284 raft_consensus.cc:697] T 1f85fc4b527a48848e5faa083b604e36 P e5256d91808b47c195bc9b4dbd7f2b87 [term 15 LEADER]: Becoming Leader. State: Replica: e5256d91808b47c195bc9b4dbd7f2b87, State: Running, Role: LEADER
I20260709 13:06:47.997715 24702 raft_consensus.cc:493] T 46c5bfeecc314717bffe987e6844b6d0 P e61c3a8f61bb48f8a963c9480e53c168 [term 21 FOLLOWER]: Starting leader election (detected failure of leader 0473d2b2d01f4459b1e90fd12cc7840e)
I20260709 13:06:47.997967 20112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96efeaaf1057492490e9a621f37e1a2d" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076"
I20260709 13:06:47.999015 19403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40e1e16737a842ee936002830f36882e" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
W20260709 13:06:47.967602 25295 log.cc:927] Time spent T 65d8cb8d6ec64f459d5a47cefab10acf P 127766fc592545a4997f7790f50f6076: Append to log took a long time: real 0.218s	user 0.001s	sys 0.000s
W20260709 13:06:47.999789 19377 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:48.010529 20107 raft_consensus.cc:1275] T 70797e5783b5454ab0d0eea663e791e3 P 127766fc592545a4997f7790f50f6076 [term 18 FOLLOWER]: Refusing update from remote peer e5256d91808b47c195bc9b4dbd7f2b87: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 18 index: 13. (index mismatch)
I20260709 13:06:47.964439 25221 raft_consensus.cc:3055] T fa731b585f684a7fb2d106c50f143b83 P 127766fc592545a4997f7790f50f6076 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:06:48.015092 20104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36f6ba92b9ba46babe4ebd6c02e5fbd9" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076"
W20260709 13:06:48.012792 19526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.2:46257, user_credentials={real_user=slave}} blocked reactor thread for 47008.3us
W20260709 13:06:48.011904 19374 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:48.012061 19409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7be9efa6559648dbb5a0f7684c4542d1" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
I20260709 13:06:48.010521 24702 raft_consensus.cc:3060] T 46c5bfeecc314717bffe987e6844b6d0 P e61c3a8f61bb48f8a963c9480e53c168 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:06:48.014575 19402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22196caba61445d3bec98a0aab3c337d" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:06:48.021953 19411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "833a2f0775ed407a94b8924ce50adb63" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:06:48.023329 19450 leader_election.cc:304] T 1a61655d99124a29b486ba4a5b37faea P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:06:48.031741 19558 raft_consensus.cc:1275] T ef32ce6fdd0e40d382c79974f30295c6 P e61c3a8f61bb48f8a963c9480e53c168 [term 20 FOLLOWER]: Refusing update from remote peer 0473d2b2d01f4459b1e90fd12cc7840e: Log matching property violated. Preceding OpId in replica: term: 19 index: 11. Preceding OpId from leader: term: 20 index: 11. (term mismatch)
I20260709 13:06:48.032239 19558 pending_rounds.cc:85] T ef32ce6fdd0e40d382c79974f30295c6 P e61c3a8f61bb48f8a963c9480e53c168: Aborting all ops after (but not including) 10
I20260709 13:06:48.036731 19558 pending_rounds.cc:107] T ef32ce6fdd0e40d382c79974f30295c6 P e61c3a8f61bb48f8a963c9480e53c168: Aborting uncommitted NO_OP operation due to leader change: 19.11
I20260709 13:06:48.014499 25221 raft_consensus.cc:740] T fa731b585f684a7fb2d106c50f143b83 P 127766fc592545a4997f7790f50f6076 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 127766fc592545a4997f7790f50f6076, State: Running, Role: LEADER
I20260709 13:06:48.019546 25138 raft_consensus.cc:2804] T d1e5873a19244c5ebbcd38e126796ee7 P e61c3a8f61bb48f8a963c9480e53c168 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:06:48.043812 25237 raft_consensus.cc:2804] T 1a61655d99124a29b486ba4a5b37faea P 0473d2b2d01f4459b1e90fd12cc7840e [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:06:48.048622 25237 raft_consensus.cc:493] T 1a61655d99124a29b486ba4a5b37faea P 0473d2b2d01f4459b1e90fd12cc7840e [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:48.049074 25237 raft_consensus.cc:3060] T 1a61655d99124a29b486ba4a5b37faea P 0473d2b2d01f4459b1e90fd12cc7840e [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:06:48.049417 19523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.4:43121, user_credentials={real_user=slave}} blocked reactor thread for 105904us
I20260709 13:06:48.050215 19523 leader_election.cc:304] T 309c3ca0ca4b4f3ba129752ea2cb293b P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: e61c3a8f61bb48f8a963c9480e53c168; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, 127766fc592545a4997f7790f50f6076
I20260709 13:06:48.037187 19558 raft_consensus.cc:2889] T ef32ce6fdd0e40d382c79974f30295c6 P e61c3a8f61bb48f8a963c9480e53c168 [term 20 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:06:48.048061 19375 leader_election.cc:304] T 2b74109013a140ada21feeef92d6f563 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:06:48.030845 25298 raft_consensus.cc:493] T 9962423cb4e54fcfa5de01daf68a86e7 P 127766fc592545a4997f7790f50f6076 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:48.033538 25039 raft_consensus.cc:493] T 2a16f7501e2444fb86d4e2778e734e02 P e5256d91808b47c195bc9b4dbd7f2b87 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:48.012848 24824 consensus_queue.cc:1059] T 7be9efa6559648dbb5a0f7684c4542d1 P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false }, Status: INVALID_TERM, Last received: 15.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.030s
I20260709 13:06:48.055212 19409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b08304a0a02b42d7840c4e8ee9a6bd1a" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:06:48.050779 25224 raft_consensus.cc:2749] T 96efeaaf1057492490e9a621f37e1a2d P 127766fc592545a4997f7790f50f6076 [term 19 FOLLOWER]: Leader pre-election lost for term 18. Reason: Vote denied by peer e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891) with higher term. Message: Invalid argument: T 96efeaaf1057492490e9a621f37e1a2d P e61c3a8f61bb48f8a963c9480e53c168 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 127766fc592545a4997f7790f50f6076 for earlier term 18. Current term is 19.
I20260709 13:06:48.059803 19523 leader_election.cc:304] T 0e1085d23e8347fbbd5bce7542f4b1f4 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e61c3a8f61bb48f8a963c9480e53c168; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, 127766fc592545a4997f7790f50f6076
I20260709 13:06:48.061245 25095 raft_consensus.cc:2749] T 309c3ca0ca4b4f3ba129752ea2cb293b P e61c3a8f61bb48f8a963c9480e53c168 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:06:48.066566 19405 raft_consensus.cc:2468] T 3e1f505cb0f1427bbd698ac889d80821 P e5256d91808b47c195bc9b4dbd7f2b87 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 19.
I20260709 13:06:48.033818 25241 consensus_queue.cc:1048] T 7f575b143b844aa096b50997dad3516a P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.024s
I20260709 13:06:48.047081 25138 raft_consensus.cc:493] T d1e5873a19244c5ebbcd38e126796ee7 P e61c3a8f61bb48f8a963c9480e53c168 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:48.068421 19523 leader_election.cc:304] T ab43d85f64114d4ebf618930e43d9ed0 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e61c3a8f61bb48f8a963c9480e53c168; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, 127766fc592545a4997f7790f50f6076
I20260709 13:06:48.069988 19411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cdf56e38bbc453d9438d359e5a69955" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:06:48.062947 25185 raft_consensus.cc:515] T df751f992649444090e27965eb1af85d P e61c3a8f61bb48f8a963c9480e53c168 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:48.071837 19450 leader_election.cc:304] T 7be9efa6559648dbb5a0f7684c4542d1 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e; no voters: 127766fc592545a4997f7790f50f6076, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:06:48.072382 25284 consensus_queue.cc:237] T 1f85fc4b527a48848e5faa083b604e36 P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:48.073626 25221 consensus_queue.cc:260] T fa731b585f684a7fb2d106c50f143b83 P 127766fc592545a4997f7790f50f6076 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:48.075464 19449 leader_election.cc:304] T 775c229504194560ba9589bc2199b089 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e; no voters: 127766fc592545a4997f7790f50f6076, e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:06:48.059633 25298 raft_consensus.cc:515] T 9962423cb4e54fcfa5de01daf68a86e7 P 127766fc592545a4997f7790f50f6076 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:48.079037 25261 raft_consensus.cc:515] T 14935b3ddf914369822e4a0547aaa355 P 0473d2b2d01f4459b1e90fd12cc7840e [term 11 FOLLOWER]: Starting leader election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:48.082314 25225 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.ChangeConfig from 127.0.0.1:40508 (request call id 1) took 9853 ms. Trace:
I20260709 13:06:48.090783 19526 leader_election.cc:304] T 28af091831594f9d8e96482078cc7625 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:06:48.091336 25086 raft_consensus.cc:2749] T 0e1085d23e8347fbbd5bce7542f4b1f4 P e61c3a8f61bb48f8a963c9480e53c168 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:06:48.107232 19410 raft_consensus.cc:2468] T 179fd671030940b4b4a4e24bcc4aba0a P e5256d91808b47c195bc9b4dbd7f2b87 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 19.
W20260709 13:06:48.121055 19450 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.3:36891, user_credentials={real_user=slave}} blocked reactor thread for 61771.2us
I20260709 13:06:48.114081 24700 raft_consensus.cc:493] T ef32ce6fdd0e40d382c79974f30295c6 P e61c3a8f61bb48f8a963c9480e53c168 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:48.115690 25095 raft_consensus.cc:2749] T ab43d85f64114d4ebf618930e43d9ed0 P e61c3a8f61bb48f8a963c9480e53c168 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:06:48.118959 25089 raft_consensus.cc:2804] T 2b74109013a140ada21feeef92d6f563 P e5256d91808b47c195bc9b4dbd7f2b87 [term 13 FOLLOWER]: Leader pre-election won for term 14
W20260709 13:06:48.131760 19526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.2:46257, user_credentials={real_user=slave}} blocked reactor thread for 89823.2us
I20260709 13:06:48.128001 25097 raft_consensus.cc:2749] T 775c229504194560ba9589bc2199b089 P 0473d2b2d01f4459b1e90fd12cc7840e [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:06:48.134021 19557 raft_consensus.cc:1275] T 76cb037fc9064d13b59a8969d897ce8c P e61c3a8f61bb48f8a963c9480e53c168 [term 15 FOLLOWER]: Refusing update from remote peer 0473d2b2d01f4459b1e90fd12cc7840e: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 15 index: 8. (term mismatch)
I20260709 13:06:48.099776 25244 raft_consensus.cc:515] T ed7fdbcb96d14d418db9ca90a792588a P e61c3a8f61bb48f8a963c9480e53c168 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:48.105894 25138 raft_consensus.cc:3060] T d1e5873a19244c5ebbcd38e126796ee7 P e61c3a8f61bb48f8a963c9480e53c168 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:06:48.104307 25039 raft_consensus.cc:515] T 2a16f7501e2444fb86d4e2778e734e02 P e5256d91808b47c195bc9b4dbd7f2b87 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:48.125450 19405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff75a1d4cb1f493db8f71ddc136ba9ab" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
I20260709 13:06:48.140833 19557 pending_rounds.cc:85] T 76cb037fc9064d13b59a8969d897ce8c P e61c3a8f61bb48f8a963c9480e53c168: Aborting all ops after (but not including) 7
I20260709 13:06:48.153625 19557 pending_rounds.cc:107] T 76cb037fc9064d13b59a8969d897ce8c P e61c3a8f61bb48f8a963c9480e53c168: Aborting uncommitted NO_OP operation due to leader change: 14.8
I20260709 13:06:48.154002 19557 raft_consensus.cc:2889] T 76cb037fc9064d13b59a8969d897ce8c P e61c3a8f61bb48f8a963c9480e53c168 [term 15 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:06:48.125515 19409 raft_consensus.cc:2468] T b08304a0a02b42d7840c4e8ee9a6bd1a P e5256d91808b47c195bc9b4dbd7f2b87 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 16.
I20260709 13:06:48.137235 25089 raft_consensus.cc:493] T 2b74109013a140ada21feeef92d6f563 P e5256d91808b47c195bc9b4dbd7f2b87 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:06:48.171442 19449 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.1:40321, user_credentials={real_user=slave}} blocked reactor thread for 96217us
I20260709 13:06:48.171622 25188 raft_consensus.cc:2749] T 7be9efa6559648dbb5a0f7684c4542d1 P 0473d2b2d01f4459b1e90fd12cc7840e [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:06:48.173339 25244 leader_election.cc:290] T ed7fdbcb96d14d418db9ca90a792588a P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 14 election: Requested vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:06:48.136137 24700 raft_consensus.cc:515] T ef32ce6fdd0e40d382c79974f30295c6 P e61c3a8f61bb48f8a963c9480e53c168 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:48.167191 25165 raft_consensus.cc:493] T 76cb037fc9064d13b59a8969d897ce8c P e61c3a8f61bb48f8a963c9480e53c168 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:06:48.193234 19526 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:48.195672 25188 raft_consensus.cc:493] T 2725d2c4cb054f18b0fc8f735c15f6c2 P 0473d2b2d01f4459b1e90fd12cc7840e [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:48.196349 25188 raft_consensus.cc:515] T 2725d2c4cb054f18b0fc8f735c15f6c2 P 0473d2b2d01f4459b1e90fd12cc7840e [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:48.188326 25089 raft_consensus.cc:3060] T 2b74109013a140ada21feeef92d6f563 P e5256d91808b47c195bc9b4dbd7f2b87 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:06:48.203328 19405 raft_consensus.cc:1275] T 9962423cb4e54fcfa5de01daf68a86e7 P e5256d91808b47c195bc9b4dbd7f2b87 [term 16 FOLLOWER]: Refusing update from remote peer 0473d2b2d01f4459b1e90fd12cc7840e: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 13:06:48.209043 25276 raft_consensus.cc:515] T 22196caba61445d3bec98a0aab3c337d P e5256d91808b47c195bc9b4dbd7f2b87 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:48.210625 25185 leader_election.cc:290] T df751f992649444090e27965eb1af85d P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 20 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:06:48.211032 25089 raft_consensus.cc:515] T 2b74109013a140ada21feeef92d6f563 P e5256d91808b47c195bc9b4dbd7f2b87 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:48.211750 25276 leader_election.cc:290] T 22196caba61445d3bec98a0aab3c337d P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 16 election: Requested vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:06:48.211987 25298 leader_election.cc:290] T 9962423cb4e54fcfa5de01daf68a86e7 P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:06:48.212988 25089 leader_election.cc:290] T 2b74109013a140ada21feeef92d6f563 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 14 election: Requested vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:06:48.212559 25165 raft_consensus.cc:515] T 76cb037fc9064d13b59a8969d897ce8c P e61c3a8f61bb48f8a963c9480e53c168 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:48.217504 25165 leader_election.cc:290] T 76cb037fc9064d13b59a8969d897ce8c P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:06:48.223658 19402 raft_consensus.cc:2393] T 22196caba61445d3bec98a0aab3c337d P e5256d91808b47c195bc9b4dbd7f2b87 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0473d2b2d01f4459b1e90fd12cc7840e in current term 16: Already voted for candidate e5256d91808b47c195bc9b4dbd7f2b87 in this term.
I20260709 13:06:48.236544 25237 raft_consensus.cc:515] T 1a61655d99124a29b486ba4a5b37faea P 0473d2b2d01f4459b1e90fd12cc7840e [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:48.237843 19409 raft_consensus.cc:1275] T ef32ce6fdd0e40d382c79974f30295c6 P e5256d91808b47c195bc9b4dbd7f2b87 [term 20 FOLLOWER]: Refusing update from remote peer 0473d2b2d01f4459b1e90fd12cc7840e: Log matching property violated. Preceding OpId in replica: term: 18 index: 10. Preceding OpId from leader: term: 20 index: 11. (index mismatch)
I20260709 13:06:48.242396 25237 leader_election.cc:290] T 1a61655d99124a29b486ba4a5b37faea P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 15 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:06:48.248592 24700 leader_election.cc:290] T ef32ce6fdd0e40d382c79974f30295c6 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:06:48.250272 25261 leader_election.cc:290] T 14935b3ddf914369822e4a0547aaa355 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 11 election: Requested vote from peers e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:06:48.175499 25086 raft_consensus.cc:2804] T 28af091831594f9d8e96482078cc7625 P e61c3a8f61bb48f8a963c9480e53c168 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:06:48.255466 25086 raft_consensus.cc:697] T 28af091831594f9d8e96482078cc7625 P e61c3a8f61bb48f8a963c9480e53c168 [term 17 LEADER]: Becoming Leader. State: Replica: e61c3a8f61bb48f8a963c9480e53c168, State: Running, Role: LEADER
I20260709 13:06:48.256470 25086 consensus_queue.cc:237] T 28af091831594f9d8e96482078cc7625 P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.9, Last appended by leader: 9, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
W20260709 13:06:48.258002 19524 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:48.283262 20076 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:48.305991 19403 raft_consensus.cc:2468] T 40e1e16737a842ee936002830f36882e P e5256d91808b47c195bc9b4dbd7f2b87 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 18.
I20260709 13:06:48.119982 25225 rpcz_store.cc:276] 0709 13:06:38.166816 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:38.167017 (+   201us) service_pool.cc:224] Handling call
0709 13:06:38.764202 (+597185us) spinlock_profiling.cc:243] Waited 1.68 ms on lock 0x7b58003557d0. stack: 00007f4a79de9343 00007f4a79de9240 00007f4a797781d4 00007f4a834b6304 00007f4a834b6299 00007f4a7ce71571 00007f4a7ce640aa 00007f4a7cee6447 00007f4a7cf0370a 00007f4a7cf0476a 00007f4a7cf0391b 00007f4a7cf0f03c 00007f4a7cf0e6b3 00007f4a7cf069fa 00007f4a81ece4c9 00007f4a7b44ac54
0709 13:06:38.907895 (+143693us) log.cc:844] Serialized 494 byte log entry
0709 13:06:39.452925 (+545030us) spinlock_profiling.cc:243] Waited 46.1 ms on lock 0x7b2c000d0cb8. stack: 00007f4a79de9343 00007f4a79de9240 00007f4a797781d4 00007f4a834b6304 00007f4a834b6299 00007f4a7b801a11 00007f4a7b810a0a 00007f4a7b810693 00007f4a7b810631 00007f4a7cf44b52 00007f4a7cf44cf5 00007f4a7ce81691 00007f4a7ce61eaa 00007f4a7ce68d53 00007f4a7ce68cd9 00007f4a7ce68c69
0709 13:06:39.967542 (+514617us) spinlock_profiling.cc:243] Waited 26.3 ms on lock 0x7b5400740a20. stack: 00007f4a79de9343 00007f4a79de9240 00007f4a797781d4 00007f4a834b6304 00007f4a834b6299 00007f4a7ce71571 00007f4a7ce7ddbe 00007f4a7ce88930 00007f4a7ce888d8 00007f4a7ce88858 00007f4a7ce88813 00007f4a7ce87a9c 00007f4a82d73626 00007f4a82d6ddd8 00007f4a7cec47cb 00007f4a7cec72c0
0709 13:06:48.014364 (+8046822us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":10112,"raft.queue_time_us":47890,"raft.run_cpu_time_us":2012,"raft.run_wall_time_us":142735,"spinlock_wait_cycles":170331520,"thread_start_us":300054,"threads_started":1,"wal-append.queue_time_us":571045,"wal-append.run_cpu_time_us":9884,"wal-append.run_wall_time_us":1459827}
I20260709 13:06:48.333249 25246 raft_consensus.cc:493] T b9f0d59553ad444883fcf5b5909f9798 P 0473d2b2d01f4459b1e90fd12cc7840e [term 14 FOLLOWER]: Starting pre-election (detected failure of leader e61c3a8f61bb48f8a963c9480e53c168)
I20260709 13:06:48.333948 25246 raft_consensus.cc:515] T b9f0d59553ad444883fcf5b5909f9798 P 0473d2b2d01f4459b1e90fd12cc7840e [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:48.295388 25188 leader_election.cc:290] T 2725d2c4cb054f18b0fc8f735c15f6c2 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:06:48.336615 25246 leader_election.cc:290] T b9f0d59553ad444883fcf5b5909f9798 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:06:48.226748 25056 raft_consensus.cc:515] T 775c229504194560ba9589bc2199b089 P e5256d91808b47c195bc9b4dbd7f2b87 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:48.340133 25056 leader_election.cc:290] T 775c229504194560ba9589bc2199b089 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 12 election: Requested vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:06:48.341018 19407 raft_consensus.cc:1240] T 775c229504194560ba9589bc2199b089 P e5256d91808b47c195bc9b4dbd7f2b87 [term 12 FOLLOWER]: Rejecting Update request from peer 127766fc592545a4997f7790f50f6076 for earlier term 11. Current term is 12. Ops: []
I20260709 13:06:48.341259 24700 raft_consensus.cc:493] T 86a6797bdfe94fa496c050ceae4bd0d9 P e61c3a8f61bb48f8a963c9480e53c168 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:48.341792 24700 raft_consensus.cc:515] T 86a6797bdfe94fa496c050ceae4bd0d9 P e61c3a8f61bb48f8a963c9480e53c168 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:48.344419 24700 leader_election.cc:290] T 86a6797bdfe94fa496c050ceae4bd0d9 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:06:48.346985 25085 raft_consensus.cc:3055] T a08760e15aac4630a629431f56024dc8 P e5256d91808b47c195bc9b4dbd7f2b87 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:06:48.347496 25085 raft_consensus.cc:740] T a08760e15aac4630a629431f56024dc8 P e5256d91808b47c195bc9b4dbd7f2b87 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: e5256d91808b47c195bc9b4dbd7f2b87, State: Running, Role: LEADER
I20260709 13:06:48.348656 25085 consensus_queue.cc:260] T a08760e15aac4630a629431f56024dc8 P e5256d91808b47c195bc9b4dbd7f2b87 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 19.11, Last appended by leader: 11, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:48.366695 25039 leader_election.cc:290] T 2a16f7501e2444fb86d4e2778e734e02 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:06:48.368729 25039 raft_consensus.cc:493] T 86a6797bdfe94fa496c050ceae4bd0d9 P e5256d91808b47c195bc9b4dbd7f2b87 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 0473d2b2d01f4459b1e90fd12cc7840e)
I20260709 13:06:48.369889 19293 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 309c3ca0ca4b4f3ba129752ea2cb293b with cas_config_opid_index 5: ChangeConfig:REMOVE_PEER succeeded (attempt 13)
I20260709 13:06:48.380167 19407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9962423cb4e54fcfa5de01daf68a86e7" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 17 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
W20260709 13:06:48.397857 19451 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:48.400249 25039 raft_consensus.cc:515] T 86a6797bdfe94fa496c050ceae4bd0d9 P e5256d91808b47c195bc9b4dbd7f2b87 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:48.394994 19407 raft_consensus.cc:2468] T 9962423cb4e54fcfa5de01daf68a86e7 P e5256d91808b47c195bc9b4dbd7f2b87 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 127766fc592545a4997f7790f50f6076 in term 16.
I20260709 13:06:48.408460 25236 raft_consensus.cc:493] T ece3db938bc649d4a40a51522ed5259c P 127766fc592545a4997f7790f50f6076 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:48.409121 25236 raft_consensus.cc:515] T ece3db938bc649d4a40a51522ed5259c P 127766fc592545a4997f7790f50f6076 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:48.402999 24702 raft_consensus.cc:515] T 46c5bfeecc314717bffe987e6844b6d0 P e61c3a8f61bb48f8a963c9480e53c168 [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:48.412111 25236 leader_election.cc:290] T ece3db938bc649d4a40a51522ed5259c P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:06:48.413182 24702 leader_election.cc:290] T 46c5bfeecc314717bffe987e6844b6d0 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 22 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:06:48.373857 25085 raft_consensus.cc:3060] T a08760e15aac4630a629431f56024dc8 P e5256d91808b47c195bc9b4dbd7f2b87 [term 19 FOLLOWER]: Advancing to term 20
W20260709 13:06:48.417446 19524 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:48.402511 25039 leader_election.cc:290] T 86a6797bdfe94fa496c050ceae4bd0d9 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:06:48.431281 25221 raft_consensus.cc:3060] T fa731b585f684a7fb2d106c50f143b83 P 127766fc592545a4997f7790f50f6076 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:06:48.445369 20103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "775c229504194560ba9589bc2199b089" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076"
I20260709 13:06:48.449630 20107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a16f7501e2444fb86d4e2778e734e02" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 17 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:06:48.448189 25039 consensus_queue.cc:1048] T 70797e5783b5454ab0d0eea663e791e3 P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Connected to new peer: Peer: permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.008s
I20260709 13:06:48.456398 20107 raft_consensus.cc:2410] T 2a16f7501e2444fb86d4e2778e734e02 P 127766fc592545a4997f7790f50f6076 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e5256d91808b47c195bc9b4dbd7f2b87 for term 17 because replica has last-logged OpId of term: 15 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 11.
I20260709 13:06:48.452353 20075 leader_election.cc:304] T 9962423cb4e54fcfa5de01daf68a86e7 P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 127766fc592545a4997f7790f50f6076, e5256d91808b47c195bc9b4dbd7f2b87; no voters: 
W20260709 13:06:48.461846 19523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.4:43121, user_credentials={real_user=slave}} blocked reactor thread for 393483us
I20260709 13:06:48.465850 19523 leader_election.cc:304] T 6c5eebf646ad445a9d1b1adc319d7b16 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e61c3a8f61bb48f8a963c9480e53c168; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, 127766fc592545a4997f7790f50f6076
W20260709 13:06:48.466992 19375 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.3:36891, user_credentials={real_user=slave}} blocked reactor thread for 421874us
I20260709 13:06:48.482707 25223 raft_consensus.cc:2804] T 9962423cb4e54fcfa5de01daf68a86e7 P 127766fc592545a4997f7790f50f6076 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:06:48.485008 25223 raft_consensus.cc:493] T 9962423cb4e54fcfa5de01daf68a86e7 P 127766fc592545a4997f7790f50f6076 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:48.485455 25223 raft_consensus.cc:3060] T 9962423cb4e54fcfa5de01daf68a86e7 P 127766fc592545a4997f7790f50f6076 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:06:48.449318 25298 consensus_queue.cc:1059] T 775c229504194560ba9589bc2199b089 P 127766fc592545a4997f7790f50f6076 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.018s
I20260709 13:06:48.466815 25246 raft_consensus.cc:493] T e381f1d6b8184797ad142de49be225a8 P 0473d2b2d01f4459b1e90fd12cc7840e [term 14 FOLLOWER]: Starting pre-election (detected failure of leader e5256d91808b47c195bc9b4dbd7f2b87)
I20260709 13:06:48.498122 25246 raft_consensus.cc:515] T e381f1d6b8184797ad142de49be225a8 P 0473d2b2d01f4459b1e90fd12cc7840e [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:48.509902 19403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ece3db938bc649d4a40a51522ed5259c" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:06:48.512419 19555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22196caba61445d3bec98a0aab3c337d" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:06:48.513226 19555 raft_consensus.cc:3060] T 22196caba61445d3bec98a0aab3c337d P e61c3a8f61bb48f8a963c9480e53c168 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:06:48.494356 24702 raft_consensus.cc:2749] T 6c5eebf646ad445a9d1b1adc319d7b16 P e61c3a8f61bb48f8a963c9480e53c168 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:06:48.466746 25241 raft_consensus.cc:493] T 85c494af21f9457a85da47b9bc70c1fd P e61c3a8f61bb48f8a963c9480e53c168 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader e5256d91808b47c195bc9b4dbd7f2b87)
I20260709 13:06:48.525947 25138 raft_consensus.cc:515] T d1e5873a19244c5ebbcd38e126796ee7 P e61c3a8f61bb48f8a963c9480e53c168 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:48.531613 19403 raft_consensus.cc:2468] T ece3db938bc649d4a40a51522ed5259c P e5256d91808b47c195bc9b4dbd7f2b87 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 127766fc592545a4997f7790f50f6076 in term 13.
I20260709 13:06:48.531873 19551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b74109013a140ada21feeef92d6f563" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:06:48.536844 19551 raft_consensus.cc:3060] T 2b74109013a140ada21feeef92d6f563 P e61c3a8f61bb48f8a963c9480e53c168 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:06:48.540659 20104 raft_consensus.cc:1240] T 7be9efa6559648dbb5a0f7684c4542d1 P 127766fc592545a4997f7790f50f6076 [term 16 FOLLOWER]: Rejecting Update request from peer e5256d91808b47c195bc9b4dbd7f2b87 for earlier term 15. Current term is 16. Ops: []
W20260709 13:06:48.542989 19523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.4:43121, user_credentials={real_user=slave}} blocked reactor thread for 77216.7us
I20260709 13:06:48.544293 19523 leader_election.cc:304] T 96efeaaf1057492490e9a621f37e1a2d P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 127766fc592545a4997f7790f50f6076, e61c3a8f61bb48f8a963c9480e53c168; no voters: 0473d2b2d01f4459b1e90fd12cc7840e
I20260709 13:06:48.545682 25183 raft_consensus.cc:2804] T 96efeaaf1057492490e9a621f37e1a2d P e61c3a8f61bb48f8a963c9480e53c168 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:06:48.545884 24700 consensus_queue.cc:1048] T f93ee515a9c14139bf566522ed8232f3 P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:06:48.546193 25183 raft_consensus.cc:697] T 96efeaaf1057492490e9a621f37e1a2d P e61c3a8f61bb48f8a963c9480e53c168 [term 19 LEADER]: Becoming Leader. State: Replica: e61c3a8f61bb48f8a963c9480e53c168, State: Running, Role: LEADER
I20260709 13:06:48.547197 19558 raft_consensus.cc:1275] T 70797e5783b5454ab0d0eea663e791e3 P e61c3a8f61bb48f8a963c9480e53c168 [term 18 FOLLOWER]: Refusing update from remote peer e5256d91808b47c195bc9b4dbd7f2b87: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 18 index: 13. (index mismatch)
I20260709 13:06:48.548038 25241 raft_consensus.cc:515] T 85c494af21f9457a85da47b9bc70c1fd P e61c3a8f61bb48f8a963c9480e53c168 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:48.549916 19554 raft_consensus.cc:1275] T 1a61655d99124a29b486ba4a5b37faea P e61c3a8f61bb48f8a963c9480e53c168 [term 14 FOLLOWER]: Refusing update from remote peer e5256d91808b47c195bc9b4dbd7f2b87: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 13:06:48.550184 25241 leader_election.cc:290] T 85c494af21f9457a85da47b9bc70c1fd P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:06:48.527103 24825 raft_consensus.cc:493] T 7f575b143b844aa096b50997dad3516a P e5256d91808b47c195bc9b4dbd7f2b87 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:48.516934 24972 raft_consensus.cc:493] T ab43d85f64114d4ebf618930e43d9ed0 P e5256d91808b47c195bc9b4dbd7f2b87 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:48.551342 24825 raft_consensus.cc:515] T 7f575b143b844aa096b50997dad3516a P e5256d91808b47c195bc9b4dbd7f2b87 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:48.551630 24972 raft_consensus.cc:515] T ab43d85f64114d4ebf618930e43d9ed0 P e5256d91808b47c195bc9b4dbd7f2b87 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } attrs { replace: true } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:48.552414 25100 raft_consensus.cc:3055] T 7be9efa6559648dbb5a0f7684c4542d1 P e5256d91808b47c195bc9b4dbd7f2b87 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:06:48.552825 25100 raft_consensus.cc:740] T 7be9efa6559648dbb5a0f7684c4542d1 P e5256d91808b47c195bc9b4dbd7f2b87 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: e5256d91808b47c195bc9b4dbd7f2b87, State: Running, Role: LEADER
I20260709 13:06:48.553480 24825 leader_election.cc:290] T 7f575b143b844aa096b50997dad3516a P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:06:48.553753 25100 consensus_queue.cc:260] T 7be9efa6559648dbb5a0f7684c4542d1 P e5256d91808b47c195bc9b4dbd7f2b87 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } attrs { replace: true } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:48.555809 25183 consensus_queue.cc:237] T 96efeaaf1057492490e9a621f37e1a2d P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 17.12, Last appended by leader: 12, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:48.575237 19556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a16f7501e2444fb86d4e2778e734e02" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 17 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:06:48.576061 19556 raft_consensus.cc:2410] T 2a16f7501e2444fb86d4e2778e734e02 P e61c3a8f61bb48f8a963c9480e53c168 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e5256d91808b47c195bc9b4dbd7f2b87 for term 17 because replica has last-logged OpId of term: 15 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 11.
I20260709 13:06:48.556367 19558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86a6797bdfe94fa496c050ceae4bd0d9" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
W20260709 13:06:48.577140 19526 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:48.577447 19558 raft_consensus.cc:2393] T 86a6797bdfe94fa496c050ceae4bd0d9 P e61c3a8f61bb48f8a963c9480e53c168 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e5256d91808b47c195bc9b4dbd7f2b87 in current term 13: Already voted for candidate e61c3a8f61bb48f8a963c9480e53c168 in this term.
I20260709 13:06:48.560057 25246 leader_election.cc:290] T e381f1d6b8184797ad142de49be225a8 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:06:48.567086 19555 raft_consensus.cc:2468] T 22196caba61445d3bec98a0aab3c337d P e61c3a8f61bb48f8a963c9480e53c168 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 16.
I20260709 13:06:48.573642 19305 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:44676 (request call id 224) took 8029 ms. Trace:
I20260709 13:06:48.546404 19523 leader_election.cc:304] T fa731b585f684a7fb2d106c50f143b83 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e61c3a8f61bb48f8a963c9480e53c168; no voters: 127766fc592545a4997f7790f50f6076, e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:06:48.582427 19551 raft_consensus.cc:2468] T 2b74109013a140ada21feeef92d6f563 P e61c3a8f61bb48f8a963c9480e53c168 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 14.
W20260709 13:06:48.585779 19374 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:48.587678 19375 leader_election.cc:304] T 2a16f7501e2444fb86d4e2778e734e02 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87; no voters: 127766fc592545a4997f7790f50f6076, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:06:48.589650 20104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab43d85f64114d4ebf618930e43d9ed0" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 18 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:06:48.586476 24964 consensus_queue.cc:1048] T 70797e5783b5454ab0d0eea663e791e3 P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.006s
I20260709 13:06:48.597870 19375 leader_election.cc:304] T 22196caba61445d3bec98a0aab3c337d P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:06:48.602211 19375 leader_election.cc:304] T 2b74109013a140ada21feeef92d6f563 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
W20260709 13:06:48.594839 19406 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.546s	user 0.005s	sys 0.036s
W20260709 13:06:48.603101 19406 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.555s	user 0.005s	sys 0.036s
I20260709 13:06:48.603411 25090 raft_consensus.cc:2804] T 2b74109013a140ada21feeef92d6f563 P e5256d91808b47c195bc9b4dbd7f2b87 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:06:48.594621 24964 consensus_queue.cc:1243] T 70797e5783b5454ab0d0eea663e791e3 P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Peer e61c3a8f61bb48f8a963c9480e53c168 log is divergent from this leader: its last log entry 15.12 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 11
I20260709 13:06:48.604214 25090 raft_consensus.cc:697] T 2b74109013a140ada21feeef92d6f563 P e5256d91808b47c195bc9b4dbd7f2b87 [term 14 LEADER]: Becoming Leader. State: Replica: e5256d91808b47c195bc9b4dbd7f2b87, State: Running, Role: LEADER
I20260709 13:06:48.605641 25085 raft_consensus.cc:2749] T 2a16f7501e2444fb86d4e2778e734e02 P e5256d91808b47c195bc9b4dbd7f2b87 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:06:48.605446 25090 consensus_queue.cc:237] T 2b74109013a140ada21feeef92d6f563 P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:48.603344 25093 raft_consensus.cc:2804] T 22196caba61445d3bec98a0aab3c337d P e5256d91808b47c195bc9b4dbd7f2b87 [term 16 FOLLOWER]: Leader election won for term 16
W20260709 13:06:48.609157 19523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.1:40321, user_credentials={real_user=slave}} blocked reactor thread for 62818.2us
I20260709 13:06:48.589036 24702 raft_consensus.cc:2749] T fa731b585f684a7fb2d106c50f143b83 P e61c3a8f61bb48f8a963c9480e53c168 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:06:48.615899 19556 pending_rounds.cc:85] T 70797e5783b5454ab0d0eea663e791e3 P e61c3a8f61bb48f8a963c9480e53c168: Aborting all ops after (but not including) 11
I20260709 13:06:48.616282 19556 pending_rounds.cc:107] T 70797e5783b5454ab0d0eea663e791e3 P e61c3a8f61bb48f8a963c9480e53c168: Aborting uncommitted NO_OP operation due to leader change: 15.12
I20260709 13:06:48.616568 19556 raft_consensus.cc:2889] T 70797e5783b5454ab0d0eea663e791e3 P e61c3a8f61bb48f8a963c9480e53c168 [term 18 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:06:48.617708 19558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab43d85f64114d4ebf618930e43d9ed0" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 18 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:06:48.623044 19555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f575b143b844aa096b50997dad3516a" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
W20260709 13:06:48.623013 19450 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.3:36891, user_credentials={real_user=slave}} blocked reactor thread for 497600us
I20260709 13:06:48.624013 19551 raft_consensus.cc:1275] T ff75a1d4cb1f493db8f71ddc136ba9ab P e61c3a8f61bb48f8a963c9480e53c168 [term 17 FOLLOWER]: Refusing update from remote peer e5256d91808b47c195bc9b4dbd7f2b87: Log matching property violated. Preceding OpId in replica: term: 15 index: 8. Preceding OpId from leader: term: 17 index: 9. (index mismatch)
I20260709 13:06:48.587154 25276 consensus_queue.cc:1059] T 7be9efa6559648dbb5a0f7684c4542d1 P e5256d91808b47c195bc9b4dbd7f2b87 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false }, Status: INVALID_TERM, Last received: 15.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.027s
I20260709 13:06:48.590827 25056 consensus_queue.cc:1048] T 1a61655d99124a29b486ba4a5b37faea P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.021s
I20260709 13:06:48.615191 25093 raft_consensus.cc:697] T 22196caba61445d3bec98a0aab3c337d P e5256d91808b47c195bc9b4dbd7f2b87 [term 16 LEADER]: Becoming Leader. State: Replica: e5256d91808b47c195bc9b4dbd7f2b87, State: Running, Role: LEADER
I20260709 13:06:48.630123 24824 consensus_queue.cc:1048] T ff75a1d4cb1f493db8f71ddc136ba9ab P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.007s
I20260709 13:06:48.628561 25244 consensus_queue.cc:1048] T edd7d470b5014c9489be7f41f64355c9 P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.010s
W20260709 13:06:48.643463 19449 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.1:40321, user_credentials={real_user=slave}} blocked reactor thread for 448380us
I20260709 13:06:48.627892 25223 raft_consensus.cc:515] T 9962423cb4e54fcfa5de01daf68a86e7 P 127766fc592545a4997f7790f50f6076 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:48.640019 19450 leader_election.cc:304] T ab43d85f64114d4ebf618930e43d9ed0 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:06:48.674185 19375 leader_election.cc:304] T ab43d85f64114d4ebf618930e43d9ed0 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87; no voters: 127766fc592545a4997f7790f50f6076, e61c3a8f61bb48f8a963c9480e53c168
W20260709 13:06:48.677343 19523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.1:40321, user_credentials={real_user=slave}} blocked reactor thread for 51450.5us
I20260709 13:06:48.658082 25138 leader_election.cc:290] T d1e5873a19244c5ebbcd38e126796ee7 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 19 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
W20260709 13:06:48.692560 19450 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.3:36891, user_credentials={real_user=slave}} blocked reactor thread for 66170.7us
I20260709 13:06:48.695183 19523 leader_election.cc:304] T 65d8cb8d6ec64f459d5a47cefab10acf P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e61c3a8f61bb48f8a963c9480e53c168; no voters: 127766fc592545a4997f7790f50f6076, e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:06:48.701002 20075 leader_election.cc:304] T ece3db938bc649d4a40a51522ed5259c P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 127766fc592545a4997f7790f50f6076, e5256d91808b47c195bc9b4dbd7f2b87; no voters: 
I20260709 13:06:48.707978 19449 leader_election.cc:304] T a08760e15aac4630a629431f56024dc8 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e; no voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:06:48.677225 19308 catalog_manager.cc:5697] T 0cdf56e38bbc453d9438d359e5a69955 P e61c3a8f61bb48f8a963c9480e53c168 reported cstate change: term changed from 11 to 14, leader changed from e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1) to 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2). New cstate: current_term: 14 leader_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } }
I20260709 13:06:48.695806 25246 raft_consensus.cc:2804] T ab43d85f64114d4ebf618930e43d9ed0 P 0473d2b2d01f4459b1e90fd12cc7840e [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:06:48.579314 19305 rpcz_store.cc:276] 0709 13:06:40.544222 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:40.544448 (+   226us) service_pool.cc:224] Handling call
0709 13:06:48.573409 (+8028961us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:06:43.483374 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:06:43.484096 (+   722us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:06:43.484142 (+    46us) write_op.cc:435] Acquired schema lock
0709 13:06:43.484168 (+    26us) tablet.cc:662] Decoding operations
0709 13:06:43.486308 (+  2140us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:06:43.486407 (+    99us) write_op.cc:641] Partition lock acquired for write op
0709 13:06:43.486446 (+    39us) tablet.cc:685] Acquiring locks for 21 operations
0709 13:06:43.790834 (+304388us) tablet.cc:701] Row locks acquired
0709 13:06:43.790860 (+    26us) write_op.cc:260] PREPARE: finished
0709 13:06:43.791012 (+   152us) write_op.cc:270] Start()
0709 13:06:43.791131 (+   119us) write_op.cc:276] Timestamp: P: 1783602403790961 usec, L: 0
0709 13:06:43.791155 (+    24us) op_driver.cc:348] REPLICATION: starting
0709 13:06:43.791873 (+   718us) log.cc:844] Serialized 8195 byte log entry
0709 13:06:44.595493 (+803620us) op_driver.cc:464] REPLICATION: finished
0709 13:06:44.835517 (+240024us) write_op.cc:301] APPLY: starting
0709 13:06:44.835632 (+   115us) tablet.cc:1367] starting BulkCheckPresence
0709 13:06:45.145111 (+309479us) tablet.cc:1370] finished BulkCheckPresence
0709 13:06:45.145214 (+   103us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:06:45.869684 (+724470us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:06:45.980902 (+111218us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=42,key_file_lookups=42,delta_file_lookups=42,mrs_lookups=0
0709 13:06:45.991585 (+ 10683us) write_op.cc:312] APPLY: finished
0709 13:06:46.104091 (+112506us) log.cc:844] Serialized 188 byte log entry
0709 13:06:46.199013 (+ 94922us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:06:46.211804 (+ 12791us) write_op.cc:454] Released schema lock
0709 13:06:46.222855 (+ 11051us) write_op.cc:341] FINISH: Updating metrics
0709 13:06:46.232433 (+  9578us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:06:46.234248 (+  1815us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":2327,"reported_tablets":51,"child_traces":[["op",{"apply.queue_time_us":213273,"apply.run_cpu_time_us":62051,"apply.run_wall_time_us":1396922,"cfile_cache_hit":86,"cfile_cache_hit_bytes":91907,"num_ops":21,"prepare.queue_time_us":335674,"prepare.run_cpu_time_us":33246,"prepare.run_wall_time_us":573481,"raft.queue_time_us":47453,"raft.run_cpu_time_us":10432,"raft.run_wall_time_us":98212,"replication_time_us":788850,"thread_start_us":768159,"threads_started":5,"wal-append.queue_time_us":520020,"wal-append.run_cpu_time_us":14176,"wal-append.run_wall_time_us":2463719}]]}
I20260709 13:06:48.715294 25246 raft_consensus.cc:493] T ab43d85f64114d4ebf618930e43d9ed0 P 0473d2b2d01f4459b1e90fd12cc7840e [term 17 FOLLOWER]: Starting leader election (detected failure of leader 127766fc592545a4997f7790f50f6076)
I20260709 13:06:48.724082 25261 raft_consensus.cc:2749] T a08760e15aac4630a629431f56024dc8 P 0473d2b2d01f4459b1e90fd12cc7840e [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 13:06:48.725977 25227 raft_consensus.cc:2804] T ece3db938bc649d4a40a51522ed5259c P 127766fc592545a4997f7790f50f6076 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:06:48.696184 25093 consensus_queue.cc:237] T 22196caba61445d3bec98a0aab3c337d P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.9, Last appended by leader: 9, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:48.729568 25244 raft_consensus.cc:493] T 2e36a9d6e29c4a7c860cf267efbd4c74 P e61c3a8f61bb48f8a963c9480e53c168 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader e5256d91808b47c195bc9b4dbd7f2b87)
I20260709 13:06:48.731470 25241 raft_consensus.cc:493] T f1b10566f45d4a7d9029858330e02d5b P e61c3a8f61bb48f8a963c9480e53c168 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:48.734229 25246 raft_consensus.cc:3060] T ab43d85f64114d4ebf618930e43d9ed0 P 0473d2b2d01f4459b1e90fd12cc7840e [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:06:48.758930 25227 raft_consensus.cc:493] T ece3db938bc649d4a40a51522ed5259c P 127766fc592545a4997f7790f50f6076 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:48.734375 25086 consensus_queue.cc:1059] T 21e14947d70440f19044d8f75c31e1f9 P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 }, Status: INVALID_TERM, Last received: 15.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.033s
I20260709 13:06:48.766829 25309 raft_consensus.cc:2749] T ab43d85f64114d4ebf618930e43d9ed0 P e5256d91808b47c195bc9b4dbd7f2b87 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:06:48.785871 19406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9962423cb4e54fcfa5de01daf68a86e7" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 17 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
I20260709 13:06:48.786521 19406 raft_consensus.cc:3060] T 9962423cb4e54fcfa5de01daf68a86e7 P e5256d91808b47c195bc9b4dbd7f2b87 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:06:48.776472 25227 raft_consensus.cc:3060] T ece3db938bc649d4a40a51522ed5259c P 127766fc592545a4997f7790f50f6076 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:06:48.788436 25308 raft_consensus.cc:2749] T 65d8cb8d6ec64f459d5a47cefab10acf P e61c3a8f61bb48f8a963c9480e53c168 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:06:48.774361 25244 raft_consensus.cc:515] T 2e36a9d6e29c4a7c860cf267efbd4c74 P e61c3a8f61bb48f8a963c9480e53c168 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:48.791692 25086 raft_consensus.cc:3055] T 21e14947d70440f19044d8f75c31e1f9 P e61c3a8f61bb48f8a963c9480e53c168 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:06:48.792119 25086 raft_consensus.cc:740] T 21e14947d70440f19044d8f75c31e1f9 P e61c3a8f61bb48f8a963c9480e53c168 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: e61c3a8f61bb48f8a963c9480e53c168, State: Running, Role: LEADER
I20260709 13:06:48.793012 25086 consensus_queue.cc:260] T 21e14947d70440f19044d8f75c31e1f9 P e61c3a8f61bb48f8a963c9480e53c168 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:48.794286 25086 raft_consensus.cc:3060] T 21e14947d70440f19044d8f75c31e1f9 P e61c3a8f61bb48f8a963c9480e53c168 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:06:48.772267 25311 raft_consensus.cc:493] T bc225c93219c45538b53a1bd3d387e4d P 0473d2b2d01f4459b1e90fd12cc7840e [term 14 FOLLOWER]: Starting pre-election (detected failure of leader e5256d91808b47c195bc9b4dbd7f2b87)
I20260709 13:06:48.800467 25311 raft_consensus.cc:515] T bc225c93219c45538b53a1bd3d387e4d P 0473d2b2d01f4459b1e90fd12cc7840e [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:48.796984 25244 leader_election.cc:290] T 2e36a9d6e29c4a7c860cf267efbd4c74 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:06:48.804792 19449 leader_election.cc:304] T f93ee515a9c14139bf566522ed8232f3 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87; no voters: e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:06:48.816828 19449 leader_election.cc:304] T edd7d470b5014c9489be7f41f64355c9 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87; no voters: e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:06:48.817873 19308 catalog_manager.cc:5697] T 22196caba61445d3bec98a0aab3c337d P e61c3a8f61bb48f8a963c9480e53c168 reported cstate change: term changed from 9 to 10, leader changed from 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2) to e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3). New cstate: current_term: 10 leader_uuid: "e61c3a8f61bb48f8a963c9480e53c168" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } health_report { overall_health: HEALTHY } } }
W20260709 13:06:48.820574 19450 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.3:36891, user_credentials={real_user=slave}} blocked reactor thread for 91516.3us
W20260709 13:06:48.827919 19523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.1:40321, user_credentials={real_user=slave}} blocked reactor thread for 46004.7us
I20260709 13:06:48.829173 19523 leader_election.cc:304] T 833a2f0775ed407a94b8924ce50adb63 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e61c3a8f61bb48f8a963c9480e53c168; no voters: 127766fc592545a4997f7790f50f6076, e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:06:48.830353 19406 raft_consensus.cc:2468] T 9962423cb4e54fcfa5de01daf68a86e7 P e5256d91808b47c195bc9b4dbd7f2b87 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 127766fc592545a4997f7790f50f6076 in term 17.
I20260709 13:06:48.832706 25223 leader_election.cc:290] T 9962423cb4e54fcfa5de01daf68a86e7 P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 17 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:06:48.837173 20075 leader_election.cc:304] T 9962423cb4e54fcfa5de01daf68a86e7 P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 127766fc592545a4997f7790f50f6076, e5256d91808b47c195bc9b4dbd7f2b87; no voters: 
I20260709 13:06:48.806980 25311 leader_election.cc:290] T bc225c93219c45538b53a1bd3d387e4d P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:06:48.840417 25223 raft_consensus.cc:2804] T 9962423cb4e54fcfa5de01daf68a86e7 P 127766fc592545a4997f7790f50f6076 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:06:48.840952 25223 raft_consensus.cc:697] T 9962423cb4e54fcfa5de01daf68a86e7 P 127766fc592545a4997f7790f50f6076 [term 17 LEADER]: Becoming Leader. State: Replica: 127766fc592545a4997f7790f50f6076, State: Running, Role: LEADER
I20260709 13:06:48.841815 25223 consensus_queue.cc:237] T 9962423cb4e54fcfa5de01daf68a86e7 P 127766fc592545a4997f7790f50f6076 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 12, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:48.819567 25188 consensus_queue.cc:1048] T 76cb037fc9064d13b59a8969d897ce8c P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.023s
I20260709 13:06:48.844015 25188 raft_consensus.cc:2804] T f93ee515a9c14139bf566522ed8232f3 P 0473d2b2d01f4459b1e90fd12cc7840e [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:06:48.844369 25188 raft_consensus.cc:493] T f93ee515a9c14139bf566522ed8232f3 P 0473d2b2d01f4459b1e90fd12cc7840e [term 18 FOLLOWER]: Starting leader election (detected failure of leader e61c3a8f61bb48f8a963c9480e53c168)
I20260709 13:06:48.844746 25188 raft_consensus.cc:3060] T f93ee515a9c14139bf566522ed8232f3 P 0473d2b2d01f4459b1e90fd12cc7840e [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:06:48.847595 25312 raft_consensus.cc:2804] T edd7d470b5014c9489be7f41f64355c9 P 0473d2b2d01f4459b1e90fd12cc7840e [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:06:48.848136 25312 raft_consensus.cc:493] T edd7d470b5014c9489be7f41f64355c9 P 0473d2b2d01f4459b1e90fd12cc7840e [term 18 FOLLOWER]: Starting leader election (detected failure of leader e61c3a8f61bb48f8a963c9480e53c168)
I20260709 13:06:48.848549 25312 raft_consensus.cc:3060] T edd7d470b5014c9489be7f41f64355c9 P 0473d2b2d01f4459b1e90fd12cc7840e [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:06:48.851398 19523 leader_election.cc:304] T b08304a0a02b42d7840c4e8ee9a6bd1a P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168; no voters: 0473d2b2d01f4459b1e90fd12cc7840e
I20260709 13:06:48.782945 25241 raft_consensus.cc:515] T f1b10566f45d4a7d9029858330e02d5b P e61c3a8f61bb48f8a963c9480e53c168 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:48.857226 19523 leader_election.cc:304] T 40e1e16737a842ee936002830f36882e P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168; no voters: 0473d2b2d01f4459b1e90fd12cc7840e
I20260709 13:06:48.871646 20103 raft_consensus.cc:1275] T 1f85fc4b527a48848e5faa083b604e36 P 127766fc592545a4997f7790f50f6076 [term 15 FOLLOWER]: Refusing update from remote peer e5256d91808b47c195bc9b4dbd7f2b87: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
W20260709 13:06:48.873080 25316 log.cc:927] Time spent T 7be9efa6559648dbb5a0f7684c4542d1 P e61c3a8f61bb48f8a963c9480e53c168: Append to log took a long time: real 0.093s	user 0.000s	sys 0.000s
I20260709 13:06:48.873409 25090 consensus_queue.cc:1048] T 1f85fc4b527a48848e5faa083b604e36 P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Connected to new peer: Peer: permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:06:48.877632 25097 raft_consensus.cc:493] T 2b74109013a140ada21feeef92d6f563 P 0473d2b2d01f4459b1e90fd12cc7840e [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:48.878213 25097 raft_consensus.cc:515] T 2b74109013a140ada21feeef92d6f563 P 0473d2b2d01f4459b1e90fd12cc7840e [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:48.881680 25241 leader_election.cc:290] T f1b10566f45d4a7d9029858330e02d5b P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:06:48.856464 25095 raft_consensus.cc:2804] T b08304a0a02b42d7840c4e8ee9a6bd1a P e61c3a8f61bb48f8a963c9480e53c168 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:06:48.884577 25100 raft_consensus.cc:3060] T 7be9efa6559648dbb5a0f7684c4542d1 P e5256d91808b47c195bc9b4dbd7f2b87 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:06:48.884738 25095 raft_consensus.cc:493] T b08304a0a02b42d7840c4e8ee9a6bd1a P e61c3a8f61bb48f8a963c9480e53c168 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 0473d2b2d01f4459b1e90fd12cc7840e)
I20260709 13:06:48.885249 25095 raft_consensus.cc:3060] T b08304a0a02b42d7840c4e8ee9a6bd1a P e61c3a8f61bb48f8a963c9480e53c168 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:06:48.888500 25236 raft_consensus.cc:3055] T 775c229504194560ba9589bc2199b089 P 127766fc592545a4997f7790f50f6076 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:06:48.837180 24972 leader_election.cc:290] T ab43d85f64114d4ebf618930e43d9ed0 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:06:48.888912 25236 raft_consensus.cc:740] T 775c229504194560ba9589bc2199b089 P 127766fc592545a4997f7790f50f6076 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 127766fc592545a4997f7790f50f6076, State: Running, Role: LEADER
I20260709 13:06:48.838238 25310 raft_consensus.cc:2749] T 833a2f0775ed407a94b8924ce50adb63 P e61c3a8f61bb48f8a963c9480e53c168 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:06:48.901125 19451 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:48.907196 19377 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:48.907692 19377 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:48.911921 25227 raft_consensus.cc:515] T ece3db938bc649d4a40a51522ed5259c P 127766fc592545a4997f7790f50f6076 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
W20260709 13:06:48.913268 19523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.1:40321, user_credentials={real_user=slave}} blocked reactor thread for 56174.6us
I20260709 13:06:48.918092 20104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed7fdbcb96d14d418db9ca90a792588a" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076"
I20260709 13:06:48.914252 20076 leader_election.cc:304] T 62c6c134d3d24a1ab144dd9ee6bc3f64 P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 127766fc592545a4997f7790f50f6076; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168
W20260709 13:06:48.933494 19450 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.3:36891, user_credentials={real_user=slave}} blocked reactor thread for 112171us
I20260709 13:06:48.935765 20104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85c494af21f9457a85da47b9bc70c1fd" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:06:48.943364 19405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85c494af21f9457a85da47b9bc70c1fd" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:06:48.945019 19407 raft_consensus.cc:1275] T 7f575b143b844aa096b50997dad3516a P e5256d91808b47c195bc9b4dbd7f2b87 [term 13 FOLLOWER]: Refusing update from remote peer e61c3a8f61bb48f8a963c9480e53c168: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 13:06:48.890122 25236 consensus_queue.cc:260] T 775c229504194560ba9589bc2199b089 P 127766fc592545a4997f7790f50f6076 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:48.947610 19406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76cb037fc9064d13b59a8969d897ce8c" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 16 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:06:48.948649 19406 raft_consensus.cc:2468] T 76cb037fc9064d13b59a8969d897ce8c P e5256d91808b47c195bc9b4dbd7f2b87 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 15.
I20260709 13:06:48.949636 19409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86a6797bdfe94fa496c050ceae4bd0d9" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:06:48.949896 19406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e5873a19244c5ebbcd38e126796ee7" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
I20260709 13:06:48.950383 19406 raft_consensus.cc:3060] T d1e5873a19244c5ebbcd38e126796ee7 P e5256d91808b47c195bc9b4dbd7f2b87 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:06:48.950248 19409 raft_consensus.cc:2468] T 86a6797bdfe94fa496c050ceae4bd0d9 P e5256d91808b47c195bc9b4dbd7f2b87 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 12.
I20260709 13:06:48.951429 19405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e36a9d6e29c4a7c860cf267efbd4c74" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:06:48.952232 19405 raft_consensus.cc:2468] T 2e36a9d6e29c4a7c860cf267efbd4c74 P e5256d91808b47c195bc9b4dbd7f2b87 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 12.
I20260709 13:06:48.952406 19409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1b10566f45d4a7d9029858330e02d5b" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:06:48.953006 19409 raft_consensus.cc:2468] T f1b10566f45d4a7d9029858330e02d5b P e5256d91808b47c195bc9b4dbd7f2b87 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 16.
I20260709 13:06:48.917827 25241 raft_consensus.cc:2804] T 40e1e16737a842ee936002830f36882e P e61c3a8f61bb48f8a963c9480e53c168 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:06:48.946928 19404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df751f992649444090e27965eb1af85d" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
I20260709 13:06:48.959517 19406 raft_consensus.cc:2468] T d1e5873a19244c5ebbcd38e126796ee7 P e5256d91808b47c195bc9b4dbd7f2b87 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 19.
I20260709 13:06:48.971949 19404 raft_consensus.cc:3060] T df751f992649444090e27965eb1af85d P e5256d91808b47c195bc9b4dbd7f2b87 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:06:48.973351 19411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46c5bfeecc314717bffe987e6844b6d0" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 22 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
I20260709 13:06:48.975154 19523 leader_election.cc:304] T 76cb037fc9064d13b59a8969d897ce8c P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:06:48.976300 19450 leader_election.cc:304] T 22196caba61445d3bec98a0aab3c337d P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:06:48.977749 19410 raft_consensus.cc:1275] T 3e1f505cb0f1427bbd698ac889d80821 P e5256d91808b47c195bc9b4dbd7f2b87 [term 19 FOLLOWER]: Refusing update from remote peer e61c3a8f61bb48f8a963c9480e53c168: Log matching property violated. Preceding OpId in replica: term: 18 index: 11. Preceding OpId from leader: term: 19 index: 12. (index mismatch)
I20260709 13:06:48.955144 19402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef32ce6fdd0e40d382c79974f30295c6" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 21 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:06:48.980522 19523 leader_election.cc:304] T 86a6797bdfe94fa496c050ceae4bd0d9 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:06:48.980753 19411 raft_consensus.cc:2393] T 46c5bfeecc314717bffe987e6844b6d0 P e5256d91808b47c195bc9b4dbd7f2b87 [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate e61c3a8f61bb48f8a963c9480e53c168 in current term 22: Already voted for candidate e5256d91808b47c195bc9b4dbd7f2b87 in this term.
I20260709 13:06:48.981389 19523 leader_election.cc:304] T 2e36a9d6e29c4a7c860cf267efbd4c74 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:06:48.985138 20076 leader_election.cc:304] T 7be9efa6559648dbb5a0f7684c4542d1 P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 127766fc592545a4997f7790f50f6076; no voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:06:48.988297 19523 leader_election.cc:304] T f1b10566f45d4a7d9029858330e02d5b P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:06:48.950186 25232 raft_consensus.cc:2749] T 62c6c134d3d24a1ab144dd9ee6bc3f64 P 127766fc592545a4997f7790f50f6076 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:06:48.991995 19402 raft_consensus.cc:2468] T ef32ce6fdd0e40d382c79974f30295c6 P e5256d91808b47c195bc9b4dbd7f2b87 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 20.
I20260709 13:06:48.994086 19551 raft_consensus.cc:1240] T ed7fdbcb96d14d418db9ca90a792588a P e61c3a8f61bb48f8a963c9480e53c168 [term 14 FOLLOWER]: Rejecting Update request from peer 127766fc592545a4997f7790f50f6076 for earlier term 13. Current term is 14. Ops: [13.11-13.11]
I20260709 13:06:48.964284 25052 raft_consensus.cc:493] T 2725d2c4cb054f18b0fc8f735c15f6c2 P e61c3a8f61bb48f8a963c9480e53c168 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:06:49.006125 19449 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.1:40321, user_credentials={real_user=slave}} blocked reactor thread for 200153us
I20260709 13:06:49.000862 24702 raft_consensus.cc:2804] T 76cb037fc9064d13b59a8969d897ce8c P e61c3a8f61bb48f8a963c9480e53c168 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:06:48.978029 25138 raft_consensus.cc:493] T 179fd671030940b4b4a4e24bcc4aba0a P e61c3a8f61bb48f8a963c9480e53c168 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader e5256d91808b47c195bc9b4dbd7f2b87)
I20260709 13:06:49.000448 19557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ece3db938bc649d4a40a51522ed5259c" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:06:49.004781 19308 catalog_manager.cc:5697] T 96efeaaf1057492490e9a621f37e1a2d P e61c3a8f61bb48f8a963c9480e53c168 reported cstate change: term changed from 11 to 13. New cstate: current_term: 13 leader_uuid: "e61c3a8f61bb48f8a963c9480e53c168" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:06:49.012400 20076 leader_election.cc:304] T 6c5eebf646ad445a9d1b1adc319d7b16 P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 127766fc592545a4997f7790f50f6076; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:06:48.999120 25308 raft_consensus.cc:2804] T 2e36a9d6e29c4a7c860cf267efbd4c74 P e61c3a8f61bb48f8a963c9480e53c168 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:06:49.018937 19557 raft_consensus.cc:2468] T ece3db938bc649d4a40a51522ed5259c P e61c3a8f61bb48f8a963c9480e53c168 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 127766fc592545a4997f7790f50f6076 in term 13.
I20260709 13:06:48.999845 24700 raft_consensus.cc:2804] T f1b10566f45d4a7d9029858330e02d5b P e61c3a8f61bb48f8a963c9480e53c168 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:06:48.999389 25310 raft_consensus.cc:2804] T 86a6797bdfe94fa496c050ceae4bd0d9 P e61c3a8f61bb48f8a963c9480e53c168 [term 13 FOLLOWER]: Leader pre-election won for term 14
W20260709 13:06:49.036248 25331 log.cc:927] Time spent T 2b74109013a140ada21feeef92d6f563 P e5256d91808b47c195bc9b4dbd7f2b87: Append to log took a long time: real 0.137s	user 0.001s	sys 0.000s
I20260709 13:06:49.015177 25236 raft_consensus.cc:3060] T 775c229504194560ba9589bc2199b089 P 127766fc592545a4997f7790f50f6076 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:06:49.015511 25298 raft_consensus.cc:2749] T 7be9efa6559648dbb5a0f7684c4542d1 P 127766fc592545a4997f7790f50f6076 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:06:49.040395 19308 catalog_manager.cc:5697] T 28af091831594f9d8e96482078cc7625 P e61c3a8f61bb48f8a963c9480e53c168 reported cstate change: term changed from 9 to 12, leader changed from e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3) to 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2). New cstate: current_term: 12 leader_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } }
I20260709 13:06:49.016811 24702 raft_consensus.cc:493] T 76cb037fc9064d13b59a8969d897ce8c P e61c3a8f61bb48f8a963c9480e53c168 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:49.023514 24700 raft_consensus.cc:493] T f1b10566f45d4a7d9029858330e02d5b P e61c3a8f61bb48f8a963c9480e53c168 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:49.023751 25310 raft_consensus.cc:493] T 86a6797bdfe94fa496c050ceae4bd0d9 P e61c3a8f61bb48f8a963c9480e53c168 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:49.024824 25308 raft_consensus.cc:493] T 2e36a9d6e29c4a7c860cf267efbd4c74 P e61c3a8f61bb48f8a963c9480e53c168 [term 11 FOLLOWER]: Starting leader election (detected failure of leader e5256d91808b47c195bc9b4dbd7f2b87)
I20260709 13:06:49.011881 25052 raft_consensus.cc:515] T 2725d2c4cb054f18b0fc8f735c15f6c2 P e61c3a8f61bb48f8a963c9480e53c168 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
W20260709 13:06:49.055580 19450 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.3:36891, user_credentials={real_user=slave}} blocked reactor thread for 77480.6us
I20260709 13:06:49.052301 20076 leader_election.cc:304] T 2a16f7501e2444fb86d4e2778e734e02 P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 127766fc592545a4997f7790f50f6076, e61c3a8f61bb48f8a963c9480e53c168; no voters: e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:06:49.042083 25332 raft_consensus.cc:493] T fa8650e71aa14778b3d73721fc50d9fc P 0473d2b2d01f4459b1e90fd12cc7840e [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:49.061188 19410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ece3db938bc649d4a40a51522ed5259c" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
I20260709 13:06:49.052695 19449 leader_election.cc:304] T 4509b76741dc428e9201c70c1658da13 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e; no voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:06:49.062566 19410 raft_consensus.cc:3060] T ece3db938bc649d4a40a51522ed5259c P e5256d91808b47c195bc9b4dbd7f2b87 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:06:49.046064 24702 raft_consensus.cc:3060] T 76cb037fc9064d13b59a8969d897ce8c P e61c3a8f61bb48f8a963c9480e53c168 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:06:49.095502 19485 raft_consensus.cc:1240] T 14935b3ddf914369822e4a0547aaa355 P 0473d2b2d01f4459b1e90fd12cc7840e [term 11 FOLLOWER]: Rejecting Update request from peer 127766fc592545a4997f7790f50f6076 for earlier term 10. Current term is 11. Ops: []
I20260709 13:06:49.094987 19484 raft_consensus.cc:2955] T 309c3ca0ca4b4f3ba129752ea2cb293b P 0473d2b2d01f4459b1e90fd12cc7840e [term 11 FOLLOWER]: Committing config change with OpId 9.10: config changed from index 5 to 10, VOTER e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3) evicted. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } } }
I20260709 13:06:49.064347 25311 consensus_queue.cc:1048] T 76cb037fc9064d13b59a8969d897ce8c P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.038s
I20260709 13:06:49.056813 25333 consensus_queue.cc:1048] T ef32ce6fdd0e40d382c79974f30295c6 P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.053s
I20260709 13:06:49.053222 25310 raft_consensus.cc:3060] T 86a6797bdfe94fa496c050ceae4bd0d9 P e61c3a8f61bb48f8a963c9480e53c168 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:06:49.049978 19523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.1:40321, user_credentials={real_user=slave}} blocked reactor thread for 60820.5us
I20260709 13:06:49.059168 19482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7be9efa6559648dbb5a0f7684c4542d1" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
W20260709 13:06:49.067960 25330 log.cc:927] Time spent T 14efcc79969f41babe5529c22d59156d P 127766fc592545a4997f7790f50f6076: Append to log took a long time: real 0.086s	user 0.001s	sys 0.000s
I20260709 13:06:49.085672 19404 raft_consensus.cc:2468] T df751f992649444090e27965eb1af85d P e5256d91808b47c195bc9b4dbd7f2b87 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 20.
W20260709 13:06:49.142158 19449 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.1:40321, user_credentials={real_user=slave}} blocked reactor thread for 94041.9us
I20260709 13:06:49.091207 25227 leader_election.cc:290] T ece3db938bc649d4a40a51522ed5259c P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 14 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:06:49.047874 25306 raft_consensus.cc:493] T 21e14947d70440f19044d8f75c31e1f9 P e5256d91808b47c195bc9b4dbd7f2b87 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:49.048063 25232 raft_consensus.cc:3060] T 6c5eebf646ad445a9d1b1adc319d7b16 P 127766fc592545a4997f7790f50f6076 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:06:49.050546 24700 raft_consensus.cc:3060] T f1b10566f45d4a7d9029858330e02d5b P e61c3a8f61bb48f8a963c9480e53c168 [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:06:49.137235 19374 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:49.130493 19477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9962423cb4e54fcfa5de01daf68a86e7" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 17 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:06:49.059332 25241 raft_consensus.cc:697] T 40e1e16737a842ee936002830f36882e P e61c3a8f61bb48f8a963c9480e53c168 [term 18 LEADER]: Becoming Leader. State: Replica: e61c3a8f61bb48f8a963c9480e53c168, State: Running, Role: LEADER
I20260709 13:06:49.140977 25332 raft_consensus.cc:515] T fa8650e71aa14778b3d73721fc50d9fc P 0473d2b2d01f4459b1e90fd12cc7840e [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:49.045710 25138 raft_consensus.cc:515] T 179fd671030940b4b4a4e24bcc4aba0a P e61c3a8f61bb48f8a963c9480e53c168 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:49.053205 25308 raft_consensus.cc:3060] T 2e36a9d6e29c4a7c860cf267efbd4c74 P e61c3a8f61bb48f8a963c9480e53c168 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:06:49.158938 19449 leader_election.cc:304] T ff75a1d4cb1f493db8f71ddc136ba9ab P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e; no voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:06:49.059217 25329 raft_consensus.cc:2804] T 22196caba61445d3bec98a0aab3c337d P 0473d2b2d01f4459b1e90fd12cc7840e [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:06:49.060891 25097 leader_election.cc:290] T 2b74109013a140ada21feeef92d6f563 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:06:49.242412 25237 raft_consensus.cc:2749] T 4509b76741dc428e9201c70c1658da13 P 0473d2b2d01f4459b1e90fd12cc7840e [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:06:49.179919 20076 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.3:36891, user_credentials={real_user=slave}} blocked reactor thread for 127688us
I20260709 13:06:49.101034 25221 raft_consensus.cc:493] T 172b3dd13109415a955b71ac0e9d2234 P 127766fc592545a4997f7790f50f6076 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:49.261962 19410 raft_consensus.cc:2468] T ece3db938bc649d4a40a51522ed5259c P e5256d91808b47c195bc9b4dbd7f2b87 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 127766fc592545a4997f7790f50f6076 in term 14.
I20260709 13:06:49.161571 19485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9962423cb4e54fcfa5de01daf68a86e7" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 17 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:06:49.305600 19482 raft_consensus.cc:3060] T 7be9efa6559648dbb5a0f7684c4542d1 P 0473d2b2d01f4459b1e90fd12cc7840e [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:06:49.141427 25298 raft_consensus.cc:2804] T 2a16f7501e2444fb86d4e2778e734e02 P 127766fc592545a4997f7790f50f6076 [term 16 FOLLOWER]: Leader election won for term 16
W20260709 13:06:49.306552 19449 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.1:40321, user_credentials={real_user=slave}} blocked reactor thread for 147778us
I20260709 13:06:49.192462 25305 raft_consensus.cc:493] T 1dc5b3532fe54f74876d02beffa2c230 P e5256d91808b47c195bc9b4dbd7f2b87 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 0473d2b2d01f4459b1e90fd12cc7840e)
I20260709 13:06:49.252504 25246 raft_consensus.cc:515] T ab43d85f64114d4ebf618930e43d9ed0 P 0473d2b2d01f4459b1e90fd12cc7840e [term 18 FOLLOWER]: Starting leader election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:49.156713 25306 raft_consensus.cc:515] T 21e14947d70440f19044d8f75c31e1f9 P e5256d91808b47c195bc9b4dbd7f2b87 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:49.295522 25311 raft_consensus.cc:493] T 0e1085d23e8347fbbd5bce7542f4b1f4 P 0473d2b2d01f4459b1e90fd12cc7840e [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 127766fc592545a4997f7790f50f6076)
W20260709 13:06:49.311260 25336 log.cc:927] Time spent T 70797e5783b5454ab0d0eea663e791e3 P e5256d91808b47c195bc9b4dbd7f2b87: Append to log took a long time: real 0.132s	user 0.000s	sys 0.000s
I20260709 13:06:49.312891 25261 raft_consensus.cc:493] T 21e14947d70440f19044d8f75c31e1f9 P 0473d2b2d01f4459b1e90fd12cc7840e [term 15 FOLLOWER]: Starting pre-election (detected failure of leader e61c3a8f61bb48f8a963c9480e53c168)
I20260709 13:06:49.313337 25340 raft_consensus.cc:2749] T ff75a1d4cb1f493db8f71ddc136ba9ab P 0473d2b2d01f4459b1e90fd12cc7840e [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:06:49.284554 25309 raft_consensus.cc:493] T 309c3ca0ca4b4f3ba129752ea2cb293b P e5256d91808b47c195bc9b4dbd7f2b87 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 127766fc592545a4997f7790f50f6076)
I20260709 13:06:49.262509 25319 raft_consensus.cc:493] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P 127766fc592545a4997f7790f50f6076 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader e5256d91808b47c195bc9b4dbd7f2b87)
I20260709 13:06:49.141235 25312 raft_consensus.cc:515] T edd7d470b5014c9489be7f41f64355c9 P 0473d2b2d01f4459b1e90fd12cc7840e [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:49.353240 19486 raft_consensus.cc:1240] T ab43d85f64114d4ebf618930e43d9ed0 P 0473d2b2d01f4459b1e90fd12cc7840e [term 18 FOLLOWER]: Rejecting Update request from peer 127766fc592545a4997f7790f50f6076 for earlier term 17. Current term is 18. Ops: []
I20260709 13:06:49.317764 25285 raft_consensus.cc:493] T fa731b585f684a7fb2d106c50f143b83 P 127766fc592545a4997f7790f50f6076 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:49.160382 25321 consensus_queue.cc:1059] T 14935b3ddf914369822e4a0547aaa355 P 127766fc592545a4997f7790f50f6076 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.166s
I20260709 13:06:49.337167 25052 leader_election.cc:290] T 2725d2c4cb054f18b0fc8f735c15f6c2 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:06:49.243059 25188 raft_consensus.cc:515] T f93ee515a9c14139bf566522ed8232f3 P 0473d2b2d01f4459b1e90fd12cc7840e [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:49.351353 25237 consensus_queue.cc:1048] T ef32ce6fdd0e40d382c79974f30295c6 P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.008s
I20260709 13:06:49.338521 25309 raft_consensus.cc:515] T 309c3ca0ca4b4f3ba129752ea2cb293b P e5256d91808b47c195bc9b4dbd7f2b87 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:49.339236 25305 raft_consensus.cc:515] T 1dc5b3532fe54f74876d02beffa2c230 P e5256d91808b47c195bc9b4dbd7f2b87 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:49.343158 19308 catalog_manager.cc:5697] T edd7d470b5014c9489be7f41f64355c9 P e61c3a8f61bb48f8a963c9480e53c168 reported cstate change: term changed from 11 to 12, leader changed from e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3) to e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1). New cstate: current_term: 12 leader_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } }
I20260709 13:06:49.344026 25306 leader_election.cc:290] T 21e14947d70440f19044d8f75c31e1f9 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:06:49.387475 25306 raft_consensus.cc:493] T 0cdf56e38bbc453d9438d359e5a69955 P e5256d91808b47c195bc9b4dbd7f2b87 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 0473d2b2d01f4459b1e90fd12cc7840e)
I20260709 13:06:49.388015 25306 raft_consensus.cc:515] T 0cdf56e38bbc453d9438d359e5a69955 P e5256d91808b47c195bc9b4dbd7f2b87 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:49.388844 25309 leader_election.cc:290] T 309c3ca0ca4b4f3ba129752ea2cb293b P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:06:49.389907 25306 leader_election.cc:290] T 0cdf56e38bbc453d9438d359e5a69955 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:06:49.344471 25345 consensus_queue.cc:1048] T 9962423cb4e54fcfa5de01daf68a86e7 P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.025s
I20260709 13:06:49.391865 25305 leader_election.cc:290] T 1dc5b3532fe54f74876d02beffa2c230 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:06:49.346959 19449 leader_election.cc:304] T 179fd671030940b4b4a4e24bcc4aba0a P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87; no voters: e61c3a8f61bb48f8a963c9480e53c168
W20260709 13:06:49.395526 19449 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.1:40321, user_credentials={real_user=slave}} blocked reactor thread for 68574.2us
I20260709 13:06:49.397655 19449 leader_election.cc:304] T 5ec1c4ce15e04c7e8c283a62179f2a64 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, 127766fc592545a4997f7790f50f6076; no voters: e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:06:49.400517 20075 leader_election.cc:304] T ece3db938bc649d4a40a51522ed5259c P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 127766fc592545a4997f7790f50f6076, e5256d91808b47c195bc9b4dbd7f2b87; no voters: 
I20260709 13:06:49.400671 25232 raft_consensus.cc:2749] T 6c5eebf646ad445a9d1b1adc319d7b16 P 127766fc592545a4997f7790f50f6076 [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:06:49.312913 25138 leader_election.cc:290] T 179fd671030940b4b4a4e24bcc4aba0a P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:06:49.401945 25340 raft_consensus.cc:2804] T 179fd671030940b4b4a4e24bcc4aba0a P 0473d2b2d01f4459b1e90fd12cc7840e [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:06:49.402550 25340 raft_consensus.cc:697] T 179fd671030940b4b4a4e24bcc4aba0a P 0473d2b2d01f4459b1e90fd12cc7840e [term 19 LEADER]: Becoming Leader. State: Replica: 0473d2b2d01f4459b1e90fd12cc7840e, State: Running, Role: LEADER
W20260709 13:06:49.356352 19450 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:49.403486 25340 consensus_queue.cc:237] T 179fd671030940b4b4a4e24bcc4aba0a P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.11, Last appended by leader: 11, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:49.405190 19485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff75a1d4cb1f493db8f71ddc136ba9ab" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:06:49.405633 19478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b74109013a140ada21feeef92d6f563" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:06:49.406284 19478 raft_consensus.cc:2468] T 2b74109013a140ada21feeef92d6f563 P 0473d2b2d01f4459b1e90fd12cc7840e [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 13.
I20260709 13:06:49.406745 19481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22196caba61445d3bec98a0aab3c337d" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:06:49.407226 19478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9f0d59553ad444883fcf5b5909f9798" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:06:49.406296 19485 raft_consensus.cc:2393] T ff75a1d4cb1f493db8f71ddc136ba9ab P 0473d2b2d01f4459b1e90fd12cc7840e [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate e5256d91808b47c195bc9b4dbd7f2b87 in current term 17: Already voted for candidate 0473d2b2d01f4459b1e90fd12cc7840e in this term.
I20260709 13:06:49.407891 19478 raft_consensus.cc:2468] T b9f0d59553ad444883fcf5b5909f9798 P 0473d2b2d01f4459b1e90fd12cc7840e [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 14.
I20260709 13:06:49.337776 25261 raft_consensus.cc:515] T 21e14947d70440f19044d8f75c31e1f9 P 0473d2b2d01f4459b1e90fd12cc7840e [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:49.408690 19485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f85fc4b527a48848e5faa083b604e36" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:06:49.293133 25329 raft_consensus.cc:493] T 22196caba61445d3bec98a0aab3c337d P 0473d2b2d01f4459b1e90fd12cc7840e [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:49.409472 25329 raft_consensus.cc:3060] T 22196caba61445d3bec98a0aab3c337d P 0473d2b2d01f4459b1e90fd12cc7840e [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:06:49.410100 19483 raft_consensus.cc:1240] T 3e1f505cb0f1427bbd698ac889d80821 P 0473d2b2d01f4459b1e90fd12cc7840e [term 19 FOLLOWER]: Rejecting Update request from peer e5256d91808b47c195bc9b4dbd7f2b87 for earlier term 18. Current term is 19. Ops: [18.11-18.11]
I20260709 13:06:49.410419 25261 leader_election.cc:290] T 21e14947d70440f19044d8f75c31e1f9 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:06:49.411036 25261 raft_consensus.cc:2764] T 5ec1c4ce15e04c7e8c283a62179f2a64 P 0473d2b2d01f4459b1e90fd12cc7840e [term 11 FOLLOWER]: Leader pre-election decision vote started in defunct term 10: won
I20260709 13:06:49.358387 19482 raft_consensus.cc:2468] T 7be9efa6559648dbb5a0f7684c4542d1 P 0473d2b2d01f4459b1e90fd12cc7840e [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 127766fc592545a4997f7790f50f6076 in term 16.
I20260709 13:06:49.355154 25319 raft_consensus.cc:515] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P 127766fc592545a4997f7790f50f6076 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:49.383818 25188 leader_election.cc:290] T f93ee515a9c14139bf566522ed8232f3 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 19 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:06:49.385367 25095 raft_consensus.cc:515] T b08304a0a02b42d7840c4e8ee9a6bd1a P e61c3a8f61bb48f8a963c9480e53c168 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:49.262540 25093 raft_consensus.cc:493] T 172b3dd13109415a955b71ac0e9d2234 P e5256d91808b47c195bc9b4dbd7f2b87 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:49.409034 19478 raft_consensus.cc:1240] T 172b3dd13109415a955b71ac0e9d2234 P 0473d2b2d01f4459b1e90fd12cc7840e [term 15 FOLLOWER]: Rejecting Update request from peer e5256d91808b47c195bc9b4dbd7f2b87 for earlier term 14. Current term is 15. Ops: []
I20260709 13:06:49.414139 19485 raft_consensus.cc:3060] T 1f85fc4b527a48848e5faa083b604e36 P 0473d2b2d01f4459b1e90fd12cc7840e [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:06:49.188436 25241 consensus_queue.cc:237] T 40e1e16737a842ee936002830f36882e P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 17.9, Last appended by leader: 9, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:49.414224 19483 raft_consensus.cc:1240] T 7be9efa6559648dbb5a0f7684c4542d1 P 0473d2b2d01f4459b1e90fd12cc7840e [term 16 FOLLOWER]: Rejecting Update request from peer e5256d91808b47c195bc9b4dbd7f2b87 for earlier term 15. Current term is 16. Ops: []
I20260709 13:06:49.315811 25221 raft_consensus.cc:515] T 172b3dd13109415a955b71ac0e9d2234 P 127766fc592545a4997f7790f50f6076 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:49.353067 25100 raft_consensus.cc:493] T 14935b3ddf914369822e4a0547aaa355 P e5256d91808b47c195bc9b4dbd7f2b87 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 127766fc592545a4997f7790f50f6076)
I20260709 13:06:49.352193 25311 raft_consensus.cc:515] T 0e1085d23e8347fbbd5bce7542f4b1f4 P 0473d2b2d01f4459b1e90fd12cc7840e [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:49.467440 25095 leader_election.cc:290] T b08304a0a02b42d7840c4e8ee9a6bd1a P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 17 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:06:49.469486 19404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36f6ba92b9ba46babe4ebd6c02e5fbd9" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:06:49.379910 25285 raft_consensus.cc:515] T fa731b585f684a7fb2d106c50f143b83 P 127766fc592545a4997f7790f50f6076 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:49.479179 19404 raft_consensus.cc:2468] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P e5256d91808b47c195bc9b4dbd7f2b87 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 127766fc592545a4997f7790f50f6076 in term 18.
W20260709 13:06:49.481343 19377 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:49.439512 25321 raft_consensus.cc:2804] T ece3db938bc649d4a40a51522ed5259c P 127766fc592545a4997f7790f50f6076 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:06:49.438764 25261 raft_consensus.cc:493] T 172b3dd13109415a955b71ac0e9d2234 P 0473d2b2d01f4459b1e90fd12cc7840e [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:49.482591 19478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22196caba61445d3bec98a0aab3c337d" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
W20260709 13:06:49.514456 19377 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:49.438938 25093 raft_consensus.cc:515] T 172b3dd13109415a955b71ac0e9d2234 P e5256d91808b47c195bc9b4dbd7f2b87 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:49.438206 25310 raft_consensus.cc:515] T 86a6797bdfe94fa496c050ceae4bd0d9 P e61c3a8f61bb48f8a963c9480e53c168 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:49.555999 19478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86a6797bdfe94fa496c050ceae4bd0d9" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:06:49.617022 19486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "775c229504194560ba9589bc2199b089" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:06:49.507089 24972 raft_consensus.cc:493] T 217b5fae677b4971b3bbd2f357a1f7ff P e5256d91808b47c195bc9b4dbd7f2b87 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 0473d2b2d01f4459b1e90fd12cc7840e)
I20260709 13:06:49.557585 19478 raft_consensus.cc:2468] T 86a6797bdfe94fa496c050ceae4bd0d9 P 0473d2b2d01f4459b1e90fd12cc7840e [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 13.
W20260709 13:06:49.622336 19449 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.4:43121, user_credentials={real_user=slave}} blocked reactor thread for 100991us
I20260709 13:06:49.623172 19449 leader_election.cc:304] T 96efeaaf1057492490e9a621f37e1a2d P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e; no voters: 127766fc592545a4997f7790f50f6076, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:06:49.520445 25298 raft_consensus.cc:697] T 2a16f7501e2444fb86d4e2778e734e02 P 127766fc592545a4997f7790f50f6076 [term 16 LEADER]: Becoming Leader. State: Replica: 127766fc592545a4997f7790f50f6076, State: Running, Role: LEADER
W20260709 13:06:49.629042 20075 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.1:40321, user_credentials={real_user=slave}} blocked reactor thread for 162927us
W20260709 13:06:49.559669 25223 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.710s	user 0.015s	sys 0.017s
I20260709 13:06:49.507710 25261 raft_consensus.cc:515] T 172b3dd13109415a955b71ac0e9d2234 P 0473d2b2d01f4459b1e90fd12cc7840e [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:49.634421 19478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b74109013a140ada21feeef92d6f563" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:06:49.484100 25349 consensus_queue.cc:1059] T 62c6c134d3d24a1ab144dd9ee6bc3f64 P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false }, Status: INVALID_TERM, Last received: 14.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.142s
I20260709 13:06:49.640395 19478 raft_consensus.cc:3060] T 2b74109013a140ada21feeef92d6f563 P 0473d2b2d01f4459b1e90fd12cc7840e [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:06:49.641197 19486 raft_consensus.cc:1275] T ff75a1d4cb1f493db8f71ddc136ba9ab P 0473d2b2d01f4459b1e90fd12cc7840e [term 17 FOLLOWER]: Refusing update from remote peer e5256d91808b47c195bc9b4dbd7f2b87: Log matching property violated. Preceding OpId in replica: term: 15 index: 8. Preceding OpId from leader: term: 17 index: 9. (index mismatch)
I20260709 13:06:49.536854 25319 leader_election.cc:290] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:06:49.518327 25100 raft_consensus.cc:515] T 14935b3ddf914369822e4a0547aaa355 P e5256d91808b47c195bc9b4dbd7f2b87 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } attrs { replace: true } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
W20260709 13:06:49.636648 25223 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.787s	user 0.016s	sys 0.017s
I20260709 13:06:49.629611 25352 raft_consensus.cc:493] T fa731b585f684a7fb2d106c50f143b83 P e5256d91808b47c195bc9b4dbd7f2b87 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 127766fc592545a4997f7790f50f6076)
I20260709 13:06:49.661995 19484 raft_consensus.cc:1240] T 1a61655d99124a29b486ba4a5b37faea P 0473d2b2d01f4459b1e90fd12cc7840e [term 15 FOLLOWER]: Rejecting Update request from peer e5256d91808b47c195bc9b4dbd7f2b87 for earlier term 14. Current term is 15. Ops: []
I20260709 13:06:49.628461 24972 raft_consensus.cc:515] T 217b5fae677b4971b3bbd2f357a1f7ff P e5256d91808b47c195bc9b4dbd7f2b87 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:49.648384 25246 leader_election.cc:290] T ab43d85f64114d4ebf618930e43d9ed0 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 18 election: Requested vote from peers e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:06:49.637458 25321 raft_consensus.cc:697] T ece3db938bc649d4a40a51522ed5259c P 127766fc592545a4997f7790f50f6076 [term 14 LEADER]: Becoming Leader. State: Replica: 127766fc592545a4997f7790f50f6076, State: Running, Role: LEADER
I20260709 13:06:49.655292 25312 leader_election.cc:290] T edd7d470b5014c9489be7f41f64355c9 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 19 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:06:49.664491 25237 raft_consensus.cc:493] T 46c5bfeecc314717bffe987e6844b6d0 P 0473d2b2d01f4459b1e90fd12cc7840e [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:49.642411 25355 consensus_queue.cc:1048] T 9962423cb4e54fcfa5de01daf68a86e7 P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Connected to new peer: Peer: permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.038s
I20260709 13:06:49.686841 19484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f575b143b844aa096b50997dad3516a" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:06:49.687745 19484 raft_consensus.cc:2468] T 7f575b143b844aa096b50997dad3516a P 0473d2b2d01f4459b1e90fd12cc7840e [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 13.
W20260709 13:06:49.680775 19377 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.17.223.2:46257 timed out after 1.661s (SENT) [suppressed 3 similar messages]
I20260709 13:06:49.689317 25362 raft_consensus.cc:493] T 1efebf73c86e432baa55533136b6e12c P 127766fc592545a4997f7790f50f6076 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 0473d2b2d01f4459b1e90fd12cc7840e)
I20260709 13:06:49.667240 25350 raft_consensus.cc:2749] T 96efeaaf1057492490e9a621f37e1a2d P 0473d2b2d01f4459b1e90fd12cc7840e [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:06:49.667876 25365 raft_consensus.cc:493] T 48824d5acfbc485ebf8c2d944e7202de P 127766fc592545a4997f7790f50f6076 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 0473d2b2d01f4459b1e90fd12cc7840e)
I20260709 13:06:49.700237 20103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "309c3ca0ca4b4f3ba129752ea2cb293b" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:06:49.702801 19484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab43d85f64114d4ebf618930e43d9ed0" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 18 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:06:49.692164 25090 raft_consensus.cc:493] T b08304a0a02b42d7840c4e8ee9a6bd1a P e5256d91808b47c195bc9b4dbd7f2b87 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 0473d2b2d01f4459b1e90fd12cc7840e)
I20260709 13:06:49.701298 25365 raft_consensus.cc:515] T 48824d5acfbc485ebf8c2d944e7202de P 127766fc592545a4997f7790f50f6076 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:49.704618 19484 raft_consensus.cc:1813] T ab43d85f64114d4ebf618930e43d9ed0 P 0473d2b2d01f4459b1e90fd12cc7840e [term 18 FOLLOWER]: Handling vote request from an unknown peer e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:06:49.668229 25352 raft_consensus.cc:515] T fa731b585f684a7fb2d106c50f143b83 P e5256d91808b47c195bc9b4dbd7f2b87 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:49.706975 25093 leader_election.cc:290] T 172b3dd13109415a955b71ac0e9d2234 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:06:49.707393 25352 leader_election.cc:290] T fa731b585f684a7fb2d106c50f143b83 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
W20260709 13:06:49.708103 25342 log.cc:927] Time spent T f93ee515a9c14139bf566522ed8232f3 P e5256d91808b47c195bc9b4dbd7f2b87: Append to log took a long time: real 0.253s	user 0.000s	sys 0.002s
I20260709 13:06:49.708247 25365 leader_election.cc:290] T 48824d5acfbc485ebf8c2d944e7202de P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:06:49.710919 25367 raft_consensus.cc:493] T 0afb57ae58a24a01850491d69f0213dd P 127766fc592545a4997f7790f50f6076 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 0473d2b2d01f4459b1e90fd12cc7840e)
I20260709 13:06:49.711539 25367 raft_consensus.cc:515] T 0afb57ae58a24a01850491d69f0213dd P 127766fc592545a4997f7790f50f6076 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
W20260709 13:06:49.713100 25343 log.cc:927] Time spent T 1a61655d99124a29b486ba4a5b37faea P e61c3a8f61bb48f8a963c9480e53c168: Append to log took a long time: real 0.177s	user 0.001s	sys 0.000s
I20260709 13:06:49.714381 25090 raft_consensus.cc:515] T b08304a0a02b42d7840c4e8ee9a6bd1a P e5256d91808b47c195bc9b4dbd7f2b87 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:49.717224 19486 raft_consensus.cc:1275] T 5ec1c4ce15e04c7e8c283a62179f2a64 P 0473d2b2d01f4459b1e90fd12cc7840e [term 11 FOLLOWER]: Refusing update from remote peer e5256d91808b47c195bc9b4dbd7f2b87: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:06:49.717386 25310 leader_election.cc:290] T 86a6797bdfe94fa496c050ceae4bd0d9 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 14 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:06:49.718286 19486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14935b3ddf914369822e4a0547aaa355" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
W20260709 13:06:49.721004 24702 consensus_meta.cc:287] T 76cb037fc9064d13b59a8969d897ce8c P e61c3a8f61bb48f8a963c9480e53c168: Time spent flushing consensus metadata: real 0.629s	user 0.007s	sys 0.003s
I20260709 13:06:49.721272 19486 raft_consensus.cc:1813] T 14935b3ddf914369822e4a0547aaa355 P 0473d2b2d01f4459b1e90fd12cc7840e [term 11 FOLLOWER]: Handling vote request from an unknown peer e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:06:49.721768 19486 raft_consensus.cc:2393] T 14935b3ddf914369822e4a0547aaa355 P 0473d2b2d01f4459b1e90fd12cc7840e [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e5256d91808b47c195bc9b4dbd7f2b87 in current term 11: Already voted for candidate 0473d2b2d01f4459b1e90fd12cc7840e in this term.
I20260709 13:06:49.721419 24702 raft_consensus.cc:515] T 76cb037fc9064d13b59a8969d897ce8c P e61c3a8f61bb48f8a963c9480e53c168 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:49.722553 19486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "309c3ca0ca4b4f3ba129752ea2cb293b" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:06:49.692922 25237 raft_consensus.cc:515] T 46c5bfeecc314717bffe987e6844b6d0 P 0473d2b2d01f4459b1e90fd12cc7840e [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:49.723169 25321 consensus_queue.cc:237] T ece3db938bc649d4a40a51522ed5259c P 127766fc592545a4997f7790f50f6076 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:49.723639 19486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21e14947d70440f19044d8f75c31e1f9" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:06:49.724179 19486 raft_consensus.cc:2468] T 21e14947d70440f19044d8f75c31e1f9 P 0473d2b2d01f4459b1e90fd12cc7840e [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 15.
I20260709 13:06:49.724920 19486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dc5b3532fe54f74876d02beffa2c230" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:06:49.725068 25237 leader_election.cc:290] T 46c5bfeecc314717bffe987e6844b6d0 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:06:49.718498 25100 leader_election.cc:290] T 14935b3ddf914369822e4a0547aaa355 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:06:49.720701 19479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cdf56e38bbc453d9438d359e5a69955" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:06:49.705704 19484 raft_consensus.cc:2393] T ab43d85f64114d4ebf618930e43d9ed0 P 0473d2b2d01f4459b1e90fd12cc7840e [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e5256d91808b47c195bc9b4dbd7f2b87 in current term 18: Already voted for candidate 0473d2b2d01f4459b1e90fd12cc7840e in this term.
I20260709 13:06:49.700433 25221 leader_election.cc:290] T 172b3dd13109415a955b71ac0e9d2234 P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
W20260709 13:06:49.728907 19449 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.4:43121, user_credentials={real_user=slave}} blocked reactor thread for 105824us
I20260709 13:06:49.729605 19449 leader_election.cc:304] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e; no voters: 127766fc592545a4997f7790f50f6076, e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:06:49.702951 25311 leader_election.cc:290] T 0e1085d23e8347fbbd5bce7542f4b1f4 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
W20260709 13:06:49.731421 25347 log.cc:927] Time spent T 309c3ca0ca4b4f3ba129752ea2cb293b P 0473d2b2d01f4459b1e90fd12cc7840e: Append to log took a long time: real 0.249s	user 0.000s	sys 0.002s
I20260709 13:06:49.731592 24702 leader_election.cc:290] T 76cb037fc9064d13b59a8969d897ce8c P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 16 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:06:49.733338 19485 raft_consensus.cc:2468] T 1f85fc4b527a48848e5faa083b604e36 P 0473d2b2d01f4459b1e90fd12cc7840e [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 15.
W20260709 13:06:49.731751 25344 log.cc:927] Time spent T edd7d470b5014c9489be7f41f64355c9 P e5256d91808b47c195bc9b4dbd7f2b87: Append to log took a long time: real 0.234s	user 0.001s	sys 0.000s
I20260709 13:06:49.739378 19486 raft_consensus.cc:1275] T 1f85fc4b527a48848e5faa083b604e36 P 0473d2b2d01f4459b1e90fd12cc7840e [term 15 FOLLOWER]: Refusing update from remote peer e5256d91808b47c195bc9b4dbd7f2b87: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 13:06:49.726711 25367 leader_election.cc:290] T 0afb57ae58a24a01850491d69f0213dd P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:06:49.737109 25285 leader_election.cc:290] T fa731b585f684a7fb2d106c50f143b83 P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:06:49.742043 19485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "172b3dd13109415a955b71ac0e9d2234" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:06:49.742853 19485 raft_consensus.cc:2468] T 172b3dd13109415a955b71ac0e9d2234 P 0473d2b2d01f4459b1e90fd12cc7840e [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 127766fc592545a4997f7790f50f6076 in term 15.
I20260709 13:06:49.741281 19377 leader_election.cc:304] T 86a6797bdfe94fa496c050ceae4bd0d9 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87; no voters: e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:06:49.742091 25369 raft_consensus.cc:2749] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P 0473d2b2d01f4459b1e90fd12cc7840e [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:06:49.696036 25362 raft_consensus.cc:515] T 1efebf73c86e432baa55533136b6e12c P 127766fc592545a4997f7790f50f6076 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:49.747138 19479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48824d5acfbc485ebf8c2d944e7202de" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:06:49.744908 19377 leader_election.cc:304] T 775c229504194560ba9589bc2199b089 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, 127766fc592545a4997f7790f50f6076
I20260709 13:06:49.752629 19402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9f0d59553ad444883fcf5b5909f9798" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:06:49.753535 19406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc225c93219c45538b53a1bd3d387e4d" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:06:49.755371 20112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e1085d23e8347fbbd5bce7542f4b1f4" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:06:49.755947 20104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14935b3ddf914369822e4a0547aaa355" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076"
I20260709 13:06:49.754575 19406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b74109013a140ada21feeef92d6f563" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:06:49.757520 19408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2725d2c4cb054f18b0fc8f735c15f6c2" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:06:49.758224 19408 raft_consensus.cc:2468] T 2725d2c4cb054f18b0fc8f735c15f6c2 P e5256d91808b47c195bc9b4dbd7f2b87 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 18.
I20260709 13:06:49.753167 25100 raft_consensus.cc:2804] T 86a6797bdfe94fa496c050ceae4bd0d9 P e5256d91808b47c195bc9b4dbd7f2b87 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:06:49.761350 25100 raft_consensus.cc:493] T 86a6797bdfe94fa496c050ceae4bd0d9 P e5256d91808b47c195bc9b4dbd7f2b87 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 0473d2b2d01f4459b1e90fd12cc7840e)
I20260709 13:06:49.761555 19404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a61655d99124a29b486ba4a5b37faea" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
I20260709 13:06:49.761741 25100 raft_consensus.cc:3060] T 86a6797bdfe94fa496c050ceae4bd0d9 P e5256d91808b47c195bc9b4dbd7f2b87 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:06:49.762598 19410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e381f1d6b8184797ad142de49be225a8" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:06:49.762812 20078 leader_election.cc:304] T 172b3dd13109415a955b71ac0e9d2234 P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, 127766fc592545a4997f7790f50f6076; no voters: 
I20260709 13:06:49.760476 25352 raft_consensus.cc:2749] T 775c229504194560ba9589bc2199b089 P e5256d91808b47c195bc9b4dbd7f2b87 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:06:49.763681 20107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab43d85f64114d4ebf618930e43d9ed0" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076"
I20260709 13:06:49.765007 20109 raft_consensus.cc:1240] T 9962423cb4e54fcfa5de01daf68a86e7 P 127766fc592545a4997f7790f50f6076 [term 17 LEADER]: Rejecting Update request from peer 0473d2b2d01f4459b1e90fd12cc7840e for earlier term 16. Current term is 17. Ops: [16.12-16.12]
I20260709 13:06:49.766048 19485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "172b3dd13109415a955b71ac0e9d2234" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:06:49.766949 19407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f93ee515a9c14139bf566522ed8232f3" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 19 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
I20260709 13:06:49.766592 19485 raft_consensus.cc:2468] T 172b3dd13109415a955b71ac0e9d2234 P 0473d2b2d01f4459b1e90fd12cc7840e [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 15.
I20260709 13:06:49.768419 19485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0afb57ae58a24a01850491d69f0213dd" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:06:49.769344 19485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36f6ba92b9ba46babe4ebd6c02e5fbd9" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:06:49.769380 25304 consensus_queue.cc:1048] T ff75a1d4cb1f493db8f71ddc136ba9ab P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:06:49.770087 19485 raft_consensus.cc:2393] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P 0473d2b2d01f4459b1e90fd12cc7840e [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 127766fc592545a4997f7790f50f6076 in current term 18: Already voted for candidate 0473d2b2d01f4459b1e90fd12cc7840e in this term.
I20260709 13:06:49.771108 25373 raft_consensus.cc:493] T 14935b3ddf914369822e4a0547aaa355 P 0473d2b2d01f4459b1e90fd12cc7840e [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:49.771785 25373 raft_consensus.cc:515] T 14935b3ddf914369822e4a0547aaa355 P 0473d2b2d01f4459b1e90fd12cc7840e [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:49.772583 24972 leader_election.cc:290] T 217b5fae677b4971b3bbd2f357a1f7ff P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:06:49.774250 25373 leader_election.cc:290] T 14935b3ddf914369822e4a0547aaa355 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:06:49.774350 25090 leader_election.cc:290] T b08304a0a02b42d7840c4e8ee9a6bd1a P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:06:49.774827 19406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21e14947d70440f19044d8f75c31e1f9" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:06:49.774945 25373 raft_consensus.cc:493] T f1b10566f45d4a7d9029858330e02d5b P 0473d2b2d01f4459b1e90fd12cc7840e [term 15 FOLLOWER]: Starting pre-election (detected failure of leader e61c3a8f61bb48f8a963c9480e53c168)
I20260709 13:06:49.775604 19406 raft_consensus.cc:2393] T 21e14947d70440f19044d8f75c31e1f9 P e5256d91808b47c195bc9b4dbd7f2b87 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0473d2b2d01f4459b1e90fd12cc7840e in current term 16: Already voted for candidate e5256d91808b47c195bc9b4dbd7f2b87 in this term.
I20260709 13:06:49.697146 25298 consensus_queue.cc:237] T 2a16f7501e2444fb86d4e2778e734e02 P 127766fc592545a4997f7790f50f6076 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:49.776932 19407 raft_consensus.cc:1240] T 9962423cb4e54fcfa5de01daf68a86e7 P e5256d91808b47c195bc9b4dbd7f2b87 [term 17 FOLLOWER]: Rejecting Update request from peer 0473d2b2d01f4459b1e90fd12cc7840e for earlier term 16. Current term is 17. Ops: [16.12-16.12]
I20260709 13:06:49.777483 19377 leader_election.cc:304] T 7f575b143b844aa096b50997dad3516a P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87; no voters: e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:06:49.780121 18300 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:06:49.780570 25285 raft_consensus.cc:2804] T 172b3dd13109415a955b71ac0e9d2234 P 127766fc592545a4997f7790f50f6076 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:06:49.780933 25285 raft_consensus.cc:493] T 172b3dd13109415a955b71ac0e9d2234 P 127766fc592545a4997f7790f50f6076 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:49.781248 25285 raft_consensus.cc:3060] T 172b3dd13109415a955b71ac0e9d2234 P 127766fc592545a4997f7790f50f6076 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:06:49.789568 25285 raft_consensus.cc:515] T 172b3dd13109415a955b71ac0e9d2234 P 127766fc592545a4997f7790f50f6076 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:49.791663 25285 leader_election.cc:290] T 172b3dd13109415a955b71ac0e9d2234 P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 16 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:06:49.793989 19478 raft_consensus.cc:2468] T 2b74109013a140ada21feeef92d6f563 P 0473d2b2d01f4459b1e90fd12cc7840e [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 14.
I20260709 13:06:49.795977 19406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46c5bfeecc314717bffe987e6844b6d0" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 23 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:06:49.796626 19406 raft_consensus.cc:2468] T 46c5bfeecc314717bffe987e6844b6d0 P e5256d91808b47c195bc9b4dbd7f2b87 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 22.
I20260709 13:06:49.775493 25373 raft_consensus.cc:515] T f1b10566f45d4a7d9029858330e02d5b P 0473d2b2d01f4459b1e90fd12cc7840e [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:49.801304 19408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa8650e71aa14778b3d73721fc50d9fc" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:06:49.802181 19485 raft_consensus.cc:1275] T 2b74109013a140ada21feeef92d6f563 P 0473d2b2d01f4459b1e90fd12cc7840e [term 14 FOLLOWER]: Refusing update from remote peer e5256d91808b47c195bc9b4dbd7f2b87: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 13:06:49.803524 19410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edd7d470b5014c9489be7f41f64355c9" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
I20260709 13:06:49.807482 19479 raft_consensus.cc:3055] T 9962423cb4e54fcfa5de01daf68a86e7 P 0473d2b2d01f4459b1e90fd12cc7840e [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:06:49.808408 19408 raft_consensus.cc:2468] T fa8650e71aa14778b3d73721fc50d9fc P e5256d91808b47c195bc9b4dbd7f2b87 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 16.
I20260709 13:06:49.810499 25369 raft_consensus.cc:493] T 2e36a9d6e29c4a7c860cf267efbd4c74 P 0473d2b2d01f4459b1e90fd12cc7840e [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:49.737807 25223 consensus_queue.cc:1059] T ab43d85f64114d4ebf618930e43d9ed0 P 127766fc592545a4997f7790f50f6076 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 }, Status: INVALID_TERM, Last received: 17.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.039s
I20260709 13:06:49.807942 19479 raft_consensus.cc:740] T 9962423cb4e54fcfa5de01daf68a86e7 P 0473d2b2d01f4459b1e90fd12cc7840e [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 0473d2b2d01f4459b1e90fd12cc7840e, State: Running, Role: LEADER
I20260709 13:06:49.816217 19478 raft_consensus.cc:1240] T 14935b3ddf914369822e4a0547aaa355 P 0473d2b2d01f4459b1e90fd12cc7840e [term 11 FOLLOWER]: Rejecting Update request from peer 127766fc592545a4997f7790f50f6076 for earlier term 10. Current term is 11. Ops: []
I20260709 13:06:49.811172 25369 raft_consensus.cc:515] T 2e36a9d6e29c4a7c860cf267efbd4c74 P 0473d2b2d01f4459b1e90fd12cc7840e [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
W20260709 13:06:49.833611 19524 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:49.813912 25347 log.cc:927] Time spent T 309c3ca0ca4b4f3ba129752ea2cb293b P 0473d2b2d01f4459b1e90fd12cc7840e: Append to log took a long time: real 0.054s	user 0.000s	sys 0.000s
I20260709 13:06:49.838487 19478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cdf56e38bbc453d9438d359e5a69955" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:06:49.839147 19482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df751f992649444090e27965eb1af85d" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
W20260709 13:06:49.841656 19377 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.2:46257, user_credentials={real_user=slave}} blocked reactor thread for 64252.3us
I20260709 13:06:49.841782 19483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed7fdbcb96d14d418db9ca90a792588a" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:06:49.802987 25352 consensus_queue.cc:1059] T 1a61655d99124a29b486ba4a5b37faea P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.038s
I20260709 13:06:49.833478 25311 raft_consensus.cc:493] T 6c5eebf646ad445a9d1b1adc319d7b16 P 0473d2b2d01f4459b1e90fd12cc7840e [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:49.852244 19482 raft_consensus.cc:3060] T df751f992649444090e27965eb1af85d P 0473d2b2d01f4459b1e90fd12cc7840e [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:06:49.837211 25237 raft_consensus.cc:493] T 40e1e16737a842ee936002830f36882e P 0473d2b2d01f4459b1e90fd12cc7840e [term 17 FOLLOWER]: Starting pre-election (detected failure of leader e5256d91808b47c195bc9b4dbd7f2b87)
I20260709 13:06:49.852418 19377 leader_election.cc:304] T 21e14947d70440f19044d8f75c31e1f9 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87; no voters: 
I20260709 13:06:49.810524 25183 consensus_queue.cc:1048] T 7f575b143b844aa096b50997dad3516a P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.033s
I20260709 13:06:49.848855 19479 consensus_queue.cc:260] T 9962423cb4e54fcfa5de01daf68a86e7 P 0473d2b2d01f4459b1e90fd12cc7840e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.12, Last appended by leader: 12, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:49.859570 19479 raft_consensus.cc:3060] T 9962423cb4e54fcfa5de01daf68a86e7 P 0473d2b2d01f4459b1e90fd12cc7840e [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:06:49.861018 25366 log.cc:927] Time spent T ed7fdbcb96d14d418db9ca90a792588a P 0473d2b2d01f4459b1e90fd12cc7840e: Append to log took a long time: real 0.101s	user 0.000s	sys 0.001s
I20260709 13:06:49.862648 19480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46c5bfeecc314717bffe987e6844b6d0" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 22 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:06:49.863988 25261 leader_election.cc:290] T 172b3dd13109415a955b71ac0e9d2234 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:06:49.866216 25100 raft_consensus.cc:515] T 86a6797bdfe94fa496c050ceae4bd0d9 P e5256d91808b47c195bc9b4dbd7f2b87 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:49.846467 25304 raft_consensus.cc:2804] T 7f575b143b844aa096b50997dad3516a P e5256d91808b47c195bc9b4dbd7f2b87 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:06:49.867980 25304 raft_consensus.cc:493] T 7f575b143b844aa096b50997dad3516a P e5256d91808b47c195bc9b4dbd7f2b87 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:49.868343 25304 raft_consensus.cc:3060] T 7f575b143b844aa096b50997dad3516a P e5256d91808b47c195bc9b4dbd7f2b87 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:06:49.870828 25341 raft_consensus.cc:493] T 14935b3ddf914369822e4a0547aaa355 P e61c3a8f61bb48f8a963c9480e53c168 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 127766fc592545a4997f7790f50f6076)
I20260709 13:06:49.846093 25232 consensus_queue.cc:1059] T 14935b3ddf914369822e4a0547aaa355 P 127766fc592545a4997f7790f50f6076 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.026s
I20260709 13:06:49.871377 25341 raft_consensus.cc:515] T 14935b3ddf914369822e4a0547aaa355 P e61c3a8f61bb48f8a963c9480e53c168 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:49.873580 25341 leader_election.cc:290] T 14935b3ddf914369822e4a0547aaa355 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:06:49.873461 19478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76cb037fc9064d13b59a8969d897ce8c" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 16 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:06:49.876194 19480 raft_consensus.cc:2468] T 46c5bfeecc314717bffe987e6844b6d0 P 0473d2b2d01f4459b1e90fd12cc7840e [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 22.
I20260709 13:06:49.879251 19478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86a6797bdfe94fa496c050ceae4bd0d9" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:06:49.879961 19480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e5873a19244c5ebbcd38e126796ee7" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:06:49.881173 25100 leader_election.cc:290] T 86a6797bdfe94fa496c050ceae4bd0d9 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 13 election: Requested vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:06:49.887568 19480 raft_consensus.cc:3060] T d1e5873a19244c5ebbcd38e126796ee7 P 0473d2b2d01f4459b1e90fd12cc7840e [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:06:49.889320 19478 raft_consensus.cc:2468] T 86a6797bdfe94fa496c050ceae4bd0d9 P 0473d2b2d01f4459b1e90fd12cc7840e [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 13.
I20260709 13:06:49.889635 25305 raft_consensus.cc:2804] T 21e14947d70440f19044d8f75c31e1f9 P e5256d91808b47c195bc9b4dbd7f2b87 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:06:49.889995 25305 raft_consensus.cc:493] T 21e14947d70440f19044d8f75c31e1f9 P e5256d91808b47c195bc9b4dbd7f2b87 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:49.890270 19478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef32ce6fdd0e40d382c79974f30295c6" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 21 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:06:49.890309 25305 raft_consensus.cc:3060] T 21e14947d70440f19044d8f75c31e1f9 P e5256d91808b47c195bc9b4dbd7f2b87 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:06:49.880549 25304 raft_consensus.cc:515] T 7f575b143b844aa096b50997dad3516a P e5256d91808b47c195bc9b4dbd7f2b87 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:49.892454 19477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "172b3dd13109415a955b71ac0e9d2234" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:06:49.892997 19477 raft_consensus.cc:3060] T 172b3dd13109415a955b71ac0e9d2234 P 0473d2b2d01f4459b1e90fd12cc7840e [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:06:49.893910 19478 raft_consensus.cc:1240] T edd7d470b5014c9489be7f41f64355c9 P 0473d2b2d01f4459b1e90fd12cc7840e [term 19 FOLLOWER]: Rejecting Update request from peer e61c3a8f61bb48f8a963c9480e53c168 for earlier term 18. Current term is 19. Ops: []
I20260709 13:06:49.889324 19377 leader_election.cc:304] T 172b3dd13109415a955b71ac0e9d2234 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87; no voters: 
I20260709 13:06:49.896308 25362 leader_election.cc:290] T 1efebf73c86e432baa55533136b6e12c P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:06:49.896553 19478 raft_consensus.cc:1240] T f93ee515a9c14139bf566522ed8232f3 P 0473d2b2d01f4459b1e90fd12cc7840e [term 19 FOLLOWER]: Rejecting Update request from peer e61c3a8f61bb48f8a963c9480e53c168 for earlier term 18. Current term is 19. Ops: []
W20260709 13:06:49.857774 24700 consensus_meta.cc:287] T f1b10566f45d4a7d9029858330e02d5b P e61c3a8f61bb48f8a963c9480e53c168: Time spent flushing consensus metadata: real 0.660s	user 0.008s	sys 0.003s
I20260709 13:06:49.926908 20107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "172b3dd13109415a955b71ac0e9d2234" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:06:49.927834 19406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "172b3dd13109415a955b71ac0e9d2234" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:06:49.931174 19478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1efebf73c86e432baa55533136b6e12c" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:06:49.920215 25369 leader_election.cc:290] T 2e36a9d6e29c4a7c860cf267efbd4c74 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:06:49.932403 19410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e36a9d6e29c4a7c860cf267efbd4c74" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:06:49.932696 25332 leader_election.cc:290] T fa8650e71aa14778b3d73721fc50d9fc P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:06:49.932875 20109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14935b3ddf914369822e4a0547aaa355" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:06:49.934291 20107 raft_consensus.cc:2393] T 172b3dd13109415a955b71ac0e9d2234 P 127766fc592545a4997f7790f50f6076 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0473d2b2d01f4459b1e90fd12cc7840e in current term 16: Already voted for candidate 127766fc592545a4997f7790f50f6076 in this term.
I20260709 13:06:49.934861 25056 raft_consensus.cc:493] T 7be9efa6559648dbb5a0f7684c4542d1 P e5256d91808b47c195bc9b4dbd7f2b87 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:49.935536 25285 raft_consensus.cc:3055] T ab43d85f64114d4ebf618930e43d9ed0 P 127766fc592545a4997f7790f50f6076 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:06:49.935397 25056 raft_consensus.cc:515] T 7be9efa6559648dbb5a0f7684c4542d1 P e5256d91808b47c195bc9b4dbd7f2b87 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } attrs { replace: true } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:49.935962 25285 raft_consensus.cc:740] T ab43d85f64114d4ebf618930e43d9ed0 P 127766fc592545a4997f7790f50f6076 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 127766fc592545a4997f7790f50f6076, State: Running, Role: LEADER
I20260709 13:06:49.936856 25285 consensus_queue.cc:260] T ab43d85f64114d4ebf618930e43d9ed0 P 127766fc592545a4997f7790f50f6076 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.11, Last appended by leader: 11, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:49.937347 19449 leader_election.cc:304] T 2725d2c4cb054f18b0fc8f735c15f6c2 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87; no voters: 
I20260709 13:06:49.938043 25285 raft_consensus.cc:3060] T ab43d85f64114d4ebf618930e43d9ed0 P 127766fc592545a4997f7790f50f6076 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:06:49.938103 25349 raft_consensus.cc:2804] T 2725d2c4cb054f18b0fc8f735c15f6c2 P 0473d2b2d01f4459b1e90fd12cc7840e [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:06:49.938766 25349 raft_consensus.cc:493] T 2725d2c4cb054f18b0fc8f735c15f6c2 P 0473d2b2d01f4459b1e90fd12cc7840e [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:49.909729 25090 raft_consensus.cc:2804] T 172b3dd13109415a955b71ac0e9d2234 P e5256d91808b47c195bc9b4dbd7f2b87 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:06:49.939195 25349 raft_consensus.cc:3060] T 2725d2c4cb054f18b0fc8f735c15f6c2 P 0473d2b2d01f4459b1e90fd12cc7840e [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:06:49.939385 25090 raft_consensus.cc:493] T 172b3dd13109415a955b71ac0e9d2234 P e5256d91808b47c195bc9b4dbd7f2b87 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:49.939853 25090 raft_consensus.cc:3060] T 172b3dd13109415a955b71ac0e9d2234 P e5256d91808b47c195bc9b4dbd7f2b87 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:06:49.940871 19483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86a6797bdfe94fa496c050ceae4bd0d9" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:06:49.945957 20075 leader_election.cc:304] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 127766fc592545a4997f7790f50f6076, e5256d91808b47c195bc9b4dbd7f2b87; no voters: 0473d2b2d01f4459b1e90fd12cc7840e
W20260709 13:06:49.947178 25329 consensus_meta.cc:287] T 22196caba61445d3bec98a0aab3c337d P 0473d2b2d01f4459b1e90fd12cc7840e: Time spent flushing consensus metadata: real 0.537s	user 0.011s	sys 0.000s
I20260709 13:06:49.947592 25329 raft_consensus.cc:515] T 22196caba61445d3bec98a0aab3c337d P 0473d2b2d01f4459b1e90fd12cc7840e [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:49.947889 20109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa731b585f684a7fb2d106c50f143b83" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:06:49.948173 20104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14935b3ddf914369822e4a0547aaa355" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:06:49.948519 20109 raft_consensus.cc:2468] T fa731b585f684a7fb2d106c50f143b83 P 127766fc592545a4997f7790f50f6076 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 13.
I20260709 13:06:49.948748 20110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7be9efa6559648dbb5a0f7684c4542d1" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:06:49.947603 20107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "172b3dd13109415a955b71ac0e9d2234" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:06:49.949340 20110 raft_consensus.cc:2468] T 7be9efa6559648dbb5a0f7684c4542d1 P 127766fc592545a4997f7790f50f6076 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 16.
I20260709 13:06:49.949589 25298 raft_consensus.cc:2804] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P 127766fc592545a4997f7790f50f6076 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:06:49.949823 20107 raft_consensus.cc:2393] T 172b3dd13109415a955b71ac0e9d2234 P 127766fc592545a4997f7790f50f6076 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e5256d91808b47c195bc9b4dbd7f2b87 in current term 16: Already voted for candidate 127766fc592545a4997f7790f50f6076 in this term.
I20260709 13:06:49.950032 25298 raft_consensus.cc:493] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P 127766fc592545a4997f7790f50f6076 [term 17 FOLLOWER]: Starting leader election (detected failure of leader e5256d91808b47c195bc9b4dbd7f2b87)
I20260709 13:06:49.950430 25298 raft_consensus.cc:3060] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P 127766fc592545a4997f7790f50f6076 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:06:49.954210 19449 leader_election.cc:304] T fa8650e71aa14778b3d73721fc50d9fc P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87; no voters: 
I20260709 13:06:49.956265 19481 raft_consensus.cc:2393] T 22196caba61445d3bec98a0aab3c337d P 0473d2b2d01f4459b1e90fd12cc7840e [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e5256d91808b47c195bc9b4dbd7f2b87 in current term 16: Already voted for candidate 0473d2b2d01f4459b1e90fd12cc7840e in this term.
I20260709 13:06:49.956123 25349 raft_consensus.cc:515] T 2725d2c4cb054f18b0fc8f735c15f6c2 P 0473d2b2d01f4459b1e90fd12cc7840e [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:49.958257 25349 leader_election.cc:290] T 2725d2c4cb054f18b0fc8f735c15f6c2 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 19 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:06:49.960685 19405 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52328 (request call id 2423) took 1019 ms. Trace:
I20260709 13:06:49.853765 24972 consensus_queue.cc:1048] T 5ec1c4ce15e04c7e8c283a62179f2a64 P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.067s
I20260709 13:06:49.961167 25376 raft_consensus.cc:2804] T fa8650e71aa14778b3d73721fc50d9fc P 0473d2b2d01f4459b1e90fd12cc7840e [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:06:49.961652 25376 raft_consensus.cc:493] T fa8650e71aa14778b3d73721fc50d9fc P 0473d2b2d01f4459b1e90fd12cc7840e [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:49.961977 25376 raft_consensus.cc:3060] T fa8650e71aa14778b3d73721fc50d9fc P 0473d2b2d01f4459b1e90fd12cc7840e [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:06:49.963063 19403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "172b3dd13109415a955b71ac0e9d2234" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:06:49.964342 25236 raft_consensus.cc:3055] T 14935b3ddf914369822e4a0547aaa355 P 127766fc592545a4997f7790f50f6076 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:06:49.964720 25236 raft_consensus.cc:740] T 14935b3ddf914369822e4a0547aaa355 P 127766fc592545a4997f7790f50f6076 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 127766fc592545a4997f7790f50f6076, State: Running, Role: LEADER
I20260709 13:06:49.965535 25236 consensus_queue.cc:260] T 14935b3ddf914369822e4a0547aaa355 P 127766fc592545a4997f7790f50f6076 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:49.967586 19484 raft_consensus.cc:1275] T 22196caba61445d3bec98a0aab3c337d P 0473d2b2d01f4459b1e90fd12cc7840e [term 16 FOLLOWER]: Refusing update from remote peer e5256d91808b47c195bc9b4dbd7f2b87: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 16 index: 10. (term mismatch)
I20260709 13:06:49.920987 25237 raft_consensus.cc:515] T 40e1e16737a842ee936002830f36882e P 0473d2b2d01f4459b1e90fd12cc7840e [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:49.967936 19484 pending_rounds.cc:85] T 22196caba61445d3bec98a0aab3c337d P 0473d2b2d01f4459b1e90fd12cc7840e: Aborting all ops after (but not including) 9
I20260709 13:06:49.968202 19484 pending_rounds.cc:107] T 22196caba61445d3bec98a0aab3c337d P 0473d2b2d01f4459b1e90fd12cc7840e: Aborting uncommitted NO_OP operation due to leader change: 14.10
I20260709 13:06:49.968418 19484 raft_consensus.cc:2889] T 22196caba61445d3bec98a0aab3c337d P 0473d2b2d01f4459b1e90fd12cc7840e [term 16 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:06:49.969772 25237 leader_election.cc:290] T 40e1e16737a842ee936002830f36882e P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:06:49.970232 19484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "217b5fae677b4971b3bbd2f357a1f7ff" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:06:49.970958 25376 raft_consensus.cc:515] T fa8650e71aa14778b3d73721fc50d9fc P 0473d2b2d01f4459b1e90fd12cc7840e [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:49.973172 25376 leader_election.cc:290] T fa8650e71aa14778b3d73721fc50d9fc P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 17 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:06:49.974040 19449 leader_election.cc:304] T 46c5bfeecc314717bffe987e6844b6d0 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87; no voters: 
I20260709 13:06:49.976964 25373 leader_election.cc:290] T f1b10566f45d4a7d9029858330e02d5b P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:06:49.977742 25373 raft_consensus.cc:2804] T 46c5bfeecc314717bffe987e6844b6d0 P 0473d2b2d01f4459b1e90fd12cc7840e [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:06:49.978183 25373 raft_consensus.cc:493] T 46c5bfeecc314717bffe987e6844b6d0 P 0473d2b2d01f4459b1e90fd12cc7840e [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:49.859015 25352 consensus_queue.cc:1243] T 1a61655d99124a29b486ba4a5b37faea P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Peer 0473d2b2d01f4459b1e90fd12cc7840e log is divergent from this leader: its last log entry 13.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 8
I20260709 13:06:49.980024 25093 raft_consensus.cc:3055] T 1a61655d99124a29b486ba4a5b37faea P e5256d91808b47c195bc9b4dbd7f2b87 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:06:49.980545 25093 raft_consensus.cc:740] T 1a61655d99124a29b486ba4a5b37faea P e5256d91808b47c195bc9b4dbd7f2b87 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: e5256d91808b47c195bc9b4dbd7f2b87, State: Running, Role: LEADER
I20260709 13:06:49.981611 25093 consensus_queue.cc:260] T 1a61655d99124a29b486ba4a5b37faea P e5256d91808b47c195bc9b4dbd7f2b87 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.9, Last appended by leader: 9, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:49.857329 25311 raft_consensus.cc:515] T 6c5eebf646ad445a9d1b1adc319d7b16 P 0473d2b2d01f4459b1e90fd12cc7840e [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:49.985170 25311 leader_election.cc:290] T 6c5eebf646ad445a9d1b1adc319d7b16 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:06:49.918449 24700 raft_consensus.cc:515] T f1b10566f45d4a7d9029858330e02d5b P e61c3a8f61bb48f8a963c9480e53c168 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:49.989240 19407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2725d2c4cb054f18b0fc8f735c15f6c2" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
I20260709 13:06:49.989960 19407 raft_consensus.cc:3060] T 2725d2c4cb054f18b0fc8f735c15f6c2 P e5256d91808b47c195bc9b4dbd7f2b87 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:06:49.932991 19410 raft_consensus.cc:2468] T 2e36a9d6e29c4a7c860cf267efbd4c74 P e5256d91808b47c195bc9b4dbd7f2b87 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 12.
I20260709 13:06:49.958415 19481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9f0d59553ad444883fcf5b5909f9798" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
W20260709 13:06:49.996644 19523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.1:40321, user_credentials={real_user=slave}} blocked reactor thread for 854916us
I20260709 13:06:50.001842 19480 raft_consensus.cc:2468] T d1e5873a19244c5ebbcd38e126796ee7 P 0473d2b2d01f4459b1e90fd12cc7840e [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 19.
I20260709 13:06:49.997601 19523 leader_election.cc:304] T d1e5873a19244c5ebbcd38e126796ee7 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:06:49.961174 19405 rpcz_store.cc:276] 0709 13:06:48.941563 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:48.952905 (+ 11342us) service_pool.cc:224] Handling call
0709 13:06:48.953307 (+   402us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:48.953827 (+   520us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:06:48.954163 (+   336us) log.cc:844] Serialized 14 byte log entry
0709 13:06:49.437119 (+482956us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:49.466292 (+ 29173us) log.cc:844] Serialized 26 byte log entry
0709 13:06:49.466480 (+   188us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:06:49.466768 (+   288us) log.cc:844] Serialized 14 byte log entry
0709 13:06:49.469458 (+  2690us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:49.469529 (+    71us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:49.960435 (+490906us) raft_consensus.cc:1685] finished
0709 13:06:49.960464 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:49.960618 (+   154us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":6056,"prepare.queue_time_us":279,"prepare.run_cpu_time_us":65,"prepare.run_wall_time_us":67,"raft.queue_time_us":25043,"raft.run_cpu_time_us":386,"raft.run_wall_time_us":21713,"spinlock_wait_cycles":1792,"thread_start_us":482433,"threads_started":2,"wal-append.queue_time_us":396902}
I20260709 13:06:50.010439 20112 raft_consensus.cc:1240] T 62c6c134d3d24a1ab144dd9ee6bc3f64 P 127766fc592545a4997f7790f50f6076 [term 15 FOLLOWER]: Rejecting Update request from peer 0473d2b2d01f4459b1e90fd12cc7840e for earlier term 14. Current term is 15. Ops: []
I20260709 13:06:49.892467 25304 leader_election.cc:290] T 7f575b143b844aa096b50997dad3516a P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 14 election: Requested vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:06:50.009567 19449 leader_election.cc:304] T 2e36a9d6e29c4a7c860cf267efbd4c74 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87; no voters: 
I20260709 13:06:50.026474 19408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa8650e71aa14778b3d73721fc50d9fc" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
I20260709 13:06:50.016986 20107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c5eebf646ad445a9d1b1adc319d7b16" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:06:50.028832 19408 raft_consensus.cc:3060] T fa8650e71aa14778b3d73721fc50d9fc P e5256d91808b47c195bc9b4dbd7f2b87 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:06:50.028963 20107 raft_consensus.cc:2468] T 6c5eebf646ad445a9d1b1adc319d7b16 P 127766fc592545a4997f7790f50f6076 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 17.
I20260709 13:06:50.027616 19403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40e1e16737a842ee936002830f36882e" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:06:50.030507 19403 raft_consensus.cc:2393] T 40e1e16737a842ee936002830f36882e P e5256d91808b47c195bc9b4dbd7f2b87 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0473d2b2d01f4459b1e90fd12cc7840e in current term 18: Already voted for candidate e61c3a8f61bb48f8a963c9480e53c168 in this term.
I20260709 13:06:49.978559 25373 raft_consensus.cc:3060] T 46c5bfeecc314717bffe987e6844b6d0 P 0473d2b2d01f4459b1e90fd12cc7840e [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:06:50.037518 19481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e36a9d6e29c4a7c860cf267efbd4c74" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:06:50.032657 19411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1b10566f45d4a7d9029858330e02d5b" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:06:50.039764 19482 raft_consensus.cc:2468] T df751f992649444090e27965eb1af85d P 0473d2b2d01f4459b1e90fd12cc7840e [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 20.
I20260709 13:06:50.041405 19405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa731b585f684a7fb2d106c50f143b83" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:06:50.042271 19405 raft_consensus.cc:2468] T fa731b585f684a7fb2d106c50f143b83 P e5256d91808b47c195bc9b4dbd7f2b87 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 127766fc592545a4997f7790f50f6076 in term 12.
I20260709 13:06:49.938158 25056 leader_election.cc:290] T 7be9efa6559648dbb5a0f7684c4542d1 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:06:50.045514 19411 raft_consensus.cc:2393] T f1b10566f45d4a7d9029858330e02d5b P e5256d91808b47c195bc9b4dbd7f2b87 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0473d2b2d01f4459b1e90fd12cc7840e in current term 16: Already voted for candidate e5256d91808b47c195bc9b4dbd7f2b87 in this term.
I20260709 13:06:50.050963 19555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21e14947d70440f19044d8f75c31e1f9" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:06:50.051779 19555 raft_consensus.cc:2468] T 21e14947d70440f19044d8f75c31e1f9 P e61c3a8f61bb48f8a963c9480e53c168 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 16.
I20260709 13:06:50.045457 19480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b08304a0a02b42d7840c4e8ee9a6bd1a" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:06:50.007884 25100 raft_consensus.cc:493] T a08760e15aac4630a629431f56024dc8 P e5256d91808b47c195bc9b4dbd7f2b87 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:49.996260 25236 raft_consensus.cc:3060] T 14935b3ddf914369822e4a0547aaa355 P 127766fc592545a4997f7790f50f6076 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:06:50.047927 19552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14935b3ddf914369822e4a0547aaa355" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:06:50.054770 19552 raft_consensus.cc:1813] T 14935b3ddf914369822e4a0547aaa355 P e61c3a8f61bb48f8a963c9480e53c168 [term 10 FOLLOWER]: Handling vote request from an unknown peer e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:06:50.055037 19377 leader_election.cc:304] T b9f0d59553ad444883fcf5b5909f9798 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:06:50.060900 19555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "217b5fae677b4971b3bbd2f357a1f7ff" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:06:50.061769 19555 raft_consensus.cc:2468] T 217b5fae677b4971b3bbd2f357a1f7ff P e61c3a8f61bb48f8a963c9480e53c168 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 12.
I20260709 13:06:50.049782 25376 raft_consensus.cc:2804] T 2e36a9d6e29c4a7c860cf267efbd4c74 P 0473d2b2d01f4459b1e90fd12cc7840e [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:06:50.068619 25376 raft_consensus.cc:493] T 2e36a9d6e29c4a7c860cf267efbd4c74 P 0473d2b2d01f4459b1e90fd12cc7840e [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:50.069377 19478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1b10566f45d4a7d9029858330e02d5b" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:06:50.070065 19449 leader_election.cc:304] T 6c5eebf646ad445a9d1b1adc319d7b16 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, 127766fc592545a4997f7790f50f6076; no voters: 
I20260709 13:06:50.070490 19551 raft_consensus.cc:1275] T 22196caba61445d3bec98a0aab3c337d P e61c3a8f61bb48f8a963c9480e53c168 [term 16 FOLLOWER]: Refusing update from remote peer e5256d91808b47c195bc9b4dbd7f2b87: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 13:06:50.071056 19552 raft_consensus.cc:2410] T 14935b3ddf914369822e4a0547aaa355 P e61c3a8f61bb48f8a963c9480e53c168 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e5256d91808b47c195bc9b4dbd7f2b87 for term 11 because replica has last-logged OpId of term: 10 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 8.
I20260709 13:06:50.071933 19559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cdf56e38bbc453d9438d359e5a69955" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:06:50.075726 19556 raft_consensus.cc:1275] T 2b74109013a140ada21feeef92d6f563 P e61c3a8f61bb48f8a963c9480e53c168 [term 14 FOLLOWER]: Refusing update from remote peer e5256d91808b47c195bc9b4dbd7f2b87: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
W20260709 13:06:50.024878 25308 consensus_meta.cc:287] T 2e36a9d6e29c4a7c860cf267efbd4c74 P e61c3a8f61bb48f8a963c9480e53c168: Time spent flushing consensus metadata: real 0.708s	user 0.011s	sys 0.001s
I20260709 13:06:50.077164 25376 raft_consensus.cc:3060] T 2e36a9d6e29c4a7c860cf267efbd4c74 P 0473d2b2d01f4459b1e90fd12cc7840e [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:06:50.078490 19553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa731b585f684a7fb2d106c50f143b83" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:06:50.050333 25332 consensus_queue.cc:1059] T 62c6c134d3d24a1ab144dd9ee6bc3f64 P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false }, Status: INVALID_TERM, Last received: 14.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.029s
I20260709 13:06:50.079242 19553 raft_consensus.cc:2393] T fa731b585f684a7fb2d106c50f143b83 P e61c3a8f61bb48f8a963c9480e53c168 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e5256d91808b47c195bc9b4dbd7f2b87 in current term 13: Already voted for candidate e61c3a8f61bb48f8a963c9480e53c168 in this term.
I20260709 13:06:50.081462 25311 raft_consensus.cc:2804] T 6c5eebf646ad445a9d1b1adc319d7b16 P 0473d2b2d01f4459b1e90fd12cc7840e [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:06:50.081629 19483 raft_consensus.cc:2468] T 86a6797bdfe94fa496c050ceae4bd0d9 P 0473d2b2d01f4459b1e90fd12cc7840e [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 13.
I20260709 13:06:50.081940 25311 raft_consensus.cc:493] T 6c5eebf646ad445a9d1b1adc319d7b16 P 0473d2b2d01f4459b1e90fd12cc7840e [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:50.082371 25311 raft_consensus.cc:3060] T 6c5eebf646ad445a9d1b1adc319d7b16 P 0473d2b2d01f4459b1e90fd12cc7840e [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:06:50.082556 19484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b08304a0a02b42d7840c4e8ee9a6bd1a" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:06:50.083699 19484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "179fd671030940b4b4a4e24bcc4aba0a" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:06:50.084683 19484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7be9efa6559648dbb5a0f7684c4542d1" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:06:50.085191 19484 raft_consensus.cc:2468] T 7be9efa6559648dbb5a0f7684c4542d1 P 0473d2b2d01f4459b1e90fd12cc7840e [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 16.
I20260709 13:06:50.088629 25338 raft_consensus.cc:493] T ab43d85f64114d4ebf618930e43d9ed0 P e61c3a8f61bb48f8a963c9480e53c168 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 127766fc592545a4997f7790f50f6076)
I20260709 13:06:50.089190 25338 raft_consensus.cc:515] T ab43d85f64114d4ebf618930e43d9ed0 P e61c3a8f61bb48f8a963c9480e53c168 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:50.070276 19478 raft_consensus.cc:2468] T f1b10566f45d4a7d9029858330e02d5b P 0473d2b2d01f4459b1e90fd12cc7840e [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 15.
I20260709 13:06:50.091372 25052 raft_consensus.cc:493] T 2a16f7501e2444fb86d4e2778e734e02 P e61c3a8f61bb48f8a963c9480e53c168 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:50.092027 19480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2725d2c4cb054f18b0fc8f735c15f6c2" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:06:50.091902 25052 raft_consensus.cc:515] T 2a16f7501e2444fb86d4e2778e734e02 P e61c3a8f61bb48f8a963c9480e53c168 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:50.092788 19480 raft_consensus.cc:2393] T 2725d2c4cb054f18b0fc8f735c15f6c2 P 0473d2b2d01f4459b1e90fd12cc7840e [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e61c3a8f61bb48f8a963c9480e53c168 in current term 19: Already voted for candidate 0473d2b2d01f4459b1e90fd12cc7840e in this term.
I20260709 13:06:50.092931 25097 raft_consensus.cc:3055] T 62c6c134d3d24a1ab144dd9ee6bc3f64 P 0473d2b2d01f4459b1e90fd12cc7840e [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:06:50.093320 25097 raft_consensus.cc:740] T 62c6c134d3d24a1ab144dd9ee6bc3f64 P 0473d2b2d01f4459b1e90fd12cc7840e [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 0473d2b2d01f4459b1e90fd12cc7840e, State: Running, Role: LEADER
I20260709 13:06:50.093597 19480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14935b3ddf914369822e4a0547aaa355" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:06:50.093961 25052 leader_election.cc:290] T 2a16f7501e2444fb86d4e2778e734e02 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:06:50.094285 19480 raft_consensus.cc:2393] T 14935b3ddf914369822e4a0547aaa355 P 0473d2b2d01f4459b1e90fd12cc7840e [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e61c3a8f61bb48f8a963c9480e53c168 in current term 11: Already voted for candidate 0473d2b2d01f4459b1e90fd12cc7840e in this term.
I20260709 13:06:50.094858 25183 raft_consensus.cc:493] T fa8650e71aa14778b3d73721fc50d9fc P e61c3a8f61bb48f8a963c9480e53c168 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:50.094895 19482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f575b143b844aa096b50997dad3516a" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:06:50.095604 19482 raft_consensus.cc:3060] T 7f575b143b844aa096b50997dad3516a P 0473d2b2d01f4459b1e90fd12cc7840e [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:06:50.095458 25183 raft_consensus.cc:515] T fa8650e71aa14778b3d73721fc50d9fc P e61c3a8f61bb48f8a963c9480e53c168 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:50.097549 19486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86a6797bdfe94fa496c050ceae4bd0d9" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:06:50.098078 19486 raft_consensus.cc:3060] T 86a6797bdfe94fa496c050ceae4bd0d9 P 0473d2b2d01f4459b1e90fd12cc7840e [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:06:50.098735 25304 consensus_queue.cc:1048] T 22196caba61445d3bec98a0aab3c337d P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:06:50.099865 19485 raft_consensus.cc:1275] T 3e1f505cb0f1427bbd698ac889d80821 P 0473d2b2d01f4459b1e90fd12cc7840e [term 19 FOLLOWER]: Refusing update from remote peer e61c3a8f61bb48f8a963c9480e53c168: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 19 index: 12. (index mismatch)
I20260709 13:06:50.071535 19557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dc5b3532fe54f74876d02beffa2c230" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:06:50.072549 19559 raft_consensus.cc:2468] T 0cdf56e38bbc453d9438d359e5a69955 P e61c3a8f61bb48f8a963c9480e53c168 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 16.
I20260709 13:06:50.091377 19478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76cb037fc9064d13b59a8969d897ce8c" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 16 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:06:50.021574 24824 raft_consensus.cc:493] T 28af091831594f9d8e96482078cc7625 P e5256d91808b47c195bc9b4dbd7f2b87 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:50.101702 19557 raft_consensus.cc:2468] T 1dc5b3532fe54f74876d02beffa2c230 P e61c3a8f61bb48f8a963c9480e53c168 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 17.
W20260709 13:06:50.107288 19377 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.2:46257, user_credentials={real_user=slave}} blocked reactor thread for 52346.5us
I20260709 13:06:50.110409 19482 raft_consensus.cc:2468] T 7f575b143b844aa096b50997dad3516a P 0473d2b2d01f4459b1e90fd12cc7840e [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 14.
I20260709 13:06:50.021282 25310 raft_consensus.cc:493] T 48824d5acfbc485ebf8c2d944e7202de P e61c3a8f61bb48f8a963c9480e53c168 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 0473d2b2d01f4459b1e90fd12cc7840e)
I20260709 13:06:50.118870 19485 raft_consensus.cc:1240] T 7f575b143b844aa096b50997dad3516a P 0473d2b2d01f4459b1e90fd12cc7840e [term 14 FOLLOWER]: Rejecting Update request from peer e61c3a8f61bb48f8a963c9480e53c168 for earlier term 13. Current term is 14. Ops: [13.10-13.10]
I20260709 13:06:50.044963 25093 raft_consensus.cc:3060] T 1a61655d99124a29b486ba4a5b37faea P e5256d91808b47c195bc9b4dbd7f2b87 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:06:50.123339 19559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f575b143b844aa096b50997dad3516a" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:06:50.126641 19404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "172b3dd13109415a955b71ac0e9d2234" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
I20260709 13:06:50.100147 25376 raft_consensus.cc:515] T 2e36a9d6e29c4a7c860cf267efbd4c74 P 0473d2b2d01f4459b1e90fd12cc7840e [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:50.140192 19557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86a6797bdfe94fa496c050ceae4bd0d9" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:06:50.129990 19556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b08304a0a02b42d7840c4e8ee9a6bd1a" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
W20260709 13:06:50.135573 19523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.1:40321, user_credentials={real_user=slave}} blocked reactor thread for 138061us
I20260709 13:06:50.136368 19374 leader_election.cc:304] T 309c3ca0ca4b4f3ba129752ea2cb293b P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, 127766fc592545a4997f7790f50f6076
I20260709 13:06:50.142899 19374 leader_election.cc:304] T 14935b3ddf914369822e4a0547aaa355 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, 127766fc592545a4997f7790f50f6076
I20260709 13:06:50.138072 25304 consensus_queue.cc:1048] T 1f85fc4b527a48848e5faa083b604e36 P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.006s
I20260709 13:06:50.148617 19481 raft_consensus.cc:2368] T 2e36a9d6e29c4a7c860cf267efbd4c74 P 0473d2b2d01f4459b1e90fd12cc7840e [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e61c3a8f61bb48f8a963c9480e53c168 for earlier term 12. Current term is 13.
I20260709 13:06:50.150003 19483 raft_consensus.cc:1275] T 96efeaaf1057492490e9a621f37e1a2d P 0473d2b2d01f4459b1e90fd12cc7840e [term 19 FOLLOWER]: Refusing update from remote peer e61c3a8f61bb48f8a963c9480e53c168: Log matching property violated. Preceding OpId in replica: term: 17 index: 12. Preceding OpId from leader: term: 19 index: 13. (index mismatch)
I20260709 13:06:50.150405 24700 leader_election.cc:290] T f1b10566f45d4a7d9029858330e02d5b P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 17 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:06:50.151891 19523 leader_election.cc:304] T ef32ce6fdd0e40d382c79974f30295c6 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:06:50.156522 19559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7be9efa6559648dbb5a0f7684c4542d1" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:06:50.158353 19477 raft_consensus.cc:2468] T 172b3dd13109415a955b71ac0e9d2234 P 0473d2b2d01f4459b1e90fd12cc7840e [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 127766fc592545a4997f7790f50f6076 in term 16.
I20260709 13:06:50.097584 25183 leader_election.cc:290] T fa8650e71aa14778b3d73721fc50d9fc P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:06:50.165786 19556 raft_consensus.cc:2393] T b08304a0a02b42d7840c4e8ee9a6bd1a P e61c3a8f61bb48f8a963c9480e53c168 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e5256d91808b47c195bc9b4dbd7f2b87 in current term 17: Already voted for candidate e61c3a8f61bb48f8a963c9480e53c168 in this term.
I20260709 13:06:50.166586 19557 raft_consensus.cc:2368] T 86a6797bdfe94fa496c050ceae4bd0d9 P e61c3a8f61bb48f8a963c9480e53c168 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate e5256d91808b47c195bc9b4dbd7f2b87 for earlier term 13. Current term is 14.
I20260709 13:06:50.153904 19374 leader_election.cc:304] T fa731b585f684a7fb2d106c50f143b83 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 127766fc592545a4997f7790f50f6076, e5256d91808b47c195bc9b4dbd7f2b87; no voters: 
I20260709 13:06:50.094157 25097 consensus_queue.cc:260] T 62c6c134d3d24a1ab144dd9ee6bc3f64 P 0473d2b2d01f4459b1e90fd12cc7840e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:50.169440 19478 raft_consensus.cc:1275] T 28af091831594f9d8e96482078cc7625 P 0473d2b2d01f4459b1e90fd12cc7840e [term 17 FOLLOWER]: Refusing update from remote peer e61c3a8f61bb48f8a963c9480e53c168: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
I20260709 13:06:50.171231 19523 leader_election.cc:304] T df751f992649444090e27965eb1af85d P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:06:50.094909 25341 raft_consensus.cc:493] T 7be9efa6559648dbb5a0f7684c4542d1 P e61c3a8f61bb48f8a963c9480e53c168 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader e5256d91808b47c195bc9b4dbd7f2b87)
W20260709 13:06:50.181581 20075 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:50.181833 19404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e36a9d6e29c4a7c860cf267efbd4c74" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
I20260709 13:06:50.121474 24972 raft_consensus.cc:2749] T b9f0d59553ad444883fcf5b5909f9798 P e5256d91808b47c195bc9b4dbd7f2b87 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:06:50.170560 20078 leader_election.cc:304] T 172b3dd13109415a955b71ac0e9d2234 P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, 127766fc592545a4997f7790f50f6076; no voters: 
I20260709 13:06:50.182392 19404 raft_consensus.cc:3060] T 2e36a9d6e29c4a7c860cf267efbd4c74 P e5256d91808b47c195bc9b4dbd7f2b87 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:06:50.171487 24700 consensus_queue.cc:1048] T 3e1f505cb0f1427bbd698ac889d80821 P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:06:50.174289 19375 leader_election.cc:304] T 217b5fae677b4971b3bbd2f357a1f7ff P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168; no voters: 0473d2b2d01f4459b1e90fd12cc7840e
I20260709 13:06:50.108480 25100 raft_consensus.cc:515] T a08760e15aac4630a629431f56024dc8 P e5256d91808b47c195bc9b4dbd7f2b87 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:50.191284 19523 leader_election.cc:304] T 85c494af21f9457a85da47b9bc70c1fd P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e61c3a8f61bb48f8a963c9480e53c168; no voters: 127766fc592545a4997f7790f50f6076, e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:06:50.105274 25308 raft_consensus.cc:515] T 2e36a9d6e29c4a7c860cf267efbd4c74 P e61c3a8f61bb48f8a963c9480e53c168 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:50.164197 24702 raft_consensus.cc:2804] T d1e5873a19244c5ebbcd38e126796ee7 P e61c3a8f61bb48f8a963c9480e53c168 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:06:50.168016 25221 raft_consensus.cc:493] T 775c229504194560ba9589bc2199b089 P 127766fc592545a4997f7790f50f6076 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:50.164842 25352 raft_consensus.cc:2749] T 309c3ca0ca4b4f3ba129752ea2cb293b P e5256d91808b47c195bc9b4dbd7f2b87 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:06:50.183344 25304 raft_consensus.cc:3060] T 14935b3ddf914369822e4a0547aaa355 P e5256d91808b47c195bc9b4dbd7f2b87 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:06:50.224642 19526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.2:46257, user_credentials={real_user=slave}} blocked reactor thread for 177992us
I20260709 13:06:50.224814 24700 raft_consensus.cc:2749] T 85c494af21f9457a85da47b9bc70c1fd P e61c3a8f61bb48f8a963c9480e53c168 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:06:50.124920 24824 raft_consensus.cc:515] T 28af091831594f9d8e96482078cc7625 P e5256d91808b47c195bc9b4dbd7f2b87 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:50.237645 19552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9f0d59553ad444883fcf5b5909f9798" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:06:50.238544 20107 raft_consensus.cc:1275] T 96efeaaf1057492490e9a621f37e1a2d P 127766fc592545a4997f7790f50f6076 [term 19 FOLLOWER]: Refusing update from remote peer e61c3a8f61bb48f8a963c9480e53c168: Log matching property violated. Preceding OpId in replica: term: 17 index: 12. Preceding OpId from leader: term: 19 index: 13. (index mismatch)
I20260709 13:06:50.138062 25310 raft_consensus.cc:515] T 48824d5acfbc485ebf8c2d944e7202de P e61c3a8f61bb48f8a963c9480e53c168 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:50.200369 25321 raft_consensus.cc:2804] T 172b3dd13109415a955b71ac0e9d2234 P 127766fc592545a4997f7790f50f6076 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:06:50.235395 20103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14935b3ddf914369822e4a0547aaa355" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:06:50.138396 25309 consensus_queue.cc:1048] T 2b74109013a140ada21feeef92d6f563 P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.063s
I20260709 13:06:50.252835 19554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2725d2c4cb054f18b0fc8f735c15f6c2" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:06:50.253885 19554 raft_consensus.cc:2468] T 2725d2c4cb054f18b0fc8f735c15f6c2 P e61c3a8f61bb48f8a963c9480e53c168 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 18.
I20260709 13:06:50.238581 20112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a16f7501e2444fb86d4e2778e734e02" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:06:50.199124 25183 raft_consensus.cc:2804] T df751f992649444090e27965eb1af85d P e61c3a8f61bb48f8a963c9480e53c168 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:06:50.203310 25337 raft_consensus.cc:2804] T ef32ce6fdd0e40d382c79974f30295c6 P e61c3a8f61bb48f8a963c9480e53c168 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:06:50.234752 19526 leader_election.cc:304] T 0cdf56e38bbc453d9438d359e5a69955 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e61c3a8f61bb48f8a963c9480e53c168; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:06:50.239524 25097 raft_consensus.cc:3060] T 62c6c134d3d24a1ab144dd9ee6bc3f64 P 0473d2b2d01f4459b1e90fd12cc7840e [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:06:50.243985 25338 leader_election.cc:290] T ab43d85f64114d4ebf618930e43d9ed0 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:06:50.191123 25376 leader_election.cc:290] T 2e36a9d6e29c4a7c860cf267efbd4c74 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 13 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:06:50.272315 19404 raft_consensus.cc:2468] T 2e36a9d6e29c4a7c860cf267efbd4c74 P e5256d91808b47c195bc9b4dbd7f2b87 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 13.
I20260709 13:06:50.263305 24700 raft_consensus.cc:493] T 62c6c134d3d24a1ab144dd9ee6bc3f64 P e61c3a8f61bb48f8a963c9480e53c168 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 0473d2b2d01f4459b1e90fd12cc7840e)
W20260709 13:06:50.250165 25366 log.cc:927] Time spent T ed7fdbcb96d14d418db9ca90a792588a P 0473d2b2d01f4459b1e90fd12cc7840e: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
I20260709 13:06:50.256201 19556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a61655d99124a29b486ba4a5b37faea" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:06:50.257704 19557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14935b3ddf914369822e4a0547aaa355" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:06:50.238202 24702 raft_consensus.cc:697] T d1e5873a19244c5ebbcd38e126796ee7 P e61c3a8f61bb48f8a963c9480e53c168 [term 19 LEADER]: Becoming Leader. State: Replica: e61c3a8f61bb48f8a963c9480e53c168, State: Running, Role: LEADER
I20260709 13:06:50.183779 25305 raft_consensus.cc:515] T 21e14947d70440f19044d8f75c31e1f9 P e5256d91808b47c195bc9b4dbd7f2b87 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:50.274293 19449 leader_election.cc:304] T 2e36a9d6e29c4a7c860cf267efbd4c74 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87; no voters: 
W20260709 13:06:50.270170 19374 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.4:43121, user_credentials={real_user=slave}} blocked reactor thread for 116342us
I20260709 13:06:50.276175 19552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e381f1d6b8184797ad142de49be225a8" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:06:50.276944 19377 leader_election.cc:304] T 7f575b143b844aa096b50997dad3516a P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87; no voters: 
I20260709 13:06:50.277570 19557 raft_consensus.cc:3060] T 14935b3ddf914369822e4a0547aaa355 P e61c3a8f61bb48f8a963c9480e53c168 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:06:50.280802 19555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa8650e71aa14778b3d73721fc50d9fc" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:06:50.261325 25352 raft_consensus.cc:2804] T 217b5fae677b4971b3bbd2f357a1f7ff P e5256d91808b47c195bc9b4dbd7f2b87 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:06:50.222817 25298 raft_consensus.cc:515] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P 127766fc592545a4997f7790f50f6076 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:50.264066 25337 raft_consensus.cc:493] T ef32ce6fdd0e40d382c79974f30295c6 P e61c3a8f61bb48f8a963c9480e53c168 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:50.294149 19555 raft_consensus.cc:2468] T fa8650e71aa14778b3d73721fc50d9fc P e61c3a8f61bb48f8a963c9480e53c168 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 16.
I20260709 13:06:50.302124 19555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edd7d470b5014c9489be7f41f64355c9" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:06:50.289641 24700 raft_consensus.cc:515] T 62c6c134d3d24a1ab144dd9ee6bc3f64 P e61c3a8f61bb48f8a963c9480e53c168 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:50.194612 25341 raft_consensus.cc:515] T 7be9efa6559648dbb5a0f7684c4542d1 P e61c3a8f61bb48f8a963c9480e53c168 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } attrs { replace: true } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:50.293936 19377 leader_election.cc:304] T 86a6797bdfe94fa496c050ceae4bd0d9 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87; no voters: 
I20260709 13:06:50.246932 25311 raft_consensus.cc:515] T 6c5eebf646ad445a9d1b1adc319d7b16 P 0473d2b2d01f4459b1e90fd12cc7840e [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
W20260709 13:06:50.303515 19526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.2:46257, user_credentials={real_user=slave}} blocked reactor thread for 68921.4us
I20260709 13:06:50.238907 25221 raft_consensus.cc:515] T 775c229504194560ba9589bc2199b089 P 127766fc592545a4997f7790f50f6076 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:50.254858 25367 consensus_queue.cc:1059] T ed7fdbcb96d14d418db9ca90a792588a P 127766fc592545a4997f7790f50f6076 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.036s
I20260709 13:06:50.276088 25086 raft_consensus.cc:493] T 0afb57ae58a24a01850491d69f0213dd P e61c3a8f61bb48f8a963c9480e53c168 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 0473d2b2d01f4459b1e90fd12cc7840e)
I20260709 13:06:50.302414 19553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc225c93219c45538b53a1bd3d387e4d" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:06:50.301698 19560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b74109013a140ada21feeef92d6f563" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:06:50.296054 25183 raft_consensus.cc:697] T df751f992649444090e27965eb1af85d P e61c3a8f61bb48f8a963c9480e53c168 [term 20 LEADER]: Becoming Leader. State: Replica: e61c3a8f61bb48f8a963c9480e53c168, State: Running, Role: LEADER
I20260709 13:06:50.299641 25352 raft_consensus.cc:493] T 217b5fae677b4971b3bbd2f357a1f7ff P e5256d91808b47c195bc9b4dbd7f2b87 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 0473d2b2d01f4459b1e90fd12cc7840e)
I20260709 13:06:50.383397 19555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa8650e71aa14778b3d73721fc50d9fc" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
W20260709 13:06:50.400532 19449 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.1:40321, user_credentials={real_user=slave}} blocked reactor thread for 126320us
I20260709 13:06:50.400995 19555 raft_consensus.cc:3060] T fa8650e71aa14778b3d73721fc50d9fc P e61c3a8f61bb48f8a963c9480e53c168 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:06:50.294991 19374 leader_election.cc:304] T 7be9efa6559648dbb5a0f7684c4542d1 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, 127766fc592545a4997f7790f50f6076, e5256d91808b47c195bc9b4dbd7f2b87; no voters: 
I20260709 13:06:50.384315 19556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40e1e16737a842ee936002830f36882e" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:06:50.390991 19558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c5eebf646ad445a9d1b1adc319d7b16" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:06:50.402343 19558 raft_consensus.cc:2468] T 6c5eebf646ad445a9d1b1adc319d7b16 P e61c3a8f61bb48f8a963c9480e53c168 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 17.
W20260709 13:06:50.394485 20077 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:50.308486 25337 raft_consensus.cc:3060] T ef32ce6fdd0e40d382c79974f30295c6 P e61c3a8f61bb48f8a963c9480e53c168 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:06:50.304418 25241 raft_consensus.cc:493] T a08760e15aac4630a629431f56024dc8 P e61c3a8f61bb48f8a963c9480e53c168 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader e5256d91808b47c195bc9b4dbd7f2b87)
I20260709 13:06:50.399408 19560 raft_consensus.cc:2393] T 2b74109013a140ada21feeef92d6f563 P e61c3a8f61bb48f8a963c9480e53c168 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0473d2b2d01f4459b1e90fd12cc7840e in current term 14: Already voted for candidate e5256d91808b47c195bc9b4dbd7f2b87 in this term.
W20260709 13:06:50.404461 19374 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.4:43121, user_credentials={real_user=slave}} blocked reactor thread for 109574us
I20260709 13:06:50.404446 25138 raft_consensus.cc:493] T 1efebf73c86e432baa55533136b6e12c P e61c3a8f61bb48f8a963c9480e53c168 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 0473d2b2d01f4459b1e90fd12cc7840e)
I20260709 13:06:50.425874 25353 raft_consensus.cc:2804] T fa731b585f684a7fb2d106c50f143b83 P e5256d91808b47c195bc9b4dbd7f2b87 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:06:50.414376 25056 raft_consensus.cc:2804] T 7f575b143b844aa096b50997dad3516a P e5256d91808b47c195bc9b4dbd7f2b87 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:06:50.426522 25353 raft_consensus.cc:493] T fa731b585f684a7fb2d106c50f143b83 P e5256d91808b47c195bc9b4dbd7f2b87 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 127766fc592545a4997f7790f50f6076)
I20260709 13:06:50.425639 25350 raft_consensus.cc:2804] T 2e36a9d6e29c4a7c860cf267efbd4c74 P 0473d2b2d01f4459b1e90fd12cc7840e [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:06:50.426975 25353 raft_consensus.cc:3060] T fa731b585f684a7fb2d106c50f143b83 P e5256d91808b47c195bc9b4dbd7f2b87 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:06:50.427313 25350 raft_consensus.cc:697] T 2e36a9d6e29c4a7c860cf267efbd4c74 P 0473d2b2d01f4459b1e90fd12cc7840e [term 13 LEADER]: Becoming Leader. State: Replica: 0473d2b2d01f4459b1e90fd12cc7840e, State: Running, Role: LEADER
I20260709 13:06:50.428022 25232 raft_consensus.cc:3055] T ed7fdbcb96d14d418db9ca90a792588a P 127766fc592545a4997f7790f50f6076 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:06:50.428448 25232 raft_consensus.cc:740] T ed7fdbcb96d14d418db9ca90a792588a P 127766fc592545a4997f7790f50f6076 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 127766fc592545a4997f7790f50f6076, State: Running, Role: LEADER
I20260709 13:06:50.428248 25350 consensus_queue.cc:237] T 2e36a9d6e29c4a7c860cf267efbd4c74 P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:50.429673 25370 raft_consensus.cc:493] T 70797e5783b5454ab0d0eea663e791e3 P 127766fc592545a4997f7790f50f6076 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader e5256d91808b47c195bc9b4dbd7f2b87)
I20260709 13:06:50.430223 25370 raft_consensus.cc:515] T 70797e5783b5454ab0d0eea663e791e3 P 127766fc592545a4997f7790f50f6076 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:50.431416 25183 consensus_queue.cc:237] T df751f992649444090e27965eb1af85d P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.12, Last appended by leader: 12, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:50.394730 25355 raft_consensus.cc:493] T 28af091831594f9d8e96482078cc7625 P 0473d2b2d01f4459b1e90fd12cc7840e [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:50.386065 25338 raft_consensus.cc:493] T 0e1085d23e8347fbbd5bce7542f4b1f4 P e61c3a8f61bb48f8a963c9480e53c168 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 127766fc592545a4997f7790f50f6076)
I20260709 13:06:50.443594 19450 leader_election.cc:304] T b9f0d59553ad444883fcf5b5909f9798 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e; no voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:06:50.443816 19408 raft_consensus.cc:2468] T fa8650e71aa14778b3d73721fc50d9fc P e5256d91808b47c195bc9b4dbd7f2b87 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 17.
I20260709 13:06:50.444675 19407 raft_consensus.cc:2468] T 2725d2c4cb054f18b0fc8f735c15f6c2 P e5256d91808b47c195bc9b4dbd7f2b87 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 19.
I20260709 13:06:50.384505 25386 raft_consensus.cc:2749] T 0cdf56e38bbc453d9438d359e5a69955 P e61c3a8f61bb48f8a963c9480e53c168 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:06:50.445901 24700 leader_election.cc:290] T 62c6c134d3d24a1ab144dd9ee6bc3f64 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
W20260709 13:06:50.447291 20076 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.3:36891, user_credentials={real_user=slave}} blocked reactor thread for 196046us
I20260709 13:06:50.383164 19526 leader_election.cc:304] T ed7fdbcb96d14d418db9ca90a792588a P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e61c3a8f61bb48f8a963c9480e53c168; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, 127766fc592545a4997f7790f50f6076
W20260709 13:06:50.455600 19479 consensus_meta.cc:287] T 9962423cb4e54fcfa5de01daf68a86e7 P 0473d2b2d01f4459b1e90fd12cc7840e: Time spent flushing consensus metadata: real 0.554s	user 0.011s	sys 0.003s
I20260709 13:06:50.459959 19450 leader_election.cc:304] T 1a61655d99124a29b486ba4a5b37faea P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e; no voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:06:50.460573 24700 raft_consensus.cc:2749] T ed7fdbcb96d14d418db9ca90a792588a P e61c3a8f61bb48f8a963c9480e53c168 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
W20260709 13:06:50.462024 19526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.2:46257, user_credentials={real_user=slave}} blocked reactor thread for 78965.3us
I20260709 13:06:50.406546 25352 raft_consensus.cc:3060] T 217b5fae677b4971b3bbd2f357a1f7ff P e5256d91808b47c195bc9b4dbd7f2b87 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:06:50.464310 19526 leader_election.cc:304] T 46c5bfeecc314717bffe987e6844b6d0 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168; no voters: e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:06:50.456925 25244 raft_consensus.cc:493] T 1a61655d99124a29b486ba4a5b37faea P e61c3a8f61bb48f8a963c9480e53c168 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader e5256d91808b47c195bc9b4dbd7f2b87)
I20260709 13:06:50.414888 25246 raft_consensus.cc:493] T 3e1f505cb0f1427bbd698ac889d80821 P 0473d2b2d01f4459b1e90fd12cc7840e [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:50.453087 25052 raft_consensus.cc:493] T 70797e5783b5454ab0d0eea663e791e3 P e61c3a8f61bb48f8a963c9480e53c168 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader e5256d91808b47c195bc9b4dbd7f2b87)
I20260709 13:06:50.452133 25241 raft_consensus.cc:515] T a08760e15aac4630a629431f56024dc8 P e61c3a8f61bb48f8a963c9480e53c168 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:50.488647 19552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab43d85f64114d4ebf618930e43d9ed0" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:06:50.488409 25052 raft_consensus.cc:515] T 70797e5783b5454ab0d0eea663e791e3 P e61c3a8f61bb48f8a963c9480e53c168 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:50.489228 19552 raft_consensus.cc:3060] T ab43d85f64114d4ebf618930e43d9ed0 P e61c3a8f61bb48f8a963c9480e53c168 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:06:50.490357 25241 leader_election.cc:290] T a08760e15aac4630a629431f56024dc8 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:06:50.426115 25138 raft_consensus.cc:515] T 1efebf73c86e432baa55533136b6e12c P e61c3a8f61bb48f8a963c9480e53c168 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:50.492399 25138 leader_election.cc:290] T 1efebf73c86e432baa55533136b6e12c P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:06:50.490521 25052 leader_election.cc:290] T 70797e5783b5454ab0d0eea663e791e3 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:06:50.492936 25138 raft_consensus.cc:2804] T 46c5bfeecc314717bffe987e6844b6d0 P e61c3a8f61bb48f8a963c9480e53c168 [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:06:50.466075 25227 raft_consensus.cc:493] T 96efeaaf1057492490e9a621f37e1a2d P 127766fc592545a4997f7790f50f6076 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:50.493863 25227 raft_consensus.cc:515] T 96efeaaf1057492490e9a621f37e1a2d P 127766fc592545a4997f7790f50f6076 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:50.469717 19560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e36a9d6e29c4a7c860cf267efbd4c74" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:06:50.495225 19560 raft_consensus.cc:3060] T 2e36a9d6e29c4a7c860cf267efbd4c74 P e61c3a8f61bb48f8a963c9480e53c168 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:06:50.495951 25227 leader_election.cc:290] T 96efeaaf1057492490e9a621f37e1a2d P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:06:50.498467 25246 raft_consensus.cc:515] T 3e1f505cb0f1427bbd698ac889d80821 P 0473d2b2d01f4459b1e90fd12cc7840e [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:50.500351 24700 consensus_queue.cc:1059] T edd7d470b5014c9489be7f41f64355c9 P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 }, Status: INVALID_TERM, Last received: 18.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:06:50.500634 25246 leader_election.cc:290] T 3e1f505cb0f1427bbd698ac889d80821 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:06:50.501376 25095 raft_consensus.cc:3055] T edd7d470b5014c9489be7f41f64355c9 P e61c3a8f61bb48f8a963c9480e53c168 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:06:50.501513 24972 raft_consensus.cc:2804] T 7be9efa6559648dbb5a0f7684c4542d1 P e5256d91808b47c195bc9b4dbd7f2b87 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:06:50.501821 25095 raft_consensus.cc:740] T edd7d470b5014c9489be7f41f64355c9 P e61c3a8f61bb48f8a963c9480e53c168 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: e61c3a8f61bb48f8a963c9480e53c168, State: Running, Role: LEADER
I20260709 13:06:50.502118 24972 raft_consensus.cc:493] T 7be9efa6559648dbb5a0f7684c4542d1 P e5256d91808b47c195bc9b4dbd7f2b87 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:50.502300 25232 consensus_queue.cc:260] T ed7fdbcb96d14d418db9ca90a792588a P 127766fc592545a4997f7790f50f6076 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:50.503412 25232 raft_consensus.cc:3060] T ed7fdbcb96d14d418db9ca90a792588a P 127766fc592545a4997f7790f50f6076 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:06:50.461143 25338 raft_consensus.cc:515] T 0e1085d23e8347fbbd5bce7542f4b1f4 P e61c3a8f61bb48f8a963c9480e53c168 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:50.398341 25086 raft_consensus.cc:515] T 0afb57ae58a24a01850491d69f0213dd P e61c3a8f61bb48f8a963c9480e53c168 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:50.471257 19556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46c5bfeecc314717bffe987e6844b6d0" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 23 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:06:50.459161 25355 raft_consensus.cc:515] T 28af091831594f9d8e96482078cc7625 P 0473d2b2d01f4459b1e90fd12cc7840e [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:50.505375 25338 leader_election.cc:290] T 0e1085d23e8347fbbd5bce7542f4b1f4 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:06:50.505501 25086 leader_election.cc:290] T 0afb57ae58a24a01850491d69f0213dd P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:06:50.404578 25392 consensus_queue.cc:1048] T 22196caba61445d3bec98a0aab3c337d P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.076s
I20260709 13:06:50.506392 25355 leader_election.cc:290] T 28af091831594f9d8e96482078cc7625 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:06:50.501395 25403 raft_consensus.cc:2804] T 86a6797bdfe94fa496c050ceae4bd0d9 P e5256d91808b47c195bc9b4dbd7f2b87 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:06:50.507536 25403 raft_consensus.cc:697] T 86a6797bdfe94fa496c050ceae4bd0d9 P e5256d91808b47c195bc9b4dbd7f2b87 [term 13 LEADER]: Becoming Leader. State: Replica: e5256d91808b47c195bc9b4dbd7f2b87, State: Running, Role: LEADER
I20260709 13:06:50.508391 25403 consensus_queue.cc:237] T 86a6797bdfe94fa496c050ceae4bd0d9 P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.6, Last appended by leader: 6, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:50.486739 24702 consensus_queue.cc:237] T d1e5873a19244c5ebbcd38e126796ee7 P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 17.9, Last appended by leader: 9, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:50.511700 19554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f93ee515a9c14139bf566522ed8232f3" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 19 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:06:50.512785 19554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14935b3ddf914369822e4a0547aaa355" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:06:50.513821 19554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e1085d23e8347fbbd5bce7542f4b1f4" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
W20260709 13:06:50.469947 25390 log.cc:927] Time spent T 76cb037fc9064d13b59a8969d897ce8c P e5256d91808b47c195bc9b4dbd7f2b87: Append to log took a long time: real 0.088s	user 0.000s	sys 0.000s
I20260709 13:06:50.465781 25188 raft_consensus.cc:2749] T b9f0d59553ad444883fcf5b5909f9798 P 0473d2b2d01f4459b1e90fd12cc7840e [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:06:50.487722 25100 leader_election.cc:290] T a08760e15aac4630a629431f56024dc8 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:06:50.516847 25310 leader_election.cc:290] T 48824d5acfbc485ebf8c2d944e7202de P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:06:50.517486 25310 raft_consensus.cc:493] T 833a2f0775ed407a94b8924ce50adb63 P e61c3a8f61bb48f8a963c9480e53c168 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 127766fc592545a4997f7790f50f6076)
I20260709 13:06:50.487618 25305 leader_election.cc:290] T 21e14947d70440f19044d8f75c31e1f9 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 17 election: Requested vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:06:50.517807 25329 leader_election.cc:290] T 22196caba61445d3bec98a0aab3c337d P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 16 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:06:50.514323 19554 raft_consensus.cc:2468] T 0e1085d23e8347fbbd5bce7542f4b1f4 P e61c3a8f61bb48f8a963c9480e53c168 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 12.
I20260709 13:06:50.520102 19554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e36a9d6e29c4a7c860cf267efbd4c74" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:06:50.485817 25308 leader_election.cc:290] T 2e36a9d6e29c4a7c860cf267efbd4c74 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 12 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:06:50.520509 20075 leader_election.cc:304] T fa731b585f684a7fb2d106c50f143b83 P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 127766fc592545a4997f7790f50f6076, e5256d91808b47c195bc9b4dbd7f2b87; no voters: 
I20260709 13:06:50.465873 19553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1b10566f45d4a7d9029858330e02d5b" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:06:50.521143 19554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2725d2c4cb054f18b0fc8f735c15f6c2" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:06:50.521733 19553 raft_consensus.cc:2368] T f1b10566f45d4a7d9029858330e02d5b P e61c3a8f61bb48f8a963c9480e53c168 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0473d2b2d01f4459b1e90fd12cc7840e for earlier term 16. Current term is 17.
I20260709 13:06:50.462200 25056 raft_consensus.cc:697] T 7f575b143b844aa096b50997dad3516a P e5256d91808b47c195bc9b4dbd7f2b87 [term 14 LEADER]: Becoming Leader. State: Replica: e5256d91808b47c195bc9b4dbd7f2b87, State: Running, Role: LEADER
W20260709 13:06:50.522061 25383 log.cc:927] Time spent T 179fd671030940b4b4a4e24bcc4aba0a P 0473d2b2d01f4459b1e90fd12cc7840e: Append to log took a long time: real 0.124s	user 0.005s	sys 0.004s
I20260709 13:06:50.518083 25310 raft_consensus.cc:515] T 833a2f0775ed407a94b8924ce50adb63 P e61c3a8f61bb48f8a963c9480e53c168 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:50.522919 19553 raft_consensus.cc:1240] T 76cb037fc9064d13b59a8969d897ce8c P e61c3a8f61bb48f8a963c9480e53c168 [term 16 FOLLOWER]: Rejecting Update request from peer 0473d2b2d01f4459b1e90fd12cc7840e for earlier term 15. Current term is 16. Ops: [15.8-15.8]
I20260709 13:06:50.522616 25056 consensus_queue.cc:237] T 7f575b143b844aa096b50997dad3516a P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:50.524178 25310 leader_election.cc:290] T 833a2f0775ed407a94b8924ce50adb63 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:06:50.524765 19553 raft_consensus.cc:1240] T b08304a0a02b42d7840c4e8ee9a6bd1a P e61c3a8f61bb48f8a963c9480e53c168 [term 17 FOLLOWER]: Rejecting Update request from peer 0473d2b2d01f4459b1e90fd12cc7840e for earlier term 16. Current term is 17. Ops: []
I20260709 13:06:50.481940 24824 leader_election.cc:290] T 28af091831594f9d8e96482078cc7625 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:06:50.527871 25370 leader_election.cc:290] T 70797e5783b5454ab0d0eea663e791e3 P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
W20260709 13:06:50.530512 25395 log.cc:927] Time spent T 5ec1c4ce15e04c7e8c283a62179f2a64 P 0473d2b2d01f4459b1e90fd12cc7840e: Append to log took a long time: real 0.060s	user 0.001s	sys 0.000s
I20260709 13:06:50.472254 25311 leader_election.cc:290] T 6c5eebf646ad445a9d1b1adc319d7b16 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 18 election: Requested vote from peers e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:06:50.487134 25298 leader_election.cc:290] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 18 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:06:50.476150 25221 leader_election.cc:290] T 775c229504194560ba9589bc2199b089 P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:06:50.535133 25244 raft_consensus.cc:515] T 1a61655d99124a29b486ba4a5b37faea P e61c3a8f61bb48f8a963c9480e53c168 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:50.535821 20103 raft_consensus.cc:2468] T 14935b3ddf914369822e4a0547aaa355 P 127766fc592545a4997f7790f50f6076 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 11.
I20260709 13:06:50.537093 25244 leader_election.cc:290] T 1a61655d99124a29b486ba4a5b37faea P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:06:50.521670 19554 raft_consensus.cc:3060] T 2725d2c4cb054f18b0fc8f735c15f6c2 P e61c3a8f61bb48f8a963c9480e53c168 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:06:50.502612 24972 raft_consensus.cc:3060] T 7be9efa6559648dbb5a0f7684c4542d1 P e5256d91808b47c195bc9b4dbd7f2b87 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:06:50.539151 25310 raft_consensus.cc:493] T 4af19371ea874c09a0a2147040835cbb P e61c3a8f61bb48f8a963c9480e53c168 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 127766fc592545a4997f7790f50f6076)
I20260709 13:06:50.477857 19558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21e14947d70440f19044d8f75c31e1f9" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:06:50.540711 19558 raft_consensus.cc:2468] T 21e14947d70440f19044d8f75c31e1f9 P e61c3a8f61bb48f8a963c9480e53c168 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 16.
W20260709 13:06:50.540957 25285 consensus_meta.cc:287] T ab43d85f64114d4ebf618930e43d9ed0 P 127766fc592545a4997f7790f50f6076: Time spent flushing consensus metadata: real 0.602s	user 0.009s	sys 0.004s
I20260709 13:06:50.474018 19486 raft_consensus.cc:2468] T 86a6797bdfe94fa496c050ceae4bd0d9 P 0473d2b2d01f4459b1e90fd12cc7840e [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 14.
I20260709 13:06:50.542838 25244 consensus_queue.cc:1048] T 3e1f505cb0f1427bbd698ac889d80821 P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:06:50.543596 19558 raft_consensus.cc:3060] T 179fd671030940b4b4a4e24bcc4aba0a P e61c3a8f61bb48f8a963c9480e53c168 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:06:50.540575 25052 consensus_queue.cc:1059] T f93ee515a9c14139bf566522ed8232f3 P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 }, Status: INVALID_TERM, Last received: 18.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.000s
W20260709 13:06:50.546845 20078 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.2:46257, user_credentials={real_user=slave}} blocked reactor thread for 74404us
I20260709 13:06:50.547148 25086 raft_consensus.cc:493] T 22196caba61445d3bec98a0aab3c337d P e61c3a8f61bb48f8a963c9480e53c168 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:50.547616 25086 raft_consensus.cc:515] T 22196caba61445d3bec98a0aab3c337d P e61c3a8f61bb48f8a963c9480e53c168 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:50.457327 25321 raft_consensus.cc:697] T 172b3dd13109415a955b71ac0e9d2234 P 127766fc592545a4997f7790f50f6076 [term 16 LEADER]: Becoming Leader. State: Replica: 127766fc592545a4997f7790f50f6076, State: Running, Role: LEADER
I20260709 13:06:50.550683 25388 raft_consensus.cc:493] T 2b74109013a140ada21feeef92d6f563 P e61c3a8f61bb48f8a963c9480e53c168 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:50.551090 20112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab43d85f64114d4ebf618930e43d9ed0" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:06:50.551167 25388 raft_consensus.cc:515] T 2b74109013a140ada21feeef92d6f563 P e61c3a8f61bb48f8a963c9480e53c168 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:50.551852 20112 raft_consensus.cc:2468] T ab43d85f64114d4ebf618930e43d9ed0 P 127766fc592545a4997f7790f50f6076 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 18.
I20260709 13:06:50.553534 25388 leader_election.cc:290] T 2b74109013a140ada21feeef92d6f563 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:06:50.549566 25368 raft_consensus.cc:2804] T fa731b585f684a7fb2d106c50f143b83 P 127766fc592545a4997f7790f50f6076 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:06:50.554798 25368 raft_consensus.cc:493] T fa731b585f684a7fb2d106c50f143b83 P 127766fc592545a4997f7790f50f6076 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:50.555197 25368 raft_consensus.cc:3060] T fa731b585f684a7fb2d106c50f143b83 P 127766fc592545a4997f7790f50f6076 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:06:50.503023 25095 consensus_queue.cc:260] T edd7d470b5014c9489be7f41f64355c9 P e61c3a8f61bb48f8a963c9480e53c168 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 18.10, Last appended by leader: 10, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:50.555698 20103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c5eebf646ad445a9d1b1adc319d7b16" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076"
I20260709 13:06:50.556264 20103 raft_consensus.cc:3060] T 6c5eebf646ad445a9d1b1adc319d7b16 P 127766fc592545a4997f7790f50f6076 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:06:50.549563 25086 leader_election.cc:290] T 22196caba61445d3bec98a0aab3c337d P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
W20260709 13:06:50.485179 25090 consensus_meta.cc:287] T 172b3dd13109415a955b71ac0e9d2234 P e5256d91808b47c195bc9b4dbd7f2b87: Time spent flushing consensus metadata: real 0.545s	user 0.007s	sys 0.000s
I20260709 13:06:50.560577 25090 raft_consensus.cc:515] T 172b3dd13109415a955b71ac0e9d2234 P e5256d91808b47c195bc9b4dbd7f2b87 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:50.566442 19406 raft_consensus.cc:2393] T 172b3dd13109415a955b71ac0e9d2234 P e5256d91808b47c195bc9b4dbd7f2b87 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0473d2b2d01f4459b1e90fd12cc7840e in current term 16: Already voted for candidate e5256d91808b47c195bc9b4dbd7f2b87 in this term.
I20260709 13:06:50.567252 25368 raft_consensus.cc:515] T fa731b585f684a7fb2d106c50f143b83 P 127766fc592545a4997f7790f50f6076 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:50.568032 25090 leader_election.cc:290] T 172b3dd13109415a955b71ac0e9d2234 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 16 election: Requested vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:06:50.539741 25310 raft_consensus.cc:515] T 4af19371ea874c09a0a2147040835cbb P e61c3a8f61bb48f8a963c9480e53c168 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:50.559645 25138 raft_consensus.cc:697] T 46c5bfeecc314717bffe987e6844b6d0 P e61c3a8f61bb48f8a963c9480e53c168 [term 22 LEADER]: Becoming Leader. State: Replica: e61c3a8f61bb48f8a963c9480e53c168, State: Running, Role: LEADER
I20260709 13:06:50.570171 25095 raft_consensus.cc:3060] T edd7d470b5014c9489be7f41f64355c9 P e61c3a8f61bb48f8a963c9480e53c168 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:06:50.572182 25310 leader_election.cc:290] T 4af19371ea874c09a0a2147040835cbb P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:06:50.568835 19557 raft_consensus.cc:2468] T 14935b3ddf914369822e4a0547aaa355 P e61c3a8f61bb48f8a963c9480e53c168 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 11.
I20260709 13:06:50.573931 19557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa731b585f684a7fb2d106c50f143b83" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:06:50.574275 20112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62c6c134d3d24a1ab144dd9ee6bc3f64" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:06:50.574537 19557 raft_consensus.cc:2468] T fa731b585f684a7fb2d106c50f143b83 P e61c3a8f61bb48f8a963c9480e53c168 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 127766fc592545a4997f7790f50f6076 in term 13.
I20260709 13:06:50.575093 20112 raft_consensus.cc:2393] T 62c6c134d3d24a1ab144dd9ee6bc3f64 P 127766fc592545a4997f7790f50f6076 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e61c3a8f61bb48f8a963c9480e53c168 in current term 15: Already voted for candidate 127766fc592545a4997f7790f50f6076 in this term.
I20260709 13:06:50.575464 19557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48824d5acfbc485ebf8c2d944e7202de" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:06:50.576169 19557 raft_consensus.cc:2468] T 48824d5acfbc485ebf8c2d944e7202de P e61c3a8f61bb48f8a963c9480e53c168 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 127766fc592545a4997f7790f50f6076 in term 18.
I20260709 13:06:50.576771 20107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1efebf73c86e432baa55533136b6e12c" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:06:50.576902 19523 leader_election.cc:304] T 14935b3ddf914369822e4a0547aaa355 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 127766fc592545a4997f7790f50f6076, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:06:50.576975 19557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ece3db938bc649d4a40a51522ed5259c" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:06:50.577564 19557 raft_consensus.cc:3060] T ece3db938bc649d4a40a51522ed5259c P e61c3a8f61bb48f8a963c9480e53c168 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:06:50.578451 20110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0afb57ae58a24a01850491d69f0213dd" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:06:50.578758 20107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e1085d23e8347fbbd5bce7542f4b1f4" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:06:50.571972 25373 raft_consensus.cc:515] T 46c5bfeecc314717bffe987e6844b6d0 P 0473d2b2d01f4459b1e90fd12cc7840e [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:50.579893 20109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48824d5acfbc485ebf8c2d944e7202de" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:06:50.580435 20109 raft_consensus.cc:2468] T 48824d5acfbc485ebf8c2d944e7202de P 127766fc592545a4997f7790f50f6076 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 18.
I20260709 13:06:50.580819 25304 raft_consensus.cc:2749] T 14935b3ddf914369822e4a0547aaa355 P e5256d91808b47c195bc9b4dbd7f2b87 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:06:50.581207 25373 leader_election.cc:290] T 46c5bfeecc314717bffe987e6844b6d0 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 23 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:06:50.575608 19555 raft_consensus.cc:2468] T fa8650e71aa14778b3d73721fc50d9fc P e61c3a8f61bb48f8a963c9480e53c168 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 17.
I20260709 13:06:50.582046 20112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70797e5783b5454ab0d0eea663e791e3" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:06:50.569854 25138 consensus_queue.cc:237] T 46c5bfeecc314717bffe987e6844b6d0 P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 21.11, Last appended by leader: 11, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:50.582839 19555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0afb57ae58a24a01850491d69f0213dd" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:06:50.583110 19553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1efebf73c86e432baa55533136b6e12c" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:06:50.581681 20109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "833a2f0775ed407a94b8924ce50adb63" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:06:50.558297 25321 consensus_queue.cc:237] T 172b3dd13109415a955b71ac0e9d2234 P 127766fc592545a4997f7790f50f6076 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
W20260709 13:06:50.587785 19526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.2:46257, user_credentials={real_user=slave}} blocked reactor thread for 54564.8us
I20260709 13:06:50.581643 25353 raft_consensus.cc:515] T fa731b585f684a7fb2d106c50f143b83 P e5256d91808b47c195bc9b4dbd7f2b87 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:50.592651 19554 raft_consensus.cc:2468] T 2725d2c4cb054f18b0fc8f735c15f6c2 P e61c3a8f61bb48f8a963c9480e53c168 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 19.
W20260709 13:06:50.594924 19450 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.3:36891, user_credentials={real_user=slave}} blocked reactor thread for 135036us
I20260709 13:06:50.595337 19449 leader_election.cc:304] T fa8650e71aa14778b3d73721fc50d9fc P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87; no voters: 
I20260709 13:06:50.572065 25352 raft_consensus.cc:515] T 217b5fae677b4971b3bbd2f357a1f7ff P e5256d91808b47c195bc9b4dbd7f2b87 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:50.595682 19450 leader_election.cc:304] T edd7d470b5014c9489be7f41f64355c9 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e; no voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:06:50.590484 20103 raft_consensus.cc:2468] T 6c5eebf646ad445a9d1b1adc319d7b16 P 127766fc592545a4997f7790f50f6076 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 18.
W20260709 13:06:50.593760 19377 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.2:46257, user_credentials={real_user=slave}} blocked reactor thread for 299886us
I20260709 13:06:50.595680 19553 raft_consensus.cc:1240] T 14935b3ddf914369822e4a0547aaa355 P e61c3a8f61bb48f8a963c9480e53c168 [term 11 FOLLOWER]: Rejecting Update request from peer 127766fc592545a4997f7790f50f6076 for earlier term 10. Current term is 11. Ops: []
I20260709 13:06:50.594761 19559 raft_consensus.cc:2468] T 7be9efa6559648dbb5a0f7684c4542d1 P e61c3a8f61bb48f8a963c9480e53c168 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 15.
I20260709 13:06:50.598489 19449 leader_election.cc:304] T 6c5eebf646ad445a9d1b1adc319d7b16 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, 127766fc592545a4997f7790f50f6076; no voters: 
I20260709 13:06:50.599056 19560 raft_consensus.cc:2468] T 2e36a9d6e29c4a7c860cf267efbd4c74 P e61c3a8f61bb48f8a963c9480e53c168 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 13.
I20260709 13:06:50.604512 19407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e1f505cb0f1427bbd698ac889d80821" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 20 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:06:50.605300 19407 raft_consensus.cc:2410] T 3e1f505cb0f1427bbd698ac889d80821 P e5256d91808b47c195bc9b4dbd7f2b87 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0473d2b2d01f4459b1e90fd12cc7840e for term 20 because replica has last-logged OpId of term: 18 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 10.
I20260709 13:06:50.605559 19405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28af091831594f9d8e96482078cc7625" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:06:50.606107 19405 raft_consensus.cc:2468] T 28af091831594f9d8e96482078cc7625 P e5256d91808b47c195bc9b4dbd7f2b87 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 17.
I20260709 13:06:50.606514 19407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46c5bfeecc314717bffe987e6844b6d0" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 23 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
I20260709 13:06:50.607072 19407 raft_consensus.cc:3060] T 46c5bfeecc314717bffe987e6844b6d0 P e5256d91808b47c195bc9b4dbd7f2b87 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:06:50.603230 19406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22196caba61445d3bec98a0aab3c337d" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
I20260709 13:06:50.620803 19560 raft_consensus.cc:1275] T 2a16f7501e2444fb86d4e2778e734e02 P e61c3a8f61bb48f8a963c9480e53c168 [term 16 FOLLOWER]: Refusing update from remote peer 127766fc592545a4997f7790f50f6076: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 13:06:50.596650 19523 leader_election.cc:304] T ab43d85f64114d4ebf618930e43d9ed0 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 127766fc592545a4997f7790f50f6076, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:06:50.622427 19450 leader_election.cc:304] T bc225c93219c45538b53a1bd3d387e4d P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e; no voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:06:50.622987 19560 raft_consensus.cc:1240] T ed7fdbcb96d14d418db9ca90a792588a P e61c3a8f61bb48f8a963c9480e53c168 [term 14 FOLLOWER]: Rejecting Update request from peer 127766fc592545a4997f7790f50f6076 for earlier term 13. Current term is 14. Ops: [13.11-13.11]
W20260709 13:06:50.647902 19449 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.4:43121, user_credentials={real_user=slave}} blocked reactor thread for 49483us
I20260709 13:06:50.649910 19449 leader_election.cc:304] T 2725d2c4cb054f18b0fc8f735c15f6c2 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87; no voters: 
I20260709 13:06:50.624780 19526 leader_election.cc:400] T 2e36a9d6e29c4a7c860cf267efbd4c74 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 12 pre-election: Vote denied by peer 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257) with higher term. Message: Invalid argument: T 2e36a9d6e29c4a7c860cf267efbd4c74 P 0473d2b2d01f4459b1e90fd12cc7840e [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e61c3a8f61bb48f8a963c9480e53c168 for earlier term 12. Current term is 13.
I20260709 13:06:50.655457 19526 leader_election.cc:304] T 86a6797bdfe94fa496c050ceae4bd0d9 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:06:50.654249 19523 leader_election.cc:304] T 48824d5acfbc485ebf8c2d944e7202de P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 127766fc592545a4997f7790f50f6076, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:06:50.666007 19407 raft_consensus.cc:2468] T 46c5bfeecc314717bffe987e6844b6d0 P e5256d91808b47c195bc9b4dbd7f2b87 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 23.
I20260709 13:06:50.624025 25052 raft_consensus.cc:2764] T 14935b3ddf914369822e4a0547aaa355 P e61c3a8f61bb48f8a963c9480e53c168 [term 11 FOLLOWER]: Leader pre-election decision vote started in defunct term 10: won
I20260709 13:06:50.647274 25310 consensus_queue.cc:1059] T 7f575b143b844aa096b50997dad3516a P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 }, Status: INVALID_TERM, Last received: 11.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.043s
I20260709 13:06:50.667928 25310 raft_consensus.cc:3055] T 7f575b143b844aa096b50997dad3516a P e61c3a8f61bb48f8a963c9480e53c168 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:06:50.668272 25310 raft_consensus.cc:740] T 7f575b143b844aa096b50997dad3516a P e61c3a8f61bb48f8a963c9480e53c168 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: e61c3a8f61bb48f8a963c9480e53c168, State: Running, Role: LEADER
I20260709 13:06:50.669158 25341 leader_election.cc:290] T 7be9efa6559648dbb5a0f7684c4542d1 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:06:50.669025 25310 consensus_queue.cc:260] T 7f575b143b844aa096b50997dad3516a P e61c3a8f61bb48f8a963c9480e53c168 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.10, Last appended by leader: 10, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:50.670027 25329 raft_consensus.cc:2749] T edd7d470b5014c9489be7f41f64355c9 P 0473d2b2d01f4459b1e90fd12cc7840e [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:06:50.670123 25310 raft_consensus.cc:3060] T 7f575b143b844aa096b50997dad3516a P e61c3a8f61bb48f8a963c9480e53c168 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:06:50.671085 19450 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.3:36891, user_credentials={real_user=slave}} blocked reactor thread for 48773.1us
I20260709 13:06:50.672075 19450 leader_election.cc:304] T e381f1d6b8184797ad142de49be225a8 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e; no voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:06:50.671293 19409 raft_consensus.cc:1240] T 217b5fae677b4971b3bbd2f357a1f7ff P e5256d91808b47c195bc9b4dbd7f2b87 [term 13 FOLLOWER]: Rejecting Update request from peer 0473d2b2d01f4459b1e90fd12cc7840e for earlier term 12. Current term is 13. Ops: []
I20260709 13:06:50.675498 20076 leader_election.cc:304] T 48824d5acfbc485ebf8c2d944e7202de P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 127766fc592545a4997f7790f50f6076, e61c3a8f61bb48f8a963c9480e53c168; no voters: 0473d2b2d01f4459b1e90fd12cc7840e
I20260709 13:06:50.676025 19450 leader_election.cc:304] T 2b74109013a140ada21feeef92d6f563 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e; no voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168
W20260709 13:06:50.619078 25366 log.cc:927] Time spent T ed7fdbcb96d14d418db9ca90a792588a P 0473d2b2d01f4459b1e90fd12cc7840e: Append to log took a long time: real 0.314s	user 0.001s	sys 0.012s
I20260709 13:06:50.677031 20076 leader_election.cc:304] T 0afb57ae58a24a01850491d69f0213dd P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 127766fc592545a4997f7790f50f6076; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:06:50.678704 20103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4af19371ea874c09a0a2147040835cbb" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:06:50.685683 19449 leader_election.cc:304] T 172b3dd13109415a955b71ac0e9d2234 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e; no voters: 127766fc592545a4997f7790f50f6076, e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:06:50.681077 19557 raft_consensus.cc:2468] T ece3db938bc649d4a40a51522ed5259c P e61c3a8f61bb48f8a963c9480e53c168 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 127766fc592545a4997f7790f50f6076 in term 14.
I20260709 13:06:50.686725 19560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96efeaaf1057492490e9a621f37e1a2d" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 20 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:06:50.687964 19554 raft_consensus.cc:1275] T ece3db938bc649d4a40a51522ed5259c P e61c3a8f61bb48f8a963c9480e53c168 [term 14 FOLLOWER]: Refusing update from remote peer 127766fc592545a4997f7790f50f6076: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
W20260709 13:06:50.698612 20075 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:50.687199 19553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70797e5783b5454ab0d0eea663e791e3" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:06:50.706082 25332 raft_consensus.cc:2749] T e381f1d6b8184797ad142de49be225a8 P 0473d2b2d01f4459b1e90fd12cc7840e [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:06:50.706405 25285 raft_consensus.cc:493] T 62c6c134d3d24a1ab144dd9ee6bc3f64 P 127766fc592545a4997f7790f50f6076 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:50.706516 20109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7be9efa6559648dbb5a0f7684c4542d1" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:06:50.706895 25329 raft_consensus.cc:2804] T 2725d2c4cb054f18b0fc8f735c15f6c2 P 0473d2b2d01f4459b1e90fd12cc7840e [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:06:50.707389 20109 raft_consensus.cc:2393] T 7be9efa6559648dbb5a0f7684c4542d1 P 127766fc592545a4997f7790f50f6076 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e61c3a8f61bb48f8a963c9480e53c168 in current term 16: Already voted for candidate 127766fc592545a4997f7790f50f6076 in this term.
I20260709 13:06:50.707067 25285 raft_consensus.cc:515] T 62c6c134d3d24a1ab144dd9ee6bc3f64 P 127766fc592545a4997f7790f50f6076 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:50.619652 25337 raft_consensus.cc:515] T ef32ce6fdd0e40d382c79974f30295c6 P e61c3a8f61bb48f8a963c9480e53c168 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:50.709252 25285 leader_election.cc:290] T 62c6c134d3d24a1ab144dd9ee6bc3f64 P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:06:50.709435 25246 raft_consensus.cc:2749] T 172b3dd13109415a955b71ac0e9d2234 P 0473d2b2d01f4459b1e90fd12cc7840e [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:06:50.709939 25337 leader_election.cc:290] T ef32ce6fdd0e40d382c79974f30295c6 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 21 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:06:50.710006 19551 raft_consensus.cc:1240] T ef32ce6fdd0e40d382c79974f30295c6 P e61c3a8f61bb48f8a963c9480e53c168 [term 21 FOLLOWER]: Rejecting Update request from peer 0473d2b2d01f4459b1e90fd12cc7840e for earlier term 20. Current term is 21. Ops: [20.11-20.11]
I20260709 13:06:50.710704 25241 raft_consensus.cc:2804] T 48824d5acfbc485ebf8c2d944e7202de P e61c3a8f61bb48f8a963c9480e53c168 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:06:50.698652 25236 raft_consensus.cc:2804] T 48824d5acfbc485ebf8c2d944e7202de P 127766fc592545a4997f7790f50f6076 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:06:50.711113 25241 raft_consensus.cc:493] T 48824d5acfbc485ebf8c2d944e7202de P e61c3a8f61bb48f8a963c9480e53c168 [term 18 FOLLOWER]: Starting leader election (detected failure of leader 0473d2b2d01f4459b1e90fd12cc7840e)
I20260709 13:06:50.711527 25236 raft_consensus.cc:493] T 48824d5acfbc485ebf8c2d944e7202de P 127766fc592545a4997f7790f50f6076 [term 18 FOLLOWER]: Starting leader election (detected failure of leader 0473d2b2d01f4459b1e90fd12cc7840e)
I20260709 13:06:50.711660 25241 raft_consensus.cc:3060] T 48824d5acfbc485ebf8c2d944e7202de P e61c3a8f61bb48f8a963c9480e53c168 [term 18 FOLLOWER]: Advancing to term 19
W20260709 13:06:50.711810 19451 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:50.712704 25349 raft_consensus.cc:493] T a08760e15aac4630a629431f56024dc8 P 0473d2b2d01f4459b1e90fd12cc7840e [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:50.707401 25329 raft_consensus.cc:697] T 2725d2c4cb054f18b0fc8f735c15f6c2 P 0473d2b2d01f4459b1e90fd12cc7840e [term 19 LEADER]: Becoming Leader. State: Replica: 0473d2b2d01f4459b1e90fd12cc7840e, State: Running, Role: LEADER
I20260709 13:06:50.711962 25236 raft_consensus.cc:3060] T 48824d5acfbc485ebf8c2d944e7202de P 127766fc592545a4997f7790f50f6076 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:06:50.714332 25329 consensus_queue.cc:237] T 2725d2c4cb054f18b0fc8f735c15f6c2 P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 17.9, Last appended by leader: 9, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:50.670725 25369 raft_consensus.cc:2804] T fa8650e71aa14778b3d73721fc50d9fc P 0473d2b2d01f4459b1e90fd12cc7840e [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:06:50.711899 25333 raft_consensus.cc:493] T 775c229504194560ba9589bc2199b089 P 0473d2b2d01f4459b1e90fd12cc7840e [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 127766fc592545a4997f7790f50f6076)
I20260709 13:06:50.717370 25369 raft_consensus.cc:697] T fa8650e71aa14778b3d73721fc50d9fc P 0473d2b2d01f4459b1e90fd12cc7840e [term 17 LEADER]: Becoming Leader. State: Replica: 0473d2b2d01f4459b1e90fd12cc7840e, State: Running, Role: LEADER
I20260709 13:06:50.717494 25333 raft_consensus.cc:515] T 775c229504194560ba9589bc2199b089 P 0473d2b2d01f4459b1e90fd12cc7840e [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:50.718230 25369 consensus_queue.cc:237] T fa8650e71aa14778b3d73721fc50d9fc P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.8, Last appended by leader: 8, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
W20260709 13:06:50.719587 25389 log.cc:927] Time spent T ef32ce6fdd0e40d382c79974f30295c6 P e5256d91808b47c195bc9b4dbd7f2b87: Append to log took a long time: real 0.262s	user 0.000s	sys 0.000s
I20260709 13:06:50.719732 25333 leader_election.cc:290] T 775c229504194560ba9589bc2199b089 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:06:50.624332 25100 raft_consensus.cc:493] T 40e1e16737a842ee936002830f36882e P e5256d91808b47c195bc9b4dbd7f2b87 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:50.720966 25100 raft_consensus.cc:515] T 40e1e16737a842ee936002830f36882e P e5256d91808b47c195bc9b4dbd7f2b87 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:50.713249 25349 raft_consensus.cc:515] T a08760e15aac4630a629431f56024dc8 P 0473d2b2d01f4459b1e90fd12cc7840e [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
W20260709 13:06:50.724990 20076 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.3:36891, user_credentials={real_user=slave}} blocked reactor thread for 48058.8us
I20260709 13:06:50.725945 20076 leader_election.cc:304] T 1efebf73c86e432baa55533136b6e12c P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 127766fc592545a4997f7790f50f6076; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:06:50.601537 25373 raft_consensus.cc:2749] T 1a61655d99124a29b486ba4a5b37faea P 0473d2b2d01f4459b1e90fd12cc7840e [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:06:50.701840 19553 raft_consensus.cc:2468] T 70797e5783b5454ab0d0eea663e791e3 P e61c3a8f61bb48f8a963c9480e53c168 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 127766fc592545a4997f7790f50f6076 in term 18.
I20260709 13:06:50.703276 19449 leader_election.cc:304] T 28af091831594f9d8e96482078cc7625 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87; no voters: 
I20260709 13:06:50.601773 25304 raft_consensus.cc:493] T f93ee515a9c14139bf566522ed8232f3 P e5256d91808b47c195bc9b4dbd7f2b87 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader e61c3a8f61bb48f8a963c9480e53c168)
I20260709 13:06:50.729722 19449 leader_election.cc:304] T 46c5bfeecc314717bffe987e6844b6d0 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87; no voters: 
W20260709 13:06:50.730726 19450 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.3:36891, user_credentials={real_user=slave}} blocked reactor thread for 54818.3us
I20260709 13:06:50.736478 19450 leader_election.cc:304] T 40e1e16737a842ee936002830f36882e P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e; no voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:06:50.672106 25338 raft_consensus.cc:2804] T 86a6797bdfe94fa496c050ceae4bd0d9 P e61c3a8f61bb48f8a963c9480e53c168 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:06:50.738037 25376 raft_consensus.cc:2804] T 28af091831594f9d8e96482078cc7625 P 0473d2b2d01f4459b1e90fd12cc7840e [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:06:50.741675 25232 consensus_queue.cc:1048] T ece3db938bc649d4a40a51522ed5259c P 127766fc592545a4997f7790f50f6076 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:06:50.742496 20076 leader_election.cc:304] T 70797e5783b5454ab0d0eea663e791e3 P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 127766fc592545a4997f7790f50f6076, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:06:50.770319 19482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62c6c134d3d24a1ab144dd9ee6bc3f64" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:06:50.770364 19486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab43d85f64114d4ebf618930e43d9ed0" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:06:50.771039 19482 raft_consensus.cc:2468] T 62c6c134d3d24a1ab144dd9ee6bc3f64 P 0473d2b2d01f4459b1e90fd12cc7840e [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 15.
I20260709 13:06:50.771311 19486 raft_consensus.cc:2393] T ab43d85f64114d4ebf618930e43d9ed0 P 0473d2b2d01f4459b1e90fd12cc7840e [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e61c3a8f61bb48f8a963c9480e53c168 in current term 18: Already voted for candidate 0473d2b2d01f4459b1e90fd12cc7840e in this term.
I20260709 13:06:50.771451 25232 raft_consensus.cc:2804] T 70797e5783b5454ab0d0eea663e791e3 P 127766fc592545a4997f7790f50f6076 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:06:50.771812 25232 raft_consensus.cc:493] T 70797e5783b5454ab0d0eea663e791e3 P 127766fc592545a4997f7790f50f6076 [term 18 FOLLOWER]: Starting leader election (detected failure of leader e5256d91808b47c195bc9b4dbd7f2b87)
I20260709 13:06:50.771961 19484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a08760e15aac4630a629431f56024dc8" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:06:50.772111 19478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e1085d23e8347fbbd5bce7542f4b1f4" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:06:50.772293 25232 raft_consensus.cc:3060] T 70797e5783b5454ab0d0eea663e791e3 P 127766fc592545a4997f7790f50f6076 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:06:50.772717 19484 raft_consensus.cc:2393] T a08760e15aac4630a629431f56024dc8 P 0473d2b2d01f4459b1e90fd12cc7840e [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e61c3a8f61bb48f8a963c9480e53c168 in current term 20: Already voted for candidate 0473d2b2d01f4459b1e90fd12cc7840e in this term.
I20260709 13:06:50.773463 19481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1efebf73c86e432baa55533136b6e12c" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:06:50.744745 19552 raft_consensus.cc:2468] T ab43d85f64114d4ebf618930e43d9ed0 P e61c3a8f61bb48f8a963c9480e53c168 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 18.
I20260709 13:06:50.775553 19558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa731b585f684a7fb2d106c50f143b83" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:06:50.746243 25304 raft_consensus.cc:515] T f93ee515a9c14139bf566522ed8232f3 P e5256d91808b47c195bc9b4dbd7f2b87 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:50.747192 25311 raft_consensus.cc:3060] T 40e1e16737a842ee936002830f36882e P 0473d2b2d01f4459b1e90fd12cc7840e [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:06:50.747570 25373 raft_consensus.cc:2804] T 46c5bfeecc314717bffe987e6844b6d0 P 0473d2b2d01f4459b1e90fd12cc7840e [term 23 FOLLOWER]: Leader election won for term 23
I20260709 13:06:50.747838 19450 leader_election.cc:304] T f93ee515a9c14139bf566522ed8232f3 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e; no voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:06:50.749218 25345 consensus_queue.cc:1059] T 217b5fae677b4971b3bbd2f357a1f7ff P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 }, Status: INVALID_TERM, Last received: 12.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:06:50.691911 24824 raft_consensus.cc:493] T f1b10566f45d4a7d9029858330e02d5b P e5256d91808b47c195bc9b4dbd7f2b87 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:50.723054 25188 raft_consensus.cc:2804] T 6c5eebf646ad445a9d1b1adc319d7b16 P 0473d2b2d01f4459b1e90fd12cc7840e [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:06:50.601536 25388 consensus_queue.cc:1048] T 96efeaaf1057492490e9a621f37e1a2d P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Connected to new peer: Peer: permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.122s
I20260709 13:06:50.761726 19407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "775c229504194560ba9589bc2199b089" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:06:50.795238 19407 raft_consensus.cc:2393] T 775c229504194560ba9589bc2199b089 P e5256d91808b47c195bc9b4dbd7f2b87 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0473d2b2d01f4459b1e90fd12cc7840e in current term 12: Already voted for candidate e5256d91808b47c195bc9b4dbd7f2b87 in this term.
I20260709 13:06:50.764156 19406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a08760e15aac4630a629431f56024dc8" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:06:50.670179 24972 raft_consensus.cc:515] T 7be9efa6559648dbb5a0f7684c4542d1 P e5256d91808b47c195bc9b4dbd7f2b87 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } attrs { replace: true } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:50.767475 19480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1b10566f45d4a7d9029858330e02d5b" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:06:50.799626 19480 raft_consensus.cc:3060] T f1b10566f45d4a7d9029858330e02d5b P 0473d2b2d01f4459b1e90fd12cc7840e [term 15 FOLLOWER]: Advancing to term 17
I20260709 13:06:50.769033 19479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48824d5acfbc485ebf8c2d944e7202de" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:06:50.769397 19485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e36a9d6e29c4a7c860cf267efbd4c74" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:06:50.761723 25236 raft_consensus.cc:515] T 48824d5acfbc485ebf8c2d944e7202de P 127766fc592545a4997f7790f50f6076 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:50.773910 19478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a61655d99124a29b486ba4a5b37faea" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:06:50.776116 19558 raft_consensus.cc:3060] T fa731b585f684a7fb2d106c50f143b83 P e61c3a8f61bb48f8a963c9480e53c168 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:06:50.805917 19479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef32ce6fdd0e40d382c79974f30295c6" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 21 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:06:50.806077 19405 raft_consensus.cc:1275] T 2a16f7501e2444fb86d4e2778e734e02 P e5256d91808b47c195bc9b4dbd7f2b87 [term 16 FOLLOWER]: Refusing update from remote peer 127766fc592545a4997f7790f50f6076: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 13:06:50.775796 19555 raft_consensus.cc:1240] T ab43d85f64114d4ebf618930e43d9ed0 P e61c3a8f61bb48f8a963c9480e53c168 [term 18 FOLLOWER]: Rejecting Update request from peer 127766fc592545a4997f7790f50f6076 for earlier term 17. Current term is 18. Ops: []
I20260709 13:06:50.777221 20112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "775c229504194560ba9589bc2199b089" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:06:50.777808 19486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b74109013a140ada21feeef92d6f563" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:06:50.807299 24700 raft_consensus.cc:2764] T ab43d85f64114d4ebf618930e43d9ed0 P e61c3a8f61bb48f8a963c9480e53c168 [term 18 FOLLOWER]: Leader pre-election decision vote started in defunct term 17: won
I20260709 13:06:50.807955 19405 raft_consensus.cc:1275] T ece3db938bc649d4a40a51522ed5259c P e5256d91808b47c195bc9b4dbd7f2b87 [term 14 FOLLOWER]: Refusing update from remote peer 127766fc592545a4997f7790f50f6076: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 13:06:50.692122 25261 raft_consensus.cc:2749] T bc225c93219c45538b53a1bd3d387e4d P 0473d2b2d01f4459b1e90fd12cc7840e [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:06:50.807168 20112 raft_consensus.cc:2468] T 775c229504194560ba9589bc2199b089 P 127766fc592545a4997f7790f50f6076 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 12.
I20260709 13:06:50.784942 25338 raft_consensus.cc:697] T 86a6797bdfe94fa496c050ceae4bd0d9 P e61c3a8f61bb48f8a963c9480e53c168 [term 14 LEADER]: Becoming Leader. State: Replica: e61c3a8f61bb48f8a963c9480e53c168, State: Running, Role: LEADER
I20260709 13:06:50.780915 19450 leader_election.cc:304] T 14935b3ddf914369822e4a0547aaa355 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e; no voters: 127766fc592545a4997f7790f50f6076, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:06:50.781805 19481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22196caba61445d3bec98a0aab3c337d" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 17 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:06:50.770277 25376 raft_consensus.cc:493] T 28af091831594f9d8e96482078cc7625 P 0473d2b2d01f4459b1e90fd12cc7840e [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:50.738438 25332 raft_consensus.cc:2749] T 2b74109013a140ada21feeef92d6f563 P 0473d2b2d01f4459b1e90fd12cc7840e [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:06:50.662487 25386 consensus_queue.cc:1048] T 28af091831594f9d8e96482078cc7625 P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.116s
I20260709 13:06:50.795929 19406 raft_consensus.cc:2468] T a08760e15aac4630a629431f56024dc8 P e5256d91808b47c195bc9b4dbd7f2b87 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 20.
I20260709 13:06:50.763235 25349 leader_election.cc:290] T a08760e15aac4630a629431f56024dc8 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:06:50.765911 19483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa8650e71aa14778b3d73721fc50d9fc" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:06:50.796090 19484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0afb57ae58a24a01850491d69f0213dd" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:06:50.797842 19482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7be9efa6559648dbb5a0f7684c4542d1" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:06:50.857611 19482 raft_consensus.cc:2393] T 7be9efa6559648dbb5a0f7684c4542d1 P 0473d2b2d01f4459b1e90fd12cc7840e [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e61c3a8f61bb48f8a963c9480e53c168 in current term 16: Already voted for candidate 127766fc592545a4997f7790f50f6076 in this term.
I20260709 13:06:50.775667 25368 leader_election.cc:290] T fa731b585f684a7fb2d106c50f143b83 P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 14 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:06:50.787336 25246 raft_consensus.cc:2749] T f93ee515a9c14139bf566522ed8232f3 P 0473d2b2d01f4459b1e90fd12cc7840e [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:06:50.776544 19552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62c6c134d3d24a1ab144dd9ee6bc3f64" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:06:50.737877 25227 consensus_queue.cc:1048] T 2a16f7501e2444fb86d4e2778e734e02 P 127766fc592545a4997f7790f50f6076 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.057s
W20260709 13:06:50.780164 19375 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.591s	user 0.010s	sys 0.029s
W20260709 13:06:50.865218 19375 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.677s	user 0.010s	sys 0.029s
W20260709 13:06:50.865558 19375 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.3:36891, user_credentials={real_user=slave}} blocked reactor thread for 677025us
I20260709 13:06:50.809691 19405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70797e5783b5454ab0d0eea663e791e3" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:06:50.784875 25100 leader_election.cc:290] T 40e1e16737a842ee936002830f36882e P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:06:50.821348 19478 raft_consensus.cc:2393] T 1a61655d99124a29b486ba4a5b37faea P 0473d2b2d01f4459b1e90fd12cc7840e [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e61c3a8f61bb48f8a963c9480e53c168 in current term 15: Already voted for candidate 0473d2b2d01f4459b1e90fd12cc7840e in this term.
I20260709 13:06:50.844048 19526 leader_election.cc:304] T 62c6c134d3d24a1ab144dd9ee6bc3f64 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168; no voters: 127766fc592545a4997f7790f50f6076
I20260709 13:06:50.797410 25086 consensus_queue.cc:1048] T 96efeaaf1057492490e9a621f37e1a2d P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.062s
I20260709 13:06:50.800382 25341 raft_consensus.cc:493] T 65d8cb8d6ec64f459d5a47cefab10acf P e61c3a8f61bb48f8a963c9480e53c168 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 127766fc592545a4997f7790f50f6076)
I20260709 13:06:50.868534 20103 raft_consensus.cc:1240] T 48824d5acfbc485ebf8c2d944e7202de P 127766fc592545a4997f7790f50f6076 [term 19 FOLLOWER]: Rejecting Update request from peer 0473d2b2d01f4459b1e90fd12cc7840e for earlier term 18. Current term is 19. Ops: []
I20260709 13:06:50.871554 19408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "775c229504194560ba9589bc2199b089" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:06:50.882826 19408 raft_consensus.cc:2468] T 775c229504194560ba9589bc2199b089 P e5256d91808b47c195bc9b4dbd7f2b87 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 127766fc592545a4997f7790f50f6076 in term 12.
I20260709 13:06:50.873822 19407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36f6ba92b9ba46babe4ebd6c02e5fbd9" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
I20260709 13:06:50.875552 19526 leader_election.cc:304] T 0e1085d23e8347fbbd5bce7542f4b1f4 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e61c3a8f61bb48f8a963c9480e53c168; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, 127766fc592545a4997f7790f50f6076
I20260709 13:06:50.887200 19526 leader_election.cc:304] T 1efebf73c86e432baa55533136b6e12c P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e61c3a8f61bb48f8a963c9480e53c168; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, 127766fc592545a4997f7790f50f6076
I20260709 13:06:50.843191 25376 raft_consensus.cc:3060] T 28af091831594f9d8e96482078cc7625 P 0473d2b2d01f4459b1e90fd12cc7840e [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:06:50.877303 24702 raft_consensus.cc:2804] T 62c6c134d3d24a1ab144dd9ee6bc3f64 P e61c3a8f61bb48f8a963c9480e53c168 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:06:50.878122 19480 raft_consensus.cc:2468] T f1b10566f45d4a7d9029858330e02d5b P 0473d2b2d01f4459b1e90fd12cc7840e [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 17.
I20260709 13:06:50.879830 25397 raft_consensus.cc:2749] T 1efebf73c86e432baa55533136b6e12c P 127766fc592545a4997f7790f50f6076 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:06:50.800541 24824 raft_consensus.cc:515] T f1b10566f45d4a7d9029858330e02d5b P e5256d91808b47c195bc9b4dbd7f2b87 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:50.857900 25353 leader_election.cc:290] T fa731b585f684a7fb2d106c50f143b83 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 13 election: Requested vote from peers e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:06:50.909253 19375 leader_election.cc:304] T 0cdf56e38bbc453d9438d359e5a69955 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168; no voters: 0473d2b2d01f4459b1e90fd12cc7840e
W20260709 13:06:50.894942 19524 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:50.860999 25183 raft_consensus.cc:493] T 309c3ca0ca4b4f3ba129752ea2cb293b P e61c3a8f61bb48f8a963c9480e53c168 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:50.897957 19486 raft_consensus.cc:2468] T 2b74109013a140ada21feeef92d6f563 P 0473d2b2d01f4459b1e90fd12cc7840e [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 14.
I20260709 13:06:50.880275 25359 raft_consensus.cc:2749] T 0afb57ae58a24a01850491d69f0213dd P 127766fc592545a4997f7790f50f6076 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:06:50.905853 19407 raft_consensus.cc:2468] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P e5256d91808b47c195bc9b4dbd7f2b87 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 127766fc592545a4997f7790f50f6076 in term 18.
I20260709 13:06:50.915169 19558 raft_consensus.cc:2468] T fa731b585f684a7fb2d106c50f143b83 P e61c3a8f61bb48f8a963c9480e53c168 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 127766fc592545a4997f7790f50f6076 in term 14.
I20260709 13:06:50.920681 19375 leader_election.cc:304] T 1dc5b3532fe54f74876d02beffa2c230 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168; no voters: 0473d2b2d01f4459b1e90fd12cc7840e
I20260709 13:06:50.922813 20075 leader_election.cc:304] T 775c229504194560ba9589bc2199b089 P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 127766fc592545a4997f7790f50f6076, e5256d91808b47c195bc9b4dbd7f2b87; no voters: 
I20260709 13:06:50.893075 25337 raft_consensus.cc:2749] T 0e1085d23e8347fbbd5bce7542f4b1f4 P e61c3a8f61bb48f8a963c9480e53c168 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:06:50.921548 20076 leader_election.cc:304] T fa731b585f684a7fb2d106c50f143b83 P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 127766fc592545a4997f7790f50f6076, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:06:50.893493 24702 raft_consensus.cc:493] T 62c6c134d3d24a1ab144dd9ee6bc3f64 P e61c3a8f61bb48f8a963c9480e53c168 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 0473d2b2d01f4459b1e90fd12cc7840e)
I20260709 13:06:50.931093 19375 leader_election.cc:304] T b08304a0a02b42d7840c4e8ee9a6bd1a P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:06:50.933084 19408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa731b585f684a7fb2d106c50f143b83" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
I20260709 13:06:50.935652 19408 raft_consensus.cc:3060] T fa731b585f684a7fb2d106c50f143b83 P e5256d91808b47c195bc9b4dbd7f2b87 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:06:50.897686 25138 raft_consensus.cc:2749] T 1efebf73c86e432baa55533136b6e12c P e61c3a8f61bb48f8a963c9480e53c168 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:06:50.966992 19375 leader_election.cc:400] T 86a6797bdfe94fa496c050ceae4bd0d9 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 13 election: Vote denied by peer e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891) with higher term. Message: Invalid argument: T 86a6797bdfe94fa496c050ceae4bd0d9 P e61c3a8f61bb48f8a963c9480e53c168 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate e5256d91808b47c195bc9b4dbd7f2b87 for earlier term 13. Current term is 14.
I20260709 13:06:50.925801 25352 leader_election.cc:290] T 217b5fae677b4971b3bbd2f357a1f7ff P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 13 election: Requested vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:06:50.924592 25408 raft_consensus.cc:2804] T 0cdf56e38bbc453d9438d359e5a69955 P e5256d91808b47c195bc9b4dbd7f2b87 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:06:50.898910 25341 raft_consensus.cc:515] T 65d8cb8d6ec64f459d5a47cefab10acf P e61c3a8f61bb48f8a963c9480e53c168 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:50.924437 25368 consensus_queue.cc:1048] T 2a16f7501e2444fb86d4e2778e734e02 P 127766fc592545a4997f7790f50f6076 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.041s
I20260709 13:06:50.937163 24702 raft_consensus.cc:3060] T 62c6c134d3d24a1ab144dd9ee6bc3f64 P e61c3a8f61bb48f8a963c9480e53c168 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:06:50.936502 25370 raft_consensus.cc:2804] T 775c229504194560ba9589bc2199b089 P 127766fc592545a4997f7790f50f6076 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:06:50.969991 25188 raft_consensus.cc:697] T 6c5eebf646ad445a9d1b1adc319d7b16 P 0473d2b2d01f4459b1e90fd12cc7840e [term 18 LEADER]: Becoming Leader. State: Replica: 0473d2b2d01f4459b1e90fd12cc7840e, State: Running, Role: LEADER
I20260709 13:06:50.965866 25093 raft_consensus.cc:2804] T 1dc5b3532fe54f74876d02beffa2c230 P e5256d91808b47c195bc9b4dbd7f2b87 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:06:50.965742 25400 raft_consensus.cc:493] T 3e1f505cb0f1427bbd698ac889d80821 P e5256d91808b47c195bc9b4dbd7f2b87 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:50.969333 25305 raft_consensus.cc:3060] T b08304a0a02b42d7840c4e8ee9a6bd1a P e5256d91808b47c195bc9b4dbd7f2b87 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:06:50.927336 25298 consensus_queue.cc:1048] T ece3db938bc649d4a40a51522ed5259c P 127766fc592545a4997f7790f50f6076 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.039s
I20260709 13:06:50.981489 19552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28af091831594f9d8e96482078cc7625" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:06:50.960623 25367 raft_consensus.cc:2804] T fa731b585f684a7fb2d106c50f143b83 P 127766fc592545a4997f7790f50f6076 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:06:50.988361 19557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21e14947d70440f19044d8f75c31e1f9" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:06:51.006552 19558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40e1e16737a842ee936002830f36882e" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:06:50.988422 19559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a08760e15aac4630a629431f56024dc8" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:06:51.007006 19551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "217b5fae677b4971b3bbd2f357a1f7ff" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:06:51.007030 19557 raft_consensus.cc:3060] T 21e14947d70440f19044d8f75c31e1f9 P e61c3a8f61bb48f8a963c9480e53c168 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:06:51.007445 19559 raft_consensus.cc:2468] T a08760e15aac4630a629431f56024dc8 P e61c3a8f61bb48f8a963c9480e53c168 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 19.
I20260709 13:06:50.969372 25309 raft_consensus.cc:493] T edd7d470b5014c9489be7f41f64355c9 P e5256d91808b47c195bc9b4dbd7f2b87 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader e61c3a8f61bb48f8a963c9480e53c168)
I20260709 13:06:50.960820 25373 raft_consensus.cc:697] T 46c5bfeecc314717bffe987e6844b6d0 P 0473d2b2d01f4459b1e90fd12cc7840e [term 23 LEADER]: Becoming Leader. State: Replica: 0473d2b2d01f4459b1e90fd12cc7840e, State: Running, Role: LEADER
I20260709 13:06:50.972151 25408 raft_consensus.cc:493] T 0cdf56e38bbc453d9438d359e5a69955 P e5256d91808b47c195bc9b4dbd7f2b87 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 0473d2b2d01f4459b1e90fd12cc7840e)
I20260709 13:06:51.010721 19554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa731b585f684a7fb2d106c50f143b83" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:06:51.012327 19554 raft_consensus.cc:2368] T fa731b585f684a7fb2d106c50f143b83 P e61c3a8f61bb48f8a963c9480e53c168 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate e5256d91808b47c195bc9b4dbd7f2b87 for earlier term 13. Current term is 14.
I20260709 13:06:50.978709 25370 raft_consensus.cc:493] T 775c229504194560ba9589bc2199b089 P 127766fc592545a4997f7790f50f6076 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:50.989880 25093 raft_consensus.cc:493] T 1dc5b3532fe54f74876d02beffa2c230 P e5256d91808b47c195bc9b4dbd7f2b87 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 0473d2b2d01f4459b1e90fd12cc7840e)
I20260709 13:06:51.022399 19408 raft_consensus.cc:2468] T fa731b585f684a7fb2d106c50f143b83 P e5256d91808b47c195bc9b4dbd7f2b87 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 127766fc592545a4997f7790f50f6076 in term 14.
I20260709 13:06:50.941923 25338 consensus_queue.cc:237] T 86a6797bdfe94fa496c050ceae4bd0d9 P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 12.6, Last appended by leader: 6, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:51.020601 25396 raft_consensus.cc:493] T 2a16f7501e2444fb86d4e2778e734e02 P e5256d91808b47c195bc9b4dbd7f2b87 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:51.036687 19407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b08304a0a02b42d7840c4e8ee9a6bd1a" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
I20260709 13:06:51.031037 19557 raft_consensus.cc:2468] T 21e14947d70440f19044d8f75c31e1f9 P e61c3a8f61bb48f8a963c9480e53c168 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 17.
I20260709 13:06:51.036942 19406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86a6797bdfe94fa496c050ceae4bd0d9" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
I20260709 13:06:51.041692 19410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa8650e71aa14778b3d73721fc50d9fc" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:06:51.008308 25411 raft_consensus.cc:493] T 4509b76741dc428e9201c70c1658da13 P e61c3a8f61bb48f8a963c9480e53c168 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader e5256d91808b47c195bc9b4dbd7f2b87)
I20260709 13:06:51.013270 25367 raft_consensus.cc:697] T fa731b585f684a7fb2d106c50f143b83 P 127766fc592545a4997f7790f50f6076 [term 14 LEADER]: Becoming Leader. State: Replica: 127766fc592545a4997f7790f50f6076, State: Running, Role: LEADER
I20260709 13:06:51.048326 19410 raft_consensus.cc:2393] T fa8650e71aa14778b3d73721fc50d9fc P e5256d91808b47c195bc9b4dbd7f2b87 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e61c3a8f61bb48f8a963c9480e53c168 in current term 17: Already voted for candidate 0473d2b2d01f4459b1e90fd12cc7840e in this term.
I20260709 13:06:51.022177 25370 raft_consensus.cc:3060] T 775c229504194560ba9589bc2199b089 P 127766fc592545a4997f7790f50f6076 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:06:51.050837 19408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "179fd671030940b4b4a4e24bcc4aba0a" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:06:51.053418 19404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76cb037fc9064d13b59a8969d897ce8c" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 16 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
I20260709 13:06:51.054463 19409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2725d2c4cb054f18b0fc8f735c15f6c2" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:06:51.024056 25304 leader_election.cc:290] T f93ee515a9c14139bf566522ed8232f3 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:06:50.927168 25100 consensus_queue.cc:1048] T 2b74109013a140ada21feeef92d6f563 P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.112s
I20260709 13:06:51.013512 25408 raft_consensus.cc:3060] T 0cdf56e38bbc453d9438d359e5a69955 P e5256d91808b47c195bc9b4dbd7f2b87 [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:06:51.038764 25384 log.cc:927] Time spent T 00000000000000000000000000000000 P 97750b77d35444acb7791ebf26cc2685: Append to log took a long time: real 0.367s	user 0.002s	sys 0.000s
W20260709 13:06:51.123781 25406 log.cc:927] Time spent T df751f992649444090e27965eb1af85d P e61c3a8f61bb48f8a963c9480e53c168: Append to log took a long time: real 0.198s	user 0.002s	sys 0.000s
I20260709 13:06:51.059122 19409 raft_consensus.cc:2393] T 2725d2c4cb054f18b0fc8f735c15f6c2 P e5256d91808b47c195bc9b4dbd7f2b87 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e61c3a8f61bb48f8a963c9480e53c168 in current term 19: Already voted for candidate 0473d2b2d01f4459b1e90fd12cc7840e in this term.
I20260709 13:06:51.127400 19409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b74109013a140ada21feeef92d6f563" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:06:51.128480 19409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "833a2f0775ed407a94b8924ce50adb63" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:06:51.129658 19409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7be9efa6559648dbb5a0f7684c4542d1" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:06:51.130287 19409 raft_consensus.cc:2368] T 7be9efa6559648dbb5a0f7684c4542d1 P e5256d91808b47c195bc9b4dbd7f2b87 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e61c3a8f61bb48f8a963c9480e53c168 for earlier term 16. Current term is 17.
I20260709 13:06:51.024972 25093 raft_consensus.cc:3060] T 1dc5b3532fe54f74876d02beffa2c230 P e5256d91808b47c195bc9b4dbd7f2b87 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:06:51.002748 25400 raft_consensus.cc:515] T 3e1f505cb0f1427bbd698ac889d80821 P e5256d91808b47c195bc9b4dbd7f2b87 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:51.069839 25236 leader_election.cc:290] T 48824d5acfbc485ebf8c2d944e7202de P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 19 election: Requested vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:06:51.058380 19411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a16f7501e2444fb86d4e2778e734e02" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:06:51.071410 19404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1b10566f45d4a7d9029858330e02d5b" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
I20260709 13:06:51.132992 19404 raft_consensus.cc:3060] T f1b10566f45d4a7d9029858330e02d5b P e5256d91808b47c195bc9b4dbd7f2b87 [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:06:51.079363 25407 log.cc:927] Time spent T d1e5873a19244c5ebbcd38e126796ee7 P e61c3a8f61bb48f8a963c9480e53c168: Append to log took a long time: real 0.114s	user 0.000s	sys 0.000s
W20260709 13:06:51.080263 25410 log.cc:927] Time spent T 46c5bfeecc314717bffe987e6844b6d0 P e61c3a8f61bb48f8a963c9480e53c168: Append to log took a long time: real 0.067s	user 0.000s	sys 0.000s
W20260709 13:06:51.080935 25405 log.cc:927] Time spent T 1f85fc4b527a48848e5faa083b604e36 P 0473d2b2d01f4459b1e90fd12cc7840e: Append to log took a long time: real 0.153s	user 0.000s	sys 0.001s
I20260709 13:06:51.086357 25311 raft_consensus.cc:2749] T 40e1e16737a842ee936002830f36882e P 0473d2b2d01f4459b1e90fd12cc7840e [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:06:51.087567 25341 leader_election.cc:290] T 65d8cb8d6ec64f459d5a47cefab10acf P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:06:51.088877 25367 consensus_queue.cc:237] T fa731b585f684a7fb2d106c50f143b83 P 127766fc592545a4997f7790f50f6076 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:51.092408 24972 leader_election.cc:290] T 7be9efa6559648dbb5a0f7684c4542d1 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 17 election: Requested vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:06:50.933990 25183 raft_consensus.cc:515] T 309c3ca0ca4b4f3ba129752ea2cb293b P e61c3a8f61bb48f8a963c9480e53c168 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } attrs { replace: true } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:51.021215 25309 raft_consensus.cc:515] T edd7d470b5014c9489be7f41f64355c9 P e5256d91808b47c195bc9b4dbd7f2b87 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:51.109074 25403 raft_consensus.cc:493] T ece3db938bc649d4a40a51522ed5259c P e5256d91808b47c195bc9b4dbd7f2b87 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:51.058873 25188 consensus_queue.cc:237] T 6c5eebf646ad445a9d1b1adc319d7b16 P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.12, Last appended by leader: 12, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:51.111227 25308 raft_consensus.cc:3055] T f93ee515a9c14139bf566522ed8232f3 P e61c3a8f61bb48f8a963c9480e53c168 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:06:51.113541 20075 leader_election.cc:304] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 127766fc592545a4997f7790f50f6076, e5256d91808b47c195bc9b4dbd7f2b87; no voters: 
W20260709 13:06:51.169919 20075 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.1:40321, user_credentials={real_user=slave}} blocked reactor thread for 56460.7us
I20260709 13:06:51.116008 19406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e36a9d6e29c4a7c860cf267efbd4c74" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
I20260709 13:06:51.116536 19402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70797e5783b5454ab0d0eea663e791e3" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:06:51.119009 19407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a08760e15aac4630a629431f56024dc8" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:06:51.171973 19406 raft_consensus.cc:2368] T 2e36a9d6e29c4a7c860cf267efbd4c74 P e5256d91808b47c195bc9b4dbd7f2b87 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate e61c3a8f61bb48f8a963c9480e53c168 for earlier term 12. Current term is 13.
I20260709 13:06:51.172030 19407 raft_consensus.cc:2468] T a08760e15aac4630a629431f56024dc8 P e5256d91808b47c195bc9b4dbd7f2b87 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 20.
I20260709 13:06:51.173086 19407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4af19371ea874c09a0a2147040835cbb" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:06:51.057835 25411 raft_consensus.cc:515] T 4509b76741dc428e9201c70c1658da13 P e61c3a8f61bb48f8a963c9480e53c168 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:51.120630 25241 raft_consensus.cc:515] T 48824d5acfbc485ebf8c2d944e7202de P e61c3a8f61bb48f8a963c9480e53c168 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:51.049335 25396 raft_consensus.cc:515] T 2a16f7501e2444fb86d4e2778e734e02 P e5256d91808b47c195bc9b4dbd7f2b87 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:51.143949 19410 raft_consensus.cc:1275] T 28af091831594f9d8e96482078cc7625 P e5256d91808b47c195bc9b4dbd7f2b87 [term 17 FOLLOWER]: Refusing update from remote peer e61c3a8f61bb48f8a963c9480e53c168: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
I20260709 13:06:51.145638 19523 leader_election.cc:304] T b08304a0a02b42d7840c4e8ee9a6bd1a P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e61c3a8f61bb48f8a963c9480e53c168; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:06:51.146858 19557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f93ee515a9c14139bf566522ed8232f3" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 19 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:06:51.200433 19557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1b10566f45d4a7d9029858330e02d5b" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:06:51.201468 19557 raft_consensus.cc:2393] T f1b10566f45d4a7d9029858330e02d5b P e61c3a8f61bb48f8a963c9480e53c168 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e5256d91808b47c195bc9b4dbd7f2b87 in current term 17: Already voted for candidate e61c3a8f61bb48f8a963c9480e53c168 in this term.
I20260709 13:06:51.147274 19560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7be9efa6559648dbb5a0f7684c4542d1" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:06:51.202136 19560 raft_consensus.cc:3060] T 7be9efa6559648dbb5a0f7684c4542d1 P e61c3a8f61bb48f8a963c9480e53c168 [term 15 FOLLOWER]: Advancing to term 17
I20260709 13:06:51.150995 19409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef32ce6fdd0e40d382c79974f30295c6" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 21 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
W20260709 13:06:51.090287 25409 log.cc:927] Time spent T 86a6797bdfe94fa496c050ceae4bd0d9 P e5256d91808b47c195bc9b4dbd7f2b87: Append to log took a long time: real 0.108s	user 0.000s	sys 0.000s
I20260709 13:06:51.207206 19410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a61655d99124a29b486ba4a5b37faea" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:06:51.207857 19410 raft_consensus.cc:2468] T 1a61655d99124a29b486ba4a5b37faea P e5256d91808b47c195bc9b4dbd7f2b87 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 15.
I20260709 13:06:51.156056 19375 leader_election.cc:304] T a08760e15aac4630a629431f56024dc8 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:06:51.163513 19485 raft_consensus.cc:1275] T 40e1e16737a842ee936002830f36882e P 0473d2b2d01f4459b1e90fd12cc7840e [term 18 FOLLOWER]: Refusing update from remote peer e61c3a8f61bb48f8a963c9480e53c168: Log matching property violated. Preceding OpId in replica: term: 17 index: 9. Preceding OpId from leader: term: 18 index: 10. (index mismatch)
I20260709 13:06:51.167389 19404 raft_consensus.cc:2468] T f1b10566f45d4a7d9029858330e02d5b P e5256d91808b47c195bc9b4dbd7f2b87 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 17.
I20260709 13:06:51.086357 25232 raft_consensus.cc:515] T 70797e5783b5454ab0d0eea663e791e3 P 127766fc592545a4997f7790f50f6076 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
W20260709 13:06:51.212116 19523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.1:40321, user_credentials={real_user=slave}} blocked reactor thread for 66584.5us
W20260709 13:06:51.212666 20075 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:51.174515 19407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22196caba61445d3bec98a0aab3c337d" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 17 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
W20260709 13:06:51.211229 19375 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.3:36891, user_credentials={real_user=slave}} blocked reactor thread for 55231us
I20260709 13:06:51.213367 19523 leader_election.cc:304] T 76cb037fc9064d13b59a8969d897ce8c P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e61c3a8f61bb48f8a963c9480e53c168; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:06:51.216413 19404 raft_consensus.cc:1275] T d1e5873a19244c5ebbcd38e126796ee7 P e5256d91808b47c195bc9b4dbd7f2b87 [term 19 FOLLOWER]: Refusing update from remote peer e61c3a8f61bb48f8a963c9480e53c168: Log matching property violated. Preceding OpId in replica: term: 17 index: 9. Preceding OpId from leader: term: 19 index: 10. (index mismatch)
I20260709 13:06:51.218405 19410 raft_consensus.cc:1275] T 40e1e16737a842ee936002830f36882e P e5256d91808b47c195bc9b4dbd7f2b87 [term 18 FOLLOWER]: Refusing update from remote peer e61c3a8f61bb48f8a963c9480e53c168: Log matching property violated. Preceding OpId in replica: term: 17 index: 9. Preceding OpId from leader: term: 18 index: 10. (index mismatch)
I20260709 13:06:51.219101 19403 raft_consensus.cc:1240] T 7f575b143b844aa096b50997dad3516a P e5256d91808b47c195bc9b4dbd7f2b87 [term 14 LEADER]: Rejecting Update request from peer e61c3a8f61bb48f8a963c9480e53c168 for earlier term 13. Current term is 14. Ops: [13.10-13.10]
I20260709 13:06:51.219744 19557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e1f505cb0f1427bbd698ac889d80821" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:06:51.150221 24702 raft_consensus.cc:515] T 62c6c134d3d24a1ab144dd9ee6bc3f64 P e61c3a8f61bb48f8a963c9480e53c168 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
W20260709 13:06:51.243369 25237 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.532s	user 0.007s	sys 0.012s
W20260709 13:06:51.244926 25237 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.534s	user 0.008s	sys 0.012s
I20260709 13:06:51.229224 19375 leader_election.cc:400] T fa731b585f684a7fb2d106c50f143b83 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 13 election: Vote denied by peer e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891) with higher term. Message: Invalid argument: T fa731b585f684a7fb2d106c50f143b83 P e61c3a8f61bb48f8a963c9480e53c168 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate e5256d91808b47c195bc9b4dbd7f2b87 for earlier term 13. Current term is 14.
I20260709 13:06:51.245599 19375 leader_election.cc:403] T fa731b585f684a7fb2d106c50f143b83 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 13 election: Cancelling election due to peer responding with higher term
I20260709 13:06:51.168777 25308 raft_consensus.cc:740] T f93ee515a9c14139bf566522ed8232f3 P e61c3a8f61bb48f8a963c9480e53c168 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: e61c3a8f61bb48f8a963c9480e53c168, State: Running, Role: LEADER
W20260709 13:06:51.256035 20077 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:51.258421 19523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.1:40321, user_credentials={real_user=slave}} blocked reactor thread for 45122.8us
I20260709 13:06:51.259538 19523 leader_election.cc:304] T 179fd671030940b4b4a4e24bcc4aba0a P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e61c3a8f61bb48f8a963c9480e53c168; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:06:51.260740 19523 leader_election.cc:304] T 2725d2c4cb054f18b0fc8f735c15f6c2 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e61c3a8f61bb48f8a963c9480e53c168; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:06:51.262089 19411 raft_consensus.cc:2468] T 2a16f7501e2444fb86d4e2778e734e02 P e5256d91808b47c195bc9b4dbd7f2b87 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 16.
I20260709 13:06:51.263684 19523 leader_election.cc:304] T 833a2f0775ed407a94b8924ce50adb63 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e61c3a8f61bb48f8a963c9480e53c168; no voters: 127766fc592545a4997f7790f50f6076, e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:06:51.267706 19560 raft_consensus.cc:2468] T 7be9efa6559648dbb5a0f7684c4542d1 P e61c3a8f61bb48f8a963c9480e53c168 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 17.
I20260709 13:06:51.273518 19405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65d8cb8d6ec64f459d5a47cefab10acf" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:06:51.265027 19375 leader_election.cc:304] T 21e14947d70440f19044d8f75c31e1f9 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:06:51.274847 24700 raft_consensus.cc:2749] T 2725d2c4cb054f18b0fc8f735c15f6c2 P e61c3a8f61bb48f8a963c9480e53c168 [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:06:51.199405 25359 raft_consensus.cc:2804] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P 127766fc592545a4997f7790f50f6076 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:06:51.277743 20103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65d8cb8d6ec64f459d5a47cefab10acf" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:06:51.278522 20112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "172b3dd13109415a955b71ac0e9d2234" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076"
I20260709 13:06:51.281338 25086 raft_consensus.cc:2749] T 833a2f0775ed407a94b8924ce50adb63 P e61c3a8f61bb48f8a963c9480e53c168 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:06:51.281915 19523 leader_election.cc:400] T 7be9efa6559648dbb5a0f7684c4542d1 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 16 pre-election: Vote denied by peer e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321) with higher term. Message: Invalid argument: T 7be9efa6559648dbb5a0f7684c4542d1 P e5256d91808b47c195bc9b4dbd7f2b87 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e61c3a8f61bb48f8a963c9480e53c168 for earlier term 16. Current term is 17.
I20260709 13:06:51.207365 25400 leader_election.cc:290] T 3e1f505cb0f1427bbd698ac889d80821 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
W20260709 13:06:51.286118 19449 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.1:40321, user_credentials={real_user=slave}} blocked reactor thread for 417714us
W20260709 13:06:51.224176 25329 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.502s	user 0.012s	sys 0.001s
I20260709 13:06:51.289276 20104 raft_consensus.cc:1240] T 70797e5783b5454ab0d0eea663e791e3 P 127766fc592545a4997f7790f50f6076 [term 19 FOLLOWER]: Rejecting Update request from peer e5256d91808b47c195bc9b4dbd7f2b87 for earlier term 18. Current term is 19. Ops: []
W20260709 13:06:51.289654 19524 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:51.215653 25100 raft_consensus.cc:2804] T a08760e15aac4630a629431f56024dc8 P e5256d91808b47c195bc9b4dbd7f2b87 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:06:51.303331 20110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa731b585f684a7fb2d106c50f143b83" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076"
I20260709 13:06:51.219224 25388 raft_consensus.cc:2749] T b08304a0a02b42d7840c4e8ee9a6bd1a P e61c3a8f61bb48f8a963c9480e53c168 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:06:51.306484 20107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7be9efa6559648dbb5a0f7684c4542d1" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076"
I20260709 13:06:51.384394 20107 raft_consensus.cc:3060] T 7be9efa6559648dbb5a0f7684c4542d1 P 127766fc592545a4997f7790f50f6076 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:06:51.274781 25056 raft_consensus.cc:2749] T fa731b585f684a7fb2d106c50f143b83 P e5256d91808b47c195bc9b4dbd7f2b87 [term 14 FOLLOWER]: Leader election lost for term 13. Reason: Vote denied by peer e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891) with higher term. Message: Invalid argument: T fa731b585f684a7fb2d106c50f143b83 P e61c3a8f61bb48f8a963c9480e53c168 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate e5256d91808b47c195bc9b4dbd7f2b87 for earlier term 13. Current term is 14.
W20260709 13:06:51.311167 25405 log.cc:927] Time spent T 1f85fc4b527a48848e5faa083b604e36 P 0473d2b2d01f4459b1e90fd12cc7840e: Append to log took a long time: real 0.062s	user 0.000s	sys 0.000s
W20260709 13:06:51.319940 20075 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.1:40321, user_credentials={real_user=slave}} blocked reactor thread for 46097.8us
I20260709 13:06:51.168542 25403 raft_consensus.cc:515] T ece3db938bc649d4a40a51522ed5259c P e5256d91808b47c195bc9b4dbd7f2b87 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:51.282402 25310 raft_consensus.cc:2749] T 76cb037fc9064d13b59a8969d897ce8c P e61c3a8f61bb48f8a963c9480e53c168 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:06:51.373278 19523 leader_election.cc:403] T 7be9efa6559648dbb5a0f7684c4542d1 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 16 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:06:51.286711 25095 raft_consensus.cc:2749] T 179fd671030940b4b4a4e24bcc4aba0a P e61c3a8f61bb48f8a963c9480e53c168 [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:06:51.282837 25097 raft_consensus.cc:3055] T 217b5fae677b4971b3bbd2f357a1f7ff P 0473d2b2d01f4459b1e90fd12cc7840e [term 12 LEADER]: Stepping down as leader of term 12
W20260709 13:06:51.375527 19374 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.4:43121, user_credentials={real_user=slave}} blocked reactor thread for 67385.2us
I20260709 13:06:51.291244 25332 raft_consensus.cc:2749] T 14935b3ddf914369822e4a0547aaa355 P 0473d2b2d01f4459b1e90fd12cc7840e [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:06:51.169013 25373 consensus_queue.cc:237] T 46c5bfeecc314717bffe987e6844b6d0 P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 21.11, Last appended by leader: 11, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
W20260709 13:06:51.385144 19375 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.3:36891, user_credentials={real_user=slave}} blocked reactor thread for 120192us
I20260709 13:06:51.288136 25397 raft_consensus.cc:493] T 1f85fc4b527a48848e5faa083b604e36 P 127766fc592545a4997f7790f50f6076 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader e5256d91808b47c195bc9b4dbd7f2b87)
I20260709 13:06:51.376976 19449 leader_election.cc:304] T a08760e15aac4630a629431f56024dc8 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87; no voters: 
W20260709 13:06:51.416353 19523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.1:40321, user_credentials={real_user=slave}} blocked reactor thread for 134577us
I20260709 13:06:51.434198 19523 leader_election.cc:304] T a08760e15aac4630a629431f56024dc8 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168; no voters: 0473d2b2d01f4459b1e90fd12cc7840e
W20260709 13:06:51.378721 25329 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.657s	user 0.013s	sys 0.001s
W20260709 13:06:51.420866 19450 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.3:36891, user_credentials={real_user=slave}} blocked reactor thread for 640017us
I20260709 13:06:51.384282 25100 raft_consensus.cc:493] T a08760e15aac4630a629431f56024dc8 P e5256d91808b47c195bc9b4dbd7f2b87 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:51.443920 19450 leader_election.cc:304] T 0e1085d23e8347fbbd5bce7542f4b1f4 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168; no voters: 127766fc592545a4997f7790f50f6076
I20260709 13:06:51.446604 20107 raft_consensus.cc:2468] T 7be9efa6559648dbb5a0f7684c4542d1 P 127766fc592545a4997f7790f50f6076 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 17.
I20260709 13:06:51.426365 25305 raft_consensus.cc:2749] T b08304a0a02b42d7840c4e8ee9a6bd1a P e5256d91808b47c195bc9b4dbd7f2b87 [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:06:51.452010 24700 raft_consensus.cc:2804] T a08760e15aac4630a629431f56024dc8 P e61c3a8f61bb48f8a963c9480e53c168 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:06:51.515900 24700 raft_consensus.cc:493] T a08760e15aac4630a629431f56024dc8 P e61c3a8f61bb48f8a963c9480e53c168 [term 19 FOLLOWER]: Starting leader election (detected failure of leader e5256d91808b47c195bc9b4dbd7f2b87)
I20260709 13:06:51.516326 24700 raft_consensus.cc:3060] T a08760e15aac4630a629431f56024dc8 P e61c3a8f61bb48f8a963c9480e53c168 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:06:51.411733 25400 raft_consensus.cc:2804] T 21e14947d70440f19044d8f75c31e1f9 P e5256d91808b47c195bc9b4dbd7f2b87 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:06:51.451858 19523 leader_election.cc:304] T 4af19371ea874c09a0a2147040835cbb P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e61c3a8f61bb48f8a963c9480e53c168; no voters: 127766fc592545a4997f7790f50f6076, e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:06:51.412879 25298 raft_consensus.cc:493] T 5ec1c4ce15e04c7e8c283a62179f2a64 P 127766fc592545a4997f7790f50f6076 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader e5256d91808b47c195bc9b4dbd7f2b87)
I20260709 13:06:51.419049 25388 raft_consensus.cc:2749] T 7be9efa6559648dbb5a0f7684c4542d1 P e61c3a8f61bb48f8a963c9480e53c168 [term 17 FOLLOWER]: Leader pre-election lost for term 16. Reason: Vote denied by peer e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321) with higher term. Message: Invalid argument: T 7be9efa6559648dbb5a0f7684c4542d1 P e5256d91808b47c195bc9b4dbd7f2b87 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e61c3a8f61bb48f8a963c9480e53c168 for earlier term 16. Current term is 17.
I20260709 13:06:51.415398 25097 raft_consensus.cc:740] T 217b5fae677b4971b3bbd2f357a1f7ff P 0473d2b2d01f4459b1e90fd12cc7840e [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 0473d2b2d01f4459b1e90fd12cc7840e, State: Running, Role: LEADER
I20260709 13:06:51.449786 25100 raft_consensus.cc:3060] T a08760e15aac4630a629431f56024dc8 P e5256d91808b47c195bc9b4dbd7f2b87 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:06:51.533998 19403 raft_consensus.cc:1275] T df751f992649444090e27965eb1af85d P e5256d91808b47c195bc9b4dbd7f2b87 [term 20 FOLLOWER]: Refusing update from remote peer e61c3a8f61bb48f8a963c9480e53c168: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 20 index: 13. (index mismatch)
I20260709 13:06:51.535359 19403 raft_consensus.cc:1240] T 46c5bfeecc314717bffe987e6844b6d0 P e5256d91808b47c195bc9b4dbd7f2b87 [term 23 FOLLOWER]: Rejecting Update request from peer e61c3a8f61bb48f8a963c9480e53c168 for earlier term 22. Current term is 23. Ops: []
I20260709 13:06:51.539594 25309 leader_election.cc:290] T edd7d470b5014c9489be7f41f64355c9 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:06:51.518783 25370 raft_consensus.cc:515] T 775c229504194560ba9589bc2199b089 P 127766fc592545a4997f7790f50f6076 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:51.542402 25403 leader_election.cc:290] T ece3db938bc649d4a40a51522ed5259c P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:06:51.546444 25403 raft_consensus.cc:493] T ef32ce6fdd0e40d382c79974f30295c6 P e5256d91808b47c195bc9b4dbd7f2b87 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 0473d2b2d01f4459b1e90fd12cc7840e)
I20260709 13:06:51.524893 25095 raft_consensus.cc:2749] T 4af19371ea874c09a0a2147040835cbb P e61c3a8f61bb48f8a963c9480e53c168 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:06:51.548189 19450 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.3:36891, user_credentials={real_user=slave}} blocked reactor thread for 104353us
I20260709 13:06:51.546788 19477 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58294 (request call id 2732) took 1359 ms. Trace:
W20260709 13:06:51.546854 19449 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.1:40321, user_credentials={real_user=slave}} blocked reactor thread for 169957us
I20260709 13:06:51.551714 24700 raft_consensus.cc:515] T a08760e15aac4630a629431f56024dc8 P e61c3a8f61bb48f8a963c9480e53c168 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:51.517246 25308 consensus_queue.cc:260] T f93ee515a9c14139bf566522ed8232f3 P e61c3a8f61bb48f8a963c9480e53c168 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 18.9, Last appended by leader: 9, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
W20260709 13:06:51.522660 19523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.1:40321, user_credentials={real_user=slave}} blocked reactor thread for 70864.9us
I20260709 13:06:51.557081 19450 leader_election.cc:400] T f1b10566f45d4a7d9029858330e02d5b P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 16 pre-election: Vote denied by peer e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891) with higher term. Message: Invalid argument: T f1b10566f45d4a7d9029858330e02d5b P e61c3a8f61bb48f8a963c9480e53c168 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0473d2b2d01f4459b1e90fd12cc7840e for earlier term 16. Current term is 17.
I20260709 13:06:51.561615 19450 leader_election.cc:403] T f1b10566f45d4a7d9029858330e02d5b P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 16 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:06:51.562256 19523 leader_election.cc:304] T 70797e5783b5454ab0d0eea663e791e3 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e61c3a8f61bb48f8a963c9480e53c168; no voters: 127766fc592545a4997f7790f50f6076, e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:06:51.554940 19477 rpcz_store.cc:276] 0709 13:06:50.170163 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:50.222519 (+ 52356us) service_pool.cc:224] Handling call
0709 13:06:50.245200 (+ 22681us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:50.399964 (+154764us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:50.400019 (+    55us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:50.440446 (+ 40427us) log.cc:844] Serialized 26 byte log entry
0709 13:06:50.778464 (+338018us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:06:50.800960 (+ 22496us) log.cc:844] Serialized 14 byte log entry
0709 13:06:51.253257 (+452297us) spinlock_profiling.cc:243] Waited 10 ms on lock 0x7b1800139ba0. stack: 00007f4a79de9343 00007f4a79de9240 00007f4a797781d4 00007f4a834b6304 00007f4a834b6299 00007f4a82ce3de1 00007f4a82cf05b1 00007f4a79d95c0a 00007f4a834d5219 00007f4a79e1da40 00007f4a79e184e4 00007f4a79e18455 00007f4a7cf00060 00007f4a7cf12716 00007f4a7cf23287 00007f4a7cf23208
0709 13:06:51.385936 (+132679us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:51.386007 (+    71us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:51.525684 (+139677us) raft_consensus.cc:1685] finished
0709 13:06:51.529648 (+  3964us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:51.529786 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":370901,"prepare.queue_time_us":25020,"prepare.run_cpu_time_us":34,"prepare.run_wall_time_us":36,"raft.queue_time_us":637623,"raft.run_cpu_time_us":222,"raft.run_wall_time_us":15523,"spinlock_wait_cycles":23063808,"thread_start_us":439854,"threads_started":2,"wal-append.queue_time_us":395895}
W20260709 13:06:51.566433 19375 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.3:36891, user_credentials={real_user=slave}} blocked reactor thread for 146913us
I20260709 13:06:51.566927 20107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ece3db938bc649d4a40a51522ed5259c" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:06:51.570171 19523 leader_election.cc:400] T 2e36a9d6e29c4a7c860cf267efbd4c74 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 12 election: Vote denied by peer e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321) with higher term. Message: Invalid argument: T 2e36a9d6e29c4a7c860cf267efbd4c74 P e5256d91808b47c195bc9b4dbd7f2b87 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate e61c3a8f61bb48f8a963c9480e53c168 for earlier term 12. Current term is 13.
I20260709 13:06:51.570509 19523 leader_election.cc:403] T 2e36a9d6e29c4a7c860cf267efbd4c74 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 12 election: Cancelling election due to peer responding with higher term
I20260709 13:06:51.517401 25404 consensus_queue.cc:1059] T 70797e5783b5454ab0d0eea663e791e3 P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false }, Status: INVALID_TERM, Last received: 18.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.044s
I20260709 13:06:51.454044 25397 raft_consensus.cc:515] T 1f85fc4b527a48848e5faa083b604e36 P 127766fc592545a4997f7790f50f6076 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:51.571280 24700 leader_election.cc:290] T a08760e15aac4630a629431f56024dc8 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 20 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:06:51.576445 19403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "775c229504194560ba9589bc2199b089" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
I20260709 13:06:51.580108 19403 raft_consensus.cc:3060] T 775c229504194560ba9589bc2199b089 P e5256d91808b47c195bc9b4dbd7f2b87 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:06:51.584473 19523 leader_election.cc:304] T 1a61655d99124a29b486ba4a5b37faea P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:06:51.565244 25369 raft_consensus.cc:2804] T 0e1085d23e8347fbbd5bce7542f4b1f4 P 0473d2b2d01f4459b1e90fd12cc7840e [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:06:51.587188 19553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edd7d470b5014c9489be7f41f64355c9" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:06:51.588925 24700 raft_consensus.cc:2804] T 1a61655d99124a29b486ba4a5b37faea P e61c3a8f61bb48f8a963c9480e53c168 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:06:51.587800 19553 raft_consensus.cc:2468] T edd7d470b5014c9489be7f41f64355c9 P e61c3a8f61bb48f8a963c9480e53c168 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 19.
I20260709 13:06:51.589519 24700 raft_consensus.cc:493] T 1a61655d99124a29b486ba4a5b37faea P e61c3a8f61bb48f8a963c9480e53c168 [term 14 FOLLOWER]: Starting leader election (detected failure of leader e5256d91808b47c195bc9b4dbd7f2b87)
I20260709 13:06:51.589871 24700 raft_consensus.cc:3060] T 1a61655d99124a29b486ba4a5b37faea P e61c3a8f61bb48f8a963c9480e53c168 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:06:51.563786 25370 leader_election.cc:290] T 775c229504194560ba9589bc2199b089 P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 13 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:06:51.591840 19523 leader_election.cc:304] T f1b10566f45d4a7d9029858330e02d5b P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:06:51.591670 19553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a16f7501e2444fb86d4e2778e734e02" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 17 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:06:51.592783 19523 leader_election.cc:304] T ef32ce6fdd0e40d382c79974f30295c6 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e61c3a8f61bb48f8a963c9480e53c168; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:06:51.573072 25308 raft_consensus.cc:3060] T f93ee515a9c14139bf566522ed8232f3 P e61c3a8f61bb48f8a963c9480e53c168 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:06:51.530736 25298 raft_consensus.cc:515] T 5ec1c4ce15e04c7e8c283a62179f2a64 P 127766fc592545a4997f7790f50f6076 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:51.596666 19478 raft_consensus.cc:1240] T f93ee515a9c14139bf566522ed8232f3 P 0473d2b2d01f4459b1e90fd12cc7840e [term 19 FOLLOWER]: Rejecting Update request from peer e61c3a8f61bb48f8a963c9480e53c168 for earlier term 18. Current term is 19. Ops: []
I20260709 13:06:51.597375 19526 leader_election.cc:304] T fa8650e71aa14778b3d73721fc50d9fc P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e61c3a8f61bb48f8a963c9480e53c168; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:06:51.599236 19553 raft_consensus.cc:2410] T 2a16f7501e2444fb86d4e2778e734e02 P e61c3a8f61bb48f8a963c9480e53c168 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e5256d91808b47c195bc9b4dbd7f2b87 for term 17 because replica has last-logged OpId of term: 15 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 11.
I20260709 13:06:51.569888 25400 raft_consensus.cc:697] T 21e14947d70440f19044d8f75c31e1f9 P e5256d91808b47c195bc9b4dbd7f2b87 [term 17 LEADER]: Becoming Leader. State: Replica: e5256d91808b47c195bc9b4dbd7f2b87, State: Running, Role: LEADER
I20260709 13:06:51.601521 19523 leader_election.cc:304] T 22196caba61445d3bec98a0aab3c337d P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e61c3a8f61bb48f8a963c9480e53c168; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:06:51.547025 25403 raft_consensus.cc:515] T ef32ce6fdd0e40d382c79974f30295c6 P e5256d91808b47c195bc9b4dbd7f2b87 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:51.631177 19557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ece3db938bc649d4a40a51522ed5259c" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:06:51.571282 25359 raft_consensus.cc:697] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P 127766fc592545a4997f7790f50f6076 [term 18 LEADER]: Becoming Leader. State: Replica: 127766fc592545a4997f7790f50f6076, State: Running, Role: LEADER
I20260709 13:06:51.576846 25311 raft_consensus.cc:2749] T f1b10566f45d4a7d9029858330e02d5b P 0473d2b2d01f4459b1e90fd12cc7840e [term 17 FOLLOWER]: Leader pre-election lost for term 16. Reason: Vote denied by peer e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891) with higher term. Message: Invalid argument: T f1b10566f45d4a7d9029858330e02d5b P e61c3a8f61bb48f8a963c9480e53c168 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0473d2b2d01f4459b1e90fd12cc7840e for earlier term 16. Current term is 17.
I20260709 13:06:51.586300 25388 raft_consensus.cc:2749] T 2e36a9d6e29c4a7c860cf267efbd4c74 P e61c3a8f61bb48f8a963c9480e53c168 [term 13 FOLLOWER]: Leader election lost for term 12. Reason: Vote denied by peer e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321) with higher term. Message: Invalid argument: T 2e36a9d6e29c4a7c860cf267efbd4c74 P e5256d91808b47c195bc9b4dbd7f2b87 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate e61c3a8f61bb48f8a963c9480e53c168 for earlier term 12. Current term is 13.
I20260709 13:06:51.642396 19480 raft_consensus.cc:1275] T df751f992649444090e27965eb1af85d P 0473d2b2d01f4459b1e90fd12cc7840e [term 20 FOLLOWER]: Refusing update from remote peer e61c3a8f61bb48f8a963c9480e53c168: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 20 index: 13. (index mismatch)
W20260709 13:06:51.592047 25376 consensus_meta.cc:287] T 28af091831594f9d8e96482078cc7625 P 0473d2b2d01f4459b1e90fd12cc7840e: Time spent flushing consensus metadata: real 0.677s	user 0.007s	sys 0.003s
W20260709 13:06:51.647603 19450 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.3:36891, user_credentials={real_user=slave}} blocked reactor thread for 53492.7us
I20260709 13:06:51.695098 19403 raft_consensus.cc:2468] T 775c229504194560ba9589bc2199b089 P e5256d91808b47c195bc9b4dbd7f2b87 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 127766fc592545a4997f7790f50f6076 in term 13.
W20260709 13:06:51.668489 20077 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:51.600965 25337 raft_consensus.cc:2804] T f1b10566f45d4a7d9029858330e02d5b P e61c3a8f61bb48f8a963c9480e53c168 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:06:51.641417 25244 raft_consensus.cc:2749] T ef32ce6fdd0e40d382c79974f30295c6 P e61c3a8f61bb48f8a963c9480e53c168 [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 13:06:51.653656 25340 raft_consensus.cc:493] T ed7fdbcb96d14d418db9ca90a792588a P 0473d2b2d01f4459b1e90fd12cc7840e [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 127766fc592545a4997f7790f50f6076)
I20260709 13:06:51.740852 25401 raft_consensus.cc:493] T d1e5873a19244c5ebbcd38e126796ee7 P e5256d91808b47c195bc9b4dbd7f2b87 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:51.740893 25340 raft_consensus.cc:515] T ed7fdbcb96d14d418db9ca90a792588a P 0473d2b2d01f4459b1e90fd12cc7840e [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:51.647249 25093 raft_consensus.cc:515] T 1dc5b3532fe54f74876d02beffa2c230 P e5256d91808b47c195bc9b4dbd7f2b87 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:51.741418 25401 raft_consensus.cc:515] T d1e5873a19244c5ebbcd38e126796ee7 P e5256d91808b47c195bc9b4dbd7f2b87 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
W20260709 13:06:51.743325 25429 log.cc:927] Time spent T 3e1f505cb0f1427bbd698ac889d80821 P e5256d91808b47c195bc9b4dbd7f2b87: Append to log took a long time: real 0.151s	user 0.001s	sys 0.000s
I20260709 13:06:51.744268 25093 leader_election.cc:290] T 1dc5b3532fe54f74876d02beffa2c230 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 18 election: Requested vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:06:51.745021 20107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a16f7501e2444fb86d4e2778e734e02" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 17 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:06:51.744949 25401 leader_election.cc:290] T d1e5873a19244c5ebbcd38e126796ee7 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:06:51.592307 25369 raft_consensus.cc:493] T 0e1085d23e8347fbbd5bce7542f4b1f4 P 0473d2b2d01f4459b1e90fd12cc7840e [term 12 FOLLOWER]: Starting leader election (detected failure of leader 127766fc592545a4997f7790f50f6076)
I20260709 13:06:51.747058 25369 raft_consensus.cc:3060] T 0e1085d23e8347fbbd5bce7542f4b1f4 P 0473d2b2d01f4459b1e90fd12cc7840e [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:06:51.748930 19557 pending_rounds.cc:85] T 7f575b143b844aa096b50997dad3516a P e61c3a8f61bb48f8a963c9480e53c168: Aborting all ops after (but not including) 9
I20260709 13:06:51.749265 19557 pending_rounds.cc:107] T 7f575b143b844aa096b50997dad3516a P e61c3a8f61bb48f8a963c9480e53c168: Aborting uncommitted NO_OP operation due to leader change: 13.10
I20260709 13:06:51.749507 19557 raft_consensus.cc:2889] T 7f575b143b844aa096b50997dad3516a P e61c3a8f61bb48f8a963c9480e53c168 [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:06:51.750780 25388 raft_consensus.cc:2749] T 22196caba61445d3bec98a0aab3c337d P e61c3a8f61bb48f8a963c9480e53c168 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:06:51.752648 19556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e5873a19244c5ebbcd38e126796ee7" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 20 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:06:51.752841 19553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dc5b3532fe54f74876d02beffa2c230" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:06:51.753721 19403 raft_consensus.cc:1275] T 2e36a9d6e29c4a7c860cf267efbd4c74 P e5256d91808b47c195bc9b4dbd7f2b87 [term 13 FOLLOWER]: Refusing update from remote peer 0473d2b2d01f4459b1e90fd12cc7840e: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 13 index: 7. (index mismatch)
I20260709 13:06:51.660094 24700 raft_consensus.cc:515] T 1a61655d99124a29b486ba4a5b37faea P e61c3a8f61bb48f8a963c9480e53c168 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:51.754417 25090 raft_consensus.cc:3055] T 70797e5783b5454ab0d0eea663e791e3 P e5256d91808b47c195bc9b4dbd7f2b87 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:06:51.754935 25090 raft_consensus.cc:740] T 70797e5783b5454ab0d0eea663e791e3 P e5256d91808b47c195bc9b4dbd7f2b87 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: e5256d91808b47c195bc9b4dbd7f2b87, State: Running, Role: LEADER
I20260709 13:06:51.756099 24700 leader_election.cc:290] T 1a61655d99124a29b486ba4a5b37faea P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 15 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:06:51.755864 25090 consensus_queue.cc:260] T 70797e5783b5454ab0d0eea663e791e3 P e5256d91808b47c195bc9b4dbd7f2b87 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 18.13, Last appended by leader: 13, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:51.694120 25376 raft_consensus.cc:515] T 28af091831594f9d8e96482078cc7625 P 0473d2b2d01f4459b1e90fd12cc7840e [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
W20260709 13:06:51.757967 19526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.2:46257, user_credentials={real_user=slave}} blocked reactor thread for 160660us
I20260709 13:06:51.759163 19526 leader_election.cc:304] T 0afb57ae58a24a01850491d69f0213dd P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e61c3a8f61bb48f8a963c9480e53c168; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, 127766fc592545a4997f7790f50f6076
I20260709 13:06:51.594280 25241 leader_election.cc:290] T 48824d5acfbc485ebf8c2d944e7202de P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 19 election: Requested vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:06:51.791771 19450 leader_election.cc:304] T 21e14947d70440f19044d8f75c31e1f9 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168; no voters: e5256d91808b47c195bc9b4dbd7f2b87
W20260709 13:06:51.792569 19523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.1:40321, user_credentials={real_user=slave}} blocked reactor thread for 191111us
I20260709 13:06:51.653719 25411 leader_election.cc:290] T 4509b76741dc428e9201c70c1658da13 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:06:51.591377 25095 consensus_queue.cc:1048] T 28af091831594f9d8e96482078cc7625 P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.202s
I20260709 13:06:51.807852 19450 leader_election.cc:304] T 14935b3ddf914369822e4a0547aaa355 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168; no voters: 127766fc592545a4997f7790f50f6076
I20260709 13:06:51.694550 25433 raft_consensus.cc:2804] T a08760e15aac4630a629431f56024dc8 P 0473d2b2d01f4459b1e90fd12cc7840e [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:06:51.727912 25246 raft_consensus.cc:493] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P 0473d2b2d01f4459b1e90fd12cc7840e [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:51.797405 24700 raft_consensus.cc:2749] T fa8650e71aa14778b3d73721fc50d9fc P e61c3a8f61bb48f8a963c9480e53c168 [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:06:51.735045 25422 raft_consensus.cc:2749] T 70797e5783b5454ab0d0eea663e791e3 P e61c3a8f61bb48f8a963c9480e53c168 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:06:51.791472 25349 raft_consensus.cc:493] T 4509b76741dc428e9201c70c1658da13 P 0473d2b2d01f4459b1e90fd12cc7840e [term 10 FOLLOWER]: Starting pre-election (detected failure of leader e5256d91808b47c195bc9b4dbd7f2b87)
I20260709 13:06:51.739149 25396 leader_election.cc:290] T 2a16f7501e2444fb86d4e2778e734e02 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:06:51.806409 19486 raft_consensus.cc:1240] T 28af091831594f9d8e96482078cc7625 P 0473d2b2d01f4459b1e90fd12cc7840e [term 18 FOLLOWER]: Rejecting Update request from peer e61c3a8f61bb48f8a963c9480e53c168 for earlier term 17. Current term is 18. Ops: [17.10-17.10]
I20260709 13:06:51.758028 25261 raft_consensus.cc:493] T ff75a1d4cb1f493db8f71ddc136ba9ab P 0473d2b2d01f4459b1e90fd12cc7840e [term 17 FOLLOWER]: Starting pre-election (detected failure of leader e5256d91808b47c195bc9b4dbd7f2b87)
I20260709 13:06:51.653817 25188 raft_consensus.cc:493] T 14efcc79969f41babe5529c22d59156d P 0473d2b2d01f4459b1e90fd12cc7840e [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 127766fc592545a4997f7790f50f6076)
I20260709 13:06:51.809100 19449 leader_election.cc:304] T 775c229504194560ba9589bc2199b089 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, 127766fc592545a4997f7790f50f6076; no voters: e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:06:51.735419 25333 consensus_queue.cc:1059] T 76cb037fc9064d13b59a8969d897ce8c P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 }, Status: INVALID_TERM, Last received: 12.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.071s
I20260709 13:06:51.800119 19526 leader_election.cc:304] T 2b74109013a140ada21feeef92d6f563 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168; no voters: e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:06:51.824481 25445 consensus_queue.cc:1059] T 46c5bfeecc314717bffe987e6844b6d0 P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:06:51.793879 25332 consensus_queue.cc:1059] T b08304a0a02b42d7840c4e8ee9a6bd1a P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 }, Status: INVALID_TERM, Last received: 16.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.030s
I20260709 13:06:51.824819 24824 leader_election.cc:290] T f1b10566f45d4a7d9029858330e02d5b P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:06:51.825906 20107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48824d5acfbc485ebf8c2d944e7202de" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076"
I20260709 13:06:51.828425 19523 leader_election.cc:304] T 65d8cb8d6ec64f459d5a47cefab10acf P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e61c3a8f61bb48f8a963c9480e53c168; no voters: 127766fc592545a4997f7790f50f6076, e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:06:51.804250 25244 raft_consensus.cc:2749] T 0afb57ae58a24a01850491d69f0213dd P e61c3a8f61bb48f8a963c9480e53c168 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:06:51.800872 25337 raft_consensus.cc:697] T f1b10566f45d4a7d9029858330e02d5b P e61c3a8f61bb48f8a963c9480e53c168 [term 17 LEADER]: Becoming Leader. State: Replica: e61c3a8f61bb48f8a963c9480e53c168, State: Running, Role: LEADER
I20260709 13:06:51.811870 25433 raft_consensus.cc:493] T a08760e15aac4630a629431f56024dc8 P 0473d2b2d01f4459b1e90fd12cc7840e [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:51.809890 25237 raft_consensus.cc:493] T 5ec1c4ce15e04c7e8c283a62179f2a64 P 0473d2b2d01f4459b1e90fd12cc7840e [term 11 FOLLOWER]: Starting pre-election (detected failure of leader e5256d91808b47c195bc9b4dbd7f2b87)
I20260709 13:06:51.847767 20107 raft_consensus.cc:2393] T 48824d5acfbc485ebf8c2d944e7202de P 127766fc592545a4997f7790f50f6076 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate e61c3a8f61bb48f8a963c9480e53c168 in current term 19: Already voted for candidate 127766fc592545a4997f7790f50f6076 in this term.
I20260709 13:06:51.811729 25341 consensus_queue.cc:1048] T d1e5873a19244c5ebbcd38e126796ee7 P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.036s
I20260709 13:06:51.817656 25388 consensus_queue.cc:1048] T 40e1e16737a842ee936002830f36882e P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.037s
I20260709 13:06:51.838682 25261 raft_consensus.cc:515] T ff75a1d4cb1f493db8f71ddc136ba9ab P 0473d2b2d01f4459b1e90fd12cc7840e [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:51.816817 25411 consensus_queue.cc:1048] T df751f992649444090e27965eb1af85d P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 10, Time since last communication: 0.034s
I20260709 13:06:51.823887 25246 raft_consensus.cc:515] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P 0473d2b2d01f4459b1e90fd12cc7840e [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:51.814313 25400 consensus_queue.cc:237] T 21e14947d70440f19044d8f75c31e1f9 P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:51.853293 25433 raft_consensus.cc:3060] T a08760e15aac4630a629431f56024dc8 P 0473d2b2d01f4459b1e90fd12cc7840e [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:06:51.846225 25446 raft_consensus.cc:2804] T 21e14947d70440f19044d8f75c31e1f9 P 0473d2b2d01f4459b1e90fd12cc7840e [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:06:51.858011 25422 raft_consensus.cc:2804] T 2b74109013a140ada21feeef92d6f563 P e61c3a8f61bb48f8a963c9480e53c168 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:06:51.841159 25349 raft_consensus.cc:515] T 4509b76741dc428e9201c70c1658da13 P 0473d2b2d01f4459b1e90fd12cc7840e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:51.941283 25261 leader_election.cc:290] T ff75a1d4cb1f493db8f71ddc136ba9ab P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
W20260709 13:06:51.942066 19450 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.3:36891, user_credentials={real_user=slave}} blocked reactor thread for 90112.9us
I20260709 13:06:51.944453 19450 leader_election.cc:304] T ab43d85f64114d4ebf618930e43d9ed0 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168; no voters: 127766fc592545a4997f7790f50f6076
I20260709 13:06:51.946357 25100 raft_consensus.cc:515] T a08760e15aac4630a629431f56024dc8 P e5256d91808b47c195bc9b4dbd7f2b87 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:51.947628 25449 consensus_queue.cc:1059] T ef32ce6fdd0e40d382c79974f30295c6 P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 }, Status: INVALID_TERM, Last received: 18.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:06:51.949683 25449 raft_consensus.cc:2804] T ab43d85f64114d4ebf618930e43d9ed0 P 0473d2b2d01f4459b1e90fd12cc7840e [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:06:51.950114 25449 raft_consensus.cc:697] T ab43d85f64114d4ebf618930e43d9ed0 P 0473d2b2d01f4459b1e90fd12cc7840e [term 18 LEADER]: Becoming Leader. State: Replica: 0473d2b2d01f4459b1e90fd12cc7840e, State: Running, Role: LEADER
I20260709 13:06:51.846278 25188 raft_consensus.cc:515] T 14efcc79969f41babe5529c22d59156d P 0473d2b2d01f4459b1e90fd12cc7840e [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:51.964540 19406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "309c3ca0ca4b4f3ba129752ea2cb293b" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:06:51.928853 25095 raft_consensus.cc:2749] T 65d8cb8d6ec64f459d5a47cefab10acf P e61c3a8f61bb48f8a963c9480e53c168 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:06:51.934221 25345 raft_consensus.cc:2804] T 775c229504194560ba9589bc2199b089 P 0473d2b2d01f4459b1e90fd12cc7840e [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:06:51.856787 25237 raft_consensus.cc:515] T 5ec1c4ce15e04c7e8c283a62179f2a64 P 0473d2b2d01f4459b1e90fd12cc7840e [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:51.958808 25261 raft_consensus.cc:3055] T ef32ce6fdd0e40d382c79974f30295c6 P 0473d2b2d01f4459b1e90fd12cc7840e [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:06:52.019683 25261 raft_consensus.cc:740] T ef32ce6fdd0e40d382c79974f30295c6 P 0473d2b2d01f4459b1e90fd12cc7840e [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 0473d2b2d01f4459b1e90fd12cc7840e, State: Running, Role: LEADER
I20260709 13:06:52.020787 25261 consensus_queue.cc:260] T ef32ce6fdd0e40d382c79974f30295c6 P 0473d2b2d01f4459b1e90fd12cc7840e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 20.11, Last appended by leader: 11, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:51.973018 25100 leader_election.cc:290] T a08760e15aac4630a629431f56024dc8 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 21 election: Requested vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
W20260709 13:06:51.973556 25432 log.cc:927] Time spent T 22196caba61445d3bec98a0aab3c337d P e61c3a8f61bb48f8a963c9480e53c168: Append to log took a long time: real 0.119s	user 0.000s	sys 0.000s
W20260709 13:06:51.974625 25430 log.cc:927] Time spent T 172b3dd13109415a955b71ac0e9d2234 P 127766fc592545a4997f7790f50f6076: Append to log took a long time: real 0.163s	user 0.000s	sys 0.001s
W20260709 13:06:51.975534 25440 log.cc:927] Time spent T 6c5eebf646ad445a9d1b1adc319d7b16 P 0473d2b2d01f4459b1e90fd12cc7840e: Append to log took a long time: real 0.144s	user 0.000s	sys 0.000s
I20260709 13:06:51.975972 25417 raft_consensus.cc:2804] T 14935b3ddf914369822e4a0547aaa355 P 0473d2b2d01f4459b1e90fd12cc7840e [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:06:51.976442 25434 raft_consensus.cc:3055] T 76cb037fc9064d13b59a8969d897ce8c P 0473d2b2d01f4459b1e90fd12cc7840e [term 15 LEADER]: Stepping down as leader of term 15
W20260709 13:06:51.977322 25437 log.cc:927] Time spent T 2b74109013a140ada21feeef92d6f563 P e61c3a8f61bb48f8a963c9480e53c168: Append to log took a long time: real 0.220s	user 0.001s	sys 0.000s
I20260709 13:06:51.992537 25449 consensus_queue.cc:237] T ab43d85f64114d4ebf618930e43d9ed0 P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.11, Last appended by leader: 11, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:51.993588 25337 consensus_queue.cc:237] T f1b10566f45d4a7d9029858330e02d5b P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:51.995352 19402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a08760e15aac4630a629431f56024dc8" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
I20260709 13:06:51.964829 25397 leader_election.cc:290] T 1f85fc4b527a48848e5faa083b604e36 P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321)
I20260709 13:06:51.964063 25329 raft_consensus.cc:493] T 1f85fc4b527a48848e5faa083b604e36 P 0473d2b2d01f4459b1e90fd12cc7840e [term 15 FOLLOWER]: Starting pre-election (detected failure of leader e5256d91808b47c195bc9b4dbd7f2b87)
I20260709 13:06:52.066908 19558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c5eebf646ad445a9d1b1adc319d7b16" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:06:51.956059 25368 raft_consensus.cc:493] T ed7fdbcb96d14d418db9ca90a792588a P 127766fc592545a4997f7790f50f6076 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:52.003504 19409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4509b76741dc428e9201c70c1658da13" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:06:52.004709 19557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a08760e15aac4630a629431f56024dc8" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:06:52.085305 19557 raft_consensus.cc:3060] T a08760e15aac4630a629431f56024dc8 P e61c3a8f61bb48f8a963c9480e53c168 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:06:51.821552 25359 consensus_queue.cc:237] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P 127766fc592545a4997f7790f50f6076 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 17.14, Last appended by leader: 14, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:52.005410 25298 leader_election.cc:290] T 5ec1c4ce15e04c7e8c283a62179f2a64 P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:06:52.005935 25403 leader_election.cc:290] T ef32ce6fdd0e40d382c79974f30295c6 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:06:52.009310 24702 leader_election.cc:290] T 62c6c134d3d24a1ab144dd9ee6bc3f64 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 15 election: Requested vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:06:52.009840 25369 raft_consensus.cc:515] T 0e1085d23e8347fbbd5bce7542f4b1f4 P 0473d2b2d01f4459b1e90fd12cc7840e [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:52.011027 25376 leader_election.cc:290] T 28af091831594f9d8e96482078cc7625 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 18 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:06:51.935336 25422 raft_consensus.cc:493] T 2b74109013a140ada21feeef92d6f563 P e61c3a8f61bb48f8a963c9480e53c168 [term 14 FOLLOWER]: Starting leader election (detected failure of leader e5256d91808b47c195bc9b4dbd7f2b87)
I20260709 13:06:52.018532 19375 leader_election.cc:304] T 7be9efa6559648dbb5a0f7684c4542d1 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 127766fc592545a4997f7790f50f6076, e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
W20260709 13:06:52.121920 19375 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.3:36891, user_credentials={real_user=slave}} blocked reactor thread for 103495us
I20260709 13:06:51.936094 25446 raft_consensus.cc:493] T 21e14947d70440f19044d8f75c31e1f9 P 0473d2b2d01f4459b1e90fd12cc7840e [term 15 FOLLOWER]: Starting leader election (detected failure of leader e61c3a8f61bb48f8a963c9480e53c168)
I20260709 13:06:52.030082 19551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef32ce6fdd0e40d382c79974f30295c6" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:06:51.971284 19406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a61655d99124a29b486ba4a5b37faea" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
I20260709 13:06:52.022315 25261 raft_consensus.cc:3060] T ef32ce6fdd0e40d382c79974f30295c6 P 0473d2b2d01f4459b1e90fd12cc7840e [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:06:52.042110 25100 raft_consensus.cc:493] T ab43d85f64114d4ebf618930e43d9ed0 P e5256d91808b47c195bc9b4dbd7f2b87 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:52.043188 25246 leader_election.cc:290] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:06:52.045322 25237 leader_election.cc:290] T 5ec1c4ce15e04c7e8c283a62179f2a64 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:06:52.051584 25188 leader_election.cc:290] T 14efcc79969f41babe5529c22d59156d P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
W20260709 13:06:52.053334 25408 consensus_meta.cc:287] T 0cdf56e38bbc453d9438d359e5a69955 P e5256d91808b47c195bc9b4dbd7f2b87: Time spent flushing consensus metadata: real 0.930s	user 0.007s	sys 0.003s
I20260709 13:06:52.054553 25417 raft_consensus.cc:697] T 14935b3ddf914369822e4a0547aaa355 P 0473d2b2d01f4459b1e90fd12cc7840e [term 11 LEADER]: Becoming Leader. State: Replica: 0473d2b2d01f4459b1e90fd12cc7840e, State: Running, Role: LEADER
I20260709 13:06:52.034128 25434 raft_consensus.cc:740] T 76cb037fc9064d13b59a8969d897ce8c P 0473d2b2d01f4459b1e90fd12cc7840e [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 0473d2b2d01f4459b1e90fd12cc7840e, State: Running, Role: LEADER
I20260709 13:06:51.998382 25345 raft_consensus.cc:493] T 775c229504194560ba9589bc2199b089 P 0473d2b2d01f4459b1e90fd12cc7840e [term 11 FOLLOWER]: Starting leader election (detected failure of leader 127766fc592545a4997f7790f50f6076)
I20260709 13:06:52.081707 19402 raft_consensus.cc:2368] T a08760e15aac4630a629431f56024dc8 P e5256d91808b47c195bc9b4dbd7f2b87 [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate e61c3a8f61bb48f8a963c9480e53c168 for earlier term 20. Current term is 21.
I20260709 13:06:52.065871 19555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22196caba61445d3bec98a0aab3c337d" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:06:52.083226 19553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e1f505cb0f1427bbd698ac889d80821" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 20 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:06:52.083807 19558 raft_consensus.cc:3060] T 6c5eebf646ad445a9d1b1adc319d7b16 P e61c3a8f61bb48f8a963c9480e53c168 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:06:52.067513 19560 raft_consensus.cc:1240] T 48824d5acfbc485ebf8c2d944e7202de P e61c3a8f61bb48f8a963c9480e53c168 [term 19 FOLLOWER]: Rejecting Update request from peer 0473d2b2d01f4459b1e90fd12cc7840e for earlier term 18. Current term is 19. Ops: []
I20260709 13:06:52.142040 19485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a08760e15aac4630a629431f56024dc8" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:06:52.142892 19483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "172b3dd13109415a955b71ac0e9d2234" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:06:52.143257 19560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed7fdbcb96d14d418db9ca90a792588a" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:06:52.144248 19560 raft_consensus.cc:2393] T ed7fdbcb96d14d418db9ca90a792588a P e61c3a8f61bb48f8a963c9480e53c168 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0473d2b2d01f4459b1e90fd12cc7840e in current term 14: Already voted for candidate e61c3a8f61bb48f8a963c9480e53c168 in this term.
I20260709 13:06:52.144296 19478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28af091831594f9d8e96482078cc7625" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:06:52.145201 19478 raft_consensus.cc:2393] T 28af091831594f9d8e96482078cc7625 P 0473d2b2d01f4459b1e90fd12cc7840e [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e5256d91808b47c195bc9b4dbd7f2b87 in current term 18: Already voted for candidate 0473d2b2d01f4459b1e90fd12cc7840e in this term.
I20260709 13:06:52.145347 19560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff75a1d4cb1f493db8f71ddc136ba9ab" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
W20260709 13:06:52.086534 19526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.2:46257, user_credentials={real_user=slave}} blocked reactor thread for 286486us
I20260709 13:06:52.091302 19559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46c5bfeecc314717bffe987e6844b6d0" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 23 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
W20260709 13:06:52.092655 19523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.4:43121, user_credentials={real_user=slave}} blocked reactor thread for 264326us
I20260709 13:06:52.149353 20107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62c6c134d3d24a1ab144dd9ee6bc3f64" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076"
W20260709 13:06:52.111745 19449 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.4:43121, user_credentials={real_user=slave}} blocked reactor thread for 302572us
I20260709 13:06:52.105619 19554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a08760e15aac4630a629431f56024dc8" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:06:52.150038 20107 raft_consensus.cc:2393] T 62c6c134d3d24a1ab144dd9ee6bc3f64 P 127766fc592545a4997f7790f50f6076 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate e61c3a8f61bb48f8a963c9480e53c168 in current term 15: Already voted for candidate 127766fc592545a4997f7790f50f6076 in this term.
I20260709 13:06:52.063802 25341 raft_consensus.cc:493] T 217b5fae677b4971b3bbd2f357a1f7ff P e61c3a8f61bb48f8a963c9480e53c168 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 0473d2b2d01f4459b1e90fd12cc7840e)
I20260709 13:06:52.132246 19551 raft_consensus.cc:2393] T ef32ce6fdd0e40d382c79974f30295c6 P e61c3a8f61bb48f8a963c9480e53c168 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e5256d91808b47c195bc9b4dbd7f2b87 in current term 21: Already voted for candidate e61c3a8f61bb48f8a963c9480e53c168 in this term.
I20260709 13:06:52.092749 25349 leader_election.cc:290] T 4509b76741dc428e9201c70c1658da13 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:06:52.134147 19557 raft_consensus.cc:2468] T a08760e15aac4630a629431f56024dc8 P e61c3a8f61bb48f8a963c9480e53c168 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 21.
I20260709 13:06:52.143579 19483 raft_consensus.cc:2393] T 172b3dd13109415a955b71ac0e9d2234 P 0473d2b2d01f4459b1e90fd12cc7840e [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate e5256d91808b47c195bc9b4dbd7f2b87 in current term 16: Already voted for candidate 127766fc592545a4997f7790f50f6076 in this term.
I20260709 13:06:52.123214 25422 raft_consensus.cc:3060] T 2b74109013a140ada21feeef92d6f563 P e61c3a8f61bb48f8a963c9480e53c168 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:06:52.124028 19375 leader_election.cc:304] T edd7d470b5014c9489be7f41f64355c9 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:06:52.139214 25376 raft_consensus.cc:493] T ff9b0eddd810459b82d91c60777c10eb P 0473d2b2d01f4459b1e90fd12cc7840e [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 127766fc592545a4997f7790f50f6076)
I20260709 13:06:52.151300 19479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40e1e16737a842ee936002830f36882e" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:06:52.160660 19557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48824d5acfbc485ebf8c2d944e7202de" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:06:52.160804 19479 raft_consensus.cc:2468] T 40e1e16737a842ee936002830f36882e P 0473d2b2d01f4459b1e90fd12cc7840e [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 18.
I20260709 13:06:52.161365 19557 raft_consensus.cc:2393] T 48824d5acfbc485ebf8c2d944e7202de P e61c3a8f61bb48f8a963c9480e53c168 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 127766fc592545a4997f7790f50f6076 in current term 19: Already voted for candidate e61c3a8f61bb48f8a963c9480e53c168 in this term.
I20260709 13:06:52.161211 19375 leader_election.cc:304] T ece3db938bc649d4a40a51522ed5259c P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87; no voters: 127766fc592545a4997f7790f50f6076, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:06:52.161665 19479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dc5b3532fe54f74876d02beffa2c230" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:06:52.162619 19479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1b10566f45d4a7d9029858330e02d5b" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:06:52.163259 19479 raft_consensus.cc:2393] T f1b10566f45d4a7d9029858330e02d5b P 0473d2b2d01f4459b1e90fd12cc7840e [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e5256d91808b47c195bc9b4dbd7f2b87 in current term 17: Already voted for candidate e61c3a8f61bb48f8a963c9480e53c168 in this term.
I20260709 13:06:52.132365 25403 raft_consensus.cc:2804] T 7be9efa6559648dbb5a0f7684c4542d1 P e5256d91808b47c195bc9b4dbd7f2b87 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:06:52.106412 25368 raft_consensus.cc:515] T ed7fdbcb96d14d418db9ca90a792588a P 127766fc592545a4997f7790f50f6076 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:52.154644 19480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21e14947d70440f19044d8f75c31e1f9" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:06:52.085548 25329 raft_consensus.cc:515] T 1f85fc4b527a48848e5faa083b604e36 P 0473d2b2d01f4459b1e90fd12cc7840e [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:52.123113 25446 raft_consensus.cc:3060] T 21e14947d70440f19044d8f75c31e1f9 P 0473d2b2d01f4459b1e90fd12cc7840e [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:06:52.176507 19551 raft_consensus.cc:1275] T 2725d2c4cb054f18b0fc8f735c15f6c2 P e61c3a8f61bb48f8a963c9480e53c168 [term 19 FOLLOWER]: Refusing update from remote peer 0473d2b2d01f4459b1e90fd12cc7840e: Log matching property violated. Preceding OpId in replica: term: 17 index: 9. Preceding OpId from leader: term: 19 index: 10. (index mismatch)
I20260709 13:06:52.174593 19407 raft_consensus.cc:1240] T 217b5fae677b4971b3bbd2f357a1f7ff P e5256d91808b47c195bc9b4dbd7f2b87 [term 13 FOLLOWER]: Rejecting Update request from peer 0473d2b2d01f4459b1e90fd12cc7840e for earlier term 12. Current term is 13. Ops: []
I20260709 13:06:52.195047 19479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96efeaaf1057492490e9a621f37e1a2d" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 20 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:06:52.195245 19551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28af091831594f9d8e96482078cc7625" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:06:52.195421 19407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28af091831594f9d8e96482078cc7625" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
I20260709 13:06:52.196005 19407 raft_consensus.cc:3060] T 28af091831594f9d8e96482078cc7625 P e5256d91808b47c195bc9b4dbd7f2b87 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:06:52.196293 19551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e1085d23e8347fbbd5bce7542f4b1f4" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:06:52.090186 19556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28af091831594f9d8e96482078cc7625" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:06:52.196870 19560 raft_consensus.cc:1275] T 2e36a9d6e29c4a7c860cf267efbd4c74 P e61c3a8f61bb48f8a963c9480e53c168 [term 13 FOLLOWER]: Refusing update from remote peer 0473d2b2d01f4459b1e90fd12cc7840e: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 13 index: 7. (index mismatch)
I20260709 13:06:52.165426 19486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e5873a19244c5ebbcd38e126796ee7" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 20 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:06:52.197535 19486 raft_consensus.cc:2468] T d1e5873a19244c5ebbcd38e126796ee7 P 0473d2b2d01f4459b1e90fd12cc7840e [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 19.
I20260709 13:06:52.168183 25341 raft_consensus.cc:515] T 217b5fae677b4971b3bbd2f357a1f7ff P e61c3a8f61bb48f8a963c9480e53c168 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:52.141041 25455 raft_consensus.cc:493] T 309c3ca0ca4b4f3ba129752ea2cb293b P 0473d2b2d01f4459b1e90fd12cc7840e [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 127766fc592545a4997f7790f50f6076)
I20260709 13:06:52.141268 25369 leader_election.cc:290] T 0e1085d23e8347fbbd5bce7542f4b1f4 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 13 election: Requested vote from peers e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:06:52.160001 19478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7be9efa6559648dbb5a0f7684c4542d1" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:06:52.206302 19478 raft_consensus.cc:3060] T 7be9efa6559648dbb5a0f7684c4542d1 P 0473d2b2d01f4459b1e90fd12cc7840e [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:06:52.170096 25309 raft_consensus.cc:2804] T edd7d470b5014c9489be7f41f64355c9 P e5256d91808b47c195bc9b4dbd7f2b87 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:06:52.171692 25246 consensus_queue.cc:1059] T 48824d5acfbc485ebf8c2d944e7202de P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false }, Status: INVALID_TERM, Last received: 18.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
W20260709 13:06:52.214476 25412 log.cc:927] Time spent T fa8650e71aa14778b3d73721fc50d9fc P 0473d2b2d01f4459b1e90fd12cc7840e: Append to log took a long time: real 1.136s	user 0.010s	sys 0.006s
I20260709 13:06:52.215466 19411 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52328 (request call id 2433) took 1178 ms. Trace:
I20260709 13:06:52.215847 19411 rpcz_store.cc:276] 0709 13:06:51.037478 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:51.037605 (+   127us) service_pool.cc:224] Handling call
0709 13:06:52.215258 (+1177653us) spinlock_profiling.cc:243] Waited 129 ms on lock 0x7b5400249354. stack: 00007f4a79de9343 00007f4a79de9240 00007f4a797781d4 00007f4a834b6304 00007f4a834b6299 00007f4a7ce71571 00007f4a7cf0c2fa 00007f4a81ecdb17 00007f4a7b4486d4 00007f4a7b448662 00007f4a7b448591 00007f4a7b44850c 00007f4a7b4477c2 00007f4a7b24348c 00007f4a7b2428c6 00007f4a7b24226f
0709 13:06:52.215386 (+   128us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":297259776}
I20260709 13:06:52.216303 25341 leader_election.cc:290] T 217b5fae677b4971b3bbd2f357a1f7ff P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:06:52.217119 19411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14efcc79969f41babe5529c22d59156d" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:06:52.208683 25188 consensus_queue.cc:1048] T 2e36a9d6e29c4a7c860cf267efbd4c74 P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.009s
I20260709 13:06:52.159910 24702 raft_consensus.cc:493] T 0cdf56e38bbc453d9438d359e5a69955 P e61c3a8f61bb48f8a963c9480e53c168 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 0473d2b2d01f4459b1e90fd12cc7840e)
I20260709 13:06:52.218930 24702 raft_consensus.cc:515] T 0cdf56e38bbc453d9438d359e5a69955 P e61c3a8f61bb48f8a963c9480e53c168 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:52.220778 24702 leader_election.cc:290] T 0cdf56e38bbc453d9438d359e5a69955 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:06:52.221268 25237 consensus_queue.cc:1059] T 217b5fae677b4971b3bbd2f357a1f7ff P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 }, Status: INVALID_TERM, Last received: 12.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:06:52.221727 19552 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40438 (request call id 2915) took 1075 ms. Trace:
I20260709 13:06:52.222113 19552 rpcz_store.cc:276] 0709 13:06:51.146698 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:51.146805 (+   107us) service_pool.cc:224] Handling call
0709 13:06:51.152302 (+  5497us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:51.224268 (+ 71966us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:51.224314 (+    46us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:51.224370 (+    56us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:06:51.224414 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:52.221496 (+997082us) spinlock_profiling.cc:243] Waited 71.7 ms on lock 0x7b5400125f54. stack: 00007f4a79de9343 00007f4a79de9240 00007f4a797781d4 00007f4a834b6304 00007f4a834b6299 00007f4a7ce71571 00007f4a7cf08e01 00007f4a7cf0783e 00007f4a81ecc419 00007f4a7b443bd4 00007f4a7b443b62 00007f4a7b443a91 00007f4a7b443a0c 00007f4a7b442cc2 00007f4a7b24348c 00007f4a7b2428c6
0709 13:06:52.221542 (+    46us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:52.221649 (+   107us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":164941568}
I20260709 13:06:52.223547 25246 raft_consensus.cc:3055] T 48824d5acfbc485ebf8c2d944e7202de P 0473d2b2d01f4459b1e90fd12cc7840e [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:06:52.223497 25411 consensus_queue.cc:1048] T df751f992649444090e27965eb1af85d P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:06:52.174091 24824 raft_consensus.cc:2749] T ece3db938bc649d4a40a51522ed5259c P e5256d91808b47c195bc9b4dbd7f2b87 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:06:52.224689 25349 consensus_queue.cc:1059] T 48824d5acfbc485ebf8c2d944e7202de P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 }, Status: INVALID_TERM, Last received: 18.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:06:52.208425 25455 raft_consensus.cc:515] T 309c3ca0ca4b4f3ba129752ea2cb293b P 0473d2b2d01f4459b1e90fd12cc7840e [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:52.218385 19411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff75a1d4cb1f493db8f71ddc136ba9ab" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:06:52.224133 25246 raft_consensus.cc:740] T 48824d5acfbc485ebf8c2d944e7202de P 0473d2b2d01f4459b1e90fd12cc7840e [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 0473d2b2d01f4459b1e90fd12cc7840e, State: Running, Role: LEADER
I20260709 13:06:52.227383 25455 leader_election.cc:290] T 309c3ca0ca4b4f3ba129752ea2cb293b P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:06:52.227632 25246 consensus_queue.cc:260] T 48824d5acfbc485ebf8c2d944e7202de P 0473d2b2d01f4459b1e90fd12cc7840e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 18.13, Last appended by leader: 13, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:52.163069 19483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e1f505cb0f1427bbd698ac889d80821" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:06:52.229038 25246 raft_consensus.cc:3060] T 48824d5acfbc485ebf8c2d944e7202de P 0473d2b2d01f4459b1e90fd12cc7840e [term 18 FOLLOWER]: Advancing to term 19
W20260709 13:06:52.230067 25458 log.cc:927] Time spent T 3e1f505cb0f1427bbd698ac889d80821 P 0473d2b2d01f4459b1e90fd12cc7840e: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
I20260709 13:06:52.230551 25329 leader_election.cc:290] T 1f85fc4b527a48848e5faa083b604e36 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:06:52.173818 19409 raft_consensus.cc:1240] T b08304a0a02b42d7840c4e8ee9a6bd1a P e5256d91808b47c195bc9b4dbd7f2b87 [term 17 FOLLOWER]: Rejecting Update request from peer 0473d2b2d01f4459b1e90fd12cc7840e for earlier term 16. Current term is 17. Ops: []
W20260709 13:06:52.181929 25308 consensus_meta.cc:287] T f93ee515a9c14139bf566522ed8232f3 P e61c3a8f61bb48f8a963c9480e53c168: Time spent flushing consensus metadata: real 0.582s	user 0.009s	sys 0.002s
I20260709 13:06:52.196221 19479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "775c229504194560ba9589bc2199b089" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:06:52.232272 19411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4509b76741dc428e9201c70c1658da13" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:06:52.233291 19486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "309c3ca0ca4b4f3ba129752ea2cb293b" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:06:52.233805 19486 raft_consensus.cc:1813] T 309c3ca0ca4b4f3ba129752ea2cb293b P 0473d2b2d01f4459b1e90fd12cc7840e [term 11 FOLLOWER]: Handling vote request from an unknown peer e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:06:52.234344 19486 raft_consensus.cc:2410] T 309c3ca0ca4b4f3ba129752ea2cb293b P 0473d2b2d01f4459b1e90fd12cc7840e [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e61c3a8f61bb48f8a963c9480e53c168 for term 12 because replica has last-logged OpId of term: 11 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 9.
I20260709 13:06:52.234217 19411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36f6ba92b9ba46babe4ebd6c02e5fbd9" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 19 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:06:52.235005 19411 raft_consensus.cc:2410] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P e5256d91808b47c195bc9b4dbd7f2b87 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0473d2b2d01f4459b1e90fd12cc7840e for term 19 because replica has last-logged OpId of term: 17 index: 14, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 13.
I20260709 13:06:52.235195 19486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a61655d99124a29b486ba4a5b37faea" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:06:52.235934 19486 raft_consensus.cc:2393] T 1a61655d99124a29b486ba4a5b37faea P 0473d2b2d01f4459b1e90fd12cc7840e [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate e61c3a8f61bb48f8a963c9480e53c168 in current term 15: Already voted for candidate 0473d2b2d01f4459b1e90fd12cc7840e in this term.
I20260709 13:06:52.236176 19411 raft_consensus.cc:1275] T fa8650e71aa14778b3d73721fc50d9fc P e5256d91808b47c195bc9b4dbd7f2b87 [term 17 FOLLOWER]: Refusing update from remote peer 0473d2b2d01f4459b1e90fd12cc7840e: Log matching property violated. Preceding OpId in replica: term: 15 index: 8. Preceding OpId from leader: term: 17 index: 9. (index mismatch)
I20260709 13:06:52.236680 19486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a08760e15aac4630a629431f56024dc8" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:06:52.232287 19409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ec1c4ce15e04c7e8c283a62179f2a64" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:06:52.238683 19478 raft_consensus.cc:2468] T 7be9efa6559648dbb5a0f7684c4542d1 P 0473d2b2d01f4459b1e90fd12cc7840e [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 17.
I20260709 13:06:52.208997 19406 raft_consensus.cc:2468] T 1a61655d99124a29b486ba4a5b37faea P e5256d91808b47c195bc9b4dbd7f2b87 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 15.
I20260709 13:06:52.208043 25309 raft_consensus.cc:493] T edd7d470b5014c9489be7f41f64355c9 P e5256d91808b47c195bc9b4dbd7f2b87 [term 18 FOLLOWER]: Starting leader election (detected failure of leader e61c3a8f61bb48f8a963c9480e53c168)
I20260709 13:06:52.243058 25309 raft_consensus.cc:3060] T edd7d470b5014c9489be7f41f64355c9 P e5256d91808b47c195bc9b4dbd7f2b87 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:06:52.243703 19478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62c6c134d3d24a1ab144dd9ee6bc3f64" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:06:52.173555 19375 leader_election.cc:304] T 2a16f7501e2444fb86d4e2778e734e02 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87; no voters: 127766fc592545a4997f7790f50f6076, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:06:52.223944 19552 raft_consensus.cc:1240] T b08304a0a02b42d7840c4e8ee9a6bd1a P e61c3a8f61bb48f8a963c9480e53c168 [term 17 FOLLOWER]: Rejecting Update request from peer 0473d2b2d01f4459b1e90fd12cc7840e for earlier term 16. Current term is 17. Ops: []
I20260709 13:06:52.247536 19408 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52328 (request call id 2436) took 1132 ms. Trace:
I20260709 13:06:52.247869 19552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70797e5783b5454ab0d0eea663e791e3" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:06:52.228106 25232 leader_election.cc:290] T 70797e5783b5454ab0d0eea663e791e3 P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 19 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:06:52.247917 19408 rpcz_store.cc:276] 0709 13:06:51.114895 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:51.119454 (+  4559us) service_pool.cc:224] Handling call
0709 13:06:51.119889 (+   435us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:51.148346 (+ 28457us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:51.148384 (+    38us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:51.152644 (+  4260us) log.cc:844] Serialized 26 byte log entry
0709 13:06:51.443147 (+290503us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:06:51.443229 (+    82us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:52.247198 (+803969us) spinlock_profiling.cc:243] Waited 12.4 ms on lock 0x7b5400060254. stack: 00007f4a79de9343 00007f4a79de9240 00007f4a797781d4 00007f4a834b6304 00007f4a834b6299 00007f4a7ce71571 00007f4a7cf08e01 00007f4a7cf0783e 00007f4a81ecc419 00007f4a7b443bd4 00007f4a7b443b62 00007f4a7b443a91 00007f4a7b443a0c 00007f4a7b442cc2 00007f4a7b24348c 00007f4a7b2428c6
0709 13:06:52.247237 (+    39us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:52.247283 (+    46us) raft_consensus.cc:1685] finished
0709 13:06:52.247295 (+    12us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:52.247487 (+   192us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3051,"raft.queue_time_us":3239,"raft.run_cpu_time_us":130,"raft.run_wall_time_us":8084,"spinlock_wait_cycles":28506368,"thread_start_us":252931,"threads_started":1,"wal-append.queue_time_us":397187}
W20260709 13:06:52.251281 25438 log.cc:927] Time spent T 9962423cb4e54fcfa5de01daf68a86e7 P 127766fc592545a4997f7790f50f6076: Append to log took a long time: real 0.446s	user 0.000s	sys 0.002s
I20260709 13:06:52.252409 19406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f85fc4b527a48848e5faa083b604e36" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:06:52.252737 25183 leader_election.cc:290] T 309c3ca0ca4b4f3ba129752ea2cb293b P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:06:52.254261 20110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "309c3ca0ca4b4f3ba129752ea2cb293b" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:06:52.255692 19408 raft_consensus.cc:1240] T 1dc5b3532fe54f74876d02beffa2c230 P e5256d91808b47c195bc9b4dbd7f2b87 [term 18 FOLLOWER]: Rejecting Update request from peer 0473d2b2d01f4459b1e90fd12cc7840e for earlier term 17. Current term is 18. Ops: []
I20260709 13:06:52.255810 19523 leader_election.cc:304] T 309c3ca0ca4b4f3ba129752ea2cb293b P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: e61c3a8f61bb48f8a963c9480e53c168; no voters: 127766fc592545a4997f7790f50f6076, e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:06:52.256065 25340 leader_election.cc:290] T ed7fdbcb96d14d418db9ca90a792588a P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
W20260709 13:06:52.259817 19526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.2:46257, user_credentials={real_user=slave}} blocked reactor thread for 49828us
I20260709 13:06:52.260637 25308 raft_consensus.cc:2749] T 309c3ca0ca4b4f3ba129752ea2cb293b P e61c3a8f61bb48f8a963c9480e53c168 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:06:52.197759 19560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4509b76741dc428e9201c70c1658da13" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:06:52.241925 20075 leader_election.cc:304] T 775c229504194560ba9589bc2199b089 P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 127766fc592545a4997f7790f50f6076, e5256d91808b47c195bc9b4dbd7f2b87; no voters: 
I20260709 13:06:52.261286 25308 consensus_queue.cc:1048] T 40e1e16737a842ee936002830f36882e P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:06:52.262534 25370 raft_consensus.cc:2804] T 775c229504194560ba9589bc2199b089 P 127766fc592545a4997f7790f50f6076 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:06:52.262593 25308 consensus_queue.cc:1059] T 28af091831594f9d8e96482078cc7625 P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 }, Status: INVALID_TERM, Last received: 16.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:06:52.263190 25370 raft_consensus.cc:697] T 775c229504194560ba9589bc2199b089 P 127766fc592545a4997f7790f50f6076 [term 13 LEADER]: Becoming Leader. State: Replica: 127766fc592545a4997f7790f50f6076, State: Running, Role: LEADER
I20260709 13:06:52.263725 25086 raft_consensus.cc:3055] T 28af091831594f9d8e96482078cc7625 P e61c3a8f61bb48f8a963c9480e53c168 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:06:52.264098 25086 raft_consensus.cc:740] T 28af091831594f9d8e96482078cc7625 P e61c3a8f61bb48f8a963c9480e53c168 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: e61c3a8f61bb48f8a963c9480e53c168, State: Running, Role: LEADER
I20260709 13:06:52.264063 25370 consensus_queue.cc:237] T 775c229504194560ba9589bc2199b089 P 127766fc592545a4997f7790f50f6076 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:52.265362 25086 consensus_queue.cc:260] T 28af091831594f9d8e96482078cc7625 P e61c3a8f61bb48f8a963c9480e53c168 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 17.10, Last appended by leader: 10, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:52.267700 19449 leader_election.cc:304] T ff75a1d4cb1f493db8f71ddc136ba9ab P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e; no voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:06:52.267887 19478 raft_consensus.cc:2468] T 62c6c134d3d24a1ab144dd9ee6bc3f64 P 0473d2b2d01f4459b1e90fd12cc7840e [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 15.
I20260709 13:06:52.150451 25345 raft_consensus.cc:3060] T 775c229504194560ba9589bc2199b089 P 0473d2b2d01f4459b1e90fd12cc7840e [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:06:52.287111 19375 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.3:36891, user_credentials={real_user=slave}} blocked reactor thread for 113633us
I20260709 13:06:52.287966 19486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48824d5acfbc485ebf8c2d944e7202de" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:06:52.272492 19478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48824d5acfbc485ebf8c2d944e7202de" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:06:52.199309 19402 raft_consensus.cc:1275] T 2725d2c4cb054f18b0fc8f735c15f6c2 P e5256d91808b47c195bc9b4dbd7f2b87 [term 19 FOLLOWER]: Refusing update from remote peer 0473d2b2d01f4459b1e90fd12cc7840e: Log matching property violated. Preceding OpId in replica: term: 17 index: 9. Preceding OpId from leader: term: 19 index: 10. (index mismatch)
I20260709 13:06:52.276477 19450 leader_election.cc:304] T 22196caba61445d3bec98a0aab3c337d P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e; no voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:06:52.277549 19407 raft_consensus.cc:2468] T 28af091831594f9d8e96482078cc7625 P e5256d91808b47c195bc9b4dbd7f2b87 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 18.
I20260709 13:06:52.205348 19558 raft_consensus.cc:2468] T 6c5eebf646ad445a9d1b1adc319d7b16 P e61c3a8f61bb48f8a963c9480e53c168 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 18.
I20260709 13:06:52.152034 25452 raft_consensus.cc:493] T 9962423cb4e54fcfa5de01daf68a86e7 P 0473d2b2d01f4459b1e90fd12cc7840e [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 127766fc592545a4997f7790f50f6076)
I20260709 13:06:52.315776 19478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f85fc4b527a48848e5faa083b604e36" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:06:52.321784 19478 raft_consensus.cc:2468] T 1f85fc4b527a48848e5faa083b604e36 P 0473d2b2d01f4459b1e90fd12cc7840e [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 127766fc592545a4997f7790f50f6076 in term 15.
I20260709 13:06:52.140031 25408 raft_consensus.cc:515] T 0cdf56e38bbc453d9438d359e5a69955 P e5256d91808b47c195bc9b4dbd7f2b87 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
W20260709 13:06:52.321869 19450 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.3:36891, user_credentials={real_user=slave}} blocked reactor thread for 45525.9us
I20260709 13:06:52.322938 19478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36f6ba92b9ba46babe4ebd6c02e5fbd9" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:06:52.323104 19450 leader_election.cc:304] T 3e1f505cb0f1427bbd698ac889d80821 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e; no voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:06:52.137547 25100 raft_consensus.cc:515] T ab43d85f64114d4ebf618930e43d9ed0 P e5256d91808b47c195bc9b4dbd7f2b87 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } attrs { replace: true } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:52.290112 19526 leader_election.cc:304] T 62c6c134d3d24a1ab144dd9ee6bc3f64 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168; no voters: 127766fc592545a4997f7790f50f6076
I20260709 13:06:52.323980 19478 raft_consensus.cc:2393] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P 0473d2b2d01f4459b1e90fd12cc7840e [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 127766fc592545a4997f7790f50f6076 in current term 18: Already voted for candidate 0473d2b2d01f4459b1e90fd12cc7840e in this term.
W20260709 13:06:52.332193 19375 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.3:36891, user_credentials={real_user=slave}} blocked reactor thread for 43527.4us
I20260709 13:06:52.271046 25403 raft_consensus.cc:697] T 7be9efa6559648dbb5a0f7684c4542d1 P e5256d91808b47c195bc9b4dbd7f2b87 [term 17 LEADER]: Becoming Leader. State: Replica: e5256d91808b47c195bc9b4dbd7f2b87, State: Running, Role: LEADER
I20260709 13:06:52.347327 19411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "309c3ca0ca4b4f3ba129752ea2cb293b" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:06:52.356341 19486 raft_consensus.cc:2468] T 48824d5acfbc485ebf8c2d944e7202de P 0473d2b2d01f4459b1e90fd12cc7840e [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 19.
I20260709 13:06:52.357820 19486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f93ee515a9c14139bf566522ed8232f3" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 19 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:06:52.369514 19478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "217b5fae677b4971b3bbd2f357a1f7ff" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:06:52.292682 25350 raft_consensus.cc:2749] T ff75a1d4cb1f493db8f71ddc136ba9ab P 0473d2b2d01f4459b1e90fd12cc7840e [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:06:52.371183 19478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "775c229504194560ba9589bc2199b089" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:06:52.394033 19403 raft_consensus.cc:1240] T 0cdf56e38bbc453d9438d359e5a69955 P e5256d91808b47c195bc9b4dbd7f2b87 [term 17 FOLLOWER]: Rejecting Update request from peer 0473d2b2d01f4459b1e90fd12cc7840e for earlier term 16. Current term is 17. Ops: []
I20260709 13:06:52.393533 19483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edd7d470b5014c9489be7f41f64355c9" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:06:52.382917 19486 raft_consensus.cc:2393] T f93ee515a9c14139bf566522ed8232f3 P 0473d2b2d01f4459b1e90fd12cc7840e [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e5256d91808b47c195bc9b4dbd7f2b87 in current term 19: Already voted for candidate 0473d2b2d01f4459b1e90fd12cc7840e in this term.
I20260709 13:06:52.395241 19483 raft_consensus.cc:2393] T edd7d470b5014c9489be7f41f64355c9 P 0473d2b2d01f4459b1e90fd12cc7840e [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e5256d91808b47c195bc9b4dbd7f2b87 in current term 19: Already voted for candidate 0473d2b2d01f4459b1e90fd12cc7840e in this term.
I20260709 13:06:52.395145 19402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70797e5783b5454ab0d0eea663e791e3" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
I20260709 13:06:52.396857 19478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4509b76741dc428e9201c70c1658da13" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:06:52.260988 25309 raft_consensus.cc:515] T edd7d470b5014c9489be7f41f64355c9 P e5256d91808b47c195bc9b4dbd7f2b87 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
W20260709 13:06:52.401255 19449 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.1:40321, user_credentials={real_user=slave}} blocked reactor thread for 74219.3us
I20260709 13:06:52.402740 19478 raft_consensus.cc:2468] T 4509b76741dc428e9201c70c1658da13 P 0473d2b2d01f4459b1e90fd12cc7840e [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 10.
I20260709 13:06:52.333073 25304 raft_consensus.cc:493] T 76cb037fc9064d13b59a8969d897ce8c P e5256d91808b47c195bc9b4dbd7f2b87 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 0473d2b2d01f4459b1e90fd12cc7840e)
W20260709 13:06:52.405541 19375 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.3:36891, user_credentials={real_user=slave}} blocked reactor thread for 72647.3us
I20260709 13:06:52.345510 25246 raft_consensus.cc:2749] T 22196caba61445d3bec98a0aab3c337d P 0473d2b2d01f4459b1e90fd12cc7840e [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:06:52.287016 25376 raft_consensus.cc:515] T ff9b0eddd810459b82d91c60777c10eb P 0473d2b2d01f4459b1e90fd12cc7840e [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:52.428699 19449 leader_election.cc:304] T 28af091831594f9d8e96482078cc7625 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87; no voters: e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:06:52.429816 19404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ec1c4ce15e04c7e8c283a62179f2a64" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
W20260709 13:06:52.414830 19377 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.2:46257, user_credentials={real_user=slave}} blocked reactor thread for 81059.3us
I20260709 13:06:52.407023 19408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f85fc4b527a48848e5faa083b604e36" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:06:52.325424 25188 raft_consensus.cc:493] T 86a6797bdfe94fa496c050ceae4bd0d9 P 0473d2b2d01f4459b1e90fd12cc7840e [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:06:52.391049 19526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.2:46257, user_credentials={real_user=slave}} blocked reactor thread for 101013us
I20260709 13:06:52.419402 19486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62c6c134d3d24a1ab144dd9ee6bc3f64" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:06:52.179244 25417 consensus_queue.cc:237] T 14935b3ddf914369822e4a0547aaa355 P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:52.179623 25434 consensus_queue.cc:260] T 76cb037fc9064d13b59a8969d897ce8c P 0473d2b2d01f4459b1e90fd12cc7840e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.8, Last appended by leader: 8, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
W20260709 13:06:52.440137 20078 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.2:46257, user_credentials={real_user=slave}} blocked reactor thread for 201836us
I20260709 13:06:52.404891 19483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ec1c4ce15e04c7e8c283a62179f2a64" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:06:52.452886 19483 raft_consensus.cc:2468] T 5ec1c4ce15e04c7e8c283a62179f2a64 P 0473d2b2d01f4459b1e90fd12cc7840e [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 127766fc592545a4997f7790f50f6076 in term 11.
I20260709 13:06:52.322533 25355 consensus_queue.cc:1048] T fa8650e71aa14778b3d73721fc50d9fc P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.083s
I20260709 13:06:52.404415 25456 raft_consensus.cc:2804] T 62c6c134d3d24a1ab144dd9ee6bc3f64 P e61c3a8f61bb48f8a963c9480e53c168 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:06:52.472581 20112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ec1c4ce15e04c7e8c283a62179f2a64" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:06:52.407948 25403 consensus_queue.cc:237] T 7be9efa6559648dbb5a0f7684c4542d1 P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 17, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } attrs { replace: true } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:52.445014 19486 raft_consensus.cc:2468] T 62c6c134d3d24a1ab144dd9ee6bc3f64 P 0473d2b2d01f4459b1e90fd12cc7840e [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 127766fc592545a4997f7790f50f6076 in term 15.
I20260709 13:06:52.328073 25340 consensus_queue.cc:1059] T b08304a0a02b42d7840c4e8ee9a6bd1a P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 }, Status: INVALID_TERM, Last received: 16.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.083s
I20260709 13:06:52.332152 25404 raft_consensus.cc:493] T b9f0d59553ad444883fcf5b5909f9798 P e5256d91808b47c195bc9b4dbd7f2b87 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader e61c3a8f61bb48f8a963c9480e53c168)
I20260709 13:06:52.449833 19477 raft_consensus.cc:1275] T 7f575b143b844aa096b50997dad3516a P 0473d2b2d01f4459b1e90fd12cc7840e [term 14 FOLLOWER]: Refusing update from remote peer e5256d91808b47c195bc9b4dbd7f2b87: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
W20260709 13:06:52.450703 19452 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:52.453099 19377 leader_election.cc:304] T 28af091831594f9d8e96482078cc7625 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:06:52.455502 19450 leader_election.cc:304] T 4509b76741dc428e9201c70c1658da13 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e; no voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:06:52.456331 20107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36f6ba92b9ba46babe4ebd6c02e5fbd9" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 19 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:06:52.463291 19483 raft_consensus.cc:1240] T 0e1085d23e8347fbbd5bce7542f4b1f4 P 0473d2b2d01f4459b1e90fd12cc7840e [term 13 FOLLOWER]: Rejecting Update request from peer 127766fc592545a4997f7790f50f6076 for earlier term 12. Current term is 13. Ops: []
I20260709 13:06:52.425170 25459 raft_consensus.cc:493] T 1dc5b3532fe54f74876d02beffa2c230 P e61c3a8f61bb48f8a963c9480e53c168 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 0473d2b2d01f4459b1e90fd12cc7840e)
I20260709 13:06:52.439323 25329 raft_consensus.cc:2749] T 3e1f505cb0f1427bbd698ac889d80821 P 0473d2b2d01f4459b1e90fd12cc7840e [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:06:52.480887 20105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14efcc79969f41babe5529c22d59156d" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:06:52.481540 20110 raft_consensus.cc:1275] T 6c5eebf646ad445a9d1b1adc319d7b16 P 127766fc592545a4997f7790f50f6076 [term 18 FOLLOWER]: Refusing update from remote peer 0473d2b2d01f4459b1e90fd12cc7840e: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 18 index: 13. (index mismatch)
I20260709 13:06:52.441105 25221 raft_consensus.cc:493] T 1efebf73c86e432baa55533136b6e12c P 127766fc592545a4997f7790f50f6076 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 0473d2b2d01f4459b1e90fd12cc7840e)
I20260709 13:06:52.487088 20112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e1085d23e8347fbbd5bce7542f4b1f4" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076"
W20260709 13:06:52.511607 25458 log.cc:927] Time spent T 3e1f505cb0f1427bbd698ac889d80821 P 0473d2b2d01f4459b1e90fd12cc7840e: Append to log took a long time: real 0.064s	user 0.000s	sys 0.000s
I20260709 13:06:52.528383 20112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f85fc4b527a48848e5faa083b604e36" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
W20260709 13:06:52.532837 19524 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:52.511246 25456 raft_consensus.cc:697] T 62c6c134d3d24a1ab144dd9ee6bc3f64 P e61c3a8f61bb48f8a963c9480e53c168 [term 15 LEADER]: Becoming Leader. State: Replica: e61c3a8f61bb48f8a963c9480e53c168, State: Running, Role: LEADER
I20260709 13:06:52.453536 25455 raft_consensus.cc:2804] T 28af091831594f9d8e96482078cc7625 P 0473d2b2d01f4459b1e90fd12cc7840e [term 18 FOLLOWER]: Leader election won for term 18
W20260709 13:06:52.518127 19484 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.585s	user 0.012s	sys 0.002s
I20260709 13:06:52.459815 25223 raft_consensus.cc:493] T ab43d85f64114d4ebf618930e43d9ed0 P 127766fc592545a4997f7790f50f6076 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:52.343896 25452 raft_consensus.cc:515] T 9962423cb4e54fcfa5de01daf68a86e7 P 0473d2b2d01f4459b1e90fd12cc7840e [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
W20260709 13:06:52.520290 19377 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.2:46257, user_credentials={real_user=slave}} blocked reactor thread for 67272us
I20260709 13:06:52.566114 19377 leader_election.cc:304] T 172b3dd13109415a955b71ac0e9d2234 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, 127766fc592545a4997f7790f50f6076
I20260709 13:06:52.431262 25350 consensus_queue.cc:1048] T 2725d2c4cb054f18b0fc8f735c15f6c2 P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.057s
I20260709 13:06:52.441629 25304 raft_consensus.cc:515] T 76cb037fc9064d13b59a8969d897ce8c P e5256d91808b47c195bc9b4dbd7f2b87 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
W20260709 13:06:52.496253 19451 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:52.527463 19450 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.3:36891, user_credentials={real_user=slave}} blocked reactor thread for 72036.8us
I20260709 13:06:52.535097 19449 leader_election.cc:304] T 5ec1c4ce15e04c7e8c283a62179f2a64 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e; no voters: 127766fc592545a4997f7790f50f6076, e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:06:52.444761 19526 leader_election.cc:304] T 48824d5acfbc485ebf8c2d944e7202de P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168; no voters: 127766fc592545a4997f7790f50f6076
I20260709 13:06:52.461622 25433 raft_consensus.cc:515] T a08760e15aac4630a629431f56024dc8 P 0473d2b2d01f4459b1e90fd12cc7840e [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:52.547988 20105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed7fdbcb96d14d418db9ca90a792588a" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:06:52.586356 20105 raft_consensus.cc:2468] T ed7fdbcb96d14d418db9ca90a792588a P 127766fc592545a4997f7790f50f6076 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 14.
I20260709 13:06:52.443984 25188 raft_consensus.cc:515] T 86a6797bdfe94fa496c050ceae4bd0d9 P 0473d2b2d01f4459b1e90fd12cc7840e [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:52.547483 20104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "309c3ca0ca4b4f3ba129752ea2cb293b" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
W20260709 13:06:52.551015 19484 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.622s	user 0.012s	sys 0.003s
I20260709 13:06:52.526286 25457 raft_consensus.cc:493] T ed7fdbcb96d14d418db9ca90a792588a P e61c3a8f61bb48f8a963c9480e53c168 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:06:52.589362 19449 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.4:43121, user_credentials={real_user=slave}} blocked reactor thread for 54354us
I20260709 13:06:52.527846 24972 raft_consensus.cc:2749] T 28af091831594f9d8e96482078cc7625 P e5256d91808b47c195bc9b4dbd7f2b87 [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:06:52.567433 19482 raft_consensus.cc:1240] T 46c5bfeecc314717bffe987e6844b6d0 P 0473d2b2d01f4459b1e90fd12cc7840e [term 23 LEADER]: Rejecting Update request from peer e61c3a8f61bb48f8a963c9480e53c168 for earlier term 22. Current term is 23. Ops: []
I20260709 13:06:52.524782 25461 consensus_queue.cc:1059] T 1dc5b3532fe54f74876d02beffa2c230 P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 }, Status: INVALID_TERM, Last received: 17.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.137s
I20260709 13:06:52.529297 25332 raft_consensus.cc:2749] T 4509b76741dc428e9201c70c1658da13 P 0473d2b2d01f4459b1e90fd12cc7840e [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:06:52.583823 20078 leader_election.cc:304] T 48824d5acfbc485ebf8c2d944e7202de P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 127766fc592545a4997f7790f50f6076; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:06:52.547638 25445 raft_consensus.cc:493] T 14935b3ddf914369822e4a0547aaa355 P e61c3a8f61bb48f8a963c9480e53c168 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:06:52.585384 19526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.2:46257, user_credentials={real_user=slave}} blocked reactor thread for 140688us
I20260709 13:06:52.609478 19526 leader_election.cc:304] T 4509b76741dc428e9201c70c1658da13 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:06:52.531157 25221 raft_consensus.cc:515] T 1efebf73c86e432baa55533136b6e12c P 127766fc592545a4997f7790f50f6076 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
W20260709 13:06:52.600190 19449 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:52.520546 25404 raft_consensus.cc:515] T b9f0d59553ad444883fcf5b5909f9798 P e5256d91808b47c195bc9b4dbd7f2b87 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:52.602753 19477 pending_rounds.cc:85] T 9962423cb4e54fcfa5de01daf68a86e7 P 0473d2b2d01f4459b1e90fd12cc7840e: Aborting all ops after (but not including) 11
I20260709 13:06:52.612953 19477 pending_rounds.cc:107] T 9962423cb4e54fcfa5de01daf68a86e7 P 0473d2b2d01f4459b1e90fd12cc7840e: Aborting uncommitted NO_OP operation due to leader change: 16.12
I20260709 13:06:52.613268 19477 raft_consensus.cc:2889] T 9962423cb4e54fcfa5de01daf68a86e7 P 0473d2b2d01f4459b1e90fd12cc7840e [term 17 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:06:52.580248 25455 raft_consensus.cc:697] T 28af091831594f9d8e96482078cc7625 P 0473d2b2d01f4459b1e90fd12cc7840e [term 18 LEADER]: Becoming Leader. State: Replica: 0473d2b2d01f4459b1e90fd12cc7840e, State: Running, Role: LEADER
I20260709 13:06:52.533622 25246 consensus_queue.cc:1059] T b08304a0a02b42d7840c4e8ee9a6bd1a P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 }, Status: INVALID_TERM, Last received: 16.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.055s
W20260709 13:06:52.605607 19375 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.3:36891, user_credentials={real_user=slave}} blocked reactor thread for 179346us
I20260709 13:06:52.611074 19485 raft_consensus.cc:2393] T a08760e15aac4630a629431f56024dc8 P 0473d2b2d01f4459b1e90fd12cc7840e [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e5256d91808b47c195bc9b4dbd7f2b87 in current term 21: Already voted for candidate 0473d2b2d01f4459b1e90fd12cc7840e in this term.
I20260709 13:06:52.594369 19377 leader_election.cc:304] T 40e1e16737a842ee936002830f36882e P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87; no voters: e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:06:52.610411 20078 leader_election.cc:304] T 1f85fc4b527a48848e5faa083b604e36 P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, 127766fc592545a4997f7790f50f6076; no voters: 
I20260709 13:06:52.591251 25416 raft_consensus.cc:493] T 96efeaaf1057492490e9a621f37e1a2d P 0473d2b2d01f4459b1e90fd12cc7840e [term 19 FOLLOWER]: Starting pre-election (detected failure of leader e61c3a8f61bb48f8a963c9480e53c168)
I20260709 13:06:52.616106 19478 raft_consensus.cc:1240] T 86a6797bdfe94fa496c050ceae4bd0d9 P 0473d2b2d01f4459b1e90fd12cc7840e [term 14 FOLLOWER]: Rejecting Update request from peer e5256d91808b47c195bc9b4dbd7f2b87 for earlier term 13. Current term is 14. Ops: []
I20260709 13:06:52.513628 25338 raft_consensus.cc:493] T 1efebf73c86e432baa55533136b6e12c P e61c3a8f61bb48f8a963c9480e53c168 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 0473d2b2d01f4459b1e90fd12cc7840e)
I20260709 13:06:52.618728 19449 leader_election.cc:304] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e; no voters: 127766fc592545a4997f7790f50f6076, e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:06:52.601593 25183 raft_consensus.cc:2804] T 48824d5acfbc485ebf8c2d944e7202de P e61c3a8f61bb48f8a963c9480e53c168 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:06:52.612998 25359 raft_consensus.cc:493] T 14935b3ddf914369822e4a0547aaa355 P 127766fc592545a4997f7790f50f6076 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:52.613207 25227 raft_consensus.cc:2749] T 48824d5acfbc485ebf8c2d944e7202de P 127766fc592545a4997f7790f50f6076 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:06:52.617473 25411 raft_consensus.cc:2804] T 4509b76741dc428e9201c70c1658da13 P e61c3a8f61bb48f8a963c9480e53c168 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:06:52.602322 25368 leader_election.cc:290] T ed7fdbcb96d14d418db9ca90a792588a P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
W20260709 13:06:52.615897 19523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.1:40321, user_credentials={real_user=slave}} blocked reactor thread for 199105us
I20260709 13:06:52.585378 25237 consensus_queue.cc:1048] T 2725d2c4cb054f18b0fc8f735c15f6c2 P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.039s
I20260709 13:06:52.631546 19375 leader_election.cc:304] T a08760e15aac4630a629431f56024dc8 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:06:52.566128 20112 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "172b3dd13109415a955b71ac0e9d2234"
dest_uuid: "127766fc592545a4997f7790f50f6076"
mode: GRACEFUL
new_leader_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
 from {username='slave'} at 127.0.0.1:48686
I20260709 13:06:52.657260 20112 raft_consensus.cc:606] T 172b3dd13109415a955b71ac0e9d2234 P 127766fc592545a4997f7790f50f6076 [term 16 LEADER]: Received request to transfer leadership to TS 0473d2b2d01f4459b1e90fd12cc7840e
I20260709 13:06:52.579568 25223 raft_consensus.cc:515] T ab43d85f64114d4ebf618930e43d9ed0 P 127766fc592545a4997f7790f50f6076 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:52.604435 25392 raft_consensus.cc:2749] T 172b3dd13109415a955b71ac0e9d2234 P e5256d91808b47c195bc9b4dbd7f2b87 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:06:52.603858 25373 raft_consensus.cc:2749] T 5ec1c4ce15e04c7e8c283a62179f2a64 P 0473d2b2d01f4459b1e90fd12cc7840e [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:06:52.654971 25411 raft_consensus.cc:493] T 4509b76741dc428e9201c70c1658da13 P e61c3a8f61bb48f8a963c9480e53c168 [term 10 FOLLOWER]: Starting leader election (detected failure of leader e5256d91808b47c195bc9b4dbd7f2b87)
I20260709 13:06:52.655896 19449 leader_election.cc:304] T 0e1085d23e8347fbbd5bce7542f4b1f4 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e; no voters: 127766fc592545a4997f7790f50f6076, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:06:52.661916 19558 raft_consensus.cc:1240] T 86a6797bdfe94fa496c050ceae4bd0d9 P e61c3a8f61bb48f8a963c9480e53c168 [term 14 LEADER]: Rejecting Update request from peer e5256d91808b47c195bc9b4dbd7f2b87 for earlier term 13. Current term is 14. Ops: []
I20260709 13:06:52.651312 25447 raft_consensus.cc:2804] T 40e1e16737a842ee936002830f36882e P e5256d91808b47c195bc9b4dbd7f2b87 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:06:52.652729 25397 raft_consensus.cc:493] T 6c5eebf646ad445a9d1b1adc319d7b16 P 127766fc592545a4997f7790f50f6076 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:52.644436 25232 raft_consensus.cc:2804] T 1f85fc4b527a48848e5faa083b604e36 P 127766fc592545a4997f7790f50f6076 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:06:52.657382 25332 raft_consensus.cc:493] T edd7d470b5014c9489be7f41f64355c9 P 0473d2b2d01f4459b1e90fd12cc7840e [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:52.650099 25408 leader_election.cc:290] T 0cdf56e38bbc453d9438d359e5a69955 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 17 election: Requested vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:06:52.715857 19551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cdf56e38bbc453d9438d359e5a69955" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
W20260709 13:06:52.653043 19377 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.2:46257, user_credentials={real_user=slave}} blocked reactor thread for 58757.4us
I20260709 13:06:52.659974 25183 raft_consensus.cc:697] T 48824d5acfbc485ebf8c2d944e7202de P e61c3a8f61bb48f8a963c9480e53c168 [term 19 LEADER]: Becoming Leader. State: Replica: e61c3a8f61bb48f8a963c9480e53c168, State: Running, Role: LEADER
I20260709 13:06:52.643024 25422 raft_consensus.cc:515] T 2b74109013a140ada21feeef92d6f563 P e61c3a8f61bb48f8a963c9480e53c168 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:52.683477 25461 raft_consensus.cc:2749] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P 0473d2b2d01f4459b1e90fd12cc7840e [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:06:52.711797 25396 raft_consensus.cc:2804] T a08760e15aac4630a629431f56024dc8 P e5256d91808b47c195bc9b4dbd7f2b87 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:06:52.683859 25376 leader_election.cc:290] T ff9b0eddd810459b82d91c60777c10eb P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:06:52.741892 25447 raft_consensus.cc:493] T 40e1e16737a842ee936002830f36882e P e5256d91808b47c195bc9b4dbd7f2b87 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:52.751655 19377 leader_election.cc:304] T 1dc5b3532fe54f74876d02beffa2c230 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:06:52.750204 19551 raft_consensus.cc:3060] T 0cdf56e38bbc453d9438d359e5a69955 P e61c3a8f61bb48f8a963c9480e53c168 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:06:52.752424 25397 raft_consensus.cc:515] T 6c5eebf646ad445a9d1b1adc319d7b16 P 127766fc592545a4997f7790f50f6076 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
W20260709 13:06:52.753863 25466 log.cc:927] Time spent T 179fd671030940b4b4a4e24bcc4aba0a P e61c3a8f61bb48f8a963c9480e53c168: Append to log took a long time: real 0.110s	user 0.000s	sys 0.000s
I20260709 13:06:52.661670 25359 raft_consensus.cc:515] T 14935b3ddf914369822e4a0547aaa355 P 127766fc592545a4997f7790f50f6076 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:52.731889 25411 raft_consensus.cc:3060] T 4509b76741dc428e9201c70c1658da13 P e61c3a8f61bb48f8a963c9480e53c168 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:06:52.657168 25338 raft_consensus.cc:515] T 1efebf73c86e432baa55533136b6e12c P e61c3a8f61bb48f8a963c9480e53c168 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:52.649427 25462 consensus_queue.cc:1048] T 2e36a9d6e29c4a7c860cf267efbd4c74 P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.270s
I20260709 13:06:52.746861 25232 raft_consensus.cc:493] T 1f85fc4b527a48848e5faa083b604e36 P 127766fc592545a4997f7790f50f6076 [term 15 FOLLOWER]: Starting leader election (detected failure of leader e5256d91808b47c195bc9b4dbd7f2b87)
I20260709 13:06:52.619498 25445 raft_consensus.cc:515] T 14935b3ddf914369822e4a0547aaa355 P e61c3a8f61bb48f8a963c9480e53c168 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:52.531014 25459 raft_consensus.cc:515] T 1dc5b3532fe54f74876d02beffa2c230 P e61c3a8f61bb48f8a963c9480e53c168 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:52.800271 25459 leader_election.cc:290] T 1dc5b3532fe54f74876d02beffa2c230 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:06:52.646636 25416 raft_consensus.cc:515] T 96efeaaf1057492490e9a621f37e1a2d P 0473d2b2d01f4459b1e90fd12cc7840e [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:52.801174 25232 raft_consensus.cc:3060] T 1f85fc4b527a48848e5faa083b604e36 P 127766fc592545a4997f7790f50f6076 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:06:52.801688 25097 consensus_queue.cc:260] T 217b5fae677b4971b3bbd2f357a1f7ff P 0473d2b2d01f4459b1e90fd12cc7840e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:52.803562 25433 leader_election.cc:290] T a08760e15aac4630a629431f56024dc8 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 21 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:06:52.607364 25457 raft_consensus.cc:515] T ed7fdbcb96d14d418db9ca90a792588a P e61c3a8f61bb48f8a963c9480e53c168 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:52.784276 25100 leader_election.cc:290] T ab43d85f64114d4ebf618930e43d9ed0 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
W20260709 13:06:52.787142 25470 log.cc:927] Time spent T 96efeaaf1057492490e9a621f37e1a2d P 0473d2b2d01f4459b1e90fd12cc7840e: Append to log took a long time: real 0.137s	user 0.001s	sys 0.000s
W20260709 13:06:52.787859 25468 log.cc:927] Time spent T 46c5bfeecc314717bffe987e6844b6d0 P 0473d2b2d01f4459b1e90fd12cc7840e: Append to log took a long time: real 0.136s	user 0.000s	sys 0.000s
I20260709 13:06:52.789829 25338 leader_election.cc:290] T 1efebf73c86e432baa55533136b6e12c P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:06:52.790504 25304 leader_election.cc:290] T 76cb037fc9064d13b59a8969d897ce8c P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
W20260709 13:06:52.791380 25473 log.cc:927] Time spent T 2b74109013a140ada21feeef92d6f563 P 0473d2b2d01f4459b1e90fd12cc7840e: Append to log took a long time: real 0.082s	user 0.000s	sys 0.000s
I20260709 13:06:52.792225 25404 leader_election.cc:290] T b9f0d59553ad444883fcf5b5909f9798 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:06:52.775712 25447 raft_consensus.cc:3060] T 40e1e16737a842ee936002830f36882e P e5256d91808b47c195bc9b4dbd7f2b87 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:06:52.793776 25422 leader_election.cc:290] T 2b74109013a140ada21feeef92d6f563 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 15 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
W20260709 13:06:52.794739 25471 log.cc:927] Time spent T ab43d85f64114d4ebf618930e43d9ed0 P 0473d2b2d01f4459b1e90fd12cc7840e: Append to log took a long time: real 0.072s	user 0.000s	sys 0.000s
I20260709 13:06:52.795047 25452 leader_election.cc:290] T 9962423cb4e54fcfa5de01daf68a86e7 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:06:52.864651 25309 leader_election.cc:290] T edd7d470b5014c9489be7f41f64355c9 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 19 election: Requested vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:06:52.865029 25359 leader_election.cc:290] T 14935b3ddf914369822e4a0547aaa355 P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:06:52.819275 25056 raft_consensus.cc:2749] T 2a16f7501e2444fb86d4e2778e734e02 P e5256d91808b47c195bc9b4dbd7f2b87 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:06:52.866428 25138 raft_consensus.cc:3055] T 46c5bfeecc314717bffe987e6844b6d0 P e61c3a8f61bb48f8a963c9480e53c168 [term 22 LEADER]: Stepping down as leader of term 22
I20260709 13:06:52.867056 25138 raft_consensus.cc:740] T 46c5bfeecc314717bffe987e6844b6d0 P e61c3a8f61bb48f8a963c9480e53c168 [term 22 LEADER]: Becoming Follower/Learner. State: Replica: e61c3a8f61bb48f8a963c9480e53c168, State: Running, Role: LEADER
I20260709 13:06:52.867897 25138 consensus_queue.cc:260] T 46c5bfeecc314717bffe987e6844b6d0 P e61c3a8f61bb48f8a963c9480e53c168 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 22.12, Last appended by leader: 12, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:52.868880 25138 raft_consensus.cc:3060] T 46c5bfeecc314717bffe987e6844b6d0 P e61c3a8f61bb48f8a963c9480e53c168 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:06:52.870070 25090 raft_consensus.cc:3060] T 70797e5783b5454ab0d0eea663e791e3 P e5256d91808b47c195bc9b4dbd7f2b87 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:06:52.875392 19482 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58286 (request call id 2516) took 1279 ms. Trace:
I20260709 13:06:52.875836 19482 rpcz_store.cc:276] 0709 13:06:51.596318 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:51.596477 (+   159us) service_pool.cc:224] Handling call
0709 13:06:51.645476 (+ 48999us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:52.597711 (+952235us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:52.875115 (+277404us) spinlock_profiling.cc:243] Waited 922 ms on lock 0x7b5400353c54. stack: 00007f4a79de9343 00007f4a79de9240 00007f4a797781d4 00007f4a834b6304 00007f4a834b6299 00007f4a7ce71571 00007f4a7cf08e01 00007f4a7cf0783e 00007f4a81ecc419 00007f4a7b443bd4 00007f4a7b443b62 00007f4a7b443a91 00007f4a7b443a0c 00007f4a7b442cc2 00007f4a7b24348c 00007f4a7b2428c6
0709 13:06:52.875327 (+   212us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2119928704}
I20260709 13:06:52.881827 25232 raft_consensus.cc:515] T 1f85fc4b527a48848e5faa083b604e36 P 127766fc592545a4997f7790f50f6076 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:52.796486 25223 leader_election.cc:290] T ab43d85f64114d4ebf618930e43d9ed0 P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:06:52.796192 25183 consensus_queue.cc:237] T 48824d5acfbc485ebf8c2d944e7202de P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 18.13, Last appended by leader: 13, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:52.778426 25461 raft_consensus.cc:2749] T 0e1085d23e8347fbbd5bce7542f4b1f4 P 0473d2b2d01f4459b1e90fd12cc7840e [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:06:52.798147 25221 leader_election.cc:290] T 1efebf73c86e432baa55533136b6e12c P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
W20260709 13:06:52.807488 19377 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.2:46257, user_credentials={real_user=slave}} blocked reactor thread for 55935.1us
I20260709 13:06:52.819689 25400 raft_consensus.cc:2749] T 1dc5b3532fe54f74876d02beffa2c230 P e5256d91808b47c195bc9b4dbd7f2b87 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:06:52.826618 19551 raft_consensus.cc:2468] T 0cdf56e38bbc453d9438d359e5a69955 P e61c3a8f61bb48f8a963c9480e53c168 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 17.
I20260709 13:06:52.916112 19484 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58286 (request call id 2517) took 1319 ms. Trace:
I20260709 13:06:52.756179 25332 raft_consensus.cc:515] T edd7d470b5014c9489be7f41f64355c9 P 0473d2b2d01f4459b1e90fd12cc7840e [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:52.916637 19484 rpcz_store.cc:276] 0709 13:06:51.596584 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:51.596971 (+   387us) service_pool.cc:224] Handling call
0709 13:06:51.647032 (+ 50061us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:51.844393 (+197361us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:51.844464 (+    71us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:51.852385 (+  7921us) log.cc:844] Serialized 26 byte log entry
0709 13:06:52.258000 (+405615us) spinlock_profiling.cc:243] Waited 3.8 ms on lock 0x7b48001ec258. stack: 00007f4a79de9343 00007f4a79de9240 00007f4a797781d4 00007f4a834b6304 00007f4a834b6299 00007f4a81e31aa1 00007f4a81e28b37 00007f4a81e289ca 00007f4a81f2026f 00007f4a81f1ff37 00007f4a81f3455c 00007f4a81f34508 00007f4a81f34488 00007f4a81f34443 00007f4a81f336ec 00007f4a80e5da96
0709 13:06:52.588837 (+330837us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:06:52.588878 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:52.588977 (+    99us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:52.915726 (+326749us) raft_consensus.cc:1685] finished
0709 13:06:52.915754 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:52.916039 (+   285us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1470,"raft.queue_time_us":116532,"raft.run_cpu_time_us":2365,"raft.run_wall_time_us":467109,"spinlock_wait_cycles":8729472,"thread_start_us":843249,"threads_started":2,"wal-append.queue_time_us":731606}
I20260709 13:06:52.782433 25188 leader_election.cc:290] T 86a6797bdfe94fa496c050ceae4bd0d9 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:06:52.677526 25456 consensus_queue.cc:237] T 62c6c134d3d24a1ab144dd9ee6bc3f64 P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:52.779904 25396 raft_consensus.cc:697] T a08760e15aac4630a629431f56024dc8 P e5256d91808b47c195bc9b4dbd7f2b87 [term 21 LEADER]: Becoming Leader. State: Replica: e5256d91808b47c195bc9b4dbd7f2b87, State: Running, Role: LEADER
W20260709 13:06:52.884289 19525 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:52.751024 25455 consensus_queue.cc:237] T 28af091831594f9d8e96482078cc7625 P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.9, Last appended by leader: 9, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:52.922595 19377 leader_election.cc:304] T f1b10566f45d4a7d9029858330e02d5b P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:06:52.894941 25397 leader_election.cc:290] T 6c5eebf646ad445a9d1b1adc319d7b16 P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:06:52.900056 25445 leader_election.cc:290] T 14935b3ddf914369822e4a0547aaa355 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:06:52.908969 25411 raft_consensus.cc:515] T 4509b76741dc428e9201c70c1658da13 P e61c3a8f61bb48f8a963c9480e53c168 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:52.911077 25434 raft_consensus.cc:3060] T 76cb037fc9064d13b59a8969d897ce8c P 0473d2b2d01f4459b1e90fd12cc7840e [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:06:52.921648 19405 raft_consensus.cc:1275] T 775c229504194560ba9589bc2199b089 P e5256d91808b47c195bc9b4dbd7f2b87 [term 13 FOLLOWER]: Refusing update from remote peer 127766fc592545a4997f7790f50f6076: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:06:52.926286 19377 leader_election.cc:304] T d1e5873a19244c5ebbcd38e126796ee7 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87; no voters: e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:06:52.944651 25400 raft_consensus.cc:2749] T f1b10566f45d4a7d9029858330e02d5b P e5256d91808b47c195bc9b4dbd7f2b87 [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:06:52.922086 25221 raft_consensus.cc:493] T 0afb57ae58a24a01850491d69f0213dd P 127766fc592545a4997f7790f50f6076 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 0473d2b2d01f4459b1e90fd12cc7840e)
W20260709 13:06:52.959981 25460 log.cc:927] Time spent T ef32ce6fdd0e40d382c79974f30295c6 P e5256d91808b47c195bc9b4dbd7f2b87: Append to log took a long time: real 0.791s	user 0.004s	sys 0.030s
I20260709 13:06:52.959409 25396 consensus_queue.cc:237] T a08760e15aac4630a629431f56024dc8 P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 19.11, Last appended by leader: 11, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
W20260709 13:06:52.968451 25345 consensus_meta.cc:287] T 775c229504194560ba9589bc2199b089 P 0473d2b2d01f4459b1e90fd12cc7840e: Time spent flushing consensus metadata: real 0.651s	user 0.010s	sys 0.000s
I20260709 13:06:52.972232 20078 leader_election.cc:304] T 5ec1c4ce15e04c7e8c283a62179f2a64 P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, 127766fc592545a4997f7790f50f6076; no voters: e5256d91808b47c195bc9b4dbd7f2b87
W20260709 13:06:52.976334 19377 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.2:46257, user_credentials={real_user=slave}} blocked reactor thread for 50160.8us
I20260709 13:06:52.980418 19377 leader_election.cc:304] T 3e1f505cb0f1427bbd698ac889d80821 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:06:52.981912 19377 leader_election.cc:304] T 217b5fae677b4971b3bbd2f357a1f7ff P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168
W20260709 13:06:52.969194 25337 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.785s	user 0.006s	sys 0.017s
I20260709 13:06:52.986459 19377 leader_election.cc:304] T f93ee515a9c14139bf566522ed8232f3 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168
W20260709 13:06:52.984565 19450 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:52.996011 20078 leader_election.cc:304] T 62c6c134d3d24a1ab144dd9ee6bc3f64 P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, 127766fc592545a4997f7790f50f6076; no voters: e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:06:53.033946 19481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed7fdbcb96d14d418db9ca90a792588a" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:06:53.033366 19482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96efeaaf1057492490e9a621f37e1a2d" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 20 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:06:53.037554 19481 raft_consensus.cc:2468] T ed7fdbcb96d14d418db9ca90a792588a P 0473d2b2d01f4459b1e90fd12cc7840e [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 127766fc592545a4997f7790f50f6076 in term 13.
I20260709 13:06:53.034699 19486 raft_consensus.cc:1275] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P 0473d2b2d01f4459b1e90fd12cc7840e [term 18 FOLLOWER]: Refusing update from remote peer 127766fc592545a4997f7790f50f6076: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 18 index: 15. (index mismatch)
W20260709 13:06:52.996052 19377 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:53.035066 19483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36f6ba92b9ba46babe4ebd6c02e5fbd9" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:06:53.033144 25368 raft_consensus.cc:2804] T 5ec1c4ce15e04c7e8c283a62179f2a64 P 127766fc592545a4997f7790f50f6076 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:06:53.055334 19483 raft_consensus.cc:2393] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P 0473d2b2d01f4459b1e90fd12cc7840e [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 127766fc592545a4997f7790f50f6076 in current term 18: Already voted for candidate 0473d2b2d01f4459b1e90fd12cc7840e in this term.
I20260709 13:06:53.043288 19556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86a6797bdfe94fa496c050ceae4bd0d9" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 15 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
W20260709 13:06:52.990121 25337 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.806s	user 0.007s	sys 0.018s
I20260709 13:06:53.044338 19486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cdf56e38bbc453d9438d359e5a69955" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:06:53.045253 19481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a08760e15aac4630a629431f56024dc8" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:06:52.990192 25309 raft_consensus.cc:2749] T 217b5fae677b4971b3bbd2f357a1f7ff P e5256d91808b47c195bc9b4dbd7f2b87 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:06:53.047554 19557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a08760e15aac4630a629431f56024dc8" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:06:53.050416 19558 raft_consensus.cc:1275] T fa8650e71aa14778b3d73721fc50d9fc P e61c3a8f61bb48f8a963c9480e53c168 [term 17 FOLLOWER]: Refusing update from remote peer 0473d2b2d01f4459b1e90fd12cc7840e: Log matching property violated. Preceding OpId in replica: term: 15 index: 8. Preceding OpId from leader: term: 17 index: 9. (index mismatch)
I20260709 13:06:53.051892 19560 raft_consensus.cc:1275] T 6c5eebf646ad445a9d1b1adc319d7b16 P e61c3a8f61bb48f8a963c9480e53c168 [term 18 FOLLOWER]: Refusing update from remote peer 0473d2b2d01f4459b1e90fd12cc7840e: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 18 index: 13. (index mismatch)
I20260709 13:06:52.984237 25441 raft_consensus.cc:2804] T d1e5873a19244c5ebbcd38e126796ee7 P e5256d91808b47c195bc9b4dbd7f2b87 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:06:52.983799 25056 raft_consensus.cc:2749] T 3e1f505cb0f1427bbd698ac889d80821 P e5256d91808b47c195bc9b4dbd7f2b87 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
W20260709 13:06:53.045871 19449 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.4:43121, user_credentials={real_user=slave}} blocked reactor thread for 390011us
I20260709 13:06:52.991281 25404 raft_consensus.cc:3060] T f93ee515a9c14139bf566522ed8232f3 P e5256d91808b47c195bc9b4dbd7f2b87 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:06:53.068284 19557 raft_consensus.cc:2393] T a08760e15aac4630a629431f56024dc8 P e61c3a8f61bb48f8a963c9480e53c168 [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate 0473d2b2d01f4459b1e90fd12cc7840e in current term 21: Already voted for candidate e5256d91808b47c195bc9b4dbd7f2b87 in this term.
I20260709 13:06:53.070016 19482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1efebf73c86e432baa55533136b6e12c" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:06:53.034569 25086 raft_consensus.cc:3060] T 28af091831594f9d8e96482078cc7625 P e61c3a8f61bb48f8a963c9480e53c168 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:06:52.996943 25397 consensus_queue.cc:1048] T 775c229504194560ba9589bc2199b089 P 127766fc592545a4997f7790f50f6076 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.076s
I20260709 13:06:53.031898 25100 consensus_queue.cc:1048] T 7f575b143b844aa096b50997dad3516a P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.042s
I20260709 13:06:53.044034 25435 raft_consensus.cc:2804] T 62c6c134d3d24a1ab144dd9ee6bc3f64 P 127766fc592545a4997f7790f50f6076 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:06:53.079718 19482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76cb037fc9064d13b59a8969d897ce8c" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:06:53.071988 19481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9f0d59553ad444883fcf5b5909f9798" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:06:52.983176 25345 raft_consensus.cc:515] T 775c229504194560ba9589bc2199b089 P 0473d2b2d01f4459b1e90fd12cc7840e [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:52.978384 25221 raft_consensus.cc:515] T 0afb57ae58a24a01850491d69f0213dd P 127766fc592545a4997f7790f50f6076 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:53.073086 19559 raft_consensus.cc:1275] T ab43d85f64114d4ebf618930e43d9ed0 P e61c3a8f61bb48f8a963c9480e53c168 [term 18 FOLLOWER]: Refusing update from remote peer 0473d2b2d01f4459b1e90fd12cc7840e: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 18 index: 12. (index mismatch)
I20260709 13:06:53.082882 19449 leader_election.cc:304] T 14efcc79969f41babe5529c22d59156d P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e; no voters: 127766fc592545a4997f7790f50f6076, e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:06:53.083662 19478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14935b3ddf914369822e4a0547aaa355" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:06:53.056041 25368 raft_consensus.cc:493] T 5ec1c4ce15e04c7e8c283a62179f2a64 P 127766fc592545a4997f7790f50f6076 [term 11 FOLLOWER]: Starting leader election (detected failure of leader e5256d91808b47c195bc9b4dbd7f2b87)
I20260709 13:06:53.082624 25237 raft_consensus.cc:493] T f93ee515a9c14139bf566522ed8232f3 P 0473d2b2d01f4459b1e90fd12cc7840e [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:53.088979 19481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab43d85f64114d4ebf618930e43d9ed0" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:06:53.073139 25441 raft_consensus.cc:493] T d1e5873a19244c5ebbcd38e126796ee7 P e5256d91808b47c195bc9b4dbd7f2b87 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:06:53.080345 20078 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.2:46257, user_credentials={real_user=slave}} blocked reactor thread for 84355.3us
I20260709 13:06:53.075457 25332 leader_election.cc:290] T edd7d470b5014c9489be7f41f64355c9 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:06:53.076990 25403 raft_consensus.cc:493] T 309c3ca0ca4b4f3ba129752ea2cb293b P e5256d91808b47c195bc9b4dbd7f2b87 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 127766fc592545a4997f7790f50f6076)
I20260709 13:06:53.099080 19449 leader_election.cc:304] T 1f85fc4b527a48848e5faa083b604e36 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e; no voters: 127766fc592545a4997f7790f50f6076, e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:06:53.101620 19478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c5eebf646ad445a9d1b1adc319d7b16" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 19 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:06:53.103015 19479 raft_consensus.cc:3060] T 775c229504194560ba9589bc2199b089 P 0473d2b2d01f4459b1e90fd12cc7840e [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:06:53.088078 25435 raft_consensus.cc:493] T 62c6c134d3d24a1ab144dd9ee6bc3f64 P 127766fc592545a4997f7790f50f6076 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:53.103175 19481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edd7d470b5014c9489be7f41f64355c9" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:06:53.108644 19449 leader_election.cc:304] T ed7fdbcb96d14d418db9ca90a792588a P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, 127766fc592545a4997f7790f50f6076; no voters: e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:06:53.092724 25309 raft_consensus.cc:493] T 46c5bfeecc314717bffe987e6844b6d0 P e5256d91808b47c195bc9b4dbd7f2b87 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:53.111657 19449 leader_election.cc:304] T 309c3ca0ca4b4f3ba129752ea2cb293b P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e; no voters: 127766fc592545a4997f7790f50f6076, e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:06:53.117631 19478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef32ce6fdd0e40d382c79974f30295c6" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:06:53.121644 19481 raft_consensus.cc:2393] T edd7d470b5014c9489be7f41f64355c9 P 0473d2b2d01f4459b1e90fd12cc7840e [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate e5256d91808b47c195bc9b4dbd7f2b87 in current term 19: Already voted for candidate 0473d2b2d01f4459b1e90fd12cc7840e in this term.
I20260709 13:06:53.120468 19478 raft_consensus.cc:2468] T ef32ce6fdd0e40d382c79974f30295c6 P 0473d2b2d01f4459b1e90fd12cc7840e [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 21.
I20260709 13:06:53.098006 25392 raft_consensus.cc:493] T b08304a0a02b42d7840c4e8ee9a6bd1a P e5256d91808b47c195bc9b4dbd7f2b87 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:53.098453 25368 raft_consensus.cc:3060] T 5ec1c4ce15e04c7e8c283a62179f2a64 P 127766fc592545a4997f7790f50f6076 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:06:53.136044 20078 leader_election.cc:304] T 96efeaaf1057492490e9a621f37e1a2d P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 127766fc592545a4997f7790f50f6076; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:06:53.102689 25441 raft_consensus.cc:3060] T d1e5873a19244c5ebbcd38e126796ee7 P e5256d91808b47c195bc9b4dbd7f2b87 [term 19 FOLLOWER]: Advancing to term 20
W20260709 13:06:53.140762 19377 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.2:46257, user_credentials={real_user=slave}} blocked reactor thread for 84657.4us
I20260709 13:06:53.087797 25311 consensus_queue.cc:1048] T 6c5eebf646ad445a9d1b1adc319d7b16 P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Connected to new peer: Peer: permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 10, Time since last communication: 0.023s
I20260709 13:06:53.141729 19481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1efebf73c86e432baa55533136b6e12c" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:06:53.123342 19478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab43d85f64114d4ebf618930e43d9ed0" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 18 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:06:53.125758 19405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff9b0eddd810459b82d91c60777c10eb" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:06:53.126380 19407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86a6797bdfe94fa496c050ceae4bd0d9" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 15 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:06:53.102722 25188 raft_consensus.cc:493] T b9f0d59553ad444883fcf5b5909f9798 P 0473d2b2d01f4459b1e90fd12cc7840e [term 14 FOLLOWER]: Starting pre-election (detected failure of leader e61c3a8f61bb48f8a963c9480e53c168)
I20260709 13:06:53.102770 25494 raft_consensus.cc:2749] T 14efcc79969f41babe5529c22d59156d P 0473d2b2d01f4459b1e90fd12cc7840e [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:06:53.108179 25056 raft_consensus.cc:493] T 2725d2c4cb054f18b0fc8f735c15f6c2 P e5256d91808b47c195bc9b4dbd7f2b87 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:53.127028 19406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a08760e15aac4630a629431f56024dc8" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
I20260709 13:06:53.161665 20078 leader_election.cc:304] T ed7fdbcb96d14d418db9ca90a792588a P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, 127766fc592545a4997f7790f50f6076; no voters: 
I20260709 13:06:53.162693 19405 raft_consensus.cc:2468] T ff9b0eddd810459b82d91c60777c10eb P e5256d91808b47c195bc9b4dbd7f2b87 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 16.
I20260709 13:06:53.162739 19406 raft_consensus.cc:1240] T 1dc5b3532fe54f74876d02beffa2c230 P e5256d91808b47c195bc9b4dbd7f2b87 [term 18 FOLLOWER]: Rejecting Update request from peer 0473d2b2d01f4459b1e90fd12cc7840e for earlier term 17. Current term is 18. Ops: []
I20260709 13:06:53.143977 19407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edd7d470b5014c9489be7f41f64355c9" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:06:53.164937 19479 raft_consensus.cc:2468] T 775c229504194560ba9589bc2199b089 P 0473d2b2d01f4459b1e90fd12cc7840e [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 127766fc592545a4997f7790f50f6076 in term 13.
I20260709 13:06:53.165016 19407 raft_consensus.cc:2468] T edd7d470b5014c9489be7f41f64355c9 P e5256d91808b47c195bc9b4dbd7f2b87 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 19.
I20260709 13:06:53.152995 19403 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52342 (request call id 3055) took 1554 ms. Trace:
I20260709 13:06:53.111088 25435 raft_consensus.cc:3060] T 62c6c134d3d24a1ab144dd9ee6bc3f64 P 127766fc592545a4997f7790f50f6076 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:06:53.119486 25332 raft_consensus.cc:2749] T 1f85fc4b527a48848e5faa083b604e36 P 0473d2b2d01f4459b1e90fd12cc7840e [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:06:53.114434 25403 raft_consensus.cc:515] T 309c3ca0ca4b4f3ba129752ea2cb293b P e5256d91808b47c195bc9b4dbd7f2b87 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:53.168470 19481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b74109013a140ada21feeef92d6f563" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:06:53.172147 19478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cdf56e38bbc453d9438d359e5a69955" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:06:53.113021 25093 raft_consensus.cc:493] T 2e36a9d6e29c4a7c860cf267efbd4c74 P e5256d91808b47c195bc9b4dbd7f2b87 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 0473d2b2d01f4459b1e90fd12cc7840e)
I20260709 13:06:53.167006 19403 rpcz_store.cc:276] 0709 13:06:51.598870 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:51.754523 (+155653us) service_pool.cc:224] Handling call
0709 13:06:51.754812 (+   289us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:52.394735 (+639923us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:53.152685 (+757950us) spinlock_profiling.cc:243] Waited 639 ms on lock 0x7b5400064d54. stack: 00007f4a79de9343 00007f4a79de9240 00007f4a797781d4 00007f4a834b6304 00007f4a834b6299 00007f4a7ce71571 00007f4a7cf08e01 00007f4a7cf0783e 00007f4a81ecc419 00007f4a7b443bd4 00007f4a7b443b62 00007f4a7b443a91 00007f4a7b443a0c 00007f4a7b442cc2 00007f4a7b24348c 00007f4a7b2428c6
0709 13:06:53.152920 (+   235us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1469680512}
I20260709 13:06:53.191044 19478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "217b5fae677b4971b3bbd2f357a1f7ff" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:06:53.137295 25461 raft_consensus.cc:2749] T 309c3ca0ca4b4f3ba129752ea2cb293b P 0473d2b2d01f4459b1e90fd12cc7840e [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:06:53.194139 19481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dc5b3532fe54f74876d02beffa2c230" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:06:53.102530 25237 raft_consensus.cc:515] T f93ee515a9c14139bf566522ed8232f3 P 0473d2b2d01f4459b1e90fd12cc7840e [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:53.209635 25237 leader_election.cc:290] T f93ee515a9c14139bf566522ed8232f3 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
W20260709 13:06:53.211460 25446 consensus_meta.cc:287] T 21e14947d70440f19044d8f75c31e1f9 P 0473d2b2d01f4459b1e90fd12cc7840e: Time spent flushing consensus metadata: real 1.002s	user 0.012s	sys 0.000s
I20260709 13:06:53.211926 25446 raft_consensus.cc:515] T 21e14947d70440f19044d8f75c31e1f9 P 0473d2b2d01f4459b1e90fd12cc7840e [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:53.214139 25446 leader_election.cc:290] T 21e14947d70440f19044d8f75c31e1f9 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 16 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:06:53.161279 25445 raft_consensus.cc:493] T f93ee515a9c14139bf566522ed8232f3 P e61c3a8f61bb48f8a963c9480e53c168 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:53.214794 19480 raft_consensus.cc:3060] T 21e14947d70440f19044d8f75c31e1f9 P 0473d2b2d01f4459b1e90fd12cc7840e [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:06:53.122385 25490 raft_consensus.cc:2804] T ed7fdbcb96d14d418db9ca90a792588a P 0473d2b2d01f4459b1e90fd12cc7840e [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:06:53.217095 25490 raft_consensus.cc:493] T ed7fdbcb96d14d418db9ca90a792588a P 0473d2b2d01f4459b1e90fd12cc7840e [term 13 FOLLOWER]: Starting leader election (detected failure of leader 127766fc592545a4997f7790f50f6076)
I20260709 13:06:53.217473 25490 raft_consensus.cc:3060] T ed7fdbcb96d14d418db9ca90a792588a P 0473d2b2d01f4459b1e90fd12cc7840e [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:06:53.195284 19411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9962423cb4e54fcfa5de01daf68a86e7" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:06:53.190132 25236 raft_consensus.cc:2804] T ed7fdbcb96d14d418db9ca90a792588a P 127766fc592545a4997f7790f50f6076 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:06:53.161661 25227 raft_consensus.cc:2749] T 96efeaaf1057492490e9a621f37e1a2d P 127766fc592545a4997f7790f50f6076 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:06:53.204222 25416 leader_election.cc:290] T 96efeaaf1057492490e9a621f37e1a2d P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
W20260709 13:06:53.207716 25486 log.cc:927] Time spent T 96efeaaf1057492490e9a621f37e1a2d P e61c3a8f61bb48f8a963c9480e53c168: Append to log took a long time: real 0.119s	user 0.000s	sys 0.000s
I20260709 13:06:53.221746 19407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f93ee515a9c14139bf566522ed8232f3" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 20 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
W20260709 13:06:53.197062 25487 log.cc:927] Time spent T 9962423cb4e54fcfa5de01daf68a86e7 P 0473d2b2d01f4459b1e90fd12cc7840e: Append to log took a long time: real 0.103s	user 0.000s	sys 0.000s
I20260709 13:06:53.225045 19553 raft_consensus.cc:1275] T 46c5bfeecc314717bffe987e6844b6d0 P e61c3a8f61bb48f8a963c9480e53c168 [term 23 FOLLOWER]: Refusing update from remote peer 0473d2b2d01f4459b1e90fd12cc7840e: Log matching property violated. Preceding OpId in replica: term: 22 index: 12. Preceding OpId from leader: term: 23 index: 12. (term mismatch)
I20260709 13:06:53.240113 19553 pending_rounds.cc:85] T 46c5bfeecc314717bffe987e6844b6d0 P e61c3a8f61bb48f8a963c9480e53c168: Aborting all ops after (but not including) 11
I20260709 13:06:53.136471 25309 raft_consensus.cc:515] T 46c5bfeecc314717bffe987e6844b6d0 P e5256d91808b47c195bc9b4dbd7f2b87 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:53.232451 25408 raft_consensus.cc:493] T 14efcc79969f41babe5529c22d59156d P e5256d91808b47c195bc9b4dbd7f2b87 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 127766fc592545a4997f7790f50f6076)
I20260709 13:06:53.237985 20112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9962423cb4e54fcfa5de01daf68a86e7" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:06:53.245244 20105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96efeaaf1057492490e9a621f37e1a2d" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:06:53.240398 19553 pending_rounds.cc:107] T 46c5bfeecc314717bffe987e6844b6d0 P e61c3a8f61bb48f8a963c9480e53c168: Aborting uncommitted NO_OP operation due to leader change: 22.12
I20260709 13:06:53.147560 25392 raft_consensus.cc:515] T b08304a0a02b42d7840c4e8ee9a6bd1a P e5256d91808b47c195bc9b4dbd7f2b87 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:53.241267 19409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21e14947d70440f19044d8f75c31e1f9" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
I20260709 13:06:53.241284 20104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff9b0eddd810459b82d91c60777c10eb" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:06:53.191126 25100 raft_consensus.cc:493] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P e5256d91808b47c195bc9b4dbd7f2b87 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:53.246032 19553 raft_consensus.cc:2889] T 46c5bfeecc314717bffe987e6844b6d0 P e61c3a8f61bb48f8a963c9480e53c168 [term 23 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:06:53.120491 25298 consensus_queue.cc:1059] T 0e1085d23e8347fbbd5bce7542f4b1f4 P 127766fc592545a4997f7790f50f6076 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 }, Status: INVALID_TERM, Last received: 12.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.067s
I20260709 13:06:53.226042 25236 raft_consensus.cc:493] T ed7fdbcb96d14d418db9ca90a792588a P 127766fc592545a4997f7790f50f6076 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:53.246770 20105 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "309c3ca0ca4b4f3ba129752ea2cb293b"
dest_uuid: "127766fc592545a4997f7790f50f6076"
mode: GRACEFUL
new_leader_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
 from {username='slave'} at 127.0.0.1:48686
I20260709 13:06:53.254910 19405 raft_consensus.cc:1275] T 46c5bfeecc314717bffe987e6844b6d0 P e5256d91808b47c195bc9b4dbd7f2b87 [term 23 FOLLOWER]: Refusing update from remote peer 0473d2b2d01f4459b1e90fd12cc7840e: Log matching property violated. Preceding OpId in replica: term: 20 index: 10. Preceding OpId from leader: term: 23 index: 12. (index mismatch)
I20260709 13:06:53.255177 20105 raft_consensus.cc:606] T 309c3ca0ca4b4f3ba129752ea2cb293b P 127766fc592545a4997f7790f50f6076 [term 11 LEADER]: Received request to transfer leadership to TS 0473d2b2d01f4459b1e90fd12cc7840e
I20260709 13:06:53.182114 25188 raft_consensus.cc:515] T b9f0d59553ad444883fcf5b5909f9798 P 0473d2b2d01f4459b1e90fd12cc7840e [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:53.248052 19449 leader_election.cc:304] T ff9b0eddd810459b82d91c60777c10eb P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87; no voters: 
I20260709 13:06:53.252599 19480 raft_consensus.cc:2468] T 21e14947d70440f19044d8f75c31e1f9 P 0473d2b2d01f4459b1e90fd12cc7840e [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 17.
I20260709 13:06:53.186388 25370 consensus_queue.cc:1048] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P 127766fc592545a4997f7790f50f6076 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 13, Time since last communication: 0.064s
I20260709 13:06:53.246976 25221 leader_election.cc:290] T 0afb57ae58a24a01850491d69f0213dd P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:06:53.186544 25056 raft_consensus.cc:515] T 2725d2c4cb054f18b0fc8f735c15f6c2 P e5256d91808b47c195bc9b4dbd7f2b87 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:53.245757 25232 leader_election.cc:290] T 1f85fc4b527a48848e5faa083b604e36 P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 16 election: Requested vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321)
I20260709 13:06:53.193578 25093 raft_consensus.cc:515] T 2e36a9d6e29c4a7c860cf267efbd4c74 P e5256d91808b47c195bc9b4dbd7f2b87 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:53.243903 25411 leader_election.cc:290] T 4509b76741dc428e9201c70c1658da13 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 11 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:06:53.215086 25445 raft_consensus.cc:515] T f93ee515a9c14139bf566522ed8232f3 P e61c3a8f61bb48f8a963c9480e53c168 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:53.256776 25236 raft_consensus.cc:3060] T ed7fdbcb96d14d418db9ca90a792588a P 127766fc592545a4997f7790f50f6076 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:06:53.266821 19449 leader_election.cc:304] T edd7d470b5014c9489be7f41f64355c9 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87; no voters: 
I20260709 13:06:53.275897 25416 raft_consensus.cc:2804] T edd7d470b5014c9489be7f41f64355c9 P 0473d2b2d01f4459b1e90fd12cc7840e [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:06:53.276289 25416 raft_consensus.cc:493] T edd7d470b5014c9489be7f41f64355c9 P 0473d2b2d01f4459b1e90fd12cc7840e [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:53.276646 25416 raft_consensus.cc:3060] T edd7d470b5014c9489be7f41f64355c9 P 0473d2b2d01f4459b1e90fd12cc7840e [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:06:53.281869 19409 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "85c494af21f9457a85da47b9bc70c1fd"
dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
mode: GRACEFUL
new_leader_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
 from {username='slave'} at 127.0.0.1:37312
I20260709 13:06:53.282454 19409 raft_consensus.cc:606] T 85c494af21f9457a85da47b9bc70c1fd P e5256d91808b47c195bc9b4dbd7f2b87 [term 15 LEADER]: Received request to transfer leadership to TS e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:06:53.252388 25408 raft_consensus.cc:515] T 14efcc79969f41babe5529c22d59156d P e5256d91808b47c195bc9b4dbd7f2b87 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
W20260709 13:06:53.268239 25500 log.cc:927] Time spent T 14935b3ddf914369822e4a0547aaa355 P 0473d2b2d01f4459b1e90fd12cc7840e: Append to log took a long time: real 0.052s	user 0.000s	sys 0.001s
I20260709 13:06:53.255643 25100 raft_consensus.cc:515] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P e5256d91808b47c195bc9b4dbd7f2b87 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:53.300441 19409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "775c229504194560ba9589bc2199b089" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
I20260709 13:06:53.301522 19409 raft_consensus.cc:2368] T 775c229504194560ba9589bc2199b089 P e5256d91808b47c195bc9b4dbd7f2b87 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 0473d2b2d01f4459b1e90fd12cc7840e for earlier term 12. Current term is 13.
I20260709 13:06:53.304765 20112 raft_consensus.cc:1275] T ab43d85f64114d4ebf618930e43d9ed0 P 127766fc592545a4997f7790f50f6076 [term 18 FOLLOWER]: Refusing update from remote peer 0473d2b2d01f4459b1e90fd12cc7840e: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 18 index: 12. (index mismatch)
I20260709 13:06:53.308153 19449 leader_election.cc:304] T 9962423cb4e54fcfa5de01daf68a86e7 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e; no voters: 127766fc592545a4997f7790f50f6076, e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:06:53.272585 25403 leader_election.cc:290] T 309c3ca0ca4b4f3ba129752ea2cb293b P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:06:53.268160 25497 raft_consensus.cc:2804] T ff9b0eddd810459b82d91c60777c10eb P 0473d2b2d01f4459b1e90fd12cc7840e [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:06:53.316370 25448 raft_consensus.cc:3055] T 1dc5b3532fe54f74876d02beffa2c230 P 0473d2b2d01f4459b1e90fd12cc7840e [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:06:53.366461 25448 raft_consensus.cc:740] T 1dc5b3532fe54f74876d02beffa2c230 P 0473d2b2d01f4459b1e90fd12cc7840e [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 0473d2b2d01f4459b1e90fd12cc7840e, State: Running, Role: LEADER
I20260709 13:06:53.322466 25237 raft_consensus.cc:2749] T 9962423cb4e54fcfa5de01daf68a86e7 P 0473d2b2d01f4459b1e90fd12cc7840e [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:06:53.271700 25332 consensus_queue.cc:1059] T 1dc5b3532fe54f74876d02beffa2c230 P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 }, Status: INVALID_TERM, Last received: 17.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.029s
I20260709 13:06:53.364403 20112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "775c229504194560ba9589bc2199b089" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076"
I20260709 13:06:53.321063 25086 raft_consensus.cc:493] T 76cb037fc9064d13b59a8969d897ce8c P e61c3a8f61bb48f8a963c9480e53c168 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:53.368752 25086 raft_consensus.cc:515] T 76cb037fc9064d13b59a8969d897ce8c P e61c3a8f61bb48f8a963c9480e53c168 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
W20260709 13:06:53.371409 25506 log.cc:927] Time spent T 62c6c134d3d24a1ab144dd9ee6bc3f64 P e61c3a8f61bb48f8a963c9480e53c168: Append to log took a long time: real 0.076s	user 0.000s	sys 0.000s
I20260709 13:06:53.372017 25086 leader_election.cc:290] T 76cb037fc9064d13b59a8969d897ce8c P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:06:53.373041 25497 raft_consensus.cc:493] T ff9b0eddd810459b82d91c60777c10eb P 0473d2b2d01f4459b1e90fd12cc7840e [term 16 FOLLOWER]: Starting leader election (detected failure of leader 127766fc592545a4997f7790f50f6076)
I20260709 13:06:53.373901 25497 raft_consensus.cc:3060] T ff9b0eddd810459b82d91c60777c10eb P 0473d2b2d01f4459b1e90fd12cc7840e [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:06:53.374590 25086 raft_consensus.cc:493] T fa8650e71aa14778b3d73721fc50d9fc P e61c3a8f61bb48f8a963c9480e53c168 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:53.375128 19449 leader_election.cc:400] T 775c229504194560ba9589bc2199b089 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 12 election: Vote denied by peer e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321) with higher term. Message: Invalid argument: T 775c229504194560ba9589bc2199b089 P e5256d91808b47c195bc9b4dbd7f2b87 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 0473d2b2d01f4459b1e90fd12cc7840e for earlier term 12. Current term is 13.
I20260709 13:06:53.375715 19449 leader_election.cc:403] T 775c229504194560ba9589bc2199b089 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 12 election: Cancelling election due to peer responding with higher term
I20260709 13:06:53.320317 25450 raft_consensus.cc:3055] T b08304a0a02b42d7840c4e8ee9a6bd1a P 0473d2b2d01f4459b1e90fd12cc7840e [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:06:53.292601 25311 consensus_queue.cc:1059] T 0cdf56e38bbc453d9438d359e5a69955 P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 }, Status: INVALID_TERM, Last received: 16.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.071s
I20260709 13:06:53.323740 25345 leader_election.cc:290] T 775c229504194560ba9589bc2199b089 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 12 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:06:53.384093 19477 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39478 (request call id 953) took 1145 ms. Trace:
I20260709 13:06:53.375088 25086 raft_consensus.cc:515] T fa8650e71aa14778b3d73721fc50d9fc P e61c3a8f61bb48f8a963c9480e53c168 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:53.362154 25411 raft_consensus.cc:493] T ff75a1d4cb1f493db8f71ddc136ba9ab P e61c3a8f61bb48f8a963c9480e53c168 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader e5256d91808b47c195bc9b4dbd7f2b87)
I20260709 13:06:53.387760 19477 rpcz_store.cc:276] 0709 13:06:52.238258 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:52.518177 (+279919us) service_pool.cc:224] Handling call
0709 13:06:52.518566 (+   389us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:52.613812 (+ 95246us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:52.613842 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:52.614218 (+   376us) log.cc:844] Serialized 26 byte log entry
0709 13:06:52.855302 (+241084us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:06:52.923181 (+ 67879us) log.cc:844] Serialized 14 byte log entry
0709 13:06:52.940041 (+ 16860us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:53.150460 (+210419us) spinlock_profiling.cc:243] Waited 84 ms on lock 0x7b540035d4d4. stack: 00007f4a79de9343 00007f4a79de9240 00007f4a797781d4 00007f4a834b6304 00007f4a834b6299 00007f4a7ce71571 00007f4a7cf08e01 00007f4a7cf0783e 00007f4a81ecc419 00007f4a7b443bd4 00007f4a7b443b62 00007f4a7b443a91 00007f4a7b443a0c 00007f4a7b442cc2 00007f4a7b24348c 00007f4a7b2428c6
0709 13:06:53.150514 (+    54us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:53.365264 (+214750us) raft_consensus.cc:1685] finished
0709 13:06:53.383894 (+ 18630us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:53.384032 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":16074,"prepare.queue_time_us":67599,"prepare.run_cpu_time_us":49,"prepare.run_wall_time_us":51,"raft.queue_time_us":16514,"raft.run_cpu_time_us":99,"raft.run_wall_time_us":98,"spinlock_wait_cycles":193119104,"thread_start_us":207379,"threads_started":1,"wal-append.queue_time_us":420460}
I20260709 13:06:53.383481 25450 raft_consensus.cc:740] T b08304a0a02b42d7840c4e8ee9a6bd1a P 0473d2b2d01f4459b1e90fd12cc7840e [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 0473d2b2d01f4459b1e90fd12cc7840e, State: Running, Role: LEADER
W20260709 13:06:53.407439 19449 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.1:40321, user_credentials={real_user=slave}} blocked reactor thread for 43684.9us
I20260709 13:06:53.377290 25329 consensus_queue.cc:1048] T ab43d85f64114d4ebf618930e43d9ed0 P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Connected to new peer: Peer: permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.022s
W20260709 13:06:53.399614 25502 log.cc:927] Time spent T 7f575b143b844aa096b50997dad3516a P e5256d91808b47c195bc9b4dbd7f2b87: Append to log took a long time: real 0.081s	user 0.000s	sys 0.000s
W20260709 13:06:53.415571 25510 log.cc:927] Time spent T 3e1f505cb0f1427bbd698ac889d80821 P e61c3a8f61bb48f8a963c9480e53c168: Append to log took a long time: real 0.142s	user 0.000s	sys 0.001s
I20260709 13:06:53.416617 25086 leader_election.cc:290] T fa8650e71aa14778b3d73721fc50d9fc P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:06:53.420233 19402 raft_consensus.cc:2468] T 70797e5783b5454ab0d0eea663e791e3 P e5256d91808b47c195bc9b4dbd7f2b87 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 127766fc592545a4997f7790f50f6076 in term 19.
I20260709 13:06:53.423961 19409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9f0d59553ad444883fcf5b5909f9798" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:06:53.424484 19409 raft_consensus.cc:2468] T b9f0d59553ad444883fcf5b5909f9798 P e5256d91808b47c195bc9b4dbd7f2b87 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 14.
I20260709 13:06:53.426496 25188 leader_election.cc:290] T b9f0d59553ad444883fcf5b5909f9798 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:06:53.396965 25411 raft_consensus.cc:515] T ff75a1d4cb1f493db8f71ddc136ba9ab P e61c3a8f61bb48f8a963c9480e53c168 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
W20260709 13:06:53.436841 25503 log.cc:927] Time spent T fa731b585f684a7fb2d106c50f143b83 P 127766fc592545a4997f7790f50f6076: Append to log took a long time: real 0.057s	user 0.000s	sys 0.000s
I20260709 13:06:53.439289 25492 raft_consensus.cc:2749] T 775c229504194560ba9589bc2199b089 P 0473d2b2d01f4459b1e90fd12cc7840e [term 13 FOLLOWER]: Leader election lost for term 12. Reason: Vote denied by peer e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321) with higher term. Message: Invalid argument: T 775c229504194560ba9589bc2199b089 P e5256d91808b47c195bc9b4dbd7f2b87 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 0473d2b2d01f4459b1e90fd12cc7840e for earlier term 12. Current term is 13.
W20260709 13:06:53.440927 25472 log.cc:927] Time spent T 86a6797bdfe94fa496c050ceae4bd0d9 P e61c3a8f61bb48f8a963c9480e53c168: Append to log took a long time: real 0.727s	user 0.001s	sys 0.003s
I20260709 13:06:53.442927 19480 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58294 (request call id 2736) took 1300 ms. Trace:
I20260709 13:06:53.443331 19480 rpcz_store.cc:276] 0709 13:06:52.142237 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:52.154404 (+ 12167us) service_pool.cc:224] Handling call
0709 13:06:53.442717 (+1288313us) spinlock_profiling.cc:243] Waited 1.02 s on lock 0x7b540035d9d4. stack: 00007f4a79de9343 00007f4a79de9240 00007f4a797781d4 00007f4a834b6304 00007f4a834b6299 00007f4a7ce71571 00007f4a7cf0c2fa 00007f4a81ecdb17 00007f4a7b4486d4 00007f4a7b448662 00007f4a7b448591 00007f4a7b44850c 00007f4a7b4477c2 00007f4a7b24348c 00007f4a7b2428c6 00007f4a7b24226f
0709 13:06:53.442853 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2347223296}
I20260709 13:06:53.450778 25450 consensus_queue.cc:260] T b08304a0a02b42d7840c4e8ee9a6bd1a P 0473d2b2d01f4459b1e90fd12cc7840e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:53.455265 19450 leader_election.cc:304] T 86a6797bdfe94fa496c050ceae4bd0d9 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e; no voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:06:53.456151 25449 consensus_queue.cc:1048] T fa8650e71aa14778b3d73721fc50d9fc P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:06:53.456518 19450 leader_election.cc:304] T a08760e15aac4630a629431f56024dc8 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e; no voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:06:53.458943 25332 consensus_queue.cc:1048] T 6c5eebf646ad445a9d1b1adc319d7b16 P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 10, Time since last communication: 0.000s
W20260709 13:06:53.460846 19452 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:53.461124 25246 raft_consensus.cc:2749] T 86a6797bdfe94fa496c050ceae4bd0d9 P 0473d2b2d01f4459b1e90fd12cc7840e [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:06:53.461882 25246 raft_consensus.cc:2749] T a08760e15aac4630a629431f56024dc8 P 0473d2b2d01f4459b1e90fd12cc7840e [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 13:06:53.464040 19482 raft_consensus.cc:2468] T 76cb037fc9064d13b59a8969d897ce8c P 0473d2b2d01f4459b1e90fd12cc7840e [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 16.
I20260709 13:06:53.467067 19477 raft_consensus.cc:1275] T 21e14947d70440f19044d8f75c31e1f9 P 0473d2b2d01f4459b1e90fd12cc7840e [term 17 FOLLOWER]: Refusing update from remote peer e5256d91808b47c195bc9b4dbd7f2b87: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 13:06:53.431835 25056 leader_election.cc:290] T 2725d2c4cb054f18b0fc8f735c15f6c2 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:06:53.480422 19484 raft_consensus.cc:1275] T d1e5873a19244c5ebbcd38e126796ee7 P 0473d2b2d01f4459b1e90fd12cc7840e [term 19 FOLLOWER]: Refusing update from remote peer e61c3a8f61bb48f8a963c9480e53c168: Log matching property violated. Preceding OpId in replica: term: 17 index: 9. Preceding OpId from leader: term: 19 index: 10. (index mismatch)
W20260709 13:06:53.482748 19485 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58294 (request call id 2734) took 1341 ms (client timeout 1592 ms). Trace:
I20260709 13:06:53.435947 25309 leader_election.cc:290] T 46c5bfeecc314717bffe987e6844b6d0 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:06:53.471992 25097 raft_consensus.cc:3060] T 217b5fae677b4971b3bbd2f357a1f7ff P 0473d2b2d01f4459b1e90fd12cc7840e [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:06:53.484592 25445 leader_election.cc:290] T f93ee515a9c14139bf566522ed8232f3 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:06:53.487818 19377 leader_election.cc:304] T ef32ce6fdd0e40d382c79974f30295c6 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87; no voters: e61c3a8f61bb48f8a963c9480e53c168
W20260709 13:06:53.483174 19485 rpcz_store.cc:269] 0709 13:06:52.141665 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:52.141784 (+   119us) service_pool.cc:224] Handling call
0709 13:06:53.482504 (+1340720us) spinlock_profiling.cc:243] Waited 468 ms on lock 0x7b5400223654. stack: 00007f4a79de9343 00007f4a79de9240 00007f4a797781d4 00007f4a834b6304 00007f4a834b6299 00007f4a7ce71571 00007f4a7cf0c2fa 00007f4a81ecdb17 00007f4a7b4486d4 00007f4a7b448662 00007f4a7b448591 00007f4a7b44850c 00007f4a7b4477c2 00007f4a7b24348c 00007f4a7b2428c6 00007f4a7b24226f
0709 13:06:53.482646 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1076964736}
I20260709 13:06:53.491979 25100 leader_election.cc:290] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:06:53.494256 19449 leader_election.cc:304] T b9f0d59553ad444883fcf5b5909f9798 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87; no voters: 
I20260709 13:06:53.500080 25450 raft_consensus.cc:3060] T b08304a0a02b42d7840c4e8ee9a6bd1a P 0473d2b2d01f4459b1e90fd12cc7840e [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:06:53.505278 25403 raft_consensus.cc:2804] T ef32ce6fdd0e40d382c79974f30295c6 P e5256d91808b47c195bc9b4dbd7f2b87 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:06:53.505861 25403 raft_consensus.cc:493] T ef32ce6fdd0e40d382c79974f30295c6 P e5256d91808b47c195bc9b4dbd7f2b87 [term 20 FOLLOWER]: Starting leader election (detected failure of leader 0473d2b2d01f4459b1e90fd12cc7840e)
I20260709 13:06:53.506210 25403 raft_consensus.cc:3060] T ef32ce6fdd0e40d382c79974f30295c6 P e5256d91808b47c195bc9b4dbd7f2b87 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:06:53.475229 25490 raft_consensus.cc:515] T ed7fdbcb96d14d418db9ca90a792588a P 0473d2b2d01f4459b1e90fd12cc7840e [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:53.495093 25086 consensus_queue.cc:1048] T d1e5873a19244c5ebbcd38e126796ee7 P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:06:53.508924 19405 raft_consensus.cc:1240] T 217b5fae677b4971b3bbd2f357a1f7ff P e5256d91808b47c195bc9b4dbd7f2b87 [term 13 FOLLOWER]: Rejecting Update request from peer 0473d2b2d01f4459b1e90fd12cc7840e for earlier term 12. Current term is 13. Ops: []
I20260709 13:06:53.540413 25376 raft_consensus.cc:2804] T b9f0d59553ad444883fcf5b5909f9798 P 0473d2b2d01f4459b1e90fd12cc7840e [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:06:53.593010 25376 raft_consensus.cc:493] T b9f0d59553ad444883fcf5b5909f9798 P 0473d2b2d01f4459b1e90fd12cc7840e [term 14 FOLLOWER]: Starting leader election (detected failure of leader e61c3a8f61bb48f8a963c9480e53c168)
I20260709 13:06:53.593498 25376 raft_consensus.cc:3060] T b9f0d59553ad444883fcf5b5909f9798 P 0473d2b2d01f4459b1e90fd12cc7840e [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:06:53.488101 25408 leader_election.cc:290] T 14efcc79969f41babe5529c22d59156d P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
W20260709 13:06:53.598593 19479 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39478 (request call id 949) took 1431 ms (client timeout 1651 ms). Trace:
I20260709 13:06:53.600063 19481 raft_consensus.cc:1275] T 775c229504194560ba9589bc2199b089 P 0473d2b2d01f4459b1e90fd12cc7840e [term 13 FOLLOWER]: Refusing update from remote peer 127766fc592545a4997f7790f50f6076: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
W20260709 13:06:53.601348 19524 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:53.505203 25353 consensus_queue.cc:1059] T 86a6797bdfe94fa496c050ceae4bd0d9 P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.011s
W20260709 13:06:53.617388 19523 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:53.599079 19479 rpcz_store.cc:269] 0709 13:06:52.167350 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:52.196011 (+ 28661us) service_pool.cc:224] Handling call
0709 13:06:53.598383 (+1402372us) spinlock_profiling.cc:243] Waited 870 ms on lock 0x7b540029e354. stack: 00007f4a79de9343 00007f4a79de9240 00007f4a797781d4 00007f4a834b6304 00007f4a834b6299 00007f4a7ce71571 00007f4a7cf0c2fa 00007f4a81ecdb17 00007f4a7b4486d4 00007f4a7b448662 00007f4a7b448591 00007f4a7b44850c 00007f4a7b4477c2 00007f4a7b24348c 00007f4a7b2428c6 00007f4a7b24226f
0709 13:06:53.598528 (+   145us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2001197440}
W20260709 13:06:53.620513 19449 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.1:40321, user_credentials={real_user=slave}} blocked reactor thread for 79310us
I20260709 13:06:53.622226 19555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed7fdbcb96d14d418db9ca90a792588a" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:06:53.622463 19406 raft_consensus.cc:1240] T b08304a0a02b42d7840c4e8ee9a6bd1a P e5256d91808b47c195bc9b4dbd7f2b87 [term 17 FOLLOWER]: Rejecting Update request from peer 0473d2b2d01f4459b1e90fd12cc7840e for earlier term 16. Current term is 17. Ops: []
I20260709 13:06:53.622825 19555 raft_consensus.cc:2468] T ed7fdbcb96d14d418db9ca90a792588a P e61c3a8f61bb48f8a963c9480e53c168 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 127766fc592545a4997f7790f50f6076 in term 14.
I20260709 13:06:53.610412 19410 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49050 (request call id 1153) took 2405 ms. Trace:
I20260709 13:06:53.614787 19553 raft_consensus.cc:1240] T 0cdf56e38bbc453d9438d359e5a69955 P e61c3a8f61bb48f8a963c9480e53c168 [term 17 FOLLOWER]: Rejecting Update request from peer 0473d2b2d01f4459b1e90fd12cc7840e for earlier term 16. Current term is 17. Ops: []
W20260709 13:06:53.616362 19452 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:53.523732 25404 raft_consensus.cc:2749] T f93ee515a9c14139bf566522ed8232f3 P e5256d91808b47c195bc9b4dbd7f2b87 [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:06:53.616997 19483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "309c3ca0ca4b4f3ba129752ea2cb293b" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:06:53.628072 19479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0afb57ae58a24a01850491d69f0213dd" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:06:53.619833 19557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21e14947d70440f19044d8f75c31e1f9" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:06:53.634974 19557 raft_consensus.cc:2368] T 21e14947d70440f19044d8f75c31e1f9 P e61c3a8f61bb48f8a963c9480e53c168 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 0473d2b2d01f4459b1e90fd12cc7840e for earlier term 16. Current term is 17.
I20260709 13:06:53.537350 25445 raft_consensus.cc:493] T fa731b585f684a7fb2d106c50f143b83 P e61c3a8f61bb48f8a963c9480e53c168 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:53.629305 19559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f93ee515a9c14139bf566522ed8232f3" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 20 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:06:53.636833 19557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1efebf73c86e432baa55533136b6e12c" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:06:53.637132 19559 raft_consensus.cc:2468] T f93ee515a9c14139bf566522ed8232f3 P e61c3a8f61bb48f8a963c9480e53c168 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 19.
I20260709 13:06:53.617240 25138 raft_consensus.cc:493] T ab43d85f64114d4ebf618930e43d9ed0 P e61c3a8f61bb48f8a963c9480e53c168 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:53.630165 19551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edd7d470b5014c9489be7f41f64355c9" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:06:53.631453 19560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9f0d59553ad444883fcf5b5909f9798" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:06:53.538224 25311 raft_consensus.cc:493] T 1a61655d99124a29b486ba4a5b37faea P 0473d2b2d01f4459b1e90fd12cc7840e [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:53.638056 19551 raft_consensus.cc:2468] T edd7d470b5014c9489be7f41f64355c9 P e61c3a8f61bb48f8a963c9480e53c168 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 19.
I20260709 13:06:53.625939 19410 rpcz_store.cc:276] 0709 13:06:51.142998 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:51.372981 (+229983us) service_pool.cc:224] Handling call
0709 13:06:52.218969 (+845988us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:06:52.271366 (+ 52397us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:52.271412 (+    46us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:06:52.272042 (+   630us) log.cc:844] Serialized 52 byte log entry
0709 13:06:52.617946 (+345904us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:06:52.778974 (+161028us) log.cc:844] Serialized 14 byte log entry
0709 13:06:52.808343 (+ 29369us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:52.808464 (+   121us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:52.808504 (+    40us) raft_consensus.cc:1685] finished
0709 13:06:52.808516 (+    12us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:53.548099 (+739583us) spinlock_profiling.cc:243] Waited 841 ms on lock 0x7b5400249350. stack: 00007f4a79de9343 00007f4a79de9240 00007f4a797781d4 00007f4a834b6304 00007f4a834b6299 00007f4a7ce71571 00007f4a7cf078ad 00007f4a81ecc419 00007f4a7b443bd4 00007f4a7b443b62 00007f4a7b443a91 00007f4a7b443a0c 00007f4a7b442cc2 00007f4a7b24348c 00007f4a7b2428c6 00007f4a7b24226f
0709 13:06:53.548268 (+   169us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":129245,"prepare.queue_time_us":174349,"prepare.run_cpu_time_us":35,"prepare.run_wall_time_us":35,"raft.queue_time_us":95947,"raft.run_cpu_time_us":332,"raft.run_wall_time_us":33993,"spinlock_wait_cycles":1934844160,"thread_start_us":387976,"threads_started":2,"wal-append.queue_time_us":434507}
I20260709 13:06:53.641423 19554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96efeaaf1057492490e9a621f37e1a2d" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:06:53.645174 19556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab43d85f64114d4ebf618930e43d9ed0" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:06:53.646247 25056 raft_consensus.cc:3055] T 86a6797bdfe94fa496c050ceae4bd0d9 P e5256d91808b47c195bc9b4dbd7f2b87 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:06:53.644932 25138 raft_consensus.cc:515] T ab43d85f64114d4ebf618930e43d9ed0 P e61c3a8f61bb48f8a963c9480e53c168 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:53.617388 25183 raft_consensus.cc:493] T b08304a0a02b42d7840c4e8ee9a6bd1a P e61c3a8f61bb48f8a963c9480e53c168 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:53.651325 19483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "775c229504194560ba9589bc2199b089" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:06:53.651923 19486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f85fc4b527a48848e5faa083b604e36" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:06:53.651225 19560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14935b3ddf914369822e4a0547aaa355" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:06:53.661752 19560 raft_consensus.cc:2468] T 14935b3ddf914369822e4a0547aaa355 P e61c3a8f61bb48f8a963c9480e53c168 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 127766fc592545a4997f7790f50f6076 in term 11.
I20260709 13:06:53.657508 19479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "775c229504194560ba9589bc2199b089" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:06:53.674194 19486 raft_consensus.cc:3060] T 1f85fc4b527a48848e5faa083b604e36 P 0473d2b2d01f4459b1e90fd12cc7840e [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:06:53.681784 19407 raft_consensus.cc:2468] T f93ee515a9c14139bf566522ed8232f3 P e5256d91808b47c195bc9b4dbd7f2b87 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 19.
I20260709 13:06:53.660975 19483 raft_consensus.cc:2376] T 775c229504194560ba9589bc2199b089 P 0473d2b2d01f4459b1e90fd12cc7840e [term 13 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 127766fc592545a4997f7790f50f6076 in term 13. Re-sending same reply.
I20260709 13:06:53.727298 19560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c5eebf646ad445a9d1b1adc319d7b16" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 19 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:06:53.486980 25368 raft_consensus.cc:515] T 5ec1c4ce15e04c7e8c283a62179f2a64 P 127766fc592545a4997f7790f50f6076 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:53.594962 25492 consensus_queue.cc:1048] T 46c5bfeecc314717bffe987e6844b6d0 P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.060s
W20260709 13:06:53.731161 19450 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.3:36891, user_credentials={real_user=slave}} blocked reactor thread for 110029us
I20260709 13:06:53.743865 19560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0afb57ae58a24a01850491d69f0213dd" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:06:53.646605 25056 raft_consensus.cc:740] T 86a6797bdfe94fa496c050ceae4bd0d9 P e5256d91808b47c195bc9b4dbd7f2b87 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: e5256d91808b47c195bc9b4dbd7f2b87, State: Running, Role: LEADER
W20260709 13:06:53.757156 19449 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.4:43121, user_credentials={real_user=slave}} blocked reactor thread for 111283us
I20260709 13:06:53.740190 19556 raft_consensus.cc:2468] T ab43d85f64114d4ebf618930e43d9ed0 P e61c3a8f61bb48f8a963c9480e53c168 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 127766fc592545a4997f7790f50f6076 in term 18.
I20260709 13:06:53.776242 19450 leader_election.cc:400] T 21e14947d70440f19044d8f75c31e1f9 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 16 election: Vote denied by peer e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891) with higher term. Message: Invalid argument: T 21e14947d70440f19044d8f75c31e1f9 P e61c3a8f61bb48f8a963c9480e53c168 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 0473d2b2d01f4459b1e90fd12cc7840e for earlier term 16. Current term is 17.
I20260709 13:06:53.776611 19450 leader_election.cc:403] T 21e14947d70440f19044d8f75c31e1f9 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 16 election: Cancelling election due to peer responding with higher term
I20260709 13:06:53.777510 19450 leader_election.cc:304] T f93ee515a9c14139bf566522ed8232f3 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
W20260709 13:06:53.779243 25516 log.cc:927] Time spent T 6c5eebf646ad445a9d1b1adc319d7b16 P 127766fc592545a4997f7790f50f6076: Append to log took a long time: real 0.266s	user 0.000s	sys 0.000s
I20260709 13:06:53.779958 25446 consensus_queue.cc:1059] T 0cdf56e38bbc453d9438d359e5a69955 P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 }, Status: INVALID_TERM, Last received: 16.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:06:53.781019 25446 raft_consensus.cc:2749] T 21e14947d70440f19044d8f75c31e1f9 P 0473d2b2d01f4459b1e90fd12cc7840e [term 17 FOLLOWER]: Leader election lost for term 16. Reason: Vote denied by peer e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891) with higher term. Message: Invalid argument: T 21e14947d70440f19044d8f75c31e1f9 P e61c3a8f61bb48f8a963c9480e53c168 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 0473d2b2d01f4459b1e90fd12cc7840e for earlier term 16. Current term is 17.
I20260709 13:06:53.781735 25446 raft_consensus.cc:2804] T f93ee515a9c14139bf566522ed8232f3 P 0473d2b2d01f4459b1e90fd12cc7840e [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:06:53.782081 25446 raft_consensus.cc:493] T f93ee515a9c14139bf566522ed8232f3 P 0473d2b2d01f4459b1e90fd12cc7840e [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:53.782405 25446 raft_consensus.cc:3060] T f93ee515a9c14139bf566522ed8232f3 P 0473d2b2d01f4459b1e90fd12cc7840e [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:06:53.635703 25350 consensus_queue.cc:1048] T ab43d85f64114d4ebf618930e43d9ed0 P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.105s
W20260709 13:06:53.742256 25447 consensus_meta.cc:287] T 40e1e16737a842ee936002830f36882e P e5256d91808b47c195bc9b4dbd7f2b87: Time spent flushing consensus metadata: real 0.830s	user 0.008s	sys 0.003s
I20260709 13:06:53.798372 19406 raft_consensus.cc:1275] T 28af091831594f9d8e96482078cc7625 P e5256d91808b47c195bc9b4dbd7f2b87 [term 18 FOLLOWER]: Refusing update from remote peer 0473d2b2d01f4459b1e90fd12cc7840e: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 18 index: 10. (index mismatch)
W20260709 13:06:53.760145 25441 consensus_meta.cc:287] T d1e5873a19244c5ebbcd38e126796ee7 P e5256d91808b47c195bc9b4dbd7f2b87: Time spent flushing consensus metadata: real 0.578s	user 0.007s	sys 0.003s
I20260709 13:06:53.723847 25456 raft_consensus.cc:493] T 4af19371ea874c09a0a2147040835cbb P e61c3a8f61bb48f8a963c9480e53c168 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 127766fc592545a4997f7790f50f6076)
I20260709 13:06:53.747859 25404 raft_consensus.cc:493] T 1a61655d99124a29b486ba4a5b37faea P e5256d91808b47c195bc9b4dbd7f2b87 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:53.649806 25311 raft_consensus.cc:515] T 1a61655d99124a29b486ba4a5b37faea P 0473d2b2d01f4459b1e90fd12cc7840e [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:53.848315 25138 leader_election.cc:290] T ab43d85f64114d4ebf618930e43d9ed0 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:06:53.848909 25138 raft_consensus.cc:493] T 21e14947d70440f19044d8f75c31e1f9 P e61c3a8f61bb48f8a963c9480e53c168 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:53.799698 25386 raft_consensus.cc:493] T 179fd671030940b4b4a4e24bcc4aba0a P e61c3a8f61bb48f8a963c9480e53c168 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 0473d2b2d01f4459b1e90fd12cc7840e)
I20260709 13:06:53.849367 25411 leader_election.cc:290] T ff75a1d4cb1f493db8f71ddc136ba9ab P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:06:53.849754 25386 raft_consensus.cc:515] T 179fd671030940b4b4a4e24bcc4aba0a P e61c3a8f61bb48f8a963c9480e53c168 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:53.827919 25456 raft_consensus.cc:515] T 4af19371ea874c09a0a2147040835cbb P e61c3a8f61bb48f8a963c9480e53c168 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:53.851837 25386 leader_election.cc:290] T 179fd671030940b4b4a4e24bcc4aba0a P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:06:53.851876 25232 raft_consensus.cc:493] T 7be9efa6559648dbb5a0f7684c4542d1 P 127766fc592545a4997f7790f50f6076 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:53.852229 25456 leader_election.cc:290] T 4af19371ea874c09a0a2147040835cbb P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:06:53.852564 25232 raft_consensus.cc:515] T 7be9efa6559648dbb5a0f7684c4542d1 P 127766fc592545a4997f7790f50f6076 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } attrs { replace: true } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
W20260709 13:06:53.828037 25505 log.cc:927] Time spent T 2e36a9d6e29c4a7c860cf267efbd4c74 P e5256d91808b47c195bc9b4dbd7f2b87: Append to log took a long time: real 0.068s	user 0.000s	sys 0.000s
I20260709 13:06:53.857312 25232 leader_election.cc:290] T 7be9efa6559648dbb5a0f7684c4542d1 P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:06:53.846110 25403 raft_consensus.cc:515] T ef32ce6fdd0e40d382c79974f30295c6 P e5256d91808b47c195bc9b4dbd7f2b87 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:53.858891 25056 consensus_queue.cc:260] T 86a6797bdfe94fa496c050ceae4bd0d9 P e5256d91808b47c195bc9b4dbd7f2b87 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 13.7, Last appended by leader: 7, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:53.860121 25056 raft_consensus.cc:3060] T 86a6797bdfe94fa496c050ceae4bd0d9 P e5256d91808b47c195bc9b4dbd7f2b87 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:06:53.860435 25403 leader_election.cc:290] T ef32ce6fdd0e40d382c79974f30295c6 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 21 election: Requested vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:06:53.860518 25520 raft_consensus.cc:493] T d1e5873a19244c5ebbcd38e126796ee7 P 0473d2b2d01f4459b1e90fd12cc7840e [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:53.861238 25520 raft_consensus.cc:515] T d1e5873a19244c5ebbcd38e126796ee7 P 0473d2b2d01f4459b1e90fd12cc7840e [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:53.655231 25445 raft_consensus.cc:515] T fa731b585f684a7fb2d106c50f143b83 P e61c3a8f61bb48f8a963c9480e53c168 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:53.849346 25138 raft_consensus.cc:515] T 21e14947d70440f19044d8f75c31e1f9 P e61c3a8f61bb48f8a963c9480e53c168 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:53.811303 25353 raft_consensus.cc:493] T 14935b3ddf914369822e4a0547aaa355 P e5256d91808b47c195bc9b4dbd7f2b87 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:53.864331 25445 leader_election.cc:290] T fa731b585f684a7fb2d106c50f143b83 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:06:53.864121 25353 raft_consensus.cc:515] T 14935b3ddf914369822e4a0547aaa355 P e5256d91808b47c195bc9b4dbd7f2b87 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } attrs { replace: true } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:53.865304 25332 consensus_queue.cc:1048] T 28af091831594f9d8e96482078cc7625 P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
W20260709 13:06:53.866142 25236 consensus_meta.cc:287] T ed7fdbcb96d14d418db9ca90a792588a P 127766fc592545a4997f7790f50f6076: Time spent flushing consensus metadata: real 0.578s	user 0.009s	sys 0.000s
I20260709 13:06:53.825881 25086 raft_consensus.cc:493] T 28af091831594f9d8e96482078cc7625 P e61c3a8f61bb48f8a963c9480e53c168 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:06:53.826211 25512 log.cc:927] Time spent T 48824d5acfbc485ebf8c2d944e7202de P e61c3a8f61bb48f8a963c9480e53c168: Append to log took a long time: real 0.400s	user 0.001s	sys 0.000s
I20260709 13:06:53.863485 19411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a61655d99124a29b486ba4a5b37faea" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:06:53.821872 20076 leader_election.cc:304] T 1efebf73c86e432baa55533136b6e12c P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 127766fc592545a4997f7790f50f6076; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168
W20260709 13:06:53.799206 25435 consensus_meta.cc:287] T 62c6c134d3d24a1ab144dd9ee6bc3f64 P 127766fc592545a4997f7790f50f6076: Time spent flushing consensus metadata: real 0.598s	user 0.001s	sys 0.009s
I20260709 13:06:53.878933 19486 raft_consensus.cc:2468] T 1f85fc4b527a48848e5faa083b604e36 P 0473d2b2d01f4459b1e90fd12cc7840e [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 127766fc592545a4997f7790f50f6076 in term 16.
I20260709 13:06:53.729557 25183 raft_consensus.cc:515] T b08304a0a02b42d7840c4e8ee9a6bd1a P e61c3a8f61bb48f8a963c9480e53c168 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
W20260709 13:06:53.828079 25515 log.cc:927] Time spent T 22196caba61445d3bec98a0aab3c337d P e5256d91808b47c195bc9b4dbd7f2b87: Append to log took a long time: real 0.068s	user 0.000s	sys 0.001s
I20260709 13:06:53.865248 25138 leader_election.cc:290] T 21e14947d70440f19044d8f75c31e1f9 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
W20260709 13:06:53.904301 20076 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.3:36891, user_credentials={real_user=slave}} blocked reactor thread for 82521.9us
I20260709 13:06:53.906443 20076 leader_election.cc:304] T 14935b3ddf914369822e4a0547aaa355 P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 127766fc592545a4997f7790f50f6076, e61c3a8f61bb48f8a963c9480e53c168; no voters: 0473d2b2d01f4459b1e90fd12cc7840e
I20260709 13:06:53.912003 20076 leader_election.cc:304] T 6c5eebf646ad445a9d1b1adc319d7b16 P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 127766fc592545a4997f7790f50f6076; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:06:53.799800 25246 consensus_queue.cc:1048] T 46c5bfeecc314717bffe987e6844b6d0 P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.100s
W20260709 13:06:53.897136 25497 consensus_meta.cc:287] T ff9b0eddd810459b82d91c60777c10eb P 0473d2b2d01f4459b1e90fd12cc7840e: Time spent flushing consensus metadata: real 0.523s	user 0.005s	sys 0.005s
I20260709 13:06:53.868897 25353 leader_election.cc:290] T 14935b3ddf914369822e4a0547aaa355 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:06:53.848930 25311 leader_election.cc:290] T 1a61655d99124a29b486ba4a5b37faea P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:06:53.866549 25236 raft_consensus.cc:515] T ed7fdbcb96d14d418db9ca90a792588a P 127766fc592545a4997f7790f50f6076 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:53.896384 25261 raft_consensus.cc:493] T 217b5fae677b4971b3bbd2f357a1f7ff P 0473d2b2d01f4459b1e90fd12cc7840e [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:06:53.914146 25416 consensus_meta.cc:287] T edd7d470b5014c9489be7f41f64355c9 P 0473d2b2d01f4459b1e90fd12cc7840e: Time spent flushing consensus metadata: real 0.637s	user 0.009s	sys 0.001s
I20260709 13:06:53.893986 25086 raft_consensus.cc:515] T 28af091831594f9d8e96482078cc7625 P e61c3a8f61bb48f8a963c9480e53c168 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:53.910394 25359 raft_consensus.cc:2749] T 1efebf73c86e432baa55533136b6e12c P 127766fc592545a4997f7790f50f6076 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:06:53.832638 25447 raft_consensus.cc:515] T 40e1e16737a842ee936002830f36882e P e5256d91808b47c195bc9b4dbd7f2b87 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:53.965030 25447 leader_election.cc:290] T 40e1e16737a842ee936002830f36882e P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 19 election: Requested vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:06:53.967857 25183 leader_election.cc:290] T b08304a0a02b42d7840c4e8ee9a6bd1a P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
W20260709 13:06:53.969148 19452 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:53.969305 25520 leader_election.cc:290] T d1e5873a19244c5ebbcd38e126796ee7 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:06:53.868676 25404 raft_consensus.cc:515] T 1a61655d99124a29b486ba4a5b37faea P e5256d91808b47c195bc9b4dbd7f2b87 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:53.974135 25404 leader_election.cc:290] T 1a61655d99124a29b486ba4a5b37faea P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:06:53.975304 19411 raft_consensus.cc:2410] T 1a61655d99124a29b486ba4a5b37faea P e5256d91808b47c195bc9b4dbd7f2b87 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0473d2b2d01f4459b1e90fd12cc7840e for term 16 because replica has last-logged OpId of term: 14 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 9.
I20260709 13:06:53.982640 25086 leader_election.cc:290] T 28af091831594f9d8e96482078cc7625 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:06:53.928347 25497 raft_consensus.cc:515] T ff9b0eddd810459b82d91c60777c10eb P 0473d2b2d01f4459b1e90fd12cc7840e [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:53.925043 25329 raft_consensus.cc:493] T e381f1d6b8184797ad142de49be225a8 P 0473d2b2d01f4459b1e90fd12cc7840e [term 14 FOLLOWER]: Starting pre-election (detected failure of leader e5256d91808b47c195bc9b4dbd7f2b87)
I20260709 13:06:53.987903 25329 raft_consensus.cc:515] T e381f1d6b8184797ad142de49be225a8 P 0473d2b2d01f4459b1e90fd12cc7840e [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:53.917424 25403 consensus_queue.cc:1048] T 21e14947d70440f19044d8f75c31e1f9 P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.075s
I20260709 13:06:53.997064 25236 leader_election.cc:290] T ed7fdbcb96d14d418db9ca90a792588a P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 15 election: Requested vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:06:53.939982 25261 raft_consensus.cc:515] T 217b5fae677b4971b3bbd2f357a1f7ff P 0473d2b2d01f4459b1e90fd12cc7840e [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:53.999189 19478 raft_consensus.cc:2468] T 217b5fae677b4971b3bbd2f357a1f7ff P 0473d2b2d01f4459b1e90fd12cc7840e [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 13.
I20260709 13:06:53.943100 25416 raft_consensus.cc:515] T edd7d470b5014c9489be7f41f64355c9 P 0473d2b2d01f4459b1e90fd12cc7840e [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:54.001561 25416 leader_election.cc:290] T edd7d470b5014c9489be7f41f64355c9 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 20 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:06:54.003073 25368 leader_election.cc:290] T 5ec1c4ce15e04c7e8c283a62179f2a64 P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 12 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:06:53.924265 25221 raft_consensus.cc:2749] T 6c5eebf646ad445a9d1b1adc319d7b16 P 127766fc592545a4997f7790f50f6076 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:06:54.020229 25376 raft_consensus.cc:515] T b9f0d59553ad444883fcf5b5909f9798 P 0473d2b2d01f4459b1e90fd12cc7840e [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:53.896088 25435 raft_consensus.cc:515] T 62c6c134d3d24a1ab144dd9ee6bc3f64 P 127766fc592545a4997f7790f50f6076 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:54.028236 25435 leader_election.cc:290] T 62c6c134d3d24a1ab144dd9ee6bc3f64 P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 16 election: Requested vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:06:53.815634 25441 raft_consensus.cc:515] T d1e5873a19244c5ebbcd38e126796ee7 P e5256d91808b47c195bc9b4dbd7f2b87 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:53.923089 25298 raft_consensus.cc:2804] T 14935b3ddf914369822e4a0547aaa355 P 127766fc592545a4997f7790f50f6076 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:06:54.031013 25298 raft_consensus.cc:493] T 14935b3ddf914369822e4a0547aaa355 P 127766fc592545a4997f7790f50f6076 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:54.031515 25298 raft_consensus.cc:3060] T 14935b3ddf914369822e4a0547aaa355 P 127766fc592545a4997f7790f50f6076 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:06:53.921047 25305 raft_consensus.cc:493] T fa731b585f684a7fb2d106c50f143b83 P e5256d91808b47c195bc9b4dbd7f2b87 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 127766fc592545a4997f7790f50f6076)
I20260709 13:06:54.035061 25305 raft_consensus.cc:515] T fa731b585f684a7fb2d106c50f143b83 P e5256d91808b47c195bc9b4dbd7f2b87 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:54.037889 25305 leader_election.cc:290] T fa731b585f684a7fb2d106c50f143b83 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:06:53.948714 25353 raft_consensus.cc:493] T 65d8cb8d6ec64f459d5a47cefab10acf P e5256d91808b47c195bc9b4dbd7f2b87 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 127766fc592545a4997f7790f50f6076)
I20260709 13:06:54.038762 25353 raft_consensus.cc:515] T 65d8cb8d6ec64f459d5a47cefab10acf P e5256d91808b47c195bc9b4dbd7f2b87 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:54.041414 25353 leader_election.cc:290] T 65d8cb8d6ec64f459d5a47cefab10acf P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:06:54.044011 25441 leader_election.cc:290] T d1e5873a19244c5ebbcd38e126796ee7 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 20 election: Requested vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:06:53.986321 25497 leader_election.cc:290] T ff9b0eddd810459b82d91c60777c10eb P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 17 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:06:53.990587 25329 leader_election.cc:290] T e381f1d6b8184797ad142de49be225a8 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
W20260709 13:06:54.055987 19480 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.525s	user 0.050s	sys 0.160s
W20260709 13:06:54.056365 19480 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.525s	user 0.050s	sys 0.160s
W20260709 13:06:54.056993 19449 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.1:40321, user_credentials={real_user=slave}} blocked reactor thread for 196926us
I20260709 13:06:54.063642 19410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e5873a19244c5ebbcd38e126796ee7" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 20 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:06:54.064621 19405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff9b0eddd810459b82d91c60777c10eb" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
I20260709 13:06:54.065188 19405 raft_consensus.cc:3060] T ff9b0eddd810459b82d91c60777c10eb P e5256d91808b47c195bc9b4dbd7f2b87 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:06:54.068077 19410 raft_consensus.cc:2393] T d1e5873a19244c5ebbcd38e126796ee7 P e5256d91808b47c195bc9b4dbd7f2b87 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0473d2b2d01f4459b1e90fd12cc7840e in current term 20: Already voted for candidate e5256d91808b47c195bc9b4dbd7f2b87 in this term.
W20260709 13:06:54.072209 19374 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:54.080735 20112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14935b3ddf914369822e4a0547aaa355" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:06:54.080773 19410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e381f1d6b8184797ad142de49be225a8" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:06:54.093679 20107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab43d85f64114d4ebf618930e43d9ed0" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 18 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:06:54.102070 19404 raft_consensus.cc:1275] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P e5256d91808b47c195bc9b4dbd7f2b87 [term 18 FOLLOWER]: Refusing update from remote peer 127766fc592545a4997f7790f50f6076: Log matching property violated. Preceding OpId in replica: term: 17 index: 14. Preceding OpId from leader: term: 18 index: 15. (index mismatch)
I20260709 13:06:54.103209 19409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f85fc4b527a48848e5faa083b604e36" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
I20260709 13:06:54.108403 20104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1efebf73c86e432baa55533136b6e12c" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:06:54.111065 20110 raft_consensus.cc:1240] T 62c6c134d3d24a1ab144dd9ee6bc3f64 P 127766fc592545a4997f7790f50f6076 [term 16 FOLLOWER]: Rejecting Update request from peer e61c3a8f61bb48f8a963c9480e53c168 for earlier term 15. Current term is 16. Ops: []
I20260709 13:06:54.109961 19403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edd7d470b5014c9489be7f41f64355c9" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
I20260709 13:06:54.119033 19403 raft_consensus.cc:3060] T edd7d470b5014c9489be7f41f64355c9 P e5256d91808b47c195bc9b4dbd7f2b87 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:06:54.121383 19405 raft_consensus.cc:2468] T ff9b0eddd810459b82d91c60777c10eb P e5256d91808b47c195bc9b4dbd7f2b87 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 17.
I20260709 13:06:54.124507 19409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7be9efa6559648dbb5a0f7684c4542d1" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 18 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:06:54.087726 25497 raft_consensus.cc:493] T 22196caba61445d3bec98a0aab3c337d P 0473d2b2d01f4459b1e90fd12cc7840e [term 16 FOLLOWER]: Starting pre-election (detected failure of leader e5256d91808b47c195bc9b4dbd7f2b87)
I20260709 13:06:54.130863 20104 raft_consensus.cc:1240] T 5ec1c4ce15e04c7e8c283a62179f2a64 P 127766fc592545a4997f7790f50f6076 [term 12 FOLLOWER]: Rejecting Update request from peer e5256d91808b47c195bc9b4dbd7f2b87 for earlier term 11. Current term is 12. Ops: []
I20260709 13:06:54.149881 19523 leader_election.cc:400] T a08760e15aac4630a629431f56024dc8 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 20 election: Vote denied by peer e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321) with higher term. Message: Invalid argument: T a08760e15aac4630a629431f56024dc8 P e5256d91808b47c195bc9b4dbd7f2b87 [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate e61c3a8f61bb48f8a963c9480e53c168 for earlier term 20. Current term is 21.
I20260709 13:06:54.150348 19523 leader_election.cc:403] T a08760e15aac4630a629431f56024dc8 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 20 election: Cancelling election due to peer responding with higher term
I20260709 13:06:54.152483 19404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ec1c4ce15e04c7e8c283a62179f2a64" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
W20260709 13:06:54.152837 25524 log.cc:927] Time spent T 2725d2c4cb054f18b0fc8f735c15f6c2 P e61c3a8f61bb48f8a963c9480e53c168: Append to log took a long time: real 0.070s	user 0.000s	sys 0.001s
I20260709 13:06:54.153234 25433 raft_consensus.cc:493] T ff75a1d4cb1f493db8f71ddc136ba9ab P 0473d2b2d01f4459b1e90fd12cc7840e [term 17 FOLLOWER]: Starting pre-election (detected failure of leader e5256d91808b47c195bc9b4dbd7f2b87)
I20260709 13:06:54.153751 25433 raft_consensus.cc:515] T ff75a1d4cb1f493db8f71ddc136ba9ab P 0473d2b2d01f4459b1e90fd12cc7840e [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:54.159940 19478 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58286 (request call id 2525) took 1030 ms. Trace:
I20260709 13:06:54.154637 20105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "309c3ca0ca4b4f3ba129752ea2cb293b" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:06:54.158088 19403 raft_consensus.cc:2468] T edd7d470b5014c9489be7f41f64355c9 P e5256d91808b47c195bc9b4dbd7f2b87 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 20.
I20260709 13:06:54.155280 25337 raft_consensus.cc:493] T ece3db938bc649d4a40a51522ed5259c P e61c3a8f61bb48f8a963c9480e53c168 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 127766fc592545a4997f7790f50f6076)
I20260709 13:06:54.179946 25337 raft_consensus.cc:515] T ece3db938bc649d4a40a51522ed5259c P e61c3a8f61bb48f8a963c9480e53c168 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:54.146061 25497 raft_consensus.cc:515] T 22196caba61445d3bec98a0aab3c337d P 0473d2b2d01f4459b1e90fd12cc7840e [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:54.181964 25337 leader_election.cc:290] T ece3db938bc649d4a40a51522ed5259c P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:06:54.182902 25497 leader_election.cc:290] T 22196caba61445d3bec98a0aab3c337d P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:06:54.184404 19481 raft_consensus.cc:1240] T ff9b0eddd810459b82d91c60777c10eb P 0473d2b2d01f4459b1e90fd12cc7840e [term 17 FOLLOWER]: Rejecting Update request from peer 127766fc592545a4997f7790f50f6076 for earlier term 16. Current term is 17. Ops: []
I20260709 13:06:54.185842 19483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7be9efa6559648dbb5a0f7684c4542d1" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 18 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:06:54.186589 19483 raft_consensus.cc:2468] T 7be9efa6559648dbb5a0f7684c4542d1 P 0473d2b2d01f4459b1e90fd12cc7840e [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 127766fc592545a4997f7790f50f6076 in term 17.
I20260709 13:06:54.135510 25521 raft_consensus.cc:493] T e381f1d6b8184797ad142de49be225a8 P e61c3a8f61bb48f8a963c9480e53c168 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader e5256d91808b47c195bc9b4dbd7f2b87)
I20260709 13:06:54.163861 25490 leader_election.cc:290] T ed7fdbcb96d14d418db9ca90a792588a P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 14 election: Requested vote from peers e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:06:54.188041 25521 raft_consensus.cc:515] T e381f1d6b8184797ad142de49be225a8 P e61c3a8f61bb48f8a963c9480e53c168 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:54.188805 25392 leader_election.cc:290] T b08304a0a02b42d7840c4e8ee9a6bd1a P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
W20260709 13:06:54.189596 25493 log.cc:927] Time spent T f1b10566f45d4a7d9029858330e02d5b P e61c3a8f61bb48f8a963c9480e53c168: Append to log took a long time: real 0.987s	user 0.012s	sys 0.000s
I20260709 13:06:54.190200 25521 leader_election.cc:290] T e381f1d6b8184797ad142de49be225a8 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:06:54.191985 25093 leader_election.cc:290] T 2e36a9d6e29c4a7c860cf267efbd4c74 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:06:54.193410 25376 leader_election.cc:290] T b9f0d59553ad444883fcf5b5909f9798 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 15 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:06:54.194825 20104 raft_consensus.cc:1275] T 7be9efa6559648dbb5a0f7684c4542d1 P 127766fc592545a4997f7790f50f6076 [term 17 FOLLOWER]: Refusing update from remote peer e5256d91808b47c195bc9b4dbd7f2b87: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 13:06:54.195035 19480 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58286 (request call id 2527) took 1064 ms. Trace:
I20260709 13:06:54.195214 20106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff9b0eddd810459b82d91c60777c10eb" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076"
I20260709 13:06:54.196067 20103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14935b3ddf914369822e4a0547aaa355" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:06:54.196822 20107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36f6ba92b9ba46babe4ebd6c02e5fbd9" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:06:54.197247 20110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14efcc79969f41babe5529c22d59156d" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:06:54.198128 20111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65d8cb8d6ec64f459d5a47cefab10acf" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:06:54.198329 25373 raft_consensus.cc:493] T 2b74109013a140ada21feeef92d6f563 P 0473d2b2d01f4459b1e90fd12cc7840e [term 14 FOLLOWER]: Starting pre-election (detected failure of leader e5256d91808b47c195bc9b4dbd7f2b87)
I20260709 13:06:54.198880 25373 raft_consensus.cc:515] T 2b74109013a140ada21feeef92d6f563 P 0473d2b2d01f4459b1e90fd12cc7840e [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:54.199220 19408 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49050 (request call id 1169) took 1482 ms. Trace:
I20260709 13:06:54.199285 19374 leader_election.cc:304] T ab43d85f64114d4ebf618930e43d9ed0 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, 127766fc592545a4997f7790f50f6076
I20260709 13:06:54.199654 19408 rpcz_store.cc:276] 0709 13:06:52.717997 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:52.718158 (+   161us) service_pool.cc:224] Handling call
0709 13:06:52.718535 (+   377us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:52.748941 (+ 30406us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:52.748971 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:52.758362 (+  9391us) log.cc:844] Serialized 26 byte log entry
0709 13:06:53.092700 (+334338us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:06:53.092737 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:54.198870 (+1106133us) spinlock_profiling.cc:243] Waited 30.2 ms on lock 0x7b54001de554. stack: 00007f4a79de9343 00007f4a79de9240 00007f4a797781d4 00007f4a834b6304 00007f4a834b6299 00007f4a7ce71571 00007f4a7cf08e01 00007f4a7cf0783e 00007f4a81ecc419 00007f4a7b443bd4 00007f4a7b443b62 00007f4a7b443a91 00007f4a7b443a0c 00007f4a7b442cc2 00007f4a7b24348c 00007f4a7b2428c6
0709 13:06:54.198913 (+    43us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:54.198959 (+    46us) raft_consensus.cc:1685] finished
0709 13:06:54.198972 (+    13us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:54.199166 (+   194us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":69364608,"thread_start_us":301440,"threads_started":1,"wal-append.queue_time_us":467342}
I20260709 13:06:54.200613 19484 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58286 (request call id 2529) took 1069 ms. Trace:
I20260709 13:06:54.200815 25373 leader_election.cc:290] T 2b74109013a140ada21feeef92d6f563 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:06:54.201040 19484 rpcz_store.cc:276] 0709 13:06:53.133049 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:53.483446 (+350397us) service_pool.cc:224] Handling call
0709 13:06:53.512116 (+ 28670us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:53.616142 (+104026us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:53.616170 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:53.627770 (+ 11600us) log.cc:844] Serialized 26 byte log entry
0709 13:06:54.060166 (+432396us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:06:54.060204 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:54.060268 (+    64us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:54.200389 (+140121us) raft_consensus.cc:1685] finished
0709 13:06:54.200410 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:54.200557 (+   147us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":118637,"raft.queue_time_us":104781,"raft.run_cpu_time_us":111,"raft.run_wall_time_us":10674,"thread_start_us":330508,"threads_started":1,"wal-append.queue_time_us":460978}
W20260709 13:06:54.202518 19402 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49050 (request call id 1162) took 1867 ms (client timeout 1984 ms). Trace:
W20260709 13:06:54.235719 19402 rpcz_store.cc:269] 0709 13:06:52.334864 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:52.338951 (+  4087us) service_pool.cc:224] Handling call
0709 13:06:54.202365 (+1863414us) spinlock_profiling.cc:243] Waited 924 ms on lock 0x7b54000b2cd4. stack: 00007f4a79de9343 00007f4a79de9240 00007f4a797781d4 00007f4a834b6304 00007f4a834b6299 00007f4a7ce71571 00007f4a7cf0c2fa 00007f4a81ecdb17 00007f4a7b4486d4 00007f4a7b448662 00007f4a7b448591 00007f4a7b44850c 00007f4a7b4477c2 00007f4a7b24348c 00007f4a7b2428c6 00007f4a7b24226f
0709 13:06:54.202461 (+    96us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2124694400}
I20260709 13:06:54.157189 25433 leader_election.cc:290] T ff75a1d4cb1f493db8f71ddc136ba9ab P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:06:54.202497 20109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa731b585f684a7fb2d106c50f143b83" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:06:54.207875 25056 raft_consensus.cc:2749] T ab43d85f64114d4ebf618930e43d9ed0 P e5256d91808b47c195bc9b4dbd7f2b87 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:06:54.236691 25261 leader_election.cc:290] T 217b5fae677b4971b3bbd2f357a1f7ff P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:06:54.202502 20078 leader_election.cc:304] T 1f85fc4b527a48848e5faa083b604e36 P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, 127766fc592545a4997f7790f50f6076; no voters: 
I20260709 13:06:54.241503 25532 raft_consensus.cc:2804] T 1f85fc4b527a48848e5faa083b604e36 P 127766fc592545a4997f7790f50f6076 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:06:54.241780 25221 consensus_queue.cc:1048] T 775c229504194560ba9589bc2199b089 P 127766fc592545a4997f7790f50f6076 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:06:54.242120 25532 raft_consensus.cc:697] T 1f85fc4b527a48848e5faa083b604e36 P 127766fc592545a4997f7790f50f6076 [term 16 LEADER]: Becoming Leader. State: Replica: 127766fc592545a4997f7790f50f6076, State: Running, Role: LEADER
I20260709 13:06:54.243136 25532 consensus_queue.cc:237] T 1f85fc4b527a48848e5faa083b604e36 P 127766fc592545a4997f7790f50f6076 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:54.244628 25221 consensus_queue.cc:1059] T ff9b0eddd810459b82d91c60777c10eb P 127766fc592545a4997f7790f50f6076 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 }, Status: INVALID_TERM, Last received: 16.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
W20260709 13:06:54.246245 19524 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:54.209306 20111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed7fdbcb96d14d418db9ca90a792588a" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076"
W20260709 13:06:54.247483 19449 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.1:40321, user_credentials={real_user=slave}} blocked reactor thread for 139865us
I20260709 13:06:54.249258 19402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9f0d59553ad444883fcf5b5909f9798" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
I20260709 13:06:54.249758 19402 raft_consensus.cc:3060] T b9f0d59553ad444883fcf5b5909f9798 P e5256d91808b47c195bc9b4dbd7f2b87 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:06:54.251853 19560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed7fdbcb96d14d418db9ca90a792588a" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
W20260709 13:06:54.210268 19523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.1:40321, user_credentials={real_user=slave}} blocked reactor thread for 60573.4us
I20260709 13:06:54.176420 19478 rpcz_store.cc:276] 0709 13:06:53.129639 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:53.190804 (+ 61165us) service_pool.cc:224] Handling call
0709 13:06:54.159742 (+968938us) spinlock_profiling.cc:243] Waited 807 ms on lock 0x7b5400221854. stack: 00007f4a79de9343 00007f4a79de9240 00007f4a797781d4 00007f4a834b6304 00007f4a834b6299 00007f4a7ce71571 00007f4a7cf0c2fa 00007f4a81ecdb17 00007f4a7b4486d4 00007f4a7b448662 00007f4a7b448591 00007f4a7b44850c 00007f4a7b4477c2 00007f4a7b24348c 00007f4a7b2428c6 00007f4a7b24226f
0709 13:06:54.159865 (+   123us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1856745344}
I20260709 13:06:54.213047 25345 raft_consensus.cc:3055] T 0cdf56e38bbc453d9438d359e5a69955 P 0473d2b2d01f4459b1e90fd12cc7840e [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:06:54.269830 20111 raft_consensus.cc:2368] T ed7fdbcb96d14d418db9ca90a792588a P 127766fc592545a4997f7790f50f6076 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 0473d2b2d01f4459b1e90fd12cc7840e for earlier term 14. Current term is 15.
I20260709 13:06:54.216018 25298 raft_consensus.cc:515] T 14935b3ddf914369822e4a0547aaa355 P 127766fc592545a4997f7790f50f6076 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:54.224121 19485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed7fdbcb96d14d418db9ca90a792588a" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:06:54.270632 19485 raft_consensus.cc:3060] T ed7fdbcb96d14d418db9ca90a792588a P 0473d2b2d01f4459b1e90fd12cc7840e [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:06:54.224687 25446 raft_consensus.cc:515] T f93ee515a9c14139bf566522ed8232f3 P 0473d2b2d01f4459b1e90fd12cc7840e [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:54.225464 25521 raft_consensus.cc:2749] T a08760e15aac4630a629431f56024dc8 P e61c3a8f61bb48f8a963c9480e53c168 [term 21 FOLLOWER]: Leader election lost for term 20. Reason: Vote denied by peer e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321) with higher term. Message: Invalid argument: T a08760e15aac4630a629431f56024dc8 P e5256d91808b47c195bc9b4dbd7f2b87 [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate e61c3a8f61bb48f8a963c9480e53c168 for earlier term 20. Current term is 21.
I20260709 13:06:54.225185 25090 consensus_queue.cc:1048] T 7be9efa6559648dbb5a0f7684c4542d1 P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Connected to new peer: Peer: permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:06:54.226975 25392 consensus_queue.cc:1059] T 5ec1c4ce15e04c7e8c283a62179f2a64 P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:06:54.227211 19481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62c6c134d3d24a1ab144dd9ee6bc3f64" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:06:54.285996 19551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a61655d99124a29b486ba4a5b37faea" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:06:54.286203 19481 raft_consensus.cc:3060] T 62c6c134d3d24a1ab144dd9ee6bc3f64 P 0473d2b2d01f4459b1e90fd12cc7840e [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:06:54.223547 19374 leader_election.cc:304] T 309c3ca0ca4b4f3ba129752ea2cb293b P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, 127766fc592545a4997f7790f50f6076
I20260709 13:06:54.231909 19482 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58294 (request call id 2757) took 1192 ms. Trace:
I20260709 13:06:54.287602 19482 rpcz_store.cc:276] 0709 13:06:53.039383 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:53.079302 (+ 39919us) service_pool.cc:224] Handling call
0709 13:06:54.231738 (+1152436us) spinlock_profiling.cc:243] Waited 373 ms on lock 0x7b5400149454. stack: 00007f4a79de9343 00007f4a79de9240 00007f4a797781d4 00007f4a834b6304 00007f4a834b6299 00007f4a7ce71571 00007f4a7cf0c2fa 00007f4a81ecdb17 00007f4a7b4486d4 00007f4a7b448662 00007f4a7b448591 00007f4a7b44850c 00007f4a7b4477c2 00007f4a7b24348c 00007f4a7b2428c6 00007f4a7b24226f
0709 13:06:54.231861 (+   123us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":857235328}
I20260709 13:06:54.232527 19483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ec1c4ce15e04c7e8c283a62179f2a64" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:06:54.288982 19483 raft_consensus.cc:3060] T 5ec1c4ce15e04c7e8c283a62179f2a64 P 0473d2b2d01f4459b1e90fd12cc7840e [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:06:54.195446 19480 rpcz_store.cc:276] 0709 13:06:53.130259 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:53.444312 (+314053us) service_pool.cc:224] Handling call
0709 13:06:53.444663 (+   351us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:06:53.445057 (+   394us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:53.445087 (+    30us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:06:53.445671 (+   584us) log.cc:844] Serialized 52 byte log entry
0709 13:06:54.056697 (+611026us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:06:54.056736 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:54.056801 (+    65us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:54.194818 (+138017us) raft_consensus.cc:1685] finished
0709 13:06:54.194838 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:54.194980 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":6869,"raft.run_cpu_time_us":87,"raft.run_wall_time_us":87,"spinlock_wait_cycles":79232,"thread_start_us":525527,"threads_started":1,"wal-append.queue_time_us":674073}
I20260709 13:06:54.252528 19557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e381f1d6b8184797ad142de49be225a8" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:06:54.290007 19557 raft_consensus.cc:2468] T e381f1d6b8184797ad142de49be225a8 P e61c3a8f61bb48f8a963c9480e53c168 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 14.
I20260709 13:06:54.291139 19557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edd7d470b5014c9489be7f41f64355c9" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:06:54.291824 19557 raft_consensus.cc:3060] T edd7d470b5014c9489be7f41f64355c9 P e61c3a8f61bb48f8a963c9480e53c168 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:06:54.254369 19450 leader_election.cc:304] T 96efeaaf1057492490e9a621f37e1a2d P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e; no voters: 127766fc592545a4997f7790f50f6076, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:06:54.255877 19449 leader_election.cc:304] T ff9b0eddd810459b82d91c60777c10eb P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87; no voters: 
I20260709 13:06:54.259093 19402 raft_consensus.cc:2468] T b9f0d59553ad444883fcf5b5909f9798 P e5256d91808b47c195bc9b4dbd7f2b87 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 15.
I20260709 13:06:54.293262 19449 leader_election.cc:304] T edd7d470b5014c9489be7f41f64355c9 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87; no voters: 
I20260709 13:06:54.245996 25359 raft_consensus.cc:3055] T ff9b0eddd810459b82d91c60777c10eb P 127766fc592545a4997f7790f50f6076 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:06:54.297674 19411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff75a1d4cb1f493db8f71ddc136ba9ab" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:06:54.269110 19560 raft_consensus.cc:2393] T ed7fdbcb96d14d418db9ca90a792588a P e61c3a8f61bb48f8a963c9480e53c168 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 0473d2b2d01f4459b1e90fd12cc7840e in current term 14: Already voted for candidate e61c3a8f61bb48f8a963c9480e53c168 in this term.
I20260709 13:06:54.298853 19552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b74109013a140ada21feeef92d6f563" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:06:54.299160 19526 leader_election.cc:304] T 217b5fae677b4971b3bbd2f357a1f7ff P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:06:54.299557 19552 raft_consensus.cc:2393] T 2b74109013a140ada21feeef92d6f563 P e61c3a8f61bb48f8a963c9480e53c168 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0473d2b2d01f4459b1e90fd12cc7840e in current term 15: Already voted for candidate e61c3a8f61bb48f8a963c9480e53c168 in this term.
I20260709 13:06:54.271184 19553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff75a1d4cb1f493db8f71ddc136ba9ab" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:06:54.275080 24700 raft_consensus.cc:493] T 7f575b143b844aa096b50997dad3516a P e61c3a8f61bb48f8a963c9480e53c168 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader e5256d91808b47c195bc9b4dbd7f2b87)
I20260709 13:06:54.300226 19553 raft_consensus.cc:2468] T ff75a1d4cb1f493db8f71ddc136ba9ab P e61c3a8f61bb48f8a963c9480e53c168 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 17.
I20260709 13:06:54.269456 25086 raft_consensus.cc:493] T 85c494af21f9457a85da47b9bc70c1fd P e61c3a8f61bb48f8a963c9480e53c168 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader e5256d91808b47c195bc9b4dbd7f2b87)
I20260709 13:06:54.276095 19523 leader_election.cc:304] T 1a61655d99124a29b486ba4a5b37faea P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168; no voters: 0473d2b2d01f4459b1e90fd12cc7840e
I20260709 13:06:54.303773 19404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22196caba61445d3bec98a0aab3c337d" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:06:54.270023 25345 raft_consensus.cc:740] T 0cdf56e38bbc453d9438d359e5a69955 P 0473d2b2d01f4459b1e90fd12cc7840e [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 0473d2b2d01f4459b1e90fd12cc7840e, State: Running, Role: LEADER
I20260709 13:06:54.289000 19551 raft_consensus.cc:2410] T 1a61655d99124a29b486ba4a5b37faea P e61c3a8f61bb48f8a963c9480e53c168 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0473d2b2d01f4459b1e90fd12cc7840e for term 16 because replica has last-logged OpId of term: 14 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 9.
W20260709 13:06:54.294382 19374 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.4:43121, user_credentials={real_user=slave}} blocked reactor thread for 70935.8us
I20260709 13:06:54.296097 19409 raft_consensus.cc:1240] T 1dc5b3532fe54f74876d02beffa2c230 P e5256d91808b47c195bc9b4dbd7f2b87 [term 18 FOLLOWER]: Rejecting Update request from peer 0473d2b2d01f4459b1e90fd12cc7840e for earlier term 17. Current term is 18. Ops: []
I20260709 13:06:54.296947 19402 raft_consensus.cc:1240] T 0cdf56e38bbc453d9438d359e5a69955 P e5256d91808b47c195bc9b4dbd7f2b87 [term 17 FOLLOWER]: Rejecting Update request from peer 0473d2b2d01f4459b1e90fd12cc7840e for earlier term 16. Current term is 17. Ops: []
I20260709 13:06:54.300269 24700 raft_consensus.cc:515] T 7f575b143b844aa096b50997dad3516a P e61c3a8f61bb48f8a963c9480e53c168 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:54.270305 19558 raft_consensus.cc:1275] T 28af091831594f9d8e96482078cc7625 P e61c3a8f61bb48f8a963c9480e53c168 [term 18 FOLLOWER]: Refusing update from remote peer 0473d2b2d01f4459b1e90fd12cc7840e: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 18 index: 10. (term mismatch)
I20260709 13:06:54.301309 19553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "217b5fae677b4971b3bbd2f357a1f7ff" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:06:54.302543 19560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22196caba61445d3bec98a0aab3c337d" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:06:54.283142 19559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e5873a19244c5ebbcd38e126796ee7" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 20 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:06:54.306533 20112 raft_consensus.cc:2393] T 14935b3ddf914369822e4a0547aaa355 P 127766fc592545a4997f7790f50f6076 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e61c3a8f61bb48f8a963c9480e53c168 in current term 12: Already voted for candidate 127766fc592545a4997f7790f50f6076 in this term.
I20260709 13:06:54.312225 20107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4af19371ea874c09a0a2147040835cbb" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:06:54.313613 19560 raft_consensus.cc:2468] T 22196caba61445d3bec98a0aab3c337d P e61c3a8f61bb48f8a963c9480e53c168 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 16.
I20260709 13:06:54.315423 19450 leader_election.cc:304] T e381f1d6b8184797ad142de49be225a8 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168; no voters: e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:06:54.316665 19450 leader_election.cc:304] T ff75a1d4cb1f493db8f71ddc136ba9ab P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:06:54.306903 19554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9f0d59553ad444883fcf5b5909f9798" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:06:54.311018 20076 leader_election.cc:304] T 0afb57ae58a24a01850491d69f0213dd P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 127766fc592545a4997f7790f50f6076; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:06:54.318001 19450 leader_election.cc:304] T 22196caba61445d3bec98a0aab3c337d P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:06:54.319712 19558 pending_rounds.cc:85] T 28af091831594f9d8e96482078cc7625 P e61c3a8f61bb48f8a963c9480e53c168: Aborting all ops after (but not including) 9
W20260709 13:06:54.319993 19523 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:54.320089 19558 pending_rounds.cc:107] T 28af091831594f9d8e96482078cc7625 P e61c3a8f61bb48f8a963c9480e53c168: Aborting uncommitted NO_OP operation due to leader change: 17.10
I20260709 13:06:54.320619 19558 raft_consensus.cc:2889] T 28af091831594f9d8e96482078cc7625 P e61c3a8f61bb48f8a963c9480e53c168 [term 18 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:06:54.323946 19404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b74109013a140ada21feeef92d6f563" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:06:54.324131 20106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ece3db938bc649d4a40a51522ed5259c" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:06:54.325194 20103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa731b585f684a7fb2d106c50f143b83" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:06:54.326261 20111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab43d85f64114d4ebf618930e43d9ed0" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:06:54.336563 19409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "217b5fae677b4971b3bbd2f357a1f7ff" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:06:54.337255 19409 raft_consensus.cc:2468] T 217b5fae677b4971b3bbd2f357a1f7ff P e5256d91808b47c195bc9b4dbd7f2b87 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 13.
W20260709 13:06:54.341022 19377 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:54.323200 25227 raft_consensus.cc:493] T 85c494af21f9457a85da47b9bc70c1fd P 127766fc592545a4997f7790f50f6076 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader e5256d91808b47c195bc9b4dbd7f2b87)
I20260709 13:06:54.314525 25086 raft_consensus.cc:515] T 85c494af21f9457a85da47b9bc70c1fd P e61c3a8f61bb48f8a963c9480e53c168 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:54.343283 25227 raft_consensus.cc:515] T 85c494af21f9457a85da47b9bc70c1fd P 127766fc592545a4997f7790f50f6076 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:54.343886 25340 raft_consensus.cc:2804] T ff75a1d4cb1f493db8f71ddc136ba9ab P 0473d2b2d01f4459b1e90fd12cc7840e [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:06:54.299889 25097 raft_consensus.cc:2749] T 96efeaaf1057492490e9a621f37e1a2d P 0473d2b2d01f4459b1e90fd12cc7840e [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:06:54.301054 25496 raft_consensus.cc:3055] T 5ec1c4ce15e04c7e8c283a62179f2a64 P e5256d91808b47c195bc9b4dbd7f2b87 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:06:54.345734 19449 leader_election.cc:304] T b9f0d59553ad444883fcf5b5909f9798 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87; no voters: 
I20260709 13:06:54.344300 25340 raft_consensus.cc:493] T ff75a1d4cb1f493db8f71ddc136ba9ab P 0473d2b2d01f4459b1e90fd12cc7840e [term 17 FOLLOWER]: Starting leader election (detected failure of leader e5256d91808b47c195bc9b4dbd7f2b87)
I20260709 13:06:54.304122 25433 raft_consensus.cc:2804] T ff9b0eddd810459b82d91c60777c10eb P 0473d2b2d01f4459b1e90fd12cc7840e [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:06:54.307396 25138 raft_consensus.cc:2804] T 217b5fae677b4971b3bbd2f357a1f7ff P e61c3a8f61bb48f8a963c9480e53c168 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:06:54.301338 25093 raft_consensus.cc:2749] T 309c3ca0ca4b4f3ba129752ea2cb293b P e5256d91808b47c195bc9b4dbd7f2b87 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:06:54.297459 25359 raft_consensus.cc:740] T ff9b0eddd810459b82d91c60777c10eb P 127766fc592545a4997f7790f50f6076 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 127766fc592545a4997f7790f50f6076, State: Running, Role: LEADER
I20260709 13:06:54.356997 19553 raft_consensus.cc:2468] T 217b5fae677b4971b3bbd2f357a1f7ff P e61c3a8f61bb48f8a963c9480e53c168 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 12.
I20260709 13:06:54.357882 19552 raft_consensus.cc:1275] T 14935b3ddf914369822e4a0547aaa355 P e61c3a8f61bb48f8a963c9480e53c168 [term 11 FOLLOWER]: Refusing update from remote peer 0473d2b2d01f4459b1e90fd12cc7840e: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:06:54.344349 25052 raft_consensus.cc:2804] T 1a61655d99124a29b486ba4a5b37faea P e61c3a8f61bb48f8a963c9480e53c168 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:06:54.331960 25497 raft_consensus.cc:2804] T edd7d470b5014c9489be7f41f64355c9 P 0473d2b2d01f4459b1e90fd12cc7840e [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:06:54.331489 25392 raft_consensus.cc:493] T 172b3dd13109415a955b71ac0e9d2234 P e5256d91808b47c195bc9b4dbd7f2b87 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 127766fc592545a4997f7790f50f6076)
W20260709 13:06:54.365788 20075 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.1:40321, user_credentials={real_user=slave}} blocked reactor thread for 290220us
I20260709 13:06:54.349921 25434 raft_consensus.cc:2804] T e381f1d6b8184797ad142de49be225a8 P 0473d2b2d01f4459b1e90fd12cc7840e [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:06:54.349617 25370 raft_consensus.cc:2749] T 0afb57ae58a24a01850491d69f0213dd P 127766fc592545a4997f7790f50f6076 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:06:54.356079 25340 raft_consensus.cc:3060] T ff75a1d4cb1f493db8f71ddc136ba9ab P 0473d2b2d01f4459b1e90fd12cc7840e [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:06:54.350219 25496 raft_consensus.cc:740] T 5ec1c4ce15e04c7e8c283a62179f2a64 P e5256d91808b47c195bc9b4dbd7f2b87 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: e5256d91808b47c195bc9b4dbd7f2b87, State: Running, Role: LEADER
I20260709 13:06:54.370522 19409 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "bc225c93219c45538b53a1bd3d387e4d"
dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
mode: GRACEFUL
new_leader_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
 from {username='slave'} at 127.0.0.1:37312
I20260709 13:06:54.396463 19409 raft_consensus.cc:606] T bc225c93219c45538b53a1bd3d387e4d P e5256d91808b47c195bc9b4dbd7f2b87 [term 14 LEADER]: Received request to transfer leadership to TS 0473d2b2d01f4459b1e90fd12cc7840e
I20260709 13:06:54.378185 19483 raft_consensus.cc:2468] T 5ec1c4ce15e04c7e8c283a62179f2a64 P 0473d2b2d01f4459b1e90fd12cc7840e [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 127766fc592545a4997f7790f50f6076 in term 12.
I20260709 13:06:54.381585 19481 raft_consensus.cc:2468] T 62c6c134d3d24a1ab144dd9ee6bc3f64 P 0473d2b2d01f4459b1e90fd12cc7840e [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 127766fc592545a4997f7790f50f6076 in term 16.
I20260709 13:06:54.399407 19402 raft_consensus.cc:1240] T b9f0d59553ad444883fcf5b5909f9798 P e5256d91808b47c195bc9b4dbd7f2b87 [term 15 FOLLOWER]: Rejecting Update request from peer e61c3a8f61bb48f8a963c9480e53c168 for earlier term 14. Current term is 15. Ops: []
I20260709 13:06:54.386148 19557 raft_consensus.cc:2468] T edd7d470b5014c9489be7f41f64355c9 P e61c3a8f61bb48f8a963c9480e53c168 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 20.
I20260709 13:06:54.361286 25463 raft_consensus.cc:493] T 48824d5acfbc485ebf8c2d944e7202de P 0473d2b2d01f4459b1e90fd12cc7840e [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:54.330468 19485 raft_consensus.cc:2468] T ed7fdbcb96d14d418db9ca90a792588a P 0473d2b2d01f4459b1e90fd12cc7840e [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 127766fc592545a4997f7790f50f6076 in term 15.
I20260709 13:06:54.401019 19402 raft_consensus.cc:1240] T 40e1e16737a842ee936002830f36882e P e5256d91808b47c195bc9b4dbd7f2b87 [term 19 FOLLOWER]: Rejecting Update request from peer e61c3a8f61bb48f8a963c9480e53c168 for earlier term 18. Current term is 19. Ops: [18.10-18.10]
I20260709 13:06:54.361106 25537 raft_consensus.cc:2804] T 22196caba61445d3bec98a0aab3c337d P 0473d2b2d01f4459b1e90fd12cc7840e [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:06:54.364955 25227 leader_election.cc:290] T 85c494af21f9457a85da47b9bc70c1fd P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:06:54.403249 19450 leader_election.cc:304] T 1a61655d99124a29b486ba4a5b37faea P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e; no voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:06:54.414412 19404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85c494af21f9457a85da47b9bc70c1fd" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:06:54.367154 25434 raft_consensus.cc:493] T e381f1d6b8184797ad142de49be225a8 P 0473d2b2d01f4459b1e90fd12cc7840e [term 14 FOLLOWER]: Starting leader election (detected failure of leader e5256d91808b47c195bc9b4dbd7f2b87)
I20260709 13:06:54.402437 25497 raft_consensus.cc:697] T edd7d470b5014c9489be7f41f64355c9 P 0473d2b2d01f4459b1e90fd12cc7840e [term 20 LEADER]: Becoming Leader. State: Replica: 0473d2b2d01f4459b1e90fd12cc7840e, State: Running, Role: LEADER
I20260709 13:06:54.361472 25138 raft_consensus.cc:493] T 217b5fae677b4971b3bbd2f357a1f7ff P e61c3a8f61bb48f8a963c9480e53c168 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 0473d2b2d01f4459b1e90fd12cc7840e)
I20260709 13:06:54.401846 25433 raft_consensus.cc:697] T ff9b0eddd810459b82d91c60777c10eb P 0473d2b2d01f4459b1e90fd12cc7840e [term 17 LEADER]: Becoming Leader. State: Replica: 0473d2b2d01f4459b1e90fd12cc7840e, State: Running, Role: LEADER
I20260709 13:06:54.404196 19449 leader_election.cc:304] T 2b74109013a140ada21feeef92d6f563 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e; no voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168
W20260709 13:06:54.428793 20076 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.3:36891, user_credentials={real_user=slave}} blocked reactor thread for 78615.8us
I20260709 13:06:54.418190 19450 leader_election.cc:304] T d1e5873a19244c5ebbcd38e126796ee7 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e; no voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:06:54.406548 25367 raft_consensus.cc:3055] T 0e1085d23e8347fbbd5bce7542f4b1f4 P 127766fc592545a4997f7790f50f6076 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:06:54.407136 25462 raft_consensus.cc:2804] T b9f0d59553ad444883fcf5b5909f9798 P 0473d2b2d01f4459b1e90fd12cc7840e [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:06:54.429589 19449 leader_election.cc:304] T 217b5fae677b4971b3bbd2f357a1f7ff P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87; no voters: 
I20260709 13:06:54.414250 25537 raft_consensus.cc:493] T 22196caba61445d3bec98a0aab3c337d P 0473d2b2d01f4459b1e90fd12cc7840e [term 16 FOLLOWER]: Starting leader election (detected failure of leader e5256d91808b47c195bc9b4dbd7f2b87)
I20260709 13:06:54.408391 25086 leader_election.cc:290] T 85c494af21f9457a85da47b9bc70c1fd P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:06:54.370455 25392 raft_consensus.cc:515] T 172b3dd13109415a955b71ac0e9d2234 P e5256d91808b47c195bc9b4dbd7f2b87 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:54.453186 19411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cdf56e38bbc453d9438d359e5a69955" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:06:54.452841 19377 leader_election.cc:304] T 76cb037fc9064d13b59a8969d897ce8c P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87; no voters: 
I20260709 13:06:54.393636 25329 consensus_queue.cc:1048] T 28af091831594f9d8e96482078cc7625 P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.039s
I20260709 13:06:54.420601 25332 raft_consensus.cc:2749] T 1a61655d99124a29b486ba4a5b37faea P 0473d2b2d01f4459b1e90fd12cc7840e [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:06:54.426467 25434 raft_consensus.cc:3060] T e381f1d6b8184797ad142de49be225a8 P 0473d2b2d01f4459b1e90fd12cc7840e [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:06:54.463937 19411 raft_consensus.cc:2393] T 0cdf56e38bbc453d9438d359e5a69955 P e5256d91808b47c195bc9b4dbd7f2b87 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e61c3a8f61bb48f8a963c9480e53c168 in current term 17: Already voted for candidate e5256d91808b47c195bc9b4dbd7f2b87 in this term.
W20260709 13:06:54.456171 25396 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.233s	user 0.014s	sys 0.038s
I20260709 13:06:54.434101 25367 raft_consensus.cc:740] T 0e1085d23e8347fbbd5bce7542f4b1f4 P 127766fc592545a4997f7790f50f6076 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 127766fc592545a4997f7790f50f6076, State: Running, Role: LEADER
I20260709 13:06:54.370134 25345 consensus_queue.cc:260] T 0cdf56e38bbc453d9438d359e5a69955 P 0473d2b2d01f4459b1e90fd12cc7840e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:54.435225 25261 raft_consensus.cc:3060] T 2b74109013a140ada21feeef92d6f563 P 0473d2b2d01f4459b1e90fd12cc7840e [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:06:54.450115 25537 raft_consensus.cc:3060] T 22196caba61445d3bec98a0aab3c337d P 0473d2b2d01f4459b1e90fd12cc7840e [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:06:54.429040 25138 raft_consensus.cc:3060] T 217b5fae677b4971b3bbd2f357a1f7ff P e61c3a8f61bb48f8a963c9480e53c168 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:06:54.455315 25350 raft_consensus.cc:3060] T d1e5873a19244c5ebbcd38e126796ee7 P 0473d2b2d01f4459b1e90fd12cc7840e [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:06:54.415195 25463 raft_consensus.cc:515] T 48824d5acfbc485ebf8c2d944e7202de P 0473d2b2d01f4459b1e90fd12cc7840e [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:54.455621 25461 raft_consensus.cc:2804] T 217b5fae677b4971b3bbd2f357a1f7ff P 0473d2b2d01f4459b1e90fd12cc7840e [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:06:54.480790 19411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76cb037fc9064d13b59a8969d897ce8c" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 17 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
W20260709 13:06:54.471174 25396 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.254s	user 0.014s	sys 0.038s
I20260709 13:06:54.458374 25462 raft_consensus.cc:697] T b9f0d59553ad444883fcf5b5909f9798 P 0473d2b2d01f4459b1e90fd12cc7840e [term 15 LEADER]: Becoming Leader. State: Replica: 0473d2b2d01f4459b1e90fd12cc7840e, State: Running, Role: LEADER
I20260709 13:06:54.449556 25490 consensus_queue.cc:1059] T 1dc5b3532fe54f74876d02beffa2c230 P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 }, Status: INVALID_TERM, Last received: 17.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.026s
I20260709 13:06:54.470878 25298 leader_election.cc:290] T 14935b3ddf914369822e4a0547aaa355 P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 12 election: Requested vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:06:54.472188 25305 raft_consensus.cc:2804] T 76cb037fc9064d13b59a8969d897ce8c P e5256d91808b47c195bc9b4dbd7f2b87 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:06:54.473968 25052 raft_consensus.cc:697] T 1a61655d99124a29b486ba4a5b37faea P e61c3a8f61bb48f8a963c9480e53c168 [term 15 LEADER]: Becoming Leader. State: Replica: e61c3a8f61bb48f8a963c9480e53c168, State: Running, Role: LEADER
I20260709 13:06:54.502139 25052 consensus_queue.cc:237] T 1a61655d99124a29b486ba4a5b37faea P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.9, Last appended by leader: 9, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:54.488727 25497 consensus_queue.cc:237] T edd7d470b5014c9489be7f41f64355c9 P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 18.10, Last appended by leader: 10, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:54.479374 25446 leader_election.cc:290] T f93ee515a9c14139bf566522ed8232f3 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 20 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:06:54.506174 19523 leader_election.cc:304] T 1efebf73c86e432baa55533136b6e12c P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e61c3a8f61bb48f8a963c9480e53c168; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, 127766fc592545a4997f7790f50f6076
I20260709 13:06:54.507170 19410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b74109013a140ada21feeef92d6f563" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
I20260709 13:06:54.508294 19410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "217b5fae677b4971b3bbd2f357a1f7ff" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:06:54.509034 19410 raft_consensus.cc:2393] T 217b5fae677b4971b3bbd2f357a1f7ff P e5256d91808b47c195bc9b4dbd7f2b87 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e61c3a8f61bb48f8a963c9480e53c168 in current term 13: Already voted for candidate e5256d91808b47c195bc9b4dbd7f2b87 in this term.
I20260709 13:06:54.509712 19410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dc5b3532fe54f74876d02beffa2c230" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
W20260709 13:06:54.491677 25538 log.cc:927] Time spent T 2a16f7501e2444fb86d4e2778e734e02 P 127766fc592545a4997f7790f50f6076: Append to log took a long time: real 0.083s	user 0.001s	sys 0.000s
I20260709 13:06:54.457841 25359 consensus_queue.cc:260] T ff9b0eddd810459b82d91c60777c10eb P 127766fc592545a4997f7790f50f6076 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.12, Last appended by leader: 12, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:54.495056 19411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4509b76741dc428e9201c70c1658da13" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
I20260709 13:06:54.495711 25367 consensus_queue.cc:260] T 0e1085d23e8347fbbd5bce7542f4b1f4 P 127766fc592545a4997f7790f50f6076 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:54.497017 25462 consensus_queue.cc:237] T b9f0d59553ad444883fcf5b5909f9798 P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:54.522320 19551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62c6c134d3d24a1ab144dd9ee6bc3f64" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:06:54.454404 25496 consensus_queue.cc:260] T 5ec1c4ce15e04c7e8c283a62179f2a64 P e5256d91808b47c195bc9b4dbd7f2b87 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
W20260709 13:06:54.500597 25499 log.cc:927] Time spent T 2b74109013a140ada21feeef92d6f563 P e5256d91808b47c195bc9b4dbd7f2b87: Append to log took a long time: real 1.278s	user 0.001s	sys 0.009s
I20260709 13:06:54.500748 25392 leader_election.cc:290] T 172b3dd13109415a955b71ac0e9d2234 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:06:54.504729 19403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff75a1d4cb1f493db8f71ddc136ba9ab" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:06:54.512573 19410 raft_consensus.cc:2393] T 1dc5b3532fe54f74876d02beffa2c230 P e5256d91808b47c195bc9b4dbd7f2b87 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e61c3a8f61bb48f8a963c9480e53c168 in current term 18: Already voted for candidate e5256d91808b47c195bc9b4dbd7f2b87 in this term.
I20260709 13:06:54.539317 19553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7be9efa6559648dbb5a0f7684c4542d1" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 18 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:06:54.539891 19553 raft_consensus.cc:2468] T 7be9efa6559648dbb5a0f7684c4542d1 P e61c3a8f61bb48f8a963c9480e53c168 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 127766fc592545a4997f7790f50f6076 in term 17.
I20260709 13:06:54.540174 19410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f93ee515a9c14139bf566522ed8232f3" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 20 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:06:54.514952 19557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed7fdbcb96d14d418db9ca90a792588a" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:06:54.541224 19557 raft_consensus.cc:3060] T ed7fdbcb96d14d418db9ca90a792588a P e61c3a8f61bb48f8a963c9480e53c168 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:06:54.542400 19477 raft_consensus.cc:1240] T 1f85fc4b527a48848e5faa083b604e36 P 0473d2b2d01f4459b1e90fd12cc7840e [term 16 FOLLOWER]: Rejecting Update request from peer e5256d91808b47c195bc9b4dbd7f2b87 for earlier term 15. Current term is 16. Ops: []
I20260709 13:06:54.543327 19477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36f6ba92b9ba46babe4ebd6c02e5fbd9" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:06:54.543850 19477 raft_consensus.cc:2468] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P 0473d2b2d01f4459b1e90fd12cc7840e [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 18.
I20260709 13:06:54.545100 19484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b08304a0a02b42d7840c4e8ee9a6bd1a" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:06:54.545751 19484 raft_consensus.cc:2468] T b08304a0a02b42d7840c4e8ee9a6bd1a P 0473d2b2d01f4459b1e90fd12cc7840e [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 17.
I20260709 13:06:54.546098 20107 raft_consensus.cc:1275] T 48824d5acfbc485ebf8c2d944e7202de P 127766fc592545a4997f7790f50f6076 [term 19 FOLLOWER]: Refusing update from remote peer e61c3a8f61bb48f8a963c9480e53c168: Log matching property violated. Preceding OpId in replica: term: 18 index: 13. Preceding OpId from leader: term: 19 index: 14. (index mismatch)
I20260709 13:06:54.498155 19407 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52342 (request call id 3083) took 1276 ms. Trace:
I20260709 13:06:54.536011 19483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a08760e15aac4630a629431f56024dc8" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:06:54.536360 19482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2725d2c4cb054f18b0fc8f735c15f6c2" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 20 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:06:54.537438 19480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21e14947d70440f19044d8f75c31e1f9" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:06:54.538050 19478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46c5bfeecc314717bffe987e6844b6d0" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 24 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:06:54.542421 19486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14efcc79969f41babe5529c22d59156d" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:06:54.547353 19480 raft_consensus.cc:2376] T 21e14947d70440f19044d8f75c31e1f9 P 0473d2b2d01f4459b1e90fd12cc7840e [term 17 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 17. Re-sending same reply.
I20260709 13:06:54.482908 25461 raft_consensus.cc:493] T 217b5fae677b4971b3bbd2f357a1f7ff P 0473d2b2d01f4459b1e90fd12cc7840e [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:54.540737 19410 raft_consensus.cc:2468] T f93ee515a9c14139bf566522ed8232f3 P e5256d91808b47c195bc9b4dbd7f2b87 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 19.
I20260709 13:06:54.512261 25521 raft_consensus.cc:2749] T 1efebf73c86e432baa55533136b6e12c P e61c3a8f61bb48f8a963c9480e53c168 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:06:54.562175 20103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85c494af21f9457a85da47b9bc70c1fd" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:06:54.489970 25305 raft_consensus.cc:493] T 76cb037fc9064d13b59a8969d897ce8c P e5256d91808b47c195bc9b4dbd7f2b87 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 0473d2b2d01f4459b1e90fd12cc7840e)
I20260709 13:06:54.547824 20076 leader_election.cc:304] T 7be9efa6559648dbb5a0f7684c4542d1 P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, 127766fc592545a4997f7790f50f6076, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:06:54.551144 19480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef32ce6fdd0e40d382c79974f30295c6" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:06:54.594364 19553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85c494af21f9457a85da47b9bc70c1fd" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:06:54.546694 19407 rpcz_store.cc:276] 0709 13:06:53.221365 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:53.221509 (+   144us) service_pool.cc:224] Handling call
0709 13:06:54.497968 (+1276459us) spinlock_profiling.cc:243] Waited 442 ms on lock 0x7b54000e65d4. stack: 00007f4a79de9343 00007f4a79de9240 00007f4a797781d4 00007f4a834b6304 00007f4a834b6299 00007f4a7ce71571 00007f4a7cf0c2fa 00007f4a81ecdb17 00007f4a7b4486d4 00007f4a7b448662 00007f4a7b448591 00007f4a7b44850c 00007f4a7b4477c2 00007f4a7b24348c 00007f4a7b2428c6 00007f4a7b24226f
0709 13:06:54.498085 (+   117us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1016640256}
I20260709 13:06:54.595049 19553 raft_consensus.cc:2468] T 85c494af21f9457a85da47b9bc70c1fd P e61c3a8f61bb48f8a963c9480e53c168 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 127766fc592545a4997f7790f50f6076 in term 15.
I20260709 13:06:54.595425 19407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28af091831594f9d8e96482078cc7625" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:06:54.596407 19407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ece3db938bc649d4a40a51522ed5259c" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:06:54.552299 25461 raft_consensus.cc:3060] T 217b5fae677b4971b3bbd2f357a1f7ff P 0473d2b2d01f4459b1e90fd12cc7840e [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:06:54.552871 25457 leader_election.cc:290] T ed7fdbcb96d14d418db9ca90a792588a P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:06:54.557593 19403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "179fd671030940b4b4a4e24bcc4aba0a" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:06:54.558318 19410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a16f7501e2444fb86d4e2778e734e02" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:06:54.512476 25433 consensus_queue.cc:237] T ff9b0eddd810459b82d91c60777c10eb P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.12, Last appended by leader: 12, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:54.559458 19557 raft_consensus.cc:2468] T ed7fdbcb96d14d418db9ca90a792588a P e61c3a8f61bb48f8a963c9480e53c168 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 127766fc592545a4997f7790f50f6076 in term 15.
W20260709 13:06:54.561254 25536 log.cc:927] Time spent T 2725d2c4cb054f18b0fc8f735c15f6c2 P 0473d2b2d01f4459b1e90fd12cc7840e: Append to log took a long time: real 0.128s	user 0.000s	sys 0.000s
W20260709 13:06:54.563455 25540 log.cc:927] Time spent T 775c229504194560ba9589bc2199b089 P e5256d91808b47c195bc9b4dbd7f2b87: Append to log took a long time: real 0.079s	user 0.000s	sys 0.000s
W20260709 13:06:54.568718 20077 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:54.579698 25340 raft_consensus.cc:515] T ff75a1d4cb1f493db8f71ddc136ba9ab P 0473d2b2d01f4459b1e90fd12cc7840e [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:54.547312 25463 leader_election.cc:290] T 48824d5acfbc485ebf8c2d944e7202de P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:06:54.581035 20078 leader_election.cc:304] T 5ec1c4ce15e04c7e8c283a62179f2a64 P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, 127766fc592545a4997f7790f50f6076; no voters: 
W20260709 13:06:54.587496 25542 log.cc:927] Time spent T 172b3dd13109415a955b71ac0e9d2234 P 127766fc592545a4997f7790f50f6076: Append to log took a long time: real 0.054s	user 0.000s	sys 0.000s
I20260709 13:06:54.631896 25448 consensus_queue.cc:260] T 1dc5b3532fe54f74876d02beffa2c230 P 0473d2b2d01f4459b1e90fd12cc7840e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 17.9, Last appended by leader: 9, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:54.591120 25496 raft_consensus.cc:3060] T 5ec1c4ce15e04c7e8c283a62179f2a64 P e5256d91808b47c195bc9b4dbd7f2b87 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:06:54.633679 25448 raft_consensus.cc:3060] T 1dc5b3532fe54f74876d02beffa2c230 P 0473d2b2d01f4459b1e90fd12cc7840e [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:06:54.599303 25305 raft_consensus.cc:3060] T 76cb037fc9064d13b59a8969d897ce8c P e5256d91808b47c195bc9b4dbd7f2b87 [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:06:54.639101 20078 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.2:46257, user_credentials={real_user=slave}} blocked reactor thread for 58160.1us
I20260709 13:06:54.639851 20078 leader_election.cc:304] T 62c6c134d3d24a1ab144dd9ee6bc3f64 P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, 127766fc592545a4997f7790f50f6076; no voters: e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:06:54.640007 25370 raft_consensus.cc:2804] T 5ec1c4ce15e04c7e8c283a62179f2a64 P 127766fc592545a4997f7790f50f6076 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:06:54.640648 25221 raft_consensus.cc:2804] T 62c6c134d3d24a1ab144dd9ee6bc3f64 P 127766fc592545a4997f7790f50f6076 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:06:54.640992 20078 leader_election.cc:304] T ed7fdbcb96d14d418db9ca90a792588a P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, 127766fc592545a4997f7790f50f6076; no voters: 
I20260709 13:06:54.641171 25221 raft_consensus.cc:697] T 62c6c134d3d24a1ab144dd9ee6bc3f64 P 127766fc592545a4997f7790f50f6076 [term 16 LEADER]: Becoming Leader. State: Replica: 127766fc592545a4997f7790f50f6076, State: Running, Role: LEADER
I20260709 13:06:54.534253 25549 consensus_queue.cc:1059] T 62c6c134d3d24a1ab144dd9ee6bc3f64 P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.072s
I20260709 13:06:54.642226 25221 consensus_queue.cc:237] T 62c6c134d3d24a1ab144dd9ee6bc3f64 P 127766fc592545a4997f7790f50f6076 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:54.643198 20107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48824d5acfbc485ebf8c2d944e7202de" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:06:54.643774 20107 raft_consensus.cc:2468] T 48824d5acfbc485ebf8c2d944e7202de P 127766fc592545a4997f7790f50f6076 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 19.
I20260709 13:06:54.591825 19449 leader_election.cc:400] T ed7fdbcb96d14d418db9ca90a792588a P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 14 election: Vote denied by peer 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121) with higher term. Message: Invalid argument: T ed7fdbcb96d14d418db9ca90a792588a P 127766fc592545a4997f7790f50f6076 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 0473d2b2d01f4459b1e90fd12cc7840e for earlier term 14. Current term is 15.
I20260709 13:06:54.645511 19449 leader_election.cc:403] T ed7fdbcb96d14d418db9ca90a792588a P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 14 election: Cancelling election due to peer responding with higher term
I20260709 13:06:54.591598 19409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21e14947d70440f19044d8f75c31e1f9" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 18 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
W20260709 13:06:54.645908 19452 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:54.646227 19449 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.4:43121, user_credentials={real_user=slave}} blocked reactor thread for 54548.3us
I20260709 13:06:54.646781 19409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85c494af21f9457a85da47b9bc70c1fd" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:06:54.647516 19556 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41504 (request call id 951) took 1023 ms. Trace:
I20260709 13:06:54.647853 19409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b08304a0a02b42d7840c4e8ee9a6bd1a" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:06:54.648007 19483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed7fdbcb96d14d418db9ca90a792588a" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 15 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:06:54.648437 19409 raft_consensus.cc:2468] T b08304a0a02b42d7840c4e8ee9a6bd1a P e5256d91808b47c195bc9b4dbd7f2b87 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 17.
I20260709 13:06:54.648736 19483 raft_consensus.cc:2393] T ed7fdbcb96d14d418db9ca90a792588a P 0473d2b2d01f4459b1e90fd12cc7840e [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e61c3a8f61bb48f8a963c9480e53c168 in current term 15: Already voted for candidate 127766fc592545a4997f7790f50f6076 in this term.
I20260709 13:06:54.649253 19409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa8650e71aa14778b3d73721fc50d9fc" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 18 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:06:54.549750 19411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4af19371ea874c09a0a2147040835cbb" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:06:54.594339 25521 raft_consensus.cc:493] T ef32ce6fdd0e40d382c79974f30295c6 P e61c3a8f61bb48f8a963c9480e53c168 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:06:54.652031 19377 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:54.593135 19551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14935b3ddf914369822e4a0547aaa355" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:06:54.652777 19551 raft_consensus.cc:3060] T 14935b3ddf914369822e4a0547aaa355 P e61c3a8f61bb48f8a963c9480e53c168 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:06:54.597342 19478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14935b3ddf914369822e4a0547aaa355" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
W20260709 13:06:54.601217 20076 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.3:36891, user_credentials={real_user=slave}} blocked reactor thread for 53460us
I20260709 13:06:54.654304 19480 raft_consensus.cc:2468] T ef32ce6fdd0e40d382c79974f30295c6 P 0473d2b2d01f4459b1e90fd12cc7840e [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 21.
I20260709 13:06:54.605543 19407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e381f1d6b8184797ad142de49be225a8" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:06:54.655444 19480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76cb037fc9064d13b59a8969d897ce8c" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 17 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:06:54.656497 19480 raft_consensus.cc:2410] T 76cb037fc9064d13b59a8969d897ce8c P 0473d2b2d01f4459b1e90fd12cc7840e [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e61c3a8f61bb48f8a963c9480e53c168 for term 17 because replica has last-logged OpId of term: 15 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 7.
I20260709 13:06:54.656589 19407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f575b143b844aa096b50997dad3516a" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:06:54.611928 19410 raft_consensus.cc:2410] T 2a16f7501e2444fb86d4e2778e734e02 P e5256d91808b47c195bc9b4dbd7f2b87 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e61c3a8f61bb48f8a963c9480e53c168 for term 17 because replica has last-logged OpId of term: 16 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 12.
I20260709 13:06:54.611912 19482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40e1e16737a842ee936002830f36882e" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:06:54.657410 19480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4509b76741dc428e9201c70c1658da13" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:06:54.594043 25367 raft_consensus.cc:3060] T 0e1085d23e8347fbbd5bce7542f4b1f4 P 127766fc592545a4997f7790f50f6076 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:06:54.630882 19403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa731b585f684a7fb2d106c50f143b83" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:06:54.632156 25340 leader_election.cc:290] T ff75a1d4cb1f493db8f71ddc136ba9ab P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 18 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:06:54.642747 25535 raft_consensus.cc:2804] T ed7fdbcb96d14d418db9ca90a792588a P 127766fc592545a4997f7790f50f6076 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:06:54.649549 25463 raft_consensus.cc:2749] T ed7fdbcb96d14d418db9ca90a792588a P 0473d2b2d01f4459b1e90fd12cc7840e [term 15 FOLLOWER]: Leader election lost for term 14. Reason: Vote denied by peer 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121) with higher term. Message: Invalid argument: T ed7fdbcb96d14d418db9ca90a792588a P 127766fc592545a4997f7790f50f6076 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 0473d2b2d01f4459b1e90fd12cc7840e for earlier term 14. Current term is 15.
I20260709 13:06:54.676728 19557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9f0d59553ad444883fcf5b5909f9798" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:06:54.678009 19557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edd7d470b5014c9489be7f41f64355c9" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:06:54.592216 20109 raft_consensus.cc:1240] T 14935b3ddf914369822e4a0547aaa355 P 127766fc592545a4997f7790f50f6076 [term 12 FOLLOWER]: Rejecting Update request from peer 0473d2b2d01f4459b1e90fd12cc7840e for earlier term 11. Current term is 12. Ops: []
I20260709 13:06:54.592952 20103 raft_consensus.cc:2468] T 85c494af21f9457a85da47b9bc70c1fd P 127766fc592545a4997f7790f50f6076 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 15.
I20260709 13:06:54.626989 19486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a61655d99124a29b486ba4a5b37faea" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:06:54.679306 19486 raft_consensus.cc:2468] T 1a61655d99124a29b486ba4a5b37faea P 0473d2b2d01f4459b1e90fd12cc7840e [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 15.
I20260709 13:06:54.658987 25549 raft_consensus.cc:3055] T 62c6c134d3d24a1ab144dd9ee6bc3f64 P e61c3a8f61bb48f8a963c9480e53c168 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:06:54.665038 19406 raft_consensus.cc:1217] T 46c5bfeecc314717bffe987e6844b6d0 P e5256d91808b47c195bc9b4dbd7f2b87 [term 23 FOLLOWER]: Deduplicated request from leader. Original: 20.10->[21.11-22.12]   Dedup: 21.11->[22.12-22.12]
I20260709 13:06:54.680476 19406 raft_consensus.cc:1240] T 46c5bfeecc314717bffe987e6844b6d0 P e5256d91808b47c195bc9b4dbd7f2b87 [term 23 FOLLOWER]: Rejecting Update request from peer e61c3a8f61bb48f8a963c9480e53c168 for earlier term 22. Current term is 23. Ops: [21.11-22.12]
I20260709 13:06:54.647862 19556 rpcz_store.cc:276] 0709 13:06:53.623999 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:53.624486 (+   487us) service_pool.cc:224] Handling call
0709 13:06:54.647381 (+1022895us) spinlock_profiling.cc:243] Waited 94.4 ms on lock 0x7b5400126454. stack: 00007f4a79de9343 00007f4a79de9240 00007f4a797781d4 00007f4a834b6304 00007f4a834b6299 00007f4a7ce71571 00007f4a7cf0c2fa 00007f4a81ecdb17 00007f4a7b4486d4 00007f4a7b448662 00007f4a7b448591 00007f4a7b44850c 00007f4a7b4477c2 00007f4a7b24348c 00007f4a7b2428c6 00007f4a7b24226f
0709 13:06:54.647470 (+    89us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":217151744}
I20260709 13:06:54.666381 19480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f93ee515a9c14139bf566522ed8232f3" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 20 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:06:54.678635 19557 raft_consensus.cc:2368] T edd7d470b5014c9489be7f41f64355c9 P e61c3a8f61bb48f8a963c9480e53c168 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate e5256d91808b47c195bc9b4dbd7f2b87 for earlier term 19. Current term is 20.
W20260709 13:06:54.681245 20078 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:54.669762 19483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14935b3ddf914369822e4a0547aaa355" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:06:54.682183 19480 raft_consensus.cc:2393] T f93ee515a9c14139bf566522ed8232f3 P 0473d2b2d01f4459b1e90fd12cc7840e [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e61c3a8f61bb48f8a963c9480e53c168 in current term 20: Already voted for candidate 0473d2b2d01f4459b1e90fd12cc7840e in this term.
I20260709 13:06:54.671028 19410 raft_consensus.cc:1240] T d1e5873a19244c5ebbcd38e126796ee7 P e5256d91808b47c195bc9b4dbd7f2b87 [term 20 FOLLOWER]: Rejecting Update request from peer e61c3a8f61bb48f8a963c9480e53c168 for earlier term 19. Current term is 20. Ops: [19.10-19.10]
I20260709 13:06:54.672075 19482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa8650e71aa14778b3d73721fc50d9fc" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 18 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:06:54.690474 19377 leader_election.cc:304] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87; no voters: 127766fc592545a4997f7790f50f6076
I20260709 13:06:54.690583 25396 consensus_queue.cc:1059] T 1f85fc4b527a48848e5faa083b604e36 P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 }, Status: INVALID_TERM, Last received: 15.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:06:54.691413 25396 raft_consensus.cc:2804] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P e5256d91808b47c195bc9b4dbd7f2b87 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:06:54.691783 25396 raft_consensus.cc:493] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P e5256d91808b47c195bc9b4dbd7f2b87 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:54.692088 25396 raft_consensus.cc:3060] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P e5256d91808b47c195bc9b4dbd7f2b87 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:06:54.692459 25350 raft_consensus.cc:2749] T d1e5873a19244c5ebbcd38e126796ee7 P 0473d2b2d01f4459b1e90fd12cc7840e [term 20 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:06:54.693132 19403 raft_consensus.cc:1275] T 86a6797bdfe94fa496c050ceae4bd0d9 P e5256d91808b47c195bc9b4dbd7f2b87 [term 14 FOLLOWER]: Refusing update from remote peer e61c3a8f61bb48f8a963c9480e53c168: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 14 index: 7. (term mismatch)
I20260709 13:06:54.693260 25090 raft_consensus.cc:3055] T 1f85fc4b527a48848e5faa083b604e36 P e5256d91808b47c195bc9b4dbd7f2b87 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:06:54.693497 19403 pending_rounds.cc:85] T 86a6797bdfe94fa496c050ceae4bd0d9 P e5256d91808b47c195bc9b4dbd7f2b87: Aborting all ops after (but not including) 6
I20260709 13:06:54.693627 25090 raft_consensus.cc:740] T 1f85fc4b527a48848e5faa083b604e36 P e5256d91808b47c195bc9b4dbd7f2b87 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: e5256d91808b47c195bc9b4dbd7f2b87, State: Running, Role: LEADER
I20260709 13:06:54.694821 25340 raft_consensus.cc:493] T 0e1085d23e8347fbbd5bce7542f4b1f4 P 0473d2b2d01f4459b1e90fd12cc7840e [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:54.694478 25090 consensus_queue.cc:260] T 1f85fc4b527a48848e5faa083b604e36 P e5256d91808b47c195bc9b4dbd7f2b87 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:54.695314 25340 raft_consensus.cc:515] T 0e1085d23e8347fbbd5bce7542f4b1f4 P 0473d2b2d01f4459b1e90fd12cc7840e [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:54.695767 25090 raft_consensus.cc:3060] T 1f85fc4b527a48848e5faa083b604e36 P e5256d91808b47c195bc9b4dbd7f2b87 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:06:54.697510 25340 leader_election.cc:290] T 0e1085d23e8347fbbd5bce7542f4b1f4 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:06:54.700317 25305 raft_consensus.cc:515] T 76cb037fc9064d13b59a8969d897ce8c P e5256d91808b47c195bc9b4dbd7f2b87 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:54.660943 25521 raft_consensus.cc:515] T ef32ce6fdd0e40d382c79974f30295c6 P e61c3a8f61bb48f8a963c9480e53c168 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:54.693749 19403 pending_rounds.cc:107] T 86a6797bdfe94fa496c050ceae4bd0d9 P e5256d91808b47c195bc9b4dbd7f2b87: Aborting uncommitted NO_OP operation due to leader change: 13.7
I20260709 13:06:54.702015 19403 raft_consensus.cc:2889] T 86a6797bdfe94fa496c050ceae4bd0d9 P e5256d91808b47c195bc9b4dbd7f2b87 [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:06:54.703003 19449 leader_election.cc:304] T 48824d5acfbc485ebf8c2d944e7202de P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, 127766fc592545a4997f7790f50f6076; no voters: 
I20260709 13:06:54.704406 25340 raft_consensus.cc:2804] T 48824d5acfbc485ebf8c2d944e7202de P 0473d2b2d01f4459b1e90fd12cc7840e [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:06:54.704789 25340 raft_consensus.cc:493] T 48824d5acfbc485ebf8c2d944e7202de P 0473d2b2d01f4459b1e90fd12cc7840e [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:54.705161 25340 raft_consensus.cc:3060] T 48824d5acfbc485ebf8c2d944e7202de P 0473d2b2d01f4459b1e90fd12cc7840e [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:06:54.705722 25434 raft_consensus.cc:515] T e381f1d6b8184797ad142de49be225a8 P 0473d2b2d01f4459b1e90fd12cc7840e [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:54.707758 25434 leader_election.cc:290] T e381f1d6b8184797ad142de49be225a8 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 15 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:06:54.713557 25396 raft_consensus.cc:515] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P e5256d91808b47c195bc9b4dbd7f2b87 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:54.675981 19558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76cb037fc9064d13b59a8969d897ce8c" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:06:54.715401 19558 raft_consensus.cc:2393] T 76cb037fc9064d13b59a8969d897ce8c P e61c3a8f61bb48f8a963c9480e53c168 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e5256d91808b47c195bc9b4dbd7f2b87 in current term 16: Already voted for candidate e61c3a8f61bb48f8a963c9480e53c168 in this term.
I20260709 13:06:54.718899 19408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff75a1d4cb1f493db8f71ddc136ba9ab" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
I20260709 13:06:54.718907 19411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f93ee515a9c14139bf566522ed8232f3" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 20 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
I20260709 13:06:54.720110 19479 raft_consensus.cc:1240] T e381f1d6b8184797ad142de49be225a8 P 0473d2b2d01f4459b1e90fd12cc7840e [term 15 FOLLOWER]: Rejecting Update request from peer e5256d91808b47c195bc9b4dbd7f2b87 for earlier term 14. Current term is 15. Ops: []
I20260709 13:06:54.720361 19411 raft_consensus.cc:3060] T f93ee515a9c14139bf566522ed8232f3 P e5256d91808b47c195bc9b4dbd7f2b87 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:06:54.719838 19405 raft_consensus.cc:1240] T 28af091831594f9d8e96482078cc7625 P e5256d91808b47c195bc9b4dbd7f2b87 [term 18 FOLLOWER]: Rejecting Update request from peer e61c3a8f61bb48f8a963c9480e53c168 for earlier term 17. Current term is 18. Ops: [17.10-17.10]
I20260709 13:06:54.720381 19558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f93ee515a9c14139bf566522ed8232f3" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 20 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:06:54.721709 19482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff75a1d4cb1f493db8f71ddc136ba9ab" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:06:54.722070 19558 raft_consensus.cc:3060] T f93ee515a9c14139bf566522ed8232f3 P e61c3a8f61bb48f8a963c9480e53c168 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:06:54.722638 19482 raft_consensus.cc:2393] T ff75a1d4cb1f493db8f71ddc136ba9ab P 0473d2b2d01f4459b1e90fd12cc7840e [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e61c3a8f61bb48f8a963c9480e53c168 in current term 18: Already voted for candidate 0473d2b2d01f4459b1e90fd12cc7840e in this term.
I20260709 13:06:54.723060 19408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e381f1d6b8184797ad142de49be225a8" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
I20260709 13:06:54.724017 19377 leader_election.cc:304] T b08304a0a02b42d7840c4e8ee9a6bd1a P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87; no voters: 
I20260709 13:06:54.730799 19486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e5873a19244c5ebbcd38e126796ee7" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 20 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:06:54.720703 20112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e1085d23e8347fbbd5bce7542f4b1f4" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:06:54.740391 19377 leader_election.cc:304] T 14efcc79969f41babe5529c22d59156d P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, 127766fc592545a4997f7790f50f6076
I20260709 13:06:54.747288 25403 raft_consensus.cc:2749] T 14efcc79969f41babe5529c22d59156d P e5256d91808b47c195bc9b4dbd7f2b87 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:06:54.748020 25304 raft_consensus.cc:2804] T b08304a0a02b42d7840c4e8ee9a6bd1a P e5256d91808b47c195bc9b4dbd7f2b87 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:06:54.747931 19552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40e1e16737a842ee936002830f36882e" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:06:54.748492 25304 raft_consensus.cc:493] T b08304a0a02b42d7840c4e8ee9a6bd1a P e5256d91808b47c195bc9b4dbd7f2b87 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:54.748838 25304 raft_consensus.cc:3060] T b08304a0a02b42d7840c4e8ee9a6bd1a P e5256d91808b47c195bc9b4dbd7f2b87 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:06:54.749259 19552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e381f1d6b8184797ad142de49be225a8" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:06:54.749433 24700 leader_election.cc:290] T 7f575b143b844aa096b50997dad3516a P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:06:54.750324 19552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff75a1d4cb1f493db8f71ddc136ba9ab" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:06:54.751583 19552 raft_consensus.cc:3060] T ff75a1d4cb1f493db8f71ddc136ba9ab P e61c3a8f61bb48f8a963c9480e53c168 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:06:54.752141 25138 raft_consensus.cc:515] T 217b5fae677b4971b3bbd2f357a1f7ff P e61c3a8f61bb48f8a963c9480e53c168 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:54.752444 19479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28af091831594f9d8e96482078cc7625" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:06:54.753538 19479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e36a9d6e29c4a7c860cf267efbd4c74" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:06:54.716871 25549 raft_consensus.cc:740] T 62c6c134d3d24a1ab144dd9ee6bc3f64 P e61c3a8f61bb48f8a963c9480e53c168 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: e61c3a8f61bb48f8a963c9480e53c168, State: Running, Role: LEADER
I20260709 13:06:54.755949 25305 leader_election.cc:290] T 76cb037fc9064d13b59a8969d897ce8c P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 16 election: Requested vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:06:54.755882 25549 consensus_queue.cc:260] T 62c6c134d3d24a1ab144dd9ee6bc3f64 P e61c3a8f61bb48f8a963c9480e53c168 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.13, Last appended by leader: 13, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:54.758276 25549 raft_consensus.cc:3060] T 62c6c134d3d24a1ab144dd9ee6bc3f64 P e61c3a8f61bb48f8a963c9480e53c168 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:06:54.759299 19559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab43d85f64114d4ebf618930e43d9ed0" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 18 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:06:54.760576 19559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48824d5acfbc485ebf8c2d944e7202de" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:06:54.761548 25537 raft_consensus.cc:515] T 22196caba61445d3bec98a0aab3c337d P 0473d2b2d01f4459b1e90fd12cc7840e [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:54.761842 19559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2725d2c4cb054f18b0fc8f735c15f6c2" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 20 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:06:54.762634 19483 raft_consensus.cc:1240] T 62c6c134d3d24a1ab144dd9ee6bc3f64 P 0473d2b2d01f4459b1e90fd12cc7840e [term 16 FOLLOWER]: Rejecting Update request from peer e61c3a8f61bb48f8a963c9480e53c168 for earlier term 15. Current term is 16. Ops: []
I20260709 13:06:54.763259 19559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef32ce6fdd0e40d382c79974f30295c6" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:06:54.763542 25521 leader_election.cc:290] T ef32ce6fdd0e40d382c79974f30295c6 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:06:54.763588 19483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e381f1d6b8184797ad142de49be225a8" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:06:54.763932 19559 raft_consensus.cc:2393] T ef32ce6fdd0e40d382c79974f30295c6 P e61c3a8f61bb48f8a963c9480e53c168 [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate e5256d91808b47c195bc9b4dbd7f2b87 in current term 21: Already voted for candidate e61c3a8f61bb48f8a963c9480e53c168 in this term.
I20260709 13:06:54.764514 19483 raft_consensus.cc:2393] T e381f1d6b8184797ad142de49be225a8 P 0473d2b2d01f4459b1e90fd12cc7840e [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e61c3a8f61bb48f8a963c9480e53c168 in current term 15: Already voted for candidate 0473d2b2d01f4459b1e90fd12cc7840e in this term.
I20260709 13:06:54.765097 19559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46c5bfeecc314717bffe987e6844b6d0" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 24 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:06:54.765566 19556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e1085d23e8347fbbd5bce7542f4b1f4" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:06:54.766376 19559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14935b3ddf914369822e4a0547aaa355" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:06:54.766773 19556 raft_consensus.cc:1240] T 2b74109013a140ada21feeef92d6f563 P e61c3a8f61bb48f8a963c9480e53c168 [term 15 FOLLOWER]: Rejecting Update request from peer e5256d91808b47c195bc9b4dbd7f2b87 for earlier term 14. Current term is 15. Ops: []
I20260709 13:06:54.767607 19558 raft_consensus.cc:2468] T f93ee515a9c14139bf566522ed8232f3 P e61c3a8f61bb48f8a963c9480e53c168 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 20.
I20260709 13:06:54.768047 19556 raft_consensus.cc:1275] T 21e14947d70440f19044d8f75c31e1f9 P e61c3a8f61bb48f8a963c9480e53c168 [term 17 FOLLOWER]: Refusing update from remote peer e5256d91808b47c195bc9b4dbd7f2b87: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 13:06:54.765120 19481 raft_consensus.cc:1240] T 22196caba61445d3bec98a0aab3c337d P 0473d2b2d01f4459b1e90fd12cc7840e [term 17 FOLLOWER]: Rejecting Update request from peer e5256d91808b47c195bc9b4dbd7f2b87 for earlier term 16. Current term is 17. Ops: []
I20260709 13:06:54.769414 19558 raft_consensus.cc:1240] T 4509b76741dc428e9201c70c1658da13 P e61c3a8f61bb48f8a963c9480e53c168 [term 11 FOLLOWER]: Rejecting Update request from peer e5256d91808b47c195bc9b4dbd7f2b87 for earlier term 10. Current term is 11. Ops: []
W20260709 13:06:54.755863 19374 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:54.761822 19552 raft_consensus.cc:2468] T ff75a1d4cb1f493db8f71ddc136ba9ab P e61c3a8f61bb48f8a963c9480e53c168 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 18.
I20260709 13:06:54.771253 19552 raft_consensus.cc:1240] T ff75a1d4cb1f493db8f71ddc136ba9ab P e61c3a8f61bb48f8a963c9480e53c168 [term 18 FOLLOWER]: Rejecting Update request from peer e5256d91808b47c195bc9b4dbd7f2b87 for earlier term 17. Current term is 18. Ops: []
I20260709 13:06:54.776723 19482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14935b3ddf914369822e4a0547aaa355" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:06:54.778366 19482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab43d85f64114d4ebf618930e43d9ed0" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:06:54.781368 19551 raft_consensus.cc:2468] T 14935b3ddf914369822e4a0547aaa355 P e61c3a8f61bb48f8a963c9480e53c168 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 127766fc592545a4997f7790f50f6076 in term 12.
I20260709 13:06:54.783277 19482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21e14947d70440f19044d8f75c31e1f9" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 18 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:06:54.784029 19558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa731b585f684a7fb2d106c50f143b83" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:06:54.784744 19486 raft_consensus.cc:2468] T d1e5873a19244c5ebbcd38e126796ee7 P 0473d2b2d01f4459b1e90fd12cc7840e [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 20.
I20260709 13:06:54.789361 19486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef32ce6fdd0e40d382c79974f30295c6" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 22 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:06:54.790445 19486 raft_consensus.cc:2410] T ef32ce6fdd0e40d382c79974f30295c6 P 0473d2b2d01f4459b1e90fd12cc7840e [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e61c3a8f61bb48f8a963c9480e53c168 for term 22 because replica has last-logged OpId of term: 20 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 18 index: 10.
I20260709 13:06:54.784941 19377 leader_election.cc:304] T ef32ce6fdd0e40d382c79974f30295c6 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87; no voters: 
I20260709 13:06:54.754470 19479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "179fd671030940b4b4a4e24bcc4aba0a" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:06:54.798430 19482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f575b143b844aa096b50997dad3516a" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:06:54.788560 19551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65d8cb8d6ec64f459d5a47cefab10acf" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:06:54.804059 19377 leader_election.cc:304] T 14935b3ddf914369822e4a0547aaa355 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, 127766fc592545a4997f7790f50f6076
I20260709 13:06:54.820550 25305 raft_consensus.cc:2749] T 14935b3ddf914369822e4a0547aaa355 P e5256d91808b47c195bc9b4dbd7f2b87 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:06:54.820779 19377 leader_election.cc:304] T 1a61655d99124a29b486ba4a5b37faea P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87; no voters: 
I20260709 13:06:54.821911 25305 raft_consensus.cc:2804] T 1a61655d99124a29b486ba4a5b37faea P e5256d91808b47c195bc9b4dbd7f2b87 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:06:54.806437 19482 raft_consensus.cc:1240] T 5ec1c4ce15e04c7e8c283a62179f2a64 P 0473d2b2d01f4459b1e90fd12cc7840e [term 12 FOLLOWER]: Rejecting Update request from peer e5256d91808b47c195bc9b4dbd7f2b87 for earlier term 11. Current term is 12. Ops: []
I20260709 13:06:54.823706 19526 leader_election.cc:304] T ab43d85f64114d4ebf618930e43d9ed0 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e61c3a8f61bb48f8a963c9480e53c168; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, 127766fc592545a4997f7790f50f6076
I20260709 13:06:54.807757 19486 raft_consensus.cc:1240] T ff75a1d4cb1f493db8f71ddc136ba9ab P 0473d2b2d01f4459b1e90fd12cc7840e [term 18 FOLLOWER]: Rejecting Update request from peer e5256d91808b47c195bc9b4dbd7f2b87 for earlier term 17. Current term is 18. Ops: []
I20260709 13:06:54.829056 19486 raft_consensus.cc:1240] T 0e1085d23e8347fbbd5bce7542f4b1f4 P 0473d2b2d01f4459b1e90fd12cc7840e [term 13 FOLLOWER]: Rejecting Update request from peer 127766fc592545a4997f7790f50f6076 for earlier term 12. Current term is 13. Ops: []
W20260709 13:06:54.829424 20075 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.1:40321, user_credentials={real_user=slave}} blocked reactor thread for 351775us
I20260709 13:06:54.798519 19411 raft_consensus.cc:2468] T f93ee515a9c14139bf566522ed8232f3 P e5256d91808b47c195bc9b4dbd7f2b87 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 20.
I20260709 13:06:54.814468 19479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b08304a0a02b42d7840c4e8ee9a6bd1a" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:06:54.831101 19479 raft_consensus.cc:2468] T b08304a0a02b42d7840c4e8ee9a6bd1a P 0473d2b2d01f4459b1e90fd12cc7840e [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 17.
I20260709 13:06:54.836829 19483 raft_consensus.cc:1240] T d1e5873a19244c5ebbcd38e126796ee7 P 0473d2b2d01f4459b1e90fd12cc7840e [term 20 FOLLOWER]: Rejecting Update request from peer e61c3a8f61bb48f8a963c9480e53c168 for earlier term 19. Current term is 20. Ops: [19.10-19.10]
I20260709 13:06:54.838280 19552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e5873a19244c5ebbcd38e126796ee7" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 20 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:06:54.833455 19556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a61655d99124a29b486ba4a5b37faea" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:06:54.834132 19377 leader_election.cc:304] T d1e5873a19244c5ebbcd38e126796ee7 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87; no voters: 
I20260709 13:06:54.843482 19559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b08304a0a02b42d7840c4e8ee9a6bd1a" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:06:54.844267 19559 raft_consensus.cc:2468] T b08304a0a02b42d7840c4e8ee9a6bd1a P e61c3a8f61bb48f8a963c9480e53c168 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 17.
W20260709 13:06:54.847486 19523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.1:40321, user_credentials={real_user=slave}} blocked reactor thread for 299042us
W20260709 13:06:54.850777 19523 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.17.223.1:40321 timed out after 1.800s (SENT) [suppressed 9 similar messages]
I20260709 13:06:54.855146 19552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e36a9d6e29c4a7c860cf267efbd4c74" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:06:54.822432 25305 raft_consensus.cc:493] T 1a61655d99124a29b486ba4a5b37faea P e5256d91808b47c195bc9b4dbd7f2b87 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:54.802167 25496 raft_consensus.cc:2804] T ef32ce6fdd0e40d382c79974f30295c6 P e5256d91808b47c195bc9b4dbd7f2b87 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:06:54.866374 20112 raft_consensus.cc:2468] T 0e1085d23e8347fbbd5bce7542f4b1f4 P 127766fc592545a4997f7790f50f6076 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 13.
I20260709 13:06:54.840865 25261 raft_consensus.cc:2749] T 2b74109013a140ada21feeef92d6f563 P 0473d2b2d01f4459b1e90fd12cc7840e [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:06:54.876952 19526 leader_election.cc:304] T b08304a0a02b42d7840c4e8ee9a6bd1a P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:06:54.825224 25093 raft_consensus.cc:493] T df751f992649444090e27965eb1af85d P e5256d91808b47c195bc9b4dbd7f2b87 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader e61c3a8f61bb48f8a963c9480e53c168)
I20260709 13:06:54.882231 25086 consensus_queue.cc:1059] T 40e1e16737a842ee936002830f36882e P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 }, Status: INVALID_TERM, Last received: 17.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:06:54.883695 25086 consensus_queue.cc:1059] T d1e5873a19244c5ebbcd38e126796ee7 P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 }, Status: INVALID_TERM, Last received: 17.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:06:54.883941 19523 leader_election.cc:304] T 76cb037fc9064d13b59a8969d897ce8c P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e61c3a8f61bb48f8a963c9480e53c168; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:06:54.882875 25337 raft_consensus.cc:2804] T b08304a0a02b42d7840c4e8ee9a6bd1a P e61c3a8f61bb48f8a963c9480e53c168 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:06:54.885186 25337 raft_consensus.cc:493] T b08304a0a02b42d7840c4e8ee9a6bd1a P e61c3a8f61bb48f8a963c9480e53c168 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:54.878857 19449 leader_election.cc:304] T f93ee515a9c14139bf566522ed8232f3 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87; no voters: 
I20260709 13:06:54.885869 25337 raft_consensus.cc:3060] T b08304a0a02b42d7840c4e8ee9a6bd1a P e61c3a8f61bb48f8a963c9480e53c168 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:06:54.886250 25237 raft_consensus.cc:2804] T f93ee515a9c14139bf566522ed8232f3 P 0473d2b2d01f4459b1e90fd12cc7840e [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:06:54.886811 25237 raft_consensus.cc:697] T f93ee515a9c14139bf566522ed8232f3 P 0473d2b2d01f4459b1e90fd12cc7840e [term 20 LEADER]: Becoming Leader. State: Replica: 0473d2b2d01f4459b1e90fd12cc7840e, State: Running, Role: LEADER
I20260709 13:06:54.887723 25237 consensus_queue.cc:237] T f93ee515a9c14139bf566522ed8232f3 P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 18.9, Last appended by leader: 9, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:54.854641 25403 raft_consensus.cc:2804] T d1e5873a19244c5ebbcd38e126796ee7 P e5256d91808b47c195bc9b4dbd7f2b87 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:06:54.896420 19485 raft_consensus.cc:1240] T 2b74109013a140ada21feeef92d6f563 P 0473d2b2d01f4459b1e90fd12cc7840e [term 15 FOLLOWER]: Rejecting Update request from peer e5256d91808b47c195bc9b4dbd7f2b87 for earlier term 14. Current term is 15. Ops: []
I20260709 13:06:54.800716 25340 raft_consensus.cc:515] T 48824d5acfbc485ebf8c2d944e7202de P 0473d2b2d01f4459b1e90fd12cc7840e [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:54.840999 25392 consensus_queue.cc:1059] T e381f1d6b8184797ad142de49be225a8 P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 }, Status: INVALID_TERM, Last received: 14.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.048s
I20260709 13:06:54.871927 25305 raft_consensus.cc:3060] T 1a61655d99124a29b486ba4a5b37faea P e5256d91808b47c195bc9b4dbd7f2b87 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:06:54.872040 25521 raft_consensus.cc:2749] T ab43d85f64114d4ebf618930e43d9ed0 P e61c3a8f61bb48f8a963c9480e53c168 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:06:54.907724 19478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76cb037fc9064d13b59a8969d897ce8c" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:06:54.891422 25548 raft_consensus.cc:493] T 309c3ca0ca4b4f3ba129752ea2cb293b P e61c3a8f61bb48f8a963c9480e53c168 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:54.900925 25456 raft_consensus.cc:3055] T d1e5873a19244c5ebbcd38e126796ee7 P e61c3a8f61bb48f8a963c9480e53c168 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:06:54.875382 25404 consensus_queue.cc:1059] T ff75a1d4cb1f493db8f71ddc136ba9ab P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 }, Status: INVALID_TERM, Last received: 17.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.043s
I20260709 13:06:55.016407 19411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22196caba61445d3bec98a0aab3c337d" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
I20260709 13:06:54.909932 25457 raft_consensus.cc:2749] T 76cb037fc9064d13b59a8969d897ce8c P e61c3a8f61bb48f8a963c9480e53c168 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:06:55.023329 25496 raft_consensus.cc:697] T ef32ce6fdd0e40d382c79974f30295c6 P e5256d91808b47c195bc9b4dbd7f2b87 [term 21 LEADER]: Becoming Leader. State: Replica: e5256d91808b47c195bc9b4dbd7f2b87, State: Running, Role: LEADER
I20260709 13:06:55.024400 25496 consensus_queue.cc:237] T ef32ce6fdd0e40d382c79974f30295c6 P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 20.11, Last appended by leader: 11, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:55.035346 25403 raft_consensus.cc:697] T d1e5873a19244c5ebbcd38e126796ee7 P e5256d91808b47c195bc9b4dbd7f2b87 [term 20 LEADER]: Becoming Leader. State: Replica: e5256d91808b47c195bc9b4dbd7f2b87, State: Running, Role: LEADER
I20260709 13:06:55.036650 25403 consensus_queue.cc:237] T d1e5873a19244c5ebbcd38e126796ee7 P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 17.9, Last appended by leader: 9, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:54.891283 25093 raft_consensus.cc:515] T df751f992649444090e27965eb1af85d P e5256d91808b47c195bc9b4dbd7f2b87 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
W20260709 13:06:55.060873 19526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.2:46257, user_credentials={real_user=slave}} blocked reactor thread for 178437us
I20260709 13:06:54.914638 25370 raft_consensus.cc:697] T 5ec1c4ce15e04c7e8c283a62179f2a64 P 127766fc592545a4997f7790f50f6076 [term 12 LEADER]: Becoming Leader. State: Replica: 127766fc592545a4997f7790f50f6076, State: Running, Role: LEADER
I20260709 13:06:54.895895 25553 consensus_queue.cc:1059] T b9f0d59553ad444883fcf5b5909f9798 P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 }, Status: INVALID_TERM, Last received: 14.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.123s
W20260709 13:06:55.067134 19523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.1:40321, user_credentials={real_user=slave}} blocked reactor thread for 183290us
I20260709 13:06:55.082419 19523 leader_election.cc:304] T 2b74109013a140ada21feeef92d6f563 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e61c3a8f61bb48f8a963c9480e53c168; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:06:55.067394 20103 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ff9b0eddd810459b82d91c60777c10eb"
dest_uuid: "127766fc592545a4997f7790f50f6076"
mode: GRACEFUL
new_leader_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
 from {username='slave'} at 127.0.0.1:48686
W20260709 13:06:55.060599 19375 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.3:36891, user_credentials={real_user=slave}} blocked reactor thread for 185052us
I20260709 13:06:54.939286 25456 raft_consensus.cc:740] T d1e5873a19244c5ebbcd38e126796ee7 P e61c3a8f61bb48f8a963c9480e53c168 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: e61c3a8f61bb48f8a963c9480e53c168, State: Running, Role: LEADER
I20260709 13:06:55.084849 19375 leader_election.cc:304] T 0cdf56e38bbc453d9438d359e5a69955 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168; no voters: 0473d2b2d01f4459b1e90fd12cc7840e
I20260709 13:06:55.129341 25370 consensus_queue.cc:237] T 5ec1c4ce15e04c7e8c283a62179f2a64 P 127766fc592545a4997f7790f50f6076 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:55.075481 25537 leader_election.cc:290] T 22196caba61445d3bec98a0aab3c337d P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 17 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
W20260709 13:06:55.081712 25534 log.cc:927] Time spent T 6c5eebf646ad445a9d1b1adc319d7b16 P e61c3a8f61bb48f8a963c9480e53c168: Append to log took a long time: real 0.141s	user 0.000s	sys 0.000s
I20260709 13:06:55.042977 25097 consensus_queue.cc:1059] T 0cdf56e38bbc453d9438d359e5a69955 P 0473d2b2d01f4459b1e90fd12cc7840e [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 }, Status: INVALID_TERM, Last received: 16.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.070s
I20260709 13:06:55.134764 25392 raft_consensus.cc:493] T 1dc5b3532fe54f74876d02beffa2c230 P e5256d91808b47c195bc9b4dbd7f2b87 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:55.135268 25392 raft_consensus.cc:515] T 1dc5b3532fe54f74876d02beffa2c230 P e5256d91808b47c195bc9b4dbd7f2b87 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
W20260709 13:06:55.155560 19375 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.3:36891, user_credentials={real_user=slave}} blocked reactor thread for 70802.2us
W20260709 13:06:55.156973 19523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.1:40321, user_credentials={real_user=slave}} blocked reactor thread for 74675.3us
I20260709 13:06:55.157961 19523 leader_election.cc:304] T 4509b76741dc428e9201c70c1658da13 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e61c3a8f61bb48f8a963c9480e53c168; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:06:55.043627 25138 leader_election.cc:290] T 217b5fae677b4971b3bbd2f357a1f7ff P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 13 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:06:55.156559 19478 raft_consensus.cc:2468] T 76cb037fc9064d13b59a8969d897ce8c P 0473d2b2d01f4459b1e90fd12cc7840e [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 16.
I20260709 13:06:55.163420 19375 leader_election.cc:304] T b9f0d59553ad444883fcf5b5909f9798 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:06:55.086035 25261 raft_consensus.cc:493] T 3e1f505cb0f1427bbd698ac889d80821 P 0473d2b2d01f4459b1e90fd12cc7840e [term 19 FOLLOWER]: Starting pre-election (detected failure of leader e61c3a8f61bb48f8a963c9480e53c168)
I20260709 13:06:55.166236 19523 leader_election.cc:304] T ff75a1d4cb1f493db8f71ddc136ba9ab P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e61c3a8f61bb48f8a963c9480e53c168; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87
W20260709 13:06:55.151338 25547 log.cc:927] Time spent T 28af091831594f9d8e96482078cc7625 P e5256d91808b47c195bc9b4dbd7f2b87: Append to log took a long time: real 0.071s	user 0.001s	sys 0.000s
I20260709 13:06:55.018317 25548 raft_consensus.cc:515] T 309c3ca0ca4b4f3ba129752ea2cb293b P e61c3a8f61bb48f8a963c9480e53c168 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } attrs { replace: true } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:55.179566 19523 leader_election.cc:304] T 1dc5b3532fe54f74876d02beffa2c230 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e61c3a8f61bb48f8a963c9480e53c168; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:06:55.166144 19478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "217b5fae677b4971b3bbd2f357a1f7ff" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:06:55.172914 25586 raft_consensus.cc:3055] T e381f1d6b8184797ad142de49be225a8 P e5256d91808b47c195bc9b4dbd7f2b87 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:06:55.188220 19523 leader_election.cc:304] T f93ee515a9c14139bf566522ed8232f3 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168; no voters: 0473d2b2d01f4459b1e90fd12cc7840e
I20260709 13:06:55.167883 25490 raft_consensus.cc:493] T 7f575b143b844aa096b50997dad3516a P 0473d2b2d01f4459b1e90fd12cc7840e [term 14 FOLLOWER]: Starting pre-election (detected failure of leader e5256d91808b47c195bc9b4dbd7f2b87)
I20260709 13:06:55.186834 25553 raft_consensus.cc:493] T 65d8cb8d6ec64f459d5a47cefab10acf P e61c3a8f61bb48f8a963c9480e53c168 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 127766fc592545a4997f7790f50f6076)
I20260709 13:06:55.164968 25549 raft_consensus.cc:2749] T 2b74109013a140ada21feeef92d6f563 P e61c3a8f61bb48f8a963c9480e53c168 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:06:55.184247 25448 raft_consensus.cc:493] T 40e1e16737a842ee936002830f36882e P 0473d2b2d01f4459b1e90fd12cc7840e [term 18 FOLLOWER]: Starting pre-election (detected failure of leader e61c3a8f61bb48f8a963c9480e53c168)
I20260709 13:06:55.190022 25138 raft_consensus.cc:2749] T 4509b76741dc428e9201c70c1658da13 P e61c3a8f61bb48f8a963c9480e53c168 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:06:55.184062 25261 raft_consensus.cc:515] T 3e1f505cb0f1427bbd698ac889d80821 P 0473d2b2d01f4459b1e90fd12cc7840e [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:55.243350 25490 raft_consensus.cc:515] T 7f575b143b844aa096b50997dad3516a P 0473d2b2d01f4459b1e90fd12cc7840e [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:55.287968 25404 raft_consensus.cc:493] T 70797e5783b5454ab0d0eea663e791e3 P e5256d91808b47c195bc9b4dbd7f2b87 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:55.288491 25392 leader_election.cc:290] T 1dc5b3532fe54f74876d02beffa2c230 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:06:55.289122 25392 raft_consensus.cc:2749] T b9f0d59553ad444883fcf5b5909f9798 P e5256d91808b47c195bc9b4dbd7f2b87 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:06:55.288787 25404 raft_consensus.cc:515] T 70797e5783b5454ab0d0eea663e791e3 P e5256d91808b47c195bc9b4dbd7f2b87 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:55.289592 25490 leader_election.cc:290] T 7f575b143b844aa096b50997dad3516a P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:06:55.241317 25549 raft_consensus.cc:3060] T 1dc5b3532fe54f74876d02beffa2c230 P e61c3a8f61bb48f8a963c9480e53c168 [term 17 FOLLOWER]: Advancing to term 18
W20260709 13:06:55.289588 19375 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.3:36891, user_credentials={real_user=slave}} blocked reactor thread for 126236us
I20260709 13:06:55.291904 19375 leader_election.cc:400] T edd7d470b5014c9489be7f41f64355c9 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 19 election: Vote denied by peer e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891) with higher term. Message: Invalid argument: T edd7d470b5014c9489be7f41f64355c9 P e61c3a8f61bb48f8a963c9480e53c168 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate e5256d91808b47c195bc9b4dbd7f2b87 for earlier term 19. Current term is 20.
I20260709 13:06:55.292101 25404 leader_election.cc:290] T 70797e5783b5454ab0d0eea663e791e3 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:06:55.218281 25586 raft_consensus.cc:740] T e381f1d6b8184797ad142de49be225a8 P e5256d91808b47c195bc9b4dbd7f2b87 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: e5256d91808b47c195bc9b4dbd7f2b87, State: Running, Role: LEADER
W20260709 13:06:55.287711 19523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.1:40321, user_credentials={real_user=slave}} blocked reactor thread for 99596.8us
I20260709 13:06:55.292243 19375 leader_election.cc:403] T edd7d470b5014c9489be7f41f64355c9 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 19 election: Cancelling election due to peer responding with higher term
I20260709 13:06:55.300609 19523 leader_election.cc:304] T 28af091831594f9d8e96482078cc7625 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e61c3a8f61bb48f8a963c9480e53c168; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:06:55.302852 19375 leader_election.cc:304] T 40e1e16737a842ee936002830f36882e P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:06:55.247079 25520 raft_consensus.cc:493] T 172b3dd13109415a955b71ac0e9d2234 P 0473d2b2d01f4459b1e90fd12cc7840e [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 127766fc592545a4997f7790f50f6076)
W20260709 13:06:55.307906 20078 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:55.309039 20107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48824d5acfbc485ebf8c2d944e7202de" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076"
I20260709 13:06:55.309725 20107 raft_consensus.cc:3060] T 48824d5acfbc485ebf8c2d944e7202de P 127766fc592545a4997f7790f50f6076 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:06:55.305194 19523 leader_election.cc:304] T ece3db938bc649d4a40a51522ed5259c P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e61c3a8f61bb48f8a963c9480e53c168; no voters: 127766fc592545a4997f7790f50f6076, e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:06:55.189399 25456 consensus_queue.cc:260] T d1e5873a19244c5ebbcd38e126796ee7 P e61c3a8f61bb48f8a963c9480e53c168 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 19.10, Last appended by leader: 10, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:55.222791 25337 raft_consensus.cc:515] T b08304a0a02b42d7840c4e8ee9a6bd1a P e61c3a8f61bb48f8a963c9480e53c168 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:55.305754 19375 leader_election.cc:304] T 2725d2c4cb054f18b0fc8f735c15f6c2 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:06:55.304742 25340 leader_election.cc:290] T 48824d5acfbc485ebf8c2d944e7202de P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 20 election: Requested vote from peers e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:06:55.318195 25588 raft_consensus.cc:2804] T 0cdf56e38bbc453d9438d359e5a69955 P e5256d91808b47c195bc9b4dbd7f2b87 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:06:55.327849 25588 raft_consensus.cc:697] T 0cdf56e38bbc453d9438d359e5a69955 P e5256d91808b47c195bc9b4dbd7f2b87 [term 17 LEADER]: Becoming Leader. State: Replica: e5256d91808b47c195bc9b4dbd7f2b87, State: Running, Role: LEADER
I20260709 13:06:55.327103 25456 raft_consensus.cc:3060] T d1e5873a19244c5ebbcd38e126796ee7 P e61c3a8f61bb48f8a963c9480e53c168 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:06:55.329483 19480 raft_consensus.cc:1240] T b9f0d59553ad444883fcf5b5909f9798 P 0473d2b2d01f4459b1e90fd12cc7840e [term 15 LEADER]: Rejecting Update request from peer e61c3a8f61bb48f8a963c9480e53c168 for earlier term 14. Current term is 15. Ops: []
I20260709 13:06:55.250063 25448 raft_consensus.cc:515] T 40e1e16737a842ee936002830f36882e P 0473d2b2d01f4459b1e90fd12cc7840e [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:55.248327 25553 raft_consensus.cc:515] T 65d8cb8d6ec64f459d5a47cefab10acf P e61c3a8f61bb48f8a963c9480e53c168 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:55.304908 25138 raft_consensus.cc:2764] T f93ee515a9c14139bf566522ed8232f3 P e61c3a8f61bb48f8a963c9480e53c168 [term 20 FOLLOWER]: Leader pre-election decision vote started in defunct term 19: won
I20260709 13:06:55.321189 19375 leader_election.cc:304] T 46c5bfeecc314717bffe987e6844b6d0 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168
W20260709 13:06:55.316578 25567 log.cc:927] Time spent T ff9b0eddd810459b82d91c60777c10eb P 0473d2b2d01f4459b1e90fd12cc7840e: Append to log took a long time: real 0.150s	user 0.001s	sys 0.000s
I20260709 13:06:55.319698 19523 leader_election.cc:304] T 179fd671030940b4b4a4e24bcc4aba0a P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e61c3a8f61bb48f8a963c9480e53c168; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87
W20260709 13:06:55.316182 25555 log.cc:927] Time spent T df751f992649444090e27965eb1af85d P e5256d91808b47c195bc9b4dbd7f2b87: Append to log took a long time: real 0.269s	user 0.001s	sys 0.000s
I20260709 13:06:55.362025 20107 raft_consensus.cc:2468] T 48824d5acfbc485ebf8c2d944e7202de P 127766fc592545a4997f7790f50f6076 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 20.
W20260709 13:06:55.334033 25557 log.cc:927] Time spent T 1a61655d99124a29b486ba4a5b37faea P e61c3a8f61bb48f8a963c9480e53c168: Append to log took a long time: real 0.278s	user 0.001s	sys 0.000s
W20260709 13:06:55.367144 25563 log.cc:927] Time spent T ab43d85f64114d4ebf618930e43d9ed0 P e61c3a8f61bb48f8a963c9480e53c168: Append to log took a long time: real 0.208s	user 0.000s	sys 0.001s
I20260709 13:06:55.316726 25591 raft_consensus.cc:493] T 2a16f7501e2444fb86d4e2778e734e02 P e5256d91808b47c195bc9b4dbd7f2b87 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 127766fc592545a4997f7790f50f6076)
W20260709 13:06:55.326982 25558 log.cc:927] Time spent T edd7d470b5014c9489be7f41f64355c9 P 0473d2b2d01f4459b1e90fd12cc7840e: Append to log took a long time: real 0.107s	user 0.001s	sys 0.000s
I20260709 13:06:55.318435 25392 raft_consensus.cc:2749] T edd7d470b5014c9489be7f41f64355c9 P e5256d91808b47c195bc9b4dbd7f2b87 [term 20 FOLLOWER]: Leader election lost for term 19. Reason: Vote denied by peer e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891) with higher term. Message: Invalid argument: T edd7d470b5014c9489be7f41f64355c9 P e61c3a8f61bb48f8a963c9480e53c168 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate e5256d91808b47c195bc9b4dbd7f2b87 for earlier term 19. Current term is 20.
I20260709 13:06:55.366750 19449 leader_election.cc:304] T 48824d5acfbc485ebf8c2d944e7202de P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, 127766fc592545a4997f7790f50f6076; no voters: 
I20260709 13:06:55.321856 25528 raft_consensus.cc:2749] T ff75a1d4cb1f493db8f71ddc136ba9ab P e61c3a8f61bb48f8a963c9480e53c168 [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:06:55.318595 25052 raft_consensus.cc:2749] T 28af091831594f9d8e96482078cc7625 P e61c3a8f61bb48f8a963c9480e53c168 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:06:55.314160 25520 raft_consensus.cc:515] T 172b3dd13109415a955b71ac0e9d2234 P 0473d2b2d01f4459b1e90fd12cc7840e [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
W20260709 13:06:55.424826 25304 consensus_meta.cc:287] T b08304a0a02b42d7840c4e8ee9a6bd1a P e5256d91808b47c195bc9b4dbd7f2b87: Time spent flushing consensus metadata: real 0.676s	user 0.005s	sys 0.005s
I20260709 13:06:55.424926 25577 raft_consensus.cc:2749] T 46c5bfeecc314717bffe987e6844b6d0 P e5256d91808b47c195bc9b4dbd7f2b87 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:06:55.425499 25304 raft_consensus.cc:515] T b08304a0a02b42d7840c4e8ee9a6bd1a P e5256d91808b47c195bc9b4dbd7f2b87 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:55.425853 25577 consensus_queue.cc:1059] T 2b74109013a140ada21feeef92d6f563 P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 }, Status: INVALID_TERM, Last received: 14.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:06:55.426995 25590 raft_consensus.cc:3055] T 2b74109013a140ada21feeef92d6f563 P e5256d91808b47c195bc9b4dbd7f2b87 [term 14 LEADER]: Stepping down as leader of term 14
W20260709 13:06:55.427211 25461 consensus_meta.cc:287] T 217b5fae677b4971b3bbd2f357a1f7ff P 0473d2b2d01f4459b1e90fd12cc7840e: Time spent flushing consensus metadata: real 0.803s	user 0.008s	sys 0.002s
I20260709 13:06:55.427479 25590 raft_consensus.cc:740] T 2b74109013a140ada21feeef92d6f563 P e5256d91808b47c195bc9b4dbd7f2b87 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: e5256d91808b47c195bc9b4dbd7f2b87, State: Running, Role: LEADER
W20260709 13:06:55.428364 19524 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:55.372792 25097 raft_consensus.cc:2804] T 48824d5acfbc485ebf8c2d944e7202de P 0473d2b2d01f4459b1e90fd12cc7840e [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:06:55.371416 25593 raft_consensus.cc:3055] T 40e1e16737a842ee936002830f36882e P e61c3a8f61bb48f8a963c9480e53c168 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:06:55.392875 25392 raft_consensus.cc:2749] T 40e1e16737a842ee936002830f36882e P e5256d91808b47c195bc9b4dbd7f2b87 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
W20260709 13:06:55.407112 25581 log.cc:927] Time spent T 775c229504194560ba9589bc2199b089 P 0473d2b2d01f4459b1e90fd12cc7840e: Append to log took a long time: real 0.086s	user 0.000s	sys 0.001s
I20260709 13:06:55.424856 25553 leader_election.cc:290] T 65d8cb8d6ec64f459d5a47cefab10acf P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:06:55.373039 25138 raft_consensus.cc:2749] T 179fd671030940b4b4a4e24bcc4aba0a P e61c3a8f61bb48f8a963c9480e53c168 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:06:55.371353 25311 raft_consensus.cc:493] T 1dc5b3532fe54f74876d02beffa2c230 P 0473d2b2d01f4459b1e90fd12cc7840e [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:55.476926 25311 raft_consensus.cc:515] T 1dc5b3532fe54f74876d02beffa2c230 P 0473d2b2d01f4459b1e90fd12cc7840e [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:55.373075 25462 raft_consensus.cc:493] T 309c3ca0ca4b4f3ba129752ea2cb293b P 0473d2b2d01f4459b1e90fd12cc7840e [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 127766fc592545a4997f7790f50f6076)
W20260709 13:06:55.446298 25555 log.cc:927] Time spent T df751f992649444090e27965eb1af85d P e5256d91808b47c195bc9b4dbd7f2b87: Append to log took a long time: real 0.075s	user 0.000s	sys 0.000s
W20260709 13:06:55.470036 19523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.1:40321, user_credentials={real_user=slave}} blocked reactor thread for 150439us
I20260709 13:06:55.368192 25591 raft_consensus.cc:515] T 2a16f7501e2444fb86d4e2778e734e02 P e5256d91808b47c195bc9b4dbd7f2b87 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:55.373324 25579 raft_consensus.cc:2749] T ece3db938bc649d4a40a51522ed5259c P e61c3a8f61bb48f8a963c9480e53c168 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:06:55.488978 19402 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52328 (request call id 2461) took 1079 ms. Trace:
I20260709 13:06:55.451167 25583 raft_consensus.cc:2749] T 2725d2c4cb054f18b0fc8f735c15f6c2 P e5256d91808b47c195bc9b4dbd7f2b87 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:06:55.471499 25052 raft_consensus.cc:493] T 70797e5783b5454ab0d0eea663e791e3 P e61c3a8f61bb48f8a963c9480e53c168 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader e5256d91808b47c195bc9b4dbd7f2b87)
I20260709 13:06:55.472293 25097 raft_consensus.cc:697] T 48824d5acfbc485ebf8c2d944e7202de P 0473d2b2d01f4459b1e90fd12cc7840e [term 20 LEADER]: Becoming Leader. State: Replica: 0473d2b2d01f4459b1e90fd12cc7840e, State: Running, Role: LEADER
I20260709 13:06:55.466444 25590 consensus_queue.cc:260] T 2b74109013a140ada21feeef92d6f563 P e5256d91808b47c195bc9b4dbd7f2b87 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:55.374727 25305 raft_consensus.cc:515] T 1a61655d99124a29b486ba4a5b37faea P e5256d91808b47c195bc9b4dbd7f2b87 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:55.483174 19523 leader_election.cc:304] T 21e14947d70440f19044d8f75c31e1f9 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e61c3a8f61bb48f8a963c9480e53c168; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87
W20260709 13:06:55.484900 19524 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:55.487931 25462 raft_consensus.cc:515] T 309c3ca0ca4b4f3ba129752ea2cb293b P 0473d2b2d01f4459b1e90fd12cc7840e [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:55.489517 19402 rpcz_store.cc:276] 0709 13:06:54.409382 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:54.410403 (+  1021us) service_pool.cc:224] Handling call
0709 13:06:54.410762 (+   359us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:06:54.423965 (+ 13203us) raft_consensus.cc:1534] Early marking committed up to index 11
0709 13:06:54.456979 (+ 33014us) log.cc:844] Serialized 14 byte log entry
0709 13:06:54.637063 (+180084us) spinlock_profiling.cc:243] Waited 2.15 ms on lock 0x7b1800365980. stack: 00007f4a79de9343 00007f4a79de9240 00007f4a797781d4 00007f4a834b6304 00007f4a834b6299 00007f4a82ce3de1 00007f4a82cf05b1 00007f4a79e1b3f3 00007f4a79e1d7c1 00007f4a79e1d779 00007f4a79e1d709 00007f4a79e1d6d1 00007f4a79e1c9cd 000000000038f354 000000000038f199 00007f4a79dfe83a
0709 13:06:54.810097 (+173034us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:06:54.810869 (+   772us) log.cc:844] Serialized 52 byte log entry
0709 13:06:54.811036 (+   167us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:06:54.811083 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:54.811177 (+    94us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:55.488692 (+677515us) raft_consensus.cc:1685] finished
0709 13:06:55.488790 (+    98us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:55.488923 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":36101,"prepare.queue_time_us":22610,"prepare.run_cpu_time_us":37,"prepare.run_wall_time_us":37,"raft.queue_time_us":6638,"raft.run_cpu_time_us":267,"raft.run_wall_time_us":28619,"spinlock_wait_cycles":4935424,"thread_start_us":327650,"threads_started":1,"wal-append.queue_time_us":440589}
I20260709 13:06:55.504928 25579 raft_consensus.cc:2749] T 21e14947d70440f19044d8f75c31e1f9 P e61c3a8f61bb48f8a963c9480e53c168 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:06:55.469527 25593 raft_consensus.cc:740] T 40e1e16737a842ee936002830f36882e P e61c3a8f61bb48f8a963c9480e53c168 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: e61c3a8f61bb48f8a963c9480e53c168, State: Running, Role: LEADER
I20260709 13:06:55.478615 25396 leader_election.cc:290] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 19 election: Requested vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:06:55.396528 25588 consensus_queue.cc:237] T 0cdf56e38bbc453d9438d359e5a69955 P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:55.496549 25591 leader_election.cc:290] T 2a16f7501e2444fb86d4e2778e734e02 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:06:55.498310 25305 leader_election.cc:290] T 1a61655d99124a29b486ba4a5b37faea P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 16 election: Requested vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
W20260709 13:06:55.499179 25582 log.cc:927] Time spent T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P 0473d2b2d01f4459b1e90fd12cc7840e: Append to log took a long time: real 0.131s	user 0.000s	sys 0.000s
I20260709 13:06:55.499735 25457 raft_consensus.cc:3055] T b9f0d59553ad444883fcf5b5909f9798 P e61c3a8f61bb48f8a963c9480e53c168 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:06:55.495296 25052 raft_consensus.cc:515] T 70797e5783b5454ab0d0eea663e791e3 P e61c3a8f61bb48f8a963c9480e53c168 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:55.447161 25461 raft_consensus.cc:515] T 217b5fae677b4971b3bbd2f357a1f7ff P 0473d2b2d01f4459b1e90fd12cc7840e [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
W20260709 13:06:55.514396 20075 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.1:40321, user_credentials={real_user=slave}} blocked reactor thread for 684127us
W20260709 13:06:55.506847 19375 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.3:36891, user_credentials={real_user=slave}} blocked reactor thread for 148340us
I20260709 13:06:55.506744 19523 leader_election.cc:304] T e381f1d6b8184797ad142de49be225a8 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e61c3a8f61bb48f8a963c9480e53c168; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:06:55.507205 25593 consensus_queue.cc:260] T 40e1e16737a842ee936002830f36882e P e61c3a8f61bb48f8a963c9480e53c168 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 18.10, Last appended by leader: 10, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:55.505896 25462 leader_election.cc:290] T 309c3ca0ca4b4f3ba129752ea2cb293b P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
W20260709 13:06:55.513471 20077 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:55.519156 19523 leader_election.cc:304] T 4af19371ea874c09a0a2147040835cbb P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e61c3a8f61bb48f8a963c9480e53c168; no voters: 127766fc592545a4997f7790f50f6076, e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:06:55.519090 25396 consensus_queue.cc:1059] T 4509b76741dc428e9201c70c1658da13 P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:06:55.520120 25591 consensus_queue.cc:1059] T ff75a1d4cb1f493db8f71ddc136ba9ab P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 }, Status: INVALID_TERM, Last received: 17.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:06:55.534348 25591 raft_consensus.cc:3055] T 4509b76741dc428e9201c70c1658da13 P e5256d91808b47c195bc9b4dbd7f2b87 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:06:55.534843 25591 raft_consensus.cc:740] T 4509b76741dc428e9201c70c1658da13 P e5256d91808b47c195bc9b4dbd7f2b87 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: e5256d91808b47c195bc9b4dbd7f2b87, State: Running, Role: LEADER
I20260709 13:06:55.536113 25591 consensus_queue.cc:260] T 4509b76741dc428e9201c70c1658da13 P e5256d91808b47c195bc9b4dbd7f2b87 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:55.537200 25052 leader_election.cc:290] T 70797e5783b5454ab0d0eea663e791e3 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
W20260709 13:06:55.538162 25572 log.cc:927] Time spent T 3e1f505cb0f1427bbd698ac889d80821 P e5256d91808b47c195bc9b4dbd7f2b87: Append to log took a long time: real 0.145s	user 0.000s	sys 0.000s
I20260709 13:06:55.515766 25535 raft_consensus.cc:697] T ed7fdbcb96d14d418db9ca90a792588a P 127766fc592545a4997f7790f50f6076 [term 15 LEADER]: Becoming Leader. State: Replica: 127766fc592545a4997f7790f50f6076, State: Running, Role: LEADER
I20260709 13:06:55.520186 25532 consensus_queue.cc:1048] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P 127766fc592545a4997f7790f50f6076 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 13:06:55.513233 25457 raft_consensus.cc:740] T b9f0d59553ad444883fcf5b5909f9798 P e61c3a8f61bb48f8a963c9480e53c168 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: e61c3a8f61bb48f8a963c9480e53c168, State: Running, Role: LEADER
I20260709 13:06:55.521379 25599 raft_consensus.cc:3060] T e381f1d6b8184797ad142de49be225a8 P e61c3a8f61bb48f8a963c9480e53c168 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:06:55.521981 19554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76cb037fc9064d13b59a8969d897ce8c" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:06:55.549335 19554 raft_consensus.cc:2393] T 76cb037fc9064d13b59a8969d897ce8c P e61c3a8f61bb48f8a963c9480e53c168 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate e5256d91808b47c195bc9b4dbd7f2b87 in current term 16: Already voted for candidate e61c3a8f61bb48f8a963c9480e53c168 in this term.
W20260709 13:06:55.550825 25559 log.cc:927] Time spent T 2a16f7501e2444fb86d4e2778e734e02 P e61c3a8f61bb48f8a963c9480e53c168: Append to log took a long time: real 0.057s	user 0.001s	sys 0.000s
I20260709 13:06:55.522754 19485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b08304a0a02b42d7840c4e8ee9a6bd1a" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:06:55.552763 19485 raft_consensus.cc:3060] T b08304a0a02b42d7840c4e8ee9a6bd1a P 0473d2b2d01f4459b1e90fd12cc7840e [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:06:55.554352 25448 leader_election.cc:290] T 40e1e16737a842ee936002830f36882e P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:06:55.525328 19557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dc5b3532fe54f74876d02beffa2c230" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
W20260709 13:06:55.526559 19375 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:55.526921 19560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70797e5783b5454ab0d0eea663e791e3" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
W20260709 13:06:55.560441 19375 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:55.560667 19560 raft_consensus.cc:2468] T 70797e5783b5454ab0d0eea663e791e3 P e61c3a8f61bb48f8a963c9480e53c168 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 18.
I20260709 13:06:55.530557 19552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a61655d99124a29b486ba4a5b37faea" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:06:55.532706 19559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a16f7501e2444fb86d4e2778e734e02" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:06:55.540335 19478 raft_consensus.cc:2368] T 217b5fae677b4971b3bbd2f357a1f7ff P 0473d2b2d01f4459b1e90fd12cc7840e [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate e61c3a8f61bb48f8a963c9480e53c168 for earlier term 13. Current term is 14.
I20260709 13:06:55.540905 19523 leader_election.cc:304] T 2a16f7501e2444fb86d4e2778e734e02 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e61c3a8f61bb48f8a963c9480e53c168; no voters: 127766fc592545a4997f7790f50f6076, e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:06:55.542384 25462 raft_consensus.cc:493] T 1f85fc4b527a48848e5faa083b604e36 P 0473d2b2d01f4459b1e90fd12cc7840e [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:55.525147 25305 consensus_queue.cc:1048] T 21e14947d70440f19044d8f75c31e1f9 P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.020s
I20260709 13:06:55.545241 25520 leader_election.cc:290] T 172b3dd13109415a955b71ac0e9d2234 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:06:55.542954 25593 raft_consensus.cc:3060] T 40e1e16737a842ee936002830f36882e P e61c3a8f61bb48f8a963c9480e53c168 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:06:55.545517 25052 raft_consensus.cc:2749] T 4af19371ea874c09a0a2147040835cbb P e61c3a8f61bb48f8a963c9480e53c168 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:06:55.546494 25457 consensus_queue.cc:260] T b9f0d59553ad444883fcf5b5909f9798 P e61c3a8f61bb48f8a963c9480e53c168 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
W20260709 13:06:55.524858 20076 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.3:36891, user_credentials={real_user=slave}} blocked reactor thread for 637441us
I20260709 13:06:55.557118 20107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "309c3ca0ca4b4f3ba129752ea2cb293b" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:06:55.538987 25591 raft_consensus.cc:3060] T 4509b76741dc428e9201c70c1658da13 P e5256d91808b47c195bc9b4dbd7f2b87 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:06:55.555752 25311 leader_election.cc:290] T 1dc5b3532fe54f74876d02beffa2c230 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
W20260709 13:06:55.555166 20077 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:55.563268 19523 leader_election.cc:304] T fa731b585f684a7fb2d106c50f143b83 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e61c3a8f61bb48f8a963c9480e53c168; no voters: 127766fc592545a4997f7790f50f6076, e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:06:55.604132 19559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22196caba61445d3bec98a0aab3c337d" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:06:55.604314 19523 leader_election.cc:304] T 7f575b143b844aa096b50997dad3516a P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e61c3a8f61bb48f8a963c9480e53c168; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:06:55.514801 25261 leader_election.cc:290] T 3e1f505cb0f1427bbd698ac889d80821 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:06:55.616397 19557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e1f505cb0f1427bbd698ac889d80821" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:06:55.567287 19402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef32ce6fdd0e40d382c79974f30295c6" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 22 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:06:55.571062 19485 raft_consensus.cc:2468] T b08304a0a02b42d7840c4e8ee9a6bd1a P 0473d2b2d01f4459b1e90fd12cc7840e [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 18.
I20260709 13:06:55.616668 20076 leader_election.cc:304] T 85c494af21f9457a85da47b9bc70c1fd P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 127766fc592545a4997f7790f50f6076, e61c3a8f61bb48f8a963c9480e53c168; no voters: e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:06:55.517565 25337 leader_election.cc:290] T b08304a0a02b42d7840c4e8ee9a6bd1a P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 18 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:06:55.577337 20106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "172b3dd13109415a955b71ac0e9d2234" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:06:55.607219 20107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed7fdbcb96d14d418db9ca90a792588a" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 15 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:06:55.608539 19560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48824d5acfbc485ebf8c2d944e7202de" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:06:55.608887 19559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f575b143b844aa096b50997dad3516a" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:06:55.611744 19523 leader_election.cc:304] T fa8650e71aa14778b3d73721fc50d9fc P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e61c3a8f61bb48f8a963c9480e53c168; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:06:55.619385 19526 leader_election.cc:304] T b08304a0a02b42d7840c4e8ee9a6bd1a P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:06:55.622013 19556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dc5b3532fe54f74876d02beffa2c230" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:06:55.566219 25579 raft_consensus.cc:2749] T 2a16f7501e2444fb86d4e2778e734e02 P e61c3a8f61bb48f8a963c9480e53c168 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:06:55.634109 20107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "172b3dd13109415a955b71ac0e9d2234" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:06:55.638592 19556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b08304a0a02b42d7840c4e8ee9a6bd1a" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:06:55.647086 19554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40e1e16737a842ee936002830f36882e" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:06:55.600723 25304 leader_election.cc:290] T b08304a0a02b42d7840c4e8ee9a6bd1a P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 18 election: Requested vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
W20260709 13:06:55.703172 20076 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.3:36891, user_credentials={real_user=slave}} blocked reactor thread for 69642.8us
I20260709 13:06:55.620772 25553 raft_consensus.cc:2749] T 7f575b143b844aa096b50997dad3516a P e61c3a8f61bb48f8a963c9480e53c168 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:06:55.609288 25396 raft_consensus.cc:493] T 4af19371ea874c09a0a2147040835cbb P e5256d91808b47c195bc9b4dbd7f2b87 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 127766fc592545a4997f7790f50f6076)
I20260709 13:06:55.704452 20076 leader_election.cc:304] T ab43d85f64114d4ebf618930e43d9ed0 P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 127766fc592545a4997f7790f50f6076, e61c3a8f61bb48f8a963c9480e53c168; no voters: 0473d2b2d01f4459b1e90fd12cc7840e
I20260709 13:06:55.605443 25551 raft_consensus.cc:2804] T 7be9efa6559648dbb5a0f7684c4542d1 P 127766fc592545a4997f7790f50f6076 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:06:55.708372 20076 leader_election.cc:304] T 14935b3ddf914369822e4a0547aaa355 P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 127766fc592545a4997f7790f50f6076, e61c3a8f61bb48f8a963c9480e53c168; no voters: 0473d2b2d01f4459b1e90fd12cc7840e
W20260709 13:06:55.711699 25525 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.965s	user 0.021s	sys 0.089s
I20260709 13:06:55.621675 25588 raft_consensus.cc:493] T 775c229504194560ba9589bc2199b089 P e5256d91808b47c195bc9b4dbd7f2b87 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 127766fc592545a4997f7790f50f6076)
I20260709 13:06:55.576121 25462 raft_consensus.cc:515] T 1f85fc4b527a48848e5faa083b604e36 P 0473d2b2d01f4459b1e90fd12cc7840e [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:55.558300 25097 consensus_queue.cc:237] T 48824d5acfbc485ebf8c2d944e7202de P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 18.13, Last appended by leader: 13, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:55.635789 25578 raft_consensus.cc:2749] T fa731b585f684a7fb2d106c50f143b83 P e61c3a8f61bb48f8a963c9480e53c168 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 13:06:55.706429 19526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.2:46257, user_credentials={real_user=slave}} blocked reactor thread for 87108.3us
I20260709 13:06:55.707110 25370 raft_consensus.cc:493] T 96efeaaf1057492490e9a621f37e1a2d P 127766fc592545a4997f7790f50f6076 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader e61c3a8f61bb48f8a963c9480e53c168)
I20260709 13:06:55.717710 20108 raft_consensus.cc:1240] T 1f85fc4b527a48848e5faa083b604e36 P 127766fc592545a4997f7790f50f6076 [term 16 LEADER]: Rejecting Update request from peer e5256d91808b47c195bc9b4dbd7f2b87 for earlier term 15. Current term is 16. Ops: []
I20260709 13:06:55.648384 25052 raft_consensus.cc:2749] T fa8650e71aa14778b3d73721fc50d9fc P e61c3a8f61bb48f8a963c9480e53c168 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:06:55.723687 20112 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46436 (request call id 954) took 1004 ms. Trace:
W20260709 13:06:55.752570 19524 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:55.724767 19559 raft_consensus.cc:2468] T 7f575b143b844aa096b50997dad3516a P e61c3a8f61bb48f8a963c9480e53c168 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 14.
I20260709 13:06:55.709360 25435 raft_consensus.cc:2804] T 85c494af21f9457a85da47b9bc70c1fd P 127766fc592545a4997f7790f50f6076 [term 15 FOLLOWER]: Leader pre-election won for term 16
W20260709 13:06:55.712328 25525 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.966s	user 0.021s	sys 0.090s
I20260709 13:06:55.707489 25457 raft_consensus.cc:3060] T b9f0d59553ad444883fcf5b5909f9798 P e61c3a8f61bb48f8a963c9480e53c168 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:06:55.718144 25532 raft_consensus.cc:2804] T 14935b3ddf914369822e4a0547aaa355 P 127766fc592545a4997f7790f50f6076 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:06:55.724356 25564 raft_consensus.cc:2804] T ab43d85f64114d4ebf618930e43d9ed0 P 127766fc592545a4997f7790f50f6076 [term 18 FOLLOWER]: Leader pre-election won for term 19
W20260709 13:06:55.765424 19523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.1:40321, user_credentials={real_user=slave}} blocked reactor thread for 153755us
I20260709 13:06:55.633432 25138 consensus_queue.cc:1048] T 86a6797bdfe94fa496c050ceae4bd0d9 P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.087s
W20260709 13:06:55.722630 25574 log.cc:927] Time spent T ab43d85f64114d4ebf618930e43d9ed0 P 127766fc592545a4997f7790f50f6076: Append to log took a long time: real 0.481s	user 0.001s	sys 0.002s
I20260709 13:06:55.759361 20112 rpcz_store.cc:276] 0709 13:06:54.719323 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:54.720458 (+  1135us) service_pool.cc:224] Handling call
0709 13:06:55.723480 (+1003022us) spinlock_profiling.cc:243] Waited 131 ms on lock 0x7b54006202d4. stack: 00007f4a79de9343 00007f4a79de9240 00007f4a797781d4 00007f4a834b6304 00007f4a834b6299 00007f4a7ce71571 00007f4a7cf0c2fa 00007f4a81ecdb17 00007f4a7b4486d4 00007f4a7b448662 00007f4a7b448591 00007f4a7b44850c 00007f4a7b4477c2 00007f4a7b24348c 00007f4a7b2428c6 00007f4a7b24226f
0709 13:06:55.723603 (+   123us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":300824320}
I20260709 13:06:55.648059 25337 raft_consensus.cc:2804] T b08304a0a02b42d7840c4e8ee9a6bd1a P e61c3a8f61bb48f8a963c9480e53c168 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:06:55.772605 25337 raft_consensus.cc:697] T b08304a0a02b42d7840c4e8ee9a6bd1a P e61c3a8f61bb48f8a963c9480e53c168 [term 18 LEADER]: Becoming Leader. State: Replica: e61c3a8f61bb48f8a963c9480e53c168, State: Running, Role: LEADER
I20260709 13:06:55.773506 25337 consensus_queue.cc:237] T b08304a0a02b42d7840c4e8ee9a6bd1a P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:55.753422 25588 raft_consensus.cc:515] T 775c229504194560ba9589bc2199b089 P e5256d91808b47c195bc9b4dbd7f2b87 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:55.778508 25588 leader_election.cc:290] T 775c229504194560ba9589bc2199b089 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
W20260709 13:06:55.756593 19526 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:55.762884 25370 raft_consensus.cc:515] T 96efeaaf1057492490e9a621f37e1a2d P 127766fc592545a4997f7790f50f6076 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:55.781633 25370 leader_election.cc:290] T 96efeaaf1057492490e9a621f37e1a2d P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:06:55.787031 25579 consensus_queue.cc:1048] T 48824d5acfbc485ebf8c2d944e7202de P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Connected to new peer: Peer: permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:06:55.788220 25462 leader_election.cc:290] T 1f85fc4b527a48848e5faa083b604e36 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:06:55.724840 25396 raft_consensus.cc:515] T 4af19371ea874c09a0a2147040835cbb P e5256d91808b47c195bc9b4dbd7f2b87 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:55.790343 19523 leader_election.cc:304] T 14935b3ddf914369822e4a0547aaa355 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e61c3a8f61bb48f8a963c9480e53c168; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, 127766fc592545a4997f7790f50f6076
I20260709 13:06:55.791530 25579 raft_consensus.cc:2749] T 14935b3ddf914369822e4a0547aaa355 P e61c3a8f61bb48f8a963c9480e53c168 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:06:55.791695 25396 leader_election.cc:290] T 4af19371ea874c09a0a2147040835cbb P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:06:55.762247 25435 raft_consensus.cc:493] T 85c494af21f9457a85da47b9bc70c1fd P 127766fc592545a4997f7790f50f6076 [term 15 FOLLOWER]: Starting leader election (detected failure of leader e5256d91808b47c195bc9b4dbd7f2b87)
I20260709 13:06:55.764676 25599 raft_consensus.cc:2749] T e381f1d6b8184797ad142de49be225a8 P e61c3a8f61bb48f8a963c9480e53c168 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:06:55.794174 25435 raft_consensus.cc:3060] T 85c494af21f9457a85da47b9bc70c1fd P 127766fc592545a4997f7790f50f6076 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:06:55.793603 19523 leader_election.cc:304] T 85c494af21f9457a85da47b9bc70c1fd P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 127766fc592545a4997f7790f50f6076, e61c3a8f61bb48f8a963c9480e53c168; no voters: e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:06:55.795711 25599 raft_consensus.cc:2804] T 85c494af21f9457a85da47b9bc70c1fd P e61c3a8f61bb48f8a963c9480e53c168 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:06:55.796262 25599 raft_consensus.cc:493] T 85c494af21f9457a85da47b9bc70c1fd P e61c3a8f61bb48f8a963c9480e53c168 [term 15 FOLLOWER]: Starting leader election (detected failure of leader e5256d91808b47c195bc9b4dbd7f2b87)
I20260709 13:06:55.796734 25599 raft_consensus.cc:3060] T 85c494af21f9457a85da47b9bc70c1fd P e61c3a8f61bb48f8a963c9480e53c168 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:06:55.765959 25564 raft_consensus.cc:493] T ab43d85f64114d4ebf618930e43d9ed0 P 127766fc592545a4997f7790f50f6076 [term 18 FOLLOWER]: Starting leader election (detected failure of leader 0473d2b2d01f4459b1e90fd12cc7840e)
I20260709 13:06:55.801522 25564 raft_consensus.cc:3060] T ab43d85f64114d4ebf618930e43d9ed0 P 127766fc592545a4997f7790f50f6076 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:06:55.810156 25580 raft_consensus.cc:3055] T ff75a1d4cb1f493db8f71ddc136ba9ab P e5256d91808b47c195bc9b4dbd7f2b87 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:06:55.766000 25549 raft_consensus.cc:2749] T 1dc5b3532fe54f74876d02beffa2c230 P e61c3a8f61bb48f8a963c9480e53c168 [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:06:55.816416 19523 leader_election.cc:304] T ed7fdbcb96d14d418db9ca90a792588a P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e61c3a8f61bb48f8a963c9480e53c168; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, 127766fc592545a4997f7790f50f6076
I20260709 13:06:55.819883 19410 raft_consensus.cc:1275] T edd7d470b5014c9489be7f41f64355c9 P e5256d91808b47c195bc9b4dbd7f2b87 [term 20 FOLLOWER]: Refusing update from remote peer 0473d2b2d01f4459b1e90fd12cc7840e: Log matching property violated. Preceding OpId in replica: term: 18 index: 10. Preceding OpId from leader: term: 20 index: 11. (index mismatch)
I20260709 13:06:55.821941 19402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f575b143b844aa096b50997dad3516a" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:06:55.699851 25535 consensus_queue.cc:237] T ed7fdbcb96d14d418db9ca90a792588a P 127766fc592545a4997f7790f50f6076 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:55.812101 25396 raft_consensus.cc:493] T ff9b0eddd810459b82d91c60777c10eb P e5256d91808b47c195bc9b4dbd7f2b87 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:55.830816 19410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40e1e16737a842ee936002830f36882e" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:06:55.828184 19402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e1f505cb0f1427bbd698ac889d80821" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:06:55.833772 19407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cdf56e38bbc453d9438d359e5a69955" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:06:55.836917 20112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65d8cb8d6ec64f459d5a47cefab10acf" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:06:55.834707 19375 leader_election.cc:304] T fa731b585f684a7fb2d106c50f143b83 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87; no voters: 127766fc592545a4997f7790f50f6076, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:06:55.834981 19405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "217b5fae677b4971b3bbd2f357a1f7ff" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
I20260709 13:06:55.837967 19410 raft_consensus.cc:2393] T 40e1e16737a842ee936002830f36882e P e5256d91808b47c195bc9b4dbd7f2b87 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0473d2b2d01f4459b1e90fd12cc7840e in current term 19: Already voted for candidate e5256d91808b47c195bc9b4dbd7f2b87 in this term.
I20260709 13:06:55.838114 19405 raft_consensus.cc:2393] T 217b5fae677b4971b3bbd2f357a1f7ff P e5256d91808b47c195bc9b4dbd7f2b87 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate e61c3a8f61bb48f8a963c9480e53c168 in current term 13: Already voted for candidate e5256d91808b47c195bc9b4dbd7f2b87 in this term.
I20260709 13:06:55.838387 19375 leader_election.cc:304] T 65d8cb8d6ec64f459d5a47cefab10acf P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87; no voters: 127766fc592545a4997f7790f50f6076, e61c3a8f61bb48f8a963c9480e53c168
W20260709 13:06:55.839052 19523 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:55.840291 19558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96efeaaf1057492490e9a621f37e1a2d" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:06:55.841455 20108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70797e5783b5454ab0d0eea663e791e3" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:06:55.842164 20108 raft_consensus.cc:2393] T 70797e5783b5454ab0d0eea663e791e3 P 127766fc592545a4997f7790f50f6076 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e61c3a8f61bb48f8a963c9480e53c168 in current term 19: Already voted for candidate 127766fc592545a4997f7790f50f6076 in this term.
I20260709 13:06:55.814060 25580 raft_consensus.cc:740] T ff75a1d4cb1f493db8f71ddc136ba9ab P e5256d91808b47c195bc9b4dbd7f2b87 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: e5256d91808b47c195bc9b4dbd7f2b87, State: Running, Role: LEADER
I20260709 13:06:55.843459 25589 raft_consensus.cc:2749] T fa731b585f684a7fb2d106c50f143b83 P e5256d91808b47c195bc9b4dbd7f2b87 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:06:55.848443 19410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dc5b3532fe54f74876d02beffa2c230" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:06:55.849123 19410 raft_consensus.cc:2468] T 1dc5b3532fe54f74876d02beffa2c230 P e5256d91808b47c195bc9b4dbd7f2b87 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 18.
I20260709 13:06:55.850942 19375 leader_election.cc:304] T 2e36a9d6e29c4a7c860cf267efbd4c74 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:06:55.817423 25461 leader_election.cc:290] T 217b5fae677b4971b3bbd2f357a1f7ff P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 14 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:06:55.854907 19410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "309c3ca0ca4b4f3ba129752ea2cb293b" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:06:55.850405 25589 raft_consensus.cc:2749] T 65d8cb8d6ec64f459d5a47cefab10acf P e5256d91808b47c195bc9b4dbd7f2b87 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:06:55.829528 25304 raft_consensus.cc:493] T 833a2f0775ed407a94b8924ce50adb63 P e5256d91808b47c195bc9b4dbd7f2b87 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 127766fc592545a4997f7790f50f6076)
I20260709 13:06:55.856627 25304 raft_consensus.cc:515] T 833a2f0775ed407a94b8924ce50adb63 P e5256d91808b47c195bc9b4dbd7f2b87 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
W20260709 13:06:55.857721 25584 log.cc:927] Time spent T 6c5eebf646ad445a9d1b1adc319d7b16 P 0473d2b2d01f4459b1e90fd12cc7840e: Append to log took a long time: real 0.455s	user 0.000s	sys 0.004s
I20260709 13:06:55.860033 19375 leader_election.cc:304] T 70797e5783b5454ab0d0eea663e791e3 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:06:55.860848 20110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70797e5783b5454ab0d0eea663e791e3" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:06:55.861717 20110 raft_consensus.cc:2468] T 70797e5783b5454ab0d0eea663e791e3 P 127766fc592545a4997f7790f50f6076 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 19.
I20260709 13:06:55.862214 25305 raft_consensus.cc:2804] T 70797e5783b5454ab0d0eea663e791e3 P e5256d91808b47c195bc9b4dbd7f2b87 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:06:55.862663 25305 raft_consensus.cc:493] T 70797e5783b5454ab0d0eea663e791e3 P e5256d91808b47c195bc9b4dbd7f2b87 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:55.860037 25583 raft_consensus.cc:2749] T 2e36a9d6e29c4a7c860cf267efbd4c74 P e5256d91808b47c195bc9b4dbd7f2b87 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:06:55.863205 25305 raft_consensus.cc:3060] T 70797e5783b5454ab0d0eea663e791e3 P e5256d91808b47c195bc9b4dbd7f2b87 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:06:55.864382 20107 raft_consensus.cc:1240] T 48824d5acfbc485ebf8c2d944e7202de P 127766fc592545a4997f7790f50f6076 [term 20 FOLLOWER]: Rejecting Update request from peer e61c3a8f61bb48f8a963c9480e53c168 for earlier term 19. Current term is 20. Ops: [19.14-19.14]
I20260709 13:06:55.865594 19405 raft_consensus.cc:1240] T 40e1e16737a842ee936002830f36882e P e5256d91808b47c195bc9b4dbd7f2b87 [term 19 FOLLOWER]: Rejecting Update request from peer e61c3a8f61bb48f8a963c9480e53c168 for earlier term 18. Current term is 19. Ops: [18.10-18.10]
I20260709 13:06:55.866729 25353 raft_consensus.cc:993] T 85c494af21f9457a85da47b9bc70c1fd P e5256d91808b47c195bc9b4dbd7f2b87: : Instructing follower e61c3a8f61bb48f8a963c9480e53c168 to start an election
I20260709 13:06:55.866994 19405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "217b5fae677b4971b3bbd2f357a1f7ff" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:06:55.867394 25353 raft_consensus.cc:1081] T 85c494af21f9457a85da47b9bc70c1fd P e5256d91808b47c195bc9b4dbd7f2b87 [term 15 LEADER]: Signalling peer e61c3a8f61bb48f8a963c9480e53c168 to start an election
I20260709 13:06:55.867739 19405 raft_consensus.cc:2393] T 217b5fae677b4971b3bbd2f357a1f7ff P e5256d91808b47c195bc9b4dbd7f2b87 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e61c3a8f61bb48f8a963c9480e53c168 in current term 13: Already voted for candidate e5256d91808b47c195bc9b4dbd7f2b87 in this term.
I20260709 13:06:55.869871 19402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70797e5783b5454ab0d0eea663e791e3" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:06:55.855690 19558 raft_consensus.cc:1275] T 62c6c134d3d24a1ab144dd9ee6bc3f64 P e61c3a8f61bb48f8a963c9480e53c168 [term 16 FOLLOWER]: Refusing update from remote peer 127766fc592545a4997f7790f50f6076: Log matching property violated. Preceding OpId in replica: term: 15 index: 13. Preceding OpId from leader: term: 16 index: 13. (term mismatch)
I20260709 13:06:55.870431 19558 pending_rounds.cc:85] T 62c6c134d3d24a1ab144dd9ee6bc3f64 P e61c3a8f61bb48f8a963c9480e53c168: Aborting all ops after (but not including) 12
I20260709 13:06:55.870659 19558 pending_rounds.cc:107] T 62c6c134d3d24a1ab144dd9ee6bc3f64 P e61c3a8f61bb48f8a963c9480e53c168: Aborting uncommitted NO_OP operation due to leader change: 15.13
I20260709 13:06:55.871115 19558 raft_consensus.cc:2889] T 62c6c134d3d24a1ab144dd9ee6bc3f64 P e61c3a8f61bb48f8a963c9480e53c168 [term 16 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:06:55.869882 19407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "309c3ca0ca4b4f3ba129752ea2cb293b" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:06:55.855654 19410 raft_consensus.cc:2468] T 309c3ca0ca4b4f3ba129752ea2cb293b P e5256d91808b47c195bc9b4dbd7f2b87 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 11.
I20260709 13:06:55.873155 19404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65d8cb8d6ec64f459d5a47cefab10acf" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:06:55.873737 19404 raft_consensus.cc:2468] T 65d8cb8d6ec64f459d5a47cefab10acf P e5256d91808b47c195bc9b4dbd7f2b87 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 18.
I20260709 13:06:55.870078 19405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b08304a0a02b42d7840c4e8ee9a6bd1a" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
I20260709 13:06:55.875020 19405 raft_consensus.cc:2393] T b08304a0a02b42d7840c4e8ee9a6bd1a P e5256d91808b47c195bc9b4dbd7f2b87 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate e61c3a8f61bb48f8a963c9480e53c168 in current term 18: Already voted for candidate e5256d91808b47c195bc9b4dbd7f2b87 in this term.
I20260709 13:06:55.875442 25578 consensus_queue.cc:1059] T 48824d5acfbc485ebf8c2d944e7202de P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false }, Status: INVALID_TERM, Last received: 18.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:06:55.875388 25236 consensus_queue.cc:1048] T 62c6c134d3d24a1ab144dd9ee6bc3f64 P 127766fc592545a4997f7790f50f6076 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:06:55.833227 25549 raft_consensus.cc:2749] T ed7fdbcb96d14d418db9ca90a792588a P e61c3a8f61bb48f8a963c9480e53c168 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:06:55.887667 19410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "217b5fae677b4971b3bbd2f357a1f7ff" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
I20260709 13:06:55.888516 19410 raft_consensus.cc:3060] T 217b5fae677b4971b3bbd2f357a1f7ff P e5256d91808b47c195bc9b4dbd7f2b87 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:06:55.883482 25599 raft_consensus.cc:515] T 85c494af21f9457a85da47b9bc70c1fd P e61c3a8f61bb48f8a963c9480e53c168 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:55.843653 25580 consensus_queue.cc:260] T ff75a1d4cb1f493db8f71ddc136ba9ab P e5256d91808b47c195bc9b4dbd7f2b87 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 17.9, Last appended by leader: 9, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:55.890355 25578 raft_consensus.cc:3055] T 48824d5acfbc485ebf8c2d944e7202de P e61c3a8f61bb48f8a963c9480e53c168 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:06:55.895493 19479 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58286 (request call id 2556) took 1207 ms. Trace:
I20260709 13:06:55.897023 25311 raft_consensus.cc:493] T 7be9efa6559648dbb5a0f7684c4542d1 P 0473d2b2d01f4459b1e90fd12cc7840e [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:55.852304 25396 raft_consensus.cc:515] T ff9b0eddd810459b82d91c60777c10eb P e5256d91808b47c195bc9b4dbd7f2b87 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:55.899121 25237 consensus_queue.cc:1048] T 14935b3ddf914369822e4a0547aaa355 P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:06:55.899891 19450 leader_election.cc:304] T e381f1d6b8184797ad142de49be225a8 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e; no voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:06:55.891031 19404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "172b3dd13109415a955b71ac0e9d2234" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:06:55.890429 19555 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40428 (request call id 3145) took 1640 ms. Trace:
I20260709 13:06:55.903337 25359 raft_consensus.cc:3060] T ff9b0eddd810459b82d91c60777c10eb P 127766fc592545a4997f7790f50f6076 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:06:55.906304 19523 leader_election.cc:304] T ef32ce6fdd0e40d382c79974f30295c6 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e61c3a8f61bb48f8a963c9480e53c168; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:06:55.884804 25304 leader_election.cc:290] T 833a2f0775ed407a94b8924ce50adb63 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:06:55.932274 19523 leader_election.cc:304] T 0cdf56e38bbc453d9438d359e5a69955 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e61c3a8f61bb48f8a963c9480e53c168; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:06:55.911576 19554 raft_consensus.cc:2468] T 40e1e16737a842ee936002830f36882e P e61c3a8f61bb48f8a963c9480e53c168 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 19.
I20260709 13:06:55.912292 19484 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58286 (request call id 2558) took 1203 ms. Trace:
I20260709 13:06:55.913208 20109 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46436 (request call id 949) took 1642 ms. Trace:
I20260709 13:06:55.919687 19407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f85fc4b527a48848e5faa083b604e36" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:06:55.919493 19479 rpcz_store.cc:276] 0709 13:06:54.688381 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:55.502869 (+814488us) service_pool.cc:224] Handling call
0709 13:06:55.503128 (+   259us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:55.503276 (+   148us) raft_consensus.cc:1534] Early marking committed up to index 13
0709 13:06:55.504545 (+  1269us) log.cc:844] Serialized 14 byte log entry
0709 13:06:55.602150 (+ 97605us) log.cc:844] Serialized 14 byte log entry
0709 13:06:55.803902 (+201752us) spinlock_profiling.cc:243] Waited 12.4 ms on lock 0x7b180048c460. stack: 00007f4a79de9343 00007f4a79de9240 00007f4a797781d4 00007f4a834b6304 00007f4a834b6299 00007f4a82ce3de1 00007f4a82cf05b1 00007f4a79e1b3f3 00007f4a79e1d7c1 00007f4a79e1d779 00007f4a79e1d709 00007f4a79e1d6d1 00007f4a79e1c9cd 000000000038f354 000000000038f199 00007f4a79dfe83a
0709 13:06:55.895005 (+ 91103us) spinlock_profiling.cc:243] Waited 4.43 ms on lock 0x7b180048c460. stack: 00007f4a79de9343 00007f4a79de9240 00007f4a797781d4 00007f4a834b6304 00007f4a834b6299 00007f4a82ce3de1 00007f4a82cf05b1 00007f4a79d95c0a 00007f4a834d5219 00007f4a79e1da40 00007f4a79e184e4 00007f4a79e18455 00007f4a7cf00060 00007f4a7cf12716 00007f4a7cf23287 00007f4a7cf23208
0709 13:06:55.895163 (+   158us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:55.895211 (+    48us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:06:55.895260 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:55.895321 (+    61us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:55.895433 (+   112us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":268937,"prepare.queue_time_us":9059,"prepare.run_cpu_time_us":98,"prepare.run_wall_time_us":765,"raft.queue_time_us":298646,"raft.run_cpu_time_us":258,"raft.run_wall_time_us":12690,"spinlock_wait_cycles":38780032,"thread_start_us":96881,"threads_started":1,"wal-append.queue_time_us":202405}
I20260709 13:06:55.933195 19484 rpcz_store.cc:276] 0709 13:06:54.708851 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:55.556810 (+847959us) service_pool.cc:224] Handling call
0709 13:06:55.557116 (+   306us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:55.557341 (+   225us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:55.557367 (+    26us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:55.557839 (+   472us) log.cc:844] Serialized 26 byte log entry
0709 13:06:55.763356 (+205517us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:06:55.763390 (+    34us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:55.763466 (+    76us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:55.912104 (+148638us) raft_consensus.cc:1685] finished
0709 13:06:55.912123 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:55.912238 (+   115us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":143502,"threads_started":1,"wal-append.queue_time_us":275208}
W20260709 13:06:55.893199 25568 log.cc:927] Time spent T 28af091831594f9d8e96482078cc7625 P e61c3a8f61bb48f8a963c9480e53c168: Append to log took a long time: real 0.381s	user 0.001s	sys 0.001s
I20260709 13:06:55.928972 19404 raft_consensus.cc:2468] T 172b3dd13109415a955b71ac0e9d2234 P e5256d91808b47c195bc9b4dbd7f2b87 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 16.
I20260709 13:06:55.928350 19555 rpcz_store.cc:276] 0709 13:06:54.249840 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:54.252598 (+  2758us) service_pool.cc:224] Handling call
0709 13:06:54.649848 (+397250us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:54.650190 (+   342us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:54.650218 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:54.650706 (+   488us) log.cc:844] Serialized 26 byte log entry
0709 13:06:54.869419 (+218713us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:06:54.869656 (+   237us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:54.869925 (+   269us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:55.368792 (+498867us) raft_consensus.cc:1685] finished
0709 13:06:55.368823 (+    31us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:55.890182 (+521359us) spinlock_profiling.cc:243] Waited 397 ms on lock 0x7b5400126450. stack: 00007f4a79de9343 00007f4a79de9240 00007f4a797781d4 00007f4a834b6304 00007f4a834b6299 00007f4a7ce71571 00007f4a7cf078ad 00007f4a81ecc419 00007f4a7b443bd4 00007f4a7b443b62 00007f4a7b443a91 00007f4a7b443a0c 00007f4a7b442cc2 00007f4a7b24348c 00007f4a7b2428c6 00007f4a7b24226f
0709 13:06:55.890372 (+   190us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1124,"raft.run_cpu_time_us":97,"raft.run_wall_time_us":6952,"spinlock_wait_cycles":912976128,"thread_start_us":217949,"threads_started":1,"wal-append.queue_time_us":369762}
I20260709 13:06:55.953656 19523 leader_election.cc:304] T 65d8cb8d6ec64f459d5a47cefab10acf P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168; no voters: 127766fc592545a4997f7790f50f6076
I20260709 13:06:55.956307 19553 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40428 (request call id 3163) took 1238 ms. Trace:
I20260709 13:06:55.957131 25553 raft_consensus.cc:2804] T 65d8cb8d6ec64f459d5a47cefab10acf P e61c3a8f61bb48f8a963c9480e53c168 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:06:55.956952 19555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4af19371ea874c09a0a2147040835cbb" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:06:55.957576 25553 raft_consensus.cc:493] T 65d8cb8d6ec64f459d5a47cefab10acf P e61c3a8f61bb48f8a963c9480e53c168 [term 18 FOLLOWER]: Starting leader election (detected failure of leader 127766fc592545a4997f7790f50f6076)
I20260709 13:06:55.958056 25553 raft_consensus.cc:3060] T 65d8cb8d6ec64f459d5a47cefab10acf P e61c3a8f61bb48f8a963c9480e53c168 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:06:55.959774 19555 raft_consensus.cc:1275] T 7be9efa6559648dbb5a0f7684c4542d1 P e61c3a8f61bb48f8a963c9480e53c168 [term 17 FOLLOWER]: Refusing update from remote peer e5256d91808b47c195bc9b4dbd7f2b87: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 13:06:55.954871 19479 raft_consensus.cc:1275] T 1a61655d99124a29b486ba4a5b37faea P 0473d2b2d01f4459b1e90fd12cc7840e [term 15 FOLLOWER]: Refusing update from remote peer e61c3a8f61bb48f8a963c9480e53c168: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 13:06:55.962095 19407 raft_consensus.cc:2468] T 1f85fc4b527a48848e5faa083b604e36 P e5256d91808b47c195bc9b4dbd7f2b87 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 16.
W20260709 13:06:55.962854 25530 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.219s	user 0.005s	sys 0.000s
W20260709 13:06:55.963378 25530 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.220s	user 0.006s	sys 0.000s
I20260709 13:06:55.924746 25532 raft_consensus.cc:697] T 14935b3ddf914369822e4a0547aaa355 P 127766fc592545a4997f7790f50f6076 [term 12 LEADER]: Becoming Leader. State: Replica: 127766fc592545a4997f7790f50f6076, State: Running, Role: LEADER
I20260709 13:06:55.975803 19408 raft_consensus.cc:1275] T ff9b0eddd810459b82d91c60777c10eb P e5256d91808b47c195bc9b4dbd7f2b87 [term 17 FOLLOWER]: Refusing update from remote peer 0473d2b2d01f4459b1e90fd12cc7840e: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
W20260709 13:06:56.009672 20076 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.3:36891, user_credentials={real_user=slave}} blocked reactor thread for 51515.8us
I20260709 13:06:55.956955 19558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "833a2f0775ed407a94b8924ce50adb63" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:06:55.897037 25590 raft_consensus.cc:3060] T 2b74109013a140ada21feeef92d6f563 P e5256d91808b47c195bc9b4dbd7f2b87 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:06:55.953408 20109 rpcz_store.cc:276] 0709 13:06:54.270753 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:54.271483 (+   730us) service_pool.cc:224] Handling call
0709 13:06:54.592004 (+320521us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:54.678845 (+ 86841us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:55.913030 (+1234185us) spinlock_profiling.cc:243] Waited 320 ms on lock 0x7b54004169d0. stack: 00007f4a79de9343 00007f4a79de9240 00007f4a797781d4 00007f4a834b6304 00007f4a834b6299 00007f4a7ce71571 00007f4a7cf078ad 00007f4a81ecc419 00007f4a7b443bd4 00007f4a7b443b62 00007f4a7b443a91 00007f4a7b443a0c 00007f4a7b442cc2 00007f4a7b24348c 00007f4a7b2428c6 00007f4a7b24226f
0709 13:06:55.913154 (+   124us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":736271232}
W20260709 13:06:56.043881 19375 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:55.928588 25602 log.cc:927] Time spent T 7be9efa6559648dbb5a0f7684c4542d1 P 127766fc592545a4997f7790f50f6076: Append to log took a long time: real 0.304s	user 0.002s	sys 0.000s
I20260709 13:06:56.048005 19558 raft_consensus.cc:1240] T e381f1d6b8184797ad142de49be225a8 P e61c3a8f61bb48f8a963c9480e53c168 [term 15 FOLLOWER]: Rejecting Update request from peer e5256d91808b47c195bc9b4dbd7f2b87 for earlier term 14. Current term is 15. Ops: []
I20260709 13:06:55.956673 19553 rpcz_store.cc:276] 0709 13:06:54.718160 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:54.718272 (+   112us) service_pool.cc:224] Handling call
0709 13:06:54.739077 (+ 20805us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:54.739439 (+   362us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:54.739467 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:54.739865 (+   398us) log.cc:844] Serialized 26 byte log entry
0709 13:06:54.924802 (+184937us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:06:54.924860 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:54.924951 (+    91us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:55.892545 (+967594us) spinlock_profiling.cc:243] Waited 9.35 ms on lock 0x7b4400022b4c. stack: 00007f4a79de9343 00007f4a79de9240 00007f4a797781d4 00007f4a834b6304 00007f4a834b6299 00007f4a79ca3db1 00007f4a79d41c85 00007f4a79d426a2 00007f4a7cab41db 00007f4a7caafaaf 00007f4a7caa386e 00007f4a7caa2bb6 00007f4a7caa27d8 00007f4a7caac221 00007f4a7caac1d9 00007f4a7caac169
0709 13:06:55.956046 (+ 63501us) raft_consensus.cc:1685] finished
0709 13:06:55.956071 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:55.956248 (+   177us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1085,"raft.run_cpu_time_us":82,"raft.run_wall_time_us":84,"spinlock_wait_cycles":21494528,"thread_start_us":184629,"threads_started":1,"wal-append.queue_time_us":750349}
I20260709 13:06:56.054774 19410 raft_consensus.cc:2468] T 217b5fae677b4971b3bbd2f357a1f7ff P e5256d91808b47c195bc9b4dbd7f2b87 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 14.
W20260709 13:06:56.056603 19449 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.1:40321, user_credentials={real_user=slave}} blocked reactor thread for 122020us
I20260709 13:06:55.918817 25578 raft_consensus.cc:740] T 48824d5acfbc485ebf8c2d944e7202de P e61c3a8f61bb48f8a963c9480e53c168 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: e61c3a8f61bb48f8a963c9480e53c168, State: Running, Role: LEADER
I20260709 13:06:55.951221 25549 raft_consensus.cc:493] T 46c5bfeecc314717bffe987e6844b6d0 P e61c3a8f61bb48f8a963c9480e53c168 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 0473d2b2d01f4459b1e90fd12cc7840e)
I20260709 13:06:56.009518 25580 raft_consensus.cc:3060] T ff75a1d4cb1f493db8f71ddc136ba9ab P e5256d91808b47c195bc9b4dbd7f2b87 [term 17 FOLLOWER]: Advancing to term 18
W20260709 13:06:56.109771 19450 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.3:36891, user_credentials={real_user=slave}} blocked reactor thread for 209944us
I20260709 13:06:55.951272 25593 raft_consensus.cc:2749] T ef32ce6fdd0e40d382c79974f30295c6 P e61c3a8f61bb48f8a963c9480e53c168 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:06:56.016846 25450 raft_consensus.cc:2749] T e381f1d6b8184797ad142de49be225a8 P 0473d2b2d01f4459b1e90fd12cc7840e [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:06:55.965144 25183 raft_consensus.cc:2749] T 0cdf56e38bbc453d9438d359e5a69955 P e61c3a8f61bb48f8a963c9480e53c168 [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 13:06:56.117892 19375 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:56.145042 19375 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:56.110343 25605 log.cc:927] Time spent T 0cdf56e38bbc453d9438d359e5a69955 P e5256d91808b47c195bc9b4dbd7f2b87: Append to log took a long time: real 0.391s	user 0.001s	sys 0.000s
I20260709 13:06:56.015859 25304 consensus_queue.cc:1048] T 7be9efa6559648dbb5a0f7684c4542d1 P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.098s
I20260709 13:06:55.930140 25311 raft_consensus.cc:515] T 7be9efa6559648dbb5a0f7684c4542d1 P 0473d2b2d01f4459b1e90fd12cc7840e [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } attrs { replace: true } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
W20260709 13:06:56.158174 19449 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.1:40321, user_credentials={real_user=slave}} blocked reactor thread for 100535us
I20260709 13:06:56.113893 25549 raft_consensus.cc:515] T 46c5bfeecc314717bffe987e6844b6d0 P e61c3a8f61bb48f8a963c9480e53c168 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
W20260709 13:06:56.165455 19450 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.3:36891, user_credentials={real_user=slave}} blocked reactor thread for 46629us
I20260709 13:06:56.167461 19450 leader_election.cc:304] T ff75a1d4cb1f493db8f71ddc136ba9ab P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168; no voters: e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:06:56.113893 25086 raft_consensus.cc:493] T 2725d2c4cb054f18b0fc8f735c15f6c2 P e61c3a8f61bb48f8a963c9480e53c168 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 0473d2b2d01f4459b1e90fd12cc7840e)
I20260709 13:06:56.113691 25411 raft_consensus.cc:493] T 0e1085d23e8347fbbd5bce7542f4b1f4 P e61c3a8f61bb48f8a963c9480e53c168 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 127766fc592545a4997f7790f50f6076)
W20260709 13:06:56.157289 25621 log.cc:927] Time spent T 46c5bfeecc314717bffe987e6844b6d0 P 0473d2b2d01f4459b1e90fd12cc7840e: Append to log took a long time: real 0.063s	user 0.000s	sys 0.000s
I20260709 13:06:56.108747 25591 consensus_queue.cc:1059] T e381f1d6b8184797ad142de49be225a8 P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 }, Status: INVALID_TERM, Last received: 14.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.073s
I20260709 13:06:56.185756 25612 raft_consensus.cc:493] T 833a2f0775ed407a94b8924ce50adb63 P e61c3a8f61bb48f8a963c9480e53c168 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 127766fc592545a4997f7790f50f6076)
I20260709 13:06:56.190727 25086 raft_consensus.cc:515] T 2725d2c4cb054f18b0fc8f735c15f6c2 P e61c3a8f61bb48f8a963c9480e53c168 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:56.199417 25612 raft_consensus.cc:515] T 833a2f0775ed407a94b8924ce50adb63 P e61c3a8f61bb48f8a963c9480e53c168 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:56.201707 25612 leader_election.cc:290] T 833a2f0775ed407a94b8924ce50adb63 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:06:56.201753 25086 leader_election.cc:290] T 2725d2c4cb054f18b0fc8f735c15f6c2 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:06:56.164469 25462 raft_consensus.cc:493] T a08760e15aac4630a629431f56024dc8 P 0473d2b2d01f4459b1e90fd12cc7840e [term 21 FOLLOWER]: Starting pre-election (detected failure of leader e5256d91808b47c195bc9b4dbd7f2b87)
I20260709 13:06:56.203492 19411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "833a2f0775ed407a94b8924ce50adb63" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:06:56.220744 19411 raft_consensus.cc:2468] T 833a2f0775ed407a94b8924ce50adb63 P e5256d91808b47c195bc9b4dbd7f2b87 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 13.
I20260709 13:06:56.204053 19410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2725d2c4cb054f18b0fc8f735c15f6c2" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:06:56.206494 19478 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58286 (request call id 2561) took 1126 ms. Trace:
W20260709 13:06:56.214921 19449 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.1:40321, user_credentials={real_user=slave}} blocked reactor thread for 47807.2us
I20260709 13:06:56.221598 19478 rpcz_store.cc:276] 0709 13:06:55.080327 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:55.165814 (+ 85487us) service_pool.cc:224] Handling call
0709 13:06:56.206300 (+1040486us) spinlock_profiling.cc:243] Waited 327 ms on lock 0x7b5400221854. stack: 00007f4a79de9343 00007f4a79de9240 00007f4a797781d4 00007f4a834b6304 00007f4a834b6299 00007f4a7ce71571 00007f4a7cf0c2fa 00007f4a81ecdb17 00007f4a7b4486d4 00007f4a7b448662 00007f4a7b448591 00007f4a7b44850c 00007f4a7b4477c2 00007f4a7b24348c 00007f4a7b2428c6 00007f4a7b24226f
0709 13:06:56.206438 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":751095680}
I20260709 13:06:56.197494 19450 leader_election.cc:304] T 22196caba61445d3bec98a0aab3c337d P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e; no voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:06:56.205227 20109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f85fc4b527a48848e5faa083b604e36" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:06:56.226632 19523 leader_election.cc:304] T 833a2f0775ed407a94b8924ce50adb63 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
W20260709 13:06:56.204888 25595 log.cc:927] Time spent T df751f992649444090e27965eb1af85d P e61c3a8f61bb48f8a963c9480e53c168: Append to log took a long time: real 0.703s	user 0.000s	sys 0.005s
I20260709 13:06:56.188230 25537 raft_consensus.cc:493] T 21e14947d70440f19044d8f75c31e1f9 P 0473d2b2d01f4459b1e90fd12cc7840e [term 17 FOLLOWER]: Starting pre-election (detected failure of leader e5256d91808b47c195bc9b4dbd7f2b87)
I20260709 13:06:56.194903 25340 raft_consensus.cc:2804] T ff75a1d4cb1f493db8f71ddc136ba9ab P 0473d2b2d01f4459b1e90fd12cc7840e [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:06:56.235675 19411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85c494af21f9457a85da47b9bc70c1fd" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
I20260709 13:06:56.195670 25183 raft_consensus.cc:493] T 22196caba61445d3bec98a0aab3c337d P e61c3a8f61bb48f8a963c9480e53c168 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader e5256d91808b47c195bc9b4dbd7f2b87)
W20260709 13:06:56.241552 19523 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:56.246812 20109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "833a2f0775ed407a94b8924ce50adb63" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
W20260709 13:06:56.250936 20077 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:56.230487 25579 raft_consensus.cc:2804] T 833a2f0775ed407a94b8924ce50adb63 P e61c3a8f61bb48f8a963c9480e53c168 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:06:56.237504 25183 raft_consensus.cc:515] T 22196caba61445d3bec98a0aab3c337d P e61c3a8f61bb48f8a963c9480e53c168 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:56.253530 25090 raft_consensus.cc:993] T bc225c93219c45538b53a1bd3d387e4d P e5256d91808b47c195bc9b4dbd7f2b87: : Instructing follower 0473d2b2d01f4459b1e90fd12cc7840e to start an election
I20260709 13:06:56.214174 25411 raft_consensus.cc:515] T 0e1085d23e8347fbbd5bce7542f4b1f4 P e61c3a8f61bb48f8a963c9480e53c168 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:56.263492 20111 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35874 (request call id 1113) took 1929 ms. Trace:
I20260709 13:06:56.260125 25623 raft_consensus.cc:2749] T 22196caba61445d3bec98a0aab3c337d P 0473d2b2d01f4459b1e90fd12cc7840e [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:06:56.265462 20111 rpcz_store.cc:276] 0709 13:06:54.334406 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:54.334544 (+   138us) service_pool.cc:224] Handling call
0709 13:06:54.355642 (+ 21098us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:54.475348 (+119706us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 13:06:54.486585 (+ 11237us) log.cc:844] Serialized 14 byte log entry
0709 13:06:55.450493 (+963908us) spinlock_profiling.cc:243] Waited 12.9 ms on lock 0x7b18000f7fc0. stack: 00007f4a79de9343 00007f4a79de9240 00007f4a797781d4 00007f4a834b6304 00007f4a834b6299 00007f4a82ce3de1 00007f4a82cf05b1 00007f4a79dfde07 00007f4a82c58ab9 00007f4a79e1a69b 00007f4a79e1893f 00007f4a79e1ac02 00007f4a7caa220b 00007f4a7caa7d23 00007f4a7caa823a 00007f4a7cf12a2a
0709 13:06:55.543680 (+ 93187us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:55.572624 (+ 28944us) log.cc:844] Serialized 26 byte log entry
0709 13:06:55.572939 (+   315us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:06:55.572975 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:55.573054 (+    79us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:56.261030 (+687976us) raft_consensus.cc:1685] finished
0709 13:06:56.263134 (+  2104us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:56.263399 (+   265us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":43274,"prepare.queue_time_us":7896,"prepare.run_cpu_time_us":49,"prepare.run_wall_time_us":20845,"raft.queue_time_us":106622,"raft.run_cpu_time_us":147,"raft.run_wall_time_us":148,"spinlock_wait_cycles":29732608,"thread_start_us":161168,"threads_started":2,"wal-append.queue_time_us":1037531}
W20260709 13:06:56.268306 25457 consensus_meta.cc:287] T b9f0d59553ad444883fcf5b5909f9798 P e61c3a8f61bb48f8a963c9480e53c168: Time spent flushing consensus metadata: real 0.502s	user 0.007s	sys 0.001s
W20260709 13:06:56.260504 25367 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.620s	user 0.004s	sys 0.004s
W20260709 13:06:56.269018 25367 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.639s	user 0.004s	sys 0.004s
I20260709 13:06:56.269732 25549 leader_election.cc:290] T 46c5bfeecc314717bffe987e6844b6d0 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:06:56.270478 25396 leader_election.cc:290] T ff9b0eddd810459b82d91c60777c10eb P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:06:56.270838 19553 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "85c494af21f9457a85da47b9bc70c1fd"
dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
 from {username='slave'} at 127.0.0.1:40438
I20260709 13:06:56.271588 19553 raft_consensus.cc:493] T 85c494af21f9457a85da47b9bc70c1fd P e61c3a8f61bb48f8a963c9480e53c168 [term 16 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:06:56.271963 19553 raft_consensus.cc:3060] T 85c494af21f9457a85da47b9bc70c1fd P e61c3a8f61bb48f8a963c9480e53c168 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:06:56.272142 19552 raft_consensus.cc:1275] T b9f0d59553ad444883fcf5b5909f9798 P e61c3a8f61bb48f8a963c9480e53c168 [term 15 FOLLOWER]: Refusing update from remote peer 0473d2b2d01f4459b1e90fd12cc7840e: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 13:06:56.274814 25183 leader_election.cc:290] T 22196caba61445d3bec98a0aab3c337d P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
W20260709 13:06:56.271155 25614 log.cc:927] Time spent T fa731b585f684a7fb2d106c50f143b83 P e61c3a8f61bb48f8a963c9480e53c168: Append to log took a long time: real 0.253s	user 0.001s	sys 0.000s
I20260709 13:06:56.280648 25311 leader_election.cc:290] T 7be9efa6559648dbb5a0f7684c4542d1 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:06:56.281420 19483 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58286 (request call id 2554) took 1593 ms. Trace:
W20260709 13:06:56.283100 25618 log.cc:927] Time spent T ed7fdbcb96d14d418db9ca90a792588a P 127766fc592545a4997f7790f50f6076: Append to log took a long time: real 0.051s	user 0.001s	sys 0.000s
I20260709 13:06:56.284132 25599 leader_election.cc:290] T 85c494af21f9457a85da47b9bc70c1fd P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 16 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:06:56.258203 25579 raft_consensus.cc:493] T 833a2f0775ed407a94b8924ce50adb63 P e61c3a8f61bb48f8a963c9480e53c168 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 127766fc592545a4997f7790f50f6076)
I20260709 13:06:56.284497 25183 raft_consensus.cc:493] T 7be9efa6559648dbb5a0f7684c4542d1 P e61c3a8f61bb48f8a963c9480e53c168 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:56.284921 25579 raft_consensus.cc:3060] T 833a2f0775ed407a94b8924ce50adb63 P e61c3a8f61bb48f8a963c9480e53c168 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:06:56.285102 25183 raft_consensus.cc:515] T 7be9efa6559648dbb5a0f7684c4542d1 P e61c3a8f61bb48f8a963c9480e53c168 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } attrs { replace: true } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:56.288194 19480 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58286 (request call id 2544) took 1624 ms. Trace:
I20260709 13:06:56.288784 25183 leader_election.cc:290] T 7be9efa6559648dbb5a0f7684c4542d1 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:06:56.288633 19480 rpcz_store.cc:276] 0709 13:06:54.663375 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:54.682896 (+ 19521us) service_pool.cc:224] Handling call
0709 13:06:54.683219 (+   323us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:55.334774 (+651555us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:56.287903 (+953129us) spinlock_profiling.cc:243] Waited 646 ms on lock 0x7b54003e94d4. stack: 00007f4a79de9343 00007f4a79de9240 00007f4a797781d4 00007f4a834b6304 00007f4a834b6299 00007f4a7ce71571 00007f4a7cf08e01 00007f4a7cf0783e 00007f4a81ecc419 00007f4a7b443bd4 00007f4a7b443b62 00007f4a7b443a91 00007f4a7b443a0c 00007f4a7b442cc2 00007f4a7b24348c 00007f4a7b2428c6
0709 13:06:56.288123 (+   220us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1485845888}
I20260709 13:06:56.182837 25532 consensus_queue.cc:237] T 14935b3ddf914369822e4a0547aaa355 P 127766fc592545a4997f7790f50f6076 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:56.263242 25622 raft_consensus.cc:493] T bc225c93219c45538b53a1bd3d387e4d P 0473d2b2d01f4459b1e90fd12cc7840e [term 14 FOLLOWER]: Starting pre-election (detected failure of leader e5256d91808b47c195bc9b4dbd7f2b87)
I20260709 13:06:56.294548 20109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7be9efa6559648dbb5a0f7684c4542d1" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 18 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:06:56.248420 25340 raft_consensus.cc:697] T ff75a1d4cb1f493db8f71ddc136ba9ab P 0473d2b2d01f4459b1e90fd12cc7840e [term 18 LEADER]: Becoming Leader. State: Replica: 0473d2b2d01f4459b1e90fd12cc7840e, State: Running, Role: LEADER
I20260709 13:06:56.189299 25578 consensus_queue.cc:260] T 48824d5acfbc485ebf8c2d944e7202de P e61c3a8f61bb48f8a963c9480e53c168 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 19.14, Last appended by leader: 14, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
W20260709 13:06:56.295377 19450 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.3:36891, user_credentials={real_user=slave}} blocked reactor thread for 97956.4us
I20260709 13:06:56.226975 25462 raft_consensus.cc:515] T a08760e15aac4630a629431f56024dc8 P 0473d2b2d01f4459b1e90fd12cc7840e [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:56.304947 19407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22196caba61445d3bec98a0aab3c337d" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:06:56.281811 19483 rpcz_store.cc:276] 0709 13:06:54.687885 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:54.837869 (+149984us) service_pool.cc:224] Handling call
0709 13:06:56.280728 (+1442859us) spinlock_profiling.cc:243] Waited 6.34 ms on lock 0x7b58001b9998. stack: 00007f4a79de9343 00007f4a79de9240 00007f4a797781d4 00007f4a834b6304 00007f4a834b6299 00007f4a79ca3db1 00007f4a79de3b71 00007f4a79de3a22 00007f4a82cfcc09 00007f4a81e56ee0 00007f4a81f200ab 00007f4a81f20131 00007f4a81ee1fc0 00007f4a81ecc929 00007f4a81ecc3d2 00007f4a7b443bd4
0709 13:06:56.280937 (+   209us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:56.281118 (+   181us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:56.281144 (+    26us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:56.281185 (+    41us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:06:56.281218 (+    33us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:56.281270 (+    52us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:56.281365 (+    95us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":14584576}
I20260709 13:06:56.311348 19411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46c5bfeecc314717bffe987e6844b6d0" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 24 candidate_status { last_received { term: 23 index: 12 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:06:56.311987 19404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7be9efa6559648dbb5a0f7684c4542d1" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 18 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:06:56.239794 25537 raft_consensus.cc:515] T 21e14947d70440f19044d8f75c31e1f9 P 0473d2b2d01f4459b1e90fd12cc7840e [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:56.315137 19411 raft_consensus.cc:2468] T 46c5bfeecc314717bffe987e6844b6d0 P e5256d91808b47c195bc9b4dbd7f2b87 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 23.
I20260709 13:06:56.245534 25450 consensus_queue.cc:1048] T edd7d470b5014c9489be7f41f64355c9 P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.047s
I20260709 13:06:56.315455 20111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85c494af21f9457a85da47b9bc70c1fd" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076"
I20260709 13:06:56.303885 25591 raft_consensus.cc:1081] T bc225c93219c45538b53a1bd3d387e4d P e5256d91808b47c195bc9b4dbd7f2b87 [term 14 LEADER]: Signalling peer 0473d2b2d01f4459b1e90fd12cc7840e to start an election
I20260709 13:06:56.323498 19480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dc5b3532fe54f74876d02beffa2c230" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:06:56.324393 19480 raft_consensus.cc:2468] T 1dc5b3532fe54f74876d02beffa2c230 P 0473d2b2d01f4459b1e90fd12cc7840e [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 18.
I20260709 13:06:56.324517 19478 raft_consensus.cc:1240] T e381f1d6b8184797ad142de49be225a8 P 0473d2b2d01f4459b1e90fd12cc7840e [term 15 FOLLOWER]: Rejecting Update request from peer e5256d91808b47c195bc9b4dbd7f2b87 for earlier term 14. Current term is 15. Ops: []
I20260709 13:06:56.303695 25183 raft_consensus.cc:493] T 6c5eebf646ad445a9d1b1adc319d7b16 P e61c3a8f61bb48f8a963c9480e53c168 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 0473d2b2d01f4459b1e90fd12cc7840e)
I20260709 13:06:56.346931 19480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b08304a0a02b42d7840c4e8ee9a6bd1a" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:06:56.347718 19480 raft_consensus.cc:2393] T b08304a0a02b42d7840c4e8ee9a6bd1a P 0473d2b2d01f4459b1e90fd12cc7840e [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate e5256d91808b47c195bc9b4dbd7f2b87 in current term 18: Already voted for candidate e61c3a8f61bb48f8a963c9480e53c168 in this term.
I20260709 13:06:56.348168 19483 raft_consensus.cc:1275] T 7be9efa6559648dbb5a0f7684c4542d1 P 0473d2b2d01f4459b1e90fd12cc7840e [term 17 FOLLOWER]: Refusing update from remote peer e5256d91808b47c195bc9b4dbd7f2b87: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
W20260709 13:06:56.351061 19526 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:56.347978 19478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a61655d99124a29b486ba4a5b37faea" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:06:56.353081 19478 raft_consensus.cc:3060] T 1a61655d99124a29b486ba4a5b37faea P 0473d2b2d01f4459b1e90fd12cc7840e [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:06:56.355878 19485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36f6ba92b9ba46babe4ebd6c02e5fbd9" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:06:56.358991 19485 raft_consensus.cc:3060] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P 0473d2b2d01f4459b1e90fd12cc7840e [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:06:56.342873 25578 raft_consensus.cc:3060] T 48824d5acfbc485ebf8c2d944e7202de P e61c3a8f61bb48f8a963c9480e53c168 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:06:56.372239 19480 raft_consensus.cc:1275] T 1f85fc4b527a48848e5faa083b604e36 P 0473d2b2d01f4459b1e90fd12cc7840e [term 16 FOLLOWER]: Refusing update from remote peer 127766fc592545a4997f7790f50f6076: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 13:06:56.366425 19553 raft_consensus.cc:515] T 85c494af21f9457a85da47b9bc70c1fd P e61c3a8f61bb48f8a963c9480e53c168 [term 17 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:56.372140 19483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96efeaaf1057492490e9a621f37e1a2d" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:06:56.375059 25624 consensus_queue.cc:1048] T 1f85fc4b527a48848e5faa083b604e36 P 127766fc592545a4997f7790f50f6076 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:06:56.375456 19479 raft_consensus.cc:1275] T 5ec1c4ce15e04c7e8c283a62179f2a64 P 0473d2b2d01f4459b1e90fd12cc7840e [term 12 FOLLOWER]: Refusing update from remote peer 127766fc592545a4997f7790f50f6076: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 13:06:56.318723 25622 raft_consensus.cc:515] T bc225c93219c45538b53a1bd3d387e4d P 0473d2b2d01f4459b1e90fd12cc7840e [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:56.392660 25622 leader_election.cc:290] T bc225c93219c45538b53a1bd3d387e4d P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
W20260709 13:06:56.397018 19374 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:56.397495 19374 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:56.397342 20110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4af19371ea874c09a0a2147040835cbb" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:06:56.398197 20112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "833a2f0775ed407a94b8924ce50adb63" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:06:56.398444 19482 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39478 (request call id 979) took 1710 ms. Trace:
I20260709 13:06:56.399454 20106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36f6ba92b9ba46babe4ebd6c02e5fbd9" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076"
I20260709 13:06:56.399834 20109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a16f7501e2444fb86d4e2778e734e02" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:06:56.398875 19482 rpcz_store.cc:276] 0709 13:06:54.688138 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:55.327214 (+639076us) service_pool.cc:224] Handling call
0709 13:06:55.327524 (+   310us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:55.446571 (+119047us) raft_consensus.cc:1534] Early marking committed up to index 11
0709 13:06:55.466933 (+ 20362us) log.cc:844] Serialized 14 byte log entry
0709 13:06:55.507274 (+ 40341us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:55.507325 (+    51us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:06:55.507375 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:56.398249 (+890874us) spinlock_profiling.cc:243] Waited 119 ms on lock 0x7b540029d954. stack: 00007f4a79de9343 00007f4a79de9240 00007f4a797781d4 00007f4a834b6304 00007f4a834b6299 00007f4a7ce71571 00007f4a7cf08e01 00007f4a7cf0783e 00007f4a81ecc419 00007f4a7b443bd4 00007f4a7b443b62 00007f4a7b443a91 00007f4a7b443a0c 00007f4a7b442cc2 00007f4a7b24348c 00007f4a7b2428c6
0709 13:06:56.398289 (+    40us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:56.398394 (+   105us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":23514,"prepare.run_cpu_time_us":52,"prepare.run_wall_time_us":52,"raft.queue_time_us":2310,"raft.run_cpu_time_us":113,"raft.run_wall_time_us":1613,"spinlock_wait_cycles":272958336,"thread_start_us":39900,"threads_started":1,"wal-append.queue_time_us":71794}
I20260709 13:06:56.410897 25411 leader_election.cc:290] T 0e1085d23e8347fbbd5bce7542f4b1f4 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:06:56.412729 20109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e1085d23e8347fbbd5bce7542f4b1f4" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:06:56.360611 25376 raft_consensus.cc:493] T 62c6c134d3d24a1ab144dd9ee6bc3f64 P 0473d2b2d01f4459b1e90fd12cc7840e [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:56.384292 19560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "217b5fae677b4971b3bbd2f357a1f7ff" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:06:56.386993 20078 leader_election.cc:304] T 96efeaaf1057492490e9a621f37e1a2d P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 127766fc592545a4997f7790f50f6076; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:06:56.382206 20105 raft_consensus.cc:1275] T ff9b0eddd810459b82d91c60777c10eb P 127766fc592545a4997f7790f50f6076 [term 17 FOLLOWER]: Refusing update from remote peer 0473d2b2d01f4459b1e90fd12cc7840e: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 13:06:56.427518 19560 raft_consensus.cc:3060] T 217b5fae677b4971b3bbd2f357a1f7ff P e61c3a8f61bb48f8a963c9480e53c168 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:06:56.423960 19478 raft_consensus.cc:2468] T 1a61655d99124a29b486ba4a5b37faea P 0473d2b2d01f4459b1e90fd12cc7840e [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 16.
I20260709 13:06:56.413386 20109 raft_consensus.cc:2468] T 0e1085d23e8347fbbd5bce7542f4b1f4 P 127766fc592545a4997f7790f50f6076 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 13.
I20260709 13:06:56.401841 19477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "172b3dd13109415a955b71ac0e9d2234" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:06:56.427793 20103 raft_consensus.cc:606] T ff9b0eddd810459b82d91c60777c10eb P 127766fc592545a4997f7790f50f6076 [term 17 FOLLOWER]: Received request to transfer leadership to TS 0473d2b2d01f4459b1e90fd12cc7840e
I20260709 13:06:56.429229 19523 leader_election.cc:304] T 0e1085d23e8347fbbd5bce7542f4b1f4 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 127766fc592545a4997f7790f50f6076, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:06:56.429301 20103 raft_consensus.cc:614] T ff9b0eddd810459b82d91c60777c10eb P 127766fc592545a4997f7790f50f6076 [term 17 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:06:56.429481 19485 raft_consensus.cc:2410] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P 0473d2b2d01f4459b1e90fd12cc7840e [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate e5256d91808b47c195bc9b4dbd7f2b87 for term 19 because replica has last-logged OpId of term: 18 index: 15, which is greater than that of the candidate, which has last-logged OpId of term: 17 index: 14.
W20260709 13:06:56.430568 19477 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58294 (request call id 2787) took 1588 ms (client timeout 2064 ms). Trace:
W20260709 13:06:56.431839 20078 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.2:46257, user_credentials={real_user=slave}} blocked reactor thread for 44934.8us
W20260709 13:06:56.431048 19477 rpcz_store.cc:269] 0709 13:06:54.842158 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:55.029550 (+187392us) service_pool.cc:224] Handling call
0709 13:06:56.401678 (+1372128us) spinlock_profiling.cc:243] Waited 1.15 ms on lock 0x7b58001b9998. stack: 00007f4a79de9343 00007f4a79de9240 00007f4a797781d4 00007f4a834b6304 00007f4a834b6299 00007f4a79ca3db1 00007f4a79de3b71 00007f4a79de3a22 00007f4a82cfcc09 00007f4a81e56ee0 00007f4a81f200ab 00007f4a81f20131 00007f4a81ece0a0 00007f4a81ecd984 00007f4a7b4486d4 00007f4a7b448662
0709 13:06:56.430512 (+ 28834us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2641280}
I20260709 13:06:56.440071 19484 raft_consensus.cc:1240] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P 0473d2b2d01f4459b1e90fd12cc7840e [term 19 FOLLOWER]: Rejecting Update request from peer 127766fc592545a4997f7790f50f6076 for earlier term 18. Current term is 19. Ops: []
W20260709 13:06:56.387116 25564 consensus_meta.cc:287] T ab43d85f64114d4ebf618930e43d9ed0 P 127766fc592545a4997f7790f50f6076: Time spent flushing consensus metadata: real 0.575s	user 0.010s	sys 0.000s
I20260709 13:06:56.370263 25093 leader_election.cc:290] T df751f992649444090e27965eb1af85d P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:06:56.447839 19481 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58294 (request call id 2764) took 1912 ms. Trace:
I20260709 13:06:56.471360 19411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85c494af21f9457a85da47b9bc70c1fd" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: true dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
I20260709 13:06:56.472291 19411 raft_consensus.cc:3055] T 85c494af21f9457a85da47b9bc70c1fd P e5256d91808b47c195bc9b4dbd7f2b87 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:06:56.472787 19411 raft_consensus.cc:740] T 85c494af21f9457a85da47b9bc70c1fd P e5256d91808b47c195bc9b4dbd7f2b87 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: e5256d91808b47c195bc9b4dbd7f2b87, State: Running, Role: LEADER
W20260709 13:06:56.454032 19523 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:56.349409 25183 raft_consensus.cc:515] T 6c5eebf646ad445a9d1b1adc319d7b16 P e61c3a8f61bb48f8a963c9480e53c168 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:56.477869 19560 raft_consensus.cc:2468] T 217b5fae677b4971b3bbd2f357a1f7ff P e61c3a8f61bb48f8a963c9480e53c168 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 14.
I20260709 13:06:56.471799 19481 rpcz_store.cc:276] 0709 13:06:54.535009 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:54.536705 (+  1696us) service_pool.cc:224] Handling call
0709 13:06:54.536968 (+   263us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:54.769482 (+232514us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:56.447555 (+1678073us) spinlock_profiling.cc:243] Waited 228 ms on lock 0x7b54000ed654. stack: 00007f4a79de9343 00007f4a79de9240 00007f4a797781d4 00007f4a834b6304 00007f4a834b6299 00007f4a7ce71571 00007f4a7cf08e01 00007f4a7cf0783e 00007f4a81ecc419 00007f4a7b443bd4 00007f4a7b443b62 00007f4a7b443a91 00007f4a7b443a0c 00007f4a7b442cc2 00007f4a7b24348c 00007f4a7b2428c6
0709 13:06:56.447766 (+   211us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":524288896}
I20260709 13:06:56.478816 19553 leader_election.cc:290] T 85c494af21f9457a85da47b9bc70c1fd P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 17 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:06:56.473796 19411 consensus_queue.cc:260] T 85c494af21f9457a85da47b9bc70c1fd P e5256d91808b47c195bc9b4dbd7f2b87 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:56.488610 19411 raft_consensus.cc:3060] T 85c494af21f9457a85da47b9bc70c1fd P e5256d91808b47c195bc9b4dbd7f2b87 [term 15 FOLLOWER]: Advancing to term 17
I20260709 13:06:56.491932 19560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7be9efa6559648dbb5a0f7684c4542d1" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 18 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:06:56.494025 19560 raft_consensus.cc:2468] T 7be9efa6559648dbb5a0f7684c4542d1 P e61c3a8f61bb48f8a963c9480e53c168 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 17.
I20260709 13:06:56.471354 25564 raft_consensus.cc:515] T ab43d85f64114d4ebf618930e43d9ed0 P 127766fc592545a4997f7790f50f6076 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:56.517334 25579 raft_consensus.cc:515] T 833a2f0775ed407a94b8924ce50adb63 P e61c3a8f61bb48f8a963c9480e53c168 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:56.519129 25564 leader_election.cc:290] T ab43d85f64114d4ebf618930e43d9ed0 P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 19 election: Requested vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:06:56.519560 25579 leader_election.cc:290] T 833a2f0775ed407a94b8924ce50adb63 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 14 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:06:56.444872 25445 raft_consensus.cc:2804] T 0e1085d23e8347fbbd5bce7542f4b1f4 P e61c3a8f61bb48f8a963c9480e53c168 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:06:56.591368 25456 raft_consensus.cc:493] T edd7d470b5014c9489be7f41f64355c9 P e61c3a8f61bb48f8a963c9480e53c168 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:56.592049 25456 raft_consensus.cc:515] T edd7d470b5014c9489be7f41f64355c9 P e61c3a8f61bb48f8a963c9480e53c168 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:56.448447 25367 raft_consensus.cc:2749] T 96efeaaf1057492490e9a621f37e1a2d P 127766fc592545a4997f7790f50f6076 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:06:56.370091 25340 consensus_queue.cc:237] T ff75a1d4cb1f493db8f71ddc136ba9ab P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 17.9, Last appended by leader: 9, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:56.619249 19411 raft_consensus.cc:2468] T 85c494af21f9457a85da47b9bc70c1fd P e5256d91808b47c195bc9b4dbd7f2b87 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 17.
W20260709 13:06:56.632512 20077 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:56.632591 19486 raft_consensus.cc:1240] T 48824d5acfbc485ebf8c2d944e7202de P 0473d2b2d01f4459b1e90fd12cc7840e [term 20 LEADER]: Rejecting Update request from peer e61c3a8f61bb48f8a963c9480e53c168 for earlier term 19. Current term is 20. Ops: []
I20260709 13:06:56.488421 25593 raft_consensus.cc:493] T 2e36a9d6e29c4a7c860cf267efbd4c74 P e61c3a8f61bb48f8a963c9480e53c168 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 0473d2b2d01f4459b1e90fd12cc7840e)
W20260709 13:06:56.524691 25435 consensus_meta.cc:287] T 85c494af21f9457a85da47b9bc70c1fd P 127766fc592545a4997f7790f50f6076: Time spent flushing consensus metadata: real 0.730s	user 0.008s	sys 0.002s
I20260709 13:06:56.638795 19551 raft_consensus.cc:1240] T 14935b3ddf914369822e4a0547aaa355 P e61c3a8f61bb48f8a963c9480e53c168 [term 12 FOLLOWER]: Rejecting Update request from peer 0473d2b2d01f4459b1e90fd12cc7840e for earlier term 11. Current term is 12. Ops: [11.10-11.10]
I20260709 13:06:56.441584 25376 raft_consensus.cc:515] T 62c6c134d3d24a1ab144dd9ee6bc3f64 P 0473d2b2d01f4459b1e90fd12cc7840e [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:56.652745 25593 raft_consensus.cc:515] T 2e36a9d6e29c4a7c860cf267efbd4c74 P e61c3a8f61bb48f8a963c9480e53c168 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:56.655606 25593 leader_election.cc:290] T 2e36a9d6e29c4a7c860cf267efbd4c74 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
W20260709 13:06:56.657038 25601 log.cc:927] Time spent T 40e1e16737a842ee936002830f36882e P 0473d2b2d01f4459b1e90fd12cc7840e: Append to log took a long time: real 0.912s	user 0.027s	sys 0.016s
I20260709 13:06:56.475962 25359 consensus_queue.cc:1048] T 5ec1c4ce15e04c7e8c283a62179f2a64 P 127766fc592545a4997f7790f50f6076 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.160s
I20260709 13:06:56.660313 25435 raft_consensus.cc:515] T 85c494af21f9457a85da47b9bc70c1fd P 127766fc592545a4997f7790f50f6076 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:56.661760 20111 raft_consensus.cc:2393] T 85c494af21f9457a85da47b9bc70c1fd P 127766fc592545a4997f7790f50f6076 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate e61c3a8f61bb48f8a963c9480e53c168 in current term 16: Already voted for candidate 127766fc592545a4997f7790f50f6076 in this term.
I20260709 13:06:56.664095 25435 leader_election.cc:290] T 85c494af21f9457a85da47b9bc70c1fd P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 16 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:06:56.664768 20103 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.LeaderStepDown from 127.0.0.1:48686 (request call id 2) took 1743 ms. Trace:
I20260709 13:06:56.665293 20103 rpcz_store.cc:276] 0709 13:06:54.920980 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:54.921137 (+   157us) service_pool.cc:224] Handling call
0709 13:06:56.664520 (+1743383us) spinlock_profiling.cc:243] Waited 1.34 s on lock 0x7b5400507654. stack: 00007f4a79de9343 00007f4a79de9240 00007f4a797781d4 00007f4a834b6304 00007f4a834b6299 00007f4a7ce71571 00007f4a7cf02853 00007f4a81ed060a 00007f4a7b4567d4 00007f4a7b456762 00007f4a7b456691 00007f4a7b45660c 00007f4a7b4558c2 00007f4a7b24348c 00007f4a7b2428c6 00007f4a7b24226f
0709 13:06:56.664655 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3091275520}
I20260709 13:06:56.666265 25456 leader_election.cc:290] T edd7d470b5014c9489be7f41f64355c9 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
W20260709 13:06:56.667344 25631 log.cc:927] Time spent T fa731b585f684a7fb2d106c50f143b83 P 127766fc592545a4997f7790f50f6076: Append to log took a long time: real 0.300s	user 0.001s	sys 0.000s
I20260709 13:06:56.595291 25445 raft_consensus.cc:493] T 0e1085d23e8347fbbd5bce7542f4b1f4 P e61c3a8f61bb48f8a963c9480e53c168 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 127766fc592545a4997f7790f50f6076)
W20260709 13:06:56.671537 19449 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.1:40321, user_credentials={real_user=slave}} blocked reactor thread for 448874us
W20260709 13:06:56.640733 25630 log.cc:927] Time spent T f1b10566f45d4a7d9029858330e02d5b P e61c3a8f61bb48f8a963c9480e53c168: Append to log took a long time: real 0.378s	user 0.001s	sys 0.000s
W20260709 13:06:56.673537 25463 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.913s	user 0.008s	sys 0.024s
I20260709 13:06:56.677340 25551 raft_consensus.cc:493] T 7be9efa6559648dbb5a0f7684c4542d1 P 127766fc592545a4997f7790f50f6076 [term 17 FOLLOWER]: Starting leader election (detected failure of leader e5256d91808b47c195bc9b4dbd7f2b87)
I20260709 13:06:56.672770 25445 raft_consensus.cc:3060] T 0e1085d23e8347fbbd5bce7542f4b1f4 P e61c3a8f61bb48f8a963c9480e53c168 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:06:56.684994 25305 consensus_meta.cc:287] T 70797e5783b5454ab0d0eea663e791e3 P e5256d91808b47c195bc9b4dbd7f2b87: Time spent flushing consensus metadata: real 0.821s	user 0.011s	sys 0.000s
I20260709 13:06:56.689530 25598 raft_consensus.cc:493] T 28af091831594f9d8e96482078cc7625 P e5256d91808b47c195bc9b4dbd7f2b87 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 0473d2b2d01f4459b1e90fd12cc7840e)
I20260709 13:06:56.690091 25598 raft_consensus.cc:515] T 28af091831594f9d8e96482078cc7625 P e5256d91808b47c195bc9b4dbd7f2b87 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:56.691047 19374 leader_election.cc:304] T 4af19371ea874c09a0a2147040835cbb P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87; no voters: 127766fc592545a4997f7790f50f6076, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:06:56.692227 25598 leader_election.cc:290] T 28af091831594f9d8e96482078cc7625 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:06:56.692549 19374 leader_election.cc:304] T 833a2f0775ed407a94b8924ce50adb63 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87; no voters: 127766fc592545a4997f7790f50f6076, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:06:56.693081 25598 raft_consensus.cc:2749] T 4af19371ea874c09a0a2147040835cbb P e5256d91808b47c195bc9b4dbd7f2b87 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:06:56.682412 25551 raft_consensus.cc:3060] T 7be9efa6559648dbb5a0f7684c4542d1 P 127766fc592545a4997f7790f50f6076 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:06:56.694521 25588 raft_consensus.cc:2749] T 833a2f0775ed407a94b8924ce50adb63 P e5256d91808b47c195bc9b4dbd7f2b87 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:06:56.696610 19374 leader_election.cc:304] T 2a16f7501e2444fb86d4e2778e734e02 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87; no voters: 127766fc592545a4997f7790f50f6076, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:06:56.697943 25396 raft_consensus.cc:2749] T 2a16f7501e2444fb86d4e2778e734e02 P e5256d91808b47c195bc9b4dbd7f2b87 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 13:06:56.680043 25463 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.920s	user 0.008s	sys 0.025s
I20260709 13:06:56.700784 19411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70797e5783b5454ab0d0eea663e791e3" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
I20260709 13:06:56.704952 19407 raft_consensus.cc:1275] T 1f85fc4b527a48848e5faa083b604e36 P e5256d91808b47c195bc9b4dbd7f2b87 [term 16 FOLLOWER]: Refusing update from remote peer 127766fc592545a4997f7790f50f6076: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 13:06:56.684738 25537 leader_election.cc:290] T 21e14947d70440f19044d8f75c31e1f9 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:06:56.684844 25462 leader_election.cc:290] T a08760e15aac4630a629431f56024dc8 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:06:56.709555 19406 raft_consensus.cc:1240] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P e5256d91808b47c195bc9b4dbd7f2b87 [term 19 FOLLOWER]: Rejecting Update request from peer 127766fc592545a4997f7790f50f6076 for earlier term 18. Current term is 19. Ops: [18.15-18.15]
I20260709 13:06:56.700450 25305 raft_consensus.cc:515] T 70797e5783b5454ab0d0eea663e791e3 P e5256d91808b47c195bc9b4dbd7f2b87 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:56.723555 25183 leader_election.cc:290] T 6c5eebf646ad445a9d1b1adc319d7b16 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:06:56.714080 25634 raft_consensus.cc:493] T 1efebf73c86e432baa55533136b6e12c P 127766fc592545a4997f7790f50f6076 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 0473d2b2d01f4459b1e90fd12cc7840e)
I20260709 13:06:56.729810 19402 raft_consensus.cc:2368] T 70797e5783b5454ab0d0eea663e791e3 P e5256d91808b47c195bc9b4dbd7f2b87 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e61c3a8f61bb48f8a963c9480e53c168 for earlier term 19. Current term is 20.
I20260709 13:06:56.745604 25183 raft_consensus.cc:493] T b9f0d59553ad444883fcf5b5909f9798 P e61c3a8f61bb48f8a963c9480e53c168 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:56.746161 25183 raft_consensus.cc:515] T b9f0d59553ad444883fcf5b5909f9798 P e61c3a8f61bb48f8a963c9480e53c168 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:56.748684 25183 leader_election.cc:290] T b9f0d59553ad444883fcf5b5909f9798 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
W20260709 13:06:56.749893 19523 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:56.756469 19411 raft_consensus.cc:1240] T ff9b0eddd810459b82d91c60777c10eb P e5256d91808b47c195bc9b4dbd7f2b87 [term 17 FOLLOWER]: Rejecting Update request from peer 127766fc592545a4997f7790f50f6076 for earlier term 16. Current term is 17. Ops: []
I20260709 13:06:56.759006 20103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85c494af21f9457a85da47b9bc70c1fd" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: true dest_uuid: "127766fc592545a4997f7790f50f6076"
I20260709 13:06:56.760200 20109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "833a2f0775ed407a94b8924ce50adb63" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076"
I20260709 13:06:56.760958 25376 leader_election.cc:290] T 62c6c134d3d24a1ab144dd9ee6bc3f64 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:06:56.761763 25548 leader_election.cc:290] T 309c3ca0ca4b4f3ba129752ea2cb293b P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:06:56.762588 20112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c5eebf646ad445a9d1b1adc319d7b16" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:06:56.764880 19486 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58286 (request call id 2557) took 2076 ms. Trace:
I20260709 13:06:56.765240 19410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "833a2f0775ed407a94b8924ce50adb63" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
I20260709 13:06:56.765829 19410 raft_consensus.cc:3060] T 833a2f0775ed407a94b8924ce50adb63 P e5256d91808b47c195bc9b4dbd7f2b87 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:06:56.767609 19552 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40428 (request call id 3176) took 1157 ms. Trace:
W20260709 13:06:56.769268 25580 consensus_meta.cc:287] T ff75a1d4cb1f493db8f71ddc136ba9ab P e5256d91808b47c195bc9b4dbd7f2b87: Time spent flushing consensus metadata: real 0.654s	user 0.007s	sys 0.001s
I20260709 13:06:56.767966 19552 rpcz_store.cc:276] 0709 13:06:55.610528 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:55.610636 (+   108us) service_pool.cc:224] Handling call
0709 13:06:55.610913 (+   277us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:56.272583 (+661670us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:56.767404 (+494821us) spinlock_profiling.cc:243] Waited 661 ms on lock 0x7b5400125054. stack: 00007f4a79de9343 00007f4a79de9240 00007f4a797781d4 00007f4a834b6304 00007f4a834b6299 00007f4a7ce71571 00007f4a7cf08e01 00007f4a7cf0783e 00007f4a81ecc419 00007f4a7b443bd4 00007f4a7b443b62 00007f4a7b443a91 00007f4a7b443a0c 00007f4a7b442cc2 00007f4a7b24348c 00007f4a7b2428c6
0709 13:06:56.767555 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1519770496}
I20260709 13:06:56.768185 25551 raft_consensus.cc:515] T 7be9efa6559648dbb5a0f7684c4542d1 P 127766fc592545a4997f7790f50f6076 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } attrs { replace: true } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:56.771975 19555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab43d85f64114d4ebf618930e43d9ed0" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:06:56.772182 19552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28af091831594f9d8e96482078cc7625" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:06:56.772759 19555 raft_consensus.cc:3060] T ab43d85f64114d4ebf618930e43d9ed0 P e61c3a8f61bb48f8a963c9480e53c168 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:06:56.773583 19552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df751f992649444090e27965eb1af85d" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:06:56.776868 19552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85c494af21f9457a85da47b9bc70c1fd" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:06:56.777060 19408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e36a9d6e29c4a7c860cf267efbd4c74" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:06:56.778612 19552 raft_consensus.cc:1275] T 0cdf56e38bbc453d9438d359e5a69955 P e61c3a8f61bb48f8a963c9480e53c168 [term 17 FOLLOWER]: Refusing update from remote peer e5256d91808b47c195bc9b4dbd7f2b87: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 13:06:56.781208 19409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edd7d470b5014c9489be7f41f64355c9" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 21 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:06:56.765236 19486 rpcz_store.cc:276] 0709 13:06:54.688652 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:55.544844 (+856192us) service_pool.cc:224] Handling call
0709 13:06:55.545178 (+   334us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:56.633626 (+1088448us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:56.764689 (+131063us) spinlock_profiling.cc:243] Waited 1.09 s on lock 0x7b54002b8ed4. stack: 00007f4a79de9343 00007f4a79de9240 00007f4a797781d4 00007f4a834b6304 00007f4a834b6299 00007f4a7ce71571 00007f4a7cf08e01 00007f4a7cf0783e 00007f4a81ecc419 00007f4a7b443bd4 00007f4a7b443b62 00007f4a7b443a91 00007f4a7b443a0c 00007f4a7b442cc2 00007f4a7b24348c 00007f4a7b2428c6
0709 13:06:56.764829 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2500415232}
I20260709 13:06:56.781870 19409 raft_consensus.cc:2468] T edd7d470b5014c9489be7f41f64355c9 P e5256d91808b47c195bc9b4dbd7f2b87 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 20.
I20260709 13:06:56.784440 25305 leader_election.cc:290] T 70797e5783b5454ab0d0eea663e791e3 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 20 election: Requested vote from peers e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
W20260709 13:06:56.784644 25639 log.cc:927] Time spent T 48824d5acfbc485ebf8c2d944e7202de P 0473d2b2d01f4459b1e90fd12cc7840e: Append to log took a long time: real 0.128s	user 0.002s	sys 0.000s
W20260709 13:06:56.785975 25553 consensus_meta.cc:287] T 65d8cb8d6ec64f459d5a47cefab10acf P e61c3a8f61bb48f8a963c9480e53c168: Time spent flushing consensus metadata: real 0.827s	user 0.008s	sys 0.005s
I20260709 13:06:56.786405 25553 raft_consensus.cc:515] T 65d8cb8d6ec64f459d5a47cefab10acf P e61c3a8f61bb48f8a963c9480e53c168 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:56.788450 25553 leader_election.cc:290] T 65d8cb8d6ec64f459d5a47cefab10acf P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 19 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
W20260709 13:06:56.789793 25641 log.cc:927] Time spent T 46c5bfeecc314717bffe987e6844b6d0 P e61c3a8f61bb48f8a963c9480e53c168: Append to log took a long time: real 0.060s	user 0.000s	sys 0.001s
I20260709 13:06:56.791182 19557 raft_consensus.cc:1240] T 65d8cb8d6ec64f459d5a47cefab10acf P e61c3a8f61bb48f8a963c9480e53c168 [term 19 FOLLOWER]: Rejecting Update request from peer 127766fc592545a4997f7790f50f6076 for earlier term 18. Current term is 19. Ops: []
I20260709 13:06:56.795766 25586 consensus_queue.cc:260] T e381f1d6b8184797ad142de49be225a8 P e5256d91808b47c195bc9b4dbd7f2b87 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:56.796797 25586 raft_consensus.cc:3060] T e381f1d6b8184797ad142de49be225a8 P e5256d91808b47c195bc9b4dbd7f2b87 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:06:56.797271 19555 raft_consensus.cc:2468] T ab43d85f64114d4ebf618930e43d9ed0 P e61c3a8f61bb48f8a963c9480e53c168 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 127766fc592545a4997f7790f50f6076 in term 19.
I20260709 13:06:56.798636 19410 raft_consensus.cc:2468] T 833a2f0775ed407a94b8924ce50adb63 P e5256d91808b47c195bc9b4dbd7f2b87 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 14.
I20260709 13:06:56.798211 19555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70797e5783b5454ab0d0eea663e791e3" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:06:56.801900 19555 raft_consensus.cc:3060] T 70797e5783b5454ab0d0eea663e791e3 P e61c3a8f61bb48f8a963c9480e53c168 [term 18 FOLLOWER]: Advancing to term 20
I20260709 13:06:56.805712 20109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70797e5783b5454ab0d0eea663e791e3" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076"
I20260709 13:06:56.810175 20109 raft_consensus.cc:3060] T 70797e5783b5454ab0d0eea663e791e3 P 127766fc592545a4997f7790f50f6076 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:06:56.803179 20076 leader_election.cc:304] T ab43d85f64114d4ebf618930e43d9ed0 P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 127766fc592545a4997f7790f50f6076, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:06:56.819149 20106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65d8cb8d6ec64f459d5a47cefab10acf" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076"
I20260709 13:06:56.820515 20112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "309c3ca0ca4b4f3ba129752ea2cb293b" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:06:56.805258 19523 leader_election.cc:304] T 46c5bfeecc314717bffe987e6844b6d0 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:06:56.808061 19407 raft_consensus.cc:1240] T 1a61655d99124a29b486ba4a5b37faea P e5256d91808b47c195bc9b4dbd7f2b87 [term 16 FOLLOWER]: Rejecting Update request from peer e61c3a8f61bb48f8a963c9480e53c168 for earlier term 15. Current term is 16. Ops: []
I20260709 13:06:56.731739 25634 raft_consensus.cc:515] T 1efebf73c86e432baa55533136b6e12c P 127766fc592545a4997f7790f50f6076 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:56.824911 25634 leader_election.cc:290] T 1efebf73c86e432baa55533136b6e12c P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:06:56.822309 19523 leader_election.cc:304] T 7be9efa6559648dbb5a0f7684c4542d1 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: e61c3a8f61bb48f8a963c9480e53c168; no voters: 127766fc592545a4997f7790f50f6076, e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:06:56.825937 25183 raft_consensus.cc:2804] T 46c5bfeecc314717bffe987e6844b6d0 P e61c3a8f61bb48f8a963c9480e53c168 [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 13:06:56.826493 25183 raft_consensus.cc:493] T 46c5bfeecc314717bffe987e6844b6d0 P e61c3a8f61bb48f8a963c9480e53c168 [term 23 FOLLOWER]: Starting leader election (detected failure of leader 0473d2b2d01f4459b1e90fd12cc7840e)
I20260709 13:06:56.827028 25183 raft_consensus.cc:3060] T 46c5bfeecc314717bffe987e6844b6d0 P e61c3a8f61bb48f8a963c9480e53c168 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:06:56.829772 19523 leader_election.cc:304] T 85c494af21f9457a85da47b9bc70c1fd P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168; no voters: 127766fc592545a4997f7790f50f6076
I20260709 13:06:56.831482 25052 raft_consensus.cc:2804] T 85c494af21f9457a85da47b9bc70c1fd P e61c3a8f61bb48f8a963c9480e53c168 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:06:56.831785 19407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65d8cb8d6ec64f459d5a47cefab10acf" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
I20260709 13:06:56.831879 19523 leader_election.cc:304] T edd7d470b5014c9489be7f41f64355c9 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:06:56.831969 25052 raft_consensus.cc:697] T 85c494af21f9457a85da47b9bc70c1fd P e61c3a8f61bb48f8a963c9480e53c168 [term 17 LEADER]: Becoming Leader. State: Replica: e61c3a8f61bb48f8a963c9480e53c168, State: Running, Role: LEADER
I20260709 13:06:56.834206 25052 consensus_queue.cc:237] T 85c494af21f9457a85da47b9bc70c1fd P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:56.819084 25611 raft_consensus.cc:2804] T ab43d85f64114d4ebf618930e43d9ed0 P 127766fc592545a4997f7790f50f6076 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:06:56.839718 25611 raft_consensus.cc:697] T ab43d85f64114d4ebf618930e43d9ed0 P 127766fc592545a4997f7790f50f6076 [term 19 LEADER]: Becoming Leader. State: Replica: 127766fc592545a4997f7790f50f6076, State: Running, Role: LEADER
I20260709 13:06:56.840808 25611 consensus_queue.cc:237] T ab43d85f64114d4ebf618930e43d9ed0 P 127766fc592545a4997f7790f50f6076 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 18.12, Last appended by leader: 12, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
W20260709 13:06:56.845690 19375 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:56.846251 19409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9f0d59553ad444883fcf5b5909f9798" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:06:56.846292 19523 leader_election.cc:304] T 833a2f0775ed407a94b8924ce50adb63 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168; no voters: 127766fc592545a4997f7790f50f6076
I20260709 13:06:56.850340 25593 raft_consensus.cc:2804] T 833a2f0775ed407a94b8924ce50adb63 P e61c3a8f61bb48f8a963c9480e53c168 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:06:56.850860 25593 raft_consensus.cc:697] T 833a2f0775ed407a94b8924ce50adb63 P e61c3a8f61bb48f8a963c9480e53c168 [term 14 LEADER]: Becoming Leader. State: Replica: e61c3a8f61bb48f8a963c9480e53c168, State: Running, Role: LEADER
I20260709 13:06:56.851711 25593 consensus_queue.cc:237] T 833a2f0775ed407a94b8924ce50adb63 P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:56.852618 19553 raft_consensus.cc:1240] T e381f1d6b8184797ad142de49be225a8 P e61c3a8f61bb48f8a963c9480e53c168 [term 15 FOLLOWER]: Rejecting Update request from peer e5256d91808b47c195bc9b4dbd7f2b87 for earlier term 14. Current term is 15. Ops: []
W20260709 13:06:56.853842 19376 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:56.854111 20104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff9b0eddd810459b82d91c60777c10eb" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:06:56.857074 19557 raft_consensus.cc:1275] T 14935b3ddf914369822e4a0547aaa355 P e61c3a8f61bb48f8a963c9480e53c168 [term 12 FOLLOWER]: Refusing update from remote peer 127766fc592545a4997f7790f50f6076: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:06:56.795053 25305 consensus_queue.cc:1048] T 0cdf56e38bbc453d9438d359e5a69955 P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.050s
I20260709 13:06:56.862329 25610 raft_consensus.cc:2804] T edd7d470b5014c9489be7f41f64355c9 P e61c3a8f61bb48f8a963c9480e53c168 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:06:56.871546 20105 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46436 (request call id 958) took 1658 ms. Trace:
I20260709 13:06:56.872014 20105 rpcz_store.cc:276] 0709 13:06:55.212980 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:55.213146 (+   166us) service_pool.cc:224] Handling call
0709 13:06:55.247358 (+ 34212us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:56.427647 (+1180289us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:56.868758 (+441111us) spinlock_profiling.cc:243] Waited 1.13 s on lock 0x7b5400507654. stack: 00007f4a79de9343 00007f4a79de9240 00007f4a797781d4 00007f4a834b6304 00007f4a834b6299 00007f4a7ce71571 00007f4a7cf08e01 00007f4a7cf0783e 00007f4a81ecc419 00007f4a7b443bd4 00007f4a7b443b62 00007f4a7b443a91 00007f4a7b443a0c 00007f4a7b442cc2 00007f4a7b24348c 00007f4a7b2428c6
0709 13:06:56.871484 (+  2726us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2609118592}
I20260709 13:06:56.892899 19555 raft_consensus.cc:2468] T 70797e5783b5454ab0d0eea663e791e3 P e61c3a8f61bb48f8a963c9480e53c168 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 20.
I20260709 13:06:56.862259 25456 consensus_queue.cc:1059] T 1a61655d99124a29b486ba4a5b37faea P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.031s
I20260709 13:06:56.887393 25565 consensus_queue.cc:1048] T 14935b3ddf914369822e4a0547aaa355 P 127766fc592545a4997f7790f50f6076 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.011s
I20260709 13:06:56.898380 20108 raft_consensus.cc:1240] T 85c494af21f9457a85da47b9bc70c1fd P 127766fc592545a4997f7790f50f6076 [term 16 FOLLOWER]: Rejecting Update request from peer e5256d91808b47c195bc9b4dbd7f2b87 for earlier term 15. Current term is 16. Ops: []
I20260709 13:06:56.899904 25551 leader_election.cc:290] T 7be9efa6559648dbb5a0f7684c4542d1 P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 18 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:06:56.867395 25610 raft_consensus.cc:493] T edd7d470b5014c9489be7f41f64355c9 P e61c3a8f61bb48f8a963c9480e53c168 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:56.923091 19375 leader_election.cc:304] T 70797e5783b5454ab0d0eea663e791e3 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:06:56.890683 19523 leader_election.cc:304] T 309c3ca0ca4b4f3ba129752ea2cb293b P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: e61c3a8f61bb48f8a963c9480e53c168; no voters: 127766fc592545a4997f7790f50f6076, e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:06:56.930599 20109 raft_consensus.cc:2468] T 70797e5783b5454ab0d0eea663e791e3 P 127766fc592545a4997f7790f50f6076 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 20.
I20260709 13:06:56.975899 19555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1efebf73c86e432baa55533136b6e12c" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
W20260709 13:06:56.980543 19375 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.3:36891, user_credentials={real_user=slave}} blocked reactor thread for 57567.7us
I20260709 13:06:56.867528 25634 consensus_queue.cc:1059] T 65d8cb8d6ec64f459d5a47cefab10acf P 127766fc592545a4997f7790f50f6076 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 }, Status: INVALID_TERM, Last received: 18.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.057s
W20260709 13:06:56.989993 19523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.4:43121, user_credentials={real_user=slave}} blocked reactor thread for 99440.3us
I20260709 13:06:56.999634 19555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7be9efa6559648dbb5a0f7684c4542d1" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:06:57.008384 19405 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52328 (request call id 2497) took 1132 ms. Trace:
I20260709 13:06:57.008880 19405 rpcz_store.cc:276] 0709 13:06:55.875919 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:55.876066 (+   147us) service_pool.cc:224] Handling call
0709 13:06:55.876350 (+   284us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:55.876544 (+   194us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:55.876567 (+    23us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:55.876990 (+   423us) log.cc:844] Serialized 26 byte log entry
0709 13:06:56.044738 (+167748us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:06:57.007625 (+962887us) spinlock_profiling.cc:243] Waited 5.69 ms on lock 0x7b1800337540. stack: 00007f4a79de9343 00007f4a79de9240 00007f4a797781d4 00007f4a834b6304 00007f4a834b6299 00007f4a82ce3de1 00007f4a82cf05b1 00007f4a7cab04bc 00007f4a79dfe48b 00007f4a82c58ab9 00007f4a79e1a69b 00007f4a79e1893f 00007f4a79e18455 00007f4a809003c7 00007f4a7cf129a7 00007f4a7cf220bf
0709 13:06:57.007788 (+   163us) log.cc:844] Serialized 14 byte log entry
0709 13:06:57.008035 (+   247us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:57.008100 (+    65us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:57.008137 (+    37us) raft_consensus.cc:1685] finished
0709 13:06:57.008204 (+    67us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:57.008327 (+   123us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":233448,"prepare.run_cpu_time_us":42,"prepare.run_wall_time_us":43,"spinlock_wait_cycles":13086464,"thread_start_us":238277,"threads_started":2,"wal-append.queue_time_us":302154}
I20260709 13:06:57.018884 25411 raft_consensus.cc:2749] T 309c3ca0ca4b4f3ba129752ea2cb293b P e61c3a8f61bb48f8a963c9480e53c168 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:06:57.019232 20107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "775c229504194560ba9589bc2199b089" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:06:57.021211 25345 raft_consensus.cc:3060] T 0cdf56e38bbc453d9438d359e5a69955 P 0473d2b2d01f4459b1e90fd12cc7840e [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:06:57.023449 19559 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40428 (request call id 3175) took 1415 ms. Trace:
I20260709 13:06:57.023850 19559 rpcz_store.cc:276] 0709 13:06:55.608452 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:55.608670 (+   218us) service_pool.cc:224] Handling call
0709 13:06:57.023231 (+1414561us) spinlock_profiling.cc:243] Waited 103 ms on lock 0x7b540012aa54. stack: 00007f4a79de9343 00007f4a79de9240 00007f4a797781d4 00007f4a834b6304 00007f4a834b6299 00007f4a7ce71571 00007f4a7cf0c2fa 00007f4a81ecdb17 00007f4a7b4486d4 00007f4a7b448662 00007f4a7b448591 00007f4a7b44850c 00007f4a7b4477c2 00007f4a7b24348c 00007f4a7b2428c6 00007f4a7b24226f
0709 13:06:57.023359 (+   128us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":236148992}
I20260709 13:06:57.026391 19558 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40438 (request call id 2977) took 1121 ms. Trace:
I20260709 13:06:56.994819 25521 raft_consensus.cc:493] T 4509b76741dc428e9201c70c1658da13 P e61c3a8f61bb48f8a963c9480e53c168 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:57.027172 25521 raft_consensus.cc:515] T 4509b76741dc428e9201c70c1658da13 P e61c3a8f61bb48f8a963c9480e53c168 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:57.029243 25521 leader_election.cc:290] T 4509b76741dc428e9201c70c1658da13 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:06:57.030189 19402 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52328 (request call id 2495) took 1160 ms. Trace:
I20260709 13:06:57.030570 19402 rpcz_store.cc:276] 0709 13:06:55.869443 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:55.869557 (+   114us) service_pool.cc:224] Handling call
0709 13:06:57.030001 (+1160444us) spinlock_profiling.cc:243] Waited 859 ms on lock 0x7b54000b2cd4. stack: 00007f4a79de9343 00007f4a79de9240 00007f4a797781d4 00007f4a834b6304 00007f4a834b6299 00007f4a7ce71571 00007f4a7cf0c2fa 00007f4a81ecdb17 00007f4a7b4486d4 00007f4a7b448662 00007f4a7b448591 00007f4a7b44850c 00007f4a7b4477c2 00007f4a7b24348c 00007f4a7b2428c6 00007f4a7b24226f
0709 13:06:57.030134 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1975883008}
W20260709 13:06:56.979259 25578 consensus_meta.cc:287] T 48824d5acfbc485ebf8c2d944e7202de P e61c3a8f61bb48f8a963c9480e53c168: Time spent flushing consensus metadata: real 0.612s	user 0.006s	sys 0.006s
I20260709 13:06:56.978888 25610 raft_consensus.cc:3060] T edd7d470b5014c9489be7f41f64355c9 P e61c3a8f61bb48f8a963c9480e53c168 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:06:57.026826 19558 rpcz_store.cc:276] 0709 13:06:55.905342 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:56.065616 (+160274us) service_pool.cc:224] Handling call
0709 13:06:57.024766 (+959150us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:57.024972 (+   206us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:57.025004 (+    32us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:57.025049 (+    45us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:06:57.025085 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:57.025146 (+    61us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:57.026206 (+  1060us) spinlock_profiling.cc:243] Waited 959 ms on lock 0x7b540012aa50. stack: 00007f4a79de9343 00007f4a79de9240 00007f4a797781d4 00007f4a834b6304 00007f4a834b6299 00007f4a7ce71571 00007f4a7cf078ad 00007f4a81ecc419 00007f4a7b443bd4 00007f4a7b443b62 00007f4a7b443a91 00007f4a7b443a0c 00007f4a7b442cc2 00007f4a7b24348c 00007f4a7b2428c6 00007f4a7b24226f
0709 13:06:57.026329 (+   123us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2205025536}
I20260709 13:06:56.990510 25580 raft_consensus.cc:2804] T 70797e5783b5454ab0d0eea663e791e3 P e5256d91808b47c195bc9b4dbd7f2b87 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:06:56.984222 25456 raft_consensus.cc:493] T d1e5873a19244c5ebbcd38e126796ee7 P e61c3a8f61bb48f8a963c9480e53c168 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:57.067441 19402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4509b76741dc428e9201c70c1658da13" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:06:57.069144 19523 leader_election.cc:400] T 70797e5783b5454ab0d0eea663e791e3 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 19 pre-election: Vote denied by peer e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321) with higher term. Message: Invalid argument: T 70797e5783b5454ab0d0eea663e791e3 P e5256d91808b47c195bc9b4dbd7f2b87 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e61c3a8f61bb48f8a963c9480e53c168 for earlier term 19. Current term is 20.
I20260709 13:06:57.093796 19523 leader_election.cc:403] T 70797e5783b5454ab0d0eea663e791e3 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 19 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:06:57.094441 24700 raft_consensus.cc:2749] T 70797e5783b5454ab0d0eea663e791e3 P e61c3a8f61bb48f8a963c9480e53c168 [term 20 FOLLOWER]: Leader pre-election lost for term 19. Reason: Vote denied by peer e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321) with higher term. Message: Invalid argument: T 70797e5783b5454ab0d0eea663e791e3 P e5256d91808b47c195bc9b4dbd7f2b87 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e61c3a8f61bb48f8a963c9480e53c168 for earlier term 19. Current term is 20.
I20260709 13:06:57.093858 19402 raft_consensus.cc:2468] T 4509b76741dc428e9201c70c1658da13 P e5256d91808b47c195bc9b4dbd7f2b87 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 11.
I20260709 13:06:57.103809 19523 leader_election.cc:304] T 4509b76741dc428e9201c70c1658da13 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:06:57.141084 25086 raft_consensus.cc:2804] T 4509b76741dc428e9201c70c1658da13 P e61c3a8f61bb48f8a963c9480e53c168 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:06:57.039816 25548 raft_consensus.cc:2749] T 7be9efa6559648dbb5a0f7684c4542d1 P e61c3a8f61bb48f8a963c9480e53c168 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:06:57.148196 19402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85c494af21f9457a85da47b9bc70c1fd" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
I20260709 13:06:57.154810 19402 raft_consensus.cc:2368] T 85c494af21f9457a85da47b9bc70c1fd P e5256d91808b47c195bc9b4dbd7f2b87 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 127766fc592545a4997f7790f50f6076 for earlier term 16. Current term is 17.
I20260709 13:06:57.155772 24700 raft_consensus.cc:493] T 0afb57ae58a24a01850491d69f0213dd P e61c3a8f61bb48f8a963c9480e53c168 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 0473d2b2d01f4459b1e90fd12cc7840e)
I20260709 13:06:57.156489 24700 raft_consensus.cc:515] T 0afb57ae58a24a01850491d69f0213dd P e61c3a8f61bb48f8a963c9480e53c168 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
W20260709 13:06:57.180224 19374 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:57.180831 19374 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:57.088495 25599 raft_consensus.cc:493] T f93ee515a9c14139bf566522ed8232f3 P e61c3a8f61bb48f8a963c9480e53c168 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:57.087247 25578 raft_consensus.cc:493] T 179fd671030940b4b4a4e24bcc4aba0a P e61c3a8f61bb48f8a963c9480e53c168 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 0473d2b2d01f4459b1e90fd12cc7840e)
I20260709 13:06:57.191767 20075 leader_election.cc:304] T 70797e5783b5454ab0d0eea663e791e3 P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 127766fc592545a4997f7790f50f6076; no voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:06:57.194389 19405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7be9efa6559648dbb5a0f7684c4542d1" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
I20260709 13:06:57.196717 19406 raft_consensus.cc:1275] T 5ec1c4ce15e04c7e8c283a62179f2a64 P e5256d91808b47c195bc9b4dbd7f2b87 [term 12 FOLLOWER]: Refusing update from remote peer 127766fc592545a4997f7790f50f6076: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 13:06:57.130806 25580 raft_consensus.cc:697] T 70797e5783b5454ab0d0eea663e791e3 P e5256d91808b47c195bc9b4dbd7f2b87 [term 20 LEADER]: Becoming Leader. State: Replica: e5256d91808b47c195bc9b4dbd7f2b87, State: Running, Role: LEADER
I20260709 13:06:57.231786 19409 raft_consensus.cc:1240] T 833a2f0775ed407a94b8924ce50adb63 P e5256d91808b47c195bc9b4dbd7f2b87 [term 14 FOLLOWER]: Rejecting Update request from peer 127766fc592545a4997f7790f50f6076 for earlier term 13. Current term is 14. Ops: []
I20260709 13:06:57.154068 25086 raft_consensus.cc:493] T 4509b76741dc428e9201c70c1658da13 P e61c3a8f61bb48f8a963c9480e53c168 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:57.120149 25456 raft_consensus.cc:515] T d1e5873a19244c5ebbcd38e126796ee7 P e61c3a8f61bb48f8a963c9480e53c168 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:57.260090 24700 leader_election.cc:290] T 0afb57ae58a24a01850491d69f0213dd P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:06:57.263304 19377 leader_election.cc:304] T 76cb037fc9064d13b59a8969d897ce8c P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87; no voters: e61c3a8f61bb48f8a963c9480e53c168
W20260709 13:06:57.264204 19554 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40428 (request call id 3178) took 1647 ms (client timeout 1679 ms). Trace:
W20260709 13:06:57.264621 19554 rpcz_store.cc:269] 0709 13:06:55.616421 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:55.616542 (+   121us) service_pool.cc:224] Handling call
0709 13:06:57.264046 (+1647504us) spinlock_profiling.cc:243] Waited 214 ms on lock 0x7b54000df554. stack: 00007f4a79de9343 00007f4a79de9240 00007f4a797781d4 00007f4a834b6304 00007f4a834b6299 00007f4a7ce71571 00007f4a7cf0c2fa 00007f4a81ecdb17 00007f4a7b4486d4 00007f4a7b448662 00007f4a7b448591 00007f4a7b44850c 00007f4a7b4477c2 00007f4a7b24348c 00007f4a7b2428c6 00007f4a7b24226f
0709 13:06:57.264149 (+   103us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":493214080}
I20260709 13:06:57.209221 25634 raft_consensus.cc:493] T ff9b0eddd810459b82d91c60777c10eb P 127766fc592545a4997f7790f50f6076 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:57.205346 25521 raft_consensus.cc:493] T 1efebf73c86e432baa55533136b6e12c P e61c3a8f61bb48f8a963c9480e53c168 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 0473d2b2d01f4459b1e90fd12cc7840e)
I20260709 13:06:57.216837 25615 raft_consensus.cc:2749] T 70797e5783b5454ab0d0eea663e791e3 P 127766fc592545a4997f7790f50f6076 [term 20 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:06:57.232906 25411 raft_consensus.cc:493] T 2b74109013a140ada21feeef92d6f563 P e61c3a8f61bb48f8a963c9480e53c168 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:57.257251 25086 raft_consensus.cc:3060] T 4509b76741dc428e9201c70c1658da13 P e61c3a8f61bb48f8a963c9480e53c168 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:06:57.286118 19558 raft_consensus.cc:1275] T d1e5873a19244c5ebbcd38e126796ee7 P e61c3a8f61bb48f8a963c9480e53c168 [term 20 FOLLOWER]: Refusing update from remote peer e5256d91808b47c195bc9b4dbd7f2b87: Log matching property violated. Preceding OpId in replica: term: 19 index: 10. Preceding OpId from leader: term: 20 index: 10. (term mismatch)
I20260709 13:06:57.288167 19558 pending_rounds.cc:85] T d1e5873a19244c5ebbcd38e126796ee7 P e61c3a8f61bb48f8a963c9480e53c168: Aborting all ops after (but not including) 9
I20260709 13:06:57.288496 19558 pending_rounds.cc:107] T d1e5873a19244c5ebbcd38e126796ee7 P e61c3a8f61bb48f8a963c9480e53c168: Aborting uncommitted NO_OP operation due to leader change: 19.10
I20260709 13:06:57.288790 19558 raft_consensus.cc:2889] T d1e5873a19244c5ebbcd38e126796ee7 P e61c3a8f61bb48f8a963c9480e53c168 [term 20 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:06:57.200244 25445 raft_consensus.cc:515] T 0e1085d23e8347fbbd5bce7542f4b1f4 P e61c3a8f61bb48f8a963c9480e53c168 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:57.293372 19377 leader_election.cc:304] T 1dc5b3532fe54f74876d02beffa2c230 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87; no voters: e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:06:57.208935 25599 raft_consensus.cc:515] T f93ee515a9c14139bf566522ed8232f3 P e61c3a8f61bb48f8a963c9480e53c168 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:57.231016 25535 consensus_queue.cc:1048] T 1f85fc4b527a48848e5faa083b604e36 P 127766fc592545a4997f7790f50f6076 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.050s
I20260709 13:06:57.279102 25093 raft_consensus.cc:2804] T 76cb037fc9064d13b59a8969d897ce8c P e5256d91808b47c195bc9b4dbd7f2b87 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:06:57.219054 25578 raft_consensus.cc:515] T 179fd671030940b4b4a4e24bcc4aba0a P e61c3a8f61bb48f8a963c9480e53c168 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:57.244127 25551 consensus_queue.cc:1059] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P 127766fc592545a4997f7790f50f6076 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 }, Status: INVALID_TERM, Last received: 17.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.040s
W20260709 13:06:57.300791 19552 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.519s	user 0.004s	sys 0.013s
W20260709 13:06:57.326364 19552 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.545s	user 0.005s	sys 0.013s
I20260709 13:06:57.290050 25411 raft_consensus.cc:515] T 2b74109013a140ada21feeef92d6f563 P e61c3a8f61bb48f8a963c9480e53c168 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:57.284058 25521 raft_consensus.cc:515] T 1efebf73c86e432baa55533136b6e12c P e61c3a8f61bb48f8a963c9480e53c168 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
W20260709 13:06:57.322270 19375 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:57.297786 25090 raft_consensus.cc:2804] T 1dc5b3532fe54f74876d02beffa2c230 P e5256d91808b47c195bc9b4dbd7f2b87 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:06:57.282660 25634 raft_consensus.cc:515] T ff9b0eddd810459b82d91c60777c10eb P 127766fc592545a4997f7790f50f6076 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
W20260709 13:06:57.312386 25598 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.524s	user 0.004s	sys 0.027s
I20260709 13:06:57.358713 25359 raft_consensus.cc:3055] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P 127766fc592545a4997f7790f50f6076 [term 18 LEADER]: Stepping down as leader of term 18
W20260709 13:06:57.362968 19450 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.3:36891, user_credentials={real_user=slave}} blocked reactor thread for 974446us
I20260709 13:06:57.364715 25056 raft_consensus.cc:493] T 5ec1c4ce15e04c7e8c283a62179f2a64 P e5256d91808b47c195bc9b4dbd7f2b87 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:57.368184 25311 raft_consensus.cc:493] T ef32ce6fdd0e40d382c79974f30295c6 P 0473d2b2d01f4459b1e90fd12cc7840e [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:57.368870 25623 raft_consensus.cc:493] T 4509b76741dc428e9201c70c1658da13 P 0473d2b2d01f4459b1e90fd12cc7840e [term 10 FOLLOWER]: Starting pre-election (detected failure of leader e5256d91808b47c195bc9b4dbd7f2b87)
W20260709 13:06:57.376080 25598 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.586s	user 0.005s	sys 0.028s
W20260709 13:06:57.369627 19449 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.1:40321, user_credentials={real_user=slave}} blocked reactor thread for 696847us
I20260709 13:06:57.394068 19449 leader_election.cc:304] T 3e1f505cb0f1427bbd698ac889d80821 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e; no voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:06:57.313504 25590 consensus_queue.cc:1048] T 7be9efa6559648dbb5a0f7684c4542d1 P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.028s
I20260709 13:06:57.323997 25520 raft_consensus.cc:493] T 0cdf56e38bbc453d9438d359e5a69955 P 0473d2b2d01f4459b1e90fd12cc7840e [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:06:57.379611 19526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.2:46257, user_credentials={real_user=slave}} blocked reactor thread for 487981us
I20260709 13:06:57.369093 25097 raft_consensus.cc:493] T 86a6797bdfe94fa496c050ceae4bd0d9 P 0473d2b2d01f4459b1e90fd12cc7840e [term 14 FOLLOWER]: Starting pre-election (detected failure of leader e61c3a8f61bb48f8a963c9480e53c168)
I20260709 13:06:57.368805 25237 raft_consensus.cc:493] T b08304a0a02b42d7840c4e8ee9a6bd1a P 0473d2b2d01f4459b1e90fd12cc7840e [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:06:57.389609 19408 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.582s	user 0.003s	sys 0.026s
W20260709 13:06:57.452072 19408 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.644s	user 0.004s	sys 0.026s
I20260709 13:06:57.347792 25090 raft_consensus.cc:493] T 1dc5b3532fe54f74876d02beffa2c230 P e5256d91808b47c195bc9b4dbd7f2b87 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:57.348803 25304 raft_consensus.cc:493] T 179fd671030940b4b4a4e24bcc4aba0a P e5256d91808b47c195bc9b4dbd7f2b87 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 0473d2b2d01f4459b1e90fd12cc7840e)
W20260709 13:06:57.403293 19376 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:57.453439 18300 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
W20260709 13:06:57.453233 19450 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.3:36891, user_credentials={real_user=slave}} blocked reactor thread for 76005.5us
I20260709 13:06:57.376739 25359 raft_consensus.cc:740] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P 127766fc592545a4997f7790f50f6076 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 127766fc592545a4997f7790f50f6076, State: Running, Role: LEADER
I20260709 13:06:57.451705 24700 raft_consensus.cc:493] T 28af091831594f9d8e96482078cc7625 P e61c3a8f61bb48f8a963c9480e53c168 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 0473d2b2d01f4459b1e90fd12cc7840e)
W20260709 13:06:57.454680 19449 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.1:40321, user_credentials={real_user=slave}} blocked reactor thread for 60714.8us
I20260709 13:06:57.473307 24700 raft_consensus.cc:515] T 28af091831594f9d8e96482078cc7625 P e61c3a8f61bb48f8a963c9480e53c168 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:57.340735 25610 raft_consensus.cc:515] T edd7d470b5014c9489be7f41f64355c9 P e61c3a8f61bb48f8a963c9480e53c168 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:57.473001 19450 leader_election.cc:304] T 217b5fae677b4971b3bbd2f357a1f7ff P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:06:57.314239 25580 consensus_queue.cc:237] T 70797e5783b5454ab0d0eea663e791e3 P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 18.13, Last appended by leader: 13, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:57.475175 19411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e5873a19244c5ebbcd38e126796ee7" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 21 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:06:57.474542 19449 leader_election.cc:304] T 1dc5b3532fe54f74876d02beffa2c230 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87; no voters: e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:06:57.455870 25237 raft_consensus.cc:515] T b08304a0a02b42d7840c4e8ee9a6bd1a P 0473d2b2d01f4459b1e90fd12cc7840e [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:57.477733 19450 leader_election.cc:304] T 7f575b143b844aa096b50997dad3516a P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168; no voters: e5256d91808b47c195bc9b4dbd7f2b87
W20260709 13:06:57.474776 19523 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:57.454377 25052 raft_consensus.cc:493] T ff75a1d4cb1f493db8f71ddc136ba9ab P e61c3a8f61bb48f8a963c9480e53c168 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:57.443194 25598 raft_consensus.cc:493] T fa8650e71aa14778b3d73721fc50d9fc P e5256d91808b47c195bc9b4dbd7f2b87 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 0473d2b2d01f4459b1e90fd12cc7840e)
I20260709 13:06:57.392303 25056 raft_consensus.cc:515] T 5ec1c4ce15e04c7e8c283a62179f2a64 P e5256d91808b47c195bc9b4dbd7f2b87 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:57.481979 25450 raft_consensus.cc:2804] T 217b5fae677b4971b3bbd2f357a1f7ff P 0473d2b2d01f4459b1e90fd12cc7840e [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:06:57.470533 25090 raft_consensus.cc:3060] T 1dc5b3532fe54f74876d02beffa2c230 P e5256d91808b47c195bc9b4dbd7f2b87 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:06:57.470881 25497 raft_consensus.cc:2749] T 3e1f505cb0f1427bbd698ac889d80821 P 0473d2b2d01f4459b1e90fd12cc7840e [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:06:57.395689 25623 raft_consensus.cc:515] T 4509b76741dc428e9201c70c1658da13 P 0473d2b2d01f4459b1e90fd12cc7840e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:57.496825 19449 leader_election.cc:304] T 309c3ca0ca4b4f3ba129752ea2cb293b P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87; no voters: 127766fc592545a4997f7790f50f6076
I20260709 13:06:57.498132 19450 leader_election.cc:304] T 40e1e16737a842ee936002830f36882e P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168; no voters: e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:06:57.393729 25311 raft_consensus.cc:515] T ef32ce6fdd0e40d382c79974f30295c6 P 0473d2b2d01f4459b1e90fd12cc7840e [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:57.507076 19449 leader_election.cc:304] T 172b3dd13109415a955b71ac0e9d2234 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87; no voters: 
I20260709 13:06:57.508404 19449 leader_election.cc:304] T 1f85fc4b527a48848e5faa083b604e36 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87; no voters: 
I20260709 13:06:57.454124 25097 raft_consensus.cc:515] T 86a6797bdfe94fa496c050ceae4bd0d9 P 0473d2b2d01f4459b1e90fd12cc7840e [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:57.514624 20108 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35874 (request call id 1122) took 1117 ms. Trace:
I20260709 13:06:57.514989 24700 leader_election.cc:290] T 28af091831594f9d8e96482078cc7625 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:06:57.489116 25496 raft_consensus.cc:493] T 2725d2c4cb054f18b0fc8f735c15f6c2 P e5256d91808b47c195bc9b4dbd7f2b87 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 0473d2b2d01f4459b1e90fd12cc7840e)
I20260709 13:06:57.451296 25520 raft_consensus.cc:515] T 0cdf56e38bbc453d9438d359e5a69955 P 0473d2b2d01f4459b1e90fd12cc7840e [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:57.533648 19404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7be9efa6559648dbb5a0f7684c4542d1" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 18 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:06:57.478255 25304 raft_consensus.cc:515] T 179fd671030940b4b4a4e24bcc4aba0a P e5256d91808b47c195bc9b4dbd7f2b87 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:57.485738 25456 leader_election.cc:290] T d1e5873a19244c5ebbcd38e126796ee7 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:06:57.531634 19406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc225c93219c45538b53a1bd3d387e4d" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:06:57.509426 25418 raft_consensus.cc:2804] T 7f575b143b844aa096b50997dad3516a P 0473d2b2d01f4459b1e90fd12cc7840e [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:06:57.532764 24700 raft_consensus.cc:493] T 14935b3ddf914369822e4a0547aaa355 P e61c3a8f61bb48f8a963c9480e53c168 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:57.486613 25632 consensus_queue.cc:1059] T 14935b3ddf914369822e4a0547aaa355 P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.031s
I20260709 13:06:57.536541 20109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7be9efa6559648dbb5a0f7684c4542d1" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 18 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:06:57.545739 19403 raft_consensus.cc:1275] T f93ee515a9c14139bf566522ed8232f3 P e5256d91808b47c195bc9b4dbd7f2b87 [term 20 FOLLOWER]: Refusing update from remote peer 0473d2b2d01f4459b1e90fd12cc7840e: Log matching property violated. Preceding OpId in replica: term: 18 index: 9. Preceding OpId from leader: term: 20 index: 10. (index mismatch)
I20260709 13:06:57.505453 25261 raft_consensus.cc:2804] T 1dc5b3532fe54f74876d02beffa2c230 P 0473d2b2d01f4459b1e90fd12cc7840e [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:06:57.524919 20108 rpcz_store.cc:276] 0709 13:06:56.397491 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:56.398362 (+   871us) service_pool.cc:224] Handling call
0709 13:06:56.894926 (+496564us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:56.956616 (+ 61690us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:57.514400 (+557784us) spinlock_profiling.cc:243] Waited 496 ms on lock 0x7b54002d5ad0. stack: 00007f4a79de9343 00007f4a79de9240 00007f4a797781d4 00007f4a834b6304 00007f4a834b6299 00007f4a7ce71571 00007f4a7cf078ad 00007f4a81ecc419 00007f4a7b443bd4 00007f4a7b443b62 00007f4a7b443a91 00007f4a7b443a0c 00007f4a7b442cc2 00007f4a7b24348c 00007f4a7b2428c6 00007f4a7b24226f
0709 13:06:57.514547 (+   147us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1141278080}
I20260709 13:06:57.548079 19402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21e14947d70440f19044d8f75c31e1f9" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:06:57.550004 20106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62c6c134d3d24a1ab144dd9ee6bc3f64" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 17 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
W20260709 13:06:57.554728 20077 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:57.516619 25373 raft_consensus.cc:2804] T 309c3ca0ca4b4f3ba129752ea2cb293b P 0473d2b2d01f4459b1e90fd12cc7840e [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:06:57.591673 25448 raft_consensus.cc:493] T 2b74109013a140ada21feeef92d6f563 P 0473d2b2d01f4459b1e90fd12cc7840e [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:57.591820 25632 raft_consensus.cc:3055] T 14935b3ddf914369822e4a0547aaa355 P 0473d2b2d01f4459b1e90fd12cc7840e [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:06:57.592399 25632 raft_consensus.cc:740] T 14935b3ddf914369822e4a0547aaa355 P 0473d2b2d01f4459b1e90fd12cc7840e [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 0473d2b2d01f4459b1e90fd12cc7840e, State: Running, Role: LEADER
I20260709 13:06:57.592260 25448 raft_consensus.cc:515] T 2b74109013a140ada21feeef92d6f563 P 0473d2b2d01f4459b1e90fd12cc7840e [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:57.593453 25632 consensus_queue.cc:260] T 14935b3ddf914369822e4a0547aaa355 P 0473d2b2d01f4459b1e90fd12cc7840e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:57.594560 25448 leader_election.cc:290] T 2b74109013a140ada21feeef92d6f563 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:06:57.545395 25590 raft_consensus.cc:493] T ff75a1d4cb1f493db8f71ddc136ba9ab P e5256d91808b47c195bc9b4dbd7f2b87 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:57.595896 25056 leader_election.cc:290] T 5ec1c4ce15e04c7e8c283a62179f2a64 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:06:57.595726 25590 raft_consensus.cc:515] T ff75a1d4cb1f493db8f71ddc136ba9ab P e5256d91808b47c195bc9b4dbd7f2b87 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:57.600329 25304 leader_election.cc:290] T 179fd671030940b4b4a4e24bcc4aba0a P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:06:57.547106 25345 consensus_queue.cc:1048] T ff9b0eddd810459b82d91c60777c10eb P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.067s
W20260709 13:06:57.556142 20075 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.1:40321, user_credentials={real_user=slave}} blocked reactor thread for 294861us
I20260709 13:06:57.505568 25450 raft_consensus.cc:697] T 217b5fae677b4971b3bbd2f357a1f7ff P 0473d2b2d01f4459b1e90fd12cc7840e [term 14 LEADER]: Becoming Leader. State: Replica: 0473d2b2d01f4459b1e90fd12cc7840e, State: Running, Role: LEADER
I20260709 13:06:57.559417 24700 raft_consensus.cc:515] T 14935b3ddf914369822e4a0547aaa355 P e61c3a8f61bb48f8a963c9480e53c168 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:57.492489 25433 consensus_queue.cc:1048] T b9f0d59553ad444883fcf5b5909f9798 P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.039s
I20260709 13:06:57.514406 25434 raft_consensus.cc:2804] T 172b3dd13109415a955b71ac0e9d2234 P 0473d2b2d01f4459b1e90fd12cc7840e [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:06:57.562131 19410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a08760e15aac4630a629431f56024dc8" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 22 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:06:57.563053 25418 raft_consensus.cc:493] T 7f575b143b844aa096b50997dad3516a P 0473d2b2d01f4459b1e90fd12cc7840e [term 14 FOLLOWER]: Starting leader election (detected failure of leader e5256d91808b47c195bc9b4dbd7f2b87)
I20260709 13:06:57.572798 20111 raft_consensus.cc:1275] T 48824d5acfbc485ebf8c2d944e7202de P 127766fc592545a4997f7790f50f6076 [term 20 FOLLOWER]: Refusing update from remote peer 0473d2b2d01f4459b1e90fd12cc7840e: Log matching property violated. Preceding OpId in replica: term: 18 index: 13. Preceding OpId from leader: term: 20 index: 14. (index mismatch)
I20260709 13:06:57.491904 25052 raft_consensus.cc:515] T ff75a1d4cb1f493db8f71ddc136ba9ab P e61c3a8f61bb48f8a963c9480e53c168 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:57.502928 25598 raft_consensus.cc:515] T fa8650e71aa14778b3d73721fc50d9fc P e5256d91808b47c195bc9b4dbd7f2b87 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:57.577054 19551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc225c93219c45538b53a1bd3d387e4d" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
W20260709 13:06:57.578336 25652 log.cc:927] Time spent T 85c494af21f9457a85da47b9bc70c1fd P e61c3a8f61bb48f8a963c9480e53c168: Append to log took a long time: real 0.063s	user 0.000s	sys 0.000s
I20260709 13:06:57.578960 25661 consensus_queue.cc:1048] T 1a61655d99124a29b486ba4a5b37faea P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:06:57.546423 25227 raft_consensus.cc:3055] T 65d8cb8d6ec64f459d5a47cefab10acf P 127766fc592545a4997f7790f50f6076 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:06:57.580060 25521 leader_election.cc:290] T 1efebf73c86e432baa55533136b6e12c P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:06:57.580183 25622 raft_consensus.cc:493] T 96efeaaf1057492490e9a621f37e1a2d P 0473d2b2d01f4459b1e90fd12cc7840e [term 19 FOLLOWER]: Starting pre-election (detected failure of leader e61c3a8f61bb48f8a963c9480e53c168)
I20260709 13:06:57.580022 19552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62c6c134d3d24a1ab144dd9ee6bc3f64" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 17 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:06:57.589238 19554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21e14947d70440f19044d8f75c31e1f9" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:06:57.533962 25497 raft_consensus.cc:2804] T 1f85fc4b527a48848e5faa083b604e36 P 0473d2b2d01f4459b1e90fd12cc7840e [term 16 FOLLOWER]: Leader pre-election won for term 17
W20260709 13:06:57.561930 25586 consensus_meta.cc:287] T e381f1d6b8184797ad142de49be225a8 P e5256d91808b47c195bc9b4dbd7f2b87: Time spent flushing consensus metadata: real 0.760s	user 0.012s	sys 0.000s
I20260709 13:06:57.610159 20109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ec1c4ce15e04c7e8c283a62179f2a64" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:06:57.611744 20108 raft_consensus.cc:1240] T 7be9efa6559648dbb5a0f7684c4542d1 P 127766fc592545a4997f7790f50f6076 [term 18 FOLLOWER]: Rejecting Update request from peer e5256d91808b47c195bc9b4dbd7f2b87 for earlier term 17. Current term is 18. Ops: []
I20260709 13:06:57.558501 25376 raft_consensus.cc:2804] T 40e1e16737a842ee936002830f36882e P 0473d2b2d01f4459b1e90fd12cc7840e [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:06:57.616246 20106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0afb57ae58a24a01850491d69f0213dd" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:06:57.616753 19449 leader_election.cc:304] T 0e1085d23e8347fbbd5bce7542f4b1f4 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, 127766fc592545a4997f7790f50f6076; no voters: e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:06:57.568831 25261 raft_consensus.cc:493] T 1dc5b3532fe54f74876d02beffa2c230 P 0473d2b2d01f4459b1e90fd12cc7840e [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:06:57.617707 19450 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:57.598425 25590 leader_election.cc:290] T ff75a1d4cb1f493db8f71ddc136ba9ab P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:06:57.576077 25623 leader_election.cc:290] T 4509b76741dc428e9201c70c1658da13 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:06:57.628482 19551 raft_consensus.cc:1240] T edd7d470b5014c9489be7f41f64355c9 P e61c3a8f61bb48f8a963c9480e53c168 [term 21 FOLLOWER]: Rejecting Update request from peer 0473d2b2d01f4459b1e90fd12cc7840e for earlier term 20. Current term is 21. Ops: []
I20260709 13:06:57.636586 20075 leader_election.cc:400] T 85c494af21f9457a85da47b9bc70c1fd P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 16 election: Vote denied by peer e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321) with higher term. Message: Invalid argument: T 85c494af21f9457a85da47b9bc70c1fd P e5256d91808b47c195bc9b4dbd7f2b87 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 127766fc592545a4997f7790f50f6076 for earlier term 16. Current term is 17.
I20260709 13:06:57.676834 20075 leader_election.cc:403] T 85c494af21f9457a85da47b9bc70c1fd P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 16 election: Cancelling election due to peer responding with higher term
I20260709 13:06:57.636493 19553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a08760e15aac4630a629431f56024dc8" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 22 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:06:57.590453 25445 leader_election.cc:290] T 0e1085d23e8347fbbd5bce7542f4b1f4 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 13 election: Requested vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:06:57.638973 24700 leader_election.cc:290] T 14935b3ddf914369822e4a0547aaa355 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:06:57.509707 25359 consensus_queue.cc:260] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P 127766fc592545a4997f7790f50f6076 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 18.15, Last appended by leader: 15, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:57.590883 25551 raft_consensus.cc:493] T 6c5eebf646ad445a9d1b1adc319d7b16 P 127766fc592545a4997f7790f50f6076 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 0473d2b2d01f4459b1e90fd12cc7840e)
I20260709 13:06:57.606735 25373 raft_consensus.cc:493] T 309c3ca0ca4b4f3ba129752ea2cb293b P 0473d2b2d01f4459b1e90fd12cc7840e [term 11 FOLLOWER]: Starting leader election (detected failure of leader 127766fc592545a4997f7790f50f6076)
I20260709 13:06:57.608310 25578 leader_election.cc:290] T 179fd671030940b4b4a4e24bcc4aba0a P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:06:57.545997 25496 raft_consensus.cc:515] T 2725d2c4cb054f18b0fc8f735c15f6c2 P e5256d91808b47c195bc9b4dbd7f2b87 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:57.650111 19552 raft_consensus.cc:1240] T ab43d85f64114d4ebf618930e43d9ed0 P e61c3a8f61bb48f8a963c9480e53c168 [term 19 FOLLOWER]: Rejecting Update request from peer 0473d2b2d01f4459b1e90fd12cc7840e for earlier term 18. Current term is 19. Ops: []
I20260709 13:06:57.618955 25418 raft_consensus.cc:3060] T 7f575b143b844aa096b50997dad3516a P 0473d2b2d01f4459b1e90fd12cc7840e [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:06:57.615373 25434 raft_consensus.cc:493] T 172b3dd13109415a955b71ac0e9d2234 P 0473d2b2d01f4459b1e90fd12cc7840e [term 16 FOLLOWER]: Starting leader election (detected failure of leader 127766fc592545a4997f7790f50f6076)
I20260709 13:06:57.620858 25340 raft_consensus.cc:493] T 14efcc79969f41babe5529c22d59156d P 0473d2b2d01f4459b1e90fd12cc7840e [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 127766fc592545a4997f7790f50f6076)
W20260709 13:06:57.641429 25651 log.cc:927] Time spent T df751f992649444090e27965eb1af85d P e5256d91808b47c195bc9b4dbd7f2b87: Append to log took a long time: real 0.117s	user 0.001s	sys 0.000s
I20260709 13:06:57.636255 25597 raft_consensus.cc:493] T 76cb037fc9064d13b59a8969d897ce8c P 0473d2b2d01f4459b1e90fd12cc7840e [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:57.637633 25661 consensus_queue.cc:1243] T 1a61655d99124a29b486ba4a5b37faea P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Peer 0473d2b2d01f4459b1e90fd12cc7840e log is divergent from this leader: its last log entry 13.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 8
I20260709 13:06:57.674960 19555 raft_consensus.cc:1240] T 833a2f0775ed407a94b8924ce50adb63 P e61c3a8f61bb48f8a963c9480e53c168 [term 14 LEADER]: Rejecting Update request from peer 127766fc592545a4997f7790f50f6076 for earlier term 13. Current term is 14. Ops: []
I20260709 13:06:57.755949 25623 raft_consensus.cc:2804] T 0e1085d23e8347fbbd5bce7542f4b1f4 P 0473d2b2d01f4459b1e90fd12cc7840e [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:06:57.679726 20075 leader_election.cc:304] T 7be9efa6559648dbb5a0f7684c4542d1 P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 127766fc592545a4997f7790f50f6076; no voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:06:57.682312 25237 leader_election.cc:290] T b08304a0a02b42d7840c4e8ee9a6bd1a P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:06:57.683167 25223 raft_consensus.cc:3060] T 85c494af21f9457a85da47b9bc70c1fd P 127766fc592545a4997f7790f50f6076 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:06:57.683346 19556 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40438 (request call id 2970) took 2055 ms. Trace:
I20260709 13:06:57.647312 25497 raft_consensus.cc:493] T 1f85fc4b527a48848e5faa083b604e36 P 0473d2b2d01f4459b1e90fd12cc7840e [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:57.622995 25632 raft_consensus.cc:3060] T 14935b3ddf914369822e4a0547aaa355 P 0473d2b2d01f4459b1e90fd12cc7840e [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:06:57.662904 25591 raft_consensus.cc:493] T e381f1d6b8184797ad142de49be225a8 P e5256d91808b47c195bc9b4dbd7f2b87 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:57.754329 25610 leader_election.cc:290] T edd7d470b5014c9489be7f41f64355c9 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 21 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:06:57.667593 25261 raft_consensus.cc:3060] T 1dc5b3532fe54f74876d02beffa2c230 P 0473d2b2d01f4459b1e90fd12cc7840e [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:06:57.664328 25376 raft_consensus.cc:493] T 40e1e16737a842ee936002830f36882e P 0473d2b2d01f4459b1e90fd12cc7840e [term 18 FOLLOWER]: Starting leader election (detected failure of leader e61c3a8f61bb48f8a963c9480e53c168)
I20260709 13:06:57.766945 20107 raft_consensus.cc:1240] T ab43d85f64114d4ebf618930e43d9ed0 P 127766fc592545a4997f7790f50f6076 [term 19 LEADER]: Rejecting Update request from peer 0473d2b2d01f4459b1e90fd12cc7840e for earlier term 18. Current term is 19. Ops: []
I20260709 13:06:57.637100 25227 raft_consensus.cc:740] T 65d8cb8d6ec64f459d5a47cefab10acf P 127766fc592545a4997f7790f50f6076 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 127766fc592545a4997f7790f50f6076, State: Running, Role: LEADER
I20260709 13:06:57.759354 25373 raft_consensus.cc:3060] T 309c3ca0ca4b4f3ba129752ea2cb293b P 0473d2b2d01f4459b1e90fd12cc7840e [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:06:57.656522 25622 raft_consensus.cc:515] T 96efeaaf1057492490e9a621f37e1a2d P 0473d2b2d01f4459b1e90fd12cc7840e [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
W20260709 13:06:57.800892 20075 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.1:40321, user_credentials={real_user=slave}} blocked reactor thread for 121247us
I20260709 13:06:57.758805 25450 consensus_queue.cc:237] T 217b5fae677b4971b3bbd2f357a1f7ff P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:57.677028 25586 consensus_queue.cc:1059] T 7be9efa6559648dbb5a0f7684c4542d1 P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false }, Status: INVALID_TERM, Last received: 17.11, Next index: 12, Last known committed idx: 10, Time since last communication: 0.118s
W20260709 13:06:57.793843 25650 log.cc:927] Time spent T 21e14947d70440f19044d8f75c31e1f9 P e5256d91808b47c195bc9b4dbd7f2b87: Append to log took a long time: real 0.183s	user 0.000s	sys 0.001s
I20260709 13:06:57.763819 25093 raft_consensus.cc:697] T 76cb037fc9064d13b59a8969d897ce8c P e5256d91808b47c195bc9b4dbd7f2b87 [term 16 LEADER]: Becoming Leader. State: Replica: e5256d91808b47c195bc9b4dbd7f2b87, State: Running, Role: LEADER
I20260709 13:06:57.804018 19556 rpcz_store.cc:276] 0709 13:06:55.627771 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:55.629419 (+  1648us) service_pool.cc:224] Handling call
0709 13:06:57.683105 (+2053686us) spinlock_profiling.cc:243] Waited 1.7 s on lock 0x7b54000f00d4. stack: 00007f4a79de9343 00007f4a79de9240 00007f4a797781d4 00007f4a834b6304 00007f4a834b6299 00007f4a7ce71571 00007f4a7cf0c2fa 00007f4a81ecdb17 00007f4a7b4486d4 00007f4a7b448662 00007f4a7b448591 00007f4a7b44850c 00007f4a7b4477c2 00007f4a7b24348c 00007f4a7b2428c6 00007f4a7b24226f
0709 13:06:57.683275 (+   170us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3911197952}
I20260709 13:06:57.756963 25236 consensus_queue.cc:1059] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P 127766fc592545a4997f7790f50f6076 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 }, Status: INVALID_TERM, Last received: 18.15, Next index: 16, Last known committed idx: 14, Time since last communication: 0.112s
I20260709 13:06:57.767570 25434 raft_consensus.cc:3060] T 172b3dd13109415a955b71ac0e9d2234 P 0473d2b2d01f4459b1e90fd12cc7840e [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:06:57.796679 25462 raft_consensus.cc:493] T e381f1d6b8184797ad142de49be225a8 P 0473d2b2d01f4459b1e90fd12cc7840e [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:57.803136 25623 raft_consensus.cc:493] T 0e1085d23e8347fbbd5bce7542f4b1f4 P 0473d2b2d01f4459b1e90fd12cc7840e [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:57.803926 25615 raft_consensus.cc:2749] T 7be9efa6559648dbb5a0f7684c4542d1 P 127766fc592545a4997f7790f50f6076 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
W20260709 13:06:57.897504 25086 consensus_meta.cc:287] T 4509b76741dc428e9201c70c1658da13 P e61c3a8f61bb48f8a963c9480e53c168: Time spent flushing consensus metadata: real 0.600s	user 0.009s	sys 0.000s
I20260709 13:06:57.761198 25551 raft_consensus.cc:515] T 6c5eebf646ad445a9d1b1adc319d7b16 P 127766fc592545a4997f7790f50f6076 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:57.809603 25497 raft_consensus.cc:3060] T 1f85fc4b527a48848e5faa083b604e36 P 0473d2b2d01f4459b1e90fd12cc7840e [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:06:57.759518 25553 raft_consensus.cc:3055] T 1a61655d99124a29b486ba4a5b37faea P e61c3a8f61bb48f8a963c9480e53c168 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:06:57.813107 25445 raft_consensus.cc:493] T e381f1d6b8184797ad142de49be225a8 P e61c3a8f61bb48f8a963c9480e53c168 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:57.818866 25376 raft_consensus.cc:3060] T 40e1e16737a842ee936002830f36882e P 0473d2b2d01f4459b1e90fd12cc7840e [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:06:57.803202 25597 raft_consensus.cc:515] T 76cb037fc9064d13b59a8969d897ce8c P 0473d2b2d01f4459b1e90fd12cc7840e [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:57.796438 25340 raft_consensus.cc:515] T 14efcc79969f41babe5529c22d59156d P 0473d2b2d01f4459b1e90fd12cc7840e [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
W20260709 13:06:57.826543 25183 consensus_meta.cc:287] T 46c5bfeecc314717bffe987e6844b6d0 P e61c3a8f61bb48f8a963c9480e53c168: Time spent flushing consensus metadata: real 0.999s	user 0.010s	sys 0.004s
I20260709 13:06:57.878924 25227 consensus_queue.cc:260] T 65d8cb8d6ec64f459d5a47cefab10acf P 127766fc592545a4997f7790f50f6076 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.11, Last appended by leader: 11, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
W20260709 13:06:57.880487 25668 log.cc:927] Time spent T 775c229504194560ba9589bc2199b089 P 127766fc592545a4997f7790f50f6076: Append to log took a long time: real 0.058s	user 0.000s	sys 0.000s
I20260709 13:06:57.880759 25462 raft_consensus.cc:515] T e381f1d6b8184797ad142de49be225a8 P 0473d2b2d01f4459b1e90fd12cc7840e [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
W20260709 13:06:57.882102 25671 log.cc:927] Time spent T a08760e15aac4630a629431f56024dc8 P e61c3a8f61bb48f8a963c9480e53c168: Append to log took a long time: real 0.059s	user 0.000s	sys 0.000s
W20260709 13:06:57.882486 25664 log.cc:927] Time spent T 62c6c134d3d24a1ab144dd9ee6bc3f64 P 127766fc592545a4997f7790f50f6076: Append to log took a long time: real 0.269s	user 0.000s	sys 0.001s
I20260709 13:06:57.837395 25624 consensus_queue.cc:1059] T 833a2f0775ed407a94b8924ce50adb63 P 127766fc592545a4997f7790f50f6076 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 }, Status: INVALID_TERM, Last received: 13.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.046s
I20260709 13:06:57.813140 25591 raft_consensus.cc:515] T e381f1d6b8184797ad142de49be225a8 P e5256d91808b47c195bc9b4dbd7f2b87 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:57.824298 25311 leader_election.cc:290] T ef32ce6fdd0e40d382c79974f30295c6 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:06:58.100416 25311 raft_consensus.cc:493] T f1b10566f45d4a7d9029858330e02d5b P 0473d2b2d01f4459b1e90fd12cc7840e [term 17 FOLLOWER]: Starting pre-election (detected failure of leader e61c3a8f61bb48f8a963c9480e53c168)
I20260709 13:06:58.101372 25311 raft_consensus.cc:515] T f1b10566f45d4a7d9029858330e02d5b P 0473d2b2d01f4459b1e90fd12cc7840e [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:58.103271 25340 leader_election.cc:290] T 14efcc79969f41babe5529c22d59156d P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:06:58.104292 25340 raft_consensus.cc:493] T df751f992649444090e27965eb1af85d P 0473d2b2d01f4459b1e90fd12cc7840e [term 20 FOLLOWER]: Starting pre-election (detected failure of leader e61c3a8f61bb48f8a963c9480e53c168)
I20260709 13:06:58.105446 25340 raft_consensus.cc:515] T df751f992649444090e27965eb1af85d P 0473d2b2d01f4459b1e90fd12cc7840e [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
W20260709 13:06:57.719142 19375 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:58.109766 25340 leader_election.cc:290] T df751f992649444090e27965eb1af85d P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
W20260709 13:06:58.035670 19449 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.4:43121, user_credentials={real_user=slave}} blocked reactor thread for 376483us
I20260709 13:06:58.110656 25340 raft_consensus.cc:493] T 5ec1c4ce15e04c7e8c283a62179f2a64 P 0473d2b2d01f4459b1e90fd12cc7840e [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:58.111758 25340 raft_consensus.cc:515] T 5ec1c4ce15e04c7e8c283a62179f2a64 P 0473d2b2d01f4459b1e90fd12cc7840e [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:58.112831 25345 raft_consensus.cc:493] T 9962423cb4e54fcfa5de01daf68a86e7 P 0473d2b2d01f4459b1e90fd12cc7840e [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 127766fc592545a4997f7790f50f6076)
W20260709 13:06:58.053701 19452 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:58.055734 19477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df751f992649444090e27965eb1af85d" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:06:58.116488 19477 raft_consensus.cc:2468] T df751f992649444090e27965eb1af85d P 0473d2b2d01f4459b1e90fd12cc7840e [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 20.
I20260709 13:06:58.057331 19478 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "bc225c93219c45538b53a1bd3d387e4d"
dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
 from {username='slave'} at 127.0.0.1:58294
I20260709 13:06:58.119077 19478 raft_consensus.cc:493] T bc225c93219c45538b53a1bd3d387e4d P 0473d2b2d01f4459b1e90fd12cc7840e [term 14 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:06:58.118997 25350 consensus_queue.cc:1048] T 48824d5acfbc485ebf8c2d944e7202de P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Connected to new peer: Peer: permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:06:58.119619 19478 raft_consensus.cc:3060] T bc225c93219c45538b53a1bd3d387e4d P 0473d2b2d01f4459b1e90fd12cc7840e [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:06:58.058807 19485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff9b0eddd810459b82d91c60777c10eb" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:06:58.123668 19485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4509b76741dc428e9201c70c1658da13" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:06:58.124159 25311 leader_election.cc:290] T f1b10566f45d4a7d9029858330e02d5b P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:06:58.124527 19485 raft_consensus.cc:2468] T 4509b76741dc428e9201c70c1658da13 P 0473d2b2d01f4459b1e90fd12cc7840e [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 10.
I20260709 13:06:58.126080 25304 raft_consensus.cc:493] T f93ee515a9c14139bf566522ed8232f3 P e5256d91808b47c195bc9b4dbd7f2b87 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:58.126971 25304 raft_consensus.cc:515] T f93ee515a9c14139bf566522ed8232f3 P e5256d91808b47c195bc9b4dbd7f2b87 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:58.129441 25337 raft_consensus.cc:493] T 40e1e16737a842ee936002830f36882e P e61c3a8f61bb48f8a963c9480e53c168 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:58.059417 19483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab43d85f64114d4ebf618930e43d9ed0" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:06:58.060002 19486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "775c229504194560ba9589bc2199b089" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:06:58.064446 19484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7be9efa6559648dbb5a0f7684c4542d1" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:06:58.130997 19484 raft_consensus.cc:3060] T 7be9efa6559648dbb5a0f7684c4542d1 P 0473d2b2d01f4459b1e90fd12cc7840e [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:06:58.130190 25337 raft_consensus.cc:515] T 40e1e16737a842ee936002830f36882e P e61c3a8f61bb48f8a963c9480e53c168 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:58.131752 19483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0afb57ae58a24a01850491d69f0213dd" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:06:58.129984 25340 leader_election.cc:290] T 5ec1c4ce15e04c7e8c283a62179f2a64 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:06:58.134033 25337 leader_election.cc:290] T 40e1e16737a842ee936002830f36882e P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:06:57.948390 25086 raft_consensus.cc:515] T 4509b76741dc428e9201c70c1658da13 P e61c3a8f61bb48f8a963c9480e53c168 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:57.828778 19557 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41504 (request call id 982) took 1028 ms. Trace:
I20260709 13:06:58.127156 19375 leader_election.cc:304] T b08304a0a02b42d7840c4e8ee9a6bd1a P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:06:58.076395 25093 consensus_queue.cc:237] T 76cb037fc9064d13b59a8969d897ce8c P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.8, Last appended by leader: 8, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:58.134987 19557 rpcz_store.cc:276] 0709 13:06:56.800777 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:56.860873 (+ 60096us) service_pool.cc:224] Handling call
0709 13:06:56.861170 (+   297us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:56.861399 (+   229us) raft_consensus.cc:1534] Early marking committed up to index 13
0709 13:06:57.274053 (+412654us) log.cc:844] Serialized 14 byte log entry
0709 13:06:57.827187 (+553134us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:57.828438 (+  1251us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:06:57.828534 (+    96us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:57.828607 (+    73us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:57.828722 (+   115us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":280326,"prepare.run_cpu_time_us":70,"prepare.run_wall_time_us":10101,"raft.queue_time_us":23259,"raft.run_cpu_time_us":68,"raft.run_wall_time_us":68,"thread_start_us":935293,"threads_started":3,"wal-append.queue_time_us":389259}
I20260709 13:06:57.891173 25052 leader_election.cc:290] T ff75a1d4cb1f493db8f71ddc136ba9ab P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:06:57.973049 25183 raft_consensus.cc:515] T 46c5bfeecc314717bffe987e6844b6d0 P e61c3a8f61bb48f8a963c9480e53c168 [term 24 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:58.140213 25183 leader_election.cc:290] T 46c5bfeecc314717bffe987e6844b6d0 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 24 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:06:58.079726 19553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff75a1d4cb1f493db8f71ddc136ba9ab" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:06:58.141214 19553 raft_consensus.cc:2468] T ff75a1d4cb1f493db8f71ddc136ba9ab P e61c3a8f61bb48f8a963c9480e53c168 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 18.
W20260709 13:06:58.083891 20077 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:58.082525 19556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "179fd671030940b4b4a4e24bcc4aba0a" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:06:58.092255 25227 raft_consensus.cc:3060] T 65d8cb8d6ec64f459d5a47cefab10acf P 127766fc592545a4997f7790f50f6076 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:06:58.143919 19484 raft_consensus.cc:2468] T 7be9efa6559648dbb5a0f7684c4542d1 P 0473d2b2d01f4459b1e90fd12cc7840e [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 127766fc592545a4997f7790f50f6076 in term 18.
I20260709 13:06:57.885535 25090 raft_consensus.cc:515] T 1dc5b3532fe54f74876d02beffa2c230 P e5256d91808b47c195bc9b4dbd7f2b87 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:58.145848 19552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2725d2c4cb054f18b0fc8f735c15f6c2" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:06:58.094766 25237 raft_consensus.cc:493] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P 0473d2b2d01f4459b1e90fd12cc7840e [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:58.147075 25237 raft_consensus.cc:515] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P 0473d2b2d01f4459b1e90fd12cc7840e [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:58.147905 25090 leader_election.cc:290] T 1dc5b3532fe54f74876d02beffa2c230 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 19 election: Requested vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:06:58.098237 25305 raft_consensus.cc:3055] T 7be9efa6559648dbb5a0f7684c4542d1 P e5256d91808b47c195bc9b4dbd7f2b87 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:06:58.148731 19552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa8650e71aa14778b3d73721fc50d9fc" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:06:58.149096 25305 raft_consensus.cc:740] T 7be9efa6559648dbb5a0f7684c4542d1 P e5256d91808b47c195bc9b4dbd7f2b87 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: e5256d91808b47c195bc9b4dbd7f2b87, State: Running, Role: LEADER
I20260709 13:06:58.113737 25345 raft_consensus.cc:515] T 9962423cb4e54fcfa5de01daf68a86e7 P 0473d2b2d01f4459b1e90fd12cc7840e [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:58.150615 19556 raft_consensus.cc:2468] T 179fd671030940b4b4a4e24bcc4aba0a P e61c3a8f61bb48f8a963c9480e53c168 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 19.
I20260709 13:06:58.094650 25261 raft_consensus.cc:515] T 1dc5b3532fe54f74876d02beffa2c230 P 0473d2b2d01f4459b1e90fd12cc7840e [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:58.152369 25345 leader_election.cc:290] T 9962423cb4e54fcfa5de01daf68a86e7 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:06:58.149879 19552 raft_consensus.cc:2468] T fa8650e71aa14778b3d73721fc50d9fc P e61c3a8f61bb48f8a963c9480e53c168 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 17.
I20260709 13:06:58.130004 25304 leader_election.cc:290] T f93ee515a9c14139bf566522ed8232f3 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:06:58.130919 19486 raft_consensus.cc:2468] T 775c229504194560ba9589bc2199b089 P 0473d2b2d01f4459b1e90fd12cc7840e [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 13.
I20260709 13:06:58.153942 25304 raft_consensus.cc:2749] T b08304a0a02b42d7840c4e8ee9a6bd1a P e5256d91808b47c195bc9b4dbd7f2b87 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
W20260709 13:06:57.804126 19526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.2:46257, user_credentials={real_user=slave}} blocked reactor thread for 275269us
I20260709 13:06:58.156066 20106 raft_consensus.cc:1240] T 7be9efa6559648dbb5a0f7684c4542d1 P 127766fc592545a4997f7790f50f6076 [term 18 FOLLOWER]: Rejecting Update request from peer e5256d91808b47c195bc9b4dbd7f2b87 for earlier term 17. Current term is 18. Ops: []
I20260709 13:06:58.158952 25086 leader_election.cc:290] T 4509b76741dc428e9201c70c1658da13 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 12 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:06:58.159248 25305 consensus_queue.cc:260] T 7be9efa6559648dbb5a0f7684c4542d1 P e5256d91808b47c195bc9b4dbd7f2b87 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.11, Last appended by leader: 11, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } attrs { replace: true } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:58.161484 25237 leader_election.cc:290] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:06:58.133893 19483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2725d2c4cb054f18b0fc8f735c15f6c2" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:06:57.895493 25496 leader_election.cc:290] T 2725d2c4cb054f18b0fc8f735c15f6c2 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:06:57.759677 25537 consensus_queue.cc:1048] T ff9b0eddd810459b82d91c60777c10eb P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Connected to new peer: Peer: permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.048s
I20260709 13:06:57.950429 25553 raft_consensus.cc:740] T 1a61655d99124a29b486ba4a5b37faea P e61c3a8f61bb48f8a963c9480e53c168 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: e61c3a8f61bb48f8a963c9480e53c168, State: Running, Role: LEADER
I20260709 13:06:58.167364 25090 consensus_queue.cc:1048] T d1e5873a19244c5ebbcd38e126796ee7 P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.034s
I20260709 13:06:57.985185 25597 leader_election.cc:290] T 76cb037fc9064d13b59a8969d897ce8c P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:06:57.977632 25598 leader_election.cc:290] T fa8650e71aa14778b3d73721fc50d9fc P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:06:57.889529 25622 leader_election.cc:290] T 96efeaaf1057492490e9a621f37e1a2d P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:06:57.898274 25623 raft_consensus.cc:3060] T 0e1085d23e8347fbbd5bce7542f4b1f4 P 0473d2b2d01f4459b1e90fd12cc7840e [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:06:57.988145 25634 leader_election.cc:290] T ff9b0eddd810459b82d91c60777c10eb P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
W20260709 13:06:57.888406 25670 log.cc:927] Time spent T 833a2f0775ed407a94b8924ce50adb63 P e61c3a8f61bb48f8a963c9480e53c168: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
I20260709 13:06:58.211905 25462 leader_election.cc:290] T e381f1d6b8184797ad142de49be225a8 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
W20260709 13:06:57.935489 25679 log.cc:927] Time spent T edd7d470b5014c9489be7f41f64355c9 P e5256d91808b47c195bc9b4dbd7f2b87: Append to log took a long time: real 0.053s	user 0.001s	sys 0.000s
I20260709 13:06:58.214563 25551 leader_election.cc:290] T 6c5eebf646ad445a9d1b1adc319d7b16 P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:06:58.216753 19552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4509b76741dc428e9201c70c1658da13" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:06:58.217844 19552 raft_consensus.cc:2368] T 4509b76741dc428e9201c70c1658da13 P e61c3a8f61bb48f8a963c9480e53c168 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0473d2b2d01f4459b1e90fd12cc7840e for earlier term 11. Current term is 12.
I20260709 13:06:57.983007 25682 raft_consensus.cc:3055] T 833a2f0775ed407a94b8924ce50adb63 P 127766fc592545a4997f7790f50f6076 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:06:58.219096 25682 raft_consensus.cc:740] T 833a2f0775ed407a94b8924ce50adb63 P 127766fc592545a4997f7790f50f6076 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 127766fc592545a4997f7790f50f6076, State: Running, Role: LEADER
I20260709 13:06:58.220593 25682 consensus_queue.cc:260] T 833a2f0775ed407a94b8924ce50adb63 P 127766fc592545a4997f7790f50f6076 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:58.222303 25682 raft_consensus.cc:3060] T 833a2f0775ed407a94b8924ce50adb63 P 127766fc592545a4997f7790f50f6076 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:06:58.183693 19375 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.3:36891, user_credentials={real_user=slave}} blocked reactor thread for 45892.4us
I20260709 13:06:58.184223 19484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e1085d23e8347fbbd5bce7542f4b1f4" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:06:58.191601 19485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9f0d59553ad444883fcf5b5909f9798" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:06:58.166618 25227 raft_consensus.cc:493] T 0e1085d23e8347fbbd5bce7542f4b1f4 P 127766fc592545a4997f7790f50f6076 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:06:58.194901 19377 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.854s	user 0.022s	sys 0.043s
I20260709 13:06:58.200516 19483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e1085d23e8347fbbd5bce7542f4b1f4" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:06:58.201205 25532 raft_consensus.cc:493] T 48824d5acfbc485ebf8c2d944e7202de P 127766fc592545a4997f7790f50f6076 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:58.199329 25261 leader_election.cc:290] T 1dc5b3532fe54f74876d02beffa2c230 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 19 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:06:57.835451 25565 consensus_queue.cc:1048] T 5ec1c4ce15e04c7e8c283a62179f2a64 P 127766fc592545a4997f7790f50f6076 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.118s
W20260709 13:06:58.206790 25396 consensus_queue.cc:1175] T 7be9efa6559648dbb5a0f7684c4542d1 P e5256d91808b47c195bc9b4dbd7f2b87 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "127766fc592545a4997f7790f50f6076" responder_term: 18 status { last_received { term: 17 index: 11 } last_committed_idx: 10 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer e5256d91808b47c195bc9b4dbd7f2b87 for earlier term 17. Current term is 18. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 13:06:58.224262 25376 raft_consensus.cc:515] T 40e1e16737a842ee936002830f36882e P 0473d2b2d01f4459b1e90fd12cc7840e [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:58.231200 19556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dc5b3532fe54f74876d02beffa2c230" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:06:58.231698 19485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28af091831594f9d8e96482078cc7625" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
W20260709 13:06:58.228322 19377 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.887s	user 0.023s	sys 0.043s
I20260709 13:06:57.966323 25445 raft_consensus.cc:515] T e381f1d6b8184797ad142de49be225a8 P e61c3a8f61bb48f8a963c9480e53c168 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:58.205946 25553 consensus_queue.cc:260] T 1a61655d99124a29b486ba4a5b37faea P e61c3a8f61bb48f8a963c9480e53c168 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.10, Last appended by leader: 10, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:58.251015 19556 raft_consensus.cc:3060] T 1dc5b3532fe54f74876d02beffa2c230 P e61c3a8f61bb48f8a963c9480e53c168 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:06:58.249873 19552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f93ee515a9c14139bf566522ed8232f3" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 21 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:06:58.234967 25227 raft_consensus.cc:515] T 0e1085d23e8347fbbd5bce7542f4b1f4 P 127766fc592545a4997f7790f50f6076 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:58.254395 19484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1efebf73c86e432baa55533136b6e12c" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:06:58.256071 19484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46c5bfeecc314717bffe987e6844b6d0" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 24 candidate_status { last_received { term: 23 index: 12 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:06:58.257570 19484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e36a9d6e29c4a7c860cf267efbd4c74" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:06:58.251560 25396 raft_consensus.cc:493] T fa731b585f684a7fb2d106c50f143b83 P e5256d91808b47c195bc9b4dbd7f2b87 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 127766fc592545a4997f7790f50f6076)
I20260709 13:06:58.258812 19553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b74109013a140ada21feeef92d6f563" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:06:58.259382 25396 raft_consensus.cc:515] T fa731b585f684a7fb2d106c50f143b83 P e5256d91808b47c195bc9b4dbd7f2b87 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:58.252303 25532 raft_consensus.cc:515] T 48824d5acfbc485ebf8c2d944e7202de P 127766fc592545a4997f7790f50f6076 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:58.263571 20106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa731b585f684a7fb2d106c50f143b83" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:06:58.264624 25445 leader_election.cc:290] T e381f1d6b8184797ad142de49be225a8 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:06:58.264967 25580 raft_consensus.cc:493] T 2b74109013a140ada21feeef92d6f563 P e5256d91808b47c195bc9b4dbd7f2b87 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:58.265059 25532 leader_election.cc:290] T 48824d5acfbc485ebf8c2d944e7202de P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:06:58.265733 25580 raft_consensus.cc:515] T 2b74109013a140ada21feeef92d6f563 P e5256d91808b47c195bc9b4dbd7f2b87 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:58.269171 25227 leader_election.cc:290] T 0e1085d23e8347fbbd5bce7542f4b1f4 P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:06:58.270488 19558 raft_consensus.cc:2955] T 14935b3ddf914369822e4a0547aaa355 P e61c3a8f61bb48f8a963c9480e53c168 [term 12 FOLLOWER]: Committing config change with OpId 10.9: config changed from index 4 to 9, VOTER e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1) evicted. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } } }
I20260709 13:06:58.271895 25677 raft_consensus.cc:493] T 48824d5acfbc485ebf8c2d944e7202de P e61c3a8f61bb48f8a963c9480e53c168 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:58.275521 19485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c5eebf646ad445a9d1b1adc319d7b16" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:06:58.276654 25097 leader_election.cc:290] T 86a6797bdfe94fa496c050ceae4bd0d9 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:06:58.278764 25396 leader_election.cc:290] T fa731b585f684a7fb2d106c50f143b83 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:06:58.259768 19553 raft_consensus.cc:2468] T 2b74109013a140ada21feeef92d6f563 P e61c3a8f61bb48f8a963c9480e53c168 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 15.
I20260709 13:06:58.276895 19485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edd7d470b5014c9489be7f41f64355c9" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 21 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:06:58.284955 25223 raft_consensus.cc:2749] T 85c494af21f9457a85da47b9bc70c1fd P 127766fc592545a4997f7790f50f6076 [term 17 FOLLOWER]: Leader election lost for term 16. Reason: Vote denied by peer e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321) with higher term. Message: Invalid argument: T 85c494af21f9457a85da47b9bc70c1fd P e5256d91808b47c195bc9b4dbd7f2b87 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 127766fc592545a4997f7790f50f6076 for earlier term 16. Current term is 17.
I20260709 13:06:58.288214 25411 leader_election.cc:290] T 2b74109013a140ada21feeef92d6f563 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:06:58.292510 25580 leader_election.cc:290] T 2b74109013a140ada21feeef92d6f563 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:06:58.293247 19552 raft_consensus.cc:2468] T f93ee515a9c14139bf566522ed8232f3 P e61c3a8f61bb48f8a963c9480e53c168 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 20.
I20260709 13:06:58.294117 25591 leader_election.cc:290] T e381f1d6b8184797ad142de49be225a8 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:06:58.295327 19375 leader_election.cc:304] T ff75a1d4cb1f493db8f71ddc136ba9ab P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:06:58.303201 19556 raft_consensus.cc:2468] T 1dc5b3532fe54f74876d02beffa2c230 P e61c3a8f61bb48f8a963c9480e53c168 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 19.
I20260709 13:06:58.272729 25677 raft_consensus.cc:515] T 48824d5acfbc485ebf8c2d944e7202de P e61c3a8f61bb48f8a963c9480e53c168 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:58.305531 19484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40e1e16737a842ee936002830f36882e" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:06:58.302413 19478 raft_consensus.cc:515] T bc225c93219c45538b53a1bd3d387e4d P 0473d2b2d01f4459b1e90fd12cc7840e [term 15 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:58.280660 25396 raft_consensus.cc:493] T 40e1e16737a842ee936002830f36882e P e5256d91808b47c195bc9b4dbd7f2b87 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:58.308017 19484 raft_consensus.cc:2468] T 40e1e16737a842ee936002830f36882e P 0473d2b2d01f4459b1e90fd12cc7840e [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 19.
I20260709 13:06:58.308410 19485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edd7d470b5014c9489be7f41f64355c9" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 21 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
W20260709 13:06:58.310993 19375 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.3:36891, user_credentials={real_user=slave}} blocked reactor thread for 56838.9us
I20260709 13:06:58.311394 19553 raft_consensus.cc:1275] T f93ee515a9c14139bf566522ed8232f3 P e61c3a8f61bb48f8a963c9480e53c168 [term 20 FOLLOWER]: Refusing update from remote peer 0473d2b2d01f4459b1e90fd12cc7840e: Log matching property violated. Preceding OpId in replica: term: 18 index: 9. Preceding OpId from leader: term: 20 index: 10. (index mismatch)
W20260709 13:06:58.314519 20075 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.1:40321, user_credentials={real_user=slave}} blocked reactor thread for 406934us
I20260709 13:06:58.306737 25086 raft_consensus.cc:493] T 1dc5b3532fe54f74876d02beffa2c230 P e61c3a8f61bb48f8a963c9480e53c168 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:06:58.318970 25418 consensus_meta.cc:287] T 7f575b143b844aa096b50997dad3516a P 0473d2b2d01f4459b1e90fd12cc7840e: Time spent flushing consensus metadata: real 0.522s	user 0.015s	sys 0.000s
I20260709 13:06:58.304852 25580 raft_consensus.cc:493] T 65d8cb8d6ec64f459d5a47cefab10acf P e5256d91808b47c195bc9b4dbd7f2b87 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 127766fc592545a4997f7790f50f6076)
I20260709 13:06:58.308075 25553 raft_consensus.cc:3060] T 1a61655d99124a29b486ba4a5b37faea P e61c3a8f61bb48f8a963c9480e53c168 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:06:58.322499 25580 raft_consensus.cc:515] T 65d8cb8d6ec64f459d5a47cefab10acf P e5256d91808b47c195bc9b4dbd7f2b87 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:58.328156 25580 leader_election.cc:290] T 65d8cb8d6ec64f459d5a47cefab10acf P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:06:58.325217 25418 raft_consensus.cc:515] T 7f575b143b844aa096b50997dad3516a P 0473d2b2d01f4459b1e90fd12cc7840e [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
W20260709 13:06:58.330633 25658 log.cc:927] Time spent T 2a16f7501e2444fb86d4e2778e734e02 P e5256d91808b47c195bc9b4dbd7f2b87: Append to log took a long time: real 0.720s	user 0.016s	sys 0.015s
I20260709 13:06:58.331147 25418 leader_election.cc:290] T 7f575b143b844aa096b50997dad3516a P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 15 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
W20260709 13:06:58.332340 25660 log.cc:927] Time spent T 0cdf56e38bbc453d9438d359e5a69955 P e61c3a8f61bb48f8a963c9480e53c168: Append to log took a long time: real 0.721s	user 0.006s	sys 0.002s
W20260709 13:06:58.332655 25659 log.cc:927] Time spent T b08304a0a02b42d7840c4e8ee9a6bd1a P e61c3a8f61bb48f8a963c9480e53c168: Append to log took a long time: real 0.721s	user 0.009s	sys 0.020s
I20260709 13:06:58.332887 19375 leader_election.cc:304] T 179fd671030940b4b4a4e24bcc4aba0a P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:06:58.334085 19375 leader_election.cc:304] T fa8650e71aa14778b3d73721fc50d9fc P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:06:58.335052 19554 raft_consensus.cc:1240] T 0cdf56e38bbc453d9438d359e5a69955 P e61c3a8f61bb48f8a963c9480e53c168 [term 17 FOLLOWER]: Rejecting Update request from peer 0473d2b2d01f4459b1e90fd12cc7840e for earlier term 16. Current term is 17. Ops: []
I20260709 13:06:58.336115 25304 raft_consensus.cc:2804] T 179fd671030940b4b4a4e24bcc4aba0a P e5256d91808b47c195bc9b4dbd7f2b87 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:06:58.336522 25304 raft_consensus.cc:493] T 179fd671030940b4b4a4e24bcc4aba0a P e5256d91808b47c195bc9b4dbd7f2b87 [term 19 FOLLOWER]: Starting leader election (detected failure of leader 0473d2b2d01f4459b1e90fd12cc7840e)
I20260709 13:06:58.336903 25304 raft_consensus.cc:3060] T 179fd671030940b4b4a4e24bcc4aba0a P e5256d91808b47c195bc9b4dbd7f2b87 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:06:58.339998 25305 raft_consensus.cc:3060] T 7be9efa6559648dbb5a0f7684c4542d1 P e5256d91808b47c195bc9b4dbd7f2b87 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:06:58.334142 19559 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40438 (request call id 2988) took 1432 ms. Trace:
I20260709 13:06:58.342881 25396 raft_consensus.cc:515] T 40e1e16737a842ee936002830f36882e P e5256d91808b47c195bc9b4dbd7f2b87 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:58.343282 19559 rpcz_store.cc:276] 0709 13:06:56.901881 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:57.027835 (+125954us) service_pool.cc:224] Handling call
0709 13:06:57.028165 (+   330us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:57.028720 (+   555us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:57.028749 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:57.029200 (+   451us) log.cc:844] Serialized 26 byte log entry
0709 13:06:57.471952 (+442752us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:06:57.472137 (+   185us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:57.472614 (+   477us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:58.331318 (+858704us) spinlock_profiling.cc:243] Waited 4.62 ms on lock 0x7b4400022b4c. stack: 00007f4a79de9343 00007f4a79de9240 00007f4a797781d4 00007f4a834b6304 00007f4a834b6299 00007f4a79ca3db1 00007f4a79d41c85 00007f4a79d426a2 00007f4a7cab41db 00007f4a7caafaaf 00007f4a7caa386e 00007f4a7caa2bb6 00007f4a7caa27d8 00007f4a7caac221 00007f4a7caac1d9 00007f4a7caac169
0709 13:06:58.333581 (+  2263us) raft_consensus.cc:1685] finished
0709 13:06:58.333607 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:58.333941 (+   334us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":95,"raft.run_cpu_time_us":75,"raft.run_wall_time_us":72,"spinlock_wait_cycles":10635520,"thread_start_us":441421,"threads_started":1,"wal-append.queue_time_us":552465}
I20260709 13:06:58.345422 25396 leader_election.cc:290] T 40e1e16737a842ee936002830f36882e P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
W20260709 13:06:58.350272 25373 consensus_meta.cc:287] T 309c3ca0ca4b4f3ba129752ea2cb293b P 0473d2b2d01f4459b1e90fd12cc7840e: Time spent flushing consensus metadata: real 0.522s	user 0.013s	sys 0.006s
I20260709 13:06:58.363726 19402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff9b0eddd810459b82d91c60777c10eb" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:06:58.350451 20106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65d8cb8d6ec64f459d5a47cefab10acf" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:06:58.342908 25497 raft_consensus.cc:515] T 1f85fc4b527a48848e5faa083b604e36 P 0473d2b2d01f4459b1e90fd12cc7840e [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:58.351162 19485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14935b3ddf914369822e4a0547aaa355" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:06:58.351379 18300 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:06:58.352223 19375 leader_election.cc:304] T f93ee515a9c14139bf566522ed8232f3 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:06:58.353073 25580 raft_consensus.cc:2804] T fa8650e71aa14778b3d73721fc50d9fc P e5256d91808b47c195bc9b4dbd7f2b87 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:06:58.353135 19552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96efeaaf1057492490e9a621f37e1a2d" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:06:58.321126 25587 raft_consensus.cc:493] T 309c3ca0ca4b4f3ba129752ea2cb293b P e5256d91808b47c195bc9b4dbd7f2b87 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 127766fc592545a4997f7790f50f6076)
I20260709 13:06:58.324421 25086 raft_consensus.cc:515] T 1dc5b3532fe54f74876d02beffa2c230 P e61c3a8f61bb48f8a963c9480e53c168 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:58.355794 25093 raft_consensus.cc:2804] T ff75a1d4cb1f493db8f71ddc136ba9ab P e5256d91808b47c195bc9b4dbd7f2b87 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:06:58.355867 19559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b08304a0a02b42d7840c4e8ee9a6bd1a" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 19 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:06:58.357405 19450 leader_election.cc:304] T 62c6c134d3d24a1ab144dd9ee6bc3f64 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e; no voters: 127766fc592545a4997f7790f50f6076, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:06:58.357930 19479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "217b5fae677b4971b3bbd2f357a1f7ff" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:06:58.345463 19484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46c5bfeecc314717bffe987e6844b6d0" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 24 candidate_status { last_received { term: 23 index: 12 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:06:58.366777 20106 raft_consensus.cc:2468] T 65d8cb8d6ec64f459d5a47cefab10acf P 127766fc592545a4997f7790f50f6076 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 19.
I20260709 13:06:58.369951 25591 raft_consensus.cc:493] T 2a16f7501e2444fb86d4e2778e734e02 P e5256d91808b47c195bc9b4dbd7f2b87 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 127766fc592545a4997f7790f50f6076)
I20260709 13:06:58.372256 19478 leader_election.cc:290] T bc225c93219c45538b53a1bd3d387e4d P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 15 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:06:58.371592 19402 raft_consensus.cc:2468] T ff9b0eddd810459b82d91c60777c10eb P e5256d91808b47c195bc9b4dbd7f2b87 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 127766fc592545a4997f7790f50f6076 in term 17.
I20260709 13:06:58.375936 25093 raft_consensus.cc:493] T ff75a1d4cb1f493db8f71ddc136ba9ab P e5256d91808b47c195bc9b4dbd7f2b87 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:58.376477 25093 raft_consensus.cc:3060] T ff75a1d4cb1f493db8f71ddc136ba9ab P e5256d91808b47c195bc9b4dbd7f2b87 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:06:58.376883 19479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "179fd671030940b4b4a4e24bcc4aba0a" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:06:58.378332 19479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7be9efa6559648dbb5a0f7684c4542d1" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 18 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:06:58.362280 25396 raft_consensus.cc:493] T 4af19371ea874c09a0a2147040835cbb P e5256d91808b47c195bc9b4dbd7f2b87 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 127766fc592545a4997f7790f50f6076)
I20260709 13:06:58.373517 25580 raft_consensus.cc:493] T fa8650e71aa14778b3d73721fc50d9fc P e5256d91808b47c195bc9b4dbd7f2b87 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 0473d2b2d01f4459b1e90fd12cc7840e)
I20260709 13:06:58.378662 19450 leader_election.cc:400] T 4509b76741dc428e9201c70c1658da13 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 11 pre-election: Vote denied by peer e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891) with higher term. Message: Invalid argument: T 4509b76741dc428e9201c70c1658da13 P e61c3a8f61bb48f8a963c9480e53c168 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0473d2b2d01f4459b1e90fd12cc7840e for earlier term 11. Current term is 12.
I20260709 13:06:58.405834 19450 leader_election.cc:403] T 4509b76741dc428e9201c70c1658da13 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 11 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:06:58.379345 19484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff75a1d4cb1f493db8f71ddc136ba9ab" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:06:58.381309 19485 raft_consensus.cc:2410] T 14935b3ddf914369822e4a0547aaa355 P 0473d2b2d01f4459b1e90fd12cc7840e [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e61c3a8f61bb48f8a963c9480e53c168 for term 13 because replica has last-logged OpId of term: 11 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 9.
I20260709 13:06:58.381403 19481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1efebf73c86e432baa55533136b6e12c" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
W20260709 13:06:58.688974 19452 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:58.472921 19558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76cb037fc9064d13b59a8969d897ce8c" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:06:58.387241 19375 leader_election.cc:304] T 1dc5b3532fe54f74876d02beffa2c230 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:06:58.491142 19478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4509b76741dc428e9201c70c1658da13" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:06:58.674077 19449 leader_election.cc:304] T 7be9efa6559648dbb5a0f7684c4542d1 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168; no voters: 127766fc592545a4997f7790f50f6076, e5256d91808b47c195bc9b4dbd7f2b87
W20260709 13:06:58.551322 20075 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.1:40321, user_credentials={real_user=slave}} blocked reactor thread for 66120.9us
I20260709 13:06:58.484612 19556 raft_consensus.cc:1275] T ff75a1d4cb1f493db8f71ddc136ba9ab P e61c3a8f61bb48f8a963c9480e53c168 [term 18 FOLLOWER]: Refusing update from remote peer 0473d2b2d01f4459b1e90fd12cc7840e: Log matching property violated. Preceding OpId in replica: term: 17 index: 9. Preceding OpId from leader: term: 18 index: 10. (index mismatch)
I20260709 13:06:58.380173 19479 raft_consensus.cc:2393] T 7be9efa6559648dbb5a0f7684c4542d1 P 0473d2b2d01f4459b1e90fd12cc7840e [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e61c3a8f61bb48f8a963c9480e53c168 in current term 18: Already voted for candidate 127766fc592545a4997f7790f50f6076 in this term.
I20260709 13:06:58.388005 19555 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41504 (request call id 986) took 1292 ms. Trace:
I20260709 13:06:58.403143 19477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e5873a19244c5ebbcd38e126796ee7" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 21 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:06:58.636653 19486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22196caba61445d3bec98a0aab3c337d" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
W20260709 13:06:58.632664 19524 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:58.624642 19405 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52342 (request call id 3139) took 1093 ms. Trace:
I20260709 13:06:58.606798 19410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4509b76741dc428e9201c70c1658da13" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:06:58.698057 19478 raft_consensus.cc:3060] T 4509b76741dc428e9201c70c1658da13 P 0473d2b2d01f4459b1e90fd12cc7840e [term 10 FOLLOWER]: Advancing to term 12
I20260709 13:06:58.637320 19482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28af091831594f9d8e96482078cc7625" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:06:58.404072 19374 leader_election.cc:304] T 65d8cb8d6ec64f459d5a47cefab10acf P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 127766fc592545a4997f7790f50f6076, e5256d91808b47c195bc9b4dbd7f2b87; no voters: 
I20260709 13:06:58.617410 20109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1efebf73c86e432baa55533136b6e12c" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:06:58.390138 19560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef32ce6fdd0e40d382c79974f30295c6" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:06:58.625638 19411 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52342 (request call id 3134) took 1096 ms. Trace:
I20260709 13:06:58.702487 19555 rpcz_store.cc:276] 0709 13:06:57.095086 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:57.100295 (+  5209us) service_pool.cc:224] Handling call
0709 13:06:57.100774 (+   479us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:57.796424 (+695650us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:58.387500 (+591076us) spinlock_profiling.cc:243] Waited 574 ms on lock 0x7b540012be54. stack: 00007f4a79de9343 00007f4a79de9240 00007f4a797781d4 00007f4a834b6304 00007f4a834b6299 00007f4a7ce71571 00007f4a7cf08e01 00007f4a7cf0783e 00007f4a81ecc419 00007f4a7b443bd4 00007f4a7b443b62 00007f4a7b443a91 00007f4a7b443a0c 00007f4a7b442cc2 00007f4a7b24348c 00007f4a7b2428c6
0709 13:06:58.387823 (+   323us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1319860992}
I20260709 13:06:58.634436 20110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36f6ba92b9ba46babe4ebd6c02e5fbd9" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 20 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:06:58.607319 19406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e381f1d6b8184797ad142de49be225a8" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:06:58.604286 25520 leader_election.cc:290] T 0cdf56e38bbc453d9438d359e5a69955 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:06:58.716068 19406 raft_consensus.cc:2468] T e381f1d6b8184797ad142de49be225a8 P e5256d91808b47c195bc9b4dbd7f2b87 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 15.
I20260709 13:06:58.478914 25376 leader_election.cc:290] T 40e1e16737a842ee936002830f36882e P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 19 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:06:58.717605 19406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86a6797bdfe94fa496c050ceae4bd0d9" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:06:58.387739 25396 raft_consensus.cc:515] T 4af19371ea874c09a0a2147040835cbb P e5256d91808b47c195bc9b4dbd7f2b87 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:58.718384 19406 raft_consensus.cc:2468] T 86a6797bdfe94fa496c050ceae4bd0d9 P e5256d91808b47c195bc9b4dbd7f2b87 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 14.
I20260709 13:06:58.718729 20112 raft_consensus.cc:1275] T 833a2f0775ed407a94b8924ce50adb63 P 127766fc592545a4997f7790f50f6076 [term 14 FOLLOWER]: Refusing update from remote peer e61c3a8f61bb48f8a963c9480e53c168: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 13:06:58.719419 19406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9962423cb4e54fcfa5de01daf68a86e7" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:06:58.720185 25396 leader_election.cc:290] T 4af19371ea874c09a0a2147040835cbb P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:06:58.403599 25497 leader_election.cc:290] T 1f85fc4b527a48848e5faa083b604e36 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 17 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:06:58.621699 20104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14935b3ddf914369822e4a0547aaa355" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:06:58.398334 20111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ec1c4ce15e04c7e8c283a62179f2a64" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:06:58.380587 20108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96efeaaf1057492490e9a621f37e1a2d" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:06:58.720624 19406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76cb037fc9064d13b59a8969d897ce8c" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:06:58.385353 25496 raft_consensus.cc:2804] T f93ee515a9c14139bf566522ed8232f3 P e5256d91808b47c195bc9b4dbd7f2b87 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:06:58.492688 19408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef32ce6fdd0e40d382c79974f30295c6" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:06:58.493374 20107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14efcc79969f41babe5529c22d59156d" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:06:58.391187 25580 raft_consensus.cc:3060] T fa8650e71aa14778b3d73721fc50d9fc P e5256d91808b47c195bc9b4dbd7f2b87 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:06:58.379015 25530 raft_consensus.cc:2749] T 62c6c134d3d24a1ab144dd9ee6bc3f64 P 0473d2b2d01f4459b1e90fd12cc7840e [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:06:58.713745 19411 rpcz_store.cc:276] 0709 13:06:57.529347 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:57.530171 (+   824us) service_pool.cc:224] Handling call
0709 13:06:57.533438 (+  3267us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:57.601084 (+ 67646us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:57.601123 (+    39us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:57.601175 (+    52us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:06:57.601219 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:58.625091 (+1023872us) spinlock_profiling.cc:243] Waited 67.4 ms on lock 0x7b54000b40d4. stack: 00007f4a79de9343 00007f4a79de9240 00007f4a797781d4 00007f4a834b6304 00007f4a834b6299 00007f4a7ce71571 00007f4a7cf08e01 00007f4a7cf0783e 00007f4a81ecc419 00007f4a7b443bd4 00007f4a7b443b62 00007f4a7b443a91 00007f4a7b443a0c 00007f4a7b442cc2 00007f4a7b24348c 00007f4a7b2428c6
0709 13:06:58.625167 (+    76us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:58.625357 (+   190us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":155004160}
I20260709 13:06:58.729319 19558 raft_consensus.cc:2468] T 76cb037fc9064d13b59a8969d897ce8c P e61c3a8f61bb48f8a963c9480e53c168 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 16.
W20260709 13:06:58.729486 25434 consensus_meta.cc:287] T 172b3dd13109415a955b71ac0e9d2234 P 0473d2b2d01f4459b1e90fd12cc7840e: Time spent flushing consensus metadata: real 0.732s	user 0.006s	sys 0.009s
I20260709 13:06:58.635257 20103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9962423cb4e54fcfa5de01daf68a86e7" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:06:58.589205 20105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e1085d23e8347fbbd5bce7542f4b1f4" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076"
W20260709 13:06:58.725984 19375 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.3:36891, user_credentials={real_user=slave}} blocked reactor thread for 352021us
I20260709 13:06:58.390084 19407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b08304a0a02b42d7840c4e8ee9a6bd1a" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 19 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:06:58.391335 19404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b74109013a140ada21feeef92d6f563" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:06:58.392436 25677 leader_election.cc:290] T 48824d5acfbc485ebf8c2d944e7202de P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
W20260709 13:06:58.733889 19374 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.4:43121, user_credentials={real_user=slave}} blocked reactor thread for 330040us
I20260709 13:06:58.492959 25450 raft_consensus.cc:493] T 22196caba61445d3bec98a0aab3c337d P 0473d2b2d01f4459b1e90fd12cc7840e [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:58.379603 25418 consensus_queue.cc:1059] T edd7d470b5014c9489be7f41f64355c9 P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.343s
I20260709 13:06:58.608821 25599 leader_election.cc:290] T f93ee515a9c14139bf566522ed8232f3 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:06:58.730906 25462 raft_consensus.cc:2749] T 7be9efa6559648dbb5a0f7684c4542d1 P 0473d2b2d01f4459b1e90fd12cc7840e [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 13:06:58.739740 19450 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.3:36891, user_credentials={real_user=slave}} blocked reactor thread for 361297us
W20260709 13:06:58.739931 19449 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.1:40321, user_credentials={real_user=slave}} blocked reactor thread for 70769.9us
I20260709 13:06:58.740339 19477 raft_consensus.cc:2468] T d1e5873a19244c5ebbcd38e126796ee7 P 0473d2b2d01f4459b1e90fd12cc7840e [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 20.
I20260709 13:06:58.740429 25445 raft_consensus.cc:493] T ece3db938bc649d4a40a51522ed5259c P e61c3a8f61bb48f8a963c9480e53c168 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 127766fc592545a4997f7790f50f6076)
W20260709 13:06:58.740911 20076 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:58.741315 19524 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:58.732002 25496 raft_consensus.cc:493] T f93ee515a9c14139bf566522ed8232f3 P e5256d91808b47c195bc9b4dbd7f2b87 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:58.741025 25520 raft_consensus.cc:493] T 1a61655d99124a29b486ba4a5b37faea P 0473d2b2d01f4459b1e90fd12cc7840e [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:58.742183 20108 raft_consensus.cc:1275] T 85c494af21f9457a85da47b9bc70c1fd P 127766fc592545a4997f7790f50f6076 [term 17 FOLLOWER]: Refusing update from remote peer e61c3a8f61bb48f8a963c9480e53c168: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 13:06:58.743341 19485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "309c3ca0ca4b4f3ba129752ea2cb293b" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:06:58.563051 25411 raft_consensus.cc:493] T fa731b585f684a7fb2d106c50f143b83 P e61c3a8f61bb48f8a963c9480e53c168 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 127766fc592545a4997f7790f50f6076)
I20260709 13:06:58.586859 25673 raft_consensus.cc:493] T ed7fdbcb96d14d418db9ca90a792588a P 0473d2b2d01f4459b1e90fd12cc7840e [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:58.670878 25661 raft_consensus.cc:493] T a08760e15aac4630a629431f56024dc8 P e61c3a8f61bb48f8a963c9480e53c168 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader e5256d91808b47c195bc9b4dbd7f2b87)
I20260709 13:06:58.744555 25305 raft_consensus.cc:2804] T 65d8cb8d6ec64f459d5a47cefab10acf P e5256d91808b47c195bc9b4dbd7f2b87 [term 18 FOLLOWER]: Leader pre-election won for term 19
W20260709 13:06:58.754454 19377 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.2:46257, user_credentials={real_user=slave}} blocked reactor thread for 388211us
I20260709 13:06:58.738413 20075 leader_election.cc:304] T ff9b0eddd810459b82d91c60777c10eb P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 127766fc592545a4997f7790f50f6076, e5256d91808b47c195bc9b4dbd7f2b87; no voters: 
I20260709 13:06:58.405748 25373 raft_consensus.cc:515] T 309c3ca0ca4b4f3ba129752ea2cb293b P 0473d2b2d01f4459b1e90fd12cc7840e [term 12 FOLLOWER]: Starting leader election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:58.776621 25496 raft_consensus.cc:3060] T f93ee515a9c14139bf566522ed8232f3 P e5256d91808b47c195bc9b4dbd7f2b87 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:06:58.788334 25520 raft_consensus.cc:515] T 1a61655d99124a29b486ba4a5b37faea P 0473d2b2d01f4459b1e90fd12cc7840e [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:58.789840 19485 raft_consensus.cc:1813] T 309c3ca0ca4b4f3ba129752ea2cb293b P 0473d2b2d01f4459b1e90fd12cc7840e [term 12 FOLLOWER]: Handling vote request from an unknown peer e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:06:58.790380 19485 raft_consensus.cc:2393] T 309c3ca0ca4b4f3ba129752ea2cb293b P 0473d2b2d01f4459b1e90fd12cc7840e [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e61c3a8f61bb48f8a963c9480e53c168 in current term 12: Already voted for candidate 0473d2b2d01f4459b1e90fd12cc7840e in this term.
I20260709 13:06:58.794795 19480 raft_consensus.cc:1240] T ff75a1d4cb1f493db8f71ddc136ba9ab P 0473d2b2d01f4459b1e90fd12cc7840e [term 18 LEADER]: Rejecting Update request from peer e5256d91808b47c195bc9b4dbd7f2b87 for earlier term 17. Current term is 18. Ops: []
I20260709 13:06:58.796233 25598 raft_consensus.cc:493] T 46c5bfeecc314717bffe987e6844b6d0 P e5256d91808b47c195bc9b4dbd7f2b87 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 0473d2b2d01f4459b1e90fd12cc7840e)
I20260709 13:06:58.493669 25587 raft_consensus.cc:515] T 309c3ca0ca4b4f3ba129752ea2cb293b P e5256d91808b47c195bc9b4dbd7f2b87 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
W20260709 13:06:58.813181 20075 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.1:40321, user_credentials={real_user=slave}} blocked reactor thread for 112385us
I20260709 13:06:58.813845 19450 leader_election.cc:304] T 2b74109013a140ada21feeef92d6f563 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:06:58.814797 19449 leader_election.cc:304] T bc225c93219c45538b53a1bd3d387e4d P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e; no voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:06:58.815744 19481 raft_consensus.cc:1275] T 62c6c134d3d24a1ab144dd9ee6bc3f64 P 0473d2b2d01f4459b1e90fd12cc7840e [term 16 FOLLOWER]: Refusing update from remote peer 127766fc592545a4997f7790f50f6076: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 13:06:58.383014 25591 raft_consensus.cc:515] T 2a16f7501e2444fb86d4e2778e734e02 P e5256d91808b47c195bc9b4dbd7f2b87 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:58.493774 25304 raft_consensus.cc:515] T 179fd671030940b4b4a4e24bcc4aba0a P e5256d91808b47c195bc9b4dbd7f2b87 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:58.763271 19406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14efcc79969f41babe5529c22d59156d" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:06:58.707721 19405 rpcz_store.cc:276] 0709 13:06:57.531196 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:57.532240 (+  1044us) service_pool.cc:224] Handling call
0709 13:06:57.532481 (+   241us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:57.654801 (+122320us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:57.654830 (+    29us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:57.654870 (+    40us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:06:57.654903 (+    33us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:58.624077 (+969174us) spinlock_profiling.cc:243] Waited 122 ms on lock 0x7b54000e5bd4. stack: 00007f4a79de9343 00007f4a79de9240 00007f4a797781d4 00007f4a834b6304 00007f4a834b6299 00007f4a7ce71571 00007f4a7cf08e01 00007f4a7cf0783e 00007f4a81ecc419 00007f4a7b443bd4 00007f4a7b443b62 00007f4a7b443a91 00007f4a7b443a0c 00007f4a7b442cc2 00007f4a7b24348c 00007f4a7b2428c6
0709 13:06:58.624157 (+    80us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:58.624401 (+   244us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":280827136}
I20260709 13:06:58.747850 19404 raft_consensus.cc:2468] T 2b74109013a140ada21feeef92d6f563 P e5256d91808b47c195bc9b4dbd7f2b87 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 15.
I20260709 13:06:58.733413 25396 raft_consensus.cc:2804] T 1dc5b3532fe54f74876d02beffa2c230 P e5256d91808b47c195bc9b4dbd7f2b87 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:06:58.386981 25097 consensus_queue.cc:1059] T ab43d85f64114d4ebf618930e43d9ed0 P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 }, Status: INVALID_TERM, Last received: 18.12, Next index: 13, Last known committed idx: 11, Time since last communication: 0.361s
I20260709 13:06:58.729897 25690 raft_consensus.cc:493] T 1f85fc4b527a48848e5faa083b604e36 P e5256d91808b47c195bc9b4dbd7f2b87 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 127766fc592545a4997f7790f50f6076)
I20260709 13:06:58.764091 19560 raft_consensus.cc:2468] T ef32ce6fdd0e40d382c79974f30295c6 P e61c3a8f61bb48f8a963c9480e53c168 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 21.
I20260709 13:06:58.746094 25553 raft_consensus.cc:493] T 76cb037fc9064d13b59a8969d897ce8c P e61c3a8f61bb48f8a963c9480e53c168 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:58.766896 20111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4af19371ea874c09a0a2147040835cbb" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:06:58.773257 19407 raft_consensus.cc:2468] T b08304a0a02b42d7840c4e8ee9a6bd1a P e5256d91808b47c195bc9b4dbd7f2b87 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 18.
I20260709 13:06:58.777539 19410 raft_consensus.cc:2468] T 4509b76741dc428e9201c70c1658da13 P e5256d91808b47c195bc9b4dbd7f2b87 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 11.
I20260709 13:06:58.780416 19523 leader_election.cc:304] T 65d8cb8d6ec64f459d5a47cefab10acf P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e61c3a8f61bb48f8a963c9480e53c168; no voters: 127766fc592545a4997f7790f50f6076, e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:06:58.786118 19408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1b10566f45d4a7d9029858330e02d5b" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:06:58.761199 19484 raft_consensus.cc:1240] T 1f85fc4b527a48848e5faa083b604e36 P 0473d2b2d01f4459b1e90fd12cc7840e [term 17 FOLLOWER]: Rejecting Update request from peer 127766fc592545a4997f7790f50f6076 for earlier term 16. Current term is 17. Ops: [16.13-16.13]
I20260709 13:06:58.749560 25093 raft_consensus.cc:515] T ff75a1d4cb1f493db8f71ddc136ba9ab P e5256d91808b47c195bc9b4dbd7f2b87 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:58.833890 19477 raft_consensus.cc:1275] T 14935b3ddf914369822e4a0547aaa355 P 0473d2b2d01f4459b1e90fd12cc7840e [term 12 FOLLOWER]: Refusing update from remote peer 127766fc592545a4997f7790f50f6076: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 12 index: 10. (term mismatch)
I20260709 13:06:58.786187 25305 raft_consensus.cc:493] T 65d8cb8d6ec64f459d5a47cefab10acf P e5256d91808b47c195bc9b4dbd7f2b87 [term 18 FOLLOWER]: Starting leader election (detected failure of leader 127766fc592545a4997f7790f50f6076)
I20260709 13:06:58.830614 19484 raft_consensus.cc:1240] T 309c3ca0ca4b4f3ba129752ea2cb293b P 0473d2b2d01f4459b1e90fd12cc7840e [term 12 FOLLOWER]: Rejecting Update request from peer 127766fc592545a4997f7790f50f6076 for earlier term 11. Current term is 12. Ops: []
I20260709 13:06:58.826948 25678 raft_consensus.cc:493] T ef32ce6fdd0e40d382c79974f30295c6 P e61c3a8f61bb48f8a963c9480e53c168 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:06:58.833725 19450 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.3:36891, user_credentials={real_user=slave}} blocked reactor thread for 58953us
I20260709 13:06:58.765509 25434 raft_consensus.cc:515] T 172b3dd13109415a955b71ac0e9d2234 P 0473d2b2d01f4459b1e90fd12cc7840e [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:58.834252 19477 pending_rounds.cc:85] T 14935b3ddf914369822e4a0547aaa355 P 0473d2b2d01f4459b1e90fd12cc7840e: Aborting all ops after (but not including) 9
I20260709 13:06:58.824369 25611 raft_consensus.cc:2804] T ff9b0eddd810459b82d91c60777c10eb P 127766fc592545a4997f7790f50f6076 [term 17 FOLLOWER]: Leader pre-election won for term 18
W20260709 13:06:58.843654 20075 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:58.825218 25373 leader_election.cc:290] T 309c3ca0ca4b4f3ba129752ea2cb293b P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 12 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:06:58.839628 19477 pending_rounds.cc:107] T 14935b3ddf914369822e4a0547aaa355 P 0473d2b2d01f4459b1e90fd12cc7840e: Aborting uncommitted NO_OP operation due to leader change: 11.10
W20260709 13:06:58.850004 19449 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.1:40321, user_credentials={real_user=slave}} blocked reactor thread for 63328.1us
I20260709 13:06:58.830097 25396 raft_consensus.cc:697] T 1dc5b3532fe54f74876d02beffa2c230 P e5256d91808b47c195bc9b4dbd7f2b87 [term 19 LEADER]: Becoming Leader. State: Replica: e5256d91808b47c195bc9b4dbd7f2b87, State: Running, Role: LEADER
I20260709 13:06:58.849386 19477 raft_consensus.cc:2889] T 14935b3ddf914369822e4a0547aaa355 P 0473d2b2d01f4459b1e90fd12cc7840e [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:06:58.853055 19407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dc5b3532fe54f74876d02beffa2c230" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
I20260709 13:06:58.856312 19450 leader_election.cc:304] T 76cb037fc9064d13b59a8969d897ce8c P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:06:58.836136 25673 raft_consensus.cc:515] T ed7fdbcb96d14d418db9ca90a792588a P 0473d2b2d01f4459b1e90fd12cc7840e [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:58.860023 25530 consensus_queue.cc:1048] T f93ee515a9c14139bf566522ed8232f3 P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:06:58.861037 25463 consensus_queue.cc:1048] T ff75a1d4cb1f493db8f71ddc136ba9ab P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:06:58.861620 25530 raft_consensus.cc:2804] T 76cb037fc9064d13b59a8969d897ce8c P 0473d2b2d01f4459b1e90fd12cc7840e [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:06:58.862056 25530 raft_consensus.cc:493] T 76cb037fc9064d13b59a8969d897ce8c P 0473d2b2d01f4459b1e90fd12cc7840e [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:58.862222 25396 consensus_queue.cc:237] T 1dc5b3532fe54f74876d02beffa2c230 P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 17.9, Last appended by leader: 9, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:58.862987 25622 raft_consensus.cc:2749] T bc225c93219c45538b53a1bd3d387e4d P 0473d2b2d01f4459b1e90fd12cc7840e [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:06:58.863982 25462 raft_consensus.cc:2804] T 2b74109013a140ada21feeef92d6f563 P 0473d2b2d01f4459b1e90fd12cc7840e [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:06:58.864383 25462 raft_consensus.cc:493] T 2b74109013a140ada21feeef92d6f563 P 0473d2b2d01f4459b1e90fd12cc7840e [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:58.864743 25462 raft_consensus.cc:3060] T 2b74109013a140ada21feeef92d6f563 P 0473d2b2d01f4459b1e90fd12cc7840e [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:06:58.846451 25411 raft_consensus.cc:515] T fa731b585f684a7fb2d106c50f143b83 P e61c3a8f61bb48f8a963c9480e53c168 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
W20260709 13:06:58.861356 25702 log.cc:927] Time spent T ff9b0eddd810459b82d91c60777c10eb P e5256d91808b47c195bc9b4dbd7f2b87: Append to log took a long time: real 0.083s	user 0.001s	sys 0.000s
W20260709 13:06:58.870074 19523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.4:43121, user_credentials={real_user=slave}} blocked reactor thread for 98187.6us
I20260709 13:06:58.839162 25305 raft_consensus.cc:3060] T 65d8cb8d6ec64f459d5a47cefab10acf P e5256d91808b47c195bc9b4dbd7f2b87 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:06:58.862461 25530 raft_consensus.cc:3060] T 76cb037fc9064d13b59a8969d897ce8c P 0473d2b2d01f4459b1e90fd12cc7840e [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:06:58.890053 20105 raft_consensus.cc:2468] T 0e1085d23e8347fbbd5bce7542f4b1f4 P 127766fc592545a4997f7790f50f6076 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 13.
I20260709 13:06:58.833410 25553 raft_consensus.cc:515] T 76cb037fc9064d13b59a8969d897ce8c P e61c3a8f61bb48f8a963c9480e53c168 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:58.872596 19484 raft_consensus.cc:1240] T 1a61655d99124a29b486ba4a5b37faea P 0473d2b2d01f4459b1e90fd12cc7840e [term 16 FOLLOWER]: Rejecting Update request from peer e61c3a8f61bb48f8a963c9480e53c168 for earlier term 15. Current term is 16. Ops: [14.9-15.10]
I20260709 13:06:58.842024 25690 raft_consensus.cc:515] T 1f85fc4b527a48848e5faa083b604e36 P e5256d91808b47c195bc9b4dbd7f2b87 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:58.844666 25611 raft_consensus.cc:493] T ff9b0eddd810459b82d91c60777c10eb P 127766fc592545a4997f7790f50f6076 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:58.880013 25587 leader_election.cc:290] T 309c3ca0ca4b4f3ba129752ea2cb293b P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:06:58.845075 25678 raft_consensus.cc:515] T ef32ce6fdd0e40d382c79974f30295c6 P e61c3a8f61bb48f8a963c9480e53c168 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:58.842464 25520 leader_election.cc:290] T 1a61655d99124a29b486ba4a5b37faea P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
W20260709 13:06:58.873508 19526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.2:46257, user_credentials={real_user=slave}} blocked reactor thread for 383021us
I20260709 13:06:58.894285 19480 raft_consensus.cc:1275] T ed7fdbcb96d14d418db9ca90a792588a P 0473d2b2d01f4459b1e90fd12cc7840e [term 15 FOLLOWER]: Refusing update from remote peer 127766fc592545a4997f7790f50f6076: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 13:06:58.942468 19402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36f6ba92b9ba46babe4ebd6c02e5fbd9" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 20 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:06:58.812671 25445 raft_consensus.cc:515] T ece3db938bc649d4a40a51522ed5259c P e61c3a8f61bb48f8a963c9480e53c168 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:58.811975 25598 raft_consensus.cc:515] T 46c5bfeecc314717bffe987e6844b6d0 P e5256d91808b47c195bc9b4dbd7f2b87 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:58.895257 19411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df751f992649444090e27965eb1af85d" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:06:58.838649 25450 raft_consensus.cc:515] T 22196caba61445d3bec98a0aab3c337d P 0473d2b2d01f4459b1e90fd12cc7840e [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:58.899696 19449 leader_election.cc:304] T 21e14947d70440f19044d8f75c31e1f9 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e; no voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:06:58.900454 25373 consensus_queue.cc:1048] T f93ee515a9c14139bf566522ed8232f3 P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:06:58.907491 25411 leader_election.cc:290] T fa731b585f684a7fb2d106c50f143b83 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
W20260709 13:06:58.871987 25623 consensus_meta.cc:287] T 0e1085d23e8347fbbd5bce7542f4b1f4 P 0473d2b2d01f4459b1e90fd12cc7840e: Time spent flushing consensus metadata: real 0.505s	user 0.013s	sys 0.000s
I20260709 13:06:58.830152 25661 raft_consensus.cc:515] T a08760e15aac4630a629431f56024dc8 P e61c3a8f61bb48f8a963c9480e53c168 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:58.910714 19404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ec1c4ce15e04c7e8c283a62179f2a64" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:06:58.915321 25086 leader_election.cc:290] T 1dc5b3532fe54f74876d02beffa2c230 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:06:58.917451 25673 leader_election.cc:290] T ed7fdbcb96d14d418db9ca90a792588a P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:06:58.919239 25093 leader_election.cc:290] T ff75a1d4cb1f493db8f71ddc136ba9ab P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 19 election: Requested vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:06:58.945282 25599 raft_consensus.cc:493] T ab43d85f64114d4ebf618930e43d9ed0 P e61c3a8f61bb48f8a963c9480e53c168 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:58.883391 25677 raft_consensus.cc:2749] T 65d8cb8d6ec64f459d5a47cefab10acf P e61c3a8f61bb48f8a963c9480e53c168 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:06:58.924135 25304 leader_election.cc:290] T 179fd671030940b4b4a4e24bcc4aba0a P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 20 election: Requested vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:06:58.940866 25611 raft_consensus.cc:3060] T ff9b0eddd810459b82d91c60777c10eb P 127766fc592545a4997f7790f50f6076 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:06:58.957018 19523 leader_election.cc:304] T 85c494af21f9457a85da47b9bc70c1fd P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e61c3a8f61bb48f8a963c9480e53c168; no voters: 127766fc592545a4997f7790f50f6076, e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:06:58.958447 19402 raft_consensus.cc:2468] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P e5256d91808b47c195bc9b4dbd7f2b87 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 19.
I20260709 13:06:58.979612 25435 raft_consensus.cc:493] T 70797e5783b5454ab0d0eea663e791e3 P 127766fc592545a4997f7790f50f6076 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:58.990928 25599 raft_consensus.cc:515] T ab43d85f64114d4ebf618930e43d9ed0 P e61c3a8f61bb48f8a963c9480e53c168 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
W20260709 13:06:58.997376 19375 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.3:36891, user_credentials={real_user=slave}} blocked reactor thread for 225387us
I20260709 13:06:59.002140 19486 raft_consensus.cc:2393] T 22196caba61445d3bec98a0aab3c337d P 0473d2b2d01f4459b1e90fd12cc7840e [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e61c3a8f61bb48f8a963c9480e53c168 in current term 17: Already voted for candidate 0473d2b2d01f4459b1e90fd12cc7840e in this term.
W20260709 13:06:59.041533 19375 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:59.001015 19411 raft_consensus.cc:2468] T df751f992649444090e27965eb1af85d P e5256d91808b47c195bc9b4dbd7f2b87 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 20.
I20260709 13:06:59.081135 19560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b74109013a140ada21feeef92d6f563" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:06:59.081823 19560 raft_consensus.cc:2468] T 2b74109013a140ada21feeef92d6f563 P e61c3a8f61bb48f8a963c9480e53c168 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 15.
I20260709 13:06:59.081735 19559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa731b585f684a7fb2d106c50f143b83" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:06:59.082736 19559 raft_consensus.cc:2468] T fa731b585f684a7fb2d106c50f143b83 P e61c3a8f61bb48f8a963c9480e53c168 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 14.
I20260709 13:06:59.102550 20105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "309c3ca0ca4b4f3ba129752ea2cb293b" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:06:59.103965 19558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e381f1d6b8184797ad142de49be225a8" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:06:59.104636 19558 raft_consensus.cc:2468] T e381f1d6b8184797ad142de49be225a8 P e61c3a8f61bb48f8a963c9480e53c168 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 15.
I20260709 13:06:59.108075 19551 raft_consensus.cc:1275] T 76cb037fc9064d13b59a8969d897ce8c P e61c3a8f61bb48f8a963c9480e53c168 [term 16 FOLLOWER]: Refusing update from remote peer e5256d91808b47c195bc9b4dbd7f2b87: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
I20260709 13:06:59.108436 19556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40e1e16737a842ee936002830f36882e" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 20 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:06:59.109288 19556 raft_consensus.cc:2410] T 40e1e16737a842ee936002830f36882e P e61c3a8f61bb48f8a963c9480e53c168 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e5256d91808b47c195bc9b4dbd7f2b87 for term 20 because replica has last-logged OpId of term: 18 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 17 index: 9.
I20260709 13:06:59.108132 19555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65d8cb8d6ec64f459d5a47cefab10acf" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:06:59.110487 19555 raft_consensus.cc:2393] T 65d8cb8d6ec64f459d5a47cefab10acf P e61c3a8f61bb48f8a963c9480e53c168 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e5256d91808b47c195bc9b4dbd7f2b87 in current term 19: Already voted for candidate e61c3a8f61bb48f8a963c9480e53c168 in this term.
I20260709 13:06:59.111640 19554 raft_consensus.cc:1275] T 70797e5783b5454ab0d0eea663e791e3 P e61c3a8f61bb48f8a963c9480e53c168 [term 20 FOLLOWER]: Refusing update from remote peer e5256d91808b47c195bc9b4dbd7f2b87: Log matching property violated. Preceding OpId in replica: term: 18 index: 13. Preceding OpId from leader: term: 20 index: 14. (index mismatch)
I20260709 13:06:59.113039 19552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4af19371ea874c09a0a2147040835cbb" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:06:59.113909 19552 raft_consensus.cc:2468] T 4af19371ea874c09a0a2147040835cbb P e61c3a8f61bb48f8a963c9480e53c168 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 8.
I20260709 13:06:59.118191 25418 raft_consensus.cc:3055] T ab43d85f64114d4ebf618930e43d9ed0 P 0473d2b2d01f4459b1e90fd12cc7840e [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:06:59.135744 19478 raft_consensus.cc:2468] T 4509b76741dc428e9201c70c1658da13 P 0473d2b2d01f4459b1e90fd12cc7840e [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 12.
W20260709 13:06:59.139024 19523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.4:43121, user_credentials={real_user=slave}} blocked reactor thread for 200034us
I20260709 13:06:58.966727 25623 raft_consensus.cc:515] T 0e1085d23e8347fbbd5bce7542f4b1f4 P 0473d2b2d01f4459b1e90fd12cc7840e [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
W20260709 13:06:59.173709 19377 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.2:46257, user_credentials={real_user=slave}} blocked reactor thread for 294196us
I20260709 13:06:59.201838 19486 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58286 (request call id 2568) took 1083 ms. Trace:
W20260709 13:06:59.206493 19375 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:59.208654 19560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a16f7501e2444fb86d4e2778e734e02" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:06:59.060611 25086 raft_consensus.cc:2749] T 85c494af21f9457a85da47b9bc70c1fd P e61c3a8f61bb48f8a963c9480e53c168 [term 17 LEADER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:06:59.202463 19486 rpcz_store.cc:276] 0709 13:06:58.118656 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:58.155073 (+ 36417us) service_pool.cc:224] Handling call
0709 13:06:58.636271 (+481198us) spinlock_profiling.cc:243] Waited 14 ms on lock 0x7b58001b9998. stack: 00007f4a79de9343 00007f4a79de9240 00007f4a797781d4 00007f4a834b6304 00007f4a834b6299 00007f4a79ca3db1 00007f4a79de3b71 00007f4a79de3a22 00007f4a82cfcc09 00007f4a81e56ee0 00007f4a81f200ab 00007f4a81f20131 00007f4a81ece0a0 00007f4a81ecd984 00007f4a7b4486d4 00007f4a7b448662
0709 13:06:59.201552 (+565281us) spinlock_profiling.cc:243] Waited 275 ms on lock 0x7b54000ed654. stack: 00007f4a79de9343 00007f4a79de9240 00007f4a797781d4 00007f4a834b6304 00007f4a834b6299 00007f4a7ce71571 00007f4a7cf0c2fa 00007f4a81ecdb17 00007f4a7b4486d4 00007f4a7b448662 00007f4a7b448591 00007f4a7b44850c 00007f4a7b4477c2 00007f4a7b24348c 00007f4a7b2428c6 00007f4a7b24226f
0709 13:06:59.201760 (+   208us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":664614528}
W20260709 13:06:59.211184 19449 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.1:40321, user_credentials={real_user=slave}} blocked reactor thread for 311594us
W20260709 13:06:59.212034 19524 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:59.212888 19526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.2:46257, user_credentials={real_user=slave}} blocked reactor thread for 53365us
W20260709 13:06:59.223004 20075 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.1:40321, user_credentials={real_user=slave}} blocked reactor thread for 133818us
I20260709 13:06:59.083806 25359 raft_consensus.cc:3060] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P 127766fc592545a4997f7790f50f6076 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:06:59.159022 25376 raft_consensus.cc:2749] T 4509b76741dc428e9201c70c1658da13 P 0473d2b2d01f4459b1e90fd12cc7840e [term 12 FOLLOWER]: Leader pre-election lost for term 11. Reason: Vote denied by peer e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891) with higher term. Message: Invalid argument: T 4509b76741dc428e9201c70c1658da13 P e61c3a8f61bb48f8a963c9480e53c168 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0473d2b2d01f4459b1e90fd12cc7840e for earlier term 11. Current term is 12.
I20260709 13:06:59.229125 19449 leader_election.cc:304] T a08760e15aac4630a629431f56024dc8 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e; no voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:06:59.157523 25445 leader_election.cc:290] T ece3db938bc649d4a40a51522ed5259c P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:06:59.172318 25591 leader_election.cc:290] T 2a16f7501e2444fb86d4e2778e734e02 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:06:59.118595 25418 raft_consensus.cc:740] T ab43d85f64114d4ebf618930e43d9ed0 P 0473d2b2d01f4459b1e90fd12cc7840e [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 0473d2b2d01f4459b1e90fd12cc7840e, State: Running, Role: LEADER
I20260709 13:06:59.206892 25434 leader_election.cc:290] T 172b3dd13109415a955b71ac0e9d2234 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 17 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:06:59.156404 25599 leader_election.cc:290] T ab43d85f64114d4ebf618930e43d9ed0 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:06:59.057166 25093 consensus_queue.cc:1059] T 22196caba61445d3bec98a0aab3c337d P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 }, Status: INVALID_TERM, Last received: 16.10, Next index: 11, Last known committed idx: 8, Time since last communication: 0.162s
I20260709 13:06:59.157840 25411 raft_consensus.cc:493] T 62c6c134d3d24a1ab144dd9ee6bc3f64 P e61c3a8f61bb48f8a963c9480e53c168 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 127766fc592545a4997f7790f50f6076)
I20260709 13:06:59.134487 25690 leader_election.cc:290] T 1f85fc4b527a48848e5faa083b604e36 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:06:59.085156 25673 raft_consensus.cc:2749] T 21e14947d70440f19044d8f75c31e1f9 P 0473d2b2d01f4459b1e90fd12cc7840e [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:06:59.240794 19483 raft_consensus.cc:2368] T 0e1085d23e8347fbbd5bce7542f4b1f4 P 0473d2b2d01f4459b1e90fd12cc7840e [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate e61c3a8f61bb48f8a963c9480e53c168 for earlier term 13. Current term is 14.
I20260709 13:06:59.242110 19557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff75a1d4cb1f493db8f71ddc136ba9ab" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:06:59.250350 19557 raft_consensus.cc:3060] T ff75a1d4cb1f493db8f71ddc136ba9ab P e61c3a8f61bb48f8a963c9480e53c168 [term 18 FOLLOWER]: Advancing to term 19
W20260709 13:06:59.252810 20078 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.2:46257, user_credentials={real_user=slave}} blocked reactor thread for 310154us
I20260709 13:06:59.158797 25677 consensus_queue.cc:1048] T 833a2f0775ed407a94b8924ce50adb63 P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Connected to new peer: Peer: permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.078s
I20260709 13:06:59.241621 19551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "179fd671030940b4b4a4e24bcc4aba0a" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
W20260709 13:06:59.260354 19450 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.3:36891, user_credentials={real_user=slave}} blocked reactor thread for 404166us
I20260709 13:06:59.239370 25373 raft_consensus.cc:2749] T a08760e15aac4630a629431f56024dc8 P 0473d2b2d01f4459b1e90fd12cc7840e [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:06:59.237756 25587 raft_consensus.cc:493] T 833a2f0775ed407a94b8924ce50adb63 P e5256d91808b47c195bc9b4dbd7f2b87 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:59.263005 19450 leader_election.cc:304] T ef32ce6fdd0e40d382c79974f30295c6 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:06:59.244041 25445 raft_consensus.cc:493] T 70797e5783b5454ab0d0eea663e791e3 P e61c3a8f61bb48f8a963c9480e53c168 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:59.231010 25223 raft_consensus.cc:493] T 0afb57ae58a24a01850491d69f0213dd P 127766fc592545a4997f7790f50f6076 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 0473d2b2d01f4459b1e90fd12cc7840e)
I20260709 13:06:59.265985 25704 raft_consensus.cc:493] T 217b5fae677b4971b3bbd2f357a1f7ff P e5256d91808b47c195bc9b4dbd7f2b87 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:59.157729 25435 raft_consensus.cc:515] T 70797e5783b5454ab0d0eea663e791e3 P 127766fc592545a4997f7790f50f6076 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:59.248769 25086 consensus_queue.cc:1048] T 85c494af21f9457a85da47b9bc70c1fd P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Connected to new peer: Peer: permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.026s
I20260709 13:06:59.280949 25520 raft_consensus.cc:2804] T ef32ce6fdd0e40d382c79974f30295c6 P 0473d2b2d01f4459b1e90fd12cc7840e [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:06:59.299742 25223 raft_consensus.cc:515] T 0afb57ae58a24a01850491d69f0213dd P 127766fc592545a4997f7790f50f6076 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:59.267140 25411 raft_consensus.cc:515] T 62c6c134d3d24a1ab144dd9ee6bc3f64 P e61c3a8f61bb48f8a963c9480e53c168 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:59.303022 20104 raft_consensus.cc:1275] T 70797e5783b5454ab0d0eea663e791e3 P 127766fc592545a4997f7790f50f6076 [term 20 FOLLOWER]: Refusing update from remote peer e5256d91808b47c195bc9b4dbd7f2b87: Log matching property violated. Preceding OpId in replica: term: 18 index: 13. Preceding OpId from leader: term: 20 index: 14. (index mismatch)
I20260709 13:06:59.302960 19449 leader_election.cc:304] T e381f1d6b8184797ad142de49be225a8 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87; no voters: 
I20260709 13:06:59.300923 19405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28af091831594f9d8e96482078cc7625" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:06:59.307089 19557 raft_consensus.cc:2468] T ff75a1d4cb1f493db8f71ddc136ba9ab P e61c3a8f61bb48f8a963c9480e53c168 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 19.
I20260709 13:06:59.310793 19560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df751f992649444090e27965eb1af85d" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:06:59.320376 19551 raft_consensus.cc:1275] T 48824d5acfbc485ebf8c2d944e7202de P e61c3a8f61bb48f8a963c9480e53c168 [term 20 FOLLOWER]: Refusing update from remote peer 0473d2b2d01f4459b1e90fd12cc7840e: Log matching property violated. Preceding OpId in replica: term: 19 index: 14. Preceding OpId from leader: term: 20 index: 14. (term mismatch)
I20260709 13:06:59.321027 19551 pending_rounds.cc:85] T 48824d5acfbc485ebf8c2d944e7202de P e61c3a8f61bb48f8a963c9480e53c168: Aborting all ops after (but not including) 13
I20260709 13:06:59.321373 19551 pending_rounds.cc:107] T 48824d5acfbc485ebf8c2d944e7202de P e61c3a8f61bb48f8a963c9480e53c168: Aborting uncommitted NO_OP operation due to leader change: 19.14
I20260709 13:06:59.321655 19551 raft_consensus.cc:2889] T 48824d5acfbc485ebf8c2d944e7202de P e61c3a8f61bb48f8a963c9480e53c168 [term 20 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:06:59.324031 19557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e381f1d6b8184797ad142de49be225a8" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:06:59.324658 19557 raft_consensus.cc:2468] T e381f1d6b8184797ad142de49be225a8 P e61c3a8f61bb48f8a963c9480e53c168 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 15.
I20260709 13:06:59.284909 25690 raft_consensus.cc:493] T 85c494af21f9457a85da47b9bc70c1fd P e5256d91808b47c195bc9b4dbd7f2b87 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:59.326985 19449 leader_election.cc:304] T 86a6797bdfe94fa496c050ceae4bd0d9 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87; no voters: 
I20260709 13:06:59.300338 25599 raft_consensus.cc:493] T ed7fdbcb96d14d418db9ca90a792588a P e61c3a8f61bb48f8a963c9480e53c168 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:59.300446 25598 leader_election.cc:290] T 46c5bfeecc314717bffe987e6844b6d0 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:06:59.302333 25520 raft_consensus.cc:493] T ef32ce6fdd0e40d382c79974f30295c6 P 0473d2b2d01f4459b1e90fd12cc7840e [term 21 FOLLOWER]: Starting leader election (detected failure of leader e5256d91808b47c195bc9b4dbd7f2b87)
I20260709 13:06:59.335291 19404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f93ee515a9c14139bf566522ed8232f3" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 21 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:06:59.289077 25445 raft_consensus.cc:515] T 70797e5783b5454ab0d0eea663e791e3 P e61c3a8f61bb48f8a963c9480e53c168 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:59.340258 19557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40e1e16737a842ee936002830f36882e" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
W20260709 13:06:59.344363 19523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.4:43121, user_credentials={real_user=slave}} blocked reactor thread for 203208us
I20260709 13:06:59.345113 25597 raft_consensus.cc:3055] T edd7d470b5014c9489be7f41f64355c9 P 0473d2b2d01f4459b1e90fd12cc7840e [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:06:59.325659 25661 leader_election.cc:290] T a08760e15aac4630a629431f56024dc8 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:06:59.346779 25223 leader_election.cc:290] T 0afb57ae58a24a01850491d69f0213dd P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:06:59.347936 19551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86a6797bdfe94fa496c050ceae4bd0d9" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:06:59.349880 19406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "179fd671030940b4b4a4e24bcc4aba0a" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:06:59.339457 25520 raft_consensus.cc:3060] T ef32ce6fdd0e40d382c79974f30295c6 P 0473d2b2d01f4459b1e90fd12cc7840e [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:06:59.299786 25587 raft_consensus.cc:515] T 833a2f0775ed407a94b8924ce50adb63 P e5256d91808b47c195bc9b4dbd7f2b87 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:59.370162 19406 raft_consensus.cc:2393] T 179fd671030940b4b4a4e24bcc4aba0a P e5256d91808b47c195bc9b4dbd7f2b87 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e61c3a8f61bb48f8a963c9480e53c168 in current term 20: Already voted for candidate e5256d91808b47c195bc9b4dbd7f2b87 in this term.
I20260709 13:06:59.351765 19403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b74109013a140ada21feeef92d6f563" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:06:59.340907 25304 raft_consensus.cc:493] T 3e1f505cb0f1427bbd698ac889d80821 P e5256d91808b47c195bc9b4dbd7f2b87 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader e61c3a8f61bb48f8a963c9480e53c168)
I20260709 13:06:59.352769 19402 raft_consensus.cc:1240] T 1a61655d99124a29b486ba4a5b37faea P e5256d91808b47c195bc9b4dbd7f2b87 [term 16 FOLLOWER]: Rejecting Update request from peer e61c3a8f61bb48f8a963c9480e53c168 for earlier term 15. Current term is 16. Ops: [15.10-15.10]
I20260709 13:06:59.352895 25713 raft_consensus.cc:493] T f1b10566f45d4a7d9029858330e02d5b P e5256d91808b47c195bc9b4dbd7f2b87 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader e61c3a8f61bb48f8a963c9480e53c168)
I20260709 13:06:59.353118 25623 leader_election.cc:290] T 0e1085d23e8347fbbd5bce7542f4b1f4 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 14 election: Requested vote from peers e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:06:59.333722 25673 raft_consensus.cc:2804] T e381f1d6b8184797ad142de49be225a8 P 0473d2b2d01f4459b1e90fd12cc7840e [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:06:59.331431 25450 leader_election.cc:290] T 22196caba61445d3bec98a0aab3c337d P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:06:59.354925 19405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40e1e16737a842ee936002830f36882e" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:06:59.370154 25261 raft_consensus.cc:493] T 14935b3ddf914369822e4a0547aaa355 P 0473d2b2d01f4459b1e90fd12cc7840e [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:59.379597 25673 raft_consensus.cc:493] T e381f1d6b8184797ad142de49be225a8 P 0473d2b2d01f4459b1e90fd12cc7840e [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:59.380723 25261 raft_consensus.cc:515] T 14935b3ddf914369822e4a0547aaa355 P 0473d2b2d01f4459b1e90fd12cc7840e [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:59.381439 25673 raft_consensus.cc:3060] T e381f1d6b8184797ad142de49be225a8 P 0473d2b2d01f4459b1e90fd12cc7840e [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:06:59.381855 19449 leader_election.cc:304] T b08304a0a02b42d7840c4e8ee9a6bd1a P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87; no voters: e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:06:59.382884 25450 raft_consensus.cc:2804] T b08304a0a02b42d7840c4e8ee9a6bd1a P 0473d2b2d01f4459b1e90fd12cc7840e [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:06:59.383303 25450 raft_consensus.cc:493] T b08304a0a02b42d7840c4e8ee9a6bd1a P 0473d2b2d01f4459b1e90fd12cc7840e [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:59.383708 25450 raft_consensus.cc:3060] T b08304a0a02b42d7840c4e8ee9a6bd1a P 0473d2b2d01f4459b1e90fd12cc7840e [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:06:59.384230 19449 leader_election.cc:304] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87; no voters: 
I20260709 13:06:59.385826 25434 raft_consensus.cc:2804] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P 0473d2b2d01f4459b1e90fd12cc7840e [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:06:59.386273 25434 raft_consensus.cc:493] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P 0473d2b2d01f4459b1e90fd12cc7840e [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:59.386646 25434 raft_consensus.cc:3060] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P 0473d2b2d01f4459b1e90fd12cc7840e [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:06:59.386972 19556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cdf56e38bbc453d9438d359e5a69955" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:06:59.388216 19556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a61655d99124a29b486ba4a5b37faea" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 17 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:06:59.388948 19556 raft_consensus.cc:2410] T 1a61655d99124a29b486ba4a5b37faea P e61c3a8f61bb48f8a963c9480e53c168 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0473d2b2d01f4459b1e90fd12cc7840e for term 17 because replica has last-logged OpId of term: 15 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 9.
I20260709 13:06:59.389834 19556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46c5bfeecc314717bffe987e6844b6d0" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 24 candidate_status { last_received { term: 23 index: 12 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:06:59.390508 19556 raft_consensus.cc:2393] T 46c5bfeecc314717bffe987e6844b6d0 P e61c3a8f61bb48f8a963c9480e53c168 [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e5256d91808b47c195bc9b4dbd7f2b87 in current term 24: Already voted for candidate e61c3a8f61bb48f8a963c9480e53c168 in this term.
I20260709 13:06:59.364902 19375 leader_election.cc:304] T 2b74109013a140ada21feeef92d6f563 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:06:59.289115 25704 raft_consensus.cc:515] T 217b5fae677b4971b3bbd2f357a1f7ff P e5256d91808b47c195bc9b4dbd7f2b87 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
W20260709 13:06:59.350467 19524 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:59.351920 25690 raft_consensus.cc:515] T 85c494af21f9457a85da47b9bc70c1fd P e5256d91808b47c195bc9b4dbd7f2b87 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:59.373638 19551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f575b143b844aa096b50997dad3516a" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:06:59.374396 19559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dc5b3532fe54f74876d02beffa2c230" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:06:59.408253 19559 raft_consensus.cc:2393] T 1dc5b3532fe54f74876d02beffa2c230 P e61c3a8f61bb48f8a963c9480e53c168 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 0473d2b2d01f4459b1e90fd12cc7840e in current term 19: Already voted for candidate e5256d91808b47c195bc9b4dbd7f2b87 in this term.
W20260709 13:06:59.375937 19526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.2:46257, user_credentials={real_user=slave}} blocked reactor thread for 96636.1us
I20260709 13:06:59.371061 19403 raft_consensus.cc:2468] T 2b74109013a140ada21feeef92d6f563 P e5256d91808b47c195bc9b4dbd7f2b87 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 15.
I20260709 13:06:59.376847 19480 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39478 (request call id 998) took 1327 ms. Trace:
I20260709 13:06:59.362835 25597 raft_consensus.cc:740] T edd7d470b5014c9489be7f41f64355c9 P 0473d2b2d01f4459b1e90fd12cc7840e [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 0473d2b2d01f4459b1e90fd12cc7840e, State: Running, Role: LEADER
I20260709 13:06:59.380157 19405 raft_consensus.cc:2468] T 40e1e16737a842ee936002830f36882e P e5256d91808b47c195bc9b4dbd7f2b87 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 19.
W20260709 13:06:59.347947 20078 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.2:46257, user_credentials={real_user=slave}} blocked reactor thread for 47147.9us
I20260709 13:06:59.391288 19406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edd7d470b5014c9489be7f41f64355c9" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 21 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
I20260709 13:06:59.392114 25445 leader_election.cc:290] T 70797e5783b5454ab0d0eea663e791e3 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:06:59.363306 19560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc225c93219c45538b53a1bd3d387e4d" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: true dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:06:59.413609 19406 raft_consensus.cc:3060] T edd7d470b5014c9489be7f41f64355c9 P e5256d91808b47c195bc9b4dbd7f2b87 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:06:59.413833 19560 raft_consensus.cc:3060] T bc225c93219c45538b53a1bd3d387e4d P e61c3a8f61bb48f8a963c9480e53c168 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:06:59.415619 20078 leader_election.cc:304] T 1efebf73c86e432baa55533136b6e12c P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 127766fc592545a4997f7790f50f6076; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:06:59.322955 25418 consensus_queue.cc:260] T ab43d85f64114d4ebf618930e43d9ed0 P 0473d2b2d01f4459b1e90fd12cc7840e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 18.12, Last appended by leader: 12, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
W20260709 13:06:59.416623 25714 log.cc:927] Time spent T 1dc5b3532fe54f74876d02beffa2c230 P e5256d91808b47c195bc9b4dbd7f2b87: Append to log took a long time: real 0.086s	user 0.000s	sys 0.001s
I20260709 13:06:59.417793 25546 raft_consensus.cc:2749] T 1efebf73c86e432baa55533136b6e12c P 127766fc592545a4997f7790f50f6076 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:06:59.418982 25223 consensus_queue.cc:1059] T 1f85fc4b527a48848e5faa083b604e36 P 127766fc592545a4997f7790f50f6076 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 }, Status: INVALID_TERM, Last received: 15.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:06:59.418834 25597 consensus_queue.cc:260] T edd7d470b5014c9489be7f41f64355c9 P 0473d2b2d01f4459b1e90fd12cc7840e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 20.11, Last appended by leader: 11, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:59.419891 25597 raft_consensus.cc:3060] T edd7d470b5014c9489be7f41f64355c9 P 0473d2b2d01f4459b1e90fd12cc7840e [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:06:59.420034 25628 raft_consensus.cc:3055] T 1f85fc4b527a48848e5faa083b604e36 P 127766fc592545a4997f7790f50f6076 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:06:59.420423 25435 leader_election.cc:290] T 70797e5783b5454ab0d0eea663e791e3 P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:06:59.421453 19403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff75a1d4cb1f493db8f71ddc136ba9ab" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:06:59.420457 25628 raft_consensus.cc:740] T 1f85fc4b527a48848e5faa083b604e36 P 127766fc592545a4997f7790f50f6076 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 127766fc592545a4997f7790f50f6076, State: Running, Role: LEADER
I20260709 13:06:59.422250 19403 raft_consensus.cc:2393] T ff75a1d4cb1f493db8f71ddc136ba9ab P e5256d91808b47c195bc9b4dbd7f2b87 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e61c3a8f61bb48f8a963c9480e53c168 in current term 19: Already voted for candidate e5256d91808b47c195bc9b4dbd7f2b87 in this term.
I20260709 13:06:59.423157 19403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4509b76741dc428e9201c70c1658da13" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
I20260709 13:06:59.423765 19403 raft_consensus.cc:3060] T 4509b76741dc428e9201c70c1658da13 P e5256d91808b47c195bc9b4dbd7f2b87 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:06:59.422917 25628 consensus_queue.cc:260] T 1f85fc4b527a48848e5faa083b604e36 P 127766fc592545a4997f7790f50f6076 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.13, Last appended by leader: 13, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:59.425154 25553 leader_election.cc:290] T 76cb037fc9064d13b59a8969d897ce8c P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:06:59.427553 25690 leader_election.cc:290] T 85c494af21f9457a85da47b9bc70c1fd P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:06:59.428139 25411 leader_election.cc:290] T 62c6c134d3d24a1ab144dd9ee6bc3f64 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:06:59.428344 19411 raft_consensus.cc:1275] T 85c494af21f9457a85da47b9bc70c1fd P e5256d91808b47c195bc9b4dbd7f2b87 [term 17 FOLLOWER]: Refusing update from remote peer e61c3a8f61bb48f8a963c9480e53c168: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 13:06:59.409875 19480 rpcz_store.cc:276] 0709 13:06:58.049716 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:58.796687 (+746971us) service_pool.cc:224] Handling call
0709 13:06:58.796985 (+   298us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:58.942326 (+145341us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:59.374415 (+432089us) spinlock_profiling.cc:243] Waited 74.5 ms on lock 0x7b54000a9954. stack: 00007f4a79de9343 00007f4a79de9240 00007f4a797781d4 00007f4a834b6304 00007f4a834b6299 00007f4a7ce71571 00007f4a7cf08e01 00007f4a7cf0783e 00007f4a81ecc419 00007f4a7b443bd4 00007f4a7b443b62 00007f4a7b443a91 00007f4a7b443a0c 00007f4a7b442cc2 00007f4a7b24348c 00007f4a7b2428c6
0709 13:06:59.376780 (+  2365us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":171333888}
I20260709 13:06:59.399606 25261 leader_election.cc:290] T 14935b3ddf914369822e4a0547aaa355 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:06:59.376897 19523 leader_election.cc:304] T 0e1085d23e8347fbbd5bce7542f4b1f4 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 127766fc592545a4997f7790f50f6076, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:06:59.406189 19375 leader_election.cc:304] T fa731b585f684a7fb2d106c50f143b83 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168; no voters: 127766fc592545a4997f7790f50f6076
I20260709 13:06:59.417876 25093 raft_consensus.cc:2804] T 2b74109013a140ada21feeef92d6f563 P e5256d91808b47c195bc9b4dbd7f2b87 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:06:59.437579 19405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e381f1d6b8184797ad142de49be225a8" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
W20260709 13:06:59.404815 25580 consensus_meta.cc:287] T fa8650e71aa14778b3d73721fc50d9fc P e5256d91808b47c195bc9b4dbd7f2b87: Time spent flushing consensus metadata: real 0.639s	user 0.011s	sys 0.000s
I20260709 13:06:59.438408 19405 raft_consensus.cc:2468] T e381f1d6b8184797ad142de49be225a8 P e5256d91808b47c195bc9b4dbd7f2b87 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 15.
I20260709 13:06:59.430145 19402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46c5bfeecc314717bffe987e6844b6d0" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 24 candidate_status { last_received { term: 23 index: 12 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
I20260709 13:06:59.400465 25673 raft_consensus.cc:515] T e381f1d6b8184797ad142de49be225a8 P 0473d2b2d01f4459b1e90fd12cc7840e [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:59.438966 19558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed7fdbcb96d14d418db9ca90a792588a" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:06:59.440449 19375 leader_election.cc:304] T e381f1d6b8184797ad142de49be225a8 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:06:59.438241 19554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1b10566f45d4a7d9029858330e02d5b" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:06:59.378911 25304 raft_consensus.cc:515] T 3e1f505cb0f1427bbd698ac889d80821 P e5256d91808b47c195bc9b4dbd7f2b87 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
W20260709 13:06:59.441301 19523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.4:43121, user_credentials={real_user=slave}} blocked reactor thread for 80194.2us
I20260709 13:06:59.441740 19559 raft_consensus.cc:1240] T 46c5bfeecc314717bffe987e6844b6d0 P e61c3a8f61bb48f8a963c9480e53c168 [term 24 FOLLOWER]: Rejecting Update request from peer 0473d2b2d01f4459b1e90fd12cc7840e for earlier term 23. Current term is 24. Ops: []
I20260709 13:06:59.441815 25682 consensus_queue.cc:1059] T 309c3ca0ca4b4f3ba129752ea2cb293b P 127766fc592545a4997f7790f50f6076 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 }, Status: INVALID_TERM, Last received: 11.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:06:59.442867 19526 leader_election.cc:304] T 0afb57ae58a24a01850491d69f0213dd P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e61c3a8f61bb48f8a963c9480e53c168; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, 127766fc592545a4997f7790f50f6076
I20260709 13:06:59.366019 25599 raft_consensus.cc:515] T ed7fdbcb96d14d418db9ca90a792588a P e61c3a8f61bb48f8a963c9480e53c168 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:59.451215 19405 raft_consensus.cc:1275] T 833a2f0775ed407a94b8924ce50adb63 P e5256d91808b47c195bc9b4dbd7f2b87 [term 14 FOLLOWER]: Refusing update from remote peer e61c3a8f61bb48f8a963c9480e53c168: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 13:06:59.452044 19560 raft_consensus.cc:2468] T bc225c93219c45538b53a1bd3d387e4d P e61c3a8f61bb48f8a963c9480e53c168 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 15.
I20260709 13:06:59.424561 25628 raft_consensus.cc:3060] T 1f85fc4b527a48848e5faa083b604e36 P 127766fc592545a4997f7790f50f6076 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:06:59.447253 19485 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58286 (request call id 2594) took 1214 ms. Trace:
I20260709 13:06:59.469520 19375 leader_election.cc:304] T 4af19371ea874c09a0a2147040835cbb P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168; no voters: 127766fc592545a4997f7790f50f6076
I20260709 13:06:59.403565 25305 raft_consensus.cc:515] T 65d8cb8d6ec64f459d5a47cefab10acf P e5256d91808b47c195bc9b4dbd7f2b87 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
W20260709 13:06:59.475661 20075 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:59.477095 19558 raft_consensus.cc:2468] T ed7fdbcb96d14d418db9ca90a792588a P e61c3a8f61bb48f8a963c9480e53c168 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 15.
W20260709 13:06:59.477478 20075 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:59.480389 19449 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.1:40321, user_credentials={real_user=slave}} blocked reactor thread for 96234.8us
I20260709 13:06:59.482579 19449 leader_election.cc:304] T df751f992649444090e27965eb1af85d P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87; no voters: 
I20260709 13:06:59.486506 19407 raft_consensus.cc:1275] T b08304a0a02b42d7840c4e8ee9a6bd1a P e5256d91808b47c195bc9b4dbd7f2b87 [term 18 FOLLOWER]: Refusing update from remote peer e61c3a8f61bb48f8a963c9480e53c168: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
I20260709 13:06:59.471454 25685 raft_consensus.cc:2804] T e381f1d6b8184797ad142de49be225a8 P e5256d91808b47c195bc9b4dbd7f2b87 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:06:59.423028 25705 consensus_queue.cc:1048] T 76cb037fc9064d13b59a8969d897ce8c P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 6, Time since last communication: 0.069s
I20260709 13:06:59.403028 25713 raft_consensus.cc:515] T f1b10566f45d4a7d9029858330e02d5b P e5256d91808b47c195bc9b4dbd7f2b87 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:59.492175 19405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f575b143b844aa096b50997dad3516a" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
I20260709 13:06:59.447697 25580 raft_consensus.cc:515] T fa8650e71aa14778b3d73721fc50d9fc P e5256d91808b47c195bc9b4dbd7f2b87 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:59.461999 19485 rpcz_store.cc:276] 0709 13:06:58.232894 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:58.854036 (+621142us) service_pool.cc:224] Handling call
0709 13:06:58.854475 (+   439us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:58.854854 (+   379us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:06:59.235717 (+380863us) log.cc:844] Serialized 14 byte log entry
0709 13:06:59.446861 (+211144us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:59.446911 (+    50us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:06:59.446957 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:59.447028 (+    71us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:59.447193 (+   165us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":852,"prepare.queue_time_us":475612,"prepare.run_cpu_time_us":50,"prepare.run_wall_time_us":51,"raft.queue_time_us":949,"raft.run_cpu_time_us":128,"raft.run_wall_time_us":7734,"thread_start_us":585984,"threads_started":2}
I20260709 13:06:59.500921 19557 raft_consensus.cc:2468] T 40e1e16737a842ee936002830f36882e P e61c3a8f61bb48f8a963c9480e53c168 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 19.
I20260709 13:06:59.504462 19403 raft_consensus.cc:2468] T 4509b76741dc428e9201c70c1658da13 P e5256d91808b47c195bc9b4dbd7f2b87 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 12.
I20260709 13:06:59.488708 25261 raft_consensus.cc:2804] T df751f992649444090e27965eb1af85d P 0473d2b2d01f4459b1e90fd12cc7840e [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:06:59.505885 19403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "309c3ca0ca4b4f3ba129752ea2cb293b" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
I20260709 13:06:59.476150 25598 consensus_queue.cc:1048] T 70797e5783b5454ab0d0eea663e791e3 P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.021s
I20260709 13:06:59.490742 25445 raft_consensus.cc:2804] T 0e1085d23e8347fbbd5bce7542f4b1f4 P e61c3a8f61bb48f8a963c9480e53c168 [term 13 FOLLOWER]: Leader election won for term 13
W20260709 13:06:59.508872 19526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.2:46257, user_credentials={real_user=slave}} blocked reactor thread for 66116us
I20260709 13:06:59.509773 19402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40e1e16737a842ee936002830f36882e" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
I20260709 13:06:59.507851 19403 raft_consensus.cc:3060] T 309c3ca0ca4b4f3ba129752ea2cb293b P e5256d91808b47c195bc9b4dbd7f2b87 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:06:59.489791 25685 raft_consensus.cc:493] T e381f1d6b8184797ad142de49be225a8 P e5256d91808b47c195bc9b4dbd7f2b87 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:59.509277 25261 raft_consensus.cc:493] T df751f992649444090e27965eb1af85d P 0473d2b2d01f4459b1e90fd12cc7840e [term 20 FOLLOWER]: Starting leader election (detected failure of leader e61c3a8f61bb48f8a963c9480e53c168)
I20260709 13:06:59.513679 19407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f85fc4b527a48848e5faa083b604e36" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
I20260709 13:06:59.514154 19402 raft_consensus.cc:2393] T 40e1e16737a842ee936002830f36882e P e5256d91808b47c195bc9b4dbd7f2b87 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 0473d2b2d01f4459b1e90fd12cc7840e in current term 19: Already voted for candidate e5256d91808b47c195bc9b4dbd7f2b87 in this term.
I20260709 13:06:59.513983 19526 leader_election.cc:304] T b9f0d59553ad444883fcf5b5909f9798 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e61c3a8f61bb48f8a963c9480e53c168; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87
W20260709 13:06:59.527531 19449 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:59.519034 19410 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52342 (request call id 3149) took 1128 ms. Trace:
I20260709 13:06:59.517668 25396 raft_consensus.cc:3055] T 22196caba61445d3bec98a0aab3c337d P e5256d91808b47c195bc9b4dbd7f2b87 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:06:59.497596 25411 raft_consensus.cc:2749] T 0afb57ae58a24a01850491d69f0213dd P e61c3a8f61bb48f8a963c9480e53c168 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:06:59.506565 25530 consensus_meta.cc:287] T 76cb037fc9064d13b59a8969d897ce8c P 0473d2b2d01f4459b1e90fd12cc7840e: Time spent flushing consensus metadata: real 0.590s	user 0.009s	sys 0.004s
I20260709 13:06:59.528208 19410 rpcz_store.cc:276] 0709 13:06:58.390492 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:58.919569 (+529077us) service_pool.cc:224] Handling call
0709 13:06:58.919964 (+   395us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:59.000497 (+ 80533us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:59.000529 (+    32us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:59.058222 (+ 57693us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:06:59.058283 (+    61us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:59.518616 (+460333us) spinlock_profiling.cc:243] Waited 76.2 ms on lock 0x7b5400239e54. stack: 00007f4a79de9343 00007f4a79de9240 00007f4a797781d4 00007f4a834b6304 00007f4a834b6299 00007f4a7ce71571 00007f4a7cf08e01 00007f4a7cf0783e 00007f4a81ecc419 00007f4a7b443bd4 00007f4a7b443b62 00007f4a7b443a91 00007f4a7b443a0c 00007f4a7b442cc2 00007f4a7b24348c 00007f4a7b2428c6
0709 13:06:59.518762 (+   146us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:59.518955 (+   193us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":175184256}
W20260709 13:06:59.535245 19375 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.3:36891, user_credentials={real_user=slave}} blocked reactor thread for 64025.9us
I20260709 13:06:59.531493 25261 raft_consensus.cc:3060] T df751f992649444090e27965eb1af85d P 0473d2b2d01f4459b1e90fd12cc7840e [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:06:59.540294 19526 leader_election.cc:304] T 28af091831594f9d8e96482078cc7625 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e61c3a8f61bb48f8a963c9480e53c168; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:06:59.541653 19526 leader_election.cc:304] T 1efebf73c86e432baa55533136b6e12c P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e61c3a8f61bb48f8a963c9480e53c168; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, 127766fc592545a4997f7790f50f6076
I20260709 13:06:59.533492 25396 raft_consensus.cc:740] T 22196caba61445d3bec98a0aab3c337d P e5256d91808b47c195bc9b4dbd7f2b87 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: e5256d91808b47c195bc9b4dbd7f2b87, State: Running, Role: LEADER
I20260709 13:06:59.542900 25708 raft_consensus.cc:2804] T 86a6797bdfe94fa496c050ceae4bd0d9 P 0473d2b2d01f4459b1e90fd12cc7840e [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:06:59.543103 19553 raft_consensus.cc:1240] T ff75a1d4cb1f493db8f71ddc136ba9ab P e61c3a8f61bb48f8a963c9480e53c168 [term 19 FOLLOWER]: Rejecting Update request from peer 0473d2b2d01f4459b1e90fd12cc7840e for earlier term 18. Current term is 19. Ops: [18.10-18.10]
I20260709 13:06:59.543207 19402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc225c93219c45538b53a1bd3d387e4d" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: true dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
I20260709 13:06:59.543965 19402 raft_consensus.cc:3055] T bc225c93219c45538b53a1bd3d387e4d P e5256d91808b47c195bc9b4dbd7f2b87 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:06:59.543556 25396 consensus_queue.cc:260] T 22196caba61445d3bec98a0aab3c337d P e5256d91808b47c195bc9b4dbd7f2b87 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:59.544260 19402 raft_consensus.cc:740] T bc225c93219c45538b53a1bd3d387e4d P e5256d91808b47c195bc9b4dbd7f2b87 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: e5256d91808b47c195bc9b4dbd7f2b87, State: Running, Role: LEADER
I20260709 13:06:59.544736 25396 raft_consensus.cc:3060] T 22196caba61445d3bec98a0aab3c337d P e5256d91808b47c195bc9b4dbd7f2b87 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:06:59.544274 25661 raft_consensus.cc:2749] T 28af091831594f9d8e96482078cc7625 P e61c3a8f61bb48f8a963c9480e53c168 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:06:59.544996 19402 consensus_queue.cc:260] T bc225c93219c45538b53a1bd3d387e4d P e5256d91808b47c195bc9b4dbd7f2b87 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:59.545914 25661 raft_consensus.cc:2749] T 1efebf73c86e432baa55533136b6e12c P e61c3a8f61bb48f8a963c9480e53c168 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:06:59.546145 19402 raft_consensus.cc:3060] T bc225c93219c45538b53a1bd3d387e4d P e5256d91808b47c195bc9b4dbd7f2b87 [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:06:59.535828 19483 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58286 (request call id 2580) took 1404 ms (client timeout 1500 ms). Trace:
I20260709 13:06:59.509948 25690 raft_consensus.cc:2804] T 4af19371ea874c09a0a2147040835cbb P e5256d91808b47c195bc9b4dbd7f2b87 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:06:59.559018 20104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48824d5acfbc485ebf8c2d944e7202de" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:06:59.559018 19405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "172b3dd13109415a955b71ac0e9d2234" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
I20260709 13:06:59.537930 19375 leader_election.cc:304] T ff75a1d4cb1f493db8f71ddc136ba9ab P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:06:59.527815 25685 raft_consensus.cc:3060] T e381f1d6b8184797ad142de49be225a8 P e5256d91808b47c195bc9b4dbd7f2b87 [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:06:59.554198 19483 rpcz_store.cc:269] 0709 13:06:58.178781 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:58.193335 (+ 14554us) service_pool.cc:224] Handling call
0709 13:06:59.519817 (+1326482us) spinlock_profiling.cc:243] Waited 1.01 s on lock 0x7b5400224054. stack: 00007f4a79de9343 00007f4a79de9240 00007f4a797781d4 00007f4a834b6304 00007f4a834b6299 00007f4a7ce71571 00007f4a7cf0c2fa 00007f4a81ecdb17 00007f4a7b4486d4 00007f4a7b448662 00007f4a7b448591 00007f4a7b44850c 00007f4a7b4477c2 00007f4a7b24348c 00007f4a7b2428c6 00007f4a7b24226f
0709 13:06:59.527080 (+  7263us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2315872512}
I20260709 13:06:59.565248 19559 raft_consensus.cc:1275] T ef32ce6fdd0e40d382c79974f30295c6 P e61c3a8f61bb48f8a963c9480e53c168 [term 21 FOLLOWER]: Refusing update from remote peer e5256d91808b47c195bc9b4dbd7f2b87: Log matching property violated. Preceding OpId in replica: term: 18 index: 10. Preceding OpId from leader: term: 21 index: 12. (index mismatch)
W20260709 13:06:59.573657 19452 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:59.575953 20106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab43d85f64114d4ebf618930e43d9ed0" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:06:59.578918 20107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ece3db938bc649d4a40a51522ed5259c" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:06:59.580662 20105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa731b585f684a7fb2d106c50f143b83" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
W20260709 13:06:59.582263 20078 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.2:46257, user_credentials={real_user=slave}} blocked reactor thread for 155134us
I20260709 13:06:59.575364 25056 raft_consensus.cc:2804] T fa731b585f684a7fb2d106c50f143b83 P e5256d91808b47c195bc9b4dbd7f2b87 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:06:59.556118 25445 raft_consensus.cc:697] T 0e1085d23e8347fbbd5bce7542f4b1f4 P e61c3a8f61bb48f8a963c9480e53c168 [term 13 LEADER]: Becoming Leader. State: Replica: e61c3a8f61bb48f8a963c9480e53c168, State: Running, Role: LEADER
I20260709 13:06:59.559408 25690 raft_consensus.cc:493] T 4af19371ea874c09a0a2147040835cbb P e5256d91808b47c195bc9b4dbd7f2b87 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 127766fc592545a4997f7790f50f6076)
I20260709 13:06:59.578824 19407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cdf56e38bbc453d9438d359e5a69955" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:06:59.575459 25724 raft_consensus.cc:2804] T ff75a1d4cb1f493db8f71ddc136ba9ab P e5256d91808b47c195bc9b4dbd7f2b87 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:06:59.595075 25599 leader_election.cc:290] T ed7fdbcb96d14d418db9ca90a792588a P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:06:59.597226 19555 raft_consensus.cc:1240] T edd7d470b5014c9489be7f41f64355c9 P e61c3a8f61bb48f8a963c9480e53c168 [term 21 FOLLOWER]: Rejecting Update request from peer 0473d2b2d01f4459b1e90fd12cc7840e for earlier term 20. Current term is 21. Ops: [20.11-20.11]
I20260709 13:06:59.596247 25677 raft_consensus.cc:493] T 309c3ca0ca4b4f3ba129752ea2cb293b P e61c3a8f61bb48f8a963c9480e53c168 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:59.598713 25712 raft_consensus.cc:493] T 21e14947d70440f19044d8f75c31e1f9 P e61c3a8f61bb48f8a963c9480e53c168 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader e5256d91808b47c195bc9b4dbd7f2b87)
I20260709 13:06:59.598886 25677 raft_consensus.cc:515] T 309c3ca0ca4b4f3ba129752ea2cb293b P e61c3a8f61bb48f8a963c9480e53c168 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } attrs { replace: true } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:59.600080 19526 leader_election.cc:304] T 2e36a9d6e29c4a7c860cf267efbd4c74 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e61c3a8f61bb48f8a963c9480e53c168; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:06:59.600179 19405 raft_consensus.cc:3060] T 172b3dd13109415a955b71ac0e9d2234 P e5256d91808b47c195bc9b4dbd7f2b87 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:06:59.595475 25705 raft_consensus.cc:493] T b9f0d59553ad444883fcf5b5909f9798 P e5256d91808b47c195bc9b4dbd7f2b87 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 0473d2b2d01f4459b1e90fd12cc7840e)
I20260709 13:06:59.554502 25530 raft_consensus.cc:515] T 76cb037fc9064d13b59a8969d897ce8c P 0473d2b2d01f4459b1e90fd12cc7840e [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:59.608975 25677 leader_election.cc:290] T 309c3ca0ca4b4f3ba129752ea2cb293b P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:06:59.610286 25445 consensus_queue.cc:237] T 0e1085d23e8347fbbd5bce7542f4b1f4 P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
W20260709 13:06:59.597044 25496 consensus_meta.cc:287] T f93ee515a9c14139bf566522ed8232f3 P e5256d91808b47c195bc9b4dbd7f2b87: Time spent flushing consensus metadata: real 0.805s	user 0.006s	sys 0.013s
I20260709 13:06:59.611100 25450 raft_consensus.cc:515] T b08304a0a02b42d7840c4e8ee9a6bd1a P 0473d2b2d01f4459b1e90fd12cc7840e [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:59.612191 19407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a61655d99124a29b486ba4a5b37faea" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 17 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:06:59.585289 25623 raft_consensus.cc:493] T 3e1f505cb0f1427bbd698ac889d80821 P 0473d2b2d01f4459b1e90fd12cc7840e [term 19 FOLLOWER]: Starting pre-election (detected failure of leader e61c3a8f61bb48f8a963c9480e53c168)
I20260709 13:06:59.588469 25056 raft_consensus.cc:493] T fa731b585f684a7fb2d106c50f143b83 P e5256d91808b47c195bc9b4dbd7f2b87 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 127766fc592545a4997f7790f50f6076)
I20260709 13:06:59.596493 25086 raft_consensus.cc:493] T 7be9efa6559648dbb5a0f7684c4542d1 P e61c3a8f61bb48f8a963c9480e53c168 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader e5256d91808b47c195bc9b4dbd7f2b87)
I20260709 13:06:59.622078 19403 raft_consensus.cc:2468] T 309c3ca0ca4b4f3ba129752ea2cb293b P e5256d91808b47c195bc9b4dbd7f2b87 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 12.
I20260709 13:06:59.603574 19557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48824d5acfbc485ebf8c2d944e7202de" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 21 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:06:59.593750 25690 raft_consensus.cc:3060] T 4af19371ea874c09a0a2147040835cbb P e5256d91808b47c195bc9b4dbd7f2b87 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:06:59.645315 25711 log.cc:927] Time spent T 5ec1c4ce15e04c7e8c283a62179f2a64 P 0473d2b2d01f4459b1e90fd12cc7840e: Append to log took a long time: real 0.247s	user 0.001s	sys 0.001s
I20260709 13:06:59.645545 25086 raft_consensus.cc:515] T 7be9efa6559648dbb5a0f7684c4542d1 P e61c3a8f61bb48f8a963c9480e53c168 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } attrs { replace: true } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:59.648471 25086 leader_election.cc:290] T 7be9efa6559648dbb5a0f7684c4542d1 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:06:59.648552 25450 leader_election.cc:290] T b08304a0a02b42d7840c4e8ee9a6bd1a P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 19 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:06:59.649042 25086 raft_consensus.cc:493] T 0cdf56e38bbc453d9438d359e5a69955 P e61c3a8f61bb48f8a963c9480e53c168 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader e5256d91808b47c195bc9b4dbd7f2b87)
I20260709 13:06:59.649611 25086 raft_consensus.cc:515] T 0cdf56e38bbc453d9438d359e5a69955 P e61c3a8f61bb48f8a963c9480e53c168 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:59.645200 25411 raft_consensus.cc:2749] T 2e36a9d6e29c4a7c860cf267efbd4c74 P e61c3a8f61bb48f8a963c9480e53c168 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:06:59.651109 19403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22196caba61445d3bec98a0aab3c337d" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:06:59.599565 25712 raft_consensus.cc:515] T 21e14947d70440f19044d8f75c31e1f9 P e61c3a8f61bb48f8a963c9480e53c168 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:59.626484 25722 consensus_queue.cc:1048] T 62c6c134d3d24a1ab144dd9ee6bc3f64 P 127766fc592545a4997f7790f50f6076 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.004s
I20260709 13:06:59.625208 25724 raft_consensus.cc:697] T ff75a1d4cb1f493db8f71ddc136ba9ab P e5256d91808b47c195bc9b4dbd7f2b87 [term 19 LEADER]: Becoming Leader. State: Replica: e5256d91808b47c195bc9b4dbd7f2b87, State: Running, Role: LEADER
I20260709 13:06:59.632416 25530 leader_election.cc:290] T 76cb037fc9064d13b59a8969d897ce8c P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 17 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:06:59.620289 25553 raft_consensus.cc:2749] T b9f0d59553ad444883fcf5b5909f9798 P e61c3a8f61bb48f8a963c9480e53c168 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:06:59.627095 25705 raft_consensus.cc:515] T b9f0d59553ad444883fcf5b5909f9798 P e5256d91808b47c195bc9b4dbd7f2b87 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
W20260709 13:06:59.634070 25716 log.cc:927] Time spent T b9f0d59553ad444883fcf5b5909f9798 P 0473d2b2d01f4459b1e90fd12cc7840e: Append to log took a long time: real 0.101s	user 0.000s	sys 0.000s
I20260709 13:06:59.635056 19555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c5eebf646ad445a9d1b1adc319d7b16" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:06:59.635622 25673 leader_election.cc:290] T e381f1d6b8184797ad142de49be225a8 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 16 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
W20260709 13:06:59.642191 19449 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.4:43121, user_credentials={real_user=slave}} blocked reactor thread for 88110.8us
I20260709 13:06:59.652824 25086 leader_election.cc:290] T 0cdf56e38bbc453d9438d359e5a69955 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:06:59.642767 19407 raft_consensus.cc:2410] T 1a61655d99124a29b486ba4a5b37faea P e5256d91808b47c195bc9b4dbd7f2b87 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0473d2b2d01f4459b1e90fd12cc7840e for term 17 because replica has last-logged OpId of term: 14 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 9.
I20260709 13:06:59.644065 19557 raft_consensus.cc:2468] T 48824d5acfbc485ebf8c2d944e7202de P e61c3a8f61bb48f8a963c9480e53c168 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 127766fc592545a4997f7790f50f6076 in term 20.
I20260709 13:06:59.645123 25056 raft_consensus.cc:3060] T fa731b585f684a7fb2d106c50f143b83 P e5256d91808b47c195bc9b4dbd7f2b87 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:06:59.626230 20107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70797e5783b5454ab0d0eea663e791e3" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 21 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:06:59.651031 19479 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39478 (request call id 991) took 1604 ms. Trace:
I20260709 13:06:59.627810 25587 leader_election.cc:290] T 833a2f0775ed407a94b8924ce50adb63 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
W20260709 13:06:59.672853 20078 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.2:46257, user_credentials={real_user=slave}} blocked reactor thread for 65840.3us
W20260709 13:06:59.634510 25462 consensus_meta.cc:287] T 2b74109013a140ada21feeef92d6f563 P 0473d2b2d01f4459b1e90fd12cc7840e: Time spent flushing consensus metadata: real 0.769s	user 0.002s	sys 0.008s
I20260709 13:06:59.670552 19449 leader_election.cc:304] T 96efeaaf1057492490e9a621f37e1a2d P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e; no voters: 127766fc592545a4997f7790f50f6076, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:06:59.672438 19557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0afb57ae58a24a01850491d69f0213dd" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:06:59.679463 20105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62c6c134d3d24a1ab144dd9ee6bc3f64" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:06:59.660941 25704 leader_election.cc:290] T 217b5fae677b4971b3bbd2f357a1f7ff P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:06:59.663290 25623 raft_consensus.cc:515] T 3e1f505cb0f1427bbd698ac889d80821 P 0473d2b2d01f4459b1e90fd12cc7840e [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:59.685448 25623 leader_election.cc:290] T 3e1f505cb0f1427bbd698ac889d80821 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:06:59.687318 19411 raft_consensus.cc:1275] T 217b5fae677b4971b3bbd2f357a1f7ff P e5256d91808b47c195bc9b4dbd7f2b87 [term 14 FOLLOWER]: Refusing update from remote peer 0473d2b2d01f4459b1e90fd12cc7840e: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 13:06:59.689510 19551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e1085d23e8347fbbd5bce7542f4b1f4" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:06:59.691015 25580 leader_election.cc:290] T fa8650e71aa14778b3d73721fc50d9fc P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 18 election: Requested vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:06:59.500138 18300 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:06:59.672732 20107 raft_consensus.cc:2468] T 70797e5783b5454ab0d0eea663e791e3 P 127766fc592545a4997f7790f50f6076 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 20.
I20260709 13:06:59.671554 20076 leader_election.cc:304] T 48824d5acfbc485ebf8c2d944e7202de P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 127766fc592545a4997f7790f50f6076, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:06:59.641898 25496 raft_consensus.cc:515] T f93ee515a9c14139bf566522ed8232f3 P e5256d91808b47c195bc9b4dbd7f2b87 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:59.699064 19449 leader_election.cc:304] T 5ec1c4ce15e04c7e8c283a62179f2a64 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e; no voters: 127766fc592545a4997f7790f50f6076, e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:06:59.667138 25305 leader_election.cc:290] T 65d8cb8d6ec64f459d5a47cefab10acf P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 19 election: Requested vote from peers e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:06:59.700649 19406 raft_consensus.cc:2410] T edd7d470b5014c9489be7f41f64355c9 P e5256d91808b47c195bc9b4dbd7f2b87 [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate e61c3a8f61bb48f8a963c9480e53c168 for term 21 because replica has last-logged OpId of term: 20 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 18 index: 10.
I20260709 13:06:59.672631 19479 rpcz_store.cc:276] 0709 13:06:58.046972 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:58.731670 (+684698us) service_pool.cc:224] Handling call
0709 13:06:58.764630 (+ 32960us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:58.771327 (+  6697us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:58.771363 (+    36us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:58.819951 (+ 48588us) log.cc:844] Serialized 26 byte log entry
0709 13:06:59.176906 (+356955us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:06:59.176961 (+    55us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:59.177060 (+    99us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:59.650764 (+473704us) raft_consensus.cc:1685] finished
0709 13:06:59.650796 (+    32us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:59.650962 (+   166us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1370,"raft.run_cpu_time_us":129,"raft.run_wall_time_us":2383,"thread_start_us":304487,"threads_started":1,"wal-append.queue_time_us":485608}
I20260709 13:06:59.705847 25724 consensus_queue.cc:237] T ff75a1d4cb1f493db8f71ddc136ba9ab P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 17.9, Last appended by leader: 9, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
W20260709 13:06:59.708225 25611 consensus_meta.cc:287] T ff9b0eddd810459b82d91c60777c10eb P 127766fc592545a4997f7790f50f6076: Time spent flushing consensus metadata: real 0.640s	user 0.009s	sys 0.000s
I20260709 13:06:59.708616 25611 raft_consensus.cc:515] T ff9b0eddd810459b82d91c60777c10eb P 127766fc592545a4997f7790f50f6076 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:59.709023 19402 raft_consensus.cc:2468] T bc225c93219c45538b53a1bd3d387e4d P e5256d91808b47c195bc9b4dbd7f2b87 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 15.
I20260709 13:06:59.710052 20104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed7fdbcb96d14d418db9ca90a792588a" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 16 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
W20260709 13:06:59.711774 25721 log.cc:927] Time spent T ff9b0eddd810459b82d91c60777c10eb P 0473d2b2d01f4459b1e90fd12cc7840e: Append to log took a long time: real 0.069s	user 0.000s	sys 0.000s
I20260709 13:06:59.710115 19402 raft_consensus.cc:1240] T edd7d470b5014c9489be7f41f64355c9 P e5256d91808b47c195bc9b4dbd7f2b87 [term 21 FOLLOWER]: Rejecting Update request from peer 0473d2b2d01f4459b1e90fd12cc7840e for earlier term 20. Current term is 21. Ops: []
I20260709 13:06:59.718997 19449 leader_election.cc:304] T 9962423cb4e54fcfa5de01daf68a86e7 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e; no voters: 127766fc592545a4997f7790f50f6076, e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:06:59.720252 20105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f85fc4b527a48848e5faa083b604e36" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076"
W20260709 13:06:59.721266 19526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.2:46257, user_credentials={real_user=slave}} blocked reactor thread for 143155us
I20260709 13:06:59.722386 19555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70797e5783b5454ab0d0eea663e791e3" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 21 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:06:59.723197 19555 raft_consensus.cc:2468] T 70797e5783b5454ab0d0eea663e791e3 P e61c3a8f61bb48f8a963c9480e53c168 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 127766fc592545a4997f7790f50f6076 in term 20.
I20260709 13:06:59.695382 25462 raft_consensus.cc:515] T 2b74109013a140ada21feeef92d6f563 P 0473d2b2d01f4459b1e90fd12cc7840e [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:59.728235 25462 leader_election.cc:290] T 2b74109013a140ada21feeef92d6f563 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 16 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:06:59.730919 20107 raft_consensus.cc:1240] T ff9b0eddd810459b82d91c60777c10eb P 127766fc592545a4997f7790f50f6076 [term 18 FOLLOWER]: Rejecting Update request from peer 0473d2b2d01f4459b1e90fd12cc7840e for earlier term 17. Current term is 18. Ops: [17.13-17.13]
I20260709 13:06:59.736128 19449 leader_election.cc:304] T 14efcc79969f41babe5529c22d59156d P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e; no voters: 127766fc592545a4997f7790f50f6076, e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:06:59.715655 25261 raft_consensus.cc:515] T df751f992649444090e27965eb1af85d P 0473d2b2d01f4459b1e90fd12cc7840e [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:59.704361 25623 raft_consensus.cc:2749] T 96efeaaf1057492490e9a621f37e1a2d P 0473d2b2d01f4459b1e90fd12cc7840e [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:06:59.743009 19404 raft_consensus.cc:2393] T f93ee515a9c14139bf566522ed8232f3 P e5256d91808b47c195bc9b4dbd7f2b87 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e61c3a8f61bb48f8a963c9480e53c168 in current term 21: Already voted for candidate e5256d91808b47c195bc9b4dbd7f2b87 in this term.
I20260709 13:06:59.748469 19377 leader_election.cc:304] T df751f992649444090e27965eb1af85d P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87; no voters: e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:06:59.718152 25598 raft_consensus.cc:493] T ece3db938bc649d4a40a51522ed5259c P e5256d91808b47c195bc9b4dbd7f2b87 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 127766fc592545a4997f7790f50f6076)
I20260709 13:06:59.748538 20112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "309c3ca0ca4b4f3ba129752ea2cb293b" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076"
I20260709 13:06:59.761528 20103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed7fdbcb96d14d418db9ca90a792588a" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:06:59.762563 20109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "309c3ca0ca4b4f3ba129752ea2cb293b" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:06:59.764762 20109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14935b3ddf914369822e4a0547aaa355" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:06:59.767124 25587 raft_consensus.cc:2804] T df751f992649444090e27965eb1af85d P e5256d91808b47c195bc9b4dbd7f2b87 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:06:59.767737 25587 raft_consensus.cc:493] T df751f992649444090e27965eb1af85d P e5256d91808b47c195bc9b4dbd7f2b87 [term 20 FOLLOWER]: Starting leader election (detected failure of leader e61c3a8f61bb48f8a963c9480e53c168)
I20260709 13:06:59.767869 19484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2725d2c4cb054f18b0fc8f735c15f6c2" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:06:59.768165 25587 raft_consensus.cc:3060] T df751f992649444090e27965eb1af85d P e5256d91808b47c195bc9b4dbd7f2b87 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:06:59.750121 25376 raft_consensus.cc:2749] T 9962423cb4e54fcfa5de01daf68a86e7 P 0473d2b2d01f4459b1e90fd12cc7840e [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:06:59.770879 25712 leader_election.cc:290] T 21e14947d70440f19044d8f75c31e1f9 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:06:59.771417 19483 raft_consensus.cc:1240] T b08304a0a02b42d7840c4e8ee9a6bd1a P 0473d2b2d01f4459b1e90fd12cc7840e [term 19 FOLLOWER]: Rejecting Update request from peer e61c3a8f61bb48f8a963c9480e53c168 for earlier term 18. Current term is 19. Ops: []
I20260709 13:06:59.772545 19480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48824d5acfbc485ebf8c2d944e7202de" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:06:59.773671 19486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f93ee515a9c14139bf566522ed8232f3" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 21 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:06:59.774730 25678 leader_election.cc:290] T ef32ce6fdd0e40d382c79974f30295c6 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:06:59.775027 19485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b74109013a140ada21feeef92d6f563" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:06:59.775729 19485 raft_consensus.cc:2393] T 2b74109013a140ada21feeef92d6f563 P 0473d2b2d01f4459b1e90fd12cc7840e [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e61c3a8f61bb48f8a963c9480e53c168 in current term 16: Already voted for candidate 0473d2b2d01f4459b1e90fd12cc7840e in this term.
W20260709 13:06:59.776497 19308 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:44698 (request call id 233) took 41852 ms (client timeout 15000 ms). Trace:
W20260709 13:06:59.776811 25359 consensus_meta.cc:287] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P 127766fc592545a4997f7790f50f6076: Time spent flushing consensus metadata: real 0.540s	user 0.009s	sys 0.000s
I20260709 13:06:59.777917 19526 leader_election.cc:304] T 6c5eebf646ad445a9d1b1adc319d7b16 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e61c3a8f61bb48f8a963c9480e53c168; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, 127766fc592545a4997f7790f50f6076
I20260709 13:06:59.778201 19478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dc5b3532fe54f74876d02beffa2c230" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 20 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:06:59.778832 19478 raft_consensus.cc:2468] T 1dc5b3532fe54f74876d02beffa2c230 P 0473d2b2d01f4459b1e90fd12cc7840e [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 19.
I20260709 13:06:59.767186 25705 leader_election.cc:290] T b9f0d59553ad444883fcf5b5909f9798 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:06:59.732784 25622 raft_consensus.cc:2749] T 5ec1c4ce15e04c7e8c283a62179f2a64 P 0473d2b2d01f4459b1e90fd12cc7840e [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:06:59.781061 20105 raft_consensus.cc:2410] T 1f85fc4b527a48848e5faa083b604e36 P 127766fc592545a4997f7790f50f6076 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 0473d2b2d01f4459b1e90fd12cc7840e for term 17 because replica has last-logged OpId of term: 16 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 12.
I20260709 13:06:59.776384 25587 raft_consensus.cc:515] T df751f992649444090e27965eb1af85d P e5256d91808b47c195bc9b4dbd7f2b87 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:59.785004 25221 consensus_queue.cc:1048] T 14935b3ddf914369822e4a0547aaa355 P 127766fc592545a4997f7790f50f6076 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.084s
I20260709 13:06:59.777662 20110 raft_consensus.cc:2468] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P 127766fc592545a4997f7790f50f6076 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 19.
I20260709 13:06:59.733467 25580 raft_consensus.cc:493] T 14935b3ddf914369822e4a0547aaa355 P e5256d91808b47c195bc9b4dbd7f2b87 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:06:59.788856 20076 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.3:36891, user_credentials={real_user=slave}} blocked reactor thread for 117396us
I20260709 13:06:59.716594 25690 raft_consensus.cc:515] T 4af19371ea874c09a0a2147040835cbb P e5256d91808b47c195bc9b4dbd7f2b87 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:59.757890 25597 raft_consensus.cc:2749] T 14efcc79969f41babe5529c22d59156d P 0473d2b2d01f4459b1e90fd12cc7840e [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:06:59.792583 19402 raft_consensus.cc:1240] T 309c3ca0ca4b4f3ba129752ea2cb293b P e5256d91808b47c195bc9b4dbd7f2b87 [term 12 FOLLOWER]: Rejecting Update request from peer 127766fc592545a4997f7790f50f6076 for earlier term 11. Current term is 12. Ops: []
I20260709 13:06:59.792768 19479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e381f1d6b8184797ad142de49be225a8" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:06:59.783241 25678 raft_consensus.cc:2749] T 6c5eebf646ad445a9d1b1adc319d7b16 P e61c3a8f61bb48f8a963c9480e53c168 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:06:59.803913 19479 raft_consensus.cc:2393] T e381f1d6b8184797ad142de49be225a8 P 0473d2b2d01f4459b1e90fd12cc7840e [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e61c3a8f61bb48f8a963c9480e53c168 in current term 16: Already voted for candidate 0473d2b2d01f4459b1e90fd12cc7840e in this term.
I20260709 13:06:59.838637 19523 leader_election.cc:304] T 70797e5783b5454ab0d0eea663e791e3 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 127766fc592545a4997f7790f50f6076, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:06:59.789508 25435 raft_consensus.cc:493] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P 127766fc592545a4997f7790f50f6076 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:59.842986 25615 raft_consensus.cc:2804] T 48824d5acfbc485ebf8c2d944e7202de P 127766fc592545a4997f7790f50f6076 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:06:59.844671 25713 leader_election.cc:290] T f1b10566f45d4a7d9029858330e02d5b P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:06:59.847831 25261 leader_election.cc:290] T df751f992649444090e27965eb1af85d P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 21 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:06:59.847963 19407 raft_consensus.cc:1240] T ff75a1d4cb1f493db8f71ddc136ba9ab P e5256d91808b47c195bc9b4dbd7f2b87 [term 19 LEADER]: Rejecting Update request from peer 0473d2b2d01f4459b1e90fd12cc7840e for earlier term 18. Current term is 19. Ops: []
I20260709 13:06:59.848716 20108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "172b3dd13109415a955b71ac0e9d2234" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076"
W20260709 13:06:59.855084 19526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.2:46257, user_credentials={real_user=slave}} blocked reactor thread for 75735.3us
I20260709 13:06:59.855911 25587 leader_election.cc:290] T df751f992649444090e27965eb1af85d P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 21 election: Requested vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:06:59.856760 19558 raft_consensus.cc:1275] T ab43d85f64114d4ebf618930e43d9ed0 P e61c3a8f61bb48f8a963c9480e53c168 [term 19 FOLLOWER]: Refusing update from remote peer 127766fc592545a4997f7790f50f6076: Log matching property violated. Preceding OpId in replica: term: 18 index: 12. Preceding OpId from leader: term: 19 index: 13. (index mismatch)
W20260709 13:06:59.862345 19452 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:59.874719 19555 raft_consensus.cc:1275] T ed7fdbcb96d14d418db9ca90a792588a P e61c3a8f61bb48f8a963c9480e53c168 [term 15 FOLLOWER]: Refusing update from remote peer 127766fc592545a4997f7790f50f6076: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 13:06:59.885841 19526 leader_election.cc:304] T 40e1e16737a842ee936002830f36882e P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:06:59.881945 25677 raft_consensus.cc:2804] T 70797e5783b5454ab0d0eea663e791e3 P e61c3a8f61bb48f8a963c9480e53c168 [term 20 FOLLOWER]: Leader pre-election won for term 21
W20260709 13:06:59.877700 25702 log.cc:927] Time spent T ff9b0eddd810459b82d91c60777c10eb P e5256d91808b47c195bc9b4dbd7f2b87: Append to log took a long time: real 0.075s	user 0.000s	sys 0.000s
I20260709 13:06:59.898191 25677 raft_consensus.cc:493] T 70797e5783b5454ab0d0eea663e791e3 P e61c3a8f61bb48f8a963c9480e53c168 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:59.898398 20108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7be9efa6559648dbb5a0f7684c4542d1" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:06:59.898648 25715 raft_consensus.cc:2804] T 40e1e16737a842ee936002830f36882e P e61c3a8f61bb48f8a963c9480e53c168 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:06:59.898904 25677 raft_consensus.cc:3060] T 70797e5783b5454ab0d0eea663e791e3 P e61c3a8f61bb48f8a963c9480e53c168 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:06:59.899199 25715 raft_consensus.cc:493] T 40e1e16737a842ee936002830f36882e P e61c3a8f61bb48f8a963c9480e53c168 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:59.899597 25715 raft_consensus.cc:3060] T 40e1e16737a842ee936002830f36882e P e61c3a8f61bb48f8a963c9480e53c168 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:06:59.871681 25615 raft_consensus.cc:493] T 48824d5acfbc485ebf8c2d944e7202de P 127766fc592545a4997f7790f50f6076 [term 20 FOLLOWER]: Starting leader election (detected failure of leader 0473d2b2d01f4459b1e90fd12cc7840e)
I20260709 13:06:59.902915 25615 raft_consensus.cc:3060] T 48824d5acfbc485ebf8c2d944e7202de P 127766fc592545a4997f7790f50f6076 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:06:59.880198 25712 raft_consensus.cc:493] T 2a16f7501e2444fb86d4e2778e734e02 P e61c3a8f61bb48f8a963c9480e53c168 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 127766fc592545a4997f7790f50f6076)
I20260709 13:06:59.903540 25712 raft_consensus.cc:515] T 2a16f7501e2444fb86d4e2778e734e02 P e61c3a8f61bb48f8a963c9480e53c168 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:59.905555 25712 leader_election.cc:290] T 2a16f7501e2444fb86d4e2778e734e02 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:06:59.906018 25712 raft_consensus.cc:493] T 1a61655d99124a29b486ba4a5b37faea P e61c3a8f61bb48f8a963c9480e53c168 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:06:59.908392 20077 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:59.891237 25434 consensus_meta.cc:287] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P 0473d2b2d01f4459b1e90fd12cc7840e: Time spent flushing consensus metadata: real 0.504s	user 0.006s	sys 0.004s
I20260709 13:06:59.918319 19411 raft_consensus.cc:1240] T f93ee515a9c14139bf566522ed8232f3 P e5256d91808b47c195bc9b4dbd7f2b87 [term 21 FOLLOWER]: Rejecting Update request from peer 0473d2b2d01f4459b1e90fd12cc7840e for earlier term 20. Current term is 21. Ops: [20.10-20.10]
I20260709 13:06:59.918578 25434 raft_consensus.cc:515] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P 0473d2b2d01f4459b1e90fd12cc7840e [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:59.919807 20112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e1085d23e8347fbbd5bce7542f4b1f4" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076"
I20260709 13:06:59.920354 20112 raft_consensus.cc:3060] T 0e1085d23e8347fbbd5bce7542f4b1f4 P 127766fc592545a4997f7790f50f6076 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:06:59.923949 25093 raft_consensus.cc:493] T 2b74109013a140ada21feeef92d6f563 P e5256d91808b47c195bc9b4dbd7f2b87 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:59.924242 19477 raft_consensus.cc:1240] T 7be9efa6559648dbb5a0f7684c4542d1 P 0473d2b2d01f4459b1e90fd12cc7840e [term 18 FOLLOWER]: Rejecting Update request from peer e5256d91808b47c195bc9b4dbd7f2b87 for earlier term 17. Current term is 18. Ops: [17.11-17.11]
I20260709 13:06:59.924414 25093 raft_consensus.cc:3060] T 2b74109013a140ada21feeef92d6f563 P e5256d91808b47c195bc9b4dbd7f2b87 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:06:59.925477 19485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ec1c4ce15e04c7e8c283a62179f2a64" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:06:59.926873 19486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff75a1d4cb1f493db8f71ddc136ba9ab" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:06:59.794740 25598 raft_consensus.cc:515] T ece3db938bc649d4a40a51522ed5259c P e5256d91808b47c195bc9b4dbd7f2b87 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:59.906582 25677 raft_consensus.cc:515] T 70797e5783b5454ab0d0eea663e791e3 P e61c3a8f61bb48f8a963c9480e53c168 [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:59.917464 19404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70797e5783b5454ab0d0eea663e791e3" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 21 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:06:59.917902 25690 leader_election.cc:290] T 4af19371ea874c09a0a2147040835cbb P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 9 election: Requested vote from peers e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:06:59.927947 19526 leader_election.cc:304] T 217b5fae677b4971b3bbd2f357a1f7ff P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e61c3a8f61bb48f8a963c9480e53c168; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:06:59.883044 25730 raft_consensus.cc:493] T 7be9efa6559648dbb5a0f7684c4542d1 P 127766fc592545a4997f7790f50f6076 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:59.938037 19484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa8650e71aa14778b3d73721fc50d9fc" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:06:59.945891 19480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "179fd671030940b4b4a4e24bcc4aba0a" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
W20260709 13:06:59.776980 19308 rpcz_store.cc:269] 0709 13:06:17.923988 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:17.924142 (+   154us) service_pool.cc:224] Handling call
0709 13:06:59.776256 (+41852114us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:06:49.950006 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:06:49.950703 (+   697us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:06:49.950752 (+    49us) write_op.cc:435] Acquired schema lock
0709 13:06:49.950771 (+    19us) tablet.cc:662] Decoding operations
0709 13:06:49.951455 (+   684us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:06:49.951557 (+   102us) write_op.cc:641] Partition lock acquired for write op
0709 13:06:49.951583 (+    26us) tablet.cc:685] Acquiring locks for 5 operations
0709 13:06:49.952207 (+   624us) tablet.cc:701] Row locks acquired
0709 13:06:49.952256 (+    49us) write_op.cc:260] PREPARE: finished
0709 13:06:49.952414 (+   158us) write_op.cc:270] Start()
0709 13:06:49.952557 (+   143us) write_op.cc:276] Timestamp: P: 1783602409952350 usec, L: 0
0709 13:06:49.952595 (+    38us) op_driver.cc:348] REPLICATION: starting
0709 13:06:49.953190 (+   595us) log.cc:844] Serialized 2074 byte log entry
0709 13:06:51.563343 (+1610153us) op_driver.cc:464] REPLICATION: finished
0709 13:06:51.808500 (+245157us) write_op.cc:301] APPLY: starting
0709 13:06:51.821346 (+ 12846us) tablet.cc:1367] starting BulkCheckPresence
0709 13:06:52.081379 (+260033us) tablet.cc:1370] finished BulkCheckPresence
0709 13:06:52.107359 (+ 25980us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:06:52.188437 (+ 81078us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:06:52.188757 (+   320us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=10,key_file_lookups=10,delta_file_lookups=10,mrs_lookups=0
0709 13:06:52.188817 (+    60us) write_op.cc:312] APPLY: finished
0709 13:06:52.189148 (+   331us) log.cc:844] Serialized 57 byte log entry
0709 13:06:52.189347 (+   199us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:06:52.189475 (+   128us) write_op.cc:454] Released schema lock
0709 13:06:52.189558 (+    83us) write_op.cc:341] FINISH: Updating metrics
0709 13:06:52.190073 (+   515us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:06:52.190107 (+    34us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":62262,"reported_tablets":51,"child_traces":[["op",{"apply.queue_time_us":232427,"apply.run_cpu_time_us":11437,"apply.run_wall_time_us":381520,"cfile_cache_hit":22,"cfile_cache_hit_bytes":25027,"num_ops":5,"prepare.queue_time_us":151291,"prepare.run_cpu_time_us":48428,"prepare.run_wall_time_us":403022,"raft.queue_time_us":397048,"raft.run_cpu_time_us":23861,"raft.run_wall_time_us":104272,"replication_time_us":1600938,"thread_start_us":557996,"threads_started":4,"wal-append.queue_time_us":352724,"wal-append.run_cpu_time_us":51761,"wal-append.run_wall_time_us":2908437}]]}
I20260709 13:06:59.879959 25435 raft_consensus.cc:515] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P 127766fc592545a4997f7790f50f6076 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:59.952278 19478 raft_consensus.cc:1275] T d1e5873a19244c5ebbcd38e126796ee7 P 0473d2b2d01f4459b1e90fd12cc7840e [term 20 FOLLOWER]: Refusing update from remote peer e5256d91808b47c195bc9b4dbd7f2b87: Log matching property violated. Preceding OpId in replica: term: 17 index: 9. Preceding OpId from leader: term: 20 index: 10. (index mismatch)
I20260709 13:06:59.964515 19477 raft_consensus.cc:1240] T 7f575b143b844aa096b50997dad3516a P 0473d2b2d01f4459b1e90fd12cc7840e [term 15 FOLLOWER]: Rejecting Update request from peer e5256d91808b47c195bc9b4dbd7f2b87 for earlier term 14. Current term is 15. Ops: []
I20260709 13:06:59.906488 25712 raft_consensus.cc:515] T 1a61655d99124a29b486ba4a5b37faea P e61c3a8f61bb48f8a963c9480e53c168 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:06:59.983480 25598 leader_election.cc:290] T ece3db938bc649d4a40a51522ed5259c P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:06:59.984539 25712 leader_election.cc:290] T 1a61655d99124a29b486ba4a5b37faea P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:06:59.984750 25304 leader_election.cc:290] T 3e1f505cb0f1427bbd698ac889d80821 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:06:59.987787 20112 raft_consensus.cc:2468] T 0e1085d23e8347fbbd5bce7542f4b1f4 P 127766fc592545a4997f7790f50f6076 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 14.
I20260709 13:06:59.986352 20103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f85fc4b527a48848e5faa083b604e36" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:06:59.988200 19523 leader_election.cc:304] T 2b74109013a140ada21feeef92d6f563 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:06:59.988698 20112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a16f7501e2444fb86d4e2778e734e02" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:06:59.989739 19523 leader_election.cc:304] T e381f1d6b8184797ad142de49be225a8 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:06:59.991210 25396 raft_consensus.cc:493] T 2e36a9d6e29c4a7c860cf267efbd4c74 P e5256d91808b47c195bc9b4dbd7f2b87 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 0473d2b2d01f4459b1e90fd12cc7840e)
I20260709 13:06:59.953141 19403 raft_consensus.cc:2468] T 22196caba61445d3bec98a0aab3c337d P e5256d91808b47c195bc9b4dbd7f2b87 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 17.
I20260709 13:06:59.931560 25434 leader_election.cc:290] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 20 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:06:59.963292 25086 raft_consensus.cc:2749] T 217b5fae677b4971b3bbd2f357a1f7ff P e61c3a8f61bb48f8a963c9480e53c168 [term 14 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:06:59.951606 25730 raft_consensus.cc:515] T 7be9efa6559648dbb5a0f7684c4542d1 P 127766fc592545a4997f7790f50f6076 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } attrs { replace: true } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:59.877866 25580 raft_consensus.cc:515] T 14935b3ddf914369822e4a0547aaa355 P e5256d91808b47c195bc9b4dbd7f2b87 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } attrs { replace: true } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:06:59.963907 25546 raft_consensus.cc:3055] T 309c3ca0ca4b4f3ba129752ea2cb293b P 127766fc592545a4997f7790f50f6076 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:06:59.968403 25611 leader_election.cc:290] T ff9b0eddd810459b82d91c60777c10eb P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 18 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
W20260709 13:06:59.968888 25732 log.cc:927] Time spent T 14935b3ddf914369822e4a0547aaa355 P 127766fc592545a4997f7790f50f6076: Append to log took a long time: real 0.127s	user 0.001s	sys 0.000s
I20260709 13:06:59.969866 25685 raft_consensus.cc:515] T e381f1d6b8184797ad142de49be225a8 P e5256d91808b47c195bc9b4dbd7f2b87 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:07:00.007648 19523 leader_election.cc:304] T 4509b76741dc428e9201c70c1658da13 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
W20260709 13:06:59.971042 19377 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:59.971025 19483 raft_consensus.cc:1275] T 0cdf56e38bbc453d9438d359e5a69955 P 0473d2b2d01f4459b1e90fd12cc7840e [term 17 FOLLOWER]: Refusing update from remote peer e5256d91808b47c195bc9b4dbd7f2b87: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
W20260709 13:06:59.972294 19526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.2:46257, user_credentials={real_user=slave}} blocked reactor thread for 78468.5us
I20260709 13:06:59.975522 25677 leader_election.cc:290] T 70797e5783b5454ab0d0eea663e791e3 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 21 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:06:59.976130 19484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2725d2c4cb054f18b0fc8f735c15f6c2" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:06:59.979668 25496 leader_election.cc:290] T f93ee515a9c14139bf566522ed8232f3 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 21 election: Requested vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:06:59.980748 19405 raft_consensus.cc:2468] T 172b3dd13109415a955b71ac0e9d2234 P e5256d91808b47c195bc9b4dbd7f2b87 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 17.
I20260709 13:07:00.012246 19405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a08760e15aac4630a629431f56024dc8" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
W20260709 13:06:59.999150 19452 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:59.991741 25553 raft_consensus.cc:2804] T 2b74109013a140ada21feeef92d6f563 P e61c3a8f61bb48f8a963c9480e53c168 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:07:00.014526 19407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa731b585f684a7fb2d106c50f143b83" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:07:00.007467 20112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85c494af21f9457a85da47b9bc70c1fd" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 18 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:07:00.003000 25587 raft_consensus.cc:493] T edd7d470b5014c9489be7f41f64355c9 P e5256d91808b47c195bc9b4dbd7f2b87 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:00.006327 19477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f93ee515a9c14139bf566522ed8232f3" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 21 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:07:00.008507 20103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "833a2f0775ed407a94b8924ce50adb63" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:07:00.048563 19557 raft_consensus.cc:1240] T 70797e5783b5454ab0d0eea663e791e3 P e61c3a8f61bb48f8a963c9480e53c168 [term 21 FOLLOWER]: Rejecting Update request from peer e5256d91808b47c195bc9b4dbd7f2b87 for earlier term 20. Current term is 21. Ops: [20.14-20.14]
W20260709 13:06:59.999722 25520 consensus_meta.cc:287] T ef32ce6fdd0e40d382c79974f30295c6 P 0473d2b2d01f4459b1e90fd12cc7840e: Time spent flushing consensus metadata: real 0.620s	user 0.011s	sys 0.000s
I20260709 13:07:00.052246 19526 leader_election.cc:304] T 179fd671030940b4b4a4e24bcc4aba0a P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e61c3a8f61bb48f8a963c9480e53c168; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:07:00.052760 19404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ece3db938bc649d4a40a51522ed5259c" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:07:00.053000 19523 leader_election.cc:304] T edd7d470b5014c9489be7f41f64355c9 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e61c3a8f61bb48f8a963c9480e53c168; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:06:59.970489 19410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff9b0eddd810459b82d91c60777c10eb" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
I20260709 13:07:00.054215 19557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "833a2f0775ed407a94b8924ce50adb63" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:07:00.006240 25546 raft_consensus.cc:740] T 309c3ca0ca4b4f3ba129752ea2cb293b P 127766fc592545a4997f7790f50f6076 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 127766fc592545a4997f7790f50f6076, State: Running, Role: LEADER
I20260709 13:07:00.007136 25661 raft_consensus.cc:2804] T e381f1d6b8184797ad142de49be225a8 P e61c3a8f61bb48f8a963c9480e53c168 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:07:00.008633 19374 leader_election.cc:304] T 2a16f7501e2444fb86d4e2778e734e02 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87; no voters: 127766fc592545a4997f7790f50f6076, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:07:00.047852 19411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dc5b3532fe54f74876d02beffa2c230" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 20 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:07:00.009013 25705 raft_consensus.cc:493] T 7be9efa6559648dbb5a0f7684c4542d1 P e5256d91808b47c195bc9b4dbd7f2b87 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:00.050034 20108 raft_consensus.cc:2393] T 7be9efa6559648dbb5a0f7684c4542d1 P 127766fc592545a4997f7790f50f6076 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e61c3a8f61bb48f8a963c9480e53c168 in current term 18: Already voted for candidate 127766fc592545a4997f7790f50f6076 in this term.
I20260709 13:07:00.051512 19405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7be9efa6559648dbb5a0f7684c4542d1" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
W20260709 13:07:00.046299 19377 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.17.223.2:46257 timed out after 1.777s (SENT) [suppressed 12 similar messages]
I20260709 13:07:00.064826 19407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70797e5783b5454ab0d0eea663e791e3" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 21 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
W20260709 13:07:00.046890 19375 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:00.059273 20075 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.1:40321, user_credentials={real_user=slave}} blocked reactor thread for 44753.5us
I20260709 13:07:00.062081 20103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65d8cb8d6ec64f459d5a47cefab10acf" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076"
I20260709 13:07:00.062356 19484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dc5b3532fe54f74876d02beffa2c230" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:07:00.068143 19484 raft_consensus.cc:2393] T 1dc5b3532fe54f74876d02beffa2c230 P 0473d2b2d01f4459b1e90fd12cc7840e [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate e5256d91808b47c195bc9b4dbd7f2b87 in current term 19: Already voted for candidate 0473d2b2d01f4459b1e90fd12cc7840e in this term.
I20260709 13:07:00.049355 19560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85c494af21f9457a85da47b9bc70c1fd" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 18 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:07:00.063879 20112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4af19371ea874c09a0a2147040835cbb" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076"
I20260709 13:07:00.045748 25553 raft_consensus.cc:493] T 2b74109013a140ada21feeef92d6f563 P e61c3a8f61bb48f8a963c9480e53c168 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:00.081714 25553 raft_consensus.cc:3060] T 2b74109013a140ada21feeef92d6f563 P e61c3a8f61bb48f8a963c9480e53c168 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:07:00.082729 25685 leader_election.cc:290] T e381f1d6b8184797ad142de49be225a8 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 16 election: Requested vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:07:00.064054 25599 consensus_queue.cc:1048] T 85c494af21f9457a85da47b9bc70c1fd P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.020s
I20260709 13:07:00.008716 25591 consensus_queue.cc:1048] T 70797e5783b5454ab0d0eea663e791e3 P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Connected to new peer: Peer: permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.054s
I20260709 13:07:00.005795 25712 consensus_queue.cc:1048] T 833a2f0775ed407a94b8924ce50adb63 P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.058s
I20260709 13:07:00.086058 19411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "309c3ca0ca4b4f3ba129752ea2cb293b" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:07:00.086645 19411 raft_consensus.cc:1813] T 309c3ca0ca4b4f3ba129752ea2cb293b P e5256d91808b47c195bc9b4dbd7f2b87 [term 12 FOLLOWER]: Handling vote request from an unknown peer e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:07:00.087098 19411 raft_consensus.cc:2393] T 309c3ca0ca4b4f3ba129752ea2cb293b P e5256d91808b47c195bc9b4dbd7f2b87 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e61c3a8f61bb48f8a963c9480e53c168 in current term 12: Already voted for candidate 0473d2b2d01f4459b1e90fd12cc7840e in this term.
I20260709 13:07:00.064361 25677 raft_consensus.cc:3060] T 179fd671030940b4b4a4e24bcc4aba0a P e61c3a8f61bb48f8a963c9480e53c168 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:07:00.088608 25705 raft_consensus.cc:515] T 7be9efa6559648dbb5a0f7684c4542d1 P e5256d91808b47c195bc9b4dbd7f2b87 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } attrs { replace: true } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:07:00.089937 19405 raft_consensus.cc:2468] T 7be9efa6559648dbb5a0f7684c4542d1 P e5256d91808b47c195bc9b4dbd7f2b87 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 18.
I20260709 13:07:00.070973 25713 consensus_queue.cc:1048] T ef32ce6fdd0e40d382c79974f30295c6 P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:07:00.072395 19409 raft_consensus.cc:1240] T 172b3dd13109415a955b71ac0e9d2234 P e5256d91808b47c195bc9b4dbd7f2b87 [term 17 FOLLOWER]: Rejecting Update request from peer 127766fc592545a4997f7790f50f6076 for earlier term 16. Current term is 17. Ops: []
I20260709 13:07:00.097523 20110 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46436 (request call id 977) took 1463 ms. Trace:
I20260709 13:07:00.097949 20110 rpcz_store.cc:276] 0709 13:06:58.633772 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:58.633996 (+   224us) service_pool.cc:224] Handling call
0709 13:07:00.097328 (+1463332us) spinlock_profiling.cc:243] Waited 1.06 s on lock 0x7b5400245c54. stack: 00007f4a79de9343 00007f4a79de9240 00007f4a797781d4 00007f4a834b6304 00007f4a834b6299 00007f4a7ce71571 00007f4a7cf0c2fa 00007f4a81ecdb17 00007f4a7b4486d4 00007f4a7b448662 00007f4a7b448591 00007f4a7b44850c 00007f4a7b4477c2 00007f4a7b24348c 00007f4a7b2428c6 00007f4a7b24226f
0709 13:07:00.097436 (+   108us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2442499968}
W20260709 13:07:00.073124 25738 log.cc:927] Time spent T b9f0d59553ad444883fcf5b5909f9798 P e5256d91808b47c195bc9b4dbd7f2b87: Append to log took a long time: real 0.140s	user 0.001s	sys 0.000s
I20260709 13:07:00.061055 25086 raft_consensus.cc:2804] T 4509b76741dc428e9201c70c1658da13 P e61c3a8f61bb48f8a963c9480e53c168 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:07:00.009387 25678 consensus_queue.cc:1048] T b08304a0a02b42d7840c4e8ee9a6bd1a P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.055s
I20260709 13:07:00.062912 25520 raft_consensus.cc:515] T ef32ce6fdd0e40d382c79974f30295c6 P 0473d2b2d01f4459b1e90fd12cc7840e [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:07:00.079340 19477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b74109013a140ada21feeef92d6f563" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:07:00.062929 25661 raft_consensus.cc:493] T e381f1d6b8184797ad142de49be225a8 P e61c3a8f61bb48f8a963c9480e53c168 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:00.129570 25661 raft_consensus.cc:3060] T e381f1d6b8184797ad142de49be225a8 P e61c3a8f61bb48f8a963c9480e53c168 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:07:00.129719 19477 raft_consensus.cc:2393] T 2b74109013a140ada21feeef92d6f563 P 0473d2b2d01f4459b1e90fd12cc7840e [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e5256d91808b47c195bc9b4dbd7f2b87 in current term 16: Already voted for candidate 0473d2b2d01f4459b1e90fd12cc7840e in this term.
I20260709 13:07:00.129878 25708 raft_consensus.cc:493] T 86a6797bdfe94fa496c050ceae4bd0d9 P 0473d2b2d01f4459b1e90fd12cc7840e [term 14 FOLLOWER]: Starting leader election (detected failure of leader e61c3a8f61bb48f8a963c9480e53c168)
I20260709 13:07:00.130219 25086 raft_consensus.cc:697] T 4509b76741dc428e9201c70c1658da13 P e61c3a8f61bb48f8a963c9480e53c168 [term 12 LEADER]: Becoming Leader. State: Replica: e61c3a8f61bb48f8a963c9480e53c168, State: Running, Role: LEADER
I20260709 13:07:00.054586 25628 consensus_queue.cc:1059] T 309c3ca0ca4b4f3ba129752ea2cb293b P 127766fc592545a4997f7790f50f6076 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 }, Status: INVALID_TERM, Last received: 11.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.026s
I20260709 13:07:00.059780 25587 raft_consensus.cc:515] T edd7d470b5014c9489be7f41f64355c9 P e5256d91808b47c195bc9b4dbd7f2b87 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:07:00.131276 25086 consensus_queue.cc:237] T 4509b76741dc428e9201c70c1658da13 P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:07:00.079867 25411 raft_consensus.cc:2749] T edd7d470b5014c9489be7f41f64355c9 P e61c3a8f61bb48f8a963c9480e53c168 [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 13:07:00.130379 25708 raft_consensus.cc:3060] T 86a6797bdfe94fa496c050ceae4bd0d9 P 0473d2b2d01f4459b1e90fd12cc7840e [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:06:59.991741 25396 raft_consensus.cc:515] T 2e36a9d6e29c4a7c860cf267efbd4c74 P e5256d91808b47c195bc9b4dbd7f2b87 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:07:00.135540 25396 leader_election.cc:290] T 2e36a9d6e29c4a7c860cf267efbd4c74 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:07:00.124327 19404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cdf56e38bbc453d9438d359e5a69955" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
W20260709 13:07:00.152972 19374 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.4:43121, user_credentials={real_user=slave}} blocked reactor thread for 144425us
I20260709 13:07:00.165285 25396 raft_consensus.cc:2749] T 2a16f7501e2444fb86d4e2778e734e02 P e5256d91808b47c195bc9b4dbd7f2b87 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:07:00.194098 19484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40e1e16737a842ee936002830f36882e" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 20 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:07:00.195456 19484 raft_consensus.cc:2410] T 40e1e16737a842ee936002830f36882e P 0473d2b2d01f4459b1e90fd12cc7840e [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e5256d91808b47c195bc9b4dbd7f2b87 for term 20 because replica has last-logged OpId of term: 18 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 17 index: 9.
I20260709 13:07:00.196525 25418 raft_consensus.cc:3060] T ab43d85f64114d4ebf618930e43d9ed0 P 0473d2b2d01f4459b1e90fd12cc7840e [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:07:00.194183 19477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e381f1d6b8184797ad142de49be225a8" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:07:00.197386 19477 raft_consensus.cc:2393] T e381f1d6b8184797ad142de49be225a8 P 0473d2b2d01f4459b1e90fd12cc7840e [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e5256d91808b47c195bc9b4dbd7f2b87 in current term 16: Already voted for candidate 0473d2b2d01f4459b1e90fd12cc7840e in this term.
I20260709 13:07:00.195603 19553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65d8cb8d6ec64f459d5a47cefab10acf" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:07:00.198647 19553 raft_consensus.cc:2393] T 65d8cb8d6ec64f459d5a47cefab10acf P e61c3a8f61bb48f8a963c9480e53c168 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate e5256d91808b47c195bc9b4dbd7f2b87 in current term 19: Already voted for candidate e61c3a8f61bb48f8a963c9480e53c168 in this term.
W20260709 13:07:00.217808 19524 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:00.215656 19523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.1:40321, user_credentials={real_user=slave}} blocked reactor thread for 162717us
I20260709 13:07:00.217181 19408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76cb037fc9064d13b59a8969d897ce8c" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 17 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:07:00.223861 19449 leader_election.cc:304] T 309c3ca0ca4b4f3ba129752ea2cb293b P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87; no voters: 
I20260709 13:07:00.228281 19477 raft_consensus.cc:1240] T 76cb037fc9064d13b59a8969d897ce8c P 0473d2b2d01f4459b1e90fd12cc7840e [term 17 FOLLOWER]: Rejecting Update request from peer e5256d91808b47c195bc9b4dbd7f2b87 for earlier term 16. Current term is 17. Ops: []
I20260709 13:07:00.229471 20109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ece3db938bc649d4a40a51522ed5259c" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:07:00.137990 25546 consensus_queue.cc:260] T 309c3ca0ca4b4f3ba129752ea2cb293b P 127766fc592545a4997f7790f50f6076 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:07:00.232892 19523 leader_election.cc:304] T ece3db938bc649d4a40a51522ed5259c P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e61c3a8f61bb48f8a963c9480e53c168; no voters: 127766fc592545a4997f7790f50f6076, e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:07:00.265992 19553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "217b5fae677b4971b3bbd2f357a1f7ff" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:07:00.266819 19553 raft_consensus.cc:2468] T 217b5fae677b4971b3bbd2f357a1f7ff P e61c3a8f61bb48f8a963c9480e53c168 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 14.
I20260709 13:07:00.268810 19523 leader_election.cc:304] T fa731b585f684a7fb2d106c50f143b83 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e61c3a8f61bb48f8a963c9480e53c168; no voters: 127766fc592545a4997f7790f50f6076, e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:07:00.270208 19405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76cb037fc9064d13b59a8969d897ce8c" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
W20260709 13:07:00.274015 19526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.2:46257, user_credentials={real_user=slave}} blocked reactor thread for 227697us
I20260709 13:07:00.273929 25537 consensus_queue.cc:1048] T 217b5fae677b4971b3bbd2f357a1f7ff P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:07:00.274601 19409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e381f1d6b8184797ad142de49be225a8" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
I20260709 13:07:00.274955 19526 leader_election.cc:304] T 46c5bfeecc314717bffe987e6844b6d0 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 24 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e61c3a8f61bb48f8a963c9480e53c168; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:07:00.275660 19409 raft_consensus.cc:2393] T e381f1d6b8184797ad142de49be225a8 P e5256d91808b47c195bc9b4dbd7f2b87 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 0473d2b2d01f4459b1e90fd12cc7840e in current term 16: Already voted for candidate e5256d91808b47c195bc9b4dbd7f2b87 in this term.
I20260709 13:07:00.276528 25597 raft_consensus.cc:2804] T 309c3ca0ca4b4f3ba129752ea2cb293b P 0473d2b2d01f4459b1e90fd12cc7840e [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:07:00.276602 19403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b08304a0a02b42d7840c4e8ee9a6bd1a" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 19 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
I20260709 13:07:00.284155 19403 raft_consensus.cc:3060] T b08304a0a02b42d7840c4e8ee9a6bd1a P e5256d91808b47c195bc9b4dbd7f2b87 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:07:00.277427 19402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e1f505cb0f1427bbd698ac889d80821" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
W20260709 13:07:00.282229 19452 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:00.282325 19405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df751f992649444090e27965eb1af85d" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
I20260709 13:07:00.271665 19449 leader_election.cc:304] T bc225c93219c45538b53a1bd3d387e4d P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87; no voters: 
I20260709 13:07:00.285799 19405 raft_consensus.cc:2393] T df751f992649444090e27965eb1af85d P e5256d91808b47c195bc9b4dbd7f2b87 [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate 0473d2b2d01f4459b1e90fd12cc7840e in current term 21: Already voted for candidate e5256d91808b47c195bc9b4dbd7f2b87 in this term.
I20260709 13:07:00.287964 19483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff75a1d4cb1f493db8f71ddc136ba9ab" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:07:00.290963 19407 raft_consensus.cc:1240] T 4af19371ea874c09a0a2147040835cbb P e5256d91808b47c195bc9b4dbd7f2b87 [term 9 FOLLOWER]: Rejecting Update request from peer 127766fc592545a4997f7790f50f6076 for earlier term 8. Current term is 9. Ops: []
I20260709 13:07:00.290143 19411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36f6ba92b9ba46babe4ebd6c02e5fbd9" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 20 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
I20260709 13:07:00.294996 19405 raft_consensus.cc:1240] T fa8650e71aa14778b3d73721fc50d9fc P e5256d91808b47c195bc9b4dbd7f2b87 [term 18 FOLLOWER]: Rejecting Update request from peer 0473d2b2d01f4459b1e90fd12cc7840e for earlier term 17. Current term is 18. Ops: []
I20260709 13:07:00.301162 19411 raft_consensus.cc:3060] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P e5256d91808b47c195bc9b4dbd7f2b87 [term 19 FOLLOWER]: Advancing to term 20
W20260709 13:07:00.295008 20078 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.2:46257, user_credentials={real_user=slave}} blocked reactor thread for 74070.6us
I20260709 13:07:00.301960 19483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a61655d99124a29b486ba4a5b37faea" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:07:00.304622 19477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "309c3ca0ca4b4f3ba129752ea2cb293b" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:07:00.305020 19409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b74109013a140ada21feeef92d6f563" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
I20260709 13:07:00.305744 19526 leader_election.cc:304] T 14935b3ddf914369822e4a0547aaa355 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e61c3a8f61bb48f8a963c9480e53c168; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, 127766fc592545a4997f7790f50f6076
I20260709 13:07:00.309417 19484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "179fd671030940b4b4a4e24bcc4aba0a" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:07:00.309777 19553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa8650e71aa14778b3d73721fc50d9fc" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:07:00.310462 19553 raft_consensus.cc:3060] T fa8650e71aa14778b3d73721fc50d9fc P e61c3a8f61bb48f8a963c9480e53c168 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:07:00.294490 19523 leader_election.cc:304] T 309c3ca0ca4b4f3ba129752ea2cb293b P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: e61c3a8f61bb48f8a963c9480e53c168; no voters: 127766fc592545a4997f7790f50f6076, e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:07:00.314922 19410 raft_consensus.cc:1240] T 179fd671030940b4b4a4e24bcc4aba0a P e5256d91808b47c195bc9b4dbd7f2b87 [term 20 FOLLOWER]: Rejecting Update request from peer 0473d2b2d01f4459b1e90fd12cc7840e for earlier term 19. Current term is 20. Ops: []
I20260709 13:07:00.308840 20106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36f6ba92b9ba46babe4ebd6c02e5fbd9" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 20 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076"
I20260709 13:07:00.315589 20106 raft_consensus.cc:3060] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P 127766fc592545a4997f7790f50f6076 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:07:00.303495 19483 raft_consensus.cc:2376] T 1a61655d99124a29b486ba4a5b37faea P 0473d2b2d01f4459b1e90fd12cc7840e [term 16 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 16. Re-sending same reply.
I20260709 13:07:00.278381 25747 raft_consensus.cc:2749] T ece3db938bc649d4a40a51522ed5259c P e61c3a8f61bb48f8a963c9480e53c168 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:07:00.316610 19449 leader_election.cc:304] T 172b3dd13109415a955b71ac0e9d2234 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87; no voters: 
I20260709 13:07:00.319401 19483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36f6ba92b9ba46babe4ebd6c02e5fbd9" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:07:00.321369 19402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21e14947d70440f19044d8f75c31e1f9" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:07:00.322399 19407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef32ce6fdd0e40d382c79974f30295c6" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 22 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:07:00.324913 19407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a16f7501e2444fb86d4e2778e734e02" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:07:00.293744 25537 raft_consensus.cc:2804] T bc225c93219c45538b53a1bd3d387e4d P 0473d2b2d01f4459b1e90fd12cc7840e [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:07:00.295516 25411 raft_consensus.cc:2749] T fa731b585f684a7fb2d106c50f143b83 P e61c3a8f61bb48f8a963c9480e53c168 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:07:00.330384 19483 raft_consensus.cc:2368] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P 0473d2b2d01f4459b1e90fd12cc7840e [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate e5256d91808b47c195bc9b4dbd7f2b87 for earlier term 19. Current term is 20.
I20260709 13:07:00.304564 25678 raft_consensus.cc:2749] T 46c5bfeecc314717bffe987e6844b6d0 P e61c3a8f61bb48f8a963c9480e53c168 [term 24 FOLLOWER]: Leader election lost for term 24. Reason: could not achieve majority
I20260709 13:07:00.363116 19484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f85fc4b527a48848e5faa083b604e36" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:07:00.348897 20112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70797e5783b5454ab0d0eea663e791e3" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 21 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076"
I20260709 13:07:00.399343 19484 raft_consensus.cc:2393] T 1f85fc4b527a48848e5faa083b604e36 P 0473d2b2d01f4459b1e90fd12cc7840e [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e5256d91808b47c195bc9b4dbd7f2b87 in current term 17: Already voted for candidate 0473d2b2d01f4459b1e90fd12cc7840e in this term.
I20260709 13:07:00.351550 19483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "172b3dd13109415a955b71ac0e9d2234" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:07:00.345741 25463 consensus_queue.cc:1059] T f93ee515a9c14139bf566522ed8232f3 P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 }, Status: INVALID_TERM, Last received: 18.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.008s
I20260709 13:07:00.346305 19449 leader_election.cc:304] T 22196caba61445d3bec98a0aab3c337d P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87; no voters: 
I20260709 13:07:00.332480 25622 consensus_queue.cc:1059] T ff75a1d4cb1f493db8f71ddc136ba9ab P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.022s
I20260709 13:07:00.290056 25735 consensus_queue.cc:1059] T 172b3dd13109415a955b71ac0e9d2234 P 127766fc592545a4997f7790f50f6076 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 }, Status: INVALID_TERM, Last received: 16.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.040s
I20260709 13:07:00.355135 19551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9f0d59553ad444883fcf5b5909f9798" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:07:00.357208 20110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a16f7501e2444fb86d4e2778e734e02" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:07:00.306614 25520 leader_election.cc:290] T ef32ce6fdd0e40d382c79974f30295c6 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 22 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
W20260709 13:07:00.359922 25056 consensus_meta.cc:287] T fa731b585f684a7fb2d106c50f143b83 P e5256d91808b47c195bc9b4dbd7f2b87: Time spent flushing consensus metadata: real 0.681s	user 0.019s	sys 0.000s
I20260709 13:07:00.364089 19479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46c5bfeecc314717bffe987e6844b6d0" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 24 candidate_status { last_received { term: 23 index: 12 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:07:00.365090 19481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "775c229504194560ba9589bc2199b089" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:07:00.365837 19482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9f0d59553ad444883fcf5b5909f9798" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:07:00.316236 25359 consensus_queue.cc:1059] T 4af19371ea874c09a0a2147040835cbb P 127766fc592545a4997f7790f50f6076 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.051s
I20260709 13:07:00.422744 25396 consensus_queue.cc:1059] T 70797e5783b5454ab0d0eea663e791e3 P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 }, Status: INVALID_TERM, Last received: 18.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.014s
I20260709 13:07:00.437494 25359 raft_consensus.cc:3055] T 4af19371ea874c09a0a2147040835cbb P 127766fc592545a4997f7790f50f6076 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:07:00.437765 25396 raft_consensus.cc:3055] T 70797e5783b5454ab0d0eea663e791e3 P e5256d91808b47c195bc9b4dbd7f2b87 [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:07:00.437902 25359 raft_consensus.cc:740] T 4af19371ea874c09a0a2147040835cbb P 127766fc592545a4997f7790f50f6076 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 127766fc592545a4997f7790f50f6076, State: Running, Role: LEADER
I20260709 13:07:00.438282 25396 raft_consensus.cc:740] T 70797e5783b5454ab0d0eea663e791e3 P e5256d91808b47c195bc9b4dbd7f2b87 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: e5256d91808b47c195bc9b4dbd7f2b87, State: Running, Role: LEADER
I20260709 13:07:00.439239 25735 raft_consensus.cc:3055] T 172b3dd13109415a955b71ac0e9d2234 P 127766fc592545a4997f7790f50f6076 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:07:00.439119 25359 consensus_queue.cc:260] T 4af19371ea874c09a0a2147040835cbb P 127766fc592545a4997f7790f50f6076 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:07:00.367703 25537 raft_consensus.cc:697] T bc225c93219c45538b53a1bd3d387e4d P 0473d2b2d01f4459b1e90fd12cc7840e [term 15 LEADER]: Becoming Leader. State: Replica: 0473d2b2d01f4459b1e90fd12cc7840e, State: Running, Role: LEADER
I20260709 13:07:00.371351 19480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e1f505cb0f1427bbd698ac889d80821" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:07:00.431689 19481 raft_consensus.cc:2468] T 775c229504194560ba9589bc2199b089 P 0473d2b2d01f4459b1e90fd12cc7840e [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 13.
I20260709 13:07:00.347168 19407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a61655d99124a29b486ba4a5b37faea" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:07:00.442255 19407 raft_consensus.cc:2468] T 1a61655d99124a29b486ba4a5b37faea P e5256d91808b47c195bc9b4dbd7f2b87 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 16.
I20260709 13:07:00.372063 25587 leader_election.cc:290] T edd7d470b5014c9489be7f41f64355c9 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:07:00.373005 25435 leader_election.cc:290] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:07:00.372638 25715 raft_consensus.cc:515] T 40e1e16737a842ee936002830f36882e P e61c3a8f61bb48f8a963c9480e53c168 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:07:00.278101 25615 raft_consensus.cc:515] T 48824d5acfbc485ebf8c2d944e7202de P 127766fc592545a4997f7790f50f6076 [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:07:00.373631 19486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa8650e71aa14778b3d73721fc50d9fc" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:07:00.374336 19559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e1f505cb0f1427bbd698ac889d80821" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:07:00.374341 19485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28af091831594f9d8e96482078cc7625" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:07:00.375113 19556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df751f992649444090e27965eb1af85d" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:07:00.375809 19560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4af19371ea874c09a0a2147040835cbb" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:07:00.376614 19557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ece3db938bc649d4a40a51522ed5259c" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:07:00.377439 19554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f93ee515a9c14139bf566522ed8232f3" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 21 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:07:00.332893 25712 raft_consensus.cc:3060] T 309c3ca0ca4b4f3ba129752ea2cb293b P e61c3a8f61bb48f8a963c9480e53c168 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:00.383095 19558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e381f1d6b8184797ad142de49be225a8" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:07:00.385401 19410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36f6ba92b9ba46babe4ebd6c02e5fbd9" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 20 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:07:00.385705 25580 leader_election.cc:290] T 14935b3ddf914369822e4a0547aaa355 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:07:00.456964 19481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f93ee515a9c14139bf566522ed8232f3" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 21 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:07:00.386859 20108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14935b3ddf914369822e4a0547aaa355" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:07:00.388268 19404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7be9efa6559648dbb5a0f7684c4542d1" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:07:00.458143 19404 raft_consensus.cc:2468] T 7be9efa6559648dbb5a0f7684c4542d1 P e5256d91808b47c195bc9b4dbd7f2b87 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 127766fc592545a4997f7790f50f6076 in term 18.
I20260709 13:07:00.367718 25093 raft_consensus.cc:515] T 2b74109013a140ada21feeef92d6f563 P e5256d91808b47c195bc9b4dbd7f2b87 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:07:00.472893 19551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edd7d470b5014c9489be7f41f64355c9" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:07:00.391649 25730 leader_election.cc:290] T 7be9efa6559648dbb5a0f7684c4542d1 P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:07:00.326604 25599 raft_consensus.cc:2749] T 14935b3ddf914369822e4a0547aaa355 P e61c3a8f61bb48f8a963c9480e53c168 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:07:00.311508 25597 raft_consensus.cc:697] T 309c3ca0ca4b4f3ba129752ea2cb293b P 0473d2b2d01f4459b1e90fd12cc7840e [term 12 LEADER]: Becoming Leader. State: Replica: 0473d2b2d01f4459b1e90fd12cc7840e, State: Running, Role: LEADER
I20260709 13:07:00.394762 19306 catalog_manager.cc:5697] T 48824d5acfbc485ebf8c2d944e7202de P 127766fc592545a4997f7790f50f6076 reported cstate change: term changed from 15 to 18, leader changed from 127766fc592545a4997f7790f50f6076 (127.17.223.4) to 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2). New cstate: current_term: 18 leader_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } } }
I20260709 13:07:00.374684 19552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1b10566f45d4a7d9029858330e02d5b" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:07:00.443605 25520 raft_consensus.cc:2804] T 22196caba61445d3bec98a0aab3c337d P 0473d2b2d01f4459b1e90fd12cc7840e [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:07:00.399389 19403 raft_consensus.cc:2468] T b08304a0a02b42d7840c4e8ee9a6bd1a P e5256d91808b47c195bc9b4dbd7f2b87 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 19.
I20260709 13:07:00.404174 19411 raft_consensus.cc:2468] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P e5256d91808b47c195bc9b4dbd7f2b87 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 20.
I20260709 13:07:00.333787 20076 leader_election.cc:304] T 70797e5783b5454ab0d0eea663e791e3 P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 127766fc592545a4997f7790f50f6076, e61c3a8f61bb48f8a963c9480e53c168; no voters: e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:07:00.366357 25553 raft_consensus.cc:515] T 2b74109013a140ada21feeef92d6f563 P e61c3a8f61bb48f8a963c9480e53c168 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:07:00.424325 19484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df751f992649444090e27965eb1af85d" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:07:00.484841 19484 raft_consensus.cc:2393] T df751f992649444090e27965eb1af85d P 0473d2b2d01f4459b1e90fd12cc7840e [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate e5256d91808b47c195bc9b4dbd7f2b87 in current term 21: Already voted for candidate 0473d2b2d01f4459b1e90fd12cc7840e in this term.
I20260709 13:07:00.424614 25463 raft_consensus.cc:3055] T f93ee515a9c14139bf566522ed8232f3 P 0473d2b2d01f4459b1e90fd12cc7840e [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:07:00.425065 25622 consensus_queue.cc:1243] T ff75a1d4cb1f493db8f71ddc136ba9ab P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Peer e5256d91808b47c195bc9b4dbd7f2b87 log is divergent from this leader: its last log entry 19.10 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 9
I20260709 13:07:00.429589 19375 leader_election.cc:304] T 833a2f0775ed407a94b8924ce50adb63 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87; no voters: 127766fc592545a4997f7790f50f6076, e61c3a8f61bb48f8a963c9480e53c168
W20260709 13:07:00.486999 19375 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.3:36891, user_credentials={real_user=slave}} blocked reactor thread for 57520.4us
I20260709 13:07:00.487608 19407 raft_consensus.cc:1240] T b08304a0a02b42d7840c4e8ee9a6bd1a P e5256d91808b47c195bc9b4dbd7f2b87 [term 19 FOLLOWER]: Rejecting Update request from peer e61c3a8f61bb48f8a963c9480e53c168 for earlier term 18. Current term is 19. Ops: [18.11-18.11]
I20260709 13:07:00.488189 19375 leader_election.cc:304] T 85c494af21f9457a85da47b9bc70c1fd P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87; no voters: 127766fc592545a4997f7790f50f6076, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:07:00.489261 19375 leader_election.cc:304] T 217b5fae677b4971b3bbd2f357a1f7ff P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:07:00.491365 19375 leader_election.cc:304] T 4af19371ea874c09a0a2147040835cbb P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87; no voters: 127766fc592545a4997f7790f50f6076, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:07:00.492031 19485 raft_consensus.cc:1240] T ef32ce6fdd0e40d382c79974f30295c6 P 0473d2b2d01f4459b1e90fd12cc7840e [term 22 FOLLOWER]: Rejecting Update request from peer e5256d91808b47c195bc9b4dbd7f2b87 for earlier term 21. Current term is 22. Ops: [21.12-21.12]
I20260709 13:07:00.491250 19486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "179fd671030940b4b4a4e24bcc4aba0a" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:07:00.404016 20103 raft_consensus.cc:2468] T 65d8cb8d6ec64f459d5a47cefab10acf P 127766fc592545a4997f7790f50f6076 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 19.
I20260709 13:07:00.436257 25720 raft_consensus.cc:2804] T 172b3dd13109415a955b71ac0e9d2234 P 0473d2b2d01f4459b1e90fd12cc7840e [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:07:00.439651 25735 raft_consensus.cc:740] T 172b3dd13109415a955b71ac0e9d2234 P 127766fc592545a4997f7790f50f6076 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 127766fc592545a4997f7790f50f6076, State: Running, Role: LEADER
W20260709 13:07:00.370249 19293 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet ab43d85f64114d4ebf618930e43d9ed0 with cas_config_opid_index 5: ChangeConfig:REMOVE_PEER failed with leader 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121) due to error UNKNOWN_ERROR; will retry: Illegal state: Leader has not yet committed an operation in its own term
W20260709 13:07:00.440733 19449 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.1:40321, user_credentials={real_user=slave}} blocked reactor thread for 94528us
I20260709 13:07:00.370558 19478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "217b5fae677b4971b3bbd2f357a1f7ff" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:07:00.442554 20106 raft_consensus.cc:2468] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P 127766fc592545a4997f7790f50f6076 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 20.
I20260709 13:07:00.452548 19480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1b10566f45d4a7d9029858330e02d5b" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:07:00.452783 19479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff9b0eddd810459b82d91c60777c10eb" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:07:00.452597 19482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e381f1d6b8184797ad142de49be225a8" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:07:00.440033 25546 raft_consensus.cc:3060] T 309c3ca0ca4b4f3ba129752ea2cb293b P 127766fc592545a4997f7790f50f6076 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:00.440025 25056 raft_consensus.cc:515] T fa731b585f684a7fb2d106c50f143b83 P e5256d91808b47c195bc9b4dbd7f2b87 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:07:00.526605 19482 raft_consensus.cc:2393] T e381f1d6b8184797ad142de49be225a8 P 0473d2b2d01f4459b1e90fd12cc7840e [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate e5256d91808b47c195bc9b4dbd7f2b87 in current term 16: Already voted for candidate 0473d2b2d01f4459b1e90fd12cc7840e in this term.
W20260709 13:07:00.350816 19526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.2:46257, user_credentials={real_user=slave}} blocked reactor thread for 45151.5us
I20260709 13:07:00.527483 19526 leader_election.cc:304] T ff75a1d4cb1f493db8f71ddc136ba9ab P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e61c3a8f61bb48f8a963c9480e53c168; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:07:00.483230 20109 raft_consensus.cc:1240] T 48824d5acfbc485ebf8c2d944e7202de P 127766fc592545a4997f7790f50f6076 [term 21 FOLLOWER]: Rejecting Update request from peer 0473d2b2d01f4459b1e90fd12cc7840e for earlier term 20. Current term is 21. Ops: []
I20260709 13:07:00.457249 25359 raft_consensus.cc:3060] T 4af19371ea874c09a0a2147040835cbb P 127766fc592545a4997f7790f50f6076 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:07:00.487082 20076 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.3:36891, user_credentials={real_user=slave}} blocked reactor thread for 153360us
I20260709 13:07:00.492688 19556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e36a9d6e29c4a7c860cf267efbd4c74" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:07:00.433274 19553 raft_consensus.cc:2468] T fa8650e71aa14778b3d73721fc50d9fc P e61c3a8f61bb48f8a963c9480e53c168 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 18.
I20260709 13:07:00.533857 19553 raft_consensus.cc:1275] T 1dc5b3532fe54f74876d02beffa2c230 P e61c3a8f61bb48f8a963c9480e53c168 [term 19 FOLLOWER]: Refusing update from remote peer e5256d91808b47c195bc9b4dbd7f2b87: Log matching property violated. Preceding OpId in replica: term: 17 index: 9. Preceding OpId from leader: term: 19 index: 10. (index mismatch)
I20260709 13:07:00.483765 25520 raft_consensus.cc:493] T 22196caba61445d3bec98a0aab3c337d P 0473d2b2d01f4459b1e90fd12cc7840e [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:07:00.494594 20075 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:00.494292 19374 leader_election.cc:304] T 65d8cb8d6ec64f459d5a47cefab10acf P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 127766fc592545a4997f7790f50f6076, e5256d91808b47c195bc9b4dbd7f2b87; no voters: e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:07:00.493541 19409 raft_consensus.cc:2393] T 2b74109013a140ada21feeef92d6f563 P e5256d91808b47c195bc9b4dbd7f2b87 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 0473d2b2d01f4459b1e90fd12cc7840e in current term 16: Already voted for candidate e5256d91808b47c195bc9b4dbd7f2b87 in this term.
W20260709 13:07:00.521741 19293 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.ChangeConfig -> {remote=127.17.223.4:43121, user_credentials={real_user=slave}} blocked reactor thread for 151754us
I20260709 13:07:00.542977 19375 leader_election.cc:304] T ece3db938bc649d4a40a51522ed5259c P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87; no voters: 127766fc592545a4997f7790f50f6076, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:07:00.518770 19480 raft_consensus.cc:2468] T f1b10566f45d4a7d9029858330e02d5b P 0473d2b2d01f4459b1e90fd12cc7840e [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 17.
I20260709 13:07:00.473618 19551 raft_consensus.cc:2468] T edd7d470b5014c9489be7f41f64355c9 P e61c3a8f61bb48f8a963c9480e53c168 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 21.
I20260709 13:07:00.374604 19408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70797e5783b5454ab0d0eea663e791e3" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 21 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
I20260709 13:07:00.546217 25496 raft_consensus.cc:2749] T ece3db938bc649d4a40a51522ed5259c P e5256d91808b47c195bc9b4dbd7f2b87 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:07:00.551734 25754 raft_consensus.cc:2749] T ff75a1d4cb1f493db8f71ddc136ba9ab P e61c3a8f61bb48f8a963c9480e53c168 [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:07:00.493840 25690 raft_consensus.cc:2749] T 833a2f0775ed407a94b8924ce50adb63 P e5256d91808b47c195bc9b4dbd7f2b87 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:07:00.511660 25221 raft_consensus.cc:2804] T 70797e5783b5454ab0d0eea663e791e3 P 127766fc592545a4997f7790f50f6076 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:07:00.486183 25463 raft_consensus.cc:740] T f93ee515a9c14139bf566522ed8232f3 P 0473d2b2d01f4459b1e90fd12cc7840e [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 0473d2b2d01f4459b1e90fd12cc7840e, State: Running, Role: LEADER
I20260709 13:07:00.555454 19554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14935b3ddf914369822e4a0547aaa355" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:07:00.514282 25580 raft_consensus.cc:2804] T 217b5fae677b4971b3bbd2f357a1f7ff P e5256d91808b47c195bc9b4dbd7f2b87 [term 14 FOLLOWER]: Leader pre-election won for term 15
W20260709 13:07:00.569585 19523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.4:43121, user_credentials={real_user=slave}} blocked reactor thread for 227520us
I20260709 13:07:00.439270 25396 consensus_queue.cc:260] T 70797e5783b5454ab0d0eea663e791e3 P e5256d91808b47c195bc9b4dbd7f2b87 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 20.14, Last appended by leader: 14, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:07:00.477550 25661 raft_consensus.cc:515] T e381f1d6b8184797ad142de49be225a8 P e61c3a8f61bb48f8a963c9480e53c168 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:07:00.523710 25591 raft_consensus.cc:2749] T 4af19371ea874c09a0a2147040835cbb P e5256d91808b47c195bc9b4dbd7f2b87 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:07:00.512253 19306 catalog_manager.cc:5697] T ab43d85f64114d4ebf618930e43d9ed0 P 127766fc592545a4997f7790f50f6076 reported cstate change: config changed from index 5 to 9, term changed from 14 to 17, VOTER e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1) evicted, no longer has a pending config: VOTER 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2), VOTER e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3), VOTER 127766fc592545a4997f7790f50f6076 (127.17.223.4). New cstate: current_term: 17 leader_uuid: "127766fc592545a4997f7790f50f6076" committed_config { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:07:00.561643 19406 raft_consensus.cc:1240] T fa731b585f684a7fb2d106c50f143b83 P e5256d91808b47c195bc9b4dbd7f2b87 [term 15 FOLLOWER]: Rejecting Update request from peer 127766fc592545a4997f7790f50f6076 for earlier term 14. Current term is 15. Ops: []
W20260709 13:07:00.564384 19452 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:00.568950 19480 raft_consensus.cc:1275] T 1dc5b3532fe54f74876d02beffa2c230 P 0473d2b2d01f4459b1e90fd12cc7840e [term 19 FOLLOWER]: Refusing update from remote peer e5256d91808b47c195bc9b4dbd7f2b87: Log matching property violated. Preceding OpId in replica: term: 17 index: 9. Preceding OpId from leader: term: 19 index: 10. (index mismatch)
I20260709 13:07:00.547894 19485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e36a9d6e29c4a7c860cf267efbd4c74" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:07:00.569662 19449 leader_election.cc:304] T b08304a0a02b42d7840c4e8ee9a6bd1a P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87; no voters: 
I20260709 13:07:00.551770 25496 raft_consensus.cc:2804] T 65d8cb8d6ec64f459d5a47cefab10acf P e5256d91808b47c195bc9b4dbd7f2b87 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:07:00.542052 25720 raft_consensus.cc:697] T 172b3dd13109415a955b71ac0e9d2234 P 0473d2b2d01f4459b1e90fd12cc7840e [term 17 LEADER]: Becoming Leader. State: Replica: 0473d2b2d01f4459b1e90fd12cc7840e, State: Running, Role: LEADER
I20260709 13:07:00.567227 25221 raft_consensus.cc:493] T 70797e5783b5454ab0d0eea663e791e3 P 127766fc592545a4997f7790f50f6076 [term 20 FOLLOWER]: Starting leader election (detected failure of leader e5256d91808b47c195bc9b4dbd7f2b87)
I20260709 13:07:00.544523 19375 leader_election.cc:304] T fa8650e71aa14778b3d73721fc50d9fc P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:07:00.550287 25520 raft_consensus.cc:3060] T 22196caba61445d3bec98a0aab3c337d P 0473d2b2d01f4459b1e90fd12cc7840e [term 17 FOLLOWER]: Advancing to term 18
W20260709 13:07:00.579650 19304 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:51954 (request call id 132) took 54524 ms (client timeout 15000 ms). Trace:
I20260709 13:07:00.580506 19449 leader_election.cc:304] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87; no voters: 
I20260709 13:07:00.585955 19482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edd7d470b5014c9489be7f41f64355c9" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:07:00.586647 19482 raft_consensus.cc:2468] T edd7d470b5014c9489be7f41f64355c9 P 0473d2b2d01f4459b1e90fd12cc7840e [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 21.
I20260709 13:07:00.586921 19480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14935b3ddf914369822e4a0547aaa355" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:07:00.587658 19480 raft_consensus.cc:1813] T 14935b3ddf914369822e4a0547aaa355 P 0473d2b2d01f4459b1e90fd12cc7840e [term 12 FOLLOWER]: Handling vote request from an unknown peer e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:07:00.566933 25598 raft_consensus.cc:2749] T 85c494af21f9457a85da47b9bc70c1fd P e5256d91808b47c195bc9b4dbd7f2b87 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 13:07:00.603689 19374 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.4:43121, user_credentials={real_user=slave}} blocked reactor thread for 109470us
I20260709 13:07:00.588251 19480 raft_consensus.cc:2410] T 14935b3ddf914369822e4a0547aaa355 P 0473d2b2d01f4459b1e90fd12cc7840e [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e5256d91808b47c195bc9b4dbd7f2b87 for term 12 because replica has last-logged OpId of term: 10 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 8.
I20260709 13:07:00.588284 19375 leader_election.cc:304] T edd7d470b5014c9489be7f41f64355c9 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:07:00.605079 19558 raft_consensus.cc:2393] T e381f1d6b8184797ad142de49be225a8 P e61c3a8f61bb48f8a963c9480e53c168 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate e5256d91808b47c195bc9b4dbd7f2b87 in current term 16: Already voted for candidate e61c3a8f61bb48f8a963c9480e53c168 in this term.
I20260709 13:07:00.589875 25724 consensus_queue.cc:1048] T 1dc5b3532fe54f74876d02beffa2c230 P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:07:00.565500 25261 consensus_queue.cc:1059] T fa8650e71aa14778b3d73721fc50d9fc P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 }, Status: INVALID_TERM, Last received: 17.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.026s
I20260709 13:07:00.569777 25580 raft_consensus.cc:493] T 217b5fae677b4971b3bbd2f357a1f7ff P e5256d91808b47c195bc9b4dbd7f2b87 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:00.614785 25580 raft_consensus.cc:3060] T 217b5fae677b4971b3bbd2f357a1f7ff P e5256d91808b47c195bc9b4dbd7f2b87 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:07:00.617551 25708 raft_consensus.cc:515] T 86a6797bdfe94fa496c050ceae4bd0d9 P 0473d2b2d01f4459b1e90fd12cc7840e [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
W20260709 13:07:00.619333 25749 log.cc:927] Time spent T 76cb037fc9064d13b59a8969d897ce8c P e61c3a8f61bb48f8a963c9480e53c168: Append to log took a long time: real 0.072s	user 0.000s	sys 0.000s
I20260709 13:07:00.581717 25376 consensus_queue.cc:1059] T 179fd671030940b4b4a4e24bcc4aba0a P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 }, Status: INVALID_TERM, Last received: 19.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.020s
I20260709 13:07:00.601192 25056 leader_election.cc:290] T fa731b585f684a7fb2d106c50f143b83 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 15 election: Requested vote from peers e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:07:00.601773 25530 raft_consensus.cc:2804] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P 0473d2b2d01f4459b1e90fd12cc7840e [term 20 FOLLOWER]: Leader election won for term 20
W20260709 13:07:00.584584 19304 rpcz_store.cc:269] 0709 13:06:06.008078 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:06.008451 (+   373us) service_pool.cc:224] Handling call
0709 13:07:00.525862 (+54517411us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2464924,"reported_tablets":28}
I20260709 13:07:00.582141 25722 consensus_queue.cc:1048] T ed7fdbcb96d14d418db9ca90a792588a P 127766fc592545a4997f7790f50f6076 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.038s
I20260709 13:07:00.605573 20107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa731b585f684a7fb2d106c50f143b83" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076"
I20260709 13:07:00.623782 25093 leader_election.cc:290] T 2b74109013a140ada21feeef92d6f563 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 16 election: Requested vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:07:00.602444 25496 raft_consensus.cc:697] T 65d8cb8d6ec64f459d5a47cefab10acf P e5256d91808b47c195bc9b4dbd7f2b87 [term 19 LEADER]: Becoming Leader. State: Replica: e5256d91808b47c195bc9b4dbd7f2b87, State: Running, Role: LEADER
W20260709 13:07:00.627164 19526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.2:46257, user_credentials={real_user=slave}} blocked reactor thread for 48253.8us
I20260709 13:07:00.628089 19526 leader_election.cc:304] T d1e5873a19244c5ebbcd38e126796ee7 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168; no voters: e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:07:00.628923 25754 raft_consensus.cc:2804] T d1e5873a19244c5ebbcd38e126796ee7 P e61c3a8f61bb48f8a963c9480e53c168 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:07:00.628312 25496 consensus_queue.cc:237] T 65d8cb8d6ec64f459d5a47cefab10acf P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.11, Last appended by leader: 11, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:07:00.629343 25754 raft_consensus.cc:493] T d1e5873a19244c5ebbcd38e126796ee7 P e61c3a8f61bb48f8a963c9480e53c168 [term 20 FOLLOWER]: Starting leader election (detected failure of leader e5256d91808b47c195bc9b4dbd7f2b87)
I20260709 13:07:00.629930 25754 raft_consensus.cc:3060] T d1e5873a19244c5ebbcd38e126796ee7 P e61c3a8f61bb48f8a963c9480e53c168 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:07:00.597867 25715 leader_election.cc:290] T 40e1e16737a842ee936002830f36882e P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 20 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:07:00.584452 25622 raft_consensus.cc:2804] T b08304a0a02b42d7840c4e8ee9a6bd1a P 0473d2b2d01f4459b1e90fd12cc7840e [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:07:00.609577 25615 leader_election.cc:290] T 48824d5acfbc485ebf8c2d944e7202de P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 21 election: Requested vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:07:00.610263 19551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7be9efa6559648dbb5a0f7684c4542d1" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:07:00.636410 19551 raft_consensus.cc:2468] T 7be9efa6559648dbb5a0f7684c4542d1 P e61c3a8f61bb48f8a963c9480e53c168 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 127766fc592545a4997f7790f50f6076 in term 17.
I20260709 13:07:00.610915 19407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b74109013a140ada21feeef92d6f563" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
I20260709 13:07:00.637715 25705 leader_election.cc:290] T 7be9efa6559648dbb5a0f7684c4542d1 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:07:00.611354 25685 raft_consensus.cc:2804] T edd7d470b5014c9489be7f41f64355c9 P e5256d91808b47c195bc9b4dbd7f2b87 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:07:00.614168 25418 raft_consensus.cc:3055] T ff75a1d4cb1f493db8f71ddc136ba9ab P 0473d2b2d01f4459b1e90fd12cc7840e [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:07:00.563265 25537 consensus_queue.cc:237] T bc225c93219c45538b53a1bd3d387e4d P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:07:00.607292 19306 catalog_manager.cc:5697] T 1efebf73c86e432baa55533136b6e12c P 127766fc592545a4997f7790f50f6076 reported cstate change: term changed from 12 to 14, leader changed from 127766fc592545a4997f7790f50f6076 (127.17.223.4) to 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2). New cstate: current_term: 14 leader_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } } }
I20260709 13:07:00.652936 20106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7be9efa6559648dbb5a0f7684c4542d1" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:07:00.653554 20106 raft_consensus.cc:2468] T 7be9efa6559648dbb5a0f7684c4542d1 P 127766fc592545a4997f7790f50f6076 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 18.
I20260709 13:07:00.644452 19557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b74109013a140ada21feeef92d6f563" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:07:00.645668 19523 leader_election.cc:304] T 2a16f7501e2444fb86d4e2778e734e02 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e61c3a8f61bb48f8a963c9480e53c168; no voters: 127766fc592545a4997f7790f50f6076, e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:07:00.646988 19375 leader_election.cc:304] T 14935b3ddf914369822e4a0547aaa355 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87; no voters: 127766fc592545a4997f7790f50f6076, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:07:00.584136 25221 raft_consensus.cc:3060] T 70797e5783b5454ab0d0eea663e791e3 P 127766fc592545a4997f7790f50f6076 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:07:00.645249 25418 raft_consensus.cc:740] T ff75a1d4cb1f493db8f71ddc136ba9ab P 0473d2b2d01f4459b1e90fd12cc7840e [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 0473d2b2d01f4459b1e90fd12cc7840e, State: Running, Role: LEADER
I20260709 13:07:00.639176 25463 consensus_queue.cc:260] T f93ee515a9c14139bf566522ed8232f3 P 0473d2b2d01f4459b1e90fd12cc7840e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 20.10, Last appended by leader: 10, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:07:00.587517 25735 consensus_queue.cc:260] T 172b3dd13109415a955b71ac0e9d2234 P 127766fc592545a4997f7790f50f6076 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.11, Last appended by leader: 11, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:07:00.644932 25685 raft_consensus.cc:493] T edd7d470b5014c9489be7f41f64355c9 P e5256d91808b47c195bc9b4dbd7f2b87 [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:00.658491 25056 raft_consensus.cc:2749] T 14935b3ddf914369822e4a0547aaa355 P e5256d91808b47c195bc9b4dbd7f2b87 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:07:00.659210 19557 raft_consensus.cc:2393] T 2b74109013a140ada21feeef92d6f563 P e61c3a8f61bb48f8a963c9480e53c168 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate e5256d91808b47c195bc9b4dbd7f2b87 in current term 16: Already voted for candidate e61c3a8f61bb48f8a963c9480e53c168 in this term.
I20260709 13:07:00.587860 25587 raft_consensus.cc:2804] T fa8650e71aa14778b3d73721fc50d9fc P e5256d91808b47c195bc9b4dbd7f2b87 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:07:00.660504 19482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f93ee515a9c14139bf566522ed8232f3" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 21 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:07:00.577550 25611 consensus_queue.cc:1048] T ab43d85f64114d4ebf618930e43d9ed0 P 127766fc592545a4997f7790f50f6076 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.066s
W20260709 13:07:00.644060 25677 consensus_meta.cc:287] T 179fd671030940b4b4a4e24bcc4aba0a P e61c3a8f61bb48f8a963c9480e53c168: Time spent flushing consensus metadata: real 0.556s	user 0.016s	sys 0.002s
I20260709 13:07:00.638077 25754 raft_consensus.cc:515] T d1e5873a19244c5ebbcd38e126796ee7 P e61c3a8f61bb48f8a963c9480e53c168 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:07:00.660187 25418 consensus_queue.cc:260] T ff75a1d4cb1f493db8f71ddc136ba9ab P 0473d2b2d01f4459b1e90fd12cc7840e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 18.10, Last appended by leader: 10, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:07:00.664307 25735 raft_consensus.cc:3060] T 172b3dd13109415a955b71ac0e9d2234 P 127766fc592545a4997f7790f50f6076 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:07:00.664779 19558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa731b585f684a7fb2d106c50f143b83" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:07:00.669710 19551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7be9efa6559648dbb5a0f7684c4542d1" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:07:00.713856 19551 raft_consensus.cc:2468] T 7be9efa6559648dbb5a0f7684c4542d1 P e61c3a8f61bb48f8a963c9480e53c168 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 17.
I20260709 13:07:00.670579 19306 catalog_manager.cc:5697] T 9962423cb4e54fcfa5de01daf68a86e7 P 127766fc592545a4997f7790f50f6076 reported cstate change: term changed from 11 to 15. New cstate: current_term: 15 leader_uuid: "127766fc592545a4997f7790f50f6076" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:07:00.714951 19485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2725d2c4cb054f18b0fc8f735c15f6c2" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:07:00.715670 19306 catalog_manager.cc:5697] T 62c6c134d3d24a1ab144dd9ee6bc3f64 P 127766fc592545a4997f7790f50f6076 reported cstate change: term changed from 13 to 14, leader changed from 127766fc592545a4997f7790f50f6076 (127.17.223.4) to 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2). New cstate: current_term: 14 leader_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } } }
I20260709 13:07:00.716959 25587 raft_consensus.cc:697] T fa8650e71aa14778b3d73721fc50d9fc P e5256d91808b47c195bc9b4dbd7f2b87 [term 18 LEADER]: Becoming Leader. State: Replica: e5256d91808b47c195bc9b4dbd7f2b87, State: Running, Role: LEADER
I20260709 13:07:00.661006 25682 consensus_queue.cc:1059] T fa731b585f684a7fb2d106c50f143b83 P 127766fc592545a4997f7790f50f6076 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 }, Status: INVALID_TERM, Last received: 14.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.026s
W20260709 13:07:00.698167 19449 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.1:40321, user_credentials={real_user=slave}} blocked reactor thread for 117727us
W20260709 13:07:00.708889 19526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.2:46257, user_credentials={real_user=slave}} blocked reactor thread for 50615us
I20260709 13:07:00.717959 25587 consensus_queue.cc:237] T fa8650e71aa14778b3d73721fc50d9fc P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 17.9, Last appended by leader: 9, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:07:00.711088 19480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7be9efa6559648dbb5a0f7684c4542d1" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:07:00.720201 25754 leader_election.cc:290] T d1e5873a19244c5ebbcd38e126796ee7 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 21 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:07:00.720602 19480 raft_consensus.cc:2468] T 7be9efa6559648dbb5a0f7684c4542d1 P 0473d2b2d01f4459b1e90fd12cc7840e [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 18.
I20260709 13:07:00.720767 25677 raft_consensus.cc:2749] T 179fd671030940b4b4a4e24bcc4aba0a P e61c3a8f61bb48f8a963c9480e53c168 [term 20 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:07:00.721933 19554 raft_consensus.cc:1240] T d1e5873a19244c5ebbcd38e126796ee7 P e61c3a8f61bb48f8a963c9480e53c168 [term 21 FOLLOWER]: Rejecting Update request from peer e5256d91808b47c195bc9b4dbd7f2b87 for earlier term 20. Current term is 21. Ops: []
I20260709 13:07:00.725047 25720 consensus_queue.cc:237] T 172b3dd13109415a955b71ac0e9d2234 P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.11, Last appended by leader: 11, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:07:00.692795 25685 raft_consensus.cc:3060] T edd7d470b5014c9489be7f41f64355c9 P e5256d91808b47c195bc9b4dbd7f2b87 [term 21 FOLLOWER]: Advancing to term 22
W20260709 13:07:00.731173 19523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.1:40321, user_credentials={real_user=slave}} blocked reactor thread for 85598.9us
I20260709 13:07:00.652482 25597 consensus_queue.cc:237] T 309c3ca0ca4b4f3ba129752ea2cb293b P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:07:00.731969 19523 leader_election.cc:304] T 1a61655d99124a29b486ba4a5b37faea P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:07:00.732873 25434 raft_consensus.cc:3055] T fa8650e71aa14778b3d73721fc50d9fc P 0473d2b2d01f4459b1e90fd12cc7840e [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:07:00.733246 25434 raft_consensus.cc:740] T fa8650e71aa14778b3d73721fc50d9fc P 0473d2b2d01f4459b1e90fd12cc7840e [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 0473d2b2d01f4459b1e90fd12cc7840e, State: Running, Role: LEADER
I20260709 13:07:00.733999 20076 leader_election.cc:304] T 7be9efa6559648dbb5a0f7684c4542d1 P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 127766fc592545a4997f7790f50f6076, e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:07:00.693914 25396 raft_consensus.cc:3060] T 70797e5783b5454ab0d0eea663e791e3 P e5256d91808b47c195bc9b4dbd7f2b87 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:07:00.745446 19480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ec1c4ce15e04c7e8c283a62179f2a64" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:07:00.696300 25553 leader_election.cc:290] T 2b74109013a140ada21feeef92d6f563 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 16 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:07:00.748214 19480 raft_consensus.cc:2410] T 5ec1c4ce15e04c7e8c283a62179f2a64 P 0473d2b2d01f4459b1e90fd12cc7840e [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e5256d91808b47c195bc9b4dbd7f2b87 for term 13 because replica has last-logged OpId of term: 12 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 10.
I20260709 13:07:00.717557 19306 catalog_manager.cc:5697] T 309c3ca0ca4b4f3ba129752ea2cb293b P 127766fc592545a4997f7790f50f6076 reported cstate change: term changed from 9 to 11, now has a pending config: VOTER e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1), VOTER 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2), VOTER 127766fc592545a4997f7790f50f6076 (127.17.223.4). New cstate: current_term: 11 leader_uuid: "127766fc592545a4997f7790f50f6076" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } attrs { replace: true } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } health_report { overall_health: HEALTHY } } } pending_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } } }
I20260709 13:07:00.751202 19485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff75a1d4cb1f493db8f71ddc136ba9ab" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:07:00.718463 25682 raft_consensus.cc:3055] T fa731b585f684a7fb2d106c50f143b83 P 127766fc592545a4997f7790f50f6076 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:07:00.741019 25755 raft_consensus.cc:2749] T 2a16f7501e2444fb86d4e2778e734e02 P e61c3a8f61bb48f8a963c9480e53c168 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:07:00.738876 25622 raft_consensus.cc:697] T b08304a0a02b42d7840c4e8ee9a6bd1a P 0473d2b2d01f4459b1e90fd12cc7840e [term 19 LEADER]: Becoming Leader. State: Replica: 0473d2b2d01f4459b1e90fd12cc7840e, State: Running, Role: LEADER
I20260709 13:07:00.741977 25546 raft_consensus.cc:2804] T 7be9efa6559648dbb5a0f7684c4542d1 P 127766fc592545a4997f7790f50f6076 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:07:00.783492 19480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa8650e71aa14778b3d73721fc50d9fc" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:07:00.733992 25434 consensus_queue.cc:260] T fa8650e71aa14778b3d73721fc50d9fc P 0473d2b2d01f4459b1e90fd12cc7840e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 17.9, Last appended by leader: 9, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:07:00.763639 19306 catalog_manager.cc:5697] T 0e1085d23e8347fbbd5bce7542f4b1f4 P 127766fc592545a4997f7790f50f6076 reported cstate change: term changed from 11 to 12, leader changed from 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2) to 127766fc592545a4997f7790f50f6076 (127.17.223.4). New cstate: current_term: 12 leader_uuid: "127766fc592545a4997f7790f50f6076" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:07:00.770862 25580 raft_consensus.cc:515] T 217b5fae677b4971b3bbd2f357a1f7ff P e5256d91808b47c195bc9b4dbd7f2b87 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:07:00.771589 25661 leader_election.cc:290] T e381f1d6b8184797ad142de49be225a8 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 16 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:07:00.754338 25682 raft_consensus.cc:740] T fa731b585f684a7fb2d106c50f143b83 P 127766fc592545a4997f7790f50f6076 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 127766fc592545a4997f7790f50f6076, State: Running, Role: LEADER
W20260709 13:07:00.772361 19375 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:00.772485 25708 leader_election.cc:290] T 86a6797bdfe94fa496c050ceae4bd0d9 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 15 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:07:00.801954 25622 consensus_queue.cc:237] T b08304a0a02b42d7840c4e8ee9a6bd1a P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:07:00.803544 19409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40e1e16737a842ee936002830f36882e" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
I20260709 13:07:00.804121 19409 raft_consensus.cc:3060] T 40e1e16737a842ee936002830f36882e P e5256d91808b47c195bc9b4dbd7f2b87 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:07:00.805332 19479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dc5b3532fe54f74876d02beffa2c230" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:07:00.806042 19479 raft_consensus.cc:2393] T 1dc5b3532fe54f74876d02beffa2c230 P 0473d2b2d01f4459b1e90fd12cc7840e [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate e5256d91808b47c195bc9b4dbd7f2b87 in current term 19: Already voted for candidate 0473d2b2d01f4459b1e90fd12cc7840e in this term.
I20260709 13:07:00.806918 19479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e1085d23e8347fbbd5bce7542f4b1f4" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:07:00.746752 25086 raft_consensus.cc:2804] T 1a61655d99124a29b486ba4a5b37faea P e61c3a8f61bb48f8a963c9480e53c168 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:07:00.807608 25086 raft_consensus.cc:493] T 1a61655d99124a29b486ba4a5b37faea P e61c3a8f61bb48f8a963c9480e53c168 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:00.807750 19479 raft_consensus.cc:2393] T 0e1085d23e8347fbbd5bce7542f4b1f4 P 0473d2b2d01f4459b1e90fd12cc7840e [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 127766fc592545a4997f7790f50f6076 in current term 14: Already voted for candidate 0473d2b2d01f4459b1e90fd12cc7840e in this term.
I20260709 13:07:00.807997 25086 raft_consensus.cc:3060] T 1a61655d99124a29b486ba4a5b37faea P e61c3a8f61bb48f8a963c9480e53c168 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:07:00.808569 19479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48824d5acfbc485ebf8c2d944e7202de" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 21 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:07:00.776690 19481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b74109013a140ada21feeef92d6f563" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:07:00.811163 19481 raft_consensus.cc:2393] T 2b74109013a140ada21feeef92d6f563 P 0473d2b2d01f4459b1e90fd12cc7840e [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate e5256d91808b47c195bc9b4dbd7f2b87 in current term 16: Already voted for candidate 0473d2b2d01f4459b1e90fd12cc7840e in this term.
I20260709 13:07:00.777004 19486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff9b0eddd810459b82d91c60777c10eb" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
W20260709 13:07:00.748921 25757 log.cc:927] Time spent T 85c494af21f9457a85da47b9bc70c1fd P e61c3a8f61bb48f8a963c9480e53c168: Append to log took a long time: real 0.055s	user 0.000s	sys 0.000s
I20260709 13:07:00.793372 19375 leader_election.cc:304] T fa731b585f684a7fb2d106c50f143b83 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87; no voters: 127766fc592545a4997f7790f50f6076, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:07:00.811753 25685 raft_consensus.cc:515] T edd7d470b5014c9489be7f41f64355c9 P e5256d91808b47c195bc9b4dbd7f2b87 [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:07:00.806919 19402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e5873a19244c5ebbcd38e126796ee7" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 21 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
I20260709 13:07:00.812865 19375 leader_election.cc:304] T 7be9efa6559648dbb5a0f7684c4542d1 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 127766fc592545a4997f7790f50f6076, e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:07:00.813789 25598 raft_consensus.cc:2749] T fa731b585f684a7fb2d106c50f143b83 P e5256d91808b47c195bc9b4dbd7f2b87 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:07:00.796648 19306 catalog_manager.cc:5697] T 2a16f7501e2444fb86d4e2778e734e02 P 127766fc592545a4997f7790f50f6076 reported cstate change: term changed from 14 to 15, leader changed from e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1) to e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3). New cstate: current_term: 15 leader_uuid: "e61c3a8f61bb48f8a963c9480e53c168" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } } }
I20260709 13:07:00.814456 25598 raft_consensus.cc:2804] T 7be9efa6559648dbb5a0f7684c4542d1 P e5256d91808b47c195bc9b4dbd7f2b87 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:07:00.814834 25598 raft_consensus.cc:493] T 7be9efa6559648dbb5a0f7684c4542d1 P e5256d91808b47c195bc9b4dbd7f2b87 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:00.815284 25598 raft_consensus.cc:3060] T 7be9efa6559648dbb5a0f7684c4542d1 P e5256d91808b47c195bc9b4dbd7f2b87 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:07:00.815039 19306 catalog_manager.cc:5697] T 96efeaaf1057492490e9a621f37e1a2d P 127766fc592545a4997f7790f50f6076 reported cstate change: term changed from 13 to 17. New cstate: current_term: 17 leader_uuid: "e61c3a8f61bb48f8a963c9480e53c168" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } } }
I20260709 13:07:00.816555 25304 consensus_queue.cc:1059] T d1e5873a19244c5ebbcd38e126796ee7 P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 }, Status: INVALID_TERM, Last received: 20.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:07:00.817451 25304 raft_consensus.cc:3055] T d1e5873a19244c5ebbcd38e126796ee7 P e5256d91808b47c195bc9b4dbd7f2b87 [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:07:00.817792 25304 raft_consensus.cc:740] T d1e5873a19244c5ebbcd38e126796ee7 P e5256d91808b47c195bc9b4dbd7f2b87 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: e5256d91808b47c195bc9b4dbd7f2b87, State: Running, Role: LEADER
I20260709 13:07:00.800334 25682 consensus_queue.cc:260] T fa731b585f684a7fb2d106c50f143b83 P 127766fc592545a4997f7790f50f6076 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:07:00.821249 25682 raft_consensus.cc:3060] T fa731b585f684a7fb2d106c50f143b83 P 127766fc592545a4997f7790f50f6076 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:07:00.823355 19554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "217b5fae677b4971b3bbd2f357a1f7ff" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:07:00.823940 19554 raft_consensus.cc:3060] T 217b5fae677b4971b3bbd2f357a1f7ff P e61c3a8f61bb48f8a963c9480e53c168 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:07:00.799197 25580 leader_election.cc:290] T 217b5fae677b4971b3bbd2f357a1f7ff P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 15 election: Requested vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:07:00.817054 19306 catalog_manager.cc:5697] T 65d8cb8d6ec64f459d5a47cefab10acf P 127766fc592545a4997f7790f50f6076 reported cstate change: term changed from 15 to 18, leader changed from e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1) to 127766fc592545a4997f7790f50f6076 (127.17.223.4). New cstate: current_term: 18 leader_uuid: "127766fc592545a4997f7790f50f6076" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:07:00.755122 25418 raft_consensus.cc:3060] T ff75a1d4cb1f493db8f71ddc136ba9ab P 0473d2b2d01f4459b1e90fd12cc7840e [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:07:00.754464 25463 raft_consensus.cc:3060] T f93ee515a9c14139bf566522ed8232f3 P 0473d2b2d01f4459b1e90fd12cc7840e [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:07:00.848295 19558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48824d5acfbc485ebf8c2d944e7202de" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:07:00.848963 19558 raft_consensus.cc:3060] T 48824d5acfbc485ebf8c2d944e7202de P e61c3a8f61bb48f8a963c9480e53c168 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:07:00.851987 19551 raft_consensus.cc:1275] T ff75a1d4cb1f493db8f71ddc136ba9ab P e61c3a8f61bb48f8a963c9480e53c168 [term 19 FOLLOWER]: Refusing update from remote peer e5256d91808b47c195bc9b4dbd7f2b87: Log matching property violated. Preceding OpId in replica: term: 17 index: 9. Preceding OpId from leader: term: 19 index: 10. (index mismatch)
I20260709 13:07:00.855088 25056 raft_consensus.cc:493] T 86a6797bdfe94fa496c050ceae4bd0d9 P e5256d91808b47c195bc9b4dbd7f2b87 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader e61c3a8f61bb48f8a963c9480e53c168)
I20260709 13:07:00.855424 25580 consensus_queue.cc:1048] T ff75a1d4cb1f493db8f71ddc136ba9ab P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:07:00.855780 25056 raft_consensus.cc:515] T 86a6797bdfe94fa496c050ceae4bd0d9 P e5256d91808b47c195bc9b4dbd7f2b87 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:07:00.748654 25530 raft_consensus.cc:697] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P 0473d2b2d01f4459b1e90fd12cc7840e [term 20 LEADER]: Becoming Leader. State: Replica: 0473d2b2d01f4459b1e90fd12cc7840e, State: Running, Role: LEADER
I20260709 13:07:00.840236 19306 catalog_manager.cc:5697] T 172b3dd13109415a955b71ac0e9d2234 P 127766fc592545a4997f7790f50f6076 reported cstate change: term changed from 11 to 14, leader changed from 127766fc592545a4997f7790f50f6076 (127.17.223.4) to e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1). New cstate: current_term: 14 leader_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } } }
I20260709 13:07:00.782954 25546 raft_consensus.cc:493] T 7be9efa6559648dbb5a0f7684c4542d1 P 127766fc592545a4997f7790f50f6076 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:00.868521 19478 raft_consensus.cc:1275] T ab43d85f64114d4ebf618930e43d9ed0 P 0473d2b2d01f4459b1e90fd12cc7840e [term 19 FOLLOWER]: Refusing update from remote peer 127766fc592545a4997f7790f50f6076: Log matching property violated. Preceding OpId in replica: term: 18 index: 12. Preceding OpId from leader: term: 19 index: 13. (index mismatch)
I20260709 13:07:00.744940 25754 consensus_queue.cc:1059] T b08304a0a02b42d7840c4e8ee9a6bd1a P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 }, Status: INVALID_TERM, Last received: 16.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.044s
I20260709 13:07:00.860566 19484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c5eebf646ad445a9d1b1adc319d7b16" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:07:00.878645 19552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edd7d470b5014c9489be7f41f64355c9" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:07:00.879356 19552 raft_consensus.cc:3060] T edd7d470b5014c9489be7f41f64355c9 P e61c3a8f61bb48f8a963c9480e53c168 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:07:00.861667 25685 leader_election.cc:290] T edd7d470b5014c9489be7f41f64355c9 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 22 election: Requested vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:07:00.881655 19481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab43d85f64114d4ebf618930e43d9ed0" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:07:00.885960 19409 raft_consensus.cc:2468] T 40e1e16737a842ee936002830f36882e P e5256d91808b47c195bc9b4dbd7f2b87 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 20.
I20260709 13:07:00.873347 25546 raft_consensus.cc:3060] T 7be9efa6559648dbb5a0f7684c4542d1 P 127766fc592545a4997f7790f50f6076 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:07:00.895346 25530 consensus_queue.cc:237] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 18.15, Last appended by leader: 15, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:07:00.896229 25661 raft_consensus.cc:3055] T b08304a0a02b42d7840c4e8ee9a6bd1a P e61c3a8f61bb48f8a963c9480e53c168 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:07:00.895804 25520 raft_consensus.cc:515] T 22196caba61445d3bec98a0aab3c337d P 0473d2b2d01f4459b1e90fd12cc7840e [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:07:00.896658 25661 raft_consensus.cc:740] T b08304a0a02b42d7840c4e8ee9a6bd1a P e61c3a8f61bb48f8a963c9480e53c168 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: e61c3a8f61bb48f8a963c9480e53c168, State: Running, Role: LEADER
I20260709 13:07:00.897481 25661 consensus_queue.cc:260] T b08304a0a02b42d7840c4e8ee9a6bd1a P e61c3a8f61bb48f8a963c9480e53c168 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 18.11, Last appended by leader: 11, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:07:00.901033 19406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e381f1d6b8184797ad142de49be225a8" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
I20260709 13:07:00.901780 19406 raft_consensus.cc:2393] T e381f1d6b8184797ad142de49be225a8 P e5256d91808b47c195bc9b4dbd7f2b87 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate e61c3a8f61bb48f8a963c9480e53c168 in current term 16: Already voted for candidate e5256d91808b47c195bc9b4dbd7f2b87 in this term.
I20260709 13:07:00.904785 19479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0afb57ae58a24a01850491d69f0213dd" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:07:00.907310 20106 raft_consensus.cc:1240] T 0e1085d23e8347fbbd5bce7542f4b1f4 P 127766fc592545a4997f7790f50f6076 [term 14 FOLLOWER]: Rejecting Update request from peer e61c3a8f61bb48f8a963c9480e53c168 for earlier term 13. Current term is 14. Ops: []
I20260709 13:07:00.908017 19407 raft_consensus.cc:1275] T 4509b76741dc428e9201c70c1658da13 P e5256d91808b47c195bc9b4dbd7f2b87 [term 12 FOLLOWER]: Refusing update from remote peer e61c3a8f61bb48f8a963c9480e53c168: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
W20260709 13:07:00.908769 20075 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:00.908825 19481 raft_consensus.cc:2468] T ab43d85f64114d4ebf618930e43d9ed0 P 0473d2b2d01f4459b1e90fd12cc7840e [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 127766fc592545a4997f7790f50f6076 in term 19.
I20260709 13:07:00.909178 19554 raft_consensus.cc:2468] T 217b5fae677b4971b3bbd2f357a1f7ff P e61c3a8f61bb48f8a963c9480e53c168 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 15.
I20260709 13:07:00.909976 19553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86a6797bdfe94fa496c050ceae4bd0d9" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:07:00.912102 19375 leader_election.cc:304] T 217b5fae677b4971b3bbd2f357a1f7ff P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:07:00.894388 25261 raft_consensus.cc:3055] T 179fd671030940b4b4a4e24bcc4aba0a P 0473d2b2d01f4459b1e90fd12cc7840e [term 19 LEADER]: Stepping down as leader of term 19
W20260709 13:07:00.907155 19449 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.4:43121, user_credentials={real_user=slave}} blocked reactor thread for 188605us
W20260709 13:07:00.925078 19526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.2:46257, user_credentials={real_user=slave}} blocked reactor thread for 204994us
I20260709 13:07:00.933048 19484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff9b0eddd810459b82d91c60777c10eb" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:07:00.899477 25661 raft_consensus.cc:3060] T b08304a0a02b42d7840c4e8ee9a6bd1a P e61c3a8f61bb48f8a963c9480e53c168 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:07:00.930534 19449 leader_election.cc:304] T 0e1085d23e8347fbbd5bce7542f4b1f4 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, 127766fc592545a4997f7790f50f6076; no voters: 
I20260709 13:07:00.941944 19558 raft_consensus.cc:2468] T 48824d5acfbc485ebf8c2d944e7202de P e61c3a8f61bb48f8a963c9480e53c168 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 127766fc592545a4997f7790f50f6076 in term 21.
I20260709 13:07:00.919337 25685 raft_consensus.cc:2804] T 217b5fae677b4971b3bbd2f357a1f7ff P e5256d91808b47c195bc9b4dbd7f2b87 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:07:00.915215 25712 raft_consensus.cc:2749] T 309c3ca0ca4b4f3ba129752ea2cb293b P e61c3a8f61bb48f8a963c9480e53c168 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:07:00.919119 25261 raft_consensus.cc:740] T 179fd671030940b4b4a4e24bcc4aba0a P 0473d2b2d01f4459b1e90fd12cc7840e [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 0473d2b2d01f4459b1e90fd12cc7840e, State: Running, Role: LEADER
I20260709 13:07:00.945436 19523 leader_election.cc:304] T 40e1e16737a842ee936002830f36882e P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:07:00.822903 25304 consensus_queue.cc:260] T d1e5873a19244c5ebbcd38e126796ee7 P e5256d91808b47c195bc9b4dbd7f2b87 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 20.10, Last appended by leader: 10, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:07:00.914561 25056 leader_election.cc:290] T 86a6797bdfe94fa496c050ceae4bd0d9 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
W20260709 13:07:00.984069 19449 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.4:43121, user_credentials={real_user=slave}} blocked reactor thread for 53622us
I20260709 13:07:00.987272 19526 leader_election.cc:400] T 0e1085d23e8347fbbd5bce7542f4b1f4 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 13 election: Vote denied by peer 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257) with higher term. Message: Invalid argument: T 0e1085d23e8347fbbd5bce7542f4b1f4 P 0473d2b2d01f4459b1e90fd12cc7840e [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate e61c3a8f61bb48f8a963c9480e53c168 for earlier term 13. Current term is 14.
I20260709 13:07:00.989130 19449 leader_election.cc:304] T 1f85fc4b527a48848e5faa083b604e36 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e; no voters: 127766fc592545a4997f7790f50f6076, e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:07:00.990175 25764 raft_consensus.cc:2749] T 1f85fc4b527a48848e5faa083b604e36 P 0473d2b2d01f4459b1e90fd12cc7840e [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:07:00.989279 25622 raft_consensus.cc:2804] T 0e1085d23e8347fbbd5bce7542f4b1f4 P 0473d2b2d01f4459b1e90fd12cc7840e [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:07:00.992486 25597 consensus_queue.cc:1059] T 48824d5acfbc485ebf8c2d944e7202de P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false }, Status: INVALID_TERM, Last received: 20.14, Next index: 15, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:07:00.994338 25622 raft_consensus.cc:697] T 0e1085d23e8347fbbd5bce7542f4b1f4 P 0473d2b2d01f4459b1e90fd12cc7840e [term 14 LEADER]: Becoming Leader. State: Replica: 0473d2b2d01f4459b1e90fd12cc7840e, State: Running, Role: LEADER
I20260709 13:07:00.994603 19409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef32ce6fdd0e40d382c79974f30295c6" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
I20260709 13:07:00.995632 25622 consensus_queue.cc:237] T 0e1085d23e8347fbbd5bce7542f4b1f4 P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:07:01.000319 19406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86a6797bdfe94fa496c050ceae4bd0d9" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
I20260709 13:07:01.003633 19406 raft_consensus.cc:3060] T 86a6797bdfe94fa496c050ceae4bd0d9 P e5256d91808b47c195bc9b4dbd7f2b87 [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:07:01.004174 19523 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:01.004191 20076 leader_election.cc:304] T 48824d5acfbc485ebf8c2d944e7202de P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 127766fc592545a4997f7790f50f6076, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
W20260709 13:07:01.014297 19375 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:01.014137 19526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.2:46257, user_credentials={real_user=slave}} blocked reactor thread for 63287.8us
I20260709 13:07:01.017959 19526 leader_election.cc:304] T 2725d2c4cb054f18b0fc8f735c15f6c2 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e61c3a8f61bb48f8a963c9480e53c168; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:07:01.023545 25599 raft_consensus.cc:2749] T 2725d2c4cb054f18b0fc8f735c15f6c2 P e61c3a8f61bb48f8a963c9480e53c168 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:07:01.029767 19526 leader_election.cc:304] T 48824d5acfbc485ebf8c2d944e7202de P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e61c3a8f61bb48f8a963c9480e53c168; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, 127766fc592545a4997f7790f50f6076
I20260709 13:07:01.035338 25599 raft_consensus.cc:2749] T 48824d5acfbc485ebf8c2d944e7202de P e61c3a8f61bb48f8a963c9480e53c168 [term 21 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:07:00.936611 25708 consensus_queue.cc:1059] T ff9b0eddd810459b82d91c60777c10eb P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false }, Status: INVALID_TERM, Last received: 16.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.048s
I20260709 13:07:01.038040 19484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36f6ba92b9ba46babe4ebd6c02e5fbd9" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 20 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:07:01.040832 19526 leader_election.cc:304] T f93ee515a9c14139bf566522ed8232f3 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e61c3a8f61bb48f8a963c9480e53c168; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:07:00.929345 25598 raft_consensus.cc:515] T 7be9efa6559648dbb5a0f7684c4542d1 P e5256d91808b47c195bc9b4dbd7f2b87 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } attrs { replace: true } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:07:01.045396 19408 raft_consensus.cc:2410] T 70797e5783b5454ab0d0eea663e791e3 P e5256d91808b47c195bc9b4dbd7f2b87 [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate e61c3a8f61bb48f8a963c9480e53c168 for term 21 because replica has last-logged OpId of term: 20 index: 14, which is greater than that of the candidate, which has last-logged OpId of term: 18 index: 13.
I20260709 13:07:01.063782 19406 raft_consensus.cc:2468] T 86a6797bdfe94fa496c050ceae4bd0d9 P e5256d91808b47c195bc9b4dbd7f2b87 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 15.
W20260709 13:07:01.089713 20075 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:00.999617 25685 raft_consensus.cc:697] T 217b5fae677b4971b3bbd2f357a1f7ff P e5256d91808b47c195bc9b4dbd7f2b87 [term 15 LEADER]: Becoming Leader. State: Replica: e5256d91808b47c195bc9b4dbd7f2b87, State: Running, Role: LEADER
I20260709 13:07:01.000067 25715 raft_consensus.cc:2804] T 40e1e16737a842ee936002830f36882e P e61c3a8f61bb48f8a963c9480e53c168 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:07:00.952509 25445 consensus_queue.cc:1059] T 0e1085d23e8347fbbd5bce7542f4b1f4 P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.091s
W20260709 13:07:01.101886 19526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.2:46257, user_credentials={real_user=slave}} blocked reactor thread for 62347us
I20260709 13:07:01.093438 19477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7be9efa6559648dbb5a0f7684c4542d1" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:07:01.103044 19477 raft_consensus.cc:2468] T 7be9efa6559648dbb5a0f7684c4542d1 P 0473d2b2d01f4459b1e90fd12cc7840e [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 127766fc592545a4997f7790f50f6076 in term 18.
I20260709 13:07:01.052001 25678 raft_consensus.cc:3060] T f93ee515a9c14139bf566522ed8232f3 P e61c3a8f61bb48f8a963c9480e53c168 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:07:01.048097 25682 raft_consensus.cc:2804] T 48824d5acfbc485ebf8c2d944e7202de P 127766fc592545a4997f7790f50f6076 [term 21 FOLLOWER]: Leader election won for term 21
W20260709 13:07:01.097792 19449 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.1:40321, user_credentials={real_user=slave}} blocked reactor thread for 46385.2us
I20260709 13:07:01.104913 19484 raft_consensus.cc:1240] T 309c3ca0ca4b4f3ba129752ea2cb293b P 0473d2b2d01f4459b1e90fd12cc7840e [term 12 LEADER]: Rejecting Update request from peer 127766fc592545a4997f7790f50f6076 for earlier term 11. Current term is 12. Ops: []
I20260709 13:07:01.105515 19478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff9b0eddd810459b82d91c60777c10eb" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:07:01.051623 25304 raft_consensus.cc:3060] T d1e5873a19244c5ebbcd38e126796ee7 P e5256d91808b47c195bc9b4dbd7f2b87 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:07:01.011583 25411 consensus_queue.cc:1048] T 4509b76741dc428e9201c70c1658da13 P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.085s
I20260709 13:07:01.114648 19477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48824d5acfbc485ebf8c2d944e7202de" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
W20260709 13:07:01.156055 19526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.2:46257, user_credentials={real_user=slave}} blocked reactor thread for 52933.8us
I20260709 13:07:01.164204 19406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22196caba61445d3bec98a0aab3c337d" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
W20260709 13:07:01.165504 19375 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:01.165920 19406 raft_consensus.cc:3060] T 22196caba61445d3bec98a0aab3c337d P e5256d91808b47c195bc9b4dbd7f2b87 [term 17 FOLLOWER]: Advancing to term 18
W20260709 13:07:01.163801 19377 leader_election.cc:336] T 1a61655d99124a29b486ba4a5b37faea P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 16 election: RPC error from VoteRequest() call to peer 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257): Timed out: RequestConsensusVote RPC to 127.17.223.2:46257 timed out after 1.921s (SENT)
I20260709 13:07:01.170555 19478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e1085d23e8347fbbd5bce7542f4b1f4" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:07:01.186405 19406 raft_consensus.cc:2468] T 22196caba61445d3bec98a0aab3c337d P e5256d91808b47c195bc9b4dbd7f2b87 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 18.
I20260709 13:07:01.186779 25730 raft_consensus.cc:493] T 1f85fc4b527a48848e5faa083b604e36 P 127766fc592545a4997f7790f50f6076 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:01.187431 25730 raft_consensus.cc:515] T 1f85fc4b527a48848e5faa083b604e36 P 127766fc592545a4997f7790f50f6076 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:07:01.188237 25434 raft_consensus.cc:3060] T fa8650e71aa14778b3d73721fc50d9fc P 0473d2b2d01f4459b1e90fd12cc7840e [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:07:01.190367 25730 leader_election.cc:290] T 1f85fc4b527a48848e5faa083b604e36 P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321)
I20260709 13:07:01.192698 25597 raft_consensus.cc:3055] T ff9b0eddd810459b82d91c60777c10eb P 0473d2b2d01f4459b1e90fd12cc7840e [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:07:01.193140 25597 raft_consensus.cc:740] T ff9b0eddd810459b82d91c60777c10eb P 0473d2b2d01f4459b1e90fd12cc7840e [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 0473d2b2d01f4459b1e90fd12cc7840e, State: Running, Role: LEADER
I20260709 13:07:01.180442 19377 leader_election.cc:304] T 1a61655d99124a29b486ba4a5b37faea P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:07:01.194254 25597 consensus_queue.cc:260] T ff9b0eddd810459b82d91c60777c10eb P 0473d2b2d01f4459b1e90fd12cc7840e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.13, Last appended by leader: 13, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:07:01.194839 25730 consensus_queue.cc:1048] T ed7fdbcb96d14d418db9ca90a792588a P 127766fc592545a4997f7790f50f6076 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
W20260709 13:07:01.196661 25769 log.cc:927] Time spent T 65d8cb8d6ec64f459d5a47cefab10acf P e5256d91808b47c195bc9b4dbd7f2b87: Append to log took a long time: real 0.197s	user 0.001s	sys 0.000s
I20260709 13:07:01.193027 19406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f85fc4b527a48848e5faa083b604e36" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:07:01.197469 19406 raft_consensus.cc:2468] T 1f85fc4b527a48848e5faa083b604e36 P e5256d91808b47c195bc9b4dbd7f2b87 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 127766fc592545a4997f7790f50f6076 in term 16.
I20260709 13:07:01.199002 20075 leader_election.cc:304] T 1f85fc4b527a48848e5faa083b604e36 P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 127766fc592545a4997f7790f50f6076, e5256d91808b47c195bc9b4dbd7f2b87; no voters: 
W20260709 13:07:01.199970 25774 log.cc:927] Time spent T 309c3ca0ca4b4f3ba129752ea2cb293b P 0473d2b2d01f4459b1e90fd12cc7840e: Append to log took a long time: real 0.098s	user 0.000s	sys 0.000s
I20260709 13:07:01.200399 25359 raft_consensus.cc:2804] T 1f85fc4b527a48848e5faa083b604e36 P 127766fc592545a4997f7790f50f6076 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:07:01.200788 25359 raft_consensus.cc:493] T 1f85fc4b527a48848e5faa083b604e36 P 127766fc592545a4997f7790f50f6076 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:01.201139 25359 raft_consensus.cc:3060] T 1f85fc4b527a48848e5faa083b604e36 P 127766fc592545a4997f7790f50f6076 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:07:01.095149 25086 raft_consensus.cc:515] T 1a61655d99124a29b486ba4a5b37faea P e61c3a8f61bb48f8a963c9480e53c168 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:07:01.097157 25261 consensus_queue.cc:260] T 179fd671030940b4b4a4e24bcc4aba0a P 0473d2b2d01f4459b1e90fd12cc7840e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 19.12, Last appended by leader: 12, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:07:01.213361 19484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c5eebf646ad445a9d1b1adc319d7b16" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:07:01.216614 19480 raft_consensus.cc:2468] T fa8650e71aa14778b3d73721fc50d9fc P 0473d2b2d01f4459b1e90fd12cc7840e [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 18.
I20260709 13:07:01.164281 25682 raft_consensus.cc:697] T 48824d5acfbc485ebf8c2d944e7202de P 127766fc592545a4997f7790f50f6076 [term 21 LEADER]: Becoming Leader. State: Replica: 127766fc592545a4997f7790f50f6076, State: Running, Role: LEADER
I20260709 13:07:01.216166 19449 leader_election.cc:304] T 86a6797bdfe94fa496c050ceae4bd0d9 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87; no voters: 
I20260709 13:07:01.233845 19449 leader_election.cc:304] T 22196caba61445d3bec98a0aab3c337d P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87; no voters: 
I20260709 13:07:01.210989 25546 raft_consensus.cc:515] T 7be9efa6559648dbb5a0f7684c4542d1 P 127766fc592545a4997f7790f50f6076 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } attrs { replace: true } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:07:01.237609 25546 leader_election.cc:290] T 7be9efa6559648dbb5a0f7684c4542d1 P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 19 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:07:01.238001 19406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7be9efa6559648dbb5a0f7684c4542d1" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
I20260709 13:07:01.238879 19406 raft_consensus.cc:2393] T 7be9efa6559648dbb5a0f7684c4542d1 P e5256d91808b47c195bc9b4dbd7f2b87 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 127766fc592545a4997f7790f50f6076 in current term 19: Already voted for candidate e5256d91808b47c195bc9b4dbd7f2b87 in this term.
W20260709 13:07:01.239334 25770 log.cc:927] Time spent T 833a2f0775ed407a94b8924ce50adb63 P e61c3a8f61bb48f8a963c9480e53c168: Append to log took a long time: real 0.075s	user 0.000s	sys 0.000s
I20260709 13:07:01.242457 25678 raft_consensus.cc:2749] T f93ee515a9c14139bf566522ed8232f3 P e61c3a8f61bb48f8a963c9480e53c168 [term 21 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:07:01.182782 25520 leader_election.cc:290] T 22196caba61445d3bec98a0aab3c337d P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 18 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:07:01.222326 25597 raft_consensus.cc:3060] T ff9b0eddd810459b82d91c60777c10eb P 0473d2b2d01f4459b1e90fd12cc7840e [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:07:01.175077 25685 consensus_queue.cc:237] T 217b5fae677b4971b3bbd2f357a1f7ff P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:07:01.246704 25682 consensus_queue.cc:237] T 48824d5acfbc485ebf8c2d944e7202de P 127766fc592545a4997f7790f50f6076 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 20.14, Last appended by leader: 14, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:07:01.248476 25591 raft_consensus.cc:2749] T 1a61655d99124a29b486ba4a5b37faea P e5256d91808b47c195bc9b4dbd7f2b87 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
W20260709 13:07:01.251375 25776 log.cc:927] Time spent T ef32ce6fdd0e40d382c79974f30295c6 P e61c3a8f61bb48f8a963c9480e53c168: Append to log took a long time: real 0.080s	user 0.003s	sys 0.000s
I20260709 13:07:01.251832 25598 leader_election.cc:290] T 7be9efa6559648dbb5a0f7684c4542d1 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 19 election: Requested vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
W20260709 13:07:01.253350 25735 consensus_meta.cc:287] T 172b3dd13109415a955b71ac0e9d2234 P 127766fc592545a4997f7790f50f6076: Time spent flushing consensus metadata: real 0.541s	user 0.007s	sys 0.000s
I20260709 13:07:01.266248 20106 raft_consensus.cc:1275] T 65d8cb8d6ec64f459d5a47cefab10acf P 127766fc592545a4997f7790f50f6076 [term 19 FOLLOWER]: Refusing update from remote peer e5256d91808b47c195bc9b4dbd7f2b87: Log matching property violated. Preceding OpId in replica: term: 18 index: 11. Preceding OpId from leader: term: 19 index: 12. (index mismatch)
I20260709 13:07:01.266633 20103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7be9efa6559648dbb5a0f7684c4542d1" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076"
W20260709 13:07:01.222640 19452 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:01.267364 20103 raft_consensus.cc:2393] T 7be9efa6559648dbb5a0f7684c4542d1 P 127766fc592545a4997f7790f50f6076 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate e5256d91808b47c195bc9b4dbd7f2b87 in current term 19: Already voted for candidate 127766fc592545a4997f7790f50f6076 in this term.
I20260709 13:07:01.274427 19558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7be9efa6559648dbb5a0f7684c4542d1" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:07:01.275301 19558 raft_consensus.cc:3060] T 7be9efa6559648dbb5a0f7684c4542d1 P e61c3a8f61bb48f8a963c9480e53c168 [term 17 FOLLOWER]: Advancing to term 19
W20260709 13:07:01.276415 19375 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:01.280994 19449 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.1:40321, user_credentials={real_user=slave}} blocked reactor thread for 47241.5us
W20260709 13:07:01.255862 25221 consensus_meta.cc:287] T 70797e5783b5454ab0d0eea663e791e3 P 127766fc592545a4997f7790f50f6076: Time spent flushing consensus metadata: real 0.596s	user 0.009s	sys 0.001s
W20260709 13:07:01.284000 19450 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.3:36891, user_credentials={real_user=slave}} blocked reactor thread for 51778.1us
I20260709 13:07:01.282390 25708 consensus_queue.cc:1048] T 48824d5acfbc485ebf8c2d944e7202de P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.006s
I20260709 13:07:01.284682 25598 consensus_queue.cc:1048] T 65d8cb8d6ec64f459d5a47cefab10acf P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Connected to new peer: Peer: permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.004s
I20260709 13:07:01.289453 25786 raft_consensus.cc:2804] T 22196caba61445d3bec98a0aab3c337d P 0473d2b2d01f4459b1e90fd12cc7840e [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:07:01.290217 25786 raft_consensus.cc:697] T 22196caba61445d3bec98a0aab3c337d P 0473d2b2d01f4459b1e90fd12cc7840e [term 18 LEADER]: Becoming Leader. State: Replica: 0473d2b2d01f4459b1e90fd12cc7840e, State: Running, Role: LEADER
I20260709 13:07:01.291433 25786 consensus_queue.cc:237] T 22196caba61445d3bec98a0aab3c337d P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.10, Last appended by leader: 10, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:07:01.294261 19552 raft_consensus.cc:2468] T edd7d470b5014c9489be7f41f64355c9 P e61c3a8f61bb48f8a963c9480e53c168 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 22.
I20260709 13:07:01.269487 25760 raft_consensus.cc:2804] T 86a6797bdfe94fa496c050ceae4bd0d9 P 0473d2b2d01f4459b1e90fd12cc7840e [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:07:01.297963 19450 leader_election.cc:304] T 0cdf56e38bbc453d9438d359e5a69955 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e; no voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:07:01.304018 19375 leader_election.cc:304] T edd7d470b5014c9489be7f41f64355c9 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:07:01.307346 19409 raft_consensus.cc:1240] T 217b5fae677b4971b3bbd2f357a1f7ff P e5256d91808b47c195bc9b4dbd7f2b87 [term 15 LEADER]: Rejecting Update request from peer 0473d2b2d01f4459b1e90fd12cc7840e for earlier term 14. Current term is 15. Ops: [14.9-14.9]
I20260709 13:07:01.272509 25546 raft_consensus.cc:493] T 96efeaaf1057492490e9a621f37e1a2d P 127766fc592545a4997f7790f50f6076 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader e61c3a8f61bb48f8a963c9480e53c168)
I20260709 13:07:01.305344 19558 raft_consensus.cc:2468] T 7be9efa6559648dbb5a0f7684c4542d1 P e61c3a8f61bb48f8a963c9480e53c168 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 19.
W20260709 13:07:01.327080 20075 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:01.341972 19377 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.2:46257, user_credentials={real_user=slave}} blocked reactor thread for 183082us
W20260709 13:07:01.346392 19377 leader_election.cc:336] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 19 election: RPC error from VoteRequest() call to peer 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257): Timed out: RequestConsensusVote RPC to 127.17.223.2:46257 timed out after 1.942s (SENT)
I20260709 13:07:01.350816 25760 raft_consensus.cc:697] T 86a6797bdfe94fa496c050ceae4bd0d9 P 0473d2b2d01f4459b1e90fd12cc7840e [term 15 LEADER]: Becoming Leader. State: Replica: 0473d2b2d01f4459b1e90fd12cc7840e, State: Running, Role: LEADER
I20260709 13:07:01.351703 25755 raft_consensus.cc:493] T 0afb57ae58a24a01850491d69f0213dd P e61c3a8f61bb48f8a963c9480e53c168 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 0473d2b2d01f4459b1e90fd12cc7840e)
W20260709 13:07:01.353117 19526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.2:46257, user_credentials={real_user=slave}} blocked reactor thread for 193782us
W20260709 13:07:01.353510 19450 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.3:36891, user_credentials={real_user=slave}} blocked reactor thread for 55688.3us
I20260709 13:07:01.355820 19556 raft_consensus.cc:1240] T 217b5fae677b4971b3bbd2f357a1f7ff P e61c3a8f61bb48f8a963c9480e53c168 [term 15 FOLLOWER]: Rejecting Update request from peer 0473d2b2d01f4459b1e90fd12cc7840e for earlier term 14. Current term is 15. Ops: []
I20260709 13:07:01.356086 19377 leader_election.cc:304] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, 127766fc592545a4997f7790f50f6076
I20260709 13:07:01.356367 19553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76cb037fc9064d13b59a8969d897ce8c" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:07:01.370266 19450 leader_election.cc:304] T 1a61655d99124a29b486ba4a5b37faea P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e; no voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:07:01.356990 19554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e381f1d6b8184797ad142de49be225a8" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:07:01.355353 19552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14935b3ddf914369822e4a0547aaa355" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:07:01.371129 19554 raft_consensus.cc:2393] T e381f1d6b8184797ad142de49be225a8 P e61c3a8f61bb48f8a963c9480e53c168 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 0473d2b2d01f4459b1e90fd12cc7840e in current term 16: Already voted for candidate e61c3a8f61bb48f8a963c9480e53c168 in this term.
I20260709 13:07:01.371563 19552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e1f505cb0f1427bbd698ac889d80821" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:07:01.371850 19554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df751f992649444090e27965eb1af85d" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:07:01.372602 19552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef32ce6fdd0e40d382c79974f30295c6" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:07:01.372726 19554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86a6797bdfe94fa496c050ceae4bd0d9" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:07:01.373636 19554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b74109013a140ada21feeef92d6f563" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:07:01.373910 19552 raft_consensus.cc:1240] T 179fd671030940b4b4a4e24bcc4aba0a P e61c3a8f61bb48f8a963c9480e53c168 [term 20 FOLLOWER]: Rejecting Update request from peer 0473d2b2d01f4459b1e90fd12cc7840e for earlier term 19. Current term is 20. Ops: []
I20260709 13:07:01.369534 19526 leader_election.cc:304] T 1dc5b3532fe54f74876d02beffa2c230 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168; no voters: e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:07:01.375128 19482 raft_consensus.cc:2410] T f93ee515a9c14139bf566522ed8232f3 P 0473d2b2d01f4459b1e90fd12cc7840e [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e5256d91808b47c195bc9b4dbd7f2b87 for term 21 because replica has last-logged OpId of term: 20 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 18 index: 9.
I20260709 13:07:01.376709 19553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b08304a0a02b42d7840c4e8ee9a6bd1a" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 19 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:07:01.378407 19554 raft_consensus.cc:2393] T 2b74109013a140ada21feeef92d6f563 P e61c3a8f61bb48f8a963c9480e53c168 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 0473d2b2d01f4459b1e90fd12cc7840e in current term 16: Already voted for candidate e61c3a8f61bb48f8a963c9480e53c168 in this term.
I20260709 13:07:01.311863 25396 raft_consensus.cc:2804] T edd7d470b5014c9489be7f41f64355c9 P e5256d91808b47c195bc9b4dbd7f2b87 [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:07:01.381589 19558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e1085d23e8347fbbd5bce7542f4b1f4" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:07:01.381903 19560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22196caba61445d3bec98a0aab3c337d" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:07:01.383424 19407 raft_consensus.cc:1275] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P e5256d91808b47c195bc9b4dbd7f2b87 [term 20 FOLLOWER]: Refusing update from remote peer 0473d2b2d01f4459b1e90fd12cc7840e: Log matching property violated. Preceding OpId in replica: term: 17 index: 14. Preceding OpId from leader: term: 20 index: 16. (index mismatch)
W20260709 13:07:01.385702 19449 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:01.386564 19449 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:01.355326 25546 raft_consensus.cc:515] T 96efeaaf1057492490e9a621f37e1a2d P 127766fc592545a4997f7790f50f6076 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:07:01.391047 19484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab43d85f64114d4ebf618930e43d9ed0" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:07:01.391323 19450 leader_election.cc:304] T 1dc5b3532fe54f74876d02beffa2c230 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e; no voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:07:01.391633 19484 raft_consensus.cc:2468] T ab43d85f64114d4ebf618930e43d9ed0 P 0473d2b2d01f4459b1e90fd12cc7840e [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 19.
I20260709 13:07:01.392454 19450 leader_election.cc:304] T 7f575b143b844aa096b50997dad3516a P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e; no voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:07:01.392519 19484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed7fdbcb96d14d418db9ca90a792588a" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 16 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:07:01.392910 25546 leader_election.cc:290] T 96efeaaf1057492490e9a621f37e1a2d P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:07:01.393291 19484 raft_consensus.cc:2410] T ed7fdbcb96d14d418db9ca90a792588a P 0473d2b2d01f4459b1e90fd12cc7840e [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e61c3a8f61bb48f8a963c9480e53c168 for term 16 because replica has last-logged OpId of term: 13 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 10.
I20260709 13:07:01.394037 19484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7be9efa6559648dbb5a0f7684c4542d1" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:07:01.394227 19450 leader_election.cc:304] T f1b10566f45d4a7d9029858330e02d5b P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e; no voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:07:01.395004 19478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22196caba61445d3bec98a0aab3c337d" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:07:01.395452 25764 raft_consensus.cc:2749] T 1a61655d99124a29b486ba4a5b37faea P 0473d2b2d01f4459b1e90fd12cc7840e [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:07:01.395699 25376 raft_consensus.cc:2749] T 1dc5b3532fe54f74876d02beffa2c230 P 0473d2b2d01f4459b1e90fd12cc7840e [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:07:01.396052 19478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62c6c134d3d24a1ab144dd9ee6bc3f64" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:07:01.396565 25785 consensus_queue.cc:1059] T 46c5bfeecc314717bffe987e6844b6d0 P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 }, Status: INVALID_TERM, Last received: 23.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:07:01.397190 19478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a61655d99124a29b486ba4a5b37faea" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:07:01.396093 25764 raft_consensus.cc:2749] T 7f575b143b844aa096b50997dad3516a P 0473d2b2d01f4459b1e90fd12cc7840e [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:07:01.397765 19478 raft_consensus.cc:2468] T 1a61655d99124a29b486ba4a5b37faea P 0473d2b2d01f4459b1e90fd12cc7840e [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 16.
I20260709 13:07:01.397694 25376 raft_consensus.cc:3055] T 46c5bfeecc314717bffe987e6844b6d0 P 0473d2b2d01f4459b1e90fd12cc7840e [term 23 LEADER]: Stepping down as leader of term 23
I20260709 13:07:01.394658 19484 raft_consensus.cc:2393] T 7be9efa6559648dbb5a0f7684c4542d1 P 0473d2b2d01f4459b1e90fd12cc7840e [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e61c3a8f61bb48f8a963c9480e53c168 in current term 18: Already voted for candidate 127766fc592545a4997f7790f50f6076 in this term.
I20260709 13:07:01.402896 19478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e1085d23e8347fbbd5bce7542f4b1f4" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:07:01.403393 19554 raft_consensus.cc:1240] T fa8650e71aa14778b3d73721fc50d9fc P e61c3a8f61bb48f8a963c9480e53c168 [term 18 FOLLOWER]: Rejecting Update request from peer 0473d2b2d01f4459b1e90fd12cc7840e for earlier term 17. Current term is 18. Ops: []
I20260709 13:07:01.405711 19450 leader_election.cc:304] T 40e1e16737a842ee936002830f36882e P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168; no voters: e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:07:01.286862 25221 raft_consensus.cc:515] T 70797e5783b5454ab0d0eea663e791e3 P 127766fc592545a4997f7790f50f6076 [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:07:01.405668 25376 raft_consensus.cc:740] T 46c5bfeecc314717bffe987e6844b6d0 P 0473d2b2d01f4459b1e90fd12cc7840e [term 23 LEADER]: Becoming Follower/Learner. State: Replica: 0473d2b2d01f4459b1e90fd12cc7840e, State: Running, Role: LEADER
W20260709 13:07:01.419760 19451 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:01.420728 19407 raft_consensus.cc:1275] T b08304a0a02b42d7840c4e8ee9a6bd1a P e5256d91808b47c195bc9b4dbd7f2b87 [term 19 FOLLOWER]: Refusing update from remote peer 0473d2b2d01f4459b1e90fd12cc7840e: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 19 index: 11. (index mismatch)
I20260709 13:07:01.422622 19526 leader_election.cc:304] T ab43d85f64114d4ebf618930e43d9ed0 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168; no voters: 127766fc592545a4997f7790f50f6076
I20260709 13:07:01.379793 25411 raft_consensus.cc:3055] T 0e1085d23e8347fbbd5bce7542f4b1f4 P e61c3a8f61bb48f8a963c9480e53c168 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:07:01.425956 19484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e381f1d6b8184797ad142de49be225a8" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:07:01.376189 25763 raft_consensus.cc:493] T 4509b76741dc428e9201c70c1658da13 P 0473d2b2d01f4459b1e90fd12cc7840e [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:01.375761 25708 raft_consensus.cc:2749] T 0cdf56e38bbc453d9438d359e5a69955 P 0473d2b2d01f4459b1e90fd12cc7840e [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:07:01.431545 19478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a08760e15aac4630a629431f56024dc8" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:07:01.437635 19484 raft_consensus.cc:2393] T e381f1d6b8184797ad142de49be225a8 P 0473d2b2d01f4459b1e90fd12cc7840e [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate e61c3a8f61bb48f8a963c9480e53c168 in current term 16: Already voted for candidate 0473d2b2d01f4459b1e90fd12cc7840e in this term.
W20260709 13:07:01.470549 19526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.2:46257, user_credentials={real_user=slave}} blocked reactor thread for 48000.8us
I20260709 13:07:01.471704 19526 leader_election.cc:304] T ed7fdbcb96d14d418db9ca90a792588a P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e61c3a8f61bb48f8a963c9480e53c168; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, 127766fc592545a4997f7790f50f6076
I20260709 13:07:01.473204 19526 leader_election.cc:304] T 22196caba61445d3bec98a0aab3c337d P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e61c3a8f61bb48f8a963c9480e53c168; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:07:01.438658 19484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40e1e16737a842ee936002830f36882e" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:07:01.407637 25598 raft_consensus.cc:2749] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P e5256d91808b47c195bc9b4dbd7f2b87 [term 20 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:07:01.419737 25599 raft_consensus.cc:2804] T 1dc5b3532fe54f74876d02beffa2c230 P e61c3a8f61bb48f8a963c9480e53c168 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:07:01.409816 25396 raft_consensus.cc:697] T edd7d470b5014c9489be7f41f64355c9 P e5256d91808b47c195bc9b4dbd7f2b87 [term 22 LEADER]: Becoming Leader. State: Replica: e5256d91808b47c195bc9b4dbd7f2b87, State: Running, Role: LEADER
I20260709 13:07:01.409443 25715 raft_consensus.cc:697] T 40e1e16737a842ee936002830f36882e P e61c3a8f61bb48f8a963c9480e53c168 [term 20 LEADER]: Becoming Leader. State: Replica: e61c3a8f61bb48f8a963c9480e53c168, State: Running, Role: LEADER
I20260709 13:07:01.380821 25755 raft_consensus.cc:515] T 0afb57ae58a24a01850491d69f0213dd P e61c3a8f61bb48f8a963c9480e53c168 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
W20260709 13:07:01.493453 20078 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.2:46257, user_credentials={real_user=slave}} blocked reactor thread for 185364us
I20260709 13:07:01.428367 25772 raft_consensus.cc:493] T 2e36a9d6e29c4a7c860cf267efbd4c74 P e61c3a8f61bb48f8a963c9480e53c168 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 0473d2b2d01f4459b1e90fd12cc7840e)
I20260709 13:07:01.433113 25764 raft_consensus.cc:2804] T 40e1e16737a842ee936002830f36882e P 0473d2b2d01f4459b1e90fd12cc7840e [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:07:01.470184 25765 raft_consensus.cc:2749] T f1b10566f45d4a7d9029858330e02d5b P 0473d2b2d01f4459b1e90fd12cc7840e [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:07:01.498320 25396 consensus_queue.cc:237] T edd7d470b5014c9489be7f41f64355c9 P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 20.11, Last appended by leader: 11, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:07:01.484866 25599 raft_consensus.cc:493] T 1dc5b3532fe54f74876d02beffa2c230 P e61c3a8f61bb48f8a963c9480e53c168 [term 19 FOLLOWER]: Starting leader election (detected failure of leader e5256d91808b47c195bc9b4dbd7f2b87)
I20260709 13:07:01.428858 25411 raft_consensus.cc:740] T 0e1085d23e8347fbbd5bce7542f4b1f4 P e61c3a8f61bb48f8a963c9480e53c168 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: e61c3a8f61bb48f8a963c9480e53c168, State: Running, Role: LEADER
W20260709 13:07:01.500020 19377 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.2:46257, user_credentials={real_user=slave}} blocked reactor thread for 153661us
I20260709 13:07:01.479745 25712 raft_consensus.cc:2804] T ab43d85f64114d4ebf618930e43d9ed0 P e61c3a8f61bb48f8a963c9480e53c168 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:07:01.537366 19478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21e14947d70440f19044d8f75c31e1f9" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:07:01.433967 25597 consensus_queue.cc:1048] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 14, Time since last communication: 0.067s
I20260709 13:07:01.492151 25678 raft_consensus.cc:2749] T ed7fdbcb96d14d418db9ca90a792588a P e61c3a8f61bb48f8a963c9480e53c168 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:07:01.496068 25747 raft_consensus.cc:2749] T 22196caba61445d3bec98a0aab3c337d P e61c3a8f61bb48f8a963c9480e53c168 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:07:01.472863 25735 consensus_queue.cc:1048] T ab43d85f64114d4ebf618930e43d9ed0 P 127766fc592545a4997f7790f50f6076 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.029s
W20260709 13:07:01.506763 25418 consensus_meta.cc:287] T ff75a1d4cb1f493db8f71ddc136ba9ab P 0473d2b2d01f4459b1e90fd12cc7840e: Time spent flushing consensus metadata: real 0.634s	user 0.005s	sys 0.005s
I20260709 13:07:01.500413 25359 raft_consensus.cc:515] T 1f85fc4b527a48848e5faa083b604e36 P 127766fc592545a4997f7790f50f6076 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:07:01.545715 19478 raft_consensus.cc:2468] T 21e14947d70440f19044d8f75c31e1f9 P 0473d2b2d01f4459b1e90fd12cc7840e [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 17.
I20260709 13:07:01.536618 25677 raft_consensus.cc:476] T 85c494af21f9457a85da47b9bc70c1fd P e61c3a8f61bb48f8a963c9480e53c168 [term 17 LEADER]: Not starting pre-election -- already a leader
I20260709 13:07:01.537887 25598 raft_consensus.cc:493] T bc225c93219c45538b53a1bd3d387e4d P e5256d91808b47c195bc9b4dbd7f2b87 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:01.540813 19450 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.3:36891, user_credentials={real_user=slave}} blocked reactor thread for 110327us
W20260709 13:07:01.551841 20078 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.2:46257, user_credentials={real_user=slave}} blocked reactor thread for 49895.6us
I20260709 13:07:01.603077 20078 leader_election.cc:304] T ff9b0eddd810459b82d91c60777c10eb P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 127766fc592545a4997f7790f50f6076; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:07:01.575491 19408 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52328 (request call id 2545) took 1239 ms. Trace:
W20260709 13:07:01.540975 19526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.2:46257, user_credentials={real_user=slave}} blocked reactor thread for 67868.2us
I20260709 13:07:01.604816 19526 leader_election.cc:304] T 62c6c134d3d24a1ab144dd9ee6bc3f64 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e61c3a8f61bb48f8a963c9480e53c168; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, 127766fc592545a4997f7790f50f6076
I20260709 13:07:01.551672 19402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a61655d99124a29b486ba4a5b37faea" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
I20260709 13:07:01.606937 19402 raft_consensus.cc:3060] T 1a61655d99124a29b486ba4a5b37faea P e5256d91808b47c195bc9b4dbd7f2b87 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:07:01.536409 25463 raft_consensus.cc:493] T 96efeaaf1057492490e9a621f37e1a2d P 0473d2b2d01f4459b1e90fd12cc7840e [term 19 FOLLOWER]: Starting pre-election (detected failure of leader e61c3a8f61bb48f8a963c9480e53c168)
I20260709 13:07:01.476181 25763 raft_consensus.cc:515] T 4509b76741dc428e9201c70c1658da13 P 0473d2b2d01f4459b1e90fd12cc7840e [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
W20260709 13:07:01.546352 19377 leader_election.cc:336] T 172b3dd13109415a955b71ac0e9d2234 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257): Timed out: RequestConsensusVote RPC to 127.17.223.2:46257 timed out after 2.064s (SENT)
I20260709 13:07:01.606441 19526 leader_election.cc:304] T 7be9efa6559648dbb5a0f7684c4542d1 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, 127766fc592545a4997f7790f50f6076
I20260709 13:07:01.603808 19408 rpcz_store.cc:276] 0709 13:07:00.331943 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:00.332115 (+   172us) service_pool.cc:224] Handling call
0709 13:07:01.563778 (+1231663us) spinlock_profiling.cc:243] Waited 500 ms on lock 0x7b54000b2cd4. stack: 00007f4a79de9343 00007f4a79de9240 00007f4a797781d4 00007f4a834b6304 00007f4a834b6299 00007f4a7ce71571 00007f4a7cf0c2fa 00007f4a81ecdb17 00007f4a7b4486d4 00007f4a7b448662 00007f4a7b448591 00007f4a7b44850c 00007f4a7b4477c2 00007f4a7b24348c 00007f4a7b2428c6 00007f4a7b24226f
0709 13:07:01.571522 (+  7744us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1149079808}
I20260709 13:07:01.601461 19485 raft_consensus.cc:2410] T ff75a1d4cb1f493db8f71ddc136ba9ab P 0473d2b2d01f4459b1e90fd12cc7840e [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e5256d91808b47c195bc9b4dbd7f2b87 for term 19 because replica has last-logged OpId of term: 18 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 17 index: 9.
I20260709 13:07:01.610915 19377 leader_election.cc:304] T 172b3dd13109415a955b71ac0e9d2234 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, 127766fc592545a4997f7790f50f6076
I20260709 13:07:01.612599 19450 leader_election.cc:304] T ed7fdbcb96d14d418db9ca90a792588a P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168; no voters: 127766fc592545a4997f7790f50f6076
W20260709 13:07:01.616331 19523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.4:43121, user_credentials={real_user=slave}} blocked reactor thread for 79022us
I20260709 13:07:01.618757 25754 raft_consensus.cc:2749] T 62c6c134d3d24a1ab144dd9ee6bc3f64 P e61c3a8f61bb48f8a963c9480e53c168 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:07:01.622332 19552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7be9efa6559648dbb5a0f7684c4542d1" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:07:01.624279 19552 raft_consensus.cc:2393] T 7be9efa6559648dbb5a0f7684c4542d1 P e61c3a8f61bb48f8a963c9480e53c168 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 127766fc592545a4997f7790f50f6076 in current term 19: Already voted for candidate e5256d91808b47c195bc9b4dbd7f2b87 in this term.
I20260709 13:07:01.624819 19557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96efeaaf1057492490e9a621f37e1a2d" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:07:01.545194 25599 raft_consensus.cc:3060] T 1dc5b3532fe54f74876d02beffa2c230 P e61c3a8f61bb48f8a963c9480e53c168 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:07:01.615129 19482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e5873a19244c5ebbcd38e126796ee7" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 21 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:07:01.629056 19450 leader_election.cc:304] T 76cb037fc9064d13b59a8969d897ce8c P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e; no voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:07:01.633755 19482 raft_consensus.cc:3060] T d1e5873a19244c5ebbcd38e126796ee7 P 0473d2b2d01f4459b1e90fd12cc7840e [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:07:01.631389 19478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b74109013a140ada21feeef92d6f563" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:07:01.634564 19478 raft_consensus.cc:2393] T 2b74109013a140ada21feeef92d6f563 P 0473d2b2d01f4459b1e90fd12cc7840e [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate e61c3a8f61bb48f8a963c9480e53c168 in current term 16: Already voted for candidate 0473d2b2d01f4459b1e90fd12cc7840e in this term.
I20260709 13:07:01.541247 25086 leader_election.cc:290] T 1a61655d99124a29b486ba4a5b37faea P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 17 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:07:01.575713 25537 raft_consensus.cc:3055] T 48824d5acfbc485ebf8c2d944e7202de P 0473d2b2d01f4459b1e90fd12cc7840e [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:07:01.550465 25712 raft_consensus.cc:493] T ab43d85f64114d4ebf618930e43d9ed0 P e61c3a8f61bb48f8a963c9480e53c168 [term 19 FOLLOWER]: Starting leader election (detected failure of leader 127766fc592545a4997f7790f50f6076)
I20260709 13:07:01.544440 25764 raft_consensus.cc:697] T 40e1e16737a842ee936002830f36882e P 0473d2b2d01f4459b1e90fd12cc7840e [term 19 LEADER]: Becoming Leader. State: Replica: 0473d2b2d01f4459b1e90fd12cc7840e, State: Running, Role: LEADER
I20260709 13:07:01.637172 19450 leader_election.cc:304] T 14935b3ddf914369822e4a0547aaa355 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e; no voters: 127766fc592545a4997f7790f50f6076, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:07:01.640425 20078 leader_election.cc:304] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 127766fc592545a4997f7790f50f6076; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:07:01.607890 25677 raft_consensus.cc:493] T 65d8cb8d6ec64f459d5a47cefab10acf P e61c3a8f61bb48f8a963c9480e53c168 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:01.689020 19478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46c5bfeecc314717bffe987e6844b6d0" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 24 candidate_status { last_received { term: 23 index: 12 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:07:01.646042 19450 leader_election.cc:304] T e381f1d6b8184797ad142de49be225a8 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e; no voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:07:01.687068 19402 raft_consensus.cc:2468] T 1a61655d99124a29b486ba4a5b37faea P e5256d91808b47c195bc9b4dbd7f2b87 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 17.
I20260709 13:07:01.687731 20109 raft_consensus.cc:1240] T 48824d5acfbc485ebf8c2d944e7202de P 127766fc592545a4997f7790f50f6076 [term 21 LEADER]: Rejecting Update request from peer 0473d2b2d01f4459b1e90fd12cc7840e for earlier term 20. Current term is 21. Ops: []
I20260709 13:07:01.636446 25754 raft_consensus.cc:2749] T 7be9efa6559648dbb5a0f7684c4542d1 P e61c3a8f61bb48f8a963c9480e53c168 [term 19 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 13:07:01.723460 19450 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.3:36891, user_credentials={real_user=slave}} blocked reactor thread for 77518.6us
W20260709 13:07:01.726979 19526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.2:46257, user_credentials={real_user=slave}} blocked reactor thread for 98040.6us
I20260709 13:07:01.727586 19450 leader_election.cc:304] T 3e1f505cb0f1427bbd698ac889d80821 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e; no voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:07:01.727749 19526 leader_election.cc:304] T e381f1d6b8184797ad142de49be225a8 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e61c3a8f61bb48f8a963c9480e53c168; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:07:01.640138 25537 raft_consensus.cc:740] T 48824d5acfbc485ebf8c2d944e7202de P 0473d2b2d01f4459b1e90fd12cc7840e [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 0473d2b2d01f4459b1e90fd12cc7840e, State: Running, Role: LEADER
I20260709 13:07:01.639393 25765 raft_consensus.cc:2749] T 76cb037fc9064d13b59a8969d897ce8c P 0473d2b2d01f4459b1e90fd12cc7840e [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:07:01.541729 25772 raft_consensus.cc:515] T 2e36a9d6e29c4a7c860cf267efbd4c74 P e61c3a8f61bb48f8a963c9480e53c168 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:07:01.627771 25463 raft_consensus.cc:515] T 96efeaaf1057492490e9a621f37e1a2d P 0473d2b2d01f4459b1e90fd12cc7840e [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
W20260709 13:07:01.714282 25756 log.cc:927] Time spent T 833a2f0775ed407a94b8924ce50adb63 P e5256d91808b47c195bc9b4dbd7f2b87: Append to log took a long time: real 0.079s	user 0.000s	sys 0.000s
I20260709 13:07:01.609844 25598 raft_consensus.cc:515] T bc225c93219c45538b53a1bd3d387e4d P e5256d91808b47c195bc9b4dbd7f2b87 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:07:01.630051 25785 raft_consensus.cc:2804] T ed7fdbcb96d14d418db9ca90a792588a P 0473d2b2d01f4459b1e90fd12cc7840e [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:07:01.638213 25546 raft_consensus.cc:2749] T ff9b0eddd810459b82d91c60777c10eb P 127766fc592545a4997f7790f50f6076 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:07:01.741894 19526 leader_election.cc:304] T a08760e15aac4630a629431f56024dc8 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e61c3a8f61bb48f8a963c9480e53c168; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:07:01.714471 25056 raft_consensus.cc:2749] T 172b3dd13109415a955b71ac0e9d2234 P e5256d91808b47c195bc9b4dbd7f2b87 [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:07:01.681017 25806 raft_consensus.cc:2749] T 14935b3ddf914369822e4a0547aaa355 P 0473d2b2d01f4459b1e90fd12cc7840e [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:07:01.600711 25376 consensus_queue.cc:260] T 46c5bfeecc314717bffe987e6844b6d0 P 0473d2b2d01f4459b1e90fd12cc7840e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 23.12, Last appended by leader: 12, Current term: 23, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:07:01.641518 25712 raft_consensus.cc:3060] T ab43d85f64114d4ebf618930e43d9ed0 P e61c3a8f61bb48f8a963c9480e53c168 [term 19 FOLLOWER]: Advancing to term 20
W20260709 13:07:01.759847 20075 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:01.753343 25798 raft_consensus.cc:2749] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P 127766fc592545a4997f7790f50f6076 [term 20 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:07:01.688820 25715 consensus_queue.cc:237] T 40e1e16737a842ee936002830f36882e P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 18.10, Last appended by leader: 10, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:07:01.754136 25800 raft_consensus.cc:493] T 1efebf73c86e432baa55533136b6e12c P e61c3a8f61bb48f8a963c9480e53c168 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 0473d2b2d01f4459b1e90fd12cc7840e)
W20260709 13:07:01.755934 20076 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.3:36891, user_credentials={real_user=slave}} blocked reactor thread for 117985us
I20260709 13:07:01.551185 25760 consensus_queue.cc:237] T 86a6797bdfe94fa496c050ceae4bd0d9 P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 14.7, Last appended by leader: 7, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:07:01.738111 25520 raft_consensus.cc:2749] T e381f1d6b8184797ad142de49be225a8 P 0473d2b2d01f4459b1e90fd12cc7840e [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:07:01.689764 25677 raft_consensus.cc:515] T 65d8cb8d6ec64f459d5a47cefab10acf P e61c3a8f61bb48f8a963c9480e53c168 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:07:01.738822 25799 raft_consensus.cc:493] T b9f0d59553ad444883fcf5b5909f9798 P e61c3a8f61bb48f8a963c9480e53c168 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 0473d2b2d01f4459b1e90fd12cc7840e)
I20260709 13:07:01.627429 25411 consensus_queue.cc:260] T 0e1085d23e8347fbbd5bce7542f4b1f4 P e61c3a8f61bb48f8a963c9480e53c168 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.12, Last appended by leader: 12, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:07:01.778030 19526 leader_election.cc:304] T 21e14947d70440f19044d8f75c31e1f9 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168; no voters: e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:07:01.778332 20076 leader_election.cc:304] T 7be9efa6559648dbb5a0f7684c4542d1 P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 127766fc592545a4997f7790f50f6076; no voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:07:01.760553 25754 raft_consensus.cc:2749] T e381f1d6b8184797ad142de49be225a8 P e61c3a8f61bb48f8a963c9480e53c168 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:07:01.782987 19526 leader_election.cc:304] T 2b74109013a140ada21feeef92d6f563 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e61c3a8f61bb48f8a963c9480e53c168; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:07:01.752357 25785 raft_consensus.cc:493] T ed7fdbcb96d14d418db9ca90a792588a P 0473d2b2d01f4459b1e90fd12cc7840e [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:07:01.766367 25304 consensus_meta.cc:287] T d1e5873a19244c5ebbcd38e126796ee7 P e5256d91808b47c195bc9b4dbd7f2b87: Time spent flushing consensus metadata: real 0.610s	user 0.001s	sys 0.009s
I20260709 13:07:01.786509 25537 consensus_queue.cc:260] T 48824d5acfbc485ebf8c2d944e7202de P 0473d2b2d01f4459b1e90fd12cc7840e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 20.14, Last appended by leader: 14, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:07:01.787809 19405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70797e5783b5454ab0d0eea663e791e3" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
I20260709 13:07:01.788184 25086 raft_consensus.cc:2804] T 21e14947d70440f19044d8f75c31e1f9 P e61c3a8f61bb48f8a963c9480e53c168 [term 17 FOLLOWER]: Leader pre-election won for term 18
W20260709 13:07:01.805873 19451 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:01.765974 25221 leader_election.cc:290] T 70797e5783b5454ab0d0eea663e791e3 P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 21 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:07:01.807991 19402 raft_consensus.cc:1275] T 309c3ca0ca4b4f3ba129752ea2cb293b P e5256d91808b47c195bc9b4dbd7f2b87 [term 12 FOLLOWER]: Refusing update from remote peer 0473d2b2d01f4459b1e90fd12cc7840e: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 12 index: 12. (index mismatch)
I20260709 13:07:01.802597 25785 raft_consensus.cc:3060] T ed7fdbcb96d14d418db9ca90a792588a P 0473d2b2d01f4459b1e90fd12cc7840e [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:07:01.809479 19377 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.2:46257, user_credentials={real_user=slave}} blocked reactor thread for 263134us
W20260709 13:07:01.796226 25661 consensus_meta.cc:287] T b08304a0a02b42d7840c4e8ee9a6bd1a P e61c3a8f61bb48f8a963c9480e53c168: Time spent flushing consensus metadata: real 0.841s	user 0.009s	sys 0.001s
I20260709 13:07:01.818068 19553 raft_consensus.cc:2410] T b08304a0a02b42d7840c4e8ee9a6bd1a P e61c3a8f61bb48f8a963c9480e53c168 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 0473d2b2d01f4459b1e90fd12cc7840e for term 19 because replica has last-logged OpId of term: 18 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 10.
I20260709 13:07:01.800933 25806 raft_consensus.cc:2749] T 3e1f505cb0f1427bbd698ac889d80821 P 0473d2b2d01f4459b1e90fd12cc7840e [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:07:01.807579 25463 leader_election.cc:290] T 96efeaaf1057492490e9a621f37e1a2d P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:07:01.806697 25086 raft_consensus.cc:493] T 21e14947d70440f19044d8f75c31e1f9 P e61c3a8f61bb48f8a963c9480e53c168 [term 17 FOLLOWER]: Starting leader election (detected failure of leader e5256d91808b47c195bc9b4dbd7f2b87)
I20260709 13:07:01.814491 25537 raft_consensus.cc:3060] T 48824d5acfbc485ebf8c2d944e7202de P 0473d2b2d01f4459b1e90fd12cc7840e [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:07:01.850109 19377 leader_election.cc:304] T 40e1e16737a842ee936002830f36882e P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:07:01.811805 25754 raft_consensus.cc:2749] T 2b74109013a140ada21feeef92d6f563 P e61c3a8f61bb48f8a963c9480e53c168 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:07:01.857517 20109 raft_consensus.cc:1275] T 172b3dd13109415a955b71ac0e9d2234 P 127766fc592545a4997f7790f50f6076 [term 17 FOLLOWER]: Refusing update from remote peer 0473d2b2d01f4459b1e90fd12cc7840e: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
I20260709 13:07:01.893674 20103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96efeaaf1057492490e9a621f37e1a2d" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:07:01.894368 20103 raft_consensus.cc:2468] T 96efeaaf1057492490e9a621f37e1a2d P 127766fc592545a4997f7790f50f6076 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 19.
W20260709 13:07:01.893074 19450 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.3:36891, user_credentials={real_user=slave}} blocked reactor thread for 165558us
I20260709 13:07:01.895601 19450 leader_election.cc:304] T df751f992649444090e27965eb1af85d P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e; no voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:07:01.817795 25755 leader_election.cc:290] T 0afb57ae58a24a01850491d69f0213dd P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:07:01.898995 19405 raft_consensus.cc:2468] T 70797e5783b5454ab0d0eea663e791e3 P e5256d91808b47c195bc9b4dbd7f2b87 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 127766fc592545a4997f7790f50f6076 in term 21.
I20260709 13:07:01.775610 25800 raft_consensus.cc:515] T 1efebf73c86e432baa55533136b6e12c P e61c3a8f61bb48f8a963c9480e53c168 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:07:01.897234 19377 leader_election.cc:304] T 46c5bfeecc314717bffe987e6844b6d0 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:07:01.905771 19377 leader_election.cc:304] T 3e1f505cb0f1427bbd698ac889d80821 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:07:01.900033 19402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4509b76741dc428e9201c70c1658da13" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:07:01.817611 25597 consensus_queue.cc:1048] T b08304a0a02b42d7840c4e8ee9a6bd1a P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.076s
I20260709 13:07:01.854420 25359 leader_election.cc:290] T 1f85fc4b527a48848e5faa083b604e36 P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 18 election: Requested vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321)
I20260709 13:07:01.852808 25086 raft_consensus.cc:3060] T 21e14947d70440f19044d8f75c31e1f9 P e61c3a8f61bb48f8a963c9480e53c168 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:07:01.795747 25799 raft_consensus.cc:515] T b9f0d59553ad444883fcf5b5909f9798 P e61c3a8f61bb48f8a963c9480e53c168 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
W20260709 13:07:01.898857 25792 log.cc:927] Time spent T 217b5fae677b4971b3bbd2f357a1f7ff P e5256d91808b47c195bc9b4dbd7f2b87: Append to log took a long time: real 0.316s	user 0.001s	sys 0.000s
W20260709 13:07:01.916538 19523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.4:43121, user_credentials={real_user=slave}} blocked reactor thread for 112782us
I20260709 13:07:01.802441 25764 consensus_queue.cc:237] T 40e1e16737a842ee936002830f36882e P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 18.10, Last appended by leader: 10, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:07:01.848506 25713 consensus_queue.cc:1059] T 7f575b143b844aa096b50997dad3516a P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 }, Status: INVALID_TERM, Last received: 14.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.055s
I20260709 13:07:01.918144 20103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0afb57ae58a24a01850491d69f0213dd" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:07:01.919253 19557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70797e5783b5454ab0d0eea663e791e3" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:07:01.890568 25304 consensus_queue.cc:1048] T 0cdf56e38bbc453d9438d359e5a69955 P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.029s
I20260709 13:07:01.910050 25814 raft_consensus.cc:2749] T 40e1e16737a842ee936002830f36882e P e5256d91808b47c195bc9b4dbd7f2b87 [term 20 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:07:01.925673 19557 raft_consensus.cc:2393] T 70797e5783b5454ab0d0eea663e791e3 P e61c3a8f61bb48f8a963c9480e53c168 [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate 127766fc592545a4997f7790f50f6076 in current term 21: Already voted for candidate e61c3a8f61bb48f8a963c9480e53c168 in this term.
W20260709 13:07:01.915501 25793 log.cc:927] Time spent T 48824d5acfbc485ebf8c2d944e7202de P 127766fc592545a4997f7790f50f6076: Append to log took a long time: real 0.161s	user 0.001s	sys 0.001s
W20260709 13:07:01.919906 25795 log.cc:927] Time spent T 85c494af21f9457a85da47b9bc70c1fd P 127766fc592545a4997f7790f50f6076: Append to log took a long time: real 0.255s	user 0.000s	sys 0.001s
I20260709 13:07:01.909416 25763 leader_election.cc:290] T 4509b76741dc428e9201c70c1658da13 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
W20260709 13:07:01.925199 25802 log.cc:927] Time spent T 65d8cb8d6ec64f459d5a47cefab10acf P 127766fc592545a4997f7790f50f6076: Append to log took a long time: real 0.276s	user 0.000s	sys 0.001s
I20260709 13:07:01.923312 25794 raft_consensus.cc:2749] T 7be9efa6559648dbb5a0f7684c4542d1 P 127766fc592545a4997f7790f50f6076 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:07:01.920025 25812 raft_consensus.cc:2749] T 3e1f505cb0f1427bbd698ac889d80821 P e5256d91808b47c195bc9b4dbd7f2b87 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:07:01.933086 25816 raft_consensus.cc:493] T 309c3ca0ca4b4f3ba129752ea2cb293b P 127766fc592545a4997f7790f50f6076 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:01.925787 25809 raft_consensus.cc:2749] T a08760e15aac4630a629431f56024dc8 P e61c3a8f61bb48f8a963c9480e53c168 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:07:01.944228 25805 raft_consensus.cc:2749] T df751f992649444090e27965eb1af85d P 0473d2b2d01f4459b1e90fd12cc7840e [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
W20260709 13:07:01.957921 25797 log.cc:927] Time spent T 172b3dd13109415a955b71ac0e9d2234 P 0473d2b2d01f4459b1e90fd12cc7840e: Append to log took a long time: real 0.208s	user 0.000s	sys 0.001s
I20260709 13:07:01.923540 25622 consensus_queue.cc:1048] T 309c3ca0ca4b4f3ba129752ea2cb293b P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.037s
I20260709 13:07:01.951556 25598 leader_election.cc:290] T bc225c93219c45538b53a1bd3d387e4d P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:07:01.924964 25396 raft_consensus.cc:3060] T 46c5bfeecc314717bffe987e6844b6d0 P e5256d91808b47c195bc9b4dbd7f2b87 [term 23 FOLLOWER]: Advancing to term 24
W20260709 13:07:01.970443 25791 log.cc:927] Time spent T 00000000000000000000000000000000 P 97750b77d35444acb7791ebf26cc2685: Append to log took a long time: real 0.492s	user 0.003s	sys 0.000s
I20260709 13:07:01.982432 19482 raft_consensus.cc:2468] T d1e5873a19244c5ebbcd38e126796ee7 P 0473d2b2d01f4459b1e90fd12cc7840e [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 21.
I20260709 13:07:01.993451 25677 leader_election.cc:290] T 65d8cb8d6ec64f459d5a47cefab10acf P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:07:01.970309 25816 raft_consensus.cc:515] T 309c3ca0ca4b4f3ba129752ea2cb293b P 127766fc592545a4997f7790f50f6076 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:07:01.996220 25816 leader_election.cc:290] T 309c3ca0ca4b4f3ba129752ea2cb293b P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:07:02.001171 25816 raft_consensus.cc:493] T 172b3dd13109415a955b71ac0e9d2234 P 127766fc592545a4997f7790f50f6076 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:02.002337 25804 consensus_queue.cc:1059] T 76cb037fc9064d13b59a8969d897ce8c P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.098s
W20260709 13:07:02.003044 25790 log.cc:927] Time spent T 0e1085d23e8347fbbd5bce7542f4b1f4 P 0473d2b2d01f4459b1e90fd12cc7840e: Append to log took a long time: real 0.308s	user 0.001s	sys 0.000s
W20260709 13:07:02.009850 25782 log.cc:927] Time spent T 62c6c134d3d24a1ab144dd9ee6bc3f64 P 0473d2b2d01f4459b1e90fd12cc7840e: Append to log took a long time: real 0.835s	user 0.003s	sys 0.000s
W20260709 13:07:02.010294 25781 log.cc:927] Time spent T 14935b3ddf914369822e4a0547aaa355 P 0473d2b2d01f4459b1e90fd12cc7840e: Append to log took a long time: real 0.835s	user 0.005s	sys 0.001s
I20260709 13:07:02.012638 19479 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39478 (request call id 1010) took 1092 ms. Trace:
I20260709 13:07:02.015544 19409 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52342 (request call id 3191) took 1016 ms. Trace:
W20260709 13:07:02.016206 25777 log.cc:927] Time spent T ff75a1d4cb1f493db8f71ddc136ba9ab P e61c3a8f61bb48f8a963c9480e53c168: Append to log took a long time: real 0.843s	user 0.004s	sys 0.000s
I20260709 13:07:02.016386 19481 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39478 (request call id 1011) took 1083 ms. Trace:
I20260709 13:07:02.016791 19481 rpcz_store.cc:276] 0709 13:07:00.932666 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:00.932849 (+   183us) service_pool.cc:224] Handling call
0709 13:07:00.933234 (+   385us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:00.933724 (+   490us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:00.933765 (+    41us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:00.939392 (+  5627us) log.cc:844] Serialized 26 byte log entry
0709 13:07:01.094474 (+155082us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:07:01.164187 (+ 69713us) log.cc:844] Serialized 14 byte log entry
0709 13:07:01.164549 (+   362us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:01.164804 (+   255us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:02.009129 (+844325us) spinlock_profiling.cc:243] Waited 23.7 ms on lock 0x7b4400022b4c. stack: 00007f4a79de9343 00007f4a79de9240 00007f4a797781d4 00007f4a834b6304 00007f4a834b6299 00007f4a79ca3db1 00007f4a79d41c85 00007f4a79d426a2 00007f4a7cab41db 00007f4a7caafaaf 00007f4a7caa386e 00007f4a7caa2bb6 00007f4a7caa27d8 00007f4a7caac221 00007f4a7caac1d9 00007f4a7caac169
0709 13:07:02.013590 (+  4461us) raft_consensus.cc:1685] finished
0709 13:07:02.016174 (+  2584us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:02.016325 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":31673,"prepare.queue_time_us":119758,"prepare.run_cpu_time_us":36,"prepare.run_wall_time_us":37,"raft.queue_time_us":1614,"raft.run_cpu_time_us":273,"raft.run_wall_time_us":9345,"spinlock_wait_cycles":54489856,"thread_start_us":138455,"threads_started":2,"wal-append.queue_time_us":187572}
I20260709 13:07:02.020027 25599 raft_consensus.cc:515] T 1dc5b3532fe54f74876d02beffa2c230 P e61c3a8f61bb48f8a963c9480e53c168 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:07:02.021521 19551 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40438 (request call id 3055) took 1153 ms. Trace:
I20260709 13:07:02.022054 19485 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58294 (request call id 2851) took 1280 ms. Trace:
I20260709 13:07:02.022531 19485 rpcz_store.cc:276] 0709 13:07:00.741671 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:00.741865 (+   194us) service_pool.cc:224] Handling call
0709 13:07:02.021863 (+1279998us) spinlock_profiling.cc:243] Waited 849 ms on lock 0x7b5400222c54. stack: 00007f4a79de9343 00007f4a79de9240 00007f4a797781d4 00007f4a834b6304 00007f4a834b6299 00007f4a7ce71571 00007f4a7cf0c2fa 00007f4a81ecdb17 00007f4a7b4486d4 00007f4a7b448662 00007f4a7b448591 00007f4a7b44850c 00007f4a7b4477c2 00007f4a7b24348c 00007f4a7b2428c6 00007f4a7b24226f
0709 13:07:02.021999 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1953409920}
W20260709 13:07:02.023214 19483 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58294 (request call id 2826) took 1690 ms (client timeout 2064 ms). Trace:
W20260709 13:07:02.023705 19483 rpcz_store.cc:269] 0709 13:07:00.333418 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:00.351266 (+ 17848us) service_pool.cc:224] Handling call
0709 13:07:02.022972 (+1671706us) spinlock_profiling.cc:243] Waited 1.09 s on lock 0x7b540029d954. stack: 00007f4a79de9343 00007f4a79de9240 00007f4a797781d4 00007f4a834b6304 00007f4a834b6299 00007f4a7ce71571 00007f4a7cf0c2fa 00007f4a81ecdb17 00007f4a7b4486d4 00007f4a7b448662 00007f4a7b448591 00007f4a7b44850c 00007f4a7b4477c2 00007f4a7b24348c 00007f4a7b2428c6 00007f4a7b24226f
0709 13:07:02.023148 (+   176us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2499018112}
I20260709 13:07:02.024171 25785 raft_consensus.cc:515] T ed7fdbcb96d14d418db9ca90a792588a P 0473d2b2d01f4459b1e90fd12cc7840e [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:07:02.024550 19477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a61655d99124a29b486ba4a5b37faea" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:07:02.024787 19483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76cb037fc9064d13b59a8969d897ce8c" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 17 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:07:02.025097 19477 raft_consensus.cc:3060] T 1a61655d99124a29b486ba4a5b37faea P 0473d2b2d01f4459b1e90fd12cc7840e [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:07:02.025700 19483 raft_consensus.cc:2393] T 76cb037fc9064d13b59a8969d897ce8c P 0473d2b2d01f4459b1e90fd12cc7840e [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e61c3a8f61bb48f8a963c9480e53c168 in current term 17: Already voted for candidate 0473d2b2d01f4459b1e90fd12cc7840e in this term.
I20260709 13:07:02.026473 25622 raft_consensus.cc:493] T a08760e15aac4630a629431f56024dc8 P 0473d2b2d01f4459b1e90fd12cc7840e [term 21 FOLLOWER]: Starting pre-election (detected failure of leader e5256d91808b47c195bc9b4dbd7f2b87)
I20260709 13:07:02.013123 19479 rpcz_store.cc:276] 0709 13:07:00.920492 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:00.926897 (+  6405us) service_pool.cc:224] Handling call
0709 13:07:00.944753 (+ 17856us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:00.945181 (+   428us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:00.945221 (+    40us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:00.949056 (+  3835us) log.cc:844] Serialized 26 byte log entry
0709 13:07:01.105114 (+156058us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:07:01.284698 (+179584us) log.cc:844] Serialized 14 byte log entry
0709 13:07:01.306336 (+ 21638us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:01.306412 (+    76us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:02.009460 (+703048us) spinlock_profiling.cc:243] Waited 39.1 ms on lock 0x7b4400022b4c. stack: 00007f4a79de9343 00007f4a79de9240 00007f4a797781d4 00007f4a834b6304 00007f4a834b6299 00007f4a79ca3db1 00007f4a79d41c85 00007f4a79d426a2 00007f4a7cab41db 00007f4a7caafaaf 00007f4a7caa386e 00007f4a7caa2bb6 00007f4a7caa27d8 00007f4a7caac221 00007f4a7caac1d9 00007f4a7caac169
0709 13:07:02.012241 (+  2781us) raft_consensus.cc:1685] finished
0709 13:07:02.012381 (+   140us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:02.012547 (+   166us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":41054,"prepare.queue_time_us":133857,"prepare.run_cpu_time_us":26,"prepare.run_wall_time_us":26,"raft.queue_time_us":68743,"raft.run_cpu_time_us":391,"raft.run_wall_time_us":55930,"spinlock_wait_cycles":89822080,"thread_start_us":197590,"threads_started":2,"wal-append.queue_time_us":194339}
I20260709 13:07:02.002105 25816 raft_consensus.cc:515] T 172b3dd13109415a955b71ac0e9d2234 P 127766fc592545a4997f7790f50f6076 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:07:02.027127 19480 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58294 (request call id 2852) took 1276 ms. Trace:
I20260709 13:07:02.031400 19480 rpcz_store.cc:276] 0709 13:07:00.750881 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:00.751027 (+   146us) service_pool.cc:224] Handling call
0709 13:07:02.026967 (+1275940us) spinlock_profiling.cc:243] Waited 432 ms on lock 0x7b5400221d54. stack: 00007f4a79de9343 00007f4a79de9240 00007f4a797781d4 00007f4a834b6304 00007f4a834b6299 00007f4a7ce71571 00007f4a7cf0c2fa 00007f4a81ecdb17 00007f4a7b4486d4 00007f4a7b448662 00007f4a7b448591 00007f4a7b44850c 00007f4a7b4477c2 00007f4a7b24348c 00007f4a7b2428c6 00007f4a7b24226f
0709 13:07:02.027073 (+   106us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":993729792}
I20260709 13:07:02.032969 19480 raft_consensus.cc:1240] T 0e1085d23e8347fbbd5bce7542f4b1f4 P 0473d2b2d01f4459b1e90fd12cc7840e [term 14 LEADER]: Rejecting Update request from peer e61c3a8f61bb48f8a963c9480e53c168 for earlier term 13. Current term is 14. Ops: []
I20260709 13:07:02.035882 19480 raft_consensus.cc:1240] T df751f992649444090e27965eb1af85d P 0473d2b2d01f4459b1e90fd12cc7840e [term 21 FOLLOWER]: Rejecting Update request from peer e61c3a8f61bb48f8a963c9480e53c168 for earlier term 20. Current term is 21. Ops: []
I20260709 13:07:02.036573 25785 leader_election.cc:290] T ed7fdbcb96d14d418db9ca90a792588a P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 16 election: Requested vote from peers e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:07:02.015998 19409 rpcz_store.cc:276] 0709 13:07:00.999232 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:01.008004 (+  8772us) service_pool.cc:224] Handling call
0709 13:07:01.008336 (+   332us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:01.307803 (+299467us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:02.015285 (+707482us) spinlock_profiling.cc:243] Waited 299 ms on lock 0x7b5400182254. stack: 00007f4a79de9343 00007f4a79de9240 00007f4a797781d4 00007f4a834b6304 00007f4a834b6299 00007f4a7ce71571 00007f4a7cf08e01 00007f4a7cf0783e 00007f4a81ecc419 00007f4a7b443bd4 00007f4a7b443b62 00007f4a7b443a91 00007f4a7b443a0c 00007f4a7b442cc2 00007f4a7b24348c 00007f4a7b2428c6
0709 13:07:02.015479 (+   194us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":686882688}
W20260709 13:07:02.043393 19293 catalog_manager.cc:5220] ChangeConfig:REMOVE_PEER RPC for tablet ab43d85f64114d4ebf618930e43d9ed0 with cas_config_opid_index 5: ChangeConfig:REMOVE_PEER failed with leader 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121) due to CAS failure; no further retry: Illegal state: Request specified cas_config_opid_index of 5 but the committed config has opid_index of 9
I20260709 13:07:02.015858 25819 raft_consensus.cc:3055] T 7f575b143b844aa096b50997dad3516a P e5256d91808b47c195bc9b4dbd7f2b87 [term 14 LEADER]: Stepping down as leader of term 14
W20260709 13:07:02.047258 25768 log.cc:927] Time spent T 1dc5b3532fe54f74876d02beffa2c230 P e61c3a8f61bb48f8a963c9480e53c168: Append to log took a long time: real 0.875s	user 0.007s	sys 0.004s
I20260709 13:07:02.048316 25799 leader_election.cc:290] T b9f0d59553ad444883fcf5b5909f9798 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:07:02.048858 19555 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40438 (request call id 3047) took 1405 ms. Trace:
I20260709 13:07:02.049343 19555 rpcz_store.cc:276] 0709 13:07:00.643341 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:00.645635 (+  2294us) service_pool.cc:224] Handling call
0709 13:07:00.669242 (+ 23607us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:00.758063 (+ 88821us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:00.758094 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:00.758586 (+   492us) log.cc:844] Serialized 26 byte log entry
0709 13:07:00.932585 (+173999us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:07:00.932611 (+    26us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:00.932658 (+    47us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:02.046433 (+1113775us) spinlock_profiling.cc:243] Waited 26 ms on lock 0x7b4400022b4c. stack: 00007f4a79de9343 00007f4a79de9240 00007f4a797781d4 00007f4a834b6304 00007f4a834b6299 00007f4a79ca3db1 00007f4a79d41c85 00007f4a79d426a2 00007f4a7cab41db 00007f4a7caafaaf 00007f4a7caa386e 00007f4a7caa2bb6 00007f4a7caa27d8 00007f4a7caac221 00007f4a7caac1d9 00007f4a7caac169
0709 13:07:02.048511 (+  2078us) raft_consensus.cc:1685] finished
0709 13:07:02.048539 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:02.048788 (+   249us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":81442,"raft.queue_time_us":90662,"raft.run_cpu_time_us":87,"raft.run_wall_time_us":87,"spinlock_wait_cycles":59733248,"thread_start_us":173666,"threads_started":1,"wal-append.queue_time_us":413330}
I20260709 13:07:02.047168 25827 raft_consensus.cc:493] T fa8650e71aa14778b3d73721fc50d9fc P e61c3a8f61bb48f8a963c9480e53c168 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:02.052664 25827 raft_consensus.cc:515] T fa8650e71aa14778b3d73721fc50d9fc P e61c3a8f61bb48f8a963c9480e53c168 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:07:02.026983 25622 raft_consensus.cc:515] T a08760e15aac4630a629431f56024dc8 P 0473d2b2d01f4459b1e90fd12cc7840e [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:07:02.056727 25622 leader_election.cc:290] T a08760e15aac4630a629431f56024dc8 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:07:02.029628 19479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "309c3ca0ca4b4f3ba129752ea2cb293b" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:07:02.058955 20106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65d8cb8d6ec64f459d5a47cefab10acf" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:07:02.047160 25819 raft_consensus.cc:740] T 7f575b143b844aa096b50997dad3516a P e5256d91808b47c195bc9b4dbd7f2b87 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: e5256d91808b47c195bc9b4dbd7f2b87, State: Running, Role: LEADER
I20260709 13:07:02.060922 25800 leader_election.cc:290] T 1efebf73c86e432baa55533136b6e12c P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:07:02.022007 19551 rpcz_store.cc:276] 0709 13:07:00.867856 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:00.874260 (+  6404us) service_pool.cc:224] Handling call
0709 13:07:00.894606 (+ 20346us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:00.894998 (+   392us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:00.895029 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:00.895476 (+   447us) log.cc:844] Serialized 26 byte log entry
0709 13:07:01.038049 (+142573us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:07:01.038105 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:01.038197 (+    92us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:02.015434 (+977237us) spinlock_profiling.cc:243] Waited 33.9 ms on lock 0x7b4400022b4c. stack: 00007f4a79de9343 00007f4a79de9240 00007f4a797781d4 00007f4a834b6304 00007f4a834b6299 00007f4a79ca3db1 00007f4a79d41c85 00007f4a79d426a2 00007f4a7cab41db 00007f4a7caafaaf 00007f4a7caa386e 00007f4a7caa2bb6 00007f4a7caa27d8 00007f4a7caac221 00007f4a7caac1d9 00007f4a7caac169
0709 13:07:02.021163 (+  5729us) raft_consensus.cc:1685] finished
0709 13:07:02.021195 (+    32us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:02.021450 (+   255us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":121,"raft.run_cpu_time_us":81,"raft.run_wall_time_us":81,"spinlock_wait_cycles":78006144,"thread_start_us":142193,"threads_started":1,"wal-append.queue_time_us":277125}
I20260709 13:07:02.061374 25819 consensus_queue.cc:260] T 7f575b143b844aa096b50997dad3516a P e5256d91808b47c195bc9b4dbd7f2b87 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:07:02.026652 19483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef32ce6fdd0e40d382c79974f30295c6" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 22 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:07:02.062906 25804 raft_consensus.cc:3055] T 76cb037fc9064d13b59a8969d897ce8c P e5256d91808b47c195bc9b4dbd7f2b87 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:07:02.063437 19483 raft_consensus.cc:2393] T ef32ce6fdd0e40d382c79974f30295c6 P 0473d2b2d01f4459b1e90fd12cc7840e [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e61c3a8f61bb48f8a963c9480e53c168 in current term 22: Already voted for candidate 0473d2b2d01f4459b1e90fd12cc7840e in this term.
I20260709 13:07:02.063350 25804 raft_consensus.cc:740] T 76cb037fc9064d13b59a8969d897ce8c P e5256d91808b47c195bc9b4dbd7f2b87 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: e5256d91808b47c195bc9b4dbd7f2b87, State: Running, Role: LEADER
I20260709 13:07:02.064327 25804 consensus_queue.cc:260] T 76cb037fc9064d13b59a8969d897ce8c P e5256d91808b47c195bc9b4dbd7f2b87 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.9, Last appended by leader: 9, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:07:02.066042 25816 leader_election.cc:290] T 172b3dd13109415a955b71ac0e9d2234 P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
W20260709 13:07:02.065969 19374 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.4:43121, user_credentials={real_user=slave}} blocked reactor thread for 59106.3us
W20260709 13:07:01.993798 25779 log.cc:927] Time spent T ed7fdbcb96d14d418db9ca90a792588a P e61c3a8f61bb48f8a963c9480e53c168: Append to log took a long time: real 0.822s	user 0.003s	sys 0.000s
I20260709 13:07:02.070466 19559 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41504 (request call id 1004) took 1196 ms. Trace:
I20260709 13:07:02.070900 19559 rpcz_store.cc:276] 0709 13:07:00.873947 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:00.879850 (+  5903us) service_pool.cc:224] Handling call
0709 13:07:00.920395 (+ 40545us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:07:00.931469 (+ 11074us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:00.931494 (+    25us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:07:00.946357 (+ 14863us) log.cc:844] Serialized 52 byte log entry
0709 13:07:01.037674 (+ 91317us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:07:01.092394 (+ 54720us) log.cc:844] Serialized 14 byte log entry
0709 13:07:01.349656 (+257262us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:01.349714 (+    58us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:01.993211 (+643497us) spinlock_profiling.cc:243] Waited 43.2 ms on lock 0x7b4400022b4c. stack: 00007f4a79de9343 00007f4a79de9240 00007f4a797781d4 00007f4a834b6304 00007f4a834b6299 00007f4a79ca3db1 00007f4a79d41c85 00007f4a79d426a2 00007f4a7cab41db 00007f4a7caafaaf 00007f4a7caa386e 00007f4a7caa2bb6 00007f4a7caa27d8 00007f4a7caac221 00007f4a7caac1d9 00007f4a7caac169
0709 13:07:02.070172 (+ 76961us) raft_consensus.cc:1685] finished
0709 13:07:02.070275 (+   103us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:02.070405 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":280237,"prepare.queue_time_us":56565,"prepare.run_cpu_time_us":31,"prepare.run_wall_time_us":32,"raft.queue_time_us":270786,"raft.run_cpu_time_us":284,"raft.run_wall_time_us":11335,"spinlock_wait_cycles":99376000,"thread_start_us":48623,"threads_started":1,"wal-append.queue_time_us":195143}
I20260709 13:07:02.030197 25772 leader_election.cc:290] T 2e36a9d6e29c4a7c860cf267efbd4c74 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:07:02.075380 19481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0afb57ae58a24a01850491d69f0213dd" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:07:02.050349 25261 raft_consensus.cc:3060] T 179fd671030940b4b4a4e24bcc4aba0a P 0473d2b2d01f4459b1e90fd12cc7840e [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:07:02.076138 25411 raft_consensus.cc:3060] T 0e1085d23e8347fbbd5bce7542f4b1f4 P e61c3a8f61bb48f8a963c9480e53c168 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:07:02.078779 19524 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:02.078490 25086 raft_consensus.cc:515] T 21e14947d70440f19044d8f75c31e1f9 P e61c3a8f61bb48f8a963c9480e53c168 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:07:02.083763 20106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1efebf73c86e432baa55533136b6e12c" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:07:02.084887 25376 raft_consensus.cc:3060] T 46c5bfeecc314717bffe987e6844b6d0 P 0473d2b2d01f4459b1e90fd12cc7840e [term 23 FOLLOWER]: Advancing to term 24
W20260709 13:07:02.088624 25796 log.cc:927] Time spent T 22196caba61445d3bec98a0aab3c337d P 0473d2b2d01f4459b1e90fd12cc7840e: Append to log took a long time: real 0.360s	user 0.002s	sys 0.000s
I20260709 13:07:02.099113 25819 raft_consensus.cc:3060] T 7f575b143b844aa096b50997dad3516a P e5256d91808b47c195bc9b4dbd7f2b87 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:07:02.023743 19485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cdf56e38bbc453d9438d359e5a69955" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:07:02.110663 19485 raft_consensus.cc:2468] T 0cdf56e38bbc453d9438d359e5a69955 P 0473d2b2d01f4459b1e90fd12cc7840e [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 17.
I20260709 13:07:02.112135 19403 raft_consensus.cc:1240] T df751f992649444090e27965eb1af85d P e5256d91808b47c195bc9b4dbd7f2b87 [term 21 FOLLOWER]: Rejecting Update request from peer e61c3a8f61bb48f8a963c9480e53c168 for earlier term 20. Current term is 21. Ops: []
I20260709 13:07:02.113137 19477 raft_consensus.cc:2468] T 1a61655d99124a29b486ba4a5b37faea P 0473d2b2d01f4459b1e90fd12cc7840e [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 17.
I20260709 13:07:02.113799 19405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65d8cb8d6ec64f459d5a47cefab10acf" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:07:02.115453 19406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9f0d59553ad444883fcf5b5909f9798" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
W20260709 13:07:02.117518 19377 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.2:46257, user_credentials={real_user=slave}} blocked reactor thread for 211801us
I20260709 13:07:02.118489 19377 leader_election.cc:304] T 775c229504194560ba9589bc2199b089 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87; no voters: 127766fc592545a4997f7790f50f6076
I20260709 13:07:02.135444 19557 raft_consensus.cc:1275] T 217b5fae677b4971b3bbd2f357a1f7ff P e61c3a8f61bb48f8a963c9480e53c168 [term 15 FOLLOWER]: Refusing update from remote peer e5256d91808b47c195bc9b4dbd7f2b87: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 13:07:02.133563 19523 leader_election.cc:304] T 70797e5783b5454ab0d0eea663e791e3 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e61c3a8f61bb48f8a963c9480e53c168; no voters: 127766fc592545a4997f7790f50f6076, e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:07:02.149581 19556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc225c93219c45538b53a1bd3d387e4d" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:07:02.148011 19523 leader_election.cc:304] T 1a61655d99124a29b486ba4a5b37faea P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:07:02.150334 19556 raft_consensus.cc:2468] T bc225c93219c45538b53a1bd3d387e4d P e61c3a8f61bb48f8a963c9480e53c168 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 15.
I20260709 13:07:02.154644 19555 raft_consensus.cc:1275] T fa8650e71aa14778b3d73721fc50d9fc P e61c3a8f61bb48f8a963c9480e53c168 [term 18 FOLLOWER]: Refusing update from remote peer e5256d91808b47c195bc9b4dbd7f2b87: Log matching property violated. Preceding OpId in replica: term: 17 index: 9. Preceding OpId from leader: term: 18 index: 10. (index mismatch)
I20260709 13:07:02.156778 19559 raft_consensus.cc:1275] T 65d8cb8d6ec64f459d5a47cefab10acf P e61c3a8f61bb48f8a963c9480e53c168 [term 19 FOLLOWER]: Refusing update from remote peer e5256d91808b47c195bc9b4dbd7f2b87: Log matching property violated. Preceding OpId in replica: term: 18 index: 11. Preceding OpId from leader: term: 19 index: 12. (index mismatch)
I20260709 13:07:02.161753 19402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e36a9d6e29c4a7c860cf267efbd4c74" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:07:02.162495 19375 leader_election.cc:304] T bc225c93219c45538b53a1bd3d387e4d P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:07:02.168853 19408 raft_consensus.cc:1240] T 86a6797bdfe94fa496c050ceae4bd0d9 P e5256d91808b47c195bc9b4dbd7f2b87 [term 15 FOLLOWER]: Rejecting Update request from peer e61c3a8f61bb48f8a963c9480e53c168 for earlier term 14. Current term is 15. Ops: []
I20260709 13:07:02.149000 25804 raft_consensus.cc:3060] T 76cb037fc9064d13b59a8969d897ce8c P e5256d91808b47c195bc9b4dbd7f2b87 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:07:02.163028 25772 raft_consensus.cc:2804] T 1a61655d99124a29b486ba4a5b37faea P e61c3a8f61bb48f8a963c9480e53c168 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:07:02.163324 25056 raft_consensus.cc:2804] T 775c229504194560ba9589bc2199b089 P e5256d91808b47c195bc9b4dbd7f2b87 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:07:02.168282 25093 raft_consensus.cc:493] T 4af19371ea874c09a0a2147040835cbb P e5256d91808b47c195bc9b4dbd7f2b87 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:02.199466 19523 leader_election.cc:304] T 65d8cb8d6ec64f459d5a47cefab10acf P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e61c3a8f61bb48f8a963c9480e53c168; no voters: 127766fc592545a4997f7790f50f6076, e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:07:02.152623 25712 raft_consensus.cc:515] T ab43d85f64114d4ebf618930e43d9ed0 P e61c3a8f61bb48f8a963c9480e53c168 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
W20260709 13:07:02.208000 19377 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.2:46257, user_credentials={real_user=slave}} blocked reactor thread for 89613.1us
I20260709 13:07:02.208922 19377 leader_election.cc:304] T b9f0d59553ad444883fcf5b5909f9798 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:07:02.200676 25591 raft_consensus.cc:2804] T bc225c93219c45538b53a1bd3d387e4d P e5256d91808b47c195bc9b4dbd7f2b87 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:07:02.202201 25056 raft_consensus.cc:493] T 775c229504194560ba9589bc2199b089 P e5256d91808b47c195bc9b4dbd7f2b87 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 127766fc592545a4997f7790f50f6076)
I20260709 13:07:02.172636 25587 consensus_queue.cc:1048] T 217b5fae677b4971b3bbd2f357a1f7ff P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.040s
I20260709 13:07:02.220775 19377 leader_election.cc:304] T 28af091831594f9d8e96482078cc7625 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168
W20260709 13:07:02.215709 19450 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.3:36891, user_credentials={real_user=slave}} blocked reactor thread for 320199us
W20260709 13:07:02.220023 20078 leader_election.cc:336] T ff9b0eddd810459b82d91c60777c10eb P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257): Timed out: RequestConsensusVote RPC to 127.17.223.2:46257 timed out after 1.650s (SENT)
W20260709 13:07:02.222945 19449 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.1:40321, user_credentials={real_user=slave}} blocked reactor thread for 324359us
I20260709 13:07:02.223323 19450 leader_election.cc:304] T ef32ce6fdd0e40d382c79974f30295c6 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e; no voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:07:02.224140 19408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa8650e71aa14778b3d73721fc50d9fc" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:07:02.207192 25772 raft_consensus.cc:697] T 1a61655d99124a29b486ba4a5b37faea P e61c3a8f61bb48f8a963c9480e53c168 [term 17 LEADER]: Becoming Leader. State: Replica: e61c3a8f61bb48f8a963c9480e53c168, State: Running, Role: LEADER
I20260709 13:07:02.211997 25661 raft_consensus.cc:2749] T 65d8cb8d6ec64f459d5a47cefab10acf P e61c3a8f61bb48f8a963c9480e53c168 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
W20260709 13:07:02.227262 19407 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.516s	user 0.008s	sys 0.011s
I20260709 13:07:02.227885 19559 raft_consensus.cc:1240] T ab43d85f64114d4ebf618930e43d9ed0 P e61c3a8f61bb48f8a963c9480e53c168 [term 20 FOLLOWER]: Rejecting Update request from peer 127766fc592545a4997f7790f50f6076 for earlier term 19. Current term is 20. Ops: []
I20260709 13:07:02.226439 19560 raft_consensus.cc:1275] T 48824d5acfbc485ebf8c2d944e7202de P e61c3a8f61bb48f8a963c9480e53c168 [term 21 FOLLOWER]: Refusing update from remote peer 127766fc592545a4997f7790f50f6076: Log matching property violated. Preceding OpId in replica: term: 18 index: 13. Preceding OpId from leader: term: 21 index: 15. (index mismatch)
I20260709 13:07:02.212900 25591 raft_consensus.cc:493] T bc225c93219c45538b53a1bd3d387e4d P e5256d91808b47c195bc9b4dbd7f2b87 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:02.205193 25678 consensus_queue.cc:1059] T df751f992649444090e27965eb1af85d P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 }, Status: INVALID_TERM, Last received: 20.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.016s
I20260709 13:07:02.205922 25093 raft_consensus.cc:515] T 4af19371ea874c09a0a2147040835cbb P e5256d91808b47c195bc9b4dbd7f2b87 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
W20260709 13:07:02.230010 19407 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.519s	user 0.008s	sys 0.011s
W20260709 13:07:02.224934 20075 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.1:40321, user_credentials={real_user=slave}} blocked reactor thread for 388156us
I20260709 13:07:02.221506 25056 raft_consensus.cc:3060] T 775c229504194560ba9589bc2199b089 P e5256d91808b47c195bc9b4dbd7f2b87 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:07:02.237892 19450 leader_election.cc:304] T 2b74109013a140ada21feeef92d6f563 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e; no voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:07:02.223762 25685 raft_consensus.cc:2749] T b9f0d59553ad444883fcf5b5909f9798 P e5256d91808b47c195bc9b4dbd7f2b87 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:07:02.224223 25808 raft_consensus.cc:493] T edd7d470b5014c9489be7f41f64355c9 P 0473d2b2d01f4459b1e90fd12cc7840e [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:02.215862 25755 consensus_queue.cc:1059] T 86a6797bdfe94fa496c050ceae4bd0d9 P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 }, Status: INVALID_TERM, Last received: 14.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.019s
I20260709 13:07:02.229003 25720 raft_consensus.cc:493] T f93ee515a9c14139bf566522ed8232f3 P 0473d2b2d01f4459b1e90fd12cc7840e [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:02.229139 25418 raft_consensus.cc:2749] T ef32ce6fdd0e40d382c79974f30295c6 P 0473d2b2d01f4459b1e90fd12cc7840e [term 22 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
I20260709 13:07:02.244915 19526 leader_election.cc:304] T 76cb037fc9064d13b59a8969d897ce8c P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e61c3a8f61bb48f8a963c9480e53c168; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:07:02.250862 19406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a08760e15aac4630a629431f56024dc8" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:07:02.233187 25591 raft_consensus.cc:3060] T bc225c93219c45538b53a1bd3d387e4d P e5256d91808b47c195bc9b4dbd7f2b87 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:07:02.246152 20075 leader_election.cc:304] T 70797e5783b5454ab0d0eea663e791e3 P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 127766fc592545a4997f7790f50f6076, e5256d91808b47c195bc9b4dbd7f2b87; no voters: e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:07:02.249428 19377 leader_election.cc:304] T f93ee515a9c14139bf566522ed8232f3 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:07:02.251545 20103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed7fdbcb96d14d418db9ca90a792588a" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076"
I20260709 13:07:02.234628 25803 raft_consensus.cc:493] T 4509b76741dc428e9201c70c1658da13 P e5256d91808b47c195bc9b4dbd7f2b87 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader e61c3a8f61bb48f8a963c9480e53c168)
I20260709 13:07:02.256382 19480 raft_consensus.cc:1240] T 86a6797bdfe94fa496c050ceae4bd0d9 P 0473d2b2d01f4459b1e90fd12cc7840e [term 15 LEADER]: Rejecting Update request from peer e61c3a8f61bb48f8a963c9480e53c168 for earlier term 14. Current term is 15. Ops: []
I20260709 13:07:02.258373 19377 leader_election.cc:304] T df751f992649444090e27965eb1af85d P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:07:02.238749 25598 raft_consensus.cc:2749] T 28af091831594f9d8e96482078cc7625 P e5256d91808b47c195bc9b4dbd7f2b87 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:07:02.257644 19478 raft_consensus.cc:2468] T 46c5bfeecc314717bffe987e6844b6d0 P 0473d2b2d01f4459b1e90fd12cc7840e [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 24.
I20260709 13:07:02.259954 19477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "217b5fae677b4971b3bbd2f357a1f7ff" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:07:02.241925 25814 consensus_queue.cc:1048] T fa8650e71aa14778b3d73721fc50d9fc P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.020s
I20260709 13:07:02.263121 25599 leader_election.cc:290] T 1dc5b3532fe54f74876d02beffa2c230 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 20 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:07:02.263626 25685 raft_consensus.cc:2749] T f93ee515a9c14139bf566522ed8232f3 P e5256d91808b47c195bc9b4dbd7f2b87 [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 13:07:02.264122 25093 leader_election.cc:290] T 4af19371ea874c09a0a2147040835cbb P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:07:02.249428 25786 consensus_queue.cc:1059] T 217b5fae677b4971b3bbd2f357a1f7ff P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.015s
I20260709 13:07:02.265897 20109 raft_consensus.cc:1275] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P 127766fc592545a4997f7790f50f6076 [term 20 FOLLOWER]: Refusing update from remote peer 0473d2b2d01f4459b1e90fd12cc7840e: Log matching property violated. Preceding OpId in replica: term: 18 index: 15. Preceding OpId from leader: term: 20 index: 16. (index mismatch)
I20260709 13:07:02.281461 19555 raft_consensus.cc:1275] T bc225c93219c45538b53a1bd3d387e4d P e61c3a8f61bb48f8a963c9480e53c168 [term 15 FOLLOWER]: Refusing update from remote peer 0473d2b2d01f4459b1e90fd12cc7840e: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 13:07:02.285638 19553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96efeaaf1057492490e9a621f37e1a2d" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:07:02.288456 19552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4509b76741dc428e9201c70c1658da13" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:07:02.314110 19552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a08760e15aac4630a629431f56024dc8" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:07:02.314888 19552 raft_consensus.cc:2468] T a08760e15aac4630a629431f56024dc8 P e61c3a8f61bb48f8a963c9480e53c168 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 21.
I20260709 13:07:02.318153 19559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22196caba61445d3bec98a0aab3c337d" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:07:02.254098 25827 leader_election.cc:290] T fa8650e71aa14778b3d73721fc50d9fc P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:07:02.244782 25825 raft_consensus.cc:2749] T 70797e5783b5454ab0d0eea663e791e3 P e61c3a8f61bb48f8a963c9480e53c168 [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 13:07:02.300760 19554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed7fdbcb96d14d418db9ca90a792588a" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:07:02.311946 19526 leader_election.cc:304] T ef32ce6fdd0e40d382c79974f30295c6 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e61c3a8f61bb48f8a963c9480e53c168; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:07:02.318910 19559 raft_consensus.cc:3060] T 22196caba61445d3bec98a0aab3c337d P e61c3a8f61bb48f8a963c9480e53c168 [term 16 FOLLOWER]: Advancing to term 18
I20260709 13:07:02.298116 19556 raft_consensus.cc:1240] T 48824d5acfbc485ebf8c2d944e7202de P e61c3a8f61bb48f8a963c9480e53c168 [term 21 FOLLOWER]: Rejecting Update request from peer 0473d2b2d01f4459b1e90fd12cc7840e for earlier term 20. Current term is 21. Ops: [20.14-20.14]
I20260709 13:07:02.296717 20078 leader_election.cc:304] T 0e1085d23e8347fbbd5bce7542f4b1f4 P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 127766fc592545a4997f7790f50f6076; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:07:02.326853 19477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edd7d470b5014c9489be7f41f64355c9" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:07:02.327505 20110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4af19371ea874c09a0a2147040835cbb" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:07:02.255340 25445 raft_consensus.cc:493] T b08304a0a02b42d7840c4e8ee9a6bd1a P e61c3a8f61bb48f8a963c9480e53c168 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:02.354768 20075 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.1:40321, user_credentials={real_user=slave}} blocked reactor thread for 108997us
I20260709 13:07:02.362697 20110 raft_consensus.cc:2468] T 4af19371ea874c09a0a2147040835cbb P 127766fc592545a4997f7790f50f6076 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 9.
I20260709 13:07:02.318338 25799 consensus_queue.cc:1059] T df751f992649444090e27965eb1af85d P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 }, Status: INVALID_TERM, Last received: 20.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.021s
I20260709 13:07:02.243826 25713 consensus_queue.cc:1048] T 65d8cb8d6ec64f459d5a47cefab10acf P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.057s
I20260709 13:07:02.302165 25812 raft_consensus.cc:2749] T df751f992649444090e27965eb1af85d P e5256d91808b47c195bc9b4dbd7f2b87 [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 13:07:02.317983 25587 consensus_queue.cc:1059] T ef32ce6fdd0e40d382c79974f30295c6 P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 }, Status: INVALID_TERM, Last received: 20.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.009s
I20260709 13:07:02.335244 25831 consensus_queue.cc:1059] T ab43d85f64114d4ebf618930e43d9ed0 P 127766fc592545a4997f7790f50f6076 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 }, Status: INVALID_TERM, Last received: 19.13, Next index: 14, Last known committed idx: 12, Time since last communication: 0.017s
I20260709 13:07:02.256778 25764 raft_consensus.cc:2749] T 2b74109013a140ada21feeef92d6f563 P 0473d2b2d01f4459b1e90fd12cc7840e [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
W20260709 13:07:02.367431 19526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.2:46257, user_credentials={real_user=slave}} blocked reactor thread for 55574.8us
I20260709 13:07:02.387802 19526 leader_election.cc:304] T 0afb57ae58a24a01850491d69f0213dd P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e61c3a8f61bb48f8a963c9480e53c168; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, 127766fc592545a4997f7790f50f6076
I20260709 13:07:02.368175 20107 raft_consensus.cc:1275] T 0e1085d23e8347fbbd5bce7542f4b1f4 P 127766fc592545a4997f7790f50f6076 [term 14 FOLLOWER]: Refusing update from remote peer 0473d2b2d01f4459b1e90fd12cc7840e: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 13:07:02.387969 19558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4af19371ea874c09a0a2147040835cbb" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:07:02.388865 19558 raft_consensus.cc:2468] T 4af19371ea874c09a0a2147040835cbb P e61c3a8f61bb48f8a963c9480e53c168 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 8.
I20260709 13:07:02.253249 25720 raft_consensus.cc:515] T f93ee515a9c14139bf566522ed8232f3 P 0473d2b2d01f4459b1e90fd12cc7840e [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:07:02.245821 25808 raft_consensus.cc:515] T edd7d470b5014c9489be7f41f64355c9 P 0473d2b2d01f4459b1e90fd12cc7840e [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:07:02.301975 25553 raft_consensus.cc:3060] T 76cb037fc9064d13b59a8969d897ce8c P e61c3a8f61bb48f8a963c9480e53c168 [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:07:02.401494 20078 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.2:46257, user_credentials={real_user=slave}} blocked reactor thread for 104854us
I20260709 13:07:02.405413 20078 leader_election.cc:304] T 6c5eebf646ad445a9d1b1adc319d7b16 P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 127766fc592545a4997f7790f50f6076; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:07:02.371943 19403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "309c3ca0ca4b4f3ba129752ea2cb293b" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:07:02.390348 19558 raft_consensus.cc:1240] T 1dc5b3532fe54f74876d02beffa2c230 P e61c3a8f61bb48f8a963c9480e53c168 [term 20 FOLLOWER]: Rejecting Update request from peer e5256d91808b47c195bc9b4dbd7f2b87 for earlier term 19. Current term is 20. Ops: []
I20260709 13:07:02.391983 19526 leader_election.cc:304] T d1e5873a19244c5ebbcd38e126796ee7 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168; no voters: e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:07:02.407018 19526 leader_election.cc:304] T 0cdf56e38bbc453d9438d359e5a69955 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168; no voters: e5256d91808b47c195bc9b4dbd7f2b87
W20260709 13:07:02.392926 19449 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.4:43121, user_credentials={real_user=slave}} blocked reactor thread for 81290.1us
W20260709 13:07:02.396987 20075 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:02.393621 19409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f85fc4b527a48848e5faa083b604e36" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
I20260709 13:07:02.407891 19409 raft_consensus.cc:3060] T 1f85fc4b527a48848e5faa083b604e36 P e5256d91808b47c195bc9b4dbd7f2b87 [term 16 FOLLOWER]: Advancing to term 18
W20260709 13:07:02.340540 19450 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:02.407786 19449 leader_election.cc:304] T 96efeaaf1057492490e9a621f37e1a2d P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, 127766fc592545a4997f7790f50f6076; no voters: 
I20260709 13:07:02.378539 25815 raft_consensus.cc:2804] T 70797e5783b5454ab0d0eea663e791e3 P 127766fc592545a4997f7790f50f6076 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:07:02.429687 19402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "172b3dd13109415a955b71ac0e9d2234" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:07:02.423039 19375 leader_election.cc:304] T 4af19371ea874c09a0a2147040835cbb P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:07:02.424295 19406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21e14947d70440f19044d8f75c31e1f9" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
I20260709 13:07:02.425117 19486 raft_consensus.cc:1240] T 172b3dd13109415a955b71ac0e9d2234 P 0473d2b2d01f4459b1e90fd12cc7840e [term 17 LEADER]: Rejecting Update request from peer 127766fc592545a4997f7790f50f6076 for earlier term 16. Current term is 17. Ops: []
I20260709 13:07:02.434770 19477 raft_consensus.cc:3060] T edd7d470b5014c9489be7f41f64355c9 P 0473d2b2d01f4459b1e90fd12cc7840e [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:07:02.435535 19405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dc5b3532fe54f74876d02beffa2c230" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
W20260709 13:07:02.436599 19377 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.2:46257, user_credentials={real_user=slave}} blocked reactor thread for 166258us
I20260709 13:07:02.438330 19484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0afb57ae58a24a01850491d69f0213dd" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:07:02.439002 19480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f85fc4b527a48848e5faa083b604e36" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:07:02.439556 19480 raft_consensus.cc:2468] T 1f85fc4b527a48848e5faa083b604e36 P 0473d2b2d01f4459b1e90fd12cc7840e [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 127766fc592545a4997f7790f50f6076 in term 17.
I20260709 13:07:02.441952 19480 raft_consensus.cc:1275] T 48824d5acfbc485ebf8c2d944e7202de P 0473d2b2d01f4459b1e90fd12cc7840e [term 21 FOLLOWER]: Refusing update from remote peer 127766fc592545a4997f7790f50f6076: Log matching property violated. Preceding OpId in replica: term: 20 index: 14. Preceding OpId from leader: term: 21 index: 15. (index mismatch)
I20260709 13:07:02.440341 19483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96efeaaf1057492490e9a621f37e1a2d" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:07:02.294049 25803 raft_consensus.cc:515] T 4509b76741dc428e9201c70c1658da13 P e5256d91808b47c195bc9b4dbd7f2b87 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:07:02.397640 25735 raft_consensus.cc:2749] T 0e1085d23e8347fbbd5bce7542f4b1f4 P 127766fc592545a4997f7790f50f6076 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:07:02.447822 19484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "172b3dd13109415a955b71ac0e9d2234" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:07:02.450130 25715 raft_consensus.cc:2804] T 0cdf56e38bbc453d9438d359e5a69955 P e61c3a8f61bb48f8a963c9480e53c168 [term 17 FOLLOWER]: Leader pre-election won for term 18
W20260709 13:07:02.451300 19449 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.4:43121, user_credentials={real_user=slave}} blocked reactor thread for 43588.9us
I20260709 13:07:02.451718 19482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7be9efa6559648dbb5a0f7684c4542d1" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:07:02.462925 19482 raft_consensus.cc:3060] T 7be9efa6559648dbb5a0f7684c4542d1 P 0473d2b2d01f4459b1e90fd12cc7840e [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:07:02.452788 19480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "309c3ca0ca4b4f3ba129752ea2cb293b" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:07:02.460877 19481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48824d5acfbc485ebf8c2d944e7202de" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 21 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:07:02.319824 25772 consensus_queue.cc:237] T 1a61655d99124a29b486ba4a5b37faea P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.10, Last appended by leader: 10, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:07:02.413920 25712 leader_election.cc:290] T ab43d85f64114d4ebf618930e43d9ed0 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 20 election: Requested vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:07:02.464207 19481 raft_consensus.cc:2410] T 48824d5acfbc485ebf8c2d944e7202de P 0473d2b2d01f4459b1e90fd12cc7840e [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 127766fc592545a4997f7790f50f6076 for term 21 because replica has last-logged OpId of term: 20 index: 14, which is greater than that of the candidate, which has last-logged OpId of term: 18 index: 13.
I20260709 13:07:02.425380 25747 raft_consensus.cc:2804] T d1e5873a19244c5ebbcd38e126796ee7 P e61c3a8f61bb48f8a963c9480e53c168 [term 21 FOLLOWER]: Leader election won for term 21
W20260709 13:07:02.464248 20076 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.3:36891, user_credentials={real_user=slave}} blocked reactor thread for 44360.4us
I20260709 13:07:02.389643 25445 raft_consensus.cc:515] T b08304a0a02b42d7840c4e8ee9a6bd1a P e61c3a8f61bb48f8a963c9480e53c168 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:07:02.460551 19409 raft_consensus.cc:2468] T 1f85fc4b527a48848e5faa083b604e36 P e5256d91808b47c195bc9b4dbd7f2b87 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 127766fc592545a4997f7790f50f6076 in term 18.
I20260709 13:07:02.455248 25815 raft_consensus.cc:697] T 70797e5783b5454ab0d0eea663e791e3 P 127766fc592545a4997f7790f50f6076 [term 21 LEADER]: Becoming Leader. State: Replica: 127766fc592545a4997f7790f50f6076, State: Running, Role: LEADER
I20260709 13:07:02.504908 19557 raft_consensus.cc:1275] T b08304a0a02b42d7840c4e8ee9a6bd1a P e61c3a8f61bb48f8a963c9480e53c168 [term 19 FOLLOWER]: Refusing update from remote peer 0473d2b2d01f4459b1e90fd12cc7840e: Log matching property violated. Preceding OpId in replica: term: 18 index: 11. Preceding OpId from leader: term: 19 index: 11. (term mismatch)
I20260709 13:07:02.462553 25715 raft_consensus.cc:493] T 0cdf56e38bbc453d9438d359e5a69955 P e61c3a8f61bb48f8a963c9480e53c168 [term 17 FOLLOWER]: Starting leader election (detected failure of leader e5256d91808b47c195bc9b4dbd7f2b87)
I20260709 13:07:02.437290 25690 raft_consensus.cc:493] T d1e5873a19244c5ebbcd38e126796ee7 P e5256d91808b47c195bc9b4dbd7f2b87 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:02.438310 25812 raft_consensus.cc:2804] T 4af19371ea874c09a0a2147040835cbb P e5256d91808b47c195bc9b4dbd7f2b87 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:07:02.413841 25597 consensus_queue.cc:1048] T 172b3dd13109415a955b71ac0e9d2234 P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Connected to new peer: Peer: permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.047s
I20260709 13:07:02.464100 19479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f85fc4b527a48848e5faa083b604e36" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:07:02.420445 25682 consensus_queue.cc:1048] T 48824d5acfbc485ebf8c2d944e7202de P 127766fc592545a4997f7790f50f6076 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 13, Time since last communication: 0.044s
I20260709 13:07:02.461593 25786 raft_consensus.cc:2804] T 96efeaaf1057492490e9a621f37e1a2d P 0473d2b2d01f4459b1e90fd12cc7840e [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:07:02.425220 25830 consensus_queue.cc:1059] T 217b5fae677b4971b3bbd2f357a1f7ff P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 }, Status: INVALID_TERM, Last received: 12.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.068s
I20260709 13:07:02.479074 19377 leader_election.cc:304] T ff9b0eddd810459b82d91c60777c10eb P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, 127766fc592545a4997f7790f50f6076
I20260709 13:07:02.456321 25537 raft_consensus.cc:493] T ff9b0eddd810459b82d91c60777c10eb P 0473d2b2d01f4459b1e90fd12cc7840e [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:02.454293 25831 raft_consensus.cc:2749] T 6c5eebf646ad445a9d1b1adc319d7b16 P 127766fc592545a4997f7790f50f6076 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:07:02.455382 25760 raft_consensus.cc:493] T 5ec1c4ce15e04c7e8c283a62179f2a64 P 0473d2b2d01f4459b1e90fd12cc7840e [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 127766fc592545a4997f7790f50f6076)
I20260709 13:07:02.492228 19480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e36a9d6e29c4a7c860cf267efbd4c74" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:07:02.469424 19477 raft_consensus.cc:2468] T edd7d470b5014c9489be7f41f64355c9 P 0473d2b2d01f4459b1e90fd12cc7840e [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 22.
I20260709 13:07:02.496098 25824 raft_consensus.cc:2749] T 0afb57ae58a24a01850491d69f0213dd P e61c3a8f61bb48f8a963c9480e53c168 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:07:02.497684 19481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dc5b3532fe54f74876d02beffa2c230" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:07:02.564052 19481 raft_consensus.cc:3060] T 1dc5b3532fe54f74876d02beffa2c230 P 0473d2b2d01f4459b1e90fd12cc7840e [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:07:02.502242 25445 leader_election.cc:290] T b08304a0a02b42d7840c4e8ee9a6bd1a P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:07:02.502803 25832 raft_consensus.cc:493] T ff75a1d4cb1f493db8f71ddc136ba9ab P 0473d2b2d01f4459b1e90fd12cc7840e [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:02.571143 25832 raft_consensus.cc:515] T ff75a1d4cb1f493db8f71ddc136ba9ab P 0473d2b2d01f4459b1e90fd12cc7840e [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:07:02.571995 25808 leader_election.cc:290] T edd7d470b5014c9489be7f41f64355c9 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:07:02.533555 25690 raft_consensus.cc:515] T d1e5873a19244c5ebbcd38e126796ee7 P e5256d91808b47c195bc9b4dbd7f2b87 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:07:02.506260 19557 pending_rounds.cc:85] T b08304a0a02b42d7840c4e8ee9a6bd1a P e61c3a8f61bb48f8a963c9480e53c168: Aborting all ops after (but not including) 10
I20260709 13:07:02.573705 19557 pending_rounds.cc:107] T b08304a0a02b42d7840c4e8ee9a6bd1a P e61c3a8f61bb48f8a963c9480e53c168: Aborting uncommitted NO_OP operation due to leader change: 18.11
I20260709 13:07:02.573958 19557 raft_consensus.cc:2889] T b08304a0a02b42d7840c4e8ee9a6bd1a P e61c3a8f61bb48f8a963c9480e53c168 [term 19 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:07:02.507819 19482 raft_consensus.cc:2468] T 7be9efa6559648dbb5a0f7684c4542d1 P 0473d2b2d01f4459b1e90fd12cc7840e [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 127766fc592545a4997f7790f50f6076 in term 19.
I20260709 13:07:02.509042 19450 leader_election.cc:304] T 4509b76741dc428e9201c70c1658da13 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e; no voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:07:02.575088 25690 leader_election.cc:290] T d1e5873a19244c5ebbcd38e126796ee7 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:07:02.575229 25720 leader_election.cc:290] T f93ee515a9c14139bf566522ed8232f3 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:07:02.493396 20075 leader_election.cc:304] T 1f85fc4b527a48848e5faa083b604e36 P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 127766fc592545a4997f7790f50f6076, e5256d91808b47c195bc9b4dbd7f2b87; no voters: 
I20260709 13:07:02.575722 25811 raft_consensus.cc:493] T fa731b585f684a7fb2d106c50f143b83 P e61c3a8f61bb48f8a963c9480e53c168 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 127766fc592545a4997f7790f50f6076)
I20260709 13:07:02.575843 25720 raft_consensus.cc:2749] T 4509b76741dc428e9201c70c1658da13 P 0473d2b2d01f4459b1e90fd12cc7840e [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:07:02.576174 20075 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.1:40321, user_credentials={real_user=slave}} blocked reactor thread for 82857.5us
I20260709 13:07:02.576330 25811 raft_consensus.cc:515] T fa731b585f684a7fb2d106c50f143b83 P e61c3a8f61bb48f8a963c9480e53c168 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:07:02.577376 25833 raft_consensus.cc:2804] T 1f85fc4b527a48848e5faa083b604e36 P 127766fc592545a4997f7790f50f6076 [term 18 FOLLOWER]: Leader election won for term 18
W20260709 13:07:02.578014 25835 log.cc:927] Time spent T 4509b76741dc428e9201c70c1658da13 P e5256d91808b47c195bc9b4dbd7f2b87: Append to log took a long time: real 0.188s	user 0.000s	sys 0.000s
I20260709 13:07:02.575259 19482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab43d85f64114d4ebf618930e43d9ed0" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:07:02.553468 25376 raft_consensus.cc:493] T 14efcc79969f41babe5529c22d59156d P 0473d2b2d01f4459b1e90fd12cc7840e [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 127766fc592545a4997f7790f50f6076)
I20260709 13:07:02.577984 25833 raft_consensus.cc:697] T 1f85fc4b527a48848e5faa083b604e36 P 127766fc592545a4997f7790f50f6076 [term 18 LEADER]: Becoming Leader. State: Replica: 127766fc592545a4997f7790f50f6076, State: Running, Role: LEADER
I20260709 13:07:02.579061 25376 raft_consensus.cc:515] T 14efcc79969f41babe5529c22d59156d P 0473d2b2d01f4459b1e90fd12cc7840e [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:07:02.579687 25833 consensus_queue.cc:237] T 1f85fc4b527a48848e5faa083b604e36 P 127766fc592545a4997f7790f50f6076 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.13, Last appended by leader: 13, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:07:02.581233 25376 leader_election.cc:290] T 14efcc79969f41babe5529c22d59156d P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:07:02.583659 19482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa8650e71aa14778b3d73721fc50d9fc" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
W20260709 13:07:02.584148 25844 log.cc:927] Time spent T b08304a0a02b42d7840c4e8ee9a6bd1a P e5256d91808b47c195bc9b4dbd7f2b87: Append to log took a long time: real 0.068s	user 0.001s	sys 0.000s
I20260709 13:07:02.584199 25396 raft_consensus.cc:2749] T 46c5bfeecc314717bffe987e6844b6d0 P e5256d91808b47c195bc9b4dbd7f2b87 [term 24 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:07:02.586140 25661 raft_consensus.cc:3055] T df751f992649444090e27965eb1af85d P e61c3a8f61bb48f8a963c9480e53c168 [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:07:02.586584 25661 raft_consensus.cc:740] T df751f992649444090e27965eb1af85d P e61c3a8f61bb48f8a963c9480e53c168 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: e61c3a8f61bb48f8a963c9480e53c168, State: Running, Role: LEADER
I20260709 13:07:02.587404 25661 consensus_queue.cc:260] T df751f992649444090e27965eb1af85d P e61c3a8f61bb48f8a963c9480e53c168 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 20.13, Last appended by leader: 13, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:07:02.589180 19481 raft_consensus.cc:2468] T 1dc5b3532fe54f74876d02beffa2c230 P 0473d2b2d01f4459b1e90fd12cc7840e [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 20.
I20260709 13:07:02.458606 25814 consensus_queue.cc:1059] T 1dc5b3532fe54f74876d02beffa2c230 P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 }, Status: INVALID_TERM, Last received: 19.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.035s
I20260709 13:07:02.534469 19479 raft_consensus.cc:3060] T 1f85fc4b527a48848e5faa083b604e36 P 0473d2b2d01f4459b1e90fd12cc7840e [term 17 FOLLOWER]: Advancing to term 18
W20260709 13:07:02.496143 25836 log.cc:927] Time spent T 86a6797bdfe94fa496c050ceae4bd0d9 P 0473d2b2d01f4459b1e90fd12cc7840e: Append to log took a long time: real 0.118s	user 0.000s	sys 0.000s
I20260709 13:07:02.538743 19559 raft_consensus.cc:2468] T 22196caba61445d3bec98a0aab3c337d P e61c3a8f61bb48f8a963c9480e53c168 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 18.
I20260709 13:07:02.520627 25715 raft_consensus.cc:3060] T 0cdf56e38bbc453d9438d359e5a69955 P e61c3a8f61bb48f8a963c9480e53c168 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:07:02.529474 25812 raft_consensus.cc:493] T 4af19371ea874c09a0a2147040835cbb P e5256d91808b47c195bc9b4dbd7f2b87 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:02.488227 25261 consensus_queue.cc:1048] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Connected to new peer: Peer: permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.065s
I20260709 13:07:02.491945 25708 consensus_queue.cc:1048] T 0e1085d23e8347fbbd5bce7542f4b1f4 P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Connected to new peer: Peer: permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.061s
I20260709 13:07:02.567225 25766 consensus_queue.cc:1059] T 86a6797bdfe94fa496c050ceae4bd0d9 P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 }, Status: INVALID_TERM, Last received: 14.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.055s
I20260709 13:07:02.567598 25815 consensus_queue.cc:237] T 70797e5783b5454ab0d0eea663e791e3 P 127766fc592545a4997f7790f50f6076 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 20.14, Last appended by leader: 14, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
W20260709 13:07:02.569175 25838 log.cc:927] Time spent T 40e1e16737a842ee936002830f36882e P 0473d2b2d01f4459b1e90fd12cc7840e: Append to log took a long time: real 0.191s	user 0.000s	sys 0.001s
I20260709 13:07:02.557528 25830 consensus_queue.cc:1243] T 217b5fae677b4971b3bbd2f357a1f7ff P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Peer e5256d91808b47c195bc9b4dbd7f2b87 log is divergent from this leader: its last log entry 15.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 8
I20260709 13:07:02.573163 25832 leader_election.cc:290] T ff75a1d4cb1f493db8f71ddc136ba9ab P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
W20260709 13:07:02.575847 19450 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.3:36891, user_credentials={real_user=slave}} blocked reactor thread for 66939.6us
I20260709 13:07:02.584331 19482 raft_consensus.cc:2468] T fa8650e71aa14778b3d73721fc50d9fc P 0473d2b2d01f4459b1e90fd12cc7840e [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 18.
I20260709 13:07:02.589833 19480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b08304a0a02b42d7840c4e8ee9a6bd1a" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:07:02.615860 19450 leader_election.cc:304] T a08760e15aac4630a629431f56024dc8 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168; no voters: e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:07:02.617063 19480 raft_consensus.cc:1275] T 4509b76741dc428e9201c70c1658da13 P 0473d2b2d01f4459b1e90fd12cc7840e [term 12 FOLLOWER]: Refusing update from remote peer e61c3a8f61bb48f8a963c9480e53c168: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:07:02.470947 19485 raft_consensus.cc:1240] T ed7fdbcb96d14d418db9ca90a792588a P 0473d2b2d01f4459b1e90fd12cc7840e [term 16 FOLLOWER]: Rejecting Update request from peer 127766fc592545a4997f7790f50f6076 for earlier term 15. Current term is 16. Ops: [15.12-15.12]
I20260709 13:07:02.477396 25827 raft_consensus.cc:3060] T ef32ce6fdd0e40d382c79974f30295c6 P e61c3a8f61bb48f8a963c9480e53c168 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:07:02.609179 25221 raft_consensus.cc:493] T fa731b585f684a7fb2d106c50f143b83 P 127766fc592545a4997f7790f50f6076 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:02.594173 19551 raft_consensus.cc:1275] T edd7d470b5014c9489be7f41f64355c9 P e61c3a8f61bb48f8a963c9480e53c168 [term 22 FOLLOWER]: Refusing update from remote peer e5256d91808b47c195bc9b4dbd7f2b87: Log matching property violated. Preceding OpId in replica: term: 18 index: 10. Preceding OpId from leader: term: 22 index: 12. (index mismatch)
I20260709 13:07:02.594235 19558 raft_consensus.cc:1275] T 22196caba61445d3bec98a0aab3c337d P e61c3a8f61bb48f8a963c9480e53c168 [term 18 FOLLOWER]: Refusing update from remote peer 0473d2b2d01f4459b1e90fd12cc7840e: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
W20260709 13:07:02.614215 25411 consensus_meta.cc:287] T 0e1085d23e8347fbbd5bce7542f4b1f4 P e61c3a8f61bb48f8a963c9480e53c168: Time spent flushing consensus metadata: real 0.535s	user 0.010s	sys 0.001s
I20260709 13:07:02.598351 19407 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52328 (request call id 2556) took 1095 ms. Trace:
I20260709 13:07:02.599997 19402 raft_consensus.cc:1275] T 40e1e16737a842ee936002830f36882e P e5256d91808b47c195bc9b4dbd7f2b87 [term 20 FOLLOWER]: Refusing update from remote peer e61c3a8f61bb48f8a963c9480e53c168: Log matching property violated. Preceding OpId in replica: term: 17 index: 9. Preceding OpId from leader: term: 20 index: 11. (index mismatch)
I20260709 13:07:02.604022 19403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa731b585f684a7fb2d106c50f143b83" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:07:02.574472 25819 raft_consensus.cc:2749] T ff9b0eddd810459b82d91c60777c10eb P e5256d91808b47c195bc9b4dbd7f2b87 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:07:02.608227 20106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab43d85f64114d4ebf618930e43d9ed0" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076"
I20260709 13:07:02.616616 25678 raft_consensus.cc:493] T 179fd671030940b4b4a4e24bcc4aba0a P e61c3a8f61bb48f8a963c9480e53c168 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:02.612262 19559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e5873a19244c5ebbcd38e126796ee7" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 22 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:07:02.613229 20103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa731b585f684a7fb2d106c50f143b83" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:07:02.566808 25530 raft_consensus.cc:493] T 9962423cb4e54fcfa5de01daf68a86e7 P 0473d2b2d01f4459b1e90fd12cc7840e [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 127766fc592545a4997f7790f50f6076)
I20260709 13:07:02.590984 19481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9f0d59553ad444883fcf5b5909f9798" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:07:02.621572 19450 leader_election.cc:304] T ed7fdbcb96d14d418db9ca90a792588a P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e; no voters: 127766fc592545a4997f7790f50f6076, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:07:02.562645 25537 raft_consensus.cc:515] T ff9b0eddd810459b82d91c60777c10eb P 0473d2b2d01f4459b1e90fd12cc7840e [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:07:02.544076 25786 raft_consensus.cc:493] T 96efeaaf1057492490e9a621f37e1a2d P 0473d2b2d01f4459b1e90fd12cc7840e [term 19 FOLLOWER]: Starting leader election (detected failure of leader e61c3a8f61bb48f8a963c9480e53c168)
I20260709 13:07:02.633628 19482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1efebf73c86e432baa55533136b6e12c" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:07:02.608287 25812 raft_consensus.cc:3060] T 4af19371ea874c09a0a2147040835cbb P e5256d91808b47c195bc9b4dbd7f2b87 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:02.639125 19403 raft_consensus.cc:2393] T fa731b585f684a7fb2d106c50f143b83 P e5256d91808b47c195bc9b4dbd7f2b87 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e61c3a8f61bb48f8a963c9480e53c168 in current term 15: Already voted for candidate e5256d91808b47c195bc9b4dbd7f2b87 in this term.
I20260709 13:07:02.595398 25811 leader_election.cc:290] T fa731b585f684a7fb2d106c50f143b83 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:07:02.610262 19409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b08304a0a02b42d7840c4e8ee9a6bd1a" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:07:02.590772 25760 raft_consensus.cc:515] T 5ec1c4ce15e04c7e8c283a62179f2a64 P 0473d2b2d01f4459b1e90fd12cc7840e [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:07:02.647576 19402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edd7d470b5014c9489be7f41f64355c9" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:07:02.617383 25766 consensus_queue.cc:1243] T 86a6797bdfe94fa496c050ceae4bd0d9 P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Peer 0473d2b2d01f4459b1e90fd12cc7840e log is divergent from this leader: its last log entry 15.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
I20260709 13:07:02.652534 19552 raft_consensus.cc:1275] T 0e1085d23e8347fbbd5bce7542f4b1f4 P e61c3a8f61bb48f8a963c9480e53c168 [term 14 FOLLOWER]: Refusing update from remote peer 0473d2b2d01f4459b1e90fd12cc7840e: Log matching property violated. Preceding OpId in replica: term: 13 index: 12. Preceding OpId from leader: term: 14 index: 12. (term mismatch)
I20260709 13:07:02.635728 19407 rpcz_store.cc:276] 0709 13:07:01.502923 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:01.535330 (+ 32407us) service_pool.cc:224] Handling call
0709 13:07:01.535797 (+   467us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:01.601983 (+ 66186us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:01.602016 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:01.609612 (+  7596us) log.cc:844] Serialized 26 byte log entry
0709 13:07:02.234472 (+624860us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:07:02.234520 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:02.234876 (+   356us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:02.577330 (+342454us) spinlock_profiling.cc:243] Waited 16.8 ms on lock 0x7b4400022b4c. stack: 00007f4a79de9343 00007f4a79de9240 00007f4a797781d4 00007f4a834b6304 00007f4a834b6299 00007f4a79ca3db1 00007f4a79d41c85 00007f4a79d426a2 00007f4a7cab41db 00007f4a7caafaaf 00007f4a7caa386e 00007f4a7caa2bb6 00007f4a7caa27d8 00007f4a7caac221 00007f4a7caac1d9 00007f4a7caac169
0709 13:07:02.591544 (+ 14214us) raft_consensus.cc:1685] finished
0709 13:07:02.591583 (+    39us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:02.598291 (+  6708us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":88700,"raft.queue_time_us":93343,"raft.run_cpu_time_us":115,"raft.run_wall_time_us":5867,"spinlock_wait_cycles":38636288,"thread_start_us":523249,"threads_started":1,"wal-append.queue_time_us":676899}
I20260709 13:07:02.671017 19552 pending_rounds.cc:85] T 0e1085d23e8347fbbd5bce7542f4b1f4 P e61c3a8f61bb48f8a963c9480e53c168: Aborting all ops after (but not including) 11
I20260709 13:07:02.671438 19552 pending_rounds.cc:107] T 0e1085d23e8347fbbd5bce7542f4b1f4 P e61c3a8f61bb48f8a963c9480e53c168: Aborting uncommitted NO_OP operation due to leader change: 13.12
I20260709 13:07:02.671737 19552 raft_consensus.cc:2889] T 0e1085d23e8347fbbd5bce7542f4b1f4 P e61c3a8f61bb48f8a963c9480e53c168 [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:07:02.634496 25832 raft_consensus.cc:2804] T a08760e15aac4630a629431f56024dc8 P 0473d2b2d01f4459b1e90fd12cc7840e [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:07:02.668248 19403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f93ee515a9c14139bf566522ed8232f3" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 22 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:07:02.678025 19407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14efcc79969f41babe5529c22d59156d" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:07:02.664556 25786 raft_consensus.cc:3060] T 96efeaaf1057492490e9a621f37e1a2d P 0473d2b2d01f4459b1e90fd12cc7840e [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:07:02.681083 19560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff75a1d4cb1f493db8f71ddc136ba9ab" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:07:02.665166 25808 raft_consensus.cc:2749] T ed7fdbcb96d14d418db9ca90a792588a P 0473d2b2d01f4459b1e90fd12cc7840e [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:07:02.688839 19409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff75a1d4cb1f493db8f71ddc136ba9ab" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:07:02.685238 19551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f93ee515a9c14139bf566522ed8232f3" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 22 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:07:02.701179 19551 raft_consensus.cc:2468] T f93ee515a9c14139bf566522ed8232f3 P e61c3a8f61bb48f8a963c9480e53c168 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 21.
I20260709 13:07:02.639901 25221 raft_consensus.cc:515] T fa731b585f684a7fb2d106c50f143b83 P 127766fc592545a4997f7790f50f6076 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
W20260709 13:07:02.703138 19377 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.2:46257, user_credentials={real_user=slave}} blocked reactor thread for 232224us
I20260709 13:07:02.704111 19407 raft_consensus.cc:1275] T 86a6797bdfe94fa496c050ceae4bd0d9 P e5256d91808b47c195bc9b4dbd7f2b87 [term 15 FOLLOWER]: Refusing update from remote peer 0473d2b2d01f4459b1e90fd12cc7840e: Log matching property violated. Preceding OpId in replica: term: 14 index: 7. Preceding OpId from leader: term: 15 index: 8. (index mismatch)
I20260709 13:07:02.704125 19377 leader_election.cc:304] T e381f1d6b8184797ad142de49be225a8 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:07:02.707226 19377 leader_election.cc:304] T f1b10566f45d4a7d9029858330e02d5b P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87; no voters: e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:07:02.655923 25678 raft_consensus.cc:515] T 179fd671030940b4b4a4e24bcc4aba0a P e61c3a8f61bb48f8a963c9480e53c168 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:07:02.709714 19554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edd7d470b5014c9489be7f41f64355c9" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:07:02.675101 25832 raft_consensus.cc:493] T a08760e15aac4630a629431f56024dc8 P 0473d2b2d01f4459b1e90fd12cc7840e [term 21 FOLLOWER]: Starting leader election (detected failure of leader e5256d91808b47c195bc9b4dbd7f2b87)
I20260709 13:07:02.713150 19377 leader_election.cc:304] T 2e36a9d6e29c4a7c860cf267efbd4c74 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:07:02.714814 19554 raft_consensus.cc:2393] T edd7d470b5014c9489be7f41f64355c9 P e61c3a8f61bb48f8a963c9480e53c168 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0473d2b2d01f4459b1e90fd12cc7840e in current term 22: Already voted for candidate e5256d91808b47c195bc9b4dbd7f2b87 in this term.
I20260709 13:07:02.715444 20103 raft_consensus.cc:2468] T fa731b585f684a7fb2d106c50f143b83 P 127766fc592545a4997f7790f50f6076 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 15.
I20260709 13:07:02.717906 19377 leader_election.cc:304] T 2725d2c4cb054f18b0fc8f735c15f6c2 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:07:02.663666 25530 raft_consensus.cc:515] T 9962423cb4e54fcfa5de01daf68a86e7 P 0473d2b2d01f4459b1e90fd12cc7840e [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:07:02.718384 19554 raft_consensus.cc:3055] T 86a6797bdfe94fa496c050ceae4bd0d9 P e61c3a8f61bb48f8a963c9480e53c168 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:07:02.724294 19554 raft_consensus.cc:740] T 86a6797bdfe94fa496c050ceae4bd0d9 P e61c3a8f61bb48f8a963c9480e53c168 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: e61c3a8f61bb48f8a963c9480e53c168, State: Running, Role: LEADER
I20260709 13:07:02.720781 25537 leader_election.cc:290] T ff9b0eddd810459b82d91c60777c10eb P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:07:02.662834 25805 consensus_queue.cc:1048] T bc225c93219c45538b53a1bd3d387e4d P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.046s
I20260709 13:07:02.721616 25851 raft_consensus.cc:493] T 46c5bfeecc314717bffe987e6844b6d0 P e61c3a8f61bb48f8a963c9480e53c168 [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:02.724924 19554 consensus_queue.cc:260] T 86a6797bdfe94fa496c050ceae4bd0d9 P e61c3a8f61bb48f8a963c9480e53c168 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 14.7, Last appended by leader: 7, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:07:02.741074 19377 leader_election.cc:304] T 5ec1c4ce15e04c7e8c283a62179f2a64 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, 127766fc592545a4997f7790f50f6076
I20260709 13:07:02.714320 25832 raft_consensus.cc:3060] T a08760e15aac4630a629431f56024dc8 P 0473d2b2d01f4459b1e90fd12cc7840e [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:07:02.715874 25819 raft_consensus.cc:2804] T f1b10566f45d4a7d9029858330e02d5b P e5256d91808b47c195bc9b4dbd7f2b87 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:07:02.739383 25093 raft_consensus.cc:2749] T 2725d2c4cb054f18b0fc8f735c15f6c2 P e5256d91808b47c195bc9b4dbd7f2b87 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
W20260709 13:07:02.829315 20075 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:02.722617 25705 raft_consensus.cc:2749] T 2e36a9d6e29c4a7c860cf267efbd4c74 P e5256d91808b47c195bc9b4dbd7f2b87 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:07:02.758916 25814 raft_consensus.cc:2749] T 5ec1c4ce15e04c7e8c283a62179f2a64 P e5256d91808b47c195bc9b4dbd7f2b87 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:07:02.749794 25808 raft_consensus.cc:493] T 179fd671030940b4b4a4e24bcc4aba0a P 0473d2b2d01f4459b1e90fd12cc7840e [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:02.772663 25819 raft_consensus.cc:493] T f1b10566f45d4a7d9029858330e02d5b P e5256d91808b47c195bc9b4dbd7f2b87 [term 17 FOLLOWER]: Starting leader election (detected failure of leader e61c3a8f61bb48f8a963c9480e53c168)
I20260709 13:07:02.852022 25819 raft_consensus.cc:3060] T f1b10566f45d4a7d9029858330e02d5b P e5256d91808b47c195bc9b4dbd7f2b87 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:07:02.855011 25808 raft_consensus.cc:515] T 179fd671030940b4b4a4e24bcc4aba0a P 0473d2b2d01f4459b1e90fd12cc7840e [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:07:02.858038 25854 raft_consensus.cc:2749] T e381f1d6b8184797ad142de49be225a8 P e5256d91808b47c195bc9b4dbd7f2b87 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:07:02.747025 25851 raft_consensus.cc:515] T 46c5bfeecc314717bffe987e6844b6d0 P e61c3a8f61bb48f8a963c9480e53c168 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:07:02.865391 25851 leader_election.cc:290] T 46c5bfeecc314717bffe987e6844b6d0 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:07:02.866134 25819 raft_consensus.cc:515] T f1b10566f45d4a7d9029858330e02d5b P e5256d91808b47c195bc9b4dbd7f2b87 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:07:02.868476 25819 leader_election.cc:290] T f1b10566f45d4a7d9029858330e02d5b P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 18 election: Requested vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:07:02.891736 19479 raft_consensus.cc:2468] T 1f85fc4b527a48848e5faa083b604e36 P 0473d2b2d01f4459b1e90fd12cc7840e [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 127766fc592545a4997f7790f50f6076 in term 18.
W20260709 13:07:02.947340 19377 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.2:46257, user_credentials={real_user=slave}} blocked reactor thread for 206346us
I20260709 13:07:02.949149 19377 leader_election.cc:304] T 2b74109013a140ada21feeef92d6f563 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:07:02.746775 25056 raft_consensus.cc:515] T 775c229504194560ba9589bc2199b089 P e5256d91808b47c195bc9b4dbd7f2b87 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:07:02.958055 25854 raft_consensus.cc:2749] T 2b74109013a140ada21feeef92d6f563 P e5256d91808b47c195bc9b4dbd7f2b87 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:07:02.968349 25857 consensus_queue.cc:1048] T 1dc5b3532fe54f74876d02beffa2c230 P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.259s
W20260709 13:07:02.963367 25553 consensus_meta.cc:287] T 76cb037fc9064d13b59a8969d897ce8c P e61c3a8f61bb48f8a963c9480e53c168: Time spent flushing consensus metadata: real 0.532s	user 0.011s	sys 0.000s
I20260709 13:07:02.978973 25678 leader_election.cc:290] T 179fd671030940b4b4a4e24bcc4aba0a P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:07:02.984547 25760 leader_election.cc:290] T 5ec1c4ce15e04c7e8c283a62179f2a64 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:07:03.005841 25056 leader_election.cc:290] T 775c229504194560ba9589bc2199b089 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 14 election: Requested vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:07:03.006955 25530 leader_election.cc:290] T 9962423cb4e54fcfa5de01daf68a86e7 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:07:03.014479 25221 leader_election.cc:290] T fa731b585f684a7fb2d106c50f143b83 P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
W20260709 13:07:03.018783 19523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.4:43121, user_credentials={real_user=slave}} blocked reactor thread for 252798us
I20260709 13:07:02.994481 25553 raft_consensus.cc:2749] T 76cb037fc9064d13b59a8969d897ce8c P e61c3a8f61bb48f8a963c9480e53c168 [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 13:07:03.031626 19377 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.2:46257, user_credentials={real_user=slave}} blocked reactor thread for 80778.1us
W20260709 13:07:03.030467 19478 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58286 (request call id 2607) took 1642 ms (client timeout 2155 ms). Trace:
W20260709 13:07:03.032536 19478 rpcz_store.cc:269] 0709 13:07:01.388290 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:01.639101 (+250811us) service_pool.cc:224] Handling call
0709 13:07:03.030279 (+1391178us) spinlock_profiling.cc:243] Waited 543 ms on lock 0x7b5400353c54. stack: 00007f4a79de9343 00007f4a79de9240 00007f4a797781d4 00007f4a834b6304 00007f4a834b6299 00007f4a7ce71571 00007f4a7cf0c2fa 00007f4a81ecdb17 00007f4a7b4486d4 00007f4a7b448662 00007f4a7b448591 00007f4a7b44850c 00007f4a7b4477c2 00007f4a7b24348c 00007f4a7b2428c6 00007f4a7b24226f
0709 13:07:03.030414 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1248082816}
W20260709 13:07:03.027483 25804 consensus_meta.cc:287] T 76cb037fc9064d13b59a8969d897ce8c P e5256d91808b47c195bc9b4dbd7f2b87: Time spent flushing consensus metadata: real 0.853s	user 0.009s	sys 0.002s
I20260709 13:07:03.000555 25747 raft_consensus.cc:697] T d1e5873a19244c5ebbcd38e126796ee7 P e61c3a8f61bb48f8a963c9480e53c168 [term 21 LEADER]: Becoming Leader. State: Replica: e61c3a8f61bb48f8a963c9480e53c168, State: Running, Role: LEADER
I20260709 13:07:03.049427 25598 raft_consensus.cc:3055] T ef32ce6fdd0e40d382c79974f30295c6 P e5256d91808b47c195bc9b4dbd7f2b87 [term 21 LEADER]: Stepping down as leader of term 21
I20260709 13:07:03.050035 25598 raft_consensus.cc:740] T ef32ce6fdd0e40d382c79974f30295c6 P e5256d91808b47c195bc9b4dbd7f2b87 [term 21 LEADER]: Becoming Follower/Learner. State: Replica: e5256d91808b47c195bc9b4dbd7f2b87, State: Running, Role: LEADER
I20260709 13:07:03.051030 25598 consensus_queue.cc:260] T ef32ce6fdd0e40d382c79974f30295c6 P e5256d91808b47c195bc9b4dbd7f2b87 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 21.12, Last appended by leader: 12, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:07:03.052610 25598 raft_consensus.cc:3060] T ef32ce6fdd0e40d382c79974f30295c6 P e5256d91808b47c195bc9b4dbd7f2b87 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:07:03.033370 25553 raft_consensus.cc:493] T 0e1085d23e8347fbbd5bce7542f4b1f4 P e61c3a8f61bb48f8a963c9480e53c168 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:03.073699 19449 leader_election.cc:304] T ff75a1d4cb1f493db8f71ddc136ba9ab P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e; no voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:07:03.090325 19450 leader_election.cc:304] T f93ee515a9c14139bf566522ed8232f3 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:07:03.091743 19450 leader_election.cc:304] T edd7d470b5014c9489be7f41f64355c9 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e; no voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:07:03.027786 25812 raft_consensus.cc:515] T 4af19371ea874c09a0a2147040835cbb P e5256d91808b47c195bc9b4dbd7f2b87 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:07:03.101012 25864 raft_consensus.cc:2804] T f93ee515a9c14139bf566522ed8232f3 P 0473d2b2d01f4459b1e90fd12cc7840e [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:07:03.101764 25864 raft_consensus.cc:493] T f93ee515a9c14139bf566522ed8232f3 P 0473d2b2d01f4459b1e90fd12cc7840e [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:03.102279 25864 raft_consensus.cc:3060] T f93ee515a9c14139bf566522ed8232f3 P 0473d2b2d01f4459b1e90fd12cc7840e [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:07:03.084652 25813 raft_consensus.cc:493] T 22196caba61445d3bec98a0aab3c337d P e5256d91808b47c195bc9b4dbd7f2b87 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:03.093891 25591 consensus_meta.cc:287] T bc225c93219c45538b53a1bd3d387e4d P e5256d91808b47c195bc9b4dbd7f2b87: Time spent flushing consensus metadata: real 0.827s	user 0.011s	sys 0.000s
I20260709 13:07:03.110954 25376 raft_consensus.cc:2749] T edd7d470b5014c9489be7f41f64355c9 P 0473d2b2d01f4459b1e90fd12cc7840e [term 22 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:07:03.087945 25553 raft_consensus.cc:515] T 0e1085d23e8347fbbd5bce7542f4b1f4 P e61c3a8f61bb48f8a963c9480e53c168 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:07:03.113793 25812 leader_election.cc:290] T 4af19371ea874c09a0a2147040835cbb P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 10 election: Requested vote from peers e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:07:03.108666 25720 raft_consensus.cc:2749] T ff75a1d4cb1f493db8f71ddc136ba9ab P 0473d2b2d01f4459b1e90fd12cc7840e [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:07:03.107322 25859 raft_consensus.cc:493] T 7f575b143b844aa096b50997dad3516a P 0473d2b2d01f4459b1e90fd12cc7840e [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:03.136005 25859 raft_consensus.cc:515] T 7f575b143b844aa096b50997dad3516a P 0473d2b2d01f4459b1e90fd12cc7840e [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:07:03.126078 25763 consensus_queue.cc:1048] T 86a6797bdfe94fa496c050ceae4bd0d9 P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.018s
I20260709 13:07:03.126294 25591 raft_consensus.cc:515] T bc225c93219c45538b53a1bd3d387e4d P e5256d91808b47c195bc9b4dbd7f2b87 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:07:03.123613 25813 raft_consensus.cc:515] T 22196caba61445d3bec98a0aab3c337d P e5256d91808b47c195bc9b4dbd7f2b87 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:07:03.162506 25786 raft_consensus.cc:515] T 96efeaaf1057492490e9a621f37e1a2d P 0473d2b2d01f4459b1e90fd12cc7840e [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:07:03.163002 25808 leader_election.cc:290] T 179fd671030940b4b4a4e24bcc4aba0a P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:07:03.168108 19556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4af19371ea874c09a0a2147040835cbb" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:07:03.168625 19558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1b10566f45d4a7d9029858330e02d5b" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:07:03.168987 19556 raft_consensus.cc:3060] T 4af19371ea874c09a0a2147040835cbb P e61c3a8f61bb48f8a963c9480e53c168 [term 8 FOLLOWER]: Advancing to term 10
I20260709 13:07:03.171957 25553 leader_election.cc:290] T 0e1085d23e8347fbbd5bce7542f4b1f4 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
W20260709 13:07:03.173429 25839 log.cc:927] Time spent T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P e5256d91808b47c195bc9b4dbd7f2b87: Append to log took a long time: real 0.795s	user 0.000s	sys 0.014s
I20260709 13:07:03.174966 19411 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52342 (request call id 3204) took 1350 ms. Trace:
I20260709 13:07:03.175469 19411 rpcz_store.cc:276] 0709 13:07:01.825120 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:01.825346 (+   226us) service_pool.cc:224] Handling call
0709 13:07:01.850056 (+ 24710us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:07:01.890899 (+ 40843us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:01.890930 (+    31us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:07:02.072471 (+181541us) spinlock_profiling.cc:243] Waited 2.47 ms on lock 0x7b2c00032ed8. stack: 00007f4a79de9343 00007f4a79de9240 00007f4a797781d4 00007f4a834b6304 00007f4a834b6299 00007f4a7b801a11 00007f4a7b811372 00007f4a7cf43a01 00007f4a7cf0843a 00007f4a7cf0783e 00007f4a81ecc419 00007f4a7b443bd4 00007f4a7b443b62 00007f4a7b443a91 00007f4a7b443a0c 00007f4a7b442cc2
0709 13:07:02.073224 (+   753us) log.cc:844] Serialized 52 byte log entry
0709 13:07:02.223984 (+150760us) raft_consensus.cc:1645] Marking committed up to 14
0709 13:07:02.224865 (+   881us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:02.224929 (+    64us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:03.172833 (+947904us) spinlock_profiling.cc:243] Waited 7.71 ms on lock 0x7b4400022b4c. stack: 00007f4a79de9343 00007f4a79de9240 00007f4a797781d4 00007f4a834b6304 00007f4a834b6299 00007f4a79ca3db1 00007f4a79d41c85 00007f4a79d426a2 00007f4a7cab41db 00007f4a7caafaaf 00007f4a7caa386e 00007f4a7caa2bb6 00007f4a7caa27d8 00007f4a7caac221 00007f4a7caac1d9 00007f4a7caac169
0709 13:07:03.174747 (+  1914us) raft_consensus.cc:1685] finished
0709 13:07:03.174768 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:03.174909 (+   141us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2765,"raft.queue_time_us":33276,"raft.run_cpu_time_us":200,"raft.run_wall_time_us":12297,"spinlock_wait_cycles":23425024,"thread_start_us":150328,"threads_started":1,"wal-append.queue_time_us":184642}
W20260709 13:07:03.180253 19526 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:03.155725 25827 consensus_meta.cc:287] T ef32ce6fdd0e40d382c79974f30295c6 P e61c3a8f61bb48f8a963c9480e53c168: Time spent flushing consensus metadata: real 0.530s	user 0.005s	sys 0.005s
I20260709 13:07:03.182840 19556 raft_consensus.cc:2468] T 4af19371ea874c09a0a2147040835cbb P e61c3a8f61bb48f8a963c9480e53c168 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 10.
I20260709 13:07:03.187654 19375 leader_election.cc:304] T 4af19371ea874c09a0a2147040835cbb P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:07:03.190397 19526 leader_election.cc:304] T ab43d85f64114d4ebf618930e43d9ed0 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e61c3a8f61bb48f8a963c9480e53c168; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, 127766fc592545a4997f7790f50f6076
I20260709 13:07:03.194543 19408 raft_consensus.cc:1240] T bc225c93219c45538b53a1bd3d387e4d P e5256d91808b47c195bc9b4dbd7f2b87 [term 16 FOLLOWER]: Rejecting Update request from peer 0473d2b2d01f4459b1e90fd12cc7840e for earlier term 15. Current term is 16. Ops: []
W20260709 13:07:03.190176 25715 consensus_meta.cc:287] T 0cdf56e38bbc453d9438d359e5a69955 P e61c3a8f61bb48f8a963c9480e53c168: Time spent flushing consensus metadata: real 0.580s	user 0.003s	sys 0.008s
I20260709 13:07:03.141642 25747 consensus_queue.cc:237] T d1e5873a19244c5ebbcd38e126796ee7 P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 20.10, Last appended by leader: 10, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:07:03.190496 25827 raft_consensus.cc:2749] T ef32ce6fdd0e40d382c79974f30295c6 P e61c3a8f61bb48f8a963c9480e53c168 [term 22 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:07:03.192238 25854 raft_consensus.cc:2804] T 4af19371ea874c09a0a2147040835cbb P e5256d91808b47c195bc9b4dbd7f2b87 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:07:03.200074 19526 leader_election.cc:304] T 2e36a9d6e29c4a7c860cf267efbd4c74 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e61c3a8f61bb48f8a963c9480e53c168; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:07:03.199141 25849 consensus_queue.cc:1048] T 40e1e16737a842ee936002830f36882e P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.021s
I20260709 13:07:03.219058 25813 leader_election.cc:290] T 22196caba61445d3bec98a0aab3c337d P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
W20260709 13:07:03.220741 25870 log.cc:927] Time spent T ed7fdbcb96d14d418db9ca90a792588a P 127766fc592545a4997f7790f50f6076: Append to log took a long time: real 0.063s	user 0.000s	sys 0.000s
I20260709 13:07:03.222512 25832 raft_consensus.cc:515] T a08760e15aac4630a629431f56024dc8 P 0473d2b2d01f4459b1e90fd12cc7840e [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:07:03.197645 25825 raft_consensus.cc:493] T 14935b3ddf914369822e4a0547aaa355 P e61c3a8f61bb48f8a963c9480e53c168 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 127766fc592545a4997f7790f50f6076)
I20260709 13:07:03.232237 19560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22196caba61445d3bec98a0aab3c337d" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 19 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
W20260709 13:07:03.245404 19449 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.1:40321, user_credentials={real_user=slave}} blocked reactor thread for 123553us
I20260709 13:07:03.199186 25824 raft_consensus.cc:2749] T ab43d85f64114d4ebf618930e43d9ed0 P e61c3a8f61bb48f8a963c9480e53c168 [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 13:07:03.185669 25713 consensus_queue.cc:1048] T edd7d470b5014c9489be7f41f64355c9 P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.028s
W20260709 13:07:03.239359 25764 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.517s	user 0.038s	sys 0.077s
I20260709 13:07:03.262948 19477 raft_consensus.cc:1240] T 96efeaaf1057492490e9a621f37e1a2d P 0473d2b2d01f4459b1e90fd12cc7840e [term 20 FOLLOWER]: Rejecting Update request from peer e61c3a8f61bb48f8a963c9480e53c168 for earlier term 19. Current term is 20. Ops: []
I20260709 13:07:03.261938 19560 raft_consensus.cc:2468] T 22196caba61445d3bec98a0aab3c337d P e61c3a8f61bb48f8a963c9480e53c168 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 18.
I20260709 13:07:03.263338 19479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46c5bfeecc314717bffe987e6844b6d0" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 25 candidate_status { last_received { term: 23 index: 12 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:07:03.266595 19479 raft_consensus.cc:2468] T 46c5bfeecc314717bffe987e6844b6d0 P 0473d2b2d01f4459b1e90fd12cc7840e [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 24.
W20260709 13:07:03.272557 19450 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.3:36891, user_credentials={real_user=slave}} blocked reactor thread for 147950us
I20260709 13:07:03.275511 19478 raft_consensus.cc:3055] T 40e1e16737a842ee936002830f36882e P 0473d2b2d01f4459b1e90fd12cc7840e [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:07:03.276006 19478 raft_consensus.cc:740] T 40e1e16737a842ee936002830f36882e P 0473d2b2d01f4459b1e90fd12cc7840e [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 0473d2b2d01f4459b1e90fd12cc7840e, State: Running, Role: LEADER
W20260709 13:07:03.280864 20075 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:03.285355 19555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "179fd671030940b4b4a4e24bcc4aba0a" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
W20260709 13:07:03.268966 25764 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.547s	user 0.038s	sys 0.078s
I20260709 13:07:03.254624 25056 raft_consensus.cc:493] T 14efcc79969f41babe5529c22d59156d P e5256d91808b47c195bc9b4dbd7f2b87 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 127766fc592545a4997f7790f50f6076)
I20260709 13:07:03.290015 19375 leader_election.cc:304] T 22196caba61445d3bec98a0aab3c337d P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:07:03.286317 19555 raft_consensus.cc:2468] T 179fd671030940b4b4a4e24bcc4aba0a P e61c3a8f61bb48f8a963c9480e53c168 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 20.
I20260709 13:07:03.271410 25411 raft_consensus.cc:2749] T 2e36a9d6e29c4a7c860cf267efbd4c74 P e61c3a8f61bb48f8a963c9480e53c168 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:07:03.253608 25854 raft_consensus.cc:697] T 4af19371ea874c09a0a2147040835cbb P e5256d91808b47c195bc9b4dbd7f2b87 [term 10 LEADER]: Becoming Leader. State: Replica: e5256d91808b47c195bc9b4dbd7f2b87, State: Running, Role: LEADER
I20260709 13:07:03.293545 19481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "179fd671030940b4b4a4e24bcc4aba0a" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:07:03.294452 19481 raft_consensus.cc:2468] T 179fd671030940b4b4a4e24bcc4aba0a P 0473d2b2d01f4459b1e90fd12cc7840e [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 20.
I20260709 13:07:03.215930 25715 raft_consensus.cc:515] T 0cdf56e38bbc453d9438d359e5a69955 P e61c3a8f61bb48f8a963c9480e53c168 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:07:03.291488 19478 consensus_queue.cc:260] T 40e1e16737a842ee936002830f36882e P 0473d2b2d01f4459b1e90fd12cc7840e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 19.11, Last appended by leader: 11, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:07:03.320528 19551 raft_consensus.cc:1240] T 0cdf56e38bbc453d9438d359e5a69955 P e61c3a8f61bb48f8a963c9480e53c168 [term 18 FOLLOWER]: Rejecting Update request from peer e5256d91808b47c195bc9b4dbd7f2b87 for earlier term 17. Current term is 18. Ops: []
I20260709 13:07:03.301131 25093 raft_consensus.cc:2804] T 22196caba61445d3bec98a0aab3c337d P e5256d91808b47c195bc9b4dbd7f2b87 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:07:03.283705 25822 consensus_queue.cc:1048] T 22196caba61445d3bec98a0aab3c337d P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.030s
I20260709 13:07:03.271099 25825 raft_consensus.cc:515] T 14935b3ddf914369822e4a0547aaa355 P e61c3a8f61bb48f8a963c9480e53c168 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:07:03.334110 25825 leader_election.cc:290] T 14935b3ddf914369822e4a0547aaa355 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
W20260709 13:07:03.329979 25841 log.cc:927] Time spent T 85c494af21f9457a85da47b9bc70c1fd P e5256d91808b47c195bc9b4dbd7f2b87: Append to log took a long time: real 0.818s	user 0.007s	sys 0.004s
I20260709 13:07:03.300091 25056 raft_consensus.cc:515] T 14efcc79969f41babe5529c22d59156d P e5256d91808b47c195bc9b4dbd7f2b87 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:07:03.331593 25832 leader_election.cc:290] T a08760e15aac4630a629431f56024dc8 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 22 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
W20260709 13:07:03.335883 19523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.1:40321, user_credentials={real_user=slave}} blocked reactor thread for 141514us
W20260709 13:07:03.349570 19376 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:03.351461 19526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.2:46257, user_credentials={real_user=slave}} blocked reactor thread for 151509us
I20260709 13:07:03.324143 25859 leader_election.cc:290] T 7f575b143b844aa096b50997dad3516a P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:07:03.326370 25093 raft_consensus.cc:493] T 22196caba61445d3bec98a0aab3c337d P e5256d91808b47c195bc9b4dbd7f2b87 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:07:03.353987 19377 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.2:46257, user_credentials={real_user=slave}} blocked reactor thread for 113846us
I20260709 13:07:03.360862 25875 raft_consensus.cc:493] T 62c6c134d3d24a1ab144dd9ee6bc3f64 P 0473d2b2d01f4459b1e90fd12cc7840e [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 127766fc592545a4997f7790f50f6076)
I20260709 13:07:03.375036 19481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f85fc4b527a48848e5faa083b604e36" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:07:03.383401 19481 raft_consensus.cc:2368] T 1f85fc4b527a48848e5faa083b604e36 P 0473d2b2d01f4459b1e90fd12cc7840e [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e5256d91808b47c195bc9b4dbd7f2b87 for earlier term 17. Current term is 18.
I20260709 13:07:03.378690 19526 leader_election.cc:304] T 1dc5b3532fe54f74876d02beffa2c230 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168; no voters: e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:07:03.386801 19483 raft_consensus.cc:1275] T fa8650e71aa14778b3d73721fc50d9fc P 0473d2b2d01f4459b1e90fd12cc7840e [term 18 FOLLOWER]: Refusing update from remote peer e5256d91808b47c195bc9b4dbd7f2b87: Log matching property violated. Preceding OpId in replica: term: 17 index: 9. Preceding OpId from leader: term: 18 index: 10. (index mismatch)
I20260709 13:07:03.386889 25879 raft_consensus.cc:2804] T 1dc5b3532fe54f74876d02beffa2c230 P e61c3a8f61bb48f8a963c9480e53c168 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:07:03.387656 25879 raft_consensus.cc:697] T 1dc5b3532fe54f74876d02beffa2c230 P e61c3a8f61bb48f8a963c9480e53c168 [term 20 LEADER]: Becoming Leader. State: Replica: e61c3a8f61bb48f8a963c9480e53c168, State: Running, Role: LEADER
I20260709 13:07:03.389950 19480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff75a1d4cb1f493db8f71ddc136ba9ab" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:07:03.390319 19483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b74109013a140ada21feeef92d6f563" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:07:03.391275 19483 raft_consensus.cc:2393] T 2b74109013a140ada21feeef92d6f563 P 0473d2b2d01f4459b1e90fd12cc7840e [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e5256d91808b47c195bc9b4dbd7f2b87 in current term 16: Already voted for candidate 0473d2b2d01f4459b1e90fd12cc7840e in this term.
I20260709 13:07:03.392158 19483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1b10566f45d4a7d9029858330e02d5b" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:07:03.393402 19483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edd7d470b5014c9489be7f41f64355c9" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:07:03.382771 25093 raft_consensus.cc:3060] T 22196caba61445d3bec98a0aab3c337d P e5256d91808b47c195bc9b4dbd7f2b87 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:07:03.393990 19483 raft_consensus.cc:2376] T edd7d470b5014c9489be7f41f64355c9 P 0473d2b2d01f4459b1e90fd12cc7840e [term 22 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 22. Re-sending same reply.
I20260709 13:07:03.395283 19480 raft_consensus.cc:2410] T ff75a1d4cb1f493db8f71ddc136ba9ab P 0473d2b2d01f4459b1e90fd12cc7840e [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate e5256d91808b47c195bc9b4dbd7f2b87 for term 19 because replica has last-logged OpId of term: 18 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 17 index: 9.
I20260709 13:07:03.385704 19526 leader_election.cc:304] T fa8650e71aa14778b3d73721fc50d9fc P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168; no voters: e5256d91808b47c195bc9b4dbd7f2b87
W20260709 13:07:03.384063 25816 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 1.180s	user 0.015s	sys 0.010s
I20260709 13:07:03.398391 19483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "775c229504194560ba9589bc2199b089" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:07:03.400058 19480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "309c3ca0ca4b4f3ba129752ea2cb293b" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:07:03.400223 19481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86a6797bdfe94fa496c050ceae4bd0d9" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:07:03.400637 19526 leader_election.cc:304] T b08304a0a02b42d7840c4e8ee9a6bd1a P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e61c3a8f61bb48f8a963c9480e53c168; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:07:03.402345 19479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7be9efa6559648dbb5a0f7684c4542d1" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:07:03.403167 19479 raft_consensus.cc:2393] T 7be9efa6559648dbb5a0f7684c4542d1 P 0473d2b2d01f4459b1e90fd12cc7840e [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate e5256d91808b47c195bc9b4dbd7f2b87 in current term 19: Already voted for candidate 127766fc592545a4997f7790f50f6076 in this term.
I20260709 13:07:03.403374 19377 leader_election.cc:400] T 1f85fc4b527a48848e5faa083b604e36 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 17 pre-election: Vote denied by peer 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257) with higher term. Message: Invalid argument: T 1f85fc4b527a48848e5faa083b604e36 P 0473d2b2d01f4459b1e90fd12cc7840e [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e5256d91808b47c195bc9b4dbd7f2b87 for earlier term 17. Current term is 18.
I20260709 13:07:03.403710 19377 leader_election.cc:403] T 1f85fc4b527a48848e5faa083b604e36 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 17 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:07:03.403882 19477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e381f1d6b8184797ad142de49be225a8" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:07:03.404662 19477 raft_consensus.cc:2393] T e381f1d6b8184797ad142de49be225a8 P 0473d2b2d01f4459b1e90fd12cc7840e [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e5256d91808b47c195bc9b4dbd7f2b87 in current term 16: Already voted for candidate 0473d2b2d01f4459b1e90fd12cc7840e in this term.
I20260709 13:07:03.405179 19480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e5873a19244c5ebbcd38e126796ee7" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 22 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:07:03.406793 19483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22196caba61445d3bec98a0aab3c337d" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 19 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:07:03.407601 25881 raft_consensus.cc:2804] T fa8650e71aa14778b3d73721fc50d9fc P e61c3a8f61bb48f8a963c9480e53c168 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:07:03.407925 25849 raft_consensus.cc:2749] T b08304a0a02b42d7840c4e8ee9a6bd1a P e61c3a8f61bb48f8a963c9480e53c168 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:07:03.408159 19479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "179fd671030940b4b4a4e24bcc4aba0a" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:07:03.408278 25304 raft_consensus.cc:2749] T 1f85fc4b527a48848e5faa083b604e36 P e5256d91808b47c195bc9b4dbd7f2b87 [term 18 FOLLOWER]: Leader pre-election lost for term 17. Reason: Vote denied by peer 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257) with higher term. Message: Invalid argument: T 1f85fc4b527a48848e5faa083b604e36 P 0473d2b2d01f4459b1e90fd12cc7840e [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e5256d91808b47c195bc9b4dbd7f2b87 for earlier term 17. Current term is 18.
I20260709 13:07:03.409209 25825 consensus_queue.cc:1048] T 4509b76741dc428e9201c70c1658da13 P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:07:03.410015 25304 consensus_queue.cc:1048] T fa8650e71aa14778b3d73721fc50d9fc P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:07:03.411109 19526 leader_election.cc:304] T b9f0d59553ad444883fcf5b5909f9798 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e61c3a8f61bb48f8a963c9480e53c168; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:07:03.411039 25879 consensus_queue.cc:237] T 1dc5b3532fe54f74876d02beffa2c230 P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 19.10, Last appended by leader: 10, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:07:03.412024 25825 raft_consensus.cc:2749] T b9f0d59553ad444883fcf5b5909f9798 P e61c3a8f61bb48f8a963c9480e53c168 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:07:03.370589 25854 consensus_queue.cc:237] T 4af19371ea874c09a0a2147040835cbb P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:07:03.415685 25056 leader_election.cc:290] T 14efcc79969f41babe5529c22d59156d P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:07:03.370947 25864 raft_consensus.cc:515] T f93ee515a9c14139bf566522ed8232f3 P 0473d2b2d01f4459b1e90fd12cc7840e [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:07:03.416337 19477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21e14947d70440f19044d8f75c31e1f9" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:07:03.416916 19477 raft_consensus.cc:3060] T 21e14947d70440f19044d8f75c31e1f9 P 0473d2b2d01f4459b1e90fd12cc7840e [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:07:03.407531 19450 leader_election.cc:304] T 179fd671030940b4b4a4e24bcc4aba0a P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:07:03.418115 25864 leader_election.cc:290] T f93ee515a9c14139bf566522ed8232f3 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 22 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:07:03.385562 25875 raft_consensus.cc:515] T 62c6c134d3d24a1ab144dd9ee6bc3f64 P 0473d2b2d01f4459b1e90fd12cc7840e [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:07:03.420341 19377 leader_election.cc:304] T f1b10566f45d4a7d9029858330e02d5b P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:07:03.421132 25875 leader_election.cc:290] T 62c6c134d3d24a1ab144dd9ee6bc3f64 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:07:03.422441 19377 leader_election.cc:304] T 86a6797bdfe94fa496c050ceae4bd0d9 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:07:03.423269 25304 raft_consensus.cc:2749] T f1b10566f45d4a7d9029858330e02d5b P e5256d91808b47c195bc9b4dbd7f2b87 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:07:03.423928 25304 raft_consensus.cc:2749] T 86a6797bdfe94fa496c050ceae4bd0d9 P e5256d91808b47c195bc9b4dbd7f2b87 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:07:03.424798 25715 leader_election.cc:290] T 0cdf56e38bbc453d9438d359e5a69955 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 18 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:07:03.405822 19480 raft_consensus.cc:2468] T d1e5873a19244c5ebbcd38e126796ee7 P 0473d2b2d01f4459b1e90fd12cc7840e [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 21.
I20260709 13:07:03.426980 19377 leader_election.cc:304] T 309c3ca0ca4b4f3ba129752ea2cb293b P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, 127766fc592545a4997f7790f50f6076
I20260709 13:07:03.427525 19480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e1085d23e8347fbbd5bce7542f4b1f4" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:07:03.428490 19377 leader_election.cc:304] T 7be9efa6559648dbb5a0f7684c4542d1 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, 127766fc592545a4997f7790f50f6076
I20260709 13:07:03.430130 19480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cdf56e38bbc453d9438d359e5a69955" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:07:03.430886 19480 raft_consensus.cc:3060] T 0cdf56e38bbc453d9438d359e5a69955 P 0473d2b2d01f4459b1e90fd12cc7840e [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:07:03.431103 19377 leader_election.cc:304] T d1e5873a19244c5ebbcd38e126796ee7 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87; no voters: 
I20260709 13:07:03.431773 19483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14935b3ddf914369822e4a0547aaa355" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:07:03.440630 19479 raft_consensus.cc:2468] T 179fd671030940b4b4a4e24bcc4aba0a P 0473d2b2d01f4459b1e90fd12cc7840e [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 20.
W20260709 13:07:03.399510 25816 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.198s	user 0.015s	sys 0.011s
I20260709 13:07:03.433678 19483 raft_consensus.cc:2468] T 14935b3ddf914369822e4a0547aaa355 P 0473d2b2d01f4459b1e90fd12cc7840e [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 12.
I20260709 13:07:03.465422 19483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14efcc79969f41babe5529c22d59156d" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:07:03.465603 19377 leader_election.cc:304] T 179fd671030940b4b4a4e24bcc4aba0a P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87; no voters: e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:07:03.464160 19477 raft_consensus.cc:2468] T 21e14947d70440f19044d8f75c31e1f9 P 0473d2b2d01f4459b1e90fd12cc7840e [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 18.
I20260709 13:07:03.466559 19483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc225c93219c45538b53a1bd3d387e4d" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:07:03.428720 25875 raft_consensus.cc:493] T 76cb037fc9064d13b59a8969d897ce8c P 0473d2b2d01f4459b1e90fd12cc7840e [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:03.454963 19481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc225c93219c45538b53a1bd3d387e4d" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:07:03.456091 19553 raft_consensus.cc:1217] T 217b5fae677b4971b3bbd2f357a1f7ff P e61c3a8f61bb48f8a963c9480e53c168 [term 15 FOLLOWER]: Deduplicated request from leader. Original: 12.8->[14.9-14.9]   Dedup: 14.9->[]
I20260709 13:07:03.470199 19553 raft_consensus.cc:1240] T 217b5fae677b4971b3bbd2f357a1f7ff P e61c3a8f61bb48f8a963c9480e53c168 [term 15 FOLLOWER]: Rejecting Update request from peer 0473d2b2d01f4459b1e90fd12cc7840e for earlier term 14. Current term is 15. Ops: [14.9-14.9]
I20260709 13:07:03.456454 19555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62c6c134d3d24a1ab144dd9ee6bc3f64" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:07:03.463272 19560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a08760e15aac4630a629431f56024dc8" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:07:03.399603 25086 leader_election.cc:290] T 21e14947d70440f19044d8f75c31e1f9 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 18 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:07:03.467655 19477 raft_consensus.cc:1275] T ff75a1d4cb1f493db8f71ddc136ba9ab P 0473d2b2d01f4459b1e90fd12cc7840e [term 19 FOLLOWER]: Refusing update from remote peer e5256d91808b47c195bc9b4dbd7f2b87: Log matching property violated. Preceding OpId in replica: term: 18 index: 10. Preceding OpId from leader: term: 19 index: 10. (term mismatch)
I20260709 13:07:03.432924 25056 raft_consensus.cc:2749] T 309c3ca0ca4b4f3ba129752ea2cb293b P e5256d91808b47c195bc9b4dbd7f2b87 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:07:03.452155 25587 raft_consensus.cc:2804] T d1e5873a19244c5ebbcd38e126796ee7 P e5256d91808b47c195bc9b4dbd7f2b87 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:07:03.441358 25304 raft_consensus.cc:2749] T 7be9efa6559648dbb5a0f7684c4542d1 P e5256d91808b47c195bc9b4dbd7f2b87 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:07:03.472213 19477 pending_rounds.cc:85] T ff75a1d4cb1f493db8f71ddc136ba9ab P 0473d2b2d01f4459b1e90fd12cc7840e: Aborting all ops after (but not including) 9
I20260709 13:07:03.474712 19477 pending_rounds.cc:107] T ff75a1d4cb1f493db8f71ddc136ba9ab P 0473d2b2d01f4459b1e90fd12cc7840e: Aborting uncommitted NO_OP operation due to leader change: 18.10
I20260709 13:07:03.471565 19555 raft_consensus.cc:2468] T 62c6c134d3d24a1ab144dd9ee6bc3f64 P e61c3a8f61bb48f8a963c9480e53c168 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 16.
I20260709 13:07:03.473568 25587 raft_consensus.cc:493] T d1e5873a19244c5ebbcd38e126796ee7 P e5256d91808b47c195bc9b4dbd7f2b87 [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:03.476197 25587 raft_consensus.cc:3060] T d1e5873a19244c5ebbcd38e126796ee7 P e5256d91808b47c195bc9b4dbd7f2b87 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:07:03.469177 25859 raft_consensus.cc:2804] T 179fd671030940b4b4a4e24bcc4aba0a P 0473d2b2d01f4459b1e90fd12cc7840e [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:07:03.481369 25705 raft_consensus.cc:2804] T 179fd671030940b4b4a4e24bcc4aba0a P e5256d91808b47c195bc9b4dbd7f2b87 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:07:03.481976 25705 raft_consensus.cc:697] T 179fd671030940b4b4a4e24bcc4aba0a P e5256d91808b47c195bc9b4dbd7f2b87 [term 20 LEADER]: Becoming Leader. State: Replica: e5256d91808b47c195bc9b4dbd7f2b87, State: Running, Role: LEADER
I20260709 13:07:03.482897 25705 consensus_queue.cc:237] T 179fd671030940b4b4a4e24bcc4aba0a P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 19.12, Last appended by leader: 12, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:07:03.489620 19480 raft_consensus.cc:2468] T 0cdf56e38bbc453d9438d359e5a69955 P 0473d2b2d01f4459b1e90fd12cc7840e [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 18.
I20260709 13:07:03.495503 19555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96efeaaf1057492490e9a621f37e1a2d" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:07:03.495810 19450 leader_election.cc:304] T 62c6c134d3d24a1ab144dd9ee6bc3f64 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:07:03.498189 19555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f93ee515a9c14139bf566522ed8232f3" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 22 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:07:03.499490 19555 raft_consensus.cc:3060] T f93ee515a9c14139bf566522ed8232f3 P e61c3a8f61bb48f8a963c9480e53c168 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:07:03.500000 19481 raft_consensus.cc:1240] T 21e14947d70440f19044d8f75c31e1f9 P 0473d2b2d01f4459b1e90fd12cc7840e [term 18 FOLLOWER]: Rejecting Update request from peer e5256d91808b47c195bc9b4dbd7f2b87 for earlier term 17. Current term is 18. Ops: []
I20260709 13:07:03.470794 25418 raft_consensus.cc:3055] T 217b5fae677b4971b3bbd2f357a1f7ff P 0473d2b2d01f4459b1e90fd12cc7840e [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:07:03.500737 19479 raft_consensus.cc:1240] T 0cdf56e38bbc453d9438d359e5a69955 P 0473d2b2d01f4459b1e90fd12cc7840e [term 18 FOLLOWER]: Rejecting Update request from peer e5256d91808b47c195bc9b4dbd7f2b87 for earlier term 17. Current term is 18. Ops: [17.11-17.11]
I20260709 13:07:03.502020 19480 raft_consensus.cc:1240] T ef32ce6fdd0e40d382c79974f30295c6 P 0473d2b2d01f4459b1e90fd12cc7840e [term 22 FOLLOWER]: Rejecting Update request from peer e5256d91808b47c195bc9b4dbd7f2b87 for earlier term 21. Current term is 22. Ops: [21.12-21.12]
I20260709 13:07:03.475152 19477 raft_consensus.cc:2889] T ff75a1d4cb1f493db8f71ddc136ba9ab P 0473d2b2d01f4459b1e90fd12cc7840e [term 19 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:07:03.472939 25875 raft_consensus.cc:515] T 76cb037fc9064d13b59a8969d897ce8c P 0473d2b2d01f4459b1e90fd12cc7840e [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:07:03.504931 19480 raft_consensus.cc:1275] T 1a61655d99124a29b486ba4a5b37faea P 0473d2b2d01f4459b1e90fd12cc7840e [term 17 FOLLOWER]: Refusing update from remote peer e61c3a8f61bb48f8a963c9480e53c168: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 13:07:03.504933 25829 raft_consensus.cc:3055] T 1dc5b3532fe54f74876d02beffa2c230 P e5256d91808b47c195bc9b4dbd7f2b87 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:07:03.506955 25875 leader_election.cc:290] T 76cb037fc9064d13b59a8969d897ce8c P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:07:03.508379 25829 raft_consensus.cc:740] T 1dc5b3532fe54f74876d02beffa2c230 P e5256d91808b47c195bc9b4dbd7f2b87 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: e5256d91808b47c195bc9b4dbd7f2b87, State: Running, Role: LEADER
I20260709 13:07:03.501264 25418 raft_consensus.cc:740] T 217b5fae677b4971b3bbd2f357a1f7ff P 0473d2b2d01f4459b1e90fd12cc7840e [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 0473d2b2d01f4459b1e90fd12cc7840e, State: Running, Role: LEADER
I20260709 13:07:03.506783 25093 raft_consensus.cc:515] T 22196caba61445d3bec98a0aab3c337d P e5256d91808b47c195bc9b4dbd7f2b87 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:07:03.509793 25418 consensus_queue.cc:260] T 217b5fae677b4971b3bbd2f357a1f7ff P 0473d2b2d01f4459b1e90fd12cc7840e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.9, Last appended by leader: 9, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:07:03.510828 25418 raft_consensus.cc:3060] T 217b5fae677b4971b3bbd2f357a1f7ff P 0473d2b2d01f4459b1e90fd12cc7840e [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:07:03.514394 19403 raft_consensus.cc:2468] T f93ee515a9c14139bf566522ed8232f3 P e5256d91808b47c195bc9b4dbd7f2b87 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 21.
I20260709 13:07:03.498100 25832 raft_consensus.cc:493] T 48824d5acfbc485ebf8c2d944e7202de P 0473d2b2d01f4459b1e90fd12cc7840e [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:03.521122 19481 raft_consensus.cc:1240] T 1dc5b3532fe54f74876d02beffa2c230 P 0473d2b2d01f4459b1e90fd12cc7840e [term 20 FOLLOWER]: Rejecting Update request from peer e5256d91808b47c195bc9b4dbd7f2b87 for earlier term 19. Current term is 20. Ops: [19.10-19.10]
I20260709 13:07:03.523550 25763 raft_consensus.cc:2804] T 62c6c134d3d24a1ab144dd9ee6bc3f64 P 0473d2b2d01f4459b1e90fd12cc7840e [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:07:03.513957 25829 consensus_queue.cc:260] T 1dc5b3532fe54f74876d02beffa2c230 P e5256d91808b47c195bc9b4dbd7f2b87 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 19.10, Last appended by leader: 10, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:07:03.524075 25763 raft_consensus.cc:493] T 62c6c134d3d24a1ab144dd9ee6bc3f64 P 0473d2b2d01f4459b1e90fd12cc7840e [term 16 FOLLOWER]: Starting leader election (detected failure of leader 127766fc592545a4997f7790f50f6076)
I20260709 13:07:03.524544 25763 raft_consensus.cc:3060] T 62c6c134d3d24a1ab144dd9ee6bc3f64 P 0473d2b2d01f4459b1e90fd12cc7840e [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:07:03.524762 25829 raft_consensus.cc:3060] T 1dc5b3532fe54f74876d02beffa2c230 P e5256d91808b47c195bc9b4dbd7f2b87 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:07:03.527097 19560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f575b143b844aa096b50997dad3516a" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:07:03.548147 25859 raft_consensus.cc:493] T 179fd671030940b4b4a4e24bcc4aba0a P 0473d2b2d01f4459b1e90fd12cc7840e [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:03.548754 25859 raft_consensus.cc:3060] T 179fd671030940b4b4a4e24bcc4aba0a P 0473d2b2d01f4459b1e90fd12cc7840e [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:07:03.554045 19552 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40428 (request call id 3254) took 1263 ms. Trace:
I20260709 13:07:03.560093 25829 consensus_queue.cc:1059] T 21e14947d70440f19044d8f75c31e1f9 P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 }, Status: INVALID_TERM, Last received: 17.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:07:03.561344 25857 raft_consensus.cc:3055] T 21e14947d70440f19044d8f75c31e1f9 P e5256d91808b47c195bc9b4dbd7f2b87 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:07:03.561735 25857 raft_consensus.cc:740] T 21e14947d70440f19044d8f75c31e1f9 P e5256d91808b47c195bc9b4dbd7f2b87 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: e5256d91808b47c195bc9b4dbd7f2b87, State: Running, Role: LEADER
I20260709 13:07:03.562489 25857 consensus_queue.cc:260] T 21e14947d70440f19044d8f75c31e1f9 P e5256d91808b47c195bc9b4dbd7f2b87 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.11, Last appended by leader: 11, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:07:03.563136 25803 leader_election.cc:290] T 4509b76741dc428e9201c70c1658da13 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:07:03.563562 25857 raft_consensus.cc:3060] T 21e14947d70440f19044d8f75c31e1f9 P e5256d91808b47c195bc9b4dbd7f2b87 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:07:03.563799 25803 consensus_queue.cc:1048] T ff75a1d4cb1f493db8f71ddc136ba9ab P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:07:03.565804 19554 raft_consensus.cc:3060] T 86a6797bdfe94fa496c050ceae4bd0d9 P e61c3a8f61bb48f8a963c9480e53c168 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:07:03.537710 25832 raft_consensus.cc:515] T 48824d5acfbc485ebf8c2d944e7202de P 0473d2b2d01f4459b1e90fd12cc7840e [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:07:03.572759 25832 leader_election.cc:290] T 48824d5acfbc485ebf8c2d944e7202de P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:07:03.554514 19552 rpcz_store.cc:276] 0709 13:07:02.291062 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:02.315627 (+ 24565us) service_pool.cc:224] Handling call
0709 13:07:02.316009 (+   382us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:02.672331 (+356322us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:03.553761 (+881430us) spinlock_profiling.cc:243] Waited 329 ms on lock 0x7b5400125a54. stack: 00007f4a79de9343 00007f4a79de9240 00007f4a797781d4 00007f4a834b6304 00007f4a834b6299 00007f4a7ce71571 00007f4a7cf08e01 00007f4a7cf0783e 00007f4a81ecc419 00007f4a7b443bd4 00007f4a7b443b62 00007f4a7b443a91 00007f4a7b443a0c 00007f4a7b442cc2 00007f4a7b24348c 00007f4a7b2428c6
0709 13:07:03.553965 (+   204us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":757411200}
I20260709 13:07:03.580950 19523 leader_election.cc:304] T fa731b585f684a7fb2d106c50f143b83 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 127766fc592545a4997f7790f50f6076, e61c3a8f61bb48f8a963c9480e53c168; no voters: e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:07:03.588647 19560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa731b585f684a7fb2d106c50f143b83" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:07:03.599625 19554 raft_consensus.cc:1275] T 86a6797bdfe94fa496c050ceae4bd0d9 P e61c3a8f61bb48f8a963c9480e53c168 [term 15 FOLLOWER]: Refusing update from remote peer 0473d2b2d01f4459b1e90fd12cc7840e: Log matching property violated. Preceding OpId in replica: term: 14 index: 7. Preceding OpId from leader: term: 15 index: 8. (index mismatch)
W20260709 13:07:03.604374 25800 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 15 current term: 15 is higher.
I20260709 13:07:03.587567 25879 raft_consensus.cc:2804] T fa731b585f684a7fb2d106c50f143b83 P e61c3a8f61bb48f8a963c9480e53c168 [term 14 FOLLOWER]: Leader pre-election won for term 15
W20260709 13:07:03.615634 19452 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:03.582849 25587 raft_consensus.cc:515] T d1e5873a19244c5ebbcd38e126796ee7 P e5256d91808b47c195bc9b4dbd7f2b87 [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
W20260709 13:07:03.630898 19526 leader_election.cc:336] T 46c5bfeecc314717bffe987e6844b6d0 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257): Timed out: RequestConsensusVote RPC to 127.17.223.2:46257 timed out after 2.155s (SENT)
I20260709 13:07:03.616201 25879 raft_consensus.cc:493] T fa731b585f684a7fb2d106c50f143b83 P e61c3a8f61bb48f8a963c9480e53c168 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 127766fc592545a4997f7790f50f6076)
I20260709 13:07:03.633484 25879 raft_consensus.cc:3060] T fa731b585f684a7fb2d106c50f143b83 P e61c3a8f61bb48f8a963c9480e53c168 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:07:03.632578 25786 leader_election.cc:290] T 96efeaaf1057492490e9a621f37e1a2d P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 20 election: Requested vote from peers e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:07:03.663578 25376 raft_consensus.cc:493] T df751f992649444090e27965eb1af85d P 0473d2b2d01f4459b1e90fd12cc7840e [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:03.636431 25816 raft_consensus.cc:3055] T ab43d85f64114d4ebf618930e43d9ed0 P 127766fc592545a4997f7790f50f6076 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:07:03.674897 25816 raft_consensus.cc:740] T ab43d85f64114d4ebf618930e43d9ed0 P 127766fc592545a4997f7790f50f6076 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 127766fc592545a4997f7790f50f6076, State: Running, Role: LEADER
I20260709 13:07:03.676100 25816 consensus_queue.cc:260] T ab43d85f64114d4ebf618930e43d9ed0 P 127766fc592545a4997f7790f50f6076 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 19.13, Last appended by leader: 13, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:07:03.677495 25816 raft_consensus.cc:3060] T ab43d85f64114d4ebf618930e43d9ed0 P 127766fc592545a4997f7790f50f6076 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:07:03.682412 25376 raft_consensus.cc:515] T df751f992649444090e27965eb1af85d P 0473d2b2d01f4459b1e90fd12cc7840e [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:07:03.683537 25881 raft_consensus.cc:493] T fa8650e71aa14778b3d73721fc50d9fc P e61c3a8f61bb48f8a963c9480e53c168 [term 18 FOLLOWER]: Starting leader election (detected failure of leader e5256d91808b47c195bc9b4dbd7f2b87)
I20260709 13:07:03.684019 25881 raft_consensus.cc:3060] T fa8650e71aa14778b3d73721fc50d9fc P e61c3a8f61bb48f8a963c9480e53c168 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:07:03.684346 19559 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40438 (request call id 3075) took 1088 ms. Trace:
I20260709 13:07:03.673246 25812 consensus_queue.cc:1059] T 0cdf56e38bbc453d9438d359e5a69955 P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 }, Status: INVALID_TERM, Last received: 16.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:07:03.506745 18300 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:07:03.685750 25857 raft_consensus.cc:3055] T 0cdf56e38bbc453d9438d359e5a69955 P e5256d91808b47c195bc9b4dbd7f2b87 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:07:03.686189 25857 raft_consensus.cc:740] T 0cdf56e38bbc453d9438d359e5a69955 P e5256d91808b47c195bc9b4dbd7f2b87 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: e5256d91808b47c195bc9b4dbd7f2b87, State: Running, Role: LEADER
I20260709 13:07:03.686889 19478 raft_consensus.cc:3060] T 40e1e16737a842ee936002830f36882e P 0473d2b2d01f4459b1e90fd12cc7840e [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:07:03.687009 25857 consensus_queue.cc:260] T 0cdf56e38bbc453d9438d359e5a69955 P e5256d91808b47c195bc9b4dbd7f2b87 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.11, Last appended by leader: 11, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:07:03.684737 19559 rpcz_store.cc:276] 0709 13:07:02.596284 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:02.596624 (+   340us) service_pool.cc:224] Handling call
0709 13:07:03.684137 (+1087513us) spinlock_profiling.cc:243] Waited 851 ms on lock 0x7b54003bae54. stack: 00007f4a79de9343 00007f4a79de9240 00007f4a797781d4 00007f4a834b6304 00007f4a834b6299 00007f4a7ce71571 00007f4a7cf0c2fa 00007f4a81ecdb17 00007f4a7b4486d4 00007f4a7b448662 00007f4a7b448591 00007f4a7b44850c 00007f4a7b4477c2 00007f4a7b24348c 00007f4a7b2428c6 00007f4a7b24226f
0709 13:07:03.684261 (+   124us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1957624064}
I20260709 13:07:03.688162 25857 raft_consensus.cc:3060] T 0cdf56e38bbc453d9438d359e5a69955 P e5256d91808b47c195bc9b4dbd7f2b87 [term 17 FOLLOWER]: Advancing to term 18
W20260709 13:07:03.691358 19374 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:03.695086 20103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "775c229504194560ba9589bc2199b089" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076"
I20260709 13:07:03.696408 20106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4af19371ea874c09a0a2147040835cbb" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076"
I20260709 13:07:03.696954 20106 raft_consensus.cc:3060] T 4af19371ea874c09a0a2147040835cbb P 127766fc592545a4997f7790f50f6076 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:03.700678 25857 raft_consensus.cc:493] T fa731b585f684a7fb2d106c50f143b83 P e5256d91808b47c195bc9b4dbd7f2b87 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:03.701346 25857 raft_consensus.cc:515] T fa731b585f684a7fb2d106c50f143b83 P e5256d91808b47c195bc9b4dbd7f2b87 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:07:03.705801 25685 raft_consensus.cc:493] T 85c494af21f9457a85da47b9bc70c1fd P e5256d91808b47c195bc9b4dbd7f2b87 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader e61c3a8f61bb48f8a963c9480e53c168)
I20260709 13:07:03.706423 19404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "179fd671030940b4b4a4e24bcc4aba0a" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:07:03.707173 19411 raft_consensus.cc:1240] T 86a6797bdfe94fa496c050ceae4bd0d9 P e5256d91808b47c195bc9b4dbd7f2b87 [term 15 FOLLOWER]: Rejecting Update request from peer e61c3a8f61bb48f8a963c9480e53c168 for earlier term 14. Current term is 15. Ops: []
I20260709 13:07:03.706269 25685 raft_consensus.cc:515] T 85c494af21f9457a85da47b9bc70c1fd P e5256d91808b47c195bc9b4dbd7f2b87 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:07:03.708338 19402 raft_consensus.cc:1240] T 775c229504194560ba9589bc2199b089 P e5256d91808b47c195bc9b4dbd7f2b87 [term 14 FOLLOWER]: Rejecting Update request from peer 127766fc592545a4997f7790f50f6076 for earlier term 13. Current term is 14. Ops: []
I20260709 13:07:03.708882 19405 raft_consensus.cc:1275] T 1a61655d99124a29b486ba4a5b37faea P e5256d91808b47c195bc9b4dbd7f2b87 [term 17 FOLLOWER]: Refusing update from remote peer e61c3a8f61bb48f8a963c9480e53c168: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 13:07:03.709659 19402 raft_consensus.cc:1275] T 70797e5783b5454ab0d0eea663e791e3 P e5256d91808b47c195bc9b4dbd7f2b87 [term 21 FOLLOWER]: Refusing update from remote peer 127766fc592545a4997f7790f50f6076: Log matching property violated. Preceding OpId in replica: term: 20 index: 14. Preceding OpId from leader: term: 21 index: 15. (index mismatch)
I20260709 13:07:03.712637 19477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22196caba61445d3bec98a0aab3c337d" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 19 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:07:03.700776 25829 raft_consensus.cc:493] T 7f575b143b844aa096b50997dad3516a P e5256d91808b47c195bc9b4dbd7f2b87 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:03.713841 19477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e5873a19244c5ebbcd38e126796ee7" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 22 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:07:03.717919 19477 raft_consensus.cc:3060] T d1e5873a19244c5ebbcd38e126796ee7 P 0473d2b2d01f4459b1e90fd12cc7840e [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:07:03.718927 19374 leader_election.cc:304] T 775c229504194560ba9589bc2199b089 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, 127766fc592545a4997f7790f50f6076
I20260709 13:07:03.719020 19406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46c5bfeecc314717bffe987e6844b6d0" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 25 candidate_status { last_received { term: 23 index: 12 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:07:03.723229 19406 raft_consensus.cc:2468] T 46c5bfeecc314717bffe987e6844b6d0 P e5256d91808b47c195bc9b4dbd7f2b87 [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 24.
I20260709 13:07:03.716497 19411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa731b585f684a7fb2d106c50f143b83" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:07:03.724052 19409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cdf56e38bbc453d9438d359e5a69955" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
I20260709 13:07:03.724256 19411 raft_consensus.cc:2468] T fa731b585f684a7fb2d106c50f143b83 P e5256d91808b47c195bc9b4dbd7f2b87 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 127766fc592545a4997f7790f50f6076 in term 15.
I20260709 13:07:03.718873 19483 raft_consensus.cc:1275] T edd7d470b5014c9489be7f41f64355c9 P 0473d2b2d01f4459b1e90fd12cc7840e [term 22 FOLLOWER]: Refusing update from remote peer e5256d91808b47c195bc9b4dbd7f2b87: Log matching property violated. Preceding OpId in replica: term: 20 index: 11. Preceding OpId from leader: term: 22 index: 12. (index mismatch)
I20260709 13:07:03.724870 20103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e1085d23e8347fbbd5bce7542f4b1f4" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:07:03.725560 20103 raft_consensus.cc:2468] T 0e1085d23e8347fbbd5bce7542f4b1f4 P 127766fc592545a4997f7790f50f6076 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 14.
I20260709 13:07:03.731688 20106 raft_consensus.cc:2468] T 4af19371ea874c09a0a2147040835cbb P 127766fc592545a4997f7790f50f6076 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 10.
I20260709 13:07:03.721273 19481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4509b76741dc428e9201c70c1658da13" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:07:03.725843 19557 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40428 (request call id 3247) took 1445 ms. Trace:
I20260709 13:07:03.738458 19557 rpcz_store.cc:276] 0709 13:07:02.280663 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:02.301482 (+ 20819us) service_pool.cc:224] Handling call
0709 13:07:02.301761 (+   279us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:02.574405 (+272644us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:03.725636 (+1151231us) spinlock_profiling.cc:243] Waited 203 ms on lock 0x7b54000f00d4. stack: 00007f4a79de9343 00007f4a79de9240 00007f4a797781d4 00007f4a834b6304 00007f4a834b6299 00007f4a7ce71571 00007f4a7cf08e01 00007f4a7cf0783e 00007f4a81ecc419 00007f4a7b443bd4 00007f4a7b443b62 00007f4a7b443a91 00007f4a7b443a0c 00007f4a7b442cc2 00007f4a7b24348c 00007f4a7b2428c6
0709 13:07:03.725790 (+   154us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":466391296}
I20260709 13:07:03.741281 19479 raft_consensus.cc:1275] T 217b5fae677b4971b3bbd2f357a1f7ff P 0473d2b2d01f4459b1e90fd12cc7840e [term 15 FOLLOWER]: Refusing update from remote peer e5256d91808b47c195bc9b4dbd7f2b87: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 15 index: 9. (term mismatch)
I20260709 13:07:03.741828 19479 pending_rounds.cc:85] T 217b5fae677b4971b3bbd2f357a1f7ff P 0473d2b2d01f4459b1e90fd12cc7840e: Aborting all ops after (but not including) 8
I20260709 13:07:03.742131 19479 pending_rounds.cc:107] T 217b5fae677b4971b3bbd2f357a1f7ff P 0473d2b2d01f4459b1e90fd12cc7840e: Aborting uncommitted NO_OP operation due to leader change: 14.9
I20260709 13:07:03.742416 19479 raft_consensus.cc:2889] T 217b5fae677b4971b3bbd2f357a1f7ff P 0473d2b2d01f4459b1e90fd12cc7840e [term 15 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:07:03.748126 20106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14935b3ddf914369822e4a0547aaa355" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:07:03.754215 19477 raft_consensus.cc:2468] T d1e5873a19244c5ebbcd38e126796ee7 P 0473d2b2d01f4459b1e90fd12cc7840e [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 22.
I20260709 13:07:03.682507 25587 leader_election.cc:290] T d1e5873a19244c5ebbcd38e126796ee7 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 22 election: Requested vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:07:03.715104 25376 leader_election.cc:290] T df751f992649444090e27965eb1af85d P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:07:03.756675 19377 leader_election.cc:304] T d1e5873a19244c5ebbcd38e126796ee7 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87; no voters: 
I20260709 13:07:03.763295 25705 consensus_queue.cc:1048] T edd7d470b5014c9489be7f41f64355c9 P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.002s
I20260709 13:07:03.767504 25857 leader_election.cc:290] T fa731b585f684a7fb2d106c50f143b83 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:07:03.757270 20109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14efcc79969f41babe5529c22d59156d" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:07:03.781631 25813 raft_consensus.cc:493] T b08304a0a02b42d7840c4e8ee9a6bd1a P e5256d91808b47c195bc9b4dbd7f2b87 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 0473d2b2d01f4459b1e90fd12cc7840e)
I20260709 13:07:03.750052 19523 leader_election.cc:304] T 0e1085d23e8347fbbd5bce7542f4b1f4 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 127766fc592545a4997f7790f50f6076, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:07:03.766861 25812 raft_consensus.cc:2749] T 775c229504194560ba9589bc2199b089 P e5256d91808b47c195bc9b4dbd7f2b87 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:07:03.782807 25587 raft_consensus.cc:2804] T d1e5873a19244c5ebbcd38e126796ee7 P e5256d91808b47c195bc9b4dbd7f2b87 [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:07:03.782697 25678 raft_consensus.cc:2804] T 0e1085d23e8347fbbd5bce7542f4b1f4 P e61c3a8f61bb48f8a963c9480e53c168 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:07:03.783442 25587 raft_consensus.cc:697] T d1e5873a19244c5ebbcd38e126796ee7 P e5256d91808b47c195bc9b4dbd7f2b87 [term 22 LEADER]: Becoming Leader. State: Replica: e5256d91808b47c195bc9b4dbd7f2b87, State: Running, Role: LEADER
I20260709 13:07:03.783638 25678 raft_consensus.cc:493] T 0e1085d23e8347fbbd5bce7542f4b1f4 P e61c3a8f61bb48f8a963c9480e53c168 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:03.784070 25678 raft_consensus.cc:3060] T 0e1085d23e8347fbbd5bce7542f4b1f4 P e61c3a8f61bb48f8a963c9480e53c168 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:07:03.784423 25587 consensus_queue.cc:237] T d1e5873a19244c5ebbcd38e126796ee7 P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 20.10, Last appended by leader: 10, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:07:03.788372 19409 raft_consensus.cc:2468] T 0cdf56e38bbc453d9438d359e5a69955 P e5256d91808b47c195bc9b4dbd7f2b87 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 18.
W20260709 13:07:03.789515 19526 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:03.789422 19478 raft_consensus.cc:1275] T 40e1e16737a842ee936002830f36882e P 0473d2b2d01f4459b1e90fd12cc7840e [term 20 FOLLOWER]: Refusing update from remote peer e61c3a8f61bb48f8a963c9480e53c168: Log matching property violated. Preceding OpId in replica: term: 19 index: 11. Preceding OpId from leader: term: 20 index: 11. (term mismatch)
I20260709 13:07:03.790584 19478 pending_rounds.cc:85] T 40e1e16737a842ee936002830f36882e P 0473d2b2d01f4459b1e90fd12cc7840e: Aborting all ops after (but not including) 10
I20260709 13:07:03.756953 19477 raft_consensus.cc:1240] T a08760e15aac4630a629431f56024dc8 P 0473d2b2d01f4459b1e90fd12cc7840e [term 22 FOLLOWER]: Rejecting Update request from peer e5256d91808b47c195bc9b4dbd7f2b87 for earlier term 21. Current term is 22. Ops: []
I20260709 13:07:03.791657 19478 pending_rounds.cc:107] T 40e1e16737a842ee936002830f36882e P 0473d2b2d01f4459b1e90fd12cc7840e: Aborting uncommitted NO_OP operation due to leader change: 19.11
I20260709 13:07:03.791989 19478 raft_consensus.cc:2889] T 40e1e16737a842ee936002830f36882e P 0473d2b2d01f4459b1e90fd12cc7840e [term 20 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:07:03.721973 25829 raft_consensus.cc:515] T 7f575b143b844aa096b50997dad3516a P e5256d91808b47c195bc9b4dbd7f2b87 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:07:03.726226 25763 raft_consensus.cc:515] T 62c6c134d3d24a1ab144dd9ee6bc3f64 P 0473d2b2d01f4459b1e90fd12cc7840e [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:07:03.767623 25819 raft_consensus.cc:493] T 76cb037fc9064d13b59a8969d897ce8c P e5256d91808b47c195bc9b4dbd7f2b87 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:03.782246 25813 raft_consensus.cc:515] T b08304a0a02b42d7840c4e8ee9a6bd1a P e5256d91808b47c195bc9b4dbd7f2b87 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:07:03.787155 25879 raft_consensus.cc:515] T fa731b585f684a7fb2d106c50f143b83 P e61c3a8f61bb48f8a963c9480e53c168 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:07:03.846817 19409 raft_consensus.cc:1240] T f1b10566f45d4a7d9029858330e02d5b P e5256d91808b47c195bc9b4dbd7f2b87 [term 18 FOLLOWER]: Rejecting Update request from peer e61c3a8f61bb48f8a963c9480e53c168 for earlier term 17. Current term is 18. Ops: []
I20260709 13:07:03.847293 19555 raft_consensus.cc:2468] T f93ee515a9c14139bf566522ed8232f3 P e61c3a8f61bb48f8a963c9480e53c168 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 22.
I20260709 13:07:03.823436 25685 leader_election.cc:290] T 85c494af21f9457a85da47b9bc70c1fd P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:07:03.819509 25598 consensus_queue.cc:1059] T a08760e15aac4630a629431f56024dc8 P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 }, Status: INVALID_TERM, Last received: 21.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.055s
I20260709 13:07:03.809099 25819 raft_consensus.cc:515] T 76cb037fc9064d13b59a8969d897ce8c P e5256d91808b47c195bc9b4dbd7f2b87 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:07:03.880228 19374 leader_election.cc:304] T 14efcc79969f41babe5529c22d59156d P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, 127766fc592545a4997f7790f50f6076
I20260709 13:07:03.866803 25827 raft_consensus.cc:493] T 7be9efa6559648dbb5a0f7684c4542d1 P e61c3a8f61bb48f8a963c9480e53c168 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:03.891765 25827 raft_consensus.cc:515] T 7be9efa6559648dbb5a0f7684c4542d1 P e61c3a8f61bb48f8a963c9480e53c168 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } attrs { replace: true } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:07:03.865625 25754 raft_consensus.cc:493] T 2725d2c4cb054f18b0fc8f735c15f6c2 P e61c3a8f61bb48f8a963c9480e53c168 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 0473d2b2d01f4459b1e90fd12cc7840e)
I20260709 13:07:03.895291 25754 raft_consensus.cc:515] T 2725d2c4cb054f18b0fc8f735c15f6c2 P e61c3a8f61bb48f8a963c9480e53c168 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:07:03.899746 19478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2725d2c4cb054f18b0fc8f735c15f6c2" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:07:03.901147 19409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7be9efa6559648dbb5a0f7684c4542d1" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 20 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:07:03.901530 19411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2725d2c4cb054f18b0fc8f735c15f6c2" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:07:03.901770 25754 leader_election.cc:290] T 2725d2c4cb054f18b0fc8f735c15f6c2 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:07:03.901777 19409 raft_consensus.cc:2468] T 7be9efa6559648dbb5a0f7684c4542d1 P e5256d91808b47c195bc9b4dbd7f2b87 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 19.
I20260709 13:07:03.877746 19560 raft_consensus.cc:2468] T fa731b585f684a7fb2d106c50f143b83 P e61c3a8f61bb48f8a963c9480e53c168 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 127766fc592545a4997f7790f50f6076 in term 15.
W20260709 13:07:03.889266 20077 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:03.915194 19478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f575b143b844aa096b50997dad3516a" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:07:03.916050 19478 raft_consensus.cc:2468] T 7f575b143b844aa096b50997dad3516a P 0473d2b2d01f4459b1e90fd12cc7840e [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 15.
I20260709 13:07:03.919216 20109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa731b585f684a7fb2d106c50f143b83" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:07:03.909677 25685 raft_consensus.cc:2749] T 14efcc79969f41babe5529c22d59156d P e5256d91808b47c195bc9b4dbd7f2b87 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:07:03.922120 20106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85c494af21f9457a85da47b9bc70c1fd" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
W20260709 13:07:03.922703 25898 log.cc:927] Time spent T bc225c93219c45538b53a1bd3d387e4d P 0473d2b2d01f4459b1e90fd12cc7840e: Append to log took a long time: real 0.102s	user 0.000s	sys 0.000s
I20260709 13:07:03.922108 25815 raft_consensus.cc:493] T 1efebf73c86e432baa55533136b6e12c P 127766fc592545a4997f7790f50f6076 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 0473d2b2d01f4459b1e90fd12cc7840e)
W20260709 13:07:03.923491 25894 log.cc:927] Time spent T 217b5fae677b4971b3bbd2f357a1f7ff P e5256d91808b47c195bc9b4dbd7f2b87: Append to log took a long time: real 0.133s	user 0.001s	sys 0.000s
I20260709 13:07:03.923894 25815 raft_consensus.cc:515] T 1efebf73c86e432baa55533136b6e12c P 127766fc592545a4997f7790f50f6076 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:07:03.926151 25815 leader_election.cc:290] T 1efebf73c86e432baa55533136b6e12c P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
W20260709 13:07:03.926909 25873 log.cc:927] Time spent T 70797e5783b5454ab0d0eea663e791e3 P 127766fc592545a4997f7790f50f6076: Append to log took a long time: real 0.638s	user 0.004s	sys 0.000s
W20260709 13:07:03.917070 25897 log.cc:927] Time spent T 4509b76741dc428e9201c70c1658da13 P 0473d2b2d01f4459b1e90fd12cc7840e: Append to log took a long time: real 0.073s	user 0.000s	sys 0.001s
I20260709 13:07:03.946100 19552 raft_consensus.cc:1240] T ab43d85f64114d4ebf618930e43d9ed0 P e61c3a8f61bb48f8a963c9480e53c168 [term 20 FOLLOWER]: Rejecting Update request from peer 127766fc592545a4997f7790f50f6076 for earlier term 19. Current term is 20. Ops: []
I20260709 13:07:03.948385 25591 leader_election.cc:290] T bc225c93219c45538b53a1bd3d387e4d P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 16 election: Requested vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:07:03.949708 25879 leader_election.cc:290] T fa731b585f684a7fb2d106c50f143b83 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 15 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:07:03.951151 25813 leader_election.cc:290] T b08304a0a02b42d7840c4e8ee9a6bd1a P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
W20260709 13:07:03.952827 19403 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52342 (request call id 3217) took 1285 ms (client timeout 1574 ms). Trace:
W20260709 13:07:03.953210 19403 rpcz_store.cc:269] 0709 13:07:02.667496 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:02.668007 (+   511us) service_pool.cc:224] Handling call
0709 13:07:03.952683 (+1284676us) spinlock_profiling.cc:243] Waited 842 ms on lock 0x7b54000e65d4. stack: 00007f4a79de9343 00007f4a79de9240 00007f4a797781d4 00007f4a834b6304 00007f4a834b6299 00007f4a7ce71571 00007f4a7cf0c2fa 00007f4a81ecdb17 00007f4a7b4486d4 00007f4a7b448662 00007f4a7b448591 00007f4a7b44850c 00007f4a7b4477c2 00007f4a7b24348c 00007f4a7b2428c6 00007f4a7b24226f
0709 13:07:03.952777 (+    94us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1935452928}
I20260709 13:07:03.955137 25829 leader_election.cc:290] T 7f575b143b844aa096b50997dad3516a P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:07:03.958998 19480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b08304a0a02b42d7840c4e8ee9a6bd1a" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:07:03.920040 20109 raft_consensus.cc:2468] T fa731b585f684a7fb2d106c50f143b83 P 127766fc592545a4997f7790f50f6076 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 15.
I20260709 13:07:03.963277 20103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa731b585f684a7fb2d106c50f143b83" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076"
I20260709 13:07:03.964251 25827 leader_election.cc:290] T 7be9efa6559648dbb5a0f7684c4542d1 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:07:03.964792 25754 raft_consensus.cc:493] T 2a16f7501e2444fb86d4e2778e734e02 P e61c3a8f61bb48f8a963c9480e53c168 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 127766fc592545a4997f7790f50f6076)
I20260709 13:07:03.965293 25754 raft_consensus.cc:515] T 2a16f7501e2444fb86d4e2778e734e02 P e61c3a8f61bb48f8a963c9480e53c168 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:07:03.967619 19478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7be9efa6559648dbb5a0f7684c4542d1" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 20 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:07:03.968185 19478 raft_consensus.cc:2468] T 7be9efa6559648dbb5a0f7684c4542d1 P 0473d2b2d01f4459b1e90fd12cc7840e [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 19.
I20260709 13:07:03.970026 25819 leader_election.cc:290] T 76cb037fc9064d13b59a8969d897ce8c P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:07:03.971922 25093 leader_election.cc:290] T 22196caba61445d3bec98a0aab3c337d P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 19 election: Requested vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:07:03.972667 19523 leader_election.cc:304] T 46c5bfeecc314717bffe987e6844b6d0 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:07:03.973183 19377 leader_election.cc:304] T 7f575b143b844aa096b50997dad3516a P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87; no voters: 
I20260709 13:07:03.975054 25598 raft_consensus.cc:2804] T 7f575b143b844aa096b50997dad3516a P e5256d91808b47c195bc9b4dbd7f2b87 [term 15 FOLLOWER]: Leader pre-election won for term 16
W20260709 13:07:03.975231 20078 connection.cc:256] RPC call timeout handler was delayed by -1.340974048000021s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1627s for a response
I20260709 13:07:03.975492 25598 raft_consensus.cc:493] T 7f575b143b844aa096b50997dad3516a P e5256d91808b47c195bc9b4dbd7f2b87 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:03.975907 25598 raft_consensus.cc:3060] T 7f575b143b844aa096b50997dad3516a P e5256d91808b47c195bc9b4dbd7f2b87 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:07:03.976141 20078 leader_election.cc:304] T 0afb57ae58a24a01850491d69f0213dd P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 127766fc592545a4997f7790f50f6076; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:07:03.976998 19481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1efebf73c86e432baa55533136b6e12c" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
W20260709 13:07:03.978017 19377 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:03.978296 19553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e5873a19244c5ebbcd38e126796ee7" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 22 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:07:03.979463 19374 leader_election.cc:304] T fa731b585f684a7fb2d106c50f143b83 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 127766fc592545a4997f7790f50f6076, e5256d91808b47c195bc9b4dbd7f2b87; no voters: 
I20260709 13:07:03.981154 19553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85c494af21f9457a85da47b9bc70c1fd" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:07:03.982961 19403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa731b585f684a7fb2d106c50f143b83" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
I20260709 13:07:03.983767 19403 raft_consensus.cc:2393] T fa731b585f684a7fb2d106c50f143b83 P e5256d91808b47c195bc9b4dbd7f2b87 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate e61c3a8f61bb48f8a963c9480e53c168 in current term 15: Already voted for candidate e5256d91808b47c195bc9b4dbd7f2b87 in this term.
I20260709 13:07:03.985031 19523 leader_election.cc:304] T 0cdf56e38bbc453d9438d359e5a69955 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:07:03.985242 19553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b08304a0a02b42d7840c4e8ee9a6bd1a" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:07:03.985921 19553 raft_consensus.cc:2468] T b08304a0a02b42d7840c4e8ee9a6bd1a P e61c3a8f61bb48f8a963c9480e53c168 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 19.
I20260709 13:07:03.985991 20103 raft_consensus.cc:2468] T fa731b585f684a7fb2d106c50f143b83 P 127766fc592545a4997f7790f50f6076 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 15.
W20260709 13:07:03.987550 20076 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.3:36891, user_credentials={real_user=slave}} blocked reactor thread for 279524us
I20260709 13:07:03.987655 19375 leader_election.cc:304] T 85c494af21f9457a85da47b9bc70c1fd P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87; no voters: 127766fc592545a4997f7790f50f6076, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:07:03.990794 19553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76cb037fc9064d13b59a8969d897ce8c" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:07:03.991371 19478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76cb037fc9064d13b59a8969d897ce8c" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:07:03.990890 19375 leader_election.cc:304] T b08304a0a02b42d7840c4e8ee9a6bd1a P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:07:03.992154 19478 raft_consensus.cc:2468] T 76cb037fc9064d13b59a8969d897ce8c P 0473d2b2d01f4459b1e90fd12cc7840e [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 17.
I20260709 13:07:03.994478 19481 raft_consensus.cc:1240] T 62c6c134d3d24a1ab144dd9ee6bc3f64 P 0473d2b2d01f4459b1e90fd12cc7840e [term 17 FOLLOWER]: Rejecting Update request from peer 127766fc592545a4997f7790f50f6076 for earlier term 16. Current term is 17. Ops: []
I20260709 13:07:03.991583 19553 raft_consensus.cc:2468] T 76cb037fc9064d13b59a8969d897ce8c P e61c3a8f61bb48f8a963c9480e53c168 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 17.
I20260709 13:07:03.996551 19553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22196caba61445d3bec98a0aab3c337d" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 19 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:07:03.975075 25705 raft_consensus.cc:3055] T a08760e15aac4630a629431f56024dc8 P e5256d91808b47c195bc9b4dbd7f2b87 [term 21 LEADER]: Stepping down as leader of term 21
I20260709 13:07:03.997788 19375 leader_election.cc:304] T 76cb037fc9064d13b59a8969d897ce8c P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:07:04.003976 20103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7be9efa6559648dbb5a0f7684c4542d1" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 20 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:07:04.004783 20103 raft_consensus.cc:2468] T 7be9efa6559648dbb5a0f7684c4542d1 P 127766fc592545a4997f7790f50f6076 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 19.
I20260709 13:07:04.007159 25812 raft_consensus.cc:493] T 70797e5783b5454ab0d0eea663e791e3 P e5256d91808b47c195bc9b4dbd7f2b87 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:04.007718 25812 raft_consensus.cc:515] T 70797e5783b5454ab0d0eea663e791e3 P e5256d91808b47c195bc9b4dbd7f2b87 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:07:04.010733 25854 raft_consensus.cc:2804] T 76cb037fc9064d13b59a8969d897ce8c P e5256d91808b47c195bc9b4dbd7f2b87 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:07:04.000279 25705 raft_consensus.cc:740] T a08760e15aac4630a629431f56024dc8 P e5256d91808b47c195bc9b4dbd7f2b87 [term 21 LEADER]: Becoming Follower/Learner. State: Replica: e5256d91808b47c195bc9b4dbd7f2b87, State: Running, Role: LEADER
I20260709 13:07:04.011168 25854 raft_consensus.cc:493] T 76cb037fc9064d13b59a8969d897ce8c P e5256d91808b47c195bc9b4dbd7f2b87 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:04.011574 25854 raft_consensus.cc:3060] T 76cb037fc9064d13b59a8969d897ce8c P e5256d91808b47c195bc9b4dbd7f2b87 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:07:04.011929 19553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f575b143b844aa096b50997dad3516a" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
W20260709 13:07:04.013198 19451 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:04.014573 19553 raft_consensus.cc:2468] T 7f575b143b844aa096b50997dad3516a P e61c3a8f61bb48f8a963c9480e53c168 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 14.
I20260709 13:07:04.015817 25754 leader_election.cc:290] T 2a16f7501e2444fb86d4e2778e734e02 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:07:04.015969 25553 consensus_queue.cc:1059] T f1b10566f45d4a7d9029858330e02d5b P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 }, Status: INVALID_TERM, Last received: 17.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:07:04.017022 25553 raft_consensus.cc:3055] T f1b10566f45d4a7d9029858330e02d5b P e61c3a8f61bb48f8a963c9480e53c168 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:07:04.017354 25553 raft_consensus.cc:740] T f1b10566f45d4a7d9029858330e02d5b P e61c3a8f61bb48f8a963c9480e53c168 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: e61c3a8f61bb48f8a963c9480e53c168, State: Running, Role: LEADER
I20260709 13:07:03.997203 25859 raft_consensus.cc:515] T 179fd671030940b4b4a4e24bcc4aba0a P 0473d2b2d01f4459b1e90fd12cc7840e [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:07:04.018712 25865 raft_consensus.cc:2804] T 0cdf56e38bbc453d9438d359e5a69955 P e61c3a8f61bb48f8a963c9480e53c168 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:07:04.019351 25865 raft_consensus.cc:697] T 0cdf56e38bbc453d9438d359e5a69955 P e61c3a8f61bb48f8a963c9480e53c168 [term 18 LEADER]: Becoming Leader. State: Replica: e61c3a8f61bb48f8a963c9480e53c168, State: Running, Role: LEADER
I20260709 13:07:04.018118 25553 consensus_queue.cc:260] T f1b10566f45d4a7d9029858330e02d5b P e61c3a8f61bb48f8a963c9480e53c168 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.11, Last appended by leader: 11, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:07:04.020480 25859 leader_election.cc:290] T 179fd671030940b4b4a4e24bcc4aba0a P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 21 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:07:03.993956 25304 raft_consensus.cc:2804] T fa731b585f684a7fb2d106c50f143b83 P e5256d91808b47c195bc9b4dbd7f2b87 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:07:04.021097 25304 raft_consensus.cc:493] T fa731b585f684a7fb2d106c50f143b83 P e5256d91808b47c195bc9b4dbd7f2b87 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:04.021479 25304 raft_consensus.cc:3060] T fa731b585f684a7fb2d106c50f143b83 P e5256d91808b47c195bc9b4dbd7f2b87 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:07:04.022490 25905 raft_consensus.cc:493] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P 127766fc592545a4997f7790f50f6076 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:04.023000 25905 raft_consensus.cc:515] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P 127766fc592545a4997f7790f50f6076 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:07:04.020437 25553 raft_consensus.cc:3060] T f1b10566f45d4a7d9029858330e02d5b P e61c3a8f61bb48f8a963c9480e53c168 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:07:04.025154 25905 leader_election.cc:290] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:07:04.028473 19551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4509b76741dc428e9201c70c1658da13" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:07:04.029340 25304 raft_consensus.cc:515] T fa731b585f684a7fb2d106c50f143b83 P e5256d91808b47c195bc9b4dbd7f2b87 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:07:03.993916 25813 raft_consensus.cc:2749] T 85c494af21f9457a85da47b9bc70c1fd P e5256d91808b47c195bc9b4dbd7f2b87 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 13:07:04.033989 20075 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.1:40321, user_credentials={real_user=slave}} blocked reactor thread for 325049us
I20260709 13:07:04.035481 19409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36f6ba92b9ba46babe4ebd6c02e5fbd9" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 21 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:07:04.035761 19551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70797e5783b5454ab0d0eea663e791e3" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 22 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:07:03.998394 25827 raft_consensus.cc:2804] T 46c5bfeecc314717bffe987e6844b6d0 P e61c3a8f61bb48f8a963c9480e53c168 [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 13:07:04.037109 19375 leader_election.cc:304] T 22196caba61445d3bec98a0aab3c337d P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:07:04.036285 19551 raft_consensus.cc:2468] T 70797e5783b5454ab0d0eea663e791e3 P e61c3a8f61bb48f8a963c9480e53c168 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 21.
W20260709 13:07:04.037948 20075 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:04.000068 25093 raft_consensus.cc:2804] T b08304a0a02b42d7840c4e8ee9a6bd1a P e5256d91808b47c195bc9b4dbd7f2b87 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:07:04.041706 19408 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52342 (request call id 3212) took 1414 ms. Trace:
I20260709 13:07:04.050066 19408 rpcz_store.cc:276] 0709 13:07:02.627161 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:02.627325 (+   164us) service_pool.cc:224] Handling call
0709 13:07:02.653250 (+ 25925us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:03.195809 (+542559us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:04.041467 (+845658us) spinlock_profiling.cc:243] Waited 541 ms on lock 0x7b540023a854. stack: 00007f4a79de9343 00007f4a79de9240 00007f4a797781d4 00007f4a834b6304 00007f4a834b6299 00007f4a7ce71571 00007f4a7cf08e01 00007f4a7cf0783e 00007f4a81ecc419 00007f4a7b443bd4 00007f4a7b443b62 00007f4a7b443a91 00007f4a7b443a0c 00007f4a7b442cc2 00007f4a7b24348c 00007f4a7b2428c6
0709 13:07:04.041634 (+   167us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1244290432}
I20260709 13:07:04.050734 19375 leader_election.cc:304] T 4509b76741dc428e9201c70c1658da13 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:07:04.052673 19375 leader_election.cc:304] T 70797e5783b5454ab0d0eea663e791e3 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:07:03.994640 25879 consensus_queue.cc:1048] T 1a61655d99124a29b486ba4a5b37faea P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 8, Time since last communication: 0.043s
I20260709 13:07:04.059237 25803 raft_consensus.cc:2804] T 70797e5783b5454ab0d0eea663e791e3 P e5256d91808b47c195bc9b4dbd7f2b87 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:07:04.065219 19526 leader_election.cc:304] T 1efebf73c86e432baa55533136b6e12c P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e61c3a8f61bb48f8a963c9480e53c168; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, 127766fc592545a4997f7790f50f6076
I20260709 13:07:04.042373 25827 raft_consensus.cc:493] T 46c5bfeecc314717bffe987e6844b6d0 P e61c3a8f61bb48f8a963c9480e53c168 [term 24 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:04.085588 25827 raft_consensus.cc:3060] T 46c5bfeecc314717bffe987e6844b6d0 P e61c3a8f61bb48f8a963c9480e53c168 [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:07:04.020426 25865 consensus_queue.cc:237] T 0cdf56e38bbc453d9438d359e5a69955 P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.11, Last appended by leader: 11, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:07:04.088313 19406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff9b0eddd810459b82d91c60777c10eb" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:07:04.088946 19406 raft_consensus.cc:2468] T ff9b0eddd810459b82d91c60777c10eb P e5256d91808b47c195bc9b4dbd7f2b87 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 17.
I20260709 13:07:04.054833 25685 raft_consensus.cc:2749] T 22196caba61445d3bec98a0aab3c337d P e5256d91808b47c195bc9b4dbd7f2b87 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:07:04.090782 25905 raft_consensus.cc:2749] T 0afb57ae58a24a01850491d69f0213dd P 127766fc592545a4997f7790f50f6076 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:07:04.091538 19411 raft_consensus.cc:1240] T 22196caba61445d3bec98a0aab3c337d P e5256d91808b47c195bc9b4dbd7f2b87 [term 19 FOLLOWER]: Rejecting Update request from peer 0473d2b2d01f4459b1e90fd12cc7840e for earlier term 18. Current term is 19. Ops: []
I20260709 13:07:04.091632 25905 consensus_queue.cc:1048] T 48824d5acfbc485ebf8c2d944e7202de P 127766fc592545a4997f7790f50f6076 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 13:07:04.093482 25598 raft_consensus.cc:515] T 7f575b143b844aa096b50997dad3516a P e5256d91808b47c195bc9b4dbd7f2b87 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:07:04.095271 25827 raft_consensus.cc:515] T 46c5bfeecc314717bffe987e6844b6d0 P e61c3a8f61bb48f8a963c9480e53c168 [term 25 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:07:04.098510 25827 leader_election.cc:290] T 46c5bfeecc314717bffe987e6844b6d0 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 25 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:07:04.099478 25304 leader_election.cc:290] T fa731b585f684a7fb2d106c50f143b83 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 16 election: Requested vote from peers e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:07:04.049960 25093 raft_consensus.cc:493] T b08304a0a02b42d7840c4e8ee9a6bd1a P e5256d91808b47c195bc9b4dbd7f2b87 [term 19 FOLLOWER]: Starting leader election (detected failure of leader 0473d2b2d01f4459b1e90fd12cc7840e)
I20260709 13:07:04.104444 19552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa731b585f684a7fb2d106c50f143b83" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:07:04.076215 19404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ec1c4ce15e04c7e8c283a62179f2a64" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:07:04.106204 19404 raft_consensus.cc:2468] T 5ec1c4ce15e04c7e8c283a62179f2a64 P e5256d91808b47c195bc9b4dbd7f2b87 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 12.
I20260709 13:07:04.076503 19405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "179fd671030940b4b4a4e24bcc4aba0a" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:07:04.000756 25881 raft_consensus.cc:515] T fa8650e71aa14778b3d73721fc50d9fc P e61c3a8f61bb48f8a963c9480e53c168 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:07:04.115255 19551 raft_consensus.cc:1275] T 4af19371ea874c09a0a2147040835cbb P e61c3a8f61bb48f8a963c9480e53c168 [term 10 FOLLOWER]: Refusing update from remote peer e5256d91808b47c195bc9b4dbd7f2b87: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:07:04.106880 19526 leader_election.cc:304] T 179fd671030940b4b4a4e24bcc4aba0a P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168; no voters: e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:07:04.113595 20103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa731b585f684a7fb2d106c50f143b83" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076"
I20260709 13:07:04.033527 25678 raft_consensus.cc:515] T 0e1085d23e8347fbbd5bce7542f4b1f4 P e61c3a8f61bb48f8a963c9480e53c168 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:07:04.119877 19404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9962423cb4e54fcfa5de01daf68a86e7" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:07:04.133288 19526 leader_election.cc:304] T 14935b3ddf914369822e4a0547aaa355 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168; no voters: 127766fc592545a4997f7790f50f6076
I20260709 13:07:04.130716 20103 raft_consensus.cc:3060] T fa731b585f684a7fb2d106c50f143b83 P 127766fc592545a4997f7790f50f6076 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:07:04.114920 25827 raft_consensus.cc:2749] T 1efebf73c86e432baa55533136b6e12c P e61c3a8f61bb48f8a963c9480e53c168 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:07:04.135367 25827 raft_consensus.cc:2804] T 14935b3ddf914369822e4a0547aaa355 P e61c3a8f61bb48f8a963c9480e53c168 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:07:04.135601 25754 raft_consensus.cc:2804] T 179fd671030940b4b4a4e24bcc4aba0a P e61c3a8f61bb48f8a963c9480e53c168 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:07:04.135691 25827 raft_consensus.cc:493] T 14935b3ddf914369822e4a0547aaa355 P e61c3a8f61bb48f8a963c9480e53c168 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 127766fc592545a4997f7790f50f6076)
I20260709 13:07:04.116372 25591 raft_consensus.cc:493] T 3e1f505cb0f1427bbd698ac889d80821 P e5256d91808b47c195bc9b4dbd7f2b87 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader e61c3a8f61bb48f8a963c9480e53c168)
I20260709 13:07:04.136816 25591 raft_consensus.cc:515] T 3e1f505cb0f1427bbd698ac889d80821 P e5256d91808b47c195bc9b4dbd7f2b87 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:07:04.136260 25827 raft_consensus.cc:3060] T 14935b3ddf914369822e4a0547aaa355 P e61c3a8f61bb48f8a963c9480e53c168 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:07:04.139366 25904 log.cc:927] Time spent T 4af19371ea874c09a0a2147040835cbb P e5256d91808b47c195bc9b4dbd7f2b87: Append to log took a long time: real 0.078s	user 0.000s	sys 0.000s
I20260709 13:07:04.140455 19482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f575b143b844aa096b50997dad3516a" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:07:04.141017 19482 raft_consensus.cc:3060] T 7f575b143b844aa096b50997dad3516a P 0473d2b2d01f4459b1e90fd12cc7840e [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:07:04.150166 19478 raft_consensus.cc:1240] T 179fd671030940b4b4a4e24bcc4aba0a P 0473d2b2d01f4459b1e90fd12cc7840e [term 21 FOLLOWER]: Rejecting Update request from peer e5256d91808b47c195bc9b4dbd7f2b87 for earlier term 20. Current term is 21. Ops: []
I20260709 13:07:04.101030 25093 raft_consensus.cc:3060] T b08304a0a02b42d7840c4e8ee9a6bd1a P e5256d91808b47c195bc9b4dbd7f2b87 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:07:04.069270 25803 raft_consensus.cc:493] T 70797e5783b5454ab0d0eea663e791e3 P e5256d91808b47c195bc9b4dbd7f2b87 [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:04.155359 25803 raft_consensus.cc:3060] T 70797e5783b5454ab0d0eea663e791e3 P e5256d91808b47c195bc9b4dbd7f2b87 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:07:04.155431 19406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f575b143b844aa096b50997dad3516a" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:07:04.156591 19406 raft_consensus.cc:2393] T 7f575b143b844aa096b50997dad3516a P e5256d91808b47c195bc9b4dbd7f2b87 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0473d2b2d01f4459b1e90fd12cc7840e in current term 16: Already voted for candidate e5256d91808b47c195bc9b4dbd7f2b87 in this term.
I20260709 13:07:04.157684 19406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f93ee515a9c14139bf566522ed8232f3" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 22 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
I20260709 13:07:04.158375 19406 raft_consensus.cc:3060] T f93ee515a9c14139bf566522ed8232f3 P e5256d91808b47c195bc9b4dbd7f2b87 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:07:04.159047 19481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e1f505cb0f1427bbd698ac889d80821" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:07:04.134414 19526 leader_election.cc:304] T 21e14947d70440f19044d8f75c31e1f9 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168; no voters: e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:07:04.172048 19486 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39478 (request call id 1005) took 3332 ms. Trace:
I20260709 13:07:04.172554 19486 rpcz_store.cc:276] 0709 13:07:00.834833 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:00.834949 (+   116us) service_pool.cc:224] Handling call
0709 13:07:02.026769 (+1191820us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:02.420040 (+393271us) spinlock_profiling.cc:243] Waited 211 ms on lock 0x7b54000d8ca0. stack: 00007f4a79de9343 00007f4a79de9240 00007f4a797781d4 00007f4a834b6304 00007f4a834b6299 00007f4a7ce71571 00007f4a7ce7fdc0 00007f4a7cf0a1c0 00007f4a7cf0b231 00007f4a7cf07d8f 00007f4a7cf0783e 00007f4a81ecc419 00007f4a7b443bd4 00007f4a7b443b62 00007f4a7b443a91 00007f4a7b443a0c
0709 13:07:02.438404 (+ 18364us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:03.348974 (+910570us) spinlock_profiling.cc:243] Waited 113 ms on lock 0x7b54000d8ca0. stack: 00007f4a79de9343 00007f4a79de9240 00007f4a797781d4 00007f4a834b6304 00007f4a834b6299 00007f4a7ce71571 00007f4a7ce7fdc0 00007f4a7cf0ba02 00007f4a7cf07dd6 00007f4a7cf0783e 00007f4a81ecc419 00007f4a7b443bd4 00007f4a7b443b62 00007f4a7b443a91 00007f4a7b443a0c 00007f4a7b442cc2
0709 13:07:04.167326 (+818352us) spinlock_profiling.cc:243] Waited 1.17 s on lock 0x7b540029d950. stack: 00007f4a79de9343 00007f4a79de9240 00007f4a797781d4 00007f4a834b6304 00007f4a834b6299 00007f4a7ce71571 00007f4a7cf078ad 00007f4a81ecc419 00007f4a7b443bd4 00007f4a7b443b62 00007f4a7b443a91 00007f4a7b443a0c 00007f4a7b442cc2 00007f4a7b24348c 00007f4a7b2428c6 00007f4a7b24226f
0709 13:07:04.167469 (+   143us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3442747776}
I20260709 13:07:04.136130 25754 raft_consensus.cc:493] T 179fd671030940b4b4a4e24bcc4aba0a P e61c3a8f61bb48f8a963c9480e53c168 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:04.159225 25854 raft_consensus.cc:515] T 76cb037fc9064d13b59a8969d897ce8c P e5256d91808b47c195bc9b4dbd7f2b87 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:07:04.184756 25854 leader_election.cc:290] T 76cb037fc9064d13b59a8969d897ce8c P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 18 election: Requested vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:07:04.129668 25766 consensus_queue.cc:1059] T 96efeaaf1057492490e9a621f37e1a2d P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 }, Status: INVALID_TERM, Last received: 19.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.030s
I20260709 13:07:04.189036 25879 raft_consensus.cc:2804] T 21e14947d70440f19044d8f75c31e1f9 P e61c3a8f61bb48f8a963c9480e53c168 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:07:04.189625 25879 raft_consensus.cc:697] T 21e14947d70440f19044d8f75c31e1f9 P e61c3a8f61bb48f8a963c9480e53c168 [term 18 LEADER]: Becoming Leader. State: Replica: e61c3a8f61bb48f8a963c9480e53c168, State: Running, Role: LEADER
I20260709 13:07:04.190469 19409 raft_consensus.cc:1240] T 40e1e16737a842ee936002830f36882e P e5256d91808b47c195bc9b4dbd7f2b87 [term 20 FOLLOWER]: Rejecting Update request from peer 0473d2b2d01f4459b1e90fd12cc7840e for earlier term 19. Current term is 20. Ops: []
I20260709 13:07:04.160423 19478 raft_consensus.cc:1240] T a08760e15aac4630a629431f56024dc8 P 0473d2b2d01f4459b1e90fd12cc7840e [term 22 FOLLOWER]: Rejecting Update request from peer e5256d91808b47c195bc9b4dbd7f2b87 for earlier term 21. Current term is 22. Ops: []
W20260709 13:07:04.161350 20077 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:04.161443 25678 leader_election.cc:290] T 0e1085d23e8347fbbd5bce7542f4b1f4 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 15 election: Requested vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:07:04.143288 25304 consensus_queue.cc:1048] T 4af19371ea874c09a0a2147040835cbb P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.019s
W20260709 13:07:04.162518 19451 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:04.136199 25881 leader_election.cc:290] T fa8650e71aa14778b3d73721fc50d9fc P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 19 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:07:04.167831 19404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a08760e15aac4630a629431f56024dc8" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
I20260709 13:07:04.190949 19407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "179fd671030940b4b4a4e24bcc4aba0a" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
I20260709 13:07:04.197455 19482 raft_consensus.cc:2468] T 7f575b143b844aa096b50997dad3516a P 0473d2b2d01f4459b1e90fd12cc7840e [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 16.
I20260709 13:07:04.234863 19407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df751f992649444090e27965eb1af85d" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 22 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:07:04.190523 25879 consensus_queue.cc:237] T 21e14947d70440f19044d8f75c31e1f9 P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.11, Last appended by leader: 11, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:07:04.229619 25755 consensus_queue.cc:1048] T 1a61655d99124a29b486ba4a5b37faea P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:07:04.116650 25813 raft_consensus.cc:493] T ece3db938bc649d4a40a51522ed5259c P e5256d91808b47c195bc9b4dbd7f2b87 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 127766fc592545a4997f7790f50f6076)
I20260709 13:07:04.207729 20103 raft_consensus.cc:2468] T fa731b585f684a7fb2d106c50f143b83 P 127766fc592545a4997f7790f50f6076 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 16.
I20260709 13:07:04.259671 19403 raft_consensus.cc:1240] T d1e5873a19244c5ebbcd38e126796ee7 P e5256d91808b47c195bc9b4dbd7f2b87 [term 22 LEADER]: Rejecting Update request from peer e61c3a8f61bb48f8a963c9480e53c168 for earlier term 21. Current term is 22. Ops: []
I20260709 13:07:04.235715 19407 raft_consensus.cc:2468] T df751f992649444090e27965eb1af85d P e5256d91808b47c195bc9b4dbd7f2b87 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 21.
I20260709 13:07:04.190654 25812 leader_election.cc:290] T 70797e5783b5454ab0d0eea663e791e3 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
W20260709 13:07:04.257403 19450 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.3:36891, user_credentials={real_user=slave}} blocked reactor thread for 68783.6us
I20260709 13:07:04.228235 25829 raft_consensus.cc:493] T 172b3dd13109415a955b71ac0e9d2234 P e5256d91808b47c195bc9b4dbd7f2b87 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 0473d2b2d01f4459b1e90fd12cc7840e)
I20260709 13:07:04.230953 25685 raft_consensus.cc:493] T 833a2f0775ed407a94b8924ce50adb63 P e5256d91808b47c195bc9b4dbd7f2b87 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader e61c3a8f61bb48f8a963c9480e53c168)
I20260709 13:07:04.242296 19402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76cb037fc9064d13b59a8969d897ce8c" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 18 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:07:04.277884 19402 raft_consensus.cc:2393] T 76cb037fc9064d13b59a8969d897ce8c P e5256d91808b47c195bc9b4dbd7f2b87 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0473d2b2d01f4459b1e90fd12cc7840e in current term 18: Already voted for candidate e5256d91808b47c195bc9b4dbd7f2b87 in this term.
I20260709 13:07:04.191740 25754 raft_consensus.cc:3060] T 179fd671030940b4b4a4e24bcc4aba0a P e61c3a8f61bb48f8a963c9480e53c168 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:07:04.217494 25827 raft_consensus.cc:515] T 14935b3ddf914369822e4a0547aaa355 P e61c3a8f61bb48f8a963c9480e53c168 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
W20260709 13:07:04.274330 19449 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.1:40321, user_credentials={real_user=slave}} blocked reactor thread for 73009.6us
I20260709 13:07:04.233430 25591 leader_election.cc:290] T 3e1f505cb0f1427bbd698ac889d80821 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
W20260709 13:07:04.276325 19523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.4:43121, user_credentials={real_user=slave}} blocked reactor thread for 272938us
I20260709 13:07:04.255302 25857 raft_consensus.cc:2749] T 4509b76741dc428e9201c70c1658da13 P e5256d91808b47c195bc9b4dbd7f2b87 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:07:04.259352 25755 consensus_queue.cc:1243] T 1a61655d99124a29b486ba4a5b37faea P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Peer 0473d2b2d01f4459b1e90fd12cc7840e log is divergent from this leader: its last log entry 13.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 8
I20260709 13:07:04.281754 19450 leader_election.cc:304] T f93ee515a9c14139bf566522ed8232f3 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:07:04.287340 19449 leader_election.cc:304] T ff9b0eddd810459b82d91c60777c10eb P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87; no voters: 
I20260709 13:07:04.285328 19523 leader_election.cc:304] T fa731b585f684a7fb2d106c50f143b83 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 127766fc592545a4997f7790f50f6076, e61c3a8f61bb48f8a963c9480e53c168; no voters: e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:07:04.167331 25803 raft_consensus.cc:515] T 70797e5783b5454ab0d0eea663e791e3 P e5256d91808b47c195bc9b4dbd7f2b87 [term 22 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:07:04.267418 19406 raft_consensus.cc:2468] T f93ee515a9c14139bf566522ed8232f3 P e5256d91808b47c195bc9b4dbd7f2b87 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 22.
I20260709 13:07:04.253947 25678 consensus_queue.cc:1048] T 40e1e16737a842ee936002830f36882e P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.026s
I20260709 13:07:04.279284 25520 raft_consensus.cc:493] T ef32ce6fdd0e40d382c79974f30295c6 P 0473d2b2d01f4459b1e90fd12cc7840e [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:04.277720 25812 raft_consensus.cc:493] T b9f0d59553ad444883fcf5b5909f9798 P e5256d91808b47c195bc9b4dbd7f2b87 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 0473d2b2d01f4459b1e90fd12cc7840e)
I20260709 13:07:04.300235 19523 leader_election.cc:304] T 7be9efa6559648dbb5a0f7684c4542d1 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 127766fc592545a4997f7790f50f6076, e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:07:04.273689 25786 consensus_queue.cc:1048] T 0e1085d23e8347fbbd5bce7542f4b1f4 P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.027s
I20260709 13:07:04.278827 25859 raft_consensus.cc:493] T f1b10566f45d4a7d9029858330e02d5b P 0473d2b2d01f4459b1e90fd12cc7840e [term 17 FOLLOWER]: Starting pre-election (detected failure of leader e61c3a8f61bb48f8a963c9480e53c168)
I20260709 13:07:04.302167 19484 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39478 (request call id 1032) took 1859 ms. Trace:
I20260709 13:07:04.279161 25760 consensus_queue.cc:1059] T bc225c93219c45538b53a1bd3d387e4d P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.020s
W20260709 13:07:04.313848 20077 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:04.273916 25813 raft_consensus.cc:515] T ece3db938bc649d4a40a51522ed5259c P e5256d91808b47c195bc9b4dbd7f2b87 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:07:04.291527 25591 raft_consensus.cc:493] T 1a61655d99124a29b486ba4a5b37faea P e5256d91808b47c195bc9b4dbd7f2b87 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:04.287107 25805 consensus_queue.cc:1048] T 86a6797bdfe94fa496c050ceae4bd0d9 P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.019s
W20260709 13:07:04.341601 25909 log.cc:927] Time spent T ff75a1d4cb1f493db8f71ddc136ba9ab P 0473d2b2d01f4459b1e90fd12cc7840e: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
I20260709 13:07:04.351974 25831 consensus_queue.cc:1059] T 775c229504194560ba9589bc2199b089 P 127766fc592545a4997f7790f50f6076 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 }, Status: INVALID_TERM, Last received: 13.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:07:04.353698 25827 leader_election.cc:290] T 14935b3ddf914369822e4a0547aaa355 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 13 election: Requested vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:07:04.359136 25763 leader_election.cc:290] T 62c6c134d3d24a1ab144dd9ee6bc3f64 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 17 election: Requested vote from peers e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:07:04.359424 25764 raft_consensus.cc:2804] T ff9b0eddd810459b82d91c60777c10eb P 0473d2b2d01f4459b1e90fd12cc7840e [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:07:04.360005 25881 raft_consensus.cc:2804] T 7be9efa6559648dbb5a0f7684c4542d1 P e61c3a8f61bb48f8a963c9480e53c168 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:07:04.278394 25829 raft_consensus.cc:515] T 172b3dd13109415a955b71ac0e9d2234 P e5256d91808b47c195bc9b4dbd7f2b87 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:07:04.365495 20103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a16f7501e2444fb86d4e2778e734e02" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:07:04.340013 19559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa731b585f684a7fb2d106c50f143b83" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:07:04.361481 25715 raft_consensus.cc:2804] T fa731b585f684a7fb2d106c50f143b83 P e61c3a8f61bb48f8a963c9480e53c168 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:07:04.289011 25537 consensus_queue.cc:1048] T b08304a0a02b42d7840c4e8ee9a6bd1a P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.019s
I20260709 13:07:04.393123 25418 raft_consensus.cc:3055] T bc225c93219c45538b53a1bd3d387e4d P 0473d2b2d01f4459b1e90fd12cc7840e [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:07:04.300447 25376 raft_consensus.cc:2804] T f93ee515a9c14139bf566522ed8232f3 P 0473d2b2d01f4459b1e90fd12cc7840e [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:07:04.280189 25685 raft_consensus.cc:515] T 833a2f0775ed407a94b8924ce50adb63 P e5256d91808b47c195bc9b4dbd7f2b87 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:07:04.394070 25813 leader_election.cc:290] T ece3db938bc649d4a40a51522ed5259c P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:07:04.396016 25803 leader_election.cc:290] T 70797e5783b5454ab0d0eea663e791e3 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 22 election: Requested vote from peers e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:07:04.397316 25093 raft_consensus.cc:515] T b08304a0a02b42d7840c4e8ee9a6bd1a P e5256d91808b47c195bc9b4dbd7f2b87 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:07:04.307083 25812 raft_consensus.cc:515] T b9f0d59553ad444883fcf5b5909f9798 P e5256d91808b47c195bc9b4dbd7f2b87 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:07:04.303414 25520 raft_consensus.cc:515] T ef32ce6fdd0e40d382c79974f30295c6 P 0473d2b2d01f4459b1e90fd12cc7840e [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:07:04.404114 20106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14935b3ddf914369822e4a0547aaa355" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076"
I20260709 13:07:04.405866 20109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e1085d23e8347fbbd5bce7542f4b1f4" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076"
I20260709 13:07:04.535105 20109 raft_consensus.cc:3060] T 0e1085d23e8347fbbd5bce7542f4b1f4 P 127766fc592545a4997f7790f50f6076 [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:07:04.407248 20078 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.2:46257, user_credentials={real_user=slave}} blocked reactor thread for 429987us
I20260709 13:07:04.536444 20078 leader_election.cc:304] T 96efeaaf1057492490e9a621f37e1a2d P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 127766fc592545a4997f7790f50f6076; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:07:04.410352 19484 rpcz_store.cc:276] 0709 13:07:02.443494 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:02.463037 (+ 19543us) service_pool.cc:224] Handling call
0709 13:07:02.463357 (+   320us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:02.695901 (+232544us) raft_consensus.cc:1534] Early marking committed up to index 11
0709 13:07:02.769183 (+ 73282us) log.cc:844] Serialized 14 byte log entry
0709 13:07:03.270850 (+501667us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:03.270930 (+    80us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:07:03.270991 (+    61us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:04.301880 (+1030889us) spinlock_profiling.cc:243] Waited 232 ms on lock 0x7b5400111054. stack: 00007f4a79de9343 00007f4a79de9240 00007f4a797781d4 00007f4a834b6304 00007f4a834b6299 00007f4a7ce71571 00007f4a7cf08e01 00007f4a7cf0783e 00007f4a81ecc419 00007f4a7b443bd4 00007f4a7b443b62 00007f4a7b443a91 00007f4a7b443a0c 00007f4a7b442cc2 00007f4a7b24348c 00007f4a7b2428c6
0709 13:07:04.301941 (+    61us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:04.302096 (+   155us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1626,"prepare.queue_time_us":153962,"prepare.run_cpu_time_us":41,"prepare.run_wall_time_us":43,"raft.queue_time_us":1767,"raft.run_cpu_time_us":125,"raft.run_wall_time_us":9583,"spinlock_wait_cycles":534170368,"thread_start_us":552250,"threads_started":2,"wal-append.queue_time_us":584008}
W20260709 13:07:04.414327 19451 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:04.416813 20076 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.3:36891, user_credentials={real_user=slave}} blocked reactor thread for 423188us
I20260709 13:07:04.417377 19374 leader_election.cc:304] T fa731b585f684a7fb2d106c50f143b83 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 127766fc592545a4997f7790f50f6076, e5256d91808b47c195bc9b4dbd7f2b87; no voters: e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:07:04.517485 20103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70797e5783b5454ab0d0eea663e791e3" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 22 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076"
I20260709 13:07:04.518219 20110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70797e5783b5454ab0d0eea663e791e3" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 22 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:07:04.521155 20108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ece3db938bc649d4a40a51522ed5259c" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:07:04.440616 25764 raft_consensus.cc:493] T ff9b0eddd810459b82d91c60777c10eb P 0473d2b2d01f4459b1e90fd12cc7840e [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:04.440122 25881 raft_consensus.cc:493] T 7be9efa6559648dbb5a0f7684c4542d1 P e61c3a8f61bb48f8a963c9480e53c168 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:04.551512 20078 leader_election.cc:304] T 172b3dd13109415a955b71ac0e9d2234 P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 127766fc592545a4997f7790f50f6076; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87
W20260709 13:07:04.555119 19374 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.4:43121, user_credentials={real_user=slave}} blocked reactor thread for 137810us
I20260709 13:07:04.410553 25859 raft_consensus.cc:515] T f1b10566f45d4a7d9029858330e02d5b P 0473d2b2d01f4459b1e90fd12cc7840e [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:07:04.574241 19408 raft_consensus.cc:1240] T b08304a0a02b42d7840c4e8ee9a6bd1a P e5256d91808b47c195bc9b4dbd7f2b87 [term 20 FOLLOWER]: Rejecting Update request from peer 0473d2b2d01f4459b1e90fd12cc7840e for earlier term 19. Current term is 20. Ops: []
W20260709 13:07:04.547730 19377 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:04.520709 25418 raft_consensus.cc:740] T bc225c93219c45538b53a1bd3d387e4d P 0473d2b2d01f4459b1e90fd12cc7840e [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 0473d2b2d01f4459b1e90fd12cc7840e, State: Running, Role: LEADER
W20260709 13:07:04.587037 20075 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.533s	user 0.019s	sys 0.013s
I20260709 13:07:04.588403 19557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1efebf73c86e432baa55533136b6e12c" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:07:04.408735 25591 raft_consensus.cc:515] T 1a61655d99124a29b486ba4a5b37faea P e5256d91808b47c195bc9b4dbd7f2b87 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:07:04.521853 25715 raft_consensus.cc:697] T fa731b585f684a7fb2d106c50f143b83 P e61c3a8f61bb48f8a963c9480e53c168 [term 15 LEADER]: Becoming Leader. State: Replica: e61c3a8f61bb48f8a963c9480e53c168, State: Running, Role: LEADER
I20260709 13:07:04.557075 25881 raft_consensus.cc:3060] T 7be9efa6559648dbb5a0f7684c4542d1 P e61c3a8f61bb48f8a963c9480e53c168 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:07:04.550232 25764 raft_consensus.cc:3060] T ff9b0eddd810459b82d91c60777c10eb P 0473d2b2d01f4459b1e90fd12cc7840e [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:07:04.616858 19556 raft_consensus.cc:1240] T 14935b3ddf914369822e4a0547aaa355 P e61c3a8f61bb48f8a963c9480e53c168 [term 13 FOLLOWER]: Rejecting Update request from peer 127766fc592545a4997f7790f50f6076 for earlier term 12. Current term is 13. Ops: []
W20260709 13:07:04.591884 25815 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.655s	user 0.010s	sys 0.040s
W20260709 13:07:04.651006 25815 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.715s	user 0.011s	sys 0.040s
I20260709 13:07:04.651520 25591 leader_election.cc:290] T 1a61655d99124a29b486ba4a5b37faea P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:07:04.652460 25917 raft_consensus.cc:493] T 6c5eebf646ad445a9d1b1adc319d7b16 P 127766fc592545a4997f7790f50f6076 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 0473d2b2d01f4459b1e90fd12cc7840e)
I20260709 13:07:04.653079 25917 raft_consensus.cc:515] T 6c5eebf646ad445a9d1b1adc319d7b16 P 127766fc592545a4997f7790f50f6076 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:07:04.654258 25918 raft_consensus.cc:2749] T 172b3dd13109415a955b71ac0e9d2234 P 127766fc592545a4997f7790f50f6076 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:07:04.655768 25685 leader_election.cc:290] T 833a2f0775ed407a94b8924ce50adb63 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:07:04.657114 25520 leader_election.cc:290] T ef32ce6fdd0e40d382c79974f30295c6 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:07:04.658867 25093 leader_election.cc:290] T b08304a0a02b42d7840c4e8ee9a6bd1a P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 20 election: Requested vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
W20260709 13:07:04.659278 25913 log.cc:927] Time spent T 4509b76741dc428e9201c70c1658da13 P e5256d91808b47c195bc9b4dbd7f2b87: Append to log took a long time: real 0.066s	user 0.000s	sys 0.000s
I20260709 13:07:04.566262 25906 raft_consensus.cc:2749] T 96efeaaf1057492490e9a621f37e1a2d P 127766fc592545a4997f7790f50f6076 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
W20260709 13:07:04.628265 19524 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:04.632097 19557 raft_consensus.cc:2468] T 1efebf73c86e432baa55533136b6e12c P e61c3a8f61bb48f8a963c9480e53c168 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 127766fc592545a4997f7790f50f6076 in term 14.
W20260709 13:07:04.645753 19451 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:04.669986 19557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48824d5acfbc485ebf8c2d944e7202de" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 22 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:07:04.673491 19552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df751f992649444090e27965eb1af85d" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 22 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:07:04.676534 19551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62c6c134d3d24a1ab144dd9ee6bc3f64" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:07:04.541805 25376 raft_consensus.cc:697] T f93ee515a9c14139bf566522ed8232f3 P 0473d2b2d01f4459b1e90fd12cc7840e [term 22 LEADER]: Becoming Leader. State: Replica: 0473d2b2d01f4459b1e90fd12cc7840e, State: Running, Role: LEADER
I20260709 13:07:04.565567 25587 raft_consensus.cc:2804] T fa731b585f684a7fb2d106c50f143b83 P e5256d91808b47c195bc9b4dbd7f2b87 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:07:04.679759 19558 raft_consensus.cc:1240] T 40e1e16737a842ee936002830f36882e P e61c3a8f61bb48f8a963c9480e53c168 [term 20 LEADER]: Rejecting Update request from peer 0473d2b2d01f4459b1e90fd12cc7840e for earlier term 19. Current term is 20. Ops: []
W20260709 13:07:04.680485 20075 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.626s	user 0.019s	sys 0.013s
W20260709 13:07:04.686340 20075 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.1:40321, user_credentials={real_user=slave}} blocked reactor thread for 632411us
I20260709 13:07:04.687220 19556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76cb037fc9064d13b59a8969d897ce8c" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 18 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:07:04.688205 19556 raft_consensus.cc:2410] T 76cb037fc9064d13b59a8969d897ce8c P e61c3a8f61bb48f8a963c9480e53c168 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0473d2b2d01f4459b1e90fd12cc7840e for term 18 because replica has last-logged OpId of term: 16 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 8.
I20260709 13:07:04.693854 19410 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "21e14947d70440f19044d8f75c31e1f9"
dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
mode: GRACEFUL
new_leader_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
 from {username='slave'} at 127.0.0.1:37312
I20260709 13:07:04.696025 19410 raft_consensus.cc:606] T 21e14947d70440f19044d8f75c31e1f9 P e5256d91808b47c195bc9b4dbd7f2b87 [term 18 FOLLOWER]: Received request to transfer leadership to TS 0473d2b2d01f4459b1e90fd12cc7840e
I20260709 13:07:04.689636 25591 raft_consensus.cc:493] T 2a16f7501e2444fb86d4e2778e734e02 P e5256d91808b47c195bc9b4dbd7f2b87 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 127766fc592545a4997f7790f50f6076)
I20260709 13:07:04.699455 19554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc225c93219c45538b53a1bd3d387e4d" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:07:04.696453 19410 raft_consensus.cc:614] T 21e14947d70440f19044d8f75c31e1f9 P e5256d91808b47c195bc9b4dbd7f2b87 [term 18 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:07:04.681979 25766 raft_consensus.cc:493] T 86a6797bdfe94fa496c050ceae4bd0d9 P e61c3a8f61bb48f8a963c9480e53c168 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:04.688405 25813 raft_consensus.cc:493] T e381f1d6b8184797ad142de49be225a8 P e5256d91808b47c195bc9b4dbd7f2b87 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:04.696283 19526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.2:46257, user_credentials={real_user=slave}} blocked reactor thread for 504372us
I20260709 13:07:04.706310 19403 raft_consensus.cc:1275] T 1dc5b3532fe54f74876d02beffa2c230 P e5256d91808b47c195bc9b4dbd7f2b87 [term 20 FOLLOWER]: Refusing update from remote peer e61c3a8f61bb48f8a963c9480e53c168: Log matching property violated. Preceding OpId in replica: term: 19 index: 10. Preceding OpId from leader: term: 20 index: 11. (index mismatch)
I20260709 13:07:04.706213 19526 leader_election.cc:304] T 2725d2c4cb054f18b0fc8f735c15f6c2 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e61c3a8f61bb48f8a963c9480e53c168; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87
W20260709 13:07:04.704826 19449 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.1:40321, user_credentials={real_user=slave}} blocked reactor thread for 417559us
I20260709 13:07:04.713189 19449 leader_election.cc:304] T 5ec1c4ce15e04c7e8c283a62179f2a64 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87; no voters: 
I20260709 13:07:04.696909 25591 raft_consensus.cc:515] T 2a16f7501e2444fb86d4e2778e734e02 P e5256d91808b47c195bc9b4dbd7f2b87 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:07:04.716645 25715 consensus_queue.cc:237] T fa731b585f684a7fb2d106c50f143b83 P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:07:04.718606 25661 raft_consensus.cc:3060] T df751f992649444090e27965eb1af85d P e61c3a8f61bb48f8a963c9480e53c168 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:07:04.719688 25859 leader_election.cc:290] T f1b10566f45d4a7d9029858330e02d5b P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:07:04.720062 25705 consensus_queue.cc:260] T a08760e15aac4630a629431f56024dc8 P e5256d91808b47c195bc9b4dbd7f2b87 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 21.12, Last appended by leader: 12, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:07:04.710074 25813 raft_consensus.cc:515] T e381f1d6b8184797ad142de49be225a8 P e5256d91808b47c195bc9b4dbd7f2b87 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:07:04.662514 25418 consensus_queue.cc:260] T bc225c93219c45538b53a1bd3d387e4d P 0473d2b2d01f4459b1e90fd12cc7840e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:07:04.732514 20109 raft_consensus.cc:2468] T 0e1085d23e8347fbbd5bce7542f4b1f4 P 127766fc592545a4997f7790f50f6076 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 15.
I20260709 13:07:04.707518 19403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a16f7501e2444fb86d4e2778e734e02" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:07:04.745167 19449 leader_election.cc:304] T 7f575b143b844aa096b50997dad3516a P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e; no voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168
W20260709 13:07:04.733664 19450 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.3:36891, user_credentials={real_user=slave}} blocked reactor thread for 451976us
I20260709 13:07:04.711632 20075 leader_election.cc:304] T fa731b585f684a7fb2d106c50f143b83 P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 127766fc592545a4997f7790f50f6076, e5256d91808b47c195bc9b4dbd7f2b87; no voters: 
I20260709 13:07:04.737365 25829 leader_election.cc:290] T 172b3dd13109415a955b71ac0e9d2234 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:07:04.738065 25854 raft_consensus.cc:493] T ef32ce6fdd0e40d382c79974f30295c6 P e5256d91808b47c195bc9b4dbd7f2b87 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:04.747219 25418 raft_consensus.cc:3060] T bc225c93219c45538b53a1bd3d387e4d P 0473d2b2d01f4459b1e90fd12cc7840e [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:07:04.748624 19403 raft_consensus.cc:2468] T 2a16f7501e2444fb86d4e2778e734e02 P e5256d91808b47c195bc9b4dbd7f2b87 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 16.
W20260709 13:07:04.735409 25912 log.cc:927] Time spent T edd7d470b5014c9489be7f41f64355c9 P 0473d2b2d01f4459b1e90fd12cc7840e: Append to log took a long time: real 0.086s	user 0.000s	sys 0.004s
I20260709 13:07:04.735124 25755 raft_consensus.cc:2749] T 2725d2c4cb054f18b0fc8f735c15f6c2 P e61c3a8f61bb48f8a963c9480e53c168 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:07:04.760699 19449 leader_election.cc:304] T df751f992649444090e27965eb1af85d P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87; no voters: 
I20260709 13:07:04.728868 25831 consensus_queue.cc:1048] T 70797e5783b5454ab0d0eea663e791e3 P 127766fc592545a4997f7790f50f6076 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 13, Time since last communication: 0.019s
W20260709 13:07:04.773980 19526 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:04.708191 25766 raft_consensus.cc:515] T 86a6797bdfe94fa496c050ceae4bd0d9 P e61c3a8f61bb48f8a963c9480e53c168 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:07:04.786945 19411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa8650e71aa14778b3d73721fc50d9fc" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
I20260709 13:07:04.787629 19407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1b10566f45d4a7d9029858330e02d5b" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
W20260709 13:07:04.758864 25865 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.533s	user 0.014s	sys 0.012s
I20260709 13:07:04.742481 25587 raft_consensus.cc:697] T fa731b585f684a7fb2d106c50f143b83 P e5256d91808b47c195bc9b4dbd7f2b87 [term 16 LEADER]: Becoming Leader. State: Replica: e5256d91808b47c195bc9b4dbd7f2b87, State: Running, Role: LEADER
I20260709 13:07:04.755227 25906 raft_consensus.cc:2764] T fa731b585f684a7fb2d106c50f143b83 P 127766fc592545a4997f7790f50f6076 [term 16 FOLLOWER]: Leader pre-election decision vote started in defunct term 15: won
I20260709 13:07:04.755916 25859 raft_consensus.cc:2804] T 5ec1c4ce15e04c7e8c283a62179f2a64 P 0473d2b2d01f4459b1e90fd12cc7840e [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:07:04.741833 25917 leader_election.cc:290] T 6c5eebf646ad445a9d1b1adc319d7b16 P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:07:04.762548 25923 raft_consensus.cc:493] T 28af091831594f9d8e96482078cc7625 P e5256d91808b47c195bc9b4dbd7f2b87 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 0473d2b2d01f4459b1e90fd12cc7840e)
I20260709 13:07:04.789713 25805 raft_consensus.cc:2804] T df751f992649444090e27965eb1af85d P 0473d2b2d01f4459b1e90fd12cc7840e [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:07:04.769554 25520 raft_consensus.cc:2749] T 7f575b143b844aa096b50997dad3516a P 0473d2b2d01f4459b1e90fd12cc7840e [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:07:04.796080 19407 raft_consensus.cc:2393] T f1b10566f45d4a7d9029858330e02d5b P e5256d91808b47c195bc9b4dbd7f2b87 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0473d2b2d01f4459b1e90fd12cc7840e in current term 18: Already voted for candidate e5256d91808b47c195bc9b4dbd7f2b87 in this term.
I20260709 13:07:04.775875 25705 raft_consensus.cc:3060] T a08760e15aac4630a629431f56024dc8 P e5256d91808b47c195bc9b4dbd7f2b87 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:07:04.890147 25086 raft_consensus.cc:493] T bc225c93219c45538b53a1bd3d387e4d P e61c3a8f61bb48f8a963c9480e53c168 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 0473d2b2d01f4459b1e90fd12cc7840e)
W20260709 13:07:04.808060 19477 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.524s	user 0.002s	sys 0.021s
I20260709 13:07:04.829177 19411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef32ce6fdd0e40d382c79974f30295c6" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 23 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
W20260709 13:07:04.891006 19477 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.607s	user 0.002s	sys 0.021s
I20260709 13:07:04.890753 25086 raft_consensus.cc:515] T bc225c93219c45538b53a1bd3d387e4d P e61c3a8f61bb48f8a963c9480e53c168 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
W20260709 13:07:04.793805 25865 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.577s	user 0.015s	sys 0.012s
I20260709 13:07:04.798210 19450 leader_election.cc:304] T 76cb037fc9064d13b59a8969d897ce8c P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e; no voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:07:04.798305 25760 raft_consensus.cc:493] T 3e1f505cb0f1427bbd698ac889d80821 P 0473d2b2d01f4459b1e90fd12cc7840e [term 19 FOLLOWER]: Starting pre-election (detected failure of leader e61c3a8f61bb48f8a963c9480e53c168)
I20260709 13:07:04.856678 25766 leader_election.cc:290] T 86a6797bdfe94fa496c050ceae4bd0d9 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:07:04.760562 25854 raft_consensus.cc:515] T ef32ce6fdd0e40d382c79974f30295c6 P e5256d91808b47c195bc9b4dbd7f2b87 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
W20260709 13:07:04.899575 19374 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:04.900851 19452 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:04.760870 25754 raft_consensus.cc:515] T 179fd671030940b4b4a4e24bcc4aba0a P e61c3a8f61bb48f8a963c9480e53c168 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
W20260709 13:07:04.898837 19450 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.3:36891, user_credentials={real_user=slave}} blocked reactor thread for 100710us
W20260709 13:07:04.921341 20078 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.2:46257, user_credentials={real_user=slave}} blocked reactor thread for 369909us
I20260709 13:07:04.922094 20078 leader_election.cc:304] T 309c3ca0ca4b4f3ba129752ea2cb293b P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 127766fc592545a4997f7790f50f6076; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:07:04.806034 25859 raft_consensus.cc:493] T 5ec1c4ce15e04c7e8c283a62179f2a64 P 0473d2b2d01f4459b1e90fd12cc7840e [term 12 FOLLOWER]: Starting leader election (detected failure of leader 127766fc592545a4997f7790f50f6076)
I20260709 13:07:04.798252 25824 raft_consensus.cc:493] T 28af091831594f9d8e96482078cc7625 P e61c3a8f61bb48f8a963c9480e53c168 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 0473d2b2d01f4459b1e90fd12cc7840e)
I20260709 13:07:04.932715 25086 leader_election.cc:290] T bc225c93219c45538b53a1bd3d387e4d P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:07:04.802721 25800 raft_consensus.cc:493] T 2b74109013a140ada21feeef92d6f563 P e61c3a8f61bb48f8a963c9480e53c168 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:04.927215 19554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c5eebf646ad445a9d1b1adc319d7b16" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:07:04.919543 20076 leader_election.cc:304] T 1efebf73c86e432baa55533136b6e12c P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 127766fc592545a4997f7790f50f6076, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:07:04.862519 25805 raft_consensus.cc:493] T df751f992649444090e27965eb1af85d P 0473d2b2d01f4459b1e90fd12cc7840e [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:04.931981 19556 raft_consensus.cc:1275] T 70797e5783b5454ab0d0eea663e791e3 P e61c3a8f61bb48f8a963c9480e53c168 [term 21 FOLLOWER]: Refusing update from remote peer 127766fc592545a4997f7790f50f6076: Log matching property violated. Preceding OpId in replica: term: 18 index: 13. Preceding OpId from leader: term: 21 index: 15. (index mismatch)
I20260709 13:07:04.935581 25086 raft_consensus.cc:493] T ef32ce6fdd0e40d382c79974f30295c6 P e61c3a8f61bb48f8a963c9480e53c168 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:04.935364 19411 raft_consensus.cc:2410] T ef32ce6fdd0e40d382c79974f30295c6 P e5256d91808b47c195bc9b4dbd7f2b87 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0473d2b2d01f4459b1e90fd12cc7840e for term 23 because replica has last-logged OpId of term: 21 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 20 index: 11.
I20260709 13:07:04.935997 25086 raft_consensus.cc:515] T ef32ce6fdd0e40d382c79974f30295c6 P e61c3a8f61bb48f8a963c9480e53c168 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:07:04.936996 25093 consensus_queue.cc:1048] T 217b5fae677b4971b3bbd2f357a1f7ff P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:07:04.920786 25786 raft_consensus.cc:3060] T 76cb037fc9064d13b59a8969d897ce8c P 0473d2b2d01f4459b1e90fd12cc7840e [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:07:04.859259 25871 consensus_queue.cc:1059] T 22196caba61445d3bec98a0aab3c337d P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.102s
I20260709 13:07:04.920576 25906 raft_consensus.cc:493] T ff9b0eddd810459b82d91c60777c10eb P 127766fc592545a4997f7790f50f6076 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:04.939601 19407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86a6797bdfe94fa496c050ceae4bd0d9" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 16 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:07:04.972111 19484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76cb037fc9064d13b59a8969d897ce8c" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:07:04.972965 19482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a61655d99124a29b486ba4a5b37faea" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 18 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:07:04.982972 19482 raft_consensus.cc:2468] T 1a61655d99124a29b486ba4a5b37faea P 0473d2b2d01f4459b1e90fd12cc7840e [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 17.
I20260709 13:07:04.973786 19480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b08304a0a02b42d7840c4e8ee9a6bd1a" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:07:04.940281 19377 leader_election.cc:304] T 7f575b143b844aa096b50997dad3516a P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87; no voters: 
I20260709 13:07:04.938714 25805 raft_consensus.cc:3060] T df751f992649444090e27965eb1af85d P 0473d2b2d01f4459b1e90fd12cc7840e [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:07:04.933027 25859 raft_consensus.cc:3060] T 5ec1c4ce15e04c7e8c283a62179f2a64 P 0473d2b2d01f4459b1e90fd12cc7840e [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:07:04.896317 25923 raft_consensus.cc:515] T 28af091831594f9d8e96482078cc7625 P e5256d91808b47c195bc9b4dbd7f2b87 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
W20260709 13:07:04.991335 19377 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.2:46257, user_credentials={real_user=slave}} blocked reactor thread for 51139.4us
I20260709 13:07:04.991469 19478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "172b3dd13109415a955b71ac0e9d2234" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
W20260709 13:07:05.003551 20076 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.3:36891, user_credentials={real_user=slave}} blocked reactor thread for 66687.3us
I20260709 13:07:04.995707 19486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9f0d59553ad444883fcf5b5909f9798" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:07:04.940701 25929 raft_consensus.cc:493] T 21e14947d70440f19044d8f75c31e1f9 P e5256d91808b47c195bc9b4dbd7f2b87 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:04.932116 25926 raft_consensus.cc:493] T 2e36a9d6e29c4a7c860cf267efbd4c74 P e61c3a8f61bb48f8a963c9480e53c168 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 0473d2b2d01f4459b1e90fd12cc7840e)
I20260709 13:07:04.764716 25376 consensus_queue.cc:237] T f93ee515a9c14139bf566522ed8232f3 P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 20.10, Last appended by leader: 10, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:07:04.920320 25760 raft_consensus.cc:515] T 3e1f505cb0f1427bbd698ac889d80821 P 0473d2b2d01f4459b1e90fd12cc7840e [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:07:04.936177 25829 consensus_queue.cc:1059] T 179fd671030940b4b4a4e24bcc4aba0a P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 }, Status: INVALID_TERM, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.063s
I20260709 13:07:04.961161 25520 raft_consensus.cc:493] T ab43d85f64114d4ebf618930e43d9ed0 P 0473d2b2d01f4459b1e90fd12cc7840e [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 127766fc592545a4997f7790f50f6076)
I20260709 13:07:04.977384 25837 raft_consensus.cc:493] T 2b74109013a140ada21feeef92d6f563 P 0473d2b2d01f4459b1e90fd12cc7840e [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:04.969218 25591 leader_election.cc:290] T 2a16f7501e2444fb86d4e2778e734e02 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:07:05.006130 19377 leader_election.cc:304] T 1a61655d99124a29b486ba4a5b37faea P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87; no voters: 
I20260709 13:07:04.940256 25920 consensus_queue.cc:1059] T 14935b3ddf914369822e4a0547aaa355 P 127766fc592545a4997f7790f50f6076 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 }, Status: INVALID_TERM, Last received: 12.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.057s
I20260709 13:07:04.989739 25865 raft_consensus.cc:493] T 4af19371ea874c09a0a2147040835cbb P e61c3a8f61bb48f8a963c9480e53c168 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:05.041246 25093 raft_consensus.cc:2804] T 1a61655d99124a29b486ba4a5b37faea P e5256d91808b47c195bc9b4dbd7f2b87 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:07:05.041657 25093 raft_consensus.cc:493] T 1a61655d99124a29b486ba4a5b37faea P e5256d91808b47c195bc9b4dbd7f2b87 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:05.042012 25093 raft_consensus.cc:3060] T 1a61655d99124a29b486ba4a5b37faea P e5256d91808b47c195bc9b4dbd7f2b87 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:07:04.938987 25800 raft_consensus.cc:515] T 2b74109013a140ada21feeef92d6f563 P e61c3a8f61bb48f8a963c9480e53c168 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:07:05.000744 19485 raft_consensus.cc:1275] T d1e5873a19244c5ebbcd38e126796ee7 P 0473d2b2d01f4459b1e90fd12cc7840e [term 22 FOLLOWER]: Refusing update from remote peer e5256d91808b47c195bc9b4dbd7f2b87: Log matching property violated. Preceding OpId in replica: term: 17 index: 9. Preceding OpId from leader: term: 22 index: 11. (index mismatch)
I20260709 13:07:04.992332 25831 raft_consensus.cc:2749] T 309c3ca0ca4b4f3ba129752ea2cb293b P 127766fc592545a4997f7790f50f6076 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:07:05.058888 19477 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58294 (request call id 2887) took 1244 ms. Trace:
W20260709 13:07:05.026307 20078 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.2:46257, user_credentials={real_user=slave}} blocked reactor thread for 100310us
I20260709 13:07:04.999262 25819 raft_consensus.cc:2804] T 7f575b143b844aa096b50997dad3516a P e5256d91808b47c195bc9b4dbd7f2b87 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:07:05.069517 19559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "179fd671030940b4b4a4e24bcc4aba0a" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:07:05.023702 25815 raft_consensus.cc:2804] T 1efebf73c86e432baa55533136b6e12c P 127766fc592545a4997f7790f50f6076 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:07:05.086604 19553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef32ce6fdd0e40d382c79974f30295c6" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 23 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:07:05.087538 19553 raft_consensus.cc:2410] T ef32ce6fdd0e40d382c79974f30295c6 P e61c3a8f61bb48f8a963c9480e53c168 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0473d2b2d01f4459b1e90fd12cc7840e for term 23 because replica has last-logged OpId of term: 21 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 20 index: 11.
I20260709 13:07:04.995522 25830 raft_consensus.cc:493] T e381f1d6b8184797ad142de49be225a8 P 0473d2b2d01f4459b1e90fd12cc7840e [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:04.990094 25906 raft_consensus.cc:515] T ff9b0eddd810459b82d91c60777c10eb P 127766fc592545a4997f7790f50f6076 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:07:05.079427 25928 raft_consensus.cc:493] T 217b5fae677b4971b3bbd2f357a1f7ff P e61c3a8f61bb48f8a963c9480e53c168 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader e5256d91808b47c195bc9b4dbd7f2b87)
W20260709 13:07:05.036691 19449 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.4:43121, user_credentials={real_user=slave}} blocked reactor thread for 259392us
I20260709 13:07:05.078235 19558 raft_consensus.cc:1240] T 0e1085d23e8347fbbd5bce7542f4b1f4 P e61c3a8f61bb48f8a963c9480e53c168 [term 15 FOLLOWER]: Rejecting Update request from peer 0473d2b2d01f4459b1e90fd12cc7840e for earlier term 14. Current term is 15. Ops: [14.12-14.12]
I20260709 13:07:05.083266 19478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e381f1d6b8184797ad142de49be225a8" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 17 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:07:04.940502 25824 raft_consensus.cc:515] T 28af091831594f9d8e96482078cc7625 P e61c3a8f61bb48f8a963c9480e53c168 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:07:05.059475 19477 rpcz_store.cc:276] 0709 13:07:03.814232 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:03.826852 (+ 12620us) service_pool.cc:224] Handling call
0709 13:07:03.875324 (+ 48472us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:03.878464 (+  3140us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 13:07:03.909589 (+ 31125us) log.cc:844] Serialized 14 byte log entry
0709 13:07:04.726087 (+816498us) spinlock_profiling.cc:243] Waited 40.8 ms on lock 0x7b4400022b4c. stack: 00007f4a79de9343 00007f4a79de9240 00007f4a797781d4 00007f4a834b6304 00007f4a834b6299 00007f4a79ca3db1 00007f4a79d41c85 00007f4a79d426a2 00007f4a7cab41db 00007f4a7caafaaf 00007f4a7caa386e 00007f4a7caa2bb6 00007f4a7caa27d8 00007f4a7caac221 00007f4a7caac1d9 00007f4a7caac169
0709 13:07:04.891370 (+165283us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:04.891957 (+   587us) log.cc:844] Serialized 26 byte log entry
0709 13:07:04.905731 (+ 13774us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:07:04.905791 (+    60us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:04.905893 (+   102us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:05.041013 (+135120us) raft_consensus.cc:1685] finished
0709 13:07:05.058615 (+ 17602us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:05.058820 (+   205us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":50532,"prepare.queue_time_us":33534,"prepare.run_cpu_time_us":34,"prepare.run_wall_time_us":34,"raft.queue_time_us":62346,"raft.run_cpu_time_us":226,"raft.run_wall_time_us":6648,"spinlock_wait_cycles":93869312,"thread_start_us":919298,"threads_started":2,"wal-append.queue_time_us":672416}
I20260709 13:07:05.084414 19559 raft_consensus.cc:2393] T 179fd671030940b4b4a4e24bcc4aba0a P e61c3a8f61bb48f8a963c9480e53c168 [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate 0473d2b2d01f4459b1e90fd12cc7840e in current term 21: Already voted for candidate e61c3a8f61bb48f8a963c9480e53c168 in this term.
W20260709 13:07:05.097414 19377 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:05.031610 19407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46c5bfeecc314717bffe987e6844b6d0" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 25 candidate_status { last_received { term: 23 index: 12 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
I20260709 13:07:05.098107 19407 raft_consensus.cc:3060] T 46c5bfeecc314717bffe987e6844b6d0 P e5256d91808b47c195bc9b4dbd7f2b87 [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:07:05.014494 25929 raft_consensus.cc:515] T 21e14947d70440f19044d8f75c31e1f9 P e5256d91808b47c195bc9b4dbd7f2b87 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:07:04.989257 25587 consensus_queue.cc:237] T fa731b585f684a7fb2d106c50f143b83 P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:07:05.060716 25832 raft_consensus.cc:493] T 46c5bfeecc314717bffe987e6844b6d0 P 0473d2b2d01f4459b1e90fd12cc7840e [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:05.105702 25093 raft_consensus.cc:515] T 1a61655d99124a29b486ba4a5b37faea P e5256d91808b47c195bc9b4dbd7f2b87 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:07:05.089470 25819 raft_consensus.cc:697] T 7f575b143b844aa096b50997dad3516a P e5256d91808b47c195bc9b4dbd7f2b87 [term 16 LEADER]: Becoming Leader. State: Replica: e5256d91808b47c195bc9b4dbd7f2b87, State: Running, Role: LEADER
I20260709 13:07:05.087743 25815 raft_consensus.cc:493] T 1efebf73c86e432baa55533136b6e12c P 127766fc592545a4997f7790f50f6076 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 0473d2b2d01f4459b1e90fd12cc7840e)
I20260709 13:07:05.015072 25926 raft_consensus.cc:515] T 2e36a9d6e29c4a7c860cf267efbd4c74 P e61c3a8f61bb48f8a963c9480e53c168 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:07:05.134967 19480 pending_rounds.cc:85] T 1a61655d99124a29b486ba4a5b37faea P 0473d2b2d01f4459b1e90fd12cc7840e: Aborting all ops after (but not including) 8
I20260709 13:07:05.135339 19480 pending_rounds.cc:107] T 1a61655d99124a29b486ba4a5b37faea P 0473d2b2d01f4459b1e90fd12cc7840e: Aborting uncommitted NO_OP operation due to leader change: 13.9
I20260709 13:07:05.135568 19480 raft_consensus.cc:2889] T 1a61655d99124a29b486ba4a5b37faea P 0473d2b2d01f4459b1e90fd12cc7840e [term 17 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:07:05.079165 25591 raft_consensus.cc:493] T 1dc5b3532fe54f74876d02beffa2c230 P e5256d91808b47c195bc9b4dbd7f2b87 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:05.123958 19479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e1085d23e8347fbbd5bce7542f4b1f4" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:07:05.130457 20106 raft_consensus.cc:1240] T 0e1085d23e8347fbbd5bce7542f4b1f4 P 127766fc592545a4997f7790f50f6076 [term 15 FOLLOWER]: Rejecting Update request from peer 0473d2b2d01f4459b1e90fd12cc7840e for earlier term 14. Current term is 15. Ops: [14.12-14.12]
I20260709 13:07:05.178958 19556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1b10566f45d4a7d9029858330e02d5b" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:07:05.214354 20103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ec1c4ce15e04c7e8c283a62179f2a64" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:07:05.129822 20109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14efcc79969f41babe5529c22d59156d" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:07:05.131148 20108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff9b0eddd810459b82d91c60777c10eb" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
W20260709 13:07:05.177459 19449 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.1:40321, user_credentials={real_user=slave}} blocked reactor thread for 44440.6us
I20260709 13:07:05.124560 19477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46c5bfeecc314717bffe987e6844b6d0" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 25 candidate_status { last_received { term: 23 index: 12 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:07:05.124265 19481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14935b3ddf914369822e4a0547aaa355" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:07:05.120777 19485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa8650e71aa14778b3d73721fc50d9fc" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:07:05.119313 19406 raft_consensus.cc:1240] T 1a61655d99124a29b486ba4a5b37faea P e5256d91808b47c195bc9b4dbd7f2b87 [term 18 FOLLOWER]: Rejecting Update request from peer e61c3a8f61bb48f8a963c9480e53c168 for earlier term 17. Current term is 18. Ops: [15.10-17.11]
W20260709 13:07:05.119800 19560 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41504 (request call id 1023) took 1556 ms (client timeout 1750 ms). Trace:
I20260709 13:07:05.088784 25829 raft_consensus.cc:493] T ab43d85f64114d4ebf618930e43d9ed0 P e5256d91808b47c195bc9b4dbd7f2b87 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:05.236560 19479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86a6797bdfe94fa496c050ceae4bd0d9" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 16 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:07:05.270392 20106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9962423cb4e54fcfa5de01daf68a86e7" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:07:05.236783 19556 raft_consensus.cc:2468] T f1b10566f45d4a7d9029858330e02d5b P e61c3a8f61bb48f8a963c9480e53c168 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 18.
I20260709 13:07:05.039525 25520 raft_consensus.cc:515] T ab43d85f64114d4ebf618930e43d9ed0 P 0473d2b2d01f4459b1e90fd12cc7840e [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
W20260709 13:07:05.112370 25935 log.cc:927] Time spent T 21e14947d70440f19044d8f75c31e1f9 P e61c3a8f61bb48f8a963c9480e53c168: Append to log took a long time: real 0.084s	user 0.000s	sys 0.001s
W20260709 13:07:05.269868 19560 rpcz_store.cc:269] 0709 13:07:03.562918 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:03.579269 (+ 16351us) service_pool.cc:224] Handling call
0709 13:07:05.119649 (+1540380us) spinlock_profiling.cc:243] Waited 288 ms on lock 0x7b540032b754. stack: 00007f4a79de9343 00007f4a79de9240 00007f4a797781d4 00007f4a834b6304 00007f4a834b6299 00007f4a7ce71571 00007f4a7cf0c2fa 00007f4a81ecdb17 00007f4a7b4486d4 00007f4a7b448662 00007f4a7b448591 00007f4a7b44850c 00007f4a7b4477c2 00007f4a7b24348c 00007f4a7b2428c6 00007f4a7b24226f
0709 13:07:05.119749 (+   100us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":663040384}
I20260709 13:07:05.216984 20108 raft_consensus.cc:2468] T ff9b0eddd810459b82d91c60777c10eb P 127766fc592545a4997f7790f50f6076 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 18.
I20260709 13:07:05.327455 19485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc225c93219c45538b53a1bd3d387e4d" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
W20260709 13:07:05.111855 25941 log.cc:927] Time spent T 48824d5acfbc485ebf8c2d944e7202de P e61c3a8f61bb48f8a963c9480e53c168: Append to log took a long time: real 0.075s	user 0.000s	sys 0.000s
I20260709 13:07:05.105278 25813 leader_election.cc:290] T e381f1d6b8184797ad142de49be225a8 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:07:05.044039 25837 raft_consensus.cc:515] T 2b74109013a140ada21feeef92d6f563 P 0473d2b2d01f4459b1e90fd12cc7840e [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:07:05.059017 25865 raft_consensus.cc:515] T 4af19371ea874c09a0a2147040835cbb P e61c3a8f61bb48f8a963c9480e53c168 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
W20260709 13:07:05.339592 20076 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.17.223.3:36891 timed out after 1.750s (SENT) [suppressed 19 similar messages]
I20260709 13:07:05.349309 19479 raft_consensus.cc:1240] T d1e5873a19244c5ebbcd38e126796ee7 P 0473d2b2d01f4459b1e90fd12cc7840e [term 22 FOLLOWER]: Rejecting Update request from peer e61c3a8f61bb48f8a963c9480e53c168 for earlier term 21. Current term is 22. Ops: []
I20260709 13:07:05.368513 20103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96efeaaf1057492490e9a621f37e1a2d" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076"
I20260709 13:07:05.369736 19479 raft_consensus.cc:1275] T 0cdf56e38bbc453d9438d359e5a69955 P 0473d2b2d01f4459b1e90fd12cc7840e [term 18 FOLLOWER]: Refusing update from remote peer e61c3a8f61bb48f8a963c9480e53c168: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 13:07:05.177659 25938 raft_consensus.cc:3055] T 14935b3ddf914369822e4a0547aaa355 P 127766fc592545a4997f7790f50f6076 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:07:05.113672 25815 raft_consensus.cc:3060] T 1efebf73c86e432baa55533136b6e12c P 127766fc592545a4997f7790f50f6076 [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:07:05.112742 25915 log.cc:927] Time spent T 48824d5acfbc485ebf8c2d944e7202de P 127766fc592545a4997f7790f50f6076: Append to log took a long time: real 0.187s	user 0.000s	sys 0.000s
I20260709 13:07:05.352885 19481 raft_consensus.cc:1275] T 1dc5b3532fe54f74876d02beffa2c230 P 0473d2b2d01f4459b1e90fd12cc7840e [term 20 FOLLOWER]: Refusing update from remote peer e61c3a8f61bb48f8a963c9480e53c168: Log matching property violated. Preceding OpId in replica: term: 17 index: 9. Preceding OpId from leader: term: 20 index: 11. (index mismatch)
I20260709 13:07:05.403092 20106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48824d5acfbc485ebf8c2d944e7202de" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 22 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
W20260709 13:07:05.366297 19377 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:05.040272 25881 raft_consensus.cc:515] T 7be9efa6559648dbb5a0f7684c4542d1 P e61c3a8f61bb48f8a963c9480e53c168 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } attrs { replace: true } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:07:05.121037 25926 leader_election.cc:290] T 2e36a9d6e29c4a7c860cf267efbd4c74 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:07:05.266549 25755 raft_consensus.cc:493] T e381f1d6b8184797ad142de49be225a8 P e61c3a8f61bb48f8a963c9480e53c168 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:05.130108 25812 leader_election.cc:290] T b9f0d59553ad444883fcf5b5909f9798 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:07:05.375748 20108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62c6c134d3d24a1ab144dd9ee6bc3f64" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:07:05.100167 25830 raft_consensus.cc:515] T e381f1d6b8184797ad142de49be225a8 P 0473d2b2d01f4459b1e90fd12cc7840e [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:07:05.411237 25755 raft_consensus.cc:515] T e381f1d6b8184797ad142de49be225a8 P e61c3a8f61bb48f8a963c9480e53c168 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:07:05.412212 19478 raft_consensus.cc:2468] T e381f1d6b8184797ad142de49be225a8 P 0473d2b2d01f4459b1e90fd12cc7840e [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 16.
I20260709 13:07:05.413051 25830 leader_election.cc:290] T e381f1d6b8184797ad142de49be225a8 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:07:05.413532 25755 leader_election.cc:290] T e381f1d6b8184797ad142de49be225a8 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:07:05.112695 25760 leader_election.cc:290] T 3e1f505cb0f1427bbd698ac889d80821 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:07:05.414592 25881 leader_election.cc:290] T 7be9efa6559648dbb5a0f7684c4542d1 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 20 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:07:05.129112 25598 leader_election.cc:290] T 7f575b143b844aa096b50997dad3516a P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 16 election: Requested vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:07:05.109165 25934 raft_consensus.cc:493] T 775c229504194560ba9589bc2199b089 P 0473d2b2d01f4459b1e90fd12cc7840e [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 127766fc592545a4997f7790f50f6076)
I20260709 13:07:05.415341 25934 raft_consensus.cc:515] T 775c229504194560ba9589bc2199b089 P 0473d2b2d01f4459b1e90fd12cc7840e [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:07:05.416344 25598 raft_consensus.cc:493] T 9962423cb4e54fcfa5de01daf68a86e7 P e5256d91808b47c195bc9b4dbd7f2b87 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 127766fc592545a4997f7790f50f6076)
I20260709 13:07:05.416955 25598 raft_consensus.cc:515] T 9962423cb4e54fcfa5de01daf68a86e7 P e5256d91808b47c195bc9b4dbd7f2b87 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:07:05.418037 25934 leader_election.cc:290] T 775c229504194560ba9589bc2199b089 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:07:05.384900 20103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62c6c134d3d24a1ab144dd9ee6bc3f64" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076"
I20260709 13:07:05.232329 25803 raft_consensus.cc:493] T 2b74109013a140ada21feeef92d6f563 P e5256d91808b47c195bc9b4dbd7f2b87 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:05.419416 25598 leader_election.cc:290] T 9962423cb4e54fcfa5de01daf68a86e7 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:07:05.400091 19406 raft_consensus.cc:1240] T df751f992649444090e27965eb1af85d P e5256d91808b47c195bc9b4dbd7f2b87 [term 21 FOLLOWER]: Rejecting Update request from peer e61c3a8f61bb48f8a963c9480e53c168 for earlier term 20. Current term is 21. Ops: []
I20260709 13:07:05.327760 25766 raft_consensus.cc:493] T ed7fdbcb96d14d418db9ca90a792588a P e61c3a8f61bb48f8a963c9480e53c168 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 127766fc592545a4997f7790f50f6076)
I20260709 13:07:05.422998 25766 raft_consensus.cc:515] T ed7fdbcb96d14d418db9ca90a792588a P e61c3a8f61bb48f8a963c9480e53c168 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:07:05.425830 25766 leader_election.cc:290] T ed7fdbcb96d14d418db9ca90a792588a P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:07:05.125819 25917 consensus_queue.cc:1059] T 62c6c134d3d24a1ab144dd9ee6bc3f64 P 127766fc592545a4997f7790f50f6076 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 }, Status: INVALID_TERM, Last received: 16.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.225s
I20260709 13:07:05.419384 25803 raft_consensus.cc:515] T 2b74109013a140ada21feeef92d6f563 P e5256d91808b47c195bc9b4dbd7f2b87 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:07:05.429198 25803 leader_election.cc:290] T 2b74109013a140ada21feeef92d6f563 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:07:05.433722 19406 raft_consensus.cc:1240] T 775c229504194560ba9589bc2199b089 P e5256d91808b47c195bc9b4dbd7f2b87 [term 14 FOLLOWER]: Rejecting Update request from peer 127766fc592545a4997f7790f50f6076 for earlier term 13. Current term is 14. Ops: []
I20260709 13:07:05.118887 25920 consensus_queue.cc:1059] T ed7fdbcb96d14d418db9ca90a792588a P 127766fc592545a4997f7790f50f6076 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 }, Status: INVALID_TERM, Last received: 13.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.262s
I20260709 13:07:05.443998 20107 raft_consensus.cc:1275] T 309c3ca0ca4b4f3ba129752ea2cb293b P 127766fc592545a4997f7790f50f6076 [term 12 FOLLOWER]: Refusing update from remote peer 0473d2b2d01f4459b1e90fd12cc7840e: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 12 index: 12. (index mismatch)
I20260709 13:07:05.176189 25832 raft_consensus.cc:515] T 46c5bfeecc314717bffe987e6844b6d0 P 0473d2b2d01f4459b1e90fd12cc7840e [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:07:05.378206 25754 leader_election.cc:290] T 179fd671030940b4b4a4e24bcc4aba0a P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 21 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:07:05.107221 25928 raft_consensus.cc:515] T 217b5fae677b4971b3bbd2f357a1f7ff P e61c3a8f61bb48f8a963c9480e53c168 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:07:05.379789 25938 raft_consensus.cc:740] T 14935b3ddf914369822e4a0547aaa355 P 127766fc592545a4997f7790f50f6076 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 127766fc592545a4997f7790f50f6076, State: Running, Role: LEADER
W20260709 13:07:05.443066 25941 log.cc:927] Time spent T 48824d5acfbc485ebf8c2d944e7202de P e61c3a8f61bb48f8a963c9480e53c168: Append to log took a long time: real 0.073s	user 0.000s	sys 0.000s
I20260709 13:07:05.350989 25591 raft_consensus.cc:515] T 1dc5b3532fe54f74876d02beffa2c230 P e5256d91808b47c195bc9b4dbd7f2b87 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
W20260709 13:07:05.469012 25937 log.cc:927] Time spent T edd7d470b5014c9489be7f41f64355c9 P e5256d91808b47c195bc9b4dbd7f2b87: Append to log took a long time: real 0.370s	user 0.000s	sys 0.000s
I20260709 13:07:05.471287 25905 raft_consensus.cc:3055] T ed7fdbcb96d14d418db9ca90a792588a P 127766fc592545a4997f7790f50f6076 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:07:05.481848 25905 raft_consensus.cc:740] T ed7fdbcb96d14d418db9ca90a792588a P 127766fc592545a4997f7790f50f6076 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 127766fc592545a4997f7790f50f6076, State: Running, Role: LEADER
I20260709 13:07:05.482971 25905 consensus_queue.cc:260] T ed7fdbcb96d14d418db9ca90a792588a P 127766fc592545a4997f7790f50f6076 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
W20260709 13:07:05.475129 25940 log.cc:927] Time spent T 172b3dd13109415a955b71ac0e9d2234 P e5256d91808b47c195bc9b4dbd7f2b87: Append to log took a long time: real 0.395s	user 0.000s	sys 0.001s
I20260709 13:07:05.473188 25800 leader_election.cc:290] T 2b74109013a140ada21feeef92d6f563 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:07:05.111740 25819 consensus_queue.cc:237] T 7f575b143b844aa096b50997dad3516a P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:07:05.447265 25598 raft_consensus.cc:493] T 40e1e16737a842ee936002830f36882e P e5256d91808b47c195bc9b4dbd7f2b87 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader e61c3a8f61bb48f8a963c9480e53c168)
I20260709 13:07:05.490724 19477 raft_consensus.cc:3060] T 46c5bfeecc314717bffe987e6844b6d0 P 0473d2b2d01f4459b1e90fd12cc7840e [term 24 FOLLOWER]: Advancing to term 25
W20260709 13:07:05.492447 25764 consensus_meta.cc:287] T ff9b0eddd810459b82d91c60777c10eb P 0473d2b2d01f4459b1e90fd12cc7840e: Time spent flushing consensus metadata: real 0.838s	user 0.002s	sys 0.008s
I20260709 13:07:05.492854 25764 raft_consensus.cc:515] T ff9b0eddd810459b82d91c60777c10eb P 0473d2b2d01f4459b1e90fd12cc7840e [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:07:05.494946 25764 leader_election.cc:290] T ff9b0eddd810459b82d91c60777c10eb P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 19 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:07:05.353319 25829 raft_consensus.cc:515] T ab43d85f64114d4ebf618930e43d9ed0 P e5256d91808b47c195bc9b4dbd7f2b87 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } attrs { replace: true } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:07:05.458002 25854 leader_election.cc:290] T ef32ce6fdd0e40d382c79974f30295c6 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:07:05.505425 19555 raft_consensus.cc:1240] T 21e14947d70440f19044d8f75c31e1f9 P e61c3a8f61bb48f8a963c9480e53c168 [term 18 LEADER]: Rejecting Update request from peer e5256d91808b47c195bc9b4dbd7f2b87 for earlier term 17. Current term is 18. Ops: []
I20260709 13:07:05.509202 19555 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40438 (request call id 3086) took 1557 ms. Trace:
I20260709 13:07:05.509606 19555 rpcz_store.cc:276] 0709 13:07:03.951438 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:03.952679 (+  1241us) service_pool.cc:224] Handling call
0709 13:07:05.504968 (+1552289us) spinlock_profiling.cc:243] Waited 25.6 ms on lock 0x7b5800003998. stack: 00007f4a79de9343 00007f4a79de9240 00007f4a797781d4 00007f4a834b6304 00007f4a834b6299 00007f4a79ca3db1 00007f4a79de3b71 00007f4a79de3a22 00007f4a82cfcc09 00007f4a81e56ee0 00007f4a81f200ab 00007f4a81f20131 00007f4a81ee1fc0 00007f4a81ecc929 00007f4a81ecc3d2 00007f4a7b443bd4
0709 13:07:05.505206 (+   238us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:05.508908 (+  3702us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:05.509137 (+   229us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":58806016}
W20260709 13:07:05.480238 25786 consensus_meta.cc:287] T 76cb037fc9064d13b59a8969d897ce8c P 0473d2b2d01f4459b1e90fd12cc7840e: Time spent flushing consensus metadata: real 0.502s	user 0.006s	sys 0.002s
W20260709 13:07:05.497787 25705 consensus_meta.cc:287] T a08760e15aac4630a629431f56024dc8 P e5256d91808b47c195bc9b4dbd7f2b87: Time spent flushing consensus metadata: real 0.581s	user 0.008s	sys 0.001s
I20260709 13:07:05.551780 25824 leader_election.cc:290] T 28af091831594f9d8e96482078cc7625 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:07:05.553017 25520 leader_election.cc:290] T ab43d85f64114d4ebf618930e43d9ed0 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
W20260709 13:07:05.553179 25947 log.cc:927] Time spent T 217b5fae677b4971b3bbd2f357a1f7ff P 0473d2b2d01f4459b1e90fd12cc7840e: Append to log took a long time: real 0.050s	user 0.000s	sys 0.000s
I20260709 13:07:05.553651 25923 leader_election.cc:290] T 28af091831594f9d8e96482078cc7625 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:07:05.554283 25854 raft_consensus.cc:493] T 775c229504194560ba9589bc2199b089 P e5256d91808b47c195bc9b4dbd7f2b87 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:05.554826 25854 raft_consensus.cc:515] T 775c229504194560ba9589bc2199b089 P e5256d91808b47c195bc9b4dbd7f2b87 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:07:05.555284 25938 consensus_queue.cc:260] T 14935b3ddf914369822e4a0547aaa355 P 127766fc592545a4997f7790f50f6076 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:07:05.556291 25906 leader_election.cc:290] T ff9b0eddd810459b82d91c60777c10eb P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:07:05.556954 25854 leader_election.cc:290] T 775c229504194560ba9589bc2199b089 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:07:05.557446 25929 leader_election.cc:290] T 21e14947d70440f19044d8f75c31e1f9 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
W20260709 13:07:05.505620 25930 log.cc:927] Time spent T 0cdf56e38bbc453d9438d359e5a69955 P e61c3a8f61bb48f8a963c9480e53c168: Append to log took a long time: real 0.207s	user 0.000s	sys 0.001s
I20260709 13:07:05.558808 25832 leader_election.cc:290] T 46c5bfeecc314717bffe987e6844b6d0 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:07:05.560806 25837 leader_election.cc:290] T 2b74109013a140ada21feeef92d6f563 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:07:05.561328 25591 leader_election.cc:290] T 1dc5b3532fe54f74876d02beffa2c230 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:07:05.526759 25786 raft_consensus.cc:2749] T 76cb037fc9064d13b59a8969d897ce8c P 0473d2b2d01f4459b1e90fd12cc7840e [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:07:05.564141 25928 leader_election.cc:290] T 217b5fae677b4971b3bbd2f357a1f7ff P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:07:05.573102 19407 raft_consensus.cc:2468] T 46c5bfeecc314717bffe987e6844b6d0 P e5256d91808b47c195bc9b4dbd7f2b87 [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 25.
I20260709 13:07:05.576059 19404 raft_consensus.cc:2468] T a08760e15aac4630a629431f56024dc8 P e5256d91808b47c195bc9b4dbd7f2b87 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 22.
W20260709 13:07:05.600342 20076 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.3:36891, user_credentials={real_user=slave}} blocked reactor thread for 260804us
I20260709 13:07:05.600461 19484 raft_consensus.cc:2468] T 76cb037fc9064d13b59a8969d897ce8c P 0473d2b2d01f4459b1e90fd12cc7840e [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 18.
I20260709 13:07:05.604977 19477 raft_consensus.cc:2468] T 46c5bfeecc314717bffe987e6844b6d0 P 0473d2b2d01f4459b1e90fd12cc7840e [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 25.
W20260709 13:07:05.599750 25937 log.cc:927] Time spent T edd7d470b5014c9489be7f41f64355c9 P e5256d91808b47c195bc9b4dbd7f2b87: Append to log took a long time: real 0.096s	user 0.000s	sys 0.000s
I20260709 13:07:05.580197 25803 raft_consensus.cc:493] T a08760e15aac4630a629431f56024dc8 P e5256d91808b47c195bc9b4dbd7f2b87 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:05.499823 25598 raft_consensus.cc:515] T 40e1e16737a842ee936002830f36882e P e5256d91808b47c195bc9b4dbd7f2b87 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:07:05.621358 25598 leader_election.cc:290] T 40e1e16737a842ee936002830f36882e P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:07:05.607595 25923 raft_consensus.cc:493] T 0cdf56e38bbc453d9438d359e5a69955 P e5256d91808b47c195bc9b4dbd7f2b87 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:05.626065 19409 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52342 (request call id 3220) took 1559 ms. Trace:
I20260709 13:07:05.626482 19409 rpcz_store.cc:276] 0709 13:07:04.067069 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:04.067208 (+   139us) service_pool.cc:224] Handling call
0709 13:07:04.190303 (+123095us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:04.191078 (+   775us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:05.625868 (+1434790us) spinlock_profiling.cc:243] Waited 123 ms on lock 0x7b54000b31d0. stack: 00007f4a79de9343 00007f4a79de9240 00007f4a797781d4 00007f4a834b6304 00007f4a834b6299 00007f4a7ce71571 00007f4a7cf078ad 00007f4a81ecc419 00007f4a7b443bd4 00007f4a7b443b62 00007f4a7b443a91 00007f4a7b443a0c 00007f4a7b442cc2 00007f4a7b24348c 00007f4a7b2428c6 00007f4a7b24226f
0709 13:07:05.626009 (+   141us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":282243840}
I20260709 13:07:05.623411 25815 raft_consensus.cc:515] T 1efebf73c86e432baa55533136b6e12c P 127766fc592545a4997f7790f50f6076 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:07:05.622016 25591 raft_consensus.cc:493] T 1f85fc4b527a48848e5faa083b604e36 P e5256d91808b47c195bc9b4dbd7f2b87 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:05.672070 19450 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.3:36891, user_credentials={real_user=slave}} blocked reactor thread for 568503us
I20260709 13:07:05.683444 19408 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52342 (request call id 3224) took 1608 ms. Trace:
I20260709 13:07:05.684170 25786 raft_consensus.cc:493] T d1e5873a19244c5ebbcd38e126796ee7 P 0473d2b2d01f4459b1e90fd12cc7840e [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:05.684828 25786 raft_consensus.cc:515] T d1e5873a19244c5ebbcd38e126796ee7 P 0473d2b2d01f4459b1e90fd12cc7840e [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
W20260709 13:07:05.686447 25916 log.cc:927] Time spent T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P 0473d2b2d01f4459b1e90fd12cc7840e: Append to log took a long time: real 1.006s	user 0.005s	sys 0.000s
I20260709 13:07:05.687068 25786 leader_election.cc:290] T d1e5873a19244c5ebbcd38e126796ee7 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:07:05.683991 19408 rpcz_store.cc:276] 0709 13:07:04.075481 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:04.076345 (+   864us) service_pool.cc:224] Handling call
0709 13:07:04.152572 (+ 76227us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:04.592083 (+439511us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:05.683158 (+1091075us) spinlock_profiling.cc:243] Waited 414 ms on lock 0x7b5400196254. stack: 00007f4a79de9343 00007f4a79de9240 00007f4a797781d4 00007f4a834b6304 00007f4a834b6299 00007f4a7ce71571 00007f4a7cf08e01 00007f4a7cf0783e 00007f4a81ecc419 00007f4a7b443bd4 00007f4a7b443b62 00007f4a7b443a91 00007f4a7b443a0c 00007f4a7b442cc2 00007f4a7b24348c 00007f4a7b2428c6
0709 13:07:05.683366 (+   208us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":951233920}
I20260709 13:07:05.690887 19482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36f6ba92b9ba46babe4ebd6c02e5fbd9" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 21 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:07:05.693146 19482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c5eebf646ad445a9d1b1adc319d7b16" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
W20260709 13:07:05.696460 19449 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.1:40321, user_credentials={real_user=slave}} blocked reactor thread for 389073us
I20260709 13:07:05.698091 19481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef32ce6fdd0e40d382c79974f30295c6" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 23 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:07:05.698880 19481 raft_consensus.cc:2468] T ef32ce6fdd0e40d382c79974f30295c6 P 0473d2b2d01f4459b1e90fd12cc7840e [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 22.
I20260709 13:07:05.701990 19409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e1f505cb0f1427bbd698ac889d80821" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:07:05.703271 19409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff9b0eddd810459b82d91c60777c10eb" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
I20260709 13:07:05.703899 19409 raft_consensus.cc:3060] T ff9b0eddd810459b82d91c60777c10eb P e5256d91808b47c195bc9b4dbd7f2b87 [term 17 FOLLOWER]: Advancing to term 19
I20260709 13:07:05.704831 20109 raft_consensus.cc:1240] T 1efebf73c86e432baa55533136b6e12c P 127766fc592545a4997f7790f50f6076 [term 15 FOLLOWER]: Rejecting Update request from peer 0473d2b2d01f4459b1e90fd12cc7840e for earlier term 14. Current term is 15. Ops: []
W20260709 13:07:05.722429 19377 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:05.625732 25944 raft_consensus.cc:493] T 65d8cb8d6ec64f459d5a47cefab10acf P 127766fc592545a4997f7790f50f6076 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader e5256d91808b47c195bc9b4dbd7f2b87)
I20260709 13:07:05.663653 25598 raft_consensus.cc:493] T 2e36a9d6e29c4a7c860cf267efbd4c74 P e5256d91808b47c195bc9b4dbd7f2b87 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 0473d2b2d01f4459b1e90fd12cc7840e)
I20260709 13:07:05.750182 19481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a61655d99124a29b486ba4a5b37faea" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 18 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
W20260709 13:07:05.751056 20075 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.619s	user 0.038s	sys 0.045s
W20260709 13:07:05.751670 20075 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.620s	user 0.038s	sys 0.045s
I20260709 13:07:05.753270 19407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "775c229504194560ba9589bc2199b089" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:07:05.754298 19407 raft_consensus.cc:2393] T 775c229504194560ba9589bc2199b089 P e5256d91808b47c195bc9b4dbd7f2b87 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0473d2b2d01f4459b1e90fd12cc7840e in current term 14: Already voted for candidate e5256d91808b47c195bc9b4dbd7f2b87 in this term.
I20260709 13:07:05.752414 19406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e381f1d6b8184797ad142de49be225a8" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 17 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:07:05.756697 19406 raft_consensus.cc:2468] T e381f1d6b8184797ad142de49be225a8 P e5256d91808b47c195bc9b4dbd7f2b87 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 16.
I20260709 13:07:05.752902 19481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9962423cb4e54fcfa5de01daf68a86e7" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:07:05.757701 19481 raft_consensus.cc:2468] T 9962423cb4e54fcfa5de01daf68a86e7 P 0473d2b2d01f4459b1e90fd12cc7840e [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 17.
I20260709 13:07:05.623238 25803 raft_consensus.cc:515] T a08760e15aac4630a629431f56024dc8 P e5256d91808b47c195bc9b4dbd7f2b87 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:07:05.762627 25587 raft_consensus.cc:493] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P e5256d91808b47c195bc9b4dbd7f2b87 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 0473d2b2d01f4459b1e90fd12cc7840e)
I20260709 13:07:05.760736 19481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40e1e16737a842ee936002830f36882e" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:07:05.760921 20103 raft_consensus.cc:1275] T 4af19371ea874c09a0a2147040835cbb P 127766fc592545a4997f7790f50f6076 [term 10 FOLLOWER]: Refusing update from remote peer e5256d91808b47c195bc9b4dbd7f2b87: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:07:05.763269 25587 raft_consensus.cc:515] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P e5256d91808b47c195bc9b4dbd7f2b87 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:07:05.764925 19481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b74109013a140ada21feeef92d6f563" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 17 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:07:05.766287 20108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "172b3dd13109415a955b71ac0e9d2234" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:07:05.766885 19481 raft_consensus.cc:2468] T 2b74109013a140ada21feeef92d6f563 P 0473d2b2d01f4459b1e90fd12cc7840e [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 16.
I20260709 13:07:05.664633 25923 raft_consensus.cc:515] T 0cdf56e38bbc453d9438d359e5a69955 P e5256d91808b47c195bc9b4dbd7f2b87 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:07:05.750640 25824 consensus_queue.cc:1048] T 0cdf56e38bbc453d9438d359e5a69955 P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.025s
I20260709 13:07:05.694635 25591 raft_consensus.cc:515] T 1f85fc4b527a48848e5faa083b604e36 P e5256d91808b47c195bc9b4dbd7f2b87 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:07:05.747854 25851 consensus_queue.cc:1059] T d1e5873a19244c5ebbcd38e126796ee7 P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.038s
I20260709 13:07:05.770130 19481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dc5b3532fe54f74876d02beffa2c230" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 21 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:07:05.786782 19406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46c5bfeecc314717bffe987e6844b6d0" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 25 candidate_status { last_received { term: 23 index: 12 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:07:05.816532 19409 raft_consensus.cc:2468] T ff9b0eddd810459b82d91c60777c10eb P e5256d91808b47c195bc9b4dbd7f2b87 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 19.
W20260709 13:07:05.774322 19449 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.4:43121, user_credentials={real_user=slave}} blocked reactor thread for 65441us
I20260709 13:07:05.856165 20104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff9b0eddd810459b82d91c60777c10eb" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076"
I20260709 13:07:05.856252 19409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e5873a19244c5ebbcd38e126796ee7" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 23 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
W20260709 13:07:05.848656 19451 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.634s	user 0.017s	sys 0.015s
I20260709 13:07:05.835460 20103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "775c229504194560ba9589bc2199b089" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:07:05.857126 19406 raft_consensus.cc:2393] T 46c5bfeecc314717bffe987e6844b6d0 P e5256d91808b47c195bc9b4dbd7f2b87 [term 25 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0473d2b2d01f4459b1e90fd12cc7840e in current term 25: Already voted for candidate e61c3a8f61bb48f8a963c9480e53c168 in this term.
I20260709 13:07:05.839355 20111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab43d85f64114d4ebf618930e43d9ed0" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
W20260709 13:07:05.857697 19451 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.643s	user 0.018s	sys 0.015s
I20260709 13:07:05.856832 20104 raft_consensus.cc:3060] T ff9b0eddd810459b82d91c60777c10eb P 127766fc592545a4997f7790f50f6076 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:07:05.856909 19481 raft_consensus.cc:2468] T 1dc5b3532fe54f74876d02beffa2c230 P 0473d2b2d01f4459b1e90fd12cc7840e [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 20.
I20260709 13:07:05.857512 20105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14efcc79969f41babe5529c22d59156d" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:07:05.783676 19450 leader_election.cc:304] T 179fd671030940b4b4a4e24bcc4aba0a P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e; no voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:07:05.744534 25837 raft_consensus.cc:493] T 4509b76741dc428e9201c70c1658da13 P 0473d2b2d01f4459b1e90fd12cc7840e [term 12 FOLLOWER]: Starting pre-election (detected failure of leader e61c3a8f61bb48f8a963c9480e53c168)
I20260709 13:07:05.881608 19481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28af091831594f9d8e96482078cc7625" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:07:05.752216 25825 consensus_queue.cc:1048] T 1dc5b3532fe54f74876d02beffa2c230 P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.130s
I20260709 13:07:05.777436 20106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "833a2f0775ed407a94b8924ce50adb63" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:07:05.857537 19409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b74109013a140ada21feeef92d6f563" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 17 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:07:05.885300 19449 leader_election.cc:304] T 9962423cb4e54fcfa5de01daf68a86e7 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e; no voters: 127766fc592545a4997f7790f50f6076, e5256d91808b47c195bc9b4dbd7f2b87
W20260709 13:07:05.894532 19451 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:05.783763 25865 leader_election.cc:290] T 4af19371ea874c09a0a2147040835cbb P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:07:05.881721 20108 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ab43d85f64114d4ebf618930e43d9ed0"
dest_uuid: "127766fc592545a4997f7790f50f6076"
mode: GRACEFUL
new_leader_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
 from {username='slave'} at 127.0.0.1:48686
I20260709 13:07:05.895821 19406 raft_consensus.cc:1240] T 22196caba61445d3bec98a0aab3c337d P e5256d91808b47c195bc9b4dbd7f2b87 [term 19 FOLLOWER]: Rejecting Update request from peer 0473d2b2d01f4459b1e90fd12cc7840e for earlier term 18. Current term is 19. Ops: [18.11-18.11]
I20260709 13:07:05.829362 25816 raft_consensus.cc:493] T ab43d85f64114d4ebf618930e43d9ed0 P 127766fc592545a4997f7790f50f6076 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:05.897221 19450 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.3:36891, user_credentials={real_user=slave}} blocked reactor thread for 113629us
I20260709 13:07:05.897604 19409 raft_consensus.cc:2468] T 2b74109013a140ada21feeef92d6f563 P e5256d91808b47c195bc9b4dbd7f2b87 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 16.
I20260709 13:07:05.783483 25952 raft_consensus.cc:493] T 833a2f0775ed407a94b8924ce50adb63 P 127766fc592545a4997f7790f50f6076 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader e61c3a8f61bb48f8a963c9480e53c168)
I20260709 13:07:05.755884 25598 raft_consensus.cc:515] T 2e36a9d6e29c4a7c860cf267efbd4c74 P e5256d91808b47c195bc9b4dbd7f2b87 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:07:05.787688 25832 consensus_queue.cc:1059] T 0e1085d23e8347fbbd5bce7542f4b1f4 P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 }, Status: INVALID_TERM, Last received: 12.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.110s
I20260709 13:07:05.908068 19481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21e14947d70440f19044d8f75c31e1f9" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:07:05.882822 25812 raft_consensus.cc:493] T 309c3ca0ca4b4f3ba129752ea2cb293b P e5256d91808b47c195bc9b4dbd7f2b87 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 0473d2b2d01f4459b1e90fd12cc7840e)
I20260709 13:07:05.893762 25587 leader_election.cc:290] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:07:05.756062 25944 raft_consensus.cc:515] T 65d8cb8d6ec64f459d5a47cefab10acf P 127766fc592545a4997f7790f50f6076 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:07:05.916145 19449 leader_election.cc:304] T 96efeaaf1057492490e9a621f37e1a2d P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e; no voters: 127766fc592545a4997f7790f50f6076, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:07:05.899423 25786 raft_consensus.cc:493] T 21e14947d70440f19044d8f75c31e1f9 P 0473d2b2d01f4459b1e90fd12cc7840e [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:05.909130 25952 raft_consensus.cc:515] T 833a2f0775ed407a94b8924ce50adb63 P 127766fc592545a4997f7790f50f6076 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
W20260709 13:07:05.915540 25922 log.cc:927] Time spent T 86a6797bdfe94fa496c050ceae4bd0d9 P e5256d91808b47c195bc9b4dbd7f2b87: Append to log took a long time: real 1.280s	user 0.000s	sys 0.006s
I20260709 13:07:05.920399 19449 leader_election.cc:304] T 62c6c134d3d24a1ab144dd9ee6bc3f64 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e; no voters: 127766fc592545a4997f7790f50f6076, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:07:05.917572 25953 raft_consensus.cc:2749] T 9962423cb4e54fcfa5de01daf68a86e7 P 0473d2b2d01f4459b1e90fd12cc7840e [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:07:05.901420 25816 raft_consensus.cc:515] T ab43d85f64114d4ebf618930e43d9ed0 P 127766fc592545a4997f7790f50f6076 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:07:05.907719 25520 raft_consensus.cc:2749] T 179fd671030940b4b4a4e24bcc4aba0a P 0473d2b2d01f4459b1e90fd12cc7840e [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
W20260709 13:07:05.912287 25418 consensus_meta.cc:287] T bc225c93219c45538b53a1bd3d387e4d P 0473d2b2d01f4459b1e90fd12cc7840e: Time spent flushing consensus metadata: real 1.153s	user 0.007s	sys 0.005s
W20260709 13:07:05.913748 25948 log.cc:927] Time spent T bc225c93219c45538b53a1bd3d387e4d P e61c3a8f61bb48f8a963c9480e53c168: Append to log took a long time: real 0.169s	user 0.000s	sys 0.001s
I20260709 13:07:05.924166 19405 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52342 (request call id 3228) took 1787 ms. Trace:
I20260709 13:07:05.947906 19405 rpcz_store.cc:276] 0709 13:07:04.136610 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:04.138762 (+  2152us) service_pool.cc:224] Handling call
0709 13:07:04.139155 (+   393us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:04.139505 (+   350us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:04.139537 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:04.140068 (+   531us) log.cc:844] Serialized 26 byte log entry
0709 13:07:04.279481 (+139413us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:07:04.279536 (+    55us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:04.282113 (+  2577us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:05.747929 (+1465816us) spinlock_profiling.cc:243] Waited 52 ms on lock 0x7b4400022b4c. stack: 00007f4a79de9343 00007f4a79de9240 00007f4a797781d4 00007f4a834b6304 00007f4a834b6299 00007f4a79ca3db1 00007f4a79d41c85 00007f4a79d426a2 00007f4a7cab41db 00007f4a7caafaaf 00007f4a7caa386e 00007f4a7caa2bb6 00007f4a7caa27d8 00007f4a7caac221 00007f4a7caac1d9 00007f4a7caac169
0709 13:07:05.923874 (+175945us) raft_consensus.cc:1685] finished
0709 13:07:05.923895 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:05.924106 (+   211us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1531,"raft.run_cpu_time_us":85,"raft.run_wall_time_us":86,"spinlock_wait_cycles":119591168,"thread_start_us":139036,"threads_started":1,"wal-append.queue_time_us":413043}
I20260709 13:07:05.950276 19485 raft_consensus.cc:2468] T bc225c93219c45538b53a1bd3d387e4d P 0473d2b2d01f4459b1e90fd12cc7840e [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 16.
I20260709 13:07:05.924576 25952 leader_election.cc:290] T 833a2f0775ed407a94b8924ce50adb63 P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:07:05.924844 25816 leader_election.cc:290] T ab43d85f64114d4ebf618930e43d9ed0 P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:07:05.925884 19479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff9b0eddd810459b82d91c60777c10eb" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 19 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:07:05.926409 20111 raft_consensus.cc:2468] T ab43d85f64114d4ebf618930e43d9ed0 P 127766fc592545a4997f7790f50f6076 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 20.
I20260709 13:07:05.926568 25920 raft_consensus.cc:3055] T 62c6c134d3d24a1ab144dd9ee6bc3f64 P 127766fc592545a4997f7790f50f6076 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:07:05.922420 25786 raft_consensus.cc:515] T 21e14947d70440f19044d8f75c31e1f9 P 0473d2b2d01f4459b1e90fd12cc7840e [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:07:05.932592 25923 leader_election.cc:290] T 0cdf56e38bbc453d9438d359e5a69955 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
W20260709 13:07:05.933598 25955 log.cc:927] Time spent T b08304a0a02b42d7840c4e8ee9a6bd1a P e61c3a8f61bb48f8a963c9480e53c168: Append to log took a long time: real 0.096s	user 0.001s	sys 0.000s
I20260709 13:07:05.957442 19479 raft_consensus.cc:2393] T ff9b0eddd810459b82d91c60777c10eb P 0473d2b2d01f4459b1e90fd12cc7840e [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 127766fc592545a4997f7790f50f6076 in current term 19: Already voted for candidate 0473d2b2d01f4459b1e90fd12cc7840e in this term.
I20260709 13:07:05.934526 19478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36f6ba92b9ba46babe4ebd6c02e5fbd9" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:07:05.934732 25376 consensus_queue.cc:1059] T 0e1085d23e8347fbbd5bce7542f4b1f4 P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false }, Status: INVALID_TERM, Last received: 12.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.013s
I20260709 13:07:05.922034 25964 raft_consensus.cc:2749] T 96efeaaf1057492490e9a621f37e1a2d P 0473d2b2d01f4459b1e90fd12cc7840e [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 13:07:05.910120 25965 raft_consensus.cc:493] T 4af19371ea874c09a0a2147040835cbb P 127766fc592545a4997f7790f50f6076 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:05.938163 20104 raft_consensus.cc:2468] T ff9b0eddd810459b82d91c60777c10eb P 127766fc592545a4997f7790f50f6076 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 19.
I20260709 13:07:05.937085 25925 raft_consensus.cc:3055] T 179fd671030940b4b4a4e24bcc4aba0a P e5256d91808b47c195bc9b4dbd7f2b87 [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:07:05.943349 20105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4af19371ea874c09a0a2147040835cbb" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:07:05.944849 19449 leader_election.cc:304] T 48824d5acfbc485ebf8c2d944e7202de P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e; no voters: 127766fc592545a4997f7790f50f6076, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:07:05.913043 25957 raft_consensus.cc:493] T ed7fdbcb96d14d418db9ca90a792588a P 0473d2b2d01f4459b1e90fd12cc7840e [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:05.951803 25553 raft_consensus.cc:3055] T 96efeaaf1057492490e9a621f37e1a2d P e61c3a8f61bb48f8a963c9480e53c168 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:07:05.951948 20110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7be9efa6559648dbb5a0f7684c4542d1" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 20 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076"
I20260709 13:07:05.973644 25553 raft_consensus.cc:740] T 96efeaaf1057492490e9a621f37e1a2d P e61c3a8f61bb48f8a963c9480e53c168 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: e61c3a8f61bb48f8a963c9480e53c168, State: Running, Role: LEADER
I20260709 13:07:05.973973 25851 raft_consensus.cc:493] T 65d8cb8d6ec64f459d5a47cefab10acf P e61c3a8f61bb48f8a963c9480e53c168 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader e5256d91808b47c195bc9b4dbd7f2b87)
I20260709 13:07:05.974519 25851 raft_consensus.cc:515] T 65d8cb8d6ec64f459d5a47cefab10acf P e61c3a8f61bb48f8a963c9480e53c168 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:07:05.974822 25553 consensus_queue.cc:260] T 96efeaaf1057492490e9a621f37e1a2d P e61c3a8f61bb48f8a963c9480e53c168 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 19.13, Last appended by leader: 13, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:07:05.976187 25093 leader_election.cc:290] T 1a61655d99124a29b486ba4a5b37faea P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 18 election: Requested vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:07:05.976253 25553 raft_consensus.cc:3060] T 96efeaaf1057492490e9a621f37e1a2d P e61c3a8f61bb48f8a963c9480e53c168 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:07:05.976552 25851 leader_election.cc:290] T 65d8cb8d6ec64f459d5a47cefab10acf P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:07:05.977154 25851 raft_consensus.cc:493] T ab43d85f64114d4ebf618930e43d9ed0 P e61c3a8f61bb48f8a963c9480e53c168 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:05.977583 25851 raft_consensus.cc:515] T ab43d85f64114d4ebf618930e43d9ed0 P e61c3a8f61bb48f8a963c9480e53c168 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:07:05.981767 19556 raft_consensus.cc:1240] T 179fd671030940b4b4a4e24bcc4aba0a P e61c3a8f61bb48f8a963c9480e53c168 [term 21 FOLLOWER]: Rejecting Update request from peer e5256d91808b47c195bc9b4dbd7f2b87 for earlier term 20. Current term is 21. Ops: []
I20260709 13:07:05.982743 25957 raft_consensus.cc:515] T ed7fdbcb96d14d418db9ca90a792588a P 0473d2b2d01f4459b1e90fd12cc7840e [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
W20260709 13:07:05.984658 25936 log.cc:927] Time spent T 309c3ca0ca4b4f3ba129752ea2cb293b P e5256d91808b47c195bc9b4dbd7f2b87: Append to log took a long time: real 0.897s	user 0.003s	sys 0.000s
I20260709 13:07:05.985018 25957 leader_election.cc:290] T ed7fdbcb96d14d418db9ca90a792588a P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:07:05.952746 20106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed7fdbcb96d14d418db9ca90a792588a" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:07:05.985807 25908 raft_consensus.cc:3055] T 775c229504194560ba9589bc2199b089 P 127766fc592545a4997f7790f50f6076 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:07:05.985955 25825 raft_consensus.cc:493] T ece3db938bc649d4a40a51522ed5259c P e61c3a8f61bb48f8a963c9480e53c168 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 127766fc592545a4997f7790f50f6076)
I20260709 13:07:05.986248 25908 raft_consensus.cc:740] T 775c229504194560ba9589bc2199b089 P 127766fc592545a4997f7790f50f6076 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 127766fc592545a4997f7790f50f6076, State: Running, Role: LEADER
I20260709 13:07:05.986541 25825 raft_consensus.cc:515] T ece3db938bc649d4a40a51522ed5259c P e61c3a8f61bb48f8a963c9480e53c168 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:07:05.987149 25908 consensus_queue.cc:260] T 775c229504194560ba9589bc2199b089 P 127766fc592545a4997f7790f50f6076 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:07:05.988211 25766 raft_consensus.cc:493] T 309c3ca0ca4b4f3ba129752ea2cb293b P e61c3a8f61bb48f8a963c9480e53c168 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:05.988629 25825 leader_election.cc:290] T ece3db938bc649d4a40a51522ed5259c P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:07:05.988713 25766 raft_consensus.cc:515] T 309c3ca0ca4b4f3ba129752ea2cb293b P e61c3a8f61bb48f8a963c9480e53c168 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } attrs { replace: true } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:07:05.954366 20108 raft_consensus.cc:606] T ab43d85f64114d4ebf618930e43d9ed0 P 127766fc592545a4997f7790f50f6076 [term 20 FOLLOWER]: Received request to transfer leadership to TS 0473d2b2d01f4459b1e90fd12cc7840e
I20260709 13:07:05.995055 20108 raft_consensus.cc:614] T ab43d85f64114d4ebf618930e43d9ed0 P 127766fc592545a4997f7790f50f6076 [term 20 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:07:05.995249 19484 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58294 (request call id 2895) took 1025 ms. Trace:
I20260709 13:07:05.995651 19484 rpcz_store.cc:276] 0709 13:07:04.969561 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:04.971790 (+  2229us) service_pool.cc:224] Handling call
0709 13:07:05.995078 (+1023288us) spinlock_profiling.cc:243] Waited 581 ms on lock 0x7b5400149454. stack: 00007f4a79de9343 00007f4a79de9240 00007f4a797781d4 00007f4a834b6304 00007f4a834b6299 00007f4a7ce71571 00007f4a7cf0c2fa 00007f4a81ecdb17 00007f4a7b4486d4 00007f4a7b448662 00007f4a7b448591 00007f4a7b44850c 00007f4a7b4477c2 00007f4a7b24348c 00007f4a7b2428c6 00007f4a7b24226f
0709 13:07:05.995192 (+   114us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1335803136}
W20260709 13:07:06.000653 25805 consensus_meta.cc:287] T df751f992649444090e27965eb1af85d P 0473d2b2d01f4459b1e90fd12cc7840e: Time spent flushing consensus metadata: real 0.996s	user 0.008s	sys 0.001s
I20260709 13:07:05.960912 19481 raft_consensus.cc:2468] T 21e14947d70440f19044d8f75c31e1f9 P 0473d2b2d01f4459b1e90fd12cc7840e [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 18.
I20260709 13:07:05.968694 25925 raft_consensus.cc:740] T 179fd671030940b4b4a4e24bcc4aba0a P e5256d91808b47c195bc9b4dbd7f2b87 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: e5256d91808b47c195bc9b4dbd7f2b87, State: Running, Role: LEADER
I20260709 13:07:05.947530 25764 raft_consensus.cc:2749] T 62c6c134d3d24a1ab144dd9ee6bc3f64 P 0473d2b2d01f4459b1e90fd12cc7840e [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:07:06.003794 25925 consensus_queue.cc:260] T 179fd671030940b4b4a4e24bcc4aba0a P e5256d91808b47c195bc9b4dbd7f2b87 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 20.13, Last appended by leader: 13, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:07:05.960479 25786 leader_election.cc:290] T 21e14947d70440f19044d8f75c31e1f9 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:07:05.971558 19557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f575b143b844aa096b50997dad3516a" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:07:06.005023 25925 raft_consensus.cc:3060] T 179fd671030940b4b4a4e24bcc4aba0a P e5256d91808b47c195bc9b4dbd7f2b87 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:07:06.005129 19557 raft_consensus.cc:3060] T 7f575b143b844aa096b50997dad3516a P e61c3a8f61bb48f8a963c9480e53c168 [term 14 FOLLOWER]: Advancing to term 16
I20260709 13:07:05.973827 25754 raft_consensus.cc:493] T 22196caba61445d3bec98a0aab3c337d P e61c3a8f61bb48f8a963c9480e53c168 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 0473d2b2d01f4459b1e90fd12cc7840e)
I20260709 13:07:06.006814 25754 raft_consensus.cc:515] T 22196caba61445d3bec98a0aab3c337d P e61c3a8f61bb48f8a963c9480e53c168 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:07:06.008816 25754 leader_election.cc:290] T 22196caba61445d3bec98a0aab3c337d P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:07:05.973852 20110 raft_consensus.cc:3060] T 7be9efa6559648dbb5a0f7684c4542d1 P 127766fc592545a4997f7790f50f6076 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:07:05.972071 19555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76cb037fc9064d13b59a8969d897ce8c" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:07:05.971891 19478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "775c229504194560ba9589bc2199b089" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:07:06.010948 19555 raft_consensus.cc:3060] T 76cb037fc9064d13b59a8969d897ce8c P e61c3a8f61bb48f8a963c9480e53c168 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:07:06.011188 19478 raft_consensus.cc:2468] T 775c229504194560ba9589bc2199b089 P 0473d2b2d01f4459b1e90fd12cc7840e [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 13.
I20260709 13:07:05.972646 19554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e1f505cb0f1427bbd698ac889d80821" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:07:05.914239 25812 raft_consensus.cc:515] T 309c3ca0ca4b4f3ba129752ea2cb293b P e5256d91808b47c195bc9b4dbd7f2b87 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:07:06.023706 19557 raft_consensus.cc:2468] T 7f575b143b844aa096b50997dad3516a P e61c3a8f61bb48f8a963c9480e53c168 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 16.
I20260709 13:07:06.019361 19555 raft_consensus.cc:2468] T 76cb037fc9064d13b59a8969d897ce8c P e61c3a8f61bb48f8a963c9480e53c168 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 18.
W20260709 13:07:06.021279 19449 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.4:43121, user_credentials={real_user=slave}} blocked reactor thread for 47580us
I20260709 13:07:06.025409 19449 leader_election.cc:304] T 14efcc79969f41babe5529c22d59156d P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e; no voters: 127766fc592545a4997f7790f50f6076, e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:07:06.026149 19555 raft_consensus.cc:1240] T 14935b3ddf914369822e4a0547aaa355 P e61c3a8f61bb48f8a963c9480e53c168 [term 13 FOLLOWER]: Rejecting Update request from peer 127766fc592545a4997f7790f50f6076 for earlier term 12. Current term is 13. Ops: []
I20260709 13:07:06.028666 19554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ece3db938bc649d4a40a51522ed5259c" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:07:06.027510 25747 raft_consensus.cc:493] T a08760e15aac4630a629431f56024dc8 P e61c3a8f61bb48f8a963c9480e53c168 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader e5256d91808b47c195bc9b4dbd7f2b87)
I20260709 13:07:06.026780 25964 raft_consensus.cc:2749] T 48824d5acfbc485ebf8c2d944e7202de P 0473d2b2d01f4459b1e90fd12cc7840e [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:07:06.031148 25812 leader_election.cc:290] T 309c3ca0ca4b4f3ba129752ea2cb293b P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:07:06.030205 25747 raft_consensus.cc:515] T a08760e15aac4630a629431f56024dc8 P e61c3a8f61bb48f8a963c9480e53c168 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
W20260709 13:07:06.033214 25909 log.cc:927] Time spent T ff75a1d4cb1f493db8f71ddc136ba9ab P 0473d2b2d01f4459b1e90fd12cc7840e: Append to log took a long time: real 1.509s	user 0.011s	sys 0.007s
I20260709 13:07:06.034857 25747 leader_election.cc:290] T a08760e15aac4630a629431f56024dc8 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:07:06.035032 25766 leader_election.cc:290] T 309c3ca0ca4b4f3ba129752ea2cb293b P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:07:06.040211 19560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a61655d99124a29b486ba4a5b37faea" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 18 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:07:06.042544 19554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70797e5783b5454ab0d0eea663e791e3" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 22 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:07:06.043139 19554 raft_consensus.cc:3060] T 70797e5783b5454ab0d0eea663e791e3 P e61c3a8f61bb48f8a963c9480e53c168 [term 21 FOLLOWER]: Advancing to term 22
W20260709 13:07:06.045382 25969 log.cc:927] Time spent T 1a61655d99124a29b486ba4a5b37faea P 0473d2b2d01f4459b1e90fd12cc7840e: Append to log took a long time: real 0.073s	user 0.000s	sys 0.000s
W20260709 13:07:06.046895 25961 log.cc:927] Time spent T fa731b585f684a7fb2d106c50f143b83 P e61c3a8f61bb48f8a963c9480e53c168: Append to log took a long time: real 0.154s	user 0.002s	sys 0.000s
I20260709 13:07:06.047261 19560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "833a2f0775ed407a94b8924ce50adb63" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:07:06.048825 19560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b08304a0a02b42d7840c4e8ee9a6bd1a" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:07:06.055197 19555 raft_consensus.cc:3055] T d1e5873a19244c5ebbcd38e126796ee7 P e61c3a8f61bb48f8a963c9480e53c168 [term 21 LEADER]: Stepping down as leader of term 21
I20260709 13:07:06.055557 19555 raft_consensus.cc:740] T d1e5873a19244c5ebbcd38e126796ee7 P e61c3a8f61bb48f8a963c9480e53c168 [term 21 LEADER]: Becoming Follower/Learner. State: Replica: e61c3a8f61bb48f8a963c9480e53c168, State: Running, Role: LEADER
I20260709 13:07:06.056815 19554 raft_consensus.cc:2468] T 70797e5783b5454ab0d0eea663e791e3 P e61c3a8f61bb48f8a963c9480e53c168 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 22.
I20260709 13:07:06.021611 20110 raft_consensus.cc:2468] T 7be9efa6559648dbb5a0f7684c4542d1 P 127766fc592545a4997f7790f50f6076 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 20.
I20260709 13:07:05.898641 25837 raft_consensus.cc:515] T 4509b76741dc428e9201c70c1658da13 P 0473d2b2d01f4459b1e90fd12cc7840e [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:07:05.956452 25920 raft_consensus.cc:740] T 62c6c134d3d24a1ab144dd9ee6bc3f64 P 127766fc592545a4997f7790f50f6076 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 127766fc592545a4997f7790f50f6076, State: Running, Role: LEADER
I20260709 13:07:06.052004 19483 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58294 (request call id 2884) took 2339 ms. Trace:
I20260709 13:07:05.962587 25816 consensus_queue.cc:1048] T 70797e5783b5454ab0d0eea663e791e3 P 127766fc592545a4997f7790f50f6076 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 13, Time since last communication: 0.088s
I20260709 13:07:06.023581 25829 leader_election.cc:290] T ab43d85f64114d4ebf618930e43d9ed0 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:07:06.024318 25962 raft_consensus.cc:493] T 85c494af21f9457a85da47b9bc70c1fd P 127766fc592545a4997f7790f50f6076 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader e61c3a8f61bb48f8a963c9480e53c168)
I20260709 13:07:06.075428 20109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed7fdbcb96d14d418db9ca90a792588a" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 17 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:07:06.076086 19554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa731b585f684a7fb2d106c50f143b83" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:07:06.056272 19555 consensus_queue.cc:260] T d1e5873a19244c5ebbcd38e126796ee7 P e61c3a8f61bb48f8a963c9480e53c168 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 21.11, Last appended by leader: 11, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:07:06.091432 19555 raft_consensus.cc:3060] T d1e5873a19244c5ebbcd38e126796ee7 P e61c3a8f61bb48f8a963c9480e53c168 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:07:06.061385 19483 rpcz_store.cc:276] 0709 13:07:03.712722 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:03.725693 (+ 12971us) service_pool.cc:224] Handling call
0709 13:07:03.725980 (+   287us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:03.726309 (+   329us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:03.726335 (+    26us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:03.726876 (+   541us) log.cc:844] Serialized 26 byte log entry
0709 13:07:04.033048 (+306172us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:07:04.058982 (+ 25934us) log.cc:844] Serialized 14 byte log entry
0709 13:07:04.059192 (+   210us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:04.059266 (+    74us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:04.138482 (+ 79216us) spinlock_profiling.cc:243] Waited 2.63 ms on lock 0x7b18003f4480. stack: 00007f4a79de9343 00007f4a79de9240 00007f4a797781d4 00007f4a834b6304 00007f4a834b6299 00007f4a82ce3de1 00007f4a82cf05b1 00007f4a79e1b3f3 00007f4a79e1d7c1 00007f4a79e1d779 00007f4a79e1d709 00007f4a79e1d6d1 00007f4a79e1c9cd 000000000038f354 000000000038f199 00007f4a79dfe83a
0709 13:07:06.032967 (+1894485us) spinlock_profiling.cc:243] Waited 7.05 ms on lock 0x7b2400275dc8. stack: 00007f4a79de9343 00007f4a79de9240 00007f4a797781d4 00007f4a834b6304 00007f4a834b6299 00007f4a79ca3db1 00007f4a79ca19c4 00007f4a79c9facb 00007f4a79e5adc9 00007f4a79e5aa55 00007f4a79e5a09d 00007f4a7ca8c10e 00007f4a7caa388c 00007f4a7caa2bb6 00007f4a7caa27d8 00007f4a7caac221
0709 13:07:06.051825 (+ 18858us) raft_consensus.cc:1685] finished
0709 13:07:06.051846 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:06.051956 (+   110us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":79550,"prepare.queue_time_us":25785,"prepare.run_cpu_time_us":36,"prepare.run_wall_time_us":38,"raft.queue_time_us":10867,"raft.run_cpu_time_us":218,"raft.run_wall_time_us":14872,"spinlock_wait_cycles":22265088,"thread_start_us":246090,"threads_started":1,"wal-append.queue_time_us":494134}
I20260709 13:07:06.093427 19554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "833a2f0775ed407a94b8924ce50adb63" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:07:06.072953 25530 raft_consensus.cc:2749] T 14efcc79969f41babe5529c22d59156d P 0473d2b2d01f4459b1e90fd12cc7840e [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:07:06.084635 19559 raft_consensus.cc:1240] T fa8650e71aa14778b3d73721fc50d9fc P e61c3a8f61bb48f8a963c9480e53c168 [term 19 FOLLOWER]: Rejecting Update request from peer e5256d91808b47c195bc9b4dbd7f2b87 for earlier term 18. Current term is 19. Ops: []
W20260709 13:07:06.050328 25859 consensus_meta.cc:287] T 5ec1c4ce15e04c7e8c283a62179f2a64 P 0473d2b2d01f4459b1e90fd12cc7840e: Time spent flushing consensus metadata: real 1.019s	user 0.004s	sys 0.004s
W20260709 13:07:06.089668 19375 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.3:36891, user_credentials={real_user=slave}} blocked reactor thread for 160007us
I20260709 13:07:06.101799 19405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef32ce6fdd0e40d382c79974f30295c6" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 23 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:07:06.101934 19556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab43d85f64114d4ebf618930e43d9ed0" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:07:06.102485 19556 raft_consensus.cc:2468] T ab43d85f64114d4ebf618930e43d9ed0 P e61c3a8f61bb48f8a963c9480e53c168 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 127766fc592545a4997f7790f50f6076 in term 20.
I20260709 13:07:06.070588 25763 raft_consensus.cc:3055] T 22196caba61445d3bec98a0aab3c337d P 0473d2b2d01f4459b1e90fd12cc7840e [term 18 LEADER]: Stepping down as leader of term 18
W20260709 13:07:06.068771 25967 log.cc:927] Time spent T f93ee515a9c14139bf566522ed8232f3 P 0473d2b2d01f4459b1e90fd12cc7840e: Append to log took a long time: real 0.113s	user 0.000s	sys 0.001s
I20260709 13:07:06.095799 19554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a16f7501e2444fb86d4e2778e734e02" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:07:06.099435 19402 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52342 (request call id 3232) took 1961 ms. Trace:
I20260709 13:07:06.104259 19555 raft_consensus.cc:1275] T d1e5873a19244c5ebbcd38e126796ee7 P e61c3a8f61bb48f8a963c9480e53c168 [term 22 FOLLOWER]: Refusing update from remote peer e5256d91808b47c195bc9b4dbd7f2b87: Log matching property violated. Preceding OpId in replica: term: 21 index: 11. Preceding OpId from leader: term: 22 index: 11. (term mismatch)
I20260709 13:07:06.105142 19555 pending_rounds.cc:85] T d1e5873a19244c5ebbcd38e126796ee7 P e61c3a8f61bb48f8a963c9480e53c168: Aborting all ops after (but not including) 10
I20260709 13:07:06.103114 19410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "179fd671030940b4b4a4e24bcc4aba0a" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
I20260709 13:07:06.105492 19555 pending_rounds.cc:107] T d1e5873a19244c5ebbcd38e126796ee7 P e61c3a8f61bb48f8a963c9480e53c168: Aborting uncommitted NO_OP operation due to leader change: 21.11
I20260709 13:07:06.105343 19409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e36a9d6e29c4a7c860cf267efbd4c74" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:07:06.105863 19555 raft_consensus.cc:2889] T d1e5873a19244c5ebbcd38e126796ee7 P e61c3a8f61bb48f8a963c9480e53c168 [term 22 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:07:06.107179 19553 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40428 (request call id 3291) took 1019 ms. Trace:
I20260709 13:07:06.107607 19553 rpcz_store.cc:276] 0709 13:07:05.087454 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:05.088285 (+   831us) service_pool.cc:224] Handling call
0709 13:07:05.088552 (+   267us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:05.088871 (+   319us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:05.088898 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:05.089320 (+   422us) log.cc:844] Serialized 26 byte log entry
0709 13:07:05.579851 (+490531us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:07:05.606441 (+ 26590us) log.cc:844] Serialized 14 byte log entry
0709 13:07:05.606727 (+   286us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:05.606823 (+    96us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:06.044318 (+437495us) spinlock_profiling.cc:243] Waited 9.06 ms on lock 0x7b180048d9c0. stack: 00007f4a79de9343 00007f4a79de9240 00007f4a797781d4 00007f4a834b6304 00007f4a834b6299 00007f4a82ce3de1 00007f4a82cf05b1 00007f4a79e1b522 00007f4a79e1d7c1 00007f4a79e1d779 00007f4a79e1d709 00007f4a79e1d6d1 00007f4a79e1c9cd 000000000038f354 000000000038f199 00007f4a79dfe83a
0709 13:07:06.106843 (+ 62525us) raft_consensus.cc:1685] finished
0709 13:07:06.106980 (+   137us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:06.107122 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":27044,"prepare.run_cpu_time_us":42,"prepare.run_wall_time_us":43,"raft.queue_time_us":3938,"raft.run_cpu_time_us":250,"raft.run_wall_time_us":18176,"spinlock_wait_cycles":20834048,"thread_start_us":402278,"threads_started":1,"wal-append.queue_time_us":665866}
W20260709 13:07:06.109776 25661 consensus_meta.cc:287] T df751f992649444090e27965eb1af85d P e61c3a8f61bb48f8a963c9480e53c168: Time spent flushing consensus metadata: real 1.369s	user 0.011s	sys 0.001s
I20260709 13:07:05.972919 25965 raft_consensus.cc:515] T 4af19371ea874c09a0a2147040835cbb P 127766fc592545a4997f7790f50f6076 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:07:06.100461 25962 raft_consensus.cc:515] T 85c494af21f9457a85da47b9bc70c1fd P 127766fc592545a4997f7790f50f6076 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:07:06.111042 19408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc225c93219c45538b53a1bd3d387e4d" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:07:06.111792 19408 raft_consensus.cc:2393] T bc225c93219c45538b53a1bd3d387e4d P e5256d91808b47c195bc9b4dbd7f2b87 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e61c3a8f61bb48f8a963c9480e53c168 in current term 16: Already voted for candidate e5256d91808b47c195bc9b4dbd7f2b87 in this term.
I20260709 13:07:06.111936 25965 leader_election.cc:290] T 4af19371ea874c09a0a2147040835cbb P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:07:06.112112 25962 leader_election.cc:290] T 85c494af21f9457a85da47b9bc70c1fd P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:07:06.112780 19552 raft_consensus.cc:2468] T df751f992649444090e27965eb1af85d P e61c3a8f61bb48f8a963c9480e53c168 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 21.
I20260709 13:07:06.113313 25591 leader_election.cc:290] T 1f85fc4b527a48848e5faa083b604e36 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:07:06.114924 19552 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40428 (request call id 3282) took 1441 ms. Trace:
I20260709 13:07:06.115207 20105 raft_consensus.cc:2468] T 4af19371ea874c09a0a2147040835cbb P 127766fc592545a4997f7790f50f6076 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 10.
I20260709 13:07:06.115379 19552 rpcz_store.cc:276] 0709 13:07:04.673105 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:04.673227 (+   122us) service_pool.cc:224] Handling call
0709 13:07:06.114757 (+1441530us) spinlock_profiling.cc:243] Waited 1.44 s on lock 0x7b54002f12d4. stack: 00007f4a79de9343 00007f4a79de9240 00007f4a797781d4 00007f4a834b6304 00007f4a834b6299 00007f4a7ce71571 00007f4a7cf0c2fa 00007f4a81ecdb17 00007f4a7b4486d4 00007f4a7b448662 00007f4a7b448591 00007f4a7b44850c 00007f4a7b4477c2 00007f4a7b24348c 00007f4a7b2428c6 00007f4a7b24226f
0709 13:07:06.114869 (+   112us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3308279680}
I20260709 13:07:06.104321 19402 rpcz_store.cc:276] 0709 13:07:04.137738 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:04.285700 (+147962us) service_pool.cc:224] Handling call
0709 13:07:04.285972 (+   272us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:04.591424 (+305452us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:04.591454 (+    30us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:04.591496 (+    42us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:07:04.591531 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:06.099235 (+1507704us) spinlock_profiling.cc:243] Waited 305 ms on lock 0x7b540023a354. stack: 00007f4a79de9343 00007f4a79de9240 00007f4a797781d4 00007f4a834b6304 00007f4a834b6299 00007f4a7ce71571 00007f4a7cf08e01 00007f4a7cf0783e 00007f4a81ecc419 00007f4a7b443bd4 00007f4a7b443b62 00007f4a7b443a91 00007f4a7b443a0c 00007f4a7b442cc2 00007f4a7b24348c 00007f4a7b2428c6
0709 13:07:06.099278 (+    43us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:06.099384 (+   106us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":702066432}
I20260709 13:07:06.027873 25805 raft_consensus.cc:515] T df751f992649444090e27965eb1af85d P 0473d2b2d01f4459b1e90fd12cc7840e [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:07:06.051612 25957 consensus_queue.cc:1048] T 309c3ca0ca4b4f3ba129752ea2cb293b P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Connected to new peer: Peer: permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.044s
I20260709 13:07:06.119951 19402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7be9efa6559648dbb5a0f7684c4542d1" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 20 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
I20260709 13:07:06.123253 19402 raft_consensus.cc:3060] T 7be9efa6559648dbb5a0f7684c4542d1 P e5256d91808b47c195bc9b4dbd7f2b87 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:07:06.125901 19405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e381f1d6b8184797ad142de49be225a8" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 17 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:07:06.126814 19405 raft_consensus.cc:2468] T e381f1d6b8184797ad142de49be225a8 P e5256d91808b47c195bc9b4dbd7f2b87 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 16.
I20260709 13:07:06.083731 25764 consensus_queue.cc:1059] T b08304a0a02b42d7840c4e8ee9a6bd1a P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 }, Status: INVALID_TERM, Last received: 19.11, Next index: 12, Last known committed idx: 10, Time since last communication: 0.045s
I20260709 13:07:06.105291 25763 raft_consensus.cc:740] T 22196caba61445d3bec98a0aab3c337d P 0473d2b2d01f4459b1e90fd12cc7840e [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 0473d2b2d01f4459b1e90fd12cc7840e, State: Running, Role: LEADER
I20260709 13:07:06.113010 25598 leader_election.cc:290] T 2e36a9d6e29c4a7c860cf267efbd4c74 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:07:06.136905 19555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e381f1d6b8184797ad142de49be225a8" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 17 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:07:06.137578 19555 raft_consensus.cc:2468] T e381f1d6b8184797ad142de49be225a8 P e61c3a8f61bb48f8a963c9480e53c168 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 16.
I20260709 13:07:06.132721 19523 leader_election.cc:304] T fa8650e71aa14778b3d73721fc50d9fc P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e61c3a8f61bb48f8a963c9480e53c168; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:07:06.135098 19405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b74109013a140ada21feeef92d6f563" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 17 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
W20260709 13:07:06.135568 19449 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.1:40321, user_credentials={real_user=slave}} blocked reactor thread for 60730.3us
I20260709 13:07:06.118458 25824 raft_consensus.cc:493] T df751f992649444090e27965eb1af85d P e61c3a8f61bb48f8a963c9480e53c168 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:06.138141 19409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "217b5fae677b4971b3bbd2f357a1f7ff" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:07:06.138411 19405 raft_consensus.cc:2468] T 2b74109013a140ada21feeef92d6f563 P e5256d91808b47c195bc9b4dbd7f2b87 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 16.
I20260709 13:07:06.145233 19405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4af19371ea874c09a0a2147040835cbb" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:07:06.147114 19408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28af091831594f9d8e96482078cc7625" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:07:06.147789 19402 raft_consensus.cc:2468] T 7be9efa6559648dbb5a0f7684c4542d1 P e5256d91808b47c195bc9b4dbd7f2b87 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 20.
I20260709 13:07:06.114395 25920 consensus_queue.cc:260] T 62c6c134d3d24a1ab144dd9ee6bc3f64 P 127766fc592545a4997f7790f50f6076 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.13, Last appended by leader: 13, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:07:06.148779 19523 leader_election.cc:304] T 86a6797bdfe94fa496c050ceae4bd0d9 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e61c3a8f61bb48f8a963c9480e53c168; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:07:06.105355 25859 raft_consensus.cc:515] T 5ec1c4ce15e04c7e8c283a62179f2a64 P 0473d2b2d01f4459b1e90fd12cc7840e [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:07:06.155576 19555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9f0d59553ad444883fcf5b5909f9798" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:07:06.157773 19555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a61655d99124a29b486ba4a5b37faea" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 18 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:07:06.159118 19410 raft_consensus.cc:2410] T 179fd671030940b4b4a4e24bcc4aba0a P e5256d91808b47c195bc9b4dbd7f2b87 [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate e61c3a8f61bb48f8a963c9480e53c168 for term 21 because replica has last-logged OpId of term: 20 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 19 index: 12.
I20260709 13:07:06.159572 19551 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40428 (request call id 3287) took 1084 ms. Trace:
I20260709 13:07:06.159958 19551 rpcz_store.cc:276] 0709 13:07:05.075668 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:05.076275 (+   607us) service_pool.cc:224] Handling call
0709 13:07:05.076625 (+   350us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:05.267064 (+190439us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:05.267096 (+    32us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:05.267139 (+    43us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:07:05.267171 (+    32us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:06.159342 (+892171us) spinlock_profiling.cc:243] Waited 190 ms on lock 0x7b540030acd4. stack: 00007f4a79de9343 00007f4a79de9240 00007f4a797781d4 00007f4a834b6304 00007f4a834b6299 00007f4a7ce71571 00007f4a7cf08e01 00007f4a7cf0783e 00007f4a81ecc419 00007f4a7b443bd4 00007f4a7b443b62 00007f4a7b443a91 00007f4a7b443a0c 00007f4a7b442cc2 00007f4a7b24348c 00007f4a7b2428c6
0709 13:07:06.159390 (+    48us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:06.159517 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":437524224}
I20260709 13:07:06.151504 25851 leader_election.cc:290] T ab43d85f64114d4ebf618930e43d9ed0 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:07:06.164276 20078 leader_election.cc:304] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 127766fc592545a4997f7790f50f6076; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:07:06.165042 25920 raft_consensus.cc:3060] T 62c6c134d3d24a1ab144dd9ee6bc3f64 P 127766fc592545a4997f7790f50f6076 [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:07:06.165553 20077 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:06.166157 25962 raft_consensus.cc:2749] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P 127766fc592545a4997f7790f50f6076 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:07:06.140895 25824 raft_consensus.cc:515] T df751f992649444090e27965eb1af85d P e61c3a8f61bb48f8a963c9480e53c168 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:07:06.168051 19477 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58286 (request call id 2651) took 1048 ms. Trace:
I20260709 13:07:06.168437 19477 rpcz_store.cc:276] 0709 13:07:05.120100 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:05.124331 (+  4231us) service_pool.cc:224] Handling call
0709 13:07:06.167883 (+1043552us) spinlock_profiling.cc:243] Waited 219 ms on lock 0x7b5400353c54. stack: 00007f4a79de9343 00007f4a79de9240 00007f4a797781d4 00007f4a834b6304 00007f4a834b6299 00007f4a7ce71571 00007f4a7cf0c2fa 00007f4a81ecdb17 00007f4a7b4486d4 00007f4a7b448662 00007f4a7b448591 00007f4a7b44850c 00007f4a7b4477c2 00007f4a7b24348c 00007f4a7b2428c6 00007f4a7b24226f
0709 13:07:06.167993 (+   110us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":503600000}
I20260709 13:07:06.170506 25824 leader_election.cc:290] T df751f992649444090e27965eb1af85d P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:07:06.152127 25944 leader_election.cc:290] T 65d8cb8d6ec64f459d5a47cefab10acf P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:07:06.170766 25865 consensus_queue.cc:1059] T 1a61655d99124a29b486ba4a5b37faea P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 }, Status: INVALID_TERM, Last received: 14.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:07:06.171361 25747 raft_consensus.cc:2749] T 86a6797bdfe94fa496c050ceae4bd0d9 P e61c3a8f61bb48f8a963c9480e53c168 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:07:06.171751 25865 raft_consensus.cc:3055] T 1a61655d99124a29b486ba4a5b37faea P e61c3a8f61bb48f8a963c9480e53c168 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:07:06.171481 25905 raft_consensus.cc:3060] T ed7fdbcb96d14d418db9ca90a792588a P 127766fc592545a4997f7790f50f6076 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:07:06.173035 20078 leader_election.cc:304] T 6c5eebf646ad445a9d1b1adc319d7b16 P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 127766fc592545a4997f7790f50f6076; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:07:06.176121 19552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b74109013a140ada21feeef92d6f563" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 17 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:07:06.177201 19551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef32ce6fdd0e40d382c79974f30295c6" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 23 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:07:06.140479 25832 raft_consensus.cc:493] T edd7d470b5014c9489be7f41f64355c9 P 0473d2b2d01f4459b1e90fd12cc7840e [term 22 FOLLOWER]: Starting pre-election (detected failure of leader e5256d91808b47c195bc9b4dbd7f2b87)
I20260709 13:07:06.177675 19553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21e14947d70440f19044d8f75c31e1f9" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:07:06.178503 19554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dc5b3532fe54f74876d02beffa2c230" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 21 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:07:06.177433 19555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28af091831594f9d8e96482078cc7625" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:07:06.180594 19551 raft_consensus.cc:2468] T ef32ce6fdd0e40d382c79974f30295c6 P e61c3a8f61bb48f8a963c9480e53c168 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 22.
I20260709 13:07:06.180521 19552 raft_consensus.cc:2468] T 2b74109013a140ada21feeef92d6f563 P e61c3a8f61bb48f8a963c9480e53c168 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 16.
I20260709 13:07:06.187547 19552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab43d85f64114d4ebf618930e43d9ed0" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 18 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:07:06.188303 19552 raft_consensus.cc:1813] T ab43d85f64114d4ebf618930e43d9ed0 P e61c3a8f61bb48f8a963c9480e53c168 [term 20 FOLLOWER]: Handling vote request from an unknown peer e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:07:06.189188 19556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cdf56e38bbc453d9438d359e5a69955" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:07:06.191960 19552 raft_consensus.cc:2368] T ab43d85f64114d4ebf618930e43d9ed0 P e61c3a8f61bb48f8a963c9480e53c168 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e5256d91808b47c195bc9b4dbd7f2b87 for earlier term 18. Current term is 20.
I20260709 13:07:06.136220 25661 consensus_queue.cc:1048] T 1dc5b3532fe54f74876d02beffa2c230 P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.043s
W20260709 13:07:06.208508 25914 log.cc:927] Time spent T 1a61655d99124a29b486ba4a5b37faea P e61c3a8f61bb48f8a963c9480e53c168: Append to log took a long time: real 1.557s	user 0.002s	sys 0.005s
I20260709 13:07:06.193533 25832 raft_consensus.cc:515] T edd7d470b5014c9489be7f41f64355c9 P 0473d2b2d01f4459b1e90fd12cc7840e [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:07:06.186990 19551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40e1e16737a842ee936002830f36882e" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:07:06.194149 19523 leader_election.cc:304] T 46c5bfeecc314717bffe987e6844b6d0 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 25 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:07:06.195324 19560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e36a9d6e29c4a7c860cf267efbd4c74" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:07:06.153628 25553 raft_consensus.cc:2749] T fa8650e71aa14778b3d73721fc50d9fc P e61c3a8f61bb48f8a963c9480e53c168 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:07:06.190742 25944 raft_consensus.cc:2749] T 6c5eebf646ad445a9d1b1adc319d7b16 P 127766fc592545a4997f7790f50f6076 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:07:06.200388 25859 leader_election.cc:290] T 5ec1c4ce15e04c7e8c283a62179f2a64 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 13 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:07:06.172219 25865 raft_consensus.cc:740] T 1a61655d99124a29b486ba4a5b37faea P e61c3a8f61bb48f8a963c9480e53c168 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: e61c3a8f61bb48f8a963c9480e53c168, State: Running, Role: LEADER
I20260709 13:07:06.203879 25837 leader_election.cc:290] T 4509b76741dc428e9201c70c1658da13 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:07:06.206162 25805 leader_election.cc:290] T df751f992649444090e27965eb1af85d P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 22 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:07:06.189924 25763 consensus_queue.cc:260] T 22196caba61445d3bec98a0aab3c337d P 0473d2b2d01f4459b1e90fd12cc7840e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.11, Last appended by leader: 11, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:07:06.210565 19560 raft_consensus.cc:2468] T 2e36a9d6e29c4a7c860cf267efbd4c74 P e61c3a8f61bb48f8a963c9480e53c168 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 13.
I20260709 13:07:06.223332 25763 raft_consensus.cc:3060] T 22196caba61445d3bec98a0aab3c337d P 0473d2b2d01f4459b1e90fd12cc7840e [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:07:06.219799 25661 raft_consensus.cc:2804] T 46c5bfeecc314717bffe987e6844b6d0 P e61c3a8f61bb48f8a963c9480e53c168 [term 25 FOLLOWER]: Leader election won for term 25
I20260709 13:07:06.224205 25661 raft_consensus.cc:697] T 46c5bfeecc314717bffe987e6844b6d0 P e61c3a8f61bb48f8a963c9480e53c168 [term 25 LEADER]: Becoming Leader. State: Replica: e61c3a8f61bb48f8a963c9480e53c168, State: Running, Role: LEADER
I20260709 13:07:06.225036 25661 consensus_queue.cc:237] T 46c5bfeecc314717bffe987e6844b6d0 P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 23.12, Last appended by leader: 12, Current term: 25, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
W20260709 13:07:06.226867 20075 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:06.211251 19375 leader_election.cc:304] T 3e1f505cb0f1427bbd698ac889d80821 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:07:06.218158 19523 leader_election.cc:304] T e381f1d6b8184797ad142de49be225a8 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:07:06.228397 19523 leader_election.cc:304] T 2b74109013a140ada21feeef92d6f563 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:07:06.228981 25827 raft_consensus.cc:2804] T e381f1d6b8184797ad142de49be225a8 P e61c3a8f61bb48f8a963c9480e53c168 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:07:06.229367 25827 raft_consensus.cc:493] T e381f1d6b8184797ad142de49be225a8 P e61c3a8f61bb48f8a963c9480e53c168 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:06.229516 19523 leader_election.cc:304] T 14935b3ddf914369822e4a0547aaa355 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e61c3a8f61bb48f8a963c9480e53c168; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, 127766fc592545a4997f7790f50f6076
I20260709 13:07:06.229727 25827 raft_consensus.cc:3060] T e381f1d6b8184797ad142de49be225a8 P e61c3a8f61bb48f8a963c9480e53c168 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:07:06.230360 25851 raft_consensus.cc:2804] T 2b74109013a140ada21feeef92d6f563 P e61c3a8f61bb48f8a963c9480e53c168 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:07:06.230774 25851 raft_consensus.cc:493] T 2b74109013a140ada21feeef92d6f563 P e61c3a8f61bb48f8a963c9480e53c168 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:06.231094 25851 raft_consensus.cc:3060] T 2b74109013a140ada21feeef92d6f563 P e61c3a8f61bb48f8a963c9480e53c168 [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:07:06.231819 25715 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 22 current term: 22 is higher.
I20260709 13:07:06.232868 25715 raft_consensus.cc:2749] T 14935b3ddf914369822e4a0547aaa355 P e61c3a8f61bb48f8a963c9480e53c168 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:07:06.235498 19523 leader_election.cc:304] T 0e1085d23e8347fbbd5bce7542f4b1f4 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 127766fc592545a4997f7790f50f6076, e61c3a8f61bb48f8a963c9480e53c168; no voters: 0473d2b2d01f4459b1e90fd12cc7840e
I20260709 13:07:06.236315 25553 raft_consensus.cc:2804] T 0e1085d23e8347fbbd5bce7542f4b1f4 P e61c3a8f61bb48f8a963c9480e53c168 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:07:06.236829 25553 raft_consensus.cc:697] T 0e1085d23e8347fbbd5bce7542f4b1f4 P e61c3a8f61bb48f8a963c9480e53c168 [term 15 LEADER]: Becoming Leader. State: Replica: e61c3a8f61bb48f8a963c9480e53c168, State: Running, Role: LEADER
I20260709 13:07:06.237668 25553 consensus_queue.cc:237] T 0e1085d23e8347fbbd5bce7542f4b1f4 P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 12, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:07:06.241405 19523 leader_election.cc:304] T 4af19371ea874c09a0a2147040835cbb P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 127766fc592545a4997f7790f50f6076, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
W20260709 13:07:06.243165 19411 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52342 (request call id 3240) took 1460 ms (client timeout 1905 ms). Trace:
W20260709 13:07:06.258292 19411 rpcz_store.cc:269] 0709 13:07:04.782367 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:04.795010 (+ 12643us) service_pool.cc:224] Handling call
0709 13:07:06.242972 (+1447962us) spinlock_profiling.cc:243] Waited 43.9 ms on lock 0x7b54001ff4d4. stack: 00007f4a79de9343 00007f4a79de9240 00007f4a797781d4 00007f4a834b6304 00007f4a834b6299 00007f4a7ce71571 00007f4a7cf0c2fa 00007f4a81ecdb17 00007f4a7b4486d4 00007f4a7b448662 00007f4a7b448591 00007f4a7b44850c 00007f4a7b4477c2 00007f4a7b24348c 00007f4a7b2428c6 00007f4a7b24226f
0709 13:07:06.243102 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":100992896}
I20260709 13:07:06.258661 20106 raft_consensus.cc:2468] T ed7fdbcb96d14d418db9ca90a792588a P 127766fc592545a4997f7790f50f6076 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 16.
I20260709 13:07:06.243043 25865 consensus_queue.cc:260] T 1a61655d99124a29b486ba4a5b37faea P e61c3a8f61bb48f8a963c9480e53c168 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.11, Last appended by leader: 11, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:07:06.260146 25865 raft_consensus.cc:3060] T 1a61655d99124a29b486ba4a5b37faea P e61c3a8f61bb48f8a963c9480e53c168 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:07:06.269747 20106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65d8cb8d6ec64f459d5a47cefab10acf" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:07:06.270403 20106 raft_consensus.cc:2468] T 65d8cb8d6ec64f459d5a47cefab10acf P 127766fc592545a4997f7790f50f6076 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 19.
I20260709 13:07:06.248137 25815 leader_election.cc:290] T 1efebf73c86e432baa55533136b6e12c P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 15 election: Requested vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:07:06.251955 25803 leader_election.cc:290] T a08760e15aac4630a629431f56024dc8 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:07:06.252729 25530 raft_consensus.cc:3055] T b08304a0a02b42d7840c4e8ee9a6bd1a P 0473d2b2d01f4459b1e90fd12cc7840e [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:07:06.253724 25938 raft_consensus.cc:3060] T 14935b3ddf914369822e4a0547aaa355 P 127766fc592545a4997f7790f50f6076 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:07:06.255259 19485 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58286 (request call id 2660) took 1132 ms. Trace:
W20260709 13:07:06.255998 19404 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52342 (request call id 3230) took 2118 ms (client timeout 1636 ms). Trace:
W20260709 13:07:06.272572 19377 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:06.274495 19402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a08760e15aac4630a629431f56024dc8" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
I20260709 13:07:06.300803 19402 raft_consensus.cc:2376] T a08760e15aac4630a629431f56024dc8 P e5256d91808b47c195bc9b4dbd7f2b87 [term 22 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 22. Re-sending same reply.
I20260709 13:07:06.275585 19405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ec1c4ce15e04c7e8c283a62179f2a64" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
I20260709 13:07:06.301591 19405 raft_consensus.cc:3060] T 5ec1c4ce15e04c7e8c283a62179f2a64 P e5256d91808b47c195bc9b4dbd7f2b87 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:07:06.276116 20075 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:06.264701 19449 leader_election.cc:304] T e381f1d6b8184797ad142de49be225a8 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87; no voters: 
I20260709 13:07:06.304163 19449 leader_election.cc:304] T 775c229504194560ba9589bc2199b089 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e; no voters: 127766fc592545a4997f7790f50f6076, e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:07:06.305190 19449 leader_election.cc:304] T ff9b0eddd810459b82d91c60777c10eb P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87; no voters: 
I20260709 13:07:06.307179 19449 leader_election.cc:304] T 2b74109013a140ada21feeef92d6f563 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87; no voters: 
I20260709 13:07:06.310957 19485 rpcz_store.cc:276] 0709 13:07:05.122441 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:05.282484 (+160043us) service_pool.cc:224] Handling call
0709 13:07:06.255108 (+972624us) spinlock_profiling.cc:243] Waited 615 ms on lock 0x7b5400344254. stack: 00007f4a79de9343 00007f4a79de9240 00007f4a797781d4 00007f4a834b6304 00007f4a834b6299 00007f4a7ce71571 00007f4a7cf0c2fa 00007f4a81ecdb17 00007f4a7b4486d4 00007f4a7b448662 00007f4a7b448591 00007f4a7b44850c 00007f4a7b4477c2 00007f4a7b24348c 00007f4a7b2428c6 00007f4a7b24226f
0709 13:07:06.255206 (+    98us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1415468928}
I20260709 13:07:06.283138 20106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "309c3ca0ca4b4f3ba129752ea2cb293b" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 13 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:07:06.288982 20111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ec1c4ce15e04c7e8c283a62179f2a64" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076"
W20260709 13:07:06.291564 19403 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52328 (request call id 2590) took 1588 ms (client timeout 1575 ms). Trace:
I20260709 13:07:06.312462 20106 raft_consensus.cc:1813] T 309c3ca0ca4b4f3ba129752ea2cb293b P 127766fc592545a4997f7790f50f6076 [term 12 FOLLOWER]: Handling vote request from an unknown peer e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:07:06.295392 20109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a16f7501e2444fb86d4e2778e734e02" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:07:06.296932 19410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4509b76741dc428e9201c70c1658da13" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:07:06.297245 19409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df751f992649444090e27965eb1af85d" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 22 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
I20260709 13:07:06.297631 25093 raft_consensus.cc:493] T 22196caba61445d3bec98a0aab3c337d P e5256d91808b47c195bc9b4dbd7f2b87 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:06.297660 19375 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.3:36891, user_credentials={real_user=slave}} blocked reactor thread for 86471.6us
W20260709 13:07:06.293560 19524 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:06.312883 19403 rpcz_store.cc:269] 0709 13:07:04.703501 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:04.707272 (+  3771us) service_pool.cc:224] Handling call
0709 13:07:06.291391 (+1584119us) spinlock_profiling.cc:243] Waited 4.12 ms on lock 0x7b5400249354. stack: 00007f4a79de9343 00007f4a79de9240 00007f4a797781d4 00007f4a834b6304 00007f4a834b6299 00007f4a7ce71571 00007f4a7cf0c2fa 00007f4a81ecdb17 00007f4a7b4486d4 00007f4a7b448662 00007f4a7b448591 00007f4a7b44850c 00007f4a7b4477c2 00007f4a7b24348c 00007f4a7b2428c6 00007f4a7b24226f
0709 13:07:06.291490 (+    99us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":9466752}
I20260709 13:07:06.320186 19555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e381f1d6b8184797ad142de49be225a8" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 17 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:07:06.320745 19450 leader_election.cc:304] T f1b10566f45d4a7d9029858330e02d5b P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168; no voters: e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:07:06.324375 19552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab43d85f64114d4ebf618930e43d9ed0" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
W20260709 13:07:06.298722 19404 rpcz_store.cc:269] 0709 13:07:04.137238 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:04.167602 (+ 30364us) service_pool.cc:224] Handling call
0709 13:07:06.255824 (+2088222us) spinlock_profiling.cc:243] Waited 1.33 s on lock 0x7b5400183654. stack: 00007f4a79de9343 00007f4a79de9240 00007f4a797781d4 00007f4a834b6304 00007f4a834b6299 00007f4a7ce71571 00007f4a7cf0c2fa 00007f4a81ecdb17 00007f4a7b4486d4 00007f4a7b448662 00007f4a7b448591 00007f4a7b44850c 00007f4a7b4477c2 00007f4a7b24348c 00007f4a7b2428c6 00007f4a7b24226f
0709 13:07:06.255913 (+    89us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3053914496}
I20260709 13:07:06.327284 19411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21e14947d70440f19044d8f75c31e1f9" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:07:06.327869 19411 raft_consensus.cc:2468] T 21e14947d70440f19044d8f75c31e1f9 P e5256d91808b47c195bc9b4dbd7f2b87 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 18.
I20260709 13:07:06.329705 19402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edd7d470b5014c9489be7f41f64355c9" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 23 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:07:06.313810 25093 raft_consensus.cc:515] T 22196caba61445d3bec98a0aab3c337d P e5256d91808b47c195bc9b4dbd7f2b87 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:07:06.314759 19409 raft_consensus.cc:3060] T df751f992649444090e27965eb1af85d P e5256d91808b47c195bc9b4dbd7f2b87 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:07:06.313349 20106 raft_consensus.cc:2410] T 309c3ca0ca4b4f3ba129752ea2cb293b P 127766fc592545a4997f7790f50f6076 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e61c3a8f61bb48f8a963c9480e53c168 for term 13 because replica has last-logged OpId of term: 11 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 9.
I20260709 13:07:06.323099 19375 leader_election.cc:304] T 76cb037fc9064d13b59a8969d897ce8c P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:07:06.338132 20112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ece3db938bc649d4a40a51522ed5259c" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:07:06.338320 20106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9962423cb4e54fcfa5de01daf68a86e7" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:07:06.339154 19552 raft_consensus.cc:2393] T ab43d85f64114d4ebf618930e43d9ed0 P e61c3a8f61bb48f8a963c9480e53c168 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0473d2b2d01f4459b1e90fd12cc7840e in current term 20: Already voted for candidate e61c3a8f61bb48f8a963c9480e53c168 in this term.
I20260709 13:07:06.339769 19557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46c5bfeecc314717bffe987e6844b6d0" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 25 candidate_status { last_received { term: 23 index: 12 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:07:06.343488 19551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b74109013a140ada21feeef92d6f563" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 17 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:07:06.353875 19477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab43d85f64114d4ebf618930e43d9ed0" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:07:06.354540 19477 raft_consensus.cc:2468] T ab43d85f64114d4ebf618930e43d9ed0 P 0473d2b2d01f4459b1e90fd12cc7840e [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 127766fc592545a4997f7790f50f6076 in term 19.
I20260709 13:07:06.356484 19482 raft_consensus.cc:1240] T 5ec1c4ce15e04c7e8c283a62179f2a64 P 0473d2b2d01f4459b1e90fd12cc7840e [term 13 FOLLOWER]: Rejecting Update request from peer 127766fc592545a4997f7790f50f6076 for earlier term 12. Current term is 13. Ops: []
I20260709 13:07:06.357740 19478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cdf56e38bbc453d9438d359e5a69955" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:07:06.359176 19481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "309c3ca0ca4b4f3ba129752ea2cb293b" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:07:06.360476 19484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f85fc4b527a48848e5faa083b604e36" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 19 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:07:06.281139 25829 raft_consensus.cc:493] T 14efcc79969f41babe5529c22d59156d P e5256d91808b47c195bc9b4dbd7f2b87 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 127766fc592545a4997f7790f50f6076)
I20260709 13:07:06.294349 25747 raft_consensus.cc:2804] T 4af19371ea874c09a0a2147040835cbb P e61c3a8f61bb48f8a963c9480e53c168 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:07:06.362637 19560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e1f505cb0f1427bbd698ac889d80821" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:07:06.363262 19485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1efebf73c86e432baa55533136b6e12c" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:07:06.363631 20111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "775c229504194560ba9589bc2199b089" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
W20260709 13:07:06.368748 19523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.1:40321, user_credentials={real_user=slave}} blocked reactor thread for 96367.4us
I20260709 13:07:06.365033 19483 raft_consensus.cc:1275] T 1f85fc4b527a48848e5faa083b604e36 P 0473d2b2d01f4459b1e90fd12cc7840e [term 18 FOLLOWER]: Refusing update from remote peer 127766fc592545a4997f7790f50f6076: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
I20260709 13:07:06.370211 19552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4af19371ea874c09a0a2147040835cbb" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:07:06.280536 25812 raft_consensus.cc:493] T 4509b76741dc428e9201c70c1658da13 P e5256d91808b47c195bc9b4dbd7f2b87 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader e61c3a8f61bb48f8a963c9480e53c168)
I20260709 13:07:06.370904 19554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65d8cb8d6ec64f459d5a47cefab10acf" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:07:06.371099 19557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85c494af21f9457a85da47b9bc70c1fd" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:07:06.371623 19553 raft_consensus.cc:1240] T 70797e5783b5454ab0d0eea663e791e3 P e61c3a8f61bb48f8a963c9480e53c168 [term 22 FOLLOWER]: Rejecting Update request from peer 127766fc592545a4997f7790f50f6076 for earlier term 21. Current term is 22. Ops: [20.14-21.15]
W20260709 13:07:06.375288 20076 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.3:36891, user_credentials={real_user=slave}} blocked reactor thread for 71846.2us
I20260709 13:07:06.377019 19559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e5873a19244c5ebbcd38e126796ee7" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 23 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:07:06.294253 25530 raft_consensus.cc:740] T b08304a0a02b42d7840c4e8ee9a6bd1a P 0473d2b2d01f4459b1e90fd12cc7840e [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 0473d2b2d01f4459b1e90fd12cc7840e, State: Running, Role: LEADER
W20260709 13:07:06.380165 20075 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.1:40321, user_credentials={real_user=slave}} blocked reactor thread for 71785.5us
I20260709 13:07:06.386431 19559 raft_consensus.cc:2410] T d1e5873a19244c5ebbcd38e126796ee7 P e61c3a8f61bb48f8a963c9480e53c168 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0473d2b2d01f4459b1e90fd12cc7840e for term 23 because replica has last-logged OpId of term: 20 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 17 index: 9.
I20260709 13:07:06.377283 20106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36f6ba92b9ba46babe4ebd6c02e5fbd9" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:07:06.299360 25928 raft_consensus.cc:493] T edd7d470b5014c9489be7f41f64355c9 P e61c3a8f61bb48f8a963c9480e53c168 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader e5256d91808b47c195bc9b4dbd7f2b87)
I20260709 13:07:06.396054 20076 leader_election.cc:304] T ab43d85f64114d4ebf618930e43d9ed0 P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 127766fc592545a4997f7790f50f6076, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:07:06.336716 25956 raft_consensus.cc:3060] T 775c229504194560ba9589bc2199b089 P 0473d2b2d01f4459b1e90fd12cc7840e [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:07:06.421701 19556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21e14947d70440f19044d8f75c31e1f9" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:07:06.335970 25881 raft_consensus.cc:493] T 48824d5acfbc485ebf8c2d944e7202de P e61c3a8f61bb48f8a963c9480e53c168 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 127766fc592545a4997f7790f50f6076)
I20260709 13:07:06.343097 25764 raft_consensus.cc:493] T 0cdf56e38bbc453d9438d359e5a69955 P 0473d2b2d01f4459b1e90fd12cc7840e [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:06.423898 20106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "309c3ca0ca4b4f3ba129752ea2cb293b" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:07:06.400220 25093 leader_election.cc:290] T 22196caba61445d3bec98a0aab3c337d P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:07:06.425463 25093 raft_consensus.cc:493] T 14935b3ddf914369822e4a0547aaa355 P e5256d91808b47c195bc9b4dbd7f2b87 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:06.425961 25093 raft_consensus.cc:515] T 14935b3ddf914369822e4a0547aaa355 P e5256d91808b47c195bc9b4dbd7f2b87 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } attrs { replace: true } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:07:06.402328 19449 leader_election.cc:304] T ef32ce6fdd0e40d382c79974f30295c6 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e; no voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:07:06.402204 25812 raft_consensus.cc:515] T 4509b76741dc428e9201c70c1658da13 P e5256d91808b47c195bc9b4dbd7f2b87 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:07:06.429458 25812 leader_election.cc:290] T 4509b76741dc428e9201c70c1658da13 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:07:06.423450 25928 raft_consensus.cc:515] T edd7d470b5014c9489be7f41f64355c9 P e61c3a8f61bb48f8a963c9480e53c168 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:07:06.336169 25945 raft_consensus.cc:493] T b9f0d59553ad444883fcf5b5909f9798 P e61c3a8f61bb48f8a963c9480e53c168 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 0473d2b2d01f4459b1e90fd12cc7840e)
I20260709 13:07:06.370844 25837 raft_consensus.cc:2804] T f1b10566f45d4a7d9029858330e02d5b P 0473d2b2d01f4459b1e90fd12cc7840e [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:07:06.416723 19559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1efebf73c86e432baa55533136b6e12c" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
W20260709 13:07:06.440652 20075 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:06.418779 19377 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.2:46257, user_credentials={real_user=slave}} blocked reactor thread for 85952.6us
I20260709 13:07:06.420169 19523 leader_election.cc:304] T ed7fdbcb96d14d418db9ca90a792588a P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 127766fc592545a4997f7790f50f6076, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:07:06.443360 25879 raft_consensus.cc:2804] T ed7fdbcb96d14d418db9ca90a792588a P e61c3a8f61bb48f8a963c9480e53c168 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:07:06.443758 25879 raft_consensus.cc:493] T ed7fdbcb96d14d418db9ca90a792588a P e61c3a8f61bb48f8a963c9480e53c168 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 127766fc592545a4997f7790f50f6076)
I20260709 13:07:06.443805 19477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a08760e15aac4630a629431f56024dc8" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 23 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:07:06.444070 19523 leader_election.cc:304] T 65d8cb8d6ec64f459d5a47cefab10acf P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 127766fc592545a4997f7790f50f6076, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:07:06.444200 25879 raft_consensus.cc:3060] T ed7fdbcb96d14d418db9ca90a792588a P e61c3a8f61bb48f8a963c9480e53c168 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:07:06.444523 19477 raft_consensus.cc:2468] T a08760e15aac4630a629431f56024dc8 P 0473d2b2d01f4459b1e90fd12cc7840e [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 22.
I20260709 13:07:06.445228 25093 leader_election.cc:290] T 14935b3ddf914369822e4a0547aaa355 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:07:06.445461 19477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e36a9d6e29c4a7c860cf267efbd4c74" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:07:06.336462 25957 raft_consensus.cc:2804] T ff9b0eddd810459b82d91c60777c10eb P 0473d2b2d01f4459b1e90fd12cc7840e [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:07:06.335678 25763 raft_consensus.cc:2804] T e381f1d6b8184797ad142de49be225a8 P 0473d2b2d01f4459b1e90fd12cc7840e [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:07:06.446544 25763 raft_consensus.cc:493] T e381f1d6b8184797ad142de49be225a8 P 0473d2b2d01f4459b1e90fd12cc7840e [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:06.446949 25763 raft_consensus.cc:3060] T e381f1d6b8184797ad142de49be225a8 P 0473d2b2d01f4459b1e90fd12cc7840e [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:07:06.447094 25825 raft_consensus.cc:2804] T 65d8cb8d6ec64f459d5a47cefab10acf P e61c3a8f61bb48f8a963c9480e53c168 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:07:06.447521 25825 raft_consensus.cc:493] T 65d8cb8d6ec64f459d5a47cefab10acf P e61c3a8f61bb48f8a963c9480e53c168 [term 19 FOLLOWER]: Starting leader election (detected failure of leader e5256d91808b47c195bc9b4dbd7f2b87)
I20260709 13:07:06.447909 25825 raft_consensus.cc:3060] T 65d8cb8d6ec64f459d5a47cefab10acf P e61c3a8f61bb48f8a963c9480e53c168 [term 19 FOLLOWER]: Advancing to term 20
W20260709 13:07:06.449326 19449 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.1:40321, user_credentials={real_user=slave}} blocked reactor thread for 47074.2us
I20260709 13:07:06.421554 19486 raft_consensus.cc:1240] T 62c6c134d3d24a1ab144dd9ee6bc3f64 P 0473d2b2d01f4459b1e90fd12cc7840e [term 17 FOLLOWER]: Rejecting Update request from peer 127766fc592545a4997f7790f50f6076 for earlier term 16. Current term is 17. Ops: []
I20260709 13:07:06.401674 19479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab43d85f64114d4ebf618930e43d9ed0" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 18 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:07:06.451059 19479 raft_consensus.cc:1813] T ab43d85f64114d4ebf618930e43d9ed0 P 0473d2b2d01f4459b1e90fd12cc7840e [term 19 FOLLOWER]: Handling vote request from an unknown peer e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:07:06.451506 19479 raft_consensus.cc:2368] T ab43d85f64114d4ebf618930e43d9ed0 P 0473d2b2d01f4459b1e90fd12cc7840e [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e5256d91808b47c195bc9b4dbd7f2b87 for earlier term 18. Current term is 19.
I20260709 13:07:06.367486 25747 raft_consensus.cc:493] T 4af19371ea874c09a0a2147040835cbb P e61c3a8f61bb48f8a963c9480e53c168 [term 10 FOLLOWER]: Starting leader election (detected failure of leader e5256d91808b47c195bc9b4dbd7f2b87)
I20260709 13:07:06.415477 19405 raft_consensus.cc:2468] T 5ec1c4ce15e04c7e8c283a62179f2a64 P e5256d91808b47c195bc9b4dbd7f2b87 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 13.
I20260709 13:07:06.321193 25851 raft_consensus.cc:515] T 2b74109013a140ada21feeef92d6f563 P e61c3a8f61bb48f8a963c9480e53c168 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:07:06.433461 19410 raft_consensus.cc:2468] T 4509b76741dc428e9201c70c1658da13 P e5256d91808b47c195bc9b4dbd7f2b87 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 12.
I20260709 13:07:06.434070 20106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f85fc4b527a48848e5faa083b604e36" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 19 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:07:06.424901 19409 raft_consensus.cc:2468] T df751f992649444090e27965eb1af85d P e5256d91808b47c195bc9b4dbd7f2b87 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 22.
I20260709 13:07:06.423588 25918 raft_consensus.cc:2804] T ab43d85f64114d4ebf618930e43d9ed0 P 127766fc592545a4997f7790f50f6076 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:07:06.435519 20112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab43d85f64114d4ebf618930e43d9ed0" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:07:06.443174 25816 consensus_queue.cc:1048] T 1f85fc4b527a48848e5faa083b604e36 P 127766fc592545a4997f7790f50f6076 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:07:06.402245 19552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed7fdbcb96d14d418db9ca90a792588a" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 17 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:07:06.339461 25786 raft_consensus.cc:2804] T 2b74109013a140ada21feeef92d6f563 P 0473d2b2d01f4459b1e90fd12cc7840e [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:07:06.453562 20109 raft_consensus.cc:1240] T fa731b585f684a7fb2d106c50f143b83 P 127766fc592545a4997f7790f50f6076 [term 16 FOLLOWER]: Rejecting Update request from peer e61c3a8f61bb48f8a963c9480e53c168 for earlier term 15. Current term is 16. Ops: []
I20260709 13:07:06.442646 19377 leader_election.cc:304] T ef32ce6fdd0e40d382c79974f30295c6 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87; no voters: 
I20260709 13:07:06.348057 25923 consensus_queue.cc:1048] T d1e5873a19244c5ebbcd38e126796ee7 P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.086s
I20260709 13:07:06.363508 25819 raft_consensus.cc:2804] T 76cb037fc9064d13b59a8969d897ce8c P e5256d91808b47c195bc9b4dbd7f2b87 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:07:06.516276 25819 raft_consensus.cc:697] T 76cb037fc9064d13b59a8969d897ce8c P e5256d91808b47c195bc9b4dbd7f2b87 [term 18 LEADER]: Becoming Leader. State: Replica: e5256d91808b47c195bc9b4dbd7f2b87, State: Running, Role: LEADER
I20260709 13:07:06.516458 25879 raft_consensus.cc:515] T ed7fdbcb96d14d418db9ca90a792588a P e61c3a8f61bb48f8a963c9480e53c168 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:07:06.517197 25819 consensus_queue.cc:237] T 76cb037fc9064d13b59a8969d897ce8c P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.9, Last appended by leader: 9, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:07:06.459438 19556 raft_consensus.cc:1240] T 0e1085d23e8347fbbd5bce7542f4b1f4 P e61c3a8f61bb48f8a963c9480e53c168 [term 15 LEADER]: Rejecting Update request from peer 0473d2b2d01f4459b1e90fd12cc7840e for earlier term 14. Current term is 15. Ops: [14.12-14.12]
I20260709 13:07:06.366887 25829 raft_consensus.cc:515] T 14efcc79969f41babe5529c22d59156d P e5256d91808b47c195bc9b4dbd7f2b87 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:07:06.401563 25962 consensus_queue.cc:1059] T 775c229504194560ba9589bc2199b089 P 127766fc592545a4997f7790f50f6076 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 }, Status: INVALID_TERM, Last received: 13.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.062s
I20260709 13:07:06.460511 20107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab43d85f64114d4ebf618930e43d9ed0" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 18 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:07:06.462735 25815 consensus_queue.cc:1059] T 5ec1c4ce15e04c7e8c283a62179f2a64 P 127766fc592545a4997f7790f50f6076 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 }, Status: INVALID_TERM, Last received: 12.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.005s
I20260709 13:07:06.468286 25827 raft_consensus.cc:515] T e381f1d6b8184797ad142de49be225a8 P e61c3a8f61bb48f8a963c9480e53c168 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:07:06.461133 20076 leader_election.cc:304] T 1efebf73c86e432baa55533136b6e12c P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 127766fc592545a4997f7790f50f6076; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:07:06.482937 25093 raft_consensus.cc:2804] T ef32ce6fdd0e40d382c79974f30295c6 P e5256d91808b47c195bc9b4dbd7f2b87 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:07:06.483127 19552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4509b76741dc428e9201c70c1658da13" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:07:06.492802 19377 leader_election.cc:304] T 9962423cb4e54fcfa5de01daf68a86e7 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87; no voters: 
I20260709 13:07:06.461436 25747 raft_consensus.cc:3060] T 4af19371ea874c09a0a2147040835cbb P e61c3a8f61bb48f8a963c9480e53c168 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:06.499955 25715 consensus_queue.cc:1059] T fa731b585f684a7fb2d106c50f143b83 P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
W20260709 13:07:06.556263 19377 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.2:46257, user_credentials={real_user=slave}} blocked reactor thread for 63563.6us
I20260709 13:07:06.507125 19551 raft_consensus.cc:2393] T 2b74109013a140ada21feeef92d6f563 P e61c3a8f61bb48f8a963c9480e53c168 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0473d2b2d01f4459b1e90fd12cc7840e in current term 17: Already voted for candidate e61c3a8f61bb48f8a963c9480e53c168 in this term.
I20260709 13:07:06.508327 25851 leader_election.cc:290] T 2b74109013a140ada21feeef92d6f563 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 17 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:07:06.509495 19559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df751f992649444090e27965eb1af85d" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 22 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:07:06.512823 19554 raft_consensus.cc:1275] T f93ee515a9c14139bf566522ed8232f3 P e61c3a8f61bb48f8a963c9480e53c168 [term 22 FOLLOWER]: Refusing update from remote peer 0473d2b2d01f4459b1e90fd12cc7840e: Log matching property violated. Preceding OpId in replica: term: 20 index: 10. Preceding OpId from leader: term: 22 index: 11. (index mismatch)
I20260709 13:07:06.559440 19559 raft_consensus.cc:3060] T df751f992649444090e27965eb1af85d P e61c3a8f61bb48f8a963c9480e53c168 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:07:06.452366 25945 raft_consensus.cc:515] T b9f0d59553ad444883fcf5b5909f9798 P e61c3a8f61bb48f8a963c9480e53c168 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:07:06.515235 25530 consensus_queue.cc:260] T b08304a0a02b42d7840c4e8ee9a6bd1a P 0473d2b2d01f4459b1e90fd12cc7840e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 19.11, Last appended by leader: 11, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:07:06.498824 25918 raft_consensus.cc:493] T ab43d85f64114d4ebf618930e43d9ed0 P 127766fc592545a4997f7790f50f6076 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:06.573890 19555 raft_consensus.cc:2393] T e381f1d6b8184797ad142de49be225a8 P e61c3a8f61bb48f8a963c9480e53c168 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0473d2b2d01f4459b1e90fd12cc7840e in current term 17: Already voted for candidate e61c3a8f61bb48f8a963c9480e53c168 in this term.
I20260709 13:07:06.436535 25837 raft_consensus.cc:493] T f1b10566f45d4a7d9029858330e02d5b P 0473d2b2d01f4459b1e90fd12cc7840e [term 17 FOLLOWER]: Starting leader election (detected failure of leader e61c3a8f61bb48f8a963c9480e53c168)
I20260709 13:07:06.460879 25830 raft_consensus.cc:2749] T ef32ce6fdd0e40d382c79974f30295c6 P 0473d2b2d01f4459b1e90fd12cc7840e [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:07:06.552079 25093 raft_consensus.cc:493] T ef32ce6fdd0e40d382c79974f30295c6 P e5256d91808b47c195bc9b4dbd7f2b87 [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:06.527478 20109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed7fdbcb96d14d418db9ca90a792588a" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076"
I20260709 13:07:06.518611 25879 leader_election.cc:290] T ed7fdbcb96d14d418db9ca90a792588a P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 16 election: Requested vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:07:06.582826 25093 raft_consensus.cc:3060] T ef32ce6fdd0e40d382c79974f30295c6 P e5256d91808b47c195bc9b4dbd7f2b87 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:07:06.463181 25956 raft_consensus.cc:2749] T 775c229504194560ba9589bc2199b089 P 0473d2b2d01f4459b1e90fd12cc7840e [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:07:06.462867 25965 raft_consensus.cc:493] T 0e1085d23e8347fbbd5bce7542f4b1f4 P 127766fc592545a4997f7790f50f6076 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:06.500371 25928 leader_election.cc:290] T edd7d470b5014c9489be7f41f64355c9 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:07:06.458794 25957 raft_consensus.cc:697] T ff9b0eddd810459b82d91c60777c10eb P 0473d2b2d01f4459b1e90fd12cc7840e [term 19 LEADER]: Becoming Leader. State: Replica: 0473d2b2d01f4459b1e90fd12cc7840e, State: Running, Role: LEADER
I20260709 13:07:06.557451 19377 leader_election.cc:304] T 2b74109013a140ada21feeef92d6f563 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87; no voters: 
I20260709 13:07:06.478175 25939 consensus_queue.cc:1059] T 70797e5783b5454ab0d0eea663e791e3 P 127766fc592545a4997f7790f50f6076 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 }, Status: INVALID_TERM, Last received: 18.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.112s
I20260709 13:07:06.561167 19450 leader_election.cc:304] T 46c5bfeecc314717bffe987e6844b6d0 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e; no voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:07:06.451148 25764 raft_consensus.cc:515] T 0cdf56e38bbc453d9438d359e5a69955 P 0473d2b2d01f4459b1e90fd12cc7840e [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:07:06.593325 19377 leader_election.cc:304] T 1dc5b3532fe54f74876d02beffa2c230 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87; no voters: 
I20260709 13:07:06.595016 19559 raft_consensus.cc:2468] T df751f992649444090e27965eb1af85d P e61c3a8f61bb48f8a963c9480e53c168 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 22.
I20260709 13:07:06.594740 20109 raft_consensus.cc:2468] T ed7fdbcb96d14d418db9ca90a792588a P 127766fc592545a4997f7790f50f6076 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 16.
I20260709 13:07:06.595624 19450 leader_election.cc:304] T 3e1f505cb0f1427bbd698ac889d80821 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e; no voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:07:06.568198 19374 leader_election.cc:304] T ece3db938bc649d4a40a51522ed5259c P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87; no voters: 127766fc592545a4997f7790f50f6076, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:07:06.438628 25881 raft_consensus.cc:515] T 48824d5acfbc485ebf8c2d944e7202de P e61c3a8f61bb48f8a963c9480e53c168 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:07:06.302736 25925 raft_consensus.cc:2749] T 3e1f505cb0f1427bbd698ac889d80821 P e5256d91808b47c195bc9b4dbd7f2b87 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:07:06.496064 25786 raft_consensus.cc:493] T 2b74109013a140ada21feeef92d6f563 P 0473d2b2d01f4459b1e90fd12cc7840e [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:06.571820 25812 raft_consensus.cc:2804] T 9962423cb4e54fcfa5de01daf68a86e7 P e5256d91808b47c195bc9b4dbd7f2b87 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:07:06.596613 19523 leader_election.cc:304] T ed7fdbcb96d14d418db9ca90a792588a P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 127766fc592545a4997f7790f50f6076, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:07:06.598326 19450 leader_election.cc:304] T d1e5873a19244c5ebbcd38e126796ee7 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e; no voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:07:06.577498 25918 raft_consensus.cc:3060] T ab43d85f64114d4ebf618930e43d9ed0 P 127766fc592545a4997f7790f50f6076 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:07:06.599035 25933 raft_consensus.cc:2749] T 46c5bfeecc314717bffe987e6844b6d0 P 0473d2b2d01f4459b1e90fd12cc7840e [term 25 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:07:06.580382 25837 raft_consensus.cc:3060] T f1b10566f45d4a7d9029858330e02d5b P 0473d2b2d01f4459b1e90fd12cc7840e [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:07:06.580997 25851 raft_consensus.cc:3055] T fa731b585f684a7fb2d106c50f143b83 P e61c3a8f61bb48f8a963c9480e53c168 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:07:06.601804 19480 raft_consensus.cc:1240] T 775c229504194560ba9589bc2199b089 P 0473d2b2d01f4459b1e90fd12cc7840e [term 14 FOLLOWER]: Rejecting Update request from peer 127766fc592545a4997f7790f50f6076 for earlier term 13. Current term is 14. Ops: []
I20260709 13:07:06.601142 25975 raft_consensus.cc:2749] T 3e1f505cb0f1427bbd698ac889d80821 P 0473d2b2d01f4459b1e90fd12cc7840e [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:07:06.590297 25923 raft_consensus.cc:493] T f1b10566f45d4a7d9029858330e02d5b P e5256d91808b47c195bc9b4dbd7f2b87 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:06.605533 19478 raft_consensus.cc:2468] T 0cdf56e38bbc453d9438d359e5a69955 P 0473d2b2d01f4459b1e90fd12cc7840e [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 18.
I20260709 13:07:06.552688 25763 raft_consensus.cc:515] T e381f1d6b8184797ad142de49be225a8 P 0473d2b2d01f4459b1e90fd12cc7840e [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:07:06.597246 25917 raft_consensus.cc:2749] T 1efebf73c86e432baa55533136b6e12c P 127766fc592545a4997f7790f50f6076 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:07:06.597520 25965 raft_consensus.cc:515] T 0e1085d23e8347fbbd5bce7542f4b1f4 P 127766fc592545a4997f7790f50f6076 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:07:06.621862 25827 leader_election.cc:290] T e381f1d6b8184797ad142de49be225a8 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 17 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:07:06.601336 25786 raft_consensus.cc:3060] T 2b74109013a140ada21feeef92d6f563 P 0473d2b2d01f4459b1e90fd12cc7840e [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:07:06.608003 25962 raft_consensus.cc:3055] T 70797e5783b5454ab0d0eea663e791e3 P 127766fc592545a4997f7790f50f6076 [term 21 LEADER]: Stepping down as leader of term 21
I20260709 13:07:06.622946 25962 raft_consensus.cc:740] T 70797e5783b5454ab0d0eea663e791e3 P 127766fc592545a4997f7790f50f6076 [term 21 LEADER]: Becoming Follower/Learner. State: Replica: 127766fc592545a4997f7790f50f6076, State: Running, Role: LEADER
I20260709 13:07:06.623785 25962 consensus_queue.cc:260] T 70797e5783b5454ab0d0eea663e791e3 P 127766fc592545a4997f7790f50f6076 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 21.15, Last appended by leader: 15, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:07:06.624428 25957 consensus_queue.cc:237] T ff9b0eddd810459b82d91c60777c10eb P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.13, Last appended by leader: 13, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:07:06.619462 25923 raft_consensus.cc:515] T f1b10566f45d4a7d9029858330e02d5b P e5256d91808b47c195bc9b4dbd7f2b87 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:07:06.624979 25962 raft_consensus.cc:3060] T 70797e5783b5454ab0d0eea663e791e3 P 127766fc592545a4997f7790f50f6076 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:07:06.608507 25520 raft_consensus.cc:2749] T d1e5873a19244c5ebbcd38e126796ee7 P 0473d2b2d01f4459b1e90fd12cc7840e [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:07:06.620471 25829 leader_election.cc:290] T 14efcc79969f41babe5529c22d59156d P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:07:06.650782 25537 consensus_queue.cc:1059] T 0e1085d23e8347fbbd5bce7542f4b1f4 P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 }, Status: INVALID_TERM, Last received: 12.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:07:06.614392 25925 raft_consensus.cc:2804] T 1dc5b3532fe54f74876d02beffa2c230 P e5256d91808b47c195bc9b4dbd7f2b87 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:07:06.609750 25803 raft_consensus.cc:2804] T 2b74109013a140ada21feeef92d6f563 P e5256d91808b47c195bc9b4dbd7f2b87 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:07:06.605360 25928 raft_consensus.cc:2804] T ed7fdbcb96d14d418db9ca90a792588a P e61c3a8f61bb48f8a963c9480e53c168 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:07:06.601469 25812 raft_consensus.cc:493] T 9962423cb4e54fcfa5de01daf68a86e7 P e5256d91808b47c195bc9b4dbd7f2b87 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 127766fc592545a4997f7790f50f6076)
I20260709 13:07:06.700418 25803 raft_consensus.cc:493] T 2b74109013a140ada21feeef92d6f563 P e5256d91808b47c195bc9b4dbd7f2b87 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:06.701372 25803 raft_consensus.cc:3060] T 2b74109013a140ada21feeef92d6f563 P e5256d91808b47c195bc9b4dbd7f2b87 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:07:06.705192 25093 raft_consensus.cc:515] T ef32ce6fdd0e40d382c79974f30295c6 P e5256d91808b47c195bc9b4dbd7f2b87 [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:07:06.608212 25530 raft_consensus.cc:3060] T b08304a0a02b42d7840c4e8ee9a6bd1a P 0473d2b2d01f4459b1e90fd12cc7840e [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:07:06.610074 25832 leader_election.cc:290] T edd7d470b5014c9489be7f41f64355c9 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:07:06.612946 25851 raft_consensus.cc:740] T fa731b585f684a7fb2d106c50f143b83 P e61c3a8f61bb48f8a963c9480e53c168 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: e61c3a8f61bb48f8a963c9480e53c168, State: Running, Role: LEADER
I20260709 13:07:06.663643 19450 leader_election.cc:304] T df751f992649444090e27965eb1af85d P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:07:06.675392 25086 leader_election.cc:290] T ef32ce6fdd0e40d382c79974f30295c6 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:07:06.668514 25763 leader_election.cc:290] T e381f1d6b8184797ad142de49be225a8 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 17 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:07:06.669822 25881 leader_election.cc:290] T 48824d5acfbc485ebf8c2d944e7202de P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:07:06.700284 25925 raft_consensus.cc:493] T 1dc5b3532fe54f74876d02beffa2c230 P e5256d91808b47c195bc9b4dbd7f2b87 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:06.673846 25923 leader_election.cc:290] T f1b10566f45d4a7d9029858330e02d5b P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:07:06.651221 25825 raft_consensus.cc:515] T 65d8cb8d6ec64f459d5a47cefab10acf P e61c3a8f61bb48f8a963c9480e53c168 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
W20260709 13:07:06.687064 19449 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.1:40321, user_credentials={real_user=slave}} blocked reactor thread for 236530us
I20260709 13:07:06.674228 25376 consensus_queue.cc:1048] T f93ee515a9c14139bf566522ed8232f3 P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 8, Time since last communication: 0.001s
W20260709 13:07:06.636888 19523 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:06.700506 25537 consensus_queue.cc:1243] T 0e1085d23e8347fbbd5bce7542f4b1f4 P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Peer e61c3a8f61bb48f8a963c9480e53c168 log is divergent from this leader: its last log entry 15.12 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 11
I20260709 13:07:06.700686 25829 consensus_queue.cc:1048] T 4af19371ea874c09a0a2147040835cbb P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Connected to new peer: Peer: permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.006s
I20260709 13:07:06.662824 25917 raft_consensus.cc:493] T 0afb57ae58a24a01850491d69f0213dd P 127766fc592545a4997f7790f50f6076 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 0473d2b2d01f4459b1e90fd12cc7840e)
W20260709 13:07:06.700086 19375 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.3:36891, user_credentials={real_user=slave}} blocked reactor thread for 359351us
I20260709 13:07:06.728679 19375 leader_election.cc:304] T 70797e5783b5454ab0d0eea663e791e3 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168; no voters: 127766fc592545a4997f7790f50f6076
I20260709 13:07:06.709738 25812 raft_consensus.cc:3060] T 9962423cb4e54fcfa5de01daf68a86e7 P e5256d91808b47c195bc9b4dbd7f2b87 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:07:06.670689 25786 raft_consensus.cc:515] T 2b74109013a140ada21feeef92d6f563 P 0473d2b2d01f4459b1e90fd12cc7840e [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
W20260709 13:07:06.720764 19450 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.3:36891, user_credentials={real_user=slave}} blocked reactor thread for 57258.2us
I20260709 13:07:06.714813 25928 raft_consensus.cc:697] T ed7fdbcb96d14d418db9ca90a792588a P e61c3a8f61bb48f8a963c9480e53c168 [term 16 LEADER]: Becoming Leader. State: Replica: e61c3a8f61bb48f8a963c9480e53c168, State: Running, Role: LEADER
W20260709 13:07:06.722162 20076 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.3:36891, user_credentials={real_user=slave}} blocked reactor thread for 261082us
I20260709 13:07:06.723198 19449 leader_election.cc:304] T a08760e15aac4630a629431f56024dc8 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87; no voters: e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:07:06.675902 25984 raft_consensus.cc:2749] T ece3db938bc649d4a40a51522ed5259c P e5256d91808b47c195bc9b4dbd7f2b87 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:07:06.737609 19375 leader_election.cc:304] T b08304a0a02b42d7840c4e8ee9a6bd1a P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:07:06.730775 25093 leader_election.cc:290] T ef32ce6fdd0e40d382c79974f30295c6 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 23 election: Requested vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
W20260709 13:07:06.727807 19377 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.2:46257, user_credentials={real_user=slave}} blocked reactor thread for 134553us
W20260709 13:07:06.733023 19374 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.4:43121, user_credentials={real_user=slave}} blocked reactor thread for 128727us
I20260709 13:07:06.724370 25832 raft_consensus.cc:2804] T df751f992649444090e27965eb1af85d P 0473d2b2d01f4459b1e90fd12cc7840e [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:07:06.739629 19555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e1085d23e8347fbbd5bce7542f4b1f4" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 16 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:07:06.724159 25925 raft_consensus.cc:3060] T 1dc5b3532fe54f74876d02beffa2c230 P e5256d91808b47c195bc9b4dbd7f2b87 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:07:06.740506 19449 leader_election.cc:304] T 21e14947d70440f19044d8f75c31e1f9 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87; no voters: e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:07:06.728113 25923 raft_consensus.cc:493] T f93ee515a9c14139bf566522ed8232f3 P e5256d91808b47c195bc9b4dbd7f2b87 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:06.747059 20109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48824d5acfbc485ebf8c2d944e7202de" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:07:06.751642 19374 leader_election.cc:304] T 172b3dd13109415a955b71ac0e9d2234 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, 127766fc592545a4997f7790f50f6076
I20260709 13:07:06.750941 19377 leader_election.cc:304] T e381f1d6b8184797ad142de49be225a8 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87; no voters: 
I20260709 13:07:06.758064 25093 consensus_queue.cc:1059] T fa8650e71aa14778b3d73721fc50d9fc P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 }, Status: INVALID_TERM, Last received: 18.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:07:06.761245 19374 leader_election.cc:304] T 833a2f0775ed407a94b8924ce50adb63 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87; no voters: 127766fc592545a4997f7790f50f6076, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:07:06.762274 19449 leader_election.cc:304] T 5ec1c4ce15e04c7e8c283a62179f2a64 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87; no voters: 
I20260709 13:07:06.734591 25879 raft_consensus.cc:493] T b08304a0a02b42d7840c4e8ee9a6bd1a P e61c3a8f61bb48f8a963c9480e53c168 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 0473d2b2d01f4459b1e90fd12cc7840e)
I20260709 13:07:06.768714 19449 leader_election.cc:304] T 4509b76741dc428e9201c70c1658da13 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87; no voters: e61c3a8f61bb48f8a963c9480e53c168
W20260709 13:07:06.772548 20075 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:06.775995 19526 leader_election.cc:304] T bc225c93219c45538b53a1bd3d387e4d P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168; no voters: e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:07:06.762343 25984 raft_consensus.cc:2749] T b08304a0a02b42d7840c4e8ee9a6bd1a P e5256d91808b47c195bc9b4dbd7f2b87 [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 13:07:06.754180 25764 leader_election.cc:290] T 0cdf56e38bbc453d9438d359e5a69955 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:07:06.751121 25982 raft_consensus.cc:2804] T 70797e5783b5454ab0d0eea663e791e3 P e5256d91808b47c195bc9b4dbd7f2b87 [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:07:06.752334 25987 raft_consensus.cc:2804] T a08760e15aac4630a629431f56024dc8 P 0473d2b2d01f4459b1e90fd12cc7840e [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:07:06.781581 19403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e381f1d6b8184797ad142de49be225a8" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 17 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
I20260709 13:07:06.784322 19374 leader_election.cc:304] T 2a16f7501e2444fb86d4e2778e734e02 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87; no voters: 127766fc592545a4997f7790f50f6076, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:07:06.786455 19410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cdf56e38bbc453d9438d359e5a69955" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 19 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:07:06.767719 25832 raft_consensus.cc:697] T df751f992649444090e27965eb1af85d P 0473d2b2d01f4459b1e90fd12cc7840e [term 22 LEADER]: Becoming Leader. State: Replica: 0473d2b2d01f4459b1e90fd12cc7840e, State: Running, Role: LEADER
I20260709 13:07:06.771420 25520 raft_consensus.cc:2804] T 5ec1c4ce15e04c7e8c283a62179f2a64 P 0473d2b2d01f4459b1e90fd12cc7840e [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:07:06.789896 19483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e36a9d6e29c4a7c860cf267efbd4c74" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:07:06.790362 19486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "179fd671030940b4b4a4e24bcc4aba0a" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:07:06.791563 19477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7be9efa6559648dbb5a0f7684c4542d1" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 20 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:07:06.815932 19477 raft_consensus.cc:3060] T 7be9efa6559648dbb5a0f7684c4542d1 P 0473d2b2d01f4459b1e90fd12cc7840e [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:07:06.791838 19479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e381f1d6b8184797ad142de49be225a8" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 17 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:07:06.817173 19479 raft_consensus.cc:2393] T e381f1d6b8184797ad142de49be225a8 P 0473d2b2d01f4459b1e90fd12cc7840e [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e61c3a8f61bb48f8a963c9480e53c168 in current term 17: Already voted for candidate 0473d2b2d01f4459b1e90fd12cc7840e in this term.
I20260709 13:07:06.794859 25928 consensus_queue.cc:237] T ed7fdbcb96d14d418db9ca90a792588a P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:07:06.800482 19480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed7fdbcb96d14d418db9ca90a792588a" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:07:06.824404 19480 raft_consensus.cc:2393] T ed7fdbcb96d14d418db9ca90a792588a P 0473d2b2d01f4459b1e90fd12cc7840e [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e61c3a8f61bb48f8a963c9480e53c168 in current term 16: Already voted for candidate 0473d2b2d01f4459b1e90fd12cc7840e in this term.
I20260709 13:07:06.801707 25881 raft_consensus.cc:2804] T bc225c93219c45538b53a1bd3d387e4d P e61c3a8f61bb48f8a963c9480e53c168 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:07:06.802307 25993 raft_consensus.cc:2804] T e381f1d6b8184797ad142de49be225a8 P e5256d91808b47c195bc9b4dbd7f2b87 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:07:06.824571 19479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b74109013a140ada21feeef92d6f563" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 17 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:07:06.802661 19485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28af091831594f9d8e96482078cc7625" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:07:06.827203 19485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22196caba61445d3bec98a0aab3c337d" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:07:06.827792 19485 raft_consensus.cc:2468] T 22196caba61445d3bec98a0aab3c337d P 0473d2b2d01f4459b1e90fd12cc7840e [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 19.
I20260709 13:07:06.828933 19485 raft_consensus.cc:1240] T 96efeaaf1057492490e9a621f37e1a2d P 0473d2b2d01f4459b1e90fd12cc7840e [term 20 FOLLOWER]: Rejecting Update request from peer e61c3a8f61bb48f8a963c9480e53c168 for earlier term 19. Current term is 20. Ops: []
I20260709 13:07:06.826040 25881 raft_consensus.cc:493] T bc225c93219c45538b53a1bd3d387e4d P e61c3a8f61bb48f8a963c9480e53c168 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 0473d2b2d01f4459b1e90fd12cc7840e)
I20260709 13:07:06.802845 25945 leader_election.cc:290] T b9f0d59553ad444883fcf5b5909f9798 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:07:06.769131 25815 raft_consensus.cc:493] T fa731b585f684a7fb2d106c50f143b83 P 127766fc592545a4997f7790f50f6076 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:06.764163 25953 raft_consensus.cc:2804] T 21e14947d70440f19044d8f75c31e1f9 P 0473d2b2d01f4459b1e90fd12cc7840e [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:07:06.732038 25917 raft_consensus.cc:515] T 0afb57ae58a24a01850491d69f0213dd P 127766fc592545a4997f7790f50f6076 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:07:06.831537 25815 raft_consensus.cc:515] T fa731b585f684a7fb2d106c50f143b83 P 127766fc592545a4997f7790f50f6076 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:07:06.831961 25825 leader_election.cc:290] T 65d8cb8d6ec64f459d5a47cefab10acf P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 20 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:07:06.832424 25965 leader_election.cc:290] T 0e1085d23e8347fbbd5bce7542f4b1f4 P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:07:06.833323 25786 leader_election.cc:290] T 2b74109013a140ada21feeef92d6f563 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 17 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:07:06.833709 25815 leader_election.cc:290] T fa731b585f684a7fb2d106c50f143b83 P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:07:06.834249 25953 raft_consensus.cc:493] T 21e14947d70440f19044d8f75c31e1f9 P 0473d2b2d01f4459b1e90fd12cc7840e [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:06.834632 25953 raft_consensus.cc:3060] T 21e14947d70440f19044d8f75c31e1f9 P 0473d2b2d01f4459b1e90fd12cc7840e [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:07:06.835045 25918 raft_consensus.cc:515] T ab43d85f64114d4ebf618930e43d9ed0 P 127766fc592545a4997f7790f50f6076 [term 21 FOLLOWER]: Starting leader election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:07:06.836221 20112 raft_consensus.cc:2393] T ab43d85f64114d4ebf618930e43d9ed0 P 127766fc592545a4997f7790f50f6076 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e61c3a8f61bb48f8a963c9480e53c168 in current term 21: Already voted for candidate 127766fc592545a4997f7790f50f6076 in this term.
I20260709 13:07:06.789201 19482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef32ce6fdd0e40d382c79974f30295c6" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 23 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:07:06.763528 25923 raft_consensus.cc:515] T f93ee515a9c14139bf566522ed8232f3 P e5256d91808b47c195bc9b4dbd7f2b87 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:07:06.826287 25993 raft_consensus.cc:493] T e381f1d6b8184797ad142de49be225a8 P e5256d91808b47c195bc9b4dbd7f2b87 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:06.837774 25993 raft_consensus.cc:3060] T e381f1d6b8184797ad142de49be225a8 P e5256d91808b47c195bc9b4dbd7f2b87 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:07:06.838801 19482 raft_consensus.cc:2468] T ef32ce6fdd0e40d382c79974f30295c6 P 0473d2b2d01f4459b1e90fd12cc7840e [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 22.
I20260709 13:07:06.838980 25923 leader_election.cc:290] T f93ee515a9c14139bf566522ed8232f3 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:07:06.839852 25520 raft_consensus.cc:697] T 5ec1c4ce15e04c7e8c283a62179f2a64 P 0473d2b2d01f4459b1e90fd12cc7840e [term 13 LEADER]: Becoming Leader. State: Replica: 0473d2b2d01f4459b1e90fd12cc7840e, State: Running, Role: LEADER
I20260709 13:07:06.814409 19410 raft_consensus.cc:2410] T 0cdf56e38bbc453d9438d359e5a69955 P e5256d91808b47c195bc9b4dbd7f2b87 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0473d2b2d01f4459b1e90fd12cc7840e for term 19 because replica has last-logged OpId of term: 17 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 10.
I20260709 13:07:06.841914 19411 raft_consensus.cc:1275] T f93ee515a9c14139bf566522ed8232f3 P e5256d91808b47c195bc9b4dbd7f2b87 [term 22 FOLLOWER]: Refusing update from remote peer 0473d2b2d01f4459b1e90fd12cc7840e: Log matching property violated. Preceding OpId in replica: term: 18 index: 9. Preceding OpId from leader: term: 22 index: 11. (index mismatch)
I20260709 13:07:06.817917 25992 raft_consensus.cc:3055] T fa8650e71aa14778b3d73721fc50d9fc P e5256d91808b47c195bc9b4dbd7f2b87 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:07:06.818795 25987 raft_consensus.cc:697] T a08760e15aac4630a629431f56024dc8 P 0473d2b2d01f4459b1e90fd12cc7840e [term 22 LEADER]: Becoming Leader. State: Replica: 0473d2b2d01f4459b1e90fd12cc7840e, State: Running, Role: LEADER
W20260709 13:07:06.820516 25865 consensus_meta.cc:287] T 1a61655d99124a29b486ba4a5b37faea P e61c3a8f61bb48f8a963c9480e53c168: Time spent flushing consensus metadata: real 0.560s	user 0.010s	sys 0.001s
I20260709 13:07:06.821321 25832 consensus_queue.cc:237] T df751f992649444090e27965eb1af85d P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 20.13, Last appended by leader: 13, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:07:06.755489 25851 consensus_queue.cc:260] T fa731b585f684a7fb2d106c50f143b83 P e61c3a8f61bb48f8a963c9480e53c168 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.12, Last appended by leader: 12, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:07:06.822381 19486 raft_consensus.cc:2393] T 179fd671030940b4b4a4e24bcc4aba0a P 0473d2b2d01f4459b1e90fd12cc7840e [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate e61c3a8f61bb48f8a963c9480e53c168 in current term 21: Already voted for candidate 0473d2b2d01f4459b1e90fd12cc7840e in this term.
I20260709 13:07:06.823557 19483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "217b5fae677b4971b3bbd2f357a1f7ff" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:07:06.775223 25879 raft_consensus.cc:515] T b08304a0a02b42d7840c4e8ee9a6bd1a P e61c3a8f61bb48f8a963c9480e53c168 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:07:06.844395 19479 raft_consensus.cc:2393] T 2b74109013a140ada21feeef92d6f563 P 0473d2b2d01f4459b1e90fd12cc7840e [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e61c3a8f61bb48f8a963c9480e53c168 in current term 17: Already voted for candidate 0473d2b2d01f4459b1e90fd12cc7840e in this term.
I20260709 13:07:06.845119 20112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65d8cb8d6ec64f459d5a47cefab10acf" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076"
I20260709 13:07:06.848268 25917 leader_election.cc:290] T 0afb57ae58a24a01850491d69f0213dd P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:07:06.850718 25908 raft_consensus.cc:3060] T 775c229504194560ba9589bc2199b089 P 127766fc592545a4997f7790f50f6076 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:07:06.851224 25803 raft_consensus.cc:515] T 2b74109013a140ada21feeef92d6f563 P e5256d91808b47c195bc9b4dbd7f2b87 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:07:06.812160 25376 raft_consensus.cc:2804] T 4509b76741dc428e9201c70c1658da13 P 0473d2b2d01f4459b1e90fd12cc7840e [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:07:06.857134 19555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa731b585f684a7fb2d106c50f143b83" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 17 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:07:06.858731 19557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0afb57ae58a24a01850491d69f0213dd" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
W20260709 13:07:06.863476 19374 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.4:43121, user_credentials={real_user=slave}} blocked reactor thread for 79259.5us
W20260709 13:07:06.868978 19377 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.2:46257, user_credentials={real_user=slave}} blocked reactor thread for 110355us
I20260709 13:07:06.868481 19483 raft_consensus.cc:2468] T 217b5fae677b4971b3bbd2f357a1f7ff P 0473d2b2d01f4459b1e90fd12cc7840e [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 15.
I20260709 13:07:06.872272 19477 raft_consensus.cc:2468] T 7be9efa6559648dbb5a0f7684c4542d1 P 0473d2b2d01f4459b1e90fd12cc7840e [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 20.
I20260709 13:07:06.867794 25984 raft_consensus.cc:2749] T 833a2f0775ed407a94b8924ce50adb63 P e5256d91808b47c195bc9b4dbd7f2b87 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:07:06.918164 19483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e1085d23e8347fbbd5bce7542f4b1f4" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 16 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:07:06.919255 19483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0afb57ae58a24a01850491d69f0213dd" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:07:06.920321 19477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab43d85f64114d4ebf618930e43d9ed0" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:07:06.920928 19477 raft_consensus.cc:3060] T ab43d85f64114d4ebf618930e43d9ed0 P 0473d2b2d01f4459b1e90fd12cc7840e [term 19 FOLLOWER]: Advancing to term 21
I20260709 13:07:06.921286 20078 leader_election.cc:304] T 0e1085d23e8347fbbd5bce7542f4b1f4 P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 127766fc592545a4997f7790f50f6076; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:07:06.862864 25998 raft_consensus.cc:2749] T 172b3dd13109415a955b71ac0e9d2234 P e5256d91808b47c195bc9b4dbd7f2b87 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:07:06.924758 19374 leader_election.cc:304] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, 127766fc592545a4997f7790f50f6076
W20260709 13:07:06.879856 19375 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.3:36891, user_credentials={real_user=slave}} blocked reactor thread for 101652us
I20260709 13:07:06.883951 25760 raft_consensus.cc:3055] T 0e1085d23e8347fbbd5bce7542f4b1f4 P 0473d2b2d01f4459b1e90fd12cc7840e [term 14 LEADER]: Stepping down as leader of term 14
W20260709 13:07:06.885327 19524 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:06.898003 19479 raft_consensus.cc:1240] T d1e5873a19244c5ebbcd38e126796ee7 P 0473d2b2d01f4459b1e90fd12cc7840e [term 22 FOLLOWER]: Rejecting Update request from peer e61c3a8f61bb48f8a963c9480e53c168 for earlier term 21. Current term is 22. Ops: [20.10-21.11]
I20260709 13:07:06.884347 25918 leader_election.cc:290] T ab43d85f64114d4ebf618930e43d9ed0 P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 21 election: Requested vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:07:06.841228 25881 raft_consensus.cc:3060] T bc225c93219c45538b53a1bd3d387e4d P e61c3a8f61bb48f8a963c9480e53c168 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:07:06.907668 19481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab43d85f64114d4ebf618930e43d9ed0" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:07:06.897229 19484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a08760e15aac4630a629431f56024dc8" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:07:06.926903 19375 leader_election.cc:304] T b9f0d59553ad444883fcf5b5909f9798 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:07:06.912225 19559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab43d85f64114d4ebf618930e43d9ed0" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:07:06.852447 25992 raft_consensus.cc:740] T fa8650e71aa14778b3d73721fc50d9fc P e5256d91808b47c195bc9b4dbd7f2b87 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: e5256d91808b47c195bc9b4dbd7f2b87, State: Running, Role: LEADER
I20260709 13:07:06.913349 19377 leader_election.cc:304] T 21e14947d70440f19044d8f75c31e1f9 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87; no voters: 
I20260709 13:07:06.927711 19559 raft_consensus.cc:3060] T ab43d85f64114d4ebf618930e43d9ed0 P e61c3a8f61bb48f8a963c9480e53c168 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:07:06.840791 25520 consensus_queue.cc:237] T 5ec1c4ce15e04c7e8c283a62179f2a64 P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:07:06.910197 25987 consensus_queue.cc:237] T a08760e15aac4630a629431f56024dc8 P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 21.12, Last appended by leader: 12, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:07:06.916915 19486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "309c3ca0ca4b4f3ba129752ea2cb293b" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 13 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:07:06.945482 19483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df751f992649444090e27965eb1af85d" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 22 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:07:06.929979 19377 leader_election.cc:304] T 775c229504194560ba9589bc2199b089 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87; no voters: 
I20260709 13:07:06.946899 19404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff9b0eddd810459b82d91c60777c10eb" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 19 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:07:06.947428 19557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edd7d470b5014c9489be7f41f64355c9" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 23 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:07:06.952334 19404 raft_consensus.cc:2393] T ff9b0eddd810459b82d91c60777c10eb P e5256d91808b47c195bc9b4dbd7f2b87 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 127766fc592545a4997f7790f50f6076 in current term 19: Already voted for candidate 0473d2b2d01f4459b1e90fd12cc7840e in this term.
I20260709 13:07:06.952605 19557 raft_consensus.cc:2468] T edd7d470b5014c9489be7f41f64355c9 P e61c3a8f61bb48f8a963c9480e53c168 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 22.
I20260709 13:07:06.952766 19375 leader_election.cc:304] T 1a61655d99124a29b486ba4a5b37faea P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:07:06.948102 19554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e381f1d6b8184797ad142de49be225a8" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 17 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:07:06.953315 19409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "833a2f0775ed407a94b8924ce50adb63" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:07:06.953707 19554 raft_consensus.cc:2393] T e381f1d6b8184797ad142de49be225a8 P e61c3a8f61bb48f8a963c9480e53c168 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 0473d2b2d01f4459b1e90fd12cc7840e in current term 17: Already voted for candidate e61c3a8f61bb48f8a963c9480e53c168 in this term.
I20260709 13:07:06.953902 19409 raft_consensus.cc:2468] T 833a2f0775ed407a94b8924ce50adb63 P e5256d91808b47c195bc9b4dbd7f2b87 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 127766fc592545a4997f7790f50f6076 in term 14.
I20260709 13:07:06.948393 19559 raft_consensus.cc:2468] T ab43d85f64114d4ebf618930e43d9ed0 P e61c3a8f61bb48f8a963c9480e53c168 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 127766fc592545a4997f7790f50f6076 in term 21.
I20260709 13:07:06.949326 20078 leader_election.cc:304] T 0afb57ae58a24a01850491d69f0213dd P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 127766fc592545a4997f7790f50f6076; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:07:06.954926 25962 raft_consensus.cc:2749] T 0afb57ae58a24a01850491d69f0213dd P 127766fc592545a4997f7790f50f6076 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:07:06.960086 19558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b74109013a140ada21feeef92d6f563" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 17 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:07:06.951572 19481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edd7d470b5014c9489be7f41f64355c9" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 23 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:07:06.968247 19481 raft_consensus.cc:2468] T edd7d470b5014c9489be7f41f64355c9 P 0473d2b2d01f4459b1e90fd12cc7840e [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 22.
I20260709 13:07:06.972249 19404 raft_consensus.cc:1275] T 1f85fc4b527a48848e5faa083b604e36 P e5256d91808b47c195bc9b4dbd7f2b87 [term 18 FOLLOWER]: Refusing update from remote peer 127766fc592545a4997f7790f50f6076: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
I20260709 13:07:06.972398 19477 raft_consensus.cc:2468] T ab43d85f64114d4ebf618930e43d9ed0 P 0473d2b2d01f4459b1e90fd12cc7840e [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 127766fc592545a4997f7790f50f6076 in term 21.
I20260709 13:07:06.911110 25376 raft_consensus.cc:493] T 4509b76741dc428e9201c70c1658da13 P 0473d2b2d01f4459b1e90fd12cc7840e [term 12 FOLLOWER]: Starting leader election (detected failure of leader e61c3a8f61bb48f8a963c9480e53c168)
I20260709 13:07:06.973603 19450 leader_election.cc:304] T edd7d470b5014c9489be7f41f64355c9 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168; no voters: e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:07:06.975595 19481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b74109013a140ada21feeef92d6f563" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 17 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:07:06.980024 19481 raft_consensus.cc:2393] T 2b74109013a140ada21feeef92d6f563 P 0473d2b2d01f4459b1e90fd12cc7840e [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate e61c3a8f61bb48f8a963c9480e53c168 in current term 17: Already voted for candidate 0473d2b2d01f4459b1e90fd12cc7840e in this term.
I20260709 13:07:06.976882 19407 raft_consensus.cc:1240] T 5ec1c4ce15e04c7e8c283a62179f2a64 P e5256d91808b47c195bc9b4dbd7f2b87 [term 13 FOLLOWER]: Rejecting Update request from peer 127766fc592545a4997f7790f50f6076 for earlier term 12. Current term is 13. Ops: []
I20260709 13:07:06.980084 19477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed7fdbcb96d14d418db9ca90a792588a" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:07:06.924108 25851 raft_consensus.cc:3060] T fa731b585f684a7fb2d106c50f143b83 P e61c3a8f61bb48f8a963c9480e53c168 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:07:06.981134 19477 raft_consensus.cc:2393] T ed7fdbcb96d14d418db9ca90a792588a P 0473d2b2d01f4459b1e90fd12cc7840e [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate e61c3a8f61bb48f8a963c9480e53c168 in current term 16: Already voted for candidate 0473d2b2d01f4459b1e90fd12cc7840e in this term.
I20260709 13:07:06.982054 19552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cdf56e38bbc453d9438d359e5a69955" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 19 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:07:06.918313 25997 raft_consensus.cc:2749] T 2a16f7501e2444fb86d4e2778e734e02 P e5256d91808b47c195bc9b4dbd7f2b87 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:07:06.928153 25760 raft_consensus.cc:740] T 0e1085d23e8347fbbd5bce7542f4b1f4 P 0473d2b2d01f4459b1e90fd12cc7840e [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 0473d2b2d01f4459b1e90fd12cc7840e, State: Running, Role: LEADER
I20260709 13:07:06.945621 25829 raft_consensus.cc:2749] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P e5256d91808b47c195bc9b4dbd7f2b87 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:07:06.945526 25905 raft_consensus.cc:2749] T 0e1085d23e8347fbbd5bce7542f4b1f4 P 127766fc592545a4997f7790f50f6076 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:07:06.967549 25984 raft_consensus.cc:2804] T 21e14947d70440f19044d8f75c31e1f9 P e5256d91808b47c195bc9b4dbd7f2b87 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:07:06.993747 19477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48824d5acfbc485ebf8c2d944e7202de" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:07:06.994073 19407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65d8cb8d6ec64f459d5a47cefab10acf" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:07:07.003437 25992 consensus_queue.cc:260] T fa8650e71aa14778b3d73721fc50d9fc P e5256d91808b47c195bc9b4dbd7f2b87 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 18.10, Last appended by leader: 10, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:07:06.964692 25747 raft_consensus.cc:515] T 4af19371ea874c09a0a2147040835cbb P e61c3a8f61bb48f8a963c9480e53c168 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
W20260709 13:07:07.006300 19377 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.2:46257, user_credentials={real_user=slave}} blocked reactor thread for 76423.8us
I20260709 13:07:06.988503 25764 raft_consensus.cc:2804] T edd7d470b5014c9489be7f41f64355c9 P 0473d2b2d01f4459b1e90fd12cc7840e [term 22 FOLLOWER]: Leader pre-election won for term 23
W20260709 13:07:07.007467 19375 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.3:36891, user_credentials={real_user=slave}} blocked reactor thread for 54769.4us
I20260709 13:07:06.951201 25591 consensus_queue.cc:1048] T d1e5873a19244c5ebbcd38e126796ee7 P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.059s
I20260709 13:07:06.991458 19481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e381f1d6b8184797ad142de49be225a8" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 17 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:07:07.011583 19483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9f0d59553ad444883fcf5b5909f9798" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:07:07.025662 19410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4af19371ea874c09a0a2147040835cbb" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:07:07.020882 25764 raft_consensus.cc:493] T edd7d470b5014c9489be7f41f64355c9 P 0473d2b2d01f4459b1e90fd12cc7840e [term 22 FOLLOWER]: Starting leader election (detected failure of leader e5256d91808b47c195bc9b4dbd7f2b87)
I20260709 13:07:07.035326 25764 raft_consensus.cc:3060] T edd7d470b5014c9489be7f41f64355c9 P 0473d2b2d01f4459b1e90fd12cc7840e [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:07:07.036451 25747 leader_election.cc:290] T 4af19371ea874c09a0a2147040835cbb P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 11 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:07:06.952090 25965 raft_consensus.cc:493] T 172b3dd13109415a955b71ac0e9d2234 P 127766fc592545a4997f7790f50f6076 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 0473d2b2d01f4459b1e90fd12cc7840e)
I20260709 13:07:07.040077 25965 raft_consensus.cc:515] T 172b3dd13109415a955b71ac0e9d2234 P 127766fc592545a4997f7790f50f6076 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:07:07.042121 25965 leader_election.cc:290] T 172b3dd13109415a955b71ac0e9d2234 P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:07:06.974819 25998 raft_consensus.cc:2749] T b9f0d59553ad444883fcf5b5909f9798 P e5256d91808b47c195bc9b4dbd7f2b87 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:07:07.046803 25803 leader_election.cc:290] T 2b74109013a140ada21feeef92d6f563 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 17 election: Requested vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:07:07.048749 25764 raft_consensus.cc:515] T edd7d470b5014c9489be7f41f64355c9 P 0473d2b2d01f4459b1e90fd12cc7840e [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:07:07.015955 25983 raft_consensus.cc:2749] T 1a61655d99124a29b486ba4a5b37faea P e5256d91808b47c195bc9b4dbd7f2b87 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:07:06.978487 25837 raft_consensus.cc:515] T f1b10566f45d4a7d9029858330e02d5b P 0473d2b2d01f4459b1e90fd12cc7840e [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:07:07.016570 25946 raft_consensus.cc:3055] T 5ec1c4ce15e04c7e8c283a62179f2a64 P 127766fc592545a4997f7790f50f6076 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:07:07.013594 25984 raft_consensus.cc:493] T 21e14947d70440f19044d8f75c31e1f9 P e5256d91808b47c195bc9b4dbd7f2b87 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:07.055859 25984 raft_consensus.cc:3060] T 21e14947d70440f19044d8f75c31e1f9 P e5256d91808b47c195bc9b4dbd7f2b87 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:07:06.984272 25376 raft_consensus.cc:3060] T 4509b76741dc428e9201c70c1658da13 P 0473d2b2d01f4459b1e90fd12cc7840e [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:07:07.023723 19375 leader_election.cc:400] T ab43d85f64114d4ebf618930e43d9ed0 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 18 pre-election: Vote denied by peer e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891) with higher term. Message: Invalid argument: T ab43d85f64114d4ebf618930e43d9ed0 P e61c3a8f61bb48f8a963c9480e53c168 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e5256d91808b47c195bc9b4dbd7f2b87 for earlier term 18. Current term is 20.
I20260709 13:07:07.007973 26002 raft_consensus.cc:2804] T 775c229504194560ba9589bc2199b089 P e5256d91808b47c195bc9b4dbd7f2b87 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:07:07.057853 19375 leader_election.cc:403] T ab43d85f64114d4ebf618930e43d9ed0 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 18 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:07:07.057996 26002 raft_consensus.cc:493] T 775c229504194560ba9589bc2199b089 P e5256d91808b47c195bc9b4dbd7f2b87 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:07.058495 26002 raft_consensus.cc:3060] T 775c229504194560ba9589bc2199b089 P e5256d91808b47c195bc9b4dbd7f2b87 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:07:07.058559 25983 raft_consensus.cc:3060] T ab43d85f64114d4ebf618930e43d9ed0 P e5256d91808b47c195bc9b4dbd7f2b87 [term 17 FOLLOWER]: Advancing to term 20
I20260709 13:07:07.058755 19375 leader_election.cc:304] T 28af091831594f9d8e96482078cc7625 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:07:07.024446 19377 leader_election.cc:304] T 309c3ca0ca4b4f3ba129752ea2cb293b P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, 127766fc592545a4997f7790f50f6076
I20260709 13:07:07.059791 25598 raft_consensus.cc:2749] T 28af091831594f9d8e96482078cc7625 P e5256d91808b47c195bc9b4dbd7f2b87 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:07:07.060115 25988 raft_consensus.cc:493] T f1b10566f45d4a7d9029858330e02d5b P e61c3a8f61bb48f8a963c9480e53c168 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:07.016129 25760 consensus_queue.cc:260] T 0e1085d23e8347fbbd5bce7542f4b1f4 P 0473d2b2d01f4459b1e90fd12cc7840e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.12, Last appended by leader: 12, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:07:07.061612 25988 raft_consensus.cc:515] T f1b10566f45d4a7d9029858330e02d5b P e61c3a8f61bb48f8a963c9480e53c168 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:07:07.068084 19377 leader_election.cc:304] T 1f85fc4b527a48848e5faa083b604e36 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, 127766fc592545a4997f7790f50f6076
I20260709 13:07:07.068732 25537 raft_consensus.cc:493] T ff75a1d4cb1f493db8f71ddc136ba9ab P 0473d2b2d01f4459b1e90fd12cc7840e [term 19 FOLLOWER]: Starting pre-election (detected failure of leader e5256d91808b47c195bc9b4dbd7f2b87)
I20260709 13:07:07.069217 19377 leader_election.cc:304] T a08760e15aac4630a629431f56024dc8 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87; no voters: 
I20260709 13:07:07.070056 25591 raft_consensus.cc:2749] T 309c3ca0ca4b4f3ba129752ea2cb293b P e5256d91808b47c195bc9b4dbd7f2b87 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:07:07.070362 19377 leader_election.cc:400] T ab43d85f64114d4ebf618930e43d9ed0 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 18 pre-election: Vote denied by peer 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257) with higher term. Message: Invalid argument: T ab43d85f64114d4ebf618930e43d9ed0 P 0473d2b2d01f4459b1e90fd12cc7840e [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e5256d91808b47c195bc9b4dbd7f2b87 for earlier term 18. Current term is 19.
I20260709 13:07:06.965269 25879 leader_election.cc:290] T b08304a0a02b42d7840c4e8ee9a6bd1a P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:07:07.070719 25591 raft_consensus.cc:2749] T 1f85fc4b527a48848e5faa083b604e36 P e5256d91808b47c195bc9b4dbd7f2b87 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:07:07.070848 25997 raft_consensus.cc:2804] T a08760e15aac4630a629431f56024dc8 P e5256d91808b47c195bc9b4dbd7f2b87 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:07:07.030170 19407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85c494af21f9457a85da47b9bc70c1fd" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:07:07.071431 25997 raft_consensus.cc:493] T a08760e15aac4630a629431f56024dc8 P e5256d91808b47c195bc9b4dbd7f2b87 [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:07.071943 25997 raft_consensus.cc:3060] T a08760e15aac4630a629431f56024dc8 P e5256d91808b47c195bc9b4dbd7f2b87 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:07:07.071420 19308 catalog_manager.cc:5697] T 309c3ca0ca4b4f3ba129752ea2cb293b P e5256d91808b47c195bc9b4dbd7f2b87 reported cstate change: config changed from index 5 to 10, term changed from 11 to 12, leader changed from 127766fc592545a4997f7790f50f6076 (127.17.223.4) to <none>, VOTER e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3) evicted, no longer has a pending config: VOTER e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1), VOTER 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2), VOTER 127766fc592545a4997f7790f50f6076 (127.17.223.4). New cstate: current_term: 12 committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } } }
I20260709 13:07:07.073763 19308 catalog_manager.cc:5697] T 46c5bfeecc314717bffe987e6844b6d0 P e5256d91808b47c195bc9b4dbd7f2b87 reported cstate change: term changed from 18 to 23, leader changed from e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1) to 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2). New cstate: current_term: 23 leader_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } }
I20260709 13:07:07.075480 20105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4af19371ea874c09a0a2147040835cbb" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076"
I20260709 13:07:07.076031 20105 raft_consensus.cc:3060] T 4af19371ea874c09a0a2147040835cbb P 127766fc592545a4997f7790f50f6076 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:07.076262 25837 leader_election.cc:290] T f1b10566f45d4a7d9029858330e02d5b P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 18 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:07:07.070838 19375 leader_election.cc:304] T 40e1e16737a842ee936002830f36882e P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:07:07.077562 19407 raft_consensus.cc:2468] T 85c494af21f9457a85da47b9bc70c1fd P e5256d91808b47c195bc9b4dbd7f2b87 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 127766fc592545a4997f7790f50f6076 in term 17.
I20260709 13:07:07.078398 25803 raft_consensus.cc:2749] T 40e1e16737a842ee936002830f36882e P e5256d91808b47c195bc9b4dbd7f2b87 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:07:07.078565 19375 leader_election.cc:304] T 2e36a9d6e29c4a7c860cf267efbd4c74 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168; no voters: 0473d2b2d01f4459b1e90fd12cc7840e
I20260709 13:07:07.079231 19554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1b10566f45d4a7d9029858330e02d5b" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:07:07.079943 19377 leader_election.cc:304] T 0cdf56e38bbc453d9438d359e5a69955 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87; no voters: e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:07:07.081776 19483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22196caba61445d3bec98a0aab3c337d" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 20 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:07:07.082511 19551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4509b76741dc428e9201c70c1658da13" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:07:07.082741 25591 raft_consensus.cc:2804] T 2e36a9d6e29c4a7c860cf267efbd4c74 P e5256d91808b47c195bc9b4dbd7f2b87 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:07:07.083137 25591 raft_consensus.cc:493] T 2e36a9d6e29c4a7c860cf267efbd4c74 P e5256d91808b47c195bc9b4dbd7f2b87 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 0473d2b2d01f4459b1e90fd12cc7840e)
I20260709 13:07:07.083570 19557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22196caba61445d3bec98a0aab3c337d" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 20 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:07:07.083730 25998 raft_consensus.cc:2804] T 0cdf56e38bbc453d9438d359e5a69955 P e5256d91808b47c195bc9b4dbd7f2b87 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:07:07.084280 19559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14935b3ddf914369822e4a0547aaa355" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:07:07.084798 19559 raft_consensus.cc:1813] T 14935b3ddf914369822e4a0547aaa355 P e61c3a8f61bb48f8a963c9480e53c168 [term 13 FOLLOWER]: Handling vote request from an unknown peer e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:07:07.084647 19557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1b10566f45d4a7d9029858330e02d5b" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:07:07.085281 19559 raft_consensus.cc:2368] T 14935b3ddf914369822e4a0547aaa355 P e61c3a8f61bb48f8a963c9480e53c168 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e5256d91808b47c195bc9b4dbd7f2b87 for earlier term 12. Current term is 13.
I20260709 13:07:07.085175 19485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4509b76741dc428e9201c70c1658da13" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:07:07.085665 19553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a08760e15aac4630a629431f56024dc8" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 23 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:07:07.086623 19484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14935b3ddf914369822e4a0547aaa355" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:07:07.082553 19483 raft_consensus.cc:2410] T 22196caba61445d3bec98a0aab3c337d P 0473d2b2d01f4459b1e90fd12cc7840e [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e5256d91808b47c195bc9b4dbd7f2b87 for term 20 because replica has last-logged OpId of term: 18 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 10.
I20260709 13:07:07.088883 19308 catalog_manager.cc:5697] T 21e14947d70440f19044d8f75c31e1f9 P e5256d91808b47c195bc9b4dbd7f2b87 reported cstate change: term changed from 7 to 17. New cstate: current_term: 17 leader_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } health_report { overall_health: HEALTHY } } }
I20260709 13:07:07.055297 25946 raft_consensus.cc:740] T 5ec1c4ce15e04c7e8c283a62179f2a64 P 127766fc592545a4997f7790f50f6076 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 127766fc592545a4997f7790f50f6076, State: Running, Role: LEADER
I20260709 13:07:07.089329 19523 leader_election.cc:304] T 7be9efa6559648dbb5a0f7684c4542d1 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 127766fc592545a4997f7790f50f6076, e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
W20260709 13:07:07.135891 19523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.1:40321, user_credentials={real_user=slave}} blocked reactor thread for 46667.9us
I20260709 13:07:06.972071 20076 leader_election.cc:304] T ab43d85f64114d4ebf618930e43d9ed0 P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 127766fc592545a4997f7790f50f6076, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:07:07.029372 19481 raft_consensus.cc:2393] T e381f1d6b8184797ad142de49be225a8 P 0473d2b2d01f4459b1e90fd12cc7840e [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate e61c3a8f61bb48f8a963c9480e53c168 in current term 17: Already voted for candidate 0473d2b2d01f4459b1e90fd12cc7840e in this term.
I20260709 13:07:07.083794 19551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef32ce6fdd0e40d382c79974f30295c6" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 23 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:07:07.137809 19551 raft_consensus.cc:3060] T ef32ce6fdd0e40d382c79974f30295c6 P e61c3a8f61bb48f8a963c9480e53c168 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:07:07.097537 19554 raft_consensus.cc:2468] T f1b10566f45d4a7d9029858330e02d5b P e61c3a8f61bb48f8a963c9480e53c168 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 18.
I20260709 13:07:07.139590 19484 raft_consensus.cc:1240] T edd7d470b5014c9489be7f41f64355c9 P 0473d2b2d01f4459b1e90fd12cc7840e [term 23 FOLLOWER]: Rejecting Update request from peer e5256d91808b47c195bc9b4dbd7f2b87 for earlier term 22. Current term is 23. Ops: []
I20260709 13:07:07.141937 19485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14efcc79969f41babe5529c22d59156d" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:07:07.143072 19485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef32ce6fdd0e40d382c79974f30295c6" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 23 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:07:07.143599 19485 raft_consensus.cc:3060] T ef32ce6fdd0e40d382c79974f30295c6 P 0473d2b2d01f4459b1e90fd12cc7840e [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:07:07.140588 19484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b74109013a140ada21feeef92d6f563" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 17 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:07:07.147934 19410 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ece3db938bc649d4a40a51522ed5259c"
dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
mode: GRACEFUL
new_leader_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
 from {username='slave'} at 127.0.0.1:37312
I20260709 13:07:07.148435 19484 raft_consensus.cc:2393] T 2b74109013a140ada21feeef92d6f563 P 0473d2b2d01f4459b1e90fd12cc7840e [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate e5256d91808b47c195bc9b4dbd7f2b87 in current term 17: Already voted for candidate 0473d2b2d01f4459b1e90fd12cc7840e in this term.
I20260709 13:07:07.148600 19410 raft_consensus.cc:606] T ece3db938bc649d4a40a51522ed5259c P e5256d91808b47c195bc9b4dbd7f2b87 [term 14 FOLLOWER]: Received request to transfer leadership to TS e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:07:07.148970 19410 raft_consensus.cc:614] T ece3db938bc649d4a40a51522ed5259c P e5256d91808b47c195bc9b4dbd7f2b87 [term 14 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:07:07.106720 19407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa731b585f684a7fb2d106c50f143b83" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 17 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:07:07.110062 20106 raft_consensus.cc:1275] T fa731b585f684a7fb2d106c50f143b83 P 127766fc592545a4997f7790f50f6076 [term 16 FOLLOWER]: Refusing update from remote peer e5256d91808b47c195bc9b4dbd7f2b87: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 13:07:07.100526 20105 raft_consensus.cc:2468] T 4af19371ea874c09a0a2147040835cbb P 127766fc592545a4997f7790f50f6076 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 11.
I20260709 13:07:07.133100 19560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc225c93219c45538b53a1bd3d387e4d" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:07:07.148979 19481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1b10566f45d4a7d9029858330e02d5b" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:07:07.150655 20110 raft_consensus.cc:1240] T 4af19371ea874c09a0a2147040835cbb P 127766fc592545a4997f7790f50f6076 [term 11 FOLLOWER]: Rejecting Update request from peer e5256d91808b47c195bc9b4dbd7f2b87 for earlier term 10. Current term is 11. Ops: [10.9-10.9]
I20260709 13:07:07.150934 19484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f93ee515a9c14139bf566522ed8232f3" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 23 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:07:07.151129 19481 raft_consensus.cc:2468] T f1b10566f45d4a7d9029858330e02d5b P 0473d2b2d01f4459b1e90fd12cc7840e [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 18.
W20260709 13:07:07.148229 19523 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:07.065713 25760 raft_consensus.cc:3060] T 0e1085d23e8347fbbd5bce7542f4b1f4 P 0473d2b2d01f4459b1e90fd12cc7840e [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:07:07.152993 19523 leader_election.cc:304] T 4af19371ea874c09a0a2147040835cbb P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 127766fc592545a4997f7790f50f6076, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:07:07.134104 19449 leader_election.cc:304] T ed7fdbcb96d14d418db9ca90a792588a P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e; no voters: 127766fc592545a4997f7790f50f6076, e61c3a8f61bb48f8a963c9480e53c168
W20260709 13:07:07.159631 20076 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.3:36891, user_credentials={real_user=slave}} blocked reactor thread for 187618us
I20260709 13:07:07.083586 25591 raft_consensus.cc:3060] T 2e36a9d6e29c4a7c860cf267efbd4c74 P e5256d91808b47c195bc9b4dbd7f2b87 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:07:07.160740 20112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14935b3ddf914369822e4a0547aaa355" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:07:07.160418 20109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14efcc79969f41babe5529c22d59156d" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:07:07.161327 20112 raft_consensus.cc:1813] T 14935b3ddf914369822e4a0547aaa355 P 127766fc592545a4997f7790f50f6076 [term 13 FOLLOWER]: Handling vote request from an unknown peer e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:07:07.161970 20112 raft_consensus.cc:2368] T 14935b3ddf914369822e4a0547aaa355 P 127766fc592545a4997f7790f50f6076 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e5256d91808b47c195bc9b4dbd7f2b87 for earlier term 12. Current term is 13.
I20260709 13:07:07.164561 19557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f93ee515a9c14139bf566522ed8232f3" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 23 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:07:07.165968 19557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b74109013a140ada21feeef92d6f563" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 17 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:07:07.176007 19557 raft_consensus.cc:2393] T 2b74109013a140ada21feeef92d6f563 P e61c3a8f61bb48f8a963c9480e53c168 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate e5256d91808b47c195bc9b4dbd7f2b87 in current term 17: Already voted for candidate e61c3a8f61bb48f8a963c9480e53c168 in this term.
I20260709 13:07:07.177596 19377 leader_election.cc:304] T f1b10566f45d4a7d9029858330e02d5b P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87; no voters: 
I20260709 13:07:07.177904 19407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "172b3dd13109415a955b71ac0e9d2234" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:07:07.181512 20107 raft_consensus.cc:1275] T 0e1085d23e8347fbbd5bce7542f4b1f4 P 127766fc592545a4997f7790f50f6076 [term 15 FOLLOWER]: Refusing update from remote peer e61c3a8f61bb48f8a963c9480e53c168: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 13:07:07.183398 20075 leader_election.cc:304] T 833a2f0775ed407a94b8924ce50adb63 P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 127766fc592545a4997f7790f50f6076, e5256d91808b47c195bc9b4dbd7f2b87; no voters: e61c3a8f61bb48f8a963c9480e53c168
W20260709 13:07:07.186972 19449 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.4:43121, user_credentials={real_user=slave}} blocked reactor thread for 52960.2us
I20260709 13:07:07.187902 19449 leader_election.cc:304] T ab43d85f64114d4ebf618930e43d9ed0 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, 127766fc592545a4997f7790f50f6076; no voters: e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:07:07.132529 25998 raft_consensus.cc:493] T 0cdf56e38bbc453d9438d359e5a69955 P e5256d91808b47c195bc9b4dbd7f2b87 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:07.194420 20075 leader_election.cc:304] T ff9b0eddd810459b82d91c60777c10eb P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 127766fc592545a4997f7790f50f6076; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:07:07.195343 19404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ece3db938bc649d4a40a51522ed5259c" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:07:07.195663 19410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65d8cb8d6ec64f459d5a47cefab10acf" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:07:07.195937 19404 raft_consensus.cc:2468] T ece3db938bc649d4a40a51522ed5259c P e5256d91808b47c195bc9b4dbd7f2b87 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 14.
I20260709 13:07:07.195955 19405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22196caba61445d3bec98a0aab3c337d" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:07:07.197335 19405 raft_consensus.cc:2393] T 22196caba61445d3bec98a0aab3c337d P e5256d91808b47c195bc9b4dbd7f2b87 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e61c3a8f61bb48f8a963c9480e53c168 in current term 19: Already voted for candidate e5256d91808b47c195bc9b4dbd7f2b87 in this term.
I20260709 13:07:07.198161 19404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "309c3ca0ca4b4f3ba129752ea2cb293b" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 13 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:07:07.199791 19526 leader_election.cc:304] T 2e36a9d6e29c4a7c860cf267efbd4c74 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e61c3a8f61bb48f8a963c9480e53c168; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:07:07.201640 26001 consensus_queue.cc:1048] T fa731b585f684a7fb2d106c50f143b83 P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Connected to new peer: Peer: permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.017s
I20260709 13:07:07.202324 19552 raft_consensus.cc:1240] T 65d8cb8d6ec64f459d5a47cefab10acf P e61c3a8f61bb48f8a963c9480e53c168 [term 20 FOLLOWER]: Rejecting Update request from peer e5256d91808b47c195bc9b4dbd7f2b87 for earlier term 19. Current term is 20. Ops: []
I20260709 13:07:07.174896 25917 raft_consensus.cc:493] T 14935b3ddf914369822e4a0547aaa355 P 127766fc592545a4997f7790f50f6076 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:07.206087 18300 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 13:07:07.228394 19404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df751f992649444090e27965eb1af85d" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 22 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:07:07.229123 19404 raft_consensus.cc:2393] T df751f992649444090e27965eb1af85d P e5256d91808b47c195bc9b4dbd7f2b87 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e61c3a8f61bb48f8a963c9480e53c168 in current term 22: Already voted for candidate 0473d2b2d01f4459b1e90fd12cc7840e in this term.
I20260709 13:07:07.229729 18300 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:07:07.207370 25819 raft_consensus.cc:2804] T f1b10566f45d4a7d9029858330e02d5b P e5256d91808b47c195bc9b4dbd7f2b87 [term 18 FOLLOWER]: Leader pre-election won for term 19
W20260709 13:07:07.207636 20078 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.2:46257, user_credentials={real_user=slave}} blocked reactor thread for 223715us
W20260709 13:07:07.208040 19523 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:07.210585 19308 catalog_manager.cc:5697] T edd7d470b5014c9489be7f41f64355c9 P e5256d91808b47c195bc9b4dbd7f2b87 reported cstate change: term changed from 12 to 20, leader changed from e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1) to 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2). New cstate: current_term: 20 leader_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } }
I20260709 13:07:07.211160 19374 leader_election.cc:304] T 14efcc79969f41babe5529c22d59156d P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, 127766fc592545a4997f7790f50f6076
I20260709 13:07:07.163403 25827 raft_consensus.cc:2804] T 7be9efa6559648dbb5a0f7684c4542d1 P e61c3a8f61bb48f8a963c9480e53c168 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:07:07.159067 25932 raft_consensus.cc:493] T 1a61655d99124a29b486ba4a5b37faea P 0473d2b2d01f4459b1e90fd12cc7840e [term 17 FOLLOWER]: Starting pre-election (detected failure of leader e61c3a8f61bb48f8a963c9480e53c168)
I20260709 13:07:07.182472 25905 raft_consensus.cc:2804] T ab43d85f64114d4ebf618930e43d9ed0 P 127766fc592545a4997f7790f50f6076 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:07:07.236312 20110 raft_consensus.cc:1240] T 0e1085d23e8347fbbd5bce7542f4b1f4 P 127766fc592545a4997f7790f50f6076 [term 15 FOLLOWER]: Rejecting Update request from peer 0473d2b2d01f4459b1e90fd12cc7840e for earlier term 14. Current term is 15. Ops: [14.12-14.12]
I20260709 13:07:07.237010 19484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "172b3dd13109415a955b71ac0e9d2234" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:07:07.260794 19404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edd7d470b5014c9489be7f41f64355c9" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 23 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
I20260709 13:07:07.212121 25956 raft_consensus.cc:2764] T ab43d85f64114d4ebf618930e43d9ed0 P 0473d2b2d01f4459b1e90fd12cc7840e [term 21 FOLLOWER]: Leader pre-election decision vote started in defunct term 19: won
I20260709 13:07:07.177461 25661 raft_consensus.cc:2804] T 4af19371ea874c09a0a2147040835cbb P e61c3a8f61bb48f8a963c9480e53c168 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:07:07.240386 20111 raft_consensus.cc:2468] T 775c229504194560ba9589bc2199b089 P 127766fc592545a4997f7790f50f6076 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 14.
I20260709 13:07:07.242444 26002 raft_consensus.cc:515] T 775c229504194560ba9589bc2199b089 P e5256d91808b47c195bc9b4dbd7f2b87 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
W20260709 13:07:07.246984 20075 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.1:40321, user_credentials={real_user=slave}} blocked reactor thread for 52743.2us
I20260709 13:07:07.247228 19551 raft_consensus.cc:2468] T ef32ce6fdd0e40d382c79974f30295c6 P e61c3a8f61bb48f8a963c9480e53c168 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 23.
I20260709 13:07:07.248353 19526 leader_election.cc:304] T 28af091831594f9d8e96482078cc7625 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e61c3a8f61bb48f8a963c9480e53c168; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:07:07.250872 25376 raft_consensus.cc:515] T 4509b76741dc428e9201c70c1658da13 P 0473d2b2d01f4459b1e90fd12cc7840e [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:07:07.069240 25537 raft_consensus.cc:515] T ff75a1d4cb1f493db8f71ddc136ba9ab P 0473d2b2d01f4459b1e90fd12cc7840e [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:07:07.253758 19485 raft_consensus.cc:2468] T ef32ce6fdd0e40d382c79974f30295c6 P 0473d2b2d01f4459b1e90fd12cc7840e [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 23.
W20260709 13:07:07.260489 19374 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.4:43121, user_credentials={real_user=slave}} blocked reactor thread for 49409.6us
I20260709 13:07:07.261344 19408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a08760e15aac4630a629431f56024dc8" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:07:07.234589 19308 catalog_manager.cc:5697] T a08760e15aac4630a629431f56024dc8 P e5256d91808b47c195bc9b4dbd7f2b87 reported cstate change: term changed from 11 to 21, leader changed from e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3) to e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1). New cstate: current_term: 21 leader_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } health_report { overall_health: HEALTHY } } }
I20260709 13:07:07.211855 25803 consensus_queue.cc:1059] T edd7d470b5014c9489be7f41f64355c9 P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 }, Status: INVALID_TERM, Last received: 22.12, Next index: 13, Last known committed idx: 10, Time since last communication: 0.094s
I20260709 13:07:07.317230 19308 catalog_manager.cc:5697] T 70797e5783b5454ab0d0eea663e791e3 P e5256d91808b47c195bc9b4dbd7f2b87 reported cstate change: term changed from 12 to 20, leader changed from 127766fc592545a4997f7790f50f6076 (127.17.223.4) to e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1). New cstate: current_term: 20 leader_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:07.193140 25964 raft_consensus.cc:2749] T ed7fdbcb96d14d418db9ca90a792588a P 0473d2b2d01f4459b1e90fd12cc7840e [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:07:07.150153 25925 raft_consensus.cc:515] T 1dc5b3532fe54f74876d02beffa2c230 P e5256d91808b47c195bc9b4dbd7f2b87 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:07:07.237274 19410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b74109013a140ada21feeef92d6f563" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 17 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
I20260709 13:07:07.252182 25962 raft_consensus.cc:2749] T ff9b0eddd810459b82d91c60777c10eb P 127766fc592545a4997f7790f50f6076 [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:07:07.263039 25747 raft_consensus.cc:2749] T 2e36a9d6e29c4a7c860cf267efbd4c74 P e61c3a8f61bb48f8a963c9480e53c168 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:07:07.323997 19450 leader_election.cc:304] T f1b10566f45d4a7d9029858330e02d5b P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:07:07.233799 25982 raft_consensus.cc:697] T 70797e5783b5454ab0d0eea663e791e3 P e5256d91808b47c195bc9b4dbd7f2b87 [term 22 LEADER]: Becoming Leader. State: Replica: e5256d91808b47c195bc9b4dbd7f2b87, State: Running, Role: LEADER
I20260709 13:07:07.193733 25998 raft_consensus.cc:3060] T 0cdf56e38bbc453d9438d359e5a69955 P e5256d91808b47c195bc9b4dbd7f2b87 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:07:07.315523 19374 leader_election.cc:400] T 14935b3ddf914369822e4a0547aaa355 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 12 pre-election: Vote denied by peer 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121) with higher term. Message: Invalid argument: T 14935b3ddf914369822e4a0547aaa355 P 127766fc592545a4997f7790f50f6076 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e5256d91808b47c195bc9b4dbd7f2b87 for earlier term 12. Current term is 13.
I20260709 13:07:07.337754 19374 leader_election.cc:403] T 14935b3ddf914369822e4a0547aaa355 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 12 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:07:07.275594 25994 raft_consensus.cc:2804] T 833a2f0775ed407a94b8924ce50adb63 P 127766fc592545a4997f7790f50f6076 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:07:07.281421 19404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1b10566f45d4a7d9029858330e02d5b" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
I20260709 13:07:07.287601 25905 raft_consensus.cc:697] T ab43d85f64114d4ebf618930e43d9ed0 P 127766fc592545a4997f7790f50f6076 [term 21 LEADER]: Becoming Leader. State: Replica: 127766fc592545a4997f7790f50f6076, State: Running, Role: LEADER
I20260709 13:07:07.232743 25819 raft_consensus.cc:493] T f1b10566f45d4a7d9029858330e02d5b P e5256d91808b47c195bc9b4dbd7f2b87 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:07.276688 25996 raft_consensus.cc:2749] T 14efcc79969f41babe5529c22d59156d P e5256d91808b47c195bc9b4dbd7f2b87 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:07:07.285961 25953 raft_consensus.cc:515] T 21e14947d70440f19044d8f75c31e1f9 P 0473d2b2d01f4459b1e90fd12cc7840e [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:07:07.325884 19407 raft_consensus.cc:1240] T fa731b585f684a7fb2d106c50f143b83 P e5256d91808b47c195bc9b4dbd7f2b87 [term 16 LEADER]: Rejecting Update request from peer e61c3a8f61bb48f8a963c9480e53c168 for earlier term 15. Current term is 16. Ops: []
W20260709 13:07:07.356911 19524 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:07.357529 19407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edd7d470b5014c9489be7f41f64355c9" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 23 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
W20260709 13:07:07.294662 25812 consensus_meta.cc:287] T 9962423cb4e54fcfa5de01daf68a86e7 P e5256d91808b47c195bc9b4dbd7f2b87: Time spent flushing consensus metadata: real 0.555s	user 0.007s	sys 0.003s
I20260709 13:07:07.359104 25812 raft_consensus.cc:515] T 9962423cb4e54fcfa5de01daf68a86e7 P e5256d91808b47c195bc9b4dbd7f2b87 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:07:07.360247 19411 raft_consensus.cc:1240] T 9962423cb4e54fcfa5de01daf68a86e7 P e5256d91808b47c195bc9b4dbd7f2b87 [term 18 FOLLOWER]: Rejecting Update request from peer 127766fc592545a4997f7790f50f6076 for earlier term 17. Current term is 18. Ops: []
I20260709 13:07:07.361325 25812 leader_election.cc:290] T 9962423cb4e54fcfa5de01daf68a86e7 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 18 election: Requested vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:07:07.363121 26002 leader_election.cc:290] T 775c229504194560ba9589bc2199b089 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 15 election: Requested vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:07:07.350215 26001 raft_consensus.cc:3060] T 14935b3ddf914369822e4a0547aaa355 P e5256d91808b47c195bc9b4dbd7f2b87 [term 11 FOLLOWER]: Advancing to term 13
I20260709 13:07:07.281251 25827 raft_consensus.cc:697] T 7be9efa6559648dbb5a0f7684c4542d1 P e61c3a8f61bb48f8a963c9480e53c168 [term 20 LEADER]: Becoming Leader. State: Replica: e61c3a8f61bb48f8a963c9480e53c168, State: Running, Role: LEADER
I20260709 13:07:07.368673 25827 consensus_queue.cc:237] T 7be9efa6559648dbb5a0f7684c4542d1 P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.11, Last appended by leader: 11, Current term: 20, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } attrs { replace: true } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:07:07.370051 20107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9962423cb4e54fcfa5de01daf68a86e7" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076"
W20260709 13:07:07.238477 25530 consensus_meta.cc:287] T b08304a0a02b42d7840c4e8ee9a6bd1a P 0473d2b2d01f4459b1e90fd12cc7840e: Time spent flushing consensus metadata: real 0.521s	user 0.007s	sys 0.002s
I20260709 13:07:07.371632 20110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "775c229504194560ba9589bc2199b089" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076"
I20260709 13:07:07.333362 19485 raft_consensus.cc:1275] T 7f575b143b844aa096b50997dad3516a P 0473d2b2d01f4459b1e90fd12cc7840e [term 16 FOLLOWER]: Refusing update from remote peer e5256d91808b47c195bc9b4dbd7f2b87: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 13:07:07.373414 19485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9962423cb4e54fcfa5de01daf68a86e7" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:07:07.334395 19410 raft_consensus.cc:2393] T 2b74109013a140ada21feeef92d6f563 P e5256d91808b47c195bc9b4dbd7f2b87 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 0473d2b2d01f4459b1e90fd12cc7840e in current term 17: Already voted for candidate e5256d91808b47c195bc9b4dbd7f2b87 in this term.
I20260709 13:07:07.375698 19410 raft_consensus.cc:1240] T 1dc5b3532fe54f74876d02beffa2c230 P e5256d91808b47c195bc9b4dbd7f2b87 [term 21 FOLLOWER]: Rejecting Update request from peer e61c3a8f61bb48f8a963c9480e53c168 for earlier term 20. Current term is 21. Ops: [20.11-20.11]
I20260709 13:07:07.336546 19478 raft_consensus.cc:1240] T 4509b76741dc428e9201c70c1658da13 P 0473d2b2d01f4459b1e90fd12cc7840e [term 13 FOLLOWER]: Rejecting Update request from peer e61c3a8f61bb48f8a963c9480e53c168 for earlier term 12. Current term is 13. Ops: []
I20260709 13:07:07.264161 25977 consensus_queue.cc:1059] T 1efebf73c86e432baa55533136b6e12c P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false }, Status: INVALID_TERM, Last received: 14.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.090s
I20260709 13:07:07.378260 25982 consensus_queue.cc:237] T 70797e5783b5454ab0d0eea663e791e3 P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 20.14, Last appended by leader: 14, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:07:07.374537 19485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "775c229504194560ba9589bc2199b089" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:07:07.382325 19485 raft_consensus.cc:3060] T 775c229504194560ba9589bc2199b089 P 0473d2b2d01f4459b1e90fd12cc7840e [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:07:07.295150 19526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.2:46257, user_credentials={real_user=slave}} blocked reactor thread for 46868.8us
I20260709 13:07:07.314689 25754 raft_consensus.cc:2749] T 28af091831594f9d8e96482078cc7625 P e61c3a8f61bb48f8a963c9480e53c168 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:07:07.341553 25975 raft_consensus.cc:2804] T f1b10566f45d4a7d9029858330e02d5b P 0473d2b2d01f4459b1e90fd12cc7840e [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:07:07.396087 19526 leader_election.cc:304] T 22196caba61445d3bec98a0aab3c337d P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:07:07.315240 25661 raft_consensus.cc:697] T 4af19371ea874c09a0a2147040835cbb P e61c3a8f61bb48f8a963c9480e53c168 [term 11 LEADER]: Becoming Leader. State: Replica: e61c3a8f61bb48f8a963c9480e53c168, State: Running, Role: LEADER
I20260709 13:07:07.283018 25932 raft_consensus.cc:515] T 1a61655d99124a29b486ba4a5b37faea P 0473d2b2d01f4459b1e90fd12cc7840e [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:07:07.323665 19308 catalog_manager.cc:5697] T ff9b0eddd810459b82d91c60777c10eb P e5256d91808b47c195bc9b4dbd7f2b87 reported cstate change: term changed from 16 to 17, leader changed from 127766fc592545a4997f7790f50f6076 (127.17.223.4) to 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2). New cstate: current_term: 17 leader_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } } }
I20260709 13:07:07.355763 19484 raft_consensus.cc:1240] T 5ec1c4ce15e04c7e8c283a62179f2a64 P 0473d2b2d01f4459b1e90fd12cc7840e [term 13 LEADER]: Rejecting Update request from peer 127766fc592545a4997f7790f50f6076 for earlier term 12. Current term is 13. Ops: []
I20260709 13:07:07.338552 25994 raft_consensus.cc:493] T 833a2f0775ed407a94b8924ce50adb63 P 127766fc592545a4997f7790f50f6076 [term 14 FOLLOWER]: Starting leader election (detected failure of leader e61c3a8f61bb48f8a963c9480e53c168)
I20260709 13:07:07.255156 25917 raft_consensus.cc:515] T 14935b3ddf914369822e4a0547aaa355 P 127766fc592545a4997f7790f50f6076 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:07:07.312677 25989 consensus_queue.cc:1048] T 1f85fc4b527a48848e5faa083b604e36 P 127766fc592545a4997f7790f50f6076 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.040s
I20260709 13:07:07.317646 25815 consensus_queue.cc:1059] T 5ec1c4ce15e04c7e8c283a62179f2a64 P 127766fc592545a4997f7790f50f6076 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 }, Status: INVALID_TERM, Last received: 12.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.035s
I20260709 13:07:07.403823 19485 raft_consensus.cc:2468] T 775c229504194560ba9589bc2199b089 P 0473d2b2d01f4459b1e90fd12cc7840e [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 15.
I20260709 13:07:07.409348 19480 raft_consensus.cc:1240] T 21e14947d70440f19044d8f75c31e1f9 P 0473d2b2d01f4459b1e90fd12cc7840e [term 19 FOLLOWER]: Rejecting Update request from peer e61c3a8f61bb48f8a963c9480e53c168 for earlier term 18. Current term is 19. Ops: []
I20260709 13:07:07.353070 25819 raft_consensus.cc:3060] T f1b10566f45d4a7d9029858330e02d5b P e5256d91808b47c195bc9b4dbd7f2b87 [term 18 FOLLOWER]: Advancing to term 19
W20260709 13:07:07.406273 19306 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:51954 (request call id 134) took 20926 ms (client timeout 15000 ms). Trace:
I20260709 13:07:07.407737 19308 catalog_manager.cc:5697] T f1b10566f45d4a7d9029858330e02d5b P e5256d91808b47c195bc9b4dbd7f2b87 reported cstate change: term changed from 15 to 17. New cstate: current_term: 17 leader_uuid: "e61c3a8f61bb48f8a963c9480e53c168" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } }
I20260709 13:07:07.427851 19308 catalog_manager.cc:5697] T b9f0d59553ad444883fcf5b5909f9798 P e5256d91808b47c195bc9b4dbd7f2b87 reported cstate change: term changed from 14 to 15, leader changed from e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3) to 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2). New cstate: current_term: 15 leader_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } }
I20260709 13:07:07.430855 19308 catalog_manager.cc:5697] T 2a16f7501e2444fb86d4e2778e734e02 P e5256d91808b47c195bc9b4dbd7f2b87 reported cstate change: term changed from 15 to 16, leader changed from e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3) to 127766fc592545a4997f7790f50f6076 (127.17.223.4). New cstate: current_term: 16 leader_uuid: "127766fc592545a4997f7790f50f6076" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } } }
I20260709 13:07:07.432906 19526 leader_election.cc:304] T ef32ce6fdd0e40d382c79974f30295c6 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168; no voters: e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:07:07.434552 25093 raft_consensus.cc:3055] T edd7d470b5014c9489be7f41f64355c9 P e5256d91808b47c195bc9b4dbd7f2b87 [term 22 LEADER]: Stepping down as leader of term 22
I20260709 13:07:07.434973 25093 raft_consensus.cc:740] T edd7d470b5014c9489be7f41f64355c9 P e5256d91808b47c195bc9b4dbd7f2b87 [term 22 LEADER]: Becoming Follower/Learner. State: Replica: e5256d91808b47c195bc9b4dbd7f2b87, State: Running, Role: LEADER
I20260709 13:07:07.435701 25093 consensus_queue.cc:260] T edd7d470b5014c9489be7f41f64355c9 P e5256d91808b47c195bc9b4dbd7f2b87 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 22.12, Last appended by leader: 12, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:07:07.436507 25917 leader_election.cc:290] T 14935b3ddf914369822e4a0547aaa355 P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:07:07.436771 25093 raft_consensus.cc:3060] T edd7d470b5014c9489be7f41f64355c9 P e5256d91808b47c195bc9b4dbd7f2b87 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:07:07.438104 25925 leader_election.cc:290] T 1dc5b3532fe54f74876d02beffa2c230 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 21 election: Requested vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:07:07.438810 25905 consensus_queue.cc:237] T ab43d85f64114d4ebf618930e43d9ed0 P 127766fc592545a4997f7790f50f6076 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 19.13, Last appended by leader: 13, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:07:07.442459 25953 leader_election.cc:290] T 21e14947d70440f19044d8f75c31e1f9 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 19 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:07:07.444123 20111 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35874 (request call id 1166) took 1081 ms. Trace:
I20260709 13:07:07.444492 20111 rpcz_store.cc:276] 0709 13:07:06.362992 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:06.363386 (+   394us) service_pool.cc:224] Handling call
0709 13:07:07.443969 (+1080583us) spinlock_profiling.cc:243] Waited 872 ms on lock 0x7b540036c754. stack: 00007f4a79de9343 00007f4a79de9240 00007f4a797781d4 00007f4a834b6304 00007f4a834b6299 00007f4a7ce71571 00007f4a7cf0c2fa 00007f4a81ecdb17 00007f4a7b4486d4 00007f4a7b448662 00007f4a7b448591 00007f4a7b44850c 00007f4a7b4477c2 00007f4a7b24348c 00007f4a7b2428c6 00007f4a7b24226f
0709 13:07:07.444070 (+   101us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2005697792}
I20260709 13:07:07.450093 19411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a16f7501e2444fb86d4e2778e734e02" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:07:07.451203 19411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9f0d59553ad444883fcf5b5909f9798" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:07:07.452138 19411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b08304a0a02b42d7840c4e8ee9a6bd1a" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:07:07.452884 19411 raft_consensus.cc:2393] T b08304a0a02b42d7840c4e8ee9a6bd1a P e5256d91808b47c195bc9b4dbd7f2b87 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e61c3a8f61bb48f8a963c9480e53c168 in current term 20: Already voted for candidate e5256d91808b47c195bc9b4dbd7f2b87 in this term.
I20260709 13:07:07.452734 25881 raft_consensus.cc:515] T bc225c93219c45538b53a1bd3d387e4d P e61c3a8f61bb48f8a963c9480e53c168 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:07:07.453613 19411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4af19371ea874c09a0a2147040835cbb" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
I20260709 13:07:07.453889 19560 raft_consensus.cc:2393] T bc225c93219c45538b53a1bd3d387e4d P e61c3a8f61bb48f8a963c9480e53c168 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate e5256d91808b47c195bc9b4dbd7f2b87 in current term 16: Already voted for candidate e61c3a8f61bb48f8a963c9480e53c168 in this term.
I20260709 13:07:07.454836 25881 leader_election.cc:290] T bc225c93219c45538b53a1bd3d387e4d P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 16 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:07:07.455771 25946 consensus_queue.cc:260] T 5ec1c4ce15e04c7e8c283a62179f2a64 P 127766fc592545a4997f7790f50f6076 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:07:07.410522 25879 raft_consensus.cc:2804] T 22196caba61445d3bec98a0aab3c337d P e61c3a8f61bb48f8a963c9480e53c168 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:07:07.460178 25879 raft_consensus.cc:493] T 22196caba61445d3bec98a0aab3c337d P e61c3a8f61bb48f8a963c9480e53c168 [term 18 FOLLOWER]: Starting leader election (detected failure of leader 0473d2b2d01f4459b1e90fd12cc7840e)
I20260709 13:07:07.460609 25879 raft_consensus.cc:3060] T 22196caba61445d3bec98a0aab3c337d P e61c3a8f61bb48f8a963c9480e53c168 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:07:07.424404 25994 raft_consensus.cc:3060] T 833a2f0775ed407a94b8924ce50adb63 P 127766fc592545a4997f7790f50f6076 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:07:07.461766 25923 consensus_queue.cc:1059] T 4af19371ea874c09a0a2147040835cbb P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:07:07.462769 25988 leader_election.cc:290] T f1b10566f45d4a7d9029858330e02d5b P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:07:07.464982 25975 raft_consensus.cc:697] T f1b10566f45d4a7d9029858330e02d5b P 0473d2b2d01f4459b1e90fd12cc7840e [term 18 LEADER]: Becoming Leader. State: Replica: 0473d2b2d01f4459b1e90fd12cc7840e, State: Running, Role: LEADER
I20260709 13:07:07.465873 25975 consensus_queue.cc:237] T f1b10566f45d4a7d9029858330e02d5b P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.11, Last appended by leader: 11, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:07:07.444142 25932 leader_election.cc:290] T 1a61655d99124a29b486ba4a5b37faea P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:07:07.468160 25764 leader_election.cc:290] T edd7d470b5014c9489be7f41f64355c9 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 23 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:07:07.474766 19308 catalog_manager.cc:5697] T fa8650e71aa14778b3d73721fc50d9fc P e5256d91808b47c195bc9b4dbd7f2b87 reported cstate change: term changed from 11 to 17. New cstate: current_term: 17 leader_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } }
I20260709 13:07:07.476352 19551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21e14947d70440f19044d8f75c31e1f9" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:07:07.477412 19560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14935b3ddf914369822e4a0547aaa355" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:07:07.478026 19560 raft_consensus.cc:2468] T 14935b3ddf914369822e4a0547aaa355 P e61c3a8f61bb48f8a963c9480e53c168 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 127766fc592545a4997f7790f50f6076 in term 13.
W20260709 13:07:07.478920 19526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.2:46257, user_credentials={real_user=slave}} blocked reactor thread for 46137.4us
I20260709 13:07:07.473407 19480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14935b3ddf914369822e4a0547aaa355" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:07:07.481005 19480 raft_consensus.cc:2468] T 14935b3ddf914369822e4a0547aaa355 P 0473d2b2d01f4459b1e90fd12cc7840e [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 127766fc592545a4997f7790f50f6076 in term 12.
W20260709 13:07:07.482635 19374 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:07.483012 19526 leader_election.cc:304] T 179fd671030940b4b4a4e24bcc4aba0a P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e61c3a8f61bb48f8a963c9480e53c168; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:07:07.479944 19308 catalog_manager.cc:5697] T 28af091831594f9d8e96482078cc7625 P e5256d91808b47c195bc9b4dbd7f2b87 reported cstate change: term changed from 12 to 18. New cstate: current_term: 18 leader_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } }
I20260709 13:07:07.484241 19308 catalog_manager.cc:5697] T 9962423cb4e54fcfa5de01daf68a86e7 P e5256d91808b47c195bc9b4dbd7f2b87 reported cstate change: term changed from 15 to 17. New cstate: current_term: 17 leader_uuid: "127766fc592545a4997f7790f50f6076" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } } }
I20260709 13:07:07.485811 19308 catalog_manager.cc:5697] T ef32ce6fdd0e40d382c79974f30295c6 P e5256d91808b47c195bc9b4dbd7f2b87 reported cstate change: term changed from 12 to 21, leader changed from e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3) to e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1). New cstate: current_term: 21 leader_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:07.482322 20078 leader_election.cc:304] T 14935b3ddf914369822e4a0547aaa355 P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, 127766fc592545a4997f7790f50f6076; no voters: 
I20260709 13:07:07.491101 19526 leader_election.cc:304] T 217b5fae677b4971b3bbd2f357a1f7ff P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168; no voters: e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:07:07.492141 19551 raft_consensus.cc:1275] T 7f575b143b844aa096b50997dad3516a P e61c3a8f61bb48f8a963c9480e53c168 [term 16 FOLLOWER]: Refusing update from remote peer e5256d91808b47c195bc9b4dbd7f2b87: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 13:07:07.492898 19308 catalog_manager.cc:5697] T 76cb037fc9064d13b59a8969d897ce8c P e5256d91808b47c195bc9b4dbd7f2b87 reported cstate change: term changed from 11 to 16. New cstate: current_term: 16 leader_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:07.494721 19308 catalog_manager.cc:5697] T d1e5873a19244c5ebbcd38e126796ee7 P e5256d91808b47c195bc9b4dbd7f2b87 reported cstate change: term changed from 17 to 20, leader changed from e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3) to e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1). New cstate: current_term: 20 leader_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } health_report { overall_health: HEALTHY } } }
I20260709 13:07:07.497586 19551 raft_consensus.cc:1275] T 76cb037fc9064d13b59a8969d897ce8c P e61c3a8f61bb48f8a963c9480e53c168 [term 18 FOLLOWER]: Refusing update from remote peer e5256d91808b47c195bc9b4dbd7f2b87: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 18 index: 10. (index mismatch)
I20260709 13:07:07.498752 19551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dc5b3532fe54f74876d02beffa2c230" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 21 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:07:07.500159 19523 leader_election.cc:304] T ece3db938bc649d4a40a51522ed5259c P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168; no voters: 127766fc592545a4997f7790f50f6076
W20260709 13:07:07.426656 19306 rpcz_store.cc:269] 0709 13:06:46.464247 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:46.473681 (+  9434us) service_pool.cc:224] Handling call
0709 13:07:07.386498 (+20912817us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:07:01.171909 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:07:01.172656 (+   747us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:07:01.172715 (+    59us) write_op.cc:435] Acquired schema lock
0709 13:07:01.172735 (+    20us) tablet.cc:662] Decoding operations
0709 13:07:01.173951 (+  1216us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:07:01.174050 (+    99us) write_op.cc:641] Partition lock acquired for write op
0709 13:07:01.174082 (+    32us) tablet.cc:685] Acquiring locks for 11 operations
0709 13:07:01.241231 (+ 67149us) tablet.cc:701] Row locks acquired
0709 13:07:01.241284 (+    53us) write_op.cc:260] PREPARE: finished
0709 13:07:01.241468 (+   184us) write_op.cc:270] Start()
0709 13:07:01.241629 (+   161us) write_op.cc:276] Timestamp: P: 1783602421241399 usec, L: 0
0709 13:07:01.241666 (+    37us) op_driver.cc:348] REPLICATION: starting
0709 13:07:01.242371 (+   705us) log.cc:844] Serialized 4577 byte log entry
0709 13:07:02.393176 (+1150805us) op_driver.cc:464] REPLICATION: finished
0709 13:07:02.696486 (+303310us) write_op.cc:301] APPLY: starting
0709 13:07:02.711828 (+ 15342us) tablet.cc:1367] starting BulkCheckPresence
0709 13:07:03.013487 (+301659us) tablet.cc:1370] finished BulkCheckPresence
0709 13:07:03.013614 (+   127us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:07:03.250636 (+237022us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:07:03.321828 (+ 71192us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=22,key_file_lookups=22,delta_file_lookups=22,mrs_lookups=0
0709 13:07:03.321919 (+    91us) write_op.cc:312] APPLY: finished
0709 13:07:03.327895 (+  5976us) log.cc:844] Serialized 105 byte log entry
0709 13:07:03.386007 (+ 58112us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:07:03.401028 (+ 15021us) write_op.cc:454] Released schema lock
0709 13:07:03.429312 (+ 28284us) write_op.cc:341] FINISH: Updating metrics
0709 13:07:03.497624 (+ 68312us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:07:03.500611 (+  2987us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":1106242,"reported_tablets":28,"child_traces":[["op",{"apply.queue_time_us":262918,"apply.run_cpu_time_us":28429,"apply.run_wall_time_us":798842,"cfile_cache_hit":46,"cfile_cache_hit_bytes":50107,"num_ops":11,"prepare.queue_time_us":284119,"prepare.run_cpu_time_us":27197,"prepare.run_wall_time_us":111022,"raft.queue_time_us":292381,"raft.run_cpu_time_us":20506,"raft.run_wall_time_us":337598,"replication_time_us":1098886,"thread_start_us":580898,"threads_started":5,"wal-append.queue_time_us":185912,"wal-append.run_cpu_time_us":33798,"wal-append.run_wall_time_us":2903537}]]}
I20260709 13:07:07.504786 19523 leader_election.cc:304] T 309c3ca0ca4b4f3ba129752ea2cb293b P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: e61c3a8f61bb48f8a963c9480e53c168; no voters: 127766fc592545a4997f7790f50f6076, e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:07:07.508780 19552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edd7d470b5014c9489be7f41f64355c9" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 23 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:07:07.509086 19411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65d8cb8d6ec64f459d5a47cefab10acf" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
I20260709 13:07:07.509917 19554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a61655d99124a29b486ba4a5b37faea" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:07:07.478241 25871 raft_consensus.cc:3055] T 1efebf73c86e432baa55533136b6e12c P 0473d2b2d01f4459b1e90fd12cc7840e [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:07:07.520922 19557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff75a1d4cb1f493db8f71ddc136ba9ab" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:07:07.522030 19554 raft_consensus.cc:2468] T 1a61655d99124a29b486ba4a5b37faea P e61c3a8f61bb48f8a963c9480e53c168 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 18.
I20260709 13:07:07.507507 19308 catalog_manager.cc:5697] T 1f85fc4b527a48848e5faa083b604e36 P e5256d91808b47c195bc9b4dbd7f2b87 reported cstate change: term changed from 13 to 16. New cstate: current_term: 16 leader_uuid: "127766fc592545a4997f7790f50f6076" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } } }
I20260709 13:07:07.487672 25989 raft_consensus.cc:493] T 62c6c134d3d24a1ab144dd9ee6bc3f64 P 127766fc592545a4997f7790f50f6076 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:07.525791 19308 catalog_manager.cc:5697] T 7f575b143b844aa096b50997dad3516a P e5256d91808b47c195bc9b4dbd7f2b87 reported cstate change: term changed from 10 to 14. New cstate: current_term: 14 leader_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } health_report { overall_health: HEALTHY } } }
I20260709 13:07:07.522841 25871 raft_consensus.cc:740] T 1efebf73c86e432baa55533136b6e12c P 0473d2b2d01f4459b1e90fd12cc7840e [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 0473d2b2d01f4459b1e90fd12cc7840e, State: Running, Role: LEADER
I20260709 13:07:07.529735 25871 consensus_queue.cc:260] T 1efebf73c86e432baa55533136b6e12c P 0473d2b2d01f4459b1e90fd12cc7840e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:07:07.530834 25661 consensus_queue.cc:237] T 4af19371ea874c09a0a2147040835cbb P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:07:07.531210 19477 raft_consensus.cc:1275] T 0e1085d23e8347fbbd5bce7542f4b1f4 P 0473d2b2d01f4459b1e90fd12cc7840e [term 15 FOLLOWER]: Refusing update from remote peer e61c3a8f61bb48f8a963c9480e53c168: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 15 index: 12. (term mismatch)
I20260709 13:07:07.531811 19477 pending_rounds.cc:85] T 0e1085d23e8347fbbd5bce7542f4b1f4 P 0473d2b2d01f4459b1e90fd12cc7840e: Aborting all ops after (but not including) 11
I20260709 13:07:07.532080 19477 pending_rounds.cc:107] T 0e1085d23e8347fbbd5bce7542f4b1f4 P 0473d2b2d01f4459b1e90fd12cc7840e: Aborting uncommitted NO_OP operation due to leader change: 14.12
I20260709 13:07:07.532347 19477 raft_consensus.cc:2889] T 0e1085d23e8347fbbd5bce7542f4b1f4 P 0473d2b2d01f4459b1e90fd12cc7840e [term 15 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:07:07.532684 26013 log.cc:927] Time spent T ed7fdbcb96d14d418db9ca90a792588a P e61c3a8f61bb48f8a963c9480e53c168: Append to log took a long time: real 0.131s	user 0.000s	sys 0.000s
W20260709 13:07:07.535267 25993 consensus_meta.cc:287] T e381f1d6b8184797ad142de49be225a8 P e5256d91808b47c195bc9b4dbd7f2b87: Time spent flushing consensus metadata: real 0.697s	user 0.009s	sys 0.002s
I20260709 13:07:07.535776 25993 raft_consensus.cc:515] T e381f1d6b8184797ad142de49be225a8 P e5256d91808b47c195bc9b4dbd7f2b87 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:07:07.537166 19403 raft_consensus.cc:2393] T e381f1d6b8184797ad142de49be225a8 P e5256d91808b47c195bc9b4dbd7f2b87 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 0473d2b2d01f4459b1e90fd12cc7840e in current term 17: Already voted for candidate e5256d91808b47c195bc9b4dbd7f2b87 in this term.
I20260709 13:07:07.487530 25754 raft_consensus.cc:2764] T ef32ce6fdd0e40d382c79974f30295c6 P e61c3a8f61bb48f8a963c9480e53c168 [term 23 FOLLOWER]: Leader pre-election decision vote started in defunct term 22: won
I20260709 13:07:07.537989 25754 raft_consensus.cc:2804] T 217b5fae677b4971b3bbd2f357a1f7ff P e61c3a8f61bb48f8a963c9480e53c168 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:07:07.538379 25754 raft_consensus.cc:493] T 217b5fae677b4971b3bbd2f357a1f7ff P e61c3a8f61bb48f8a963c9480e53c168 [term 15 FOLLOWER]: Starting leader election (detected failure of leader e5256d91808b47c195bc9b4dbd7f2b87)
I20260709 13:07:07.538995 25754 raft_consensus.cc:3060] T 217b5fae677b4971b3bbd2f357a1f7ff P e61c3a8f61bb48f8a963c9480e53c168 [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:07:07.541687 25851 consensus_meta.cc:287] T fa731b585f684a7fb2d106c50f143b83 P e61c3a8f61bb48f8a963c9480e53c168: Time spent flushing consensus metadata: real 0.552s	user 0.006s	sys 0.000s
I20260709 13:07:07.542349 25992 raft_consensus.cc:3060] T fa8650e71aa14778b3d73721fc50d9fc P e5256d91808b47c195bc9b4dbd7f2b87 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:07:07.542531 19555 raft_consensus.cc:2410] T fa731b585f684a7fb2d106c50f143b83 P e61c3a8f61bb48f8a963c9480e53c168 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 127766fc592545a4997f7790f50f6076 for term 17 because replica has last-logged OpId of term: 15 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 11.
I20260709 13:07:07.546836 25376 leader_election.cc:290] T 4509b76741dc428e9201c70c1658da13 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 13 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:07:07.548489 19403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b74109013a140ada21feeef92d6f563" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 17 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
I20260709 13:07:07.549271 19403 raft_consensus.cc:2393] T 2b74109013a140ada21feeef92d6f563 P e5256d91808b47c195bc9b4dbd7f2b87 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate e61c3a8f61bb48f8a963c9480e53c168 in current term 17: Already voted for candidate e5256d91808b47c195bc9b4dbd7f2b87 in this term.
I20260709 13:07:07.549103 25754 raft_consensus.cc:515] T 217b5fae677b4971b3bbd2f357a1f7ff P e61c3a8f61bb48f8a963c9480e53c168 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:07:07.550086 19403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e381f1d6b8184797ad142de49be225a8" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 17 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
I20260709 13:07:07.504839 25881 consensus_queue.cc:1048] T 0e1085d23e8347fbbd5bce7542f4b1f4 P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Connected to new peer: Peer: permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.027s
I20260709 13:07:07.531159 25871 raft_consensus.cc:3060] T 1efebf73c86e432baa55533136b6e12c P 0473d2b2d01f4459b1e90fd12cc7840e [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:07:07.554023 19556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4509b76741dc428e9201c70c1658da13" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:07:07.506248 25928 raft_consensus.cc:2749] T 179fd671030940b4b4a4e24bcc4aba0a P e61c3a8f61bb48f8a963c9480e53c168 [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 13:07:07.555845 19551 raft_consensus.cc:3060] T a08760e15aac4630a629431f56024dc8 P e61c3a8f61bb48f8a963c9480e53c168 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:07:07.518694 25920 raft_consensus.cc:2804] T 14935b3ddf914369822e4a0547aaa355 P 127766fc592545a4997f7790f50f6076 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:07:07.557749 19403 raft_consensus.cc:2393] T e381f1d6b8184797ad142de49be225a8 P e5256d91808b47c195bc9b4dbd7f2b87 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate e61c3a8f61bb48f8a963c9480e53c168 in current term 17: Already voted for candidate e5256d91808b47c195bc9b4dbd7f2b87 in this term.
I20260709 13:07:07.538261 25998 raft_consensus.cc:515] T 0cdf56e38bbc453d9438d359e5a69955 P e5256d91808b47c195bc9b4dbd7f2b87 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:07:07.587298 19409 raft_consensus.cc:1240] T 0cdf56e38bbc453d9438d359e5a69955 P e5256d91808b47c195bc9b4dbd7f2b87 [term 19 FOLLOWER]: Rejecting Update request from peer e61c3a8f61bb48f8a963c9480e53c168 for earlier term 18. Current term is 19. Ops: []
I20260709 13:07:07.588593 19450 leader_election.cc:304] T 1a61655d99124a29b486ba4a5b37faea P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:07:07.589488 25957 raft_consensus.cc:2804] T 1a61655d99124a29b486ba4a5b37faea P 0473d2b2d01f4459b1e90fd12cc7840e [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:07:07.589923 25957 raft_consensus.cc:493] T 1a61655d99124a29b486ba4a5b37faea P 0473d2b2d01f4459b1e90fd12cc7840e [term 17 FOLLOWER]: Starting leader election (detected failure of leader e61c3a8f61bb48f8a963c9480e53c168)
I20260709 13:07:07.590332 25957 raft_consensus.cc:3060] T 1a61655d99124a29b486ba4a5b37faea P 0473d2b2d01f4459b1e90fd12cc7840e [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:07:07.591714 25998 leader_election.cc:290] T 0cdf56e38bbc453d9438d359e5a69955 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 19 election: Requested vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:07:07.593261 25920 raft_consensus.cc:493] T 14935b3ddf914369822e4a0547aaa355 P 127766fc592545a4997f7790f50f6076 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:07.593750 25920 raft_consensus.cc:3060] T 14935b3ddf914369822e4a0547aaa355 P 127766fc592545a4997f7790f50f6076 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:07:07.593901 19559 raft_consensus.cc:1275] T fa731b585f684a7fb2d106c50f143b83 P e61c3a8f61bb48f8a963c9480e53c168 [term 16 FOLLOWER]: Refusing update from remote peer e5256d91808b47c195bc9b4dbd7f2b87: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 16 index: 12. (term mismatch)
I20260709 13:07:07.594285 19559 pending_rounds.cc:85] T fa731b585f684a7fb2d106c50f143b83 P e61c3a8f61bb48f8a963c9480e53c168: Aborting all ops after (but not including) 11
I20260709 13:07:07.594508 19559 pending_rounds.cc:107] T fa731b585f684a7fb2d106c50f143b83 P e61c3a8f61bb48f8a963c9480e53c168: Aborting uncommitted NO_OP operation due to leader change: 15.12
I20260709 13:07:07.594769 19559 raft_consensus.cc:2889] T fa731b585f684a7fb2d106c50f143b83 P e61c3a8f61bb48f8a963c9480e53c168 [term 16 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:07:07.594964 19411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1b10566f45d4a7d9029858330e02d5b" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:07:07.552091 19375 leader_election.cc:304] T 4509b76741dc428e9201c70c1658da13 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:07:07.579370 26001 raft_consensus.cc:2749] T 14935b3ddf914369822e4a0547aaa355 P e5256d91808b47c195bc9b4dbd7f2b87 [term 13 FOLLOWER]: Leader pre-election lost for term 12. Reason: Vote denied by peer 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121) with higher term. Message: Invalid argument: T 14935b3ddf914369822e4a0547aaa355 P 127766fc592545a4997f7790f50f6076 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e5256d91808b47c195bc9b4dbd7f2b87 for earlier term 12. Current term is 13.
I20260709 13:07:07.550592 25984 raft_consensus.cc:515] T 21e14947d70440f19044d8f75c31e1f9 P e5256d91808b47c195bc9b4dbd7f2b87 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:07:07.565502 25851 raft_consensus.cc:2749] T 309c3ca0ca4b4f3ba129752ea2cb293b P e61c3a8f61bb48f8a963c9480e53c168 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:07:07.558290 25989 raft_consensus.cc:515] T 62c6c134d3d24a1ab144dd9ee6bc3f64 P 127766fc592545a4997f7790f50f6076 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:07:07.606256 25859 raft_consensus.cc:493] T 7f575b143b844aa096b50997dad3516a P 0473d2b2d01f4459b1e90fd12cc7840e [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:07.606850 25859 raft_consensus.cc:515] T 7f575b143b844aa096b50997dad3516a P 0473d2b2d01f4459b1e90fd12cc7840e [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:07:07.608585 25989 leader_election.cc:290] T 62c6c134d3d24a1ab144dd9ee6bc3f64 P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:07:07.523336 25537 leader_election.cc:290] T ff75a1d4cb1f493db8f71ddc136ba9ab P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:07:07.609162 25859 leader_election.cc:290] T 7f575b143b844aa096b50997dad3516a P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:07:07.609788 19477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62c6c134d3d24a1ab144dd9ee6bc3f64" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:07:07.538358 25993 leader_election.cc:290] T e381f1d6b8184797ad142de49be225a8 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 17 election: Requested vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:07:07.610440 19477 raft_consensus.cc:2468] T 62c6c134d3d24a1ab144dd9ee6bc3f64 P 0473d2b2d01f4459b1e90fd12cc7840e [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 127766fc592545a4997f7790f50f6076 in term 17.
I20260709 13:07:07.610764 25993 raft_consensus.cc:2749] T 4509b76741dc428e9201c70c1658da13 P e5256d91808b47c195bc9b4dbd7f2b87 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:07:07.612165 20078 leader_election.cc:304] T 62c6c134d3d24a1ab144dd9ee6bc3f64 P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, 127766fc592545a4997f7790f50f6076; no voters: 
I20260709 13:07:07.613544 25908 raft_consensus.cc:2804] T 62c6c134d3d24a1ab144dd9ee6bc3f64 P 127766fc592545a4997f7790f50f6076 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:07:07.613945 25908 raft_consensus.cc:493] T 62c6c134d3d24a1ab144dd9ee6bc3f64 P 127766fc592545a4997f7790f50f6076 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:07.614319 25908 raft_consensus.cc:3060] T 62c6c134d3d24a1ab144dd9ee6bc3f64 P 127766fc592545a4997f7790f50f6076 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:07:07.579051 19552 raft_consensus.cc:1275] T df751f992649444090e27965eb1af85d P e61c3a8f61bb48f8a963c9480e53c168 [term 22 FOLLOWER]: Refusing update from remote peer 0473d2b2d01f4459b1e90fd12cc7840e: Log matching property violated. Preceding OpId in replica: term: 20 index: 13. Preceding OpId from leader: term: 22 index: 14. (index mismatch)
I20260709 13:07:07.615794 19556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f575b143b844aa096b50997dad3516a" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 17 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
W20260709 13:07:07.617455 19452 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:07.509727 25865 raft_consensus.cc:2804] T ece3db938bc649d4a40a51522ed5259c P e61c3a8f61bb48f8a963c9480e53c168 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:07:07.559367 19308 catalog_manager.cc:5697] T 179fd671030940b4b4a4e24bcc4aba0a P e5256d91808b47c195bc9b4dbd7f2b87 reported cstate change: term changed from 13 to 19, leader changed from e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3) to 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2). New cstate: current_term: 19 leader_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } }
I20260709 13:07:07.616703 19556 raft_consensus.cc:2468] T 7f575b143b844aa096b50997dad3516a P e61c3a8f61bb48f8a963c9480e53c168 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 16.
I20260709 13:07:07.632467 19406 raft_consensus.cc:1240] T 21e14947d70440f19044d8f75c31e1f9 P e5256d91808b47c195bc9b4dbd7f2b87 [term 19 FOLLOWER]: Rejecting Update request from peer e61c3a8f61bb48f8a963c9480e53c168 for earlier term 18. Current term is 19. Ops: []
W20260709 13:07:07.603457 19375 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.3:36891, user_credentials={real_user=slave}} blocked reactor thread for 51630.4us
I20260709 13:07:07.634290 19375 leader_election.cc:304] T 22196caba61445d3bec98a0aab3c337d P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:07:07.642696 19375 leader_election.cc:400] T 14935b3ddf914369822e4a0547aaa355 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 12 pre-election: Vote denied by peer e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891) with higher term. Message: Invalid argument: T 14935b3ddf914369822e4a0547aaa355 P e61c3a8f61bb48f8a963c9480e53c168 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e5256d91808b47c195bc9b4dbd7f2b87 for earlier term 12. Current term is 13.
W20260709 13:07:07.602823 25997 consensus_meta.cc:287] T a08760e15aac4630a629431f56024dc8 P e5256d91808b47c195bc9b4dbd7f2b87: Time spent flushing consensus metadata: real 0.530s	user 0.010s	sys 0.000s
W20260709 13:07:07.608639 25983 consensus_meta.cc:287] T ab43d85f64114d4ebf618930e43d9ed0 P e5256d91808b47c195bc9b4dbd7f2b87: Time spent flushing consensus metadata: real 0.550s	user 0.005s	sys 0.005s
I20260709 13:07:07.631564 19308 catalog_manager.cc:5697] T 3e1f505cb0f1427bbd698ac889d80821 P e5256d91808b47c195bc9b4dbd7f2b87 reported cstate change: term changed from 16 to 19, leader changed from e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1) to e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3). New cstate: current_term: 19 leader_uuid: "e61c3a8f61bb48f8a963c9480e53c168" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } }
I20260709 13:07:07.633118 25865 raft_consensus.cc:493] T ece3db938bc649d4a40a51522ed5259c P e61c3a8f61bb48f8a963c9480e53c168 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 127766fc592545a4997f7790f50f6076)
I20260709 13:07:07.674319 19551 raft_consensus.cc:1275] T a08760e15aac4630a629431f56024dc8 P e61c3a8f61bb48f8a963c9480e53c168 [term 22 FOLLOWER]: Refusing update from remote peer 0473d2b2d01f4459b1e90fd12cc7840e: Log matching property violated. Preceding OpId in replica: term: 21 index: 12. Preceding OpId from leader: term: 22 index: 13. (index mismatch)
I20260709 13:07:07.646587 25992 raft_consensus.cc:2749] T 22196caba61445d3bec98a0aab3c337d P e5256d91808b47c195bc9b4dbd7f2b87 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:07:07.644663 25851 raft_consensus.cc:493] T ff75a1d4cb1f493db8f71ddc136ba9ab P e61c3a8f61bb48f8a963c9480e53c168 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader e5256d91808b47c195bc9b4dbd7f2b87)
I20260709 13:07:07.652534 25983 raft_consensus.cc:2749] T ab43d85f64114d4ebf618930e43d9ed0 P e5256d91808b47c195bc9b4dbd7f2b87 [term 20 FOLLOWER]: Leader pre-election lost for term 18. Reason: Vote denied by peer e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891) with higher term. Message: Invalid argument: T ab43d85f64114d4ebf618930e43d9ed0 P e61c3a8f61bb48f8a963c9480e53c168 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e5256d91808b47c195bc9b4dbd7f2b87 for earlier term 18. Current term is 20.
I20260709 13:07:07.675766 25865 raft_consensus.cc:3060] T ece3db938bc649d4a40a51522ed5259c P e61c3a8f61bb48f8a963c9480e53c168 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:07:07.731915 19308 catalog_manager.cc:5697] T 172b3dd13109415a955b71ac0e9d2234 P e5256d91808b47c195bc9b4dbd7f2b87 reported cstate change: term changed from 14 to 16, leader changed from e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1) to 127766fc592545a4997f7790f50f6076 (127.17.223.4). New cstate: current_term: 16 leader_uuid: "127766fc592545a4997f7790f50f6076" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } } }
I20260709 13:07:07.733659 19308 catalog_manager.cc:5697] T 14efcc79969f41babe5529c22d59156d P e5256d91808b47c195bc9b4dbd7f2b87 reported cstate change: term changed from 16 to 17, leader changed from e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1) to 127766fc592545a4997f7790f50f6076 (127.17.223.4). New cstate: current_term: 17 leader_uuid: "127766fc592545a4997f7790f50f6076" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } } }
W20260709 13:07:07.738654 19375 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.3:36891, user_credentials={real_user=slave}} blocked reactor thread for 96169.9us
I20260709 13:07:07.743533 19375 leader_election.cc:304] T f93ee515a9c14139bf566522ed8232f3 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:07:07.649847 25997 raft_consensus.cc:515] T a08760e15aac4630a629431f56024dc8 P e5256d91808b47c195bc9b4dbd7f2b87 [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
W20260709 13:07:07.812994 20075 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.522s	user 0.016s	sys 0.012s
W20260709 13:07:07.813491 20075 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.522s	user 0.016s	sys 0.012s
W20260709 13:07:07.813825 20075 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.1:40321, user_credentials={real_user=slave}} blocked reactor thread for 523153us
I20260709 13:07:07.814812 20075 leader_election.cc:304] T 65d8cb8d6ec64f459d5a47cefab10acf P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 127766fc592545a4997f7790f50f6076; no voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:07:07.774006 25819 raft_consensus.cc:515] T f1b10566f45d4a7d9029858330e02d5b P e5256d91808b47c195bc9b4dbd7f2b87 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
W20260709 13:07:07.822474 19375 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.3:36891, user_credentials={real_user=slave}} blocked reactor thread for 78993.2us
I20260709 13:07:07.823645 19375 leader_election.cc:304] T 2b74109013a140ada21feeef92d6f563 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:07:07.825677 19375 leader_election.cc:304] T ef32ce6fdd0e40d382c79974f30295c6 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:07:07.734997 19308 catalog_manager.cc:5697] T 2725d2c4cb054f18b0fc8f735c15f6c2 P e5256d91808b47c195bc9b4dbd7f2b87 reported cstate change: term changed from 17 to 19, leader changed from e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3) to 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2). New cstate: current_term: 19 leader_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } }
I20260709 13:07:07.741129 19450 leader_election.cc:304] T 7f575b143b844aa096b50997dad3516a P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
W20260709 13:07:07.829993 19450 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.3:36891, user_credentials={real_user=slave}} blocked reactor thread for 88982.5us
I20260709 13:07:07.695643 25851 raft_consensus.cc:515] T ff75a1d4cb1f493db8f71ddc136ba9ab P e61c3a8f61bb48f8a963c9480e53c168 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:07:07.767407 25984 leader_election.cc:290] T 21e14947d70440f19044d8f75c31e1f9 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 19 election: Requested vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
W20260709 13:07:07.767634 25591 consensus_meta.cc:287] T 2e36a9d6e29c4a7c860cf267efbd4c74 P e5256d91808b47c195bc9b4dbd7f2b87: Time spent flushing consensus metadata: real 0.575s	user 0.006s	sys 0.002s
I20260709 13:07:07.767901 25754 leader_election.cc:290] T 217b5fae677b4971b3bbd2f357a1f7ff P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 16 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:07:07.780614 25920 raft_consensus.cc:515] T 14935b3ddf914369822e4a0547aaa355 P 127766fc592545a4997f7790f50f6076 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:07:07.796245 25376 raft_consensus.cc:493] T fa8650e71aa14778b3d73721fc50d9fc P 0473d2b2d01f4459b1e90fd12cc7840e [term 18 FOLLOWER]: Starting pre-election (detected failure of leader e5256d91808b47c195bc9b4dbd7f2b87)
I20260709 13:07:07.796849 25953 consensus_queue.cc:1048] T df751f992649444090e27965eb1af85d P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
W20260709 13:07:07.875411 19558 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.589s	user 0.021s	sys 0.039s
W20260709 13:07:07.875901 19558 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.589s	user 0.021s	sys 0.039s
I20260709 13:07:07.798482 25977 raft_consensus.cc:493] T 96efeaaf1057492490e9a621f37e1a2d P 0473d2b2d01f4459b1e90fd12cc7840e [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:07.831408 19308 catalog_manager.cc:5697] T 0cdf56e38bbc453d9438d359e5a69955 P e5256d91808b47c195bc9b4dbd7f2b87 reported cstate change: term changed from 14 to 17, leader changed from 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2) to e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1). New cstate: current_term: 17 leader_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:07.838930 20075 leader_election.cc:304] T 4af19371ea874c09a0a2147040835cbb P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 127766fc592545a4997f7790f50f6076; no voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:07:07.882884 19404 raft_consensus.cc:2368] T f1b10566f45d4a7d9029858330e02d5b P e5256d91808b47c195bc9b4dbd7f2b87 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 0473d2b2d01f4459b1e90fd12cc7840e for earlier term 18. Current term is 19.
I20260709 13:07:07.877882 19408 raft_consensus.cc:2368] T a08760e15aac4630a629431f56024dc8 P e5256d91808b47c195bc9b4dbd7f2b87 [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e61c3a8f61bb48f8a963c9480e53c168 for earlier term 22. Current term is 23.
W20260709 13:07:07.878294 19377 thread.cc:641] server-negotiator [worker] (thread pool) Time spent creating pthread: real 0.511s	user 0.000s	sys 0.029s
W20260709 13:07:07.883680 19377 thread.cc:608] server-negotiator [worker] (thread pool) Time spent starting thread: real 0.516s	user 0.000s	sys 0.029s
I20260709 13:07:07.884088 19308 catalog_manager.cc:5697] T fa731b585f684a7fb2d106c50f143b83 P e5256d91808b47c195bc9b4dbd7f2b87 reported cstate change: term changed from 12 to 14. New cstate: current_term: 14 leader_uuid: "127766fc592545a4997f7790f50f6076" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } } }
I20260709 13:07:07.887053 19308 catalog_manager.cc:5697] T ece3db938bc649d4a40a51522ed5259c P e5256d91808b47c195bc9b4dbd7f2b87 reported cstate change: term changed from 10 to 14, leader changed from e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1) to 127766fc592545a4997f7790f50f6076 (127.17.223.4). New cstate: current_term: 14 leader_uuid: "127766fc592545a4997f7790f50f6076" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } } }
I20260709 13:07:07.851332 25983 raft_consensus.cc:2749] T f93ee515a9c14139bf566522ed8232f3 P e5256d91808b47c195bc9b4dbd7f2b87 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:07:07.839308 25537 raft_consensus.cc:493] T 179fd671030940b4b4a4e24bcc4aba0a P 0473d2b2d01f4459b1e90fd12cc7840e [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:07.842525 25944 raft_consensus.cc:2749] T 65d8cb8d6ec64f459d5a47cefab10acf P 127766fc592545a4997f7790f50f6076 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
W20260709 13:07:07.890239 19375 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.3:36891, user_credentials={real_user=slave}} blocked reactor thread for 64596.8us
I20260709 13:07:07.838711 25989 raft_consensus.cc:493] T 309c3ca0ca4b4f3ba129752ea2cb293b P 127766fc592545a4997f7790f50f6076 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 0473d2b2d01f4459b1e90fd12cc7840e)
I20260709 13:07:07.842983 25992 raft_consensus.cc:2749] T 2b74109013a140ada21feeef92d6f563 P e5256d91808b47c195bc9b4dbd7f2b87 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:07:07.892747 19308 catalog_manager.cc:5697] T 2e36a9d6e29c4a7c860cf267efbd4c74 P e5256d91808b47c195bc9b4dbd7f2b87 reported cstate change: term changed from 11 to 13, leader changed from e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1) to 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2). New cstate: current_term: 13 leader_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } }
W20260709 13:07:07.892765 19410 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.516s	user 0.010s	sys 0.022s
I20260709 13:07:07.800426 25994 raft_consensus.cc:515] T 833a2f0775ed407a94b8924ce50adb63 P 127766fc592545a4997f7790f50f6076 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:07:07.906312 19377 leader_election.cc:304] T 9962423cb4e54fcfa5de01daf68a86e7 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, 127766fc592545a4997f7790f50f6076
I20260709 13:07:07.881223 25918 raft_consensus.cc:493] T 70797e5783b5454ab0d0eea663e791e3 P 127766fc592545a4997f7790f50f6076 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:07.842923 26001 consensus_queue.cc:1059] T 65d8cb8d6ec64f459d5a47cefab10acf P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 }, Status: INVALID_TERM, Last received: 19.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.059s
I20260709 13:07:07.877962 25376 raft_consensus.cc:515] T fa8650e71aa14778b3d73721fc50d9fc P 0473d2b2d01f4459b1e90fd12cc7840e [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:07:07.878154 25760 consensus_queue.cc:1048] T a08760e15aac4630a629431f56024dc8 P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.024s
I20260709 13:07:07.920380 19477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21e14947d70440f19044d8f75c31e1f9" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
W20260709 13:07:07.903666 19410 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.527s	user 0.010s	sys 0.022s
W20260709 13:07:07.885623 25827 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.500s	user 0.010s	sys 0.013s
I20260709 13:07:07.905596 25093 consensus_queue.cc:1048] T 7f575b143b844aa096b50997dad3516a P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
W20260709 13:07:07.928524 19526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.2:46257, user_credentials={real_user=slave}} blocked reactor thread for 437477us
W20260709 13:07:07.907645 19449 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.628s	user 0.008s	sys 0.014s
I20260709 13:07:07.780617 25957 raft_consensus.cc:515] T 1a61655d99124a29b486ba4a5b37faea P 0473d2b2d01f4459b1e90fd12cc7840e [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:07:07.901497 19375 leader_election.cc:304] T bc225c93219c45538b53a1bd3d387e4d P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168
W20260709 13:07:07.930522 19449 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.651s	user 0.008s	sys 0.014s
W20260709 13:07:07.912335 19523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.1:40321, user_credentials={real_user=slave}} blocked reactor thread for 407662us
I20260709 13:07:07.904985 19308 catalog_manager.cc:5697] T 775c229504194560ba9589bc2199b089 P e5256d91808b47c195bc9b4dbd7f2b87 reported cstate change: term changed from 11 to 13. New cstate: current_term: 13 leader_uuid: "127766fc592545a4997f7790f50f6076" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } } }
I20260709 13:07:07.899528 25984 raft_consensus.cc:2804] T ef32ce6fdd0e40d382c79974f30295c6 P e5256d91808b47c195bc9b4dbd7f2b87 [term 23 FOLLOWER]: Leader election won for term 23
I20260709 13:07:07.919373 19483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e381f1d6b8184797ad142de49be225a8" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 17 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:07:07.919636 19484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cdf56e38bbc453d9438d359e5a69955" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:07:07.875770 25530 raft_consensus.cc:2804] T 7f575b143b844aa096b50997dad3516a P 0473d2b2d01f4459b1e90fd12cc7840e [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:07:07.942777 19486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dc5b3532fe54f74876d02beffa2c230" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 21 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:07:07.921260 19477 raft_consensus.cc:2393] T 21e14947d70440f19044d8f75c31e1f9 P 0473d2b2d01f4459b1e90fd12cc7840e [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate e5256d91808b47c195bc9b4dbd7f2b87 in current term 19: Already voted for candidate 0473d2b2d01f4459b1e90fd12cc7840e in this term.
I20260709 13:07:07.876618 25591 raft_consensus.cc:515] T 2e36a9d6e29c4a7c860cf267efbd4c74 P e5256d91808b47c195bc9b4dbd7f2b87 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:07:07.903092 25993 raft_consensus.cc:493] T 179fd671030940b4b4a4e24bcc4aba0a P e5256d91808b47c195bc9b4dbd7f2b87 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:07.911254 25982 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.530s	user 0.045s	sys 0.074s
I20260709 13:07:07.935693 19449 leader_election.cc:304] T 0cdf56e38bbc453d9438d359e5a69955 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e; no voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:07:07.937134 19526 leader_election.cc:304] T ab43d85f64114d4ebf618930e43d9ed0 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e61c3a8f61bb48f8a963c9480e53c168; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, 127766fc592545a4997f7790f50f6076
I20260709 13:07:07.888330 25977 raft_consensus.cc:515] T 96efeaaf1057492490e9a621f37e1a2d P 0473d2b2d01f4459b1e90fd12cc7840e [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:07:07.943971 19483 raft_consensus.cc:2393] T e381f1d6b8184797ad142de49be225a8 P 0473d2b2d01f4459b1e90fd12cc7840e [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate e5256d91808b47c195bc9b4dbd7f2b87 in current term 17: Already voted for candidate 0473d2b2d01f4459b1e90fd12cc7840e in this term.
I20260709 13:07:07.950016 25093 consensus_queue.cc:1048] T fa731b585f684a7fb2d106c50f143b83 P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:07:07.907523 25989 raft_consensus.cc:515] T 309c3ca0ca4b4f3ba129752ea2cb293b P 127766fc592545a4997f7790f50f6076 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:07:07.903069 25537 raft_consensus.cc:515] T 179fd671030940b4b4a4e24bcc4aba0a P 0473d2b2d01f4459b1e90fd12cc7840e [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:07:07.930027 25859 raft_consensus.cc:493] T 76cb037fc9064d13b59a8969d897ce8c P 0473d2b2d01f4459b1e90fd12cc7840e [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:07.955016 19526 leader_election.cc:304] T edd7d470b5014c9489be7f41f64355c9 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
W20260709 13:07:08.007786 19526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.2:46257, user_credentials={real_user=slave}} blocked reactor thread for 52874.9us
I20260709 13:07:08.009320 19526 leader_election.cc:304] T 48824d5acfbc485ebf8c2d944e7202de P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e61c3a8f61bb48f8a963c9480e53c168; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, 127766fc592545a4997f7790f50f6076
I20260709 13:07:07.932550 25983 raft_consensus.cc:2749] T bc225c93219c45538b53a1bd3d387e4d P e5256d91808b47c195bc9b4dbd7f2b87 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:07:07.944365 25944 raft_consensus.cc:493] T 6c5eebf646ad445a9d1b1adc319d7b16 P 127766fc592545a4997f7790f50f6076 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 0473d2b2d01f4459b1e90fd12cc7840e)
I20260709 13:07:07.930053 25905 raft_consensus.cc:2749] T 4af19371ea874c09a0a2147040835cbb P 127766fc592545a4997f7790f50f6076 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:07:07.957741 25093 raft_consensus.cc:2749] T 9962423cb4e54fcfa5de01daf68a86e7 P e5256d91808b47c195bc9b4dbd7f2b87 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
W20260709 13:07:07.958658 19377 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.2:46257, user_credentials={real_user=slave}} blocked reactor thread for 52418.5us
I20260709 13:07:08.019230 19377 leader_election.cc:304] T 775c229504194560ba9589bc2199b089 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87; no voters: 127766fc592545a4997f7790f50f6076
I20260709 13:07:07.943125 25530 raft_consensus.cc:493] T 7f575b143b844aa096b50997dad3516a P 0473d2b2d01f4459b1e90fd12cc7840e [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:07:08.010865 19449 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.1:40321, user_credentials={real_user=slave}} blocked reactor thread for 53581.2us
W20260709 13:07:08.010311 25587 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.505s	user 0.015s	sys 0.017s
W20260709 13:07:07.952852 25982 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.572s	user 0.045s	sys 0.075s
I20260709 13:07:07.940719 25925 consensus_queue.cc:1048] T 7f575b143b844aa096b50997dad3516a P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.065s
I20260709 13:07:08.023553 19449 leader_election.cc:304] T edd7d470b5014c9489be7f41f64355c9 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 23 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e; no voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:07:08.011305 19407 raft_consensus.cc:1240] T 2e36a9d6e29c4a7c860cf267efbd4c74 P e5256d91808b47c195bc9b4dbd7f2b87 [term 14 FOLLOWER]: Rejecting Update request from peer 0473d2b2d01f4459b1e90fd12cc7840e for earlier term 13. Current term is 14. Ops: []
I20260709 13:07:07.916904 25918 raft_consensus.cc:515] T 70797e5783b5454ab0d0eea663e791e3 P 127766fc592545a4997f7790f50f6076 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:07:07.956216 25827 raft_consensus.cc:2749] T ab43d85f64114d4ebf618930e43d9ed0 P e61c3a8f61bb48f8a963c9480e53c168 [term 21 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:07:08.021268 25988 raft_consensus.cc:2749] T 48824d5acfbc485ebf8c2d944e7202de P e61c3a8f61bb48f8a963c9480e53c168 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:07:07.956724 25984 raft_consensus.cc:697] T ef32ce6fdd0e40d382c79974f30295c6 P e5256d91808b47c195bc9b4dbd7f2b87 [term 23 LEADER]: Becoming Leader. State: Replica: e5256d91808b47c195bc9b4dbd7f2b87, State: Running, Role: LEADER
I20260709 13:07:08.046268 19449 leader_election.cc:304] T 2b74109013a140ada21feeef92d6f563 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e; no voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:07:08.048447 19402 raft_consensus.cc:1240] T 70797e5783b5454ab0d0eea663e791e3 P e5256d91808b47c195bc9b4dbd7f2b87 [term 22 LEADER]: Rejecting Update request from peer 127766fc592545a4997f7790f50f6076 for earlier term 21. Current term is 22. Ops: [21.15-21.15]
I20260709 13:07:08.021795 25964 raft_consensus.cc:2749] T 0cdf56e38bbc453d9438d359e5a69955 P 0473d2b2d01f4459b1e90fd12cc7840e [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:07:08.019665 25881 raft_consensus.cc:2804] T edd7d470b5014c9489be7f41f64355c9 P e61c3a8f61bb48f8a963c9480e53c168 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:07:08.025805 25944 raft_consensus.cc:515] T 6c5eebf646ad445a9d1b1adc319d7b16 P 127766fc592545a4997f7790f50f6076 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:07:08.032334 25983 raft_consensus.cc:2804] T 775c229504194560ba9589bc2199b089 P e5256d91808b47c195bc9b4dbd7f2b87 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:07:07.953920 25879 raft_consensus.cc:515] T 22196caba61445d3bec98a0aab3c337d P e61c3a8f61bb48f8a963c9480e53c168 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:07:07.954602 25993 raft_consensus.cc:515] T 179fd671030940b4b4a4e24bcc4aba0a P e5256d91808b47c195bc9b4dbd7f2b87 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:07:08.033684 19523 leader_election.cc:304] T df751f992649444090e27965eb1af85d P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e61c3a8f61bb48f8a963c9480e53c168; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:07:08.006325 25953 consensus_queue.cc:1048] T f93ee515a9c14139bf566522ed8232f3 P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.041s
I20260709 13:07:07.959362 26008 consensus_queue.cc:1048] T 76cb037fc9064d13b59a8969d897ce8c P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.101s
I20260709 13:07:08.039148 25754 raft_consensus.cc:493] T 96efeaaf1057492490e9a621f37e1a2d P e61c3a8f61bb48f8a963c9480e53c168 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:08.032132 25530 raft_consensus.cc:3060] T 7f575b143b844aa096b50997dad3516a P 0473d2b2d01f4459b1e90fd12cc7840e [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:07:08.079807 19449 leader_election.cc:304] T e381f1d6b8184797ad142de49be225a8 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e; no voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168
W20260709 13:07:08.144483 26021 log.cc:927] Time spent T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P 127766fc592545a4997f7790f50f6076: Append to log took a long time: real 0.192s	user 0.000s	sys 0.001s
I20260709 13:07:08.084347 26033 raft_consensus.cc:2749] T 2b74109013a140ada21feeef92d6f563 P 0473d2b2d01f4459b1e90fd12cc7840e [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:07:08.049609 26017 raft_consensus.cc:493] T bc225c93219c45538b53a1bd3d387e4d P 0473d2b2d01f4459b1e90fd12cc7840e [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:08.064044 25881 raft_consensus.cc:493] T edd7d470b5014c9489be7f41f64355c9 P e61c3a8f61bb48f8a963c9480e53c168 [term 22 FOLLOWER]: Starting leader election (detected failure of leader e5256d91808b47c195bc9b4dbd7f2b87)
I20260709 13:07:08.101835 19481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a08760e15aac4630a629431f56024dc8" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 23 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:07:08.148473 20109 pending_rounds.cc:85] T 70797e5783b5454ab0d0eea663e791e3 P 127766fc592545a4997f7790f50f6076: Aborting all ops after (but not including) 14
I20260709 13:07:08.102715 19480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1b10566f45d4a7d9029858330e02d5b" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:07:08.229771 20109 pending_rounds.cc:107] T 70797e5783b5454ab0d0eea663e791e3 P 127766fc592545a4997f7790f50f6076: Aborting uncommitted NO_OP operation due to leader change: 21.15
I20260709 13:07:08.132062 19482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e36a9d6e29c4a7c860cf267efbd4c74" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:07:08.230652 20109 raft_consensus.cc:2889] T 70797e5783b5454ab0d0eea663e791e3 P 127766fc592545a4997f7790f50f6076 [term 22 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:07:08.020328 25859 raft_consensus.cc:515] T 76cb037fc9064d13b59a8969d897ce8c P 0473d2b2d01f4459b1e90fd12cc7840e [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:07:08.049458 25760 raft_consensus.cc:2749] T edd7d470b5014c9489be7f41f64355c9 P 0473d2b2d01f4459b1e90fd12cc7840e [term 23 FOLLOWER]: Leader election lost for term 23. Reason: could not achieve majority
I20260709 13:07:08.109565 25851 leader_election.cc:290] T ff75a1d4cb1f493db8f71ddc136ba9ab P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:07:08.094846 25983 raft_consensus.cc:697] T 775c229504194560ba9589bc2199b089 P e5256d91808b47c195bc9b4dbd7f2b87 [term 15 LEADER]: Becoming Leader. State: Replica: e5256d91808b47c195bc9b4dbd7f2b87, State: Running, Role: LEADER
I20260709 13:07:08.229858 25591 leader_election.cc:290] T 2e36a9d6e29c4a7c860cf267efbd4c74 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 14 election: Requested vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:07:08.086401 25819 leader_election.cc:290] T f1b10566f45d4a7d9029858330e02d5b P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 19 election: Requested vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
W20260709 13:07:08.088377 19452 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:08.156038 19375 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.3:36891, user_credentials={real_user=slave}} blocked reactor thread for 208056us
W20260709 13:07:08.158309 20075 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.1:40321, user_credentials={real_user=slave}} blocked reactor thread for 319713us
I20260709 13:07:08.236193 25881 raft_consensus.cc:3060] T edd7d470b5014c9489be7f41f64355c9 P e61c3a8f61bb48f8a963c9480e53c168 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:07:08.126044 25376 leader_election.cc:290] T fa8650e71aa14778b3d73721fc50d9fc P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
W20260709 13:07:08.104547 25661 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.504s	user 0.018s	sys 0.004s
W20260709 13:07:08.186322 19523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.1:40321, user_credentials={real_user=slave}} blocked reactor thread for 152719us
I20260709 13:07:08.139380 25994 leader_election.cc:290] T 833a2f0775ed407a94b8924ce50adb63 P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 15 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
W20260709 13:07:08.210275 19449 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.1:40321, user_credentials={real_user=slave}} blocked reactor thread for 130552us
I20260709 13:07:08.259269 19449 leader_election.cc:400] T f1b10566f45d4a7d9029858330e02d5b P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 18 election: Vote denied by peer e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321) with higher term. Message: Invalid argument: T f1b10566f45d4a7d9029858330e02d5b P e5256d91808b47c195bc9b4dbd7f2b87 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 0473d2b2d01f4459b1e90fd12cc7840e for earlier term 18. Current term is 19.
W20260709 13:07:08.220404 26029 log.cc:927] Time spent T 70797e5783b5454ab0d0eea663e791e3 P e5256d91808b47c195bc9b4dbd7f2b87: Append to log took a long time: real 0.135s	user 0.000s	sys 0.002s
I20260709 13:07:08.231477 18300 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:07:08.185178 25827 raft_consensus.cc:493] T fa731b585f684a7fb2d106c50f143b83 P e61c3a8f61bb48f8a963c9480e53c168 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:08.260612 19556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e381f1d6b8184797ad142de49be225a8" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 17 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:07:08.261543 19553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cdf56e38bbc453d9438d359e5a69955" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:07:08.262334 19551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21e14947d70440f19044d8f75c31e1f9" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:07:08.275556 19405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a61655d99124a29b486ba4a5b37faea" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:07:08.252116 19482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "179fd671030940b4b4a4e24bcc4aba0a" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 22 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:07:08.258240 19523 leader_election.cc:304] T 2a16f7501e2444fb86d4e2778e734e02 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e61c3a8f61bb48f8a963c9480e53c168; no voters: 127766fc592545a4997f7790f50f6076, e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:07:08.276615 19482 raft_consensus.cc:2468] T 179fd671030940b4b4a4e24bcc4aba0a P 0473d2b2d01f4459b1e90fd12cc7840e [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 21.
I20260709 13:07:08.276888 20105 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35874 (request call id 1175) took 1052 ms. Trace:
I20260709 13:07:08.248154 19484 raft_consensus.cc:1275] T 76cb037fc9064d13b59a8969d897ce8c P 0473d2b2d01f4459b1e90fd12cc7840e [term 18 FOLLOWER]: Refusing update from remote peer e5256d91808b47c195bc9b4dbd7f2b87: Log matching property violated. Preceding OpId in replica: term: 15 index: 8. Preceding OpId from leader: term: 18 index: 10. (index mismatch)
I20260709 13:07:08.256157 20075 leader_election.cc:304] T 85c494af21f9457a85da47b9bc70c1fd P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 127766fc592545a4997f7790f50f6076, e5256d91808b47c195bc9b4dbd7f2b87; no voters: e61c3a8f61bb48f8a963c9480e53c168
W20260709 13:07:08.228407 26037 log.cc:927] Time spent T f1b10566f45d4a7d9029858330e02d5b P 0473d2b2d01f4459b1e90fd12cc7840e: Append to log took a long time: real 0.101s	user 0.000s	sys 0.002s
I20260709 13:07:08.182080 25957 leader_election.cc:290] T 1a61655d99124a29b486ba4a5b37faea P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 18 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:07:08.263612 19554 raft_consensus.cc:1240] T 65d8cb8d6ec64f459d5a47cefab10acf P e61c3a8f61bb48f8a963c9480e53c168 [term 20 FOLLOWER]: Rejecting Update request from peer e5256d91808b47c195bc9b4dbd7f2b87 for earlier term 19. Current term is 20. Ops: []
I20260709 13:07:08.270489 19481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1b10566f45d4a7d9029858330e02d5b" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:07:08.271234 19478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc225c93219c45538b53a1bd3d387e4d" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:07:08.272228 19485 raft_consensus.cc:1275] T ed7fdbcb96d14d418db9ca90a792588a P 0473d2b2d01f4459b1e90fd12cc7840e [term 16 FOLLOWER]: Refusing update from remote peer e61c3a8f61bb48f8a963c9480e53c168: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 13:07:08.308625 19404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21e14947d70440f19044d8f75c31e1f9" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
I20260709 13:07:08.277613 19482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "217b5fae677b4971b3bbd2f357a1f7ff" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:07:08.309486 19404 raft_consensus.cc:2393] T 21e14947d70440f19044d8f75c31e1f9 P e5256d91808b47c195bc9b4dbd7f2b87 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 0473d2b2d01f4459b1e90fd12cc7840e in current term 19: Already voted for candidate e5256d91808b47c195bc9b4dbd7f2b87 in this term.
I20260709 13:07:08.309788 19485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff75a1d4cb1f493db8f71ddc136ba9ab" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
W20260709 13:07:08.253013 26040 log.cc:927] Time spent T 1f85fc4b527a48848e5faa083b604e36 P 127766fc592545a4997f7790f50f6076: Append to log took a long time: real 0.068s	user 0.000s	sys 0.000s
I20260709 13:07:08.283835 19556 raft_consensus.cc:2393] T e381f1d6b8184797ad142de49be225a8 P e61c3a8f61bb48f8a963c9480e53c168 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate e5256d91808b47c195bc9b4dbd7f2b87 in current term 17: Already voted for candidate e61c3a8f61bb48f8a963c9480e53c168 in this term.
I20260709 13:07:08.284562 19410 raft_consensus.cc:1275] T ff9b0eddd810459b82d91c60777c10eb P e5256d91808b47c195bc9b4dbd7f2b87 [term 19 FOLLOWER]: Refusing update from remote peer 0473d2b2d01f4459b1e90fd12cc7840e: Log matching property violated. Preceding OpId in replica: term: 17 index: 13. Preceding OpId from leader: term: 19 index: 14. (index mismatch)
I20260709 13:07:08.227975 25932 raft_consensus.cc:2749] T e381f1d6b8184797ad142de49be225a8 P 0473d2b2d01f4459b1e90fd12cc7840e [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:07:08.285095 20075 leader_election.cc:304] T 172b3dd13109415a955b71ac0e9d2234 P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 127766fc592545a4997f7790f50f6076; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:07:08.127806 25984 consensus_queue.cc:237] T ef32ce6fdd0e40d382c79974f30295c6 P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 21.12, Last appended by leader: 12, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:07:08.241937 25537 leader_election.cc:290] T 179fd671030940b4b4a4e24bcc4aba0a P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:07:08.303371 19560 raft_consensus.cc:1240] T 4af19371ea874c09a0a2147040835cbb P e61c3a8f61bb48f8a963c9480e53c168 [term 11 LEADER]: Rejecting Update request from peer e5256d91808b47c195bc9b4dbd7f2b87 for earlier term 10. Current term is 11. Ops: []
I20260709 13:07:08.249555 25993 leader_election.cc:290] T 179fd671030940b4b4a4e24bcc4aba0a P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:07:08.247357 25944 leader_election.cc:290] T 6c5eebf646ad445a9d1b1adc319d7b16 P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:07:08.268672 25946 raft_consensus.cc:3060] T 5ec1c4ce15e04c7e8c283a62179f2a64 P 127766fc592545a4997f7790f50f6076 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:07:08.305249 19481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22196caba61445d3bec98a0aab3c337d" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:07:08.250048 25989 leader_election.cc:290] T 309c3ca0ca4b4f3ba129752ea2cb293b P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:07:08.305768 25661 consensus_queue.cc:1059] T 21e14947d70440f19044d8f75c31e1f9 P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:07:08.306243 25988 raft_consensus.cc:2749] T 2a16f7501e2444fb86d4e2778e734e02 P e61c3a8f61bb48f8a963c9480e53c168 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:07:08.291503 19405 raft_consensus.cc:2393] T 1a61655d99124a29b486ba4a5b37faea P e5256d91808b47c195bc9b4dbd7f2b87 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0473d2b2d01f4459b1e90fd12cc7840e in current term 18: Already voted for candidate e5256d91808b47c195bc9b4dbd7f2b87 in this term.
I20260709 13:07:08.371479 19552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "179fd671030940b4b4a4e24bcc4aba0a" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 22 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:07:08.372763 19402 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49050 (request call id 1258) took 1430 ms. Trace:
I20260709 13:07:08.373296 19402 rpcz_store.cc:276] 0709 13:07:06.942268 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:06.942449 (+   181us) service_pool.cc:224] Handling call
0709 13:07:06.942893 (+   444us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:08.061774 (+1118881us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:08.372414 (+310640us) spinlock_profiling.cc:243] Waited 1.11 s on lock 0x7b54000b2cd4. stack: 00007f4a79de9343 00007f4a79de9240 00007f4a797781d4 00007f4a834b6304 00007f4a834b6299 00007f4a7ce71571 00007f4a7cf08e01 00007f4a7cf0783e 00007f4a81ecc419 00007f4a7b443bd4 00007f4a7b443b62 00007f4a7b443a91 00007f4a7b443a0c 00007f4a7b442cc2 00007f4a7b24348c 00007f4a7b2428c6
0709 13:07:08.372687 (+   273us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2541721344}
I20260709 13:07:08.276069 25851 consensus_queue.cc:1059] T 1dc5b3532fe54f74876d02beffa2c230 P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 }, Status: INVALID_TERM, Last received: 19.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.060s
I20260709 13:07:08.248797 25859 leader_election.cc:290] T 76cb037fc9064d13b59a8969d897ce8c P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:07:08.253647 25879 leader_election.cc:290] T 22196caba61445d3bec98a0aab3c337d P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 19 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:07:08.272920 19480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b08304a0a02b42d7840c4e8ee9a6bd1a" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:07:08.285245 19523 leader_election.cc:304] T b9f0d59553ad444883fcf5b5909f9798 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e61c3a8f61bb48f8a963c9480e53c168; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:07:08.311229 19485 raft_consensus.cc:1275] T 46c5bfeecc314717bffe987e6844b6d0 P 0473d2b2d01f4459b1e90fd12cc7840e [term 25 FOLLOWER]: Refusing update from remote peer e61c3a8f61bb48f8a963c9480e53c168: Log matching property violated. Preceding OpId in replica: term: 23 index: 12. Preceding OpId from leader: term: 25 index: 13. (index mismatch)
I20260709 13:07:08.474068 19480 raft_consensus.cc:2468] T b08304a0a02b42d7840c4e8ee9a6bd1a P 0473d2b2d01f4459b1e90fd12cc7840e [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 20.
W20260709 13:07:08.278689 26020 log.cc:927] Time spent T 40e1e16737a842ee936002830f36882e P 0473d2b2d01f4459b1e90fd12cc7840e: Append to log took a long time: real 0.258s	user 0.000s	sys 0.001s
I20260709 13:07:08.229548 26035 raft_consensus.cc:2749] T df751f992649444090e27965eb1af85d P e61c3a8f61bb48f8a963c9480e53c168 [term 22 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:07:08.317976 19556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e36a9d6e29c4a7c860cf267efbd4c74" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:07:08.324903 20111 raft_consensus.cc:1240] T 4af19371ea874c09a0a2147040835cbb P 127766fc592545a4997f7790f50f6076 [term 11 FOLLOWER]: Rejecting Update request from peer e5256d91808b47c195bc9b4dbd7f2b87 for earlier term 10. Current term is 11. Ops: [10.9-10.9]
I20260709 13:07:08.310174 25928 consensus_queue.cc:1059] T 4509b76741dc428e9201c70c1658da13 P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 }, Status: INVALID_TERM, Last received: 12.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.068s
I20260709 13:07:08.291441 25827 raft_consensus.cc:515] T fa731b585f684a7fb2d106c50f143b83 P e61c3a8f61bb48f8a963c9480e53c168 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:07:08.338227 26036 raft_consensus.cc:493] T fa8650e71aa14778b3d73721fc50d9fc P e61c3a8f61bb48f8a963c9480e53c168 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:08.222224 25754 raft_consensus.cc:515] T 96efeaaf1057492490e9a621f37e1a2d P e61c3a8f61bb48f8a963c9480e53c168 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
W20260709 13:07:08.350487 19526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.2:46257, user_credentials={real_user=slave}} blocked reactor thread for 64226.3us
I20260709 13:07:08.351600 25918 leader_election.cc:290] T 70797e5783b5454ab0d0eea663e791e3 P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:07:08.351997 26044 raft_consensus.cc:493] T ed7fdbcb96d14d418db9ca90a792588a P 127766fc592545a4997f7790f50f6076 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:08.514410 26036 raft_consensus.cc:515] T fa8650e71aa14778b3d73721fc50d9fc P e61c3a8f61bb48f8a963c9480e53c168 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:07:08.514508 26044 raft_consensus.cc:515] T ed7fdbcb96d14d418db9ca90a792588a P 127766fc592545a4997f7790f50f6076 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:07:08.516875 26036 leader_election.cc:290] T fa8650e71aa14778b3d73721fc50d9fc P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:07:08.312393 25994 raft_consensus.cc:2804] T 85c494af21f9457a85da47b9bc70c1fd P 127766fc592545a4997f7790f50f6076 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:07:08.518246 25994 raft_consensus.cc:493] T 85c494af21f9457a85da47b9bc70c1fd P 127766fc592545a4997f7790f50f6076 [term 17 FOLLOWER]: Starting leader election (detected failure of leader e61c3a8f61bb48f8a963c9480e53c168)
I20260709 13:07:08.518827 25994 raft_consensus.cc:3060] T 85c494af21f9457a85da47b9bc70c1fd P 127766fc592545a4997f7790f50f6076 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:07:08.372418 19552 raft_consensus.cc:2468] T 179fd671030940b4b4a4e24bcc4aba0a P e61c3a8f61bb48f8a963c9480e53c168 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 21.
I20260709 13:07:08.380630 19484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14935b3ddf914369822e4a0547aaa355" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:07:08.321880 26042 raft_consensus.cc:2749] T 172b3dd13109415a955b71ac0e9d2234 P 127766fc592545a4997f7790f50f6076 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 13:07:08.491117 25871 consensus_meta.cc:287] T 1efebf73c86e432baa55533136b6e12c P 0473d2b2d01f4459b1e90fd12cc7840e: Time spent flushing consensus metadata: real 0.904s	user 0.005s	sys 0.006s
I20260709 13:07:08.240397 26017 raft_consensus.cc:515] T bc225c93219c45538b53a1bd3d387e4d P 0473d2b2d01f4459b1e90fd12cc7840e [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:07:08.257908 25865 raft_consensus.cc:515] T ece3db938bc649d4a40a51522ed5259c P e61c3a8f61bb48f8a963c9480e53c168 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:07:08.250543 25983 consensus_queue.cc:237] T 775c229504194560ba9589bc2199b089 P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:07:08.485347 25879 raft_consensus.cc:493] T 86a6797bdfe94fa496c050ceae4bd0d9 P e61c3a8f61bb48f8a963c9480e53c168 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 0473d2b2d01f4459b1e90fd12cc7840e)
I20260709 13:07:08.482214 20107 raft_consensus.cc:1275] T ff9b0eddd810459b82d91c60777c10eb P 127766fc592545a4997f7790f50f6076 [term 19 FOLLOWER]: Refusing update from remote peer 0473d2b2d01f4459b1e90fd12cc7840e: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 19 index: 14. (index mismatch)
I20260709 13:07:08.335652 25591 raft_consensus.cc:493] T 7be9efa6559648dbb5a0f7684c4542d1 P e5256d91808b47c195bc9b4dbd7f2b87 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:08.471925 25530 raft_consensus.cc:515] T 7f575b143b844aa096b50997dad3516a P 0473d2b2d01f4459b1e90fd12cc7840e [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
W20260709 13:07:08.472615 26040 log.cc:927] Time spent T 1f85fc4b527a48848e5faa083b604e36 P 127766fc592545a4997f7790f50f6076: Append to log took a long time: real 0.137s	user 0.000s	sys 0.000s
W20260709 13:07:08.482494 26039 log.cc:927] Time spent T f93ee515a9c14139bf566522ed8232f3 P 0473d2b2d01f4459b1e90fd12cc7840e: Append to log took a long time: real 0.216s	user 0.000s	sys 0.001s
W20260709 13:07:08.479336 25908 consensus_meta.cc:287] T 62c6c134d3d24a1ab144dd9ee6bc3f64 P 127766fc592545a4997f7790f50f6076: Time spent flushing consensus metadata: real 0.865s	user 0.010s	sys 0.003s
I20260709 13:07:08.485719 25661 raft_consensus.cc:3055] T 21e14947d70440f19044d8f75c31e1f9 P e61c3a8f61bb48f8a963c9480e53c168 [term 18 LEADER]: Stepping down as leader of term 18
W20260709 13:07:08.507604 26034 log.cc:927] Time spent T 4af19371ea874c09a0a2147040835cbb P e5256d91808b47c195bc9b4dbd7f2b87: Append to log took a long time: real 0.366s	user 0.000s	sys 0.001s
I20260709 13:07:08.348680 26043 consensus_queue.cc:1059] T 9962423cb4e54fcfa5de01daf68a86e7 P 127766fc592545a4997f7790f50f6076 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 }, Status: INVALID_TERM, Last received: 17.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.147s
I20260709 13:07:08.545565 26043 raft_consensus.cc:3055] T 9962423cb4e54fcfa5de01daf68a86e7 P 127766fc592545a4997f7790f50f6076 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:07:08.545909 26043 raft_consensus.cc:740] T 9962423cb4e54fcfa5de01daf68a86e7 P 127766fc592545a4997f7790f50f6076 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 127766fc592545a4997f7790f50f6076, State: Running, Role: LEADER
I20260709 13:07:08.546746 26043 consensus_queue.cc:260] T 9962423cb4e54fcfa5de01daf68a86e7 P 127766fc592545a4997f7790f50f6076 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 17.12, Last appended by leader: 12, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:07:08.547868 26043 raft_consensus.cc:3060] T 9962423cb4e54fcfa5de01daf68a86e7 P 127766fc592545a4997f7790f50f6076 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:07:08.543430 25908 raft_consensus.cc:515] T 62c6c134d3d24a1ab144dd9ee6bc3f64 P 127766fc592545a4997f7790f50f6076 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:07:08.551350 25908 leader_election.cc:290] T 62c6c134d3d24a1ab144dd9ee6bc3f64 P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 18 election: Requested vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:07:08.552069 26017 leader_election.cc:290] T bc225c93219c45538b53a1bd3d387e4d P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:07:08.542161 25661 raft_consensus.cc:740] T 21e14947d70440f19044d8f75c31e1f9 P e61c3a8f61bb48f8a963c9480e53c168 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: e61c3a8f61bb48f8a963c9480e53c168, State: Running, Role: LEADER
I20260709 13:07:08.553172 25661 consensus_queue.cc:260] T 21e14947d70440f19044d8f75c31e1f9 P e61c3a8f61bb48f8a963c9480e53c168 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.12, Last appended by leader: 12, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:07:08.554021 25661 raft_consensus.cc:3060] T 21e14947d70440f19044d8f75c31e1f9 P e61c3a8f61bb48f8a963c9480e53c168 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:07:08.555879 25865 leader_election.cc:290] T ece3db938bc649d4a40a51522ed5259c P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 15 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:07:08.557026 25865 raft_consensus.cc:493] T 76cb037fc9064d13b59a8969d897ce8c P e61c3a8f61bb48f8a963c9480e53c168 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:08.557544 25865 raft_consensus.cc:515] T 76cb037fc9064d13b59a8969d897ce8c P e61c3a8f61bb48f8a963c9480e53c168 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:07:08.561374 25754 leader_election.cc:290] T 96efeaaf1057492490e9a621f37e1a2d P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:07:08.562600 25827 leader_election.cc:290] T fa731b585f684a7fb2d106c50f143b83 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:07:08.535594 25879 raft_consensus.cc:515] T 86a6797bdfe94fa496c050ceae4bd0d9 P e61c3a8f61bb48f8a963c9480e53c168 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:07:08.480679 25851 raft_consensus.cc:493] T 1efebf73c86e432baa55533136b6e12c P e61c3a8f61bb48f8a963c9480e53c168 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 0473d2b2d01f4459b1e90fd12cc7840e)
I20260709 13:07:08.563747 25851 raft_consensus.cc:515] T 1efebf73c86e432baa55533136b6e12c P e61c3a8f61bb48f8a963c9480e53c168 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:07:08.564577 25992 raft_consensus.cc:3055] T 65d8cb8d6ec64f459d5a47cefab10acf P e5256d91808b47c195bc9b4dbd7f2b87 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:07:08.564944 25879 leader_election.cc:290] T 86a6797bdfe94fa496c050ceae4bd0d9 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:07:08.565111 25992 raft_consensus.cc:740] T 65d8cb8d6ec64f459d5a47cefab10acf P e5256d91808b47c195bc9b4dbd7f2b87 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: e5256d91808b47c195bc9b4dbd7f2b87, State: Running, Role: LEADER
I20260709 13:07:08.521835 26044 leader_election.cc:290] T ed7fdbcb96d14d418db9ca90a792588a P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:07:08.563100 25997 leader_election.cc:290] T a08760e15aac4630a629431f56024dc8 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 23 election: Requested vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:07:08.520723 25988 raft_consensus.cc:2749] T b9f0d59553ad444883fcf5b5909f9798 P e61c3a8f61bb48f8a963c9480e53c168 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 13:07:08.485045 26041 log.cc:927] Time spent T 4af19371ea874c09a0a2147040835cbb P e61c3a8f61bb48f8a963c9480e53c168: Append to log took a long time: real 0.182s	user 0.002s	sys 0.000s
I20260709 13:07:08.349434 19404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f575b143b844aa096b50997dad3516a" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 17 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:07:08.325901 19375 leader_election.cc:304] T 0cdf56e38bbc453d9438d359e5a69955 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:07:08.609563 19402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa8650e71aa14778b3d73721fc50d9fc" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:07:08.611375 19404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a61655d99124a29b486ba4a5b37faea" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
I20260709 13:07:08.611545 19402 raft_consensus.cc:2468] T fa8650e71aa14778b3d73721fc50d9fc P e5256d91808b47c195bc9b4dbd7f2b87 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 19.
I20260709 13:07:08.612440 19403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "179fd671030940b4b4a4e24bcc4aba0a" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 22 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:07:08.612923 19404 raft_consensus.cc:2393] T 1a61655d99124a29b486ba4a5b37faea P e5256d91808b47c195bc9b4dbd7f2b87 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 0473d2b2d01f4459b1e90fd12cc7840e in current term 18: Already voted for candidate e5256d91808b47c195bc9b4dbd7f2b87 in this term.
I20260709 13:07:08.613711 19403 raft_consensus.cc:2410] T 179fd671030940b4b4a4e24bcc4aba0a P e5256d91808b47c195bc9b4dbd7f2b87 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0473d2b2d01f4459b1e90fd12cc7840e for term 22 because replica has last-logged OpId of term: 20 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 19 index: 12.
I20260709 13:07:08.614650 19404 raft_consensus.cc:1240] T a08760e15aac4630a629431f56024dc8 P e5256d91808b47c195bc9b4dbd7f2b87 [term 23 FOLLOWER]: Rejecting Update request from peer 0473d2b2d01f4459b1e90fd12cc7840e for earlier term 22. Current term is 23. Ops: []
W20260709 13:07:08.613484 19375 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.3:36891, user_credentials={real_user=slave}} blocked reactor thread for 287511us
I20260709 13:07:08.384089 19405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70797e5783b5454ab0d0eea663e791e3" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 23 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:07:08.338709 19406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff75a1d4cb1f493db8f71ddc136ba9ab" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:07:08.338452 19408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4509b76741dc428e9201c70c1658da13" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
I20260709 13:07:08.332173 19411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "309c3ca0ca4b4f3ba129752ea2cb293b" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:07:08.332791 19409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "833a2f0775ed407a94b8924ce50adb63" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
I20260709 13:07:08.319579 19410 raft_consensus.cc:1275] T 5ec1c4ce15e04c7e8c283a62179f2a64 P e5256d91808b47c195bc9b4dbd7f2b87 [term 13 FOLLOWER]: Refusing update from remote peer 0473d2b2d01f4459b1e90fd12cc7840e: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 13:07:08.381815 19477 raft_consensus.cc:1275] T ab43d85f64114d4ebf618930e43d9ed0 P 0473d2b2d01f4459b1e90fd12cc7840e [term 21 FOLLOWER]: Refusing update from remote peer 127766fc592545a4997f7790f50f6076: Log matching property violated. Preceding OpId in replica: term: 19 index: 13. Preceding OpId from leader: term: 21 index: 14. (index mismatch)
I20260709 13:07:08.613483 19402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76cb037fc9064d13b59a8969d897ce8c" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 19 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:07:08.631224 19477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed7fdbcb96d14d418db9ca90a792588a" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:07:08.632212 19477 raft_consensus.cc:2468] T ed7fdbcb96d14d418db9ca90a792588a P 0473d2b2d01f4459b1e90fd12cc7840e [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 127766fc592545a4997f7790f50f6076 in term 16.
I20260709 13:07:08.635361 19479 raft_consensus.cc:1240] T 7f575b143b844aa096b50997dad3516a P 0473d2b2d01f4459b1e90fd12cc7840e [term 17 FOLLOWER]: Rejecting Update request from peer e5256d91808b47c195bc9b4dbd7f2b87 for earlier term 16. Current term is 17. Ops: [16.11-16.11]
I20260709 13:07:08.475129 19480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "309c3ca0ca4b4f3ba129752ea2cb293b" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:07:08.382149 19481 raft_consensus.cc:2468] T 22196caba61445d3bec98a0aab3c337d P 0473d2b2d01f4459b1e90fd12cc7840e [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 19.
I20260709 13:07:08.477487 19483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c5eebf646ad445a9d1b1adc319d7b16" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
W20260709 13:07:08.477005 19523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.1:40321, user_credentials={real_user=slave}} blocked reactor thread for 191856us
I20260709 13:07:08.521474 19484 raft_consensus.cc:3060] T 14935b3ddf914369822e4a0547aaa355 P 0473d2b2d01f4459b1e90fd12cc7840e [term 12 FOLLOWER]: Advancing to term 14
I20260709 13:07:08.644318 19523 leader_election.cc:304] T 65d8cb8d6ec64f459d5a47cefab10acf P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e61c3a8f61bb48f8a963c9480e53c168; no voters: 127766fc592545a4997f7790f50f6076, e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:07:08.646399 19375 leader_election.cc:304] T 179fd671030940b4b4a4e24bcc4aba0a P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:07:08.488817 19556 raft_consensus.cc:1240] T 217b5fae677b4971b3bbd2f357a1f7ff P e61c3a8f61bb48f8a963c9480e53c168 [term 16 FOLLOWER]: Rejecting Update request from peer e5256d91808b47c195bc9b4dbd7f2b87 for earlier term 15. Current term is 16. Ops: []
I20260709 13:07:08.651221 19556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a08760e15aac4630a629431f56024dc8" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 23 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:07:08.652004 19556 raft_consensus.cc:3060] T a08760e15aac4630a629431f56024dc8 P e61c3a8f61bb48f8a963c9480e53c168 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:07:08.668509 26067 raft_consensus.cc:493] T fa8650e71aa14778b3d73721fc50d9fc P e5256d91808b47c195bc9b4dbd7f2b87 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:08.668730 26065 raft_consensus.cc:493] T 2a16f7501e2444fb86d4e2778e734e02 P e5256d91808b47c195bc9b4dbd7f2b87 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 127766fc592545a4997f7790f50f6076)
W20260709 13:07:08.329633 20075 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:08.671906 19478 raft_consensus.cc:2468] T bc225c93219c45538b53a1bd3d387e4d P 0473d2b2d01f4459b1e90fd12cc7840e [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 16.
I20260709 13:07:08.678272 25530 leader_election.cc:290] T 7f575b143b844aa096b50997dad3516a P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 17 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:07:08.679400 25530 raft_consensus.cc:493] T 40e1e16737a842ee936002830f36882e P 0473d2b2d01f4459b1e90fd12cc7840e [term 20 FOLLOWER]: Starting pre-election (detected failure of leader e61c3a8f61bb48f8a963c9480e53c168)
I20260709 13:07:08.679946 26069 consensus_queue.cc:1059] T 4af19371ea874c09a0a2147040835cbb P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:07:08.680240 25530 raft_consensus.cc:515] T 40e1e16737a842ee936002830f36882e P 0473d2b2d01f4459b1e90fd12cc7840e [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:07:08.277457 20105 rpcz_store.cc:276] 0709 13:07:07.208764 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:07.208913 (+   149us) service_pool.cc:224] Handling call
0709 13:07:07.209195 (+   282us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:07.211797 (+  2602us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:07.211827 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:07.228010 (+ 16183us) log.cc:844] Serialized 26 byte log entry
0709 13:07:07.725780 (+497770us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:07:07.725827 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:07.725903 (+    76us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:08.261454 (+535551us) raft_consensus.cc:1685] finished
0709 13:07:08.261472 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:08.261599 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2278,"raft.queue_time_us":18474,"raft.run_cpu_time_us":133,"raft.run_wall_time_us":31308,"thread_start_us":412407,"threads_started":1,"wal-append.queue_time_us":864629}
I20260709 13:07:08.673897 26065 raft_consensus.cc:515] T 2a16f7501e2444fb86d4e2778e734e02 P e5256d91808b47c195bc9b4dbd7f2b87 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:07:08.683243 25530 leader_election.cc:290] T 40e1e16737a842ee936002830f36882e P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:07:08.686182 26065 leader_election.cc:290] T 2a16f7501e2444fb86d4e2778e734e02 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:07:08.686501 25530 raft_consensus.cc:493] T 0e1085d23e8347fbbd5bce7542f4b1f4 P 0473d2b2d01f4459b1e90fd12cc7840e [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:08.687495 25587 raft_consensus.cc:493] T df751f992649444090e27965eb1af85d P e5256d91808b47c195bc9b4dbd7f2b87 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:08.686905 26065 raft_consensus.cc:2749] T 0cdf56e38bbc453d9438d359e5a69955 P e5256d91808b47c195bc9b4dbd7f2b87 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:07:08.690528 19556 raft_consensus.cc:2468] T a08760e15aac4630a629431f56024dc8 P e61c3a8f61bb48f8a963c9480e53c168 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 23.
I20260709 13:07:08.699842 25815 raft_consensus.cc:493] T 96efeaaf1057492490e9a621f37e1a2d P 127766fc592545a4997f7790f50f6076 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader e61c3a8f61bb48f8a963c9480e53c168)
I20260709 13:07:08.700068 25992 consensus_queue.cc:260] T 65d8cb8d6ec64f459d5a47cefab10acf P e5256d91808b47c195bc9b4dbd7f2b87 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 19.12, Last appended by leader: 12, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:07:08.700919 25815 raft_consensus.cc:515] T 96efeaaf1057492490e9a621f37e1a2d P 127766fc592545a4997f7790f50f6076 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:07:08.703611 25923 raft_consensus.cc:493] T 5ec1c4ce15e04c7e8c283a62179f2a64 P e5256d91808b47c195bc9b4dbd7f2b87 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:08.703799 19523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.1:40321, user_credentials={real_user=slave}} blocked reactor thread for 59950.6us
I20260709 13:07:08.704492 25923 raft_consensus.cc:515] T 5ec1c4ce15e04c7e8c283a62179f2a64 P e5256d91808b47c195bc9b4dbd7f2b87 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:07:08.705148 19523 leader_election.cc:304] T 2b74109013a140ada21feeef92d6f563 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e61c3a8f61bb48f8a963c9480e53c168; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:07:08.706681 25982 raft_consensus.cc:493] T b08304a0a02b42d7840c4e8ee9a6bd1a P e5256d91808b47c195bc9b4dbd7f2b87 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:08.707459 25982 raft_consensus.cc:515] T b08304a0a02b42d7840c4e8ee9a6bd1a P e5256d91808b47c195bc9b4dbd7f2b87 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
W20260709 13:07:08.707918 26062 log.cc:927] Time spent T 00000000000000000000000000000000 P 97750b77d35444acb7791ebf26cc2685: Append to log took a long time: real 0.130s	user 0.002s	sys 0.000s
I20260709 13:07:08.708252 19552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a16f7501e2444fb86d4e2778e734e02" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:07:08.711185 26036 raft_consensus.cc:2749] T 65d8cb8d6ec64f459d5a47cefab10acf P e61c3a8f61bb48f8a963c9480e53c168 [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 13:07:08.711474 25819 raft_consensus.cc:2804] T 179fd671030940b4b4a4e24bcc4aba0a P e5256d91808b47c195bc9b4dbd7f2b87 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:07:08.711903 25819 raft_consensus.cc:493] T 179fd671030940b4b4a4e24bcc4aba0a P e5256d91808b47c195bc9b4dbd7f2b87 [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:08.712338 25819 raft_consensus.cc:3060] T 179fd671030940b4b4a4e24bcc4aba0a P e5256d91808b47c195bc9b4dbd7f2b87 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:07:08.712368 25993 consensus_queue.cc:1059] T 217b5fae677b4971b3bbd2f357a1f7ff P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 }, Status: INVALID_TERM, Last received: 15.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:07:08.715073 25851 leader_election.cc:290] T 1efebf73c86e432baa55533136b6e12c P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:07:08.715854 25851 raft_consensus.cc:3055] T 1dc5b3532fe54f74876d02beffa2c230 P e61c3a8f61bb48f8a963c9480e53c168 [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:07:08.716229 25997 raft_consensus.cc:3055] T 217b5fae677b4971b3bbd2f357a1f7ff P e5256d91808b47c195bc9b4dbd7f2b87 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:07:08.716306 25851 raft_consensus.cc:740] T 1dc5b3532fe54f74876d02beffa2c230 P e61c3a8f61bb48f8a963c9480e53c168 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: e61c3a8f61bb48f8a963c9480e53c168, State: Running, Role: LEADER
I20260709 13:07:08.716796 25997 raft_consensus.cc:740] T 217b5fae677b4971b3bbd2f357a1f7ff P e5256d91808b47c195bc9b4dbd7f2b87 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: e5256d91808b47c195bc9b4dbd7f2b87, State: Running, Role: LEADER
W20260709 13:07:08.718158 20077 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:08.720018 20105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a16f7501e2444fb86d4e2778e734e02" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:07:08.539394 25881 raft_consensus.cc:515] T edd7d470b5014c9489be7f41f64355c9 P e61c3a8f61bb48f8a963c9480e53c168 [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:07:08.723968 19407 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52342 (request call id 3272) took 1482 ms. Trace:
I20260709 13:07:08.724924 25881 leader_election.cc:290] T edd7d470b5014c9489be7f41f64355c9 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 23 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:07:08.722051 25587 raft_consensus.cc:515] T df751f992649444090e27965eb1af85d P e5256d91808b47c195bc9b4dbd7f2b87 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:07:08.725235 25908 raft_consensus.cc:493] T 0e1085d23e8347fbbd5bce7542f4b1f4 P 127766fc592545a4997f7790f50f6076 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:08.726049 25908 raft_consensus.cc:515] T 0e1085d23e8347fbbd5bce7542f4b1f4 P 127766fc592545a4997f7790f50f6076 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:07:08.727579 25587 leader_election.cc:290] T df751f992649444090e27965eb1af85d P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:07:08.730520 25815 leader_election.cc:290] T 96efeaaf1057492490e9a621f37e1a2d P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:07:08.689929 26067 raft_consensus.cc:515] T fa8650e71aa14778b3d73721fc50d9fc P e5256d91808b47c195bc9b4dbd7f2b87 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:07:08.733331 26067 leader_election.cc:290] T fa8650e71aa14778b3d73721fc50d9fc P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:07:08.724944 19552 raft_consensus.cc:1275] T 70797e5783b5454ab0d0eea663e791e3 P e61c3a8f61bb48f8a963c9480e53c168 [term 22 FOLLOWER]: Refusing update from remote peer e5256d91808b47c195bc9b4dbd7f2b87: Log matching property violated. Preceding OpId in replica: term: 18 index: 13. Preceding OpId from leader: term: 22 index: 15. (index mismatch)
I20260709 13:07:08.733371 19523 leader_election.cc:304] T e381f1d6b8184797ad142de49be225a8 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e61c3a8f61bb48f8a963c9480e53c168; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:07:08.738021 25879 raft_consensus.cc:2749] T e381f1d6b8184797ad142de49be225a8 P e61c3a8f61bb48f8a963c9480e53c168 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:07:08.538161 25591 raft_consensus.cc:515] T 7be9efa6559648dbb5a0f7684c4542d1 P e5256d91808b47c195bc9b4dbd7f2b87 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } attrs { replace: true } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:07:08.715094 25928 raft_consensus.cc:2749] T 2b74109013a140ada21feeef92d6f563 P e61c3a8f61bb48f8a963c9480e53c168 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
W20260709 13:07:08.744061 20075 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.1:40321, user_credentials={real_user=slave}} blocked reactor thread for 65315.4us
I20260709 13:07:08.744415 25879 consensus_queue.cc:1059] T 0cdf56e38bbc453d9438d359e5a69955 P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:07:08.745782 25591 leader_election.cc:290] T 7be9efa6559648dbb5a0f7684c4542d1 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:07:08.747128 25879 raft_consensus.cc:3055] T 0cdf56e38bbc453d9438d359e5a69955 P e61c3a8f61bb48f8a963c9480e53c168 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:07:08.747736 25879 raft_consensus.cc:740] T 0cdf56e38bbc453d9438d359e5a69955 P e61c3a8f61bb48f8a963c9480e53c168 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: e61c3a8f61bb48f8a963c9480e53c168, State: Running, Role: LEADER
I20260709 13:07:08.749315 25879 consensus_queue.cc:260] T 0cdf56e38bbc453d9438d359e5a69955 P e61c3a8f61bb48f8a963c9480e53c168 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.12, Last appended by leader: 12, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
W20260709 13:07:08.750959 25925 consensus_queue.cc:1175] T 65d8cb8d6ec64f459d5a47cefab10acf P e5256d91808b47c195bc9b4dbd7f2b87 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "e61c3a8f61bb48f8a963c9480e53c168" responder_term: 20 status { last_received { term: 19 index: 12 } last_committed_idx: 12 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer e5256d91808b47c195bc9b4dbd7f2b87 for earlier term 19. Current term is 20. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 13:07:08.752040 25879 raft_consensus.cc:3060] T 0cdf56e38bbc453d9438d359e5a69955 P e61c3a8f61bb48f8a963c9480e53c168 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:07:08.752548 26044 raft_consensus.cc:493] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P 127766fc592545a4997f7790f50f6076 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 0473d2b2d01f4459b1e90fd12cc7840e)
I20260709 13:07:08.753665 25984 raft_consensus.cc:493] T ff9b0eddd810459b82d91c60777c10eb P e5256d91808b47c195bc9b4dbd7f2b87 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:08.753337 26044 raft_consensus.cc:515] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P 127766fc592545a4997f7790f50f6076 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:07:08.717821 25851 consensus_queue.cc:260] T 1dc5b3532fe54f74876d02beffa2c230 P e61c3a8f61bb48f8a963c9480e53c168 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 20.11, Last appended by leader: 11, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:07:08.751983 19375 leader_election.cc:304] T a08760e15aac4630a629431f56024dc8 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:07:08.758489 25992 raft_consensus.cc:3060] T 65d8cb8d6ec64f459d5a47cefab10acf P e5256d91808b47c195bc9b4dbd7f2b87 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:07:08.786568 19556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7be9efa6559648dbb5a0f7684c4542d1" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 21 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:07:08.724403 19407 rpcz_store.cc:276] 0709 13:07:07.241831 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:07.358408 (+116577us) service_pool.cc:224] Handling call
0709 13:07:07.358695 (+   287us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:08.042485 (+683790us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:08.723434 (+680949us) spinlock_profiling.cc:243] Waited 600 ms on lock 0x7b5400064854. stack: 00007f4a79de9343 00007f4a79de9240 00007f4a797781d4 00007f4a834b6304 00007f4a834b6299 00007f4a7ce71571 00007f4a7cf08e01 00007f4a7cf0783e 00007f4a81ecc419 00007f4a7b443bd4 00007f4a7b443b62 00007f4a7b443a91 00007f4a7b443a0c 00007f4a7b442cc2 00007f4a7b24348c 00007f4a7b2428c6
0709 13:07:08.723756 (+   322us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1379840896}
I20260709 13:07:08.761545 25982 leader_election.cc:290] T b08304a0a02b42d7840c4e8ee9a6bd1a P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:07:08.754405 25984 raft_consensus.cc:515] T ff9b0eddd810459b82d91c60777c10eb P e5256d91808b47c195bc9b4dbd7f2b87 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:07:08.793044 19552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa8650e71aa14778b3d73721fc50d9fc" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:07:08.718122 25997 consensus_queue.cc:260] T 217b5fae677b4971b3bbd2f357a1f7ff P e5256d91808b47c195bc9b4dbd7f2b87 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:07:08.798534 25925 raft_consensus.cc:2804] T a08760e15aac4630a629431f56024dc8 P e5256d91808b47c195bc9b4dbd7f2b87 [term 23 FOLLOWER]: Leader election won for term 23
I20260709 13:07:08.792017 25530 raft_consensus.cc:515] T 0e1085d23e8347fbbd5bce7542f4b1f4 P 0473d2b2d01f4459b1e90fd12cc7840e [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:07:08.801026 25982 raft_consensus.cc:493] T 172b3dd13109415a955b71ac0e9d2234 P e5256d91808b47c195bc9b4dbd7f2b87 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 0473d2b2d01f4459b1e90fd12cc7840e)
I20260709 13:07:08.780349 25587 raft_consensus.cc:493] T 86a6797bdfe94fa496c050ceae4bd0d9 P e5256d91808b47c195bc9b4dbd7f2b87 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 0473d2b2d01f4459b1e90fd12cc7840e)
I20260709 13:07:08.806751 25982 raft_consensus.cc:515] T 172b3dd13109415a955b71ac0e9d2234 P e5256d91808b47c195bc9b4dbd7f2b87 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:07:08.809227 25982 leader_election.cc:290] T 172b3dd13109415a955b71ac0e9d2234 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:07:08.805274 25925 raft_consensus.cc:697] T a08760e15aac4630a629431f56024dc8 P e5256d91808b47c195bc9b4dbd7f2b87 [term 23 LEADER]: Becoming Leader. State: Replica: e5256d91808b47c195bc9b4dbd7f2b87, State: Running, Role: LEADER
I20260709 13:07:08.810823 26067 consensus_queue.cc:1048] T 70797e5783b5454ab0d0eea663e791e3 P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:07:08.814595 25925 consensus_queue.cc:237] T a08760e15aac4630a629431f56024dc8 P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 21.12, Last appended by leader: 12, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:07:08.817974 19554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b08304a0a02b42d7840c4e8ee9a6bd1a" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:07:08.818962 19554 raft_consensus.cc:2468] T b08304a0a02b42d7840c4e8ee9a6bd1a P e61c3a8f61bb48f8a963c9480e53c168 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 19.
I20260709 13:07:08.821919 19552 raft_consensus.cc:2468] T fa8650e71aa14778b3d73721fc50d9fc P e61c3a8f61bb48f8a963c9480e53c168 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 19.
W20260709 13:07:08.823307 26018 log.cc:927] Time spent T d1e5873a19244c5ebbcd38e126796ee7 P e61c3a8f61bb48f8a963c9480e53c168: Append to log took a long time: real 0.088s	user 0.000s	sys 0.001s
W20260709 13:07:08.826849 19525 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:08.827518 25997 raft_consensus.cc:3060] T 217b5fae677b4971b3bbd2f357a1f7ff P e5256d91808b47c195bc9b4dbd7f2b87 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:07:08.828716 25851 raft_consensus.cc:3060] T 1dc5b3532fe54f74876d02beffa2c230 P e61c3a8f61bb48f8a963c9480e53c168 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:07:08.830856 19553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df751f992649444090e27965eb1af85d" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 23 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:07:08.832149 25908 leader_election.cc:290] T 0e1085d23e8347fbbd5bce7542f4b1f4 P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:07:08.833993 19556 raft_consensus.cc:1240] T a08760e15aac4630a629431f56024dc8 P e61c3a8f61bb48f8a963c9480e53c168 [term 23 FOLLOWER]: Rejecting Update request from peer 0473d2b2d01f4459b1e90fd12cc7840e for earlier term 22. Current term is 23. Ops: [22.13-22.13]
I20260709 13:07:08.834506 26044 leader_election.cc:290] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:07:08.835974 25923 leader_election.cc:290] T 5ec1c4ce15e04c7e8c283a62179f2a64 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:07:08.842984 19377 leader_election.cc:304] T 1dc5b3532fe54f74876d02beffa2c230 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:07:08.843027 26059 consensus_queue.cc:1048] T 0e1085d23e8347fbbd5bce7542f4b1f4 P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:07:08.844937 19377 leader_election.cc:304] T 21e14947d70440f19044d8f75c31e1f9 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:07:08.846032 26067 raft_consensus.cc:2749] T 1dc5b3532fe54f74876d02beffa2c230 P e5256d91808b47c195bc9b4dbd7f2b87 [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 13:07:08.846853 26067 raft_consensus.cc:2749] T 21e14947d70440f19044d8f75c31e1f9 P e5256d91808b47c195bc9b4dbd7f2b87 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:07:08.847088 19556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa8650e71aa14778b3d73721fc50d9fc" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:07:08.847204 20109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7be9efa6559648dbb5a0f7684c4542d1" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 21 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:07:08.847913 19556 raft_consensus.cc:2393] T fa8650e71aa14778b3d73721fc50d9fc P e61c3a8f61bb48f8a963c9480e53c168 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0473d2b2d01f4459b1e90fd12cc7840e in current term 19: Already voted for candidate e61c3a8f61bb48f8a963c9480e53c168 in this term.
I20260709 13:07:08.848673 19523 leader_election.cc:304] T f1b10566f45d4a7d9029858330e02d5b P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e61c3a8f61bb48f8a963c9480e53c168; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:07:08.848872 19556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc225c93219c45538b53a1bd3d387e4d" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:07:08.849710 19556 raft_consensus.cc:2468] T bc225c93219c45538b53a1bd3d387e4d P e61c3a8f61bb48f8a963c9480e53c168 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 16.
I20260709 13:07:08.849486 26059 consensus_queue.cc:1048] T ed7fdbcb96d14d418db9ca90a792588a P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:07:08.850294 25928 raft_consensus.cc:2749] T f1b10566f45d4a7d9029858330e02d5b P e61c3a8f61bb48f8a963c9480e53c168 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 13:07:08.859001 20078 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.2:46257, user_credentials={real_user=slave}} blocked reactor thread for 63748.2us
I20260709 13:07:08.862064 25918 raft_consensus.cc:493] T 1efebf73c86e432baa55533136b6e12c P 127766fc592545a4997f7790f50f6076 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:08.862128 20078 leader_election.cc:304] T ed7fdbcb96d14d418db9ca90a792588a P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, 127766fc592545a4997f7790f50f6076; no voters: 
I20260709 13:07:08.862582 25905 consensus_queue.cc:1048] T ab43d85f64114d4ebf618930e43d9ed0 P 127766fc592545a4997f7790f50f6076 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:07:08.862833 25918 raft_consensus.cc:515] T 1efebf73c86e432baa55533136b6e12c P 127766fc592545a4997f7790f50f6076 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:07:08.863008 25587 raft_consensus.cc:515] T 86a6797bdfe94fa496c050ceae4bd0d9 P e5256d91808b47c195bc9b4dbd7f2b87 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:07:08.846657 19377 leader_election.cc:304] T e381f1d6b8184797ad142de49be225a8 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:07:08.872051 19486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62c6c134d3d24a1ab144dd9ee6bc3f64" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:07:08.872319 25865 leader_election.cc:290] T 76cb037fc9064d13b59a8969d897ce8c P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:07:08.878700 25587 leader_election.cc:290] T 86a6797bdfe94fa496c050ceae4bd0d9 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:07:08.880316 19557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "179fd671030940b4b4a4e24bcc4aba0a" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 22 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:07:08.881213 19557 raft_consensus.cc:2468] T 179fd671030940b4b4a4e24bcc4aba0a P e61c3a8f61bb48f8a963c9480e53c168 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 21.
I20260709 13:07:08.882156 19557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f575b143b844aa096b50997dad3516a" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 17 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:07:08.883805 25747 raft_consensus.cc:3055] T 4509b76741dc428e9201c70c1658da13 P e61c3a8f61bb48f8a963c9480e53c168 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:07:08.884249 25747 raft_consensus.cc:740] T 4509b76741dc428e9201c70c1658da13 P e61c3a8f61bb48f8a963c9480e53c168 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: e61c3a8f61bb48f8a963c9480e53c168, State: Running, Role: LEADER
I20260709 13:07:08.885301 25747 consensus_queue.cc:260] T 4509b76741dc428e9201c70c1658da13 P e61c3a8f61bb48f8a963c9480e53c168 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:07:08.888312 25984 leader_election.cc:290] T ff9b0eddd810459b82d91c60777c10eb P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
W20260709 13:07:08.836000 19449 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.1:40321, user_credentials={real_user=slave}} blocked reactor thread for 451356us
I20260709 13:07:08.892457 25918 leader_election.cc:290] T 1efebf73c86e432baa55533136b6e12c P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:07:08.893676 19486 raft_consensus.cc:3060] T 62c6c134d3d24a1ab144dd9ee6bc3f64 P 0473d2b2d01f4459b1e90fd12cc7840e [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:07:08.894798 19374 leader_election.cc:304] T 2a16f7501e2444fb86d4e2778e734e02 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87; no voters: 127766fc592545a4997f7790f50f6076, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:07:08.895128 19526 leader_election.cc:304] T b08304a0a02b42d7840c4e8ee9a6bd1a P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168; no voters: e5256d91808b47c195bc9b4dbd7f2b87
W20260709 13:07:08.895772 19374 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.4:43121, user_credentials={real_user=slave}} blocked reactor thread for 95637us
I20260709 13:07:08.896917 19526 leader_election.cc:304] T 22196caba61445d3bec98a0aab3c337d P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:07:08.870115 25530 leader_election.cc:290] T 0e1085d23e8347fbbd5bce7542f4b1f4 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:07:08.899039 26061 consensus_queue.cc:1048] T 46c5bfeecc314717bffe987e6844b6d0 P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:07:08.900719 26061 raft_consensus.cc:2804] T 22196caba61445d3bec98a0aab3c337d P e61c3a8f61bb48f8a963c9480e53c168 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:07:08.901170 26061 raft_consensus.cc:697] T 22196caba61445d3bec98a0aab3c337d P e61c3a8f61bb48f8a963c9480e53c168 [term 19 LEADER]: Becoming Leader. State: Replica: e61c3a8f61bb48f8a963c9480e53c168, State: Running, Role: LEADER
I20260709 13:07:08.847993 20109 raft_consensus.cc:2468] T 7be9efa6559648dbb5a0f7684c4542d1 P 127766fc592545a4997f7790f50f6076 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 20.
I20260709 13:07:08.898291 26059 raft_consensus.cc:2804] T b08304a0a02b42d7840c4e8ee9a6bd1a P e61c3a8f61bb48f8a963c9480e53c168 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:07:08.906589 20105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "172b3dd13109415a955b71ac0e9d2234" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:07:08.909394 19402 raft_consensus.cc:1275] T df751f992649444090e27965eb1af85d P e5256d91808b47c195bc9b4dbd7f2b87 [term 22 FOLLOWER]: Refusing update from remote peer 0473d2b2d01f4459b1e90fd12cc7840e: Log matching property violated. Preceding OpId in replica: term: 20 index: 13. Preceding OpId from leader: term: 22 index: 14. (index mismatch)
I20260709 13:07:08.910028 19411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f575b143b844aa096b50997dad3516a" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 17 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
I20260709 13:07:08.910730 26001 raft_consensus.cc:3055] T 4af19371ea874c09a0a2147040835cbb P e5256d91808b47c195bc9b4dbd7f2b87 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:07:08.911187 26001 raft_consensus.cc:740] T 4af19371ea874c09a0a2147040835cbb P e5256d91808b47c195bc9b4dbd7f2b87 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: e5256d91808b47c195bc9b4dbd7f2b87, State: Running, Role: LEADER
I20260709 13:07:08.912386 19409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc225c93219c45538b53a1bd3d387e4d" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:07:08.913162 19409 raft_consensus.cc:2468] T bc225c93219c45538b53a1bd3d387e4d P e5256d91808b47c195bc9b4dbd7f2b87 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 16.
I20260709 13:07:08.914170 19408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40e1e16737a842ee936002830f36882e" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:07:08.914965 26059 raft_consensus.cc:493] T b08304a0a02b42d7840c4e8ee9a6bd1a P e61c3a8f61bb48f8a963c9480e53c168 [term 19 FOLLOWER]: Starting leader election (detected failure of leader 0473d2b2d01f4459b1e90fd12cc7840e)
I20260709 13:07:08.915588 26059 raft_consensus.cc:3060] T b08304a0a02b42d7840c4e8ee9a6bd1a P e61c3a8f61bb48f8a963c9480e53c168 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:07:08.912398 26001 consensus_queue.cc:260] T 4af19371ea874c09a0a2147040835cbb P e5256d91808b47c195bc9b4dbd7f2b87 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:07:08.904273 25587 raft_consensus.cc:2749] T 2a16f7501e2444fb86d4e2778e734e02 P e5256d91808b47c195bc9b4dbd7f2b87 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:07:08.920233 19403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36f6ba92b9ba46babe4ebd6c02e5fbd9" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:07:08.931131 19486 raft_consensus.cc:2468] T 62c6c134d3d24a1ab144dd9ee6bc3f64 P 0473d2b2d01f4459b1e90fd12cc7840e [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 127766fc592545a4997f7790f50f6076 in term 18.
I20260709 13:07:08.936825 20109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ec1c4ce15e04c7e8c283a62179f2a64" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:07:08.937109 19403 raft_consensus.cc:2468] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P e5256d91808b47c195bc9b4dbd7f2b87 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 127766fc592545a4997f7790f50f6076 in term 20.
I20260709 13:07:08.936753 19484 raft_consensus.cc:2468] T 14935b3ddf914369822e4a0547aaa355 P 0473d2b2d01f4459b1e90fd12cc7840e [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 127766fc592545a4997f7790f50f6076 in term 14.
I20260709 13:07:08.938608 20075 leader_election.cc:304] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 127766fc592545a4997f7790f50f6076, e5256d91808b47c195bc9b4dbd7f2b87; no voters: 
W20260709 13:07:08.941522 20078 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.2:46257, user_credentials={real_user=slave}} blocked reactor thread for 79550.1us
I20260709 13:07:08.942716 19556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a61655d99124a29b486ba4a5b37faea" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:07:08.945366 25918 raft_consensus.cc:2804] T ed7fdbcb96d14d418db9ca90a792588a P 127766fc592545a4997f7790f50f6076 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:07:08.945953 25918 raft_consensus.cc:493] T ed7fdbcb96d14d418db9ca90a792588a P 127766fc592545a4997f7790f50f6076 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:08.946429 25918 raft_consensus.cc:3060] T ed7fdbcb96d14d418db9ca90a792588a P 127766fc592545a4997f7790f50f6076 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:07:08.946889 25998 raft_consensus.cc:2749] T e381f1d6b8184797ad142de49be225a8 P e5256d91808b47c195bc9b4dbd7f2b87 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
W20260709 13:07:08.947821 19377 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.2:46257, user_credentials={real_user=slave}} blocked reactor thread for 101266us
I20260709 13:07:08.950018 19377 leader_election.cc:304] T 2e36a9d6e29c4a7c860cf267efbd4c74 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168
W20260709 13:07:08.951409 25946 consensus_meta.cc:287] T 5ec1c4ce15e04c7e8c283a62179f2a64 P 127766fc592545a4997f7790f50f6076: Time spent flushing consensus metadata: real 0.583s	user 0.008s	sys 0.004s
I20260709 13:07:08.952355 25920 leader_election.cc:290] T 14935b3ddf914369822e4a0547aaa355 P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 14 election: Requested vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:07:08.952669 20112 raft_consensus.cc:1275] T 5ec1c4ce15e04c7e8c283a62179f2a64 P 127766fc592545a4997f7790f50f6076 [term 13 FOLLOWER]: Refusing update from remote peer 0473d2b2d01f4459b1e90fd12cc7840e: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 13:07:08.955060 25917 raft_consensus.cc:493] T 5ec1c4ce15e04c7e8c283a62179f2a64 P 127766fc592545a4997f7790f50f6076 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:08.955536 25917 raft_consensus.cc:515] T 5ec1c4ce15e04c7e8c283a62179f2a64 P 127766fc592545a4997f7790f50f6076 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:07:08.956283 19560 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40438 (request call id 3143) took 1465 ms. Trace:
I20260709 13:07:08.956671 19560 rpcz_store.cc:276] 0709 13:07:07.490445 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:07.501239 (+ 10794us) service_pool.cc:224] Handling call
0709 13:07:07.503381 (+  2142us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:08.337290 (+833909us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:08.955845 (+618555us) spinlock_profiling.cc:243] Waited 790 ms on lock 0x7b5400309dd4. stack: 00007f4a79de9343 00007f4a79de9240 00007f4a797781d4 00007f4a834b6304 00007f4a834b6299 00007f4a7ce71571 00007f4a7cf08e01 00007f4a7cf0783e 00007f4a81ecc419 00007f4a7b443bd4 00007f4a7b443b62 00007f4a7b443a91 00007f4a7b443a0c 00007f4a7b442cc2 00007f4a7b24348c 00007f4a7b2428c6
0709 13:07:08.956096 (+   251us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1817682688}
I20260709 13:07:08.958091 19560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40e1e16737a842ee936002830f36882e" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:07:08.959169 25747 raft_consensus.cc:3060] T 4509b76741dc428e9201c70c1658da13 P e61c3a8f61bb48f8a963c9480e53c168 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:07:08.927695 25923 raft_consensus.cc:493] T 40e1e16737a842ee936002830f36882e P e5256d91808b47c195bc9b4dbd7f2b87 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader e61c3a8f61bb48f8a963c9480e53c168)
I20260709 13:07:08.968531 25923 raft_consensus.cc:515] T 40e1e16737a842ee936002830f36882e P e5256d91808b47c195bc9b4dbd7f2b87 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:07:08.970842 19486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b08304a0a02b42d7840c4e8ee9a6bd1a" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:07:08.971356 26001 raft_consensus.cc:3060] T 4af19371ea874c09a0a2147040835cbb P e5256d91808b47c195bc9b4dbd7f2b87 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:08.970842 19408 raft_consensus.cc:2468] T 40e1e16737a842ee936002830f36882e P e5256d91808b47c195bc9b4dbd7f2b87 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 20.
I20260709 13:07:08.976596 19484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df751f992649444090e27965eb1af85d" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 23 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:07:08.977773 19523 leader_election.cc:400] T a08760e15aac4630a629431f56024dc8 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 22 pre-election: Vote denied by peer e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321) with higher term. Message: Invalid argument: T a08760e15aac4630a629431f56024dc8 P e5256d91808b47c195bc9b4dbd7f2b87 [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e61c3a8f61bb48f8a963c9480e53c168 for earlier term 22. Current term is 23.
I20260709 13:07:08.978101 19523 leader_election.cc:403] T a08760e15aac4630a629431f56024dc8 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 22 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:07:08.971606 19486 raft_consensus.cc:2468] T b08304a0a02b42d7840c4e8ee9a6bd1a P 0473d2b2d01f4459b1e90fd12cc7840e [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 20.
I20260709 13:07:08.938555 26061 consensus_queue.cc:237] T 22196caba61445d3bec98a0aab3c337d P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.11, Last appended by leader: 11, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:07:08.992596 19557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76cb037fc9064d13b59a8969d897ce8c" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 19 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:07:08.980005 26044 raft_consensus.cc:2804] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P 127766fc592545a4997f7790f50f6076 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:07:08.993181 19479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa8650e71aa14778b3d73721fc50d9fc" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:07:08.997143 19486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96efeaaf1057492490e9a621f37e1a2d" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:07:08.964895 25918 raft_consensus.cc:515] T ed7fdbcb96d14d418db9ca90a792588a P 127766fc592545a4997f7790f50f6076 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:07:09.000100 19484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36f6ba92b9ba46babe4ebd6c02e5fbd9" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
W20260709 13:07:09.003177 19377 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.2:46257, user_credentials={real_user=slave}} blocked reactor thread for 53234us
I20260709 13:07:08.988276 25998 raft_consensus.cc:2749] T 2e36a9d6e29c4a7c860cf267efbd4c74 P e5256d91808b47c195bc9b4dbd7f2b87 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:07:08.989948 26036 raft_consensus.cc:2749] T a08760e15aac4630a629431f56024dc8 P e61c3a8f61bb48f8a963c9480e53c168 [term 23 FOLLOWER]: Leader pre-election lost for term 22. Reason: Vote denied by peer e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321) with higher term. Message: Invalid argument: T a08760e15aac4630a629431f56024dc8 P e5256d91808b47c195bc9b4dbd7f2b87 [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e61c3a8f61bb48f8a963c9480e53c168 for earlier term 22. Current term is 23.
I20260709 13:07:09.005635 19479 raft_consensus.cc:2468] T fa8650e71aa14778b3d73721fc50d9fc P 0473d2b2d01f4459b1e90fd12cc7840e [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 18.
I20260709 13:07:09.004832 20078 leader_election.cc:304] T 309c3ca0ca4b4f3ba129752ea2cb293b P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 127766fc592545a4997f7790f50f6076; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:07:09.011264 25917 leader_election.cc:290] T 5ec1c4ce15e04c7e8c283a62179f2a64 P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
W20260709 13:07:09.024966 26031 log.cc:927] Time spent T 7be9efa6559648dbb5a0f7684c4542d1 P e61c3a8f61bb48f8a963c9480e53c168: Append to log took a long time: real 0.865s	user 0.017s	sys 0.000s
I20260709 13:07:08.994661 26044 raft_consensus.cc:493] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P 127766fc592545a4997f7790f50f6076 [term 20 FOLLOWER]: Starting leader election (detected failure of leader 0473d2b2d01f4459b1e90fd12cc7840e)
I20260709 13:07:08.999966 25923 leader_election.cc:290] T 40e1e16737a842ee936002830f36882e P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:07:09.038419 19485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7be9efa6559648dbb5a0f7684c4542d1" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 21 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:07:09.039302 26059 raft_consensus.cc:515] T b08304a0a02b42d7840c4e8ee9a6bd1a P e61c3a8f61bb48f8a963c9480e53c168 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:07:09.039800 19485 raft_consensus.cc:2468] T 7be9efa6559648dbb5a0f7684c4542d1 P 0473d2b2d01f4459b1e90fd12cc7840e [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 20.
I20260709 13:07:09.040756 19483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e1085d23e8347fbbd5bce7542f4b1f4" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 16 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:07:09.041373 19483 raft_consensus.cc:2468] T 0e1085d23e8347fbbd5bce7542f4b1f4 P 0473d2b2d01f4459b1e90fd12cc7840e [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 127766fc592545a4997f7790f50f6076 in term 15.
I20260709 13:07:09.042169 25832 raft_consensus.cc:493] T 46c5bfeecc314717bffe987e6844b6d0 P 0473d2b2d01f4459b1e90fd12cc7840e [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:09.042927 25832 raft_consensus.cc:515] T 46c5bfeecc314717bffe987e6844b6d0 P 0473d2b2d01f4459b1e90fd12cc7840e [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
W20260709 13:07:09.047219 19523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.1:40321, user_credentials={real_user=slave}} blocked reactor thread for 172104us
I20260709 13:07:09.049825 19409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ec1c4ce15e04c7e8c283a62179f2a64" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:07:09.050889 19409 raft_consensus.cc:2468] T 5ec1c4ce15e04c7e8c283a62179f2a64 P e5256d91808b47c195bc9b4dbd7f2b87 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 127766fc592545a4997f7790f50f6076 in term 13.
I20260709 13:07:09.051149 19481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96efeaaf1057492490e9a621f37e1a2d" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:07:09.052552 19481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edd7d470b5014c9489be7f41f64355c9" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 23 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:07:09.052757 19484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1efebf73c86e432baa55533136b6e12c" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:07:09.053040 19482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa8650e71aa14778b3d73721fc50d9fc" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:07:09.032176 20107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff9b0eddd810459b82d91c60777c10eb" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 20 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:07:09.053681 19482 raft_consensus.cc:2468] T fa8650e71aa14778b3d73721fc50d9fc P 0473d2b2d01f4459b1e90fd12cc7840e [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 18.
I20260709 13:07:09.054174 19407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc225c93219c45538b53a1bd3d387e4d" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
I20260709 13:07:09.054553 19482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76cb037fc9064d13b59a8969d897ce8c" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 19 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:07:09.055203 19407 raft_consensus.cc:2393] T bc225c93219c45538b53a1bd3d387e4d P e5256d91808b47c195bc9b4dbd7f2b87 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate e61c3a8f61bb48f8a963c9480e53c168 in current term 16: Already voted for candidate e5256d91808b47c195bc9b4dbd7f2b87 in this term.
I20260709 13:07:09.055248 19482 raft_consensus.cc:2468] T 76cb037fc9064d13b59a8969d897ce8c P 0473d2b2d01f4459b1e90fd12cc7840e [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 18.
I20260709 13:07:09.055981 25977 leader_election.cc:290] T 96efeaaf1057492490e9a621f37e1a2d P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:07:09.056558 19555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1b10566f45d4a7d9029858330e02d5b" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:07:09.057196 19555 raft_consensus.cc:3060] T f1b10566f45d4a7d9029858330e02d5b P e61c3a8f61bb48f8a963c9480e53c168 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:07:09.053681 19484 raft_consensus.cc:2468] T 1efebf73c86e432baa55533136b6e12c P 0473d2b2d01f4459b1e90fd12cc7840e [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 15.
I20260709 13:07:09.058521 19480 raft_consensus.cc:1275] T 7be9efa6559648dbb5a0f7684c4542d1 P 0473d2b2d01f4459b1e90fd12cc7840e [term 20 FOLLOWER]: Refusing update from remote peer e61c3a8f61bb48f8a963c9480e53c168: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 20 index: 12. (index mismatch)
I20260709 13:07:09.061007 19557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e1085d23e8347fbbd5bce7542f4b1f4" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 16 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:07:09.060309 19477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86a6797bdfe94fa496c050ceae4bd0d9" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:07:09.034427 26044 raft_consensus.cc:3060] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P 127766fc592545a4997f7790f50f6076 [term 20 FOLLOWER]: Advancing to term 21
W20260709 13:07:09.065037 20078 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.2:46257, user_credentials={real_user=slave}} blocked reactor thread for 63921.2us
I20260709 13:07:09.069226 25905 raft_consensus.cc:2749] T 309c3ca0ca4b4f3ba129752ea2cb293b P 127766fc592545a4997f7790f50f6076 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:07:09.080466 19377 leader_election.cc:304] T b08304a0a02b42d7840c4e8ee9a6bd1a P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87; no voters: 
I20260709 13:07:09.081939 25998 consensus_queue.cc:1048] T 76cb037fc9064d13b59a8969d897ce8c P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:07:09.082952 26069 consensus_queue.cc:1059] T 7f575b143b844aa096b50997dad3516a P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 }, Status: INVALID_TERM, Last received: 14.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:07:09.083868 26065 raft_consensus.cc:2804] T b08304a0a02b42d7840c4e8ee9a6bd1a P e5256d91808b47c195bc9b4dbd7f2b87 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:07:09.084465 26065 raft_consensus.cc:493] T b08304a0a02b42d7840c4e8ee9a6bd1a P e5256d91808b47c195bc9b4dbd7f2b87 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:09.085011 26065 raft_consensus.cc:3060] T b08304a0a02b42d7840c4e8ee9a6bd1a P e5256d91808b47c195bc9b4dbd7f2b87 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:07:09.075047 25819 raft_consensus.cc:515] T 179fd671030940b4b4a4e24bcc4aba0a P e5256d91808b47c195bc9b4dbd7f2b87 [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:07:09.089389 25819 leader_election.cc:290] T 179fd671030940b4b4a4e24bcc4aba0a P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 22 election: Requested vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:07:09.090571 20078 leader_election.cc:304] T 62c6c134d3d24a1ab144dd9ee6bc3f64 P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, 127766fc592545a4997f7790f50f6076; no voters: 
I20260709 13:07:09.091205 19486 raft_consensus.cc:2393] T 96efeaaf1057492490e9a621f37e1a2d P 0473d2b2d01f4459b1e90fd12cc7840e [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 127766fc592545a4997f7790f50f6076 in current term 20: Already voted for candidate 0473d2b2d01f4459b1e90fd12cc7840e in this term.
I20260709 13:07:09.091585 20078 leader_election.cc:304] T 14935b3ddf914369822e4a0547aaa355 P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, 127766fc592545a4997f7790f50f6076; no voters: 
I20260709 13:07:09.094440 19450 leader_election.cc:304] T bc225c93219c45538b53a1bd3d387e4d P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:07:09.094849 25871 consensus_queue.cc:1059] T a08760e15aac4630a629431f56024dc8 P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 }, Status: INVALID_TERM, Last received: 21.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:07:09.095593 19450 leader_election.cc:304] T 179fd671030940b4b4a4e24bcc4aba0a P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:07:09.095736 25977 raft_consensus.cc:2804] T bc225c93219c45538b53a1bd3d387e4d P 0473d2b2d01f4459b1e90fd12cc7840e [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:07:09.096143 25977 raft_consensus.cc:493] T bc225c93219c45538b53a1bd3d387e4d P 0473d2b2d01f4459b1e90fd12cc7840e [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:09.096489 25977 raft_consensus.cc:3060] T bc225c93219c45538b53a1bd3d387e4d P 0473d2b2d01f4459b1e90fd12cc7840e [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:07:09.054121 20107 raft_consensus.cc:2468] T ff9b0eddd810459b82d91c60777c10eb P 127766fc592545a4997f7790f50f6076 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 19.
I20260709 13:07:09.053297 19481 raft_consensus.cc:2393] T edd7d470b5014c9489be7f41f64355c9 P 0473d2b2d01f4459b1e90fd12cc7840e [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate e61c3a8f61bb48f8a963c9480e53c168 in current term 23: Already voted for candidate 0473d2b2d01f4459b1e90fd12cc7840e in this term.
I20260709 13:07:09.099428 20075 leader_election.cc:304] T 5ec1c4ce15e04c7e8c283a62179f2a64 P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 127766fc592545a4997f7790f50f6076, e5256d91808b47c195bc9b4dbd7f2b87; no voters: 
I20260709 13:07:09.105943 19556 raft_consensus.cc:2468] T 1a61655d99124a29b486ba4a5b37faea P e61c3a8f61bb48f8a963c9480e53c168 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 18.
I20260709 13:07:09.107301 19375 leader_election.cc:304] T fa8650e71aa14778b3d73721fc50d9fc P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:07:09.084170 26069 raft_consensus.cc:3055] T 7f575b143b844aa096b50997dad3516a P e5256d91808b47c195bc9b4dbd7f2b87 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:07:09.109705 19374 leader_election.cc:304] T ff9b0eddd810459b82d91c60777c10eb P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 127766fc592545a4997f7790f50f6076, e5256d91808b47c195bc9b4dbd7f2b87; no voters: 
I20260709 13:07:09.115444 25918 leader_election.cc:290] T ed7fdbcb96d14d418db9ca90a792588a P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 17 election: Requested vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:07:09.119969 25819 raft_consensus.cc:2804] T ff9b0eddd810459b82d91c60777c10eb P e5256d91808b47c195bc9b4dbd7f2b87 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:07:09.120611 25819 raft_consensus.cc:493] T ff9b0eddd810459b82d91c60777c10eb P e5256d91808b47c195bc9b4dbd7f2b87 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:09.121042 25819 raft_consensus.cc:3060] T ff9b0eddd810459b82d91c60777c10eb P e5256d91808b47c195bc9b4dbd7f2b87 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:07:09.107342 25998 raft_consensus.cc:493] T 46c5bfeecc314717bffe987e6844b6d0 P e5256d91808b47c195bc9b4dbd7f2b87 [term 25 FOLLOWER]: Starting pre-election (detected failure of leader e61c3a8f61bb48f8a963c9480e53c168)
I20260709 13:07:09.122890 25998 raft_consensus.cc:515] T 46c5bfeecc314717bffe987e6844b6d0 P e5256d91808b47c195bc9b4dbd7f2b87 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:07:09.123768 25920 raft_consensus.cc:2804] T 62c6c134d3d24a1ab144dd9ee6bc3f64 P 127766fc592545a4997f7790f50f6076 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:07:09.095919 25871 raft_consensus.cc:3055] T a08760e15aac4630a629431f56024dc8 P 0473d2b2d01f4459b1e90fd12cc7840e [term 22 LEADER]: Stepping down as leader of term 22
I20260709 13:07:09.124531 25871 raft_consensus.cc:740] T a08760e15aac4630a629431f56024dc8 P 0473d2b2d01f4459b1e90fd12cc7840e [term 22 LEADER]: Becoming Follower/Learner. State: Replica: 0473d2b2d01f4459b1e90fd12cc7840e, State: Running, Role: LEADER
I20260709 13:07:09.094914 26073 raft_consensus.cc:493] T 3e1f505cb0f1427bbd698ac889d80821 P e5256d91808b47c195bc9b4dbd7f2b87 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader e61c3a8f61bb48f8a963c9480e53c168)
I20260709 13:07:09.125453 25871 consensus_queue.cc:260] T a08760e15aac4630a629431f56024dc8 P 0473d2b2d01f4459b1e90fd12cc7840e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 22.13, Last appended by leader: 13, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:07:09.126230 26073 raft_consensus.cc:515] T 3e1f505cb0f1427bbd698ac889d80821 P e5256d91808b47c195bc9b4dbd7f2b87 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:07:09.126819 25957 raft_consensus.cc:2804] T 179fd671030940b4b4a4e24bcc4aba0a P 0473d2b2d01f4459b1e90fd12cc7840e [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:07:09.127347 25957 raft_consensus.cc:493] T 179fd671030940b4b4a4e24bcc4aba0a P 0473d2b2d01f4459b1e90fd12cc7840e [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:09.127694 25957 raft_consensus.cc:3060] T 179fd671030940b4b4a4e24bcc4aba0a P 0473d2b2d01f4459b1e90fd12cc7840e [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:07:09.128489 26073 leader_election.cc:290] T 3e1f505cb0f1427bbd698ac889d80821 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:07:09.129555 20105 raft_consensus.cc:1240] T 833a2f0775ed407a94b8924ce50adb63 P 127766fc592545a4997f7790f50f6076 [term 15 FOLLOWER]: Rejecting Update request from peer e61c3a8f61bb48f8a963c9480e53c168 for earlier term 14. Current term is 15. Ops: []
I20260709 13:07:09.134135 25871 raft_consensus.cc:3060] T a08760e15aac4630a629431f56024dc8 P 0473d2b2d01f4459b1e90fd12cc7840e [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:07:09.137156 19486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1efebf73c86e432baa55533136b6e12c" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:07:09.137789 19486 raft_consensus.cc:2468] T 1efebf73c86e432baa55533136b6e12c P 0473d2b2d01f4459b1e90fd12cc7840e [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 127766fc592545a4997f7790f50f6076 in term 15.
I20260709 13:07:09.138815 25093 raft_consensus.cc:2804] T fa8650e71aa14778b3d73721fc50d9fc P e5256d91808b47c195bc9b4dbd7f2b87 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:07:09.139228 20105 raft_consensus.cc:3060] T 775c229504194560ba9589bc2199b089 P 127766fc592545a4997f7790f50f6076 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:07:09.140493 19375 leader_election.cc:304] T df751f992649444090e27965eb1af85d P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:07:09.139281 25093 raft_consensus.cc:493] T fa8650e71aa14778b3d73721fc50d9fc P e5256d91808b47c195bc9b4dbd7f2b87 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:09.142983 25093 raft_consensus.cc:3060] T fa8650e71aa14778b3d73721fc50d9fc P e5256d91808b47c195bc9b4dbd7f2b87 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:07:09.143096 25946 raft_consensus.cc:2804] T 14935b3ddf914369822e4a0547aaa355 P 127766fc592545a4997f7790f50f6076 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:07:09.143458 25587 raft_consensus.cc:2749] T df751f992649444090e27965eb1af85d P e5256d91808b47c195bc9b4dbd7f2b87 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:07:09.143659 25946 raft_consensus.cc:697] T 14935b3ddf914369822e4a0547aaa355 P 127766fc592545a4997f7790f50f6076 [term 14 LEADER]: Becoming Leader. State: Replica: 127766fc592545a4997f7790f50f6076, State: Running, Role: LEADER
I20260709 13:07:09.144798 25946 consensus_queue.cc:237] T 14935b3ddf914369822e4a0547aaa355 P 127766fc592545a4997f7790f50f6076 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
W20260709 13:07:09.145512 19374 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:09.150027 26065 raft_consensus.cc:515] T b08304a0a02b42d7840c4e8ee9a6bd1a P e5256d91808b47c195bc9b4dbd7f2b87 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:07:09.152040 26065 leader_election.cc:290] T b08304a0a02b42d7840c4e8ee9a6bd1a P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 21 election: Requested vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
W20260709 13:07:09.155345 25994 consensus_meta.cc:287] T 85c494af21f9457a85da47b9bc70c1fd P 127766fc592545a4997f7790f50f6076: Time spent flushing consensus metadata: real 0.636s	user 0.015s	sys 0.000s
I20260709 13:07:09.155855 25994 raft_consensus.cc:515] T 85c494af21f9457a85da47b9bc70c1fd P 127766fc592545a4997f7790f50f6076 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:07:09.157976 25994 leader_election.cc:290] T 85c494af21f9457a85da47b9bc70c1fd P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 18 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:07:09.163650 19485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ec1c4ce15e04c7e8c283a62179f2a64" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:07:09.165544 19555 raft_consensus.cc:2468] T f1b10566f45d4a7d9029858330e02d5b P e61c3a8f61bb48f8a963c9480e53c168 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 19.
I20260709 13:07:09.165776 25992 raft_consensus.cc:493] T edd7d470b5014c9489be7f41f64355c9 P e5256d91808b47c195bc9b4dbd7f2b87 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:09.167934 19449 leader_election.cc:304] T 21e14947d70440f19044d8f75c31e1f9 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e; no voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:07:09.174471 20105 raft_consensus.cc:1275] T 775c229504194560ba9589bc2199b089 P 127766fc592545a4997f7790f50f6076 [term 15 FOLLOWER]: Refusing update from remote peer e5256d91808b47c195bc9b4dbd7f2b87: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 13:07:09.125233 25998 leader_election.cc:290] T 46c5bfeecc314717bffe987e6844b6d0 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:07:09.170554 25093 raft_consensus.cc:515] T fa8650e71aa14778b3d73721fc50d9fc P e5256d91808b47c195bc9b4dbd7f2b87 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
W20260709 13:07:09.179965 20075 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.1:40321, user_credentials={real_user=slave}} blocked reactor thread for 80620.8us
I20260709 13:07:09.185647 19477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "172b3dd13109415a955b71ac0e9d2234" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
W20260709 13:07:09.188701 19375 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.3:36891, user_credentials={real_user=slave}} blocked reactor thread for 43849.4us
W20260709 13:07:09.192844 20076 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.3:36891, user_credentials={real_user=slave}} blocked reactor thread for 111448us
I20260709 13:07:09.178031 25957 raft_consensus.cc:515] T 179fd671030940b4b4a4e24bcc4aba0a P 0473d2b2d01f4459b1e90fd12cc7840e [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:07:09.199222 20106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e1085d23e8347fbbd5bce7542f4b1f4" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 16 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:07:09.200592 26073 raft_consensus.cc:493] T 833a2f0775ed407a94b8924ce50adb63 P e5256d91808b47c195bc9b4dbd7f2b87 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader e61c3a8f61bb48f8a963c9480e53c168)
I20260709 13:07:09.200935 25957 leader_election.cc:290] T 179fd671030940b4b4a4e24bcc4aba0a P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 22 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:07:09.201304 26073 raft_consensus.cc:515] T 833a2f0775ed407a94b8924ce50adb63 P e5256d91808b47c195bc9b4dbd7f2b87 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:07:09.201782 26065 consensus_queue.cc:1048] T 775c229504194560ba9589bc2199b089 P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Connected to new peer: Peer: permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:07:09.202855 19409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85c494af21f9457a85da47b9bc70c1fd" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
I20260709 13:07:09.203500 19409 raft_consensus.cc:3060] T 85c494af21f9457a85da47b9bc70c1fd P e5256d91808b47c195bc9b4dbd7f2b87 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:07:09.204021 19485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ec1c4ce15e04c7e8c283a62179f2a64" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
W20260709 13:07:09.205047 19451 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:09.205957 20111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "833a2f0775ed407a94b8924ce50adb63" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:07:09.206925 20111 raft_consensus.cc:2393] T 833a2f0775ed407a94b8924ce50adb63 P 127766fc592545a4997f7790f50f6076 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e5256d91808b47c195bc9b4dbd7f2b87 in current term 15: Already voted for candidate 127766fc592545a4997f7790f50f6076 in this term.
I20260709 13:07:09.219080 25992 raft_consensus.cc:515] T edd7d470b5014c9489be7f41f64355c9 P e5256d91808b47c195bc9b4dbd7f2b87 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:07:09.219671 19401 tablet_service.cc:1558] Processing DeleteTablet for tablet ab43d85f64114d4ebf618930e43d9ed0 with delete_type TABLET_DATA_TOMBSTONED (TS e5256d91808b47c195bc9b4dbd7f2b87 not found in new config with opid_index 9) from {username='slave'} at 127.0.0.1:41524
W20260709 13:07:09.221554 19526 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:09.221571 25992 leader_election.cc:290] T edd7d470b5014c9489be7f41f64355c9 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:07:09.222719 19377 leader_election.cc:304] T 7be9efa6559648dbb5a0f7684c4542d1 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, 127766fc592545a4997f7790f50f6076, e5256d91808b47c195bc9b4dbd7f2b87; no voters: e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:07:09.223140 19480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86a6797bdfe94fa496c050ceae4bd0d9" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:07:09.223567 25992 raft_consensus.cc:2804] T 7be9efa6559648dbb5a0f7684c4542d1 P e5256d91808b47c195bc9b4dbd7f2b87 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:07:09.203529 26073 leader_election.cc:290] T 833a2f0775ed407a94b8924ce50adb63 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:07:09.224030 25992 raft_consensus.cc:493] T 7be9efa6559648dbb5a0f7684c4542d1 P e5256d91808b47c195bc9b4dbd7f2b87 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:09.224530 25992 raft_consensus.cc:3060] T 7be9efa6559648dbb5a0f7684c4542d1 P e5256d91808b47c195bc9b4dbd7f2b87 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:07:09.180699 25994 raft_consensus.cc:2804] T 5ec1c4ce15e04c7e8c283a62179f2a64 P 127766fc592545a4997f7790f50f6076 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:07:09.226485 25994 raft_consensus.cc:493] T 5ec1c4ce15e04c7e8c283a62179f2a64 P 127766fc592545a4997f7790f50f6076 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:09.226897 25994 raft_consensus.cc:3060] T 5ec1c4ce15e04c7e8c283a62179f2a64 P 127766fc592545a4997f7790f50f6076 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:07:09.168322 25920 raft_consensus.cc:697] T 62c6c134d3d24a1ab144dd9ee6bc3f64 P 127766fc592545a4997f7790f50f6076 [term 18 LEADER]: Becoming Leader. State: Replica: 127766fc592545a4997f7790f50f6076, State: Running, Role: LEADER
I20260709 13:07:09.227674 19409 raft_consensus.cc:2468] T 85c494af21f9457a85da47b9bc70c1fd P e5256d91808b47c195bc9b4dbd7f2b87 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 127766fc592545a4997f7790f50f6076 in term 18.
I20260709 13:07:09.111327 26069 raft_consensus.cc:740] T 7f575b143b844aa096b50997dad3516a P e5256d91808b47c195bc9b4dbd7f2b87 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: e5256d91808b47c195bc9b4dbd7f2b87, State: Running, Role: LEADER
I20260709 13:07:09.233665 25819 raft_consensus.cc:515] T ff9b0eddd810459b82d91c60777c10eb P e5256d91808b47c195bc9b4dbd7f2b87 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:07:09.235229 25920 consensus_queue.cc:237] T 62c6c134d3d24a1ab144dd9ee6bc3f64 P 127766fc592545a4997f7790f50f6076 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.13, Last appended by leader: 13, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:07:09.236044 25819 leader_election.cc:290] T ff9b0eddd810459b82d91c60777c10eb P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 20 election: Requested vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:07:09.239638 20075 leader_election.cc:304] T 85c494af21f9457a85da47b9bc70c1fd P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 127766fc592545a4997f7790f50f6076, e5256d91808b47c195bc9b4dbd7f2b87; no voters: 
I20260709 13:07:09.246258 19480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff9b0eddd810459b82d91c60777c10eb" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 20 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:07:09.253103 25093 leader_election.cc:290] T fa8650e71aa14778b3d73721fc50d9fc P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 20 election: Requested vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:07:09.315858 19482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40e1e16737a842ee936002830f36882e" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:07:09.312589 20078 leader_election.cc:304] T 0e1085d23e8347fbbd5bce7542f4b1f4 P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, 127766fc592545a4997f7790f50f6076; no voters: 
W20260709 13:07:09.323938 19449 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.1:40321, user_credentials={real_user=slave}} blocked reactor thread for 156144us
I20260709 13:07:09.334622 19559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86a6797bdfe94fa496c050ceae4bd0d9" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:07:09.337352 19552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96efeaaf1057492490e9a621f37e1a2d" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:07:09.338280 19552 raft_consensus.cc:2468] T 96efeaaf1057492490e9a621f37e1a2d P e61c3a8f61bb48f8a963c9480e53c168 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 20.
I20260709 13:07:09.338778 25957 raft_consensus.cc:2749] T 21e14947d70440f19044d8f75c31e1f9 P 0473d2b2d01f4459b1e90fd12cc7840e [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
W20260709 13:07:09.342185 20075 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.1:40321, user_credentials={real_user=slave}} blocked reactor thread for 110004us
I20260709 13:07:09.316752 19482 raft_consensus.cc:2468] T 40e1e16737a842ee936002830f36882e P 0473d2b2d01f4459b1e90fd12cc7840e [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 20.
W20260709 13:07:09.342744 20076 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.3:36891, user_credentials={real_user=slave}} blocked reactor thread for 102009us
W20260709 13:07:09.366146 20078 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.2:46257, user_credentials={real_user=slave}} blocked reactor thread for 53638.8us
I20260709 13:07:09.370729 20109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff9b0eddd810459b82d91c60777c10eb" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 20 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076"
I20260709 13:07:09.371484 20109 raft_consensus.cc:3060] T ff9b0eddd810459b82d91c60777c10eb P 127766fc592545a4997f7790f50f6076 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:07:09.382522 20106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ece3db938bc649d4a40a51522ed5259c" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076"
I20260709 13:07:09.384920 25988 raft_consensus.cc:493] T f93ee515a9c14139bf566522ed8232f3 P e61c3a8f61bb48f8a963c9480e53c168 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 0473d2b2d01f4459b1e90fd12cc7840e)
I20260709 13:07:09.385187 19552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "179fd671030940b4b4a4e24bcc4aba0a" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 22 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:07:09.385823 19552 raft_consensus.cc:3060] T 179fd671030940b4b4a4e24bcc4aba0a P e61c3a8f61bb48f8a963c9480e53c168 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:07:09.385579 25988 raft_consensus.cc:515] T f93ee515a9c14139bf566522ed8232f3 P e61c3a8f61bb48f8a963c9480e53c168 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:07:09.387097 19558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40e1e16737a842ee936002830f36882e" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:07:09.387739 25988 leader_election.cc:290] T f93ee515a9c14139bf566522ed8232f3 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:07:09.388772 19551 raft_consensus.cc:1240] T f1b10566f45d4a7d9029858330e02d5b P e61c3a8f61bb48f8a963c9480e53c168 [term 19 FOLLOWER]: Rejecting Update request from peer 0473d2b2d01f4459b1e90fd12cc7840e for earlier term 18. Current term is 19. Ops: []
I20260709 13:07:09.366320 25908 raft_consensus.cc:2804] T 85c494af21f9457a85da47b9bc70c1fd P 127766fc592545a4997f7790f50f6076 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:07:09.388638 19559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46c5bfeecc314717bffe987e6844b6d0" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 26 candidate_status { last_received { term: 23 index: 12 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:07:09.390540 19480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "179fd671030940b4b4a4e24bcc4aba0a" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 22 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:07:09.391289 19480 raft_consensus.cc:2393] T 179fd671030940b4b4a4e24bcc4aba0a P 0473d2b2d01f4459b1e90fd12cc7840e [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate e5256d91808b47c195bc9b4dbd7f2b87 in current term 22: Already voted for candidate 0473d2b2d01f4459b1e90fd12cc7840e in this term.
I20260709 13:07:09.392488 19559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46c5bfeecc314717bffe987e6844b6d0" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 26 candidate_status { last_received { term: 23 index: 12 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:07:09.386436 25987 raft_consensus.cc:493] T ef32ce6fdd0e40d382c79974f30295c6 P 0473d2b2d01f4459b1e90fd12cc7840e [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:09.394626 19552 raft_consensus.cc:2468] T 179fd671030940b4b4a4e24bcc4aba0a P e61c3a8f61bb48f8a963c9480e53c168 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 22.
I20260709 13:07:09.340452 25925 raft_consensus.cc:493] T 28af091831594f9d8e96482078cc7625 P e5256d91808b47c195bc9b4dbd7f2b87 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 0473d2b2d01f4459b1e90fd12cc7840e)
I20260709 13:07:09.421507 19482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46c5bfeecc314717bffe987e6844b6d0" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 26 candidate_status { last_received { term: 23 index: 12 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:07:09.424022 20112 raft_consensus.cc:1275] T 7be9efa6559648dbb5a0f7684c4542d1 P 127766fc592545a4997f7790f50f6076 [term 20 FOLLOWER]: Refusing update from remote peer e61c3a8f61bb48f8a963c9480e53c168: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 20 index: 12. (index mismatch)
I20260709 13:07:09.423933 19552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e1f505cb0f1427bbd698ac889d80821" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:07:09.319723 25977 raft_consensus.cc:515] T bc225c93219c45538b53a1bd3d387e4d P 0473d2b2d01f4459b1e90fd12cc7840e [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:07:09.460227 19483 raft_consensus.cc:1240] T 7f575b143b844aa096b50997dad3516a P 0473d2b2d01f4459b1e90fd12cc7840e [term 17 FOLLOWER]: Rejecting Update request from peer e5256d91808b47c195bc9b4dbd7f2b87 for earlier term 16. Current term is 17. Ops: [16.11-16.11]
W20260709 13:07:09.464138 19449 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.1:40321, user_credentials={real_user=slave}} blocked reactor thread for 137712us
I20260709 13:07:09.473409 19559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b08304a0a02b42d7840c4e8ee9a6bd1a" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:07:09.477286 19559 raft_consensus.cc:3060] T b08304a0a02b42d7840c4e8ee9a6bd1a P e61c3a8f61bb48f8a963c9480e53c168 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:07:09.435565 19480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e1f505cb0f1427bbd698ac889d80821" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:07:09.424289 25905 raft_consensus.cc:2804] T 0e1085d23e8347fbbd5bce7542f4b1f4 P 127766fc592545a4997f7790f50f6076 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:07:09.480324 19482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b08304a0a02b42d7840c4e8ee9a6bd1a" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:07:09.481031 19482 raft_consensus.cc:3060] T b08304a0a02b42d7840c4e8ee9a6bd1a P 0473d2b2d01f4459b1e90fd12cc7840e [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:07:09.375614 26069 consensus_queue.cc:260] T 7f575b143b844aa096b50997dad3516a P e5256d91808b47c195bc9b4dbd7f2b87 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.11, Last appended by leader: 11, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:07:09.494518 19552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "833a2f0775ed407a94b8924ce50adb63" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:07:09.496554 19480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edd7d470b5014c9489be7f41f64355c9" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 24 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:07:09.427698 26033 consensus_queue.cc:1048] T ff9b0eddd810459b82d91c60777c10eb P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Connected to new peer: Peer: permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.322s
I20260709 13:07:09.427529 25987 raft_consensus.cc:515] T ef32ce6fdd0e40d382c79974f30295c6 P 0473d2b2d01f4459b1e90fd12cc7840e [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:07:09.494050 19449 leader_election.cc:304] T fa8650e71aa14778b3d73721fc50d9fc P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87; no voters: e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:07:09.491954 19485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa8650e71aa14778b3d73721fc50d9fc" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:07:09.482090 25871 raft_consensus.cc:493] T 775c229504194560ba9589bc2199b089 P 0473d2b2d01f4459b1e90fd12cc7840e [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:09.499037 19485 raft_consensus.cc:3060] T fa8650e71aa14778b3d73721fc50d9fc P 0473d2b2d01f4459b1e90fd12cc7840e [term 18 FOLLOWER]: Advancing to term 20
W20260709 13:07:09.478188 26078 log.cc:927] Time spent T df751f992649444090e27965eb1af85d P 0473d2b2d01f4459b1e90fd12cc7840e: Append to log took a long time: real 0.076s	user 0.000s	sys 0.001s
I20260709 13:07:09.532572 19556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edd7d470b5014c9489be7f41f64355c9" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 24 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:07:09.504177 19377 leader_election.cc:304] T 172b3dd13109415a955b71ac0e9d2234 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, 127766fc592545a4997f7790f50f6076
I20260709 13:07:09.533473 19484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff9b0eddd810459b82d91c60777c10eb" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 20 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:07:09.534574 19377 leader_election.cc:304] T 5ec1c4ce15e04c7e8c283a62179f2a64 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, 127766fc592545a4997f7790f50f6076
I20260709 13:07:09.500100 19480 raft_consensus.cc:2468] T edd7d470b5014c9489be7f41f64355c9 P 0473d2b2d01f4459b1e90fd12cc7840e [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 23.
I20260709 13:07:09.503923 20078 leader_election.cc:304] T 1efebf73c86e432baa55533136b6e12c P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, 127766fc592545a4997f7790f50f6076; no voters: 
W20260709 13:07:09.498440 26008 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.584s	user 0.019s	sys 0.053s
W20260709 13:07:09.541169 19449 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.1:40321, user_credentials={real_user=slave}} blocked reactor thread for 47242.6us
I20260709 13:07:09.547587 19556 raft_consensus.cc:2468] T edd7d470b5014c9489be7f41f64355c9 P e61c3a8f61bb48f8a963c9480e53c168 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 23.
I20260709 13:07:09.545993 19551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "179fd671030940b4b4a4e24bcc4aba0a" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 22 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:07:09.552987 20104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa731b585f684a7fb2d106c50f143b83" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 17 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:07:09.553555 19450 leader_election.cc:304] T 1a61655d99124a29b486ba4a5b37faea P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:07:09.554584 19551 raft_consensus.cc:2393] T 179fd671030940b4b4a4e24bcc4aba0a P e61c3a8f61bb48f8a963c9480e53c168 [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate 0473d2b2d01f4459b1e90fd12cc7840e in current term 22: Already voted for candidate e5256d91808b47c195bc9b4dbd7f2b87 in this term.
W20260709 13:07:09.544741 26008 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.823s	user 0.019s	sys 0.054s
I20260709 13:07:09.500110 25925 raft_consensus.cc:515] T 28af091831594f9d8e96482078cc7625 P e5256d91808b47c195bc9b4dbd7f2b87 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:07:09.549777 19377 leader_election.cc:304] T 40e1e16737a842ee936002830f36882e P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87; no voters: 
I20260709 13:07:09.539770 25819 raft_consensus.cc:2749] T 172b3dd13109415a955b71ac0e9d2234 P e5256d91808b47c195bc9b4dbd7f2b87 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:07:09.684319 19558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c5eebf646ad445a9d1b1adc319d7b16" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:07:09.562363 19484 raft_consensus.cc:1275] T ef32ce6fdd0e40d382c79974f30295c6 P 0473d2b2d01f4459b1e90fd12cc7840e [term 23 FOLLOWER]: Refusing update from remote peer e5256d91808b47c195bc9b4dbd7f2b87: Log matching property violated. Preceding OpId in replica: term: 20 index: 11. Preceding OpId from leader: term: 23 index: 13. (index mismatch)
I20260709 13:07:09.582413 19403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa8650e71aa14778b3d73721fc50d9fc" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:07:09.583009 19408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff75a1d4cb1f493db8f71ddc136ba9ab" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:07:09.652105 19402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ece3db938bc649d4a40a51522ed5259c" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
I20260709 13:07:09.683665 19554 raft_consensus.cc:1275] T ab43d85f64114d4ebf618930e43d9ed0 P e61c3a8f61bb48f8a963c9480e53c168 [term 21 FOLLOWER]: Refusing update from remote peer 127766fc592545a4997f7790f50f6076: Log matching property violated. Preceding OpId in replica: term: 19 index: 13. Preceding OpId from leader: term: 21 index: 14. (index mismatch)
W20260709 13:07:09.586942 19478 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58286 (request call id 2693) took 1316 ms (client timeout 1723 ms). Trace:
I20260709 13:07:09.672366 19556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "833a2f0775ed407a94b8924ce50adb63" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:07:09.647424 25093 raft_consensus.cc:493] T 4509b76741dc428e9201c70c1658da13 P e5256d91808b47c195bc9b4dbd7f2b87 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader e61c3a8f61bb48f8a963c9480e53c168)
W20260709 13:07:09.592062 20076 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.3:36891, user_credentials={real_user=slave}} blocked reactor thread for 97523.3us
I20260709 13:07:09.591468 19406 raft_consensus.cc:1240] T 1dc5b3532fe54f74876d02beffa2c230 P e5256d91808b47c195bc9b4dbd7f2b87 [term 21 FOLLOWER]: Rejecting Update request from peer e61c3a8f61bb48f8a963c9480e53c168 for earlier term 20. Current term is 21. Ops: [20.11-20.11]
I20260709 13:07:09.583098 19409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "217b5fae677b4971b3bbd2f357a1f7ff" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
I20260709 13:07:09.662220 19404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86a6797bdfe94fa496c050ceae4bd0d9" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:07:09.582163 19407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22196caba61445d3bec98a0aab3c337d" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
I20260709 13:07:09.733146 19403 raft_consensus.cc:2393] T fa8650e71aa14778b3d73721fc50d9fc P e5256d91808b47c195bc9b4dbd7f2b87 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e61c3a8f61bb48f8a963c9480e53c168 in current term 20: Already voted for candidate e5256d91808b47c195bc9b4dbd7f2b87 in this term.
I20260709 13:07:09.733306 19553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70797e5783b5454ab0d0eea663e791e3" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 23 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:07:09.670481 19551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62c6c134d3d24a1ab144dd9ee6bc3f64" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:07:09.623529 20109 raft_consensus.cc:2468] T ff9b0eddd810459b82d91c60777c10eb P 127766fc592545a4997f7790f50f6076 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 20.
W20260709 13:07:09.603232 19449 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.1:40321, user_credentials={real_user=slave}} blocked reactor thread for 47904.9us
I20260709 13:07:09.550161 25920 raft_consensus.cc:2804] T 1efebf73c86e432baa55533136b6e12c P 127766fc592545a4997f7790f50f6076 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:07:09.683221 19410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa731b585f684a7fb2d106c50f143b83" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 17 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:07:09.536697 25908 raft_consensus.cc:697] T 85c494af21f9457a85da47b9bc70c1fd P 127766fc592545a4997f7790f50f6076 [term 18 LEADER]: Becoming Leader. State: Replica: 127766fc592545a4997f7790f50f6076, State: Running, Role: LEADER
W20260709 13:07:09.576881 26050 log.cc:927] Time spent T 1dc5b3532fe54f74876d02beffa2c230 P e61c3a8f61bb48f8a963c9480e53c168: Append to log took a long time: real 1.035s	user 0.005s	sys 0.019s
I20260709 13:07:09.570710 20108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96efeaaf1057492490e9a621f37e1a2d" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:07:09.753548 19449 leader_election.cc:304] T ff75a1d4cb1f493db8f71ddc136ba9ab P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e; no voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168
W20260709 13:07:09.732435 19478 rpcz_store.cc:269] 0709 13:07:08.270379 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:08.271020 (+   641us) service_pool.cc:224] Handling call
0709 13:07:09.582609 (+1311589us) spinlock_profiling.cc:243] Waited 329 ms on lock 0x7b5400344254. stack: 00007f4a79de9343 00007f4a79de9240 00007f4a797781d4 00007f4a834b6304 00007f4a834b6299 00007f4a7ce71571 00007f4a7cf0c2fa 00007f4a81ecdb17 00007f4a7b4486d4 00007f4a7b448662 00007f4a7b448591 00007f4a7b44850c 00007f4a7b4477c2 00007f4a7b24348c 00007f4a7b2428c6 00007f4a7b24226f
0709 13:07:09.586853 (+  4244us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":755891456}
I20260709 13:07:09.593211 25905 raft_consensus.cc:493] T 0e1085d23e8347fbbd5bce7542f4b1f4 P 127766fc592545a4997f7790f50f6076 [term 15 FOLLOWER]: Starting leader election (detected failure of leader e61c3a8f61bb48f8a963c9480e53c168)
I20260709 13:07:09.587992 26065 raft_consensus.cc:493] T 2b74109013a140ada21feeef92d6f563 P e5256d91808b47c195bc9b4dbd7f2b87 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:09.559547 25964 consensus_queue.cc:1048] T ff9b0eddd810459b82d91c60777c10eb P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.197s
I20260709 13:07:09.734978 19404 raft_consensus.cc:2468] T 86a6797bdfe94fa496c050ceae4bd0d9 P e5256d91808b47c195bc9b4dbd7f2b87 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 15.
I20260709 13:07:09.552441 26001 raft_consensus.cc:2749] T 5ec1c4ce15e04c7e8c283a62179f2a64 P e5256d91808b47c195bc9b4dbd7f2b87 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:07:09.596613 20112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1efebf73c86e432baa55533136b6e12c" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:07:09.717100 19559 raft_consensus.cc:2468] T b08304a0a02b42d7840c4e8ee9a6bd1a P e61c3a8f61bb48f8a963c9480e53c168 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 21.
I20260709 13:07:09.573390 26035 raft_consensus.cc:493] T 62c6c134d3d24a1ab144dd9ee6bc3f64 P e61c3a8f61bb48f8a963c9480e53c168 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 127766fc592545a4997f7790f50f6076)
I20260709 13:07:09.483485 26044 raft_consensus.cc:515] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P 127766fc592545a4997f7790f50f6076 [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:07:09.775038 20107 raft_consensus.cc:1240] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P 127766fc592545a4997f7790f50f6076 [term 21 FOLLOWER]: Rejecting Update request from peer 0473d2b2d01f4459b1e90fd12cc7840e for earlier term 20. Current term is 21. Ops: []
I20260709 13:07:09.775676 19553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62c6c134d3d24a1ab144dd9ee6bc3f64" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:07:09.775876 19482 raft_consensus.cc:2468] T b08304a0a02b42d7840c4e8ee9a6bd1a P 0473d2b2d01f4459b1e90fd12cc7840e [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 21.
I20260709 13:07:09.558838 25871 raft_consensus.cc:515] T 775c229504194560ba9589bc2199b089 P 0473d2b2d01f4459b1e90fd12cc7840e [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
W20260709 13:07:09.737660 19377 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.2:46257, user_credentials={real_user=slave}} blocked reactor thread for 187955us
I20260709 13:07:09.752444 19405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edd7d470b5014c9489be7f41f64355c9" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 23 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
I20260709 13:07:09.756048 19402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76cb037fc9064d13b59a8969d897ce8c" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 19 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:07:09.721910 19485 raft_consensus.cc:2468] T fa8650e71aa14778b3d73721fc50d9fc P 0473d2b2d01f4459b1e90fd12cc7840e [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 20.
I20260709 13:07:09.757767 25983 raft_consensus.cc:2804] T 40e1e16737a842ee936002830f36882e P e5256d91808b47c195bc9b4dbd7f2b87 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:07:09.755720 25997 raft_consensus.cc:493] T 65d8cb8d6ec64f459d5a47cefab10acf P e5256d91808b47c195bc9b4dbd7f2b87 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:09.754011 25977 leader_election.cc:290] T bc225c93219c45538b53a1bd3d387e4d P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 17 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:07:09.763051 19409 raft_consensus.cc:2468] T 217b5fae677b4971b3bbd2f357a1f7ff P e5256d91808b47c195bc9b4dbd7f2b87 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 16.
I20260709 13:07:09.765477 26088 tablet_replica.cc:333] T ab43d85f64114d4ebf618930e43d9ed0 P e5256d91808b47c195bc9b4dbd7f2b87: stopping tablet replica
I20260709 13:07:09.770998 25905 raft_consensus.cc:3060] T 0e1085d23e8347fbbd5bce7542f4b1f4 P 127766fc592545a4997f7790f50f6076 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:07:09.771651 19558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed7fdbcb96d14d418db9ca90a792588a" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:07:09.739008 25920 raft_consensus.cc:493] T 1efebf73c86e432baa55533136b6e12c P 127766fc592545a4997f7790f50f6076 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:09.752133 20108 raft_consensus.cc:2468] T 96efeaaf1057492490e9a621f37e1a2d P 127766fc592545a4997f7790f50f6076 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 19.
I20260709 13:07:09.774745 26035 raft_consensus.cc:515] T 62c6c134d3d24a1ab144dd9ee6bc3f64 P e61c3a8f61bb48f8a963c9480e53c168 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:07:09.572016 25987 leader_election.cc:290] T ef32ce6fdd0e40d382c79974f30295c6 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:07:09.748540 25093 raft_consensus.cc:515] T 4509b76741dc428e9201c70c1658da13 P e5256d91808b47c195bc9b4dbd7f2b87 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:07:09.777776 19407 raft_consensus.cc:2393] T 22196caba61445d3bec98a0aab3c337d P e5256d91808b47c195bc9b4dbd7f2b87 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate e61c3a8f61bb48f8a963c9480e53c168 in current term 19: Already voted for candidate e5256d91808b47c195bc9b4dbd7f2b87 in this term.
I20260709 13:07:09.798252 19554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96efeaaf1057492490e9a621f37e1a2d" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:07:09.795926 25983 raft_consensus.cc:493] T 40e1e16737a842ee936002830f36882e P e5256d91808b47c195bc9b4dbd7f2b87 [term 20 FOLLOWER]: Starting leader election (detected failure of leader e61c3a8f61bb48f8a963c9480e53c168)
I20260709 13:07:09.802794 19556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e1085d23e8347fbbd5bce7542f4b1f4" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 16 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:07:09.805282 19553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1efebf73c86e432baa55533136b6e12c" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:07:09.810153 19407 raft_consensus.cc:1240] T 85c494af21f9457a85da47b9bc70c1fd P e5256d91808b47c195bc9b4dbd7f2b87 [term 18 FOLLOWER]: Rejecting Update request from peer e61c3a8f61bb48f8a963c9480e53c168 for earlier term 17. Current term is 18. Ops: []
I20260709 13:07:09.808107 19554 raft_consensus.cc:2468] T 96efeaaf1057492490e9a621f37e1a2d P e61c3a8f61bb48f8a963c9480e53c168 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 127766fc592545a4997f7790f50f6076 in term 20.
I20260709 13:07:09.810945 19480 raft_consensus.cc:1275] T 775c229504194560ba9589bc2199b089 P 0473d2b2d01f4459b1e90fd12cc7840e [term 15 FOLLOWER]: Refusing update from remote peer e5256d91808b47c195bc9b4dbd7f2b87: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
W20260709 13:07:09.804122 25994 consensus_meta.cc:287] T 5ec1c4ce15e04c7e8c283a62179f2a64 P 127766fc592545a4997f7790f50f6076: Time spent flushing consensus metadata: real 0.562s	user 0.011s	sys 0.000s
I20260709 13:07:09.813839 19551 raft_consensus.cc:2468] T 62c6c134d3d24a1ab144dd9ee6bc3f64 P e61c3a8f61bb48f8a963c9480e53c168 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 127766fc592545a4997f7790f50f6076 in term 16.
I20260709 13:07:09.814869 19559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14935b3ddf914369822e4a0547aaa355" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:07:09.803906 25920 raft_consensus.cc:3060] T 1efebf73c86e432baa55533136b6e12c P 127766fc592545a4997f7790f50f6076 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:07:09.815300 19553 raft_consensus.cc:2468] T 1efebf73c86e432baa55533136b6e12c P e61c3a8f61bb48f8a963c9480e53c168 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 127766fc592545a4997f7790f50f6076 in term 14.
I20260709 13:07:09.806422 25983 raft_consensus.cc:3060] T 40e1e16737a842ee936002830f36882e P e5256d91808b47c195bc9b4dbd7f2b87 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:07:09.810196 26017 raft_consensus.cc:2764] T fa8650e71aa14778b3d73721fc50d9fc P 0473d2b2d01f4459b1e90fd12cc7840e [term 20 FOLLOWER]: Leader pre-election decision vote started in defunct term 18: won
I20260709 13:07:09.821652 19407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b08304a0a02b42d7840c4e8ee9a6bd1a" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
I20260709 13:07:09.822494 19407 raft_consensus.cc:2368] T b08304a0a02b42d7840c4e8ee9a6bd1a P e5256d91808b47c195bc9b4dbd7f2b87 [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate e61c3a8f61bb48f8a963c9480e53c168 for earlier term 20. Current term is 21.
I20260709 13:07:09.799891 25997 raft_consensus.cc:515] T 65d8cb8d6ec64f459d5a47cefab10acf P e5256d91808b47c195bc9b4dbd7f2b87 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:07:09.822650 19558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa731b585f684a7fb2d106c50f143b83" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 17 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:07:09.805881 26065 raft_consensus.cc:515] T 2b74109013a140ada21feeef92d6f563 P e5256d91808b47c195bc9b4dbd7f2b87 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:07:09.824928 25908 consensus_queue.cc:237] T 85c494af21f9457a85da47b9bc70c1fd P 127766fc592545a4997f7790f50f6076 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.13, Last appended by leader: 13, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:07:09.841568 19553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed7fdbcb96d14d418db9ca90a792588a" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:07:09.828553 25093 leader_election.cc:290] T 4509b76741dc428e9201c70c1658da13 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:07:09.851413 19559 raft_consensus.cc:3060] T 14935b3ddf914369822e4a0547aaa355 P e61c3a8f61bb48f8a963c9480e53c168 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:07:09.837733 19554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa8650e71aa14778b3d73721fc50d9fc" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:07:09.853829 19554 raft_consensus.cc:3060] T fa8650e71aa14778b3d73721fc50d9fc P e61c3a8f61bb48f8a963c9480e53c168 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:07:09.816615 25994 raft_consensus.cc:515] T 5ec1c4ce15e04c7e8c283a62179f2a64 P 127766fc592545a4997f7790f50f6076 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:07:09.860152 19556 raft_consensus.cc:1275] T a08760e15aac4630a629431f56024dc8 P e61c3a8f61bb48f8a963c9480e53c168 [term 23 FOLLOWER]: Refusing update from remote peer e5256d91808b47c195bc9b4dbd7f2b87: Log matching property violated. Preceding OpId in replica: term: 21 index: 12. Preceding OpId from leader: term: 23 index: 13. (index mismatch)
W20260709 13:07:09.827447 25992 consensus_meta.cc:287] T 7be9efa6559648dbb5a0f7684c4542d1 P e5256d91808b47c195bc9b4dbd7f2b87: Time spent flushing consensus metadata: real 0.602s	user 0.009s	sys 0.005s
I20260709 13:07:09.840935 25997 leader_election.cc:290] T 65d8cb8d6ec64f459d5a47cefab10acf P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:07:09.841944 25925 leader_election.cc:290] T 28af091831594f9d8e96482078cc7625 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:07:09.880091 19553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85c494af21f9457a85da47b9bc70c1fd" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:07:09.855154 26065 leader_election.cc:290] T 2b74109013a140ada21feeef92d6f563 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:07:09.883102 19552 raft_consensus.cc:1275] T ef32ce6fdd0e40d382c79974f30295c6 P e61c3a8f61bb48f8a963c9480e53c168 [term 23 FOLLOWER]: Refusing update from remote peer e5256d91808b47c195bc9b4dbd7f2b87: Log matching property violated. Preceding OpId in replica: term: 21 index: 12. Preceding OpId from leader: term: 23 index: 13. (index mismatch)
I20260709 13:07:09.884783 19374 leader_election.cc:304] T ff9b0eddd810459b82d91c60777c10eb P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 127766fc592545a4997f7790f50f6076, e5256d91808b47c195bc9b4dbd7f2b87; no voters: 
I20260709 13:07:09.885553 19558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4509b76741dc428e9201c70c1658da13" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
W20260709 13:07:09.872092 19526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.2:46257, user_credentials={real_user=slave}} blocked reactor thread for 118211us
I20260709 13:07:09.886268 19558 raft_consensus.cc:2468] T 4509b76741dc428e9201c70c1658da13 P e61c3a8f61bb48f8a963c9480e53c168 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 13.
W20260709 13:07:09.891275 26084 log.cc:927] Time spent T ab43d85f64114d4ebf618930e43d9ed0 P 0473d2b2d01f4459b1e90fd12cc7840e: Append to log took a long time: real 0.082s	user 0.000s	sys 0.000s
W20260709 13:07:09.884923 26093 log.cc:927] Time spent T 70797e5783b5454ab0d0eea663e791e3 P e61c3a8f61bb48f8a963c9480e53c168: Append to log took a long time: real 0.077s	user 0.000s	sys 0.001s
I20260709 13:07:09.898412 26035 leader_election.cc:290] T 62c6c134d3d24a1ab144dd9ee6bc3f64 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:07:09.901036 25994 leader_election.cc:290] T 5ec1c4ce15e04c7e8c283a62179f2a64 P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 14 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:07:09.869127 25992 raft_consensus.cc:515] T 7be9efa6559648dbb5a0f7684c4542d1 P e5256d91808b47c195bc9b4dbd7f2b87 [term 21 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } attrs { replace: true } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:07:09.894157 26044 leader_election.cc:290] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 21 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:07:09.895030 26065 raft_consensus.cc:2804] T ff9b0eddd810459b82d91c60777c10eb P e5256d91808b47c195bc9b4dbd7f2b87 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:07:09.892978 26092 raft_consensus.cc:493] T 65d8cb8d6ec64f459d5a47cefab10acf P 127766fc592545a4997f7790f50f6076 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader e5256d91808b47c195bc9b4dbd7f2b87)
I20260709 13:07:09.905859 26092 raft_consensus.cc:515] T 65d8cb8d6ec64f459d5a47cefab10acf P 127766fc592545a4997f7790f50f6076 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
W20260709 13:07:09.907121 26085 log.cc:927] Time spent T 14935b3ddf914369822e4a0547aaa355 P 127766fc592545a4997f7790f50f6076: Append to log took a long time: real 0.095s	user 0.000s	sys 0.001s
W20260709 13:07:09.904490 26087 log.cc:927] Time spent T ed7fdbcb96d14d418db9ca90a792588a P 0473d2b2d01f4459b1e90fd12cc7840e: Append to log took a long time: real 0.098s	user 0.000s	sys 0.001s
I20260709 13:07:09.914320 26092 leader_election.cc:290] T 65d8cb8d6ec64f459d5a47cefab10acf P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:07:09.915185 19375 leader_election.cc:304] T f1b10566f45d4a7d9029858330e02d5b P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168; no voters: 0473d2b2d01f4459b1e90fd12cc7840e
I20260709 13:07:09.916249 25997 raft_consensus.cc:2804] T f1b10566f45d4a7d9029858330e02d5b P e5256d91808b47c195bc9b4dbd7f2b87 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:07:09.916556 26065 raft_consensus.cc:697] T ff9b0eddd810459b82d91c60777c10eb P e5256d91808b47c195bc9b4dbd7f2b87 [term 20 LEADER]: Becoming Leader. State: Replica: e5256d91808b47c195bc9b4dbd7f2b87, State: Running, Role: LEADER
I20260709 13:07:09.917320 25997 raft_consensus.cc:697] T f1b10566f45d4a7d9029858330e02d5b P e5256d91808b47c195bc9b4dbd7f2b87 [term 19 LEADER]: Becoming Leader. State: Replica: e5256d91808b47c195bc9b4dbd7f2b87, State: Running, Role: LEADER
I20260709 13:07:09.917748 26065 consensus_queue.cc:237] T ff9b0eddd810459b82d91c60777c10eb P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.13, Last appended by leader: 13, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:07:09.919601 19555 raft_consensus.cc:1240] T ece3db938bc649d4a40a51522ed5259c P e61c3a8f61bb48f8a963c9480e53c168 [term 15 FOLLOWER]: Rejecting Update request from peer 127766fc592545a4997f7790f50f6076 for earlier term 14. Current term is 15. Ops: []
I20260709 13:07:09.918298 25997 consensus_queue.cc:237] T f1b10566f45d4a7d9029858330e02d5b P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.11, Last appended by leader: 11, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:07:09.921592 20076 leader_election.cc:304] T 833a2f0775ed407a94b8924ce50adb63 P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 127766fc592545a4997f7790f50f6076; no voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:07:09.922930 20076 leader_election.cc:304] T 6c5eebf646ad445a9d1b1adc319d7b16 P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 127766fc592545a4997f7790f50f6076; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:07:09.923440 19553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65d8cb8d6ec64f459d5a47cefab10acf" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:07:09.924177 19553 raft_consensus.cc:2393] T 65d8cb8d6ec64f459d5a47cefab10acf P e61c3a8f61bb48f8a963c9480e53c168 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 127766fc592545a4997f7790f50f6076 in current term 20: Already voted for candidate e61c3a8f61bb48f8a963c9480e53c168 in this term.
I20260709 13:07:09.924414 20076 leader_election.cc:304] T 70797e5783b5454ab0d0eea663e791e3 P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 127766fc592545a4997f7790f50f6076; no voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:07:09.925041 25946 raft_consensus.cc:2749] T 833a2f0775ed407a94b8924ce50adb63 P 127766fc592545a4997f7790f50f6076 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:07:09.926000 26044 raft_consensus.cc:2749] T 6c5eebf646ad445a9d1b1adc319d7b16 P 127766fc592545a4997f7790f50f6076 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 13:07:09.928038 19450 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.3:36891, user_credentials={real_user=slave}} blocked reactor thread for 378513us
I20260709 13:07:09.935252 19405 raft_consensus.cc:2468] T edd7d470b5014c9489be7f41f64355c9 P e5256d91808b47c195bc9b4dbd7f2b87 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 23.
I20260709 13:07:09.934605 19450 leader_election.cc:304] T 96efeaaf1057492490e9a621f37e1a2d P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:07:09.937335 26043 consensus_queue.cc:1048] T ab43d85f64114d4ebf618930e43d9ed0 P 127766fc592545a4997f7790f50f6076 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.007s
I20260709 13:07:09.940248 25957 raft_consensus.cc:2804] T 1a61655d99124a29b486ba4a5b37faea P 0473d2b2d01f4459b1e90fd12cc7840e [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:07:09.941546 25977 raft_consensus.cc:2749] T ff75a1d4cb1f493db8f71ddc136ba9ab P 0473d2b2d01f4459b1e90fd12cc7840e [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:07:09.943485 19375 leader_election.cc:304] T 86a6797bdfe94fa496c050ceae4bd0d9 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:07:09.945210 19375 leader_election.cc:304] T 46c5bfeecc314717bffe987e6844b6d0 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:07:09.946317 19375 leader_election.cc:304] T 179fd671030940b4b4a4e24bcc4aba0a P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168; no voters: 0473d2b2d01f4459b1e90fd12cc7840e
I20260709 13:07:09.949224 19559 raft_consensus.cc:2468] T 14935b3ddf914369822e4a0547aaa355 P e61c3a8f61bb48f8a963c9480e53c168 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 127766fc592545a4997f7790f50f6076 in term 14.
I20260709 13:07:09.952380 25925 raft_consensus.cc:2749] T 86a6797bdfe94fa496c050ceae4bd0d9 P e5256d91808b47c195bc9b4dbd7f2b87 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:07:09.953615 20076 leader_election.cc:304] T 96efeaaf1057492490e9a621f37e1a2d P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 127766fc592545a4997f7790f50f6076, e61c3a8f61bb48f8a963c9480e53c168; no voters: 0473d2b2d01f4459b1e90fd12cc7840e
W20260709 13:07:09.954317 19449 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.1:40321, user_credentials={real_user=slave}} blocked reactor thread for 200912us
W20260709 13:07:09.954710 19526 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:09.930919 25871 leader_election.cc:290] T 775c229504194560ba9589bc2199b089 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:07:09.936399 25994 raft_consensus.cc:2749] T 70797e5783b5454ab0d0eea663e791e3 P 127766fc592545a4997f7790f50f6076 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:07:09.963685 25537 raft_consensus.cc:2804] T 96efeaaf1057492490e9a621f37e1a2d P 0473d2b2d01f4459b1e90fd12cc7840e [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:07:09.964251 25376 raft_consensus.cc:493] T 3e1f505cb0f1427bbd698ac889d80821 P 0473d2b2d01f4459b1e90fd12cc7840e [term 19 FOLLOWER]: Starting pre-election (detected failure of leader e61c3a8f61bb48f8a963c9480e53c168)
I20260709 13:07:09.964887 19556 raft_consensus.cc:1275] T 14935b3ddf914369822e4a0547aaa355 P e61c3a8f61bb48f8a963c9480e53c168 [term 14 FOLLOWER]: Refusing update from remote peer 127766fc592545a4997f7790f50f6076: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 13:07:09.942368 25957 raft_consensus.cc:697] T 1a61655d99124a29b486ba4a5b37faea P 0473d2b2d01f4459b1e90fd12cc7840e [term 18 LEADER]: Becoming Leader. State: Replica: 0473d2b2d01f4459b1e90fd12cc7840e, State: Running, Role: LEADER
I20260709 13:07:09.941704 25975 raft_consensus.cc:493] T 48824d5acfbc485ebf8c2d944e7202de P 0473d2b2d01f4459b1e90fd12cc7840e [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 127766fc592545a4997f7790f50f6076)
I20260709 13:07:09.966478 19375 leader_election.cc:304] T 3e1f505cb0f1427bbd698ac889d80821 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:07:09.967130 25537 raft_consensus.cc:493] T 96efeaaf1057492490e9a621f37e1a2d P 0473d2b2d01f4459b1e90fd12cc7840e [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:09.971031 25376 raft_consensus.cc:515] T 3e1f505cb0f1427bbd698ac889d80821 P 0473d2b2d01f4459b1e90fd12cc7840e [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:07:09.973763 19375 leader_election.cc:304] T 833a2f0775ed407a94b8924ce50adb63 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87; no voters: 127766fc592545a4997f7790f50f6076, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:07:09.964934 26097 raft_consensus.cc:2804] T 179fd671030940b4b4a4e24bcc4aba0a P e5256d91808b47c195bc9b4dbd7f2b87 [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:07:09.979038 19449 leader_election.cc:304] T 4509b76741dc428e9201c70c1658da13 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e; no voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:07:09.982719 20076 leader_election.cc:304] T fa731b585f684a7fb2d106c50f143b83 P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 127766fc592545a4997f7790f50f6076; no voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:07:09.973266 25537 raft_consensus.cc:3060] T 96efeaaf1057492490e9a621f37e1a2d P 0473d2b2d01f4459b1e90fd12cc7840e [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:07:09.990291 19478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36f6ba92b9ba46babe4ebd6c02e5fbd9" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:07:09.993495 19484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ec1c4ce15e04c7e8c283a62179f2a64" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:07:09.976042 26044 raft_consensus.cc:2804] T 96efeaaf1057492490e9a621f37e1a2d P 127766fc592545a4997f7790f50f6076 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:07:09.978101 26001 raft_consensus.cc:2749] T 46c5bfeecc314717bffe987e6844b6d0 P e5256d91808b47c195bc9b4dbd7f2b87 [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 13:07:09.993458 19481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed7fdbcb96d14d418db9ca90a792588a" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:07:09.995991 19558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef32ce6fdd0e40d382c79974f30295c6" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 24 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:07:09.980250 25925 raft_consensus.cc:2749] T 3e1f505cb0f1427bbd698ac889d80821 P e5256d91808b47c195bc9b4dbd7f2b87 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:07:09.995352 19555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc225c93219c45538b53a1bd3d387e4d" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:07:10.001642 19555 raft_consensus.cc:3060] T bc225c93219c45538b53a1bd3d387e4d P e61c3a8f61bb48f8a963c9480e53c168 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:07:10.002261 19558 raft_consensus.cc:2410] T ef32ce6fdd0e40d382c79974f30295c6 P e61c3a8f61bb48f8a963c9480e53c168 [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0473d2b2d01f4459b1e90fd12cc7840e for term 24 because replica has last-logged OpId of term: 21 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 20 index: 11.
I20260709 13:07:09.982337 26097 raft_consensus.cc:697] T 179fd671030940b4b4a4e24bcc4aba0a P e5256d91808b47c195bc9b4dbd7f2b87 [term 22 LEADER]: Becoming Leader. State: Replica: e5256d91808b47c195bc9b4dbd7f2b87, State: Running, Role: LEADER
I20260709 13:07:09.979270 25871 raft_consensus.cc:493] T 9962423cb4e54fcfa5de01daf68a86e7 P 0473d2b2d01f4459b1e90fd12cc7840e [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 127766fc592545a4997f7790f50f6076)
I20260709 13:07:09.972860 25977 consensus_queue.cc:1059] T f1b10566f45d4a7d9029858330e02d5b P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.022s
I20260709 13:07:09.990998 25994 raft_consensus.cc:2749] T fa731b585f684a7fb2d106c50f143b83 P 127766fc592545a4997f7790f50f6076 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:07:10.023643 26088 raft_consensus.cc:2243] T ab43d85f64114d4ebf618930e43d9ed0 P e5256d91808b47c195bc9b4dbd7f2b87 [term 20 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:10.008374 25376 leader_election.cc:290] T 3e1f505cb0f1427bbd698ac889d80821 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:07:10.009523 25851 raft_consensus.cc:493] T 7f575b143b844aa096b50997dad3516a P e61c3a8f61bb48f8a963c9480e53c168 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader e5256d91808b47c195bc9b4dbd7f2b87)
W20260709 13:07:10.014279 26094 log.cc:927] Time spent T 22196caba61445d3bec98a0aab3c337d P e61c3a8f61bb48f8a963c9480e53c168: Append to log took a long time: real 0.122s	user 0.002s	sys 0.000s
I20260709 13:07:10.006747 25953 raft_consensus.cc:493] T 1dc5b3532fe54f74876d02beffa2c230 P 0473d2b2d01f4459b1e90fd12cc7840e [term 20 FOLLOWER]: Starting pre-election (detected failure of leader e61c3a8f61bb48f8a963c9480e53c168)
I20260709 13:07:10.023206 25957 consensus_queue.cc:237] T 1a61655d99124a29b486ba4a5b37faea P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 17.11, Last appended by leader: 11, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:07:10.000960 26065 raft_consensus.cc:3060] T 833a2f0775ed407a94b8924ce50adb63 P e5256d91808b47c195bc9b4dbd7f2b87 [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:07:10.027402 19375 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.3:36891, user_credentials={real_user=slave}} blocked reactor thread for 53709.1us
I20260709 13:07:09.995759 26044 raft_consensus.cc:493] T 96efeaaf1057492490e9a621f37e1a2d P 127766fc592545a4997f7790f50f6076 [term 19 FOLLOWER]: Starting leader election (detected failure of leader e61c3a8f61bb48f8a963c9480e53c168)
I20260709 13:07:10.038568 19375 leader_election.cc:304] T edd7d470b5014c9489be7f41f64355c9 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:07:10.056568 19375 leader_election.cc:304] T b08304a0a02b42d7840c4e8ee9a6bd1a P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:07:10.057531 25997 raft_consensus.cc:2804] T b08304a0a02b42d7840c4e8ee9a6bd1a P e5256d91808b47c195bc9b4dbd7f2b87 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:07:10.038142 26044 raft_consensus.cc:3060] T 96efeaaf1057492490e9a621f37e1a2d P 127766fc592545a4997f7790f50f6076 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:07:10.058102 25997 raft_consensus.cc:697] T b08304a0a02b42d7840c4e8ee9a6bd1a P e5256d91808b47c195bc9b4dbd7f2b87 [term 21 LEADER]: Becoming Leader. State: Replica: e5256d91808b47c195bc9b4dbd7f2b87, State: Running, Role: LEADER
I20260709 13:07:10.058241 26097 consensus_queue.cc:237] T 179fd671030940b4b4a4e24bcc4aba0a P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 20.13, Last appended by leader: 13, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:07:10.059500 25997 consensus_queue.cc:237] T b08304a0a02b42d7840c4e8ee9a6bd1a P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 19.11, Last appended by leader: 11, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:07:10.023831 26057 raft_consensus.cc:2749] T 4509b76741dc428e9201c70c1658da13 P 0473d2b2d01f4459b1e90fd12cc7840e [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:07:10.065678 19375 leader_election.cc:304] T 4509b76741dc428e9201c70c1658da13 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:07:10.035508 25832 leader_election.cc:290] T 46c5bfeecc314717bffe987e6844b6d0 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:07:10.061637 25871 raft_consensus.cc:515] T 9962423cb4e54fcfa5de01daf68a86e7 P 0473d2b2d01f4459b1e90fd12cc7840e [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:07:10.035730 25851 raft_consensus.cc:515] T 7f575b143b844aa096b50997dad3516a P e61c3a8f61bb48f8a963c9480e53c168 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:07:10.072228 25871 leader_election.cc:290] T 9962423cb4e54fcfa5de01daf68a86e7 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:07:10.068065 25925 consensus_queue.cc:1048] T a08760e15aac4630a629431f56024dc8 P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.005s
I20260709 13:07:10.073186 25851 leader_election.cc:290] T 7f575b143b844aa096b50997dad3516a P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:07:10.074506 25925 raft_consensus.cc:2804] T 4509b76741dc428e9201c70c1658da13 P e5256d91808b47c195bc9b4dbd7f2b87 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:07:10.074967 25925 raft_consensus.cc:493] T 4509b76741dc428e9201c70c1658da13 P e5256d91808b47c195bc9b4dbd7f2b87 [term 12 FOLLOWER]: Starting leader election (detected failure of leader e61c3a8f61bb48f8a963c9480e53c168)
I20260709 13:07:10.075347 25925 raft_consensus.cc:3060] T 4509b76741dc428e9201c70c1658da13 P e5256d91808b47c195bc9b4dbd7f2b87 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:07:09.999104 25975 raft_consensus.cc:515] T 48824d5acfbc485ebf8c2d944e7202de P 0473d2b2d01f4459b1e90fd12cc7840e [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:07:10.086403 19555 raft_consensus.cc:2468] T bc225c93219c45538b53a1bd3d387e4d P e61c3a8f61bb48f8a963c9480e53c168 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 17.
I20260709 13:07:10.047273 26059 leader_election.cc:290] T b08304a0a02b42d7840c4e8ee9a6bd1a P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 20 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:07:10.027701 25987 raft_consensus.cc:493] T 14efcc79969f41babe5529c22d59156d P 0473d2b2d01f4459b1e90fd12cc7840e [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 127766fc592545a4997f7790f50f6076)
I20260709 13:07:10.034758 25992 leader_election.cc:290] T 7be9efa6559648dbb5a0f7684c4542d1 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 21 election: Requested vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:07:10.000885 25983 raft_consensus.cc:515] T 40e1e16737a842ee936002830f36882e P e5256d91808b47c195bc9b4dbd7f2b87 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:07:10.062175 26008 raft_consensus.cc:2804] T edd7d470b5014c9489be7f41f64355c9 P e5256d91808b47c195bc9b4dbd7f2b87 [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 13:07:10.104550 25983 leader_election.cc:290] T 40e1e16737a842ee936002830f36882e P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 21 election: Requested vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:07:10.108789 19554 raft_consensus.cc:2468] T fa8650e71aa14778b3d73721fc50d9fc P e61c3a8f61bb48f8a963c9480e53c168 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 20.
W20260709 13:07:10.112283 20076 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.3:36891, user_credentials={real_user=slave}} blocked reactor thread for 86089.6us
I20260709 13:07:10.029944 25953 raft_consensus.cc:515] T 1dc5b3532fe54f74876d02beffa2c230 P 0473d2b2d01f4459b1e90fd12cc7840e [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:07:10.130174 25537 raft_consensus.cc:515] T 96efeaaf1057492490e9a621f37e1a2d P 0473d2b2d01f4459b1e90fd12cc7840e [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:07:10.139292 19407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36f6ba92b9ba46babe4ebd6c02e5fbd9" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
I20260709 13:07:10.139590 25953 leader_election.cc:290] T 1dc5b3532fe54f74876d02beffa2c230 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:07:10.140100 25537 leader_election.cc:290] T 96efeaaf1057492490e9a621f37e1a2d P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 21 election: Requested vote from peers e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:07:10.140688 19409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ec1c4ce15e04c7e8c283a62179f2a64" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
I20260709 13:07:10.141291 19409 raft_consensus.cc:3060] T 5ec1c4ce15e04c7e8c283a62179f2a64 P e5256d91808b47c195bc9b4dbd7f2b87 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:07:10.068212 26103 consensus_queue.cc:1048] T ef32ce6fdd0e40d382c79974f30295c6 P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.045s
I20260709 13:07:10.145076 25946 raft_consensus.cc:493] T 0afb57ae58a24a01850491d69f0213dd P 127766fc592545a4997f7790f50f6076 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 0473d2b2d01f4459b1e90fd12cc7840e)
I20260709 13:07:10.145713 25946 raft_consensus.cc:515] T 0afb57ae58a24a01850491d69f0213dd P 127766fc592545a4997f7790f50f6076 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:07:10.099323 25851 consensus_queue.cc:1059] T 833a2f0775ed407a94b8924ce50adb63 P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false }, Status: INVALID_TERM, Last received: 14.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.019s
I20260709 13:07:10.126772 26088 raft_consensus.cc:2272] T ab43d85f64114d4ebf618930e43d9ed0 P e5256d91808b47c195bc9b4dbd7f2b87 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:10.097903 26008 raft_consensus.cc:493] T edd7d470b5014c9489be7f41f64355c9 P e5256d91808b47c195bc9b4dbd7f2b87 [term 23 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:10.131395 26059 consensus_queue.cc:1048] T 7be9efa6559648dbb5a0f7684c4542d1 P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Connected to new peer: Peer: permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:07:10.172400 25747 raft_consensus.cc:3055] T 833a2f0775ed407a94b8924ce50adb63 P e61c3a8f61bb48f8a963c9480e53c168 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:07:10.172767 26008 raft_consensus.cc:3060] T edd7d470b5014c9489be7f41f64355c9 P e5256d91808b47c195bc9b4dbd7f2b87 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:07:10.172874 25747 raft_consensus.cc:740] T 833a2f0775ed407a94b8924ce50adb63 P e61c3a8f61bb48f8a963c9480e53c168 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: e61c3a8f61bb48f8a963c9480e53c168, State: Running, Role: LEADER
I20260709 13:07:10.131784 19485 raft_consensus.cc:1275] T a08760e15aac4630a629431f56024dc8 P 0473d2b2d01f4459b1e90fd12cc7840e [term 23 FOLLOWER]: Refusing update from remote peer e5256d91808b47c195bc9b4dbd7f2b87: Log matching property violated. Preceding OpId in replica: term: 22 index: 13. Preceding OpId from leader: term: 23 index: 13. (term mismatch)
I20260709 13:07:10.173731 19485 pending_rounds.cc:85] T a08760e15aac4630a629431f56024dc8 P 0473d2b2d01f4459b1e90fd12cc7840e: Aborting all ops after (but not including) 12
I20260709 13:07:10.174005 19485 pending_rounds.cc:107] T a08760e15aac4630a629431f56024dc8 P 0473d2b2d01f4459b1e90fd12cc7840e: Aborting uncommitted NO_OP operation due to leader change: 22.13
I20260709 13:07:10.174551 19485 raft_consensus.cc:2889] T a08760e15aac4630a629431f56024dc8 P 0473d2b2d01f4459b1e90fd12cc7840e [term 23 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:07:10.118424 26057 raft_consensus.cc:493] T 0cdf56e38bbc453d9438d359e5a69955 P 0473d2b2d01f4459b1e90fd12cc7840e [term 18 FOLLOWER]: Starting pre-election (detected failure of leader e61c3a8f61bb48f8a963c9480e53c168)
I20260709 13:07:10.175679 26057 raft_consensus.cc:515] T 0cdf56e38bbc453d9438d359e5a69955 P 0473d2b2d01f4459b1e90fd12cc7840e [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:07:10.106375 25987 raft_consensus.cc:515] T 14efcc79969f41babe5529c22d59156d P 0473d2b2d01f4459b1e90fd12cc7840e [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:07:10.106868 25975 leader_election.cc:290] T 48824d5acfbc485ebf8c2d944e7202de P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:07:10.148339 20107 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46436 (request call id 1032) took 1041 ms. Trace:
I20260709 13:07:10.149293 19402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65d8cb8d6ec64f459d5a47cefab10acf" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:07:10.152611 26103 raft_consensus.cc:493] T 309c3ca0ca4b4f3ba129752ea2cb293b P e5256d91808b47c195bc9b4dbd7f2b87 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 0473d2b2d01f4459b1e90fd12cc7840e)
I20260709 13:07:10.156576 19377 leader_election.cc:304] T fa8650e71aa14778b3d73721fc50d9fc P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87; no voters: 
I20260709 13:07:10.181304 19484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b74109013a140ada21feeef92d6f563" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 18 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:07:10.182391 19480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28af091831594f9d8e96482078cc7625" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:07:10.181241 19402 raft_consensus.cc:2468] T 65d8cb8d6ec64f459d5a47cefab10acf P e5256d91808b47c195bc9b4dbd7f2b87 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 127766fc592545a4997f7790f50f6076 in term 20.
I20260709 13:07:10.180505 20107 rpcz_store.cc:276] 0709 13:07:09.110460 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:09.116944 (+  6484us) service_pool.cc:224] Handling call
0709 13:07:09.130816 (+ 13872us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:09.775436 (+644620us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:10.148105 (+372669us) spinlock_profiling.cc:243] Waited 644 ms on lock 0x7b5400245c54. stack: 00007f4a79de9343 00007f4a79de9240 00007f4a797781d4 00007f4a834b6304 00007f4a834b6299 00007f4a7ce71571 00007f4a7cf08e01 00007f4a7cf0783e 00007f4a81ecc419 00007f4a7b443bd4 00007f4a7b443b62 00007f4a7b443a91 00007f4a7b443a0c 00007f4a7b442cc2 00007f4a7b24348c 00007f4a7b2428c6
0709 13:07:10.148279 (+   174us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1481169664}
W20260709 13:07:10.158902 19523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.4:43121, user_credentials={real_user=slave}} blocked reactor thread for 43686.8us
I20260709 13:07:10.096536 26065 raft_consensus.cc:2749] T 833a2f0775ed407a94b8924ce50adb63 P e5256d91808b47c195bc9b4dbd7f2b87 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:07:10.161929 19409 raft_consensus.cc:2468] T 5ec1c4ce15e04c7e8c283a62179f2a64 P e5256d91808b47c195bc9b4dbd7f2b87 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 127766fc592545a4997f7790f50f6076 in term 14.
I20260709 13:07:10.167469 19486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40e1e16737a842ee936002830f36882e" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:07:10.198371 25093 raft_consensus.cc:2804] T fa8650e71aa14778b3d73721fc50d9fc P e5256d91808b47c195bc9b4dbd7f2b87 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:07:10.199100 25093 raft_consensus.cc:697] T fa8650e71aa14778b3d73721fc50d9fc P e5256d91808b47c195bc9b4dbd7f2b87 [term 20 LEADER]: Becoming Leader. State: Replica: e5256d91808b47c195bc9b4dbd7f2b87, State: Running, Role: LEADER
I20260709 13:07:10.172144 25376 raft_consensus.cc:3055] T f1b10566f45d4a7d9029858330e02d5b P 0473d2b2d01f4459b1e90fd12cc7840e [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:07:10.199667 25376 raft_consensus.cc:740] T f1b10566f45d4a7d9029858330e02d5b P 0473d2b2d01f4459b1e90fd12cc7840e [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 0473d2b2d01f4459b1e90fd12cc7840e, State: Running, Role: LEADER
I20260709 13:07:10.172559 26107 consensus_queue.cc:1048] T ef32ce6fdd0e40d382c79974f30295c6 P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.004s
I20260709 13:07:10.137367 19552 raft_consensus.cc:3060] T 62c6c134d3d24a1ab144dd9ee6bc3f64 P e61c3a8f61bb48f8a963c9480e53c168 [term 16 FOLLOWER]: Advancing to term 18
I20260709 13:07:10.178833 19485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0afb57ae58a24a01850491d69f0213dd" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:07:10.185784 19477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7be9efa6559648dbb5a0f7684c4542d1" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 21 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:07:10.201260 19477 raft_consensus.cc:3060] T 7be9efa6559648dbb5a0f7684c4542d1 P 0473d2b2d01f4459b1e90fd12cc7840e [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:07:10.200124 19523 leader_election.cc:304] T ff75a1d4cb1f493db8f71ddc136ba9ab P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e61c3a8f61bb48f8a963c9480e53c168; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:07:10.173940 25747 consensus_queue.cc:260] T 833a2f0775ed407a94b8924ce50adb63 P e61c3a8f61bb48f8a963c9480e53c168 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:07:10.171425 25946 leader_election.cc:290] T 0afb57ae58a24a01850491d69f0213dd P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:07:10.201323 19484 raft_consensus.cc:2468] T 2b74109013a140ada21feeef92d6f563 P 0473d2b2d01f4459b1e90fd12cc7840e [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 17.
I20260709 13:07:10.180850 19481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4509b76741dc428e9201c70c1658da13" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:07:10.198405 19486 raft_consensus.cc:3060] T 40e1e16737a842ee936002830f36882e P 0473d2b2d01f4459b1e90fd12cc7840e [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:07:10.218779 25992 consensus_queue.cc:1048] T 775c229504194560ba9589bc2199b089 P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:07:10.219905 19481 raft_consensus.cc:2393] T 4509b76741dc428e9201c70c1658da13 P 0473d2b2d01f4459b1e90fd12cc7840e [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e5256d91808b47c195bc9b4dbd7f2b87 in current term 13: Already voted for candidate 0473d2b2d01f4459b1e90fd12cc7840e in this term.
I20260709 13:07:10.199342 25994 raft_consensus.cc:493] T 4af19371ea874c09a0a2147040835cbb P 127766fc592545a4997f7790f50f6076 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:10.233805 19450 leader_election.cc:304] T bc225c93219c45538b53a1bd3d387e4d P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:07:10.234645 25964 raft_consensus.cc:2804] T bc225c93219c45538b53a1bd3d387e4d P 0473d2b2d01f4459b1e90fd12cc7840e [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:07:10.235248 25964 raft_consensus.cc:697] T bc225c93219c45538b53a1bd3d387e4d P 0473d2b2d01f4459b1e90fd12cc7840e [term 17 LEADER]: Becoming Leader. State: Replica: 0473d2b2d01f4459b1e90fd12cc7840e, State: Running, Role: LEADER
I20260709 13:07:10.236451 26108 raft_consensus.cc:493] T 1dc5b3532fe54f74876d02beffa2c230 P e61c3a8f61bb48f8a963c9480e53c168 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:10.236388 25964 consensus_queue.cc:237] T bc225c93219c45538b53a1bd3d387e4d P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:07:10.237252 26108 raft_consensus.cc:515] T 1dc5b3532fe54f74876d02beffa2c230 P e61c3a8f61bb48f8a963c9480e53c168 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:07:10.240477 19553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e1f505cb0f1427bbd698ac889d80821" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:07:10.244896 20075 leader_election.cc:304] T 65d8cb8d6ec64f459d5a47cefab10acf P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 127766fc592545a4997f7790f50f6076, e5256d91808b47c195bc9b4dbd7f2b87; no voters: 
I20260709 13:07:10.249948 19554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96efeaaf1057492490e9a621f37e1a2d" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:07:10.250521 19554 raft_consensus.cc:3060] T 96efeaaf1057492490e9a621f37e1a2d P e61c3a8f61bb48f8a963c9480e53c168 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:07:10.251557 19551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dc5b3532fe54f74876d02beffa2c230" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:07:10.252116 19551 raft_consensus.cc:2468] T 1dc5b3532fe54f74876d02beffa2c230 P e61c3a8f61bb48f8a963c9480e53c168 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 21.
I20260709 13:07:10.253017 19553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48824d5acfbc485ebf8c2d944e7202de" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:07:10.255345 26108 leader_election.cc:290] T 1dc5b3532fe54f74876d02beffa2c230 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:07:10.256181 19450 leader_election.cc:304] T 1dc5b3532fe54f74876d02beffa2c230 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:07:10.257225 25957 raft_consensus.cc:2804] T 1dc5b3532fe54f74876d02beffa2c230 P 0473d2b2d01f4459b1e90fd12cc7840e [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:07:10.257488 19554 raft_consensus.cc:2468] T 96efeaaf1057492490e9a621f37e1a2d P e61c3a8f61bb48f8a963c9480e53c168 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 21.
I20260709 13:07:10.257642 25957 raft_consensus.cc:493] T 1dc5b3532fe54f74876d02beffa2c230 P 0473d2b2d01f4459b1e90fd12cc7840e [term 20 FOLLOWER]: Starting leader election (detected failure of leader e61c3a8f61bb48f8a963c9480e53c168)
I20260709 13:07:10.258153 25957 raft_consensus.cc:3060] T 1dc5b3532fe54f74876d02beffa2c230 P 0473d2b2d01f4459b1e90fd12cc7840e [term 20 FOLLOWER]: Advancing to term 21
W20260709 13:07:10.263021 19523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.1:40321, user_credentials={real_user=slave}} blocked reactor thread for 63011.5us
I20260709 13:07:10.267201 20075 leader_election.cc:304] T 5ec1c4ce15e04c7e8c283a62179f2a64 P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 127766fc592545a4997f7790f50f6076, e5256d91808b47c195bc9b4dbd7f2b87; no voters: 
I20260709 13:07:10.223140 25923 raft_consensus.cc:493] T 9962423cb4e54fcfa5de01daf68a86e7 P e5256d91808b47c195bc9b4dbd7f2b87 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:10.179471 25920 raft_consensus.cc:515] T 1efebf73c86e432baa55533136b6e12c P 127766fc592545a4997f7790f50f6076 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:07:10.268673 19450 leader_election.cc:304] T 96efeaaf1057492490e9a621f37e1a2d P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:07:10.270025 25093 consensus_queue.cc:237] T fa8650e71aa14778b3d73721fc50d9fc P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 18.10, Last appended by leader: 10, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
W20260709 13:07:10.276707 20078 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.2:46257, user_credentials={real_user=slave}} blocked reactor thread for 102106us
I20260709 13:07:10.277518 20078 leader_election.cc:304] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 127766fc592545a4997f7790f50f6076; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:07:10.277016 25376 consensus_queue.cc:260] T f1b10566f45d4a7d9029858330e02d5b P 0473d2b2d01f4459b1e90fd12cc7840e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.12, Last appended by leader: 12, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:07:10.281917 19377 leader_election.cc:304] T 2b74109013a140ada21feeef92d6f563 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87; no voters: 
W20260709 13:07:10.296182 19375 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.3:36891, user_credentials={real_user=slave}} blocked reactor thread for 229303us
I20260709 13:07:10.297451 25376 raft_consensus.cc:3060] T f1b10566f45d4a7d9029858330e02d5b P 0473d2b2d01f4459b1e90fd12cc7840e [term 18 FOLLOWER]: Advancing to term 19
W20260709 13:07:10.299053 19449 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.1:40321, user_credentials={real_user=slave}} blocked reactor thread for 323104us
I20260709 13:07:10.268151 25851 raft_consensus.cc:2749] T ff75a1d4cb1f493db8f71ddc136ba9ab P e61c3a8f61bb48f8a963c9480e53c168 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:07:10.222932 26065 consensus_queue.cc:1048] T a08760e15aac4630a629431f56024dc8 P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.064s
I20260709 13:07:10.300323 19523 leader_election.cc:304] T ece3db938bc649d4a40a51522ed5259c P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e61c3a8f61bb48f8a963c9480e53c168; no voters: 127766fc592545a4997f7790f50f6076, e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:07:10.304464 20112 raft_consensus.cc:2368] T 1efebf73c86e432baa55533136b6e12c P 127766fc592545a4997f7790f50f6076 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e61c3a8f61bb48f8a963c9480e53c168 for earlier term 15. Current term is 16.
I20260709 13:07:10.307217 19554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65d8cb8d6ec64f459d5a47cefab10acf" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:07:10.286429 25908 raft_consensus.cc:2804] T 65d8cb8d6ec64f459d5a47cefab10acf P 127766fc592545a4997f7790f50f6076 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:07:10.276132 25923 raft_consensus.cc:515] T 9962423cb4e54fcfa5de01daf68a86e7 P e5256d91808b47c195bc9b4dbd7f2b87 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:07:10.308702 19553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28af091831594f9d8e96482078cc7625" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:07:10.211066 26103 raft_consensus.cc:515] T 309c3ca0ca4b4f3ba129752ea2cb293b P e5256d91808b47c195bc9b4dbd7f2b87 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:07:10.314970 19402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f93ee515a9c14139bf566522ed8232f3" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 23 candidate_status { last_received { term: 22 index: 11 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:07:10.299611 26092 raft_consensus.cc:2804] T 5ec1c4ce15e04c7e8c283a62179f2a64 P 127766fc592545a4997f7790f50f6076 [term 14 FOLLOWER]: Leader election won for term 14
W20260709 13:07:10.317143 26077 log.cc:927] Time spent T 775c229504194560ba9589bc2199b089 P e5256d91808b47c195bc9b4dbd7f2b87: Append to log took a long time: real 0.062s	user 0.000s	sys 0.000s
I20260709 13:07:10.317296 25987 leader_election.cc:290] T 14efcc79969f41babe5529c22d59156d P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:07:10.318857 25920 leader_election.cc:290] T 1efebf73c86e432baa55533136b6e12c P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 16 election: Requested vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:07:10.318989 19551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b74109013a140ada21feeef92d6f563" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 18 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:07:10.307886 19554 raft_consensus.cc:2468] T 65d8cb8d6ec64f459d5a47cefab10acf P e61c3a8f61bb48f8a963c9480e53c168 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 20.
I20260709 13:07:10.321380 19486 raft_consensus.cc:2468] T 40e1e16737a842ee936002830f36882e P 0473d2b2d01f4459b1e90fd12cc7840e [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 21.
I20260709 13:07:10.288548 25747 raft_consensus.cc:3060] T 833a2f0775ed407a94b8924ce50adb63 P e61c3a8f61bb48f8a963c9480e53c168 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:07:10.323380 19557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40e1e16737a842ee936002830f36882e" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:07:10.311480 19558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7be9efa6559648dbb5a0f7684c4542d1" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 21 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:07:10.323850 19411 raft_consensus.cc:1240] T 833a2f0775ed407a94b8924ce50adb63 P e5256d91808b47c195bc9b4dbd7f2b87 [term 15 FOLLOWER]: Rejecting Update request from peer e61c3a8f61bb48f8a963c9480e53c168 for earlier term 14. Current term is 15. Ops: []
W20260709 13:07:10.325297 20078 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.2:46257, user_credentials={real_user=slave}} blocked reactor thread for 47854.6us
I20260709 13:07:10.296072 25998 raft_consensus.cc:2804] T 2b74109013a140ada21feeef92d6f563 P e5256d91808b47c195bc9b4dbd7f2b87 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:07:10.341440 25998 raft_consensus.cc:493] T 2b74109013a140ada21feeef92d6f563 P e5256d91808b47c195bc9b4dbd7f2b87 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:10.341885 25998 raft_consensus.cc:3060] T 2b74109013a140ada21feeef92d6f563 P e5256d91808b47c195bc9b4dbd7f2b87 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:07:10.316424 26043 raft_consensus.cc:493] T 172b3dd13109415a955b71ac0e9d2234 P 127766fc592545a4997f7790f50f6076 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 0473d2b2d01f4459b1e90fd12cc7840e)
I20260709 13:07:10.343802 19407 raft_consensus.cc:1275] T 22196caba61445d3bec98a0aab3c337d P e5256d91808b47c195bc9b4dbd7f2b87 [term 19 FOLLOWER]: Refusing update from remote peer e61c3a8f61bb48f8a963c9480e53c168: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
I20260709 13:07:10.345019 19551 raft_consensus.cc:2468] T 2b74109013a140ada21feeef92d6f563 P e61c3a8f61bb48f8a963c9480e53c168 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 17.
I20260709 13:07:10.328702 19402 raft_consensus.cc:2468] T f93ee515a9c14139bf566522ed8232f3 P e5256d91808b47c195bc9b4dbd7f2b87 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 22.
I20260709 13:07:10.347299 26115 raft_consensus.cc:2749] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P 127766fc592545a4997f7790f50f6076 [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 13:07:10.334636 19409 raft_consensus.cc:1240] T 40e1e16737a842ee936002830f36882e P e5256d91808b47c195bc9b4dbd7f2b87 [term 21 FOLLOWER]: Rejecting Update request from peer e61c3a8f61bb48f8a963c9480e53c168 for earlier term 20. Current term is 21. Ops: []
I20260709 13:07:10.347970 20105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7be9efa6559648dbb5a0f7684c4542d1" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 21 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076"
I20260709 13:07:10.348553 20105 raft_consensus.cc:3060] T 7be9efa6559648dbb5a0f7684c4542d1 P 127766fc592545a4997f7790f50f6076 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:07:10.351321 20108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62c6c134d3d24a1ab144dd9ee6bc3f64" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:07:10.352450 19449 leader_election.cc:304] T 76cb037fc9064d13b59a8969d897ce8c P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e; no voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:07:10.347173 20110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65d8cb8d6ec64f459d5a47cefab10acf" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:07:10.286798 26106 raft_consensus.cc:2804] T 96efeaaf1057492490e9a621f37e1a2d P 0473d2b2d01f4459b1e90fd12cc7840e [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:07:10.287647 25994 raft_consensus.cc:515] T 4af19371ea874c09a0a2147040835cbb P 127766fc592545a4997f7790f50f6076 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:07:10.360941 19552 raft_consensus.cc:1275] T 62c6c134d3d24a1ab144dd9ee6bc3f64 P e61c3a8f61bb48f8a963c9480e53c168 [term 18 FOLLOWER]: Refusing update from remote peer 127766fc592545a4997f7790f50f6076: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
I20260709 13:07:10.320621 25908 raft_consensus.cc:493] T 65d8cb8d6ec64f459d5a47cefab10acf P 127766fc592545a4997f7790f50f6076 [term 19 FOLLOWER]: Starting leader election (detected failure of leader e5256d91808b47c195bc9b4dbd7f2b87)
I20260709 13:07:10.363011 20107 raft_consensus.cc:1240] T 85c494af21f9457a85da47b9bc70c1fd P 127766fc592545a4997f7790f50f6076 [term 18 LEADER]: Rejecting Update request from peer e61c3a8f61bb48f8a963c9480e53c168 for earlier term 17. Current term is 18. Ops: []
W20260709 13:07:10.362231 20075 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.1:40321, user_credentials={real_user=slave}} blocked reactor thread for 95140.9us
W20260709 13:07:10.366140 19523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.1:40321, user_credentials={real_user=slave}} blocked reactor thread for 77053.2us
I20260709 13:07:10.366884 19523 leader_election.cc:304] T fa731b585f684a7fb2d106c50f143b83 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e61c3a8f61bb48f8a963c9480e53c168; no voters: 127766fc592545a4997f7790f50f6076, e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:07:10.374159 19375 leader_election.cc:304] T 28af091831594f9d8e96482078cc7625 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:07:10.376868 19375 leader_election.cc:304] T 65d8cb8d6ec64f459d5a47cefab10acf P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
W20260709 13:07:10.402158 20078 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.2:46257, user_credentials={real_user=slave}} blocked reactor thread for 60903.5us
I20260709 13:07:10.403518 20078 leader_election.cc:304] T ed7fdbcb96d14d418db9ca90a792588a P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 127766fc592545a4997f7790f50f6076; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:07:10.352818 26113 consensus_queue.cc:1048] T 5ec1c4ce15e04c7e8c283a62179f2a64 P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.010s
I20260709 13:07:10.305960 26008 raft_consensus.cc:515] T edd7d470b5014c9489be7f41f64355c9 P e5256d91808b47c195bc9b4dbd7f2b87 [term 24 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:07:10.361907 26061 raft_consensus.cc:493] T 21e14947d70440f19044d8f75c31e1f9 P e61c3a8f61bb48f8a963c9480e53c168 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:10.419803 19523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.1:40321, user_credentials={real_user=slave}} blocked reactor thread for 52992.9us
I20260709 13:07:10.373061 25908 raft_consensus.cc:3060] T 65d8cb8d6ec64f459d5a47cefab10acf P 127766fc592545a4997f7790f50f6076 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:07:10.379725 20105 raft_consensus.cc:2468] T 7be9efa6559648dbb5a0f7684c4542d1 P 127766fc592545a4997f7790f50f6076 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 21.
W20260709 13:07:10.424105 19449 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.1:40321, user_credentials={real_user=slave}} blocked reactor thread for 71741.1us
I20260709 13:07:10.364749 26035 raft_consensus.cc:2749] T ece3db938bc649d4a40a51522ed5259c P e61c3a8f61bb48f8a963c9480e53c168 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:07:10.404042 25997 raft_consensus.cc:2749] T 28af091831594f9d8e96482078cc7625 P e5256d91808b47c195bc9b4dbd7f2b87 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:07:10.426839 19523 leader_election.cc:304] T 86a6797bdfe94fa496c050ceae4bd0d9 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:07:10.361618 25987 raft_consensus.cc:2749] T 76cb037fc9064d13b59a8969d897ce8c P 0473d2b2d01f4459b1e90fd12cc7840e [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:07:10.372839 26106 raft_consensus.cc:697] T 96efeaaf1057492490e9a621f37e1a2d P 0473d2b2d01f4459b1e90fd12cc7840e [term 21 LEADER]: Becoming Leader. State: Replica: 0473d2b2d01f4459b1e90fd12cc7840e, State: Running, Role: LEADER
I20260709 13:07:10.411878 26097 raft_consensus.cc:2804] T 65d8cb8d6ec64f459d5a47cefab10acf P e5256d91808b47c195bc9b4dbd7f2b87 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:07:10.419621 26092 raft_consensus.cc:697] T 5ec1c4ce15e04c7e8c283a62179f2a64 P 127766fc592545a4997f7790f50f6076 [term 14 LEADER]: Becoming Leader. State: Replica: 127766fc592545a4997f7790f50f6076, State: Running, Role: LEADER
I20260709 13:07:10.420117 26115 raft_consensus.cc:493] T 9962423cb4e54fcfa5de01daf68a86e7 P 127766fc592545a4997f7790f50f6076 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:10.455226 19523 leader_election.cc:304] T 217b5fae677b4971b3bbd2f357a1f7ff P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168; no voters: 0473d2b2d01f4459b1e90fd12cc7840e
I20260709 13:07:10.379139 26043 raft_consensus.cc:515] T 172b3dd13109415a955b71ac0e9d2234 P 127766fc592545a4997f7790f50f6076 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:07:10.422574 26057 leader_election.cc:290] T 0cdf56e38bbc453d9438d359e5a69955 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:07:10.431504 26107 raft_consensus.cc:493] T 1a61655d99124a29b486ba4a5b37faea P e5256d91808b47c195bc9b4dbd7f2b87 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:10.472273 19449 leader_election.cc:304] T 7f575b143b844aa096b50997dad3516a P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e; no voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:07:10.438536 26118 raft_consensus.cc:2749] T ed7fdbcb96d14d418db9ca90a792588a P 127766fc592545a4997f7790f50f6076 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:07:10.452975 26097 raft_consensus.cc:493] T 65d8cb8d6ec64f459d5a47cefab10acf P e5256d91808b47c195bc9b4dbd7f2b87 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:07:10.475670 20078 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.2:46257, user_credentials={real_user=slave}} blocked reactor thread for 53885.2us
I20260709 13:07:10.466883 26059 raft_consensus.cc:2804] T 86a6797bdfe94fa496c050ceae4bd0d9 P e61c3a8f61bb48f8a963c9480e53c168 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:07:10.431695 26061 raft_consensus.cc:515] T 21e14947d70440f19044d8f75c31e1f9 P e61c3a8f61bb48f8a963c9480e53c168 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:07:10.470853 25530 consensus_queue.cc:1059] T 2e36a9d6e29c4a7c860cf267efbd4c74 P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 }, Status: INVALID_TERM, Last received: 13.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.010s
I20260709 13:07:10.488272 19484 raft_consensus.cc:1275] T 62c6c134d3d24a1ab144dd9ee6bc3f64 P 0473d2b2d01f4459b1e90fd12cc7840e [term 18 FOLLOWER]: Refusing update from remote peer 127766fc592545a4997f7790f50f6076: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
W20260709 13:07:10.483564 25905 consensus_meta.cc:287] T 0e1085d23e8347fbbd5bce7542f4b1f4 P 127766fc592545a4997f7790f50f6076: Time spent flushing consensus metadata: real 0.676s	user 0.008s	sys 0.003s
I20260709 13:07:10.489135 26065 raft_consensus.cc:493] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P e5256d91808b47c195bc9b4dbd7f2b87 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 0473d2b2d01f4459b1e90fd12cc7840e)
I20260709 13:07:10.490267 19482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1efebf73c86e432baa55533136b6e12c" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
W20260709 13:07:10.482863 26110 log.cc:927] Time spent T 179fd671030940b4b4a4e24bcc4aba0a P e5256d91808b47c195bc9b4dbd7f2b87: Append to log took a long time: real 0.144s	user 0.000s	sys 0.001s
W20260709 13:07:10.483667 20075 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.1:40321, user_credentials={real_user=slave}} blocked reactor thread for 50229.9us
I20260709 13:07:10.481710 26097 raft_consensus.cc:3060] T 65d8cb8d6ec64f459d5a47cefab10acf P e5256d91808b47c195bc9b4dbd7f2b87 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:07:10.500743 19449 leader_election.cc:304] T 40e1e16737a842ee936002830f36882e P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87; no voters: e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:07:10.503309 26033 raft_consensus.cc:2764] T 40e1e16737a842ee936002830f36882e P 0473d2b2d01f4459b1e90fd12cc7840e [term 21 FOLLOWER]: Leader pre-election decision vote started in defunct term 20: won
I20260709 13:07:10.504803 19526 leader_election.cc:304] T fa8650e71aa14778b3d73721fc50d9fc P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168; no voters: e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:07:10.506304 19407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "179fd671030940b4b4a4e24bcc4aba0a" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 22 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
I20260709 13:07:10.506603 19411 raft_consensus.cc:1240] T f1b10566f45d4a7d9029858330e02d5b P e5256d91808b47c195bc9b4dbd7f2b87 [term 19 LEADER]: Rejecting Update request from peer 0473d2b2d01f4459b1e90fd12cc7840e for earlier term 18. Current term is 19. Ops: []
I20260709 13:07:10.495987 19478 raft_consensus.cc:1275] T 14935b3ddf914369822e4a0547aaa355 P 0473d2b2d01f4459b1e90fd12cc7840e [term 14 FOLLOWER]: Refusing update from remote peer 127766fc592545a4997f7790f50f6076: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 13:07:10.507530 19409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46c5bfeecc314717bffe987e6844b6d0" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 26 candidate_status { last_received { term: 23 index: 12 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:07:10.497393 19482 raft_consensus.cc:3060] T 1efebf73c86e432baa55533136b6e12c P 0473d2b2d01f4459b1e90fd12cc7840e [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:07:10.510968 19402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "775c229504194560ba9589bc2199b089" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:07:10.512115 19407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc225c93219c45538b53a1bd3d387e4d" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
I20260709 13:07:10.512696 19407 raft_consensus.cc:3060] T bc225c93219c45538b53a1bd3d387e4d P e5256d91808b47c195bc9b4dbd7f2b87 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:07:10.514534 19478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b08304a0a02b42d7840c4e8ee9a6bd1a" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:07:10.515237 19478 raft_consensus.cc:2368] T b08304a0a02b42d7840c4e8ee9a6bd1a P 0473d2b2d01f4459b1e90fd12cc7840e [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate e61c3a8f61bb48f8a963c9480e53c168 for earlier term 20. Current term is 21.
I20260709 13:07:10.515162 19411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef32ce6fdd0e40d382c79974f30295c6" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 24 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:07:10.518704 19484 raft_consensus.cc:1240] T 40e1e16737a842ee936002830f36882e P 0473d2b2d01f4459b1e90fd12cc7840e [term 21 FOLLOWER]: Rejecting Update request from peer e61c3a8f61bb48f8a963c9480e53c168 for earlier term 20. Current term is 21. Ops: []
I20260709 13:07:10.518874 19411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9962423cb4e54fcfa5de01daf68a86e7" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:07:10.519596 19411 raft_consensus.cc:2393] T 9962423cb4e54fcfa5de01daf68a86e7 P e5256d91808b47c195bc9b4dbd7f2b87 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0473d2b2d01f4459b1e90fd12cc7840e in current term 18: Already voted for candidate e5256d91808b47c195bc9b4dbd7f2b87 in this term.
I20260709 13:07:10.520332 19409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e1f505cb0f1427bbd698ac889d80821" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:07:10.520500 19484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f93ee515a9c14139bf566522ed8232f3" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 23 candidate_status { last_received { term: 22 index: 11 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:07:10.523306 19402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dc5b3532fe54f74876d02beffa2c230" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:07:10.523751 19484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc225c93219c45538b53a1bd3d387e4d" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:07:10.524257 19402 raft_consensus.cc:2393] T 1dc5b3532fe54f74876d02beffa2c230 P e5256d91808b47c195bc9b4dbd7f2b87 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0473d2b2d01f4459b1e90fd12cc7840e in current term 21: Already voted for candidate e5256d91808b47c195bc9b4dbd7f2b87 in this term.
I20260709 13:07:10.525449 19482 raft_consensus.cc:2468] T 1efebf73c86e432baa55533136b6e12c P 0473d2b2d01f4459b1e90fd12cc7840e [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 127766fc592545a4997f7790f50f6076 in term 16.
I20260709 13:07:10.526304 19485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f575b143b844aa096b50997dad3516a" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:07:10.531590 19405 raft_consensus.cc:1240] T 5ec1c4ce15e04c7e8c283a62179f2a64 P e5256d91808b47c195bc9b4dbd7f2b87 [term 14 FOLLOWER]: Rejecting Update request from peer 0473d2b2d01f4459b1e90fd12cc7840e for earlier term 13. Current term is 14. Ops: [13.12-13.12]
I20260709 13:07:10.526688 19480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dc5b3532fe54f74876d02beffa2c230" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:07:10.482903 26059 raft_consensus.cc:493] T 86a6797bdfe94fa496c050ceae4bd0d9 P e61c3a8f61bb48f8a963c9480e53c168 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 0473d2b2d01f4459b1e90fd12cc7840e)
I20260709 13:07:10.527443 19478 raft_consensus.cc:1275] T 22196caba61445d3bec98a0aab3c337d P 0473d2b2d01f4459b1e90fd12cc7840e [term 19 FOLLOWER]: Refusing update from remote peer e61c3a8f61bb48f8a963c9480e53c168: Log matching property violated. Preceding OpId in replica: term: 18 index: 11. Preceding OpId from leader: term: 19 index: 12. (index mismatch)
I20260709 13:07:10.527725 19409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cdf56e38bbc453d9438d359e5a69955" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:07:10.527838 26033 consensus_queue.cc:1048] T 5ec1c4ce15e04c7e8c283a62179f2a64 P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Connected to new peer: Peer: permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:07:10.527462 19411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14efcc79969f41babe5529c22d59156d" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:07:10.525480 19484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62c6c134d3d24a1ab144dd9ee6bc3f64" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:07:10.529953 26097 raft_consensus.cc:515] T 65d8cb8d6ec64f459d5a47cefab10acf P e5256d91808b47c195bc9b4dbd7f2b87 [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:07:10.485229 25987 raft_consensus.cc:2749] T 7f575b143b844aa096b50997dad3516a P 0473d2b2d01f4459b1e90fd12cc7840e [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:07:10.484716 26035 raft_consensus.cc:2804] T 217b5fae677b4971b3bbd2f357a1f7ff P e61c3a8f61bb48f8a963c9480e53c168 [term 16 FOLLOWER]: Leader election won for term 16
W20260709 13:07:10.559978 19526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.2:46257, user_credentials={real_user=slave}} blocked reactor thread for 55256.9us
W20260709 13:07:10.559957 19523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.1:40321, user_credentials={real_user=slave}} blocked reactor thread for 66098.6us
I20260709 13:07:10.550624 19407 raft_consensus.cc:2468] T bc225c93219c45538b53a1bd3d387e4d P e5256d91808b47c195bc9b4dbd7f2b87 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 17.
I20260709 13:07:10.554636 19484 raft_consensus.cc:2368] T 62c6c134d3d24a1ab144dd9ee6bc3f64 P 0473d2b2d01f4459b1e90fd12cc7840e [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e61c3a8f61bb48f8a963c9480e53c168 for earlier term 17. Current term is 18.
I20260709 13:07:10.563060 19523 leader_election.cc:400] T b08304a0a02b42d7840c4e8ee9a6bd1a P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 20 election: Vote denied by peer e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321) with higher term. Message: Invalid argument: T b08304a0a02b42d7840c4e8ee9a6bd1a P e5256d91808b47c195bc9b4dbd7f2b87 [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate e61c3a8f61bb48f8a963c9480e53c168 for earlier term 20. Current term is 21.
I20260709 13:07:10.486451 25975 consensus_queue.cc:1048] T df751f992649444090e27965eb1af85d P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.053s
I20260709 13:07:10.470883 26107 raft_consensus.cc:515] T 1a61655d99124a29b486ba4a5b37faea P e5256d91808b47c195bc9b4dbd7f2b87 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:07:10.570309 19485 raft_consensus.cc:2393] T 7f575b143b844aa096b50997dad3516a P 0473d2b2d01f4459b1e90fd12cc7840e [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e61c3a8f61bb48f8a963c9480e53c168 in current term 17: Already voted for candidate 0473d2b2d01f4459b1e90fd12cc7840e in this term.
I20260709 13:07:10.527266 19449 leader_election.cc:304] T 0e1085d23e8347fbbd5bce7542f4b1f4 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e; no voters: 127766fc592545a4997f7790f50f6076, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:07:10.467391 26115 raft_consensus.cc:515] T 9962423cb4e54fcfa5de01daf68a86e7 P 127766fc592545a4997f7790f50f6076 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:07:10.563544 19523 leader_election.cc:403] T b08304a0a02b42d7840c4e8ee9a6bd1a P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 20 election: Cancelling election due to peer responding with higher term
I20260709 13:07:10.562575 19526 leader_election.cc:304] T 76cb037fc9064d13b59a8969d897ce8c P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168; no voters: e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:07:10.565026 20112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96efeaaf1057492490e9a621f37e1a2d" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:07:10.545476 26059 raft_consensus.cc:3060] T 86a6797bdfe94fa496c050ceae4bd0d9 P e61c3a8f61bb48f8a963c9480e53c168 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:07:10.567914 19409 raft_consensus.cc:2393] T 0cdf56e38bbc453d9438d359e5a69955 P e5256d91808b47c195bc9b4dbd7f2b87 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0473d2b2d01f4459b1e90fd12cc7840e in current term 19: Already voted for candidate e5256d91808b47c195bc9b4dbd7f2b87 in this term.
W20260709 13:07:10.552875 26122 log.cc:927] Time spent T fa731b585f684a7fb2d106c50f143b83 P e61c3a8f61bb48f8a963c9480e53c168: Append to log took a long time: real 0.115s	user 0.000s	sys 0.000s
W20260709 13:07:10.553246 26114 log.cc:927] Time spent T b08304a0a02b42d7840c4e8ee9a6bd1a P e5256d91808b47c195bc9b4dbd7f2b87: Append to log took a long time: real 0.133s	user 0.001s	sys 0.000s
I20260709 13:07:10.493801 25925 raft_consensus.cc:515] T 4509b76741dc428e9201c70c1658da13 P e5256d91808b47c195bc9b4dbd7f2b87 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:07:10.497074 25905 raft_consensus.cc:515] T 0e1085d23e8347fbbd5bce7542f4b1f4 P 127766fc592545a4997f7790f50f6076 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:07:10.595983 20105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "775c229504194560ba9589bc2199b089" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:07:10.572677 26035 raft_consensus.cc:697] T 217b5fae677b4971b3bbd2f357a1f7ff P e61c3a8f61bb48f8a963c9480e53c168 [term 16 LEADER]: Becoming Leader. State: Replica: e61c3a8f61bb48f8a963c9480e53c168, State: Running, Role: LEADER
I20260709 13:07:10.553565 26065 raft_consensus.cc:515] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P e5256d91808b47c195bc9b4dbd7f2b87 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
W20260709 13:07:10.623901 26127 log.cc:927] Time spent T a08760e15aac4630a629431f56024dc8 P 0473d2b2d01f4459b1e90fd12cc7840e: Append to log took a long time: real 0.131s	user 0.000s	sys 0.000s
I20260709 13:07:10.590989 26096 raft_consensus.cc:493] T b9f0d59553ad444883fcf5b5909f9798 P e5256d91808b47c195bc9b4dbd7f2b87 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 0473d2b2d01f4459b1e90fd12cc7840e)
I20260709 13:07:10.625749 26096 raft_consensus.cc:515] T b9f0d59553ad444883fcf5b5909f9798 P e5256d91808b47c195bc9b4dbd7f2b87 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:07:10.627246 25997 raft_consensus.cc:493] T 1dc5b3532fe54f74876d02beffa2c230 P e5256d91808b47c195bc9b4dbd7f2b87 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:10.627755 25997 raft_consensus.cc:515] T 1dc5b3532fe54f74876d02beffa2c230 P e5256d91808b47c195bc9b4dbd7f2b87 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:07:10.630473 20107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9962423cb4e54fcfa5de01daf68a86e7" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:07:10.631119 20107 raft_consensus.cc:2468] T 9962423cb4e54fcfa5de01daf68a86e7 P 127766fc592545a4997f7790f50f6076 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 18.
I20260709 13:07:10.632897 26133 raft_consensus.cc:2749] T b08304a0a02b42d7840c4e8ee9a6bd1a P e61c3a8f61bb48f8a963c9480e53c168 [term 21 FOLLOWER]: Leader election lost for term 20. Reason: Vote denied by peer e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321) with higher term. Message: Invalid argument: T b08304a0a02b42d7840c4e8ee9a6bd1a P e5256d91808b47c195bc9b4dbd7f2b87 [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate e61c3a8f61bb48f8a963c9480e53c168 for earlier term 20. Current term is 21.
I20260709 13:07:10.633670 26133 raft_consensus.cc:2804] T 76cb037fc9064d13b59a8969d897ce8c P e61c3a8f61bb48f8a963c9480e53c168 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:07:10.633992 26133 raft_consensus.cc:493] T 76cb037fc9064d13b59a8969d897ce8c P e61c3a8f61bb48f8a963c9480e53c168 [term 18 FOLLOWER]: Starting leader election (detected failure of leader e5256d91808b47c195bc9b4dbd7f2b87)
I20260709 13:07:10.634351 26133 raft_consensus.cc:3060] T 76cb037fc9064d13b59a8969d897ce8c P e61c3a8f61bb48f8a963c9480e53c168 [term 18 FOLLOWER]: Advancing to term 19
W20260709 13:07:10.643860 19449 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.4:43121, user_credentials={real_user=slave}} blocked reactor thread for 116667us
I20260709 13:07:10.603796 19556 raft_consensus.cc:1275] T 179fd671030940b4b4a4e24bcc4aba0a P e61c3a8f61bb48f8a963c9480e53c168 [term 22 FOLLOWER]: Refusing update from remote peer e5256d91808b47c195bc9b4dbd7f2b87: Log matching property violated. Preceding OpId in replica: term: 19 index: 12. Preceding OpId from leader: term: 22 index: 14. (index mismatch)
I20260709 13:07:10.602792 26125 raft_consensus.cc:2764] T fa8650e71aa14778b3d73721fc50d9fc P e61c3a8f61bb48f8a963c9480e53c168 [term 20 FOLLOWER]: Leader pre-election decision vote started in defunct term 19: won
I20260709 13:07:10.606814 26035 consensus_queue.cc:237] T 217b5fae677b4971b3bbd2f357a1f7ff P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:07:10.607230 25905 leader_election.cc:290] T 0e1085d23e8347fbbd5bce7542f4b1f4 P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 16 election: Requested vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:07:10.607400 25957 raft_consensus.cc:515] T 1dc5b3532fe54f74876d02beffa2c230 P 0473d2b2d01f4459b1e90fd12cc7840e [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:07:10.609548 25925 leader_election.cc:290] T 4509b76741dc428e9201c70c1658da13 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 13 election: Requested vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
W20260709 13:07:10.611697 26121 log.cc:927] Time spent T 76cb037fc9064d13b59a8969d897ce8c P e5256d91808b47c195bc9b4dbd7f2b87: Append to log took a long time: real 0.053s	user 0.000s	sys 0.000s
I20260709 13:07:10.612321 26116 raft_consensus.cc:493] T 4af19371ea874c09a0a2147040835cbb P e5256d91808b47c195bc9b4dbd7f2b87 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:10.666392 19553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edd7d470b5014c9489be7f41f64355c9" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 24 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:07:10.666463 26116 raft_consensus.cc:515] T 4af19371ea874c09a0a2147040835cbb P e5256d91808b47c195bc9b4dbd7f2b87 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:07:10.667100 19449 leader_election.cc:304] T 179fd671030940b4b4a4e24bcc4aba0a P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e; no voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:07:10.666648 20107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48824d5acfbc485ebf8c2d944e7202de" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:07:10.612969 25994 leader_election.cc:290] T 4af19371ea874c09a0a2147040835cbb P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:07:10.544086 26092 consensus_queue.cc:237] T 5ec1c4ce15e04c7e8c283a62179f2a64 P 127766fc592545a4997f7790f50f6076 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:07:10.668411 26057 raft_consensus.cc:2749] T 179fd671030940b4b4a4e24bcc4aba0a P 0473d2b2d01f4459b1e90fd12cc7840e [term 22 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
I20260709 13:07:10.670498 19449 leader_election.cc:304] T 46c5bfeecc314717bffe987e6844b6d0 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e; no voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:07:10.666421 19411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "172b3dd13109415a955b71ac0e9d2234" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
W20260709 13:07:10.648289 26130 log.cc:927] Time spent T a08760e15aac4630a629431f56024dc8 P e61c3a8f61bb48f8a963c9480e53c168: Append to log took a long time: real 0.077s	user 0.000s	sys 0.000s
I20260709 13:07:10.605144 26008 leader_election.cc:290] T edd7d470b5014c9489be7f41f64355c9 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 24 election: Requested vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:07:10.650326 19409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4af19371ea874c09a0a2147040835cbb" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 12 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:07:10.654487 19477 raft_consensus.cc:2468] T 7be9efa6559648dbb5a0f7684c4542d1 P 0473d2b2d01f4459b1e90fd12cc7840e [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 21.
I20260709 13:07:10.672147 19449 leader_election.cc:304] T ef32ce6fdd0e40d382c79974f30295c6 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e; no voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:07:10.667202 19553 raft_consensus.cc:3060] T edd7d470b5014c9489be7f41f64355c9 P e61c3a8f61bb48f8a963c9480e53c168 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:07:10.671625 19411 raft_consensus.cc:2468] T 172b3dd13109415a955b71ac0e9d2234 P e5256d91808b47c195bc9b4dbd7f2b87 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 127766fc592545a4997f7790f50f6076 in term 17.
I20260709 13:07:10.669082 26116 leader_election.cc:290] T 4af19371ea874c09a0a2147040835cbb P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:07:10.674702 26033 raft_consensus.cc:2749] T 46c5bfeecc314717bffe987e6844b6d0 P 0473d2b2d01f4459b1e90fd12cc7840e [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 13:07:10.673659 25975 consensus_queue.cc:1059] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false }, Status: INVALID_TERM, Last received: 20.16, Next index: 17, Last known committed idx: 16, Time since last communication: 0.049s
I20260709 13:07:10.719970 26113 raft_consensus.cc:2749] T ef32ce6fdd0e40d382c79974f30295c6 P 0473d2b2d01f4459b1e90fd12cc7840e [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:07:10.635553 25987 raft_consensus.cc:2749] T 0e1085d23e8347fbbd5bce7542f4b1f4 P 0473d2b2d01f4459b1e90fd12cc7840e [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 13:07:10.720112 19449 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.1:40321, user_credentials={real_user=slave}} blocked reactor thread for 48055.6us
I20260709 13:07:10.720651 26113 raft_consensus.cc:3055] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P 0473d2b2d01f4459b1e90fd12cc7840e [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:07:10.721029 26113 raft_consensus.cc:740] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P 0473d2b2d01f4459b1e90fd12cc7840e [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 0473d2b2d01f4459b1e90fd12cc7840e, State: Running, Role: LEADER
I20260709 13:07:10.721613 26097 leader_election.cc:290] T 65d8cb8d6ec64f459d5a47cefab10acf P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 21 election: Requested vote from peers e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:07:10.721827 26113 consensus_queue.cc:260] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P 0473d2b2d01f4459b1e90fd12cc7840e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 20.16, Last appended by leader: 16, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:07:10.716372 25957 leader_election.cc:290] T 1dc5b3532fe54f74876d02beffa2c230 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 21 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:07:10.716595 20107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96efeaaf1057492490e9a621f37e1a2d" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076"
I20260709 13:07:10.649845 26088 ts_tablet_manager.cc:1916] T ab43d85f64114d4ebf618930e43d9ed0 P e5256d91808b47c195bc9b4dbd7f2b87: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:07:10.724501 19409 raft_consensus.cc:2410] T 4af19371ea874c09a0a2147040835cbb P e5256d91808b47c195bc9b4dbd7f2b87 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 127766fc592545a4997f7790f50f6076 for term 12 because replica has last-logged OpId of term: 10 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 8.
I20260709 13:07:10.719164 19480 raft_consensus.cc:2468] T 1dc5b3532fe54f74876d02beffa2c230 P 0473d2b2d01f4459b1e90fd12cc7840e [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 21.
W20260709 13:07:10.744798 19526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.2:46257, user_credentials={real_user=slave}} blocked reactor thread for 182326us
I20260709 13:07:10.571133 26134 consensus_queue.cc:1059] T 85c494af21f9457a85da47b9bc70c1fd P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 }, Status: INVALID_TERM, Last received: 17.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.109s
I20260709 13:07:10.722361 19449 leader_election.cc:304] T 3e1f505cb0f1427bbd698ac889d80821 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e; no voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:07:10.707113 19559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4509b76741dc428e9201c70c1658da13" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:07:10.775878 19409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dc5b3532fe54f74876d02beffa2c230" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
I20260709 13:07:10.778537 19409 raft_consensus.cc:2393] T 1dc5b3532fe54f74876d02beffa2c230 P e5256d91808b47c195bc9b4dbd7f2b87 [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate 0473d2b2d01f4459b1e90fd12cc7840e in current term 21: Already voted for candidate e5256d91808b47c195bc9b4dbd7f2b87 in this term.
W20260709 13:07:10.711676 26044 consensus_meta.cc:287] T 96efeaaf1057492490e9a621f37e1a2d P 127766fc592545a4997f7790f50f6076: Time spent flushing consensus metadata: real 0.653s	user 0.003s	sys 0.009s
I20260709 13:07:10.743167 26113 raft_consensus.cc:3060] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P 0473d2b2d01f4459b1e90fd12cc7840e [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:07:10.755056 19526 leader_election.cc:304] T 1efebf73c86e432baa55533136b6e12c P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:07:10.708148 26107 leader_election.cc:290] T 1a61655d99124a29b486ba4a5b37faea P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:07:10.698917 26057 raft_consensus.cc:493] T ed7fdbcb96d14d418db9ca90a792588a P 0473d2b2d01f4459b1e90fd12cc7840e [term 16 FOLLOWER]: Starting pre-election (detected failure of leader e61c3a8f61bb48f8a963c9480e53c168)
I20260709 13:07:10.790449 20107 raft_consensus.cc:1240] T ff9b0eddd810459b82d91c60777c10eb P 127766fc592545a4997f7790f50f6076 [term 20 FOLLOWER]: Rejecting Update request from peer 0473d2b2d01f4459b1e90fd12cc7840e for earlier term 19. Current term is 20. Ops: [17.13-19.14]
I20260709 13:07:10.575532 26106 consensus_queue.cc:237] T 96efeaaf1057492490e9a621f37e1a2d P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 19.13, Last appended by leader: 13, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:07:10.712383 25997 leader_election.cc:290] T 1dc5b3532fe54f74876d02beffa2c230 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:07:10.775676 26065 leader_election.cc:290] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:07:10.776923 25987 raft_consensus.cc:2749] T 3e1f505cb0f1427bbd698ac889d80821 P 0473d2b2d01f4459b1e90fd12cc7840e [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:07:10.713613 26061 leader_election.cc:290] T 21e14947d70440f19044d8f75c31e1f9 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:07:10.709187 26115 leader_election.cc:290] T 9962423cb4e54fcfa5de01daf68a86e7 P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:07:10.782496 26043 leader_election.cc:290] T 172b3dd13109415a955b71ac0e9d2234 P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
W20260709 13:07:10.794858 25964 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.554s	user 0.012s	sys 0.046s
I20260709 13:07:10.829855 20107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14efcc79969f41babe5529c22d59156d" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:07:10.814524 26057 raft_consensus.cc:515] T ed7fdbcb96d14d418db9ca90a792588a P 0473d2b2d01f4459b1e90fd12cc7840e [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:07:10.834362 26057 leader_election.cc:290] T ed7fdbcb96d14d418db9ca90a792588a P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:07:10.837461 19559 raft_consensus.cc:2468] T 4509b76741dc428e9201c70c1658da13 P e61c3a8f61bb48f8a963c9480e53c168 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 13.
I20260709 13:07:10.722620 25819 consensus_queue.cc:1059] T 7f575b143b844aa096b50997dad3516a P e5256d91808b47c195bc9b4dbd7f2b87 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 }, Status: INVALID_TERM, Last received: 14.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.091s
I20260709 13:07:10.779523 25957 consensus_queue.cc:1059] T 5ec1c4ce15e04c7e8c283a62179f2a64 P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 }, Status: INVALID_TERM, Last received: 12.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.038s
W20260709 13:07:10.844117 19523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.1:40321, user_credentials={real_user=slave}} blocked reactor thread for 281175us
I20260709 13:07:10.818979 26134 raft_consensus.cc:2804] T 1efebf73c86e432baa55533136b6e12c P e61c3a8f61bb48f8a963c9480e53c168 [term 14 FOLLOWER]: Leader pre-election won for term 15
W20260709 13:07:10.845983 19374 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.4:43121, user_credentials={real_user=slave}} blocked reactor thread for 192948us
W20260709 13:07:10.830648 25964 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.590s	user 0.012s	sys 0.046s
I20260709 13:07:10.844836 19523 leader_election.cc:304] T edd7d470b5014c9489be7f41f64355c9 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168; no voters: 0473d2b2d01f4459b1e90fd12cc7840e
I20260709 13:07:10.851050 20105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed7fdbcb96d14d418db9ca90a792588a" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:07:10.853088 19449 leader_election.cc:304] T 775c229504194560ba9589bc2199b089 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e; no voters: 127766fc592545a4997f7790f50f6076, e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:07:10.853538 20105 raft_consensus.cc:2393] T ed7fdbcb96d14d418db9ca90a792588a P 127766fc592545a4997f7790f50f6076 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0473d2b2d01f4459b1e90fd12cc7840e in current term 17: Already voted for candidate 127766fc592545a4997f7790f50f6076 in this term.
I20260709 13:07:10.785290 26044 raft_consensus.cc:515] T 96efeaaf1057492490e9a621f37e1a2d P 127766fc592545a4997f7790f50f6076 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:07:10.851459 20075 leader_election.cc:304] T 172b3dd13109415a955b71ac0e9d2234 P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 127766fc592545a4997f7790f50f6076, e5256d91808b47c195bc9b4dbd7f2b87; no voters: 
I20260709 13:07:10.854280 19449 leader_election.cc:304] T 9962423cb4e54fcfa5de01daf68a86e7 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, 127766fc592545a4997f7790f50f6076; no voters: e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:07:10.711040 26096 leader_election.cc:290] T b9f0d59553ad444883fcf5b5909f9798 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:07:10.867769 20104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4af19371ea874c09a0a2147040835cbb" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:07:10.870069 19449 leader_election.cc:304] T 48824d5acfbc485ebf8c2d944e7202de P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e; no voters: 127766fc592545a4997f7790f50f6076, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:07:10.868435 20104 raft_consensus.cc:2468] T 4af19371ea874c09a0a2147040835cbb P 127766fc592545a4997f7790f50f6076 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 11.
I20260709 13:07:10.906832 20109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65d8cb8d6ec64f459d5a47cefab10acf" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076"
I20260709 13:07:10.935060 19409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9962423cb4e54fcfa5de01daf68a86e7" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:07:10.936532 20105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36f6ba92b9ba46babe4ebd6c02e5fbd9" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:07:10.937423 20105 raft_consensus.cc:2393] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P 127766fc592545a4997f7790f50f6076 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e5256d91808b47c195bc9b4dbd7f2b87 in current term 21: Already voted for candidate 127766fc592545a4997f7790f50f6076 in this term.
I20260709 13:07:10.852056 26134 raft_consensus.cc:493] T 1efebf73c86e432baa55533136b6e12c P e61c3a8f61bb48f8a963c9480e53c168 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 0473d2b2d01f4459b1e90fd12cc7840e)
I20260709 13:07:10.935833 19409 raft_consensus.cc:2468] T 9962423cb4e54fcfa5de01daf68a86e7 P e5256d91808b47c195bc9b4dbd7f2b87 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 127766fc592545a4997f7790f50f6076 in term 18.
I20260709 13:07:10.997457 19377 leader_election.cc:304] T 40e1e16737a842ee936002830f36882e P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87; no voters: e61c3a8f61bb48f8a963c9480e53c168
W20260709 13:07:10.915032 20076 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.17.223.3:36891 timed out after 1.959s (SENT) [suppressed 6 similar messages]
I20260709 13:07:10.937824 20112 raft_consensus.cc:2468] T 96efeaaf1057492490e9a621f37e1a2d P 127766fc592545a4997f7790f50f6076 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 20.
I20260709 13:07:11.006170 20111 raft_consensus.cc:1240] T 5ec1c4ce15e04c7e8c283a62179f2a64 P 127766fc592545a4997f7790f50f6076 [term 14 LEADER]: Rejecting Update request from peer 0473d2b2d01f4459b1e90fd12cc7840e for earlier term 13. Current term is 14. Ops: [13.12-13.12]
I20260709 13:07:10.906559 26115 raft_consensus.cc:2804] T 172b3dd13109415a955b71ac0e9d2234 P 127766fc592545a4997f7790f50f6076 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:07:10.906366 25957 raft_consensus.cc:2749] T 775c229504194560ba9589bc2199b089 P 0473d2b2d01f4459b1e90fd12cc7840e [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:07:10.912585 25987 raft_consensus.cc:2804] T 9962423cb4e54fcfa5de01daf68a86e7 P 0473d2b2d01f4459b1e90fd12cc7840e [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:07:10.930729 25964 raft_consensus.cc:2749] T 48824d5acfbc485ebf8c2d944e7202de P 0473d2b2d01f4459b1e90fd12cc7840e [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:07:11.013833 20108 raft_consensus.cc:1275] T ff9b0eddd810459b82d91c60777c10eb P 127766fc592545a4997f7790f50f6076 [term 20 FOLLOWER]: Refusing update from remote peer e5256d91808b47c195bc9b4dbd7f2b87: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 20 index: 14. (index mismatch)
I20260709 13:07:10.934001 25975 raft_consensus.cc:3055] T 5ec1c4ce15e04c7e8c283a62179f2a64 P 0473d2b2d01f4459b1e90fd12cc7840e [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:07:10.991690 26135 raft_consensus.cc:493] T 2725d2c4cb054f18b0fc8f735c15f6c2 P e5256d91808b47c195bc9b4dbd7f2b87 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 0473d2b2d01f4459b1e90fd12cc7840e)
I20260709 13:07:10.846067 26137 consensus_queue.cc:1048] T 7be9efa6559648dbb5a0f7684c4542d1 P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 9, Time since last communication: 0.165s
W20260709 13:07:11.025745 19449 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.4:43121, user_credentials={real_user=slave}} blocked reactor thread for 155770us
I20260709 13:07:11.003469 26134 raft_consensus.cc:3060] T 1efebf73c86e432baa55533136b6e12c P e61c3a8f61bb48f8a963c9480e53c168 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:07:11.078289 26057 consensus_queue.cc:1059] T ff9b0eddd810459b82d91c60777c10eb P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false }, Status: INVALID_TERM, Last received: 16.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:07:11.080111 26057 raft_consensus.cc:3055] T ff9b0eddd810459b82d91c60777c10eb P 0473d2b2d01f4459b1e90fd12cc7840e [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:07:11.080461 26057 raft_consensus.cc:740] T ff9b0eddd810459b82d91c60777c10eb P 0473d2b2d01f4459b1e90fd12cc7840e [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 0473d2b2d01f4459b1e90fd12cc7840e, State: Running, Role: LEADER
I20260709 13:07:11.081317 26057 consensus_queue.cc:260] T ff9b0eddd810459b82d91c60777c10eb P 0473d2b2d01f4459b1e90fd12cc7840e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 19.14, Last appended by leader: 14, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:07:11.009927 26065 raft_consensus.cc:493] T e381f1d6b8184797ad142de49be225a8 P e5256d91808b47c195bc9b4dbd7f2b87 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:11.014447 26115 raft_consensus.cc:493] T 172b3dd13109415a955b71ac0e9d2234 P 127766fc592545a4997f7790f50f6076 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 0473d2b2d01f4459b1e90fd12cc7840e)
I20260709 13:07:11.017338 25987 raft_consensus.cc:493] T 9962423cb4e54fcfa5de01daf68a86e7 P 0473d2b2d01f4459b1e90fd12cc7840e [term 17 FOLLOWER]: Starting leader election (detected failure of leader 127766fc592545a4997f7790f50f6076)
I20260709 13:07:11.100348 26101 raft_consensus.cc:3055] T 2e36a9d6e29c4a7c860cf267efbd4c74 P 0473d2b2d01f4459b1e90fd12cc7840e [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:07:11.087797 26142 raft_consensus.cc:2804] T 40e1e16737a842ee936002830f36882e P e5256d91808b47c195bc9b4dbd7f2b87 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:07:11.103886 26141 raft_consensus.cc:493] T 0cdf56e38bbc453d9438d359e5a69955 P e5256d91808b47c195bc9b4dbd7f2b87 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:11.104431 26065 raft_consensus.cc:515] T e381f1d6b8184797ad142de49be225a8 P e5256d91808b47c195bc9b4dbd7f2b87 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:07:11.109934 26044 leader_election.cc:290] T 96efeaaf1057492490e9a621f37e1a2d P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 20 election: Requested vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
W20260709 13:07:11.130602 19526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.2:46257, user_credentials={real_user=slave}} blocked reactor thread for 299302us
I20260709 13:07:11.038823 25975 raft_consensus.cc:740] T 5ec1c4ce15e04c7e8c283a62179f2a64 P 0473d2b2d01f4459b1e90fd12cc7840e [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 0473d2b2d01f4459b1e90fd12cc7840e, State: Running, Role: LEADER
I20260709 13:07:11.082505 26057 raft_consensus.cc:3060] T ff9b0eddd810459b82d91c60777c10eb P 0473d2b2d01f4459b1e90fd12cc7840e [term 19 FOLLOWER]: Advancing to term 20
W20260709 13:07:11.135311 26133 consensus_meta.cc:287] T 76cb037fc9064d13b59a8969d897ce8c P e61c3a8f61bb48f8a963c9480e53c168: Time spent flushing consensus metadata: real 0.500s	user 0.003s	sys 0.007s
I20260709 13:07:11.018344 26059 raft_consensus.cc:515] T 86a6797bdfe94fa496c050ceae4bd0d9 P e61c3a8f61bb48f8a963c9480e53c168 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:07:11.085323 26116 raft_consensus.cc:493] T 22196caba61445d3bec98a0aab3c337d P e5256d91808b47c195bc9b4dbd7f2b87 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:11.156910 19526 leader_election.cc:400] T b08304a0a02b42d7840c4e8ee9a6bd1a P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 20 election: Vote denied by peer 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257) with higher term. Message: Invalid argument: T b08304a0a02b42d7840c4e8ee9a6bd1a P 0473d2b2d01f4459b1e90fd12cc7840e [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate e61c3a8f61bb48f8a963c9480e53c168 for earlier term 20. Current term is 21.
I20260709 13:07:11.095947 26115 raft_consensus.cc:3060] T 172b3dd13109415a955b71ac0e9d2234 P 127766fc592545a4997f7790f50f6076 [term 17 FOLLOWER]: Advancing to term 18
W20260709 13:07:11.151537 19449 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:11.133133 26101 raft_consensus.cc:740] T 2e36a9d6e29c4a7c860cf267efbd4c74 P 0473d2b2d01f4459b1e90fd12cc7840e [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 0473d2b2d01f4459b1e90fd12cc7840e, State: Running, Role: LEADER
I20260709 13:07:11.134572 25851 raft_consensus.cc:2749] T fa731b585f684a7fb2d106c50f143b83 P e61c3a8f61bb48f8a963c9480e53c168 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:07:11.132365 25987 raft_consensus.cc:3060] T 9962423cb4e54fcfa5de01daf68a86e7 P 0473d2b2d01f4459b1e90fd12cc7840e [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:07:11.177047 26142 raft_consensus.cc:697] T 40e1e16737a842ee936002830f36882e P e5256d91808b47c195bc9b4dbd7f2b87 [term 21 LEADER]: Becoming Leader. State: Replica: e5256d91808b47c195bc9b4dbd7f2b87, State: Running, Role: LEADER
W20260709 13:07:11.190878 19523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.1:40321, user_credentials={real_user=slave}} blocked reactor thread for 346103us
I20260709 13:07:11.084923 26135 raft_consensus.cc:515] T 2725d2c4cb054f18b0fc8f735c15f6c2 P e5256d91808b47c195bc9b4dbd7f2b87 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:07:11.228796 25975 consensus_queue.cc:260] T 5ec1c4ce15e04c7e8c283a62179f2a64 P 0473d2b2d01f4459b1e90fd12cc7840e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.12, Last appended by leader: 12, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:07:11.230116 25975 raft_consensus.cc:3060] T 5ec1c4ce15e04c7e8c283a62179f2a64 P 0473d2b2d01f4459b1e90fd12cc7840e [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:07:11.237856 25998 consensus_meta.cc:287] T 2b74109013a140ada21feeef92d6f563 P e5256d91808b47c195bc9b4dbd7f2b87: Time spent flushing consensus metadata: real 0.896s	user 0.012s	sys 0.000s
I20260709 13:07:11.226572 25957 raft_consensus.cc:493] T d1e5873a19244c5ebbcd38e126796ee7 P 0473d2b2d01f4459b1e90fd12cc7840e [term 22 FOLLOWER]: Starting pre-election (detected failure of leader e5256d91808b47c195bc9b4dbd7f2b87)
I20260709 13:07:11.244415 25957 raft_consensus.cc:515] T d1e5873a19244c5ebbcd38e126796ee7 P 0473d2b2d01f4459b1e90fd12cc7840e [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:07:11.238517 25747 raft_consensus.cc:3055] T 85c494af21f9457a85da47b9bc70c1fd P e61c3a8f61bb48f8a963c9480e53c168 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:07:11.246913 25747 raft_consensus.cc:740] T 85c494af21f9457a85da47b9bc70c1fd P e61c3a8f61bb48f8a963c9480e53c168 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: e61c3a8f61bb48f8a963c9480e53c168, State: Running, Role: LEADER
I20260709 13:07:11.247781 25747 consensus_queue.cc:260] T 85c494af21f9457a85da47b9bc70c1fd P e61c3a8f61bb48f8a963c9480e53c168 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.13, Last appended by leader: 13, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:07:11.248216 19552 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41504 (request call id 1072) took 1355 ms. Trace:
I20260709 13:07:11.248970 19552 rpcz_store.cc:276] 0709 13:07:09.893135 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:09.893347 (+   212us) service_pool.cc:224] Handling call
0709 13:07:10.137243 (+243896us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:10.363506 (+226263us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:11.248030 (+884524us) spinlock_profiling.cc:243] Waited 240 ms on lock 0x7b54000f05d0. stack: 00007f4a79de9343 00007f4a79de9240 00007f4a797781d4 00007f4a834b6304 00007f4a834b6299 00007f4a7ce71571 00007f4a7cf078ad 00007f4a81ecc419 00007f4a7b443bd4 00007f4a7b443b62 00007f4a7b443a91 00007f4a7b443a0c 00007f4a7b442cc2 00007f4a7b24348c 00007f4a7b2428c6 00007f4a7b24226f
0709 13:07:11.248161 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":551718656}
I20260709 13:07:11.246454 25957 leader_election.cc:290] T d1e5873a19244c5ebbcd38e126796ee7 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
W20260709 13:07:11.255249 26136 log.cc:927] Time spent T bc225c93219c45538b53a1bd3d387e4d P 0473d2b2d01f4459b1e90fd12cc7840e: Append to log took a long time: real 0.120s	user 0.000s	sys 0.000s
I20260709 13:07:11.255755 20075 leader_election.cc:304] T 9962423cb4e54fcfa5de01daf68a86e7 P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 127766fc592545a4997f7790f50f6076, e5256d91808b47c195bc9b4dbd7f2b87; no voters: 
I20260709 13:07:11.256942 25905 raft_consensus.cc:2804] T 9962423cb4e54fcfa5de01daf68a86e7 P 127766fc592545a4997f7790f50f6076 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:07:11.257340 25905 raft_consensus.cc:493] T 9962423cb4e54fcfa5de01daf68a86e7 P 127766fc592545a4997f7790f50f6076 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:11.257681 25905 raft_consensus.cc:3060] T 9962423cb4e54fcfa5de01daf68a86e7 P 127766fc592545a4997f7790f50f6076 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:07:11.250216 25998 raft_consensus.cc:515] T 2b74109013a140ada21feeef92d6f563 P e5256d91808b47c195bc9b4dbd7f2b87 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:07:11.261067 25998 leader_election.cc:290] T 2b74109013a140ada21feeef92d6f563 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 18 election: Requested vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:07:11.241080 25988 consensus_queue.cc:1059] T 40e1e16737a842ee936002830f36882e P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 }, Status: INVALID_TERM, Last received: 20.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:07:11.263967 19374 leader_election.cc:304] T 4af19371ea874c09a0a2147040835cbb P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 127766fc592545a4997f7790f50f6076, e5256d91808b47c195bc9b4dbd7f2b87; no voters: 
I20260709 13:07:11.187449 26133 raft_consensus.cc:515] T 76cb037fc9064d13b59a8969d897ce8c P e61c3a8f61bb48f8a963c9480e53c168 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:07:11.266564 25993 raft_consensus.cc:493] T 21e14947d70440f19044d8f75c31e1f9 P e5256d91808b47c195bc9b4dbd7f2b87 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:11.268375 25992 raft_consensus.cc:2804] T 4af19371ea874c09a0a2147040835cbb P e5256d91808b47c195bc9b4dbd7f2b87 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:07:11.268851 25992 raft_consensus.cc:493] T 4af19371ea874c09a0a2147040835cbb P e5256d91808b47c195bc9b4dbd7f2b87 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:11.268642 25993 raft_consensus.cc:515] T 21e14947d70440f19044d8f75c31e1f9 P e5256d91808b47c195bc9b4dbd7f2b87 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:07:11.269251 25992 raft_consensus.cc:3060] T 4af19371ea874c09a0a2147040835cbb P e5256d91808b47c195bc9b4dbd7f2b87 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:11.270484 26065 leader_election.cc:290] T e381f1d6b8184797ad142de49be225a8 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:07:11.190937 26116 raft_consensus.cc:515] T 22196caba61445d3bec98a0aab3c337d P e5256d91808b47c195bc9b4dbd7f2b87 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:07:11.176753 26141 raft_consensus.cc:515] T 0cdf56e38bbc453d9438d359e5a69955 P e5256d91808b47c195bc9b4dbd7f2b87 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
W20260709 13:07:11.265513 25908 consensus_meta.cc:287] T 65d8cb8d6ec64f459d5a47cefab10acf P 127766fc592545a4997f7790f50f6076: Time spent flushing consensus metadata: real 0.833s	user 0.015s	sys 0.000s
W20260709 13:07:11.282708 20076 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.3:36891, user_credentials={real_user=slave}} blocked reactor thread for 367695us
I20260709 13:07:11.265024 26147 raft_consensus.cc:493] T ab43d85f64114d4ebf618930e43d9ed0 P e61c3a8f61bb48f8a963c9480e53c168 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:11.297147 19557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cdf56e38bbc453d9438d359e5a69955" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:07:11.297998 19557 raft_consensus.cc:2468] T 0cdf56e38bbc453d9438d359e5a69955 P e61c3a8f61bb48f8a963c9480e53c168 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 19.
I20260709 13:07:11.267095 26125 consensus_queue.cc:1048] T 22196caba61445d3bec98a0aab3c337d P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.033s
I20260709 13:07:11.297289 25908 raft_consensus.cc:515] T 65d8cb8d6ec64f459d5a47cefab10acf P 127766fc592545a4997f7790f50f6076 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:07:11.306783 20110 raft_consensus.cc:2468] T 65d8cb8d6ec64f459d5a47cefab10acf P 127766fc592545a4997f7790f50f6076 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 20.
I20260709 13:07:11.311527 26059 leader_election.cc:290] T 86a6797bdfe94fa496c050ceae4bd0d9 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 16 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:07:11.319162 26133 leader_election.cc:290] T 76cb037fc9064d13b59a8969d897ce8c P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 19 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:07:11.320739 26141 leader_election.cc:290] T 0cdf56e38bbc453d9438d359e5a69955 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:07:11.284907 25993 leader_election.cc:290] T 21e14947d70440f19044d8f75c31e1f9 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
W20260709 13:07:11.297866 19553 consensus_meta.cc:287] T edd7d470b5014c9489be7f41f64355c9 P e61c3a8f61bb48f8a963c9480e53c168: Time spent flushing consensus metadata: real 0.575s	user 0.011s	sys 0.000s
I20260709 13:07:11.325759 19553 raft_consensus.cc:2468] T edd7d470b5014c9489be7f41f64355c9 P e61c3a8f61bb48f8a963c9480e53c168 [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 24.
W20260709 13:07:11.324815 19526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.2:46257, user_credentials={real_user=slave}} blocked reactor thread for 133599us
W20260709 13:07:11.304374 26113 consensus_meta.cc:287] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P 0473d2b2d01f4459b1e90fd12cc7840e: Time spent flushing consensus metadata: real 0.518s	user 0.006s	sys 0.003s
W20260709 13:07:11.359921 19523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.1:40321, user_credentials={real_user=slave}} blocked reactor thread for 134147us
I20260709 13:07:11.360818 19523 leader_election.cc:304] T f93ee515a9c14139bf566522ed8232f3 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168; no voters: 0473d2b2d01f4459b1e90fd12cc7840e
I20260709 13:07:11.331238 26151 raft_consensus.cc:3055] T 40e1e16737a842ee936002830f36882e P e61c3a8f61bb48f8a963c9480e53c168 [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:07:11.291193 26065 consensus_queue.cc:1048] T ff9b0eddd810459b82d91c60777c10eb P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Connected to new peer: Peer: permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.037s
W20260709 13:07:11.372356 26145 log.cc:927] Time spent T 5ec1c4ce15e04c7e8c283a62179f2a64 P 127766fc592545a4997f7790f50f6076: Append to log took a long time: real 0.145s	user 0.000s	sys 0.000s
I20260709 13:07:11.373145 20110 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35874 (request call id 1198) took 1027 ms. Trace:
I20260709 13:07:11.373673 20110 rpcz_store.cc:276] 0709 13:07:10.346007 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:10.346792 (+   785us) service_pool.cc:224] Handling call
0709 13:07:11.372919 (+1026127us) spinlock_profiling.cc:243] Waited 953 ms on lock 0x7b540036fe54. stack: 00007f4a79de9343 00007f4a79de9240 00007f4a797781d4 00007f4a834b6304 00007f4a834b6299 00007f4a7ce71571 00007f4a7cf0c2fa 00007f4a81ecdb17 00007f4a7b4486d4 00007f4a7b448662 00007f4a7b448591 00007f4a7b44850c 00007f4a7b4477c2 00007f4a7b24348c 00007f4a7b2428c6 00007f4a7b24226f
0709 13:07:11.373065 (+   146us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2192294272}
I20260709 13:07:11.374388 26116 leader_election.cc:290] T 22196caba61445d3bec98a0aab3c337d P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:07:11.378592 26069 raft_consensus.cc:3060] T 7f575b143b844aa096b50997dad3516a P e5256d91808b47c195bc9b4dbd7f2b87 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:07:11.366082 26151 raft_consensus.cc:740] T 40e1e16737a842ee936002830f36882e P e61c3a8f61bb48f8a963c9480e53c168 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: e61c3a8f61bb48f8a963c9480e53c168, State: Running, Role: LEADER
I20260709 13:07:11.330329 26143 raft_consensus.cc:2764] T edd7d470b5014c9489be7f41f64355c9 P e61c3a8f61bb48f8a963c9480e53c168 [term 24 FOLLOWER]: Leader election decision vote started in defunct term 23: won
W20260709 13:07:11.424728 19523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.1:40321, user_credentials={real_user=slave}} blocked reactor thread for 60620us
I20260709 13:07:11.416540 26001 consensus_queue.cc:1048] T 179fd671030940b4b4a4e24bcc4aba0a P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:07:11.363179 26113 raft_consensus.cc:493] T fa8650e71aa14778b3d73721fc50d9fc P 0473d2b2d01f4459b1e90fd12cc7840e [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:11.352510 26137 raft_consensus.cc:493] T 70797e5783b5454ab0d0eea663e791e3 P e61c3a8f61bb48f8a963c9480e53c168 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader e5256d91808b47c195bc9b4dbd7f2b87)
I20260709 13:07:11.444172 26113 raft_consensus.cc:515] T fa8650e71aa14778b3d73721fc50d9fc P 0473d2b2d01f4459b1e90fd12cc7840e [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:07:11.351145 26133 raft_consensus.cc:493] T 1a61655d99124a29b486ba4a5b37faea P e61c3a8f61bb48f8a963c9480e53c168 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:11.445088 26133 raft_consensus.cc:515] T 1a61655d99124a29b486ba4a5b37faea P e61c3a8f61bb48f8a963c9480e53c168 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:07:11.446302 26113 leader_election.cc:290] T fa8650e71aa14778b3d73721fc50d9fc P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:07:11.447093 26133 leader_election.cc:290] T 1a61655d99124a29b486ba4a5b37faea P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:07:11.451234 26151 consensus_queue.cc:260] T 40e1e16737a842ee936002830f36882e P e61c3a8f61bb48f8a963c9480e53c168 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 20.11, Last appended by leader: 11, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:07:11.452703 26151 raft_consensus.cc:3060] T 40e1e16737a842ee936002830f36882e P e61c3a8f61bb48f8a963c9480e53c168 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:07:11.454368 26057 raft_consensus.cc:493] T 14935b3ddf914369822e4a0547aaa355 P 0473d2b2d01f4459b1e90fd12cc7840e [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:11.455161 26057 raft_consensus.cc:515] T 14935b3ddf914369822e4a0547aaa355 P 0473d2b2d01f4459b1e90fd12cc7840e [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:07:11.458138 26057 leader_election.cc:290] T 14935b3ddf914369822e4a0547aaa355 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:07:11.458869 26035 raft_consensus.cc:2804] T f93ee515a9c14139bf566522ed8232f3 P e61c3a8f61bb48f8a963c9480e53c168 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:07:11.459281 26035 raft_consensus.cc:493] T f93ee515a9c14139bf566522ed8232f3 P e61c3a8f61bb48f8a963c9480e53c168 [term 22 FOLLOWER]: Starting leader election (detected failure of leader 0473d2b2d01f4459b1e90fd12cc7840e)
I20260709 13:07:11.459630 26035 raft_consensus.cc:3060] T f93ee515a9c14139bf566522ed8232f3 P e61c3a8f61bb48f8a963c9480e53c168 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:07:11.460620 19407 raft_consensus.cc:1240] T 2e36a9d6e29c4a7c860cf267efbd4c74 P e5256d91808b47c195bc9b4dbd7f2b87 [term 14 FOLLOWER]: Rejecting Update request from peer 0473d2b2d01f4459b1e90fd12cc7840e for earlier term 13. Current term is 14. Ops: []
I20260709 13:07:11.465253 19407 raft_consensus.cc:1275] T 1a61655d99124a29b486ba4a5b37faea P e5256d91808b47c195bc9b4dbd7f2b87 [term 18 FOLLOWER]: Refusing update from remote peer 0473d2b2d01f4459b1e90fd12cc7840e: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 18 index: 12. (index mismatch)
I20260709 13:07:11.468043 25905 raft_consensus.cc:515] T 9962423cb4e54fcfa5de01daf68a86e7 P 127766fc592545a4997f7790f50f6076 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:07:11.423245 19375 leader_election.cc:304] T 4509b76741dc428e9201c70c1658da13 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:07:11.427291 26135 leader_election.cc:290] T 2725d2c4cb054f18b0fc8f735c15f6c2 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:07:11.327797 26142 consensus_queue.cc:237] T 40e1e16737a842ee936002830f36882e P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 20.11, Last appended by leader: 11, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:07:11.303791 26147 raft_consensus.cc:515] T ab43d85f64114d4ebf618930e43d9ed0 P e61c3a8f61bb48f8a963c9480e53c168 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:07:11.433674 20105 raft_consensus.cc:1240] T ed7fdbcb96d14d418db9ca90a792588a P 127766fc592545a4997f7790f50f6076 [term 17 FOLLOWER]: Rejecting Update request from peer e61c3a8f61bb48f8a963c9480e53c168 for earlier term 16. Current term is 17. Ops: []
I20260709 13:07:11.434729 20109 raft_consensus.cc:1240] T 7be9efa6559648dbb5a0f7684c4542d1 P 127766fc592545a4997f7790f50f6076 [term 21 FOLLOWER]: Rejecting Update request from peer e61c3a8f61bb48f8a963c9480e53c168 for earlier term 20. Current term is 21. Ops: [20.12-20.12]
I20260709 13:07:11.435665 20108 raft_consensus.cc:1275] T 4af19371ea874c09a0a2147040835cbb P 127766fc592545a4997f7790f50f6076 [term 11 FOLLOWER]: Refusing update from remote peer e61c3a8f61bb48f8a963c9480e53c168: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:07:11.437304 19402 raft_consensus.cc:1240] T ff9b0eddd810459b82d91c60777c10eb P e5256d91808b47c195bc9b4dbd7f2b87 [term 20 LEADER]: Rejecting Update request from peer 0473d2b2d01f4459b1e90fd12cc7840e for earlier term 19. Current term is 20. Ops: [19.14-19.14]
I20260709 13:07:11.444281 26137 raft_consensus.cc:515] T 70797e5783b5454ab0d0eea663e791e3 P e61c3a8f61bb48f8a963c9480e53c168 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:07:11.295157 26101 consensus_queue.cc:260] T 2e36a9d6e29c4a7c860cf267efbd4c74 P 0473d2b2d01f4459b1e90fd12cc7840e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:07:11.471546 25747 raft_consensus.cc:3060] T 85c494af21f9457a85da47b9bc70c1fd P e61c3a8f61bb48f8a963c9480e53c168 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:07:11.472337 19407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e5873a19244c5ebbcd38e126796ee7" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 23 candidate_status { last_received { term: 22 index: 11 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
W20260709 13:07:11.474305 19450 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:11.441272 20111 raft_consensus.cc:1240] T 0e1085d23e8347fbbd5bce7542f4b1f4 P 127766fc592545a4997f7790f50f6076 [term 16 FOLLOWER]: Rejecting Update request from peer e61c3a8f61bb48f8a963c9480e53c168 for earlier term 15. Current term is 16. Ops: []
W20260709 13:07:11.479059 26150 log.cc:927] Time spent T ab43d85f64114d4ebf618930e43d9ed0 P 127766fc592545a4997f7790f50f6076: Append to log took a long time: real 0.079s	user 0.003s	sys 0.000s
I20260709 13:07:11.481319 26143 raft_consensus.cc:493] T 2a16f7501e2444fb86d4e2778e734e02 P e61c3a8f61bb48f8a963c9480e53c168 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 127766fc592545a4997f7790f50f6076)
I20260709 13:07:11.551350 26143 raft_consensus.cc:515] T 2a16f7501e2444fb86d4e2778e734e02 P e61c3a8f61bb48f8a963c9480e53c168 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:07:11.553669 19552 raft_consensus.cc:1275] T 1a61655d99124a29b486ba4a5b37faea P e61c3a8f61bb48f8a963c9480e53c168 [term 18 FOLLOWER]: Refusing update from remote peer 0473d2b2d01f4459b1e90fd12cc7840e: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 18 index: 12. (index mismatch)
W20260709 13:07:11.482270 19523 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:11.482849 26158 raft_consensus.cc:493] T 2e36a9d6e29c4a7c860cf267efbd4c74 P e61c3a8f61bb48f8a963c9480e53c168 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 0473d2b2d01f4459b1e90fd12cc7840e)
I20260709 13:07:11.554280 26143 leader_election.cc:290] T 2a16f7501e2444fb86d4e2778e734e02 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:07:11.555066 26158 raft_consensus.cc:515] T 2e36a9d6e29c4a7c860cf267efbd4c74 P e61c3a8f61bb48f8a963c9480e53c168 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:07:11.557193 26158 leader_election.cc:290] T 2e36a9d6e29c4a7c860cf267efbd4c74 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:07:11.484331 25992 raft_consensus.cc:515] T 4af19371ea874c09a0a2147040835cbb P e5256d91808b47c195bc9b4dbd7f2b87 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:07:11.485061 18300 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 13:07:11.387394 26148 log.cc:927] Time spent T df751f992649444090e27965eb1af85d P e5256d91808b47c195bc9b4dbd7f2b87: Append to log took a long time: real 0.086s	user 0.000s	sys 0.000s
I20260709 13:07:11.486146 26103 leader_election.cc:290] T 309c3ca0ca4b4f3ba129752ea2cb293b P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:07:11.486280 26001 raft_consensus.cc:493] T 2e36a9d6e29c4a7c860cf267efbd4c74 P e5256d91808b47c195bc9b4dbd7f2b87 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:11.489276 19410 raft_consensus.cc:1275] T 85c494af21f9457a85da47b9bc70c1fd P e5256d91808b47c195bc9b4dbd7f2b87 [term 18 FOLLOWER]: Refusing update from remote peer 127766fc592545a4997f7790f50f6076: Log matching property violated. Preceding OpId in replica: term: 17 index: 13. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
I20260709 13:07:11.490341 19404 raft_consensus.cc:1275] T 5ec1c4ce15e04c7e8c283a62179f2a64 P e5256d91808b47c195bc9b4dbd7f2b87 [term 14 FOLLOWER]: Refusing update from remote peer 127766fc592545a4997f7790f50f6076: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 13:07:11.581920 20078 leader_election.cc:304] T 1efebf73c86e432baa55533136b6e12c P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, 127766fc592545a4997f7790f50f6076; no voters: 
I20260709 13:07:11.583127 19554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65d8cb8d6ec64f459d5a47cefab10acf" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:07:11.492130 19405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65d8cb8d6ec64f459d5a47cefab10acf" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
I20260709 13:07:11.583868 19554 raft_consensus.cc:3060] T 65d8cb8d6ec64f459d5a47cefab10acf P e61c3a8f61bb48f8a963c9480e53c168 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:07:11.584090 19405 raft_consensus.cc:2368] T 65d8cb8d6ec64f459d5a47cefab10acf P e5256d91808b47c195bc9b4dbd7f2b87 [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate 127766fc592545a4997f7790f50f6076 for earlier term 20. Current term is 21.
I20260709 13:07:11.495383 20107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "309c3ca0ca4b4f3ba129752ea2cb293b" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:07:11.491324 25923 leader_election.cc:290] T 9962423cb4e54fcfa5de01daf68a86e7 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:07:11.511444 20106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9962423cb4e54fcfa5de01daf68a86e7" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:07:11.591181 20106 raft_consensus.cc:2393] T 9962423cb4e54fcfa5de01daf68a86e7 P 127766fc592545a4997f7790f50f6076 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e5256d91808b47c195bc9b4dbd7f2b87 in current term 19: Already voted for candidate 127766fc592545a4997f7790f50f6076 in this term.
I20260709 13:07:11.591874 19553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0afb57ae58a24a01850491d69f0213dd" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:07:11.592867 19552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62c6c134d3d24a1ab144dd9ee6bc3f64" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:07:11.593628 19552 raft_consensus.cc:2468] T 62c6c134d3d24a1ab144dd9ee6bc3f64 P e61c3a8f61bb48f8a963c9480e53c168 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 127766fc592545a4997f7790f50f6076 in term 18.
W20260709 13:07:11.513067 19375 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.3:36891, user_credentials={real_user=slave}} blocked reactor thread for 89877us
I20260709 13:07:11.604743 20075 leader_election.cc:400] T 65d8cb8d6ec64f459d5a47cefab10acf P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 20 election: Vote denied by peer e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321) with higher term. Message: Invalid argument: T 65d8cb8d6ec64f459d5a47cefab10acf P e5256d91808b47c195bc9b4dbd7f2b87 [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate 127766fc592545a4997f7790f50f6076 for earlier term 20. Current term is 21.
I20260709 13:07:11.605121 20075 leader_election.cc:403] T 65d8cb8d6ec64f459d5a47cefab10acf P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 20 election: Cancelling election due to peer responding with higher term
I20260709 13:07:11.576480 26137 leader_election.cc:290] T 70797e5783b5454ab0d0eea663e791e3 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:07:11.483392 26133 raft_consensus.cc:493] T 48824d5acfbc485ebf8c2d944e7202de P e61c3a8f61bb48f8a963c9480e53c168 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 127766fc592545a4997f7790f50f6076)
I20260709 13:07:11.565383 19377 leader_election.cc:304] T 7be9efa6559648dbb5a0f7684c4542d1 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, 127766fc592545a4997f7790f50f6076, e5256d91808b47c195bc9b4dbd7f2b87; no voters: e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:07:11.557767 19406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa8650e71aa14778b3d73721fc50d9fc" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 21 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:07:11.567376 20109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14935b3ddf914369822e4a0547aaa355" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:07:11.576639 26159 raft_consensus.cc:493] T 2725d2c4cb054f18b0fc8f735c15f6c2 P e61c3a8f61bb48f8a963c9480e53c168 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 0473d2b2d01f4459b1e90fd12cc7840e)
I20260709 13:07:11.576730 19523 leader_election.cc:304] T 96efeaaf1057492490e9a621f37e1a2d P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 127766fc592545a4997f7790f50f6076, e61c3a8f61bb48f8a963c9480e53c168; no voters: 0473d2b2d01f4459b1e90fd12cc7840e
W20260709 13:07:11.613821 19377 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.2:46257, user_credentials={real_user=slave}} blocked reactor thread for 48578.7us
I20260709 13:07:11.614064 19556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e1085d23e8347fbbd5bce7542f4b1f4" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:07:11.577183 19560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1efebf73c86e432baa55533136b6e12c" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:07:11.547176 26065 raft_consensus.cc:2804] T 4509b76741dc428e9201c70c1658da13 P e5256d91808b47c195bc9b4dbd7f2b87 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:07:11.557902 26119 consensus_queue.cc:1059] T ece3db938bc649d4a40a51522ed5259c P 127766fc592545a4997f7790f50f6076 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 }, Status: INVALID_TERM, Last received: 14.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.020s
I20260709 13:07:11.577877 19555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4af19371ea874c09a0a2147040835cbb" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 12 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:07:11.581760 26101 raft_consensus.cc:3060] T 2e36a9d6e29c4a7c860cf267efbd4c74 P 0473d2b2d01f4459b1e90fd12cc7840e [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:07:11.582696 26113 raft_consensus.cc:493] T 22196caba61445d3bec98a0aab3c337d P 0473d2b2d01f4459b1e90fd12cc7840e [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:11.578090 25908 leader_election.cc:290] T 65d8cb8d6ec64f459d5a47cefab10acf P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 20 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:07:11.609344 19551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96efeaaf1057492490e9a621f37e1a2d" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:07:11.621711 19553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dc5b3532fe54f74876d02beffa2c230" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:07:11.350044 19526 leader_election.cc:304] T bc225c93219c45538b53a1bd3d387e4d P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e61c3a8f61bb48f8a963c9480e53c168; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:07:11.622973 26140 raft_consensus.cc:2804] T 1efebf73c86e432baa55533136b6e12c P 127766fc592545a4997f7790f50f6076 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:07:11.647135 26140 raft_consensus.cc:697] T 1efebf73c86e432baa55533136b6e12c P 127766fc592545a4997f7790f50f6076 [term 16 LEADER]: Becoming Leader. State: Replica: 127766fc592545a4997f7790f50f6076, State: Running, Role: LEADER
I20260709 13:07:11.648048 26140 consensus_queue.cc:237] T 1efebf73c86e432baa55533136b6e12c P 127766fc592545a4997f7790f50f6076 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:07:11.622843 25975 consensus_queue.cc:1048] T 1a61655d99124a29b486ba4a5b37faea P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:07:11.623526 26159 raft_consensus.cc:515] T 2725d2c4cb054f18b0fc8f735c15f6c2 P e61c3a8f61bb48f8a963c9480e53c168 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:07:11.625994 26119 raft_consensus.cc:3055] T ece3db938bc649d4a40a51522ed5259c P 127766fc592545a4997f7790f50f6076 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:07:11.626387 26097 raft_consensus.cc:493] T 14935b3ddf914369822e4a0547aaa355 P e5256d91808b47c195bc9b4dbd7f2b87 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:11.662874 26128 consensus_queue.cc:1048] T 14935b3ddf914369822e4a0547aaa355 P 127766fc592545a4997f7790f50f6076 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.059s
I20260709 13:07:11.602701 26044 consensus_queue.cc:1048] T 62c6c134d3d24a1ab144dd9ee6bc3f64 P 127766fc592545a4997f7790f50f6076 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.058s
I20260709 13:07:11.663568 26097 raft_consensus.cc:515] T 14935b3ddf914369822e4a0547aaa355 P e5256d91808b47c195bc9b4dbd7f2b87 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } attrs { replace: true } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:07:11.652639 26113 raft_consensus.cc:515] T 22196caba61445d3bec98a0aab3c337d P 0473d2b2d01f4459b1e90fd12cc7840e [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:07:11.622121 25923 raft_consensus.cc:2804] T 7be9efa6559648dbb5a0f7684c4542d1 P e5256d91808b47c195bc9b4dbd7f2b87 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:07:11.666957 25992 leader_election.cc:290] T 4af19371ea874c09a0a2147040835cbb P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 12 election: Requested vote from peers e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:07:11.667146 26113 leader_election.cc:290] T 22196caba61445d3bec98a0aab3c337d P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:07:11.640229 26162 raft_consensus.cc:493] T e381f1d6b8184797ad142de49be225a8 P 0473d2b2d01f4459b1e90fd12cc7840e [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:11.668226 26159 leader_election.cc:290] T 2725d2c4cb054f18b0fc8f735c15f6c2 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:07:11.668015 26162 raft_consensus.cc:515] T e381f1d6b8184797ad142de49be225a8 P 0473d2b2d01f4459b1e90fd12cc7840e [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:07:11.627449 25987 raft_consensus.cc:515] T 9962423cb4e54fcfa5de01daf68a86e7 P 0473d2b2d01f4459b1e90fd12cc7840e [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:07:11.670068 25987 leader_election.cc:290] T 9962423cb4e54fcfa5de01daf68a86e7 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 18 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:07:11.670658 26092 consensus_queue.cc:1048] T 14935b3ddf914369822e4a0547aaa355 P 127766fc592545a4997f7790f50f6076 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:07:11.627972 19555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed7fdbcb96d14d418db9ca90a792588a" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:07:11.671970 26163 consensus_queue.cc:1048] T 62c6c134d3d24a1ab144dd9ee6bc3f64 P 127766fc592545a4997f7790f50f6076 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:07:11.672330 19555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9f0d59553ad444883fcf5b5909f9798" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:07:11.673403 19555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14935b3ddf914369822e4a0547aaa355" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:07:11.673910 19555 raft_consensus.cc:2376] T 14935b3ddf914369822e4a0547aaa355 P e61c3a8f61bb48f8a963c9480e53c168 [term 14 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 127766fc592545a4997f7790f50f6076 in term 14. Re-sending same reply.
I20260709 13:07:11.632229 26065 raft_consensus.cc:697] T 4509b76741dc428e9201c70c1658da13 P e5256d91808b47c195bc9b4dbd7f2b87 [term 13 LEADER]: Becoming Leader. State: Replica: e5256d91808b47c195bc9b4dbd7f2b87, State: Running, Role: LEADER
I20260709 13:07:11.675442 26065 consensus_queue.cc:237] T 4509b76741dc428e9201c70c1658da13 P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:07:11.633181 25946 raft_consensus.cc:3060] T 65d8cb8d6ec64f459d5a47cefab10acf P 127766fc592545a4997f7790f50f6076 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:07:11.604502 26001 raft_consensus.cc:515] T 2e36a9d6e29c4a7c860cf267efbd4c74 P e5256d91808b47c195bc9b4dbd7f2b87 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:07:11.680886 26001 leader_election.cc:290] T 2e36a9d6e29c4a7c860cf267efbd4c74 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
W20260709 13:07:11.682245 26134 consensus_meta.cc:287] T 1efebf73c86e432baa55533136b6e12c P e61c3a8f61bb48f8a963c9480e53c168: Time spent flushing consensus metadata: real 0.547s	user 0.003s	sys 0.003s
I20260709 13:07:11.633641 26043 consensus_queue.cc:1048] T 85c494af21f9457a85da47b9bc70c1fd P 127766fc592545a4997f7790f50f6076 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:07:11.634570 19552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4af19371ea874c09a0a2147040835cbb" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:07:11.692725 26035 raft_consensus.cc:515] T f93ee515a9c14139bf566522ed8232f3 P e61c3a8f61bb48f8a963c9480e53c168 [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
W20260709 13:07:11.635564 19523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.4:43121, user_credentials={real_user=slave}} blocked reactor thread for 58926.8us
I20260709 13:07:11.694998 19523 leader_election.cc:400] T 1efebf73c86e432baa55533136b6e12c P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 15 pre-election: Vote denied by peer 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121) with higher term. Message: Invalid argument: T 1efebf73c86e432baa55533136b6e12c P 127766fc592545a4997f7790f50f6076 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e61c3a8f61bb48f8a963c9480e53c168 for earlier term 15. Current term is 16.
I20260709 13:07:11.666481 26097 leader_election.cc:290] T 14935b3ddf914369822e4a0547aaa355 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:07:11.661254 26135 raft_consensus.cc:493] T 46c5bfeecc314717bffe987e6844b6d0 P e5256d91808b47c195bc9b4dbd7f2b87 [term 25 FOLLOWER]: Starting pre-election (detected failure of leader e61c3a8f61bb48f8a963c9480e53c168)
I20260709 13:07:11.699306 26135 raft_consensus.cc:515] T 46c5bfeecc314717bffe987e6844b6d0 P e5256d91808b47c195bc9b4dbd7f2b87 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:07:11.700634 19555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dc5b3532fe54f74876d02beffa2c230" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 22 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:07:11.701309 26135 leader_election.cc:290] T 46c5bfeecc314717bffe987e6844b6d0 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:07:11.660784 26119 raft_consensus.cc:740] T ece3db938bc649d4a40a51522ed5259c P 127766fc592545a4997f7790f50f6076 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 127766fc592545a4997f7790f50f6076, State: Running, Role: LEADER
I20260709 13:07:11.701990 19555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cdf56e38bbc453d9438d359e5a69955" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 20 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:07:11.702941 19555 raft_consensus.cc:2410] T 0cdf56e38bbc453d9438d359e5a69955 P e61c3a8f61bb48f8a963c9480e53c168 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e5256d91808b47c195bc9b4dbd7f2b87 for term 20 because replica has last-logged OpId of term: 18 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 17 index: 11.
I20260709 13:07:11.702647 26119 consensus_queue.cc:260] T ece3db938bc649d4a40a51522ed5259c P 127766fc592545a4997f7790f50f6076 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:07:11.703953 19555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2725d2c4cb054f18b0fc8f735c15f6c2" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:07:11.704137 26119 raft_consensus.cc:3060] T ece3db938bc649d4a40a51522ed5259c P 127766fc592545a4997f7790f50f6076 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:07:11.704627 19555 raft_consensus.cc:2468] T 2725d2c4cb054f18b0fc8f735c15f6c2 P e61c3a8f61bb48f8a963c9480e53c168 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 19.
I20260709 13:07:11.638993 19449 leader_election.cc:304] T 14efcc79969f41babe5529c22d59156d P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e; no voters: 127766fc592545a4997f7790f50f6076, e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:07:11.620805 26117 raft_consensus.cc:493] T 85c494af21f9457a85da47b9bc70c1fd P e5256d91808b47c195bc9b4dbd7f2b87 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:11.639688 26133 raft_consensus.cc:515] T 48824d5acfbc485ebf8c2d944e7202de P e61c3a8f61bb48f8a963c9480e53c168 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:07:11.655319 19411 raft_consensus.cc:1240] T 4af19371ea874c09a0a2147040835cbb P e5256d91808b47c195bc9b4dbd7f2b87 [term 12 FOLLOWER]: Rejecting Update request from peer e61c3a8f61bb48f8a963c9480e53c168 for earlier term 11. Current term is 12. Ops: []
I20260709 13:07:11.656050 19553 raft_consensus.cc:2468] T 1dc5b3532fe54f74876d02beffa2c230 P e61c3a8f61bb48f8a963c9480e53c168 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 21.
I20260709 13:07:11.656421 19406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f575b143b844aa096b50997dad3516a" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:07:11.656682 19410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dc5b3532fe54f74876d02beffa2c230" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:07:11.657099 19407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21e14947d70440f19044d8f75c31e1f9" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:07:11.658257 19409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76cb037fc9064d13b59a8969d897ce8c" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
I20260709 13:07:11.729557 19554 raft_consensus.cc:2468] T 65d8cb8d6ec64f459d5a47cefab10acf P e61c3a8f61bb48f8a963c9480e53c168 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 21.
I20260709 13:07:11.658586 19402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86a6797bdfe94fa496c050ceae4bd0d9" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
I20260709 13:07:11.661140 19556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e5873a19244c5ebbcd38e126796ee7" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 23 candidate_status { last_received { term: 22 index: 11 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:07:11.662736 25975 raft_consensus.cc:493] T 1f85fc4b527a48848e5faa083b604e36 P 0473d2b2d01f4459b1e90fd12cc7840e [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 127766fc592545a4997f7790f50f6076)
I20260709 13:07:11.708164 25946 raft_consensus.cc:2749] T 65d8cb8d6ec64f459d5a47cefab10acf P 127766fc592545a4997f7790f50f6076 [term 21 FOLLOWER]: Leader election lost for term 20. Reason: Vote denied by peer e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321) with higher term. Message: Invalid argument: T 65d8cb8d6ec64f459d5a47cefab10acf P e5256d91808b47c195bc9b4dbd7f2b87 [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate 127766fc592545a4997f7790f50f6076 for earlier term 20. Current term is 21.
I20260709 13:07:11.708331 26108 raft_consensus.cc:2749] T bc225c93219c45538b53a1bd3d387e4d P e61c3a8f61bb48f8a963c9480e53c168 [term 17 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
W20260709 13:07:11.707510 19526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.2:46257, user_credentials={real_user=slave}} blocked reactor thread for 357569us
I20260709 13:07:11.709425 20110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14935b3ddf914369822e4a0547aaa355" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 14 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:07:11.709436 25530 raft_consensus.cc:493] T 217b5fae677b4971b3bbd2f357a1f7ff P 0473d2b2d01f4459b1e90fd12cc7840e [term 15 FOLLOWER]: Starting pre-election (detected failure of leader e5256d91808b47c195bc9b4dbd7f2b87)
I20260709 13:07:11.709908 19450 leader_election.cc:304] T 0cdf56e38bbc453d9438d359e5a69955 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168; no voters: e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:07:11.743598 26141 raft_consensus.cc:493] T 217b5fae677b4971b3bbd2f357a1f7ff P e5256d91808b47c195bc9b4dbd7f2b87 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:11.743534 20107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab43d85f64114d4ebf618930e43d9ed0" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 22 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:07:11.744227 26141 raft_consensus.cc:515] T 217b5fae677b4971b3bbd2f357a1f7ff P e5256d91808b47c195bc9b4dbd7f2b87 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:07:11.737423 26117 raft_consensus.cc:515] T 85c494af21f9457a85da47b9bc70c1fd P e5256d91808b47c195bc9b4dbd7f2b87 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:07:11.710498 20109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4af19371ea874c09a0a2147040835cbb" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076"
I20260709 13:07:11.746783 20109 raft_consensus.cc:3060] T 4af19371ea874c09a0a2147040835cbb P 127766fc592545a4997f7790f50f6076 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:11.747038 19480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9962423cb4e54fcfa5de01daf68a86e7" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:07:11.747550 19559 raft_consensus.cc:1275] T 85c494af21f9457a85da47b9bc70c1fd P e61c3a8f61bb48f8a963c9480e53c168 [term 18 FOLLOWER]: Refusing update from remote peer 127766fc592545a4997f7790f50f6076: Log matching property violated. Preceding OpId in replica: term: 17 index: 13. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
I20260709 13:07:11.747709 19480 raft_consensus.cc:2468] T 9962423cb4e54fcfa5de01daf68a86e7 P 0473d2b2d01f4459b1e90fd12cc7840e [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 127766fc592545a4997f7790f50f6076 in term 18.
I20260709 13:07:11.748669 19403 raft_consensus.cc:1240] T 85c494af21f9457a85da47b9bc70c1fd P e5256d91808b47c195bc9b4dbd7f2b87 [term 18 FOLLOWER]: Rejecting Update request from peer e61c3a8f61bb48f8a963c9480e53c168 for earlier term 17. Current term is 18. Ops: []
I20260709 13:07:11.748811 26057 consensus_queue.cc:1048] T 1a61655d99124a29b486ba4a5b37faea P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:07:11.749727 26088 ts_tablet_manager.cc:1929] T ab43d85f64114d4ebf618930e43d9ed0 P e5256d91808b47c195bc9b4dbd7f2b87: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 14.8
I20260709 13:07:11.750273 26088 log.cc:1199] T ab43d85f64114d4ebf618930e43d9ed0 P e5256d91808b47c195bc9b4dbd7f2b87: Deleting WAL directory at /tmp/dist-test-taskKd2k48/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602220613947-18300-0/minicluster-data/ts-0-root/wals/ab43d85f64114d4ebf618930e43d9ed0
I20260709 13:07:11.751003 19485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e1085d23e8347fbbd5bce7542f4b1f4" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:07:11.751605 19485 raft_consensus.cc:3060] T 0e1085d23e8347fbbd5bce7542f4b1f4 P 0473d2b2d01f4459b1e90fd12cc7840e [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:07:11.734223 26159 raft_consensus.cc:493] T f1b10566f45d4a7d9029858330e02d5b P e61c3a8f61bb48f8a963c9480e53c168 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:11.752480 26159 raft_consensus.cc:515] T f1b10566f45d4a7d9029858330e02d5b P e61c3a8f61bb48f8a963c9480e53c168 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:07:11.711018 26158 consensus_queue.cc:1059] T ed7fdbcb96d14d418db9ca90a792588a P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:07:11.755059 19481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "172b3dd13109415a955b71ac0e9d2234" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:07:11.755764 26117 leader_election.cc:290] T 85c494af21f9457a85da47b9bc70c1fd P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:07:11.712816 26043 consensus_queue.cc:1048] T 5ec1c4ce15e04c7e8c283a62179f2a64 P 127766fc592545a4997f7790f50f6076 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:07:11.743479 25530 raft_consensus.cc:515] T 217b5fae677b4971b3bbd2f357a1f7ff P 0473d2b2d01f4459b1e90fd12cc7840e [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:07:11.712925 26143 consensus_queue.cc:1059] T 7be9efa6559648dbb5a0f7684c4542d1 P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false }, Status: INVALID_TERM, Last received: 17.11, Next index: 12, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:07:11.758111 26143 raft_consensus.cc:3055] T 7be9efa6559648dbb5a0f7684c4542d1 P e61c3a8f61bb48f8a963c9480e53c168 [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:07:11.758499 26143 raft_consensus.cc:740] T 7be9efa6559648dbb5a0f7684c4542d1 P e61c3a8f61bb48f8a963c9480e53c168 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: e61c3a8f61bb48f8a963c9480e53c168, State: Running, Role: LEADER
I20260709 13:07:11.758607 25530 leader_election.cc:290] T 217b5fae677b4971b3bbd2f357a1f7ff P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:07:11.759379 26143 consensus_queue.cc:260] T 7be9efa6559648dbb5a0f7684c4542d1 P e61c3a8f61bb48f8a963c9480e53c168 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 20.12, Last appended by leader: 12, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } attrs { replace: true } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:07:11.760838 26143 raft_consensus.cc:3060] T 7be9efa6559648dbb5a0f7684c4542d1 P e61c3a8f61bb48f8a963c9480e53c168 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:07:11.713644 26061 consensus_queue.cc:1048] T 4af19371ea874c09a0a2147040835cbb P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Connected to new peer: Peer: permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:07:11.714088 20108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70797e5783b5454ab0d0eea663e791e3" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:07:11.761736 19480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96efeaaf1057492490e9a621f37e1a2d" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:07:11.687816 26147 leader_election.cc:290] T ab43d85f64114d4ebf618930e43d9ed0 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:07:11.746856 25987 raft_consensus.cc:2804] T 0cdf56e38bbc453d9438d359e5a69955 P 0473d2b2d01f4459b1e90fd12cc7840e [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:07:11.714263 25851 consensus_queue.cc:1059] T 0e1085d23e8347fbbd5bce7542f4b1f4 P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false }, Status: INVALID_TERM, Last received: 15.12, Next index: 13, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:07:11.762931 25987 raft_consensus.cc:493] T 0cdf56e38bbc453d9438d359e5a69955 P 0473d2b2d01f4459b1e90fd12cc7840e [term 18 FOLLOWER]: Starting leader election (detected failure of leader e61c3a8f61bb48f8a963c9480e53c168)
I20260709 13:07:11.636065 26137 raft_consensus.cc:2764] T 96efeaaf1057492490e9a621f37e1a2d P e61c3a8f61bb48f8a963c9480e53c168 [term 21 FOLLOWER]: Leader pre-election decision vote started in defunct term 20: won
I20260709 13:07:11.763410 25987 raft_consensus.cc:3060] T 0cdf56e38bbc453d9438d359e5a69955 P 0473d2b2d01f4459b1e90fd12cc7840e [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:07:11.763875 19551 raft_consensus.cc:2368] T 96efeaaf1057492490e9a621f37e1a2d P e61c3a8f61bb48f8a963c9480e53c168 [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate 127766fc592545a4997f7790f50f6076 for earlier term 20. Current term is 21.
W20260709 13:07:11.724171 19449 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.4:43121, user_credentials={real_user=slave}} blocked reactor thread for 85268.4us
I20260709 13:07:11.765115 19449 leader_election.cc:304] T ed7fdbcb96d14d418db9ca90a792588a P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e; no voters: 127766fc592545a4997f7790f50f6076, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:07:11.715282 20076 leader_election.cc:304] T 0afb57ae58a24a01850491d69f0213dd P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 127766fc592545a4997f7790f50f6076; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168
W20260709 13:07:11.767813 20076 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.3:36891, user_credentials={real_user=slave}} blocked reactor thread for 52609.8us
I20260709 13:07:11.768837 20076 leader_election.cc:304] T 4af19371ea874c09a0a2147040835cbb P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 127766fc592545a4997f7790f50f6076; no voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:07:11.729736 19410 raft_consensus.cc:2468] T 1dc5b3532fe54f74876d02beffa2c230 P e5256d91808b47c195bc9b4dbd7f2b87 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 21.
I20260709 13:07:11.729769 19407 raft_consensus.cc:2468] T 21e14947d70440f19044d8f75c31e1f9 P e5256d91808b47c195bc9b4dbd7f2b87 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 19.
I20260709 13:07:11.732343 19553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4af19371ea874c09a0a2147040835cbb" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:07:11.740660 19526 leader_election.cc:400] T 62c6c134d3d24a1ab144dd9ee6bc3f64 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 17 pre-election: Vote denied by peer 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257) with higher term. Message: Invalid argument: T 62c6c134d3d24a1ab144dd9ee6bc3f64 P 0473d2b2d01f4459b1e90fd12cc7840e [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e61c3a8f61bb48f8a963c9480e53c168 for earlier term 17. Current term is 18.
I20260709 13:07:11.712248 20106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a16f7501e2444fb86d4e2778e734e02" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:07:11.771184 19526 leader_election.cc:403] T 62c6c134d3d24a1ab144dd9ee6bc3f64 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 17 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:07:11.670066 26162 leader_election.cc:290] T e381f1d6b8184797ad142de49be225a8 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:07:11.775440 19553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14935b3ddf914369822e4a0547aaa355" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:07:11.779384 19553 raft_consensus.cc:2468] T 14935b3ddf914369822e4a0547aaa355 P e61c3a8f61bb48f8a963c9480e53c168 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 14.
I20260709 13:07:11.727898 26113 raft_consensus.cc:2749] T 14efcc79969f41babe5529c22d59156d P 0473d2b2d01f4459b1e90fd12cc7840e [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:07:11.777985 20109 raft_consensus.cc:2468] T 4af19371ea874c09a0a2147040835cbb P 127766fc592545a4997f7790f50f6076 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 12.
I20260709 13:07:11.778043 19526 leader_election.cc:304] T 1dc5b3532fe54f74876d02beffa2c230 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:07:11.778281 19556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e36a9d6e29c4a7c860cf267efbd4c74" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:07:11.788208 20106 raft_consensus.cc:1240] T 4af19371ea874c09a0a2147040835cbb P 127766fc592545a4997f7790f50f6076 [term 12 FOLLOWER]: Rejecting Update request from peer e61c3a8f61bb48f8a963c9480e53c168 for earlier term 11. Current term is 12. Ops: [10.9-11.10]
W20260709 13:07:11.801594 19523 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:11.776651 19485 raft_consensus.cc:2468] T 0e1085d23e8347fbbd5bce7542f4b1f4 P 0473d2b2d01f4459b1e90fd12cc7840e [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 127766fc592545a4997f7790f50f6076 in term 16.
I20260709 13:07:11.783715 20107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85c494af21f9457a85da47b9bc70c1fd" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:07:11.784351 19553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65d8cb8d6ec64f459d5a47cefab10acf" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:07:11.803661 19553 raft_consensus.cc:2368] T 65d8cb8d6ec64f459d5a47cefab10acf P e61c3a8f61bb48f8a963c9480e53c168 [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate 127766fc592545a4997f7790f50f6076 for earlier term 20. Current term is 21.
I20260709 13:07:11.782490 20105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9962423cb4e54fcfa5de01daf68a86e7" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076"
I20260709 13:07:11.804841 20105 raft_consensus.cc:2368] T 9962423cb4e54fcfa5de01daf68a86e7 P 127766fc592545a4997f7790f50f6076 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 0473d2b2d01f4459b1e90fd12cc7840e for earlier term 18. Current term is 19.
I20260709 13:07:11.785429 19410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22196caba61445d3bec98a0aab3c337d" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:07:11.785916 19555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46c5bfeecc314717bffe987e6844b6d0" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 26 candidate_status { last_received { term: 25 index: 13 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:07:11.727998 25923 raft_consensus.cc:697] T 7be9efa6559648dbb5a0f7684c4542d1 P e5256d91808b47c195bc9b4dbd7f2b87 [term 21 LEADER]: Becoming Leader. State: Replica: e5256d91808b47c195bc9b4dbd7f2b87, State: Running, Role: LEADER
I20260709 13:07:11.789705 19374 leader_election.cc:304] T 4af19371ea874c09a0a2147040835cbb P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 127766fc592545a4997f7790f50f6076, e5256d91808b47c195bc9b4dbd7f2b87; no voters: 
I20260709 13:07:11.805858 19410 raft_consensus.cc:2468] T 22196caba61445d3bec98a0aab3c337d P e5256d91808b47c195bc9b4dbd7f2b87 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 19.
W20260709 13:07:11.813490 20076 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.3:36891, user_credentials={real_user=slave}} blocked reactor thread for 43502.7us
I20260709 13:07:11.814901 19484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9962423cb4e54fcfa5de01daf68a86e7" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:07:11.754565 26159 leader_election.cc:290] T f1b10566f45d4a7d9029858330e02d5b P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:07:11.815512 19484 raft_consensus.cc:2468] T 9962423cb4e54fcfa5de01daf68a86e7 P 0473d2b2d01f4459b1e90fd12cc7840e [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 18.
I20260709 13:07:11.819775 19553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a61655d99124a29b486ba4a5b37faea" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 19 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:07:11.821162 19553 raft_consensus.cc:2410] T 1a61655d99124a29b486ba4a5b37faea P e61c3a8f61bb48f8a963c9480e53c168 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e5256d91808b47c195bc9b4dbd7f2b87 for term 19 because replica has last-logged OpId of term: 17 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 9.
I20260709 13:07:11.821300 19480 raft_consensus.cc:1275] T 5ec1c4ce15e04c7e8c283a62179f2a64 P 0473d2b2d01f4459b1e90fd12cc7840e [term 14 FOLLOWER]: Refusing update from remote peer 127766fc592545a4997f7790f50f6076: Log matching property violated. Preceding OpId in replica: term: 13 index: 12. Preceding OpId from leader: term: 14 index: 12. (term mismatch)
I20260709 13:07:11.821664 19480 pending_rounds.cc:85] T 5ec1c4ce15e04c7e8c283a62179f2a64 P 0473d2b2d01f4459b1e90fd12cc7840e: Aborting all ops after (but not including) 11
I20260709 13:07:11.763266 25851 raft_consensus.cc:3055] T 0e1085d23e8347fbbd5bce7542f4b1f4 P e61c3a8f61bb48f8a963c9480e53c168 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:07:11.819775 19479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edd7d470b5014c9489be7f41f64355c9" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 24 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:07:11.824410 19410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9962423cb4e54fcfa5de01daf68a86e7" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
W20260709 13:07:11.822088 19526 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:11.824147 20076 leader_election.cc:400] T 65d8cb8d6ec64f459d5a47cefab10acf P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 20 election: Vote denied by peer e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891) with higher term. Message: Invalid argument: T 65d8cb8d6ec64f459d5a47cefab10acf P e61c3a8f61bb48f8a963c9480e53c168 [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate 127766fc592545a4997f7790f50f6076 for earlier term 20. Current term is 21.
I20260709 13:07:11.824782 19479 raft_consensus.cc:3060] T edd7d470b5014c9489be7f41f64355c9 P 0473d2b2d01f4459b1e90fd12cc7840e [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:07:11.821106 19485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "309c3ca0ca4b4f3ba129752ea2cb293b" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:07:11.827205 19556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21e14947d70440f19044d8f75c31e1f9" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 20 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:07:11.829459 19556 raft_consensus.cc:2410] T 21e14947d70440f19044d8f75c31e1f9 P e61c3a8f61bb48f8a963c9480e53c168 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e5256d91808b47c195bc9b4dbd7f2b87 for term 20 because replica has last-logged OpId of term: 18 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 17 index: 11.
I20260709 13:07:11.716099 26134 raft_consensus.cc:515] T 1efebf73c86e432baa55533136b6e12c P e61c3a8f61bb48f8a963c9480e53c168 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:07:11.778055 26033 raft_consensus.cc:3060] T ed7fdbcb96d14d418db9ca90a792588a P 0473d2b2d01f4459b1e90fd12cc7840e [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:07:11.812999 25946 raft_consensus.cc:2749] T 4af19371ea874c09a0a2147040835cbb P 127766fc592545a4997f7790f50f6076 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:07:11.837515 19524 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:11.774999 25908 raft_consensus.cc:2749] T 0afb57ae58a24a01850491d69f0213dd P 127766fc592545a4997f7790f50f6076 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:07:11.733829 26115 raft_consensus.cc:515] T 172b3dd13109415a955b71ac0e9d2234 P 127766fc592545a4997f7790f50f6076 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:07:11.831586 19410 raft_consensus.cc:2393] T 9962423cb4e54fcfa5de01daf68a86e7 P e5256d91808b47c195bc9b4dbd7f2b87 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 0473d2b2d01f4459b1e90fd12cc7840e in current term 18: Already voted for candidate e5256d91808b47c195bc9b4dbd7f2b87 in this term.
I20260709 13:07:11.821933 19480 pending_rounds.cc:107] T 5ec1c4ce15e04c7e8c283a62179f2a64 P 0473d2b2d01f4459b1e90fd12cc7840e: Aborting uncommitted NO_OP operation due to leader change: 13.12
I20260709 13:07:11.843498 19553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22196caba61445d3bec98a0aab3c337d" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 20 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:07:11.843824 19480 raft_consensus.cc:2889] T 5ec1c4ce15e04c7e8c283a62179f2a64 P 0473d2b2d01f4459b1e90fd12cc7840e [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:07:11.839923 19555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e381f1d6b8184797ad142de49be225a8" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 18 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:07:11.840444 19560 raft_consensus.cc:3060] T 1efebf73c86e432baa55533136b6e12c P e61c3a8f61bb48f8a963c9480e53c168 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:07:11.787170 26147 raft_consensus.cc:2749] T 62c6c134d3d24a1ab144dd9ee6bc3f64 P e61c3a8f61bb48f8a963c9480e53c168 [term 18 FOLLOWER]: Leader pre-election lost for term 17. Reason: Vote denied by peer 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257) with higher term. Message: Invalid argument: T 62c6c134d3d24a1ab144dd9ee6bc3f64 P 0473d2b2d01f4459b1e90fd12cc7840e [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e61c3a8f61bb48f8a963c9480e53c168 for earlier term 17. Current term is 18.
I20260709 13:07:11.785360 26107 raft_consensus.cc:493] T 7f575b143b844aa096b50997dad3516a P e5256d91808b47c195bc9b4dbd7f2b87 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:11.820169 26108 raft_consensus.cc:2804] T 1dc5b3532fe54f74876d02beffa2c230 P e61c3a8f61bb48f8a963c9480e53c168 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:07:11.848214 25376 raft_consensus.cc:493] T 21e14947d70440f19044d8f75c31e1f9 P 0473d2b2d01f4459b1e90fd12cc7840e [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:11.850821 25376 raft_consensus.cc:515] T 21e14947d70440f19044d8f75c31e1f9 P 0473d2b2d01f4459b1e90fd12cc7840e [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:07:11.769428 25975 raft_consensus.cc:515] T 1f85fc4b527a48848e5faa083b604e36 P 0473d2b2d01f4459b1e90fd12cc7840e [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:07:11.848910 19553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14935b3ddf914369822e4a0547aaa355" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 14 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:07:11.857627 19553 raft_consensus.cc:1813] T 14935b3ddf914369822e4a0547aaa355 P e61c3a8f61bb48f8a963c9480e53c168 [term 14 FOLLOWER]: Handling vote request from an unknown peer e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:07:11.858376 19553 raft_consensus.cc:2393] T 14935b3ddf914369822e4a0547aaa355 P e61c3a8f61bb48f8a963c9480e53c168 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e5256d91808b47c195bc9b4dbd7f2b87 in current term 14: Already voted for candidate 127766fc592545a4997f7790f50f6076 in this term.
I20260709 13:07:11.823973 26137 raft_consensus.cc:493] T 28af091831594f9d8e96482078cc7625 P e61c3a8f61bb48f8a963c9480e53c168 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 0473d2b2d01f4459b1e90fd12cc7840e)
I20260709 13:07:11.769009 26157 consensus_queue.cc:1048] T 22196caba61445d3bec98a0aab3c337d P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.062s
I20260709 13:07:11.852226 19556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b74109013a140ada21feeef92d6f563" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 18 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:07:11.867555 19556 raft_consensus.cc:3060] T 2b74109013a140ada21feeef92d6f563 P e61c3a8f61bb48f8a963c9480e53c168 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:07:11.828306 25819 raft_consensus.cc:2804] T 4af19371ea874c09a0a2147040835cbb P e5256d91808b47c195bc9b4dbd7f2b87 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:07:11.863353 25376 leader_election.cc:290] T 21e14947d70440f19044d8f75c31e1f9 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:07:11.863826 19483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4509b76741dc428e9201c70c1658da13" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:07:11.864240 19411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e381f1d6b8184797ad142de49be225a8" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 18 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:07:11.865229 20111 raft_consensus.cc:1240] T 172b3dd13109415a955b71ac0e9d2234 P 127766fc592545a4997f7790f50f6076 [term 18 FOLLOWER]: Rejecting Update request from peer 0473d2b2d01f4459b1e90fd12cc7840e for earlier term 17. Current term is 18. Ops: []
I20260709 13:07:11.824460 25851 raft_consensus.cc:740] T 0e1085d23e8347fbbd5bce7542f4b1f4 P e61c3a8f61bb48f8a963c9480e53c168 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: e61c3a8f61bb48f8a963c9480e53c168, State: Running, Role: LEADER
I20260709 13:07:11.866539 26107 raft_consensus.cc:515] T 7f575b143b844aa096b50997dad3516a P e5256d91808b47c195bc9b4dbd7f2b87 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:07:11.869942 26137 raft_consensus.cc:515] T 28af091831594f9d8e96482078cc7625 P e61c3a8f61bb48f8a963c9480e53c168 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:07:11.894865 19375 leader_election.cc:304] T edd7d470b5014c9489be7f41f64355c9 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:07:11.871650 25819 raft_consensus.cc:697] T 4af19371ea874c09a0a2147040835cbb P e5256d91808b47c195bc9b4dbd7f2b87 [term 12 LEADER]: Becoming Leader. State: Replica: e5256d91808b47c195bc9b4dbd7f2b87, State: Running, Role: LEADER
I20260709 13:07:11.873546 25975 leader_election.cc:290] T 1f85fc4b527a48848e5faa083b604e36 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:07:11.896062 19483 raft_consensus.cc:2393] T 4509b76741dc428e9201c70c1658da13 P 0473d2b2d01f4459b1e90fd12cc7840e [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate e5256d91808b47c195bc9b4dbd7f2b87 in current term 13: Already voted for candidate 0473d2b2d01f4459b1e90fd12cc7840e in this term.
I20260709 13:07:11.850442 26108 raft_consensus.cc:493] T 1dc5b3532fe54f74876d02beffa2c230 P e61c3a8f61bb48f8a963c9480e53c168 [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:11.896071 25819 consensus_queue.cc:237] T 4af19371ea874c09a0a2147040835cbb P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:07:11.879041 25923 consensus_queue.cc:237] T 7be9efa6559648dbb5a0f7684c4542d1 P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.11, Last appended by leader: 11, Current term: 21, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } attrs { replace: true } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:07:11.898541 19406 raft_consensus.cc:2468] T 7f575b143b844aa096b50997dad3516a P e5256d91808b47c195bc9b4dbd7f2b87 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 17.
I20260709 13:07:11.880182 19553 raft_consensus.cc:1275] T b08304a0a02b42d7840c4e8ee9a6bd1a P e61c3a8f61bb48f8a963c9480e53c168 [term 21 FOLLOWER]: Refusing update from remote peer e5256d91808b47c195bc9b4dbd7f2b87: Log matching property violated. Preceding OpId in replica: term: 19 index: 11. Preceding OpId from leader: term: 21 index: 12. (index mismatch)
I20260709 13:07:11.844487 26159 raft_consensus.cc:493] T e381f1d6b8184797ad142de49be225a8 P e61c3a8f61bb48f8a963c9480e53c168 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:11.911870 19485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9f0d59553ad444883fcf5b5909f9798" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:07:11.882622 19559 raft_consensus.cc:1240] T f93ee515a9c14139bf566522ed8232f3 P e61c3a8f61bb48f8a963c9480e53c168 [term 23 FOLLOWER]: Rejecting Update request from peer 0473d2b2d01f4459b1e90fd12cc7840e for earlier term 22. Current term is 23. Ops: []
I20260709 13:07:11.885654 19480 raft_consensus.cc:1275] T b08304a0a02b42d7840c4e8ee9a6bd1a P 0473d2b2d01f4459b1e90fd12cc7840e [term 21 FOLLOWER]: Refusing update from remote peer e5256d91808b47c195bc9b4dbd7f2b87: Log matching property violated. Preceding OpId in replica: term: 19 index: 11. Preceding OpId from leader: term: 21 index: 12. (index mismatch)
I20260709 13:07:11.857577 25977 raft_consensus.cc:493] T ff75a1d4cb1f493db8f71ddc136ba9ab P 0473d2b2d01f4459b1e90fd12cc7840e [term 19 FOLLOWER]: Starting pre-election (detected failure of leader e5256d91808b47c195bc9b4dbd7f2b87)
I20260709 13:07:11.850230 26001 raft_consensus.cc:493] T 3e1f505cb0f1427bbd698ac889d80821 P e5256d91808b47c195bc9b4dbd7f2b87 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader e61c3a8f61bb48f8a963c9480e53c168)
I20260709 13:07:11.886996 26043 consensus_queue.cc:1048] T 85c494af21f9457a85da47b9bc70c1fd P 127766fc592545a4997f7790f50f6076 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:07:11.892570 19481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36f6ba92b9ba46babe4ebd6c02e5fbd9" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:07:11.916563 19481 raft_consensus.cc:2468] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P 0473d2b2d01f4459b1e90fd12cc7840e [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 21.
I20260709 13:07:11.850544 25957 raft_consensus.cc:493] T f1b10566f45d4a7d9029858330e02d5b P 0473d2b2d01f4459b1e90fd12cc7840e [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:11.877651 26115 leader_election.cc:290] T 172b3dd13109415a955b71ac0e9d2234 P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 18 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:07:11.869256 19411 raft_consensus.cc:2468] T e381f1d6b8184797ad142de49be225a8 P e5256d91808b47c195bc9b4dbd7f2b87 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 17.
I20260709 13:07:11.910285 26117 raft_consensus.cc:493] T 14efcc79969f41babe5529c22d59156d P e5256d91808b47c195bc9b4dbd7f2b87 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 127766fc592545a4997f7790f50f6076)
I20260709 13:07:11.897085 26108 raft_consensus.cc:3060] T 1dc5b3532fe54f74876d02beffa2c230 P e61c3a8f61bb48f8a963c9480e53c168 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:07:11.857733 25925 raft_consensus.cc:493] T 833a2f0775ed407a94b8924ce50adb63 P e5256d91808b47c195bc9b4dbd7f2b87 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:11.917634 19552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa8650e71aa14778b3d73721fc50d9fc" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 21 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:07:11.959417 19481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21e14947d70440f19044d8f75c31e1f9" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:07:11.959792 19552 raft_consensus.cc:2468] T fa8650e71aa14778b3d73721fc50d9fc P e61c3a8f61bb48f8a963c9480e53c168 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 20.
I20260709 13:07:11.911466 26103 raft_consensus.cc:2804] T edd7d470b5014c9489be7f41f64355c9 P e5256d91808b47c195bc9b4dbd7f2b87 [term 24 FOLLOWER]: Leader election won for term 24
I20260709 13:07:11.960062 19481 raft_consensus.cc:2468] T 21e14947d70440f19044d8f75c31e1f9 P 0473d2b2d01f4459b1e90fd12cc7840e [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 19.
I20260709 13:07:11.915943 26033 raft_consensus.cc:2749] T ed7fdbcb96d14d418db9ca90a792588a P 0473d2b2d01f4459b1e90fd12cc7840e [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:07:11.919854 19483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a61655d99124a29b486ba4a5b37faea" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 19 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:07:11.969578 19480 raft_consensus.cc:1240] T 0e1085d23e8347fbbd5bce7542f4b1f4 P 0473d2b2d01f4459b1e90fd12cc7840e [term 16 FOLLOWER]: Rejecting Update request from peer e61c3a8f61bb48f8a963c9480e53c168 for earlier term 15. Current term is 16. Ops: []
I20260709 13:07:11.896907 19375 leader_election.cc:304] T 2725d2c4cb054f18b0fc8f735c15f6c2 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:07:11.938787 19485 raft_consensus.cc:1240] T 7be9efa6559648dbb5a0f7684c4542d1 P 0473d2b2d01f4459b1e90fd12cc7840e [term 21 FOLLOWER]: Rejecting Update request from peer e61c3a8f61bb48f8a963c9480e53c168 for earlier term 20. Current term is 21. Ops: [17.11-20.12]
I20260709 13:07:11.971881 19485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a61655d99124a29b486ba4a5b37faea" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:07:11.944876 19553 raft_consensus.cc:1240] T 86a6797bdfe94fa496c050ceae4bd0d9 P e61c3a8f61bb48f8a963c9480e53c168 [term 16 FOLLOWER]: Rejecting Update request from peer 0473d2b2d01f4459b1e90fd12cc7840e for earlier term 15. Current term is 16. Ops: []
I20260709 13:07:11.949589 19556 raft_consensus.cc:2468] T 2b74109013a140ada21feeef92d6f563 P e61c3a8f61bb48f8a963c9480e53c168 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 18.
I20260709 13:07:11.918638 19479 raft_consensus.cc:2468] T edd7d470b5014c9489be7f41f64355c9 P 0473d2b2d01f4459b1e90fd12cc7840e [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 24.
W20260709 13:07:11.971324 19375 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.3:36891, user_credentials={real_user=slave}} blocked reactor thread for 74481us
I20260709 13:07:11.974786 19554 raft_consensus.cc:1240] T 76cb037fc9064d13b59a8969d897ce8c P e61c3a8f61bb48f8a963c9480e53c168 [term 19 FOLLOWER]: Rejecting Update request from peer e5256d91808b47c195bc9b4dbd7f2b87 for earlier term 18. Current term is 19. Ops: []
I20260709 13:07:11.973572 19479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86a6797bdfe94fa496c050ceae4bd0d9" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
W20260709 13:07:11.975514 19375 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:11.975803 19554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85c494af21f9457a85da47b9bc70c1fd" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:07:11.976063 19375 leader_election.cc:304] T 65d8cb8d6ec64f459d5a47cefab10acf P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168; no voters: 127766fc592545a4997f7790f50f6076
I20260709 13:07:11.976665 19554 raft_consensus.cc:2468] T 85c494af21f9457a85da47b9bc70c1fd P e61c3a8f61bb48f8a963c9480e53c168 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 18.
I20260709 13:07:11.983349 19411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a16f7501e2444fb86d4e2778e734e02" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:07:11.986187 19375 leader_election.cc:304] T 14935b3ddf914369822e4a0547aaa355 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87; no voters: 127766fc592545a4997f7790f50f6076, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:07:11.988920 19405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9962423cb4e54fcfa5de01daf68a86e7" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
I20260709 13:07:11.991047 19405 raft_consensus.cc:3060] T 9962423cb4e54fcfa5de01daf68a86e7 P e5256d91808b47c195bc9b4dbd7f2b87 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:07:11.911391 25987 raft_consensus.cc:515] T 0cdf56e38bbc453d9438d359e5a69955 P 0473d2b2d01f4459b1e90fd12cc7840e [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:07:12.024698 19480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dc5b3532fe54f74876d02beffa2c230" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 22 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:07:12.025833 19480 raft_consensus.cc:2410] T 1dc5b3532fe54f74876d02beffa2c230 P 0473d2b2d01f4459b1e90fd12cc7840e [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e5256d91808b47c195bc9b4dbd7f2b87 for term 22 because replica has last-logged OpId of term: 20 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 19 index: 10.
I20260709 13:07:11.993058 19559 raft_consensus.cc:1275] T fa8650e71aa14778b3d73721fc50d9fc P e61c3a8f61bb48f8a963c9480e53c168 [term 20 FOLLOWER]: Refusing update from remote peer e5256d91808b47c195bc9b4dbd7f2b87: Log matching property violated. Preceding OpId in replica: term: 18 index: 10. Preceding OpId from leader: term: 20 index: 11. (index mismatch)
I20260709 13:07:11.973344 26115 raft_consensus.cc:493] T 833a2f0775ed407a94b8924ce50adb63 P 127766fc592545a4997f7790f50f6076 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:11.967002 26017 raft_consensus.cc:493] T b08304a0a02b42d7840c4e8ee9a6bd1a P 0473d2b2d01f4459b1e90fd12cc7840e [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:11.996362 19556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "217b5fae677b4971b3bbd2f357a1f7ff" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:07:11.984910 26103 raft_consensus.cc:697] T edd7d470b5014c9489be7f41f64355c9 P e5256d91808b47c195bc9b4dbd7f2b87 [term 24 LEADER]: Becoming Leader. State: Replica: e5256d91808b47c195bc9b4dbd7f2b87, State: Running, Role: LEADER
I20260709 13:07:11.997221 26154 raft_consensus.cc:3060] T 14935b3ddf914369822e4a0547aaa355 P e5256d91808b47c195bc9b4dbd7f2b87 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:07:11.998737 25993 consensus_queue.cc:1048] T b08304a0a02b42d7840c4e8ee9a6bd1a P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:07:12.001777 25093 consensus_queue.cc:1059] T 76cb037fc9064d13b59a8969d897ce8c P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 }, Status: INVALID_TERM, Last received: 18.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:07:11.979794 25992 raft_consensus.cc:2804] T 2725d2c4cb054f18b0fc8f735c15f6c2 P e5256d91808b47c195bc9b4dbd7f2b87 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:07:12.011152 19479 raft_consensus.cc:1240] T ed7fdbcb96d14d418db9ca90a792588a P 0473d2b2d01f4459b1e90fd12cc7840e [term 17 FOLLOWER]: Rejecting Update request from peer e61c3a8f61bb48f8a963c9480e53c168 for earlier term 16. Current term is 17. Ops: []
I20260709 13:07:11.959528 26101 raft_consensus.cc:493] T a08760e15aac4630a629431f56024dc8 P 0473d2b2d01f4459b1e90fd12cc7840e [term 23 FOLLOWER]: Starting pre-election (detected failure of leader e5256d91808b47c195bc9b4dbd7f2b87)
I20260709 13:07:12.026844 19481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76cb037fc9064d13b59a8969d897ce8c" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:07:12.001629 19553 raft_consensus.cc:1275] T f1b10566f45d4a7d9029858330e02d5b P e61c3a8f61bb48f8a963c9480e53c168 [term 19 FOLLOWER]: Refusing update from remote peer e5256d91808b47c195bc9b4dbd7f2b87: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 19 index: 12. (index mismatch)
I20260709 13:07:12.032966 19449 leader_election.cc:304] T 22196caba61445d3bec98a0aab3c337d P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87; no voters: 
I20260709 13:07:11.984809 26097 raft_consensus.cc:2804] T 65d8cb8d6ec64f459d5a47cefab10acf P e5256d91808b47c195bc9b4dbd7f2b87 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:07:12.030743 19526 leader_election.cc:304] T 21e14947d70440f19044d8f75c31e1f9 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:07:12.029758 20111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f85fc4b527a48848e5faa083b604e36" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:07:11.920436 25977 raft_consensus.cc:515] T ff75a1d4cb1f493db8f71ddc136ba9ab P 0473d2b2d01f4459b1e90fd12cc7840e [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:07:11.938043 26001 raft_consensus.cc:515] T 3e1f505cb0f1427bbd698ac889d80821 P e5256d91808b47c195bc9b4dbd7f2b87 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:07:12.039057 25093 raft_consensus.cc:3055] T 76cb037fc9064d13b59a8969d897ce8c P e5256d91808b47c195bc9b4dbd7f2b87 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:07:11.998551 26088 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41524 (request call id 0) took 2814 ms. Trace:
I20260709 13:07:12.039419 19560 raft_consensus.cc:2468] T 1efebf73c86e432baa55533136b6e12c P e61c3a8f61bb48f8a963c9480e53c168 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 127766fc592545a4997f7790f50f6076 in term 16.
I20260709 13:07:11.942005 25957 raft_consensus.cc:515] T f1b10566f45d4a7d9029858330e02d5b P 0473d2b2d01f4459b1e90fd12cc7840e [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:07:11.980705 26157 raft_consensus.cc:493] T a08760e15aac4630a629431f56024dc8 P e61c3a8f61bb48f8a963c9480e53c168 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader e5256d91808b47c195bc9b4dbd7f2b87)
I20260709 13:07:12.046013 19411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2725d2c4cb054f18b0fc8f735c15f6c2" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:07:12.046607 19449 leader_election.cc:304] T e381f1d6b8184797ad142de49be225a8 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87; no voters: 
I20260709 13:07:12.100258 19477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2725d2c4cb054f18b0fc8f735c15f6c2" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
W20260709 13:07:12.100793 19449 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.1:40321, user_credentials={real_user=slave}} blocked reactor thread for 54309.5us
I20260709 13:07:12.101724 19449 leader_election.cc:400] T 9962423cb4e54fcfa5de01daf68a86e7 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 18 election: Vote denied by peer 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121) with higher term. Message: Invalid argument: T 9962423cb4e54fcfa5de01daf68a86e7 P 127766fc592545a4997f7790f50f6076 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 0473d2b2d01f4459b1e90fd12cc7840e for earlier term 18. Current term is 19.
I20260709 13:07:12.102089 19449 leader_election.cc:403] T 9962423cb4e54fcfa5de01daf68a86e7 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 18 election: Cancelling election due to peer responding with higher term
I20260709 13:07:12.053565 19480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48824d5acfbc485ebf8c2d944e7202de" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:07:11.967478 26159 raft_consensus.cc:515] T e381f1d6b8184797ad142de49be225a8 P e61c3a8f61bb48f8a963c9480e53c168 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:07:12.105554 25376 raft_consensus.cc:3060] T 9962423cb4e54fcfa5de01daf68a86e7 P 0473d2b2d01f4459b1e90fd12cc7840e [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:07:12.095961 25093 raft_consensus.cc:740] T 76cb037fc9064d13b59a8969d897ce8c P e5256d91808b47c195bc9b4dbd7f2b87 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: e5256d91808b47c195bc9b4dbd7f2b87, State: Running, Role: LEADER
I20260709 13:07:12.002573 19375 leader_election.cc:304] T 2b74109013a140ada21feeef92d6f563 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:07:11.969324 25925 raft_consensus.cc:515] T 833a2f0775ed407a94b8924ce50adb63 P e5256d91808b47c195bc9b4dbd7f2b87 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:07:11.985509 26117 raft_consensus.cc:515] T 14efcc79969f41babe5529c22d59156d P e5256d91808b47c195bc9b4dbd7f2b87 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:07:12.041137 25992 raft_consensus.cc:493] T 2725d2c4cb054f18b0fc8f735c15f6c2 P e5256d91808b47c195bc9b4dbd7f2b87 [term 19 FOLLOWER]: Starting leader election (detected failure of leader 0473d2b2d01f4459b1e90fd12cc7840e)
I20260709 13:07:12.053210 25871 raft_consensus.cc:2804] T 22196caba61445d3bec98a0aab3c337d P 0473d2b2d01f4459b1e90fd12cc7840e [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:07:12.138329 19484 raft_consensus.cc:1275] T f1b10566f45d4a7d9029858330e02d5b P 0473d2b2d01f4459b1e90fd12cc7840e [term 19 FOLLOWER]: Refusing update from remote peer e5256d91808b47c195bc9b4dbd7f2b87: Log matching property violated. Preceding OpId in replica: term: 18 index: 12. Preceding OpId from leader: term: 19 index: 12. (term mismatch)
I20260709 13:07:12.138828 19484 pending_rounds.cc:85] T f1b10566f45d4a7d9029858330e02d5b P 0473d2b2d01f4459b1e90fd12cc7840e: Aborting all ops after (but not including) 11
I20260709 13:07:12.139083 19484 pending_rounds.cc:107] T f1b10566f45d4a7d9029858330e02d5b P 0473d2b2d01f4459b1e90fd12cc7840e: Aborting uncommitted NO_OP operation due to leader change: 18.12
I20260709 13:07:12.139381 19484 raft_consensus.cc:2889] T f1b10566f45d4a7d9029858330e02d5b P 0473d2b2d01f4459b1e90fd12cc7840e [term 19 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:07:12.122906 19481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e36a9d6e29c4a7c860cf267efbd4c74" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:07:12.125157 20078 leader_election.cc:304] T 0e1085d23e8347fbbd5bce7542f4b1f4 P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, 127766fc592545a4997f7790f50f6076; no voters: e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:07:12.129199 19450 leader_election.cc:304] T 1dc5b3532fe54f74876d02beffa2c230 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168; no voters: e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:07:12.112664 19405 raft_consensus.cc:2468] T 9962423cb4e54fcfa5de01daf68a86e7 P e5256d91808b47c195bc9b4dbd7f2b87 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 127766fc592545a4997f7790f50f6076 in term 19.
I20260709 13:07:12.142249 19405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "217b5fae677b4971b3bbd2f357a1f7ff" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:07:12.143204 19405 raft_consensus.cc:2393] T 217b5fae677b4971b3bbd2f357a1f7ff P e5256d91808b47c195bc9b4dbd7f2b87 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0473d2b2d01f4459b1e90fd12cc7840e in current term 16: Already voted for candidate e61c3a8f61bb48f8a963c9480e53c168 in this term.
I20260709 13:07:12.099629 26061 raft_consensus.cc:2804] T 21e14947d70440f19044d8f75c31e1f9 P e61c3a8f61bb48f8a963c9480e53c168 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:07:12.140100 19481 raft_consensus.cc:2468] T 2e36a9d6e29c4a7c860cf267efbd4c74 P 0473d2b2d01f4459b1e90fd12cc7840e [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 14.
I20260709 13:07:12.146020 19477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46c5bfeecc314717bffe987e6844b6d0" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 26 candidate_status { last_received { term: 25 index: 13 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:07:12.150748 19411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e36a9d6e29c4a7c860cf267efbd4c74" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:07:12.151428 19450 leader_election.cc:304] T d1e5873a19244c5ebbcd38e126796ee7 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e; no voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:07:12.151909 20108 raft_consensus.cc:3060] T 96efeaaf1057492490e9a621f37e1a2d P 127766fc592545a4997f7790f50f6076 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:07:12.106815 26113 raft_consensus.cc:2804] T e381f1d6b8184797ad142de49be225a8 P 0473d2b2d01f4459b1e90fd12cc7840e [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:07:12.152562 19555 raft_consensus.cc:2468] T e381f1d6b8184797ad142de49be225a8 P e61c3a8f61bb48f8a963c9480e53c168 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 17.
I20260709 13:07:12.141955 25093 consensus_queue.cc:260] T 76cb037fc9064d13b59a8969d897ce8c P e5256d91808b47c195bc9b4dbd7f2b87 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 18.10, Last appended by leader: 10, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:07:12.175941 25093 raft_consensus.cc:3060] T 76cb037fc9064d13b59a8969d897ce8c P e5256d91808b47c195bc9b4dbd7f2b87 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:07:12.157630 19405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70797e5783b5454ab0d0eea663e791e3" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:07:12.176306 19480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2725d2c4cb054f18b0fc8f735c15f6c2" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:07:12.136735 25871 raft_consensus.cc:493] T 22196caba61445d3bec98a0aab3c337d P 0473d2b2d01f4459b1e90fd12cc7840e [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:12.155742 19553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22196caba61445d3bec98a0aab3c337d" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:07:12.040512 26017 raft_consensus.cc:515] T b08304a0a02b42d7840c4e8ee9a6bd1a P 0473d2b2d01f4459b1e90fd12cc7840e [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:07:12.191777 25957 leader_election.cc:290] T f1b10566f45d4a7d9029858330e02d5b P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:07:12.149881 26061 raft_consensus.cc:493] T 21e14947d70440f19044d8f75c31e1f9 P e61c3a8f61bb48f8a963c9480e53c168 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:12.192544 26061 raft_consensus.cc:3060] T 21e14947d70440f19044d8f75c31e1f9 P e61c3a8f61bb48f8a963c9480e53c168 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:07:12.194723 19409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "172b3dd13109415a955b71ac0e9d2234" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
I20260709 13:07:12.170495 25975 raft_consensus.cc:2804] T 1dc5b3532fe54f74876d02beffa2c230 P 0473d2b2d01f4459b1e90fd12cc7840e [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:07:12.195551 25975 raft_consensus.cc:697] T 1dc5b3532fe54f74876d02beffa2c230 P 0473d2b2d01f4459b1e90fd12cc7840e [term 21 LEADER]: Becoming Leader. State: Replica: 0473d2b2d01f4459b1e90fd12cc7840e, State: Running, Role: LEADER
I20260709 13:07:12.195932 19409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21e14947d70440f19044d8f75c31e1f9" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 20 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:07:12.167168 19450 leader_election.cc:304] T 14935b3ddf914369822e4a0547aaa355 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168; no voters: 127766fc592545a4997f7790f50f6076
I20260709 13:07:12.097893 26151 consensus_queue.cc:1059] T 0e1085d23e8347fbbd5bce7542f4b1f4 P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 }, Status: INVALID_TERM, Last received: 15.12, Next index: 13, Last known committed idx: 11, Time since last communication: 0.049s
I20260709 13:07:12.135285 25992 raft_consensus.cc:3060] T 2725d2c4cb054f18b0fc8f735c15f6c2 P e5256d91808b47c195bc9b4dbd7f2b87 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:07:12.144517 20075 leader_election.cc:304] T 9962423cb4e54fcfa5de01daf68a86e7 P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 127766fc592545a4997f7790f50f6076, e5256d91808b47c195bc9b4dbd7f2b87; no voters: 
I20260709 13:07:12.143507 26065 raft_consensus.cc:493] T bc225c93219c45538b53a1bd3d387e4d P e5256d91808b47c195bc9b4dbd7f2b87 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:12.177500 19405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a61655d99124a29b486ba4a5b37faea" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:07:12.041733 26115 raft_consensus.cc:515] T 833a2f0775ed407a94b8924ce50adb63 P 127766fc592545a4997f7790f50f6076 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:07:12.181831 19477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cdf56e38bbc453d9438d359e5a69955" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 20 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:07:12.183526 26001 leader_election.cc:290] T 3e1f505cb0f1427bbd698ac889d80821 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
W20260709 13:07:12.184356 26176 log.cc:927] Time spent T 00000000000000000000000000000000 P 97750b77d35444acb7791ebf26cc2685: Append to log took a long time: real 0.079s	user 0.000s	sys 0.000s
W20260709 13:07:12.185062 26174 log.cc:927] Time spent T 40e1e16737a842ee936002830f36882e P e5256d91808b47c195bc9b4dbd7f2b87: Append to log took a long time: real 0.087s	user 0.000s	sys 0.000s
I20260709 13:07:12.141587 25953 consensus_queue.cc:1059] T 172b3dd13109415a955b71ac0e9d2234 P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false }, Status: INVALID_TERM, Last received: 17.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.052s
I20260709 13:07:12.192128 26017 leader_election.cc:290] T b08304a0a02b42d7840c4e8ee9a6bd1a P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:07:12.054919 26101 raft_consensus.cc:515] T a08760e15aac4630a629431f56024dc8 P 0473d2b2d01f4459b1e90fd12cc7840e [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:07:12.161441 19411 raft_consensus.cc:2393] T 2e36a9d6e29c4a7c860cf267efbd4c74 P e5256d91808b47c195bc9b4dbd7f2b87 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e61c3a8f61bb48f8a963c9480e53c168 in current term 14: Already voted for candidate e5256d91808b47c195bc9b4dbd7f2b87 in this term.
I20260709 13:07:12.203896 19553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "217b5fae677b4971b3bbd2f357a1f7ff" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:07:12.233891 26033 raft_consensus.cc:2804] T 14935b3ddf914369822e4a0547aaa355 P 0473d2b2d01f4459b1e90fd12cc7840e [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:07:12.266894 26033 raft_consensus.cc:493] T 14935b3ddf914369822e4a0547aaa355 P 0473d2b2d01f4459b1e90fd12cc7840e [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:12.267297 26033 raft_consensus.cc:3060] T 14935b3ddf914369822e4a0547aaa355 P 0473d2b2d01f4459b1e90fd12cc7840e [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:07:12.200766 26141 leader_election.cc:290] T 217b5fae677b4971b3bbd2f357a1f7ff P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:07:12.178490 26113 raft_consensus.cc:493] T e381f1d6b8184797ad142de49be225a8 P 0473d2b2d01f4459b1e90fd12cc7840e [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:12.206701 19410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f85fc4b527a48848e5faa083b604e36" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:07:12.239528 25920 raft_consensus.cc:2804] T 9962423cb4e54fcfa5de01daf68a86e7 P 127766fc592545a4997f7790f50f6076 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:07:12.207906 25977 leader_election.cc:290] T ff75a1d4cb1f493db8f71ddc136ba9ab P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:07:12.146937 25993 raft_consensus.cc:2804] T 2b74109013a140ada21feeef92d6f563 P e5256d91808b47c195bc9b4dbd7f2b87 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:07:12.211119 19478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e36a9d6e29c4a7c860cf267efbd4c74" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
W20260709 13:07:12.274967 19375 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.3:36891, user_credentials={real_user=slave}} blocked reactor thread for 272464us
I20260709 13:07:12.213169 19551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21e14947d70440f19044d8f75c31e1f9" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 20 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:07:12.213667 19407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1b10566f45d4a7d9029858330e02d5b" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 20 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:07:12.196450 25975 consensus_queue.cc:237] T 1dc5b3532fe54f74876d02beffa2c230 P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 20.11, Last appended by leader: 11, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:07:12.220258 19480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "217b5fae677b4971b3bbd2f357a1f7ff" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:07:12.200006 26117 leader_election.cc:290] T 14efcc79969f41babe5529c22d59156d P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:07:12.276435 19480 raft_consensus.cc:2468] T 217b5fae677b4971b3bbd2f357a1f7ff P 0473d2b2d01f4459b1e90fd12cc7840e [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 15.
I20260709 13:07:12.221654 25376 raft_consensus.cc:2749] T 9962423cb4e54fcfa5de01daf68a86e7 P 0473d2b2d01f4459b1e90fd12cc7840e [term 19 FOLLOWER]: Leader election lost for term 18. Reason: Vote denied by peer 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121) with higher term. Message: Invalid argument: T 9962423cb4e54fcfa5de01daf68a86e7 P 127766fc592545a4997f7790f50f6076 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 0473d2b2d01f4459b1e90fd12cc7840e for earlier term 18. Current term is 19.
I20260709 13:07:12.166501 26162 raft_consensus.cc:2749] T d1e5873a19244c5ebbcd38e126796ee7 P 0473d2b2d01f4459b1e90fd12cc7840e [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:07:12.221961 19409 raft_consensus.cc:2468] T 21e14947d70440f19044d8f75c31e1f9 P e5256d91808b47c195bc9b4dbd7f2b87 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 19.
I20260709 13:07:12.218312 26035 leader_election.cc:290] T f93ee515a9c14139bf566522ed8232f3 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 23 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
W20260709 13:07:12.227232 19450 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.3:36891, user_credentials={real_user=slave}} blocked reactor thread for 60748.6us
I20260709 13:07:12.114109 26157 raft_consensus.cc:515] T a08760e15aac4630a629431f56024dc8 P e61c3a8f61bb48f8a963c9480e53c168 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:07:12.177695 26092 raft_consensus.cc:2804] T 0e1085d23e8347fbbd5bce7542f4b1f4 P 127766fc592545a4997f7790f50f6076 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:07:12.237176 19477 raft_consensus.cc:2410] T 0cdf56e38bbc453d9438d359e5a69955 P 0473d2b2d01f4459b1e90fd12cc7840e [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e5256d91808b47c195bc9b4dbd7f2b87 for term 20 because replica has last-logged OpId of term: 18 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 17 index: 11.
I20260709 13:07:12.209997 25871 raft_consensus.cc:3060] T 22196caba61445d3bec98a0aab3c337d P 0473d2b2d01f4459b1e90fd12cc7840e [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:07:12.179754 26107 leader_election.cc:290] T 7f575b143b844aa096b50997dad3516a P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
W20260709 13:07:12.234529 20075 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.1:40321, user_credentials={real_user=slave}} blocked reactor thread for 90121.9us
I20260709 13:07:12.227964 26097 raft_consensus.cc:697] T 65d8cb8d6ec64f459d5a47cefab10acf P e5256d91808b47c195bc9b4dbd7f2b87 [term 21 LEADER]: Becoming Leader. State: Replica: e5256d91808b47c195bc9b4dbd7f2b87, State: Running, Role: LEADER
I20260709 13:07:12.257833 19558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e381f1d6b8184797ad142de49be225a8" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 18 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:07:12.174785 26044 consensus_queue.cc:1048] T 5ec1c4ce15e04c7e8c283a62179f2a64 P 127766fc592545a4997f7790f50f6076 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.064s
I20260709 13:07:12.334383 25925 leader_election.cc:290] T 833a2f0775ed407a94b8924ce50adb63 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:07:12.335254 19477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1b10566f45d4a7d9029858330e02d5b" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 20 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:07:12.336362 19477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21e14947d70440f19044d8f75c31e1f9" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 20 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:07:12.336961 19477 raft_consensus.cc:2468] T 21e14947d70440f19044d8f75c31e1f9 P 0473d2b2d01f4459b1e90fd12cc7840e [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 19.
W20260709 13:07:12.337368 26182 log.cc:927] Time spent T 775c229504194560ba9589bc2199b089 P 0473d2b2d01f4459b1e90fd12cc7840e: Append to log took a long time: real 0.059s	user 0.000s	sys 0.000s
I20260709 13:07:12.337766 19477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22196caba61445d3bec98a0aab3c337d" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 20 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:07:12.278759 25905 leader_election.cc:290] T 9962423cb4e54fcfa5de01daf68a86e7 P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 19 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:07:12.342176 26101 leader_election.cc:290] T a08760e15aac4630a629431f56024dc8 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:07:12.343449 19486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b74109013a140ada21feeef92d6f563" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 18 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:07:12.343379 26061 raft_consensus.cc:515] T 21e14947d70440f19044d8f75c31e1f9 P e61c3a8f61bb48f8a963c9480e53c168 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:07:12.344177 19486 raft_consensus.cc:3060] T 2b74109013a140ada21feeef92d6f563 P 0473d2b2d01f4459b1e90fd12cc7840e [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:07:12.345597 26061 leader_election.cc:290] T 21e14947d70440f19044d8f75c31e1f9 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 20 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:07:12.286794 25993 raft_consensus.cc:697] T 2b74109013a140ada21feeef92d6f563 P e5256d91808b47c195bc9b4dbd7f2b87 [term 18 LEADER]: Becoming Leader. State: Replica: e5256d91808b47c195bc9b4dbd7f2b87, State: Running, Role: LEADER
I20260709 13:07:12.287185 26159 leader_election.cc:290] T e381f1d6b8184797ad142de49be225a8 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:07:12.282363 26134 leader_election.cc:290] T 1efebf73c86e432baa55533136b6e12c P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 15 election: Requested vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:07:12.348309 19551 raft_consensus.cc:2393] T 21e14947d70440f19044d8f75c31e1f9 P e61c3a8f61bb48f8a963c9480e53c168 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0473d2b2d01f4459b1e90fd12cc7840e in current term 20: Already voted for candidate e61c3a8f61bb48f8a963c9480e53c168 in this term.
I20260709 13:07:12.204650 20111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14efcc79969f41babe5529c22d59156d" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:07:12.275713 19375 leader_election.cc:304] T 85c494af21f9457a85da47b9bc70c1fd P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168; no voters: 127766fc592545a4997f7790f50f6076
I20260709 13:07:12.275498 19478 raft_consensus.cc:2468] T 2e36a9d6e29c4a7c860cf267efbd4c74 P 0473d2b2d01f4459b1e90fd12cc7840e [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 14.
I20260709 13:07:12.168572 26103 consensus_queue.cc:237] T edd7d470b5014c9489be7f41f64355c9 P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 22.12, Last appended by leader: 12, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:07:12.275434 26113 raft_consensus.cc:3060] T e381f1d6b8184797ad142de49be225a8 P 0473d2b2d01f4459b1e90fd12cc7840e [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:07:12.285658 19480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1efebf73c86e432baa55533136b6e12c" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:07:12.297324 19450 leader_election.cc:304] T fa8650e71aa14778b3d73721fc50d9fc P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168; no voters: e5256d91808b47c195bc9b4dbd7f2b87
W20260709 13:07:12.359925 19450 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.3:36891, user_credentials={real_user=slave}} blocked reactor thread for 62693.9us
I20260709 13:07:12.268133 26017 raft_consensus.cc:3055] T 172b3dd13109415a955b71ac0e9d2234 P 0473d2b2d01f4459b1e90fd12cc7840e [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:07:12.240370 26065 raft_consensus.cc:515] T bc225c93219c45538b53a1bd3d387e4d P e5256d91808b47c195bc9b4dbd7f2b87 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:07:12.099345 26088 rpcz_store.cc:276] 0709 13:07:09.219131 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:09.219375 (+   244us) service_pool.cc:224] Handling call
0709 13:07:09.667585 (+448210us) ts_tablet_manager.cc:1151] Deleting tablet ab43d85f64114d4ebf618930e43d9ed0
0709 13:07:09.689320 (+ 21735us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0709 13:07:11.447276 (+1757956us) tablet_metadata.cc:665] Metadata flushed
0709 13:07:11.749590 (+302314us) tablet_metadata.cc:665] Metadata flushed
0709 13:07:11.998435 (+248845us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":204725,"tablet-delete.queue_time_us":446999,"thread_start_us":204454,"threads_started":1}
I20260709 13:07:12.304710 26092 raft_consensus.cc:697] T 0e1085d23e8347fbbd5bce7542f4b1f4 P 127766fc592545a4997f7790f50f6076 [term 16 LEADER]: Becoming Leader. State: Replica: 127766fc592545a4997f7790f50f6076, State: Running, Role: LEADER
I20260709 13:07:12.304987 25987 leader_election.cc:290] T 0cdf56e38bbc453d9438d359e5a69955 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 19 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:07:12.327090 26147 raft_consensus.cc:493] T ece3db938bc649d4a40a51522ed5259c P e61c3a8f61bb48f8a963c9480e53c168 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:12.327575 26035 raft_consensus.cc:493] T ff75a1d4cb1f493db8f71ddc136ba9ab P e61c3a8f61bb48f8a963c9480e53c168 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader e5256d91808b47c195bc9b4dbd7f2b87)
I20260709 13:07:12.327812 26115 leader_election.cc:290] T 833a2f0775ed407a94b8924ce50adb63 P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:07:12.329663 26137 leader_election.cc:290] T 28af091831594f9d8e96482078cc7625 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:07:12.295642 26162 raft_consensus.cc:493] T 7be9efa6559648dbb5a0f7684c4542d1 P 0473d2b2d01f4459b1e90fd12cc7840e [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:12.296478 26178 log.cc:927] Time spent T 5ec1c4ce15e04c7e8c283a62179f2a64 P e5256d91808b47c195bc9b4dbd7f2b87: Append to log took a long time: real 0.087s	user 0.000s	sys 0.000s
I20260709 13:07:12.331174 26097 consensus_queue.cc:237] T 65d8cb8d6ec64f459d5a47cefab10acf P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 19.12, Last appended by leader: 12, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:07:12.332166 26157 leader_election.cc:290] T a08760e15aac4630a629431f56024dc8 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
W20260709 13:07:12.393390 19377 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.2:46257, user_credentials={real_user=slave}} blocked reactor thread for 153820us
I20260709 13:07:12.351720 19482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e381f1d6b8184797ad142de49be225a8" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 18 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
W20260709 13:07:12.352520 19524 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:12.352854 20108 raft_consensus.cc:1275] T 96efeaaf1057492490e9a621f37e1a2d P 127766fc592545a4997f7790f50f6076 [term 21 FOLLOWER]: Refusing update from remote peer 0473d2b2d01f4459b1e90fd12cc7840e: Log matching property violated. Preceding OpId in replica: term: 19 index: 13. Preceding OpId from leader: term: 21 index: 14. (index mismatch)
I20260709 13:07:12.353437 19406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "833a2f0775ed407a94b8924ce50adb63" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
W20260709 13:07:12.394574 19377 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:12.330222 26108 raft_consensus.cc:515] T 1dc5b3532fe54f74876d02beffa2c230 P e61c3a8f61bb48f8a963c9480e53c168 [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:07:12.360934 19486 raft_consensus.cc:2468] T 2b74109013a140ada21feeef92d6f563 P 0473d2b2d01f4459b1e90fd12cc7840e [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 18.
I20260709 13:07:12.362974 19480 raft_consensus.cc:2368] T 1efebf73c86e432baa55533136b6e12c P 0473d2b2d01f4459b1e90fd12cc7840e [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate e61c3a8f61bb48f8a963c9480e53c168 for earlier term 15. Current term is 16.
I20260709 13:07:12.363178 25376 consensus_queue.cc:1059] T 86a6797bdfe94fa496c050ceae4bd0d9 P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 }, Status: INVALID_TERM, Last received: 15.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:07:12.364063 19450 leader_election.cc:304] T 217b5fae677b4971b3bbd2f357a1f7ff P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e; no voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:07:12.287041 25920 raft_consensus.cc:697] T 9962423cb4e54fcfa5de01daf68a86e7 P 127766fc592545a4997f7790f50f6076 [term 19 LEADER]: Becoming Leader. State: Replica: 127766fc592545a4997f7790f50f6076, State: Running, Role: LEADER
I20260709 13:07:12.369913 19478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab43d85f64114d4ebf618930e43d9ed0" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 22 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:07:12.398123 19478 raft_consensus.cc:2410] T ab43d85f64114d4ebf618930e43d9ed0 P 0473d2b2d01f4459b1e90fd12cc7840e [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e61c3a8f61bb48f8a963c9480e53c168 for term 22 because replica has last-logged OpId of term: 21 index: 14, which is greater than that of the candidate, which has last-logged OpId of term: 19 index: 13.
I20260709 13:07:12.374033 19485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14935b3ddf914369822e4a0547aaa355" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 14 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
W20260709 13:07:12.378243 19375 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.3:36891, user_credentials={real_user=slave}} blocked reactor thread for 102602us
I20260709 13:07:12.299472 25977 consensus_queue.cc:1059] T f93ee515a9c14139bf566522ed8232f3 P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 }, Status: INVALID_TERM, Last received: 22.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.065s
I20260709 13:07:12.385984 19404 raft_consensus.cc:1240] T 7be9efa6559648dbb5a0f7684c4542d1 P e5256d91808b47c195bc9b4dbd7f2b87 [term 21 LEADER]: Rejecting Update request from peer e61c3a8f61bb48f8a963c9480e53c168 for earlier term 20. Current term is 21. Ops: []
I20260709 13:07:12.388602 19405 raft_consensus.cc:1275] T bc225c93219c45538b53a1bd3d387e4d P e5256d91808b47c195bc9b4dbd7f2b87 [term 17 FOLLOWER]: Refusing update from remote peer 0473d2b2d01f4459b1e90fd12cc7840e: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
I20260709 13:07:12.361955 26017 raft_consensus.cc:740] T 172b3dd13109415a955b71ac0e9d2234 P 0473d2b2d01f4459b1e90fd12cc7840e [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 0473d2b2d01f4459b1e90fd12cc7840e, State: Running, Role: LEADER
I20260709 13:07:12.368422 25953 raft_consensus.cc:2804] T fa8650e71aa14778b3d73721fc50d9fc P 0473d2b2d01f4459b1e90fd12cc7840e [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:07:12.351142 20107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "833a2f0775ed407a94b8924ce50adb63" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:07:12.406311 20107 raft_consensus.cc:2468] T 833a2f0775ed407a94b8924ce50adb63 P 127766fc592545a4997f7790f50f6076 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 15.
I20260709 13:07:12.394901 19406 raft_consensus.cc:2468] T 833a2f0775ed407a94b8924ce50adb63 P e5256d91808b47c195bc9b4dbd7f2b87 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 127766fc592545a4997f7790f50f6076 in term 15.
I20260709 13:07:12.347626 25993 consensus_queue.cc:237] T 2b74109013a140ada21feeef92d6f563 P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:07:12.408962 19374 leader_election.cc:304] T 833a2f0775ed407a94b8924ce50adb63 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 127766fc592545a4997f7790f50f6076, e5256d91808b47c195bc9b4dbd7f2b87; no voters: 
I20260709 13:07:12.358307 26033 raft_consensus.cc:515] T 14935b3ddf914369822e4a0547aaa355 P 0473d2b2d01f4459b1e90fd12cc7840e [term 15 FOLLOWER]: Starting leader election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:07:12.411449 26191 consensus_queue.cc:1048] T f1b10566f45d4a7d9029858330e02d5b P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.003s
I20260709 13:07:12.413420 26033 leader_election.cc:290] T 14935b3ddf914369822e4a0547aaa355 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 15 election: Requested vote from peers e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:07:12.401158 19377 leader_election.cc:304] T 9962423cb4e54fcfa5de01daf68a86e7 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87; no voters: 127766fc592545a4997f7790f50f6076
I20260709 13:07:12.416417 19377 leader_election.cc:304] T b9f0d59553ad444883fcf5b5909f9798 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:07:12.393829 26162 raft_consensus.cc:515] T 7be9efa6559648dbb5a0f7684c4542d1 P 0473d2b2d01f4459b1e90fd12cc7840e [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } attrs { replace: true } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:07:12.418385 19485 raft_consensus.cc:1813] T 14935b3ddf914369822e4a0547aaa355 P 0473d2b2d01f4459b1e90fd12cc7840e [term 15 FOLLOWER]: Handling vote request from an unknown peer e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:07:12.419507 26162 leader_election.cc:290] T 7be9efa6559648dbb5a0f7684c4542d1 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:07:12.419992 19485 raft_consensus.cc:2368] T 14935b3ddf914369822e4a0547aaa355 P 0473d2b2d01f4459b1e90fd12cc7840e [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e5256d91808b47c195bc9b4dbd7f2b87 for earlier term 14. Current term is 15.
I20260709 13:07:12.420349 20075 leader_election.cc:304] T 833a2f0775ed407a94b8924ce50adb63 P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 127766fc592545a4997f7790f50f6076, e5256d91808b47c195bc9b4dbd7f2b87; no voters: 
I20260709 13:07:12.421211 26140 raft_consensus.cc:2804] T 833a2f0775ed407a94b8924ce50adb63 P 127766fc592545a4997f7790f50f6076 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:07:12.421589 26140 raft_consensus.cc:493] T 833a2f0775ed407a94b8924ce50adb63 P 127766fc592545a4997f7790f50f6076 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:12.421906 26140 raft_consensus.cc:3060] T 833a2f0775ed407a94b8924ce50adb63 P 127766fc592545a4997f7790f50f6076 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:07:12.408533 25987 raft_consensus.cc:3060] T 217b5fae677b4971b3bbd2f357a1f7ff P 0473d2b2d01f4459b1e90fd12cc7840e [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:07:12.423671 26065 leader_election.cc:290] T bc225c93219c45538b53a1bd3d387e4d P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:07:12.424242 26065 consensus_queue.cc:1048] T b08304a0a02b42d7840c4e8ee9a6bd1a P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:07:12.386520 26154 raft_consensus.cc:2749] T 14935b3ddf914369822e4a0547aaa355 P e5256d91808b47c195bc9b4dbd7f2b87 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:07:12.405985 25953 raft_consensus.cc:493] T fa8650e71aa14778b3d73721fc50d9fc P 0473d2b2d01f4459b1e90fd12cc7840e [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:12.424449 26190 raft_consensus.cc:2804] T 833a2f0775ed407a94b8924ce50adb63 P e5256d91808b47c195bc9b4dbd7f2b87 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:07:12.403954 25376 raft_consensus.cc:3055] T 86a6797bdfe94fa496c050ceae4bd0d9 P 0473d2b2d01f4459b1e90fd12cc7840e [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:07:12.432787 25376 raft_consensus.cc:740] T 86a6797bdfe94fa496c050ceae4bd0d9 P 0473d2b2d01f4459b1e90fd12cc7840e [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 0473d2b2d01f4459b1e90fd12cc7840e, State: Running, Role: LEADER
I20260709 13:07:12.395429 25957 raft_consensus.cc:493] T ff9b0eddd810459b82d91c60777c10eb P 0473d2b2d01f4459b1e90fd12cc7840e [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:12.419515 19377 leader_election.cc:304] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87; no voters: 127766fc592545a4997f7790f50f6076
I20260709 13:07:12.399899 26117 raft_consensus.cc:2804] T 85c494af21f9457a85da47b9bc70c1fd P e5256d91808b47c195bc9b4dbd7f2b87 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:07:12.433745 19552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f575b143b844aa096b50997dad3516a" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:07:12.435258 19557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e1f505cb0f1427bbd698ac889d80821" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:07:12.419931 25925 raft_consensus.cc:2749] T b9f0d59553ad444883fcf5b5909f9798 P e5256d91808b47c195bc9b4dbd7f2b87 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:07:12.389849 26035 raft_consensus.cc:515] T ff75a1d4cb1f493db8f71ddc136ba9ab P e61c3a8f61bb48f8a963c9480e53c168 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:07:12.393617 26147 raft_consensus.cc:515] T ece3db938bc649d4a40a51522ed5259c P e61c3a8f61bb48f8a963c9480e53c168 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:07:12.418819 26069 raft_consensus.cc:2764] T 9962423cb4e54fcfa5de01daf68a86e7 P e5256d91808b47c195bc9b4dbd7f2b87 [term 19 FOLLOWER]: Leader pre-election decision vote started in defunct term 18: won
I20260709 13:07:12.451355 25376 consensus_queue.cc:260] T 86a6797bdfe94fa496c050ceae4bd0d9 P 0473d2b2d01f4459b1e90fd12cc7840e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.8, Last appended by leader: 8, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:07:12.461645 19377 leader_election.cc:304] T 1a61655d99124a29b486ba4a5b37faea P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:07:12.433171 25953 raft_consensus.cc:3060] T fa8650e71aa14778b3d73721fc50d9fc P 0473d2b2d01f4459b1e90fd12cc7840e [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:07:12.467543 25376 raft_consensus.cc:3060] T 86a6797bdfe94fa496c050ceae4bd0d9 P 0473d2b2d01f4459b1e90fd12cc7840e [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:07:12.464984 19552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc225c93219c45538b53a1bd3d387e4d" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 18 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:07:12.432722 26190 raft_consensus.cc:493] T 833a2f0775ed407a94b8924ce50adb63 P e5256d91808b47c195bc9b4dbd7f2b87 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:12.467327 19558 raft_consensus.cc:1275] T 40e1e16737a842ee936002830f36882e P e61c3a8f61bb48f8a963c9480e53c168 [term 21 FOLLOWER]: Refusing update from remote peer e5256d91808b47c195bc9b4dbd7f2b87: Log matching property violated. Preceding OpId in replica: term: 20 index: 11. Preceding OpId from leader: term: 21 index: 12. (index mismatch)
I20260709 13:07:12.470971 19560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "833a2f0775ed407a94b8924ce50adb63" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:07:12.464941 19377 leader_election.cc:304] T 1dc5b3532fe54f74876d02beffa2c230 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:07:12.472092 19560 raft_consensus.cc:2468] T 833a2f0775ed407a94b8924ce50adb63 P e61c3a8f61bb48f8a963c9480e53c168 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 15.
I20260709 13:07:12.420138 26092 consensus_queue.cc:237] T 0e1085d23e8347fbbd5bce7542f4b1f4 P 127766fc592545a4997f7790f50f6076 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.12, Last appended by leader: 12, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:07:12.476174 26035 leader_election.cc:290] T ff75a1d4cb1f493db8f71ddc136ba9ab P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:07:12.472342 25992 raft_consensus.cc:515] T 2725d2c4cb054f18b0fc8f735c15f6c2 P e5256d91808b47c195bc9b4dbd7f2b87 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:07:12.449162 25957 raft_consensus.cc:515] T ff9b0eddd810459b82d91c60777c10eb P 0473d2b2d01f4459b1e90fd12cc7840e [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:07:12.480633 25957 leader_election.cc:290] T ff9b0eddd810459b82d91c60777c10eb P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:07:12.410732 25923 consensus_queue.cc:1048] T fa8650e71aa14778b3d73721fc50d9fc P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.056s
I20260709 13:07:12.483906 26059 raft_consensus.cc:3055] T ed7fdbcb96d14d418db9ca90a792588a P e61c3a8f61bb48f8a963c9480e53c168 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:07:12.484339 26059 raft_consensus.cc:740] T ed7fdbcb96d14d418db9ca90a792588a P e61c3a8f61bb48f8a963c9480e53c168 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: e61c3a8f61bb48f8a963c9480e53c168, State: Running, Role: LEADER
I20260709 13:07:12.485333 19481 raft_consensus.cc:1275] T 179fd671030940b4b4a4e24bcc4aba0a P 0473d2b2d01f4459b1e90fd12cc7840e [term 22 FOLLOWER]: Refusing update from remote peer e5256d91808b47c195bc9b4dbd7f2b87: Log matching property violated. Preceding OpId in replica: term: 19 index: 12. Preceding OpId from leader: term: 22 index: 14. (index mismatch)
I20260709 13:07:12.485173 26059 consensus_queue.cc:260] T ed7fdbcb96d14d418db9ca90a792588a P e61c3a8f61bb48f8a963c9480e53c168 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.13, Last appended by leader: 13, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:07:12.486236 26059 raft_consensus.cc:3060] T ed7fdbcb96d14d418db9ca90a792588a P e61c3a8f61bb48f8a963c9480e53c168 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:07:12.466606 26192 raft_consensus.cc:2804] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P e5256d91808b47c195bc9b4dbd7f2b87 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:07:12.487229 26192 raft_consensus.cc:493] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P e5256d91808b47c195bc9b4dbd7f2b87 [term 20 FOLLOWER]: Starting leader election (detected failure of leader 0473d2b2d01f4459b1e90fd12cc7840e)
I20260709 13:07:12.487643 26192 raft_consensus.cc:3060] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P e5256d91808b47c195bc9b4dbd7f2b87 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:07:12.490754 26017 consensus_queue.cc:260] T 172b3dd13109415a955b71ac0e9d2234 P 0473d2b2d01f4459b1e90fd12cc7840e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 17.12, Last appended by leader: 12, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:07:12.491972 26017 raft_consensus.cc:3060] T 172b3dd13109415a955b71ac0e9d2234 P 0473d2b2d01f4459b1e90fd12cc7840e [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:07:12.448678 26179 raft_consensus.cc:493] T ed7fdbcb96d14d418db9ca90a792588a P 127766fc592545a4997f7790f50f6076 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:12.473238 19450 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.3:36891, user_credentials={real_user=slave}} blocked reactor thread for 109278us
I20260709 13:07:12.507119 19552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b08304a0a02b42d7840c4e8ee9a6bd1a" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 22 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:07:12.524298 19478 raft_consensus.cc:1275] T ff9b0eddd810459b82d91c60777c10eb P 0473d2b2d01f4459b1e90fd12cc7840e [term 20 FOLLOWER]: Refusing update from remote peer e5256d91808b47c195bc9b4dbd7f2b87: Log matching property violated. Preceding OpId in replica: term: 19 index: 14. Preceding OpId from leader: term: 20 index: 14. (term mismatch)
I20260709 13:07:12.524784 19478 pending_rounds.cc:85] T ff9b0eddd810459b82d91c60777c10eb P 0473d2b2d01f4459b1e90fd12cc7840e: Aborting all ops after (but not including) 13
I20260709 13:07:12.525077 19478 pending_rounds.cc:107] T ff9b0eddd810459b82d91c60777c10eb P 0473d2b2d01f4459b1e90fd12cc7840e: Aborting uncommitted NO_OP operation due to leader change: 19.14
I20260709 13:07:12.525372 19478 raft_consensus.cc:2889] T ff9b0eddd810459b82d91c60777c10eb P 0473d2b2d01f4459b1e90fd12cc7840e [term 20 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:07:12.526213 19377 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.2:46257, user_credentials={real_user=slave}} blocked reactor thread for 61345.3us
I20260709 13:07:12.529582 19377 leader_election.cc:304] T 46c5bfeecc314717bffe987e6844b6d0 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:07:12.478520 25992 leader_election.cc:290] T 2725d2c4cb054f18b0fc8f735c15f6c2 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 20 election: Requested vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:07:12.472965 26190 raft_consensus.cc:3060] T 833a2f0775ed407a94b8924ce50adb63 P e5256d91808b47c195bc9b4dbd7f2b87 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:07:12.534340 19556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff75a1d4cb1f493db8f71ddc136ba9ab" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:07:12.543496 19556 raft_consensus.cc:2468] T ff75a1d4cb1f493db8f71ddc136ba9ab P e61c3a8f61bb48f8a963c9480e53c168 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 19.
I20260709 13:07:12.471376 26001 raft_consensus.cc:2749] T 1a61655d99124a29b486ba4a5b37faea P e5256d91808b47c195bc9b4dbd7f2b87 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 13:07:12.538347 19374 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.4:43121, user_credentials={real_user=slave}} blocked reactor thread for 71895us
I20260709 13:07:12.539776 25977 raft_consensus.cc:493] T 40e1e16737a842ee936002830f36882e P 0473d2b2d01f4459b1e90fd12cc7840e [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:12.542327 25376 raft_consensus.cc:493] T 4509b76741dc428e9201c70c1658da13 P 0473d2b2d01f4459b1e90fd12cc7840e [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:12.550114 25977 raft_consensus.cc:515] T 40e1e16737a842ee936002830f36882e P 0473d2b2d01f4459b1e90fd12cc7840e [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:07:12.554494 25376 raft_consensus.cc:515] T 4509b76741dc428e9201c70c1658da13 P 0473d2b2d01f4459b1e90fd12cc7840e [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:07:12.560864 19556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14935b3ddf914369822e4a0547aaa355" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:07:12.561616 19556 raft_consensus.cc:3060] T 14935b3ddf914369822e4a0547aaa355 P e61c3a8f61bb48f8a963c9480e53c168 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:07:12.566905 19377 leader_election.cc:304] T 217b5fae677b4971b3bbd2f357a1f7ff P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87; no voters: e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:07:12.570528 19560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1b10566f45d4a7d9029858330e02d5b" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:07:12.560664 19450 leader_election.cc:304] T ff75a1d4cb1f493db8f71ddc136ba9ab P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:07:12.537995 25925 raft_consensus.cc:2749] T 1dc5b3532fe54f74876d02beffa2c230 P e5256d91808b47c195bc9b4dbd7f2b87 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:07:12.538187 26033 raft_consensus.cc:493] T ab43d85f64114d4ebf618930e43d9ed0 P 0473d2b2d01f4459b1e90fd12cc7840e [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 127766fc592545a4997f7790f50f6076)
I20260709 13:07:12.616897 19558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a08760e15aac4630a629431f56024dc8" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 24 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
W20260709 13:07:12.617439 19450 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.3:36891, user_credentials={real_user=slave}} blocked reactor thread for 56856.1us
W20260709 13:07:12.615159 19377 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.2:46257, user_credentials={real_user=slave}} blocked reactor thread for 48343us
I20260709 13:07:12.492641 25920 consensus_queue.cc:237] T 9962423cb4e54fcfa5de01daf68a86e7 P 127766fc592545a4997f7790f50f6076 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 17.12, Last appended by leader: 12, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:07:12.509509 26140 raft_consensus.cc:515] T 833a2f0775ed407a94b8924ce50adb63 P 127766fc592545a4997f7790f50f6076 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:07:12.524075 26179 raft_consensus.cc:515] T ed7fdbcb96d14d418db9ca90a792588a P 127766fc592545a4997f7790f50f6076 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:07:12.654660 19560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cdf56e38bbc453d9438d359e5a69955" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:07:12.537482 26113 raft_consensus.cc:515] T e381f1d6b8184797ad142de49be225a8 P 0473d2b2d01f4459b1e90fd12cc7840e [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:07:12.654752 19481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9962423cb4e54fcfa5de01daf68a86e7" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:07:12.611572 25819 raft_consensus.cc:2749] T 46c5bfeecc314717bffe987e6844b6d0 P e5256d91808b47c195bc9b4dbd7f2b87 [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 13:07:12.657759 19377 leader_election.cc:304] T 0cdf56e38bbc453d9438d359e5a69955 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:07:12.668215 19556 raft_consensus.cc:2468] T 14935b3ddf914369822e4a0547aaa355 P e61c3a8f61bb48f8a963c9480e53c168 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 15.
I20260709 13:07:12.669433 19556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7be9efa6559648dbb5a0f7684c4542d1" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 22 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:07:12.670512 19556 raft_consensus.cc:2410] T 7be9efa6559648dbb5a0f7684c4542d1 P e61c3a8f61bb48f8a963c9480e53c168 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0473d2b2d01f4459b1e90fd12cc7840e for term 22 because replica has last-logged OpId of term: 20 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 10.
W20260709 13:07:12.690908 26198 log.cc:927] Time spent T ef32ce6fdd0e40d382c79974f30295c6 P e61c3a8f61bb48f8a963c9480e53c168: Append to log took a long time: real 0.144s	user 0.001s	sys 0.000s
I20260709 13:07:12.693217 25977 leader_election.cc:290] T 40e1e16737a842ee936002830f36882e P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:07:12.694087 25376 leader_election.cc:290] T 4509b76741dc428e9201c70c1658da13 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
W20260709 13:07:12.702569 19377 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.2:46257, user_credentials={real_user=slave}} blocked reactor thread for 44901.6us
I20260709 13:07:12.703562 19377 leader_election.cc:304] T 21e14947d70440f19044d8f75c31e1f9 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87; no voters: e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:07:12.655926 26162 raft_consensus.cc:2804] T ff75a1d4cb1f493db8f71ddc136ba9ab P 0473d2b2d01f4459b1e90fd12cc7840e [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:07:12.710530 19482 raft_consensus.cc:2393] T e381f1d6b8184797ad142de49be225a8 P 0473d2b2d01f4459b1e90fd12cc7840e [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e5256d91808b47c195bc9b4dbd7f2b87 in current term 18: Already voted for candidate 0473d2b2d01f4459b1e90fd12cc7840e in this term.
I20260709 13:07:12.623684 25992 raft_consensus.cc:2804] T 217b5fae677b4971b3bbd2f357a1f7ff P e5256d91808b47c195bc9b4dbd7f2b87 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:07:12.713438 19377 leader_election.cc:304] T 2e36a9d6e29c4a7c860cf267efbd4c74 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87; no voters: e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:07:12.660531 25530 raft_consensus.cc:493] T 62c6c134d3d24a1ab144dd9ee6bc3f64 P 0473d2b2d01f4459b1e90fd12cc7840e [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:12.724550 19560 raft_consensus.cc:2468] T 0cdf56e38bbc453d9438d359e5a69955 P e61c3a8f61bb48f8a963c9480e53c168 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 19.
I20260709 13:07:12.694406 26160 raft_consensus.cc:493] T 4509b76741dc428e9201c70c1658da13 P e61c3a8f61bb48f8a963c9480e53c168 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:12.729139 26219 raft_consensus.cc:493] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P 127766fc592545a4997f7790f50f6076 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:12.711906 25819 raft_consensus.cc:2749] T 0cdf56e38bbc453d9438d359e5a69955 P e5256d91808b47c195bc9b4dbd7f2b87 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:07:12.649966 26033 raft_consensus.cc:515] T ab43d85f64114d4ebf618930e43d9ed0 P 0473d2b2d01f4459b1e90fd12cc7840e [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:07:12.714944 26162 raft_consensus.cc:493] T ff75a1d4cb1f493db8f71ddc136ba9ab P 0473d2b2d01f4459b1e90fd12cc7840e [term 19 FOLLOWER]: Starting leader election (detected failure of leader e5256d91808b47c195bc9b4dbd7f2b87)
I20260709 13:07:12.716581 25925 raft_consensus.cc:2804] T 21e14947d70440f19044d8f75c31e1f9 P e5256d91808b47c195bc9b4dbd7f2b87 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:07:12.722942 25992 raft_consensus.cc:493] T 217b5fae677b4971b3bbd2f357a1f7ff P e5256d91808b47c195bc9b4dbd7f2b87 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:12.730918 26108 leader_election.cc:290] T 1dc5b3532fe54f74876d02beffa2c230 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 22 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
W20260709 13:07:12.770808 26214 log.cc:927] Time spent T a08760e15aac4630a629431f56024dc8 P 0473d2b2d01f4459b1e90fd12cc7840e: Append to log took a long time: real 0.061s	user 0.000s	sys 0.001s
I20260709 13:07:12.771831 26113 leader_election.cc:290] T e381f1d6b8184797ad142de49be225a8 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 18 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:07:12.732741 26097 consensus_queue.cc:1048] T 179fd671030940b4b4a4e24bcc4aba0a P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.048s
I20260709 13:07:12.783910 26140 leader_election.cc:290] T 833a2f0775ed407a94b8924ce50adb63 P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 16 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:07:12.734723 26160 raft_consensus.cc:515] T 4509b76741dc428e9201c70c1658da13 P e61c3a8f61bb48f8a963c9480e53c168 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:07:12.788431 25376 raft_consensus.cc:493] T 1efebf73c86e432baa55533136b6e12c P 0473d2b2d01f4459b1e90fd12cc7840e [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:12.732200 25993 raft_consensus.cc:2804] T 2e36a9d6e29c4a7c860cf267efbd4c74 P e5256d91808b47c195bc9b4dbd7f2b87 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:07:12.791117 26162 raft_consensus.cc:3060] T ff75a1d4cb1f493db8f71ddc136ba9ab P 0473d2b2d01f4459b1e90fd12cc7840e [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:07:12.818194 25376 raft_consensus.cc:515] T 1efebf73c86e432baa55533136b6e12c P 0473d2b2d01f4459b1e90fd12cc7840e [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:07:12.729887 25530 raft_consensus.cc:515] T 62c6c134d3d24a1ab144dd9ee6bc3f64 P 0473d2b2d01f4459b1e90fd12cc7840e [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:07:12.791342 25925 raft_consensus.cc:493] T 21e14947d70440f19044d8f75c31e1f9 P e5256d91808b47c195bc9b4dbd7f2b87 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:12.809414 25992 raft_consensus.cc:3060] T 217b5fae677b4971b3bbd2f357a1f7ff P e5256d91808b47c195bc9b4dbd7f2b87 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:07:12.767405 25871 raft_consensus.cc:515] T 22196caba61445d3bec98a0aab3c337d P 0473d2b2d01f4459b1e90fd12cc7840e [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:07:12.840387 25871 leader_election.cc:290] T 22196caba61445d3bec98a0aab3c337d P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 20 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:07:12.765700 26219 raft_consensus.cc:515] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P 127766fc592545a4997f7790f50f6076 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:07:12.844378 26219 leader_election.cc:290] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:07:12.844179 25953 raft_consensus.cc:515] T fa8650e71aa14778b3d73721fc50d9fc P 0473d2b2d01f4459b1e90fd12cc7840e [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:07:12.846264 25953 leader_election.cc:290] T fa8650e71aa14778b3d73721fc50d9fc P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 21 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:07:12.824558 25987 raft_consensus.cc:2749] T 217b5fae677b4971b3bbd2f357a1f7ff P 0473d2b2d01f4459b1e90fd12cc7840e [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:07:12.849162 25376 leader_election.cc:290] T 1efebf73c86e432baa55533136b6e12c P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:07:12.793407 26179 leader_election.cc:290] T ed7fdbcb96d14d418db9ca90a792588a P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:07:12.851045 19477 raft_consensus.cc:2393] T 22196caba61445d3bec98a0aab3c337d P 0473d2b2d01f4459b1e90fd12cc7840e [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e5256d91808b47c195bc9b4dbd7f2b87 in current term 20: Already voted for candidate 0473d2b2d01f4459b1e90fd12cc7840e in this term.
I20260709 13:07:12.842362 25530 leader_election.cc:290] T 62c6c134d3d24a1ab144dd9ee6bc3f64 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:07:12.820618 25993 raft_consensus.cc:493] T 2e36a9d6e29c4a7c860cf267efbd4c74 P e5256d91808b47c195bc9b4dbd7f2b87 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:12.817196 26192 raft_consensus.cc:515] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P e5256d91808b47c195bc9b4dbd7f2b87 [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:07:12.855049 25993 raft_consensus.cc:3060] T 2e36a9d6e29c4a7c860cf267efbd4c74 P e5256d91808b47c195bc9b4dbd7f2b87 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:07:12.855450 25975 raft_consensus.cc:3055] T f93ee515a9c14139bf566522ed8232f3 P 0473d2b2d01f4459b1e90fd12cc7840e [term 22 LEADER]: Stepping down as leader of term 22
I20260709 13:07:12.855988 25975 raft_consensus.cc:740] T f93ee515a9c14139bf566522ed8232f3 P 0473d2b2d01f4459b1e90fd12cc7840e [term 22 LEADER]: Becoming Follower/Learner. State: Replica: 0473d2b2d01f4459b1e90fd12cc7840e, State: Running, Role: LEADER
I20260709 13:07:12.857640 26033 leader_election.cc:290] T ab43d85f64114d4ebf618930e43d9ed0 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:07:12.857175 25975 consensus_queue.cc:260] T f93ee515a9c14139bf566522ed8232f3 P 0473d2b2d01f4459b1e90fd12cc7840e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 22.11, Last appended by leader: 11, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:07:12.859127 19480 raft_consensus.cc:1240] T fa8650e71aa14778b3d73721fc50d9fc P 0473d2b2d01f4459b1e90fd12cc7840e [term 21 FOLLOWER]: Rejecting Update request from peer e5256d91808b47c195bc9b4dbd7f2b87 for earlier term 20. Current term is 21. Ops: []
W20260709 13:07:12.861881 19525 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:12.867578 20106 raft_consensus.cc:1275] T 7be9efa6559648dbb5a0f7684c4542d1 P 127766fc592545a4997f7790f50f6076 [term 21 FOLLOWER]: Refusing update from remote peer e5256d91808b47c195bc9b4dbd7f2b87: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 21 index: 12. (index mismatch)
I20260709 13:07:12.868728 19481 raft_consensus.cc:2468] T 9962423cb4e54fcfa5de01daf68a86e7 P 0473d2b2d01f4459b1e90fd12cc7840e [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 127766fc592545a4997f7790f50f6076 in term 19.
I20260709 13:07:12.870698 19481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "309c3ca0ca4b4f3ba129752ea2cb293b" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:07:12.873209 19408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "833a2f0775ed407a94b8924ce50adb63" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
I20260709 13:07:12.864353 25925 raft_consensus.cc:3060] T 21e14947d70440f19044d8f75c31e1f9 P e5256d91808b47c195bc9b4dbd7f2b87 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:07:12.864764 26147 leader_election.cc:290] T ece3db938bc649d4a40a51522ed5259c P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:07:12.858508 25975 raft_consensus.cc:3060] T f93ee515a9c14139bf566522ed8232f3 P 0473d2b2d01f4459b1e90fd12cc7840e [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:07:12.883682 19481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f575b143b844aa096b50997dad3516a" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
W20260709 13:07:12.889122 26184 log.cc:927] Time spent T 1efebf73c86e432baa55533136b6e12c P 127766fc592545a4997f7790f50f6076: Append to log took a long time: real 0.607s	user 0.003s	sys 0.000s
I20260709 13:07:12.892198 19555 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40438 (request call id 3207) took 1193 ms. Trace:
I20260709 13:07:12.880300 26192 leader_election.cc:290] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 21 election: Requested vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:07:12.895124 19555 rpcz_store.cc:276] 0709 13:07:11.690291 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:11.806901 (+116610us) service_pool.cc:224] Handling call
0709 13:07:12.883100 (+1076199us) spinlock_profiling.cc:243] Waited 308 ms on lock 0x7b540009c9d4. stack: 00007f4a79de9343 00007f4a79de9240 00007f4a797781d4 00007f4a834b6304 00007f4a834b6299 00007f4a7ce71571 00007f4a7cf0c2fa 00007f4a81ecdb17 00007f4a7b4486d4 00007f4a7b448662 00007f4a7b448591 00007f4a7b44850c 00007f4a7b4477c2 00007f4a7b24348c 00007f4a7b2428c6 00007f4a7b24226f
0709 13:07:12.883193 (+    93us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":708464384}
I20260709 13:07:12.894804 19481 raft_consensus.cc:2468] T 7f575b143b844aa096b50997dad3516a P 0473d2b2d01f4459b1e90fd12cc7840e [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 17.
I20260709 13:07:12.900563 19402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36f6ba92b9ba46babe4ebd6c02e5fbd9" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 22 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:07:12.901923 19481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2725d2c4cb054f18b0fc8f735c15f6c2" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:07:12.902881 26162 raft_consensus.cc:515] T ff75a1d4cb1f493db8f71ddc136ba9ab P 0473d2b2d01f4459b1e90fd12cc7840e [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:07:12.903597 19481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e1f505cb0f1427bbd698ac889d80821" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:07:12.905082 26133 leader_election.cc:290] T 48824d5acfbc485ebf8c2d944e7202de P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:07:12.907004 26160 leader_election.cc:290] T 4509b76741dc428e9201c70c1658da13 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:07:12.907765 26162 leader_election.cc:290] T ff75a1d4cb1f493db8f71ddc136ba9ab P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 20 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:07:12.909035 26154 raft_consensus.cc:493] T ece3db938bc649d4a40a51522ed5259c P e5256d91808b47c195bc9b4dbd7f2b87 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 127766fc592545a4997f7790f50f6076)
I20260709 13:07:12.901134 19402 raft_consensus.cc:2468] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P e5256d91808b47c195bc9b4dbd7f2b87 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 127766fc592545a4997f7790f50f6076 in term 21.
I20260709 13:07:12.913002 20076 leader_election.cc:400] T 96efeaaf1057492490e9a621f37e1a2d P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 20 election: Vote denied by peer e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891) with higher term. Message: Invalid argument: T 96efeaaf1057492490e9a621f37e1a2d P e61c3a8f61bb48f8a963c9480e53c168 [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate 127766fc592545a4997f7790f50f6076 for earlier term 20. Current term is 21.
I20260709 13:07:12.915328 19409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a08760e15aac4630a629431f56024dc8" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 24 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:07:12.915606 19403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21e14947d70440f19044d8f75c31e1f9" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
W20260709 13:07:12.920804 19523 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:12.921880 20076 leader_election.cc:403] T 96efeaaf1057492490e9a621f37e1a2d P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 20 election: Cancelling election due to peer responding with higher term
I20260709 13:07:12.922727 19411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28af091831594f9d8e96482078cc7625" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:07:12.922927 19407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e381f1d6b8184797ad142de49be225a8" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 18 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:07:12.923570 19407 raft_consensus.cc:2468] T e381f1d6b8184797ad142de49be225a8 P e5256d91808b47c195bc9b4dbd7f2b87 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 17.
I20260709 13:07:12.921731 19406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f93ee515a9c14139bf566522ed8232f3" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 23 candidate_status { last_received { term: 22 index: 11 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
W20260709 13:07:12.922338 19523 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:12.926319 26219 raft_consensus.cc:2749] T 96efeaaf1057492490e9a621f37e1a2d P 127766fc592545a4997f7790f50f6076 [term 21 FOLLOWER]: Leader election lost for term 20. Reason: Vote denied by peer e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891) with higher term. Message: Invalid argument: T 96efeaaf1057492490e9a621f37e1a2d P e61c3a8f61bb48f8a963c9480e53c168 [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate 127766fc592545a4997f7790f50f6076 for earlier term 20. Current term is 21.
I20260709 13:07:12.919492 26147 raft_consensus.cc:493] T 40e1e16737a842ee936002830f36882e P e61c3a8f61bb48f8a963c9480e53c168 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:12.929639 19481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "172b3dd13109415a955b71ac0e9d2234" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:07:12.930577 19560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "833a2f0775ed407a94b8924ce50adb63" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:07:12.932369 19560 raft_consensus.cc:3060] T 833a2f0775ed407a94b8924ce50adb63 P e61c3a8f61bb48f8a963c9480e53c168 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:07:12.932462 19409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4509b76741dc428e9201c70c1658da13" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:07:12.933020 19556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed7fdbcb96d14d418db9ca90a792588a" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 18 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:07:12.919370 26108 raft_consensus.cc:493] T fa731b585f684a7fb2d106c50f143b83 P e61c3a8f61bb48f8a963c9480e53c168 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader e5256d91808b47c195bc9b4dbd7f2b87)
I20260709 13:07:12.931245 19523 leader_election.cc:304] T 86a6797bdfe94fa496c050ceae4bd0d9 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e61c3a8f61bb48f8a963c9480e53c168; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:07:12.934547 19556 raft_consensus.cc:2410] T ed7fdbcb96d14d418db9ca90a792588a P e61c3a8f61bb48f8a963c9480e53c168 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 127766fc592545a4997f7790f50f6076 for term 18 because replica has last-logged OpId of term: 16 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 12.
I20260709 13:07:12.930521 19552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "833a2f0775ed407a94b8924ce50adb63" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:07:12.933818 20075 leader_election.cc:304] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 127766fc592545a4997f7790f50f6076, e5256d91808b47c195bc9b4dbd7f2b87; no voters: 
I20260709 13:07:12.935540 19553 raft_consensus.cc:1240] T 14935b3ddf914369822e4a0547aaa355 P e61c3a8f61bb48f8a963c9480e53c168 [term 15 FOLLOWER]: Rejecting Update request from peer 127766fc592545a4997f7790f50f6076 for earlier term 14. Current term is 15. Ops: [14.11-14.11]
I20260709 13:07:12.938802 19402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dc5b3532fe54f74876d02beffa2c230" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
I20260709 13:07:12.939432 19402 raft_consensus.cc:3060] T 1dc5b3532fe54f74876d02beffa2c230 P e5256d91808b47c195bc9b4dbd7f2b87 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:07:12.940263 19523 leader_election.cc:304] T 76cb037fc9064d13b59a8969d897ce8c P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e61c3a8f61bb48f8a963c9480e53c168; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:07:12.919687 26097 consensus_queue.cc:1048] T 40e1e16737a842ee936002830f36882e P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.015s
I20260709 13:07:12.946739 19523 leader_election.cc:304] T 2a16f7501e2444fb86d4e2778e734e02 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e61c3a8f61bb48f8a963c9480e53c168; no voters: 127766fc592545a4997f7790f50f6076, e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:07:12.945432 19553 raft_consensus.cc:1275] T 1efebf73c86e432baa55533136b6e12c P e61c3a8f61bb48f8a963c9480e53c168 [term 16 FOLLOWER]: Refusing update from remote peer 127766fc592545a4997f7790f50f6076: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 13:07:12.931957 26059 raft_consensus.cc:493] T 7be9efa6559648dbb5a0f7684c4542d1 P e61c3a8f61bb48f8a963c9480e53c168 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:12.952600 19560 raft_consensus.cc:2468] T 833a2f0775ed407a94b8924ce50adb63 P e61c3a8f61bb48f8a963c9480e53c168 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 127766fc592545a4997f7790f50f6076 in term 16.
I20260709 13:07:12.949545 19523 leader_election.cc:304] T 2725d2c4cb054f18b0fc8f735c15f6c2 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e61c3a8f61bb48f8a963c9480e53c168; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:07:12.654467 19293 catalog_manager.cc:5028] TS e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321): tablet ab43d85f64114d4ebf618930e43d9ed0 (table test-workload [id=ce1025c73cf04c4baf25820ae7ff0a53]) successfully deleted
I20260709 13:07:12.928164 20106 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "172b3dd13109415a955b71ac0e9d2234"
dest_uuid: "127766fc592545a4997f7790f50f6076"
mode: GRACEFUL
new_leader_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
 from {username='slave'} at 127.0.0.1:48686
I20260709 13:07:12.956769 20106 raft_consensus.cc:606] T 172b3dd13109415a955b71ac0e9d2234 P 127766fc592545a4997f7790f50f6076 [term 18 FOLLOWER]: Received request to transfer leadership to TS 0473d2b2d01f4459b1e90fd12cc7840e
I20260709 13:07:12.956876 19407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff75a1d4cb1f493db8f71ddc136ba9ab" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:07:12.957350 20106 raft_consensus.cc:614] T 172b3dd13109415a955b71ac0e9d2234 P 127766fc592545a4997f7790f50f6076 [term 18 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 13:07:12.959771 26212 log.cc:927] Time spent T b08304a0a02b42d7840c4e8ee9a6bd1a P e61c3a8f61bb48f8a963c9480e53c168: Append to log took a long time: real 0.336s	user 0.000s	sys 0.001s
W20260709 13:07:12.962929 26196 log.cc:927] Time spent T 7be9efa6559648dbb5a0f7684c4542d1 P e5256d91808b47c195bc9b4dbd7f2b87: Append to log took a long time: real 0.421s	user 0.002s	sys 0.006s
I20260709 13:07:12.929836 26160 consensus_queue.cc:1059] T 4af19371ea874c09a0a2147040835cbb P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.020s
I20260709 13:07:12.948737 26151 raft_consensus.cc:2749] T 76cb037fc9064d13b59a8969d897ce8c P e61c3a8f61bb48f8a963c9480e53c168 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:07:12.964422 26151 raft_consensus.cc:2749] T 2725d2c4cb054f18b0fc8f735c15f6c2 P e61c3a8f61bb48f8a963c9480e53c168 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:07:12.969367 25925 raft_consensus.cc:515] T 21e14947d70440f19044d8f75c31e1f9 P e5256d91808b47c195bc9b4dbd7f2b87 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:07:12.973470 19402 raft_consensus.cc:2468] T 1dc5b3532fe54f74876d02beffa2c230 P e5256d91808b47c195bc9b4dbd7f2b87 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 22.
I20260709 13:07:12.973650 19485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14efcc79969f41babe5529c22d59156d" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:07:12.974833 19402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ece3db938bc649d4a40a51522ed5259c" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:07:12.954748 26159 raft_consensus.cc:2749] T 2a16f7501e2444fb86d4e2778e734e02 P e61c3a8f61bb48f8a963c9480e53c168 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 13:07:12.975464 26186 log.cc:927] Time spent T 76cb037fc9064d13b59a8969d897ce8c P 0473d2b2d01f4459b1e90fd12cc7840e: Append to log took a long time: real 0.699s	user 0.000s	sys 0.002s
I20260709 13:07:12.945021 25747 raft_consensus.cc:2749] T 86a6797bdfe94fa496c050ceae4bd0d9 P e61c3a8f61bb48f8a963c9480e53c168 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:07:12.976527 25925 leader_election.cc:290] T 21e14947d70440f19044d8f75c31e1f9 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 20 election: Requested vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:07:12.977774 25851 consensus_queue.cc:260] T 0e1085d23e8347fbbd5bce7542f4b1f4 P e61c3a8f61bb48f8a963c9480e53c168 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
W20260709 13:07:12.978863 19293 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.DeleteTablet -> {remote=127.17.223.1:40321, user_credentials={real_user=slave}} blocked reactor thread for 432511us
I20260709 13:07:12.945585 26108 raft_consensus.cc:515] T fa731b585f684a7fb2d106c50f143b83 P e61c3a8f61bb48f8a963c9480e53c168 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:07:12.981431 26108 leader_election.cc:290] T fa731b585f684a7fb2d106c50f143b83 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:07:12.983296 19485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed7fdbcb96d14d418db9ca90a792588a" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 18 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:07:12.984081 25992 raft_consensus.cc:515] T 217b5fae677b4971b3bbd2f357a1f7ff P e5256d91808b47c195bc9b4dbd7f2b87 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:07:12.984524 19485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc225c93219c45538b53a1bd3d387e4d" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 18 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:07:12.985126 19410 raft_consensus.cc:1240] T 217b5fae677b4971b3bbd2f357a1f7ff P e5256d91808b47c195bc9b4dbd7f2b87 [term 17 FOLLOWER]: Rejecting Update request from peer e61c3a8f61bb48f8a963c9480e53c168 for earlier term 16. Current term is 17. Ops: []
I20260709 13:07:12.985925 19481 raft_consensus.cc:2468] T 172b3dd13109415a955b71ac0e9d2234 P 0473d2b2d01f4459b1e90fd12cc7840e [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 127766fc592545a4997f7790f50f6076 in term 18.
I20260709 13:07:12.986426 26059 raft_consensus.cc:515] T 7be9efa6559648dbb5a0f7684c4542d1 P e61c3a8f61bb48f8a963c9480e53c168 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } attrs { replace: true } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:07:12.989599 19403 raft_consensus.cc:2393] T 21e14947d70440f19044d8f75c31e1f9 P e5256d91808b47c195bc9b4dbd7f2b87 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate e61c3a8f61bb48f8a963c9480e53c168 in current term 20: Already voted for candidate e5256d91808b47c195bc9b4dbd7f2b87 in this term.
I20260709 13:07:12.991271 19481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36f6ba92b9ba46babe4ebd6c02e5fbd9" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 22 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:07:12.989107 26059 leader_election.cc:290] T 7be9efa6559648dbb5a0f7684c4542d1 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:07:12.929600 26154 raft_consensus.cc:515] T ece3db938bc649d4a40a51522ed5259c P e5256d91808b47c195bc9b4dbd7f2b87 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
W20260709 13:07:12.991966 19451 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:12.992461 19559 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40438 (request call id 3216) took 1299 ms. Trace:
I20260709 13:07:12.951382 26044 raft_consensus.cc:2804] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P 127766fc592545a4997f7790f50f6076 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:07:13.007555 26044 raft_consensus.cc:493] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P 127766fc592545a4997f7790f50f6076 [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:13.007948 26044 raft_consensus.cc:3060] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P 127766fc592545a4997f7790f50f6076 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:07:13.010825 19402 raft_consensus.cc:2468] T ece3db938bc649d4a40a51522ed5259c P e5256d91808b47c195bc9b4dbd7f2b87 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 14.
I20260709 13:07:13.012476 20110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ece3db938bc649d4a40a51522ed5259c" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:07:13.013099 20110 raft_consensus.cc:2468] T ece3db938bc649d4a40a51522ed5259c P 127766fc592545a4997f7790f50f6076 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 15.
I20260709 13:07:12.986181 25992 leader_election.cc:290] T 217b5fae677b4971b3bbd2f357a1f7ff P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 17 election: Requested vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:07:12.994581 26119 raft_consensus.cc:493] T 6c5eebf646ad445a9d1b1adc319d7b16 P 127766fc592545a4997f7790f50f6076 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 0473d2b2d01f4459b1e90fd12cc7840e)
I20260709 13:07:12.941471 26147 raft_consensus.cc:515] T 40e1e16737a842ee936002830f36882e P e61c3a8f61bb48f8a963c9480e53c168 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:07:12.995085 19484 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58294 (request call id 2985) took 1164 ms. Trace:
I20260709 13:07:12.995287 25851 raft_consensus.cc:3060] T 0e1085d23e8347fbbd5bce7542f4b1f4 P e61c3a8f61bb48f8a963c9480e53c168 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:07:12.996412 25993 raft_consensus.cc:515] T 2e36a9d6e29c4a7c860cf267efbd4c74 P e5256d91808b47c195bc9b4dbd7f2b87 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:07:12.999002 19480 raft_consensus.cc:1240] T 14935b3ddf914369822e4a0547aaa355 P 0473d2b2d01f4459b1e90fd12cc7840e [term 15 FOLLOWER]: Rejecting Update request from peer 127766fc592545a4997f7790f50f6076 for earlier term 14. Current term is 15. Ops: [14.11-14.11]
I20260709 13:07:13.005234 19559 rpcz_store.cc:276] 0709 13:07:11.692823 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:12.053872 (+361049us) service_pool.cc:224] Handling call
0709 13:07:12.116488 (+ 62616us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:12.348794 (+232306us) raft_consensus.cc:1534] Early marking committed up to index 13
0709 13:07:12.365656 (+ 16862us) log.cc:844] Serialized 14 byte log entry
0709 13:07:12.460596 (+ 94940us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:12.460648 (+    52us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:07:12.460689 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:12.992235 (+531546us) spinlock_profiling.cc:243] Waited 232 ms on lock 0x7b5400125554. stack: 00007f4a79de9343 00007f4a79de9240 00007f4a797781d4 00007f4a834b6304 00007f4a834b6299 00007f4a7ce71571 00007f4a7cf08e01 00007f4a7cf0783e 00007f4a81ecc419 00007f4a7b443bd4 00007f4a7b443b62 00007f4a7b443a91 00007f4a7b443a0c 00007f4a7b442cc2 00007f4a7b24348c 00007f4a7b2428c6
0709 13:07:12.992278 (+    43us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:12.992399 (+   121us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":17185,"prepare.run_cpu_time_us":59,"prepare.run_wall_time_us":2943,"raft.queue_time_us":18716,"raft.run_cpu_time_us":102,"raft.run_wall_time_us":21787,"spinlock_wait_cycles":533768960,"thread_start_us":81136,"threads_started":1,"wal-append.queue_time_us":116522}
I20260709 13:07:12.999603 26190 raft_consensus.cc:515] T 833a2f0775ed407a94b8924ce50adb63 P e5256d91808b47c195bc9b4dbd7f2b87 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:07:13.002370 19481 raft_consensus.cc:2468] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P 0473d2b2d01f4459b1e90fd12cc7840e [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 127766fc592545a4997f7790f50f6076 in term 21.
I20260709 13:07:13.005189 19375 leader_election.cc:304] T e381f1d6b8184797ad142de49be225a8 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:07:13.006394 19554 raft_consensus.cc:1275] T 4509b76741dc428e9201c70c1658da13 P e61c3a8f61bb48f8a963c9480e53c168 [term 13 FOLLOWER]: Refusing update from remote peer e5256d91808b47c195bc9b4dbd7f2b87: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:07:13.007090 26154 leader_election.cc:290] T ece3db938bc649d4a40a51522ed5259c P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:07:13.006997 19553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2725d2c4cb054f18b0fc8f735c15f6c2" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:07:13.013636 20107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1efebf73c86e432baa55533136b6e12c" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076"
I20260709 13:07:13.014292 20111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48824d5acfbc485ebf8c2d944e7202de" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:07:13.014645 20109 raft_consensus.cc:1275] T 4af19371ea874c09a0a2147040835cbb P 127766fc592545a4997f7790f50f6076 [term 12 FOLLOWER]: Refusing update from remote peer e5256d91808b47c195bc9b4dbd7f2b87: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:07:13.038615 19484 rpcz_store.cc:276] 0709 13:07:11.830699 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:11.831261 (+   562us) service_pool.cc:224] Handling call
0709 13:07:11.856658 (+ 25397us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:12.164583 (+307925us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:12.994838 (+830255us) spinlock_profiling.cc:243] Waited 281 ms on lock 0x7b5400353754. stack: 00007f4a79de9343 00007f4a79de9240 00007f4a797781d4 00007f4a834b6304 00007f4a834b6299 00007f4a7ce71571 00007f4a7cf08e01 00007f4a7cf0783e 00007f4a81ecc419 00007f4a7b443bd4 00007f4a7b443b62 00007f4a7b443a91 00007f4a7b443a0c 00007f4a7b442cc2 00007f4a7b24348c 00007f4a7b2428c6
0709 13:07:12.995009 (+   171us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":646795136}
I20260709 13:07:12.993017 19479 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58286 (request call id 2726) took 1050 ms. Trace:
I20260709 13:07:13.014865 20105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36f6ba92b9ba46babe4ebd6c02e5fbd9" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076"
I20260709 13:07:12.993040 19483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36f6ba92b9ba46babe4ebd6c02e5fbd9" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:07:13.017314 20106 raft_consensus.cc:1240] T ed7fdbcb96d14d418db9ca90a792588a P 127766fc592545a4997f7790f50f6076 [term 17 FOLLOWER]: Rejecting Update request from peer e61c3a8f61bb48f8a963c9480e53c168 for earlier term 16. Current term is 17. Ops: [16.13-16.13]
I20260709 13:07:13.034334 19558 raft_consensus.cc:1275] T 2b74109013a140ada21feeef92d6f563 P e61c3a8f61bb48f8a963c9480e53c168 [term 18 FOLLOWER]: Refusing update from remote peer e5256d91808b47c195bc9b4dbd7f2b87: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 18 index: 10. (index mismatch)
I20260709 13:07:13.036118 19556 raft_consensus.cc:1275] T 7be9efa6559648dbb5a0f7684c4542d1 P e61c3a8f61bb48f8a963c9480e53c168 [term 21 FOLLOWER]: Refusing update from remote peer e5256d91808b47c195bc9b4dbd7f2b87: Log matching property violated. Preceding OpId in replica: term: 20 index: 12. Preceding OpId from leader: term: 21 index: 12. (term mismatch)
I20260709 13:07:13.049791 20078 leader_election.cc:304] T 172b3dd13109415a955b71ac0e9d2234 P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, 127766fc592545a4997f7790f50f6076; no voters: e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:07:13.053294 19479 rpcz_store.cc:276] 0709 13:07:11.942742 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:11.975774 (+ 33032us) service_pool.cc:224] Handling call
0709 13:07:11.995461 (+ 19687us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:12.041218 (+ 45757us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:12.992784 (+951566us) spinlock_profiling.cc:243] Waited 15.4 ms on lock 0x7b54000a9954. stack: 00007f4a79de9343 00007f4a79de9240 00007f4a797781d4 00007f4a834b6304 00007f4a834b6299 00007f4a7ce71571 00007f4a7cf08e01 00007f4a7cf0783e 00007f4a81ecc419 00007f4a7b443bd4 00007f4a7b443b62 00007f4a7b443a91 00007f4a7b443a0c 00007f4a7b442cc2 00007f4a7b24348c 00007f4a7b2428c6
0709 13:07:12.992963 (+   179us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":35510656}
W20260709 13:07:13.077600 19451 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:13.109822 19375 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.3:36891, user_credentials={real_user=slave}} blocked reactor thread for 56756.1us
I20260709 13:07:13.111930 19556 pending_rounds.cc:85] T 7be9efa6559648dbb5a0f7684c4542d1 P e61c3a8f61bb48f8a963c9480e53c168: Aborting all ops after (but not including) 11
I20260709 13:07:13.112469 19556 pending_rounds.cc:107] T 7be9efa6559648dbb5a0f7684c4542d1 P e61c3a8f61bb48f8a963c9480e53c168: Aborting uncommitted NO_OP operation due to leader change: 20.12
I20260709 13:07:13.113212 19556 raft_consensus.cc:2889] T 7be9efa6559648dbb5a0f7684c4542d1 P e61c3a8f61bb48f8a963c9480e53c168 [term 21 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:07:13.117139 19481 raft_consensus.cc:1275] T 1efebf73c86e432baa55533136b6e12c P 0473d2b2d01f4459b1e90fd12cc7840e [term 16 FOLLOWER]: Refusing update from remote peer 127766fc592545a4997f7790f50f6076: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 13:07:13.119076 19481 raft_consensus.cc:1275] T 40e1e16737a842ee936002830f36882e P 0473d2b2d01f4459b1e90fd12cc7840e [term 21 FOLLOWER]: Refusing update from remote peer e5256d91808b47c195bc9b4dbd7f2b87: Log matching property violated. Preceding OpId in replica: term: 20 index: 11. Preceding OpId from leader: term: 21 index: 12. (index mismatch)
W20260709 13:07:13.120136 20078 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.2:46257, user_credentials={real_user=slave}} blocked reactor thread for 70429.9us
I20260709 13:07:13.120747 19481 raft_consensus.cc:1275] T 4509b76741dc428e9201c70c1658da13 P 0473d2b2d01f4459b1e90fd12cc7840e [term 13 FOLLOWER]: Refusing update from remote peer e5256d91808b47c195bc9b4dbd7f2b87: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:07:13.123634 26217 raft_consensus.cc:2804] T 172b3dd13109415a955b71ac0e9d2234 P 127766fc592545a4997f7790f50f6076 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:07:13.124418 19484 raft_consensus.cc:1275] T 7be9efa6559648dbb5a0f7684c4542d1 P 0473d2b2d01f4459b1e90fd12cc7840e [term 21 FOLLOWER]: Refusing update from remote peer e5256d91808b47c195bc9b4dbd7f2b87: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 21 index: 12. (index mismatch)
I20260709 13:07:13.126879 19485 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "28af091831594f9d8e96482078cc7625"
dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
mode: GRACEFUL
new_leader_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
 from {username='slave'} at 127.0.0.1:48168
I20260709 13:07:13.127503 19485 raft_consensus.cc:606] T 28af091831594f9d8e96482078cc7625 P 0473d2b2d01f4459b1e90fd12cc7840e [term 18 LEADER]: Received request to transfer leadership to TS e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:07:13.116864 26035 consensus_queue.cc:1059] T 4af19371ea874c09a0a2147040835cbb P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.021s
I20260709 13:07:13.145198 25993 leader_election.cc:290] T 2e36a9d6e29c4a7c860cf267efbd4c74 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 15 election: Requested vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:07:13.148295 20112 raft_consensus.cc:1275] T 65d8cb8d6ec64f459d5a47cefab10acf P 127766fc592545a4997f7790f50f6076 [term 21 FOLLOWER]: Refusing update from remote peer e5256d91808b47c195bc9b4dbd7f2b87: Log matching property violated. Preceding OpId in replica: term: 19 index: 12. Preceding OpId from leader: term: 21 index: 13. (index mismatch)
I20260709 13:07:13.150138 26147 leader_election.cc:290] T 40e1e16737a842ee936002830f36882e P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:07:13.152398 26190 leader_election.cc:290] T 833a2f0775ed407a94b8924ce50adb63 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 16 election: Requested vote from peers e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:07:13.155313 26151 raft_consensus.cc:3055] T 4af19371ea874c09a0a2147040835cbb P e61c3a8f61bb48f8a963c9480e53c168 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:07:13.155885 26151 raft_consensus.cc:740] T 4af19371ea874c09a0a2147040835cbb P e61c3a8f61bb48f8a963c9480e53c168 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: e61c3a8f61bb48f8a963c9480e53c168, State: Running, Role: LEADER
I20260709 13:07:13.168438 26160 raft_consensus.cc:493] T 0afb57ae58a24a01850491d69f0213dd P e61c3a8f61bb48f8a963c9480e53c168 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 0473d2b2d01f4459b1e90fd12cc7840e)
I20260709 13:07:13.168778 26219 consensus_queue.cc:1059] T 14935b3ddf914369822e4a0547aaa355 P 127766fc592545a4997f7790f50f6076 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 }, Status: INVALID_TERM, Last received: 12.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:07:13.169179 26160 raft_consensus.cc:515] T 0afb57ae58a24a01850491d69f0213dd P e61c3a8f61bb48f8a963c9480e53c168 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:07:13.170814 26059 raft_consensus.cc:493] T 6c5eebf646ad445a9d1b1adc319d7b16 P e61c3a8f61bb48f8a963c9480e53c168 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 0473d2b2d01f4459b1e90fd12cc7840e)
I20260709 13:07:13.171329 19477 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58294 (request call id 2999) took 1153 ms. Trace:
I20260709 13:07:13.171504 19486 raft_consensus.cc:1240] T 22196caba61445d3bec98a0aab3c337d P 0473d2b2d01f4459b1e90fd12cc7840e [term 20 FOLLOWER]: Rejecting Update request from peer e61c3a8f61bb48f8a963c9480e53c168 for earlier term 19. Current term is 20. Ops: [19.12-19.12]
I20260709 13:07:13.171739 19477 rpcz_store.cc:276] 0709 13:07:12.017479 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:12.337535 (+320056us) service_pool.cc:224] Handling call
0709 13:07:13.171113 (+833578us) spinlock_profiling.cc:243] Waited 512 ms on lock 0x7b54000ed654. stack: 00007f4a79de9343 00007f4a79de9240 00007f4a797781d4 00007f4a834b6304 00007f4a834b6299 00007f4a7ce71571 00007f4a7cf0c2fa 00007f4a81ecdb17 00007f4a7b4486d4 00007f4a7b448662 00007f4a7b448591 00007f4a7b44850c 00007f4a7b4477c2 00007f4a7b24348c 00007f4a7b2428c6 00007f4a7b24226f
0709 13:07:13.171272 (+   159us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1178645888}
I20260709 13:07:13.173005 19408 raft_consensus.cc:2393] T 833a2f0775ed407a94b8924ce50adb63 P e5256d91808b47c195bc9b4dbd7f2b87 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 127766fc592545a4997f7790f50f6076 in current term 16: Already voted for candidate e5256d91808b47c195bc9b4dbd7f2b87 in this term.
I20260709 13:07:13.173321 19486 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58286 (request call id 2733) took 1176 ms. Trace:
I20260709 13:07:13.173682 19486 rpcz_store.cc:276] 0709 13:07:11.996686 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:12.401298 (+404612us) service_pool.cc:224] Handling call
0709 13:07:13.171257 (+769959us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:13.172052 (+   795us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:13.173143 (+  1091us) spinlock_profiling.cc:243] Waited 769 ms on lock 0x7b54000ed650. stack: 00007f4a79de9343 00007f4a79de9240 00007f4a797781d4 00007f4a834b6304 00007f4a834b6299 00007f4a7ce71571 00007f4a7cf078ad 00007f4a81ecc419 00007f4a7b443bd4 00007f4a7b443b62 00007f4a7b443a91 00007f4a7b443a0c 00007f4a7b442cc2 00007f4a7b24348c 00007f4a7b2428c6 00007f4a7b24226f
0709 13:07:13.173271 (+   128us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1769768192}
I20260709 13:07:13.187086 19483 raft_consensus.cc:2468] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P 0473d2b2d01f4459b1e90fd12cc7840e [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 21.
I20260709 13:07:13.189070 19409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b08304a0a02b42d7840c4e8ee9a6bd1a" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 22 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:07:13.189911 19410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cdf56e38bbc453d9438d359e5a69955" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
I20260709 13:07:13.194576 19526 leader_election.cc:304] T 2e36a9d6e29c4a7c860cf267efbd4c74 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:07:13.196069 19410 raft_consensus.cc:2393] T 0cdf56e38bbc453d9438d359e5a69955 P e5256d91808b47c195bc9b4dbd7f2b87 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 0473d2b2d01f4459b1e90fd12cc7840e in current term 19: Already voted for candidate e5256d91808b47c195bc9b4dbd7f2b87 in this term.
I20260709 13:07:13.054684 25925 raft_consensus.cc:2804] T e381f1d6b8184797ad142de49be225a8 P e5256d91808b47c195bc9b4dbd7f2b87 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:07:13.198247 20112 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "36f6ba92b9ba46babe4ebd6c02e5fbd9"
dest_uuid: "127766fc592545a4997f7790f50f6076"
mode: GRACEFUL
new_leader_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
 from {username='slave'} at 127.0.0.1:48686
I20260709 13:07:13.199079 19409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a08760e15aac4630a629431f56024dc8" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 24 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:07:13.200563 19477 raft_consensus.cc:1275] T 0e1085d23e8347fbbd5bce7542f4b1f4 P 0473d2b2d01f4459b1e90fd12cc7840e [term 16 FOLLOWER]: Refusing update from remote peer 127766fc592545a4997f7790f50f6076: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 13:07:13.202361 20106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ece3db938bc649d4a40a51522ed5259c" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:07:13.204627 19410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff9b0eddd810459b82d91c60777c10eb" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:07:13.109422 26115 raft_consensus.cc:493] T fa731b585f684a7fb2d106c50f143b83 P 127766fc592545a4997f7790f50f6076 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader e5256d91808b47c195bc9b4dbd7f2b87)
I20260709 13:07:13.203361 20106 raft_consensus.cc:2468] T ece3db938bc649d4a40a51522ed5259c P 127766fc592545a4997f7790f50f6076 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 15.
I20260709 13:07:13.214314 19402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1b10566f45d4a7d9029858330e02d5b" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:07:13.214536 19407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff75a1d4cb1f493db8f71ddc136ba9ab" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:07:13.198479 19526 leader_election.cc:304] T ab43d85f64114d4ebf618930e43d9ed0 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e61c3a8f61bb48f8a963c9480e53c168; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, 127766fc592545a4997f7790f50f6076
I20260709 13:07:13.220649 19410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e381f1d6b8184797ad142de49be225a8" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 18 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
I20260709 13:07:13.221773 19409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40e1e16737a842ee936002830f36882e" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:07:13.224005 19526 leader_election.cc:400] T 1efebf73c86e432baa55533136b6e12c P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 15 election: Vote denied by peer 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257) with higher term. Message: Invalid argument: T 1efebf73c86e432baa55533136b6e12c P 0473d2b2d01f4459b1e90fd12cc7840e [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate e61c3a8f61bb48f8a963c9480e53c168 for earlier term 15. Current term is 16.
I20260709 13:07:13.224438 19526 leader_election.cc:403] T 1efebf73c86e432baa55533136b6e12c P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 15 election: Cancelling election due to peer responding with higher term
I20260709 13:07:13.227437 19402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4509b76741dc428e9201c70c1658da13" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:07:13.193320 26217 raft_consensus.cc:697] T 172b3dd13109415a955b71ac0e9d2234 P 127766fc592545a4997f7790f50f6076 [term 18 LEADER]: Becoming Leader. State: Replica: 127766fc592545a4997f7790f50f6076, State: Running, Role: LEADER
I20260709 13:07:13.199663 25925 raft_consensus.cc:493] T e381f1d6b8184797ad142de49be225a8 P e5256d91808b47c195bc9b4dbd7f2b87 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:13.039161 26001 consensus_queue.cc:1048] T 7be9efa6559648dbb5a0f7684c4542d1 P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Connected to new peer: Peer: permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.175s
I20260709 13:07:13.206202 26108 raft_consensus.cc:2804] T 2e36a9d6e29c4a7c860cf267efbd4c74 P e61c3a8f61bb48f8a963c9480e53c168 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:07:13.171433 26059 raft_consensus.cc:515] T 6c5eebf646ad445a9d1b1adc319d7b16 P e61c3a8f61bb48f8a963c9480e53c168 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:07:13.251336 19407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7be9efa6559648dbb5a0f7684c4542d1" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 22 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:07:13.253809 19403 raft_consensus.cc:1240] T 2725d2c4cb054f18b0fc8f735c15f6c2 P e5256d91808b47c195bc9b4dbd7f2b87 [term 20 FOLLOWER]: Rejecting Update request from peer 0473d2b2d01f4459b1e90fd12cc7840e for earlier term 19. Current term is 20. Ops: []
I20260709 13:07:13.231218 25747 raft_consensus.cc:2749] T 1efebf73c86e432baa55533136b6e12c P e61c3a8f61bb48f8a963c9480e53c168 [term 16 FOLLOWER]: Leader election lost for term 15. Reason: Vote denied by peer 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257) with higher term. Message: Invalid argument: T 1efebf73c86e432baa55533136b6e12c P 0473d2b2d01f4459b1e90fd12cc7840e [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate e61c3a8f61bb48f8a963c9480e53c168 for earlier term 15. Current term is 16.
W20260709 13:07:13.263626 26205 log.cc:927] Time spent T edd7d470b5014c9489be7f41f64355c9 P e5256d91808b47c195bc9b4dbd7f2b87: Append to log took a long time: real 0.724s	user 0.003s	sys 0.000s
I20260709 13:07:13.261405 26044 raft_consensus.cc:515] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P 127766fc592545a4997f7790f50f6076 [term 22 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
W20260709 13:07:13.267342 26225 log.cc:927] Time spent T 85c494af21f9457a85da47b9bc70c1fd P e61c3a8f61bb48f8a963c9480e53c168: Append to log took a long time: real 0.156s	user 0.000s	sys 0.000s
I20260709 13:07:13.225927 26226 raft_consensus.cc:2749] T ab43d85f64114d4ebf618930e43d9ed0 P e61c3a8f61bb48f8a963c9480e53c168 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:07:13.269084 26044 leader_election.cc:290] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 22 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:07:13.270090 20112 raft_consensus.cc:606] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P 127766fc592545a4997f7790f50f6076 [term 22 FOLLOWER]: Received request to transfer leadership to TS e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:07:13.270511 20112 raft_consensus.cc:614] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P 127766fc592545a4997f7790f50f6076 [term 22 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:07:13.271240 20105 raft_consensus.cc:2368] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P 127766fc592545a4997f7790f50f6076 [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate e5256d91808b47c195bc9b4dbd7f2b87 for earlier term 21. Current term is 22.
I20260709 13:07:13.196517 26092 consensus_queue.cc:1048] T 1efebf73c86e432baa55533136b6e12c P 127766fc592545a4997f7790f50f6076 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.058s
W20260709 13:07:13.253940 19449 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:13.274106 20107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14935b3ddf914369822e4a0547aaa355" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076"
W20260709 13:07:13.277603 19449 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:13.274354 19523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.1:40321, user_credentials={real_user=slave}} blocked reactor thread for 324829us
I20260709 13:07:13.274833 20111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff9b0eddd810459b82d91c60777c10eb" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:07:13.051397 26119 raft_consensus.cc:515] T 6c5eebf646ad445a9d1b1adc319d7b16 P 127766fc592545a4997f7790f50f6076 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:07:13.276171 20104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62c6c134d3d24a1ab144dd9ee6bc3f64" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 19 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:07:13.278615 19523 leader_election.cc:304] T 70797e5783b5454ab0d0eea663e791e3 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e61c3a8f61bb48f8a963c9480e53c168; no voters: 127766fc592545a4997f7790f50f6076, e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:07:13.282533 19483 raft_consensus.cc:1275] T 217b5fae677b4971b3bbd2f357a1f7ff P 0473d2b2d01f4459b1e90fd12cc7840e [term 16 FOLLOWER]: Refusing update from remote peer e61c3a8f61bb48f8a963c9480e53c168: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 13:07:13.283654 20109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7be9efa6559648dbb5a0f7684c4542d1" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 22 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:07:13.284482 20109 raft_consensus.cc:2410] T 7be9efa6559648dbb5a0f7684c4542d1 P 127766fc592545a4997f7790f50f6076 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0473d2b2d01f4459b1e90fd12cc7840e for term 22 because replica has last-logged OpId of term: 17 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 10.
I20260709 13:07:13.286988 19403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36f6ba92b9ba46babe4ebd6c02e5fbd9" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 22 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
I20260709 13:07:13.287720 19403 raft_consensus.cc:3060] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P e5256d91808b47c195bc9b4dbd7f2b87 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:07:13.300196 20107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab43d85f64114d4ebf618930e43d9ed0" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:07:13.301441 20111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1efebf73c86e432baa55533136b6e12c" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 17 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:07:13.258394 25925 raft_consensus.cc:3060] T e381f1d6b8184797ad142de49be225a8 P e5256d91808b47c195bc9b4dbd7f2b87 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:07:13.302556 19483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28af091831594f9d8e96482078cc7625" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:07:13.306896 19483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4509b76741dc428e9201c70c1658da13" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:07:13.307421 19523 leader_election.cc:304] T 1a61655d99124a29b486ba4a5b37faea P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e61c3a8f61bb48f8a963c9480e53c168; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:07:13.307613 19483 raft_consensus.cc:2468] T 4509b76741dc428e9201c70c1658da13 P 0473d2b2d01f4459b1e90fd12cc7840e [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 13.
I20260709 13:07:13.303252 19485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a08760e15aac4630a629431f56024dc8" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 24 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:07:13.304612 19479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f93ee515a9c14139bf566522ed8232f3" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 23 candidate_status { last_received { term: 22 index: 11 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:07:13.308743 19483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21e14947d70440f19044d8f75c31e1f9" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:07:13.311496 19483 raft_consensus.cc:3060] T 21e14947d70440f19044d8f75c31e1f9 P 0473d2b2d01f4459b1e90fd12cc7840e [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:07:13.258028 26108 raft_consensus.cc:493] T 2e36a9d6e29c4a7c860cf267efbd4c74 P e61c3a8f61bb48f8a963c9480e53c168 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 0473d2b2d01f4459b1e90fd12cc7840e)
I20260709 13:07:13.259095 25905 consensus_queue.cc:1048] T 0e1085d23e8347fbbd5bce7542f4b1f4 P 127766fc592545a4997f7790f50f6076 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.042s
I20260709 13:07:13.232802 26115 raft_consensus.cc:515] T fa731b585f684a7fb2d106c50f143b83 P 127766fc592545a4997f7790f50f6076 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:07:13.313154 19486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e381f1d6b8184797ad142de49be225a8" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 18 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:07:13.315358 19409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22196caba61445d3bec98a0aab3c337d" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
I20260709 13:07:13.315874 19523 leader_election.cc:304] T f1b10566f45d4a7d9029858330e02d5b P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e61c3a8f61bb48f8a963c9480e53c168; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:07:13.322902 19486 raft_consensus.cc:2393] T e381f1d6b8184797ad142de49be225a8 P 0473d2b2d01f4459b1e90fd12cc7840e [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e61c3a8f61bb48f8a963c9480e53c168 in current term 18: Already voted for candidate 0473d2b2d01f4459b1e90fd12cc7840e in this term.
I20260709 13:07:13.323309 19449 leader_election.cc:304] T 1f85fc4b527a48848e5faa083b604e36 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e; no voters: 127766fc592545a4997f7790f50f6076, e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:07:13.317368 19407 raft_consensus.cc:1240] T 1dc5b3532fe54f74876d02beffa2c230 P e5256d91808b47c195bc9b4dbd7f2b87 [term 22 FOLLOWER]: Rejecting Update request from peer 0473d2b2d01f4459b1e90fd12cc7840e for earlier term 21. Current term is 22. Ops: []
I20260709 13:07:13.327371 19485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dc5b3532fe54f74876d02beffa2c230" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:07:13.303329 26207 raft_consensus.cc:493] T 775c229504194560ba9589bc2199b089 P 0473d2b2d01f4459b1e90fd12cc7840e [term 15 FOLLOWER]: Starting pre-election (detected failure of leader e5256d91808b47c195bc9b4dbd7f2b87)
I20260709 13:07:13.327111 19449 leader_election.cc:304] T 21e14947d70440f19044d8f75c31e1f9 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87; no voters: 
I20260709 13:07:13.302361 26147 raft_consensus.cc:2749] T 70797e5783b5454ab0d0eea663e791e3 P e61c3a8f61bb48f8a963c9480e53c168 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:07:13.339793 19483 raft_consensus.cc:2468] T 21e14947d70440f19044d8f75c31e1f9 P 0473d2b2d01f4459b1e90fd12cc7840e [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 20.
I20260709 13:07:13.269655 26159 consensus_queue.cc:1059] T 22196caba61445d3bec98a0aab3c337d P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 }, Status: INVALID_TERM, Last received: 18.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.044s
I20260709 13:07:13.343559 19486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff75a1d4cb1f493db8f71ddc136ba9ab" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:07:13.338832 19374 leader_election.cc:304] T ece3db938bc649d4a40a51522ed5259c P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 127766fc592545a4997f7790f50f6076, e5256d91808b47c195bc9b4dbd7f2b87; no voters: 
I20260709 13:07:13.347138 19485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40e1e16737a842ee936002830f36882e" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:07:13.349226 19483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36f6ba92b9ba46babe4ebd6c02e5fbd9" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 22 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:07:13.318233 26108 raft_consensus.cc:3060] T 2e36a9d6e29c4a7c860cf267efbd4c74 P e61c3a8f61bb48f8a963c9480e53c168 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:07:13.321322 25747 raft_consensus.cc:2749] T 1a61655d99124a29b486ba4a5b37faea P e61c3a8f61bb48f8a963c9480e53c168 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:07:13.329989 26101 raft_consensus.cc:2749] T 1f85fc4b527a48848e5faa083b604e36 P 0473d2b2d01f4459b1e90fd12cc7840e [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:07:13.351197 19483 raft_consensus.cc:3060] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P 0473d2b2d01f4459b1e90fd12cc7840e [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:07:13.317343 25530 raft_consensus.cc:493] T 76cb037fc9064d13b59a8969d897ce8c P 0473d2b2d01f4459b1e90fd12cc7840e [term 18 FOLLOWER]: Starting pre-election (detected failure of leader e5256d91808b47c195bc9b4dbd7f2b87)
I20260709 13:07:13.341722 26017 raft_consensus.cc:2764] T 21e14947d70440f19044d8f75c31e1f9 P 0473d2b2d01f4459b1e90fd12cc7840e [term 20 FOLLOWER]: Leader pre-election decision vote started in defunct term 19: won
I20260709 13:07:13.347975 19485 raft_consensus.cc:2468] T 40e1e16737a842ee936002830f36882e P 0473d2b2d01f4459b1e90fd12cc7840e [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 21.
I20260709 13:07:13.289149 26217 consensus_queue.cc:237] T 172b3dd13109415a955b71ac0e9d2234 P 127766fc592545a4997f7790f50f6076 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 17.12, Last appended by leader: 12, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:07:13.363471 19407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa8650e71aa14778b3d73721fc50d9fc" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 21 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
I20260709 13:07:13.329824 26163 raft_consensus.cc:493] T 309c3ca0ca4b4f3ba129752ea2cb293b P 127766fc592545a4997f7790f50f6076 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 0473d2b2d01f4459b1e90fd12cc7840e)
I20260709 13:07:13.365667 19409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff75a1d4cb1f493db8f71ddc136ba9ab" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
I20260709 13:07:13.359536 19486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7be9efa6559648dbb5a0f7684c4542d1" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:07:13.372144 19486 raft_consensus.cc:2468] T 7be9efa6559648dbb5a0f7684c4542d1 P 0473d2b2d01f4459b1e90fd12cc7840e [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 21.
I20260709 13:07:13.357659 26097 raft_consensus.cc:2804] T ece3db938bc649d4a40a51522ed5259c P e5256d91808b47c195bc9b4dbd7f2b87 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:07:13.328581 26207 raft_consensus.cc:515] T 775c229504194560ba9589bc2199b089 P 0473d2b2d01f4459b1e90fd12cc7840e [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:07:13.384572 19485 raft_consensus.cc:1240] T 0e1085d23e8347fbbd5bce7542f4b1f4 P 0473d2b2d01f4459b1e90fd12cc7840e [term 16 FOLLOWER]: Rejecting Update request from peer e61c3a8f61bb48f8a963c9480e53c168 for earlier term 15. Current term is 16. Ops: []
I20260709 13:07:13.386515 19479 raft_consensus.cc:2468] T f93ee515a9c14139bf566522ed8232f3 P 0473d2b2d01f4459b1e90fd12cc7840e [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 23.
I20260709 13:07:13.388041 19449 leader_election.cc:304] T b08304a0a02b42d7840c4e8ee9a6bd1a P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e; no voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:07:13.391978 19449 leader_election.cc:304] T ff9b0eddd810459b82d91c60777c10eb P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e; no voters: 127766fc592545a4997f7790f50f6076, e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:07:13.360783 26160 leader_election.cc:290] T 0afb57ae58a24a01850491d69f0213dd P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:07:13.396670 19403 raft_consensus.cc:2468] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P e5256d91808b47c195bc9b4dbd7f2b87 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 127766fc592545a4997f7790f50f6076 in term 22.
I20260709 13:07:13.367477 26147 raft_consensus.cc:2749] T f1b10566f45d4a7d9029858330e02d5b P e61c3a8f61bb48f8a963c9480e53c168 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:07:13.346051 26192 consensus_queue.cc:1048] T 4af19371ea874c09a0a2147040835cbb P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Connected to new peer: Peer: permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.037s
I20260709 13:07:13.401257 19483 raft_consensus.cc:2468] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P 0473d2b2d01f4459b1e90fd12cc7840e [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 127766fc592545a4997f7790f50f6076 in term 22.
I20260709 13:07:13.389391 26163 raft_consensus.cc:515] T 309c3ca0ca4b4f3ba129752ea2cb293b P 127766fc592545a4997f7790f50f6076 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
W20260709 13:07:13.407541 26234 log.cc:927] Time spent T f1b10566f45d4a7d9029858330e02d5b P e5256d91808b47c195bc9b4dbd7f2b87: Append to log took a long time: real 0.116s	user 0.001s	sys 0.000s
I20260709 13:07:13.408421 19551 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40428 (request call id 3396) took 1285 ms. Trace:
W20260709 13:07:13.409080 19451 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:13.409655 26233 log.cc:927] Time spent T b08304a0a02b42d7840c4e8ee9a6bd1a P e5256d91808b47c195bc9b4dbd7f2b87: Append to log took a long time: real 0.061s	user 0.000s	sys 0.000s
I20260709 13:07:13.408802 19551 rpcz_store.cc:276] 0709 13:07:12.123303 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:12.212863 (+ 89560us) service_pool.cc:224] Handling call
0709 13:07:13.408222 (+1195359us) spinlock_profiling.cc:243] Waited 72.4 ms on lock 0x7b540029b8d4. stack: 00007f4a79de9343 00007f4a79de9240 00007f4a797781d4 00007f4a834b6304 00007f4a834b6299 00007f4a7ce71571 00007f4a7cf0c2fa 00007f4a81ecdb17 00007f4a7b4486d4 00007f4a7b448662 00007f4a7b448591 00007f4a7b44850c 00007f4a7b4477c2 00007f4a7b24348c 00007f4a7b2428c6 00007f4a7b24226f
0709 13:07:13.408351 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":166466944}
I20260709 13:07:13.410034 26151 consensus_queue.cc:260] T 4af19371ea874c09a0a2147040835cbb P e61c3a8f61bb48f8a963c9480e53c168 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:07:13.358809 26069 consensus_queue.cc:1048] T 65d8cb8d6ec64f459d5a47cefab10acf P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Connected to new peer: Peer: permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.036s
I20260709 13:07:13.411443 26151 raft_consensus.cc:3060] T 4af19371ea874c09a0a2147040835cbb P e61c3a8f61bb48f8a963c9480e53c168 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:13.413255 20103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "833a2f0775ed407a94b8924ce50adb63" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076"
I20260709 13:07:13.414080 20103 raft_consensus.cc:2393] T 833a2f0775ed407a94b8924ce50adb63 P 127766fc592545a4997f7790f50f6076 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate e5256d91808b47c195bc9b4dbd7f2b87 in current term 16: Already voted for candidate 127766fc592545a4997f7790f50f6076 in this term.
I20260709 13:07:13.398963 25975 raft_consensus.cc:2749] T ff9b0eddd810459b82d91c60777c10eb P 0473d2b2d01f4459b1e90fd12cc7840e [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:07:13.392907 26097 raft_consensus.cc:493] T ece3db938bc649d4a40a51522ed5259c P e5256d91808b47c195bc9b4dbd7f2b87 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 127766fc592545a4997f7790f50f6076)
I20260709 13:07:13.416145 26097 raft_consensus.cc:3060] T ece3db938bc649d4a40a51522ed5259c P e5256d91808b47c195bc9b4dbd7f2b87 [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:07:13.419762 26232 log.cc:927] Time spent T fa8650e71aa14778b3d73721fc50d9fc P e61c3a8f61bb48f8a963c9480e53c168: Append to log took a long time: real 0.128s	user 0.001s	sys 0.000s
I20260709 13:07:13.420199 26059 leader_election.cc:290] T 6c5eebf646ad445a9d1b1adc319d7b16 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:07:13.422331 26207 leader_election.cc:290] T 775c229504194560ba9589bc2199b089 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:07:13.392562 25530 raft_consensus.cc:515] T 76cb037fc9064d13b59a8969d897ce8c P 0473d2b2d01f4459b1e90fd12cc7840e [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:07:13.426191 25530 leader_election.cc:290] T 76cb037fc9064d13b59a8969d897ce8c P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:07:13.426602 19405 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52342 (request call id 3330) took 1514 ms. Trace:
I20260709 13:07:13.427006 19405 rpcz_store.cc:276] 0709 13:07:11.911902 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:12.255732 (+343830us) service_pool.cc:224] Handling call
0709 13:07:12.255960 (+   228us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:12.400259 (+144299us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:13.426387 (+1026128us) spinlock_profiling.cc:243] Waited 132 ms on lock 0x7b540023a854. stack: 00007f4a79de9343 00007f4a79de9240 00007f4a797781d4 00007f4a834b6304 00007f4a834b6299 00007f4a7ce71571 00007f4a7cf08e01 00007f4a7cf0783e 00007f4a81ecc419 00007f4a7b443bd4 00007f4a7b443b62 00007f4a7b443a91 00007f4a7b443a0c 00007f4a7b442cc2 00007f4a7b24348c 00007f4a7b2428c6
0709 13:07:13.426546 (+   159us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":304110336}
I20260709 13:07:13.428439 19404 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52328 (request call id 2653) took 1774 ms. Trace:
I20260709 13:07:13.428804 19404 rpcz_store.cc:276] 0709 13:07:11.654256 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:11.654430 (+   174us) service_pool.cc:224] Handling call
0709 13:07:11.670388 (+ 15958us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:12.402760 (+732372us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:13.428232 (+1025472us) spinlock_profiling.cc:243] Waited 715 ms on lock 0x7b54001d9f54. stack: 00007f4a79de9343 00007f4a79de9240 00007f4a797781d4 00007f4a834b6304 00007f4a834b6299 00007f4a7ce71571 00007f4a7cf08e01 00007f4a7cf0783e 00007f4a81ecc419 00007f4a7b443bd4 00007f4a7b443b62 00007f4a7b443a91 00007f4a7b443a0c 00007f4a7b442cc2 00007f4a7b24348c 00007f4a7b2428c6
0709 13:07:13.428384 (+   152us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1645129088}
I20260709 13:07:13.430344 19450 leader_election.cc:304] T f1b10566f45d4a7d9029858330e02d5b P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e; no voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168
W20260709 13:07:13.431861 19524 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:13.435225 19552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4509b76741dc428e9201c70c1658da13" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:07:13.436415 19450 leader_election.cc:304] T a08760e15aac4630a629431f56024dc8 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e; no voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:07:13.437245 19557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40e1e16737a842ee936002830f36882e" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:07:13.437986 19557 raft_consensus.cc:2468] T 40e1e16737a842ee936002830f36882e P e61c3a8f61bb48f8a963c9480e53c168 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 21.
I20260709 13:07:13.441148 19555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e381f1d6b8184797ad142de49be225a8" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 18 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:07:13.441761 19555 raft_consensus.cc:3060] T e381f1d6b8184797ad142de49be225a8 P e61c3a8f61bb48f8a963c9480e53c168 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:07:13.443053 19556 raft_consensus.cc:1240] T f93ee515a9c14139bf566522ed8232f3 P e61c3a8f61bb48f8a963c9480e53c168 [term 23 FOLLOWER]: Rejecting Update request from peer 0473d2b2d01f4459b1e90fd12cc7840e for earlier term 22. Current term is 23. Ops: []
I20260709 13:07:13.394627 26101 raft_consensus.cc:2749] T b08304a0a02b42d7840c4e8ee9a6bd1a P 0473d2b2d01f4459b1e90fd12cc7840e [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:07:13.444537 26119 leader_election.cc:290] T 6c5eebf646ad445a9d1b1adc319d7b16 P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:07:13.434758 26160 raft_consensus.cc:493] T edd7d470b5014c9489be7f41f64355c9 P e61c3a8f61bb48f8a963c9480e53c168 [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:13.436017 19552 raft_consensus.cc:2468] T 4509b76741dc428e9201c70c1658da13 P e61c3a8f61bb48f8a963c9480e53c168 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 13.
I20260709 13:07:13.446126 19450 leader_election.cc:304] T 14935b3ddf914369822e4a0547aaa355 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168; no voters: 127766fc592545a4997f7790f50f6076
I20260709 13:07:13.433357 19526 leader_election.cc:304] T 4509b76741dc428e9201c70c1658da13 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:07:13.367244 25953 consensus_queue.cc:1048] T 96efeaaf1057492490e9a621f37e1a2d P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Connected to new peer: Peer: permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.064s
I20260709 13:07:13.450953 19526 leader_election.cc:304] T 21e14947d70440f19044d8f75c31e1f9 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:07:13.449517 19450 leader_election.cc:304] T 7be9efa6559648dbb5a0f7684c4542d1 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e; no voters: 127766fc592545a4997f7790f50f6076, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:07:13.453150 19526 leader_election.cc:304] T 40e1e16737a842ee936002830f36882e P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
W20260709 13:07:13.450474 19523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.1:40321, user_credentials={real_user=slave}} blocked reactor thread for 134649us
I20260709 13:07:13.451182 19557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa8650e71aa14778b3d73721fc50d9fc" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 21 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:07:13.456138 19523 leader_election.cc:304] T 7f575b143b844aa096b50997dad3516a P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168; no voters: 0473d2b2d01f4459b1e90fd12cc7840e
I20260709 13:07:13.464097 20078 leader_election.cc:304] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, 127766fc592545a4997f7790f50f6076; no voters: 
I20260709 13:07:13.466419 19552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1efebf73c86e432baa55533136b6e12c" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 17 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:07:13.467244 19552 raft_consensus.cc:2468] T 1efebf73c86e432baa55533136b6e12c P e61c3a8f61bb48f8a963c9480e53c168 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 16.
I20260709 13:07:13.468848 19558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22196caba61445d3bec98a0aab3c337d" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:07:13.469295 19557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab43d85f64114d4ebf618930e43d9ed0" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:07:13.469882 19560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62c6c134d3d24a1ab144dd9ee6bc3f64" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 19 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:07:13.472026 19450 leader_election.cc:304] T 0cdf56e38bbc453d9438d359e5a69955 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168; no voters: e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:07:13.447000 25530 raft_consensus.cc:2749] T f1b10566f45d4a7d9029858330e02d5b P 0473d2b2d01f4459b1e90fd12cc7840e [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
W20260709 13:07:13.476708 19449 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.1:40321, user_credentials={real_user=slave}} blocked reactor thread for 79208.7us
I20260709 13:07:13.476706 19560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff75a1d4cb1f493db8f71ddc136ba9ab" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:07:13.452113 26101 raft_consensus.cc:2749] T a08760e15aac4630a629431f56024dc8 P 0473d2b2d01f4459b1e90fd12cc7840e [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:07:13.463382 26207 raft_consensus.cc:2804] T 14935b3ddf914369822e4a0547aaa355 P 0473d2b2d01f4459b1e90fd12cc7840e [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:07:13.473603 25905 raft_consensus.cc:2804] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P 127766fc592545a4997f7790f50f6076 [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:07:13.480248 26033 raft_consensus.cc:2804] T 0cdf56e38bbc453d9438d359e5a69955 P 0473d2b2d01f4459b1e90fd12cc7840e [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:07:13.452793 26147 consensus_queue.cc:1048] T 217b5fae677b4971b3bbd2f357a1f7ff P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.031s
I20260709 13:07:13.489274 26228 raft_consensus.cc:2804] T 21e14947d70440f19044d8f75c31e1f9 P e61c3a8f61bb48f8a963c9480e53c168 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:07:13.489787 26228 raft_consensus.cc:697] T 21e14947d70440f19044d8f75c31e1f9 P e61c3a8f61bb48f8a963c9480e53c168 [term 20 LEADER]: Becoming Leader. State: Replica: e61c3a8f61bb48f8a963c9480e53c168, State: Running, Role: LEADER
I20260709 13:07:13.489817 26147 raft_consensus.cc:2804] T 40e1e16737a842ee936002830f36882e P e61c3a8f61bb48f8a963c9480e53c168 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:07:13.490479 26147 raft_consensus.cc:493] T 40e1e16737a842ee936002830f36882e P e61c3a8f61bb48f8a963c9480e53c168 [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:13.479535 26162 raft_consensus.cc:493] T 46c5bfeecc314717bffe987e6844b6d0 P 0473d2b2d01f4459b1e90fd12cc7840e [term 25 FOLLOWER]: Starting pre-election (detected failure of leader e61c3a8f61bb48f8a963c9480e53c168)
I20260709 13:07:13.492130 25953 consensus_queue.cc:1059] T 2725d2c4cb054f18b0fc8f735c15f6c2 P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 }, Status: INVALID_TERM, Last received: 19.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:07:13.492496 26162 raft_consensus.cc:515] T 46c5bfeecc314717bffe987e6844b6d0 P 0473d2b2d01f4459b1e90fd12cc7840e [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:07:13.494243 19480 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "fa8650e71aa14778b3d73721fc50d9fc"
dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
mode: GRACEFUL
new_leader_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
 from {username='slave'} at 127.0.0.1:48168
I20260709 13:07:13.470645 26160 raft_consensus.cc:515] T edd7d470b5014c9489be7f41f64355c9 P e61c3a8f61bb48f8a963c9480e53c168 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:07:13.494992 19480 raft_consensus.cc:606] T fa8650e71aa14778b3d73721fc50d9fc P 0473d2b2d01f4459b1e90fd12cc7840e [term 21 FOLLOWER]: Received request to transfer leadership to TS e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:07:13.495489 19480 raft_consensus.cc:614] T fa8650e71aa14778b3d73721fc50d9fc P 0473d2b2d01f4459b1e90fd12cc7840e [term 21 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:07:13.496454 26160 leader_election.cc:290] T edd7d470b5014c9489be7f41f64355c9 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:07:13.497048 26160 raft_consensus.cc:2804] T 7f575b143b844aa096b50997dad3516a P e61c3a8f61bb48f8a963c9480e53c168 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:07:13.497452 26160 raft_consensus.cc:493] T 7f575b143b844aa096b50997dad3516a P e61c3a8f61bb48f8a963c9480e53c168 [term 16 FOLLOWER]: Starting leader election (detected failure of leader e5256d91808b47c195bc9b4dbd7f2b87)
I20260709 13:07:13.497824 26160 raft_consensus.cc:3060] T 7f575b143b844aa096b50997dad3516a P e61c3a8f61bb48f8a963c9480e53c168 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:07:13.490959 26147 raft_consensus.cc:3060] T 40e1e16737a842ee936002830f36882e P e61c3a8f61bb48f8a963c9480e53c168 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:07:13.500366 26097 raft_consensus.cc:515] T ece3db938bc649d4a40a51522ed5259c P e5256d91808b47c195bc9b4dbd7f2b87 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:07:13.504096 25925 raft_consensus.cc:515] T e381f1d6b8184797ad142de49be225a8 P e5256d91808b47c195bc9b4dbd7f2b87 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:07:13.507112 19410 raft_consensus.cc:2393] T e381f1d6b8184797ad142de49be225a8 P e5256d91808b47c195bc9b4dbd7f2b87 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 0473d2b2d01f4459b1e90fd12cc7840e in current term 18: Already voted for candidate e5256d91808b47c195bc9b4dbd7f2b87 in this term.
I20260709 13:07:13.507347 19560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76cb037fc9064d13b59a8969d897ce8c" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:07:13.508364 19560 raft_consensus.cc:2393] T 76cb037fc9064d13b59a8969d897ce8c P e61c3a8f61bb48f8a963c9480e53c168 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0473d2b2d01f4459b1e90fd12cc7840e in current term 19: Already voted for candidate e61c3a8f61bb48f8a963c9480e53c168 in this term.
I20260709 13:07:13.473984 26204 raft_consensus.cc:2749] T 7be9efa6559648dbb5a0f7684c4542d1 P 0473d2b2d01f4459b1e90fd12cc7840e [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:07:13.517526 19555 raft_consensus.cc:2468] T e381f1d6b8184797ad142de49be225a8 P e61c3a8f61bb48f8a963c9480e53c168 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 18.
I20260709 13:07:13.481844 26151 raft_consensus.cc:2804] T 4509b76741dc428e9201c70c1658da13 P e61c3a8f61bb48f8a963c9480e53c168 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:07:13.494540 26162 leader_election.cc:290] T 46c5bfeecc314717bffe987e6844b6d0 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:07:13.525719 25975 raft_consensus.cc:3055] T 2725d2c4cb054f18b0fc8f735c15f6c2 P 0473d2b2d01f4459b1e90fd12cc7840e [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:07:13.527735 18300 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 4
I20260709 13:07:13.522507 26151 raft_consensus.cc:493] T 4509b76741dc428e9201c70c1658da13 P e61c3a8f61bb48f8a963c9480e53c168 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:13.520243 26207 raft_consensus.cc:697] T 14935b3ddf914369822e4a0547aaa355 P 0473d2b2d01f4459b1e90fd12cc7840e [term 15 LEADER]: Becoming Leader. State: Replica: 0473d2b2d01f4459b1e90fd12cc7840e, State: Running, Role: LEADER
I20260709 13:07:13.520622 25905 raft_consensus.cc:697] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P 127766fc592545a4997f7790f50f6076 [term 22 LEADER]: Becoming Leader. State: Replica: 127766fc592545a4997f7790f50f6076, State: Running, Role: LEADER
I20260709 13:07:13.518730 25925 leader_election.cc:290] T e381f1d6b8184797ad142de49be225a8 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 18 election: Requested vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:07:13.490795 26228 consensus_queue.cc:237] T 21e14947d70440f19044d8f75c31e1f9 P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.12, Last appended by leader: 12, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:07:13.558145 20108 raft_consensus.cc:1240] T 0e1085d23e8347fbbd5bce7542f4b1f4 P 127766fc592545a4997f7790f50f6076 [term 16 LEADER]: Rejecting Update request from peer e61c3a8f61bb48f8a963c9480e53c168 for earlier term 15. Current term is 16. Ops: []
I20260709 13:07:13.559377 19406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "309c3ca0ca4b4f3ba129752ea2cb293b" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:07:13.559990 19478 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58294 (request call id 2994) took 1544 ms. Trace:
I20260709 13:07:13.560635 19478 rpcz_store.cc:276] 0709 13:07:12.015891 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:12.429599 (+413708us) service_pool.cc:224] Handling call
0709 13:07:12.443245 (+ 13646us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:12.525864 (+ 82619us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:13.559686 (+1033822us) spinlock_profiling.cc:243] Waited 50.7 ms on lock 0x7b54003ea3d4. stack: 00007f4a79de9343 00007f4a79de9240 00007f4a797781d4 00007f4a834b6304 00007f4a834b6299 00007f4a7ce71571 00007f4a7cf08e01 00007f4a7cf0783e 00007f4a81ecc419 00007f4a7b443bd4 00007f4a7b443b62 00007f4a7b443a91 00007f4a7b443a0c 00007f4a7b442cc2 00007f4a7b24348c 00007f4a7b2428c6
0709 13:07:13.559911 (+   225us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":116588416}
I20260709 13:07:13.562196 19405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa731b585f684a7fb2d106c50f143b83" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:07:13.528416 25975 raft_consensus.cc:740] T 2725d2c4cb054f18b0fc8f735c15f6c2 P 0473d2b2d01f4459b1e90fd12cc7840e [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 0473d2b2d01f4459b1e90fd12cc7840e, State: Running, Role: LEADER
I20260709 13:07:13.567849 19403 raft_consensus.cc:1275] T 9962423cb4e54fcfa5de01daf68a86e7 P e5256d91808b47c195bc9b4dbd7f2b87 [term 19 FOLLOWER]: Refusing update from remote peer 127766fc592545a4997f7790f50f6076: Log matching property violated. Preceding OpId in replica: term: 17 index: 12. Preceding OpId from leader: term: 19 index: 13. (index mismatch)
I20260709 13:07:13.544008 26151 raft_consensus.cc:3060] T 4509b76741dc428e9201c70c1658da13 P e61c3a8f61bb48f8a963c9480e53c168 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:07:13.550457 26108 raft_consensus.cc:515] T 2e36a9d6e29c4a7c860cf267efbd4c74 P e61c3a8f61bb48f8a963c9480e53c168 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:07:13.576610 26163 leader_election.cc:290] T 309c3ca0ca4b4f3ba129752ea2cb293b P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:07:13.581362 25747 raft_consensus.cc:3055] T 22196caba61445d3bec98a0aab3c337d P e61c3a8f61bb48f8a963c9480e53c168 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:07:13.581985 25747 raft_consensus.cc:740] T 22196caba61445d3bec98a0aab3c337d P e61c3a8f61bb48f8a963c9480e53c168 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: e61c3a8f61bb48f8a963c9480e53c168, State: Running, Role: LEADER
I20260709 13:07:13.583009 26160 raft_consensus.cc:515] T 7f575b143b844aa096b50997dad3516a P e61c3a8f61bb48f8a963c9480e53c168 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:07:13.577943 26108 leader_election.cc:290] T 2e36a9d6e29c4a7c860cf267efbd4c74 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 14 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:07:13.587847 26160 leader_election.cc:290] T 7f575b143b844aa096b50997dad3516a P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 17 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:07:13.589514 26147 raft_consensus.cc:515] T 40e1e16737a842ee936002830f36882e P e61c3a8f61bb48f8a963c9480e53c168 [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:07:13.593614 26147 leader_election.cc:290] T 40e1e16737a842ee936002830f36882e P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 22 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:07:13.595286 26151 raft_consensus.cc:515] T 4509b76741dc428e9201c70c1658da13 P e61c3a8f61bb48f8a963c9480e53c168 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:07:13.597613 25747 consensus_queue.cc:260] T 22196caba61445d3bec98a0aab3c337d P e61c3a8f61bb48f8a963c9480e53c168 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 19.12, Last appended by leader: 12, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:07:13.598591 26151 leader_election.cc:290] T 4509b76741dc428e9201c70c1658da13 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 14 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:07:13.599354 25747 raft_consensus.cc:3060] T 22196caba61445d3bec98a0aab3c337d P e61c3a8f61bb48f8a963c9480e53c168 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:07:13.603595 25975 consensus_queue.cc:260] T 2725d2c4cb054f18b0fc8f735c15f6c2 P 0473d2b2d01f4459b1e90fd12cc7840e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 19.10, Last appended by leader: 10, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:07:13.590517 25905 consensus_queue.cc:237] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P 127766fc592545a4997f7790f50f6076 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 20.16, Last appended by leader: 16, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:07:13.591336 19557 raft_consensus.cc:2468] T ab43d85f64114d4ebf618930e43d9ed0 P e61c3a8f61bb48f8a963c9480e53c168 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 21.
W20260709 13:07:13.591681 25851 consensus_meta.cc:287] T 0e1085d23e8347fbbd5bce7542f4b1f4 P e61c3a8f61bb48f8a963c9480e53c168: Time spent flushing consensus metadata: real 0.537s	user 0.009s	sys 0.001s
I20260709 13:07:13.612185 26207 consensus_queue.cc:237] T 14935b3ddf914369822e4a0547aaa355 P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
W20260709 13:07:13.618029 19525 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:13.566772 26097 leader_election.cc:290] T ece3db938bc649d4a40a51522ed5259c P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 15 election: Requested vote from peers e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:07:13.629142 26240 raft_consensus.cc:493] T ef32ce6fdd0e40d382c79974f30295c6 P e61c3a8f61bb48f8a963c9480e53c168 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader e5256d91808b47c195bc9b4dbd7f2b87)
I20260709 13:07:13.629856 26240 raft_consensus.cc:515] T ef32ce6fdd0e40d382c79974f30295c6 P e61c3a8f61bb48f8a963c9480e53c168 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:07:13.632527 26240 leader_election.cc:290] T ef32ce6fdd0e40d382c79974f30295c6 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:07:13.646523 26179 raft_consensus.cc:3055] T 14935b3ddf914369822e4a0547aaa355 P 127766fc592545a4997f7790f50f6076 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:07:13.647112 26179 raft_consensus.cc:740] T 14935b3ddf914369822e4a0547aaa355 P 127766fc592545a4997f7790f50f6076 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 127766fc592545a4997f7790f50f6076, State: Running, Role: LEADER
I20260709 13:07:13.648106 26179 consensus_queue.cc:260] T 14935b3ddf914369822e4a0547aaa355 P 127766fc592545a4997f7790f50f6076 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.11, Last appended by leader: 11, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:07:13.649370 26179 raft_consensus.cc:3060] T 14935b3ddf914369822e4a0547aaa355 P 127766fc592545a4997f7790f50f6076 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:07:13.652496 26115 leader_election.cc:290] T fa731b585f684a7fb2d106c50f143b83 P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
W20260709 13:07:13.657469 26229 log.cc:927] Time spent T 62c6c134d3d24a1ab144dd9ee6bc3f64 P 0473d2b2d01f4459b1e90fd12cc7840e: Append to log took a long time: real 0.366s	user 0.004s	sys 0.000s
I20260709 13:07:13.662173 20110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ece3db938bc649d4a40a51522ed5259c" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076"
W20260709 13:07:13.664458 19374 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.4:43121, user_credentials={real_user=slave}} blocked reactor thread for 55820.2us
I20260709 13:07:13.668242 19553 raft_consensus.cc:1275] T edd7d470b5014c9489be7f41f64355c9 P e61c3a8f61bb48f8a963c9480e53c168 [term 24 FOLLOWER]: Refusing update from remote peer e5256d91808b47c195bc9b4dbd7f2b87: Log matching property violated. Preceding OpId in replica: term: 22 index: 12. Preceding OpId from leader: term: 24 index: 13. (index mismatch)
I20260709 13:07:13.669689 19554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21e14947d70440f19044d8f75c31e1f9" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 20 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
W20260709 13:07:13.675014 19375 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.3:36891, user_credentials={real_user=slave}} blocked reactor thread for 55795.3us
I20260709 13:07:13.677906 19554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "217b5fae677b4971b3bbd2f357a1f7ff" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
W20260709 13:07:13.680366 19449 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.1:40321, user_credentials={real_user=slave}} blocked reactor thread for 197332us
I20260709 13:07:13.682720 25376 consensus_queue.cc:1059] T 1dc5b3532fe54f74876d02beffa2c230 P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:07:13.686214 19482 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39478 (request call id 1101) took 1186 ms. Trace:
W20260709 13:07:13.606477 26209 log.cc:927] Time spent T 0e1085d23e8347fbbd5bce7542f4b1f4 P 127766fc592545a4997f7790f50f6076: Append to log took a long time: real 1.066s	user 0.003s	sys 0.000s
I20260709 13:07:13.691682 19555 raft_consensus.cc:1275] T 4af19371ea874c09a0a2147040835cbb P e61c3a8f61bb48f8a963c9480e53c168 [term 12 FOLLOWER]: Refusing update from remote peer e5256d91808b47c195bc9b4dbd7f2b87: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 12 index: 10. (term mismatch)
I20260709 13:07:13.695699 19555 pending_rounds.cc:85] T 4af19371ea874c09a0a2147040835cbb P e61c3a8f61bb48f8a963c9480e53c168: Aborting all ops after (but not including) 9
I20260709 13:07:13.696019 19555 pending_rounds.cc:107] T 4af19371ea874c09a0a2147040835cbb P e61c3a8f61bb48f8a963c9480e53c168: Aborting uncommitted NO_OP operation due to leader change: 11.10
I20260709 13:07:13.696100 25376 consensus_queue.cc:1048] T bc225c93219c45538b53a1bd3d387e4d P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:07:13.696430 19555 raft_consensus.cc:2889] T 4af19371ea874c09a0a2147040835cbb P e61c3a8f61bb48f8a963c9480e53c168 [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:07:13.686736 19482 rpcz_store.cc:276] 0709 13:07:12.500238 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:12.995975 (+495737us) service_pool.cc:224] Handling call
0709 13:07:12.996306 (+   331us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:12.996643 (+   337us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:12.996675 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:12.997181 (+   506us) log.cc:844] Serialized 26 byte log entry
0709 13:07:13.230932 (+233751us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:07:13.230980 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:13.231051 (+    71us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:13.656787 (+425736us) spinlock_profiling.cc:243] Waited 9.14 ms on lock 0x7b4400022b4c. stack: 00007f4a79de9343 00007f4a79de9240 00007f4a797781d4 00007f4a834b6304 00007f4a834b6299 00007f4a79ca3db1 00007f4a79d41c85 00007f4a79d426a2 00007f4a7cab41db 00007f4a7caafaaf 00007f4a7caa386e 00007f4a7caa2bb6 00007f4a7caa27d8 00007f4a7caac221 00007f4a7caac1d9 00007f4a7caac169
0709 13:07:13.658847 (+  2060us) raft_consensus.cc:1685] finished
0709 13:07:13.658876 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:13.686129 (+ 27253us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":2773,"raft.run_cpu_time_us":80,"raft.run_wall_time_us":80,"spinlock_wait_cycles":21032704,"thread_start_us":233287,"threads_started":1,"wal-append.queue_time_us":294302}
W20260709 13:07:13.694568 19450 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.3:36891, user_credentials={real_user=slave}} blocked reactor thread for 214540us
I20260709 13:07:13.693113 19554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ece3db938bc649d4a40a51522ed5259c" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:07:13.712103 19554 raft_consensus.cc:2393] T ece3db938bc649d4a40a51522ed5259c P e61c3a8f61bb48f8a963c9480e53c168 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e5256d91808b47c195bc9b4dbd7f2b87 in current term 15: Already voted for candidate e61c3a8f61bb48f8a963c9480e53c168 in this term.
I20260709 13:07:13.714490 19559 raft_consensus.cc:1240] T 40e1e16737a842ee936002830f36882e P e61c3a8f61bb48f8a963c9480e53c168 [term 22 FOLLOWER]: Rejecting Update request from peer e5256d91808b47c195bc9b4dbd7f2b87 for earlier term 21. Current term is 22. Ops: [21.12-21.12]
I20260709 13:07:13.680233 26033 raft_consensus.cc:697] T 0cdf56e38bbc453d9438d359e5a69955 P 0473d2b2d01f4459b1e90fd12cc7840e [term 19 LEADER]: Becoming Leader. State: Replica: 0473d2b2d01f4459b1e90fd12cc7840e, State: Running, Role: LEADER
I20260709 13:07:13.723258 19377 leader_election.cc:304] T 309c3ca0ca4b4f3ba129752ea2cb293b P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, 127766fc592545a4997f7790f50f6076
I20260709 13:07:13.724763 19377 leader_election.cc:304] T 7f575b143b844aa096b50997dad3516a P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87; no voters: e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:07:13.725728 19374 leader_election.cc:400] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 21 election: Vote denied by peer 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121) with higher term. Message: Invalid argument: T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P 127766fc592545a4997f7790f50f6076 [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate e5256d91808b47c195bc9b4dbd7f2b87 for earlier term 21. Current term is 22.
I20260709 13:07:13.726158 19374 leader_election.cc:403] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 21 election: Cancelling election due to peer responding with higher term
I20260709 13:07:13.715402 19450 leader_election.cc:304] T 40e1e16737a842ee936002830f36882e P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168; no voters: e5256d91808b47c195bc9b4dbd7f2b87
W20260709 13:07:13.739449 19375 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.3:36891, user_credentials={real_user=slave}} blocked reactor thread for 52872.3us
I20260709 13:07:13.746028 19560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e36a9d6e29c4a7c860cf267efbd4c74" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:07:13.746833 19560 raft_consensus.cc:3060] T 2e36a9d6e29c4a7c860cf267efbd4c74 P e61c3a8f61bb48f8a963c9480e53c168 [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:07:13.748241 20076 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:13.707965 25957 raft_consensus.cc:3055] T 1dc5b3532fe54f74876d02beffa2c230 P 0473d2b2d01f4459b1e90fd12cc7840e [term 21 LEADER]: Stepping down as leader of term 21
I20260709 13:07:13.754148 19407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76cb037fc9064d13b59a8969d897ce8c" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:07:13.756814 19555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ece3db938bc649d4a40a51522ed5259c" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:07:13.757287 19377 leader_election.cc:304] T 2725d2c4cb054f18b0fc8f735c15f6c2 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168
W20260709 13:07:13.751263 19523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.1:40321, user_credentials={real_user=slave}} blocked reactor thread for 295185us
I20260709 13:07:13.757537 19555 raft_consensus.cc:2393] T ece3db938bc649d4a40a51522ed5259c P e61c3a8f61bb48f8a963c9480e53c168 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate e5256d91808b47c195bc9b4dbd7f2b87 in current term 15: Already voted for candidate e61c3a8f61bb48f8a963c9480e53c168 in this term.
I20260709 13:07:13.758848 19523 leader_election.cc:304] T a08760e15aac4630a629431f56024dc8 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e61c3a8f61bb48f8a963c9480e53c168; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87
W20260709 13:07:13.753311 19526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.2:46257, user_credentials={real_user=slave}} blocked reactor thread for 300212us
I20260709 13:07:13.754772 19407 raft_consensus.cc:2468] T 76cb037fc9064d13b59a8969d897ce8c P e5256d91808b47c195bc9b4dbd7f2b87 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 19.
I20260709 13:07:13.765842 19523 leader_election.cc:304] T e381f1d6b8184797ad142de49be225a8 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168; no voters: 0473d2b2d01f4459b1e90fd12cc7840e
I20260709 13:07:13.770530 25093 raft_consensus.cc:2804] T 7f575b143b844aa096b50997dad3516a P e5256d91808b47c195bc9b4dbd7f2b87 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:07:13.679095 26216 consensus_queue.cc:1048] T 9962423cb4e54fcfa5de01daf68a86e7 P 127766fc592545a4997f7790f50f6076 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.065s
I20260709 13:07:13.770942 25093 raft_consensus.cc:493] T 7f575b143b844aa096b50997dad3516a P e5256d91808b47c195bc9b4dbd7f2b87 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:13.771057 19555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e381f1d6b8184797ad142de49be225a8" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 18 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:07:13.771528 25093 raft_consensus.cc:3060] T 7f575b143b844aa096b50997dad3516a P e5256d91808b47c195bc9b4dbd7f2b87 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:07:13.770836 19559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "833a2f0775ed407a94b8924ce50adb63" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:07:13.771817 19555 raft_consensus.cc:2393] T e381f1d6b8184797ad142de49be225a8 P e61c3a8f61bb48f8a963c9480e53c168 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate e5256d91808b47c195bc9b4dbd7f2b87 in current term 18: Already voted for candidate 0473d2b2d01f4459b1e90fd12cc7840e in this term.
I20260709 13:07:13.772235 19559 raft_consensus.cc:2393] T 833a2f0775ed407a94b8924ce50adb63 P e61c3a8f61bb48f8a963c9480e53c168 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate e5256d91808b47c195bc9b4dbd7f2b87 in current term 16: Already voted for candidate 127766fc592545a4997f7790f50f6076 in this term.
I20260709 13:07:13.774564 19403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "775c229504194560ba9589bc2199b089" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:07:13.775343 19523 leader_election.cc:304] T 28af091831594f9d8e96482078cc7625 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e61c3a8f61bb48f8a963c9480e53c168; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:07:13.776031 20105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "775c229504194560ba9589bc2199b089" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:07:13.777189 19523 leader_election.cc:304] T 1dc5b3532fe54f74876d02beffa2c230 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168; no voters: 0473d2b2d01f4459b1e90fd12cc7840e
I20260709 13:07:13.777082 19408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46c5bfeecc314717bffe987e6844b6d0" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 26 candidate_status { last_received { term: 25 index: 13 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:07:13.785228 19450 leader_election.cc:304] T 4509b76741dc428e9201c70c1658da13 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168; no voters: e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:07:13.750384 26069 raft_consensus.cc:2749] T 309c3ca0ca4b4f3ba129752ea2cb293b P e5256d91808b47c195bc9b4dbd7f2b87 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:07:13.788630 19377 leader_election.cc:304] T 3e1f505cb0f1427bbd698ac889d80821 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:07:13.789239 19482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0afb57ae58a24a01850491d69f0213dd" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:07:13.754361 25957 raft_consensus.cc:740] T 1dc5b3532fe54f74876d02beffa2c230 P 0473d2b2d01f4459b1e90fd12cc7840e [term 21 LEADER]: Becoming Follower/Learner. State: Replica: 0473d2b2d01f4459b1e90fd12cc7840e, State: Running, Role: LEADER
I20260709 13:07:13.784731 26162 raft_consensus.cc:493] T ed7fdbcb96d14d418db9ca90a792588a P 0473d2b2d01f4459b1e90fd12cc7840e [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:13.764885 25905 raft_consensus.cc:493] T ff9b0eddd810459b82d91c60777c10eb P 127766fc592545a4997f7790f50f6076 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader e5256d91808b47c195bc9b4dbd7f2b87)
I20260709 13:07:13.774349 26228 raft_consensus.cc:2749] T a08760e15aac4630a629431f56024dc8 P e61c3a8f61bb48f8a963c9480e53c168 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:07:13.801443 19450 leader_election.cc:304] T 1efebf73c86e432baa55533136b6e12c P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168; no voters: 127766fc592545a4997f7790f50f6076
I20260709 13:07:13.825376 25376 raft_consensus.cc:2804] T 1efebf73c86e432baa55533136b6e12c P 0473d2b2d01f4459b1e90fd12cc7840e [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:07:13.825829 25376 raft_consensus.cc:493] T 1efebf73c86e432baa55533136b6e12c P 0473d2b2d01f4459b1e90fd12cc7840e [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:13.816262 19560 raft_consensus.cc:2468] T 2e36a9d6e29c4a7c860cf267efbd4c74 P e61c3a8f61bb48f8a963c9480e53c168 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 15.
I20260709 13:07:13.826253 25376 raft_consensus.cc:3060] T 1efebf73c86e432baa55533136b6e12c P 0473d2b2d01f4459b1e90fd12cc7840e [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:07:13.775606 26117 raft_consensus.cc:493] T 85c494af21f9457a85da47b9bc70c1fd P e5256d91808b47c195bc9b4dbd7f2b87 [term 18 FOLLOWER]: Starting leader election (detected failure of leader 127766fc592545a4997f7790f50f6076)
I20260709 13:07:13.826402 19450 leader_election.cc:304] T fa8650e71aa14778b3d73721fc50d9fc P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e; no voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:07:13.831764 25975 raft_consensus.cc:3060] T 2725d2c4cb054f18b0fc8f735c15f6c2 P 0473d2b2d01f4459b1e90fd12cc7840e [term 19 FOLLOWER]: Advancing to term 20
W20260709 13:07:13.832952 20075 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:13.833756 26245 raft_consensus.cc:2749] T fa8650e71aa14778b3d73721fc50d9fc P 0473d2b2d01f4459b1e90fd12cc7840e [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 13:07:13.836338 25923 raft_consensus.cc:2749] T 3e1f505cb0f1427bbd698ac889d80821 P e5256d91808b47c195bc9b4dbd7f2b87 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:07:13.827746 25905 raft_consensus.cc:515] T ff9b0eddd810459b82d91c60777c10eb P 127766fc592545a4997f7790f50f6076 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:07:13.770088 26033 consensus_queue.cc:237] T 0cdf56e38bbc453d9438d359e5a69955 P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.12, Last appended by leader: 12, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:07:13.785167 25851 raft_consensus.cc:2764] T e381f1d6b8184797ad142de49be225a8 P e61c3a8f61bb48f8a963c9480e53c168 [term 18 FOLLOWER]: Leader pre-election decision vote started in defunct term 17: won
I20260709 13:07:13.818611 25093 raft_consensus.cc:515] T 7f575b143b844aa096b50997dad3516a P e5256d91808b47c195bc9b4dbd7f2b87 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:07:13.789216 26133 raft_consensus.cc:2804] T 1dc5b3532fe54f74876d02beffa2c230 P e61c3a8f61bb48f8a963c9480e53c168 [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:07:13.788280 26240 raft_consensus.cc:2749] T 28af091831594f9d8e96482078cc7625 P e61c3a8f61bb48f8a963c9480e53c168 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:07:13.816980 26207 raft_consensus.cc:2804] T 4509b76741dc428e9201c70c1658da13 P 0473d2b2d01f4459b1e90fd12cc7840e [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:07:13.840173 19450 leader_election.cc:304] T 22196caba61445d3bec98a0aab3c337d P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e; no voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:07:13.819880 19523 leader_election.cc:304] T ff75a1d4cb1f493db8f71ddc136ba9ab P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e61c3a8f61bb48f8a963c9480e53c168; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:07:13.828615 19377 leader_election.cc:400] T 14935b3ddf914369822e4a0547aaa355 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 14 pre-election: Vote denied by peer 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257) with higher term. Message: Invalid argument: T 14935b3ddf914369822e4a0547aaa355 P 0473d2b2d01f4459b1e90fd12cc7840e [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e5256d91808b47c195bc9b4dbd7f2b87 for earlier term 14. Current term is 15.
I20260709 13:07:13.819911 19526 leader_election.cc:304] T f93ee515a9c14139bf566522ed8232f3 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168; no voters: e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:07:13.807698 26097 raft_consensus.cc:2749] T 2725d2c4cb054f18b0fc8f735c15f6c2 P e5256d91808b47c195bc9b4dbd7f2b87 [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 13:07:13.866145 25376 raft_consensus.cc:515] T 1efebf73c86e432baa55533136b6e12c P 0473d2b2d01f4459b1e90fd12cc7840e [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:07:13.863329 19377 leader_election.cc:304] T 14efcc79969f41babe5529c22d59156d P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, 127766fc592545a4997f7790f50f6076
I20260709 13:07:13.800760 26001 raft_consensus.cc:2749] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P e5256d91808b47c195bc9b4dbd7f2b87 [term 22 FOLLOWER]: Leader election lost for term 21. Reason: Vote denied by peer 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121) with higher term. Message: Invalid argument: T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P 127766fc592545a4997f7790f50f6076 [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate e5256d91808b47c195bc9b4dbd7f2b87 for earlier term 21. Current term is 22.
I20260709 13:07:13.870038 19377 leader_election.cc:304] T bc225c93219c45538b53a1bd3d387e4d P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:07:13.824044 25925 raft_consensus.cc:493] T 172b3dd13109415a955b71ac0e9d2234 P e5256d91808b47c195bc9b4dbd7f2b87 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 0473d2b2d01f4459b1e90fd12cc7840e)
W20260709 13:07:13.870234 19523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.1:40321, user_credentials={real_user=slave}} blocked reactor thread for 50489.4us
I20260709 13:07:13.790563 26192 consensus_queue.cc:1048] T 4509b76741dc428e9201c70c1658da13 P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.073s
W20260709 13:07:13.871328 19526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.2:46257, user_credentials={real_user=slave}} blocked reactor thread for 51539.5us
I20260709 13:07:13.884828 25376 leader_election.cc:290] T 1efebf73c86e432baa55533136b6e12c P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 17 election: Requested vote from peers e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:07:13.861795 26207 raft_consensus.cc:493] T 4509b76741dc428e9201c70c1658da13 P 0473d2b2d01f4459b1e90fd12cc7840e [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:13.827991 25993 raft_consensus.cc:493] T df751f992649444090e27965eb1af85d P e5256d91808b47c195bc9b4dbd7f2b87 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 0473d2b2d01f4459b1e90fd12cc7840e)
I20260709 13:07:13.829568 26117 raft_consensus.cc:3060] T 85c494af21f9457a85da47b9bc70c1fd P e5256d91808b47c195bc9b4dbd7f2b87 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:07:13.876588 19523 leader_election.cc:304] T ece3db938bc649d4a40a51522ed5259c P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:07:13.784878 26246 raft_consensus.cc:2804] T 40e1e16737a842ee936002830f36882e P 0473d2b2d01f4459b1e90fd12cc7840e [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:07:13.878579 19377 leader_election.cc:304] T 22196caba61445d3bec98a0aab3c337d P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:07:13.880798 19450 leader_election.cc:304] T 62c6c134d3d24a1ab144dd9ee6bc3f64 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e; no voters: 127766fc592545a4997f7790f50f6076, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:07:13.888159 26069 consensus_queue.cc:1048] T 4509b76741dc428e9201c70c1658da13 P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
W20260709 13:07:13.889328 19374 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.4:43121, user_credentials={real_user=slave}} blocked reactor thread for 176445us
I20260709 13:07:13.860875 26133 raft_consensus.cc:697] T 1dc5b3532fe54f74876d02beffa2c230 P e61c3a8f61bb48f8a963c9480e53c168 [term 22 LEADER]: Becoming Leader. State: Replica: e61c3a8f61bb48f8a963c9480e53c168, State: Running, Role: LEADER
I20260709 13:07:13.872937 26160 raft_consensus.cc:2749] T ff75a1d4cb1f493db8f71ddc136ba9ab P e61c3a8f61bb48f8a963c9480e53c168 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:07:13.829411 26162 raft_consensus.cc:515] T ed7fdbcb96d14d418db9ca90a792588a P 0473d2b2d01f4459b1e90fd12cc7840e [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:07:13.895502 26207 raft_consensus.cc:3060] T 4509b76741dc428e9201c70c1658da13 P 0473d2b2d01f4459b1e90fd12cc7840e [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:07:13.788921 26151 consensus_queue.cc:1059] T 217b5fae677b4971b3bbd2f357a1f7ff P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.091s
I20260709 13:07:13.907986 19450 leader_election.cc:304] T ff75a1d4cb1f493db8f71ddc136ba9ab P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e; no voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:07:13.882129 26243 raft_consensus.cc:2804] T f93ee515a9c14139bf566522ed8232f3 P e61c3a8f61bb48f8a963c9480e53c168 [term 23 FOLLOWER]: Leader election won for term 23
I20260709 13:07:13.873247 26142 raft_consensus.cc:2749] T 14efcc79969f41babe5529c22d59156d P e5256d91808b47c195bc9b4dbd7f2b87 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:07:13.908987 26240 raft_consensus.cc:493] T 0e1085d23e8347fbbd5bce7542f4b1f4 P e61c3a8f61bb48f8a963c9480e53c168 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:13.941933 26240 raft_consensus.cc:515] T 0e1085d23e8347fbbd5bce7542f4b1f4 P e61c3a8f61bb48f8a963c9480e53c168 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:07:13.942057 26142 consensus_queue.cc:1048] T 7be9efa6559648dbb5a0f7684c4542d1 P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:07:13.944201 26240 leader_election.cc:290] T 0e1085d23e8347fbbd5bce7542f4b1f4 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:07:13.944854 26142 raft_consensus.cc:3060] T 22196caba61445d3bec98a0aab3c337d P e5256d91808b47c195bc9b4dbd7f2b87 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:07:13.911156 25376 raft_consensus.cc:493] T 0e1085d23e8347fbbd5bce7542f4b1f4 P 0473d2b2d01f4459b1e90fd12cc7840e [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:13.945593 25376 raft_consensus.cc:515] T 0e1085d23e8347fbbd5bce7542f4b1f4 P 0473d2b2d01f4459b1e90fd12cc7840e [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:07:13.947443 25376 leader_election.cc:290] T 0e1085d23e8347fbbd5bce7542f4b1f4 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:07:13.911691 20076 leader_election.cc:304] T ed7fdbcb96d14d418db9ca90a792588a P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 127766fc592545a4997f7790f50f6076; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:07:13.949491 20076 leader_election.cc:304] T 833a2f0775ed407a94b8924ce50adb63 P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 127766fc592545a4997f7790f50f6076, e61c3a8f61bb48f8a963c9480e53c168; no voters: e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:07:13.950829 26119 raft_consensus.cc:2749] T ed7fdbcb96d14d418db9ca90a792588a P 127766fc592545a4997f7790f50f6076 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:07:13.950990 20103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0afb57ae58a24a01850491d69f0213dd" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:07:13.951609 26119 consensus_queue.cc:1048] T 1efebf73c86e432baa55533136b6e12c P 127766fc592545a4997f7790f50f6076 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:07:13.953161 26119 raft_consensus.cc:2804] T 833a2f0775ed407a94b8924ce50adb63 P 127766fc592545a4997f7790f50f6076 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:07:13.953681 26119 raft_consensus.cc:697] T 833a2f0775ed407a94b8924ce50adb63 P 127766fc592545a4997f7790f50f6076 [term 16 LEADER]: Becoming Leader. State: Replica: 127766fc592545a4997f7790f50f6076, State: Running, Role: LEADER
I20260709 13:07:13.877960 26191 consensus_queue.cc:1059] T fa8650e71aa14778b3d73721fc50d9fc P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.036s
I20260709 13:07:13.956828 26151 raft_consensus.cc:3055] T 217b5fae677b4971b3bbd2f357a1f7ff P e61c3a8f61bb48f8a963c9480e53c168 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:07:13.957278 26151 raft_consensus.cc:740] T 217b5fae677b4971b3bbd2f357a1f7ff P e61c3a8f61bb48f8a963c9480e53c168 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: e61c3a8f61bb48f8a963c9480e53c168, State: Running, Role: LEADER
I20260709 13:07:13.958082 26151 consensus_queue.cc:260] T 217b5fae677b4971b3bbd2f357a1f7ff P e61c3a8f61bb48f8a963c9480e53c168 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.10, Last appended by leader: 10, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:07:13.959438 26151 raft_consensus.cc:3060] T 217b5fae677b4971b3bbd2f357a1f7ff P e61c3a8f61bb48f8a963c9480e53c168 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:07:13.912599 26017 raft_consensus.cc:2749] T 62c6c134d3d24a1ab144dd9ee6bc3f64 P 0473d2b2d01f4459b1e90fd12cc7840e [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:07:13.954583 26119 consensus_queue.cc:237] T 833a2f0775ed407a94b8924ce50adb63 P 127766fc592545a4997f7790f50f6076 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:07:13.966383 26133 consensus_queue.cc:237] T 1dc5b3532fe54f74876d02beffa2c230 P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 20.11, Last appended by leader: 11, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:07:13.913838 26244 raft_consensus.cc:2804] T ece3db938bc649d4a40a51522ed5259c P e61c3a8f61bb48f8a963c9480e53c168 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:07:13.968194 26244 raft_consensus.cc:493] T ece3db938bc649d4a40a51522ed5259c P e61c3a8f61bb48f8a963c9480e53c168 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:13.968559 26244 raft_consensus.cc:3060] T ece3db938bc649d4a40a51522ed5259c P e61c3a8f61bb48f8a963c9480e53c168 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:07:13.970456 26243 raft_consensus.cc:697] T f93ee515a9c14139bf566522ed8232f3 P e61c3a8f61bb48f8a963c9480e53c168 [term 23 LEADER]: Becoming Leader. State: Replica: e61c3a8f61bb48f8a963c9480e53c168, State: Running, Role: LEADER
I20260709 13:07:13.971719 26243 consensus_queue.cc:237] T f93ee515a9c14139bf566522ed8232f3 P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 22.11, Last appended by leader: 11, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:07:13.892234 25957 consensus_queue.cc:260] T 1dc5b3532fe54f74876d02beffa2c230 P 0473d2b2d01f4459b1e90fd12cc7840e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 21.12, Last appended by leader: 12, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:07:13.975876 25957 raft_consensus.cc:3060] T 1dc5b3532fe54f74876d02beffa2c230 P 0473d2b2d01f4459b1e90fd12cc7840e [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:07:13.980964 26154 raft_consensus.cc:3055] T fa8650e71aa14778b3d73721fc50d9fc P e5256d91808b47c195bc9b4dbd7f2b87 [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:07:13.981513 26154 raft_consensus.cc:740] T fa8650e71aa14778b3d73721fc50d9fc P e5256d91808b47c195bc9b4dbd7f2b87 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: e5256d91808b47c195bc9b4dbd7f2b87, State: Running, Role: LEADER
I20260709 13:07:13.882151 25925 raft_consensus.cc:515] T 172b3dd13109415a955b71ac0e9d2234 P e5256d91808b47c195bc9b4dbd7f2b87 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:07:13.933878 20107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c5eebf646ad445a9d1b1adc319d7b16" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:07:13.894024 26106 raft_consensus.cc:2749] T 22196caba61445d3bec98a0aab3c337d P 0473d2b2d01f4459b1e90fd12cc7840e [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 13:07:13.907711 25905 leader_election.cc:290] T ff9b0eddd810459b82d91c60777c10eb P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:07:13.908190 26001 consensus_queue.cc:1048] T f1b10566f45d4a7d9029858330e02d5b P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.078s
I20260709 13:07:13.939873 26245 raft_consensus.cc:2749] T ff75a1d4cb1f493db8f71ddc136ba9ab P 0473d2b2d01f4459b1e90fd12cc7840e [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
W20260709 13:07:13.941007 26251 log.cc:927] Time spent T 7be9efa6559648dbb5a0f7684c4542d1 P 127766fc592545a4997f7790f50f6076: Append to log took a long time: real 0.115s	user 0.000s	sys 0.000s
I20260709 13:07:13.909857 19523 leader_election.cc:304] T 48824d5acfbc485ebf8c2d944e7202de P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e61c3a8f61bb48f8a963c9480e53c168; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, 127766fc592545a4997f7790f50f6076
W20260709 13:07:13.895694 19375 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.3:36891, user_credentials={real_user=slave}} blocked reactor thread for 153032us
I20260709 13:07:13.932072 20105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa731b585f684a7fb2d106c50f143b83" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:07:13.911063 26246 raft_consensus.cc:493] T 40e1e16737a842ee936002830f36882e P 0473d2b2d01f4459b1e90fd12cc7840e [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:13.933040 20106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7be9efa6559648dbb5a0f7684c4542d1" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
W20260709 13:07:13.987146 19450 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.3:36891, user_credentials={real_user=slave}} blocked reactor thread for 48948.3us
I20260709 13:07:13.883581 25923 consensus_queue.cc:1048] T 40e1e16737a842ee936002830f36882e P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.053s
W20260709 13:07:14.003006 19377 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.2:46257, user_credentials={real_user=slave}} blocked reactor thread for 124508us
W20260709 13:07:14.002890 19523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.4:43121, user_credentials={real_user=slave}} blocked reactor thread for 93104.4us
I20260709 13:07:14.002898 19450 leader_election.cc:304] T e381f1d6b8184797ad142de49be225a8 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168; no voters: e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:07:14.013804 19557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa731b585f684a7fb2d106c50f143b83" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:07:13.872260 25093 leader_election.cc:290] T 7f575b143b844aa096b50997dad3516a P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 18 election: Requested vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:07:13.898497 25993 raft_consensus.cc:515] T df751f992649444090e27965eb1af85d P e5256d91808b47c195bc9b4dbd7f2b87 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:07:14.028867 19450 leader_election.cc:304] T ab43d85f64114d4ebf618930e43d9ed0 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168; no voters: 127766fc592545a4997f7790f50f6076
I20260709 13:07:14.032249 20076 leader_election.cc:304] T fa731b585f684a7fb2d106c50f143b83 P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 127766fc592545a4997f7790f50f6076; no voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:07:14.034473 20110 raft_consensus.cc:2468] T ece3db938bc649d4a40a51522ed5259c P 127766fc592545a4997f7790f50f6076 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 15.
I20260709 13:07:14.010885 19555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c5eebf646ad445a9d1b1adc319d7b16" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:07:13.994293 25871 raft_consensus.cc:493] T 179fd671030940b4b4a4e24bcc4aba0a P 0473d2b2d01f4459b1e90fd12cc7840e [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:14.038400 19555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1efebf73c86e432baa55533136b6e12c" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 17 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:07:14.043644 25093 consensus_queue.cc:1048] T 7be9efa6559648dbb5a0f7684c4542d1 P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:07:14.048020 19557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46c5bfeecc314717bffe987e6844b6d0" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 26 candidate_status { last_received { term: 25 index: 13 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:07:14.053794 19560 raft_consensus.cc:1275] T 0e1085d23e8347fbbd5bce7542f4b1f4 P e61c3a8f61bb48f8a963c9480e53c168 [term 16 FOLLOWER]: Refusing update from remote peer 127766fc592545a4997f7790f50f6076: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 13:07:13.982398 26154 consensus_queue.cc:260] T fa8650e71aa14778b3d73721fc50d9fc P e5256d91808b47c195bc9b4dbd7f2b87 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 20.11, Last appended by leader: 11, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
W20260709 13:07:14.055481 19374 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.4:43121, user_credentials={real_user=slave}} blocked reactor thread for 145971us
I20260709 13:07:14.028538 26240 raft_consensus.cc:2749] T 48824d5acfbc485ebf8c2d944e7202de P e61c3a8f61bb48f8a963c9480e53c168 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:07:14.005216 26246 raft_consensus.cc:3060] T 40e1e16737a842ee936002830f36882e P 0473d2b2d01f4459b1e90fd12cc7840e [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:07:14.041797 26017 raft_consensus.cc:2804] T ab43d85f64114d4ebf618930e43d9ed0 P 0473d2b2d01f4459b1e90fd12cc7840e [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:07:14.042201 26245 raft_consensus.cc:2804] T e381f1d6b8184797ad142de49be225a8 P 0473d2b2d01f4459b1e90fd12cc7840e [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:07:14.064766 19557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e1085d23e8347fbbd5bce7542f4b1f4" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:07:14.073625 19481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "217b5fae677b4971b3bbd2f357a1f7ff" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:07:14.074246 19481 raft_consensus.cc:3060] T 217b5fae677b4971b3bbd2f357a1f7ff P 0473d2b2d01f4459b1e90fd12cc7840e [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:07:14.075466 19480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e381f1d6b8184797ad142de49be225a8" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 18 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:07:14.075474 19483 raft_consensus.cc:1275] T 2b74109013a140ada21feeef92d6f563 P 0473d2b2d01f4459b1e90fd12cc7840e [term 18 FOLLOWER]: Refusing update from remote peer e5256d91808b47c195bc9b4dbd7f2b87: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 18 index: 10. (index mismatch)
I20260709 13:07:14.070179 19410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff9b0eddd810459b82d91c60777c10eb" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:07:14.068514 19557 raft_consensus.cc:2468] T 0e1085d23e8347fbbd5bce7542f4b1f4 P e61c3a8f61bb48f8a963c9480e53c168 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 16.
I20260709 13:07:14.058889 26160 raft_consensus.cc:493] T ed7fdbcb96d14d418db9ca90a792588a P e61c3a8f61bb48f8a963c9480e53c168 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:14.109041 19479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e36a9d6e29c4a7c860cf267efbd4c74" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:07:14.109683 19479 raft_consensus.cc:3060] T 2e36a9d6e29c4a7c860cf267efbd4c74 P 0473d2b2d01f4459b1e90fd12cc7840e [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:07:14.112906 19483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c5eebf646ad445a9d1b1adc319d7b16" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:07:14.113996 19483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff9b0eddd810459b82d91c60777c10eb" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:07:14.114521 19483 raft_consensus.cc:2468] T ff9b0eddd810459b82d91c60777c10eb P 0473d2b2d01f4459b1e90fd12cc7840e [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 127766fc592545a4997f7790f50f6076 in term 20.
I20260709 13:07:14.117591 19477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21e14947d70440f19044d8f75c31e1f9" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 20 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:07:14.118222 19477 raft_consensus.cc:2393] T 21e14947d70440f19044d8f75c31e1f9 P 0473d2b2d01f4459b1e90fd12cc7840e [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate e5256d91808b47c195bc9b4dbd7f2b87 in current term 20: Already voted for candidate e61c3a8f61bb48f8a963c9480e53c168 in this term.
I20260709 13:07:14.049700 25871 raft_consensus.cc:515] T 179fd671030940b4b4a4e24bcc4aba0a P 0473d2b2d01f4459b1e90fd12cc7840e [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:07:14.134796 19482 raft_consensus.cc:1275] T edd7d470b5014c9489be7f41f64355c9 P 0473d2b2d01f4459b1e90fd12cc7840e [term 24 FOLLOWER]: Refusing update from remote peer e5256d91808b47c195bc9b4dbd7f2b87: Log matching property violated. Preceding OpId in replica: term: 22 index: 12. Preceding OpId from leader: term: 24 index: 13. (index mismatch)
I20260709 13:07:14.132884 19486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f575b143b844aa096b50997dad3516a" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:07:14.136308 19486 raft_consensus.cc:3060] T 7f575b143b844aa096b50997dad3516a P 0473d2b2d01f4459b1e90fd12cc7840e [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:07:14.065873 26017 raft_consensus.cc:493] T ab43d85f64114d4ebf618930e43d9ed0 P 0473d2b2d01f4459b1e90fd12cc7840e [term 21 FOLLOWER]: Starting leader election (detected failure of leader 127766fc592545a4997f7790f50f6076)
W20260709 13:07:14.137874 20076 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.3:36891, user_credentials={real_user=slave}} blocked reactor thread for 105703us
I20260709 13:07:14.092067 26154 raft_consensus.cc:3060] T fa8650e71aa14778b3d73721fc50d9fc P e5256d91808b47c195bc9b4dbd7f2b87 [term 20 FOLLOWER]: Advancing to term 21
W20260709 13:07:14.125880 25747 consensus_meta.cc:287] T 22196caba61445d3bec98a0aab3c337d P e61c3a8f61bb48f8a963c9480e53c168: Time spent flushing consensus metadata: real 0.526s	user 0.010s	sys 0.000s
I20260709 13:07:14.055297 26262 consensus_queue.cc:1048] T 2b74109013a140ada21feeef92d6f563 P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.075s
W20260709 13:07:14.142001 20078 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.2:46257, user_credentials={real_user=slave}} blocked reactor thread for 108136us
I20260709 13:07:14.141122 19483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "309c3ca0ca4b4f3ba129752ea2cb293b" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:07:14.099512 26216 raft_consensus.cc:2749] T fa731b585f684a7fb2d106c50f143b83 P 127766fc592545a4997f7790f50f6076 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:07:14.108160 26245 raft_consensus.cc:697] T e381f1d6b8184797ad142de49be225a8 P 0473d2b2d01f4459b1e90fd12cc7840e [term 18 LEADER]: Becoming Leader. State: Replica: 0473d2b2d01f4459b1e90fd12cc7840e, State: Running, Role: LEADER
I20260709 13:07:14.145781 19479 raft_consensus.cc:2468] T 2e36a9d6e29c4a7c860cf267efbd4c74 P 0473d2b2d01f4459b1e90fd12cc7840e [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 15.
I20260709 13:07:14.145813 19481 raft_consensus.cc:2468] T 217b5fae677b4971b3bbd2f357a1f7ff P 0473d2b2d01f4459b1e90fd12cc7840e [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 17.
I20260709 13:07:14.147882 19477 raft_consensus.cc:1240] T 1efebf73c86e432baa55533136b6e12c P 0473d2b2d01f4459b1e90fd12cc7840e [term 17 FOLLOWER]: Rejecting Update request from peer 127766fc592545a4997f7790f50f6076 for earlier term 16. Current term is 17. Ops: [16.13-16.13]
W20260709 13:07:14.138226 19375 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.3:36891, user_credentials={real_user=slave}} blocked reactor thread for 100524us
I20260709 13:07:14.165102 19375 leader_election.cc:304] T 833a2f0775ed407a94b8924ce50adb63 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87; no voters: 127766fc592545a4997f7790f50f6076, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:07:14.066514 26263 consensus_queue.cc:1048] T edd7d470b5014c9489be7f41f64355c9 P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.081s
I20260709 13:07:14.140357 26017 raft_consensus.cc:3060] T ab43d85f64114d4ebf618930e43d9ed0 P 0473d2b2d01f4459b1e90fd12cc7840e [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:07:14.168948 19479 raft_consensus.cc:1275] T 9962423cb4e54fcfa5de01daf68a86e7 P 0473d2b2d01f4459b1e90fd12cc7840e [term 19 FOLLOWER]: Refusing update from remote peer 127766fc592545a4997f7790f50f6076: Log matching property violated. Preceding OpId in replica: term: 17 index: 12. Preceding OpId from leader: term: 19 index: 13. (index mismatch)
I20260709 13:07:14.173174 19483 raft_consensus.cc:1240] T 14935b3ddf914369822e4a0547aaa355 P 0473d2b2d01f4459b1e90fd12cc7840e [term 15 LEADER]: Rejecting Update request from peer 127766fc592545a4997f7790f50f6076 for earlier term 14. Current term is 15. Ops: [14.11-14.11]
I20260709 13:07:14.174544 19556 raft_consensus.cc:1240] T 1dc5b3532fe54f74876d02beffa2c230 P e61c3a8f61bb48f8a963c9480e53c168 [term 22 LEADER]: Rejecting Update request from peer 0473d2b2d01f4459b1e90fd12cc7840e for earlier term 21. Current term is 22. Ops: []
I20260709 13:07:14.181005 19486 raft_consensus.cc:2468] T 7f575b143b844aa096b50997dad3516a P 0473d2b2d01f4459b1e90fd12cc7840e [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 18.
I20260709 13:07:14.166175 19375 leader_election.cc:304] T 2e36a9d6e29c4a7c860cf267efbd4c74 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:07:14.124321 26160 raft_consensus.cc:515] T ed7fdbcb96d14d418db9ca90a792588a P e61c3a8f61bb48f8a963c9480e53c168 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:07:14.142648 26001 consensus_queue.cc:1059] T 40e1e16737a842ee936002830f36882e P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 }, Status: INVALID_TERM, Last received: 20.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.051s
W20260709 13:07:14.207304 19377 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.2:46257, user_credentials={real_user=slave}} blocked reactor thread for 172963us
I20260709 13:07:14.144281 26267 consensus_queue.cc:1048] T 4af19371ea874c09a0a2147040835cbb P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.064s
I20260709 13:07:14.149339 19450 leader_election.cc:304] T 0e1085d23e8347fbbd5bce7542f4b1f4 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:07:14.210886 26162 leader_election.cc:290] T ed7fdbcb96d14d418db9ca90a792588a P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:07:14.251427 18300 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
W20260709 13:07:14.258497 19526 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:14.245970 25925 leader_election.cc:290] T 172b3dd13109415a955b71ac0e9d2234 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:07:14.244808 26276 consensus_queue.cc:1048] T 0e1085d23e8347fbbd5bce7542f4b1f4 P 127766fc592545a4997f7790f50f6076 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.042s
I20260709 13:07:14.258220 26263 raft_consensus.cc:2749] T 833a2f0775ed407a94b8924ce50adb63 P e5256d91808b47c195bc9b4dbd7f2b87 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:07:14.262471 26162 raft_consensus.cc:2804] T 0e1085d23e8347fbbd5bce7542f4b1f4 P 0473d2b2d01f4459b1e90fd12cc7840e [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:07:14.300626 26244 raft_consensus.cc:515] T ece3db938bc649d4a40a51522ed5259c P e61c3a8f61bb48f8a963c9480e53c168 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:07:14.274267 26266 raft_consensus.cc:2804] T 2e36a9d6e29c4a7c860cf267efbd4c74 P e5256d91808b47c195bc9b4dbd7f2b87 [term 15 FOLLOWER]: Leader election won for term 15
W20260709 13:07:14.328912 20075 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:14.305233 26117 raft_consensus.cc:515] T 85c494af21f9457a85da47b9bc70c1fd P e5256d91808b47c195bc9b4dbd7f2b87 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:07:14.266601 26275 raft_consensus.cc:3055] T 40e1e16737a842ee936002830f36882e P e5256d91808b47c195bc9b4dbd7f2b87 [term 21 LEADER]: Stepping down as leader of term 21
I20260709 13:07:14.273932 25993 leader_election.cc:290] T df751f992649444090e27965eb1af85d P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
W20260709 13:07:14.254772 19450 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.3:36891, user_credentials={real_user=slave}} blocked reactor thread for 105600us
I20260709 13:07:14.315537 26207 raft_consensus.cc:515] T 4509b76741dc428e9201c70c1658da13 P 0473d2b2d01f4459b1e90fd12cc7840e [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:07:14.318130 26284 consensus_queue.cc:1048] T ff9b0eddd810459b82d91c60777c10eb P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:07:14.256560 26245 consensus_queue.cc:237] T e381f1d6b8184797ad142de49be225a8 P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:07:14.282992 26162 raft_consensus.cc:493] T 0e1085d23e8347fbbd5bce7542f4b1f4 P 0473d2b2d01f4459b1e90fd12cc7840e [term 16 FOLLOWER]: Starting leader election (detected failure of leader 127766fc592545a4997f7790f50f6076)
I20260709 13:07:14.384130 20078 leader_election.cc:304] T 6c5eebf646ad445a9d1b1adc319d7b16 P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 127766fc592545a4997f7790f50f6076; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:07:14.385977 20078 leader_election.cc:304] T ff9b0eddd810459b82d91c60777c10eb P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, 127766fc592545a4997f7790f50f6076; no voters: 
I20260709 13:07:14.386195 26244 leader_election.cc:290] T ece3db938bc649d4a40a51522ed5259c P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 16 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
W20260709 13:07:14.357774 19375 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.3:36891, user_credentials={real_user=slave}} blocked reactor thread for 191656us
W20260709 13:07:14.367158 26272 log.cc:927] Time spent T 1dc5b3532fe54f74876d02beffa2c230 P e61c3a8f61bb48f8a963c9480e53c168: Append to log took a long time: real 0.099s	user 0.000s	sys 0.000s
W20260709 13:07:14.372426 26250 log.cc:927] Time spent T ef32ce6fdd0e40d382c79974f30295c6 P 0473d2b2d01f4459b1e90fd12cc7840e: Append to log took a long time: real 0.530s	user 0.002s	sys 0.000s
I20260709 13:07:14.372560 26246 raft_consensus.cc:515] T 40e1e16737a842ee936002830f36882e P 0473d2b2d01f4459b1e90fd12cc7840e [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:07:14.375754 19408 raft_consensus.cc:1240] T 85c494af21f9457a85da47b9bc70c1fd P e5256d91808b47c195bc9b4dbd7f2b87 [term 19 FOLLOWER]: Rejecting Update request from peer 127766fc592545a4997f7790f50f6076 for earlier term 18. Current term is 19. Ops: []
I20260709 13:07:14.376859 26117 leader_election.cc:290] T 85c494af21f9457a85da47b9bc70c1fd P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 19 election: Requested vote from peers e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:07:14.377801 26160 leader_election.cc:290] T ed7fdbcb96d14d418db9ca90a792588a P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:07:14.378966 26142 raft_consensus.cc:2749] T 22196caba61445d3bec98a0aab3c337d P e5256d91808b47c195bc9b4dbd7f2b87 [term 20 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:07:14.403853 20078 leader_election.cc:304] T 309c3ca0ca4b4f3ba129752ea2cb293b P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 127766fc592545a4997f7790f50f6076; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:07:14.405423 19554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed7fdbcb96d14d418db9ca90a792588a" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:07:14.357601 26275 raft_consensus.cc:740] T 40e1e16737a842ee936002830f36882e P e5256d91808b47c195bc9b4dbd7f2b87 [term 21 LEADER]: Becoming Follower/Learner. State: Replica: e5256d91808b47c195bc9b4dbd7f2b87, State: Running, Role: LEADER
I20260709 13:07:14.380749 26207 leader_election.cc:290] T 4509b76741dc428e9201c70c1658da13 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 14 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:07:14.356971 26266 raft_consensus.cc:697] T 2e36a9d6e29c4a7c860cf267efbd4c74 P e5256d91808b47c195bc9b4dbd7f2b87 [term 15 LEADER]: Becoming Leader. State: Replica: e5256d91808b47c195bc9b4dbd7f2b87, State: Running, Role: LEADER
I20260709 13:07:14.406102 19554 raft_consensus.cc:2468] T ed7fdbcb96d14d418db9ca90a792588a P e61c3a8f61bb48f8a963c9480e53c168 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 17.
W20260709 13:07:14.363531 26268 log.cc:927] Time spent T 96efeaaf1057492490e9a621f37e1a2d P 0473d2b2d01f4459b1e90fd12cc7840e: Append to log took a long time: real 0.147s	user 0.000s	sys 0.001s
I20260709 13:07:14.386831 26216 raft_consensus.cc:2749] T 6c5eebf646ad445a9d1b1adc319d7b16 P 127766fc592545a4997f7790f50f6076 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:07:14.388738 26162 raft_consensus.cc:3060] T 0e1085d23e8347fbbd5bce7542f4b1f4 P 0473d2b2d01f4459b1e90fd12cc7840e [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:07:14.428543 25376 raft_consensus.cc:993] T 28af091831594f9d8e96482078cc7625 P 0473d2b2d01f4459b1e90fd12cc7840e: : Instructing follower e61c3a8f61bb48f8a963c9480e53c168 to start an election
I20260709 13:07:14.429055 25376 raft_consensus.cc:1081] T 28af091831594f9d8e96482078cc7625 P 0473d2b2d01f4459b1e90fd12cc7840e [term 18 LEADER]: Signalling peer e61c3a8f61bb48f8a963c9480e53c168 to start an election
I20260709 13:07:14.432999 19558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4509b76741dc428e9201c70c1658da13" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:07:14.434005 19558 raft_consensus.cc:2393] T 4509b76741dc428e9201c70c1658da13 P e61c3a8f61bb48f8a963c9480e53c168 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 0473d2b2d01f4459b1e90fd12cc7840e in current term 14: Already voted for candidate e61c3a8f61bb48f8a963c9480e53c168 in this term.
I20260709 13:07:14.415185 26276 raft_consensus.cc:2804] T ff9b0eddd810459b82d91c60777c10eb P 127766fc592545a4997f7790f50f6076 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:07:14.415676 26277 raft_consensus.cc:2749] T 309c3ca0ca4b4f3ba129752ea2cb293b P 127766fc592545a4997f7790f50f6076 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:07:14.467128 26277 consensus_queue.cc:1048] T 9962423cb4e54fcfa5de01daf68a86e7 P 127766fc592545a4997f7790f50f6076 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:07:14.468554 19558 raft_consensus.cc:1275] T 65d8cb8d6ec64f459d5a47cefab10acf P e61c3a8f61bb48f8a963c9480e53c168 [term 21 FOLLOWER]: Refusing update from remote peer e5256d91808b47c195bc9b4dbd7f2b87: Log matching property violated. Preceding OpId in replica: term: 19 index: 12. Preceding OpId from leader: term: 21 index: 13. (index mismatch)
I20260709 13:07:14.474218 19558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f575b143b844aa096b50997dad3516a" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:07:14.475198 19558 raft_consensus.cc:3060] T 7f575b143b844aa096b50997dad3516a P e61c3a8f61bb48f8a963c9480e53c168 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:07:14.448982 26276 raft_consensus.cc:493] T ff9b0eddd810459b82d91c60777c10eb P 127766fc592545a4997f7790f50f6076 [term 20 FOLLOWER]: Starting leader election (detected failure of leader e5256d91808b47c195bc9b4dbd7f2b87)
I20260709 13:07:14.476898 26276 raft_consensus.cc:3060] T ff9b0eddd810459b82d91c60777c10eb P 127766fc592545a4997f7790f50f6076 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:07:14.479034 26266 consensus_queue.cc:237] T 2e36a9d6e29c4a7c860cf267efbd4c74 P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:07:14.435207 25851 raft_consensus.cc:493] T 85c494af21f9457a85da47b9bc70c1fd P e61c3a8f61bb48f8a963c9480e53c168 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 127766fc592545a4997f7790f50f6076)
I20260709 13:07:14.490422 25851 raft_consensus.cc:515] T 85c494af21f9457a85da47b9bc70c1fd P e61c3a8f61bb48f8a963c9480e53c168 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:07:14.492108 19559 raft_consensus.cc:1240] T 4509b76741dc428e9201c70c1658da13 P e61c3a8f61bb48f8a963c9480e53c168 [term 14 FOLLOWER]: Rejecting Update request from peer e5256d91808b47c195bc9b4dbd7f2b87 for earlier term 13. Current term is 14. Ops: [13.8-13.8]
I20260709 13:07:14.492457 25851 leader_election.cc:290] T 85c494af21f9457a85da47b9bc70c1fd P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
W20260709 13:07:14.499639 26258 log.cc:927] Time spent T 1a61655d99124a29b486ba4a5b37faea P e5256d91808b47c195bc9b4dbd7f2b87: Append to log took a long time: real 0.448s	user 0.001s	sys 0.000s
I20260709 13:07:14.415077 25871 leader_election.cc:290] T 179fd671030940b4b4a4e24bcc4aba0a P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:07:14.454617 26246 leader_election.cc:290] T 40e1e16737a842ee936002830f36882e P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 22 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:07:14.462991 26216 consensus_queue.cc:1059] T 1efebf73c86e432baa55533136b6e12c P 127766fc592545a4997f7790f50f6076 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 }, Status: INVALID_TERM, Last received: 14.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:07:14.465879 26275 consensus_queue.cc:260] T 40e1e16737a842ee936002830f36882e P e5256d91808b47c195bc9b4dbd7f2b87 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 21.12, Last appended by leader: 12, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:07:14.467206 26244 raft_consensus.cc:493] T 2b74109013a140ada21feeef92d6f563 P e61c3a8f61bb48f8a963c9480e53c168 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:14.434455 19449 leader_election.cc:304] T 76cb037fc9064d13b59a8969d897ce8c P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87; no voters: e61c3a8f61bb48f8a963c9480e53c168
W20260709 13:07:14.529922 19449 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.1:40321, user_credentials={real_user=slave}} blocked reactor thread for 95555.2us
W20260709 13:07:14.439320 26265 log.cc:927] Time spent T 96efeaaf1057492490e9a621f37e1a2d P 127766fc592545a4997f7790f50f6076: Append to log took a long time: real 0.353s	user 0.002s	sys 0.000s
W20260709 13:07:14.530977 19377 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.2:46257, user_credentials={real_user=slave}} blocked reactor thread for 283806us
I20260709 13:07:14.532966 19551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df751f992649444090e27965eb1af85d" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:07:14.531704 19449 leader_election.cc:304] T 46c5bfeecc314717bffe987e6844b6d0 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e; no voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168
W20260709 13:07:14.509943 20077 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.517s	user 0.003s	sys 0.010s
W20260709 13:07:14.522210 19374 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.4:43121, user_credentials={real_user=slave}} blocked reactor thread for 447627us
I20260709 13:07:14.524837 26160 raft_consensus.cc:493] T 309c3ca0ca4b4f3ba129752ea2cb293b P e61c3a8f61bb48f8a963c9480e53c168 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:14.535554 20077 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.543s	user 0.004s	sys 0.011s
I20260709 13:07:14.536665 19560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85c494af21f9457a85da47b9bc70c1fd" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:07:14.537209 19560 raft_consensus.cc:3060] T 85c494af21f9457a85da47b9bc70c1fd P e61c3a8f61bb48f8a963c9480e53c168 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:07:14.540297 20110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "172b3dd13109415a955b71ac0e9d2234" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:07:14.542840 19410 raft_consensus.cc:1275] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P e5256d91808b47c195bc9b4dbd7f2b87 [term 22 FOLLOWER]: Refusing update from remote peer 127766fc592545a4997f7790f50f6076: Log matching property violated. Preceding OpId in replica: term: 20 index: 16. Preceding OpId from leader: term: 22 index: 17. (index mismatch)
I20260709 13:07:14.543102 25376 raft_consensus.cc:2749] T 46c5bfeecc314717bffe987e6844b6d0 P 0473d2b2d01f4459b1e90fd12cc7840e [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 13:07:14.546916 20107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e1085d23e8347fbbd5bce7542f4b1f4" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:07:14.547605 19526 leader_election.cc:304] T 0afb57ae58a24a01850491d69f0213dd P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e61c3a8f61bb48f8a963c9480e53c168; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, 127766fc592545a4997f7790f50f6076
I20260709 13:07:14.551661 25376 raft_consensus.cc:493] T 3e1f505cb0f1427bbd698ac889d80821 P 0473d2b2d01f4459b1e90fd12cc7840e [term 19 FOLLOWER]: Starting pre-election (detected failure of leader e61c3a8f61bb48f8a963c9480e53c168)
W20260709 13:07:14.553135 19449 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:14.545038 20108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85c494af21f9457a85da47b9bc70c1fd" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076"
I20260709 13:07:14.552277 25376 raft_consensus.cc:515] T 3e1f505cb0f1427bbd698ac889d80821 P 0473d2b2d01f4459b1e90fd12cc7840e [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:07:14.563256 20106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ece3db938bc649d4a40a51522ed5259c" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076"
I20260709 13:07:14.567085 20106 raft_consensus.cc:3060] T ece3db938bc649d4a40a51522ed5259c P 127766fc592545a4997f7790f50f6076 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:07:14.568715 19374 leader_election.cc:304] T ece3db938bc649d4a40a51522ed5259c P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 127766fc592545a4997f7790f50f6076, e5256d91808b47c195bc9b4dbd7f2b87; no voters: e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:07:14.570649 19405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4509b76741dc428e9201c70c1658da13" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
I20260709 13:07:14.571177 26101 raft_consensus.cc:493] T edd7d470b5014c9489be7f41f64355c9 P 0473d2b2d01f4459b1e90fd12cc7840e [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:14.566735 25747 raft_consensus.cc:493] T 0cdf56e38bbc453d9438d359e5a69955 P e61c3a8f61bb48f8a963c9480e53c168 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:14.571767 19404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40e1e16737a842ee936002830f36882e" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
I20260709 13:07:14.566597 26228 raft_consensus.cc:2749] T 0afb57ae58a24a01850491d69f0213dd P e61c3a8f61bb48f8a963c9480e53c168 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:07:14.572744 20109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85c494af21f9457a85da47b9bc70c1fd" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:07:14.573421 26119 consensus_queue.cc:1048] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P 127766fc592545a4997f7790f50f6076 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.000s
I20260709 13:07:14.573864 20103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed7fdbcb96d14d418db9ca90a792588a" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:07:14.574522 20103 raft_consensus.cc:2468] T ed7fdbcb96d14d418db9ca90a792588a P 127766fc592545a4997f7790f50f6076 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 17.
I20260709 13:07:14.574900 19403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "179fd671030940b4b4a4e24bcc4aba0a" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 23 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:07:14.571699 26101 raft_consensus.cc:515] T edd7d470b5014c9489be7f41f64355c9 P 0473d2b2d01f4459b1e90fd12cc7840e [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:07:14.562433 19560 raft_consensus.cc:2468] T 85c494af21f9457a85da47b9bc70c1fd P e61c3a8f61bb48f8a963c9480e53c168 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 19.
I20260709 13:07:14.578954 19523 leader_election.cc:304] T ed7fdbcb96d14d418db9ca90a792588a P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 127766fc592545a4997f7790f50f6076, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:07:14.579602 25747 raft_consensus.cc:515] T 0cdf56e38bbc453d9438d359e5a69955 P e61c3a8f61bb48f8a963c9480e53c168 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:07:14.586854 25957 raft_consensus.cc:493] T 86a6797bdfe94fa496c050ceae4bd0d9 P 0473d2b2d01f4459b1e90fd12cc7840e [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:14.587347 25957 raft_consensus.cc:515] T 86a6797bdfe94fa496c050ceae4bd0d9 P 0473d2b2d01f4459b1e90fd12cc7840e [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:07:14.589373 25957 leader_election.cc:290] T 86a6797bdfe94fa496c050ceae4bd0d9 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:07:14.592520 25376 leader_election.cc:290] T 3e1f505cb0f1427bbd698ac889d80821 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:07:14.593444 19484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c5eebf646ad445a9d1b1adc319d7b16" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:07:14.594617 19551 raft_consensus.cc:1240] T 85c494af21f9457a85da47b9bc70c1fd P e61c3a8f61bb48f8a963c9480e53c168 [term 19 FOLLOWER]: Rejecting Update request from peer 127766fc592545a4997f7790f50f6076 for earlier term 18. Current term is 19. Ops: []
W20260709 13:07:14.579035 19377 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.2:46257, user_credentials={real_user=slave}} blocked reactor thread for 47262.3us
I20260709 13:07:14.541429 26246 raft_consensus.cc:2804] T 76cb037fc9064d13b59a8969d897ce8c P 0473d2b2d01f4459b1e90fd12cc7840e [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:07:14.575348 26160 raft_consensus.cc:515] T 309c3ca0ca4b4f3ba129752ea2cb293b P e61c3a8f61bb48f8a963c9480e53c168 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } attrs { replace: true } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:07:14.598068 19484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edd7d470b5014c9489be7f41f64355c9" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 25 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:07:14.599895 19485 raft_consensus.cc:1240] T 217b5fae677b4971b3bbd2f357a1f7ff P 0473d2b2d01f4459b1e90fd12cc7840e [term 17 FOLLOWER]: Rejecting Update request from peer e61c3a8f61bb48f8a963c9480e53c168 for earlier term 16. Current term is 17. Ops: [16.10-16.10]
I20260709 13:07:14.608278 26151 raft_consensus.cc:493] T 86a6797bdfe94fa496c050ceae4bd0d9 P e61c3a8f61bb48f8a963c9480e53c168 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:14.608775 26151 raft_consensus.cc:515] T 86a6797bdfe94fa496c050ceae4bd0d9 P e61c3a8f61bb48f8a963c9480e53c168 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:07:14.568231 26275 raft_consensus.cc:3060] T 40e1e16737a842ee936002830f36882e P e5256d91808b47c195bc9b4dbd7f2b87 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:07:14.529747 26017 raft_consensus.cc:515] T ab43d85f64114d4ebf618930e43d9ed0 P 0473d2b2d01f4459b1e90fd12cc7840e [term 22 FOLLOWER]: Starting leader election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:07:14.616671 19484 raft_consensus.cc:2468] T edd7d470b5014c9489be7f41f64355c9 P 0473d2b2d01f4459b1e90fd12cc7840e [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 24.
I20260709 13:07:14.540859 26244 raft_consensus.cc:515] T 2b74109013a140ada21feeef92d6f563 P e61c3a8f61bb48f8a963c9480e53c168 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:07:14.624333 19482 raft_consensus.cc:1240] T ab43d85f64114d4ebf618930e43d9ed0 P 0473d2b2d01f4459b1e90fd12cc7840e [term 22 FOLLOWER]: Rejecting Update request from peer 127766fc592545a4997f7790f50f6076 for earlier term 21. Current term is 22. Ops: []
I20260709 13:07:14.597880 26228 raft_consensus.cc:2804] T ed7fdbcb96d14d418db9ca90a792588a P e61c3a8f61bb48f8a963c9480e53c168 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:07:14.606619 25957 raft_consensus.cc:493] T 172b3dd13109415a955b71ac0e9d2234 P 0473d2b2d01f4459b1e90fd12cc7840e [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:14.575963 26044 consensus_queue.cc:1059] T 85c494af21f9457a85da47b9bc70c1fd P 127766fc592545a4997f7790f50f6076 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 }, Status: INVALID_TERM, Last received: 18.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.050s
I20260709 13:07:14.600934 26246 raft_consensus.cc:493] T 76cb037fc9064d13b59a8969d897ce8c P 0473d2b2d01f4459b1e90fd12cc7840e [term 18 FOLLOWER]: Starting leader election (detected failure of leader e5256d91808b47c195bc9b4dbd7f2b87)
I20260709 13:07:14.636096 19485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e36a9d6e29c4a7c860cf267efbd4c74" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:07:14.600741 26288 raft_consensus.cc:2804] T ece3db938bc649d4a40a51522ed5259c P e5256d91808b47c195bc9b4dbd7f2b87 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:07:14.633288 19558 raft_consensus.cc:2468] T 7f575b143b844aa096b50997dad3516a P e61c3a8f61bb48f8a963c9480e53c168 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 18.
I20260709 13:07:14.635645 19403 raft_consensus.cc:3060] T 172b3dd13109415a955b71ac0e9d2234 P e5256d91808b47c195bc9b4dbd7f2b87 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:07:14.637427 19478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f575b143b844aa096b50997dad3516a" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:07:14.638767 19485 raft_consensus.cc:2368] T 2e36a9d6e29c4a7c860cf267efbd4c74 P 0473d2b2d01f4459b1e90fd12cc7840e [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate e61c3a8f61bb48f8a963c9480e53c168 for earlier term 14. Current term is 15.
I20260709 13:07:14.638866 19481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40e1e16737a842ee936002830f36882e" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:07:14.639602 19478 raft_consensus.cc:2368] T 7f575b143b844aa096b50997dad3516a P 0473d2b2d01f4459b1e90fd12cc7840e [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate e61c3a8f61bb48f8a963c9480e53c168 for earlier term 17. Current term is 18.
I20260709 13:07:14.639865 19481 raft_consensus.cc:2393] T 40e1e16737a842ee936002830f36882e P 0473d2b2d01f4459b1e90fd12cc7840e [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate e61c3a8f61bb48f8a963c9480e53c168 in current term 22: Already voted for candidate 0473d2b2d01f4459b1e90fd12cc7840e in this term.
I20260709 13:07:14.621335 26162 raft_consensus.cc:515] T 0e1085d23e8347fbbd5bce7542f4b1f4 P 0473d2b2d01f4459b1e90fd12cc7840e [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:07:14.640609 19485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4509b76741dc428e9201c70c1658da13" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:07:14.643445 19486 raft_consensus.cc:1275] T 21e14947d70440f19044d8f75c31e1f9 P 0473d2b2d01f4459b1e90fd12cc7840e [term 20 FOLLOWER]: Refusing update from remote peer e61c3a8f61bb48f8a963c9480e53c168: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 20 index: 13. (index mismatch)
I20260709 13:07:14.642262 19481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef32ce6fdd0e40d382c79974f30295c6" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 24 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:07:14.654896 19481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed7fdbcb96d14d418db9ca90a792588a" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:07:14.655726 19481 raft_consensus.cc:2468] T ed7fdbcb96d14d418db9ca90a792588a P 0473d2b2d01f4459b1e90fd12cc7840e [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 17.
I20260709 13:07:14.632725 26228 raft_consensus.cc:493] T ed7fdbcb96d14d418db9ca90a792588a P e61c3a8f61bb48f8a963c9480e53c168 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:14.662995 25093 consensus_queue.cc:1048] T 2b74109013a140ada21feeef92d6f563 P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:07:14.660179 19485 raft_consensus.cc:2393] T 4509b76741dc428e9201c70c1658da13 P 0473d2b2d01f4459b1e90fd12cc7840e [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate e61c3a8f61bb48f8a963c9480e53c168 in current term 14: Already voted for candidate 0473d2b2d01f4459b1e90fd12cc7840e in this term.
I20260709 13:07:14.629833 26262 raft_consensus.cc:493] T f93ee515a9c14139bf566522ed8232f3 P e5256d91808b47c195bc9b4dbd7f2b87 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 0473d2b2d01f4459b1e90fd12cc7840e)
I20260709 13:07:14.633788 25747 leader_election.cc:290] T 0cdf56e38bbc453d9438d359e5a69955 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:07:14.661638 19477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e1085d23e8347fbbd5bce7542f4b1f4" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:07:14.671795 19410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa731b585f684a7fb2d106c50f143b83" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:07:14.639218 26246 raft_consensus.cc:3060] T 76cb037fc9064d13b59a8969d897ce8c P 0473d2b2d01f4459b1e90fd12cc7840e [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:07:14.672169 19406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40e1e16737a842ee936002830f36882e" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:07:14.670532 19377 leader_election.cc:304] T 21e14947d70440f19044d8f75c31e1f9 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:07:14.672569 19402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edd7d470b5014c9489be7f41f64355c9" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 25 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:07:14.673317 19409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e36a9d6e29c4a7c860cf267efbd4c74" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
I20260709 13:07:14.689642 19402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40e1e16737a842ee936002830f36882e" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
W20260709 13:07:14.691905 20078 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.2:46257, user_credentials={real_user=slave}} blocked reactor thread for 283426us
I20260709 13:07:14.692569 19410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4509b76741dc428e9201c70c1658da13" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
I20260709 13:07:14.693698 19410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f575b143b844aa096b50997dad3516a" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
I20260709 13:07:14.699863 19481 raft_consensus.cc:1275] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P 0473d2b2d01f4459b1e90fd12cc7840e [term 22 FOLLOWER]: Refusing update from remote peer 127766fc592545a4997f7790f50f6076: Log matching property violated. Preceding OpId in replica: term: 20 index: 16. Preceding OpId from leader: term: 22 index: 17. (index mismatch)
I20260709 13:07:14.706194 19478 raft_consensus.cc:1275] T f93ee515a9c14139bf566522ed8232f3 P 0473d2b2d01f4459b1e90fd12cc7840e [term 23 FOLLOWER]: Refusing update from remote peer e61c3a8f61bb48f8a963c9480e53c168: Log matching property violated. Preceding OpId in replica: term: 22 index: 11. Preceding OpId from leader: term: 23 index: 12. (index mismatch)
I20260709 13:07:14.655131 26288 raft_consensus.cc:697] T ece3db938bc649d4a40a51522ed5259c P e5256d91808b47c195bc9b4dbd7f2b87 [term 15 LEADER]: Becoming Leader. State: Replica: e5256d91808b47c195bc9b4dbd7f2b87, State: Running, Role: LEADER
I20260709 13:07:14.709115 19409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef32ce6fdd0e40d382c79974f30295c6" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 24 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:07:14.709472 19410 raft_consensus.cc:2368] T 7f575b143b844aa096b50997dad3516a P e5256d91808b47c195bc9b4dbd7f2b87 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate e61c3a8f61bb48f8a963c9480e53c168 for earlier term 17. Current term is 18.
I20260709 13:07:14.712864 19478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "309c3ca0ca4b4f3ba129752ea2cb293b" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 13 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:07:14.710479 19558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "179fd671030940b4b4a4e24bcc4aba0a" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 23 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:07:14.711268 19552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e1f505cb0f1427bbd698ac889d80821" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:07:14.710163 19405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7be9efa6559648dbb5a0f7684c4542d1" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:07:14.714707 19486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cdf56e38bbc453d9438d359e5a69955" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:07:14.675995 26228 raft_consensus.cc:3060] T ed7fdbcb96d14d418db9ca90a792588a P e61c3a8f61bb48f8a963c9480e53c168 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:07:14.716085 19485 raft_consensus.cc:1275] T 1dc5b3532fe54f74876d02beffa2c230 P 0473d2b2d01f4459b1e90fd12cc7840e [term 22 FOLLOWER]: Refusing update from remote peer e61c3a8f61bb48f8a963c9480e53c168: Log matching property violated. Preceding OpId in replica: term: 21 index: 12. Preceding OpId from leader: term: 22 index: 12. (term mismatch)
I20260709 13:07:14.721458 19485 pending_rounds.cc:85] T 1dc5b3532fe54f74876d02beffa2c230 P 0473d2b2d01f4459b1e90fd12cc7840e: Aborting all ops after (but not including) 11
I20260709 13:07:14.721692 19485 pending_rounds.cc:107] T 1dc5b3532fe54f74876d02beffa2c230 P 0473d2b2d01f4459b1e90fd12cc7840e: Aborting uncommitted NO_OP operation due to leader change: 21.12
I20260709 13:07:14.721920 19485 raft_consensus.cc:2889] T 1dc5b3532fe54f74876d02beffa2c230 P 0473d2b2d01f4459b1e90fd12cc7840e [term 22 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:07:14.718245 19560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40e1e16737a842ee936002830f36882e" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:07:14.726538 19560 raft_consensus.cc:2393] T 40e1e16737a842ee936002830f36882e P e61c3a8f61bb48f8a963c9480e53c168 [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate 0473d2b2d01f4459b1e90fd12cc7840e in current term 22: Already voted for candidate e61c3a8f61bb48f8a963c9480e53c168 in this term.
I20260709 13:07:14.729979 19558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86a6797bdfe94fa496c050ceae4bd0d9" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:07:14.730974 19558 raft_consensus.cc:2468] T 86a6797bdfe94fa496c050ceae4bd0d9 P e61c3a8f61bb48f8a963c9480e53c168 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 16.
I20260709 13:07:14.732697 19558 raft_consensus.cc:1275] T 0cdf56e38bbc453d9438d359e5a69955 P e61c3a8f61bb48f8a963c9480e53c168 [term 19 FOLLOWER]: Refusing update from remote peer 0473d2b2d01f4459b1e90fd12cc7840e: Log matching property violated. Preceding OpId in replica: term: 18 index: 12. Preceding OpId from leader: term: 19 index: 13. (index mismatch)
I20260709 13:07:14.640959 25957 raft_consensus.cc:515] T 172b3dd13109415a955b71ac0e9d2234 P 0473d2b2d01f4459b1e90fd12cc7840e [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:07:14.745227 19560 raft_consensus.cc:1275] T 14935b3ddf914369822e4a0547aaa355 P e61c3a8f61bb48f8a963c9480e53c168 [term 15 FOLLOWER]: Refusing update from remote peer 0473d2b2d01f4459b1e90fd12cc7840e: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 13:07:14.744287 19449 leader_election.cc:304] T 775c229504194560ba9589bc2199b089 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e; no voters: 127766fc592545a4997f7790f50f6076, e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:07:14.690593 25851 raft_consensus.cc:493] T fa8650e71aa14778b3d73721fc50d9fc P e61c3a8f61bb48f8a963c9480e53c168 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader e5256d91808b47c195bc9b4dbd7f2b87)
I20260709 13:07:14.752046 19377 leader_election.cc:304] T 217b5fae677b4971b3bbd2f357a1f7ff P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87; no voters: e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:07:14.754154 19526 leader_election.cc:304] T 6c5eebf646ad445a9d1b1adc319d7b16 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e61c3a8f61bb48f8a963c9480e53c168; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, 127766fc592545a4997f7790f50f6076
I20260709 13:07:14.755460 19402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e1f505cb0f1427bbd698ac889d80821" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:07:14.756646 19406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86a6797bdfe94fa496c050ceae4bd0d9" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:07:14.757272 19406 raft_consensus.cc:2468] T 86a6797bdfe94fa496c050ceae4bd0d9 P e5256d91808b47c195bc9b4dbd7f2b87 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 15.
I20260709 13:07:14.702948 26289 raft_consensus.cc:493] T 46c5bfeecc314717bffe987e6844b6d0 P e5256d91808b47c195bc9b4dbd7f2b87 [term 25 FOLLOWER]: Starting pre-election (detected failure of leader e61c3a8f61bb48f8a963c9480e53c168)
I20260709 13:07:14.717829 19551 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "28af091831594f9d8e96482078cc7625"
dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
 from {username='slave'} at 127.0.0.1:40428
I20260709 13:07:14.758523 26192 consensus_queue.cc:1048] T edd7d470b5014c9489be7f41f64355c9 P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:07:14.763947 26216 raft_consensus.cc:3055] T 85c494af21f9457a85da47b9bc70c1fd P 127766fc592545a4997f7790f50f6076 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:07:14.758945 19405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ece3db938bc649d4a40a51522ed5259c" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
I20260709 13:07:14.764392 26216 raft_consensus.cc:740] T 85c494af21f9457a85da47b9bc70c1fd P 127766fc592545a4997f7790f50f6076 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 127766fc592545a4997f7790f50f6076, State: Running, Role: LEADER
I20260709 13:07:14.765625 19405 raft_consensus.cc:1275] T 1dc5b3532fe54f74876d02beffa2c230 P e5256d91808b47c195bc9b4dbd7f2b87 [term 22 FOLLOWER]: Refusing update from remote peer e61c3a8f61bb48f8a963c9480e53c168: Log matching property violated. Preceding OpId in replica: term: 19 index: 10. Preceding OpId from leader: term: 22 index: 12. (index mismatch)
I20260709 13:07:14.694684 26262 raft_consensus.cc:515] T f93ee515a9c14139bf566522ed8232f3 P e5256d91808b47c195bc9b4dbd7f2b87 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:07:14.768015 19450 leader_election.cc:304] T ed7fdbcb96d14d418db9ca90a792588a P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:07:14.768620 19411 raft_consensus.cc:3060] T f93ee515a9c14139bf566522ed8232f3 P e5256d91808b47c195bc9b4dbd7f2b87 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:07:14.771647 25376 raft_consensus.cc:2804] T ed7fdbcb96d14d418db9ca90a792588a P 0473d2b2d01f4459b1e90fd12cc7840e [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:07:14.772112 25376 raft_consensus.cc:493] T ed7fdbcb96d14d418db9ca90a792588a P 0473d2b2d01f4459b1e90fd12cc7840e [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:14.772445 25376 raft_consensus.cc:3060] T ed7fdbcb96d14d418db9ca90a792588a P 0473d2b2d01f4459b1e90fd12cc7840e [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:07:14.775977 26293 raft_consensus.cc:2749] T 6c5eebf646ad445a9d1b1adc319d7b16 P e61c3a8f61bb48f8a963c9480e53c168 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:07:14.778517 26289 raft_consensus.cc:515] T 46c5bfeecc314717bffe987e6844b6d0 P e5256d91808b47c195bc9b4dbd7f2b87 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:07:14.780915 26289 leader_election.cc:290] T 46c5bfeecc314717bffe987e6844b6d0 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:07:14.760175 19551 raft_consensus.cc:493] T 28af091831594f9d8e96482078cc7625 P e61c3a8f61bb48f8a963c9480e53c168 [term 18 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:07:14.782037 19551 raft_consensus.cc:3060] T 28af091831594f9d8e96482078cc7625 P e61c3a8f61bb48f8a963c9480e53c168 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:07:14.783310 25957 leader_election.cc:290] T 172b3dd13109415a955b71ac0e9d2234 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:07:14.710701 26207 raft_consensus.cc:493] T 14efcc79969f41babe5529c22d59156d P 0473d2b2d01f4459b1e90fd12cc7840e [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 127766fc592545a4997f7790f50f6076)
I20260709 13:07:14.768164 26262 leader_election.cc:290] T f93ee515a9c14139bf566522ed8232f3 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:07:14.786413 20106 raft_consensus.cc:2468] T ece3db938bc649d4a40a51522ed5259c P 127766fc592545a4997f7790f50f6076 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 16.
I20260709 13:07:14.785116 19377 leader_election.cc:304] T 7f575b143b844aa096b50997dad3516a P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87; no voters: 
I20260709 13:07:14.791493 19523 leader_election.cc:304] T ece3db938bc649d4a40a51522ed5259c P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 127766fc592545a4997f7790f50f6076, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:07:14.787907 26151 leader_election.cc:290] T 86a6797bdfe94fa496c050ceae4bd0d9 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:07:14.715498 26296 raft_consensus.cc:2749] T 21e14947d70440f19044d8f75c31e1f9 P e5256d91808b47c195bc9b4dbd7f2b87 [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 13:07:14.714593 26044 consensus_queue.cc:1059] T 85c494af21f9457a85da47b9bc70c1fd P 127766fc592545a4997f7790f50f6076 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 }, Status: INVALID_TERM, Last received: 18.14, Next index: 15, Last known committed idx: 13, Time since last communication: 0.072s
I20260709 13:07:14.839916 19411 raft_consensus.cc:1275] T f93ee515a9c14139bf566522ed8232f3 P e5256d91808b47c195bc9b4dbd7f2b87 [term 23 FOLLOWER]: Refusing update from remote peer e61c3a8f61bb48f8a963c9480e53c168: Log matching property violated. Preceding OpId in replica: term: 22 index: 11. Preceding OpId from leader: term: 23 index: 12. (index mismatch)
W20260709 13:07:14.834966 19374 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.4:43121, user_credentials={real_user=slave}} blocked reactor thread for 45126.7us
I20260709 13:07:14.760211 26245 raft_consensus.cc:2749] T 775c229504194560ba9589bc2199b089 P 0473d2b2d01f4459b1e90fd12cc7840e [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:07:14.838222 19405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85c494af21f9457a85da47b9bc70c1fd" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:07:14.839332 19410 raft_consensus.cc:1275] T 21e14947d70440f19044d8f75c31e1f9 P e5256d91808b47c195bc9b4dbd7f2b87 [term 20 FOLLOWER]: Refusing update from remote peer e61c3a8f61bb48f8a963c9480e53c168: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 20 index: 13. (index mismatch)
I20260709 13:07:14.842347 25376 raft_consensus.cc:515] T ed7fdbcb96d14d418db9ca90a792588a P 0473d2b2d01f4459b1e90fd12cc7840e [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:07:14.846474 19403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cdf56e38bbc453d9438d359e5a69955" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:07:14.847121 19403 raft_consensus.cc:2468] T 0cdf56e38bbc453d9438d359e5a69955 P e5256d91808b47c195bc9b4dbd7f2b87 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 19.
W20260709 13:07:14.843744 19377 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.2:46257, user_credentials={real_user=slave}} blocked reactor thread for 58699.5us
I20260709 13:07:14.795869 26192 raft_consensus.cc:2804] T 217b5fae677b4971b3bbd2f357a1f7ff P e5256d91808b47c195bc9b4dbd7f2b87 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:07:14.855835 19523 leader_election.cc:304] T fa731b585f684a7fb2d106c50f143b83 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e61c3a8f61bb48f8a963c9480e53c168; no voters: 127766fc592545a4997f7790f50f6076, e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:07:14.805935 26293 raft_consensus.cc:2804] T ece3db938bc649d4a40a51522ed5259c P e61c3a8f61bb48f8a963c9480e53c168 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:07:14.784711 25851 raft_consensus.cc:515] T fa8650e71aa14778b3d73721fc50d9fc P e61c3a8f61bb48f8a963c9480e53c168 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:07:14.862793 19405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86a6797bdfe94fa496c050ceae4bd0d9" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:07:14.864188 19405 raft_consensus.cc:2468] T 86a6797bdfe94fa496c050ceae4bd0d9 P e5256d91808b47c195bc9b4dbd7f2b87 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 15.
W20260709 13:07:14.924536 20076 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.3:36891, user_credentials={real_user=slave}} blocked reactor thread for 78406.2us
W20260709 13:07:14.924705 19377 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.2:46257, user_credentials={real_user=slave}} blocked reactor thread for 75166us
W20260709 13:07:14.925607 19374 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:14.842868 26017 leader_election.cc:290] T ab43d85f64114d4ebf618930e43d9ed0 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 22 election: Requested vote from peers e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:07:14.795025 26207 raft_consensus.cc:515] T 14efcc79969f41babe5529c22d59156d P 0473d2b2d01f4459b1e90fd12cc7840e [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:07:14.853261 26283 raft_consensus.cc:2804] T 7f575b143b844aa096b50997dad3516a P e5256d91808b47c195bc9b4dbd7f2b87 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:07:14.931778 19403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "309c3ca0ca4b4f3ba129752ea2cb293b" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 13 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:07:14.856227 26288 consensus_queue.cc:237] T ece3db938bc649d4a40a51522ed5259c P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:07:14.931691 26097 raft_consensus.cc:2749] T bc225c93219c45538b53a1bd3d387e4d P e5256d91808b47c195bc9b4dbd7f2b87 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:07:14.864976 26192 raft_consensus.cc:697] T 217b5fae677b4971b3bbd2f357a1f7ff P e5256d91808b47c195bc9b4dbd7f2b87 [term 17 LEADER]: Becoming Leader. State: Replica: e5256d91808b47c195bc9b4dbd7f2b87, State: Running, Role: LEADER
I20260709 13:07:14.981750 26283 raft_consensus.cc:697] T 7f575b143b844aa096b50997dad3516a P e5256d91808b47c195bc9b4dbd7f2b87 [term 18 LEADER]: Becoming Leader. State: Replica: e5256d91808b47c195bc9b4dbd7f2b87, State: Running, Role: LEADER
I20260709 13:07:14.943292 26101 leader_election.cc:290] T edd7d470b5014c9489be7f41f64355c9 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
W20260709 13:07:14.963644 26300 log.cc:927] Time spent T 833a2f0775ed407a94b8924ce50adb63 P 127766fc592545a4997f7790f50f6076: Append to log took a long time: real 0.179s	user 0.000s	sys 0.000s
I20260709 13:07:15.017740 26160 leader_election.cc:290] T 309c3ca0ca4b4f3ba129752ea2cb293b P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:07:14.947234 26151 raft_consensus.cc:2749] T fa731b585f684a7fb2d106c50f143b83 P e61c3a8f61bb48f8a963c9480e53c168 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 13:07:14.967413 26301 log.cc:927] Time spent T bc225c93219c45538b53a1bd3d387e4d P e5256d91808b47c195bc9b4dbd7f2b87: Append to log took a long time: real 0.119s	user 0.000s	sys 0.000s
I20260709 13:07:14.973863 19551 raft_consensus.cc:515] T 28af091831594f9d8e96482078cc7625 P e61c3a8f61bb48f8a963c9480e53c168 [term 19 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:07:15.017199 25851 leader_election.cc:290] T fa8650e71aa14778b3d73721fc50d9fc P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:07:14.974879 26044 raft_consensus.cc:493] T 7be9efa6559648dbb5a0f7684c4542d1 P 127766fc592545a4997f7790f50f6076 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader e5256d91808b47c195bc9b4dbd7f2b87)
I20260709 13:07:15.022984 26283 consensus_queue.cc:237] T 7f575b143b844aa096b50997dad3516a P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.11, Last appended by leader: 11, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:07:15.029379 25376 leader_election.cc:290] T ed7fdbcb96d14d418db9ca90a792588a P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 18 election: Requested vote from peers e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:07:15.025799 26162 leader_election.cc:290] T 0e1085d23e8347fbbd5bce7542f4b1f4 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 17 election: Requested vote from peers e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:07:15.031118 26290 consensus_queue.cc:1059] T 4509b76741dc428e9201c70c1658da13 P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 }, Status: INVALID_TERM, Last received: 12.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
W20260709 13:07:15.037724 20078 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.2:46257, user_credentials={real_user=slave}} blocked reactor thread for 323657us
I20260709 13:07:15.039211 19551 leader_election.cc:290] T 28af091831594f9d8e96482078cc7625 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 19 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
W20260709 13:07:15.040272 19450 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.3:36891, user_credentials={real_user=slave}} blocked reactor thread for 271321us
W20260709 13:07:15.040472 19526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.2:46257, user_credentials={real_user=slave}} blocked reactor thread for 264861us
I20260709 13:07:15.042865 19526 leader_election.cc:400] T 2e36a9d6e29c4a7c860cf267efbd4c74 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 14 election: Vote denied by peer 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257) with higher term. Message: Invalid argument: T 2e36a9d6e29c4a7c860cf267efbd4c74 P 0473d2b2d01f4459b1e90fd12cc7840e [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate e61c3a8f61bb48f8a963c9480e53c168 for earlier term 14. Current term is 15.
I20260709 13:07:15.043193 19526 leader_election.cc:403] T 2e36a9d6e29c4a7c860cf267efbd4c74 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 14 election: Cancelling election due to peer responding with higher term
I20260709 13:07:15.043135 19450 leader_election.cc:304] T 4509b76741dc428e9201c70c1658da13 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e; no voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:07:15.045336 25376 raft_consensus.cc:2749] T 4509b76741dc428e9201c70c1658da13 P 0473d2b2d01f4459b1e90fd12cc7840e [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:07:15.027547 26244 leader_election.cc:290] T 2b74109013a140ada21feeef92d6f563 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
W20260709 13:07:15.048897 20075 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.1:40321, user_credentials={real_user=slave}} blocked reactor thread for 285277us
I20260709 13:07:15.037758 26151 raft_consensus.cc:493] T 2a16f7501e2444fb86d4e2778e734e02 P e61c3a8f61bb48f8a963c9480e53c168 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 127766fc592545a4997f7790f50f6076)
I20260709 13:07:15.033185 25923 consensus_queue.cc:1048] T 65d8cb8d6ec64f459d5a47cefab10acf P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.019s
I20260709 13:07:15.044386 25851 raft_consensus.cc:2749] T 2e36a9d6e29c4a7c860cf267efbd4c74 P e61c3a8f61bb48f8a963c9480e53c168 [term 15 FOLLOWER]: Leader election lost for term 14. Reason: Vote denied by peer 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257) with higher term. Message: Invalid argument: T 2e36a9d6e29c4a7c860cf267efbd4c74 P 0473d2b2d01f4459b1e90fd12cc7840e [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate e61c3a8f61bb48f8a963c9480e53c168 for earlier term 14. Current term is 15.
I20260709 13:07:15.083355 25376 raft_consensus.cc:493] T f93ee515a9c14139bf566522ed8232f3 P 0473d2b2d01f4459b1e90fd12cc7840e [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:15.088284 25376 raft_consensus.cc:515] T f93ee515a9c14139bf566522ed8232f3 P 0473d2b2d01f4459b1e90fd12cc7840e [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:07:15.067929 26290 raft_consensus.cc:3055] T 4509b76741dc428e9201c70c1658da13 P e5256d91808b47c195bc9b4dbd7f2b87 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:07:15.089962 26290 raft_consensus.cc:740] T 4509b76741dc428e9201c70c1658da13 P e5256d91808b47c195bc9b4dbd7f2b87 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: e5256d91808b47c195bc9b4dbd7f2b87, State: Running, Role: LEADER
I20260709 13:07:15.090260 25376 leader_election.cc:290] T f93ee515a9c14139bf566522ed8232f3 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:07:15.090883 26290 consensus_queue.cc:260] T 4509b76741dc428e9201c70c1658da13 P e5256d91808b47c195bc9b4dbd7f2b87 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:07:15.092152 26290 raft_consensus.cc:3060] T 4509b76741dc428e9201c70c1658da13 P e5256d91808b47c195bc9b4dbd7f2b87 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:07:15.098296 25376 raft_consensus.cc:493] T 21e14947d70440f19044d8f75c31e1f9 P 0473d2b2d01f4459b1e90fd12cc7840e [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:15.098821 25376 raft_consensus.cc:515] T 21e14947d70440f19044d8f75c31e1f9 P 0473d2b2d01f4459b1e90fd12cc7840e [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:07:15.100577 25376 leader_election.cc:290] T 21e14947d70440f19044d8f75c31e1f9 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
W20260709 13:07:15.102751 26294 log.cc:927] Time spent T 65d8cb8d6ec64f459d5a47cefab10acf P e5256d91808b47c195bc9b4dbd7f2b87: Append to log took a long time: real 0.081s	user 0.001s	sys 0.000s
I20260709 13:07:15.103696 19407 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52342 (request call id 3360) took 1309 ms. Trace:
I20260709 13:07:15.104072 19407 rpcz_store.cc:276] 0709 13:07:13.794190 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:13.794754 (+   564us) service_pool.cc:224] Handling call
0709 13:07:13.795104 (+   350us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:07:14.058146 (+263042us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:14.058190 (+    44us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:07:14.062728 (+  4538us) log.cc:844] Serialized 52 byte log entry
0709 13:07:14.644679 (+581951us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:07:14.840036 (+195357us) log.cc:844] Serialized 14 byte log entry
0709 13:07:14.924753 (+ 84717us) log.cc:844] Serialized 14 byte log entry
0709 13:07:14.925045 (+   292us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:14.925133 (+    88us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:14.999433 (+ 74300us) spinlock_profiling.cc:243] Waited 10.6 ms on lock 0x7b18000fd9c0. stack: 00007f4a79de9343 00007f4a79de9240 00007f4a797781d4 00007f4a834b6304 00007f4a834b6299 00007f4a82ce3de1 00007f4a82cf05b1 00007f4a79e1b522 00007f4a79e1d7c1 00007f4a79e1d779 00007f4a79e1d709 00007f4a79e1d6d1 00007f4a79e1c9cd 000000000038f354 000000000038f199 00007f4a79dfe83a
0709 13:07:15.103501 (+104068us) raft_consensus.cc:1685] finished
0709 13:07:15.103523 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:15.103646 (+   123us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":107207,"prepare.queue_time_us":546688,"prepare.run_cpu_time_us":83,"prepare.run_wall_time_us":2297,"raft.queue_time_us":131768,"raft.run_cpu_time_us":334,"raft.run_wall_time_us":10322,"spinlock_wait_cycles":24343424,"thread_start_us":909441,"threads_started":3,"wal-append.queue_time_us":608565}
I20260709 13:07:15.038399 26044 raft_consensus.cc:515] T 7be9efa6559648dbb5a0f7684c4542d1 P 127766fc592545a4997f7790f50f6076 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } attrs { replace: true } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
W20260709 13:07:15.086475 26297 log.cc:927] Time spent T 0e1085d23e8347fbbd5bce7542f4b1f4 P e61c3a8f61bb48f8a963c9480e53c168: Append to log took a long time: real 0.477s	user 0.005s	sys 0.005s
I20260709 13:07:15.066075 19526 leader_election.cc:400] T 7f575b143b844aa096b50997dad3516a P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 17 election: Vote denied by peer 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257) with higher term. Message: Invalid argument: T 7f575b143b844aa096b50997dad3516a P 0473d2b2d01f4459b1e90fd12cc7840e [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate e61c3a8f61bb48f8a963c9480e53c168 for earlier term 17. Current term is 18.
I20260709 13:07:15.124554 19526 leader_election.cc:403] T 7f575b143b844aa096b50997dad3516a P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 17 election: Cancelling election due to peer responding with higher term
W20260709 13:07:15.125519 19450 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.3:36891, user_credentials={real_user=slave}} blocked reactor thread for 79188.6us
I20260709 13:07:15.067253 26244 consensus_queue.cc:1048] T 21e14947d70440f19044d8f75c31e1f9 P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.048s
I20260709 13:07:15.127351 19450 leader_election.cc:304] T 179fd671030940b4b4a4e24bcc4aba0a P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e; no voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168
W20260709 13:07:15.132440 19526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.2:46257, user_credentials={real_user=slave}} blocked reactor thread for 66614.5us
I20260709 13:07:15.133704 19526 leader_election.cc:304] T 0e1085d23e8347fbbd5bce7542f4b1f4 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e61c3a8f61bb48f8a963c9480e53c168; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, 127766fc592545a4997f7790f50f6076
I20260709 13:07:15.081537 26151 raft_consensus.cc:515] T 2a16f7501e2444fb86d4e2778e734e02 P e61c3a8f61bb48f8a963c9480e53c168 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:07:15.139132 25376 raft_consensus.cc:2749] T 179fd671030940b4b4a4e24bcc4aba0a P 0473d2b2d01f4459b1e90fd12cc7840e [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:07:15.146131 19526 leader_election.cc:304] T 4509b76741dc428e9201c70c1658da13 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e61c3a8f61bb48f8a963c9480e53c168; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:07:15.143927 26162 raft_consensus.cc:493] T ef32ce6fdd0e40d382c79974f30295c6 P 0473d2b2d01f4459b1e90fd12cc7840e [term 23 FOLLOWER]: Starting pre-election (detected failure of leader e5256d91808b47c195bc9b4dbd7f2b87)
I20260709 13:07:15.152627 19449 leader_election.cc:304] T 3e1f505cb0f1427bbd698ac889d80821 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e; no voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168
W20260709 13:07:15.155296 26309 log.cc:927] Time spent T edd7d470b5014c9489be7f41f64355c9 P e61c3a8f61bb48f8a963c9480e53c168: Append to log took a long time: real 0.070s	user 0.000s	sys 0.000s
I20260709 13:07:15.156942 26151 leader_election.cc:290] T 2a16f7501e2444fb86d4e2778e734e02 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:07:15.051576 26192 consensus_queue.cc:237] T 217b5fae677b4971b3bbd2f357a1f7ff P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:07:15.160116 20106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1efebf73c86e432baa55533136b6e12c" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 17 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076"
I20260709 13:07:15.160822 20112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e1085d23e8347fbbd5bce7542f4b1f4" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:07:15.140298 19450 leader_election.cc:304] T 86a6797bdfe94fa496c050ceae4bd0d9 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:07:15.161542 20108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "172b3dd13109415a955b71ac0e9d2234" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:07:15.161919 20110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab43d85f64114d4ebf618930e43d9ed0" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076"
I20260709 13:07:15.163062 20107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e1085d23e8347fbbd5bce7542f4b1f4" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076"
I20260709 13:07:15.168241 20105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed7fdbcb96d14d418db9ca90a792588a" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:07:15.171175 20105 raft_consensus.cc:2468] T ed7fdbcb96d14d418db9ca90a792588a P 127766fc592545a4997f7790f50f6076 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 17.
I20260709 13:07:15.172061 25376 raft_consensus.cc:2804] T 86a6797bdfe94fa496c050ceae4bd0d9 P 0473d2b2d01f4459b1e90fd12cc7840e [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:07:15.172582 25376 raft_consensus.cc:493] T 86a6797bdfe94fa496c050ceae4bd0d9 P 0473d2b2d01f4459b1e90fd12cc7840e [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:15.172927 25376 raft_consensus.cc:3060] T 86a6797bdfe94fa496c050ceae4bd0d9 P 0473d2b2d01f4459b1e90fd12cc7840e [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:07:15.173475 20109 raft_consensus.cc:1275] T 14935b3ddf914369822e4a0547aaa355 P 127766fc592545a4997f7790f50f6076 [term 15 FOLLOWER]: Refusing update from remote peer 0473d2b2d01f4459b1e90fd12cc7840e: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 15 index: 11. (term mismatch)
I20260709 13:07:15.173883 20109 pending_rounds.cc:85] T 14935b3ddf914369822e4a0547aaa355 P 127766fc592545a4997f7790f50f6076: Aborting all ops after (but not including) 10
I20260709 13:07:15.174144 20109 pending_rounds.cc:107] T 14935b3ddf914369822e4a0547aaa355 P 127766fc592545a4997f7790f50f6076: Aborting uncommitted NO_OP operation due to leader change: 14.11
I20260709 13:07:15.174408 20109 raft_consensus.cc:2889] T 14935b3ddf914369822e4a0547aaa355 P 127766fc592545a4997f7790f50f6076 [term 15 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:07:15.176631 19375 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.3:36891, user_credentials={real_user=slave}} blocked reactor thread for 152346us
I20260709 13:07:15.178936 20103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed7fdbcb96d14d418db9ca90a792588a" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076"
I20260709 13:07:15.179437 19375 leader_election.cc:304] T 85c494af21f9457a85da47b9bc70c1fd P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168; no voters: 127766fc592545a4997f7790f50f6076
I20260709 13:07:15.179525 20103 raft_consensus.cc:3060] T ed7fdbcb96d14d418db9ca90a792588a P 127766fc592545a4997f7790f50f6076 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:07:15.182034 19551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edd7d470b5014c9489be7f41f64355c9" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 25 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:07:15.184418 19377 leader_election.cc:304] T e381f1d6b8184797ad142de49be225a8 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:07:15.185585 19553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab43d85f64114d4ebf618930e43d9ed0" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:07:15.166343 26101 raft_consensus.cc:2749] T 3e1f505cb0f1427bbd698ac889d80821 P 0473d2b2d01f4459b1e90fd12cc7840e [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:07:15.188488 19556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed7fdbcb96d14d418db9ca90a792588a" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:07:15.192891 19555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e1085d23e8347fbbd5bce7542f4b1f4" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:07:15.169646 26207 leader_election.cc:290] T 14efcc79969f41babe5529c22d59156d P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:07:15.196154 26151 raft_consensus.cc:2749] T 7f575b143b844aa096b50997dad3516a P e61c3a8f61bb48f8a963c9480e53c168 [term 18 FOLLOWER]: Leader election lost for term 17. Reason: Vote denied by peer 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257) with higher term. Message: Invalid argument: T 7f575b143b844aa096b50997dad3516a P 0473d2b2d01f4459b1e90fd12cc7840e [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate e61c3a8f61bb48f8a963c9480e53c168 for earlier term 17. Current term is 18.
I20260709 13:07:15.196301 26245 raft_consensus.cc:493] T 9962423cb4e54fcfa5de01daf68a86e7 P 0473d2b2d01f4459b1e90fd12cc7840e [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:15.197026 25975 raft_consensus.cc:493] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P 0473d2b2d01f4459b1e90fd12cc7840e [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:15.216498 25975 raft_consensus.cc:515] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P 0473d2b2d01f4459b1e90fd12cc7840e [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:07:15.216646 19482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "172b3dd13109415a955b71ac0e9d2234" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:07:15.197727 26017 raft_consensus.cc:493] T b08304a0a02b42d7840c4e8ee9a6bd1a P 0473d2b2d01f4459b1e90fd12cc7840e [term 21 FOLLOWER]: Starting pre-election (detected failure of leader e5256d91808b47c195bc9b4dbd7f2b87)
I20260709 13:07:15.218940 26017 raft_consensus.cc:515] T b08304a0a02b42d7840c4e8ee9a6bd1a P 0473d2b2d01f4459b1e90fd12cc7840e [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
W20260709 13:07:15.219524 26276 consensus_meta.cc:287] T ff9b0eddd810459b82d91c60777c10eb P 127766fc592545a4997f7790f50f6076: Time spent flushing consensus metadata: real 0.742s	user 0.012s	sys 0.000s
I20260709 13:07:15.166468 26162 raft_consensus.cc:515] T ef32ce6fdd0e40d382c79974f30295c6 P 0473d2b2d01f4459b1e90fd12cc7840e [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:07:15.202154 20103 raft_consensus.cc:2468] T ed7fdbcb96d14d418db9ca90a792588a P 127766fc592545a4997f7790f50f6076 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 18.
I20260709 13:07:15.218281 19482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f93ee515a9c14139bf566522ed8232f3" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 23 candidate_status { last_received { term: 22 index: 11 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:07:15.202785 25376 raft_consensus.cc:515] T 86a6797bdfe94fa496c050ceae4bd0d9 P 0473d2b2d01f4459b1e90fd12cc7840e [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:07:15.203997 19480 raft_consensus.cc:1240] T 0e1085d23e8347fbbd5bce7542f4b1f4 P 0473d2b2d01f4459b1e90fd12cc7840e [term 17 FOLLOWER]: Rejecting Update request from peer 127766fc592545a4997f7790f50f6076 for earlier term 16. Current term is 17. Ops: []
I20260709 13:07:15.221473 19482 raft_consensus.cc:2393] T f93ee515a9c14139bf566522ed8232f3 P 0473d2b2d01f4459b1e90fd12cc7840e [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e5256d91808b47c195bc9b4dbd7f2b87 in current term 23: Already voted for candidate e61c3a8f61bb48f8a963c9480e53c168 in this term.
I20260709 13:07:15.205171 26295 consensus_queue.cc:1059] T ab43d85f64114d4ebf618930e43d9ed0 P 127766fc592545a4997f7790f50f6076 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 }, Status: INVALID_TERM, Last received: 21.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 13:07:15.205610 26140 consensus_queue.cc:1048] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P 127766fc592545a4997f7790f50f6076 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.000s
I20260709 13:07:15.225348 19377 leader_election.cc:304] T 172b3dd13109415a955b71ac0e9d2234 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, 127766fc592545a4997f7790f50f6076
I20260709 13:07:15.192196 26270 raft_consensus.cc:2804] T 85c494af21f9457a85da47b9bc70c1fd P e5256d91808b47c195bc9b4dbd7f2b87 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:07:15.231068 19552 raft_consensus.cc:1240] T 28af091831594f9d8e96482078cc7625 P e61c3a8f61bb48f8a963c9480e53c168 [term 19 FOLLOWER]: Rejecting Update request from peer 0473d2b2d01f4459b1e90fd12cc7840e for earlier term 18. Current term is 19. Ops: []
I20260709 13:07:15.207244 19486 raft_consensus.cc:1240] T 40e1e16737a842ee936002830f36882e P 0473d2b2d01f4459b1e90fd12cc7840e [term 22 FOLLOWER]: Rejecting Update request from peer e5256d91808b47c195bc9b4dbd7f2b87 for earlier term 21. Current term is 22. Ops: [21.12-21.12]
I20260709 13:07:15.207580 19478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df751f992649444090e27965eb1af85d" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:07:15.199476 19477 raft_consensus.cc:1240] T 1efebf73c86e432baa55533136b6e12c P 0473d2b2d01f4459b1e90fd12cc7840e [term 17 FOLLOWER]: Rejecting Update request from peer 127766fc592545a4997f7790f50f6076 for earlier term 16. Current term is 17. Ops: [16.13-16.13]
I20260709 13:07:15.182503 25957 consensus_queue.cc:1048] T 14935b3ddf914369822e4a0547aaa355 P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.038s
I20260709 13:07:15.224270 19480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46c5bfeecc314717bffe987e6844b6d0" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 26 candidate_status { last_received { term: 25 index: 13 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:07:15.224872 26321 raft_consensus.cc:2749] T 4509b76741dc428e9201c70c1658da13 P e61c3a8f61bb48f8a963c9480e53c168 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:07:15.225116 26295 raft_consensus.cc:3055] T ab43d85f64114d4ebf618930e43d9ed0 P 127766fc592545a4997f7790f50f6076 [term 21 LEADER]: Stepping down as leader of term 21
I20260709 13:07:15.205139 19481 raft_consensus.cc:1275] T 172b3dd13109415a955b71ac0e9d2234 P 0473d2b2d01f4459b1e90fd12cc7840e [term 18 FOLLOWER]: Refusing update from remote peer 127766fc592545a4997f7790f50f6076: Log matching property violated. Preceding OpId in replica: term: 17 index: 12. Preceding OpId from leader: term: 18 index: 13. (index mismatch)
I20260709 13:07:15.228068 19558 raft_consensus.cc:1275] T e381f1d6b8184797ad142de49be225a8 P e61c3a8f61bb48f8a963c9480e53c168 [term 18 FOLLOWER]: Refusing update from remote peer 0473d2b2d01f4459b1e90fd12cc7840e: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
I20260709 13:07:15.182619 25871 consensus_queue.cc:1048] T 0cdf56e38bbc453d9438d359e5a69955 P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.035s
I20260709 13:07:15.231568 19553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f93ee515a9c14139bf566522ed8232f3" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 24 candidate_status { last_received { term: 22 index: 11 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:07:15.195106 26154 raft_consensus.cc:2749] T e381f1d6b8184797ad142de49be225a8 P e5256d91808b47c195bc9b4dbd7f2b87 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:07:15.218616 25975 leader_election.cc:290] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:07:15.235704 19557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21e14947d70440f19044d8f75c31e1f9" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 21 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:07:15.211891 25851 raft_consensus.cc:2749] T 0e1085d23e8347fbbd5bce7542f4b1f4 P e61c3a8f61bb48f8a963c9480e53c168 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:07:15.258416 25851 raft_consensus.cc:493] T 179fd671030940b4b4a4e24bcc4aba0a P e61c3a8f61bb48f8a963c9480e53c168 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader e5256d91808b47c195bc9b4dbd7f2b87)
I20260709 13:07:15.259037 25851 raft_consensus.cc:515] T 179fd671030940b4b4a4e24bcc4aba0a P e61c3a8f61bb48f8a963c9480e53c168 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:07:15.210911 26317 raft_consensus.cc:493] T 2725d2c4cb054f18b0fc8f735c15f6c2 P e61c3a8f61bb48f8a963c9480e53c168 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 0473d2b2d01f4459b1e90fd12cc7840e)
I20260709 13:07:15.261720 26317 raft_consensus.cc:515] T 2725d2c4cb054f18b0fc8f735c15f6c2 P e61c3a8f61bb48f8a963c9480e53c168 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:07:15.264187 26317 leader_election.cc:290] T 2725d2c4cb054f18b0fc8f735c15f6c2 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:07:15.219921 26276 raft_consensus.cc:515] T ff9b0eddd810459b82d91c60777c10eb P 127766fc592545a4997f7790f50f6076 [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:07:15.188982 26293 raft_consensus.cc:697] T ece3db938bc649d4a40a51522ed5259c P e61c3a8f61bb48f8a963c9480e53c168 [term 16 LEADER]: Becoming Leader. State: Replica: e61c3a8f61bb48f8a963c9480e53c168, State: Running, Role: LEADER
I20260709 13:07:15.220418 26179 raft_consensus.cc:493] T 70797e5783b5454ab0d0eea663e791e3 P 127766fc592545a4997f7790f50f6076 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader e5256d91808b47c195bc9b4dbd7f2b87)
I20260709 13:07:15.233006 26097 raft_consensus.cc:2749] T 172b3dd13109415a955b71ac0e9d2234 P e5256d91808b47c195bc9b4dbd7f2b87 [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:07:15.229810 26092 raft_consensus.cc:3055] T 1efebf73c86e432baa55533136b6e12c P 127766fc592545a4997f7790f50f6076 [term 16 LEADER]: Stepping down as leader of term 16
W20260709 13:07:15.269898 19523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.1:40321, user_credentials={real_user=slave}} blocked reactor thread for 345521us
I20260709 13:07:15.273519 19482 raft_consensus.cc:1240] T 4509b76741dc428e9201c70c1658da13 P 0473d2b2d01f4459b1e90fd12cc7840e [term 14 FOLLOWER]: Rejecting Update request from peer e5256d91808b47c195bc9b4dbd7f2b87 for earlier term 13. Current term is 14. Ops: [13.8-13.8]
I20260709 13:07:15.276428 19411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b74109013a140ada21feeef92d6f563" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 19 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
W20260709 13:07:15.245877 19374 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.4:43121, user_credentials={real_user=slave}} blocked reactor thread for 202055us
I20260709 13:07:15.281745 19407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa8650e71aa14778b3d73721fc50d9fc" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:07:15.253078 26295 raft_consensus.cc:740] T ab43d85f64114d4ebf618930e43d9ed0 P 127766fc592545a4997f7790f50f6076 [term 21 LEADER]: Becoming Follower/Learner. State: Replica: 127766fc592545a4997f7790f50f6076, State: Running, Role: LEADER
I20260709 13:07:15.239270 26270 raft_consensus.cc:697] T 85c494af21f9457a85da47b9bc70c1fd P e5256d91808b47c195bc9b4dbd7f2b87 [term 19 LEADER]: Becoming Leader. State: Replica: e5256d91808b47c195bc9b4dbd7f2b87, State: Running, Role: LEADER
I20260709 13:07:15.317283 20107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "309c3ca0ca4b4f3ba129752ea2cb293b" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 13 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:07:15.282491 19407 raft_consensus.cc:2468] T fa8650e71aa14778b3d73721fc50d9fc P e5256d91808b47c195bc9b4dbd7f2b87 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 21.
I20260709 13:07:15.222790 26245 raft_consensus.cc:515] T 9962423cb4e54fcfa5de01daf68a86e7 P 0473d2b2d01f4459b1e90fd12cc7840e [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:07:15.319859 20111 raft_consensus.cc:1240] T ff9b0eddd810459b82d91c60777c10eb P 127766fc592545a4997f7790f50f6076 [term 21 FOLLOWER]: Rejecting Update request from peer e5256d91808b47c195bc9b4dbd7f2b87 for earlier term 20. Current term is 21. Ops: []
I20260709 13:07:15.326962 19407 raft_consensus.cc:1275] T 833a2f0775ed407a94b8924ce50adb63 P e5256d91808b47c195bc9b4dbd7f2b87 [term 16 FOLLOWER]: Refusing update from remote peer 127766fc592545a4997f7790f50f6076: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 13:07:15.332227 26245 leader_election.cc:290] T 9962423cb4e54fcfa5de01daf68a86e7 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:07:15.233605 26151 consensus_queue.cc:1048] T f93ee515a9c14139bf566522ed8232f3 P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.041s
I20260709 13:07:15.339520 19409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a16f7501e2444fb86d4e2778e734e02" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:07:15.333544 19482 raft_consensus.cc:1240] T ff75a1d4cb1f493db8f71ddc136ba9ab P 0473d2b2d01f4459b1e90fd12cc7840e [term 20 FOLLOWER]: Rejecting Update request from peer e5256d91808b47c195bc9b4dbd7f2b87 for earlier term 19. Current term is 20. Ops: []
I20260709 13:07:15.341693 20107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a16f7501e2444fb86d4e2778e734e02" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:07:15.342782 19410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "179fd671030940b4b4a4e24bcc4aba0a" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:07:15.335806 19407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28af091831594f9d8e96482078cc7625" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: true dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
I20260709 13:07:15.343781 19407 raft_consensus.cc:3060] T 28af091831594f9d8e96482078cc7625 P e5256d91808b47c195bc9b4dbd7f2b87 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:07:15.345031 19406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2725d2c4cb054f18b0fc8f735c15f6c2" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:07:15.345808 19406 raft_consensus.cc:2393] T 2725d2c4cb054f18b0fc8f735c15f6c2 P e5256d91808b47c195bc9b4dbd7f2b87 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e61c3a8f61bb48f8a963c9480e53c168 in current term 20: Already voted for candidate e5256d91808b47c195bc9b4dbd7f2b87 in this term.
I20260709 13:07:15.345306 26293 consensus_queue.cc:237] T ece3db938bc649d4a40a51522ed5259c P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:07:15.346851 25851 leader_election.cc:290] T 179fd671030940b4b4a4e24bcc4aba0a P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:07:15.268446 26140 consensus_queue.cc:1059] T 0e1085d23e8347fbbd5bce7542f4b1f4 P 127766fc592545a4997f7790f50f6076 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 }, Status: INVALID_TERM, Last received: 16.13, Next index: 14, Last known committed idx: 11, Time since last communication: 0.068s
I20260709 13:07:15.283208 26092 raft_consensus.cc:740] T 1efebf73c86e432baa55533136b6e12c P 127766fc592545a4997f7790f50f6076 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 127766fc592545a4997f7790f50f6076, State: Running, Role: LEADER
I20260709 13:07:15.319804 26316 raft_consensus.cc:493] T 2725d2c4cb054f18b0fc8f735c15f6c2 P 0473d2b2d01f4459b1e90fd12cc7840e [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:15.317500 26179 raft_consensus.cc:515] T 70797e5783b5454ab0d0eea663e791e3 P 127766fc592545a4997f7790f50f6076 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:07:15.356357 25851 raft_consensus.cc:493] T f1b10566f45d4a7d9029858330e02d5b P e61c3a8f61bb48f8a963c9480e53c168 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader e5256d91808b47c195bc9b4dbd7f2b87)
I20260709 13:07:15.377792 19552 raft_consensus.cc:1240] T 85c494af21f9457a85da47b9bc70c1fd P e61c3a8f61bb48f8a963c9480e53c168 [term 19 FOLLOWER]: Rejecting Update request from peer 127766fc592545a4997f7790f50f6076 for earlier term 18. Current term is 19. Ops: []
I20260709 13:07:15.375008 19407 raft_consensus.cc:2468] T 28af091831594f9d8e96482078cc7625 P e5256d91808b47c195bc9b4dbd7f2b87 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 19.
I20260709 13:07:15.360210 26324 raft_consensus.cc:493] T 833a2f0775ed407a94b8924ce50adb63 P e61c3a8f61bb48f8a963c9480e53c168 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:15.383780 19376 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:15.384446 26320 log.cc:927] Time spent T 4af19371ea874c09a0a2147040835cbb P e5256d91808b47c195bc9b4dbd7f2b87: Append to log took a long time: real 0.145s	user 0.000s	sys 0.000s
I20260709 13:07:15.348632 26216 consensus_queue.cc:260] T 85c494af21f9457a85da47b9bc70c1fd P 127766fc592545a4997f7790f50f6076 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 18.14, Last appended by leader: 14, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
W20260709 13:07:15.389353 19526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.2:46257, user_credentials={real_user=slave}} blocked reactor thread for 224383us
I20260709 13:07:15.392545 26151 raft_consensus.cc:493] T 22196caba61445d3bec98a0aab3c337d P e61c3a8f61bb48f8a963c9480e53c168 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:15.395511 19559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f93ee515a9c14139bf566522ed8232f3" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 23 candidate_status { last_received { term: 22 index: 11 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:07:15.396678 19552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46c5bfeecc314717bffe987e6844b6d0" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 26 candidate_status { last_received { term: 25 index: 13 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:07:15.387234 26044 leader_election.cc:290] T 7be9efa6559648dbb5a0f7684c4542d1 P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:07:15.400720 19523 leader_election.cc:304] T 40e1e16737a842ee936002830f36882e P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e61c3a8f61bb48f8a963c9480e53c168; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:07:15.377182 26017 leader_election.cc:290] T b08304a0a02b42d7840c4e8ee9a6bd1a P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:07:15.421799 19526 leader_election.cc:304] T edd7d470b5014c9489be7f41f64355c9 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168; no voters: e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:07:15.375830 26321 raft_consensus.cc:493] T 76cb037fc9064d13b59a8969d897ce8c P e61c3a8f61bb48f8a963c9480e53c168 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:15.374298 26328 raft_consensus.cc:493] T 65d8cb8d6ec64f459d5a47cefab10acf P e61c3a8f61bb48f8a963c9480e53c168 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:15.371537 26319 consensus_queue.cc:1048] T 833a2f0775ed407a94b8924ce50adb63 P 127766fc592545a4997f7790f50f6076 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.059s
W20260709 13:07:15.429510 26322 log.cc:927] Time spent T 0e1085d23e8347fbbd5bce7542f4b1f4 P 127766fc592545a4997f7790f50f6076: Append to log took a long time: real 0.063s	user 0.000s	sys 0.001s
I20260709 13:07:15.366451 26316 raft_consensus.cc:515] T 2725d2c4cb054f18b0fc8f735c15f6c2 P 0473d2b2d01f4459b1e90fd12cc7840e [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:07:15.451594 19405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f93ee515a9c14139bf566522ed8232f3" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 24 candidate_status { last_received { term: 22 index: 11 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:07:15.464499 19405 raft_consensus.cc:2468] T f93ee515a9c14139bf566522ed8232f3 P e5256d91808b47c195bc9b4dbd7f2b87 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 23.
I20260709 13:07:15.452872 19408 raft_consensus.cc:1275] T 0cdf56e38bbc453d9438d359e5a69955 P e5256d91808b47c195bc9b4dbd7f2b87 [term 19 FOLLOWER]: Refusing update from remote peer 0473d2b2d01f4459b1e90fd12cc7840e: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 19 index: 13. (index mismatch)
I20260709 13:07:15.468094 19408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21e14947d70440f19044d8f75c31e1f9" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 21 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:07:15.454332 19407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "172b3dd13109415a955b71ac0e9d2234" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:07:15.456668 26276 leader_election.cc:290] T ff9b0eddd810459b82d91c60777c10eb P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 21 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:07:15.461467 26290 raft_consensus.cc:493] T b9f0d59553ad444883fcf5b5909f9798 P e5256d91808b47c195bc9b4dbd7f2b87 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 0473d2b2d01f4459b1e90fd12cc7840e)
I20260709 13:07:15.482184 19405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14efcc79969f41babe5529c22d59156d" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:07:15.399380 25851 raft_consensus.cc:515] T f1b10566f45d4a7d9029858330e02d5b P e61c3a8f61bb48f8a963c9480e53c168 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:07:15.483017 19411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edd7d470b5014c9489be7f41f64355c9" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 25 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:07:15.468827 19408 raft_consensus.cc:2468] T 21e14947d70440f19044d8f75c31e1f9 P e5256d91808b47c195bc9b4dbd7f2b87 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 20.
I20260709 13:07:15.442322 26216 raft_consensus.cc:3060] T 85c494af21f9457a85da47b9bc70c1fd P 127766fc592545a4997f7790f50f6076 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:07:15.487975 26163 raft_consensus.cc:493] T 14935b3ddf914369822e4a0547aaa355 P 127766fc592545a4997f7790f50f6076 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:15.488673 26163 raft_consensus.cc:515] T 14935b3ddf914369822e4a0547aaa355 P 127766fc592545a4997f7790f50f6076 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:07:15.495471 19407 raft_consensus.cc:1275] T e381f1d6b8184797ad142de49be225a8 P e5256d91808b47c195bc9b4dbd7f2b87 [term 18 FOLLOWER]: Refusing update from remote peer 0473d2b2d01f4459b1e90fd12cc7840e: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
I20260709 13:07:15.446185 26331 raft_consensus.cc:3055] T 0e1085d23e8347fbbd5bce7542f4b1f4 P 127766fc592545a4997f7790f50f6076 [term 16 LEADER]: Stepping down as leader of term 16
W20260709 13:07:15.455035 26246 consensus_meta.cc:287] T 76cb037fc9064d13b59a8969d897ce8c P 0473d2b2d01f4459b1e90fd12cc7840e: Time spent flushing consensus metadata: real 0.742s	user 0.013s	sys 0.005s
I20260709 13:07:15.446483 26321 raft_consensus.cc:515] T 76cb037fc9064d13b59a8969d897ce8c P e61c3a8f61bb48f8a963c9480e53c168 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:07:15.450748 26328 raft_consensus.cc:515] T 65d8cb8d6ec64f459d5a47cefab10acf P e61c3a8f61bb48f8a963c9480e53c168 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:07:15.436434 26151 raft_consensus.cc:515] T 22196caba61445d3bec98a0aab3c337d P e61c3a8f61bb48f8a963c9480e53c168 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:07:15.395187 26295 consensus_queue.cc:260] T ab43d85f64114d4ebf618930e43d9ed0 P 127766fc592545a4997f7790f50f6076 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 21.14, Last appended by leader: 14, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:07:15.424943 26270 consensus_queue.cc:237] T 85c494af21f9457a85da47b9bc70c1fd P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 18.14, Last appended by leader: 14, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:07:15.436988 26092 consensus_queue.cc:260] T 1efebf73c86e432baa55533136b6e12c P 127766fc592545a4997f7790f50f6076 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.13, Last appended by leader: 13, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:07:15.411517 26324 raft_consensus.cc:515] T 833a2f0775ed407a94b8924ce50adb63 P e61c3a8f61bb48f8a963c9480e53c168 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:07:15.512639 19408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff9b0eddd810459b82d91c60777c10eb" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
I20260709 13:07:15.504084 19411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7be9efa6559648dbb5a0f7684c4542d1" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:07:15.533022 19405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70797e5783b5454ab0d0eea663e791e3" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
W20260709 13:07:15.585866 19526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.2:46257, user_credentials={real_user=slave}} blocked reactor thread for 164139us
W20260709 13:07:15.496465 19523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.1:40321, user_credentials={real_user=slave}} blocked reactor thread for 95852.1us
I20260709 13:07:15.588734 19523 leader_election.cc:304] T ef32ce6fdd0e40d382c79974f30295c6 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e61c3a8f61bb48f8a963c9480e53c168; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87
W20260709 13:07:15.510198 26228 consensus_meta.cc:287] T ed7fdbcb96d14d418db9ca90a792588a P e61c3a8f61bb48f8a963c9480e53c168: Time spent flushing consensus metadata: real 0.758s	user 0.009s	sys 0.002s
W20260709 13:07:15.563127 26322 log.cc:927] Time spent T 0e1085d23e8347fbbd5bce7542f4b1f4 P 127766fc592545a4997f7790f50f6076: Append to log took a long time: real 0.080s	user 0.000s	sys 0.001s
W20260709 13:07:15.512331 26275 consensus_meta.cc:287] T 40e1e16737a842ee936002830f36882e P e5256d91808b47c195bc9b4dbd7f2b87: Time spent flushing consensus metadata: real 0.894s	user 0.006s	sys 0.006s
I20260709 13:07:15.497079 26162 leader_election.cc:290] T ef32ce6fdd0e40d382c79974f30295c6 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:07:15.554545 26244 raft_consensus.cc:2804] T edd7d470b5014c9489be7f41f64355c9 P e61c3a8f61bb48f8a963c9480e53c168 [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 13:07:15.514607 25851 leader_election.cc:290] T f1b10566f45d4a7d9029858330e02d5b P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:07:15.514031 25975 raft_consensus.cc:493] T 22196caba61445d3bec98a0aab3c337d P 0473d2b2d01f4459b1e90fd12cc7840e [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:15.504061 26179 leader_election.cc:290] T 70797e5783b5454ab0d0eea663e791e3 P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:07:15.507161 26163 leader_election.cc:290] T 14935b3ddf914369822e4a0547aaa355 P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:07:15.583662 26331 raft_consensus.cc:740] T 0e1085d23e8347fbbd5bce7542f4b1f4 P 127766fc592545a4997f7790f50f6076 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 127766fc592545a4997f7790f50f6076, State: Running, Role: LEADER
I20260709 13:07:15.603551 26092 raft_consensus.cc:3060] T 1efebf73c86e432baa55533136b6e12c P 127766fc592545a4997f7790f50f6076 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:07:15.519050 26334 raft_consensus.cc:2749] T 40e1e16737a842ee936002830f36882e P e61c3a8f61bb48f8a963c9480e53c168 [term 22 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
I20260709 13:07:15.505695 26316 leader_election.cc:290] T 2725d2c4cb054f18b0fc8f735c15f6c2 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:07:15.614118 19404 raft_consensus.cc:2410] T 40e1e16737a842ee936002830f36882e P e5256d91808b47c195bc9b4dbd7f2b87 [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate 0473d2b2d01f4459b1e90fd12cc7840e for term 22 because replica has last-logged OpId of term: 21 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 20 index: 11.
W20260709 13:07:15.617694 19375 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.3:36891, user_credentials={real_user=slave}} blocked reactor thread for 194850us
I20260709 13:07:15.497218 26290 raft_consensus.cc:515] T b9f0d59553ad444883fcf5b5909f9798 P e5256d91808b47c195bc9b4dbd7f2b87 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:07:15.499836 26317 consensus_queue.cc:1048] T 1dc5b3532fe54f74876d02beffa2c230 P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.111s
I20260709 13:07:15.611407 26295 raft_consensus.cc:3060] T ab43d85f64114d4ebf618930e43d9ed0 P 127766fc592545a4997f7790f50f6076 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:07:15.515071 26246 raft_consensus.cc:515] T 76cb037fc9064d13b59a8969d897ce8c P 0473d2b2d01f4459b1e90fd12cc7840e [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:07:15.618921 26244 raft_consensus.cc:493] T edd7d470b5014c9489be7f41f64355c9 P e61c3a8f61bb48f8a963c9480e53c168 [term 24 FOLLOWER]: Starting leader election (detected failure of leader e5256d91808b47c195bc9b4dbd7f2b87)
I20260709 13:07:15.631377 25975 raft_consensus.cc:515] T 22196caba61445d3bec98a0aab3c337d P 0473d2b2d01f4459b1e90fd12cc7840e [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
W20260709 13:07:15.654832 19449 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.1:40321, user_credentials={real_user=slave}} blocked reactor thread for 490729us
I20260709 13:07:15.658927 26331 consensus_queue.cc:260] T 0e1085d23e8347fbbd5bce7542f4b1f4 P 127766fc592545a4997f7790f50f6076 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.13, Last appended by leader: 13, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:07:15.659685 26151 leader_election.cc:290] T 22196caba61445d3bec98a0aab3c337d P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:07:15.660141 26349 raft_consensus.cc:493] T 217b5fae677b4971b3bbd2f357a1f7ff P e61c3a8f61bb48f8a963c9480e53c168 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:15.660748 26349 raft_consensus.cc:515] T 217b5fae677b4971b3bbd2f357a1f7ff P e61c3a8f61bb48f8a963c9480e53c168 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:07:15.649752 26347 raft_consensus.cc:493] T bc225c93219c45538b53a1bd3d387e4d P e61c3a8f61bb48f8a963c9480e53c168 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 0473d2b2d01f4459b1e90fd12cc7840e)
I20260709 13:07:15.662170 26347 raft_consensus.cc:515] T bc225c93219c45538b53a1bd3d387e4d P e61c3a8f61bb48f8a963c9480e53c168 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:07:15.663651 26321 leader_election.cc:290] T 76cb037fc9064d13b59a8969d897ce8c P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:07:15.664206 26347 leader_election.cc:290] T bc225c93219c45538b53a1bd3d387e4d P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:07:15.666644 19409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b08304a0a02b42d7840c4e8ee9a6bd1a" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:07:15.667639 19403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9962423cb4e54fcfa5de01daf68a86e7" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 20 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:07:15.667929 19408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36f6ba92b9ba46babe4ebd6c02e5fbd9" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 23 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
W20260709 13:07:15.668363 19374 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:15.633702 25851 raft_consensus.cc:493] T 1a61655d99124a29b486ba4a5b37faea P e61c3a8f61bb48f8a963c9480e53c168 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 0473d2b2d01f4459b1e90fd12cc7840e)
I20260709 13:07:15.660249 26331 raft_consensus.cc:3060] T 0e1085d23e8347fbbd5bce7542f4b1f4 P 127766fc592545a4997f7790f50f6076 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:07:15.667593 19402 raft_consensus.cc:1240] T 28af091831594f9d8e96482078cc7625 P e5256d91808b47c195bc9b4dbd7f2b87 [term 19 FOLLOWER]: Rejecting Update request from peer 0473d2b2d01f4459b1e90fd12cc7840e for earlier term 18. Current term is 19. Ops: []
I20260709 13:07:15.674959 19408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef32ce6fdd0e40d382c79974f30295c6" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 24 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:07:15.675100 19377 leader_election.cc:304] T f93ee515a9c14139bf566522ed8232f3 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:07:15.676900 19408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2725d2c4cb054f18b0fc8f735c15f6c2" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 21 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:07:15.677502 19408 raft_consensus.cc:2468] T 2725d2c4cb054f18b0fc8f735c15f6c2 P e5256d91808b47c195bc9b4dbd7f2b87 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 20.
I20260709 13:07:15.612231 26228 raft_consensus.cc:515] T ed7fdbcb96d14d418db9ca90a792588a P e61c3a8f61bb48f8a963c9480e53c168 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:07:15.694149 19377 leader_election.cc:304] T df751f992649444090e27965eb1af85d P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:07:15.671319 25923 raft_consensus.cc:493] T 40e1e16737a842ee936002830f36882e P e5256d91808b47c195bc9b4dbd7f2b87 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:15.669374 26334 raft_consensus.cc:2749] T ef32ce6fdd0e40d382c79974f30295c6 P e61c3a8f61bb48f8a963c9480e53c168 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:07:15.705700 19405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86a6797bdfe94fa496c050ceae4bd0d9" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
I20260709 13:07:15.706502 19405 raft_consensus.cc:3060] T 86a6797bdfe94fa496c050ceae4bd0d9 P e5256d91808b47c195bc9b4dbd7f2b87 [term 15 FOLLOWER]: Advancing to term 17
I20260709 13:07:15.708472 19377 leader_election.cc:304] T 46c5bfeecc314717bffe987e6844b6d0 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:07:15.670053 26244 raft_consensus.cc:3060] T edd7d470b5014c9489be7f41f64355c9 P e61c3a8f61bb48f8a963c9480e53c168 [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:07:15.714321 19554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86a6797bdfe94fa496c050ceae4bd0d9" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:07:15.715072 19554 raft_consensus.cc:3060] T 86a6797bdfe94fa496c050ceae4bd0d9 P e61c3a8f61bb48f8a963c9480e53c168 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:07:15.714413 19555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b08304a0a02b42d7840c4e8ee9a6bd1a" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:07:15.708905 26349 leader_election.cc:290] T 217b5fae677b4971b3bbd2f357a1f7ff P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:07:15.721342 19556 raft_consensus.cc:2393] T ed7fdbcb96d14d418db9ca90a792588a P e61c3a8f61bb48f8a963c9480e53c168 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 0473d2b2d01f4459b1e90fd12cc7840e in current term 18: Already voted for candidate e61c3a8f61bb48f8a963c9480e53c168 in this term.
I20260709 13:07:15.652191 26293 raft_consensus.cc:493] T b08304a0a02b42d7840c4e8ee9a6bd1a P e61c3a8f61bb48f8a963c9480e53c168 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader e5256d91808b47c195bc9b4dbd7f2b87)
I20260709 13:07:15.726323 19405 raft_consensus.cc:2468] T 86a6797bdfe94fa496c050ceae4bd0d9 P e5256d91808b47c195bc9b4dbd7f2b87 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 17.
I20260709 13:07:15.703995 26191 raft_consensus.cc:2749] T f93ee515a9c14139bf566522ed8232f3 P e5256d91808b47c195bc9b4dbd7f2b87 [term 23 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:07:15.733870 26328 leader_election.cc:290] T 65d8cb8d6ec64f459d5a47cefab10acf P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:07:15.734607 26326 consensus_queue.cc:1059] T ff75a1d4cb1f493db8f71ddc136ba9ab P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 }, Status: INVALID_TERM, Last received: 19.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:07:15.740131 26324 leader_election.cc:290] T 833a2f0775ed407a94b8924ce50adb63 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:07:15.715408 26327 raft_consensus.cc:2749] T df751f992649444090e27965eb1af85d P e5256d91808b47c195bc9b4dbd7f2b87 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:07:15.740710 26293 raft_consensus.cc:515] T b08304a0a02b42d7840c4e8ee9a6bd1a P e61c3a8f61bb48f8a963c9480e53c168 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:07:15.743029 26293 leader_election.cc:290] T b08304a0a02b42d7840c4e8ee9a6bd1a P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:07:15.744416 26290 leader_election.cc:290] T b9f0d59553ad444883fcf5b5909f9798 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:07:15.746434 19555 raft_consensus.cc:2468] T b08304a0a02b42d7840c4e8ee9a6bd1a P e61c3a8f61bb48f8a963c9480e53c168 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 21.
I20260709 13:07:15.681205 25851 raft_consensus.cc:515] T 1a61655d99124a29b486ba4a5b37faea P e61c3a8f61bb48f8a963c9480e53c168 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:07:15.761387 19551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef32ce6fdd0e40d382c79974f30295c6" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 24 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:07:15.762548 19551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2725d2c4cb054f18b0fc8f735c15f6c2" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 21 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:07:15.763166 19551 raft_consensus.cc:2468] T 2725d2c4cb054f18b0fc8f735c15f6c2 P e61c3a8f61bb48f8a963c9480e53c168 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 19.
W20260709 13:07:15.771525 26340 log.cc:927] Time spent T 7be9efa6559648dbb5a0f7684c4542d1 P 127766fc592545a4997f7790f50f6076: Append to log took a long time: real 0.273s	user 0.002s	sys 0.000s
W20260709 13:07:15.778920 19377 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.2:46257, user_credentials={real_user=slave}} blocked reactor thread for 46025.9us
I20260709 13:07:15.705369 25923 raft_consensus.cc:515] T 40e1e16737a842ee936002830f36882e P e5256d91808b47c195bc9b4dbd7f2b87 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:07:15.730355 26288 raft_consensus.cc:2749] T 46c5bfeecc314717bffe987e6844b6d0 P e5256d91808b47c195bc9b4dbd7f2b87 [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
W20260709 13:07:15.821254 19523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.1:40321, user_credentials={real_user=slave}} blocked reactor thread for 232621us
I20260709 13:07:15.822582 19523 leader_election.cc:304] T 7be9efa6559648dbb5a0f7684c4542d1 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168; no voters: 127766fc592545a4997f7790f50f6076, e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:07:15.826278 25747 raft_consensus.cc:2749] T 7be9efa6559648dbb5a0f7684c4542d1 P e61c3a8f61bb48f8a963c9480e53c168 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:07:15.802881 26154 raft_consensus.cc:493] T 76cb037fc9064d13b59a8969d897ce8c P e5256d91808b47c195bc9b4dbd7f2b87 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:15.799896 26228 leader_election.cc:290] T ed7fdbcb96d14d418db9ca90a792588a P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 18 election: Requested vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:07:15.829159 19523 leader_election.cc:400] T 7f575b143b844aa096b50997dad3516a P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 17 election: Vote denied by peer e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321) with higher term. Message: Invalid argument: T 7f575b143b844aa096b50997dad3516a P e5256d91808b47c195bc9b4dbd7f2b87 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate e61c3a8f61bb48f8a963c9480e53c168 for earlier term 17. Current term is 18.
I20260709 13:07:15.837963 25747 consensus_queue.cc:1048] T 1dc5b3532fe54f74876d02beffa2c230 P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:07:15.838992 26246 leader_election.cc:290] T 76cb037fc9064d13b59a8969d897ce8c P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 19 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:07:15.840220 19523 leader_election.cc:304] T 0cdf56e38bbc453d9438d359e5a69955 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168; no voters: 0473d2b2d01f4459b1e90fd12cc7840e
I20260709 13:07:15.840592 25851 leader_election.cc:290] T 1a61655d99124a29b486ba4a5b37faea P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:07:15.845611 19523 leader_election.cc:304] T 85c494af21f9457a85da47b9bc70c1fd P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e61c3a8f61bb48f8a963c9480e53c168; no voters: 127766fc592545a4997f7790f50f6076, e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:07:15.846453 26293 raft_consensus.cc:2749] T 85c494af21f9457a85da47b9bc70c1fd P e61c3a8f61bb48f8a963c9480e53c168 [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 13:07:15.852035 20075 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:15.846760 19523 leader_election.cc:304] T 86a6797bdfe94fa496c050ceae4bd0d9 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:07:15.863603 19523 leader_election.cc:304] T 309c3ca0ca4b4f3ba129752ea2cb293b P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: e61c3a8f61bb48f8a963c9480e53c168; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:07:15.886482 19523 leader_election.cc:304] T fa8650e71aa14778b3d73721fc50d9fc P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:07:15.893239 19403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22196caba61445d3bec98a0aab3c337d" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:07:15.893816 19409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc225c93219c45538b53a1bd3d387e4d" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:07:15.893868 19403 raft_consensus.cc:2468] T 22196caba61445d3bec98a0aab3c337d P e5256d91808b47c195bc9b4dbd7f2b87 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 20.
I20260709 13:07:15.894326 20111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "833a2f0775ed407a94b8924ce50adb63" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 17 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:07:15.894392 19408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "217b5fae677b4971b3bbd2f357a1f7ff" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:07:15.894632 19402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76cb037fc9064d13b59a8969d897ce8c" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:07:15.895381 19403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65d8cb8d6ec64f459d5a47cefab10acf" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 22 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:07:15.894541 19409 raft_consensus.cc:2468] T bc225c93219c45538b53a1bd3d387e4d P e5256d91808b47c195bc9b4dbd7f2b87 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 17.
I20260709 13:07:15.896806 19409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b08304a0a02b42d7840c4e8ee9a6bd1a" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:07:15.897765 20107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65d8cb8d6ec64f459d5a47cefab10acf" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 22 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:07:15.897850 19409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "833a2f0775ed407a94b8924ce50adb63" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 17 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:07:15.901335 20111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed7fdbcb96d14d418db9ca90a792588a" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076"
I20260709 13:07:15.902171 20111 raft_consensus.cc:2393] T ed7fdbcb96d14d418db9ca90a792588a P 127766fc592545a4997f7790f50f6076 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate e61c3a8f61bb48f8a963c9480e53c168 in current term 18: Already voted for candidate 0473d2b2d01f4459b1e90fd12cc7840e in this term.
I20260709 13:07:15.339913 18300 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:07:15.914501 19408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a61655d99124a29b486ba4a5b37faea" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:07:15.915961 19554 raft_consensus.cc:2468] T 86a6797bdfe94fa496c050ceae4bd0d9 P e61c3a8f61bb48f8a963c9480e53c168 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 17.
I20260709 13:07:15.919103 19405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1b10566f45d4a7d9029858330e02d5b" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:07:15.919064 19404 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52342 (request call id 3366) took 1365 ms. Trace:
I20260709 13:07:15.920396 19404 rpcz_store.cc:276] 0709 13:07:14.550504 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:14.550614 (+   110us) service_pool.cc:224] Handling call
0709 13:07:15.910888 (+1360274us) spinlock_profiling.cc:243] Waited 1.04 s on lock 0x7b54000b31d4. stack: 00007f4a79de9343 00007f4a79de9240 00007f4a797781d4 00007f4a834b6304 00007f4a834b6299 00007f4a7ce71571 00007f4a7cf0c2fa 00007f4a81ecdb17 00007f4a7b4486d4 00007f4a7b448662 00007f4a7b448591 00007f4a7b44850c 00007f4a7b4477c2 00007f4a7b24348c 00007f4a7b2428c6 00007f4a7b24226f
0709 13:07:15.915411 (+  4523us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2394537856}
I20260709 13:07:15.829566 26154 raft_consensus.cc:515] T 76cb037fc9064d13b59a8969d897ce8c P e5256d91808b47c195bc9b4dbd7f2b87 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:07:15.888885 26324 raft_consensus.cc:2749] T 309c3ca0ca4b4f3ba129752ea2cb293b P e61c3a8f61bb48f8a963c9480e53c168 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:07:15.924652 19407 raft_consensus.cc:1240] T 85c494af21f9457a85da47b9bc70c1fd P e5256d91808b47c195bc9b4dbd7f2b87 [term 19 LEADER]: Rejecting Update request from peer 127766fc592545a4997f7790f50f6076 for earlier term 18. Current term is 19. Ops: []
I20260709 13:07:15.896801 26228 raft_consensus.cc:2804] T fa8650e71aa14778b3d73721fc50d9fc P e61c3a8f61bb48f8a963c9480e53c168 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:07:15.885304 26328 consensus_queue.cc:1048] T 21e14947d70440f19044d8f75c31e1f9 P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.038s
I20260709 13:07:15.912595 25975 leader_election.cc:290] T 22196caba61445d3bec98a0aab3c337d P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:07:15.917917 25851 raft_consensus.cc:2764] T 86a6797bdfe94fa496c050ceae4bd0d9 P e61c3a8f61bb48f8a963c9480e53c168 [term 17 FOLLOWER]: Leader pre-election decision vote started in defunct term 16: won
I20260709 13:07:15.892481 26321 consensus_queue.cc:1048] T f93ee515a9c14139bf566522ed8232f3 P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.039s
I20260709 13:07:15.935561 19402 raft_consensus.cc:2468] T 76cb037fc9064d13b59a8969d897ce8c P e5256d91808b47c195bc9b4dbd7f2b87 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 19.
I20260709 13:07:15.896278 26266 consensus_queue.cc:1059] T ff9b0eddd810459b82d91c60777c10eb P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false }, Status: INVALID_TERM, Last received: 20.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.037s
I20260709 13:07:15.964246 25923 leader_election.cc:290] T 40e1e16737a842ee936002830f36882e P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
W20260709 13:07:15.965161 19436 heartbeater.cc:646] Failed to heartbeat to 127.17.223.62:36283 (0 consecutive failures): Timed out: Failed to send heartbeat to master: TSHeartbeat RPC to 127.17.223.62:36283 timed out after 15.000s (SENT)
I20260709 13:07:15.933895 26228 raft_consensus.cc:493] T fa8650e71aa14778b3d73721fc50d9fc P e61c3a8f61bb48f8a963c9480e53c168 [term 20 FOLLOWER]: Starting leader election (detected failure of leader e5256d91808b47c195bc9b4dbd7f2b87)
I20260709 13:07:15.986403 26154 leader_election.cc:290] T 76cb037fc9064d13b59a8969d897ce8c P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:07:15.987322 26266 raft_consensus.cc:3055] T ff9b0eddd810459b82d91c60777c10eb P e5256d91808b47c195bc9b4dbd7f2b87 [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:07:15.992940 26244 raft_consensus.cc:515] T edd7d470b5014c9489be7f41f64355c9 P e61c3a8f61bb48f8a963c9480e53c168 [term 25 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:07:16.000814 26228 raft_consensus.cc:3060] T fa8650e71aa14778b3d73721fc50d9fc P e61c3a8f61bb48f8a963c9480e53c168 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:07:16.021303 26244 leader_election.cc:290] T edd7d470b5014c9489be7f41f64355c9 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 25 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:07:16.021620 20107 raft_consensus.cc:1275] T ece3db938bc649d4a40a51522ed5259c P 127766fc592545a4997f7790f50f6076 [term 16 FOLLOWER]: Refusing update from remote peer e61c3a8f61bb48f8a963c9480e53c168: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 13:07:16.023146 19411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edd7d470b5014c9489be7f41f64355c9" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 25 candidate_status { last_received { term: 24 index: 13 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
I20260709 13:07:16.024992 26328 consensus_queue.cc:1048] T ece3db938bc649d4a40a51522ed5259c P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Connected to new peer: Peer: permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:07:16.027951 26275 raft_consensus.cc:3055] T ff75a1d4cb1f493db8f71ddc136ba9ab P e5256d91808b47c195bc9b4dbd7f2b87 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:07:16.028373 26275 raft_consensus.cc:740] T ff75a1d4cb1f493db8f71ddc136ba9ab P e5256d91808b47c195bc9b4dbd7f2b87 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: e5256d91808b47c195bc9b4dbd7f2b87, State: Running, Role: LEADER
I20260709 13:07:16.029119 26275 consensus_queue.cc:260] T ff75a1d4cb1f493db8f71ddc136ba9ab P e5256d91808b47c195bc9b4dbd7f2b87 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 19.10, Last appended by leader: 10, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:07:16.030419 26275 raft_consensus.cc:3060] T ff75a1d4cb1f493db8f71ddc136ba9ab P e5256d91808b47c195bc9b4dbd7f2b87 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:07:16.000512 26266 raft_consensus.cc:740] T ff9b0eddd810459b82d91c60777c10eb P e5256d91808b47c195bc9b4dbd7f2b87 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: e5256d91808b47c195bc9b4dbd7f2b87, State: Running, Role: LEADER
I20260709 13:07:16.009209 26293 raft_consensus.cc:493] T ff75a1d4cb1f493db8f71ddc136ba9ab P e61c3a8f61bb48f8a963c9480e53c168 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader e5256d91808b47c195bc9b4dbd7f2b87)
I20260709 13:07:16.006853 25747 raft_consensus.cc:2804] T 0cdf56e38bbc453d9438d359e5a69955 P e61c3a8f61bb48f8a963c9480e53c168 [term 19 FOLLOWER]: Leader pre-election won for term 20
W20260709 13:07:16.039885 26329 log.cc:927] Time spent T 9962423cb4e54fcfa5de01daf68a86e7 P 127766fc592545a4997f7790f50f6076: Append to log took a long time: real 0.600s	user 0.004s	sys 0.001s
I20260709 13:07:16.040071 26266 consensus_queue.cc:260] T ff9b0eddd810459b82d91c60777c10eb P e5256d91808b47c195bc9b4dbd7f2b87 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 20.14, Last appended by leader: 14, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:07:16.048295 20112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36f6ba92b9ba46babe4ebd6c02e5fbd9" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 23 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
W20260709 13:07:16.049546 20078 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:16.048156 20111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14efcc79969f41babe5529c22d59156d" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:07:16.050927 20109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9962423cb4e54fcfa5de01daf68a86e7" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 20 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:07:16.054430 26266 raft_consensus.cc:3060] T ff9b0eddd810459b82d91c60777c10eb P e5256d91808b47c195bc9b4dbd7f2b87 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:07:16.054715 26331 raft_consensus.cc:493] T fa731b585f684a7fb2d106c50f143b83 P 127766fc592545a4997f7790f50f6076 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader e5256d91808b47c195bc9b4dbd7f2b87)
I20260709 13:07:16.055207 26331 raft_consensus.cc:515] T fa731b585f684a7fb2d106c50f143b83 P 127766fc592545a4997f7790f50f6076 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:07:16.057150 26331 leader_election.cc:290] T fa731b585f684a7fb2d106c50f143b83 P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:07:16.059196 19557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7be9efa6559648dbb5a0f7684c4542d1" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:07:16.059823 19554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70797e5783b5454ab0d0eea663e791e3" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:07:16.061269 19554 raft_consensus.cc:2468] T 70797e5783b5454ab0d0eea663e791e3 P e61c3a8f61bb48f8a963c9480e53c168 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 127766fc592545a4997f7790f50f6076 in term 22.
I20260709 13:07:16.059887 19557 raft_consensus.cc:2468] T 7be9efa6559648dbb5a0f7684c4542d1 P e61c3a8f61bb48f8a963c9480e53c168 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 127766fc592545a4997f7790f50f6076 in term 21.
I20260709 13:07:16.062701 19558 raft_consensus.cc:1275] T 833a2f0775ed407a94b8924ce50adb63 P e61c3a8f61bb48f8a963c9480e53c168 [term 16 FOLLOWER]: Refusing update from remote peer 127766fc592545a4997f7790f50f6076: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 13:07:16.059592 19551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14935b3ddf914369822e4a0547aaa355" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 16 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
W20260709 13:07:16.063484 20077 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:16.075655 19405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa731b585f684a7fb2d106c50f143b83" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:07:16.044106 26293 raft_consensus.cc:515] T ff75a1d4cb1f493db8f71ddc136ba9ab P e61c3a8f61bb48f8a963c9480e53c168 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
W20260709 13:07:16.083820 26367 log.cc:927] Time spent T 14935b3ddf914369822e4a0547aaa355 P e61c3a8f61bb48f8a963c9480e53c168: Append to log took a long time: real 0.070s	user 0.003s	sys 0.000s
I20260709 13:07:16.084630 19554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa731b585f684a7fb2d106c50f143b83" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:07:16.076118 26295 consensus_queue.cc:1048] T 172b3dd13109415a955b71ac0e9d2234 P 127766fc592545a4997f7790f50f6076 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.016s
W20260709 13:07:16.102145 19377 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:16.090987 26328 raft_consensus.cc:493] T a08760e15aac4630a629431f56024dc8 P e61c3a8f61bb48f8a963c9480e53c168 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader e5256d91808b47c195bc9b4dbd7f2b87)
I20260709 13:07:16.122294 25376 leader_election.cc:290] T 86a6797bdfe94fa496c050ceae4bd0d9 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 17 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:07:16.109277 26328 raft_consensus.cc:515] T a08760e15aac4630a629431f56024dc8 P e61c3a8f61bb48f8a963c9480e53c168 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:07:16.130388 26228 raft_consensus.cc:515] T fa8650e71aa14778b3d73721fc50d9fc P e61c3a8f61bb48f8a963c9480e53c168 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:07:16.160487 19486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa8650e71aa14778b3d73721fc50d9fc" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:07:16.160653 19477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86a6797bdfe94fa496c050ceae4bd0d9" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:07:16.161293 19486 raft_consensus.cc:2393] T fa8650e71aa14778b3d73721fc50d9fc P 0473d2b2d01f4459b1e90fd12cc7840e [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e61c3a8f61bb48f8a963c9480e53c168 in current term 21: Already voted for candidate 0473d2b2d01f4459b1e90fd12cc7840e in this term.
I20260709 13:07:16.161706 19477 raft_consensus.cc:2393] T 86a6797bdfe94fa496c050ceae4bd0d9 P 0473d2b2d01f4459b1e90fd12cc7840e [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e61c3a8f61bb48f8a963c9480e53c168 in current term 17: Already voted for candidate 0473d2b2d01f4459b1e90fd12cc7840e in this term.
I20260709 13:07:16.164959 19485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "179fd671030940b4b4a4e24bcc4aba0a" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:07:16.166128 19478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28af091831594f9d8e96482078cc7625" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: true dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:07:16.168066 19481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7be9efa6559648dbb5a0f7684c4542d1" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:07:16.169118 19481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14935b3ddf914369822e4a0547aaa355" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 16 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:07:16.170786 19484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2725d2c4cb054f18b0fc8f735c15f6c2" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:07:16.171329 19484 raft_consensus.cc:2468] T 2725d2c4cb054f18b0fc8f735c15f6c2 P 0473d2b2d01f4459b1e90fd12cc7840e [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 20.
W20260709 13:07:16.171784 20077 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:16.175526 19478 raft_consensus.cc:3055] T 28af091831594f9d8e96482078cc7625 P 0473d2b2d01f4459b1e90fd12cc7840e [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:07:16.175894 19478 raft_consensus.cc:740] T 28af091831594f9d8e96482078cc7625 P 0473d2b2d01f4459b1e90fd12cc7840e [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 0473d2b2d01f4459b1e90fd12cc7840e, State: Running, Role: LEADER
I20260709 13:07:16.166445 19485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff9b0eddd810459b82d91c60777c10eb" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:07:16.178558 19485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc225c93219c45538b53a1bd3d387e4d" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:07:16.172874 19482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1b10566f45d4a7d9029858330e02d5b" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:07:16.179730 19477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22196caba61445d3bec98a0aab3c337d" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:07:16.180030 19482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "217b5fae677b4971b3bbd2f357a1f7ff" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:07:16.180609 19482 raft_consensus.cc:2468] T 217b5fae677b4971b3bbd2f357a1f7ff P 0473d2b2d01f4459b1e90fd12cc7840e [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 17.
I20260709 13:07:16.181416 19482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76cb037fc9064d13b59a8969d897ce8c" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:07:16.181903 19482 raft_consensus.cc:2468] T 76cb037fc9064d13b59a8969d897ce8c P 0473d2b2d01f4459b1e90fd12cc7840e [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 19.
I20260709 13:07:16.183271 19480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b74109013a140ada21feeef92d6f563" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 19 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:07:16.183954 25975 raft_consensus.cc:493] T 1dc5b3532fe54f74876d02beffa2c230 P 0473d2b2d01f4459b1e90fd12cc7840e [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:16.180475 19477 raft_consensus.cc:2468] T 22196caba61445d3bec98a0aab3c337d P 0473d2b2d01f4459b1e90fd12cc7840e [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 20.
W20260709 13:07:16.184897 26369 log.cc:927] Time spent T 1dc5b3532fe54f74876d02beffa2c230 P e5256d91808b47c195bc9b4dbd7f2b87: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
W20260709 13:07:16.185554 26371 log.cc:927] Time spent T 0cdf56e38bbc453d9438d359e5a69955 P e61c3a8f61bb48f8a963c9480e53c168: Append to log took a long time: real 0.162s	user 0.000s	sys 0.003s
I20260709 13:07:16.186652 26162 raft_consensus.cc:493] T d1e5873a19244c5ebbcd38e126796ee7 P 0473d2b2d01f4459b1e90fd12cc7840e [term 22 FOLLOWER]: Starting pre-election (detected failure of leader e5256d91808b47c195bc9b4dbd7f2b87)
I20260709 13:07:16.203379 26162 raft_consensus.cc:515] T d1e5873a19244c5ebbcd38e126796ee7 P 0473d2b2d01f4459b1e90fd12cc7840e [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:07:16.204514 19554 raft_consensus.cc:1275] T 7f575b143b844aa096b50997dad3516a P e61c3a8f61bb48f8a963c9480e53c168 [term 18 FOLLOWER]: Refusing update from remote peer e5256d91808b47c195bc9b4dbd7f2b87: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 18 index: 12. (index mismatch)
I20260709 13:07:16.204545 26151 raft_consensus.cc:493] T 4af19371ea874c09a0a2147040835cbb P e61c3a8f61bb48f8a963c9480e53c168 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader e5256d91808b47c195bc9b4dbd7f2b87)
I20260709 13:07:16.205265 26151 raft_consensus.cc:515] T 4af19371ea874c09a0a2147040835cbb P e61c3a8f61bb48f8a963c9480e53c168 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:07:16.205722 26162 leader_election.cc:290] T d1e5873a19244c5ebbcd38e126796ee7 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:07:16.206353 19557 raft_consensus.cc:1240] T edd7d470b5014c9489be7f41f64355c9 P e61c3a8f61bb48f8a963c9480e53c168 [term 25 FOLLOWER]: Rejecting Update request from peer e5256d91808b47c195bc9b4dbd7f2b87 for earlier term 24. Current term is 25. Ops: []
I20260709 13:07:16.176578 19478 consensus_queue.cc:260] T 28af091831594f9d8e96482078cc7625 P 0473d2b2d01f4459b1e90fd12cc7840e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 18.10, Last appended by leader: 10, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:07:16.207285 26151 leader_election.cc:290] T 4af19371ea874c09a0a2147040835cbb P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:07:16.207373 19478 raft_consensus.cc:3060] T 28af091831594f9d8e96482078cc7625 P 0473d2b2d01f4459b1e90fd12cc7840e [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:07:16.207864 26151 raft_consensus.cc:493] T d1e5873a19244c5ebbcd38e126796ee7 P e61c3a8f61bb48f8a963c9480e53c168 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader e5256d91808b47c195bc9b4dbd7f2b87)
I20260709 13:07:16.208397 26151 raft_consensus.cc:515] T d1e5873a19244c5ebbcd38e126796ee7 P e61c3a8f61bb48f8a963c9480e53c168 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
W20260709 13:07:16.197583 26339 log.cc:927] Time spent T ff9b0eddd810459b82d91c60777c10eb P 0473d2b2d01f4459b1e90fd12cc7840e: Append to log took a long time: real 0.741s	user 0.000s	sys 0.007s
I20260709 13:07:16.227629 19477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed7fdbcb96d14d418db9ca90a792588a" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:07:16.228643 19477 raft_consensus.cc:2393] T ed7fdbcb96d14d418db9ca90a792588a P 0473d2b2d01f4459b1e90fd12cc7840e [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate e61c3a8f61bb48f8a963c9480e53c168 in current term 18: Already voted for candidate 0473d2b2d01f4459b1e90fd12cc7840e in this term.
I20260709 13:07:16.232209 19559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9f0d59553ad444883fcf5b5909f9798" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:07:16.177867 26204 raft_consensus.cc:493] T a08760e15aac4630a629431f56024dc8 P 0473d2b2d01f4459b1e90fd12cc7840e [term 23 FOLLOWER]: Starting pre-election (detected failure of leader e5256d91808b47c195bc9b4dbd7f2b87)
I20260709 13:07:16.235340 19482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a61655d99124a29b486ba4a5b37faea" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:07:16.210258 26316 raft_consensus.cc:493] T 2e36a9d6e29c4a7c860cf267efbd4c74 P 0473d2b2d01f4459b1e90fd12cc7840e [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:16.232128 26246 raft_consensus.cc:493] T fa8650e71aa14778b3d73721fc50d9fc P 0473d2b2d01f4459b1e90fd12cc7840e [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:16.262521 19477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b08304a0a02b42d7840c4e8ee9a6bd1a" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:07:16.281183 19477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff75a1d4cb1f493db8f71ddc136ba9ab" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:07:16.282037 19477 raft_consensus.cc:2393] T ff75a1d4cb1f493db8f71ddc136ba9ab P 0473d2b2d01f4459b1e90fd12cc7840e [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e61c3a8f61bb48f8a963c9480e53c168 in current term 20: Already voted for candidate 0473d2b2d01f4459b1e90fd12cc7840e in this term.
I20260709 13:07:16.259150 19482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edd7d470b5014c9489be7f41f64355c9" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 25 candidate_status { last_received { term: 24 index: 13 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:07:16.275802 19478 raft_consensus.cc:2468] T 28af091831594f9d8e96482078cc7625 P 0473d2b2d01f4459b1e90fd12cc7840e [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 19.
I20260709 13:07:16.207401 25747 raft_consensus.cc:493] T 0cdf56e38bbc453d9438d359e5a69955 P e61c3a8f61bb48f8a963c9480e53c168 [term 19 FOLLOWER]: Starting leader election (detected failure of leader 0473d2b2d01f4459b1e90fd12cc7840e)
W20260709 13:07:16.210536 26241 consensus_queue.cc:1175] T 28af091831594f9d8e96482078cc7625 P 0473d2b2d01f4459b1e90fd12cc7840e [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "e61c3a8f61bb48f8a963c9480e53c168" responder_term: 19 status { last_received { term: 18 index: 10 } last_committed_idx: 10 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer 0473d2b2d01f4459b1e90fd12cc7840e for earlier term 18. Current term is 19. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 13:07:16.239466 26101 raft_consensus.cc:493] T 46c5bfeecc314717bffe987e6844b6d0 P 0473d2b2d01f4459b1e90fd12cc7840e [term 25 FOLLOWER]: Starting pre-election (detected failure of leader e61c3a8f61bb48f8a963c9480e53c168)
I20260709 13:07:16.286470 19551 raft_consensus.cc:1275] T 2e36a9d6e29c4a7c860cf267efbd4c74 P e61c3a8f61bb48f8a963c9480e53c168 [term 15 FOLLOWER]: Refusing update from remote peer e5256d91808b47c195bc9b4dbd7f2b87: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 15 index: 8. (index mismatch)
I20260709 13:07:16.292624 19559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76cb037fc9064d13b59a8969d897ce8c" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:07:16.287045 19558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40e1e16737a842ee936002830f36882e" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 23 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:07:16.293263 19559 raft_consensus.cc:2468] T 76cb037fc9064d13b59a8969d897ce8c P e61c3a8f61bb48f8a963c9480e53c168 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 19.
I20260709 13:07:16.214845 25975 raft_consensus.cc:515] T 1dc5b3532fe54f74876d02beffa2c230 P 0473d2b2d01f4459b1e90fd12cc7840e [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:07:16.249244 26293 leader_election.cc:290] T ff75a1d4cb1f493db8f71ddc136ba9ab P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:07:16.293699 19558 raft_consensus.cc:2468] T 40e1e16737a842ee936002830f36882e P e61c3a8f61bb48f8a963c9480e53c168 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 22.
I20260709 13:07:16.301005 19559 raft_consensus.cc:1275] T 217b5fae677b4971b3bbd2f357a1f7ff P e61c3a8f61bb48f8a963c9480e53c168 [term 17 FOLLOWER]: Refusing update from remote peer e5256d91808b47c195bc9b4dbd7f2b87: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 17 index: 10. (term mismatch)
I20260709 13:07:16.301347 19559 pending_rounds.cc:85] T 217b5fae677b4971b3bbd2f357a1f7ff P e61c3a8f61bb48f8a963c9480e53c168: Aborting all ops after (but not including) 9
I20260709 13:07:16.301554 19559 pending_rounds.cc:107] T 217b5fae677b4971b3bbd2f357a1f7ff P e61c3a8f61bb48f8a963c9480e53c168: Aborting uncommitted NO_OP operation due to leader change: 16.10
I20260709 13:07:16.301781 19559 raft_consensus.cc:2889] T 217b5fae677b4971b3bbd2f357a1f7ff P e61c3a8f61bb48f8a963c9480e53c168 [term 17 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:07:16.289821 19555 raft_consensus.cc:1240] T ece3db938bc649d4a40a51522ed5259c P e61c3a8f61bb48f8a963c9480e53c168 [term 16 LEADER]: Rejecting Update request from peer e5256d91808b47c195bc9b4dbd7f2b87 for earlier term 15. Current term is 16. Ops: []
I20260709 13:07:16.302091 19449 leader_election.cc:304] T 1efebf73c86e432baa55533136b6e12c P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e; no voters: 127766fc592545a4997f7790f50f6076, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:07:16.308756 19449 leader_election.cc:304] T ab43d85f64114d4ebf618930e43d9ed0 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e; no voters: 127766fc592545a4997f7790f50f6076, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:07:16.305248 19523 leader_election.cc:304] T 2a16f7501e2444fb86d4e2778e734e02 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e61c3a8f61bb48f8a963c9480e53c168; no voters: 127766fc592545a4997f7790f50f6076, e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:07:16.313169 19523 leader_election.cc:304] T 28af091831594f9d8e96482078cc7625 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:07:16.291396 25747 raft_consensus.cc:3060] T 0cdf56e38bbc453d9438d359e5a69955 P e61c3a8f61bb48f8a963c9480e53c168 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:07:16.248499 26204 raft_consensus.cc:515] T a08760e15aac4630a629431f56024dc8 P 0473d2b2d01f4459b1e90fd12cc7840e [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:07:16.315960 19523 leader_election.cc:304] T 22196caba61445d3bec98a0aab3c337d P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:07:16.315048 19449 leader_election.cc:304] T 0e1085d23e8347fbbd5bce7542f4b1f4 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e; no voters: 127766fc592545a4997f7790f50f6076, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:07:16.294378 26101 raft_consensus.cc:515] T 46c5bfeecc314717bffe987e6844b6d0 P 0473d2b2d01f4459b1e90fd12cc7840e [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:07:16.338887 19479 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58294 (request call id 3036) took 1130 ms. Trace:
I20260709 13:07:16.323498 19523 leader_election.cc:304] T bc225c93219c45538b53a1bd3d387e4d P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:07:16.332901 19449 leader_election.cc:304] T ed7fdbcb96d14d418db9ca90a792588a P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, 127766fc592545a4997f7790f50f6076; no voters: 
I20260709 13:07:16.342151 19523 leader_election.cc:304] T 65d8cb8d6ec64f459d5a47cefab10acf P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e61c3a8f61bb48f8a963c9480e53c168; no voters: 127766fc592545a4997f7790f50f6076, e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:07:16.297835 26163 raft_consensus.cc:493] T 96efeaaf1057492490e9a621f37e1a2d P 127766fc592545a4997f7790f50f6076 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 0473d2b2d01f4459b1e90fd12cc7840e)
I20260709 13:07:16.314162 26017 raft_consensus.cc:2749] T 1efebf73c86e432baa55533136b6e12c P 0473d2b2d01f4459b1e90fd12cc7840e [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:07:16.339318 19479 rpcz_store.cc:276] 0709 13:07:15.208975 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:15.209146 (+   171us) service_pool.cc:224] Handling call
0709 13:07:15.209501 (+   355us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:15.212271 (+  2770us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:15.212313 (+    42us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:15.212839 (+   526us) log.cc:844] Serialized 26 byte log entry
0709 13:07:15.320669 (+107830us) raft_consensus.cc:1645] Marking committed up to 14
0709 13:07:15.486980 (+166311us) log.cc:844] Serialized 14 byte log entry
0709 13:07:15.488717 (+  1737us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:15.488791 (+    74us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:16.177897 (+689106us) spinlock_profiling.cc:243] Waited 58.5 ms on lock 0x7b4400022b4c. stack: 00007f4a79de9343 00007f4a79de9240 00007f4a797781d4 00007f4a834b6304 00007f4a834b6299 00007f4a79ca3db1 00007f4a79d41c85 00007f4a79d426a2 00007f4a7cab41db 00007f4a7caafaaf 00007f4a7caa386e 00007f4a7caa2bb6 00007f4a7caa27d8 00007f4a7caac221 00007f4a7caac1d9 00007f4a7caac169
0709 13:07:16.320602 (+142705us) raft_consensus.cc:1685] finished
0709 13:07:16.338693 (+ 18091us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:16.338831 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2276,"prepare.queue_time_us":135924,"prepare.run_cpu_time_us":30,"prepare.run_wall_time_us":30,"raft.queue_time_us":4462,"raft.run_cpu_time_us":245,"raft.run_wall_time_us":16256,"spinlock_wait_cycles":134552320,"thread_start_us":201412,"threads_started":2,"wal-append.queue_time_us":222828}
I20260709 13:07:16.348322 19523 leader_election.cc:304] T 833a2f0775ed407a94b8924ce50adb63 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e61c3a8f61bb48f8a963c9480e53c168; no voters: 127766fc592545a4997f7790f50f6076, e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:07:16.284170 26246 raft_consensus.cc:515] T fa8650e71aa14778b3d73721fc50d9fc P 0473d2b2d01f4459b1e90fd12cc7840e [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:07:16.285794 26316 raft_consensus.cc:515] T 2e36a9d6e29c4a7c860cf267efbd4c74 P 0473d2b2d01f4459b1e90fd12cc7840e [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:07:16.319875 25871 raft_consensus.cc:2749] T ab43d85f64114d4ebf618930e43d9ed0 P 0473d2b2d01f4459b1e90fd12cc7840e [term 22 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
I20260709 13:07:16.320111 26349 raft_consensus.cc:2804] T 28af091831594f9d8e96482078cc7625 P e61c3a8f61bb48f8a963c9480e53c168 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:07:16.318080 26293 raft_consensus.cc:2749] T 2a16f7501e2444fb86d4e2778e734e02 P e61c3a8f61bb48f8a963c9480e53c168 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:07:16.365423 19523 leader_election.cc:304] T 76cb037fc9064d13b59a8969d897ce8c P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:07:16.320894 26328 leader_election.cc:290] T a08760e15aac4630a629431f56024dc8 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:07:16.341420 26160 raft_consensus.cc:2804] T 22196caba61445d3bec98a0aab3c337d P e61c3a8f61bb48f8a963c9480e53c168 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:07:16.341111 26162 raft_consensus.cc:2749] T 0e1085d23e8347fbbd5bce7542f4b1f4 P 0473d2b2d01f4459b1e90fd12cc7840e [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:07:16.388638 20076 leader_election.cc:304] T 70797e5783b5454ab0d0eea663e791e3 P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 127766fc592545a4997f7790f50f6076, e61c3a8f61bb48f8a963c9480e53c168; no voters: e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:07:16.387778 19375 leader_election.cc:304] T 76cb037fc9064d13b59a8969d897ce8c P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
W20260709 13:07:16.338054 19450 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.3:36891, user_credentials={real_user=slave}} blocked reactor thread for 172398us
I20260709 13:07:16.362702 26017 raft_consensus.cc:2804] T ed7fdbcb96d14d418db9ca90a792588a P 0473d2b2d01f4459b1e90fd12cc7840e [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:07:16.394205 20107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4af19371ea874c09a0a2147040835cbb" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:07:16.394794 26017 raft_consensus.cc:697] T ed7fdbcb96d14d418db9ca90a792588a P 0473d2b2d01f4459b1e90fd12cc7840e [term 18 LEADER]: Becoming Leader. State: Replica: 0473d2b2d01f4459b1e90fd12cc7840e, State: Running, Role: LEADER
I20260709 13:07:16.394896 26349 raft_consensus.cc:697] T 28af091831594f9d8e96482078cc7625 P e61c3a8f61bb48f8a963c9480e53c168 [term 19 LEADER]: Becoming Leader. State: Replica: e61c3a8f61bb48f8a963c9480e53c168, State: Running, Role: LEADER
I20260709 13:07:16.395884 26017 consensus_queue.cc:237] T ed7fdbcb96d14d418db9ca90a792588a P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.13, Last appended by leader: 13, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:07:16.395920 26349 consensus_queue.cc:237] T 28af091831594f9d8e96482078cc7625 P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 18.10, Last appended by leader: 10, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:07:16.397156 26328 raft_consensus.cc:2804] T 76cb037fc9064d13b59a8969d897ce8c P e61c3a8f61bb48f8a963c9480e53c168 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:07:16.397564 26328 raft_consensus.cc:493] T 76cb037fc9064d13b59a8969d897ce8c P e61c3a8f61bb48f8a963c9480e53c168 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:16.397899 26328 raft_consensus.cc:3060] T 76cb037fc9064d13b59a8969d897ce8c P e61c3a8f61bb48f8a963c9480e53c168 [term 19 FOLLOWER]: Advancing to term 20
W20260709 13:07:16.401194 26376 log.cc:927] Time spent T 21e14947d70440f19044d8f75c31e1f9 P e5256d91808b47c195bc9b4dbd7f2b87: Append to log took a long time: real 0.122s	user 0.000s	sys 0.000s
I20260709 13:07:16.403465 26270 consensus_queue.cc:1048] T 2e36a9d6e29c4a7c860cf267efbd4c74 P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:07:16.405536 26330 raft_consensus.cc:2804] T 70797e5783b5454ab0d0eea663e791e3 P 127766fc592545a4997f7790f50f6076 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:07:16.405998 26330 raft_consensus.cc:493] T 70797e5783b5454ab0d0eea663e791e3 P 127766fc592545a4997f7790f50f6076 [term 22 FOLLOWER]: Starting leader election (detected failure of leader e5256d91808b47c195bc9b4dbd7f2b87)
I20260709 13:07:16.406394 26330 raft_consensus.cc:3060] T 70797e5783b5454ab0d0eea663e791e3 P 127766fc592545a4997f7790f50f6076 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:07:16.406849 26151 leader_election.cc:290] T d1e5873a19244c5ebbcd38e126796ee7 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:07:16.353786 26289 raft_consensus.cc:493] T 1a61655d99124a29b486ba4a5b37faea P e5256d91808b47c195bc9b4dbd7f2b87 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 0473d2b2d01f4459b1e90fd12cc7840e)
I20260709 13:07:16.413143 26289 raft_consensus.cc:515] T 1a61655d99124a29b486ba4a5b37faea P e5256d91808b47c195bc9b4dbd7f2b87 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:07:16.391439 26160 raft_consensus.cc:493] T 22196caba61445d3bec98a0aab3c337d P e61c3a8f61bb48f8a963c9480e53c168 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:16.414350 26160 raft_consensus.cc:3060] T 22196caba61445d3bec98a0aab3c337d P e61c3a8f61bb48f8a963c9480e53c168 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:07:16.367372 26262 consensus_queue.cc:1059] T edd7d470b5014c9489be7f41f64355c9 P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 }, Status: INVALID_TERM, Last received: 24.13, Next index: 14, Last known committed idx: 12, Time since last communication: 0.052s
W20260709 13:07:16.415675 19308 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:44676 (request call id 225) took 15829 ms (client timeout 15000 ms). Trace:
I20260709 13:07:16.416085 26262 raft_consensus.cc:3055] T edd7d470b5014c9489be7f41f64355c9 P e5256d91808b47c195bc9b4dbd7f2b87 [term 24 LEADER]: Stepping down as leader of term 24
I20260709 13:07:16.416800 26262 raft_consensus.cc:740] T edd7d470b5014c9489be7f41f64355c9 P e5256d91808b47c195bc9b4dbd7f2b87 [term 24 LEADER]: Becoming Follower/Learner. State: Replica: e5256d91808b47c195bc9b4dbd7f2b87, State: Running, Role: LEADER
I20260709 13:07:16.417811 26262 consensus_queue.cc:260] T edd7d470b5014c9489be7f41f64355c9 P e5256d91808b47c195bc9b4dbd7f2b87 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 24.13, Last appended by leader: 13, Current term: 24, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:07:16.368956 26228 leader_election.cc:290] T fa8650e71aa14778b3d73721fc50d9fc P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 21 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:07:16.355340 25851 raft_consensus.cc:2804] T bc225c93219c45538b53a1bd3d387e4d P e61c3a8f61bb48f8a963c9480e53c168 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:07:16.354525 26244 raft_consensus.cc:2749] T 65d8cb8d6ec64f459d5a47cefab10acf P e61c3a8f61bb48f8a963c9480e53c168 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:07:16.366292 26321 raft_consensus.cc:2749] T 833a2f0775ed407a94b8924ce50adb63 P e61c3a8f61bb48f8a963c9480e53c168 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:07:16.433765 20076 leader_election.cc:304] T fa731b585f684a7fb2d106c50f143b83 P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 127766fc592545a4997f7790f50f6076; no voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:07:16.423336 19375 leader_election.cc:304] T 40e1e16737a842ee936002830f36882e P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:07:16.406993 19307 catalog_manager.cc:5697] T df751f992649444090e27965eb1af85d P e61c3a8f61bb48f8a963c9480e53c168 reported cstate change: term changed from 13 to 17. New cstate: current_term: 17 leader_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } }
I20260709 13:07:16.439967 26207 consensus_queue.cc:1048] T e381f1d6b8184797ad142de49be225a8 P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:07:16.355273 26348 consensus_queue.cc:1048] T 7f575b143b844aa096b50997dad3516a P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.068s
I20260709 13:07:16.444401 19307 catalog_manager.cc:5697] T e381f1d6b8184797ad142de49be225a8 P e61c3a8f61bb48f8a963c9480e53c168 reported cstate change: term changed from 8 to 12, leader changed from e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3) to e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1). New cstate: current_term: 12 leader_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } }
I20260709 13:07:16.445683 25975 leader_election.cc:290] T 1dc5b3532fe54f74876d02beffa2c230 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:07:16.446198 19307 catalog_manager.cc:5697] T 22196caba61445d3bec98a0aab3c337d P e61c3a8f61bb48f8a963c9480e53c168 reported cstate change: term changed from 10 to 13. New cstate: current_term: 13 leader_uuid: "e61c3a8f61bb48f8a963c9480e53c168" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } health_report { overall_health: HEALTHY } } }
I20260709 13:07:16.446923 26326 raft_consensus.cc:2804] T 40e1e16737a842ee936002830f36882e P e5256d91808b47c195bc9b4dbd7f2b87 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:07:16.447383 26326 raft_consensus.cc:493] T 40e1e16737a842ee936002830f36882e P e5256d91808b47c195bc9b4dbd7f2b87 [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:16.447811 26326 raft_consensus.cc:3060] T 40e1e16737a842ee936002830f36882e P e5256d91808b47c195bc9b4dbd7f2b87 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:07:16.448047 19307 catalog_manager.cc:5697] T f93ee515a9c14139bf566522ed8232f3 P e61c3a8f61bb48f8a963c9480e53c168 reported cstate change: term changed from 15 to 16, leader changed from 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2) to e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3). New cstate: current_term: 16 leader_uuid: "e61c3a8f61bb48f8a963c9480e53c168" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } health_report { overall_health: HEALTHY } } }
I20260709 13:07:16.449455 26296 consensus_queue.cc:1048] T 217b5fae677b4971b3bbd2f357a1f7ff P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:07:16.432339 19450 leader_election.cc:304] T 2725d2c4cb054f18b0fc8f735c15f6c2 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:07:16.451244 25975 raft_consensus.cc:2804] T 2725d2c4cb054f18b0fc8f735c15f6c2 P 0473d2b2d01f4459b1e90fd12cc7840e [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:07:16.451164 26296 consensus_queue.cc:1059] T ece3db938bc649d4a40a51522ed5259c P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 }, Status: INVALID_TERM, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:07:16.451807 25975 raft_consensus.cc:493] T 2725d2c4cb054f18b0fc8f735c15f6c2 P 0473d2b2d01f4459b1e90fd12cc7840e [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:16.452028 26296 consensus_queue.cc:1243] T ece3db938bc649d4a40a51522ed5259c P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Peer e61c3a8f61bb48f8a963c9480e53c168 log is divergent from this leader: its last log entry 16.13 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 12
I20260709 13:07:16.452200 25975 raft_consensus.cc:3060] T 2725d2c4cb054f18b0fc8f735c15f6c2 P 0473d2b2d01f4459b1e90fd12cc7840e [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:07:16.453076 26191 raft_consensus.cc:3055] T ece3db938bc649d4a40a51522ed5259c P e5256d91808b47c195bc9b4dbd7f2b87 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:07:16.453557 26191 raft_consensus.cc:740] T ece3db938bc649d4a40a51522ed5259c P e5256d91808b47c195bc9b4dbd7f2b87 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: e5256d91808b47c195bc9b4dbd7f2b87, State: Running, Role: LEADER
I20260709 13:07:16.446201 25905 consensus_queue.cc:1048] T 833a2f0775ed407a94b8924ce50adb63 P 127766fc592545a4997f7790f50f6076 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.009s
I20260709 13:07:16.454536 26191 consensus_queue.cc:260] T ece3db938bc649d4a40a51522ed5259c P e5256d91808b47c195bc9b4dbd7f2b87 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.13, Last appended by leader: 13, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:07:16.455681 26191 raft_consensus.cc:3060] T ece3db938bc649d4a40a51522ed5259c P e5256d91808b47c195bc9b4dbd7f2b87 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:07:16.459893 25975 raft_consensus.cc:515] T 2725d2c4cb054f18b0fc8f735c15f6c2 P 0473d2b2d01f4459b1e90fd12cc7840e [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:07:16.461961 25975 leader_election.cc:290] T 2725d2c4cb054f18b0fc8f735c15f6c2 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 21 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:07:16.463130 26044 raft_consensus.cc:2749] T fa731b585f684a7fb2d106c50f143b83 P 127766fc592545a4997f7790f50f6076 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:07:16.431121 26154 raft_consensus.cc:2804] T 76cb037fc9064d13b59a8969d897ce8c P e5256d91808b47c195bc9b4dbd7f2b87 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:07:16.464694 26154 raft_consensus.cc:493] T 76cb037fc9064d13b59a8969d897ce8c P e5256d91808b47c195bc9b4dbd7f2b87 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:16.465032 26154 raft_consensus.cc:3060] T 76cb037fc9064d13b59a8969d897ce8c P e5256d91808b47c195bc9b4dbd7f2b87 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:07:16.467556 19410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4af19371ea874c09a0a2147040835cbb" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:07:16.471680 20109 raft_consensus.cc:1240] T ece3db938bc649d4a40a51522ed5259c P 127766fc592545a4997f7790f50f6076 [term 16 FOLLOWER]: Rejecting Update request from peer e5256d91808b47c195bc9b4dbd7f2b87 for earlier term 15. Current term is 16. Ops: []
I20260709 13:07:16.474579 26241 raft_consensus.cc:493] T 775c229504194560ba9589bc2199b089 P 0473d2b2d01f4459b1e90fd12cc7840e [term 15 FOLLOWER]: Starting pre-election (detected failure of leader e5256d91808b47c195bc9b4dbd7f2b87)
I20260709 13:07:16.475147 26241 raft_consensus.cc:515] T 775c229504194560ba9589bc2199b089 P 0473d2b2d01f4459b1e90fd12cc7840e [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:07:16.477123 26241 leader_election.cc:290] T 775c229504194560ba9589bc2199b089 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:07:16.479640 26204 leader_election.cc:290] T a08760e15aac4630a629431f56024dc8 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:07:16.480743 26246 leader_election.cc:290] T fa8650e71aa14778b3d73721fc50d9fc P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:07:16.356015 26163 raft_consensus.cc:515] T 96efeaaf1057492490e9a621f37e1a2d P 127766fc592545a4997f7790f50f6076 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:07:16.481168 19450 leader_election.cc:304] T 86a6797bdfe94fa496c050ceae4bd0d9 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:07:16.481873 26246 raft_consensus.cc:2804] T 86a6797bdfe94fa496c050ceae4bd0d9 P 0473d2b2d01f4459b1e90fd12cc7840e [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:07:16.482419 26246 raft_consensus.cc:697] T 86a6797bdfe94fa496c050ceae4bd0d9 P 0473d2b2d01f4459b1e90fd12cc7840e [term 17 LEADER]: Becoming Leader. State: Replica: 0473d2b2d01f4459b1e90fd12cc7840e, State: Running, Role: LEADER
I20260709 13:07:16.335906 26245 consensus_queue.cc:1048] T 14935b3ddf914369822e4a0547aaa355 P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Connected to new peer: Peer: permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.058s
I20260709 13:07:16.483249 26246 consensus_queue.cc:237] T 86a6797bdfe94fa496c050ceae4bd0d9 P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.8, Last appended by leader: 8, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:07:16.485729 19450 leader_election.cc:304] T b08304a0a02b42d7840c4e8ee9a6bd1a P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:07:16.423432 25851 raft_consensus.cc:493] T bc225c93219c45538b53a1bd3d387e4d P e61c3a8f61bb48f8a963c9480e53c168 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 0473d2b2d01f4459b1e90fd12cc7840e)
I20260709 13:07:16.487176 25851 raft_consensus.cc:3060] T bc225c93219c45538b53a1bd3d387e4d P e61c3a8f61bb48f8a963c9480e53c168 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:07:16.471767 26316 leader_election.cc:290] T 2e36a9d6e29c4a7c860cf267efbd4c74 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:07:16.490700 26163 leader_election.cc:290] T 96efeaaf1057492490e9a621f37e1a2d P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:07:16.492785 26101 leader_election.cc:290] T 46c5bfeecc314717bffe987e6844b6d0 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:07:16.493002 19410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a08760e15aac4630a629431f56024dc8" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 24 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:07:16.494585 19410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa8650e71aa14778b3d73721fc50d9fc" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
I20260709 13:07:16.499547 19404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e5873a19244c5ebbcd38e126796ee7" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 23 candidate_status { last_received { term: 22 index: 11 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:07:16.487090 19402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff75a1d4cb1f493db8f71ddc136ba9ab" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:07:16.500941 19402 raft_consensus.cc:2468] T ff75a1d4cb1f493db8f71ddc136ba9ab P e5256d91808b47c195bc9b4dbd7f2b87 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 20.
I20260709 13:07:16.450515 19307 catalog_manager.cc:5697] T 6c5eebf646ad445a9d1b1adc319d7b16 P e61c3a8f61bb48f8a963c9480e53c168 reported cstate change: term changed from 8 to 14, leader changed from e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3) to 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2). New cstate: current_term: 14 leader_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } } }
W20260709 13:07:16.513917 19523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.4:43121, user_credentials={real_user=slave}} blocked reactor thread for 74585.3us
I20260709 13:07:16.532806 19559 raft_consensus.cc:1275] T 85c494af21f9457a85da47b9bc70c1fd P e61c3a8f61bb48f8a963c9480e53c168 [term 19 FOLLOWER]: Refusing update from remote peer e5256d91808b47c195bc9b4dbd7f2b87: Log matching property violated. Preceding OpId in replica: term: 18 index: 14. Preceding OpId from leader: term: 19 index: 15. (index mismatch)
I20260709 13:07:16.527347 26163 raft_consensus.cc:493] T ab43d85f64114d4ebf618930e43d9ed0 P 127766fc592545a4997f7790f50f6076 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:16.571010 20103 raft_consensus.cc:1275] T 85c494af21f9457a85da47b9bc70c1fd P 127766fc592545a4997f7790f50f6076 [term 19 FOLLOWER]: Refusing update from remote peer e5256d91808b47c195bc9b4dbd7f2b87: Log matching property violated. Preceding OpId in replica: term: 18 index: 14. Preceding OpId from leader: term: 19 index: 15. (index mismatch)
I20260709 13:07:16.545253 26262 raft_consensus.cc:3060] T edd7d470b5014c9489be7f41f64355c9 P e5256d91808b47c195bc9b4dbd7f2b87 [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:07:16.580206 19404 raft_consensus.cc:1275] T ece3db938bc649d4a40a51522ed5259c P e5256d91808b47c195bc9b4dbd7f2b87 [term 16 FOLLOWER]: Refusing update from remote peer e61c3a8f61bb48f8a963c9480e53c168: Log matching property violated. Preceding OpId in replica: term: 15 index: 13. Preceding OpId from leader: term: 16 index: 13. (term mismatch)
I20260709 13:07:16.588862 19404 pending_rounds.cc:85] T ece3db938bc649d4a40a51522ed5259c P e5256d91808b47c195bc9b4dbd7f2b87: Aborting all ops after (but not including) 12
I20260709 13:07:16.589182 19404 pending_rounds.cc:107] T ece3db938bc649d4a40a51522ed5259c P e5256d91808b47c195bc9b4dbd7f2b87: Aborting uncommitted NO_OP operation due to leader change: 15.13
I20260709 13:07:16.589486 19404 raft_consensus.cc:2889] T ece3db938bc649d4a40a51522ed5259c P e5256d91808b47c195bc9b4dbd7f2b87 [term 16 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:07:16.546805 26204 raft_consensus.cc:2804] T b08304a0a02b42d7840c4e8ee9a6bd1a P 0473d2b2d01f4459b1e90fd12cc7840e [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:07:16.602660 19553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96efeaaf1057492490e9a621f37e1a2d" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
W20260709 13:07:16.602727 19450 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.3:36891, user_credentials={real_user=slave}} blocked reactor thread for 43611.6us
I20260709 13:07:16.609125 19523 leader_election.cc:304] T 4af19371ea874c09a0a2147040835cbb P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e61c3a8f61bb48f8a963c9480e53c168; no voters: 127766fc592545a4997f7790f50f6076, e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:07:16.612857 19523 leader_election.cc:304] T ff75a1d4cb1f493db8f71ddc136ba9ab P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:07:16.618783 26228 raft_consensus.cc:2804] T ff75a1d4cb1f493db8f71ddc136ba9ab P e61c3a8f61bb48f8a963c9480e53c168 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:07:16.619331 26228 raft_consensus.cc:493] T ff75a1d4cb1f493db8f71ddc136ba9ab P e61c3a8f61bb48f8a963c9480e53c168 [term 19 FOLLOWER]: Starting leader election (detected failure of leader e5256d91808b47c195bc9b4dbd7f2b87)
I20260709 13:07:16.619766 26228 raft_consensus.cc:3060] T ff75a1d4cb1f493db8f71ddc136ba9ab P e61c3a8f61bb48f8a963c9480e53c168 [term 19 FOLLOWER]: Advancing to term 20
W20260709 13:07:16.629679 19377 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:16.598260 26160 raft_consensus.cc:515] T 22196caba61445d3bec98a0aab3c337d P e61c3a8f61bb48f8a963c9480e53c168 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
W20260709 13:07:16.647675 19450 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.3:36891, user_credentials={real_user=slave}} blocked reactor thread for 43485.8us
I20260709 13:07:16.649744 19557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22196caba61445d3bec98a0aab3c337d" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 21 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:07:16.593601 26204 raft_consensus.cc:493] T b08304a0a02b42d7840c4e8ee9a6bd1a P 0473d2b2d01f4459b1e90fd12cc7840e [term 21 FOLLOWER]: Starting leader election (detected failure of leader e5256d91808b47c195bc9b4dbd7f2b87)
I20260709 13:07:16.656267 20078 leader_election.cc:304] T 7be9efa6559648dbb5a0f7684c4542d1 P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 127766fc592545a4997f7790f50f6076, e61c3a8f61bb48f8a963c9480e53c168; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:07:16.572304 26288 consensus_queue.cc:1048] T 85c494af21f9457a85da47b9bc70c1fd P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 13, Time since last communication: 0.067s
I20260709 13:07:16.660429 20078 leader_election.cc:304] T 14935b3ddf914369822e4a0547aaa355 P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 127766fc592545a4997f7790f50f6076; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:07:16.661870 19551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a61655d99124a29b486ba4a5b37faea" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:07:16.663923 20078 leader_election.cc:304] T ff9b0eddd810459b82d91c60777c10eb P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 127766fc592545a4997f7790f50f6076; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:07:16.574010 26328 raft_consensus.cc:515] T 76cb037fc9064d13b59a8969d897ce8c P e61c3a8f61bb48f8a963c9480e53c168 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:07:16.594259 26163 raft_consensus.cc:515] T ab43d85f64114d4ebf618930e43d9ed0 P 127766fc592545a4997f7790f50f6076 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:07:16.672627 19557 raft_consensus.cc:2393] T 22196caba61445d3bec98a0aab3c337d P e61c3a8f61bb48f8a963c9480e53c168 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0473d2b2d01f4459b1e90fd12cc7840e in current term 21: Already voted for candidate e61c3a8f61bb48f8a963c9480e53c168 in this term.
I20260709 13:07:16.643270 26331 raft_consensus.cc:493] T 85c494af21f9457a85da47b9bc70c1fd P 127766fc592545a4997f7790f50f6076 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:16.680224 19410 raft_consensus.cc:2468] T fa8650e71aa14778b3d73721fc50d9fc P e5256d91808b47c195bc9b4dbd7f2b87 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 21.
I20260709 13:07:16.627569 26151 consensus_queue.cc:1048] T ece3db938bc649d4a40a51522ed5259c P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.041s
I20260709 13:07:16.681694 19552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76cb037fc9064d13b59a8969d897ce8c" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:07:16.661752 26204 raft_consensus.cc:3060] T b08304a0a02b42d7840c4e8ee9a6bd1a P 0473d2b2d01f4459b1e90fd12cc7840e [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:07:16.667006 26295 raft_consensus.cc:2749] T 7be9efa6559648dbb5a0f7684c4542d1 P 127766fc592545a4997f7790f50f6076 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:07:16.669653 26216 raft_consensus.cc:2749] T 14935b3ddf914369822e4a0547aaa355 P 127766fc592545a4997f7790f50f6076 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:07:16.683673 26321 raft_consensus.cc:493] T 6c5eebf646ad445a9d1b1adc319d7b16 P e61c3a8f61bb48f8a963c9480e53c168 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 0473d2b2d01f4459b1e90fd12cc7840e)
I20260709 13:07:16.645439 26326 raft_consensus.cc:515] T 40e1e16737a842ee936002830f36882e P e5256d91808b47c195bc9b4dbd7f2b87 [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
W20260709 13:07:16.416249 19308 rpcz_store.cc:269] 0709 13:07:00.586198 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:00.589808 (+  3610us) service_pool.cc:224] Handling call
0709 13:07:16.415440 (+15825632us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:07:08.500739 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:07:08.501344 (+   605us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:07:08.501378 (+    34us) write_op.cc:435] Acquired schema lock
0709 13:07:08.501393 (+    15us) tablet.cc:662] Decoding operations
0709 13:07:08.503536 (+  2143us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:07:08.503597 (+    61us) write_op.cc:641] Partition lock acquired for write op
0709 13:07:08.503634 (+    37us) tablet.cc:685] Acquiring locks for 28 operations
0709 13:07:08.506106 (+  2472us) tablet.cc:701] Row locks acquired
0709 13:07:08.506129 (+    23us) write_op.cc:260] PREPARE: finished
0709 13:07:08.506294 (+   165us) write_op.cc:270] Start()
0709 13:07:08.506422 (+   128us) write_op.cc:276] Timestamp: P: 1783602428506236 usec, L: 0
0709 13:07:08.506444 (+    22us) op_driver.cc:348] REPLICATION: starting
0709 13:07:08.570654 (+ 64210us) log.cc:844] Serialized 10841 byte log entry
0709 13:07:09.023762 (+453108us) op_driver.cc:464] REPLICATION: finished
0709 13:07:09.400613 (+376851us) write_op.cc:301] APPLY: starting
0709 13:07:09.468263 (+ 67650us) tablet.cc:1367] starting BulkCheckPresence
0709 13:07:10.630487 (+1162224us) tablet.cc:1370] finished BulkCheckPresence
0709 13:07:10.630599 (+   112us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:07:11.641800 (+1011201us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:07:11.642301 (+   501us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=56,key_file_lookups=56,delta_file_lookups=56,mrs_lookups=0
0709 13:07:11.642353 (+    52us) write_op.cc:312] APPLY: finished
0709 13:07:11.714893 (+ 72540us) log.cc:844] Serialized 244 byte log entry
0709 13:07:11.888328 (+173435us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:07:12.019160 (+130832us) write_op.cc:454] Released schema lock
0709 13:07:12.019274 (+   114us) write_op.cc:341] FINISH: Updating metrics
0709 13:07:12.019869 (+   595us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:07:12.019906 (+    37us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":186329,"reported_tablets":46,"spinlock_wait_cycles":47616,"child_traces":[["op",{"apply.queue_time_us":291433,"apply.run_cpu_time_us":58331,"apply.run_wall_time_us":2651554,"cfile_cache_hit":114,"cfile_cache_hit_bytes":121167,"num_ops":28,"prepare.queue_time_us":395126,"prepare.run_cpu_time_us":11124,"prepare.run_wall_time_us":77269,"raft.queue_time_us":202628,"raft.run_cpu_time_us":15153,"raft.run_wall_time_us":89775,"replication_time_us":517099,"spinlock_wait_cycles":13568,"thread_start_us":568354,"threads_started":5,"wal-append.queue_time_us":277453,"wal-append.run_cpu_time_us":57943,"wal-append.run_wall_time_us":2708243}]]}
I20260709 13:07:16.657549 26289 leader_election.cc:290] T 1a61655d99124a29b486ba4a5b37faea P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:07:16.674202 25905 raft_consensus.cc:2749] T ff9b0eddd810459b82d91c60777c10eb P 127766fc592545a4997f7790f50f6076 [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 13:07:16.690691 19554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e5873a19244c5ebbcd38e126796ee7" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 23 candidate_status { last_received { term: 22 index: 11 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:07:16.703207 19552 raft_consensus.cc:2368] T 76cb037fc9064d13b59a8969d897ce8c P e61c3a8f61bb48f8a963c9480e53c168 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 0473d2b2d01f4459b1e90fd12cc7840e for earlier term 19. Current term is 20.
I20260709 13:07:16.742250 19485 raft_consensus.cc:1275] T 2e36a9d6e29c4a7c860cf267efbd4c74 P 0473d2b2d01f4459b1e90fd12cc7840e [term 15 FOLLOWER]: Refusing update from remote peer e5256d91808b47c195bc9b4dbd7f2b87: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 15 index: 8. (index mismatch)
I20260709 13:07:16.670179 26192 consensus_queue.cc:1048] T 85c494af21f9457a85da47b9bc70c1fd P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Connected to new peer: Peer: permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.040s
I20260709 13:07:16.745733 19486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9f0d59553ad444883fcf5b5909f9798" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:07:16.758769 19479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40e1e16737a842ee936002830f36882e" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 23 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:07:16.759577 19479 raft_consensus.cc:2468] T 40e1e16737a842ee936002830f36882e P 0473d2b2d01f4459b1e90fd12cc7840e [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 22.
I20260709 13:07:16.710337 26207 raft_consensus.cc:493] T 62c6c134d3d24a1ab144dd9ee6bc3f64 P 0473d2b2d01f4459b1e90fd12cc7840e [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 127766fc592545a4997f7790f50f6076)
I20260709 13:07:16.774546 19558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dc5b3532fe54f74876d02beffa2c230" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 23 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:07:16.780195 19558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e36a9d6e29c4a7c860cf267efbd4c74" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 16 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:07:16.781376 19558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46c5bfeecc314717bffe987e6844b6d0" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 26 candidate_status { last_received { term: 25 index: 13 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:07:16.782473 19558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa8650e71aa14778b3d73721fc50d9fc" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 22 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:07:16.778827 19553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a08760e15aac4630a629431f56024dc8" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 24 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:07:16.761817 19554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2725d2c4cb054f18b0fc8f735c15f6c2" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 21 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:07:16.710196 26379 raft_consensus.cc:493] T ff75a1d4cb1f493db8f71ddc136ba9ab P 0473d2b2d01f4459b1e90fd12cc7840e [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:16.685787 26331 raft_consensus.cc:515] T 85c494af21f9457a85da47b9bc70c1fd P 127766fc592545a4997f7790f50f6076 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:07:16.785761 19554 raft_consensus.cc:3060] T 2725d2c4cb054f18b0fc8f735c15f6c2 P e61c3a8f61bb48f8a963c9480e53c168 [term 19 FOLLOWER]: Advancing to term 21
I20260709 13:07:16.787709 19558 raft_consensus.cc:2410] T fa8650e71aa14778b3d73721fc50d9fc P e61c3a8f61bb48f8a963c9480e53c168 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0473d2b2d01f4459b1e90fd12cc7840e for term 22 because replica has last-logged OpId of term: 20 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 18 index: 10.
I20260709 13:07:16.789251 19479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76cb037fc9064d13b59a8969d897ce8c" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:07:16.790788 19479 raft_consensus.cc:2468] T 76cb037fc9064d13b59a8969d897ce8c P 0473d2b2d01f4459b1e90fd12cc7840e [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 19.
I20260709 13:07:16.713603 26216 raft_consensus.cc:493] T 0afb57ae58a24a01850491d69f0213dd P 127766fc592545a4997f7790f50f6076 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 0473d2b2d01f4459b1e90fd12cc7840e)
I20260709 13:07:16.697118 26330 raft_consensus.cc:515] T 70797e5783b5454ab0d0eea663e791e3 P 127766fc592545a4997f7790f50f6076 [term 23 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:07:16.709483 26321 raft_consensus.cc:515] T 6c5eebf646ad445a9d1b1adc319d7b16 P e61c3a8f61bb48f8a963c9480e53c168 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:07:16.816918 19478 raft_consensus.cc:1275] T 7f575b143b844aa096b50997dad3516a P 0473d2b2d01f4459b1e90fd12cc7840e [term 18 FOLLOWER]: Refusing update from remote peer e5256d91808b47c195bc9b4dbd7f2b87: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 18 index: 12. (index mismatch)
I20260709 13:07:16.819550 20107 raft_consensus.cc:1240] T 70797e5783b5454ab0d0eea663e791e3 P 127766fc592545a4997f7790f50f6076 [term 23 FOLLOWER]: Rejecting Update request from peer e5256d91808b47c195bc9b4dbd7f2b87 for earlier term 22. Current term is 23. Ops: []
W20260709 13:07:16.820791 20078 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.2:46257, user_credentials={real_user=slave}} blocked reactor thread for 147359us
I20260709 13:07:16.793923 26364 raft_consensus.cc:2749] T 4af19371ea874c09a0a2147040835cbb P e61c3a8f61bb48f8a963c9480e53c168 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:07:16.831900 19554 raft_consensus.cc:2468] T 2725d2c4cb054f18b0fc8f735c15f6c2 P e61c3a8f61bb48f8a963c9480e53c168 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 21.
I20260709 13:07:16.859041 19485 raft_consensus.cc:1275] T 217b5fae677b4971b3bbd2f357a1f7ff P 0473d2b2d01f4459b1e90fd12cc7840e [term 17 FOLLOWER]: Refusing update from remote peer e5256d91808b47c195bc9b4dbd7f2b87: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
I20260709 13:07:16.861105 19479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a61655d99124a29b486ba4a5b37faea" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:07:16.792214 26379 raft_consensus.cc:515] T ff75a1d4cb1f493db8f71ddc136ba9ab P 0473d2b2d01f4459b1e90fd12cc7840e [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:07:16.791263 26207 raft_consensus.cc:515] T 62c6c134d3d24a1ab144dd9ee6bc3f64 P 0473d2b2d01f4459b1e90fd12cc7840e [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
W20260709 13:07:16.883602 26384 log.cc:927] Time spent T 2b74109013a140ada21feeef92d6f563 P e61c3a8f61bb48f8a963c9480e53c168: Append to log took a long time: real 0.127s	user 0.001s	sys 0.000s
W20260709 13:07:16.884732 26386 log.cc:927] Time spent T 9962423cb4e54fcfa5de01daf68a86e7 P 0473d2b2d01f4459b1e90fd12cc7840e: Append to log took a long time: real 0.214s	user 0.000s	sys 0.001s
W20260709 13:07:16.886015 26395 log.cc:927] Time spent T 7f575b143b844aa096b50997dad3516a P e61c3a8f61bb48f8a963c9480e53c168: Append to log took a long time: real 0.125s	user 0.000s	sys 0.001s
W20260709 13:07:16.886843 26398 log.cc:927] Time spent T 21e14947d70440f19044d8f75c31e1f9 P e61c3a8f61bb48f8a963c9480e53c168: Append to log took a long time: real 0.071s	user 0.001s	sys 0.000s
I20260709 13:07:16.887169 26328 leader_election.cc:290] T 76cb037fc9064d13b59a8969d897ce8c P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 20 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
W20260709 13:07:16.890110 19449 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.547s	user 0.009s	sys 0.009s
W20260709 13:07:16.890456 19449 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.547s	user 0.009s	sys 0.009s
I20260709 13:07:16.898182 26379 leader_election.cc:290] T ff75a1d4cb1f493db8f71ddc136ba9ab P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:07:16.900341 26321 leader_election.cc:290] T 6c5eebf646ad445a9d1b1adc319d7b16 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:07:16.903419 26331 leader_election.cc:290] T 85c494af21f9457a85da47b9bc70c1fd P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:07:16.904511 26160 leader_election.cc:290] T 22196caba61445d3bec98a0aab3c337d P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 21 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:07:16.801149 26216 raft_consensus.cc:515] T 0afb57ae58a24a01850491d69f0213dd P 127766fc592545a4997f7790f50f6076 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:07:16.915807 19552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85c494af21f9457a85da47b9bc70c1fd" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:07:16.921713 19552 raft_consensus.cc:2468] T 85c494af21f9457a85da47b9bc70c1fd P e61c3a8f61bb48f8a963c9480e53c168 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 127766fc592545a4997f7790f50f6076 in term 19.
W20260709 13:07:16.917420 19449 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.1:40321, user_credentials={real_user=slave}} blocked reactor thread for 573952us
I20260709 13:07:16.922864 20076 leader_election.cc:304] T 85c494af21f9457a85da47b9bc70c1fd P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 127766fc592545a4997f7790f50f6076, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:07:16.924880 19552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70797e5783b5454ab0d0eea663e791e3" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:07:16.925060 26092 raft_consensus.cc:2804] T 85c494af21f9457a85da47b9bc70c1fd P 127766fc592545a4997f7790f50f6076 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:07:16.925652 26092 raft_consensus.cc:493] T 85c494af21f9457a85da47b9bc70c1fd P 127766fc592545a4997f7790f50f6076 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:16.926088 26092 raft_consensus.cc:3060] T 85c494af21f9457a85da47b9bc70c1fd P 127766fc592545a4997f7790f50f6076 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:07:16.944419 19449 leader_election.cc:304] T f93ee515a9c14139bf566522ed8232f3 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87; no voters: e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:07:16.820144 25851 raft_consensus.cc:515] T bc225c93219c45538b53a1bd3d387e4d P e61c3a8f61bb48f8a963c9480e53c168 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:07:16.951773 26017 raft_consensus.cc:2804] T f93ee515a9c14139bf566522ed8232f3 P 0473d2b2d01f4459b1e90fd12cc7840e [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 13:07:16.954592 25975 consensus_queue.cc:1048] T 0cdf56e38bbc453d9438d359e5a69955 P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.001s
W20260709 13:07:16.923035 25747 consensus_meta.cc:287] T 0cdf56e38bbc453d9438d359e5a69955 P e61c3a8f61bb48f8a963c9480e53c168: Time spent flushing consensus metadata: real 0.585s	user 0.010s	sys 0.000s
I20260709 13:07:16.959619 20111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c5eebf646ad445a9d1b1adc319d7b16" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:07:16.972011 20111 raft_consensus.cc:2468] T 6c5eebf646ad445a9d1b1adc319d7b16 P 127766fc592545a4997f7790f50f6076 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 18.
I20260709 13:07:16.932138 26330 leader_election.cc:290] T 70797e5783b5454ab0d0eea663e791e3 P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 23 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:07:16.967716 19523 leader_election.cc:304] T fa8650e71aa14778b3d73721fc50d9fc P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:07:16.955578 19449 leader_election.cc:304] T 172b3dd13109415a955b71ac0e9d2234 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e; no voters: 127766fc592545a4997f7790f50f6076, e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:07:16.979074 19523 leader_election.cc:304] T 6c5eebf646ad445a9d1b1adc319d7b16 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 127766fc592545a4997f7790f50f6076, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:07:16.982116 19449 leader_election.cc:304] T 21e14947d70440f19044d8f75c31e1f9 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87; no voters: e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:07:16.984402 19481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96efeaaf1057492490e9a621f37e1a2d" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:07:16.987476 25376 raft_consensus.cc:2804] T 21e14947d70440f19044d8f75c31e1f9 P 0473d2b2d01f4459b1e90fd12cc7840e [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:07:16.971230 26179 raft_consensus.cc:493] T 309c3ca0ca4b4f3ba129752ea2cb293b P 127766fc592545a4997f7790f50f6076 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 0473d2b2d01f4459b1e90fd12cc7840e)
I20260709 13:07:16.988914 19551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab43d85f64114d4ebf618930e43d9ed0" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 23 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:07:16.969384 26017 raft_consensus.cc:493] T f93ee515a9c14139bf566522ed8232f3 P 0473d2b2d01f4459b1e90fd12cc7840e [term 23 FOLLOWER]: Starting leader election (detected failure of leader e61c3a8f61bb48f8a963c9480e53c168)
I20260709 13:07:16.989254 25376 raft_consensus.cc:493] T 21e14947d70440f19044d8f75c31e1f9 P 0473d2b2d01f4459b1e90fd12cc7840e [term 20 FOLLOWER]: Starting leader election (detected failure of leader e61c3a8f61bb48f8a963c9480e53c168)
I20260709 13:07:16.991277 19449 leader_election.cc:304] T edd7d470b5014c9489be7f41f64355c9 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e; no voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:07:16.994521 25376 raft_consensus.cc:3060] T 21e14947d70440f19044d8f75c31e1f9 P 0473d2b2d01f4459b1e90fd12cc7840e [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:07:17.003014 19479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab43d85f64114d4ebf618930e43d9ed0" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 23 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:07:17.003720 19479 raft_consensus.cc:2468] T ab43d85f64114d4ebf618930e43d9ed0 P 0473d2b2d01f4459b1e90fd12cc7840e [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 127766fc592545a4997f7790f50f6076 in term 22.
I20260709 13:07:17.006748 19558 raft_consensus.cc:1240] T bc225c93219c45538b53a1bd3d387e4d P e61c3a8f61bb48f8a963c9480e53c168 [term 18 FOLLOWER]: Rejecting Update request from peer 0473d2b2d01f4459b1e90fd12cc7840e for earlier term 17. Current term is 18. Ops: []
I20260709 13:07:17.007624 19449 leader_election.cc:304] T 14efcc79969f41babe5529c22d59156d P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e; no voters: 127766fc592545a4997f7790f50f6076, e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:07:17.000523 26179 raft_consensus.cc:515] T 309c3ca0ca4b4f3ba129752ea2cb293b P 127766fc592545a4997f7790f50f6076 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:07:17.012778 26179 leader_election.cc:290] T 309c3ca0ca4b4f3ba129752ea2cb293b P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
W20260709 13:07:17.013379 26389 log.cc:927] Time spent T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P 0473d2b2d01f4459b1e90fd12cc7840e: Append to log took a long time: real 0.132s	user 0.000s	sys 0.001s
I20260709 13:07:17.020395 26364 raft_consensus.cc:493] T 4509b76741dc428e9201c70c1658da13 P e61c3a8f61bb48f8a963c9480e53c168 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:17.021209 26364 raft_consensus.cc:515] T 4509b76741dc428e9201c70c1658da13 P e61c3a8f61bb48f8a963c9480e53c168 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:07:17.012573 26246 raft_consensus.cc:2749] T edd7d470b5014c9489be7f41f64355c9 P 0473d2b2d01f4459b1e90fd12cc7840e [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:07:17.024087 26246 raft_consensus.cc:2749] T 14efcc79969f41babe5529c22d59156d P 0473d2b2d01f4459b1e90fd12cc7840e [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:07:17.026973 26246 consensus_queue.cc:1048] T e381f1d6b8184797ad142de49be225a8 P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:07:17.028980 26228 raft_consensus.cc:515] T ff75a1d4cb1f493db8f71ddc136ba9ab P e61c3a8f61bb48f8a963c9480e53c168 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:07:17.033747 19555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff75a1d4cb1f493db8f71ddc136ba9ab" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 21 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:07:17.034660 19555 raft_consensus.cc:2468] T ff75a1d4cb1f493db8f71ddc136ba9ab P e61c3a8f61bb48f8a963c9480e53c168 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 20.
I20260709 13:07:17.032907 19449 leader_election.cc:304] T 9962423cb4e54fcfa5de01daf68a86e7 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e; no voters: 127766fc592545a4997f7790f50f6076, e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:07:17.038264 26246 raft_consensus.cc:2749] T 9962423cb4e54fcfa5de01daf68a86e7 P 0473d2b2d01f4459b1e90fd12cc7840e [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:07:17.040022 26207 leader_election.cc:290] T 62c6c134d3d24a1ab144dd9ee6bc3f64 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
W20260709 13:07:17.040843 26378 log.cc:927] Time spent T 21e14947d70440f19044d8f75c31e1f9 P 0473d2b2d01f4459b1e90fd12cc7840e: Append to log took a long time: real 0.629s	user 0.005s	sys 0.001s
I20260709 13:07:16.985409 26101 raft_consensus.cc:2749] T 172b3dd13109415a955b71ac0e9d2234 P 0473d2b2d01f4459b1e90fd12cc7840e [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:07:17.044956 19449 leader_election.cc:304] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e; no voters: 127766fc592545a4997f7790f50f6076, e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:07:17.047813 19450 leader_election.cc:304] T 2725d2c4cb054f18b0fc8f735c15f6c2 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:07:17.049746 26246 raft_consensus.cc:493] T 7f575b143b844aa096b50997dad3516a P 0473d2b2d01f4459b1e90fd12cc7840e [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:16.985589 26321 raft_consensus.cc:2804] T fa8650e71aa14778b3d73721fc50d9fc P e61c3a8f61bb48f8a963c9480e53c168 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:07:17.051753 19449 leader_election.cc:304] T ef32ce6fdd0e40d382c79974f30295c6 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e; no voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:07:16.988056 26160 raft_consensus.cc:2804] T 6c5eebf646ad445a9d1b1adc319d7b16 P e61c3a8f61bb48f8a963c9480e53c168 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:07:16.986882 26163 leader_election.cc:290] T ab43d85f64114d4ebf618930e43d9ed0 P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:07:17.071293 19450 leader_election.cc:400] T 76cb037fc9064d13b59a8969d897ce8c P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 19 election: Vote denied by peer e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891) with higher term. Message: Invalid argument: T 76cb037fc9064d13b59a8969d897ce8c P e61c3a8f61bb48f8a963c9480e53c168 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 0473d2b2d01f4459b1e90fd12cc7840e for earlier term 19. Current term is 20.
W20260709 13:07:17.078990 19377 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.2:46257, user_credentials={real_user=slave}} blocked reactor thread for 77519.6us
I20260709 13:07:16.976820 25747 raft_consensus.cc:515] T 0cdf56e38bbc453d9438d359e5a69955 P e61c3a8f61bb48f8a963c9480e53c168 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:07:17.106767 19450 leader_election.cc:403] T 76cb037fc9064d13b59a8969d897ce8c P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 19 election: Cancelling election due to peer responding with higher term
I20260709 13:07:17.108625 26097 raft_consensus.cc:493] T 4509b76741dc428e9201c70c1658da13 P e5256d91808b47c195bc9b4dbd7f2b87 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:17.000844 26017 raft_consensus.cc:3060] T f93ee515a9c14139bf566522ed8232f3 P 0473d2b2d01f4459b1e90fd12cc7840e [term 23 FOLLOWER]: Advancing to term 24
W20260709 13:07:17.109907 19449 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.1:40321, user_credentials={real_user=slave}} blocked reactor thread for 58280.3us
I20260709 13:07:17.107352 19377 leader_election.cc:304] T b9f0d59553ad444883fcf5b5909f9798 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:07:17.066382 26326 leader_election.cc:290] T 40e1e16737a842ee936002830f36882e P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 23 election: Requested vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:07:17.056598 26295 raft_consensus.cc:493] T 1efebf73c86e432baa55533136b6e12c P 127766fc592545a4997f7790f50f6076 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:17.122558 19450 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.3:36891, user_credentials={real_user=slave}} blocked reactor thread for 72697.8us
I20260709 13:07:17.106029 26207 raft_consensus.cc:2749] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P 0473d2b2d01f4459b1e90fd12cc7840e [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:07:17.110061 25376 raft_consensus.cc:515] T 21e14947d70440f19044d8f75c31e1f9 P 0473d2b2d01f4459b1e90fd12cc7840e [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:07:17.050585 26381 raft_consensus.cc:2804] T 2725d2c4cb054f18b0fc8f735c15f6c2 P 0473d2b2d01f4459b1e90fd12cc7840e [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:07:17.123553 19559 raft_consensus.cc:1240] T 0cdf56e38bbc453d9438d359e5a69955 P e61c3a8f61bb48f8a963c9480e53c168 [term 20 FOLLOWER]: Rejecting Update request from peer 0473d2b2d01f4459b1e90fd12cc7840e for earlier term 19. Current term is 20. Ops: []
I20260709 13:07:17.053527 26324 raft_consensus.cc:493] T 1efebf73c86e432baa55533136b6e12c P e61c3a8f61bb48f8a963c9480e53c168 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 127766fc592545a4997f7790f50f6076)
I20260709 13:07:17.126853 19410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85c494af21f9457a85da47b9bc70c1fd" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:07:17.072867 19547 tablet_service.cc:1558] Processing DeleteTablet for tablet 309c3ca0ca4b4f3ba129752ea2cb293b with delete_type TABLET_DATA_TOMBSTONED (TS e61c3a8f61bb48f8a963c9480e53c168 not found in new config with opid_index 10) from {username='slave'} at 127.0.0.1:49904
I20260709 13:07:17.067811 26191 consensus_queue.cc:1048] T 2e36a9d6e29c4a7c860cf267efbd4c74 P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.049s
I20260709 13:07:17.135772 19483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40e1e16737a842ee936002830f36882e" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 23 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:07:17.050509 26092 raft_consensus.cc:515] T 85c494af21f9457a85da47b9bc70c1fd P 127766fc592545a4997f7790f50f6076 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:07:17.110814 26321 raft_consensus.cc:697] T fa8650e71aa14778b3d73721fc50d9fc P e61c3a8f61bb48f8a963c9480e53c168 [term 21 LEADER]: Becoming Leader. State: Replica: e61c3a8f61bb48f8a963c9480e53c168, State: Running, Role: LEADER
I20260709 13:07:17.113481 26241 raft_consensus.cc:2749] T ef32ce6fdd0e40d382c79974f30295c6 P 0473d2b2d01f4459b1e90fd12cc7840e [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:07:17.104970 26160 raft_consensus.cc:493] T 6c5eebf646ad445a9d1b1adc319d7b16 P e61c3a8f61bb48f8a963c9480e53c168 [term 18 FOLLOWER]: Starting leader election (detected failure of leader 0473d2b2d01f4459b1e90fd12cc7840e)
I20260709 13:07:17.109364 26097 raft_consensus.cc:515] T 4509b76741dc428e9201c70c1658da13 P e5256d91808b47c195bc9b4dbd7f2b87 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:07:17.154907 19484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0afb57ae58a24a01850491d69f0213dd" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:07:17.155115 19410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "309c3ca0ca4b4f3ba129752ea2cb293b" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:07:17.050325 26246 raft_consensus.cc:515] T 7f575b143b844aa096b50997dad3516a P 0473d2b2d01f4459b1e90fd12cc7840e [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:07:17.138782 19483 raft_consensus.cc:3060] T 40e1e16737a842ee936002830f36882e P 0473d2b2d01f4459b1e90fd12cc7840e [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:07:17.137876 19405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70797e5783b5454ab0d0eea663e791e3" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
I20260709 13:07:17.186084 20107 raft_consensus.cc:1240] T 85c494af21f9457a85da47b9bc70c1fd P 127766fc592545a4997f7790f50f6076 [term 20 FOLLOWER]: Rejecting Update request from peer e5256d91808b47c195bc9b4dbd7f2b87 for earlier term 19. Current term is 20. Ops: [19.15-19.15]
I20260709 13:07:17.137632 26266 raft_consensus.cc:2749] T b9f0d59553ad444883fcf5b5909f9798 P e5256d91808b47c195bc9b4dbd7f2b87 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:07:17.125144 25975 raft_consensus.cc:3060] T 76cb037fc9064d13b59a8969d897ce8c P 0473d2b2d01f4459b1e90fd12cc7840e [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:07:17.125412 26295 raft_consensus.cc:515] T 1efebf73c86e432baa55533136b6e12c P 127766fc592545a4997f7790f50f6076 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:07:17.145220 19480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "309c3ca0ca4b4f3ba129752ea2cb293b" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:07:17.167645 20078 leader_election.cc:304] T 96efeaaf1057492490e9a621f37e1a2d P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 127766fc592545a4997f7790f50f6076; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:07:17.140575 26381 raft_consensus.cc:697] T 2725d2c4cb054f18b0fc8f735c15f6c2 P 0473d2b2d01f4459b1e90fd12cc7840e [term 21 LEADER]: Becoming Leader. State: Replica: 0473d2b2d01f4459b1e90fd12cc7840e, State: Running, Role: LEADER
I20260709 13:07:17.188498 26216 leader_election.cc:290] T 0afb57ae58a24a01850491d69f0213dd P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:07:17.134861 25376 leader_election.cc:290] T 21e14947d70440f19044d8f75c31e1f9 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 21 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
W20260709 13:07:17.198189 19526 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.17.223.2:46257 timed out after 1.596s (SENT) [suppressed 1 similar messages]
I20260709 13:07:17.134861 19449 leader_election.cc:304] T 40e1e16737a842ee936002830f36882e P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e; no voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:07:17.157088 26160 raft_consensus.cc:3060] T 6c5eebf646ad445a9d1b1adc319d7b16 P e61c3a8f61bb48f8a963c9480e53c168 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:07:17.202386 20078 leader_election.cc:304] T ab43d85f64114d4ebf618930e43d9ed0 P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, 127766fc592545a4997f7790f50f6076; no voters: e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:07:17.204208 19450 leader_election.cc:304] T ff75a1d4cb1f493db8f71ddc136ba9ab P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:07:17.206892 19556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21e14947d70440f19044d8f75c31e1f9" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
W20260709 13:07:17.191138 26154 consensus_meta.cc:287] T 76cb037fc9064d13b59a8969d897ce8c P e5256d91808b47c195bc9b4dbd7f2b87: Time spent flushing consensus metadata: real 0.726s	user 0.011s	sys 0.000s
W20260709 13:07:17.193220 26409 log.cc:927] Time spent T 14935b3ddf914369822e4a0547aaa355 P 0473d2b2d01f4459b1e90fd12cc7840e: Append to log took a long time: real 0.052s	user 0.001s	sys 0.000s
I20260709 13:07:17.142086 26204 raft_consensus.cc:515] T b08304a0a02b42d7840c4e8ee9a6bd1a P 0473d2b2d01f4459b1e90fd12cc7840e [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
W20260709 13:07:17.240231 19449 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.1:40321, user_credentials={real_user=slave}} blocked reactor thread for 105440us
W20260709 13:07:17.239075 19375 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.3:36891, user_credentials={real_user=slave}} blocked reactor thread for 156769us
I20260709 13:07:17.234485 19558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62c6c134d3d24a1ab144dd9ee6bc3f64" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
W20260709 13:07:17.267473 19377 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.2:46257, user_credentials={real_user=slave}} blocked reactor thread for 113442us
I20260709 13:07:17.150024 26288 consensus_queue.cc:1059] T 70797e5783b5454ab0d0eea663e791e3 P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false }, Status: INVALID_TERM, Last received: 22.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.062s
I20260709 13:07:17.140774 26324 raft_consensus.cc:515] T 1efebf73c86e432baa55533136b6e12c P e61c3a8f61bb48f8a963c9480e53c168 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:07:17.280810 19553 raft_consensus.cc:1275] T 86a6797bdfe94fa496c050ceae4bd0d9 P e61c3a8f61bb48f8a963c9480e53c168 [term 17 FOLLOWER]: Refusing update from remote peer 0473d2b2d01f4459b1e90fd12cc7840e: Log matching property violated. Preceding OpId in replica: term: 15 index: 8. Preceding OpId from leader: term: 17 index: 9. (index mismatch)
I20260709 13:07:17.269874 19480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a08760e15aac4630a629431f56024dc8" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 24 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:07:17.270495 19484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa8650e71aa14778b3d73721fc50d9fc" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:07:17.282805 19484 raft_consensus.cc:2393] T fa8650e71aa14778b3d73721fc50d9fc P 0473d2b2d01f4459b1e90fd12cc7840e [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate e61c3a8f61bb48f8a963c9480e53c168 in current term 21: Already voted for candidate 0473d2b2d01f4459b1e90fd12cc7840e in this term.
I20260709 13:07:17.271992 19479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e5873a19244c5ebbcd38e126796ee7" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 23 candidate_status { last_received { term: 22 index: 11 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:07:17.272782 19481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76cb037fc9064d13b59a8969d897ce8c" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:07:17.273084 19486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22196caba61445d3bec98a0aab3c337d" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:07:17.273396 19485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c5eebf646ad445a9d1b1adc319d7b16" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:07:17.283782 19486 raft_consensus.cc:3060] T 22196caba61445d3bec98a0aab3c337d P 0473d2b2d01f4459b1e90fd12cc7840e [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:07:17.274149 19477 raft_consensus.cc:1275] T 28af091831594f9d8e96482078cc7625 P 0473d2b2d01f4459b1e90fd12cc7840e [term 19 FOLLOWER]: Refusing update from remote peer e61c3a8f61bb48f8a963c9480e53c168: Log matching property violated. Preceding OpId in replica: term: 18 index: 10. Preceding OpId from leader: term: 19 index: 11. (index mismatch)
I20260709 13:07:17.228608 26404 raft_consensus.cc:2749] T 96efeaaf1057492490e9a621f37e1a2d P 127766fc592545a4997f7790f50f6076 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:07:17.242944 26316 raft_consensus.cc:2804] T ff75a1d4cb1f493db8f71ddc136ba9ab P 0473d2b2d01f4459b1e90fd12cc7840e [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:07:17.297497 19478 raft_consensus.cc:1240] T b08304a0a02b42d7840c4e8ee9a6bd1a P 0473d2b2d01f4459b1e90fd12cc7840e [term 22 FOLLOWER]: Rejecting Update request from peer e5256d91808b47c195bc9b4dbd7f2b87 for earlier term 21. Current term is 22. Ops: []
I20260709 13:07:17.232378 26348 raft_consensus.cc:493] T 309c3ca0ca4b4f3ba129752ea2cb293b P e5256d91808b47c195bc9b4dbd7f2b87 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 0473d2b2d01f4459b1e90fd12cc7840e)
I20260709 13:07:17.344153 19410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22196caba61445d3bec98a0aab3c337d" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 21 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:07:17.348181 19410 raft_consensus.cc:2410] T 22196caba61445d3bec98a0aab3c337d P e5256d91808b47c195bc9b4dbd7f2b87 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0473d2b2d01f4459b1e90fd12cc7840e for term 21 because replica has last-logged OpId of term: 19 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 18 index: 11.
I20260709 13:07:17.348374 19407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46c5bfeecc314717bffe987e6844b6d0" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 26 candidate_status { last_received { term: 25 index: 13 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:07:17.346079 19404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e5873a19244c5ebbcd38e126796ee7" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 23 candidate_status { last_received { term: 22 index: 11 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:07:17.347034 19405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76cb037fc9064d13b59a8969d897ce8c" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
I20260709 13:07:17.248416 26410 raft_consensus.cc:2804] T ab43d85f64114d4ebf618930e43d9ed0 P 127766fc592545a4997f7790f50f6076 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:07:17.356485 19486 raft_consensus.cc:2468] T 22196caba61445d3bec98a0aab3c337d P 0473d2b2d01f4459b1e90fd12cc7840e [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 21.
I20260709 13:07:17.334383 19483 raft_consensus.cc:2468] T 40e1e16737a842ee936002830f36882e P 0473d2b2d01f4459b1e90fd12cc7840e [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 23.
W20260709 13:07:17.370976 19450 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.3:36891, user_credentials={real_user=slave}} blocked reactor thread for 101656us
W20260709 13:07:17.378650 20078 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.2:46257, user_credentials={real_user=slave}} blocked reactor thread for 168995us
W20260709 13:07:17.379220 19526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.2:46257, user_credentials={real_user=slave}} blocked reactor thread for 181063us
I20260709 13:07:17.239507 26154 raft_consensus.cc:515] T 76cb037fc9064d13b59a8969d897ce8c P e5256d91808b47c195bc9b4dbd7f2b87 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:07:17.385007 19404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dc5b3532fe54f74876d02beffa2c230" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 23 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:07:17.387310 19407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2725d2c4cb054f18b0fc8f735c15f6c2" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 21 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
I20260709 13:07:17.388120 19407 raft_consensus.cc:3060] T 2725d2c4cb054f18b0fc8f735c15f6c2 P e5256d91808b47c195bc9b4dbd7f2b87 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:07:17.390489 19410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e36a9d6e29c4a7c860cf267efbd4c74" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 16 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:07:17.348232 26316 raft_consensus.cc:493] T ff75a1d4cb1f493db8f71ddc136ba9ab P 0473d2b2d01f4459b1e90fd12cc7840e [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:17.266882 26101 consensus_queue.cc:1059] T bc225c93219c45538b53a1bd3d387e4d P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 }, Status: INVALID_TERM, Last received: 17.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.087s
I20260709 13:07:17.393481 19404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "775c229504194560ba9589bc2199b089" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:07:17.396198 19404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a08760e15aac4630a629431f56024dc8" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 24 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
W20260709 13:07:17.397747 20075 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.1:40321, user_credentials={real_user=slave}} blocked reactor thread for 169252us
I20260709 13:07:17.398746 19402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa8650e71aa14778b3d73721fc50d9fc" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 22 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:07:17.399770 19402 raft_consensus.cc:2410] T fa8650e71aa14778b3d73721fc50d9fc P e5256d91808b47c195bc9b4dbd7f2b87 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0473d2b2d01f4459b1e90fd12cc7840e for term 22 because replica has last-logged OpId of term: 20 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 18 index: 10.
I20260709 13:07:17.382014 19526 leader_election.cc:304] T 179fd671030940b4b4a4e24bcc4aba0a P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e61c3a8f61bb48f8a963c9480e53c168; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:07:17.567399 26245 raft_consensus.cc:493] T ff9b0eddd810459b82d91c60777c10eb P 0473d2b2d01f4459b1e90fd12cc7840e [term 20 FOLLOWER]: Starting pre-election (detected failure of leader e5256d91808b47c195bc9b4dbd7f2b87)
W20260709 13:07:17.412976 26414 log.cc:927] Time spent T 2b74109013a140ada21feeef92d6f563 P 0473d2b2d01f4459b1e90fd12cc7840e: Append to log took a long time: real 0.163s	user 0.000s	sys 0.000s
W20260709 13:07:17.529361 19375 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.3:36891, user_credentials={real_user=slave}} blocked reactor thread for 232683us
I20260709 13:07:17.379166 26207 raft_consensus.cc:2749] T 40e1e16737a842ee936002830f36882e P 0473d2b2d01f4459b1e90fd12cc7840e [term 23 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
I20260709 13:07:17.379305 26381 consensus_queue.cc:237] T 2725d2c4cb054f18b0fc8f735c15f6c2 P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 19.10, Last appended by leader: 10, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:07:17.606231 26364 leader_election.cc:290] T 4509b76741dc428e9201c70c1658da13 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:07:17.512465 19406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21e14947d70440f19044d8f75c31e1f9" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
I20260709 13:07:17.360810 26410 raft_consensus.cc:493] T ab43d85f64114d4ebf618930e43d9ed0 P 127766fc592545a4997f7790f50f6076 [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:17.402278 19404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff75a1d4cb1f493db8f71ddc136ba9ab" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 21 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:07:17.608470 19404 raft_consensus.cc:2468] T ff75a1d4cb1f493db8f71ddc136ba9ab P e5256d91808b47c195bc9b4dbd7f2b87 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 20.
W20260709 13:07:17.462412 26413 log.cc:927] Time spent T 833a2f0775ed407a94b8924ce50adb63 P e61c3a8f61bb48f8a963c9480e53c168: Append to log took a long time: real 0.295s	user 0.000s	sys 0.001s
I20260709 13:07:17.354048 26262 consensus_queue.cc:1048] T 7f575b143b844aa096b50997dad3516a P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.050s
I20260709 13:07:17.352278 26348 raft_consensus.cc:515] T 309c3ca0ca4b4f3ba129752ea2cb293b P e5256d91808b47c195bc9b4dbd7f2b87 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:07:17.405525 20078 leader_election.cc:304] T 309c3ca0ca4b4f3ba129752ea2cb293b P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 127766fc592545a4997f7790f50f6076; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:07:17.604377 26293 raft_consensus.cc:2749] T 179fd671030940b4b4a4e24bcc4aba0a P e61c3a8f61bb48f8a963c9480e53c168 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:07:17.352540 26321 consensus_queue.cc:237] T fa8650e71aa14778b3d73721fc50d9fc P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 20.11, Last appended by leader: 11, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:07:17.403684 25747 leader_election.cc:290] T 0cdf56e38bbc453d9438d359e5a69955 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 20 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:07:17.472909 26097 leader_election.cc:290] T 4509b76741dc428e9201c70c1658da13 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:07:17.427131 19405 raft_consensus.cc:2368] T 76cb037fc9064d13b59a8969d897ce8c P e5256d91808b47c195bc9b4dbd7f2b87 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 0473d2b2d01f4459b1e90fd12cc7840e for earlier term 19. Current term is 20.
W20260709 13:07:17.624894 20078 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.2:46257, user_credentials={real_user=slave}} blocked reactor thread for 219454us
I20260709 13:07:17.422926 26420 raft_consensus.cc:3055] T 70797e5783b5454ab0d0eea663e791e3 P e5256d91808b47c195bc9b4dbd7f2b87 [term 22 LEADER]: Stepping down as leader of term 22
I20260709 13:07:17.407709 19407 raft_consensus.cc:2468] T 2725d2c4cb054f18b0fc8f735c15f6c2 P e5256d91808b47c195bc9b4dbd7f2b87 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 21.
I20260709 13:07:17.400310 20075 leader_election.cc:304] T 70797e5783b5454ab0d0eea663e791e3 P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 23 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 127766fc592545a4997f7790f50f6076; no voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:07:17.594372 25851 leader_election.cc:290] T bc225c93219c45538b53a1bd3d387e4d P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 18 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:07:17.594468 26228 leader_election.cc:290] T ff75a1d4cb1f493db8f71ddc136ba9ab P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 20 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
W20260709 13:07:17.586024 19450 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.3:36891, user_credentials={real_user=slave}} blocked reactor thread for 197595us
I20260709 13:07:17.599274 19409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f575b143b844aa096b50997dad3516a" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 19 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:07:17.582608 26428 raft_consensus.cc:3055] T bc225c93219c45538b53a1bd3d387e4d P 0473d2b2d01f4459b1e90fd12cc7840e [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:07:17.602156 19408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b08304a0a02b42d7840c4e8ee9a6bd1a" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
I20260709 13:07:17.602262 19449 leader_election.cc:304] T 22196caba61445d3bec98a0aab3c337d P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e; no voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:07:17.586496 26092 leader_election.cc:290] T 85c494af21f9457a85da47b9bc70c1fd P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 20 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
W20260709 13:07:17.604032 19377 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.2:46257, user_credentials={real_user=slave}} blocked reactor thread for 317690us
I20260709 13:07:17.592355 26295 leader_election.cc:290] T 1efebf73c86e432baa55533136b6e12c P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
W20260709 13:07:17.601257 19526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.2:46257, user_credentials={real_user=slave}} blocked reactor thread for 219318us
I20260709 13:07:17.689159 19526 leader_election.cc:304] T f1b10566f45d4a7d9029858330e02d5b P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e61c3a8f61bb48f8a963c9480e53c168; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:07:17.600720 26204 leader_election.cc:290] T b08304a0a02b42d7840c4e8ee9a6bd1a P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 22 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:07:17.593570 26160 raft_consensus.cc:515] T 6c5eebf646ad445a9d1b1adc319d7b16 P e61c3a8f61bb48f8a963c9480e53c168 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:07:17.396267 26316 raft_consensus.cc:3060] T ff75a1d4cb1f493db8f71ddc136ba9ab P 0473d2b2d01f4459b1e90fd12cc7840e [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:07:17.433449 19402 raft_consensus.cc:1275] T 86a6797bdfe94fa496c050ceae4bd0d9 P e5256d91808b47c195bc9b4dbd7f2b87 [term 17 FOLLOWER]: Refusing update from remote peer 0473d2b2d01f4459b1e90fd12cc7840e: Log matching property violated. Preceding OpId in replica: term: 15 index: 8. Preceding OpId from leader: term: 17 index: 9. (index mismatch)
I20260709 13:07:17.634984 26420 raft_consensus.cc:740] T 70797e5783b5454ab0d0eea663e791e3 P e5256d91808b47c195bc9b4dbd7f2b87 [term 22 LEADER]: Becoming Follower/Learner. State: Replica: e5256d91808b47c195bc9b4dbd7f2b87, State: Running, Role: LEADER
I20260709 13:07:17.640147 20107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "309c3ca0ca4b4f3ba129752ea2cb293b" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:07:17.604642 26245 raft_consensus.cc:515] T ff9b0eddd810459b82d91c60777c10eb P 0473d2b2d01f4459b1e90fd12cc7840e [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:07:17.674156 20111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1efebf73c86e432baa55533136b6e12c" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
W20260709 13:07:17.694422 20075 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.1:40321, user_credentials={real_user=slave}} blocked reactor thread for 294371us
W20260709 13:07:17.710417 19374 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.4:43121, user_credentials={real_user=slave}} blocked reactor thread for 74115.6us
W20260709 13:07:17.717011 19375 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.3:36891, user_credentials={real_user=slave}} blocked reactor thread for 111897us
W20260709 13:07:17.764565 19526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.2:46257, user_credentials={real_user=slave}} blocked reactor thread for 75503.5us
I20260709 13:07:17.673025 26425 raft_consensus.cc:2749] T 70797e5783b5454ab0d0eea663e791e3 P 127766fc592545a4997f7790f50f6076 [term 23 FOLLOWER]: Leader election lost for term 23. Reason: could not achieve majority
I20260709 13:07:17.633703 26314 raft_consensus.cc:2749] T 309c3ca0ca4b4f3ba129752ea2cb293b P 127766fc592545a4997f7790f50f6076 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:07:17.769356 20108 raft_consensus.cc:1275] T ed7fdbcb96d14d418db9ca90a792588a P 127766fc592545a4997f7790f50f6076 [term 18 FOLLOWER]: Refusing update from remote peer 0473d2b2d01f4459b1e90fd12cc7840e: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
I20260709 13:07:17.770103 20106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62c6c134d3d24a1ab144dd9ee6bc3f64" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:07:17.610224 26410 raft_consensus.cc:3060] T ab43d85f64114d4ebf618930e43d9ed0 P 127766fc592545a4997f7790f50f6076 [term 22 FOLLOWER]: Advancing to term 23
W20260709 13:07:17.771157 26413 log.cc:927] Time spent T 833a2f0775ed407a94b8924ce50adb63 P e61c3a8f61bb48f8a963c9480e53c168: Append to log took a long time: real 0.137s	user 0.001s	sys 0.000s
I20260709 13:07:17.666040 26163 raft_consensus.cc:493] T 0e1085d23e8347fbbd5bce7542f4b1f4 P 127766fc592545a4997f7790f50f6076 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:17.684896 26428 raft_consensus.cc:740] T bc225c93219c45538b53a1bd3d387e4d P 0473d2b2d01f4459b1e90fd12cc7840e [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 0473d2b2d01f4459b1e90fd12cc7840e, State: Running, Role: LEADER
I20260709 13:07:17.787043 20111 raft_consensus.cc:2468] T 1efebf73c86e432baa55533136b6e12c P 127766fc592545a4997f7790f50f6076 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 17.
I20260709 13:07:17.787788 19526 leader_election.cc:304] T 217b5fae677b4971b3bbd2f357a1f7ff P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168; no voters: e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:07:17.765486 20103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "775c229504194560ba9589bc2199b089" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:07:17.790475 19408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22196caba61445d3bec98a0aab3c337d" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
I20260709 13:07:17.806126 19408 raft_consensus.cc:3060] T 22196caba61445d3bec98a0aab3c337d P e5256d91808b47c195bc9b4dbd7f2b87 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:07:17.791332 19409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76cb037fc9064d13b59a8969d897ce8c" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
I20260709 13:07:17.793617 19404 raft_consensus.cc:1275] T 28af091831594f9d8e96482078cc7625 P e5256d91808b47c195bc9b4dbd7f2b87 [term 19 FOLLOWER]: Refusing update from remote peer e61c3a8f61bb48f8a963c9480e53c168: Log matching property violated. Preceding OpId in replica: term: 18 index: 10. Preceding OpId from leader: term: 19 index: 11. (index mismatch)
W20260709 13:07:17.785116 19449 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.1:40321, user_credentials={real_user=slave}} blocked reactor thread for 182925us
I20260709 13:07:17.636014 26348 leader_election.cc:290] T 309c3ca0ca4b4f3ba129752ea2cb293b P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:07:17.804620 20110 raft_consensus.cc:1240] T 70797e5783b5454ab0d0eea663e791e3 P 127766fc592545a4997f7790f50f6076 [term 23 FOLLOWER]: Rejecting Update request from peer e5256d91808b47c195bc9b4dbd7f2b87 for earlier term 22. Current term is 23. Ops: []
I20260709 13:07:17.683692 26324 leader_election.cc:290] T 1efebf73c86e432baa55533136b6e12c P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:07:17.766320 26293 raft_consensus.cc:2749] T f1b10566f45d4a7d9029858330e02d5b P e61c3a8f61bb48f8a963c9480e53c168 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:07:17.766517 26154 leader_election.cc:290] T 76cb037fc9064d13b59a8969d897ce8c P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 20 election: Requested vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:07:17.771665 26228 raft_consensus.cc:493] T 7be9efa6559648dbb5a0f7684c4542d1 P e61c3a8f61bb48f8a963c9480e53c168 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader e5256d91808b47c195bc9b4dbd7f2b87)
W20260709 13:07:17.767963 19547 thread.cc:608] tablet-delete [worker] (thread pool) Time spent starting thread: real 0.520s	user 0.009s	sys 0.026s
I20260709 13:07:17.808279 19523 leader_election.cc:304] T 1efebf73c86e432baa55533136b6e12c P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 127766fc592545a4997f7790f50f6076, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:07:17.690093 25871 consensus_queue.cc:1059] T 0cdf56e38bbc453d9438d359e5a69955 P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 }, Status: INVALID_TERM, Last received: 19.13, Next index: 14, Last known committed idx: 11, Time since last communication: 0.115s
I20260709 13:07:17.799759 26204 raft_consensus.cc:2749] T 22196caba61445d3bec98a0aab3c337d P 0473d2b2d01f4459b1e90fd12cc7840e [term 21 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:07:17.824036 19409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4509b76741dc428e9201c70c1658da13" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:07:17.861874 19409 raft_consensus.cc:2410] T 4509b76741dc428e9201c70c1658da13 P e5256d91808b47c195bc9b4dbd7f2b87 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e61c3a8f61bb48f8a963c9480e53c168 for term 15 because replica has last-logged OpId of term: 13 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 7.
I20260709 13:07:17.823685 19404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff75a1d4cb1f493db8f71ddc136ba9ab" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
I20260709 13:07:17.828037 19406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc225c93219c45538b53a1bd3d387e4d" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
W20260709 13:07:17.853696 19523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.4:43121, user_credentials={real_user=slave}} blocked reactor thread for 45521.9us
I20260709 13:07:17.814567 19526 leader_election.cc:304] T 2b74109013a140ada21feeef92d6f563 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e61c3a8f61bb48f8a963c9480e53c168; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:07:17.859572 19560 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41504 (request call id 1122) took 1292 ms. Trace:
W20260709 13:07:17.866154 19526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.2:46257, user_credentials={real_user=slave}} blocked reactor thread for 51686.7us
I20260709 13:07:17.865701 19560 rpcz_store.cc:276] 0709 13:07:16.567571 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:16.575600 (+  8029us) service_pool.cc:224] Handling call
0709 13:07:16.600515 (+ 24915us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:16.601152 (+   637us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:16.601186 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:16.601606 (+   420us) log.cc:844] Serialized 26 byte log entry
0709 13:07:16.933124 (+331518us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:07:16.972113 (+ 38989us) log.cc:844] Serialized 14 byte log entry
0709 13:07:16.972323 (+   210us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:16.972399 (+    76us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:17.024990 (+ 52591us) spinlock_profiling.cc:243] Waited 2.91 ms on lock 0x7b18004adfa0. stack: 00007f4a79de9343 00007f4a79de9240 00007f4a797781d4 00007f4a834b6304 00007f4a834b6299 00007f4a82ce3de1 00007f4a82cf05b1 00007f4a79e1b522 00007f4a79e1d7c1 00007f4a79e1d779 00007f4a79e1d709 00007f4a79e1d6d1 00007f4a79e1c9cd 000000000038f354 000000000038f199 00007f4a79dfe83a
0709 13:07:17.853000 (+828010us) raft_consensus.cc:1685] finished
0709 13:07:17.859344 (+  6344us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:17.859513 (+   169us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":93,"prepare.queue_time_us":38976,"prepare.run_cpu_time_us":37,"prepare.run_wall_time_us":40,"raft.queue_time_us":164,"raft.run_cpu_time_us":195,"raft.run_wall_time_us":4674,"spinlock_wait_cycles":6689664,"thread_start_us":331093,"threads_started":1,"wal-append.queue_time_us":522688}
I20260709 13:07:17.867252 19526 leader_election.cc:304] T ed7fdbcb96d14d418db9ca90a792588a P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e61c3a8f61bb48f8a963c9480e53c168; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, 127766fc592545a4997f7790f50f6076
I20260709 13:07:17.869079 19526 leader_election.cc:304] T 1a61655d99124a29b486ba4a5b37faea P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e61c3a8f61bb48f8a963c9480e53c168; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:07:17.864482 25851 raft_consensus.cc:2804] T 1efebf73c86e432baa55533136b6e12c P e61c3a8f61bb48f8a963c9480e53c168 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:07:17.876959 19526 leader_election.cc:304] T b08304a0a02b42d7840c4e8ee9a6bd1a P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e61c3a8f61bb48f8a963c9480e53c168; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:07:17.820194 25747 raft_consensus.cc:2804] T 217b5fae677b4971b3bbd2f357a1f7ff P e61c3a8f61bb48f8a963c9480e53c168 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:07:17.882651 19406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cdf56e38bbc453d9438d359e5a69955" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
I20260709 13:07:17.892589 19557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40e1e16737a842ee936002830f36882e" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 23 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:07:17.893199 19557 raft_consensus.cc:3060] T 40e1e16737a842ee936002830f36882e P e61c3a8f61bb48f8a963c9480e53c168 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:07:17.864200 26154 raft_consensus.cc:493] T edd7d470b5014c9489be7f41f64355c9 P e5256d91808b47c195bc9b4dbd7f2b87 [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:17.805720 26431 consensus_queue.cc:1048] T 86a6797bdfe94fa496c050ceae4bd0d9 P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.082s
I20260709 13:07:17.868053 26293 raft_consensus.cc:2749] T 2b74109013a140ada21feeef92d6f563 P e61c3a8f61bb48f8a963c9480e53c168 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:07:17.824790 26348 consensus_queue.cc:1059] T 85c494af21f9457a85da47b9bc70c1fd P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false }, Status: INVALID_TERM, Last received: 18.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.077s
I20260709 13:07:17.913000 26154 raft_consensus.cc:515] T edd7d470b5014c9489be7f41f64355c9 P e5256d91808b47c195bc9b4dbd7f2b87 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
W20260709 13:07:17.918216 26424 log.cc:927] Time spent T 00000000000000000000000000000000 P 97750b77d35444acb7791ebf26cc2685: Append to log took a long time: real 0.231s	user 0.000s	sys 0.000s
I20260709 13:07:17.879037 26434 raft_consensus.cc:493] T 1f85fc4b527a48848e5faa083b604e36 P 0473d2b2d01f4459b1e90fd12cc7840e [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 127766fc592545a4997f7790f50f6076)
I20260709 13:07:17.930735 20110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c5eebf646ad445a9d1b1adc319d7b16" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076"
I20260709 13:07:17.816615 26163 raft_consensus.cc:515] T 0e1085d23e8347fbbd5bce7542f4b1f4 P 127766fc592545a4997f7790f50f6076 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:07:17.935525 19558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4509b76741dc428e9201c70c1658da13" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:07:17.936415 19556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76cb037fc9064d13b59a8969d897ce8c" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:07:17.937114 19556 raft_consensus.cc:2393] T 76cb037fc9064d13b59a8969d897ce8c P e61c3a8f61bb48f8a963c9480e53c168 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate e5256d91808b47c195bc9b4dbd7f2b87 in current term 20: Already voted for candidate e61c3a8f61bb48f8a963c9480e53c168 in this term.
I20260709 13:07:17.878916 26324 raft_consensus.cc:2749] T ed7fdbcb96d14d418db9ca90a792588a P e61c3a8f61bb48f8a963c9480e53c168 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:07:17.901324 26328 raft_consensus.cc:2749] T b08304a0a02b42d7840c4e8ee9a6bd1a P e61c3a8f61bb48f8a963c9480e53c168 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:07:17.936116 19558 raft_consensus.cc:2468] T 4509b76741dc428e9201c70c1658da13 P e61c3a8f61bb48f8a963c9480e53c168 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 14.
I20260709 13:07:17.854398 26326 consensus_queue.cc:1048] T 217b5fae677b4971b3bbd2f357a1f7ff P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.060s
I20260709 13:07:17.901687 26364 raft_consensus.cc:2749] T 1a61655d99124a29b486ba4a5b37faea P e61c3a8f61bb48f8a963c9480e53c168 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:07:17.878499 25851 raft_consensus.cc:493] T 1efebf73c86e432baa55533136b6e12c P e61c3a8f61bb48f8a963c9480e53c168 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 127766fc592545a4997f7790f50f6076)
W20260709 13:07:17.922684 26427 log.cc:927] Time spent T ece3db938bc649d4a40a51522ed5259c P 127766fc592545a4997f7790f50f6076: Append to log took a long time: real 0.240s	user 0.001s	sys 0.000s
I20260709 13:07:17.923054 26160 leader_election.cc:290] T 6c5eebf646ad445a9d1b1adc319d7b16 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 19 election: Requested vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:07:17.912209 26428 consensus_queue.cc:260] T bc225c93219c45538b53a1bd3d387e4d P 0473d2b2d01f4459b1e90fd12cc7840e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.10, Last appended by leader: 10, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:07:17.927484 26245 leader_election.cc:290] T ff9b0eddd810459b82d91c60777c10eb P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:07:17.901620 25747 raft_consensus.cc:493] T 217b5fae677b4971b3bbd2f357a1f7ff P e61c3a8f61bb48f8a963c9480e53c168 [term 17 FOLLOWER]: Starting leader election (detected failure of leader e5256d91808b47c195bc9b4dbd7f2b87)
W20260709 13:07:17.878088 19450 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.3:36891, user_credentials={real_user=slave}} blocked reactor thread for 210198us
I20260709 13:07:17.860369 26228 raft_consensus.cc:515] T 7be9efa6559648dbb5a0f7684c4542d1 P e61c3a8f61bb48f8a963c9480e53c168 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } attrs { replace: true } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
W20260709 13:07:17.915835 26418 log.cc:927] Time spent T 1dc5b3532fe54f74876d02beffa2c230 P e61c3a8f61bb48f8a963c9480e53c168: Append to log took a long time: real 0.505s	user 0.003s	sys 0.009s
I20260709 13:07:17.940831 26433 tablet_replica.cc:333] T 309c3ca0ca4b4f3ba129752ea2cb293b P e61c3a8f61bb48f8a963c9480e53c168: stopping tablet replica
I20260709 13:07:17.943993 26154 leader_election.cc:290] T edd7d470b5014c9489be7f41f64355c9 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:07:17.947887 26429 raft_consensus.cc:3055] T 85c494af21f9457a85da47b9bc70c1fd P e5256d91808b47c195bc9b4dbd7f2b87 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:07:17.938177 26434 raft_consensus.cc:515] T 1f85fc4b527a48848e5faa083b604e36 P 0473d2b2d01f4459b1e90fd12cc7840e [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:07:17.950217 19408 raft_consensus.cc:2468] T 22196caba61445d3bec98a0aab3c337d P e5256d91808b47c195bc9b4dbd7f2b87 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 21.
I20260709 13:07:17.980239 25851 raft_consensus.cc:3060] T 1efebf73c86e432baa55533136b6e12c P e61c3a8f61bb48f8a963c9480e53c168 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:07:18.000003 19559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f575b143b844aa096b50997dad3516a" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 19 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:07:17.878008 26420 consensus_queue.cc:260] T 70797e5783b5454ab0d0eea663e791e3 P e5256d91808b47c195bc9b4dbd7f2b87 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 22.15, Last appended by leader: 15, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
W20260709 13:07:17.951917 25975 consensus_meta.cc:287] T 76cb037fc9064d13b59a8969d897ce8c P 0473d2b2d01f4459b1e90fd12cc7840e: Time spent flushing consensus metadata: real 0.752s	user 0.007s	sys 0.002s
W20260709 13:07:17.955762 26017 consensus_meta.cc:287] T f93ee515a9c14139bf566522ed8232f3 P 0473d2b2d01f4459b1e90fd12cc7840e: Time spent flushing consensus metadata: real 0.839s	user 0.008s	sys 0.002s
I20260709 13:07:17.979540 26163 leader_election.cc:290] T 0e1085d23e8347fbbd5bce7542f4b1f4 P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:07:17.993907 25747 raft_consensus.cc:3060] T 217b5fae677b4971b3bbd2f357a1f7ff P e61c3a8f61bb48f8a963c9480e53c168 [term 17 FOLLOWER]: Advancing to term 18
W20260709 13:07:18.023980 19450 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:17.983196 19557 raft_consensus.cc:2468] T 40e1e16737a842ee936002830f36882e P e61c3a8f61bb48f8a963c9480e53c168 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 23.
I20260709 13:07:17.989784 19558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edd7d470b5014c9489be7f41f64355c9" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 26 candidate_status { last_received { term: 24 index: 13 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:07:18.025326 19558 raft_consensus.cc:2468] T edd7d470b5014c9489be7f41f64355c9 P e61c3a8f61bb48f8a963c9480e53c168 [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 25.
I20260709 13:07:18.004853 19551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b08304a0a02b42d7840c4e8ee9a6bd1a" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:07:17.982051 26325 raft_consensus.cc:493] T ff9b0eddd810459b82d91c60777c10eb P e5256d91808b47c195bc9b4dbd7f2b87 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:18.032660 19478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1efebf73c86e432baa55533136b6e12c" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:07:18.033254 19478 raft_consensus.cc:2468] T 1efebf73c86e432baa55533136b6e12c P 0473d2b2d01f4459b1e90fd12cc7840e [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 127766fc592545a4997f7790f50f6076 in term 17.
I20260709 13:07:18.034463 20078 leader_election.cc:304] T 1efebf73c86e432baa55533136b6e12c P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, 127766fc592545a4997f7790f50f6076; no voters: 
I20260709 13:07:18.009788 26429 raft_consensus.cc:740] T 85c494af21f9457a85da47b9bc70c1fd P e5256d91808b47c195bc9b4dbd7f2b87 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: e5256d91808b47c195bc9b4dbd7f2b87, State: Running, Role: LEADER
I20260709 13:07:18.040644 19404 raft_consensus.cc:2468] T ff75a1d4cb1f493db8f71ddc136ba9ab P e5256d91808b47c195bc9b4dbd7f2b87 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 20.
I20260709 13:07:18.017864 26428 raft_consensus.cc:3060] T bc225c93219c45538b53a1bd3d387e4d P 0473d2b2d01f4459b1e90fd12cc7840e [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:07:18.019981 25975 raft_consensus.cc:2749] T 76cb037fc9064d13b59a8969d897ce8c P 0473d2b2d01f4459b1e90fd12cc7840e [term 20 FOLLOWER]: Leader election lost for term 19. Reason: Vote denied by peer e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891) with higher term. Message: Invalid argument: T 76cb037fc9064d13b59a8969d897ce8c P e61c3a8f61bb48f8a963c9480e53c168 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 0473d2b2d01f4459b1e90fd12cc7840e for earlier term 19. Current term is 20.
I20260709 13:07:18.048058 26160 raft_consensus.cc:493] T 2a16f7501e2444fb86d4e2778e734e02 P e61c3a8f61bb48f8a963c9480e53c168 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 127766fc592545a4997f7790f50f6076)
I20260709 13:07:18.051797 26160 raft_consensus.cc:515] T 2a16f7501e2444fb86d4e2778e734e02 P e61c3a8f61bb48f8a963c9480e53c168 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:07:18.053459 26228 leader_election.cc:290] T 7be9efa6559648dbb5a0f7684c4542d1 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:07:18.053895 26160 leader_election.cc:290] T 2a16f7501e2444fb86d4e2778e734e02 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:07:18.055764 19526 leader_election.cc:304] T edd7d470b5014c9489be7f41f64355c9 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 25 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e61c3a8f61bb48f8a963c9480e53c168; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:07:18.040289 26420 raft_consensus.cc:3060] T 70797e5783b5454ab0d0eea663e791e3 P e5256d91808b47c195bc9b4dbd7f2b87 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:07:18.054720 19375 leader_election.cc:304] T 4509b76741dc428e9201c70c1658da13 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:07:18.031612 26379 raft_consensus.cc:493] T 3e1f505cb0f1427bbd698ac889d80821 P 0473d2b2d01f4459b1e90fd12cc7840e [term 19 FOLLOWER]: Starting pre-election (detected failure of leader e61c3a8f61bb48f8a963c9480e53c168)
I20260709 13:07:18.037442 26388 raft_consensus.cc:493] T 0e1085d23e8347fbbd5bce7542f4b1f4 P 0473d2b2d01f4459b1e90fd12cc7840e [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:18.063815 19375 leader_election.cc:304] T 40e1e16737a842ee936002830f36882e P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:07:18.039583 26163 raft_consensus.cc:2804] T 1efebf73c86e432baa55533136b6e12c P 127766fc592545a4997f7790f50f6076 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:07:18.022039 26017 raft_consensus.cc:515] T f93ee515a9c14139bf566522ed8232f3 P 0473d2b2d01f4459b1e90fd12cc7840e [term 24 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:07:18.068516 19375 leader_election.cc:304] T edd7d470b5014c9489be7f41f64355c9 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
W20260709 13:07:18.068477 19449 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.4:43121, user_credentials={real_user=slave}} blocked reactor thread for 259709us
I20260709 13:07:18.072242 19526 leader_election.cc:304] T a08760e15aac4630a629431f56024dc8 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e61c3a8f61bb48f8a963c9480e53c168; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:07:18.051818 26433 raft_consensus.cc:2243] T 309c3ca0ca4b4f3ba129752ea2cb293b P e61c3a8f61bb48f8a963c9480e53c168 [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:18.076479 19481 raft_consensus.cc:2468] T 76cb037fc9064d13b59a8969d897ce8c P 0473d2b2d01f4459b1e90fd12cc7840e [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 20.
I20260709 13:07:18.037501 26325 raft_consensus.cc:515] T ff9b0eddd810459b82d91c60777c10eb P e5256d91808b47c195bc9b4dbd7f2b87 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:07:18.067277 26160 raft_consensus.cc:2749] T edd7d470b5014c9489be7f41f64355c9 P e61c3a8f61bb48f8a963c9480e53c168 [term 25 FOLLOWER]: Leader election lost for term 25. Reason: could not achieve majority
W20260709 13:07:18.091787 19523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.1:40321, user_credentials={real_user=slave}} blocked reactor thread for 156729us
I20260709 13:07:18.050153 26316 raft_consensus.cc:515] T ff75a1d4cb1f493db8f71ddc136ba9ab P 0473d2b2d01f4459b1e90fd12cc7840e [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:07:18.068514 26441 raft_consensus.cc:2804] T 4509b76741dc428e9201c70c1658da13 P e5256d91808b47c195bc9b4dbd7f2b87 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:07:18.070871 26163 raft_consensus.cc:493] T 1efebf73c86e432baa55533136b6e12c P 127766fc592545a4997f7790f50f6076 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:18.077255 26289 raft_consensus.cc:2804] T 40e1e16737a842ee936002830f36882e P e5256d91808b47c195bc9b4dbd7f2b87 [term 23 FOLLOWER]: Leader election won for term 23
I20260709 13:07:18.103703 19449 leader_election.cc:304] T 46c5bfeecc314717bffe987e6844b6d0 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e; no voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:07:18.109385 19449 leader_election.cc:304] T d1e5873a19244c5ebbcd38e126796ee7 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e; no voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:07:18.110538 19449 leader_election.cc:304] T 1dc5b3532fe54f74876d02beffa2c230 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e; no voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:07:18.110872 26204 raft_consensus.cc:2749] T 46c5bfeecc314717bffe987e6844b6d0 P 0473d2b2d01f4459b1e90fd12cc7840e [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 13:07:18.111261 26444 raft_consensus.cc:2749] T d1e5873a19244c5ebbcd38e126796ee7 P 0473d2b2d01f4459b1e90fd12cc7840e [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:07:18.111773 26204 raft_consensus.cc:2749] T 1dc5b3532fe54f74876d02beffa2c230 P 0473d2b2d01f4459b1e90fd12cc7840e [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:07:18.112496 26433 raft_consensus.cc:2272] T 309c3ca0ca4b4f3ba129752ea2cb293b P e61c3a8f61bb48f8a963c9480e53c168 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:18.112637 19449 leader_election.cc:304] T 2e36a9d6e29c4a7c860cf267efbd4c74 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e; no voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:07:18.113766 19449 leader_election.cc:304] T a08760e15aac4630a629431f56024dc8 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e; no voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:07:18.084374 26154 raft_consensus.cc:2804] T edd7d470b5014c9489be7f41f64355c9 P e5256d91808b47c195bc9b4dbd7f2b87 [term 25 FOLLOWER]: Leader pre-election won for term 26
I20260709 13:07:18.114485 26444 raft_consensus.cc:2749] T 2e36a9d6e29c4a7c860cf267efbd4c74 P 0473d2b2d01f4459b1e90fd12cc7840e [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:07:18.114606 26154 raft_consensus.cc:493] T edd7d470b5014c9489be7f41f64355c9 P e5256d91808b47c195bc9b4dbd7f2b87 [term 25 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:18.115073 26154 raft_consensus.cc:3060] T edd7d470b5014c9489be7f41f64355c9 P e5256d91808b47c195bc9b4dbd7f2b87 [term 25 FOLLOWER]: Advancing to term 26
I20260709 13:07:18.115165 26444 raft_consensus.cc:2749] T a08760e15aac4630a629431f56024dc8 P 0473d2b2d01f4459b1e90fd12cc7840e [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:07:18.116227 19449 leader_election.cc:304] T fa8650e71aa14778b3d73721fc50d9fc P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e; no voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:07:18.117614 26444 raft_consensus.cc:2749] T fa8650e71aa14778b3d73721fc50d9fc P 0473d2b2d01f4459b1e90fd12cc7840e [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:07:18.119223 26160 consensus_queue.cc:1048] T 28af091831594f9d8e96482078cc7625 P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:07:18.120100 26017 leader_election.cc:290] T f93ee515a9c14139bf566522ed8232f3 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 24 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:07:18.120718 26160 raft_consensus.cc:2749] T a08760e15aac4630a629431f56024dc8 P e61c3a8f61bb48f8a963c9480e53c168 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:07:18.121716 26160 consensus_queue.cc:1048] T 28af091831594f9d8e96482078cc7625 P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:07:18.124851 26325 leader_election.cc:290] T ff9b0eddd810459b82d91c60777c10eb P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:07:18.113179 26163 raft_consensus.cc:3060] T 1efebf73c86e432baa55533136b6e12c P 127766fc592545a4997f7790f50f6076 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:07:18.080720 26429 consensus_queue.cc:260] T 85c494af21f9457a85da47b9bc70c1fd P e5256d91808b47c195bc9b4dbd7f2b87 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 19.15, Last appended by leader: 15, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:07:18.139851 26429 raft_consensus.cc:3060] T 85c494af21f9457a85da47b9bc70c1fd P e5256d91808b47c195bc9b4dbd7f2b87 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:07:18.142799 20107 raft_consensus.cc:2468] T 309c3ca0ca4b4f3ba129752ea2cb293b P 127766fc592545a4997f7790f50f6076 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 12.
I20260709 13:07:18.143455 26434 leader_election.cc:290] T 1f85fc4b527a48848e5faa083b604e36 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:07:18.143841 26246 leader_election.cc:290] T 7f575b143b844aa096b50997dad3516a P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:07:18.101871 26441 raft_consensus.cc:493] T 4509b76741dc428e9201c70c1658da13 P e5256d91808b47c195bc9b4dbd7f2b87 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:18.145007 26441 raft_consensus.cc:3060] T 4509b76741dc428e9201c70c1658da13 P e5256d91808b47c195bc9b4dbd7f2b87 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:07:18.078905 26388 raft_consensus.cc:515] T 0e1085d23e8347fbbd5bce7542f4b1f4 P 0473d2b2d01f4459b1e90fd12cc7840e [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:07:18.148383 26410 raft_consensus.cc:515] T ab43d85f64114d4ebf618930e43d9ed0 P 127766fc592545a4997f7790f50f6076 [term 23 FOLLOWER]: Starting leader election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:07:18.149333 26388 leader_election.cc:290] T 0e1085d23e8347fbbd5bce7542f4b1f4 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:07:18.070861 26379 raft_consensus.cc:515] T 3e1f505cb0f1427bbd698ac889d80821 P 0473d2b2d01f4459b1e90fd12cc7840e [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:07:18.151559 26379 leader_election.cc:290] T 3e1f505cb0f1427bbd698ac889d80821 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:07:18.153167 26316 leader_election.cc:290] T ff75a1d4cb1f493db8f71ddc136ba9ab P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 21 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:07:18.157812 19449 leader_election.cc:304] T 21e14947d70440f19044d8f75c31e1f9 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e; no voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:07:18.166476 26433 ts_tablet_manager.cc:1916] T 309c3ca0ca4b4f3ba129752ea2cb293b P e61c3a8f61bb48f8a963c9480e53c168: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
W20260709 13:07:18.187171 19377 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.2:46257, user_credentials={real_user=slave}} blocked reactor thread for 498424us
I20260709 13:07:18.187944 19377 leader_election.cc:304] T 1a61655d99124a29b486ba4a5b37faea P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:07:18.142223 25747 raft_consensus.cc:515] T 217b5fae677b4971b3bbd2f357a1f7ff P e61c3a8f61bb48f8a963c9480e53c168 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
W20260709 13:07:18.204401 19376 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:18.206367 19449 leader_election.cc:400] T 76cb037fc9064d13b59a8969d897ce8c P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 19 election: Vote denied by peer e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321) with higher term. Message: Invalid argument: T 76cb037fc9064d13b59a8969d897ce8c P e5256d91808b47c195bc9b4dbd7f2b87 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 0473d2b2d01f4459b1e90fd12cc7840e for earlier term 19. Current term is 20.
I20260709 13:07:18.210971 20106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff9b0eddd810459b82d91c60777c10eb" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 22 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:07:18.215003 20106 raft_consensus.cc:2468] T ff9b0eddd810459b82d91c60777c10eb P 127766fc592545a4997f7790f50f6076 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 21.
I20260709 13:07:18.216884 20106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff9b0eddd810459b82d91c60777c10eb" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:07:18.218048 20106 raft_consensus.cc:2393] T ff9b0eddd810459b82d91c60777c10eb P 127766fc592545a4997f7790f50f6076 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0473d2b2d01f4459b1e90fd12cc7840e in current term 21: Already voted for candidate 127766fc592545a4997f7790f50f6076 in this term.
I20260709 13:07:18.218101 20111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e1085d23e8347fbbd5bce7542f4b1f4" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:07:18.218894 20111 raft_consensus.cc:2468] T 0e1085d23e8347fbbd5bce7542f4b1f4 P 127766fc592545a4997f7790f50f6076 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 17.
I20260709 13:07:18.237826 19449 leader_election.cc:304] T 62c6c134d3d24a1ab144dd9ee6bc3f64 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e; no voters: 127766fc592545a4997f7790f50f6076, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:07:18.237780 19450 leader_election.cc:304] T 7f575b143b844aa096b50997dad3516a P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e; no voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:07:18.238337 18300 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:07:18.177522 26364 raft_consensus.cc:493] T 70797e5783b5454ab0d0eea663e791e3 P e61c3a8f61bb48f8a963c9480e53c168 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader e5256d91808b47c195bc9b4dbd7f2b87)
I20260709 13:07:18.257036 19450 leader_election.cc:304] T b08304a0a02b42d7840c4e8ee9a6bd1a P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e; no voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:07:18.258869 20105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f85fc4b527a48848e5faa083b604e36" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:07:18.181573 26316 raft_consensus.cc:2749] T 21e14947d70440f19044d8f75c31e1f9 P 0473d2b2d01f4459b1e90fd12cc7840e [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 13:07:18.259860 19553 raft_consensus.cc:1240] T 217b5fae677b4971b3bbd2f357a1f7ff P e61c3a8f61bb48f8a963c9480e53c168 [term 18 FOLLOWER]: Rejecting Update request from peer e5256d91808b47c195bc9b4dbd7f2b87 for earlier term 17. Current term is 18. Ops: []
I20260709 13:07:18.258571 26207 consensus_queue.cc:1048] T ed7fdbcb96d14d418db9ca90a792588a P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Connected to new peer: Peer: permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.003s
I20260709 13:07:18.270761 26101 raft_consensus.cc:2749] T 7f575b143b844aa096b50997dad3516a P 0473d2b2d01f4459b1e90fd12cc7840e [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:07:18.191766 26410 leader_election.cc:290] T ab43d85f64114d4ebf618930e43d9ed0 P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 23 election: Requested vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:07:18.276523 26154 raft_consensus.cc:515] T edd7d470b5014c9489be7f41f64355c9 P e5256d91808b47c195bc9b4dbd7f2b87 [term 26 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
W20260709 13:07:18.282524 19449 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.4:43121, user_credentials={real_user=slave}} blocked reactor thread for 44770.6us
I20260709 13:07:18.283285 19449 leader_election.cc:304] T 775c229504194560ba9589bc2199b089 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e; no voters: 127766fc592545a4997f7790f50f6076, e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:07:18.284346 19449 leader_election.cc:304] T 0e1085d23e8347fbbd5bce7542f4b1f4 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, 127766fc592545a4997f7790f50f6076; no voters: 
I20260709 13:07:18.285454 26450 raft_consensus.cc:493] T 2b74109013a140ada21feeef92d6f563 P 0473d2b2d01f4459b1e90fd12cc7840e [term 18 FOLLOWER]: Starting pre-election (detected failure of leader e5256d91808b47c195bc9b4dbd7f2b87)
I20260709 13:07:18.285952 26450 raft_consensus.cc:515] T 2b74109013a140ada21feeef92d6f563 P 0473d2b2d01f4459b1e90fd12cc7840e [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:07:18.288091 26450 leader_election.cc:290] T 2b74109013a140ada21feeef92d6f563 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:07:18.288604 26450 raft_consensus.cc:2749] T 62c6c134d3d24a1ab144dd9ee6bc3f64 P 0473d2b2d01f4459b1e90fd12cc7840e [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:07:18.289193 26450 raft_consensus.cc:2749] T b08304a0a02b42d7840c4e8ee9a6bd1a P 0473d2b2d01f4459b1e90fd12cc7840e [term 22 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
I20260709 13:07:18.290258 26450 raft_consensus.cc:2749] T 775c229504194560ba9589bc2199b089 P 0473d2b2d01f4459b1e90fd12cc7840e [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:07:18.290835 26434 raft_consensus.cc:2804] T 0e1085d23e8347fbbd5bce7542f4b1f4 P 0473d2b2d01f4459b1e90fd12cc7840e [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:07:18.291205 26434 raft_consensus.cc:493] T 0e1085d23e8347fbbd5bce7542f4b1f4 P 0473d2b2d01f4459b1e90fd12cc7840e [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:18.291548 26434 raft_consensus.cc:3060] T 0e1085d23e8347fbbd5bce7542f4b1f4 P 0473d2b2d01f4459b1e90fd12cc7840e [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:07:18.292811 25747 leader_election.cc:290] T 217b5fae677b4971b3bbd2f357a1f7ff P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 18 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:07:18.295001 26154 leader_election.cc:290] T edd7d470b5014c9489be7f41f64355c9 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 26 election: Requested vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:07:18.297251 19478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e1085d23e8347fbbd5bce7542f4b1f4" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:07:18.306456 19479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab43d85f64114d4ebf618930e43d9ed0" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 23 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:07:18.307888 19479 raft_consensus.cc:3060] T ab43d85f64114d4ebf618930e43d9ed0 P 0473d2b2d01f4459b1e90fd12cc7840e [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:07:18.219378 26379 consensus_queue.cc:1048] T 86a6797bdfe94fa496c050ceae4bd0d9 P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.087s
I20260709 13:07:18.237360 26388 raft_consensus.cc:493] T 4509b76741dc428e9201c70c1658da13 P 0473d2b2d01f4459b1e90fd12cc7840e [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:18.290417 26163 raft_consensus.cc:515] T 1efebf73c86e432baa55533136b6e12c P 127766fc592545a4997f7790f50f6076 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:07:18.323820 26204 raft_consensus.cc:493] T f1b10566f45d4a7d9029858330e02d5b P 0473d2b2d01f4459b1e90fd12cc7840e [term 19 FOLLOWER]: Starting pre-election (detected failure of leader e5256d91808b47c195bc9b4dbd7f2b87)
I20260709 13:07:18.327762 26410 raft_consensus.cc:493] T 4af19371ea874c09a0a2147040835cbb P 127766fc592545a4997f7790f50f6076 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader e5256d91808b47c195bc9b4dbd7f2b87)
I20260709 13:07:18.296402 26364 raft_consensus.cc:515] T 70797e5783b5454ab0d0eea663e791e3 P e61c3a8f61bb48f8a963c9480e53c168 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
W20260709 13:07:18.349653 19526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.2:46257, user_credentials={real_user=slave}} blocked reactor thread for 277500us
I20260709 13:07:18.331059 26447 raft_consensus.cc:493] T 7be9efa6559648dbb5a0f7684c4542d1 P 0473d2b2d01f4459b1e90fd12cc7840e [term 21 FOLLOWER]: Starting pre-election (detected failure of leader e5256d91808b47c195bc9b4dbd7f2b87)
I20260709 13:07:18.354936 19479 raft_consensus.cc:2468] T ab43d85f64114d4ebf618930e43d9ed0 P 0473d2b2d01f4459b1e90fd12cc7840e [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 127766fc592545a4997f7790f50f6076 in term 23.
I20260709 13:07:18.355377 19526 leader_election.cc:304] T d1e5873a19244c5ebbcd38e126796ee7 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e61c3a8f61bb48f8a963c9480e53c168; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:07:18.329001 26388 raft_consensus.cc:515] T 4509b76741dc428e9201c70c1658da13 P 0473d2b2d01f4459b1e90fd12cc7840e [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
W20260709 13:07:18.358652 19523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.1:40321, user_credentials={real_user=slave}} blocked reactor thread for 265007us
I20260709 13:07:18.346269 25871 raft_consensus.cc:493] T 179fd671030940b4b4a4e24bcc4aba0a P 0473d2b2d01f4459b1e90fd12cc7840e [term 22 FOLLOWER]: Starting pre-election (detected failure of leader e5256d91808b47c195bc9b4dbd7f2b87)
I20260709 13:07:18.365999 19526 leader_election.cc:304] T 22196caba61445d3bec98a0aab3c337d P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:07:18.370822 19523 leader_election.cc:304] T ff75a1d4cb1f493db8f71ddc136ba9ab P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:07:18.375332 19526 leader_election.cc:304] T 76cb037fc9064d13b59a8969d897ce8c P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168; no voters: e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:07:18.351245 26204 raft_consensus.cc:515] T f1b10566f45d4a7d9029858330e02d5b P 0473d2b2d01f4459b1e90fd12cc7840e [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:07:18.377923 20105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7be9efa6559648dbb5a0f7684c4542d1" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:07:18.376650 20106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a16f7501e2444fb86d4e2778e734e02" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:07:18.356451 26410 raft_consensus.cc:515] T 4af19371ea874c09a0a2147040835cbb P 127766fc592545a4997f7790f50f6076 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:07:18.365165 25851 raft_consensus.cc:515] T 1efebf73c86e432baa55533136b6e12c P e61c3a8f61bb48f8a963c9480e53c168 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:07:18.359596 26447 raft_consensus.cc:515] T 7be9efa6559648dbb5a0f7684c4542d1 P 0473d2b2d01f4459b1e90fd12cc7840e [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } attrs { replace: true } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:07:18.370374 25871 raft_consensus.cc:515] T 179fd671030940b4b4a4e24bcc4aba0a P 0473d2b2d01f4459b1e90fd12cc7840e [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:07:18.372750 26464 raft_consensus.cc:2749] T d1e5873a19244c5ebbcd38e126796ee7 P e61c3a8f61bb48f8a963c9480e53c168 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:07:18.420306 26204 leader_election.cc:290] T f1b10566f45d4a7d9029858330e02d5b P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:07:18.422489 25871 leader_election.cc:290] T 179fd671030940b4b4a4e24bcc4aba0a P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
W20260709 13:07:18.462550 19377 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.2:46257, user_credentials={real_user=slave}} blocked reactor thread for 274678us
I20260709 13:07:18.463136 19406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f93ee515a9c14139bf566522ed8232f3" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 24 candidate_status { last_received { term: 23 index: 12 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
I20260709 13:07:18.379225 26293 raft_consensus.cc:2804] T ff75a1d4cb1f493db8f71ddc136ba9ab P e61c3a8f61bb48f8a963c9480e53c168 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:07:18.379381 26228 raft_consensus.cc:2804] T 22196caba61445d3bec98a0aab3c337d P e61c3a8f61bb48f8a963c9480e53c168 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:07:18.380879 26457 raft_consensus.cc:2804] T 76cb037fc9064d13b59a8969d897ce8c P e61c3a8f61bb48f8a963c9480e53c168 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:07:18.431805 26364 leader_election.cc:290] T 70797e5783b5454ab0d0eea663e791e3 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
W20260709 13:07:18.431998 26439 log.cc:927] Time spent T 0cdf56e38bbc453d9438d359e5a69955 P e5256d91808b47c195bc9b4dbd7f2b87: Append to log took a long time: real 0.414s	user 0.000s	sys 0.003s
W20260709 13:07:18.435202 26435 log.cc:927] Time spent T e381f1d6b8184797ad142de49be225a8 P e5256d91808b47c195bc9b4dbd7f2b87: Append to log took a long time: real 0.365s	user 0.004s	sys 0.000s
I20260709 13:07:18.439939 26432 raft_consensus.cc:3055] T 0cdf56e38bbc453d9438d359e5a69955 P 0473d2b2d01f4459b1e90fd12cc7840e [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:07:18.464213 26429 raft_consensus.cc:2749] T 1a61655d99124a29b486ba4a5b37faea P e5256d91808b47c195bc9b4dbd7f2b87 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:07:18.377653 26382 raft_consensus.cc:493] T 28af091831594f9d8e96482078cc7625 P 0473d2b2d01f4459b1e90fd12cc7840e [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:18.443657 19554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0afb57ae58a24a01850491d69f0213dd" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:07:18.443620 26289 raft_consensus.cc:697] T 40e1e16737a842ee936002830f36882e P e5256d91808b47c195bc9b4dbd7f2b87 [term 23 LEADER]: Becoming Leader. State: Replica: e5256d91808b47c195bc9b4dbd7f2b87, State: Running, Role: LEADER
I20260709 13:07:18.423823 26441 raft_consensus.cc:515] T 4509b76741dc428e9201c70c1658da13 P e5256d91808b47c195bc9b4dbd7f2b87 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:07:18.446587 26410 leader_election.cc:290] T 4af19371ea874c09a0a2147040835cbb P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:07:18.447237 19404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7be9efa6559648dbb5a0f7684c4542d1" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:07:18.501792 19477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c5eebf646ad445a9d1b1adc319d7b16" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:07:18.512028 19404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "179fd671030940b4b4a4e24bcc4aba0a" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:07:18.447453 19409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "217b5fae677b4971b3bbd2f357a1f7ff" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
I20260709 13:07:18.513270 19477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4509b76741dc428e9201c70c1658da13" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:07:18.514057 19477 raft_consensus.cc:2468] T 4509b76741dc428e9201c70c1658da13 P 0473d2b2d01f4459b1e90fd12cc7840e [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 14.
I20260709 13:07:18.514127 19409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4509b76741dc428e9201c70c1658da13" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:07:18.448521 19408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a16f7501e2444fb86d4e2778e734e02" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:07:18.449465 26388 leader_election.cc:290] T 4509b76741dc428e9201c70c1658da13 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
W20260709 13:07:18.449615 19374 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:18.449911 26262 raft_consensus.cc:493] T 1f85fc4b527a48848e5faa083b604e36 P e5256d91808b47c195bc9b4dbd7f2b87 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 127766fc592545a4997f7790f50f6076)
I20260709 13:07:18.450641 26420 consensus_queue.cc:1059] T 217b5fae677b4971b3bbd2f357a1f7ff P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 }, Status: INVALID_TERM, Last received: 17.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:07:18.454815 19402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff9b0eddd810459b82d91c60777c10eb" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:07:18.526304 19408 raft_consensus.cc:1275] T 2725d2c4cb054f18b0fc8f735c15f6c2 P e5256d91808b47c195bc9b4dbd7f2b87 [term 21 FOLLOWER]: Refusing update from remote peer 0473d2b2d01f4459b1e90fd12cc7840e: Log matching property violated. Preceding OpId in replica: term: 19 index: 10. Preceding OpId from leader: term: 21 index: 11. (index mismatch)
I20260709 13:07:18.455432 19407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e1f505cb0f1427bbd698ac889d80821" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:07:18.456931 19403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b74109013a140ada21feeef92d6f563" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:07:18.458863 19405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f85fc4b527a48848e5faa083b604e36" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:07:18.461906 25851 leader_election.cc:290] T 1efebf73c86e432baa55533136b6e12c P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 17 election: Requested vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:07:18.469179 19485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cdf56e38bbc453d9438d359e5a69955" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:07:18.533536 19523 leader_election.cc:304] T 6c5eebf646ad445a9d1b1adc319d7b16 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e61c3a8f61bb48f8a963c9480e53c168; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, 127766fc592545a4997f7790f50f6076
I20260709 13:07:18.533954 19485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1efebf73c86e432baa55533136b6e12c" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:07:18.477758 26468 raft_consensus.cc:493] T 0e1085d23e8347fbbd5bce7542f4b1f4 P e61c3a8f61bb48f8a963c9480e53c168 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 127766fc592545a4997f7790f50f6076)
I20260709 13:07:18.473687 19483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc225c93219c45538b53a1bd3d387e4d" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:07:18.476572 19481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff75a1d4cb1f493db8f71ddc136ba9ab" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:07:18.547217 19481 raft_consensus.cc:2368] T ff75a1d4cb1f493db8f71ddc136ba9ab P 0473d2b2d01f4459b1e90fd12cc7840e [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate e61c3a8f61bb48f8a963c9480e53c168 for earlier term 20. Current term is 21.
I20260709 13:07:18.476311 19484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2725d2c4cb054f18b0fc8f735c15f6c2" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:07:18.479103 19486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4509b76741dc428e9201c70c1658da13" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:07:18.440184 26321 raft_consensus.cc:493] T 48824d5acfbc485ebf8c2d944e7202de P e61c3a8f61bb48f8a963c9480e53c168 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 127766fc592545a4997f7790f50f6076)
I20260709 13:07:18.492933 19556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edd7d470b5014c9489be7f41f64355c9" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 26 candidate_status { last_received { term: 24 index: 13 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:07:18.498960 19559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f93ee515a9c14139bf566522ed8232f3" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 24 candidate_status { last_received { term: 23 index: 12 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:07:18.499383 19557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85c494af21f9457a85da47b9bc70c1fd" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:07:18.548414 19486 raft_consensus.cc:2468] T 4509b76741dc428e9201c70c1658da13 P 0473d2b2d01f4459b1e90fd12cc7840e [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 14.
I20260709 13:07:18.548573 19556 raft_consensus.cc:3060] T edd7d470b5014c9489be7f41f64355c9 P e61c3a8f61bb48f8a963c9480e53c168 [term 25 FOLLOWER]: Advancing to term 26
I20260709 13:07:18.549312 19486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76cb037fc9064d13b59a8969d897ce8c" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:07:18.549803 19486 raft_consensus.cc:2393] T 76cb037fc9064d13b59a8969d897ce8c P 0473d2b2d01f4459b1e90fd12cc7840e [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate e5256d91808b47c195bc9b4dbd7f2b87 in current term 20: Already voted for candidate e61c3a8f61bb48f8a963c9480e53c168 in this term.
I20260709 13:07:18.501197 19480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1efebf73c86e432baa55533136b6e12c" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:07:18.505101 19551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1efebf73c86e432baa55533136b6e12c" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:07:18.506037 19553 raft_consensus.cc:1240] T 6c5eebf646ad445a9d1b1adc319d7b16 P e61c3a8f61bb48f8a963c9480e53c168 [term 19 FOLLOWER]: Rejecting Update request from peer 0473d2b2d01f4459b1e90fd12cc7840e for earlier term 18. Current term is 19. Ops: []
I20260709 13:07:18.550876 19553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e1085d23e8347fbbd5bce7542f4b1f4" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:07:18.517593 19477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "217b5fae677b4971b3bbd2f357a1f7ff" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:07:18.521173 19404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff75a1d4cb1f493db8f71ddc136ba9ab" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 21 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
I20260709 13:07:18.551678 19477 raft_consensus.cc:3060] T 217b5fae677b4971b3bbd2f357a1f7ff P 0473d2b2d01f4459b1e90fd12cc7840e [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:07:18.476941 26228 raft_consensus.cc:697] T 22196caba61445d3bec98a0aab3c337d P e61c3a8f61bb48f8a963c9480e53c168 [term 21 LEADER]: Becoming Leader. State: Replica: e61c3a8f61bb48f8a963c9480e53c168, State: Running, Role: LEADER
I20260709 13:07:18.477665 26432 raft_consensus.cc:740] T 0cdf56e38bbc453d9438d359e5a69955 P 0473d2b2d01f4459b1e90fd12cc7840e [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 0473d2b2d01f4459b1e90fd12cc7840e, State: Running, Role: LEADER
I20260709 13:07:18.528674 19552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e1f505cb0f1427bbd698ac889d80821" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:07:18.479470 26293 raft_consensus.cc:697] T ff75a1d4cb1f493db8f71ddc136ba9ab P e61c3a8f61bb48f8a963c9480e53c168 [term 20 LEADER]: Becoming Leader. State: Replica: e61c3a8f61bb48f8a963c9480e53c168, State: Running, Role: LEADER
I20260709 13:07:18.479367 26328 raft_consensus.cc:493] T 7f575b143b844aa096b50997dad3516a P e61c3a8f61bb48f8a963c9480e53c168 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader e5256d91808b47c195bc9b4dbd7f2b87)
I20260709 13:07:18.533591 19560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1b10566f45d4a7d9029858330e02d5b" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:07:18.526454 19402 raft_consensus.cc:2468] T ff9b0eddd810459b82d91c60777c10eb P e5256d91808b47c195bc9b4dbd7f2b87 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 21.
I20260709 13:07:18.568852 19560 raft_consensus.cc:2468] T f1b10566f45d4a7d9029858330e02d5b P e61c3a8f61bb48f8a963c9480e53c168 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 19.
I20260709 13:07:18.569249 19402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70797e5783b5454ab0d0eea663e791e3" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:07:18.569695 19560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b74109013a140ada21feeef92d6f563" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:07:18.570775 19560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4af19371ea874c09a0a2147040835cbb" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:07:18.571329 19560 raft_consensus.cc:2468] T 4af19371ea874c09a0a2147040835cbb P e61c3a8f61bb48f8a963c9480e53c168 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 127766fc592545a4997f7790f50f6076 in term 12.
I20260709 13:07:18.472985 19406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1b10566f45d4a7d9029858330e02d5b" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:07:18.572650 19410 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52342 (request call id 3399) took 1152 ms. Trace:
I20260709 13:07:18.537446 20106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70797e5783b5454ab0d0eea663e791e3" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:07:18.574388 20106 raft_consensus.cc:2393] T 70797e5783b5454ab0d0eea663e791e3 P 127766fc592545a4997f7790f50f6076 [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e61c3a8f61bb48f8a963c9480e53c168 in current term 23: Already voted for candidate 127766fc592545a4997f7790f50f6076 in this term.
I20260709 13:07:18.538412 19526 leader_election.cc:304] T 0cdf56e38bbc453d9438d359e5a69955 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e61c3a8f61bb48f8a963c9480e53c168; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:07:18.542022 20076 leader_election.cc:304] T 0afb57ae58a24a01850491d69f0213dd P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 127766fc592545a4997f7790f50f6076; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:07:18.542236 19409 raft_consensus.cc:2393] T 4509b76741dc428e9201c70c1658da13 P e5256d91808b47c195bc9b4dbd7f2b87 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0473d2b2d01f4459b1e90fd12cc7840e in current term 15: Already voted for candidate e5256d91808b47c195bc9b4dbd7f2b87 in this term.
I20260709 13:07:18.547827 19408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7be9efa6559648dbb5a0f7684c4542d1" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:07:18.575848 19526 leader_election.cc:400] T ff75a1d4cb1f493db8f71ddc136ba9ab P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 20 election: Vote denied by peer 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257) with higher term. Message: Invalid argument: T ff75a1d4cb1f493db8f71ddc136ba9ab P 0473d2b2d01f4459b1e90fd12cc7840e [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate e61c3a8f61bb48f8a963c9480e53c168 for earlier term 20. Current term is 21.
I20260709 13:07:18.551717 19404 raft_consensus.cc:3060] T ff75a1d4cb1f493db8f71ddc136ba9ab P e5256d91808b47c195bc9b4dbd7f2b87 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:07:18.576638 19526 leader_election.cc:304] T 4509b76741dc428e9201c70c1658da13 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168; no voters: e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:07:18.462558 26434 raft_consensus.cc:515] T 0e1085d23e8347fbbd5bce7542f4b1f4 P 0473d2b2d01f4459b1e90fd12cc7840e [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:07:18.553313 19485 raft_consensus.cc:2393] T 1efebf73c86e432baa55533136b6e12c P 0473d2b2d01f4459b1e90fd12cc7840e [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate e61c3a8f61bb48f8a963c9480e53c168 in current term 17: Already voted for candidate 0473d2b2d01f4459b1e90fd12cc7840e in this term.
I20260709 13:07:18.555399 19559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "179fd671030940b4b4a4e24bcc4aba0a" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:07:18.550262 19551 raft_consensus.cc:2468] T 1efebf73c86e432baa55533136b6e12c P e61c3a8f61bb48f8a963c9480e53c168 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 127766fc592545a4997f7790f50f6076 in term 17.
I20260709 13:07:18.559561 19481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "309c3ca0ca4b4f3ba129752ea2cb293b" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:07:18.559665 19552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab43d85f64114d4ebf618930e43d9ed0" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 23 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:07:18.562618 20103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1efebf73c86e432baa55533136b6e12c" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076"
I20260709 13:07:18.582499 19406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85c494af21f9457a85da47b9bc70c1fd" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
I20260709 13:07:18.582938 19552 raft_consensus.cc:3060] T ab43d85f64114d4ebf618930e43d9ed0 P e61c3a8f61bb48f8a963c9480e53c168 [term 21 FOLLOWER]: Advancing to term 23
I20260709 13:07:18.583114 20103 raft_consensus.cc:2368] T 1efebf73c86e432baa55533136b6e12c P 127766fc592545a4997f7790f50f6076 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate e61c3a8f61bb48f8a963c9480e53c168 for earlier term 17. Current term is 18.
I20260709 13:07:18.524974 26429 raft_consensus.cc:493] T 86a6797bdfe94fa496c050ceae4bd0d9 P e5256d91808b47c195bc9b4dbd7f2b87 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:18.567773 19483 raft_consensus.cc:2468] T bc225c93219c45538b53a1bd3d387e4d P 0473d2b2d01f4459b1e90fd12cc7840e [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 18.
I20260709 13:07:18.516037 26470 raft_consensus.cc:493] T 85c494af21f9457a85da47b9bc70c1fd P e61c3a8f61bb48f8a963c9480e53c168 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader e5256d91808b47c195bc9b4dbd7f2b87)
I20260709 13:07:18.608510 26470 raft_consensus.cc:515] T 85c494af21f9457a85da47b9bc70c1fd P e61c3a8f61bb48f8a963c9480e53c168 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:07:18.609915 19374 leader_election.cc:304] T ff9b0eddd810459b82d91c60777c10eb P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 127766fc592545a4997f7790f50f6076, e5256d91808b47c195bc9b4dbd7f2b87; no voters: 
I20260709 13:07:18.611752 19478 raft_consensus.cc:2393] T 0e1085d23e8347fbbd5bce7542f4b1f4 P 0473d2b2d01f4459b1e90fd12cc7840e [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 127766fc592545a4997f7790f50f6076 in current term 18: Already voted for candidate 0473d2b2d01f4459b1e90fd12cc7840e in this term.
I20260709 13:07:18.611801 26097 raft_consensus.cc:2804] T ff9b0eddd810459b82d91c60777c10eb P e5256d91808b47c195bc9b4dbd7f2b87 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:07:18.612355 26097 raft_consensus.cc:493] T ff9b0eddd810459b82d91c60777c10eb P e5256d91808b47c195bc9b4dbd7f2b87 [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:18.612576 19485 raft_consensus.cc:1240] T f93ee515a9c14139bf566522ed8232f3 P 0473d2b2d01f4459b1e90fd12cc7840e [term 24 FOLLOWER]: Rejecting Update request from peer e61c3a8f61bb48f8a963c9480e53c168 for earlier term 23. Current term is 24. Ops: []
I20260709 13:07:18.612742 26097 raft_consensus.cc:3060] T ff9b0eddd810459b82d91c60777c10eb P e5256d91808b47c195bc9b4dbd7f2b87 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:07:18.613547 19485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff9b0eddd810459b82d91c60777c10eb" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 22 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:07:18.614100 19485 raft_consensus.cc:2468] T ff9b0eddd810459b82d91c60777c10eb P 0473d2b2d01f4459b1e90fd12cc7840e [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 20.
I20260709 13:07:18.569816 19402 raft_consensus.cc:2468] T 70797e5783b5454ab0d0eea663e791e3 P e5256d91808b47c195bc9b4dbd7f2b87 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 23.
I20260709 13:07:18.464493 20078 leader_election.cc:304] T ab43d85f64114d4ebf618930e43d9ed0 P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, 127766fc592545a4997f7790f50f6076; no voters: 
I20260709 13:07:18.499835 25923 consensus_queue.cc:1059] T b08304a0a02b42d7840c4e8ee9a6bd1a P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 }, Status: INVALID_TERM, Last received: 21.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.054s
I20260709 13:07:18.580235 19408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4af19371ea874c09a0a2147040835cbb" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
W20260709 13:07:18.615892 20078 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.2:46257, user_credentials={real_user=slave}} blocked reactor thread for 151465us
I20260709 13:07:18.616171 25923 raft_consensus.cc:3055] T b08304a0a02b42d7840c4e8ee9a6bd1a P e5256d91808b47c195bc9b4dbd7f2b87 [term 21 LEADER]: Stepping down as leader of term 21
I20260709 13:07:18.616569 25923 raft_consensus.cc:740] T b08304a0a02b42d7840c4e8ee9a6bd1a P e5256d91808b47c195bc9b4dbd7f2b87 [term 21 LEADER]: Becoming Follower/Learner. State: Replica: e5256d91808b47c195bc9b4dbd7f2b87, State: Running, Role: LEADER
I20260709 13:07:18.617331 25923 consensus_queue.cc:260] T b08304a0a02b42d7840c4e8ee9a6bd1a P e5256d91808b47c195bc9b4dbd7f2b87 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 21.12, Last appended by leader: 12, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:07:18.617858 26425 raft_consensus.cc:2804] T ab43d85f64114d4ebf618930e43d9ed0 P 127766fc592545a4997f7790f50f6076 [term 23 FOLLOWER]: Leader election won for term 23
I20260709 13:07:18.618424 26425 raft_consensus.cc:697] T ab43d85f64114d4ebf618930e43d9ed0 P 127766fc592545a4997f7790f50f6076 [term 23 LEADER]: Becoming Leader. State: Replica: 127766fc592545a4997f7790f50f6076, State: Running, Role: LEADER
I20260709 13:07:18.618564 26293 consensus_queue.cc:237] T ff75a1d4cb1f493db8f71ddc136ba9ab P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 19.10, Last appended by leader: 10, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:07:18.619059 19552 raft_consensus.cc:2468] T ab43d85f64114d4ebf618930e43d9ed0 P e61c3a8f61bb48f8a963c9480e53c168 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 127766fc592545a4997f7790f50f6076 in term 23.
I20260709 13:07:18.614614 19404 raft_consensus.cc:2468] T ff75a1d4cb1f493db8f71ddc136ba9ab P e5256d91808b47c195bc9b4dbd7f2b87 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 21.
I20260709 13:07:18.619289 26425 consensus_queue.cc:237] T ab43d85f64114d4ebf618930e43d9ed0 P 127766fc592545a4997f7790f50f6076 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 21.14, Last appended by leader: 14, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:07:18.553566 25851 raft_consensus.cc:2749] T 6c5eebf646ad445a9d1b1adc319d7b16 P e61c3a8f61bb48f8a963c9480e53c168 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:07:18.573006 19410 rpcz_store.cc:276] 0709 13:07:17.421918 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:17.422478 (+   560us) service_pool.cc:224] Handling call
0709 13:07:17.422840 (+   362us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:17.423167 (+   327us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:17.423195 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:17.423642 (+   447us) log.cc:844] Serialized 26 byte log entry
0709 13:07:17.852824 (+429182us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:07:17.852866 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:17.852939 (+    73us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:18.413567 (+560628us) spinlock_profiling.cc:243] Waited 3.49 ms on lock 0x7b4400022b4c. stack: 00007f4a79de9343 00007f4a79de9240 00007f4a797781d4 00007f4a834b6304 00007f4a834b6299 00007f4a79ca3db1 00007f4a79d41c85 00007f4a79d426a2 00007f4a7cab41db 00007f4a7caafaaf 00007f4a7caa386e 00007f4a7caa2bb6 00007f4a7caa27d8 00007f4a7caac221 00007f4a7caac1d9 00007f4a7caac169
0709 13:07:18.561751 (+148184us) raft_consensus.cc:1685] finished
0709 13:07:18.561772 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:18.572594 (+ 10822us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":2121,"raft.run_cpu_time_us":93,"raft.run_wall_time_us":93,"spinlock_wait_cycles":8021248,"thread_start_us":428810,"threads_started":1,"wal-append.queue_time_us":611159}
I20260709 13:07:18.628682 19377 leader_election.cc:304] T 76cb037fc9064d13b59a8969d897ce8c P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:07:18.592336 19411 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52342 (request call id 3400) took 1168 ms. Trace:
I20260709 13:07:18.593012 19559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4509b76741dc428e9201c70c1658da13" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:07:18.629578 19559 raft_consensus.cc:2468] T 4509b76741dc428e9201c70c1658da13 P e61c3a8f61bb48f8a963c9480e53c168 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 14.
I20260709 13:07:18.630574 19559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e1085d23e8347fbbd5bce7542f4b1f4" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:07:18.593767 19551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e1085d23e8347fbbd5bce7542f4b1f4" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:07:18.630873 19558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7be9efa6559648dbb5a0f7684c4542d1" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:07:18.565820 26430 raft_consensus.cc:493] T 28af091831594f9d8e96482078cc7625 P e5256d91808b47c195bc9b4dbd7f2b87 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:18.601449 26447 leader_election.cc:290] T 7be9efa6559648dbb5a0f7684c4542d1 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:07:18.591200 26331 raft_consensus.cc:493] T ece3db938bc649d4a40a51522ed5259c P 127766fc592545a4997f7790f50f6076 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader e61c3a8f61bb48f8a963c9480e53c168)
I20260709 13:07:18.602367 26434 leader_election.cc:290] T 0e1085d23e8347fbbd5bce7542f4b1f4 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 18 election: Requested vote from peers e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:07:18.536134 26262 raft_consensus.cc:515] T 1f85fc4b527a48848e5faa083b604e36 P e5256d91808b47c195bc9b4dbd7f2b87 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:07:18.603178 26228 consensus_queue.cc:237] T 22196caba61445d3bec98a0aab3c337d P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 19.12, Last appended by leader: 12, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:07:18.559095 26468 raft_consensus.cc:515] T 0e1085d23e8347fbbd5bce7542f4b1f4 P e61c3a8f61bb48f8a963c9480e53c168 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:07:18.605003 19484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edd7d470b5014c9489be7f41f64355c9" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 26 candidate_status { last_received { term: 24 index: 13 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:07:18.663028 19484 raft_consensus.cc:2468] T edd7d470b5014c9489be7f41f64355c9 P 0473d2b2d01f4459b1e90fd12cc7840e [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 24.
I20260709 13:07:18.580725 26328 raft_consensus.cc:515] T 7f575b143b844aa096b50997dad3516a P e61c3a8f61bb48f8a963c9480e53c168 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:07:18.606778 26429 raft_consensus.cc:515] T 86a6797bdfe94fa496c050ceae4bd0d9 P e5256d91808b47c195bc9b4dbd7f2b87 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:07:18.607190 19481 raft_consensus.cc:1240] T 21e14947d70440f19044d8f75c31e1f9 P 0473d2b2d01f4459b1e90fd12cc7840e [term 21 FOLLOWER]: Rejecting Update request from peer e61c3a8f61bb48f8a963c9480e53c168 for earlier term 20. Current term is 21. Ops: []
I20260709 13:07:18.561996 26321 raft_consensus.cc:515] T 48824d5acfbc485ebf8c2d944e7202de P e61c3a8f61bb48f8a963c9480e53c168 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:07:18.622413 19557 raft_consensus.cc:3060] T 85c494af21f9457a85da47b9bc70c1fd P e61c3a8f61bb48f8a963c9480e53c168 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:07:18.583518 19406 raft_consensus.cc:2410] T 85c494af21f9457a85da47b9bc70c1fd P e5256d91808b47c195bc9b4dbd7f2b87 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 127766fc592545a4997f7790f50f6076 for term 20 because replica has last-logged OpId of term: 19 index: 15, which is greater than that of the candidate, which has last-logged OpId of term: 18 index: 14.
I20260709 13:07:18.625486 19477 raft_consensus.cc:2468] T 217b5fae677b4971b3bbd2f357a1f7ff P 0473d2b2d01f4459b1e90fd12cc7840e [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 18.
I20260709 13:07:18.578979 19449 leader_election.cc:304] T ff9b0eddd810459b82d91c60777c10eb P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87; no voters: 127766fc592545a4997f7790f50f6076
I20260709 13:07:18.633646 26325 raft_consensus.cc:2749] T 76cb037fc9064d13b59a8969d897ce8c P e5256d91808b47c195bc9b4dbd7f2b87 [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 13:07:18.516701 26382 raft_consensus.cc:515] T 28af091831594f9d8e96482078cc7625 P 0473d2b2d01f4459b1e90fd12cc7840e [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:07:18.634335 19485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edd7d470b5014c9489be7f41f64355c9" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 26 candidate_status { last_received { term: 24 index: 13 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:07:18.682919 19485 raft_consensus.cc:3060] T edd7d470b5014c9489be7f41f64355c9 P 0473d2b2d01f4459b1e90fd12cc7840e [term 24 FOLLOWER]: Advancing to term 26
I20260709 13:07:18.634871 19556 raft_consensus.cc:2468] T edd7d470b5014c9489be7f41f64355c9 P e61c3a8f61bb48f8a963c9480e53c168 [term 26 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 26.
I20260709 13:07:18.629369 19411 rpcz_store.cc:276] 0709 13:07:17.426206 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:17.426662 (+   456us) service_pool.cc:224] Handling call
0709 13:07:17.427106 (+   444us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:07:17.481004 (+ 53898us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:17.481048 (+    44us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:07:17.501007 (+ 19959us) log.cc:844] Serialized 52 byte log entry
0709 13:07:17.768183 (+267176us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:07:18.055707 (+287524us) log.cc:844] Serialized 14 byte log entry
0709 13:07:18.059120 (+  3413us) log.cc:844] Serialized 14 byte log entry
0709 13:07:18.071258 (+ 12138us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:18.071335 (+    77us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:18.147357 (+ 76022us) spinlock_profiling.cc:243] Waited 4.17 ms on lock 0x7b1800404800. stack: 00007f4a79de9343 00007f4a79de9240 00007f4a797781d4 00007f4a834b6304 00007f4a834b6299 00007f4a82ce3de1 00007f4a82cf05b1 00007f4a79e1b3f3 00007f4a79e1d7c1 00007f4a79e1d779 00007f4a79e1d709 00007f4a79e1d6d1 00007f4a79e1c9cd 000000000038f354 000000000038f199 00007f4a79dfe83a
0709 13:07:18.374225 (+226868us) spinlock_profiling.cc:243] Waited 3.86 ms on lock 0x7b1800404800. stack: 00007f4a79de9343 00007f4a79de9240 00007f4a797781d4 00007f4a834b6304 00007f4a834b6299 00007f4a82ce3de1 00007f4a82cf05b1 00007f4a79e1b522 00007f4a79e1d7c1 00007f4a79e1d779 00007f4a79e1d709 00007f4a79e1d6d1 00007f4a79e1c9cd 000000000038f354 000000000038f199 00007f4a79dfe83a
0709 13:07:18.416737 (+ 42512us) spinlock_profiling.cc:243] Waited 4.68 ms on lock 0x7b4400022b4c. stack: 00007f4a79de9343 00007f4a79de9240 00007f4a797781d4 00007f4a834b6304 00007f4a834b6299 00007f4a79ca3db1 00007f4a79d41c85 00007f4a79d426a2 00007f4a7cab41db 00007f4a7caafaaf 00007f4a7caa386e 00007f4a7caa2bb6 00007f4a7caa27d8 00007f4a7caac221 00007f4a7caac1d9 00007f4a7caac169
0709 13:07:18.443318 (+ 26581us) spinlock_profiling.cc:243] Waited 5.08 ms on lock 0x7b1800404800. stack: 00007f4a79de9343 00007f4a79de9240 00007f4a797781d4 00007f4a834b6304 00007f4a834b6299 00007f4a82ce3de1 00007f4a82cf05b1 00007f4a79d95c0a 00007f4a834d5219 00007f4a80ddc58f 00007f4a79e1b571 00007f4a79e1d7c1 00007f4a79e1d779 00007f4a79e1d709 00007f4a79e1d6d1 00007f4a79e1c9cd
0709 13:07:18.592141 (+148823us) raft_consensus.cc:1685] finished
0709 13:07:18.592161 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:18.592282 (+   121us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":374459,"prepare.queue_time_us":94188,"prepare.run_cpu_time_us":91,"prepare.run_wall_time_us":3134,"raft.queue_time_us":79273,"raft.run_cpu_time_us":370,"raft.run_wall_time_us":10172,"spinlock_wait_cycles":40903552,"thread_start_us":438023,"threads_started":2,"wal-append.queue_time_us":420982}
I20260709 13:07:18.647985 19450 leader_election.cc:304] T f93ee515a9c14139bf566522ed8232f3 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 24 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e; no voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:07:18.578437 26163 leader_election.cc:290] T 1efebf73c86e432baa55533136b6e12c P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 18 election: Requested vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:07:18.558687 26241 consensus_queue.cc:1048] T 2725d2c4cb054f18b0fc8f735c15f6c2 P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.072s
I20260709 13:07:18.594867 26464 raft_consensus.cc:2749] T 0cdf56e38bbc453d9438d359e5a69955 P e61c3a8f61bb48f8a963c9480e53c168 [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 13:07:18.684728 19553 raft_consensus.cc:2468] T 0e1085d23e8347fbbd5bce7542f4b1f4 P e61c3a8f61bb48f8a963c9480e53c168 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 127766fc592545a4997f7790f50f6076 in term 16.
I20260709 13:07:18.684728 19557 raft_consensus.cc:2410] T 85c494af21f9457a85da47b9bc70c1fd P e61c3a8f61bb48f8a963c9480e53c168 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 127766fc592545a4997f7790f50f6076 for term 20 because replica has last-logged OpId of term: 19 index: 15, which is greater than that of the candidate, which has last-logged OpId of term: 18 index: 14.
I20260709 13:07:18.610518 26470 leader_election.cc:290] T 85c494af21f9457a85da47b9bc70c1fd P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:07:18.668078 19481 raft_consensus.cc:1275] T fa8650e71aa14778b3d73721fc50d9fc P 0473d2b2d01f4459b1e90fd12cc7840e [term 21 FOLLOWER]: Refusing update from remote peer e61c3a8f61bb48f8a963c9480e53c168: Log matching property violated. Preceding OpId in replica: term: 18 index: 10. Preceding OpId from leader: term: 21 index: 12. (index mismatch)
I20260709 13:07:18.591421 26454 raft_consensus.cc:2749] T 0afb57ae58a24a01850491d69f0213dd P 127766fc592545a4997f7790f50f6076 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:07:18.675602 19449 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.1:40321, user_credentials={real_user=slave}} blocked reactor thread for 96718us
I20260709 13:07:18.696724 25376 raft_consensus.cc:2749] T f93ee515a9c14139bf566522ed8232f3 P 0473d2b2d01f4459b1e90fd12cc7840e [term 24 FOLLOWER]: Leader election lost for term 24. Reason: could not achieve majority
I20260709 13:07:18.698460 20103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7be9efa6559648dbb5a0f7684c4542d1" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:07:18.676577 26326 raft_consensus.cc:3055] T 217b5fae677b4971b3bbd2f357a1f7ff P e5256d91808b47c195bc9b4dbd7f2b87 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:07:18.700484 19526 leader_election.cc:304] T 2725d2c4cb054f18b0fc8f735c15f6c2 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e61c3a8f61bb48f8a963c9480e53c168; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:07:18.702257 20110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e1085d23e8347fbbd5bce7542f4b1f4" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076"
I20260709 13:07:18.702996 20110 raft_consensus.cc:3060] T 0e1085d23e8347fbbd5bce7542f4b1f4 P 127766fc592545a4997f7790f50f6076 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:07:18.596773 19560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff75a1d4cb1f493db8f71ddc136ba9ab" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 21 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:07:18.679669 19405 raft_consensus.cc:2468] T 1f85fc4b527a48848e5faa083b604e36 P e5256d91808b47c195bc9b4dbd7f2b87 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 18.
W20260709 13:07:18.709156 26474 log.cc:927] Time spent T 86a6797bdfe94fa496c050ceae4bd0d9 P e61c3a8f61bb48f8a963c9480e53c168: Append to log took a long time: real 0.143s	user 0.000s	sys 0.001s
I20260709 13:07:18.713502 26468 leader_election.cc:290] T 0e1085d23e8347fbbd5bce7542f4b1f4 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:07:18.657262 26430 raft_consensus.cc:515] T 28af091831594f9d8e96482078cc7625 P e5256d91808b47c195bc9b4dbd7f2b87 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:07:18.664361 26331 raft_consensus.cc:515] T ece3db938bc649d4a40a51522ed5259c P 127766fc592545a4997f7790f50f6076 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
W20260709 13:07:18.715452 26473 log.cc:927] Time spent T e381f1d6b8184797ad142de49be225a8 P e61c3a8f61bb48f8a963c9480e53c168: Append to log took a long time: real 0.051s	user 0.001s	sys 0.000s
I20260709 13:07:18.632198 26289 consensus_queue.cc:237] T 40e1e16737a842ee936002830f36882e P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 21.12, Last appended by leader: 12, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:07:18.716765 26430 leader_election.cc:290] T 28af091831594f9d8e96482078cc7625 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:07:18.717036 26429 leader_election.cc:290] T 86a6797bdfe94fa496c050ceae4bd0d9 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:07:18.718004 26441 leader_election.cc:290] T 4509b76741dc428e9201c70c1658da13 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 15 election: Requested vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:07:18.684947 26388 raft_consensus.cc:2804] T ff9b0eddd810459b82d91c60777c10eb P 0473d2b2d01f4459b1e90fd12cc7840e [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:07:18.659549 26428 consensus_queue.cc:1059] T 6c5eebf646ad445a9d1b1adc319d7b16 P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 }, Status: INVALID_TERM, Last received: 18.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.034s
I20260709 13:07:18.662822 25747 raft_consensus.cc:2804] T 4509b76741dc428e9201c70c1658da13 P e61c3a8f61bb48f8a963c9480e53c168 [term 14 FOLLOWER]: Leader pre-election won for term 15
W20260709 13:07:18.692350 19523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.1:40321, user_credentials={real_user=slave}} blocked reactor thread for 138653us
I20260709 13:07:18.665140 26364 raft_consensus.cc:493] T 62c6c134d3d24a1ab144dd9ee6bc3f64 P e61c3a8f61bb48f8a963c9480e53c168 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 127766fc592545a4997f7790f50f6076)
W20260709 13:07:18.694562 19450 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.3:36891, user_credentials={real_user=slave}} blocked reactor thread for 47931.2us
I20260709 13:07:18.724314 19450 leader_election.cc:304] T 3e1f505cb0f1427bbd698ac889d80821 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e; no voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:07:18.635280 26457 raft_consensus.cc:697] T 76cb037fc9064d13b59a8969d897ce8c P e61c3a8f61bb48f8a963c9480e53c168 [term 20 LEADER]: Becoming Leader. State: Replica: e61c3a8f61bb48f8a963c9480e53c168, State: Running, Role: LEADER
I20260709 13:07:18.681540 19477 raft_consensus.cc:1240] T 217b5fae677b4971b3bbd2f357a1f7ff P 0473d2b2d01f4459b1e90fd12cc7840e [term 18 FOLLOWER]: Rejecting Update request from peer e5256d91808b47c195bc9b4dbd7f2b87 for earlier term 17. Current term is 18. Ops: [17.10-17.10]
I20260709 13:07:18.721223 20110 raft_consensus.cc:2468] T 0e1085d23e8347fbbd5bce7542f4b1f4 P 127766fc592545a4997f7790f50f6076 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 18.
W20260709 13:07:18.726246 19374 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.4:43121, user_credentials={real_user=slave}} blocked reactor thread for 116401us
I20260709 13:07:18.732987 19374 leader_election.cc:304] T 309c3ca0ca4b4f3ba129752ea2cb293b P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 127766fc592545a4997f7790f50f6076, e5256d91808b47c195bc9b4dbd7f2b87; no voters: 0473d2b2d01f4459b1e90fd12cc7840e
I20260709 13:07:18.700099 26326 raft_consensus.cc:740] T 217b5fae677b4971b3bbd2f357a1f7ff P e5256d91808b47c195bc9b4dbd7f2b87 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: e5256d91808b47c195bc9b4dbd7f2b87, State: Running, Role: LEADER
I20260709 13:07:18.739831 19526 leader_election.cc:304] T bc225c93219c45538b53a1bd3d387e4d P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168; no voters: e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:07:18.742164 26468 raft_consensus.cc:2749] T 2725d2c4cb054f18b0fc8f735c15f6c2 P e61c3a8f61bb48f8a963c9480e53c168 [term 21 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:07:18.743024 26468 raft_consensus.cc:2804] T bc225c93219c45538b53a1bd3d387e4d P e61c3a8f61bb48f8a963c9480e53c168 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:07:18.743479 26468 raft_consensus.cc:697] T bc225c93219c45538b53a1bd3d387e4d P e61c3a8f61bb48f8a963c9480e53c168 [term 18 LEADER]: Becoming Leader. State: Replica: e61c3a8f61bb48f8a963c9480e53c168, State: Running, Role: LEADER
I20260709 13:07:18.744540 26468 consensus_queue.cc:237] T bc225c93219c45538b53a1bd3d387e4d P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.10, Last appended by leader: 10, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:07:18.746886 26478 consensus_queue.cc:1059] T f93ee515a9c14139bf566522ed8232f3 P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 }, Status: INVALID_TERM, Last received: 23.12, Next index: 13, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:07:18.747978 26478 consensus_queue.cc:1059] T 21e14947d70440f19044d8f75c31e1f9 P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 }, Status: INVALID_TERM, Last received: 20.13, Next index: 14, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:07:18.750118 26464 raft_consensus.cc:3055] T f93ee515a9c14139bf566522ed8232f3 P e61c3a8f61bb48f8a963c9480e53c168 [term 23 LEADER]: Stepping down as leader of term 23
I20260709 13:07:18.750550 26464 raft_consensus.cc:740] T f93ee515a9c14139bf566522ed8232f3 P e61c3a8f61bb48f8a963c9480e53c168 [term 23 LEADER]: Becoming Follower/Learner. State: Replica: e61c3a8f61bb48f8a963c9480e53c168, State: Running, Role: LEADER
I20260709 13:07:18.751619 26464 consensus_queue.cc:260] T f93ee515a9c14139bf566522ed8232f3 P e61c3a8f61bb48f8a963c9480e53c168 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 23.12, Last appended by leader: 12, Current term: 23, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:07:18.753269 26464 raft_consensus.cc:3060] T f93ee515a9c14139bf566522ed8232f3 P e61c3a8f61bb48f8a963c9480e53c168 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:07:18.721167 26388 raft_consensus.cc:493] T ff9b0eddd810459b82d91c60777c10eb P 0473d2b2d01f4459b1e90fd12cc7840e [term 20 FOLLOWER]: Starting leader election (detected failure of leader e5256d91808b47c195bc9b4dbd7f2b87)
W20260709 13:07:18.737884 26467 log.cc:927] Time spent T e381f1d6b8184797ad142de49be225a8 P 0473d2b2d01f4459b1e90fd12cc7840e: Append to log took a long time: real 0.261s	user 0.001s	sys 0.001s
I20260709 13:07:18.759550 19449 leader_election.cc:304] T 0e1085d23e8347fbbd5bce7542f4b1f4 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, 127766fc592545a4997f7790f50f6076; no voters: 
I20260709 13:07:18.725410 25747 raft_consensus.cc:493] T 4509b76741dc428e9201c70c1658da13 P e61c3a8f61bb48f8a963c9480e53c168 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:18.765959 19449 leader_election.cc:304] T 7be9efa6559648dbb5a0f7684c4542d1 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e; no voters: 127766fc592545a4997f7790f50f6076, e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:07:18.761793 19485 raft_consensus.cc:2468] T edd7d470b5014c9489be7f41f64355c9 P 0473d2b2d01f4459b1e90fd12cc7840e [term 26 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 26.
I20260709 13:07:18.761921 19479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7be9efa6559648dbb5a0f7684c4542d1" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:07:18.736406 26275 raft_consensus.cc:2804] T 309c3ca0ca4b4f3ba129752ea2cb293b P e5256d91808b47c195bc9b4dbd7f2b87 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:07:18.789891 19485 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0afb57ae58a24a01850491d69f0213dd"
dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
mode: GRACEFUL
new_leader_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
 from {username='slave'} at 127.0.0.1:48168
I20260709 13:07:18.790513 19485 raft_consensus.cc:606] T 0afb57ae58a24a01850491d69f0213dd P 0473d2b2d01f4459b1e90fd12cc7840e [term 12 LEADER]: Received request to transfer leadership to TS e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:07:18.761225 26388 raft_consensus.cc:3060] T ff9b0eddd810459b82d91c60777c10eb P 0473d2b2d01f4459b1e90fd12cc7840e [term 20 FOLLOWER]: Advancing to term 21
W20260709 13:07:18.792037 19523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.1:40321, user_credentials={real_user=slave}} blocked reactor thread for 69169.2us
I20260709 13:07:18.789104 26316 raft_consensus.cc:2804] T 0e1085d23e8347fbbd5bce7542f4b1f4 P 0473d2b2d01f4459b1e90fd12cc7840e [term 18 FOLLOWER]: Leader election won for term 18
W20260709 13:07:18.792727 19450 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.3:36891, user_credentials={real_user=slave}} blocked reactor thread for 68520.7us
I20260709 13:07:18.823693 19523 leader_election.cc:304] T 7be9efa6559648dbb5a0f7684c4542d1 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: e61c3a8f61bb48f8a963c9480e53c168; no voters: 127766fc592545a4997f7790f50f6076, e5256d91808b47c195bc9b4dbd7f2b87
W20260709 13:07:18.821357 19375 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.3:36891, user_credentials={real_user=slave}} blocked reactor thread for 180813us
I20260709 13:07:18.735227 26364 raft_consensus.cc:515] T 62c6c134d3d24a1ab144dd9ee6bc3f64 P e61c3a8f61bb48f8a963c9480e53c168 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:07:18.789461 25747 raft_consensus.cc:3060] T 4509b76741dc428e9201c70c1658da13 P e61c3a8f61bb48f8a963c9480e53c168 [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:07:18.819099 26480 log.cc:927] Time spent T ed7fdbcb96d14d418db9ca90a792588a P 0473d2b2d01f4459b1e90fd12cc7840e: Append to log took a long time: real 0.058s	user 0.000s	sys 0.000s
I20260709 13:07:18.789146 26275 raft_consensus.cc:493] T 309c3ca0ca4b4f3ba129752ea2cb293b P e5256d91808b47c195bc9b4dbd7f2b87 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 0473d2b2d01f4459b1e90fd12cc7840e)
I20260709 13:07:18.800717 26447 raft_consensus.cc:2749] T 3e1f505cb0f1427bbd698ac889d80821 P 0473d2b2d01f4459b1e90fd12cc7840e [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:07:18.820950 26428 raft_consensus.cc:2749] T 7be9efa6559648dbb5a0f7684c4542d1 P 0473d2b2d01f4459b1e90fd12cc7840e [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
W20260709 13:07:18.843933 19526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.2:46257, user_credentials={real_user=slave}} blocked reactor thread for 102259us
I20260709 13:07:18.798454 19449 leader_election.cc:304] T ff75a1d4cb1f493db8f71ddc136ba9ab P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87; no voters: 
I20260709 13:07:18.826207 19450 leader_election.cc:304] T f1b10566f45d4a7d9029858330e02d5b P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168; no voters: e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:07:18.844827 19375 leader_election.cc:304] T edd7d470b5014c9489be7f41f64355c9 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 26 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:07:18.797978 26479 raft_consensus.cc:3055] T 21e14947d70440f19044d8f75c31e1f9 P e61c3a8f61bb48f8a963c9480e53c168 [term 20 LEADER]: Stepping down as leader of term 20
W20260709 13:07:18.871316 19450 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.3:36891, user_credentials={real_user=slave}} blocked reactor thread for 45176.4us
I20260709 13:07:18.878194 19450 leader_election.cc:304] T 2b74109013a140ada21feeef92d6f563 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e; no voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:07:18.854053 19526 leader_election.cc:304] T 217b5fae677b4971b3bbd2f357a1f7ff P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168; no voters: e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:07:18.838079 26316 raft_consensus.cc:697] T 0e1085d23e8347fbbd5bce7542f4b1f4 P 0473d2b2d01f4459b1e90fd12cc7840e [term 18 LEADER]: Becoming Leader. State: Replica: 0473d2b2d01f4459b1e90fd12cc7840e, State: Running, Role: LEADER
I20260709 13:07:18.845005 26275 raft_consensus.cc:3060] T 309c3ca0ca4b4f3ba129752ea2cb293b P e5256d91808b47c195bc9b4dbd7f2b87 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:07:18.880929 19523 leader_election.cc:304] T 70797e5783b5454ab0d0eea663e791e3 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:07:18.877592 26479 raft_consensus.cc:740] T 21e14947d70440f19044d8f75c31e1f9 P e61c3a8f61bb48f8a963c9480e53c168 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: e61c3a8f61bb48f8a963c9480e53c168, State: Running, Role: LEADER
I20260709 13:07:18.883693 26446 raft_consensus.cc:2804] T edd7d470b5014c9489be7f41f64355c9 P e5256d91808b47c195bc9b4dbd7f2b87 [term 26 FOLLOWER]: Leader election won for term 26
I20260709 13:07:18.899204 26446 raft_consensus.cc:697] T edd7d470b5014c9489be7f41f64355c9 P e5256d91808b47c195bc9b4dbd7f2b87 [term 26 LEADER]: Becoming Leader. State: Replica: e5256d91808b47c195bc9b4dbd7f2b87, State: Running, Role: LEADER
I20260709 13:07:18.900133 26446 consensus_queue.cc:237] T edd7d470b5014c9489be7f41f64355c9 P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 24.13, Last appended by leader: 13, Current term: 26, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:07:18.834038 26326 consensus_queue.cc:260] T 217b5fae677b4971b3bbd2f357a1f7ff P e5256d91808b47c195bc9b4dbd7f2b87 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.10, Last appended by leader: 10, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:07:18.902966 26326 raft_consensus.cc:3060] T 217b5fae677b4971b3bbd2f357a1f7ff P e5256d91808b47c195bc9b4dbd7f2b87 [term 17 FOLLOWER]: Advancing to term 18
W20260709 13:07:18.895625 26476 log.cc:927] Time spent T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P 0473d2b2d01f4459b1e90fd12cc7840e: Append to log took a long time: real 0.190s	user 0.001s	sys 0.000s
I20260709 13:07:18.893692 26321 leader_election.cc:290] T 48824d5acfbc485ebf8c2d944e7202de P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:07:18.893978 26328 leader_election.cc:290] T 7f575b143b844aa096b50997dad3516a P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:07:18.890157 26382 leader_election.cc:290] T 28af091831594f9d8e96482078cc7625 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:07:18.845312 26457 consensus_queue.cc:237] T 76cb037fc9064d13b59a8969d897ce8c P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 18.10, Last appended by leader: 10, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
W20260709 13:07:18.951179 26485 log.cc:927] Time spent T 7f575b143b844aa096b50997dad3516a P e61c3a8f61bb48f8a963c9480e53c168: Append to log took a long time: real 0.064s	user 0.000s	sys 0.000s
I20260709 13:07:18.950951 26316 consensus_queue.cc:237] T 0e1085d23e8347fbbd5bce7542f4b1f4 P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.13, Last appended by leader: 13, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
W20260709 13:07:18.952071 26481 log.cc:927] Time spent T 2e36a9d6e29c4a7c860cf267efbd4c74 P 0473d2b2d01f4459b1e90fd12cc7840e: Append to log took a long time: real 0.111s	user 0.001s	sys 0.000s
I20260709 13:07:18.952137 25747 raft_consensus.cc:515] T 4509b76741dc428e9201c70c1658da13 P e61c3a8f61bb48f8a963c9480e53c168 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:07:18.914486 26262 leader_election.cc:290] T 1f85fc4b527a48848e5faa083b604e36 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:07:18.954329 25747 leader_election.cc:290] T 4509b76741dc428e9201c70c1658da13 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 15 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
W20260709 13:07:18.955503 26489 log.cc:927] Time spent T ab43d85f64114d4ebf618930e43d9ed0 P 127766fc592545a4997f7790f50f6076: Append to log took a long time: real 0.075s	user 0.001s	sys 0.000s
I20260709 13:07:18.955219 26388 raft_consensus.cc:515] T ff9b0eddd810459b82d91c60777c10eb P 0473d2b2d01f4459b1e90fd12cc7840e [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:07:18.957217 26388 leader_election.cc:290] T ff9b0eddd810459b82d91c60777c10eb P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 21 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:07:18.941538 26160 raft_consensus.cc:2749] T 7be9efa6559648dbb5a0f7684c4542d1 P e61c3a8f61bb48f8a963c9480e53c168 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
W20260709 13:07:18.944383 26477 log.cc:927] Time spent T 7f575b143b844aa096b50997dad3516a P e5256d91808b47c195bc9b4dbd7f2b87: Append to log took a long time: real 0.208s	user 0.001s	sys 0.000s
I20260709 13:07:18.957787 26097 raft_consensus.cc:515] T ff9b0eddd810459b82d91c60777c10eb P e5256d91808b47c195bc9b4dbd7f2b87 [term 22 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:07:18.964907 26491 raft_consensus.cc:2804] T 70797e5783b5454ab0d0eea663e791e3 P e61c3a8f61bb48f8a963c9480e53c168 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:07:18.962525 26293 raft_consensus.cc:2804] T 217b5fae677b4971b3bbd2f357a1f7ff P e61c3a8f61bb48f8a963c9480e53c168 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:07:18.964617 26433 ts_tablet_manager.cc:1929] T 309c3ca0ca4b4f3ba129752ea2cb293b P e61c3a8f61bb48f8a963c9480e53c168: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 9.9
I20260709 13:07:18.965799 26479 consensus_queue.cc:260] T 21e14947d70440f19044d8f75c31e1f9 P e61c3a8f61bb48f8a963c9480e53c168 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 20.13, Last appended by leader: 13, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:07:18.983527 26479 raft_consensus.cc:3060] T 21e14947d70440f19044d8f75c31e1f9 P e61c3a8f61bb48f8a963c9480e53c168 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:07:18.979597 26491 raft_consensus.cc:493] T 70797e5783b5454ab0d0eea663e791e3 P e61c3a8f61bb48f8a963c9480e53c168 [term 22 FOLLOWER]: Starting leader election (detected failure of leader e5256d91808b47c195bc9b4dbd7f2b87)
I20260709 13:07:18.984633 26491 raft_consensus.cc:3060] T 70797e5783b5454ab0d0eea663e791e3 P e61c3a8f61bb48f8a963c9480e53c168 [term 22 FOLLOWER]: Advancing to term 23
W20260709 13:07:18.986840 26321 consensus_queue.cc:1175] T 21e14947d70440f19044d8f75c31e1f9 P e61c3a8f61bb48f8a963c9480e53c168 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" responder_term: 20 status { last_received { term: 20 index: 13 } last_committed_idx: 13 last_received_current_leader { term: 20 index: 13 } }
I20260709 13:07:18.981505 26433 log.cc:1199] T 309c3ca0ca4b4f3ba129752ea2cb293b P e61c3a8f61bb48f8a963c9480e53c168: Deleting WAL directory at /tmp/dist-test-taskKd2k48/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602220613947-18300-0/minicluster-data/ts-2-root/wals/309c3ca0ca4b4f3ba129752ea2cb293b
I20260709 13:07:18.991696 26364 leader_election.cc:290] T 62c6c134d3d24a1ab144dd9ee6bc3f64 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:07:18.994493 26433 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49904 (request call id 0) took 1922 ms. Trace:
I20260709 13:07:18.996556 26433 rpcz_store.cc:276] 0709 13:07:17.072308 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:17.072576 (+   268us) service_pool.cc:224] Handling call
0709 13:07:17.914168 (+841592us) ts_tablet_manager.cc:1151] Deleting tablet 309c3ca0ca4b4f3ba129752ea2cb293b
0709 13:07:17.916088 (+  1920us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0709 13:07:18.452225 (+536137us) tablet_metadata.cc:665] Metadata flushed
0709 13:07:18.963053 (+510828us) tablet_metadata.cc:665] Metadata flushed
0709 13:07:18.994413 (+ 31360us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":41026,"tablet-delete.queue_time_us":753034,"thread_start_us":590804,"threads_started":1}
W20260709 13:07:19.034176 19377 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:19.045569 19526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.2:46257, user_credentials={real_user=slave}} blocked reactor thread for 191423us
W20260709 13:07:19.048468 19523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.1:40321, user_credentials={real_user=slave}} blocked reactor thread for 167490us
I20260709 13:07:19.048053 20103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f85fc4b527a48848e5faa083b604e36" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:07:19.057976 26293 raft_consensus.cc:697] T 217b5fae677b4971b3bbd2f357a1f7ff P e61c3a8f61bb48f8a963c9480e53c168 [term 18 LEADER]: Becoming Leader. State: Replica: e61c3a8f61bb48f8a963c9480e53c168, State: Running, Role: LEADER
I20260709 13:07:18.989920 26275 raft_consensus.cc:515] T 309c3ca0ca4b4f3ba129752ea2cb293b P e5256d91808b47c195bc9b4dbd7f2b87 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:07:19.074934 26097 leader_election.cc:290] T ff9b0eddd810459b82d91c60777c10eb P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 22 election: Requested vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:07:19.077459 26491 raft_consensus.cc:515] T 70797e5783b5454ab0d0eea663e791e3 P e61c3a8f61bb48f8a963c9480e53c168 [term 23 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:07:19.092844 20110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff9b0eddd810459b82d91c60777c10eb" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 22 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076"
I20260709 13:07:19.093855 20110 raft_consensus.cc:3060] T ff9b0eddd810459b82d91c60777c10eb P 127766fc592545a4997f7790f50f6076 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:07:19.094445 20076 leader_election.cc:304] T 4af19371ea874c09a0a2147040835cbb P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 127766fc592545a4997f7790f50f6076, e61c3a8f61bb48f8a963c9480e53c168; no voters: e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:07:19.095899 26496 raft_consensus.cc:2804] T 4af19371ea874c09a0a2147040835cbb P 127766fc592545a4997f7790f50f6076 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:07:19.096524 26496 raft_consensus.cc:493] T 4af19371ea874c09a0a2147040835cbb P 127766fc592545a4997f7790f50f6076 [term 12 FOLLOWER]: Starting leader election (detected failure of leader e5256d91808b47c195bc9b4dbd7f2b87)
I20260709 13:07:19.097059 26496 raft_consensus.cc:3060] T 4af19371ea874c09a0a2147040835cbb P 127766fc592545a4997f7790f50f6076 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:07:19.097977 26207 raft_consensus.cc:3055] T 6c5eebf646ad445a9d1b1adc319d7b16 P 0473d2b2d01f4459b1e90fd12cc7840e [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:07:19.099169 26293 consensus_queue.cc:237] T 217b5fae677b4971b3bbd2f357a1f7ff P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 17.10, Last appended by leader: 10, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:07:19.098558 26207 raft_consensus.cc:740] T 6c5eebf646ad445a9d1b1adc319d7b16 P 0473d2b2d01f4459b1e90fd12cc7840e [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 0473d2b2d01f4459b1e90fd12cc7840e, State: Running, Role: LEADER
I20260709 13:07:19.107697 26207 consensus_queue.cc:260] T 6c5eebf646ad445a9d1b1adc319d7b16 P 0473d2b2d01f4459b1e90fd12cc7840e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 18.13, Last appended by leader: 13, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:07:19.111555 19404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85c494af21f9457a85da47b9bc70c1fd" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:07:19.112661 19404 raft_consensus.cc:2468] T 85c494af21f9457a85da47b9bc70c1fd P e5256d91808b47c195bc9b4dbd7f2b87 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 20.
W20260709 13:07:19.114799 26488 log.cc:927] Time spent T 40e1e16737a842ee936002830f36882e P e5256d91808b47c195bc9b4dbd7f2b87: Append to log took a long time: real 0.163s	user 0.002s	sys 0.000s
I20260709 13:07:19.116604 26364 consensus_queue.cc:1048] T fa8650e71aa14778b3d73721fc50d9fc P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:07:19.108608 26491 leader_election.cc:290] T 70797e5783b5454ab0d0eea663e791e3 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 23 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:07:19.125103 26422 raft_consensus.cc:493] T bc225c93219c45538b53a1bd3d387e4d P e5256d91808b47c195bc9b4dbd7f2b87 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 0473d2b2d01f4459b1e90fd12cc7840e)
I20260709 13:07:19.126024 26422 raft_consensus.cc:515] T bc225c93219c45538b53a1bd3d387e4d P e5256d91808b47c195bc9b4dbd7f2b87 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:07:19.127053 26484 raft_consensus.cc:493] T df751f992649444090e27965eb1af85d P e5256d91808b47c195bc9b4dbd7f2b87 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 0473d2b2d01f4459b1e90fd12cc7840e)
I20260709 13:07:19.128047 26484 raft_consensus.cc:515] T df751f992649444090e27965eb1af85d P e5256d91808b47c195bc9b4dbd7f2b87 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:07:19.129016 26422 leader_election.cc:290] T bc225c93219c45538b53a1bd3d387e4d P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:07:19.124570 26207 raft_consensus.cc:3060] T 6c5eebf646ad445a9d1b1adc319d7b16 P 0473d2b2d01f4459b1e90fd12cc7840e [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:07:19.133945 20103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85c494af21f9457a85da47b9bc70c1fd" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:07:19.136010 20110 raft_consensus.cc:2468] T ff9b0eddd810459b82d91c60777c10eb P 127766fc592545a4997f7790f50f6076 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 22.
I20260709 13:07:19.138659 26275 leader_election.cc:290] T 309c3ca0ca4b4f3ba129752ea2cb293b P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 13 election: Requested vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:07:19.149168 19553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28af091831594f9d8e96482078cc7625" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
W20260709 13:07:19.150918 20076 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.3:36891, user_credentials={real_user=slave}} blocked reactor thread for 53929.1us
I20260709 13:07:19.135107 19485 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1efebf73c86e432baa55533136b6e12c"
dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
mode: GRACEFUL
new_leader_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
 from {username='slave'} at 127.0.0.1:48168
I20260709 13:07:19.151590 26331 leader_election.cc:290] T ece3db938bc649d4a40a51522ed5259c P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:07:19.151806 19553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86a6797bdfe94fa496c050ceae4bd0d9" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 18 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:07:19.154487 19553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4509b76741dc428e9201c70c1658da13" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:07:19.155480 19553 raft_consensus.cc:2393] T 4509b76741dc428e9201c70c1658da13 P e61c3a8f61bb48f8a963c9480e53c168 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate e5256d91808b47c195bc9b4dbd7f2b87 in current term 15: Already voted for candidate e61c3a8f61bb48f8a963c9480e53c168 in this term.
I20260709 13:07:19.157051 19404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ece3db938bc649d4a40a51522ed5259c" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:07:19.157649 19403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f575b143b844aa096b50997dad3516a" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:07:19.175175 20103 raft_consensus.cc:2393] T 85c494af21f9457a85da47b9bc70c1fd P 127766fc592545a4997f7790f50f6076 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e61c3a8f61bb48f8a963c9480e53c168 in current term 20: Already voted for candidate 127766fc592545a4997f7790f50f6076 in this term.
I20260709 13:07:19.179742 20106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "309c3ca0ca4b4f3ba129752ea2cb293b" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076"
I20260709 13:07:19.183197 19374 leader_election.cc:304] T ff9b0eddd810459b82d91c60777c10eb P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 127766fc592545a4997f7790f50f6076, e5256d91808b47c195bc9b4dbd7f2b87; no voters: 
I20260709 13:07:19.184224 20106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e1085d23e8347fbbd5bce7542f4b1f4" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:07:19.190289 20110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48824d5acfbc485ebf8c2d944e7202de" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:07:19.190490 20106 raft_consensus.cc:2368] T 0e1085d23e8347fbbd5bce7542f4b1f4 P 127766fc592545a4997f7790f50f6076 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e61c3a8f61bb48f8a963c9480e53c168 for earlier term 17. Current term is 18.
I20260709 13:07:19.191569 26289 raft_consensus.cc:2804] T ff9b0eddd810459b82d91c60777c10eb P e5256d91808b47c195bc9b4dbd7f2b87 [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:07:19.192382 26289 raft_consensus.cc:697] T ff9b0eddd810459b82d91c60777c10eb P e5256d91808b47c195bc9b4dbd7f2b87 [term 22 LEADER]: Becoming Leader. State: Replica: e5256d91808b47c195bc9b4dbd7f2b87, State: Running, Role: LEADER
I20260709 13:07:19.151901 19485 raft_consensus.cc:606] T 1efebf73c86e432baa55533136b6e12c P 0473d2b2d01f4459b1e90fd12cc7840e [term 17 FOLLOWER]: Received request to transfer leadership to TS e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:07:19.195631 19485 raft_consensus.cc:614] T 1efebf73c86e432baa55533136b6e12c P 0473d2b2d01f4459b1e90fd12cc7840e [term 17 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:07:19.208494 19485 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "217b5fae677b4971b3bbd2f357a1f7ff"
dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
mode: GRACEFUL
new_leader_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
 from {username='slave'} at 127.0.0.1:48168
I20260709 13:07:19.194204 26289 consensus_queue.cc:237] T ff9b0eddd810459b82d91c60777c10eb P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 20.14, Last appended by leader: 14, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:07:19.240204 20103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62c6c134d3d24a1ab144dd9ee6bc3f64" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:07:19.213472 19485 raft_consensus.cc:606] T 217b5fae677b4971b3bbd2f357a1f7ff P 0473d2b2d01f4459b1e90fd12cc7840e [term 18 FOLLOWER]: Received request to transfer leadership to TS e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:07:19.242393 19552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ece3db938bc649d4a40a51522ed5259c" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
W20260709 13:07:19.244506 26506 log.cc:927] Time spent T 217b5fae677b4971b3bbd2f357a1f7ff P e61c3a8f61bb48f8a963c9480e53c168: Append to log took a long time: real 0.123s	user 0.001s	sys 0.000s
I20260709 13:07:19.244326 19523 leader_election.cc:304] T 2a16f7501e2444fb86d4e2778e734e02 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e61c3a8f61bb48f8a963c9480e53c168; no voters: 127766fc592545a4997f7790f50f6076, e5256d91808b47c195bc9b4dbd7f2b87
W20260709 13:07:19.248224 19524 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:19.250576 19485 raft_consensus.cc:614] T 217b5fae677b4971b3bbd2f357a1f7ff P 0473d2b2d01f4459b1e90fd12cc7840e [term 18 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:07:19.252569 26491 raft_consensus.cc:2749] T 2a16f7501e2444fb86d4e2778e734e02 P e61c3a8f61bb48f8a963c9480e53c168 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:07:19.260717 19552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc225c93219c45538b53a1bd3d387e4d" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:07:19.264171 19554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1efebf73c86e432baa55533136b6e12c" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:07:19.265913 19411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4509b76741dc428e9201c70c1658da13" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
I20260709 13:07:19.267423 19411 raft_consensus.cc:2393] T 4509b76741dc428e9201c70c1658da13 P e5256d91808b47c195bc9b4dbd7f2b87 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate e61c3a8f61bb48f8a963c9480e53c168 in current term 15: Already voted for candidate e5256d91808b47c195bc9b4dbd7f2b87 in this term.
I20260709 13:07:19.271476 20103 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5ec1c4ce15e04c7e8c283a62179f2a64"
dest_uuid: "127766fc592545a4997f7790f50f6076"
mode: GRACEFUL
new_leader_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
 from {username='slave'} at 127.0.0.1:48686
I20260709 13:07:19.272176 20103 raft_consensus.cc:606] T 5ec1c4ce15e04c7e8c283a62179f2a64 P 127766fc592545a4997f7790f50f6076 [term 14 LEADER]: Received request to transfer leadership to TS 0473d2b2d01f4459b1e90fd12cc7840e
I20260709 13:07:19.284802 19523 leader_election.cc:400] T 1efebf73c86e432baa55533136b6e12c P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 17 election: Vote denied by peer 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121) with higher term. Message: Invalid argument: T 1efebf73c86e432baa55533136b6e12c P 127766fc592545a4997f7790f50f6076 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate e61c3a8f61bb48f8a963c9480e53c168 for earlier term 17. Current term is 18.
I20260709 13:07:19.285164 19523 leader_election.cc:403] T 1efebf73c86e432baa55533136b6e12c P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 17 election: Cancelling election due to peer responding with higher term
I20260709 13:07:19.285789 19485 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "df751f992649444090e27965eb1af85d"
dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
mode: GRACEFUL
new_leader_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
 from {username='slave'} at 127.0.0.1:48168
I20260709 13:07:19.286545 19485 raft_consensus.cc:606] T df751f992649444090e27965eb1af85d P 0473d2b2d01f4459b1e90fd12cc7840e [term 22 LEADER]: Received request to transfer leadership to TS e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:07:19.290820 18300 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:07:19.301625 19554 raft_consensus.cc:3060] T 1efebf73c86e432baa55533136b6e12c P e61c3a8f61bb48f8a963c9480e53c168 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:07:19.304219 26163 raft_consensus.cc:493] T 7be9efa6559648dbb5a0f7684c4542d1 P 127766fc592545a4997f7790f50f6076 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader e5256d91808b47c195bc9b4dbd7f2b87)
I20260709 13:07:19.305001 26163 raft_consensus.cc:515] T 7be9efa6559648dbb5a0f7684c4542d1 P 127766fc592545a4997f7790f50f6076 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } attrs { replace: true } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:07:19.305166 26484 leader_election.cc:290] T df751f992649444090e27965eb1af85d P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
W20260709 13:07:19.307001 26495 log.cc:927] Time spent T 1dc5b3532fe54f74876d02beffa2c230 P 0473d2b2d01f4459b1e90fd12cc7840e: Append to log took a long time: real 0.356s	user 0.003s	sys 0.001s
I20260709 13:07:19.308943 26163 leader_election.cc:290] T 7be9efa6559648dbb5a0f7684c4542d1 P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:07:19.308871 26496 raft_consensus.cc:515] T 4af19371ea874c09a0a2147040835cbb P 127766fc592545a4997f7790f50f6076 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:07:19.312050 19409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7be9efa6559648dbb5a0f7684c4542d1" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:07:19.312170 26432 consensus_queue.cc:260] T 0cdf56e38bbc453d9438d359e5a69955 P 0473d2b2d01f4459b1e90fd12cc7840e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 19.13, Last appended by leader: 13, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:07:19.313486 26432 raft_consensus.cc:3060] T 0cdf56e38bbc453d9438d359e5a69955 P 0473d2b2d01f4459b1e90fd12cc7840e [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:07:19.316859 19523 leader_election.cc:400] T 0e1085d23e8347fbbd5bce7542f4b1f4 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 17 pre-election: Vote denied by peer 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121) with higher term. Message: Invalid argument: T 0e1085d23e8347fbbd5bce7542f4b1f4 P 127766fc592545a4997f7790f50f6076 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e61c3a8f61bb48f8a963c9480e53c168 for earlier term 17. Current term is 18.
I20260709 13:07:19.317363 19523 leader_election.cc:403] T 0e1085d23e8347fbbd5bce7542f4b1f4 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 17 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:07:19.317487 25923 raft_consensus.cc:3060] T b08304a0a02b42d7840c4e8ee9a6bd1a P e5256d91808b47c195bc9b4dbd7f2b87 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:07:19.324745 19553 raft_consensus.cc:1275] T 40e1e16737a842ee936002830f36882e P e61c3a8f61bb48f8a963c9480e53c168 [term 23 FOLLOWER]: Refusing update from remote peer e5256d91808b47c195bc9b4dbd7f2b87: Log matching property violated. Preceding OpId in replica: term: 20 index: 11. Preceding OpId from leader: term: 23 index: 13. (index mismatch)
I20260709 13:07:19.328372 19552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df751f992649444090e27965eb1af85d" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:07:19.334811 26479 raft_consensus.cc:3060] T 0e1085d23e8347fbbd5bce7542f4b1f4 P e61c3a8f61bb48f8a963c9480e53c168 [term 16 FOLLOWER]: Advancing to term 18
I20260709 13:07:19.143537 19294 catalog_manager.cc:5028] TS e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891): tablet 309c3ca0ca4b4f3ba129752ea2cb293b (table test-workload [id=ce1025c73cf04c4baf25820ae7ff0a53]) successfully deleted
W20260709 13:07:19.338068 19294 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.DeleteTablet -> {remote=127.17.223.3:36891, user_credentials={real_user=slave}} blocked reactor thread for 194743us
I20260709 13:07:19.340634 26241 raft_consensus.cc:2804] T f1b10566f45d4a7d9029858330e02d5b P 0473d2b2d01f4459b1e90fd12cc7840e [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:07:19.341166 26241 raft_consensus.cc:493] T f1b10566f45d4a7d9029858330e02d5b P 0473d2b2d01f4459b1e90fd12cc7840e [term 19 FOLLOWER]: Starting leader election (detected failure of leader e5256d91808b47c195bc9b4dbd7f2b87)
W20260709 13:07:19.341372 19450 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.3:36891, user_credentials={real_user=slave}} blocked reactor thread for 463137us
I20260709 13:07:19.341625 26241 raft_consensus.cc:3060] T f1b10566f45d4a7d9029858330e02d5b P 0473d2b2d01f4459b1e90fd12cc7840e [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:07:19.342785 18300 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:07:19.342609 19450 leader_election.cc:304] T 179fd671030940b4b4a4e24bcc4aba0a P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e; no voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:07:19.343824 26204 raft_consensus.cc:2749] T 2b74109013a140ada21feeef92d6f563 P 0473d2b2d01f4459b1e90fd12cc7840e [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:07:19.344415 19450 leader_election.cc:304] T 4509b76741dc428e9201c70c1658da13 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:07:19.344753 26204 raft_consensus.cc:2804] T ff75a1d4cb1f493db8f71ddc136ba9ab P 0473d2b2d01f4459b1e90fd12cc7840e [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:07:19.345362 26204 raft_consensus.cc:697] T ff75a1d4cb1f493db8f71ddc136ba9ab P 0473d2b2d01f4459b1e90fd12cc7840e [term 21 LEADER]: Becoming Leader. State: Replica: 0473d2b2d01f4459b1e90fd12cc7840e, State: Running, Role: LEADER
I20260709 13:07:19.347214 26382 raft_consensus.cc:2749] T 179fd671030940b4b4a4e24bcc4aba0a P 0473d2b2d01f4459b1e90fd12cc7840e [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
W20260709 13:07:19.351698 19449 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.1:40321, user_credentials={real_user=slave}} blocked reactor thread for 553209us
I20260709 13:07:19.347647 26388 raft_consensus.cc:2804] T 4509b76741dc428e9201c70c1658da13 P 0473d2b2d01f4459b1e90fd12cc7840e [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:07:19.355564 26388 raft_consensus.cc:493] T 4509b76741dc428e9201c70c1658da13 P 0473d2b2d01f4459b1e90fd12cc7840e [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:19.355937 26388 raft_consensus.cc:3060] T 4509b76741dc428e9201c70c1658da13 P 0473d2b2d01f4459b1e90fd12cc7840e [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:07:19.360711 20076 leader_election.cc:304] T 0e1085d23e8347fbbd5bce7542f4b1f4 P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 127766fc592545a4997f7790f50f6076, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:07:19.361137 19408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4af19371ea874c09a0a2147040835cbb" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
I20260709 13:07:19.363297 26216 raft_consensus.cc:2764] T 0e1085d23e8347fbbd5bce7542f4b1f4 P 127766fc592545a4997f7790f50f6076 [term 18 FOLLOWER]: Leader pre-election decision vote started in defunct term 17: won
I20260709 13:07:19.364163 20103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70797e5783b5454ab0d0eea663e791e3" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076"
I20260709 13:07:19.364979 20103 raft_consensus.cc:2393] T 70797e5783b5454ab0d0eea663e791e3 P 127766fc592545a4997f7790f50f6076 [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate e61c3a8f61bb48f8a963c9480e53c168 in current term 23: Already voted for candidate 127766fc592545a4997f7790f50f6076 in this term.
I20260709 13:07:19.366547 26496 leader_election.cc:290] T 4af19371ea874c09a0a2147040835cbb P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 13 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:07:19.368211 20076 leader_election.cc:304] T 85c494af21f9457a85da47b9bc70c1fd P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 127766fc592545a4997f7790f50f6076; no voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:07:19.369786 26496 raft_consensus.cc:2749] T 85c494af21f9457a85da47b9bc70c1fd P 127766fc592545a4997f7790f50f6076 [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 13:07:19.346645 26204 consensus_queue.cc:237] T ff75a1d4cb1f493db8f71ddc136ba9ab P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 19.10, Last appended by leader: 10, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:07:19.381114 19449 leader_election.cc:304] T 1f85fc4b527a48848e5faa083b604e36 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87; no voters: 127766fc592545a4997f7790f50f6076
I20260709 13:07:19.382529 25871 raft_consensus.cc:2804] T 1f85fc4b527a48848e5faa083b604e36 P 0473d2b2d01f4459b1e90fd12cc7840e [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:07:19.383457 25871 raft_consensus.cc:493] T 1f85fc4b527a48848e5faa083b604e36 P 0473d2b2d01f4459b1e90fd12cc7840e [term 18 FOLLOWER]: Starting leader election (detected failure of leader 127766fc592545a4997f7790f50f6076)
I20260709 13:07:19.383903 25871 raft_consensus.cc:3060] T 1f85fc4b527a48848e5faa083b604e36 P 0473d2b2d01f4459b1e90fd12cc7840e [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:07:19.385360 26326 raft_consensus.cc:493] T 46c5bfeecc314717bffe987e6844b6d0 P e5256d91808b47c195bc9b4dbd7f2b87 [term 25 FOLLOWER]: Starting pre-election (detected failure of leader e61c3a8f61bb48f8a963c9480e53c168)
I20260709 13:07:19.386090 26326 raft_consensus.cc:515] T 46c5bfeecc314717bffe987e6844b6d0 P e5256d91808b47c195bc9b4dbd7f2b87 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:07:19.388535 26326 leader_election.cc:290] T 46c5bfeecc314717bffe987e6844b6d0 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:07:19.393311 26154 raft_consensus.cc:493] T 1dc5b3532fe54f74876d02beffa2c230 P e5256d91808b47c195bc9b4dbd7f2b87 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader e61c3a8f61bb48f8a963c9480e53c168)
I20260709 13:07:19.394928 26289 raft_consensus.cc:493] T f93ee515a9c14139bf566522ed8232f3 P e5256d91808b47c195bc9b4dbd7f2b87 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader e61c3a8f61bb48f8a963c9480e53c168)
I20260709 13:07:19.395860 26289 raft_consensus.cc:515] T f93ee515a9c14139bf566522ed8232f3 P e5256d91808b47c195bc9b4dbd7f2b87 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:07:19.394078 26154 raft_consensus.cc:515] T 1dc5b3532fe54f74876d02beffa2c230 P e5256d91808b47c195bc9b4dbd7f2b87 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:07:19.400211 25871 raft_consensus.cc:515] T 1f85fc4b527a48848e5faa083b604e36 P 0473d2b2d01f4459b1e90fd12cc7840e [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:07:19.400903 26154 leader_election.cc:290] T 1dc5b3532fe54f74876d02beffa2c230 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:07:19.398605 26289 leader_election.cc:290] T f93ee515a9c14139bf566522ed8232f3 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:07:19.405282 20076 leader_election.cc:304] T ece3db938bc649d4a40a51522ed5259c P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 127766fc592545a4997f7790f50f6076; no voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:07:19.412387 26216 raft_consensus.cc:2749] T ece3db938bc649d4a40a51522ed5259c P 127766fc592545a4997f7790f50f6076 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:07:19.419879 19409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28af091831594f9d8e96482078cc7625" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:07:19.374245 19523 leader_election.cc:304] T 85c494af21f9457a85da47b9bc70c1fd P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168; no voters: 127766fc592545a4997f7790f50f6076
I20260709 13:07:19.436887 19409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff9b0eddd810459b82d91c60777c10eb" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
I20260709 13:07:19.402498 25871 leader_election.cc:290] T 1f85fc4b527a48848e5faa083b604e36 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 19 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:07:19.456586 19485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f575b143b844aa096b50997dad3516a" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:07:19.457343 19478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4509b76741dc428e9201c70c1658da13" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:07:19.457973 26478 raft_consensus.cc:2764] T 85c494af21f9457a85da47b9bc70c1fd P e61c3a8f61bb48f8a963c9480e53c168 [term 20 FOLLOWER]: Leader pre-election decision vote started in defunct term 19: won
I20260709 13:07:19.459319 19557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dc5b3532fe54f74876d02beffa2c230" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 23 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:07:19.449234 26154 consensus_queue.cc:1048] T 40e1e16737a842ee936002830f36882e P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.000s
W20260709 13:07:19.450367 19523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.1:40321, user_credentials={real_user=slave}} blocked reactor thread for 78116.8us
I20260709 13:07:19.455263 19486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e1085d23e8347fbbd5bce7542f4b1f4" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:07:19.455855 26438 raft_consensus.cc:493] T ef32ce6fdd0e40d382c79974f30295c6 P 0473d2b2d01f4459b1e90fd12cc7840e [term 23 FOLLOWER]: Starting pre-election (detected failure of leader e5256d91808b47c195bc9b4dbd7f2b87)
I20260709 13:07:19.456140 19480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48824d5acfbc485ebf8c2d944e7202de" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:07:19.472656 26438 raft_consensus.cc:515] T ef32ce6fdd0e40d382c79974f30295c6 P 0473d2b2d01f4459b1e90fd12cc7840e [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:07:19.475047 26438 leader_election.cc:290] T ef32ce6fdd0e40d382c79974f30295c6 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:07:19.475255 19560 raft_consensus.cc:1275] T 2725d2c4cb054f18b0fc8f735c15f6c2 P e61c3a8f61bb48f8a963c9480e53c168 [term 21 FOLLOWER]: Refusing update from remote peer 0473d2b2d01f4459b1e90fd12cc7840e: Log matching property violated. Preceding OpId in replica: term: 19 index: 10. Preceding OpId from leader: term: 21 index: 11. (index mismatch)
I20260709 13:07:19.476347 19556 raft_consensus.cc:1240] T 0cdf56e38bbc453d9438d359e5a69955 P e61c3a8f61bb48f8a963c9480e53c168 [term 20 FOLLOWER]: Rejecting Update request from peer 0473d2b2d01f4459b1e90fd12cc7840e for earlier term 19. Current term is 20. Ops: []
I20260709 13:07:19.477509 19479 raft_consensus.cc:1240] T ff75a1d4cb1f493db8f71ddc136ba9ab P 0473d2b2d01f4459b1e90fd12cc7840e [term 21 LEADER]: Rejecting Update request from peer e61c3a8f61bb48f8a963c9480e53c168 for earlier term 20. Current term is 21. Ops: []
I20260709 13:07:19.466588 19553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f93ee515a9c14139bf566522ed8232f3" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 24 candidate_status { last_received { term: 23 index: 12 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:07:19.477535 19481 raft_consensus.cc:1240] T 1f85fc4b527a48848e5faa083b604e36 P 0473d2b2d01f4459b1e90fd12cc7840e [term 19 FOLLOWER]: Rejecting Update request from peer 127766fc592545a4997f7790f50f6076 for earlier term 18. Current term is 19. Ops: []
I20260709 13:07:19.445268 26388 raft_consensus.cc:515] T 4509b76741dc428e9201c70c1658da13 P 0473d2b2d01f4459b1e90fd12cc7840e [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:07:19.480656 19485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62c6c134d3d24a1ab144dd9ee6bc3f64" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:07:19.467346 19554 raft_consensus.cc:2468] T 1efebf73c86e432baa55533136b6e12c P e61c3a8f61bb48f8a963c9480e53c168 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 127766fc592545a4997f7790f50f6076 in term 18.
I20260709 13:07:19.482280 19553 raft_consensus.cc:2468] T f93ee515a9c14139bf566522ed8232f3 P e61c3a8f61bb48f8a963c9480e53c168 [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 24.
I20260709 13:07:19.490531 19480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1efebf73c86e432baa55533136b6e12c" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:07:19.493845 19481 raft_consensus.cc:1275] T ab43d85f64114d4ebf618930e43d9ed0 P 0473d2b2d01f4459b1e90fd12cc7840e [term 23 FOLLOWER]: Refusing update from remote peer 127766fc592545a4997f7790f50f6076: Log matching property violated. Preceding OpId in replica: term: 21 index: 14. Preceding OpId from leader: term: 23 index: 15. (index mismatch)
I20260709 13:07:19.436089 26241 raft_consensus.cc:515] T f1b10566f45d4a7d9029858330e02d5b P 0473d2b2d01f4459b1e90fd12cc7840e [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:07:19.497200 19478 raft_consensus.cc:2393] T 4509b76741dc428e9201c70c1658da13 P 0473d2b2d01f4459b1e90fd12cc7840e [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate e61c3a8f61bb48f8a963c9480e53c168 in current term 15: Already voted for candidate 0473d2b2d01f4459b1e90fd12cc7840e in this term.
I20260709 13:07:19.497223 19552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46c5bfeecc314717bffe987e6844b6d0" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 26 candidate_status { last_received { term: 25 index: 13 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:07:19.498468 19551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28af091831594f9d8e96482078cc7625" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:07:19.498625 20103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff9b0eddd810459b82d91c60777c10eb" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076"
I20260709 13:07:19.499439 20103 raft_consensus.cc:2368] T ff9b0eddd810459b82d91c60777c10eb P 127766fc592545a4997f7790f50f6076 [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate 0473d2b2d01f4459b1e90fd12cc7840e for earlier term 21. Current term is 22.
I20260709 13:07:19.500483 19484 raft_consensus.cc:1275] T 22196caba61445d3bec98a0aab3c337d P 0473d2b2d01f4459b1e90fd12cc7840e [term 21 FOLLOWER]: Refusing update from remote peer e61c3a8f61bb48f8a963c9480e53c168: Log matching property violated. Preceding OpId in replica: term: 18 index: 11. Preceding OpId from leader: term: 21 index: 13. (index mismatch)
I20260709 13:07:19.501243 19405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70797e5783b5454ab0d0eea663e791e3" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
I20260709 13:07:19.496860 25851 raft_consensus.cc:2749] T 1efebf73c86e432baa55533136b6e12c P e61c3a8f61bb48f8a963c9480e53c168 [term 18 FOLLOWER]: Leader election lost for term 17. Reason: Vote denied by peer 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121) with higher term. Message: Invalid argument: T 1efebf73c86e432baa55533136b6e12c P 127766fc592545a4997f7790f50f6076 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate e61c3a8f61bb48f8a963c9480e53c168 for earlier term 17. Current term is 18.
I20260709 13:07:19.509984 19480 raft_consensus.cc:3060] T 1efebf73c86e432baa55533136b6e12c P 0473d2b2d01f4459b1e90fd12cc7840e [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:07:19.511081 19486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7be9efa6559648dbb5a0f7684c4542d1" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:07:19.505133 26388 leader_election.cc:290] T 4509b76741dc428e9201c70c1658da13 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 15 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:07:19.529074 19405 raft_consensus.cc:2468] T 70797e5783b5454ab0d0eea663e791e3 P e5256d91808b47c195bc9b4dbd7f2b87 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 23.
I20260709 13:07:19.532860 19449 leader_election.cc:400] T ff9b0eddd810459b82d91c60777c10eb P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 21 election: Vote denied by peer 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121) with higher term. Message: Invalid argument: T ff9b0eddd810459b82d91c60777c10eb P 127766fc592545a4997f7790f50f6076 [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate 0473d2b2d01f4459b1e90fd12cc7840e for earlier term 21. Current term is 22.
I20260709 13:07:19.536504 19449 leader_election.cc:403] T ff9b0eddd810459b82d91c60777c10eb P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 21 election: Cancelling election due to peer responding with higher term
I20260709 13:07:19.539847 25871 raft_consensus.cc:3060] T ff9b0eddd810459b82d91c60777c10eb P 0473d2b2d01f4459b1e90fd12cc7840e [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:07:19.543748 20076 leader_election.cc:304] T 1efebf73c86e432baa55533136b6e12c P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 127766fc592545a4997f7790f50f6076, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:07:19.544239 19559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7be9efa6559648dbb5a0f7684c4542d1" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
W20260709 13:07:19.546144 19377 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.2:46257, user_credentials={real_user=slave}} blocked reactor thread for 91747.9us
I20260709 13:07:19.547189 19554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4af19371ea874c09a0a2147040835cbb" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:07:19.548516 19485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28af091831594f9d8e96482078cc7625" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:07:19.555124 19375 leader_election.cc:304] T f93ee515a9c14139bf566522ed8232f3 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:07:19.555235 26216 raft_consensus.cc:2804] T 1efebf73c86e432baa55533136b6e12c P 127766fc592545a4997f7790f50f6076 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:07:19.550194 19553 raft_consensus.cc:1275] T ab43d85f64114d4ebf618930e43d9ed0 P e61c3a8f61bb48f8a963c9480e53c168 [term 23 FOLLOWER]: Refusing update from remote peer 127766fc592545a4997f7790f50f6076: Log matching property violated. Preceding OpId in replica: term: 21 index: 14. Preceding OpId from leader: term: 23 index: 15. (index mismatch)
I20260709 13:07:19.557225 19478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86a6797bdfe94fa496c050ceae4bd0d9" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 18 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
W20260709 13:07:19.567358 19451 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:19.569217 19375 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.3:36891, user_credentials={real_user=slave}} blocked reactor thread for 49387.9us
I20260709 13:07:19.583731 19404 raft_consensus.cc:3060] T bc225c93219c45538b53a1bd3d387e4d P e5256d91808b47c195bc9b4dbd7f2b87 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:07:19.574441 19481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4509b76741dc428e9201c70c1658da13" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:07:19.586280 19478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f85fc4b527a48848e5faa083b604e36" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:07:19.586436 19409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f85fc4b527a48848e5faa083b604e36" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
I20260709 13:07:19.587144 19481 raft_consensus.cc:2393] T 4509b76741dc428e9201c70c1658da13 P 0473d2b2d01f4459b1e90fd12cc7840e [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate e5256d91808b47c195bc9b4dbd7f2b87 in current term 15: Already voted for candidate 0473d2b2d01f4459b1e90fd12cc7840e in this term.
I20260709 13:07:19.580560 19526 leader_election.cc:304] T 7f575b143b844aa096b50997dad3516a P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e61c3a8f61bb48f8a963c9480e53c168; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:07:19.567502 26216 raft_consensus.cc:697] T 1efebf73c86e432baa55533136b6e12c P 127766fc592545a4997f7790f50f6076 [term 18 LEADER]: Becoming Leader. State: Replica: 127766fc592545a4997f7790f50f6076, State: Running, Role: LEADER
I20260709 13:07:19.600199 19411 raft_consensus.cc:1240] T ff75a1d4cb1f493db8f71ddc136ba9ab P e5256d91808b47c195bc9b4dbd7f2b87 [term 21 FOLLOWER]: Rejecting Update request from peer e61c3a8f61bb48f8a963c9480e53c168 for earlier term 20. Current term is 21. Ops: []
I20260709 13:07:19.602497 20103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f85fc4b527a48848e5faa083b604e36" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076"
I20260709 13:07:19.605669 19403 raft_consensus.cc:1275] T 22196caba61445d3bec98a0aab3c337d P e5256d91808b47c195bc9b4dbd7f2b87 [term 21 FOLLOWER]: Refusing update from remote peer e61c3a8f61bb48f8a963c9480e53c168: Log matching property violated. Preceding OpId in replica: term: 19 index: 12. Preceding OpId from leader: term: 21 index: 13. (index mismatch)
I20260709 13:07:19.611474 19410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4509b76741dc428e9201c70c1658da13" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
I20260709 13:07:19.612051 19409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef32ce6fdd0e40d382c79974f30295c6" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 24 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:07:19.612468 19410 raft_consensus.cc:2393] T 4509b76741dc428e9201c70c1658da13 P e5256d91808b47c195bc9b4dbd7f2b87 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 0473d2b2d01f4459b1e90fd12cc7840e in current term 15: Already voted for candidate e5256d91808b47c195bc9b4dbd7f2b87 in this term.
W20260709 13:07:19.611812 26513 log.cc:927] Time spent T ff75a1d4cb1f493db8f71ddc136ba9ab P 0473d2b2d01f4459b1e90fd12cc7840e: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
I20260709 13:07:19.613323 26448 raft_consensus.cc:2804] T f93ee515a9c14139bf566522ed8232f3 P e5256d91808b47c195bc9b4dbd7f2b87 [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 13:07:19.613821 26448 raft_consensus.cc:493] T f93ee515a9c14139bf566522ed8232f3 P e5256d91808b47c195bc9b4dbd7f2b87 [term 23 FOLLOWER]: Starting leader election (detected failure of leader e61c3a8f61bb48f8a963c9480e53c168)
I20260709 13:07:19.614225 26448 raft_consensus.cc:3060] T f93ee515a9c14139bf566522ed8232f3 P e5256d91808b47c195bc9b4dbd7f2b87 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:07:19.624234 26491 raft_consensus.cc:2749] T 7f575b143b844aa096b50997dad3516a P e61c3a8f61bb48f8a963c9480e53c168 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 13:07:19.624498 19526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.2:46257, user_credentials={real_user=slave}} blocked reactor thread for 44020.9us
I20260709 13:07:19.625278 19526 leader_election.cc:304] T 48824d5acfbc485ebf8c2d944e7202de P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e61c3a8f61bb48f8a963c9480e53c168; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, 127766fc592545a4997f7790f50f6076
I20260709 13:07:19.626144 26491 raft_consensus.cc:2749] T 48824d5acfbc485ebf8c2d944e7202de P e61c3a8f61bb48f8a963c9480e53c168 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:07:19.630995 20076 leader_election.cc:304] T 7be9efa6559648dbb5a0f7684c4542d1 P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 127766fc592545a4997f7790f50f6076; no voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:07:19.631808 26163 raft_consensus.cc:2749] T 7be9efa6559648dbb5a0f7684c4542d1 P 127766fc592545a4997f7790f50f6076 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:07:19.632642 26216 consensus_queue.cc:237] T 1efebf73c86e432baa55533136b6e12c P 127766fc592545a4997f7790f50f6076 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.13, Last appended by leader: 13, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:07:19.670717 19449 leader_election.cc:304] T 1f85fc4b527a48848e5faa083b604e36 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e; no voters: 127766fc592545a4997f7790f50f6076, e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:07:19.676431 19404 raft_consensus.cc:1275] T bc225c93219c45538b53a1bd3d387e4d P e5256d91808b47c195bc9b4dbd7f2b87 [term 18 FOLLOWER]: Refusing update from remote peer e61c3a8f61bb48f8a963c9480e53c168: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
I20260709 13:07:19.677914 20076 leader_election.cc:304] T 4af19371ea874c09a0a2147040835cbb P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 127766fc592545a4997f7790f50f6076; no voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:07:19.683271 19408 raft_consensus.cc:1275] T 217b5fae677b4971b3bbd2f357a1f7ff P e5256d91808b47c195bc9b4dbd7f2b87 [term 18 FOLLOWER]: Refusing update from remote peer e61c3a8f61bb48f8a963c9480e53c168: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
I20260709 13:07:19.690294 19478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "309c3ca0ca4b4f3ba129752ea2cb293b" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
W20260709 13:07:19.695176 19526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.2:46257, user_credentials={real_user=slave}} blocked reactor thread for 46650.7us
I20260709 13:07:19.696219 19403 raft_consensus.cc:1275] T 76cb037fc9064d13b59a8969d897ce8c P e5256d91808b47c195bc9b4dbd7f2b87 [term 20 FOLLOWER]: Refusing update from remote peer e61c3a8f61bb48f8a963c9480e53c168: Log matching property violated. Preceding OpId in replica: term: 18 index: 10. Preceding OpId from leader: term: 20 index: 11. (index mismatch)
I20260709 13:07:19.702807 19526 leader_election.cc:304] T 62c6c134d3d24a1ab144dd9ee6bc3f64 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e61c3a8f61bb48f8a963c9480e53c168; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, 127766fc592545a4997f7790f50f6076
I20260709 13:07:19.706130 19404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1b10566f45d4a7d9029858330e02d5b" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
I20260709 13:07:19.702950 19523 leader_election.cc:304] T 70797e5783b5454ab0d0eea663e791e3 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168; no voters: 127766fc592545a4997f7790f50f6076
I20260709 13:07:19.714289 19481 raft_consensus.cc:1275] T 76cb037fc9064d13b59a8969d897ce8c P 0473d2b2d01f4459b1e90fd12cc7840e [term 20 FOLLOWER]: Refusing update from remote peer e61c3a8f61bb48f8a963c9480e53c168: Log matching property violated. Preceding OpId in replica: term: 18 index: 10. Preceding OpId from leader: term: 20 index: 11. (index mismatch)
I20260709 13:07:19.715870 19480 raft_consensus.cc:2468] T 1efebf73c86e432baa55533136b6e12c P 0473d2b2d01f4459b1e90fd12cc7840e [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 127766fc592545a4997f7790f50f6076 in term 18.
I20260709 13:07:19.717257 19478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff9b0eddd810459b82d91c60777c10eb" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 22 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:07:19.685535 25851 raft_consensus.cc:493] T e381f1d6b8184797ad142de49be225a8 P e61c3a8f61bb48f8a963c9480e53c168 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 0473d2b2d01f4459b1e90fd12cc7840e)
I20260709 13:07:19.724435 25851 raft_consensus.cc:515] T e381f1d6b8184797ad142de49be225a8 P e61c3a8f61bb48f8a963c9480e53c168 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:07:19.731447 19477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df751f992649444090e27965eb1af85d" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:07:19.731799 25851 leader_election.cc:290] T e381f1d6b8184797ad142de49be225a8 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:07:19.732955 19484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc225c93219c45538b53a1bd3d387e4d" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:07:19.733960 19484 raft_consensus.cc:2393] T bc225c93219c45538b53a1bd3d387e4d P 0473d2b2d01f4459b1e90fd12cc7840e [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e5256d91808b47c195bc9b4dbd7f2b87 in current term 18: Already voted for candidate e61c3a8f61bb48f8a963c9480e53c168 in this term.
W20260709 13:07:19.747319 19526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.2:46257, user_credentials={real_user=slave}} blocked reactor thread for 51439.2us
I20260709 13:07:19.767058 19480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f93ee515a9c14139bf566522ed8232f3" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 24 candidate_status { last_received { term: 23 index: 12 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:07:19.783239 19481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46c5bfeecc314717bffe987e6844b6d0" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 26 candidate_status { last_received { term: 25 index: 13 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:07:19.760074 26241 leader_election.cc:290] T f1b10566f45d4a7d9029858330e02d5b P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 20 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:07:19.789896 19484 raft_consensus.cc:1275] T 40e1e16737a842ee936002830f36882e P 0473d2b2d01f4459b1e90fd12cc7840e [term 23 FOLLOWER]: Refusing update from remote peer e5256d91808b47c195bc9b4dbd7f2b87: Log matching property violated. Preceding OpId in replica: term: 20 index: 11. Preceding OpId from leader: term: 23 index: 13. (index mismatch)
I20260709 13:07:19.797883 26416 consensus_queue.cc:1048] T ab43d85f64114d4ebf618930e43d9ed0 P 127766fc592545a4997f7790f50f6076 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.113s
I20260709 13:07:19.804975 20103 raft_consensus.cc:1275] T ff9b0eddd810459b82d91c60777c10eb P 127766fc592545a4997f7790f50f6076 [term 22 FOLLOWER]: Refusing update from remote peer e5256d91808b47c195bc9b4dbd7f2b87: Log matching property violated. Preceding OpId in replica: term: 20 index: 14. Preceding OpId from leader: term: 22 index: 15. (index mismatch)
I20260709 13:07:19.805644 26316 raft_consensus.cc:493] T 22196caba61445d3bec98a0aab3c337d P 0473d2b2d01f4459b1e90fd12cc7840e [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:19.806174 19553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4509b76741dc428e9201c70c1658da13" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:07:19.799126 19479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dc5b3532fe54f74876d02beffa2c230" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 23 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:07:19.786748 26479 raft_consensus.cc:2749] T 0e1085d23e8347fbbd5bce7542f4b1f4 P e61c3a8f61bb48f8a963c9480e53c168 [term 18 FOLLOWER]: Leader pre-election lost for term 17. Reason: Vote denied by peer 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121) with higher term. Message: Invalid argument: T 0e1085d23e8347fbbd5bce7542f4b1f4 P 127766fc592545a4997f7790f50f6076 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e61c3a8f61bb48f8a963c9480e53c168 for earlier term 17. Current term is 18.
I20260709 13:07:19.818506 19480 raft_consensus.cc:2393] T f93ee515a9c14139bf566522ed8232f3 P 0473d2b2d01f4459b1e90fd12cc7840e [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e5256d91808b47c195bc9b4dbd7f2b87 in current term 24: Already voted for candidate 0473d2b2d01f4459b1e90fd12cc7840e in this term.
I20260709 13:07:19.815508 26428 raft_consensus.cc:2749] T 1f85fc4b527a48848e5faa083b604e36 P 0473d2b2d01f4459b1e90fd12cc7840e [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:07:19.837467 19481 raft_consensus.cc:1275] T edd7d470b5014c9489be7f41f64355c9 P 0473d2b2d01f4459b1e90fd12cc7840e [term 26 FOLLOWER]: Refusing update from remote peer e5256d91808b47c195bc9b4dbd7f2b87: Log matching property violated. Preceding OpId in replica: term: 24 index: 13. Preceding OpId from leader: term: 26 index: 14. (index mismatch)
I20260709 13:07:19.841151 19558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1b10566f45d4a7d9029858330e02d5b" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:07:19.841722 26204 raft_consensus.cc:993] T 0afb57ae58a24a01850491d69f0213dd P 0473d2b2d01f4459b1e90fd12cc7840e: : Instructing follower e61c3a8f61bb48f8a963c9480e53c168 to start an election
I20260709 13:07:19.842002 26438 raft_consensus.cc:993] T df751f992649444090e27965eb1af85d P 0473d2b2d01f4459b1e90fd12cc7840e: : Instructing follower e61c3a8f61bb48f8a963c9480e53c168 to start an election
I20260709 13:07:19.842208 26204 raft_consensus.cc:1081] T 0afb57ae58a24a01850491d69f0213dd P 0473d2b2d01f4459b1e90fd12cc7840e [term 12 LEADER]: Signalling peer e61c3a8f61bb48f8a963c9480e53c168 to start an election
I20260709 13:07:19.842505 26438 raft_consensus.cc:1081] T df751f992649444090e27965eb1af85d P 0473d2b2d01f4459b1e90fd12cc7840e [term 22 LEADER]: Signalling peer e61c3a8f61bb48f8a963c9480e53c168 to start an election
I20260709 13:07:19.843235 26204 consensus_queue.cc:1048] T 2725d2c4cb054f18b0fc8f735c15f6c2 P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:07:19.843801 26528 consensus_queue.cc:1059] T 1f85fc4b527a48848e5faa083b604e36 P 127766fc592545a4997f7790f50f6076 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 }, Status: INVALID_TERM, Last received: 18.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 13:07:19.844221 19450 leader_election.cc:304] T 28af091831594f9d8e96482078cc7625 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e; no voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168
W20260709 13:07:19.846434 26524 log.cc:927] Time spent T 2725d2c4cb054f18b0fc8f735c15f6c2 P 0473d2b2d01f4459b1e90fd12cc7840e: Append to log took a long time: real 0.054s	user 0.000s	sys 0.001s
I20260709 13:07:19.847631 26457 consensus_queue.cc:1048] T 22196caba61445d3bec98a0aab3c337d P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.051s
I20260709 13:07:19.811479 26324 raft_consensus.cc:2749] T 62c6c134d3d24a1ab144dd9ee6bc3f64 P e61c3a8f61bb48f8a963c9480e53c168 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:07:19.848448 26321 raft_consensus.cc:2804] T 70797e5783b5454ab0d0eea663e791e3 P e61c3a8f61bb48f8a963c9480e53c168 [term 23 FOLLOWER]: Leader election won for term 23
I20260709 13:07:19.849123 26321 raft_consensus.cc:697] T 70797e5783b5454ab0d0eea663e791e3 P e61c3a8f61bb48f8a963c9480e53c168 [term 23 LEADER]: Becoming Leader. State: Replica: e61c3a8f61bb48f8a963c9480e53c168, State: Running, Role: LEADER
I20260709 13:07:19.831341 25923 consensus_queue.cc:1048] T ff9b0eddd810459b82d91c60777c10eb P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Connected to new peer: Peer: permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.022s
I20260709 13:07:19.811889 26295 raft_consensus.cc:2749] T 4af19371ea874c09a0a2147040835cbb P 127766fc592545a4997f7790f50f6076 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:07:19.851161 26295 raft_consensus.cc:3055] T 1f85fc4b527a48848e5faa083b604e36 P 127766fc592545a4997f7790f50f6076 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:07:19.851511 26295 raft_consensus.cc:740] T 1f85fc4b527a48848e5faa083b604e36 P 127766fc592545a4997f7790f50f6076 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 127766fc592545a4997f7790f50f6076, State: Running, Role: LEADER
I20260709 13:07:19.852474 26295 consensus_queue.cc:260] T 1f85fc4b527a48848e5faa083b604e36 P 127766fc592545a4997f7790f50f6076 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 18.14, Last appended by leader: 14, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:07:19.811502 19553 raft_consensus.cc:2393] T 4509b76741dc428e9201c70c1658da13 P e61c3a8f61bb48f8a963c9480e53c168 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 0473d2b2d01f4459b1e90fd12cc7840e in current term 15: Already voted for candidate e61c3a8f61bb48f8a963c9480e53c168 in this term.
I20260709 13:07:19.847841 26431 raft_consensus.cc:2749] T 28af091831594f9d8e96482078cc7625 P 0473d2b2d01f4459b1e90fd12cc7840e [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:07:19.811826 19551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef32ce6fdd0e40d382c79974f30295c6" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 24 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
W20260709 13:07:19.808513 19523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.1:40321, user_credentials={real_user=slave}} blocked reactor thread for 105618us
I20260709 13:07:19.853997 19558 raft_consensus.cc:1275] T 0e1085d23e8347fbbd5bce7542f4b1f4 P e61c3a8f61bb48f8a963c9480e53c168 [term 18 FOLLOWER]: Refusing update from remote peer 0473d2b2d01f4459b1e90fd12cc7840e: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
I20260709 13:07:19.858819 20106 raft_consensus.cc:1240] T 4af19371ea874c09a0a2147040835cbb P 127766fc592545a4997f7790f50f6076 [term 13 FOLLOWER]: Rejecting Update request from peer e5256d91808b47c195bc9b4dbd7f2b87 for earlier term 12. Current term is 13. Ops: []
I20260709 13:07:19.824783 25871 raft_consensus.cc:2749] T ff9b0eddd810459b82d91c60777c10eb P 0473d2b2d01f4459b1e90fd12cc7840e [term 22 FOLLOWER]: Leader election lost for term 21. Reason: Vote denied by peer 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121) with higher term. Message: Invalid argument: T ff9b0eddd810459b82d91c60777c10eb P 127766fc592545a4997f7790f50f6076 [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate 0473d2b2d01f4459b1e90fd12cc7840e for earlier term 21. Current term is 22.
I20260709 13:07:19.854007 26295 raft_consensus.cc:3060] T 1f85fc4b527a48848e5faa083b604e36 P 127766fc592545a4997f7790f50f6076 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:07:19.891641 19405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e381f1d6b8184797ad142de49be225a8" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:07:19.824889 26316 raft_consensus.cc:515] T 22196caba61445d3bec98a0aab3c337d P 0473d2b2d01f4459b1e90fd12cc7840e [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:07:19.908130 19450 leader_election.cc:304] T 4509b76741dc428e9201c70c1658da13 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e; no voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:07:19.850356 26321 consensus_queue.cc:237] T 70797e5783b5454ab0d0eea663e791e3 P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 22.15, Last appended by leader: 15, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
W20260709 13:07:19.909166 19526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.2:46257, user_credentials={real_user=slave}} blocked reactor thread for 159091us
I20260709 13:07:19.884418 26479 consensus_queue.cc:1059] T ff75a1d4cb1f493db8f71ddc136ba9ab P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.027s
I20260709 13:07:19.883736 26324 consensus_queue.cc:1048] T 217b5fae677b4971b3bbd2f357a1f7ff P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.031s
I20260709 13:07:19.916734 19450 leader_election.cc:304] T ef32ce6fdd0e40d382c79974f30295c6 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e; no voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:07:19.888417 19553 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "0afb57ae58a24a01850491d69f0213dd"
dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
 from {username='slave'} at 127.0.0.1:40428
I20260709 13:07:19.898942 19554 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "df751f992649444090e27965eb1af85d"
dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
 from {username='slave'} at 127.0.0.1:40428
I20260709 13:07:19.934859 19553 raft_consensus.cc:493] T 0afb57ae58a24a01850491d69f0213dd P e61c3a8f61bb48f8a963c9480e53c168 [term 12 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:07:19.884145 25851 consensus_queue.cc:1048] T 22196caba61445d3bec98a0aab3c337d P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.026s
I20260709 13:07:19.935474 19553 raft_consensus.cc:3060] T 0afb57ae58a24a01850491d69f0213dd P e61c3a8f61bb48f8a963c9480e53c168 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:07:19.906875 26447 raft_consensus.cc:493] T 40e1e16737a842ee936002830f36882e P 0473d2b2d01f4459b1e90fd12cc7840e [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:19.934993 19554 raft_consensus.cc:493] T df751f992649444090e27965eb1af85d P e61c3a8f61bb48f8a963c9480e53c168 [term 22 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:07:19.936230 19554 raft_consensus.cc:3060] T df751f992649444090e27965eb1af85d P e61c3a8f61bb48f8a963c9480e53c168 [term 22 FOLLOWER]: Advancing to term 23
W20260709 13:07:19.915345 20076 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.3:36891, user_credentials={real_user=slave}} blocked reactor thread for 237503us
I20260709 13:07:19.954715 26447 raft_consensus.cc:515] T 40e1e16737a842ee936002830f36882e P 0473d2b2d01f4459b1e90fd12cc7840e [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
W20260709 13:07:19.950870 26516 log.cc:927] Time spent T fa8650e71aa14778b3d73721fc50d9fc P 0473d2b2d01f4459b1e90fd12cc7840e: Append to log took a long time: real 0.108s	user 0.001s	sys 0.000s
I20260709 13:07:19.936278 26216 consensus_queue.cc:1048] T ab43d85f64114d4ebf618930e43d9ed0 P 127766fc592545a4997f7790f50f6076 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.027s
I20260709 13:07:19.909619 26410 raft_consensus.cc:493] T 309c3ca0ca4b4f3ba129752ea2cb293b P 127766fc592545a4997f7790f50f6076 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 0473d2b2d01f4459b1e90fd12cc7840e)
W20260709 13:07:19.977243 20078 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.2:46257, user_credentials={real_user=slave}} blocked reactor thread for 85794.9us
I20260709 13:07:19.885659 26448 raft_consensus.cc:515] T f93ee515a9c14139bf566522ed8232f3 P e5256d91808b47c195bc9b4dbd7f2b87 [term 24 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:07:19.968371 19526 leader_election.cc:304] T 4509b76741dc428e9201c70c1658da13 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e61c3a8f61bb48f8a963c9480e53c168; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:07:19.910261 26478 consensus_queue.cc:1048] T bc225c93219c45538b53a1bd3d387e4d P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.036s
I20260709 13:07:19.945056 26207 raft_consensus.cc:493] T 21e14947d70440f19044d8f75c31e1f9 P 0473d2b2d01f4459b1e90fd12cc7840e [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:20.005201 26207 raft_consensus.cc:515] T 21e14947d70440f19044d8f75c31e1f9 P 0473d2b2d01f4459b1e90fd12cc7840e [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:07:20.005658 26448 leader_election.cc:290] T f93ee515a9c14139bf566522ed8232f3 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 24 election: Requested vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:07:19.945564 26241 raft_consensus.cc:2749] T ef32ce6fdd0e40d382c79974f30295c6 P 0473d2b2d01f4459b1e90fd12cc7840e [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:07:19.991820 19377 leader_election.cc:304] T 28af091831594f9d8e96482078cc7625 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:07:20.020529 19553 raft_consensus.cc:515] T 0afb57ae58a24a01850491d69f0213dd P e61c3a8f61bb48f8a963c9480e53c168 [term 13 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
W20260709 13:07:20.106024 20076 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.3:36891, user_credentials={real_user=slave}} blocked reactor thread for 82009.6us
W20260709 13:07:20.104086 19526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.2:46257, user_credentials={real_user=slave}} blocked reactor thread for 135934us
I20260709 13:07:20.116551 19481 raft_consensus.cc:1275] T bc225c93219c45538b53a1bd3d387e4d P 0473d2b2d01f4459b1e90fd12cc7840e [term 18 FOLLOWER]: Refusing update from remote peer e61c3a8f61bb48f8a963c9480e53c168: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
I20260709 13:07:20.120658 26316 leader_election.cc:290] T 22196caba61445d3bec98a0aab3c337d P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:07:20.121299 26534 consensus_queue.cc:1059] T ff75a1d4cb1f493db8f71ddc136ba9ab P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.094s
I20260709 13:07:20.121625 26379 raft_consensus.cc:493] T 1dc5b3532fe54f74876d02beffa2c230 P 0473d2b2d01f4459b1e90fd12cc7840e [term 22 FOLLOWER]: Starting pre-election (detected failure of leader e61c3a8f61bb48f8a963c9480e53c168)
W20260709 13:07:20.120893 26510 log.cc:927] Time spent T edd7d470b5014c9489be7f41f64355c9 P e5256d91808b47c195bc9b4dbd7f2b87: Append to log took a long time: real 0.154s	user 0.002s	sys 0.002s
I20260709 13:07:20.120604 19486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0afb57ae58a24a01850491d69f0213dd" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: true dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:07:20.129395 19486 raft_consensus.cc:3055] T 0afb57ae58a24a01850491d69f0213dd P 0473d2b2d01f4459b1e90fd12cc7840e [term 12 LEADER]: Stepping down as leader of term 12
W20260709 13:07:20.120723 20075 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.1:40321, user_credentials={real_user=slave}} blocked reactor thread for 115452us
I20260709 13:07:20.120558 26531 raft_consensus.cc:2749] T 28af091831594f9d8e96482078cc7625 P e5256d91808b47c195bc9b4dbd7f2b87 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:07:20.139271 19480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e381f1d6b8184797ad142de49be225a8" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:07:20.129756 19486 raft_consensus.cc:740] T 0afb57ae58a24a01850491d69f0213dd P 0473d2b2d01f4459b1e90fd12cc7840e [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 0473d2b2d01f4459b1e90fd12cc7840e, State: Running, Role: LEADER
I20260709 13:07:20.020154 26410 raft_consensus.cc:515] T 309c3ca0ca4b4f3ba129752ea2cb293b P 127766fc592545a4997f7790f50f6076 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
W20260709 13:07:20.143591 19377 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.2:46257, user_credentials={real_user=slave}} blocked reactor thread for 163744us
I20260709 13:07:20.109376 26512 raft_consensus.cc:2749] T 4509b76741dc428e9201c70c1658da13 P 0473d2b2d01f4459b1e90fd12cc7840e [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:07:20.145965 19479 raft_consensus.cc:1275] T 217b5fae677b4971b3bbd2f357a1f7ff P 0473d2b2d01f4459b1e90fd12cc7840e [term 18 FOLLOWER]: Refusing update from remote peer e61c3a8f61bb48f8a963c9480e53c168: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
I20260709 13:07:20.135100 19554 raft_consensus.cc:515] T df751f992649444090e27965eb1af85d P e61c3a8f61bb48f8a963c9480e53c168 [term 23 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:07:20.153539 26207 leader_election.cc:290] T 21e14947d70440f19044d8f75c31e1f9 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:07:20.116463 25923 raft_consensus.cc:493] T 0cdf56e38bbc453d9438d359e5a69955 P e5256d91808b47c195bc9b4dbd7f2b87 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 0473d2b2d01f4459b1e90fd12cc7840e)
I20260709 13:07:20.126245 26379 raft_consensus.cc:515] T 1dc5b3532fe54f74876d02beffa2c230 P 0473d2b2d01f4459b1e90fd12cc7840e [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:07:20.148954 19486 consensus_queue.cc:260] T 0afb57ae58a24a01850491d69f0213dd P 0473d2b2d01f4459b1e90fd12cc7840e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:07:20.124642 26382 raft_consensus.cc:493] T b08304a0a02b42d7840c4e8ee9a6bd1a P 0473d2b2d01f4459b1e90fd12cc7840e [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:20.163223 19486 raft_consensus.cc:3060] T 0afb57ae58a24a01850491d69f0213dd P 0473d2b2d01f4459b1e90fd12cc7840e [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:07:20.165201 26470 raft_consensus.cc:2749] T 4509b76741dc428e9201c70c1658da13 P e61c3a8f61bb48f8a963c9480e53c168 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:07:20.167811 26447 leader_election.cc:290] T 40e1e16737a842ee936002830f36882e P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:07:20.176321 19554 leader_election.cc:290] T df751f992649444090e27965eb1af85d P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 23 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:07:20.177944 19377 leader_election.cc:304] T 86a6797bdfe94fa496c050ceae4bd0d9 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:07:20.123798 26511 consensus_queue.cc:1048] T 0e1085d23e8347fbbd5bce7542f4b1f4 P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.221s
I20260709 13:07:20.184049 19486 raft_consensus.cc:2468] T 0afb57ae58a24a01850491d69f0213dd P 0473d2b2d01f4459b1e90fd12cc7840e [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 13.
I20260709 13:07:20.190153 19552 raft_consensus.cc:1240] T 0afb57ae58a24a01850491d69f0213dd P e61c3a8f61bb48f8a963c9480e53c168 [term 13 FOLLOWER]: Rejecting Update request from peer 0473d2b2d01f4459b1e90fd12cc7840e for earlier term 12. Current term is 13. Ops: []
I20260709 13:07:20.193156 19560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22196caba61445d3bec98a0aab3c337d" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 22 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:07:20.195642 26321 raft_consensus.cc:493] T b08304a0a02b42d7840c4e8ee9a6bd1a P e61c3a8f61bb48f8a963c9480e53c168 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader e5256d91808b47c195bc9b4dbd7f2b87)
W20260709 13:07:20.196435 26550 log.cc:927] Time spent T 2725d2c4cb054f18b0fc8f735c15f6c2 P e61c3a8f61bb48f8a963c9480e53c168: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
I20260709 13:07:20.196368 26321 raft_consensus.cc:515] T b08304a0a02b42d7840c4e8ee9a6bd1a P e61c3a8f61bb48f8a963c9480e53c168 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:07:20.198137 26416 raft_consensus.cc:493] T 70797e5783b5454ab0d0eea663e791e3 P 127766fc592545a4997f7790f50f6076 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:20.198834 26321 leader_election.cc:290] T b08304a0a02b42d7840c4e8ee9a6bd1a P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
W20260709 13:07:20.201473 26539 log.cc:927] Time spent T fa8650e71aa14778b3d73721fc50d9fc P e61c3a8f61bb48f8a963c9480e53c168: Append to log took a long time: real 0.086s	user 0.000s	sys 0.000s
I20260709 13:07:20.201682 26163 raft_consensus.cc:993] T 5ec1c4ce15e04c7e8c283a62179f2a64 P 127766fc592545a4997f7790f50f6076: : Instructing follower 0473d2b2d01f4459b1e90fd12cc7840e to start an election
I20260709 13:07:20.202153 26163 raft_consensus.cc:1081] T 5ec1c4ce15e04c7e8c283a62179f2a64 P 127766fc592545a4997f7790f50f6076 [term 14 LEADER]: Signalling peer 0473d2b2d01f4459b1e90fd12cc7840e to start an election
I20260709 13:07:20.123631 26532 consensus_queue.cc:1048] T 76cb037fc9064d13b59a8969d897ce8c P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.233s
I20260709 13:07:20.214190 19486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b08304a0a02b42d7840c4e8ee9a6bd1a" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:07:20.215301 19558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21e14947d70440f19044d8f75c31e1f9" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 22 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:07:20.202567 26416 raft_consensus.cc:515] T 70797e5783b5454ab0d0eea663e791e3 P 127766fc592545a4997f7790f50f6076 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:07:20.215955 19558 raft_consensus.cc:2468] T 21e14947d70440f19044d8f75c31e1f9 P e61c3a8f61bb48f8a963c9480e53c168 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 21.
I20260709 13:07:20.217100 26448 raft_consensus.cc:493] T b08304a0a02b42d7840c4e8ee9a6bd1a P e5256d91808b47c195bc9b4dbd7f2b87 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:20.217581 26448 raft_consensus.cc:515] T b08304a0a02b42d7840c4e8ee9a6bd1a P e5256d91808b47c195bc9b4dbd7f2b87 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:07:20.219545 26448 leader_election.cc:290] T b08304a0a02b42d7840c4e8ee9a6bd1a P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:07:20.222654 26275 raft_consensus.cc:493] T 21e14947d70440f19044d8f75c31e1f9 P e5256d91808b47c195bc9b4dbd7f2b87 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader e61c3a8f61bb48f8a963c9480e53c168)
I20260709 13:07:20.222977 26295 raft_consensus.cc:493] T 14935b3ddf914369822e4a0547aaa355 P 127766fc592545a4997f7790f50f6076 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 0473d2b2d01f4459b1e90fd12cc7840e)
I20260709 13:07:20.222841 26382 raft_consensus.cc:515] T b08304a0a02b42d7840c4e8ee9a6bd1a P 0473d2b2d01f4459b1e90fd12cc7840e [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:07:20.223325 26275 raft_consensus.cc:515] T 21e14947d70440f19044d8f75c31e1f9 P e5256d91808b47c195bc9b4dbd7f2b87 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:07:20.223572 26295 raft_consensus.cc:515] T 14935b3ddf914369822e4a0547aaa355 P 127766fc592545a4997f7790f50f6076 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:07:20.225122 26382 leader_election.cc:290] T b08304a0a02b42d7840c4e8ee9a6bd1a P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:07:20.225370 26275 leader_election.cc:290] T 21e14947d70440f19044d8f75c31e1f9 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:07:20.222482 26416 leader_election.cc:290] T 70797e5783b5454ab0d0eea663e791e3 P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
W20260709 13:07:20.226135 19377 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.2:46257, user_credentials={real_user=slave}} blocked reactor thread for 57412us
I20260709 13:07:20.226466 19407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22196caba61445d3bec98a0aab3c337d" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 22 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:07:20.227103 19486 raft_consensus.cc:2393] T b08304a0a02b42d7840c4e8ee9a6bd1a P 0473d2b2d01f4459b1e90fd12cc7840e [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e61c3a8f61bb48f8a963c9480e53c168 in current term 22: Already voted for candidate 0473d2b2d01f4459b1e90fd12cc7840e in this term.
I20260709 13:07:20.228271 19411 raft_consensus.cc:1275] T ff75a1d4cb1f493db8f71ddc136ba9ab P e5256d91808b47c195bc9b4dbd7f2b87 [term 21 FOLLOWER]: Refusing update from remote peer 0473d2b2d01f4459b1e90fd12cc7840e: Log matching property violated. Preceding OpId in replica: term: 19 index: 10. Preceding OpId from leader: term: 21 index: 11. (index mismatch)
I20260709 13:07:20.229584 19411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21e14947d70440f19044d8f75c31e1f9" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 22 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:07:20.230156 19411 raft_consensus.cc:2468] T 21e14947d70440f19044d8f75c31e1f9 P e5256d91808b47c195bc9b4dbd7f2b87 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 20.
I20260709 13:07:20.233983 19449 leader_election.cc:304] T f1b10566f45d4a7d9029858330e02d5b P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e; no voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:07:20.235764 19554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40e1e16737a842ee936002830f36882e" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 24 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:07:20.189790 26531 raft_consensus.cc:2749] T 86a6797bdfe94fa496c050ceae4bd0d9 P e5256d91808b47c195bc9b4dbd7f2b87 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:07:20.191288 26512 raft_consensus.cc:493] T 7f575b143b844aa096b50997dad3516a P 0473d2b2d01f4459b1e90fd12cc7840e [term 18 FOLLOWER]: Starting pre-election (detected failure of leader e5256d91808b47c195bc9b4dbd7f2b87)
I20260709 13:07:20.175231 25923 raft_consensus.cc:515] T 0cdf56e38bbc453d9438d359e5a69955 P e5256d91808b47c195bc9b4dbd7f2b87 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:07:20.195572 26534 consensus_queue.cc:1243] T ff75a1d4cb1f493db8f71ddc136ba9ab P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Peer 0473d2b2d01f4459b1e90fd12cc7840e log is divergent from this leader: its last log entry 21.11 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 10
I20260709 13:07:20.243028 19411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40e1e16737a842ee936002830f36882e" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 24 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:07:20.236759 19526 leader_election.cc:304] T 0afb57ae58a24a01850491d69f0213dd P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:07:20.244053 19407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b08304a0a02b42d7840c4e8ee9a6bd1a" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 23 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:07:20.241609 19484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df751f992649444090e27965eb1af85d" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: true dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:07:20.242882 19552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b08304a0a02b42d7840c4e8ee9a6bd1a" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 23 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:07:20.241922 19450 leader_election.cc:304] T 21e14947d70440f19044d8f75c31e1f9 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:07:20.255141 19484 raft_consensus.cc:3055] T df751f992649444090e27965eb1af85d P 0473d2b2d01f4459b1e90fd12cc7840e [term 22 LEADER]: Stepping down as leader of term 22
I20260709 13:07:20.249181 19407 raft_consensus.cc:2468] T b08304a0a02b42d7840c4e8ee9a6bd1a P e5256d91808b47c195bc9b4dbd7f2b87 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 22.
I20260709 13:07:20.256932 19377 leader_election.cc:304] T 1f85fc4b527a48848e5faa083b604e36 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, 127766fc592545a4997f7790f50f6076
I20260709 13:07:20.255524 19484 raft_consensus.cc:740] T df751f992649444090e27965eb1af85d P 0473d2b2d01f4459b1e90fd12cc7840e [term 22 LEADER]: Becoming Follower/Learner. State: Replica: 0473d2b2d01f4459b1e90fd12cc7840e, State: Running, Role: LEADER
I20260709 13:07:20.250272 19552 raft_consensus.cc:2468] T b08304a0a02b42d7840c4e8ee9a6bd1a P e61c3a8f61bb48f8a963c9480e53c168 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 21.
I20260709 13:07:20.262193 26379 leader_election.cc:290] T 1dc5b3532fe54f74876d02beffa2c230 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:07:20.267336 19449 leader_election.cc:304] T 22196caba61445d3bec98a0aab3c337d P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e; no voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:07:20.248512 26447 raft_consensus.cc:2749] T f1b10566f45d4a7d9029858330e02d5b P 0473d2b2d01f4459b1e90fd12cc7840e [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 13:07:20.235584 26470 consensus_queue.cc:1048] T bc225c93219c45538b53a1bd3d387e4d P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.027s
I20260709 13:07:20.268721 26544 consensus_queue.cc:1048] T 76cb037fc9064d13b59a8969d897ce8c P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.065s
I20260709 13:07:20.276001 19449 leader_election.cc:304] T b08304a0a02b42d7840c4e8ee9a6bd1a P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87; no voters: 
W20260709 13:07:20.277660 26515 log.cc:927] Time spent T 86a6797bdfe94fa496c050ceae4bd0d9 P 0473d2b2d01f4459b1e90fd12cc7840e: Append to log took a long time: real 0.563s	user 0.002s	sys 0.000s
I20260709 13:07:20.277582 26017 consensus_queue.cc:1048] T ff75a1d4cb1f493db8f71ddc136ba9ab P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:07:20.278774 26540 raft_consensus.cc:493] T 6c5eebf646ad445a9d1b1adc319d7b16 P 127766fc592545a4997f7790f50f6076 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 0473d2b2d01f4459b1e90fd12cc7840e)
I20260709 13:07:20.273908 26275 raft_consensus.cc:2749] T 1f85fc4b527a48848e5faa083b604e36 P e5256d91808b47c195bc9b4dbd7f2b87 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:07:20.279320 26540 raft_consensus.cc:515] T 6c5eebf646ad445a9d1b1adc319d7b16 P 127766fc592545a4997f7790f50f6076 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:07:20.267488 26207 raft_consensus.cc:2804] T 21e14947d70440f19044d8f75c31e1f9 P 0473d2b2d01f4459b1e90fd12cc7840e [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:07:20.281596 26207 raft_consensus.cc:493] T 21e14947d70440f19044d8f75c31e1f9 P 0473d2b2d01f4459b1e90fd12cc7840e [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:20.281957 26207 raft_consensus.cc:3060] T 21e14947d70440f19044d8f75c31e1f9 P 0473d2b2d01f4459b1e90fd12cc7840e [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:07:20.269132 25851 raft_consensus.cc:2804] T 0afb57ae58a24a01850491d69f0213dd P e61c3a8f61bb48f8a963c9480e53c168 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:07:20.261531 26228 consensus_queue.cc:1048] T 217b5fae677b4971b3bbd2f357a1f7ff P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.047s
I20260709 13:07:20.259038 26512 raft_consensus.cc:515] T 7f575b143b844aa096b50997dad3516a P 0473d2b2d01f4459b1e90fd12cc7840e [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:07:20.289019 19484 consensus_queue.cc:260] T df751f992649444090e27965eb1af85d P 0473d2b2d01f4459b1e90fd12cc7840e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 22.14, Last appended by leader: 14, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:07:20.290289 26511 raft_consensus.cc:2804] T b08304a0a02b42d7840c4e8ee9a6bd1a P 0473d2b2d01f4459b1e90fd12cc7840e [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:07:20.295228 26511 raft_consensus.cc:493] T b08304a0a02b42d7840c4e8ee9a6bd1a P 0473d2b2d01f4459b1e90fd12cc7840e [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:20.296332 26511 raft_consensus.cc:3060] T b08304a0a02b42d7840c4e8ee9a6bd1a P 0473d2b2d01f4459b1e90fd12cc7840e [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:07:20.296627 26410 leader_election.cc:290] T 309c3ca0ca4b4f3ba129752ea2cb293b P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:07:20.289397 26382 raft_consensus.cc:2749] T 22196caba61445d3bec98a0aab3c337d P 0473d2b2d01f4459b1e90fd12cc7840e [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
W20260709 13:07:20.308284 19377 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.2:46257, user_credentials={real_user=slave}} blocked reactor thread for 58196.8us
I20260709 13:07:20.312449 19411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dc5b3532fe54f74876d02beffa2c230" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 23 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:07:20.315127 19377 leader_election.cc:304] T 4509b76741dc428e9201c70c1658da13 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:07:20.320132 26484 raft_consensus.cc:493] T 76cb037fc9064d13b59a8969d897ce8c P e5256d91808b47c195bc9b4dbd7f2b87 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:20.313892 26540 leader_election.cc:290] T 6c5eebf646ad445a9d1b1adc319d7b16 P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:07:20.320122 26434 raft_consensus.cc:493] T 0cdf56e38bbc453d9438d359e5a69955 P 0473d2b2d01f4459b1e90fd12cc7840e [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:20.323298 26434 raft_consensus.cc:515] T 0cdf56e38bbc453d9438d359e5a69955 P 0473d2b2d01f4459b1e90fd12cc7840e [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:07:20.320652 26484 raft_consensus.cc:515] T 76cb037fc9064d13b59a8969d897ce8c P e5256d91808b47c195bc9b4dbd7f2b87 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:07:20.329445 26484 leader_election.cc:290] T 76cb037fc9064d13b59a8969d897ce8c P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:07:20.330369 26434 leader_election.cc:290] T 0cdf56e38bbc453d9438d359e5a69955 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
W20260709 13:07:20.333392 20078 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.2:46257, user_credentials={real_user=slave}} blocked reactor thread for 226144us
I20260709 13:07:20.340245 26275 raft_consensus.cc:2749] T 4509b76741dc428e9201c70c1658da13 P e5256d91808b47c195bc9b4dbd7f2b87 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:07:20.344437 19377 leader_election.cc:304] T 309c3ca0ca4b4f3ba129752ea2cb293b P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, 127766fc592545a4997f7790f50f6076
I20260709 13:07:20.345109 26512 leader_election.cc:290] T 7f575b143b844aa096b50997dad3516a P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:07:20.345340 26275 raft_consensus.cc:2749] T 309c3ca0ca4b4f3ba129752ea2cb293b P e5256d91808b47c195bc9b4dbd7f2b87 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:07:20.347144 19377 leader_election.cc:304] T df751f992649444090e27965eb1af85d P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:07:20.347229 19559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dc5b3532fe54f74876d02beffa2c230" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 23 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:07:20.348356 26484 raft_consensus.cc:2749] T df751f992649444090e27965eb1af85d P e5256d91808b47c195bc9b4dbd7f2b87 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:07:20.349125 19377 leader_election.cc:304] T bc225c93219c45538b53a1bd3d387e4d P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:07:20.349838 26531 raft_consensus.cc:2749] T bc225c93219c45538b53a1bd3d387e4d P e5256d91808b47c195bc9b4dbd7f2b87 [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:07:20.352411 19450 leader_election.cc:304] T 40e1e16737a842ee936002830f36882e P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e; no voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:07:20.354619 19552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cdf56e38bbc453d9438d359e5a69955" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:07:20.355166 19559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f575b143b844aa096b50997dad3516a" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:07:20.355412 19552 raft_consensus.cc:2468] T 0cdf56e38bbc453d9438d359e5a69955 P e61c3a8f61bb48f8a963c9480e53c168 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 20.
I20260709 13:07:20.356801 19377 leader_election.cc:304] T 46c5bfeecc314717bffe987e6844b6d0 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:07:20.359376 19377 leader_election.cc:304] T 1dc5b3532fe54f74876d02beffa2c230 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:07:20.355837 19559 raft_consensus.cc:2468] T 7f575b143b844aa096b50997dad3516a P e61c3a8f61bb48f8a963c9480e53c168 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 18.
I20260709 13:07:20.361132 26097 raft_consensus.cc:2749] T 1dc5b3532fe54f74876d02beffa2c230 P e5256d91808b47c195bc9b4dbd7f2b87 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:07:20.361244 26154 raft_consensus.cc:2749] T 46c5bfeecc314717bffe987e6844b6d0 P e5256d91808b47c195bc9b4dbd7f2b87 [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 13:07:20.355460 26512 raft_consensus.cc:2749] T 40e1e16737a842ee936002830f36882e P 0473d2b2d01f4459b1e90fd12cc7840e [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:07:20.363377 19450 leader_election.cc:304] T 1dc5b3532fe54f74876d02beffa2c230 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e; no voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:07:20.363720 26275 consensus_queue.cc:1048] T edd7d470b5014c9489be7f41f64355c9 P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:07:20.364331 26512 raft_consensus.cc:2749] T 1dc5b3532fe54f74876d02beffa2c230 P 0473d2b2d01f4459b1e90fd12cc7840e [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:07:20.359890 26448 consensus_queue.cc:1048] T 40e1e16737a842ee936002830f36882e P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.006s
W20260709 13:07:20.369652 26537 log.cc:927] Time spent T 1efebf73c86e432baa55533136b6e12c P 127766fc592545a4997f7790f50f6076: Append to log took a long time: real 0.363s	user 0.001s	sys 0.001s
I20260709 13:07:20.357424 26511 raft_consensus.cc:515] T b08304a0a02b42d7840c4e8ee9a6bd1a P 0473d2b2d01f4459b1e90fd12cc7840e [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
W20260709 13:07:20.372505 26535 log.cc:927] Time spent T ed7fdbcb96d14d418db9ca90a792588a P 127766fc592545a4997f7790f50f6076: Append to log took a long time: real 0.256s	user 0.001s	sys 0.000s
I20260709 13:07:20.374373 19450 leader_election.cc:304] T 0cdf56e38bbc453d9438d359e5a69955 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:07:20.374298 26207 raft_consensus.cc:515] T 21e14947d70440f19044d8f75c31e1f9 P 0473d2b2d01f4459b1e90fd12cc7840e [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:07:20.375571 26245 raft_consensus.cc:2804] T 0cdf56e38bbc453d9438d359e5a69955 P 0473d2b2d01f4459b1e90fd12cc7840e [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:07:20.376001 26245 raft_consensus.cc:493] T 0cdf56e38bbc453d9438d359e5a69955 P 0473d2b2d01f4459b1e90fd12cc7840e [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:20.376344 26245 raft_consensus.cc:3060] T 0cdf56e38bbc453d9438d359e5a69955 P 0473d2b2d01f4459b1e90fd12cc7840e [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:07:20.376870 26207 leader_election.cc:290] T 21e14947d70440f19044d8f75c31e1f9 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 22 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:07:20.378170 19450 leader_election.cc:304] T 7f575b143b844aa096b50997dad3516a P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:07:20.380599 19559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21e14947d70440f19044d8f75c31e1f9" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 22 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:07:20.381173 19559 raft_consensus.cc:3060] T 21e14947d70440f19044d8f75c31e1f9 P e61c3a8f61bb48f8a963c9480e53c168 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:07:20.381955 19481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14935b3ddf914369822e4a0547aaa355" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:07:20.382788 19482 raft_consensus.cc:1275] T 1efebf73c86e432baa55533136b6e12c P 0473d2b2d01f4459b1e90fd12cc7840e [term 18 FOLLOWER]: Refusing update from remote peer 127766fc592545a4997f7790f50f6076: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
I20260709 13:07:20.379528 19410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cdf56e38bbc453d9438d359e5a69955" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:07:20.386564 19410 raft_consensus.cc:2468] T 0cdf56e38bbc453d9438d359e5a69955 P e5256d91808b47c195bc9b4dbd7f2b87 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 19.
I20260709 13:07:20.386809 19477 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "5ec1c4ce15e04c7e8c283a62179f2a64"
dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
 from {username='slave'} at 127.0.0.1:39478
I20260709 13:07:20.387334 19477 raft_consensus.cc:493] T 5ec1c4ce15e04c7e8c283a62179f2a64 P 0473d2b2d01f4459b1e90fd12cc7840e [term 14 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:07:20.387696 19477 raft_consensus.cc:3060] T 5ec1c4ce15e04c7e8c283a62179f2a64 P 0473d2b2d01f4459b1e90fd12cc7840e [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:07:20.391711 19559 raft_consensus.cc:2468] T 21e14947d70440f19044d8f75c31e1f9 P e61c3a8f61bb48f8a963c9480e53c168 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 22.
I20260709 13:07:20.393682 19405 raft_consensus.cc:1240] T 309c3ca0ca4b4f3ba129752ea2cb293b P e5256d91808b47c195bc9b4dbd7f2b87 [term 13 FOLLOWER]: Rejecting Update request from peer 0473d2b2d01f4459b1e90fd12cc7840e for earlier term 12. Current term is 13. Ops: []
I20260709 13:07:20.396385 19409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f575b143b844aa096b50997dad3516a" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:07:20.396076 19405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b08304a0a02b42d7840c4e8ee9a6bd1a" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 23 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
I20260709 13:07:20.397689 19405 raft_consensus.cc:3060] T b08304a0a02b42d7840c4e8ee9a6bd1a P e5256d91808b47c195bc9b4dbd7f2b87 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:07:20.387921 26207 raft_consensus.cc:2804] T 7f575b143b844aa096b50997dad3516a P 0473d2b2d01f4459b1e90fd12cc7840e [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:07:20.400837 26434 raft_consensus.cc:493] T 76cb037fc9064d13b59a8969d897ce8c P 0473d2b2d01f4459b1e90fd12cc7840e [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:20.412889 19411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21e14947d70440f19044d8f75c31e1f9" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 22 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
I20260709 13:07:20.413499 19411 raft_consensus.cc:3060] T 21e14947d70440f19044d8f75c31e1f9 P e5256d91808b47c195bc9b4dbd7f2b87 [term 20 FOLLOWER]: Advancing to term 22
I20260709 13:07:20.392282 26511 leader_election.cc:290] T b08304a0a02b42d7840c4e8ee9a6bd1a P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 23 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:07:20.415817 19479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c5eebf646ad445a9d1b1adc319d7b16" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:07:20.420612 19479 raft_consensus.cc:2468] T 6c5eebf646ad445a9d1b1adc319d7b16 P 0473d2b2d01f4459b1e90fd12cc7840e [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 127766fc592545a4997f7790f50f6076 in term 19.
I20260709 13:07:20.411149 19482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "309c3ca0ca4b4f3ba129752ea2cb293b" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:07:20.425189 19483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f93ee515a9c14139bf566522ed8232f3" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 24 candidate_status { last_received { term: 23 index: 12 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:07:20.425977 19483 raft_consensus.cc:2393] T f93ee515a9c14139bf566522ed8232f3 P 0473d2b2d01f4459b1e90fd12cc7840e [term 24 FOLLOWER]: Leader election vote request: Denying vote to candidate e5256d91808b47c195bc9b4dbd7f2b87 in current term 24: Already voted for candidate 0473d2b2d01f4459b1e90fd12cc7840e in this term.
I20260709 13:07:20.413348 26207 raft_consensus.cc:493] T 7f575b143b844aa096b50997dad3516a P 0473d2b2d01f4459b1e90fd12cc7840e [term 18 FOLLOWER]: Starting leader election (detected failure of leader e5256d91808b47c195bc9b4dbd7f2b87)
I20260709 13:07:20.434230 19553 leader_election.cc:290] T 0afb57ae58a24a01850491d69f0213dd P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 13 election: Requested vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:07:20.430750 20078 leader_election.cc:304] T 6c5eebf646ad445a9d1b1adc319d7b16 P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, 127766fc592545a4997f7790f50f6076; no voters: 
I20260709 13:07:20.424595 26434 raft_consensus.cc:515] T 76cb037fc9064d13b59a8969d897ce8c P 0473d2b2d01f4459b1e90fd12cc7840e [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:07:20.444554 26529 consensus_queue.cc:1048] T 1efebf73c86e432baa55533136b6e12c P 127766fc592545a4997f7790f50f6076 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.021s
I20260709 13:07:20.445611 26434 leader_election.cc:290] T 76cb037fc9064d13b59a8969d897ce8c P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:07:20.449819 19483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cdf56e38bbc453d9438d359e5a69955" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:07:20.443980 19479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b08304a0a02b42d7840c4e8ee9a6bd1a" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 23 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:07:20.451650 19479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21e14947d70440f19044d8f75c31e1f9" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:07:20.452313 19479 raft_consensus.cc:2368] T 21e14947d70440f19044d8f75c31e1f9 P 0473d2b2d01f4459b1e90fd12cc7840e [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e5256d91808b47c195bc9b4dbd7f2b87 for earlier term 21. Current term is 22.
I20260709 13:07:20.453038 19479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76cb037fc9064d13b59a8969d897ce8c" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 21 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:07:20.453559 19479 raft_consensus.cc:2468] T 76cb037fc9064d13b59a8969d897ce8c P 0473d2b2d01f4459b1e90fd12cc7840e [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 20.
I20260709 13:07:20.398211 26447 consensus_queue.cc:1059] T 309c3ca0ca4b4f3ba129752ea2cb293b P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 }, Status: INVALID_TERM, Last received: 12.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.042s
I20260709 13:07:20.439637 19477 raft_consensus.cc:515] T 5ec1c4ce15e04c7e8c283a62179f2a64 P 0473d2b2d01f4459b1e90fd12cc7840e [term 15 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:07:20.456149 26447 raft_consensus.cc:3055] T 309c3ca0ca4b4f3ba129752ea2cb293b P 0473d2b2d01f4459b1e90fd12cc7840e [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:07:20.456499 26447 raft_consensus.cc:740] T 309c3ca0ca4b4f3ba129752ea2cb293b P 0473d2b2d01f4459b1e90fd12cc7840e [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 0473d2b2d01f4459b1e90fd12cc7840e, State: Running, Role: LEADER
I20260709 13:07:20.457363 26447 consensus_queue.cc:260] T 309c3ca0ca4b4f3ba129752ea2cb293b P 0473d2b2d01f4459b1e90fd12cc7840e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 12.12, Last appended by leader: 12, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:07:20.458496 26447 raft_consensus.cc:3060] T 309c3ca0ca4b4f3ba129752ea2cb293b P 0473d2b2d01f4459b1e90fd12cc7840e [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:07:20.465065 25851 raft_consensus.cc:697] T 0afb57ae58a24a01850491d69f0213dd P e61c3a8f61bb48f8a963c9480e53c168 [term 13 LEADER]: Becoming Leader. State: Replica: e61c3a8f61bb48f8a963c9480e53c168, State: Running, Role: LEADER
I20260709 13:07:20.443840 26528 raft_consensus.cc:2804] T 6c5eebf646ad445a9d1b1adc319d7b16 P 127766fc592545a4997f7790f50f6076 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:07:20.476588 26532 raft_consensus.cc:493] T 6c5eebf646ad445a9d1b1adc319d7b16 P e61c3a8f61bb48f8a963c9480e53c168 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:20.497761 26532 raft_consensus.cc:515] T 6c5eebf646ad445a9d1b1adc319d7b16 P e61c3a8f61bb48f8a963c9480e53c168 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:07:20.499993 26532 leader_election.cc:290] T 6c5eebf646ad445a9d1b1adc319d7b16 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:07:20.442798 26207 raft_consensus.cc:3060] T 7f575b143b844aa096b50997dad3516a P 0473d2b2d01f4459b1e90fd12cc7840e [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:07:20.480383 19554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f93ee515a9c14139bf566522ed8232f3" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 24 candidate_status { last_received { term: 23 index: 12 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:07:20.504709 25851 consensus_queue.cc:237] T 0afb57ae58a24a01850491d69f0213dd P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:07:20.505671 19486 raft_consensus.cc:1240] T f1b10566f45d4a7d9029858330e02d5b P 0473d2b2d01f4459b1e90fd12cc7840e [term 20 FOLLOWER]: Rejecting Update request from peer e5256d91808b47c195bc9b4dbd7f2b87 for earlier term 19. Current term is 20. Ops: []
I20260709 13:07:20.486212 19560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21e14947d70440f19044d8f75c31e1f9" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:07:20.509608 19560 raft_consensus.cc:2368] T 21e14947d70440f19044d8f75c31e1f9 P e61c3a8f61bb48f8a963c9480e53c168 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e5256d91808b47c195bc9b4dbd7f2b87 for earlier term 21. Current term is 22.
I20260709 13:07:20.488438 19559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76cb037fc9064d13b59a8969d897ce8c" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 21 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:07:20.344096 18300 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:07:20.489965 19411 raft_consensus.cc:2468] T 21e14947d70440f19044d8f75c31e1f9 P e5256d91808b47c195bc9b4dbd7f2b87 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 22.
I20260709 13:07:20.492100 19405 raft_consensus.cc:2468] T b08304a0a02b42d7840c4e8ee9a6bd1a P e5256d91808b47c195bc9b4dbd7f2b87 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 23.
I20260709 13:07:20.495203 19553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b08304a0a02b42d7840c4e8ee9a6bd1a" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 23 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:07:20.513252 19553 raft_consensus.cc:3060] T b08304a0a02b42d7840c4e8ee9a6bd1a P e61c3a8f61bb48f8a963c9480e53c168 [term 21 FOLLOWER]: Advancing to term 23
I20260709 13:07:20.488790 19450 leader_election.cc:304] T 21e14947d70440f19044d8f75c31e1f9 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:07:20.496174 19477 leader_election.cc:290] T 5ec1c4ce15e04c7e8c283a62179f2a64 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 15 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:07:20.494802 26528 raft_consensus.cc:493] T 6c5eebf646ad445a9d1b1adc319d7b16 P 127766fc592545a4997f7790f50f6076 [term 18 FOLLOWER]: Starting leader election (detected failure of leader 0473d2b2d01f4459b1e90fd12cc7840e)
I20260709 13:07:20.482056 19552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b08304a0a02b42d7840c4e8ee9a6bd1a" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 23 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:07:20.516696 20106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ec1c4ce15e04c7e8c283a62179f2a64" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: true dest_uuid: "127766fc592545a4997f7790f50f6076"
I20260709 13:07:20.517268 20106 raft_consensus.cc:3055] T 5ec1c4ce15e04c7e8c283a62179f2a64 P 127766fc592545a4997f7790f50f6076 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:07:20.517568 20106 raft_consensus.cc:740] T 5ec1c4ce15e04c7e8c283a62179f2a64 P 127766fc592545a4997f7790f50f6076 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 127766fc592545a4997f7790f50f6076, State: Running, Role: LEADER
I20260709 13:07:20.518504 26528 raft_consensus.cc:3060] T 6c5eebf646ad445a9d1b1adc319d7b16 P 127766fc592545a4997f7790f50f6076 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:07:20.518342 20106 consensus_queue.cc:260] T 5ec1c4ce15e04c7e8c283a62179f2a64 P 127766fc592545a4997f7790f50f6076 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:07:20.518317 26484 consensus_queue.cc:1059] T 4af19371ea874c09a0a2147040835cbb P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false }, Status: INVALID_TERM, Last received: 12.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:07:20.520073 25923 leader_election.cc:290] T 0cdf56e38bbc453d9438d359e5a69955 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:07:20.520341 26564 raft_consensus.cc:3055] T 4af19371ea874c09a0a2147040835cbb P e5256d91808b47c195bc9b4dbd7f2b87 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:07:20.520746 26564 raft_consensus.cc:740] T 4af19371ea874c09a0a2147040835cbb P e5256d91808b47c195bc9b4dbd7f2b87 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: e5256d91808b47c195bc9b4dbd7f2b87, State: Running, Role: LEADER
I20260709 13:07:20.521548 26564 consensus_queue.cc:260] T 4af19371ea874c09a0a2147040835cbb P e5256d91808b47c195bc9b4dbd7f2b87 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:07:20.522725 26564 raft_consensus.cc:3060] T 4af19371ea874c09a0a2147040835cbb P e5256d91808b47c195bc9b4dbd7f2b87 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:07:20.522961 26382 raft_consensus.cc:2804] T 21e14947d70440f19044d8f75c31e1f9 P 0473d2b2d01f4459b1e90fd12cc7840e [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:07:20.524914 20106 raft_consensus.cc:3060] T 5ec1c4ce15e04c7e8c283a62179f2a64 P 127766fc592545a4997f7790f50f6076 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:07:20.530037 19485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c5eebf646ad445a9d1b1adc319d7b16" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:07:20.532063 20106 raft_consensus.cc:2468] T 5ec1c4ce15e04c7e8c283a62179f2a64 P 127766fc592545a4997f7790f50f6076 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 15.
I20260709 13:07:20.534986 20106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0afb57ae58a24a01850491d69f0213dd" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: true dest_uuid: "127766fc592545a4997f7790f50f6076"
I20260709 13:07:20.535528 20106 raft_consensus.cc:3060] T 0afb57ae58a24a01850491d69f0213dd P 127766fc592545a4997f7790f50f6076 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:07:20.536260 20110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c5eebf646ad445a9d1b1adc319d7b16" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:07:20.537480 20103 raft_consensus.cc:1275] T 70797e5783b5454ab0d0eea663e791e3 P 127766fc592545a4997f7790f50f6076 [term 23 FOLLOWER]: Refusing update from remote peer e61c3a8f61bb48f8a963c9480e53c168: Log matching property violated. Preceding OpId in replica: term: 22 index: 15. Preceding OpId from leader: term: 23 index: 16. (index mismatch)
I20260709 13:07:20.540352 19553 raft_consensus.cc:2468] T b08304a0a02b42d7840c4e8ee9a6bd1a P e61c3a8f61bb48f8a963c9480e53c168 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 23.
I20260709 13:07:20.544883 19485 raft_consensus.cc:2468] T 6c5eebf646ad445a9d1b1adc319d7b16 P 0473d2b2d01f4459b1e90fd12cc7840e [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 19.
I20260709 13:07:20.544957 26245 raft_consensus.cc:515] T 0cdf56e38bbc453d9438d359e5a69955 P 0473d2b2d01f4459b1e90fd12cc7840e [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:07:20.546278 19483 raft_consensus.cc:2368] T 0cdf56e38bbc453d9438d359e5a69955 P 0473d2b2d01f4459b1e90fd12cc7840e [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e5256d91808b47c195bc9b4dbd7f2b87 for earlier term 20. Current term is 21.
I20260709 13:07:20.548760 19557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c5eebf646ad445a9d1b1adc319d7b16" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:07:20.550354 19405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76cb037fc9064d13b59a8969d897ce8c" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 21 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:07:20.552039 19449 leader_election.cc:304] T 5ec1c4ce15e04c7e8c283a62179f2a64 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, 127766fc592545a4997f7790f50f6076; no voters: 
I20260709 13:07:20.552855 19405 raft_consensus.cc:2468] T 76cb037fc9064d13b59a8969d897ce8c P e5256d91808b47c195bc9b4dbd7f2b87 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 20.
I20260709 13:07:20.555728 19554 raft_consensus.cc:2468] T f93ee515a9c14139bf566522ed8232f3 P e61c3a8f61bb48f8a963c9480e53c168 [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 24.
I20260709 13:07:20.555760 20106 raft_consensus.cc:2468] T 0afb57ae58a24a01850491d69f0213dd P 127766fc592545a4997f7790f50f6076 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 13.
I20260709 13:07:20.561415 19559 raft_consensus.cc:1275] T 1efebf73c86e432baa55533136b6e12c P e61c3a8f61bb48f8a963c9480e53c168 [term 18 FOLLOWER]: Refusing update from remote peer 127766fc592545a4997f7790f50f6076: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
I20260709 13:07:20.563021 19406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70797e5783b5454ab0d0eea663e791e3" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 24 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:07:20.563635 19406 raft_consensus.cc:2468] T 70797e5783b5454ab0d0eea663e791e3 P e5256d91808b47c195bc9b4dbd7f2b87 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 127766fc592545a4997f7790f50f6076 in term 23.
I20260709 13:07:20.564374 26382 raft_consensus.cc:697] T 21e14947d70440f19044d8f75c31e1f9 P 0473d2b2d01f4459b1e90fd12cc7840e [term 22 LEADER]: Becoming Leader. State: Replica: 0473d2b2d01f4459b1e90fd12cc7840e, State: Running, Role: LEADER
I20260709 13:07:20.565348 26382 consensus_queue.cc:237] T 21e14947d70440f19044d8f75c31e1f9 P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 20.13, Last appended by leader: 13, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:07:20.567760 20075 leader_election.cc:304] T 70797e5783b5454ab0d0eea663e791e3 P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 127766fc592545a4997f7790f50f6076, e5256d91808b47c195bc9b4dbd7f2b87; no voters: 
I20260709 13:07:20.569450 26540 raft_consensus.cc:2804] T 70797e5783b5454ab0d0eea663e791e3 P 127766fc592545a4997f7790f50f6076 [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 13:07:20.569660 19552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70797e5783b5454ab0d0eea663e791e3" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 24 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:07:20.570783 19557 raft_consensus.cc:2393] T 6c5eebf646ad445a9d1b1adc319d7b16 P e61c3a8f61bb48f8a963c9480e53c168 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 127766fc592545a4997f7790f50f6076 in current term 19: Already voted for candidate e61c3a8f61bb48f8a963c9480e53c168 in this term.
I20260709 13:07:20.569823 26540 raft_consensus.cc:493] T 70797e5783b5454ab0d0eea663e791e3 P 127766fc592545a4997f7790f50f6076 [term 23 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:20.571336 26540 raft_consensus.cc:3060] T 70797e5783b5454ab0d0eea663e791e3 P 127766fc592545a4997f7790f50f6076 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:07:20.551959 19526 leader_election.cc:304] T 6c5eebf646ad445a9d1b1adc319d7b16 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:07:20.572975 19450 leader_election.cc:304] T b08304a0a02b42d7840c4e8ee9a6bd1a P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:07:20.582985 19405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "309c3ca0ca4b4f3ba129752ea2cb293b" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:07:20.573783 19523 leader_election.cc:304] T e381f1d6b8184797ad142de49be225a8 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e61c3a8f61bb48f8a963c9480e53c168; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:07:20.584283 19405 raft_consensus.cc:2393] T 309c3ca0ca4b4f3ba129752ea2cb293b P e5256d91808b47c195bc9b4dbd7f2b87 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 127766fc592545a4997f7790f50f6076 in current term 13: Already voted for candidate e5256d91808b47c195bc9b4dbd7f2b87 in this term.
I20260709 13:07:20.591163 26245 leader_election.cc:290] T 0cdf56e38bbc453d9438d359e5a69955 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 21 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:07:20.594549 19478 raft_consensus.cc:2468] T ff9b0eddd810459b82d91c60777c10eb P 0473d2b2d01f4459b1e90fd12cc7840e [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 22.
W20260709 13:07:20.595566 19452 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:20.597663 19410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ec1c4ce15e04c7e8c283a62179f2a64" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: true dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
I20260709 13:07:20.598443 19410 raft_consensus.cc:3060] T 5ec1c4ce15e04c7e8c283a62179f2a64 P e5256d91808b47c195bc9b4dbd7f2b87 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:07:20.588968 26017 raft_consensus.cc:2804] T 5ec1c4ce15e04c7e8c283a62179f2a64 P 0473d2b2d01f4459b1e90fd12cc7840e [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:07:20.601249 25871 raft_consensus.cc:2804] T b08304a0a02b42d7840c4e8ee9a6bd1a P 0473d2b2d01f4459b1e90fd12cc7840e [term 23 FOLLOWER]: Leader election won for term 23
I20260709 13:07:20.601367 26017 raft_consensus.cc:697] T 5ec1c4ce15e04c7e8c283a62179f2a64 P 0473d2b2d01f4459b1e90fd12cc7840e [term 15 LEADER]: Becoming Leader. State: Replica: 0473d2b2d01f4459b1e90fd12cc7840e, State: Running, Role: LEADER
I20260709 13:07:20.601853 25871 raft_consensus.cc:697] T b08304a0a02b42d7840c4e8ee9a6bd1a P 0473d2b2d01f4459b1e90fd12cc7840e [term 23 LEADER]: Becoming Leader. State: Replica: 0473d2b2d01f4459b1e90fd12cc7840e, State: Running, Role: LEADER
I20260709 13:07:20.602818 25871 consensus_queue.cc:237] T b08304a0a02b42d7840c4e8ee9a6bd1a P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 21.12, Last appended by leader: 12, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:07:20.585081 26228 raft_consensus.cc:2804] T 6c5eebf646ad445a9d1b1adc319d7b16 P e61c3a8f61bb48f8a963c9480e53c168 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:07:20.597551 25851 raft_consensus.cc:2749] T e381f1d6b8184797ad142de49be225a8 P e61c3a8f61bb48f8a963c9480e53c168 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:07:20.655269 19551 raft_consensus.cc:3055] T ff75a1d4cb1f493db8f71ddc136ba9ab P e61c3a8f61bb48f8a963c9480e53c168 [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:07:20.659284 19484 raft_consensus.cc:3060] T df751f992649444090e27965eb1af85d P 0473d2b2d01f4459b1e90fd12cc7840e [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:07:20.655598 19551 raft_consensus.cc:740] T ff75a1d4cb1f493db8f71ddc136ba9ab P e61c3a8f61bb48f8a963c9480e53c168 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: e61c3a8f61bb48f8a963c9480e53c168, State: Running, Role: LEADER
I20260709 13:07:20.662509 19377 leader_election.cc:400] T 21e14947d70440f19044d8f75c31e1f9 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 21 pre-election: Vote denied by peer 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257) with higher term. Message: Invalid argument: T 21e14947d70440f19044d8f75c31e1f9 P 0473d2b2d01f4459b1e90fd12cc7840e [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e5256d91808b47c195bc9b4dbd7f2b87 for earlier term 21. Current term is 22.
I20260709 13:07:20.662827 19377 leader_election.cc:403] T 21e14947d70440f19044d8f75c31e1f9 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 21 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:07:20.662880 19559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76cb037fc9064d13b59a8969d897ce8c" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 21 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:07:20.663188 20078 leader_election.cc:304] T 309c3ca0ca4b4f3ba129752ea2cb293b P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 127766fc592545a4997f7790f50f6076; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87
W20260709 13:07:20.663938 19449 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.1:40321, user_credentials={real_user=slave}} blocked reactor thread for 81034us
I20260709 13:07:20.665046 19449 leader_election.cc:304] T 76cb037fc9064d13b59a8969d897ce8c P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87; no voters: 
I20260709 13:07:20.666095 19559 raft_consensus.cc:1240] T df751f992649444090e27965eb1af85d P e61c3a8f61bb48f8a963c9480e53c168 [term 23 FOLLOWER]: Rejecting Update request from peer 0473d2b2d01f4459b1e90fd12cc7840e for earlier term 22. Current term is 23. Ops: []
I20260709 13:07:20.663383 19377 leader_election.cc:304] T 76cb037fc9064d13b59a8969d897ce8c P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87; no voters: 
I20260709 13:07:20.668223 19557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cdf56e38bbc453d9438d359e5a69955" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:07:20.668835 19557 raft_consensus.cc:3060] T 0cdf56e38bbc453d9438d359e5a69955 P e61c3a8f61bb48f8a963c9480e53c168 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:07:20.653187 26228 raft_consensus.cc:493] T 6c5eebf646ad445a9d1b1adc319d7b16 P e61c3a8f61bb48f8a963c9480e53c168 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:20.674046 19377 leader_election.cc:400] T 0cdf56e38bbc453d9438d359e5a69955 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 20 pre-election: Vote denied by peer 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257) with higher term. Message: Invalid argument: T 0cdf56e38bbc453d9438d359e5a69955 P 0473d2b2d01f4459b1e90fd12cc7840e [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e5256d91808b47c195bc9b4dbd7f2b87 for earlier term 20. Current term is 21.
I20260709 13:07:20.674466 19377 leader_election.cc:403] T 0cdf56e38bbc453d9438d359e5a69955 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 20 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:07:20.671198 26416 raft_consensus.cc:3060] T 309c3ca0ca4b4f3ba129752ea2cb293b P 127766fc592545a4997f7790f50f6076 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:07:20.670452 26348 raft_consensus.cc:2749] T 21e14947d70440f19044d8f75c31e1f9 P e5256d91808b47c195bc9b4dbd7f2b87 [term 22 FOLLOWER]: Leader pre-election lost for term 21. Reason: Vote denied by peer 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257) with higher term. Message: Invalid argument: T 21e14947d70440f19044d8f75c31e1f9 P 0473d2b2d01f4459b1e90fd12cc7840e [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e5256d91808b47c195bc9b4dbd7f2b87 for earlier term 21. Current term is 22.
I20260709 13:07:20.602449 26017 consensus_queue.cc:237] T 5ec1c4ce15e04c7e8c283a62179f2a64 P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:07:20.674028 26228 raft_consensus.cc:3060] T 6c5eebf646ad445a9d1b1adc319d7b16 P e61c3a8f61bb48f8a963c9480e53c168 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:07:20.662070 26470 consensus_queue.cc:1048] T 70797e5783b5454ab0d0eea663e791e3 P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Connected to new peer: Peer: permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.019s
I20260709 13:07:20.670949 26484 consensus_queue.cc:1059] T f1b10566f45d4a7d9029858330e02d5b P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 }, Status: INVALID_TERM, Last received: 19.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.017s
I20260709 13:07:20.688999 26379 raft_consensus.cc:2804] T 76cb037fc9064d13b59a8969d897ce8c P 0473d2b2d01f4459b1e90fd12cc7840e [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:07:20.706965 26553 raft_consensus.cc:493] T a08760e15aac4630a629431f56024dc8 P e61c3a8f61bb48f8a963c9480e53c168 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader e5256d91808b47c195bc9b4dbd7f2b87)
I20260709 13:07:20.707268 26288 raft_consensus.cc:2804] T 76cb037fc9064d13b59a8969d897ce8c P e5256d91808b47c195bc9b4dbd7f2b87 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:07:20.707708 26547 consensus_queue.cc:1048] T 1efebf73c86e432baa55533136b6e12c P 127766fc592545a4997f7790f50f6076 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.049s
I20260709 13:07:20.708287 26446 raft_consensus.cc:3060] T 0cdf56e38bbc453d9438d359e5a69955 P e5256d91808b47c195bc9b4dbd7f2b87 [term 19 FOLLOWER]: Advancing to term 21
I20260709 13:07:20.708338 19551 consensus_queue.cc:260] T ff75a1d4cb1f493db8f71ddc136ba9ab P e61c3a8f61bb48f8a963c9480e53c168 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 20.11, Last appended by leader: 11, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:07:20.708845 26484 raft_consensus.cc:3055] T f1b10566f45d4a7d9029858330e02d5b P e5256d91808b47c195bc9b4dbd7f2b87 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:07:20.715492 26207 raft_consensus.cc:515] T 7f575b143b844aa096b50997dad3516a P 0473d2b2d01f4459b1e90fd12cc7840e [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
W20260709 13:07:20.719405 26566 log.cc:927] Time spent T 40e1e16737a842ee936002830f36882e P 0473d2b2d01f4459b1e90fd12cc7840e: Append to log took a long time: real 0.142s	user 0.001s	sys 0.000s
I20260709 13:07:20.718191 26528 raft_consensus.cc:515] T 6c5eebf646ad445a9d1b1adc319d7b16 P 127766fc592545a4997f7790f50f6076 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:07:20.732456 26288 raft_consensus.cc:493] T 76cb037fc9064d13b59a8969d897ce8c P e5256d91808b47c195bc9b4dbd7f2b87 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:20.731523 19557 raft_consensus.cc:2468] T 0cdf56e38bbc453d9438d359e5a69955 P e61c3a8f61bb48f8a963c9480e53c168 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 21.
I20260709 13:07:20.728502 26379 raft_consensus.cc:493] T 76cb037fc9064d13b59a8969d897ce8c P 0473d2b2d01f4459b1e90fd12cc7840e [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:20.775450 26288 raft_consensus.cc:3060] T 76cb037fc9064d13b59a8969d897ce8c P e5256d91808b47c195bc9b4dbd7f2b87 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:07:20.782841 26379 raft_consensus.cc:3060] T 76cb037fc9064d13b59a8969d897ce8c P 0473d2b2d01f4459b1e90fd12cc7840e [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:07:20.783968 26528 leader_election.cc:290] T 6c5eebf646ad445a9d1b1adc319d7b16 P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 19 election: Requested vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:07:20.784687 20110 raft_consensus.cc:2468] T 6c5eebf646ad445a9d1b1adc319d7b16 P 127766fc592545a4997f7790f50f6076 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 19.
I20260709 13:07:20.786367 19553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c5eebf646ad445a9d1b1adc319d7b16" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:07:20.787436 19450 leader_election.cc:304] T 0cdf56e38bbc453d9438d359e5a69955 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:07:20.788163 19479 raft_consensus.cc:1240] T 7f575b143b844aa096b50997dad3516a P 0473d2b2d01f4459b1e90fd12cc7840e [term 19 FOLLOWER]: Rejecting Update request from peer e5256d91808b47c195bc9b4dbd7f2b87 for earlier term 18. Current term is 19. Ops: []
I20260709 13:07:20.788838 26447 raft_consensus.cc:2804] T 0cdf56e38bbc453d9438d359e5a69955 P 0473d2b2d01f4459b1e90fd12cc7840e [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:07:20.789343 26447 raft_consensus.cc:697] T 0cdf56e38bbc453d9438d359e5a69955 P 0473d2b2d01f4459b1e90fd12cc7840e [term 21 LEADER]: Becoming Leader. State: Replica: 0473d2b2d01f4459b1e90fd12cc7840e, State: Running, Role: LEADER
I20260709 13:07:20.790180 26447 consensus_queue.cc:237] T 0cdf56e38bbc453d9438d359e5a69955 P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 19.13, Last appended by leader: 13, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:07:20.737542 26484 raft_consensus.cc:740] T f1b10566f45d4a7d9029858330e02d5b P e5256d91808b47c195bc9b4dbd7f2b87 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: e5256d91808b47c195bc9b4dbd7f2b87, State: Running, Role: LEADER
I20260709 13:07:20.790822 26324 raft_consensus.cc:493] T 65d8cb8d6ec64f459d5a47cefab10acf P e61c3a8f61bb48f8a963c9480e53c168 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader e5256d91808b47c195bc9b4dbd7f2b87)
I20260709 13:07:20.816553 26324 raft_consensus.cc:515] T 65d8cb8d6ec64f459d5a47cefab10acf P e61c3a8f61bb48f8a963c9480e53c168 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:07:20.816850 26484 consensus_queue.cc:260] T f1b10566f45d4a7d9029858330e02d5b P e5256d91808b47c195bc9b4dbd7f2b87 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 19.12, Last appended by leader: 12, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:07:20.817986 26484 raft_consensus.cc:3060] T f1b10566f45d4a7d9029858330e02d5b P e5256d91808b47c195bc9b4dbd7f2b87 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:07:20.818071 19478 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58294 (request call id 3083) took 1116 ms. Trace:
I20260709 13:07:20.734774 26553 raft_consensus.cc:515] T a08760e15aac4630a629431f56024dc8 P e61c3a8f61bb48f8a963c9480e53c168 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:07:20.800742 26288 raft_consensus.cc:515] T 76cb037fc9064d13b59a8969d897ce8c P e5256d91808b47c195bc9b4dbd7f2b87 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:07:20.818693 19478 rpcz_store.cc:276] 0709 13:07:19.701719 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:19.702084 (+   365us) service_pool.cc:224] Handling call
0709 13:07:20.817832 (+1115748us) spinlock_profiling.cc:243] Waited 823 ms on lock 0x7b54003ea3d4. stack: 00007f4a79de9343 00007f4a79de9240 00007f4a797781d4 00007f4a834b6304 00007f4a834b6299 00007f4a7ce71571 00007f4a7cf0c2fa 00007f4a81ecdb17 00007f4a7b4486d4 00007f4a7b448662 00007f4a7b448591 00007f4a7b44850c 00007f4a7b4477c2 00007f4a7b24348c 00007f4a7b2428c6 00007f4a7b24226f
0709 13:07:20.817971 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1894023936}
I20260709 13:07:20.820473 26553 leader_election.cc:290] T a08760e15aac4630a629431f56024dc8 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:07:20.820755 26288 leader_election.cc:290] T 76cb037fc9064d13b59a8969d897ce8c P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 21 election: Requested vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:07:20.821504 26324 leader_election.cc:290] T 65d8cb8d6ec64f459d5a47cefab10acf P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:07:20.822166 19481 raft_consensus.cc:1275] T ff9b0eddd810459b82d91c60777c10eb P 0473d2b2d01f4459b1e90fd12cc7840e [term 22 FOLLOWER]: Refusing update from remote peer e5256d91808b47c195bc9b4dbd7f2b87: Log matching property violated. Preceding OpId in replica: term: 20 index: 14. Preceding OpId from leader: term: 22 index: 15. (index mismatch)
I20260709 13:07:20.828969 19557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cdf56e38bbc453d9438d359e5a69955" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:07:20.829699 19557 raft_consensus.cc:2368] T 0cdf56e38bbc453d9438d359e5a69955 P e61c3a8f61bb48f8a963c9480e53c168 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e5256d91808b47c195bc9b4dbd7f2b87 for earlier term 20. Current term is 21.
I20260709 13:07:20.829615 19552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14935b3ddf914369822e4a0547aaa355" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:07:20.815822 26207 leader_election.cc:290] T 7f575b143b844aa096b50997dad3516a P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 19 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:07:20.831692 20110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65d8cb8d6ec64f459d5a47cefab10acf" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:07:20.832549 19554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f575b143b844aa096b50997dad3516a" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:07:20.817229 26295 leader_election.cc:290] T 14935b3ddf914369822e4a0547aaa355 P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:07:20.834520 19484 raft_consensus.cc:2468] T df751f992649444090e27965eb1af85d P 0473d2b2d01f4459b1e90fd12cc7840e [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 23.
I20260709 13:07:20.843657 19484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76cb037fc9064d13b59a8969d897ce8c" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 21 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:07:20.841346 19410 raft_consensus.cc:2468] T 5ec1c4ce15e04c7e8c283a62179f2a64 P e5256d91808b47c195bc9b4dbd7f2b87 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 15.
W20260709 13:07:20.842054 20078 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.2:46257, user_credentials={real_user=slave}} blocked reactor thread for 174939us
I20260709 13:07:20.846278 20076 leader_election.cc:304] T 14935b3ddf914369822e4a0547aaa355 P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 127766fc592545a4997f7790f50f6076; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168
W20260709 13:07:20.849805 19449 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.1:40321, user_credentials={real_user=slave}} blocked reactor thread for 169325us
I20260709 13:07:20.876802 19405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df751f992649444090e27965eb1af85d" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: true dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
I20260709 13:07:20.877494 19405 raft_consensus.cc:3060] T df751f992649444090e27965eb1af85d P e5256d91808b47c195bc9b4dbd7f2b87 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:07:20.880532 19407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f575b143b844aa096b50997dad3516a" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
I20260709 13:07:20.882503 19411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b08304a0a02b42d7840c4e8ee9a6bd1a" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:07:20.883440 19411 raft_consensus.cc:2368] T b08304a0a02b42d7840c4e8ee9a6bd1a P e5256d91808b47c195bc9b4dbd7f2b87 [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e61c3a8f61bb48f8a963c9480e53c168 for earlier term 22. Current term is 23.
I20260709 13:07:20.884428 19410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cdf56e38bbc453d9438d359e5a69955" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
I20260709 13:07:20.863791 26295 raft_consensus.cc:2749] T 14935b3ddf914369822e4a0547aaa355 P 127766fc592545a4997f7790f50f6076 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:07:20.862461 26326 consensus_queue.cc:1059] T 7f575b143b844aa096b50997dad3516a P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 }, Status: INVALID_TERM, Last received: 18.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.030s
I20260709 13:07:20.892570 26326 raft_consensus.cc:3055] T 7f575b143b844aa096b50997dad3516a P e5256d91808b47c195bc9b4dbd7f2b87 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:07:20.892980 26326 raft_consensus.cc:740] T 7f575b143b844aa096b50997dad3516a P e5256d91808b47c195bc9b4dbd7f2b87 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: e5256d91808b47c195bc9b4dbd7f2b87, State: Running, Role: LEADER
I20260709 13:07:20.893965 26416 raft_consensus.cc:2749] T 309c3ca0ca4b4f3ba129752ea2cb293b P 127766fc592545a4997f7790f50f6076 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:07:20.893777 26326 consensus_queue.cc:260] T 7f575b143b844aa096b50997dad3516a P e5256d91808b47c195bc9b4dbd7f2b87 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 18.12, Last appended by leader: 12, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
W20260709 13:07:20.896384 19377 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:20.897708 26326 raft_consensus.cc:3060] T 7f575b143b844aa096b50997dad3516a P e5256d91808b47c195bc9b4dbd7f2b87 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:07:20.897965 26379 raft_consensus.cc:515] T 76cb037fc9064d13b59a8969d897ce8c P 0473d2b2d01f4459b1e90fd12cc7840e [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:07:20.899632 19479 raft_consensus.cc:1240] T 76cb037fc9064d13b59a8969d897ce8c P 0473d2b2d01f4459b1e90fd12cc7840e [term 21 FOLLOWER]: Rejecting Update request from peer e61c3a8f61bb48f8a963c9480e53c168 for earlier term 20. Current term is 21. Ops: [20.11-20.11]
I20260709 13:07:20.899273 19303 catalog_manager.cc:5697] T 309c3ca0ca4b4f3ba129752ea2cb293b P 0473d2b2d01f4459b1e90fd12cc7840e reported cstate change: config changed from index 10 to 5, term changed from 12 to 11, leader changed from <none> to 127766fc592545a4997f7790f50f6076 (127.17.223.4), VOTER e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3) added, now has a pending config: VOTER e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1), VOTER 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2), VOTER 127766fc592545a4997f7790f50f6076 (127.17.223.4). New cstate: current_term: 11 leader_uuid: "127766fc592545a4997f7790f50f6076" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } attrs { replace: true } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } } } pending_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } } }
I20260709 13:07:20.901824 26379 leader_election.cc:290] T 76cb037fc9064d13b59a8969d897ce8c P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 21 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:07:20.905405 19554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76cb037fc9064d13b59a8969d897ce8c" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 21 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:07:20.882970 19526 leader_election.cc:304] T df751f992649444090e27965eb1af85d P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:07:20.909140 19404 raft_consensus.cc:1240] T 76cb037fc9064d13b59a8969d897ce8c P e5256d91808b47c195bc9b4dbd7f2b87 [term 21 FOLLOWER]: Rejecting Update request from peer e61c3a8f61bb48f8a963c9480e53c168 for earlier term 20. Current term is 21. Ops: [20.11-20.11]
I20260709 13:07:20.909395 20106 raft_consensus.cc:1275] T 0e1085d23e8347fbbd5bce7542f4b1f4 P 127766fc592545a4997f7790f50f6076 [term 18 FOLLOWER]: Refusing update from remote peer 0473d2b2d01f4459b1e90fd12cc7840e: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
I20260709 13:07:20.918792 19409 raft_consensus.cc:1217] T ff75a1d4cb1f493db8f71ddc136ba9ab P e5256d91808b47c195bc9b4dbd7f2b87 [term 21 FOLLOWER]: Deduplicated request from leader. Original: 19.10->[20.11-20.11]   Dedup: 20.11->[]
I20260709 13:07:20.923920 19405 raft_consensus.cc:2468] T df751f992649444090e27965eb1af85d P e5256d91808b47c195bc9b4dbd7f2b87 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 23.
I20260709 13:07:20.924520 19409 raft_consensus.cc:1240] T ff75a1d4cb1f493db8f71ddc136ba9ab P e5256d91808b47c195bc9b4dbd7f2b87 [term 21 FOLLOWER]: Rejecting Update request from peer e61c3a8f61bb48f8a963c9480e53c168 for earlier term 20. Current term is 21. Ops: [20.11-20.11]
I20260709 13:07:20.926115 19477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c5eebf646ad445a9d1b1adc319d7b16" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:07:20.927707 19478 raft_consensus.cc:1240] T 5ec1c4ce15e04c7e8c283a62179f2a64 P 0473d2b2d01f4459b1e90fd12cc7840e [term 15 LEADER]: Rejecting Update request from peer 127766fc592545a4997f7790f50f6076 for earlier term 14. Current term is 15. Ops: []
I20260709 13:07:20.933179 19404 raft_consensus.cc:1275] T 70797e5783b5454ab0d0eea663e791e3 P e5256d91808b47c195bc9b4dbd7f2b87 [term 23 FOLLOWER]: Refusing update from remote peer e61c3a8f61bb48f8a963c9480e53c168: Log matching property violated. Preceding OpId in replica: term: 22 index: 15. Preceding OpId from leader: term: 23 index: 16. (index mismatch)
I20260709 13:07:20.920756 26479 raft_consensus.cc:2804] T df751f992649444090e27965eb1af85d P e61c3a8f61bb48f8a963c9480e53c168 [term 23 FOLLOWER]: Leader election won for term 23
I20260709 13:07:20.959049 19484 raft_consensus.cc:1240] T f1b10566f45d4a7d9029858330e02d5b P 0473d2b2d01f4459b1e90fd12cc7840e [term 20 FOLLOWER]: Rejecting Update request from peer e5256d91808b47c195bc9b4dbd7f2b87 for earlier term 19. Current term is 20. Ops: []
I20260709 13:07:21.007140 19551 raft_consensus.cc:3060] T ff75a1d4cb1f493db8f71ddc136ba9ab P e61c3a8f61bb48f8a963c9480e53c168 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:07:21.007489 19477 raft_consensus.cc:2468] T 6c5eebf646ad445a9d1b1adc319d7b16 P 0473d2b2d01f4459b1e90fd12cc7840e [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 127766fc592545a4997f7790f50f6076 in term 19.
I20260709 13:07:20.902302 19303 catalog_manager.cc:5697] T e381f1d6b8184797ad142de49be225a8 P 0473d2b2d01f4459b1e90fd12cc7840e reported cstate change: term changed from 12 to 14. New cstate: current_term: 14 leader_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } }
I20260709 13:07:21.006426 26446 raft_consensus.cc:2749] T 0cdf56e38bbc453d9438d359e5a69955 P e5256d91808b47c195bc9b4dbd7f2b87 [term 21 FOLLOWER]: Leader pre-election lost for term 20. Reason: Vote denied by peer 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257) with higher term. Message: Invalid argument: T 0cdf56e38bbc453d9438d359e5a69955 P 0473d2b2d01f4459b1e90fd12cc7840e [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e5256d91808b47c195bc9b4dbd7f2b87 for earlier term 20. Current term is 21.
W20260709 13:07:21.020080 26578 log.cc:927] Time spent T 217b5fae677b4971b3bbd2f357a1f7ff P 0473d2b2d01f4459b1e90fd12cc7840e: Append to log took a long time: real 0.067s	user 0.000s	sys 0.000s
I20260709 13:07:21.022915 19547 tablet_service.cc:1558] Processing DeleteTablet for tablet 309c3ca0ca4b4f3ba129752ea2cb293b with delete_type TABLET_DATA_TOMBSTONED (Replica with old config index 5 (current committed config index is 10)) from {username='slave'} at 127.0.0.1:49904
I20260709 13:07:20.960510 26479 raft_consensus.cc:697] T df751f992649444090e27965eb1af85d P e61c3a8f61bb48f8a963c9480e53c168 [term 23 LEADER]: Becoming Leader. State: Replica: e61c3a8f61bb48f8a963c9480e53c168, State: Running, Role: LEADER
W20260709 13:07:21.025543 19307 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:44698 (request call id 234) took 40257 ms (client timeout 15000 ms). Trace:
W20260709 13:07:21.027128 19525 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:21.027964 19303 catalog_manager.cc:5697] T b08304a0a02b42d7840c4e8ee9a6bd1a P 0473d2b2d01f4459b1e90fd12cc7840e reported cstate change: term changed from 12 to 16. New cstate: current_term: 16 leader_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } health_report { overall_health: HEALTHY } } }
I20260709 13:07:21.033120 26532 raft_consensus.cc:493] T edd7d470b5014c9489be7f41f64355c9 P e61c3a8f61bb48f8a963c9480e53c168 [term 26 FOLLOWER]: Starting pre-election (detected failure of leader e5256d91808b47c195bc9b4dbd7f2b87)
I20260709 13:07:21.047606 19409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65d8cb8d6ec64f459d5a47cefab10acf" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:07:21.049144 19554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76cb037fc9064d13b59a8969d897ce8c" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 21 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
W20260709 13:07:21.040135 19307 rpcz_store.cc:269] 0709 13:06:40.767904 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:40.768121 (+   217us) service_pool.cc:224] Handling call
0709 13:07:21.025268 (+40257147us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:07:17.009497 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:07:17.057538 (+ 48041us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:07:17.057598 (+    60us) write_op.cc:435] Acquired schema lock
0709 13:07:17.057625 (+    27us) tablet.cc:662] Decoding operations
0709 13:07:17.058487 (+   862us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:07:17.058596 (+   109us) write_op.cc:641] Partition lock acquired for write op
0709 13:07:17.058635 (+    39us) tablet.cc:685] Acquiring locks for 5 operations
0709 13:07:17.059407 (+   772us) tablet.cc:701] Row locks acquired
0709 13:07:17.059473 (+    66us) write_op.cc:260] PREPARE: finished
0709 13:07:17.059670 (+   197us) write_op.cc:270] Start()
0709 13:07:17.059851 (+   181us) write_op.cc:276] Timestamp: P: 1783602437059594 usec, L: 0
0709 13:07:17.094079 (+ 34228us) op_driver.cc:348] REPLICATION: starting
0709 13:07:17.140994 (+ 46915us) log.cc:844] Serialized 2074 byte log entry
0709 13:07:18.345371 (+1204377us) op_driver.cc:464] REPLICATION: finished
0709 13:07:18.633248 (+287877us) write_op.cc:301] APPLY: starting
0709 13:07:18.651065 (+ 17817us) tablet.cc:1367] starting BulkCheckPresence
0709 13:07:18.984727 (+333662us) tablet.cc:1370] finished BulkCheckPresence
0709 13:07:18.984880 (+   153us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:07:18.989492 (+  4612us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:07:18.989723 (+   231us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=10,key_file_lookups=10,delta_file_lookups=10,mrs_lookups=0
0709 13:07:18.989765 (+    42us) write_op.cc:312] APPLY: finished
0709 13:07:18.989999 (+   234us) log.cc:844] Serialized 57 byte log entry
0709 13:07:18.990175 (+   176us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:07:18.990285 (+   110us) write_op.cc:454] Released schema lock
0709 13:07:18.990325 (+    40us) write_op.cc:341] FINISH: Updating metrics
0709 13:07:18.990773 (+   448us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:07:18.990803 (+    30us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":561770,"reported_tablets":51,"child_traces":[["op",{"apply.queue_time_us":214257,"apply.run_cpu_time_us":23310,"apply.run_wall_time_us":399101,"cfile_cache_hit":22,"cfile_cache_hit_bytes":25027,"num_ops":5,"prepare.queue_time_us":196892,"prepare.run_cpu_time_us":36197,"prepare.run_wall_time_us":603203,"raft.queue_time_us":362419,"raft.run_cpu_time_us":13832,"raft.run_wall_time_us":149408,"replication_time_us":1228371,"thread_start_us":804772,"threads_started":4,"wal-append.queue_time_us":471173,"wal-append.run_cpu_time_us":16569,"wal-append.run_wall_time_us":2403374}]]}
W20260709 13:07:21.070864 26573 log.cc:927] Time spent T ab43d85f64114d4ebf618930e43d9ed0 P 127766fc592545a4997f7790f50f6076: Append to log took a long time: real 0.145s	user 0.001s	sys 0.000s
I20260709 13:07:21.071570 26479 consensus_queue.cc:237] T df751f992649444090e27965eb1af85d P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 22.14, Last appended by leader: 14, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
W20260709 13:07:21.079823 26540 consensus_meta.cc:287] T 70797e5783b5454ab0d0eea663e791e3 P 127766fc592545a4997f7790f50f6076: Time spent flushing consensus metadata: real 0.508s	user 0.009s	sys 0.001s
I20260709 13:07:21.016501 26154 raft_consensus.cc:493] T e381f1d6b8184797ad142de49be225a8 P e5256d91808b47c195bc9b4dbd7f2b87 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 0473d2b2d01f4459b1e90fd12cc7840e)
I20260709 13:07:20.958361 26228 raft_consensus.cc:515] T 6c5eebf646ad445a9d1b1adc319d7b16 P e61c3a8f61bb48f8a963c9480e53c168 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:07:21.088093 19405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a08760e15aac4630a629431f56024dc8" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 24 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:07:21.088754 19410 raft_consensus.cc:2468] T 0cdf56e38bbc453d9438d359e5a69955 P e5256d91808b47c195bc9b4dbd7f2b87 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 21.
I20260709 13:07:21.130463 19553 raft_consensus.cc:2368] T 6c5eebf646ad445a9d1b1adc319d7b16 P e61c3a8f61bb48f8a963c9480e53c168 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 127766fc592545a4997f7790f50f6076 for earlier term 19. Current term is 20.
I20260709 13:07:21.098220 26564 consensus_queue.cc:1048] T ff9b0eddd810459b82d91c60777c10eb P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.032s
I20260709 13:07:21.131572 26228 leader_election.cc:290] T 6c5eebf646ad445a9d1b1adc319d7b16 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 20 election: Requested vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:07:21.092648 26534 raft_consensus.cc:493] T 40e1e16737a842ee936002830f36882e P e61c3a8f61bb48f8a963c9480e53c168 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader e5256d91808b47c195bc9b4dbd7f2b87)
I20260709 13:07:21.132828 26154 raft_consensus.cc:515] T e381f1d6b8184797ad142de49be225a8 P e5256d91808b47c195bc9b4dbd7f2b87 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:07:21.133590 26534 raft_consensus.cc:515] T 40e1e16737a842ee936002830f36882e P e61c3a8f61bb48f8a963c9480e53c168 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:07:21.107350 26326 raft_consensus.cc:493] T fa8650e71aa14778b3d73721fc50d9fc P e5256d91808b47c195bc9b4dbd7f2b87 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader e61c3a8f61bb48f8a963c9480e53c168)
I20260709 13:07:21.135546 26154 leader_election.cc:290] T e381f1d6b8184797ad142de49be225a8 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:07:21.135782 26326 raft_consensus.cc:515] T fa8650e71aa14778b3d73721fc50d9fc P e5256d91808b47c195bc9b4dbd7f2b87 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:07:21.136518 26534 leader_election.cc:290] T 40e1e16737a842ee936002830f36882e P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:07:21.136798 26540 raft_consensus.cc:515] T 70797e5783b5454ab0d0eea663e791e3 P 127766fc592545a4997f7790f50f6076 [term 24 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:07:21.138281 20105 raft_consensus.cc:1240] T 70797e5783b5454ab0d0eea663e791e3 P 127766fc592545a4997f7790f50f6076 [term 24 FOLLOWER]: Rejecting Update request from peer e61c3a8f61bb48f8a963c9480e53c168 for earlier term 23. Current term is 24. Ops: [23.16-23.16]
I20260709 13:07:21.139236 26540 leader_election.cc:290] T 70797e5783b5454ab0d0eea663e791e3 P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 24 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
W20260709 13:07:21.091652 20077 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:21.139936 26326 leader_election.cc:290] T fa8650e71aa14778b3d73721fc50d9fc P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:07:21.094589 20078 leader_election.cc:304] T 6c5eebf646ad445a9d1b1adc319d7b16 P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, 127766fc592545a4997f7790f50f6076; no voters: 
I20260709 13:07:21.140065 26532 raft_consensus.cc:515] T edd7d470b5014c9489be7f41f64355c9 P e61c3a8f61bb48f8a963c9480e53c168 [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:07:21.140744 20076 leader_election.cc:400] T 6c5eebf646ad445a9d1b1adc319d7b16 P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 19 election: Vote denied by peer e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891) with higher term. Message: Invalid argument: T 6c5eebf646ad445a9d1b1adc319d7b16 P e61c3a8f61bb48f8a963c9480e53c168 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 127766fc592545a4997f7790f50f6076 for earlier term 19. Current term is 20.
I20260709 13:07:21.141307 19405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70797e5783b5454ab0d0eea663e791e3" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 24 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
I20260709 13:07:21.128666 19375 leader_election.cc:400] T 21e14947d70440f19044d8f75c31e1f9 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 21 pre-election: Vote denied by peer e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891) with higher term. Message: Invalid argument: T 21e14947d70440f19044d8f75c31e1f9 P e61c3a8f61bb48f8a963c9480e53c168 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e5256d91808b47c195bc9b4dbd7f2b87 for earlier term 21. Current term is 22.
W20260709 13:07:21.141921 20078 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.2:46257, user_credentials={real_user=slave}} blocked reactor thread for 47419us
W20260709 13:07:21.142509 19375 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.3:36891, user_credentials={real_user=slave}} blocked reactor thread for 51914.5us
I20260709 13:07:21.144501 19375 leader_election.cc:304] T b08304a0a02b42d7840c4e8ee9a6bd1a P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:07:21.141921 19405 raft_consensus.cc:3060] T 70797e5783b5454ab0d0eea663e791e3 P e5256d91808b47c195bc9b4dbd7f2b87 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:07:21.154820 19375 leader_election.cc:304] T f93ee515a9c14139bf566522ed8232f3 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168; no voters: 0473d2b2d01f4459b1e90fd12cc7840e
I20260709 13:07:21.158491 19375 leader_election.cc:400] T 0cdf56e38bbc453d9438d359e5a69955 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 20 pre-election: Vote denied by peer e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891) with higher term. Message: Invalid argument: T 0cdf56e38bbc453d9438d359e5a69955 P e61c3a8f61bb48f8a963c9480e53c168 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e5256d91808b47c195bc9b4dbd7f2b87 for earlier term 20. Current term is 21.
W20260709 13:07:21.126806 26580 log.cc:927] Time spent T 21e14947d70440f19044d8f75c31e1f9 P 0473d2b2d01f4459b1e90fd12cc7840e: Append to log took a long time: real 0.057s	user 0.000s	sys 0.003s
I20260709 13:07:21.140439 19303 catalog_manager.cc:5697] T 22196caba61445d3bec98a0aab3c337d P 0473d2b2d01f4459b1e90fd12cc7840e reported cstate change: term changed from 13 to 14, leader changed from e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3) to 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2). New cstate: current_term: 14 leader_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:21.190805 20110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c5eebf646ad445a9d1b1adc319d7b16" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076"
W20260709 13:07:21.191253 20076 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.3:36891, user_credentials={real_user=slave}} blocked reactor thread for 58346us
W20260709 13:07:21.127105 26589 log.cc:927] Time spent T b08304a0a02b42d7840c4e8ee9a6bd1a P 0473d2b2d01f4459b1e90fd12cc7840e: Append to log took a long time: real 0.169s	user 0.004s	sys 0.000s
I20260709 13:07:21.194732 19559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70797e5783b5454ab0d0eea663e791e3" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 24 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:07:21.164217 26289 raft_consensus.cc:2804] T f93ee515a9c14139bf566522ed8232f3 P e5256d91808b47c195bc9b4dbd7f2b87 [term 24 FOLLOWER]: Leader election won for term 24
I20260709 13:07:21.198333 19405 raft_consensus.cc:2468] T 70797e5783b5454ab0d0eea663e791e3 P e5256d91808b47c195bc9b4dbd7f2b87 [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 127766fc592545a4997f7790f50f6076 in term 24.
I20260709 13:07:21.229188 19551 raft_consensus.cc:1275] T ff75a1d4cb1f493db8f71ddc136ba9ab P e61c3a8f61bb48f8a963c9480e53c168 [term 21 FOLLOWER]: Refusing update from remote peer 0473d2b2d01f4459b1e90fd12cc7840e: Log matching property violated. Preceding OpId in replica: term: 20 index: 11. Preceding OpId from leader: term: 21 index: 11. (term mismatch)
I20260709 13:07:21.156279 26564 raft_consensus.cc:2749] T b08304a0a02b42d7840c4e8ee9a6bd1a P e5256d91808b47c195bc9b4dbd7f2b87 [term 23 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:07:21.548352 26154 raft_consensus.cc:493] T 85c494af21f9457a85da47b9bc70c1fd P e5256d91808b47c195bc9b4dbd7f2b87 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:21.190847 26545 raft_consensus.cc:2804] T 6c5eebf646ad445a9d1b1adc319d7b16 P 127766fc592545a4997f7790f50f6076 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:07:21.156435 26534 consensus_queue.cc:1059] T 70797e5783b5454ab0d0eea663e791e3 P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false }, Status: INVALID_TERM, Last received: 22.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.097s
I20260709 13:07:21.548903 26154 raft_consensus.cc:515] T 85c494af21f9457a85da47b9bc70c1fd P e5256d91808b47c195bc9b4dbd7f2b87 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:07:21.549674 26534 raft_consensus.cc:3055] T 70797e5783b5454ab0d0eea663e791e3 P e61c3a8f61bb48f8a963c9480e53c168 [term 23 LEADER]: Stepping down as leader of term 23
I20260709 13:07:21.550034 26534 raft_consensus.cc:740] T 70797e5783b5454ab0d0eea663e791e3 P e61c3a8f61bb48f8a963c9480e53c168 [term 23 LEADER]: Becoming Follower/Learner. State: Replica: e61c3a8f61bb48f8a963c9480e53c168, State: Running, Role: LEADER
I20260709 13:07:21.205402 20075 leader_election.cc:304] T 70797e5783b5454ab0d0eea663e791e3 P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 127766fc592545a4997f7790f50f6076, e5256d91808b47c195bc9b4dbd7f2b87; no voters: e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:07:21.202881 26228 raft_consensus.cc:493] T 85c494af21f9457a85da47b9bc70c1fd P e61c3a8f61bb48f8a963c9480e53c168 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:21.555675 19375 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.3:36891, user_credentials={real_user=slave}} blocked reactor thread for 395108us
W20260709 13:07:21.547737 19525 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:21.548106 19551 pending_rounds.cc:85] T ff75a1d4cb1f493db8f71ddc136ba9ab P e61c3a8f61bb48f8a963c9480e53c168: Aborting all ops after (but not including) 10
I20260709 13:07:21.548381 26416 raft_consensus.cc:493] T 85c494af21f9457a85da47b9bc70c1fd P 127766fc592545a4997f7790f50f6076 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:21.564342 19450 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.3:36891, user_credentials={real_user=slave}} blocked reactor thread for 507815us
I20260709 13:07:21.564241 26416 raft_consensus.cc:515] T 85c494af21f9457a85da47b9bc70c1fd P 127766fc592545a4997f7790f50f6076 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:07:21.565060 26448 raft_consensus.cc:493] T 2725d2c4cb054f18b0fc8f735c15f6c2 P e5256d91808b47c195bc9b4dbd7f2b87 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 0473d2b2d01f4459b1e90fd12cc7840e)
I20260709 13:07:21.565541 26448 raft_consensus.cc:515] T 2725d2c4cb054f18b0fc8f735c15f6c2 P e5256d91808b47c195bc9b4dbd7f2b87 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
W20260709 13:07:21.568471 20077 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:21.569191 19478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a08760e15aac4630a629431f56024dc8" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 24 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:07:21.561856 26154 leader_election.cc:290] T 85c494af21f9457a85da47b9bc70c1fd P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:07:21.570425 19481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c5eebf646ad445a9d1b1adc319d7b16" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:07:21.571137 19375 leader_election.cc:304] T 76cb037fc9064d13b59a8969d897ce8c P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:07:21.571398 19481 raft_consensus.cc:3060] T 6c5eebf646ad445a9d1b1adc319d7b16 P 0473d2b2d01f4459b1e90fd12cc7840e [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:07:21.572448 19477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40e1e16737a842ee936002830f36882e" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 24 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:07:21.572732 26564 raft_consensus.cc:2749] T 76cb037fc9064d13b59a8969d897ce8c P e5256d91808b47c195bc9b4dbd7f2b87 [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 13:07:21.566411 26416 leader_election.cc:290] T 85c494af21f9457a85da47b9bc70c1fd P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:07:21.554893 26534 consensus_queue.cc:260] T 70797e5783b5454ab0d0eea663e791e3 P e61c3a8f61bb48f8a963c9480e53c168 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 23.16, Last appended by leader: 16, Current term: 23, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:07:21.576309 20105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85c494af21f9457a85da47b9bc70c1fd" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:07:21.576468 26416 raft_consensus.cc:2804] T 70797e5783b5454ab0d0eea663e791e3 P 127766fc592545a4997f7790f50f6076 [term 24 FOLLOWER]: Leader election won for term 24
I20260709 13:07:21.576898 20105 raft_consensus.cc:2468] T 85c494af21f9457a85da47b9bc70c1fd P 127766fc592545a4997f7790f50f6076 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 20.
I20260709 13:07:21.576977 26416 raft_consensus.cc:697] T 70797e5783b5454ab0d0eea663e791e3 P 127766fc592545a4997f7790f50f6076 [term 24 LEADER]: Becoming Leader. State: Replica: 127766fc592545a4997f7790f50f6076, State: Running, Role: LEADER
I20260709 13:07:21.578279 19482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e381f1d6b8184797ad142de49be225a8" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:07:21.579430 19486 raft_consensus.cc:1275] T 0afb57ae58a24a01850491d69f0213dd P 0473d2b2d01f4459b1e90fd12cc7840e [term 13 FOLLOWER]: Refusing update from remote peer e61c3a8f61bb48f8a963c9480e53c168: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:07:21.581470 26448 leader_election.cc:290] T 2725d2c4cb054f18b0fc8f735c15f6c2 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:07:21.582178 19478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa8650e71aa14778b3d73721fc50d9fc" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:07:21.583897 19523 leader_election.cc:400] T b08304a0a02b42d7840c4e8ee9a6bd1a P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 22 pre-election: Vote denied by peer e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321) with higher term. Message: Invalid argument: T b08304a0a02b42d7840c4e8ee9a6bd1a P e5256d91808b47c195bc9b4dbd7f2b87 [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e61c3a8f61bb48f8a963c9480e53c168 for earlier term 22. Current term is 23.
I20260709 13:07:21.577948 26416 consensus_queue.cc:237] T 70797e5783b5454ab0d0eea663e791e3 P 127766fc592545a4997f7790f50f6076 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 22.15, Last appended by leader: 15, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:07:21.585343 19481 raft_consensus.cc:2468] T 6c5eebf646ad445a9d1b1adc319d7b16 P 0473d2b2d01f4459b1e90fd12cc7840e [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 20.
I20260709 13:07:21.589794 19405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40e1e16737a842ee936002830f36882e" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 24 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:07:21.584396 19523 leader_election.cc:403] T b08304a0a02b42d7840c4e8ee9a6bd1a P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 22 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:07:21.570261 26512 raft_consensus.cc:493] T 1f85fc4b527a48848e5faa083b604e36 P 0473d2b2d01f4459b1e90fd12cc7840e [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:21.561369 19551 pending_rounds.cc:107] T ff75a1d4cb1f493db8f71ddc136ba9ab P e61c3a8f61bb48f8a963c9480e53c168: Aborting uncommitted NO_OP operation due to leader change: 20.11
I20260709 13:07:21.627632 19551 raft_consensus.cc:2889] T ff75a1d4cb1f493db8f71ddc136ba9ab P e61c3a8f61bb48f8a963c9480e53c168 [term 21 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:07:21.599797 26289 raft_consensus.cc:697] T f93ee515a9c14139bf566522ed8232f3 P e5256d91808b47c195bc9b4dbd7f2b87 [term 24 LEADER]: Becoming Leader. State: Replica: e5256d91808b47c195bc9b4dbd7f2b87, State: Running, Role: LEADER
I20260709 13:07:21.634948 19410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edd7d470b5014c9489be7f41f64355c9" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 27 candidate_status { last_received { term: 24 index: 13 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:07:21.635092 26289 consensus_queue.cc:237] T f93ee515a9c14139bf566522ed8232f3 P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 23.12, Last appended by leader: 12, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:07:21.642021 19553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e381f1d6b8184797ad142de49be225a8" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:07:21.642179 19558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85c494af21f9457a85da47b9bc70c1fd" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:07:21.647357 19557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2725d2c4cb054f18b0fc8f735c15f6c2" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 22 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:07:21.660856 19551 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40428 (request call id 3535) took 1682 ms. Trace:
I20260709 13:07:21.661680 19551 rpcz_store.cc:276] 0709 13:07:19.957707 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:19.957873 (+   166us) service_pool.cc:224] Handling call
0709 13:07:19.991727 (+ 33854us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:20.655175 (+663448us) spinlock_profiling.cc:243] Waited 32.6 ms on lock 0x7b54003794a0. stack: 00007f4a79de9343 00007f4a79de9240 00007f4a797781d4 00007f4a834b6304 00007f4a834b6299 00007f4a7ce71571 00007f4a7ce7fdc0 00007f4a7cf0a1c0 00007f4a7cf0b231 00007f4a7cf07d8f 00007f4a7cf0783e 00007f4a81ecc419 00007f4a7b443bd4 00007f4a7b443b62 00007f4a7b443a91 00007f4a7b443a0c
0709 13:07:20.707927 (+ 52752us) spinlock_profiling.cc:243] Waited 11.9 ms on lock 0x7b4c00114f00. stack: 00007f4a79de9343 00007f4a79de9240 00007f4a797781d4 00007f4a834b6304 00007f4a834b6299 00007f4a7b1d4a20 00007f4a7b1e5a29 00007f4a7b1ab644 00007f4a7b1d2f2d 00007f4a7b1d2b93 00007f4a7cf0318b 00007f4a7cf03cb5 00007f4a7cefef30 00007f4a7cf007de 00007f4a7cf0ab49 00007f4a7cf0b416
0709 13:07:20.960417 (+252490us) spinlock_profiling.cc:243] Waited 50.4 ms on lock 0x7b58005df8d0. stack: 00007f4a79de9343 00007f4a79de9240 00007f4a797781d4 00007f4a834b6304 00007f4a834b6299 00007f4a7ce71571 00007f4a7ce640aa 00007f4a7cee6447 00007f4a7cefefe7 00007f4a7cf007de 00007f4a7cf0ab49 00007f4a7cf0b416 00007f4a7cf07d8f 00007f4a7cf0783e 00007f4a81ecc419 00007f4a7b443bd4
0709 13:07:21.639415 (+678998us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:21.639598 (+   183us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":218329344}
I20260709 13:07:21.680755 19560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa8650e71aa14778b3d73721fc50d9fc" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:07:21.639200 25851 raft_consensus.cc:2749] T b08304a0a02b42d7840c4e8ee9a6bd1a P e61c3a8f61bb48f8a963c9480e53c168 [term 23 FOLLOWER]: Leader pre-election lost for term 22. Reason: Vote denied by peer e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321) with higher term. Message: Invalid argument: T b08304a0a02b42d7840c4e8ee9a6bd1a P e5256d91808b47c195bc9b4dbd7f2b87 [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e61c3a8f61bb48f8a963c9480e53c168 for earlier term 22. Current term is 23.
W20260709 13:07:21.668365 26560 log.cc:927] Time spent T 217b5fae677b4971b3bbd2f357a1f7ff P e5256d91808b47c195bc9b4dbd7f2b87: Append to log took a long time: real 0.085s	user 0.000s	sys 0.000s
I20260709 13:07:21.650831 26470 raft_consensus.cc:493] T 62c6c134d3d24a1ab144dd9ee6bc3f64 P e61c3a8f61bb48f8a963c9480e53c168 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 127766fc592545a4997f7790f50f6076)
I20260709 13:07:21.698354 26529 raft_consensus.cc:493] T 0e1085d23e8347fbbd5bce7542f4b1f4 P 127766fc592545a4997f7790f50f6076 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:21.699009 26529 raft_consensus.cc:515] T 0e1085d23e8347fbbd5bce7542f4b1f4 P 127766fc592545a4997f7790f50f6076 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:07:21.701290 26529 leader_election.cc:290] T 0e1085d23e8347fbbd5bce7542f4b1f4 P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:07:21.584134 26228 raft_consensus.cc:515] T 85c494af21f9457a85da47b9bc70c1fd P e61c3a8f61bb48f8a963c9480e53c168 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
W20260709 13:07:21.667594 26478 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 21 current term: 21 is higher.
W20260709 13:07:21.725550 19526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.2:46257, user_credentials={real_user=slave}} blocked reactor thread for 138178us
I20260709 13:07:21.703343 26555 consensus_queue.cc:1059] T 76cb037fc9064d13b59a8969d897ce8c P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 }, Status: INVALID_TERM, Last received: 18.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:07:21.686355 26532 leader_election.cc:290] T edd7d470b5014c9489be7f41f64355c9 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
W20260709 13:07:21.691030 26557 log.cc:927] Time spent T 22196caba61445d3bec98a0aab3c337d P e5256d91808b47c195bc9b4dbd7f2b87: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
I20260709 13:07:21.638586 26512 raft_consensus.cc:515] T 1f85fc4b527a48848e5faa083b604e36 P 0473d2b2d01f4459b1e90fd12cc7840e [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:07:21.739804 19558 raft_consensus.cc:2468] T 85c494af21f9457a85da47b9bc70c1fd P e61c3a8f61bb48f8a963c9480e53c168 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 20.
I20260709 13:07:21.726392 26577 raft_consensus.cc:493] T 309c3ca0ca4b4f3ba129752ea2cb293b P 0473d2b2d01f4459b1e90fd12cc7840e [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:21.746778 26574 raft_consensus.cc:493] T f93ee515a9c14139bf566522ed8232f3 P 0473d2b2d01f4459b1e90fd12cc7840e [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:21.747413 26574 raft_consensus.cc:515] T f93ee515a9c14139bf566522ed8232f3 P 0473d2b2d01f4459b1e90fd12cc7840e [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:07:21.749841 26574 leader_election.cc:290] T f93ee515a9c14139bf566522ed8232f3 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:07:21.752972 26531 raft_consensus.cc:493] T 28af091831594f9d8e96482078cc7625 P e5256d91808b47c195bc9b4dbd7f2b87 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader e61c3a8f61bb48f8a963c9480e53c168)
I20260709 13:07:21.753753 26531 raft_consensus.cc:515] T 28af091831594f9d8e96482078cc7625 P e5256d91808b47c195bc9b4dbd7f2b87 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:07:21.756332 26531 leader_election.cc:290] T 28af091831594f9d8e96482078cc7625 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:07:21.757264 26512 leader_election.cc:290] T 1f85fc4b527a48848e5faa083b604e36 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:07:21.759524 25851 raft_consensus.cc:3055] T 76cb037fc9064d13b59a8969d897ce8c P e61c3a8f61bb48f8a963c9480e53c168 [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:07:21.759931 25851 raft_consensus.cc:740] T 76cb037fc9064d13b59a8969d897ce8c P e61c3a8f61bb48f8a963c9480e53c168 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: e61c3a8f61bb48f8a963c9480e53c168, State: Running, Role: LEADER
I20260709 13:07:21.760759 25851 consensus_queue.cc:260] T 76cb037fc9064d13b59a8969d897ce8c P e61c3a8f61bb48f8a963c9480e53c168 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 20.11, Last appended by leader: 11, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:07:21.760990 19377 leader_election.cc:304] T e381f1d6b8184797ad142de49be225a8 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:07:21.762017 25851 raft_consensus.cc:3060] T 76cb037fc9064d13b59a8969d897ce8c P e61c3a8f61bb48f8a963c9480e53c168 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:07:21.762825 26288 raft_consensus.cc:2749] T e381f1d6b8184797ad142de49be225a8 P e5256d91808b47c195bc9b4dbd7f2b87 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 13:07:21.789238 19450 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.3:36891, user_credentials={real_user=slave}} blocked reactor thread for 139026us
I20260709 13:07:21.731930 19303 catalog_manager.cc:5697] T 6c5eebf646ad445a9d1b1adc319d7b16 P 0473d2b2d01f4459b1e90fd12cc7840e reported cstate change: term changed from 14 to 16. New cstate: current_term: 16 leader_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:21.808486 19551 raft_consensus.cc:1275] T 0cdf56e38bbc453d9438d359e5a69955 P e61c3a8f61bb48f8a963c9480e53c168 [term 21 FOLLOWER]: Refusing update from remote peer 0473d2b2d01f4459b1e90fd12cc7840e: Log matching property violated. Preceding OpId in replica: term: 19 index: 13. Preceding OpId from leader: term: 21 index: 14. (index mismatch)
W20260709 13:07:21.809707 20075 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.1:40321, user_credentials={real_user=slave}} blocked reactor thread for 604345us
I20260709 13:07:21.698536 26470 raft_consensus.cc:515] T 62c6c134d3d24a1ab144dd9ee6bc3f64 P e61c3a8f61bb48f8a963c9480e53c168 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
W20260709 13:07:21.809134 19449 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.4:43121, user_credentials={real_user=slave}} blocked reactor thread for 75807.1us
I20260709 13:07:21.809268 19481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2725d2c4cb054f18b0fc8f735c15f6c2" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 22 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:07:21.814771 19479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28af091831594f9d8e96482078cc7625" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:07:21.818614 19560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f93ee515a9c14139bf566522ed8232f3" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 25 candidate_status { last_received { term: 23 index: 12 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:07:21.812456 19449 leader_election.cc:304] T 7f575b143b844aa096b50997dad3516a P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e; no voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:07:21.824975 19557 raft_consensus.cc:1275] T b08304a0a02b42d7840c4e8ee9a6bd1a P e61c3a8f61bb48f8a963c9480e53c168 [term 23 FOLLOWER]: Refusing update from remote peer 0473d2b2d01f4459b1e90fd12cc7840e: Log matching property violated. Preceding OpId in replica: term: 21 index: 12. Preceding OpId from leader: term: 23 index: 13. (index mismatch)
I20260709 13:07:21.825205 19377 leader_election.cc:304] T 2725d2c4cb054f18b0fc8f735c15f6c2 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:07:21.821209 19560 raft_consensus.cc:2468] T f93ee515a9c14139bf566522ed8232f3 P e61c3a8f61bb48f8a963c9480e53c168 [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 24.
I20260709 13:07:21.837797 19551 raft_consensus.cc:1275] T 21e14947d70440f19044d8f75c31e1f9 P e61c3a8f61bb48f8a963c9480e53c168 [term 22 FOLLOWER]: Refusing update from remote peer 0473d2b2d01f4459b1e90fd12cc7840e: Log matching property violated. Preceding OpId in replica: term: 20 index: 13. Preceding OpId from leader: term: 22 index: 14. (index mismatch)
I20260709 13:07:21.838547 19478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e1085d23e8347fbbd5bce7542f4b1f4" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 19 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
W20260709 13:07:21.840811 19523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.1:40321, user_credentials={real_user=slave}} blocked reactor thread for 180437us
I20260709 13:07:21.843333 19479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edd7d470b5014c9489be7f41f64355c9" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 27 candidate_status { last_received { term: 24 index: 13 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:07:21.832682 26531 raft_consensus.cc:2749] T 2725d2c4cb054f18b0fc8f735c15f6c2 P e5256d91808b47c195bc9b4dbd7f2b87 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:07:21.852195 19450 leader_election.cc:304] T f93ee515a9c14139bf566522ed8232f3 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:07:21.798120 26577 raft_consensus.cc:515] T 309c3ca0ca4b4f3ba129752ea2cb293b P 0473d2b2d01f4459b1e90fd12cc7840e [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:07:21.843720 26574 raft_consensus.cc:2749] T 7f575b143b844aa096b50997dad3516a P 0473d2b2d01f4459b1e90fd12cc7840e [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:07:21.810696 26316 consensus_queue.cc:1048] T ff75a1d4cb1f493db8f71ddc136ba9ab P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.037s
I20260709 13:07:21.919407 20106 raft_consensus.cc:1275] T 5ec1c4ce15e04c7e8c283a62179f2a64 P 127766fc592545a4997f7790f50f6076 [term 15 FOLLOWER]: Refusing update from remote peer 0473d2b2d01f4459b1e90fd12cc7840e: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 13:07:21.814620 26241 consensus_queue.cc:1048] T 0e1085d23e8347fbbd5bce7542f4b1f4 P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Connected to new peer: Peer: permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.037s
I20260709 13:07:21.886229 19374 leader_election.cc:304] T 85c494af21f9457a85da47b9bc70c1fd P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 127766fc592545a4997f7790f50f6076, e5256d91808b47c195bc9b4dbd7f2b87; no voters: 
I20260709 13:07:21.939283 26434 consensus_queue.cc:1048] T 21e14947d70440f19044d8f75c31e1f9 P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:07:21.854612 26428 consensus_queue.cc:1048] T b08304a0a02b42d7840c4e8ee9a6bd1a P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.086s
W20260709 13:07:21.938362 26575 log.cc:927] Time spent T edd7d470b5014c9489be7f41f64355c9 P 0473d2b2d01f4459b1e90fd12cc7840e: Append to log took a long time: real 0.089s	user 0.000s	sys 0.001s
I20260709 13:07:21.942948 19404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76cb037fc9064d13b59a8969d897ce8c" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 21 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
I20260709 13:07:21.927868 26512 raft_consensus.cc:2804] T f93ee515a9c14139bf566522ed8232f3 P 0473d2b2d01f4459b1e90fd12cc7840e [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 13:07:21.943625 26512 raft_consensus.cc:493] T f93ee515a9c14139bf566522ed8232f3 P 0473d2b2d01f4459b1e90fd12cc7840e [term 24 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:21.943807 19404 raft_consensus.cc:2393] T 76cb037fc9064d13b59a8969d897ce8c P e5256d91808b47c195bc9b4dbd7f2b87 [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate 0473d2b2d01f4459b1e90fd12cc7840e in current term 21: Already voted for candidate e5256d91808b47c195bc9b4dbd7f2b87 in this term.
I20260709 13:07:21.944010 26512 raft_consensus.cc:3060] T f93ee515a9c14139bf566522ed8232f3 P 0473d2b2d01f4459b1e90fd12cc7840e [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:07:21.849830 26382 consensus_queue.cc:1048] T 0cdf56e38bbc453d9438d359e5a69955 P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 11, Time since last communication: 0.095s
I20260709 13:07:21.949050 26577 leader_election.cc:290] T 309c3ca0ca4b4f3ba129752ea2cb293b P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:07:21.952329 26470 leader_election.cc:290] T 62c6c134d3d24a1ab144dd9ee6bc3f64 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:07:21.956329 19303 catalog_manager.cc:5697] T 86a6797bdfe94fa496c050ceae4bd0d9 P 0473d2b2d01f4459b1e90fd12cc7840e reported cstate change: term changed from 10 to 12. New cstate: current_term: 12 leader_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:21.929018 26544 consensus_queue.cc:1048] T 0afb57ae58a24a01850491d69f0213dd P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.035s
I20260709 13:07:21.927042 19526 leader_election.cc:304] T 6c5eebf646ad445a9d1b1adc319d7b16 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
W20260709 13:07:21.973552 19374 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.4:43121, user_credentials={real_user=slave}} blocked reactor thread for 87458.2us
I20260709 13:07:21.975562 19405 raft_consensus.cc:1275] T 21e14947d70440f19044d8f75c31e1f9 P e5256d91808b47c195bc9b4dbd7f2b87 [term 22 FOLLOWER]: Refusing update from remote peer 0473d2b2d01f4459b1e90fd12cc7840e: Log matching property violated. Preceding OpId in replica: term: 20 index: 13. Preceding OpId from leader: term: 22 index: 14. (index mismatch)
I20260709 13:07:21.976475 25851 raft_consensus.cc:2804] T 6c5eebf646ad445a9d1b1adc319d7b16 P e61c3a8f61bb48f8a963c9480e53c168 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:07:21.976917 25851 raft_consensus.cc:697] T 6c5eebf646ad445a9d1b1adc319d7b16 P e61c3a8f61bb48f8a963c9480e53c168 [term 20 LEADER]: Becoming Leader. State: Replica: e61c3a8f61bb48f8a963c9480e53c168, State: Running, Role: LEADER
W20260709 13:07:21.975016 19526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.2:46257, user_credentials={real_user=slave}} blocked reactor thread for 76185.5us
I20260709 13:07:21.982276 19404 raft_consensus.cc:1275] T b08304a0a02b42d7840c4e8ee9a6bd1a P e5256d91808b47c195bc9b4dbd7f2b87 [term 23 FOLLOWER]: Refusing update from remote peer 0473d2b2d01f4459b1e90fd12cc7840e: Log matching property violated. Preceding OpId in replica: term: 21 index: 12. Preceding OpId from leader: term: 23 index: 13. (index mismatch)
I20260709 13:07:21.985790 19294 catalog_manager.cc:5028] TS e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891): tablet 309c3ca0ca4b4f3ba129752ea2cb293b (table test-workload [id=ce1025c73cf04c4baf25820ae7ff0a53]) successfully deleted
I20260709 13:07:21.986696 19483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62c6c134d3d24a1ab144dd9ee6bc3f64" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:07:21.987694 25851 consensus_queue.cc:237] T 6c5eebf646ad445a9d1b1adc319d7b16 P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 18.13, Last appended by leader: 13, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:07:21.968060 26540 raft_consensus.cc:493] T 1f85fc4b527a48848e5faa083b604e36 P 127766fc592545a4997f7790f50f6076 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:21.968393 26228 leader_election.cc:290] T 85c494af21f9457a85da47b9bc70c1fd P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:07:21.979765 26289 raft_consensus.cc:2804] T 85c494af21f9457a85da47b9bc70c1fd P e5256d91808b47c195bc9b4dbd7f2b87 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:07:22.011406 20108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f85fc4b527a48848e5faa083b604e36" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:07:22.016332 19409 raft_consensus.cc:1275] T 0cdf56e38bbc453d9438d359e5a69955 P e5256d91808b47c195bc9b4dbd7f2b87 [term 21 FOLLOWER]: Refusing update from remote peer 0473d2b2d01f4459b1e90fd12cc7840e: Log matching property violated. Preceding OpId in replica: term: 19 index: 13. Preceding OpId from leader: term: 21 index: 14. (index mismatch)
I20260709 13:07:22.017968 19404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85c494af21f9457a85da47b9bc70c1fd" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 21 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:07:22.017325 19303 catalog_manager.cc:5697] T 1dc5b3532fe54f74876d02beffa2c230 P 0473d2b2d01f4459b1e90fd12cc7840e reported cstate change: term changed from 12 to 17, leader changed from e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1) to 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2). New cstate: current_term: 17 leader_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:22.021395 26512 raft_consensus.cc:515] T f93ee515a9c14139bf566522ed8232f3 P 0473d2b2d01f4459b1e90fd12cc7840e [term 25 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:07:21.939049 26478 consensus_queue.cc:1048] T 70797e5783b5454ab0d0eea663e791e3 P e61c3a8f61bb48f8a963c9480e53c168 [NON_LEADER]: Connected to new peer: Peer: permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.049s
I20260709 13:07:22.030215 26574 raft_consensus.cc:493] T f1b10566f45d4a7d9029858330e02d5b P 0473d2b2d01f4459b1e90fd12cc7840e [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:21.987794 26544 raft_consensus.cc:493] T 4af19371ea874c09a0a2147040835cbb P e61c3a8f61bb48f8a963c9480e53c168 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader e5256d91808b47c195bc9b4dbd7f2b87)
I20260709 13:07:22.029700 26289 raft_consensus.cc:493] T 85c494af21f9457a85da47b9bc70c1fd P e5256d91808b47c195bc9b4dbd7f2b87 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:22.029385 26228 raft_consensus.cc:493] T 2e36a9d6e29c4a7c860cf267efbd4c74 P e61c3a8f61bb48f8a963c9480e53c168 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader e5256d91808b47c195bc9b4dbd7f2b87)
I20260709 13:07:22.024685 26540 raft_consensus.cc:515] T 1f85fc4b527a48848e5faa083b604e36 P 127766fc592545a4997f7790f50f6076 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:07:22.069146 26531 raft_consensus.cc:493] T f1b10566f45d4a7d9029858330e02d5b P e5256d91808b47c195bc9b4dbd7f2b87 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:22.045552 26289 raft_consensus.cc:3060] T 85c494af21f9457a85da47b9bc70c1fd P e5256d91808b47c195bc9b4dbd7f2b87 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:07:22.071926 26598 raft_consensus.cc:493] T ff75a1d4cb1f493db8f71ddc136ba9ab P e5256d91808b47c195bc9b4dbd7f2b87 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 0473d2b2d01f4459b1e90fd12cc7840e)
I20260709 13:07:22.045432 26544 raft_consensus.cc:515] T 4af19371ea874c09a0a2147040835cbb P e61c3a8f61bb48f8a963c9480e53c168 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:07:22.083978 19409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f93ee515a9c14139bf566522ed8232f3" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 25 candidate_status { last_received { term: 23 index: 12 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
W20260709 13:07:22.082657 26545 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.533s	user 0.003s	sys 0.003s
I20260709 13:07:22.088855 19403 raft_consensus.cc:1275] T 5ec1c4ce15e04c7e8c283a62179f2a64 P e5256d91808b47c195bc9b4dbd7f2b87 [term 15 FOLLOWER]: Refusing update from remote peer 0473d2b2d01f4459b1e90fd12cc7840e: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 13:07:22.087340 20108 raft_consensus.cc:2468] T 1f85fc4b527a48848e5faa083b604e36 P 127766fc592545a4997f7790f50f6076 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 19.
I20260709 13:07:22.044793 26574 raft_consensus.cc:515] T f1b10566f45d4a7d9029858330e02d5b P 0473d2b2d01f4459b1e90fd12cc7840e [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:07:22.138119 19403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f85fc4b527a48848e5faa083b604e36" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
W20260709 13:07:22.086567 26545 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.537s	user 0.004s	sys 0.003s
I20260709 13:07:22.138996 19403 raft_consensus.cc:2468] T 1f85fc4b527a48848e5faa083b604e36 P e5256d91808b47c195bc9b4dbd7f2b87 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 18.
I20260709 13:07:22.067000 26228 raft_consensus.cc:515] T 2e36a9d6e29c4a7c860cf267efbd4c74 P e61c3a8f61bb48f8a963c9480e53c168 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
W20260709 13:07:22.145675 19524 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:22.086303 26531 raft_consensus.cc:515] T f1b10566f45d4a7d9029858330e02d5b P e5256d91808b47c195bc9b4dbd7f2b87 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
W20260709 13:07:22.174625 20078 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.2:46257, user_credentials={real_user=slave}} blocked reactor thread for 178160us
I20260709 13:07:22.086915 26598 raft_consensus.cc:515] T ff75a1d4cb1f493db8f71ddc136ba9ab P e5256d91808b47c195bc9b4dbd7f2b87 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:07:22.196458 19409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "309c3ca0ca4b4f3ba129752ea2cb293b" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:07:22.197141 19409 raft_consensus.cc:2468] T 309c3ca0ca4b4f3ba129752ea2cb293b P e5256d91808b47c195bc9b4dbd7f2b87 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 13.
I20260709 13:07:22.143338 26545 raft_consensus.cc:697] T 6c5eebf646ad445a9d1b1adc319d7b16 P 127766fc592545a4997f7790f50f6076 [term 19 LEADER]: Becoming Leader. State: Replica: 127766fc592545a4997f7790f50f6076, State: Running, Role: LEADER
I20260709 13:07:22.181957 19449 leader_election.cc:304] T 76cb037fc9064d13b59a8969d897ce8c P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e; no voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:07:22.207921 20106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "309c3ca0ca4b4f3ba129752ea2cb293b" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:07:22.208680 20106 raft_consensus.cc:2468] T 309c3ca0ca4b4f3ba129752ea2cb293b P 127766fc592545a4997f7790f50f6076 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 13.
I20260709 13:07:22.182938 26447 raft_consensus.cc:493] T 217b5fae677b4971b3bbd2f357a1f7ff P 0473d2b2d01f4459b1e90fd12cc7840e [term 18 FOLLOWER]: Starting pre-election (detected failure of leader e61c3a8f61bb48f8a963c9480e53c168)
I20260709 13:07:22.190727 26599 raft_consensus.cc:493] T 4af19371ea874c09a0a2147040835cbb P e5256d91808b47c195bc9b4dbd7f2b87 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:22.229986 19553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f93ee515a9c14139bf566522ed8232f3" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 25 candidate_status { last_received { term: 23 index: 12 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:07:22.230726 19553 raft_consensus.cc:3060] T f93ee515a9c14139bf566522ed8232f3 P e61c3a8f61bb48f8a963c9480e53c168 [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:07:22.209542 26017 raft_consensus.cc:2749] T 76cb037fc9064d13b59a8969d897ce8c P 0473d2b2d01f4459b1e90fd12cc7840e [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 13:07:22.239997 19486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f85fc4b527a48848e5faa083b604e36" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:07:22.240773 19486 raft_consensus.cc:2468] T 1f85fc4b527a48848e5faa083b604e36 P 0473d2b2d01f4459b1e90fd12cc7840e [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 127766fc592545a4997f7790f50f6076 in term 19.
I20260709 13:07:22.245055 19449 leader_election.cc:304] T 1f85fc4b527a48848e5faa083b604e36 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87; no voters: 
W20260709 13:07:22.237932 26416 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.602s	user 0.003s	sys 0.017s
I20260709 13:07:22.229769 26512 leader_election.cc:290] T f93ee515a9c14139bf566522ed8232f3 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 25 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:07:22.224856 26428 consensus_queue.cc:1048] T 21e14947d70440f19044d8f75c31e1f9 P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.021s
W20260709 13:07:22.250806 26416 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.615s	user 0.005s	sys 0.018s
W20260709 13:07:22.264175 19523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.1:40321, user_credentials={real_user=slave}} blocked reactor thread for 326160us
I20260709 13:07:22.228279 26447 raft_consensus.cc:515] T 217b5fae677b4971b3bbd2f357a1f7ff P 0473d2b2d01f4459b1e90fd12cc7840e [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:07:22.266515 19523 leader_election.cc:304] T 65d8cb8d6ec64f459d5a47cefab10acf P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e61c3a8f61bb48f8a963c9480e53c168; no voters: 127766fc592545a4997f7790f50f6076, e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:07:22.241701 26379 consensus_queue.cc:1048] T b08304a0a02b42d7840c4e8ee9a6bd1a P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.021s
I20260709 13:07:22.272678 26603 raft_consensus.cc:2749] T 65d8cb8d6ec64f459d5a47cefab10acf P e61c3a8f61bb48f8a963c9480e53c168 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:07:22.245265 26388 consensus_queue.cc:1048] T 0cdf56e38bbc453d9438d359e5a69955 P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.022s
W20260709 13:07:22.282155 26611 log.cc:927] Time spent T ff9b0eddd810459b82d91c60777c10eb P 0473d2b2d01f4459b1e90fd12cc7840e: Append to log took a long time: real 0.101s	user 0.001s	sys 0.000s
I20260709 13:07:22.267053 26540 leader_election.cc:290] T 1f85fc4b527a48848e5faa083b604e36 P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321)
I20260709 13:07:22.269609 19523 leader_election.cc:304] T a08760e15aac4630a629431f56024dc8 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e61c3a8f61bb48f8a963c9480e53c168; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:07:22.265064 26017 raft_consensus.cc:2804] T 1f85fc4b527a48848e5faa083b604e36 P 0473d2b2d01f4459b1e90fd12cc7840e [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:07:22.267340 20078 leader_election.cc:304] T 1f85fc4b527a48848e5faa083b604e36 P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, 127766fc592545a4997f7790f50f6076; no voters: 
I20260709 13:07:22.247956 26316 consensus_queue.cc:1048] T 5ec1c4ce15e04c7e8c283a62179f2a64 P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.021s
I20260709 13:07:22.236644 26599 raft_consensus.cc:515] T 4af19371ea874c09a0a2147040835cbb P e5256d91808b47c195bc9b4dbd7f2b87 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
W20260709 13:07:22.279196 26609 log.cc:927] Time spent T df751f992649444090e27965eb1af85d P e61c3a8f61bb48f8a963c9480e53c168: Append to log took a long time: real 0.080s	user 0.001s	sys 0.000s
I20260709 13:07:22.293339 19523 leader_election.cc:304] T 40e1e16737a842ee936002830f36882e P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e61c3a8f61bb48f8a963c9480e53c168; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:07:22.296207 19553 raft_consensus.cc:2468] T f93ee515a9c14139bf566522ed8232f3 P e61c3a8f61bb48f8a963c9480e53c168 [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 25.
I20260709 13:07:22.279428 26544 leader_election.cc:290] T 4af19371ea874c09a0a2147040835cbb P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:07:22.298476 19450 leader_election.cc:304] T f93ee515a9c14139bf566522ed8232f3 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 25 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
W20260709 13:07:22.304057 20075 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.1:40321, user_credentials={real_user=slave}} blocked reactor thread for 280901us
I20260709 13:07:22.287879 26017 raft_consensus.cc:493] T 1f85fc4b527a48848e5faa083b604e36 P 0473d2b2d01f4459b1e90fd12cc7840e [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:22.309173 19523 leader_election.cc:304] T edd7d470b5014c9489be7f41f64355c9 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e61c3a8f61bb48f8a963c9480e53c168; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:07:22.288857 26228 leader_election.cc:290] T 2e36a9d6e29c4a7c860cf267efbd4c74 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:07:22.316354 19553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85c494af21f9457a85da47b9bc70c1fd" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 21 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:07:22.302753 26600 raft_consensus.cc:2804] T 1f85fc4b527a48848e5faa083b604e36 P 127766fc592545a4997f7790f50f6076 [term 19 FOLLOWER]: Leader pre-election won for term 20
W20260709 13:07:22.310890 26610 log.cc:927] Time spent T bc225c93219c45538b53a1bd3d387e4d P e5256d91808b47c195bc9b4dbd7f2b87: Append to log took a long time: real 0.140s	user 0.000s	sys 0.001s
I20260709 13:07:22.305070 26388 raft_consensus.cc:2804] T f93ee515a9c14139bf566522ed8232f3 P 0473d2b2d01f4459b1e90fd12cc7840e [term 25 FOLLOWER]: Leader election won for term 25
I20260709 13:07:22.303218 26615 raft_consensus.cc:2749] T a08760e15aac4630a629431f56024dc8 P e61c3a8f61bb48f8a963c9480e53c168 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:07:22.310097 26544 raft_consensus.cc:2749] T 40e1e16737a842ee936002830f36882e P e61c3a8f61bb48f8a963c9480e53c168 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:07:22.322558 19553 raft_consensus.cc:2410] T 85c494af21f9457a85da47b9bc70c1fd P e61c3a8f61bb48f8a963c9480e53c168 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 127766fc592545a4997f7790f50f6076 for term 21 because replica has last-logged OpId of term: 19 index: 15, which is greater than that of the candidate, which has last-logged OpId of term: 18 index: 14.
I20260709 13:07:22.333360 26416 raft_consensus.cc:493] T 4af19371ea874c09a0a2147040835cbb P 127766fc592545a4997f7790f50f6076 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:22.314992 26017 raft_consensus.cc:3060] T 1f85fc4b527a48848e5faa083b604e36 P 0473d2b2d01f4459b1e90fd12cc7840e [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:07:22.343576 19559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e1085d23e8347fbbd5bce7542f4b1f4" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 19 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
W20260709 13:07:22.321599 26607 log.cc:927] Time spent T edd7d470b5014c9489be7f41f64355c9 P e61c3a8f61bb48f8a963c9480e53c168: Append to log took a long time: real 0.111s	user 0.000s	sys 0.001s
I20260709 13:07:22.316931 26479 raft_consensus.cc:2749] T edd7d470b5014c9489be7f41f64355c9 P e61c3a8f61bb48f8a963c9480e53c168 [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
I20260709 13:07:22.274055 26545 consensus_queue.cc:237] T 6c5eebf646ad445a9d1b1adc319d7b16 P 127766fc592545a4997f7790f50f6076 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 18.13, Last appended by leader: 13, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:07:22.349617 26416 raft_consensus.cc:515] T 4af19371ea874c09a0a2147040835cbb P 127766fc592545a4997f7790f50f6076 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:07:22.360162 26574 leader_election.cc:290] T f1b10566f45d4a7d9029858330e02d5b P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:07:22.371342 19555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1b10566f45d4a7d9029858330e02d5b" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:07:22.377192 26598 leader_election.cc:290] T ff75a1d4cb1f493db8f71ddc136ba9ab P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:07:22.318459 26600 raft_consensus.cc:493] T 1f85fc4b527a48848e5faa083b604e36 P 127766fc592545a4997f7790f50f6076 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:22.321892 26621 raft_consensus.cc:493] T 5ec1c4ce15e04c7e8c283a62179f2a64 P 127766fc592545a4997f7790f50f6076 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:22.345534 26531 leader_election.cc:290] T f1b10566f45d4a7d9029858330e02d5b P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:07:22.345211 26388 raft_consensus.cc:697] T f93ee515a9c14139bf566522ed8232f3 P 0473d2b2d01f4459b1e90fd12cc7840e [term 25 LEADER]: Becoming Leader. State: Replica: 0473d2b2d01f4459b1e90fd12cc7840e, State: Running, Role: LEADER
I20260709 13:07:22.390478 19555 raft_consensus.cc:2468] T f1b10566f45d4a7d9029858330e02d5b P e61c3a8f61bb48f8a963c9480e53c168 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 19.
I20260709 13:07:22.400993 19450 leader_election.cc:304] T f1b10566f45d4a7d9029858330e02d5b P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
W20260709 13:07:22.403738 19449 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.1:40321, user_credentials={real_user=slave}} blocked reactor thread for 158781us
I20260709 13:07:22.405177 20103 raft_consensus.cc:1275] T 0afb57ae58a24a01850491d69f0213dd P 127766fc592545a4997f7790f50f6076 [term 13 FOLLOWER]: Refusing update from remote peer e61c3a8f61bb48f8a963c9480e53c168: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:07:22.408134 20103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62c6c134d3d24a1ab144dd9ee6bc3f64" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:07:22.410596 19405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85c494af21f9457a85da47b9bc70c1fd" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:07:22.413518 20103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85c494af21f9457a85da47b9bc70c1fd" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:07:22.414553 20103 raft_consensus.cc:2468] T 85c494af21f9457a85da47b9bc70c1fd P 127766fc592545a4997f7790f50f6076 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 20.
I20260709 13:07:22.415032 26598 raft_consensus.cc:493] T ece3db938bc649d4a40a51522ed5259c P e5256d91808b47c195bc9b4dbd7f2b87 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader e61c3a8f61bb48f8a963c9480e53c168)
I20260709 13:07:22.415611 26598 raft_consensus.cc:515] T ece3db938bc649d4a40a51522ed5259c P e5256d91808b47c195bc9b4dbd7f2b87 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:07:22.417131 19405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4af19371ea874c09a0a2147040835cbb" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:07:22.418203 26598 leader_election.cc:290] T ece3db938bc649d4a40a51522ed5259c P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:07:22.418147 19405 raft_consensus.cc:2468] T 4af19371ea874c09a0a2147040835cbb P e5256d91808b47c195bc9b4dbd7f2b87 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 13.
I20260709 13:07:22.419889 19478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1b10566f45d4a7d9029858330e02d5b" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:07:22.420450 19478 raft_consensus.cc:2468] T f1b10566f45d4a7d9029858330e02d5b P 0473d2b2d01f4459b1e90fd12cc7840e [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 20.
I20260709 13:07:22.420579 19485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff75a1d4cb1f493db8f71ddc136ba9ab" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 22 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:07:22.421351 19405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e36a9d6e29c4a7c860cf267efbd4c74" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:07:22.424551 20103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4af19371ea874c09a0a2147040835cbb" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:07:22.425863 20103 raft_consensus.cc:2393] T 4af19371ea874c09a0a2147040835cbb P 127766fc592545a4997f7790f50f6076 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e61c3a8f61bb48f8a963c9480e53c168 in current term 13: Already voted for candidate 127766fc592545a4997f7790f50f6076 in this term.
I20260709 13:07:22.426456 26154 raft_consensus.cc:493] T 7f575b143b844aa096b50997dad3516a P e5256d91808b47c195bc9b4dbd7f2b87 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:22.427090 26154 raft_consensus.cc:515] T 7f575b143b844aa096b50997dad3516a P e5256d91808b47c195bc9b4dbd7f2b87 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:07:22.438184 19405 raft_consensus.cc:1275] T 70797e5783b5454ab0d0eea663e791e3 P e5256d91808b47c195bc9b4dbd7f2b87 [term 24 FOLLOWER]: Refusing update from remote peer 127766fc592545a4997f7790f50f6076: Log matching property violated. Preceding OpId in replica: term: 22 index: 15. Preceding OpId from leader: term: 24 index: 16. (index mismatch)
I20260709 13:07:22.432241 19377 leader_election.cc:304] T f1b10566f45d4a7d9029858330e02d5b P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87; no voters: 
I20260709 13:07:22.453752 19410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f85fc4b527a48848e5faa083b604e36" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:07:22.454567 19410 raft_consensus.cc:2468] T 1f85fc4b527a48848e5faa083b604e36 P e5256d91808b47c195bc9b4dbd7f2b87 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 127766fc592545a4997f7790f50f6076 in term 18.
I20260709 13:07:22.393573 26600 raft_consensus.cc:3060] T 1f85fc4b527a48848e5faa083b604e36 P 127766fc592545a4997f7790f50f6076 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:07:22.484937 19449 leader_election.cc:304] T 309c3ca0ca4b4f3ba129752ea2cb293b P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, 127766fc592545a4997f7790f50f6076; no voters: 
I20260709 13:07:22.542124 20103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ece3db938bc649d4a40a51522ed5259c" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:07:22.449446 26207 raft_consensus.cc:2804] T f1b10566f45d4a7d9029858330e02d5b P 0473d2b2d01f4459b1e90fd12cc7840e [term 20 FOLLOWER]: Leader pre-election won for term 21
W20260709 13:07:22.599118 20076 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.3:36891, user_credentials={real_user=slave}} blocked reactor thread for 171696us
I20260709 13:07:22.565143 26534 raft_consensus.cc:3060] T 70797e5783b5454ab0d0eea663e791e3 P e61c3a8f61bb48f8a963c9480e53c168 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:07:22.397926 26621 raft_consensus.cc:515] T 5ec1c4ce15e04c7e8c283a62179f2a64 P 127766fc592545a4997f7790f50f6076 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:07:22.634812 20076 leader_election.cc:304] T 0e1085d23e8347fbbd5bce7542f4b1f4 P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 127766fc592545a4997f7790f50f6076; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:07:22.578233 26207 raft_consensus.cc:493] T f1b10566f45d4a7d9029858330e02d5b P 0473d2b2d01f4459b1e90fd12cc7840e [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:07:22.652855 20075 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.1:40321, user_credentials={real_user=slave}} blocked reactor thread for 212397us
I20260709 13:07:22.629222 26633 raft_consensus.cc:493] T 5ec1c4ce15e04c7e8c283a62179f2a64 P e5256d91808b47c195bc9b4dbd7f2b87 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:22.629084 25923 raft_consensus.cc:493] T 1dc5b3532fe54f74876d02beffa2c230 P e5256d91808b47c195bc9b4dbd7f2b87 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader e61c3a8f61bb48f8a963c9480e53c168)
I20260709 13:07:22.629418 26326 raft_consensus.cc:493] T 46c5bfeecc314717bffe987e6844b6d0 P e5256d91808b47c195bc9b4dbd7f2b87 [term 25 FOLLOWER]: Starting pre-election (detected failure of leader e61c3a8f61bb48f8a963c9480e53c168)
I20260709 13:07:22.609084 26636 raft_consensus.cc:2804] T 309c3ca0ca4b4f3ba129752ea2cb293b P 0473d2b2d01f4459b1e90fd12cc7840e [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:07:22.561537 26512 consensus_queue.cc:1048] T 5ec1c4ce15e04c7e8c283a62179f2a64 P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Connected to new peer: Peer: permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.102s
I20260709 13:07:22.638504 26447 leader_election.cc:290] T 217b5fae677b4971b3bbd2f357a1f7ff P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:07:22.652232 26275 raft_consensus.cc:493] T df751f992649444090e27965eb1af85d P e5256d91808b47c195bc9b4dbd7f2b87 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:22.655373 26207 raft_consensus.cc:3060] T f1b10566f45d4a7d9029858330e02d5b P 0473d2b2d01f4459b1e90fd12cc7840e [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:07:22.665979 26388 consensus_queue.cc:237] T f93ee515a9c14139bf566522ed8232f3 P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 23.12, Last appended by leader: 12, Current term: 25, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:07:22.653379 26428 raft_consensus.cc:493] T ab43d85f64114d4ebf618930e43d9ed0 P 0473d2b2d01f4459b1e90fd12cc7840e [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 127766fc592545a4997f7790f50f6076)
I20260709 13:07:22.669374 26326 raft_consensus.cc:515] T 46c5bfeecc314717bffe987e6844b6d0 P e5256d91808b47c195bc9b4dbd7f2b87 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:07:22.727114 26428 raft_consensus.cc:515] T ab43d85f64114d4ebf618930e43d9ed0 P 0473d2b2d01f4459b1e90fd12cc7840e [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:07:22.729679 26428 leader_election.cc:290] T ab43d85f64114d4ebf618930e43d9ed0 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:07:22.666698 26097 raft_consensus.cc:493] T 217b5fae677b4971b3bbd2f357a1f7ff P e5256d91808b47c195bc9b4dbd7f2b87 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader e61c3a8f61bb48f8a963c9480e53c168)
I20260709 13:07:22.643435 26645 consensus_queue.cc:1048] T 70797e5783b5454ab0d0eea663e791e3 P 127766fc592545a4997f7790f50f6076 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.086s
I20260709 13:07:22.666033 26599 leader_election.cc:290] T 4af19371ea874c09a0a2147040835cbb P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:07:22.679246 26275 raft_consensus.cc:515] T df751f992649444090e27965eb1af85d P e5256d91808b47c195bc9b4dbd7f2b87 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:07:22.673111 26496 raft_consensus.cc:2749] T 0e1085d23e8347fbbd5bce7542f4b1f4 P 127766fc592545a4997f7790f50f6076 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 13:07:22.683281 26625 log.cc:927] Time spent T 40e1e16737a842ee936002830f36882e P e61c3a8f61bb48f8a963c9480e53c168: Append to log took a long time: real 0.291s	user 0.000s	sys 0.000s
W20260709 13:07:22.679989 26628 log.cc:927] Time spent T bc225c93219c45538b53a1bd3d387e4d P 0473d2b2d01f4459b1e90fd12cc7840e: Append to log took a long time: real 0.116s	user 0.000s	sys 0.000s
W20260709 13:07:22.734972 20078 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.2:46257, user_credentials={real_user=slave}} blocked reactor thread for 72837.4us
I20260709 13:07:22.735069 26275 leader_election.cc:290] T df751f992649444090e27965eb1af85d P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:07:22.667158 26636 raft_consensus.cc:493] T 309c3ca0ca4b4f3ba129752ea2cb293b P 0473d2b2d01f4459b1e90fd12cc7840e [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:22.737421 26636 raft_consensus.cc:3060] T 309c3ca0ca4b4f3ba129752ea2cb293b P 0473d2b2d01f4459b1e90fd12cc7840e [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:07:22.741402 19481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ec1c4ce15e04c7e8c283a62179f2a64" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
W20260709 13:07:22.703586 26619 log.cc:927] Time spent T 21e14947d70440f19044d8f75c31e1f9 P e61c3a8f61bb48f8a963c9480e53c168: Append to log took a long time: real 0.361s	user 0.000s	sys 0.001s
I20260709 13:07:22.745388 26326 leader_election.cc:290] T 46c5bfeecc314717bffe987e6844b6d0 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:07:22.755458 26431 raft_consensus.cc:493] T df751f992649444090e27965eb1af85d P 0473d2b2d01f4459b1e90fd12cc7840e [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:22.756053 26431 raft_consensus.cc:515] T df751f992649444090e27965eb1af85d P 0473d2b2d01f4459b1e90fd12cc7840e [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:07:22.758288 26431 leader_election.cc:290] T df751f992649444090e27965eb1af85d P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:07:22.760665 26532 raft_consensus.cc:493] T 4509b76741dc428e9201c70c1658da13 P e61c3a8f61bb48f8a963c9480e53c168 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:22.761289 26532 raft_consensus.cc:515] T 4509b76741dc428e9201c70c1658da13 P e61c3a8f61bb48f8a963c9480e53c168 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
W20260709 13:07:22.765717 20076 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.3:36891, user_credentials={real_user=slave}} blocked reactor thread for 94653.2us
I20260709 13:07:22.703302 26416 leader_election.cc:290] T 4af19371ea874c09a0a2147040835cbb P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:07:22.666785 26633 raft_consensus.cc:515] T 5ec1c4ce15e04c7e8c283a62179f2a64 P e5256d91808b47c195bc9b4dbd7f2b87 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:07:22.669529 25923 raft_consensus.cc:515] T 1dc5b3532fe54f74876d02beffa2c230 P e5256d91808b47c195bc9b4dbd7f2b87 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:07:22.683954 26154 leader_election.cc:290] T 7f575b143b844aa096b50997dad3516a P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
W20260709 13:07:22.723223 26637 log.cc:927] Time spent T 0e1085d23e8347fbbd5bce7542f4b1f4 P 127766fc592545a4997f7790f50f6076: Append to log took a long time: real 0.062s	user 0.000s	sys 0.001s
I20260709 13:07:22.731145 26097 raft_consensus.cc:515] T 217b5fae677b4971b3bbd2f357a1f7ff P e5256d91808b47c195bc9b4dbd7f2b87 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:07:22.679677 20103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4af19371ea874c09a0a2147040835cbb" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:07:22.647239 26632 raft_consensus.cc:2804] T f1b10566f45d4a7d9029858330e02d5b P e5256d91808b47c195bc9b4dbd7f2b87 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:07:22.785383 20103 raft_consensus.cc:2468] T 4af19371ea874c09a0a2147040835cbb P 127766fc592545a4997f7790f50f6076 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 13.
W20260709 13:07:22.713403 26639 log.cc:927] Time spent T 1efebf73c86e432baa55533136b6e12c P 127766fc592545a4997f7790f50f6076: Append to log took a long time: real 0.101s	user 0.000s	sys 0.001s
I20260709 13:07:22.779971 26479 raft_consensus.cc:493] T ef32ce6fdd0e40d382c79974f30295c6 P e61c3a8f61bb48f8a963c9480e53c168 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader e5256d91808b47c195bc9b4dbd7f2b87)
I20260709 13:07:22.806370 26615 raft_consensus.cc:493] T 7f575b143b844aa096b50997dad3516a P e61c3a8f61bb48f8a963c9480e53c168 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader e5256d91808b47c195bc9b4dbd7f2b87)
I20260709 13:07:22.813196 26615 raft_consensus.cc:515] T 7f575b143b844aa096b50997dad3516a P e61c3a8f61bb48f8a963c9480e53c168 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:07:22.794734 26632 raft_consensus.cc:493] T f1b10566f45d4a7d9029858330e02d5b P e5256d91808b47c195bc9b4dbd7f2b87 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:22.814368 26632 raft_consensus.cc:3060] T f1b10566f45d4a7d9029858330e02d5b P e5256d91808b47c195bc9b4dbd7f2b87 [term 20 FOLLOWER]: Advancing to term 21
W20260709 13:07:22.816855 20076 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.3:36891, user_credentials={real_user=slave}} blocked reactor thread for 49478us
I20260709 13:07:22.708624 26621 leader_election.cc:290] T 5ec1c4ce15e04c7e8c283a62179f2a64 P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:07:22.851958 19552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df751f992649444090e27965eb1af85d" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 24 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:07:22.856983 19551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "217b5fae677b4971b3bbd2f357a1f7ff" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:07:22.806882 26478 raft_consensus.cc:493] T 7be9efa6559648dbb5a0f7684c4542d1 P e61c3a8f61bb48f8a963c9480e53c168 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader e5256d91808b47c195bc9b4dbd7f2b87)
I20260709 13:07:22.860301 26478 raft_consensus.cc:515] T 7be9efa6559648dbb5a0f7684c4542d1 P e61c3a8f61bb48f8a963c9480e53c168 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } attrs { replace: true } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:07:22.825937 26615 leader_election.cc:290] T 7f575b143b844aa096b50997dad3516a P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:07:22.834498 19560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28af091831594f9d8e96482078cc7625" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:07:22.837509 26479 raft_consensus.cc:515] T ef32ce6fdd0e40d382c79974f30295c6 P e61c3a8f61bb48f8a963c9480e53c168 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:07:22.846248 19554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab43d85f64114d4ebf618930e43d9ed0" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 24 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:07:22.848619 26642 raft_consensus.cc:493] T 0afb57ae58a24a01850491d69f0213dd P 127766fc592545a4997f7790f50f6076 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:22.878031 19410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1b10566f45d4a7d9029858330e02d5b" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
W20260709 13:07:22.878538 19377 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.2:46257, user_credentials={real_user=slave}} blocked reactor thread for 446374us
W20260709 13:07:22.881826 19449 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.4:43121, user_credentials={real_user=slave}} blocked reactor thread for 395723us
I20260709 13:07:22.885761 19552 raft_consensus.cc:1240] T f93ee515a9c14139bf566522ed8232f3 P e61c3a8f61bb48f8a963c9480e53c168 [term 25 FOLLOWER]: Rejecting Update request from peer e5256d91808b47c195bc9b4dbd7f2b87 for earlier term 24. Current term is 25. Ops: []
I20260709 13:07:22.886225 19478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46c5bfeecc314717bffe987e6844b6d0" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 26 candidate_status { last_received { term: 25 index: 13 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:07:22.876189 19403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f93ee515a9c14139bf566522ed8232f3" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 25 candidate_status { last_received { term: 23 index: 12 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
I20260709 13:07:22.889531 19523 leader_election.cc:304] T 62c6c134d3d24a1ab144dd9ee6bc3f64 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e61c3a8f61bb48f8a963c9480e53c168; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, 127766fc592545a4997f7790f50f6076
I20260709 13:07:22.884660 19485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f575b143b844aa096b50997dad3516a" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:07:22.891148 19479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df751f992649444090e27965eb1af85d" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 24 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:07:22.891625 19485 raft_consensus.cc:2468] T 7f575b143b844aa096b50997dad3516a P 0473d2b2d01f4459b1e90fd12cc7840e [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 19.
I20260709 13:07:22.892544 19523 leader_election.cc:304] T 85c494af21f9457a85da47b9bc70c1fd P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 127766fc592545a4997f7790f50f6076, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:07:22.891690 19479 raft_consensus.cc:2468] T df751f992649444090e27965eb1af85d P 0473d2b2d01f4459b1e90fd12cc7840e [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 23.
I20260709 13:07:22.891180 19556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4af19371ea874c09a0a2147040835cbb" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:07:22.907167 19406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "217b5fae677b4971b3bbd2f357a1f7ff" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:07:22.908957 20108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab43d85f64114d4ebf618930e43d9ed0" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 24 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:07:22.906006 19556 raft_consensus.cc:2468] T 4af19371ea874c09a0a2147040835cbb P e61c3a8f61bb48f8a963c9480e53c168 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 127766fc592545a4997f7790f50f6076 in term 12.
I20260709 13:07:22.907758 19406 raft_consensus.cc:2468] T 217b5fae677b4971b3bbd2f357a1f7ff P e5256d91808b47c195bc9b4dbd7f2b87 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 18.
I20260709 13:07:22.887025 26448 raft_consensus.cc:493] T 4509b76741dc428e9201c70c1658da13 P e5256d91808b47c195bc9b4dbd7f2b87 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:22.890831 26288 raft_consensus.cc:493] T 22196caba61445d3bec98a0aab3c337d P e5256d91808b47c195bc9b4dbd7f2b87 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader e61c3a8f61bb48f8a963c9480e53c168)
I20260709 13:07:22.925840 20076 leader_election.cc:304] T 4af19371ea874c09a0a2147040835cbb P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 127766fc592545a4997f7790f50f6076, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:07:22.931344 19551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1b10566f45d4a7d9029858330e02d5b" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:07:22.905371 26617 raft_consensus.cc:2749] T 62c6c134d3d24a1ab144dd9ee6bc3f64 P e61c3a8f61bb48f8a963c9480e53c168 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:07:22.934067 19551 raft_consensus.cc:2468] T f1b10566f45d4a7d9029858330e02d5b P e61c3a8f61bb48f8a963c9480e53c168 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 19.
I20260709 13:07:22.932960 19552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff75a1d4cb1f493db8f71ddc136ba9ab" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 22 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:07:22.936229 26643 raft_consensus.cc:2804] T 4af19371ea874c09a0a2147040835cbb P 127766fc592545a4997f7790f50f6076 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:07:22.941074 19558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ece3db938bc649d4a40a51522ed5259c" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
W20260709 13:07:22.928508 26017 consensus_meta.cc:287] T 1f85fc4b527a48848e5faa083b604e36 P 0473d2b2d01f4459b1e90fd12cc7840e: Time spent flushing consensus metadata: real 0.542s	user 0.013s	sys 0.000s
I20260709 13:07:22.951810 19560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f575b143b844aa096b50997dad3516a" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:07:22.945057 19523 leader_election.cc:304] T 4af19371ea874c09a0a2147040835cbb P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168; no voters: 127766fc592545a4997f7790f50f6076
I20260709 13:07:22.895470 26615 consensus_queue.cc:1048] T 0afb57ae58a24a01850491d69f0213dd P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Connected to new peer: Peer: permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.037s
I20260709 13:07:22.952682 19560 raft_consensus.cc:2468] T 7f575b143b844aa096b50997dad3516a P e61c3a8f61bb48f8a963c9480e53c168 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 18.
I20260709 13:07:22.938984 19449 leader_election.cc:304] T 217b5fae677b4971b3bbd2f357a1f7ff P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87; no voters: e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:07:22.957937 19554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46c5bfeecc314717bffe987e6844b6d0" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 26 candidate_status { last_received { term: 25 index: 13 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:07:22.961076 19556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4af19371ea874c09a0a2147040835cbb" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:07:22.961135 19483 raft_consensus.cc:1240] T f93ee515a9c14139bf566522ed8232f3 P 0473d2b2d01f4459b1e90fd12cc7840e [term 25 LEADER]: Rejecting Update request from peer e5256d91808b47c195bc9b4dbd7f2b87 for earlier term 24. Current term is 25. Ops: []
I20260709 13:07:22.954487 19551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df751f992649444090e27965eb1af85d" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 24 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:07:22.892407 26642 raft_consensus.cc:515] T 0afb57ae58a24a01850491d69f0213dd P 127766fc592545a4997f7790f50f6076 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:07:22.944271 26643 raft_consensus.cc:493] T 4af19371ea874c09a0a2147040835cbb P 127766fc592545a4997f7790f50f6076 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:22.960559 26553 raft_consensus.cc:2804] T 4af19371ea874c09a0a2147040835cbb P e61c3a8f61bb48f8a963c9480e53c168 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:07:22.927968 26448 raft_consensus.cc:515] T 4509b76741dc428e9201c70c1658da13 P e5256d91808b47c195bc9b4dbd7f2b87 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:07:22.955955 26532 leader_election.cc:290] T 4509b76741dc428e9201c70c1658da13 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:07:22.936426 26288 raft_consensus.cc:515] T 22196caba61445d3bec98a0aab3c337d P e5256d91808b47c195bc9b4dbd7f2b87 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
W20260709 13:07:22.987305 19449 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.1:40321, user_credentials={real_user=slave}} blocked reactor thread for 49385.6us
I20260709 13:07:22.959280 26650 raft_consensus.cc:493] T 2a16f7501e2444fb86d4e2778e734e02 P e5256d91808b47c195bc9b4dbd7f2b87 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 127766fc592545a4997f7790f50f6076)
I20260709 13:07:22.982854 26643 raft_consensus.cc:3060] T 4af19371ea874c09a0a2147040835cbb P 127766fc592545a4997f7790f50f6076 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:07:23.001330 19374 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.4:43121, user_credentials={real_user=slave}} blocked reactor thread for 104510us
I20260709 13:07:22.959824 26017 raft_consensus.cc:515] T 1f85fc4b527a48848e5faa083b604e36 P 0473d2b2d01f4459b1e90fd12cc7840e [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:07:23.003602 19478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e36a9d6e29c4a7c860cf267efbd4c74" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:07:22.986949 26553 raft_consensus.cc:493] T 4af19371ea874c09a0a2147040835cbb P e61c3a8f61bb48f8a963c9480e53c168 [term 12 FOLLOWER]: Starting leader election (detected failure of leader e5256d91808b47c195bc9b4dbd7f2b87)
I20260709 13:07:23.001830 19375 leader_election.cc:304] T fa8650e71aa14778b3d73721fc50d9fc P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:07:23.008543 26613 raft_consensus.cc:2804] T 85c494af21f9457a85da47b9bc70c1fd P e61c3a8f61bb48f8a963c9480e53c168 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:07:23.004841 19374 leader_election.cc:304] T 4af19371ea874c09a0a2147040835cbb P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 127766fc592545a4997f7790f50f6076, e5256d91808b47c195bc9b4dbd7f2b87; no voters: 
I20260709 13:07:23.008785 26097 leader_election.cc:290] T 217b5fae677b4971b3bbd2f357a1f7ff P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:07:23.013712 19403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4af19371ea874c09a0a2147040835cbb" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:07:23.014370 19403 raft_consensus.cc:2468] T 4af19371ea874c09a0a2147040835cbb P e5256d91808b47c195bc9b4dbd7f2b87 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 127766fc592545a4997f7790f50f6076 in term 13.
I20260709 13:07:23.015851 26017 leader_election.cc:290] T 1f85fc4b527a48848e5faa083b604e36 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 20 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:07:23.017364 26288 leader_election.cc:290] T 22196caba61445d3bec98a0aab3c337d P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:07:23.015614 26647 raft_consensus.cc:2804] T 4af19371ea874c09a0a2147040835cbb P e5256d91808b47c195bc9b4dbd7f2b87 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:07:23.019167 26647 raft_consensus.cc:493] T 4af19371ea874c09a0a2147040835cbb P e5256d91808b47c195bc9b4dbd7f2b87 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:23.019552 26647 raft_consensus.cc:3060] T 4af19371ea874c09a0a2147040835cbb P e5256d91808b47c195bc9b4dbd7f2b87 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:07:23.000545 26600 raft_consensus.cc:515] T 1f85fc4b527a48848e5faa083b604e36 P 127766fc592545a4997f7790f50f6076 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:07:23.022063 26600 leader_election.cc:290] T 1f85fc4b527a48848e5faa083b604e36 P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 20 election: Requested vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321)
I20260709 13:07:23.022912 19478 raft_consensus.cc:1275] T df751f992649444090e27965eb1af85d P 0473d2b2d01f4459b1e90fd12cc7840e [term 23 FOLLOWER]: Refusing update from remote peer e61c3a8f61bb48f8a963c9480e53c168: Log matching property violated. Preceding OpId in replica: term: 22 index: 14. Preceding OpId from leader: term: 23 index: 15. (index mismatch)
I20260709 13:07:23.024585 26633 leader_election.cc:290] T 5ec1c4ce15e04c7e8c283a62179f2a64 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:07:23.007923 26650 raft_consensus.cc:515] T 2a16f7501e2444fb86d4e2778e734e02 P e5256d91808b47c195bc9b4dbd7f2b87 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:07:23.009202 19402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df751f992649444090e27965eb1af85d" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 24 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:07:23.032285 19402 raft_consensus.cc:2468] T df751f992649444090e27965eb1af85d P e5256d91808b47c195bc9b4dbd7f2b87 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 23.
I20260709 13:07:23.012087 26613 raft_consensus.cc:493] T 85c494af21f9457a85da47b9bc70c1fd P e61c3a8f61bb48f8a963c9480e53c168 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:23.034307 26613 raft_consensus.cc:3060] T 85c494af21f9457a85da47b9bc70c1fd P e61c3a8f61bb48f8a963c9480e53c168 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:07:22.993515 26649 raft_consensus.cc:2804] T 217b5fae677b4971b3bbd2f357a1f7ff P 0473d2b2d01f4459b1e90fd12cc7840e [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:07:23.038275 26649 raft_consensus.cc:493] T 217b5fae677b4971b3bbd2f357a1f7ff P 0473d2b2d01f4459b1e90fd12cc7840e [term 18 FOLLOWER]: Starting leader election (detected failure of leader e61c3a8f61bb48f8a963c9480e53c168)
I20260709 13:07:23.038650 26649 raft_consensus.cc:3060] T 217b5fae677b4971b3bbd2f357a1f7ff P 0473d2b2d01f4459b1e90fd12cc7840e [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:07:23.013762 26553 raft_consensus.cc:3060] T 4af19371ea874c09a0a2147040835cbb P e61c3a8f61bb48f8a963c9480e53c168 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:07:23.058811 26479 leader_election.cc:290] T ef32ce6fdd0e40d382c79974f30295c6 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:07:23.059387 26650 leader_election.cc:290] T 2a16f7501e2444fb86d4e2778e734e02 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:07:23.059559 26478 leader_election.cc:290] T 7be9efa6559648dbb5a0f7684c4542d1 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:07:23.055708 19483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f85fc4b527a48848e5faa083b604e36" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:07:23.057337 19478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f575b143b844aa096b50997dad3516a" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:07:23.060891 19478 raft_consensus.cc:2393] T 7f575b143b844aa096b50997dad3516a P 0473d2b2d01f4459b1e90fd12cc7840e [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e61c3a8f61bb48f8a963c9480e53c168 in current term 19: Already voted for candidate 0473d2b2d01f4459b1e90fd12cc7840e in this term.
I20260709 13:07:23.061334 26642 leader_election.cc:290] T 0afb57ae58a24a01850491d69f0213dd P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:07:23.057837 20110 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46422 (request call id 1101) took 1874 ms. Trace:
I20260709 13:07:23.058063 26448 leader_election.cc:290] T 4509b76741dc428e9201c70c1658da13 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:07:23.062137 20110 rpcz_store.cc:276] 0709 13:07:21.183680 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:21.190537 (+  6857us) service_pool.cc:224] Handling call
0709 13:07:23.057612 (+1867075us) spinlock_profiling.cc:243] Waited 1.8 s on lock 0x7b5400661054. stack: 00007f4a79de9343 00007f4a79de9240 00007f4a797781d4 00007f4a834b6304 00007f4a834b6299 00007f4a7ce71571 00007f4a7cf0c2fa 00007f4a81ecdb17 00007f4a7b4486d4 00007f4a7b448662 00007f4a7b448591 00007f4a7b44850c 00007f4a7b4477c2 00007f4a7b24348c 00007f4a7b2428c6 00007f4a7b24226f
0709 13:07:23.057760 (+   148us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4139667200}
I20260709 13:07:23.064081 19483 raft_consensus.cc:2393] T 1f85fc4b527a48848e5faa083b604e36 P 0473d2b2d01f4459b1e90fd12cc7840e [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 127766fc592545a4997f7790f50f6076 in current term 20: Already voted for candidate 0473d2b2d01f4459b1e90fd12cc7840e in this term.
I20260709 13:07:23.065142 25923 leader_election.cc:290] T 1dc5b3532fe54f74876d02beffa2c230 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:07:23.000175 26646 raft_consensus.cc:493] T 3e1f505cb0f1427bbd698ac889d80821 P e5256d91808b47c195bc9b4dbd7f2b87 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader e61c3a8f61bb48f8a963c9480e53c168)
I20260709 13:07:23.065925 26646 raft_consensus.cc:515] T 3e1f505cb0f1427bbd698ac889d80821 P e5256d91808b47c195bc9b4dbd7f2b87 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:07:23.068049 19551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0afb57ae58a24a01850491d69f0213dd" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:07:23.070693 26382 raft_consensus.cc:493] T 40e1e16737a842ee936002830f36882e P 0473d2b2d01f4459b1e90fd12cc7840e [term 23 FOLLOWER]: Starting pre-election (detected failure of leader e5256d91808b47c195bc9b4dbd7f2b87)
I20260709 13:07:23.071293 26382 raft_consensus.cc:515] T 40e1e16737a842ee936002830f36882e P 0473d2b2d01f4459b1e90fd12cc7840e [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:07:23.073518 26382 leader_election.cc:290] T 40e1e16737a842ee936002830f36882e P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:07:23.074041 26382 raft_consensus.cc:493] T 46c5bfeecc314717bffe987e6844b6d0 P 0473d2b2d01f4459b1e90fd12cc7840e [term 25 FOLLOWER]: Starting pre-election (detected failure of leader e61c3a8f61bb48f8a963c9480e53c168)
I20260709 13:07:23.074980 26379 raft_consensus.cc:493] T 1dc5b3532fe54f74876d02beffa2c230 P 0473d2b2d01f4459b1e90fd12cc7840e [term 22 FOLLOWER]: Starting pre-election (detected failure of leader e61c3a8f61bb48f8a963c9480e53c168)
I20260709 13:07:23.075508 26379 raft_consensus.cc:515] T 1dc5b3532fe54f74876d02beffa2c230 P 0473d2b2d01f4459b1e90fd12cc7840e [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:07:23.077600 26379 leader_election.cc:290] T 1dc5b3532fe54f74876d02beffa2c230 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:07:23.079830 19483 raft_consensus.cc:1275] T 6c5eebf646ad445a9d1b1adc319d7b16 P 0473d2b2d01f4459b1e90fd12cc7840e [term 20 FOLLOWER]: Refusing update from remote peer e61c3a8f61bb48f8a963c9480e53c168: Log matching property violated. Preceding OpId in replica: term: 18 index: 13. Preceding OpId from leader: term: 20 index: 14. (index mismatch)
I20260709 13:07:23.081082 19551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40e1e16737a842ee936002830f36882e" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 24 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:07:23.074581 26382 raft_consensus.cc:515] T 46c5bfeecc314717bffe987e6844b6d0 P 0473d2b2d01f4459b1e90fd12cc7840e [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:07:23.082719 19552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dc5b3532fe54f74876d02beffa2c230" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 23 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:07:23.083714 26204 raft_consensus.cc:493] T ff9b0eddd810459b82d91c60777c10eb P 0473d2b2d01f4459b1e90fd12cc7840e [term 22 FOLLOWER]: Starting pre-election (detected failure of leader e5256d91808b47c195bc9b4dbd7f2b87)
I20260709 13:07:23.084380 26204 raft_consensus.cc:515] T ff9b0eddd810459b82d91c60777c10eb P 0473d2b2d01f4459b1e90fd12cc7840e [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:07:23.087625 26382 leader_election.cc:290] T 46c5bfeecc314717bffe987e6844b6d0 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
W20260709 13:07:23.061488 26289 consensus_meta.cc:287] T 85c494af21f9457a85da47b9bc70c1fd P e5256d91808b47c195bc9b4dbd7f2b87: Time spent flushing consensus metadata: real 0.938s	user 0.016s	sys 0.000s
I20260709 13:07:23.088762 26289 raft_consensus.cc:515] T 85c494af21f9457a85da47b9bc70c1fd P e5256d91808b47c195bc9b4dbd7f2b87 [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:07:23.089922 19404 raft_consensus.cc:2393] T 85c494af21f9457a85da47b9bc70c1fd P e5256d91808b47c195bc9b4dbd7f2b87 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 127766fc592545a4997f7790f50f6076 in current term 21: Already voted for candidate e5256d91808b47c195bc9b4dbd7f2b87 in this term.
I20260709 13:07:23.091059 19404 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49050 (request call id 1419) took 1102 ms. Trace:
W20260709 13:07:23.095048 19375 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.3:36891, user_credentials={real_user=slave}} blocked reactor thread for 83601us
I20260709 13:07:23.097704 19552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46c5bfeecc314717bffe987e6844b6d0" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 26 candidate_status { last_received { term: 25 index: 13 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:07:23.100342 20110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7be9efa6559648dbb5a0f7684c4542d1" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:07:23.091383 19404 rpcz_store.cc:276] 0709 13:07:21.988956 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:21.989820 (+   864us) service_pool.cc:224] Handling call
0709 13:07:23.090823 (+1101003us) spinlock_profiling.cc:243] Waited 1.06 s on lock 0x7b5400065c54. stack: 00007f4a79de9343 00007f4a79de9240 00007f4a797781d4 00007f4a834b6304 00007f4a834b6299 00007f4a7ce71571 00007f4a7cf0c2fa 00007f4a81ecdb17 00007f4a7b4486d4 00007f4a7b448662 00007f4a7b448591 00007f4a7b44850c 00007f4a7b4477c2 00007f4a7b24348c 00007f4a7b2428c6 00007f4a7b24226f
0709 13:07:23.090974 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2438760704}
I20260709 13:07:23.090883 26289 leader_election.cc:290] T 85c494af21f9457a85da47b9bc70c1fd P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 21 election: Requested vote from peers e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:07:23.113627 19375 leader_election.cc:304] T 28af091831594f9d8e96482078cc7625 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:07:23.086442 26204 leader_election.cc:290] T ff9b0eddd810459b82d91c60777c10eb P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:07:23.119575 19478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7be9efa6559648dbb5a0f7684c4542d1" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:07:23.120982 19477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0afb57ae58a24a01850491d69f0213dd" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:07:23.030735 26154 raft_consensus.cc:2749] T fa8650e71aa14778b3d73721fc50d9fc P e5256d91808b47c195bc9b4dbd7f2b87 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
W20260709 13:07:23.128062 19377 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.2:46257, user_credentials={real_user=slave}} blocked reactor thread for 200144us
I20260709 13:07:23.128793 19377 leader_election.cc:304] T 7f575b143b844aa096b50997dad3516a P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87; no voters: 
I20260709 13:07:23.068084 26646 leader_election.cc:290] T 3e1f505cb0f1427bbd698ac889d80821 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:07:23.128695 19402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ec1c4ce15e04c7e8c283a62179f2a64" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:07:23.122275 19483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4509b76741dc428e9201c70c1658da13" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 16 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:07:23.133225 19483 raft_consensus.cc:2468] T 4509b76741dc428e9201c70c1658da13 P 0473d2b2d01f4459b1e90fd12cc7840e [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 15.
I20260709 13:07:23.121941 26531 raft_consensus.cc:2749] T 28af091831594f9d8e96482078cc7625 P e5256d91808b47c195bc9b4dbd7f2b87 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:07:23.136680 20078 leader_election.cc:304] T 0afb57ae58a24a01850491d69f0213dd P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 127766fc592545a4997f7790f50f6076; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:07:23.143167 19375 leader_election.cc:304] T ff75a1d4cb1f493db8f71ddc136ba9ab P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:07:23.145321 19375 leader_election.cc:304] T ece3db938bc649d4a40a51522ed5259c P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87; no voters: 127766fc592545a4997f7790f50f6076, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:07:23.145139 19377 leader_election.cc:304] T df751f992649444090e27965eb1af85d P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87; no voters: 
I20260709 13:07:23.147642 19477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef32ce6fdd0e40d382c79974f30295c6" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 24 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:07:23.123116 26207 raft_consensus.cc:515] T f1b10566f45d4a7d9029858330e02d5b P 0473d2b2d01f4459b1e90fd12cc7840e [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:07:23.152118 19404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f85fc4b527a48848e5faa083b604e36" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
I20260709 13:07:23.156483 19404 raft_consensus.cc:3060] T 1f85fc4b527a48848e5faa083b604e36 P e5256d91808b47c195bc9b4dbd7f2b87 [term 18 FOLLOWER]: Advancing to term 20
I20260709 13:07:23.129032 26446 consensus_queue.cc:1059] T f93ee515a9c14139bf566522ed8232f3 P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 }, Status: INVALID_TERM, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.016s
I20260709 13:07:23.150166 19449 leader_election.cc:304] T ab43d85f64114d4ebf618930e43d9ed0 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e; no voters: 127766fc592545a4997f7790f50f6076, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:07:23.164585 20106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a16f7501e2444fb86d4e2778e734e02" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:07:23.165534 20075 leader_election.cc:304] T 85c494af21f9457a85da47b9bc70c1fd P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 127766fc592545a4997f7790f50f6076; no voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:07:23.168419 20110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85c494af21f9457a85da47b9bc70c1fd" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076"
I20260709 13:07:23.169095 20110 raft_consensus.cc:3060] T 85c494af21f9457a85da47b9bc70c1fd P 127766fc592545a4997f7790f50f6076 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:07:23.170619 19403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f85fc4b527a48848e5faa083b604e36" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
I20260709 13:07:23.171569 19526 leader_election.cc:304] T 2e36a9d6e29c4a7c860cf267efbd4c74 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e61c3a8f61bb48f8a963c9480e53c168; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:07:23.146761 25923 raft_consensus.cc:2804] T 7f575b143b844aa096b50997dad3516a P e5256d91808b47c195bc9b4dbd7f2b87 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:07:23.179777 19478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22196caba61445d3bec98a0aab3c337d" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:07:23.182602 19477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dc5b3532fe54f74876d02beffa2c230" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 23 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:07:23.184446 19481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "217b5fae677b4971b3bbd2f357a1f7ff" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:07:23.149413 26599 raft_consensus.cc:2749] T ff75a1d4cb1f493db8f71ddc136ba9ab P e5256d91808b47c195bc9b4dbd7f2b87 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:07:23.184459 20103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ec1c4ce15e04c7e8c283a62179f2a64" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:07:23.186307 19449 leader_election.cc:304] T df751f992649444090e27965eb1af85d P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87; no voters: e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:07:23.191340 19477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e1f505cb0f1427bbd698ac889d80821" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:07:23.192441 19406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40e1e16737a842ee936002830f36882e" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 24 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:07:23.193840 19406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dc5b3532fe54f74876d02beffa2c230" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 23 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:07:23.195731 20111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f85fc4b527a48848e5faa083b604e36" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076"
I20260709 13:07:23.196722 20111 raft_consensus.cc:2393] T 1f85fc4b527a48848e5faa083b604e36 P 127766fc592545a4997f7790f50f6076 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 0473d2b2d01f4459b1e90fd12cc7840e in current term 20: Already voted for candidate 127766fc592545a4997f7790f50f6076 in this term.
I20260709 13:07:23.214150 19483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ec1c4ce15e04c7e8c283a62179f2a64" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:07:23.197293 26577 raft_consensus.cc:2804] T df751f992649444090e27965eb1af85d P 0473d2b2d01f4459b1e90fd12cc7840e [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 13:07:23.195959 20075 leader_election.cc:304] T 5ec1c4ce15e04c7e8c283a62179f2a64 P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 127766fc592545a4997f7790f50f6076; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:07:23.214845 26577 raft_consensus.cc:493] T df751f992649444090e27965eb1af85d P 0473d2b2d01f4459b1e90fd12cc7840e [term 23 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:23.215224 26577 raft_consensus.cc:3060] T df751f992649444090e27965eb1af85d P 0473d2b2d01f4459b1e90fd12cc7840e [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:07:23.215911 19411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46c5bfeecc314717bffe987e6844b6d0" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 26 candidate_status { last_received { term: 25 index: 13 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:07:23.216267 26529 raft_consensus.cc:2749] T 5ec1c4ce15e04c7e8c283a62179f2a64 P 127766fc592545a4997f7790f50f6076 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:07:23.216535 19411 raft_consensus.cc:2468] T 46c5bfeecc314717bffe987e6844b6d0 P e5256d91808b47c195bc9b4dbd7f2b87 [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 25.
I20260709 13:07:23.217474 19411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff9b0eddd810459b82d91c60777c10eb" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:07:23.197783 26478 raft_consensus.cc:2749] T 2e36a9d6e29c4a7c860cf267efbd4c74 P e61c3a8f61bb48f8a963c9480e53c168 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:07:23.198316 26324 consensus_queue.cc:1048] T df751f992649444090e27965eb1af85d P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 13:07:23.200222 26555 consensus_queue.cc:1048] T 6c5eebf646ad445a9d1b1adc319d7b16 P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:07:23.203428 20112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff9b0eddd810459b82d91c60777c10eb" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:07:23.203887 26636 raft_consensus.cc:515] T 309c3ca0ca4b4f3ba129752ea2cb293b P 0473d2b2d01f4459b1e90fd12cc7840e [term 14 FOLLOWER]: Starting leader election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
W20260709 13:07:23.204908 26534 consensus_meta.cc:287] T 70797e5783b5454ab0d0eea663e791e3 P e61c3a8f61bb48f8a963c9480e53c168: Time spent flushing consensus metadata: real 0.562s	user 0.008s	sys 0.004s
I20260709 13:07:23.222744 26207 leader_election.cc:290] T f1b10566f45d4a7d9029858330e02d5b P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 21 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:07:23.222941 19555 raft_consensus.cc:1275] T 70797e5783b5454ab0d0eea663e791e3 P e61c3a8f61bb48f8a963c9480e53c168 [term 24 FOLLOWER]: Refusing update from remote peer 127766fc592545a4997f7790f50f6076: Log matching property violated. Preceding OpId in replica: term: 23 index: 16. Preceding OpId from leader: term: 24 index: 16. (term mismatch)
I20260709 13:07:23.223338 19555 pending_rounds.cc:85] T 70797e5783b5454ab0d0eea663e791e3 P e61c3a8f61bb48f8a963c9480e53c168: Aborting all ops after (but not including) 15
I20260709 13:07:23.223544 19555 pending_rounds.cc:107] T 70797e5783b5454ab0d0eea663e791e3 P e61c3a8f61bb48f8a963c9480e53c168: Aborting uncommitted NO_OP operation due to leader change: 23.16
I20260709 13:07:23.223783 19555 raft_consensus.cc:2889] T 70797e5783b5454ab0d0eea663e791e3 P e61c3a8f61bb48f8a963c9480e53c168 [term 24 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:07:23.208616 26553 raft_consensus.cc:515] T 4af19371ea874c09a0a2147040835cbb P e61c3a8f61bb48f8a963c9480e53c168 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:07:23.210409 19480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4509b76741dc428e9201c70c1658da13" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:07:23.224835 19480 raft_consensus.cc:2468] T 4509b76741dc428e9201c70c1658da13 P 0473d2b2d01f4459b1e90fd12cc7840e [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 15.
I20260709 13:07:23.210932 20109 raft_consensus.cc:3055] T 6c5eebf646ad445a9d1b1adc319d7b16 P 127766fc592545a4997f7790f50f6076 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:07:23.225555 20109 raft_consensus.cc:740] T 6c5eebf646ad445a9d1b1adc319d7b16 P 127766fc592545a4997f7790f50f6076 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 127766fc592545a4997f7790f50f6076, State: Running, Role: LEADER
I20260709 13:07:23.212980 19526 leader_election.cc:304] T 7be9efa6559648dbb5a0f7684c4542d1 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: e61c3a8f61bb48f8a963c9480e53c168; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, 127766fc592545a4997f7790f50f6076
I20260709 13:07:23.176162 26326 raft_consensus.cc:2804] T df751f992649444090e27965eb1af85d P e5256d91808b47c195bc9b4dbd7f2b87 [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 13:07:23.231386 26446 raft_consensus.cc:3055] T f93ee515a9c14139bf566522ed8232f3 P e5256d91808b47c195bc9b4dbd7f2b87 [term 24 LEADER]: Stepping down as leader of term 24
I20260709 13:07:23.231806 26446 raft_consensus.cc:740] T f93ee515a9c14139bf566522ed8232f3 P e5256d91808b47c195bc9b4dbd7f2b87 [term 24 LEADER]: Becoming Follower/Learner. State: Replica: e5256d91808b47c195bc9b4dbd7f2b87, State: Running, Role: LEADER
I20260709 13:07:23.232558 26446 consensus_queue.cc:260] T f93ee515a9c14139bf566522ed8232f3 P e5256d91808b47c195bc9b4dbd7f2b87 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 24.13, Last appended by leader: 13, Current term: 24, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:07:23.194437 19406 raft_consensus.cc:2468] T 1dc5b3532fe54f74876d02beffa2c230 P e5256d91808b47c195bc9b4dbd7f2b87 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 22.
I20260709 13:07:23.229920 19449 leader_election.cc:304] T 40e1e16737a842ee936002830f36882e P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e; no voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:07:23.172488 26531 raft_consensus.cc:2749] T ece3db938bc649d4a40a51522ed5259c P e5256d91808b47c195bc9b4dbd7f2b87 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:07:23.224349 26479 raft_consensus.cc:493] T 70797e5783b5454ab0d0eea663e791e3 P e61c3a8f61bb48f8a963c9480e53c168 [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:23.168880 26017 raft_consensus.cc:2749] T ab43d85f64114d4ebf618930e43d9ed0 P 0473d2b2d01f4459b1e90fd12cc7840e [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
W20260709 13:07:23.240211 19374 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.4:43121, user_credentials={real_user=slave}} blocked reactor thread for 76716.7us
I20260709 13:07:23.243620 26613 raft_consensus.cc:515] T 85c494af21f9457a85da47b9bc70c1fd P e61c3a8f61bb48f8a963c9480e53c168 [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:07:23.248494 26613 leader_election.cc:290] T 85c494af21f9457a85da47b9bc70c1fd P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 21 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:07:23.242264 26479 raft_consensus.cc:515] T 70797e5783b5454ab0d0eea663e791e3 P e61c3a8f61bb48f8a963c9480e53c168 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:07:23.231402 26326 raft_consensus.cc:493] T df751f992649444090e27965eb1af85d P e5256d91808b47c195bc9b4dbd7f2b87 [term 23 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:23.272403 26326 raft_consensus.cc:3060] T df751f992649444090e27965eb1af85d P e5256d91808b47c195bc9b4dbd7f2b87 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:07:23.273655 20106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4af19371ea874c09a0a2147040835cbb" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076"
I20260709 13:07:23.159373 26643 raft_consensus.cc:515] T 4af19371ea874c09a0a2147040835cbb P 127766fc592545a4997f7790f50f6076 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:07:23.184175 25923 raft_consensus.cc:493] T 7f575b143b844aa096b50997dad3516a P e5256d91808b47c195bc9b4dbd7f2b87 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:23.276299 25923 raft_consensus.cc:3060] T 7f575b143b844aa096b50997dad3516a P e5256d91808b47c195bc9b4dbd7f2b87 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:07:23.277590 20106 raft_consensus.cc:2368] T 4af19371ea874c09a0a2147040835cbb P 127766fc592545a4997f7790f50f6076 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate e61c3a8f61bb48f8a963c9480e53c168 for earlier term 13. Current term is 14.
I20260709 13:07:23.255275 20112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85c494af21f9457a85da47b9bc70c1fd" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076"
I20260709 13:07:23.260072 20110 raft_consensus.cc:2468] T 85c494af21f9457a85da47b9bc70c1fd P 127766fc592545a4997f7790f50f6076 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 21.
I20260709 13:07:23.226282 20109 consensus_queue.cc:260] T 6c5eebf646ad445a9d1b1adc319d7b16 P 127766fc592545a4997f7790f50f6076 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 19.14, Last appended by leader: 14, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:07:23.264346 19480 raft_consensus.cc:1240] T 6c5eebf646ad445a9d1b1adc319d7b16 P 0473d2b2d01f4459b1e90fd12cc7840e [term 20 FOLLOWER]: Rejecting Update request from peer 127766fc592545a4997f7790f50f6076 for earlier term 19. Current term is 20. Ops: []
I20260709 13:07:23.279657 26632 raft_consensus.cc:515] T f1b10566f45d4a7d9029858330e02d5b P e5256d91808b47c195bc9b4dbd7f2b87 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:07:23.281327 19377 leader_election.cc:304] T 5ec1c4ce15e04c7e8c283a62179f2a64 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, 127766fc592545a4997f7790f50f6076
I20260709 13:07:23.283020 19410 raft_consensus.cc:2393] T f1b10566f45d4a7d9029858330e02d5b P e5256d91808b47c195bc9b4dbd7f2b87 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0473d2b2d01f4459b1e90fd12cc7840e in current term 21: Already voted for candidate e5256d91808b47c195bc9b4dbd7f2b87 in this term.
I20260709 13:07:23.283517 26598 raft_consensus.cc:2749] T 5ec1c4ce15e04c7e8c283a62179f2a64 P e5256d91808b47c195bc9b4dbd7f2b87 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:07:23.286923 26540 raft_consensus.cc:2749] T 85c494af21f9457a85da47b9bc70c1fd P 127766fc592545a4997f7790f50f6076 [term 21 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:07:23.287304 19403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1b10566f45d4a7d9029858330e02d5b" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
I20260709 13:07:23.265172 26534 raft_consensus.cc:2749] T 7be9efa6559648dbb5a0f7684c4542d1 P e61c3a8f61bb48f8a963c9480e53c168 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:07:23.282445 19377 leader_election.cc:304] T 4509b76741dc428e9201c70c1658da13 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87; no voters: 
I20260709 13:07:23.267554 19449 leader_election.cc:304] T 46c5bfeecc314717bffe987e6844b6d0 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87; no voters: e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:07:23.293368 19551 raft_consensus.cc:1275] T f93ee515a9c14139bf566522ed8232f3 P e61c3a8f61bb48f8a963c9480e53c168 [term 25 FOLLOWER]: Refusing update from remote peer 0473d2b2d01f4459b1e90fd12cc7840e: Log matching property violated. Preceding OpId in replica: term: 23 index: 12. Preceding OpId from leader: term: 25 index: 13. (index mismatch)
W20260709 13:07:23.294040 19375 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.3:36891, user_credentials={real_user=slave}} blocked reactor thread for 133070us
I20260709 13:07:23.270829 19556 raft_consensus.cc:2468] T 4af19371ea874c09a0a2147040835cbb P e61c3a8f61bb48f8a963c9480e53c168 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 13.
I20260709 13:07:23.270875 19554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1b10566f45d4a7d9029858330e02d5b" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:07:23.294885 19554 raft_consensus.cc:3060] T f1b10566f45d4a7d9029858330e02d5b P e61c3a8f61bb48f8a963c9480e53c168 [term 19 FOLLOWER]: Advancing to term 21
I20260709 13:07:23.266616 26154 consensus_queue.cc:1059] T f93ee515a9c14139bf566522ed8232f3 P e5256d91808b47c195bc9b4dbd7f2b87 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 }, Status: INVALID_TERM, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.008s
I20260709 13:07:23.268855 26379 raft_consensus.cc:2749] T 40e1e16737a842ee936002830f36882e P 0473d2b2d01f4459b1e90fd12cc7840e [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:07:23.294807 19375 leader_election.cc:304] T 46c5bfeecc314717bffe987e6844b6d0 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:07:23.272022 26553 leader_election.cc:290] T 4af19371ea874c09a0a2147040835cbb P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 13 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:07:23.292074 19374 leader_election.cc:304] T 85c494af21f9457a85da47b9bc70c1fd P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 127766fc592545a4997f7790f50f6076, e5256d91808b47c195bc9b4dbd7f2b87; no voters: 
I20260709 13:07:23.290741 19526 leader_election.cc:304] T 4509b76741dc428e9201c70c1658da13 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:07:23.300310 19404 raft_consensus.cc:2468] T 1f85fc4b527a48848e5faa083b604e36 P e5256d91808b47c195bc9b4dbd7f2b87 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 127766fc592545a4997f7790f50f6076 in term 20.
I20260709 13:07:23.304466 19449 leader_election.cc:304] T ff9b0eddd810459b82d91c60777c10eb P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e; no voters: 127766fc592545a4997f7790f50f6076, e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:07:23.306602 26555 raft_consensus.cc:493] T 76cb037fc9064d13b59a8969d897ce8c P e61c3a8f61bb48f8a963c9480e53c168 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:23.307474 26555 raft_consensus.cc:515] T 76cb037fc9064d13b59a8969d897ce8c P e61c3a8f61bb48f8a963c9480e53c168 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:07:23.308145 26245 raft_consensus.cc:2749] T ff9b0eddd810459b82d91c60777c10eb P 0473d2b2d01f4459b1e90fd12cc7840e [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:07:23.306090 26388 raft_consensus.cc:2804] T 46c5bfeecc314717bffe987e6844b6d0 P 0473d2b2d01f4459b1e90fd12cc7840e [term 25 FOLLOWER]: Leader pre-election won for term 26
I20260709 13:07:23.309302 26388 raft_consensus.cc:493] T 46c5bfeecc314717bffe987e6844b6d0 P 0473d2b2d01f4459b1e90fd12cc7840e [term 25 FOLLOWER]: Starting leader election (detected failure of leader e61c3a8f61bb48f8a963c9480e53c168)
I20260709 13:07:23.309693 26388 raft_consensus.cc:3060] T 46c5bfeecc314717bffe987e6844b6d0 P 0473d2b2d01f4459b1e90fd12cc7840e [term 25 FOLLOWER]: Advancing to term 26
I20260709 13:07:23.309821 26643 leader_election.cc:290] T 4af19371ea874c09a0a2147040835cbb P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 14 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:07:23.298342 26599 raft_consensus.cc:2804] T 4509b76741dc428e9201c70c1658da13 P e5256d91808b47c195bc9b4dbd7f2b87 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:07:23.316180 19402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4af19371ea874c09a0a2147040835cbb" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
I20260709 13:07:23.313390 19411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f575b143b844aa096b50997dad3516a" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:07:23.318742 19449 leader_election.cc:304] T 1f85fc4b527a48848e5faa083b604e36 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e; no voters: 127766fc592545a4997f7790f50f6076, e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:07:23.313614 19551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4af19371ea874c09a0a2147040835cbb" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:07:23.298180 26154 consensus_queue.cc:1243] T f93ee515a9c14139bf566522ed8232f3 P e5256d91808b47c195bc9b4dbd7f2b87 [NON_LEADER]: Peer 0473d2b2d01f4459b1e90fd12cc7840e log is divergent from this leader: its last log entry 25.13 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 11
I20260709 13:07:23.349306 19449 leader_election.cc:304] T 1dc5b3532fe54f74876d02beffa2c230 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87; no voters: e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:07:23.349987 19554 raft_consensus.cc:2468] T f1b10566f45d4a7d9029858330e02d5b P e61c3a8f61bb48f8a963c9480e53c168 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 21.
I20260709 13:07:23.311513 26598 raft_consensus.cc:2749] T 46c5bfeecc314717bffe987e6844b6d0 P e5256d91808b47c195bc9b4dbd7f2b87 [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 13:07:23.328706 26599 raft_consensus.cc:493] T 4509b76741dc428e9201c70c1658da13 P e5256d91808b47c195bc9b4dbd7f2b87 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:23.332628 26531 raft_consensus.cc:2804] T 85c494af21f9457a85da47b9bc70c1fd P e5256d91808b47c195bc9b4dbd7f2b87 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:07:23.293334 26647 raft_consensus.cc:515] T 4af19371ea874c09a0a2147040835cbb P e5256d91808b47c195bc9b4dbd7f2b87 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:07:23.352620 19450 leader_election.cc:304] T f1b10566f45d4a7d9029858330e02d5b P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:07:23.347226 26648 raft_consensus.cc:2749] T 1f85fc4b527a48848e5faa083b604e36 P 0473d2b2d01f4459b1e90fd12cc7840e [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 13:07:23.305878 26617 raft_consensus.cc:2804] T 4509b76741dc428e9201c70c1658da13 P e61c3a8f61bb48f8a963c9480e53c168 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:07:23.383033 26617 raft_consensus.cc:493] T 4509b76741dc428e9201c70c1658da13 P e61c3a8f61bb48f8a963c9480e53c168 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:23.342361 26649 raft_consensus.cc:515] T 217b5fae677b4971b3bbd2f357a1f7ff P 0473d2b2d01f4459b1e90fd12cc7840e [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:07:23.383570 26617 raft_consensus.cc:3060] T 4509b76741dc428e9201c70c1658da13 P e61c3a8f61bb48f8a963c9480e53c168 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:07:23.385370 26649 leader_election.cc:290] T 217b5fae677b4971b3bbd2f357a1f7ff P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 19 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:07:23.340240 26643 consensus_queue.cc:1048] T 70797e5783b5454ab0d0eea663e791e3 P 127766fc592545a4997f7790f50f6076 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.027s
I20260709 13:07:23.387070 26379 raft_consensus.cc:2804] T 1dc5b3532fe54f74876d02beffa2c230 P 0473d2b2d01f4459b1e90fd12cc7840e [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:07:23.387651 26379 raft_consensus.cc:493] T 1dc5b3532fe54f74876d02beffa2c230 P 0473d2b2d01f4459b1e90fd12cc7840e [term 22 FOLLOWER]: Starting leader election (detected failure of leader e61c3a8f61bb48f8a963c9480e53c168)
I20260709 13:07:23.388116 26379 raft_consensus.cc:3060] T 1dc5b3532fe54f74876d02beffa2c230 P 0473d2b2d01f4459b1e90fd12cc7840e [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:07:23.388540 26647 leader_election.cc:290] T 4af19371ea874c09a0a2147040835cbb P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 14 election: Requested vote from peers e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:07:23.346740 26245 raft_consensus.cc:493] T bc225c93219c45538b53a1bd3d387e4d P 0473d2b2d01f4459b1e90fd12cc7840e [term 18 FOLLOWER]: Starting pre-election (detected failure of leader e61c3a8f61bb48f8a963c9480e53c168)
I20260709 13:07:23.342864 26241 consensus_queue.cc:1048] T f93ee515a9c14139bf566522ed8232f3 P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.038s
I20260709 13:07:23.390842 26531 raft_consensus.cc:697] T 85c494af21f9457a85da47b9bc70c1fd P e5256d91808b47c195bc9b4dbd7f2b87 [term 21 LEADER]: Becoming Leader. State: Replica: e5256d91808b47c195bc9b4dbd7f2b87, State: Running, Role: LEADER
I20260709 13:07:23.391851 26531 consensus_queue.cc:237] T 85c494af21f9457a85da47b9bc70c1fd P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 19.15, Last appended by leader: 15, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:07:23.394408 19554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "217b5fae677b4971b3bbd2f357a1f7ff" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:07:23.390470 26431 raft_consensus.cc:2804] T f1b10566f45d4a7d9029858330e02d5b P 0473d2b2d01f4459b1e90fd12cc7840e [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:07:23.379484 26632 leader_election.cc:290] T f1b10566f45d4a7d9029858330e02d5b P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 21 election: Requested vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:07:23.306473 26642 consensus_queue.cc:1059] T 6c5eebf646ad445a9d1b1adc319d7b16 P 127766fc592545a4997f7790f50f6076 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 }, Status: INVALID_TERM, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.056s
I20260709 13:07:23.397464 19402 raft_consensus.cc:2393] T 4af19371ea874c09a0a2147040835cbb P e5256d91808b47c195bc9b4dbd7f2b87 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 127766fc592545a4997f7790f50f6076 in current term 14: Already voted for candidate e5256d91808b47c195bc9b4dbd7f2b87 in this term.
I20260709 13:07:23.397830 19409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4509b76741dc428e9201c70c1658da13" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 16 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:07:23.403698 19479 raft_consensus.cc:1240] T 217b5fae677b4971b3bbd2f357a1f7ff P 0473d2b2d01f4459b1e90fd12cc7840e [term 19 FOLLOWER]: Rejecting Update request from peer e61c3a8f61bb48f8a963c9480e53c168 for earlier term 18. Current term is 19. Ops: []
I20260709 13:07:23.390105 26577 raft_consensus.cc:515] T df751f992649444090e27965eb1af85d P 0473d2b2d01f4459b1e90fd12cc7840e [term 24 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:07:23.412232 19404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef32ce6fdd0e40d382c79974f30295c6" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 24 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:07:23.359993 26599 raft_consensus.cc:3060] T 4509b76741dc428e9201c70c1658da13 P e5256d91808b47c195bc9b4dbd7f2b87 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:07:23.415088 26431 raft_consensus.cc:697] T f1b10566f45d4a7d9029858330e02d5b P 0473d2b2d01f4459b1e90fd12cc7840e [term 21 LEADER]: Becoming Leader. State: Replica: 0473d2b2d01f4459b1e90fd12cc7840e, State: Running, Role: LEADER
I20260709 13:07:23.416157 26431 consensus_queue.cc:237] T f1b10566f45d4a7d9029858330e02d5b P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 19.12, Last appended by leader: 12, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:07:23.418923 19405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7be9efa6559648dbb5a0f7684c4542d1" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:07:23.426038 26555 leader_election.cc:290] T 76cb037fc9064d13b59a8969d897ce8c P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:07:23.390990 26245 raft_consensus.cc:515] T bc225c93219c45538b53a1bd3d387e4d P 0473d2b2d01f4459b1e90fd12cc7840e [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:07:23.439954 20075 leader_election.cc:304] T 1f85fc4b527a48848e5faa083b604e36 P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 127766fc592545a4997f7790f50f6076, e5256d91808b47c195bc9b4dbd7f2b87; no voters: 0473d2b2d01f4459b1e90fd12cc7840e
I20260709 13:07:23.441792 26245 leader_election.cc:290] T bc225c93219c45538b53a1bd3d387e4d P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:07:23.442392 26642 raft_consensus.cc:2804] T 1f85fc4b527a48848e5faa083b604e36 P 127766fc592545a4997f7790f50f6076 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:07:23.443005 26642 raft_consensus.cc:697] T 1f85fc4b527a48848e5faa083b604e36 P 127766fc592545a4997f7790f50f6076 [term 20 LEADER]: Becoming Leader. State: Replica: 127766fc592545a4997f7790f50f6076, State: Running, Role: LEADER
I20260709 13:07:23.443914 26642 consensus_queue.cc:237] T 1f85fc4b527a48848e5faa083b604e36 P 127766fc592545a4997f7790f50f6076 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 18.14, Last appended by leader: 14, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:07:23.444962 26479 leader_election.cc:290] T 70797e5783b5454ab0d0eea663e791e3 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:07:23.404903 26636 leader_election.cc:290] T 309c3ca0ca4b4f3ba129752ea2cb293b P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 14 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:07:23.460682 19556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc225c93219c45538b53a1bd3d387e4d" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:07:23.461046 20103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4af19371ea874c09a0a2147040835cbb" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076"
I20260709 13:07:23.464461 19403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85c494af21f9457a85da47b9bc70c1fd" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
I20260709 13:07:23.467679 20103 raft_consensus.cc:2393] T 4af19371ea874c09a0a2147040835cbb P 127766fc592545a4997f7790f50f6076 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate e5256d91808b47c195bc9b4dbd7f2b87 in current term 14: Already voted for candidate 127766fc592545a4997f7790f50f6076 in this term.
I20260709 13:07:23.481784 19479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1b10566f45d4a7d9029858330e02d5b" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:07:23.467918 26645 raft_consensus.cc:2749] T 0afb57ae58a24a01850491d69f0213dd P 127766fc592545a4997f7790f50f6076 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:07:23.501076 19405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4af19371ea874c09a0a2147040835cbb" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
I20260709 13:07:23.505801 26446 raft_consensus.cc:3060] T f93ee515a9c14139bf566522ed8232f3 P e5256d91808b47c195bc9b4dbd7f2b87 [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:07:23.509702 20109 raft_consensus.cc:3060] T 6c5eebf646ad445a9d1b1adc319d7b16 P 127766fc592545a4997f7790f50f6076 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:07:23.513216 26617 raft_consensus.cc:515] T 4509b76741dc428e9201c70c1658da13 P e61c3a8f61bb48f8a963c9480e53c168 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
W20260709 13:07:23.521171 19449 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.1:40321, user_credentials={real_user=slave}} blocked reactor thread for 155548us
I20260709 13:07:23.527395 19559 raft_consensus.cc:1240] T 6c5eebf646ad445a9d1b1adc319d7b16 P e61c3a8f61bb48f8a963c9480e53c168 [term 20 LEADER]: Rejecting Update request from peer 127766fc592545a4997f7790f50f6076 for earlier term 19. Current term is 20. Ops: []
I20260709 13:07:23.538131 19560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a16f7501e2444fb86d4e2778e734e02" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:07:23.539502 19403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "217b5fae677b4971b3bbd2f357a1f7ff" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
I20260709 13:07:23.543329 19404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "309c3ca0ca4b4f3ba129752ea2cb293b" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
I20260709 13:07:23.543876 19404 raft_consensus.cc:3060] T 309c3ca0ca4b4f3ba129752ea2cb293b P e5256d91808b47c195bc9b4dbd7f2b87 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:07:23.547104 19552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22196caba61445d3bec98a0aab3c337d" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:07:23.548380 19407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76cb037fc9064d13b59a8969d897ce8c" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:07:23.529328 19523 leader_election.cc:400] T 4af19371ea874c09a0a2147040835cbb P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 13 election: Vote denied by peer 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121) with higher term. Message: Invalid argument: T 4af19371ea874c09a0a2147040835cbb P 127766fc592545a4997f7790f50f6076 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate e61c3a8f61bb48f8a963c9480e53c168 for earlier term 13. Current term is 14.
I20260709 13:07:23.549154 19407 raft_consensus.cc:2468] T 76cb037fc9064d13b59a8969d897ce8c P e5256d91808b47c195bc9b4dbd7f2b87 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 21.
I20260709 13:07:23.549448 19523 leader_election.cc:403] T 4af19371ea874c09a0a2147040835cbb P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 13 election: Cancelling election due to peer responding with higher term
I20260709 13:07:23.548405 19558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4509b76741dc428e9201c70c1658da13" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:07:23.551023 20110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "309c3ca0ca4b4f3ba129752ea2cb293b" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076"
I20260709 13:07:23.551741 20110 raft_consensus.cc:3060] T 309c3ca0ca4b4f3ba129752ea2cb293b P 127766fc592545a4997f7790f50f6076 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:07:23.555441 19552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e1f505cb0f1427bbd698ac889d80821" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:07:23.556285 19558 raft_consensus.cc:2393] T 4509b76741dc428e9201c70c1658da13 P e61c3a8f61bb48f8a963c9480e53c168 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e5256d91808b47c195bc9b4dbd7f2b87 in current term 16: Already voted for candidate e61c3a8f61bb48f8a963c9480e53c168 in this term.
I20260709 13:07:23.557056 19553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dc5b3532fe54f74876d02beffa2c230" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 23 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:07:23.564548 19404 raft_consensus.cc:2468] T 309c3ca0ca4b4f3ba129752ea2cb293b P e5256d91808b47c195bc9b4dbd7f2b87 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 14.
W20260709 13:07:23.525782 26666 log.cc:927] Time spent T 0afb57ae58a24a01850491d69f0213dd P 127766fc592545a4997f7790f50f6076: Append to log took a long time: real 0.080s	user 0.000s	sys 0.003s
I20260709 13:07:23.577011 19559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "217b5fae677b4971b3bbd2f357a1f7ff" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:07:23.582963 19477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76cb037fc9064d13b59a8969d897ce8c" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:07:23.583892 19477 raft_consensus.cc:2468] T 76cb037fc9064d13b59a8969d897ce8c P 0473d2b2d01f4459b1e90fd12cc7840e [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 21.
I20260709 13:07:23.594434 19481 raft_consensus.cc:1240] T df751f992649444090e27965eb1af85d P 0473d2b2d01f4459b1e90fd12cc7840e [term 24 FOLLOWER]: Rejecting Update request from peer e61c3a8f61bb48f8a963c9480e53c168 for earlier term 23. Current term is 24. Ops: [23.15-23.15]
I20260709 13:07:23.596489 20109 raft_consensus.cc:1275] T 6c5eebf646ad445a9d1b1adc319d7b16 P 127766fc592545a4997f7790f50f6076 [term 20 FOLLOWER]: Refusing update from remote peer e61c3a8f61bb48f8a963c9480e53c168: Log matching property violated. Preceding OpId in replica: term: 19 index: 14. Preceding OpId from leader: term: 20 index: 14. (term mismatch)
I20260709 13:07:23.596899 19407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc225c93219c45538b53a1bd3d387e4d" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:07:23.597167 20109 pending_rounds.cc:85] T 6c5eebf646ad445a9d1b1adc319d7b16 P 127766fc592545a4997f7790f50f6076: Aborting all ops after (but not including) 13
I20260709 13:07:23.597503 20109 pending_rounds.cc:107] T 6c5eebf646ad445a9d1b1adc319d7b16 P 127766fc592545a4997f7790f50f6076: Aborting uncommitted NO_OP operation due to leader change: 19.14
I20260709 13:07:23.598088 20109 raft_consensus.cc:2889] T 6c5eebf646ad445a9d1b1adc319d7b16 P 127766fc592545a4997f7790f50f6076 [term 20 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:07:23.596285 19558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85c494af21f9457a85da47b9bc70c1fd" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:07:23.601564 19523 leader_election.cc:304] T ef32ce6fdd0e40d382c79974f30295c6 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e61c3a8f61bb48f8a963c9480e53c168; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:07:23.602367 26324 raft_consensus.cc:2749] T ef32ce6fdd0e40d382c79974f30295c6 P e61c3a8f61bb48f8a963c9480e53c168 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:07:23.613476 19558 raft_consensus.cc:2393] T 85c494af21f9457a85da47b9bc70c1fd P e61c3a8f61bb48f8a963c9480e53c168 [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate e5256d91808b47c195bc9b4dbd7f2b87 in current term 21: Already voted for candidate e61c3a8f61bb48f8a963c9480e53c168 in this term.
I20260709 13:07:23.615427 20110 raft_consensus.cc:2468] T 309c3ca0ca4b4f3ba129752ea2cb293b P 127766fc592545a4997f7790f50f6076 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 14.
I20260709 13:07:23.603653 19523 leader_election.cc:304] T 85c494af21f9457a85da47b9bc70c1fd P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e61c3a8f61bb48f8a963c9480e53c168; no voters: 127766fc592545a4997f7790f50f6076, e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:07:23.646466 19558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1b10566f45d4a7d9029858330e02d5b" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:07:23.647291 19558 raft_consensus.cc:2393] T f1b10566f45d4a7d9029858330e02d5b P e61c3a8f61bb48f8a963c9480e53c168 [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate e5256d91808b47c195bc9b4dbd7f2b87 in current term 21: Already voted for candidate 0473d2b2d01f4459b1e90fd12cc7840e in this term.
I20260709 13:07:23.663004 26615 raft_consensus.cc:2749] T 85c494af21f9457a85da47b9bc70c1fd P e61c3a8f61bb48f8a963c9480e53c168 [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
W20260709 13:07:23.666926 19449 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.4:43121, user_credentials={real_user=slave}} blocked reactor thread for 70520.9us
I20260709 13:07:23.670288 19408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df751f992649444090e27965eb1af85d" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 24 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
I20260709 13:07:23.558341 26534 consensus_queue.cc:1059] T 217b5fae677b4971b3bbd2f357a1f7ff P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 }, Status: INVALID_TERM, Last received: 18.11, Next index: 12, Last known committed idx: 9, Time since last communication: 0.077s
I20260709 13:07:23.628598 19559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4af19371ea874c09a0a2147040835cbb" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:07:23.574226 26602 raft_consensus.cc:3060] T 4af19371ea874c09a0a2147040835cbb P e61c3a8f61bb48f8a963c9480e53c168 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:07:23.674998 19526 leader_election.cc:304] T 76cb037fc9064d13b59a8969d897ce8c P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:07:23.575321 26326 raft_consensus.cc:515] T df751f992649444090e27965eb1af85d P e5256d91808b47c195bc9b4dbd7f2b87 [term 24 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:07:23.680780 26324 raft_consensus.cc:2804] T 76cb037fc9064d13b59a8969d897ce8c P e61c3a8f61bb48f8a963c9480e53c168 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:07:23.684036 19405 raft_consensus.cc:1275] T f93ee515a9c14139bf566522ed8232f3 P e5256d91808b47c195bc9b4dbd7f2b87 [term 25 FOLLOWER]: Refusing update from remote peer 0473d2b2d01f4459b1e90fd12cc7840e: Log matching property violated. Preceding OpId in replica: term: 24 index: 13. Preceding OpId from leader: term: 25 index: 13. (term mismatch)
I20260709 13:07:23.685456 19405 pending_rounds.cc:85] T f93ee515a9c14139bf566522ed8232f3 P e5256d91808b47c195bc9b4dbd7f2b87: Aborting all ops after (but not including) 12
I20260709 13:07:23.685778 19405 pending_rounds.cc:107] T f93ee515a9c14139bf566522ed8232f3 P e5256d91808b47c195bc9b4dbd7f2b87: Aborting uncommitted NO_OP operation due to leader change: 24.13
I20260709 13:07:23.686072 19405 raft_consensus.cc:2889] T f93ee515a9c14139bf566522ed8232f3 P e5256d91808b47c195bc9b4dbd7f2b87 [term 25 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:07:23.687220 19449 leader_election.cc:304] T 217b5fae677b4971b3bbd2f357a1f7ff P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e; no voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:07:23.599386 25923 raft_consensus.cc:515] T 7f575b143b844aa096b50997dad3516a P e5256d91808b47c195bc9b4dbd7f2b87 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:07:23.699168 19449 leader_election.cc:304] T 309c3ca0ca4b4f3ba129752ea2cb293b P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87; no voters: 
I20260709 13:07:23.702023 19449 leader_election.cc:304] T bc225c93219c45538b53a1bd3d387e4d P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e; no voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:07:23.707870 19406 raft_consensus.cc:1240] T df751f992649444090e27965eb1af85d P e5256d91808b47c195bc9b4dbd7f2b87 [term 24 FOLLOWER]: Rejecting Update request from peer e61c3a8f61bb48f8a963c9480e53c168 for earlier term 23. Current term is 24. Ops: []
I20260709 13:07:23.710660 19411 raft_consensus.cc:2368] T 7f575b143b844aa096b50997dad3516a P e5256d91808b47c195bc9b4dbd7f2b87 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e61c3a8f61bb48f8a963c9480e53c168 for earlier term 19. Current term is 20.
I20260709 13:07:23.683146 26577 leader_election.cc:290] T df751f992649444090e27965eb1af85d P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 24 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:07:23.689576 26324 raft_consensus.cc:493] T 76cb037fc9064d13b59a8969d897ce8c P e61c3a8f61bb48f8a963c9480e53c168 [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:23.716043 26241 raft_consensus.cc:2749] T bc225c93219c45538b53a1bd3d387e4d P 0473d2b2d01f4459b1e90fd12cc7840e [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:07:23.704139 26447 raft_consensus.cc:2749] T 217b5fae677b4971b3bbd2f357a1f7ff P 0473d2b2d01f4459b1e90fd12cc7840e [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:07:23.709981 26574 raft_consensus.cc:2804] T 309c3ca0ca4b4f3ba129752ea2cb293b P 0473d2b2d01f4459b1e90fd12cc7840e [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:07:23.724195 26574 raft_consensus.cc:697] T 309c3ca0ca4b4f3ba129752ea2cb293b P 0473d2b2d01f4459b1e90fd12cc7840e [term 14 LEADER]: Becoming Leader. State: Replica: 0473d2b2d01f4459b1e90fd12cc7840e, State: Running, Role: LEADER
I20260709 13:07:23.725023 26574 consensus_queue.cc:237] T 309c3ca0ca4b4f3ba129752ea2cb293b P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 12.12, Last appended by leader: 12, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:07:23.728060 26617 leader_election.cc:290] T 4509b76741dc428e9201c70c1658da13 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 16 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:07:23.729923 25923 leader_election.cc:290] T 7f575b143b844aa096b50997dad3516a P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 20 election: Requested vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:07:23.702481 26615 consensus_queue.cc:1059] T df751f992649444090e27965eb1af85d P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 }, Status: INVALID_TERM, Last received: 22.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.021s
I20260709 13:07:23.731480 26326 leader_election.cc:290] T df751f992649444090e27965eb1af85d P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 24 election: Requested vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:07:23.731441 26615 raft_consensus.cc:3055] T df751f992649444090e27965eb1af85d P e61c3a8f61bb48f8a963c9480e53c168 [term 23 LEADER]: Stepping down as leader of term 23
I20260709 13:07:23.732487 26615 raft_consensus.cc:740] T df751f992649444090e27965eb1af85d P e61c3a8f61bb48f8a963c9480e53c168 [term 23 LEADER]: Becoming Follower/Learner. State: Replica: e61c3a8f61bb48f8a963c9480e53c168, State: Running, Role: LEADER
I20260709 13:07:23.733584 26615 consensus_queue.cc:260] T df751f992649444090e27965eb1af85d P e61c3a8f61bb48f8a963c9480e53c168 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 23.15, Last appended by leader: 15, Current term: 23, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:07:23.735345 26615 raft_consensus.cc:3060] T df751f992649444090e27965eb1af85d P e61c3a8f61bb48f8a963c9480e53c168 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:07:23.730139 26599 raft_consensus.cc:515] T 4509b76741dc428e9201c70c1658da13 P e5256d91808b47c195bc9b4dbd7f2b87 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:07:23.739846 19409 raft_consensus.cc:2393] T 4509b76741dc428e9201c70c1658da13 P e5256d91808b47c195bc9b4dbd7f2b87 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e61c3a8f61bb48f8a963c9480e53c168 in current term 16: Already voted for candidate e5256d91808b47c195bc9b4dbd7f2b87 in this term.
I20260709 13:07:23.741964 26599 leader_election.cc:290] T 4509b76741dc428e9201c70c1658da13 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 16 election: Requested vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:07:23.715415 26324 raft_consensus.cc:3060] T 76cb037fc9064d13b59a8969d897ce8c P e61c3a8f61bb48f8a963c9480e53c168 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:07:23.720139 26431 raft_consensus.cc:493] T 2e36a9d6e29c4a7c860cf267efbd4c74 P 0473d2b2d01f4459b1e90fd12cc7840e [term 15 FOLLOWER]: Starting pre-election (detected failure of leader e5256d91808b47c195bc9b4dbd7f2b87)
I20260709 13:07:23.750361 26388 raft_consensus.cc:515] T 46c5bfeecc314717bffe987e6844b6d0 P 0473d2b2d01f4459b1e90fd12cc7840e [term 26 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:07:23.771003 26431 raft_consensus.cc:515] T 2e36a9d6e29c4a7c860cf267efbd4c74 P 0473d2b2d01f4459b1e90fd12cc7840e [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:07:23.772365 26388 leader_election.cc:290] T 46c5bfeecc314717bffe987e6844b6d0 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 26 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:07:23.773053 26431 leader_election.cc:290] T 2e36a9d6e29c4a7c860cf267efbd4c74 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:07:23.773729 19485 raft_consensus.cc:1240] T 46c5bfeecc314717bffe987e6844b6d0 P 0473d2b2d01f4459b1e90fd12cc7840e [term 26 FOLLOWER]: Rejecting Update request from peer e61c3a8f61bb48f8a963c9480e53c168 for earlier term 25. Current term is 26. Ops: []
I20260709 13:07:23.767745 26207 consensus_queue.cc:1048] T f93ee515a9c14139bf566522ed8232f3 P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.008s
I20260709 13:07:23.779696 19408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e36a9d6e29c4a7c860cf267efbd4c74" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
W20260709 13:07:23.783350 19526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.2:46257, user_credentials={real_user=slave}} blocked reactor thread for 86281.8us
I20260709 13:07:23.783542 19405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46c5bfeecc314717bffe987e6844b6d0" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 26 candidate_status { last_received { term: 25 index: 13 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
I20260709 13:07:23.788865 26379 raft_consensus.cc:515] T 1dc5b3532fe54f74876d02beffa2c230 P 0473d2b2d01f4459b1e90fd12cc7840e [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:07:23.795612 19486 raft_consensus.cc:1240] T 1dc5b3532fe54f74876d02beffa2c230 P 0473d2b2d01f4459b1e90fd12cc7840e [term 23 FOLLOWER]: Rejecting Update request from peer e61c3a8f61bb48f8a963c9480e53c168 for earlier term 22. Current term is 23. Ops: []
I20260709 13:07:23.797353 26379 leader_election.cc:290] T 1dc5b3532fe54f74876d02beffa2c230 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 23 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:07:23.814379 19482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4509b76741dc428e9201c70c1658da13" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 16 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:07:23.815112 19482 raft_consensus.cc:3060] T 4509b76741dc428e9201c70c1658da13 P 0473d2b2d01f4459b1e90fd12cc7840e [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:07:23.815814 19405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dc5b3532fe54f74876d02beffa2c230" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 23 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
I20260709 13:07:23.826476 19482 raft_consensus.cc:2468] T 4509b76741dc428e9201c70c1658da13 P 0473d2b2d01f4459b1e90fd12cc7840e [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 16.
I20260709 13:07:23.828068 19526 leader_election.cc:304] T 4509b76741dc428e9201c70c1658da13 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:07:23.823824 26324 raft_consensus.cc:515] T 76cb037fc9064d13b59a8969d897ce8c P e61c3a8f61bb48f8a963c9480e53c168 [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:07:23.832445 26553 raft_consensus.cc:2804] T 4509b76741dc428e9201c70c1658da13 P e61c3a8f61bb48f8a963c9480e53c168 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:07:23.832979 26553 raft_consensus.cc:697] T 4509b76741dc428e9201c70c1658da13 P e61c3a8f61bb48f8a963c9480e53c168 [term 16 LEADER]: Becoming Leader. State: Replica: e61c3a8f61bb48f8a963c9480e53c168, State: Running, Role: LEADER
I20260709 13:07:23.833841 26553 consensus_queue.cc:237] T 4509b76741dc428e9201c70c1658da13 P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
W20260709 13:07:23.837409 19523 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:23.842584 26479 raft_consensus.cc:3055] T 217b5fae677b4971b3bbd2f357a1f7ff P e61c3a8f61bb48f8a963c9480e53c168 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:07:23.843068 26479 raft_consensus.cc:740] T 217b5fae677b4971b3bbd2f357a1f7ff P e61c3a8f61bb48f8a963c9480e53c168 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: e61c3a8f61bb48f8a963c9480e53c168, State: Running, Role: LEADER
I20260709 13:07:23.843914 26479 consensus_queue.cc:260] T 217b5fae677b4971b3bbd2f357a1f7ff P e61c3a8f61bb48f8a963c9480e53c168 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.11, Last appended by leader: 11, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:07:23.845239 26479 raft_consensus.cc:3060] T 217b5fae677b4971b3bbd2f357a1f7ff P e61c3a8f61bb48f8a963c9480e53c168 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:07:23.855268 19553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df751f992649444090e27965eb1af85d" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 24 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:07:23.856156 19553 raft_consensus.cc:2410] T df751f992649444090e27965eb1af85d P e61c3a8f61bb48f8a963c9480e53c168 [term 24 FOLLOWER]: Leader election vote request: Denying vote to candidate 0473d2b2d01f4459b1e90fd12cc7840e for term 24 because replica has last-logged OpId of term: 23 index: 15, which is greater than that of the candidate, which has last-logged OpId of term: 22 index: 14.
I20260709 13:07:23.868955 19555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e36a9d6e29c4a7c860cf267efbd4c74" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:07:23.869182 19560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dc5b3532fe54f74876d02beffa2c230" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 23 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:07:23.869463 19551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46c5bfeecc314717bffe987e6844b6d0" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 26 candidate_status { last_received { term: 25 index: 13 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
W20260709 13:07:23.875346 26669 log.cc:927] Time spent T 5ec1c4ce15e04c7e8c283a62179f2a64 P 0473d2b2d01f4459b1e90fd12cc7840e: Append to log took a long time: real 0.195s	user 0.003s	sys 0.000s
I20260709 13:07:23.880595 20075 leader_election.cc:304] T 4af19371ea874c09a0a2147040835cbb P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 127766fc592545a4997f7790f50f6076; no voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:07:23.858752 26602 raft_consensus.cc:2749] T 4af19371ea874c09a0a2147040835cbb P e61c3a8f61bb48f8a963c9480e53c168 [term 14 FOLLOWER]: Leader election lost for term 13. Reason: Vote denied by peer 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121) with higher term. Message: Invalid argument: T 4af19371ea874c09a0a2147040835cbb P 127766fc592545a4997f7790f50f6076 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate e61c3a8f61bb48f8a963c9480e53c168 for earlier term 13. Current term is 14.
I20260709 13:07:23.884166 19375 leader_election.cc:304] T 2a16f7501e2444fb86d4e2778e734e02 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87; no voters: 127766fc592545a4997f7790f50f6076, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:07:23.885329 19375 leader_election.cc:304] T 22196caba61445d3bec98a0aab3c337d P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:07:23.885882 26295 raft_consensus.cc:2749] T 4af19371ea874c09a0a2147040835cbb P 127766fc592545a4997f7790f50f6076 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:07:23.886759 26275 raft_consensus.cc:2749] T 22196caba61445d3bec98a0aab3c337d P e5256d91808b47c195bc9b4dbd7f2b87 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:07:23.885435 26097 raft_consensus.cc:2749] T 2a16f7501e2444fb86d4e2778e734e02 P e5256d91808b47c195bc9b4dbd7f2b87 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:07:23.893884 20106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70797e5783b5454ab0d0eea663e791e3" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 25 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:07:23.895018 26683 consensus_queue.cc:1048] T 6c5eebf646ad445a9d1b1adc319d7b16 P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Connected to new peer: Peer: permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:07:23.886390 19375 leader_election.cc:304] T 1dc5b3532fe54f74876d02beffa2c230 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:07:23.855131 26615 consensus_queue.cc:1059] T 1dc5b3532fe54f74876d02beffa2c230 P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 }, Status: INVALID_TERM, Last received: 22.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:07:23.903323 19559 raft_consensus.cc:2468] T 4af19371ea874c09a0a2147040835cbb P e61c3a8f61bb48f8a963c9480e53c168 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 14.
I20260709 13:07:23.906301 19450 leader_election.cc:304] T df751f992649444090e27965eb1af85d P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 24 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e; no voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:07:23.916401 19450 leader_election.cc:304] T 2e36a9d6e29c4a7c860cf267efbd4c74 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e; no voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:07:23.919834 19450 leader_election.cc:304] T 1dc5b3532fe54f74876d02beffa2c230 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 23 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e; no voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:07:23.908020 26647 raft_consensus.cc:2749] T 1dc5b3532fe54f74876d02beffa2c230 P e5256d91808b47c195bc9b4dbd7f2b87 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:07:23.921801 19450 leader_election.cc:304] T 46c5bfeecc314717bffe987e6844b6d0 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 26 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e; no voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:07:23.918124 26534 raft_consensus.cc:3055] T 1dc5b3532fe54f74876d02beffa2c230 P e61c3a8f61bb48f8a963c9480e53c168 [term 22 LEADER]: Stepping down as leader of term 22
I20260709 13:07:23.929104 26534 raft_consensus.cc:740] T 1dc5b3532fe54f74876d02beffa2c230 P e61c3a8f61bb48f8a963c9480e53c168 [term 22 LEADER]: Becoming Follower/Learner. State: Replica: e61c3a8f61bb48f8a963c9480e53c168, State: Running, Role: LEADER
I20260709 13:07:23.929982 26534 consensus_queue.cc:260] T 1dc5b3532fe54f74876d02beffa2c230 P e61c3a8f61bb48f8a963c9480e53c168 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 22.12, Last appended by leader: 12, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:07:23.917893 26577 raft_consensus.cc:2749] T df751f992649444090e27965eb1af85d P 0473d2b2d01f4459b1e90fd12cc7840e [term 24 FOLLOWER]: Leader election lost for term 24. Reason: could not achieve majority
I20260709 13:07:23.908147 26017 raft_consensus.cc:493] T edd7d470b5014c9489be7f41f64355c9 P 0473d2b2d01f4459b1e90fd12cc7840e [term 26 FOLLOWER]: Starting pre-election (detected failure of leader e5256d91808b47c195bc9b4dbd7f2b87)
I20260709 13:07:23.932088 26017 raft_consensus.cc:515] T edd7d470b5014c9489be7f41f64355c9 P 0473d2b2d01f4459b1e90fd12cc7840e [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:07:23.934188 26017 leader_election.cc:290] T edd7d470b5014c9489be7f41f64355c9 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:07:23.925201 26379 raft_consensus.cc:2749] T 1dc5b3532fe54f74876d02beffa2c230 P 0473d2b2d01f4459b1e90fd12cc7840e [term 23 FOLLOWER]: Leader election lost for term 23. Reason: could not achieve majority
I20260709 13:07:23.923722 26555 consensus_queue.cc:1059] T 46c5bfeecc314717bffe987e6844b6d0 P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 }, Status: INVALID_TERM, Last received: 25.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.013s
I20260709 13:07:23.937775 26683 raft_consensus.cc:3055] T 46c5bfeecc314717bffe987e6844b6d0 P e61c3a8f61bb48f8a963c9480e53c168 [term 25 LEADER]: Stepping down as leader of term 25
I20260709 13:07:23.938174 26683 raft_consensus.cc:740] T 46c5bfeecc314717bffe987e6844b6d0 P e61c3a8f61bb48f8a963c9480e53c168 [term 25 LEADER]: Becoming Follower/Learner. State: Replica: e61c3a8f61bb48f8a963c9480e53c168, State: Running, Role: LEADER
I20260709 13:07:23.924264 26636 raft_consensus.cc:2749] T 2e36a9d6e29c4a7c860cf267efbd4c74 P 0473d2b2d01f4459b1e90fd12cc7840e [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:07:23.944664 19410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edd7d470b5014c9489be7f41f64355c9" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 27 candidate_status { last_received { term: 26 index: 14 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:07:23.939014 26683 consensus_queue.cc:260] T 46c5bfeecc314717bffe987e6844b6d0 P e61c3a8f61bb48f8a963c9480e53c168 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 25.13, Last appended by leader: 13, Current term: 25, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:07:23.947214 19375 leader_election.cc:304] T 217b5fae677b4971b3bbd2f357a1f7ff P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:07:23.948318 19375 leader_election.cc:304] T 3e1f505cb0f1427bbd698ac889d80821 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:07:23.953678 26683 raft_consensus.cc:3060] T 46c5bfeecc314717bffe987e6844b6d0 P e61c3a8f61bb48f8a963c9480e53c168 [term 25 FOLLOWER]: Advancing to term 26
I20260709 13:07:23.954269 26324 leader_election.cc:290] T 76cb037fc9064d13b59a8969d897ce8c P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 22 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:07:23.949115 26647 raft_consensus.cc:2749] T 217b5fae677b4971b3bbd2f357a1f7ff P e5256d91808b47c195bc9b4dbd7f2b87 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:07:23.957288 26632 raft_consensus.cc:2749] T 3e1f505cb0f1427bbd698ac889d80821 P e5256d91808b47c195bc9b4dbd7f2b87 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:07:23.957969 26431 raft_consensus.cc:2749] T 46c5bfeecc314717bffe987e6844b6d0 P 0473d2b2d01f4459b1e90fd12cc7840e [term 26 FOLLOWER]: Leader election lost for term 26. Reason: could not achieve majority
I20260709 13:07:23.959869 19485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76cb037fc9064d13b59a8969d897ce8c" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:07:23.960454 19485 raft_consensus.cc:3060] T 76cb037fc9064d13b59a8969d897ce8c P 0473d2b2d01f4459b1e90fd12cc7840e [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:07:23.966462 19479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df751f992649444090e27965eb1af85d" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 24 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:07:23.966887 19482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f575b143b844aa096b50997dad3516a" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:07:23.967281 19479 raft_consensus.cc:2393] T df751f992649444090e27965eb1af85d P 0473d2b2d01f4459b1e90fd12cc7840e [term 24 FOLLOWER]: Leader election vote request: Denying vote to candidate e5256d91808b47c195bc9b4dbd7f2b87 in current term 24: Already voted for candidate 0473d2b2d01f4459b1e90fd12cc7840e in this term.
I20260709 13:07:23.967430 19482 raft_consensus.cc:3060] T 7f575b143b844aa096b50997dad3516a P 0473d2b2d01f4459b1e90fd12cc7840e [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:07:23.968273 19375 leader_election.cc:304] T f1b10566f45d4a7d9029858330e02d5b P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:07:23.969223 19479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4509b76741dc428e9201c70c1658da13" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:07:23.970191 19479 raft_consensus.cc:2393] T 4509b76741dc428e9201c70c1658da13 P 0473d2b2d01f4459b1e90fd12cc7840e [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate e5256d91808b47c195bc9b4dbd7f2b87 in current term 16: Already voted for candidate e61c3a8f61bb48f8a963c9480e53c168 in this term.
I20260709 13:07:23.970471 19375 leader_election.cc:304] T 4af19371ea874c09a0a2147040835cbb P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168; no voters: 127766fc592545a4997f7790f50f6076
I20260709 13:07:23.972394 26289 raft_consensus.cc:2749] T f1b10566f45d4a7d9029858330e02d5b P e5256d91808b47c195bc9b4dbd7f2b87 [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 13:07:23.974422 26275 raft_consensus.cc:2804] T 4af19371ea874c09a0a2147040835cbb P e5256d91808b47c195bc9b4dbd7f2b87 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:07:23.974936 26275 raft_consensus.cc:697] T 4af19371ea874c09a0a2147040835cbb P e5256d91808b47c195bc9b4dbd7f2b87 [term 14 LEADER]: Becoming Leader. State: Replica: e5256d91808b47c195bc9b4dbd7f2b87, State: Running, Role: LEADER
I20260709 13:07:23.975757 26275 consensus_queue.cc:237] T 4af19371ea874c09a0a2147040835cbb P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:07:23.977087 19410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70797e5783b5454ab0d0eea663e791e3" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 25 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:07:23.978060 19411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4509b76741dc428e9201c70c1658da13" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 16 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
I20260709 13:07:23.981060 19482 raft_consensus.cc:2468] T 7f575b143b844aa096b50997dad3516a P 0473d2b2d01f4459b1e90fd12cc7840e [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 20.
I20260709 13:07:23.982024 19411 raft_consensus.cc:2393] T 4509b76741dc428e9201c70c1658da13 P e5256d91808b47c195bc9b4dbd7f2b87 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate e61c3a8f61bb48f8a963c9480e53c168 in current term 16: Already voted for candidate e5256d91808b47c195bc9b4dbd7f2b87 in this term.
I20260709 13:07:23.992993 19485 raft_consensus.cc:2468] T 76cb037fc9064d13b59a8969d897ce8c P 0473d2b2d01f4459b1e90fd12cc7840e [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 22.
I20260709 13:07:24.006494 19410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76cb037fc9064d13b59a8969d897ce8c" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
I20260709 13:07:24.007331 19410 raft_consensus.cc:3060] T 76cb037fc9064d13b59a8969d897ce8c P e5256d91808b47c195bc9b4dbd7f2b87 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:07:24.017859 19410 raft_consensus.cc:2468] T 76cb037fc9064d13b59a8969d897ce8c P e5256d91808b47c195bc9b4dbd7f2b87 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 22.
I20260709 13:07:24.019860 19554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f575b143b844aa096b50997dad3516a" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:07:24.020511 19554 raft_consensus.cc:3060] T 7f575b143b844aa096b50997dad3516a P e61c3a8f61bb48f8a963c9480e53c168 [term 18 FOLLOWER]: Advancing to term 20
I20260709 13:07:24.022298 19559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df751f992649444090e27965eb1af85d" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 24 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:07:24.023201 19559 raft_consensus.cc:2410] T df751f992649444090e27965eb1af85d P e61c3a8f61bb48f8a963c9480e53c168 [term 24 FOLLOWER]: Leader election vote request: Denying vote to candidate e5256d91808b47c195bc9b4dbd7f2b87 for term 24 because replica has last-logged OpId of term: 23 index: 15, which is greater than that of the candidate, which has last-logged OpId of term: 22 index: 14.
I20260709 13:07:24.036317 19553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edd7d470b5014c9489be7f41f64355c9" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 27 candidate_status { last_received { term: 26 index: 14 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:07:24.037436 19558 raft_consensus.cc:1275] T f1b10566f45d4a7d9029858330e02d5b P e61c3a8f61bb48f8a963c9480e53c168 [term 21 FOLLOWER]: Refusing update from remote peer 0473d2b2d01f4459b1e90fd12cc7840e: Log matching property violated. Preceding OpId in replica: term: 19 index: 12. Preceding OpId from leader: term: 21 index: 13. (index mismatch)
I20260709 13:07:24.042037 19479 raft_consensus.cc:1275] T 1f85fc4b527a48848e5faa083b604e36 P 0473d2b2d01f4459b1e90fd12cc7840e [term 20 FOLLOWER]: Refusing update from remote peer 127766fc592545a4997f7790f50f6076: Log matching property violated. Preceding OpId in replica: term: 18 index: 14. Preceding OpId from leader: term: 20 index: 15. (index mismatch)
I20260709 13:07:24.056890 19551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4509b76741dc428e9201c70c1658da13" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:07:24.057891 19523 leader_election.cc:400] T 7f575b143b844aa096b50997dad3516a P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 19 pre-election: Vote denied by peer e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321) with higher term. Message: Invalid argument: T 7f575b143b844aa096b50997dad3516a P e5256d91808b47c195bc9b4dbd7f2b87 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e61c3a8f61bb48f8a963c9480e53c168 for earlier term 19. Current term is 20.
I20260709 13:07:24.058241 19523 leader_election.cc:403] T 7f575b143b844aa096b50997dad3516a P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 19 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:07:24.066406 19554 raft_consensus.cc:2468] T 7f575b143b844aa096b50997dad3516a P e61c3a8f61bb48f8a963c9480e53c168 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 20.
I20260709 13:07:24.059259 19450 leader_election.cc:304] T edd7d470b5014c9489be7f41f64355c9 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e; no voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:07:24.069613 19523 leader_election.cc:304] T 70797e5783b5454ab0d0eea663e791e3 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e61c3a8f61bb48f8a963c9480e53c168; no voters: 127766fc592545a4997f7790f50f6076, e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:07:24.063243 19377 leader_election.cc:304] T 7f575b143b844aa096b50997dad3516a P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87; no voters: 
I20260709 13:07:24.077097 20110 raft_consensus.cc:1275] T 85c494af21f9457a85da47b9bc70c1fd P 127766fc592545a4997f7790f50f6076 [term 21 FOLLOWER]: Refusing update from remote peer e5256d91808b47c195bc9b4dbd7f2b87: Log matching property violated. Preceding OpId in replica: term: 18 index: 14. Preceding OpId from leader: term: 21 index: 16. (index mismatch)
I20260709 13:07:24.080304 19523 leader_election.cc:304] T 76cb037fc9064d13b59a8969d897ce8c P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:07:24.073854 26324 raft_consensus.cc:2749] T 70797e5783b5454ab0d0eea663e791e3 P e61c3a8f61bb48f8a963c9480e53c168 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:07:24.084570 19375 leader_election.cc:304] T df751f992649444090e27965eb1af85d P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 24 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:07:24.071697 26683 raft_consensus.cc:2749] T 7f575b143b844aa096b50997dad3516a P e61c3a8f61bb48f8a963c9480e53c168 [term 20 FOLLOWER]: Leader pre-election lost for term 19. Reason: Vote denied by peer e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321) with higher term. Message: Invalid argument: T 7f575b143b844aa096b50997dad3516a P e5256d91808b47c195bc9b4dbd7f2b87 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e61c3a8f61bb48f8a963c9480e53c168 for earlier term 19. Current term is 20.
I20260709 13:07:24.074272 26574 raft_consensus.cc:2749] T edd7d470b5014c9489be7f41f64355c9 P 0473d2b2d01f4459b1e90fd12cc7840e [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
I20260709 13:07:24.069469 26540 consensus_queue.cc:1048] T 1f85fc4b527a48848e5faa083b604e36 P 127766fc592545a4997f7790f50f6076 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.019s
I20260709 13:07:24.071421 26382 consensus_queue.cc:1048] T f1b10566f45d4a7d9029858330e02d5b P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.018s
I20260709 13:07:24.087193 26617 raft_consensus.cc:2804] T 76cb037fc9064d13b59a8969d897ce8c P e61c3a8f61bb48f8a963c9480e53c168 [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:07:24.090288 26289 raft_consensus.cc:2804] T 7f575b143b844aa096b50997dad3516a P e5256d91808b47c195bc9b4dbd7f2b87 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:07:24.083576 26662 consensus_queue.cc:1048] T 85c494af21f9457a85da47b9bc70c1fd P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Connected to new peer: Peer: permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 14, Time since last communication: 0.015s
I20260709 13:07:24.093772 26650 raft_consensus.cc:2749] T df751f992649444090e27965eb1af85d P e5256d91808b47c195bc9b4dbd7f2b87 [term 24 FOLLOWER]: Leader election lost for term 24. Reason: could not achieve majority
I20260709 13:07:24.114017 26534 raft_consensus.cc:3060] T 1dc5b3532fe54f74876d02beffa2c230 P e61c3a8f61bb48f8a963c9480e53c168 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:07:24.119727 26617 raft_consensus.cc:697] T 76cb037fc9064d13b59a8969d897ce8c P e61c3a8f61bb48f8a963c9480e53c168 [term 22 LEADER]: Becoming Leader. State: Replica: e61c3a8f61bb48f8a963c9480e53c168, State: Running, Role: LEADER
I20260709 13:07:24.120652 26617 consensus_queue.cc:237] T 76cb037fc9064d13b59a8969d897ce8c P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 20.11, Last appended by leader: 11, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:07:24.108790 19375 leader_election.cc:304] T 4509b76741dc428e9201c70c1658da13 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:07:24.125252 26662 raft_consensus.cc:2749] T 4509b76741dc428e9201c70c1658da13 P e5256d91808b47c195bc9b4dbd7f2b87 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:07:24.110260 26289 raft_consensus.cc:697] T 7f575b143b844aa096b50997dad3516a P e5256d91808b47c195bc9b4dbd7f2b87 [term 20 LEADER]: Becoming Leader. State: Replica: e5256d91808b47c195bc9b4dbd7f2b87, State: Running, Role: LEADER
I20260709 13:07:24.130103 19557 raft_consensus.cc:1275] T 85c494af21f9457a85da47b9bc70c1fd P e61c3a8f61bb48f8a963c9480e53c168 [term 21 FOLLOWER]: Refusing update from remote peer e5256d91808b47c195bc9b4dbd7f2b87: Log matching property violated. Preceding OpId in replica: term: 19 index: 15. Preceding OpId from leader: term: 21 index: 16. (index mismatch)
I20260709 13:07:24.138224 19408 raft_consensus.cc:1275] T f1b10566f45d4a7d9029858330e02d5b P e5256d91808b47c195bc9b4dbd7f2b87 [term 21 FOLLOWER]: Refusing update from remote peer 0473d2b2d01f4459b1e90fd12cc7840e: Log matching property violated. Preceding OpId in replica: term: 19 index: 12. Preceding OpId from leader: term: 21 index: 13. (index mismatch)
I20260709 13:07:24.140064 26577 consensus_queue.cc:1048] T f1b10566f45d4a7d9029858330e02d5b P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:07:24.162089 26289 consensus_queue.cc:237] T 7f575b143b844aa096b50997dad3516a P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 18.12, Last appended by leader: 12, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:07:24.175915 19408 raft_consensus.cc:1275] T 1f85fc4b527a48848e5faa083b604e36 P e5256d91808b47c195bc9b4dbd7f2b87 [term 20 FOLLOWER]: Refusing update from remote peer 127766fc592545a4997f7790f50f6076: Log matching property violated. Preceding OpId in replica: term: 18 index: 14. Preceding OpId from leader: term: 20 index: 15. (index mismatch)
I20260709 13:07:24.193503 26540 consensus_queue.cc:1048] T 1f85fc4b527a48848e5faa083b604e36 P 127766fc592545a4997f7790f50f6076 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 13:07:24.206741 26693 consensus_queue.cc:1048] T 85c494af21f9457a85da47b9bc70c1fd P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 14, Time since last communication: 0.004s
I20260709 13:07:24.210275 19408 raft_consensus.cc:1275] T 309c3ca0ca4b4f3ba129752ea2cb293b P e5256d91808b47c195bc9b4dbd7f2b87 [term 14 FOLLOWER]: Refusing update from remote peer 0473d2b2d01f4459b1e90fd12cc7840e: Log matching property violated. Preceding OpId in replica: term: 12 index: 12. Preceding OpId from leader: term: 14 index: 13. (index mismatch)
I20260709 13:07:24.223837 26388 consensus_queue.cc:1048] T 309c3ca0ca4b4f3ba129752ea2cb293b P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.009s
I20260709 13:07:24.243386 19408 raft_consensus.cc:1275] T 4509b76741dc428e9201c70c1658da13 P e5256d91808b47c195bc9b4dbd7f2b87 [term 16 FOLLOWER]: Refusing update from remote peer e61c3a8f61bb48f8a963c9480e53c168: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 16 index: 8. (term mismatch)
I20260709 13:07:24.243835 19408 pending_rounds.cc:85] T 4509b76741dc428e9201c70c1658da13 P e5256d91808b47c195bc9b4dbd7f2b87: Aborting all ops after (but not including) 7
I20260709 13:07:24.244089 19408 pending_rounds.cc:107] T 4509b76741dc428e9201c70c1658da13 P e5256d91808b47c195bc9b4dbd7f2b87: Aborting uncommitted NO_OP operation due to leader change: 13.8
I20260709 13:07:24.244331 19408 raft_consensus.cc:2889] T 4509b76741dc428e9201c70c1658da13 P e5256d91808b47c195bc9b4dbd7f2b87 [term 16 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:07:24.262037 20110 raft_consensus.cc:1275] T 309c3ca0ca4b4f3ba129752ea2cb293b P 127766fc592545a4997f7790f50f6076 [term 14 FOLLOWER]: Refusing update from remote peer 0473d2b2d01f4459b1e90fd12cc7840e: Log matching property violated. Preceding OpId in replica: term: 12 index: 12. Preceding OpId from leader: term: 14 index: 13. (index mismatch)
I20260709 13:07:24.268895 26555 consensus_queue.cc:1048] T 4509b76741dc428e9201c70c1658da13 P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:07:24.282968 26431 consensus_queue.cc:1048] T 309c3ca0ca4b4f3ba129752ea2cb293b P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Connected to new peer: Peer: permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.011s
W20260709 13:07:24.305117 26698 log.cc:927] Time spent T 1f85fc4b527a48848e5faa083b604e36 P e5256d91808b47c195bc9b4dbd7f2b87: Append to log took a long time: real 0.075s	user 0.004s	sys 0.000s
W20260709 13:07:24.317230 26700 log.cc:927] Time spent T 85c494af21f9457a85da47b9bc70c1fd P e61c3a8f61bb48f8a963c9480e53c168: Append to log took a long time: real 0.087s	user 0.001s	sys 0.000s
I20260709 13:07:24.325037 19483 raft_consensus.cc:1275] T 4509b76741dc428e9201c70c1658da13 P 0473d2b2d01f4459b1e90fd12cc7840e [term 16 FOLLOWER]: Refusing update from remote peer e61c3a8f61bb48f8a963c9480e53c168: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 16 index: 8. (index mismatch)
I20260709 13:07:24.326880 26683 consensus_queue.cc:1048] T 4509b76741dc428e9201c70c1658da13 P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:07:24.381965 18300 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 13:07:24.406495 19303 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:44688 (request call id 228) took 36519 ms (client timeout 15000 ms). Trace:
W20260709 13:07:24.406984 19303 rpcz_store.cc:269] 0709 13:06:47.886990 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:47.887333 (+   343us) service_pool.cc:224] Handling call
0709 13:07:24.406405 (+36519072us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:07:22.617550 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:07:22.618533 (+   983us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:07:22.618608 (+    75us) write_op.cc:435] Acquired schema lock
0709 13:07:22.618640 (+    32us) tablet.cc:662] Decoding operations
0709 13:07:22.620479 (+  1839us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:07:22.620612 (+   133us) write_op.cc:641] Partition lock acquired for write op
0709 13:07:22.620657 (+    45us) tablet.cc:685] Acquiring locks for 7 operations
0709 13:07:22.621618 (+   961us) tablet.cc:701] Row locks acquired
0709 13:07:22.621669 (+    51us) write_op.cc:260] PREPARE: finished
0709 13:07:22.621922 (+   253us) write_op.cc:270] Start()
0709 13:07:22.622126 (+   204us) write_op.cc:276] Timestamp: P: 1783602442621825 usec, L: 0
0709 13:07:22.622181 (+    55us) op_driver.cc:348] REPLICATION: starting
0709 13:07:22.624444 (+  2263us) log.cc:844] Serialized 3086 byte log entry
0709 13:07:23.232914 (+608470us) spinlock_profiling.cc:243] Waited 105 ms on lock 0x7b18004586e0. stack: 00007f4a79de9343 00007f4a79de9240 00007f4a797781d4 00007f4a834b6304 00007f4a834b6299 00007f4a82ce3de1 00007f4a82cf05b1 00007f4a79e1b3f3 00007f4a79e1d7c1 00007f4a79e1d779 00007f4a79e1d709 00007f4a79e1d6d1 00007f4a79e1c9cd 000000000038f354 000000000038f199 00007f4a79dfe83a
0709 13:07:23.516893 (+283979us) op_driver.cc:464] REPLICATION: finished
0709 13:07:23.813163 (+296270us) write_op.cc:301] APPLY: starting
0709 13:07:23.813276 (+   113us) tablet.cc:1367] starting BulkCheckPresence
0709 13:07:23.856251 (+ 42975us) tablet.cc:1370] finished BulkCheckPresence
0709 13:07:23.856299 (+    48us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:07:23.929325 (+ 73026us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:07:23.929631 (+   306us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=14,key_file_lookups=14,delta_file_lookups=14,mrs_lookups=0
0709 13:07:23.929689 (+    58us) write_op.cc:312] APPLY: finished
0709 13:07:23.930004 (+   315us) log.cc:844] Serialized 73 byte log entry
0709 13:07:23.930173 (+   169us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:07:23.930284 (+   111us) write_op.cc:454] Released schema lock
0709 13:07:23.930348 (+    64us) write_op.cc:341] FINISH: Updating metrics
0709 13:07:23.930788 (+   440us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:07:23.930824 (+    36us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":155147,"reported_tablets":51,"child_traces":[["op",{"apply.queue_time_us":289093,"apply.run_cpu_time_us":13913,"apply.run_wall_time_us":117593,"cfile_cache_hit":30,"cfile_cache_hit_bytes":33387,"num_ops":7,"prepare.queue_time_us":580456,"prepare.run_cpu_time_us":41324,"prepare.run_wall_time_us":505984,"raft.queue_time_us":236978,"raft.run_cpu_time_us":11069,"raft.run_wall_time_us":289475,"replication_time_us":867287,"spinlock_wait_cycles":241901696,"thread_start_us":887544,"threads_started":4,"wal-append.queue_time_us":386304}]]}
I20260709 13:07:24.523768 19301 catalog_manager.cc:5697] T 309c3ca0ca4b4f3ba129752ea2cb293b P e5256d91808b47c195bc9b4dbd7f2b87 reported cstate change: config changed from index 5 to 10, term changed from 11 to 13, leader changed from 127766fc592545a4997f7790f50f6076 (127.17.223.4) to <none>, VOTER e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3) evicted, no longer has a pending config: VOTER e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1), VOTER 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2), VOTER 127766fc592545a4997f7790f50f6076 (127.17.223.4). New cstate: current_term: 13 committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } } }
I20260709 13:07:24.529505 19551 raft_consensus.cc:1275] T 4af19371ea874c09a0a2147040835cbb P e61c3a8f61bb48f8a963c9480e53c168 [term 14 FOLLOWER]: Refusing update from remote peer e5256d91808b47c195bc9b4dbd7f2b87: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 13:07:24.533130 19301 catalog_manager.cc:5697] T 22196caba61445d3bec98a0aab3c337d P e5256d91808b47c195bc9b4dbd7f2b87 reported cstate change: term changed from 14 to 21, leader changed from 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2) to e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3). New cstate: current_term: 21 leader_uuid: "e61c3a8f61bb48f8a963c9480e53c168" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } }
I20260709 13:07:24.535015 19301 catalog_manager.cc:5697] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P e5256d91808b47c195bc9b4dbd7f2b87 reported cstate change: term changed from 16 to 22. New cstate: current_term: 22 leader_uuid: "127766fc592545a4997f7790f50f6076" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } } }
I20260709 13:07:24.536504 19301 catalog_manager.cc:5697] T 46c5bfeecc314717bffe987e6844b6d0 P e5256d91808b47c195bc9b4dbd7f2b87 reported cstate change: term changed from 23 to 25, leader changed from 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2) to e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3). New cstate: current_term: 25 leader_uuid: "e61c3a8f61bb48f8a963c9480e53c168" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } }
I20260709 13:07:24.538872 26693 consensus_queue.cc:1048] T 4af19371ea874c09a0a2147040835cbb P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:07:24.542415 19483 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0afb57ae58a24a01850491d69f0213dd"
dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
mode: GRACEFUL
new_leader_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
 from {username='slave'} at 127.0.0.1:48168
I20260709 13:07:24.548271 19483 raft_consensus.cc:606] T 0afb57ae58a24a01850491d69f0213dd P 0473d2b2d01f4459b1e90fd12cc7840e [term 13 FOLLOWER]: Received request to transfer leadership to TS e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:07:24.548660 19483 raft_consensus.cc:614] T 0afb57ae58a24a01850491d69f0213dd P 0473d2b2d01f4459b1e90fd12cc7840e [term 13 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:07:24.553367 20109 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "172b3dd13109415a955b71ac0e9d2234"
dest_uuid: "127766fc592545a4997f7790f50f6076"
mode: GRACEFUL
new_leader_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
 from {username='slave'} at 127.0.0.1:48686
I20260709 13:07:24.554065 20109 raft_consensus.cc:606] T 172b3dd13109415a955b71ac0e9d2234 P 127766fc592545a4997f7790f50f6076 [term 18 LEADER]: Received request to transfer leadership to TS e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:07:24.557355 19483 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "62c6c134d3d24a1ab144dd9ee6bc3f64"
dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
mode: GRACEFUL
new_leader_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
 from {username='slave'} at 127.0.0.1:48168
I20260709 13:07:24.557910 19483 raft_consensus.cc:606] T 62c6c134d3d24a1ab144dd9ee6bc3f64 P 0473d2b2d01f4459b1e90fd12cc7840e [term 18 FOLLOWER]: Received request to transfer leadership to TS e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:07:24.558269 19483 raft_consensus.cc:614] T 62c6c134d3d24a1ab144dd9ee6bc3f64 P 0473d2b2d01f4459b1e90fd12cc7840e [term 18 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:07:24.560779 19483 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6c5eebf646ad445a9d1b1adc319d7b16"
dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
mode: GRACEFUL
new_leader_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
 from {username='slave'} at 127.0.0.1:48168
I20260709 13:07:24.561298 19483 raft_consensus.cc:606] T 6c5eebf646ad445a9d1b1adc319d7b16 P 0473d2b2d01f4459b1e90fd12cc7840e [term 20 FOLLOWER]: Received request to transfer leadership to TS e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:07:24.561610 19483 raft_consensus.cc:614] T 6c5eebf646ad445a9d1b1adc319d7b16 P 0473d2b2d01f4459b1e90fd12cc7840e [term 20 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:07:24.563928 19483 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b9f0d59553ad444883fcf5b5909f9798"
dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
mode: GRACEFUL
new_leader_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
 from {username='slave'} at 127.0.0.1:48168
I20260709 13:07:24.564425 19483 raft_consensus.cc:606] T b9f0d59553ad444883fcf5b5909f9798 P 0473d2b2d01f4459b1e90fd12cc7840e [term 15 LEADER]: Received request to transfer leadership to TS e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:07:24.566982 19483 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "fa8650e71aa14778b3d73721fc50d9fc"
dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
mode: GRACEFUL
new_leader_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
 from {username='slave'} at 127.0.0.1:48168
I20260709 13:07:24.567480 19483 raft_consensus.cc:606] T fa8650e71aa14778b3d73721fc50d9fc P 0473d2b2d01f4459b1e90fd12cc7840e [term 21 FOLLOWER]: Received request to transfer leadership to TS e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:07:24.567793 19483 raft_consensus.cc:614] T fa8650e71aa14778b3d73721fc50d9fc P 0473d2b2d01f4459b1e90fd12cc7840e [term 21 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:07:24.568706 18300 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 13:07:24.570768 18300 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:07:24.556207 19301 catalog_manager.cc:5697] T 21e14947d70440f19044d8f75c31e1f9 P e5256d91808b47c195bc9b4dbd7f2b87 reported cstate change: term changed from 17 to 20, leader changed from e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1) to e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3). New cstate: current_term: 20 leader_uuid: "e61c3a8f61bb48f8a963c9480e53c168" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } }
I20260709 13:07:24.573939 19301 catalog_manager.cc:5697] T 40e1e16737a842ee936002830f36882e P e5256d91808b47c195bc9b4dbd7f2b87 reported cstate change: term changed from 17 to 23. New cstate: current_term: 23 leader_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:24.575645 19301 catalog_manager.cc:5697] T 7be9efa6559648dbb5a0f7684c4542d1 P e5256d91808b47c195bc9b4dbd7f2b87 reported cstate change: term changed from 13 to 21, leader changed from 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2) to e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1). New cstate: current_term: 21 leader_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:07:24.577533 19301 catalog_manager.cc:5697] T 217b5fae677b4971b3bbd2f357a1f7ff P e5256d91808b47c195bc9b4dbd7f2b87 reported cstate change: term changed from 12 to 18, leader changed from 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2) to e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3). New cstate: current_term: 18 leader_uuid: "e61c3a8f61bb48f8a963c9480e53c168" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } }
I20260709 13:07:24.594043 20109 raft_consensus.cc:1275] T 4af19371ea874c09a0a2147040835cbb P 127766fc592545a4997f7790f50f6076 [term 14 FOLLOWER]: Refusing update from remote peer e5256d91808b47c195bc9b4dbd7f2b87: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 13:07:24.595942 26289 consensus_queue.cc:1048] T 4af19371ea874c09a0a2147040835cbb P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Connected to new peer: Peer: permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:07:24.618914 19402 raft_consensus.cc:1275] T 76cb037fc9064d13b59a8969d897ce8c P e5256d91808b47c195bc9b4dbd7f2b87 [term 22 FOLLOWER]: Refusing update from remote peer e61c3a8f61bb48f8a963c9480e53c168: Log matching property violated. Preceding OpId in replica: term: 18 index: 10. Preceding OpId from leader: term: 22 index: 12. (index mismatch)
I20260709 13:07:24.620628 26683 consensus_queue.cc:1048] T 76cb037fc9064d13b59a8969d897ce8c P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:07:24.658030 19301 catalog_manager.cc:5697] T e381f1d6b8184797ad142de49be225a8 P e5256d91808b47c195bc9b4dbd7f2b87 reported cstate change: term changed from 14 to 18, leader changed from e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1) to 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2). New cstate: current_term: 18 leader_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } }
I20260709 13:07:24.666169 19551 raft_consensus.cc:1275] T 7f575b143b844aa096b50997dad3516a P e61c3a8f61bb48f8a963c9480e53c168 [term 20 FOLLOWER]: Refusing update from remote peer e5256d91808b47c195bc9b4dbd7f2b87: Log matching property violated. Preceding OpId in replica: term: 18 index: 12. Preceding OpId from leader: term: 20 index: 13. (index mismatch)
I20260709 13:07:24.669433 26693 consensus_queue.cc:1048] T 7f575b143b844aa096b50997dad3516a P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
W20260709 13:07:24.678730 19309 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:44688 (request call id 227) took 61735 ms (client timeout 15000 ms). Trace:
W20260709 13:07:24.679184 19309 rpcz_store.cc:269] 0709 13:06:22.904302 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:22.904601 (+   299us) service_pool.cc:224] Handling call
0709 13:06:23.819963 (+915362us) spinlock_profiling.cc:243] Waited 5.96 ms on lock 0x7b5400002210. stack: 00007f4a79de9343 00007f4a79de9240 00007f4a797781d4 00007f4a834b6304 00007f4a834b6299 00007f4a79ca3db1 00007f4a79de3e9c 00007f4a79de40f6 00007f4a82d5da89 00007f4a82cf5da6 00007f4a82cc7088 00007f4a82dc537e 00007f4a812862a4 00007f4a81286232 00007f4a81286161 00007f4a812860dc
0709 13:07:24.639658 (+60819695us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1209483,"reported_tablets":51,"spinlock_wait_cycles":13699328}
I20260709 13:07:24.681327 19301 catalog_manager.cc:5697] T edd7d470b5014c9489be7f41f64355c9 P e5256d91808b47c195bc9b4dbd7f2b87 reported cstate change: term changed from 20 to 26, leader changed from 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2) to e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1). New cstate: current_term: 26 leader_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:24.683383 19301 catalog_manager.cc:5697] T a08760e15aac4630a629431f56024dc8 P e5256d91808b47c195bc9b4dbd7f2b87 reported cstate change: term changed from 21 to 23. New cstate: current_term: 23 leader_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } health_report { overall_health: HEALTHY } } }
I20260709 13:07:24.685039 19301 catalog_manager.cc:5697] T ff9b0eddd810459b82d91c60777c10eb P e5256d91808b47c195bc9b4dbd7f2b87 reported cstate change: term changed from 17 to 22, leader changed from 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2) to e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1). New cstate: current_term: 22 leader_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 13:07:24.689954 19296 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 7be9efa6559648dbb5a0f7684c4542d1 with cas_config_opid_index 6: ChangeConfig:REMOVE_PEER failed with leader 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica 0473d2b2d01f4459b1e90fd12cc7840e is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 21 leader_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } attrs { replace: true } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } } }
I20260709 13:07:24.700614 19483 raft_consensus.cc:1275] T 76cb037fc9064d13b59a8969d897ce8c P 0473d2b2d01f4459b1e90fd12cc7840e [term 22 FOLLOWER]: Refusing update from remote peer e61c3a8f61bb48f8a963c9480e53c168: Log matching property violated. Preceding OpId in replica: term: 18 index: 10. Preceding OpId from leader: term: 22 index: 12. (index mismatch)
I20260709 13:07:24.702652 26555 consensus_queue.cc:1048] T 76cb037fc9064d13b59a8969d897ce8c P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:07:24.708479 19483 raft_consensus.cc:1275] T 7f575b143b844aa096b50997dad3516a P 0473d2b2d01f4459b1e90fd12cc7840e [term 20 FOLLOWER]: Refusing update from remote peer e5256d91808b47c195bc9b4dbd7f2b87: Log matching property violated. Preceding OpId in replica: term: 18 index: 12. Preceding OpId from leader: term: 20 index: 13. (index mismatch)
I20260709 13:07:24.715149 19301 catalog_manager.cc:5697] T f1b10566f45d4a7d9029858330e02d5b P e5256d91808b47c195bc9b4dbd7f2b87 reported cstate change: term changed from 17 to 19, leader changed from e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3) to e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1). New cstate: current_term: 19 leader_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } health_report { overall_health: HEALTHY } } }
I20260709 13:07:24.717344 19301 catalog_manager.cc:5697] T 2b74109013a140ada21feeef92d6f563 P e5256d91808b47c195bc9b4dbd7f2b87 reported cstate change: term changed from 12 to 18, leader changed from e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3) to e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1). New cstate: current_term: 18 leader_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } health_report { overall_health: HEALTHY } } }
I20260709 13:07:24.719604 26097 consensus_queue.cc:1048] T 7f575b143b844aa096b50997dad3516a P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:07:24.743208 19301 catalog_manager.cc:5697] T 65d8cb8d6ec64f459d5a47cefab10acf P e5256d91808b47c195bc9b4dbd7f2b87 reported cstate change: term changed from 18 to 21, leader changed from 127766fc592545a4997f7790f50f6076 (127.17.223.4) to e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1). New cstate: current_term: 21 leader_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:07:24.762048 19301 catalog_manager.cc:5697] T ef32ce6fdd0e40d382c79974f30295c6 P e5256d91808b47c195bc9b4dbd7f2b87 reported cstate change: term changed from 21 to 23. New cstate: current_term: 23 leader_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } health_report { overall_health: HEALTHY } } }
I20260709 13:07:24.795140 19301 catalog_manager.cc:5697] T d1e5873a19244c5ebbcd38e126796ee7 P e5256d91808b47c195bc9b4dbd7f2b87 reported cstate change: term changed from 20 to 22. New cstate: current_term: 22 leader_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } health_report { overall_health: HEALTHY } } }
I20260709 13:07:24.838507 26649 raft_consensus.cc:993] T b9f0d59553ad444883fcf5b5909f9798 P 0473d2b2d01f4459b1e90fd12cc7840e: : Instructing follower e61c3a8f61bb48f8a963c9480e53c168 to start an election
I20260709 13:07:24.839073 26649 raft_consensus.cc:1081] T b9f0d59553ad444883fcf5b5909f9798 P 0473d2b2d01f4459b1e90fd12cc7840e [term 15 LEADER]: Signalling peer e61c3a8f61bb48f8a963c9480e53c168 to start an election
I20260709 13:07:24.800570 19301 catalog_manager.cc:5697] T 4af19371ea874c09a0a2147040835cbb P e5256d91808b47c195bc9b4dbd7f2b87 reported cstate change: term changed from 8 to 12, leader changed from 127766fc592545a4997f7790f50f6076 (127.17.223.4) to e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1). New cstate: current_term: 12 leader_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:07:24.844110 19301 catalog_manager.cc:5697] T 86a6797bdfe94fa496c050ceae4bd0d9 P e5256d91808b47c195bc9b4dbd7f2b87 reported cstate change: term changed from 12 to 17. New cstate: current_term: 17 leader_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } }
I20260709 13:07:24.843976 19551 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b9f0d59553ad444883fcf5b5909f9798"
dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
 from {username='slave'} at 127.0.0.1:40428
I20260709 13:07:24.845546 19551 raft_consensus.cc:493] T b9f0d59553ad444883fcf5b5909f9798 P e61c3a8f61bb48f8a963c9480e53c168 [term 15 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:07:24.845851 19551 raft_consensus.cc:3060] T b9f0d59553ad444883fcf5b5909f9798 P e61c3a8f61bb48f8a963c9480e53c168 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:07:24.845808 19301 catalog_manager.cc:5697] T fa8650e71aa14778b3d73721fc50d9fc P e5256d91808b47c195bc9b4dbd7f2b87 reported cstate change: term changed from 17 to 21, leader changed from 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2) to e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3). New cstate: current_term: 21 leader_uuid: "e61c3a8f61bb48f8a963c9480e53c168" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } }
I20260709 13:07:24.863413 19301 catalog_manager.cc:5697] T 7f575b143b844aa096b50997dad3516a P e5256d91808b47c195bc9b4dbd7f2b87 reported cstate change: term changed from 14 to 18. New cstate: current_term: 18 leader_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } health_report { overall_health: HEALTHY } } }
I20260709 13:07:24.865024 19301 catalog_manager.cc:5697] T 9962423cb4e54fcfa5de01daf68a86e7 P e5256d91808b47c195bc9b4dbd7f2b87 reported cstate change: term changed from 17 to 19. New cstate: current_term: 19 leader_uuid: "127766fc592545a4997f7790f50f6076" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } } }
I20260709 13:07:24.866384 19301 catalog_manager.cc:5697] T 1a61655d99124a29b486ba4a5b37faea P e5256d91808b47c195bc9b4dbd7f2b87 reported cstate change: term changed from 12 to 18, leader changed from e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1) to 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2). New cstate: current_term: 18 leader_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } }
W20260709 13:07:24.939869 19450 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.3:36891, user_credentials={real_user=slave}} blocked reactor thread for 68417.4us
I20260709 13:07:24.938519 19301 catalog_manager.cc:5697] T 5ec1c4ce15e04c7e8c283a62179f2a64 P e5256d91808b47c195bc9b4dbd7f2b87 reported cstate change: term changed from 10 to 14. New cstate: current_term: 14 leader_uuid: "127766fc592545a4997f7790f50f6076" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } } }
I20260709 13:07:24.943099 19301 catalog_manager.cc:5697] T 1f85fc4b527a48848e5faa083b604e36 P e5256d91808b47c195bc9b4dbd7f2b87 reported cstate change: term changed from 16 to 18. New cstate: current_term: 18 leader_uuid: "127766fc592545a4997f7790f50f6076" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } } }
I20260709 13:07:24.949222 19301 catalog_manager.cc:5697] T 179fd671030940b4b4a4e24bcc4aba0a P e5256d91808b47c195bc9b4dbd7f2b87 reported cstate change: term changed from 19 to 22, leader changed from 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2) to e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1). New cstate: current_term: 22 leader_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } health_report { overall_health: HEALTHY } } }
I20260709 13:07:24.968075 19551 raft_consensus.cc:515] T b9f0d59553ad444883fcf5b5909f9798 P e61c3a8f61bb48f8a963c9480e53c168 [term 16 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:07:24.972440 19410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9f0d59553ad444883fcf5b5909f9798" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: true dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
I20260709 13:07:24.973027 19410 raft_consensus.cc:3060] T b9f0d59553ad444883fcf5b5909f9798 P e5256d91808b47c195bc9b4dbd7f2b87 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:07:24.980252 19410 raft_consensus.cc:2468] T b9f0d59553ad444883fcf5b5909f9798 P e5256d91808b47c195bc9b4dbd7f2b87 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 16.
I20260709 13:07:24.981488 19523 leader_election.cc:304] T b9f0d59553ad444883fcf5b5909f9798 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:07:24.982329 26683 raft_consensus.cc:2804] T b9f0d59553ad444883fcf5b5909f9798 P e61c3a8f61bb48f8a963c9480e53c168 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:07:24.982863 26683 raft_consensus.cc:697] T b9f0d59553ad444883fcf5b5909f9798 P e61c3a8f61bb48f8a963c9480e53c168 [term 16 LEADER]: Becoming Leader. State: Replica: e61c3a8f61bb48f8a963c9480e53c168, State: Running, Role: LEADER
I20260709 13:07:24.983836 19301 catalog_manager.cc:5697] T 172b3dd13109415a955b71ac0e9d2234 P e5256d91808b47c195bc9b4dbd7f2b87 reported cstate change: term changed from 16 to 18. New cstate: current_term: 18 leader_uuid: "127766fc592545a4997f7790f50f6076" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } } }
I20260709 13:07:24.983769 26683 consensus_queue.cc:237] T b9f0d59553ad444883fcf5b5909f9798 P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:07:24.985522 19301 catalog_manager.cc:5697] T 1dc5b3532fe54f74876d02beffa2c230 P e5256d91808b47c195bc9b4dbd7f2b87 reported cstate change: term changed from 17 to 22, leader changed from 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2) to e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3). New cstate: current_term: 22 leader_uuid: "e61c3a8f61bb48f8a963c9480e53c168" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } }
I20260709 13:07:24.987797 19483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9f0d59553ad444883fcf5b5909f9798" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: true dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:07:24.988370 19483 raft_consensus.cc:3055] T b9f0d59553ad444883fcf5b5909f9798 P 0473d2b2d01f4459b1e90fd12cc7840e [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:07:24.988677 19483 raft_consensus.cc:740] T b9f0d59553ad444883fcf5b5909f9798 P 0473d2b2d01f4459b1e90fd12cc7840e [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 0473d2b2d01f4459b1e90fd12cc7840e, State: Running, Role: LEADER
I20260709 13:07:24.989359 19483 consensus_queue.cc:260] T b9f0d59553ad444883fcf5b5909f9798 P 0473d2b2d01f4459b1e90fd12cc7840e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:07:24.990360 19483 raft_consensus.cc:3060] T b9f0d59553ad444883fcf5b5909f9798 P 0473d2b2d01f4459b1e90fd12cc7840e [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:07:25.002450 19301 catalog_manager.cc:5697] T ece3db938bc649d4a40a51522ed5259c P e5256d91808b47c195bc9b4dbd7f2b87 reported cstate change: term changed from 14 to 16, leader changed from 127766fc592545a4997f7790f50f6076 (127.17.223.4) to e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3). New cstate: current_term: 16 leader_uuid: "e61c3a8f61bb48f8a963c9480e53c168" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } } }
I20260709 13:07:25.004294 19301 catalog_manager.cc:5697] T df751f992649444090e27965eb1af85d P e5256d91808b47c195bc9b4dbd7f2b87 reported cstate change: term changed from 17 to 22. New cstate: current_term: 22 leader_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } }
I20260709 13:07:25.005690 19301 catalog_manager.cc:5697] T 2e36a9d6e29c4a7c860cf267efbd4c74 P e5256d91808b47c195bc9b4dbd7f2b87 reported cstate change: term changed from 13 to 15, leader changed from 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2) to e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1). New cstate: current_term: 15 leader_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } health_report { overall_health: HEALTHY } } }
I20260709 13:07:25.007661 19301 catalog_manager.cc:5697] T f93ee515a9c14139bf566522ed8232f3 P e5256d91808b47c195bc9b4dbd7f2b87 reported cstate change: term changed from 16 to 23. New cstate: current_term: 23 leader_uuid: "e61c3a8f61bb48f8a963c9480e53c168" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } }
I20260709 13:07:25.008832 26615 raft_consensus.cc:493] T df751f992649444090e27965eb1af85d P e61c3a8f61bb48f8a963c9480e53c168 [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:25.015413 26615 raft_consensus.cc:515] T df751f992649444090e27965eb1af85d P e61c3a8f61bb48f8a963c9480e53c168 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:07:25.015672 19301 catalog_manager.cc:5697] T 0cdf56e38bbc453d9438d359e5a69955 P e5256d91808b47c195bc9b4dbd7f2b87 reported cstate change: term changed from 17 to 19, leader changed from e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1) to 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2). New cstate: current_term: 19 leader_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } }
I20260709 13:07:25.017683 26615 leader_election.cc:290] T df751f992649444090e27965eb1af85d P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:07:25.017541 19301 catalog_manager.cc:5697] T fa731b585f684a7fb2d106c50f143b83 P e5256d91808b47c195bc9b4dbd7f2b87 reported cstate change: term changed from 14 to 16, leader changed from 127766fc592545a4997f7790f50f6076 (127.17.223.4) to e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1). New cstate: current_term: 16 leader_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:07:25.019905 19410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df751f992649444090e27965eb1af85d" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 25 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:07:25.032474 19410 raft_consensus.cc:2468] T df751f992649444090e27965eb1af85d P e5256d91808b47c195bc9b4dbd7f2b87 [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 24.
I20260709 13:07:25.020941 19486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df751f992649444090e27965eb1af85d" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 25 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:07:25.033677 19486 raft_consensus.cc:2468] T df751f992649444090e27965eb1af85d P 0473d2b2d01f4459b1e90fd12cc7840e [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 24.
I20260709 13:07:25.035049 19523 leader_election.cc:304] T df751f992649444090e27965eb1af85d P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:07:25.035977 26615 raft_consensus.cc:2804] T df751f992649444090e27965eb1af85d P e61c3a8f61bb48f8a963c9480e53c168 [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 13:07:25.036370 26615 raft_consensus.cc:493] T df751f992649444090e27965eb1af85d P e61c3a8f61bb48f8a963c9480e53c168 [term 24 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:25.036703 26615 raft_consensus.cc:3060] T df751f992649444090e27965eb1af85d P e61c3a8f61bb48f8a963c9480e53c168 [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:07:24.983695 19551 leader_election.cc:290] T b9f0d59553ad444883fcf5b5909f9798 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 16 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:07:25.028739 19483 raft_consensus.cc:2468] T b9f0d59553ad444883fcf5b5909f9798 P 0473d2b2d01f4459b1e90fd12cc7840e [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 16.
I20260709 13:07:25.046461 19301 catalog_manager.cc:5697] T 775c229504194560ba9589bc2199b089 P e5256d91808b47c195bc9b4dbd7f2b87 reported cstate change: term changed from 13 to 15, leader changed from 127766fc592545a4997f7790f50f6076 (127.17.223.4) to e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1). New cstate: current_term: 15 leader_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:07:25.048751 19301 catalog_manager.cc:5697] T 833a2f0775ed407a94b8924ce50adb63 P e5256d91808b47c195bc9b4dbd7f2b87 reported cstate change: term changed from 13 to 16. New cstate: current_term: 16 leader_uuid: "127766fc592545a4997f7790f50f6076" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } } }
I20260709 13:07:25.045184 26615 raft_consensus.cc:515] T df751f992649444090e27965eb1af85d P e61c3a8f61bb48f8a963c9480e53c168 [term 25 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:07:25.056398 19402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df751f992649444090e27965eb1af85d" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 25 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
I20260709 13:07:25.056613 26615 leader_election.cc:290] T df751f992649444090e27965eb1af85d P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 25 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:07:25.056998 19402 raft_consensus.cc:3060] T df751f992649444090e27965eb1af85d P e5256d91808b47c195bc9b4dbd7f2b87 [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:07:25.057886 19483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df751f992649444090e27965eb1af85d" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 25 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:07:25.058480 19483 raft_consensus.cc:3060] T df751f992649444090e27965eb1af85d P 0473d2b2d01f4459b1e90fd12cc7840e [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:07:25.076829 19402 raft_consensus.cc:2468] T df751f992649444090e27965eb1af85d P e5256d91808b47c195bc9b4dbd7f2b87 [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 25.
I20260709 13:07:25.078200 19523 leader_election.cc:304] T df751f992649444090e27965eb1af85d P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 25 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:07:25.079031 26683 raft_consensus.cc:2804] T df751f992649444090e27965eb1af85d P e61c3a8f61bb48f8a963c9480e53c168 [term 25 FOLLOWER]: Leader election won for term 25
I20260709 13:07:25.079579 26683 raft_consensus.cc:697] T df751f992649444090e27965eb1af85d P e61c3a8f61bb48f8a963c9480e53c168 [term 25 LEADER]: Becoming Leader. State: Replica: e61c3a8f61bb48f8a963c9480e53c168, State: Running, Role: LEADER
I20260709 13:07:25.080478 26683 consensus_queue.cc:237] T df751f992649444090e27965eb1af85d P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 23.15, Last appended by leader: 15, Current term: 25, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:07:25.098387 19483 raft_consensus.cc:2468] T df751f992649444090e27965eb1af85d P 0473d2b2d01f4459b1e90fd12cc7840e [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 25.
I20260709 13:07:25.109472 26645 raft_consensus.cc:993] T 172b3dd13109415a955b71ac0e9d2234 P 127766fc592545a4997f7790f50f6076: : Instructing follower e5256d91808b47c195bc9b4dbd7f2b87 to start an election
I20260709 13:07:25.109995 26714 raft_consensus.cc:1081] T 172b3dd13109415a955b71ac0e9d2234 P 127766fc592545a4997f7790f50f6076 [term 18 LEADER]: Signalling peer e5256d91808b47c195bc9b4dbd7f2b87 to start an election
I20260709 13:07:25.111922 19402 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "172b3dd13109415a955b71ac0e9d2234"
dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
 from {username='slave'} at 127.0.0.1:49050
I20260709 13:07:25.112434 19402 raft_consensus.cc:493] T 172b3dd13109415a955b71ac0e9d2234 P e5256d91808b47c195bc9b4dbd7f2b87 [term 18 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:07:25.112738 19402 raft_consensus.cc:3060] T 172b3dd13109415a955b71ac0e9d2234 P e5256d91808b47c195bc9b4dbd7f2b87 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:07:25.121542 19402 raft_consensus.cc:515] T 172b3dd13109415a955b71ac0e9d2234 P e5256d91808b47c195bc9b4dbd7f2b87 [term 19 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:07:25.125131 19402 leader_election.cc:290] T 172b3dd13109415a955b71ac0e9d2234 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 19 election: Requested vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:07:25.125708 19483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "172b3dd13109415a955b71ac0e9d2234" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: true dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:07:25.126284 19483 raft_consensus.cc:3060] T 172b3dd13109415a955b71ac0e9d2234 P 0473d2b2d01f4459b1e90fd12cc7840e [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:07:25.127919 20109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "172b3dd13109415a955b71ac0e9d2234" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: true dest_uuid: "127766fc592545a4997f7790f50f6076"
I20260709 13:07:25.128472 20109 raft_consensus.cc:3055] T 172b3dd13109415a955b71ac0e9d2234 P 127766fc592545a4997f7790f50f6076 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:07:25.128664 20109 raft_consensus.cc:740] T 172b3dd13109415a955b71ac0e9d2234 P 127766fc592545a4997f7790f50f6076 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 127766fc592545a4997f7790f50f6076, State: Running, Role: LEADER
I20260709 13:07:25.133508 19483 raft_consensus.cc:2468] T 172b3dd13109415a955b71ac0e9d2234 P 0473d2b2d01f4459b1e90fd12cc7840e [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 19.
I20260709 13:07:25.134577 19377 leader_election.cc:304] T 172b3dd13109415a955b71ac0e9d2234 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87; no voters: 
I20260709 13:07:25.137339 26599 raft_consensus.cc:2804] T 172b3dd13109415a955b71ac0e9d2234 P e5256d91808b47c195bc9b4dbd7f2b87 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:07:25.137848 26599 raft_consensus.cc:697] T 172b3dd13109415a955b71ac0e9d2234 P e5256d91808b47c195bc9b4dbd7f2b87 [term 19 LEADER]: Becoming Leader. State: Replica: e5256d91808b47c195bc9b4dbd7f2b87, State: Running, Role: LEADER
I20260709 13:07:25.138824 26599 consensus_queue.cc:237] T 172b3dd13109415a955b71ac0e9d2234 P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 18.13, Last appended by leader: 13, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:07:25.142604 20109 consensus_queue.cc:260] T 172b3dd13109415a955b71ac0e9d2234 P 127766fc592545a4997f7790f50f6076 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 18.13, Last appended by leader: 13, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:07:25.146904 20109 raft_consensus.cc:3060] T 172b3dd13109415a955b71ac0e9d2234 P 127766fc592545a4997f7790f50f6076 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:07:25.161721 20109 raft_consensus.cc:2468] T 172b3dd13109415a955b71ac0e9d2234 P 127766fc592545a4997f7790f50f6076 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 19.
I20260709 13:07:25.221817 26617 raft_consensus.cc:493] T 1dc5b3532fe54f74876d02beffa2c230 P e61c3a8f61bb48f8a963c9480e53c168 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:25.222339 26617 raft_consensus.cc:515] T 1dc5b3532fe54f74876d02beffa2c230 P e61c3a8f61bb48f8a963c9480e53c168 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:07:25.224416 26617 leader_election.cc:290] T 1dc5b3532fe54f74876d02beffa2c230 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:07:25.226699 19402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dc5b3532fe54f74876d02beffa2c230" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 24 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:07:25.228394 19486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dc5b3532fe54f74876d02beffa2c230" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 24 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:07:25.228976 19486 raft_consensus.cc:2468] T 1dc5b3532fe54f74876d02beffa2c230 P 0473d2b2d01f4459b1e90fd12cc7840e [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 23.
I20260709 13:07:25.231187 19526 leader_election.cc:304] T 1dc5b3532fe54f74876d02beffa2c230 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168; no voters: e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:07:25.232283 26683 raft_consensus.cc:2804] T 1dc5b3532fe54f74876d02beffa2c230 P e61c3a8f61bb48f8a963c9480e53c168 [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 13:07:25.232723 26683 raft_consensus.cc:493] T 1dc5b3532fe54f74876d02beffa2c230 P e61c3a8f61bb48f8a963c9480e53c168 [term 23 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:25.233131 26683 raft_consensus.cc:3060] T 1dc5b3532fe54f74876d02beffa2c230 P e61c3a8f61bb48f8a963c9480e53c168 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:07:25.260192 26683 raft_consensus.cc:515] T 1dc5b3532fe54f74876d02beffa2c230 P e61c3a8f61bb48f8a963c9480e53c168 [term 24 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:07:25.262210 26683 leader_election.cc:290] T 1dc5b3532fe54f74876d02beffa2c230 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 24 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:07:25.278959 19402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dc5b3532fe54f74876d02beffa2c230" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 24 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
I20260709 13:07:25.279556 19483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dc5b3532fe54f74876d02beffa2c230" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 24 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:07:25.280130 19483 raft_consensus.cc:3060] T 1dc5b3532fe54f74876d02beffa2c230 P 0473d2b2d01f4459b1e90fd12cc7840e [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:07:25.286754 19483 raft_consensus.cc:2468] T 1dc5b3532fe54f74876d02beffa2c230 P 0473d2b2d01f4459b1e90fd12cc7840e [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 24.
I20260709 13:07:25.298810 19526 leader_election.cc:304] T 1dc5b3532fe54f74876d02beffa2c230 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168; no voters: e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:07:25.300252 26722 raft_consensus.cc:2804] T 1dc5b3532fe54f74876d02beffa2c230 P e61c3a8f61bb48f8a963c9480e53c168 [term 24 FOLLOWER]: Leader election won for term 24
I20260709 13:07:25.300809 26722 raft_consensus.cc:697] T 1dc5b3532fe54f74876d02beffa2c230 P e61c3a8f61bb48f8a963c9480e53c168 [term 24 LEADER]: Becoming Leader. State: Replica: e61c3a8f61bb48f8a963c9480e53c168, State: Running, Role: LEADER
I20260709 13:07:25.301746 26722 consensus_queue.cc:237] T 1dc5b3532fe54f74876d02beffa2c230 P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 22.12, Last appended by leader: 12, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:07:25.460388 26722 raft_consensus.cc:493] T 217b5fae677b4971b3bbd2f357a1f7ff P e61c3a8f61bb48f8a963c9480e53c168 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:25.460912 26722 raft_consensus.cc:515] T 217b5fae677b4971b3bbd2f357a1f7ff P e61c3a8f61bb48f8a963c9480e53c168 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:07:25.463088 26722 leader_election.cc:290] T 217b5fae677b4971b3bbd2f357a1f7ff P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:07:25.464838 19483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "217b5fae677b4971b3bbd2f357a1f7ff" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:07:25.465512 19410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "217b5fae677b4971b3bbd2f357a1f7ff" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:07:25.465534 19483 raft_consensus.cc:2468] T 217b5fae677b4971b3bbd2f357a1f7ff P 0473d2b2d01f4459b1e90fd12cc7840e [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 19.
I20260709 13:07:25.466307 19410 raft_consensus.cc:2468] T 217b5fae677b4971b3bbd2f357a1f7ff P e5256d91808b47c195bc9b4dbd7f2b87 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 18.
I20260709 13:07:25.467075 19526 leader_election.cc:304] T 217b5fae677b4971b3bbd2f357a1f7ff P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:07:25.468190 26723 raft_consensus.cc:493] T 46c5bfeecc314717bffe987e6844b6d0 P e61c3a8f61bb48f8a963c9480e53c168 [term 26 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:25.468650 26723 raft_consensus.cc:515] T 46c5bfeecc314717bffe987e6844b6d0 P e61c3a8f61bb48f8a963c9480e53c168 [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:07:25.470753 26723 leader_election.cc:290] T 46c5bfeecc314717bffe987e6844b6d0 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:07:25.471237 26723 raft_consensus.cc:2804] T 217b5fae677b4971b3bbd2f357a1f7ff P e61c3a8f61bb48f8a963c9480e53c168 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:07:25.471560 26723 raft_consensus.cc:493] T 217b5fae677b4971b3bbd2f357a1f7ff P e61c3a8f61bb48f8a963c9480e53c168 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:25.471897 26723 raft_consensus.cc:3060] T 217b5fae677b4971b3bbd2f357a1f7ff P e61c3a8f61bb48f8a963c9480e53c168 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:07:25.475811 19483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46c5bfeecc314717bffe987e6844b6d0" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 27 candidate_status { last_received { term: 25 index: 13 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:07:25.476536 19483 raft_consensus.cc:2468] T 46c5bfeecc314717bffe987e6844b6d0 P 0473d2b2d01f4459b1e90fd12cc7840e [term 26 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 26.
I20260709 13:07:25.478787 19402 raft_consensus.cc:1275] T b9f0d59553ad444883fcf5b5909f9798 P e5256d91808b47c195bc9b4dbd7f2b87 [term 16 FOLLOWER]: Refusing update from remote peer e61c3a8f61bb48f8a963c9480e53c168: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 13:07:25.479782 19526 leader_election.cc:304] T 46c5bfeecc314717bffe987e6844b6d0 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:07:25.481065 26599 raft_consensus.cc:493] T 46c5bfeecc314717bffe987e6844b6d0 P e5256d91808b47c195bc9b4dbd7f2b87 [term 25 FOLLOWER]: Starting pre-election (detected failure of leader e61c3a8f61bb48f8a963c9480e53c168)
I20260709 13:07:25.481583 26599 raft_consensus.cc:515] T 46c5bfeecc314717bffe987e6844b6d0 P e5256d91808b47c195bc9b4dbd7f2b87 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:07:25.482849 26683 raft_consensus.cc:2804] T 46c5bfeecc314717bffe987e6844b6d0 P e61c3a8f61bb48f8a963c9480e53c168 [term 26 FOLLOWER]: Leader pre-election won for term 27
I20260709 13:07:25.483286 26683 raft_consensus.cc:493] T 46c5bfeecc314717bffe987e6844b6d0 P e61c3a8f61bb48f8a963c9480e53c168 [term 26 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:25.483646 26683 raft_consensus.cc:3060] T 46c5bfeecc314717bffe987e6844b6d0 P e61c3a8f61bb48f8a963c9480e53c168 [term 26 FOLLOWER]: Advancing to term 27
I20260709 13:07:25.487965 19410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46c5bfeecc314717bffe987e6844b6d0" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 27 candidate_status { last_received { term: 25 index: 13 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" is_pre_election: true
I20260709 13:07:25.488579 19410 raft_consensus.cc:2468] T 46c5bfeecc314717bffe987e6844b6d0 P e5256d91808b47c195bc9b4dbd7f2b87 [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 25.
I20260709 13:07:25.490504 26599 leader_election.cc:290] T 46c5bfeecc314717bffe987e6844b6d0 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:07:25.492213 19483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46c5bfeecc314717bffe987e6844b6d0" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 26 candidate_status { last_received { term: 25 index: 13 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:07:25.492350 26555 consensus_queue.cc:1048] T b9f0d59553ad444883fcf5b5909f9798 P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:07:25.492938 19483 raft_consensus.cc:2393] T 46c5bfeecc314717bffe987e6844b6d0 P 0473d2b2d01f4459b1e90fd12cc7840e [term 26 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e5256d91808b47c195bc9b4dbd7f2b87 in current term 26: Already voted for candidate 0473d2b2d01f4459b1e90fd12cc7840e in this term.
I20260709 13:07:25.493687 19555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46c5bfeecc314717bffe987e6844b6d0" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 26 candidate_status { last_received { term: 25 index: 13 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:07:25.506263 26693 raft_consensus.cc:493] T 1dc5b3532fe54f74876d02beffa2c230 P e5256d91808b47c195bc9b4dbd7f2b87 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader e61c3a8f61bb48f8a963c9480e53c168)
I20260709 13:07:25.506879 26693 raft_consensus.cc:515] T 1dc5b3532fe54f74876d02beffa2c230 P e5256d91808b47c195bc9b4dbd7f2b87 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:07:25.508977 26693 leader_election.cc:290] T 1dc5b3532fe54f74876d02beffa2c230 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:07:25.509542 19483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dc5b3532fe54f74876d02beffa2c230" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 23 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:07:25.510313 19483 raft_consensus.cc:2368] T 1dc5b3532fe54f74876d02beffa2c230 P 0473d2b2d01f4459b1e90fd12cc7840e [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e5256d91808b47c195bc9b4dbd7f2b87 for earlier term 23. Current term is 24.
I20260709 13:07:25.510445 19551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dc5b3532fe54f74876d02beffa2c230" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 23 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:07:25.511550 19377 leader_election.cc:400] T 1dc5b3532fe54f74876d02beffa2c230 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 23 pre-election: Vote denied by peer 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257) with higher term. Message: Invalid argument: T 1dc5b3532fe54f74876d02beffa2c230 P 0473d2b2d01f4459b1e90fd12cc7840e [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e5256d91808b47c195bc9b4dbd7f2b87 for earlier term 23. Current term is 24.
I20260709 13:07:25.511873 19377 leader_election.cc:403] T 1dc5b3532fe54f74876d02beffa2c230 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 23 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:07:25.513578 26598 raft_consensus.cc:3060] T 1dc5b3532fe54f74876d02beffa2c230 P e5256d91808b47c195bc9b4dbd7f2b87 [term 22 FOLLOWER]: Advancing to term 24
I20260709 13:07:25.556886 19486 raft_consensus.cc:1275] T 172b3dd13109415a955b71ac0e9d2234 P 0473d2b2d01f4459b1e90fd12cc7840e [term 19 FOLLOWER]: Refusing update from remote peer e5256d91808b47c195bc9b4dbd7f2b87: Log matching property violated. Preceding OpId in replica: term: 18 index: 13. Preceding OpId from leader: term: 19 index: 14. (index mismatch)
I20260709 13:07:25.558491 26289 consensus_queue.cc:1048] T 172b3dd13109415a955b71ac0e9d2234 P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:07:25.565889 26598 raft_consensus.cc:2749] T 1dc5b3532fe54f74876d02beffa2c230 P e5256d91808b47c195bc9b4dbd7f2b87 [term 24 FOLLOWER]: Leader pre-election lost for term 23. Reason: Vote denied by peer 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257) with higher term. Message: Invalid argument: T 1dc5b3532fe54f74876d02beffa2c230 P 0473d2b2d01f4459b1e90fd12cc7840e [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e5256d91808b47c195bc9b4dbd7f2b87 for earlier term 23. Current term is 24.
I20260709 13:07:25.568958 19402 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7be9efa6559648dbb5a0f7684c4542d1"
dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:41524
I20260709 13:07:25.569591 19402 raft_consensus.cc:606] T 7be9efa6559648dbb5a0f7684c4542d1 P e5256d91808b47c195bc9b4dbd7f2b87 [term 21 LEADER]: Received request to transfer leadership
I20260709 13:07:25.571830 18300 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:07:25.589150 19402 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7be9efa6559648dbb5a0f7684c4542d1"
dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:41524
I20260709 13:07:25.589840 19402 raft_consensus.cc:606] T 7be9efa6559648dbb5a0f7684c4542d1 P e5256d91808b47c195bc9b4dbd7f2b87 [term 21 LEADER]: Received request to transfer leadership
I20260709 13:07:25.597999 19483 raft_consensus.cc:1275] T b9f0d59553ad444883fcf5b5909f9798 P 0473d2b2d01f4459b1e90fd12cc7840e [term 16 FOLLOWER]: Refusing update from remote peer e61c3a8f61bb48f8a963c9480e53c168: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 13:07:25.599673 26555 consensus_queue.cc:1048] T b9f0d59553ad444883fcf5b5909f9798 P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
W20260709 13:07:25.600270 19293 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: leadership transfer for 7be9efa6559648dbb5a0f7684c4542d1 already in progress
I20260709 13:07:25.619043 26683 raft_consensus.cc:515] T 46c5bfeecc314717bffe987e6844b6d0 P e61c3a8f61bb48f8a963c9480e53c168 [term 27 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:07:25.620332 19555 raft_consensus.cc:2368] T 46c5bfeecc314717bffe987e6844b6d0 P e61c3a8f61bb48f8a963c9480e53c168 [term 27 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e5256d91808b47c195bc9b4dbd7f2b87 for earlier term 26. Current term is 27.
I20260709 13:07:25.624138 19375 leader_election.cc:400] T 46c5bfeecc314717bffe987e6844b6d0 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 26 pre-election: Vote denied by peer e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891) with higher term. Message: Invalid argument: T 46c5bfeecc314717bffe987e6844b6d0 P e61c3a8f61bb48f8a963c9480e53c168 [term 27 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e5256d91808b47c195bc9b4dbd7f2b87 for earlier term 26. Current term is 27.
I20260709 13:07:25.624464 19375 leader_election.cc:403] T 46c5bfeecc314717bffe987e6844b6d0 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 26 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:07:25.625002 26693 raft_consensus.cc:3060] T 46c5bfeecc314717bffe987e6844b6d0 P e5256d91808b47c195bc9b4dbd7f2b87 [term 25 FOLLOWER]: Advancing to term 27
I20260709 13:07:25.637630 26723 raft_consensus.cc:515] T 217b5fae677b4971b3bbd2f357a1f7ff P e61c3a8f61bb48f8a963c9480e53c168 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:07:25.655764 20109 raft_consensus.cc:1275] T 172b3dd13109415a955b71ac0e9d2234 P 127766fc592545a4997f7790f50f6076 [term 19 FOLLOWER]: Refusing update from remote peer e5256d91808b47c195bc9b4dbd7f2b87: Log matching property violated. Preceding OpId in replica: term: 18 index: 13. Preceding OpId from leader: term: 19 index: 14. (index mismatch)
I20260709 13:07:25.657953 19402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46c5bfeecc314717bffe987e6844b6d0" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 27 candidate_status { last_received { term: 25 index: 13 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
I20260709 13:07:25.668188 26598 consensus_queue.cc:1048] T 172b3dd13109415a955b71ac0e9d2234 P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Connected to new peer: Peer: permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:07:25.678465 19480 raft_consensus.cc:1275] T df751f992649444090e27965eb1af85d P 0473d2b2d01f4459b1e90fd12cc7840e [term 25 FOLLOWER]: Refusing update from remote peer e61c3a8f61bb48f8a963c9480e53c168: Log matching property violated. Preceding OpId in replica: term: 22 index: 14. Preceding OpId from leader: term: 25 index: 16. (index mismatch)
I20260709 13:07:25.681002 26722 consensus_queue.cc:1048] T df751f992649444090e27965eb1af85d P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 13:07:25.684136 19410 raft_consensus.cc:1275] T df751f992649444090e27965eb1af85d P e5256d91808b47c195bc9b4dbd7f2b87 [term 25 FOLLOWER]: Refusing update from remote peer e61c3a8f61bb48f8a963c9480e53c168: Log matching property violated. Preceding OpId in replica: term: 22 index: 14. Preceding OpId from leader: term: 25 index: 16. (index mismatch)
W20260709 13:07:25.692453 19293 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.LeaderStepDown -> {remote=127.17.223.1:40321, user_credentials={real_user=slave}} blocked reactor thread for 92334.4us
I20260709 13:07:25.694252 19408 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7be9efa6559648dbb5a0f7684c4542d1"
dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:41524
I20260709 13:07:25.694890 19408 raft_consensus.cc:606] T 7be9efa6559648dbb5a0f7684c4542d1 P e5256d91808b47c195bc9b4dbd7f2b87 [term 21 LEADER]: Received request to transfer leadership
I20260709 13:07:25.695339 26693 raft_consensus.cc:2749] T 46c5bfeecc314717bffe987e6844b6d0 P e5256d91808b47c195bc9b4dbd7f2b87 [term 27 FOLLOWER]: Leader pre-election lost for term 26. Reason: Vote denied by peer e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891) with higher term. Message: Invalid argument: T 46c5bfeecc314717bffe987e6844b6d0 P e61c3a8f61bb48f8a963c9480e53c168 [term 27 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e5256d91808b47c195bc9b4dbd7f2b87 for earlier term 26. Current term is 27.
I20260709 13:07:25.703487 19402 raft_consensus.cc:2468] T 46c5bfeecc314717bffe987e6844b6d0 P e5256d91808b47c195bc9b4dbd7f2b87 [term 27 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 27.
I20260709 13:07:25.708321 19523 leader_election.cc:304] T 46c5bfeecc314717bffe987e6844b6d0 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 27 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:07:25.709594 26617 raft_consensus.cc:2804] T 46c5bfeecc314717bffe987e6844b6d0 P e61c3a8f61bb48f8a963c9480e53c168 [term 27 FOLLOWER]: Leader election won for term 27
I20260709 13:07:25.710551 26617 raft_consensus.cc:697] T 46c5bfeecc314717bffe987e6844b6d0 P e61c3a8f61bb48f8a963c9480e53c168 [term 27 LEADER]: Becoming Leader. State: Replica: e61c3a8f61bb48f8a963c9480e53c168, State: Running, Role: LEADER
I20260709 13:07:25.711792 26617 consensus_queue.cc:237] T 46c5bfeecc314717bffe987e6844b6d0 P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 25.13, Last appended by leader: 13, Current term: 27, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:07:25.706714 26722 consensus_queue.cc:1048] T df751f992649444090e27965eb1af85d P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 14, Time since last communication: 0.021s
I20260709 13:07:25.752187 19478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46c5bfeecc314717bffe987e6844b6d0" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 27 candidate_status { last_received { term: 25 index: 13 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:07:25.752801 19478 raft_consensus.cc:3060] T 46c5bfeecc314717bffe987e6844b6d0 P 0473d2b2d01f4459b1e90fd12cc7840e [term 26 FOLLOWER]: Advancing to term 27
I20260709 13:07:25.751581 26683 leader_election.cc:290] T 46c5bfeecc314717bffe987e6844b6d0 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 27 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:07:25.784993 19478 raft_consensus.cc:2468] T 46c5bfeecc314717bffe987e6844b6d0 P 0473d2b2d01f4459b1e90fd12cc7840e [term 27 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 27.
I20260709 13:07:25.806809 19304 catalog_manager.cc:5697] T 62c6c134d3d24a1ab144dd9ee6bc3f64 P e61c3a8f61bb48f8a963c9480e53c168 reported cstate change: term changed from 14 to 16, leader changed from 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2) to 127766fc592545a4997f7790f50f6076 (127.17.223.4). New cstate: current_term: 16 leader_uuid: "127766fc592545a4997f7790f50f6076" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } } }
I20260709 13:07:25.838637 19402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "217b5fae677b4971b3bbd2f357a1f7ff" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
I20260709 13:07:25.839682 19402 raft_consensus.cc:3060] T 217b5fae677b4971b3bbd2f357a1f7ff P e5256d91808b47c195bc9b4dbd7f2b87 [term 18 FOLLOWER]: Advancing to term 20
W20260709 13:07:25.848435 26732 log.cc:927] Time spent T df751f992649444090e27965eb1af85d P 0473d2b2d01f4459b1e90fd12cc7840e: Append to log took a long time: real 0.062s	user 0.000s	sys 0.000s
I20260709 13:07:25.841547 26723 leader_election.cc:290] T 217b5fae677b4971b3bbd2f357a1f7ff P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 20 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:07:25.860682 19304 catalog_manager.cc:5697] T 14935b3ddf914369822e4a0547aaa355 P e61c3a8f61bb48f8a963c9480e53c168 reported cstate change: config changed from index 4 to 9, term changed from 10 to 12, VOTER e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1) evicted. New cstate: current_term: 12 leader_uuid: "127766fc592545a4997f7790f50f6076" committed_config { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } } }
I20260709 13:07:25.869735 19304 catalog_manager.cc:5697] T 85c494af21f9457a85da47b9bc70c1fd P e61c3a8f61bb48f8a963c9480e53c168 reported cstate change: term changed from 15 to 17, leader changed from e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1) to e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3). New cstate: current_term: 17 leader_uuid: "e61c3a8f61bb48f8a963c9480e53c168" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:25.885937 19402 raft_consensus.cc:2468] T 217b5fae677b4971b3bbd2f357a1f7ff P e5256d91808b47c195bc9b4dbd7f2b87 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 20.
I20260709 13:07:25.904827 19304 catalog_manager.cc:5697] T 96efeaaf1057492490e9a621f37e1a2d P e61c3a8f61bb48f8a963c9480e53c168 reported cstate change: term changed from 17 to 19. New cstate: current_term: 19 leader_uuid: "e61c3a8f61bb48f8a963c9480e53c168" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:07:25.907618 19304 catalog_manager.cc:5697] T 6c5eebf646ad445a9d1b1adc319d7b16 P e61c3a8f61bb48f8a963c9480e53c168 reported cstate change: term changed from 16 to 18. New cstate: current_term: 18 leader_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } } }
I20260709 13:07:25.919644 19301 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:44676 (request call id 226) took 5372 ms. Trace:
I20260709 13:07:25.941372 19301 rpcz_store.cc:276] 0709 13:07:20.547349 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:20.547585 (+   236us) service_pool.cc:224] Handling call
0709 13:07:25.919526 (+5371941us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:07:25.135009 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:07:25.135984 (+   975us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:07:25.136021 (+    37us) write_op.cc:435] Acquired schema lock
0709 13:07:25.136040 (+    19us) tablet.cc:662] Decoding operations
0709 13:07:25.175130 (+ 39090us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:07:25.175187 (+    57us) write_op.cc:641] Partition lock acquired for write op
0709 13:07:25.175213 (+    26us) tablet.cc:685] Acquiring locks for 36 operations
0709 13:07:25.177666 (+  2453us) tablet.cc:701] Row locks acquired
0709 13:07:25.177682 (+    16us) write_op.cc:260] PREPARE: finished
0709 13:07:25.177825 (+   143us) write_op.cc:270] Start()
0709 13:07:25.177949 (+   124us) write_op.cc:276] Timestamp: P: 1783602445177778 usec, L: 0
0709 13:07:25.177967 (+    18us) op_driver.cc:348] REPLICATION: starting
0709 13:07:25.179086 (+  1119us) log.cc:844] Serialized 13968 byte log entry
0709 13:07:25.239388 (+ 60302us) op_driver.cc:464] REPLICATION: finished
0709 13:07:25.289964 (+ 50576us) write_op.cc:301] APPLY: starting
0709 13:07:25.290048 (+    84us) tablet.cc:1367] starting BulkCheckPresence
0709 13:07:25.403354 (+113306us) tablet.cc:1370] finished BulkCheckPresence
0709 13:07:25.403490 (+   136us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:07:25.518863 (+115373us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:07:25.519279 (+   416us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=72,key_file_lookups=72,delta_file_lookups=72,mrs_lookups=0
0709 13:07:25.519324 (+    45us) write_op.cc:312] APPLY: finished
0709 13:07:25.519895 (+   571us) log.cc:844] Serialized 308 byte log entry
0709 13:07:25.520075 (+   180us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:07:25.520340 (+   265us) write_op.cc:454] Released schema lock
0709 13:07:25.520408 (+    68us) write_op.cc:341] FINISH: Updating metrics
0709 13:07:25.520869 (+   461us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:07:25.520897 (+    28us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":35176,"reported_tablets":49,"child_traces":[["op",{"apply.queue_time_us":50317,"apply.run_cpu_time_us":45414,"apply.run_wall_time_us":230880,"cfile_cache_hit":146,"cfile_cache_hit_bytes":154607,"num_ops":36,"prepare.queue_time_us":27267,"prepare.run_cpu_time_us":15406,"prepare.run_wall_time_us":52693,"raft.queue_time_us":48501,"raft.run_cpu_time_us":10019,"raft.run_wall_time_us":41777,"replication_time_us":61273,"spinlock_wait_cycles":2816,"thread_start_us":95370,"threads_started":4,"wal-append.queue_time_us":8002}]]}
I20260709 13:07:25.941947 19304 catalog_manager.cc:5697] T 0e1085d23e8347fbbd5bce7542f4b1f4 P e61c3a8f61bb48f8a963c9480e53c168 reported cstate change: term changed from 12 to 13, leader changed from 127766fc592545a4997f7790f50f6076 (127.17.223.4) to e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3). New cstate: current_term: 13 leader_uuid: "e61c3a8f61bb48f8a963c9480e53c168" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:25.954350 19304 catalog_manager.cc:5697] T b08304a0a02b42d7840c4e8ee9a6bd1a P e61c3a8f61bb48f8a963c9480e53c168 reported cstate change: term changed from 16 to 18, leader changed from 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2) to e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3). New cstate: current_term: 18 leader_uuid: "e61c3a8f61bb48f8a963c9480e53c168" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } health_report { overall_health: HEALTHY } } }
I20260709 13:07:25.983299 19523 leader_election.cc:304] T 217b5fae677b4971b3bbd2f357a1f7ff P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
W20260709 13:07:25.986208 19526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.2:46257, user_credentials={real_user=slave}} blocked reactor thread for 157982us
W20260709 13:07:25.987581 19449 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.4:43121, user_credentials={real_user=slave}} blocked reactor thread for 102387us
I20260709 13:07:25.997743 19483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "217b5fae677b4971b3bbd2f357a1f7ff" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:07:25.998442 19483 raft_consensus.cc:3060] T 217b5fae677b4971b3bbd2f357a1f7ff P 0473d2b2d01f4459b1e90fd12cc7840e [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:07:26.009109 19547 tablet_service.cc:1558] Processing DeleteTablet for tablet 309c3ca0ca4b4f3ba129752ea2cb293b with delete_type TABLET_DATA_TOMBSTONED (TS e61c3a8f61bb48f8a963c9480e53c168 not found in new config with opid_index 10) from {username='slave'} at 127.0.0.1:49904
I20260709 13:07:26.015937 26739 raft_consensus.cc:993] T 7be9efa6559648dbb5a0f7684c4542d1 P e5256d91808b47c195bc9b4dbd7f2b87: : Instructing follower e61c3a8f61bb48f8a963c9480e53c168 to start an election
I20260709 13:07:26.016558 26738 raft_consensus.cc:1081] T 7be9efa6559648dbb5a0f7684c4542d1 P e5256d91808b47c195bc9b4dbd7f2b87 [term 21 LEADER]: Signalling peer e61c3a8f61bb48f8a963c9480e53c168 to start an election
I20260709 13:07:26.005074 26683 raft_consensus.cc:2804] T 217b5fae677b4971b3bbd2f357a1f7ff P e61c3a8f61bb48f8a963c9480e53c168 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:07:26.035073 19408 raft_consensus.cc:1275] T 1dc5b3532fe54f74876d02beffa2c230 P e5256d91808b47c195bc9b4dbd7f2b87 [term 24 FOLLOWER]: Refusing update from remote peer e61c3a8f61bb48f8a963c9480e53c168: Log matching property violated. Preceding OpId in replica: term: 22 index: 12. Preceding OpId from leader: term: 24 index: 13. (index mismatch)
I20260709 13:07:26.036034 19483 raft_consensus.cc:2468] T 217b5fae677b4971b3bbd2f357a1f7ff P 0473d2b2d01f4459b1e90fd12cc7840e [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 20.
I20260709 13:07:26.041020 19478 raft_consensus.cc:1275] T 1dc5b3532fe54f74876d02beffa2c230 P 0473d2b2d01f4459b1e90fd12cc7840e [term 24 FOLLOWER]: Refusing update from remote peer e61c3a8f61bb48f8a963c9480e53c168: Log matching property violated. Preceding OpId in replica: term: 22 index: 12. Preceding OpId from leader: term: 24 index: 13. (index mismatch)
I20260709 13:07:26.070655 19551 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "7be9efa6559648dbb5a0f7684c4542d1"
dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
 from {username='slave'} at 127.0.0.1:40438
I20260709 13:07:26.071277 19551 raft_consensus.cc:493] T 7be9efa6559648dbb5a0f7684c4542d1 P e61c3a8f61bb48f8a963c9480e53c168 [term 21 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:07:26.071650 19551 raft_consensus.cc:3060] T 7be9efa6559648dbb5a0f7684c4542d1 P e61c3a8f61bb48f8a963c9480e53c168 [term 21 FOLLOWER]: Advancing to term 22
W20260709 13:07:26.087553 19523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.4:43121, user_credentials={real_user=slave}} blocked reactor thread for 49726.4us
I20260709 13:07:26.091706 26617 consensus_queue.cc:1048] T 1dc5b3532fe54f74876d02beffa2c230 P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:07:26.078402 26683 raft_consensus.cc:697] T 217b5fae677b4971b3bbd2f357a1f7ff P e61c3a8f61bb48f8a963c9480e53c168 [term 20 LEADER]: Becoming Leader. State: Replica: e61c3a8f61bb48f8a963c9480e53c168, State: Running, Role: LEADER
I20260709 13:07:26.093448 26683 consensus_queue.cc:237] T 217b5fae677b4971b3bbd2f357a1f7ff P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.11, Last appended by leader: 11, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
W20260709 13:07:26.100194 19526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.2:46257, user_credentials={real_user=slave}} blocked reactor thread for 49718.1us
I20260709 13:07:26.087697 19551 raft_consensus.cc:515] T 7be9efa6559648dbb5a0f7684c4542d1 P e61c3a8f61bb48f8a963c9480e53c168 [term 22 FOLLOWER]: Starting forced leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } attrs { replace: true } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:07:26.126433 19551 leader_election.cc:290] T 7be9efa6559648dbb5a0f7684c4542d1 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 22 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:07:26.128858 20110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7be9efa6559648dbb5a0f7684c4542d1" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: true dest_uuid: "127766fc592545a4997f7790f50f6076"
I20260709 13:07:26.129524 20110 raft_consensus.cc:3060] T 7be9efa6559648dbb5a0f7684c4542d1 P 127766fc592545a4997f7790f50f6076 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:07:26.136895 20110 raft_consensus.cc:2468] T 7be9efa6559648dbb5a0f7684c4542d1 P 127766fc592545a4997f7790f50f6076 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 22.
W20260709 13:07:26.157011 19357 auto_rebalancer.cc:893] Removing replace marker failed: Service unavailable: leader transfer in progress
W20260709 13:07:26.157421 19357 auto_rebalancer.cc:901] Could not move replica: Remote error: Service unavailable: leadership transfer for 7be9efa6559648dbb5a0f7684c4542d1 already in progress
W20260709 13:07:26.157687 19357 auto_rebalancer.cc:330] scheduled replica move failed to complete: Remote error: Service unavailable: leadership transfer for 7be9efa6559648dbb5a0f7684c4542d1 already in progress
I20260709 13:07:26.168069 26722 consensus_queue.cc:1048] T 1dc5b3532fe54f74876d02beffa2c230 P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:07:26.168354 19294 catalog_manager.cc:5028] TS e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891): tablet 309c3ca0ca4b4f3ba129752ea2cb293b (table test-workload [id=ce1025c73cf04c4baf25820ae7ff0a53]) successfully deleted
W20260709 13:07:26.188760 19293 catalog_manager.cc:4755] TS e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321): ChangeConfig:REMOVE_PEER RPC failed for tablet 7be9efa6559648dbb5a0f7684c4542d1: Remote error: Service unavailable: leader transfer in progress
W20260709 13:07:26.194379 19375 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.3:36891, user_credentials={real_user=slave}} blocked reactor thread for 93036.2us
I20260709 13:07:26.198930 19402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7be9efa6559648dbb5a0f7684c4542d1" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: true dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
I20260709 13:07:26.207499 19553 raft_consensus.cc:1240] T 7be9efa6559648dbb5a0f7684c4542d1 P e61c3a8f61bb48f8a963c9480e53c168 [term 22 FOLLOWER]: Rejecting Update request from peer e5256d91808b47c195bc9b4dbd7f2b87 for earlier term 21. Current term is 22. Ops: []
I20260709 13:07:26.209805 26599 consensus_queue.cc:1059] T 7be9efa6559648dbb5a0f7684c4542d1 P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 }, Status: INVALID_TERM, Last received: 21.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:07:26.215515 19402 raft_consensus.cc:3055] T 7be9efa6559648dbb5a0f7684c4542d1 P e5256d91808b47c195bc9b4dbd7f2b87 [term 21 LEADER]: Stepping down as leader of term 21
I20260709 13:07:26.215888 19402 raft_consensus.cc:740] T 7be9efa6559648dbb5a0f7684c4542d1 P e5256d91808b47c195bc9b4dbd7f2b87 [term 21 LEADER]: Becoming Follower/Learner. State: Replica: e5256d91808b47c195bc9b4dbd7f2b87, State: Running, Role: LEADER
I20260709 13:07:26.220696 19402 consensus_queue.cc:260] T 7be9efa6559648dbb5a0f7684c4542d1 P e5256d91808b47c195bc9b4dbd7f2b87 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 21.12, Last appended by leader: 12, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } attrs { replace: true } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:07:26.225943 19402 raft_consensus.cc:3060] T 7be9efa6559648dbb5a0f7684c4542d1 P e5256d91808b47c195bc9b4dbd7f2b87 [term 21 FOLLOWER]: Advancing to term 22
W20260709 13:07:26.240541 19449 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.1:40321, user_credentials={real_user=slave}} blocked reactor thread for 129081us
I20260709 13:07:26.241968 19402 raft_consensus.cc:2468] T 7be9efa6559648dbb5a0f7684c4542d1 P e5256d91808b47c195bc9b4dbd7f2b87 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 22.
W20260709 13:07:26.247478 26746 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 22 current term: 22 is higher.
I20260709 13:07:26.265389 19523 leader_election.cc:304] T 7be9efa6559648dbb5a0f7684c4542d1 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 127766fc592545a4997f7790f50f6076, e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:07:26.270404 26763 raft_consensus.cc:2804] T 7be9efa6559648dbb5a0f7684c4542d1 P e61c3a8f61bb48f8a963c9480e53c168 [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:07:26.272578 26763 raft_consensus.cc:697] T 7be9efa6559648dbb5a0f7684c4542d1 P e61c3a8f61bb48f8a963c9480e53c168 [term 22 LEADER]: Becoming Leader. State: Replica: e61c3a8f61bb48f8a963c9480e53c168, State: Running, Role: LEADER
I20260709 13:07:26.273554 26763 consensus_queue.cc:237] T 7be9efa6559648dbb5a0f7684c4542d1 P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 21.12, Last appended by leader: 12, Current term: 22, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } attrs { replace: true } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:07:26.278640 19486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7be9efa6559648dbb5a0f7684c4542d1" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: true dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:07:26.279276 19486 raft_consensus.cc:3060] T 7be9efa6559648dbb5a0f7684c4542d1 P 0473d2b2d01f4459b1e90fd12cc7840e [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:07:26.294584 19486 raft_consensus.cc:2468] T 7be9efa6559648dbb5a0f7684c4542d1 P 0473d2b2d01f4459b1e90fd12cc7840e [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 22.
I20260709 13:07:26.324822 26599 raft_consensus.cc:493] T 14935b3ddf914369822e4a0547aaa355 P e5256d91808b47c195bc9b4dbd7f2b87 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:26.325461 26599 raft_consensus.cc:515] T 14935b3ddf914369822e4a0547aaa355 P e5256d91808b47c195bc9b4dbd7f2b87 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } attrs { replace: true } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:07:26.329454 19486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14935b3ddf914369822e4a0547aaa355" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 15 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:07:26.331343 20110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14935b3ddf914369822e4a0547aaa355" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 15 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:07:26.334478 19377 leader_election.cc:304] T 14935b3ddf914369822e4a0547aaa355 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, 127766fc592545a4997f7790f50f6076
I20260709 13:07:26.335701 26764 raft_consensus.cc:2749] T 14935b3ddf914369822e4a0547aaa355 P e5256d91808b47c195bc9b4dbd7f2b87 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:07:26.337393 19555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14935b3ddf914369822e4a0547aaa355" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 15 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:07:26.338660 26599 leader_election.cc:290] T 14935b3ddf914369822e4a0547aaa355 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:07:26.371747 19410 raft_consensus.cc:1275] T 46c5bfeecc314717bffe987e6844b6d0 P e5256d91808b47c195bc9b4dbd7f2b87 [term 27 FOLLOWER]: Refusing update from remote peer e61c3a8f61bb48f8a963c9480e53c168: Log matching property violated. Preceding OpId in replica: term: 25 index: 13. Preceding OpId from leader: term: 27 index: 14. (index mismatch)
I20260709 13:07:26.373116 19483 raft_consensus.cc:1275] T 46c5bfeecc314717bffe987e6844b6d0 P 0473d2b2d01f4459b1e90fd12cc7840e [term 27 FOLLOWER]: Refusing update from remote peer e61c3a8f61bb48f8a963c9480e53c168: Log matching property violated. Preceding OpId in replica: term: 25 index: 13. Preceding OpId from leader: term: 27 index: 14. (index mismatch)
I20260709 13:07:26.373382 26741 consensus_queue.cc:1048] T 46c5bfeecc314717bffe987e6844b6d0 P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:07:26.376830 26741 consensus_queue.cc:1048] T 46c5bfeecc314717bffe987e6844b6d0 P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:07:26.492481 19301 catalog_manager.cc:5697] T 309c3ca0ca4b4f3ba129752ea2cb293b P e5256d91808b47c195bc9b4dbd7f2b87 reported cstate change: term changed from 13 to 14, leader changed from <none> to 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2). New cstate: current_term: 14 leader_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } } }
I20260709 13:07:26.493992 19301 catalog_manager.cc:5697] T 21e14947d70440f19044d8f75c31e1f9 P e5256d91808b47c195bc9b4dbd7f2b87 reported cstate change: term changed from 20 to 22, leader changed from e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3) to 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2). New cstate: current_term: 22 leader_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } }
I20260709 13:07:26.495401 19301 catalog_manager.cc:5697] T 85c494af21f9457a85da47b9bc70c1fd P e5256d91808b47c195bc9b4dbd7f2b87 reported cstate change: term changed from 17 to 21, leader changed from e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3) to e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1). New cstate: current_term: 21 leader_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:07:26.497174 19301 catalog_manager.cc:5697] T 7f575b143b844aa096b50997dad3516a P e5256d91808b47c195bc9b4dbd7f2b87 reported cstate change: term changed from 18 to 20. New cstate: current_term: 20 leader_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } health_report { overall_health: HEALTHY } } }
I20260709 13:07:26.535697 19402 raft_consensus.cc:1275] T 217b5fae677b4971b3bbd2f357a1f7ff P e5256d91808b47c195bc9b4dbd7f2b87 [term 20 FOLLOWER]: Refusing update from remote peer e61c3a8f61bb48f8a963c9480e53c168: Log matching property violated. Preceding OpId in replica: term: 18 index: 11. Preceding OpId from leader: term: 20 index: 12. (index mismatch)
I20260709 13:07:26.537497 26749 consensus_queue.cc:1048] T 217b5fae677b4971b3bbd2f357a1f7ff P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:07:26.498629 19301 catalog_manager.cc:5697] T 76cb037fc9064d13b59a8969d897ce8c P e5256d91808b47c195bc9b4dbd7f2b87 reported cstate change: term changed from 16 to 22, leader changed from e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1) to e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3). New cstate: current_term: 22 leader_uuid: "e61c3a8f61bb48f8a963c9480e53c168" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } }
I20260709 13:07:26.559242 19483 raft_consensus.cc:1275] T 217b5fae677b4971b3bbd2f357a1f7ff P 0473d2b2d01f4459b1e90fd12cc7840e [term 20 FOLLOWER]: Refusing update from remote peer e61c3a8f61bb48f8a963c9480e53c168: Log matching property violated. Preceding OpId in replica: term: 18 index: 11. Preceding OpId from leader: term: 20 index: 12. (index mismatch)
I20260709 13:07:26.560853 26763 consensus_queue.cc:1048] T 217b5fae677b4971b3bbd2f357a1f7ff P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:07:26.590577 19301 catalog_manager.cc:5697] T 1f85fc4b527a48848e5faa083b604e36 P e5256d91808b47c195bc9b4dbd7f2b87 reported cstate change: term changed from 18 to 20. New cstate: current_term: 20 leader_uuid: "127766fc592545a4997f7790f50f6076" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } } }
I20260709 13:07:26.592432 19301 catalog_manager.cc:5697] T 70797e5783b5454ab0d0eea663e791e3 P e5256d91808b47c195bc9b4dbd7f2b87 reported cstate change: term changed from 20 to 24, leader changed from e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1) to 127766fc592545a4997f7790f50f6076 (127.17.223.4). New cstate: current_term: 24 leader_uuid: "127766fc592545a4997f7790f50f6076" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } } }
I20260709 13:07:26.612142 19547 tablet_service.cc:1558] Processing DeleteTablet for tablet 309c3ca0ca4b4f3ba129752ea2cb293b with delete_type TABLET_DATA_TOMBSTONED (Replica with old config index 5 (current committed config index is 10)) from {username='slave'} at 127.0.0.1:49904
I20260709 13:07:26.615828 19401 tablet_service.cc:1558] Processing DeleteTablet for tablet 14935b3ddf914369822e4a0547aaa355 with delete_type TABLET_DATA_TOMBSTONED (TS e5256d91808b47c195bc9b4dbd7f2b87 not found in new config with opid_index 9) from {username='slave'} at 127.0.0.1:41524
I20260709 13:07:26.625391 19294 catalog_manager.cc:5028] TS e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891): tablet 309c3ca0ca4b4f3ba129752ea2cb293b (table test-workload [id=ce1025c73cf04c4baf25820ae7ff0a53]) successfully deleted
I20260709 13:07:26.594089 19301 catalog_manager.cc:5697] T f1b10566f45d4a7d9029858330e02d5b P e5256d91808b47c195bc9b4dbd7f2b87 reported cstate change: term changed from 19 to 21, leader changed from e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1) to 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2). New cstate: current_term: 21 leader_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } }
I20260709 13:07:26.639389 19301 catalog_manager.cc:5697] T b08304a0a02b42d7840c4e8ee9a6bd1a P e5256d91808b47c195bc9b4dbd7f2b87 reported cstate change: term changed from 18 to 23, leader changed from e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3) to 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2). New cstate: current_term: 23 leader_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } }
I20260709 13:07:26.641077 19301 catalog_manager.cc:5697] T b9f0d59553ad444883fcf5b5909f9798 P e5256d91808b47c195bc9b4dbd7f2b87 reported cstate change: term changed from 15 to 16, leader changed from 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2) to e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3). New cstate: current_term: 16 leader_uuid: "e61c3a8f61bb48f8a963c9480e53c168" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } }
I20260709 13:07:26.642244 19301 catalog_manager.cc:5697] T 4af19371ea874c09a0a2147040835cbb P e5256d91808b47c195bc9b4dbd7f2b87 reported cstate change: term changed from 12 to 14. New cstate: current_term: 14 leader_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:07:26.656021 19304 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:44698 (request call id 235) took 24064 ms (client timeout 15000 ms). Trace:
I20260709 13:07:26.658072 19301 catalog_manager.cc:5697] T 172b3dd13109415a955b71ac0e9d2234 P e5256d91808b47c195bc9b4dbd7f2b87 reported cstate change: term changed from 18 to 19, leader changed from 127766fc592545a4997f7790f50f6076 (127.17.223.4) to e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1). New cstate: current_term: 19 leader_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:07:26.660045 19301 catalog_manager.cc:5697] T 5ec1c4ce15e04c7e8c283a62179f2a64 P e5256d91808b47c195bc9b4dbd7f2b87 reported cstate change: term changed from 14 to 15, leader changed from 127766fc592545a4997f7790f50f6076 (127.17.223.4) to 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2). New cstate: current_term: 15 leader_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } } }
I20260709 13:07:26.661536 19301 catalog_manager.cc:5697] T 4509b76741dc428e9201c70c1658da13 P e5256d91808b47c195bc9b4dbd7f2b87 reported cstate change: term changed from 10 to 16, leader changed from e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1) to e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3). New cstate: current_term: 16 leader_uuid: "e61c3a8f61bb48f8a963c9480e53c168" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } }
W20260709 13:07:26.656610 19304 rpcz_store.cc:269] 0709 13:07:02.590570 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:02.595974 (+  5404us) service_pool.cc:224] Handling call
0709 13:07:26.649431 (+24053457us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:07:26.167808 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:07:26.170124 (+  2316us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:07:26.170180 (+    56us) write_op.cc:435] Acquired schema lock
0709 13:07:26.170218 (+    38us) tablet.cc:662] Decoding operations
0709 13:07:26.179115 (+  8897us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:07:26.179524 (+   409us) write_op.cc:641] Partition lock acquired for write op
0709 13:07:26.179571 (+    47us) tablet.cc:685] Acquiring locks for 7 operations
0709 13:07:26.184594 (+  5023us) tablet.cc:701] Row locks acquired
0709 13:07:26.184625 (+    31us) write_op.cc:260] PREPARE: finished
0709 13:07:26.184827 (+   202us) write_op.cc:270] Start()
0709 13:07:26.184976 (+   149us) write_op.cc:276] Timestamp: P: 1783602446184768 usec, L: 0
0709 13:07:26.185006 (+    30us) op_driver.cc:348] REPLICATION: starting
0709 13:07:26.231485 (+ 46479us) log.cc:844] Serialized 2819 byte log entry
0709 13:07:26.317555 (+ 86070us) op_driver.cc:464] REPLICATION: finished
0709 13:07:26.346501 (+ 28946us) write_op.cc:301] APPLY: starting
0709 13:07:26.346589 (+    88us) tablet.cc:1367] starting BulkCheckPresence
0709 13:07:26.392497 (+ 45908us) tablet.cc:1370] finished BulkCheckPresence
0709 13:07:26.392604 (+   107us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:07:26.423261 (+ 30657us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:07:26.423506 (+   245us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=14,key_file_lookups=14,delta_file_lookups=14,mrs_lookups=0
0709 13:07:26.423559 (+    53us) write_op.cc:312] APPLY: finished
0709 13:07:26.423850 (+   291us) log.cc:844] Serialized 73 byte log entry
0709 13:07:26.424033 (+   183us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:07:26.435716 (+ 11683us) write_op.cc:454] Released schema lock
0709 13:07:26.435765 (+    49us) write_op.cc:341] FINISH: Updating metrics
0709 13:07:26.439494 (+  3729us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:07:26.439703 (+   209us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":66575,"reported_tablets":51,"child_traces":[["op",{"apply.queue_time_us":28679,"apply.run_cpu_time_us":10701,"apply.run_wall_time_us":92958,"cfile_cache_hit":30,"cfile_cache_hit_bytes":33387,"num_ops":7,"prepare.queue_time_us":115415,"prepare.run_cpu_time_us":5313,"prepare.run_wall_time_us":64088,"replication_time_us":113852,"thread_start_us":83423,"threads_started":2}]]}
I20260709 13:07:26.663692 19301 catalog_manager.cc:5697] T 1dc5b3532fe54f74876d02beffa2c230 P e5256d91808b47c195bc9b4dbd7f2b87 reported cstate change: term changed from 22 to 24. New cstate: current_term: 24 leader_uuid: "e61c3a8f61bb48f8a963c9480e53c168" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } }
I20260709 13:07:26.667130 19301 catalog_manager.cc:5697] T df751f992649444090e27965eb1af85d P e5256d91808b47c195bc9b4dbd7f2b87 reported cstate change: term changed from 22 to 25, leader changed from 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2) to e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3). New cstate: current_term: 25 leader_uuid: "e61c3a8f61bb48f8a963c9480e53c168" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } }
I20260709 13:07:26.670099 19301 catalog_manager.cc:5697] T f93ee515a9c14139bf566522ed8232f3 P e5256d91808b47c195bc9b4dbd7f2b87 reported cstate change: term changed from 23 to 25, leader changed from e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3) to 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2). New cstate: current_term: 25 leader_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } }
I20260709 13:07:26.671761 19301 catalog_manager.cc:5697] T ff75a1d4cb1f493db8f71ddc136ba9ab P e5256d91808b47c195bc9b4dbd7f2b87 reported cstate change: term changed from 15 to 21, leader changed from e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1) to 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2). New cstate: current_term: 21 leader_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } }
I20260709 13:07:26.672708 19301 catalog_manager.cc:5697] T 0cdf56e38bbc453d9438d359e5a69955 P e5256d91808b47c195bc9b4dbd7f2b87 reported cstate change: term changed from 19 to 21. New cstate: current_term: 21 leader_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } }
I20260709 13:07:26.673831 19301 catalog_manager.cc:5697] T bc225c93219c45538b53a1bd3d387e4d P e5256d91808b47c195bc9b4dbd7f2b87 reported cstate change: term changed from 14 to 18, leader changed from e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1) to e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3). New cstate: current_term: 18 leader_uuid: "e61c3a8f61bb48f8a963c9480e53c168" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } }
I20260709 13:07:26.675066 19301 catalog_manager.cc:5697] T 28af091831594f9d8e96482078cc7625 P e5256d91808b47c195bc9b4dbd7f2b87 reported cstate change: term changed from 18 to 19, leader changed from 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2) to e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3). New cstate: current_term: 19 leader_uuid: "e61c3a8f61bb48f8a963c9480e53c168" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } }
I20260709 13:07:26.677088 19301 catalog_manager.cc:5697] T 2725d2c4cb054f18b0fc8f735c15f6c2 P e5256d91808b47c195bc9b4dbd7f2b87 reported cstate change: term changed from 19 to 21. New cstate: current_term: 21 leader_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } }
I20260709 13:07:26.703681 26774 tablet_replica.cc:333] T 14935b3ddf914369822e4a0547aaa355 P e5256d91808b47c195bc9b4dbd7f2b87: stopping tablet replica
I20260709 13:07:26.720209 26774 raft_consensus.cc:2243] T 14935b3ddf914369822e4a0547aaa355 P e5256d91808b47c195bc9b4dbd7f2b87 [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:26.720973 26774 raft_consensus.cc:2272] T 14935b3ddf914369822e4a0547aaa355 P e5256d91808b47c195bc9b4dbd7f2b87 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:26.747067 26774 ts_tablet_manager.cc:1916] T 14935b3ddf914369822e4a0547aaa355 P e5256d91808b47c195bc9b4dbd7f2b87: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:07:26.757308 19402 raft_consensus.cc:1275] T 7be9efa6559648dbb5a0f7684c4542d1 P e5256d91808b47c195bc9b4dbd7f2b87 [term 22 FOLLOWER]: Refusing update from remote peer e61c3a8f61bb48f8a963c9480e53c168: Log matching property violated. Preceding OpId in replica: term: 21 index: 12. Preceding OpId from leader: term: 22 index: 13. (index mismatch)
I20260709 13:07:26.761351 26749 consensus_queue.cc:1048] T 7be9efa6559648dbb5a0f7684c4542d1 P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:07:26.765432 20110 raft_consensus.cc:1275] T 7be9efa6559648dbb5a0f7684c4542d1 P 127766fc592545a4997f7790f50f6076 [term 22 FOLLOWER]: Refusing update from remote peer e61c3a8f61bb48f8a963c9480e53c168: Log matching property violated. Preceding OpId in replica: term: 21 index: 12. Preceding OpId from leader: term: 22 index: 13. (index mismatch)
I20260709 13:07:26.767033 26741 consensus_queue.cc:1048] T 7be9efa6559648dbb5a0f7684c4542d1 P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Connected to new peer: Peer: permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:07:26.785689 18300 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:07:26.800010 19483 raft_consensus.cc:1275] T 7be9efa6559648dbb5a0f7684c4542d1 P 0473d2b2d01f4459b1e90fd12cc7840e [term 22 FOLLOWER]: Refusing update from remote peer e61c3a8f61bb48f8a963c9480e53c168: Log matching property violated. Preceding OpId in replica: term: 21 index: 12. Preceding OpId from leader: term: 22 index: 13. (index mismatch)
I20260709 13:07:26.804255 26741 consensus_queue.cc:1048] T 7be9efa6559648dbb5a0f7684c4542d1 P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:07:26.820297 26774 ts_tablet_manager.cc:1929] T 14935b3ddf914369822e4a0547aaa355 P e5256d91808b47c195bc9b4dbd7f2b87: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 10.8
I20260709 13:07:26.827644 26774 log.cc:1199] T 14935b3ddf914369822e4a0547aaa355 P e5256d91808b47c195bc9b4dbd7f2b87: Deleting WAL directory at /tmp/dist-test-taskKd2k48/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602220613947-18300-0/minicluster-data/ts-0-root/wals/14935b3ddf914369822e4a0547aaa355
I20260709 13:07:26.830242 19293 catalog_manager.cc:5028] TS e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321): tablet 14935b3ddf914369822e4a0547aaa355 (table test-workload [id=ce1025c73cf04c4baf25820ae7ff0a53]) successfully deleted
I20260709 13:07:26.842695 19305 catalog_manager.cc:5697] T 48824d5acfbc485ebf8c2d944e7202de P 127766fc592545a4997f7790f50f6076 reported cstate change: term changed from 18 to 21, leader changed from 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2) to 127766fc592545a4997f7790f50f6076 (127.17.223.4). New cstate: current_term: 21 leader_uuid: "127766fc592545a4997f7790f50f6076" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:07:26.861730 19305 catalog_manager.cc:5697] T ab43d85f64114d4ebf618930e43d9ed0 P 127766fc592545a4997f7790f50f6076 reported cstate change: term changed from 17 to 19. New cstate: current_term: 19 leader_uuid: "127766fc592545a4997f7790f50f6076" committed_config { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:07:26.880494 19305 catalog_manager.cc:5697] T ed7fdbcb96d14d418db9ca90a792588a P 127766fc592545a4997f7790f50f6076 reported cstate change: term changed from 9 to 15. New cstate: current_term: 15 leader_uuid: "127766fc592545a4997f7790f50f6076" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:07:26.927364 19402 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "179fd671030940b4b4a4e24bcc4aba0a"
dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
mode: GRACEFUL
new_leader_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
 from {username='slave'} at 127.0.0.1:37312
I20260709 13:07:26.928005 19402 raft_consensus.cc:606] T 179fd671030940b4b4a4e24bcc4aba0a P e5256d91808b47c195bc9b4dbd7f2b87 [term 22 LEADER]: Received request to transfer leadership to TS 0473d2b2d01f4459b1e90fd12cc7840e
I20260709 13:07:26.932817 19405 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2e36a9d6e29c4a7c860cf267efbd4c74"
dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
mode: GRACEFUL
new_leader_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
 from {username='slave'} at 127.0.0.1:37312
I20260709 13:07:26.933418 19405 raft_consensus.cc:606] T 2e36a9d6e29c4a7c860cf267efbd4c74 P e5256d91808b47c195bc9b4dbd7f2b87 [term 15 LEADER]: Received request to transfer leadership to TS 0473d2b2d01f4459b1e90fd12cc7840e
I20260709 13:07:26.947141 19301 catalog_manager.cc:5697] T 217b5fae677b4971b3bbd2f357a1f7ff P e5256d91808b47c195bc9b4dbd7f2b87 reported cstate change: term changed from 18 to 20. New cstate: current_term: 20 leader_uuid: "e61c3a8f61bb48f8a963c9480e53c168" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } }
I20260709 13:07:26.947799 19405 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a08760e15aac4630a629431f56024dc8"
dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
mode: GRACEFUL
new_leader_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
 from {username='slave'} at 127.0.0.1:37312
I20260709 13:07:26.948357 19405 raft_consensus.cc:606] T a08760e15aac4630a629431f56024dc8 P e5256d91808b47c195bc9b4dbd7f2b87 [term 23 LEADER]: Received request to transfer leadership to TS e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:07:26.948493 19301 catalog_manager.cc:5697] T 7be9efa6559648dbb5a0f7684c4542d1 P e5256d91808b47c195bc9b4dbd7f2b87 reported cstate change: term changed from 21 to 22, leader changed from e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1) to e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3). New cstate: current_term: 22 leader_uuid: "e61c3a8f61bb48f8a963c9480e53c168" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } attrs { replace: true } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } } }
I20260709 13:07:26.950030 19301 catalog_manager.cc:5697] T 46c5bfeecc314717bffe987e6844b6d0 P e5256d91808b47c195bc9b4dbd7f2b87 reported cstate change: term changed from 25 to 27. New cstate: current_term: 27 leader_uuid: "e61c3a8f61bb48f8a963c9480e53c168" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } }
I20260709 13:07:26.970400 19411 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ef32ce6fdd0e40d382c79974f30295c6"
dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
mode: GRACEFUL
new_leader_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
 from {username='slave'} at 127.0.0.1:37312
I20260709 13:07:26.971043 19411 raft_consensus.cc:606] T ef32ce6fdd0e40d382c79974f30295c6 P e5256d91808b47c195bc9b4dbd7f2b87 [term 23 LEADER]: Received request to transfer leadership to TS 0473d2b2d01f4459b1e90fd12cc7840e
I20260709 13:07:26.972658 18300 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 4
I20260709 13:07:26.996879 18300 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
W20260709 13:07:27.003830 19305 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:51954 (request call id 135) took 23282 ms (client timeout 15000 ms). Trace:
W20260709 13:07:27.010807 19305 rpcz_store.cc:269] 0709 13:07:03.721889 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:03.760394 (+ 38505us) service_pool.cc:224] Handling call
0709 13:07:04.398739 (+638345us) spinlock_profiling.cc:243] Waited 21.4 ms on lock 0x7b54003fb6d4. stack: 00007f4a79de9343 00007f4a79de9240 00007f4a797781d4 00007f4a834b6304 00007f4a834b6299 00007f4a7ce72090 00007f4a7cf10f3a 00007f4a82cc71cc 00007f4a82dc537e 00007f4a812862a4 00007f4a81286232 00007f4a81286161 00007f4a812860dc 00007f4a81285392 00007f4a7b24348c 00007f4a7b2428c6
0709 13:07:26.938960 (+22540221us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:07:26.938986 (+    26us) write_op.cc:454] Released schema lock
0709 13:07:27.003739 (+ 64753us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:07:26.927108 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:07:26.927606 (+   498us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:07:26.927644 (+    38us) write_op.cc:435] Acquired schema lock
0709 13:07:26.927661 (+    17us) tablet.cc:662] Decoding operations
0709 13:07:26.928183 (+   522us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:07:26.928241 (+    58us) write_op.cc:641] Partition lock acquired for write op
0709 13:07:26.928273 (+    32us) tablet.cc:685] Acquiring locks for 3 operations
0709 13:07:26.928604 (+   331us) tablet.cc:701] Row locks acquired
0709 13:07:26.928618 (+    14us) write_op.cc:260] PREPARE: finished
0709 13:07:26.928760 (+   142us) write_op.cc:270] Start()
0709 13:07:26.928855 (+    95us) write_op.cc:276] Timestamp: P: 1783602446928709 usec, L: 0
0709 13:07:26.928875 (+    20us) op_driver.cc:348] REPLICATION: starting
0709 13:07:26.929440 (+   565us) log.cc:844] Serialized 1289 byte log entry
0709 13:07:26.932109 (+  2669us) op_driver.cc:464] REPLICATION: finished
0709 13:07:26.932704 (+   595us) write_op.cc:301] APPLY: starting
0709 13:07:26.932794 (+    90us) tablet.cc:1367] starting BulkCheckPresence
0709 13:07:26.934565 (+  1771us) tablet.cc:1370] finished BulkCheckPresence
0709 13:07:26.934687 (+   122us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:07:26.936615 (+  1928us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:07:26.936804 (+   189us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=6,key_file_lookups=6,delta_file_lookups=6,mrs_lookups=0
0709 13:07:26.936856 (+    52us) write_op.cc:312] APPLY: finished
0709 13:07:26.937093 (+   237us) log.cc:844] Serialized 41 byte log entry
0709 13:07:26.938430 (+  1337us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:07:26.938515 (+    85us) write_op.cc:454] Released schema lock
0709 13:07:26.938553 (+    38us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"mutex_wait_us":1620208,"reported_tablets":28,"spinlock_wait_cycles":49176832,"child_traces":[["op",{"apply.queue_time_us":378,"apply.run_cpu_time_us":4985,"apply.run_wall_time_us":6150,"cfile_cache_hit":12,"cfile_cache_hit_bytes":12540,"num_ops":3,"prepare.queue_time_us":2925,"prepare.run_cpu_time_us":2595,"prepare.run_wall_time_us":2595,"replication_time_us":3098}]]}
I20260709 13:07:27.027009 19306 catalog_manager.cc:5697] T 14935b3ddf914369822e4a0547aaa355 P 0473d2b2d01f4459b1e90fd12cc7840e reported cstate change: term changed from 12 to 15, leader changed from 127766fc592545a4997f7790f50f6076 (127.17.223.4) to 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2). New cstate: current_term: 15 leader_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" committed_config { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:27.031106 19306 catalog_manager.cc:5697] T ab43d85f64114d4ebf618930e43d9ed0 P 0473d2b2d01f4459b1e90fd12cc7840e reported cstate change: term changed from 19 to 21. New cstate: current_term: 21 leader_uuid: "127766fc592545a4997f7790f50f6076" committed_config { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } } }
I20260709 13:07:27.032872 19306 catalog_manager.cc:5697] T 96efeaaf1057492490e9a621f37e1a2d P 0473d2b2d01f4459b1e90fd12cc7840e reported cstate change: term changed from 19 to 21, leader changed from e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3) to 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2). New cstate: current_term: 21 leader_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:27.043637 26762 raft_consensus.cc:993] T 2e36a9d6e29c4a7c860cf267efbd4c74 P e5256d91808b47c195bc9b4dbd7f2b87: : Instructing follower 0473d2b2d01f4459b1e90fd12cc7840e to start an election
I20260709 13:07:27.044191 26599 raft_consensus.cc:1081] T 2e36a9d6e29c4a7c860cf267efbd4c74 P e5256d91808b47c195bc9b4dbd7f2b87 [term 15 LEADER]: Signalling peer 0473d2b2d01f4459b1e90fd12cc7840e to start an election
I20260709 13:07:27.050523 19478 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "2e36a9d6e29c4a7c860cf267efbd4c74"
dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
 from {username='slave'} at 127.0.0.1:58294
I20260709 13:07:27.054836 19478 raft_consensus.cc:493] T 2e36a9d6e29c4a7c860cf267efbd4c74 P 0473d2b2d01f4459b1e90fd12cc7840e [term 15 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:07:27.055233 19478 raft_consensus.cc:3060] T 2e36a9d6e29c4a7c860cf267efbd4c74 P 0473d2b2d01f4459b1e90fd12cc7840e [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:07:27.073593 19478 raft_consensus.cc:515] T 2e36a9d6e29c4a7c860cf267efbd4c74 P 0473d2b2d01f4459b1e90fd12cc7840e [term 16 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:07:27.077498 19478 leader_election.cc:290] T 2e36a9d6e29c4a7c860cf267efbd4c74 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 16 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:07:27.078605 19411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e36a9d6e29c4a7c860cf267efbd4c74" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: true dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
I20260709 13:07:27.083920 19411 raft_consensus.cc:3055] T 2e36a9d6e29c4a7c860cf267efbd4c74 P e5256d91808b47c195bc9b4dbd7f2b87 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:07:27.084235 19411 raft_consensus.cc:740] T 2e36a9d6e29c4a7c860cf267efbd4c74 P e5256d91808b47c195bc9b4dbd7f2b87 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: e5256d91808b47c195bc9b4dbd7f2b87, State: Running, Role: LEADER
I20260709 13:07:27.083220 19551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e36a9d6e29c4a7c860cf267efbd4c74" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: true dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:07:27.085067 19551 raft_consensus.cc:3060] T 2e36a9d6e29c4a7c860cf267efbd4c74 P e61c3a8f61bb48f8a963c9480e53c168 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:07:27.092801 19551 raft_consensus.cc:2468] T 2e36a9d6e29c4a7c860cf267efbd4c74 P e61c3a8f61bb48f8a963c9480e53c168 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 16.
I20260709 13:07:27.086222 19411 consensus_queue.cc:260] T 2e36a9d6e29c4a7c860cf267efbd4c74 P e5256d91808b47c195bc9b4dbd7f2b87 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.8, Last appended by leader: 8, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:07:27.095022 19411 raft_consensus.cc:3060] T 2e36a9d6e29c4a7c860cf267efbd4c74 P e5256d91808b47c195bc9b4dbd7f2b87 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:07:27.097254 19450 leader_election.cc:304] T 2e36a9d6e29c4a7c860cf267efbd4c74 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:07:27.099677 26511 raft_consensus.cc:2804] T 2e36a9d6e29c4a7c860cf267efbd4c74 P 0473d2b2d01f4459b1e90fd12cc7840e [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:07:27.100190 26511 raft_consensus.cc:697] T 2e36a9d6e29c4a7c860cf267efbd4c74 P 0473d2b2d01f4459b1e90fd12cc7840e [term 16 LEADER]: Becoming Leader. State: Replica: 0473d2b2d01f4459b1e90fd12cc7840e, State: Running, Role: LEADER
I20260709 13:07:27.101040 26511 consensus_queue.cc:237] T 2e36a9d6e29c4a7c860cf267efbd4c74 P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.8, Last appended by leader: 8, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:07:27.105777 19411 raft_consensus.cc:2468] T 2e36a9d6e29c4a7c860cf267efbd4c74 P e5256d91808b47c195bc9b4dbd7f2b87 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 16.
I20260709 13:07:27.119637 19308 catalog_manager.cc:5697] T ab43d85f64114d4ebf618930e43d9ed0 P 127766fc592545a4997f7790f50f6076 reported cstate change: term changed from 21 to 23. New cstate: current_term: 23 leader_uuid: "127766fc592545a4997f7790f50f6076" committed_config { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:07:27.122932 19308 catalog_manager.cc:5697] T 62c6c134d3d24a1ab144dd9ee6bc3f64 P 127766fc592545a4997f7790f50f6076 reported cstate change: term changed from 16 to 18. New cstate: current_term: 18 leader_uuid: "127766fc592545a4997f7790f50f6076" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:07:27.127715 19308 catalog_manager.cc:5697] T ed7fdbcb96d14d418db9ca90a792588a P 127766fc592545a4997f7790f50f6076 reported cstate change: term changed from 15 to 18, leader changed from 127766fc592545a4997f7790f50f6076 (127.17.223.4) to 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2). New cstate: current_term: 18 leader_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } } }
I20260709 13:07:27.160422 19306 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:44688 (request call id 229) took 10751 ms. Trace:
I20260709 13:07:27.160934 19306 rpcz_store.cc:276] 0709 13:07:16.409455 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:16.409716 (+   261us) service_pool.cc:224] Handling call
0709 13:07:27.061237 (+10651521us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:07:27.061265 (+    28us) write_op.cc:454] Released schema lock
0709 13:07:27.160328 (+ 99063us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:07:27.051457 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:07:27.051974 (+   517us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:07:27.052008 (+    34us) write_op.cc:435] Acquired schema lock
0709 13:07:27.052020 (+    12us) tablet.cc:662] Decoding operations
0709 13:07:27.052542 (+   522us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:07:27.052597 (+    55us) write_op.cc:641] Partition lock acquired for write op
0709 13:07:27.052622 (+    25us) tablet.cc:685] Acquiring locks for 3 operations
0709 13:07:27.052945 (+   323us) tablet.cc:701] Row locks acquired
0709 13:07:27.052961 (+    16us) write_op.cc:260] PREPARE: finished
0709 13:07:27.053102 (+   141us) write_op.cc:270] Start()
0709 13:07:27.053200 (+    98us) write_op.cc:276] Timestamp: P: 1783602447053047 usec, L: 0
0709 13:07:27.053216 (+    16us) op_driver.cc:348] REPLICATION: starting
0709 13:07:27.053794 (+   578us) log.cc:844] Serialized 1293 byte log entry
0709 13:07:27.055611 (+  1817us) op_driver.cc:464] REPLICATION: finished
0709 13:07:27.056011 (+   400us) write_op.cc:301] APPLY: starting
0709 13:07:27.056084 (+    73us) tablet.cc:1367] starting BulkCheckPresence
0709 13:07:27.057815 (+  1731us) tablet.cc:1370] finished BulkCheckPresence
0709 13:07:27.057896 (+    81us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:07:27.059613 (+  1717us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:07:27.059798 (+   185us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=6,key_file_lookups=6,delta_file_lookups=6,mrs_lookups=0
0709 13:07:27.059846 (+    48us) write_op.cc:312] APPLY: finished
0709 13:07:27.060034 (+   188us) log.cc:844] Serialized 41 byte log entry
0709 13:07:27.060184 (+   150us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:07:27.060269 (+    85us) write_op.cc:454] Released schema lock
0709 13:07:27.060307 (+    38us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"mutex_wait_us":113,"reported_tablets":51,"child_traces":[["op",{"apply.queue_time_us":216,"apply.run_cpu_time_us":4546,"apply.run_wall_time_us":4546,"cfile_cache_hit":12,"cfile_cache_hit_bytes":12540,"num_ops":3,"prepare.queue_time_us":95,"prepare.run_cpu_time_us":2572,"prepare.run_wall_time_us":2572,"replication_time_us":2296}]]}
I20260709 13:07:27.234192 19551 consensus_queue.cc:237] T 7be9efa6559648dbb5a0f7684c4542d1 P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 22.13, Last appended by leader: 12, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:07:27.240211 20110 raft_consensus.cc:1275] T 7be9efa6559648dbb5a0f7684c4542d1 P 127766fc592545a4997f7790f50f6076 [term 22 FOLLOWER]: Refusing update from remote peer e61c3a8f61bb48f8a963c9480e53c168: Log matching property violated. Preceding OpId in replica: term: 22 index: 13. Preceding OpId from leader: term: 22 index: 14. (index mismatch)
I20260709 13:07:27.240725 19308 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:51954 (request call id 136) took 7854 ms. Trace:
I20260709 13:07:27.243031 19478 raft_consensus.cc:1275] T 7be9efa6559648dbb5a0f7684c4542d1 P 0473d2b2d01f4459b1e90fd12cc7840e [term 22 FOLLOWER]: Refusing update from remote peer e61c3a8f61bb48f8a963c9480e53c168: Log matching property violated. Preceding OpId in replica: term: 22 index: 13. Preceding OpId from leader: term: 22 index: 14. (index mismatch)
I20260709 13:07:27.244241 26763 consensus_queue.cc:1048] T 7be9efa6559648dbb5a0f7684c4542d1 P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Connected to new peer: Peer: permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:07:27.266587 26617 raft_consensus.cc:2955] T 7be9efa6559648dbb5a0f7684c4542d1 P e61c3a8f61bb48f8a963c9480e53c168 [term 22 LEADER]: Committing config change with OpId 22.14: config changed from index 6 to 14, VOTER e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1) evicted. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } } }
I20260709 13:07:27.256464 19308 rpcz_store.cc:276] 0709 13:07:19.386088 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:19.386416 (+   328us) service_pool.cc:224] Handling call
0709 13:07:27.148148 (+7761732us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:07:27.148177 (+    29us) write_op.cc:454] Released schema lock
0709 13:07:27.240661 (+ 92484us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:07:27.135815 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:07:27.136407 (+   592us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:07:27.136447 (+    40us) write_op.cc:435] Acquired schema lock
0709 13:07:27.136468 (+    21us) tablet.cc:662] Decoding operations
0709 13:07:27.137033 (+   565us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:07:27.137091 (+    58us) write_op.cc:641] Partition lock acquired for write op
0709 13:07:27.137126 (+    35us) tablet.cc:685] Acquiring locks for 3 operations
0709 13:07:27.137472 (+   346us) tablet.cc:701] Row locks acquired
0709 13:07:27.137495 (+    23us) write_op.cc:260] PREPARE: finished
0709 13:07:27.137646 (+   151us) write_op.cc:270] Start()
0709 13:07:27.137763 (+   117us) write_op.cc:276] Timestamp: P: 1783602447137600 usec, L: 0
0709 13:07:27.137787 (+    24us) op_driver.cc:348] REPLICATION: starting
0709 13:07:27.138459 (+   672us) log.cc:844] Serialized 1293 byte log entry
0709 13:07:27.140907 (+  2448us) op_driver.cc:464] REPLICATION: finished
0709 13:07:27.142428 (+  1521us) write_op.cc:301] APPLY: starting
0709 13:07:27.142502 (+    74us) tablet.cc:1367] starting BulkCheckPresence
0709 13:07:27.144360 (+  1858us) tablet.cc:1370] finished BulkCheckPresence
0709 13:07:27.144474 (+   114us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:07:27.146308 (+  1834us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:07:27.146484 (+   176us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=6,key_file_lookups=6,delta_file_lookups=6,mrs_lookups=0
0709 13:07:27.146535 (+    51us) write_op.cc:312] APPLY: finished
0709 13:07:27.146772 (+   237us) log.cc:844] Serialized 41 byte log entry
0709 13:07:27.147647 (+   875us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:07:27.147741 (+    94us) write_op.cc:454] Released schema lock
0709 13:07:27.147788 (+    47us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"mutex_wait_us":77840,"reported_tablets":28,"child_traces":[["op",{"apply.queue_time_us":1295,"apply.run_cpu_time_us":4910,"apply.run_wall_time_us":5617,"cfile_cache_hit":12,"cfile_cache_hit_bytes":12540,"num_ops":3,"prepare.queue_time_us":123,"prepare.run_cpu_time_us":2927,"prepare.run_wall_time_us":2926,"replication_time_us":3007}]]}
I20260709 13:07:27.276605 20108 raft_consensus.cc:2955] T 7be9efa6559648dbb5a0f7684c4542d1 P 127766fc592545a4997f7790f50f6076 [term 22 FOLLOWER]: Committing config change with OpId 22.14: config changed from index 6 to 14, VOTER e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1) evicted. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } } }
I20260709 13:07:27.276885 19302 catalog_manager.cc:5697] T 0e1085d23e8347fbbd5bce7542f4b1f4 P e61c3a8f61bb48f8a963c9480e53c168 reported cstate change: term changed from 13 to 16, leader changed from e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3) to 127766fc592545a4997f7790f50f6076 (127.17.223.4). New cstate: current_term: 16 leader_uuid: "127766fc592545a4997f7790f50f6076" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } } }
I20260709 13:07:27.282862 26763 consensus_queue.cc:1048] T 7be9efa6559648dbb5a0f7684c4542d1 P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:07:27.289207 19478 raft_consensus.cc:2955] T 7be9efa6559648dbb5a0f7684c4542d1 P 0473d2b2d01f4459b1e90fd12cc7840e [term 22 FOLLOWER]: Committing config change with OpId 22.14: config changed from index 6 to 14, VOTER e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1) evicted. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } } }
I20260709 13:07:27.310297 19294 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 7be9efa6559648dbb5a0f7684c4542d1 with cas_config_opid_index 6: ChangeConfig:REMOVE_PEER succeeded (attempt 8)
I20260709 13:07:27.334563 26764 raft_consensus.cc:993] T a08760e15aac4630a629431f56024dc8 P e5256d91808b47c195bc9b4dbd7f2b87: : Instructing follower e61c3a8f61bb48f8a963c9480e53c168 to start an election
I20260709 13:07:27.335143 26599 raft_consensus.cc:1081] T a08760e15aac4630a629431f56024dc8 P e5256d91808b47c195bc9b4dbd7f2b87 [term 23 LEADER]: Signalling peer e61c3a8f61bb48f8a963c9480e53c168 to start an election
I20260709 13:07:27.336880 19551 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a08760e15aac4630a629431f56024dc8"
dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
 from {username='slave'} at 127.0.0.1:40438
I20260709 13:07:27.337477 19551 raft_consensus.cc:493] T a08760e15aac4630a629431f56024dc8 P e61c3a8f61bb48f8a963c9480e53c168 [term 23 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:07:27.337834 19551 raft_consensus.cc:3060] T a08760e15aac4630a629431f56024dc8 P e61c3a8f61bb48f8a963c9480e53c168 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:07:27.353652 26764 raft_consensus.cc:993] T ef32ce6fdd0e40d382c79974f30295c6 P e5256d91808b47c195bc9b4dbd7f2b87: : Instructing follower 0473d2b2d01f4459b1e90fd12cc7840e to start an election
I20260709 13:07:27.354202 26764 raft_consensus.cc:1081] T ef32ce6fdd0e40d382c79974f30295c6 P e5256d91808b47c195bc9b4dbd7f2b87 [term 23 LEADER]: Signalling peer 0473d2b2d01f4459b1e90fd12cc7840e to start an election
I20260709 13:07:27.361481 26762 raft_consensus.cc:993] T 179fd671030940b4b4a4e24bcc4aba0a P e5256d91808b47c195bc9b4dbd7f2b87: : Instructing follower 0473d2b2d01f4459b1e90fd12cc7840e to start an election
I20260709 13:07:27.362023 26762 raft_consensus.cc:1081] T 179fd671030940b4b4a4e24bcc4aba0a P e5256d91808b47c195bc9b4dbd7f2b87 [term 22 LEADER]: Signalling peer 0473d2b2d01f4459b1e90fd12cc7840e to start an election
I20260709 13:07:27.368191 19551 raft_consensus.cc:515] T a08760e15aac4630a629431f56024dc8 P e61c3a8f61bb48f8a963c9480e53c168 [term 24 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:07:27.369443 19483 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "179fd671030940b4b4a4e24bcc4aba0a"
dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
 from {username='slave'} at 127.0.0.1:58294
I20260709 13:07:27.369979 19483 raft_consensus.cc:493] T 179fd671030940b4b4a4e24bcc4aba0a P 0473d2b2d01f4459b1e90fd12cc7840e [term 22 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:07:27.370302 19483 raft_consensus.cc:3060] T 179fd671030940b4b4a4e24bcc4aba0a P 0473d2b2d01f4459b1e90fd12cc7840e [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:07:27.372056 19551 leader_election.cc:290] T a08760e15aac4630a629431f56024dc8 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 24 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:07:27.373003 19411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a08760e15aac4630a629431f56024dc8" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 24 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: true dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
I20260709 13:07:27.374956 19486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a08760e15aac4630a629431f56024dc8" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 24 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: true dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:07:27.375523 19486 raft_consensus.cc:3060] T a08760e15aac4630a629431f56024dc8 P 0473d2b2d01f4459b1e90fd12cc7840e [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:07:27.374039 19411 raft_consensus.cc:3055] T a08760e15aac4630a629431f56024dc8 P e5256d91808b47c195bc9b4dbd7f2b87 [term 23 LEADER]: Stepping down as leader of term 23
I20260709 13:07:27.377534 19411 raft_consensus.cc:740] T a08760e15aac4630a629431f56024dc8 P e5256d91808b47c195bc9b4dbd7f2b87 [term 23 LEADER]: Becoming Follower/Learner. State: Replica: e5256d91808b47c195bc9b4dbd7f2b87, State: Running, Role: LEADER
I20260709 13:07:27.378950 19411 consensus_queue.cc:260] T a08760e15aac4630a629431f56024dc8 P e5256d91808b47c195bc9b4dbd7f2b87 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 23.13, Last appended by leader: 13, Current term: 23, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:07:27.381127 19478 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ef32ce6fdd0e40d382c79974f30295c6"
dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
 from {username='slave'} at 127.0.0.1:58294
I20260709 13:07:27.381685 19478 raft_consensus.cc:493] T ef32ce6fdd0e40d382c79974f30295c6 P 0473d2b2d01f4459b1e90fd12cc7840e [term 23 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:07:27.382000 19478 raft_consensus.cc:3060] T ef32ce6fdd0e40d382c79974f30295c6 P 0473d2b2d01f4459b1e90fd12cc7840e [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:07:27.386109 19411 raft_consensus.cc:3060] T a08760e15aac4630a629431f56024dc8 P e5256d91808b47c195bc9b4dbd7f2b87 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:07:27.399781 19483 raft_consensus.cc:515] T 179fd671030940b4b4a4e24bcc4aba0a P 0473d2b2d01f4459b1e90fd12cc7840e [term 23 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:07:27.400465 19486 raft_consensus.cc:2468] T a08760e15aac4630a629431f56024dc8 P 0473d2b2d01f4459b1e90fd12cc7840e [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 24.
I20260709 13:07:27.399515 19478 raft_consensus.cc:515] T ef32ce6fdd0e40d382c79974f30295c6 P 0473d2b2d01f4459b1e90fd12cc7840e [term 24 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:07:27.401895 19526 leader_election.cc:304] T a08760e15aac4630a629431f56024dc8 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:07:27.403640 19405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "179fd671030940b4b4a4e24bcc4aba0a" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: true dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
I20260709 13:07:27.404127 19405 raft_consensus.cc:3055] T 179fd671030940b4b4a4e24bcc4aba0a P e5256d91808b47c195bc9b4dbd7f2b87 [term 22 LEADER]: Stepping down as leader of term 22
I20260709 13:07:27.404349 19405 raft_consensus.cc:740] T 179fd671030940b4b4a4e24bcc4aba0a P e5256d91808b47c195bc9b4dbd7f2b87 [term 22 LEADER]: Becoming Follower/Learner. State: Replica: e5256d91808b47c195bc9b4dbd7f2b87, State: Running, Role: LEADER
I20260709 13:07:27.404981 19411 raft_consensus.cc:2468] T a08760e15aac4630a629431f56024dc8 P e5256d91808b47c195bc9b4dbd7f2b87 [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 24.
I20260709 13:07:27.405915 19483 leader_election.cc:290] T 179fd671030940b4b4a4e24bcc4aba0a P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 23 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:07:27.407514 19551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "179fd671030940b4b4a4e24bcc4aba0a" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: true dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:07:27.408344 19551 raft_consensus.cc:3060] T 179fd671030940b4b4a4e24bcc4aba0a P e61c3a8f61bb48f8a963c9480e53c168 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:07:27.405037 19405 consensus_queue.cc:260] T 179fd671030940b4b4a4e24bcc4aba0a P e5256d91808b47c195bc9b4dbd7f2b87 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 22.14, Last appended by leader: 14, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:07:27.409855 19411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef32ce6fdd0e40d382c79974f30295c6" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 24 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: true dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
I20260709 13:07:27.410408 19411 raft_consensus.cc:3055] T ef32ce6fdd0e40d382c79974f30295c6 P e5256d91808b47c195bc9b4dbd7f2b87 [term 23 LEADER]: Stepping down as leader of term 23
I20260709 13:07:27.410748 19411 raft_consensus.cc:740] T ef32ce6fdd0e40d382c79974f30295c6 P e5256d91808b47c195bc9b4dbd7f2b87 [term 23 LEADER]: Becoming Follower/Learner. State: Replica: e5256d91808b47c195bc9b4dbd7f2b87, State: Running, Role: LEADER
I20260709 13:07:27.411700 19405 raft_consensus.cc:3060] T 179fd671030940b4b4a4e24bcc4aba0a P e5256d91808b47c195bc9b4dbd7f2b87 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:07:27.411535 19411 consensus_queue.cc:260] T ef32ce6fdd0e40d382c79974f30295c6 P e5256d91808b47c195bc9b4dbd7f2b87 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 23.13, Last appended by leader: 13, Current term: 23, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:07:27.412529 19411 raft_consensus.cc:3060] T ef32ce6fdd0e40d382c79974f30295c6 P e5256d91808b47c195bc9b4dbd7f2b87 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:07:27.418077 19553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef32ce6fdd0e40d382c79974f30295c6" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 24 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: true dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:07:27.418726 19553 raft_consensus.cc:3060] T ef32ce6fdd0e40d382c79974f30295c6 P e61c3a8f61bb48f8a963c9480e53c168 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:07:27.420563 19478 leader_election.cc:290] T ef32ce6fdd0e40d382c79974f30295c6 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 24 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:07:27.403367 26617 raft_consensus.cc:2804] T a08760e15aac4630a629431f56024dc8 P e61c3a8f61bb48f8a963c9480e53c168 [term 24 FOLLOWER]: Leader election won for term 24
I20260709 13:07:27.425325 19405 raft_consensus.cc:2468] T 179fd671030940b4b4a4e24bcc4aba0a P e5256d91808b47c195bc9b4dbd7f2b87 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 23.
I20260709 13:07:27.435024 19553 raft_consensus.cc:2468] T ef32ce6fdd0e40d382c79974f30295c6 P e61c3a8f61bb48f8a963c9480e53c168 [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 24.
I20260709 13:07:27.438969 19411 raft_consensus.cc:2468] T ef32ce6fdd0e40d382c79974f30295c6 P e5256d91808b47c195bc9b4dbd7f2b87 [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 24.
I20260709 13:07:27.444765 19551 raft_consensus.cc:2468] T 179fd671030940b4b4a4e24bcc4aba0a P e61c3a8f61bb48f8a963c9480e53c168 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 23.
I20260709 13:07:27.471921 19450 leader_election.cc:304] T ef32ce6fdd0e40d382c79974f30295c6 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:07:27.474694 19308 catalog_manager.cc:5697] T 2e36a9d6e29c4a7c860cf267efbd4c74 P 0473d2b2d01f4459b1e90fd12cc7840e reported cstate change: term changed from 15 to 16, leader changed from e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1) to 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2). New cstate: current_term: 16 leader_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:27.474576 19450 leader_election.cc:304] T 179fd671030940b4b4a4e24bcc4aba0a P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:07:27.479125 26742 raft_consensus.cc:2804] T ef32ce6fdd0e40d382c79974f30295c6 P 0473d2b2d01f4459b1e90fd12cc7840e [term 24 FOLLOWER]: Leader election won for term 24
I20260709 13:07:27.492585 26577 raft_consensus.cc:2804] T 179fd671030940b4b4a4e24bcc4aba0a P 0473d2b2d01f4459b1e90fd12cc7840e [term 23 FOLLOWER]: Leader election won for term 23
I20260709 13:07:27.493152 26577 raft_consensus.cc:697] T 179fd671030940b4b4a4e24bcc4aba0a P 0473d2b2d01f4459b1e90fd12cc7840e [term 23 LEADER]: Becoming Leader. State: Replica: 0473d2b2d01f4459b1e90fd12cc7840e, State: Running, Role: LEADER
I20260709 13:07:27.494886 26742 raft_consensus.cc:697] T ef32ce6fdd0e40d382c79974f30295c6 P 0473d2b2d01f4459b1e90fd12cc7840e [term 24 LEADER]: Becoming Leader. State: Replica: 0473d2b2d01f4459b1e90fd12cc7840e, State: Running, Role: LEADER
I20260709 13:07:27.495664 26742 consensus_queue.cc:237] T ef32ce6fdd0e40d382c79974f30295c6 P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 23.13, Last appended by leader: 13, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:07:27.463681 26617 raft_consensus.cc:697] T a08760e15aac4630a629431f56024dc8 P e61c3a8f61bb48f8a963c9480e53c168 [term 24 LEADER]: Becoming Leader. State: Replica: e61c3a8f61bb48f8a963c9480e53c168, State: Running, Role: LEADER
I20260709 13:07:27.496946 19308 catalog_manager.cc:5697] T 0e1085d23e8347fbbd5bce7542f4b1f4 P 0473d2b2d01f4459b1e90fd12cc7840e reported cstate change: term changed from 16 to 18, leader changed from 127766fc592545a4997f7790f50f6076 (127.17.223.4) to 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2). New cstate: current_term: 18 leader_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:07:27.499485 26617 consensus_queue.cc:237] T a08760e15aac4630a629431f56024dc8 P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 23.13, Last appended by leader: 13, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:07:27.494043 26577 consensus_queue.cc:237] T 179fd671030940b4b4a4e24bcc4aba0a P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 22.14, Last appended by leader: 14, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:07:27.510905 19308 catalog_manager.cc:5697] T 6c5eebf646ad445a9d1b1adc319d7b16 P 0473d2b2d01f4459b1e90fd12cc7840e reported cstate change: term changed from 18 to 20, leader changed from 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2) to e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3). New cstate: current_term: 20 leader_uuid: "e61c3a8f61bb48f8a963c9480e53c168" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } } }
I20260709 13:07:27.520255 19308 catalog_manager.cc:5697] T 0afb57ae58a24a01850491d69f0213dd P 0473d2b2d01f4459b1e90fd12cc7840e reported cstate change: term changed from 12 to 13, leader changed from 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2) to e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3). New cstate: current_term: 13 leader_uuid: "e61c3a8f61bb48f8a963c9480e53c168" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } } }
I20260709 13:07:27.522017 19308 catalog_manager.cc:5697] T 1efebf73c86e432baa55533136b6e12c P 0473d2b2d01f4459b1e90fd12cc7840e reported cstate change: term changed from 14 to 18, leader changed from 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2) to 127766fc592545a4997f7790f50f6076 (127.17.223.4). New cstate: current_term: 18 leader_uuid: "127766fc592545a4997f7790f50f6076" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } } }
I20260709 13:07:27.537724 19302 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:44698 (request call id 236) took 7060 ms. Trace:
I20260709 13:07:27.541707 19551 consensus_queue.cc:237] T df751f992649444090e27965eb1af85d P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 25.16, Last appended by leader: 15, Current term: 25, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 17 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } attrs { replace: true } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: NON_VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: true } }
I20260709 13:07:27.570621 19478 raft_consensus.cc:1275] T df751f992649444090e27965eb1af85d P 0473d2b2d01f4459b1e90fd12cc7840e [term 25 FOLLOWER]: Refusing update from remote peer e61c3a8f61bb48f8a963c9480e53c168: Log matching property violated. Preceding OpId in replica: term: 25 index: 16. Preceding OpId from leader: term: 25 index: 17. (index mismatch)
I20260709 13:07:27.572240 26741 consensus_queue.cc:1048] T df751f992649444090e27965eb1af85d P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.000s
I20260709 13:07:27.576310 19405 raft_consensus.cc:1275] T df751f992649444090e27965eb1af85d P e5256d91808b47c195bc9b4dbd7f2b87 [term 25 FOLLOWER]: Refusing update from remote peer e61c3a8f61bb48f8a963c9480e53c168: Log matching property violated. Preceding OpId in replica: term: 25 index: 16. Preceding OpId from leader: term: 25 index: 17. (index mismatch)
I20260709 13:07:27.577744 26749 consensus_queue.cc:1048] T df751f992649444090e27965eb1af85d P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.000s
I20260709 13:07:27.589335 20110 raft_consensus.cc:3060] T df751f992649444090e27965eb1af85d P 127766fc592545a4997f7790f50f6076 [term 2 LEARNER]: Advancing to term 25
I20260709 13:07:27.596894 20110 raft_consensus.cc:1275] T df751f992649444090e27965eb1af85d P 127766fc592545a4997f7790f50f6076 [term 25 LEARNER]: Refusing update from remote peer e61c3a8f61bb48f8a963c9480e53c168: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 25 index: 17. (index mismatch)
I20260709 13:07:27.620507 26763 consensus_queue.cc:1048] T df751f992649444090e27965eb1af85d P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Connected to new peer: Peer: permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: NON_VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:07:27.601192 26741 raft_consensus.cc:2955] T df751f992649444090e27965eb1af85d P e61c3a8f61bb48f8a963c9480e53c168 [term 25 LEADER]: Committing config change with OpId 25.17: config changed from index -1 to 17, NON_VOTER 127766fc592545a4997f7790f50f6076 (127.17.223.4) added. New config: { opid_index: 17 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } attrs { replace: true } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: NON_VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: true } } }
I20260709 13:07:27.607273 19483 raft_consensus.cc:2955] T df751f992649444090e27965eb1af85d P 0473d2b2d01f4459b1e90fd12cc7840e [term 25 FOLLOWER]: Committing config change with OpId 25.17: config changed from index -1 to 17, NON_VOTER 127766fc592545a4997f7790f50f6076 (127.17.223.4) added. New config: { opid_index: 17 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } attrs { replace: true } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: NON_VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: true } } }
I20260709 13:07:27.632369 19553 raft_consensus.cc:1275] T 2e36a9d6e29c4a7c860cf267efbd4c74 P e61c3a8f61bb48f8a963c9480e53c168 [term 16 FOLLOWER]: Refusing update from remote peer 0473d2b2d01f4459b1e90fd12cc7840e: Log matching property violated. Preceding OpId in replica: term: 15 index: 8. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
I20260709 13:07:27.634541 26765 consensus_queue.cc:1048] T 2e36a9d6e29c4a7c860cf267efbd4c74 P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:07:27.538239 19302 rpcz_store.cc:276] 0709 13:07:20.477415 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:20.477668 (+   253us) service_pool.cc:224] Handling call
0709 13:07:27.537650 (+7059982us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:07:27.351831 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:07:27.352422 (+   591us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:07:27.352479 (+    57us) write_op.cc:435] Acquired schema lock
0709 13:07:27.352501 (+    22us) tablet.cc:662] Decoding operations
0709 13:07:27.352884 (+   383us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:07:27.352948 (+    64us) write_op.cc:641] Partition lock acquired for write op
0709 13:07:27.352986 (+    38us) tablet.cc:685] Acquiring locks for 1 operations
0709 13:07:27.353144 (+   158us) tablet.cc:701] Row locks acquired
0709 13:07:27.353161 (+    17us) write_op.cc:260] PREPARE: finished
0709 13:07:27.353298 (+   137us) write_op.cc:270] Start()
0709 13:07:27.353419 (+   121us) write_op.cc:276] Timestamp: P: 1783602447353256 usec, L: 0
0709 13:07:27.353442 (+    23us) op_driver.cc:348] REPLICATION: starting
0709 13:07:27.354056 (+   614us) log.cc:844] Serialized 533 byte log entry
0709 13:07:27.355986 (+  1930us) op_driver.cc:464] REPLICATION: finished
0709 13:07:27.356408 (+   422us) write_op.cc:301] APPLY: starting
0709 13:07:27.356483 (+    75us) tablet.cc:1367] starting BulkCheckPresence
0709 13:07:27.357299 (+   816us) tablet.cc:1370] finished BulkCheckPresence
0709 13:07:27.357413 (+   114us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:07:27.358084 (+   671us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:07:27.358268 (+   184us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=2,key_file_lookups=2,delta_file_lookups=2,mrs_lookups=0
0709 13:07:27.358319 (+    51us) write_op.cc:312] APPLY: finished
0709 13:07:27.358505 (+   186us) log.cc:844] Serialized 25 byte log entry
0709 13:07:27.358663 (+   158us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:07:27.360780 (+  2117us) write_op.cc:454] Released schema lock
0709 13:07:27.360820 (+    40us) write_op.cc:341] FINISH: Updating metrics
0709 13:07:27.361110 (+   290us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:07:27.361136 (+    26us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":84309,"reported_tablets":51,"child_traces":[["op",{"apply.queue_time_us":228,"apply.run_cpu_time_us":2667,"apply.run_wall_time_us":4671,"cfile_cache_hit":4,"cfile_cache_hit_bytes":4180,"num_ops":1,"prepare.queue_time_us":46792,"prepare.run_cpu_time_us":2505,"prepare.run_wall_time_us":2505,"replication_time_us":2428}]]}
I20260709 13:07:27.639982 19306 catalog_manager.cc:5697] T 7be9efa6559648dbb5a0f7684c4542d1 P 127766fc592545a4997f7790f50f6076 reported cstate change: config changed from index 6 to 14, VOTER e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1) evicted. New cstate: current_term: 22 leader_uuid: "e61c3a8f61bb48f8a963c9480e53c168" committed_config { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } } }
I20260709 13:07:27.651808 26763 consensus_queue.cc:1243] T df751f992649444090e27965eb1af85d P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Peer 127766fc592545a4997f7790f50f6076 log is divergent from this leader: its last log entry 1.2 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 1
I20260709 13:07:27.674849 19551 consensus_queue.cc:237] T 28af091831594f9d8e96482078cc7625 P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 19.11, Last appended by leader: 10, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } attrs { replace: true } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: NON_VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: true } }
I20260709 13:07:27.689841 19401 tablet_service.cc:1558] Processing DeleteTablet for tablet 7be9efa6559648dbb5a0f7684c4542d1 with delete_type TABLET_DATA_TOMBSTONED (TS e5256d91808b47c195bc9b4dbd7f2b87 not found in new config with opid_index 14) from {username='slave'} at 127.0.0.1:41524
I20260709 13:07:27.704550 19308 catalog_manager.cc:5697] T ef32ce6fdd0e40d382c79974f30295c6 P 0473d2b2d01f4459b1e90fd12cc7840e reported cstate change: term changed from 23 to 24, leader changed from e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1) to 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2). New cstate: current_term: 24 leader_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:27.706375 19308 catalog_manager.cc:5697] T 179fd671030940b4b4a4e24bcc4aba0a P 0473d2b2d01f4459b1e90fd12cc7840e reported cstate change: term changed from 22 to 23, leader changed from e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1) to 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2). New cstate: current_term: 23 leader_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:27.708015 19308 catalog_manager.cc:5697] T df751f992649444090e27965eb1af85d P 0473d2b2d01f4459b1e90fd12cc7840e reported cstate change: config changed from index -1 to 17, NON_VOTER 127766fc592545a4997f7790f50f6076 (127.17.223.4) added. New cstate: current_term: 25 leader_uuid: "e61c3a8f61bb48f8a963c9480e53c168" committed_config { opid_index: 17 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } attrs { replace: true } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: NON_VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: true } } }
I20260709 13:07:27.710711 19405 raft_consensus.cc:1275] T 2e36a9d6e29c4a7c860cf267efbd4c74 P e5256d91808b47c195bc9b4dbd7f2b87 [term 16 FOLLOWER]: Refusing update from remote peer 0473d2b2d01f4459b1e90fd12cc7840e: Log matching property violated. Preceding OpId in replica: term: 15 index: 8. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
W20260709 13:07:27.715898 19523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.4:43121, user_credentials={real_user=slave}} blocked reactor thread for 45549.7us
I20260709 13:07:27.719385 19402 raft_consensus.cc:2955] T df751f992649444090e27965eb1af85d P e5256d91808b47c195bc9b4dbd7f2b87 [term 25 FOLLOWER]: Committing config change with OpId 25.17: config changed from index -1 to 17, NON_VOTER 127766fc592545a4997f7790f50f6076 (127.17.223.4) added. New config: { opid_index: 17 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } attrs { replace: true } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: NON_VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: true } } }
I20260709 13:07:27.732466 26577 consensus_queue.cc:1048] T 2e36a9d6e29c4a7c860cf267efbd4c74 P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:07:27.786414 19483 raft_consensus.cc:1275] T 28af091831594f9d8e96482078cc7625 P 0473d2b2d01f4459b1e90fd12cc7840e [term 19 FOLLOWER]: Refusing update from remote peer e61c3a8f61bb48f8a963c9480e53c168: Log matching property violated. Preceding OpId in replica: term: 19 index: 11. Preceding OpId from leader: term: 19 index: 12. (index mismatch)
I20260709 13:07:27.802619 26790 consensus_queue.cc:1048] T 28af091831594f9d8e96482078cc7625 P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
W20260709 13:07:27.809508 19523 consensus_peers.cc:597] T 28af091831594f9d8e96482078cc7625 P e61c3a8f61bb48f8a963c9480e53c168 -> Peer 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121): Couldn't send request to peer 127766fc592545a4997f7790f50f6076. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 28af091831594f9d8e96482078cc7625. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:07:27.811705 19402 raft_consensus.cc:1275] T 28af091831594f9d8e96482078cc7625 P e5256d91808b47c195bc9b4dbd7f2b87 [term 19 FOLLOWER]: Refusing update from remote peer e61c3a8f61bb48f8a963c9480e53c168: Log matching property violated. Preceding OpId in replica: term: 19 index: 11. Preceding OpId from leader: term: 19 index: 12. (index mismatch)
I20260709 13:07:27.844156 26795 tablet_replica.cc:333] T 7be9efa6559648dbb5a0f7684c4542d1 P e5256d91808b47c195bc9b4dbd7f2b87: stopping tablet replica
I20260709 13:07:27.880478 26795 raft_consensus.cc:2243] T 7be9efa6559648dbb5a0f7684c4542d1 P e5256d91808b47c195bc9b4dbd7f2b87 [term 22 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:27.896274 26795 raft_consensus.cc:2272] T 7be9efa6559648dbb5a0f7684c4542d1 P e5256d91808b47c195bc9b4dbd7f2b87 [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:27.842819 26790 consensus_queue.cc:1048] T 28af091831594f9d8e96482078cc7625 P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.046s
I20260709 13:07:27.899487 26795 ts_tablet_manager.cc:1916] T 7be9efa6559648dbb5a0f7684c4542d1 P e5256d91808b47c195bc9b4dbd7f2b87: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:07:27.929431 19405 raft_consensus.cc:1275] T a08760e15aac4630a629431f56024dc8 P e5256d91808b47c195bc9b4dbd7f2b87 [term 24 FOLLOWER]: Refusing update from remote peer e61c3a8f61bb48f8a963c9480e53c168: Log matching property violated. Preceding OpId in replica: term: 23 index: 13. Preceding OpId from leader: term: 24 index: 14. (index mismatch)
I20260709 13:07:27.932199 26794 consensus_queue.cc:1048] T a08760e15aac4630a629431f56024dc8 P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:07:28.047484 18300 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:07:28.063153 20110 pending_rounds.cc:85] T df751f992649444090e27965eb1af85d P 127766fc592545a4997f7790f50f6076: Aborting all ops after (but not including) 1
I20260709 13:07:28.063566 20110 pending_rounds.cc:107] T df751f992649444090e27965eb1af85d P 127766fc592545a4997f7790f50f6076: Aborting uncommitted CHANGE_CONFIG_OP operation due to leader change: 1.2
I20260709 13:07:28.063841 20110 raft_consensus.cc:2917] T df751f992649444090e27965eb1af85d P 127766fc592545a4997f7790f50f6076 [term 25 LEARNER]: Aborting config change with OpId 1.2: Aborted: Op aborted by new leader
I20260709 13:07:28.064237 20110 raft_consensus.cc:2889] T df751f992649444090e27965eb1af85d P 127766fc592545a4997f7790f50f6076 [term 25 NON_PARTICIPANT]: CHANGE_CONFIG_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:07:28.111404 19478 raft_consensus.cc:1275] T a08760e15aac4630a629431f56024dc8 P 0473d2b2d01f4459b1e90fd12cc7840e [term 24 FOLLOWER]: Refusing update from remote peer e61c3a8f61bb48f8a963c9480e53c168: Log matching property violated. Preceding OpId in replica: term: 23 index: 13. Preceding OpId from leader: term: 24 index: 14. (index mismatch)
I20260709 13:07:28.085366 26749 raft_consensus.cc:2955] T 28af091831594f9d8e96482078cc7625 P e61c3a8f61bb48f8a963c9480e53c168 [term 19 LEADER]: Committing config change with OpId 19.12: config changed from index -1 to 12, NON_VOTER 127766fc592545a4997f7790f50f6076 (127.17.223.4) added. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } attrs { replace: true } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: NON_VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: true } } }
I20260709 13:07:28.114037 26789 consensus_queue.cc:1048] T a08760e15aac4630a629431f56024dc8 P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
W20260709 13:07:28.140514 20075 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.1:40321, user_credentials={real_user=slave}} blocked reactor thread for 58884.8us
W20260709 13:07:28.145455 19450 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.3:36891, user_credentials={real_user=slave}} blocked reactor thread for 93152.3us
I20260709 13:07:28.150391 19553 raft_consensus.cc:1275] T ef32ce6fdd0e40d382c79974f30295c6 P e61c3a8f61bb48f8a963c9480e53c168 [term 24 FOLLOWER]: Refusing update from remote peer 0473d2b2d01f4459b1e90fd12cc7840e: Log matching property violated. Preceding OpId in replica: term: 23 index: 13. Preceding OpId from leader: term: 24 index: 14. (index mismatch)
I20260709 13:07:28.188047 19411 raft_consensus.cc:1275] T 179fd671030940b4b4a4e24bcc4aba0a P e5256d91808b47c195bc9b4dbd7f2b87 [term 23 FOLLOWER]: Refusing update from remote peer 0473d2b2d01f4459b1e90fd12cc7840e: Log matching property violated. Preceding OpId in replica: term: 22 index: 14. Preceding OpId from leader: term: 23 index: 15. (index mismatch)
I20260709 13:07:28.212823 19483 raft_consensus.cc:2955] T 28af091831594f9d8e96482078cc7625 P 0473d2b2d01f4459b1e90fd12cc7840e [term 19 FOLLOWER]: Committing config change with OpId 19.12: config changed from index -1 to 12, NON_VOTER 127766fc592545a4997f7790f50f6076 (127.17.223.4) added. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } attrs { replace: true } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: NON_VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: true } } }
W20260709 13:07:28.268356 26811 log.cc:927] Time spent T df751f992649444090e27965eb1af85d P 127766fc592545a4997f7790f50f6076: Append to log took a long time: real 0.094s	user 0.001s	sys 0.000s
I20260709 13:07:28.268594 26801 consensus_queue.cc:1048] T 179fd671030940b4b4a4e24bcc4aba0a P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 13:07:28.276389 26742 consensus_queue.cc:1048] T ef32ce6fdd0e40d382c79974f30295c6 P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:07:28.278152 19553 raft_consensus.cc:1275] T 179fd671030940b4b4a4e24bcc4aba0a P e61c3a8f61bb48f8a963c9480e53c168 [term 23 FOLLOWER]: Refusing update from remote peer 0473d2b2d01f4459b1e90fd12cc7840e: Log matching property violated. Preceding OpId in replica: term: 22 index: 14. Preceding OpId from leader: term: 23 index: 15. (index mismatch)
W20260709 13:07:28.317596 19375 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.3:36891, user_credentials={real_user=slave}} blocked reactor thread for 124760us
W20260709 13:07:28.326773 19523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.1:40321, user_credentials={real_user=slave}} blocked reactor thread for 99114.1us
I20260709 13:07:28.413026 26829 ts_tablet_manager.cc:933] T 28af091831594f9d8e96482078cc7625 P 127766fc592545a4997f7790f50f6076: Initiating tablet copy from peer e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:07:28.315140 26812 consensus_queue.cc:1048] T 179fd671030940b4b4a4e24bcc4aba0a P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.085s
W20260709 13:07:28.439389 20078 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.2:46257, user_credentials={real_user=slave}} blocked reactor thread for 159865us
I20260709 13:07:28.441798 19402 raft_consensus.cc:1275] T ef32ce6fdd0e40d382c79974f30295c6 P e5256d91808b47c195bc9b4dbd7f2b87 [term 24 FOLLOWER]: Refusing update from remote peer 0473d2b2d01f4459b1e90fd12cc7840e: Log matching property violated. Preceding OpId in replica: term: 23 index: 13. Preceding OpId from leader: term: 24 index: 14. (index mismatch)
I20260709 13:07:28.471071 26795 ts_tablet_manager.cc:1929] T 7be9efa6559648dbb5a0f7684c4542d1 P e5256d91808b47c195bc9b4dbd7f2b87: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 22.13
I20260709 13:07:28.471556 26795 log.cc:1199] T 7be9efa6559648dbb5a0f7684c4542d1 P e5256d91808b47c195bc9b4dbd7f2b87: Deleting WAL directory at /tmp/dist-test-taskKd2k48/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602220613947-18300-0/minicluster-data/ts-0-root/wals/7be9efa6559648dbb5a0f7684c4542d1
I20260709 13:07:28.473188 19308 catalog_manager.cc:5697] T a08760e15aac4630a629431f56024dc8 P 0473d2b2d01f4459b1e90fd12cc7840e reported cstate change: term changed from 23 to 24, leader changed from e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1) to e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3). New cstate: current_term: 24 leader_uuid: "e61c3a8f61bb48f8a963c9480e53c168" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } }
I20260709 13:07:28.490994 19293 catalog_manager.cc:5028] TS e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321): tablet 7be9efa6559648dbb5a0f7684c4542d1 (table test-workload [id=ce1025c73cf04c4baf25820ae7ff0a53]) successfully deleted
W20260709 13:07:28.521704 19526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.2:46257, user_credentials={real_user=slave}} blocked reactor thread for 237631us
W20260709 13:07:28.567907 20078 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.2:46257, user_credentials={real_user=slave}} blocked reactor thread for 52069.1us
W20260709 13:07:28.597937 19449 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.1:40321, user_credentials={real_user=slave}} blocked reactor thread for 45941.2us
I20260709 13:07:28.624475 26839 consensus_queue.cc:1048] T ef32ce6fdd0e40d382c79974f30295c6 P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:07:28.609894 20110 raft_consensus.cc:2955] T df751f992649444090e27965eb1af85d P 127766fc592545a4997f7790f50f6076 [term 25 LEARNER]: Committing config change with OpId 25.17: config changed from index -1 to 17, NON_VOTER 127766fc592545a4997f7790f50f6076 (127.17.223.4) added. New config: { opid_index: 17 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } attrs { replace: true } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: NON_VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: true } } }
I20260709 13:07:28.639022 26829 tablet_copy_client.cc:323] T 28af091831594f9d8e96482078cc7625 P 127766fc592545a4997f7790f50f6076: tablet copy: Beginning tablet copy session from remote peer at address 127.17.223.3:36891
W20260709 13:07:28.699625 19523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.1:40321, user_credentials={real_user=slave}} blocked reactor thread for 371908us
W20260709 13:07:28.713903 26825 log.cc:927] Time spent T a08760e15aac4630a629431f56024dc8 P 0473d2b2d01f4459b1e90fd12cc7840e: Append to log took a long time: real 0.294s	user 0.012s	sys 0.000s
I20260709 13:07:28.728741 19402 raft_consensus.cc:2955] T 28af091831594f9d8e96482078cc7625 P e5256d91808b47c195bc9b4dbd7f2b87 [term 19 FOLLOWER]: Committing config change with OpId 19.12: config changed from index -1 to 12, NON_VOTER 127766fc592545a4997f7790f50f6076 (127.17.223.4) added. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } attrs { replace: true } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: NON_VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: true } } }
W20260709 13:07:28.736562 19449 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.4:43121, user_credentials={real_user=slave}} blocked reactor thread for 78669.2us
W20260709 13:07:28.823465 26806 log.cc:927] Time spent T a08760e15aac4630a629431f56024dc8 P e5256d91808b47c195bc9b4dbd7f2b87: Append to log took a long time: real 0.054s	user 0.000s	sys 0.001s
I20260709 13:07:28.828634 19570 tablet_copy_service.cc:140] P e61c3a8f61bb48f8a963c9480e53c168: Received BeginTabletCopySession request for tablet 28af091831594f9d8e96482078cc7625 from peer 127766fc592545a4997f7790f50f6076 ({username='slave'} at 127.0.0.1:41504)
I20260709 13:07:28.829305 19570 tablet_copy_service.cc:161] P e61c3a8f61bb48f8a963c9480e53c168: Beginning new tablet copy session on tablet 28af091831594f9d8e96482078cc7625 from peer 127766fc592545a4997f7790f50f6076 at {username='slave'} at 127.0.0.1:41504: session id = 127766fc592545a4997f7790f50f6076-28af091831594f9d8e96482078cc7625
I20260709 13:07:28.858336 19570 tablet_copy_source_session.cc:215] T 28af091831594f9d8e96482078cc7625 P e61c3a8f61bb48f8a963c9480e53c168: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:07:28.954000 26829 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 28af091831594f9d8e96482078cc7625. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:29.093115 26791 raft_consensus.cc:1064] T df751f992649444090e27965eb1af85d P e61c3a8f61bb48f8a963c9480e53c168: attempting to promote NON_VOTER 127766fc592545a4997f7790f50f6076 to VOTER
I20260709 13:07:29.095594 19478 consensus_queue.cc:237] T 21e14947d70440f19044d8f75c31e1f9 P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 22.14, Last appended by leader: 13, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } attrs { replace: true } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: NON_VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: true } }
I20260709 13:07:29.095606 26791 consensus_queue.cc:237] T df751f992649444090e27965eb1af85d P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 25.17, Last appended by leader: 15, Current term: 25, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 18 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } attrs { replace: true } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:07:29.104410 19302 catalog_manager.cc:5697] T 28af091831594f9d8e96482078cc7625 P 0473d2b2d01f4459b1e90fd12cc7840e reported cstate change: config changed from index -1 to 12, NON_VOTER 127766fc592545a4997f7790f50f6076 (127.17.223.4) added. New cstate: current_term: 19 leader_uuid: "e61c3a8f61bb48f8a963c9480e53c168" committed_config { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } attrs { replace: true } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: NON_VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: true } } }
I20260709 13:07:29.113168 18300 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:07:29.148442 26829 tablet_copy_client.cc:806] T 28af091831594f9d8e96482078cc7625 P 127766fc592545a4997f7790f50f6076: tablet copy: Starting download of 0 data blocks...
I20260709 13:07:29.149117 26829 tablet_copy_client.cc:670] T 28af091831594f9d8e96482078cc7625 P 127766fc592545a4997f7790f50f6076: tablet copy: Starting download of 1 WAL segments...
I20260709 13:07:29.172223 26829 tablet_copy_client.cc:538] T 28af091831594f9d8e96482078cc7625 P 127766fc592545a4997f7790f50f6076: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:07:29.184626 19553 raft_consensus.cc:1275] T 21e14947d70440f19044d8f75c31e1f9 P e61c3a8f61bb48f8a963c9480e53c168 [term 22 FOLLOWER]: Refusing update from remote peer 0473d2b2d01f4459b1e90fd12cc7840e: Log matching property violated. Preceding OpId in replica: term: 22 index: 14. Preceding OpId from leader: term: 22 index: 15. (index mismatch)
I20260709 13:07:29.190608 26851 consensus_queue.cc:1048] T 21e14947d70440f19044d8f75c31e1f9 P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 13:07:29.197367 26829 tablet_bootstrap.cc:492] T 28af091831594f9d8e96482078cc7625 P 127766fc592545a4997f7790f50f6076: Bootstrap starting.
I20260709 13:07:29.199952 20110 raft_consensus.cc:1275] T df751f992649444090e27965eb1af85d P 127766fc592545a4997f7790f50f6076 [term 25 LEARNER]: Refusing update from remote peer e61c3a8f61bb48f8a963c9480e53c168: Log matching property violated. Preceding OpId in replica: term: 25 index: 17. Preceding OpId from leader: term: 25 index: 18. (index mismatch)
W20260709 13:07:29.256703 19523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.4:43121, user_credentials={real_user=slave}} blocked reactor thread for 54024.4us
I20260709 13:07:29.263230 19478 raft_consensus.cc:1275] T df751f992649444090e27965eb1af85d P 0473d2b2d01f4459b1e90fd12cc7840e [term 25 FOLLOWER]: Refusing update from remote peer e61c3a8f61bb48f8a963c9480e53c168: Log matching property violated. Preceding OpId in replica: term: 25 index: 17. Preceding OpId from leader: term: 25 index: 18. (index mismatch)
I20260709 13:07:29.263399 19406 raft_consensus.cc:1275] T df751f992649444090e27965eb1af85d P e5256d91808b47c195bc9b4dbd7f2b87 [term 25 FOLLOWER]: Refusing update from remote peer e61c3a8f61bb48f8a963c9480e53c168: Log matching property violated. Preceding OpId in replica: term: 25 index: 17. Preceding OpId from leader: term: 25 index: 18. (index mismatch)
I20260709 13:07:29.265203 19409 raft_consensus.cc:1275] T 21e14947d70440f19044d8f75c31e1f9 P e5256d91808b47c195bc9b4dbd7f2b87 [term 22 FOLLOWER]: Refusing update from remote peer 0473d2b2d01f4459b1e90fd12cc7840e: Log matching property violated. Preceding OpId in replica: term: 22 index: 14. Preceding OpId from leader: term: 22 index: 15. (index mismatch)
I20260709 13:07:29.283378 26836 consensus_queue.cc:1048] T df751f992649444090e27965eb1af85d P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Connected to new peer: Peer: permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.003s
I20260709 13:07:29.338501 26789 consensus_queue.cc:1048] T df751f992649444090e27965eb1af85d P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.004s
I20260709 13:07:29.353715 26841 consensus_queue.cc:1048] T df751f992649444090e27965eb1af85d P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.001s
I20260709 13:07:29.312055 26823 consensus_queue.cc:1048] T 21e14947d70440f19044d8f75c31e1f9 P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
W20260709 13:07:29.369510 19449 consensus_peers.cc:597] T 21e14947d70440f19044d8f75c31e1f9 P 0473d2b2d01f4459b1e90fd12cc7840e -> Peer 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121): Couldn't send request to peer 127766fc592545a4997f7790f50f6076. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 21e14947d70440f19044d8f75c31e1f9. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:07:29.485615 26849 raft_consensus.cc:2955] T 21e14947d70440f19044d8f75c31e1f9 P 0473d2b2d01f4459b1e90fd12cc7840e [term 22 LEADER]: Committing config change with OpId 22.15: config changed from index -1 to 15, NON_VOTER 127766fc592545a4997f7790f50f6076 (127.17.223.4) added. New config: { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } attrs { replace: true } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: NON_VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: true } } }
I20260709 13:07:29.508059 26790 raft_consensus.cc:2955] T df751f992649444090e27965eb1af85d P e61c3a8f61bb48f8a963c9480e53c168 [term 25 LEADER]: Committing config change with OpId 25.18: config changed from index 17 to 18, 127766fc592545a4997f7790f50f6076 (127.17.223.4) changed from NON_VOTER to VOTER. New config: { opid_index: 18 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } attrs { replace: true } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } } }
I20260709 13:07:29.511159 19551 raft_consensus.cc:2955] T 21e14947d70440f19044d8f75c31e1f9 P e61c3a8f61bb48f8a963c9480e53c168 [term 22 FOLLOWER]: Committing config change with OpId 22.15: config changed from index -1 to 15, NON_VOTER 127766fc592545a4997f7790f50f6076 (127.17.223.4) added. New config: { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } attrs { replace: true } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: NON_VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: true } } }
I20260709 13:07:29.554917 19405 raft_consensus.cc:2955] T df751f992649444090e27965eb1af85d P e5256d91808b47c195bc9b4dbd7f2b87 [term 25 FOLLOWER]: Committing config change with OpId 25.18: config changed from index 17 to 18, 127766fc592545a4997f7790f50f6076 (127.17.223.4) changed from NON_VOTER to VOTER. New config: { opid_index: 18 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } attrs { replace: true } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } } }
I20260709 13:07:29.609097 19479 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0cdf56e38bbc453d9438d359e5a69955"
dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
mode: GRACEFUL
new_leader_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
 from {username='slave'} at 127.0.0.1:48168
I20260709 13:07:29.609998 19479 raft_consensus.cc:606] T 0cdf56e38bbc453d9438d359e5a69955 P 0473d2b2d01f4459b1e90fd12cc7840e [term 21 LEADER]: Received request to transfer leadership to TS e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:07:29.614600 19479 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2e36a9d6e29c4a7c860cf267efbd4c74"
dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
mode: GRACEFUL
new_leader_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
 from {username='slave'} at 127.0.0.1:48168
I20260709 13:07:29.615242 19479 raft_consensus.cc:606] T 2e36a9d6e29c4a7c860cf267efbd4c74 P 0473d2b2d01f4459b1e90fd12cc7840e [term 16 LEADER]: Received request to transfer leadership to TS e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:07:29.618368 19479 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5ec1c4ce15e04c7e8c283a62179f2a64"
dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
mode: GRACEFUL
new_leader_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
 from {username='slave'} at 127.0.0.1:48168
I20260709 13:07:29.619088 19479 raft_consensus.cc:606] T 5ec1c4ce15e04c7e8c283a62179f2a64 P 0473d2b2d01f4459b1e90fd12cc7840e [term 15 LEADER]: Received request to transfer leadership to TS e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:07:29.621320 26577 raft_consensus.cc:993] T 2e36a9d6e29c4a7c860cf267efbd4c74 P 0473d2b2d01f4459b1e90fd12cc7840e: : Instructing follower e5256d91808b47c195bc9b4dbd7f2b87 to start an election
I20260709 13:07:29.621971 26577 raft_consensus.cc:1081] T 2e36a9d6e29c4a7c860cf267efbd4c74 P 0473d2b2d01f4459b1e90fd12cc7840e [term 16 LEADER]: Signalling peer e5256d91808b47c195bc9b4dbd7f2b87 to start an election
I20260709 13:07:29.630316 19479 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e381f1d6b8184797ad142de49be225a8"
dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
mode: GRACEFUL
new_leader_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
 from {username='slave'} at 127.0.0.1:48168
I20260709 13:07:29.630982 19479 raft_consensus.cc:606] T e381f1d6b8184797ad142de49be225a8 P 0473d2b2d01f4459b1e90fd12cc7840e [term 18 LEADER]: Received request to transfer leadership to TS e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:07:29.635792 19555 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "fa8650e71aa14778b3d73721fc50d9fc"
dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
mode: GRACEFUL
new_leader_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
 from {username='slave'} at 127.0.0.1:39264
I20260709 13:07:29.636412 19555 raft_consensus.cc:606] T fa8650e71aa14778b3d73721fc50d9fc P e61c3a8f61bb48f8a963c9480e53c168 [term 21 LEADER]: Received request to transfer leadership to TS 0473d2b2d01f4459b1e90fd12cc7840e
I20260709 13:07:29.639245 18300 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:07:29.641912 18300 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:07:29.654935 19406 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "2e36a9d6e29c4a7c860cf267efbd4c74"
dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
 from {username='slave'} at 127.0.0.1:52342
I20260709 13:07:29.655624 19406 raft_consensus.cc:493] T 2e36a9d6e29c4a7c860cf267efbd4c74 P e5256d91808b47c195bc9b4dbd7f2b87 [term 16 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:07:29.656002 19406 raft_consensus.cc:3060] T 2e36a9d6e29c4a7c860cf267efbd4c74 P e5256d91808b47c195bc9b4dbd7f2b87 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:07:29.665648 19406 raft_consensus.cc:515] T 2e36a9d6e29c4a7c860cf267efbd4c74 P e5256d91808b47c195bc9b4dbd7f2b87 [term 17 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:07:29.684016 26837 raft_consensus.cc:993] T fa8650e71aa14778b3d73721fc50d9fc P e61c3a8f61bb48f8a963c9480e53c168: : Instructing follower 0473d2b2d01f4459b1e90fd12cc7840e to start an election
I20260709 13:07:29.684695 26791 raft_consensus.cc:1081] T fa8650e71aa14778b3d73721fc50d9fc P e61c3a8f61bb48f8a963c9480e53c168 [term 21 LEADER]: Signalling peer 0473d2b2d01f4459b1e90fd12cc7840e to start an election
I20260709 13:07:29.688820 19411 raft_consensus.cc:2955] T 21e14947d70440f19044d8f75c31e1f9 P e5256d91808b47c195bc9b4dbd7f2b87 [term 22 FOLLOWER]: Committing config change with OpId 22.15: config changed from index -1 to 15, NON_VOTER 127766fc592545a4997f7790f50f6076 (127.17.223.4) added. New config: { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } attrs { replace: true } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: NON_VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: true } } }
I20260709 13:07:29.690380 19555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e36a9d6e29c4a7c860cf267efbd4c74" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: true dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:07:29.691444 19555 raft_consensus.cc:3060] T 2e36a9d6e29c4a7c860cf267efbd4c74 P e61c3a8f61bb48f8a963c9480e53c168 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:07:29.696221 19483 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "fa8650e71aa14778b3d73721fc50d9fc"
dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
 from {username='slave'} at 127.0.0.1:58286
I20260709 13:07:29.696751 19483 raft_consensus.cc:493] T fa8650e71aa14778b3d73721fc50d9fc P 0473d2b2d01f4459b1e90fd12cc7840e [term 21 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:07:29.697088 19483 raft_consensus.cc:3060] T fa8650e71aa14778b3d73721fc50d9fc P 0473d2b2d01f4459b1e90fd12cc7840e [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:07:29.699903 19555 raft_consensus.cc:2468] T 2e36a9d6e29c4a7c860cf267efbd4c74 P e61c3a8f61bb48f8a963c9480e53c168 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 17.
I20260709 13:07:29.701149 19375 leader_election.cc:304] T 2e36a9d6e29c4a7c860cf267efbd4c74 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:07:29.702103 26746 raft_consensus.cc:2804] T 2e36a9d6e29c4a7c860cf267efbd4c74 P e5256d91808b47c195bc9b4dbd7f2b87 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:07:29.702620 26746 raft_consensus.cc:697] T 2e36a9d6e29c4a7c860cf267efbd4c74 P e5256d91808b47c195bc9b4dbd7f2b87 [term 17 LEADER]: Becoming Leader. State: Replica: e5256d91808b47c195bc9b4dbd7f2b87, State: Running, Role: LEADER
I20260709 13:07:29.703613 26746 consensus_queue.cc:237] T 2e36a9d6e29c4a7c860cf267efbd4c74 P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.9, Last appended by leader: 9, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:07:29.689814 19406 leader_election.cc:290] T 2e36a9d6e29c4a7c860cf267efbd4c74 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 17 election: Requested vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:07:29.713989 19483 raft_consensus.cc:515] T fa8650e71aa14778b3d73721fc50d9fc P 0473d2b2d01f4459b1e90fd12cc7840e [term 22 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:07:29.724076 19410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa8650e71aa14778b3d73721fc50d9fc" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: true dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
I20260709 13:07:29.724686 19410 raft_consensus.cc:3060] T fa8650e71aa14778b3d73721fc50d9fc P e5256d91808b47c195bc9b4dbd7f2b87 [term 21 FOLLOWER]: Advancing to term 22
W20260709 13:07:29.731904 19450 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.3:36891, user_credentials={real_user=slave}} blocked reactor thread for 53124.8us
I20260709 13:07:29.736714 20103 raft_consensus.cc:2955] T df751f992649444090e27965eb1af85d P 127766fc592545a4997f7790f50f6076 [term 25 FOLLOWER]: Committing config change with OpId 25.18: config changed from index 17 to 18, 127766fc592545a4997f7790f50f6076 (127.17.223.4) changed from NON_VOTER to VOTER. New config: { opid_index: 18 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } attrs { replace: true } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } } }
I20260709 13:07:29.757725 19305 catalog_manager.cc:5697] T df751f992649444090e27965eb1af85d P 127766fc592545a4997f7790f50f6076 reported cstate change: config changed from index 17 to 18, 127766fc592545a4997f7790f50f6076 (127.17.223.4) changed from NON_VOTER to VOTER. New cstate: current_term: 25 leader_uuid: "e61c3a8f61bb48f8a963c9480e53c168" committed_config { opid_index: 18 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } attrs { replace: true } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } } }
I20260709 13:07:29.763765 19410 raft_consensus.cc:2468] T fa8650e71aa14778b3d73721fc50d9fc P e5256d91808b47c195bc9b4dbd7f2b87 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 22.
I20260709 13:07:29.780385 19306 catalog_manager.cc:5697] T 21e14947d70440f19044d8f75c31e1f9 P 0473d2b2d01f4459b1e90fd12cc7840e reported cstate change: config changed from index -1 to 15, NON_VOTER 127766fc592545a4997f7790f50f6076 (127.17.223.4) added. New cstate: current_term: 22 leader_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" committed_config { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: NON_VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
W20260709 13:07:29.782074 19450 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.3:36891, user_credentials={real_user=slave}} blocked reactor thread for 48229.6us
I20260709 13:07:29.809049 19449 leader_election.cc:304] T fa8650e71aa14778b3d73721fc50d9fc P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87; no voters: 
I20260709 13:07:29.810174 26829 tablet_bootstrap.cc:492] T 28af091831594f9d8e96482078cc7625 P 127766fc592545a4997f7790f50f6076: Bootstrap replayed 1/1 log segments. Stats: ops{read=14 overwritten=2 applied=12 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:07:29.804253 19551 consensus_queue.cc:237] T 76cb037fc9064d13b59a8969d897ce8c P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 22.12, Last appended by leader: 11, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } attrs { replace: true } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: NON_VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: true } }
I20260709 13:07:29.819550 19483 leader_election.cc:290] T fa8650e71aa14778b3d73721fc50d9fc P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 22 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:07:29.818811 26829 tablet_bootstrap.cc:492] T 28af091831594f9d8e96482078cc7625 P 127766fc592545a4997f7790f50f6076: Bootstrap complete.
I20260709 13:07:29.812572 26577 raft_consensus.cc:2804] T fa8650e71aa14778b3d73721fc50d9fc P 0473d2b2d01f4459b1e90fd12cc7840e [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:07:29.829170 19479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e36a9d6e29c4a7c860cf267efbd4c74" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: true dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:07:29.837602 19479 raft_consensus.cc:3055] T 2e36a9d6e29c4a7c860cf267efbd4c74 P 0473d2b2d01f4459b1e90fd12cc7840e [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:07:29.837911 19479 raft_consensus.cc:740] T 2e36a9d6e29c4a7c860cf267efbd4c74 P 0473d2b2d01f4459b1e90fd12cc7840e [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 0473d2b2d01f4459b1e90fd12cc7840e, State: Running, Role: LEADER
I20260709 13:07:29.835732 26577 raft_consensus.cc:697] T fa8650e71aa14778b3d73721fc50d9fc P 0473d2b2d01f4459b1e90fd12cc7840e [term 22 LEADER]: Becoming Leader. State: Replica: 0473d2b2d01f4459b1e90fd12cc7840e, State: Running, Role: LEADER
I20260709 13:07:29.829713 19486 raft_consensus.cc:2955] T df751f992649444090e27965eb1af85d P 0473d2b2d01f4459b1e90fd12cc7840e [term 25 FOLLOWER]: Committing config change with OpId 25.18: config changed from index 17 to 18, 127766fc592545a4997f7790f50f6076 (127.17.223.4) changed from NON_VOTER to VOTER. New config: { opid_index: 18 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } attrs { replace: true } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } } }
I20260709 13:07:29.843274 19479 consensus_queue.cc:260] T 2e36a9d6e29c4a7c860cf267efbd4c74 P 0473d2b2d01f4459b1e90fd12cc7840e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.9, Last appended by leader: 9, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:07:29.855304 19559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa8650e71aa14778b3d73721fc50d9fc" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: true dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:07:29.856019 19559 raft_consensus.cc:3055] T fa8650e71aa14778b3d73721fc50d9fc P e61c3a8f61bb48f8a963c9480e53c168 [term 21 LEADER]: Stepping down as leader of term 21
I20260709 13:07:29.856292 19559 raft_consensus.cc:740] T fa8650e71aa14778b3d73721fc50d9fc P e61c3a8f61bb48f8a963c9480e53c168 [term 21 LEADER]: Becoming Follower/Learner. State: Replica: e61c3a8f61bb48f8a963c9480e53c168, State: Running, Role: LEADER
I20260709 13:07:29.864051 26829 ts_tablet_manager.cc:1403] T 28af091831594f9d8e96482078cc7625 P 127766fc592545a4997f7790f50f6076: Time spent bootstrapping tablet: real 0.669s	user 0.044s	sys 0.012s
I20260709 13:07:29.867900 19559 consensus_queue.cc:260] T fa8650e71aa14778b3d73721fc50d9fc P e61c3a8f61bb48f8a963c9480e53c168 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 21.12, Last appended by leader: 12, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:07:29.889377 19559 raft_consensus.cc:3060] T fa8650e71aa14778b3d73721fc50d9fc P e61c3a8f61bb48f8a963c9480e53c168 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:07:29.894480 19405 raft_consensus.cc:1240] T 2e36a9d6e29c4a7c860cf267efbd4c74 P e5256d91808b47c195bc9b4dbd7f2b87 [term 17 LEADER]: Rejecting Update request from peer 0473d2b2d01f4459b1e90fd12cc7840e for earlier term 16. Current term is 17. Ops: []
I20260709 13:07:29.896569 26577 consensus_queue.cc:237] T fa8650e71aa14778b3d73721fc50d9fc P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 21.12, Last appended by leader: 12, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:07:29.922614 26829 raft_consensus.cc:359] T 28af091831594f9d8e96482078cc7625 P 127766fc592545a4997f7790f50f6076 [term 19 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } attrs { replace: true } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: NON_VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: true } }
I20260709 13:07:29.929586 26829 raft_consensus.cc:740] T 28af091831594f9d8e96482078cc7625 P 127766fc592545a4997f7790f50f6076 [term 19 LEARNER]: Becoming Follower/Learner. State: Replica: 127766fc592545a4997f7790f50f6076, State: Initialized, Role: LEARNER
I20260709 13:07:29.930380 26829 consensus_queue.cc:260] T 28af091831594f9d8e96482078cc7625 P 127766fc592545a4997f7790f50f6076 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 12, Last appended: 19.12, Last appended by leader: 12, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } attrs { replace: true } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: NON_VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: true } }
I20260709 13:07:29.933262 19479 raft_consensus.cc:3060] T 2e36a9d6e29c4a7c860cf267efbd4c74 P 0473d2b2d01f4459b1e90fd12cc7840e [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:07:29.944399 26818 raft_consensus.cc:993] T 0cdf56e38bbc453d9438d359e5a69955 P 0473d2b2d01f4459b1e90fd12cc7840e: : Instructing follower e5256d91808b47c195bc9b4dbd7f2b87 to start an election
I20260709 13:07:29.950727 26818 raft_consensus.cc:1081] T 0cdf56e38bbc453d9438d359e5a69955 P 0473d2b2d01f4459b1e90fd12cc7840e [term 21 LEADER]: Signalling peer e5256d91808b47c195bc9b4dbd7f2b87 to start an election
I20260709 13:07:29.955476 26829 ts_tablet_manager.cc:1434] T 28af091831594f9d8e96482078cc7625 P 127766fc592545a4997f7790f50f6076: Time spent starting tablet: real 0.068s	user 0.005s	sys 0.002s
I20260709 13:07:29.957664 19570 tablet_copy_service.cc:342] P e61c3a8f61bb48f8a963c9480e53c168: Request end of tablet copy session 127766fc592545a4997f7790f50f6076-28af091831594f9d8e96482078cc7625 received from {username='slave'} at 127.0.0.1:41504
I20260709 13:07:29.958164 19570 tablet_copy_service.cc:434] P e61c3a8f61bb48f8a963c9480e53c168: ending tablet copy session 127766fc592545a4997f7790f50f6076-28af091831594f9d8e96482078cc7625 on tablet 28af091831594f9d8e96482078cc7625 with peer 127766fc592545a4997f7790f50f6076
I20260709 13:07:29.962910 19410 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "0cdf56e38bbc453d9438d359e5a69955"
dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
 from {username='slave'} at 127.0.0.1:52342
I20260709 13:07:29.963482 19410 raft_consensus.cc:493] T 0cdf56e38bbc453d9438d359e5a69955 P e5256d91808b47c195bc9b4dbd7f2b87 [term 21 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:07:29.990710 19410 raft_consensus.cc:3060] T 0cdf56e38bbc453d9438d359e5a69955 P e5256d91808b47c195bc9b4dbd7f2b87 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:07:29.943513 19479 raft_consensus.cc:2468] T 2e36a9d6e29c4a7c860cf267efbd4c74 P 0473d2b2d01f4459b1e90fd12cc7840e [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 17.
I20260709 13:07:30.003041 19559 raft_consensus.cc:2468] T fa8650e71aa14778b3d73721fc50d9fc P e61c3a8f61bb48f8a963c9480e53c168 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 22.
I20260709 13:07:30.094776 19410 raft_consensus.cc:515] T 0cdf56e38bbc453d9438d359e5a69955 P e5256d91808b47c195bc9b4dbd7f2b87 [term 22 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:07:30.113641 26878 ts_tablet_manager.cc:933] T 21e14947d70440f19044d8f75c31e1f9 P 127766fc592545a4997f7790f50f6076: Initiating tablet copy from peer 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
W20260709 13:07:30.130646 19526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.2:46257, user_credentials={real_user=slave}} blocked reactor thread for 45415.2us
I20260709 13:07:30.133404 26851 raft_consensus.cc:993] T 5ec1c4ce15e04c7e8c283a62179f2a64 P 0473d2b2d01f4459b1e90fd12cc7840e: : Instructing follower e5256d91808b47c195bc9b4dbd7f2b87 to start an election
I20260709 13:07:30.133919 26851 raft_consensus.cc:1081] T 5ec1c4ce15e04c7e8c283a62179f2a64 P 0473d2b2d01f4459b1e90fd12cc7840e [term 15 LEADER]: Signalling peer e5256d91808b47c195bc9b4dbd7f2b87 to start an election
I20260709 13:07:30.148211 19479 raft_consensus.cc:1275] T 76cb037fc9064d13b59a8969d897ce8c P 0473d2b2d01f4459b1e90fd12cc7840e [term 22 FOLLOWER]: Refusing update from remote peer e61c3a8f61bb48f8a963c9480e53c168: Log matching property violated. Preceding OpId in replica: term: 22 index: 12. Preceding OpId from leader: term: 22 index: 13. (index mismatch)
I20260709 13:07:30.148645 19408 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "5ec1c4ce15e04c7e8c283a62179f2a64"
dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
 from {username='slave'} at 127.0.0.1:52342
I20260709 13:07:30.149241 19408 raft_consensus.cc:493] T 5ec1c4ce15e04c7e8c283a62179f2a64 P e5256d91808b47c195bc9b4dbd7f2b87 [term 15 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:07:30.149609 19408 raft_consensus.cc:3060] T 5ec1c4ce15e04c7e8c283a62179f2a64 P e5256d91808b47c195bc9b4dbd7f2b87 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:07:30.152845 26822 consensus_queue.cc:1048] T 76cb037fc9064d13b59a8969d897ce8c P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:07:30.155436 19406 raft_consensus.cc:1275] T 76cb037fc9064d13b59a8969d897ce8c P e5256d91808b47c195bc9b4dbd7f2b87 [term 22 FOLLOWER]: Refusing update from remote peer e61c3a8f61bb48f8a963c9480e53c168: Log matching property violated. Preceding OpId in replica: term: 22 index: 12. Preceding OpId from leader: term: 22 index: 13. (index mismatch)
I20260709 13:07:30.158084 19551 raft_consensus.cc:1275] T 2e36a9d6e29c4a7c860cf267efbd4c74 P e61c3a8f61bb48f8a963c9480e53c168 [term 17 FOLLOWER]: Refusing update from remote peer e5256d91808b47c195bc9b4dbd7f2b87: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
I20260709 13:07:30.157886 26822 consensus_queue.cc:1048] T 76cb037fc9064d13b59a8969d897ce8c P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:07:30.188781 19410 leader_election.cc:290] T 0cdf56e38bbc453d9438d359e5a69955 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 22 election: Requested vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:07:30.194380 19551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cdf56e38bbc453d9438d359e5a69955" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: true dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:07:30.195001 19551 raft_consensus.cc:3060] T 0cdf56e38bbc453d9438d359e5a69955 P e61c3a8f61bb48f8a963c9480e53c168 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:07:30.193065 19408 raft_consensus.cc:515] T 5ec1c4ce15e04c7e8c283a62179f2a64 P e5256d91808b47c195bc9b4dbd7f2b87 [term 16 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
W20260709 13:07:30.209270 19523 consensus_peers.cc:597] T 76cb037fc9064d13b59a8969d897ce8c P e61c3a8f61bb48f8a963c9480e53c168 -> Peer 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121): Couldn't send request to peer 127766fc592545a4997f7790f50f6076. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 76cb037fc9064d13b59a8969d897ce8c. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:07:30.211498 26878 tablet_copy_client.cc:323] T 21e14947d70440f19044d8f75c31e1f9 P 127766fc592545a4997f7790f50f6076: tablet copy: Beginning tablet copy session from remote peer at address 127.17.223.2:46257
I20260709 13:07:30.223048 19408 leader_election.cc:290] T 5ec1c4ce15e04c7e8c283a62179f2a64 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 16 election: Requested vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:07:30.204282 26599 consensus_queue.cc:1048] T 2e36a9d6e29c4a7c860cf267efbd4c74 P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.031s
I20260709 13:07:30.279016 20103 raft_consensus.cc:1217] T 28af091831594f9d8e96482078cc7625 P 127766fc592545a4997f7790f50f6076 [term 19 LEARNER]: Deduplicated request from leader. Original: 19.11->[19.12-19.12]   Dedup: 19.12->[]
I20260709 13:07:30.290972 19551 raft_consensus.cc:2468] T 0cdf56e38bbc453d9438d359e5a69955 P e61c3a8f61bb48f8a963c9480e53c168 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 22.
I20260709 13:07:30.292328 19375 leader_election.cc:304] T 0cdf56e38bbc453d9438d359e5a69955 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:07:30.316179 26880 raft_consensus.cc:2804] T 0cdf56e38bbc453d9438d359e5a69955 P e5256d91808b47c195bc9b4dbd7f2b87 [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:07:30.316754 26880 raft_consensus.cc:697] T 0cdf56e38bbc453d9438d359e5a69955 P e5256d91808b47c195bc9b4dbd7f2b87 [term 22 LEADER]: Becoming Leader. State: Replica: e5256d91808b47c195bc9b4dbd7f2b87, State: Running, Role: LEADER
I20260709 13:07:30.317744 26880 consensus_queue.cc:237] T 0cdf56e38bbc453d9438d359e5a69955 P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 21.14, Last appended by leader: 14, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:07:30.327576 20103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ec1c4ce15e04c7e8c283a62179f2a64" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: true dest_uuid: "127766fc592545a4997f7790f50f6076"
I20260709 13:07:30.328233 20103 raft_consensus.cc:3060] T 5ec1c4ce15e04c7e8c283a62179f2a64 P 127766fc592545a4997f7790f50f6076 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:07:30.343101 19302 catalog_manager.cc:5697] T 2e36a9d6e29c4a7c860cf267efbd4c74 P e5256d91808b47c195bc9b4dbd7f2b87 reported cstate change: term changed from 16 to 17, leader changed from 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2) to e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1). New cstate: current_term: 17 leader_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:30.392688 26841 raft_consensus.cc:2955] T 76cb037fc9064d13b59a8969d897ce8c P e61c3a8f61bb48f8a963c9480e53c168 [term 22 LEADER]: Committing config change with OpId 22.13: config changed from index -1 to 13, NON_VOTER 127766fc592545a4997f7790f50f6076 (127.17.223.4) added. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } attrs { replace: true } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: NON_VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: true } } }
I20260709 13:07:30.395990 26883 raft_consensus.cc:993] T e381f1d6b8184797ad142de49be225a8 P 0473d2b2d01f4459b1e90fd12cc7840e: : Instructing follower e5256d91808b47c195bc9b4dbd7f2b87 to start an election
I20260709 13:07:30.396574 26883 raft_consensus.cc:1081] T e381f1d6b8184797ad142de49be225a8 P 0473d2b2d01f4459b1e90fd12cc7840e [term 18 LEADER]: Signalling peer e5256d91808b47c195bc9b4dbd7f2b87 to start an election
I20260709 13:07:30.392714 19486 raft_consensus.cc:2955] T 76cb037fc9064d13b59a8969d897ce8c P 0473d2b2d01f4459b1e90fd12cc7840e [term 22 FOLLOWER]: Committing config change with OpId 22.13: config changed from index -1 to 13, NON_VOTER 127766fc592545a4997f7790f50f6076 (127.17.223.4) added. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } attrs { replace: true } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: NON_VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: true } } }
I20260709 13:07:30.412992 20103 raft_consensus.cc:2468] T 5ec1c4ce15e04c7e8c283a62179f2a64 P 127766fc592545a4997f7790f50f6076 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 16.
I20260709 13:07:30.403642 19306 catalog_manager.cc:5697] T fa8650e71aa14778b3d73721fc50d9fc P 0473d2b2d01f4459b1e90fd12cc7840e reported cstate change: term changed from 21 to 22, leader changed from e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3) to 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2). New cstate: current_term: 22 leader_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } health_report { overall_health: UNKNOWN } } }
W20260709 13:07:30.417279 19450 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.3:36891, user_credentials={real_user=slave}} blocked reactor thread for 193508us
I20260709 13:07:30.427800 19411 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e381f1d6b8184797ad142de49be225a8"
dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
 from {username='slave'} at 127.0.0.1:52342
I20260709 13:07:30.428449 19411 raft_consensus.cc:493] T e381f1d6b8184797ad142de49be225a8 P e5256d91808b47c195bc9b4dbd7f2b87 [term 18 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:07:30.428815 19411 raft_consensus.cc:3060] T e381f1d6b8184797ad142de49be225a8 P e5256d91808b47c195bc9b4dbd7f2b87 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:07:30.437687 19374 leader_election.cc:304] T 5ec1c4ce15e04c7e8c283a62179f2a64 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 127766fc592545a4997f7790f50f6076, e5256d91808b47c195bc9b4dbd7f2b87; no voters: 
I20260709 13:07:30.440969 26894 raft_consensus.cc:2804] T 5ec1c4ce15e04c7e8c283a62179f2a64 P e5256d91808b47c195bc9b4dbd7f2b87 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:07:30.441627 26894 raft_consensus.cc:697] T 5ec1c4ce15e04c7e8c283a62179f2a64 P e5256d91808b47c195bc9b4dbd7f2b87 [term 16 LEADER]: Becoming Leader. State: Replica: e5256d91808b47c195bc9b4dbd7f2b87, State: Running, Role: LEADER
I20260709 13:07:30.442608 26894 consensus_queue.cc:237] T 5ec1c4ce15e04c7e8c283a62179f2a64 P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 15.13, Last appended by leader: 13, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:07:30.479195 19496 tablet_copy_service.cc:140] P 0473d2b2d01f4459b1e90fd12cc7840e: Received BeginTabletCopySession request for tablet 21e14947d70440f19044d8f75c31e1f9 from peer 127766fc592545a4997f7790f50f6076 ({username='slave'} at 127.0.0.1:39478)
I20260709 13:07:30.479913 19496 tablet_copy_service.cc:161] P 0473d2b2d01f4459b1e90fd12cc7840e: Beginning new tablet copy session on tablet 21e14947d70440f19044d8f75c31e1f9 from peer 127766fc592545a4997f7790f50f6076 at {username='slave'} at 127.0.0.1:39478: session id = 127766fc592545a4997f7790f50f6076-21e14947d70440f19044d8f75c31e1f9
I20260709 13:07:30.481549 19411 raft_consensus.cc:515] T e381f1d6b8184797ad142de49be225a8 P e5256d91808b47c195bc9b4dbd7f2b87 [term 19 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:07:30.498198 19406 raft_consensus.cc:2955] T 76cb037fc9064d13b59a8969d897ce8c P e5256d91808b47c195bc9b4dbd7f2b87 [term 22 FOLLOWER]: Committing config change with OpId 22.13: config changed from index -1 to 13, NON_VOTER 127766fc592545a4997f7790f50f6076 (127.17.223.4) added. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } attrs { replace: true } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: NON_VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: true } } }
I20260709 13:07:30.505841 19496 tablet_copy_source_session.cc:215] T 21e14947d70440f19044d8f75c31e1f9 P 0473d2b2d01f4459b1e90fd12cc7840e: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:07:30.512970 19553 consensus_queue.cc:237] T df751f992649444090e27965eb1af85d P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 18, Committed index: 18, Last appended: 25.18, Last appended by leader: 15, Current term: 25, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 19 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:07:30.531415 20103 raft_consensus.cc:1275] T df751f992649444090e27965eb1af85d P 127766fc592545a4997f7790f50f6076 [term 25 FOLLOWER]: Refusing update from remote peer e61c3a8f61bb48f8a963c9480e53c168: Log matching property violated. Preceding OpId in replica: term: 25 index: 18. Preceding OpId from leader: term: 25 index: 19. (index mismatch)
I20260709 13:07:30.533504 26898 consensus_queue.cc:1048] T df751f992649444090e27965eb1af85d P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Connected to new peer: Peer: permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 19, Last known committed idx: 18, Time since last communication: 0.001s
I20260709 13:07:30.537633 26829 ts_tablet_manager.cc:933] T 76cb037fc9064d13b59a8969d897ce8c P 127766fc592545a4997f7790f50f6076: Initiating tablet copy from peer e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:07:30.543296 19411 leader_election.cc:290] T e381f1d6b8184797ad142de49be225a8 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 19 election: Requested vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:07:30.552934 26790 raft_consensus.cc:2955] T df751f992649444090e27965eb1af85d P e61c3a8f61bb48f8a963c9480e53c168 [term 25 LEADER]: Committing config change with OpId 25.19: config changed from index 18 to 19, VOTER 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2) evicted. New config: { opid_index: 19 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } } }
I20260709 13:07:30.560923 20103 raft_consensus.cc:2955] T df751f992649444090e27965eb1af85d P 127766fc592545a4997f7790f50f6076 [term 25 FOLLOWER]: Committing config change with OpId 25.19: config changed from index 18 to 19, VOTER 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2) evicted. New config: { opid_index: 19 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } } }
I20260709 13:07:30.578460 19551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e381f1d6b8184797ad142de49be225a8" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: true dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:07:30.579092 19551 raft_consensus.cc:3060] T e381f1d6b8184797ad142de49be225a8 P e61c3a8f61bb48f8a963c9480e53c168 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:07:30.580482 19486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cdf56e38bbc453d9438d359e5a69955" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: true dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:07:30.581074 19486 raft_consensus.cc:3055] T 0cdf56e38bbc453d9438d359e5a69955 P 0473d2b2d01f4459b1e90fd12cc7840e [term 21 LEADER]: Stepping down as leader of term 21
I20260709 13:07:30.581374 19486 raft_consensus.cc:740] T 0cdf56e38bbc453d9438d359e5a69955 P 0473d2b2d01f4459b1e90fd12cc7840e [term 21 LEADER]: Becoming Follower/Learner. State: Replica: 0473d2b2d01f4459b1e90fd12cc7840e, State: Running, Role: LEADER
I20260709 13:07:30.581895 19485 raft_consensus.cc:1275] T 2e36a9d6e29c4a7c860cf267efbd4c74 P 0473d2b2d01f4459b1e90fd12cc7840e [term 17 FOLLOWER]: Refusing update from remote peer e5256d91808b47c195bc9b4dbd7f2b87: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
I20260709 13:07:30.583019 19478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ec1c4ce15e04c7e8c283a62179f2a64" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: true dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:07:30.583575 19478 raft_consensus.cc:3055] T 5ec1c4ce15e04c7e8c283a62179f2a64 P 0473d2b2d01f4459b1e90fd12cc7840e [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:07:30.583868 19478 raft_consensus.cc:740] T 5ec1c4ce15e04c7e8c283a62179f2a64 P 0473d2b2d01f4459b1e90fd12cc7840e [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 0473d2b2d01f4459b1e90fd12cc7840e, State: Running, Role: LEADER
I20260709 13:07:30.584599 19478 consensus_queue.cc:260] T 5ec1c4ce15e04c7e8c283a62179f2a64 P 0473d2b2d01f4459b1e90fd12cc7840e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 15.13, Last appended by leader: 13, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:07:30.585721 19478 raft_consensus.cc:3060] T 5ec1c4ce15e04c7e8c283a62179f2a64 P 0473d2b2d01f4459b1e90fd12cc7840e [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:07:30.587229 19477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e381f1d6b8184797ad142de49be225a8" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: true dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:07:30.587793 19477 raft_consensus.cc:3055] T e381f1d6b8184797ad142de49be225a8 P 0473d2b2d01f4459b1e90fd12cc7840e [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:07:30.588065 19477 raft_consensus.cc:740] T e381f1d6b8184797ad142de49be225a8 P 0473d2b2d01f4459b1e90fd12cc7840e [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 0473d2b2d01f4459b1e90fd12cc7840e, State: Running, Role: LEADER
I20260709 13:07:30.588783 19477 consensus_queue.cc:260] T e381f1d6b8184797ad142de49be225a8 P 0473d2b2d01f4459b1e90fd12cc7840e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.11, Last appended by leader: 11, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:07:30.589843 19477 raft_consensus.cc:3060] T e381f1d6b8184797ad142de49be225a8 P 0473d2b2d01f4459b1e90fd12cc7840e [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:07:30.592733 19294 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet df751f992649444090e27965eb1af85d with cas_config_opid_index 18: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:07:30.582105 19486 consensus_queue.cc:260] T 0cdf56e38bbc453d9438d359e5a69955 P 0473d2b2d01f4459b1e90fd12cc7840e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 21.14, Last appended by leader: 14, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:07:30.597746 19486 raft_consensus.cc:3060] T 0cdf56e38bbc453d9438d359e5a69955 P 0473d2b2d01f4459b1e90fd12cc7840e [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:07:30.598798 26878 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 21e14947d70440f19044d8f75c31e1f9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:30.599700 19552 raft_consensus.cc:1240] T 0cdf56e38bbc453d9438d359e5a69955 P e61c3a8f61bb48f8a963c9480e53c168 [term 22 FOLLOWER]: Rejecting Update request from peer 0473d2b2d01f4459b1e90fd12cc7840e for earlier term 21. Current term is 22. Ops: []
I20260709 13:07:30.604441 19306 catalog_manager.cc:5697] T df751f992649444090e27965eb1af85d P 127766fc592545a4997f7790f50f6076 reported cstate change: config changed from index 18 to 19, VOTER 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2) evicted. New cstate: current_term: 25 leader_uuid: "e61c3a8f61bb48f8a963c9480e53c168" committed_config { opid_index: 19 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } } }
I20260709 13:07:30.613233 26884 consensus_queue.cc:1048] T 2e36a9d6e29c4a7c860cf267efbd4c74 P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:07:30.623387 19559 raft_consensus.cc:1275] T fa8650e71aa14778b3d73721fc50d9fc P e61c3a8f61bb48f8a963c9480e53c168 [term 22 FOLLOWER]: Refusing update from remote peer 0473d2b2d01f4459b1e90fd12cc7840e: Log matching property violated. Preceding OpId in replica: term: 21 index: 12. Preceding OpId from leader: term: 22 index: 13. (index mismatch)
I20260709 13:07:30.626544 19408 raft_consensus.cc:1275] T fa8650e71aa14778b3d73721fc50d9fc P e5256d91808b47c195bc9b4dbd7f2b87 [term 22 FOLLOWER]: Refusing update from remote peer 0473d2b2d01f4459b1e90fd12cc7840e: Log matching property violated. Preceding OpId in replica: term: 21 index: 12. Preceding OpId from leader: term: 22 index: 13. (index mismatch)
I20260709 13:07:30.628770 19411 raft_consensus.cc:1275] T df751f992649444090e27965eb1af85d P e5256d91808b47c195bc9b4dbd7f2b87 [term 25 FOLLOWER]: Refusing update from remote peer e61c3a8f61bb48f8a963c9480e53c168: Log matching property violated. Preceding OpId in replica: term: 25 index: 18. Preceding OpId from leader: term: 25 index: 19. (index mismatch)
I20260709 13:07:30.629542 26900 consensus_queue.cc:1048] T fa8650e71aa14778b3d73721fc50d9fc P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:07:30.635342 19486 raft_consensus.cc:2468] T 0cdf56e38bbc453d9438d359e5a69955 P 0473d2b2d01f4459b1e90fd12cc7840e [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 22.
I20260709 13:07:30.636145 19478 raft_consensus.cc:2468] T 5ec1c4ce15e04c7e8c283a62179f2a64 P 0473d2b2d01f4459b1e90fd12cc7840e [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 16.
W20260709 13:07:30.635056 19523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.1:40321, user_credentials={real_user=slave}} blocked reactor thread for 59389.6us
I20260709 13:07:30.646473 18300 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:07:30.653174 19551 raft_consensus.cc:2468] T e381f1d6b8184797ad142de49be225a8 P e61c3a8f61bb48f8a963c9480e53c168 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 19.
I20260709 13:07:30.655463 19560 raft_consensus.cc:1240] T e381f1d6b8184797ad142de49be225a8 P e61c3a8f61bb48f8a963c9480e53c168 [term 19 FOLLOWER]: Rejecting Update request from peer 0473d2b2d01f4459b1e90fd12cc7840e for earlier term 18. Current term is 19. Ops: []
I20260709 13:07:30.654641 19375 leader_election.cc:304] T e381f1d6b8184797ad142de49be225a8 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:07:30.659375 26880 raft_consensus.cc:2804] T e381f1d6b8184797ad142de49be225a8 P e5256d91808b47c195bc9b4dbd7f2b87 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:07:30.663044 19477 raft_consensus.cc:2468] T e381f1d6b8184797ad142de49be225a8 P 0473d2b2d01f4459b1e90fd12cc7840e [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 19.
I20260709 13:07:30.668422 26741 consensus_queue.cc:1048] T df751f992649444090e27965eb1af85d P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 19, Last known committed idx: 18, Time since last communication: 0.003s
I20260709 13:07:30.668946 26880 raft_consensus.cc:697] T e381f1d6b8184797ad142de49be225a8 P e5256d91808b47c195bc9b4dbd7f2b87 [term 19 LEADER]: Becoming Leader. State: Replica: e5256d91808b47c195bc9b4dbd7f2b87, State: Running, Role: LEADER
I20260709 13:07:30.669960 26880 consensus_queue.cc:237] T e381f1d6b8184797ad142de49be225a8 P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.11, Last appended by leader: 11, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:07:30.682019 19308 catalog_manager.cc:5697] T 76cb037fc9064d13b59a8969d897ce8c P 0473d2b2d01f4459b1e90fd12cc7840e reported cstate change: config changed from index -1 to 13, NON_VOTER 127766fc592545a4997f7790f50f6076 (127.17.223.4) added. New cstate: current_term: 22 leader_uuid: "e61c3a8f61bb48f8a963c9480e53c168" committed_config { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } attrs { replace: true } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: NON_VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: true } } }
I20260709 13:07:30.691319 26829 tablet_copy_client.cc:323] T 76cb037fc9064d13b59a8969d897ce8c P 127766fc592545a4997f7790f50f6076: tablet copy: Beginning tablet copy session from remote peer at address 127.17.223.3:36891
I20260709 13:07:30.713020 19468 tablet_service.cc:1558] Processing DeleteTablet for tablet df751f992649444090e27965eb1af85d with delete_type TABLET_DATA_TOMBSTONED (TS 0473d2b2d01f4459b1e90fd12cc7840e not found in new config with opid_index 19) from {username='slave'} at 127.0.0.1:57480
I20260709 13:07:30.788360 19306 catalog_manager.cc:5697] T 0cdf56e38bbc453d9438d359e5a69955 P e5256d91808b47c195bc9b4dbd7f2b87 reported cstate change: term changed from 21 to 22, leader changed from 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2) to e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1). New cstate: current_term: 22 leader_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:30.792480 19306 catalog_manager.cc:5697] T 5ec1c4ce15e04c7e8c283a62179f2a64 P e5256d91808b47c195bc9b4dbd7f2b87 reported cstate change: term changed from 15 to 16, leader changed from 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2) to e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1). New cstate: current_term: 16 leader_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:30.808669 26900 consensus_queue.cc:1048] T fa8650e71aa14778b3d73721fc50d9fc P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:07:30.872001 26822 raft_consensus.cc:1064] T 28af091831594f9d8e96482078cc7625 P e61c3a8f61bb48f8a963c9480e53c168: attempting to promote NON_VOTER 127766fc592545a4997f7790f50f6076 to VOTER
I20260709 13:07:30.865255 19570 tablet_copy_service.cc:140] P e61c3a8f61bb48f8a963c9480e53c168: Received BeginTabletCopySession request for tablet 76cb037fc9064d13b59a8969d897ce8c from peer 127766fc592545a4997f7790f50f6076 ({username='slave'} at 127.0.0.1:41504)
I20260709 13:07:30.890960 19482 raft_consensus.cc:1275] T 0cdf56e38bbc453d9438d359e5a69955 P 0473d2b2d01f4459b1e90fd12cc7840e [term 22 FOLLOWER]: Refusing update from remote peer e5256d91808b47c195bc9b4dbd7f2b87: Log matching property violated. Preceding OpId in replica: term: 21 index: 14. Preceding OpId from leader: term: 22 index: 15. (index mismatch)
I20260709 13:07:30.892593 19570 tablet_copy_service.cc:161] P e61c3a8f61bb48f8a963c9480e53c168: Beginning new tablet copy session on tablet 76cb037fc9064d13b59a8969d897ce8c from peer 127766fc592545a4997f7790f50f6076 at {username='slave'} at 127.0.0.1:41504: session id = 127766fc592545a4997f7790f50f6076-76cb037fc9064d13b59a8969d897ce8c
W20260709 13:07:30.910635 19523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.4:43121, user_credentials={real_user=slave}} blocked reactor thread for 60629.9us
I20260709 13:07:30.902827 26894 consensus_queue.cc:1048] T 0cdf56e38bbc453d9438d359e5a69955 P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.011s
I20260709 13:07:30.915568 19484 raft_consensus.cc:1275] T 5ec1c4ce15e04c7e8c283a62179f2a64 P 0473d2b2d01f4459b1e90fd12cc7840e [term 16 FOLLOWER]: Refusing update from remote peer e5256d91808b47c195bc9b4dbd7f2b87: Log matching property violated. Preceding OpId in replica: term: 15 index: 13. Preceding OpId from leader: term: 16 index: 14. (index mismatch)
I20260709 13:07:30.891928 19408 raft_consensus.cc:2955] T df751f992649444090e27965eb1af85d P e5256d91808b47c195bc9b4dbd7f2b87 [term 25 FOLLOWER]: Committing config change with OpId 25.19: config changed from index 18 to 19, VOTER 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2) evicted. New config: { opid_index: 19 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } } }
I20260709 13:07:30.942198 19553 raft_consensus.cc:1275] T 0cdf56e38bbc453d9438d359e5a69955 P e61c3a8f61bb48f8a963c9480e53c168 [term 22 FOLLOWER]: Refusing update from remote peer e5256d91808b47c195bc9b4dbd7f2b87: Log matching property violated. Preceding OpId in replica: term: 21 index: 14. Preceding OpId from leader: term: 22 index: 15. (index mismatch)
I20260709 13:07:30.924800 26907 tablet_replica.cc:333] T df751f992649444090e27965eb1af85d P 0473d2b2d01f4459b1e90fd12cc7840e: stopping tablet replica
W20260709 13:07:30.965444 19526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.2:46257, user_credentials={real_user=slave}} blocked reactor thread for 116873us
I20260709 13:07:30.924692 26884 consensus_queue.cc:1048] T 5ec1c4ce15e04c7e8c283a62179f2a64 P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.039s
I20260709 13:07:31.003151 26878 tablet_copy_client.cc:806] T 21e14947d70440f19044d8f75c31e1f9 P 127766fc592545a4997f7790f50f6076: tablet copy: Starting download of 0 data blocks...
I20260709 13:07:31.048733 26878 tablet_copy_client.cc:670] T 21e14947d70440f19044d8f75c31e1f9 P 127766fc592545a4997f7790f50f6076: tablet copy: Starting download of 1 WAL segments...
I20260709 13:07:31.061121 26822 consensus_queue.cc:237] T 28af091831594f9d8e96482078cc7625 P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 19.12, Last appended by leader: 10, Current term: 19, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } attrs { replace: true } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:07:31.100281 19570 tablet_copy_source_session.cc:215] T 76cb037fc9064d13b59a8969d897ce8c P e61c3a8f61bb48f8a963c9480e53c168: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:07:31.113521 26907 raft_consensus.cc:2243] T df751f992649444090e27965eb1af85d P 0473d2b2d01f4459b1e90fd12cc7840e [term 25 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:31.126495 26907 raft_consensus.cc:2272] T df751f992649444090e27965eb1af85d P 0473d2b2d01f4459b1e90fd12cc7840e [term 25 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:31.140724 26599 consensus_queue.cc:1048] T 0cdf56e38bbc453d9438d359e5a69955 P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 13:07:31.142549 20103 raft_consensus.cc:1275] T 5ec1c4ce15e04c7e8c283a62179f2a64 P 127766fc592545a4997f7790f50f6076 [term 16 FOLLOWER]: Refusing update from remote peer e5256d91808b47c195bc9b4dbd7f2b87: Log matching property violated. Preceding OpId in replica: term: 15 index: 13. Preceding OpId from leader: term: 16 index: 14. (index mismatch)
I20260709 13:07:31.147614 26907 ts_tablet_manager.cc:1916] T df751f992649444090e27965eb1af85d P 0473d2b2d01f4459b1e90fd12cc7840e: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:07:31.190703 19557 raft_consensus.cc:1275] T e381f1d6b8184797ad142de49be225a8 P e61c3a8f61bb48f8a963c9480e53c168 [term 19 FOLLOWER]: Refusing update from remote peer e5256d91808b47c195bc9b4dbd7f2b87: Log matching property violated. Preceding OpId in replica: term: 18 index: 11. Preceding OpId from leader: term: 19 index: 12. (index mismatch)
I20260709 13:07:31.192440 26884 consensus_queue.cc:1048] T 5ec1c4ce15e04c7e8c283a62179f2a64 P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Connected to new peer: Peer: permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:07:31.205871 26764 consensus_queue.cc:1048] T e381f1d6b8184797ad142de49be225a8 P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:07:31.215003 26829 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 76cb037fc9064d13b59a8969d897ce8c. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:07:31.326366 19450 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.3:36891, user_credentials={real_user=slave}} blocked reactor thread for 98007.4us
I20260709 13:07:31.348945 20110 raft_consensus.cc:1275] T 28af091831594f9d8e96482078cc7625 P 127766fc592545a4997f7790f50f6076 [term 19 LEARNER]: Refusing update from remote peer e61c3a8f61bb48f8a963c9480e53c168: Log matching property violated. Preceding OpId in replica: term: 19 index: 12. Preceding OpId from leader: term: 19 index: 13. (index mismatch)
I20260709 13:07:31.351871 19482 raft_consensus.cc:1275] T 28af091831594f9d8e96482078cc7625 P 0473d2b2d01f4459b1e90fd12cc7840e [term 19 FOLLOWER]: Refusing update from remote peer e61c3a8f61bb48f8a963c9480e53c168: Log matching property violated. Preceding OpId in replica: term: 19 index: 12. Preceding OpId from leader: term: 19 index: 13. (index mismatch)
I20260709 13:07:31.368603 26878 tablet_copy_client.cc:538] T 21e14947d70440f19044d8f75c31e1f9 P 127766fc592545a4997f7790f50f6076: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:07:31.410404 19406 raft_consensus.cc:1275] T 28af091831594f9d8e96482078cc7625 P e5256d91808b47c195bc9b4dbd7f2b87 [term 19 FOLLOWER]: Refusing update from remote peer e61c3a8f61bb48f8a963c9480e53c168: Log matching property violated. Preceding OpId in replica: term: 19 index: 12. Preceding OpId from leader: term: 19 index: 13. (index mismatch)
I20260709 13:07:31.421939 26910 consensus_queue.cc:1048] T 28af091831594f9d8e96482078cc7625 P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:07:31.448890 26910 consensus_queue.cc:1048] T 28af091831594f9d8e96482078cc7625 P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.005s
I20260709 13:07:31.456390 19481 raft_consensus.cc:1275] T e381f1d6b8184797ad142de49be225a8 P 0473d2b2d01f4459b1e90fd12cc7840e [term 19 FOLLOWER]: Refusing update from remote peer e5256d91808b47c195bc9b4dbd7f2b87: Log matching property violated. Preceding OpId in replica: term: 18 index: 11. Preceding OpId from leader: term: 19 index: 12. (index mismatch)
I20260709 13:07:31.457911 26898 consensus_queue.cc:1048] T 28af091831594f9d8e96482078cc7625 P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Connected to new peer: Peer: permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:07:31.463802 26907 ts_tablet_manager.cc:1929] T df751f992649444090e27965eb1af85d P 0473d2b2d01f4459b1e90fd12cc7840e: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 25.18
I20260709 13:07:31.464305 26907 log.cc:1199] T df751f992649444090e27965eb1af85d P 0473d2b2d01f4459b1e90fd12cc7840e: Deleting WAL directory at /tmp/dist-test-taskKd2k48/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602220613947-18300-0/minicluster-data/ts-1-root/wals/df751f992649444090e27965eb1af85d
I20260709 13:07:31.442461 26878 tablet_bootstrap.cc:492] T 21e14947d70440f19044d8f75c31e1f9 P 127766fc592545a4997f7790f50f6076: Bootstrap starting.
I20260709 13:07:31.499290 26917 consensus_queue.cc:1048] T e381f1d6b8184797ad142de49be225a8 P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.008s
I20260709 13:07:31.518604 19296 catalog_manager.cc:5028] TS 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257): tablet df751f992649444090e27965eb1af85d (table test-workload [id=ce1025c73cf04c4baf25820ae7ff0a53]) successfully deleted
I20260709 13:07:31.533318 19305 catalog_manager.cc:5697] T e381f1d6b8184797ad142de49be225a8 P e5256d91808b47c195bc9b4dbd7f2b87 reported cstate change: term changed from 18 to 19, leader changed from 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2) to e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1). New cstate: current_term: 19 leader_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:31.679939 26829 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.StartTabletCopy from 127.0.0.1:46422 (request call id 1181) took 1143 ms. Trace:
I20260709 13:07:31.694974 26829 rpcz_store.cc:276] 0709 13:07:30.536928 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:30.537059 (+   131us) service_pool.cc:224] Handling call
0709 13:07:30.538079 (+  1020us) ts_tablet_manager.cc:934] T 76cb037fc9064d13b59a8969d897ce8c P 127766fc592545a4997f7790f50f6076: Initiating tablet copy from peer e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
0709 13:07:31.213842 (+675763us) tablet_copy_client.cc:368] Tablet copy session begun
0709 13:07:31.426522 (+212680us) tablet_metadata.cc:665] Metadata flushed
0709 13:07:31.444873 (+ 18351us) tablet_copy_client.cc:497] Wrote new tablet metadata
0709 13:07:31.679048 (+234175us) tablet_copy_client.cc:418] Wrote new consensus metadata
0709 13:07:31.679483 (+   435us) tablet_replica.cc:206] Creating consensus instance
0709 13:07:31.679783 (+   300us) ts_tablet_manager.cc:989] Replica registered.
0709 13:07:31.679855 (+    72us) inbound_call.cc:177] Queueing success response
Metrics: {"dns_us":27083,"tablet-copy.queue_time_us":90,"thread_start_us":123365,"threads_started":1}
I20260709 13:07:31.697770 26829 tablet_copy_client.cc:806] T 76cb037fc9064d13b59a8969d897ce8c P 127766fc592545a4997f7790f50f6076: tablet copy: Starting download of 0 data blocks...
I20260709 13:07:31.698338 26829 tablet_copy_client.cc:670] T 76cb037fc9064d13b59a8969d897ce8c P 127766fc592545a4997f7790f50f6076: tablet copy: Starting download of 1 WAL segments...
I20260709 13:07:31.805251 26914 raft_consensus.cc:2955] T 28af091831594f9d8e96482078cc7625 P e61c3a8f61bb48f8a963c9480e53c168 [term 19 LEADER]: Committing config change with OpId 19.13: config changed from index 12 to 13, 127766fc592545a4997f7790f50f6076 (127.17.223.4) changed from NON_VOTER to VOTER. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } attrs { replace: true } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } } }
I20260709 13:07:31.850487 20106 raft_consensus.cc:2955] T 28af091831594f9d8e96482078cc7625 P 127766fc592545a4997f7790f50f6076 [term 19 FOLLOWER]: Committing config change with OpId 19.13: config changed from index 12 to 13, 127766fc592545a4997f7790f50f6076 (127.17.223.4) changed from NON_VOTER to VOTER. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } attrs { replace: true } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } } }
I20260709 13:07:31.878010 26829 tablet_copy_client.cc:538] T 76cb037fc9064d13b59a8969d897ce8c P 127766fc592545a4997f7790f50f6076: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:07:31.898245 26829 tablet_bootstrap.cc:492] T 76cb037fc9064d13b59a8969d897ce8c P 127766fc592545a4997f7790f50f6076: Bootstrap starting.
I20260709 13:07:31.897469 19483 raft_consensus.cc:2955] T 28af091831594f9d8e96482078cc7625 P 0473d2b2d01f4459b1e90fd12cc7840e [term 19 FOLLOWER]: Committing config change with OpId 19.13: config changed from index 12 to 13, 127766fc592545a4997f7790f50f6076 (127.17.223.4) changed from NON_VOTER to VOTER. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } attrs { replace: true } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } } }
I20260709 13:07:31.925092 19302 catalog_manager.cc:5697] T 28af091831594f9d8e96482078cc7625 P e61c3a8f61bb48f8a963c9480e53c168 reported cstate change: config changed from index 12 to 13, 127766fc592545a4997f7790f50f6076 (127.17.223.4) changed from NON_VOTER to VOTER. New cstate: current_term: 19 leader_uuid: "e61c3a8f61bb48f8a963c9480e53c168" committed_config { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:07:31.927860 19406 raft_consensus.cc:2955] T 28af091831594f9d8e96482078cc7625 P e5256d91808b47c195bc9b4dbd7f2b87 [term 19 FOLLOWER]: Committing config change with OpId 19.13: config changed from index 12 to 13, 127766fc592545a4997f7790f50f6076 (127.17.223.4) changed from NON_VOTER to VOTER. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } attrs { replace: true } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } } }
I20260709 13:07:31.975313 19557 consensus_queue.cc:237] T 28af091831594f9d8e96482078cc7625 P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 19.13, Last appended by leader: 10, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:07:31.987627 20106 raft_consensus.cc:1275] T 28af091831594f9d8e96482078cc7625 P 127766fc592545a4997f7790f50f6076 [term 19 FOLLOWER]: Refusing update from remote peer e61c3a8f61bb48f8a963c9480e53c168: Log matching property violated. Preceding OpId in replica: term: 19 index: 13. Preceding OpId from leader: term: 19 index: 14. (index mismatch)
I20260709 13:07:31.993058 26791 consensus_queue.cc:1048] T 28af091831594f9d8e96482078cc7625 P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Connected to new peer: Peer: permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:07:32.000265 19406 raft_consensus.cc:1275] T 28af091831594f9d8e96482078cc7625 P e5256d91808b47c195bc9b4dbd7f2b87 [term 19 FOLLOWER]: Refusing update from remote peer e61c3a8f61bb48f8a963c9480e53c168: Log matching property violated. Preceding OpId in replica: term: 19 index: 13. Preceding OpId from leader: term: 19 index: 14. (index mismatch)
I20260709 13:07:32.006173 18300 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:07:32.015012 26749 consensus_queue.cc:1048] T 28af091831594f9d8e96482078cc7625 P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.006s
I20260709 13:07:32.020643 26898 raft_consensus.cc:2955] T 28af091831594f9d8e96482078cc7625 P e61c3a8f61bb48f8a963c9480e53c168 [term 19 LEADER]: Committing config change with OpId 19.14: config changed from index 13 to 14, VOTER 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2) evicted. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } } }
I20260709 13:07:32.027979 20103 raft_consensus.cc:2955] T 28af091831594f9d8e96482078cc7625 P 127766fc592545a4997f7790f50f6076 [term 19 FOLLOWER]: Committing config change with OpId 19.14: config changed from index 13 to 14, VOTER 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2) evicted. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } } }
I20260709 13:07:32.056880 19410 raft_consensus.cc:2955] T 28af091831594f9d8e96482078cc7625 P e5256d91808b47c195bc9b4dbd7f2b87 [term 19 FOLLOWER]: Committing config change with OpId 19.14: config changed from index 13 to 14, VOTER 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2) evicted. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } } }
I20260709 13:07:32.089493 19302 catalog_manager.cc:5697] T 28af091831594f9d8e96482078cc7625 P e5256d91808b47c195bc9b4dbd7f2b87 reported cstate change: config changed from index 13 to 14, VOTER 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2) evicted. New cstate: current_term: 19 leader_uuid: "e61c3a8f61bb48f8a963c9480e53c168" committed_config { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } } }
I20260709 13:07:32.096109 26878 tablet_bootstrap.cc:492] T 21e14947d70440f19044d8f75c31e1f9 P 127766fc592545a4997f7790f50f6076: Bootstrap replayed 1/1 log segments. Stats: ops{read=16 overwritten=1 applied=15 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:07:32.097247 26878 tablet_bootstrap.cc:492] T 21e14947d70440f19044d8f75c31e1f9 P 127766fc592545a4997f7790f50f6076: Bootstrap complete.
I20260709 13:07:32.098055 26878 ts_tablet_manager.cc:1403] T 21e14947d70440f19044d8f75c31e1f9 P 127766fc592545a4997f7790f50f6076: Time spent bootstrapping tablet: real 0.656s	user 0.068s	sys 0.064s
I20260709 13:07:32.104176 19468 tablet_service.cc:1558] Processing DeleteTablet for tablet 28af091831594f9d8e96482078cc7625 with delete_type TABLET_DATA_TOMBSTONED (TS 0473d2b2d01f4459b1e90fd12cc7840e not found in new config with opid_index 14) from {username='slave'} at 127.0.0.1:57480
I20260709 13:07:32.119997 19481 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2725d2c4cb054f18b0fc8f735c15f6c2"
dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
mode: GRACEFUL
new_leader_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
 from {username='slave'} at 127.0.0.1:48168
I20260709 13:07:32.120612 19481 raft_consensus.cc:606] T 2725d2c4cb054f18b0fc8f735c15f6c2 P 0473d2b2d01f4459b1e90fd12cc7840e [term 21 LEADER]: Received request to transfer leadership to TS e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:07:32.123839 19411 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "40e1e16737a842ee936002830f36882e"
dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
mode: GRACEFUL
new_leader_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
 from {username='slave'} at 127.0.0.1:37312
I20260709 13:07:32.124363 19411 raft_consensus.cc:606] T 40e1e16737a842ee936002830f36882e P e5256d91808b47c195bc9b4dbd7f2b87 [term 23 LEADER]: Received request to transfer leadership to TS 0473d2b2d01f4459b1e90fd12cc7840e
I20260709 13:07:32.127209 19557 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7be9efa6559648dbb5a0f7684c4542d1"
dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
mode: GRACEFUL
new_leader_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
 from {username='slave'} at 127.0.0.1:39264
I20260709 13:07:32.127751 19557 raft_consensus.cc:606] T 7be9efa6559648dbb5a0f7684c4542d1 P e61c3a8f61bb48f8a963c9480e53c168 [term 22 LEADER]: Received request to transfer leadership to TS 0473d2b2d01f4459b1e90fd12cc7840e
I20260709 13:07:32.129240 19294 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 28af091831594f9d8e96482078cc7625 with cas_config_opid_index 13: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:07:32.130172 18300 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 13:07:32.132300 18300 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:07:32.146404 26943 tablet_replica.cc:333] T 28af091831594f9d8e96482078cc7625 P 0473d2b2d01f4459b1e90fd12cc7840e: stopping tablet replica
I20260709 13:07:32.148162 26943 raft_consensus.cc:2243] T 28af091831594f9d8e96482078cc7625 P 0473d2b2d01f4459b1e90fd12cc7840e [term 19 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:32.149024 26878 raft_consensus.cc:359] T 21e14947d70440f19044d8f75c31e1f9 P 127766fc592545a4997f7790f50f6076 [term 22 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } attrs { replace: true } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: NON_VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: true } }
I20260709 13:07:32.149137 26943 raft_consensus.cc:2272] T 28af091831594f9d8e96482078cc7625 P 0473d2b2d01f4459b1e90fd12cc7840e [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:32.149896 26878 raft_consensus.cc:740] T 21e14947d70440f19044d8f75c31e1f9 P 127766fc592545a4997f7790f50f6076 [term 22 LEARNER]: Becoming Follower/Learner. State: Replica: 127766fc592545a4997f7790f50f6076, State: Initialized, Role: LEARNER
I20260709 13:07:32.159399 26943 ts_tablet_manager.cc:1916] T 28af091831594f9d8e96482078cc7625 P 0473d2b2d01f4459b1e90fd12cc7840e: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:07:32.156193 26878 consensus_queue.cc:260] T 21e14947d70440f19044d8f75c31e1f9 P 127766fc592545a4997f7790f50f6076 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 15, Last appended: 22.15, Last appended by leader: 15, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } attrs { replace: true } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: NON_VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: true } }
I20260709 13:07:32.170295 26878 ts_tablet_manager.cc:1434] T 21e14947d70440f19044d8f75c31e1f9 P 127766fc592545a4997f7790f50f6076: Time spent starting tablet: real 0.072s	user 0.003s	sys 0.003s
I20260709 13:07:32.185953 19496 tablet_copy_service.cc:342] P 0473d2b2d01f4459b1e90fd12cc7840e: Request end of tablet copy session 127766fc592545a4997f7790f50f6076-21e14947d70440f19044d8f75c31e1f9 received from {username='slave'} at 127.0.0.1:39478
I20260709 13:07:32.186442 19496 tablet_copy_service.cc:434] P 0473d2b2d01f4459b1e90fd12cc7840e: ending tablet copy session 127766fc592545a4997f7790f50f6076-21e14947d70440f19044d8f75c31e1f9 on tablet 21e14947d70440f19044d8f75c31e1f9 with peer 127766fc592545a4997f7790f50f6076
I20260709 13:07:32.258657 26829 tablet_bootstrap.cc:492] T 76cb037fc9064d13b59a8969d897ce8c P 127766fc592545a4997f7790f50f6076: Bootstrap replayed 1/1 log segments. Stats: ops{read=15 overwritten=2 applied=13 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:07:32.259655 26829 tablet_bootstrap.cc:492] T 76cb037fc9064d13b59a8969d897ce8c P 127766fc592545a4997f7790f50f6076: Bootstrap complete.
I20260709 13:07:32.260311 26829 ts_tablet_manager.cc:1403] T 76cb037fc9064d13b59a8969d897ce8c P 127766fc592545a4997f7790f50f6076: Time spent bootstrapping tablet: real 0.362s	user 0.038s	sys 0.011s
I20260709 13:07:32.263705 26943 ts_tablet_manager.cc:1929] T 28af091831594f9d8e96482078cc7625 P 0473d2b2d01f4459b1e90fd12cc7840e: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 19.13
I20260709 13:07:32.264192 26943 log.cc:1199] T 28af091831594f9d8e96482078cc7625 P 0473d2b2d01f4459b1e90fd12cc7840e: Deleting WAL directory at /tmp/dist-test-taskKd2k48/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602220613947-18300-0/minicluster-data/ts-1-root/wals/28af091831594f9d8e96482078cc7625
I20260709 13:07:32.265908 19296 catalog_manager.cc:5028] TS 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257): tablet 28af091831594f9d8e96482078cc7625 (table test-workload [id=ce1025c73cf04c4baf25820ae7ff0a53]) successfully deleted
I20260709 13:07:32.291774 26932 raft_consensus.cc:993] T 2725d2c4cb054f18b0fc8f735c15f6c2 P 0473d2b2d01f4459b1e90fd12cc7840e: : Instructing follower e61c3a8f61bb48f8a963c9480e53c168 to start an election
I20260709 13:07:32.292368 26932 raft_consensus.cc:1081] T 2725d2c4cb054f18b0fc8f735c15f6c2 P 0473d2b2d01f4459b1e90fd12cc7840e [term 21 LEADER]: Signalling peer e61c3a8f61bb48f8a963c9480e53c168 to start an election
I20260709 13:07:32.294080 19557 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "2725d2c4cb054f18b0fc8f735c15f6c2"
dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
 from {username='slave'} at 127.0.0.1:40428
I20260709 13:07:32.294902 19557 raft_consensus.cc:493] T 2725d2c4cb054f18b0fc8f735c15f6c2 P e61c3a8f61bb48f8a963c9480e53c168 [term 21 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:07:32.295315 19557 raft_consensus.cc:3060] T 2725d2c4cb054f18b0fc8f735c15f6c2 P e61c3a8f61bb48f8a963c9480e53c168 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:07:32.298384 26829 raft_consensus.cc:359] T 76cb037fc9064d13b59a8969d897ce8c P 127766fc592545a4997f7790f50f6076 [term 22 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } attrs { replace: true } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: NON_VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: true } }
I20260709 13:07:32.299187 26829 raft_consensus.cc:740] T 76cb037fc9064d13b59a8969d897ce8c P 127766fc592545a4997f7790f50f6076 [term 22 LEARNER]: Becoming Follower/Learner. State: Replica: 127766fc592545a4997f7790f50f6076, State: Initialized, Role: LEARNER
I20260709 13:07:32.299795 26829 consensus_queue.cc:260] T 76cb037fc9064d13b59a8969d897ce8c P 127766fc592545a4997f7790f50f6076 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 13, Last appended: 22.13, Last appended by leader: 13, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } attrs { replace: true } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: NON_VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: true } }
I20260709 13:07:32.310968 19557 raft_consensus.cc:515] T 2725d2c4cb054f18b0fc8f735c15f6c2 P e61c3a8f61bb48f8a963c9480e53c168 [term 22 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:07:32.317057 19557 leader_election.cc:290] T 2725d2c4cb054f18b0fc8f735c15f6c2 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 22 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:07:32.317569 19406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2725d2c4cb054f18b0fc8f735c15f6c2" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 22 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: true dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
I20260709 13:07:32.318169 19406 raft_consensus.cc:3060] T 2725d2c4cb054f18b0fc8f735c15f6c2 P e5256d91808b47c195bc9b4dbd7f2b87 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:07:32.322175 19481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2725d2c4cb054f18b0fc8f735c15f6c2" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 22 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: true dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:07:32.322822 19481 raft_consensus.cc:3055] T 2725d2c4cb054f18b0fc8f735c15f6c2 P 0473d2b2d01f4459b1e90fd12cc7840e [term 21 LEADER]: Stepping down as leader of term 21
I20260709 13:07:32.323098 19481 raft_consensus.cc:740] T 2725d2c4cb054f18b0fc8f735c15f6c2 P 0473d2b2d01f4459b1e90fd12cc7840e [term 21 LEADER]: Becoming Follower/Learner. State: Replica: 0473d2b2d01f4459b1e90fd12cc7840e, State: Running, Role: LEADER
I20260709 13:07:32.323817 19481 consensus_queue.cc:260] T 2725d2c4cb054f18b0fc8f735c15f6c2 P 0473d2b2d01f4459b1e90fd12cc7840e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 21.11, Last appended by leader: 11, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:07:32.325034 19481 raft_consensus.cc:3060] T 2725d2c4cb054f18b0fc8f735c15f6c2 P 0473d2b2d01f4459b1e90fd12cc7840e [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:07:32.327191 19406 raft_consensus.cc:2468] T 2725d2c4cb054f18b0fc8f735c15f6c2 P e5256d91808b47c195bc9b4dbd7f2b87 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 22.
I20260709 13:07:32.327209 26829 ts_tablet_manager.cc:1434] T 76cb037fc9064d13b59a8969d897ce8c P 127766fc592545a4997f7790f50f6076: Time spent starting tablet: real 0.067s	user 0.005s	sys 0.003s
I20260709 13:07:32.338346 19523 leader_election.cc:304] T 2725d2c4cb054f18b0fc8f735c15f6c2 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:07:32.339684 26898 raft_consensus.cc:2804] T 2725d2c4cb054f18b0fc8f735c15f6c2 P e61c3a8f61bb48f8a963c9480e53c168 [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:07:32.340041 19570 tablet_copy_service.cc:342] P e61c3a8f61bb48f8a963c9480e53c168: Request end of tablet copy session 127766fc592545a4997f7790f50f6076-76cb037fc9064d13b59a8969d897ce8c received from {username='slave'} at 127.0.0.1:41504
I20260709 13:07:32.340186 26898 raft_consensus.cc:697] T 2725d2c4cb054f18b0fc8f735c15f6c2 P e61c3a8f61bb48f8a963c9480e53c168 [term 22 LEADER]: Becoming Leader. State: Replica: e61c3a8f61bb48f8a963c9480e53c168, State: Running, Role: LEADER
I20260709 13:07:32.340562 19570 tablet_copy_service.cc:434] P e61c3a8f61bb48f8a963c9480e53c168: ending tablet copy session 127766fc592545a4997f7790f50f6076-76cb037fc9064d13b59a8969d897ce8c on tablet 76cb037fc9064d13b59a8969d897ce8c with peer 127766fc592545a4997f7790f50f6076
I20260709 13:07:32.346376 26898 consensus_queue.cc:237] T 2725d2c4cb054f18b0fc8f735c15f6c2 P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 21.11, Last appended by leader: 11, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:07:32.344159 19481 raft_consensus.cc:2468] T 2725d2c4cb054f18b0fc8f735c15f6c2 P 0473d2b2d01f4459b1e90fd12cc7840e [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 22.
I20260709 13:07:32.358136 26910 raft_consensus.cc:993] T 7be9efa6559648dbb5a0f7684c4542d1 P e61c3a8f61bb48f8a963c9480e53c168: : Instructing follower 0473d2b2d01f4459b1e90fd12cc7840e to start an election
I20260709 13:07:32.359201 26910 raft_consensus.cc:1081] T 7be9efa6559648dbb5a0f7684c4542d1 P e61c3a8f61bb48f8a963c9480e53c168 [term 22 LEADER]: Signalling peer 0473d2b2d01f4459b1e90fd12cc7840e to start an election
I20260709 13:07:32.361017 19483 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "7be9efa6559648dbb5a0f7684c4542d1"
dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
 from {username='slave'} at 127.0.0.1:58286
I20260709 13:07:32.361536 19483 raft_consensus.cc:493] T 7be9efa6559648dbb5a0f7684c4542d1 P 0473d2b2d01f4459b1e90fd12cc7840e [term 22 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:07:32.361867 19483 raft_consensus.cc:3060] T 7be9efa6559648dbb5a0f7684c4542d1 P 0473d2b2d01f4459b1e90fd12cc7840e [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:07:32.369422 19483 raft_consensus.cc:515] T 7be9efa6559648dbb5a0f7684c4542d1 P 0473d2b2d01f4459b1e90fd12cc7840e [term 23 FOLLOWER]: Starting forced leader election with config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:07:32.382282 19483 leader_election.cc:290] T 7be9efa6559648dbb5a0f7684c4542d1 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 23 election: Requested vote from peers e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:07:32.382563 20106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7be9efa6559648dbb5a0f7684c4542d1" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: true dest_uuid: "127766fc592545a4997f7790f50f6076"
I20260709 13:07:32.383236 20106 raft_consensus.cc:3060] T 7be9efa6559648dbb5a0f7684c4542d1 P 127766fc592545a4997f7790f50f6076 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:07:32.388877 19557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7be9efa6559648dbb5a0f7684c4542d1" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: true dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:07:32.389499 19557 raft_consensus.cc:3055] T 7be9efa6559648dbb5a0f7684c4542d1 P e61c3a8f61bb48f8a963c9480e53c168 [term 22 LEADER]: Stepping down as leader of term 22
I20260709 13:07:32.389813 19557 raft_consensus.cc:740] T 7be9efa6559648dbb5a0f7684c4542d1 P e61c3a8f61bb48f8a963c9480e53c168 [term 22 LEADER]: Becoming Follower/Learner. State: Replica: e61c3a8f61bb48f8a963c9480e53c168, State: Running, Role: LEADER
I20260709 13:07:32.390964 19557 consensus_queue.cc:260] T 7be9efa6559648dbb5a0f7684c4542d1 P e61c3a8f61bb48f8a963c9480e53c168 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 22.14, Last appended by leader: 14, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:07:32.393186 19557 raft_consensus.cc:3060] T 7be9efa6559648dbb5a0f7684c4542d1 P e61c3a8f61bb48f8a963c9480e53c168 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:07:32.403697 20103 raft_consensus.cc:1217] T 76cb037fc9064d13b59a8969d897ce8c P 127766fc592545a4997f7790f50f6076 [term 22 LEARNER]: Deduplicated request from leader. Original: 22.12->[22.13-22.13]   Dedup: 22.13->[]
I20260709 13:07:32.419155 20106 raft_consensus.cc:2468] T 7be9efa6559648dbb5a0f7684c4542d1 P 127766fc592545a4997f7790f50f6076 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 23.
I20260709 13:07:32.432652 19449 leader_election.cc:304] T 7be9efa6559648dbb5a0f7684c4542d1 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, 127766fc592545a4997f7790f50f6076; no voters: 
I20260709 13:07:32.438170 26874 raft_consensus.cc:2804] T 7be9efa6559648dbb5a0f7684c4542d1 P 0473d2b2d01f4459b1e90fd12cc7840e [term 23 FOLLOWER]: Leader election won for term 23
I20260709 13:07:32.438750 26874 raft_consensus.cc:697] T 7be9efa6559648dbb5a0f7684c4542d1 P 0473d2b2d01f4459b1e90fd12cc7840e [term 23 LEADER]: Becoming Leader. State: Replica: 0473d2b2d01f4459b1e90fd12cc7840e, State: Running, Role: LEADER
I20260709 13:07:32.439615 26874 consensus_queue.cc:237] T 7be9efa6559648dbb5a0f7684c4542d1 P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 22.14, Last appended by leader: 14, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:07:32.466289 26917 raft_consensus.cc:993] T 40e1e16737a842ee936002830f36882e P e5256d91808b47c195bc9b4dbd7f2b87: : Instructing follower 0473d2b2d01f4459b1e90fd12cc7840e to start an election
I20260709 13:07:32.466908 26917 raft_consensus.cc:1081] T 40e1e16737a842ee936002830f36882e P e5256d91808b47c195bc9b4dbd7f2b87 [term 23 LEADER]: Signalling peer 0473d2b2d01f4459b1e90fd12cc7840e to start an election
I20260709 13:07:32.470952 19480 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "40e1e16737a842ee936002830f36882e"
dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
 from {username='slave'} at 127.0.0.1:58294
I20260709 13:07:32.471498 19480 raft_consensus.cc:493] T 40e1e16737a842ee936002830f36882e P 0473d2b2d01f4459b1e90fd12cc7840e [term 23 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:07:32.471822 19480 raft_consensus.cc:3060] T 40e1e16737a842ee936002830f36882e P 0473d2b2d01f4459b1e90fd12cc7840e [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:07:32.478415 19557 raft_consensus.cc:2468] T 7be9efa6559648dbb5a0f7684c4542d1 P e61c3a8f61bb48f8a963c9480e53c168 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 23.
I20260709 13:07:32.513573 20106 raft_consensus.cc:1217] T 21e14947d70440f19044d8f75c31e1f9 P 127766fc592545a4997f7790f50f6076 [term 22 LEARNER]: Deduplicated request from leader. Original: 22.14->[22.15-22.15]   Dedup: 22.15->[]
I20260709 13:07:32.523212 19480 raft_consensus.cc:515] T 40e1e16737a842ee936002830f36882e P 0473d2b2d01f4459b1e90fd12cc7840e [term 24 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:07:32.541215 19306 catalog_manager.cc:5697] T 2725d2c4cb054f18b0fc8f735c15f6c2 P e61c3a8f61bb48f8a963c9480e53c168 reported cstate change: term changed from 21 to 22, leader changed from 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2) to e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3). New cstate: current_term: 22 leader_uuid: "e61c3a8f61bb48f8a963c9480e53c168" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } health_report { overall_health: HEALTHY } } }
I20260709 13:07:32.548020 19302 catalog_manager.cc:5697] T 7be9efa6559648dbb5a0f7684c4542d1 P 0473d2b2d01f4459b1e90fd12cc7840e reported cstate change: term changed from 22 to 23, leader changed from e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3) to 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2). New cstate: current_term: 23 leader_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" committed_config { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:32.568226 19480 leader_election.cc:290] T 40e1e16737a842ee936002830f36882e P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 24 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:07:32.568815 19406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40e1e16737a842ee936002830f36882e" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 24 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: true dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
I20260709 13:07:32.569420 19406 raft_consensus.cc:3055] T 40e1e16737a842ee936002830f36882e P e5256d91808b47c195bc9b4dbd7f2b87 [term 23 LEADER]: Stepping down as leader of term 23
I20260709 13:07:32.569703 19406 raft_consensus.cc:740] T 40e1e16737a842ee936002830f36882e P e5256d91808b47c195bc9b4dbd7f2b87 [term 23 LEADER]: Becoming Follower/Learner. State: Replica: e5256d91808b47c195bc9b4dbd7f2b87, State: Running, Role: LEADER
I20260709 13:07:32.570847 19557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40e1e16737a842ee936002830f36882e" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 24 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: true dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:07:32.570750 19406 consensus_queue.cc:260] T 40e1e16737a842ee936002830f36882e P e5256d91808b47c195bc9b4dbd7f2b87 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 23.13, Last appended by leader: 13, Current term: 23, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:07:32.571419 19557 raft_consensus.cc:3060] T 40e1e16737a842ee936002830f36882e P e61c3a8f61bb48f8a963c9480e53c168 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:07:32.572047 19406 raft_consensus.cc:3060] T 40e1e16737a842ee936002830f36882e P e5256d91808b47c195bc9b4dbd7f2b87 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:07:32.577525 19406 raft_consensus.cc:2468] T 40e1e16737a842ee936002830f36882e P e5256d91808b47c195bc9b4dbd7f2b87 [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 24.
I20260709 13:07:32.577623 19557 raft_consensus.cc:2468] T 40e1e16737a842ee936002830f36882e P e61c3a8f61bb48f8a963c9480e53c168 [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 24.
I20260709 13:07:32.580739 19450 leader_election.cc:304] T 40e1e16737a842ee936002830f36882e P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:07:32.581598 26818 raft_consensus.cc:2804] T 40e1e16737a842ee936002830f36882e P 0473d2b2d01f4459b1e90fd12cc7840e [term 24 FOLLOWER]: Leader election won for term 24
I20260709 13:07:32.582109 26818 raft_consensus.cc:697] T 40e1e16737a842ee936002830f36882e P 0473d2b2d01f4459b1e90fd12cc7840e [term 24 LEADER]: Becoming Leader. State: Replica: 0473d2b2d01f4459b1e90fd12cc7840e, State: Running, Role: LEADER
I20260709 13:07:32.582947 26818 consensus_queue.cc:237] T 40e1e16737a842ee936002830f36882e P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 23.13, Last appended by leader: 13, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:07:32.650450 19302 catalog_manager.cc:5697] T 40e1e16737a842ee936002830f36882e P 0473d2b2d01f4459b1e90fd12cc7840e reported cstate change: term changed from 23 to 24, leader changed from e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1) to 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2). New cstate: current_term: 24 leader_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:32.790185 19481 raft_consensus.cc:1275] T 2725d2c4cb054f18b0fc8f735c15f6c2 P 0473d2b2d01f4459b1e90fd12cc7840e [term 22 FOLLOWER]: Refusing update from remote peer e61c3a8f61bb48f8a963c9480e53c168: Log matching property violated. Preceding OpId in replica: term: 21 index: 11. Preceding OpId from leader: term: 22 index: 12. (index mismatch)
I20260709 13:07:32.792650 26909 consensus_queue.cc:1048] T 2725d2c4cb054f18b0fc8f735c15f6c2 P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:07:32.841015 26741 raft_consensus.cc:1064] T 76cb037fc9064d13b59a8969d897ce8c P e61c3a8f61bb48f8a963c9480e53c168: attempting to promote NON_VOTER 127766fc592545a4997f7790f50f6076 to VOTER
I20260709 13:07:32.850167 26741 consensus_queue.cc:237] T 76cb037fc9064d13b59a8969d897ce8c P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 22.13, Last appended by leader: 11, Current term: 22, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } attrs { replace: true } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:07:32.878510 19483 raft_consensus.cc:1275] T 76cb037fc9064d13b59a8969d897ce8c P 0473d2b2d01f4459b1e90fd12cc7840e [term 22 FOLLOWER]: Refusing update from remote peer e61c3a8f61bb48f8a963c9480e53c168: Log matching property violated. Preceding OpId in replica: term: 22 index: 13. Preceding OpId from leader: term: 22 index: 14. (index mismatch)
I20260709 13:07:32.879592 20106 raft_consensus.cc:1275] T 76cb037fc9064d13b59a8969d897ce8c P 127766fc592545a4997f7790f50f6076 [term 22 LEARNER]: Refusing update from remote peer e61c3a8f61bb48f8a963c9480e53c168: Log matching property violated. Preceding OpId in replica: term: 22 index: 13. Preceding OpId from leader: term: 22 index: 14. (index mismatch)
I20260709 13:07:32.880402 26914 consensus_queue.cc:1048] T 76cb037fc9064d13b59a8969d897ce8c P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:07:32.885481 26898 consensus_queue.cc:1048] T 76cb037fc9064d13b59a8969d897ce8c P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Connected to new peer: Peer: permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:07:32.887387 19411 raft_consensus.cc:1275] T 2725d2c4cb054f18b0fc8f735c15f6c2 P e5256d91808b47c195bc9b4dbd7f2b87 [term 22 FOLLOWER]: Refusing update from remote peer e61c3a8f61bb48f8a963c9480e53c168: Log matching property violated. Preceding OpId in replica: term: 21 index: 11. Preceding OpId from leader: term: 22 index: 12. (index mismatch)
I20260709 13:07:32.892455 19411 raft_consensus.cc:1275] T 76cb037fc9064d13b59a8969d897ce8c P e5256d91808b47c195bc9b4dbd7f2b87 [term 22 FOLLOWER]: Refusing update from remote peer e61c3a8f61bb48f8a963c9480e53c168: Log matching property violated. Preceding OpId in replica: term: 22 index: 13. Preceding OpId from leader: term: 22 index: 14. (index mismatch)
I20260709 13:07:32.894304 26910 consensus_queue.cc:1048] T 2725d2c4cb054f18b0fc8f735c15f6c2 P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:07:32.901109 19560 raft_consensus.cc:1275] T 7be9efa6559648dbb5a0f7684c4542d1 P e61c3a8f61bb48f8a963c9480e53c168 [term 23 FOLLOWER]: Refusing update from remote peer 0473d2b2d01f4459b1e90fd12cc7840e: Log matching property violated. Preceding OpId in replica: term: 22 index: 14. Preceding OpId from leader: term: 23 index: 15. (index mismatch)
I20260709 13:07:32.902771 26818 consensus_queue.cc:1048] T 7be9efa6559648dbb5a0f7684c4542d1 P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 13:07:32.911280 26910 consensus_queue.cc:1048] T 76cb037fc9064d13b59a8969d897ce8c P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
W20260709 13:07:32.959177 19374 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.4:43121, user_credentials={real_user=slave}} blocked reactor thread for 48872.9us
I20260709 13:07:33.033003 20103 raft_consensus.cc:2955] T 76cb037fc9064d13b59a8969d897ce8c P 127766fc592545a4997f7790f50f6076 [term 22 FOLLOWER]: Committing config change with OpId 22.14: config changed from index 13 to 14, 127766fc592545a4997f7790f50f6076 (127.17.223.4) changed from NON_VOTER to VOTER. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } attrs { replace: true } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } } }
I20260709 13:07:33.026253 26914 raft_consensus.cc:2955] T 76cb037fc9064d13b59a8969d897ce8c P e61c3a8f61bb48f8a963c9480e53c168 [term 22 LEADER]: Committing config change with OpId 22.14: config changed from index 13 to 14, 127766fc592545a4997f7790f50f6076 (127.17.223.4) changed from NON_VOTER to VOTER. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } attrs { replace: true } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } } }
W20260709 13:07:33.109297 19375 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.3:36891, user_credentials={real_user=slave}} blocked reactor thread for 110507us
W20260709 13:07:33.121376 19374 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.4:43121, user_credentials={real_user=slave}} blocked reactor thread for 114708us
I20260709 13:07:33.138433 19408 raft_consensus.cc:1275] T 40e1e16737a842ee936002830f36882e P e5256d91808b47c195bc9b4dbd7f2b87 [term 24 FOLLOWER]: Refusing update from remote peer 0473d2b2d01f4459b1e90fd12cc7840e: Log matching property violated. Preceding OpId in replica: term: 23 index: 13. Preceding OpId from leader: term: 24 index: 14. (index mismatch)
I20260709 13:07:33.142383 20103 raft_consensus.cc:1275] T 7be9efa6559648dbb5a0f7684c4542d1 P 127766fc592545a4997f7790f50f6076 [term 23 FOLLOWER]: Refusing update from remote peer 0473d2b2d01f4459b1e90fd12cc7840e: Log matching property violated. Preceding OpId in replica: term: 22 index: 14. Preceding OpId from leader: term: 23 index: 15. (index mismatch)
I20260709 13:07:33.161710 19302 catalog_manager.cc:5697] T 76cb037fc9064d13b59a8969d897ce8c P 127766fc592545a4997f7790f50f6076 reported cstate change: config changed from index 13 to 14, 127766fc592545a4997f7790f50f6076 (127.17.223.4) changed from NON_VOTER to VOTER. New cstate: current_term: 22 leader_uuid: "e61c3a8f61bb48f8a963c9480e53c168" committed_config { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } attrs { replace: true } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } } }
I20260709 13:07:33.225270 18300 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 13:07:33.234844 19449 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.1:40321, user_credentials={real_user=slave}} blocked reactor thread for 84225.9us
I20260709 13:07:33.236178 26972 consensus_queue.cc:1048] T 40e1e16737a842ee936002830f36882e P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
W20260709 13:07:33.273689 26956 log.cc:927] Time spent T 76cb037fc9064d13b59a8969d897ce8c P e5256d91808b47c195bc9b4dbd7f2b87: Append to log took a long time: real 0.082s	user 0.000s	sys 0.000s
I20260709 13:07:33.277153 26818 consensus_queue.cc:1048] T 7be9efa6559648dbb5a0f7684c4542d1 P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Connected to new peer: Peer: permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
W20260709 13:07:33.298522 19450 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.3:36891, user_credentials={real_user=slave}} blocked reactor thread for 287100us
I20260709 13:07:33.313289 19557 raft_consensus.cc:1275] T 40e1e16737a842ee936002830f36882e P e61c3a8f61bb48f8a963c9480e53c168 [term 24 FOLLOWER]: Refusing update from remote peer 0473d2b2d01f4459b1e90fd12cc7840e: Log matching property violated. Preceding OpId in replica: term: 23 index: 13. Preceding OpId from leader: term: 24 index: 14. (index mismatch)
I20260709 13:07:33.493934 19480 raft_consensus.cc:2955] T 76cb037fc9064d13b59a8969d897ce8c P 0473d2b2d01f4459b1e90fd12cc7840e [term 22 FOLLOWER]: Committing config change with OpId 22.14: config changed from index 13 to 14, 127766fc592545a4997f7790f50f6076 (127.17.223.4) changed from NON_VOTER to VOTER. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } attrs { replace: true } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } } }
W20260709 13:07:33.527019 19523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.1:40321, user_credentials={real_user=slave}} blocked reactor thread for 154073us
I20260709 13:07:33.551883 26972 raft_consensus.cc:1064] T 21e14947d70440f19044d8f75c31e1f9 P 0473d2b2d01f4459b1e90fd12cc7840e: attempting to promote NON_VOTER 127766fc592545a4997f7790f50f6076 to VOTER
I20260709 13:07:33.554380 26972 consensus_queue.cc:237] T 21e14947d70440f19044d8f75c31e1f9 P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 22.15, Last appended by leader: 13, Current term: 22, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } attrs { replace: true } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
W20260709 13:07:33.659307 19449 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.1:40321, user_credentials={real_user=slave}} blocked reactor thread for 62264.8us
W20260709 13:07:33.807832 19374 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.4:43121, user_credentials={real_user=slave}} blocked reactor thread for 172450us
I20260709 13:07:33.816303 26980 consensus_queue.cc:1048] T 40e1e16737a842ee936002830f36882e P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
W20260709 13:07:33.820252 20076 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.3:36891, user_credentials={real_user=slave}} blocked reactor thread for 153814us
I20260709 13:07:33.845983 20112 raft_consensus.cc:1275] T 21e14947d70440f19044d8f75c31e1f9 P 127766fc592545a4997f7790f50f6076 [term 22 LEARNER]: Refusing update from remote peer 0473d2b2d01f4459b1e90fd12cc7840e: Log matching property violated. Preceding OpId in replica: term: 22 index: 15. Preceding OpId from leader: term: 22 index: 16. (index mismatch)
I20260709 13:07:33.921955 19402 raft_consensus.cc:2955] T 76cb037fc9064d13b59a8969d897ce8c P e5256d91808b47c195bc9b4dbd7f2b87 [term 22 FOLLOWER]: Committing config change with OpId 22.14: config changed from index 13 to 14, 127766fc592545a4997f7790f50f6076 (127.17.223.4) changed from NON_VOTER to VOTER. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } attrs { replace: true } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } } }
I20260709 13:07:33.959372 19411 raft_consensus.cc:1275] T 21e14947d70440f19044d8f75c31e1f9 P e5256d91808b47c195bc9b4dbd7f2b87 [term 22 FOLLOWER]: Refusing update from remote peer 0473d2b2d01f4459b1e90fd12cc7840e: Log matching property violated. Preceding OpId in replica: term: 22 index: 15. Preceding OpId from leader: term: 22 index: 16. (index mismatch)
I20260709 13:07:33.984256 19556 raft_consensus.cc:1275] T 21e14947d70440f19044d8f75c31e1f9 P e61c3a8f61bb48f8a963c9480e53c168 [term 22 FOLLOWER]: Refusing update from remote peer 0473d2b2d01f4459b1e90fd12cc7840e: Log matching property violated. Preceding OpId in replica: term: 22 index: 15. Preceding OpId from leader: term: 22 index: 16. (index mismatch)
W20260709 13:07:34.004164 19375 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.3:36891, user_credentials={real_user=slave}} blocked reactor thread for 49045.3us
I20260709 13:07:34.026984 26987 consensus_queue.cc:1048] T 21e14947d70440f19044d8f75c31e1f9 P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Connected to new peer: Peer: permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.000s
I20260709 13:07:34.060837 19556 consensus_queue.cc:237] T 76cb037fc9064d13b59a8969d897ce8c P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 22.14, Last appended by leader: 11, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:07:34.059710 26966 consensus_queue.cc:1048] T 21e14947d70440f19044d8f75c31e1f9 P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.019s
I20260709 13:07:34.086987 26965 consensus_queue.cc:1048] T 21e14947d70440f19044d8f75c31e1f9 P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.000s
I20260709 13:07:34.129761 20110 raft_consensus.cc:1275] T 76cb037fc9064d13b59a8969d897ce8c P 127766fc592545a4997f7790f50f6076 [term 22 FOLLOWER]: Refusing update from remote peer e61c3a8f61bb48f8a963c9480e53c168: Log matching property violated. Preceding OpId in replica: term: 22 index: 14. Preceding OpId from leader: term: 22 index: 15. (index mismatch)
I20260709 13:07:34.134359 19406 raft_consensus.cc:1275] T 76cb037fc9064d13b59a8969d897ce8c P e5256d91808b47c195bc9b4dbd7f2b87 [term 22 FOLLOWER]: Refusing update from remote peer e61c3a8f61bb48f8a963c9480e53c168: Log matching property violated. Preceding OpId in replica: term: 22 index: 14. Preceding OpId from leader: term: 22 index: 15. (index mismatch)
I20260709 13:07:34.135335 26985 consensus_queue.cc:1048] T 76cb037fc9064d13b59a8969d897ce8c P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Connected to new peer: Peer: permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 13:07:34.146942 26986 consensus_queue.cc:1048] T 76cb037fc9064d13b59a8969d897ce8c P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 13:07:34.165357 26914 raft_consensus.cc:2955] T 76cb037fc9064d13b59a8969d897ce8c P e61c3a8f61bb48f8a963c9480e53c168 [term 22 LEADER]: Committing config change with OpId 22.15: config changed from index 14 to 15, VOTER 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2) evicted. New config: { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } } }
I20260709 13:07:34.178972 19294 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 76cb037fc9064d13b59a8969d897ce8c with cas_config_opid_index 14: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:07:34.181897 20110 raft_consensus.cc:2955] T 76cb037fc9064d13b59a8969d897ce8c P 127766fc592545a4997f7790f50f6076 [term 22 FOLLOWER]: Committing config change with OpId 22.15: config changed from index 14 to 15, VOTER 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2) evicted. New config: { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } } }
I20260709 13:07:34.183552 19406 raft_consensus.cc:2955] T 76cb037fc9064d13b59a8969d897ce8c P e5256d91808b47c195bc9b4dbd7f2b87 [term 22 FOLLOWER]: Committing config change with OpId 22.15: config changed from index 14 to 15, VOTER 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2) evicted. New config: { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } } }
I20260709 13:07:34.208774 19305 catalog_manager.cc:5697] T 76cb037fc9064d13b59a8969d897ce8c P 127766fc592545a4997f7790f50f6076 reported cstate change: config changed from index 14 to 15, VOTER 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2) evicted. New cstate: current_term: 22 leader_uuid: "e61c3a8f61bb48f8a963c9480e53c168" committed_config { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } } }
I20260709 13:07:34.226225 26965 raft_consensus.cc:2955] T 21e14947d70440f19044d8f75c31e1f9 P 0473d2b2d01f4459b1e90fd12cc7840e [term 22 LEADER]: Committing config change with OpId 22.16: config changed from index 15 to 16, 127766fc592545a4997f7790f50f6076 (127.17.223.4) changed from NON_VOTER to VOTER. New config: { opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } attrs { replace: true } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } } }
I20260709 13:07:34.227918 19556 raft_consensus.cc:2955] T 21e14947d70440f19044d8f75c31e1f9 P e61c3a8f61bb48f8a963c9480e53c168 [term 22 FOLLOWER]: Committing config change with OpId 22.16: config changed from index 15 to 16, 127766fc592545a4997f7790f50f6076 (127.17.223.4) changed from NON_VOTER to VOTER. New config: { opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } attrs { replace: true } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } } }
I20260709 13:07:34.265113 20110 raft_consensus.cc:2955] T 21e14947d70440f19044d8f75c31e1f9 P 127766fc592545a4997f7790f50f6076 [term 22 FOLLOWER]: Committing config change with OpId 22.16: config changed from index 15 to 16, 127766fc592545a4997f7790f50f6076 (127.17.223.4) changed from NON_VOTER to VOTER. New config: { opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } attrs { replace: true } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } } }
I20260709 13:07:34.269033 19402 raft_consensus.cc:2955] T 21e14947d70440f19044d8f75c31e1f9 P e5256d91808b47c195bc9b4dbd7f2b87 [term 22 FOLLOWER]: Committing config change with OpId 22.16: config changed from index 15 to 16, 127766fc592545a4997f7790f50f6076 (127.17.223.4) changed from NON_VOTER to VOTER. New config: { opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } attrs { replace: true } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } } }
I20260709 13:07:34.285437 19304 catalog_manager.cc:5697] T 21e14947d70440f19044d8f75c31e1f9 P 0473d2b2d01f4459b1e90fd12cc7840e reported cstate change: config changed from index 15 to 16, 127766fc592545a4997f7790f50f6076 (127.17.223.4) changed from NON_VOTER to VOTER. New cstate: current_term: 22 leader_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" committed_config { opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:07:34.292753 19468 tablet_service.cc:1558] Processing DeleteTablet for tablet 76cb037fc9064d13b59a8969d897ce8c with delete_type TABLET_DATA_TOMBSTONED (TS 0473d2b2d01f4459b1e90fd12cc7840e not found in new config with opid_index 15) from {username='slave'} at 127.0.0.1:57480
I20260709 13:07:34.335114 27009 tablet_replica.cc:333] T 76cb037fc9064d13b59a8969d897ce8c P 0473d2b2d01f4459b1e90fd12cc7840e: stopping tablet replica
I20260709 13:07:34.336748 27009 raft_consensus.cc:2243] T 76cb037fc9064d13b59a8969d897ce8c P 0473d2b2d01f4459b1e90fd12cc7840e [term 22 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:34.338414 27009 raft_consensus.cc:2272] T 76cb037fc9064d13b59a8969d897ce8c P 0473d2b2d01f4459b1e90fd12cc7840e [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:34.373644 19485 consensus_queue.cc:237] T 21e14947d70440f19044d8f75c31e1f9 P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 22.16, Last appended by leader: 13, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 17 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:07:34.380863 27009 ts_tablet_manager.cc:1916] T 76cb037fc9064d13b59a8969d897ce8c P 0473d2b2d01f4459b1e90fd12cc7840e: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:07:34.381081 19406 raft_consensus.cc:1275] T 21e14947d70440f19044d8f75c31e1f9 P e5256d91808b47c195bc9b4dbd7f2b87 [term 22 FOLLOWER]: Refusing update from remote peer 0473d2b2d01f4459b1e90fd12cc7840e: Log matching property violated. Preceding OpId in replica: term: 22 index: 16. Preceding OpId from leader: term: 22 index: 17. (index mismatch)
I20260709 13:07:34.385866 20106 raft_consensus.cc:1275] T 21e14947d70440f19044d8f75c31e1f9 P 127766fc592545a4997f7790f50f6076 [term 22 FOLLOWER]: Refusing update from remote peer 0473d2b2d01f4459b1e90fd12cc7840e: Log matching property violated. Preceding OpId in replica: term: 22 index: 16. Preceding OpId from leader: term: 22 index: 17. (index mismatch)
I20260709 13:07:34.401301 26983 consensus_queue.cc:1048] T 21e14947d70440f19044d8f75c31e1f9 P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Connected to new peer: Peer: permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.001s
I20260709 13:07:34.406806 26965 consensus_queue.cc:1048] T 21e14947d70440f19044d8f75c31e1f9 P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.001s
I20260709 13:07:34.427171 26983 raft_consensus.cc:2955] T 21e14947d70440f19044d8f75c31e1f9 P 0473d2b2d01f4459b1e90fd12cc7840e [term 22 LEADER]: Committing config change with OpId 22.17: config changed from index 16 to 17, VOTER e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3) evicted. New config: { opid_index: 17 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } } }
I20260709 13:07:34.434252 20110 raft_consensus.cc:2955] T 21e14947d70440f19044d8f75c31e1f9 P 127766fc592545a4997f7790f50f6076 [term 22 FOLLOWER]: Committing config change with OpId 22.17: config changed from index 16 to 17, VOTER e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3) evicted. New config: { opid_index: 17 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } } }
I20260709 13:07:34.441229 19402 raft_consensus.cc:2955] T 21e14947d70440f19044d8f75c31e1f9 P e5256d91808b47c195bc9b4dbd7f2b87 [term 22 FOLLOWER]: Committing config change with OpId 22.17: config changed from index 16 to 17, VOTER e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3) evicted. New config: { opid_index: 17 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } } }
I20260709 13:07:34.480696 19296 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 21e14947d70440f19044d8f75c31e1f9 with cas_config_opid_index 16: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:07:34.488268 19304 catalog_manager.cc:5697] T 21e14947d70440f19044d8f75c31e1f9 P 127766fc592545a4997f7790f50f6076 reported cstate change: config changed from index 16 to 17, VOTER e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3) evicted. New cstate: current_term: 22 leader_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" committed_config { opid_index: 17 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } } }
I20260709 13:07:34.503751 27009 ts_tablet_manager.cc:1929] T 76cb037fc9064d13b59a8969d897ce8c P 0473d2b2d01f4459b1e90fd12cc7840e: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 22.14
I20260709 13:07:34.504256 27009 log.cc:1199] T 76cb037fc9064d13b59a8969d897ce8c P 0473d2b2d01f4459b1e90fd12cc7840e: Deleting WAL directory at /tmp/dist-test-taskKd2k48/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602220613947-18300-0/minicluster-data/ts-1-root/wals/76cb037fc9064d13b59a8969d897ce8c
I20260709 13:07:34.529153 19547 tablet_service.cc:1558] Processing DeleteTablet for tablet 21e14947d70440f19044d8f75c31e1f9 with delete_type TABLET_DATA_TOMBSTONED (TS e61c3a8f61bb48f8a963c9480e53c168 not found in new config with opid_index 17) from {username='slave'} at 127.0.0.1:49904
I20260709 13:07:34.530592 19296 catalog_manager.cc:5028] TS 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257): tablet 76cb037fc9064d13b59a8969d897ce8c (table test-workload [id=ce1025c73cf04c4baf25820ae7ff0a53]) successfully deleted
I20260709 13:07:34.564313 27010 tablet_replica.cc:333] T 21e14947d70440f19044d8f75c31e1f9 P e61c3a8f61bb48f8a963c9480e53c168: stopping tablet replica
I20260709 13:07:34.565538 27010 raft_consensus.cc:2243] T 21e14947d70440f19044d8f75c31e1f9 P e61c3a8f61bb48f8a963c9480e53c168 [term 22 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:34.568403 27010 raft_consensus.cc:2272] T 21e14947d70440f19044d8f75c31e1f9 P e61c3a8f61bb48f8a963c9480e53c168 [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:34.604207 27010 ts_tablet_manager.cc:1916] T 21e14947d70440f19044d8f75c31e1f9 P e61c3a8f61bb48f8a963c9480e53c168: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:07:34.663851 27010 ts_tablet_manager.cc:1929] T 21e14947d70440f19044d8f75c31e1f9 P e61c3a8f61bb48f8a963c9480e53c168: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 22.16
I20260709 13:07:34.664381 27010 log.cc:1199] T 21e14947d70440f19044d8f75c31e1f9 P e61c3a8f61bb48f8a963c9480e53c168: Deleting WAL directory at /tmp/dist-test-taskKd2k48/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602220613947-18300-0/minicluster-data/ts-2-root/wals/21e14947d70440f19044d8f75c31e1f9
I20260709 13:07:34.666335 19294 catalog_manager.cc:5028] TS e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891): tablet 21e14947d70440f19044d8f75c31e1f9 (table test-workload [id=ce1025c73cf04c4baf25820ae7ff0a53]) successfully deleted
I20260709 13:07:34.870733 18300 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:07:35.078069 19556 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2725d2c4cb054f18b0fc8f735c15f6c2"
dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
mode: GRACEFUL
new_leader_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
 from {username='slave'} at 127.0.0.1:39264
I20260709 13:07:35.078661 19556 raft_consensus.cc:606] T 2725d2c4cb054f18b0fc8f735c15f6c2 P e61c3a8f61bb48f8a963c9480e53c168 [term 22 LEADER]: Received request to transfer leadership to TS 0473d2b2d01f4459b1e90fd12cc7840e
I20260709 13:07:35.082286 19485 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "309c3ca0ca4b4f3ba129752ea2cb293b"
dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
mode: GRACEFUL
new_leader_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
 from {username='slave'} at 127.0.0.1:48168
I20260709 13:07:35.082863 19485 raft_consensus.cc:606] T 309c3ca0ca4b4f3ba129752ea2cb293b P 0473d2b2d01f4459b1e90fd12cc7840e [term 14 LEADER]: Received request to transfer leadership to TS e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:07:35.087852 19486 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7be9efa6559648dbb5a0f7684c4542d1"
dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
mode: GRACEFUL
new_leader_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
 from {username='slave'} at 127.0.0.1:48168
I20260709 13:07:35.088445 19486 raft_consensus.cc:606] T 7be9efa6559648dbb5a0f7684c4542d1 P 0473d2b2d01f4459b1e90fd12cc7840e [term 23 LEADER]: Received request to transfer leadership to TS e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:07:35.089591 18300 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 13:07:35.091611 18300 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:07:35.192516 26985 raft_consensus.cc:993] T 2725d2c4cb054f18b0fc8f735c15f6c2 P e61c3a8f61bb48f8a963c9480e53c168: : Instructing follower 0473d2b2d01f4459b1e90fd12cc7840e to start an election
I20260709 13:07:35.194046 26985 raft_consensus.cc:1081] T 2725d2c4cb054f18b0fc8f735c15f6c2 P e61c3a8f61bb48f8a963c9480e53c168 [term 22 LEADER]: Signalling peer 0473d2b2d01f4459b1e90fd12cc7840e to start an election
I20260709 13:07:35.195926 19486 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "2725d2c4cb054f18b0fc8f735c15f6c2"
dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
 from {username='slave'} at 127.0.0.1:58286
I20260709 13:07:35.196596 19486 raft_consensus.cc:493] T 2725d2c4cb054f18b0fc8f735c15f6c2 P 0473d2b2d01f4459b1e90fd12cc7840e [term 22 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:07:35.197060 19486 raft_consensus.cc:3060] T 2725d2c4cb054f18b0fc8f735c15f6c2 P 0473d2b2d01f4459b1e90fd12cc7840e [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:07:35.204452 19486 raft_consensus.cc:515] T 2725d2c4cb054f18b0fc8f735c15f6c2 P 0473d2b2d01f4459b1e90fd12cc7840e [term 23 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:07:35.207265 19402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2725d2c4cb054f18b0fc8f735c15f6c2" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 23 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: true dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
I20260709 13:07:35.207703 19556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2725d2c4cb054f18b0fc8f735c15f6c2" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 23 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: true dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:07:35.207882 19402 raft_consensus.cc:3060] T 2725d2c4cb054f18b0fc8f735c15f6c2 P e5256d91808b47c195bc9b4dbd7f2b87 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:07:35.208297 19556 raft_consensus.cc:3055] T 2725d2c4cb054f18b0fc8f735c15f6c2 P e61c3a8f61bb48f8a963c9480e53c168 [term 22 LEADER]: Stepping down as leader of term 22
I20260709 13:07:35.208627 19556 raft_consensus.cc:740] T 2725d2c4cb054f18b0fc8f735c15f6c2 P e61c3a8f61bb48f8a963c9480e53c168 [term 22 LEADER]: Becoming Follower/Learner. State: Replica: e61c3a8f61bb48f8a963c9480e53c168, State: Running, Role: LEADER
I20260709 13:07:35.209357 19556 consensus_queue.cc:260] T 2725d2c4cb054f18b0fc8f735c15f6c2 P e61c3a8f61bb48f8a963c9480e53c168 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 22.12, Last appended by leader: 12, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:07:35.210414 19556 raft_consensus.cc:3060] T 2725d2c4cb054f18b0fc8f735c15f6c2 P e61c3a8f61bb48f8a963c9480e53c168 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:07:35.206575 19486 leader_election.cc:290] T 2725d2c4cb054f18b0fc8f735c15f6c2 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 23 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:07:35.219139 19556 raft_consensus.cc:2468] T 2725d2c4cb054f18b0fc8f735c15f6c2 P e61c3a8f61bb48f8a963c9480e53c168 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 23.
I20260709 13:07:35.224315 19450 leader_election.cc:304] T 2725d2c4cb054f18b0fc8f735c15f6c2 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:07:35.225143 26987 raft_consensus.cc:2804] T 2725d2c4cb054f18b0fc8f735c15f6c2 P 0473d2b2d01f4459b1e90fd12cc7840e [term 23 FOLLOWER]: Leader election won for term 23
I20260709 13:07:35.225633 26987 raft_consensus.cc:697] T 2725d2c4cb054f18b0fc8f735c15f6c2 P 0473d2b2d01f4459b1e90fd12cc7840e [term 23 LEADER]: Becoming Leader. State: Replica: 0473d2b2d01f4459b1e90fd12cc7840e, State: Running, Role: LEADER
I20260709 13:07:35.226456 26987 consensus_queue.cc:237] T 2725d2c4cb054f18b0fc8f735c15f6c2 P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 22.12, Last appended by leader: 12, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:07:35.259920 19304 catalog_manager.cc:5697] T 2725d2c4cb054f18b0fc8f735c15f6c2 P 0473d2b2d01f4459b1e90fd12cc7840e reported cstate change: term changed from 22 to 23, leader changed from e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3) to 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2). New cstate: current_term: 23 leader_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:35.265269 19402 raft_consensus.cc:2468] T 2725d2c4cb054f18b0fc8f735c15f6c2 P e5256d91808b47c195bc9b4dbd7f2b87 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 23.
I20260709 13:07:35.385349 26983 raft_consensus.cc:993] T 7be9efa6559648dbb5a0f7684c4542d1 P 0473d2b2d01f4459b1e90fd12cc7840e: : Instructing follower e61c3a8f61bb48f8a963c9480e53c168 to start an election
I20260709 13:07:35.385919 26983 raft_consensus.cc:1081] T 7be9efa6559648dbb5a0f7684c4542d1 P 0473d2b2d01f4459b1e90fd12cc7840e [term 23 LEADER]: Signalling peer e61c3a8f61bb48f8a963c9480e53c168 to start an election
I20260709 13:07:35.395526 19559 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "7be9efa6559648dbb5a0f7684c4542d1"
dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
 from {username='slave'} at 127.0.0.1:40428
I20260709 13:07:35.396191 19559 raft_consensus.cc:493] T 7be9efa6559648dbb5a0f7684c4542d1 P e61c3a8f61bb48f8a963c9480e53c168 [term 23 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:07:35.396574 19559 raft_consensus.cc:3060] T 7be9efa6559648dbb5a0f7684c4542d1 P e61c3a8f61bb48f8a963c9480e53c168 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:07:35.404346 19559 raft_consensus.cc:515] T 7be9efa6559648dbb5a0f7684c4542d1 P e61c3a8f61bb48f8a963c9480e53c168 [term 24 FOLLOWER]: Starting forced leader election with config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:07:35.407495 19485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7be9efa6559648dbb5a0f7684c4542d1" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 24 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: true dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:07:35.408093 19485 raft_consensus.cc:3055] T 7be9efa6559648dbb5a0f7684c4542d1 P 0473d2b2d01f4459b1e90fd12cc7840e [term 23 LEADER]: Stepping down as leader of term 23
I20260709 13:07:35.408396 19485 raft_consensus.cc:740] T 7be9efa6559648dbb5a0f7684c4542d1 P 0473d2b2d01f4459b1e90fd12cc7840e [term 23 LEADER]: Becoming Follower/Learner. State: Replica: 0473d2b2d01f4459b1e90fd12cc7840e, State: Running, Role: LEADER
I20260709 13:07:35.409106 19485 consensus_queue.cc:260] T 7be9efa6559648dbb5a0f7684c4542d1 P 0473d2b2d01f4459b1e90fd12cc7840e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 23.15, Last appended by leader: 15, Current term: 23, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:07:35.410305 19485 raft_consensus.cc:3060] T 7be9efa6559648dbb5a0f7684c4542d1 P 0473d2b2d01f4459b1e90fd12cc7840e [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:07:35.416533 19559 leader_election.cc:290] T 7be9efa6559648dbb5a0f7684c4542d1 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 24 election: Requested vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:07:35.418138 20106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7be9efa6559648dbb5a0f7684c4542d1" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 24 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: true dest_uuid: "127766fc592545a4997f7790f50f6076"
I20260709 13:07:35.418704 20106 raft_consensus.cc:3060] T 7be9efa6559648dbb5a0f7684c4542d1 P 127766fc592545a4997f7790f50f6076 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:07:35.429360 19485 raft_consensus.cc:2468] T 7be9efa6559648dbb5a0f7684c4542d1 P 0473d2b2d01f4459b1e90fd12cc7840e [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 24.
I20260709 13:07:35.433775 20106 raft_consensus.cc:2468] T 7be9efa6559648dbb5a0f7684c4542d1 P 127766fc592545a4997f7790f50f6076 [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 24.
I20260709 13:07:35.435496 19523 leader_election.cc:304] T 7be9efa6559648dbb5a0f7684c4542d1 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 127766fc592545a4997f7790f50f6076, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:07:35.437453 26986 raft_consensus.cc:2804] T 7be9efa6559648dbb5a0f7684c4542d1 P e61c3a8f61bb48f8a963c9480e53c168 [term 24 FOLLOWER]: Leader election won for term 24
I20260709 13:07:35.438016 26986 raft_consensus.cc:697] T 7be9efa6559648dbb5a0f7684c4542d1 P e61c3a8f61bb48f8a963c9480e53c168 [term 24 LEADER]: Becoming Leader. State: Replica: e61c3a8f61bb48f8a963c9480e53c168, State: Running, Role: LEADER
I20260709 13:07:35.438875 26986 consensus_queue.cc:237] T 7be9efa6559648dbb5a0f7684c4542d1 P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 23.15, Last appended by leader: 15, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
W20260709 13:07:35.547981 19449 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.1:40321, user_credentials={real_user=slave}} blocked reactor thread for 99079.4us
I20260709 13:07:35.614629 19304 catalog_manager.cc:5697] T 7be9efa6559648dbb5a0f7684c4542d1 P e61c3a8f61bb48f8a963c9480e53c168 reported cstate change: term changed from 23 to 24, leader changed from 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2) to e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3). New cstate: current_term: 24 leader_uuid: "e61c3a8f61bb48f8a963c9480e53c168" committed_config { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 13:07:35.640687 19523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.4:43121, user_credentials={real_user=slave}} blocked reactor thread for 81557.1us
I20260709 13:07:35.700603 26987 raft_consensus.cc:993] T 309c3ca0ca4b4f3ba129752ea2cb293b P 0473d2b2d01f4459b1e90fd12cc7840e: : Instructing follower e5256d91808b47c195bc9b4dbd7f2b87 to start an election
W20260709 13:07:35.700696 19523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.1:40321, user_credentials={real_user=slave}} blocked reactor thread for 50342.3us
I20260709 13:07:35.701196 26987 raft_consensus.cc:1081] T 309c3ca0ca4b4f3ba129752ea2cb293b P 0473d2b2d01f4459b1e90fd12cc7840e [term 14 LEADER]: Signalling peer e5256d91808b47c195bc9b4dbd7f2b87 to start an election
I20260709 13:07:35.704041 19406 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "309c3ca0ca4b4f3ba129752ea2cb293b"
dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
 from {username='slave'} at 127.0.0.1:52342
I20260709 13:07:35.704597 19406 raft_consensus.cc:493] T 309c3ca0ca4b4f3ba129752ea2cb293b P e5256d91808b47c195bc9b4dbd7f2b87 [term 14 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:07:35.704972 19406 raft_consensus.cc:3060] T 309c3ca0ca4b4f3ba129752ea2cb293b P e5256d91808b47c195bc9b4dbd7f2b87 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:07:35.729056 19406 raft_consensus.cc:515] T 309c3ca0ca4b4f3ba129752ea2cb293b P e5256d91808b47c195bc9b4dbd7f2b87 [term 15 FOLLOWER]: Starting forced leader election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
W20260709 13:07:35.734944 19377 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.2:46257, user_credentials={real_user=slave}} blocked reactor thread for 86154.3us
I20260709 13:07:35.739406 19485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "309c3ca0ca4b4f3ba129752ea2cb293b" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: true dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:07:35.739974 19485 raft_consensus.cc:3055] T 309c3ca0ca4b4f3ba129752ea2cb293b P 0473d2b2d01f4459b1e90fd12cc7840e [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:07:35.740240 19485 raft_consensus.cc:740] T 309c3ca0ca4b4f3ba129752ea2cb293b P 0473d2b2d01f4459b1e90fd12cc7840e [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 0473d2b2d01f4459b1e90fd12cc7840e, State: Running, Role: LEADER
I20260709 13:07:35.740923 19485 consensus_queue.cc:260] T 309c3ca0ca4b4f3ba129752ea2cb293b P 0473d2b2d01f4459b1e90fd12cc7840e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 14.13, Last appended by leader: 13, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:07:35.742029 19485 raft_consensus.cc:3060] T 309c3ca0ca4b4f3ba129752ea2cb293b P 0473d2b2d01f4459b1e90fd12cc7840e [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:07:35.736156 19406 leader_election.cc:290] T 309c3ca0ca4b4f3ba129752ea2cb293b P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 15 election: Requested vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:07:35.753249 19485 raft_consensus.cc:2468] T 309c3ca0ca4b4f3ba129752ea2cb293b P 0473d2b2d01f4459b1e90fd12cc7840e [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 15.
I20260709 13:07:35.754451 19406 raft_consensus.cc:1275] T 2725d2c4cb054f18b0fc8f735c15f6c2 P e5256d91808b47c195bc9b4dbd7f2b87 [term 23 FOLLOWER]: Refusing update from remote peer 0473d2b2d01f4459b1e90fd12cc7840e: Log matching property violated. Preceding OpId in replica: term: 22 index: 12. Preceding OpId from leader: term: 23 index: 13. (index mismatch)
I20260709 13:07:35.758288 19560 raft_consensus.cc:1275] T 2725d2c4cb054f18b0fc8f735c15f6c2 P e61c3a8f61bb48f8a963c9480e53c168 [term 23 FOLLOWER]: Refusing update from remote peer 0473d2b2d01f4459b1e90fd12cc7840e: Log matching property violated. Preceding OpId in replica: term: 22 index: 12. Preceding OpId from leader: term: 23 index: 13. (index mismatch)
W20260709 13:07:35.760402 19526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.2:46257, user_credentials={real_user=slave}} blocked reactor thread for 109458us
I20260709 13:07:35.761688 19377 leader_election.cc:304] T 309c3ca0ca4b4f3ba129752ea2cb293b P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87; no voters: 
I20260709 13:07:35.767961 26987 consensus_queue.cc:1048] T 2725d2c4cb054f18b0fc8f735c15f6c2 P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:07:35.773510 27020 consensus_queue.cc:1048] T 2725d2c4cb054f18b0fc8f735c15f6c2 P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:07:35.783152 20110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "309c3ca0ca4b4f3ba129752ea2cb293b" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: true dest_uuid: "127766fc592545a4997f7790f50f6076"
I20260709 13:07:35.783757 20110 raft_consensus.cc:3060] T 309c3ca0ca4b4f3ba129752ea2cb293b P 127766fc592545a4997f7790f50f6076 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:07:35.786880 27026 raft_consensus.cc:2804] T 309c3ca0ca4b4f3ba129752ea2cb293b P e5256d91808b47c195bc9b4dbd7f2b87 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:07:35.788635 27026 raft_consensus.cc:697] T 309c3ca0ca4b4f3ba129752ea2cb293b P e5256d91808b47c195bc9b4dbd7f2b87 [term 15 LEADER]: Becoming Leader. State: Replica: e5256d91808b47c195bc9b4dbd7f2b87, State: Running, Role: LEADER
I20260709 13:07:35.789513 27026 consensus_queue.cc:237] T 309c3ca0ca4b4f3ba129752ea2cb293b P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 14.13, Last appended by leader: 13, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:07:35.799362 20110 raft_consensus.cc:2468] T 309c3ca0ca4b4f3ba129752ea2cb293b P 127766fc592545a4997f7790f50f6076 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 15.
I20260709 13:07:35.832158 19304 catalog_manager.cc:5697] T 309c3ca0ca4b4f3ba129752ea2cb293b P e5256d91808b47c195bc9b4dbd7f2b87 reported cstate change: term changed from 14 to 15, leader changed from 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2) to e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1). New cstate: current_term: 15 leader_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 13:07:35.883641 19374 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.4:43121, user_credentials={real_user=slave}} blocked reactor thread for 51270.6us
I20260709 13:07:35.909847 20110 raft_consensus.cc:1275] T 7be9efa6559648dbb5a0f7684c4542d1 P 127766fc592545a4997f7790f50f6076 [term 24 FOLLOWER]: Refusing update from remote peer e61c3a8f61bb48f8a963c9480e53c168: Log matching property violated. Preceding OpId in replica: term: 23 index: 15. Preceding OpId from leader: term: 24 index: 16. (index mismatch)
I20260709 13:07:35.918268 27018 consensus_queue.cc:1048] T 7be9efa6559648dbb5a0f7684c4542d1 P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Connected to new peer: Peer: permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.000s
I20260709 13:07:35.927033 19406 consensus_queue.cc:237] T d1e5873a19244c5ebbcd38e126796ee7 P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 22.11, Last appended by leader: 10, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } attrs { replace: true } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: NON_VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: true } }
W20260709 13:07:35.950299 19374 consensus_peers.cc:597] T d1e5873a19244c5ebbcd38e126796ee7 P e5256d91808b47c195bc9b4dbd7f2b87 -> Peer 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121): Couldn't send request to peer 127766fc592545a4997f7790f50f6076. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: d1e5873a19244c5ebbcd38e126796ee7. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:07:35.953425 19560 raft_consensus.cc:1275] T d1e5873a19244c5ebbcd38e126796ee7 P e61c3a8f61bb48f8a963c9480e53c168 [term 22 FOLLOWER]: Refusing update from remote peer e5256d91808b47c195bc9b4dbd7f2b87: Log matching property violated. Preceding OpId in replica: term: 22 index: 11. Preceding OpId from leader: term: 22 index: 12. (index mismatch)
I20260709 13:07:35.955034 27033 consensus_queue.cc:1048] T d1e5873a19244c5ebbcd38e126796ee7 P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:07:35.962350 19480 raft_consensus.cc:1275] T 7be9efa6559648dbb5a0f7684c4542d1 P 0473d2b2d01f4459b1e90fd12cc7840e [term 24 FOLLOWER]: Refusing update from remote peer e61c3a8f61bb48f8a963c9480e53c168: Log matching property violated. Preceding OpId in replica: term: 23 index: 15. Preceding OpId from leader: term: 24 index: 16. (index mismatch)
I20260709 13:07:35.966471 27018 consensus_queue.cc:1048] T 7be9efa6559648dbb5a0f7684c4542d1 P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.000s
I20260709 13:07:35.973832 19481 raft_consensus.cc:1275] T d1e5873a19244c5ebbcd38e126796ee7 P 0473d2b2d01f4459b1e90fd12cc7840e [term 22 FOLLOWER]: Refusing update from remote peer e5256d91808b47c195bc9b4dbd7f2b87: Log matching property violated. Preceding OpId in replica: term: 22 index: 11. Preceding OpId from leader: term: 22 index: 12. (index mismatch)
I20260709 13:07:35.975549 26961 consensus_queue.cc:1048] T d1e5873a19244c5ebbcd38e126796ee7 P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:07:36.061237 27026 raft_consensus.cc:2955] T d1e5873a19244c5ebbcd38e126796ee7 P e5256d91808b47c195bc9b4dbd7f2b87 [term 22 LEADER]: Committing config change with OpId 22.12: config changed from index -1 to 12, NON_VOTER 127766fc592545a4997f7790f50f6076 (127.17.223.4) added. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } attrs { replace: true } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: NON_VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: true } } }
I20260709 13:07:36.070535 19481 raft_consensus.cc:2955] T d1e5873a19244c5ebbcd38e126796ee7 P 0473d2b2d01f4459b1e90fd12cc7840e [term 22 FOLLOWER]: Committing config change with OpId 22.12: config changed from index -1 to 12, NON_VOTER 127766fc592545a4997f7790f50f6076 (127.17.223.4) added. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } attrs { replace: true } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: NON_VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: true } } }
I20260709 13:07:36.081261 19483 consensus_queue.cc:237] T fa8650e71aa14778b3d73721fc50d9fc P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 22.13, Last appended by leader: 12, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } attrs { replace: true } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: NON_VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: true } }
I20260709 13:07:36.078492 19560 raft_consensus.cc:2955] T d1e5873a19244c5ebbcd38e126796ee7 P e61c3a8f61bb48f8a963c9480e53c168 [term 22 FOLLOWER]: Committing config change with OpId 22.12: config changed from index -1 to 12, NON_VOTER 127766fc592545a4997f7790f50f6076 (127.17.223.4) added. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } attrs { replace: true } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: NON_VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: true } } }
I20260709 13:07:36.092600 18300 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:07:36.105782 19301 catalog_manager.cc:5697] T d1e5873a19244c5ebbcd38e126796ee7 P e5256d91808b47c195bc9b4dbd7f2b87 reported cstate change: config changed from index -1 to 12, NON_VOTER 127766fc592545a4997f7790f50f6076 (127.17.223.4) added. New cstate: current_term: 22 leader_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" committed_config { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: NON_VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:36.161079 19559 raft_consensus.cc:1275] T fa8650e71aa14778b3d73721fc50d9fc P e61c3a8f61bb48f8a963c9480e53c168 [term 22 FOLLOWER]: Refusing update from remote peer 0473d2b2d01f4459b1e90fd12cc7840e: Log matching property violated. Preceding OpId in replica: term: 22 index: 13. Preceding OpId from leader: term: 22 index: 14. (index mismatch)
I20260709 13:07:36.162868 27019 consensus_queue.cc:1048] T fa8650e71aa14778b3d73721fc50d9fc P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
W20260709 13:07:36.164024 19449 consensus_peers.cc:597] T fa8650e71aa14778b3d73721fc50d9fc P 0473d2b2d01f4459b1e90fd12cc7840e -> Peer 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121): Couldn't send request to peer 127766fc592545a4997f7790f50f6076. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: fa8650e71aa14778b3d73721fc50d9fc. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:07:36.166606 19402 raft_consensus.cc:1275] T fa8650e71aa14778b3d73721fc50d9fc P e5256d91808b47c195bc9b4dbd7f2b87 [term 22 FOLLOWER]: Refusing update from remote peer 0473d2b2d01f4459b1e90fd12cc7840e: Log matching property violated. Preceding OpId in replica: term: 22 index: 13. Preceding OpId from leader: term: 22 index: 14. (index mismatch)
I20260709 13:07:36.169740 27020 consensus_queue.cc:1048] T fa8650e71aa14778b3d73721fc50d9fc P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:07:36.187170 27027 raft_consensus.cc:2955] T fa8650e71aa14778b3d73721fc50d9fc P 0473d2b2d01f4459b1e90fd12cc7840e [term 22 LEADER]: Committing config change with OpId 22.14: config changed from index -1 to 14, NON_VOTER 127766fc592545a4997f7790f50f6076 (127.17.223.4) added. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } attrs { replace: true } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: NON_VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: true } } }
I20260709 13:07:36.212237 19560 raft_consensus.cc:2955] T fa8650e71aa14778b3d73721fc50d9fc P e61c3a8f61bb48f8a963c9480e53c168 [term 22 FOLLOWER]: Committing config change with OpId 22.14: config changed from index -1 to 14, NON_VOTER 127766fc592545a4997f7790f50f6076 (127.17.223.4) added. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } attrs { replace: true } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: NON_VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: true } } }
I20260709 13:07:36.219244 19483 raft_consensus.cc:1275] T 309c3ca0ca4b4f3ba129752ea2cb293b P 0473d2b2d01f4459b1e90fd12cc7840e [term 15 FOLLOWER]: Refusing update from remote peer e5256d91808b47c195bc9b4dbd7f2b87: Log matching property violated. Preceding OpId in replica: term: 14 index: 13. Preceding OpId from leader: term: 15 index: 14. (index mismatch)
I20260709 13:07:36.220633 27030 consensus_queue.cc:1048] T 309c3ca0ca4b4f3ba129752ea2cb293b P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:07:36.228096 19411 raft_consensus.cc:2955] T fa8650e71aa14778b3d73721fc50d9fc P e5256d91808b47c195bc9b4dbd7f2b87 [term 22 FOLLOWER]: Committing config change with OpId 22.14: config changed from index -1 to 14, NON_VOTER 127766fc592545a4997f7790f50f6076 (127.17.223.4) added. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } attrs { replace: true } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: NON_VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: true } } }
I20260709 13:07:36.262040 19301 catalog_manager.cc:5697] T fa8650e71aa14778b3d73721fc50d9fc P e5256d91808b47c195bc9b4dbd7f2b87 reported cstate change: config changed from index -1 to 14, NON_VOTER 127766fc592545a4997f7790f50f6076 (127.17.223.4) added. New cstate: current_term: 22 leader_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" committed_config { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } attrs { replace: true } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: NON_VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: true } } }
I20260709 13:07:36.271484 20112 raft_consensus.cc:1275] T 309c3ca0ca4b4f3ba129752ea2cb293b P 127766fc592545a4997f7790f50f6076 [term 15 FOLLOWER]: Refusing update from remote peer e5256d91808b47c195bc9b4dbd7f2b87: Log matching property violated. Preceding OpId in replica: term: 14 index: 13. Preceding OpId from leader: term: 15 index: 14. (index mismatch)
I20260709 13:07:36.274076 27026 consensus_queue.cc:1048] T 309c3ca0ca4b4f3ba129752ea2cb293b P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Connected to new peer: Peer: permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:07:36.286104 19560 consensus_queue.cc:237] T bc225c93219c45538b53a1bd3d387e4d P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.11, Last appended by leader: 10, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } attrs { replace: true } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: NON_VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: true } }
I20260709 13:07:36.322002 19483 raft_consensus.cc:1275] T bc225c93219c45538b53a1bd3d387e4d P 0473d2b2d01f4459b1e90fd12cc7840e [term 18 FOLLOWER]: Refusing update from remote peer e61c3a8f61bb48f8a963c9480e53c168: Log matching property violated. Preceding OpId in replica: term: 18 index: 11. Preceding OpId from leader: term: 18 index: 12. (index mismatch)
W20260709 13:07:36.328531 20075 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.1:40321, user_credentials={real_user=slave}} blocked reactor thread for 53042.1us
W20260709 13:07:36.342185 19523 consensus_peers.cc:597] T bc225c93219c45538b53a1bd3d387e4d P e61c3a8f61bb48f8a963c9480e53c168 -> Peer 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121): Couldn't send request to peer 127766fc592545a4997f7790f50f6076. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: bc225c93219c45538b53a1bd3d387e4d. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:07:36.343698 19411 raft_consensus.cc:1275] T bc225c93219c45538b53a1bd3d387e4d P e5256d91808b47c195bc9b4dbd7f2b87 [term 18 FOLLOWER]: Refusing update from remote peer e61c3a8f61bb48f8a963c9480e53c168: Log matching property violated. Preceding OpId in replica: term: 18 index: 11. Preceding OpId from leader: term: 18 index: 12. (index mismatch)
I20260709 13:07:36.345894 27017 consensus_queue.cc:1048] T bc225c93219c45538b53a1bd3d387e4d P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:07:36.372437 27018 consensus_queue.cc:1048] T bc225c93219c45538b53a1bd3d387e4d P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:07:36.399264 27017 raft_consensus.cc:2955] T bc225c93219c45538b53a1bd3d387e4d P e61c3a8f61bb48f8a963c9480e53c168 [term 18 LEADER]: Committing config change with OpId 18.12: config changed from index -1 to 12, NON_VOTER 127766fc592545a4997f7790f50f6076 (127.17.223.4) added. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } attrs { replace: true } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: NON_VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: true } } }
I20260709 13:07:36.400833 19481 raft_consensus.cc:2955] T bc225c93219c45538b53a1bd3d387e4d P 0473d2b2d01f4459b1e90fd12cc7840e [term 18 FOLLOWER]: Committing config change with OpId 18.12: config changed from index -1 to 12, NON_VOTER 127766fc592545a4997f7790f50f6076 (127.17.223.4) added. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } attrs { replace: true } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: NON_VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: true } } }
I20260709 13:07:36.414932 19402 raft_consensus.cc:2955] T bc225c93219c45538b53a1bd3d387e4d P e5256d91808b47c195bc9b4dbd7f2b87 [term 18 FOLLOWER]: Committing config change with OpId 18.12: config changed from index -1 to 12, NON_VOTER 127766fc592545a4997f7790f50f6076 (127.17.223.4) added. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } attrs { replace: true } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: NON_VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: true } } }
I20260709 13:07:36.425484 19301 catalog_manager.cc:5697] T bc225c93219c45538b53a1bd3d387e4d P 0473d2b2d01f4459b1e90fd12cc7840e reported cstate change: config changed from index -1 to 12, NON_VOTER 127766fc592545a4997f7790f50f6076 (127.17.223.4) added. New cstate: current_term: 18 leader_uuid: "e61c3a8f61bb48f8a963c9480e53c168" committed_config { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } attrs { replace: true } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: NON_VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: true } } }
I20260709 13:07:36.444828 19560 consensus_queue.cc:237] T b9f0d59553ad444883fcf5b5909f9798 P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.11, Last appended by leader: 10, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } attrs { replace: true } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: NON_VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: true } }
I20260709 13:07:36.514451 19483 raft_consensus.cc:1275] T b9f0d59553ad444883fcf5b5909f9798 P 0473d2b2d01f4459b1e90fd12cc7840e [term 16 FOLLOWER]: Refusing update from remote peer e61c3a8f61bb48f8a963c9480e53c168: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 13:07:36.516233 26985 consensus_queue.cc:1048] T b9f0d59553ad444883fcf5b5909f9798 P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
W20260709 13:07:36.524652 19523 consensus_peers.cc:597] T b9f0d59553ad444883fcf5b5909f9798 P e61c3a8f61bb48f8a963c9480e53c168 -> Peer 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121): Couldn't send request to peer 127766fc592545a4997f7790f50f6076. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: b9f0d59553ad444883fcf5b5909f9798. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:07:36.526037 19411 raft_consensus.cc:1275] T b9f0d59553ad444883fcf5b5909f9798 P e5256d91808b47c195bc9b4dbd7f2b87 [term 16 FOLLOWER]: Refusing update from remote peer e61c3a8f61bb48f8a963c9480e53c168: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 13:07:36.529621 27021 consensus_queue.cc:1048] T b9f0d59553ad444883fcf5b5909f9798 P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:07:36.545469 27060 ts_tablet_manager.cc:933] T d1e5873a19244c5ebbcd38e126796ee7 P 127766fc592545a4997f7790f50f6076: Initiating tablet copy from peer e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321)
I20260709 13:07:36.553205 27021 raft_consensus.cc:2955] T b9f0d59553ad444883fcf5b5909f9798 P e61c3a8f61bb48f8a963c9480e53c168 [term 16 LEADER]: Committing config change with OpId 16.12: config changed from index -1 to 12, NON_VOTER 127766fc592545a4997f7790f50f6076 (127.17.223.4) added. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } attrs { replace: true } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: NON_VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: true } } }
I20260709 13:07:36.555711 19411 raft_consensus.cc:2955] T b9f0d59553ad444883fcf5b5909f9798 P e5256d91808b47c195bc9b4dbd7f2b87 [term 16 FOLLOWER]: Committing config change with OpId 16.12: config changed from index -1 to 12, NON_VOTER 127766fc592545a4997f7790f50f6076 (127.17.223.4) added. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } attrs { replace: true } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: NON_VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: true } } }
I20260709 13:07:36.581539 19301 catalog_manager.cc:5697] T b9f0d59553ad444883fcf5b5909f9798 P e5256d91808b47c195bc9b4dbd7f2b87 reported cstate change: config changed from index -1 to 12, NON_VOTER 127766fc592545a4997f7790f50f6076 (127.17.223.4) added. New cstate: current_term: 16 leader_uuid: "e61c3a8f61bb48f8a963c9480e53c168" committed_config { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } attrs { replace: true } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: NON_VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: true } } }
I20260709 13:07:36.583336 19483 raft_consensus.cc:2955] T b9f0d59553ad444883fcf5b5909f9798 P 0473d2b2d01f4459b1e90fd12cc7840e [term 16 FOLLOWER]: Committing config change with OpId 16.12: config changed from index -1 to 12, NON_VOTER 127766fc592545a4997f7790f50f6076 (127.17.223.4) added. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } attrs { replace: true } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: NON_VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: true } } }
I20260709 13:07:36.659179 27062 ts_tablet_manager.cc:933] T fa8650e71aa14778b3d73721fc50d9fc P 127766fc592545a4997f7790f50f6076: Initiating tablet copy from peer 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:07:36.663254 27060 tablet_copy_client.cc:323] T d1e5873a19244c5ebbcd38e126796ee7 P 127766fc592545a4997f7790f50f6076: tablet copy: Beginning tablet copy session from remote peer at address 127.17.223.1:40321
I20260709 13:07:36.666206 19421 tablet_copy_service.cc:140] P e5256d91808b47c195bc9b4dbd7f2b87: Received BeginTabletCopySession request for tablet d1e5873a19244c5ebbcd38e126796ee7 from peer 127766fc592545a4997f7790f50f6076 ({username='slave'} at 127.0.0.1:49050)
I20260709 13:07:36.666831 19421 tablet_copy_service.cc:161] P e5256d91808b47c195bc9b4dbd7f2b87: Beginning new tablet copy session on tablet d1e5873a19244c5ebbcd38e126796ee7 from peer 127766fc592545a4997f7790f50f6076 at {username='slave'} at 127.0.0.1:49050: session id = 127766fc592545a4997f7790f50f6076-d1e5873a19244c5ebbcd38e126796ee7
I20260709 13:07:36.676453 19421 tablet_copy_source_session.cc:215] T d1e5873a19244c5ebbcd38e126796ee7 P e5256d91808b47c195bc9b4dbd7f2b87: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:07:36.680760 27060 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d1e5873a19244c5ebbcd38e126796ee7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:36.743125 27062 tablet_copy_client.cc:323] T fa8650e71aa14778b3d73721fc50d9fc P 127766fc592545a4997f7790f50f6076: tablet copy: Beginning tablet copy session from remote peer at address 127.17.223.2:46257
I20260709 13:07:36.746160 19496 tablet_copy_service.cc:140] P 0473d2b2d01f4459b1e90fd12cc7840e: Received BeginTabletCopySession request for tablet fa8650e71aa14778b3d73721fc50d9fc from peer 127766fc592545a4997f7790f50f6076 ({username='slave'} at 127.0.0.1:39478)
I20260709 13:07:36.746739 19496 tablet_copy_service.cc:161] P 0473d2b2d01f4459b1e90fd12cc7840e: Beginning new tablet copy session on tablet fa8650e71aa14778b3d73721fc50d9fc from peer 127766fc592545a4997f7790f50f6076 at {username='slave'} at 127.0.0.1:39478: session id = 127766fc592545a4997f7790f50f6076-fa8650e71aa14778b3d73721fc50d9fc
I20260709 13:07:36.755268 19496 tablet_copy_source_session.cc:215] T fa8650e71aa14778b3d73721fc50d9fc P 0473d2b2d01f4459b1e90fd12cc7840e: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:07:36.787509 27064 ts_tablet_manager.cc:933] T bc225c93219c45538b53a1bd3d387e4d P 127766fc592545a4997f7790f50f6076: Initiating tablet copy from peer e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:07:36.787992 27062 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fa8650e71aa14778b3d73721fc50d9fc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:36.801401 27064 tablet_copy_client.cc:323] T bc225c93219c45538b53a1bd3d387e4d P 127766fc592545a4997f7790f50f6076: tablet copy: Beginning tablet copy session from remote peer at address 127.17.223.3:36891
I20260709 13:07:36.803231 27060 tablet_copy_client.cc:806] T d1e5873a19244c5ebbcd38e126796ee7 P 127766fc592545a4997f7790f50f6076: tablet copy: Starting download of 0 data blocks...
I20260709 13:07:36.803287 19570 tablet_copy_service.cc:140] P e61c3a8f61bb48f8a963c9480e53c168: Received BeginTabletCopySession request for tablet bc225c93219c45538b53a1bd3d387e4d from peer 127766fc592545a4997f7790f50f6076 ({username='slave'} at 127.0.0.1:41504)
I20260709 13:07:36.804025 19570 tablet_copy_service.cc:161] P e61c3a8f61bb48f8a963c9480e53c168: Beginning new tablet copy session on tablet bc225c93219c45538b53a1bd3d387e4d from peer 127766fc592545a4997f7790f50f6076 at {username='slave'} at 127.0.0.1:41504: session id = 127766fc592545a4997f7790f50f6076-bc225c93219c45538b53a1bd3d387e4d
I20260709 13:07:36.804073 27060 tablet_copy_client.cc:670] T d1e5873a19244c5ebbcd38e126796ee7 P 127766fc592545a4997f7790f50f6076: tablet copy: Starting download of 1 WAL segments...
I20260709 13:07:36.811664 19570 tablet_copy_source_session.cc:215] T bc225c93219c45538b53a1bd3d387e4d P e61c3a8f61bb48f8a963c9480e53c168: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:07:36.823217 27064 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bc225c93219c45538b53a1bd3d387e4d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:36.826049 27060 tablet_copy_client.cc:538] T d1e5873a19244c5ebbcd38e126796ee7 P 127766fc592545a4997f7790f50f6076: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:07:36.869520 27060 tablet_bootstrap.cc:492] T d1e5873a19244c5ebbcd38e126796ee7 P 127766fc592545a4997f7790f50f6076: Bootstrap starting.
I20260709 13:07:36.885345 27062 tablet_copy_client.cc:806] T fa8650e71aa14778b3d73721fc50d9fc P 127766fc592545a4997f7790f50f6076: tablet copy: Starting download of 0 data blocks...
I20260709 13:07:36.886842 27062 tablet_copy_client.cc:670] T fa8650e71aa14778b3d73721fc50d9fc P 127766fc592545a4997f7790f50f6076: tablet copy: Starting download of 1 WAL segments...
I20260709 13:07:36.894708 27062 tablet_copy_client.cc:538] T fa8650e71aa14778b3d73721fc50d9fc P 127766fc592545a4997f7790f50f6076: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:07:36.898617 27064 tablet_copy_client.cc:806] T bc225c93219c45538b53a1bd3d387e4d P 127766fc592545a4997f7790f50f6076: tablet copy: Starting download of 0 data blocks...
I20260709 13:07:36.899214 27064 tablet_copy_client.cc:670] T bc225c93219c45538b53a1bd3d387e4d P 127766fc592545a4997f7790f50f6076: tablet copy: Starting download of 1 WAL segments...
I20260709 13:07:36.902716 27064 tablet_copy_client.cc:538] T bc225c93219c45538b53a1bd3d387e4d P 127766fc592545a4997f7790f50f6076: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:07:36.924404 27062 tablet_bootstrap.cc:492] T fa8650e71aa14778b3d73721fc50d9fc P 127766fc592545a4997f7790f50f6076: Bootstrap starting.
I20260709 13:07:36.935911 27064 tablet_bootstrap.cc:492] T bc225c93219c45538b53a1bd3d387e4d P 127766fc592545a4997f7790f50f6076: Bootstrap starting.
I20260709 13:07:37.053299 27067 ts_tablet_manager.cc:933] T b9f0d59553ad444883fcf5b5909f9798 P 127766fc592545a4997f7790f50f6076: Initiating tablet copy from peer e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
W20260709 13:07:37.090835 19450 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.3:36891, user_credentials={real_user=slave}} blocked reactor thread for 75519.5us
I20260709 13:07:37.183655 27067 tablet_copy_client.cc:323] T b9f0d59553ad444883fcf5b5909f9798 P 127766fc592545a4997f7790f50f6076: tablet copy: Beginning tablet copy session from remote peer at address 127.17.223.3:36891
W20260709 13:07:37.228957 19523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.1:40321, user_credentials={real_user=slave}} blocked reactor thread for 85015us
W20260709 13:07:37.230414 19375 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.3:36891, user_credentials={real_user=slave}} blocked reactor thread for 47043.7us
I20260709 13:07:37.287846 18300 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:07:37.289150 19570 tablet_copy_service.cc:140] P e61c3a8f61bb48f8a963c9480e53c168: Received BeginTabletCopySession request for tablet b9f0d59553ad444883fcf5b5909f9798 from peer 127766fc592545a4997f7790f50f6076 ({username='slave'} at 127.0.0.1:41504)
I20260709 13:07:37.289638 19570 tablet_copy_service.cc:161] P e61c3a8f61bb48f8a963c9480e53c168: Beginning new tablet copy session on tablet b9f0d59553ad444883fcf5b5909f9798 from peer 127766fc592545a4997f7790f50f6076 at {username='slave'} at 127.0.0.1:41504: session id = 127766fc592545a4997f7790f50f6076-b9f0d59553ad444883fcf5b5909f9798
I20260709 13:07:37.305716 19570 tablet_copy_source_session.cc:215] T b9f0d59553ad444883fcf5b5909f9798 P e61c3a8f61bb48f8a963c9480e53c168: Tablet Copy: opened 0 blocks and 1 log segments
W20260709 13:07:37.288975 27060 log.cc:927] Time spent T d1e5873a19244c5ebbcd38e126796ee7 P 127766fc592545a4997f7790f50f6076: Append to log took a long time: real 0.106s	user 0.004s	sys 0.000s
I20260709 13:07:37.404420 27067 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b9f0d59553ad444883fcf5b5909f9798. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:37.509087 19560 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "28af091831594f9d8e96482078cc7625"
dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
mode: GRACEFUL
new_leader_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
 from {username='slave'} at 127.0.0.1:39264
I20260709 13:07:37.509704 19560 raft_consensus.cc:606] T 28af091831594f9d8e96482078cc7625 P e61c3a8f61bb48f8a963c9480e53c168 [term 19 LEADER]: Received request to transfer leadership to TS e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:07:37.512624 19411 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7f575b143b844aa096b50997dad3516a"
dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
mode: GRACEFUL
new_leader_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
 from {username='slave'} at 127.0.0.1:37312
I20260709 13:07:37.513203 19411 raft_consensus.cc:606] T 7f575b143b844aa096b50997dad3516a P e5256d91808b47c195bc9b4dbd7f2b87 [term 20 LEADER]: Received request to transfer leadership to TS 0473d2b2d01f4459b1e90fd12cc7840e
I20260709 13:07:37.519372 27067 tablet_copy_client.cc:806] T b9f0d59553ad444883fcf5b5909f9798 P 127766fc592545a4997f7790f50f6076: tablet copy: Starting download of 0 data blocks...
I20260709 13:07:37.520071 27067 tablet_copy_client.cc:670] T b9f0d59553ad444883fcf5b5909f9798 P 127766fc592545a4997f7790f50f6076: tablet copy: Starting download of 1 WAL segments...
I20260709 13:07:37.520169 19480 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "96efeaaf1057492490e9a621f37e1a2d"
dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
mode: GRACEFUL
new_leader_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
 from {username='slave'} at 127.0.0.1:48168
I20260709 13:07:37.520830 19480 raft_consensus.cc:606] T 96efeaaf1057492490e9a621f37e1a2d P 0473d2b2d01f4459b1e90fd12cc7840e [term 21 LEADER]: Received request to transfer leadership to TS e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:07:37.530977 18300 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 13:07:37.536958 18300 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:07:37.547346 27067 tablet_copy_client.cc:538] T b9f0d59553ad444883fcf5b5909f9798 P 127766fc592545a4997f7790f50f6076: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:07:37.550227 27064 tablet_bootstrap.cc:492] T bc225c93219c45538b53a1bd3d387e4d P 127766fc592545a4997f7790f50f6076: Bootstrap replayed 1/1 log segments. Stats: ops{read=12 overwritten=0 applied=12 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:07:37.554484 27069 raft_consensus.cc:993] T 28af091831594f9d8e96482078cc7625 P e61c3a8f61bb48f8a963c9480e53c168: : Instructing follower e5256d91808b47c195bc9b4dbd7f2b87 to start an election
I20260709 13:07:37.555680 27083 raft_consensus.cc:1081] T 28af091831594f9d8e96482078cc7625 P e61c3a8f61bb48f8a963c9480e53c168 [term 19 LEADER]: Signalling peer e5256d91808b47c195bc9b4dbd7f2b87 to start an election
I20260709 13:07:37.559078 19402 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "28af091831594f9d8e96482078cc7625"
dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
 from {username='slave'} at 127.0.0.1:52328
I20260709 13:07:37.559613 19402 raft_consensus.cc:493] T 28af091831594f9d8e96482078cc7625 P e5256d91808b47c195bc9b4dbd7f2b87 [term 19 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:07:37.559947 19402 raft_consensus.cc:3060] T 28af091831594f9d8e96482078cc7625 P e5256d91808b47c195bc9b4dbd7f2b87 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:07:37.567458 19402 raft_consensus.cc:515] T 28af091831594f9d8e96482078cc7625 P e5256d91808b47c195bc9b4dbd7f2b87 [term 20 FOLLOWER]: Starting forced leader election with config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:07:37.571339 27064 tablet_bootstrap.cc:492] T bc225c93219c45538b53a1bd3d387e4d P 127766fc592545a4997f7790f50f6076: Bootstrap complete.
W20260709 13:07:37.594026 27062 log.cc:927] Time spent T fa8650e71aa14778b3d73721fc50d9fc P 127766fc592545a4997f7790f50f6076: Append to log took a long time: real 0.055s	user 0.000s	sys 0.001s
I20260709 13:07:37.594628 27060 tablet_bootstrap.cc:492] T d1e5873a19244c5ebbcd38e126796ee7 P 127766fc592545a4997f7790f50f6076: Bootstrap replayed 1/1 log segments. Stats: ops{read=13 overwritten=1 applied=12 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:07:37.600968 19402 leader_election.cc:290] T 28af091831594f9d8e96482078cc7625 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 20 election: Requested vote from peers e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:07:37.601863 19556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28af091831594f9d8e96482078cc7625" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: true dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:07:37.602449 19556 raft_consensus.cc:3055] T 28af091831594f9d8e96482078cc7625 P e61c3a8f61bb48f8a963c9480e53c168 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:07:37.602936 19556 raft_consensus.cc:740] T 28af091831594f9d8e96482078cc7625 P e61c3a8f61bb48f8a963c9480e53c168 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: e61c3a8f61bb48f8a963c9480e53c168, State: Running, Role: LEADER
I20260709 13:07:37.603648 19556 consensus_queue.cc:260] T 28af091831594f9d8e96482078cc7625 P e61c3a8f61bb48f8a963c9480e53c168 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 19.14, Last appended by leader: 14, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:07:37.604805 19556 raft_consensus.cc:3060] T 28af091831594f9d8e96482078cc7625 P e61c3a8f61bb48f8a963c9480e53c168 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:07:37.607703 20112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28af091831594f9d8e96482078cc7625" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: true dest_uuid: "127766fc592545a4997f7790f50f6076"
I20260709 13:07:37.608302 20112 raft_consensus.cc:3060] T 28af091831594f9d8e96482078cc7625 P 127766fc592545a4997f7790f50f6076 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:07:37.600009 27064 ts_tablet_manager.cc:1403] T bc225c93219c45538b53a1bd3d387e4d P 127766fc592545a4997f7790f50f6076: Time spent bootstrapping tablet: real 0.664s	user 0.059s	sys 0.039s
I20260709 13:07:37.620812 19556 raft_consensus.cc:2468] T 28af091831594f9d8e96482078cc7625 P e61c3a8f61bb48f8a963c9480e53c168 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 20.
I20260709 13:07:37.622040 19375 leader_election.cc:304] T 28af091831594f9d8e96482078cc7625 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:07:37.627399 27060 tablet_bootstrap.cc:492] T d1e5873a19244c5ebbcd38e126796ee7 P 127766fc592545a4997f7790f50f6076: Bootstrap complete.
I20260709 13:07:37.624116 27079 raft_consensus.cc:2804] T 28af091831594f9d8e96482078cc7625 P e5256d91808b47c195bc9b4dbd7f2b87 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:07:37.631341 27079 raft_consensus.cc:697] T 28af091831594f9d8e96482078cc7625 P e5256d91808b47c195bc9b4dbd7f2b87 [term 20 LEADER]: Becoming Leader. State: Replica: e5256d91808b47c195bc9b4dbd7f2b87, State: Running, Role: LEADER
I20260709 13:07:37.632239 27079 consensus_queue.cc:237] T 28af091831594f9d8e96482078cc7625 P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 19.14, Last appended by leader: 14, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:07:37.640645 20112 raft_consensus.cc:2468] T 28af091831594f9d8e96482078cc7625 P 127766fc592545a4997f7790f50f6076 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 20.
I20260709 13:07:37.649209 27060 ts_tablet_manager.cc:1403] T d1e5873a19244c5ebbcd38e126796ee7 P 127766fc592545a4997f7790f50f6076: Time spent bootstrapping tablet: real 0.780s	user 0.050s	sys 0.018s
I20260709 13:07:37.674024 27067 tablet_bootstrap.cc:492] T b9f0d59553ad444883fcf5b5909f9798 P 127766fc592545a4997f7790f50f6076: Bootstrap starting.
I20260709 13:07:37.693624 27064 raft_consensus.cc:359] T bc225c93219c45538b53a1bd3d387e4d P 127766fc592545a4997f7790f50f6076 [term 18 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } attrs { replace: true } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: NON_VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: true } }
I20260709 13:07:37.694657 27064 raft_consensus.cc:740] T bc225c93219c45538b53a1bd3d387e4d P 127766fc592545a4997f7790f50f6076 [term 18 LEARNER]: Becoming Follower/Learner. State: Replica: 127766fc592545a4997f7790f50f6076, State: Initialized, Role: LEARNER
I20260709 13:07:37.695392 27064 consensus_queue.cc:260] T bc225c93219c45538b53a1bd3d387e4d P 127766fc592545a4997f7790f50f6076 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 12, Last appended: 18.12, Last appended by leader: 12, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } attrs { replace: true } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: NON_VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: true } }
I20260709 13:07:37.696671 27060 raft_consensus.cc:359] T d1e5873a19244c5ebbcd38e126796ee7 P 127766fc592545a4997f7790f50f6076 [term 22 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } attrs { replace: true } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: NON_VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: true } }
I20260709 13:07:37.707397 27060 raft_consensus.cc:740] T d1e5873a19244c5ebbcd38e126796ee7 P 127766fc592545a4997f7790f50f6076 [term 22 LEARNER]: Becoming Follower/Learner. State: Replica: 127766fc592545a4997f7790f50f6076, State: Initialized, Role: LEARNER
I20260709 13:07:37.710264 27060 consensus_queue.cc:260] T d1e5873a19244c5ebbcd38e126796ee7 P 127766fc592545a4997f7790f50f6076 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 12, Last appended: 22.12, Last appended by leader: 12, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } attrs { replace: true } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: NON_VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: true } }
I20260709 13:07:37.715391 27060 ts_tablet_manager.cc:1434] T d1e5873a19244c5ebbcd38e126796ee7 P 127766fc592545a4997f7790f50f6076: Time spent starting tablet: real 0.065s	user 0.007s	sys 0.000s
I20260709 13:07:37.740461 19421 tablet_copy_service.cc:342] P e5256d91808b47c195bc9b4dbd7f2b87: Request end of tablet copy session 127766fc592545a4997f7790f50f6076-d1e5873a19244c5ebbcd38e126796ee7 received from {username='slave'} at 127.0.0.1:49050
I20260709 13:07:37.740789 27064 ts_tablet_manager.cc:1434] T bc225c93219c45538b53a1bd3d387e4d P 127766fc592545a4997f7790f50f6076: Time spent starting tablet: real 0.122s	user 0.005s	sys 0.005s
I20260709 13:07:37.740962 19421 tablet_copy_service.cc:434] P e5256d91808b47c195bc9b4dbd7f2b87: ending tablet copy session 127766fc592545a4997f7790f50f6076-d1e5873a19244c5ebbcd38e126796ee7 on tablet d1e5873a19244c5ebbcd38e126796ee7 with peer 127766fc592545a4997f7790f50f6076
I20260709 13:07:37.744093 19570 tablet_copy_service.cc:342] P e61c3a8f61bb48f8a963c9480e53c168: Request end of tablet copy session 127766fc592545a4997f7790f50f6076-bc225c93219c45538b53a1bd3d387e4d received from {username='slave'} at 127.0.0.1:41504
I20260709 13:07:37.744603 19570 tablet_copy_service.cc:434] P e61c3a8f61bb48f8a963c9480e53c168: ending tablet copy session 127766fc592545a4997f7790f50f6076-bc225c93219c45538b53a1bd3d387e4d on tablet bc225c93219c45538b53a1bd3d387e4d with peer 127766fc592545a4997f7790f50f6076
I20260709 13:07:37.783324 27027 raft_consensus.cc:993] T 96efeaaf1057492490e9a621f37e1a2d P 0473d2b2d01f4459b1e90fd12cc7840e: : Instructing follower e61c3a8f61bb48f8a963c9480e53c168 to start an election
I20260709 13:07:37.786306 27073 raft_consensus.cc:1081] T 96efeaaf1057492490e9a621f37e1a2d P 0473d2b2d01f4459b1e90fd12cc7840e [term 21 LEADER]: Signalling peer e61c3a8f61bb48f8a963c9480e53c168 to start an election
I20260709 13:07:37.793057 19559 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "96efeaaf1057492490e9a621f37e1a2d"
dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
 from {username='slave'} at 127.0.0.1:40428
I20260709 13:07:37.793651 19559 raft_consensus.cc:493] T 96efeaaf1057492490e9a621f37e1a2d P e61c3a8f61bb48f8a963c9480e53c168 [term 21 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:07:37.793982 19559 raft_consensus.cc:3060] T 96efeaaf1057492490e9a621f37e1a2d P e61c3a8f61bb48f8a963c9480e53c168 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:07:37.815059 19559 raft_consensus.cc:515] T 96efeaaf1057492490e9a621f37e1a2d P e61c3a8f61bb48f8a963c9480e53c168 [term 22 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:07:37.823942 20112 raft_consensus.cc:1217] T bc225c93219c45538b53a1bd3d387e4d P 127766fc592545a4997f7790f50f6076 [term 18 LEARNER]: Deduplicated request from leader. Original: 18.11->[18.12-18.12]   Dedup: 18.12->[]
I20260709 13:07:37.840322 19480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96efeaaf1057492490e9a621f37e1a2d" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: true dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:07:37.840911 19480 raft_consensus.cc:3055] T 96efeaaf1057492490e9a621f37e1a2d P 0473d2b2d01f4459b1e90fd12cc7840e [term 21 LEADER]: Stepping down as leader of term 21
I20260709 13:07:37.841185 19480 raft_consensus.cc:740] T 96efeaaf1057492490e9a621f37e1a2d P 0473d2b2d01f4459b1e90fd12cc7840e [term 21 LEADER]: Becoming Follower/Learner. State: Replica: 0473d2b2d01f4459b1e90fd12cc7840e, State: Running, Role: LEADER
I20260709 13:07:37.841856 19480 consensus_queue.cc:260] T 96efeaaf1057492490e9a621f37e1a2d P 0473d2b2d01f4459b1e90fd12cc7840e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 21.14, Last appended by leader: 14, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:07:37.843734 19480 raft_consensus.cc:3060] T 96efeaaf1057492490e9a621f37e1a2d P 0473d2b2d01f4459b1e90fd12cc7840e [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:07:37.848477 27079 raft_consensus.cc:993] T 7f575b143b844aa096b50997dad3516a P e5256d91808b47c195bc9b4dbd7f2b87: : Instructing follower 0473d2b2d01f4459b1e90fd12cc7840e to start an election
I20260709 13:07:37.848981 27079 raft_consensus.cc:1081] T 7f575b143b844aa096b50997dad3516a P e5256d91808b47c195bc9b4dbd7f2b87 [term 20 LEADER]: Signalling peer 0473d2b2d01f4459b1e90fd12cc7840e to start an election
I20260709 13:07:37.852581 19485 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "7f575b143b844aa096b50997dad3516a"
dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
 from {username='slave'} at 127.0.0.1:58294
I20260709 13:07:37.853077 19485 raft_consensus.cc:493] T 7f575b143b844aa096b50997dad3516a P 0473d2b2d01f4459b1e90fd12cc7840e [term 20 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:07:37.853404 19485 raft_consensus.cc:3060] T 7f575b143b844aa096b50997dad3516a P 0473d2b2d01f4459b1e90fd12cc7840e [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:07:37.856616 20112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96efeaaf1057492490e9a621f37e1a2d" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: true dest_uuid: "127766fc592545a4997f7790f50f6076"
I20260709 13:07:37.857019 19480 raft_consensus.cc:2468] T 96efeaaf1057492490e9a621f37e1a2d P 0473d2b2d01f4459b1e90fd12cc7840e [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 22.
I20260709 13:07:37.857270 20112 raft_consensus.cc:3060] T 96efeaaf1057492490e9a621f37e1a2d P 127766fc592545a4997f7790f50f6076 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:07:37.857916 19559 leader_election.cc:290] T 96efeaaf1057492490e9a621f37e1a2d P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 22 election: Requested vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:07:37.858287 19526 leader_election.cc:304] T 96efeaaf1057492490e9a621f37e1a2d P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:07:37.859179 27087 raft_consensus.cc:2804] T 96efeaaf1057492490e9a621f37e1a2d P e61c3a8f61bb48f8a963c9480e53c168 [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:07:37.859681 27087 raft_consensus.cc:697] T 96efeaaf1057492490e9a621f37e1a2d P e61c3a8f61bb48f8a963c9480e53c168 [term 22 LEADER]: Becoming Leader. State: Replica: e61c3a8f61bb48f8a963c9480e53c168, State: Running, Role: LEADER
I20260709 13:07:37.860574 27087 consensus_queue.cc:237] T 96efeaaf1057492490e9a621f37e1a2d P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 21.14, Last appended by leader: 14, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:07:37.872538 20112 raft_consensus.cc:2468] T 96efeaaf1057492490e9a621f37e1a2d P 127766fc592545a4997f7790f50f6076 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 22.
I20260709 13:07:37.876401 19301 catalog_manager.cc:5697] T 28af091831594f9d8e96482078cc7625 P e5256d91808b47c195bc9b4dbd7f2b87 reported cstate change: term changed from 19 to 20, leader changed from e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3) to e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1). New cstate: current_term: 20 leader_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" committed_config { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:37.877238 19485 raft_consensus.cc:515] T 7f575b143b844aa096b50997dad3516a P 0473d2b2d01f4459b1e90fd12cc7840e [term 21 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:07:37.881582 27062 tablet_bootstrap.cc:492] T fa8650e71aa14778b3d73721fc50d9fc P 127766fc592545a4997f7790f50f6076: Bootstrap replayed 1/1 log segments. Stats: ops{read=15 overwritten=1 applied=14 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:07:37.882144 19402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f575b143b844aa096b50997dad3516a" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: true dest_uuid: "e5256d91808b47c195bc9b4dbd7f2b87"
I20260709 13:07:37.885989 19402 raft_consensus.cc:3055] T 7f575b143b844aa096b50997dad3516a P e5256d91808b47c195bc9b4dbd7f2b87 [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:07:37.886312 19402 raft_consensus.cc:740] T 7f575b143b844aa096b50997dad3516a P e5256d91808b47c195bc9b4dbd7f2b87 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: e5256d91808b47c195bc9b4dbd7f2b87, State: Running, Role: LEADER
I20260709 13:07:37.887019 19402 consensus_queue.cc:260] T 7f575b143b844aa096b50997dad3516a P e5256d91808b47c195bc9b4dbd7f2b87 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 20.13, Last appended by leader: 13, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:07:37.887887 27062 tablet_bootstrap.cc:492] T fa8650e71aa14778b3d73721fc50d9fc P 127766fc592545a4997f7790f50f6076: Bootstrap complete.
I20260709 13:07:37.888106 19402 raft_consensus.cc:3060] T 7f575b143b844aa096b50997dad3516a P e5256d91808b47c195bc9b4dbd7f2b87 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:07:37.903723 19485 leader_election.cc:290] T 7f575b143b844aa096b50997dad3516a P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 21 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:07:37.903826 19559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f575b143b844aa096b50997dad3516a" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: true dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:07:37.904814 19559 raft_consensus.cc:3060] T 7f575b143b844aa096b50997dad3516a P e61c3a8f61bb48f8a963c9480e53c168 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:07:37.888680 27062 ts_tablet_manager.cc:1403] T fa8650e71aa14778b3d73721fc50d9fc P 127766fc592545a4997f7790f50f6076: Time spent bootstrapping tablet: real 0.965s	user 0.045s	sys 0.030s
I20260709 13:07:37.915032 19402 raft_consensus.cc:2468] T 7f575b143b844aa096b50997dad3516a P e5256d91808b47c195bc9b4dbd7f2b87 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 21.
I20260709 13:07:37.916383 19449 leader_election.cc:304] T 7f575b143b844aa096b50997dad3516a P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87; no voters: 
I20260709 13:07:37.925638 19559 raft_consensus.cc:2468] T 7f575b143b844aa096b50997dad3516a P e61c3a8f61bb48f8a963c9480e53c168 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 21.
I20260709 13:07:37.938190 27073 raft_consensus.cc:2804] T 7f575b143b844aa096b50997dad3516a P 0473d2b2d01f4459b1e90fd12cc7840e [term 21 FOLLOWER]: Leader election won for term 21
W20260709 13:07:37.991845 19449 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.1:40321, user_credentials={real_user=slave}} blocked reactor thread for 75550.6us
W20260709 13:07:38.017185 19377 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RunLeaderElection -> {remote=127.17.223.2:46257, user_credentials={real_user=slave}} blocked reactor thread for 96612.9us
I20260709 13:07:38.106468 20112 raft_consensus.cc:1275] T 28af091831594f9d8e96482078cc7625 P 127766fc592545a4997f7790f50f6076 [term 20 FOLLOWER]: Refusing update from remote peer e5256d91808b47c195bc9b4dbd7f2b87: Log matching property violated. Preceding OpId in replica: term: 19 index: 14. Preceding OpId from leader: term: 20 index: 15. (index mismatch)
W20260709 13:07:38.116343 19450 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.3:36891, user_credentials={real_user=slave}} blocked reactor thread for 147839us
I20260709 13:07:38.135421 20112 raft_consensus.cc:1217] T d1e5873a19244c5ebbcd38e126796ee7 P 127766fc592545a4997f7790f50f6076 [term 22 LEARNER]: Deduplicated request from leader. Original: 22.11->[22.12-22.12]   Dedup: 22.12->[]
I20260709 13:07:38.108235 27073 raft_consensus.cc:697] T 7f575b143b844aa096b50997dad3516a P 0473d2b2d01f4459b1e90fd12cc7840e [term 21 LEADER]: Becoming Leader. State: Replica: 0473d2b2d01f4459b1e90fd12cc7840e, State: Running, Role: LEADER
I20260709 13:07:38.149935 19304 catalog_manager.cc:5697] T 96efeaaf1057492490e9a621f37e1a2d P e61c3a8f61bb48f8a963c9480e53c168 reported cstate change: term changed from 21 to 22, leader changed from 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2) to e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3). New cstate: current_term: 22 leader_uuid: "e61c3a8f61bb48f8a963c9480e53c168" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:38.158779 27023 consensus_queue.cc:1048] T 28af091831594f9d8e96482078cc7625 P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Connected to new peer: Peer: permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.046s
W20260709 13:07:38.234241 19449 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.1:40321, user_credentials={real_user=slave}} blocked reactor thread for 100959us
W20260709 13:07:38.255539 27089 log.cc:927] Time spent T 96efeaaf1057492490e9a621f37e1a2d P e61c3a8f61bb48f8a963c9480e53c168: Append to log took a long time: real 0.136s	user 0.001s	sys 0.000s
I20260709 13:07:38.213482 27073 consensus_queue.cc:237] T 7f575b143b844aa096b50997dad3516a P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 20.13, Last appended by leader: 13, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:07:38.279672 27062 raft_consensus.cc:359] T fa8650e71aa14778b3d73721fc50d9fc P 127766fc592545a4997f7790f50f6076 [term 22 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } attrs { replace: true } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: NON_VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: true } }
I20260709 13:07:38.312155 27062 raft_consensus.cc:740] T fa8650e71aa14778b3d73721fc50d9fc P 127766fc592545a4997f7790f50f6076 [term 22 LEARNER]: Becoming Follower/Learner. State: Replica: 127766fc592545a4997f7790f50f6076, State: Initialized, Role: LEARNER
I20260709 13:07:38.312930 27062 consensus_queue.cc:260] T fa8650e71aa14778b3d73721fc50d9fc P 127766fc592545a4997f7790f50f6076 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 14, Last appended: 22.14, Last appended by leader: 14, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } attrs { replace: true } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: NON_VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: true } }
I20260709 13:07:38.315502 27099 raft_consensus.cc:1064] T bc225c93219c45538b53a1bd3d387e4d P e61c3a8f61bb48f8a963c9480e53c168: attempting to promote NON_VOTER 127766fc592545a4997f7790f50f6076 to VOTER
I20260709 13:07:38.318292 27099 consensus_queue.cc:237] T bc225c93219c45538b53a1bd3d387e4d P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 18.12, Last appended by leader: 10, Current term: 18, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } attrs { replace: true } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:07:38.333742 27062 ts_tablet_manager.cc:1434] T fa8650e71aa14778b3d73721fc50d9fc P 127766fc592545a4997f7790f50f6076: Time spent starting tablet: real 0.415s	user 0.012s	sys 0.005s
I20260709 13:07:38.390523 19557 raft_consensus.cc:1275] T 28af091831594f9d8e96482078cc7625 P e61c3a8f61bb48f8a963c9480e53c168 [term 20 FOLLOWER]: Refusing update from remote peer e5256d91808b47c195bc9b4dbd7f2b87: Log matching property violated. Preceding OpId in replica: term: 19 index: 14. Preceding OpId from leader: term: 20 index: 15. (index mismatch)
W20260709 13:07:38.423529 20078 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.2:46257, user_credentials={real_user=slave}} blocked reactor thread for 100818us
W20260709 13:07:38.473325 19523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.1:40321, user_credentials={real_user=slave}} blocked reactor thread for 90392.5us
W20260709 13:07:38.474538 20078 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.2:46257, user_credentials={real_user=slave}} blocked reactor thread for 44671.3us
I20260709 13:07:38.519765 20106 raft_consensus.cc:1275] T 96efeaaf1057492490e9a621f37e1a2d P 127766fc592545a4997f7790f50f6076 [term 22 FOLLOWER]: Refusing update from remote peer e61c3a8f61bb48f8a963c9480e53c168: Log matching property violated. Preceding OpId in replica: term: 21 index: 14. Preceding OpId from leader: term: 22 index: 15. (index mismatch)
I20260709 13:07:38.522346 20110 raft_consensus.cc:1217] T fa8650e71aa14778b3d73721fc50d9fc P 127766fc592545a4997f7790f50f6076 [term 22 LEARNER]: Deduplicated request from leader. Original: 22.13->[22.14-22.14]   Dedup: 22.14->[]
I20260709 13:07:38.533108 27107 consensus_queue.cc:1048] T 28af091831594f9d8e96482078cc7625 P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
W20260709 13:07:38.523789 19374 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.4:43121, user_credentials={real_user=slave}} blocked reactor thread for 54630.5us
I20260709 13:07:38.576462 19496 tablet_copy_service.cc:342] P 0473d2b2d01f4459b1e90fd12cc7840e: Request end of tablet copy session 127766fc592545a4997f7790f50f6076-fa8650e71aa14778b3d73721fc50d9fc received from {username='slave'} at 127.0.0.1:39478
I20260709 13:07:38.576947 19496 tablet_copy_service.cc:434] P 0473d2b2d01f4459b1e90fd12cc7840e: ending tablet copy session 127766fc592545a4997f7790f50f6076-fa8650e71aa14778b3d73721fc50d9fc on tablet fa8650e71aa14778b3d73721fc50d9fc with peer 127766fc592545a4997f7790f50f6076
W20260709 13:07:38.589435 19377 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.2:46257, user_credentials={real_user=slave}} blocked reactor thread for 112386us
I20260709 13:07:38.604702 19485 raft_consensus.cc:1275] T 96efeaaf1057492490e9a621f37e1a2d P 0473d2b2d01f4459b1e90fd12cc7840e [term 22 FOLLOWER]: Refusing update from remote peer e61c3a8f61bb48f8a963c9480e53c168: Log matching property violated. Preceding OpId in replica: term: 21 index: 14. Preceding OpId from leader: term: 22 index: 15. (index mismatch)
W20260709 13:07:38.592881 27067 log.cc:927] Time spent T b9f0d59553ad444883fcf5b5909f9798 P 127766fc592545a4997f7790f50f6076: Append to log took a long time: real 0.054s	user 0.004s	sys 0.000s
I20260709 13:07:38.623083 27117 consensus_queue.cc:1048] T 96efeaaf1057492490e9a621f37e1a2d P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 13:07:38.662791 27097 consensus_queue.cc:1048] T 96efeaaf1057492490e9a621f37e1a2d P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Connected to new peer: Peer: permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 13:07:38.679229 27081 raft_consensus.cc:1064] T d1e5873a19244c5ebbcd38e126796ee7 P e5256d91808b47c195bc9b4dbd7f2b87: attempting to promote NON_VOTER 127766fc592545a4997f7790f50f6076 to VOTER
I20260709 13:07:38.679530 19481 raft_consensus.cc:1275] T bc225c93219c45538b53a1bd3d387e4d P 0473d2b2d01f4459b1e90fd12cc7840e [term 18 FOLLOWER]: Refusing update from remote peer e61c3a8f61bb48f8a963c9480e53c168: Log matching property violated. Preceding OpId in replica: term: 18 index: 12. Preceding OpId from leader: term: 18 index: 13. (index mismatch)
I20260709 13:07:38.683813 27081 consensus_queue.cc:237] T d1e5873a19244c5ebbcd38e126796ee7 P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 22.12, Last appended by leader: 10, Current term: 22, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } attrs { replace: true } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:07:38.697651 19406 raft_consensus.cc:1275] T bc225c93219c45538b53a1bd3d387e4d P e5256d91808b47c195bc9b4dbd7f2b87 [term 18 FOLLOWER]: Refusing update from remote peer e61c3a8f61bb48f8a963c9480e53c168: Log matching property violated. Preceding OpId in replica: term: 18 index: 12. Preceding OpId from leader: term: 18 index: 13. (index mismatch)
I20260709 13:07:38.697417 20103 raft_consensus.cc:1275] T bc225c93219c45538b53a1bd3d387e4d P 127766fc592545a4997f7790f50f6076 [term 18 LEARNER]: Refusing update from remote peer e61c3a8f61bb48f8a963c9480e53c168: Log matching property violated. Preceding OpId in replica: term: 18 index: 12. Preceding OpId from leader: term: 18 index: 13. (index mismatch)
I20260709 13:07:38.710094 27067 tablet_bootstrap.cc:492] T b9f0d59553ad444883fcf5b5909f9798 P 127766fc592545a4997f7790f50f6076: Bootstrap replayed 1/1 log segments. Stats: ops{read=12 overwritten=0 applied=12 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:07:38.711225 27067 tablet_bootstrap.cc:492] T b9f0d59553ad444883fcf5b5909f9798 P 127766fc592545a4997f7790f50f6076: Bootstrap complete.
I20260709 13:07:38.702267 27069 consensus_queue.cc:1048] T bc225c93219c45538b53a1bd3d387e4d P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.017s
I20260709 13:07:38.741911 27105 consensus_queue.cc:1048] T bc225c93219c45538b53a1bd3d387e4d P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:07:38.753039 27017 consensus_queue.cc:1048] T bc225c93219c45538b53a1bd3d387e4d P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Connected to new peer: Peer: permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:07:38.748973 27067 ts_tablet_manager.cc:1403] T b9f0d59553ad444883fcf5b5909f9798 P 127766fc592545a4997f7790f50f6076: Time spent bootstrapping tablet: real 1.075s	user 0.058s	sys 0.042s
I20260709 13:07:38.812956 18300 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:07:38.814018 19305 catalog_manager.cc:5697] T 7f575b143b844aa096b50997dad3516a P 0473d2b2d01f4459b1e90fd12cc7840e reported cstate change: term changed from 20 to 21, leader changed from e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1) to 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2). New cstate: current_term: 21 leader_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:38.823976 19483 raft_consensus.cc:1275] T d1e5873a19244c5ebbcd38e126796ee7 P 0473d2b2d01f4459b1e90fd12cc7840e [term 22 FOLLOWER]: Refusing update from remote peer e5256d91808b47c195bc9b4dbd7f2b87: Log matching property violated. Preceding OpId in replica: term: 22 index: 12. Preceding OpId from leader: term: 22 index: 13. (index mismatch)
I20260709 13:07:38.825903 19552 raft_consensus.cc:1275] T d1e5873a19244c5ebbcd38e126796ee7 P e61c3a8f61bb48f8a963c9480e53c168 [term 22 FOLLOWER]: Refusing update from remote peer e5256d91808b47c195bc9b4dbd7f2b87: Log matching property violated. Preceding OpId in replica: term: 22 index: 12. Preceding OpId from leader: term: 22 index: 13. (index mismatch)
I20260709 13:07:38.826033 27067 raft_consensus.cc:359] T b9f0d59553ad444883fcf5b5909f9798 P 127766fc592545a4997f7790f50f6076 [term 16 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } attrs { replace: true } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: NON_VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: true } }
I20260709 13:07:38.835639 27067 raft_consensus.cc:740] T b9f0d59553ad444883fcf5b5909f9798 P 127766fc592545a4997f7790f50f6076 [term 16 LEARNER]: Becoming Follower/Learner. State: Replica: 127766fc592545a4997f7790f50f6076, State: Initialized, Role: LEARNER
W20260709 13:07:38.836853 27134 log.cc:927] Time spent T d1e5873a19244c5ebbcd38e126796ee7 P e5256d91808b47c195bc9b4dbd7f2b87: Append to log took a long time: real 0.092s	user 0.001s	sys 0.000s
I20260709 13:07:38.836599 27067 consensus_queue.cc:260] T b9f0d59553ad444883fcf5b5909f9798 P 127766fc592545a4997f7790f50f6076 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 12, Last appended: 16.12, Last appended by leader: 12, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } attrs { replace: true } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: NON_VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: true } }
I20260709 13:07:38.841759 27067 ts_tablet_manager.cc:1434] T b9f0d59553ad444883fcf5b5909f9798 P 127766fc592545a4997f7790f50f6076: Time spent starting tablet: real 0.043s	user 0.007s	sys 0.000s
W20260709 13:07:38.856779 19374 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.4:43121, user_credentials={real_user=slave}} blocked reactor thread for 53504.3us
I20260709 13:07:38.858785 20103 raft_consensus.cc:1275] T d1e5873a19244c5ebbcd38e126796ee7 P 127766fc592545a4997f7790f50f6076 [term 22 LEARNER]: Refusing update from remote peer e5256d91808b47c195bc9b4dbd7f2b87: Log matching property violated. Preceding OpId in replica: term: 22 index: 12. Preceding OpId from leader: term: 22 index: 13. (index mismatch)
I20260709 13:07:38.866132 19402 raft_consensus.cc:1275] T 7f575b143b844aa096b50997dad3516a P e5256d91808b47c195bc9b4dbd7f2b87 [term 21 FOLLOWER]: Refusing update from remote peer 0473d2b2d01f4459b1e90fd12cc7840e: Log matching property violated. Preceding OpId in replica: term: 20 index: 13. Preceding OpId from leader: term: 21 index: 14. (index mismatch)
W20260709 13:07:38.866394 19523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.1:40321, user_credentials={real_user=slave}} blocked reactor thread for 93528.1us
I20260709 13:07:38.875698 19570 tablet_copy_service.cc:342] P e61c3a8f61bb48f8a963c9480e53c168: Request end of tablet copy session 127766fc592545a4997f7790f50f6076-b9f0d59553ad444883fcf5b5909f9798 received from {username='slave'} at 127.0.0.1:41504
I20260709 13:07:38.876112 19570 tablet_copy_service.cc:434] P e61c3a8f61bb48f8a963c9480e53c168: ending tablet copy session 127766fc592545a4997f7790f50f6076-b9f0d59553ad444883fcf5b5909f9798 on tablet b9f0d59553ad444883fcf5b5909f9798 with peer 127766fc592545a4997f7790f50f6076
I20260709 13:07:38.882156 19552 raft_consensus.cc:1275] T 7f575b143b844aa096b50997dad3516a P e61c3a8f61bb48f8a963c9480e53c168 [term 21 FOLLOWER]: Refusing update from remote peer 0473d2b2d01f4459b1e90fd12cc7840e: Log matching property violated. Preceding OpId in replica: term: 20 index: 13. Preceding OpId from leader: term: 21 index: 14. (index mismatch)
I20260709 13:07:38.889014 26987 consensus_queue.cc:1048] T 7f575b143b844aa096b50997dad3516a P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.013s
I20260709 13:07:38.886292 27079 consensus_queue.cc:1048] T d1e5873a19244c5ebbcd38e126796ee7 P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.023s
I20260709 13:07:38.954996 27126 consensus_queue.cc:1048] T d1e5873a19244c5ebbcd38e126796ee7 P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.011s
I20260709 13:07:38.960744 27106 consensus_queue.cc:1048] T d1e5873a19244c5ebbcd38e126796ee7 P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Connected to new peer: Peer: permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
/apache/dev/git/kudu/src/kudu/master/auto_leader_rebalancer-test.cc:278: Failure
Failed
Bad status: Illegal state: leader_transfer_task size should be 0, but 3
/apache/dev/git/kudu/src/kudu/util/test_util.cc:402: Failure
Failed
Timed out waiting for assertion to pass.
I20260709 13:07:39.018343 18300 tablet_server.cc:179] TabletServer@127.17.223.1:0 shutting down...
W20260709 13:07:39.069206 19523 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 1 similar messages]
I20260709 13:07:39.103871 27087 raft_consensus.cc:2955] T bc225c93219c45538b53a1bd3d387e4d P e61c3a8f61bb48f8a963c9480e53c168 [term 18 LEADER]: Committing config change with OpId 18.13: config changed from index 12 to 13, 127766fc592545a4997f7790f50f6076 (127.17.223.4) changed from NON_VOTER to VOTER. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } attrs { replace: true } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } } }
W20260709 13:07:39.132838 19450 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.3:36891, user_credentials={real_user=slave}} blocked reactor thread for 249112us
W20260709 13:07:39.150972 19449 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.1:40321, user_credentials={real_user=slave}} blocked reactor thread for 75357.5us
I20260709 13:07:39.154038 19485 raft_consensus.cc:2955] T bc225c93219c45538b53a1bd3d387e4d P 0473d2b2d01f4459b1e90fd12cc7840e [term 18 FOLLOWER]: Committing config change with OpId 18.13: config changed from index 12 to 13, 127766fc592545a4997f7790f50f6076 (127.17.223.4) changed from NON_VOTER to VOTER. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } attrs { replace: true } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } } }
W20260709 13:07:39.160539 19523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.1:40321, user_credentials={real_user=slave}} blocked reactor thread for 91357.5us
W20260709 13:07:39.165138 20075 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.1:40321, user_credentials={real_user=slave}} blocked reactor thread for 70818.8us
I20260709 13:07:39.165833 20106 raft_consensus.cc:1217] T b9f0d59553ad444883fcf5b5909f9798 P 127766fc592545a4997f7790f50f6076 [term 16 LEARNER]: Deduplicated request from leader. Original: 16.11->[16.12-16.12]   Dedup: 16.12->[]
W20260709 13:07:39.180127 20075 consensus_peers.cc:597] T 833a2f0775ed407a94b8924ce50adb63 P 127766fc592545a4997f7790f50f6076 -> Peer e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321): Couldn't send request to peer e5256d91808b47c195bc9b4dbd7f2b87. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:07:39.200089 19449 consensus_peers.cc:597] T 2725d2c4cb054f18b0fc8f735c15f6c2 P 0473d2b2d01f4459b1e90fd12cc7840e -> Peer e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321): Couldn't send request to peer e5256d91808b47c195bc9b4dbd7f2b87. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:07:39.179152 26987 consensus_queue.cc:1048] T 7f575b143b844aa096b50997dad3516a P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.059s
I20260709 13:07:39.250362 19302 catalog_manager.cc:5697] T bc225c93219c45538b53a1bd3d387e4d P e61c3a8f61bb48f8a963c9480e53c168 reported cstate change: config changed from index 12 to 13, 127766fc592545a4997f7790f50f6076 (127.17.223.4) changed from NON_VOTER to VOTER. New cstate: current_term: 18 leader_uuid: "e61c3a8f61bb48f8a963c9480e53c168" committed_config { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:07:39.280643 19449 consensus_peers.cc:597] T 40e1e16737a842ee936002830f36882e P 0473d2b2d01f4459b1e90fd12cc7840e -> Peer e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321): Couldn't send request to peer e5256d91808b47c195bc9b4dbd7f2b87. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:07:39.286784 27136 log.cc:927] Time spent T bc225c93219c45538b53a1bd3d387e4d P 0473d2b2d01f4459b1e90fd12cc7840e: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
W20260709 13:07:39.300818 19523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.4:43121, user_credentials={real_user=slave}} blocked reactor thread for 69841us
W20260709 13:07:39.301352 27150 log.cc:927] Time spent T d1e5873a19244c5ebbcd38e126796ee7 P e61c3a8f61bb48f8a963c9480e53c168: Append to log took a long time: real 0.112s	user 0.001s	sys 0.000s
W20260709 13:07:39.310945 19523 consensus_peers.cc:597] T 217b5fae677b4971b3bbd2f357a1f7ff P e61c3a8f61bb48f8a963c9480e53c168 -> Peer e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321): Couldn't send request to peer e5256d91808b47c195bc9b4dbd7f2b87. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:07:39.322587 20106 raft_consensus.cc:2955] T bc225c93219c45538b53a1bd3d387e4d P 127766fc592545a4997f7790f50f6076 [term 18 FOLLOWER]: Committing config change with OpId 18.13: config changed from index 12 to 13, 127766fc592545a4997f7790f50f6076 (127.17.223.4) changed from NON_VOTER to VOTER. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } attrs { replace: true } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } } }
W20260709 13:07:39.329418 27149 log.cc:927] Time spent T d1e5873a19244c5ebbcd38e126796ee7 P 127766fc592545a4997f7790f50f6076: Append to log took a long time: real 0.058s	user 0.001s	sys 0.000s
I20260709 13:07:39.333571 27081 raft_consensus.cc:2955] T d1e5873a19244c5ebbcd38e126796ee7 P e5256d91808b47c195bc9b4dbd7f2b87 [term 22 LEADER]: Committing config change with OpId 22.13: config changed from index 12 to 13, 127766fc592545a4997f7790f50f6076 (127.17.223.4) changed from NON_VOTER to VOTER. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } attrs { replace: true } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } } }
I20260709 13:07:39.340852 27019 raft_consensus.cc:1064] T fa8650e71aa14778b3d73721fc50d9fc P 0473d2b2d01f4459b1e90fd12cc7840e: attempting to promote NON_VOTER 127766fc592545a4997f7790f50f6076 to VOTER
I20260709 13:07:39.343983 20110 raft_consensus.cc:2955] T d1e5873a19244c5ebbcd38e126796ee7 P 127766fc592545a4997f7790f50f6076 [term 22 FOLLOWER]: Committing config change with OpId 22.13: config changed from index 12 to 13, 127766fc592545a4997f7790f50f6076 (127.17.223.4) changed from NON_VOTER to VOTER. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } attrs { replace: true } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } } }
W20260709 13:07:39.365007 19526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.2:46257, user_credentials={real_user=slave}} blocked reactor thread for 124663us
I20260709 13:07:39.406123 27019 consensus_queue.cc:237] T fa8650e71aa14778b3d73721fc50d9fc P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 22.14, Last appended by leader: 12, Current term: 22, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } attrs { replace: true } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
W20260709 13:07:39.570421 19449 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.1:40321, user_credentials={real_user=slave}} blocked reactor thread for 288660us
W20260709 13:07:39.603173 19523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.4:43121, user_credentials={real_user=slave}} blocked reactor thread for 254054us
W20260709 13:07:39.609675 19523 consensus_peers.cc:597] T b9f0d59553ad444883fcf5b5909f9798 P e61c3a8f61bb48f8a963c9480e53c168 -> Peer e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321): Couldn't send request to peer e5256d91808b47c195bc9b4dbd7f2b87. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:07:39.610641 19523 consensus_peers.cc:597] T 22196caba61445d3bec98a0aab3c337d P e61c3a8f61bb48f8a963c9480e53c168 -> Peer e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321): Couldn't send request to peer e5256d91808b47c195bc9b4dbd7f2b87. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:07:39.611487 19523 consensus_peers.cc:597] T 4509b76741dc428e9201c70c1658da13 P e61c3a8f61bb48f8a963c9480e53c168 -> Peer e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321): Couldn't send request to peer e5256d91808b47c195bc9b4dbd7f2b87. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:07:39.880510 19449 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.4:43121, user_credentials={real_user=slave}} blocked reactor thread for 156297us
W20260709 13:07:40.110337 19449 consensus_peers.cc:597] T b08304a0a02b42d7840c4e8ee9a6bd1a P 0473d2b2d01f4459b1e90fd12cc7840e -> Peer e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321): Couldn't send request to peer e5256d91808b47c195bc9b4dbd7f2b87. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:07:40.124008 27126 raft_consensus.cc:493] T fa8650e71aa14778b3d73721fc50d9fc P e5256d91808b47c195bc9b4dbd7f2b87 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 0473d2b2d01f4459b1e90fd12cc7840e)
I20260709 13:07:40.129756 27106 raft_consensus.cc:493] T 40e1e16737a842ee936002830f36882e P e5256d91808b47c195bc9b4dbd7f2b87 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 0473d2b2d01f4459b1e90fd12cc7840e)
W20260709 13:07:40.136866 19449 consensus_peers.cc:597] T f1b10566f45d4a7d9029858330e02d5b P 0473d2b2d01f4459b1e90fd12cc7840e -> Peer e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321): Couldn't send request to peer e5256d91808b47c195bc9b4dbd7f2b87. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:07:40.188347 27128 raft_consensus.cc:493] T 2725d2c4cb054f18b0fc8f735c15f6c2 P e5256d91808b47c195bc9b4dbd7f2b87 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 0473d2b2d01f4459b1e90fd12cc7840e)
I20260709 13:07:40.189324 27128 raft_consensus.cc:515] T 2725d2c4cb054f18b0fc8f735c15f6c2 P e5256d91808b47c195bc9b4dbd7f2b87 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:07:40.132573 27106 raft_consensus.cc:515] T 40e1e16737a842ee936002830f36882e P e5256d91808b47c195bc9b4dbd7f2b87 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:07:40.128862 27126 raft_consensus.cc:515] T fa8650e71aa14778b3d73721fc50d9fc P e5256d91808b47c195bc9b4dbd7f2b87 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } attrs { replace: true } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: NON_VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: true } }
W20260709 13:07:40.204051 19449 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.1:40321, user_credentials={real_user=slave}} blocked reactor thread for 61640.4us
I20260709 13:07:40.228453 27079 raft_consensus.cc:493] T 9962423cb4e54fcfa5de01daf68a86e7 P e5256d91808b47c195bc9b4dbd7f2b87 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 127766fc592545a4997f7790f50f6076)
I20260709 13:07:40.254431 27100 raft_consensus.cc:493] T 217b5fae677b4971b3bbd2f357a1f7ff P 0473d2b2d01f4459b1e90fd12cc7840e [term 20 FOLLOWER]: Starting pre-election (detected failure of leader e61c3a8f61bb48f8a963c9480e53c168)
I20260709 13:07:40.255482 27100 raft_consensus.cc:515] T 217b5fae677b4971b3bbd2f357a1f7ff P 0473d2b2d01f4459b1e90fd12cc7840e [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:07:40.258927 27100 leader_election.cc:290] T 217b5fae677b4971b3bbd2f357a1f7ff P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
W20260709 13:07:40.262919 19449 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.1:40321, user_credentials={real_user=slave}} blocked reactor thread for 51882.1us
I20260709 13:07:40.230248 27160 raft_consensus.cc:493] T 4509b76741dc428e9201c70c1658da13 P e5256d91808b47c195bc9b4dbd7f2b87 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader e61c3a8f61bb48f8a963c9480e53c168)
I20260709 13:07:40.287155 27160 raft_consensus.cc:515] T 4509b76741dc428e9201c70c1658da13 P e5256d91808b47c195bc9b4dbd7f2b87 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:07:40.295962 27126 leader_election.cc:290] T fa8650e71aa14778b3d73721fc50d9fc P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:07:40.272338 27079 raft_consensus.cc:515] T 9962423cb4e54fcfa5de01daf68a86e7 P e5256d91808b47c195bc9b4dbd7f2b87 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:07:40.297783 27171 raft_consensus.cc:493] T b9f0d59553ad444883fcf5b5909f9798 P e5256d91808b47c195bc9b4dbd7f2b87 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader e61c3a8f61bb48f8a963c9480e53c168)
I20260709 13:07:40.309101 27126 raft_consensus.cc:493] T 833a2f0775ed407a94b8924ce50adb63 P e5256d91808b47c195bc9b4dbd7f2b87 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 127766fc592545a4997f7790f50f6076)
I20260709 13:07:40.309278 27168 raft_consensus.cc:493] T f1b10566f45d4a7d9029858330e02d5b P e5256d91808b47c195bc9b4dbd7f2b87 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 0473d2b2d01f4459b1e90fd12cc7840e)
I20260709 13:07:40.310020 27126 raft_consensus.cc:515] T 833a2f0775ed407a94b8924ce50adb63 P e5256d91808b47c195bc9b4dbd7f2b87 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:07:40.312583 27126 leader_election.cc:290] T 833a2f0775ed407a94b8924ce50adb63 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:07:40.310472 27168 raft_consensus.cc:515] T f1b10566f45d4a7d9029858330e02d5b P e5256d91808b47c195bc9b4dbd7f2b87 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:07:40.298642 27079 leader_election.cc:290] T 9962423cb4e54fcfa5de01daf68a86e7 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:07:40.318904 27164 raft_consensus.cc:493] T e381f1d6b8184797ad142de49be225a8 P e61c3a8f61bb48f8a963c9480e53c168 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader e5256d91808b47c195bc9b4dbd7f2b87)
I20260709 13:07:40.323443 27164 raft_consensus.cc:515] T e381f1d6b8184797ad142de49be225a8 P e61c3a8f61bb48f8a963c9480e53c168 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:07:40.320911 27159 raft_consensus.cc:493] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P e5256d91808b47c195bc9b4dbd7f2b87 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 127766fc592545a4997f7790f50f6076)
I20260709 13:07:40.298780 27171 raft_consensus.cc:515] T b9f0d59553ad444883fcf5b5909f9798 P e5256d91808b47c195bc9b4dbd7f2b87 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } attrs { replace: true } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: NON_VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: true } }
I20260709 13:07:40.326313 27159 raft_consensus.cc:515] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P e5256d91808b47c195bc9b4dbd7f2b87 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:07:40.327826 27171 leader_election.cc:290] T b9f0d59553ad444883fcf5b5909f9798 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:07:40.303014 27165 raft_consensus.cc:493] T b08304a0a02b42d7840c4e8ee9a6bd1a P e5256d91808b47c195bc9b4dbd7f2b87 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 0473d2b2d01f4459b1e90fd12cc7840e)
I20260709 13:07:40.328819 27165 raft_consensus.cc:515] T b08304a0a02b42d7840c4e8ee9a6bd1a P e5256d91808b47c195bc9b4dbd7f2b87 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:07:40.329861 19559 consensus_queue.cc:237] T bc225c93219c45538b53a1bd3d387e4d P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 18.13, Last appended by leader: 10, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:07:40.330242 27159 leader_election.cc:290] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:07:40.322450 27170 raft_consensus.cc:493] T 217b5fae677b4971b3bbd2f357a1f7ff P e5256d91808b47c195bc9b4dbd7f2b87 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader e61c3a8f61bb48f8a963c9480e53c168)
I20260709 13:07:40.347399 27100 raft_consensus.cc:493] T 48824d5acfbc485ebf8c2d944e7202de P 0473d2b2d01f4459b1e90fd12cc7840e [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 127766fc592545a4997f7790f50f6076)
I20260709 13:07:40.348407 27100 raft_consensus.cc:515] T 48824d5acfbc485ebf8c2d944e7202de P 0473d2b2d01f4459b1e90fd12cc7840e [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:07:40.331977 27164 leader_election.cc:290] T e381f1d6b8184797ad142de49be225a8 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
W20260709 13:07:40.350018 19449 consensus_peers.cc:597] T f93ee515a9c14139bf566522ed8232f3 P 0473d2b2d01f4459b1e90fd12cc7840e -> Peer e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321): Couldn't send request to peer e5256d91808b47c195bc9b4dbd7f2b87. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:07:40.350736 27164 raft_consensus.cc:493] T f93ee515a9c14139bf566522ed8232f3 P e61c3a8f61bb48f8a963c9480e53c168 [term 25 FOLLOWER]: Starting pre-election (detected failure of leader 0473d2b2d01f4459b1e90fd12cc7840e)
I20260709 13:07:40.351505 27164 raft_consensus.cc:515] T f93ee515a9c14139bf566522ed8232f3 P e61c3a8f61bb48f8a963c9480e53c168 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:07:40.352731 27079 raft_consensus.cc:493] T 3e1f505cb0f1427bbd698ac889d80821 P e5256d91808b47c195bc9b4dbd7f2b87 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader e61c3a8f61bb48f8a963c9480e53c168)
I20260709 13:07:40.353488 27079 raft_consensus.cc:515] T 3e1f505cb0f1427bbd698ac889d80821 P e5256d91808b47c195bc9b4dbd7f2b87 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:07:40.335721 27165 leader_election.cc:290] T b08304a0a02b42d7840c4e8ee9a6bd1a P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:07:40.333990 27158 raft_consensus.cc:493] T ece3db938bc649d4a40a51522ed5259c P e5256d91808b47c195bc9b4dbd7f2b87 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader e61c3a8f61bb48f8a963c9480e53c168)
I20260709 13:07:40.333699 27160 leader_election.cc:290] T 4509b76741dc428e9201c70c1658da13 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:07:40.344520 27170 raft_consensus.cc:515] T 217b5fae677b4971b3bbd2f357a1f7ff P e5256d91808b47c195bc9b4dbd7f2b87 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:07:40.333459 27168 leader_election.cc:290] T f1b10566f45d4a7d9029858330e02d5b P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:07:40.359337 27164 leader_election.cc:290] T f93ee515a9c14139bf566522ed8232f3 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:07:40.371160 27100 leader_election.cc:290] T 48824d5acfbc485ebf8c2d944e7202de P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:07:40.371927 27100 raft_consensus.cc:493] T 172b3dd13109415a955b71ac0e9d2234 P 0473d2b2d01f4459b1e90fd12cc7840e [term 19 FOLLOWER]: Starting pre-election (detected failure of leader e5256d91808b47c195bc9b4dbd7f2b87)
I20260709 13:07:40.372696 27100 raft_consensus.cc:515] T 172b3dd13109415a955b71ac0e9d2234 P 0473d2b2d01f4459b1e90fd12cc7840e [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:07:40.374928 27158 raft_consensus.cc:515] T ece3db938bc649d4a40a51522ed5259c P e5256d91808b47c195bc9b4dbd7f2b87 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:07:40.375715 19477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e381f1d6b8184797ad142de49be225a8" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:07:40.376307 27073 raft_consensus.cc:493] T 4509b76741dc428e9201c70c1658da13 P 0473d2b2d01f4459b1e90fd12cc7840e [term 16 FOLLOWER]: Starting pre-election (detected failure of leader e61c3a8f61bb48f8a963c9480e53c168)
I20260709 13:07:40.377416 27158 leader_election.cc:290] T ece3db938bc649d4a40a51522ed5259c P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:07:40.378371 27172 raft_consensus.cc:493] T 22196caba61445d3bec98a0aab3c337d P e5256d91808b47c195bc9b4dbd7f2b87 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader e61c3a8f61bb48f8a963c9480e53c168)
I20260709 13:07:40.378711 27158 raft_consensus.cc:493] T 1dc5b3532fe54f74876d02beffa2c230 P e5256d91808b47c195bc9b4dbd7f2b87 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader e61c3a8f61bb48f8a963c9480e53c168)
I20260709 13:07:40.378871 27100 leader_election.cc:290] T 172b3dd13109415a955b71ac0e9d2234 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:07:40.379138 27172 raft_consensus.cc:515] T 22196caba61445d3bec98a0aab3c337d P e5256d91808b47c195bc9b4dbd7f2b87 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:07:40.379436 27158 raft_consensus.cc:515] T 1dc5b3532fe54f74876d02beffa2c230 P e5256d91808b47c195bc9b4dbd7f2b87 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:07:40.381520 27172 leader_election.cc:290] T 22196caba61445d3bec98a0aab3c337d P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:07:40.382699 27079 leader_election.cc:290] T 3e1f505cb0f1427bbd698ac889d80821 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:07:40.377137 27073 raft_consensus.cc:515] T 4509b76741dc428e9201c70c1658da13 P 0473d2b2d01f4459b1e90fd12cc7840e [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:07:40.392143 27174 raft_consensus.cc:493] T 70797e5783b5454ab0d0eea663e791e3 P e5256d91808b47c195bc9b4dbd7f2b87 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 127766fc592545a4997f7790f50f6076)
I20260709 13:07:40.392925 27173 raft_consensus.cc:493] T 21e14947d70440f19044d8f75c31e1f9 P e5256d91808b47c195bc9b4dbd7f2b87 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 0473d2b2d01f4459b1e90fd12cc7840e)
I20260709 13:07:40.393098 27174 raft_consensus.cc:515] T 70797e5783b5454ab0d0eea663e791e3 P e5256d91808b47c195bc9b4dbd7f2b87 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:07:40.393788 27173 raft_consensus.cc:515] T 21e14947d70440f19044d8f75c31e1f9 P e5256d91808b47c195bc9b4dbd7f2b87 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 17 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:07:40.396247 27160 raft_consensus.cc:493] T bc225c93219c45538b53a1bd3d387e4d P e5256d91808b47c195bc9b4dbd7f2b87 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader e61c3a8f61bb48f8a963c9480e53c168)
I20260709 13:07:40.396415 27170 leader_election.cc:290] T 217b5fae677b4971b3bbd2f357a1f7ff P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:07:40.397045 27160 raft_consensus.cc:515] T bc225c93219c45538b53a1bd3d387e4d P e5256d91808b47c195bc9b4dbd7f2b87 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } attrs { replace: true } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:07:40.398510 27098 raft_consensus.cc:493] T 7f575b143b844aa096b50997dad3516a P e61c3a8f61bb48f8a963c9480e53c168 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:40.399163 27098 raft_consensus.cc:515] T 7f575b143b844aa096b50997dad3516a P e61c3a8f61bb48f8a963c9480e53c168 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:07:40.400075 27171 raft_consensus.cc:493] T 1f85fc4b527a48848e5faa083b604e36 P e5256d91808b47c195bc9b4dbd7f2b87 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 127766fc592545a4997f7790f50f6076)
I20260709 13:07:40.400691 27171 raft_consensus.cc:515] T 1f85fc4b527a48848e5faa083b604e36 P e5256d91808b47c195bc9b4dbd7f2b87 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:07:40.401139 27174 leader_election.cc:290] T 70797e5783b5454ab0d0eea663e791e3 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:07:40.401363 27098 leader_election.cc:290] T 7f575b143b844aa096b50997dad3516a P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:07:40.406462 27173 leader_election.cc:290] T 21e14947d70440f19044d8f75c31e1f9 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:07:40.406867 27170 raft_consensus.cc:493] T 14efcc79969f41babe5529c22d59156d P e5256d91808b47c195bc9b4dbd7f2b87 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 127766fc592545a4997f7790f50f6076)
I20260709 13:07:40.407105 27173 raft_consensus.cc:493] T f93ee515a9c14139bf566522ed8232f3 P e5256d91808b47c195bc9b4dbd7f2b87 [term 25 FOLLOWER]: Starting pre-election (detected failure of leader 0473d2b2d01f4459b1e90fd12cc7840e)
I20260709 13:07:40.407649 27170 raft_consensus.cc:515] T 14efcc79969f41babe5529c22d59156d P e5256d91808b47c195bc9b4dbd7f2b87 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:07:40.409412 27171 leader_election.cc:290] T 1f85fc4b527a48848e5faa083b604e36 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:07:40.407881 27173 raft_consensus.cc:515] T f93ee515a9c14139bf566522ed8232f3 P e5256d91808b47c195bc9b4dbd7f2b87 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:07:40.410336 27073 leader_election.cc:290] T 4509b76741dc428e9201c70c1658da13 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:07:40.412068 27098 raft_consensus.cc:493] T 62c6c134d3d24a1ab144dd9ee6bc3f64 P e61c3a8f61bb48f8a963c9480e53c168 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 127766fc592545a4997f7790f50f6076)
I20260709 13:07:40.410468 27170 leader_election.cc:290] T 14efcc79969f41babe5529c22d59156d P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
W20260709 13:07:40.426930 19449 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.4:43121, user_credentials={real_user=slave}} blocked reactor thread for 51960.6us
I20260709 13:07:40.430580 27157 raft_consensus.cc:493] T 309c3ca0ca4b4f3ba129752ea2cb293b P 0473d2b2d01f4459b1e90fd12cc7840e [term 15 FOLLOWER]: Starting pre-election (detected failure of leader e5256d91808b47c195bc9b4dbd7f2b87)
I20260709 13:07:40.431424 27157 raft_consensus.cc:515] T 309c3ca0ca4b4f3ba129752ea2cb293b P 0473d2b2d01f4459b1e90fd12cc7840e [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:07:40.432847 20112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48824d5acfbc485ebf8c2d944e7202de" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:07:40.433387 20110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "172b3dd13109415a955b71ac0e9d2234" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:07:40.433736 27157 leader_election.cc:290] T 309c3ca0ca4b4f3ba129752ea2cb293b P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:07:40.436205 27105 raft_consensus.cc:1064] T b9f0d59553ad444883fcf5b5909f9798 P e61c3a8f61bb48f8a963c9480e53c168: attempting to promote NON_VOTER 127766fc592545a4997f7790f50f6076 to VOTER
I20260709 13:07:40.436959 20110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "309c3ca0ca4b4f3ba129752ea2cb293b" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:07:40.413035 27160 leader_election.cc:290] T bc225c93219c45538b53a1bd3d387e4d P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:07:40.446157 19302 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:44698 (request call id 279) took 1114 ms. Trace:
I20260709 13:07:40.446558 19302 rpcz_store.cc:276] 0709 13:07:39.331175 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:39.331351 (+   176us) service_pool.cc:224] Handling call
0709 13:07:40.445959 (+1114608us) inbound_call.cc:177] Queueing success response
Metrics: {"reported_tablets":1}
I20260709 13:07:40.438278 27172 raft_consensus.cc:493] T 46c5bfeecc314717bffe987e6844b6d0 P e5256d91808b47c195bc9b4dbd7f2b87 [term 27 FOLLOWER]: Starting pre-election (detected failure of leader e61c3a8f61bb48f8a963c9480e53c168)
I20260709 13:07:40.423288 27098 raft_consensus.cc:515] T 62c6c134d3d24a1ab144dd9ee6bc3f64 P e61c3a8f61bb48f8a963c9480e53c168 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:07:40.449180 27158 leader_election.cc:290] T 1dc5b3532fe54f74876d02beffa2c230 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:07:40.461259 20103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9962423cb4e54fcfa5de01daf68a86e7" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:07:40.463786 27098 leader_election.cc:290] T 62c6c134d3d24a1ab144dd9ee6bc3f64 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:07:40.463699 27170 raft_consensus.cc:493] T df751f992649444090e27965eb1af85d P e5256d91808b47c195bc9b4dbd7f2b87 [term 25 FOLLOWER]: Starting pre-election (detected failure of leader e61c3a8f61bb48f8a963c9480e53c168)
I20260709 13:07:40.464651 27170 raft_consensus.cc:515] T df751f992649444090e27965eb1af85d P e5256d91808b47c195bc9b4dbd7f2b87 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 19 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:07:40.465725 20108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36f6ba92b9ba46babe4ebd6c02e5fbd9" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 23 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:07:40.467068 27170 leader_election.cc:290] T df751f992649444090e27965eb1af85d P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:07:40.466305 19552 raft_consensus.cc:2955] T d1e5873a19244c5ebbcd38e126796ee7 P e61c3a8f61bb48f8a963c9480e53c168 [term 22 FOLLOWER]: Committing config change with OpId 22.13: config changed from index 12 to 13, 127766fc592545a4997f7790f50f6076 (127.17.223.4) changed from NON_VOTER to VOTER. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } attrs { replace: true } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } } }
I20260709 13:07:40.458735 20109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "833a2f0775ed407a94b8924ce50adb63" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:07:40.457872 27173 leader_election.cc:290] T f93ee515a9c14139bf566522ed8232f3 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:07:40.474611 27176 raft_consensus.cc:493] T 76cb037fc9064d13b59a8969d897ce8c P e5256d91808b47c195bc9b4dbd7f2b87 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader e61c3a8f61bb48f8a963c9480e53c168)
I20260709 13:07:40.475028 27158 raft_consensus.cc:493] T ff75a1d4cb1f493db8f71ddc136ba9ab P e5256d91808b47c195bc9b4dbd7f2b87 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 0473d2b2d01f4459b1e90fd12cc7840e)
I20260709 13:07:40.475296 27176 raft_consensus.cc:515] T 76cb037fc9064d13b59a8969d897ce8c P e5256d91808b47c195bc9b4dbd7f2b87 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:07:40.475754 27158 raft_consensus.cc:515] T ff75a1d4cb1f493db8f71ddc136ba9ab P e5256d91808b47c195bc9b4dbd7f2b87 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
W20260709 13:07:40.477452 20075 consensus_peers.cc:597] T 9962423cb4e54fcfa5de01daf68a86e7 P 127766fc592545a4997f7790f50f6076 -> Peer e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321): Couldn't send request to peer e5256d91808b47c195bc9b4dbd7f2b87. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:07:40.478982 27172 raft_consensus.cc:515] T 46c5bfeecc314717bffe987e6844b6d0 P e5256d91808b47c195bc9b4dbd7f2b87 [term 27 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:07:40.481976 27172 leader_election.cc:290] T 46c5bfeecc314717bffe987e6844b6d0 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:07:40.474895 20111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ece3db938bc649d4a40a51522ed5259c" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:07:40.483564 27120 raft_consensus.cc:493] T 0e1085d23e8347fbbd5bce7542f4b1f4 P 127766fc592545a4997f7790f50f6076 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 0473d2b2d01f4459b1e90fd12cc7840e)
I20260709 13:07:40.484265 27120 raft_consensus.cc:515] T 0e1085d23e8347fbbd5bce7542f4b1f4 P 127766fc592545a4997f7790f50f6076 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:07:40.485370 27176 leader_election.cc:290] T 76cb037fc9064d13b59a8969d897ce8c P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:07:40.490622 19555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9f0d59553ad444883fcf5b5909f9798" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:07:40.492511 19555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4509b76741dc428e9201c70c1658da13" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:07:40.490974 27176 raft_consensus.cc:493] T 1a61655d99124a29b486ba4a5b37faea P e5256d91808b47c195bc9b4dbd7f2b87 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 0473d2b2d01f4459b1e90fd12cc7840e)
I20260709 13:07:40.497435 27176 raft_consensus.cc:515] T 1a61655d99124a29b486ba4a5b37faea P e5256d91808b47c195bc9b4dbd7f2b87 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:07:40.485261 19560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1b10566f45d4a7d9029858330e02d5b" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:07:40.495203 27158 leader_election.cc:290] T ff75a1d4cb1f493db8f71ddc136ba9ab P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
W20260709 13:07:40.496441 19523 consensus_peers.cc:597] T ece3db938bc649d4a40a51522ed5259c P e61c3a8f61bb48f8a963c9480e53c168 -> Peer e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321): Couldn't send request to peer e5256d91808b47c195bc9b4dbd7f2b87. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:07:40.489645 19551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa8650e71aa14778b3d73721fc50d9fc" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:07:40.469511 19558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "833a2f0775ed407a94b8924ce50adb63" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:07:40.467653 27170 raft_consensus.cc:493] T ef32ce6fdd0e40d382c79974f30295c6 P e5256d91808b47c195bc9b4dbd7f2b87 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 0473d2b2d01f4459b1e90fd12cc7840e)
I20260709 13:07:40.511529 27170 raft_consensus.cc:515] T ef32ce6fdd0e40d382c79974f30295c6 P e5256d91808b47c195bc9b4dbd7f2b87 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:07:40.512274 19555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70797e5783b5454ab0d0eea663e791e3" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 25 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:07:40.513561 19555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "217b5fae677b4971b3bbd2f357a1f7ff" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:07:40.513921 27170 leader_election.cc:290] T ef32ce6fdd0e40d382c79974f30295c6 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:07:40.509168 19558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc225c93219c45538b53a1bd3d387e4d" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:07:40.515017 27120 leader_election.cc:290] T 0e1085d23e8347fbbd5bce7542f4b1f4 P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:07:40.515664 19558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22196caba61445d3bec98a0aab3c337d" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:07:40.518989 19558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b08304a0a02b42d7840c4e8ee9a6bd1a" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 24 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:07:40.509217 19551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ece3db938bc649d4a40a51522ed5259c" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:07:40.520311 19558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e1f505cb0f1427bbd698ac889d80821" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:07:40.519052 27158 raft_consensus.cc:493] T 179fd671030940b4b4a4e24bcc4aba0a P e5256d91808b47c195bc9b4dbd7f2b87 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 0473d2b2d01f4459b1e90fd12cc7840e)
I20260709 13:07:40.521245 27158 raft_consensus.cc:515] T 179fd671030940b4b4a4e24bcc4aba0a P e5256d91808b47c195bc9b4dbd7f2b87 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:07:40.510002 26961 raft_consensus.cc:493] T 2a16f7501e2444fb86d4e2778e734e02 P e5256d91808b47c195bc9b4dbd7f2b87 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 127766fc592545a4997f7790f50f6076)
I20260709 13:07:40.522693 26961 raft_consensus.cc:515] T 2a16f7501e2444fb86d4e2778e734e02 P e5256d91808b47c195bc9b4dbd7f2b87 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:07:40.524968 26961 leader_election.cc:290] T 2a16f7501e2444fb86d4e2778e734e02 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:07:40.528666 27158 leader_election.cc:290] T 179fd671030940b4b4a4e24bcc4aba0a P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
W20260709 13:07:40.510944 19523 consensus_peers.cc:597] T 3e1f505cb0f1427bbd698ac889d80821 P e61c3a8f61bb48f8a963c9480e53c168 -> Peer e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321): Couldn't send request to peer e5256d91808b47c195bc9b4dbd7f2b87. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:07:40.531111 19523 consensus_peers.cc:597] T df751f992649444090e27965eb1af85d P e61c3a8f61bb48f8a963c9480e53c168 -> Peer e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321): Couldn't send request to peer e5256d91808b47c195bc9b4dbd7f2b87. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:07:40.531706 19523 consensus_peers.cc:597] T 46c5bfeecc314717bffe987e6844b6d0 P e61c3a8f61bb48f8a963c9480e53c168 -> Peer e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321): Couldn't send request to peer e5256d91808b47c195bc9b4dbd7f2b87. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:07:40.553325 19551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dc5b3532fe54f74876d02beffa2c230" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 25 candidate_status { last_received { term: 24 index: 13 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:07:40.554505 19555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f93ee515a9c14139bf566522ed8232f3" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 26 candidate_status { last_received { term: 25 index: 13 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:07:40.556213 19555 raft_consensus.cc:2468] T f93ee515a9c14139bf566522ed8232f3 P e61c3a8f61bb48f8a963c9480e53c168 [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 25.
I20260709 13:07:40.557443 19551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e1085d23e8347fbbd5bce7542f4b1f4" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:07:40.571120 19486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f93ee515a9c14139bf566522ed8232f3" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 26 candidate_status { last_received { term: 25 index: 13 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:07:40.577603 19486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f575b143b844aa096b50997dad3516a" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 22 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:07:40.578936 20109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70797e5783b5454ab0d0eea663e791e3" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 25 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:07:40.579643 19560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df751f992649444090e27965eb1af85d" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 26 candidate_status { last_received { term: 25 index: 19 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:07:40.587080 27120 raft_consensus.cc:493] T 6c5eebf646ad445a9d1b1adc319d7b16 P 127766fc592545a4997f7790f50f6076 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader e61c3a8f61bb48f8a963c9480e53c168)
I20260709 13:07:40.588114 27120 raft_consensus.cc:515] T 6c5eebf646ad445a9d1b1adc319d7b16 P 127766fc592545a4997f7790f50f6076 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:07:40.600407 27092 raft_consensus.cc:493] T 309c3ca0ca4b4f3ba129752ea2cb293b P 127766fc592545a4997f7790f50f6076 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader e5256d91808b47c195bc9b4dbd7f2b87)
I20260709 13:07:40.601255 27092 raft_consensus.cc:515] T 309c3ca0ca4b4f3ba129752ea2cb293b P 127766fc592545a4997f7790f50f6076 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:07:40.603780 27092 leader_election.cc:290] T 309c3ca0ca4b4f3ba129752ea2cb293b P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:07:40.600386 19480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e1085d23e8347fbbd5bce7542f4b1f4" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
W20260709 13:07:40.613204 19449 consensus_peers.cc:597] T ef32ce6fdd0e40d382c79974f30295c6 P 0473d2b2d01f4459b1e90fd12cc7840e -> Peer e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321): Couldn't send request to peer e5256d91808b47c195bc9b4dbd7f2b87. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:07:40.614049 19449 consensus_peers.cc:597] T 7f575b143b844aa096b50997dad3516a P 0473d2b2d01f4459b1e90fd12cc7840e -> Peer e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321): Couldn't send request to peer e5256d91808b47c195bc9b4dbd7f2b87. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:07:40.621182 27105 consensus_queue.cc:237] T b9f0d59553ad444883fcf5b5909f9798 P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.12, Last appended by leader: 10, Current term: 16, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } attrs { replace: true } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:07:40.625293 20106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21e14947d70440f19044d8f75c31e1f9" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 23 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:07:40.625483 20108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc225c93219c45538b53a1bd3d387e4d" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:07:40.627058 19477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62c6c134d3d24a1ab144dd9ee6bc3f64" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:07:40.628752 20112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14efcc79969f41babe5529c22d59156d" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:07:40.629791 27128 leader_election.cc:290] T 2725d2c4cb054f18b0fc8f735c15f6c2 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:07:40.632002 19486 raft_consensus.cc:1275] T bc225c93219c45538b53a1bd3d387e4d P 0473d2b2d01f4459b1e90fd12cc7840e [term 18 FOLLOWER]: Refusing update from remote peer e61c3a8f61bb48f8a963c9480e53c168: Log matching property violated. Preceding OpId in replica: term: 18 index: 13. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
I20260709 13:07:40.634855 20109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f85fc4b527a48848e5faa083b604e36" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:07:40.638795 20108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76cb037fc9064d13b59a8969d897ce8c" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:07:40.638892 27120 leader_election.cc:290] T 6c5eebf646ad445a9d1b1adc319d7b16 P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:07:40.640132 20106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a16f7501e2444fb86d4e2778e734e02" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:07:40.639575 20112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df751f992649444090e27965eb1af85d" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 26 candidate_status { last_received { term: 25 index: 19 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:07:40.650753 19483 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58294 (request call id 3508) took 1304 ms. Trace:
I20260709 13:07:40.651018 19560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c5eebf646ad445a9d1b1adc319d7b16" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:07:40.651177 19483 rpcz_store.cc:276] 0709 13:07:39.346228 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:39.346364 (+   136us) service_pool.cc:224] Handling call
0709 13:07:40.649994 (+1303630us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:40.650228 (+   234us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:40.650252 (+    24us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:40.650294 (+    42us) raft_consensus.cc:1645] Marking committed up to 14
0709 13:07:40.650319 (+    25us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:40.650385 (+    66us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:40.650495 (+   110us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:40.652468 19557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76cb037fc9064d13b59a8969d897ce8c" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:07:40.653524 19551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46c5bfeecc314717bffe987e6844b6d0" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 28 candidate_status { last_received { term: 27 index: 14 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:07:40.654528 19555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff75a1d4cb1f493db8f71ddc136ba9ab" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 22 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:07:40.655380 20112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62c6c134d3d24a1ab144dd9ee6bc3f64" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:07:40.656035 27106 leader_election.cc:290] T 40e1e16737a842ee936002830f36882e P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:07:40.657434 20112 raft_consensus.cc:1275] T bc225c93219c45538b53a1bd3d387e4d P 127766fc592545a4997f7790f50f6076 [term 18 FOLLOWER]: Refusing update from remote peer e61c3a8f61bb48f8a963c9480e53c168: Log matching property violated. Preceding OpId in replica: term: 18 index: 13. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
W20260709 13:07:40.648653 19449 consensus_peers.cc:597] T 21e14947d70440f19044d8f75c31e1f9 P 0473d2b2d01f4459b1e90fd12cc7840e -> Peer e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321): Couldn't send request to peer e5256d91808b47c195bc9b4dbd7f2b87. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:07:40.659621 19449 consensus_peers.cc:597] T ff75a1d4cb1f493db8f71ddc136ba9ab P 0473d2b2d01f4459b1e90fd12cc7840e -> Peer e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321): Couldn't send request to peer e5256d91808b47c195bc9b4dbd7f2b87. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:07:40.660725 19449 consensus_peers.cc:597] T 86a6797bdfe94fa496c050ceae4bd0d9 P 0473d2b2d01f4459b1e90fd12cc7840e -> Peer e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321): Couldn't send request to peer e5256d91808b47c195bc9b4dbd7f2b87. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:07:40.661455 19449 consensus_peers.cc:597] T 179fd671030940b4b4a4e24bcc4aba0a P 0473d2b2d01f4459b1e90fd12cc7840e -> Peer e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321): Couldn't send request to peer e5256d91808b47c195bc9b4dbd7f2b87. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:07:40.662173 27162 consensus_queue.cc:1048] T bc225c93219c45538b53a1bd3d387e4d P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Connected to new peer: Peer: permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:07:40.662954 27176 leader_election.cc:290] T 1a61655d99124a29b486ba4a5b37faea P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:07:40.668206 27159 raft_consensus.cc:493] T 7f575b143b844aa096b50997dad3516a P e5256d91808b47c195bc9b4dbd7f2b87 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 0473d2b2d01f4459b1e90fd12cc7840e)
I20260709 13:07:40.668810 27170 raft_consensus.cc:493] T 86a6797bdfe94fa496c050ceae4bd0d9 P e5256d91808b47c195bc9b4dbd7f2b87 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 0473d2b2d01f4459b1e90fd12cc7840e)
I20260709 13:07:40.669621 27178 raft_consensus.cc:493] T ff75a1d4cb1f493db8f71ddc136ba9ab P e61c3a8f61bb48f8a963c9480e53c168 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 0473d2b2d01f4459b1e90fd12cc7840e)
I20260709 13:07:40.669672 27170 raft_consensus.cc:515] T 86a6797bdfe94fa496c050ceae4bd0d9 P e5256d91808b47c195bc9b4dbd7f2b87 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:07:40.668838 27159 raft_consensus.cc:515] T 7f575b143b844aa096b50997dad3516a P e5256d91808b47c195bc9b4dbd7f2b87 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:07:40.670570 27178 raft_consensus.cc:515] T ff75a1d4cb1f493db8f71ddc136ba9ab P e61c3a8f61bb48f8a963c9480e53c168 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:07:40.672492 27170 leader_election.cc:290] T 86a6797bdfe94fa496c050ceae4bd0d9 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:07:40.672878 27178 leader_election.cc:290] T ff75a1d4cb1f493db8f71ddc136ba9ab P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:07:40.672518 27159 leader_election.cc:290] T 7f575b143b844aa096b50997dad3516a P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
W20260709 13:07:40.688135 19449 consensus_peers.cc:597] T 1a61655d99124a29b486ba4a5b37faea P 0473d2b2d01f4459b1e90fd12cc7840e -> Peer e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321): Couldn't send request to peer e5256d91808b47c195bc9b4dbd7f2b87. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:07:40.690533 19449 leader_election.cc:336] T 217b5fae677b4971b3bbd2f357a1f7ff P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:07:40.694198 19553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef32ce6fdd0e40d382c79974f30295c6" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 25 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:07:40.698545 19553 raft_consensus.cc:2468] T ef32ce6fdd0e40d382c79974f30295c6 P e61c3a8f61bb48f8a963c9480e53c168 [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 24.
I20260709 13:07:40.699069 27157 raft_consensus.cc:493] T 5ec1c4ce15e04c7e8c283a62179f2a64 P 0473d2b2d01f4459b1e90fd12cc7840e [term 16 FOLLOWER]: Starting pre-election (detected failure of leader e5256d91808b47c195bc9b4dbd7f2b87)
I20260709 13:07:40.699673 27157 raft_consensus.cc:515] T 5ec1c4ce15e04c7e8c283a62179f2a64 P 0473d2b2d01f4459b1e90fd12cc7840e [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:07:40.701947 27157 leader_election.cc:290] T 5ec1c4ce15e04c7e8c283a62179f2a64 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
W20260709 13:07:40.702548 19523 leader_election.cc:336] T e381f1d6b8184797ad142de49be225a8 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:07:40.702911 19554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a16f7501e2444fb86d4e2778e734e02" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:07:40.704584 19486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff75a1d4cb1f493db8f71ddc136ba9ab" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 22 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:07:40.707840 19483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9962423cb4e54fcfa5de01daf68a86e7" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:07:40.708705 19477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4509b76741dc428e9201c70c1658da13" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:07:40.709373 19477 raft_consensus.cc:2468] T 4509b76741dc428e9201c70c1658da13 P 0473d2b2d01f4459b1e90fd12cc7840e [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 16.
I20260709 13:07:40.710608 19482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa8650e71aa14778b3d73721fc50d9fc" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:07:40.702996 19523 leader_election.cc:304] T e381f1d6b8184797ad142de49be225a8 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e61c3a8f61bb48f8a963c9480e53c168; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87
W20260709 13:07:40.712278 19449 leader_election.cc:336] T 172b3dd13109415a955b71ac0e9d2234 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:07:40.712932 19449 leader_election.cc:304] T 172b3dd13109415a955b71ac0e9d2234 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e; no voters: 127766fc592545a4997f7790f50f6076, e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:07:40.713390 19485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9f0d59553ad444883fcf5b5909f9798" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:07:40.716454 19483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22196caba61445d3bec98a0aab3c337d" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:07:40.716917 19481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e1f505cb0f1427bbd698ac889d80821" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:07:40.721952 27157 raft_consensus.cc:2749] T 172b3dd13109415a955b71ac0e9d2234 P 0473d2b2d01f4459b1e90fd12cc7840e [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:07:40.712199 19480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1b10566f45d4a7d9029858330e02d5b" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
W20260709 13:07:40.723227 19449 leader_election.cc:336] T 4509b76741dc428e9201c70c1658da13 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:07:40.723832 19449 leader_election.cc:336] T 309c3ca0ca4b4f3ba129752ea2cb293b P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:07:40.724246 19449 leader_election.cc:304] T 309c3ca0ca4b4f3ba129752ea2cb293b P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e; no voters: 127766fc592545a4997f7790f50f6076, e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:07:40.726728 19482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b08304a0a02b42d7840c4e8ee9a6bd1a" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 24 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:07:40.728361 19477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dc5b3532fe54f74876d02beffa2c230" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 25 candidate_status { last_received { term: 24 index: 13 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:07:40.729692 19485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36f6ba92b9ba46babe4ebd6c02e5fbd9" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 23 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:07:40.734954 27157 raft_consensus.cc:2749] T 309c3ca0ca4b4f3ba129752ea2cb293b P 0473d2b2d01f4459b1e90fd12cc7840e [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 13:07:40.738902 19449 consensus_peers.cc:597] T fa8650e71aa14778b3d73721fc50d9fc P 0473d2b2d01f4459b1e90fd12cc7840e -> Peer e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321): Couldn't send request to peer e5256d91808b47c195bc9b4dbd7f2b87. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:07:40.741469 19374 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.4:43121, user_credentials={real_user=slave}} blocked reactor thread for 47973.5us
I20260709 13:07:40.750351 19556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "179fd671030940b4b4a4e24bcc4aba0a" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 24 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:07:40.751243 19555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a61655d99124a29b486ba4a5b37faea" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:07:40.751698 19556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f575b143b844aa096b50997dad3516a" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:07:40.752257 19556 raft_consensus.cc:2468] T 7f575b143b844aa096b50997dad3516a P e61c3a8f61bb48f8a963c9480e53c168 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 21.
I20260709 13:07:40.752385 19551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86a6797bdfe94fa496c050ceae4bd0d9" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:07:40.753623 27021 raft_consensus.cc:493] T b08304a0a02b42d7840c4e8ee9a6bd1a P e61c3a8f61bb48f8a963c9480e53c168 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 0473d2b2d01f4459b1e90fd12cc7840e)
I20260709 13:07:40.754192 27021 raft_consensus.cc:515] T b08304a0a02b42d7840c4e8ee9a6bd1a P e61c3a8f61bb48f8a963c9480e53c168 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:07:40.754897 27152 raft_consensus.cc:493] T 40e1e16737a842ee936002830f36882e P e61c3a8f61bb48f8a963c9480e53c168 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 0473d2b2d01f4459b1e90fd12cc7840e)
I20260709 13:07:40.755440 27128 raft_consensus.cc:493] T a08760e15aac4630a629431f56024dc8 P e5256d91808b47c195bc9b4dbd7f2b87 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader e61c3a8f61bb48f8a963c9480e53c168)
I20260709 13:07:40.755748 27155 raft_consensus.cc:493] T ed7fdbcb96d14d418db9ca90a792588a P e61c3a8f61bb48f8a963c9480e53c168 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 0473d2b2d01f4459b1e90fd12cc7840e)
I20260709 13:07:40.756065 27128 raft_consensus.cc:515] T a08760e15aac4630a629431f56024dc8 P e5256d91808b47c195bc9b4dbd7f2b87 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:07:40.756417 27155 raft_consensus.cc:515] T ed7fdbcb96d14d418db9ca90a792588a P e61c3a8f61bb48f8a963c9480e53c168 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
W20260709 13:07:40.757500 19526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.2:46257, user_credentials={real_user=slave}} blocked reactor thread for 62614.7us
I20260709 13:07:40.758353 27128 leader_election.cc:290] T a08760e15aac4630a629431f56024dc8 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:07:40.803017 19553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40e1e16737a842ee936002830f36882e" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 25 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:07:40.817935 19481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc225c93219c45538b53a1bd3d387e4d" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:07:40.833478 27182 raft_consensus.cc:493] T 14935b3ddf914369822e4a0547aaa355 P e61c3a8f61bb48f8a963c9480e53c168 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 0473d2b2d01f4459b1e90fd12cc7840e)
I20260709 13:07:40.808725 27115 raft_consensus.cc:2749] T e381f1d6b8184797ad142de49be225a8 P e61c3a8f61bb48f8a963c9480e53c168 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:07:40.818699 19478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff75a1d4cb1f493db8f71ddc136ba9ab" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 22 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
W20260709 13:07:40.813983 19375 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.3:36891, user_credentials={real_user=slave}} blocked reactor thread for 58551.6us
W20260709 13:07:40.872043 19523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.1:40321, user_credentials={real_user=slave}} blocked reactor thread for 169510us
I20260709 13:07:40.871740 27182 raft_consensus.cc:515] T 14935b3ddf914369822e4a0547aaa355 P e61c3a8f61bb48f8a963c9480e53c168 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:07:40.819097 19479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef32ce6fdd0e40d382c79974f30295c6" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 25 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:07:40.876971 27182 leader_election.cc:290] T 14935b3ddf914369822e4a0547aaa355 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:07:40.755450 27152 raft_consensus.cc:515] T 40e1e16737a842ee936002830f36882e P e61c3a8f61bb48f8a963c9480e53c168 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
W20260709 13:07:40.810387 19374 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.4:43121, user_credentials={real_user=slave}} blocked reactor thread for 63371.8us
I20260709 13:07:40.758450 19526 leader_election.cc:304] T 62c6c134d3d24a1ab144dd9ee6bc3f64 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e61c3a8f61bb48f8a963c9480e53c168; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, 127766fc592545a4997f7790f50f6076
I20260709 13:07:40.878654 27182 raft_consensus.cc:2749] T 62c6c134d3d24a1ab144dd9ee6bc3f64 P e61c3a8f61bb48f8a963c9480e53c168 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 13:07:40.878891 19523 consensus_peers.cc:597] T 1dc5b3532fe54f74876d02beffa2c230 P e61c3a8f61bb48f8a963c9480e53c168 -> Peer e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321): Couldn't send request to peer e5256d91808b47c195bc9b4dbd7f2b87. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:07:40.879613 19526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.2:46257, user_credentials={real_user=slave}} blocked reactor thread for 121236us
W20260709 13:07:40.880199 19523 consensus_peers.cc:597] T 76cb037fc9064d13b59a8969d897ce8c P e61c3a8f61bb48f8a963c9480e53c168 -> Peer e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321): Couldn't send request to peer e5256d91808b47c195bc9b4dbd7f2b87. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:07:40.873899 19449 leader_election.cc:336] T 5ec1c4ce15e04c7e8c283a62179f2a64 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:07:40.881264 19482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21e14947d70440f19044d8f75c31e1f9" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 23 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:07:40.819095 19485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "217b5fae677b4971b3bbd2f357a1f7ff" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:07:40.877955 19553 raft_consensus.cc:2468] T 40e1e16737a842ee936002830f36882e P e61c3a8f61bb48f8a963c9480e53c168 [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 24.
I20260709 13:07:40.819514 19477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f85fc4b527a48848e5faa083b604e36" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
W20260709 13:07:40.882925 19523 leader_election.cc:336] T f93ee515a9c14139bf566522ed8232f3 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:07:40.889757 19523 leader_election.cc:304] T f93ee515a9c14139bf566522ed8232f3 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e61c3a8f61bb48f8a963c9480e53c168; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:07:40.866184 27155 leader_election.cc:290] T ed7fdbcb96d14d418db9ca90a792588a P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:07:40.908524 19477 raft_consensus.cc:2468] T 1f85fc4b527a48848e5faa083b604e36 P 0473d2b2d01f4459b1e90fd12cc7840e [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 20.
I20260709 13:07:40.909857 27105 raft_consensus.cc:2749] T f93ee515a9c14139bf566522ed8232f3 P e61c3a8f61bb48f8a963c9480e53c168 [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 13:07:40.880630 27182 consensus_queue.cc:1048] T bc225c93219c45538b53a1bd3d387e4d P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.040s
I20260709 13:07:40.909740 19554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2725d2c4cb054f18b0fc8f735c15f6c2" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 24 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:07:40.922168 19554 raft_consensus.cc:2468] T 2725d2c4cb054f18b0fc8f735c15f6c2 P e61c3a8f61bb48f8a963c9480e53c168 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 23.
I20260709 13:07:41.048803 19479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "179fd671030940b4b4a4e24bcc4aba0a" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 24 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
W20260709 13:07:41.066527 19523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.1:40321, user_credentials={real_user=slave}} blocked reactor thread for 185637us
I20260709 13:07:41.068274 19374 leader_election.cc:304] T 833a2f0775ed407a94b8924ce50adb63 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87; no voters: 127766fc592545a4997f7790f50f6076, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:07:41.135159 27176 raft_consensus.cc:2749] T 833a2f0775ed407a94b8924ce50adb63 P e5256d91808b47c195bc9b4dbd7f2b87 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 13:07:41.103718 19375 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.3:36891, user_credentials={real_user=slave}} blocked reactor thread for 225925us
I20260709 13:07:41.139353 19375 leader_election.cc:304] T f93ee515a9c14139bf566522ed8232f3 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:07:41.140172 27176 raft_consensus.cc:2804] T f93ee515a9c14139bf566522ed8232f3 P e5256d91808b47c195bc9b4dbd7f2b87 [term 25 FOLLOWER]: Leader pre-election won for term 26
I20260709 13:07:41.140556 27176 raft_consensus.cc:493] T f93ee515a9c14139bf566522ed8232f3 P e5256d91808b47c195bc9b4dbd7f2b87 [term 25 FOLLOWER]: Starting leader election (detected failure of leader 0473d2b2d01f4459b1e90fd12cc7840e)
I20260709 13:07:41.140934 27176 raft_consensus.cc:3060] T f93ee515a9c14139bf566522ed8232f3 P e5256d91808b47c195bc9b4dbd7f2b87 [term 25 FOLLOWER]: Advancing to term 26
I20260709 13:07:41.148381 27178 raft_consensus.cc:493] T 1a61655d99124a29b486ba4a5b37faea P e61c3a8f61bb48f8a963c9480e53c168 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 0473d2b2d01f4459b1e90fd12cc7840e)
I20260709 13:07:41.149075 27178 raft_consensus.cc:515] T 1a61655d99124a29b486ba4a5b37faea P e61c3a8f61bb48f8a963c9480e53c168 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:07:41.150250 27167 raft_consensus.cc:493] T 179fd671030940b4b4a4e24bcc4aba0a P e61c3a8f61bb48f8a963c9480e53c168 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 0473d2b2d01f4459b1e90fd12cc7840e)
I20260709 13:07:41.150928 27167 raft_consensus.cc:515] T 179fd671030940b4b4a4e24bcc4aba0a P e61c3a8f61bb48f8a963c9480e53c168 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:07:41.153065 27167 leader_election.cc:290] T 179fd671030940b4b4a4e24bcc4aba0a P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:07:41.149062 19375 leader_election.cc:304] T ef32ce6fdd0e40d382c79974f30295c6 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:07:41.158365 19478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40e1e16737a842ee936002830f36882e" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 25 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:07:41.157773 19482 raft_consensus.cc:2955] T d1e5873a19244c5ebbcd38e126796ee7 P 0473d2b2d01f4459b1e90fd12cc7840e [term 22 FOLLOWER]: Committing config change with OpId 22.13: config changed from index 12 to 13, 127766fc592545a4997f7790f50f6076 (127.17.223.4) changed from NON_VOTER to VOTER. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } attrs { replace: true } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } } }
I20260709 13:07:41.160671 20112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ec1c4ce15e04c7e8c283a62179f2a64" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:07:41.160974 20109 raft_consensus.cc:1275] T fa8650e71aa14778b3d73721fc50d9fc P 127766fc592545a4997f7790f50f6076 [term 22 LEARNER]: Refusing update from remote peer 0473d2b2d01f4459b1e90fd12cc7840e: Log matching property violated. Preceding OpId in replica: term: 22 index: 14. Preceding OpId from leader: term: 22 index: 15. (index mismatch)
I20260709 13:07:41.162983 19477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2725d2c4cb054f18b0fc8f735c15f6c2" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 24 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
W20260709 13:07:41.163269 19374 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.4:43121, user_credentials={real_user=slave}} blocked reactor thread for 95279.3us
I20260709 13:07:41.164028 19374 leader_election.cc:304] T ece3db938bc649d4a40a51522ed5259c P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87; no voters: 127766fc592545a4997f7790f50f6076, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:07:41.151232 27178 leader_election.cc:290] T 1a61655d99124a29b486ba4a5b37faea P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
W20260709 13:07:41.171892 20075 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.693s	user 0.032s	sys 0.024s
W20260709 13:07:41.172278 20075 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.694s	user 0.032s	sys 0.024s
W20260709 13:07:41.172533 20075 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.1:40321, user_credentials={real_user=slave}} blocked reactor thread for 694433us
I20260709 13:07:41.191128 19478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a08760e15aac4630a629431f56024dc8" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 25 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:07:41.192924 19477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f575b143b844aa096b50997dad3516a" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
W20260709 13:07:41.187279 20075 consensus_peers.cc:597] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P 127766fc592545a4997f7790f50f6076 -> Peer e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321): Couldn't send request to peer e5256d91808b47c195bc9b4dbd7f2b87. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:07:41.195712 20075 consensus_peers.cc:597] T 14efcc79969f41babe5529c22d59156d P 127766fc592545a4997f7790f50f6076 -> Peer e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321): Couldn't send request to peer e5256d91808b47c195bc9b4dbd7f2b87. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:07:41.198210 19375 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.3:36891, user_credentials={real_user=slave}} blocked reactor thread for 49224.7us
I20260709 13:07:41.154364 27176 raft_consensus.cc:515] T f93ee515a9c14139bf566522ed8232f3 P e5256d91808b47c195bc9b4dbd7f2b87 [term 26 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:07:41.200227 27098 raft_consensus.cc:493] T fa8650e71aa14778b3d73721fc50d9fc P e61c3a8f61bb48f8a963c9480e53c168 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 0473d2b2d01f4459b1e90fd12cc7840e)
I20260709 13:07:41.201561 27173 raft_consensus.cc:2749] T ece3db938bc649d4a40a51522ed5259c P e5256d91808b47c195bc9b4dbd7f2b87 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:07:41.201617 27092 raft_consensus.cc:493] T bc225c93219c45538b53a1bd3d387e4d P 127766fc592545a4997f7790f50f6076 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader e61c3a8f61bb48f8a963c9480e53c168)
I20260709 13:07:41.200875 19374 leader_election.cc:304] T 70797e5783b5454ab0d0eea663e791e3 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87; no voters: 127766fc592545a4997f7790f50f6076, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:07:41.206836 19482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86a6797bdfe94fa496c050ceae4bd0d9" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:07:41.207823 19477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c5eebf646ad445a9d1b1adc319d7b16" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:07:41.210171 27092 raft_consensus.cc:515] T bc225c93219c45538b53a1bd3d387e4d P 127766fc592545a4997f7790f50f6076 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } attrs { replace: true } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:07:41.213004 27092 leader_election.cc:290] T bc225c93219c45538b53a1bd3d387e4d P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:07:41.205578 27170 raft_consensus.cc:2804] T ef32ce6fdd0e40d382c79974f30295c6 P e5256d91808b47c195bc9b4dbd7f2b87 [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 13:07:41.214145 27170 raft_consensus.cc:493] T ef32ce6fdd0e40d382c79974f30295c6 P e5256d91808b47c195bc9b4dbd7f2b87 [term 24 FOLLOWER]: Starting leader election (detected failure of leader 0473d2b2d01f4459b1e90fd12cc7840e)
I20260709 13:07:41.214526 27170 raft_consensus.cc:3060] T ef32ce6fdd0e40d382c79974f30295c6 P e5256d91808b47c195bc9b4dbd7f2b87 [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:07:41.215801 19479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a61655d99124a29b486ba4a5b37faea" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:07:41.217448 27182 raft_consensus.cc:493] T 86a6797bdfe94fa496c050ceae4bd0d9 P e61c3a8f61bb48f8a963c9480e53c168 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 0473d2b2d01f4459b1e90fd12cc7840e)
I20260709 13:07:41.217983 27182 raft_consensus.cc:515] T 86a6797bdfe94fa496c050ceae4bd0d9 P e61c3a8f61bb48f8a963c9480e53c168 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:07:41.218931 27098 raft_consensus.cc:515] T fa8650e71aa14778b3d73721fc50d9fc P e61c3a8f61bb48f8a963c9480e53c168 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } attrs { replace: true } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: NON_VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: true } }
I20260709 13:07:41.220072 27182 leader_election.cc:290] T 86a6797bdfe94fa496c050ceae4bd0d9 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:07:41.220813 27021 leader_election.cc:290] T b08304a0a02b42d7840c4e8ee9a6bd1a P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:07:41.221185 27098 leader_election.cc:290] T fa8650e71aa14778b3d73721fc50d9fc P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:07:41.213162 27176 leader_election.cc:290] T f93ee515a9c14139bf566522ed8232f3 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 26 election: Requested vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:07:41.223199 19377 leader_election.cc:304] T 9962423cb4e54fcfa5de01daf68a86e7 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, 127766fc592545a4997f7790f50f6076
I20260709 13:07:41.224359 19377 leader_election.cc:304] T 4509b76741dc428e9201c70c1658da13 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87; no voters: e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:07:41.225508 19377 leader_election.cc:304] T fa8650e71aa14778b3d73721fc50d9fc P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:07:41.227270 27159 raft_consensus.cc:2749] T 9962423cb4e54fcfa5de01daf68a86e7 P e5256d91808b47c195bc9b4dbd7f2b87 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:07:41.227981 27159 raft_consensus.cc:2804] T 4509b76741dc428e9201c70c1658da13 P e5256d91808b47c195bc9b4dbd7f2b87 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:07:41.228185 19374 leader_election.cc:304] T bc225c93219c45538b53a1bd3d387e4d P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87; no voters: 127766fc592545a4997f7790f50f6076, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:07:41.228353 27159 raft_consensus.cc:493] T 4509b76741dc428e9201c70c1658da13 P e5256d91808b47c195bc9b4dbd7f2b87 [term 16 FOLLOWER]: Starting leader election (detected failure of leader e61c3a8f61bb48f8a963c9480e53c168)
I20260709 13:07:41.228827 27173 raft_consensus.cc:2749] T fa8650e71aa14778b3d73721fc50d9fc P e5256d91808b47c195bc9b4dbd7f2b87 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:07:41.229851 27173 raft_consensus.cc:2749] T 70797e5783b5454ab0d0eea663e791e3 P e5256d91808b47c195bc9b4dbd7f2b87 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:07:41.226542 19377 leader_election.cc:304] T b9f0d59553ad444883fcf5b5909f9798 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:07:41.230747 27159 raft_consensus.cc:3060] T 4509b76741dc428e9201c70c1658da13 P e5256d91808b47c195bc9b4dbd7f2b87 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:07:41.231775 19374 leader_election.cc:304] T 76cb037fc9064d13b59a8969d897ce8c P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87; no voters: 127766fc592545a4997f7790f50f6076, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:07:41.230494 27173 raft_consensus.cc:2749] T bc225c93219c45538b53a1bd3d387e4d P e5256d91808b47c195bc9b4dbd7f2b87 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:07:41.237671 19305 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:44676 (request call id 264) took 1983 ms. Trace:
I20260709 13:07:41.239068 19374 leader_election.cc:304] T df751f992649444090e27965eb1af85d P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87; no voters: 127766fc592545a4997f7790f50f6076, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:07:41.239197 19377 leader_election.cc:304] T 22196caba61445d3bec98a0aab3c337d P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:07:41.242273 19375 leader_election.cc:304] T 7f575b143b844aa096b50997dad3516a P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:07:41.238088 19305 rpcz_store.cc:276] 0709 13:07:39.254173 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:39.256299 (+  2126us) service_pool.cc:224] Handling call
0709 13:07:41.237475 (+1981176us) inbound_call.cc:177] Queueing success response
Metrics: {"reported_tablets":1,"spinlock_wait_cycles":14208}
I20260709 13:07:41.244532 19374 leader_election.cc:304] T 2a16f7501e2444fb86d4e2778e734e02 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87; no voters: 127766fc592545a4997f7790f50f6076, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:07:41.244547 19377 leader_election.cc:304] T 3e1f505cb0f1427bbd698ac889d80821 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:07:41.245669 19482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "309c3ca0ca4b4f3ba129752ea2cb293b" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:07:41.251051 27193 raft_consensus.cc:2749] T 76cb037fc9064d13b59a8969d897ce8c P e5256d91808b47c195bc9b4dbd7f2b87 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:07:41.252662 19377 leader_election.cc:304] T f1b10566f45d4a7d9029858330e02d5b P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168
W20260709 13:07:41.255550 20078 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.2:46257, user_credentials={real_user=slave}} blocked reactor thread for 48742.1us
I20260709 13:07:41.243871 27173 raft_consensus.cc:2749] T b9f0d59553ad444883fcf5b5909f9798 P e5256d91808b47c195bc9b4dbd7f2b87 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:07:41.252488 27098 raft_consensus.cc:493] T f1b10566f45d4a7d9029858330e02d5b P e61c3a8f61bb48f8a963c9480e53c168 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 0473d2b2d01f4459b1e90fd12cc7840e)
I20260709 13:07:41.263959 27193 raft_consensus.cc:2749] T 22196caba61445d3bec98a0aab3c337d P e5256d91808b47c195bc9b4dbd7f2b87 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:07:41.265591 27193 raft_consensus.cc:2749] T df751f992649444090e27965eb1af85d P e5256d91808b47c195bc9b4dbd7f2b87 [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 13:07:41.268679 19377 leader_election.cc:304] T b08304a0a02b42d7840c4e8ee9a6bd1a P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:07:41.269788 19377 leader_election.cc:304] T 1dc5b3532fe54f74876d02beffa2c230 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:07:41.267958 27193 raft_consensus.cc:2749] T 3e1f505cb0f1427bbd698ac889d80821 P e5256d91808b47c195bc9b4dbd7f2b87 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:07:41.270656 27193 raft_consensus.cc:2749] T 2a16f7501e2444fb86d4e2778e734e02 P e5256d91808b47c195bc9b4dbd7f2b87 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:07:41.271044 19377 leader_election.cc:304] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, 127766fc592545a4997f7790f50f6076
I20260709 13:07:41.273661 19377 leader_election.cc:304] T ff75a1d4cb1f493db8f71ddc136ba9ab P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:07:41.279992 27176 raft_consensus.cc:2749] T f1b10566f45d4a7d9029858330e02d5b P e5256d91808b47c195bc9b4dbd7f2b87 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:07:41.286947 27159 raft_consensus.cc:515] T 4509b76741dc428e9201c70c1658da13 P e5256d91808b47c195bc9b4dbd7f2b87 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:07:41.282729 27173 raft_consensus.cc:2804] T 7f575b143b844aa096b50997dad3516a P e5256d91808b47c195bc9b4dbd7f2b87 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:07:41.288892 27173 raft_consensus.cc:493] T 7f575b143b844aa096b50997dad3516a P e5256d91808b47c195bc9b4dbd7f2b87 [term 21 FOLLOWER]: Starting leader election (detected failure of leader 0473d2b2d01f4459b1e90fd12cc7840e)
I20260709 13:07:41.289314 27173 raft_consensus.cc:3060] T 7f575b143b844aa096b50997dad3516a P e5256d91808b47c195bc9b4dbd7f2b87 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:07:41.290096 27152 leader_election.cc:290] T 40e1e16737a842ee936002830f36882e P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
W20260709 13:07:41.291720 20076 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.3:36891, user_credentials={real_user=slave}} blocked reactor thread for 572196us
I20260709 13:07:41.293780 27098 raft_consensus.cc:515] T f1b10566f45d4a7d9029858330e02d5b P e61c3a8f61bb48f8a963c9480e53c168 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:07:41.296947 19551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc225c93219c45538b53a1bd3d387e4d" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:07:41.300283 27098 leader_election.cc:290] T f1b10566f45d4a7d9029858330e02d5b P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:07:41.301520 27176 raft_consensus.cc:2749] T b08304a0a02b42d7840c4e8ee9a6bd1a P e5256d91808b47c195bc9b4dbd7f2b87 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:07:41.302484 27176 raft_consensus.cc:2749] T 1dc5b3532fe54f74876d02beffa2c230 P e5256d91808b47c195bc9b4dbd7f2b87 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:07:41.303162 20078 leader_election.cc:304] T 0e1085d23e8347fbbd5bce7542f4b1f4 P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 127766fc592545a4997f7790f50f6076; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:07:41.304286 20078 leader_election.cc:304] T 6c5eebf646ad445a9d1b1adc319d7b16 P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 127766fc592545a4997f7790f50f6076; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:07:41.303735 27176 raft_consensus.cc:2749] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P e5256d91808b47c195bc9b4dbd7f2b87 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
W20260709 13:07:41.311609 19375 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.3:36891, user_credentials={real_user=slave}} blocked reactor thread for 65390us
I20260709 13:07:41.312790 20106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed7fdbcb96d14d418db9ca90a792588a" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
W20260709 13:07:41.324169 19377 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.2:46257, user_credentials={real_user=slave}} blocked reactor thread for 50593.8us
I20260709 13:07:41.325786 19377 leader_election.cc:304] T 1f85fc4b527a48848e5faa083b604e36 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87; no voters: 127766fc592545a4997f7790f50f6076
I20260709 13:07:41.312831 19375 leader_election.cc:304] T 2725d2c4cb054f18b0fc8f735c15f6c2 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:07:41.329238 19552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a08760e15aac4630a629431f56024dc8" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 25 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:07:41.329988 19551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f93ee515a9c14139bf566522ed8232f3" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 26 candidate_status { last_received { term: 25 index: 13 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:07:41.330600 19551 raft_consensus.cc:3060] T f93ee515a9c14139bf566522ed8232f3 P e61c3a8f61bb48f8a963c9480e53c168 [term 25 FOLLOWER]: Advancing to term 26
I20260709 13:07:41.323329 27192 raft_consensus.cc:2749] T 0e1085d23e8347fbbd5bce7542f4b1f4 P 127766fc592545a4997f7790f50f6076 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:07:41.341604 27159 leader_election.cc:290] T 4509b76741dc428e9201c70c1658da13 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 17 election: Requested vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:07:41.342330 27159 raft_consensus.cc:2749] T ff75a1d4cb1f493db8f71ddc136ba9ab P e5256d91808b47c195bc9b4dbd7f2b87 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:07:41.344000 27173 raft_consensus.cc:515] T 7f575b143b844aa096b50997dad3516a P e5256d91808b47c195bc9b4dbd7f2b87 [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:07:41.346168 27173 leader_election.cc:290] T 7f575b143b844aa096b50997dad3516a P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 22 election: Requested vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:07:41.347695 20108 raft_consensus.cc:1275] T b9f0d59553ad444883fcf5b5909f9798 P 127766fc592545a4997f7790f50f6076 [term 16 LEARNER]: Refusing update from remote peer e61c3a8f61bb48f8a963c9480e53c168: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 13:07:41.351773 27197 raft_consensus.cc:2749] T 6c5eebf646ad445a9d1b1adc319d7b16 P 127766fc592545a4997f7790f50f6076 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:07:41.358300 19551 raft_consensus.cc:2468] T f93ee515a9c14139bf566522ed8232f3 P e61c3a8f61bb48f8a963c9480e53c168 [term 26 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e5256d91808b47c195bc9b4dbd7f2b87 in term 26.
I20260709 13:07:41.360155 19483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46c5bfeecc314717bffe987e6844b6d0" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 28 candidate_status { last_received { term: 27 index: 14 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:07:41.366109 27198 raft_consensus.cc:2804] T 2725d2c4cb054f18b0fc8f735c15f6c2 P e5256d91808b47c195bc9b4dbd7f2b87 [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 13:07:41.368634 27194 raft_consensus.cc:2804] T 1f85fc4b527a48848e5faa083b604e36 P e5256d91808b47c195bc9b4dbd7f2b87 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:07:41.369459 27194 raft_consensus.cc:493] T 1f85fc4b527a48848e5faa083b604e36 P e5256d91808b47c195bc9b4dbd7f2b87 [term 20 FOLLOWER]: Starting leader election (detected failure of leader 127766fc592545a4997f7790f50f6076)
I20260709 13:07:41.370307 27194 raft_consensus.cc:3060] T 1f85fc4b527a48848e5faa083b604e36 P e5256d91808b47c195bc9b4dbd7f2b87 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:07:41.366591 27198 raft_consensus.cc:493] T 2725d2c4cb054f18b0fc8f735c15f6c2 P e5256d91808b47c195bc9b4dbd7f2b87 [term 23 FOLLOWER]: Starting leader election (detected failure of leader 0473d2b2d01f4459b1e90fd12cc7840e)
I20260709 13:07:41.373982 19555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48824d5acfbc485ebf8c2d944e7202de" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:07:41.374297 27198 raft_consensus.cc:3060] T 2725d2c4cb054f18b0fc8f735c15f6c2 P e5256d91808b47c195bc9b4dbd7f2b87 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:07:41.379101 19553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4509b76741dc428e9201c70c1658da13" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:07:41.398394 19554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "217b5fae677b4971b3bbd2f357a1f7ff" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:07:41.351343 27170 raft_consensus.cc:515] T ef32ce6fdd0e40d382c79974f30295c6 P e5256d91808b47c195bc9b4dbd7f2b87 [term 25 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:07:41.402962 27170 leader_election.cc:290] T ef32ce6fdd0e40d382c79974f30295c6 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 25 election: Requested vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:07:41.403088 27198 raft_consensus.cc:515] T 2725d2c4cb054f18b0fc8f735c15f6c2 P e5256d91808b47c195bc9b4dbd7f2b87 [term 24 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:07:41.405216 19560 raft_consensus.cc:1240] T f93ee515a9c14139bf566522ed8232f3 P e61c3a8f61bb48f8a963c9480e53c168 [term 26 FOLLOWER]: Rejecting Update request from peer 0473d2b2d01f4459b1e90fd12cc7840e for earlier term 25. Current term is 26. Ops: []
I20260709 13:07:41.405059 19480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f93ee515a9c14139bf566522ed8232f3" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 26 candidate_status { last_received { term: 25 index: 13 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:07:41.405936 19304 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:44688 (request call id 275) took 2163 ms. Trace:
I20260709 13:07:41.407838 19556 raft_consensus.cc:1275] T fa8650e71aa14778b3d73721fc50d9fc P e61c3a8f61bb48f8a963c9480e53c168 [term 22 FOLLOWER]: Refusing update from remote peer 0473d2b2d01f4459b1e90fd12cc7840e: Log matching property violated. Preceding OpId in replica: term: 22 index: 14. Preceding OpId from leader: term: 22 index: 15. (index mismatch)
I20260709 13:07:41.412457 19304 rpcz_store.cc:276] 0709 13:07:39.242547 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:39.247156 (+  4609us) service_pool.cc:224] Handling call
0709 13:07:40.596639 (+1349483us) spinlock_profiling.cc:243] Waited 3.3 ms on lock 0x7b54003fb6d4. stack: 00007f4a79de9343 00007f4a79de9240 00007f4a797781d4 00007f4a834b6304 00007f4a834b6299 00007f4a7ce72090 00007f4a7cf10f3a 00007f4a82cc71cc 00007f4a82dc537e 00007f4a812862a4 00007f4a81286232 00007f4a81286161 00007f4a812860dc 00007f4a81285392 00007f4a7b24348c 00007f4a7b2428c6
0709 13:07:41.405748 (+809109us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":555506,"reported_tablets":1,"spinlock_wait_cycles":7586688}
W20260709 13:07:41.434499 19377 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.2:46257, user_credentials={real_user=slave}} blocked reactor thread for 108814us
I20260709 13:07:41.435787 19377 leader_election.cc:304] T 21e14947d70440f19044d8f75c31e1f9 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, 127766fc592545a4997f7790f50f6076
I20260709 13:07:41.405074 27198 leader_election.cc:290] T 2725d2c4cb054f18b0fc8f735c15f6c2 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 24 election: Requested vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:07:41.438645 19377 leader_election.cc:304] T 217b5fae677b4971b3bbd2f357a1f7ff P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:07:41.445385 19377 leader_election.cc:304] T 179fd671030940b4b4a4e24bcc4aba0a P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:07:41.448263 19486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14efcc79969f41babe5529c22d59156d" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
W20260709 13:07:41.450266 20078 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.2:46257, user_credentials={real_user=slave}} blocked reactor thread for 146037us
I20260709 13:07:41.451290 19377 leader_election.cc:304] T 1a61655d99124a29b486ba4a5b37faea P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:07:41.440064 27204 raft_consensus.cc:2749] T 21e14947d70440f19044d8f75c31e1f9 P e5256d91808b47c195bc9b4dbd7f2b87 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
W20260709 13:07:41.459641 19524 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:41.459474 19377 leader_election.cc:304] T 86a6797bdfe94fa496c050ceae4bd0d9 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:07:41.462899 26961 raft_consensus.cc:2749] T 1a61655d99124a29b486ba4a5b37faea P e5256d91808b47c195bc9b4dbd7f2b87 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:07:41.465235 19556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4509b76741dc428e9201c70c1658da13" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:07:41.466135 19301 catalog_manager.cc:5697] T d1e5873a19244c5ebbcd38e126796ee7 P 127766fc592545a4997f7790f50f6076 reported cstate change: config changed from index 12 to 13, 127766fc592545a4997f7790f50f6076 (127.17.223.4) changed from NON_VOTER to VOTER. New cstate: current_term: 22 leader_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" committed_config { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } attrs { replace: true } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } } }
I20260709 13:07:41.450768 27128 raft_consensus.cc:2749] T 217b5fae677b4971b3bbd2f357a1f7ff P e5256d91808b47c195bc9b4dbd7f2b87 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:07:41.504045 27170 raft_consensus.cc:2749] T 86a6797bdfe94fa496c050ceae4bd0d9 P e5256d91808b47c195bc9b4dbd7f2b87 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:07:41.505725 19483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed7fdbcb96d14d418db9ca90a792588a" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:07:41.476318 19377 leader_election.cc:304] T 46c5bfeecc314717bffe987e6844b6d0 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:07:41.477000 19551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2725d2c4cb054f18b0fc8f735c15f6c2" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 24 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:07:41.479420 19554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f575b143b844aa096b50997dad3516a" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:07:41.481069 27194 raft_consensus.cc:515] T 1f85fc4b527a48848e5faa083b604e36 P e5256d91808b47c195bc9b4dbd7f2b87 [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
W20260709 13:07:41.487957 20075 consensus_peers.cc:597] T 70797e5783b5454ab0d0eea663e791e3 P 127766fc592545a4997f7790f50f6076 -> Peer e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321): Couldn't send request to peer e5256d91808b47c195bc9b4dbd7f2b87. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:07:41.455523 27193 raft_consensus.cc:2749] T 179fd671030940b4b4a4e24bcc4aba0a P e5256d91808b47c195bc9b4dbd7f2b87 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:07:41.490015 19375 leader_election.cc:304] T a08760e15aac4630a629431f56024dc8 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:07:41.507555 19486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14935b3ddf914369822e4a0547aaa355" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:07:41.476733 19553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef32ce6fdd0e40d382c79974f30295c6" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 25 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:07:41.510251 19482 raft_consensus.cc:1275] T b9f0d59553ad444883fcf5b5909f9798 P 0473d2b2d01f4459b1e90fd12cc7840e [term 16 FOLLOWER]: Refusing update from remote peer e61c3a8f61bb48f8a963c9480e53c168: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 13:07:41.512238 27170 raft_consensus.cc:2749] T 46c5bfeecc314717bffe987e6844b6d0 P e5256d91808b47c195bc9b4dbd7f2b87 [term 27 FOLLOWER]: Leader pre-election lost for term 28. Reason: could not achieve majority
I20260709 13:07:41.513038 19481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86a6797bdfe94fa496c050ceae4bd0d9" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:07:41.530310 19482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa8650e71aa14778b3d73721fc50d9fc" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:07:41.541954 19483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a61655d99124a29b486ba4a5b37faea" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:07:41.534327 19485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "179fd671030940b4b4a4e24bcc4aba0a" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 24 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
W20260709 13:07:41.547885 19450 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.3:36891, user_credentials={real_user=slave}} blocked reactor thread for 66686.1us
W20260709 13:07:41.549256 19375 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.3:36891, user_credentials={real_user=slave}} blocked reactor thread for 59343us
W20260709 13:07:41.534871 20075 consensus_peers.cc:597] T 1f85fc4b527a48848e5faa083b604e36 P 127766fc592545a4997f7790f50f6076 -> Peer e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321): Couldn't send request to peer e5256d91808b47c195bc9b4dbd7f2b87. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:07:41.548286 20110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14935b3ddf914369822e4a0547aaa355" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
W20260709 13:07:41.556399 20075 consensus_peers.cc:597] T 2a16f7501e2444fb86d4e2778e734e02 P 127766fc592545a4997f7790f50f6076 -> Peer e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321): Couldn't send request to peer e5256d91808b47c195bc9b4dbd7f2b87. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:07:41.559178 19523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.1:40321, user_credentials={real_user=slave}} blocked reactor thread for 80240.3us
I20260709 13:07:41.560281 19478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1b10566f45d4a7d9029858330e02d5b" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:07:41.561786 19375 leader_election.cc:304] T 40e1e16737a842ee936002830f36882e P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168; no voters: 0473d2b2d01f4459b1e90fd12cc7840e
I20260709 13:07:41.566648 19450 leader_election.cc:304] T 48824d5acfbc485ebf8c2d944e7202de P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e; no voters: 127766fc592545a4997f7790f50f6076, e61c3a8f61bb48f8a963c9480e53c168
W20260709 13:07:41.575177 19523 leader_election.cc:336] T 7f575b143b844aa096b50997dad3516a P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:07:41.608933 27196 raft_consensus.cc:2749] T a08760e15aac4630a629431f56024dc8 P e5256d91808b47c195bc9b4dbd7f2b87 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:07:41.609452 27206 raft_consensus.cc:2749] T 48824d5acfbc485ebf8c2d944e7202de P 0473d2b2d01f4459b1e90fd12cc7840e [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:07:41.570173 26961 raft_consensus.cc:2804] T 40e1e16737a842ee936002830f36882e P e5256d91808b47c195bc9b4dbd7f2b87 [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 13:07:41.609787 19484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b08304a0a02b42d7840c4e8ee9a6bd1a" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 24 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:07:41.610183 26961 raft_consensus.cc:493] T 40e1e16737a842ee936002830f36882e P e5256d91808b47c195bc9b4dbd7f2b87 [term 24 FOLLOWER]: Starting leader election (detected failure of leader 0473d2b2d01f4459b1e90fd12cc7840e)
I20260709 13:07:41.610616 26961 raft_consensus.cc:3060] T 40e1e16737a842ee936002830f36882e P e5256d91808b47c195bc9b4dbd7f2b87 [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:07:41.610801 27194 leader_election.cc:290] T 1f85fc4b527a48848e5faa083b604e36 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 21 election: Requested vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
W20260709 13:07:41.605808 20075 leader_election.cc:336] T 309c3ca0ca4b4f3ba129752ea2cb293b P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:07:41.615167 20075 leader_election.cc:304] T 309c3ca0ca4b4f3ba129752ea2cb293b P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 127766fc592545a4997f7790f50f6076; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:07:41.618952 27202 raft_consensus.cc:2749] T 309c3ca0ca4b4f3ba129752ea2cb293b P 127766fc592545a4997f7790f50f6076 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:07:41.619655 20110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f85fc4b527a48848e5faa083b604e36" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076"
I20260709 13:07:41.625288 19526 leader_election.cc:304] T ed7fdbcb96d14d418db9ca90a792588a P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e61c3a8f61bb48f8a963c9480e53c168; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, 127766fc592545a4997f7790f50f6076
I20260709 13:07:41.608260 19523 leader_election.cc:304] T 7f575b143b844aa096b50997dad3516a P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e61c3a8f61bb48f8a963c9480e53c168; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:07:41.626966 27182 raft_consensus.cc:2749] T ed7fdbcb96d14d418db9ca90a792588a P e61c3a8f61bb48f8a963c9480e53c168 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:07:41.627140 27164 raft_consensus.cc:2749] T 7f575b143b844aa096b50997dad3516a P e61c3a8f61bb48f8a963c9480e53c168 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
W20260709 13:07:41.628544 19523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.1:40321, user_credentials={real_user=slave}} blocked reactor thread for 53422.4us
W20260709 13:07:41.629252 19523 consensus_peers.cc:597] T a08760e15aac4630a629431f56024dc8 P e61c3a8f61bb48f8a963c9480e53c168 -> Peer e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321): Couldn't send request to peer e5256d91808b47c195bc9b4dbd7f2b87. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:07:41.631882 20075 leader_election.cc:336] T bc225c93219c45538b53a1bd3d387e4d P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:07:41.632344 20075 leader_election.cc:304] T bc225c93219c45538b53a1bd3d387e4d P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 127766fc592545a4997f7790f50f6076; no voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168
W20260709 13:07:41.636622 19450 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.3:36891, user_credentials={real_user=slave}} blocked reactor thread for 70086.5us
W20260709 13:07:41.644512 19375 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.3:36891, user_credentials={real_user=slave}} blocked reactor thread for 82798.8us
I20260709 13:07:41.645218 19523 leader_election.cc:304] T 14935b3ddf914369822e4a0547aaa355 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e61c3a8f61bb48f8a963c9480e53c168; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, 127766fc592545a4997f7790f50f6076
I20260709 13:07:41.645206 19375 leader_election.cc:304] T f93ee515a9c14139bf566522ed8232f3 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 26 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:07:41.568303 27152 consensus_queue.cc:1048] T b9f0d59553ad444883fcf5b5909f9798 P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Connected to new peer: Peer: permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.070s
I20260709 13:07:41.658032 27191 raft_consensus.cc:2749] T bc225c93219c45538b53a1bd3d387e4d P 127766fc592545a4997f7790f50f6076 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:07:41.663743 27183 raft_consensus.cc:2955] T bc225c93219c45538b53a1bd3d387e4d P e61c3a8f61bb48f8a963c9480e53c168 [term 18 LEADER]: Committing config change with OpId 18.14: config changed from index 13 to 14, VOTER e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1) evicted. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } } }
I20260709 13:07:41.651211 27160 raft_consensus.cc:2804] T f93ee515a9c14139bf566522ed8232f3 P e5256d91808b47c195bc9b4dbd7f2b87 [term 26 FOLLOWER]: Leader election won for term 26
I20260709 13:07:41.671905 19479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40e1e16737a842ee936002830f36882e" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 25 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:07:41.653223 27115 raft_consensus.cc:2749] T 14935b3ddf914369822e4a0547aaa355 P e61c3a8f61bb48f8a963c9480e53c168 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:07:41.681195 27160 raft_consensus.cc:697] T f93ee515a9c14139bf566522ed8232f3 P e5256d91808b47c195bc9b4dbd7f2b87 [term 26 LEADER]: Becoming Leader. State: Replica: e5256d91808b47c195bc9b4dbd7f2b87, State: Running, Role: LEADER
I20260709 13:07:41.681556 20111 raft_consensus.cc:2955] T bc225c93219c45538b53a1bd3d387e4d P 127766fc592545a4997f7790f50f6076 [term 18 FOLLOWER]: Committing config change with OpId 18.14: config changed from index 13 to 14, VOTER e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1) evicted. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } } }
I20260709 13:07:41.689821 27105 consensus_queue.cc:1048] T b9f0d59553ad444883fcf5b5909f9798 P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.004s
I20260709 13:07:41.685562 27160 consensus_queue.cc:237] T f93ee515a9c14139bf566522ed8232f3 P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 25.13, Last appended by leader: 13, Current term: 26, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:07:41.665993 26961 raft_consensus.cc:515] T 40e1e16737a842ee936002830f36882e P e5256d91808b47c195bc9b4dbd7f2b87 [term 25 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
W20260709 13:07:41.703923 19449 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.4:43121, user_credentials={real_user=slave}} blocked reactor thread for 56671.2us
I20260709 13:07:41.705377 19449 leader_election.cc:304] T 5ec1c4ce15e04c7e8c283a62179f2a64 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e; no voters: 127766fc592545a4997f7790f50f6076, e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:07:41.724378 27144 raft_consensus.cc:2749] T 5ec1c4ce15e04c7e8c283a62179f2a64 P 0473d2b2d01f4459b1e90fd12cc7840e [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 13:07:41.740541 19450 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.3:36891, user_credentials={real_user=slave}} blocked reactor thread for 91913.4us
I20260709 13:07:41.744318 19554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40e1e16737a842ee936002830f36882e" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 25 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
W20260709 13:07:41.742826 19523 leader_election.cc:336] T ff75a1d4cb1f493db8f71ddc136ba9ab P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:07:41.741991 19450 leader_election.cc:304] T 4509b76741dc428e9201c70c1658da13 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e; no voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:07:41.727509 26961 leader_election.cc:290] T 40e1e16737a842ee936002830f36882e P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 25 election: Requested vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:07:41.750980 19523 leader_election.cc:304] T ff75a1d4cb1f493db8f71ddc136ba9ab P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e61c3a8f61bb48f8a963c9480e53c168; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:07:41.752094 19450 leader_election.cc:304] T 217b5fae677b4971b3bbd2f357a1f7ff P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e; no voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:07:41.766999 27071 raft_consensus.cc:2749] T 4509b76741dc428e9201c70c1658da13 P 0473d2b2d01f4459b1e90fd12cc7840e [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 13:07:41.754433 19523 consensus_peers.cc:597] T b9f0d59553ad444883fcf5b5909f9798 P e61c3a8f61bb48f8a963c9480e53c168 -> Peer e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321): Couldn't send request to peer e5256d91808b47c195bc9b4dbd7f2b87. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:07:41.772543 19523 leader_election.cc:336] T 40e1e16737a842ee936002830f36882e P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:07:41.795830 19449 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.4:43121, user_credentials={real_user=slave}} blocked reactor thread for 90524.5us
W20260709 13:07:41.798321 19523 leader_election.cc:336] T 1a61655d99124a29b486ba4a5b37faea P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:07:41.798822 19523 leader_election.cc:304] T 1a61655d99124a29b486ba4a5b37faea P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e61c3a8f61bb48f8a963c9480e53c168; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87
W20260709 13:07:41.800239 19523 leader_election.cc:336] T 179fd671030940b4b4a4e24bcc4aba0a P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:07:41.800746 19523 leader_election.cc:304] T 179fd671030940b4b4a4e24bcc4aba0a P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e61c3a8f61bb48f8a963c9480e53c168; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:07:41.806475 27155 raft_consensus.cc:2749] T 179fd671030940b4b4a4e24bcc4aba0a P e61c3a8f61bb48f8a963c9480e53c168 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:07:41.771876 27071 raft_consensus.cc:2749] T 217b5fae677b4971b3bbd2f357a1f7ff P 0473d2b2d01f4459b1e90fd12cc7840e [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
W20260709 13:07:41.811362 19523 leader_election.cc:336] T 86a6797bdfe94fa496c050ceae4bd0d9 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:07:41.811813 19523 leader_election.cc:304] T 86a6797bdfe94fa496c050ceae4bd0d9 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e61c3a8f61bb48f8a963c9480e53c168; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:07:41.812487 27155 raft_consensus.cc:2749] T 86a6797bdfe94fa496c050ceae4bd0d9 P e61c3a8f61bb48f8a963c9480e53c168 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 13:07:41.813676 19523 leader_election.cc:336] T b08304a0a02b42d7840c4e8ee9a6bd1a P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:07:41.814033 19523 leader_election.cc:304] T b08304a0a02b42d7840c4e8ee9a6bd1a P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e61c3a8f61bb48f8a963c9480e53c168; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:07:41.814651 27155 raft_consensus.cc:2749] T b08304a0a02b42d7840c4e8ee9a6bd1a P e61c3a8f61bb48f8a963c9480e53c168 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
W20260709 13:07:41.817231 19523 leader_election.cc:336] T fa8650e71aa14778b3d73721fc50d9fc P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:07:41.817592 19523 leader_election.cc:304] T fa8650e71aa14778b3d73721fc50d9fc P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e61c3a8f61bb48f8a963c9480e53c168; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:07:41.818241 27155 raft_consensus.cc:2749] T fa8650e71aa14778b3d73721fc50d9fc P e61c3a8f61bb48f8a963c9480e53c168 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
W20260709 13:07:41.819298 19523 leader_election.cc:336] T f1b10566f45d4a7d9029858330e02d5b P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:07:41.772317 27105 raft_consensus.cc:2749] T ff75a1d4cb1f493db8f71ddc136ba9ab P e61c3a8f61bb48f8a963c9480e53c168 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:07:41.819729 19523 leader_election.cc:304] T f1b10566f45d4a7d9029858330e02d5b P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e61c3a8f61bb48f8a963c9480e53c168; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:07:41.832243 27071 consensus_queue.cc:1048] T fa8650e71aa14778b3d73721fc50d9fc P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 13:07:41.828081 27155 raft_consensus.cc:2749] T f1b10566f45d4a7d9029858330e02d5b P e61c3a8f61bb48f8a963c9480e53c168 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:07:41.835548 27218 consensus_queue.cc:1059] T f93ee515a9c14139bf566522ed8232f3 P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 }, Status: INVALID_TERM, Last received: 25.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:07:41.804569 27152 raft_consensus.cc:2749] T 1a61655d99124a29b486ba4a5b37faea P e61c3a8f61bb48f8a963c9480e53c168 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:07:41.838976 19377 leader_election.cc:304] T 14efcc79969f41babe5529c22d59156d P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, 127766fc592545a4997f7790f50f6076
I20260709 13:07:41.844529 27158 raft_consensus.cc:2749] T 14efcc79969f41babe5529c22d59156d P e5256d91808b47c195bc9b4dbd7f2b87 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:07:41.847461 19484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4509b76741dc428e9201c70c1658da13" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:07:41.846796 19479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f93ee515a9c14139bf566522ed8232f3" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 26 candidate_status { last_received { term: 25 index: 13 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:07:41.869412 19478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef32ce6fdd0e40d382c79974f30295c6" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 25 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:07:41.891736 19479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2725d2c4cb054f18b0fc8f735c15f6c2" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 24 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:07:41.905607 27183 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.ChangeConfig from 127.0.0.1:49904 (request call id 9) took 2281 ms. Trace:
I20260709 13:07:41.907073 19485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40e1e16737a842ee936002830f36882e" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 25 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:07:41.909457 19486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc225c93219c45538b53a1bd3d387e4d" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
W20260709 13:07:41.912329 19581 debug-util.cc:398] Leaking SignalData structure 0x7b08003299c0 after lost signal to thread 18303
W20260709 13:07:41.913682 19581 debug-util.cc:398] Leaking SignalData structure 0x7b0800286aa0 after lost signal to thread 19343
I20260709 13:07:41.916687 19484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f85fc4b527a48848e5faa083b604e36" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:07:41.914279 19477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f575b143b844aa096b50997dad3516a" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
W20260709 13:07:41.921260 19581 debug-util.cc:398] Leaking SignalData structure 0x7b08001331a0 after lost signal to thread 19412
W20260709 13:07:41.921627 19581 debug-util.cc:398] Leaking SignalData structure 0x7b08002e0520 after lost signal to thread 19435
W20260709 13:07:41.924134 19449 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.4:43121, user_credentials={real_user=slave}} blocked reactor thread for 103128us
I20260709 13:07:41.927683 19377 leader_election.cc:304] T 4509b76741dc428e9201c70c1658da13 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168
W20260709 13:07:41.937168 19581 debug-util.cc:398] Leaking SignalData structure 0x7b080017e0c0 after lost signal to thread 19510
W20260709 13:07:41.938378 19581 debug-util.cc:398] Leaking SignalData structure 0x7b0800308500 after lost signal to thread 19584
W20260709 13:07:41.939582 19581 debug-util.cc:398] Leaking SignalData structure 0x7b08002ba840 after lost signal to thread 20136
W20260709 13:07:41.939851 19581 debug-util.cc:398] Leaking SignalData structure 0x7b08002d6ee0 after lost signal to thread 20137
I20260709 13:07:41.834625 27071 consensus_queue.cc:1048] T fa8650e71aa14778b3d73721fc50d9fc P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Connected to new peer: Peer: permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.089s
I20260709 13:07:41.935202 19526 leader_election.cc:304] T 40e1e16737a842ee936002830f36882e P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e61c3a8f61bb48f8a963c9480e53c168; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:07:41.945320 19377 leader_election.cc:304] T ef32ce6fdd0e40d382c79974f30295c6 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 25 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:07:41.937100 19478 raft_consensus.cc:2955] T bc225c93219c45538b53a1bd3d387e4d P 0473d2b2d01f4459b1e90fd12cc7840e [term 18 FOLLOWER]: Committing config change with OpId 18.14: config changed from index 13 to 14, VOTER e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1) evicted. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } } }
I20260709 13:07:41.948944 27164 raft_consensus.cc:2749] T 40e1e16737a842ee936002830f36882e P e61c3a8f61bb48f8a963c9480e53c168 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:07:41.964075 27195 raft_consensus.cc:2749] T 4509b76741dc428e9201c70c1658da13 P e5256d91808b47c195bc9b4dbd7f2b87 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:07:41.951673 27193 raft_consensus.cc:2749] T ef32ce6fdd0e40d382c79974f30295c6 P e5256d91808b47c195bc9b4dbd7f2b87 [term 25 FOLLOWER]: Leader election lost for term 25. Reason: could not achieve majority
I20260709 13:07:41.966727 19377 leader_election.cc:304] T 40e1e16737a842ee936002830f36882e P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 25 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:07:41.907907 27183 rpcz_store.cc:276] 0709 13:07:39.624603 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:40.320196 (+695593us) service_pool.cc:224] Handling call
0709 13:07:40.367908 (+ 47712us) log.cc:844] Serialized 494 byte log entry
0709 13:07:41.905502 (+1537594us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":10162,"raft.queue_time_us":26889,"raft.run_cpu_time_us":1430,"raft.run_wall_time_us":51420,"thread_start_us":232967,"threads_started":2,"wal-append.queue_time_us":77579,"wal-append.run_cpu_time_us":2031,"wal-append.run_wall_time_us":1045523}
I20260709 13:07:42.004779 27213 raft_consensus.cc:3055] T f93ee515a9c14139bf566522ed8232f3 P 0473d2b2d01f4459b1e90fd12cc7840e [term 25 LEADER]: Stepping down as leader of term 25
I20260709 13:07:42.005424 27213 raft_consensus.cc:740] T f93ee515a9c14139bf566522ed8232f3 P 0473d2b2d01f4459b1e90fd12cc7840e [term 25 LEADER]: Becoming Follower/Learner. State: Replica: 0473d2b2d01f4459b1e90fd12cc7840e, State: Running, Role: LEADER
I20260709 13:07:42.006292 27213 consensus_queue.cc:260] T f93ee515a9c14139bf566522ed8232f3 P 0473d2b2d01f4459b1e90fd12cc7840e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 25.13, Last appended by leader: 13, Current term: 25, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:07:41.995985 27193 raft_consensus.cc:2749] T 40e1e16737a842ee936002830f36882e P e5256d91808b47c195bc9b4dbd7f2b87 [term 25 FOLLOWER]: Leader election lost for term 25. Reason: could not achieve majority
I20260709 13:07:42.028085 27213 raft_consensus.cc:3060] T f93ee515a9c14139bf566522ed8232f3 P 0473d2b2d01f4459b1e90fd12cc7840e [term 25 FOLLOWER]: Advancing to term 26
I20260709 13:07:42.043614 19294 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet bc225c93219c45538b53a1bd3d387e4d with cas_config_opid_index 13: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:07:42.027220 19377 leader_election.cc:304] T 2725d2c4cb054f18b0fc8f735c15f6c2 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 24 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168
W20260709 13:07:42.100517 19377 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.2:46257, user_credentials={real_user=slave}} blocked reactor thread for 73385.6us
I20260709 13:07:42.101239 19377 leader_election.cc:304] T 7f575b143b844aa096b50997dad3516a P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168
W20260709 13:07:42.102931 19449 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.1:40321, user_credentials={real_user=slave}} blocked reactor thread for 162247us
I20260709 13:07:42.103991 27196 raft_consensus.cc:2749] T 2725d2c4cb054f18b0fc8f735c15f6c2 P e5256d91808b47c195bc9b4dbd7f2b87 [term 24 FOLLOWER]: Leader election lost for term 24. Reason: could not achieve majority
I20260709 13:07:42.114332 27159 raft_consensus.cc:2749] T 7f575b143b844aa096b50997dad3516a P e5256d91808b47c195bc9b4dbd7f2b87 [term 22 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
I20260709 13:07:42.119802 19377 leader_election.cc:304] T 1f85fc4b527a48848e5faa083b604e36 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, 127766fc592545a4997f7790f50f6076
I20260709 13:07:42.135612 27164 raft_consensus.cc:2955] T b9f0d59553ad444883fcf5b5909f9798 P e61c3a8f61bb48f8a963c9480e53c168 [term 16 LEADER]: Committing config change with OpId 16.13: config changed from index 12 to 13, 127766fc592545a4997f7790f50f6076 (127.17.223.4) changed from NON_VOTER to VOTER. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } attrs { replace: true } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } } }
I20260709 13:07:42.137894 19485 raft_consensus.cc:2955] T b9f0d59553ad444883fcf5b5909f9798 P 0473d2b2d01f4459b1e90fd12cc7840e [term 16 FOLLOWER]: Committing config change with OpId 16.13: config changed from index 12 to 13, 127766fc592545a4997f7790f50f6076 (127.17.223.4) changed from NON_VOTER to VOTER. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } attrs { replace: true } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } } }
I20260709 13:07:42.140810 19557 raft_consensus.cc:1275] T f93ee515a9c14139bf566522ed8232f3 P e61c3a8f61bb48f8a963c9480e53c168 [term 26 FOLLOWER]: Refusing update from remote peer e5256d91808b47c195bc9b4dbd7f2b87: Log matching property violated. Preceding OpId in replica: term: 25 index: 13. Preceding OpId from leader: term: 26 index: 14. (index mismatch)
I20260709 13:07:42.128051 19301 catalog_manager.cc:5697] T bc225c93219c45538b53a1bd3d387e4d P 127766fc592545a4997f7790f50f6076 reported cstate change: config changed from index 13 to 14, VOTER e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1) evicted. New cstate: current_term: 18 leader_uuid: "e61c3a8f61bb48f8a963c9480e53c168" committed_config { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } } }
I20260709 13:07:42.130393 27160 raft_consensus.cc:2749] T 1f85fc4b527a48848e5faa083b604e36 P e5256d91808b47c195bc9b4dbd7f2b87 [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 13:07:42.156769 27176 consensus_queue.cc:1048] T f93ee515a9c14139bf566522ed8232f3 P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:07:42.243764 27213 raft_consensus.cc:2955] T fa8650e71aa14778b3d73721fc50d9fc P 0473d2b2d01f4459b1e90fd12cc7840e [term 22 LEADER]: Committing config change with OpId 22.15: config changed from index 14 to 15, 127766fc592545a4997f7790f50f6076 (127.17.223.4) changed from NON_VOTER to VOTER. New config: { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } attrs { replace: true } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } } }
I20260709 13:07:42.258881 19483 raft_consensus.cc:1275] T f93ee515a9c14139bf566522ed8232f3 P 0473d2b2d01f4459b1e90fd12cc7840e [term 26 FOLLOWER]: Refusing update from remote peer e5256d91808b47c195bc9b4dbd7f2b87: Log matching property violated. Preceding OpId in replica: term: 25 index: 13. Preceding OpId from leader: term: 26 index: 14. (index mismatch)
I20260709 13:07:42.266566 19554 raft_consensus.cc:2955] T fa8650e71aa14778b3d73721fc50d9fc P e61c3a8f61bb48f8a963c9480e53c168 [term 22 FOLLOWER]: Committing config change with OpId 22.15: config changed from index 14 to 15, 127766fc592545a4997f7790f50f6076 (127.17.223.4) changed from NON_VOTER to VOTER. New config: { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } attrs { replace: true } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } } }
I20260709 13:07:42.270329 27160 consensus_queue.cc:1048] T f93ee515a9c14139bf566522ed8232f3 P e5256d91808b47c195bc9b4dbd7f2b87 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:07:42.271343 19305 catalog_manager.cc:5697] T f93ee515a9c14139bf566522ed8232f3 P e5256d91808b47c195bc9b4dbd7f2b87 reported cstate change: term changed from 25 to 26, leader changed from 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2) to e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1). New cstate: current_term: 26 leader_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:42.274853 20110 raft_consensus.cc:2955] T fa8650e71aa14778b3d73721fc50d9fc P 127766fc592545a4997f7790f50f6076 [term 22 FOLLOWER]: Committing config change with OpId 22.15: config changed from index 14 to 15, 127766fc592545a4997f7790f50f6076 (127.17.223.4) changed from NON_VOTER to VOTER. New config: { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } attrs { replace: true } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } } }
W20260709 13:07:42.281144 19293 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.ChangeConfig -> {remote=127.17.223.1:40321, user_credentials={real_user=slave}} blocked reactor thread for 49321.1us
W20260709 13:07:42.321005 19293 catalog_manager.cc:4755] TS e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321): ChangeConfig:REMOVE_PEER RPC failed for tablet d1e5873a19244c5ebbcd38e126796ee7: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:07:42.402743 19450 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.3:36891, user_credentials={real_user=slave}} blocked reactor thread for 62984.9us
I20260709 13:07:42.424767 18300 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:07:42.429054 20111 raft_consensus.cc:2955] T b9f0d59553ad444883fcf5b5909f9798 P 127766fc592545a4997f7790f50f6076 [term 16 FOLLOWER]: Committing config change with OpId 16.13: config changed from index 12 to 13, 127766fc592545a4997f7790f50f6076 (127.17.223.4) changed from NON_VOTER to VOTER. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } attrs { replace: true } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } } }
I20260709 13:07:42.447522 18300 tablet_replica.cc:333] T 179fd671030940b4b4a4e24bcc4aba0a P e5256d91808b47c195bc9b4dbd7f2b87: stopping tablet replica
I20260709 13:07:42.459225 19302 catalog_manager.cc:5697] T fa8650e71aa14778b3d73721fc50d9fc P 127766fc592545a4997f7790f50f6076 reported cstate change: config changed from index 14 to 15, 127766fc592545a4997f7790f50f6076 (127.17.223.4) changed from NON_VOTER to VOTER. New cstate: current_term: 22 leader_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" committed_config { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } attrs { replace: true } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } } }
I20260709 13:07:42.461251 18300 raft_consensus.cc:2243] T 179fd671030940b4b4a4e24bcc4aba0a P e5256d91808b47c195bc9b4dbd7f2b87 [term 23 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:42.462080 18300 raft_consensus.cc:2272] T 179fd671030940b4b4a4e24bcc4aba0a P e5256d91808b47c195bc9b4dbd7f2b87 [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:42.511788 18300 tablet_replica.cc:333] T 28af091831594f9d8e96482078cc7625 P e5256d91808b47c195bc9b4dbd7f2b87: stopping tablet replica
W20260709 13:07:42.535424 19293 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.ChangeConfig -> {remote=127.17.223.1:40321, user_credentials={real_user=slave}} blocked reactor thread for 81228.7us
I20260709 13:07:42.534516 18300 raft_consensus.cc:2243] T 28af091831594f9d8e96482078cc7625 P e5256d91808b47c195bc9b4dbd7f2b87 [term 20 LEADER]: Raft consensus shutting down.
I20260709 13:07:42.551649 19305 catalog_manager.cc:5697] T b9f0d59553ad444883fcf5b5909f9798 P 127766fc592545a4997f7790f50f6076 reported cstate change: config changed from index 12 to 13, 127766fc592545a4997f7790f50f6076 (127.17.223.4) changed from NON_VOTER to VOTER. New cstate: current_term: 16 leader_uuid: "e61c3a8f61bb48f8a963c9480e53c168" committed_config { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } attrs { replace: true } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } } }
W20260709 13:07:42.584932 19377 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.2:46257, user_credentials={real_user=slave}} blocked reactor thread for 54501.3us
I20260709 13:07:42.590986 18300 raft_consensus.cc:2272] T 28af091831594f9d8e96482078cc7625 P e5256d91808b47c195bc9b4dbd7f2b87 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:42.612594 18300 tablet_replica.cc:333] T ff9b0eddd810459b82d91c60777c10eb P e5256d91808b47c195bc9b4dbd7f2b87: stopping tablet replica
I20260709 13:07:42.647590 18300 raft_consensus.cc:2243] T ff9b0eddd810459b82d91c60777c10eb P e5256d91808b47c195bc9b4dbd7f2b87 [term 22 LEADER]: Raft consensus shutting down.
I20260709 13:07:42.648995 18300 raft_consensus.cc:2272] T ff9b0eddd810459b82d91c60777c10eb P e5256d91808b47c195bc9b4dbd7f2b87 [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:42.684537 18300 tablet_replica.cc:333] T 2b74109013a140ada21feeef92d6f563 P e5256d91808b47c195bc9b4dbd7f2b87: stopping tablet replica
I20260709 13:07:42.685505 18300 raft_consensus.cc:2243] T 2b74109013a140ada21feeef92d6f563 P e5256d91808b47c195bc9b4dbd7f2b87 [term 18 LEADER]: Raft consensus shutting down.
I20260709 13:07:42.697106 18300 raft_consensus.cc:2272] T 2b74109013a140ada21feeef92d6f563 P e5256d91808b47c195bc9b4dbd7f2b87 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:42.700266 18300 tablet_replica.cc:333] T 1dc5b3532fe54f74876d02beffa2c230 P e5256d91808b47c195bc9b4dbd7f2b87: stopping tablet replica
I20260709 13:07:42.701179 18300 raft_consensus.cc:2243] T 1dc5b3532fe54f74876d02beffa2c230 P e5256d91808b47c195bc9b4dbd7f2b87 [term 24 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:42.701798 18300 raft_consensus.cc:2272] T 1dc5b3532fe54f74876d02beffa2c230 P e5256d91808b47c195bc9b4dbd7f2b87 [term 24 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:42.729346 18300 tablet_replica.cc:333] T 4509b76741dc428e9201c70c1658da13 P e5256d91808b47c195bc9b4dbd7f2b87: stopping tablet replica
I20260709 13:07:42.730259 18300 raft_consensus.cc:2243] T 4509b76741dc428e9201c70c1658da13 P e5256d91808b47c195bc9b4dbd7f2b87 [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:42.730878 18300 raft_consensus.cc:2272] T 4509b76741dc428e9201c70c1658da13 P e5256d91808b47c195bc9b4dbd7f2b87 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:42.733953 18300 tablet_replica.cc:333] T fa731b585f684a7fb2d106c50f143b83 P e5256d91808b47c195bc9b4dbd7f2b87: stopping tablet replica
I20260709 13:07:42.758869 18300 raft_consensus.cc:2243] T fa731b585f684a7fb2d106c50f143b83 P e5256d91808b47c195bc9b4dbd7f2b87 [term 16 LEADER]: Raft consensus shutting down.
I20260709 13:07:42.759969 18300 raft_consensus.cc:2272] T fa731b585f684a7fb2d106c50f143b83 P e5256d91808b47c195bc9b4dbd7f2b87 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:42.775907 18300 tablet_replica.cc:333] T 833a2f0775ed407a94b8924ce50adb63 P e5256d91808b47c195bc9b4dbd7f2b87: stopping tablet replica
I20260709 13:07:42.776798 18300 raft_consensus.cc:2243] T 833a2f0775ed407a94b8924ce50adb63 P e5256d91808b47c195bc9b4dbd7f2b87 [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:42.777448 18300 raft_consensus.cc:2272] T 833a2f0775ed407a94b8924ce50adb63 P e5256d91808b47c195bc9b4dbd7f2b87 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:42.789083 18300 tablet_replica.cc:333] T ece3db938bc649d4a40a51522ed5259c P e5256d91808b47c195bc9b4dbd7f2b87: stopping tablet replica
I20260709 13:07:42.789937 18300 raft_consensus.cc:2243] T ece3db938bc649d4a40a51522ed5259c P e5256d91808b47c195bc9b4dbd7f2b87 [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:42.790622 18300 raft_consensus.cc:2272] T ece3db938bc649d4a40a51522ed5259c P e5256d91808b47c195bc9b4dbd7f2b87 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:42.793345 18300 tablet_replica.cc:333] T 775c229504194560ba9589bc2199b089 P e5256d91808b47c195bc9b4dbd7f2b87: stopping tablet replica
I20260709 13:07:42.794132 18300 raft_consensus.cc:2243] T 775c229504194560ba9589bc2199b089 P e5256d91808b47c195bc9b4dbd7f2b87 [term 15 LEADER]: Raft consensus shutting down.
I20260709 13:07:42.815004 27240 raft_consensus.cc:493] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P e5256d91808b47c195bc9b4dbd7f2b87 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 127766fc592545a4997f7790f50f6076)
I20260709 13:07:42.815685 27240 raft_consensus.cc:515] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P e5256d91808b47c195bc9b4dbd7f2b87 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:07:42.818768 19484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36f6ba92b9ba46babe4ebd6c02e5fbd9" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 23 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:07:42.823304 18300 raft_consensus.cc:2272] T 775c229504194560ba9589bc2199b089 P e5256d91808b47c195bc9b4dbd7f2b87 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:42.830340 18300 tablet_replica.cc:333] T 5ec1c4ce15e04c7e8c283a62179f2a64 P e5256d91808b47c195bc9b4dbd7f2b87: stopping tablet replica
I20260709 13:07:42.831458 27240 leader_election.cc:290] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:07:42.832547 20111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36f6ba92b9ba46babe4ebd6c02e5fbd9" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 23 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:07:42.832541 18300 raft_consensus.cc:2243] T 5ec1c4ce15e04c7e8c283a62179f2a64 P e5256d91808b47c195bc9b4dbd7f2b87 [term 16 LEADER]: Raft consensus shutting down.
I20260709 13:07:42.834183 19374 leader_election.cc:304] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, 127766fc592545a4997f7790f50f6076
I20260709 13:07:42.834815 18300 raft_consensus.cc:2272] T 5ec1c4ce15e04c7e8c283a62179f2a64 P e5256d91808b47c195bc9b4dbd7f2b87 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:42.836396 27196 raft_consensus.cc:2749] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P e5256d91808b47c195bc9b4dbd7f2b87 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:07:42.846707 18300 tablet_replica.cc:333] T df751f992649444090e27965eb1af85d P e5256d91808b47c195bc9b4dbd7f2b87: stopping tablet replica
I20260709 13:07:42.847551 18300 raft_consensus.cc:2243] T df751f992649444090e27965eb1af85d P e5256d91808b47c195bc9b4dbd7f2b87 [term 25 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:42.848232 18300 raft_consensus.cc:2272] T df751f992649444090e27965eb1af85d P e5256d91808b47c195bc9b4dbd7f2b87 [term 25 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:42.851042 18300 tablet_replica.cc:333] T bc225c93219c45538b53a1bd3d387e4d P e5256d91808b47c195bc9b4dbd7f2b87: stopping tablet replica
I20260709 13:07:42.851866 18300 raft_consensus.cc:2243] T bc225c93219c45538b53a1bd3d387e4d P e5256d91808b47c195bc9b4dbd7f2b87 [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:42.852456 18300 pending_rounds.cc:70] T bc225c93219c45538b53a1bd3d387e4d P e5256d91808b47c195bc9b4dbd7f2b87: Trying to abort 1 pending ops.
I20260709 13:07:42.852684 18300 pending_rounds.cc:77] T bc225c93219c45538b53a1bd3d387e4d P e5256d91808b47c195bc9b4dbd7f2b87: Aborting op as it isn't in flight: id { term: 18 index: 13 } timestamp: 7305635669265362944 op_type: CHANGE_CONFIG_OP change_config_record { tablet_id: "bc225c93219c45538b53a1bd3d387e4d" old_config { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } attrs { replace: true } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: NON_VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: true } } } new_config { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } attrs { replace: true } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } } } }
I20260709 13:07:42.853854 18300 raft_consensus.cc:2917] T bc225c93219c45538b53a1bd3d387e4d P e5256d91808b47c195bc9b4dbd7f2b87 [term 18 FOLLOWER]: Aborting config change with OpId 18.13: Aborted: Op aborted
I20260709 13:07:42.854256 18300 raft_consensus.cc:2889] T bc225c93219c45538b53a1bd3d387e4d P e5256d91808b47c195bc9b4dbd7f2b87 [term 18 FOLLOWER]: CHANGE_CONFIG_OP replication failed: Aborted: Op aborted
I20260709 13:07:42.854583 18300 raft_consensus.cc:2272] T bc225c93219c45538b53a1bd3d387e4d P e5256d91808b47c195bc9b4dbd7f2b87 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:42.857947 18300 tablet_replica.cc:333] T 7f575b143b844aa096b50997dad3516a P e5256d91808b47c195bc9b4dbd7f2b87: stopping tablet replica
I20260709 13:07:42.859020 18300 raft_consensus.cc:2243] T 7f575b143b844aa096b50997dad3516a P e5256d91808b47c195bc9b4dbd7f2b87 [term 22 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:42.859606 18300 pending_rounds.cc:70] T 7f575b143b844aa096b50997dad3516a P e5256d91808b47c195bc9b4dbd7f2b87: Trying to abort 1 pending ops.
I20260709 13:07:42.859872 18300 pending_rounds.cc:77] T 7f575b143b844aa096b50997dad3516a P e5256d91808b47c195bc9b4dbd7f2b87: Aborting op as it isn't in flight: id { term: 21 index: 14 } timestamp: 7305635669096570880 op_type: NO_OP noop_request { }
I20260709 13:07:42.860217 18300 raft_consensus.cc:2889] T 7f575b143b844aa096b50997dad3516a P e5256d91808b47c195bc9b4dbd7f2b87 [term 22 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted
I20260709 13:07:42.860625 18300 raft_consensus.cc:2272] T 7f575b143b844aa096b50997dad3516a P e5256d91808b47c195bc9b4dbd7f2b87 [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:42.887408 18300 tablet_replica.cc:333] T 9962423cb4e54fcfa5de01daf68a86e7 P e5256d91808b47c195bc9b4dbd7f2b87: stopping tablet replica
I20260709 13:07:42.888294 18300 raft_consensus.cc:2243] T 9962423cb4e54fcfa5de01daf68a86e7 P e5256d91808b47c195bc9b4dbd7f2b87 [term 19 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:42.888926 18300 raft_consensus.cc:2272] T 9962423cb4e54fcfa5de01daf68a86e7 P e5256d91808b47c195bc9b4dbd7f2b87 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:42.896513 18300 tablet_replica.cc:333] T 172b3dd13109415a955b71ac0e9d2234 P e5256d91808b47c195bc9b4dbd7f2b87: stopping tablet replica
I20260709 13:07:42.897368 18300 raft_consensus.cc:2243] T 172b3dd13109415a955b71ac0e9d2234 P e5256d91808b47c195bc9b4dbd7f2b87 [term 19 LEADER]: Raft consensus shutting down.
I20260709 13:07:42.915340 18300 raft_consensus.cc:2272] T 172b3dd13109415a955b71ac0e9d2234 P e5256d91808b47c195bc9b4dbd7f2b87 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:42.949397 18300 tablet_replica.cc:333] T 65d8cb8d6ec64f459d5a47cefab10acf P e5256d91808b47c195bc9b4dbd7f2b87: stopping tablet replica
I20260709 13:07:42.952359 18300 raft_consensus.cc:2243] T 65d8cb8d6ec64f459d5a47cefab10acf P e5256d91808b47c195bc9b4dbd7f2b87 [term 21 LEADER]: Raft consensus shutting down.
I20260709 13:07:42.953863 18300 raft_consensus.cc:2272] T 65d8cb8d6ec64f459d5a47cefab10acf P e5256d91808b47c195bc9b4dbd7f2b87 [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:42.956748 18300 tablet_replica.cc:333] T ef32ce6fdd0e40d382c79974f30295c6 P e5256d91808b47c195bc9b4dbd7f2b87: stopping tablet replica
I20260709 13:07:42.957607 18300 raft_consensus.cc:2243] T ef32ce6fdd0e40d382c79974f30295c6 P e5256d91808b47c195bc9b4dbd7f2b87 [term 25 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:42.958127 18300 raft_consensus.cc:2272] T ef32ce6fdd0e40d382c79974f30295c6 P e5256d91808b47c195bc9b4dbd7f2b87 [term 25 FOLLOWER]: Raft consensus is shut down!
W20260709 13:07:42.966619 19523 consensus_peers.cc:597] T 22196caba61445d3bec98a0aab3c337d P e61c3a8f61bb48f8a963c9480e53c168 -> Peer e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321): Couldn't send request to peer e5256d91808b47c195bc9b4dbd7f2b87. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:07:42.977862 27240 raft_consensus.cc:493] T 2a16f7501e2444fb86d4e2778e734e02 P e5256d91808b47c195bc9b4dbd7f2b87 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 127766fc592545a4997f7790f50f6076)
I20260709 13:07:42.991478 27240 raft_consensus.cc:515] T 2a16f7501e2444fb86d4e2778e734e02 P e5256d91808b47c195bc9b4dbd7f2b87 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:07:42.993820 27240 leader_election.cc:290] T 2a16f7501e2444fb86d4e2778e734e02 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:07:42.994501 19557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a16f7501e2444fb86d4e2778e734e02" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:07:42.996658 20111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a16f7501e2444fb86d4e2778e734e02" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:07:42.999662 19375 leader_election.cc:304] T 2a16f7501e2444fb86d4e2778e734e02 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87; no voters: 127766fc592545a4997f7790f50f6076, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:07:43.000836 27240 raft_consensus.cc:2749] T 2a16f7501e2444fb86d4e2778e734e02 P e5256d91808b47c195bc9b4dbd7f2b87 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:07:43.019449 18300 tablet_replica.cc:333] T b08304a0a02b42d7840c4e8ee9a6bd1a P e5256d91808b47c195bc9b4dbd7f2b87: stopping tablet replica
I20260709 13:07:43.020505 18300 raft_consensus.cc:2243] T b08304a0a02b42d7840c4e8ee9a6bd1a P e5256d91808b47c195bc9b4dbd7f2b87 [term 23 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:43.021126 18300 raft_consensus.cc:2272] T b08304a0a02b42d7840c4e8ee9a6bd1a P e5256d91808b47c195bc9b4dbd7f2b87 [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:43.024199 18300 tablet_replica.cc:333] T f93ee515a9c14139bf566522ed8232f3 P e5256d91808b47c195bc9b4dbd7f2b87: stopping tablet replica
I20260709 13:07:43.025043 18300 raft_consensus.cc:2243] T f93ee515a9c14139bf566522ed8232f3 P e5256d91808b47c195bc9b4dbd7f2b87 [term 26 LEADER]: Raft consensus shutting down.
W20260709 13:07:43.045418 19523 consensus_peers.cc:597] T 4509b76741dc428e9201c70c1658da13 P e61c3a8f61bb48f8a963c9480e53c168 -> Peer e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321): Couldn't send request to peer e5256d91808b47c195bc9b4dbd7f2b87. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:07:43.051265 18300 raft_consensus.cc:2272] T f93ee515a9c14139bf566522ed8232f3 P e5256d91808b47c195bc9b4dbd7f2b87 [term 26 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:43.055456 18300 tablet_replica.cc:333] T 2725d2c4cb054f18b0fc8f735c15f6c2 P e5256d91808b47c195bc9b4dbd7f2b87: stopping tablet replica
I20260709 13:07:43.056351 18300 raft_consensus.cc:2243] T 2725d2c4cb054f18b0fc8f735c15f6c2 P e5256d91808b47c195bc9b4dbd7f2b87 [term 24 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:43.056948 18300 raft_consensus.cc:2272] T 2725d2c4cb054f18b0fc8f735c15f6c2 P e5256d91808b47c195bc9b4dbd7f2b87 [term 24 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:43.069312 18300 tablet_replica.cc:333] T ff75a1d4cb1f493db8f71ddc136ba9ab P e5256d91808b47c195bc9b4dbd7f2b87: stopping tablet replica
I20260709 13:07:43.070053 18300 raft_consensus.cc:2243] T ff75a1d4cb1f493db8f71ddc136ba9ab P e5256d91808b47c195bc9b4dbd7f2b87 [term 21 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:43.071543 18300 raft_consensus.cc:2272] T ff75a1d4cb1f493db8f71ddc136ba9ab P e5256d91808b47c195bc9b4dbd7f2b87 [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:43.086642 18300 tablet_replica.cc:333] T 0cdf56e38bbc453d9438d359e5a69955 P e5256d91808b47c195bc9b4dbd7f2b87: stopping tablet replica
I20260709 13:07:43.087559 18300 raft_consensus.cc:2243] T 0cdf56e38bbc453d9438d359e5a69955 P e5256d91808b47c195bc9b4dbd7f2b87 [term 22 LEADER]: Raft consensus shutting down.
I20260709 13:07:43.088685 18300 raft_consensus.cc:2272] T 0cdf56e38bbc453d9438d359e5a69955 P e5256d91808b47c195bc9b4dbd7f2b87 [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:43.092814 27240 raft_consensus.cc:493] T 3e1f505cb0f1427bbd698ac889d80821 P e5256d91808b47c195bc9b4dbd7f2b87 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader e61c3a8f61bb48f8a963c9480e53c168)
I20260709 13:07:43.093451 27240 raft_consensus.cc:515] T 3e1f505cb0f1427bbd698ac889d80821 P e5256d91808b47c195bc9b4dbd7f2b87 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:07:43.097177 27240 leader_election.cc:290] T 3e1f505cb0f1427bbd698ac889d80821 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:07:43.099690 19484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e1f505cb0f1427bbd698ac889d80821" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:07:43.101248 19557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e1f505cb0f1427bbd698ac889d80821" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:07:43.103513 19375 leader_election.cc:304] T 3e1f505cb0f1427bbd698ac889d80821 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:07:43.104408 27196 raft_consensus.cc:2749] T 3e1f505cb0f1427bbd698ac889d80821 P e5256d91808b47c195bc9b4dbd7f2b87 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:07:43.108774 18300 tablet_replica.cc:333] T 1a61655d99124a29b486ba4a5b37faea P e5256d91808b47c195bc9b4dbd7f2b87: stopping tablet replica
I20260709 13:07:43.109817 18300 raft_consensus.cc:2243] T 1a61655d99124a29b486ba4a5b37faea P e5256d91808b47c195bc9b4dbd7f2b87 [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:43.110576 18300 raft_consensus.cc:2272] T 1a61655d99124a29b486ba4a5b37faea P e5256d91808b47c195bc9b4dbd7f2b87 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:43.113478 18300 tablet_replica.cc:333] T 3e1f505cb0f1427bbd698ac889d80821 P e5256d91808b47c195bc9b4dbd7f2b87: stopping tablet replica
I20260709 13:07:43.115561 18300 raft_consensus.cc:2243] T 3e1f505cb0f1427bbd698ac889d80821 P e5256d91808b47c195bc9b4dbd7f2b87 [term 19 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:43.116330 18300 raft_consensus.cc:2272] T 3e1f505cb0f1427bbd698ac889d80821 P e5256d91808b47c195bc9b4dbd7f2b87 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:43.119514 18300 tablet_replica.cc:333] T 2a16f7501e2444fb86d4e2778e734e02 P e5256d91808b47c195bc9b4dbd7f2b87: stopping tablet replica
I20260709 13:07:43.120327 18300 raft_consensus.cc:2243] T 2a16f7501e2444fb86d4e2778e734e02 P e5256d91808b47c195bc9b4dbd7f2b87 [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:43.120931 18300 raft_consensus.cc:2272] T 2a16f7501e2444fb86d4e2778e734e02 P e5256d91808b47c195bc9b4dbd7f2b87 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:43.123942 18300 tablet_replica.cc:333] T 86a6797bdfe94fa496c050ceae4bd0d9 P e5256d91808b47c195bc9b4dbd7f2b87: stopping tablet replica
I20260709 13:07:43.124891 18300 raft_consensus.cc:2243] T 86a6797bdfe94fa496c050ceae4bd0d9 P e5256d91808b47c195bc9b4dbd7f2b87 [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:43.125859 18300 raft_consensus.cc:2272] T 86a6797bdfe94fa496c050ceae4bd0d9 P e5256d91808b47c195bc9b4dbd7f2b87 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:43.128543 18300 tablet_replica.cc:333] T 14efcc79969f41babe5529c22d59156d P e5256d91808b47c195bc9b4dbd7f2b87: stopping tablet replica
I20260709 13:07:43.129264 18300 raft_consensus.cc:2243] T 14efcc79969f41babe5529c22d59156d P e5256d91808b47c195bc9b4dbd7f2b87 [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:43.129804 18300 raft_consensus.cc:2272] T 14efcc79969f41babe5529c22d59156d P e5256d91808b47c195bc9b4dbd7f2b87 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:43.132918 18300 tablet_replica.cc:333] T d1e5873a19244c5ebbcd38e126796ee7 P e5256d91808b47c195bc9b4dbd7f2b87: stopping tablet replica
I20260709 13:07:43.137969 18300 raft_consensus.cc:2243] T d1e5873a19244c5ebbcd38e126796ee7 P e5256d91808b47c195bc9b4dbd7f2b87 [term 22 LEADER]: Raft consensus shutting down.
I20260709 13:07:43.139281 18300 raft_consensus.cc:2272] T d1e5873a19244c5ebbcd38e126796ee7 P e5256d91808b47c195bc9b4dbd7f2b87 [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:43.141806 18300 tablet_replica.cc:333] T 4af19371ea874c09a0a2147040835cbb P e5256d91808b47c195bc9b4dbd7f2b87: stopping tablet replica
I20260709 13:07:43.142501 18300 raft_consensus.cc:2243] T 4af19371ea874c09a0a2147040835cbb P e5256d91808b47c195bc9b4dbd7f2b87 [term 14 LEADER]: Raft consensus shutting down.
I20260709 13:07:43.143606 18300 raft_consensus.cc:2272] T 4af19371ea874c09a0a2147040835cbb P e5256d91808b47c195bc9b4dbd7f2b87 [term 14 FOLLOWER]: Raft consensus is shut down!
W20260709 13:07:43.144804 19449 consensus_peers.cc:597] T 40e1e16737a842ee936002830f36882e P 0473d2b2d01f4459b1e90fd12cc7840e -> Peer e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321): Couldn't send request to peer e5256d91808b47c195bc9b4dbd7f2b87. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:07:43.146202 18300 tablet_replica.cc:333] T b9f0d59553ad444883fcf5b5909f9798 P e5256d91808b47c195bc9b4dbd7f2b87: stopping tablet replica
I20260709 13:07:43.147115 18300 raft_consensus.cc:2243] T b9f0d59553ad444883fcf5b5909f9798 P e5256d91808b47c195bc9b4dbd7f2b87 [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:43.147931 18300 raft_consensus.cc:2272] T b9f0d59553ad444883fcf5b5909f9798 P e5256d91808b47c195bc9b4dbd7f2b87 [term 16 FOLLOWER]: Raft consensus is shut down!
W20260709 13:07:43.154911 20075 consensus_peers.cc:597] T 14efcc79969f41babe5529c22d59156d P 127766fc592545a4997f7790f50f6076 -> Peer e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321): Couldn't send request to peer e5256d91808b47c195bc9b4dbd7f2b87. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:07:43.158202 18300 tablet_replica.cc:333] T 40e1e16737a842ee936002830f36882e P e5256d91808b47c195bc9b4dbd7f2b87: stopping tablet replica
I20260709 13:07:43.159093 18300 raft_consensus.cc:2243] T 40e1e16737a842ee936002830f36882e P e5256d91808b47c195bc9b4dbd7f2b87 [term 25 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:43.159669 18300 raft_consensus.cc:2272] T 40e1e16737a842ee936002830f36882e P e5256d91808b47c195bc9b4dbd7f2b87 [term 25 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:43.162910 18300 tablet_replica.cc:333] T 309c3ca0ca4b4f3ba129752ea2cb293b P e5256d91808b47c195bc9b4dbd7f2b87: stopping tablet replica
I20260709 13:07:43.163734 18300 raft_consensus.cc:2243] T 309c3ca0ca4b4f3ba129752ea2cb293b P e5256d91808b47c195bc9b4dbd7f2b87 [term 15 LEADER]: Raft consensus shutting down.
I20260709 13:07:43.163972 27240 raft_consensus.cc:493] T 46c5bfeecc314717bffe987e6844b6d0 P e5256d91808b47c195bc9b4dbd7f2b87 [term 27 FOLLOWER]: Starting pre-election (detected failure of leader e61c3a8f61bb48f8a963c9480e53c168)
I20260709 13:07:43.164480 27240 raft_consensus.cc:515] T 46c5bfeecc314717bffe987e6844b6d0 P e5256d91808b47c195bc9b4dbd7f2b87 [term 27 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:07:43.166478 27240 leader_election.cc:290] T 46c5bfeecc314717bffe987e6844b6d0 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:07:43.168592 19557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46c5bfeecc314717bffe987e6844b6d0" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 28 candidate_status { last_received { term: 27 index: 14 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:07:43.170583 19484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46c5bfeecc314717bffe987e6844b6d0" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 28 candidate_status { last_received { term: 27 index: 14 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:07:43.172622 19377 leader_election.cc:304] T 46c5bfeecc314717bffe987e6844b6d0 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:07:43.173477 27240 raft_consensus.cc:2749] T 46c5bfeecc314717bffe987e6844b6d0 P e5256d91808b47c195bc9b4dbd7f2b87 [term 27 FOLLOWER]: Leader pre-election lost for term 28. Reason: could not achieve majority
I20260709 13:07:43.174991 18300 raft_consensus.cc:2272] T 309c3ca0ca4b4f3ba129752ea2cb293b P e5256d91808b47c195bc9b4dbd7f2b87 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:43.177690 18300 tablet_replica.cc:333] T 85c494af21f9457a85da47b9bc70c1fd P e5256d91808b47c195bc9b4dbd7f2b87: stopping tablet replica
I20260709 13:07:43.179350 18300 raft_consensus.cc:2243] T 85c494af21f9457a85da47b9bc70c1fd P e5256d91808b47c195bc9b4dbd7f2b87 [term 21 LEADER]: Raft consensus shutting down.
I20260709 13:07:43.180394 18300 raft_consensus.cc:2272] T 85c494af21f9457a85da47b9bc70c1fd P e5256d91808b47c195bc9b4dbd7f2b87 [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:43.183035 18300 tablet_replica.cc:333] T 22196caba61445d3bec98a0aab3c337d P e5256d91808b47c195bc9b4dbd7f2b87: stopping tablet replica
I20260709 13:07:43.183744 18300 raft_consensus.cc:2243] T 22196caba61445d3bec98a0aab3c337d P e5256d91808b47c195bc9b4dbd7f2b87 [term 21 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:43.184428 18300 raft_consensus.cc:2272] T 22196caba61445d3bec98a0aab3c337d P e5256d91808b47c195bc9b4dbd7f2b87 [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:43.187543 18300 tablet_replica.cc:333] T 2e36a9d6e29c4a7c860cf267efbd4c74 P e5256d91808b47c195bc9b4dbd7f2b87: stopping tablet replica
I20260709 13:07:43.188282 18300 raft_consensus.cc:2243] T 2e36a9d6e29c4a7c860cf267efbd4c74 P e5256d91808b47c195bc9b4dbd7f2b87 [term 17 LEADER]: Raft consensus shutting down.
I20260709 13:07:43.189205 27196 raft_consensus.cc:493] T 76cb037fc9064d13b59a8969d897ce8c P e5256d91808b47c195bc9b4dbd7f2b87 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader e61c3a8f61bb48f8a963c9480e53c168)
I20260709 13:07:43.189352 18300 raft_consensus.cc:2272] T 2e36a9d6e29c4a7c860cf267efbd4c74 P e5256d91808b47c195bc9b4dbd7f2b87 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:43.189812 27196 raft_consensus.cc:515] T 76cb037fc9064d13b59a8969d897ce8c P e5256d91808b47c195bc9b4dbd7f2b87 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:07:43.192075 27196 leader_election.cc:290] T 76cb037fc9064d13b59a8969d897ce8c P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:07:43.192322 18300 tablet_replica.cc:333] T e381f1d6b8184797ad142de49be225a8 P e5256d91808b47c195bc9b4dbd7f2b87: stopping tablet replica
I20260709 13:07:43.193145 18300 raft_consensus.cc:2243] T e381f1d6b8184797ad142de49be225a8 P e5256d91808b47c195bc9b4dbd7f2b87 [term 19 LEADER]: Raft consensus shutting down.
I20260709 13:07:43.194132 18300 raft_consensus.cc:2272] T e381f1d6b8184797ad142de49be225a8 P e5256d91808b47c195bc9b4dbd7f2b87 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:43.194582 19557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76cb037fc9064d13b59a8969d897ce8c" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:07:43.196141 20111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76cb037fc9064d13b59a8969d897ce8c" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:07:43.199268 19374 leader_election.cc:304] T 76cb037fc9064d13b59a8969d897ce8c P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87; no voters: 127766fc592545a4997f7790f50f6076, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:07:43.200091 27240 raft_consensus.cc:493] T 70797e5783b5454ab0d0eea663e791e3 P e5256d91808b47c195bc9b4dbd7f2b87 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 127766fc592545a4997f7790f50f6076)
I20260709 13:07:43.200616 27196 raft_consensus.cc:2749] T 76cb037fc9064d13b59a8969d897ce8c P e5256d91808b47c195bc9b4dbd7f2b87 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:07:43.200574 27240 raft_consensus.cc:515] T 70797e5783b5454ab0d0eea663e791e3 P e5256d91808b47c195bc9b4dbd7f2b87 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:07:43.203151 27240 leader_election.cc:290] T 70797e5783b5454ab0d0eea663e791e3 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:07:43.205109 18300 tablet_replica.cc:333] T 76cb037fc9064d13b59a8969d897ce8c P e5256d91808b47c195bc9b4dbd7f2b87: stopping tablet replica
I20260709 13:07:43.205868 18300 raft_consensus.cc:2243] T 76cb037fc9064d13b59a8969d897ce8c P e5256d91808b47c195bc9b4dbd7f2b87 [term 22 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:43.206525 18300 raft_consensus.cc:2272] T 76cb037fc9064d13b59a8969d897ce8c P e5256d91808b47c195bc9b4dbd7f2b87 [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:43.207528 19554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70797e5783b5454ab0d0eea663e791e3" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 25 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:07:43.209399 18300 tablet_replica.cc:333] T 1f85fc4b527a48848e5faa083b604e36 P e5256d91808b47c195bc9b4dbd7f2b87: stopping tablet replica
I20260709 13:07:43.210186 18300 raft_consensus.cc:2243] T 1f85fc4b527a48848e5faa083b604e36 P e5256d91808b47c195bc9b4dbd7f2b87 [term 21 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:43.210848 18300 raft_consensus.cc:2272] T 1f85fc4b527a48848e5faa083b604e36 P e5256d91808b47c195bc9b4dbd7f2b87 [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:43.213672 18300 tablet_replica.cc:333] T fa8650e71aa14778b3d73721fc50d9fc P e5256d91808b47c195bc9b4dbd7f2b87: stopping tablet replica
I20260709 13:07:43.214386 18300 raft_consensus.cc:2243] T fa8650e71aa14778b3d73721fc50d9fc P e5256d91808b47c195bc9b4dbd7f2b87 [term 22 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:43.215093 18300 raft_consensus.cc:2272] T fa8650e71aa14778b3d73721fc50d9fc P e5256d91808b47c195bc9b4dbd7f2b87 [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:43.215044 20111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70797e5783b5454ab0d0eea663e791e3" candidate_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" candidate_term: 25 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:07:43.217033 19374 leader_election.cc:304] T 70797e5783b5454ab0d0eea663e791e3 P e5256d91808b47c195bc9b4dbd7f2b87 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5256d91808b47c195bc9b4dbd7f2b87; no voters: 127766fc592545a4997f7790f50f6076, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:07:43.217842 27240 raft_consensus.cc:2749] T 70797e5783b5454ab0d0eea663e791e3 P e5256d91808b47c195bc9b4dbd7f2b87 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:07:43.218098 18300 tablet_replica.cc:333] T 217b5fae677b4971b3bbd2f357a1f7ff P e5256d91808b47c195bc9b4dbd7f2b87: stopping tablet replica
I20260709 13:07:43.218945 18300 raft_consensus.cc:2243] T 217b5fae677b4971b3bbd2f357a1f7ff P e5256d91808b47c195bc9b4dbd7f2b87 [term 20 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:43.219520 18300 raft_consensus.cc:2272] T 217b5fae677b4971b3bbd2f357a1f7ff P e5256d91808b47c195bc9b4dbd7f2b87 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:43.222435 18300 tablet_replica.cc:333] T f1b10566f45d4a7d9029858330e02d5b P e5256d91808b47c195bc9b4dbd7f2b87: stopping tablet replica
I20260709 13:07:43.223114 18300 raft_consensus.cc:2243] T f1b10566f45d4a7d9029858330e02d5b P e5256d91808b47c195bc9b4dbd7f2b87 [term 21 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:43.223651 18300 raft_consensus.cc:2272] T f1b10566f45d4a7d9029858330e02d5b P e5256d91808b47c195bc9b4dbd7f2b87 [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:43.226505 18300 tablet_replica.cc:333] T 21e14947d70440f19044d8f75c31e1f9 P e5256d91808b47c195bc9b4dbd7f2b87: stopping tablet replica
I20260709 13:07:43.227169 18300 raft_consensus.cc:2243] T 21e14947d70440f19044d8f75c31e1f9 P e5256d91808b47c195bc9b4dbd7f2b87 [term 22 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:43.228075 18300 raft_consensus.cc:2272] T 21e14947d70440f19044d8f75c31e1f9 P e5256d91808b47c195bc9b4dbd7f2b87 [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:43.230618 18300 tablet_replica.cc:333] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P e5256d91808b47c195bc9b4dbd7f2b87: stopping tablet replica
I20260709 13:07:43.240118 18300 raft_consensus.cc:2243] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P e5256d91808b47c195bc9b4dbd7f2b87 [term 22 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:43.245223 18300 raft_consensus.cc:2272] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P e5256d91808b47c195bc9b4dbd7f2b87 [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:43.248147 18300 tablet_replica.cc:333] T 46c5bfeecc314717bffe987e6844b6d0 P e5256d91808b47c195bc9b4dbd7f2b87: stopping tablet replica
I20260709 13:07:43.248862 18300 raft_consensus.cc:2243] T 46c5bfeecc314717bffe987e6844b6d0 P e5256d91808b47c195bc9b4dbd7f2b87 [term 27 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:43.249477 18300 raft_consensus.cc:2272] T 46c5bfeecc314717bffe987e6844b6d0 P e5256d91808b47c195bc9b4dbd7f2b87 [term 27 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:43.252374 18300 tablet_replica.cc:333] T edd7d470b5014c9489be7f41f64355c9 P e5256d91808b47c195bc9b4dbd7f2b87: stopping tablet replica
I20260709 13:07:43.253436 18300 raft_consensus.cc:2243] T edd7d470b5014c9489be7f41f64355c9 P e5256d91808b47c195bc9b4dbd7f2b87 [term 26 LEADER]: Raft consensus shutting down.
I20260709 13:07:43.254542 18300 raft_consensus.cc:2272] T edd7d470b5014c9489be7f41f64355c9 P e5256d91808b47c195bc9b4dbd7f2b87 [term 26 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:43.257856 18300 tablet_replica.cc:333] T a08760e15aac4630a629431f56024dc8 P e5256d91808b47c195bc9b4dbd7f2b87: stopping tablet replica
I20260709 13:07:43.258562 18300 raft_consensus.cc:2243] T a08760e15aac4630a629431f56024dc8 P e5256d91808b47c195bc9b4dbd7f2b87 [term 24 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:43.259126 18300 raft_consensus.cc:2272] T a08760e15aac4630a629431f56024dc8 P e5256d91808b47c195bc9b4dbd7f2b87 [term 24 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:43.262259 18300 tablet_replica.cc:333] T 70797e5783b5454ab0d0eea663e791e3 P e5256d91808b47c195bc9b4dbd7f2b87: stopping tablet replica
I20260709 13:07:43.263036 18300 raft_consensus.cc:2243] T 70797e5783b5454ab0d0eea663e791e3 P e5256d91808b47c195bc9b4dbd7f2b87 [term 24 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:43.263607 18300 raft_consensus.cc:2272] T 70797e5783b5454ab0d0eea663e791e3 P e5256d91808b47c195bc9b4dbd7f2b87 [term 24 FOLLOWER]: Raft consensus is shut down!
W20260709 13:07:43.280822 20075 consensus_peers.cc:597] T 833a2f0775ed407a94b8924ce50adb63 P 127766fc592545a4997f7790f50f6076 -> Peer e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321): Couldn't send request to peer e5256d91808b47c195bc9b4dbd7f2b87. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 13:07:43.293391 19523 consensus_peers.cc:597] T 217b5fae677b4971b3bbd2f357a1f7ff P e61c3a8f61bb48f8a963c9480e53c168 -> Peer e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321): Couldn't send request to peer e5256d91808b47c195bc9b4dbd7f2b87. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 13:07:43.316900 19523 consensus_peers.cc:597] T 3e1f505cb0f1427bbd698ac889d80821 P e61c3a8f61bb48f8a963c9480e53c168 -> Peer e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321): Couldn't send request to peer e5256d91808b47c195bc9b4dbd7f2b87. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 13:07:43.401214 19449 consensus_peers.cc:597] T 86a6797bdfe94fa496c050ceae4bd0d9 P 0473d2b2d01f4459b1e90fd12cc7840e -> Peer e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321): Couldn't send request to peer e5256d91808b47c195bc9b4dbd7f2b87. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:07:43.420284 27213 raft_consensus.cc:493] T 2b74109013a140ada21feeef92d6f563 P 0473d2b2d01f4459b1e90fd12cc7840e [term 18 FOLLOWER]: Starting pre-election (detected failure of leader e5256d91808b47c195bc9b4dbd7f2b87)
I20260709 13:07:43.420881 27213 raft_consensus.cc:515] T 2b74109013a140ada21feeef92d6f563 P 0473d2b2d01f4459b1e90fd12cc7840e [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:07:43.423250 27213 leader_election.cc:290] T 2b74109013a140ada21feeef92d6f563 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:07:43.428570 19554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b74109013a140ada21feeef92d6f563" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
W20260709 13:07:43.429986 19449 leader_election.cc:336] T 2b74109013a140ada21feeef92d6f563 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:07:43.432518 19450 leader_election.cc:304] T 2b74109013a140ada21feeef92d6f563 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e; no voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:07:43.435353 27157 raft_consensus.cc:2749] T 2b74109013a140ada21feeef92d6f563 P 0473d2b2d01f4459b1e90fd12cc7840e [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 13:07:43.518582 19523 consensus_peers.cc:597] T 76cb037fc9064d13b59a8969d897ce8c P e61c3a8f61bb48f8a963c9480e53c168 -> Peer e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321): Couldn't send request to peer e5256d91808b47c195bc9b4dbd7f2b87. Status: Network error: Client connection negotiation failed: client connection to 127.17.223.1:40321: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:07:43.550089 19449 consensus_peers.cc:597] T b08304a0a02b42d7840c4e8ee9a6bd1a P 0473d2b2d01f4459b1e90fd12cc7840e -> Peer e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321): Couldn't send request to peer e5256d91808b47c195bc9b4dbd7f2b87. Status: Network error: Client connection negotiation failed: client connection to 127.17.223.1:40321: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:07:43.560339 20075 consensus_peers.cc:597] T 9962423cb4e54fcfa5de01daf68a86e7 P 127766fc592545a4997f7790f50f6076 -> Peer e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321): Couldn't send request to peer e5256d91808b47c195bc9b4dbd7f2b87. Status: Network error: Client connection negotiation failed: client connection to 127.17.223.1:40321: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:07:43.560874 20075 consensus_peers.cc:597] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P 127766fc592545a4997f7790f50f6076 -> Peer e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321): Couldn't send request to peer e5256d91808b47c195bc9b4dbd7f2b87. Status: Network error: Client connection negotiation failed: client connection to 127.17.223.1:40321: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:07:43.561272 20075 consensus_peers.cc:597] T 70797e5783b5454ab0d0eea663e791e3 P 127766fc592545a4997f7790f50f6076 -> Peer e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321): Couldn't send request to peer e5256d91808b47c195bc9b4dbd7f2b87. Status: Network error: Client connection negotiation failed: client connection to 127.17.223.1:40321: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:07:43.567725 19449 consensus_peers.cc:597] T 2725d2c4cb054f18b0fc8f735c15f6c2 P 0473d2b2d01f4459b1e90fd12cc7840e -> Peer e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321): Couldn't send request to peer e5256d91808b47c195bc9b4dbd7f2b87. Status: Network error: Client connection negotiation failed: client connection to 127.17.223.1:40321: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:07:43.709468 20075 consensus_peers.cc:597] T 2a16f7501e2444fb86d4e2778e734e02 P 127766fc592545a4997f7790f50f6076 -> Peer e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321): Couldn't send request to peer e5256d91808b47c195bc9b4dbd7f2b87. Status: Network error: Client connection negotiation failed: client connection to 127.17.223.1:40321: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:07:43.714012 19523 consensus_peers.cc:597] T 46c5bfeecc314717bffe987e6844b6d0 P e61c3a8f61bb48f8a963c9480e53c168 -> Peer e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321): Couldn't send request to peer e5256d91808b47c195bc9b4dbd7f2b87. Status: Network error: Client connection negotiation failed: client connection to 127.17.223.1:40321: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:07:43.730791 19449 consensus_peers.cc:597] T 7f575b143b844aa096b50997dad3516a P 0473d2b2d01f4459b1e90fd12cc7840e -> Peer e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321): Couldn't send request to peer e5256d91808b47c195bc9b4dbd7f2b87. Status: Network error: Client connection negotiation failed: client connection to 127.17.223.1:40321: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:07:43.739320 27021 raft_consensus.cc:493] T 28af091831594f9d8e96482078cc7625 P e61c3a8f61bb48f8a963c9480e53c168 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader e5256d91808b47c195bc9b4dbd7f2b87)
I20260709 13:07:43.739936 27021 raft_consensus.cc:515] T 28af091831594f9d8e96482078cc7625 P e61c3a8f61bb48f8a963c9480e53c168 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:07:43.742137 27021 leader_election.cc:290] T 28af091831594f9d8e96482078cc7625 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:07:43.743335 20111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28af091831594f9d8e96482078cc7625" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
W20260709 13:07:43.752121 19523 leader_election.cc:336] T 28af091831594f9d8e96482078cc7625 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321): Network error: Client connection negotiation failed: client connection to 127.17.223.1:40321: connect: Connection refused (error 111)
I20260709 13:07:43.752615 19523 leader_election.cc:304] T 28af091831594f9d8e96482078cc7625 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e61c3a8f61bb48f8a963c9480e53c168; no voters: 127766fc592545a4997f7790f50f6076, e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:07:43.754336 27152 raft_consensus.cc:2749] T 28af091831594f9d8e96482078cc7625 P e61c3a8f61bb48f8a963c9480e53c168 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
W20260709 13:07:43.772336 19293 catalog_manager.cc:4755] TS e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet bc225c93219c45538b53a1bd3d387e4d: Network error: Client connection negotiation failed: client connection to 127.17.223.1:40321: connect: Connection refused (error 111)
I20260709 13:07:43.783815 27191 raft_consensus.cc:493] T 28af091831594f9d8e96482078cc7625 P 127766fc592545a4997f7790f50f6076 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader e5256d91808b47c195bc9b4dbd7f2b87)
I20260709 13:07:43.787086 27191 raft_consensus.cc:515] T 28af091831594f9d8e96482078cc7625 P 127766fc592545a4997f7790f50f6076 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:07:43.789166 27191 leader_election.cc:290] T 28af091831594f9d8e96482078cc7625 P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
W20260709 13:07:43.785637 19449 consensus_peers.cc:597] T 1a61655d99124a29b486ba4a5b37faea P 0473d2b2d01f4459b1e90fd12cc7840e -> Peer e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321): Couldn't send request to peer e5256d91808b47c195bc9b4dbd7f2b87. Status: Network error: Client connection negotiation failed: client connection to 127.17.223.1:40321: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:07:43.779413 19523 consensus_peers.cc:597] T df751f992649444090e27965eb1af85d P e61c3a8f61bb48f8a963c9480e53c168 -> Peer e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321): Couldn't send request to peer e5256d91808b47c195bc9b4dbd7f2b87. Status: Network error: Client connection negotiation failed: client connection to 127.17.223.1:40321: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:07:43.793519 20075 leader_election.cc:336] T 28af091831594f9d8e96482078cc7625 P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321): Network error: Client connection negotiation failed: client connection to 127.17.223.1:40321: connect: Connection refused (error 111)
I20260709 13:07:43.794893 19557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28af091831594f9d8e96482078cc7625" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:07:43.795483 19557 raft_consensus.cc:2468] T 28af091831594f9d8e96482078cc7625 P e61c3a8f61bb48f8a963c9480e53c168 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 127766fc592545a4997f7790f50f6076 in term 20.
I20260709 13:07:43.796589 20076 leader_election.cc:304] T 28af091831594f9d8e96482078cc7625 P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 127766fc592545a4997f7790f50f6076, e61c3a8f61bb48f8a963c9480e53c168; no voters: e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:07:43.797650 27191 raft_consensus.cc:2804] T 28af091831594f9d8e96482078cc7625 P 127766fc592545a4997f7790f50f6076 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:07:43.798026 27191 raft_consensus.cc:493] T 28af091831594f9d8e96482078cc7625 P 127766fc592545a4997f7790f50f6076 [term 20 FOLLOWER]: Starting leader election (detected failure of leader e5256d91808b47c195bc9b4dbd7f2b87)
I20260709 13:07:43.798378 27191 raft_consensus.cc:3060] T 28af091831594f9d8e96482078cc7625 P 127766fc592545a4997f7790f50f6076 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:07:43.806146 27191 raft_consensus.cc:515] T 28af091831594f9d8e96482078cc7625 P 127766fc592545a4997f7790f50f6076 [term 21 FOLLOWER]: Starting leader election with config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
W20260709 13:07:43.816061 19449 consensus_peers.cc:597] T fa8650e71aa14778b3d73721fc50d9fc P 0473d2b2d01f4459b1e90fd12cc7840e -> Peer e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321): Couldn't send request to peer e5256d91808b47c195bc9b4dbd7f2b87. Status: Network error: Client connection negotiation failed: client connection to 127.17.223.1:40321: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:07:43.824486 19557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28af091831594f9d8e96482078cc7625" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:07:43.825132 19557 raft_consensus.cc:3060] T 28af091831594f9d8e96482078cc7625 P e61c3a8f61bb48f8a963c9480e53c168 [term 20 FOLLOWER]: Advancing to term 21
W20260709 13:07:43.827989 20075 leader_election.cc:336] T 28af091831594f9d8e96482078cc7625 P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 21 election: RPC error from VoteRequest() call to peer e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321): Network error: Client connection negotiation failed: client connection to 127.17.223.1:40321: connect: Connection refused (error 111)
W20260709 13:07:43.838174 19449 consensus_peers.cc:597] T ff75a1d4cb1f493db8f71ddc136ba9ab P 0473d2b2d01f4459b1e90fd12cc7840e -> Peer e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321): Couldn't send request to peer e5256d91808b47c195bc9b4dbd7f2b87. Status: Network error: Client connection negotiation failed: client connection to 127.17.223.1:40321: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:07:43.850237 19557 raft_consensus.cc:2468] T 28af091831594f9d8e96482078cc7625 P e61c3a8f61bb48f8a963c9480e53c168 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 127766fc592545a4997f7790f50f6076 in term 21.
W20260709 13:07:43.851050 20075 consensus_peers.cc:597] T 1f85fc4b527a48848e5faa083b604e36 P 127766fc592545a4997f7790f50f6076 -> Peer e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321): Couldn't send request to peer e5256d91808b47c195bc9b4dbd7f2b87. Status: Network error: Client connection negotiation failed: client connection to 127.17.223.1:40321: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:07:43.851712 20076 leader_election.cc:304] T 28af091831594f9d8e96482078cc7625 P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 127766fc592545a4997f7790f50f6076, e61c3a8f61bb48f8a963c9480e53c168; no voters: e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:07:43.852556 27245 raft_consensus.cc:2804] T 28af091831594f9d8e96482078cc7625 P 127766fc592545a4997f7790f50f6076 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:07:43.853044 27245 raft_consensus.cc:697] T 28af091831594f9d8e96482078cc7625 P 127766fc592545a4997f7790f50f6076 [term 21 LEADER]: Becoming Leader. State: Replica: 127766fc592545a4997f7790f50f6076, State: Running, Role: LEADER
I20260709 13:07:43.853916 27245 consensus_queue.cc:237] T 28af091831594f9d8e96482078cc7625 P 127766fc592545a4997f7790f50f6076 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 20.15, Last appended by leader: 15, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:07:43.857434 27191 leader_election.cc:290] T 28af091831594f9d8e96482078cc7625 P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 21 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
W20260709 13:07:43.872597 19449 consensus_peers.cc:597] T f1b10566f45d4a7d9029858330e02d5b P 0473d2b2d01f4459b1e90fd12cc7840e -> Peer e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321): Couldn't send request to peer e5256d91808b47c195bc9b4dbd7f2b87. Status: Network error: Client connection negotiation failed: client connection to 127.17.223.1:40321: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:07:43.875223 19449 consensus_peers.cc:597] T ef32ce6fdd0e40d382c79974f30295c6 P 0473d2b2d01f4459b1e90fd12cc7840e -> Peer e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321): Couldn't send request to peer e5256d91808b47c195bc9b4dbd7f2b87. Status: Network error: Client connection negotiation failed: client connection to 127.17.223.1:40321: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:07:43.886897 27201 raft_consensus.cc:493] T fa731b585f684a7fb2d106c50f143b83 P 127766fc592545a4997f7790f50f6076 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader e5256d91808b47c195bc9b4dbd7f2b87)
I20260709 13:07:43.887501 27201 raft_consensus.cc:515] T fa731b585f684a7fb2d106c50f143b83 P 127766fc592545a4997f7790f50f6076 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
W20260709 13:07:43.890564 19523 consensus_peers.cc:597] T 1dc5b3532fe54f74876d02beffa2c230 P e61c3a8f61bb48f8a963c9480e53c168 -> Peer e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321): Couldn't send request to peer e5256d91808b47c195bc9b4dbd7f2b87. Status: Network error: Client connection negotiation failed: client connection to 127.17.223.1:40321: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:07:43.895985 20075 leader_election.cc:336] T fa731b585f684a7fb2d106c50f143b83 P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321): Network error: Client connection negotiation failed: client connection to 127.17.223.1:40321: connect: Connection refused (error 111)
I20260709 13:07:43.897878 27201 leader_election.cc:290] T fa731b585f684a7fb2d106c50f143b83 P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:07:43.902768 19302 catalog_manager.cc:5697] T 28af091831594f9d8e96482078cc7625 P 127766fc592545a4997f7790f50f6076 reported cstate change: term changed from 20 to 21, leader changed from e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1) to 127766fc592545a4997f7790f50f6076 (127.17.223.4). New cstate: current_term: 21 leader_uuid: "127766fc592545a4997f7790f50f6076" committed_config { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:07:43.900282 19557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa731b585f684a7fb2d106c50f143b83" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:07:43.912628 20076 leader_election.cc:304] T fa731b585f684a7fb2d106c50f143b83 P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 127766fc592545a4997f7790f50f6076; no voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:07:43.913805 27201 raft_consensus.cc:2749] T fa731b585f684a7fb2d106c50f143b83 P 127766fc592545a4997f7790f50f6076 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:07:43.957007 27201 raft_consensus.cc:493] T 172b3dd13109415a955b71ac0e9d2234 P 127766fc592545a4997f7790f50f6076 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader e5256d91808b47c195bc9b4dbd7f2b87)
I20260709 13:07:43.957602 27201 raft_consensus.cc:515] T 172b3dd13109415a955b71ac0e9d2234 P 127766fc592545a4997f7790f50f6076 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:07:43.961200 27201 leader_election.cc:290] T 172b3dd13109415a955b71ac0e9d2234 P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:07:43.963352 19484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "172b3dd13109415a955b71ac0e9d2234" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
W20260709 13:07:43.961604 19523 consensus_peers.cc:597] T ece3db938bc649d4a40a51522ed5259c P e61c3a8f61bb48f8a963c9480e53c168 -> Peer e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321): Couldn't send request to peer e5256d91808b47c195bc9b4dbd7f2b87. Status: Network error: Client connection negotiation failed: client connection to 127.17.223.1:40321: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:07:43.966297 20075 leader_election.cc:336] T 172b3dd13109415a955b71ac0e9d2234 P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321): Network error: Client connection negotiation failed: client connection to 127.17.223.1:40321: connect: Connection refused (error 111)
I20260709 13:07:43.966707 20075 leader_election.cc:304] T 172b3dd13109415a955b71ac0e9d2234 P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 127766fc592545a4997f7790f50f6076; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:07:43.969120 27201 raft_consensus.cc:2749] T 172b3dd13109415a955b71ac0e9d2234 P 127766fc592545a4997f7790f50f6076 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
W20260709 13:07:43.981134 19449 consensus_peers.cc:597] T 179fd671030940b4b4a4e24bcc4aba0a P 0473d2b2d01f4459b1e90fd12cc7840e -> Peer e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321): Couldn't send request to peer e5256d91808b47c195bc9b4dbd7f2b87. Status: Network error: Client connection negotiation failed: client connection to 127.17.223.1:40321: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:07:43.991350 27241 raft_consensus.cc:493] T 5ec1c4ce15e04c7e8c283a62179f2a64 P 0473d2b2d01f4459b1e90fd12cc7840e [term 16 FOLLOWER]: Starting pre-election (detected failure of leader e5256d91808b47c195bc9b4dbd7f2b87)
I20260709 13:07:43.992101 27241 raft_consensus.cc:515] T 5ec1c4ce15e04c7e8c283a62179f2a64 P 0473d2b2d01f4459b1e90fd12cc7840e [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:07:43.994931 27021 raft_consensus.cc:493] T fa731b585f684a7fb2d106c50f143b83 P e61c3a8f61bb48f8a963c9480e53c168 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader e5256d91808b47c195bc9b4dbd7f2b87)
I20260709 13:07:43.995571 27021 raft_consensus.cc:515] T fa731b585f684a7fb2d106c50f143b83 P e61c3a8f61bb48f8a963c9480e53c168 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:07:43.999282 20111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa731b585f684a7fb2d106c50f143b83" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:07:44.000017 20111 raft_consensus.cc:2468] T fa731b585f684a7fb2d106c50f143b83 P 127766fc592545a4997f7790f50f6076 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 16.
I20260709 13:07:43.997816 27021 leader_election.cc:290] T fa731b585f684a7fb2d106c50f143b83 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:07:44.001422 19523 leader_election.cc:304] T fa731b585f684a7fb2d106c50f143b83 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 127766fc592545a4997f7790f50f6076, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
W20260709 13:07:44.004839 19523 leader_election.cc:336] T fa731b585f684a7fb2d106c50f143b83 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321): Network error: Client connection negotiation failed: client connection to 127.17.223.1:40321: connect: Connection refused (error 111)
I20260709 13:07:43.994529 27241 leader_election.cc:290] T 5ec1c4ce15e04c7e8c283a62179f2a64 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:07:44.008829 27021 raft_consensus.cc:2804] T fa731b585f684a7fb2d106c50f143b83 P e61c3a8f61bb48f8a963c9480e53c168 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:07:44.008874 20111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ec1c4ce15e04c7e8c283a62179f2a64" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:07:44.009431 27021 raft_consensus.cc:493] T fa731b585f684a7fb2d106c50f143b83 P e61c3a8f61bb48f8a963c9480e53c168 [term 16 FOLLOWER]: Starting leader election (detected failure of leader e5256d91808b47c195bc9b4dbd7f2b87)
I20260709 13:07:44.009857 27021 raft_consensus.cc:3060] T fa731b585f684a7fb2d106c50f143b83 P e61c3a8f61bb48f8a963c9480e53c168 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:07:44.012048 27201 raft_consensus.cc:493] T 65d8cb8d6ec64f459d5a47cefab10acf P 127766fc592545a4997f7790f50f6076 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader e5256d91808b47c195bc9b4dbd7f2b87)
I20260709 13:07:44.012566 27201 raft_consensus.cc:515] T 65d8cb8d6ec64f459d5a47cefab10acf P 127766fc592545a4997f7790f50f6076 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:07:44.014847 27201 leader_election.cc:290] T 65d8cb8d6ec64f459d5a47cefab10acf P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
W20260709 13:07:44.019090 19449 leader_election.cc:336] T 5ec1c4ce15e04c7e8c283a62179f2a64 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321): Network error: Client connection negotiation failed: client connection to 127.17.223.1:40321: connect: Connection refused (error 111)
I20260709 13:07:44.023893 19449 leader_election.cc:304] T 5ec1c4ce15e04c7e8c283a62179f2a64 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e; no voters: 127766fc592545a4997f7790f50f6076, e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:07:44.019388 19557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65d8cb8d6ec64f459d5a47cefab10acf" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:07:44.028265 27241 raft_consensus.cc:2749] T 5ec1c4ce15e04c7e8c283a62179f2a64 P 0473d2b2d01f4459b1e90fd12cc7840e [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 13:07:44.023142 20075 leader_election.cc:336] T 65d8cb8d6ec64f459d5a47cefab10acf P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321): Network error: Client connection negotiation failed: client connection to 127.17.223.1:40321: connect: Connection refused (error 111)
I20260709 13:07:44.031492 20076 leader_election.cc:304] T 65d8cb8d6ec64f459d5a47cefab10acf P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 127766fc592545a4997f7790f50f6076; no voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:07:44.039125 27245 raft_consensus.cc:2749] T 65d8cb8d6ec64f459d5a47cefab10acf P 127766fc592545a4997f7790f50f6076 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:07:44.037824 27021 raft_consensus.cc:515] T fa731b585f684a7fb2d106c50f143b83 P e61c3a8f61bb48f8a963c9480e53c168 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:07:44.043316 27021 leader_election.cc:290] T fa731b585f684a7fb2d106c50f143b83 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 17 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:07:44.045940 20111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa731b585f684a7fb2d106c50f143b83" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076"
I20260709 13:07:44.046579 20111 raft_consensus.cc:3060] T fa731b585f684a7fb2d106c50f143b83 P 127766fc592545a4997f7790f50f6076 [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:07:44.053445 19523 leader_election.cc:336] T fa731b585f684a7fb2d106c50f143b83 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 17 election: RPC error from VoteRequest() call to peer e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321): Network error: Client connection negotiation failed: client connection to 127.17.223.1:40321: connect: Connection refused (error 111)
I20260709 13:07:44.062288 20111 raft_consensus.cc:2468] T fa731b585f684a7fb2d106c50f143b83 P 127766fc592545a4997f7790f50f6076 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 17.
I20260709 13:07:44.069491 19523 leader_election.cc:304] T fa731b585f684a7fb2d106c50f143b83 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 127766fc592545a4997f7790f50f6076, e61c3a8f61bb48f8a963c9480e53c168; no voters: e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:07:44.071187 27021 raft_consensus.cc:2804] T fa731b585f684a7fb2d106c50f143b83 P e61c3a8f61bb48f8a963c9480e53c168 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:07:44.071990 27021 raft_consensus.cc:697] T fa731b585f684a7fb2d106c50f143b83 P e61c3a8f61bb48f8a963c9480e53c168 [term 17 LEADER]: Becoming Leader. State: Replica: e61c3a8f61bb48f8a963c9480e53c168, State: Running, Role: LEADER
I20260709 13:07:44.072954 27021 consensus_queue.cc:237] T fa731b585f684a7fb2d106c50f143b83 P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.12, Last appended by leader: 12, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:07:44.092458 27241 raft_consensus.cc:493] T ff9b0eddd810459b82d91c60777c10eb P 0473d2b2d01f4459b1e90fd12cc7840e [term 22 FOLLOWER]: Starting pre-election (detected failure of leader e5256d91808b47c195bc9b4dbd7f2b87)
I20260709 13:07:44.093065 27021 raft_consensus.cc:493] T 2b74109013a140ada21feeef92d6f563 P e61c3a8f61bb48f8a963c9480e53c168 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader e5256d91808b47c195bc9b4dbd7f2b87)
I20260709 13:07:44.093608 27021 raft_consensus.cc:515] T 2b74109013a140ada21feeef92d6f563 P e61c3a8f61bb48f8a963c9480e53c168 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
W20260709 13:07:44.094991 19523 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.17.223.1:40321: connect: Connection refused (error 111) [suppressed 238 similar messages]
I20260709 13:07:44.098345 27201 raft_consensus.cc:493] T ff9b0eddd810459b82d91c60777c10eb P 127766fc592545a4997f7790f50f6076 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader e5256d91808b47c195bc9b4dbd7f2b87)
I20260709 13:07:44.097620 19301 catalog_manager.cc:5697] T fa731b585f684a7fb2d106c50f143b83 P e61c3a8f61bb48f8a963c9480e53c168 reported cstate change: term changed from 16 to 17, leader changed from e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1) to e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3). New cstate: current_term: 17 leader_uuid: "e61c3a8f61bb48f8a963c9480e53c168" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:44.098858 27201 raft_consensus.cc:515] T ff9b0eddd810459b82d91c60777c10eb P 127766fc592545a4997f7790f50f6076 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:07:44.099164 27245 raft_consensus.cc:493] T 775c229504194560ba9589bc2199b089 P 127766fc592545a4997f7790f50f6076 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader e5256d91808b47c195bc9b4dbd7f2b87)
I20260709 13:07:44.099738 27245 raft_consensus.cc:515] T 775c229504194560ba9589bc2199b089 P 127766fc592545a4997f7790f50f6076 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:07:44.093077 27241 raft_consensus.cc:515] T ff9b0eddd810459b82d91c60777c10eb P 0473d2b2d01f4459b1e90fd12cc7840e [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:07:44.100941 27201 leader_election.cc:290] T ff9b0eddd810459b82d91c60777c10eb P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:07:44.101825 27245 leader_election.cc:290] T 775c229504194560ba9589bc2199b089 P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:07:44.102226 27241 leader_election.cc:290] T ff9b0eddd810459b82d91c60777c10eb P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:07:44.103240 19484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff9b0eddd810459b82d91c60777c10eb" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:07:44.103745 27021 leader_election.cc:290] T 2b74109013a140ada21feeef92d6f563 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:07:44.103839 19484 raft_consensus.cc:2468] T ff9b0eddd810459b82d91c60777c10eb P 0473d2b2d01f4459b1e90fd12cc7840e [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 127766fc592545a4997f7790f50f6076 in term 22.
I20260709 13:07:44.105687 20078 leader_election.cc:304] T ff9b0eddd810459b82d91c60777c10eb P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, 127766fc592545a4997f7790f50f6076; no voters: 
I20260709 13:07:44.105806 19483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "775c229504194560ba9589bc2199b089" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:07:44.109731 27201 raft_consensus.cc:493] T 5ec1c4ce15e04c7e8c283a62179f2a64 P 127766fc592545a4997f7790f50f6076 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader e5256d91808b47c195bc9b4dbd7f2b87)
I20260709 13:07:44.110235 27201 raft_consensus.cc:515] T 5ec1c4ce15e04c7e8c283a62179f2a64 P 127766fc592545a4997f7790f50f6076 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:07:44.114156 19484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ec1c4ce15e04c7e8c283a62179f2a64" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:07:44.114768 19484 raft_consensus.cc:2468] T 5ec1c4ce15e04c7e8c283a62179f2a64 P 0473d2b2d01f4459b1e90fd12cc7840e [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 127766fc592545a4997f7790f50f6076 in term 16.
I20260709 13:07:44.115829 27201 leader_election.cc:290] T 5ec1c4ce15e04c7e8c283a62179f2a64 P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:07:44.116463 27201 raft_consensus.cc:2804] T ff9b0eddd810459b82d91c60777c10eb P 127766fc592545a4997f7790f50f6076 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:07:44.116822 27201 raft_consensus.cc:493] T ff9b0eddd810459b82d91c60777c10eb P 127766fc592545a4997f7790f50f6076 [term 22 FOLLOWER]: Starting leader election (detected failure of leader e5256d91808b47c195bc9b4dbd7f2b87)
I20260709 13:07:44.117215 27201 raft_consensus.cc:3060] T ff9b0eddd810459b82d91c60777c10eb P 127766fc592545a4997f7790f50f6076 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:07:44.118912 19483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b74109013a140ada21feeef92d6f563" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:07:44.119349 20078 leader_election.cc:304] T 5ec1c4ce15e04c7e8c283a62179f2a64 P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, 127766fc592545a4997f7790f50f6076; no voters: 
I20260709 13:07:44.119589 19483 raft_consensus.cc:2468] T 2b74109013a140ada21feeef92d6f563 P 0473d2b2d01f4459b1e90fd12cc7840e [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 18.
I20260709 13:07:44.120179 27191 raft_consensus.cc:2804] T 5ec1c4ce15e04c7e8c283a62179f2a64 P 127766fc592545a4997f7790f50f6076 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:07:44.120535 27191 raft_consensus.cc:493] T 5ec1c4ce15e04c7e8c283a62179f2a64 P 127766fc592545a4997f7790f50f6076 [term 16 FOLLOWER]: Starting leader election (detected failure of leader e5256d91808b47c195bc9b4dbd7f2b87)
W20260709 13:07:44.120734 20075 leader_election.cc:336] T ff9b0eddd810459b82d91c60777c10eb P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321): Network error: Client connection negotiation failed: client connection to 127.17.223.1:40321: connect: Connection refused (error 111)
I20260709 13:07:44.120913 27191 raft_consensus.cc:3060] T 5ec1c4ce15e04c7e8c283a62179f2a64 P 127766fc592545a4997f7790f50f6076 [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:07:44.121493 20075 leader_election.cc:336] T 775c229504194560ba9589bc2199b089 P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321): Network error: Client connection negotiation failed: client connection to 127.17.223.1:40321: connect: Connection refused (error 111)
I20260709 13:07:44.121882 20075 leader_election.cc:304] T 775c229504194560ba9589bc2199b089 P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 127766fc592545a4997f7790f50f6076; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:07:44.122610 20111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff9b0eddd810459b82d91c60777c10eb" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:07:44.122826 27152 raft_consensus.cc:493] T 65d8cb8d6ec64f459d5a47cefab10acf P e61c3a8f61bb48f8a963c9480e53c168 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader e5256d91808b47c195bc9b4dbd7f2b87)
I20260709 13:07:44.123339 27152 raft_consensus.cc:515] T 65d8cb8d6ec64f459d5a47cefab10acf P e61c3a8f61bb48f8a963c9480e53c168 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
W20260709 13:07:44.124343 19449 leader_election.cc:336] T ff9b0eddd810459b82d91c60777c10eb P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321): Network error: Client connection negotiation failed: client connection to 127.17.223.1:40321: connect: Connection refused (error 111)
I20260709 13:07:44.125413 27152 leader_election.cc:290] T 65d8cb8d6ec64f459d5a47cefab10acf P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:07:44.125819 19526 leader_election.cc:304] T 2b74109013a140ada21feeef92d6f563 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:07:44.126945 27152 raft_consensus.cc:2804] T 2b74109013a140ada21feeef92d6f563 P e61c3a8f61bb48f8a963c9480e53c168 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:07:44.127471 27152 raft_consensus.cc:493] T 2b74109013a140ada21feeef92d6f563 P e61c3a8f61bb48f8a963c9480e53c168 [term 18 FOLLOWER]: Starting leader election (detected failure of leader e5256d91808b47c195bc9b4dbd7f2b87)
I20260709 13:07:44.128261 27152 raft_consensus.cc:3060] T 2b74109013a140ada21feeef92d6f563 P e61c3a8f61bb48f8a963c9480e53c168 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:07:44.128450 27191 raft_consensus.cc:515] T 5ec1c4ce15e04c7e8c283a62179f2a64 P 127766fc592545a4997f7790f50f6076 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:07:44.131929 19483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ec1c4ce15e04c7e8c283a62179f2a64" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:07:44.132537 19483 raft_consensus.cc:3060] T 5ec1c4ce15e04c7e8c283a62179f2a64 P 0473d2b2d01f4459b1e90fd12cc7840e [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:07:44.133747 27245 raft_consensus.cc:2749] T 775c229504194560ba9589bc2199b089 P 127766fc592545a4997f7790f50f6076 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:07:44.132920 27191 leader_election.cc:290] T 5ec1c4ce15e04c7e8c283a62179f2a64 P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 17 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:07:44.143656 27152 raft_consensus.cc:515] T 2b74109013a140ada21feeef92d6f563 P e61c3a8f61bb48f8a963c9480e53c168 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:07:44.145114 27241 raft_consensus.cc:493] T 172b3dd13109415a955b71ac0e9d2234 P 0473d2b2d01f4459b1e90fd12cc7840e [term 19 FOLLOWER]: Starting pre-election (detected failure of leader e5256d91808b47c195bc9b4dbd7f2b87)
I20260709 13:07:44.145663 27241 raft_consensus.cc:515] T 172b3dd13109415a955b71ac0e9d2234 P 0473d2b2d01f4459b1e90fd12cc7840e [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:07:44.146082 27152 leader_election.cc:290] T 2b74109013a140ada21feeef92d6f563 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 19 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:07:44.147096 19484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b74109013a140ada21feeef92d6f563" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:07:44.147677 19484 raft_consensus.cc:3060] T 2b74109013a140ada21feeef92d6f563 P 0473d2b2d01f4459b1e90fd12cc7840e [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:07:44.147818 27241 leader_election.cc:290] T 172b3dd13109415a955b71ac0e9d2234 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:07:44.148798 20110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "172b3dd13109415a955b71ac0e9d2234" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:07:44.149405 20110 raft_consensus.cc:2468] T 172b3dd13109415a955b71ac0e9d2234 P 127766fc592545a4997f7790f50f6076 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 19.
W20260709 13:07:44.150451 19449 consensus_peers.cc:597] T 21e14947d70440f19044d8f75c31e1f9 P 0473d2b2d01f4459b1e90fd12cc7840e -> Peer e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321): Couldn't send request to peer e5256d91808b47c195bc9b4dbd7f2b87. Status: Network error: Client connection negotiation failed: client connection to 127.17.223.1:40321: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:07:44.153290 19449 leader_election.cc:304] T 172b3dd13109415a955b71ac0e9d2234 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, 127766fc592545a4997f7790f50f6076; no voters: 
I20260709 13:07:44.154049 27241 raft_consensus.cc:2804] T 172b3dd13109415a955b71ac0e9d2234 P 0473d2b2d01f4459b1e90fd12cc7840e [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:07:44.154541 27241 raft_consensus.cc:493] T 172b3dd13109415a955b71ac0e9d2234 P 0473d2b2d01f4459b1e90fd12cc7840e [term 19 FOLLOWER]: Starting leader election (detected failure of leader e5256d91808b47c195bc9b4dbd7f2b87)
I20260709 13:07:44.155006 27241 raft_consensus.cc:3060] T 172b3dd13109415a955b71ac0e9d2234 P 0473d2b2d01f4459b1e90fd12cc7840e [term 19 FOLLOWER]: Advancing to term 20
W20260709 13:07:44.155182 19449 leader_election.cc:336] T 172b3dd13109415a955b71ac0e9d2234 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321): Network error: Client connection negotiation failed: client connection to 127.17.223.1:40321: connect: Connection refused (error 111)
I20260709 13:07:44.156316 19484 raft_consensus.cc:2468] T 2b74109013a140ada21feeef92d6f563 P 0473d2b2d01f4459b1e90fd12cc7840e [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 19.
W20260709 13:07:44.146517 20075 leader_election.cc:336] T 5ec1c4ce15e04c7e8c283a62179f2a64 P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321): Network error: Client connection negotiation failed: client connection to 127.17.223.1:40321: connect: Connection refused (error 111)
I20260709 13:07:44.159832 19526 leader_election.cc:304] T 2b74109013a140ada21feeef92d6f563 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:07:44.161839 19483 raft_consensus.cc:2468] T 5ec1c4ce15e04c7e8c283a62179f2a64 P 0473d2b2d01f4459b1e90fd12cc7840e [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 127766fc592545a4997f7790f50f6076 in term 17.
I20260709 13:07:44.162973 20078 leader_election.cc:304] T 5ec1c4ce15e04c7e8c283a62179f2a64 P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, 127766fc592545a4997f7790f50f6076; no voters: 
I20260709 13:07:44.167850 27245 raft_consensus.cc:2804] T 5ec1c4ce15e04c7e8c283a62179f2a64 P 127766fc592545a4997f7790f50f6076 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:07:44.168421 27245 raft_consensus.cc:697] T 5ec1c4ce15e04c7e8c283a62179f2a64 P 127766fc592545a4997f7790f50f6076 [term 17 LEADER]: Becoming Leader. State: Replica: 127766fc592545a4997f7790f50f6076, State: Running, Role: LEADER
I20260709 13:07:44.169299 27245 consensus_queue.cc:237] T 5ec1c4ce15e04c7e8c283a62179f2a64 P 127766fc592545a4997f7790f50f6076 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 16.14, Last appended by leader: 14, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:07:44.163690 27152 raft_consensus.cc:2804] T 2b74109013a140ada21feeef92d6f563 P e61c3a8f61bb48f8a963c9480e53c168 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:07:44.175760 27152 raft_consensus.cc:697] T 2b74109013a140ada21feeef92d6f563 P e61c3a8f61bb48f8a963c9480e53c168 [term 19 LEADER]: Becoming Leader. State: Replica: e61c3a8f61bb48f8a963c9480e53c168, State: Running, Role: LEADER
I20260709 13:07:44.186515 27201 raft_consensus.cc:515] T ff9b0eddd810459b82d91c60777c10eb P 127766fc592545a4997f7790f50f6076 [term 23 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:07:44.206452 27201 leader_election.cc:290] T ff9b0eddd810459b82d91c60777c10eb P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 23 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:07:44.206964 20111 raft_consensus.cc:2393] T ff9b0eddd810459b82d91c60777c10eb P 127766fc592545a4997f7790f50f6076 [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0473d2b2d01f4459b1e90fd12cc7840e in current term 23: Already voted for candidate 127766fc592545a4997f7790f50f6076 in this term.
I20260709 13:07:44.209393 27152 consensus_queue.cc:237] T 2b74109013a140ada21feeef92d6f563 P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 18.10, Last appended by leader: 10, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:07:44.218704 19483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff9b0eddd810459b82d91c60777c10eb" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:07:44.219568 19483 raft_consensus.cc:3060] T ff9b0eddd810459b82d91c60777c10eb P 0473d2b2d01f4459b1e90fd12cc7840e [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:07:44.227991 19449 leader_election.cc:304] T ff9b0eddd810459b82d91c60777c10eb P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e; no voters: 127766fc592545a4997f7790f50f6076, e5256d91808b47c195bc9b4dbd7f2b87
W20260709 13:07:44.231927 20075 leader_election.cc:336] T 5ec1c4ce15e04c7e8c283a62179f2a64 P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 17 election: RPC error from VoteRequest() call to peer e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321): Network error: Client connection negotiation failed: client connection to 127.17.223.1:40321: connect: Connection refused (error 111)
I20260709 13:07:44.211894 27241 raft_consensus.cc:515] T 172b3dd13109415a955b71ac0e9d2234 P 0473d2b2d01f4459b1e90fd12cc7840e [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:07:44.236450 19483 raft_consensus.cc:2468] T ff9b0eddd810459b82d91c60777c10eb P 0473d2b2d01f4459b1e90fd12cc7840e [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 127766fc592545a4997f7790f50f6076 in term 23.
I20260709 13:07:44.242111 20111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65d8cb8d6ec64f459d5a47cefab10acf" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:07:44.242791 20111 raft_consensus.cc:2468] T 65d8cb8d6ec64f459d5a47cefab10acf P 127766fc592545a4997f7790f50f6076 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 21.
I20260709 13:07:44.243566 27260 raft_consensus.cc:493] T 775c229504194560ba9589bc2199b089 P 0473d2b2d01f4459b1e90fd12cc7840e [term 15 FOLLOWER]: Starting pre-election (detected failure of leader e5256d91808b47c195bc9b4dbd7f2b87)
I20260709 13:07:44.253465 27260 raft_consensus.cc:515] T 775c229504194560ba9589bc2199b089 P 0473d2b2d01f4459b1e90fd12cc7840e [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:07:44.254920 27257 raft_consensus.cc:493] T 85c494af21f9457a85da47b9bc70c1fd P 127766fc592545a4997f7790f50f6076 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader e5256d91808b47c195bc9b4dbd7f2b87)
I20260709 13:07:44.255730 27260 leader_election.cc:290] T 775c229504194560ba9589bc2199b089 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:07:44.256944 27201 raft_consensus.cc:493] T d1e5873a19244c5ebbcd38e126796ee7 P 127766fc592545a4997f7790f50f6076 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader e5256d91808b47c195bc9b4dbd7f2b87)
I20260709 13:07:44.257485 27201 raft_consensus.cc:515] T d1e5873a19244c5ebbcd38e126796ee7 P 127766fc592545a4997f7790f50f6076 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } attrs { replace: true } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:07:44.260969 19301 catalog_manager.cc:5697] T 5ec1c4ce15e04c7e8c283a62179f2a64 P 127766fc592545a4997f7790f50f6076 reported cstate change: term changed from 16 to 17, leader changed from e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1) to 127766fc592545a4997f7790f50f6076 (127.17.223.4). New cstate: current_term: 17 leader_uuid: "127766fc592545a4997f7790f50f6076" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:07:44.264060 27241 leader_election.cc:290] T 172b3dd13109415a955b71ac0e9d2234 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 20 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:07:44.255471 27257 raft_consensus.cc:515] T 85c494af21f9457a85da47b9bc70c1fd P 127766fc592545a4997f7790f50f6076 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:07:44.273139 20078 leader_election.cc:304] T ff9b0eddd810459b82d91c60777c10eb P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, 127766fc592545a4997f7790f50f6076; no voters: 
I20260709 13:07:44.242053 27213 raft_consensus.cc:2749] T ff9b0eddd810459b82d91c60777c10eb P 0473d2b2d01f4459b1e90fd12cc7840e [term 23 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:07:44.277304 27201 leader_election.cc:290] T d1e5873a19244c5ebbcd38e126796ee7 P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:07:44.281541 27263 raft_consensus.cc:493] T e381f1d6b8184797ad142de49be225a8 P e61c3a8f61bb48f8a963c9480e53c168 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader e5256d91808b47c195bc9b4dbd7f2b87)
I20260709 13:07:44.282321 19484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e5873a19244c5ebbcd38e126796ee7" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
W20260709 13:07:44.283409 19449 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.4:43121, user_credentials={real_user=slave}} blocked reactor thread for 45919.4us
I20260709 13:07:44.288378 27201 raft_consensus.cc:2804] T ff9b0eddd810459b82d91c60777c10eb P 127766fc592545a4997f7790f50f6076 [term 23 FOLLOWER]: Leader election won for term 23
I20260709 13:07:44.288944 27201 raft_consensus.cc:697] T ff9b0eddd810459b82d91c60777c10eb P 127766fc592545a4997f7790f50f6076 [term 23 LEADER]: Becoming Leader. State: Replica: 127766fc592545a4997f7790f50f6076, State: Running, Role: LEADER
I20260709 13:07:44.291590 27201 consensus_queue.cc:237] T ff9b0eddd810459b82d91c60777c10eb P 127766fc592545a4997f7790f50f6076 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 22.15, Last appended by leader: 15, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
W20260709 13:07:44.294086 19449 leader_election.cc:336] T 775c229504194560ba9589bc2199b089 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321): Network error: Client connection negotiation failed: client connection to 127.17.223.1:40321: connect: Connection refused (error 111)
W20260709 13:07:44.294561 19449 leader_election.cc:336] T 172b3dd13109415a955b71ac0e9d2234 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 20 election: RPC error from VoteRequest() call to peer e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321): Network error: Client connection negotiation failed: client connection to 127.17.223.1:40321: connect: Connection refused (error 111)
I20260709 13:07:44.300573 20111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "775c229504194560ba9589bc2199b089" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:07:44.300871 19557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e5873a19244c5ebbcd38e126796ee7" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:07:44.301277 20111 raft_consensus.cc:2468] T 775c229504194560ba9589bc2199b089 P 127766fc592545a4997f7790f50f6076 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 15.
I20260709 13:07:44.302760 20111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "172b3dd13109415a955b71ac0e9d2234" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076"
I20260709 13:07:44.303293 20111 raft_consensus.cc:3060] T 172b3dd13109415a955b71ac0e9d2234 P 127766fc592545a4997f7790f50f6076 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:07:44.305593 27264 raft_consensus.cc:493] T 0cdf56e38bbc453d9438d359e5a69955 P 0473d2b2d01f4459b1e90fd12cc7840e [term 22 FOLLOWER]: Starting pre-election (detected failure of leader e5256d91808b47c195bc9b4dbd7f2b87)
I20260709 13:07:44.313908 19557 raft_consensus.cc:1275] T 28af091831594f9d8e96482078cc7625 P e61c3a8f61bb48f8a963c9480e53c168 [term 21 FOLLOWER]: Refusing update from remote peer 127766fc592545a4997f7790f50f6076: Log matching property violated. Preceding OpId in replica: term: 20 index: 15. Preceding OpId from leader: term: 21 index: 16. (index mismatch)
I20260709 13:07:44.318462 19449 leader_election.cc:304] T 775c229504194560ba9589bc2199b089 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, 127766fc592545a4997f7790f50f6076; no voters: e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:07:44.324186 20111 raft_consensus.cc:2468] T 172b3dd13109415a955b71ac0e9d2234 P 127766fc592545a4997f7790f50f6076 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 20.
W20260709 13:07:44.321206 19523 leader_election.cc:336] T 2b74109013a140ada21feeef92d6f563 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321): Network error: Client connection negotiation failed: client connection to 127.17.223.1:40321: connect: Connection refused (error 111)
I20260709 13:07:44.335438 20076 leader_election.cc:304] T d1e5873a19244c5ebbcd38e126796ee7 P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 127766fc592545a4997f7790f50f6076; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:07:44.336184 19523 leader_election.cc:304] T 65d8cb8d6ec64f459d5a47cefab10acf P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 127766fc592545a4997f7790f50f6076, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:07:44.341971 27262 raft_consensus.cc:2749] T d1e5873a19244c5ebbcd38e126796ee7 P 127766fc592545a4997f7790f50f6076 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:07:44.344693 27260 raft_consensus.cc:493] T f93ee515a9c14139bf566522ed8232f3 P 0473d2b2d01f4459b1e90fd12cc7840e [term 26 FOLLOWER]: Starting pre-election (detected failure of leader e5256d91808b47c195bc9b4dbd7f2b87)
I20260709 13:07:44.345434 27260 raft_consensus.cc:515] T f93ee515a9c14139bf566522ed8232f3 P 0473d2b2d01f4459b1e90fd12cc7840e [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:07:44.347700 27241 raft_consensus.cc:2804] T 775c229504194560ba9589bc2199b089 P 0473d2b2d01f4459b1e90fd12cc7840e [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:07:44.348119 27260 leader_election.cc:290] T f93ee515a9c14139bf566522ed8232f3 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:07:44.304067 27263 raft_consensus.cc:515] T e381f1d6b8184797ad142de49be225a8 P e61c3a8f61bb48f8a963c9480e53c168 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:07:44.315047 27264 raft_consensus.cc:515] T 0cdf56e38bbc453d9438d359e5a69955 P 0473d2b2d01f4459b1e90fd12cc7840e [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:07:44.358852 27266 raft_consensus.cc:493] T f93ee515a9c14139bf566522ed8232f3 P e61c3a8f61bb48f8a963c9480e53c168 [term 26 FOLLOWER]: Starting pre-election (detected failure of leader e5256d91808b47c195bc9b4dbd7f2b87)
I20260709 13:07:44.370123 27266 raft_consensus.cc:515] T f93ee515a9c14139bf566522ed8232f3 P e61c3a8f61bb48f8a963c9480e53c168 [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:07:44.371963 27191 raft_consensus.cc:493] T 309c3ca0ca4b4f3ba129752ea2cb293b P 127766fc592545a4997f7790f50f6076 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader e5256d91808b47c195bc9b4dbd7f2b87)
I20260709 13:07:44.372220 27266 leader_election.cc:290] T f93ee515a9c14139bf566522ed8232f3 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:07:44.372509 27191 raft_consensus.cc:515] T 309c3ca0ca4b4f3ba129752ea2cb293b P 127766fc592545a4997f7790f50f6076 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:07:44.358551 27263 leader_election.cc:290] T e381f1d6b8184797ad142de49be225a8 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
W20260709 13:07:44.375370 20075 leader_election.cc:336] T ff9b0eddd810459b82d91c60777c10eb P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 23 election: RPC error from VoteRequest() call to peer e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321): Network error: Client connection negotiation failed: client connection to 127.17.223.1:40321: connect: Connection refused (error 111)
W20260709 13:07:44.376248 20075 leader_election.cc:336] T d1e5873a19244c5ebbcd38e126796ee7 P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321): Network error: Client connection negotiation failed: client connection to 127.17.223.1:40321: connect: Connection refused (error 111)
I20260709 13:07:44.350615 27265 raft_consensus.cc:2804] T 65d8cb8d6ec64f459d5a47cefab10acf P e61c3a8f61bb48f8a963c9480e53c168 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:07:44.377383 27265 raft_consensus.cc:493] T 65d8cb8d6ec64f459d5a47cefab10acf P e61c3a8f61bb48f8a963c9480e53c168 [term 21 FOLLOWER]: Starting leader election (detected failure of leader e5256d91808b47c195bc9b4dbd7f2b87)
I20260709 13:07:44.377770 27265 raft_consensus.cc:3060] T 65d8cb8d6ec64f459d5a47cefab10acf P e61c3a8f61bb48f8a963c9480e53c168 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:07:44.376911 19483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "309c3ca0ca4b4f3ba129752ea2cb293b" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
W20260709 13:07:44.380571 20075 leader_election.cc:336] T 85c494af21f9457a85da47b9bc70c1fd P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321): Network error: Client connection negotiation failed: client connection to 127.17.223.1:40321: connect: Connection refused (error 111)
W20260709 13:07:44.381398 20075 consensus_peers.cc:597] T 28af091831594f9d8e96482078cc7625 P 127766fc592545a4997f7790f50f6076 -> Peer e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321): Couldn't send request to peer e5256d91808b47c195bc9b4dbd7f2b87. Status: Network error: Client connection negotiation failed: client connection to 127.17.223.1:40321: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:07:44.372872 19301 catalog_manager.cc:5697] T 2b74109013a140ada21feeef92d6f563 P e61c3a8f61bb48f8a963c9480e53c168 reported cstate change: term changed from 18 to 19, leader changed from e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1) to e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3). New cstate: current_term: 19 leader_uuid: "e61c3a8f61bb48f8a963c9480e53c168" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } health_report { overall_health: HEALTHY } } }
I20260709 13:07:44.384325 19557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f93ee515a9c14139bf566522ed8232f3" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 27 candidate_status { last_received { term: 26 index: 14 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:07:44.374518 27191 leader_election.cc:290] T 309c3ca0ca4b4f3ba129752ea2cb293b P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:07:44.387283 27257 leader_election.cc:290] T 85c494af21f9457a85da47b9bc70c1fd P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:07:44.387809 27257 consensus_queue.cc:1048] T 28af091831594f9d8e96482078cc7625 P 127766fc592545a4997f7790f50f6076 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.000s
I20260709 13:07:44.384922 19557 raft_consensus.cc:2468] T f93ee515a9c14139bf566522ed8232f3 P e61c3a8f61bb48f8a963c9480e53c168 [term 26 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 26.
W20260709 13:07:44.391093 20075 leader_election.cc:336] T 309c3ca0ca4b4f3ba129752ea2cb293b P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321): Network error: Client connection negotiation failed: client connection to 127.17.223.1:40321: connect: Connection refused (error 111)
I20260709 13:07:44.391541 20075 leader_election.cc:304] T 309c3ca0ca4b4f3ba129752ea2cb293b P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 127766fc592545a4997f7790f50f6076; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87
W20260709 13:07:44.396482 19523 consensus_peers.cc:597] T a08760e15aac4630a629431f56024dc8 P e61c3a8f61bb48f8a963c9480e53c168 -> Peer e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321): Couldn't send request to peer e5256d91808b47c195bc9b4dbd7f2b87. Status: Network error: Client connection negotiation failed: client connection to 127.17.223.1:40321: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:07:44.397082 19523 leader_election.cc:336] T 65d8cb8d6ec64f459d5a47cefab10acf P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321): Network error: Client connection negotiation failed: client connection to 127.17.223.1:40321: connect: Connection refused (error 111)
W20260709 13:07:44.397934 19523 leader_election.cc:336] T 2b74109013a140ada21feeef92d6f563 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 19 election: RPC error from VoteRequest() call to peer e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321): Network error: Client connection negotiation failed: client connection to 127.17.223.1:40321: connect: Connection refused (error 111)
I20260709 13:07:44.398126 19554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85c494af21f9457a85da47b9bc70c1fd" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:07:44.348119 27241 raft_consensus.cc:493] T 775c229504194560ba9589bc2199b089 P 0473d2b2d01f4459b1e90fd12cc7840e [term 15 FOLLOWER]: Starting leader election (detected failure of leader e5256d91808b47c195bc9b4dbd7f2b87)
I20260709 13:07:44.400254 19450 leader_election.cc:304] T f93ee515a9c14139bf566522ed8232f3 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:07:44.405334 20076 leader_election.cc:304] T 85c494af21f9457a85da47b9bc70c1fd P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 127766fc592545a4997f7790f50f6076; no voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:07:44.406847 27258 raft_consensus.cc:2749] T 85c494af21f9457a85da47b9bc70c1fd P 127766fc592545a4997f7790f50f6076 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:07:44.412503 27260 raft_consensus.cc:2804] T f93ee515a9c14139bf566522ed8232f3 P 0473d2b2d01f4459b1e90fd12cc7840e [term 26 FOLLOWER]: Leader pre-election won for term 27
I20260709 13:07:44.415624 27260 raft_consensus.cc:493] T f93ee515a9c14139bf566522ed8232f3 P 0473d2b2d01f4459b1e90fd12cc7840e [term 26 FOLLOWER]: Starting leader election (detected failure of leader e5256d91808b47c195bc9b4dbd7f2b87)
I20260709 13:07:44.416071 27260 raft_consensus.cc:3060] T f93ee515a9c14139bf566522ed8232f3 P 0473d2b2d01f4459b1e90fd12cc7840e [term 26 FOLLOWER]: Advancing to term 27
I20260709 13:07:44.416440 27264 leader_election.cc:290] T 0cdf56e38bbc453d9438d359e5a69955 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:07:44.350991 27152 raft_consensus.cc:493] T edd7d470b5014c9489be7f41f64355c9 P e61c3a8f61bb48f8a963c9480e53c168 [term 26 FOLLOWER]: Starting pre-election (detected failure of leader e5256d91808b47c195bc9b4dbd7f2b87)
I20260709 13:07:44.403661 27241 raft_consensus.cc:3060] T 775c229504194560ba9589bc2199b089 P 0473d2b2d01f4459b1e90fd12cc7840e [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:07:44.400863 27255 raft_consensus.cc:493] T 2e36a9d6e29c4a7c860cf267efbd4c74 P e61c3a8f61bb48f8a963c9480e53c168 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader e5256d91808b47c195bc9b4dbd7f2b87)
I20260709 13:07:44.421805 27255 raft_consensus.cc:515] T 2e36a9d6e29c4a7c860cf267efbd4c74 P e61c3a8f61bb48f8a963c9480e53c168 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:07:44.424191 27260 raft_consensus.cc:515] T f93ee515a9c14139bf566522ed8232f3 P 0473d2b2d01f4459b1e90fd12cc7840e [term 27 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:07:44.429836 19557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cdf56e38bbc453d9438d359e5a69955" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:07:44.430838 19554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f93ee515a9c14139bf566522ed8232f3" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 27 candidate_status { last_received { term: 26 index: 14 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:07:44.431372 19554 raft_consensus.cc:3060] T f93ee515a9c14139bf566522ed8232f3 P e61c3a8f61bb48f8a963c9480e53c168 [term 26 FOLLOWER]: Advancing to term 27
I20260709 13:07:44.417706 27152 raft_consensus.cc:515] T edd7d470b5014c9489be7f41f64355c9 P e61c3a8f61bb48f8a963c9480e53c168 [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:07:44.426585 27260 leader_election.cc:290] T f93ee515a9c14139bf566522ed8232f3 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 27 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:07:44.435846 27152 leader_election.cc:290] T edd7d470b5014c9489be7f41f64355c9 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:07:44.441797 19554 raft_consensus.cc:2468] T f93ee515a9c14139bf566522ed8232f3 P e61c3a8f61bb48f8a963c9480e53c168 [term 27 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 27.
I20260709 13:07:44.403829 27257 raft_consensus.cc:2749] T 309c3ca0ca4b4f3ba129752ea2cb293b P 127766fc592545a4997f7790f50f6076 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:07:44.442997 27255 leader_election.cc:290] T 2e36a9d6e29c4a7c860cf267efbd4c74 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:07:44.450096 27241 raft_consensus.cc:515] T 775c229504194560ba9589bc2199b089 P 0473d2b2d01f4459b1e90fd12cc7840e [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
W20260709 13:07:44.451514 19523 leader_election.cc:336] T f93ee515a9c14139bf566522ed8232f3 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 27 pre-election: RPC error from VoteRequest() call to peer e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321): Network error: Client connection negotiation failed: client connection to 127.17.223.1:40321: connect: Connection refused (error 111)
I20260709 13:07:44.451701 19450 leader_election.cc:304] T f93ee515a9c14139bf566522ed8232f3 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 27 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
W20260709 13:07:44.454141 19523 leader_election.cc:336] T e381f1d6b8184797ad142de49be225a8 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321): Network error: Client connection negotiation failed: client connection to 127.17.223.1:40321: connect: Connection refused (error 111)
W20260709 13:07:44.454843 19523 consensus_peers.cc:597] T b9f0d59553ad444883fcf5b5909f9798 P e61c3a8f61bb48f8a963c9480e53c168 -> Peer e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321): Couldn't send request to peer e5256d91808b47c195bc9b4dbd7f2b87. Status: Network error: Client connection negotiation failed: client connection to 127.17.223.1:40321: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:07:44.466701 27241 leader_election.cc:290] T 775c229504194560ba9589bc2199b089 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 16 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:07:44.464926 27265 raft_consensus.cc:515] T 65d8cb8d6ec64f459d5a47cefab10acf P e61c3a8f61bb48f8a963c9480e53c168 [term 22 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:07:44.468663 27213 raft_consensus.cc:2804] T f93ee515a9c14139bf566522ed8232f3 P 0473d2b2d01f4459b1e90fd12cc7840e [term 27 FOLLOWER]: Leader election won for term 27
I20260709 13:07:44.469182 27265 leader_election.cc:290] T 65d8cb8d6ec64f459d5a47cefab10acf P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 22 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:07:44.469233 27213 raft_consensus.cc:697] T f93ee515a9c14139bf566522ed8232f3 P 0473d2b2d01f4459b1e90fd12cc7840e [term 27 LEADER]: Becoming Leader. State: Replica: 0473d2b2d01f4459b1e90fd12cc7840e, State: Running, Role: LEADER
I20260709 13:07:44.470489 27213 consensus_queue.cc:237] T f93ee515a9c14139bf566522ed8232f3 P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 26.14, Last appended by leader: 14, Current term: 27, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
W20260709 13:07:44.465116 19449 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.4:43121, user_credentials={real_user=slave}} blocked reactor thread for 146724us
W20260709 13:07:44.476369 19523 leader_election.cc:336] T 2e36a9d6e29c4a7c860cf267efbd4c74 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321): Network error: Client connection negotiation failed: client connection to 127.17.223.1:40321: connect: Connection refused (error 111)
I20260709 13:07:44.482990 20111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65d8cb8d6ec64f459d5a47cefab10acf" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076"
I20260709 13:07:44.483538 20111 raft_consensus.cc:3060] T 65d8cb8d6ec64f459d5a47cefab10acf P 127766fc592545a4997f7790f50f6076 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:07:44.485525 19449 leader_election.cc:304] T 172b3dd13109415a955b71ac0e9d2234 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, 127766fc592545a4997f7790f50f6076; no voters: e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:07:44.487272 27269 raft_consensus.cc:493] T d1e5873a19244c5ebbcd38e126796ee7 P 0473d2b2d01f4459b1e90fd12cc7840e [term 22 FOLLOWER]: Starting pre-election (detected failure of leader e5256d91808b47c195bc9b4dbd7f2b87)
I20260709 13:07:44.487838 27269 raft_consensus.cc:515] T d1e5873a19244c5ebbcd38e126796ee7 P 0473d2b2d01f4459b1e90fd12cc7840e [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } attrs { replace: true } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:07:44.494565 27270 raft_consensus.cc:493] T 309c3ca0ca4b4f3ba129752ea2cb293b P 0473d2b2d01f4459b1e90fd12cc7840e [term 15 FOLLOWER]: Starting pre-election (detected failure of leader e5256d91808b47c195bc9b4dbd7f2b87)
I20260709 13:07:44.495355 20111 raft_consensus.cc:2468] T 65d8cb8d6ec64f459d5a47cefab10acf P 127766fc592545a4997f7790f50f6076 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 22.
I20260709 13:07:44.495148 27270 raft_consensus.cc:515] T 309c3ca0ca4b4f3ba129752ea2cb293b P 0473d2b2d01f4459b1e90fd12cc7840e [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:07:44.497164 27270 leader_election.cc:290] T 309c3ca0ca4b4f3ba129752ea2cb293b P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:07:44.499104 19554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e5873a19244c5ebbcd38e126796ee7" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:07:44.502020 27261 raft_consensus.cc:493] T 85c494af21f9457a85da47b9bc70c1fd P e61c3a8f61bb48f8a963c9480e53c168 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader e5256d91808b47c195bc9b4dbd7f2b87)
I20260709 13:07:44.502605 27261 raft_consensus.cc:515] T 85c494af21f9457a85da47b9bc70c1fd P e61c3a8f61bb48f8a963c9480e53c168 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:07:44.504379 27255 raft_consensus.cc:493] T 4af19371ea874c09a0a2147040835cbb P e61c3a8f61bb48f8a963c9480e53c168 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader e5256d91808b47c195bc9b4dbd7f2b87)
I20260709 13:07:44.504874 27255 raft_consensus.cc:515] T 4af19371ea874c09a0a2147040835cbb P e61c3a8f61bb48f8a963c9480e53c168 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:07:44.490425 27269 leader_election.cc:290] T d1e5873a19244c5ebbcd38e126796ee7 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:07:44.508080 27261 leader_election.cc:290] T 85c494af21f9457a85da47b9bc70c1fd P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
W20260709 13:07:44.516297 18300 thread.cc:527] Waited for 1000ms trying to join with diag-logger (tid 19432)
I20260709 13:07:44.518931 20111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "775c229504194560ba9589bc2199b089" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076"
I20260709 13:07:44.519323 27255 leader_election.cc:290] T 4af19371ea874c09a0a2147040835cbb P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:07:44.519505 20111 raft_consensus.cc:3060] T 775c229504194560ba9589bc2199b089 P 127766fc592545a4997f7790f50f6076 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:07:44.511680 27269 raft_consensus.cc:2804] T 172b3dd13109415a955b71ac0e9d2234 P 0473d2b2d01f4459b1e90fd12cc7840e [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:07:44.525033 20110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e5873a19244c5ebbcd38e126796ee7" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:07:44.525662 20110 raft_consensus.cc:2468] T d1e5873a19244c5ebbcd38e126796ee7 P 127766fc592545a4997f7790f50f6076 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 22.
I20260709 13:07:44.526527 27255 raft_consensus.cc:493] T 0cdf56e38bbc453d9438d359e5a69955 P e61c3a8f61bb48f8a963c9480e53c168 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader e5256d91808b47c195bc9b4dbd7f2b87)
I20260709 13:07:44.527096 27255 raft_consensus.cc:515] T 0cdf56e38bbc453d9438d359e5a69955 P e61c3a8f61bb48f8a963c9480e53c168 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:07:44.528614 27201 raft_consensus.cc:493] T 4af19371ea874c09a0a2147040835cbb P 127766fc592545a4997f7790f50f6076 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader e5256d91808b47c195bc9b4dbd7f2b87)
I20260709 13:07:44.528189 19301 catalog_manager.cc:5697] T ff9b0eddd810459b82d91c60777c10eb P 127766fc592545a4997f7790f50f6076 reported cstate change: term changed from 22 to 23, leader changed from e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1) to 127766fc592545a4997f7790f50f6076 (127.17.223.4). New cstate: current_term: 23 leader_uuid: "127766fc592545a4997f7790f50f6076" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:07:44.529531 27255 leader_election.cc:290] T 0cdf56e38bbc453d9438d359e5a69955 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:07:44.529469 27201 raft_consensus.cc:515] T 4af19371ea874c09a0a2147040835cbb P 127766fc592545a4997f7790f50f6076 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:07:44.533696 27201 leader_election.cc:290] T 4af19371ea874c09a0a2147040835cbb P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:07:44.534538 27255 raft_consensus.cc:493] T d1e5873a19244c5ebbcd38e126796ee7 P e61c3a8f61bb48f8a963c9480e53c168 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader e5256d91808b47c195bc9b4dbd7f2b87)
I20260709 13:07:44.535305 27255 raft_consensus.cc:515] T d1e5873a19244c5ebbcd38e126796ee7 P e61c3a8f61bb48f8a963c9480e53c168 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } attrs { replace: true } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:07:44.535713 27269 raft_consensus.cc:697] T 172b3dd13109415a955b71ac0e9d2234 P 0473d2b2d01f4459b1e90fd12cc7840e [term 20 LEADER]: Becoming Leader. State: Replica: 0473d2b2d01f4459b1e90fd12cc7840e, State: Running, Role: LEADER
I20260709 13:07:44.536655 27269 consensus_queue.cc:237] T 172b3dd13109415a955b71ac0e9d2234 P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 19.14, Last appended by leader: 14, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
W20260709 13:07:44.537737 20075 leader_election.cc:336] T 4af19371ea874c09a0a2147040835cbb P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321): Network error: Client connection negotiation failed: client connection to 127.17.223.1:40321: connect: Connection refused (error 111)
I20260709 13:07:44.538003 27255 leader_election.cc:290] T d1e5873a19244c5ebbcd38e126796ee7 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
W20260709 13:07:44.530781 19523 leader_election.cc:336] T edd7d470b5014c9489be7f41f64355c9 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 27 pre-election: RPC error from VoteRequest() call to peer e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321): Network error: Client connection negotiation failed: client connection to 127.17.223.1:40321: connect: Connection refused (error 111)
I20260709 13:07:44.543561 20110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85c494af21f9457a85da47b9bc70c1fd" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:07:44.544170 20110 raft_consensus.cc:2468] T 85c494af21f9457a85da47b9bc70c1fd P 127766fc592545a4997f7790f50f6076 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 21.
I20260709 13:07:44.545117 27241 raft_consensus.cc:493] T 2e36a9d6e29c4a7c860cf267efbd4c74 P 0473d2b2d01f4459b1e90fd12cc7840e [term 17 FOLLOWER]: Starting pre-election (detected failure of leader e5256d91808b47c195bc9b4dbd7f2b87)
I20260709 13:07:44.545658 27241 raft_consensus.cc:515] T 2e36a9d6e29c4a7c860cf267efbd4c74 P 0473d2b2d01f4459b1e90fd12cc7840e [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:07:44.546944 20107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4af19371ea874c09a0a2147040835cbb" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:07:44.547564 20107 raft_consensus.cc:2468] T 4af19371ea874c09a0a2147040835cbb P 127766fc592545a4997f7790f50f6076 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 14.
I20260709 13:07:44.548030 20110 raft_consensus.cc:1275] T fa731b585f684a7fb2d106c50f143b83 P 127766fc592545a4997f7790f50f6076 [term 17 FOLLOWER]: Refusing update from remote peer e61c3a8f61bb48f8a963c9480e53c168: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 13:07:44.551991 19523 leader_election.cc:304] T 65d8cb8d6ec64f459d5a47cefab10acf P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 127766fc592545a4997f7790f50f6076, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:07:44.553761 20110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "309c3ca0ca4b4f3ba129752ea2cb293b" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:07:44.554785 20110 raft_consensus.cc:2468] T 309c3ca0ca4b4f3ba129752ea2cb293b P 127766fc592545a4997f7790f50f6076 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 15.
I20260709 13:07:44.559618 19523 leader_election.cc:304] T 85c494af21f9457a85da47b9bc70c1fd P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 127766fc592545a4997f7790f50f6076, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:07:44.561049 19523 leader_election.cc:304] T 4af19371ea874c09a0a2147040835cbb P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 127766fc592545a4997f7790f50f6076, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:07:44.566200 20111 raft_consensus.cc:2468] T 775c229504194560ba9589bc2199b089 P 127766fc592545a4997f7790f50f6076 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 16.
I20260709 13:07:44.563143 27271 raft_consensus.cc:2804] T 65d8cb8d6ec64f459d5a47cefab10acf P e61c3a8f61bb48f8a963c9480e53c168 [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:07:44.563418 27261 raft_consensus.cc:2804] T 85c494af21f9457a85da47b9bc70c1fd P e61c3a8f61bb48f8a963c9480e53c168 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:07:44.568689 27265 raft_consensus.cc:2804] T 4af19371ea874c09a0a2147040835cbb P e61c3a8f61bb48f8a963c9480e53c168 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:07:44.579877 19554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e36a9d6e29c4a7c860cf267efbd4c74" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:07:44.580449 19554 raft_consensus.cc:2468] T 2e36a9d6e29c4a7c860cf267efbd4c74 P e61c3a8f61bb48f8a963c9480e53c168 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 17.
I20260709 13:07:44.575953 27213 raft_consensus.cc:493] T edd7d470b5014c9489be7f41f64355c9 P 0473d2b2d01f4459b1e90fd12cc7840e [term 26 FOLLOWER]: Starting pre-election (detected failure of leader e5256d91808b47c195bc9b4dbd7f2b87)
I20260709 13:07:44.578830 27271 raft_consensus.cc:697] T 65d8cb8d6ec64f459d5a47cefab10acf P e61c3a8f61bb48f8a963c9480e53c168 [term 22 LEADER]: Becoming Leader. State: Replica: e61c3a8f61bb48f8a963c9480e53c168, State: Running, Role: LEADER
I20260709 13:07:44.577637 27241 leader_election.cc:290] T 2e36a9d6e29c4a7c860cf267efbd4c74 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:07:44.578157 19556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4af19371ea874c09a0a2147040835cbb" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:07:44.582021 19450 leader_election.cc:304] T 2e36a9d6e29c4a7c860cf267efbd4c74 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:07:44.593281 27241 raft_consensus.cc:2804] T 2e36a9d6e29c4a7c860cf267efbd4c74 P 0473d2b2d01f4459b1e90fd12cc7840e [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:07:44.592947 27271 consensus_queue.cc:237] T 65d8cb8d6ec64f459d5a47cefab10acf P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 21.13, Last appended by leader: 13, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:07:44.593691 27241 raft_consensus.cc:493] T 2e36a9d6e29c4a7c860cf267efbd4c74 P 0473d2b2d01f4459b1e90fd12cc7840e [term 17 FOLLOWER]: Starting leader election (detected failure of leader e5256d91808b47c195bc9b4dbd7f2b87)
I20260709 13:07:44.594086 27241 raft_consensus.cc:3060] T 2e36a9d6e29c4a7c860cf267efbd4c74 P 0473d2b2d01f4459b1e90fd12cc7840e [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:07:44.569854 27021 consensus_queue.cc:1048] T fa731b585f684a7fb2d106c50f143b83 P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Connected to new peer: Peer: permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.007s
I20260709 13:07:44.579577 27261 raft_consensus.cc:493] T 85c494af21f9457a85da47b9bc70c1fd P e61c3a8f61bb48f8a963c9480e53c168 [term 21 FOLLOWER]: Starting leader election (detected failure of leader e5256d91808b47c195bc9b4dbd7f2b87)
I20260709 13:07:44.595546 27261 raft_consensus.cc:3060] T 85c494af21f9457a85da47b9bc70c1fd P e61c3a8f61bb48f8a963c9480e53c168 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:07:44.579783 27265 raft_consensus.cc:493] T 4af19371ea874c09a0a2147040835cbb P e61c3a8f61bb48f8a963c9480e53c168 [term 14 FOLLOWER]: Starting leader election (detected failure of leader e5256d91808b47c195bc9b4dbd7f2b87)
I20260709 13:07:44.597092 27265 raft_consensus.cc:3060] T 4af19371ea874c09a0a2147040835cbb P e61c3a8f61bb48f8a963c9480e53c168 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:07:44.602057 27241 raft_consensus.cc:515] T 2e36a9d6e29c4a7c860cf267efbd4c74 P 0473d2b2d01f4459b1e90fd12cc7840e [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:07:44.605953 27241 leader_election.cc:290] T 2e36a9d6e29c4a7c860cf267efbd4c74 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 18 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:07:44.606652 19560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e36a9d6e29c4a7c860cf267efbd4c74" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:07:44.607713 19560 raft_consensus.cc:3060] T 2e36a9d6e29c4a7c860cf267efbd4c74 P e61c3a8f61bb48f8a963c9480e53c168 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:07:44.588416 20111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e5873a19244c5ebbcd38e126796ee7" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
W20260709 13:07:44.589078 19523 leader_election.cc:336] T 65d8cb8d6ec64f459d5a47cefab10acf P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 22 election: RPC error from VoteRequest() call to peer e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321): Network error: Client connection negotiation failed: client connection to 127.17.223.1:40321: connect: Connection refused (error 111)
I20260709 13:07:44.612989 20111 raft_consensus.cc:2468] T d1e5873a19244c5ebbcd38e126796ee7 P 127766fc592545a4997f7790f50f6076 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 22.
W20260709 13:07:44.618629 19523 consensus_peers.cc:597] T fa731b585f684a7fb2d106c50f143b83 P e61c3a8f61bb48f8a963c9480e53c168 -> Peer e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321): Couldn't send request to peer e5256d91808b47c195bc9b4dbd7f2b87. Status: Network error: Client connection negotiation failed: client connection to 127.17.223.1:40321: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:07:44.619022 27213 raft_consensus.cc:515] T edd7d470b5014c9489be7f41f64355c9 P 0473d2b2d01f4459b1e90fd12cc7840e [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:07:44.622862 27213 leader_election.cc:290] T edd7d470b5014c9489be7f41f64355c9 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:07:44.626658 19557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edd7d470b5014c9489be7f41f64355c9" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 27 candidate_status { last_received { term: 26 index: 14 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:07:44.643724 19557 raft_consensus.cc:2468] T edd7d470b5014c9489be7f41f64355c9 P e61c3a8f61bb48f8a963c9480e53c168 [term 26 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 26.
I20260709 13:07:44.656750 27265 raft_consensus.cc:515] T 4af19371ea874c09a0a2147040835cbb P e61c3a8f61bb48f8a963c9480e53c168 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:07:44.659045 19556 raft_consensus.cc:2393] T 4af19371ea874c09a0a2147040835cbb P e61c3a8f61bb48f8a963c9480e53c168 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 127766fc592545a4997f7790f50f6076 in current term 15: Already voted for candidate e61c3a8f61bb48f8a963c9480e53c168 in this term.
I20260709 13:07:44.645905 19450 leader_election.cc:304] T edd7d470b5014c9489be7f41f64355c9 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:07:44.671808 27270 raft_consensus.cc:2804] T edd7d470b5014c9489be7f41f64355c9 P 0473d2b2d01f4459b1e90fd12cc7840e [term 26 FOLLOWER]: Leader pre-election won for term 27
I20260709 13:07:44.672194 27270 raft_consensus.cc:493] T edd7d470b5014c9489be7f41f64355c9 P 0473d2b2d01f4459b1e90fd12cc7840e [term 26 FOLLOWER]: Starting leader election (detected failure of leader e5256d91808b47c195bc9b4dbd7f2b87)
I20260709 13:07:44.672271 19484 raft_consensus.cc:1275] T 5ec1c4ce15e04c7e8c283a62179f2a64 P 0473d2b2d01f4459b1e90fd12cc7840e [term 17 FOLLOWER]: Refusing update from remote peer 127766fc592545a4997f7790f50f6076: Log matching property violated. Preceding OpId in replica: term: 16 index: 14. Preceding OpId from leader: term: 17 index: 15. (index mismatch)
I20260709 13:07:44.672586 27270 raft_consensus.cc:3060] T edd7d470b5014c9489be7f41f64355c9 P 0473d2b2d01f4459b1e90fd12cc7840e [term 26 FOLLOWER]: Advancing to term 27
I20260709 13:07:44.676642 27261 raft_consensus.cc:515] T 85c494af21f9457a85da47b9bc70c1fd P e61c3a8f61bb48f8a963c9480e53c168 [term 22 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:07:44.678807 27261 leader_election.cc:290] T 85c494af21f9457a85da47b9bc70c1fd P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 22 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:07:44.684579 19560 raft_consensus.cc:2468] T 2e36a9d6e29c4a7c860cf267efbd4c74 P e61c3a8f61bb48f8a963c9480e53c168 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 18.
I20260709 13:07:44.685328 20076 leader_election.cc:304] T 4af19371ea874c09a0a2147040835cbb P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 127766fc592545a4997f7790f50f6076; no voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168
W20260709 13:07:44.685590 19523 leader_election.cc:336] T 4af19371ea874c09a0a2147040835cbb P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321): Network error: Client connection negotiation failed: client connection to 127.17.223.1:40321: connect: Connection refused (error 111)
W20260709 13:07:44.686245 19523 leader_election.cc:336] T 85c494af21f9457a85da47b9bc70c1fd P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321): Network error: Client connection negotiation failed: client connection to 127.17.223.1:40321: connect: Connection refused (error 111)
W20260709 13:07:44.687533 19523 leader_election.cc:336] T 0cdf56e38bbc453d9438d359e5a69955 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321): Network error: Client connection negotiation failed: client connection to 127.17.223.1:40321: connect: Connection refused (error 111)
W20260709 13:07:44.688118 19523 leader_election.cc:336] T d1e5873a19244c5ebbcd38e126796ee7 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321): Network error: Client connection negotiation failed: client connection to 127.17.223.1:40321: connect: Connection refused (error 111)
I20260709 13:07:44.689239 19450 leader_election.cc:304] T 2e36a9d6e29c4a7c860cf267efbd4c74 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:07:44.701148 20110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85c494af21f9457a85da47b9bc70c1fd" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076"
I20260709 13:07:44.701766 20110 raft_consensus.cc:3060] T 85c494af21f9457a85da47b9bc70c1fd P 127766fc592545a4997f7790f50f6076 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:07:44.691383 27191 raft_consensus.cc:3060] T 4af19371ea874c09a0a2147040835cbb P 127766fc592545a4997f7790f50f6076 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:07:44.708840 20107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4af19371ea874c09a0a2147040835cbb" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076"
I20260709 13:07:44.712786 20110 raft_consensus.cc:2468] T 85c494af21f9457a85da47b9bc70c1fd P 127766fc592545a4997f7790f50f6076 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 22.
I20260709 13:07:44.714113 19484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f93ee515a9c14139bf566522ed8232f3" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 27 candidate_status { last_received { term: 26 index: 14 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:07:44.718168 19523 leader_election.cc:304] T 85c494af21f9457a85da47b9bc70c1fd P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 127766fc592545a4997f7790f50f6076, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:07:44.723940 19483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e381f1d6b8184797ad142de49be225a8" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:07:44.720146 19301 catalog_manager.cc:5697] T f93ee515a9c14139bf566522ed8232f3 P 0473d2b2d01f4459b1e90fd12cc7840e reported cstate change: term changed from 26 to 27, leader changed from e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1) to 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2). New cstate: current_term: 27 leader_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:44.700320 27260 raft_consensus.cc:493] T e381f1d6b8184797ad142de49be225a8 P 0473d2b2d01f4459b1e90fd12cc7840e [term 19 FOLLOWER]: Starting pre-election (detected failure of leader e5256d91808b47c195bc9b4dbd7f2b87)
I20260709 13:07:44.694365 27257 consensus_queue.cc:1048] T 5ec1c4ce15e04c7e8c283a62179f2a64 P 127766fc592545a4997f7790f50f6076 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.025s
I20260709 13:07:44.706573 27241 raft_consensus.cc:2804] T 2e36a9d6e29c4a7c860cf267efbd4c74 P 0473d2b2d01f4459b1e90fd12cc7840e [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:07:44.737784 27241 raft_consensus.cc:697] T 2e36a9d6e29c4a7c860cf267efbd4c74 P 0473d2b2d01f4459b1e90fd12cc7840e [term 18 LEADER]: Becoming Leader. State: Replica: 0473d2b2d01f4459b1e90fd12cc7840e, State: Running, Role: LEADER
I20260709 13:07:44.738775 27241 consensus_queue.cc:237] T 2e36a9d6e29c4a7c860cf267efbd4c74 P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.10, Last appended by leader: 10, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:07:44.707015 27265 leader_election.cc:290] T 4af19371ea874c09a0a2147040835cbb P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 15 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:07:44.745507 27260 raft_consensus.cc:515] T e381f1d6b8184797ad142de49be225a8 P 0473d2b2d01f4459b1e90fd12cc7840e [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:07:44.747284 19484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e36a9d6e29c4a7c860cf267efbd4c74" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:07:44.747872 19483 raft_consensus.cc:2468] T e381f1d6b8184797ad142de49be225a8 P 0473d2b2d01f4459b1e90fd12cc7840e [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 19.
I20260709 13:07:44.748245 19477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edd7d470b5014c9489be7f41f64355c9" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 27 candidate_status { last_received { term: 26 index: 14 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:07:44.748977 27260 leader_election.cc:290] T e381f1d6b8184797ad142de49be225a8 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:07:44.750586 19485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cdf56e38bbc453d9438d359e5a69955" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:07:44.751161 19485 raft_consensus.cc:2468] T 0cdf56e38bbc453d9438d359e5a69955 P 0473d2b2d01f4459b1e90fd12cc7840e [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 22.
I20260709 13:07:44.752848 19484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e5873a19244c5ebbcd38e126796ee7" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:07:44.753417 19484 raft_consensus.cc:2468] T d1e5873a19244c5ebbcd38e126796ee7 P 0473d2b2d01f4459b1e90fd12cc7840e [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 22.
I20260709 13:07:44.754745 19553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e381f1d6b8184797ad142de49be225a8" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:07:44.762585 19478 raft_consensus.cc:1275] T 2b74109013a140ada21feeef92d6f563 P 0473d2b2d01f4459b1e90fd12cc7840e [term 19 FOLLOWER]: Refusing update from remote peer e61c3a8f61bb48f8a963c9480e53c168: Log matching property violated. Preceding OpId in replica: term: 18 index: 10. Preceding OpId from leader: term: 19 index: 11. (index mismatch)
I20260709 13:07:44.723438 27152 raft_consensus.cc:2804] T 85c494af21f9457a85da47b9bc70c1fd P e61c3a8f61bb48f8a963c9480e53c168 [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:07:44.768628 27152 raft_consensus.cc:697] T 85c494af21f9457a85da47b9bc70c1fd P e61c3a8f61bb48f8a963c9480e53c168 [term 22 LEADER]: Becoming Leader. State: Replica: e61c3a8f61bb48f8a963c9480e53c168, State: Running, Role: LEADER
I20260709 13:07:44.769590 27152 consensus_queue.cc:237] T 85c494af21f9457a85da47b9bc70c1fd P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 21.16, Last appended by leader: 16, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:07:44.755468 19553 raft_consensus.cc:2468] T e381f1d6b8184797ad142de49be225a8 P e61c3a8f61bb48f8a963c9480e53c168 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 19.
I20260709 13:07:44.773682 19526 leader_election.cc:304] T f93ee515a9c14139bf566522ed8232f3 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e61c3a8f61bb48f8a963c9480e53c168; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:07:44.775291 19526 leader_election.cc:304] T 2e36a9d6e29c4a7c860cf267efbd4c74 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e61c3a8f61bb48f8a963c9480e53c168; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:07:44.780953 27266 raft_consensus.cc:2749] T 2e36a9d6e29c4a7c860cf267efbd4c74 P e61c3a8f61bb48f8a963c9480e53c168 [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:07:44.781703 19526 leader_election.cc:304] T 0cdf56e38bbc453d9438d359e5a69955 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168; no voters: e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:07:44.787073 27255 raft_consensus.cc:2749] T f93ee515a9c14139bf566522ed8232f3 P e61c3a8f61bb48f8a963c9480e53c168 [term 27 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
W20260709 13:07:44.789350 19523 leader_election.cc:336] T 4af19371ea874c09a0a2147040835cbb P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 15 election: RPC error from VoteRequest() call to peer e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321): Network error: Client connection negotiation failed: client connection to 127.17.223.1:40321: connect: Connection refused (error 111)
I20260709 13:07:44.774058 19450 leader_election.cc:304] T e381f1d6b8184797ad142de49be225a8 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:07:44.785691 19526 leader_election.cc:304] T e381f1d6b8184797ad142de49be225a8 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168; no voters: e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:07:44.795482 19449 leader_election.cc:304] T 309c3ca0ca4b4f3ba129752ea2cb293b P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, 127766fc592545a4997f7790f50f6076; no voters: 
I20260709 13:07:44.792614 19302 catalog_manager.cc:5697] T 65d8cb8d6ec64f459d5a47cefab10acf P e61c3a8f61bb48f8a963c9480e53c168 reported cstate change: term changed from 21 to 22, leader changed from e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1) to e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3). New cstate: current_term: 22 leader_uuid: "e61c3a8f61bb48f8a963c9480e53c168" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:44.802930 27277 raft_consensus.cc:2804] T e381f1d6b8184797ad142de49be225a8 P 0473d2b2d01f4459b1e90fd12cc7840e [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:07:44.803376 27277 raft_consensus.cc:493] T e381f1d6b8184797ad142de49be225a8 P 0473d2b2d01f4459b1e90fd12cc7840e [term 19 FOLLOWER]: Starting leader election (detected failure of leader e5256d91808b47c195bc9b4dbd7f2b87)
I20260709 13:07:44.803761 27277 raft_consensus.cc:3060] T e381f1d6b8184797ad142de49be225a8 P 0473d2b2d01f4459b1e90fd12cc7840e [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:07:44.804032 27280 raft_consensus.cc:2804] T 309c3ca0ca4b4f3ba129752ea2cb293b P 0473d2b2d01f4459b1e90fd12cc7840e [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:07:44.804450 27280 raft_consensus.cc:493] T 309c3ca0ca4b4f3ba129752ea2cb293b P 0473d2b2d01f4459b1e90fd12cc7840e [term 15 FOLLOWER]: Starting leader election (detected failure of leader e5256d91808b47c195bc9b4dbd7f2b87)
I20260709 13:07:44.804819 27280 raft_consensus.cc:3060] T 309c3ca0ca4b4f3ba129752ea2cb293b P 0473d2b2d01f4459b1e90fd12cc7840e [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:07:44.808274 19523 consensus_peers.cc:597] T 2b74109013a140ada21feeef92d6f563 P e61c3a8f61bb48f8a963c9480e53c168 -> Peer e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321): Couldn't send request to peer e5256d91808b47c195bc9b4dbd7f2b87. Status: Network error: Client connection negotiation failed: client connection to 127.17.223.1:40321: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:07:44.782600 27266 raft_consensus.cc:2804] T 0cdf56e38bbc453d9438d359e5a69955 P e61c3a8f61bb48f8a963c9480e53c168 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:07:44.806751 19449 leader_election.cc:304] T 775c229504194560ba9589bc2199b089 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, 127766fc592545a4997f7790f50f6076; no voters: 
I20260709 13:07:44.812541 27266 raft_consensus.cc:493] T 0cdf56e38bbc453d9438d359e5a69955 P e61c3a8f61bb48f8a963c9480e53c168 [term 22 FOLLOWER]: Starting leader election (detected failure of leader e5256d91808b47c195bc9b4dbd7f2b87)
I20260709 13:07:44.800944 27255 raft_consensus.cc:2804] T e381f1d6b8184797ad142de49be225a8 P e61c3a8f61bb48f8a963c9480e53c168 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:07:44.932832 27270 raft_consensus.cc:515] T edd7d470b5014c9489be7f41f64355c9 P 0473d2b2d01f4459b1e90fd12cc7840e [term 27 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:07:44.936879 19477 raft_consensus.cc:2393] T edd7d470b5014c9489be7f41f64355c9 P 0473d2b2d01f4459b1e90fd12cc7840e [term 27 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e61c3a8f61bb48f8a963c9480e53c168 in current term 27: Already voted for candidate 0473d2b2d01f4459b1e90fd12cc7840e in this term.
I20260709 13:07:44.937794 27270 leader_election.cc:290] T edd7d470b5014c9489be7f41f64355c9 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 27 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:07:44.920038 27266 raft_consensus.cc:3060] T 0cdf56e38bbc453d9438d359e5a69955 P e61c3a8f61bb48f8a963c9480e53c168 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:07:44.938789 27280 raft_consensus.cc:515] T 309c3ca0ca4b4f3ba129752ea2cb293b P 0473d2b2d01f4459b1e90fd12cc7840e [term 16 FOLLOWER]: Starting leader election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:07:44.947079 19553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edd7d470b5014c9489be7f41f64355c9" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 27 candidate_status { last_received { term: 26 index: 14 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:07:44.951725 19553 raft_consensus.cc:3060] T edd7d470b5014c9489be7f41f64355c9 P e61c3a8f61bb48f8a963c9480e53c168 [term 26 FOLLOWER]: Advancing to term 27
I20260709 13:07:44.920241 27255 raft_consensus.cc:493] T e381f1d6b8184797ad142de49be225a8 P e61c3a8f61bb48f8a963c9480e53c168 [term 19 FOLLOWER]: Starting leader election (detected failure of leader e5256d91808b47c195bc9b4dbd7f2b87)
I20260709 13:07:44.958372 19526 leader_election.cc:304] T d1e5873a19244c5ebbcd38e126796ee7 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, 127766fc592545a4997f7790f50f6076, e61c3a8f61bb48f8a963c9480e53c168; no voters: e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:07:44.959136 27255 raft_consensus.cc:3060] T e381f1d6b8184797ad142de49be225a8 P e61c3a8f61bb48f8a963c9480e53c168 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:07:44.982914 27280 leader_election.cc:290] T 309c3ca0ca4b4f3ba129752ea2cb293b P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 16 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:07:44.959498 27266 raft_consensus.cc:515] T 0cdf56e38bbc453d9438d359e5a69955 P e61c3a8f61bb48f8a963c9480e53c168 [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
W20260709 13:07:45.021837 19450 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.3:36891, user_credentials={real_user=slave}} blocked reactor thread for 75579.9us
I20260709 13:07:45.041953 27191 raft_consensus.cc:2749] T 4af19371ea874c09a0a2147040835cbb P 127766fc592545a4997f7790f50f6076 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:07:45.043838 27277 raft_consensus.cc:515] T e381f1d6b8184797ad142de49be225a8 P 0473d2b2d01f4459b1e90fd12cc7840e [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:07:45.045907 27277 leader_election.cc:290] T e381f1d6b8184797ad142de49be225a8 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 20 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:07:45.059294 19553 raft_consensus.cc:2468] T edd7d470b5014c9489be7f41f64355c9 P e61c3a8f61bb48f8a963c9480e53c168 [term 27 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 27.
I20260709 13:07:45.021520 27260 raft_consensus.cc:2804] T 775c229504194560ba9589bc2199b089 P 0473d2b2d01f4459b1e90fd12cc7840e [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:07:45.070165 27260 raft_consensus.cc:697] T 775c229504194560ba9589bc2199b089 P 0473d2b2d01f4459b1e90fd12cc7840e [term 16 LEADER]: Becoming Leader. State: Replica: 0473d2b2d01f4459b1e90fd12cc7840e, State: Running, Role: LEADER
I20260709 13:07:45.071399 27260 consensus_queue.cc:237] T 775c229504194560ba9589bc2199b089 P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:07:44.983244 27271 raft_consensus.cc:2804] T d1e5873a19244c5ebbcd38e126796ee7 P e61c3a8f61bb48f8a963c9480e53c168 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:07:45.087034 27271 raft_consensus.cc:493] T d1e5873a19244c5ebbcd38e126796ee7 P e61c3a8f61bb48f8a963c9480e53c168 [term 22 FOLLOWER]: Starting leader election (detected failure of leader e5256d91808b47c195bc9b4dbd7f2b87)
I20260709 13:07:45.087702 27271 raft_consensus.cc:3060] T d1e5873a19244c5ebbcd38e126796ee7 P e61c3a8f61bb48f8a963c9480e53c168 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:07:45.091997 20107 raft_consensus.cc:2468] T 4af19371ea874c09a0a2147040835cbb P 127766fc592545a4997f7790f50f6076 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 15.
W20260709 13:07:45.096772 19450 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.3:36891, user_credentials={real_user=slave}} blocked reactor thread for 56103.6us
I20260709 13:07:45.098850 27255 raft_consensus.cc:515] T e381f1d6b8184797ad142de49be225a8 P e61c3a8f61bb48f8a963c9480e53c168 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:07:45.101118 27255 leader_election.cc:290] T e381f1d6b8184797ad142de49be225a8 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 20 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
W20260709 13:07:45.113768 19523 leader_election.cc:336] T 85c494af21f9457a85da47b9bc70c1fd P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 22 election: RPC error from VoteRequest() call to peer e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321): Network error: Client connection negotiation failed: client connection to 127.17.223.1:40321: connect: Connection refused (error 111)
I20260709 13:07:45.121831 19479 raft_consensus.cc:1275] T ff9b0eddd810459b82d91c60777c10eb P 0473d2b2d01f4459b1e90fd12cc7840e [term 23 FOLLOWER]: Refusing update from remote peer 127766fc592545a4997f7790f50f6076: Log matching property violated. Preceding OpId in replica: term: 22 index: 15. Preceding OpId from leader: term: 23 index: 16. (index mismatch)
I20260709 13:07:45.127723 19450 leader_election.cc:304] T edd7d470b5014c9489be7f41f64355c9 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 27 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
W20260709 13:07:45.138096 19449 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.4:43121, user_credentials={real_user=slave}} blocked reactor thread for 331445us
I20260709 13:07:45.143471 19523 leader_election.cc:304] T 4af19371ea874c09a0a2147040835cbb P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 127766fc592545a4997f7790f50f6076, e61c3a8f61bb48f8a963c9480e53c168; no voters: e5256d91808b47c195bc9b4dbd7f2b87
W20260709 13:07:45.144238 19526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.2:46257, user_credentials={real_user=slave}} blocked reactor thread for 181353us
I20260709 13:07:45.148831 19553 raft_consensus.cc:1275] T f93ee515a9c14139bf566522ed8232f3 P e61c3a8f61bb48f8a963c9480e53c168 [term 27 FOLLOWER]: Refusing update from remote peer 0473d2b2d01f4459b1e90fd12cc7840e: Log matching property violated. Preceding OpId in replica: term: 26 index: 14. Preceding OpId from leader: term: 27 index: 15. (index mismatch)
W20260709 13:07:45.154911 19449 leader_election.cc:336] T f93ee515a9c14139bf566522ed8232f3 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 27 pre-election: RPC error from VoteRequest() call to peer e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321): Network error: Client connection negotiation failed: client connection to 127.17.223.1:40321: connect: Connection refused (error 111)
W20260709 13:07:45.148576 19293 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.DeleteTablet -> {remote=127.17.223.1:40321, user_credentials={real_user=slave}} blocked reactor thread for 92557.5us
I20260709 13:07:45.150583 19556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e381f1d6b8184797ad142de49be225a8" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:07:45.157876 19556 raft_consensus.cc:2393] T e381f1d6b8184797ad142de49be225a8 P e61c3a8f61bb48f8a963c9480e53c168 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 0473d2b2d01f4459b1e90fd12cc7840e in current term 20: Already voted for candidate e61c3a8f61bb48f8a963c9480e53c168 in this term.
I20260709 13:07:45.150125 27277 raft_consensus.cc:2804] T edd7d470b5014c9489be7f41f64355c9 P 0473d2b2d01f4459b1e90fd12cc7840e [term 27 FOLLOWER]: Leader election won for term 27
I20260709 13:07:45.174844 27277 raft_consensus.cc:697] T edd7d470b5014c9489be7f41f64355c9 P 0473d2b2d01f4459b1e90fd12cc7840e [term 27 LEADER]: Becoming Leader. State: Replica: 0473d2b2d01f4459b1e90fd12cc7840e, State: Running, Role: LEADER
I20260709 13:07:45.175949 27277 consensus_queue.cc:237] T edd7d470b5014c9489be7f41f64355c9 P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 26.14, Last appended by leader: 14, Current term: 27, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:07:45.183683 27297 consensus_queue.cc:1048] T 2b74109013a140ada21feeef92d6f563 P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.005s
I20260709 13:07:45.185976 27266 leader_election.cc:290] T 0cdf56e38bbc453d9438d359e5a69955 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 23 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
W20260709 13:07:45.187815 20075 consensus_peers.cc:597] T ff9b0eddd810459b82d91c60777c10eb P 127766fc592545a4997f7790f50f6076 -> Peer e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321): Couldn't send request to peer e5256d91808b47c195bc9b4dbd7f2b87. Status: Network error: Client connection negotiation failed: client connection to 127.17.223.1:40321: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:07:45.196776 20075 consensus_peers.cc:597] T 5ec1c4ce15e04c7e8c283a62179f2a64 P 127766fc592545a4997f7790f50f6076 -> Peer e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321): Couldn't send request to peer e5256d91808b47c195bc9b4dbd7f2b87. Status: Network error: Client connection negotiation failed: client connection to 127.17.223.1:40321: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:07:45.199000 19450 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.3:36891, user_credentials={real_user=slave}} blocked reactor thread for 46869.4us
W20260709 13:07:45.205587 19449 leader_election.cc:336] T 0cdf56e38bbc453d9438d359e5a69955 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321): Network error: Client connection negotiation failed: client connection to 127.17.223.1:40321: connect: Connection refused (error 111)
I20260709 13:07:45.206944 19449 leader_election.cc:304] T 0cdf56e38bbc453d9438d359e5a69955 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e; no voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:07:45.164306 27152 raft_consensus.cc:2804] T 4af19371ea874c09a0a2147040835cbb P e61c3a8f61bb48f8a963c9480e53c168 [term 15 FOLLOWER]: Leader election won for term 15
W20260709 13:07:45.235925 19449 leader_election.cc:336] T f93ee515a9c14139bf566522ed8232f3 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 27 election: RPC error from VoteRequest() call to peer e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321): Network error: Client connection negotiation failed: client connection to 127.17.223.1:40321: connect: Connection refused (error 111)
W20260709 13:07:45.238699 19449 leader_election.cc:336] T 775c229504194560ba9589bc2199b089 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 16 election: RPC error from VoteRequest() call to peer e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321): Network error: Client connection negotiation failed: client connection to 127.17.223.1:40321: connect: Connection refused (error 111)
W20260709 13:07:45.239372 19449 leader_election.cc:336] T d1e5873a19244c5ebbcd38e126796ee7 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321): Network error: Client connection negotiation failed: client connection to 127.17.223.1:40321: connect: Connection refused (error 111)
W20260709 13:07:45.242048 19523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.4:43121, user_credentials={real_user=slave}} blocked reactor thread for 90465.6us
I20260709 13:07:45.240414 19449 leader_election.cc:304] T d1e5873a19244c5ebbcd38e126796ee7 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, 127766fc592545a4997f7790f50f6076; no voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:07:45.235000 27287 consensus_queue.cc:1048] T ff9b0eddd810459b82d91c60777c10eb P 127766fc592545a4997f7790f50f6076 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.016s
I20260709 13:07:45.242373 27267 raft_consensus.cc:2749] T 0cdf56e38bbc453d9438d359e5a69955 P 0473d2b2d01f4459b1e90fd12cc7840e [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:07:45.213652 27213 consensus_queue.cc:1048] T f93ee515a9c14139bf566522ed8232f3 P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.023s
W20260709 13:07:45.259459 19293 catalog_manager.cc:4755] TS e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet bc225c93219c45538b53a1bd3d387e4d: Network error: Client connection negotiation failed: client connection to 127.17.223.1:40321: connect: Connection refused (error 111)
W20260709 13:07:45.263502 19449 leader_election.cc:336] T 309c3ca0ca4b4f3ba129752ea2cb293b P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321): Network error: Client connection negotiation failed: client connection to 127.17.223.1:40321: connect: Connection refused (error 111)
W20260709 13:07:45.282858 19526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.2:46257, user_credentials={real_user=slave}} blocked reactor thread for 131884us
I20260709 13:07:45.276027 19301 catalog_manager.cc:5697] T 172b3dd13109415a955b71ac0e9d2234 P 0473d2b2d01f4459b1e90fd12cc7840e reported cstate change: term changed from 19 to 20, leader changed from e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1) to 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2). New cstate: current_term: 20 leader_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:45.241537 27152 raft_consensus.cc:697] T 4af19371ea874c09a0a2147040835cbb P e61c3a8f61bb48f8a963c9480e53c168 [term 15 LEADER]: Becoming Leader. State: Replica: e61c3a8f61bb48f8a963c9480e53c168, State: Running, Role: LEADER
I20260709 13:07:45.286996 19301 catalog_manager.cc:5697] T 2e36a9d6e29c4a7c860cf267efbd4c74 P 0473d2b2d01f4459b1e90fd12cc7840e reported cstate change: term changed from 17 to 18, leader changed from e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1) to 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2). New cstate: current_term: 18 leader_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:45.295161 20111 raft_consensus.cc:1275] T 65d8cb8d6ec64f459d5a47cefab10acf P 127766fc592545a4997f7790f50f6076 [term 22 FOLLOWER]: Refusing update from remote peer e61c3a8f61bb48f8a963c9480e53c168: Log matching property violated. Preceding OpId in replica: term: 21 index: 13. Preceding OpId from leader: term: 22 index: 14. (index mismatch)
I20260709 13:07:45.272779 27267 raft_consensus.cc:2749] T d1e5873a19244c5ebbcd38e126796ee7 P 0473d2b2d01f4459b1e90fd12cc7840e [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:07:45.310181 19302 catalog_manager.cc:5697] T 85c494af21f9457a85da47b9bc70c1fd P e61c3a8f61bb48f8a963c9480e53c168 reported cstate change: term changed from 21 to 22, leader changed from e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1) to e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3). New cstate: current_term: 22 leader_uuid: "e61c3a8f61bb48f8a963c9480e53c168" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:45.331393 27288 consensus_queue.cc:1048] T 65d8cb8d6ec64f459d5a47cefab10acf P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Connected to new peer: Peer: permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:07:45.337198 27152 consensus_queue.cc:237] T 4af19371ea874c09a0a2147040835cbb P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
W20260709 13:07:45.341310 19523 leader_election.cc:336] T e381f1d6b8184797ad142de49be225a8 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 20 election: RPC error from VoteRequest() call to peer e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321): Network error: Client connection negotiation failed: client connection to 127.17.223.1:40321: connect: Connection refused (error 111)
W20260709 13:07:45.365272 27251 log.cc:927] Time spent T 00000000000000000000000000000000 P 97750b77d35444acb7791ebf26cc2685: Append to log took a long time: real 0.060s	user 0.001s	sys 0.000s
W20260709 13:07:45.366377 27300 log.cc:927] Time spent T 2e36a9d6e29c4a7c860cf267efbd4c74 P 0473d2b2d01f4459b1e90fd12cc7840e: Append to log took a long time: real 0.120s	user 0.001s	sys 0.000s
I20260709 13:07:45.318002 27271 raft_consensus.cc:515] T d1e5873a19244c5ebbcd38e126796ee7 P e61c3a8f61bb48f8a963c9480e53c168 [term 23 FOLLOWER]: Starting leader election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } attrs { replace: true } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:07:45.402374 19526 leader_election.cc:304] T edd7d470b5014c9489be7f41f64355c9 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e61c3a8f61bb48f8a963c9480e53c168; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:07:45.407938 19486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e381f1d6b8184797ad142de49be225a8" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:07:45.408707 19486 raft_consensus.cc:2393] T e381f1d6b8184797ad142de49be225a8 P 0473d2b2d01f4459b1e90fd12cc7840e [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate e61c3a8f61bb48f8a963c9480e53c168 in current term 20: Already voted for candidate 0473d2b2d01f4459b1e90fd12cc7840e in this term.
I20260709 13:07:45.409276 19482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cdf56e38bbc453d9438d359e5a69955" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:07:45.409842 19482 raft_consensus.cc:3060] T 0cdf56e38bbc453d9438d359e5a69955 P 0473d2b2d01f4459b1e90fd12cc7840e [term 22 FOLLOWER]: Advancing to term 23
W20260709 13:07:45.445324 19449 leader_election.cc:336] T 2e36a9d6e29c4a7c860cf267efbd4c74 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321): Network error: Client connection negotiation failed: client connection to 127.17.223.1:40321: connect: Connection refused (error 111)
W20260709 13:07:45.446950 19449 leader_election.cc:336] T 2e36a9d6e29c4a7c860cf267efbd4c74 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 18 election: RPC error from VoteRequest() call to peer e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321): Network error: Client connection negotiation failed: client connection to 127.17.223.1:40321: connect: Connection refused (error 111)
I20260709 13:07:45.448441 19526 leader_election.cc:304] T e381f1d6b8184797ad142de49be225a8 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e61c3a8f61bb48f8a963c9480e53c168; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87
W20260709 13:07:45.449208 19449 leader_election.cc:336] T edd7d470b5014c9489be7f41f64355c9 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 27 pre-election: RPC error from VoteRequest() call to peer e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321): Network error: Client connection negotiation failed: client connection to 127.17.223.1:40321: connect: Connection refused (error 111)
W20260709 13:07:45.449923 19449 leader_election.cc:336] T e381f1d6b8184797ad142de49be225a8 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321): Network error: Client connection negotiation failed: client connection to 127.17.223.1:40321: connect: Connection refused (error 111)
W20260709 13:07:45.452246 20076 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.3:36891, user_credentials={real_user=slave}} blocked reactor thread for 76069.8us
I20260709 13:07:45.429147 27021 raft_consensus.cc:2749] T edd7d470b5014c9489be7f41f64355c9 P e61c3a8f61bb48f8a963c9480e53c168 [term 27 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
I20260709 13:07:45.467392 27152 raft_consensus.cc:2749] T e381f1d6b8184797ad142de49be225a8 P e61c3a8f61bb48f8a963c9480e53c168 [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 13:07:45.483354 27271 leader_election.cc:290] T d1e5873a19244c5ebbcd38e126796ee7 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 23 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
W20260709 13:07:45.490075 19449 leader_election.cc:336] T edd7d470b5014c9489be7f41f64355c9 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 27 election: RPC error from VoteRequest() call to peer e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321): Network error: Client connection negotiation failed: client connection to 127.17.223.1:40321: connect: Connection refused (error 111)
W20260709 13:07:45.491948 19523 leader_election.cc:336] T 0cdf56e38bbc453d9438d359e5a69955 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 23 election: RPC error from VoteRequest() call to peer e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321): Network error: Client connection negotiation failed: client connection to 127.17.223.1:40321: connect: Connection refused (error 111)
W20260709 13:07:45.492669 19523 consensus_peers.cc:597] T 65d8cb8d6ec64f459d5a47cefab10acf P e61c3a8f61bb48f8a963c9480e53c168 -> Peer e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321): Couldn't send request to peer e5256d91808b47c195bc9b4dbd7f2b87. Status: Network error: Client connection negotiation failed: client connection to 127.17.223.1:40321: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:07:45.494781 19449 leader_election.cc:336] T 309c3ca0ca4b4f3ba129752ea2cb293b P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 16 election: RPC error from VoteRequest() call to peer e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321): Network error: Client connection negotiation failed: client connection to 127.17.223.1:40321: connect: Connection refused (error 111)
W20260709 13:07:45.495290 19449 consensus_peers.cc:597] T f93ee515a9c14139bf566522ed8232f3 P 0473d2b2d01f4459b1e90fd12cc7840e -> Peer e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321): Couldn't send request to peer e5256d91808b47c195bc9b4dbd7f2b87. Status: Network error: Client connection negotiation failed: client connection to 127.17.223.1:40321: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:07:45.495657 19449 leader_election.cc:336] T e381f1d6b8184797ad142de49be225a8 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 20 election: RPC error from VoteRequest() call to peer e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321): Network error: Client connection negotiation failed: client connection to 127.17.223.1:40321: connect: Connection refused (error 111)
I20260709 13:07:45.496003 19449 leader_election.cc:304] T e381f1d6b8184797ad142de49be225a8 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e; no voters: e5256d91808b47c195bc9b4dbd7f2b87, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:07:45.496686 27260 raft_consensus.cc:2749] T e381f1d6b8184797ad142de49be225a8 P 0473d2b2d01f4459b1e90fd12cc7840e [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 13:07:45.499063 20111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e5873a19244c5ebbcd38e126796ee7" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076"
I20260709 13:07:45.499677 20111 raft_consensus.cc:3060] T d1e5873a19244c5ebbcd38e126796ee7 P 127766fc592545a4997f7790f50f6076 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:07:45.500104 19482 raft_consensus.cc:2468] T 0cdf56e38bbc453d9438d359e5a69955 P 0473d2b2d01f4459b1e90fd12cc7840e [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 23.
W20260709 13:07:45.502764 19449 consensus_peers.cc:597] T 172b3dd13109415a955b71ac0e9d2234 P 0473d2b2d01f4459b1e90fd12cc7840e -> Peer e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321): Couldn't send request to peer e5256d91808b47c195bc9b4dbd7f2b87. Status: Network error: Client connection negotiation failed: client connection to 127.17.223.1:40321: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:07:45.516819 18300 thread.cc:527] Waited for 2000ms trying to join with diag-logger (tid 19432)
I20260709 13:07:45.529241 20111 raft_consensus.cc:2468] T d1e5873a19244c5ebbcd38e126796ee7 P 127766fc592545a4997f7790f50f6076 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 23.
W20260709 13:07:45.546936 19523 consensus_peers.cc:597] T 85c494af21f9457a85da47b9bc70c1fd P e61c3a8f61bb48f8a963c9480e53c168 -> Peer e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321): Couldn't send request to peer e5256d91808b47c195bc9b4dbd7f2b87. Status: Network error: Client connection negotiation failed: client connection to 127.17.223.1:40321: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:07:45.547132 19526 leader_election.cc:304] T 0cdf56e38bbc453d9438d359e5a69955 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168; no voters: e5256d91808b47c195bc9b4dbd7f2b87
W20260709 13:07:45.547588 19523 leader_election.cc:336] T d1e5873a19244c5ebbcd38e126796ee7 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 23 election: RPC error from VoteRequest() call to peer e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321): Network error: Client connection negotiation failed: client connection to 127.17.223.1:40321: connect: Connection refused (error 111)
I20260709 13:07:45.545150 19302 catalog_manager.cc:5697] T 4af19371ea874c09a0a2147040835cbb P e61c3a8f61bb48f8a963c9480e53c168 reported cstate change: term changed from 14 to 15, leader changed from e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1) to e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3). New cstate: current_term: 15 leader_uuid: "e61c3a8f61bb48f8a963c9480e53c168" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:45.556078 19479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e5873a19244c5ebbcd38e126796ee7" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:07:45.563305 19553 raft_consensus.cc:1275] T 2e36a9d6e29c4a7c860cf267efbd4c74 P e61c3a8f61bb48f8a963c9480e53c168 [term 18 FOLLOWER]: Refusing update from remote peer 0473d2b2d01f4459b1e90fd12cc7840e: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
I20260709 13:07:45.572342 19479 raft_consensus.cc:3060] T d1e5873a19244c5ebbcd38e126796ee7 P 0473d2b2d01f4459b1e90fd12cc7840e [term 22 FOLLOWER]: Advancing to term 23
W20260709 13:07:45.541988 20078 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.2:46257, user_credentials={real_user=slave}} blocked reactor thread for 176802us
I20260709 13:07:45.550611 27265 raft_consensus.cc:2804] T 0cdf56e38bbc453d9438d359e5a69955 P e61c3a8f61bb48f8a963c9480e53c168 [term 23 FOLLOWER]: Leader election won for term 23
I20260709 13:07:45.574874 27265 raft_consensus.cc:697] T 0cdf56e38bbc453d9438d359e5a69955 P e61c3a8f61bb48f8a963c9480e53c168 [term 23 LEADER]: Becoming Leader. State: Replica: e61c3a8f61bb48f8a963c9480e53c168, State: Running, Role: LEADER
I20260709 13:07:45.576020 27265 consensus_queue.cc:237] T 0cdf56e38bbc453d9438d359e5a69955 P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 22.15, Last appended by leader: 15, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:07:45.570235 19305 catalog_manager.cc:5697] T edd7d470b5014c9489be7f41f64355c9 P 0473d2b2d01f4459b1e90fd12cc7840e reported cstate change: term changed from 26 to 27, leader changed from e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1) to 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2). New cstate: current_term: 27 leader_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:45.584815 20111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "309c3ca0ca4b4f3ba129752ea2cb293b" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076"
I20260709 13:07:45.585405 20111 raft_consensus.cc:3060] T 309c3ca0ca4b4f3ba129752ea2cb293b P 127766fc592545a4997f7790f50f6076 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:07:45.584007 27267 consensus_queue.cc:1048] T 2e36a9d6e29c4a7c860cf267efbd4c74 P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.006s
I20260709 13:07:45.595892 20112 raft_consensus.cc:1275] T 85c494af21f9457a85da47b9bc70c1fd P 127766fc592545a4997f7790f50f6076 [term 22 FOLLOWER]: Refusing update from remote peer e61c3a8f61bb48f8a963c9480e53c168: Log matching property violated. Preceding OpId in replica: term: 21 index: 16. Preceding OpId from leader: term: 22 index: 17. (index mismatch)
I20260709 13:07:45.600162 20112 raft_consensus.cc:1275] T 172b3dd13109415a955b71ac0e9d2234 P 127766fc592545a4997f7790f50f6076 [term 20 FOLLOWER]: Refusing update from remote peer 0473d2b2d01f4459b1e90fd12cc7840e: Log matching property violated. Preceding OpId in replica: term: 19 index: 14. Preceding OpId from leader: term: 20 index: 15. (index mismatch)
I20260709 13:07:45.606691 20111 raft_consensus.cc:2468] T 309c3ca0ca4b4f3ba129752ea2cb293b P 127766fc592545a4997f7790f50f6076 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 16.
I20260709 13:07:45.609215 19479 raft_consensus.cc:2468] T d1e5873a19244c5ebbcd38e126796ee7 P 0473d2b2d01f4459b1e90fd12cc7840e [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 23.
I20260709 13:07:45.581916 19305 catalog_manager.cc:5697] T 775c229504194560ba9589bc2199b089 P 0473d2b2d01f4459b1e90fd12cc7840e reported cstate change: term changed from 15 to 16, leader changed from e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1) to 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2). New cstate: current_term: 16 leader_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 13:07:45.617690 19449 consensus_peers.cc:597] T 2e36a9d6e29c4a7c860cf267efbd4c74 P 0473d2b2d01f4459b1e90fd12cc7840e -> Peer e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321): Couldn't send request to peer e5256d91808b47c195bc9b4dbd7f2b87. Status: Network error: Client connection negotiation failed: client connection to 127.17.223.1:40321: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:07:45.622025 19526 leader_election.cc:304] T d1e5873a19244c5ebbcd38e126796ee7 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, 127766fc592545a4997f7790f50f6076, e61c3a8f61bb48f8a963c9480e53c168; no voters: e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:07:45.626729 20111 raft_consensus.cc:1275] T 775c229504194560ba9589bc2199b089 P 127766fc592545a4997f7790f50f6076 [term 16 FOLLOWER]: Refusing update from remote peer 0473d2b2d01f4459b1e90fd12cc7840e: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 13:07:45.632076 19449 leader_election.cc:304] T 309c3ca0ca4b4f3ba129752ea2cb293b P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, 127766fc592545a4997f7790f50f6076; no voters: e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:07:45.625521 27266 consensus_queue.cc:1048] T 85c494af21f9457a85da47b9bc70c1fd P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Connected to new peer: Peer: permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.014s
I20260709 13:07:45.638072 27297 raft_consensus.cc:2804] T d1e5873a19244c5ebbcd38e126796ee7 P e61c3a8f61bb48f8a963c9480e53c168 [term 23 FOLLOWER]: Leader election won for term 23
I20260709 13:07:45.650770 27297 raft_consensus.cc:697] T d1e5873a19244c5ebbcd38e126796ee7 P e61c3a8f61bb48f8a963c9480e53c168 [term 23 LEADER]: Becoming Leader. State: Replica: e61c3a8f61bb48f8a963c9480e53c168, State: Running, Role: LEADER
I20260709 13:07:45.638702 27267 consensus_queue.cc:1048] T 172b3dd13109415a955b71ac0e9d2234 P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Connected to new peer: Peer: permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.014s
I20260709 13:07:45.651736 27297 consensus_queue.cc:237] T d1e5873a19244c5ebbcd38e126796ee7 P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 22.13, Last appended by leader: 13, Current term: 23, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } attrs { replace: true } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:07:45.653128 27213 raft_consensus.cc:2804] T 309c3ca0ca4b4f3ba129752ea2cb293b P 0473d2b2d01f4459b1e90fd12cc7840e [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:07:45.664888 27296 consensus_queue.cc:1048] T 775c229504194560ba9589bc2199b089 P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Connected to new peer: Peer: permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:07:45.665552 27213 raft_consensus.cc:697] T 309c3ca0ca4b4f3ba129752ea2cb293b P 0473d2b2d01f4459b1e90fd12cc7840e [term 16 LEADER]: Becoming Leader. State: Replica: 0473d2b2d01f4459b1e90fd12cc7840e, State: Running, Role: LEADER
I20260709 13:07:45.672444 19553 raft_consensus.cc:1275] T edd7d470b5014c9489be7f41f64355c9 P e61c3a8f61bb48f8a963c9480e53c168 [term 27 FOLLOWER]: Refusing update from remote peer 0473d2b2d01f4459b1e90fd12cc7840e: Log matching property violated. Preceding OpId in replica: term: 26 index: 14. Preceding OpId from leader: term: 27 index: 15. (index mismatch)
I20260709 13:07:45.682448 27264 consensus_queue.cc:1048] T edd7d470b5014c9489be7f41f64355c9 P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 13:07:45.666683 27213 consensus_queue.cc:237] T 309c3ca0ca4b4f3ba129752ea2cb293b P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 15.14, Last appended by leader: 14, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
W20260709 13:07:45.765345 19449 consensus_peers.cc:597] T edd7d470b5014c9489be7f41f64355c9 P 0473d2b2d01f4459b1e90fd12cc7840e -> Peer e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321): Couldn't send request to peer e5256d91808b47c195bc9b4dbd7f2b87. Status: Network error: Client connection negotiation failed: client connection to 127.17.223.1:40321: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:07:45.777105 19523 consensus_peers.cc:597] T 4509b76741dc428e9201c70c1658da13 P e61c3a8f61bb48f8a963c9480e53c168 -> Peer e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321): Couldn't send request to peer e5256d91808b47c195bc9b4dbd7f2b87. Status: Network error: Client connection negotiation failed: client connection to 127.17.223.1:40321: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:07:45.821647 20075 consensus_peers.cc:597] T 14efcc79969f41babe5529c22d59156d P 127766fc592545a4997f7790f50f6076 -> Peer e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321): Couldn't send request to peer e5256d91808b47c195bc9b4dbd7f2b87. Status: Network error: Client connection negotiation failed: client connection to 127.17.223.1:40321: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:07:45.824787 19449 consensus_peers.cc:597] T 775c229504194560ba9589bc2199b089 P 0473d2b2d01f4459b1e90fd12cc7840e -> Peer e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321): Couldn't send request to peer e5256d91808b47c195bc9b4dbd7f2b87. Status: Network error: Client connection negotiation failed: client connection to 127.17.223.1:40321: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:07:45.869863 19302 catalog_manager.cc:5697] T 0cdf56e38bbc453d9438d359e5a69955 P e61c3a8f61bb48f8a963c9480e53c168 reported cstate change: term changed from 22 to 23, leader changed from e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1) to e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3). New cstate: current_term: 23 leader_uuid: "e61c3a8f61bb48f8a963c9480e53c168" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } health_report { overall_health: HEALTHY } } }
I20260709 13:07:45.884574 19301 catalog_manager.cc:5697] T 309c3ca0ca4b4f3ba129752ea2cb293b P 0473d2b2d01f4459b1e90fd12cc7840e reported cstate change: term changed from 15 to 16, leader changed from e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1) to 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2). New cstate: current_term: 16 leader_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 13:07:45.900585 19523 consensus_peers.cc:597] T 22196caba61445d3bec98a0aab3c337d P e61c3a8f61bb48f8a963c9480e53c168 -> Peer e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321): Couldn't send request to peer e5256d91808b47c195bc9b4dbd7f2b87. Status: Network error: Client connection negotiation failed: client connection to 127.17.223.1:40321: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:07:45.941190 19523 consensus_peers.cc:597] T 3e1f505cb0f1427bbd698ac889d80821 P e61c3a8f61bb48f8a963c9480e53c168 -> Peer e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321): Couldn't send request to peer e5256d91808b47c195bc9b4dbd7f2b87. Status: Network error: Client connection negotiation failed: client connection to 127.17.223.1:40321: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:07:45.946859 19523 consensus_peers.cc:597] T 4af19371ea874c09a0a2147040835cbb P e61c3a8f61bb48f8a963c9480e53c168 -> Peer e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321): Couldn't send request to peer e5256d91808b47c195bc9b4dbd7f2b87. Status: Network error: Client connection negotiation failed: client connection to 127.17.223.1:40321: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:07:45.950397 19305 catalog_manager.cc:5697] T d1e5873a19244c5ebbcd38e126796ee7 P e61c3a8f61bb48f8a963c9480e53c168 reported cstate change: term changed from 22 to 23, leader changed from e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1) to e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3). New cstate: current_term: 23 leader_uuid: "e61c3a8f61bb48f8a963c9480e53c168" committed_config { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 13:07:45.955015 19523 consensus_peers.cc:597] T 217b5fae677b4971b3bbd2f357a1f7ff P e61c3a8f61bb48f8a963c9480e53c168 -> Peer e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321): Couldn't send request to peer e5256d91808b47c195bc9b4dbd7f2b87. Status: Network error: Client connection negotiation failed: client connection to 127.17.223.1:40321: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:07:45.973372 19553 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d1e5873a19244c5ebbcd38e126796ee7"
dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:49904
I20260709 13:07:45.974094 19553 raft_consensus.cc:606] T d1e5873a19244c5ebbcd38e126796ee7 P e61c3a8f61bb48f8a963c9480e53c168 [term 23 LEADER]: Received request to transfer leadership
W20260709 13:07:45.978171 19523 consensus_peers.cc:597] T 76cb037fc9064d13b59a8969d897ce8c P e61c3a8f61bb48f8a963c9480e53c168 -> Peer e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321): Couldn't send request to peer e5256d91808b47c195bc9b4dbd7f2b87. Status: Network error: Client connection negotiation failed: client connection to 127.17.223.1:40321: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:07:45.979799 19551 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d1e5873a19244c5ebbcd38e126796ee7"
dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:49904
I20260709 13:07:45.980396 19551 raft_consensus.cc:606] T d1e5873a19244c5ebbcd38e126796ee7 P e61c3a8f61bb48f8a963c9480e53c168 [term 23 LEADER]: Received request to transfer leadership
I20260709 13:07:45.980791 20109 raft_consensus.cc:1275] T 4af19371ea874c09a0a2147040835cbb P 127766fc592545a4997f7790f50f6076 [term 15 FOLLOWER]: Refusing update from remote peer e61c3a8f61bb48f8a963c9480e53c168: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 13:07:45.992332 27261 consensus_queue.cc:1048] T 4af19371ea874c09a0a2147040835cbb P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Connected to new peer: Peer: permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
W20260709 13:07:45.992339 19523 consensus_peers.cc:597] T 0cdf56e38bbc453d9438d359e5a69955 P e61c3a8f61bb48f8a963c9480e53c168 -> Peer e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321): Couldn't send request to peer e5256d91808b47c195bc9b4dbd7f2b87. Status: Network error: Client connection negotiation failed: client connection to 127.17.223.1:40321: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:07:46.002236 19483 raft_consensus.cc:1275] T 0cdf56e38bbc453d9438d359e5a69955 P 0473d2b2d01f4459b1e90fd12cc7840e [term 23 FOLLOWER]: Refusing update from remote peer e61c3a8f61bb48f8a963c9480e53c168: Log matching property violated. Preceding OpId in replica: term: 22 index: 15. Preceding OpId from leader: term: 23 index: 16. (index mismatch)
I20260709 13:07:46.006295 27021 consensus_queue.cc:1048] T 0cdf56e38bbc453d9438d359e5a69955 P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.000s
W20260709 13:07:46.017256 20075 consensus_peers.cc:597] T 9962423cb4e54fcfa5de01daf68a86e7 P 127766fc592545a4997f7790f50f6076 -> Peer e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321): Couldn't send request to peer e5256d91808b47c195bc9b4dbd7f2b87. Status: Network error: Client connection negotiation failed: client connection to 127.17.223.1:40321: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:07:46.044778 20075 consensus_peers.cc:597] T 2a16f7501e2444fb86d4e2778e734e02 P 127766fc592545a4997f7790f50f6076 -> Peer e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321): Couldn't send request to peer e5256d91808b47c195bc9b4dbd7f2b87. Status: Network error: Client connection negotiation failed: client connection to 127.17.223.1:40321: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:07:46.055008 19294 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.LeaderStepDown -> {remote=127.17.223.3:36891, user_credentials={real_user=slave}} blocked reactor thread for 72588.9us
I20260709 13:07:46.079447 19553 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d1e5873a19244c5ebbcd38e126796ee7"
dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:49904
I20260709 13:07:46.080003 19553 raft_consensus.cc:606] T d1e5873a19244c5ebbcd38e126796ee7 P e61c3a8f61bb48f8a963c9480e53c168 [term 23 LEADER]: Received request to transfer leadership
W20260709 13:07:46.086462 20075 consensus_peers.cc:597] T 833a2f0775ed407a94b8924ce50adb63 P 127766fc592545a4997f7790f50f6076 -> Peer e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321): Couldn't send request to peer e5256d91808b47c195bc9b4dbd7f2b87. Status: Network error: Client connection negotiation failed: client connection to 127.17.223.1:40321: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:07:46.087021 19357 auto_rebalancer.cc:893] Removing replace marker failed: Service unavailable: leader transfer in progress
W20260709 13:07:46.087451 19357 auto_rebalancer.cc:901] Could not move replica: Remote error: Service unavailable: leadership transfer for d1e5873a19244c5ebbcd38e126796ee7 already in progress
W20260709 13:07:46.087759 19357 auto_rebalancer.cc:330] scheduled replica move failed to complete: Remote error: Service unavailable: leadership transfer for d1e5873a19244c5ebbcd38e126796ee7 already in progress
I20260709 13:07:46.096534 20109 raft_consensus.cc:1275] T d1e5873a19244c5ebbcd38e126796ee7 P 127766fc592545a4997f7790f50f6076 [term 23 FOLLOWER]: Refusing update from remote peer e61c3a8f61bb48f8a963c9480e53c168: Log matching property violated. Preceding OpId in replica: term: 22 index: 13. Preceding OpId from leader: term: 23 index: 14. (index mismatch)
W20260709 13:07:46.099799 19523 consensus_peers.cc:597] T d1e5873a19244c5ebbcd38e126796ee7 P e61c3a8f61bb48f8a963c9480e53c168 -> Peer e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321): Couldn't send request to peer e5256d91808b47c195bc9b4dbd7f2b87. Status: Network error: Client connection negotiation failed: client connection to 127.17.223.1:40321: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:07:46.107419 27303 consensus_queue.cc:1048] T d1e5873a19244c5ebbcd38e126796ee7 P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Connected to new peer: Peer: permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:07:46.124531 19483 raft_consensus.cc:1275] T d1e5873a19244c5ebbcd38e126796ee7 P 0473d2b2d01f4459b1e90fd12cc7840e [term 23 FOLLOWER]: Refusing update from remote peer e61c3a8f61bb48f8a963c9480e53c168: Log matching property violated. Preceding OpId in replica: term: 22 index: 13. Preceding OpId from leader: term: 23 index: 14. (index mismatch)
I20260709 13:07:46.130378 27303 consensus_queue.cc:1048] T d1e5873a19244c5ebbcd38e126796ee7 P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
W20260709 13:07:46.140973 19523 consensus_peers.cc:597] T df751f992649444090e27965eb1af85d P e61c3a8f61bb48f8a963c9480e53c168 -> Peer e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321): Couldn't send request to peer e5256d91808b47c195bc9b4dbd7f2b87. Status: Network error: Client connection negotiation failed: client connection to 127.17.223.1:40321: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:07:46.243681 27265 raft_consensus.cc:993] T d1e5873a19244c5ebbcd38e126796ee7 P e61c3a8f61bb48f8a963c9480e53c168: : Instructing follower 0473d2b2d01f4459b1e90fd12cc7840e to start an election
I20260709 13:07:46.244199 27265 raft_consensus.cc:1081] T d1e5873a19244c5ebbcd38e126796ee7 P e61c3a8f61bb48f8a963c9480e53c168 [term 23 LEADER]: Signalling peer 0473d2b2d01f4459b1e90fd12cc7840e to start an election
W20260709 13:07:46.278523 19449 consensus_peers.cc:597] T 309c3ca0ca4b4f3ba129752ea2cb293b P 0473d2b2d01f4459b1e90fd12cc7840e -> Peer e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321): Couldn't send request to peer e5256d91808b47c195bc9b4dbd7f2b87. Status: Network error: Client connection negotiation failed: client connection to 127.17.223.1:40321: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:07:46.261219 19483 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d1e5873a19244c5ebbcd38e126796ee7"
dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
 from {username='slave'} at 127.0.0.1:58286
I20260709 13:07:46.285593 19483 raft_consensus.cc:493] T d1e5873a19244c5ebbcd38e126796ee7 P 0473d2b2d01f4459b1e90fd12cc7840e [term 23 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:07:46.285975 19483 raft_consensus.cc:3060] T d1e5873a19244c5ebbcd38e126796ee7 P 0473d2b2d01f4459b1e90fd12cc7840e [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:07:46.322531 19483 raft_consensus.cc:515] T d1e5873a19244c5ebbcd38e126796ee7 P 0473d2b2d01f4459b1e90fd12cc7840e [term 24 FOLLOWER]: Starting forced leader election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } attrs { replace: true } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:07:46.340912 19553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e5873a19244c5ebbcd38e126796ee7" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 24 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: true dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:07:46.341511 19553 raft_consensus.cc:3055] T d1e5873a19244c5ebbcd38e126796ee7 P e61c3a8f61bb48f8a963c9480e53c168 [term 23 LEADER]: Stepping down as leader of term 23
I20260709 13:07:46.341789 19553 raft_consensus.cc:740] T d1e5873a19244c5ebbcd38e126796ee7 P e61c3a8f61bb48f8a963c9480e53c168 [term 23 LEADER]: Becoming Follower/Learner. State: Replica: e61c3a8f61bb48f8a963c9480e53c168, State: Running, Role: LEADER
I20260709 13:07:46.342506 19553 consensus_queue.cc:260] T d1e5873a19244c5ebbcd38e126796ee7 P e61c3a8f61bb48f8a963c9480e53c168 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 23.14, Last appended by leader: 14, Current term: 23, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } attrs { replace: true } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:07:46.349848 19483 leader_election.cc:290] T d1e5873a19244c5ebbcd38e126796ee7 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 24 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:07:46.350172 19553 raft_consensus.cc:3060] T d1e5873a19244c5ebbcd38e126796ee7 P e61c3a8f61bb48f8a963c9480e53c168 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:07:46.373811 20107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e5873a19244c5ebbcd38e126796ee7" candidate_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" candidate_term: 24 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: true dest_uuid: "127766fc592545a4997f7790f50f6076"
I20260709 13:07:46.374506 20107 raft_consensus.cc:3060] T d1e5873a19244c5ebbcd38e126796ee7 P 127766fc592545a4997f7790f50f6076 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:07:46.382074 19553 raft_consensus.cc:2468] T d1e5873a19244c5ebbcd38e126796ee7 P e61c3a8f61bb48f8a963c9480e53c168 [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 24.
W20260709 13:07:46.401597 20075 consensus_peers.cc:597] T 70797e5783b5454ab0d0eea663e791e3 P 127766fc592545a4997f7790f50f6076 -> Peer e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321): Couldn't send request to peer e5256d91808b47c195bc9b4dbd7f2b87. Status: Network error: Client connection negotiation failed: client connection to 127.17.223.1:40321: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:07:46.405769 20107 raft_consensus.cc:2468] T d1e5873a19244c5ebbcd38e126796ee7 P 127766fc592545a4997f7790f50f6076 [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0473d2b2d01f4459b1e90fd12cc7840e in term 24.
W20260709 13:07:46.406752 19449 leader_election.cc:336] T d1e5873a19244c5ebbcd38e126796ee7 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 24 election: RPC error from VoteRequest() call to peer e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321): Network error: Client connection negotiation failed: client connection to 127.17.223.1:40321: connect: Connection refused (error 111)
I20260709 13:07:46.415510 20107 raft_consensus.cc:1275] T 309c3ca0ca4b4f3ba129752ea2cb293b P 127766fc592545a4997f7790f50f6076 [term 16 FOLLOWER]: Refusing update from remote peer 0473d2b2d01f4459b1e90fd12cc7840e: Log matching property violated. Preceding OpId in replica: term: 15 index: 14. Preceding OpId from leader: term: 16 index: 15. (index mismatch)
W20260709 13:07:46.417724 19449 consensus_peers.cc:597] T b08304a0a02b42d7840c4e8ee9a6bd1a P 0473d2b2d01f4459b1e90fd12cc7840e -> Peer e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321): Couldn't send request to peer e5256d91808b47c195bc9b4dbd7f2b87. Status: Network error: Client connection negotiation failed: client connection to 127.17.223.1:40321: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:07:46.429935 19449 consensus_peers.cc:597] T 86a6797bdfe94fa496c050ceae4bd0d9 P 0473d2b2d01f4459b1e90fd12cc7840e -> Peer e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321): Couldn't send request to peer e5256d91808b47c195bc9b4dbd7f2b87. Status: Network error: Client connection negotiation failed: client connection to 127.17.223.1:40321: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:07:46.436995 19449 leader_election.cc:304] T d1e5873a19244c5ebbcd38e126796ee7 P 0473d2b2d01f4459b1e90fd12cc7840e [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, 127766fc592545a4997f7790f50f6076, e61c3a8f61bb48f8a963c9480e53c168; no voters: e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:07:46.437866 27269 raft_consensus.cc:2804] T d1e5873a19244c5ebbcd38e126796ee7 P 0473d2b2d01f4459b1e90fd12cc7840e [term 24 FOLLOWER]: Leader election won for term 24
I20260709 13:07:46.438524 27269 raft_consensus.cc:697] T d1e5873a19244c5ebbcd38e126796ee7 P 0473d2b2d01f4459b1e90fd12cc7840e [term 24 LEADER]: Becoming Leader. State: Replica: 0473d2b2d01f4459b1e90fd12cc7840e, State: Running, Role: LEADER
I20260709 13:07:46.439971 27269 consensus_queue.cc:237] T d1e5873a19244c5ebbcd38e126796ee7 P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 23.14, Last appended by leader: 14, Current term: 24, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } attrs { replace: true } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
W20260709 13:07:46.450395 20075 consensus_peers.cc:597] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P 127766fc592545a4997f7790f50f6076 -> Peer e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321): Couldn't send request to peer e5256d91808b47c195bc9b4dbd7f2b87. Status: Network error: Client connection negotiation failed: client connection to 127.17.223.1:40321: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:07:46.453699 27269 consensus_queue.cc:1048] T 309c3ca0ca4b4f3ba129752ea2cb293b P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Connected to new peer: Peer: permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 13:07:46.454769 19301 catalog_manager.cc:5697] T d1e5873a19244c5ebbcd38e126796ee7 P 0473d2b2d01f4459b1e90fd12cc7840e reported cstate change: term changed from 23 to 24, leader changed from e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3) to 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2). New cstate: current_term: 24 leader_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" committed_config { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 13:07:46.461452 20075 consensus_peers.cc:597] T 1f85fc4b527a48848e5faa083b604e36 P 127766fc592545a4997f7790f50f6076 -> Peer e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321): Couldn't send request to peer e5256d91808b47c195bc9b4dbd7f2b87. Status: Network error: Client connection negotiation failed: client connection to 127.17.223.1:40321: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:07:46.517508 18300 thread.cc:527] Waited for 3000ms trying to join with diag-logger (tid 19432)
W20260709 13:07:46.527367 19523 consensus_peers.cc:597] T ece3db938bc649d4a40a51522ed5259c P e61c3a8f61bb48f8a963c9480e53c168 -> Peer e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321): Couldn't send request to peer e5256d91808b47c195bc9b4dbd7f2b87. Status: Network error: Client connection negotiation failed: client connection to 127.17.223.1:40321: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:07:46.545276 19449 consensus_peers.cc:597] T 40e1e16737a842ee936002830f36882e P 0473d2b2d01f4459b1e90fd12cc7840e -> Peer e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321): Couldn't send request to peer e5256d91808b47c195bc9b4dbd7f2b87. Status: Network error: Client connection negotiation failed: client connection to 127.17.223.1:40321: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:07:46.603461 19523 consensus_peers.cc:597] T 1dc5b3532fe54f74876d02beffa2c230 P e61c3a8f61bb48f8a963c9480e53c168 -> Peer e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321): Couldn't send request to peer e5256d91808b47c195bc9b4dbd7f2b87. Status: Network error: Client connection negotiation failed: client connection to 127.17.223.1:40321: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:07:46.720046 19523 consensus_peers.cc:597] T 46c5bfeecc314717bffe987e6844b6d0 P e61c3a8f61bb48f8a963c9480e53c168 -> Peer e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321): Couldn't send request to peer e5256d91808b47c195bc9b4dbd7f2b87. Status: Network error: Client connection negotiation failed: client connection to 127.17.223.1:40321: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:07:46.745128 19449 consensus_peers.cc:597] T ef32ce6fdd0e40d382c79974f30295c6 P 0473d2b2d01f4459b1e90fd12cc7840e -> Peer e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321): Couldn't send request to peer e5256d91808b47c195bc9b4dbd7f2b87. Status: Network error: Client connection negotiation failed: client connection to 127.17.223.1:40321: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:07:46.750330 19449 consensus_peers.cc:597] T 2725d2c4cb054f18b0fc8f735c15f6c2 P 0473d2b2d01f4459b1e90fd12cc7840e -> Peer e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321): Couldn't send request to peer e5256d91808b47c195bc9b4dbd7f2b87. Status: Network error: Client connection negotiation failed: client connection to 127.17.223.1:40321: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:07:46.784644 19523 consensus_peers.cc:597] T b9f0d59553ad444883fcf5b5909f9798 P e61c3a8f61bb48f8a963c9480e53c168 -> Peer e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321): Couldn't send request to peer e5256d91808b47c195bc9b4dbd7f2b87. Status: Network error: Client connection negotiation failed: client connection to 127.17.223.1:40321: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:07:46.812696 19449 consensus_peers.cc:597] T f1b10566f45d4a7d9029858330e02d5b P 0473d2b2d01f4459b1e90fd12cc7840e -> Peer e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321): Couldn't send request to peer e5256d91808b47c195bc9b4dbd7f2b87. Status: Network error: Client connection negotiation failed: client connection to 127.17.223.1:40321: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:07:46.835615 19449 consensus_peers.cc:597] T d1e5873a19244c5ebbcd38e126796ee7 P 0473d2b2d01f4459b1e90fd12cc7840e -> Peer e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321): Couldn't send request to peer e5256d91808b47c195bc9b4dbd7f2b87. Status: Network error: Client connection negotiation failed: client connection to 127.17.223.1:40321: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:07:46.857447 19553 raft_consensus.cc:1275] T d1e5873a19244c5ebbcd38e126796ee7 P e61c3a8f61bb48f8a963c9480e53c168 [term 24 FOLLOWER]: Refusing update from remote peer 0473d2b2d01f4459b1e90fd12cc7840e: Log matching property violated. Preceding OpId in replica: term: 23 index: 14. Preceding OpId from leader: term: 24 index: 15. (index mismatch)
I20260709 13:07:46.867394 27213 consensus_queue.cc:1048] T d1e5873a19244c5ebbcd38e126796ee7 P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
W20260709 13:07:46.963305 20075 consensus_peers.cc:597] T 28af091831594f9d8e96482078cc7625 P 127766fc592545a4997f7790f50f6076 -> Peer e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321): Couldn't send request to peer e5256d91808b47c195bc9b4dbd7f2b87. Status: Network error: Client connection negotiation failed: client connection to 127.17.223.1:40321: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:07:47.022451 27345 raft_consensus.cc:493] T e381f1d6b8184797ad142de49be225a8 P e61c3a8f61bb48f8a963c9480e53c168 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:47.023027 27345 raft_consensus.cc:515] T e381f1d6b8184797ad142de49be225a8 P e61c3a8f61bb48f8a963c9480e53c168 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:07:47.025152 27345 leader_election.cc:290] T e381f1d6b8184797ad142de49be225a8 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:07:47.027233 19483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e381f1d6b8184797ad142de49be225a8" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" is_pre_election: true
I20260709 13:07:47.027877 19483 raft_consensus.cc:2468] T e381f1d6b8184797ad142de49be225a8 P 0473d2b2d01f4459b1e90fd12cc7840e [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 20.
I20260709 13:07:47.029314 19526 leader_election.cc:304] T e381f1d6b8184797ad142de49be225a8 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:07:47.030066 27345 raft_consensus.cc:2804] T e381f1d6b8184797ad142de49be225a8 P e61c3a8f61bb48f8a963c9480e53c168 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:07:47.030438 27345 raft_consensus.cc:493] T e381f1d6b8184797ad142de49be225a8 P e61c3a8f61bb48f8a963c9480e53c168 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:47.030784 27345 raft_consensus.cc:3060] T e381f1d6b8184797ad142de49be225a8 P e61c3a8f61bb48f8a963c9480e53c168 [term 20 FOLLOWER]: Advancing to term 21
W20260709 13:07:47.034994 19523 leader_election.cc:336] T e381f1d6b8184797ad142de49be225a8 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321): Network error: Client connection negotiation failed: client connection to 127.17.223.1:40321: connect: Connection refused (error 111)
I20260709 13:07:47.039858 20107 raft_consensus.cc:1275] T d1e5873a19244c5ebbcd38e126796ee7 P 127766fc592545a4997f7790f50f6076 [term 24 FOLLOWER]: Refusing update from remote peer 0473d2b2d01f4459b1e90fd12cc7840e: Log matching property violated. Preceding OpId in replica: term: 23 index: 14. Preceding OpId from leader: term: 24 index: 15. (index mismatch)
I20260709 13:07:47.042604 27269 consensus_queue.cc:1048] T d1e5873a19244c5ebbcd38e126796ee7 P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Connected to new peer: Peer: permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 13:07:47.045367 27345 raft_consensus.cc:515] T e381f1d6b8184797ad142de49be225a8 P e61c3a8f61bb48f8a963c9480e53c168 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:07:47.057536 19483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e381f1d6b8184797ad142de49be225a8" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "0473d2b2d01f4459b1e90fd12cc7840e"
I20260709 13:07:47.058139 19483 raft_consensus.cc:3060] T e381f1d6b8184797ad142de49be225a8 P 0473d2b2d01f4459b1e90fd12cc7840e [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:07:47.055783 27345 leader_election.cc:290] T e381f1d6b8184797ad142de49be225a8 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 21 election: Requested vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
W20260709 13:07:47.059872 19523 leader_election.cc:336] T e381f1d6b8184797ad142de49be225a8 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 21 election: RPC error from VoteRequest() call to peer e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321): Network error: Client connection negotiation failed: client connection to 127.17.223.1:40321: connect: Connection refused (error 111)
I20260709 13:07:47.066547 19483 raft_consensus.cc:2468] T e381f1d6b8184797ad142de49be225a8 P 0473d2b2d01f4459b1e90fd12cc7840e [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 21.
I20260709 13:07:47.071010 19526 leader_election.cc:304] T e381f1d6b8184797ad142de49be225a8 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168; no voters: e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:07:47.074566 27345 raft_consensus.cc:2804] T e381f1d6b8184797ad142de49be225a8 P e61c3a8f61bb48f8a963c9480e53c168 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:07:47.075508 27345 raft_consensus.cc:697] T e381f1d6b8184797ad142de49be225a8 P e61c3a8f61bb48f8a963c9480e53c168 [term 21 LEADER]: Becoming Leader. State: Replica: e61c3a8f61bb48f8a963c9480e53c168, State: Running, Role: LEADER
I20260709 13:07:47.078715 27345 consensus_queue.cc:237] T e381f1d6b8184797ad142de49be225a8 P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 19.12, Last appended by leader: 12, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
W20260709 13:07:47.118842 19449 consensus_peers.cc:597] T 7f575b143b844aa096b50997dad3516a P 0473d2b2d01f4459b1e90fd12cc7840e -> Peer e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321): Couldn't send request to peer e5256d91808b47c195bc9b4dbd7f2b87. Status: Network error: Client connection negotiation failed: client connection to 127.17.223.1:40321: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:07:47.147732 19449 consensus_peers.cc:597] T fa8650e71aa14778b3d73721fc50d9fc P 0473d2b2d01f4459b1e90fd12cc7840e -> Peer e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321): Couldn't send request to peer e5256d91808b47c195bc9b4dbd7f2b87. Status: Network error: Client connection negotiation failed: client connection to 127.17.223.1:40321: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:07:47.160995 19523 consensus_peers.cc:597] T a08760e15aac4630a629431f56024dc8 P e61c3a8f61bb48f8a963c9480e53c168 -> Peer e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321): Couldn't send request to peer e5256d91808b47c195bc9b4dbd7f2b87. Status: Network error: Client connection negotiation failed: client connection to 127.17.223.1:40321: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:07:47.174320 19301 catalog_manager.cc:5697] T e381f1d6b8184797ad142de49be225a8 P e61c3a8f61bb48f8a963c9480e53c168 reported cstate change: term changed from 19 to 21, leader changed from e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1) to e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3). New cstate: current_term: 21 leader_uuid: "e61c3a8f61bb48f8a963c9480e53c168" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } health_report { overall_health: HEALTHY } } }
W20260709 13:07:47.264519 19523 consensus_peers.cc:597] T fa731b585f684a7fb2d106c50f143b83 P e61c3a8f61bb48f8a963c9480e53c168 -> Peer e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321): Couldn't send request to peer e5256d91808b47c195bc9b4dbd7f2b87. Status: Network error: Client connection negotiation failed: client connection to 127.17.223.1:40321: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:07:47.281617 20075 consensus_peers.cc:597] T ff9b0eddd810459b82d91c60777c10eb P 127766fc592545a4997f7790f50f6076 -> Peer e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321): Couldn't send request to peer e5256d91808b47c195bc9b4dbd7f2b87. Status: Network error: Client connection negotiation failed: client connection to 127.17.223.1:40321: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:07:47.382409 20075 consensus_peers.cc:597] T 5ec1c4ce15e04c7e8c283a62179f2a64 P 127766fc592545a4997f7790f50f6076 -> Peer e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321): Couldn't send request to peer e5256d91808b47c195bc9b4dbd7f2b87. Status: Network error: Client connection negotiation failed: client connection to 127.17.223.1:40321: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:07:47.405412 19449 consensus_peers.cc:597] T 1a61655d99124a29b486ba4a5b37faea P 0473d2b2d01f4459b1e90fd12cc7840e -> Peer e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321): Couldn't send request to peer e5256d91808b47c195bc9b4dbd7f2b87. Status: Network error: Client connection negotiation failed: client connection to 127.17.223.1:40321: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:07:47.443043 19449 consensus_peers.cc:597] T 179fd671030940b4b4a4e24bcc4aba0a P 0473d2b2d01f4459b1e90fd12cc7840e -> Peer e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321): Couldn't send request to peer e5256d91808b47c195bc9b4dbd7f2b87. Status: Network error: Client connection negotiation failed: client connection to 127.17.223.1:40321: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:07:47.446254 19293 catalog_manager.cc:4755] TS e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet bc225c93219c45538b53a1bd3d387e4d: Network error: Client connection negotiation failed: client connection to 127.17.223.1:40321: connect: Connection refused (error 111)
I20260709 13:07:47.446559 19483 consensus_queue.cc:237] T d1e5873a19244c5ebbcd38e126796ee7 P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 24.15, Last appended by leader: 14, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:07:47.456039 20107 raft_consensus.cc:1275] T d1e5873a19244c5ebbcd38e126796ee7 P 127766fc592545a4997f7790f50f6076 [term 24 FOLLOWER]: Refusing update from remote peer 0473d2b2d01f4459b1e90fd12cc7840e: Log matching property violated. Preceding OpId in replica: term: 24 index: 15. Preceding OpId from leader: term: 24 index: 16. (index mismatch)
I20260709 13:07:47.468729 27269 consensus_queue.cc:1048] T d1e5873a19244c5ebbcd38e126796ee7 P 0473d2b2d01f4459b1e90fd12cc7840e [LEADER]: Connected to new peer: Peer: permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.000s
W20260709 13:07:47.471331 19449 consensus_peers.cc:597] T d1e5873a19244c5ebbcd38e126796ee7 P 0473d2b2d01f4459b1e90fd12cc7840e -> Peer e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321): Couldn't send request to peer e5256d91808b47c195bc9b4dbd7f2b87. Status: Network error: Client connection negotiation failed: client connection to 127.17.223.1:40321: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:07:47.491779 27277 raft_consensus.cc:2955] T d1e5873a19244c5ebbcd38e126796ee7 P 0473d2b2d01f4459b1e90fd12cc7840e [term 24 LEADER]: Committing config change with OpId 24.16: config changed from index 13 to 16, VOTER e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3) evicted. New config: { opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } } }
W20260709 13:07:47.494037 19449 consensus_peers.cc:597] T 21e14947d70440f19044d8f75c31e1f9 P 0473d2b2d01f4459b1e90fd12cc7840e -> Peer e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321): Couldn't send request to peer e5256d91808b47c195bc9b4dbd7f2b87. Status: Network error: Client connection negotiation failed: client connection to 127.17.223.1:40321: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:07:47.495813 20107 raft_consensus.cc:2955] T d1e5873a19244c5ebbcd38e126796ee7 P 127766fc592545a4997f7790f50f6076 [term 24 FOLLOWER]: Committing config change with OpId 24.16: config changed from index 13 to 16, VOTER e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3) evicted. New config: { opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } } }
I20260709 13:07:47.510635 19296 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet d1e5873a19244c5ebbcd38e126796ee7 with cas_config_opid_index 13: ChangeConfig:REMOVE_PEER succeeded (attempt 9)
W20260709 13:07:47.517970 18300 thread.cc:527] Waited for 4000ms trying to join with diag-logger (tid 19432)
I20260709 13:07:47.517817 19301 catalog_manager.cc:5697] T d1e5873a19244c5ebbcd38e126796ee7 P 127766fc592545a4997f7790f50f6076 reported cstate change: config changed from index 13 to 16, VOTER e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3) evicted. New cstate: current_term: 24 leader_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" committed_config { opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } } }
W20260709 13:07:47.526139 19523 consensus_peers.cc:597] T e381f1d6b8184797ad142de49be225a8 P e61c3a8f61bb48f8a963c9480e53c168 -> Peer e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321): Couldn't send request to peer e5256d91808b47c195bc9b4dbd7f2b87. Status: Network error: Client connection negotiation failed: client connection to 127.17.223.1:40321: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:07:47.534443 19523 consensus_peers.cc:597] T 2b74109013a140ada21feeef92d6f563 P e61c3a8f61bb48f8a963c9480e53c168 -> Peer e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321): Couldn't send request to peer e5256d91808b47c195bc9b4dbd7f2b87. Status: Network error: Client connection negotiation failed: client connection to 127.17.223.1:40321: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:07:47.539686 19547 tablet_service.cc:1558] Processing DeleteTablet for tablet d1e5873a19244c5ebbcd38e126796ee7 with delete_type TABLET_DATA_TOMBSTONED (TS e61c3a8f61bb48f8a963c9480e53c168 not found in new config with opid_index 16) from {username='slave'} at 127.0.0.1:49904
W20260709 13:07:47.598280 19449 consensus_peers.cc:597] T ff75a1d4cb1f493db8f71ddc136ba9ab P 0473d2b2d01f4459b1e90fd12cc7840e -> Peer e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321): Couldn't send request to peer e5256d91808b47c195bc9b4dbd7f2b87. Status: Network error: Client connection negotiation failed: client connection to 127.17.223.1:40321: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:07:47.611522 27355 tablet_replica.cc:333] T d1e5873a19244c5ebbcd38e126796ee7 P e61c3a8f61bb48f8a963c9480e53c168: stopping tablet replica
I20260709 13:07:47.616730 27355 raft_consensus.cc:2243] T d1e5873a19244c5ebbcd38e126796ee7 P e61c3a8f61bb48f8a963c9480e53c168 [term 24 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:47.617441 27355 raft_consensus.cc:2272] T d1e5873a19244c5ebbcd38e126796ee7 P e61c3a8f61bb48f8a963c9480e53c168 [term 24 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:47.641232 27355 ts_tablet_manager.cc:1916] T d1e5873a19244c5ebbcd38e126796ee7 P e61c3a8f61bb48f8a963c9480e53c168: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:07:47.653755 19483 raft_consensus.cc:1275] T e381f1d6b8184797ad142de49be225a8 P 0473d2b2d01f4459b1e90fd12cc7840e [term 21 FOLLOWER]: Refusing update from remote peer e61c3a8f61bb48f8a963c9480e53c168: Log matching property violated. Preceding OpId in replica: term: 19 index: 12. Preceding OpId from leader: term: 21 index: 13. (index mismatch)
I20260709 13:07:47.673050 27345 consensus_queue.cc:1048] T e381f1d6b8184797ad142de49be225a8 P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:07:47.678099 27355 ts_tablet_manager.cc:1929] T d1e5873a19244c5ebbcd38e126796ee7 P e61c3a8f61bb48f8a963c9480e53c168: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 24.15
I20260709 13:07:47.678817 27355 log.cc:1199] T d1e5873a19244c5ebbcd38e126796ee7 P e61c3a8f61bb48f8a963c9480e53c168: Deleting WAL directory at /tmp/dist-test-taskKd2k48/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602220613947-18300-0/minicluster-data/ts-2-root/wals/d1e5873a19244c5ebbcd38e126796ee7
I20260709 13:07:47.680751 19294 catalog_manager.cc:5028] TS e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891): tablet d1e5873a19244c5ebbcd38e126796ee7 (table test-workload [id=ce1025c73cf04c4baf25820ae7ff0a53]) successfully deleted
W20260709 13:07:47.724016 19449 consensus_peers.cc:597] T f93ee515a9c14139bf566522ed8232f3 P 0473d2b2d01f4459b1e90fd12cc7840e -> Peer e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321): Couldn't send request to peer e5256d91808b47c195bc9b4dbd7f2b87. Status: Network error: Client connection negotiation failed: client connection to 127.17.223.1:40321: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:07:47.818068 19523 consensus_peers.cc:597] T 65d8cb8d6ec64f459d5a47cefab10acf P e61c3a8f61bb48f8a963c9480e53c168 -> Peer e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321): Couldn't send request to peer e5256d91808b47c195bc9b4dbd7f2b87. Status: Network error: Client connection negotiation failed: client connection to 127.17.223.1:40321: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:07:47.890552 19523 consensus_peers.cc:597] T 85c494af21f9457a85da47b9bc70c1fd P e61c3a8f61bb48f8a963c9480e53c168 -> Peer e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321): Couldn't send request to peer e5256d91808b47c195bc9b4dbd7f2b87. Status: Network error: Client connection negotiation failed: client connection to 127.17.223.1:40321: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:07:47.934590 19449 consensus_peers.cc:597] T 172b3dd13109415a955b71ac0e9d2234 P 0473d2b2d01f4459b1e90fd12cc7840e -> Peer e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321): Couldn't send request to peer e5256d91808b47c195bc9b4dbd7f2b87. Status: Network error: Client connection negotiation failed: client connection to 127.17.223.1:40321: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:07:47.989019 19523 consensus_peers.cc:597] T 4509b76741dc428e9201c70c1658da13 P e61c3a8f61bb48f8a963c9480e53c168 -> Peer e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321): Couldn't send request to peer e5256d91808b47c195bc9b4dbd7f2b87. Status: Network error: Client connection negotiation failed: client connection to 127.17.223.1:40321: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:07:48.023348 19449 consensus_peers.cc:597] T 775c229504194560ba9589bc2199b089 P 0473d2b2d01f4459b1e90fd12cc7840e -> Peer e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321): Couldn't send request to peer e5256d91808b47c195bc9b4dbd7f2b87. Status: Network error: Client connection negotiation failed: client connection to 127.17.223.1:40321: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:07:48.062975 19523 consensus_peers.cc:597] T 3e1f505cb0f1427bbd698ac889d80821 P e61c3a8f61bb48f8a963c9480e53c168 -> Peer e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321): Couldn't send request to peer e5256d91808b47c195bc9b4dbd7f2b87. Status: Network error: Client connection negotiation failed: client connection to 127.17.223.1:40321: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:07:48.106423 19449 consensus_peers.cc:597] T 2e36a9d6e29c4a7c860cf267efbd4c74 P 0473d2b2d01f4459b1e90fd12cc7840e -> Peer e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321): Couldn't send request to peer e5256d91808b47c195bc9b4dbd7f2b87. Status: Network error: Client connection negotiation failed: client connection to 127.17.223.1:40321: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:07:48.113437 19523 consensus_peers.cc:597] T 0cdf56e38bbc453d9438d359e5a69955 P e61c3a8f61bb48f8a963c9480e53c168 -> Peer e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321): Couldn't send request to peer e5256d91808b47c195bc9b4dbd7f2b87. Status: Network error: Client connection negotiation failed: client connection to 127.17.223.1:40321: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:07:48.130614 20075 consensus_peers.cc:597] T 14efcc79969f41babe5529c22d59156d P 127766fc592545a4997f7790f50f6076 -> Peer e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321): Couldn't send request to peer e5256d91808b47c195bc9b4dbd7f2b87. Status: Network error: Client connection negotiation failed: client connection to 127.17.223.1:40321: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:07:48.133971 19449 consensus_peers.cc:597] T edd7d470b5014c9489be7f41f64355c9 P 0473d2b2d01f4459b1e90fd12cc7840e -> Peer e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321): Couldn't send request to peer e5256d91808b47c195bc9b4dbd7f2b87. Status: Network error: Client connection negotiation failed: client connection to 127.17.223.1:40321: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:07:48.280270 20075 consensus_peers.cc:597] T 2a16f7501e2444fb86d4e2778e734e02 P 127766fc592545a4997f7790f50f6076 -> Peer e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321): Couldn't send request to peer e5256d91808b47c195bc9b4dbd7f2b87. Status: Network error: Client connection negotiation failed: client connection to 127.17.223.1:40321: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:07:48.363574 19523 consensus_peers.cc:597] T 76cb037fc9064d13b59a8969d897ce8c P e61c3a8f61bb48f8a963c9480e53c168 -> Peer e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321): Couldn't send request to peer e5256d91808b47c195bc9b4dbd7f2b87. Status: Network error: Client connection negotiation failed: client connection to 127.17.223.1:40321: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:07:48.431725 19523 consensus_peers.cc:597] T 217b5fae677b4971b3bbd2f357a1f7ff P e61c3a8f61bb48f8a963c9480e53c168 -> Peer e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321): Couldn't send request to peer e5256d91808b47c195bc9b4dbd7f2b87. Status: Network error: Client connection negotiation failed: client connection to 127.17.223.1:40321: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:07:48.437608 19523 consensus_peers.cc:597] T 22196caba61445d3bec98a0aab3c337d P e61c3a8f61bb48f8a963c9480e53c168 -> Peer e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321): Couldn't send request to peer e5256d91808b47c195bc9b4dbd7f2b87. Status: Network error: Client connection negotiation failed: client connection to 127.17.223.1:40321: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:07:48.459668 19523 consensus_peers.cc:597] T df751f992649444090e27965eb1af85d P e61c3a8f61bb48f8a963c9480e53c168 -> Peer e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321): Couldn't send request to peer e5256d91808b47c195bc9b4dbd7f2b87. Status: Network error: Client connection negotiation failed: client connection to 127.17.223.1:40321: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:07:48.511708 20075 consensus_peers.cc:597] T 9962423cb4e54fcfa5de01daf68a86e7 P 127766fc592545a4997f7790f50f6076 -> Peer e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321): Couldn't send request to peer e5256d91808b47c195bc9b4dbd7f2b87. Status: Network error: Client connection negotiation failed: client connection to 127.17.223.1:40321: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:07:48.518739 18300 thread.cc:527] Waited for 5000ms trying to join with diag-logger (tid 19432)
W20260709 13:07:48.601202 19523 consensus_peers.cc:597] T 4af19371ea874c09a0a2147040835cbb P e61c3a8f61bb48f8a963c9480e53c168 -> Peer e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321): Couldn't send request to peer e5256d91808b47c195bc9b4dbd7f2b87. Status: Network error: Client connection negotiation failed: client connection to 127.17.223.1:40321: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:07:48.696157 19449 consensus_peers.cc:597] T 309c3ca0ca4b4f3ba129752ea2cb293b P 0473d2b2d01f4459b1e90fd12cc7840e -> Peer e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321): Couldn't send request to peer e5256d91808b47c195bc9b4dbd7f2b87. Status: Network error: Client connection negotiation failed: client connection to 127.17.223.1:40321: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:07:48.830725 19449 consensus_peers.cc:597] T b08304a0a02b42d7840c4e8ee9a6bd1a P 0473d2b2d01f4459b1e90fd12cc7840e -> Peer e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321): Couldn't send request to peer e5256d91808b47c195bc9b4dbd7f2b87. Status: Network error: Client connection negotiation failed: client connection to 127.17.223.1:40321: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:07:48.856818 20075 consensus_peers.cc:597] T 833a2f0775ed407a94b8924ce50adb63 P 127766fc592545a4997f7790f50f6076 -> Peer e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321): Couldn't send request to peer e5256d91808b47c195bc9b4dbd7f2b87. Status: Network error: Client connection negotiation failed: client connection to 127.17.223.1:40321: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:07:48.899909 19523 consensus_peers.cc:597] T ece3db938bc649d4a40a51522ed5259c P e61c3a8f61bb48f8a963c9480e53c168 -> Peer e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321): Couldn't send request to peer e5256d91808b47c195bc9b4dbd7f2b87. Status: Network error: Client connection negotiation failed: client connection to 127.17.223.1:40321: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:07:48.919684 19449 consensus_peers.cc:597] T 86a6797bdfe94fa496c050ceae4bd0d9 P 0473d2b2d01f4459b1e90fd12cc7840e -> Peer e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321): Couldn't send request to peer e5256d91808b47c195bc9b4dbd7f2b87. Status: Network error: Client connection negotiation failed: client connection to 127.17.223.1:40321: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:07:49.083904 19523 consensus_peers.cc:597] T b9f0d59553ad444883fcf5b5909f9798 P e61c3a8f61bb48f8a963c9480e53c168 -> Peer e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321): Couldn't send request to peer e5256d91808b47c195bc9b4dbd7f2b87. Status: Network error: Client connection negotiation failed: client connection to 127.17.223.1:40321: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:07:49.097352 19523 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.17.223.1:40321: connect: Connection refused (error 111) [suppressed 455 similar messages]
W20260709 13:07:49.102681 20075 consensus_peers.cc:597] T 1f85fc4b527a48848e5faa083b604e36 P 127766fc592545a4997f7790f50f6076 -> Peer e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321): Couldn't send request to peer e5256d91808b47c195bc9b4dbd7f2b87. Status: Network error: Client connection negotiation failed: client connection to 127.17.223.1:40321: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:07:49.175504 19523 consensus_peers.cc:597] T 46c5bfeecc314717bffe987e6844b6d0 P e61c3a8f61bb48f8a963c9480e53c168 -> Peer e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321): Couldn't send request to peer e5256d91808b47c195bc9b4dbd7f2b87. Status: Network error: Client connection negotiation failed: client connection to 127.17.223.1:40321: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:07:49.178609 20075 consensus_peers.cc:597] T 70797e5783b5454ab0d0eea663e791e3 P 127766fc592545a4997f7790f50f6076 -> Peer e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321): Couldn't send request to peer e5256d91808b47c195bc9b4dbd7f2b87. Status: Network error: Client connection negotiation failed: client connection to 127.17.223.1:40321: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:07:49.184592 19449 consensus_peers.cc:597] T 2725d2c4cb054f18b0fc8f735c15f6c2 P 0473d2b2d01f4459b1e90fd12cc7840e -> Peer e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321): Couldn't send request to peer e5256d91808b47c195bc9b4dbd7f2b87. Status: Network error: Client connection negotiation failed: client connection to 127.17.223.1:40321: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:07:49.200603 19449 consensus_peers.cc:597] T ef32ce6fdd0e40d382c79974f30295c6 P 0473d2b2d01f4459b1e90fd12cc7840e -> Peer e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321): Couldn't send request to peer e5256d91808b47c195bc9b4dbd7f2b87. Status: Network error: Client connection negotiation failed: client connection to 127.17.223.1:40321: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:07:49.210342 20075 consensus_peers.cc:597] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P 127766fc592545a4997f7790f50f6076 -> Peer e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321): Couldn't send request to peer e5256d91808b47c195bc9b4dbd7f2b87. Status: Network error: Client connection negotiation failed: client connection to 127.17.223.1:40321: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:07:49.253939 19449 consensus_peers.cc:597] T f1b10566f45d4a7d9029858330e02d5b P 0473d2b2d01f4459b1e90fd12cc7840e -> Peer e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321): Couldn't send request to peer e5256d91808b47c195bc9b4dbd7f2b87. Status: Network error: Client connection negotiation failed: client connection to 127.17.223.1:40321: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:07:49.256289 19449 consensus_peers.cc:597] T 40e1e16737a842ee936002830f36882e P 0473d2b2d01f4459b1e90fd12cc7840e -> Peer e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321): Couldn't send request to peer e5256d91808b47c195bc9b4dbd7f2b87. Status: Network error: Client connection negotiation failed: client connection to 127.17.223.1:40321: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:07:49.262794 19523 consensus_peers.cc:597] T 1dc5b3532fe54f74876d02beffa2c230 P e61c3a8f61bb48f8a963c9480e53c168 -> Peer e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321): Couldn't send request to peer e5256d91808b47c195bc9b4dbd7f2b87. Status: Network error: Client connection negotiation failed: client connection to 127.17.223.1:40321: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:07:49.388942 20075 consensus_peers.cc:597] T 28af091831594f9d8e96482078cc7625 P 127766fc592545a4997f7790f50f6076 -> Peer e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321): Couldn't send request to peer e5256d91808b47c195bc9b4dbd7f2b87. Status: Network error: Client connection negotiation failed: client connection to 127.17.223.1:40321: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:07:49.477510 19449 consensus_peers.cc:597] T fa8650e71aa14778b3d73721fc50d9fc P 0473d2b2d01f4459b1e90fd12cc7840e -> Peer e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321): Couldn't send request to peer e5256d91808b47c195bc9b4dbd7f2b87. Status: Network error: Client connection negotiation failed: client connection to 127.17.223.1:40321: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:07:49.521337 18300 thread.cc:527] Waited for 6000ms trying to join with diag-logger (tid 19432)
W20260709 13:07:49.639497 19449 consensus_peers.cc:597] T 7f575b143b844aa096b50997dad3516a P 0473d2b2d01f4459b1e90fd12cc7840e -> Peer e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321): Couldn't send request to peer e5256d91808b47c195bc9b4dbd7f2b87. Status: Network error: Client connection negotiation failed: client connection to 127.17.223.1:40321: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:07:49.708655 19523 consensus_peers.cc:597] T a08760e15aac4630a629431f56024dc8 P e61c3a8f61bb48f8a963c9480e53c168 -> Peer e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321): Couldn't send request to peer e5256d91808b47c195bc9b4dbd7f2b87. Status: Network error: Client connection negotiation failed: client connection to 127.17.223.1:40321: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:07:49.846285 19449 consensus_peers.cc:597] T 1a61655d99124a29b486ba4a5b37faea P 0473d2b2d01f4459b1e90fd12cc7840e -> Peer e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321): Couldn't send request to peer e5256d91808b47c195bc9b4dbd7f2b87. Status: Network error: Client connection negotiation failed: client connection to 127.17.223.1:40321: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:07:49.936245 19523 consensus_peers.cc:597] T fa731b585f684a7fb2d106c50f143b83 P e61c3a8f61bb48f8a963c9480e53c168 -> Peer e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321): Couldn't send request to peer e5256d91808b47c195bc9b4dbd7f2b87. Status: Network error: Client connection negotiation failed: client connection to 127.17.223.1:40321: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:07:49.962994 19523 consensus_peers.cc:597] T 2b74109013a140ada21feeef92d6f563 P e61c3a8f61bb48f8a963c9480e53c168 -> Peer e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321): Couldn't send request to peer e5256d91808b47c195bc9b4dbd7f2b87. Status: Network error: Client connection negotiation failed: client connection to 127.17.223.1:40321: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:07:50.010214 20078 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.2:46257, user_credentials={real_user=slave}} blocked reactor thread for 56066us
W20260709 13:07:50.030361 19449 consensus_peers.cc:597] T 179fd671030940b4b4a4e24bcc4aba0a P 0473d2b2d01f4459b1e90fd12cc7840e -> Peer e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321): Couldn't send request to peer e5256d91808b47c195bc9b4dbd7f2b87. Status: Network error: Client connection negotiation failed: client connection to 127.17.223.1:40321: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:07:50.040282 19449 consensus_peers.cc:597] T 21e14947d70440f19044d8f75c31e1f9 P 0473d2b2d01f4459b1e90fd12cc7840e -> Peer e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321): Couldn't send request to peer e5256d91808b47c195bc9b4dbd7f2b87. Status: Network error: Client connection negotiation failed: client connection to 127.17.223.1:40321: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:07:50.072400 19523 consensus_peers.cc:597] T 4509b76741dc428e9201c70c1658da13 P e61c3a8f61bb48f8a963c9480e53c168 -> Peer e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321): Couldn't send request to peer e5256d91808b47c195bc9b4dbd7f2b87. Status: Network error: Client connection negotiation failed: client connection to 127.17.223.1:40321: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:07:50.087906 19449 consensus_peers.cc:597] T ff75a1d4cb1f493db8f71ddc136ba9ab P 0473d2b2d01f4459b1e90fd12cc7840e -> Peer e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321): Couldn't send request to peer e5256d91808b47c195bc9b4dbd7f2b87. Status: Network error: Client connection negotiation failed: client connection to 127.17.223.1:40321: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:07:50.165704 19449 consensus_peers.cc:597] T f93ee515a9c14139bf566522ed8232f3 P 0473d2b2d01f4459b1e90fd12cc7840e -> Peer e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321): Couldn't send request to peer e5256d91808b47c195bc9b4dbd7f2b87. Status: Network error: Client connection negotiation failed: client connection to 127.17.223.1:40321: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:07:50.168697 20075 consensus_peers.cc:597] T 5ec1c4ce15e04c7e8c283a62179f2a64 P 127766fc592545a4997f7790f50f6076 -> Peer e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321): Couldn't send request to peer e5256d91808b47c195bc9b4dbd7f2b87. Status: Network error: Client connection negotiation failed: client connection to 127.17.223.1:40321: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:07:50.197449 19449 consensus_peers.cc:597] T d1e5873a19244c5ebbcd38e126796ee7 P 0473d2b2d01f4459b1e90fd12cc7840e -> Peer e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321): Couldn't send request to peer e5256d91808b47c195bc9b4dbd7f2b87. Status: Network error: Client connection negotiation failed: client connection to 127.17.223.1:40321: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:07:50.216514 20075 consensus_peers.cc:597] T ff9b0eddd810459b82d91c60777c10eb P 127766fc592545a4997f7790f50f6076 -> Peer e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321): Couldn't send request to peer e5256d91808b47c195bc9b4dbd7f2b87. Status: Network error: Client connection negotiation failed: client connection to 127.17.223.1:40321: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:07:50.228766 19523 consensus_peers.cc:597] T e381f1d6b8184797ad142de49be225a8 P e61c3a8f61bb48f8a963c9480e53c168 -> Peer e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321): Couldn't send request to peer e5256d91808b47c195bc9b4dbd7f2b87. Status: Network error: Client connection negotiation failed: client connection to 127.17.223.1:40321: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:07:50.265759 19523 consensus_peers.cc:597] T 85c494af21f9457a85da47b9bc70c1fd P e61c3a8f61bb48f8a963c9480e53c168 -> Peer e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321): Couldn't send request to peer e5256d91808b47c195bc9b4dbd7f2b87. Status: Network error: Client connection negotiation failed: client connection to 127.17.223.1:40321: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:07:50.296463 19523 consensus_peers.cc:597] T 0cdf56e38bbc453d9438d359e5a69955 P e61c3a8f61bb48f8a963c9480e53c168 -> Peer e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321): Couldn't send request to peer e5256d91808b47c195bc9b4dbd7f2b87. Status: Network error: Client connection negotiation failed: client connection to 127.17.223.1:40321: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:07:50.370204 19523 consensus_peers.cc:597] T 65d8cb8d6ec64f459d5a47cefab10acf P e61c3a8f61bb48f8a963c9480e53c168 -> Peer e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321): Couldn't send request to peer e5256d91808b47c195bc9b4dbd7f2b87. Status: Network error: Client connection negotiation failed: client connection to 127.17.223.1:40321: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:07:50.443426 19449 consensus_peers.cc:597] T 172b3dd13109415a955b71ac0e9d2234 P 0473d2b2d01f4459b1e90fd12cc7840e -> Peer e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321): Couldn't send request to peer e5256d91808b47c195bc9b4dbd7f2b87. Status: Network error: Client connection negotiation failed: client connection to 127.17.223.1:40321: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:07:50.481366 20075 consensus_peers.cc:597] T 14efcc79969f41babe5529c22d59156d P 127766fc592545a4997f7790f50f6076 -> Peer e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321): Couldn't send request to peer e5256d91808b47c195bc9b4dbd7f2b87. Status: Network error: Client connection negotiation failed: client connection to 127.17.223.1:40321: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:07:50.522171 18300 thread.cc:527] Waited for 7000ms trying to join with diag-logger (tid 19432)
W20260709 13:07:50.533325 19523 consensus_peers.cc:597] T 3e1f505cb0f1427bbd698ac889d80821 P e61c3a8f61bb48f8a963c9480e53c168 -> Peer e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321): Couldn't send request to peer e5256d91808b47c195bc9b4dbd7f2b87. Status: Network error: Client connection negotiation failed: client connection to 127.17.223.1:40321: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:07:50.573441 20075 consensus_peers.cc:597] T 2a16f7501e2444fb86d4e2778e734e02 P 127766fc592545a4997f7790f50f6076 -> Peer e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321): Couldn't send request to peer e5256d91808b47c195bc9b4dbd7f2b87. Status: Network error: Client connection negotiation failed: client connection to 127.17.223.1:40321: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:07:50.606091 19449 consensus_peers.cc:597] T edd7d470b5014c9489be7f41f64355c9 P 0473d2b2d01f4459b1e90fd12cc7840e -> Peer e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321): Couldn't send request to peer e5256d91808b47c195bc9b4dbd7f2b87. Status: Network error: Client connection negotiation failed: client connection to 127.17.223.1:40321: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:07:50.663466 19449 consensus_peers.cc:597] T 2e36a9d6e29c4a7c860cf267efbd4c74 P 0473d2b2d01f4459b1e90fd12cc7840e -> Peer e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321): Couldn't send request to peer e5256d91808b47c195bc9b4dbd7f2b87. Status: Network error: Client connection negotiation failed: client connection to 127.17.223.1:40321: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:07:50.681139 19449 consensus_peers.cc:597] T 775c229504194560ba9589bc2199b089 P 0473d2b2d01f4459b1e90fd12cc7840e -> Peer e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321): Couldn't send request to peer e5256d91808b47c195bc9b4dbd7f2b87. Status: Network error: Client connection negotiation failed: client connection to 127.17.223.1:40321: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:07:50.762777 19523 consensus_peers.cc:597] T 76cb037fc9064d13b59a8969d897ce8c P e61c3a8f61bb48f8a963c9480e53c168 -> Peer e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321): Couldn't send request to peer e5256d91808b47c195bc9b4dbd7f2b87. Status: Network error: Client connection negotiation failed: client connection to 127.17.223.1:40321: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:07:50.969892 20075 consensus_peers.cc:597] T 9962423cb4e54fcfa5de01daf68a86e7 P 127766fc592545a4997f7790f50f6076 -> Peer e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321): Couldn't send request to peer e5256d91808b47c195bc9b4dbd7f2b87. Status: Network error: Client connection negotiation failed: client connection to 127.17.223.1:40321: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:07:50.980427 19523 consensus_peers.cc:597] T 217b5fae677b4971b3bbd2f357a1f7ff P e61c3a8f61bb48f8a963c9480e53c168 -> Peer e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321): Couldn't send request to peer e5256d91808b47c195bc9b4dbd7f2b87. Status: Network error: Client connection negotiation failed: client connection to 127.17.223.1:40321: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:07:51.037508 19523 consensus_peers.cc:597] T 4af19371ea874c09a0a2147040835cbb P e61c3a8f61bb48f8a963c9480e53c168 -> Peer e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321): Couldn't send request to peer e5256d91808b47c195bc9b4dbd7f2b87. Status: Network error: Client connection negotiation failed: client connection to 127.17.223.1:40321: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:07:51.048426 19449 consensus_peers.cc:597] T b08304a0a02b42d7840c4e8ee9a6bd1a P 0473d2b2d01f4459b1e90fd12cc7840e -> Peer e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321): Couldn't send request to peer e5256d91808b47c195bc9b4dbd7f2b87. Status: Network error: Client connection negotiation failed: client connection to 127.17.223.1:40321: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:07:51.078334 19523 consensus_peers.cc:597] T df751f992649444090e27965eb1af85d P e61c3a8f61bb48f8a963c9480e53c168 -> Peer e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321): Couldn't send request to peer e5256d91808b47c195bc9b4dbd7f2b87. Status: Network error: Client connection negotiation failed: client connection to 127.17.223.1:40321: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:07:51.214603 19523 consensus_peers.cc:597] T 22196caba61445d3bec98a0aab3c337d P e61c3a8f61bb48f8a963c9480e53c168 -> Peer e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321): Couldn't send request to peer e5256d91808b47c195bc9b4dbd7f2b87. Status: Network error: Client connection negotiation failed: client connection to 127.17.223.1:40321: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:07:51.488787 19523 consensus_peers.cc:597] T b9f0d59553ad444883fcf5b5909f9798 P e61c3a8f61bb48f8a963c9480e53c168 -> Peer e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321): Couldn't send request to peer e5256d91808b47c195bc9b4dbd7f2b87. Status: Network error: Client connection negotiation failed: client connection to 127.17.223.1:40321: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:07:51.491189 19449 consensus_peers.cc:597] T ef32ce6fdd0e40d382c79974f30295c6 P 0473d2b2d01f4459b1e90fd12cc7840e -> Peer e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321): Couldn't send request to peer e5256d91808b47c195bc9b4dbd7f2b87. Status: Network error: Client connection negotiation failed: client connection to 127.17.223.1:40321: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:07:51.509752 19449 consensus_peers.cc:597] T 86a6797bdfe94fa496c050ceae4bd0d9 P 0473d2b2d01f4459b1e90fd12cc7840e -> Peer e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321): Couldn't send request to peer e5256d91808b47c195bc9b4dbd7f2b87. Status: Network error: Client connection negotiation failed: client connection to 127.17.223.1:40321: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:07:51.522722 18300 thread.cc:527] Waited for 8000ms trying to join with diag-logger (tid 19432)
W20260709 13:07:51.541440 19523 consensus_peers.cc:597] T ece3db938bc649d4a40a51522ed5259c P e61c3a8f61bb48f8a963c9480e53c168 -> Peer e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321): Couldn't send request to peer e5256d91808b47c195bc9b4dbd7f2b87. Status: Network error: Client connection negotiation failed: client connection to 127.17.223.1:40321: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:07:51.532142 19449 consensus_peers.cc:597] T 2725d2c4cb054f18b0fc8f735c15f6c2 P 0473d2b2d01f4459b1e90fd12cc7840e -> Peer e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321): Couldn't send request to peer e5256d91808b47c195bc9b4dbd7f2b87. Status: Network error: Client connection negotiation failed: client connection to 127.17.223.1:40321: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:07:51.567009 20075 consensus_peers.cc:597] T 1f85fc4b527a48848e5faa083b604e36 P 127766fc592545a4997f7790f50f6076 -> Peer e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321): Couldn't send request to peer e5256d91808b47c195bc9b4dbd7f2b87. Status: Network error: Client connection negotiation failed: client connection to 127.17.223.1:40321: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:07:51.620149 19449 consensus_peers.cc:597] T 309c3ca0ca4b4f3ba129752ea2cb293b P 0473d2b2d01f4459b1e90fd12cc7840e -> Peer e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321): Couldn't send request to peer e5256d91808b47c195bc9b4dbd7f2b87. Status: Network error: Client connection negotiation failed: client connection to 127.17.223.1:40321: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:07:51.645596 20075 consensus_peers.cc:597] T 70797e5783b5454ab0d0eea663e791e3 P 127766fc592545a4997f7790f50f6076 -> Peer e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321): Couldn't send request to peer e5256d91808b47c195bc9b4dbd7f2b87. Status: Network error: Client connection negotiation failed: client connection to 127.17.223.1:40321: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:07:51.665393 19293 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.DeleteTablet -> {remote=127.17.223.1:40321, user_credentials={real_user=slave}} blocked reactor thread for 47701.4us
W20260709 13:07:51.670616 19523 consensus_peers.cc:597] T 46c5bfeecc314717bffe987e6844b6d0 P e61c3a8f61bb48f8a963c9480e53c168 -> Peer e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321): Couldn't send request to peer e5256d91808b47c195bc9b4dbd7f2b87. Status: Network error: Client connection negotiation failed: client connection to 127.17.223.1:40321: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:07:51.672300 19449 consensus_peers.cc:597] T 40e1e16737a842ee936002830f36882e P 0473d2b2d01f4459b1e90fd12cc7840e -> Peer e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321): Couldn't send request to peer e5256d91808b47c195bc9b4dbd7f2b87. Status: Network error: Client connection negotiation failed: client connection to 127.17.223.1:40321: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:07:51.683014 19293 catalog_manager.cc:4755] TS e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet bc225c93219c45538b53a1bd3d387e4d: Network error: Client connection negotiation failed: client connection to 127.17.223.1:40321: connect: Connection refused (error 111)
W20260709 13:07:51.687288 19449 consensus_peers.cc:597] T f1b10566f45d4a7d9029858330e02d5b P 0473d2b2d01f4459b1e90fd12cc7840e -> Peer e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321): Couldn't send request to peer e5256d91808b47c195bc9b4dbd7f2b87. Status: Network error: Client connection negotiation failed: client connection to 127.17.223.1:40321: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:07:51.728456 20075 consensus_peers.cc:597] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P 127766fc592545a4997f7790f50f6076 -> Peer e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321): Couldn't send request to peer e5256d91808b47c195bc9b4dbd7f2b87. Status: Network error: Client connection negotiation failed: client connection to 127.17.223.1:40321: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:07:51.761039 20075 consensus_peers.cc:597] T 833a2f0775ed407a94b8924ce50adb63 P 127766fc592545a4997f7790f50f6076 -> Peer e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321): Couldn't send request to peer e5256d91808b47c195bc9b4dbd7f2b87. Status: Network error: Client connection negotiation failed: client connection to 127.17.223.1:40321: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:07:51.978596 19449 consensus_peers.cc:597] T fa8650e71aa14778b3d73721fc50d9fc P 0473d2b2d01f4459b1e90fd12cc7840e -> Peer e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321): Couldn't send request to peer e5256d91808b47c195bc9b4dbd7f2b87. Status: Network error: Client connection negotiation failed: client connection to 127.17.223.1:40321: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:07:52.042178 20075 consensus_peers.cc:597] T 28af091831594f9d8e96482078cc7625 P 127766fc592545a4997f7790f50f6076 -> Peer e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321): Couldn't send request to peer e5256d91808b47c195bc9b4dbd7f2b87. Status: Network error: Client connection negotiation failed: client connection to 127.17.223.1:40321: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:07:52.098380 19523 consensus_peers.cc:597] T 1dc5b3532fe54f74876d02beffa2c230 P e61c3a8f61bb48f8a963c9480e53c168 -> Peer e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321): Couldn't send request to peer e5256d91808b47c195bc9b4dbd7f2b87. Status: Network error: Client connection negotiation failed: client connection to 127.17.223.1:40321: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:07:52.284060 19449 consensus_peers.cc:597] T 179fd671030940b4b4a4e24bcc4aba0a P 0473d2b2d01f4459b1e90fd12cc7840e -> Peer e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321): Couldn't send request to peer e5256d91808b47c195bc9b4dbd7f2b87. Status: Network error: Client connection negotiation failed: client connection to 127.17.223.1:40321: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:07:52.327164 19523 consensus_peers.cc:597] T fa731b585f684a7fb2d106c50f143b83 P e61c3a8f61bb48f8a963c9480e53c168 -> Peer e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321): Couldn't send request to peer e5256d91808b47c195bc9b4dbd7f2b87. Status: Network error: Client connection negotiation failed: client connection to 127.17.223.1:40321: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:07:52.330277 19449 consensus_peers.cc:597] T 1a61655d99124a29b486ba4a5b37faea P 0473d2b2d01f4459b1e90fd12cc7840e -> Peer e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321): Couldn't send request to peer e5256d91808b47c195bc9b4dbd7f2b87. Status: Network error: Client connection negotiation failed: client connection to 127.17.223.1:40321: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:07:52.372219 19449 consensus_peers.cc:597] T 7f575b143b844aa096b50997dad3516a P 0473d2b2d01f4459b1e90fd12cc7840e -> Peer e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321): Couldn't send request to peer e5256d91808b47c195bc9b4dbd7f2b87. Status: Network error: Client connection negotiation failed: client connection to 127.17.223.1:40321: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:07:52.374696 19523 consensus_peers.cc:597] T a08760e15aac4630a629431f56024dc8 P e61c3a8f61bb48f8a963c9480e53c168 -> Peer e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321): Couldn't send request to peer e5256d91808b47c195bc9b4dbd7f2b87. Status: Network error: Client connection negotiation failed: client connection to 127.17.223.1:40321: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:07:52.445848 19523 consensus_peers.cc:597] T 2b74109013a140ada21feeef92d6f563 P e61c3a8f61bb48f8a963c9480e53c168 -> Peer e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321): Couldn't send request to peer e5256d91808b47c195bc9b4dbd7f2b87. Status: Network error: Client connection negotiation failed: client connection to 127.17.223.1:40321: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:07:52.523202 18300 thread.cc:527] Waited for 9000ms trying to join with diag-logger (tid 19432)
W20260709 13:07:52.552726 19449 consensus_peers.cc:597] T 21e14947d70440f19044d8f75c31e1f9 P 0473d2b2d01f4459b1e90fd12cc7840e -> Peer e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321): Couldn't send request to peer e5256d91808b47c195bc9b4dbd7f2b87. Status: Network error: Client connection negotiation failed: client connection to 127.17.223.1:40321: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:07:52.625576 19523 consensus_peers.cc:597] T 4509b76741dc428e9201c70c1658da13 P e61c3a8f61bb48f8a963c9480e53c168 -> Peer e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321): Couldn't send request to peer e5256d91808b47c195bc9b4dbd7f2b87. Status: Network error: Client connection negotiation failed: client connection to 127.17.223.1:40321: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:07:52.638859 19523 consensus_peers.cc:597] T e381f1d6b8184797ad142de49be225a8 P e61c3a8f61bb48f8a963c9480e53c168 -> Peer e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321): Couldn't send request to peer e5256d91808b47c195bc9b4dbd7f2b87. Status: Network error: Client connection negotiation failed: client connection to 127.17.223.1:40321: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:07:52.696126 20075 consensus_peers.cc:597] T 5ec1c4ce15e04c7e8c283a62179f2a64 P 127766fc592545a4997f7790f50f6076 -> Peer e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321): Couldn't send request to peer e5256d91808b47c195bc9b4dbd7f2b87. Status: Network error: Client connection negotiation failed: client connection to 127.17.223.1:40321: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:07:52.741402 19449 consensus_peers.cc:597] T f93ee515a9c14139bf566522ed8232f3 P 0473d2b2d01f4459b1e90fd12cc7840e -> Peer e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321): Couldn't send request to peer e5256d91808b47c195bc9b4dbd7f2b87. Status: Network error: Client connection negotiation failed: client connection to 127.17.223.1:40321: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:07:52.767112 19523 consensus_peers.cc:597] T 0cdf56e38bbc453d9438d359e5a69955 P e61c3a8f61bb48f8a963c9480e53c168 -> Peer e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321): Couldn't send request to peer e5256d91808b47c195bc9b4dbd7f2b87. Status: Network error: Client connection negotiation failed: client connection to 127.17.223.1:40321: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:07:52.768567 19449 consensus_peers.cc:597] T ff75a1d4cb1f493db8f71ddc136ba9ab P 0473d2b2d01f4459b1e90fd12cc7840e -> Peer e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321): Couldn't send request to peer e5256d91808b47c195bc9b4dbd7f2b87. Status: Network error: Client connection negotiation failed: client connection to 127.17.223.1:40321: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:07:52.857308 19523 consensus_peers.cc:597] T 85c494af21f9457a85da47b9bc70c1fd P e61c3a8f61bb48f8a963c9480e53c168 -> Peer e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321): Couldn't send request to peer e5256d91808b47c195bc9b4dbd7f2b87. Status: Network error: Client connection negotiation failed: client connection to 127.17.223.1:40321: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:07:52.884176 20075 consensus_peers.cc:597] T 14efcc79969f41babe5529c22d59156d P 127766fc592545a4997f7790f50f6076 -> Peer e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321): Couldn't send request to peer e5256d91808b47c195bc9b4dbd7f2b87. Status: Network error: Client connection negotiation failed: client connection to 127.17.223.1:40321: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:07:52.942027 19449 consensus_peers.cc:597] T 172b3dd13109415a955b71ac0e9d2234 P 0473d2b2d01f4459b1e90fd12cc7840e -> Peer e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321): Couldn't send request to peer e5256d91808b47c195bc9b4dbd7f2b87. Status: Network error: Client connection negotiation failed: client connection to 127.17.223.1:40321: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:07:52.948434 19449 consensus_peers.cc:597] T 2e36a9d6e29c4a7c860cf267efbd4c74 P 0473d2b2d01f4459b1e90fd12cc7840e -> Peer e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321): Couldn't send request to peer e5256d91808b47c195bc9b4dbd7f2b87. Status: Network error: Client connection negotiation failed: client connection to 127.17.223.1:40321: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:07:52.955286 20075 consensus_peers.cc:597] T ff9b0eddd810459b82d91c60777c10eb P 127766fc592545a4997f7790f50f6076 -> Peer e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321): Couldn't send request to peer e5256d91808b47c195bc9b4dbd7f2b87. Status: Network error: Client connection negotiation failed: client connection to 127.17.223.1:40321: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:07:52.964136 19449 consensus_peers.cc:597] T edd7d470b5014c9489be7f41f64355c9 P 0473d2b2d01f4459b1e90fd12cc7840e -> Peer e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321): Couldn't send request to peer e5256d91808b47c195bc9b4dbd7f2b87. Status: Network error: Client connection negotiation failed: client connection to 127.17.223.1:40321: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:07:52.974289 19523 consensus_peers.cc:597] T 65d8cb8d6ec64f459d5a47cefab10acf P e61c3a8f61bb48f8a963c9480e53c168 -> Peer e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321): Couldn't send request to peer e5256d91808b47c195bc9b4dbd7f2b87. Status: Network error: Client connection negotiation failed: client connection to 127.17.223.1:40321: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:07:52.991961 19449 consensus_peers.cc:597] T d1e5873a19244c5ebbcd38e126796ee7 P 0473d2b2d01f4459b1e90fd12cc7840e -> Peer e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321): Couldn't send request to peer e5256d91808b47c195bc9b4dbd7f2b87. Status: Network error: Client connection negotiation failed: client connection to 127.17.223.1:40321: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:07:53.098932 19523 consensus_peers.cc:597] T 3e1f505cb0f1427bbd698ac889d80821 P e61c3a8f61bb48f8a963c9480e53c168 -> Peer e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321): Couldn't send request to peer e5256d91808b47c195bc9b4dbd7f2b87. Status: Network error: Client connection negotiation failed: client connection to 127.17.223.1:40321: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:07:53.253912 20075 consensus_peers.cc:597] T 2a16f7501e2444fb86d4e2778e734e02 P 127766fc592545a4997f7790f50f6076 -> Peer e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321): Couldn't send request to peer e5256d91808b47c195bc9b4dbd7f2b87. Status: Network error: Client connection negotiation failed: client connection to 127.17.223.1:40321: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:07:53.310392 19449 consensus_peers.cc:597] T 775c229504194560ba9589bc2199b089 P 0473d2b2d01f4459b1e90fd12cc7840e -> Peer e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321): Couldn't send request to peer e5256d91808b47c195bc9b4dbd7f2b87. Status: Network error: Client connection negotiation failed: client connection to 127.17.223.1:40321: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:07:53.384198 19523 consensus_peers.cc:597] T 76cb037fc9064d13b59a8969d897ce8c P e61c3a8f61bb48f8a963c9480e53c168 -> Peer e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321): Couldn't send request to peer e5256d91808b47c195bc9b4dbd7f2b87. Status: Network error: Client connection negotiation failed: client connection to 127.17.223.1:40321: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:07:53.438076 19523 consensus_peers.cc:597] T 217b5fae677b4971b3bbd2f357a1f7ff P e61c3a8f61bb48f8a963c9480e53c168 -> Peer e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321): Couldn't send request to peer e5256d91808b47c195bc9b4dbd7f2b87. Status: Network error: Client connection negotiation failed: client connection to 127.17.223.1:40321: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:07:53.524087 18300 thread.cc:527] Waited for 10000ms trying to join with diag-logger (tid 19432)
W20260709 13:07:53.525583 19523 consensus_peers.cc:597] T df751f992649444090e27965eb1af85d P e61c3a8f61bb48f8a963c9480e53c168 -> Peer e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321): Couldn't send request to peer e5256d91808b47c195bc9b4dbd7f2b87. Status: Network error: Client connection negotiation failed: client connection to 127.17.223.1:40321: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:07:53.565389 19449 consensus_peers.cc:597] T b08304a0a02b42d7840c4e8ee9a6bd1a P 0473d2b2d01f4459b1e90fd12cc7840e -> Peer e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321): Couldn't send request to peer e5256d91808b47c195bc9b4dbd7f2b87. Status: Network error: Client connection negotiation failed: client connection to 127.17.223.1:40321: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:07:53.730865 19523 consensus_peers.cc:597] T 4af19371ea874c09a0a2147040835cbb P e61c3a8f61bb48f8a963c9480e53c168 -> Peer e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321): Couldn't send request to peer e5256d91808b47c195bc9b4dbd7f2b87. Status: Network error: Client connection negotiation failed: client connection to 127.17.223.1:40321: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:07:53.822865 20075 consensus_peers.cc:597] T 70797e5783b5454ab0d0eea663e791e3 P 127766fc592545a4997f7790f50f6076 -> Peer e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321): Couldn't send request to peer e5256d91808b47c195bc9b4dbd7f2b87. Status: Network error: Client connection negotiation failed: client connection to 127.17.223.1:40321: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:07:53.869400 20075 consensus_peers.cc:597] T 9962423cb4e54fcfa5de01daf68a86e7 P 127766fc592545a4997f7790f50f6076 -> Peer e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321): Couldn't send request to peer e5256d91808b47c195bc9b4dbd7f2b87. Status: Network error: Client connection negotiation failed: client connection to 127.17.223.1:40321: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:07:53.945910 19449 consensus_peers.cc:597] T ef32ce6fdd0e40d382c79974f30295c6 P 0473d2b2d01f4459b1e90fd12cc7840e -> Peer e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321): Couldn't send request to peer e5256d91808b47c195bc9b4dbd7f2b87. Status: Network error: Client connection negotiation failed: client connection to 127.17.223.1:40321: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:07:53.954363 19449 consensus_peers.cc:597] T 309c3ca0ca4b4f3ba129752ea2cb293b P 0473d2b2d01f4459b1e90fd12cc7840e -> Peer e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321): Couldn't send request to peer e5256d91808b47c195bc9b4dbd7f2b87. Status: Network error: Client connection negotiation failed: client connection to 127.17.223.1:40321: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:07:53.982879 19523 consensus_peers.cc:597] T 22196caba61445d3bec98a0aab3c337d P e61c3a8f61bb48f8a963c9480e53c168 -> Peer e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321): Couldn't send request to peer e5256d91808b47c195bc9b4dbd7f2b87. Status: Network error: Client connection negotiation failed: client connection to 127.17.223.1:40321: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:07:53.995198 20075 consensus_peers.cc:597] T 1f85fc4b527a48848e5faa083b604e36 P 127766fc592545a4997f7790f50f6076 -> Peer e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321): Couldn't send request to peer e5256d91808b47c195bc9b4dbd7f2b87. Status: Network error: Client connection negotiation failed: client connection to 127.17.223.1:40321: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:07:54.032052 19449 consensus_peers.cc:597] T 86a6797bdfe94fa496c050ceae4bd0d9 P 0473d2b2d01f4459b1e90fd12cc7840e -> Peer e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321): Couldn't send request to peer e5256d91808b47c195bc9b4dbd7f2b87. Status: Network error: Client connection negotiation failed: client connection to 127.17.223.1:40321: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:07:54.036835 19523 consensus_peers.cc:597] T b9f0d59553ad444883fcf5b5909f9798 P e61c3a8f61bb48f8a963c9480e53c168 -> Peer e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321): Couldn't send request to peer e5256d91808b47c195bc9b4dbd7f2b87. Status: Network error: Client connection negotiation failed: client connection to 127.17.223.1:40321: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:07:54.101730 19449 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.17.223.1:40321: connect: Connection refused (error 111) [suppressed 468 similar messages]
W20260709 13:07:54.108291 19523 consensus_peers.cc:597] T 46c5bfeecc314717bffe987e6844b6d0 P e61c3a8f61bb48f8a963c9480e53c168 -> Peer e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321): Couldn't send request to peer e5256d91808b47c195bc9b4dbd7f2b87. Status: Network error: Client connection negotiation failed: client connection to 127.17.223.1:40321: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:07:54.115355 19449 consensus_peers.cc:597] T 40e1e16737a842ee936002830f36882e P 0473d2b2d01f4459b1e90fd12cc7840e -> Peer e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321): Couldn't send request to peer e5256d91808b47c195bc9b4dbd7f2b87. Status: Network error: Client connection negotiation failed: client connection to 127.17.223.1:40321: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:07:54.142627 20075 consensus_peers.cc:597] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P 127766fc592545a4997f7790f50f6076 -> Peer e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321): Couldn't send request to peer e5256d91808b47c195bc9b4dbd7f2b87. Status: Network error: Client connection negotiation failed: client connection to 127.17.223.1:40321: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:07:54.388970 19449 consensus_peers.cc:597] T fa8650e71aa14778b3d73721fc50d9fc P 0473d2b2d01f4459b1e90fd12cc7840e -> Peer e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321): Couldn't send request to peer e5256d91808b47c195bc9b4dbd7f2b87. Status: Network error: Client connection negotiation failed: client connection to 127.17.223.1:40321: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:07:54.389621 19449 consensus_peers.cc:597] T f1b10566f45d4a7d9029858330e02d5b P 0473d2b2d01f4459b1e90fd12cc7840e -> Peer e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321): Couldn't send request to peer e5256d91808b47c195bc9b4dbd7f2b87. Status: Network error: Client connection negotiation failed: client connection to 127.17.223.1:40321: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:07:54.391171 19449 consensus_peers.cc:597] T 2725d2c4cb054f18b0fc8f735c15f6c2 P 0473d2b2d01f4459b1e90fd12cc7840e -> Peer e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321): Couldn't send request to peer e5256d91808b47c195bc9b4dbd7f2b87. Status: Network error: Client connection negotiation failed: client connection to 127.17.223.1:40321: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:07:54.428113 20075 consensus_peers.cc:597] T 833a2f0775ed407a94b8924ce50adb63 P 127766fc592545a4997f7790f50f6076 -> Peer e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321): Couldn't send request to peer e5256d91808b47c195bc9b4dbd7f2b87. Status: Network error: Client connection negotiation failed: client connection to 127.17.223.1:40321: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:07:54.429919 20075 consensus_peers.cc:597] T 28af091831594f9d8e96482078cc7625 P 127766fc592545a4997f7790f50f6076 -> Peer e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321): Couldn't send request to peer e5256d91808b47c195bc9b4dbd7f2b87. Status: Network error: Client connection negotiation failed: client connection to 127.17.223.1:40321: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:07:54.473450 19523 consensus_peers.cc:597] T ece3db938bc649d4a40a51522ed5259c P e61c3a8f61bb48f8a963c9480e53c168 -> Peer e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321): Couldn't send request to peer e5256d91808b47c195bc9b4dbd7f2b87. Status: Network error: Client connection negotiation failed: client connection to 127.17.223.1:40321: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:07:54.478857 19523 consensus_peers.cc:597] T 1dc5b3532fe54f74876d02beffa2c230 P e61c3a8f61bb48f8a963c9480e53c168 -> Peer e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321): Couldn't send request to peer e5256d91808b47c195bc9b4dbd7f2b87. Status: Network error: Client connection negotiation failed: client connection to 127.17.223.1:40321: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:07:54.480334 19449 consensus_peers.cc:597] T 7f575b143b844aa096b50997dad3516a P 0473d2b2d01f4459b1e90fd12cc7840e -> Peer e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321): Couldn't send request to peer e5256d91808b47c195bc9b4dbd7f2b87. Status: Network error: Client connection negotiation failed: client connection to 127.17.223.1:40321: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:07:54.524572 18300 thread.cc:527] Waited for 11000ms trying to join with diag-logger (tid 19432)
W20260709 13:07:54.715519 19449 consensus_peers.cc:597] T 179fd671030940b4b4a4e24bcc4aba0a P 0473d2b2d01f4459b1e90fd12cc7840e -> Peer e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321): Couldn't send request to peer e5256d91808b47c195bc9b4dbd7f2b87. Status: Network error: Client connection negotiation failed: client connection to 127.17.223.1:40321: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:07:54.809914 19523 consensus_peers.cc:597] T fa731b585f684a7fb2d106c50f143b83 P e61c3a8f61bb48f8a963c9480e53c168 -> Peer e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321): Couldn't send request to peer e5256d91808b47c195bc9b4dbd7f2b87. Status: Network error: Client connection negotiation failed: client connection to 127.17.223.1:40321: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:07:54.962853 19523 consensus_peers.cc:597] T a08760e15aac4630a629431f56024dc8 P e61c3a8f61bb48f8a963c9480e53c168 -> Peer e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321): Couldn't send request to peer e5256d91808b47c195bc9b4dbd7f2b87. Status: Network error: Client connection negotiation failed: client connection to 127.17.223.1:40321: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:07:55.102280 19523 consensus_peers.cc:597] T 2b74109013a140ada21feeef92d6f563 P e61c3a8f61bb48f8a963c9480e53c168 -> Peer e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321): Couldn't send request to peer e5256d91808b47c195bc9b4dbd7f2b87. Status: Network error: Client connection negotiation failed: client connection to 127.17.223.1:40321: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:07:55.105965 19449 consensus_peers.cc:597] T f93ee515a9c14139bf566522ed8232f3 P 0473d2b2d01f4459b1e90fd12cc7840e -> Peer e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321): Couldn't send request to peer e5256d91808b47c195bc9b4dbd7f2b87. Status: Network error: Client connection negotiation failed: client connection to 127.17.223.1:40321: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:07:55.126475 19449 consensus_peers.cc:597] T 21e14947d70440f19044d8f75c31e1f9 P 0473d2b2d01f4459b1e90fd12cc7840e -> Peer e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321): Couldn't send request to peer e5256d91808b47c195bc9b4dbd7f2b87. Status: Network error: Client connection negotiation failed: client connection to 127.17.223.1:40321: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:07:55.132493 19449 consensus_peers.cc:597] T 1a61655d99124a29b486ba4a5b37faea P 0473d2b2d01f4459b1e90fd12cc7840e -> Peer e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321): Couldn't send request to peer e5256d91808b47c195bc9b4dbd7f2b87. Status: Network error: Client connection negotiation failed: client connection to 127.17.223.1:40321: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:07:55.189235 19449 consensus_peers.cc:597] T 172b3dd13109415a955b71ac0e9d2234 P 0473d2b2d01f4459b1e90fd12cc7840e -> Peer e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321): Couldn't send request to peer e5256d91808b47c195bc9b4dbd7f2b87. Status: Network error: Client connection negotiation failed: client connection to 127.17.223.1:40321: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:07:55.196781 19523 consensus_peers.cc:597] T 4509b76741dc428e9201c70c1658da13 P e61c3a8f61bb48f8a963c9480e53c168 -> Peer e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321): Couldn't send request to peer e5256d91808b47c195bc9b4dbd7f2b87. Status: Network error: Client connection negotiation failed: client connection to 127.17.223.1:40321: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:07:55.210126 19507 debug-util.cc:398] Leaking SignalData structure 0x7b0800392980 after lost signal to thread 18303
W20260709 13:07:55.211504 19507 debug-util.cc:398] Leaking SignalData structure 0x7b080039e1c0 after lost signal to thread 19343
W20260709 13:07:55.212908 19507 debug-util.cc:398] Leaking SignalData structure 0x7b0800157b20 after lost signal to thread 19510
W20260709 13:07:55.214087 19507 debug-util.cc:398] Leaking SignalData structure 0x7b08003e7160 after lost signal to thread 19584
W20260709 13:07:55.218487 19507 debug-util.cc:398] Leaking SignalData structure 0x7b080039d840 after lost signal to thread 20136
W20260709 13:07:55.233276 19523 consensus_peers.cc:597] T e381f1d6b8184797ad142de49be225a8 P e61c3a8f61bb48f8a963c9480e53c168 -> Peer e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321): Couldn't send request to peer e5256d91808b47c195bc9b4dbd7f2b87. Status: Network error: Client connection negotiation failed: client connection to 127.17.223.1:40321: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:07:55.272027 20075 consensus_peers.cc:597] T 5ec1c4ce15e04c7e8c283a62179f2a64 P 127766fc592545a4997f7790f50f6076 -> Peer e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321): Couldn't send request to peer e5256d91808b47c195bc9b4dbd7f2b87. Status: Network error: Client connection negotiation failed: client connection to 127.17.223.1:40321: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:07:55.352505 20075 consensus_peers.cc:597] T 14efcc79969f41babe5529c22d59156d P 127766fc592545a4997f7790f50f6076 -> Peer e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321): Couldn't send request to peer e5256d91808b47c195bc9b4dbd7f2b87. Status: Network error: Client connection negotiation failed: client connection to 127.17.223.1:40321: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:07:55.429652 19523 consensus_peers.cc:597] T 0cdf56e38bbc453d9438d359e5a69955 P e61c3a8f61bb48f8a963c9480e53c168 -> Peer e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321): Couldn't send request to peer e5256d91808b47c195bc9b4dbd7f2b87. Status: Network error: Client connection negotiation failed: client connection to 127.17.223.1:40321: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:07:55.450404 19449 consensus_peers.cc:597] T edd7d470b5014c9489be7f41f64355c9 P 0473d2b2d01f4459b1e90fd12cc7840e -> Peer e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321): Couldn't send request to peer e5256d91808b47c195bc9b4dbd7f2b87. Status: Network error: Client connection negotiation failed: client connection to 127.17.223.1:40321: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:07:55.471910 19449 consensus_peers.cc:597] T 2e36a9d6e29c4a7c860cf267efbd4c74 P 0473d2b2d01f4459b1e90fd12cc7840e -> Peer e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321): Couldn't send request to peer e5256d91808b47c195bc9b4dbd7f2b87. Status: Network error: Client connection negotiation failed: client connection to 127.17.223.1:40321: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:07:55.485047 19523 consensus_peers.cc:597] T 65d8cb8d6ec64f459d5a47cefab10acf P e61c3a8f61bb48f8a963c9480e53c168 -> Peer e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321): Couldn't send request to peer e5256d91808b47c195bc9b4dbd7f2b87. Status: Network error: Client connection negotiation failed: client connection to 127.17.223.1:40321: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:07:55.501060 19449 consensus_peers.cc:597] T d1e5873a19244c5ebbcd38e126796ee7 P 0473d2b2d01f4459b1e90fd12cc7840e -> Peer e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321): Couldn't send request to peer e5256d91808b47c195bc9b4dbd7f2b87. Status: Network error: Client connection negotiation failed: client connection to 127.17.223.1:40321: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:07:55.525082 18300 thread.cc:527] Waited for 12000ms trying to join with diag-logger (tid 19432)
W20260709 13:07:55.541617 20075 consensus_peers.cc:597] T ff9b0eddd810459b82d91c60777c10eb P 127766fc592545a4997f7790f50f6076 -> Peer e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321): Couldn't send request to peer e5256d91808b47c195bc9b4dbd7f2b87. Status: Network error: Client connection negotiation failed: client connection to 127.17.223.1:40321: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:07:55.574404 19523 consensus_peers.cc:597] T 85c494af21f9457a85da47b9bc70c1fd P e61c3a8f61bb48f8a963c9480e53c168 -> Peer e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321): Couldn't send request to peer e5256d91808b47c195bc9b4dbd7f2b87. Status: Network error: Client connection negotiation failed: client connection to 127.17.223.1:40321: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:07:55.668819 19449 consensus_peers.cc:597] T 775c229504194560ba9589bc2199b089 P 0473d2b2d01f4459b1e90fd12cc7840e -> Peer e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321): Couldn't send request to peer e5256d91808b47c195bc9b4dbd7f2b87. Status: Network error: Client connection negotiation failed: client connection to 127.17.223.1:40321: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:07:55.701223 19449 consensus_peers.cc:597] T ff75a1d4cb1f493db8f71ddc136ba9ab P 0473d2b2d01f4459b1e90fd12cc7840e -> Peer e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321): Couldn't send request to peer e5256d91808b47c195bc9b4dbd7f2b87. Status: Network error: Client connection negotiation failed: client connection to 127.17.223.1:40321: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:07:55.789537 19523 consensus_peers.cc:597] T 3e1f505cb0f1427bbd698ac889d80821 P e61c3a8f61bb48f8a963c9480e53c168 -> Peer e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321): Couldn't send request to peer e5256d91808b47c195bc9b4dbd7f2b87. Status: Network error: Client connection negotiation failed: client connection to 127.17.223.1:40321: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:07:55.856863 19523 consensus_peers.cc:597] T 76cb037fc9064d13b59a8969d897ce8c P e61c3a8f61bb48f8a963c9480e53c168 -> Peer e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321): Couldn't send request to peer e5256d91808b47c195bc9b4dbd7f2b87. Status: Network error: Client connection negotiation failed: client connection to 127.17.223.1:40321: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:07:55.927441 19523 consensus_peers.cc:597] T 217b5fae677b4971b3bbd2f357a1f7ff P e61c3a8f61bb48f8a963c9480e53c168 -> Peer e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321): Couldn't send request to peer e5256d91808b47c195bc9b4dbd7f2b87. Status: Network error: Client connection negotiation failed: client connection to 127.17.223.1:40321: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:07:56.050443 19523 consensus_peers.cc:597] T df751f992649444090e27965eb1af85d P e61c3a8f61bb48f8a963c9480e53c168 -> Peer e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321): Couldn't send request to peer e5256d91808b47c195bc9b4dbd7f2b87. Status: Network error: Client connection negotiation failed: client connection to 127.17.223.1:40321: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:07:56.213665 19449 consensus_peers.cc:597] T b08304a0a02b42d7840c4e8ee9a6bd1a P 0473d2b2d01f4459b1e90fd12cc7840e -> Peer e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321): Couldn't send request to peer e5256d91808b47c195bc9b4dbd7f2b87. Status: Network error: Client connection negotiation failed: client connection to 127.17.223.1:40321: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:07:56.239387 19523 consensus_peers.cc:597] T 4af19371ea874c09a0a2147040835cbb P e61c3a8f61bb48f8a963c9480e53c168 -> Peer e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321): Couldn't send request to peer e5256d91808b47c195bc9b4dbd7f2b87. Status: Network error: Client connection negotiation failed: client connection to 127.17.223.1:40321: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:07:56.394270 19523 consensus_peers.cc:597] T 22196caba61445d3bec98a0aab3c337d P e61c3a8f61bb48f8a963c9480e53c168 -> Peer e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321): Couldn't send request to peer e5256d91808b47c195bc9b4dbd7f2b87. Status: Network error: Client connection negotiation failed: client connection to 127.17.223.1:40321: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:07:56.475687 19523 consensus_peers.cc:597] T b9f0d59553ad444883fcf5b5909f9798 P e61c3a8f61bb48f8a963c9480e53c168 -> Peer e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321): Couldn't send request to peer e5256d91808b47c195bc9b4dbd7f2b87. Status: Network error: Client connection negotiation failed: client connection to 127.17.223.1:40321: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:07:56.491989 19449 consensus_peers.cc:597] T 2725d2c4cb054f18b0fc8f735c15f6c2 P 0473d2b2d01f4459b1e90fd12cc7840e -> Peer e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321): Couldn't send request to peer e5256d91808b47c195bc9b4dbd7f2b87. Status: Network error: Client connection negotiation failed: client connection to 127.17.223.1:40321: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:07:56.525199 19449 consensus_peers.cc:597] T 309c3ca0ca4b4f3ba129752ea2cb293b P 0473d2b2d01f4459b1e90fd12cc7840e -> Peer e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321): Couldn't send request to peer e5256d91808b47c195bc9b4dbd7f2b87. Status: Network error: Client connection negotiation failed: client connection to 127.17.223.1:40321: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:07:56.525619 18300 thread.cc:527] Waited for 13000ms trying to join with diag-logger (tid 19432)
W20260709 13:07:56.548435 19449 consensus_peers.cc:597] T ef32ce6fdd0e40d382c79974f30295c6 P 0473d2b2d01f4459b1e90fd12cc7840e -> Peer e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321): Couldn't send request to peer e5256d91808b47c195bc9b4dbd7f2b87. Status: Network error: Client connection negotiation failed: client connection to 127.17.223.1:40321: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:07:56.777804 19449 consensus_peers.cc:597] T f1b10566f45d4a7d9029858330e02d5b P 0473d2b2d01f4459b1e90fd12cc7840e -> Peer e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321): Couldn't send request to peer e5256d91808b47c195bc9b4dbd7f2b87. Status: Network error: Client connection negotiation failed: client connection to 127.17.223.1:40321: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:07:56.780289 19449 consensus_peers.cc:597] T 40e1e16737a842ee936002830f36882e P 0473d2b2d01f4459b1e90fd12cc7840e -> Peer e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321): Couldn't send request to peer e5256d91808b47c195bc9b4dbd7f2b87. Status: Network error: Client connection negotiation failed: client connection to 127.17.223.1:40321: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:07:56.814988 19523 consensus_peers.cc:597] T ece3db938bc649d4a40a51522ed5259c P e61c3a8f61bb48f8a963c9480e53c168 -> Peer e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321): Couldn't send request to peer e5256d91808b47c195bc9b4dbd7f2b87. Status: Network error: Client connection negotiation failed: client connection to 127.17.223.1:40321: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:07:56.815605 19523 consensus_peers.cc:597] T 46c5bfeecc314717bffe987e6844b6d0 P e61c3a8f61bb48f8a963c9480e53c168 -> Peer e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321): Couldn't send request to peer e5256d91808b47c195bc9b4dbd7f2b87. Status: Network error: Client connection negotiation failed: client connection to 127.17.223.1:40321: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:07:56.816257 19523 consensus_peers.cc:597] T 1dc5b3532fe54f74876d02beffa2c230 P e61c3a8f61bb48f8a963c9480e53c168 -> Peer e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321): Couldn't send request to peer e5256d91808b47c195bc9b4dbd7f2b87. Status: Network error: Client connection negotiation failed: client connection to 127.17.223.1:40321: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:07:56.871500 19449 consensus_peers.cc:597] T fa8650e71aa14778b3d73721fc50d9fc P 0473d2b2d01f4459b1e90fd12cc7840e -> Peer e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321): Couldn't send request to peer e5256d91808b47c195bc9b4dbd7f2b87. Status: Network error: Client connection negotiation failed: client connection to 127.17.223.1:40321: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:07:56.927619 19449 consensus_peers.cc:597] T 86a6797bdfe94fa496c050ceae4bd0d9 P 0473d2b2d01f4459b1e90fd12cc7840e -> Peer e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321): Couldn't send request to peer e5256d91808b47c195bc9b4dbd7f2b87. Status: Network error: Client connection negotiation failed: client connection to 127.17.223.1:40321: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:07:57.045198 20075 consensus_peers.cc:597] T 2a16f7501e2444fb86d4e2778e734e02 P 127766fc592545a4997f7790f50f6076 -> Peer e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321): Couldn't send request to peer e5256d91808b47c195bc9b4dbd7f2b87. Status: Network error: Client connection negotiation failed: client connection to 127.17.223.1:40321: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:07:57.057041 20075 consensus_peers.cc:597] T 9962423cb4e54fcfa5de01daf68a86e7 P 127766fc592545a4997f7790f50f6076 -> Peer e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321): Couldn't send request to peer e5256d91808b47c195bc9b4dbd7f2b87. Status: Network error: Client connection negotiation failed: client connection to 127.17.223.1:40321: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:07:57.058169 20075 consensus_peers.cc:597] T 1f85fc4b527a48848e5faa083b604e36 P 127766fc592545a4997f7790f50f6076 -> Peer e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321): Couldn't send request to peer e5256d91808b47c195bc9b4dbd7f2b87. Status: Network error: Client connection negotiation failed: client connection to 127.17.223.1:40321: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:07:57.090616 19449 consensus_peers.cc:597] T 7f575b143b844aa096b50997dad3516a P 0473d2b2d01f4459b1e90fd12cc7840e -> Peer e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321): Couldn't send request to peer e5256d91808b47c195bc9b4dbd7f2b87. Status: Network error: Client connection negotiation failed: client connection to 127.17.223.1:40321: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:07:57.239912 19449 consensus_peers.cc:597] T 179fd671030940b4b4a4e24bcc4aba0a P 0473d2b2d01f4459b1e90fd12cc7840e -> Peer e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321): Couldn't send request to peer e5256d91808b47c195bc9b4dbd7f2b87. Status: Network error: Client connection negotiation failed: client connection to 127.17.223.1:40321: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:07:57.348215 20075 consensus_peers.cc:597] T 28af091831594f9d8e96482078cc7625 P 127766fc592545a4997f7790f50f6076 -> Peer e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321): Couldn't send request to peer e5256d91808b47c195bc9b4dbd7f2b87. Status: Network error: Client connection negotiation failed: client connection to 127.17.223.1:40321: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:07:57.387118 20075 consensus_peers.cc:597] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P 127766fc592545a4997f7790f50f6076 -> Peer e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321): Couldn't send request to peer e5256d91808b47c195bc9b4dbd7f2b87. Status: Network error: Client connection negotiation failed: client connection to 127.17.223.1:40321: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:07:57.443850 19523 consensus_peers.cc:597] T a08760e15aac4630a629431f56024dc8 P e61c3a8f61bb48f8a963c9480e53c168 -> Peer e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321): Couldn't send request to peer e5256d91808b47c195bc9b4dbd7f2b87. Status: Network error: Client connection negotiation failed: client connection to 127.17.223.1:40321: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:07:57.497619 19523 consensus_peers.cc:597] T fa731b585f684a7fb2d106c50f143b83 P e61c3a8f61bb48f8a963c9480e53c168 -> Peer e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321): Couldn't send request to peer e5256d91808b47c195bc9b4dbd7f2b87. Status: Network error: Client connection negotiation failed: client connection to 127.17.223.1:40321: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:07:57.518649 20075 consensus_peers.cc:597] T 70797e5783b5454ab0d0eea663e791e3 P 127766fc592545a4997f7790f50f6076 -> Peer e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321): Couldn't send request to peer e5256d91808b47c195bc9b4dbd7f2b87. Status: Network error: Client connection negotiation failed: client connection to 127.17.223.1:40321: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:07:57.526100 18300 thread.cc:527] Waited for 14000ms trying to join with diag-logger (tid 19432)
W20260709 13:07:57.571985 19523 consensus_peers.cc:597] T 4509b76741dc428e9201c70c1658da13 P e61c3a8f61bb48f8a963c9480e53c168 -> Peer e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321): Couldn't send request to peer e5256d91808b47c195bc9b4dbd7f2b87. Status: Network error: Client connection negotiation failed: client connection to 127.17.223.1:40321: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:07:57.644526 19340 debug-util.cc:398] Leaking SignalData structure 0x7b0800281ba0 after lost signal to thread 18303
W20260709 13:07:57.747624 19340 debug-util.cc:398] Leaking SignalData structure 0x7b0800374380 after lost signal to thread 19343
W20260709 13:07:57.748974 19340 debug-util.cc:398] Leaking SignalData structure 0x7b080017a8a0 after lost signal to thread 19510
W20260709 13:07:57.750082 19340 debug-util.cc:398] Leaking SignalData structure 0x7b0800089da0 after lost signal to thread 19584
W20260709 13:07:57.751447 19340 debug-util.cc:398] Leaking SignalData structure 0x7b08003da5a0 after lost signal to thread 20136
W20260709 13:07:57.768630 20075 consensus_peers.cc:597] T 833a2f0775ed407a94b8924ce50adb63 P 127766fc592545a4997f7790f50f6076 -> Peer e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321): Couldn't send request to peer e5256d91808b47c195bc9b4dbd7f2b87. Status: Network error: Client connection negotiation failed: client connection to 127.17.223.1:40321: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:07:57.910051 19449 consensus_peers.cc:597] T 21e14947d70440f19044d8f75c31e1f9 P 0473d2b2d01f4459b1e90fd12cc7840e -> Peer e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321): Couldn't send request to peer e5256d91808b47c195bc9b4dbd7f2b87. Status: Network error: Client connection negotiation failed: client connection to 127.17.223.1:40321: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:07:57.917757 19449 consensus_peers.cc:597] T 1a61655d99124a29b486ba4a5b37faea P 0473d2b2d01f4459b1e90fd12cc7840e -> Peer e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321): Couldn't send request to peer e5256d91808b47c195bc9b4dbd7f2b87. Status: Network error: Client connection negotiation failed: client connection to 127.17.223.1:40321: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:07:57.962543 19449 consensus_peers.cc:597] T 2e36a9d6e29c4a7c860cf267efbd4c74 P 0473d2b2d01f4459b1e90fd12cc7840e -> Peer e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321): Couldn't send request to peer e5256d91808b47c195bc9b4dbd7f2b87. Status: Network error: Client connection negotiation failed: client connection to 127.17.223.1:40321: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:07:57.965322 19449 consensus_peers.cc:597] T edd7d470b5014c9489be7f41f64355c9 P 0473d2b2d01f4459b1e90fd12cc7840e -> Peer e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321): Couldn't send request to peer e5256d91808b47c195bc9b4dbd7f2b87. Status: Network error: Client connection negotiation failed: client connection to 127.17.223.1:40321: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:07:57.965910 19449 consensus_peers.cc:597] T 172b3dd13109415a955b71ac0e9d2234 P 0473d2b2d01f4459b1e90fd12cc7840e -> Peer e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321): Couldn't send request to peer e5256d91808b47c195bc9b4dbd7f2b87. Status: Network error: Client connection negotiation failed: client connection to 127.17.223.1:40321: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:07:57.966400 19449 consensus_peers.cc:597] T f93ee515a9c14139bf566522ed8232f3 P 0473d2b2d01f4459b1e90fd12cc7840e -> Peer e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321): Couldn't send request to peer e5256d91808b47c195bc9b4dbd7f2b87. Status: Network error: Client connection negotiation failed: client connection to 127.17.223.1:40321: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:07:57.966887 19523 consensus_peers.cc:597] T 0cdf56e38bbc453d9438d359e5a69955 P e61c3a8f61bb48f8a963c9480e53c168 -> Peer e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321): Couldn't send request to peer e5256d91808b47c195bc9b4dbd7f2b87. Status: Network error: Client connection negotiation failed: client connection to 127.17.223.1:40321: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:07:57.970009 19523 consensus_peers.cc:597] T 2b74109013a140ada21feeef92d6f563 P e61c3a8f61bb48f8a963c9480e53c168 -> Peer e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321): Couldn't send request to peer e5256d91808b47c195bc9b4dbd7f2b87. Status: Network error: Client connection negotiation failed: client connection to 127.17.223.1:40321: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:07:58.022400 19523 consensus_peers.cc:597] T e381f1d6b8184797ad142de49be225a8 P e61c3a8f61bb48f8a963c9480e53c168 -> Peer e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321): Couldn't send request to peer e5256d91808b47c195bc9b4dbd7f2b87. Status: Network error: Client connection negotiation failed: client connection to 127.17.223.1:40321: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:07:58.037623 19449 consensus_peers.cc:597] T d1e5873a19244c5ebbcd38e126796ee7 P 0473d2b2d01f4459b1e90fd12cc7840e -> Peer e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321): Couldn't send request to peer e5256d91808b47c195bc9b4dbd7f2b87. Status: Network error: Client connection negotiation failed: client connection to 127.17.223.1:40321: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:07:58.039145 20075 consensus_peers.cc:597] T ff9b0eddd810459b82d91c60777c10eb P 127766fc592545a4997f7790f50f6076 -> Peer e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321): Couldn't send request to peer e5256d91808b47c195bc9b4dbd7f2b87. Status: Network error: Client connection negotiation failed: client connection to 127.17.223.1:40321: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:07:58.058157 19523 consensus_peers.cc:597] T 65d8cb8d6ec64f459d5a47cefab10acf P e61c3a8f61bb48f8a963c9480e53c168 -> Peer e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321): Couldn't send request to peer e5256d91808b47c195bc9b4dbd7f2b87. Status: Network error: Client connection negotiation failed: client connection to 127.17.223.1:40321: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:07:58.183679 19523 consensus_peers.cc:597] T 85c494af21f9457a85da47b9bc70c1fd P e61c3a8f61bb48f8a963c9480e53c168 -> Peer e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321): Couldn't send request to peer e5256d91808b47c195bc9b4dbd7f2b87. Status: Network error: Client connection negotiation failed: client connection to 127.17.223.1:40321: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:07:58.225070 20075 consensus_peers.cc:597] T 14efcc79969f41babe5529c22d59156d P 127766fc592545a4997f7790f50f6076 -> Peer e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321): Couldn't send request to peer e5256d91808b47c195bc9b4dbd7f2b87. Status: Network error: Client connection negotiation failed: client connection to 127.17.223.1:40321: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:07:58.478888 19523 consensus_peers.cc:597] T 3e1f505cb0f1427bbd698ac889d80821 P e61c3a8f61bb48f8a963c9480e53c168 -> Peer e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321): Couldn't send request to peer e5256d91808b47c195bc9b4dbd7f2b87. Status: Network error: Client connection negotiation failed: client connection to 127.17.223.1:40321: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:07:58.479502 19523 consensus_peers.cc:597] T 76cb037fc9064d13b59a8969d897ce8c P e61c3a8f61bb48f8a963c9480e53c168 -> Peer e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321): Couldn't send request to peer e5256d91808b47c195bc9b4dbd7f2b87. Status: Network error: Client connection negotiation failed: client connection to 127.17.223.1:40321: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:07:58.497287 19449 consensus_peers.cc:597] T ff75a1d4cb1f493db8f71ddc136ba9ab P 0473d2b2d01f4459b1e90fd12cc7840e -> Peer e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321): Couldn't send request to peer e5256d91808b47c195bc9b4dbd7f2b87. Status: Network error: Client connection negotiation failed: client connection to 127.17.223.1:40321: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:07:58.506373 19449 consensus_peers.cc:597] T 775c229504194560ba9589bc2199b089 P 0473d2b2d01f4459b1e90fd12cc7840e -> Peer e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321): Couldn't send request to peer e5256d91808b47c195bc9b4dbd7f2b87. Status: Network error: Client connection negotiation failed: client connection to 127.17.223.1:40321: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:07:58.508267 19523 consensus_peers.cc:597] T df751f992649444090e27965eb1af85d P e61c3a8f61bb48f8a963c9480e53c168 -> Peer e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321): Couldn't send request to peer e5256d91808b47c195bc9b4dbd7f2b87. Status: Network error: Client connection negotiation failed: client connection to 127.17.223.1:40321: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:07:58.526558 18300 thread.cc:527] Waited for 15000ms trying to join with diag-logger (tid 19432)
W20260709 13:07:58.559476 19523 consensus_peers.cc:597] T 217b5fae677b4971b3bbd2f357a1f7ff P e61c3a8f61bb48f8a963c9480e53c168 -> Peer e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321): Couldn't send request to peer e5256d91808b47c195bc9b4dbd7f2b87. Status: Network error: Client connection negotiation failed: client connection to 127.17.223.1:40321: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:07:58.591203 20075 consensus_peers.cc:597] T 5ec1c4ce15e04c7e8c283a62179f2a64 P 127766fc592545a4997f7790f50f6076 -> Peer e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321): Couldn't send request to peer e5256d91808b47c195bc9b4dbd7f2b87. Status: Network error: Client connection negotiation failed: client connection to 127.17.223.1:40321: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:07:58.754345 19523 consensus_peers.cc:597] T 4af19371ea874c09a0a2147040835cbb P e61c3a8f61bb48f8a963c9480e53c168 -> Peer e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321): Couldn't send request to peer e5256d91808b47c195bc9b4dbd7f2b87. Status: Network error: Client connection negotiation failed: client connection to 127.17.223.1:40321: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:07:58.983920 19523 consensus_peers.cc:597] T 22196caba61445d3bec98a0aab3c337d P e61c3a8f61bb48f8a963c9480e53c168 -> Peer e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321): Couldn't send request to peer e5256d91808b47c195bc9b4dbd7f2b87. Status: Network error: Client connection negotiation failed: client connection to 127.17.223.1:40321: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:07:59.122627 19449 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.17.223.1:40321: connect: Connection refused (error 111) [suppressed 443 similar messages]
W20260709 13:07:59.171046 19449 consensus_peers.cc:597] T b08304a0a02b42d7840c4e8ee9a6bd1a P 0473d2b2d01f4459b1e90fd12cc7840e -> Peer e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321): Couldn't send request to peer e5256d91808b47c195bc9b4dbd7f2b87. Status: Network error: Client connection negotiation failed: client connection to 127.17.223.1:40321: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:07:59.177666 19449 consensus_peers.cc:597] T 2725d2c4cb054f18b0fc8f735c15f6c2 P 0473d2b2d01f4459b1e90fd12cc7840e -> Peer e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321): Couldn't send request to peer e5256d91808b47c195bc9b4dbd7f2b87. Status: Network error: Client connection negotiation failed: client connection to 127.17.223.1:40321: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:07:59.258917 19523 consensus_peers.cc:597] T b9f0d59553ad444883fcf5b5909f9798 P e61c3a8f61bb48f8a963c9480e53c168 -> Peer e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321): Couldn't send request to peer e5256d91808b47c195bc9b4dbd7f2b87. Status: Network error: Client connection negotiation failed: client connection to 127.17.223.1:40321: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:07:59.271319 19449 consensus_peers.cc:597] T ef32ce6fdd0e40d382c79974f30295c6 P 0473d2b2d01f4459b1e90fd12cc7840e -> Peer e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321): Couldn't send request to peer e5256d91808b47c195bc9b4dbd7f2b87. Status: Network error: Client connection negotiation failed: client connection to 127.17.223.1:40321: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:07:59.268723 19523 consensus_peers.cc:597] T 1dc5b3532fe54f74876d02beffa2c230 P e61c3a8f61bb48f8a963c9480e53c168 -> Peer e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321): Couldn't send request to peer e5256d91808b47c195bc9b4dbd7f2b87. Status: Network error: Client connection negotiation failed: client connection to 127.17.223.1:40321: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:07:59.325374 20075 consensus_peers.cc:597] T 1f85fc4b527a48848e5faa083b604e36 P 127766fc592545a4997f7790f50f6076 -> Peer e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321): Couldn't send request to peer e5256d91808b47c195bc9b4dbd7f2b87. Status: Network error: Client connection negotiation failed: client connection to 127.17.223.1:40321: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:07:59.347846 20075 consensus_peers.cc:597] T 9962423cb4e54fcfa5de01daf68a86e7 P 127766fc592545a4997f7790f50f6076 -> Peer e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321): Couldn't send request to peer e5256d91808b47c195bc9b4dbd7f2b87. Status: Network error: Client connection negotiation failed: client connection to 127.17.223.1:40321: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:07:59.357148 20075 consensus_peers.cc:597] T 2a16f7501e2444fb86d4e2778e734e02 P 127766fc592545a4997f7790f50f6076 -> Peer e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321): Couldn't send request to peer e5256d91808b47c195bc9b4dbd7f2b87. Status: Network error: Client connection negotiation failed: client connection to 127.17.223.1:40321: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:07:59.459350 19523 consensus_peers.cc:597] T 46c5bfeecc314717bffe987e6844b6d0 P e61c3a8f61bb48f8a963c9480e53c168 -> Peer e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321): Couldn't send request to peer e5256d91808b47c195bc9b4dbd7f2b87. Status: Network error: Client connection negotiation failed: client connection to 127.17.223.1:40321: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:07:59.527046 18300 thread.cc:527] Waited for 16000ms trying to join with diag-logger (tid 19432)
W20260709 13:07:59.570835 19523 consensus_peers.cc:597] T ece3db938bc649d4a40a51522ed5259c P e61c3a8f61bb48f8a963c9480e53c168 -> Peer e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321): Couldn't send request to peer e5256d91808b47c195bc9b4dbd7f2b87. Status: Network error: Client connection negotiation failed: client connection to 127.17.223.1:40321: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:07:59.699038 20075 consensus_peers.cc:597] T 28af091831594f9d8e96482078cc7625 P 127766fc592545a4997f7790f50f6076 -> Peer e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321): Couldn't send request to peer e5256d91808b47c195bc9b4dbd7f2b87. Status: Network error: Client connection negotiation failed: client connection to 127.17.223.1:40321: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:07:59.723147 20075 consensus_peers.cc:597] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P 127766fc592545a4997f7790f50f6076 -> Peer e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321): Couldn't send request to peer e5256d91808b47c195bc9b4dbd7f2b87. Status: Network error: Client connection negotiation failed: client connection to 127.17.223.1:40321: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:07:59.855938 19523 consensus_peers.cc:597] T fa731b585f684a7fb2d106c50f143b83 P e61c3a8f61bb48f8a963c9480e53c168 -> Peer e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321): Couldn't send request to peer e5256d91808b47c195bc9b4dbd7f2b87. Status: Network error: Client connection negotiation failed: client connection to 127.17.223.1:40321: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:07:59.945123 19523 consensus_peers.cc:597] T a08760e15aac4630a629431f56024dc8 P e61c3a8f61bb48f8a963c9480e53c168 -> Peer e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321): Couldn't send request to peer e5256d91808b47c195bc9b4dbd7f2b87. Status: Network error: Client connection negotiation failed: client connection to 127.17.223.1:40321: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:08:00.006263 19293 catalog_manager.cc:4755] TS e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet bc225c93219c45538b53a1bd3d387e4d: Network error: Client connection negotiation failed: client connection to 127.17.223.1:40321: connect: Connection refused (error 111)
W20260709 13:08:00.112571 20075 consensus_peers.cc:597] T 70797e5783b5454ab0d0eea663e791e3 P 127766fc592545a4997f7790f50f6076 -> Peer e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321): Couldn't send request to peer e5256d91808b47c195bc9b4dbd7f2b87. Status: Network error: Client connection negotiation failed: client connection to 127.17.223.1:40321: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:08:00.180730 19523 consensus_peers.cc:597] T 4509b76741dc428e9201c70c1658da13 P e61c3a8f61bb48f8a963c9480e53c168 -> Peer e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321): Couldn't send request to peer e5256d91808b47c195bc9b4dbd7f2b87. Status: Network error: Client connection negotiation failed: client connection to 127.17.223.1:40321: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:08:00.259366 20075 consensus_peers.cc:597] T 833a2f0775ed407a94b8924ce50adb63 P 127766fc592545a4997f7790f50f6076 -> Peer e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321): Couldn't send request to peer e5256d91808b47c195bc9b4dbd7f2b87. Status: Network error: Client connection negotiation failed: client connection to 127.17.223.1:40321: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:08:00.440029 19523 consensus_peers.cc:597] T 0cdf56e38bbc453d9438d359e5a69955 P e61c3a8f61bb48f8a963c9480e53c168 -> Peer e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321): Couldn't send request to peer e5256d91808b47c195bc9b4dbd7f2b87. Status: Network error: Client connection negotiation failed: client connection to 127.17.223.1:40321: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:08:00.443089 19523 consensus_peers.cc:597] T e381f1d6b8184797ad142de49be225a8 P e61c3a8f61bb48f8a963c9480e53c168 -> Peer e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321): Couldn't send request to peer e5256d91808b47c195bc9b4dbd7f2b87. Status: Network error: Client connection negotiation failed: client connection to 127.17.223.1:40321: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:08:00.445317 19523 consensus_peers.cc:597] T 2b74109013a140ada21feeef92d6f563 P e61c3a8f61bb48f8a963c9480e53c168 -> Peer e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321): Couldn't send request to peer e5256d91808b47c195bc9b4dbd7f2b87. Status: Network error: Client connection negotiation failed: client connection to 127.17.223.1:40321: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:08:00.448249 19449 consensus_peers.cc:597] T 309c3ca0ca4b4f3ba129752ea2cb293b P 0473d2b2d01f4459b1e90fd12cc7840e -> Peer e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321): Couldn't send request to peer e5256d91808b47c195bc9b4dbd7f2b87. Status: Network error: Client connection negotiation failed: client connection to 127.17.223.1:40321: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:08:00.468665 19449 consensus_peers.cc:597] T fa8650e71aa14778b3d73721fc50d9fc P 0473d2b2d01f4459b1e90fd12cc7840e -> Peer e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321): Couldn't send request to peer e5256d91808b47c195bc9b4dbd7f2b87. Status: Network error: Client connection negotiation failed: client connection to 127.17.223.1:40321: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:08:00.470328 19449 consensus_peers.cc:597] T 40e1e16737a842ee936002830f36882e P 0473d2b2d01f4459b1e90fd12cc7840e -> Peer e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321): Couldn't send request to peer e5256d91808b47c195bc9b4dbd7f2b87. Status: Network error: Client connection negotiation failed: client connection to 127.17.223.1:40321: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:08:00.473088 19449 consensus_peers.cc:597] T 86a6797bdfe94fa496c050ceae4bd0d9 P 0473d2b2d01f4459b1e90fd12cc7840e -> Peer e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321): Couldn't send request to peer e5256d91808b47c195bc9b4dbd7f2b87. Status: Network error: Client connection negotiation failed: client connection to 127.17.223.1:40321: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:08:00.474843 19449 consensus_peers.cc:597] T f1b10566f45d4a7d9029858330e02d5b P 0473d2b2d01f4459b1e90fd12cc7840e -> Peer e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321): Couldn't send request to peer e5256d91808b47c195bc9b4dbd7f2b87. Status: Network error: Client connection negotiation failed: client connection to 127.17.223.1:40321: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:08:00.493500 19449 consensus_peers.cc:597] T 7f575b143b844aa096b50997dad3516a P 0473d2b2d01f4459b1e90fd12cc7840e -> Peer e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321): Couldn't send request to peer e5256d91808b47c195bc9b4dbd7f2b87. Status: Network error: Client connection negotiation failed: client connection to 127.17.223.1:40321: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:08:00.527747 18300 thread.cc:527] Waited for 17000ms trying to join with diag-logger (tid 19432)
W20260709 13:08:00.663564 19449 consensus_peers.cc:597] T 172b3dd13109415a955b71ac0e9d2234 P 0473d2b2d01f4459b1e90fd12cc7840e -> Peer e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321): Couldn't send request to peer e5256d91808b47c195bc9b4dbd7f2b87. Status: Network error: Client connection negotiation failed: client connection to 127.17.223.1:40321: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:08:00.692016 20075 consensus_peers.cc:597] T ff9b0eddd810459b82d91c60777c10eb P 127766fc592545a4997f7790f50f6076 -> Peer e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321): Couldn't send request to peer e5256d91808b47c195bc9b4dbd7f2b87. Status: Network error: Client connection negotiation failed: client connection to 127.17.223.1:40321: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:08:00.713043 19449 consensus_peers.cc:597] T 179fd671030940b4b4a4e24bcc4aba0a P 0473d2b2d01f4459b1e90fd12cc7840e -> Peer e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321): Couldn't send request to peer e5256d91808b47c195bc9b4dbd7f2b87. Status: Network error: Client connection negotiation failed: client connection to 127.17.223.1:40321: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:08:00.726617 19449 consensus_peers.cc:597] T 21e14947d70440f19044d8f75c31e1f9 P 0473d2b2d01f4459b1e90fd12cc7840e -> Peer e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321): Couldn't send request to peer e5256d91808b47c195bc9b4dbd7f2b87. Status: Network error: Client connection negotiation failed: client connection to 127.17.223.1:40321: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:08:00.777869 19523 consensus_peers.cc:597] T 85c494af21f9457a85da47b9bc70c1fd P e61c3a8f61bb48f8a963c9480e53c168 -> Peer e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321): Couldn't send request to peer e5256d91808b47c195bc9b4dbd7f2b87. Status: Network error: Client connection negotiation failed: client connection to 127.17.223.1:40321: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:08:00.799322 19523 consensus_peers.cc:597] T 65d8cb8d6ec64f459d5a47cefab10acf P e61c3a8f61bb48f8a963c9480e53c168 -> Peer e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321): Couldn't send request to peer e5256d91808b47c195bc9b4dbd7f2b87. Status: Network error: Client connection negotiation failed: client connection to 127.17.223.1:40321: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:08:00.910801 20075 consensus_peers.cc:597] T 14efcc79969f41babe5529c22d59156d P 127766fc592545a4997f7790f50f6076 -> Peer e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321): Couldn't send request to peer e5256d91808b47c195bc9b4dbd7f2b87. Status: Network error: Client connection negotiation failed: client connection to 127.17.223.1:40321: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:08:00.937016 20075 consensus_peers.cc:597] T 5ec1c4ce15e04c7e8c283a62179f2a64 P 127766fc592545a4997f7790f50f6076 -> Peer e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321): Couldn't send request to peer e5256d91808b47c195bc9b4dbd7f2b87. Status: Network error: Client connection negotiation failed: client connection to 127.17.223.1:40321: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:08:01.189491 19523 consensus_peers.cc:597] T 3e1f505cb0f1427bbd698ac889d80821 P e61c3a8f61bb48f8a963c9480e53c168 -> Peer e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321): Couldn't send request to peer e5256d91808b47c195bc9b4dbd7f2b87. Status: Network error: Client connection negotiation failed: client connection to 127.17.223.1:40321: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:08:01.257339 19523 consensus_peers.cc:597] T 76cb037fc9064d13b59a8969d897ce8c P e61c3a8f61bb48f8a963c9480e53c168 -> Peer e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321): Couldn't send request to peer e5256d91808b47c195bc9b4dbd7f2b87. Status: Network error: Client connection negotiation failed: client connection to 127.17.223.1:40321: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:08:01.274819 19449 consensus_peers.cc:597] T f93ee515a9c14139bf566522ed8232f3 P 0473d2b2d01f4459b1e90fd12cc7840e -> Peer e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321): Couldn't send request to peer e5256d91808b47c195bc9b4dbd7f2b87. Status: Network error: Client connection negotiation failed: client connection to 127.17.223.1:40321: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:08:01.358011 19449 consensus_peers.cc:597] T edd7d470b5014c9489be7f41f64355c9 P 0473d2b2d01f4459b1e90fd12cc7840e -> Peer e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321): Couldn't send request to peer e5256d91808b47c195bc9b4dbd7f2b87. Status: Network error: Client connection negotiation failed: client connection to 127.17.223.1:40321: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:08:01.372581 19523 consensus_peers.cc:597] T df751f992649444090e27965eb1af85d P e61c3a8f61bb48f8a963c9480e53c168 -> Peer e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321): Couldn't send request to peer e5256d91808b47c195bc9b4dbd7f2b87. Status: Network error: Client connection negotiation failed: client connection to 127.17.223.1:40321: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:08:01.428076 19523 consensus_peers.cc:597] T 217b5fae677b4971b3bbd2f357a1f7ff P e61c3a8f61bb48f8a963c9480e53c168 -> Peer e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321): Couldn't send request to peer e5256d91808b47c195bc9b4dbd7f2b87. Status: Network error: Client connection negotiation failed: client connection to 127.17.223.1:40321: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:08:01.528311 18300 thread.cc:527] Waited for 18000ms trying to join with diag-logger (tid 19432)
W20260709 13:08:01.590832 19523 consensus_peers.cc:597] T 4af19371ea874c09a0a2147040835cbb P e61c3a8f61bb48f8a963c9480e53c168 -> Peer e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321): Couldn't send request to peer e5256d91808b47c195bc9b4dbd7f2b87. Status: Network error: Client connection negotiation failed: client connection to 127.17.223.1:40321: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:08:01.604398 19449 consensus_peers.cc:597] T d1e5873a19244c5ebbcd38e126796ee7 P 0473d2b2d01f4459b1e90fd12cc7840e -> Peer e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321): Couldn't send request to peer e5256d91808b47c195bc9b4dbd7f2b87. Status: Network error: Client connection negotiation failed: client connection to 127.17.223.1:40321: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:08:01.657577 19523 consensus_peers.cc:597] T 22196caba61445d3bec98a0aab3c337d P e61c3a8f61bb48f8a963c9480e53c168 -> Peer e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321): Couldn't send request to peer e5256d91808b47c195bc9b4dbd7f2b87. Status: Network error: Client connection negotiation failed: client connection to 127.17.223.1:40321: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:08:01.665230 19449 consensus_peers.cc:597] T 2e36a9d6e29c4a7c860cf267efbd4c74 P 0473d2b2d01f4459b1e90fd12cc7840e -> Peer e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321): Couldn't send request to peer e5256d91808b47c195bc9b4dbd7f2b87. Status: Network error: Client connection negotiation failed: client connection to 127.17.223.1:40321: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:08:01.670269 19449 consensus_peers.cc:597] T 1a61655d99124a29b486ba4a5b37faea P 0473d2b2d01f4459b1e90fd12cc7840e -> Peer e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321): Couldn't send request to peer e5256d91808b47c195bc9b4dbd7f2b87. Status: Network error: Client connection negotiation failed: client connection to 127.17.223.1:40321: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:08:01.686234 19523 consensus_peers.cc:597] T b9f0d59553ad444883fcf5b5909f9798 P e61c3a8f61bb48f8a963c9480e53c168 -> Peer e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321): Couldn't send request to peer e5256d91808b47c195bc9b4dbd7f2b87. Status: Network error: Client connection negotiation failed: client connection to 127.17.223.1:40321: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:08:01.738659 19523 consensus_peers.cc:597] T 1dc5b3532fe54f74876d02beffa2c230 P e61c3a8f61bb48f8a963c9480e53c168 -> Peer e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321): Couldn't send request to peer e5256d91808b47c195bc9b4dbd7f2b87. Status: Network error: Client connection negotiation failed: client connection to 127.17.223.1:40321: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:08:01.800096 20075 consensus_peers.cc:597] T 1f85fc4b527a48848e5faa083b604e36 P 127766fc592545a4997f7790f50f6076 -> Peer e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321): Couldn't send request to peer e5256d91808b47c195bc9b4dbd7f2b87. Status: Network error: Client connection negotiation failed: client connection to 127.17.223.1:40321: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:08:01.889712 19449 consensus_peers.cc:597] T 775c229504194560ba9589bc2199b089 P 0473d2b2d01f4459b1e90fd12cc7840e -> Peer e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321): Couldn't send request to peer e5256d91808b47c195bc9b4dbd7f2b87. Status: Network error: Client connection negotiation failed: client connection to 127.17.223.1:40321: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:08:01.894057 20075 consensus_peers.cc:597] T 2a16f7501e2444fb86d4e2778e734e02 P 127766fc592545a4997f7790f50f6076 -> Peer e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321): Couldn't send request to peer e5256d91808b47c195bc9b4dbd7f2b87. Status: Network error: Client connection negotiation failed: client connection to 127.17.223.1:40321: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:08:01.951093 20075 consensus_peers.cc:597] T 9962423cb4e54fcfa5de01daf68a86e7 P 127766fc592545a4997f7790f50f6076 -> Peer e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321): Couldn't send request to peer e5256d91808b47c195bc9b4dbd7f2b87. Status: Network error: Client connection negotiation failed: client connection to 127.17.223.1:40321: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:08:01.970036 19449 consensus_peers.cc:597] T ff75a1d4cb1f493db8f71ddc136ba9ab P 0473d2b2d01f4459b1e90fd12cc7840e -> Peer e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321): Couldn't send request to peer e5256d91808b47c195bc9b4dbd7f2b87. Status: Network error: Client connection negotiation failed: client connection to 127.17.223.1:40321: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:08:01.997048 19449 consensus_peers.cc:597] T b08304a0a02b42d7840c4e8ee9a6bd1a P 0473d2b2d01f4459b1e90fd12cc7840e -> Peer e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321): Couldn't send request to peer e5256d91808b47c195bc9b4dbd7f2b87. Status: Network error: Client connection negotiation failed: client connection to 127.17.223.1:40321: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:08:02.007910 19449 consensus_peers.cc:597] T 2725d2c4cb054f18b0fc8f735c15f6c2 P 0473d2b2d01f4459b1e90fd12cc7840e -> Peer e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321): Couldn't send request to peer e5256d91808b47c195bc9b4dbd7f2b87. Status: Network error: Client connection negotiation failed: client connection to 127.17.223.1:40321: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:08:02.056854 19523 consensus_peers.cc:597] T 46c5bfeecc314717bffe987e6844b6d0 P e61c3a8f61bb48f8a963c9480e53c168 -> Peer e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321): Couldn't send request to peer e5256d91808b47c195bc9b4dbd7f2b87. Status: Network error: Client connection negotiation failed: client connection to 127.17.223.1:40321: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:08:02.121271 19449 consensus_peers.cc:597] T ef32ce6fdd0e40d382c79974f30295c6 P 0473d2b2d01f4459b1e90fd12cc7840e -> Peer e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321): Couldn't send request to peer e5256d91808b47c195bc9b4dbd7f2b87. Status: Network error: Client connection negotiation failed: client connection to 127.17.223.1:40321: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:08:02.255270 19523 consensus_peers.cc:597] T ece3db938bc649d4a40a51522ed5259c P e61c3a8f61bb48f8a963c9480e53c168 -> Peer e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321): Couldn't send request to peer e5256d91808b47c195bc9b4dbd7f2b87. Status: Network error: Client connection negotiation failed: client connection to 127.17.223.1:40321: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:08:02.309451 19523 consensus_peers.cc:597] T fa731b585f684a7fb2d106c50f143b83 P e61c3a8f61bb48f8a963c9480e53c168 -> Peer e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321): Couldn't send request to peer e5256d91808b47c195bc9b4dbd7f2b87. Status: Network error: Client connection negotiation failed: client connection to 127.17.223.1:40321: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:08:02.327603 20075 consensus_peers.cc:597] T 70797e5783b5454ab0d0eea663e791e3 P 127766fc592545a4997f7790f50f6076 -> Peer e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321): Couldn't send request to peer e5256d91808b47c195bc9b4dbd7f2b87. Status: Network error: Client connection negotiation failed: client connection to 127.17.223.1:40321: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:08:02.434767 19523 consensus_peers.cc:597] T a08760e15aac4630a629431f56024dc8 P e61c3a8f61bb48f8a963c9480e53c168 -> Peer e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321): Couldn't send request to peer e5256d91808b47c195bc9b4dbd7f2b87. Status: Network error: Client connection negotiation failed: client connection to 127.17.223.1:40321: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:08:02.455814 20075 consensus_peers.cc:597] T 28af091831594f9d8e96482078cc7625 P 127766fc592545a4997f7790f50f6076 -> Peer e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321): Couldn't send request to peer e5256d91808b47c195bc9b4dbd7f2b87. Status: Network error: Client connection negotiation failed: client connection to 127.17.223.1:40321: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:08:02.528843 18300 thread.cc:527] Waited for 19000ms trying to join with diag-logger (tid 19432)
W20260709 13:08:02.627054 20076 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.3:36891, user_credentials={real_user=slave}} blocked reactor thread for 65903.3us
W20260709 13:08:02.650264 20075 consensus_peers.cc:597] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P 127766fc592545a4997f7790f50f6076 -> Peer e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321): Couldn't send request to peer e5256d91808b47c195bc9b4dbd7f2b87. Status: Network error: Client connection negotiation failed: client connection to 127.17.223.1:40321: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:08:02.722808 19523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.4:43121, user_credentials={real_user=slave}} blocked reactor thread for 161576us
W20260709 13:08:02.742439 20075 consensus_peers.cc:597] T 833a2f0775ed407a94b8924ce50adb63 P 127766fc592545a4997f7790f50f6076 -> Peer e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321): Couldn't send request to peer e5256d91808b47c195bc9b4dbd7f2b87. Status: Network error: Client connection negotiation failed: client connection to 127.17.223.1:40321: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:08:02.784953 19449 consensus_peers.cc:597] T fa8650e71aa14778b3d73721fc50d9fc P 0473d2b2d01f4459b1e90fd12cc7840e -> Peer e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321): Couldn't send request to peer e5256d91808b47c195bc9b4dbd7f2b87. Status: Network error: Client connection negotiation failed: client connection to 127.17.223.1:40321: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:08:02.822926 19523 consensus_peers.cc:597] T 4509b76741dc428e9201c70c1658da13 P e61c3a8f61bb48f8a963c9480e53c168 -> Peer e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321): Couldn't send request to peer e5256d91808b47c195bc9b4dbd7f2b87. Status: Network error: Client connection negotiation failed: client connection to 127.17.223.1:40321: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:08:02.830513 19523 consensus_peers.cc:597] T e381f1d6b8184797ad142de49be225a8 P e61c3a8f61bb48f8a963c9480e53c168 -> Peer e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321): Couldn't send request to peer e5256d91808b47c195bc9b4dbd7f2b87. Status: Network error: Client connection negotiation failed: client connection to 127.17.223.1:40321: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:08:02.866500 19449 consensus_peers.cc:597] T 309c3ca0ca4b4f3ba129752ea2cb293b P 0473d2b2d01f4459b1e90fd12cc7840e -> Peer e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321): Couldn't send request to peer e5256d91808b47c195bc9b4dbd7f2b87. Status: Network error: Client connection negotiation failed: client connection to 127.17.223.1:40321: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:08:02.867272 19449 consensus_peers.cc:597] T 40e1e16737a842ee936002830f36882e P 0473d2b2d01f4459b1e90fd12cc7840e -> Peer e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321): Couldn't send request to peer e5256d91808b47c195bc9b4dbd7f2b87. Status: Network error: Client connection negotiation failed: client connection to 127.17.223.1:40321: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:08:02.881281 19523 consensus_peers.cc:597] T 0cdf56e38bbc453d9438d359e5a69955 P e61c3a8f61bb48f8a963c9480e53c168 -> Peer e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321): Couldn't send request to peer e5256d91808b47c195bc9b4dbd7f2b87. Status: Network error: Client connection negotiation failed: client connection to 127.17.223.1:40321: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:08:02.904006 19449 consensus_peers.cc:597] T 7f575b143b844aa096b50997dad3516a P 0473d2b2d01f4459b1e90fd12cc7840e -> Peer e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321): Couldn't send request to peer e5256d91808b47c195bc9b4dbd7f2b87. Status: Network error: Client connection negotiation failed: client connection to 127.17.223.1:40321: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:08:02.912293 19449 consensus_peers.cc:597] T f1b10566f45d4a7d9029858330e02d5b P 0473d2b2d01f4459b1e90fd12cc7840e -> Peer e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321): Couldn't send request to peer e5256d91808b47c195bc9b4dbd7f2b87. Status: Network error: Client connection negotiation failed: client connection to 127.17.223.1:40321: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:08:02.973429 20075 consensus_peers.cc:597] T ff9b0eddd810459b82d91c60777c10eb P 127766fc592545a4997f7790f50f6076 -> Peer e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321): Couldn't send request to peer e5256d91808b47c195bc9b4dbd7f2b87. Status: Network error: Client connection negotiation failed: client connection to 127.17.223.1:40321: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:08:02.984016 19449 consensus_peers.cc:597] T 172b3dd13109415a955b71ac0e9d2234 P 0473d2b2d01f4459b1e90fd12cc7840e -> Peer e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321): Couldn't send request to peer e5256d91808b47c195bc9b4dbd7f2b87. Status: Network error: Client connection negotiation failed: client connection to 127.17.223.1:40321: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:08:03.065491 19523 consensus_peers.cc:597] T 2b74109013a140ada21feeef92d6f563 P e61c3a8f61bb48f8a963c9480e53c168 -> Peer e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321): Couldn't send request to peer e5256d91808b47c195bc9b4dbd7f2b87. Status: Network error: Client connection negotiation failed: client connection to 127.17.223.1:40321: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:08:03.393080 19523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.1:40321, user_credentials={real_user=slave}} blocked reactor thread for 47924.9us
W20260709 13:08:03.435381 19449 consensus_peers.cc:597] T 86a6797bdfe94fa496c050ceae4bd0d9 P 0473d2b2d01f4459b1e90fd12cc7840e -> Peer e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321): Couldn't send request to peer e5256d91808b47c195bc9b4dbd7f2b87. Status: Network error: Client connection negotiation failed: client connection to 127.17.223.1:40321: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:08:03.437620 19449 consensus_peers.cc:597] T 21e14947d70440f19044d8f75c31e1f9 P 0473d2b2d01f4459b1e90fd12cc7840e -> Peer e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321): Couldn't send request to peer e5256d91808b47c195bc9b4dbd7f2b87. Status: Network error: Client connection negotiation failed: client connection to 127.17.223.1:40321: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:08:03.442883 20075 consensus_peers.cc:597] T 5ec1c4ce15e04c7e8c283a62179f2a64 P 127766fc592545a4997f7790f50f6076 -> Peer e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321): Couldn't send request to peer e5256d91808b47c195bc9b4dbd7f2b87. Status: Network error: Client connection negotiation failed: client connection to 127.17.223.1:40321: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:08:03.529404 18300 thread.cc:527] Waited for 20000ms trying to join with diag-logger (tid 19432)
W20260709 13:08:03.533390 19523 consensus_peers.cc:597] T 3e1f505cb0f1427bbd698ac889d80821 P e61c3a8f61bb48f8a963c9480e53c168 -> Peer e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321): Couldn't send request to peer e5256d91808b47c195bc9b4dbd7f2b87. Status: Network error: Client connection negotiation failed: client connection to 127.17.223.1:40321: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:08:03.533921 19523 consensus_peers.cc:597] T 65d8cb8d6ec64f459d5a47cefab10acf P e61c3a8f61bb48f8a963c9480e53c168 -> Peer e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321): Couldn't send request to peer e5256d91808b47c195bc9b4dbd7f2b87. Status: Network error: Client connection negotiation failed: client connection to 127.17.223.1:40321: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:08:03.540851 19523 consensus_peers.cc:597] T 85c494af21f9457a85da47b9bc70c1fd P e61c3a8f61bb48f8a963c9480e53c168 -> Peer e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321): Couldn't send request to peer e5256d91808b47c195bc9b4dbd7f2b87. Status: Network error: Client connection negotiation failed: client connection to 127.17.223.1:40321: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:08:03.576526 20075 consensus_peers.cc:597] T 14efcc79969f41babe5529c22d59156d P 127766fc592545a4997f7790f50f6076 -> Peer e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321): Couldn't send request to peer e5256d91808b47c195bc9b4dbd7f2b87. Status: Network error: Client connection negotiation failed: client connection to 127.17.223.1:40321: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:08:03.604652 19449 consensus_peers.cc:597] T 179fd671030940b4b4a4e24bcc4aba0a P 0473d2b2d01f4459b1e90fd12cc7840e -> Peer e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321): Couldn't send request to peer e5256d91808b47c195bc9b4dbd7f2b87. Status: Network error: Client connection negotiation failed: client connection to 127.17.223.1:40321: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:08:03.733197 19523 consensus_peers.cc:597] T df751f992649444090e27965eb1af85d P e61c3a8f61bb48f8a963c9480e53c168 -> Peer e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321): Couldn't send request to peer e5256d91808b47c195bc9b4dbd7f2b87. Status: Network error: Client connection negotiation failed: client connection to 127.17.223.1:40321: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:08:03.776244 19449 consensus_peers.cc:597] T f93ee515a9c14139bf566522ed8232f3 P 0473d2b2d01f4459b1e90fd12cc7840e -> Peer e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321): Couldn't send request to peer e5256d91808b47c195bc9b4dbd7f2b87. Status: Network error: Client connection negotiation failed: client connection to 127.17.223.1:40321: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:08:03.812162 19449 consensus_peers.cc:597] T edd7d470b5014c9489be7f41f64355c9 P 0473d2b2d01f4459b1e90fd12cc7840e -> Peer e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321): Couldn't send request to peer e5256d91808b47c195bc9b4dbd7f2b87. Status: Network error: Client connection negotiation failed: client connection to 127.17.223.1:40321: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:08:03.815972 19523 consensus_peers.cc:597] T 22196caba61445d3bec98a0aab3c337d P e61c3a8f61bb48f8a963c9480e53c168 -> Peer e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321): Couldn't send request to peer e5256d91808b47c195bc9b4dbd7f2b87. Status: Network error: Client connection negotiation failed: client connection to 127.17.223.1:40321: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:08:03.875512 19523 consensus_peers.cc:597] T 217b5fae677b4971b3bbd2f357a1f7ff P e61c3a8f61bb48f8a963c9480e53c168 -> Peer e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321): Couldn't send request to peer e5256d91808b47c195bc9b4dbd7f2b87. Status: Network error: Client connection negotiation failed: client connection to 127.17.223.1:40321: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:08:03.876128 19523 consensus_peers.cc:597] T 76cb037fc9064d13b59a8969d897ce8c P e61c3a8f61bb48f8a963c9480e53c168 -> Peer e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321): Couldn't send request to peer e5256d91808b47c195bc9b4dbd7f2b87. Status: Network error: Client connection negotiation failed: client connection to 127.17.223.1:40321: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:08:03.965354 19449 consensus_peers.cc:597] T 2e36a9d6e29c4a7c860cf267efbd4c74 P 0473d2b2d01f4459b1e90fd12cc7840e -> Peer e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321): Couldn't send request to peer e5256d91808b47c195bc9b4dbd7f2b87. Status: Network error: Client connection negotiation failed: client connection to 127.17.223.1:40321: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:08:03.997675 19449 consensus_peers.cc:597] T d1e5873a19244c5ebbcd38e126796ee7 P 0473d2b2d01f4459b1e90fd12cc7840e -> Peer e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321): Couldn't send request to peer e5256d91808b47c195bc9b4dbd7f2b87. Status: Network error: Client connection negotiation failed: client connection to 127.17.223.1:40321: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:08:04.097481 20075 consensus_peers.cc:597] T 2a16f7501e2444fb86d4e2778e734e02 P 127766fc592545a4997f7790f50f6076 -> Peer e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321): Couldn't send request to peer e5256d91808b47c195bc9b4dbd7f2b87. Status: Network error: Client connection negotiation failed: client connection to 127.17.223.1:40321: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:08:04.107556 20075 consensus_peers.cc:597] T 1f85fc4b527a48848e5faa083b604e36 P 127766fc592545a4997f7790f50f6076 -> Peer e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321): Couldn't send request to peer e5256d91808b47c195bc9b4dbd7f2b87. Status: Network error: Client connection negotiation failed: client connection to 127.17.223.1:40321: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:08:04.160355 19449 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.17.223.1:40321: connect: Connection refused (error 111) [suppressed 439 similar messages]
W20260709 13:08:04.183707 19523 consensus_peers.cc:597] T 4af19371ea874c09a0a2147040835cbb P e61c3a8f61bb48f8a963c9480e53c168 -> Peer e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321): Couldn't send request to peer e5256d91808b47c195bc9b4dbd7f2b87. Status: Network error: Client connection negotiation failed: client connection to 127.17.223.1:40321: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:08:04.196040 19523 consensus_peers.cc:597] T b9f0d59553ad444883fcf5b5909f9798 P e61c3a8f61bb48f8a963c9480e53c168 -> Peer e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321): Couldn't send request to peer e5256d91808b47c195bc9b4dbd7f2b87. Status: Network error: Client connection negotiation failed: client connection to 127.17.223.1:40321: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:08:04.226820 19449 consensus_peers.cc:597] T 1a61655d99124a29b486ba4a5b37faea P 0473d2b2d01f4459b1e90fd12cc7840e -> Peer e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321): Couldn't send request to peer e5256d91808b47c195bc9b4dbd7f2b87. Status: Network error: Client connection negotiation failed: client connection to 127.17.223.1:40321: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:08:04.355822 19449 consensus_peers.cc:597] T 2725d2c4cb054f18b0fc8f735c15f6c2 P 0473d2b2d01f4459b1e90fd12cc7840e -> Peer e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321): Couldn't send request to peer e5256d91808b47c195bc9b4dbd7f2b87. Status: Network error: Client connection negotiation failed: client connection to 127.17.223.1:40321: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:08:04.501164 20075 consensus_peers.cc:597] T 9962423cb4e54fcfa5de01daf68a86e7 P 127766fc592545a4997f7790f50f6076 -> Peer e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321): Couldn't send request to peer e5256d91808b47c195bc9b4dbd7f2b87. Status: Network error: Client connection negotiation failed: client connection to 127.17.223.1:40321: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:08:04.514065 19449 consensus_peers.cc:597] T 775c229504194560ba9589bc2199b089 P 0473d2b2d01f4459b1e90fd12cc7840e -> Peer e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321): Couldn't send request to peer e5256d91808b47c195bc9b4dbd7f2b87. Status: Network error: Client connection negotiation failed: client connection to 127.17.223.1:40321: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:08:04.529925 18300 thread.cc:527] Waited for 21000ms trying to join with diag-logger (tid 19432)
W20260709 13:08:04.557497 19523 consensus_peers.cc:597] T 1dc5b3532fe54f74876d02beffa2c230 P e61c3a8f61bb48f8a963c9480e53c168 -> Peer e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321): Couldn't send request to peer e5256d91808b47c195bc9b4dbd7f2b87. Status: Network error: Client connection negotiation failed: client connection to 127.17.223.1:40321: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:08:04.573604 19449 consensus_peers.cc:597] T ef32ce6fdd0e40d382c79974f30295c6 P 0473d2b2d01f4459b1e90fd12cc7840e -> Peer e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321): Couldn't send request to peer e5256d91808b47c195bc9b4dbd7f2b87. Status: Network error: Client connection negotiation failed: client connection to 127.17.223.1:40321: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:08:04.630228 19523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.4:43121, user_credentials={real_user=slave}} blocked reactor thread for 44068.2us
W20260709 13:08:04.707425 19449 consensus_peers.cc:597] T b08304a0a02b42d7840c4e8ee9a6bd1a P 0473d2b2d01f4459b1e90fd12cc7840e -> Peer e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321): Couldn't send request to peer e5256d91808b47c195bc9b4dbd7f2b87. Status: Network error: Client connection negotiation failed: client connection to 127.17.223.1:40321: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:08:04.812033 19523 consensus_peers.cc:597] T ece3db938bc649d4a40a51522ed5259c P e61c3a8f61bb48f8a963c9480e53c168 -> Peer e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321): Couldn't send request to peer e5256d91808b47c195bc9b4dbd7f2b87. Status: Network error: Client connection negotiation failed: client connection to 127.17.223.1:40321: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:08:04.812471 19449 consensus_peers.cc:597] T ff75a1d4cb1f493db8f71ddc136ba9ab P 0473d2b2d01f4459b1e90fd12cc7840e -> Peer e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321): Couldn't send request to peer e5256d91808b47c195bc9b4dbd7f2b87. Status: Network error: Client connection negotiation failed: client connection to 127.17.223.1:40321: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:08:04.885222 20075 consensus_peers.cc:597] T 70797e5783b5454ab0d0eea663e791e3 P 127766fc592545a4997f7790f50f6076 -> Peer e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321): Couldn't send request to peer e5256d91808b47c195bc9b4dbd7f2b87. Status: Network error: Client connection negotiation failed: client connection to 127.17.223.1:40321: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:08:04.893514 19523 consensus_peers.cc:597] T fa731b585f684a7fb2d106c50f143b83 P e61c3a8f61bb48f8a963c9480e53c168 -> Peer e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321): Couldn't send request to peer e5256d91808b47c195bc9b4dbd7f2b87. Status: Network error: Client connection negotiation failed: client connection to 127.17.223.1:40321: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:08:04.911465 19523 consensus_peers.cc:597] T 46c5bfeecc314717bffe987e6844b6d0 P e61c3a8f61bb48f8a963c9480e53c168 -> Peer e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321): Couldn't send request to peer e5256d91808b47c195bc9b4dbd7f2b87. Status: Network error: Client connection negotiation failed: client connection to 127.17.223.1:40321: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:08:05.084679 20075 consensus_peers.cc:597] T 833a2f0775ed407a94b8924ce50adb63 P 127766fc592545a4997f7790f50f6076 -> Peer e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321): Couldn't send request to peer e5256d91808b47c195bc9b4dbd7f2b87. Status: Network error: Client connection negotiation failed: client connection to 127.17.223.1:40321: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:08:05.120311 19523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.4:43121, user_credentials={real_user=slave}} blocked reactor thread for 94153.6us
W20260709 13:08:05.195377 19523 consensus_peers.cc:597] T a08760e15aac4630a629431f56024dc8 P e61c3a8f61bb48f8a963c9480e53c168 -> Peer e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321): Couldn't send request to peer e5256d91808b47c195bc9b4dbd7f2b87. Status: Network error: Client connection negotiation failed: client connection to 127.17.223.1:40321: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:08:05.189025 19449 consensus_peers.cc:597] T 309c3ca0ca4b4f3ba129752ea2cb293b P 0473d2b2d01f4459b1e90fd12cc7840e -> Peer e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321): Couldn't send request to peer e5256d91808b47c195bc9b4dbd7f2b87. Status: Network error: Client connection negotiation failed: client connection to 127.17.223.1:40321: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:08:05.218149 20075 consensus_peers.cc:597] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P 127766fc592545a4997f7790f50f6076 -> Peer e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321): Couldn't send request to peer e5256d91808b47c195bc9b4dbd7f2b87. Status: Network error: Client connection negotiation failed: client connection to 127.17.223.1:40321: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:08:05.236776 20075 consensus_peers.cc:597] T 28af091831594f9d8e96482078cc7625 P 127766fc592545a4997f7790f50f6076 -> Peer e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321): Couldn't send request to peer e5256d91808b47c195bc9b4dbd7f2b87. Status: Network error: Client connection negotiation failed: client connection to 127.17.223.1:40321: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
I20260709 13:08:05.291134 18300 tablet_server.cc:196] TabletServer@127.17.223.1:0 shutdown complete.
W20260709 13:08:05.323101 19523 consensus_peers.cc:597] T 0cdf56e38bbc453d9438d359e5a69955 P e61c3a8f61bb48f8a963c9480e53c168 -> Peer e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321): Couldn't send request to peer e5256d91808b47c195bc9b4dbd7f2b87. Status: Network error: Client connection negotiation failed: client connection to 127.17.223.1:40321: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:08:05.420665 19449 consensus_peers.cc:597] T 7f575b143b844aa096b50997dad3516a P 0473d2b2d01f4459b1e90fd12cc7840e -> Peer e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321): Couldn't send request to peer e5256d91808b47c195bc9b4dbd7f2b87. Status: Network error: Client connection negotiation failed: client connection to 127.17.223.1:40321: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:08:05.444394 19523 consensus_peers.cc:597] T e381f1d6b8184797ad142de49be225a8 P e61c3a8f61bb48f8a963c9480e53c168 -> Peer e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321): Couldn't send request to peer e5256d91808b47c195bc9b4dbd7f2b87. Status: Network error: Client connection negotiation failed: client connection to 127.17.223.1:40321: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:08:05.421296 19449 consensus_peers.cc:597] T fa8650e71aa14778b3d73721fc50d9fc P 0473d2b2d01f4459b1e90fd12cc7840e -> Peer e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321): Couldn't send request to peer e5256d91808b47c195bc9b4dbd7f2b87. Status: Network error: Client connection negotiation failed: client connection to 127.17.223.1:40321: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:08:05.490795 19449 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.1:40321, user_credentials={real_user=slave}} blocked reactor thread for 69556.7us
W20260709 13:08:05.517191 19449 consensus_peers.cc:597] T 40e1e16737a842ee936002830f36882e P 0473d2b2d01f4459b1e90fd12cc7840e -> Peer e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321): Couldn't send request to peer e5256d91808b47c195bc9b4dbd7f2b87. Status: Network error: Client connection negotiation failed: client connection to 127.17.223.1:40321: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:08:05.478559 20075 consensus_peers.cc:597] T ff9b0eddd810459b82d91c60777c10eb P 127766fc592545a4997f7790f50f6076 -> Peer e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321): Couldn't send request to peer e5256d91808b47c195bc9b4dbd7f2b87. Status: Network error: Client connection negotiation failed: client connection to 127.17.223.1:40321: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:08:05.536216 20075 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.1:40321, user_credentials={real_user=slave}} blocked reactor thread for 57738.1us
W20260709 13:08:05.548141 19449 consensus_peers.cc:597] T 172b3dd13109415a955b71ac0e9d2234 P 0473d2b2d01f4459b1e90fd12cc7840e -> Peer e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321): Couldn't send request to peer e5256d91808b47c195bc9b4dbd7f2b87. Status: Network error: Client connection negotiation failed: client connection to 127.17.223.1:40321: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
I20260709 13:08:05.558441 18300 tablet_server.cc:179] TabletServer@127.17.223.2:0 shutting down...
W20260709 13:08:05.574756 19449 consensus_peers.cc:597] T f1b10566f45d4a7d9029858330e02d5b P 0473d2b2d01f4459b1e90fd12cc7840e -> Peer e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321): Couldn't send request to peer e5256d91808b47c195bc9b4dbd7f2b87. Status: Network error: Client connection negotiation failed: client connection to 127.17.223.1:40321: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:08:05.589740 19526 consensus_peers.cc:597] T 0afb57ae58a24a01850491d69f0213dd P e61c3a8f61bb48f8a963c9480e53c168 -> Peer 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257): Couldn't send request to peer 0473d2b2d01f4459b1e90fd12cc7840e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:08:05.591743 19526 consensus_peers.cc:597] T a08760e15aac4630a629431f56024dc8 P e61c3a8f61bb48f8a963c9480e53c168 -> Peer 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257): Couldn't send request to peer 0473d2b2d01f4459b1e90fd12cc7840e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:08:05.595971 19526 consensus_peers.cc:597] T 0cdf56e38bbc453d9438d359e5a69955 P e61c3a8f61bb48f8a963c9480e53c168 -> Peer 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257): Couldn't send request to peer 0473d2b2d01f4459b1e90fd12cc7840e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:08:05.601390 19523 consensus_peers.cc:597] T 4509b76741dc428e9201c70c1658da13 P e61c3a8f61bb48f8a963c9480e53c168 -> Peer e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321): Couldn't send request to peer e5256d91808b47c195bc9b4dbd7f2b87. Status: Network error: Client connection negotiation failed: client connection to 127.17.223.1:40321: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 13:08:05.623119 20078 consensus_peers.cc:597] T 9962423cb4e54fcfa5de01daf68a86e7 P 127766fc592545a4997f7790f50f6076 -> Peer 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257): Couldn't send request to peer 0473d2b2d01f4459b1e90fd12cc7840e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:08:05.613307 19526 consensus_peers.cc:597] T e381f1d6b8184797ad142de49be225a8 P e61c3a8f61bb48f8a963c9480e53c168 -> Peer 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257): Couldn't send request to peer 0473d2b2d01f4459b1e90fd12cc7840e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:08:05.636693 19523 consensus_peers.cc:597] T 3e1f505cb0f1427bbd698ac889d80821 P e61c3a8f61bb48f8a963c9480e53c168 -> Peer e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321): Couldn't send request to peer e5256d91808b47c195bc9b4dbd7f2b87. Status: Network error: Client connection negotiation failed: client connection to 127.17.223.1:40321: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 13:08:05.637640 19526 consensus_peers.cc:597] T 6c5eebf646ad445a9d1b1adc319d7b16 P e61c3a8f61bb48f8a963c9480e53c168 -> Peer 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257): Couldn't send request to peer 0473d2b2d01f4459b1e90fd12cc7840e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:08:05.655807 19526 consensus_peers.cc:597] T 217b5fae677b4971b3bbd2f357a1f7ff P e61c3a8f61bb48f8a963c9480e53c168 -> Peer 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257): Couldn't send request to peer 0473d2b2d01f4459b1e90fd12cc7840e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:08:05.663005 19526 consensus_peers.cc:597] T 3e1f505cb0f1427bbd698ac889d80821 P e61c3a8f61bb48f8a963c9480e53c168 -> Peer 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257): Couldn't send request to peer 0473d2b2d01f4459b1e90fd12cc7840e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:08:05.673651 20078 consensus_peers.cc:597] T 48824d5acfbc485ebf8c2d944e7202de P 127766fc592545a4997f7790f50f6076 -> Peer 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257): Couldn't send request to peer 0473d2b2d01f4459b1e90fd12cc7840e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:08:05.677960 19526 consensus_peers.cc:597] T 96efeaaf1057492490e9a621f37e1a2d P e61c3a8f61bb48f8a963c9480e53c168 -> Peer 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257): Couldn't send request to peer 0473d2b2d01f4459b1e90fd12cc7840e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:08:05.693547 19449 consensus_peers.cc:597] T 21e14947d70440f19044d8f75c31e1f9 P 0473d2b2d01f4459b1e90fd12cc7840e -> Peer e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321): Couldn't send request to peer e5256d91808b47c195bc9b4dbd7f2b87. Status: Network error: Client connection negotiation failed: client connection to 127.17.223.1:40321: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
I20260709 13:08:05.704710 18300 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:08:05.706017 18300 tablet_replica.cc:333] T ff9b0eddd810459b82d91c60777c10eb P 0473d2b2d01f4459b1e90fd12cc7840e: stopping tablet replica
I20260709 13:08:05.707080 18300 raft_consensus.cc:2243] T ff9b0eddd810459b82d91c60777c10eb P 0473d2b2d01f4459b1e90fd12cc7840e [term 23 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:05.708271 18300 raft_consensus.cc:2272] T ff9b0eddd810459b82d91c60777c10eb P 0473d2b2d01f4459b1e90fd12cc7840e [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:05.712987 18300 tablet_replica.cc:333] T 48824d5acfbc485ebf8c2d944e7202de P 0473d2b2d01f4459b1e90fd12cc7840e: stopping tablet replica
I20260709 13:08:05.715605 18300 raft_consensus.cc:2243] T 48824d5acfbc485ebf8c2d944e7202de P 0473d2b2d01f4459b1e90fd12cc7840e [term 21 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:05.716315 18300 raft_consensus.cc:2272] T 48824d5acfbc485ebf8c2d944e7202de P 0473d2b2d01f4459b1e90fd12cc7840e [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:05.719456 18300 tablet_replica.cc:333] T 775c229504194560ba9589bc2199b089 P 0473d2b2d01f4459b1e90fd12cc7840e: stopping tablet replica
I20260709 13:08:05.720428 18300 raft_consensus.cc:2243] T 775c229504194560ba9589bc2199b089 P 0473d2b2d01f4459b1e90fd12cc7840e [term 16 LEADER]: Raft consensus shutting down.
I20260709 13:08:05.722000 18300 raft_consensus.cc:2272] T 775c229504194560ba9589bc2199b089 P 0473d2b2d01f4459b1e90fd12cc7840e [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:05.724888 18300 tablet_replica.cc:333] T 2b74109013a140ada21feeef92d6f563 P 0473d2b2d01f4459b1e90fd12cc7840e: stopping tablet replica
I20260709 13:08:05.725744 18300 raft_consensus.cc:2243] T 2b74109013a140ada21feeef92d6f563 P 0473d2b2d01f4459b1e90fd12cc7840e [term 19 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:05.726394 18300 raft_consensus.cc:2272] T 2b74109013a140ada21feeef92d6f563 P 0473d2b2d01f4459b1e90fd12cc7840e [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:05.730298 18300 tablet_replica.cc:333] T 4509b76741dc428e9201c70c1658da13 P 0473d2b2d01f4459b1e90fd12cc7840e: stopping tablet replica
I20260709 13:08:05.731132 18300 raft_consensus.cc:2243] T 4509b76741dc428e9201c70c1658da13 P 0473d2b2d01f4459b1e90fd12cc7840e [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:05.731870 18300 raft_consensus.cc:2272] T 4509b76741dc428e9201c70c1658da13 P 0473d2b2d01f4459b1e90fd12cc7840e [term 16 FOLLOWER]: Raft consensus is shut down!
W20260709 13:08:05.734325 20078 consensus_peers.cc:597] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P 127766fc592545a4997f7790f50f6076 -> Peer 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257): Couldn't send request to peer 0473d2b2d01f4459b1e90fd12cc7840e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:08:05.737078 18300 tablet_replica.cc:333] T 179fd671030940b4b4a4e24bcc4aba0a P 0473d2b2d01f4459b1e90fd12cc7840e: stopping tablet replica
I20260709 13:08:05.738030 18300 raft_consensus.cc:2243] T 179fd671030940b4b4a4e24bcc4aba0a P 0473d2b2d01f4459b1e90fd12cc7840e [term 23 LEADER]: Raft consensus shutting down.
I20260709 13:08:05.739298 18300 raft_consensus.cc:2272] T 179fd671030940b4b4a4e24bcc4aba0a P 0473d2b2d01f4459b1e90fd12cc7840e [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:05.742367 18300 tablet_replica.cc:333] T 0e1085d23e8347fbbd5bce7542f4b1f4 P 0473d2b2d01f4459b1e90fd12cc7840e: stopping tablet replica
I20260709 13:08:05.743371 18300 raft_consensus.cc:2243] T 0e1085d23e8347fbbd5bce7542f4b1f4 P 0473d2b2d01f4459b1e90fd12cc7840e [term 18 LEADER]: Raft consensus shutting down.
I20260709 13:08:05.744481 18300 raft_consensus.cc:2272] T 0e1085d23e8347fbbd5bce7542f4b1f4 P 0473d2b2d01f4459b1e90fd12cc7840e [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:05.747153 18300 tablet_replica.cc:333] T ab43d85f64114d4ebf618930e43d9ed0 P 0473d2b2d01f4459b1e90fd12cc7840e: stopping tablet replica
I20260709 13:08:05.747998 18300 raft_consensus.cc:2243] T ab43d85f64114d4ebf618930e43d9ed0 P 0473d2b2d01f4459b1e90fd12cc7840e [term 23 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:05.748742 18300 raft_consensus.cc:2272] T ab43d85f64114d4ebf618930e43d9ed0 P 0473d2b2d01f4459b1e90fd12cc7840e [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:05.753466 18300 tablet_replica.cc:333] T 1dc5b3532fe54f74876d02beffa2c230 P 0473d2b2d01f4459b1e90fd12cc7840e: stopping tablet replica
I20260709 13:08:05.754245 18300 raft_consensus.cc:2243] T 1dc5b3532fe54f74876d02beffa2c230 P 0473d2b2d01f4459b1e90fd12cc7840e [term 24 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:05.754949 18300 raft_consensus.cc:2272] T 1dc5b3532fe54f74876d02beffa2c230 P 0473d2b2d01f4459b1e90fd12cc7840e [term 24 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:05.758328 18300 tablet_replica.cc:333] T bc225c93219c45538b53a1bd3d387e4d P 0473d2b2d01f4459b1e90fd12cc7840e: stopping tablet replica
I20260709 13:08:05.759177 18300 raft_consensus.cc:2243] T bc225c93219c45538b53a1bd3d387e4d P 0473d2b2d01f4459b1e90fd12cc7840e [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:05.760360 18300 raft_consensus.cc:2272] T bc225c93219c45538b53a1bd3d387e4d P 0473d2b2d01f4459b1e90fd12cc7840e [term 18 FOLLOWER]: Raft consensus is shut down!
W20260709 13:08:05.766798 19526 consensus_peers.cc:597] T 1dc5b3532fe54f74876d02beffa2c230 P e61c3a8f61bb48f8a963c9480e53c168 -> Peer 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257): Couldn't send request to peer 0473d2b2d01f4459b1e90fd12cc7840e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:08:05.770095 19526 consensus_peers.cc:597] T b9f0d59553ad444883fcf5b5909f9798 P e61c3a8f61bb48f8a963c9480e53c168 -> Peer 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257): Couldn't send request to peer 0473d2b2d01f4459b1e90fd12cc7840e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:08:05.772346 18300 tablet_replica.cc:333] T 5ec1c4ce15e04c7e8c283a62179f2a64 P 0473d2b2d01f4459b1e90fd12cc7840e: stopping tablet replica
I20260709 13:08:05.773294 18300 raft_consensus.cc:2243] T 5ec1c4ce15e04c7e8c283a62179f2a64 P 0473d2b2d01f4459b1e90fd12cc7840e [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:05.774741 18300 raft_consensus.cc:2272] T 5ec1c4ce15e04c7e8c283a62179f2a64 P 0473d2b2d01f4459b1e90fd12cc7840e [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:05.777408 18300 tablet_replica.cc:333] T 62c6c134d3d24a1ab144dd9ee6bc3f64 P 0473d2b2d01f4459b1e90fd12cc7840e: stopping tablet replica
I20260709 13:08:05.778157 18300 raft_consensus.cc:2243] T 62c6c134d3d24a1ab144dd9ee6bc3f64 P 0473d2b2d01f4459b1e90fd12cc7840e [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:05.778806 18300 raft_consensus.cc:2272] T 62c6c134d3d24a1ab144dd9ee6bc3f64 P 0473d2b2d01f4459b1e90fd12cc7840e [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:05.784228 18300 tablet_replica.cc:333] T 2725d2c4cb054f18b0fc8f735c15f6c2 P 0473d2b2d01f4459b1e90fd12cc7840e: stopping tablet replica
W20260709 13:08:05.784828 19526 consensus_peers.cc:597] T bc225c93219c45538b53a1bd3d387e4d P e61c3a8f61bb48f8a963c9480e53c168 -> Peer 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257): Couldn't send request to peer 0473d2b2d01f4459b1e90fd12cc7840e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:08:05.785060 18300 raft_consensus.cc:2243] T 2725d2c4cb054f18b0fc8f735c15f6c2 P 0473d2b2d01f4459b1e90fd12cc7840e [term 23 LEADER]: Raft consensus shutting down.
I20260709 13:08:05.787251 18300 raft_consensus.cc:2272] T 2725d2c4cb054f18b0fc8f735c15f6c2 P 0473d2b2d01f4459b1e90fd12cc7840e [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:05.790014 18300 tablet_replica.cc:333] T 6c5eebf646ad445a9d1b1adc319d7b16 P 0473d2b2d01f4459b1e90fd12cc7840e: stopping tablet replica
I20260709 13:08:05.790781 18300 raft_consensus.cc:2243] T 6c5eebf646ad445a9d1b1adc319d7b16 P 0473d2b2d01f4459b1e90fd12cc7840e [term 20 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:05.791558 18300 raft_consensus.cc:2272] T 6c5eebf646ad445a9d1b1adc319d7b16 P 0473d2b2d01f4459b1e90fd12cc7840e [term 20 FOLLOWER]: Raft consensus is shut down!
W20260709 13:08:05.794447 20078 consensus_peers.cc:597] T ab43d85f64114d4ebf618930e43d9ed0 P 127766fc592545a4997f7790f50f6076 -> Peer 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257): Couldn't send request to peer 0473d2b2d01f4459b1e90fd12cc7840e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:08:05.794477 18300 tablet_replica.cc:333] T 7f575b143b844aa096b50997dad3516a P 0473d2b2d01f4459b1e90fd12cc7840e: stopping tablet replica
I20260709 13:08:05.795537 18300 raft_consensus.cc:2243] T 7f575b143b844aa096b50997dad3516a P 0473d2b2d01f4459b1e90fd12cc7840e [term 21 LEADER]: Raft consensus shutting down.
I20260709 13:08:05.796756 18300 raft_consensus.cc:2272] T 7f575b143b844aa096b50997dad3516a P 0473d2b2d01f4459b1e90fd12cc7840e [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:05.800757 18300 tablet_replica.cc:333] T 9962423cb4e54fcfa5de01daf68a86e7 P 0473d2b2d01f4459b1e90fd12cc7840e: stopping tablet replica
I20260709 13:08:05.801520 18300 raft_consensus.cc:2243] T 9962423cb4e54fcfa5de01daf68a86e7 P 0473d2b2d01f4459b1e90fd12cc7840e [term 19 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:05.802139 18300 raft_consensus.cc:2272] T 9962423cb4e54fcfa5de01daf68a86e7 P 0473d2b2d01f4459b1e90fd12cc7840e [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:05.804742 18300 tablet_replica.cc:333] T f93ee515a9c14139bf566522ed8232f3 P 0473d2b2d01f4459b1e90fd12cc7840e: stopping tablet replica
I20260709 13:08:05.805505 18300 raft_consensus.cc:2243] T f93ee515a9c14139bf566522ed8232f3 P 0473d2b2d01f4459b1e90fd12cc7840e [term 27 LEADER]: Raft consensus shutting down.
I20260709 13:08:05.807011 18300 raft_consensus.cc:2272] T f93ee515a9c14139bf566522ed8232f3 P 0473d2b2d01f4459b1e90fd12cc7840e [term 27 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:05.811786 18300 tablet_replica.cc:333] T 172b3dd13109415a955b71ac0e9d2234 P 0473d2b2d01f4459b1e90fd12cc7840e: stopping tablet replica
I20260709 13:08:05.812665 18300 raft_consensus.cc:2243] T 172b3dd13109415a955b71ac0e9d2234 P 0473d2b2d01f4459b1e90fd12cc7840e [term 20 LEADER]: Raft consensus shutting down.
I20260709 13:08:05.813748 18300 raft_consensus.cc:2272] T 172b3dd13109415a955b71ac0e9d2234 P 0473d2b2d01f4459b1e90fd12cc7840e [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:05.817581 18300 tablet_replica.cc:333] T 86a6797bdfe94fa496c050ceae4bd0d9 P 0473d2b2d01f4459b1e90fd12cc7840e: stopping tablet replica
I20260709 13:08:05.818323 18300 raft_consensus.cc:2243] T 86a6797bdfe94fa496c050ceae4bd0d9 P 0473d2b2d01f4459b1e90fd12cc7840e [term 17 LEADER]: Raft consensus shutting down.
I20260709 13:08:05.819409 18300 raft_consensus.cc:2272] T 86a6797bdfe94fa496c050ceae4bd0d9 P 0473d2b2d01f4459b1e90fd12cc7840e [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:05.823993 18300 tablet_replica.cc:333] T ef32ce6fdd0e40d382c79974f30295c6 P 0473d2b2d01f4459b1e90fd12cc7840e: stopping tablet replica
W20260709 13:08:05.824111 20075 consensus_peers.cc:597] T 14efcc79969f41babe5529c22d59156d P 127766fc592545a4997f7790f50f6076 -> Peer e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321): Couldn't send request to peer e5256d91808b47c195bc9b4dbd7f2b87. Status: Network error: Client connection negotiation failed: client connection to 127.17.223.1:40321: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
I20260709 13:08:05.824924 18300 raft_consensus.cc:2243] T ef32ce6fdd0e40d382c79974f30295c6 P 0473d2b2d01f4459b1e90fd12cc7840e [term 24 LEADER]: Raft consensus shutting down.
W20260709 13:08:05.825135 20078 consensus_peers.cc:597] T 1efebf73c86e432baa55533136b6e12c P 127766fc592545a4997f7790f50f6076 -> Peer 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257): Couldn't send request to peer 0473d2b2d01f4459b1e90fd12cc7840e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:08:05.826241 18300 raft_consensus.cc:2272] T ef32ce6fdd0e40d382c79974f30295c6 P 0473d2b2d01f4459b1e90fd12cc7840e [term 24 FOLLOWER]: Raft consensus is shut down!
W20260709 13:08:05.828356 20078 consensus_peers.cc:597] T 1f85fc4b527a48848e5faa083b604e36 P 127766fc592545a4997f7790f50f6076 -> Peer 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257): Couldn't send request to peer 0473d2b2d01f4459b1e90fd12cc7840e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:08:05.831533 18300 tablet_replica.cc:333] T b08304a0a02b42d7840c4e8ee9a6bd1a P 0473d2b2d01f4459b1e90fd12cc7840e: stopping tablet replica
I20260709 13:08:05.832405 18300 raft_consensus.cc:2243] T b08304a0a02b42d7840c4e8ee9a6bd1a P 0473d2b2d01f4459b1e90fd12cc7840e [term 23 LEADER]: Raft consensus shutting down.
I20260709 13:08:05.834620 18300 raft_consensus.cc:2272] T b08304a0a02b42d7840c4e8ee9a6bd1a P 0473d2b2d01f4459b1e90fd12cc7840e [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:05.837293 18300 tablet_replica.cc:333] T 3e1f505cb0f1427bbd698ac889d80821 P 0473d2b2d01f4459b1e90fd12cc7840e: stopping tablet replica
I20260709 13:08:05.838074 18300 raft_consensus.cc:2243] T 3e1f505cb0f1427bbd698ac889d80821 P 0473d2b2d01f4459b1e90fd12cc7840e [term 19 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:05.838752 18300 raft_consensus.cc:2272] T 3e1f505cb0f1427bbd698ac889d80821 P 0473d2b2d01f4459b1e90fd12cc7840e [term 19 FOLLOWER]: Raft consensus is shut down!
W20260709 13:08:05.841851 19526 consensus_peers.cc:597] T 22196caba61445d3bec98a0aab3c337d P e61c3a8f61bb48f8a963c9480e53c168 -> Peer 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257): Couldn't send request to peer 0473d2b2d01f4459b1e90fd12cc7840e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:08:05.842641 18300 tablet_replica.cc:333] T edd7d470b5014c9489be7f41f64355c9 P 0473d2b2d01f4459b1e90fd12cc7840e: stopping tablet replica
W20260709 13:08:05.843426 19523 consensus_peers.cc:597] T 2b74109013a140ada21feeef92d6f563 P e61c3a8f61bb48f8a963c9480e53c168 -> Peer e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321): Couldn't send request to peer e5256d91808b47c195bc9b4dbd7f2b87. Status: Network error: Client connection negotiation failed: client connection to 127.17.223.1:40321: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
I20260709 13:08:05.844457 18300 raft_consensus.cc:2243] T edd7d470b5014c9489be7f41f64355c9 P 0473d2b2d01f4459b1e90fd12cc7840e [term 27 LEADER]: Raft consensus shutting down.
I20260709 13:08:05.846061 18300 raft_consensus.cc:2272] T edd7d470b5014c9489be7f41f64355c9 P 0473d2b2d01f4459b1e90fd12cc7840e [term 27 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:05.850896 18300 tablet_replica.cc:333] T a08760e15aac4630a629431f56024dc8 P 0473d2b2d01f4459b1e90fd12cc7840e: stopping tablet replica
I20260709 13:08:05.852710 18300 raft_consensus.cc:2243] T a08760e15aac4630a629431f56024dc8 P 0473d2b2d01f4459b1e90fd12cc7840e [term 24 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:05.854619 18300 raft_consensus.cc:2272] T a08760e15aac4630a629431f56024dc8 P 0473d2b2d01f4459b1e90fd12cc7840e [term 24 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:05.858203 18300 tablet_replica.cc:333] T 0afb57ae58a24a01850491d69f0213dd P 0473d2b2d01f4459b1e90fd12cc7840e: stopping tablet replica
I20260709 13:08:05.859098 18300 raft_consensus.cc:2243] T 0afb57ae58a24a01850491d69f0213dd P 0473d2b2d01f4459b1e90fd12cc7840e [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:05.859741 18300 raft_consensus.cc:2272] T 0afb57ae58a24a01850491d69f0213dd P 0473d2b2d01f4459b1e90fd12cc7840e [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:05.862950 18300 tablet_replica.cc:333] T 1a61655d99124a29b486ba4a5b37faea P 0473d2b2d01f4459b1e90fd12cc7840e: stopping tablet replica
I20260709 13:08:05.863703 18300 raft_consensus.cc:2243] T 1a61655d99124a29b486ba4a5b37faea P 0473d2b2d01f4459b1e90fd12cc7840e [term 18 LEADER]: Raft consensus shutting down.
I20260709 13:08:05.864811 18300 raft_consensus.cc:2272] T 1a61655d99124a29b486ba4a5b37faea P 0473d2b2d01f4459b1e90fd12cc7840e [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:05.867592 18300 tablet_replica.cc:333] T 309c3ca0ca4b4f3ba129752ea2cb293b P 0473d2b2d01f4459b1e90fd12cc7840e: stopping tablet replica
I20260709 13:08:05.868399 18300 raft_consensus.cc:2243] T 309c3ca0ca4b4f3ba129752ea2cb293b P 0473d2b2d01f4459b1e90fd12cc7840e [term 16 LEADER]: Raft consensus shutting down.
I20260709 13:08:05.869751 18300 raft_consensus.cc:2272] T 309c3ca0ca4b4f3ba129752ea2cb293b P 0473d2b2d01f4459b1e90fd12cc7840e [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:05.875313 18300 tablet_replica.cc:333] T d1e5873a19244c5ebbcd38e126796ee7 P 0473d2b2d01f4459b1e90fd12cc7840e: stopping tablet replica
I20260709 13:08:05.876117 18300 raft_consensus.cc:2243] T d1e5873a19244c5ebbcd38e126796ee7 P 0473d2b2d01f4459b1e90fd12cc7840e [term 24 LEADER]: Raft consensus shutting down.
I20260709 13:08:05.877990 18300 raft_consensus.cc:2272] T d1e5873a19244c5ebbcd38e126796ee7 P 0473d2b2d01f4459b1e90fd12cc7840e [term 24 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:05.881861 18300 tablet_replica.cc:333] T b9f0d59553ad444883fcf5b5909f9798 P 0473d2b2d01f4459b1e90fd12cc7840e: stopping tablet replica
I20260709 13:08:05.882622 18300 raft_consensus.cc:2243] T b9f0d59553ad444883fcf5b5909f9798 P 0473d2b2d01f4459b1e90fd12cc7840e [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:05.883680 18300 raft_consensus.cc:2272] T b9f0d59553ad444883fcf5b5909f9798 P 0473d2b2d01f4459b1e90fd12cc7840e [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:05.887210 18300 tablet_replica.cc:333] T 7be9efa6559648dbb5a0f7684c4542d1 P 0473d2b2d01f4459b1e90fd12cc7840e: stopping tablet replica
I20260709 13:08:05.887964 18300 raft_consensus.cc:2243] T 7be9efa6559648dbb5a0f7684c4542d1 P 0473d2b2d01f4459b1e90fd12cc7840e [term 24 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:05.888588 18300 raft_consensus.cc:2272] T 7be9efa6559648dbb5a0f7684c4542d1 P 0473d2b2d01f4459b1e90fd12cc7840e [term 24 FOLLOWER]: Raft consensus is shut down!
W20260709 13:08:05.889353 19526 consensus_peers.cc:597] T 7be9efa6559648dbb5a0f7684c4542d1 P e61c3a8f61bb48f8a963c9480e53c168 -> Peer 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257): Couldn't send request to peer 0473d2b2d01f4459b1e90fd12cc7840e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:08:05.891242 18300 tablet_replica.cc:333] T 40e1e16737a842ee936002830f36882e P 0473d2b2d01f4459b1e90fd12cc7840e: stopping tablet replica
I20260709 13:08:05.892074 18300 raft_consensus.cc:2243] T 40e1e16737a842ee936002830f36882e P 0473d2b2d01f4459b1e90fd12cc7840e [term 24 LEADER]: Raft consensus shutting down.
I20260709 13:08:05.893229 18300 raft_consensus.cc:2272] T 40e1e16737a842ee936002830f36882e P 0473d2b2d01f4459b1e90fd12cc7840e [term 24 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:05.895785 18300 tablet_replica.cc:333] T 1efebf73c86e432baa55533136b6e12c P 0473d2b2d01f4459b1e90fd12cc7840e: stopping tablet replica
I20260709 13:08:05.896653 18300 raft_consensus.cc:2243] T 1efebf73c86e432baa55533136b6e12c P 0473d2b2d01f4459b1e90fd12cc7840e [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:05.897275 18300 raft_consensus.cc:2272] T 1efebf73c86e432baa55533136b6e12c P 0473d2b2d01f4459b1e90fd12cc7840e [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:05.899960 18300 tablet_replica.cc:333] T 14efcc79969f41babe5529c22d59156d P 0473d2b2d01f4459b1e90fd12cc7840e: stopping tablet replica
I20260709 13:08:05.900750 18300 raft_consensus.cc:2243] T 14efcc79969f41babe5529c22d59156d P 0473d2b2d01f4459b1e90fd12cc7840e [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:05.901450 18300 raft_consensus.cc:2272] T 14efcc79969f41babe5529c22d59156d P 0473d2b2d01f4459b1e90fd12cc7840e [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:05.905292 18300 tablet_replica.cc:333] T 1f85fc4b527a48848e5faa083b604e36 P 0473d2b2d01f4459b1e90fd12cc7840e: stopping tablet replica
I20260709 13:08:05.906083 18300 raft_consensus.cc:2243] T 1f85fc4b527a48848e5faa083b604e36 P 0473d2b2d01f4459b1e90fd12cc7840e [term 20 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:05.907045 18300 raft_consensus.cc:2272] T 1f85fc4b527a48848e5faa083b604e36 P 0473d2b2d01f4459b1e90fd12cc7840e [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:05.909832 18300 tablet_replica.cc:333] T 21e14947d70440f19044d8f75c31e1f9 P 0473d2b2d01f4459b1e90fd12cc7840e: stopping tablet replica
I20260709 13:08:05.910632 18300 raft_consensus.cc:2243] T 21e14947d70440f19044d8f75c31e1f9 P 0473d2b2d01f4459b1e90fd12cc7840e [term 22 LEADER]: Raft consensus shutting down.
I20260709 13:08:05.911746 18300 raft_consensus.cc:2272] T 21e14947d70440f19044d8f75c31e1f9 P 0473d2b2d01f4459b1e90fd12cc7840e [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:05.914186 18300 tablet_replica.cc:333] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P 0473d2b2d01f4459b1e90fd12cc7840e: stopping tablet replica
I20260709 13:08:05.914942 18300 raft_consensus.cc:2243] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P 0473d2b2d01f4459b1e90fd12cc7840e [term 22 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:05.915493 18300 raft_consensus.cc:2272] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P 0473d2b2d01f4459b1e90fd12cc7840e [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:05.917999 18300 tablet_replica.cc:333] T 46c5bfeecc314717bffe987e6844b6d0 P 0473d2b2d01f4459b1e90fd12cc7840e: stopping tablet replica
I20260709 13:08:05.918784 18300 raft_consensus.cc:2243] T 46c5bfeecc314717bffe987e6844b6d0 P 0473d2b2d01f4459b1e90fd12cc7840e [term 27 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:05.919400 18300 raft_consensus.cc:2272] T 46c5bfeecc314717bffe987e6844b6d0 P 0473d2b2d01f4459b1e90fd12cc7840e [term 27 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:05.923995 18300 tablet_replica.cc:333] T 2e36a9d6e29c4a7c860cf267efbd4c74 P 0473d2b2d01f4459b1e90fd12cc7840e: stopping tablet replica
I20260709 13:08:05.924741 18300 raft_consensus.cc:2243] T 2e36a9d6e29c4a7c860cf267efbd4c74 P 0473d2b2d01f4459b1e90fd12cc7840e [term 18 LEADER]: Raft consensus shutting down.
I20260709 13:08:05.925740 18300 raft_consensus.cc:2272] T 2e36a9d6e29c4a7c860cf267efbd4c74 P 0473d2b2d01f4459b1e90fd12cc7840e [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:05.928490 18300 tablet_replica.cc:333] T 22196caba61445d3bec98a0aab3c337d P 0473d2b2d01f4459b1e90fd12cc7840e: stopping tablet replica
I20260709 13:08:05.929220 18300 raft_consensus.cc:2243] T 22196caba61445d3bec98a0aab3c337d P 0473d2b2d01f4459b1e90fd12cc7840e [term 21 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:05.930074 18300 raft_consensus.cc:2272] T 22196caba61445d3bec98a0aab3c337d P 0473d2b2d01f4459b1e90fd12cc7840e [term 21 FOLLOWER]: Raft consensus is shut down!
W20260709 13:08:05.931082 20078 consensus_peers.cc:597] T 62c6c134d3d24a1ab144dd9ee6bc3f64 P 127766fc592545a4997f7790f50f6076 -> Peer 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257): Couldn't send request to peer 0473d2b2d01f4459b1e90fd12cc7840e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:08:05.932588 18300 tablet_replica.cc:333] T 14935b3ddf914369822e4a0547aaa355 P 0473d2b2d01f4459b1e90fd12cc7840e: stopping tablet replica
I20260709 13:08:05.933370 18300 raft_consensus.cc:2243] T 14935b3ddf914369822e4a0547aaa355 P 0473d2b2d01f4459b1e90fd12cc7840e [term 15 LEADER]: Raft consensus shutting down.
I20260709 13:08:05.934455 18300 raft_consensus.cc:2272] T 14935b3ddf914369822e4a0547aaa355 P 0473d2b2d01f4459b1e90fd12cc7840e [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:05.937119 18300 tablet_replica.cc:333] T 96efeaaf1057492490e9a621f37e1a2d P 0473d2b2d01f4459b1e90fd12cc7840e: stopping tablet replica
I20260709 13:08:05.937856 18300 raft_consensus.cc:2243] T 96efeaaf1057492490e9a621f37e1a2d P 0473d2b2d01f4459b1e90fd12cc7840e [term 22 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:05.938413 18300 raft_consensus.cc:2272] T 96efeaaf1057492490e9a621f37e1a2d P 0473d2b2d01f4459b1e90fd12cc7840e [term 22 FOLLOWER]: Raft consensus is shut down!
W20260709 13:08:05.940353 19526 consensus_peers.cc:597] T 2b74109013a140ada21feeef92d6f563 P e61c3a8f61bb48f8a963c9480e53c168 -> Peer 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257): Couldn't send request to peer 0473d2b2d01f4459b1e90fd12cc7840e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:08:05.940927 18300 tablet_replica.cc:333] T fa8650e71aa14778b3d73721fc50d9fc P 0473d2b2d01f4459b1e90fd12cc7840e: stopping tablet replica
I20260709 13:08:05.941668 18300 raft_consensus.cc:2243] T fa8650e71aa14778b3d73721fc50d9fc P 0473d2b2d01f4459b1e90fd12cc7840e [term 22 LEADER]: Raft consensus shutting down.
I20260709 13:08:05.942987 18300 raft_consensus.cc:2272] T fa8650e71aa14778b3d73721fc50d9fc P 0473d2b2d01f4459b1e90fd12cc7840e [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:05.945359 18300 tablet_replica.cc:333] T f1b10566f45d4a7d9029858330e02d5b P 0473d2b2d01f4459b1e90fd12cc7840e: stopping tablet replica
I20260709 13:08:05.946344 18300 raft_consensus.cc:2243] T f1b10566f45d4a7d9029858330e02d5b P 0473d2b2d01f4459b1e90fd12cc7840e [term 21 LEADER]: Raft consensus shutting down.
W20260709 13:08:05.945358 20078 consensus_peers.cc:597] T ff9b0eddd810459b82d91c60777c10eb P 127766fc592545a4997f7790f50f6076 -> Peer 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257): Couldn't send request to peer 0473d2b2d01f4459b1e90fd12cc7840e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:08:05.947511 18300 raft_consensus.cc:2272] T f1b10566f45d4a7d9029858330e02d5b P 0473d2b2d01f4459b1e90fd12cc7840e [term 21 FOLLOWER]: Raft consensus is shut down!
W20260709 13:08:05.949923 20078 consensus_peers.cc:597] T 5ec1c4ce15e04c7e8c283a62179f2a64 P 127766fc592545a4997f7790f50f6076 -> Peer 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257): Couldn't send request to peer 0473d2b2d01f4459b1e90fd12cc7840e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:08:05.950076 18300 tablet_replica.cc:333] T 0cdf56e38bbc453d9438d359e5a69955 P 0473d2b2d01f4459b1e90fd12cc7840e: stopping tablet replica
W20260709 13:08:05.950660 20078 consensus_peers.cc:597] T 14efcc79969f41babe5529c22d59156d P 127766fc592545a4997f7790f50f6076 -> Peer 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257): Couldn't send request to peer 0473d2b2d01f4459b1e90fd12cc7840e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:08:05.950917 18300 raft_consensus.cc:2243] T 0cdf56e38bbc453d9438d359e5a69955 P 0473d2b2d01f4459b1e90fd12cc7840e [term 23 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:05.951560 18300 raft_consensus.cc:2272] T 0cdf56e38bbc453d9438d359e5a69955 P 0473d2b2d01f4459b1e90fd12cc7840e [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:05.953992 18300 tablet_replica.cc:333] T ff75a1d4cb1f493db8f71ddc136ba9ab P 0473d2b2d01f4459b1e90fd12cc7840e: stopping tablet replica
I20260709 13:08:05.954722 18300 raft_consensus.cc:2243] T ff75a1d4cb1f493db8f71ddc136ba9ab P 0473d2b2d01f4459b1e90fd12cc7840e [term 21 LEADER]: Raft consensus shutting down.
I20260709 13:08:05.955709 18300 raft_consensus.cc:2272] T ff75a1d4cb1f493db8f71ddc136ba9ab P 0473d2b2d01f4459b1e90fd12cc7840e [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:05.958355 18300 tablet_replica.cc:333] T e381f1d6b8184797ad142de49be225a8 P 0473d2b2d01f4459b1e90fd12cc7840e: stopping tablet replica
I20260709 13:08:05.959040 18300 raft_consensus.cc:2243] T e381f1d6b8184797ad142de49be225a8 P 0473d2b2d01f4459b1e90fd12cc7840e [term 21 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:05.959657 18300 raft_consensus.cc:2272] T e381f1d6b8184797ad142de49be225a8 P 0473d2b2d01f4459b1e90fd12cc7840e [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:05.962146 18300 tablet_replica.cc:333] T 217b5fae677b4971b3bbd2f357a1f7ff P 0473d2b2d01f4459b1e90fd12cc7840e: stopping tablet replica
I20260709 13:08:05.962809 18300 raft_consensus.cc:2243] T 217b5fae677b4971b3bbd2f357a1f7ff P 0473d2b2d01f4459b1e90fd12cc7840e [term 20 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:05.963441 18300 raft_consensus.cc:2272] T 217b5fae677b4971b3bbd2f357a1f7ff P 0473d2b2d01f4459b1e90fd12cc7840e [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:05.965895 18300 tablet_replica.cc:333] T ed7fdbcb96d14d418db9ca90a792588a P 0473d2b2d01f4459b1e90fd12cc7840e: stopping tablet replica
I20260709 13:08:05.966542 18300 raft_consensus.cc:2243] T ed7fdbcb96d14d418db9ca90a792588a P 0473d2b2d01f4459b1e90fd12cc7840e [term 18 LEADER]: Raft consensus shutting down.
I20260709 13:08:05.969626 18300 raft_consensus.cc:2272] T ed7fdbcb96d14d418db9ca90a792588a P 0473d2b2d01f4459b1e90fd12cc7840e [term 18 FOLLOWER]: Raft consensus is shut down!
W20260709 13:08:05.972882 19526 consensus_peers.cc:597] T 4509b76741dc428e9201c70c1658da13 P e61c3a8f61bb48f8a963c9480e53c168 -> Peer 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257): Couldn't send request to peer 0473d2b2d01f4459b1e90fd12cc7840e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:08:06.003631 19526 consensus_peers.cc:597] T 46c5bfeecc314717bffe987e6844b6d0 P e61c3a8f61bb48f8a963c9480e53c168 -> Peer 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257): Couldn't send request to peer 0473d2b2d01f4459b1e90fd12cc7840e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:08:06.047438 19523 consensus_peers.cc:597] T 85c494af21f9457a85da47b9bc70c1fd P e61c3a8f61bb48f8a963c9480e53c168 -> Peer e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321): Couldn't send request to peer e5256d91808b47c195bc9b4dbd7f2b87. Status: Network error: Client connection negotiation failed: client connection to 127.17.223.1:40321: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:08:06.091269 19523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.1:40321, user_credentials={real_user=slave}} blocked reactor thread for 43898us
W20260709 13:08:06.114351 19523 consensus_peers.cc:597] T 65d8cb8d6ec64f459d5a47cefab10acf P e61c3a8f61bb48f8a963c9480e53c168 -> Peer e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321): Couldn't send request to peer e5256d91808b47c195bc9b4dbd7f2b87. Status: Network error: Client connection negotiation failed: client connection to 127.17.223.1:40321: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:08:06.124418 19523 consensus_peers.cc:597] T 22196caba61445d3bec98a0aab3c337d P e61c3a8f61bb48f8a963c9480e53c168 -> Peer e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321): Couldn't send request to peer e5256d91808b47c195bc9b4dbd7f2b87. Status: Network error: Client connection negotiation failed: client connection to 127.17.223.1:40321: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 13:08:06.132524 20075 consensus_peers.cc:597] T 5ec1c4ce15e04c7e8c283a62179f2a64 P 127766fc592545a4997f7790f50f6076 -> Peer e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321): Couldn't send request to peer e5256d91808b47c195bc9b4dbd7f2b87. Status: Network error: Client connection negotiation failed: client connection to 127.17.223.1:40321: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:08:06.309649 19523 consensus_peers.cc:597] T df751f992649444090e27965eb1af85d P e61c3a8f61bb48f8a963c9480e53c168 -> Peer e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321): Couldn't send request to peer e5256d91808b47c195bc9b4dbd7f2b87. Status: Network error: Client connection negotiation failed: client connection to 127.17.223.1:40321: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 13:08:06.313031 19523 consensus_peers.cc:597] T 217b5fae677b4971b3bbd2f357a1f7ff P e61c3a8f61bb48f8a963c9480e53c168 -> Peer e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321): Couldn't send request to peer e5256d91808b47c195bc9b4dbd7f2b87. Status: Network error: Client connection negotiation failed: client connection to 127.17.223.1:40321: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 13:08:06.548532 19523 consensus_peers.cc:597] T 76cb037fc9064d13b59a8969d897ce8c P e61c3a8f61bb48f8a963c9480e53c168 -> Peer e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321): Couldn't send request to peer e5256d91808b47c195bc9b4dbd7f2b87. Status: Network error: Client connection negotiation failed: client connection to 127.17.223.1:40321: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 13:08:06.740761 19523 consensus_peers.cc:597] T b9f0d59553ad444883fcf5b5909f9798 P e61c3a8f61bb48f8a963c9480e53c168 -> Peer e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321): Couldn't send request to peer e5256d91808b47c195bc9b4dbd7f2b87. Status: Network error: Client connection negotiation failed: client connection to 127.17.223.1:40321: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
I20260709 13:08:06.792016 27443 raft_consensus.cc:493] T 0e1085d23e8347fbbd5bce7542f4b1f4 P 127766fc592545a4997f7790f50f6076 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 0473d2b2d01f4459b1e90fd12cc7840e)
I20260709 13:08:06.794431 27443 raft_consensus.cc:515] T 0e1085d23e8347fbbd5bce7542f4b1f4 P 127766fc592545a4997f7790f50f6076 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:08:06.810330 27443 leader_election.cc:290] T 0e1085d23e8347fbbd5bce7542f4b1f4 P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
W20260709 13:08:06.813594 20078 leader_election.cc:336] T 0e1085d23e8347fbbd5bce7542f4b1f4 P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257): Network error: Client connection negotiation failed: client connection to 127.17.223.2:46257: connect: Connection refused (error 111)
I20260709 13:08:06.822768 19556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e1085d23e8347fbbd5bce7542f4b1f4" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
W20260709 13:08:06.834333 20075 consensus_peers.cc:597] T 1f85fc4b527a48848e5faa083b604e36 P 127766fc592545a4997f7790f50f6076 -> Peer e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321): Couldn't send request to peer e5256d91808b47c195bc9b4dbd7f2b87. Status: Network error: Client connection negotiation failed: client connection to 127.17.223.1:40321: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
I20260709 13:08:06.844796 20076 leader_election.cc:304] T 0e1085d23e8347fbbd5bce7542f4b1f4 P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 127766fc592545a4997f7790f50f6076; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e61c3a8f61bb48f8a963c9480e53c168
I20260709 13:08:06.845989 27443 raft_consensus.cc:2749] T 0e1085d23e8347fbbd5bce7542f4b1f4 P 127766fc592545a4997f7790f50f6076 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 13:08:06.862593 19523 consensus_peers.cc:597] T 4af19371ea874c09a0a2147040835cbb P e61c3a8f61bb48f8a963c9480e53c168 -> Peer e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321): Couldn't send request to peer e5256d91808b47c195bc9b4dbd7f2b87. Status: Network error: Client connection negotiation failed: client connection to 127.17.223.1:40321: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
I20260709 13:08:06.875931 27440 raft_consensus.cc:493] T f93ee515a9c14139bf566522ed8232f3 P e61c3a8f61bb48f8a963c9480e53c168 [term 27 FOLLOWER]: Starting pre-election (detected failure of leader 0473d2b2d01f4459b1e90fd12cc7840e)
I20260709 13:08:06.906442 27440 raft_consensus.cc:515] T f93ee515a9c14139bf566522ed8232f3 P e61c3a8f61bb48f8a963c9480e53c168 [term 27 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:08:06.911072 27440 leader_election.cc:290] T f93ee515a9c14139bf566522ed8232f3 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
W20260709 13:08:06.917511 19526 leader_election.cc:336] T f93ee515a9c14139bf566522ed8232f3 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 28 pre-election: RPC error from VoteRequest() call to peer 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257): Network error: Client connection negotiation failed: client connection to 127.17.223.2:46257: connect: Connection refused (error 111)
W20260709 13:08:06.938763 20075 consensus_peers.cc:597] T 2a16f7501e2444fb86d4e2778e734e02 P 127766fc592545a4997f7790f50f6076 -> Peer e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321): Couldn't send request to peer e5256d91808b47c195bc9b4dbd7f2b87. Status: Network error: Client connection negotiation failed: client connection to 127.17.223.1:40321: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
I20260709 13:08:06.944923 27440 raft_consensus.cc:493] T b08304a0a02b42d7840c4e8ee9a6bd1a P e61c3a8f61bb48f8a963c9480e53c168 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 0473d2b2d01f4459b1e90fd12cc7840e)
I20260709 13:08:06.945515 27440 raft_consensus.cc:515] T b08304a0a02b42d7840c4e8ee9a6bd1a P e61c3a8f61bb48f8a963c9480e53c168 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:08:06.970062 27440 leader_election.cc:290] T b08304a0a02b42d7840c4e8ee9a6bd1a P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
W20260709 13:08:06.971782 19526 leader_election.cc:336] T b08304a0a02b42d7840c4e8ee9a6bd1a P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257): Network error: Client connection negotiation failed: client connection to 127.17.223.2:46257: connect: Connection refused (error 111)
W20260709 13:08:06.982177 19523 leader_election.cc:336] T f93ee515a9c14139bf566522ed8232f3 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 28 pre-election: RPC error from VoteRequest() call to peer e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321): Network error: Client connection negotiation failed: client connection to 127.17.223.1:40321: connect: Connection refused (error 111)
I20260709 13:08:06.982923 19523 leader_election.cc:304] T f93ee515a9c14139bf566522ed8232f3 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e61c3a8f61bb48f8a963c9480e53c168; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:08:06.986352 27448 raft_consensus.cc:2749] T f93ee515a9c14139bf566522ed8232f3 P e61c3a8f61bb48f8a963c9480e53c168 [term 27 FOLLOWER]: Leader pre-election lost for term 28. Reason: could not achieve majority
I20260709 13:08:07.000458 27448 raft_consensus.cc:493] T 7f575b143b844aa096b50997dad3516a P e61c3a8f61bb48f8a963c9480e53c168 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 0473d2b2d01f4459b1e90fd12cc7840e)
I20260709 13:08:07.001026 27448 raft_consensus.cc:515] T 7f575b143b844aa096b50997dad3516a P e61c3a8f61bb48f8a963c9480e53c168 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:08:07.005968 27448 leader_election.cc:290] T 7f575b143b844aa096b50997dad3516a P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:08:07.008375 27443 raft_consensus.cc:493] T 775c229504194560ba9589bc2199b089 P 127766fc592545a4997f7790f50f6076 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 0473d2b2d01f4459b1e90fd12cc7840e)
I20260709 13:08:07.008953 27443 raft_consensus.cc:515] T 775c229504194560ba9589bc2199b089 P 127766fc592545a4997f7790f50f6076 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:08:07.011358 27443 leader_election.cc:290] T 775c229504194560ba9589bc2199b089 P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
W20260709 13:08:07.020828 20075 leader_election.cc:336] T 775c229504194560ba9589bc2199b089 P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321): Network error: Client connection negotiation failed: client connection to 127.17.223.1:40321: connect: Connection refused (error 111)
W20260709 13:08:07.024900 20078 leader_election.cc:336] T 775c229504194560ba9589bc2199b089 P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257): Network error: Client connection negotiation failed: client connection to 127.17.223.2:46257: connect: Connection refused (error 111)
I20260709 13:08:07.025345 20078 leader_election.cc:304] T 775c229504194560ba9589bc2199b089 P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 127766fc592545a4997f7790f50f6076; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:08:07.026499 27443 raft_consensus.cc:2749] T 775c229504194560ba9589bc2199b089 P 127766fc592545a4997f7790f50f6076 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 13:08:07.036015 19526 leader_election.cc:336] T 7f575b143b844aa096b50997dad3516a P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257): Network error: Client connection negotiation failed: client connection to 127.17.223.2:46257: connect: Connection refused (error 111)
I20260709 13:08:07.038245 27448 raft_consensus.cc:493] T 179fd671030940b4b4a4e24bcc4aba0a P e61c3a8f61bb48f8a963c9480e53c168 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 0473d2b2d01f4459b1e90fd12cc7840e)
I20260709 13:08:07.038841 27448 raft_consensus.cc:515] T 179fd671030940b4b4a4e24bcc4aba0a P e61c3a8f61bb48f8a963c9480e53c168 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:08:07.042729 27448 leader_election.cc:290] T 179fd671030940b4b4a4e24bcc4aba0a P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
W20260709 13:08:07.046192 19523 leader_election.cc:336] T b08304a0a02b42d7840c4e8ee9a6bd1a P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321): Network error: Client connection negotiation failed: client connection to 127.17.223.1:40321: connect: Connection refused (error 111)
I20260709 13:08:07.046599 19523 leader_election.cc:304] T b08304a0a02b42d7840c4e8ee9a6bd1a P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e61c3a8f61bb48f8a963c9480e53c168; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:08:07.049558 27437 raft_consensus.cc:2749] T b08304a0a02b42d7840c4e8ee9a6bd1a P e61c3a8f61bb48f8a963c9480e53c168 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:08:07.063344 27440 raft_consensus.cc:493] T 2725d2c4cb054f18b0fc8f735c15f6c2 P e61c3a8f61bb48f8a963c9480e53c168 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 0473d2b2d01f4459b1e90fd12cc7840e)
I20260709 13:08:07.064136 27440 raft_consensus.cc:515] T 2725d2c4cb054f18b0fc8f735c15f6c2 P e61c3a8f61bb48f8a963c9480e53c168 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:08:07.094894 27437 raft_consensus.cc:493] T 0e1085d23e8347fbbd5bce7542f4b1f4 P e61c3a8f61bb48f8a963c9480e53c168 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 0473d2b2d01f4459b1e90fd12cc7840e)
I20260709 13:08:07.095504 27437 raft_consensus.cc:515] T 0e1085d23e8347fbbd5bce7542f4b1f4 P e61c3a8f61bb48f8a963c9480e53c168 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:08:07.098119 27437 leader_election.cc:290] T 0e1085d23e8347fbbd5bce7542f4b1f4 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:08:07.066983 27440 leader_election.cc:290] T 2725d2c4cb054f18b0fc8f735c15f6c2 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
W20260709 13:08:07.099704 19526 leader_election.cc:336] T 179fd671030940b4b4a4e24bcc4aba0a P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257): Network error: Client connection negotiation failed: client connection to 127.17.223.2:46257: connect: Connection refused (error 111)
W20260709 13:08:07.102921 19523 leader_election.cc:336] T 7f575b143b844aa096b50997dad3516a P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321): Network error: Client connection negotiation failed: client connection to 127.17.223.1:40321: connect: Connection refused (error 111)
I20260709 13:08:07.103360 19523 leader_election.cc:304] T 7f575b143b844aa096b50997dad3516a P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e61c3a8f61bb48f8a963c9480e53c168; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87
W20260709 13:08:07.104992 19526 leader_election.cc:336] T 2725d2c4cb054f18b0fc8f735c15f6c2 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257): Network error: Client connection negotiation failed: client connection to 127.17.223.2:46257: connect: Connection refused (error 111)
W20260709 13:08:07.105602 19526 leader_election.cc:336] T 0e1085d23e8347fbbd5bce7542f4b1f4 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257): Network error: Client connection negotiation failed: client connection to 127.17.223.2:46257: connect: Connection refused (error 111)
I20260709 13:08:07.108590 27437 raft_consensus.cc:2749] T 7f575b143b844aa096b50997dad3516a P e61c3a8f61bb48f8a963c9480e53c168 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:08:07.127555 27440 raft_consensus.cc:493] T 86a6797bdfe94fa496c050ceae4bd0d9 P e61c3a8f61bb48f8a963c9480e53c168 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 0473d2b2d01f4459b1e90fd12cc7840e)
I20260709 13:08:07.128163 27440 raft_consensus.cc:515] T 86a6797bdfe94fa496c050ceae4bd0d9 P e61c3a8f61bb48f8a963c9480e53c168 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:08:07.130174 27440 leader_election.cc:290] T 86a6797bdfe94fa496c050ceae4bd0d9 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:08:07.134014 20111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e1085d23e8347fbbd5bce7542f4b1f4" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:08:07.134764 20111 raft_consensus.cc:2468] T 0e1085d23e8347fbbd5bce7542f4b1f4 P 127766fc592545a4997f7790f50f6076 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 18.
W20260709 13:08:07.135383 19526 leader_election.cc:336] T 86a6797bdfe94fa496c050ceae4bd0d9 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257): Network error: Client connection negotiation failed: client connection to 127.17.223.2:46257: connect: Connection refused (error 111)
W20260709 13:08:07.142771 19523 leader_election.cc:336] T 179fd671030940b4b4a4e24bcc4aba0a P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321): Network error: Client connection negotiation failed: client connection to 127.17.223.1:40321: connect: Connection refused (error 111)
I20260709 13:08:07.143307 19523 leader_election.cc:304] T 179fd671030940b4b4a4e24bcc4aba0a P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e61c3a8f61bb48f8a963c9480e53c168; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:08:07.144878 27440 raft_consensus.cc:2749] T 179fd671030940b4b4a4e24bcc4aba0a P e61c3a8f61bb48f8a963c9480e53c168 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:08:07.152213 27437 raft_consensus.cc:493] T ed7fdbcb96d14d418db9ca90a792588a P e61c3a8f61bb48f8a963c9480e53c168 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 0473d2b2d01f4459b1e90fd12cc7840e)
I20260709 13:08:07.152719 27437 raft_consensus.cc:515] T ed7fdbcb96d14d418db9ca90a792588a P e61c3a8f61bb48f8a963c9480e53c168 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:08:07.155171 27437 leader_election.cc:290] T ed7fdbcb96d14d418db9ca90a792588a P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:08:07.163347 27440 raft_consensus.cc:493] T 14935b3ddf914369822e4a0547aaa355 P e61c3a8f61bb48f8a963c9480e53c168 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 0473d2b2d01f4459b1e90fd12cc7840e)
I20260709 13:08:07.166261 27440 raft_consensus.cc:515] T 14935b3ddf914369822e4a0547aaa355 P e61c3a8f61bb48f8a963c9480e53c168 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
W20260709 13:08:07.167836 19526 leader_election.cc:336] T ed7fdbcb96d14d418db9ca90a792588a P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257): Network error: Client connection negotiation failed: client connection to 127.17.223.2:46257: connect: Connection refused (error 111)
I20260709 13:08:07.168581 27440 leader_election.cc:290] T 14935b3ddf914369822e4a0547aaa355 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:08:07.169709 27437 raft_consensus.cc:493] T edd7d470b5014c9489be7f41f64355c9 P e61c3a8f61bb48f8a963c9480e53c168 [term 27 FOLLOWER]: Starting pre-election (detected failure of leader 0473d2b2d01f4459b1e90fd12cc7840e)
I20260709 13:08:07.170240 27437 raft_consensus.cc:515] T edd7d470b5014c9489be7f41f64355c9 P e61c3a8f61bb48f8a963c9480e53c168 [term 27 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:08:07.172466 27437 leader_election.cc:290] T edd7d470b5014c9489be7f41f64355c9 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:08:07.173295 19523 leader_election.cc:304] T 0e1085d23e8347fbbd5bce7542f4b1f4 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 127766fc592545a4997f7790f50f6076, e61c3a8f61bb48f8a963c9480e53c168; no voters: 0473d2b2d01f4459b1e90fd12cc7840e
I20260709 13:08:07.178406 27437 raft_consensus.cc:493] T ef32ce6fdd0e40d382c79974f30295c6 P e61c3a8f61bb48f8a963c9480e53c168 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 0473d2b2d01f4459b1e90fd12cc7840e)
I20260709 13:08:07.180049 27437 raft_consensus.cc:515] T ef32ce6fdd0e40d382c79974f30295c6 P e61c3a8f61bb48f8a963c9480e53c168 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
W20260709 13:08:07.181449 19523 leader_election.cc:336] T 2725d2c4cb054f18b0fc8f735c15f6c2 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321): Network error: Client connection negotiation failed: client connection to 127.17.223.1:40321: connect: Connection refused (error 111)
I20260709 13:08:07.182204 19523 leader_election.cc:304] T 2725d2c4cb054f18b0fc8f735c15f6c2 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e61c3a8f61bb48f8a963c9480e53c168; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:08:07.183046 27437 leader_election.cc:290] T ef32ce6fdd0e40d382c79974f30295c6 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:08:07.179979 27450 raft_consensus.cc:2804] T 0e1085d23e8347fbbd5bce7542f4b1f4 P e61c3a8f61bb48f8a963c9480e53c168 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:08:07.186241 27450 raft_consensus.cc:493] T 0e1085d23e8347fbbd5bce7542f4b1f4 P e61c3a8f61bb48f8a963c9480e53c168 [term 18 FOLLOWER]: Starting leader election (detected failure of leader 0473d2b2d01f4459b1e90fd12cc7840e)
I20260709 13:08:07.186609 27450 raft_consensus.cc:3060] T 0e1085d23e8347fbbd5bce7542f4b1f4 P e61c3a8f61bb48f8a963c9480e53c168 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:08:07.189010 20111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed7fdbcb96d14d418db9ca90a792588a" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:08:07.190629 27440 raft_consensus.cc:2749] T 2725d2c4cb054f18b0fc8f735c15f6c2 P e61c3a8f61bb48f8a963c9480e53c168 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:08:07.197724 27440 raft_consensus.cc:493] T 40e1e16737a842ee936002830f36882e P e61c3a8f61bb48f8a963c9480e53c168 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 0473d2b2d01f4459b1e90fd12cc7840e)
I20260709 13:08:07.198241 27440 raft_consensus.cc:515] T 40e1e16737a842ee936002830f36882e P e61c3a8f61bb48f8a963c9480e53c168 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:08:07.200307 20111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14935b3ddf914369822e4a0547aaa355" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:08:07.200659 27440 leader_election.cc:290] T 40e1e16737a842ee936002830f36882e P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
W20260709 13:08:07.201516 19526 leader_election.cc:336] T 14935b3ddf914369822e4a0547aaa355 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257): Network error: Client connection negotiation failed: client connection to 127.17.223.2:46257: connect: Connection refused (error 111)
W20260709 13:08:07.211199 19526 leader_election.cc:336] T edd7d470b5014c9489be7f41f64355c9 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 28 pre-election: RPC error from VoteRequest() call to peer 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257): Network error: Client connection negotiation failed: client connection to 127.17.223.2:46257: connect: Connection refused (error 111)
W20260709 13:08:07.211789 19526 leader_election.cc:336] T ef32ce6fdd0e40d382c79974f30295c6 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257): Network error: Client connection negotiation failed: client connection to 127.17.223.2:46257: connect: Connection refused (error 111)
W20260709 13:08:07.212405 19523 leader_election.cc:336] T 86a6797bdfe94fa496c050ceae4bd0d9 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321): Network error: Client connection negotiation failed: client connection to 127.17.223.1:40321: connect: Connection refused (error 111)
I20260709 13:08:07.213284 27451 raft_consensus.cc:493] T f1b10566f45d4a7d9029858330e02d5b P e61c3a8f61bb48f8a963c9480e53c168 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 0473d2b2d01f4459b1e90fd12cc7840e)
I20260709 13:08:07.213450 27445 raft_consensus.cc:493] T ed7fdbcb96d14d418db9ca90a792588a P 127766fc592545a4997f7790f50f6076 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 0473d2b2d01f4459b1e90fd12cc7840e)
I20260709 13:08:07.213922 27451 raft_consensus.cc:515] T f1b10566f45d4a7d9029858330e02d5b P e61c3a8f61bb48f8a963c9480e53c168 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:08:07.214043 27445 raft_consensus.cc:515] T ed7fdbcb96d14d418db9ca90a792588a P 127766fc592545a4997f7790f50f6076 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:08:07.217057 27451 leader_election.cc:290] T f1b10566f45d4a7d9029858330e02d5b P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:08:07.202055 27450 raft_consensus.cc:515] T 0e1085d23e8347fbbd5bce7542f4b1f4 P e61c3a8f61bb48f8a963c9480e53c168 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:08:07.221340 27450 leader_election.cc:290] T 0e1085d23e8347fbbd5bce7542f4b1f4 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 19 election: Requested vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
W20260709 13:08:07.222365 19526 leader_election.cc:336] T 40e1e16737a842ee936002830f36882e P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257): Network error: Client connection negotiation failed: client connection to 127.17.223.2:46257: connect: Connection refused (error 111)
W20260709 13:08:07.225625 19526 leader_election.cc:336] T f1b10566f45d4a7d9029858330e02d5b P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257): Network error: Client connection negotiation failed: client connection to 127.17.223.2:46257: connect: Connection refused (error 111)
I20260709 13:08:07.226297 27445 leader_election.cc:290] T ed7fdbcb96d14d418db9ca90a792588a P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
W20260709 13:08:07.227116 20078 leader_election.cc:336] T ed7fdbcb96d14d418db9ca90a792588a P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257): Network error: Client connection negotiation failed: client connection to 127.17.223.2:46257: connect: Connection refused (error 111)
I20260709 13:08:07.212915 19523 leader_election.cc:304] T 86a6797bdfe94fa496c050ceae4bd0d9 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e61c3a8f61bb48f8a963c9480e53c168; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:08:07.229386 27450 raft_consensus.cc:2749] T 86a6797bdfe94fa496c050ceae4bd0d9 P e61c3a8f61bb48f8a963c9480e53c168 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:08:07.232048 27445 raft_consensus.cc:493] T 21e14947d70440f19044d8f75c31e1f9 P 127766fc592545a4997f7790f50f6076 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 0473d2b2d01f4459b1e90fd12cc7840e)
I20260709 13:08:07.232573 27445 raft_consensus.cc:515] T 21e14947d70440f19044d8f75c31e1f9 P 127766fc592545a4997f7790f50f6076 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 17 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
W20260709 13:08:07.236320 19526 leader_election.cc:336] T 0e1085d23e8347fbbd5bce7542f4b1f4 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 19 election: RPC error from VoteRequest() call to peer 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257): Network error: Client connection negotiation failed: client connection to 127.17.223.2:46257: connect: Connection refused (error 111)
W20260709 13:08:07.241186 20075 leader_election.cc:336] T 21e14947d70440f19044d8f75c31e1f9 P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321): Network error: Client connection negotiation failed: client connection to 127.17.223.1:40321: connect: Connection refused (error 111)
I20260709 13:08:07.243378 27445 leader_election.cc:290] T 21e14947d70440f19044d8f75c31e1f9 P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:08:07.245752 27443 raft_consensus.cc:493] T fa8650e71aa14778b3d73721fc50d9fc P 127766fc592545a4997f7790f50f6076 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 0473d2b2d01f4459b1e90fd12cc7840e)
I20260709 13:08:07.249732 27443 raft_consensus.cc:515] T fa8650e71aa14778b3d73721fc50d9fc P 127766fc592545a4997f7790f50f6076 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } attrs { replace: true } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:08:07.254755 27443 leader_election.cc:290] T fa8650e71aa14778b3d73721fc50d9fc P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:08:07.255630 27443 raft_consensus.cc:493] T d1e5873a19244c5ebbcd38e126796ee7 P 127766fc592545a4997f7790f50f6076 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 0473d2b2d01f4459b1e90fd12cc7840e)
I20260709 13:08:07.256253 27443 raft_consensus.cc:515] T d1e5873a19244c5ebbcd38e126796ee7 P 127766fc592545a4997f7790f50f6076 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:08:07.258319 27443 leader_election.cc:290] T d1e5873a19244c5ebbcd38e126796ee7 P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:08:07.258785 27451 raft_consensus.cc:493] T ff75a1d4cb1f493db8f71ddc136ba9ab P e61c3a8f61bb48f8a963c9480e53c168 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 0473d2b2d01f4459b1e90fd12cc7840e)
I20260709 13:08:07.260124 27451 raft_consensus.cc:515] T ff75a1d4cb1f493db8f71ddc136ba9ab P e61c3a8f61bb48f8a963c9480e53c168 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:08:07.262112 27451 leader_election.cc:290] T ff75a1d4cb1f493db8f71ddc136ba9ab P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
W20260709 13:08:07.249133 20078 leader_election.cc:336] T 21e14947d70440f19044d8f75c31e1f9 P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257): Network error: Client connection negotiation failed: client connection to 127.17.223.2:46257: connect: Connection refused (error 111)
I20260709 13:08:07.265069 20078 leader_election.cc:304] T 21e14947d70440f19044d8f75c31e1f9 P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 127766fc592545a4997f7790f50f6076; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87
W20260709 13:08:07.266120 19526 leader_election.cc:336] T ff75a1d4cb1f493db8f71ddc136ba9ab P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257): Network error: Client connection negotiation failed: client connection to 127.17.223.2:46257: connect: Connection refused (error 111)
W20260709 13:08:07.266449 20075 leader_election.cc:336] T fa8650e71aa14778b3d73721fc50d9fc P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321): Network error: Client connection negotiation failed: client connection to 127.17.223.1:40321: connect: Connection refused (error 111)
I20260709 13:08:07.266629 27445 raft_consensus.cc:2749] T 21e14947d70440f19044d8f75c31e1f9 P 127766fc592545a4997f7790f50f6076 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
W20260709 13:08:07.267038 20075 leader_election.cc:336] T d1e5873a19244c5ebbcd38e126796ee7 P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321): Network error: Client connection negotiation failed: client connection to 127.17.223.1:40321: connect: Connection refused (error 111)
W20260709 13:08:07.267684 20075 consensus_peers.cc:597] T 9962423cb4e54fcfa5de01daf68a86e7 P 127766fc592545a4997f7790f50f6076 -> Peer e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321): Couldn't send request to peer e5256d91808b47c195bc9b4dbd7f2b87. Status: Network error: Client connection negotiation failed: client connection to 127.17.223.1:40321: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
I20260709 13:08:07.275861 19523 leader_election.cc:304] T ed7fdbcb96d14d418db9ca90a792588a P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e61c3a8f61bb48f8a963c9480e53c168; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, 127766fc592545a4997f7790f50f6076
I20260709 13:08:07.276840 27451 raft_consensus.cc:2749] T ed7fdbcb96d14d418db9ca90a792588a P e61c3a8f61bb48f8a963c9480e53c168 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 13:08:07.277557 20078 leader_election.cc:336] T fa8650e71aa14778b3d73721fc50d9fc P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257): Network error: Client connection negotiation failed: client connection to 127.17.223.2:46257: connect: Connection refused (error 111)
I20260709 13:08:07.277983 20078 leader_election.cc:304] T fa8650e71aa14778b3d73721fc50d9fc P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 127766fc592545a4997f7790f50f6076; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87
W20260709 13:08:07.278638 20078 leader_election.cc:336] T d1e5873a19244c5ebbcd38e126796ee7 P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257): Network error: Client connection negotiation failed: client connection to 127.17.223.2:46257: connect: Connection refused (error 111)
I20260709 13:08:07.278682 27445 raft_consensus.cc:2749] T fa8650e71aa14778b3d73721fc50d9fc P 127766fc592545a4997f7790f50f6076 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:08:07.279127 20078 leader_election.cc:304] T d1e5873a19244c5ebbcd38e126796ee7 P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 127766fc592545a4997f7790f50f6076; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:08:07.279938 27453 raft_consensus.cc:2749] T d1e5873a19244c5ebbcd38e126796ee7 P 127766fc592545a4997f7790f50f6076 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:08:07.281903 19523 leader_election.cc:304] T 14935b3ddf914369822e4a0547aaa355 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e61c3a8f61bb48f8a963c9480e53c168; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, 127766fc592545a4997f7790f50f6076
I20260709 13:08:07.282606 27440 raft_consensus.cc:2749] T 14935b3ddf914369822e4a0547aaa355 P e61c3a8f61bb48f8a963c9480e53c168 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:08:07.286108 20111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e1085d23e8347fbbd5bce7542f4b1f4" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076"
I20260709 13:08:07.286697 20111 raft_consensus.cc:3060] T 0e1085d23e8347fbbd5bce7542f4b1f4 P 127766fc592545a4997f7790f50f6076 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:08:07.291487 27443 raft_consensus.cc:493] T 172b3dd13109415a955b71ac0e9d2234 P 127766fc592545a4997f7790f50f6076 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 0473d2b2d01f4459b1e90fd12cc7840e)
I20260709 13:08:07.292042 27443 raft_consensus.cc:515] T 172b3dd13109415a955b71ac0e9d2234 P 127766fc592545a4997f7790f50f6076 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:08:07.294386 27443 leader_election.cc:290] T 172b3dd13109415a955b71ac0e9d2234 P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
W20260709 13:08:07.296324 19523 leader_election.cc:336] T edd7d470b5014c9489be7f41f64355c9 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 28 pre-election: RPC error from VoteRequest() call to peer e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321): Network error: Client connection negotiation failed: client connection to 127.17.223.1:40321: connect: Connection refused (error 111)
I20260709 13:08:07.297611 19523 leader_election.cc:304] T edd7d470b5014c9489be7f41f64355c9 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e61c3a8f61bb48f8a963c9480e53c168; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:08:07.298942 27440 raft_consensus.cc:2749] T edd7d470b5014c9489be7f41f64355c9 P e61c3a8f61bb48f8a963c9480e53c168 [term 27 FOLLOWER]: Leader pre-election lost for term 28. Reason: could not achieve majority
W20260709 13:08:07.299960 20075 leader_election.cc:336] T 172b3dd13109415a955b71ac0e9d2234 P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321): Network error: Client connection negotiation failed: client connection to 127.17.223.1:40321: connect: Connection refused (error 111)
W20260709 13:08:07.301033 19523 leader_election.cc:336] T ef32ce6fdd0e40d382c79974f30295c6 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321): Network error: Client connection negotiation failed: client connection to 127.17.223.1:40321: connect: Connection refused (error 111)
I20260709 13:08:07.301456 19523 leader_election.cc:304] T ef32ce6fdd0e40d382c79974f30295c6 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e61c3a8f61bb48f8a963c9480e53c168; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:08:07.302081 27440 raft_consensus.cc:2749] T ef32ce6fdd0e40d382c79974f30295c6 P e61c3a8f61bb48f8a963c9480e53c168 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
W20260709 13:08:07.303673 19523 leader_election.cc:336] T 40e1e16737a842ee936002830f36882e P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321): Network error: Client connection negotiation failed: client connection to 127.17.223.1:40321: connect: Connection refused (error 111)
I20260709 13:08:07.304065 19523 leader_election.cc:304] T 40e1e16737a842ee936002830f36882e P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e61c3a8f61bb48f8a963c9480e53c168; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:08:07.304672 27440 raft_consensus.cc:2749] T 40e1e16737a842ee936002830f36882e P e61c3a8f61bb48f8a963c9480e53c168 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:08:07.310386 19556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed7fdbcb96d14d418db9ca90a792588a" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:08:07.310511 20111 raft_consensus.cc:2468] T 0e1085d23e8347fbbd5bce7542f4b1f4 P 127766fc592545a4997f7790f50f6076 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 19.
I20260709 13:08:07.311060 19556 raft_consensus.cc:2468] T ed7fdbcb96d14d418db9ca90a792588a P e61c3a8f61bb48f8a963c9480e53c168 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 127766fc592545a4997f7790f50f6076 in term 18.
I20260709 13:08:07.311673 27443 raft_consensus.cc:493] T 309c3ca0ca4b4f3ba129752ea2cb293b P 127766fc592545a4997f7790f50f6076 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 0473d2b2d01f4459b1e90fd12cc7840e)
I20260709 13:08:07.312338 19555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa8650e71aa14778b3d73721fc50d9fc" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:08:07.320710 27443 raft_consensus.cc:515] T 309c3ca0ca4b4f3ba129752ea2cb293b P 127766fc592545a4997f7790f50f6076 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
W20260709 13:08:07.322307 19523 leader_election.cc:336] T f1b10566f45d4a7d9029858330e02d5b P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321): Network error: Client connection negotiation failed: client connection to 127.17.223.1:40321: connect: Connection refused (error 111)
I20260709 13:08:07.322822 19523 leader_election.cc:304] T f1b10566f45d4a7d9029858330e02d5b P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e61c3a8f61bb48f8a963c9480e53c168; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:08:07.323673 27440 raft_consensus.cc:2749] T f1b10566f45d4a7d9029858330e02d5b P e61c3a8f61bb48f8a963c9480e53c168 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
W20260709 13:08:07.323709 19523 leader_election.cc:336] T ff75a1d4cb1f493db8f71ddc136ba9ab P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321): Network error: Client connection negotiation failed: client connection to 127.17.223.1:40321: connect: Connection refused (error 111)
I20260709 13:08:07.324398 19523 leader_election.cc:304] T ff75a1d4cb1f493db8f71ddc136ba9ab P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e61c3a8f61bb48f8a963c9480e53c168; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:08:07.326184 27440 raft_consensus.cc:2749] T ff75a1d4cb1f493db8f71ddc136ba9ab P e61c3a8f61bb48f8a963c9480e53c168 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:08:07.327260 27443 leader_election.cc:290] T 309c3ca0ca4b4f3ba129752ea2cb293b P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:08:07.328349 20076 leader_election.cc:304] T ed7fdbcb96d14d418db9ca90a792588a P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 127766fc592545a4997f7790f50f6076, e61c3a8f61bb48f8a963c9480e53c168; no voters: 0473d2b2d01f4459b1e90fd12cc7840e
I20260709 13:08:07.329877 27445 raft_consensus.cc:2804] T ed7fdbcb96d14d418db9ca90a792588a P 127766fc592545a4997f7790f50f6076 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:08:07.330231 27445 raft_consensus.cc:493] T ed7fdbcb96d14d418db9ca90a792588a P 127766fc592545a4997f7790f50f6076 [term 18 FOLLOWER]: Starting leader election (detected failure of leader 0473d2b2d01f4459b1e90fd12cc7840e)
I20260709 13:08:07.330545 27445 raft_consensus.cc:3060] T ed7fdbcb96d14d418db9ca90a792588a P 127766fc592545a4997f7790f50f6076 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:08:07.333274 27440 raft_consensus.cc:493] T 1a61655d99124a29b486ba4a5b37faea P e61c3a8f61bb48f8a963c9480e53c168 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 0473d2b2d01f4459b1e90fd12cc7840e)
I20260709 13:08:07.333745 27440 raft_consensus.cc:515] T 1a61655d99124a29b486ba4a5b37faea P e61c3a8f61bb48f8a963c9480e53c168 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
W20260709 13:08:07.334334 20075 leader_election.cc:336] T 309c3ca0ca4b4f3ba129752ea2cb293b P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321): Network error: Client connection negotiation failed: client connection to 127.17.223.1:40321: connect: Connection refused (error 111)
W20260709 13:08:07.340936 19526 leader_election.cc:336] T 1a61655d99124a29b486ba4a5b37faea P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257): Network error: Client connection negotiation failed: client connection to 127.17.223.2:46257: connect: Connection refused (error 111)
W20260709 13:08:07.342939 20078 leader_election.cc:336] T 172b3dd13109415a955b71ac0e9d2234 P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257): Network error: Client connection negotiation failed: client connection to 127.17.223.2:46257: connect: Connection refused (error 111)
I20260709 13:08:07.343417 20078 leader_election.cc:304] T 172b3dd13109415a955b71ac0e9d2234 P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 127766fc592545a4997f7790f50f6076; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:08:07.343657 27440 leader_election.cc:290] T 1a61655d99124a29b486ba4a5b37faea P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
I20260709 13:08:07.344551 27443 raft_consensus.cc:2749] T 172b3dd13109415a955b71ac0e9d2234 P 127766fc592545a4997f7790f50f6076 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:08:07.348179 27445 raft_consensus.cc:515] T ed7fdbcb96d14d418db9ca90a792588a P 127766fc592545a4997f7790f50f6076 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:08:07.360118 19523 leader_election.cc:304] T 0e1085d23e8347fbbd5bce7542f4b1f4 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 127766fc592545a4997f7790f50f6076, e61c3a8f61bb48f8a963c9480e53c168; no voters: 0473d2b2d01f4459b1e90fd12cc7840e
I20260709 13:08:07.360882 27445 leader_election.cc:290] T ed7fdbcb96d14d418db9ca90a792588a P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 19 election: Requested vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:08:07.361406 27440 raft_consensus.cc:2804] T 0e1085d23e8347fbbd5bce7542f4b1f4 P e61c3a8f61bb48f8a963c9480e53c168 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:08:07.362838 27440 raft_consensus.cc:697] T 0e1085d23e8347fbbd5bce7542f4b1f4 P e61c3a8f61bb48f8a963c9480e53c168 [term 19 LEADER]: Becoming Leader. State: Replica: e61c3a8f61bb48f8a963c9480e53c168, State: Running, Role: LEADER
I20260709 13:08:07.364928 27440 consensus_queue.cc:237] T 0e1085d23e8347fbbd5bce7542f4b1f4 P e61c3a8f61bb48f8a963c9480e53c168 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 18.14, Last appended by leader: 14, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:08:07.372175 19556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed7fdbcb96d14d418db9ca90a792588a" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
I20260709 13:08:07.372753 19556 raft_consensus.cc:3060] T ed7fdbcb96d14d418db9ca90a792588a P e61c3a8f61bb48f8a963c9480e53c168 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:08:07.374818 27450 raft_consensus.cc:493] T fa8650e71aa14778b3d73721fc50d9fc P e61c3a8f61bb48f8a963c9480e53c168 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 0473d2b2d01f4459b1e90fd12cc7840e)
I20260709 13:08:07.375489 27450 raft_consensus.cc:515] T fa8650e71aa14778b3d73721fc50d9fc P e61c3a8f61bb48f8a963c9480e53c168 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } attrs { replace: true } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:08:07.378185 27450 leader_election.cc:290] T fa8650e71aa14778b3d73721fc50d9fc P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), 127766fc592545a4997f7790f50f6076 (127.17.223.4:43121)
I20260709 13:08:07.379225 27453 raft_consensus.cc:493] T 14935b3ddf914369822e4a0547aaa355 P 127766fc592545a4997f7790f50f6076 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 0473d2b2d01f4459b1e90fd12cc7840e)
I20260709 13:08:07.379729 27453 raft_consensus.cc:515] T 14935b3ddf914369822e4a0547aaa355 P 127766fc592545a4997f7790f50f6076 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:08:07.382077 27453 leader_election.cc:290] T 14935b3ddf914369822e4a0547aaa355 P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:08:07.383035 19556 raft_consensus.cc:2468] T ed7fdbcb96d14d418db9ca90a792588a P e61c3a8f61bb48f8a963c9480e53c168 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 127766fc592545a4997f7790f50f6076 in term 19.
W20260709 13:08:07.384480 19523 leader_election.cc:336] T 1a61655d99124a29b486ba4a5b37faea P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321): Network error: Client connection negotiation failed: client connection to 127.17.223.1:40321: connect: Connection refused (error 111)
I20260709 13:08:07.385950 19523 leader_election.cc:304] T 1a61655d99124a29b486ba4a5b37faea P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e61c3a8f61bb48f8a963c9480e53c168; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87
W20260709 13:08:07.386971 19523 consensus_peers.cc:597] T fa731b585f684a7fb2d106c50f143b83 P e61c3a8f61bb48f8a963c9480e53c168 -> Peer e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321): Couldn't send request to peer e5256d91808b47c195bc9b4dbd7f2b87. Status: Network error: Client connection negotiation failed: client connection to 127.17.223.1:40321: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
I20260709 13:08:07.387411 27440 raft_consensus.cc:2749] T 1a61655d99124a29b486ba4a5b37faea P e61c3a8f61bb48f8a963c9480e53c168 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:08:07.391225 20076 leader_election.cc:304] T ed7fdbcb96d14d418db9ca90a792588a P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 127766fc592545a4997f7790f50f6076, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:08:07.391979 27445 raft_consensus.cc:2804] T ed7fdbcb96d14d418db9ca90a792588a P 127766fc592545a4997f7790f50f6076 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:08:07.392668 27445 raft_consensus.cc:697] T ed7fdbcb96d14d418db9ca90a792588a P 127766fc592545a4997f7790f50f6076 [term 19 LEADER]: Becoming Leader. State: Replica: 127766fc592545a4997f7790f50f6076, State: Running, Role: LEADER
I20260709 13:08:07.393767 19556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14935b3ddf914369822e4a0547aaa355" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168" is_pre_election: true
I20260709 13:08:07.394357 19556 raft_consensus.cc:2468] T 14935b3ddf914369822e4a0547aaa355 P e61c3a8f61bb48f8a963c9480e53c168 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 127766fc592545a4997f7790f50f6076 in term 15.
I20260709 13:08:07.393491 27445 consensus_queue.cc:237] T ed7fdbcb96d14d418db9ca90a792588a P 127766fc592545a4997f7790f50f6076 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 18.14, Last appended by leader: 14, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:08:07.395162 19301 catalog_manager.cc:5697] T 0e1085d23e8347fbbd5bce7542f4b1f4 P e61c3a8f61bb48f8a963c9480e53c168 reported cstate change: term changed from 18 to 19, leader changed from 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2) to e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3). New cstate: current_term: 19 leader_uuid: "e61c3a8f61bb48f8a963c9480e53c168" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:07.396952 18300 tablet_server.cc:196] TabletServer@127.17.223.2:0 shutdown complete.
I20260709 13:08:07.391568 20111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa8650e71aa14778b3d73721fc50d9fc" candidate_uuid: "e61c3a8f61bb48f8a963c9480e53c168" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "127766fc592545a4997f7790f50f6076" is_pre_election: true
I20260709 13:08:07.399960 20111 raft_consensus.cc:2468] T fa8650e71aa14778b3d73721fc50d9fc P 127766fc592545a4997f7790f50f6076 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e61c3a8f61bb48f8a963c9480e53c168 in term 22.
W20260709 13:08:07.401342 19526 leader_election.cc:336] T fa8650e71aa14778b3d73721fc50d9fc P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257): Network error: Client connection negotiation failed: client connection to 127.17.223.2:46257: connect: Connection refused (error 111)
W20260709 13:08:07.411839 20078 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.2:46257, user_credentials={real_user=slave}} blocked reactor thread for 57965.8us
W20260709 13:08:07.412505 20078 leader_election.cc:336] T 309c3ca0ca4b4f3ba129752ea2cb293b P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257): Network error: Client connection negotiation failed: client connection to 127.17.223.2:46257: connect: Connection refused (error 111)
I20260709 13:08:07.413100 20076 leader_election.cc:304] T 14935b3ddf914369822e4a0547aaa355 P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 127766fc592545a4997f7790f50f6076, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:08:07.413295 20078 leader_election.cc:304] T 309c3ca0ca4b4f3ba129752ea2cb293b P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 127766fc592545a4997f7790f50f6076; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87
W20260709 13:08:07.414247 19523 leader_election.cc:336] T fa8650e71aa14778b3d73721fc50d9fc P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321): Network error: Client connection negotiation failed: client connection to 127.17.223.1:40321: connect: Connection refused (error 111)
I20260709 13:08:07.414933 19523 leader_election.cc:304] T fa8650e71aa14778b3d73721fc50d9fc P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 127766fc592545a4997f7790f50f6076, e61c3a8f61bb48f8a963c9480e53c168; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:08:07.415647 27450 raft_consensus.cc:2749] T fa8650e71aa14778b3d73721fc50d9fc P e61c3a8f61bb48f8a963c9480e53c168 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:08:07.416536 27450 raft_consensus.cc:493] T 2e36a9d6e29c4a7c860cf267efbd4c74 P e61c3a8f61bb48f8a963c9480e53c168 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 0473d2b2d01f4459b1e90fd12cc7840e)
I20260709 13:08:07.414332 27443 raft_consensus.cc:2804] T 14935b3ddf914369822e4a0547aaa355 P 127766fc592545a4997f7790f50f6076 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:08:07.417011 27450 raft_consensus.cc:515] T 2e36a9d6e29c4a7c860cf267efbd4c74 P e61c3a8f61bb48f8a963c9480e53c168 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5256d91808b47c195bc9b4dbd7f2b87" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40321 } } peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } }
I20260709 13:08:07.417665 27443 raft_consensus.cc:493] T 14935b3ddf914369822e4a0547aaa355 P 127766fc592545a4997f7790f50f6076 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 0473d2b2d01f4459b1e90fd12cc7840e)
W20260709 13:08:07.418030 19523 consensus_peers.cc:597] T a08760e15aac4630a629431f56024dc8 P e61c3a8f61bb48f8a963c9480e53c168 -> Peer e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321): Couldn't send request to peer e5256d91808b47c195bc9b4dbd7f2b87. Status: Network error: Client connection negotiation failed: client connection to 127.17.223.1:40321: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
I20260709 13:08:07.418105 27443 raft_consensus.cc:3060] T 14935b3ddf914369822e4a0547aaa355 P 127766fc592545a4997f7790f50f6076 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:08:07.419546 27450 leader_election.cc:290] T 2e36a9d6e29c4a7c860cf267efbd4c74 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321), 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257)
W20260709 13:08:07.425390 19523 leader_election.cc:336] T 2e36a9d6e29c4a7c860cf267efbd4c74 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321): Network error: Client connection negotiation failed: client connection to 127.17.223.1:40321: connect: Connection refused (error 111)
W20260709 13:08:07.425848 19523 consensus_peers.cc:597] T 1dc5b3532fe54f74876d02beffa2c230 P e61c3a8f61bb48f8a963c9480e53c168 -> Peer e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321): Couldn't send request to peer e5256d91808b47c195bc9b4dbd7f2b87. Status: Network error: Client connection negotiation failed: client connection to 127.17.223.1:40321: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
I20260709 13:08:07.431129 27443 raft_consensus.cc:515] T 14935b3ddf914369822e4a0547aaa355 P 127766fc592545a4997f7790f50f6076 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
I20260709 13:08:07.433777 27452 raft_consensus.cc:2749] T 309c3ca0ca4b4f3ba129752ea2cb293b P 127766fc592545a4997f7790f50f6076 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:08:07.437208 27443 leader_election.cc:290] T 14935b3ddf914369822e4a0547aaa355 P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 16 election: Requested vote from peers 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257), e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891)
I20260709 13:08:07.438254 19556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14935b3ddf914369822e4a0547aaa355" candidate_uuid: "127766fc592545a4997f7790f50f6076" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "e61c3a8f61bb48f8a963c9480e53c168"
W20260709 13:08:07.446929 19526 leader_election.cc:336] T 2e36a9d6e29c4a7c860cf267efbd4c74 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257): Network error: Client connection negotiation failed: client connection to 127.17.223.2:46257: connect: Connection refused (error 111)
I20260709 13:08:07.448895 19526 leader_election.cc:304] T 2e36a9d6e29c4a7c860cf267efbd4c74 P e61c3a8f61bb48f8a963c9480e53c168 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e61c3a8f61bb48f8a963c9480e53c168; no voters: 0473d2b2d01f4459b1e90fd12cc7840e, e5256d91808b47c195bc9b4dbd7f2b87
I20260709 13:08:07.448935 19556 raft_consensus.cc:3060] T 14935b3ddf914369822e4a0547aaa355 P e61c3a8f61bb48f8a963c9480e53c168 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:08:07.449746 27450 raft_consensus.cc:2749] T 2e36a9d6e29c4a7c860cf267efbd4c74 P e61c3a8f61bb48f8a963c9480e53c168 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:08:07.460574 19556 raft_consensus.cc:2468] T 14935b3ddf914369822e4a0547aaa355 P e61c3a8f61bb48f8a963c9480e53c168 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 127766fc592545a4997f7790f50f6076 in term 16.
W20260709 13:08:07.461921 20078 leader_election.cc:336] T ed7fdbcb96d14d418db9ca90a792588a P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 19 election: RPC error from VoteRequest() call to peer 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257): Network error: Client connection negotiation failed: client connection to 127.17.223.2:46257: connect: Connection refused (error 111)
I20260709 13:08:07.463269 20076 leader_election.cc:304] T 14935b3ddf914369822e4a0547aaa355 P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 127766fc592545a4997f7790f50f6076, e61c3a8f61bb48f8a963c9480e53c168; no voters: 
I20260709 13:08:07.464618 27453 raft_consensus.cc:2804] T 14935b3ddf914369822e4a0547aaa355 P 127766fc592545a4997f7790f50f6076 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:08:07.465302 27453 raft_consensus.cc:697] T 14935b3ddf914369822e4a0547aaa355 P 127766fc592545a4997f7790f50f6076 [term 16 LEADER]: Becoming Leader. State: Replica: 127766fc592545a4997f7790f50f6076, State: Running, Role: LEADER
I20260709 13:08:07.467386 27453 consensus_queue.cc:237] T 14935b3ddf914369822e4a0547aaa355 P 127766fc592545a4997f7790f50f6076 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.11, Last appended by leader: 11, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } }
W20260709 13:08:07.489104 20078 leader_election.cc:336] T 14935b3ddf914369822e4a0547aaa355 P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257): Network error: Client connection negotiation failed: client connection to 127.17.223.2:46257: connect: Connection refused (error 111)
W20260709 13:08:07.489903 20078 leader_election.cc:336] T 14935b3ddf914369822e4a0547aaa355 P 127766fc592545a4997f7790f50f6076 [CANDIDATE]: Term 16 election: RPC error from VoteRequest() call to peer 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257): Network error: Client connection negotiation failed: client connection to 127.17.223.2:46257: connect: Connection refused (error 111)
I20260709 13:08:07.493153 19305 catalog_manager.cc:5697] T ed7fdbcb96d14d418db9ca90a792588a P 127766fc592545a4997f7790f50f6076 reported cstate change: term changed from 18 to 19, leader changed from 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2) to 127766fc592545a4997f7790f50f6076 (127.17.223.4). New cstate: current_term: 19 leader_uuid: "127766fc592545a4997f7790f50f6076" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:08:07.497630 20075 consensus_peers.cc:597] T 833a2f0775ed407a94b8924ce50adb63 P 127766fc592545a4997f7790f50f6076 -> Peer e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321): Couldn't send request to peer e5256d91808b47c195bc9b4dbd7f2b87. Status: Network error: Client connection negotiation failed: client connection to 127.17.223.1:40321: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 13:08:07.501549 20075 consensus_peers.cc:597] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P 127766fc592545a4997f7790f50f6076 -> Peer e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321): Couldn't send request to peer e5256d91808b47c195bc9b4dbd7f2b87. Status: Network error: Client connection negotiation failed: client connection to 127.17.223.1:40321: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 13:08:07.531913 20075 consensus_peers.cc:597] T 70797e5783b5454ab0d0eea663e791e3 P 127766fc592545a4997f7790f50f6076 -> Peer e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321): Couldn't send request to peer e5256d91808b47c195bc9b4dbd7f2b87. Status: Network error: Client connection negotiation failed: client connection to 127.17.223.1:40321: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
I20260709 13:08:07.600283 19305 catalog_manager.cc:5697] T 14935b3ddf914369822e4a0547aaa355 P 127766fc592545a4997f7790f50f6076 reported cstate change: term changed from 15 to 16, leader changed from 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2) to 127766fc592545a4997f7790f50f6076 (127.17.223.4). New cstate: current_term: 16 leader_uuid: "127766fc592545a4997f7790f50f6076" committed_config { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "0473d2b2d01f4459b1e90fd12cc7840e" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 46257 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e61c3a8f61bb48f8a963c9480e53c168" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 36891 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "127766fc592545a4997f7790f50f6076" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 43121 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:08:07.610306 18300 tablet_server.cc:179] TabletServer@127.17.223.3:0 shutting down...
W20260709 13:08:07.614850 19523 consensus_peers.cc:597] T 0cdf56e38bbc453d9438d359e5a69955 P e61c3a8f61bb48f8a963c9480e53c168 -> Peer e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321): Couldn't send request to peer e5256d91808b47c195bc9b4dbd7f2b87. Status: Network error: Client connection negotiation failed: client connection to 127.17.223.1:40321: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
I20260709 13:08:07.678776 18300 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:08:07.679931 18300 tablet_replica.cc:333] T 2b74109013a140ada21feeef92d6f563 P e61c3a8f61bb48f8a963c9480e53c168: stopping tablet replica
I20260709 13:08:07.680974 18300 raft_consensus.cc:2243] T 2b74109013a140ada21feeef92d6f563 P e61c3a8f61bb48f8a963c9480e53c168 [term 19 LEADER]: Raft consensus shutting down.
I20260709 13:08:07.681969 18300 raft_consensus.cc:2272] T 2b74109013a140ada21feeef92d6f563 P e61c3a8f61bb48f8a963c9480e53c168 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:07.684329 18300 tablet_replica.cc:333] T fa731b585f684a7fb2d106c50f143b83 P e61c3a8f61bb48f8a963c9480e53c168: stopping tablet replica
I20260709 13:08:07.684929 18300 raft_consensus.cc:2243] T fa731b585f684a7fb2d106c50f143b83 P e61c3a8f61bb48f8a963c9480e53c168 [term 17 LEADER]: Raft consensus shutting down.
I20260709 13:08:07.685781 18300 raft_consensus.cc:2272] T fa731b585f684a7fb2d106c50f143b83 P e61c3a8f61bb48f8a963c9480e53c168 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:07.688309 18300 tablet_replica.cc:333] T 48824d5acfbc485ebf8c2d944e7202de P e61c3a8f61bb48f8a963c9480e53c168: stopping tablet replica
I20260709 13:08:07.689033 18300 raft_consensus.cc:2243] T 48824d5acfbc485ebf8c2d944e7202de P e61c3a8f61bb48f8a963c9480e53c168 [term 21 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:07.689779 18300 raft_consensus.cc:2272] T 48824d5acfbc485ebf8c2d944e7202de P e61c3a8f61bb48f8a963c9480e53c168 [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:07.694234 18300 tablet_replica.cc:333] T 833a2f0775ed407a94b8924ce50adb63 P e61c3a8f61bb48f8a963c9480e53c168: stopping tablet replica
W20260709 13:08:07.695492 19523 consensus_peers.cc:597] T 46c5bfeecc314717bffe987e6844b6d0 P e61c3a8f61bb48f8a963c9480e53c168 -> Peer e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321): Couldn't send request to peer e5256d91808b47c195bc9b4dbd7f2b87. Status: Network error: Client connection negotiation failed: client connection to 127.17.223.1:40321: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
I20260709 13:08:07.695904 18300 raft_consensus.cc:2243] T 833a2f0775ed407a94b8924ce50adb63 P e61c3a8f61bb48f8a963c9480e53c168 [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:07.696434 18300 raft_consensus.cc:2272] T 833a2f0775ed407a94b8924ce50adb63 P e61c3a8f61bb48f8a963c9480e53c168 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:07.698483 18300 tablet_replica.cc:333] T e381f1d6b8184797ad142de49be225a8 P e61c3a8f61bb48f8a963c9480e53c168: stopping tablet replica
I20260709 13:08:07.699069 18300 raft_consensus.cc:2243] T e381f1d6b8184797ad142de49be225a8 P e61c3a8f61bb48f8a963c9480e53c168 [term 21 LEADER]: Raft consensus shutting down.
I20260709 13:08:07.700321 18300 raft_consensus.cc:2272] T e381f1d6b8184797ad142de49be225a8 P e61c3a8f61bb48f8a963c9480e53c168 [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:07.703382 18300 tablet_replica.cc:333] T 76cb037fc9064d13b59a8969d897ce8c P e61c3a8f61bb48f8a963c9480e53c168: stopping tablet replica
I20260709 13:08:07.704213 18300 raft_consensus.cc:2243] T 76cb037fc9064d13b59a8969d897ce8c P e61c3a8f61bb48f8a963c9480e53c168 [term 22 LEADER]: Raft consensus shutting down.
I20260709 13:08:07.706113 18300 raft_consensus.cc:2272] T 76cb037fc9064d13b59a8969d897ce8c P e61c3a8f61bb48f8a963c9480e53c168 [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:07.710825 18300 tablet_replica.cc:333] T 28af091831594f9d8e96482078cc7625 P e61c3a8f61bb48f8a963c9480e53c168: stopping tablet replica
I20260709 13:08:07.711589 18300 raft_consensus.cc:2243] T 28af091831594f9d8e96482078cc7625 P e61c3a8f61bb48f8a963c9480e53c168 [term 21 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:07.712163 18300 raft_consensus.cc:2272] T 28af091831594f9d8e96482078cc7625 P e61c3a8f61bb48f8a963c9480e53c168 [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:07.719774 18300 tablet_replica.cc:333] T 1dc5b3532fe54f74876d02beffa2c230 P e61c3a8f61bb48f8a963c9480e53c168: stopping tablet replica
I20260709 13:08:07.720656 18300 raft_consensus.cc:2243] T 1dc5b3532fe54f74876d02beffa2c230 P e61c3a8f61bb48f8a963c9480e53c168 [term 24 LEADER]: Raft consensus shutting down.
I20260709 13:08:07.722710 18300 raft_consensus.cc:2272] T 1dc5b3532fe54f74876d02beffa2c230 P e61c3a8f61bb48f8a963c9480e53c168 [term 24 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:07.725313 18300 tablet_replica.cc:333] T ece3db938bc649d4a40a51522ed5259c P e61c3a8f61bb48f8a963c9480e53c168: stopping tablet replica
I20260709 13:08:07.726258 18300 raft_consensus.cc:2243] T ece3db938bc649d4a40a51522ed5259c P e61c3a8f61bb48f8a963c9480e53c168 [term 16 LEADER]: Raft consensus shutting down.
I20260709 13:08:07.728555 18300 raft_consensus.cc:2272] T ece3db938bc649d4a40a51522ed5259c P e61c3a8f61bb48f8a963c9480e53c168 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:07.731166 18300 tablet_replica.cc:333] T 4509b76741dc428e9201c70c1658da13 P e61c3a8f61bb48f8a963c9480e53c168: stopping tablet replica
I20260709 13:08:07.731962 18300 raft_consensus.cc:2243] T 4509b76741dc428e9201c70c1658da13 P e61c3a8f61bb48f8a963c9480e53c168 [term 16 LEADER]: Raft consensus shutting down.
I20260709 13:08:07.733873 18300 raft_consensus.cc:2272] T 4509b76741dc428e9201c70c1658da13 P e61c3a8f61bb48f8a963c9480e53c168 [term 16 FOLLOWER]: Raft consensus is shut down!
W20260709 13:08:07.736261 20076 consensus_peers.cc:597] T 1efebf73c86e432baa55533136b6e12c P 127766fc592545a4997f7790f50f6076 -> Peer e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891): Couldn't send request to peer e61c3a8f61bb48f8a963c9480e53c168. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:08:07.743036 18300 tablet_replica.cc:333] T 179fd671030940b4b4a4e24bcc4aba0a P e61c3a8f61bb48f8a963c9480e53c168: stopping tablet replica
I20260709 13:08:07.743966 18300 raft_consensus.cc:2243] T 179fd671030940b4b4a4e24bcc4aba0a P e61c3a8f61bb48f8a963c9480e53c168 [term 23 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:07.744752 18300 raft_consensus.cc:2272] T 179fd671030940b4b4a4e24bcc4aba0a P e61c3a8f61bb48f8a963c9480e53c168 [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:07.747454 18300 tablet_replica.cc:333] T ab43d85f64114d4ebf618930e43d9ed0 P e61c3a8f61bb48f8a963c9480e53c168: stopping tablet replica
W20260709 13:08:07.747579 20076 consensus_peers.cc:597] T 833a2f0775ed407a94b8924ce50adb63 P 127766fc592545a4997f7790f50f6076 -> Peer e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891): Couldn't send request to peer e61c3a8f61bb48f8a963c9480e53c168. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:08:07.748243 18300 raft_consensus.cc:2243] T ab43d85f64114d4ebf618930e43d9ed0 P e61c3a8f61bb48f8a963c9480e53c168 [term 23 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:07.749087 18300 raft_consensus.cc:2272] T ab43d85f64114d4ebf618930e43d9ed0 P e61c3a8f61bb48f8a963c9480e53c168 [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:07.751139 18300 tablet_replica.cc:333] T 0e1085d23e8347fbbd5bce7542f4b1f4 P e61c3a8f61bb48f8a963c9480e53c168: stopping tablet replica
I20260709 13:08:07.751696 18300 raft_consensus.cc:2243] T 0e1085d23e8347fbbd5bce7542f4b1f4 P e61c3a8f61bb48f8a963c9480e53c168 [term 19 LEADER]: Raft consensus shutting down.
I20260709 13:08:07.752372 18300 pending_rounds.cc:70] T 0e1085d23e8347fbbd5bce7542f4b1f4 P e61c3a8f61bb48f8a963c9480e53c168: Trying to abort 1 pending ops.
I20260709 13:08:07.752602 18300 pending_rounds.cc:77] T 0e1085d23e8347fbbd5bce7542f4b1f4 P e61c3a8f61bb48f8a963c9480e53c168: Aborting op as it isn't in flight: id { term: 19 index: 15 } timestamp: 7305635788255633408 op_type: NO_OP noop_request { }
I20260709 13:08:07.752954 18300 raft_consensus.cc:2889] T 0e1085d23e8347fbbd5bce7542f4b1f4 P e61c3a8f61bb48f8a963c9480e53c168 [term 19 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260709 13:08:07.753227 18300 raft_consensus.cc:2272] T 0e1085d23e8347fbbd5bce7542f4b1f4 P e61c3a8f61bb48f8a963c9480e53c168 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:07.756094 18300 tablet_replica.cc:333] T 2725d2c4cb054f18b0fc8f735c15f6c2 P e61c3a8f61bb48f8a963c9480e53c168: stopping tablet replica
I20260709 13:08:07.756842 18300 raft_consensus.cc:2243] T 2725d2c4cb054f18b0fc8f735c15f6c2 P e61c3a8f61bb48f8a963c9480e53c168 [term 23 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:07.757472 18300 raft_consensus.cc:2272] T 2725d2c4cb054f18b0fc8f735c15f6c2 P e61c3a8f61bb48f8a963c9480e53c168 [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:07.760108 18300 tablet_replica.cc:333] T 6c5eebf646ad445a9d1b1adc319d7b16 P e61c3a8f61bb48f8a963c9480e53c168: stopping tablet replica
I20260709 13:08:07.760823 18300 raft_consensus.cc:2243] T 6c5eebf646ad445a9d1b1adc319d7b16 P e61c3a8f61bb48f8a963c9480e53c168 [term 20 LEADER]: Raft consensus shutting down.
I20260709 13:08:07.761770 18300 raft_consensus.cc:2272] T 6c5eebf646ad445a9d1b1adc319d7b16 P e61c3a8f61bb48f8a963c9480e53c168 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:07.764214 18300 tablet_replica.cc:333] T f93ee515a9c14139bf566522ed8232f3 P e61c3a8f61bb48f8a963c9480e53c168: stopping tablet replica
I20260709 13:08:07.764952 18300 raft_consensus.cc:2243] T f93ee515a9c14139bf566522ed8232f3 P e61c3a8f61bb48f8a963c9480e53c168 [term 27 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:07.765564 18300 raft_consensus.cc:2272] T f93ee515a9c14139bf566522ed8232f3 P e61c3a8f61bb48f8a963c9480e53c168 [term 27 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:07.767896 18300 tablet_replica.cc:333] T 7f575b143b844aa096b50997dad3516a P e61c3a8f61bb48f8a963c9480e53c168: stopping tablet replica
I20260709 13:08:07.768777 18300 raft_consensus.cc:2243] T 7f575b143b844aa096b50997dad3516a P e61c3a8f61bb48f8a963c9480e53c168 [term 21 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:07.769721 18300 raft_consensus.cc:2272] T 7f575b143b844aa096b50997dad3516a P e61c3a8f61bb48f8a963c9480e53c168 [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:07.773315 18300 tablet_replica.cc:333] T bc225c93219c45538b53a1bd3d387e4d P e61c3a8f61bb48f8a963c9480e53c168: stopping tablet replica
I20260709 13:08:07.774096 18300 raft_consensus.cc:2243] T bc225c93219c45538b53a1bd3d387e4d P e61c3a8f61bb48f8a963c9480e53c168 [term 18 LEADER]: Raft consensus shutting down.
I20260709 13:08:07.775206 18300 raft_consensus.cc:2272] T bc225c93219c45538b53a1bd3d387e4d P e61c3a8f61bb48f8a963c9480e53c168 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:07.778326 18300 tablet_replica.cc:333] T 62c6c134d3d24a1ab144dd9ee6bc3f64 P e61c3a8f61bb48f8a963c9480e53c168: stopping tablet replica
I20260709 13:08:07.779042 18300 raft_consensus.cc:2243] T 62c6c134d3d24a1ab144dd9ee6bc3f64 P e61c3a8f61bb48f8a963c9480e53c168 [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:07.779542 18300 raft_consensus.cc:2272] T 62c6c134d3d24a1ab144dd9ee6bc3f64 P e61c3a8f61bb48f8a963c9480e53c168 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:07.781677 18300 tablet_replica.cc:333] T df751f992649444090e27965eb1af85d P e61c3a8f61bb48f8a963c9480e53c168: stopping tablet replica
I20260709 13:08:07.782213 18300 raft_consensus.cc:2243] T df751f992649444090e27965eb1af85d P e61c3a8f61bb48f8a963c9480e53c168 [term 25 LEADER]: Raft consensus shutting down.
I20260709 13:08:07.783190 18300 raft_consensus.cc:2272] T df751f992649444090e27965eb1af85d P e61c3a8f61bb48f8a963c9480e53c168 [term 25 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:07.785120 18300 tablet_replica.cc:333] T 3e1f505cb0f1427bbd698ac889d80821 P e61c3a8f61bb48f8a963c9480e53c168: stopping tablet replica
I20260709 13:08:07.785832 18300 raft_consensus.cc:2243] T 3e1f505cb0f1427bbd698ac889d80821 P e61c3a8f61bb48f8a963c9480e53c168 [term 19 LEADER]: Raft consensus shutting down.
I20260709 13:08:07.786741 18300 raft_consensus.cc:2272] T 3e1f505cb0f1427bbd698ac889d80821 P e61c3a8f61bb48f8a963c9480e53c168 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:07.788499 18300 tablet_replica.cc:333] T 65d8cb8d6ec64f459d5a47cefab10acf P e61c3a8f61bb48f8a963c9480e53c168: stopping tablet replica
I20260709 13:08:07.789151 18300 raft_consensus.cc:2243] T 65d8cb8d6ec64f459d5a47cefab10acf P e61c3a8f61bb48f8a963c9480e53c168 [term 22 LEADER]: Raft consensus shutting down.
I20260709 13:08:07.790328 18300 raft_consensus.cc:2272] T 65d8cb8d6ec64f459d5a47cefab10acf P e61c3a8f61bb48f8a963c9480e53c168 [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:07.792728 18300 tablet_replica.cc:333] T ef32ce6fdd0e40d382c79974f30295c6 P e61c3a8f61bb48f8a963c9480e53c168: stopping tablet replica
I20260709 13:08:07.793510 18300 raft_consensus.cc:2243] T ef32ce6fdd0e40d382c79974f30295c6 P e61c3a8f61bb48f8a963c9480e53c168 [term 24 FOLLOWER]: Raft consensus shutting down.
W20260709 13:08:07.793705 20076 consensus_peers.cc:597] T 70797e5783b5454ab0d0eea663e791e3 P 127766fc592545a4997f7790f50f6076 -> Peer e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891): Couldn't send request to peer e61c3a8f61bb48f8a963c9480e53c168. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:08:07.794085 18300 raft_consensus.cc:2272] T ef32ce6fdd0e40d382c79974f30295c6 P e61c3a8f61bb48f8a963c9480e53c168 [term 24 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:07.796370 18300 tablet_replica.cc:333] T b08304a0a02b42d7840c4e8ee9a6bd1a P e61c3a8f61bb48f8a963c9480e53c168: stopping tablet replica
I20260709 13:08:07.797154 18300 raft_consensus.cc:2243] T b08304a0a02b42d7840c4e8ee9a6bd1a P e61c3a8f61bb48f8a963c9480e53c168 [term 23 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:07.797880 18300 raft_consensus.cc:2272] T b08304a0a02b42d7840c4e8ee9a6bd1a P e61c3a8f61bb48f8a963c9480e53c168 [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:07.801395 18300 tablet_replica.cc:333] T ff75a1d4cb1f493db8f71ddc136ba9ab P e61c3a8f61bb48f8a963c9480e53c168: stopping tablet replica
I20260709 13:08:07.802167 18300 raft_consensus.cc:2243] T ff75a1d4cb1f493db8f71ddc136ba9ab P e61c3a8f61bb48f8a963c9480e53c168 [term 21 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:07.802793 18300 raft_consensus.cc:2272] T ff75a1d4cb1f493db8f71ddc136ba9ab P e61c3a8f61bb48f8a963c9480e53c168 [term 21 FOLLOWER]: Raft consensus is shut down!
W20260709 13:08:07.805825 19526 consensus_peers.cc:597] T a08760e15aac4630a629431f56024dc8 P e61c3a8f61bb48f8a963c9480e53c168 -> Peer 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257): Couldn't send request to peer 0473d2b2d01f4459b1e90fd12cc7840e. Status: Network error: Client connection negotiation failed: client connection to 127.17.223.2:46257: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:08:07.806131 18300 tablet_replica.cc:333] T 0cdf56e38bbc453d9438d359e5a69955 P e61c3a8f61bb48f8a963c9480e53c168: stopping tablet replica
I20260709 13:08:07.806921 18300 raft_consensus.cc:2243] T 0cdf56e38bbc453d9438d359e5a69955 P e61c3a8f61bb48f8a963c9480e53c168 [term 23 LEADER]: Raft consensus shutting down.
I20260709 13:08:07.807901 18300 raft_consensus.cc:2272] T 0cdf56e38bbc453d9438d359e5a69955 P e61c3a8f61bb48f8a963c9480e53c168 [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:07.809732 18300 tablet_replica.cc:333] T 96efeaaf1057492490e9a621f37e1a2d P e61c3a8f61bb48f8a963c9480e53c168: stopping tablet replica
I20260709 13:08:07.810266 18300 raft_consensus.cc:2243] T 96efeaaf1057492490e9a621f37e1a2d P e61c3a8f61bb48f8a963c9480e53c168 [term 22 LEADER]: Raft consensus shutting down.
I20260709 13:08:07.811144 18300 raft_consensus.cc:2272] T 96efeaaf1057492490e9a621f37e1a2d P e61c3a8f61bb48f8a963c9480e53c168 [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:07.813011 18300 tablet_replica.cc:333] T 85c494af21f9457a85da47b9bc70c1fd P e61c3a8f61bb48f8a963c9480e53c168: stopping tablet replica
I20260709 13:08:07.813620 18300 raft_consensus.cc:2243] T 85c494af21f9457a85da47b9bc70c1fd P e61c3a8f61bb48f8a963c9480e53c168 [term 22 LEADER]: Raft consensus shutting down.
I20260709 13:08:07.814433 18300 raft_consensus.cc:2272] T 85c494af21f9457a85da47b9bc70c1fd P e61c3a8f61bb48f8a963c9480e53c168 [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:07.816967 18300 tablet_replica.cc:333] T 22196caba61445d3bec98a0aab3c337d P e61c3a8f61bb48f8a963c9480e53c168: stopping tablet replica
I20260709 13:08:07.817721 18300 raft_consensus.cc:2243] T 22196caba61445d3bec98a0aab3c337d P e61c3a8f61bb48f8a963c9480e53c168 [term 21 LEADER]: Raft consensus shutting down.
I20260709 13:08:07.818790 18300 raft_consensus.cc:2272] T 22196caba61445d3bec98a0aab3c337d P e61c3a8f61bb48f8a963c9480e53c168 [term 21 FOLLOWER]: Raft consensus is shut down!
W20260709 13:08:07.820415 20076 consensus_peers.cc:597] T ed7fdbcb96d14d418db9ca90a792588a P 127766fc592545a4997f7790f50f6076 -> Peer e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891): Couldn't send request to peer e61c3a8f61bb48f8a963c9480e53c168. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:08:07.821342 18300 tablet_replica.cc:333] T 0afb57ae58a24a01850491d69f0213dd P e61c3a8f61bb48f8a963c9480e53c168: stopping tablet replica
I20260709 13:08:07.822149 18300 raft_consensus.cc:2243] T 0afb57ae58a24a01850491d69f0213dd P e61c3a8f61bb48f8a963c9480e53c168 [term 13 LEADER]: Raft consensus shutting down.
I20260709 13:08:07.823233 18300 raft_consensus.cc:2272] T 0afb57ae58a24a01850491d69f0213dd P e61c3a8f61bb48f8a963c9480e53c168 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:07.825917 18300 tablet_replica.cc:333] T 1a61655d99124a29b486ba4a5b37faea P e61c3a8f61bb48f8a963c9480e53c168: stopping tablet replica
I20260709 13:08:07.826625 18300 raft_consensus.cc:2243] T 1a61655d99124a29b486ba4a5b37faea P e61c3a8f61bb48f8a963c9480e53c168 [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:07.827330 18300 raft_consensus.cc:2272] T 1a61655d99124a29b486ba4a5b37faea P e61c3a8f61bb48f8a963c9480e53c168 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:07.829959 18300 tablet_replica.cc:333] T 4af19371ea874c09a0a2147040835cbb P e61c3a8f61bb48f8a963c9480e53c168: stopping tablet replica
I20260709 13:08:07.830725 18300 raft_consensus.cc:2243] T 4af19371ea874c09a0a2147040835cbb P e61c3a8f61bb48f8a963c9480e53c168 [term 15 LEADER]: Raft consensus shutting down.
I20260709 13:08:07.831868 18300 raft_consensus.cc:2272] T 4af19371ea874c09a0a2147040835cbb P e61c3a8f61bb48f8a963c9480e53c168 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:07.834332 18300 tablet_replica.cc:333] T 86a6797bdfe94fa496c050ceae4bd0d9 P e61c3a8f61bb48f8a963c9480e53c168: stopping tablet replica
I20260709 13:08:07.835070 18300 raft_consensus.cc:2243] T 86a6797bdfe94fa496c050ceae4bd0d9 P e61c3a8f61bb48f8a963c9480e53c168 [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:07.835657 18300 raft_consensus.cc:2272] T 86a6797bdfe94fa496c050ceae4bd0d9 P e61c3a8f61bb48f8a963c9480e53c168 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:07.838325 18300 tablet_replica.cc:333] T 2a16f7501e2444fb86d4e2778e734e02 P e61c3a8f61bb48f8a963c9480e53c168: stopping tablet replica
I20260709 13:08:07.839097 18300 raft_consensus.cc:2243] T 2a16f7501e2444fb86d4e2778e734e02 P e61c3a8f61bb48f8a963c9480e53c168 [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:07.839764 18300 raft_consensus.cc:2272] T 2a16f7501e2444fb86d4e2778e734e02 P e61c3a8f61bb48f8a963c9480e53c168 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:07.842213 18300 tablet_replica.cc:333] T 7be9efa6559648dbb5a0f7684c4542d1 P e61c3a8f61bb48f8a963c9480e53c168: stopping tablet replica
I20260709 13:08:07.842955 18300 raft_consensus.cc:2243] T 7be9efa6559648dbb5a0f7684c4542d1 P e61c3a8f61bb48f8a963c9480e53c168 [term 24 LEADER]: Raft consensus shutting down.
I20260709 13:08:07.843963 18300 raft_consensus.cc:2272] T 7be9efa6559648dbb5a0f7684c4542d1 P e61c3a8f61bb48f8a963c9480e53c168 [term 24 FOLLOWER]: Raft consensus is shut down!
W20260709 13:08:07.844278 20076 consensus_peers.cc:597] T 28af091831594f9d8e96482078cc7625 P 127766fc592545a4997f7790f50f6076 -> Peer e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891): Couldn't send request to peer e61c3a8f61bb48f8a963c9480e53c168. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:08:07.845273 20076 consensus_peers.cc:597] T 48824d5acfbc485ebf8c2d944e7202de P 127766fc592545a4997f7790f50f6076 -> Peer e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891): Couldn't send request to peer e61c3a8f61bb48f8a963c9480e53c168. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:08:07.846415 18300 tablet_replica.cc:333] T 40e1e16737a842ee936002830f36882e P e61c3a8f61bb48f8a963c9480e53c168: stopping tablet replica
I20260709 13:08:07.847157 18300 raft_consensus.cc:2243] T 40e1e16737a842ee936002830f36882e P e61c3a8f61bb48f8a963c9480e53c168 [term 24 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:07.847738 18300 raft_consensus.cc:2272] T 40e1e16737a842ee936002830f36882e P e61c3a8f61bb48f8a963c9480e53c168 [term 24 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:07.849732 18300 tablet_replica.cc:333] T b9f0d59553ad444883fcf5b5909f9798 P e61c3a8f61bb48f8a963c9480e53c168: stopping tablet replica
I20260709 13:08:07.850281 18300 raft_consensus.cc:2243] T b9f0d59553ad444883fcf5b5909f9798 P e61c3a8f61bb48f8a963c9480e53c168 [term 16 LEADER]: Raft consensus shutting down.
I20260709 13:08:07.851349 18300 raft_consensus.cc:2272] T b9f0d59553ad444883fcf5b5909f9798 P e61c3a8f61bb48f8a963c9480e53c168 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:07.853149 18300 tablet_replica.cc:333] T fa8650e71aa14778b3d73721fc50d9fc P e61c3a8f61bb48f8a963c9480e53c168: stopping tablet replica
I20260709 13:08:07.853653 18300 raft_consensus.cc:2243] T fa8650e71aa14778b3d73721fc50d9fc P e61c3a8f61bb48f8a963c9480e53c168 [term 22 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:07.854246 18300 raft_consensus.cc:2272] T fa8650e71aa14778b3d73721fc50d9fc P e61c3a8f61bb48f8a963c9480e53c168 [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:07.856004 18300 tablet_replica.cc:333] T 14935b3ddf914369822e4a0547aaa355 P e61c3a8f61bb48f8a963c9480e53c168: stopping tablet replica
I20260709 13:08:07.856508 18300 raft_consensus.cc:2243] T 14935b3ddf914369822e4a0547aaa355 P e61c3a8f61bb48f8a963c9480e53c168 [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:07.857297 18300 raft_consensus.cc:2272] T 14935b3ddf914369822e4a0547aaa355 P e61c3a8f61bb48f8a963c9480e53c168 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:07.859275 18300 tablet_replica.cc:333] T 2e36a9d6e29c4a7c860cf267efbd4c74 P e61c3a8f61bb48f8a963c9480e53c168: stopping tablet replica
I20260709 13:08:07.859968 18300 raft_consensus.cc:2243] T 2e36a9d6e29c4a7c860cf267efbd4c74 P e61c3a8f61bb48f8a963c9480e53c168 [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:07.860657 18300 raft_consensus.cc:2272] T 2e36a9d6e29c4a7c860cf267efbd4c74 P e61c3a8f61bb48f8a963c9480e53c168 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:07.863487 18300 tablet_replica.cc:333] T edd7d470b5014c9489be7f41f64355c9 P e61c3a8f61bb48f8a963c9480e53c168: stopping tablet replica
I20260709 13:08:07.864166 18300 raft_consensus.cc:2243] T edd7d470b5014c9489be7f41f64355c9 P e61c3a8f61bb48f8a963c9480e53c168 [term 27 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:07.864809 18300 raft_consensus.cc:2272] T edd7d470b5014c9489be7f41f64355c9 P e61c3a8f61bb48f8a963c9480e53c168 [term 27 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:07.867192 18300 tablet_replica.cc:333] T a08760e15aac4630a629431f56024dc8 P e61c3a8f61bb48f8a963c9480e53c168: stopping tablet replica
I20260709 13:08:07.867777 18300 raft_consensus.cc:2243] T a08760e15aac4630a629431f56024dc8 P e61c3a8f61bb48f8a963c9480e53c168 [term 24 LEADER]: Raft consensus shutting down.
I20260709 13:08:07.868567 18300 raft_consensus.cc:2272] T a08760e15aac4630a629431f56024dc8 P e61c3a8f61bb48f8a963c9480e53c168 [term 24 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:07.871066 18300 tablet_replica.cc:333] T 70797e5783b5454ab0d0eea663e791e3 P e61c3a8f61bb48f8a963c9480e53c168: stopping tablet replica
I20260709 13:08:07.871789 18300 raft_consensus.cc:2243] T 70797e5783b5454ab0d0eea663e791e3 P e61c3a8f61bb48f8a963c9480e53c168 [term 24 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:07.872458 18300 raft_consensus.cc:2272] T 70797e5783b5454ab0d0eea663e791e3 P e61c3a8f61bb48f8a963c9480e53c168 [term 24 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:07.875053 18300 tablet_replica.cc:333] T 46c5bfeecc314717bffe987e6844b6d0 P e61c3a8f61bb48f8a963c9480e53c168: stopping tablet replica
I20260709 13:08:07.875578 18300 raft_consensus.cc:2243] T 46c5bfeecc314717bffe987e6844b6d0 P e61c3a8f61bb48f8a963c9480e53c168 [term 27 LEADER]: Raft consensus shutting down.
I20260709 13:08:07.876343 18300 raft_consensus.cc:2272] T 46c5bfeecc314717bffe987e6844b6d0 P e61c3a8f61bb48f8a963c9480e53c168 [term 27 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:07.878372 18300 tablet_replica.cc:333] T 1efebf73c86e432baa55533136b6e12c P e61c3a8f61bb48f8a963c9480e53c168: stopping tablet replica
I20260709 13:08:07.878926 18300 raft_consensus.cc:2243] T 1efebf73c86e432baa55533136b6e12c P e61c3a8f61bb48f8a963c9480e53c168 [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:07.879411 18300 raft_consensus.cc:2272] T 1efebf73c86e432baa55533136b6e12c P e61c3a8f61bb48f8a963c9480e53c168 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:07.881296 18300 tablet_replica.cc:333] T 217b5fae677b4971b3bbd2f357a1f7ff P e61c3a8f61bb48f8a963c9480e53c168: stopping tablet replica
I20260709 13:08:07.881778 18300 raft_consensus.cc:2243] T 217b5fae677b4971b3bbd2f357a1f7ff P e61c3a8f61bb48f8a963c9480e53c168 [term 20 LEADER]: Raft consensus shutting down.
I20260709 13:08:07.882587 18300 raft_consensus.cc:2272] T 217b5fae677b4971b3bbd2f357a1f7ff P e61c3a8f61bb48f8a963c9480e53c168 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:07.884554 18300 tablet_replica.cc:333] T f1b10566f45d4a7d9029858330e02d5b P e61c3a8f61bb48f8a963c9480e53c168: stopping tablet replica
I20260709 13:08:07.885038 18300 raft_consensus.cc:2243] T f1b10566f45d4a7d9029858330e02d5b P e61c3a8f61bb48f8a963c9480e53c168 [term 21 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:07.885462 18300 raft_consensus.cc:2272] T f1b10566f45d4a7d9029858330e02d5b P e61c3a8f61bb48f8a963c9480e53c168 [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:07.887305 18300 tablet_replica.cc:333] T ed7fdbcb96d14d418db9ca90a792588a P e61c3a8f61bb48f8a963c9480e53c168: stopping tablet replica
I20260709 13:08:07.887759 18300 raft_consensus.cc:2243] T ed7fdbcb96d14d418db9ca90a792588a P e61c3a8f61bb48f8a963c9480e53c168 [term 19 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:07.888305 18300 raft_consensus.cc:2272] T ed7fdbcb96d14d418db9ca90a792588a P e61c3a8f61bb48f8a963c9480e53c168 [term 19 FOLLOWER]: Raft consensus is shut down!
W20260709 13:08:07.982127 20076 consensus_peers.cc:597] T 14935b3ddf914369822e4a0547aaa355 P 127766fc592545a4997f7790f50f6076 -> Peer e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891): Couldn't send request to peer e61c3a8f61bb48f8a963c9480e53c168. Status: Network error: Client connection negotiation failed: client connection to 127.17.223.3:36891: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:08:07.985620 20078 consensus_peers.cc:597] T ed7fdbcb96d14d418db9ca90a792588a P 127766fc592545a4997f7790f50f6076 -> Peer 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257): Couldn't send request to peer 0473d2b2d01f4459b1e90fd12cc7840e. Status: Network error: Client connection negotiation failed: client connection to 127.17.223.2:46257: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:08:07.989259 20075 consensus_peers.cc:597] T 28af091831594f9d8e96482078cc7625 P 127766fc592545a4997f7790f50f6076 -> Peer e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321): Couldn't send request to peer e5256d91808b47c195bc9b4dbd7f2b87. Status: Network error: Client connection negotiation failed: client connection to 127.17.223.1:40321: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:08:07.990015 20076 consensus_peers.cc:597] T 2a16f7501e2444fb86d4e2778e734e02 P 127766fc592545a4997f7790f50f6076 -> Peer e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891): Couldn't send request to peer e61c3a8f61bb48f8a963c9480e53c168. Status: Network error: Client connection negotiation failed: client connection to 127.17.223.3:36891: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:08:08.040094 20076 consensus_peers.cc:597] T ab43d85f64114d4ebf618930e43d9ed0 P 127766fc592545a4997f7790f50f6076 -> Peer e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891): Couldn't send request to peer e61c3a8f61bb48f8a963c9480e53c168. Status: Network error: Client connection negotiation failed: client connection to 127.17.223.3:36891: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:08:08.072610 20078 consensus_peers.cc:597] T 14935b3ddf914369822e4a0547aaa355 P 127766fc592545a4997f7790f50f6076 -> Peer 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257): Couldn't send request to peer 0473d2b2d01f4459b1e90fd12cc7840e. Status: Network error: Client connection negotiation failed: client connection to 127.17.223.2:46257: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:08:08.086606 20076 consensus_peers.cc:597] T 62c6c134d3d24a1ab144dd9ee6bc3f64 P 127766fc592545a4997f7790f50f6076 -> Peer e61c3a8f61bb48f8a963c9480e53c168 (127.17.223.3:36891): Couldn't send request to peer e61c3a8f61bb48f8a963c9480e53c168. Status: Network error: Client connection negotiation failed: client connection to 127.17.223.3:36891: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:08:08.087694 20075 consensus_peers.cc:597] T 14efcc79969f41babe5529c22d59156d P 127766fc592545a4997f7790f50f6076 -> Peer e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321): Couldn't send request to peer e5256d91808b47c195bc9b4dbd7f2b87. Status: Network error: Client connection negotiation failed: client connection to 127.17.223.1:40321: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
W20260709 13:08:08.088217 20075 consensus_peers.cc:597] T ff9b0eddd810459b82d91c60777c10eb P 127766fc592545a4997f7790f50f6076 -> Peer e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321): Couldn't send request to peer e5256d91808b47c195bc9b4dbd7f2b87. Status: Network error: Client connection negotiation failed: client connection to 127.17.223.1:40321: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:08:08.139482 20078 consensus_peers.cc:597] T 9962423cb4e54fcfa5de01daf68a86e7 P 127766fc592545a4997f7790f50f6076 -> Peer 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257): Couldn't send request to peer 0473d2b2d01f4459b1e90fd12cc7840e. Status: Network error: Client connection negotiation failed: client connection to 127.17.223.2:46257: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:08:08.220394 20078 consensus_peers.cc:597] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P 127766fc592545a4997f7790f50f6076 -> Peer 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257): Couldn't send request to peer 0473d2b2d01f4459b1e90fd12cc7840e. Status: Network error: Client connection negotiation failed: client connection to 127.17.223.2:46257: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:08:08.252727 20078 consensus_peers.cc:597] T 62c6c134d3d24a1ab144dd9ee6bc3f64 P 127766fc592545a4997f7790f50f6076 -> Peer 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257): Couldn't send request to peer 0473d2b2d01f4459b1e90fd12cc7840e. Status: Network error: Client connection negotiation failed: client connection to 127.17.223.2:46257: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:08:08.253712 20078 consensus_peers.cc:597] T 1f85fc4b527a48848e5faa083b604e36 P 127766fc592545a4997f7790f50f6076 -> Peer 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257): Couldn't send request to peer 0473d2b2d01f4459b1e90fd12cc7840e. Status: Network error: Client connection negotiation failed: client connection to 127.17.223.2:46257: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:08:08.308679 20078 consensus_peers.cc:597] T 5ec1c4ce15e04c7e8c283a62179f2a64 P 127766fc592545a4997f7790f50f6076 -> Peer 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257): Couldn't send request to peer 0473d2b2d01f4459b1e90fd12cc7840e. Status: Network error: Client connection negotiation failed: client connection to 127.17.223.2:46257: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:08:08.309185 20078 consensus_peers.cc:597] T ab43d85f64114d4ebf618930e43d9ed0 P 127766fc592545a4997f7790f50f6076 -> Peer 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257): Couldn't send request to peer 0473d2b2d01f4459b1e90fd12cc7840e. Status: Network error: Client connection negotiation failed: client connection to 127.17.223.2:46257: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:08:08.338294 20078 consensus_peers.cc:597] T 48824d5acfbc485ebf8c2d944e7202de P 127766fc592545a4997f7790f50f6076 -> Peer 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257): Couldn't send request to peer 0473d2b2d01f4459b1e90fd12cc7840e. Status: Network error: Client connection negotiation failed: client connection to 127.17.223.2:46257: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:08:08.338794 20078 consensus_peers.cc:597] T 1efebf73c86e432baa55533136b6e12c P 127766fc592545a4997f7790f50f6076 -> Peer 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257): Couldn't send request to peer 0473d2b2d01f4459b1e90fd12cc7840e. Status: Network error: Client connection negotiation failed: client connection to 127.17.223.2:46257: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:08:08.368263 20078 consensus_peers.cc:597] T 14efcc79969f41babe5529c22d59156d P 127766fc592545a4997f7790f50f6076 -> Peer 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257): Couldn't send request to peer 0473d2b2d01f4459b1e90fd12cc7840e. Status: Network error: Client connection negotiation failed: client connection to 127.17.223.2:46257: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:08:08.478645 20078 consensus_peers.cc:597] T ff9b0eddd810459b82d91c60777c10eb P 127766fc592545a4997f7790f50f6076 -> Peer 0473d2b2d01f4459b1e90fd12cc7840e (127.17.223.2:46257): Couldn't send request to peer 0473d2b2d01f4459b1e90fd12cc7840e. Status: Network error: Client connection negotiation failed: client connection to 127.17.223.2:46257: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:08:08.497740 20075 consensus_peers.cc:597] T 5ec1c4ce15e04c7e8c283a62179f2a64 P 127766fc592545a4997f7790f50f6076 -> Peer e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321): Couldn't send request to peer e5256d91808b47c195bc9b4dbd7f2b87. Status: Network error: Client connection negotiation failed: client connection to 127.17.223.1:40321: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
I20260709 13:08:08.503124 18300 tablet_server.cc:196] TabletServer@127.17.223.3:0 shutdown complete.
I20260709 13:08:08.622401 18300 tablet_server.cc:179] TabletServer@127.17.223.4:0 shutting down...
I20260709 13:08:08.673540 18300 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:08:08.674458 18300 tablet_replica.cc:333] T bc225c93219c45538b53a1bd3d387e4d P 127766fc592545a4997f7790f50f6076: stopping tablet replica
I20260709 13:08:08.675397 18300 raft_consensus.cc:2243] T bc225c93219c45538b53a1bd3d387e4d P 127766fc592545a4997f7790f50f6076 [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:08.676146 18300 raft_consensus.cc:2272] T bc225c93219c45538b53a1bd3d387e4d P 127766fc592545a4997f7790f50f6076 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:08.679411 18300 tablet_replica.cc:333] T fa8650e71aa14778b3d73721fc50d9fc P 127766fc592545a4997f7790f50f6076: stopping tablet replica
I20260709 13:08:08.680227 18300 raft_consensus.cc:2243] T fa8650e71aa14778b3d73721fc50d9fc P 127766fc592545a4997f7790f50f6076 [term 22 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:08.680902 18300 raft_consensus.cc:2272] T fa8650e71aa14778b3d73721fc50d9fc P 127766fc592545a4997f7790f50f6076 [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:08.683878 18300 tablet_replica.cc:333] T 28af091831594f9d8e96482078cc7625 P 127766fc592545a4997f7790f50f6076: stopping tablet replica
I20260709 13:08:08.684752 18300 raft_consensus.cc:2243] T 28af091831594f9d8e96482078cc7625 P 127766fc592545a4997f7790f50f6076 [term 21 LEADER]: Raft consensus shutting down.
I20260709 13:08:08.686237 18300 raft_consensus.cc:2272] T 28af091831594f9d8e96482078cc7625 P 127766fc592545a4997f7790f50f6076 [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:08.689230 18300 tablet_replica.cc:333] T 14935b3ddf914369822e4a0547aaa355 P 127766fc592545a4997f7790f50f6076: stopping tablet replica
I20260709 13:08:08.690080 18300 raft_consensus.cc:2243] T 14935b3ddf914369822e4a0547aaa355 P 127766fc592545a4997f7790f50f6076 [term 16 LEADER]: Raft consensus shutting down.
I20260709 13:08:08.691135 18300 pending_rounds.cc:70] T 14935b3ddf914369822e4a0547aaa355 P 127766fc592545a4997f7790f50f6076: Trying to abort 1 pending ops.
I20260709 13:08:08.691377 18300 pending_rounds.cc:77] T 14935b3ddf914369822e4a0547aaa355 P 127766fc592545a4997f7790f50f6076: Aborting op as it isn't in flight: id { term: 16 index: 12 } timestamp: 7305635788681490432 op_type: NO_OP noop_request { }
I20260709 13:08:08.691725 18300 raft_consensus.cc:2889] T 14935b3ddf914369822e4a0547aaa355 P 127766fc592545a4997f7790f50f6076 [term 16 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260709 13:08:08.692062 18300 raft_consensus.cc:2272] T 14935b3ddf914369822e4a0547aaa355 P 127766fc592545a4997f7790f50f6076 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:08.694687 18300 tablet_replica.cc:333] T df751f992649444090e27965eb1af85d P 127766fc592545a4997f7790f50f6076: stopping tablet replica
I20260709 13:08:08.695514 18300 raft_consensus.cc:2243] T df751f992649444090e27965eb1af85d P 127766fc592545a4997f7790f50f6076 [term 25 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:08.696663 18300 raft_consensus.cc:2272] T df751f992649444090e27965eb1af85d P 127766fc592545a4997f7790f50f6076 [term 25 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:08.699414 18300 tablet_replica.cc:333] T ab43d85f64114d4ebf618930e43d9ed0 P 127766fc592545a4997f7790f50f6076: stopping tablet replica
I20260709 13:08:08.700160 18300 raft_consensus.cc:2243] T ab43d85f64114d4ebf618930e43d9ed0 P 127766fc592545a4997f7790f50f6076 [term 23 LEADER]: Raft consensus shutting down.
I20260709 13:08:08.701434 18300 raft_consensus.cc:2272] T ab43d85f64114d4ebf618930e43d9ed0 P 127766fc592545a4997f7790f50f6076 [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:08.704386 18300 tablet_replica.cc:333] T 309c3ca0ca4b4f3ba129752ea2cb293b P 127766fc592545a4997f7790f50f6076: stopping tablet replica
I20260709 13:08:08.705143 18300 raft_consensus.cc:2243] T 309c3ca0ca4b4f3ba129752ea2cb293b P 127766fc592545a4997f7790f50f6076 [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:08.705906 18300 raft_consensus.cc:2272] T 309c3ca0ca4b4f3ba129752ea2cb293b P 127766fc592545a4997f7790f50f6076 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:08.708833 18300 tablet_replica.cc:333] T 96efeaaf1057492490e9a621f37e1a2d P 127766fc592545a4997f7790f50f6076: stopping tablet replica
I20260709 13:08:08.709566 18300 raft_consensus.cc:2243] T 96efeaaf1057492490e9a621f37e1a2d P 127766fc592545a4997f7790f50f6076 [term 22 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:08.710289 18300 raft_consensus.cc:2272] T 96efeaaf1057492490e9a621f37e1a2d P 127766fc592545a4997f7790f50f6076 [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:08.713006 18300 tablet_replica.cc:333] T 5ec1c4ce15e04c7e8c283a62179f2a64 P 127766fc592545a4997f7790f50f6076: stopping tablet replica
I20260709 13:08:08.713670 18300 raft_consensus.cc:2243] T 5ec1c4ce15e04c7e8c283a62179f2a64 P 127766fc592545a4997f7790f50f6076 [term 17 LEADER]: Raft consensus shutting down.
I20260709 13:08:08.714696 18300 raft_consensus.cc:2272] T 5ec1c4ce15e04c7e8c283a62179f2a64 P 127766fc592545a4997f7790f50f6076 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:08.717260 18300 tablet_replica.cc:333] T 70797e5783b5454ab0d0eea663e791e3 P 127766fc592545a4997f7790f50f6076: stopping tablet replica
I20260709 13:08:08.717988 18300 raft_consensus.cc:2243] T 70797e5783b5454ab0d0eea663e791e3 P 127766fc592545a4997f7790f50f6076 [term 24 LEADER]: Raft consensus shutting down.
I20260709 13:08:08.719023 18300 raft_consensus.cc:2272] T 70797e5783b5454ab0d0eea663e791e3 P 127766fc592545a4997f7790f50f6076 [term 24 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:08.721766 18300 tablet_replica.cc:333] T 1efebf73c86e432baa55533136b6e12c P 127766fc592545a4997f7790f50f6076: stopping tablet replica
I20260709 13:08:08.722657 18300 raft_consensus.cc:2243] T 1efebf73c86e432baa55533136b6e12c P 127766fc592545a4997f7790f50f6076 [term 18 LEADER]: Raft consensus shutting down.
I20260709 13:08:08.723778 18300 raft_consensus.cc:2272] T 1efebf73c86e432baa55533136b6e12c P 127766fc592545a4997f7790f50f6076 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:08.726444 18300 tablet_replica.cc:333] T 14efcc79969f41babe5529c22d59156d P 127766fc592545a4997f7790f50f6076: stopping tablet replica
I20260709 13:08:08.727382 18300 raft_consensus.cc:2243] T 14efcc79969f41babe5529c22d59156d P 127766fc592545a4997f7790f50f6076 [term 17 LEADER]: Raft consensus shutting down.
I20260709 13:08:08.728554 18300 raft_consensus.cc:2272] T 14efcc79969f41babe5529c22d59156d P 127766fc592545a4997f7790f50f6076 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:08.731398 18300 tablet_replica.cc:333] T 172b3dd13109415a955b71ac0e9d2234 P 127766fc592545a4997f7790f50f6076: stopping tablet replica
I20260709 13:08:08.732228 18300 raft_consensus.cc:2243] T 172b3dd13109415a955b71ac0e9d2234 P 127766fc592545a4997f7790f50f6076 [term 20 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:08.732805 18300 raft_consensus.cc:2272] T 172b3dd13109415a955b71ac0e9d2234 P 127766fc592545a4997f7790f50f6076 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:08.735455 18300 tablet_replica.cc:333] T b9f0d59553ad444883fcf5b5909f9798 P 127766fc592545a4997f7790f50f6076: stopping tablet replica
I20260709 13:08:08.736213 18300 raft_consensus.cc:2243] T b9f0d59553ad444883fcf5b5909f9798 P 127766fc592545a4997f7790f50f6076 [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:08.736840 18300 raft_consensus.cc:2272] T b9f0d59553ad444883fcf5b5909f9798 P 127766fc592545a4997f7790f50f6076 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:08.739785 18300 tablet_replica.cc:333] T 2a16f7501e2444fb86d4e2778e734e02 P 127766fc592545a4997f7790f50f6076: stopping tablet replica
I20260709 13:08:08.740520 18300 raft_consensus.cc:2243] T 2a16f7501e2444fb86d4e2778e734e02 P 127766fc592545a4997f7790f50f6076 [term 16 LEADER]: Raft consensus shutting down.
I20260709 13:08:08.741571 18300 raft_consensus.cc:2272] T 2a16f7501e2444fb86d4e2778e734e02 P 127766fc592545a4997f7790f50f6076 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:08.744124 18300 tablet_replica.cc:333] T 4af19371ea874c09a0a2147040835cbb P 127766fc592545a4997f7790f50f6076: stopping tablet replica
I20260709 13:08:08.744892 18300 raft_consensus.cc:2243] T 4af19371ea874c09a0a2147040835cbb P 127766fc592545a4997f7790f50f6076 [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:08.745496 18300 raft_consensus.cc:2272] T 4af19371ea874c09a0a2147040835cbb P 127766fc592545a4997f7790f50f6076 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:08.747995 18300 tablet_replica.cc:333] T fa731b585f684a7fb2d106c50f143b83 P 127766fc592545a4997f7790f50f6076: stopping tablet replica
I20260709 13:08:08.748777 18300 raft_consensus.cc:2243] T fa731b585f684a7fb2d106c50f143b83 P 127766fc592545a4997f7790f50f6076 [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:08.749598 18300 raft_consensus.cc:2272] T fa731b585f684a7fb2d106c50f143b83 P 127766fc592545a4997f7790f50f6076 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:08.752388 18300 tablet_replica.cc:333] T ed7fdbcb96d14d418db9ca90a792588a P 127766fc592545a4997f7790f50f6076: stopping tablet replica
I20260709 13:08:08.753134 18300 raft_consensus.cc:2243] T ed7fdbcb96d14d418db9ca90a792588a P 127766fc592545a4997f7790f50f6076 [term 19 LEADER]: Raft consensus shutting down.
I20260709 13:08:08.754117 18300 pending_rounds.cc:70] T ed7fdbcb96d14d418db9ca90a792588a P 127766fc592545a4997f7790f50f6076: Trying to abort 1 pending ops.
I20260709 13:08:08.754330 18300 pending_rounds.cc:77] T ed7fdbcb96d14d418db9ca90a792588a P 127766fc592545a4997f7790f50f6076: Aborting op as it isn't in flight: id { term: 19 index: 15 } timestamp: 7305635788377202688 op_type: NO_OP noop_request { }
I20260709 13:08:08.754654 18300 raft_consensus.cc:2889] T ed7fdbcb96d14d418db9ca90a792588a P 127766fc592545a4997f7790f50f6076 [term 19 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260709 13:08:08.755021 18300 raft_consensus.cc:2272] T ed7fdbcb96d14d418db9ca90a792588a P 127766fc592545a4997f7790f50f6076 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:08.757520 18300 tablet_replica.cc:333] T ff9b0eddd810459b82d91c60777c10eb P 127766fc592545a4997f7790f50f6076: stopping tablet replica
I20260709 13:08:08.758275 18300 raft_consensus.cc:2243] T ff9b0eddd810459b82d91c60777c10eb P 127766fc592545a4997f7790f50f6076 [term 23 LEADER]: Raft consensus shutting down.
I20260709 13:08:08.759413 18300 raft_consensus.cc:2272] T ff9b0eddd810459b82d91c60777c10eb P 127766fc592545a4997f7790f50f6076 [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:08.761965 18300 tablet_replica.cc:333] T d1e5873a19244c5ebbcd38e126796ee7 P 127766fc592545a4997f7790f50f6076: stopping tablet replica
I20260709 13:08:08.762655 18300 raft_consensus.cc:2243] T d1e5873a19244c5ebbcd38e126796ee7 P 127766fc592545a4997f7790f50f6076 [term 24 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:08.763311 18300 raft_consensus.cc:2272] T d1e5873a19244c5ebbcd38e126796ee7 P 127766fc592545a4997f7790f50f6076 [term 24 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:08.766155 18300 tablet_replica.cc:333] T 76cb037fc9064d13b59a8969d897ce8c P 127766fc592545a4997f7790f50f6076: stopping tablet replica
I20260709 13:08:08.766922 18300 raft_consensus.cc:2243] T 76cb037fc9064d13b59a8969d897ce8c P 127766fc592545a4997f7790f50f6076 [term 22 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:08.767647 18300 raft_consensus.cc:2272] T 76cb037fc9064d13b59a8969d897ce8c P 127766fc592545a4997f7790f50f6076 [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:08.770414 18300 tablet_replica.cc:333] T 1f85fc4b527a48848e5faa083b604e36 P 127766fc592545a4997f7790f50f6076: stopping tablet replica
I20260709 13:08:08.771118 18300 raft_consensus.cc:2243] T 1f85fc4b527a48848e5faa083b604e36 P 127766fc592545a4997f7790f50f6076 [term 20 LEADER]: Raft consensus shutting down.
I20260709 13:08:08.772137 18300 raft_consensus.cc:2272] T 1f85fc4b527a48848e5faa083b604e36 P 127766fc592545a4997f7790f50f6076 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:08.774827 18300 tablet_replica.cc:333] T ece3db938bc649d4a40a51522ed5259c P 127766fc592545a4997f7790f50f6076: stopping tablet replica
I20260709 13:08:08.775523 18300 raft_consensus.cc:2243] T ece3db938bc649d4a40a51522ed5259c P 127766fc592545a4997f7790f50f6076 [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:08.776058 18300 raft_consensus.cc:2272] T ece3db938bc649d4a40a51522ed5259c P 127766fc592545a4997f7790f50f6076 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:08.778630 18300 tablet_replica.cc:333] T 62c6c134d3d24a1ab144dd9ee6bc3f64 P 127766fc592545a4997f7790f50f6076: stopping tablet replica
I20260709 13:08:08.779394 18300 raft_consensus.cc:2243] T 62c6c134d3d24a1ab144dd9ee6bc3f64 P 127766fc592545a4997f7790f50f6076 [term 18 LEADER]: Raft consensus shutting down.
I20260709 13:08:08.780380 18300 raft_consensus.cc:2272] T 62c6c134d3d24a1ab144dd9ee6bc3f64 P 127766fc592545a4997f7790f50f6076 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:08.782851 18300 tablet_replica.cc:333] T 775c229504194560ba9589bc2199b089 P 127766fc592545a4997f7790f50f6076: stopping tablet replica
I20260709 13:08:08.783516 18300 raft_consensus.cc:2243] T 775c229504194560ba9589bc2199b089 P 127766fc592545a4997f7790f50f6076 [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:08.784039 18300 raft_consensus.cc:2272] T 775c229504194560ba9589bc2199b089 P 127766fc592545a4997f7790f50f6076 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:08.786367 18300 tablet_replica.cc:333] T 48824d5acfbc485ebf8c2d944e7202de P 127766fc592545a4997f7790f50f6076: stopping tablet replica
I20260709 13:08:08.787032 18300 raft_consensus.cc:2243] T 48824d5acfbc485ebf8c2d944e7202de P 127766fc592545a4997f7790f50f6076 [term 21 LEADER]: Raft consensus shutting down.
I20260709 13:08:08.788017 18300 raft_consensus.cc:2272] T 48824d5acfbc485ebf8c2d944e7202de P 127766fc592545a4997f7790f50f6076 [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:08.790575 18300 tablet_replica.cc:333] T 0afb57ae58a24a01850491d69f0213dd P 127766fc592545a4997f7790f50f6076: stopping tablet replica
I20260709 13:08:08.791327 18300 raft_consensus.cc:2243] T 0afb57ae58a24a01850491d69f0213dd P 127766fc592545a4997f7790f50f6076 [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:08.791966 18300 raft_consensus.cc:2272] T 0afb57ae58a24a01850491d69f0213dd P 127766fc592545a4997f7790f50f6076 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:08.794730 18300 tablet_replica.cc:333] T 9962423cb4e54fcfa5de01daf68a86e7 P 127766fc592545a4997f7790f50f6076: stopping tablet replica
I20260709 13:08:08.795457 18300 raft_consensus.cc:2243] T 9962423cb4e54fcfa5de01daf68a86e7 P 127766fc592545a4997f7790f50f6076 [term 19 LEADER]: Raft consensus shutting down.
I20260709 13:08:08.796533 18300 raft_consensus.cc:2272] T 9962423cb4e54fcfa5de01daf68a86e7 P 127766fc592545a4997f7790f50f6076 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:08.799549 18300 tablet_replica.cc:333] T 6c5eebf646ad445a9d1b1adc319d7b16 P 127766fc592545a4997f7790f50f6076: stopping tablet replica
I20260709 13:08:08.800305 18300 raft_consensus.cc:2243] T 6c5eebf646ad445a9d1b1adc319d7b16 P 127766fc592545a4997f7790f50f6076 [term 20 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:08.801074 18300 raft_consensus.cc:2272] T 6c5eebf646ad445a9d1b1adc319d7b16 P 127766fc592545a4997f7790f50f6076 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:08.803876 18300 tablet_replica.cc:333] T 0e1085d23e8347fbbd5bce7542f4b1f4 P 127766fc592545a4997f7790f50f6076: stopping tablet replica
I20260709 13:08:08.804625 18300 raft_consensus.cc:2243] T 0e1085d23e8347fbbd5bce7542f4b1f4 P 127766fc592545a4997f7790f50f6076 [term 19 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:08.805204 18300 raft_consensus.cc:2272] T 0e1085d23e8347fbbd5bce7542f4b1f4 P 127766fc592545a4997f7790f50f6076 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:08.807873 18300 tablet_replica.cc:333] T 85c494af21f9457a85da47b9bc70c1fd P 127766fc592545a4997f7790f50f6076: stopping tablet replica
I20260709 13:08:08.808609 18300 raft_consensus.cc:2243] T 85c494af21f9457a85da47b9bc70c1fd P 127766fc592545a4997f7790f50f6076 [term 22 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:08.809247 18300 raft_consensus.cc:2272] T 85c494af21f9457a85da47b9bc70c1fd P 127766fc592545a4997f7790f50f6076 [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:08.811941 18300 tablet_replica.cc:333] T 21e14947d70440f19044d8f75c31e1f9 P 127766fc592545a4997f7790f50f6076: stopping tablet replica
I20260709 13:08:08.864867 18300 raft_consensus.cc:2243] T 21e14947d70440f19044d8f75c31e1f9 P 127766fc592545a4997f7790f50f6076 [term 22 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:08.865761 18300 raft_consensus.cc:2272] T 21e14947d70440f19044d8f75c31e1f9 P 127766fc592545a4997f7790f50f6076 [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:08.868762 18300 tablet_replica.cc:333] T 7be9efa6559648dbb5a0f7684c4542d1 P 127766fc592545a4997f7790f50f6076: stopping tablet replica
I20260709 13:08:08.869431 18300 raft_consensus.cc:2243] T 7be9efa6559648dbb5a0f7684c4542d1 P 127766fc592545a4997f7790f50f6076 [term 24 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:08.870373 18300 raft_consensus.cc:2272] T 7be9efa6559648dbb5a0f7684c4542d1 P 127766fc592545a4997f7790f50f6076 [term 24 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:08.873181 18300 tablet_replica.cc:333] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P 127766fc592545a4997f7790f50f6076: stopping tablet replica
I20260709 13:08:08.873834 18300 raft_consensus.cc:2243] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P 127766fc592545a4997f7790f50f6076 [term 22 LEADER]: Raft consensus shutting down.
I20260709 13:08:08.874848 18300 raft_consensus.cc:2272] T 36f6ba92b9ba46babe4ebd6c02e5fbd9 P 127766fc592545a4997f7790f50f6076 [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:08.878814 18300 tablet_replica.cc:333] T 833a2f0775ed407a94b8924ce50adb63 P 127766fc592545a4997f7790f50f6076: stopping tablet replica
I20260709 13:08:08.879418 18300 raft_consensus.cc:2243] T 833a2f0775ed407a94b8924ce50adb63 P 127766fc592545a4997f7790f50f6076 [term 16 LEADER]: Raft consensus shutting down.
I20260709 13:08:08.880374 18300 raft_consensus.cc:2272] T 833a2f0775ed407a94b8924ce50adb63 P 127766fc592545a4997f7790f50f6076 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:08.882710 18300 tablet_replica.cc:333] T 65d8cb8d6ec64f459d5a47cefab10acf P 127766fc592545a4997f7790f50f6076: stopping tablet replica
I20260709 13:08:08.883250 18300 raft_consensus.cc:2243] T 65d8cb8d6ec64f459d5a47cefab10acf P 127766fc592545a4997f7790f50f6076 [term 22 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:08.883801 18300 raft_consensus.cc:2272] T 65d8cb8d6ec64f459d5a47cefab10acf P 127766fc592545a4997f7790f50f6076 [term 22 FOLLOWER]: Raft consensus is shut down!
W20260709 13:08:09.876154 20133 debug-util.cc:398] Leaking SignalData structure 0x7b08000d6ce0 after lost signal to thread 18303
W20260709 13:08:09.877167 20133 debug-util.cc:398] Leaking SignalData structure 0x7b08003cf140 after lost signal to thread 19343
W20260709 13:08:09.877693 20133 debug-util.cc:398] Leaking SignalData structure 0x7b08003db000 after lost signal to thread 20136
W20260709 13:08:09.948196 18300 thread.cc:527] Waited for 1000ms trying to join with diag-logger (tid 20133)
I20260709 13:08:10.802984 18300 tablet_server.cc:196] TabletServer@127.17.223.4:0 shutdown complete.
I20260709 13:08:10.931840 18300 master.cc:562] Master@127.17.223.62:36283 shutting down...
W20260709 13:08:10.977347 19357 auto_rebalancer.cc:873] Removing replace marker failed: Catalog manager is not initialized. State: Closing
W20260709 13:08:10.977655 19357 auto_rebalancer.cc:901] Could not move replica: Service unavailable: Catalog manager is not initialized. State: Closing
W20260709 13:08:10.977867 19357 auto_rebalancer.cc:330] scheduled replica move failed to complete: Service unavailable: Catalog manager is not initialized. State: Closing
W20260709 13:08:16.434799 19293 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.17.223.1:40321: connect: Connection refused (error 111) [suppressed 488 similar messages]
W20260709 13:08:16.438001 19293 catalog_manager.cc:4755] TS e5256d91808b47c195bc9b4dbd7f2b87 (127.17.223.1:40321): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet bc225c93219c45538b53a1bd3d387e4d: Network error: Client connection negotiation failed: client connection to 127.17.223.1:40321: connect: Connection refused (error 111)
I20260709 13:08:16.581439 18300 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 97750b77d35444acb7791ebf26cc2685 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:08:16.582350 18300 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 97750b77d35444acb7791ebf26cc2685 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:16.582762 18300 tablet_replica.cc:333] T 00000000000000000000000000000000 P 97750b77d35444acb7791ebf26cc2685: stopping tablet replica
I20260709 13:08:16.748771 18300 master.cc:584] Master@127.17.223.62:36283 shutdown complete.
I20260709 13:08:16.797551 18300 test_util.cc:182] -----------------------------------------------
I20260709 13:08:16.797837 18300 test_util.cc:183] Had failures, leaving test files at /tmp/dist-test-taskKd2k48/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602220613947-18300-0
[  FAILED  ] LeaderRebalancerTest.AddTserver (252898 ms)
[ RUN      ] LeaderRebalancerTest.RestartTserver
I20260709 13:08:16.801227 18300 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.17.223.62:40677
I20260709 13:08:16.802330 18300 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:08:16.808210 27466 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:08:16.808266 27467 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:08:16.808760 27469 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:08:16.810588 18300 server_base.cc:1061] running on GCE node
I20260709 13:08:16.815506 18300 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:08:16.815732 18300 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:08:16.815909 18300 hybrid_clock.cc:648] HybridClock initialized: now 1783602496815892 us; error 0 us; skew 500 ppm
I20260709 13:08:16.816427 18300 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:08:16.819046 18300 webserver.cc:533] Webserver started at http://127.17.223.62:38231/ using document root <none> and password file <none>
I20260709 13:08:16.819550 18300 fs_manager.cc:362] Metadata directory not provided
I20260709 13:08:16.819746 18300 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:08:16.820078 18300 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:08:16.821303 18300 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskKd2k48/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602220613947-18300-0/minicluster-data/master-0-root/instance:
uuid: "dee8111901394f00bf3594b0450fcadb"
format_stamp: "Formatted at 2026-07-09 13:08:16 on dist-test-slave-vl1s"
I20260709 13:08:16.825830 18300 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.004s	sys 0.003s
I20260709 13:08:16.829169 27474 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:08:16.829932 18300 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260709 13:08:16.830221 18300 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskKd2k48/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602220613947-18300-0/minicluster-data/master-0-root
uuid: "dee8111901394f00bf3594b0450fcadb"
format_stamp: "Formatted at 2026-07-09 13:08:16 on dist-test-slave-vl1s"
I20260709 13:08:16.830518 18300 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskKd2k48/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602220613947-18300-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskKd2k48/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602220613947-18300-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskKd2k48/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602220613947-18300-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:08:16.844192 18300 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:08:16.845402 18300 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:08:16.883862 18300 rpc_server.cc:307] RPC server started. Bound to: 127.17.223.62:40677
I20260709 13:08:16.883960 27525 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.17.223.62:40677 every 8 connection(s)
I20260709 13:08:16.887908 27526 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:16.898437 27526 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P dee8111901394f00bf3594b0450fcadb: Bootstrap starting.
I20260709 13:08:16.903246 27526 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P dee8111901394f00bf3594b0450fcadb: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:16.907308 27526 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P dee8111901394f00bf3594b0450fcadb: No bootstrap required, opened a new log
I20260709 13:08:16.909458 27526 raft_consensus.cc:359] T 00000000000000000000000000000000 P dee8111901394f00bf3594b0450fcadb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "dee8111901394f00bf3594b0450fcadb" member_type: VOTER }
I20260709 13:08:16.909896 27526 raft_consensus.cc:385] T 00000000000000000000000000000000 P dee8111901394f00bf3594b0450fcadb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:16.910132 27526 raft_consensus.cc:740] T 00000000000000000000000000000000 P dee8111901394f00bf3594b0450fcadb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dee8111901394f00bf3594b0450fcadb, State: Initialized, Role: FOLLOWER
I20260709 13:08:16.910832 27526 consensus_queue.cc:260] T 00000000000000000000000000000000 P dee8111901394f00bf3594b0450fcadb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "dee8111901394f00bf3594b0450fcadb" member_type: VOTER }
I20260709 13:08:16.911294 27526 raft_consensus.cc:399] T 00000000000000000000000000000000 P dee8111901394f00bf3594b0450fcadb [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 13:08:16.911545 27526 raft_consensus.cc:493] T 00000000000000000000000000000000 P dee8111901394f00bf3594b0450fcadb [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 13:08:16.911821 27526 raft_consensus.cc:3060] T 00000000000000000000000000000000 P dee8111901394f00bf3594b0450fcadb [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:16.916226 27526 raft_consensus.cc:515] T 00000000000000000000000000000000 P dee8111901394f00bf3594b0450fcadb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "dee8111901394f00bf3594b0450fcadb" member_type: VOTER }
I20260709 13:08:16.916756 27526 leader_election.cc:304] T 00000000000000000000000000000000 P dee8111901394f00bf3594b0450fcadb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: dee8111901394f00bf3594b0450fcadb; no voters: 
I20260709 13:08:16.917900 27526 leader_election.cc:290] T 00000000000000000000000000000000 P dee8111901394f00bf3594b0450fcadb [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 13:08:16.918229 27529 raft_consensus.cc:2804] T 00000000000000000000000000000000 P dee8111901394f00bf3594b0450fcadb [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:08:16.919571 27529 raft_consensus.cc:697] T 00000000000000000000000000000000 P dee8111901394f00bf3594b0450fcadb [term 1 LEADER]: Becoming Leader. State: Replica: dee8111901394f00bf3594b0450fcadb, State: Running, Role: LEADER
I20260709 13:08:16.920269 27529 consensus_queue.cc:237] T 00000000000000000000000000000000 P dee8111901394f00bf3594b0450fcadb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "dee8111901394f00bf3594b0450fcadb" member_type: VOTER }
I20260709 13:08:16.920921 27526 sys_catalog.cc:565] T 00000000000000000000000000000000 P dee8111901394f00bf3594b0450fcadb [sys.catalog]: configured and running, proceeding with master startup.
I20260709 13:08:16.925376 27530 sys_catalog.cc:455] T 00000000000000000000000000000000 P dee8111901394f00bf3594b0450fcadb [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "dee8111901394f00bf3594b0450fcadb" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "dee8111901394f00bf3594b0450fcadb" member_type: VOTER } }
I20260709 13:08:16.925527 27531 sys_catalog.cc:455] T 00000000000000000000000000000000 P dee8111901394f00bf3594b0450fcadb [sys.catalog]: SysCatalogTable state changed. Reason: New leader dee8111901394f00bf3594b0450fcadb. Latest consensus state: current_term: 1 leader_uuid: "dee8111901394f00bf3594b0450fcadb" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "dee8111901394f00bf3594b0450fcadb" member_type: VOTER } }
I20260709 13:08:16.926311 27530 sys_catalog.cc:458] T 00000000000000000000000000000000 P dee8111901394f00bf3594b0450fcadb [sys.catalog]: This master's current role is: LEADER
I20260709 13:08:16.926472 27531 sys_catalog.cc:458] T 00000000000000000000000000000000 P dee8111901394f00bf3594b0450fcadb [sys.catalog]: This master's current role is: LEADER
I20260709 13:08:16.929556 27536 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 13:08:16.938531 27536 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 13:08:16.940593 18300 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 13:08:16.947770 27536 catalog_manager.cc:1383] Generated new cluster ID: 606ae649a2e84d21902b7023400e2a80
I20260709 13:08:16.948081 27536 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 13:08:16.968214 27536 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 13:08:16.969466 27536 catalog_manager.cc:1540] Loading token signing keys...
I20260709 13:08:16.982853 27536 catalog_manager.cc:6070] T 00000000000000000000000000000000 P dee8111901394f00bf3594b0450fcadb: Generated new TSK 0
I20260709 13:08:16.983434 27536 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 13:08:17.007045 18300 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:08:17.012995 27547 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:08:17.014195 27548 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:08:17.016489 18300 server_base.cc:1061] running on GCE node
W20260709 13:08:17.016790 27550 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:08:17.018965 18300 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:08:17.019235 18300 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:08:17.019407 18300 hybrid_clock.cc:648] HybridClock initialized: now 1783602497019386 us; error 0 us; skew 500 ppm
I20260709 13:08:17.019963 18300 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:08:17.022318 18300 webserver.cc:533] Webserver started at http://127.17.223.1:37355/ using document root <none> and password file <none>
I20260709 13:08:17.022935 18300 fs_manager.cc:362] Metadata directory not provided
I20260709 13:08:17.023142 18300 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:08:17.023414 18300 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:08:17.024693 18300 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskKd2k48/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602220613947-18300-0/minicluster-data/ts-0-root/instance:
uuid: "2513a663afac495eb09126ff55e8b2b0"
format_stamp: "Formatted at 2026-07-09 13:08:17 on dist-test-slave-vl1s"
I20260709 13:08:17.029112 18300 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.006s	sys 0.000s
I20260709 13:08:17.032612 27555 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:08:17.033589 18300 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.001s	sys 0.000s
I20260709 13:08:17.033915 18300 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskKd2k48/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602220613947-18300-0/minicluster-data/ts-0-root
uuid: "2513a663afac495eb09126ff55e8b2b0"
format_stamp: "Formatted at 2026-07-09 13:08:17 on dist-test-slave-vl1s"
I20260709 13:08:17.034186 18300 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskKd2k48/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602220613947-18300-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskKd2k48/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602220613947-18300-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskKd2k48/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602220613947-18300-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:08:17.044229 18300 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:08:17.045369 18300 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:08:17.046835 18300 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:08:17.049069 18300 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:08:17.049243 18300 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:08:17.049531 18300 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:08:17.049705 18300 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:08:17.094653 18300 rpc_server.cc:307] RPC server started. Bound to: 127.17.223.1:40721
I20260709 13:08:17.094830 27617 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.17.223.1:40721 every 8 connection(s)
I20260709 13:08:17.099720 18300 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:08:17.107931 27622 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:08:17.108805 27623 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:08:17.110924 27625 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:08:17.112111 18300 server_base.cc:1061] running on GCE node
I20260709 13:08:17.114477 18300 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:08:17.114750 18300 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:08:17.114914 18300 hybrid_clock.cc:648] HybridClock initialized: now 1783602497114898 us; error 0 us; skew 500 ppm
I20260709 13:08:17.115437 18300 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:08:17.117801 18300 webserver.cc:533] Webserver started at http://127.17.223.2:37363/ using document root <none> and password file <none>
I20260709 13:08:17.118227 18300 fs_manager.cc:362] Metadata directory not provided
I20260709 13:08:17.118392 18300 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:08:17.118599 18300 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:08:17.119906 18300 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskKd2k48/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602220613947-18300-0/minicluster-data/ts-1-root/instance:
uuid: "41268b218b804905a110c86738e74400"
format_stamp: "Formatted at 2026-07-09 13:08:17 on dist-test-slave-vl1s"
I20260709 13:08:17.123658 27618 heartbeater.cc:344] Connected to a master server at 127.17.223.62:40677
I20260709 13:08:17.124084 27618 heartbeater.cc:461] Registering TS with master...
I20260709 13:08:17.125032 27618 heartbeater.cc:507] Master 127.17.223.62:40677 requested a full tablet report, sending...
I20260709 13:08:17.125641 18300 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.006s	sys 0.000s
I20260709 13:08:17.127341 27491 ts_manager.cc:194] Registered new tserver with Master: 2513a663afac495eb09126ff55e8b2b0 (127.17.223.1:40721)
I20260709 13:08:17.129371 27491 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:43420
I20260709 13:08:17.129704 27630 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:08:17.130709 18300 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.002s	sys 0.000s
I20260709 13:08:17.131040 18300 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskKd2k48/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602220613947-18300-0/minicluster-data/ts-1-root
uuid: "41268b218b804905a110c86738e74400"
format_stamp: "Formatted at 2026-07-09 13:08:17 on dist-test-slave-vl1s"
I20260709 13:08:17.131325 18300 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskKd2k48/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602220613947-18300-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskKd2k48/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602220613947-18300-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskKd2k48/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602220613947-18300-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:08:17.141961 18300 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:08:17.143280 18300 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:08:17.144764 18300 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:08:17.147089 18300 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:08:17.147321 18300 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:08:17.147578 18300 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:08:17.147758 18300 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:08:17.188385 18300 rpc_server.cc:307] RPC server started. Bound to: 127.17.223.2:44403
I20260709 13:08:17.188521 27692 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.17.223.2:44403 every 8 connection(s)
I20260709 13:08:17.194911 18300 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:08:17.204911 27696 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:08:17.206380 27697 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:08:17.211956 27693 heartbeater.cc:344] Connected to a master server at 127.17.223.62:40677
I20260709 13:08:17.212044 18300 server_base.cc:1061] running on GCE node
I20260709 13:08:17.212633 27693 heartbeater.cc:461] Registering TS with master...
W20260709 13:08:17.213611 27699 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:08:17.213707 27693 heartbeater.cc:507] Master 127.17.223.62:40677 requested a full tablet report, sending...
I20260709 13:08:17.214720 18300 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:08:17.215010 18300 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:08:17.215291 18300 hybrid_clock.cc:648] HybridClock initialized: now 1783602497215269 us; error 0 us; skew 500 ppm
I20260709 13:08:17.216126 18300 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:08:17.216280 27491 ts_manager.cc:194] Registered new tserver with Master: 41268b218b804905a110c86738e74400 (127.17.223.2:44403)
I20260709 13:08:17.218518 27491 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:43430
I20260709 13:08:17.219439 18300 webserver.cc:533] Webserver started at http://127.17.223.3:42367/ using document root <none> and password file <none>
I20260709 13:08:17.220109 18300 fs_manager.cc:362] Metadata directory not provided
I20260709 13:08:17.220399 18300 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:08:17.220772 18300 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:08:17.222301 18300 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskKd2k48/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602220613947-18300-0/minicluster-data/ts-2-root/instance:
uuid: "665f7e09521a4c3f9284c1d8b0e094ff"
format_stamp: "Formatted at 2026-07-09 13:08:17 on dist-test-slave-vl1s"
I20260709 13:08:17.227715 18300 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.002s	sys 0.003s
I20260709 13:08:17.232815 27704 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:08:17.233896 18300 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.000s	sys 0.002s
I20260709 13:08:17.234234 18300 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskKd2k48/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602220613947-18300-0/minicluster-data/ts-2-root
uuid: "665f7e09521a4c3f9284c1d8b0e094ff"
format_stamp: "Formatted at 2026-07-09 13:08:17 on dist-test-slave-vl1s"
I20260709 13:08:17.234556 18300 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskKd2k48/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602220613947-18300-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskKd2k48/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602220613947-18300-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskKd2k48/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602220613947-18300-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:08:17.257030 18300 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:08:17.258870 18300 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:08:17.261001 18300 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:08:17.263640 18300 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:08:17.263870 18300 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:08:17.264129 18300 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:08:17.264298 18300 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:08:17.307672 18300 rpc_server.cc:307] RPC server started. Bound to: 127.17.223.3:38749
I20260709 13:08:17.307780 27766 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.17.223.3:38749 every 8 connection(s)
I20260709 13:08:17.312626 18300 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:08:17.320957 27770 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:08:17.323293 27771 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:08:17.324887 27773 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:08:17.325780 18300 server_base.cc:1061] running on GCE node
I20260709 13:08:17.326933 18300 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:08:17.327169 18300 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:08:17.327294 27767 heartbeater.cc:344] Connected to a master server at 127.17.223.62:40677
I20260709 13:08:17.327430 18300 hybrid_clock.cc:648] HybridClock initialized: now 1783602497327407 us; error 0 us; skew 500 ppm
I20260709 13:08:17.327759 27767 heartbeater.cc:461] Registering TS with master...
I20260709 13:08:17.328292 18300 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:08:17.328789 27767 heartbeater.cc:507] Master 127.17.223.62:40677 requested a full tablet report, sending...
I20260709 13:08:17.331094 18300 webserver.cc:533] Webserver started at http://127.17.223.4:42743/ using document root <none> and password file <none>
I20260709 13:08:17.331403 27491 ts_manager.cc:194] Registered new tserver with Master: 665f7e09521a4c3f9284c1d8b0e094ff (127.17.223.3:38749)
I20260709 13:08:17.331840 18300 fs_manager.cc:362] Metadata directory not provided
I20260709 13:08:17.332146 18300 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:08:17.332511 18300 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:08:17.333280 27491 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:43438
I20260709 13:08:17.333956 18300 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskKd2k48/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602220613947-18300-0/minicluster-data/ts-3-root/instance:
uuid: "18435fbb525741328139e84a1e354954"
format_stamp: "Formatted at 2026-07-09 13:08:17 on dist-test-slave-vl1s"
I20260709 13:08:17.339026 18300 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.005s	sys 0.001s
I20260709 13:08:17.342308 27778 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:08:17.343133 18300 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.001s
I20260709 13:08:17.343446 18300 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskKd2k48/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602220613947-18300-0/minicluster-data/ts-3-root
uuid: "18435fbb525741328139e84a1e354954"
format_stamp: "Formatted at 2026-07-09 13:08:17 on dist-test-slave-vl1s"
I20260709 13:08:17.343741 18300 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskKd2k48/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602220613947-18300-0/minicluster-data/ts-3-root
metadata directory: /tmp/dist-test-taskKd2k48/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602220613947-18300-0/minicluster-data/ts-3-root
1 data directories: /tmp/dist-test-taskKd2k48/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602220613947-18300-0/minicluster-data/ts-3-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:08:17.358315 18300 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:08:17.359881 18300 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:08:17.361440 18300 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:08:17.363714 18300 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:08:17.363950 18300 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:08:17.364197 18300 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:08:17.364384 18300 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:08:17.407809 18300 rpc_server.cc:307] RPC server started. Bound to: 127.17.223.4:40545
I20260709 13:08:17.407904 27840 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.17.223.4:40545 every 8 connection(s)
I20260709 13:08:17.423604 27841 heartbeater.cc:344] Connected to a master server at 127.17.223.62:40677
I20260709 13:08:17.424043 27841 heartbeater.cc:461] Registering TS with master...
I20260709 13:08:17.424795 27841 heartbeater.cc:507] Master 127.17.223.62:40677 requested a full tablet report, sending...
I20260709 13:08:17.426817 27491 ts_manager.cc:194] Registered new tserver with Master: 18435fbb525741328139e84a1e354954 (127.17.223.4:40545)
I20260709 13:08:17.427711 18300 internal_mini_cluster.cc:371] 4 TS(s) registered with all masters after 0.016330581s
I20260709 13:08:17.428509 27491 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:43452
I20260709 13:08:17.455127 27491 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:43468:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\313c+\002\004\001\000\226\307V\004\004\001\000a+\202\006\004\001\000,\217\255\010\004\001\000\367\362\330\n\004\001\000\302V\004\r\004\001\000\215\272/\017\004\001\000X\036[\021\004\001\000#\202\206\023\004\001\000\356\345\261\025\004\001\000\271I\335\027\004\001\000\204\255\010\032\004\001\000O\0214\034\004\001\000\032u_\036\004\001\000\345\330\212 \004\001\000\260<\266\"\004\001\000{\240\341$\004\001\000F\004\r\'\004\001\000\021h8)\004\001\000\334\313c+\004\001\000\247/\217-\004\001\000r\223\272/\004\001\000=\367\3451\004\001\000\010[\0214\004\001\000\323\276<6\004\001\000\236\"h8\004\001\000i\206\223:\004\001\0004\352\276<\004\001\000\377M\352>\004\001\000\312\261\025A\004\001\000\225\025AC\004\001\000`ylE\004\001\000+\335\227G\004\001\000\366@\303I\004\001\000\301\244\356K\004\001\000\214\010\032N\004\001\000WlEP\004\001\000\"\320pR\004\001\000\3553\234T\004\001\000\270\227\307V\004\001\000\203\373\362X\004\001\000N_\036[\004\001\000\031\303I]\004\001\000\344&u_\004\001\000\257\212\240a\004\001\000z\356\313c\004\001\000ER\367e\004\001\000\020\266\"h\004\001\000\333\031Nj\004\001\000\246}yl\004\001\000q\341\244n\004\001\000<E\320p\004\001\000\007\251\373r\004\001\000\322\014\'u\004\001\000\235pRw\004\001\000h\324}y\004\001\00038\251{\004\001\000\376\233\324}""\004\001\000\313c+\002\004\001\000\226\307V\004\004\001\000a+\202\006\004\001\000,\217\255\010\004\001\000\367\362\330\n\004\001\000\302V\004\r\004\001\000\215\272/\017\004\001\000X\036[\021\004\001\000#\202\206\023\004\001\000\356\345\261\025\004\001\000\271I\335\027\004\001\000\204\255\010\032\004\001\000O\0214\034\004\001\000\032u_\036\004\001\000\345\330\212 \004\001\000\260<\266\"\004\001\000{\240\341$\004\001\000F\004\r\'\004\001\000\021h8)\004\001\000\334\313c+\004\001\000\247/\217-\004\001\000r\223\272/\004\001\000=\367\3451\004\001\000\010[\0214\004\001\000\323\276<6\004\001\000\236\"h8\004\001\000i\206\223:\004\001\0004\352\276<\004\001\000\377M\352>\004\001\000\312\261\025A\004\001\000\225\025AC\004\001\000`ylE\004\001\000+\335\227G\004\001\000\366@\303I\004\001\000\301\244\356K\004\001\000\214\010\032N\004\001\000WlEP\004\001\000\"\320pR\004\001\000\3553\234T\004\001\000\270\227\307V\004\001\000\203\373\362X\004\001\000N_\036[\004\001\000\031\303I]\004\001\000\344&u_\004\001\000\257\212\240a\004\001\000z\356\313c\004\001\000ER\367e\004\001\000\020\266\"h\004\001\000\333\031Nj\004\001\000\246}yl\004\001\000q\341\244n\004\001\000<E\320p\004\001\000\007\251\373r\004\001\000\322\014\'u\004\001\000\235pRw\004\001\000h\324}y\004\001\00038\251{\004\001\000\376\233\324}"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
I20260709 13:08:17.713707 27583 tablet_service.cc:1511] Processing CreateTablet for tablet 18f991bbbf3a4615aab49899c7ef86dc (DEFAULT_TABLE table=test-workload [id=726d57952dab4de7b40bbe78e31e0eaf]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 13:08:17.715342 27583 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 18f991bbbf3a4615aab49899c7ef86dc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:17.715170 27581 tablet_service.cc:1511] Processing CreateTablet for tablet de531c50b1524ec788b27bc4b883689a (DEFAULT_TABLE table=test-workload [id=726d57952dab4de7b40bbe78e31e0eaf]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 13:08:17.716655 27581 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet de531c50b1524ec788b27bc4b883689a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:17.718701 27582 tablet_service.cc:1511] Processing CreateTablet for tablet 1a26f012cd6e4c4c8bf86b5fda903800 (DEFAULT_TABLE table=test-workload [id=726d57952dab4de7b40bbe78e31e0eaf]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 13:08:17.720160 27582 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1a26f012cd6e4c4c8bf86b5fda903800. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:17.722787 27579 tablet_service.cc:1511] Processing CreateTablet for tablet a9eac7f072de454a8ff2beb019da45d9 (DEFAULT_TABLE table=test-workload [id=726d57952dab4de7b40bbe78e31e0eaf]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 13:08:17.724407 27579 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a9eac7f072de454a8ff2beb019da45d9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:17.724934 27580 tablet_service.cc:1511] Processing CreateTablet for tablet 456941807b254f5fb32dca4f84bd16ea (DEFAULT_TABLE table=test-workload [id=726d57952dab4de7b40bbe78e31e0eaf]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 13:08:17.722853 27578 tablet_service.cc:1511] Processing CreateTablet for tablet 55a3afc21cea43ea85f4a2155552422d (DEFAULT_TABLE table=test-workload [id=726d57952dab4de7b40bbe78e31e0eaf]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 13:08:17.726320 27580 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 456941807b254f5fb32dca4f84bd16ea. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:17.726961 27578 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 55a3afc21cea43ea85f4a2155552422d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:17.728925 27577 tablet_service.cc:1511] Processing CreateTablet for tablet dd959195de1942f7999397a56496f5bc (DEFAULT_TABLE table=test-workload [id=726d57952dab4de7b40bbe78e31e0eaf]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 13:08:17.730365 27577 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dd959195de1942f7999397a56496f5bc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:17.734181 27576 tablet_service.cc:1511] Processing CreateTablet for tablet d0c8b4ec2d844a89b4bb66c0f1bf2c8f (DEFAULT_TABLE table=test-workload [id=726d57952dab4de7b40bbe78e31e0eaf]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 13:08:17.735682 27576 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d0c8b4ec2d844a89b4bb66c0f1bf2c8f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:17.740976 27575 tablet_service.cc:1511] Processing CreateTablet for tablet 64490a86db8c4f5ca54f4f8085f41319 (DEFAULT_TABLE table=test-workload [id=726d57952dab4de7b40bbe78e31e0eaf]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 13:08:17.742430 27575 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 64490a86db8c4f5ca54f4f8085f41319. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:17.760901 27732 tablet_service.cc:1511] Processing CreateTablet for tablet 18f991bbbf3a4615aab49899c7ef86dc (DEFAULT_TABLE table=test-workload [id=726d57952dab4de7b40bbe78e31e0eaf]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 13:08:17.762372 27732 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 18f991bbbf3a4615aab49899c7ef86dc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:17.763852 27728 tablet_service.cc:1511] Processing CreateTablet for tablet 55a3afc21cea43ea85f4a2155552422d (DEFAULT_TABLE table=test-workload [id=726d57952dab4de7b40bbe78e31e0eaf]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 13:08:17.765040 27730 tablet_service.cc:1511] Processing CreateTablet for tablet 9ac520b68b79484990a8725d6549174e (DEFAULT_TABLE table=test-workload [id=726d57952dab4de7b40bbe78e31e0eaf]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 13:08:17.766209 27727 tablet_service.cc:1511] Processing CreateTablet for tablet fc84b896d2ae4581bc236b96d5de9de3 (DEFAULT_TABLE table=test-workload [id=726d57952dab4de7b40bbe78e31e0eaf]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 13:08:17.768283 27730 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9ac520b68b79484990a8725d6549174e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:17.769742 27725 tablet_service.cc:1511] Processing CreateTablet for tablet 64490a86db8c4f5ca54f4f8085f41319 (DEFAULT_TABLE table=test-workload [id=726d57952dab4de7b40bbe78e31e0eaf]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 13:08:17.769979 27726 tablet_service.cc:1511] Processing CreateTablet for tablet dd959195de1942f7999397a56496f5bc (DEFAULT_TABLE table=test-workload [id=726d57952dab4de7b40bbe78e31e0eaf]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 13:08:17.775099 27728 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 55a3afc21cea43ea85f4a2155552422d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:17.774793 27724 tablet_service.cc:1511] Processing CreateTablet for tablet 56803a5c0dea4efeabafb6829d9215cd (DEFAULT_TABLE table=test-workload [id=726d57952dab4de7b40bbe78e31e0eaf]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 13:08:17.763859 27731 tablet_service.cc:1511] Processing CreateTablet for tablet 1a26f012cd6e4c4c8bf86b5fda903800 (DEFAULT_TABLE table=test-workload [id=726d57952dab4de7b40bbe78e31e0eaf]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 13:08:17.762446 27729 tablet_service.cc:1511] Processing CreateTablet for tablet 456941807b254f5fb32dca4f84bd16ea (DEFAULT_TABLE table=test-workload [id=726d57952dab4de7b40bbe78e31e0eaf]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 13:08:17.777266 27727 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fc84b896d2ae4581bc236b96d5de9de3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:17.777024 27658 tablet_service.cc:1511] Processing CreateTablet for tablet 1a26f012cd6e4c4c8bf86b5fda903800 (DEFAULT_TABLE table=test-workload [id=726d57952dab4de7b40bbe78e31e0eaf]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 13:08:17.778369 27658 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1a26f012cd6e4c4c8bf86b5fda903800. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:17.779747 27726 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dd959195de1942f7999397a56496f5bc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:17.779947 27657 tablet_service.cc:1511] Processing CreateTablet for tablet de531c50b1524ec788b27bc4b883689a (DEFAULT_TABLE table=test-workload [id=726d57952dab4de7b40bbe78e31e0eaf]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 13:08:17.780260 27650 tablet_service.cc:1511] Processing CreateTablet for tablet 56803a5c0dea4efeabafb6829d9215cd (DEFAULT_TABLE table=test-workload [id=726d57952dab4de7b40bbe78e31e0eaf]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 13:08:17.781330 27657 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet de531c50b1524ec788b27bc4b883689a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:17.783243 27650 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 56803a5c0dea4efeabafb6829d9215cd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:17.784173 27861 tablet_bootstrap.cc:492] T 1a26f012cd6e4c4c8bf86b5fda903800 P 2513a663afac495eb09126ff55e8b2b0: Bootstrap starting.
I20260709 13:08:17.783958 27656 tablet_service.cc:1511] Processing CreateTablet for tablet 9ac520b68b79484990a8725d6549174e (DEFAULT_TABLE table=test-workload [id=726d57952dab4de7b40bbe78e31e0eaf]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 13:08:17.785315 27656 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9ac520b68b79484990a8725d6549174e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:17.783277 27731 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1a26f012cd6e4c4c8bf86b5fda903800. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:17.786185 27724 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 56803a5c0dea4efeabafb6829d9215cd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:17.787880 27655 tablet_service.cc:1511] Processing CreateTablet for tablet 456941807b254f5fb32dca4f84bd16ea (DEFAULT_TABLE table=test-workload [id=726d57952dab4de7b40bbe78e31e0eaf]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 13:08:17.789165 27655 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 456941807b254f5fb32dca4f84bd16ea. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:17.791043 27729 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 456941807b254f5fb32dca4f84bd16ea. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:17.791980 27806 tablet_service.cc:1511] Processing CreateTablet for tablet 18f991bbbf3a4615aab49899c7ef86dc (DEFAULT_TABLE table=test-workload [id=726d57952dab4de7b40bbe78e31e0eaf]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 13:08:17.793496 27806 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 18f991bbbf3a4615aab49899c7ef86dc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:17.793877 27653 tablet_service.cc:1511] Processing CreateTablet for tablet fc84b896d2ae4581bc236b96d5de9de3 (DEFAULT_TABLE table=test-workload [id=726d57952dab4de7b40bbe78e31e0eaf]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 13:08:17.795006 27725 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 64490a86db8c4f5ca54f4f8085f41319. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:17.795281 27653 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fc84b896d2ae4581bc236b96d5de9de3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:17.791950 27654 tablet_service.cc:1511] Processing CreateTablet for tablet a9eac7f072de454a8ff2beb019da45d9 (DEFAULT_TABLE table=test-workload [id=726d57952dab4de7b40bbe78e31e0eaf]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 13:08:17.799530 27654 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a9eac7f072de454a8ff2beb019da45d9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:17.799970 27652 tablet_service.cc:1511] Processing CreateTablet for tablet dd959195de1942f7999397a56496f5bc (DEFAULT_TABLE table=test-workload [id=726d57952dab4de7b40bbe78e31e0eaf]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 13:08:17.801333 27652 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dd959195de1942f7999397a56496f5bc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:17.804744 27805 tablet_service.cc:1511] Processing CreateTablet for tablet de531c50b1524ec788b27bc4b883689a (DEFAULT_TABLE table=test-workload [id=726d57952dab4de7b40bbe78e31e0eaf]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 13:08:17.806128 27805 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet de531c50b1524ec788b27bc4b883689a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:17.807947 27804 tablet_service.cc:1511] Processing CreateTablet for tablet 9ac520b68b79484990a8725d6549174e (DEFAULT_TABLE table=test-workload [id=726d57952dab4de7b40bbe78e31e0eaf]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 13:08:17.809310 27804 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9ac520b68b79484990a8725d6549174e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:17.812412 27803 tablet_service.cc:1511] Processing CreateTablet for tablet a9eac7f072de454a8ff2beb019da45d9 (DEFAULT_TABLE table=test-workload [id=726d57952dab4de7b40bbe78e31e0eaf]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 13:08:17.813731 27803 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a9eac7f072de454a8ff2beb019da45d9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:17.815894 27802 tablet_service.cc:1511] Processing CreateTablet for tablet 55a3afc21cea43ea85f4a2155552422d (DEFAULT_TABLE table=test-workload [id=726d57952dab4de7b40bbe78e31e0eaf]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 13:08:17.819705 27799 tablet_service.cc:1511] Processing CreateTablet for tablet 64490a86db8c4f5ca54f4f8085f41319 (DEFAULT_TABLE table=test-workload [id=726d57952dab4de7b40bbe78e31e0eaf]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 13:08:17.819893 27801 tablet_service.cc:1511] Processing CreateTablet for tablet fc84b896d2ae4581bc236b96d5de9de3 (DEFAULT_TABLE table=test-workload [id=726d57952dab4de7b40bbe78e31e0eaf]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 13:08:17.822144 27798 tablet_service.cc:1511] Processing CreateTablet for tablet 56803a5c0dea4efeabafb6829d9215cd (DEFAULT_TABLE table=test-workload [id=726d57952dab4de7b40bbe78e31e0eaf]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 13:08:17.822374 27577 tablet_service.cc:1511] Processing CreateTablet for tablet 7b77a53b493f4e979fdf38a0b17176b0 (DEFAULT_TABLE table=test-workload [id=726d57952dab4de7b40bbe78e31e0eaf]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 13:08:17.823105 27802 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 55a3afc21cea43ea85f4a2155552422d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:17.824934 27577 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7b77a53b493f4e979fdf38a0b17176b0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:17.825331 27651 tablet_service.cc:1511] Processing CreateTablet for tablet d0c8b4ec2d844a89b4bb66c0f1bf2c8f (DEFAULT_TABLE table=test-workload [id=726d57952dab4de7b40bbe78e31e0eaf]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 13:08:17.829080 27801 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fc84b896d2ae4581bc236b96d5de9de3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:17.831627 27800 tablet_service.cc:1511] Processing CreateTablet for tablet d0c8b4ec2d844a89b4bb66c0f1bf2c8f (DEFAULT_TABLE table=test-workload [id=726d57952dab4de7b40bbe78e31e0eaf]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 13:08:17.833017 27800 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d0c8b4ec2d844a89b4bb66c0f1bf2c8f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:17.846073 27649 tablet_service.cc:1511] Processing CreateTablet for tablet 7b77a53b493f4e979fdf38a0b17176b0 (DEFAULT_TABLE table=test-workload [id=726d57952dab4de7b40bbe78e31e0eaf]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 13:08:17.848945 27723 tablet_service.cc:1511] Processing CreateTablet for tablet 7b77a53b493f4e979fdf38a0b17176b0 (DEFAULT_TABLE table=test-workload [id=726d57952dab4de7b40bbe78e31e0eaf]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 13:08:17.850703 27797 tablet_service.cc:1511] Processing CreateTablet for tablet bc0b10615ecb4485a9a9de298938697d (DEFAULT_TABLE table=test-workload [id=726d57952dab4de7b40bbe78e31e0eaf]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 13:08:17.852218 27797 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bc0b10615ecb4485a9a9de298938697d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:17.863161 27861 tablet_bootstrap.cc:654] T 1a26f012cd6e4c4c8bf86b5fda903800 P 2513a663afac495eb09126ff55e8b2b0: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:17.878150 27579 tablet_service.cc:1511] Processing CreateTablet for tablet bc0b10615ecb4485a9a9de298938697d (DEFAULT_TABLE table=test-workload [id=726d57952dab4de7b40bbe78e31e0eaf]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 13:08:17.879592 27579 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bc0b10615ecb4485a9a9de298938697d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:17.827185 27651 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d0c8b4ec2d844a89b4bb66c0f1bf2c8f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:17.892226 27654 tablet_service.cc:1511] Processing CreateTablet for tablet bc0b10615ecb4485a9a9de298938697d (DEFAULT_TABLE table=test-workload [id=726d57952dab4de7b40bbe78e31e0eaf]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 13:08:17.893596 27654 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bc0b10615ecb4485a9a9de298938697d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:17.904383 27799 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 64490a86db8c4f5ca54f4f8085f41319. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:17.905014 27862 tablet_bootstrap.cc:492] T 1a26f012cd6e4c4c8bf86b5fda903800 P 665f7e09521a4c3f9284c1d8b0e094ff: Bootstrap starting.
I20260709 13:08:17.900319 27578 tablet_service.cc:1511] Processing CreateTablet for tablet 11224ef6c00a40cdba4311ceb63bddb9 (DEFAULT_TABLE table=test-workload [id=726d57952dab4de7b40bbe78e31e0eaf]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 13:08:17.907043 27798 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 56803a5c0dea4efeabafb6829d9215cd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:17.907598 27578 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 11224ef6c00a40cdba4311ceb63bddb9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:17.915019 27731 tablet_service.cc:1511] Processing CreateTablet for tablet 11224ef6c00a40cdba4311ceb63bddb9 (DEFAULT_TABLE table=test-workload [id=726d57952dab4de7b40bbe78e31e0eaf]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 13:08:17.934108 27649 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7b77a53b493f4e979fdf38a0b17176b0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:17.930524 27723 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7b77a53b493f4e979fdf38a0b17176b0. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:08:17.937033 27539 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:08:17.953714 27801 tablet_service.cc:1511] Processing CreateTablet for tablet 11224ef6c00a40cdba4311ceb63bddb9 (DEFAULT_TABLE table=test-workload [id=726d57952dab4de7b40bbe78e31e0eaf]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 13:08:17.955132 27801 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 11224ef6c00a40cdba4311ceb63bddb9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:17.975497 27731 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 11224ef6c00a40cdba4311ceb63bddb9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:17.995904 27800 tablet_service.cc:1511] Processing CreateTablet for tablet df06af11cae7484d969017fcb5b7e753 (DEFAULT_TABLE table=test-workload [id=726d57952dab4de7b40bbe78e31e0eaf]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 13:08:17.997452 27800 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet df06af11cae7484d969017fcb5b7e753. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:18.006431 27727 tablet_service.cc:1511] Processing CreateTablet for tablet df06af11cae7484d969017fcb5b7e753 (DEFAULT_TABLE table=test-workload [id=726d57952dab4de7b40bbe78e31e0eaf]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 13:08:18.011513 27865 tablet_bootstrap.cc:492] T d0c8b4ec2d844a89b4bb66c0f1bf2c8f P 18435fbb525741328139e84a1e354954: Bootstrap starting.
I20260709 13:08:18.014446 27862 tablet_bootstrap.cc:654] T 1a26f012cd6e4c4c8bf86b5fda903800 P 665f7e09521a4c3f9284c1d8b0e094ff: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:18.017081 27863 tablet_bootstrap.cc:492] T 56803a5c0dea4efeabafb6829d9215cd P 41268b218b804905a110c86738e74400: Bootstrap starting.
I20260709 13:08:18.019905 27797 tablet_service.cc:1511] Processing CreateTablet for tablet 15a4c537259e4b2882a5cc8e723b260a (DEFAULT_TABLE table=test-workload [id=726d57952dab4de7b40bbe78e31e0eaf]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 13:08:18.038997 27797 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 15a4c537259e4b2882a5cc8e723b260a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:18.041360 27863 tablet_bootstrap.cc:654] T 56803a5c0dea4efeabafb6829d9215cd P 41268b218b804905a110c86738e74400: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:18.043095 27727 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet df06af11cae7484d969017fcb5b7e753. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:18.021059 27581 tablet_service.cc:1511] Processing CreateTablet for tablet 15a4c537259e4b2882a5cc8e723b260a (DEFAULT_TABLE table=test-workload [id=726d57952dab4de7b40bbe78e31e0eaf]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 13:08:18.044216 27581 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 15a4c537259e4b2882a5cc8e723b260a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:18.022487 27575 tablet_service.cc:1511] Processing CreateTablet for tablet 866a01285ca8436385f8d16dcfb0d4e3 (DEFAULT_TABLE table=test-workload [id=726d57952dab4de7b40bbe78e31e0eaf]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 13:08:18.048879 27862 tablet_bootstrap.cc:492] T 1a26f012cd6e4c4c8bf86b5fda903800 P 665f7e09521a4c3f9284c1d8b0e094ff: No bootstrap required, opened a new log
I20260709 13:08:18.049438 27862 ts_tablet_manager.cc:1403] T 1a26f012cd6e4c4c8bf86b5fda903800 P 665f7e09521a4c3f9284c1d8b0e094ff: Time spent bootstrapping tablet: real 0.145s	user 0.015s	sys 0.011s
I20260709 13:08:18.023342 27861 tablet_bootstrap.cc:492] T 1a26f012cd6e4c4c8bf86b5fda903800 P 2513a663afac495eb09126ff55e8b2b0: No bootstrap required, opened a new log
I20260709 13:08:18.029045 27730 tablet_service.cc:1511] Processing CreateTablet for tablet 866a01285ca8436385f8d16dcfb0d4e3 (DEFAULT_TABLE table=test-workload [id=726d57952dab4de7b40bbe78e31e0eaf]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 13:08:18.051502 27730 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 866a01285ca8436385f8d16dcfb0d4e3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:18.048910 27575 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 866a01285ca8436385f8d16dcfb0d4e3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:18.054993 27862 raft_consensus.cc:359] T 1a26f012cd6e4c4c8bf86b5fda903800 P 665f7e09521a4c3f9284c1d8b0e094ff [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "41268b218b804905a110c86738e74400" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 44403 } } peers { permanent_uuid: "2513a663afac495eb09126ff55e8b2b0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40721 } } peers { permanent_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 38749 } }
I20260709 13:08:18.055757 27862 raft_consensus.cc:385] T 1a26f012cd6e4c4c8bf86b5fda903800 P 665f7e09521a4c3f9284c1d8b0e094ff [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:18.056043 27862 raft_consensus.cc:740] T 1a26f012cd6e4c4c8bf86b5fda903800 P 665f7e09521a4c3f9284c1d8b0e094ff [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 665f7e09521a4c3f9284c1d8b0e094ff, State: Initialized, Role: FOLLOWER
I20260709 13:08:18.059544 27862 consensus_queue.cc:260] T 1a26f012cd6e4c4c8bf86b5fda903800 P 665f7e09521a4c3f9284c1d8b0e094ff [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "41268b218b804905a110c86738e74400" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 44403 } } peers { permanent_uuid: "2513a663afac495eb09126ff55e8b2b0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40721 } } peers { permanent_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 38749 } }
I20260709 13:08:18.066654 27732 tablet_service.cc:1511] Processing CreateTablet for tablet c9ea919812394c7aba307c2ff5b81f51 (DEFAULT_TABLE table=test-workload [id=726d57952dab4de7b40bbe78e31e0eaf]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 13:08:18.068049 27732 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c9ea919812394c7aba307c2ff5b81f51. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:18.073271 27861 ts_tablet_manager.cc:1403] T 1a26f012cd6e4c4c8bf86b5fda903800 P 2513a663afac495eb09126ff55e8b2b0: Time spent bootstrapping tablet: real 0.290s	user 0.015s	sys 0.034s
I20260709 13:08:18.074720 27862 ts_tablet_manager.cc:1434] T 1a26f012cd6e4c4c8bf86b5fda903800 P 665f7e09521a4c3f9284c1d8b0e094ff: Time spent starting tablet: real 0.025s	user 0.001s	sys 0.010s
I20260709 13:08:18.075466 27767 heartbeater.cc:499] Master 127.17.223.62:40677 was elected leader, sending a full tablet report...
I20260709 13:08:18.076710 27650 tablet_service.cc:1511] Processing CreateTablet for tablet df06af11cae7484d969017fcb5b7e753 (DEFAULT_TABLE table=test-workload [id=726d57952dab4de7b40bbe78e31e0eaf]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 13:08:18.078367 27650 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet df06af11cae7484d969017fcb5b7e753. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:18.079736 27652 tablet_service.cc:1511] Processing CreateTablet for tablet 866a01285ca8436385f8d16dcfb0d4e3 (DEFAULT_TABLE table=test-workload [id=726d57952dab4de7b40bbe78e31e0eaf]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 13:08:18.081041 27652 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 866a01285ca8436385f8d16dcfb0d4e3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:18.091295 27862 tablet_bootstrap.cc:492] T fc84b896d2ae4581bc236b96d5de9de3 P 665f7e09521a4c3f9284c1d8b0e094ff: Bootstrap starting.
I20260709 13:08:18.093519 27865 tablet_bootstrap.cc:654] T d0c8b4ec2d844a89b4bb66c0f1bf2c8f P 18435fbb525741328139e84a1e354954: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:18.097807 27656 tablet_service.cc:1511] Processing CreateTablet for tablet 68cc2880cf79462c99d9009957eb5fd2 (DEFAULT_TABLE table=test-workload [id=726d57952dab4de7b40bbe78e31e0eaf]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 13:08:18.103621 27803 tablet_service.cc:1511] Processing CreateTablet for tablet c9ea919812394c7aba307c2ff5b81f51 (DEFAULT_TABLE table=test-workload [id=726d57952dab4de7b40bbe78e31e0eaf]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 13:08:18.125615 27723 tablet_service.cc:1511] Processing CreateTablet for tablet 68cc2880cf79462c99d9009957eb5fd2 (DEFAULT_TABLE table=test-workload [id=726d57952dab4de7b40bbe78e31e0eaf]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 13:08:18.127260 27723 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 68cc2880cf79462c99d9009957eb5fd2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:18.076691 27861 raft_consensus.cc:359] T 1a26f012cd6e4c4c8bf86b5fda903800 P 2513a663afac495eb09126ff55e8b2b0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "41268b218b804905a110c86738e74400" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 44403 } } peers { permanent_uuid: "2513a663afac495eb09126ff55e8b2b0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40721 } } peers { permanent_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 38749 } }
I20260709 13:08:18.093376 27651 tablet_service.cc:1511] Processing CreateTablet for tablet 15a4c537259e4b2882a5cc8e723b260a (DEFAULT_TABLE table=test-workload [id=726d57952dab4de7b40bbe78e31e0eaf]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 13:08:18.127471 27656 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 68cc2880cf79462c99d9009957eb5fd2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:18.128932 27861 raft_consensus.cc:385] T 1a26f012cd6e4c4c8bf86b5fda903800 P 2513a663afac495eb09126ff55e8b2b0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:18.130854 27861 raft_consensus.cc:740] T 1a26f012cd6e4c4c8bf86b5fda903800 P 2513a663afac495eb09126ff55e8b2b0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2513a663afac495eb09126ff55e8b2b0, State: Initialized, Role: FOLLOWER
I20260709 13:08:18.132413 27618 heartbeater.cc:499] Master 127.17.223.62:40677 was elected leader, sending a full tablet report...
I20260709 13:08:18.132061 27861 consensus_queue.cc:260] T 1a26f012cd6e4c4c8bf86b5fda903800 P 2513a663afac495eb09126ff55e8b2b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "41268b218b804905a110c86738e74400" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 44403 } } peers { permanent_uuid: "2513a663afac495eb09126ff55e8b2b0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40721 } } peers { permanent_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 38749 } }
I20260709 13:08:18.133716 27651 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 15a4c537259e4b2882a5cc8e723b260a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:18.146648 27578 tablet_service.cc:1511] Processing CreateTablet for tablet 765d0bd527c64f74be713c390a018bba (DEFAULT_TABLE table=test-workload [id=726d57952dab4de7b40bbe78e31e0eaf]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 13:08:18.148108 27863 tablet_bootstrap.cc:492] T 56803a5c0dea4efeabafb6829d9215cd P 41268b218b804905a110c86738e74400: No bootstrap required, opened a new log
I20260709 13:08:18.148650 27863 ts_tablet_manager.cc:1403] T 56803a5c0dea4efeabafb6829d9215cd P 41268b218b804905a110c86738e74400: Time spent bootstrapping tablet: real 0.166s	user 0.008s	sys 0.008s
I20260709 13:08:18.153687 27802 tablet_service.cc:1511] Processing CreateTablet for tablet 68cc2880cf79462c99d9009957eb5fd2 (DEFAULT_TABLE table=test-workload [id=726d57952dab4de7b40bbe78e31e0eaf]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 13:08:18.155892 27805 tablet_service.cc:1511] Processing CreateTablet for tablet e5847d81a5284a44a6b2b21cf6f4351c (DEFAULT_TABLE table=test-workload [id=726d57952dab4de7b40bbe78e31e0eaf]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 13:08:18.156700 27579 tablet_service.cc:1511] Processing CreateTablet for tablet e5847d81a5284a44a6b2b21cf6f4351c (DEFAULT_TABLE table=test-workload [id=726d57952dab4de7b40bbe78e31e0eaf]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 13:08:18.158028 27649 tablet_service.cc:1511] Processing CreateTablet for tablet e5847d81a5284a44a6b2b21cf6f4351c (DEFAULT_TABLE table=test-workload [id=726d57952dab4de7b40bbe78e31e0eaf]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 13:08:18.123912 27577 tablet_service.cc:1511] Processing CreateTablet for tablet c9ea919812394c7aba307c2ff5b81f51 (DEFAULT_TABLE table=test-workload [id=726d57952dab4de7b40bbe78e31e0eaf]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 13:08:18.126029 27803 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c9ea919812394c7aba307c2ff5b81f51. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:18.158448 27730 tablet_service.cc:1511] Processing CreateTablet for tablet 765d0bd527c64f74be713c390a018bba (DEFAULT_TABLE table=test-workload [id=726d57952dab4de7b40bbe78e31e0eaf]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 13:08:18.159372 27649 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e5847d81a5284a44a6b2b21cf6f4351c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:18.159785 27730 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 765d0bd527c64f74be713c390a018bba. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:18.163012 27802 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 68cc2880cf79462c99d9009957eb5fd2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:18.123087 27862 tablet_bootstrap.cc:654] T fc84b896d2ae4581bc236b96d5de9de3 P 665f7e09521a4c3f9284c1d8b0e094ff: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:18.165148 27805 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e5847d81a5284a44a6b2b21cf6f4351c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:18.167474 27578 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 765d0bd527c64f74be713c390a018bba. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:18.180022 27654 tablet_service.cc:1511] Processing CreateTablet for tablet 765d0bd527c64f74be713c390a018bba (DEFAULT_TABLE table=test-workload [id=726d57952dab4de7b40bbe78e31e0eaf]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 13:08:18.181133 27579 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e5847d81a5284a44a6b2b21cf6f4351c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:18.187403 27731 tablet_service.cc:1511] Processing CreateTablet for tablet 80e2477670ec4db18ad338931d714544 (DEFAULT_TABLE table=test-workload [id=726d57952dab4de7b40bbe78e31e0eaf]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 13:08:18.188689 27731 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 80e2477670ec4db18ad338931d714544. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:18.188253 27863 raft_consensus.cc:359] T 56803a5c0dea4efeabafb6829d9215cd P 41268b218b804905a110c86738e74400 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "41268b218b804905a110c86738e74400" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 44403 } } peers { permanent_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 38749 } } peers { permanent_uuid: "18435fbb525741328139e84a1e354954" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 40545 } }
I20260709 13:08:18.189282 27863 raft_consensus.cc:385] T 56803a5c0dea4efeabafb6829d9215cd P 41268b218b804905a110c86738e74400 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:18.189707 27863 raft_consensus.cc:740] T 56803a5c0dea4efeabafb6829d9215cd P 41268b218b804905a110c86738e74400 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 41268b218b804905a110c86738e74400, State: Initialized, Role: FOLLOWER
I20260709 13:08:18.190625 27863 consensus_queue.cc:260] T 56803a5c0dea4efeabafb6829d9215cd P 41268b218b804905a110c86738e74400 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "41268b218b804905a110c86738e74400" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 44403 } } peers { permanent_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 38749 } } peers { permanent_uuid: "18435fbb525741328139e84a1e354954" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 40545 } }
I20260709 13:08:18.185949 27654 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 765d0bd527c64f74be713c390a018bba. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:18.207978 27577 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c9ea919812394c7aba307c2ff5b81f51. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:18.215376 27693 heartbeater.cc:499] Master 127.17.223.62:40677 was elected leader, sending a full tablet report...
I20260709 13:08:18.215902 27863 ts_tablet_manager.cc:1434] T 56803a5c0dea4efeabafb6829d9215cd P 41268b218b804905a110c86738e74400: Time spent starting tablet: real 0.067s	user 0.010s	sys 0.004s
I20260709 13:08:18.217006 27863 tablet_bootstrap.cc:492] T a9eac7f072de454a8ff2beb019da45d9 P 41268b218b804905a110c86738e74400: Bootstrap starting.
I20260709 13:08:18.220654 27798 tablet_service.cc:1511] Processing CreateTablet for tablet 80e2477670ec4db18ad338931d714544 (DEFAULT_TABLE table=test-workload [id=726d57952dab4de7b40bbe78e31e0eaf]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 13:08:18.222112 27798 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 80e2477670ec4db18ad338931d714544. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:18.223567 27863 tablet_bootstrap.cc:654] T a9eac7f072de454a8ff2beb019da45d9 P 41268b218b804905a110c86738e74400: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:18.223959 27865 tablet_bootstrap.cc:492] T d0c8b4ec2d844a89b4bb66c0f1bf2c8f P 18435fbb525741328139e84a1e354954: No bootstrap required, opened a new log
I20260709 13:08:18.227766 27865 ts_tablet_manager.cc:1403] T d0c8b4ec2d844a89b4bb66c0f1bf2c8f P 18435fbb525741328139e84a1e354954: Time spent bootstrapping tablet: real 0.217s	user 0.027s	sys 0.007s
I20260709 13:08:18.233953 27861 ts_tablet_manager.cc:1434] T 1a26f012cd6e4c4c8bf86b5fda903800 P 2513a663afac495eb09126ff55e8b2b0: Time spent starting tablet: real 0.160s	user 0.011s	sys 0.003s
I20260709 13:08:18.235755 27861 tablet_bootstrap.cc:492] T dd959195de1942f7999397a56496f5bc P 2513a663afac495eb09126ff55e8b2b0: Bootstrap starting.
I20260709 13:08:18.240191 27865 raft_consensus.cc:359] T d0c8b4ec2d844a89b4bb66c0f1bf2c8f P 18435fbb525741328139e84a1e354954 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18435fbb525741328139e84a1e354954" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 40545 } } peers { permanent_uuid: "2513a663afac495eb09126ff55e8b2b0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40721 } } peers { permanent_uuid: "41268b218b804905a110c86738e74400" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 44403 } }
I20260709 13:08:18.242722 27865 raft_consensus.cc:385] T d0c8b4ec2d844a89b4bb66c0f1bf2c8f P 18435fbb525741328139e84a1e354954 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:18.244575 27865 raft_consensus.cc:740] T d0c8b4ec2d844a89b4bb66c0f1bf2c8f P 18435fbb525741328139e84a1e354954 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 18435fbb525741328139e84a1e354954, State: Initialized, Role: FOLLOWER
I20260709 13:08:18.246028 27576 tablet_service.cc:1511] Processing CreateTablet for tablet 80e2477670ec4db18ad338931d714544 (DEFAULT_TABLE table=test-workload [id=726d57952dab4de7b40bbe78e31e0eaf]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 13:08:18.248461 27576 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 80e2477670ec4db18ad338931d714544. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:18.245973 27865 consensus_queue.cc:260] T d0c8b4ec2d844a89b4bb66c0f1bf2c8f P 18435fbb525741328139e84a1e354954 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18435fbb525741328139e84a1e354954" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 40545 } } peers { permanent_uuid: "2513a663afac495eb09126ff55e8b2b0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40721 } } peers { permanent_uuid: "41268b218b804905a110c86738e74400" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 44403 } }
I20260709 13:08:18.256426 27862 tablet_bootstrap.cc:492] T fc84b896d2ae4581bc236b96d5de9de3 P 665f7e09521a4c3f9284c1d8b0e094ff: No bootstrap required, opened a new log
I20260709 13:08:18.257057 27862 ts_tablet_manager.cc:1403] T fc84b896d2ae4581bc236b96d5de9de3 P 665f7e09521a4c3f9284c1d8b0e094ff: Time spent bootstrapping tablet: real 0.166s	user 0.023s	sys 0.007s
I20260709 13:08:18.257299 27728 tablet_service.cc:1511] Processing CreateTablet for tablet 1d9bdb76a5094186b5ac6c8f8e1c9840 (DEFAULT_TABLE table=test-workload [id=726d57952dab4de7b40bbe78e31e0eaf]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 13:08:18.269536 27862 raft_consensus.cc:359] T fc84b896d2ae4581bc236b96d5de9de3 P 665f7e09521a4c3f9284c1d8b0e094ff [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "41268b218b804905a110c86738e74400" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 44403 } } peers { permanent_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 38749 } } peers { permanent_uuid: "18435fbb525741328139e84a1e354954" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 40545 } }
I20260709 13:08:18.270329 27862 raft_consensus.cc:385] T fc84b896d2ae4581bc236b96d5de9de3 P 665f7e09521a4c3f9284c1d8b0e094ff [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:18.270653 27862 raft_consensus.cc:740] T fc84b896d2ae4581bc236b96d5de9de3 P 665f7e09521a4c3f9284c1d8b0e094ff [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 665f7e09521a4c3f9284c1d8b0e094ff, State: Initialized, Role: FOLLOWER
I20260709 13:08:18.270804 27728 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1d9bdb76a5094186b5ac6c8f8e1c9840. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:18.271616 27862 consensus_queue.cc:260] T fc84b896d2ae4581bc236b96d5de9de3 P 665f7e09521a4c3f9284c1d8b0e094ff [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "41268b218b804905a110c86738e74400" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 44403 } } peers { permanent_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 38749 } } peers { permanent_uuid: "18435fbb525741328139e84a1e354954" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 40545 } }
I20260709 13:08:18.273612 27649 tablet_service.cc:1511] Processing CreateTablet for tablet 1d9bdb76a5094186b5ac6c8f8e1c9840 (DEFAULT_TABLE table=test-workload [id=726d57952dab4de7b40bbe78e31e0eaf]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 13:08:18.291952 27800 tablet_service.cc:1511] Processing CreateTablet for tablet 1d9bdb76a5094186b5ac6c8f8e1c9840 (DEFAULT_TABLE table=test-workload [id=726d57952dab4de7b40bbe78e31e0eaf]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 13:08:18.293304 27800 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1d9bdb76a5094186b5ac6c8f8e1c9840. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:18.300012 27865 ts_tablet_manager.cc:1434] T d0c8b4ec2d844a89b4bb66c0f1bf2c8f P 18435fbb525741328139e84a1e354954: Time spent starting tablet: real 0.070s	user 0.006s	sys 0.008s
I20260709 13:08:18.304710 27861 tablet_bootstrap.cc:654] T dd959195de1942f7999397a56496f5bc P 2513a663afac495eb09126ff55e8b2b0: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:18.310998 27841 heartbeater.cc:499] Master 127.17.223.62:40677 was elected leader, sending a full tablet report...
I20260709 13:08:18.315001 27649 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1d9bdb76a5094186b5ac6c8f8e1c9840. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:18.315407 27863 tablet_bootstrap.cc:492] T a9eac7f072de454a8ff2beb019da45d9 P 41268b218b804905a110c86738e74400: No bootstrap required, opened a new log
I20260709 13:08:18.315961 27863 ts_tablet_manager.cc:1403] T a9eac7f072de454a8ff2beb019da45d9 P 41268b218b804905a110c86738e74400: Time spent bootstrapping tablet: real 0.099s	user 0.027s	sys 0.013s
I20260709 13:08:18.323315 27865 tablet_bootstrap.cc:492] T fc84b896d2ae4581bc236b96d5de9de3 P 18435fbb525741328139e84a1e354954: Bootstrap starting.
I20260709 13:08:18.324013 27863 raft_consensus.cc:359] T a9eac7f072de454a8ff2beb019da45d9 P 41268b218b804905a110c86738e74400 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18435fbb525741328139e84a1e354954" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 40545 } } peers { permanent_uuid: "2513a663afac495eb09126ff55e8b2b0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40721 } } peers { permanent_uuid: "41268b218b804905a110c86738e74400" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 44403 } }
W20260709 13:08:18.324615 27768 tablet.cc:2406] T 1a26f012cd6e4c4c8bf86b5fda903800 P 665f7e09521a4c3f9284c1d8b0e094ff: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260709 13:08:18.325392 27862 ts_tablet_manager.cc:1434] T fc84b896d2ae4581bc236b96d5de9de3 P 665f7e09521a4c3f9284c1d8b0e094ff: Time spent starting tablet: real 0.068s	user 0.009s	sys 0.000s
I20260709 13:08:18.336934 27579 tablet_service.cc:1511] Processing CreateTablet for tablet 5e6f8bdfe11b4af4aa27a711db7cbe7a (DEFAULT_TABLE table=test-workload [id=726d57952dab4de7b40bbe78e31e0eaf]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 13:08:18.347400 27728 tablet_service.cc:1511] Processing CreateTablet for tablet 5e6f8bdfe11b4af4aa27a711db7cbe7a (DEFAULT_TABLE table=test-workload [id=726d57952dab4de7b40bbe78e31e0eaf]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 13:08:18.348562 27579 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5e6f8bdfe11b4af4aa27a711db7cbe7a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:18.328069 27863 raft_consensus.cc:385] T a9eac7f072de454a8ff2beb019da45d9 P 41268b218b804905a110c86738e74400 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:18.349092 27863 raft_consensus.cc:740] T a9eac7f072de454a8ff2beb019da45d9 P 41268b218b804905a110c86738e74400 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 41268b218b804905a110c86738e74400, State: Initialized, Role: FOLLOWER
I20260709 13:08:18.349969 27863 consensus_queue.cc:260] T a9eac7f072de454a8ff2beb019da45d9 P 41268b218b804905a110c86738e74400 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18435fbb525741328139e84a1e354954" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 40545 } } peers { permanent_uuid: "2513a663afac495eb09126ff55e8b2b0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40721 } } peers { permanent_uuid: "41268b218b804905a110c86738e74400" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 44403 } }
I20260709 13:08:18.344228 27861 tablet_bootstrap.cc:492] T dd959195de1942f7999397a56496f5bc P 2513a663afac495eb09126ff55e8b2b0: No bootstrap required, opened a new log
I20260709 13:08:18.355064 27861 ts_tablet_manager.cc:1403] T dd959195de1942f7999397a56496f5bc P 2513a663afac495eb09126ff55e8b2b0: Time spent bootstrapping tablet: real 0.120s	user 0.011s	sys 0.003s
I20260709 13:08:18.350894 27654 tablet_service.cc:1511] Processing CreateTablet for tablet 5e6f8bdfe11b4af4aa27a711db7cbe7a (DEFAULT_TABLE table=test-workload [id=726d57952dab4de7b40bbe78e31e0eaf]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 13:08:18.358542 27654 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5e6f8bdfe11b4af4aa27a711db7cbe7a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:18.359192 27863 ts_tablet_manager.cc:1434] T a9eac7f072de454a8ff2beb019da45d9 P 41268b218b804905a110c86738e74400: Time spent starting tablet: real 0.043s	user 0.005s	sys 0.004s
I20260709 13:08:18.358150 27861 raft_consensus.cc:359] T dd959195de1942f7999397a56496f5bc P 2513a663afac495eb09126ff55e8b2b0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2513a663afac495eb09126ff55e8b2b0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40721 } } peers { permanent_uuid: "41268b218b804905a110c86738e74400" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 44403 } } peers { permanent_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 38749 } }
I20260709 13:08:18.360451 27861 raft_consensus.cc:385] T dd959195de1942f7999397a56496f5bc P 2513a663afac495eb09126ff55e8b2b0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:18.360777 27861 raft_consensus.cc:740] T dd959195de1942f7999397a56496f5bc P 2513a663afac495eb09126ff55e8b2b0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2513a663afac495eb09126ff55e8b2b0, State: Initialized, Role: FOLLOWER
I20260709 13:08:18.361663 27861 consensus_queue.cc:260] T dd959195de1942f7999397a56496f5bc P 2513a663afac495eb09126ff55e8b2b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2513a663afac495eb09126ff55e8b2b0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40721 } } peers { permanent_uuid: "41268b218b804905a110c86738e74400" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 44403 } } peers { permanent_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 38749 } }
I20260709 13:08:18.362416 27576 tablet_service.cc:1511] Processing CreateTablet for tablet e9b149d77d9941158ead8e9e592e7b27 (DEFAULT_TABLE table=test-workload [id=726d57952dab4de7b40bbe78e31e0eaf]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 13:08:18.363802 27576 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e9b149d77d9941158ead8e9e592e7b27. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:18.363850 27861 ts_tablet_manager.cc:1434] T dd959195de1942f7999397a56496f5bc P 2513a663afac495eb09126ff55e8b2b0: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 13:08:18.364904 27861 tablet_bootstrap.cc:492] T 55a3afc21cea43ea85f4a2155552422d P 2513a663afac495eb09126ff55e8b2b0: Bootstrap starting.
I20260709 13:08:18.366766 27863 tablet_bootstrap.cc:492] T 456941807b254f5fb32dca4f84bd16ea P 41268b218b804905a110c86738e74400: Bootstrap starting.
I20260709 13:08:18.367133 27800 tablet_service.cc:1511] Processing CreateTablet for tablet e9b149d77d9941158ead8e9e592e7b27 (DEFAULT_TABLE table=test-workload [id=726d57952dab4de7b40bbe78e31e0eaf]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 13:08:18.368366 27800 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e9b149d77d9941158ead8e9e592e7b27. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:18.373139 27863 tablet_bootstrap.cc:654] T 456941807b254f5fb32dca4f84bd16ea P 41268b218b804905a110c86738e74400: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:18.345865 27865 tablet_bootstrap.cc:654] T fc84b896d2ae4581bc236b96d5de9de3 P 18435fbb525741328139e84a1e354954: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:18.350801 27728 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5e6f8bdfe11b4af4aa27a711db7cbe7a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:18.344115 27862 tablet_bootstrap.cc:492] T 64490a86db8c4f5ca54f4f8085f41319 P 665f7e09521a4c3f9284c1d8b0e094ff: Bootstrap starting.
I20260709 13:08:18.383455 27654 tablet_service.cc:1511] Processing CreateTablet for tablet e9b149d77d9941158ead8e9e592e7b27 (DEFAULT_TABLE table=test-workload [id=726d57952dab4de7b40bbe78e31e0eaf]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 13:08:18.384779 27654 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e9b149d77d9941158ead8e9e592e7b27. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:18.387246 27861 tablet_bootstrap.cc:654] T 55a3afc21cea43ea85f4a2155552422d P 2513a663afac495eb09126ff55e8b2b0: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:18.392107 27730 tablet_service.cc:1511] Processing CreateTablet for tablet ff09d7e79a3e43918f3c71d10a40d60b (DEFAULT_TABLE table=test-workload [id=726d57952dab4de7b40bbe78e31e0eaf]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 13:08:18.393568 27730 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ff09d7e79a3e43918f3c71d10a40d60b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:18.393875 27798 tablet_service.cc:1511] Processing CreateTablet for tablet ff09d7e79a3e43918f3c71d10a40d60b (DEFAULT_TABLE table=test-workload [id=726d57952dab4de7b40bbe78e31e0eaf]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 13:08:18.395134 27798 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ff09d7e79a3e43918f3c71d10a40d60b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:18.396404 27577 tablet_service.cc:1511] Processing CreateTablet for tablet ff09d7e79a3e43918f3c71d10a40d60b (DEFAULT_TABLE table=test-workload [id=726d57952dab4de7b40bbe78e31e0eaf]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 13:08:18.397641 27577 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ff09d7e79a3e43918f3c71d10a40d60b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:18.397940 27649 tablet_service.cc:1511] Processing CreateTablet for tablet 5f4a8242380b4863bf5ad2c055229bb7 (DEFAULT_TABLE table=test-workload [id=726d57952dab4de7b40bbe78e31e0eaf]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 13:08:18.399197 27649 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5f4a8242380b4863bf5ad2c055229bb7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:18.401785 27803 tablet_service.cc:1511] Processing CreateTablet for tablet 5f4a8242380b4863bf5ad2c055229bb7 (DEFAULT_TABLE table=test-workload [id=726d57952dab4de7b40bbe78e31e0eaf]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 13:08:18.401944 27731 tablet_service.cc:1511] Processing CreateTablet for tablet 5f4a8242380b4863bf5ad2c055229bb7 (DEFAULT_TABLE table=test-workload [id=726d57952dab4de7b40bbe78e31e0eaf]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 13:08:18.403057 27803 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5f4a8242380b4863bf5ad2c055229bb7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:18.403214 27731 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5f4a8242380b4863bf5ad2c055229bb7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:18.409148 27865 tablet_bootstrap.cc:492] T fc84b896d2ae4581bc236b96d5de9de3 P 18435fbb525741328139e84a1e354954: No bootstrap required, opened a new log
I20260709 13:08:18.409699 27865 ts_tablet_manager.cc:1403] T fc84b896d2ae4581bc236b96d5de9de3 P 18435fbb525741328139e84a1e354954: Time spent bootstrapping tablet: real 0.087s	user 0.005s	sys 0.007s
I20260709 13:08:18.411458 27862 tablet_bootstrap.cc:654] T 64490a86db8c4f5ca54f4f8085f41319 P 665f7e09521a4c3f9284c1d8b0e094ff: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:18.416654 27581 tablet_service.cc:1511] Processing CreateTablet for tablet 47b65672307641ae81d5f94c639b1a10 (DEFAULT_TABLE table=test-workload [id=726d57952dab4de7b40bbe78e31e0eaf]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 13:08:18.417153 27865 raft_consensus.cc:359] T fc84b896d2ae4581bc236b96d5de9de3 P 18435fbb525741328139e84a1e354954 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "41268b218b804905a110c86738e74400" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 44403 } } peers { permanent_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 38749 } } peers { permanent_uuid: "18435fbb525741328139e84a1e354954" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 40545 } }
I20260709 13:08:18.417903 27865 raft_consensus.cc:385] T fc84b896d2ae4581bc236b96d5de9de3 P 18435fbb525741328139e84a1e354954 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:18.418011 27581 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 47b65672307641ae81d5f94c639b1a10. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:18.418231 27865 raft_consensus.cc:740] T fc84b896d2ae4581bc236b96d5de9de3 P 18435fbb525741328139e84a1e354954 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 18435fbb525741328139e84a1e354954, State: Initialized, Role: FOLLOWER
I20260709 13:08:18.422751 27863 tablet_bootstrap.cc:492] T 456941807b254f5fb32dca4f84bd16ea P 41268b218b804905a110c86738e74400: No bootstrap required, opened a new log
I20260709 13:08:18.423285 27863 ts_tablet_manager.cc:1403] T 456941807b254f5fb32dca4f84bd16ea P 41268b218b804905a110c86738e74400: Time spent bootstrapping tablet: real 0.063s	user 0.012s	sys 0.000s
I20260709 13:08:18.429915 27861 tablet_bootstrap.cc:492] T 55a3afc21cea43ea85f4a2155552422d P 2513a663afac495eb09126ff55e8b2b0: No bootstrap required, opened a new log
I20260709 13:08:18.430425 27861 ts_tablet_manager.cc:1403] T 55a3afc21cea43ea85f4a2155552422d P 2513a663afac495eb09126ff55e8b2b0: Time spent bootstrapping tablet: real 0.066s	user 0.006s	sys 0.004s
I20260709 13:08:18.433154 27870 raft_consensus.cc:493] T 1a26f012cd6e4c4c8bf86b5fda903800 P 2513a663afac495eb09126ff55e8b2b0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:18.433640 27870 raft_consensus.cc:515] T 1a26f012cd6e4c4c8bf86b5fda903800 P 2513a663afac495eb09126ff55e8b2b0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "41268b218b804905a110c86738e74400" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 44403 } } peers { permanent_uuid: "2513a663afac495eb09126ff55e8b2b0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40721 } } peers { permanent_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 38749 } }
I20260709 13:08:18.433894 27728 tablet_service.cc:1511] Processing CreateTablet for tablet 47b65672307641ae81d5f94c639b1a10 (DEFAULT_TABLE table=test-workload [id=726d57952dab4de7b40bbe78e31e0eaf]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 13:08:18.435374 27575 tablet_service.cc:1511] Processing CreateTablet for tablet bc77856749a0473a8b3124ce8c523815 (DEFAULT_TABLE table=test-workload [id=726d57952dab4de7b40bbe78e31e0eaf]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 13:08:18.436257 27870 leader_election.cc:290] T 1a26f012cd6e4c4c8bf86b5fda903800 P 2513a663afac495eb09126ff55e8b2b0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 41268b218b804905a110c86738e74400 (127.17.223.2:44403), 665f7e09521a4c3f9284c1d8b0e094ff (127.17.223.3:38749)
I20260709 13:08:18.436524 27728 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 47b65672307641ae81d5f94c639b1a10. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:18.436721 27575 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bc77856749a0473a8b3124ce8c523815. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:18.436898 27865 consensus_queue.cc:260] T fc84b896d2ae4581bc236b96d5de9de3 P 18435fbb525741328139e84a1e354954 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "41268b218b804905a110c86738e74400" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 44403 } } peers { permanent_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 38749 } } peers { permanent_uuid: "18435fbb525741328139e84a1e354954" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 40545 } }
I20260709 13:08:18.440075 27861 raft_consensus.cc:359] T 55a3afc21cea43ea85f4a2155552422d P 2513a663afac495eb09126ff55e8b2b0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 38749 } } peers { permanent_uuid: "18435fbb525741328139e84a1e354954" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 40545 } } peers { permanent_uuid: "2513a663afac495eb09126ff55e8b2b0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40721 } }
I20260709 13:08:18.440833 27861 raft_consensus.cc:385] T 55a3afc21cea43ea85f4a2155552422d P 2513a663afac495eb09126ff55e8b2b0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:18.441121 27861 raft_consensus.cc:740] T 55a3afc21cea43ea85f4a2155552422d P 2513a663afac495eb09126ff55e8b2b0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2513a663afac495eb09126ff55e8b2b0, State: Initialized, Role: FOLLOWER
I20260709 13:08:18.441820 27861 consensus_queue.cc:260] T 55a3afc21cea43ea85f4a2155552422d P 2513a663afac495eb09126ff55e8b2b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 38749 } } peers { permanent_uuid: "18435fbb525741328139e84a1e354954" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 40545 } } peers { permanent_uuid: "2513a663afac495eb09126ff55e8b2b0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40721 } }
I20260709 13:08:18.442211 27865 ts_tablet_manager.cc:1434] T fc84b896d2ae4581bc236b96d5de9de3 P 18435fbb525741328139e84a1e354954: Time spent starting tablet: real 0.032s	user 0.008s	sys 0.000s
I20260709 13:08:18.426294 27863 raft_consensus.cc:359] T 456941807b254f5fb32dca4f84bd16ea P 41268b218b804905a110c86738e74400 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2513a663afac495eb09126ff55e8b2b0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40721 } } peers { permanent_uuid: "41268b218b804905a110c86738e74400" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 44403 } } peers { permanent_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 38749 } }
I20260709 13:08:18.443011 27863 raft_consensus.cc:385] T 456941807b254f5fb32dca4f84bd16ea P 41268b218b804905a110c86738e74400 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:18.443432 27863 raft_consensus.cc:740] T 456941807b254f5fb32dca4f84bd16ea P 41268b218b804905a110c86738e74400 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 41268b218b804905a110c86738e74400, State: Initialized, Role: FOLLOWER
I20260709 13:08:18.444360 27863 consensus_queue.cc:260] T 456941807b254f5fb32dca4f84bd16ea P 41268b218b804905a110c86738e74400 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2513a663afac495eb09126ff55e8b2b0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40721 } } peers { permanent_uuid: "41268b218b804905a110c86738e74400" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 44403 } } peers { permanent_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 38749 } }
I20260709 13:08:18.444554 27654 tablet_service.cc:1511] Processing CreateTablet for tablet 47b65672307641ae81d5f94c639b1a10 (DEFAULT_TABLE table=test-workload [id=726d57952dab4de7b40bbe78e31e0eaf]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 13:08:18.435374 27800 tablet_service.cc:1511] Processing CreateTablet for tablet bc77856749a0473a8b3124ce8c523815 (DEFAULT_TABLE table=test-workload [id=726d57952dab4de7b40bbe78e31e0eaf]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 13:08:18.443529 27865 tablet_bootstrap.cc:492] T bc0b10615ecb4485a9a9de298938697d P 18435fbb525741328139e84a1e354954: Bootstrap starting.
I20260709 13:08:18.451182 27800 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bc77856749a0473a8b3124ce8c523815. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:18.455224 27867 raft_consensus.cc:493] T fc84b896d2ae4581bc236b96d5de9de3 P 665f7e09521a4c3f9284c1d8b0e094ff [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:18.455730 27867 raft_consensus.cc:515] T fc84b896d2ae4581bc236b96d5de9de3 P 665f7e09521a4c3f9284c1d8b0e094ff [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "41268b218b804905a110c86738e74400" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 44403 } } peers { permanent_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 38749 } } peers { permanent_uuid: "18435fbb525741328139e84a1e354954" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 40545 } }
I20260709 13:08:18.458370 27867 leader_election.cc:290] T fc84b896d2ae4581bc236b96d5de9de3 P 665f7e09521a4c3f9284c1d8b0e094ff [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 41268b218b804905a110c86738e74400 (127.17.223.2:44403), 18435fbb525741328139e84a1e354954 (127.17.223.4:40545)
I20260709 13:08:18.446177 27654 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 47b65672307641ae81d5f94c639b1a10. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:18.462925 27862 tablet_bootstrap.cc:492] T 64490a86db8c4f5ca54f4f8085f41319 P 665f7e09521a4c3f9284c1d8b0e094ff: No bootstrap required, opened a new log
I20260709 13:08:18.471396 27872 raft_consensus.cc:493] T 56803a5c0dea4efeabafb6829d9215cd P 41268b218b804905a110c86738e74400 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:18.472170 27867 raft_consensus.cc:493] T 1a26f012cd6e4c4c8bf86b5fda903800 P 665f7e09521a4c3f9284c1d8b0e094ff [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:18.473678 27872 raft_consensus.cc:515] T 56803a5c0dea4efeabafb6829d9215cd P 41268b218b804905a110c86738e74400 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "41268b218b804905a110c86738e74400" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 44403 } } peers { permanent_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 38749 } } peers { permanent_uuid: "18435fbb525741328139e84a1e354954" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 40545 } }
I20260709 13:08:18.473781 27867 raft_consensus.cc:515] T 1a26f012cd6e4c4c8bf86b5fda903800 P 665f7e09521a4c3f9284c1d8b0e094ff [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "41268b218b804905a110c86738e74400" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 44403 } } peers { permanent_uuid: "2513a663afac495eb09126ff55e8b2b0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40721 } } peers { permanent_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 38749 } }
I20260709 13:08:18.475687 27649 tablet_service.cc:1511] Processing CreateTablet for tablet bc77856749a0473a8b3124ce8c523815 (DEFAULT_TABLE table=test-workload [id=726d57952dab4de7b40bbe78e31e0eaf]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 13:08:18.477174 27649 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bc77856749a0473a8b3124ce8c523815. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:18.480026 27863 ts_tablet_manager.cc:1434] T 456941807b254f5fb32dca4f84bd16ea P 41268b218b804905a110c86738e74400: Time spent starting tablet: real 0.056s	user 0.007s	sys 0.000s
I20260709 13:08:18.480492 27872 leader_election.cc:290] T 56803a5c0dea4efeabafb6829d9215cd P 41268b218b804905a110c86738e74400 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 665f7e09521a4c3f9284c1d8b0e094ff (127.17.223.3:38749), 18435fbb525741328139e84a1e354954 (127.17.223.4:40545)
I20260709 13:08:18.484405 27862 ts_tablet_manager.cc:1403] T 64490a86db8c4f5ca54f4f8085f41319 P 665f7e09521a4c3f9284c1d8b0e094ff: Time spent bootstrapping tablet: real 0.141s	user 0.010s	sys 0.003s
I20260709 13:08:18.510105 27867 leader_election.cc:290] T 1a26f012cd6e4c4c8bf86b5fda903800 P 665f7e09521a4c3f9284c1d8b0e094ff [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 41268b218b804905a110c86738e74400 (127.17.223.2:44403), 2513a663afac495eb09126ff55e8b2b0 (127.17.223.1:40721)
I20260709 13:08:18.509850 27863 tablet_bootstrap.cc:492] T dd959195de1942f7999397a56496f5bc P 41268b218b804905a110c86738e74400: Bootstrap starting.
I20260709 13:08:18.520568 27727 tablet_service.cc:1511] Processing CreateTablet for tablet 78e19c035a854ee98657bec3edcb3585 (DEFAULT_TABLE table=test-workload [id=726d57952dab4de7b40bbe78e31e0eaf]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 13:08:18.541332 27874 raft_consensus.cc:493] T d0c8b4ec2d844a89b4bb66c0f1bf2c8f P 18435fbb525741328139e84a1e354954 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:18.529121 27578 tablet_service.cc:1511] Processing CreateTablet for tablet 78e19c035a854ee98657bec3edcb3585 (DEFAULT_TABLE table=test-workload [id=726d57952dab4de7b40bbe78e31e0eaf]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 13:08:18.560165 27798 tablet_service.cc:1511] Processing CreateTablet for tablet 78e19c035a854ee98657bec3edcb3585 (DEFAULT_TABLE table=test-workload [id=726d57952dab4de7b40bbe78e31e0eaf]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 13:08:18.562058 27798 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 78e19c035a854ee98657bec3edcb3585. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:18.563606 27727 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 78e19c035a854ee98657bec3edcb3585. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:18.548548 27874 raft_consensus.cc:515] T d0c8b4ec2d844a89b4bb66c0f1bf2c8f P 18435fbb525741328139e84a1e354954 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18435fbb525741328139e84a1e354954" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 40545 } } peers { permanent_uuid: "2513a663afac495eb09126ff55e8b2b0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40721 } } peers { permanent_uuid: "41268b218b804905a110c86738e74400" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 44403 } }
I20260709 13:08:18.568995 27732 tablet_service.cc:1511] Processing CreateTablet for tablet 106e04f510c741439b91c39d5fac5a23 (DEFAULT_TABLE table=test-workload [id=726d57952dab4de7b40bbe78e31e0eaf]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 13:08:18.570909 27732 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 106e04f510c741439b91c39d5fac5a23. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:18.576581 27865 tablet_bootstrap.cc:654] T bc0b10615ecb4485a9a9de298938697d P 18435fbb525741328139e84a1e354954: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:18.579411 27861 ts_tablet_manager.cc:1434] T 55a3afc21cea43ea85f4a2155552422d P 2513a663afac495eb09126ff55e8b2b0: Time spent starting tablet: real 0.149s	user 0.008s	sys 0.000s
I20260709 13:08:18.583984 27874 leader_election.cc:290] T d0c8b4ec2d844a89b4bb66c0f1bf2c8f P 18435fbb525741328139e84a1e354954 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2513a663afac495eb09126ff55e8b2b0 (127.17.223.1:40721), 41268b218b804905a110c86738e74400 (127.17.223.2:44403)
I20260709 13:08:18.597337 27862 raft_consensus.cc:359] T 64490a86db8c4f5ca54f4f8085f41319 P 665f7e09521a4c3f9284c1d8b0e094ff [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 38749 } } peers { permanent_uuid: "18435fbb525741328139e84a1e354954" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 40545 } } peers { permanent_uuid: "2513a663afac495eb09126ff55e8b2b0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40721 } }
I20260709 13:08:18.598156 27862 raft_consensus.cc:385] T 64490a86db8c4f5ca54f4f8085f41319 P 665f7e09521a4c3f9284c1d8b0e094ff [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:18.607373 27583 tablet_service.cc:1511] Processing CreateTablet for tablet 93c69c92efc3402e8e9546cb961bbcdc (DEFAULT_TABLE table=test-workload [id=726d57952dab4de7b40bbe78e31e0eaf]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 13:08:18.598500 27862 raft_consensus.cc:740] T 64490a86db8c4f5ca54f4f8085f41319 P 665f7e09521a4c3f9284c1d8b0e094ff [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 665f7e09521a4c3f9284c1d8b0e094ff, State: Initialized, Role: FOLLOWER
I20260709 13:08:18.616636 27723 tablet_service.cc:1511] Processing CreateTablet for tablet 93c69c92efc3402e8e9546cb961bbcdc (DEFAULT_TABLE table=test-workload [id=726d57952dab4de7b40bbe78e31e0eaf]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 13:08:18.631891 27723 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 93c69c92efc3402e8e9546cb961bbcdc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:18.636843 27593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a26f012cd6e4c4c8bf86b5fda903800" candidate_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2513a663afac495eb09126ff55e8b2b0" is_pre_election: true
I20260709 13:08:18.637966 27593 raft_consensus.cc:2468] T 1a26f012cd6e4c4c8bf86b5fda903800 P 2513a663afac495eb09126ff55e8b2b0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 665f7e09521a4c3f9284c1d8b0e094ff in term 0.
I20260709 13:08:18.639971 27705 leader_election.cc:304] T 1a26f012cd6e4c4c8bf86b5fda903800 P 665f7e09521a4c3f9284c1d8b0e094ff [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2513a663afac495eb09126ff55e8b2b0, 665f7e09521a4c3f9284c1d8b0e094ff; no voters: 
I20260709 13:08:18.641038 27867 raft_consensus.cc:2804] T 1a26f012cd6e4c4c8bf86b5fda903800 P 665f7e09521a4c3f9284c1d8b0e094ff [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:08:18.641407 27867 raft_consensus.cc:493] T 1a26f012cd6e4c4c8bf86b5fda903800 P 665f7e09521a4c3f9284c1d8b0e094ff [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:18.641603 27578 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 78e19c035a854ee98657bec3edcb3585. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:18.641770 27867 raft_consensus.cc:3060] T 1a26f012cd6e4c4c8bf86b5fda903800 P 665f7e09521a4c3f9284c1d8b0e094ff [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:18.620133 27863 tablet_bootstrap.cc:654] T dd959195de1942f7999397a56496f5bc P 41268b218b804905a110c86738e74400: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:18.647197 27656 tablet_service.cc:1511] Processing CreateTablet for tablet 106e04f510c741439b91c39d5fac5a23 (DEFAULT_TABLE table=test-workload [id=726d57952dab4de7b40bbe78e31e0eaf]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 13:08:18.648479 27656 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 106e04f510c741439b91c39d5fac5a23. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:18.651258 27583 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 93c69c92efc3402e8e9546cb961bbcdc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:18.651718 27861 tablet_bootstrap.cc:492] T a9eac7f072de454a8ff2beb019da45d9 P 2513a663afac495eb09126ff55e8b2b0: Bootstrap starting.
I20260709 13:08:18.662882 27803 tablet_service.cc:1511] Processing CreateTablet for tablet 106e04f510c741439b91c39d5fac5a23 (DEFAULT_TABLE table=test-workload [id=726d57952dab4de7b40bbe78e31e0eaf]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 13:08:18.663199 27805 tablet_service.cc:1511] Processing CreateTablet for tablet 4cd7359accee42808761c37543247321 (DEFAULT_TABLE table=test-workload [id=726d57952dab4de7b40bbe78e31e0eaf]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 13:08:18.664186 27803 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 106e04f510c741439b91c39d5fac5a23. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:18.665532 27805 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4cd7359accee42808761c37543247321. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:18.686398 27867 raft_consensus.cc:515] T 1a26f012cd6e4c4c8bf86b5fda903800 P 665f7e09521a4c3f9284c1d8b0e094ff [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "41268b218b804905a110c86738e74400" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 44403 } } peers { permanent_uuid: "2513a663afac495eb09126ff55e8b2b0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40721 } } peers { permanent_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 38749 } }
I20260709 13:08:18.688053 27668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc84b896d2ae4581bc236b96d5de9de3" candidate_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "41268b218b804905a110c86738e74400" is_pre_election: true
I20260709 13:08:18.689721 27667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a26f012cd6e4c4c8bf86b5fda903800" candidate_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "41268b218b804905a110c86738e74400" is_pre_election: true
I20260709 13:08:18.696157 27870 raft_consensus.cc:493] T dd959195de1942f7999397a56496f5bc P 2513a663afac495eb09126ff55e8b2b0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:18.696798 27870 raft_consensus.cc:515] T dd959195de1942f7999397a56496f5bc P 2513a663afac495eb09126ff55e8b2b0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2513a663afac495eb09126ff55e8b2b0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40721 } } peers { permanent_uuid: "41268b218b804905a110c86738e74400" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 44403 } } peers { permanent_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 38749 } }
I20260709 13:08:18.698529 27581 tablet_service.cc:1511] Processing CreateTablet for tablet 4cd7359accee42808761c37543247321 (DEFAULT_TABLE table=test-workload [id=726d57952dab4de7b40bbe78e31e0eaf]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 13:08:18.689716 27593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a26f012cd6e4c4c8bf86b5fda903800" candidate_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2513a663afac495eb09126ff55e8b2b0"
I20260709 13:08:18.699505 27593 raft_consensus.cc:3060] T 1a26f012cd6e4c4c8bf86b5fda903800 P 2513a663afac495eb09126ff55e8b2b0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:18.700033 27581 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4cd7359accee42808761c37543247321. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:18.700482 27742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a26f012cd6e4c4c8bf86b5fda903800" candidate_uuid: "2513a663afac495eb09126ff55e8b2b0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" is_pre_election: true
I20260709 13:08:18.701452 27742 raft_consensus.cc:2393] T 1a26f012cd6e4c4c8bf86b5fda903800 P 665f7e09521a4c3f9284c1d8b0e094ff [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2513a663afac495eb09126ff55e8b2b0 in current term 1: Already voted for candidate 665f7e09521a4c3f9284c1d8b0e094ff in this term.
I20260709 13:08:18.694046 27651 tablet_service.cc:1511] Processing CreateTablet for tablet 4cd7359accee42808761c37543247321 (DEFAULT_TABLE table=test-workload [id=726d57952dab4de7b40bbe78e31e0eaf]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 13:08:18.686655 27861 tablet_bootstrap.cc:654] T a9eac7f072de454a8ff2beb019da45d9 P 2513a663afac495eb09126ff55e8b2b0: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:18.709601 27667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a26f012cd6e4c4c8bf86b5fda903800" candidate_uuid: "2513a663afac495eb09126ff55e8b2b0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "41268b218b804905a110c86738e74400" is_pre_election: true
W20260709 13:08:18.710399 27708 leader_election.cc:343] T fc84b896d2ae4581bc236b96d5de9de3 P 665f7e09521a4c3f9284c1d8b0e094ff [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 41268b218b804905a110c86738e74400 (127.17.223.2:44403): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:18.681845 27862 consensus_queue.cc:260] T 64490a86db8c4f5ca54f4f8085f41319 P 665f7e09521a4c3f9284c1d8b0e094ff [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 38749 } } peers { permanent_uuid: "18435fbb525741328139e84a1e354954" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 40545 } } peers { permanent_uuid: "2513a663afac495eb09126ff55e8b2b0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40721 } }
I20260709 13:08:18.710935 27654 tablet_service.cc:1511] Processing CreateTablet for tablet 93c69c92efc3402e8e9546cb961bbcdc (DEFAULT_TABLE table=test-workload [id=726d57952dab4de7b40bbe78e31e0eaf]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
W20260709 13:08:18.717201 27708 leader_election.cc:343] T 1a26f012cd6e4c4c8bf86b5fda903800 P 665f7e09521a4c3f9284c1d8b0e094ff [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 41268b218b804905a110c86738e74400 (127.17.223.2:44403): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:18.718125 27654 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 93c69c92efc3402e8e9546cb961bbcdc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:18.719866 27652 tablet_service.cc:1511] Processing CreateTablet for tablet 8ee97a8570ae4cb49195d1b977d1cdf4 (DEFAULT_TABLE table=test-workload [id=726d57952dab4de7b40bbe78e31e0eaf]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 13:08:18.721191 27652 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8ee97a8570ae4cb49195d1b977d1cdf4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:18.723225 27651 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4cd7359accee42808761c37543247321. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:08:18.728137 27559 leader_election.cc:343] T 1a26f012cd6e4c4c8bf86b5fda903800 P 2513a663afac495eb09126ff55e8b2b0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 41268b218b804905a110c86738e74400 (127.17.223.2:44403): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:18.727609 27667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a26f012cd6e4c4c8bf86b5fda903800" candidate_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "41268b218b804905a110c86738e74400"
I20260709 13:08:18.728987 27559 leader_election.cc:304] T 1a26f012cd6e4c4c8bf86b5fda903800 P 2513a663afac495eb09126ff55e8b2b0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2513a663afac495eb09126ff55e8b2b0; no voters: 41268b218b804905a110c86738e74400, 665f7e09521a4c3f9284c1d8b0e094ff
W20260709 13:08:18.729750 27708 leader_election.cc:343] T 1a26f012cd6e4c4c8bf86b5fda903800 P 665f7e09521a4c3f9284c1d8b0e094ff [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 41268b218b804905a110c86738e74400 (127.17.223.2:44403): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:18.730813 27668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd959195de1942f7999397a56496f5bc" candidate_uuid: "2513a663afac495eb09126ff55e8b2b0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "41268b218b804905a110c86738e74400" is_pre_election: true
I20260709 13:08:18.733166 27576 tablet_service.cc:1511] Processing CreateTablet for tablet 1cd5e6e9b36d4591961cb379d7065be9 (DEFAULT_TABLE table=test-workload [id=726d57952dab4de7b40bbe78e31e0eaf]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 13:08:18.733564 27870 leader_election.cc:290] T dd959195de1942f7999397a56496f5bc P 2513a663afac495eb09126ff55e8b2b0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 41268b218b804905a110c86738e74400 (127.17.223.2:44403), 665f7e09521a4c3f9284c1d8b0e094ff (127.17.223.3:38749)
I20260709 13:08:18.736686 27872 raft_consensus.cc:493] T a9eac7f072de454a8ff2beb019da45d9 P 41268b218b804905a110c86738e74400 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:18.737277 27872 raft_consensus.cc:515] T a9eac7f072de454a8ff2beb019da45d9 P 41268b218b804905a110c86738e74400 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18435fbb525741328139e84a1e354954" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 40545 } } peers { permanent_uuid: "2513a663afac495eb09126ff55e8b2b0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40721 } } peers { permanent_uuid: "41268b218b804905a110c86738e74400" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 44403 } }
I20260709 13:08:18.704892 27867 leader_election.cc:290] T 1a26f012cd6e4c4c8bf86b5fda903800 P 665f7e09521a4c3f9284c1d8b0e094ff [CANDIDATE]: Term 1 election: Requested vote from peers 41268b218b804905a110c86738e74400 (127.17.223.2:44403), 2513a663afac495eb09126ff55e8b2b0 (127.17.223.1:40721)
I20260709 13:08:18.742852 27872 leader_election.cc:290] T a9eac7f072de454a8ff2beb019da45d9 P 41268b218b804905a110c86738e74400 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 18435fbb525741328139e84a1e354954 (127.17.223.4:40545), 2513a663afac495eb09126ff55e8b2b0 (127.17.223.1:40721)
I20260709 13:08:18.729317 27723 tablet_service.cc:1511] Processing CreateTablet for tablet 1cd5e6e9b36d4591961cb379d7065be9 (DEFAULT_TABLE table=test-workload [id=726d57952dab4de7b40bbe78e31e0eaf]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 13:08:18.744966 27723 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1cd5e6e9b36d4591961cb379d7065be9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:18.734570 27576 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1cd5e6e9b36d4591961cb379d7065be9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:18.749068 27815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9eac7f072de454a8ff2beb019da45d9" candidate_uuid: "41268b218b804905a110c86738e74400" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "18435fbb525741328139e84a1e354954" is_pre_election: true
I20260709 13:08:18.746083 27816 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56803a5c0dea4efeabafb6829d9215cd" candidate_uuid: "41268b218b804905a110c86738e74400" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "18435fbb525741328139e84a1e354954" is_pre_election: true
I20260709 13:08:18.751196 27800 tablet_service.cc:1511] Processing CreateTablet for tablet 1cd5e6e9b36d4591961cb379d7065be9 (DEFAULT_TABLE table=test-workload [id=726d57952dab4de7b40bbe78e31e0eaf]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 13:08:18.752867 27730 tablet_service.cc:1511] Processing CreateTablet for tablet 8ee97a8570ae4cb49195d1b977d1cdf4 (DEFAULT_TABLE table=test-workload [id=726d57952dab4de7b40bbe78e31e0eaf]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
W20260709 13:08:18.768926 27634 leader_election.cc:343] T 56803a5c0dea4efeabafb6829d9215cd P 41268b218b804905a110c86738e74400 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 18435fbb525741328139e84a1e354954 (127.17.223.4:40545): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:18.779557 27867 raft_consensus.cc:493] T 64490a86db8c4f5ca54f4f8085f41319 P 665f7e09521a4c3f9284c1d8b0e094ff [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:18.754562 27593 raft_consensus.cc:2468] T 1a26f012cd6e4c4c8bf86b5fda903800 P 2513a663afac495eb09126ff55e8b2b0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 665f7e09521a4c3f9284c1d8b0e094ff in term 1.
I20260709 13:08:18.790618 27870 raft_consensus.cc:2749] T 1a26f012cd6e4c4c8bf86b5fda903800 P 2513a663afac495eb09126ff55e8b2b0 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:08:18.791675 27634 leader_election.cc:343] T a9eac7f072de454a8ff2beb019da45d9 P 41268b218b804905a110c86738e74400 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 18435fbb525741328139e84a1e354954 (127.17.223.4:40545): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:18.794245 27668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0c8b4ec2d844a89b4bb66c0f1bf2c8f" candidate_uuid: "18435fbb525741328139e84a1e354954" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "41268b218b804905a110c86738e74400" is_pre_election: true
I20260709 13:08:18.795298 27730 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8ee97a8570ae4cb49195d1b977d1cdf4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:18.795109 27797 tablet_service.cc:1511] Processing CreateTablet for tablet 8ee97a8570ae4cb49195d1b977d1cdf4 (DEFAULT_TABLE table=test-workload [id=726d57952dab4de7b40bbe78e31e0eaf]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 13:08:18.796097 27872 raft_consensus.cc:493] T 456941807b254f5fb32dca4f84bd16ea P 41268b218b804905a110c86738e74400 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:08:18.796339 27782 leader_election.cc:343] T d0c8b4ec2d844a89b4bb66c0f1bf2c8f P 18435fbb525741328139e84a1e354954 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 41268b218b804905a110c86738e74400 (127.17.223.2:44403): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:18.796731 27872 raft_consensus.cc:515] T 456941807b254f5fb32dca4f84bd16ea P 41268b218b804905a110c86738e74400 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2513a663afac495eb09126ff55e8b2b0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40721 } } peers { permanent_uuid: "41268b218b804905a110c86738e74400" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 44403 } } peers { permanent_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 38749 } }
I20260709 13:08:18.798846 27742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56803a5c0dea4efeabafb6829d9215cd" candidate_uuid: "41268b218b804905a110c86738e74400" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" is_pre_election: true
I20260709 13:08:18.789281 27867 raft_consensus.cc:515] T 64490a86db8c4f5ca54f4f8085f41319 P 665f7e09521a4c3f9284c1d8b0e094ff [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 38749 } } peers { permanent_uuid: "18435fbb525741328139e84a1e354954" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 40545 } } peers { permanent_uuid: "2513a663afac495eb09126ff55e8b2b0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40721 } }
W20260709 13:08:18.800351 27634 leader_election.cc:343] T 56803a5c0dea4efeabafb6829d9215cd P 41268b218b804905a110c86738e74400 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 665f7e09521a4c3f9284c1d8b0e094ff (127.17.223.3:38749): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:18.800902 27634 leader_election.cc:304] T 56803a5c0dea4efeabafb6829d9215cd P 41268b218b804905a110c86738e74400 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 41268b218b804905a110c86738e74400; no voters: 18435fbb525741328139e84a1e354954, 665f7e09521a4c3f9284c1d8b0e094ff
I20260709 13:08:18.805253 27872 leader_election.cc:290] T 456941807b254f5fb32dca4f84bd16ea P 41268b218b804905a110c86738e74400 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2513a663afac495eb09126ff55e8b2b0 (127.17.223.1:40721), 665f7e09521a4c3f9284c1d8b0e094ff (127.17.223.3:38749)
I20260709 13:08:18.805877 27872 raft_consensus.cc:2749] T 56803a5c0dea4efeabafb6829d9215cd P 41268b218b804905a110c86738e74400 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:08:18.805814 27705 leader_election.cc:304] T 1a26f012cd6e4c4c8bf86b5fda903800 P 665f7e09521a4c3f9284c1d8b0e094ff [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2513a663afac495eb09126ff55e8b2b0, 665f7e09521a4c3f9284c1d8b0e094ff; no voters: 41268b218b804905a110c86738e74400
I20260709 13:08:18.810321 27867 leader_election.cc:290] T 64490a86db8c4f5ca54f4f8085f41319 P 665f7e09521a4c3f9284c1d8b0e094ff [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 18435fbb525741328139e84a1e354954 (127.17.223.4:40545), 2513a663afac495eb09126ff55e8b2b0 (127.17.223.1:40721)
I20260709 13:08:18.810969 27867 raft_consensus.cc:2804] T 1a26f012cd6e4c4c8bf86b5fda903800 P 665f7e09521a4c3f9284c1d8b0e094ff [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:08:18.811105 27593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64490a86db8c4f5ca54f4f8085f41319" candidate_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2513a663afac495eb09126ff55e8b2b0" is_pre_election: true
I20260709 13:08:18.811513 27867 raft_consensus.cc:697] T 1a26f012cd6e4c4c8bf86b5fda903800 P 665f7e09521a4c3f9284c1d8b0e094ff [term 1 LEADER]: Becoming Leader. State: Replica: 665f7e09521a4c3f9284c1d8b0e094ff, State: Running, Role: LEADER
W20260709 13:08:18.812708 27705 leader_election.cc:343] T 64490a86db8c4f5ca54f4f8085f41319 P 665f7e09521a4c3f9284c1d8b0e094ff [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2513a663afac495eb09126ff55e8b2b0 (127.17.223.1:40721): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:18.812515 27867 consensus_queue.cc:237] T 1a26f012cd6e4c4c8bf86b5fda903800 P 665f7e09521a4c3f9284c1d8b0e094ff [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "41268b218b804905a110c86738e74400" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 44403 } } peers { permanent_uuid: "2513a663afac495eb09126ff55e8b2b0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40721 } } peers { permanent_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 38749 } }
I20260709 13:08:18.815241 27800 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1cd5e6e9b36d4591961cb379d7065be9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:18.819061 27865 tablet_bootstrap.cc:492] T bc0b10615ecb4485a9a9de298938697d P 18435fbb525741328139e84a1e354954: No bootstrap required, opened a new log
I20260709 13:08:18.819687 27865 ts_tablet_manager.cc:1403] T bc0b10615ecb4485a9a9de298938697d P 18435fbb525741328139e84a1e354954: Time spent bootstrapping tablet: real 0.376s	user 0.028s	sys 0.005s
I20260709 13:08:18.820353 27583 tablet_service.cc:1511] Processing CreateTablet for tablet 85cdd21b7a5f4db7af44327c57c16d43 (DEFAULT_TABLE table=test-workload [id=726d57952dab4de7b40bbe78e31e0eaf]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 13:08:18.822197 27583 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 85cdd21b7a5f4db7af44327c57c16d43. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:08:18.803730 27559 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.3:38749, user_credentials={real_user=slave}} blocked reactor thread for 74834.2us
I20260709 13:08:18.828641 27592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "456941807b254f5fb32dca4f84bd16ea" candidate_uuid: "41268b218b804905a110c86738e74400" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2513a663afac495eb09126ff55e8b2b0" is_pre_election: true
I20260709 13:08:18.829959 27742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd959195de1942f7999397a56496f5bc" candidate_uuid: "2513a663afac495eb09126ff55e8b2b0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" is_pre_election: true
I20260709 13:08:18.828941 27593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9eac7f072de454a8ff2beb019da45d9" candidate_uuid: "41268b218b804905a110c86738e74400" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2513a663afac495eb09126ff55e8b2b0" is_pre_election: true
I20260709 13:08:18.831650 27797 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8ee97a8570ae4cb49195d1b977d1cdf4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:18.830266 27870 raft_consensus.cc:493] T 55a3afc21cea43ea85f4a2155552422d P 2513a663afac495eb09126ff55e8b2b0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:08:18.830374 27559 leader_election.cc:343] T dd959195de1942f7999397a56496f5bc P 2513a663afac495eb09126ff55e8b2b0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 41268b218b804905a110c86738e74400 (127.17.223.2:44403): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:08:18.859993 27631 leader_election.cc:343] T a9eac7f072de454a8ff2beb019da45d9 P 41268b218b804905a110c86738e74400 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2513a663afac495eb09126ff55e8b2b0 (127.17.223.1:40721): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:18.860543 27631 leader_election.cc:304] T a9eac7f072de454a8ff2beb019da45d9 P 41268b218b804905a110c86738e74400 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 41268b218b804905a110c86738e74400; no voters: 18435fbb525741328139e84a1e354954, 2513a663afac495eb09126ff55e8b2b0
I20260709 13:08:18.863198 27862 ts_tablet_manager.cc:1434] T 64490a86db8c4f5ca54f4f8085f41319 P 665f7e09521a4c3f9284c1d8b0e094ff: Time spent starting tablet: real 0.358s	user 0.013s	sys 0.045s
I20260709 13:08:18.863577 27816 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64490a86db8c4f5ca54f4f8085f41319" candidate_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "18435fbb525741328139e84a1e354954" is_pre_election: true
I20260709 13:08:18.864542 27862 tablet_bootstrap.cc:492] T 9ac520b68b79484990a8725d6549174e P 665f7e09521a4c3f9284c1d8b0e094ff: Bootstrap starting.
I20260709 13:08:18.863134 27815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc84b896d2ae4581bc236b96d5de9de3" candidate_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "18435fbb525741328139e84a1e354954" is_pre_election: true
I20260709 13:08:18.865366 27815 raft_consensus.cc:2468] T fc84b896d2ae4581bc236b96d5de9de3 P 18435fbb525741328139e84a1e354954 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 665f7e09521a4c3f9284c1d8b0e094ff in term 0.
W20260709 13:08:18.867014 27708 leader_election.cc:343] T 64490a86db8c4f5ca54f4f8085f41319 P 665f7e09521a4c3f9284c1d8b0e094ff [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 18435fbb525741328139e84a1e354954 (127.17.223.4:40545): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:18.867519 27708 leader_election.cc:304] T 64490a86db8c4f5ca54f4f8085f41319 P 665f7e09521a4c3f9284c1d8b0e094ff [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 665f7e09521a4c3f9284c1d8b0e094ff; no voters: 18435fbb525741328139e84a1e354954, 2513a663afac495eb09126ff55e8b2b0
I20260709 13:08:18.870225 27863 tablet_bootstrap.cc:492] T dd959195de1942f7999397a56496f5bc P 41268b218b804905a110c86738e74400: No bootstrap required, opened a new log
I20260709 13:08:18.870797 27863 ts_tablet_manager.cc:1403] T dd959195de1942f7999397a56496f5bc P 41268b218b804905a110c86738e74400: Time spent bootstrapping tablet: real 0.381s	user 0.035s	sys 0.009s
I20260709 13:08:18.870095 27732 tablet_service.cc:1511] Processing CreateTablet for tablet 85cdd21b7a5f4db7af44327c57c16d43 (DEFAULT_TABLE table=test-workload [id=726d57952dab4de7b40bbe78e31e0eaf]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 13:08:18.872035 27732 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 85cdd21b7a5f4db7af44327c57c16d43. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:18.867609 27901 raft_consensus.cc:2749] T a9eac7f072de454a8ff2beb019da45d9 P 41268b218b804905a110c86738e74400 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:08:18.856683 27634 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.3:38749, user_credentials={real_user=slave}} blocked reactor thread for 56388.6us
W20260709 13:08:18.877089 27559 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.2:44403, user_credentials={real_user=slave}} blocked reactor thread for 46788.3us
W20260709 13:08:18.881724 27631 leader_election.cc:343] T 456941807b254f5fb32dca4f84bd16ea P 41268b218b804905a110c86738e74400 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2513a663afac495eb09126ff55e8b2b0 (127.17.223.1:40721): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:18.889626 27581 tablet_service.cc:1511] Processing CreateTablet for tablet 3a7da70e9f0f49a9bf60184a8f0b5339 (DEFAULT_TABLE table=test-workload [id=726d57952dab4de7b40bbe78e31e0eaf]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 13:08:18.891152 27581 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3a7da70e9f0f49a9bf60184a8f0b5339. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:18.880874 27863 raft_consensus.cc:359] T dd959195de1942f7999397a56496f5bc P 41268b218b804905a110c86738e74400 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2513a663afac495eb09126ff55e8b2b0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40721 } } peers { permanent_uuid: "41268b218b804905a110c86738e74400" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 44403 } } peers { permanent_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 38749 } }
I20260709 13:08:18.892622 27863 raft_consensus.cc:385] T dd959195de1942f7999397a56496f5bc P 41268b218b804905a110c86738e74400 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:18.892982 27863 raft_consensus.cc:740] T dd959195de1942f7999397a56496f5bc P 41268b218b804905a110c86738e74400 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 41268b218b804905a110c86738e74400, State: Initialized, Role: FOLLOWER
I20260709 13:08:18.858930 27870 raft_consensus.cc:515] T 55a3afc21cea43ea85f4a2155552422d P 2513a663afac495eb09126ff55e8b2b0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 38749 } } peers { permanent_uuid: "18435fbb525741328139e84a1e354954" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 40545 } } peers { permanent_uuid: "2513a663afac495eb09126ff55e8b2b0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40721 } }
I20260709 13:08:18.894405 27863 consensus_queue.cc:260] T dd959195de1942f7999397a56496f5bc P 41268b218b804905a110c86738e74400 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2513a663afac495eb09126ff55e8b2b0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40721 } } peers { permanent_uuid: "41268b218b804905a110c86738e74400" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 44403 } } peers { permanent_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 38749 } }
I20260709 13:08:18.896150 27803 tablet_service.cc:1511] Processing CreateTablet for tablet 3a7da70e9f0f49a9bf60184a8f0b5339 (DEFAULT_TABLE table=test-workload [id=726d57952dab4de7b40bbe78e31e0eaf]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 13:08:18.896804 27863 ts_tablet_manager.cc:1434] T dd959195de1942f7999397a56496f5bc P 41268b218b804905a110c86738e74400: Time spent starting tablet: real 0.026s	user 0.007s	sys 0.000s
I20260709 13:08:18.897863 27863 tablet_bootstrap.cc:492] T d0c8b4ec2d844a89b4bb66c0f1bf2c8f P 41268b218b804905a110c86738e74400: Bootstrap starting.
I20260709 13:08:18.898061 27803 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3a7da70e9f0f49a9bf60184a8f0b5339. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:18.898386 27727 tablet_service.cc:1511] Processing CreateTablet for tablet 8d1aa996b2034de7b2d77545de68e73c (DEFAULT_TABLE table=test-workload [id=726d57952dab4de7b40bbe78e31e0eaf]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 13:08:18.896199 27805 tablet_service.cc:1511] Processing CreateTablet for tablet 8d1aa996b2034de7b2d77545de68e73c (DEFAULT_TABLE table=test-workload [id=726d57952dab4de7b40bbe78e31e0eaf]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 13:08:18.899870 27727 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8d1aa996b2034de7b2d77545de68e73c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:18.900053 27805 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8d1aa996b2034de7b2d77545de68e73c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:18.903664 27861 tablet_bootstrap.cc:492] T a9eac7f072de454a8ff2beb019da45d9 P 2513a663afac495eb09126ff55e8b2b0: No bootstrap required, opened a new log
I20260709 13:08:18.904254 27861 ts_tablet_manager.cc:1403] T a9eac7f072de454a8ff2beb019da45d9 P 2513a663afac495eb09126ff55e8b2b0: Time spent bootstrapping tablet: real 0.253s	user 0.010s	sys 0.021s
I20260709 13:08:18.883213 27865 raft_consensus.cc:359] T bc0b10615ecb4485a9a9de298938697d P 18435fbb525741328139e84a1e354954 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18435fbb525741328139e84a1e354954" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 40545 } } peers { permanent_uuid: "2513a663afac495eb09126ff55e8b2b0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40721 } } peers { permanent_uuid: "41268b218b804905a110c86738e74400" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 44403 } }
I20260709 13:08:18.905544 27865 raft_consensus.cc:385] T bc0b10615ecb4485a9a9de298938697d P 18435fbb525741328139e84a1e354954 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:18.905865 27865 raft_consensus.cc:740] T bc0b10615ecb4485a9a9de298938697d P 18435fbb525741328139e84a1e354954 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 18435fbb525741328139e84a1e354954, State: Initialized, Role: FOLLOWER
I20260709 13:08:18.907063 27867 raft_consensus.cc:2749] T 64490a86db8c4f5ca54f4f8085f41319 P 665f7e09521a4c3f9284c1d8b0e094ff [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:08:18.916054 27870 leader_election.cc:290] T 55a3afc21cea43ea85f4a2155552422d P 2513a663afac495eb09126ff55e8b2b0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 665f7e09521a4c3f9284c1d8b0e094ff (127.17.223.3:38749), 18435fbb525741328139e84a1e354954 (127.17.223.4:40545)
I20260709 13:08:18.919714 27651 tablet_service.cc:1511] Processing CreateTablet for tablet 85cdd21b7a5f4db7af44327c57c16d43 (DEFAULT_TABLE table=test-workload [id=726d57952dab4de7b40bbe78e31e0eaf]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 13:08:18.921213 27651 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 85cdd21b7a5f4db7af44327c57c16d43. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:18.923416 27654 tablet_service.cc:1511] Processing CreateTablet for tablet 3a7da70e9f0f49a9bf60184a8f0b5339 (DEFAULT_TABLE table=test-workload [id=726d57952dab4de7b40bbe78e31e0eaf]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 13:08:18.924726 27592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0c8b4ec2d844a89b4bb66c0f1bf2c8f" candidate_uuid: "18435fbb525741328139e84a1e354954" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2513a663afac495eb09126ff55e8b2b0" is_pre_election: true
W20260709 13:08:18.925324 27708 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.4:40545, user_credentials={real_user=slave}} blocked reactor thread for 58359us
W20260709 13:08:18.920192 27559 leader_election.cc:343] T dd959195de1942f7999397a56496f5bc P 2513a663afac495eb09126ff55e8b2b0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 665f7e09521a4c3f9284c1d8b0e094ff (127.17.223.3:38749): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:18.919445 27863 tablet_bootstrap.cc:654] T d0c8b4ec2d844a89b4bb66c0f1bf2c8f P 41268b218b804905a110c86738e74400: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:18.927724 27654 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3a7da70e9f0f49a9bf60184a8f0b5339. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:18.929337 27578 tablet_service.cc:1511] Processing CreateTablet for tablet 8d1aa996b2034de7b2d77545de68e73c (DEFAULT_TABLE table=test-workload [id=726d57952dab4de7b40bbe78e31e0eaf]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 13:08:18.933907 27559 leader_election.cc:304] T dd959195de1942f7999397a56496f5bc P 2513a663afac495eb09126ff55e8b2b0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2513a663afac495eb09126ff55e8b2b0; no voters: 41268b218b804905a110c86738e74400, 665f7e09521a4c3f9284c1d8b0e094ff
I20260709 13:08:18.939188 27861 raft_consensus.cc:359] T a9eac7f072de454a8ff2beb019da45d9 P 2513a663afac495eb09126ff55e8b2b0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18435fbb525741328139e84a1e354954" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 40545 } } peers { permanent_uuid: "2513a663afac495eb09126ff55e8b2b0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40721 } } peers { permanent_uuid: "41268b218b804905a110c86738e74400" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 44403 } }
I20260709 13:08:18.939535 27870 raft_consensus.cc:2749] T dd959195de1942f7999397a56496f5bc P 2513a663afac495eb09126ff55e8b2b0 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:08:18.941052 27742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55a3afc21cea43ea85f4a2155552422d" candidate_uuid: "2513a663afac495eb09126ff55e8b2b0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" is_pre_election: true
I20260709 13:08:18.942479 27861 raft_consensus.cc:385] T a9eac7f072de454a8ff2beb019da45d9 P 2513a663afac495eb09126ff55e8b2b0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:18.942559 27742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "456941807b254f5fb32dca4f84bd16ea" candidate_uuid: "41268b218b804905a110c86738e74400" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" is_pre_election: true
I20260709 13:08:18.942900 27861 raft_consensus.cc:740] T a9eac7f072de454a8ff2beb019da45d9 P 2513a663afac495eb09126ff55e8b2b0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2513a663afac495eb09126ff55e8b2b0, State: Initialized, Role: FOLLOWER
I20260709 13:08:18.938880 27862 tablet_bootstrap.cc:654] T 9ac520b68b79484990a8725d6549174e P 665f7e09521a4c3f9284c1d8b0e094ff: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:18.948807 27861 consensus_queue.cc:260] T a9eac7f072de454a8ff2beb019da45d9 P 2513a663afac495eb09126ff55e8b2b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18435fbb525741328139e84a1e354954" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 40545 } } peers { permanent_uuid: "2513a663afac495eb09126ff55e8b2b0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40721 } } peers { permanent_uuid: "41268b218b804905a110c86738e74400" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 44403 } }
I20260709 13:08:18.906634 27865 consensus_queue.cc:260] T bc0b10615ecb4485a9a9de298938697d P 18435fbb525741328139e84a1e354954 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18435fbb525741328139e84a1e354954" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 40545 } } peers { permanent_uuid: "2513a663afac495eb09126ff55e8b2b0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40721 } } peers { permanent_uuid: "41268b218b804905a110c86738e74400" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 44403 } }
I20260709 13:08:18.951351 27861 ts_tablet_manager.cc:1434] T a9eac7f072de454a8ff2beb019da45d9 P 2513a663afac495eb09126ff55e8b2b0: Time spent starting tablet: real 0.047s	user 0.006s	sys 0.004s
I20260709 13:08:18.952762 27708 leader_election.cc:304] T fc84b896d2ae4581bc236b96d5de9de3 P 665f7e09521a4c3f9284c1d8b0e094ff [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 18435fbb525741328139e84a1e354954, 665f7e09521a4c3f9284c1d8b0e094ff; no voters: 41268b218b804905a110c86738e74400
I20260709 13:08:18.954074 27867 raft_consensus.cc:2804] T fc84b896d2ae4581bc236b96d5de9de3 P 665f7e09521a4c3f9284c1d8b0e094ff [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:08:18.954469 27867 raft_consensus.cc:493] T fc84b896d2ae4581bc236b96d5de9de3 P 665f7e09521a4c3f9284c1d8b0e094ff [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:18.954866 27867 raft_consensus.cc:3060] T fc84b896d2ae4581bc236b96d5de9de3 P 665f7e09521a4c3f9284c1d8b0e094ff [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:18.958077 27865 ts_tablet_manager.cc:1434] T bc0b10615ecb4485a9a9de298938697d P 18435fbb525741328139e84a1e354954: Time spent starting tablet: real 0.138s	user 0.009s	sys 0.000s
I20260709 13:08:18.959491 27578 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8d1aa996b2034de7b2d77545de68e73c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:18.963711 27861 tablet_bootstrap.cc:492] T 64490a86db8c4f5ca54f4f8085f41319 P 2513a663afac495eb09126ff55e8b2b0: Bootstrap starting.
W20260709 13:08:18.966969 27634 leader_election.cc:343] T 456941807b254f5fb32dca4f84bd16ea P 41268b218b804905a110c86738e74400 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 665f7e09521a4c3f9284c1d8b0e094ff (127.17.223.3:38749): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:18.967548 27634 leader_election.cc:304] T 456941807b254f5fb32dca4f84bd16ea P 41268b218b804905a110c86738e74400 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 41268b218b804905a110c86738e74400; no voters: 2513a663afac495eb09126ff55e8b2b0, 665f7e09521a4c3f9284c1d8b0e094ff
I20260709 13:08:18.969486 27901 raft_consensus.cc:2749] T 456941807b254f5fb32dca4f84bd16ea P 41268b218b804905a110c86738e74400 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:08:18.975029 27861 tablet_bootstrap.cc:654] T 64490a86db8c4f5ca54f4f8085f41319 P 2513a663afac495eb09126ff55e8b2b0: Neither blocks nor log segments found. Creating new log.
W20260709 13:08:18.976261 27539 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:08:18.979722 27489 catalog_manager.cc:5697] T 1a26f012cd6e4c4c8bf86b5fda903800 P 665f7e09521a4c3f9284c1d8b0e094ff reported cstate change: term changed from 0 to 1, leader changed from <none> to 665f7e09521a4c3f9284c1d8b0e094ff (127.17.223.3). New cstate: current_term: 1 leader_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "41268b218b804905a110c86738e74400" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 44403 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2513a663afac495eb09126ff55e8b2b0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40721 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 38749 } health_report { overall_health: HEALTHY } } }
I20260709 13:08:18.983402 27865 tablet_bootstrap.cc:492] T 9ac520b68b79484990a8725d6549174e P 18435fbb525741328139e84a1e354954: Bootstrap starting.
I20260709 13:08:18.986949 27583 tablet_service.cc:1511] Processing CreateTablet for tablet 8e758d59bd4a4eae9f67662e165013f9 (DEFAULT_TABLE table=test-workload [id=726d57952dab4de7b40bbe78e31e0eaf]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 13:08:18.992381 27583 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8e758d59bd4a4eae9f67662e165013f9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:18.995033 27874 raft_consensus.cc:493] T bc0b10615ecb4485a9a9de298938697d P 18435fbb525741328139e84a1e354954 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:18.995594 27874 raft_consensus.cc:515] T bc0b10615ecb4485a9a9de298938697d P 18435fbb525741328139e84a1e354954 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18435fbb525741328139e84a1e354954" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 40545 } } peers { permanent_uuid: "2513a663afac495eb09126ff55e8b2b0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40721 } } peers { permanent_uuid: "41268b218b804905a110c86738e74400" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 44403 } }
I20260709 13:08:18.998054 27874 leader_election.cc:290] T bc0b10615ecb4485a9a9de298938697d P 18435fbb525741328139e84a1e354954 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2513a663afac495eb09126ff55e8b2b0 (127.17.223.1:40721), 41268b218b804905a110c86738e74400 (127.17.223.2:44403)
W20260709 13:08:18.999397 27779 leader_election.cc:343] T d0c8b4ec2d844a89b4bb66c0f1bf2c8f P 18435fbb525741328139e84a1e354954 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2513a663afac495eb09126ff55e8b2b0 (127.17.223.1:40721): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:18.999940 27779 leader_election.cc:304] T d0c8b4ec2d844a89b4bb66c0f1bf2c8f P 18435fbb525741328139e84a1e354954 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 18435fbb525741328139e84a1e354954; no voters: 2513a663afac495eb09126ff55e8b2b0, 41268b218b804905a110c86738e74400
I20260709 13:08:19.001001 27592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc0b10615ecb4485a9a9de298938697d" candidate_uuid: "18435fbb525741328139e84a1e354954" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2513a663afac495eb09126ff55e8b2b0" is_pre_election: true
I20260709 13:08:19.002264 27668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc0b10615ecb4485a9a9de298938697d" candidate_uuid: "18435fbb525741328139e84a1e354954" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "41268b218b804905a110c86738e74400" is_pre_election: true
I20260709 13:08:19.004048 27874 raft_consensus.cc:2749] T d0c8b4ec2d844a89b4bb66c0f1bf2c8f P 18435fbb525741328139e84a1e354954 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:08:19.005007 27732 tablet_service.cc:1511] Processing CreateTablet for tablet 8e0d496efc3f41f3be82a538ef3cfdac (DEFAULT_TABLE table=test-workload [id=726d57952dab4de7b40bbe78e31e0eaf]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 13:08:18.962426 27867 raft_consensus.cc:515] T fc84b896d2ae4581bc236b96d5de9de3 P 665f7e09521a4c3f9284c1d8b0e094ff [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "41268b218b804905a110c86738e74400" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 44403 } } peers { permanent_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 38749 } } peers { permanent_uuid: "18435fbb525741328139e84a1e354954" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 40545 } }
I20260709 13:08:19.006274 27732 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8e0d496efc3f41f3be82a538ef3cfdac. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:19.006398 27651 tablet_service.cc:1511] Processing CreateTablet for tablet 8e758d59bd4a4eae9f67662e165013f9 (DEFAULT_TABLE table=test-workload [id=726d57952dab4de7b40bbe78e31e0eaf]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 13:08:19.012491 27651 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8e758d59bd4a4eae9f67662e165013f9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:19.013216 27862 tablet_bootstrap.cc:492] T 9ac520b68b79484990a8725d6549174e P 665f7e09521a4c3f9284c1d8b0e094ff: No bootstrap required, opened a new log
I20260709 13:08:19.013736 27862 ts_tablet_manager.cc:1403] T 9ac520b68b79484990a8725d6549174e P 665f7e09521a4c3f9284c1d8b0e094ff: Time spent bootstrapping tablet: real 0.149s	user 0.008s	sys 0.022s
W20260709 13:08:19.007287 27782 leader_election.cc:343] T bc0b10615ecb4485a9a9de298938697d P 18435fbb525741328139e84a1e354954 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 41268b218b804905a110c86738e74400 (127.17.223.2:44403): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:19.016656 27805 tablet_service.cc:1511] Processing CreateTablet for tablet 8e0d496efc3f41f3be82a538ef3cfdac (DEFAULT_TABLE table=test-workload [id=726d57952dab4de7b40bbe78e31e0eaf]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 13:08:19.018049 27805 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8e0d496efc3f41f3be82a538ef3cfdac. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:08:19.002266 27559 leader_election.cc:343] T 55a3afc21cea43ea85f4a2155552422d P 2513a663afac495eb09126ff55e8b2b0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 665f7e09521a4c3f9284c1d8b0e094ff (127.17.223.3:38749): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:08:19.027483 27779 leader_election.cc:343] T bc0b10615ecb4485a9a9de298938697d P 18435fbb525741328139e84a1e354954 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2513a663afac495eb09126ff55e8b2b0 (127.17.223.1:40721): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:19.028018 27779 leader_election.cc:304] T bc0b10615ecb4485a9a9de298938697d P 18435fbb525741328139e84a1e354954 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 18435fbb525741328139e84a1e354954; no voters: 2513a663afac495eb09126ff55e8b2b0, 41268b218b804905a110c86738e74400
I20260709 13:08:19.029412 27874 raft_consensus.cc:2749] T bc0b10615ecb4485a9a9de298938697d P 18435fbb525741328139e84a1e354954 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:08:19.029316 27815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55a3afc21cea43ea85f4a2155552422d" candidate_uuid: "2513a663afac495eb09126ff55e8b2b0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "18435fbb525741328139e84a1e354954" is_pre_election: true
I20260709 13:08:19.029425 27862 raft_consensus.cc:359] T 9ac520b68b79484990a8725d6549174e P 665f7e09521a4c3f9284c1d8b0e094ff [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "41268b218b804905a110c86738e74400" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 44403 } } peers { permanent_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 38749 } } peers { permanent_uuid: "18435fbb525741328139e84a1e354954" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 40545 } }
I20260709 13:08:19.032790 27862 raft_consensus.cc:385] T 9ac520b68b79484990a8725d6549174e P 665f7e09521a4c3f9284c1d8b0e094ff [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:19.033100 27862 raft_consensus.cc:740] T 9ac520b68b79484990a8725d6549174e P 665f7e09521a4c3f9284c1d8b0e094ff [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 665f7e09521a4c3f9284c1d8b0e094ff, State: Initialized, Role: FOLLOWER
I20260709 13:08:19.009137 27652 tablet_service.cc:1511] Processing CreateTablet for tablet 8e0d496efc3f41f3be82a538ef3cfdac (DEFAULT_TABLE table=test-workload [id=726d57952dab4de7b40bbe78e31e0eaf]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 13:08:19.034900 27727 tablet_service.cc:1511] Processing CreateTablet for tablet 8e758d59bd4a4eae9f67662e165013f9 (DEFAULT_TABLE table=test-workload [id=726d57952dab4de7b40bbe78e31e0eaf]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 13:08:19.035394 27862 consensus_queue.cc:260] T 9ac520b68b79484990a8725d6549174e P 665f7e09521a4c3f9284c1d8b0e094ff [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "41268b218b804905a110c86738e74400" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 44403 } } peers { permanent_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 38749 } } peers { permanent_uuid: "18435fbb525741328139e84a1e354954" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 40545 } }
I20260709 13:08:19.027994 27865 tablet_bootstrap.cc:654] T 9ac520b68b79484990a8725d6549174e P 18435fbb525741328139e84a1e354954: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:19.055769 27867 leader_election.cc:290] T fc84b896d2ae4581bc236b96d5de9de3 P 665f7e09521a4c3f9284c1d8b0e094ff [CANDIDATE]: Term 1 election: Requested vote from peers 41268b218b804905a110c86738e74400 (127.17.223.2:44403), 18435fbb525741328139e84a1e354954 (127.17.223.4:40545)
I20260709 13:08:19.056236 27652 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8e0d496efc3f41f3be82a538ef3cfdac. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:19.057258 27862 ts_tablet_manager.cc:1434] T 9ac520b68b79484990a8725d6549174e P 665f7e09521a4c3f9284c1d8b0e094ff: Time spent starting tablet: real 0.043s	user 0.008s	sys 0.000s
I20260709 13:08:19.037420 27803 tablet_service.cc:1511] Processing CreateTablet for tablet 2d994cb13f8f453284bcb1f8b85824a2 (DEFAULT_TABLE table=test-workload [id=726d57952dab4de7b40bbe78e31e0eaf]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 13:08:19.037827 27668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc84b896d2ae4581bc236b96d5de9de3" candidate_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "41268b218b804905a110c86738e74400"
I20260709 13:08:19.038712 27815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc84b896d2ae4581bc236b96d5de9de3" candidate_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "18435fbb525741328139e84a1e354954"
W20260709 13:08:19.044934 27559 leader_election.cc:343] T 55a3afc21cea43ea85f4a2155552422d P 2513a663afac495eb09126ff55e8b2b0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 18435fbb525741328139e84a1e354954 (127.17.223.4:40545): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:19.054963 27581 tablet_service.cc:1511] Processing CreateTablet for tablet 2d994cb13f8f453284bcb1f8b85824a2 (DEFAULT_TABLE table=test-workload [id=726d57952dab4de7b40bbe78e31e0eaf]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 13:08:19.064486 27581 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2d994cb13f8f453284bcb1f8b85824a2. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:08:19.064296 27708 leader_election.cc:343] T fc84b896d2ae4581bc236b96d5de9de3 P 665f7e09521a4c3f9284c1d8b0e094ff [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 41268b218b804905a110c86738e74400 (127.17.223.2:44403): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:19.066112 27803 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2d994cb13f8f453284bcb1f8b85824a2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:19.058296 27862 tablet_bootstrap.cc:492] T dd959195de1942f7999397a56496f5bc P 665f7e09521a4c3f9284c1d8b0e094ff: Bootstrap starting.
I20260709 13:08:19.063390 27815 raft_consensus.cc:3060] T fc84b896d2ae4581bc236b96d5de9de3 P 18435fbb525741328139e84a1e354954 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:19.055469 27727 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8e758d59bd4a4eae9f67662e165013f9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:19.074000 27732 tablet_service.cc:1511] Processing CreateTablet for tablet ae05961ab7a94458b1ad2cde9785c63b (DEFAULT_TABLE table=test-workload [id=726d57952dab4de7b40bbe78e31e0eaf]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 13:08:19.070996 27559 leader_election.cc:304] T 55a3afc21cea43ea85f4a2155552422d P 2513a663afac495eb09126ff55e8b2b0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2513a663afac495eb09126ff55e8b2b0; no voters: 18435fbb525741328139e84a1e354954, 665f7e09521a4c3f9284c1d8b0e094ff
I20260709 13:08:19.076370 27576 tablet_service.cc:1511] Processing CreateTablet for tablet ae05961ab7a94458b1ad2cde9785c63b (DEFAULT_TABLE table=test-workload [id=726d57952dab4de7b40bbe78e31e0eaf]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 13:08:19.078080 27576 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ae05961ab7a94458b1ad2cde9785c63b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:19.078853 27870 raft_consensus.cc:2749] T 55a3afc21cea43ea85f4a2155552422d P 2513a663afac495eb09126ff55e8b2b0 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:08:19.085438 27654 tablet_service.cc:1511] Processing CreateTablet for tablet 2d994cb13f8f453284bcb1f8b85824a2 (DEFAULT_TABLE table=test-workload [id=726d57952dab4de7b40bbe78e31e0eaf]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 13:08:19.086316 27654 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2d994cb13f8f453284bcb1f8b85824a2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:19.092590 27800 tablet_service.cc:1511] Processing CreateTablet for tablet ae05961ab7a94458b1ad2cde9785c63b (DEFAULT_TABLE table=test-workload [id=726d57952dab4de7b40bbe78e31e0eaf]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 13:08:19.094087 27800 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ae05961ab7a94458b1ad2cde9785c63b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:19.097651 27656 tablet_service.cc:1511] Processing CreateTablet for tablet 1c5e794c2a0a45fa99bcfde6aeb45d2e (DEFAULT_TABLE table=test-workload [id=726d57952dab4de7b40bbe78e31e0eaf]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 13:08:19.099193 27656 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1c5e794c2a0a45fa99bcfde6aeb45d2e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:19.104923 27863 tablet_bootstrap.cc:492] T d0c8b4ec2d844a89b4bb66c0f1bf2c8f P 41268b218b804905a110c86738e74400: No bootstrap required, opened a new log
I20260709 13:08:19.083316 27815 raft_consensus.cc:2468] T fc84b896d2ae4581bc236b96d5de9de3 P 18435fbb525741328139e84a1e354954 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 665f7e09521a4c3f9284c1d8b0e094ff in term 1.
I20260709 13:08:19.105517 27863 ts_tablet_manager.cc:1403] T d0c8b4ec2d844a89b4bb66c0f1bf2c8f P 41268b218b804905a110c86738e74400: Time spent bootstrapping tablet: real 0.208s	user 0.021s	sys 0.014s
I20260709 13:08:19.106822 27732 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ae05961ab7a94458b1ad2cde9785c63b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:19.108012 27723 tablet_service.cc:1511] Processing CreateTablet for tablet 1c5e794c2a0a45fa99bcfde6aeb45d2e (DEFAULT_TABLE table=test-workload [id=726d57952dab4de7b40bbe78e31e0eaf]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 13:08:19.113163 27708 leader_election.cc:304] T fc84b896d2ae4581bc236b96d5de9de3 P 665f7e09521a4c3f9284c1d8b0e094ff [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 18435fbb525741328139e84a1e354954, 665f7e09521a4c3f9284c1d8b0e094ff; no voters: 41268b218b804905a110c86738e74400
I20260709 13:08:19.121683 27903 raft_consensus.cc:2804] T fc84b896d2ae4581bc236b96d5de9de3 P 665f7e09521a4c3f9284c1d8b0e094ff [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:08:19.122407 27903 raft_consensus.cc:697] T fc84b896d2ae4581bc236b96d5de9de3 P 665f7e09521a4c3f9284c1d8b0e094ff [term 1 LEADER]: Becoming Leader. State: Replica: 665f7e09521a4c3f9284c1d8b0e094ff, State: Running, Role: LEADER
I20260709 13:08:19.123414 27903 consensus_queue.cc:237] T fc84b896d2ae4581bc236b96d5de9de3 P 665f7e09521a4c3f9284c1d8b0e094ff [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "41268b218b804905a110c86738e74400" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 44403 } } peers { permanent_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 38749 } } peers { permanent_uuid: "18435fbb525741328139e84a1e354954" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 40545 } }
I20260709 13:08:19.127384 27863 raft_consensus.cc:359] T d0c8b4ec2d844a89b4bb66c0f1bf2c8f P 41268b218b804905a110c86738e74400 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18435fbb525741328139e84a1e354954" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 40545 } } peers { permanent_uuid: "2513a663afac495eb09126ff55e8b2b0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40721 } } peers { permanent_uuid: "41268b218b804905a110c86738e74400" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 44403 } }
I20260709 13:08:19.128325 27863 raft_consensus.cc:385] T d0c8b4ec2d844a89b4bb66c0f1bf2c8f P 41268b218b804905a110c86738e74400 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:19.141902 27797 tablet_service.cc:1511] Processing CreateTablet for tablet 1c5e794c2a0a45fa99bcfde6aeb45d2e (DEFAULT_TABLE table=test-workload [id=726d57952dab4de7b40bbe78e31e0eaf]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 13:08:19.143323 27797 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1c5e794c2a0a45fa99bcfde6aeb45d2e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:19.144959 27583 tablet_service.cc:1511] Processing CreateTablet for tablet ea92a607c73b4d289d081146089a86f9 (DEFAULT_TABLE table=test-workload [id=726d57952dab4de7b40bbe78e31e0eaf]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 13:08:19.146322 27583 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ea92a607c73b4d289d081146089a86f9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:19.150935 27723 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1c5e794c2a0a45fa99bcfde6aeb45d2e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:19.139756 27863 raft_consensus.cc:740] T d0c8b4ec2d844a89b4bb66c0f1bf2c8f P 41268b218b804905a110c86738e74400 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 41268b218b804905a110c86738e74400, State: Initialized, Role: FOLLOWER
I20260709 13:08:19.158659 27654 tablet_service.cc:1511] Processing CreateTablet for tablet ea92a607c73b4d289d081146089a86f9 (DEFAULT_TABLE table=test-workload [id=726d57952dab4de7b40bbe78e31e0eaf]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 13:08:19.160035 27654 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ea92a607c73b4d289d081146089a86f9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:19.159554 27863 consensus_queue.cc:260] T d0c8b4ec2d844a89b4bb66c0f1bf2c8f P 41268b218b804905a110c86738e74400 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18435fbb525741328139e84a1e354954" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 40545 } } peers { permanent_uuid: "2513a663afac495eb09126ff55e8b2b0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40721 } } peers { permanent_uuid: "41268b218b804905a110c86738e74400" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 44403 } }
I20260709 13:08:19.165118 27863 ts_tablet_manager.cc:1434] T d0c8b4ec2d844a89b4bb66c0f1bf2c8f P 41268b218b804905a110c86738e74400: Time spent starting tablet: real 0.055s	user 0.000s	sys 0.007s
I20260709 13:08:19.166326 27863 tablet_bootstrap.cc:492] T fc84b896d2ae4581bc236b96d5de9de3 P 41268b218b804905a110c86738e74400: Bootstrap starting.
I20260709 13:08:19.173260 27863 tablet_bootstrap.cc:654] T fc84b896d2ae4581bc236b96d5de9de3 P 41268b218b804905a110c86738e74400: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:19.187242 27865 tablet_bootstrap.cc:492] T 9ac520b68b79484990a8725d6549174e P 18435fbb525741328139e84a1e354954: No bootstrap required, opened a new log
I20260709 13:08:19.187446 27861 tablet_bootstrap.cc:492] T 64490a86db8c4f5ca54f4f8085f41319 P 2513a663afac495eb09126ff55e8b2b0: No bootstrap required, opened a new log
I20260709 13:08:19.187892 27865 ts_tablet_manager.cc:1403] T 9ac520b68b79484990a8725d6549174e P 18435fbb525741328139e84a1e354954: Time spent bootstrapping tablet: real 0.205s	user 0.019s	sys 0.000s
I20260709 13:08:19.190019 27576 tablet_service.cc:1511] Processing CreateTablet for tablet 5a55d1bac7374ff6b83cc7bae2d3b1f3 (DEFAULT_TABLE table=test-workload [id=726d57952dab4de7b40bbe78e31e0eaf]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 13:08:19.191679 27576 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5a55d1bac7374ff6b83cc7bae2d3b1f3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:19.191516 27865 raft_consensus.cc:359] T 9ac520b68b79484990a8725d6549174e P 18435fbb525741328139e84a1e354954 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "41268b218b804905a110c86738e74400" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 44403 } } peers { permanent_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 38749 } } peers { permanent_uuid: "18435fbb525741328139e84a1e354954" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 40545 } }
I20260709 13:08:19.192438 27865 raft_consensus.cc:385] T 9ac520b68b79484990a8725d6549174e P 18435fbb525741328139e84a1e354954 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:19.192366 27730 tablet_service.cc:1511] Processing CreateTablet for tablet ea92a607c73b4d289d081146089a86f9 (DEFAULT_TABLE table=test-workload [id=726d57952dab4de7b40bbe78e31e0eaf]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 13:08:19.192950 27865 raft_consensus.cc:740] T 9ac520b68b79484990a8725d6549174e P 18435fbb525741328139e84a1e354954 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 18435fbb525741328139e84a1e354954, State: Initialized, Role: FOLLOWER
I20260709 13:08:19.187939 27861 ts_tablet_manager.cc:1403] T 64490a86db8c4f5ca54f4f8085f41319 P 2513a663afac495eb09126ff55e8b2b0: Time spent bootstrapping tablet: real 0.224s	user 0.047s	sys 0.017s
I20260709 13:08:19.193815 27730 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ea92a607c73b4d289d081146089a86f9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:19.196995 27861 raft_consensus.cc:359] T 64490a86db8c4f5ca54f4f8085f41319 P 2513a663afac495eb09126ff55e8b2b0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 38749 } } peers { permanent_uuid: "18435fbb525741328139e84a1e354954" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 40545 } } peers { permanent_uuid: "2513a663afac495eb09126ff55e8b2b0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40721 } }
I20260709 13:08:19.197862 27861 raft_consensus.cc:385] T 64490a86db8c4f5ca54f4f8085f41319 P 2513a663afac495eb09126ff55e8b2b0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:19.198210 27861 raft_consensus.cc:740] T 64490a86db8c4f5ca54f4f8085f41319 P 2513a663afac495eb09126ff55e8b2b0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2513a663afac495eb09126ff55e8b2b0, State: Initialized, Role: FOLLOWER
I20260709 13:08:19.199077 27861 consensus_queue.cc:260] T 64490a86db8c4f5ca54f4f8085f41319 P 2513a663afac495eb09126ff55e8b2b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 38749 } } peers { permanent_uuid: "18435fbb525741328139e84a1e354954" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 40545 } } peers { permanent_uuid: "2513a663afac495eb09126ff55e8b2b0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40721 } }
I20260709 13:08:19.193836 27805 tablet_service.cc:1511] Processing CreateTablet for tablet 5a55d1bac7374ff6b83cc7bae2d3b1f3 (DEFAULT_TABLE table=test-workload [id=726d57952dab4de7b40bbe78e31e0eaf]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 13:08:19.200713 27805 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5a55d1bac7374ff6b83cc7bae2d3b1f3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:19.206990 27865 consensus_queue.cc:260] T 9ac520b68b79484990a8725d6549174e P 18435fbb525741328139e84a1e354954 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "41268b218b804905a110c86738e74400" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 44403 } } peers { permanent_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 38749 } } peers { permanent_uuid: "18435fbb525741328139e84a1e354954" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 40545 } }
I20260709 13:08:19.209606 27865 ts_tablet_manager.cc:1434] T 9ac520b68b79484990a8725d6549174e P 18435fbb525741328139e84a1e354954: Time spent starting tablet: real 0.021s	user 0.005s	sys 0.000s
I20260709 13:08:19.221140 27731 tablet_service.cc:1511] Processing CreateTablet for tablet 2d68b1be563949efbcb4bbe71eddd0d8 (DEFAULT_TABLE table=test-workload [id=726d57952dab4de7b40bbe78e31e0eaf]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 13:08:19.222600 27861 ts_tablet_manager.cc:1434] T 64490a86db8c4f5ca54f4f8085f41319 P 2513a663afac495eb09126ff55e8b2b0: Time spent starting tablet: real 0.029s	user 0.004s	sys 0.003s
I20260709 13:08:19.222499 27731 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2d68b1be563949efbcb4bbe71eddd0d8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:19.223896 27861 tablet_bootstrap.cc:492] T de531c50b1524ec788b27bc4b883689a P 2513a663afac495eb09126ff55e8b2b0: Bootstrap starting.
I20260709 13:08:19.223649 27651 tablet_service.cc:1511] Processing CreateTablet for tablet 5a55d1bac7374ff6b83cc7bae2d3b1f3 (DEFAULT_TABLE table=test-workload [id=726d57952dab4de7b40bbe78e31e0eaf]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 13:08:19.224959 27651 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5a55d1bac7374ff6b83cc7bae2d3b1f3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:19.222472 27862 tablet_bootstrap.cc:654] T dd959195de1942f7999397a56496f5bc P 665f7e09521a4c3f9284c1d8b0e094ff: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:19.244163 27861 tablet_bootstrap.cc:654] T de531c50b1524ec788b27bc4b883689a P 2513a663afac495eb09126ff55e8b2b0: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:19.245913 27798 tablet_service.cc:1511] Processing CreateTablet for tablet 2d68b1be563949efbcb4bbe71eddd0d8 (DEFAULT_TABLE table=test-workload [id=726d57952dab4de7b40bbe78e31e0eaf]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 13:08:19.247498 27798 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2d68b1be563949efbcb4bbe71eddd0d8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:19.254274 27865 tablet_bootstrap.cc:492] T 11224ef6c00a40cdba4311ceb63bddb9 P 18435fbb525741328139e84a1e354954: Bootstrap starting.
I20260709 13:08:19.263273 27578 tablet_service.cc:1511] Processing CreateTablet for tablet 2d68b1be563949efbcb4bbe71eddd0d8 (DEFAULT_TABLE table=test-workload [id=726d57952dab4de7b40bbe78e31e0eaf]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 13:08:19.269661 27578 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2d68b1be563949efbcb4bbe71eddd0d8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:19.266510 27870 raft_consensus.cc:493] T 64490a86db8c4f5ca54f4f8085f41319 P 2513a663afac495eb09126ff55e8b2b0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:19.274972 27870 raft_consensus.cc:515] T 64490a86db8c4f5ca54f4f8085f41319 P 2513a663afac495eb09126ff55e8b2b0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 38749 } } peers { permanent_uuid: "18435fbb525741328139e84a1e354954" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 40545 } } peers { permanent_uuid: "2513a663afac495eb09126ff55e8b2b0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40721 } }
I20260709 13:08:19.276860 27901 raft_consensus.cc:493] T dd959195de1942f7999397a56496f5bc P 41268b218b804905a110c86738e74400 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:19.277369 27870 leader_election.cc:290] T 64490a86db8c4f5ca54f4f8085f41319 P 2513a663afac495eb09126ff55e8b2b0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 665f7e09521a4c3f9284c1d8b0e094ff (127.17.223.3:38749), 18435fbb525741328139e84a1e354954 (127.17.223.4:40545)
I20260709 13:08:19.279109 27742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64490a86db8c4f5ca54f4f8085f41319" candidate_uuid: "2513a663afac495eb09126ff55e8b2b0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" is_pre_election: true
I20260709 13:08:19.279562 27815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64490a86db8c4f5ca54f4f8085f41319" candidate_uuid: "2513a663afac495eb09126ff55e8b2b0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "18435fbb525741328139e84a1e354954" is_pre_election: true
I20260709 13:08:19.279956 27742 raft_consensus.cc:2468] T 64490a86db8c4f5ca54f4f8085f41319 P 665f7e09521a4c3f9284c1d8b0e094ff [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2513a663afac495eb09126ff55e8b2b0 in term 0.
I20260709 13:08:19.277364 27901 raft_consensus.cc:515] T dd959195de1942f7999397a56496f5bc P 41268b218b804905a110c86738e74400 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2513a663afac495eb09126ff55e8b2b0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40721 } } peers { permanent_uuid: "41268b218b804905a110c86738e74400" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 44403 } } peers { permanent_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 38749 } }
I20260709 13:08:19.282923 27901 leader_election.cc:290] T dd959195de1942f7999397a56496f5bc P 41268b218b804905a110c86738e74400 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2513a663afac495eb09126ff55e8b2b0 (127.17.223.1:40721), 665f7e09521a4c3f9284c1d8b0e094ff (127.17.223.3:38749)
I20260709 13:08:19.283962 27592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd959195de1942f7999397a56496f5bc" candidate_uuid: "41268b218b804905a110c86738e74400" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2513a663afac495eb09126ff55e8b2b0" is_pre_election: true
I20260709 13:08:19.284087 27559 leader_election.cc:304] T 64490a86db8c4f5ca54f4f8085f41319 P 2513a663afac495eb09126ff55e8b2b0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2513a663afac495eb09126ff55e8b2b0, 665f7e09521a4c3f9284c1d8b0e094ff; no voters: 
I20260709 13:08:19.268425 27863 tablet_bootstrap.cc:492] T fc84b896d2ae4581bc236b96d5de9de3 P 41268b218b804905a110c86738e74400: No bootstrap required, opened a new log
I20260709 13:08:19.288218 27870 raft_consensus.cc:2804] T 64490a86db8c4f5ca54f4f8085f41319 P 2513a663afac495eb09126ff55e8b2b0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:08:19.288662 27870 raft_consensus.cc:493] T 64490a86db8c4f5ca54f4f8085f41319 P 2513a663afac495eb09126ff55e8b2b0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:19.289039 27870 raft_consensus.cc:3060] T 64490a86db8c4f5ca54f4f8085f41319 P 2513a663afac495eb09126ff55e8b2b0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:19.291198 27863 ts_tablet_manager.cc:1403] T fc84b896d2ae4581bc236b96d5de9de3 P 41268b218b804905a110c86738e74400: Time spent bootstrapping tablet: real 0.125s	user 0.008s	sys 0.013s
I20260709 13:08:19.285184 27592 raft_consensus.cc:2468] T dd959195de1942f7999397a56496f5bc P 2513a663afac495eb09126ff55e8b2b0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 41268b218b804905a110c86738e74400 in term 0.
W20260709 13:08:19.292992 27559 leader_election.cc:343] T 64490a86db8c4f5ca54f4f8085f41319 P 2513a663afac495eb09126ff55e8b2b0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 18435fbb525741328139e84a1e354954 (127.17.223.4:40545): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:19.297210 27631 leader_election.cc:304] T dd959195de1942f7999397a56496f5bc P 41268b218b804905a110c86738e74400 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2513a663afac495eb09126ff55e8b2b0, 41268b218b804905a110c86738e74400; no voters: 
I20260709 13:08:19.297456 27742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd959195de1942f7999397a56496f5bc" candidate_uuid: "41268b218b804905a110c86738e74400" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" is_pre_election: true
I20260709 13:08:19.297999 27901 raft_consensus.cc:2804] T dd959195de1942f7999397a56496f5bc P 41268b218b804905a110c86738e74400 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:08:19.298416 27901 raft_consensus.cc:493] T dd959195de1942f7999397a56496f5bc P 41268b218b804905a110c86738e74400 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:19.298785 27901 raft_consensus.cc:3060] T dd959195de1942f7999397a56496f5bc P 41268b218b804905a110c86738e74400 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:08:19.303284 27634 leader_election.cc:343] T dd959195de1942f7999397a56496f5bc P 41268b218b804905a110c86738e74400 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 665f7e09521a4c3f9284c1d8b0e094ff (127.17.223.3:38749): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:19.307090 27870 raft_consensus.cc:515] T 64490a86db8c4f5ca54f4f8085f41319 P 2513a663afac495eb09126ff55e8b2b0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 38749 } } peers { permanent_uuid: "18435fbb525741328139e84a1e354954" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 40545 } } peers { permanent_uuid: "2513a663afac495eb09126ff55e8b2b0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40721 } }
I20260709 13:08:19.307083 27901 raft_consensus.cc:515] T dd959195de1942f7999397a56496f5bc P 41268b218b804905a110c86738e74400 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2513a663afac495eb09126ff55e8b2b0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40721 } } peers { permanent_uuid: "41268b218b804905a110c86738e74400" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 44403 } } peers { permanent_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 38749 } }
I20260709 13:08:19.309203 27870 leader_election.cc:290] T 64490a86db8c4f5ca54f4f8085f41319 P 2513a663afac495eb09126ff55e8b2b0 [CANDIDATE]: Term 1 election: Requested vote from peers 665f7e09521a4c3f9284c1d8b0e094ff (127.17.223.3:38749), 18435fbb525741328139e84a1e354954 (127.17.223.4:40545)
I20260709 13:08:19.309991 27901 leader_election.cc:290] T dd959195de1942f7999397a56496f5bc P 41268b218b804905a110c86738e74400 [CANDIDATE]: Term 1 election: Requested vote from peers 2513a663afac495eb09126ff55e8b2b0 (127.17.223.1:40721), 665f7e09521a4c3f9284c1d8b0e094ff (127.17.223.3:38749)
I20260709 13:08:19.311131 27592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd959195de1942f7999397a56496f5bc" candidate_uuid: "41268b218b804905a110c86738e74400" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2513a663afac495eb09126ff55e8b2b0"
I20260709 13:08:19.311720 27592 raft_consensus.cc:3060] T dd959195de1942f7999397a56496f5bc P 2513a663afac495eb09126ff55e8b2b0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:19.312228 27862 tablet_bootstrap.cc:492] T dd959195de1942f7999397a56496f5bc P 665f7e09521a4c3f9284c1d8b0e094ff: No bootstrap required, opened a new log
I20260709 13:08:19.312902 27862 ts_tablet_manager.cc:1403] T dd959195de1942f7999397a56496f5bc P 665f7e09521a4c3f9284c1d8b0e094ff: Time spent bootstrapping tablet: real 0.255s	user 0.032s	sys 0.019s
I20260709 13:08:19.311012 27731 tablet_service.cc:1511] Processing CreateTablet for tablet 9e94954fc474414ba7563be776d6c80a (DEFAULT_TABLE table=test-workload [id=726d57952dab4de7b40bbe78e31e0eaf]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 13:08:19.315485 27815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64490a86db8c4f5ca54f4f8085f41319" candidate_uuid: "2513a663afac495eb09126ff55e8b2b0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "18435fbb525741328139e84a1e354954"
I20260709 13:08:19.315630 27741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64490a86db8c4f5ca54f4f8085f41319" candidate_uuid: "2513a663afac495eb09126ff55e8b2b0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "665f7e09521a4c3f9284c1d8b0e094ff"
I20260709 13:08:19.315866 27903 consensus_queue.cc:1048] T 1a26f012cd6e4c4c8bf86b5fda903800 P 665f7e09521a4c3f9284c1d8b0e094ff [LEADER]: Connected to new peer: Peer: permanent_uuid: "2513a663afac495eb09126ff55e8b2b0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40721 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:08:19.316968 27742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd959195de1942f7999397a56496f5bc" candidate_uuid: "41268b218b804905a110c86738e74400" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "665f7e09521a4c3f9284c1d8b0e094ff"
W20260709 13:08:19.318414 27634 leader_election.cc:343] T dd959195de1942f7999397a56496f5bc P 41268b218b804905a110c86738e74400 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 665f7e09521a4c3f9284c1d8b0e094ff (127.17.223.3:38749): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:08:19.317085 27559 leader_election.cc:343] T 64490a86db8c4f5ca54f4f8085f41319 P 2513a663afac495eb09126ff55e8b2b0 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 18435fbb525741328139e84a1e354954 (127.17.223.4:40545): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:19.316283 27741 raft_consensus.cc:3060] T 64490a86db8c4f5ca54f4f8085f41319 P 665f7e09521a4c3f9284c1d8b0e094ff [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:19.321748 27863 raft_consensus.cc:359] T fc84b896d2ae4581bc236b96d5de9de3 P 41268b218b804905a110c86738e74400 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "41268b218b804905a110c86738e74400" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 44403 } } peers { permanent_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 38749 } } peers { permanent_uuid: "18435fbb525741328139e84a1e354954" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 40545 } }
I20260709 13:08:19.324517 27863 raft_consensus.cc:385] T fc84b896d2ae4581bc236b96d5de9de3 P 41268b218b804905a110c86738e74400 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:19.324849 27863 raft_consensus.cc:740] T fc84b896d2ae4581bc236b96d5de9de3 P 41268b218b804905a110c86738e74400 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 41268b218b804905a110c86738e74400, State: Initialized, Role: FOLLOWER
I20260709 13:08:19.316039 27731 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9e94954fc474414ba7563be776d6c80a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:19.335645 27656 tablet_service.cc:1511] Processing CreateTablet for tablet 9e94954fc474414ba7563be776d6c80a (DEFAULT_TABLE table=test-workload [id=726d57952dab4de7b40bbe78e31e0eaf]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 13:08:19.337101 27656 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9e94954fc474414ba7563be776d6c80a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:19.341058 27592 raft_consensus.cc:2468] T dd959195de1942f7999397a56496f5bc P 2513a663afac495eb09126ff55e8b2b0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 41268b218b804905a110c86738e74400 in term 1.
I20260709 13:08:19.346053 27654 tablet_service.cc:1511] Processing CreateTablet for tablet 585e960f8d0f42268f2fe98e1e7b83f0 (DEFAULT_TABLE table=test-workload [id=726d57952dab4de7b40bbe78e31e0eaf]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 13:08:19.346688 27576 tablet_service.cc:1511] Processing CreateTablet for tablet 585e960f8d0f42268f2fe98e1e7b83f0 (DEFAULT_TABLE table=test-workload [id=726d57952dab4de7b40bbe78e31e0eaf]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 13:08:19.347215 27631 leader_election.cc:304] T dd959195de1942f7999397a56496f5bc P 41268b218b804905a110c86738e74400 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2513a663afac495eb09126ff55e8b2b0, 41268b218b804905a110c86738e74400; no voters: 665f7e09521a4c3f9284c1d8b0e094ff
I20260709 13:08:19.347851 27870 raft_consensus.cc:493] T a9eac7f072de454a8ff2beb019da45d9 P 2513a663afac495eb09126ff55e8b2b0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:19.347234 27654 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 585e960f8d0f42268f2fe98e1e7b83f0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:19.341164 27741 raft_consensus.cc:2468] T 64490a86db8c4f5ca54f4f8085f41319 P 665f7e09521a4c3f9284c1d8b0e094ff [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2513a663afac495eb09126ff55e8b2b0 in term 1.
I20260709 13:08:19.349184 27559 leader_election.cc:304] T 64490a86db8c4f5ca54f4f8085f41319 P 2513a663afac495eb09126ff55e8b2b0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2513a663afac495eb09126ff55e8b2b0, 665f7e09521a4c3f9284c1d8b0e094ff; no voters: 18435fbb525741328139e84a1e354954
I20260709 13:08:19.350579 27898 raft_consensus.cc:2804] T 64490a86db8c4f5ca54f4f8085f41319 P 2513a663afac495eb09126ff55e8b2b0 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:08:19.344082 27865 tablet_bootstrap.cc:654] T 11224ef6c00a40cdba4311ceb63bddb9 P 18435fbb525741328139e84a1e354954: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:19.357362 27862 raft_consensus.cc:359] T dd959195de1942f7999397a56496f5bc P 665f7e09521a4c3f9284c1d8b0e094ff [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2513a663afac495eb09126ff55e8b2b0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40721 } } peers { permanent_uuid: "41268b218b804905a110c86738e74400" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 44403 } } peers { permanent_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 38749 } }
I20260709 13:08:19.358371 27862 raft_consensus.cc:385] T dd959195de1942f7999397a56496f5bc P 665f7e09521a4c3f9284c1d8b0e094ff [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:19.359850 27861 tablet_bootstrap.cc:492] T de531c50b1524ec788b27bc4b883689a P 2513a663afac495eb09126ff55e8b2b0: No bootstrap required, opened a new log
I20260709 13:08:19.360420 27861 ts_tablet_manager.cc:1403] T de531c50b1524ec788b27bc4b883689a P 2513a663afac495eb09126ff55e8b2b0: Time spent bootstrapping tablet: real 0.137s	user 0.013s	sys 0.008s
I20260709 13:08:19.349126 27732 tablet_service.cc:1511] Processing CreateTablet for tablet 585e960f8d0f42268f2fe98e1e7b83f0 (DEFAULT_TABLE table=test-workload [id=726d57952dab4de7b40bbe78e31e0eaf]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 13:08:19.363060 27732 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 585e960f8d0f42268f2fe98e1e7b83f0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:19.364334 27489 catalog_manager.cc:5697] T fc84b896d2ae4581bc236b96d5de9de3 P 665f7e09521a4c3f9284c1d8b0e094ff reported cstate change: term changed from 0 to 1, leader changed from <none> to 665f7e09521a4c3f9284c1d8b0e094ff (127.17.223.3). New cstate: current_term: 1 leader_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "41268b218b804905a110c86738e74400" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 44403 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 38749 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "18435fbb525741328139e84a1e354954" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 40545 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:19.330227 27863 consensus_queue.cc:260] T fc84b896d2ae4581bc236b96d5de9de3 P 41268b218b804905a110c86738e74400 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "41268b218b804905a110c86738e74400" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 44403 } } peers { permanent_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 38749 } } peers { permanent_uuid: "18435fbb525741328139e84a1e354954" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 40545 } }
I20260709 13:08:19.367286 27800 tablet_service.cc:1511] Processing CreateTablet for tablet 28737c73be174729ad3e9d238af7d975 (DEFAULT_TABLE table=test-workload [id=726d57952dab4de7b40bbe78e31e0eaf]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 13:08:19.368673 27901 raft_consensus.cc:2804] T dd959195de1942f7999397a56496f5bc P 41268b218b804905a110c86738e74400 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:08:19.357461 27870 raft_consensus.cc:515] T a9eac7f072de454a8ff2beb019da45d9 P 2513a663afac495eb09126ff55e8b2b0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18435fbb525741328139e84a1e354954" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 40545 } } peers { permanent_uuid: "2513a663afac495eb09126ff55e8b2b0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40721 } } peers { permanent_uuid: "41268b218b804905a110c86738e74400" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 44403 } }
I20260709 13:08:19.347955 27576 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 585e960f8d0f42268f2fe98e1e7b83f0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:19.370373 27578 tablet_service.cc:1511] Processing CreateTablet for tablet 28737c73be174729ad3e9d238af7d975 (DEFAULT_TABLE table=test-workload [id=726d57952dab4de7b40bbe78e31e0eaf]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 13:08:19.375435 27863 ts_tablet_manager.cc:1434] T fc84b896d2ae4581bc236b96d5de9de3 P 41268b218b804905a110c86738e74400: Time spent starting tablet: real 0.080s	user 0.005s	sys 0.002s
I20260709 13:08:19.382992 27730 tablet_service.cc:1511] Processing CreateTablet for tablet 9c0f604d66664505aa9469fb058601b6 (DEFAULT_TABLE table=test-workload [id=726d57952dab4de7b40bbe78e31e0eaf]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 13:08:19.383787 27583 tablet_service.cc:1511] Processing CreateTablet for tablet 9c0f604d66664505aa9469fb058601b6 (DEFAULT_TABLE table=test-workload [id=726d57952dab4de7b40bbe78e31e0eaf]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 13:08:19.384271 27863 tablet_bootstrap.cc:492] T 9ac520b68b79484990a8725d6549174e P 41268b218b804905a110c86738e74400: Bootstrap starting.
I20260709 13:08:19.384828 27730 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9c0f604d66664505aa9469fb058601b6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:19.385757 27805 tablet_service.cc:1511] Processing CreateTablet for tablet 9c0f604d66664505aa9469fb058601b6 (DEFAULT_TABLE table=test-workload [id=726d57952dab4de7b40bbe78e31e0eaf]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 13:08:19.382354 27668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9eac7f072de454a8ff2beb019da45d9" candidate_uuid: "2513a663afac495eb09126ff55e8b2b0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "41268b218b804905a110c86738e74400" is_pre_election: true
I20260709 13:08:19.387544 27668 raft_consensus.cc:2468] T a9eac7f072de454a8ff2beb019da45d9 P 41268b218b804905a110c86738e74400 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2513a663afac495eb09126ff55e8b2b0 in term 0.
W20260709 13:08:19.388684 27708 consensus_peers.cc:597] T 1a26f012cd6e4c4c8bf86b5fda903800 P 665f7e09521a4c3f9284c1d8b0e094ff -> Peer 41268b218b804905a110c86738e74400 (127.17.223.2:44403): Couldn't send request to peer 41268b218b804905a110c86738e74400. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:08:19.388854 27559 leader_election.cc:304] T a9eac7f072de454a8ff2beb019da45d9 P 2513a663afac495eb09126ff55e8b2b0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2513a663afac495eb09126ff55e8b2b0, 41268b218b804905a110c86738e74400; no voters: 
I20260709 13:08:19.389983 27583 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9c0f604d66664505aa9469fb058601b6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:19.391001 27578 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 28737c73be174729ad3e9d238af7d975. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:19.376441 27800 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 28737c73be174729ad3e9d238af7d975. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:19.381211 27815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9eac7f072de454a8ff2beb019da45d9" candidate_uuid: "2513a663afac495eb09126ff55e8b2b0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "18435fbb525741328139e84a1e354954" is_pre_election: true
I20260709 13:08:19.381955 27870 leader_election.cc:290] T a9eac7f072de454a8ff2beb019da45d9 P 2513a663afac495eb09126ff55e8b2b0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 18435fbb525741328139e84a1e354954 (127.17.223.4:40545), 41268b218b804905a110c86738e74400 (127.17.223.2:44403)
I20260709 13:08:19.382315 27797 tablet_service.cc:1511] Processing CreateTablet for tablet 9e94954fc474414ba7563be776d6c80a (DEFAULT_TABLE table=test-workload [id=726d57952dab4de7b40bbe78e31e0eaf]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 13:08:19.368059 27862 raft_consensus.cc:740] T dd959195de1942f7999397a56496f5bc P 665f7e09521a4c3f9284c1d8b0e094ff [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 665f7e09521a4c3f9284c1d8b0e094ff, State: Initialized, Role: FOLLOWER
I20260709 13:08:19.401443 27870 raft_consensus.cc:2804] T a9eac7f072de454a8ff2beb019da45d9 P 2513a663afac495eb09126ff55e8b2b0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:08:19.378170 27901 raft_consensus.cc:697] T dd959195de1942f7999397a56496f5bc P 41268b218b804905a110c86738e74400 [term 1 LEADER]: Becoming Leader. State: Replica: 41268b218b804905a110c86738e74400, State: Running, Role: LEADER
I20260709 13:08:19.401860 27870 raft_consensus.cc:493] T a9eac7f072de454a8ff2beb019da45d9 P 2513a663afac495eb09126ff55e8b2b0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:19.402522 27870 raft_consensus.cc:3060] T a9eac7f072de454a8ff2beb019da45d9 P 2513a663afac495eb09126ff55e8b2b0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:19.401806 27862 consensus_queue.cc:260] T dd959195de1942f7999397a56496f5bc P 665f7e09521a4c3f9284c1d8b0e094ff [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2513a663afac495eb09126ff55e8b2b0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40721 } } peers { permanent_uuid: "41268b218b804905a110c86738e74400" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 44403 } } peers { permanent_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 38749 } }
I20260709 13:08:19.404945 27862 ts_tablet_manager.cc:1434] T dd959195de1942f7999397a56496f5bc P 665f7e09521a4c3f9284c1d8b0e094ff: Time spent starting tablet: real 0.091s	user 0.006s	sys 0.000s
I20260709 13:08:19.406163 27862 tablet_bootstrap.cc:492] T 56803a5c0dea4efeabafb6829d9215cd P 665f7e09521a4c3f9284c1d8b0e094ff: Bootstrap starting.
I20260709 13:08:19.407557 27901 consensus_queue.cc:237] T dd959195de1942f7999397a56496f5bc P 41268b218b804905a110c86738e74400 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2513a663afac495eb09126ff55e8b2b0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40721 } } peers { permanent_uuid: "41268b218b804905a110c86738e74400" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 44403 } } peers { permanent_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 38749 } }
I20260709 13:08:19.411329 27897 raft_consensus.cc:493] T 9ac520b68b79484990a8725d6549174e P 665f7e09521a4c3f9284c1d8b0e094ff [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:19.411836 27897 raft_consensus.cc:515] T 9ac520b68b79484990a8725d6549174e P 665f7e09521a4c3f9284c1d8b0e094ff [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "41268b218b804905a110c86738e74400" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 44403 } } peers { permanent_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 38749 } } peers { permanent_uuid: "18435fbb525741328139e84a1e354954" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 40545 } }
I20260709 13:08:19.413779 27874 raft_consensus.cc:493] T 9ac520b68b79484990a8725d6549174e P 18435fbb525741328139e84a1e354954 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:19.414400 27874 raft_consensus.cc:515] T 9ac520b68b79484990a8725d6549174e P 18435fbb525741328139e84a1e354954 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "41268b218b804905a110c86738e74400" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 44403 } } peers { permanent_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 38749 } } peers { permanent_uuid: "18435fbb525741328139e84a1e354954" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 40545 } }
I20260709 13:08:19.416193 27815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ac520b68b79484990a8725d6549174e" candidate_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "18435fbb525741328139e84a1e354954" is_pre_election: true
I20260709 13:08:19.416834 27874 leader_election.cc:290] T 9ac520b68b79484990a8725d6549174e P 18435fbb525741328139e84a1e354954 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 41268b218b804905a110c86738e74400 (127.17.223.2:44403), 665f7e09521a4c3f9284c1d8b0e094ff (127.17.223.3:38749)
I20260709 13:08:19.417001 27815 raft_consensus.cc:2468] T 9ac520b68b79484990a8725d6549174e P 18435fbb525741328139e84a1e354954 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 665f7e09521a4c3f9284c1d8b0e094ff in term 0.
I20260709 13:08:19.413882 27897 leader_election.cc:290] T 9ac520b68b79484990a8725d6549174e P 665f7e09521a4c3f9284c1d8b0e094ff [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 41268b218b804905a110c86738e74400 (127.17.223.2:44403), 18435fbb525741328139e84a1e354954 (127.17.223.4:40545)
I20260709 13:08:19.400074 27898 raft_consensus.cc:697] T 64490a86db8c4f5ca54f4f8085f41319 P 2513a663afac495eb09126ff55e8b2b0 [term 1 LEADER]: Becoming Leader. State: Replica: 2513a663afac495eb09126ff55e8b2b0, State: Running, Role: LEADER
I20260709 13:08:19.424819 27797 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9e94954fc474414ba7563be776d6c80a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:19.426597 27668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ac520b68b79484990a8725d6549174e" candidate_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "41268b218b804905a110c86738e74400" is_pre_election: true
I20260709 13:08:19.443188 27667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ac520b68b79484990a8725d6549174e" candidate_uuid: "18435fbb525741328139e84a1e354954" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "41268b218b804905a110c86738e74400" is_pre_election: true
I20260709 13:08:19.444033 27654 tablet_service.cc:1511] Processing CreateTablet for tablet afcb3b39d1c9495eab95404687865537 (DEFAULT_TABLE table=test-workload [id=726d57952dab4de7b40bbe78e31e0eaf]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 13:08:19.445214 27654 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet afcb3b39d1c9495eab95404687865537. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:19.401755 27656 tablet_service.cc:1511] Processing CreateTablet for tablet 28737c73be174729ad3e9d238af7d975 (DEFAULT_TABLE table=test-workload [id=726d57952dab4de7b40bbe78e31e0eaf]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 13:08:19.447976 27805 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9c0f604d66664505aa9469fb058601b6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:19.449821 27872 raft_consensus.cc:493] T d0c8b4ec2d844a89b4bb66c0f1bf2c8f P 41268b218b804905a110c86738e74400 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:08:19.440398 27559 leader_election.cc:343] T a9eac7f072de454a8ff2beb019da45d9 P 2513a663afac495eb09126ff55e8b2b0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 18435fbb525741328139e84a1e354954 (127.17.223.4:40545): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:08:19.459619 27708 leader_election.cc:343] T 9ac520b68b79484990a8725d6549174e P 665f7e09521a4c3f9284c1d8b0e094ff [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 41268b218b804905a110c86738e74400 (127.17.223.2:44403): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:19.462306 27731 tablet_service.cc:1511] Processing CreateTablet for tablet afcb3b39d1c9495eab95404687865537 (DEFAULT_TABLE table=test-workload [id=726d57952dab4de7b40bbe78e31e0eaf]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 13:08:19.463358 27862 tablet_bootstrap.cc:654] T 56803a5c0dea4efeabafb6829d9215cd P 665f7e09521a4c3f9284c1d8b0e094ff: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:19.467741 27731 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet afcb3b39d1c9495eab95404687865537. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:19.472949 27861 raft_consensus.cc:359] T de531c50b1524ec788b27bc4b883689a P 2513a663afac495eb09126ff55e8b2b0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "41268b218b804905a110c86738e74400" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 44403 } } peers { permanent_uuid: "18435fbb525741328139e84a1e354954" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 40545 } } peers { permanent_uuid: "2513a663afac495eb09126ff55e8b2b0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40721 } }
I20260709 13:08:19.473762 27861 raft_consensus.cc:385] T de531c50b1524ec788b27bc4b883689a P 2513a663afac495eb09126ff55e8b2b0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:19.463167 27898 consensus_queue.cc:237] T 64490a86db8c4f5ca54f4f8085f41319 P 2513a663afac495eb09126ff55e8b2b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 38749 } } peers { permanent_uuid: "18435fbb525741328139e84a1e354954" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 40545 } } peers { permanent_uuid: "2513a663afac495eb09126ff55e8b2b0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40721 } }
I20260709 13:08:19.474711 27581 tablet_service.cc:1511] Processing CreateTablet for tablet e23b142958324f69aa0bad3a5828fa83 (DEFAULT_TABLE table=test-workload [id=726d57952dab4de7b40bbe78e31e0eaf]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 13:08:19.474080 27861 raft_consensus.cc:740] T de531c50b1524ec788b27bc4b883689a P 2513a663afac495eb09126ff55e8b2b0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2513a663afac495eb09126ff55e8b2b0, State: Initialized, Role: FOLLOWER
I20260709 13:08:19.476013 27581 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e23b142958324f69aa0bad3a5828fa83. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:19.476929 27897 raft_consensus.cc:493] T dd959195de1942f7999397a56496f5bc P 665f7e09521a4c3f9284c1d8b0e094ff [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:19.476647 27861 consensus_queue.cc:260] T de531c50b1524ec788b27bc4b883689a P 2513a663afac495eb09126ff55e8b2b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "41268b218b804905a110c86738e74400" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 44403 } } peers { permanent_uuid: "18435fbb525741328139e84a1e354954" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 40545 } } peers { permanent_uuid: "2513a663afac495eb09126ff55e8b2b0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40721 } }
I20260709 13:08:19.477440 27897 raft_consensus.cc:515] T dd959195de1942f7999397a56496f5bc P 665f7e09521a4c3f9284c1d8b0e094ff [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2513a663afac495eb09126ff55e8b2b0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40721 } } peers { permanent_uuid: "41268b218b804905a110c86738e74400" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 44403 } } peers { permanent_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 38749 } }
I20260709 13:08:19.479282 27861 ts_tablet_manager.cc:1434] T de531c50b1524ec788b27bc4b883689a P 2513a663afac495eb09126ff55e8b2b0: Time spent starting tablet: real 0.119s	user 0.006s	sys 0.004s
I20260709 13:08:19.479548 27897 leader_election.cc:290] T dd959195de1942f7999397a56496f5bc P 665f7e09521a4c3f9284c1d8b0e094ff [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2513a663afac495eb09126ff55e8b2b0 (127.17.223.1:40721), 41268b218b804905a110c86738e74400 (127.17.223.2:44403)
I20260709 13:08:19.465742 27872 raft_consensus.cc:515] T d0c8b4ec2d844a89b4bb66c0f1bf2c8f P 41268b218b804905a110c86738e74400 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18435fbb525741328139e84a1e354954" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 40545 } } peers { permanent_uuid: "2513a663afac495eb09126ff55e8b2b0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40721 } } peers { permanent_uuid: "41268b218b804905a110c86738e74400" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 44403 } }
I20260709 13:08:19.480355 27861 tablet_bootstrap.cc:492] T 456941807b254f5fb32dca4f84bd16ea P 2513a663afac495eb09126ff55e8b2b0: Bootstrap starting.
I20260709 13:08:19.462077 27656 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 28737c73be174729ad3e9d238af7d975. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:19.483294 27708 leader_election.cc:304] T 9ac520b68b79484990a8725d6549174e P 665f7e09521a4c3f9284c1d8b0e094ff [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 18435fbb525741328139e84a1e354954, 665f7e09521a4c3f9284c1d8b0e094ff; no voters: 41268b218b804905a110c86738e74400
I20260709 13:08:19.484156 27897 raft_consensus.cc:2804] T 9ac520b68b79484990a8725d6549174e P 665f7e09521a4c3f9284c1d8b0e094ff [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:08:19.484557 27897 raft_consensus.cc:493] T 9ac520b68b79484990a8725d6549174e P 665f7e09521a4c3f9284c1d8b0e094ff [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:19.484928 27897 raft_consensus.cc:3060] T 9ac520b68b79484990a8725d6549174e P 665f7e09521a4c3f9284c1d8b0e094ff [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:19.493119 27577 tablet_service.cc:1511] Processing CreateTablet for tablet b6be829f6d3f40c99a3c5be18b0c259c (DEFAULT_TABLE table=test-workload [id=726d57952dab4de7b40bbe78e31e0eaf]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 13:08:19.494519 27577 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b6be829f6d3f40c99a3c5be18b0c259c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:19.495491 27593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd959195de1942f7999397a56496f5bc" candidate_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2513a663afac495eb09126ff55e8b2b0" is_pre_election: true
I20260709 13:08:19.496299 27593 raft_consensus.cc:2393] T dd959195de1942f7999397a56496f5bc P 2513a663afac495eb09126ff55e8b2b0 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 665f7e09521a4c3f9284c1d8b0e094ff in current term 1: Already voted for candidate 41268b218b804905a110c86738e74400 in this term.
I20260709 13:08:19.497385 27668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd959195de1942f7999397a56496f5bc" candidate_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "41268b218b804905a110c86738e74400" is_pre_election: true
I20260709 13:08:19.499029 27798 tablet_service.cc:1511] Processing CreateTablet for tablet afcb3b39d1c9495eab95404687865537 (DEFAULT_TABLE table=test-workload [id=726d57952dab4de7b40bbe78e31e0eaf]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 13:08:19.499836 27872 leader_election.cc:290] T d0c8b4ec2d844a89b4bb66c0f1bf2c8f P 41268b218b804905a110c86738e74400 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 18435fbb525741328139e84a1e354954 (127.17.223.4:40545), 2513a663afac495eb09126ff55e8b2b0 (127.17.223.1:40721)
I20260709 13:08:19.500389 27798 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet afcb3b39d1c9495eab95404687865537. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:19.502372 27815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0c8b4ec2d844a89b4bb66c0f1bf2c8f" candidate_uuid: "41268b218b804905a110c86738e74400" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "18435fbb525741328139e84a1e354954" is_pre_election: true
I20260709 13:08:19.503072 27815 raft_consensus.cc:2468] T d0c8b4ec2d844a89b4bb66c0f1bf2c8f P 18435fbb525741328139e84a1e354954 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 41268b218b804905a110c86738e74400 in term 0.
I20260709 13:08:19.499074 27708 leader_election.cc:304] T dd959195de1942f7999397a56496f5bc P 665f7e09521a4c3f9284c1d8b0e094ff [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 665f7e09521a4c3f9284c1d8b0e094ff; no voters: 2513a663afac495eb09126ff55e8b2b0, 41268b218b804905a110c86738e74400
I20260709 13:08:19.501820 27490 catalog_manager.cc:5697] T dd959195de1942f7999397a56496f5bc P 41268b218b804905a110c86738e74400 reported cstate change: term changed from 0 to 1, leader changed from <none> to 41268b218b804905a110c86738e74400 (127.17.223.2). New cstate: current_term: 1 leader_uuid: "41268b218b804905a110c86738e74400" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2513a663afac495eb09126ff55e8b2b0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40721 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "41268b218b804905a110c86738e74400" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 44403 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 38749 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:19.504670 27903 raft_consensus.cc:3060] T dd959195de1942f7999397a56496f5bc P 665f7e09521a4c3f9284c1d8b0e094ff [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:19.505301 27727 tablet_service.cc:1511] Processing CreateTablet for tablet e23b142958324f69aa0bad3a5828fa83 (DEFAULT_TABLE table=test-workload [id=726d57952dab4de7b40bbe78e31e0eaf]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 13:08:19.505800 27870 raft_consensus.cc:515] T a9eac7f072de454a8ff2beb019da45d9 P 2513a663afac495eb09126ff55e8b2b0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18435fbb525741328139e84a1e354954" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 40545 } } peers { permanent_uuid: "2513a663afac495eb09126ff55e8b2b0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40721 } } peers { permanent_uuid: "41268b218b804905a110c86738e74400" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 44403 } }
I20260709 13:08:19.509225 27654 tablet_service.cc:1511] Processing CreateTablet for tablet e23b142958324f69aa0bad3a5828fa83 (DEFAULT_TABLE table=test-workload [id=726d57952dab4de7b40bbe78e31e0eaf]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 13:08:19.509795 27634 leader_election.cc:304] T d0c8b4ec2d844a89b4bb66c0f1bf2c8f P 41268b218b804905a110c86738e74400 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 18435fbb525741328139e84a1e354954, 41268b218b804905a110c86738e74400; no voters: 
I20260709 13:08:19.509965 27593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0c8b4ec2d844a89b4bb66c0f1bf2c8f" candidate_uuid: "41268b218b804905a110c86738e74400" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2513a663afac495eb09126ff55e8b2b0" is_pre_election: true
I20260709 13:08:19.506595 27727 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e23b142958324f69aa0bad3a5828fa83. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:19.512023 27815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9eac7f072de454a8ff2beb019da45d9" candidate_uuid: "2513a663afac495eb09126ff55e8b2b0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "18435fbb525741328139e84a1e354954"
W20260709 13:08:19.513000 27631 leader_election.cc:343] T d0c8b4ec2d844a89b4bb66c0f1bf2c8f P 41268b218b804905a110c86738e74400 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2513a663afac495eb09126ff55e8b2b0 (127.17.223.1:40721): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:08:19.513407 27559 leader_election.cc:343] T a9eac7f072de454a8ff2beb019da45d9 P 2513a663afac495eb09126ff55e8b2b0 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 18435fbb525741328139e84a1e354954 (127.17.223.4:40545): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:19.515195 27870 leader_election.cc:290] T a9eac7f072de454a8ff2beb019da45d9 P 2513a663afac495eb09126ff55e8b2b0 [CANDIDATE]: Term 1 election: Requested vote from peers 18435fbb525741328139e84a1e354954 (127.17.223.4:40545), 41268b218b804905a110c86738e74400 (127.17.223.2:44403)
I20260709 13:08:19.515398 27668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9eac7f072de454a8ff2beb019da45d9" candidate_uuid: "2513a663afac495eb09126ff55e8b2b0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "41268b218b804905a110c86738e74400"
I20260709 13:08:19.516009 27668 raft_consensus.cc:3060] T a9eac7f072de454a8ff2beb019da45d9 P 41268b218b804905a110c86738e74400 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:19.518172 27897 raft_consensus.cc:515] T 9ac520b68b79484990a8725d6549174e P 665f7e09521a4c3f9284c1d8b0e094ff [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "41268b218b804905a110c86738e74400" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 44403 } } peers { permanent_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 38749 } } peers { permanent_uuid: "18435fbb525741328139e84a1e354954" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 40545 } }
W20260709 13:08:19.519049 27782 leader_election.cc:343] T 9ac520b68b79484990a8725d6549174e P 18435fbb525741328139e84a1e354954 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 41268b218b804905a110c86738e74400 (127.17.223.2:44403): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:19.519321 27872 raft_consensus.cc:2804] T d0c8b4ec2d844a89b4bb66c0f1bf2c8f P 41268b218b804905a110c86738e74400 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:08:19.519737 27872 raft_consensus.cc:493] T d0c8b4ec2d844a89b4bb66c0f1bf2c8f P 41268b218b804905a110c86738e74400 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:19.520079 27872 raft_consensus.cc:3060] T d0c8b4ec2d844a89b4bb66c0f1bf2c8f P 41268b218b804905a110c86738e74400 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:19.520354 27897 leader_election.cc:290] T 9ac520b68b79484990a8725d6549174e P 665f7e09521a4c3f9284c1d8b0e094ff [CANDIDATE]: Term 1 election: Requested vote from peers 41268b218b804905a110c86738e74400 (127.17.223.2:44403), 18435fbb525741328139e84a1e354954 (127.17.223.4:40545)
I20260709 13:08:19.521039 27667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ac520b68b79484990a8725d6549174e" candidate_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "41268b218b804905a110c86738e74400"
W20260709 13:08:19.522953 27708 leader_election.cc:343] T 9ac520b68b79484990a8725d6549174e P 665f7e09521a4c3f9284c1d8b0e094ff [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 41268b218b804905a110c86738e74400 (127.17.223.2:44403): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:19.524706 27797 tablet_service.cc:1511] Processing CreateTablet for tablet b6be829f6d3f40c99a3c5be18b0c259c (DEFAULT_TABLE table=test-workload [id=726d57952dab4de7b40bbe78e31e0eaf]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 13:08:19.525925 27654 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e23b142958324f69aa0bad3a5828fa83. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:19.526511 27797 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b6be829f6d3f40c99a3c5be18b0c259c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:19.527026 27815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ac520b68b79484990a8725d6549174e" candidate_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "18435fbb525741328139e84a1e354954"
I20260709 13:08:19.527858 27815 raft_consensus.cc:3060] T 9ac520b68b79484990a8725d6549174e P 18435fbb525741328139e84a1e354954 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:19.534116 27861 tablet_bootstrap.cc:654] T 456941807b254f5fb32dca4f84bd16ea P 2513a663afac495eb09126ff55e8b2b0: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:19.534932 27815 raft_consensus.cc:2468] T 9ac520b68b79484990a8725d6549174e P 18435fbb525741328139e84a1e354954 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 665f7e09521a4c3f9284c1d8b0e094ff in term 1.
I20260709 13:08:19.535931 27865 tablet_bootstrap.cc:492] T 11224ef6c00a40cdba4311ceb63bddb9 P 18435fbb525741328139e84a1e354954: No bootstrap required, opened a new log
I20260709 13:08:19.536469 27865 ts_tablet_manager.cc:1403] T 11224ef6c00a40cdba4311ceb63bddb9 P 18435fbb525741328139e84a1e354954: Time spent bootstrapping tablet: real 0.296s	user 0.017s	sys 0.000s
I20260709 13:08:19.536850 27708 leader_election.cc:304] T 9ac520b68b79484990a8725d6549174e P 665f7e09521a4c3f9284c1d8b0e094ff [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 18435fbb525741328139e84a1e354954, 665f7e09521a4c3f9284c1d8b0e094ff; no voters: 41268b218b804905a110c86738e74400
I20260709 13:08:19.539676 27865 raft_consensus.cc:359] T 11224ef6c00a40cdba4311ceb63bddb9 P 18435fbb525741328139e84a1e354954 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 38749 } } peers { permanent_uuid: "18435fbb525741328139e84a1e354954" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 40545 } } peers { permanent_uuid: "2513a663afac495eb09126ff55e8b2b0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40721 } }
I20260709 13:08:19.540433 27865 raft_consensus.cc:385] T 11224ef6c00a40cdba4311ceb63bddb9 P 18435fbb525741328139e84a1e354954 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:19.540735 27865 raft_consensus.cc:740] T 11224ef6c00a40cdba4311ceb63bddb9 P 18435fbb525741328139e84a1e354954 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 18435fbb525741328139e84a1e354954, State: Initialized, Role: FOLLOWER
I20260709 13:08:19.541510 27865 consensus_queue.cc:260] T 11224ef6c00a40cdba4311ceb63bddb9 P 18435fbb525741328139e84a1e354954 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 38749 } } peers { permanent_uuid: "18435fbb525741328139e84a1e354954" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 40545 } } peers { permanent_uuid: "2513a663afac495eb09126ff55e8b2b0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40721 } }
I20260709 13:08:19.505306 27863 tablet_bootstrap.cc:654] T 9ac520b68b79484990a8725d6549174e P 41268b218b804905a110c86738e74400: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:19.544273 27651 tablet_service.cc:1511] Processing CreateTablet for tablet b6be829f6d3f40c99a3c5be18b0c259c (DEFAULT_TABLE table=test-workload [id=726d57952dab4de7b40bbe78e31e0eaf]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 13:08:19.545580 27651 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b6be829f6d3f40c99a3c5be18b0c259c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:19.545414 27732 tablet_service.cc:1511] Processing CreateTablet for tablet 9db60240699a4db2ba5faa2c50a742da (DEFAULT_TABLE table=test-workload [id=726d57952dab4de7b40bbe78e31e0eaf]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 13:08:19.546610 27732 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9db60240699a4db2ba5faa2c50a742da. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:19.552621 27803 tablet_service.cc:1511] Processing CreateTablet for tablet 9db60240699a4db2ba5faa2c50a742da (DEFAULT_TABLE table=test-workload [id=726d57952dab4de7b40bbe78e31e0eaf]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 13:08:19.553833 27803 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9db60240699a4db2ba5faa2c50a742da. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:19.559000 27897 raft_consensus.cc:2804] T 9ac520b68b79484990a8725d6549174e P 665f7e09521a4c3f9284c1d8b0e094ff [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:08:19.559790 27897 raft_consensus.cc:697] T 9ac520b68b79484990a8725d6549174e P 665f7e09521a4c3f9284c1d8b0e094ff [term 1 LEADER]: Becoming Leader. State: Replica: 665f7e09521a4c3f9284c1d8b0e094ff, State: Running, Role: LEADER
I20260709 13:08:19.561896 27583 tablet_service.cc:1511] Processing CreateTablet for tablet 9db60240699a4db2ba5faa2c50a742da (DEFAULT_TABLE table=test-workload [id=726d57952dab4de7b40bbe78e31e0eaf]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 13:08:19.562520 27897 consensus_queue.cc:237] T 9ac520b68b79484990a8725d6549174e P 665f7e09521a4c3f9284c1d8b0e094ff [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "41268b218b804905a110c86738e74400" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 44403 } } peers { permanent_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 38749 } } peers { permanent_uuid: "18435fbb525741328139e84a1e354954" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 40545 } }
I20260709 13:08:19.566871 27652 tablet_service.cc:1511] Processing CreateTablet for tablet 539b1d2240654c74bd9054a06a8eaac6 (DEFAULT_TABLE table=test-workload [id=726d57952dab4de7b40bbe78e31e0eaf]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 13:08:19.563336 27583 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9db60240699a4db2ba5faa2c50a742da. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:19.568189 27652 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 539b1d2240654c74bd9054a06a8eaac6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:19.571235 27668 raft_consensus.cc:2468] T a9eac7f072de454a8ff2beb019da45d9 P 41268b218b804905a110c86738e74400 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2513a663afac495eb09126ff55e8b2b0 in term 1.
I20260709 13:08:19.572679 27559 leader_election.cc:304] T a9eac7f072de454a8ff2beb019da45d9 P 2513a663afac495eb09126ff55e8b2b0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2513a663afac495eb09126ff55e8b2b0, 41268b218b804905a110c86738e74400; no voters: 18435fbb525741328139e84a1e354954
I20260709 13:08:19.573588 27870 raft_consensus.cc:2804] T a9eac7f072de454a8ff2beb019da45d9 P 2513a663afac495eb09126ff55e8b2b0 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:08:19.574077 27870 raft_consensus.cc:697] T a9eac7f072de454a8ff2beb019da45d9 P 2513a663afac495eb09126ff55e8b2b0 [term 1 LEADER]: Becoming Leader. State: Replica: 2513a663afac495eb09126ff55e8b2b0, State: Running, Role: LEADER
I20260709 13:08:19.574867 27870 consensus_queue.cc:237] T a9eac7f072de454a8ff2beb019da45d9 P 2513a663afac495eb09126ff55e8b2b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18435fbb525741328139e84a1e354954" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 40545 } } peers { permanent_uuid: "2513a663afac495eb09126ff55e8b2b0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40721 } } peers { permanent_uuid: "41268b218b804905a110c86738e74400" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 44403 } }
I20260709 13:08:19.570138 27872 raft_consensus.cc:515] T d0c8b4ec2d844a89b4bb66c0f1bf2c8f P 41268b218b804905a110c86738e74400 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18435fbb525741328139e84a1e354954" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 40545 } } peers { permanent_uuid: "2513a663afac495eb09126ff55e8b2b0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40721 } } peers { permanent_uuid: "41268b218b804905a110c86738e74400" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 44403 } }
I20260709 13:08:19.597947 27861 tablet_bootstrap.cc:492] T 456941807b254f5fb32dca4f84bd16ea P 2513a663afac495eb09126ff55e8b2b0: No bootstrap required, opened a new log
I20260709 13:08:19.598774 27861 ts_tablet_manager.cc:1403] T 456941807b254f5fb32dca4f84bd16ea P 2513a663afac495eb09126ff55e8b2b0: Time spent bootstrapping tablet: real 0.119s	user 0.017s	sys 0.011s
I20260709 13:08:19.600618 27863 tablet_bootstrap.cc:492] T 9ac520b68b79484990a8725d6549174e P 41268b218b804905a110c86738e74400: No bootstrap required, opened a new log
I20260709 13:08:19.601172 27863 ts_tablet_manager.cc:1403] T 9ac520b68b79484990a8725d6549174e P 41268b218b804905a110c86738e74400: Time spent bootstrapping tablet: real 0.217s	user 0.015s	sys 0.001s
I20260709 13:08:19.603132 27861 raft_consensus.cc:359] T 456941807b254f5fb32dca4f84bd16ea P 2513a663afac495eb09126ff55e8b2b0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2513a663afac495eb09126ff55e8b2b0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40721 } } peers { permanent_uuid: "41268b218b804905a110c86738e74400" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 44403 } } peers { permanent_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 38749 } }
I20260709 13:08:19.603957 27861 raft_consensus.cc:385] T 456941807b254f5fb32dca4f84bd16ea P 2513a663afac495eb09126ff55e8b2b0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:19.604382 27861 raft_consensus.cc:740] T 456941807b254f5fb32dca4f84bd16ea P 2513a663afac495eb09126ff55e8b2b0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2513a663afac495eb09126ff55e8b2b0, State: Initialized, Role: FOLLOWER
I20260709 13:08:19.604717 27741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ac520b68b79484990a8725d6549174e" candidate_uuid: "18435fbb525741328139e84a1e354954" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" is_pre_election: true
I20260709 13:08:19.604020 27863 raft_consensus.cc:359] T 9ac520b68b79484990a8725d6549174e P 41268b218b804905a110c86738e74400 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "41268b218b804905a110c86738e74400" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 44403 } } peers { permanent_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 38749 } } peers { permanent_uuid: "18435fbb525741328139e84a1e354954" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 40545 } }
I20260709 13:08:19.605262 27861 consensus_queue.cc:260] T 456941807b254f5fb32dca4f84bd16ea P 2513a663afac495eb09126ff55e8b2b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2513a663afac495eb09126ff55e8b2b0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40721 } } peers { permanent_uuid: "41268b218b804905a110c86738e74400" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 44403 } } peers { permanent_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 38749 } }
I20260709 13:08:19.606272 27782 leader_election.cc:304] T 9ac520b68b79484990a8725d6549174e P 18435fbb525741328139e84a1e354954 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 18435fbb525741328139e84a1e354954; no voters: 41268b218b804905a110c86738e74400, 665f7e09521a4c3f9284c1d8b0e094ff
I20260709 13:08:19.606516 27668 raft_consensus.cc:3060] T fc84b896d2ae4581bc236b96d5de9de3 P 41268b218b804905a110c86738e74400 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:19.605798 27863 raft_consensus.cc:385] T 9ac520b68b79484990a8725d6549174e P 41268b218b804905a110c86738e74400 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:19.608393 27874 raft_consensus.cc:2749] T 9ac520b68b79484990a8725d6549174e P 18435fbb525741328139e84a1e354954 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:08:19.619443 27865 ts_tablet_manager.cc:1434] T 11224ef6c00a40cdba4311ceb63bddb9 P 18435fbb525741328139e84a1e354954: Time spent starting tablet: real 0.083s	user 0.007s	sys 0.000s
I20260709 13:08:19.620533 27865 tablet_bootstrap.cc:492] T 18f991bbbf3a4615aab49899c7ef86dc P 18435fbb525741328139e84a1e354954: Bootstrap starting.
I20260709 13:08:19.623541 27903 raft_consensus.cc:2749] T dd959195de1942f7999397a56496f5bc P 665f7e09521a4c3f9284c1d8b0e094ff [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:08:19.608600 27863 raft_consensus.cc:740] T 9ac520b68b79484990a8725d6549174e P 41268b218b804905a110c86738e74400 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 41268b218b804905a110c86738e74400, State: Initialized, Role: FOLLOWER
I20260709 13:08:19.650965 27730 tablet_service.cc:1511] Processing CreateTablet for tablet 539b1d2240654c74bd9054a06a8eaac6 (DEFAULT_TABLE table=test-workload [id=726d57952dab4de7b40bbe78e31e0eaf]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 13:08:19.652555 27730 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 539b1d2240654c74bd9054a06a8eaac6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:19.656652 27803 tablet_service.cc:1511] Processing CreateTablet for tablet 539b1d2240654c74bd9054a06a8eaac6 (DEFAULT_TABLE table=test-workload [id=726d57952dab4de7b40bbe78e31e0eaf]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 13:08:19.658157 27803 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 539b1d2240654c74bd9054a06a8eaac6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:19.658802 27863 consensus_queue.cc:260] T 9ac520b68b79484990a8725d6549174e P 41268b218b804905a110c86738e74400 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "41268b218b804905a110c86738e74400" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 44403 } } peers { permanent_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 38749 } } peers { permanent_uuid: "18435fbb525741328139e84a1e354954" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 40545 } }
I20260709 13:08:19.659929 27576 tablet_service.cc:1511] Processing CreateTablet for tablet bbd0bdc9640c4956a5d60406841ef0f0 (DEFAULT_TABLE table=test-workload [id=726d57952dab4de7b40bbe78e31e0eaf]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 13:08:19.666575 27576 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bbd0bdc9640c4956a5d60406841ef0f0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:19.661634 27863 ts_tablet_manager.cc:1434] T 9ac520b68b79484990a8725d6549174e P 41268b218b804905a110c86738e74400: Time spent starting tablet: real 0.060s	user 0.006s	sys 0.001s
I20260709 13:08:19.671886 27863 tablet_bootstrap.cc:492] T 7b77a53b493f4e979fdf38a0b17176b0 P 41268b218b804905a110c86738e74400: Bootstrap starting.
I20260709 13:08:19.672750 27874 raft_consensus.cc:493] T 11224ef6c00a40cdba4311ceb63bddb9 P 18435fbb525741328139e84a1e354954 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:19.673280 27874 raft_consensus.cc:515] T 11224ef6c00a40cdba4311ceb63bddb9 P 18435fbb525741328139e84a1e354954 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 38749 } } peers { permanent_uuid: "18435fbb525741328139e84a1e354954" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 40545 } } peers { permanent_uuid: "2513a663afac495eb09126ff55e8b2b0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40721 } }
I20260709 13:08:19.675401 27874 leader_election.cc:290] T 11224ef6c00a40cdba4311ceb63bddb9 P 18435fbb525741328139e84a1e354954 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 665f7e09521a4c3f9284c1d8b0e094ff (127.17.223.3:38749), 2513a663afac495eb09126ff55e8b2b0 (127.17.223.1:40721)
I20260709 13:08:19.675748 27872 leader_election.cc:290] T d0c8b4ec2d844a89b4bb66c0f1bf2c8f P 41268b218b804905a110c86738e74400 [CANDIDATE]: Term 1 election: Requested vote from peers 18435fbb525741328139e84a1e354954 (127.17.223.4:40545), 2513a663afac495eb09126ff55e8b2b0 (127.17.223.1:40721)
I20260709 13:08:19.677539 27862 tablet_bootstrap.cc:492] T 56803a5c0dea4efeabafb6829d9215cd P 665f7e09521a4c3f9284c1d8b0e094ff: No bootstrap required, opened a new log
I20260709 13:08:19.678049 27862 ts_tablet_manager.cc:1403] T 56803a5c0dea4efeabafb6829d9215cd P 665f7e09521a4c3f9284c1d8b0e094ff: Time spent bootstrapping tablet: real 0.272s	user 0.024s	sys 0.023s
I20260709 13:08:19.678360 27815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0c8b4ec2d844a89b4bb66c0f1bf2c8f" candidate_uuid: "41268b218b804905a110c86738e74400" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "18435fbb525741328139e84a1e354954"
I20260709 13:08:19.679025 27815 raft_consensus.cc:3060] T d0c8b4ec2d844a89b4bb66c0f1bf2c8f P 18435fbb525741328139e84a1e354954 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:19.681206 27862 raft_consensus.cc:359] T 56803a5c0dea4efeabafb6829d9215cd P 665f7e09521a4c3f9284c1d8b0e094ff [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "41268b218b804905a110c86738e74400" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 44403 } } peers { permanent_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 38749 } } peers { permanent_uuid: "18435fbb525741328139e84a1e354954" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 40545 } }
I20260709 13:08:19.681919 27862 raft_consensus.cc:385] T 56803a5c0dea4efeabafb6829d9215cd P 665f7e09521a4c3f9284c1d8b0e094ff [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:19.677577 27593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0c8b4ec2d844a89b4bb66c0f1bf2c8f" candidate_uuid: "41268b218b804905a110c86738e74400" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2513a663afac495eb09126ff55e8b2b0"
I20260709 13:08:19.688829 27732 tablet_service.cc:1511] Processing CreateTablet for tablet bbd0bdc9640c4956a5d60406841ef0f0 (DEFAULT_TABLE table=test-workload [id=726d57952dab4de7b40bbe78e31e0eaf]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 13:08:19.689280 27741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11224ef6c00a40cdba4311ceb63bddb9" candidate_uuid: "18435fbb525741328139e84a1e354954" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" is_pre_election: true
W20260709 13:08:19.689426 27631 leader_election.cc:343] T d0c8b4ec2d844a89b4bb66c0f1bf2c8f P 41268b218b804905a110c86738e74400 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 2513a663afac495eb09126ff55e8b2b0 (127.17.223.1:40721): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:19.690007 27732 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bbd0bdc9640c4956a5d60406841ef0f0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:19.682206 27862 raft_consensus.cc:740] T 56803a5c0dea4efeabafb6829d9215cd P 665f7e09521a4c3f9284c1d8b0e094ff [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 665f7e09521a4c3f9284c1d8b0e094ff, State: Initialized, Role: FOLLOWER
W20260709 13:08:19.696907 27782 leader_election.cc:343] T 11224ef6c00a40cdba4311ceb63bddb9 P 18435fbb525741328139e84a1e354954 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 665f7e09521a4c3f9284c1d8b0e094ff (127.17.223.3:38749): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:19.694962 27798 tablet_service.cc:1511] Processing CreateTablet for tablet 86af954f570648969cbc47c03d15c447 (DEFAULT_TABLE table=test-workload [id=726d57952dab4de7b40bbe78e31e0eaf]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 13:08:19.698156 27798 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 86af954f570648969cbc47c03d15c447. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:19.701274 27652 tablet_service.cc:1511] Processing CreateTablet for tablet 86af954f570648969cbc47c03d15c447 (DEFAULT_TABLE table=test-workload [id=726d57952dab4de7b40bbe78e31e0eaf]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 13:08:19.702466 27593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11224ef6c00a40cdba4311ceb63bddb9" candidate_uuid: "18435fbb525741328139e84a1e354954" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2513a663afac495eb09126ff55e8b2b0" is_pre_election: true
W20260709 13:08:19.704202 27779 leader_election.cc:343] T 11224ef6c00a40cdba4311ceb63bddb9 P 18435fbb525741328139e84a1e354954 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2513a663afac495eb09126ff55e8b2b0 (127.17.223.1:40721): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:19.704664 27779 leader_election.cc:304] T 11224ef6c00a40cdba4311ceb63bddb9 P 18435fbb525741328139e84a1e354954 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 18435fbb525741328139e84a1e354954; no voters: 2513a663afac495eb09126ff55e8b2b0, 665f7e09521a4c3f9284c1d8b0e094ff
I20260709 13:08:19.701427 27800 tablet_service.cc:1511] Processing CreateTablet for tablet fb246ce2984c4a6393f12f75083c9fcf (DEFAULT_TABLE table=test-workload [id=726d57952dab4de7b40bbe78e31e0eaf]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 13:08:19.705677 27577 tablet_service.cc:1511] Processing CreateTablet for tablet 86af954f570648969cbc47c03d15c447 (DEFAULT_TABLE table=test-workload [id=726d57952dab4de7b40bbe78e31e0eaf]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 13:08:19.706313 27800 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fb246ce2984c4a6393f12f75083c9fcf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:19.706617 27577 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 86af954f570648969cbc47c03d15c447. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:19.676891 27488 catalog_manager.cc:5697] T 64490a86db8c4f5ca54f4f8085f41319 P 2513a663afac495eb09126ff55e8b2b0 reported cstate change: term changed from 0 to 1, leader changed from <none> to 2513a663afac495eb09126ff55e8b2b0 (127.17.223.1). New cstate: current_term: 1 leader_uuid: "2513a663afac495eb09126ff55e8b2b0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 38749 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "18435fbb525741328139e84a1e354954" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 40545 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2513a663afac495eb09126ff55e8b2b0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40721 } health_report { overall_health: HEALTHY } } }
I20260709 13:08:19.709472 27581 tablet_service.cc:1511] Processing CreateTablet for tablet fb246ce2984c4a6393f12f75083c9fcf (DEFAULT_TABLE table=test-workload [id=726d57952dab4de7b40bbe78e31e0eaf]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 13:08:19.710278 27865 tablet_bootstrap.cc:654] T 18f991bbbf3a4615aab49899c7ef86dc P 18435fbb525741328139e84a1e354954: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:19.710690 27581 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fb246ce2984c4a6393f12f75083c9fcf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:19.711053 27861 ts_tablet_manager.cc:1434] T 456941807b254f5fb32dca4f84bd16ea P 2513a663afac495eb09126ff55e8b2b0: Time spent starting tablet: real 0.111s	user 0.005s	sys 0.003s
I20260709 13:08:19.712101 27861 tablet_bootstrap.cc:492] T d0c8b4ec2d844a89b4bb66c0f1bf2c8f P 2513a663afac495eb09126ff55e8b2b0: Bootstrap starting.
I20260709 13:08:19.716547 27874 raft_consensus.cc:2749] T 11224ef6c00a40cdba4311ceb63bddb9 P 18435fbb525741328139e84a1e354954 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:08:19.719564 27656 tablet_service.cc:1511] Processing CreateTablet for tablet bbd0bdc9640c4956a5d60406841ef0f0 (DEFAULT_TABLE table=test-workload [id=726d57952dab4de7b40bbe78e31e0eaf]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 13:08:19.723882 27815 raft_consensus.cc:2468] T d0c8b4ec2d844a89b4bb66c0f1bf2c8f P 18435fbb525741328139e84a1e354954 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 41268b218b804905a110c86738e74400 in term 1.
I20260709 13:08:19.731384 27634 leader_election.cc:304] T d0c8b4ec2d844a89b4bb66c0f1bf2c8f P 41268b218b804905a110c86738e74400 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 18435fbb525741328139e84a1e354954, 41268b218b804905a110c86738e74400; no voters: 2513a663afac495eb09126ff55e8b2b0
I20260709 13:08:19.732367 27872 raft_consensus.cc:2804] T d0c8b4ec2d844a89b4bb66c0f1bf2c8f P 41268b218b804905a110c86738e74400 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:08:19.732852 27872 raft_consensus.cc:697] T d0c8b4ec2d844a89b4bb66c0f1bf2c8f P 41268b218b804905a110c86738e74400 [term 1 LEADER]: Becoming Leader. State: Replica: 41268b218b804905a110c86738e74400, State: Running, Role: LEADER
I20260709 13:08:19.733100 27897 consensus_queue.cc:1048] T fc84b896d2ae4581bc236b96d5de9de3 P 665f7e09521a4c3f9284c1d8b0e094ff [LEADER]: Connected to new peer: Peer: permanent_uuid: "18435fbb525741328139e84a1e354954" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 40545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.006s
I20260709 13:08:19.734189 27652 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 86af954f570648969cbc47c03d15c447. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:19.733652 27872 consensus_queue.cc:237] T d0c8b4ec2d844a89b4bb66c0f1bf2c8f P 41268b218b804905a110c86738e74400 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18435fbb525741328139e84a1e354954" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 40545 } } peers { permanent_uuid: "2513a663afac495eb09126ff55e8b2b0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40721 } } peers { permanent_uuid: "41268b218b804905a110c86738e74400" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 44403 } }
I20260709 13:08:19.733779 27731 tablet_service.cc:1511] Processing CreateTablet for tablet fb246ce2984c4a6393f12f75083c9fcf (DEFAULT_TABLE table=test-workload [id=726d57952dab4de7b40bbe78e31e0eaf]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 13:08:19.739333 27656 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bbd0bdc9640c4956a5d60406841ef0f0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:19.739482 27862 consensus_queue.cc:260] T 56803a5c0dea4efeabafb6829d9215cd P 665f7e09521a4c3f9284c1d8b0e094ff [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "41268b218b804905a110c86738e74400" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 44403 } } peers { permanent_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 38749 } } peers { permanent_uuid: "18435fbb525741328139e84a1e354954" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 40545 } }
I20260709 13:08:19.741721 27862 ts_tablet_manager.cc:1434] T 56803a5c0dea4efeabafb6829d9215cd P 665f7e09521a4c3f9284c1d8b0e094ff: Time spent starting tablet: real 0.063s	user 0.004s	sys 0.002s
I20260709 13:08:19.742636 27490 catalog_manager.cc:5697] T a9eac7f072de454a8ff2beb019da45d9 P 2513a663afac495eb09126ff55e8b2b0 reported cstate change: term changed from 0 to 1, leader changed from <none> to 2513a663afac495eb09126ff55e8b2b0 (127.17.223.1). New cstate: current_term: 1 leader_uuid: "2513a663afac495eb09126ff55e8b2b0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18435fbb525741328139e84a1e354954" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 40545 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2513a663afac495eb09126ff55e8b2b0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40721 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "41268b218b804905a110c86738e74400" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 44403 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:19.743192 27863 tablet_bootstrap.cc:654] T 7b77a53b493f4e979fdf38a0b17176b0 P 41268b218b804905a110c86738e74400: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:19.743366 27731 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fb246ce2984c4a6393f12f75083c9fcf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:19.742731 27862 tablet_bootstrap.cc:492] T 456941807b254f5fb32dca4f84bd16ea P 665f7e09521a4c3f9284c1d8b0e094ff: Bootstrap starting.
I20260709 13:08:19.760641 27897 consensus_queue.cc:1048] T fc84b896d2ae4581bc236b96d5de9de3 P 665f7e09521a4c3f9284c1d8b0e094ff [LEADER]: Connected to new peer: Peer: permanent_uuid: "41268b218b804905a110c86738e74400" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 44403 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:08:19.770406 27861 tablet_bootstrap.cc:654] T d0c8b4ec2d844a89b4bb66c0f1bf2c8f P 2513a663afac495eb09126ff55e8b2b0: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:19.722608 27487 catalog_manager.cc:5697] T 9ac520b68b79484990a8725d6549174e P 665f7e09521a4c3f9284c1d8b0e094ff reported cstate change: term changed from 0 to 1, leader changed from <none> to 665f7e09521a4c3f9284c1d8b0e094ff (127.17.223.3). New cstate: current_term: 1 leader_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "41268b218b804905a110c86738e74400" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 44403 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 38749 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "18435fbb525741328139e84a1e354954" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 40545 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:19.780848 27865 tablet_bootstrap.cc:492] T 18f991bbbf3a4615aab49899c7ef86dc P 18435fbb525741328139e84a1e354954: No bootstrap required, opened a new log
I20260709 13:08:19.781394 27865 ts_tablet_manager.cc:1403] T 18f991bbbf3a4615aab49899c7ef86dc P 18435fbb525741328139e84a1e354954: Time spent bootstrapping tablet: real 0.161s	user 0.008s	sys 0.012s
I20260709 13:08:19.787134 27865 raft_consensus.cc:359] T 18f991bbbf3a4615aab49899c7ef86dc P 18435fbb525741328139e84a1e354954 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2513a663afac495eb09126ff55e8b2b0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40721 } } peers { permanent_uuid: "18435fbb525741328139e84a1e354954" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 40545 } } peers { permanent_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 38749 } }
I20260709 13:08:19.788523 27865 raft_consensus.cc:385] T 18f991bbbf3a4615aab49899c7ef86dc P 18435fbb525741328139e84a1e354954 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:19.789575 27865 raft_consensus.cc:740] T 18f991bbbf3a4615aab49899c7ef86dc P 18435fbb525741328139e84a1e354954 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 18435fbb525741328139e84a1e354954, State: Initialized, Role: FOLLOWER
I20260709 13:08:19.790340 27865 consensus_queue.cc:260] T 18f991bbbf3a4615aab49899c7ef86dc P 18435fbb525741328139e84a1e354954 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2513a663afac495eb09126ff55e8b2b0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40721 } } peers { permanent_uuid: "18435fbb525741328139e84a1e354954" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 40545 } } peers { permanent_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 38749 } }
I20260709 13:08:19.812316 27863 tablet_bootstrap.cc:492] T 7b77a53b493f4e979fdf38a0b17176b0 P 41268b218b804905a110c86738e74400: No bootstrap required, opened a new log
I20260709 13:08:19.811009 27865 ts_tablet_manager.cc:1434] T 18f991bbbf3a4615aab49899c7ef86dc P 18435fbb525741328139e84a1e354954: Time spent starting tablet: real 0.029s	user 0.010s	sys 0.000s
I20260709 13:08:19.812884 27863 ts_tablet_manager.cc:1403] T 7b77a53b493f4e979fdf38a0b17176b0 P 41268b218b804905a110c86738e74400: Time spent bootstrapping tablet: real 0.141s	user 0.009s	sys 0.010s
I20260709 13:08:19.814042 27865 tablet_bootstrap.cc:492] T 64490a86db8c4f5ca54f4f8085f41319 P 18435fbb525741328139e84a1e354954: Bootstrap starting.
I20260709 13:08:19.816443 27863 raft_consensus.cc:359] T 7b77a53b493f4e979fdf38a0b17176b0 P 41268b218b804905a110c86738e74400 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2513a663afac495eb09126ff55e8b2b0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40721 } } peers { permanent_uuid: "41268b218b804905a110c86738e74400" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 44403 } } peers { permanent_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 38749 } }
I20260709 13:08:19.817289 27863 raft_consensus.cc:385] T 7b77a53b493f4e979fdf38a0b17176b0 P 41268b218b804905a110c86738e74400 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:19.817564 27863 raft_consensus.cc:740] T 7b77a53b493f4e979fdf38a0b17176b0 P 41268b218b804905a110c86738e74400 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 41268b218b804905a110c86738e74400, State: Initialized, Role: FOLLOWER
I20260709 13:08:19.818382 27863 consensus_queue.cc:260] T 7b77a53b493f4e979fdf38a0b17176b0 P 41268b218b804905a110c86738e74400 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2513a663afac495eb09126ff55e8b2b0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40721 } } peers { permanent_uuid: "41268b218b804905a110c86738e74400" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 44403 } } peers { permanent_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 38749 } }
I20260709 13:08:19.822618 27901 raft_consensus.cc:493] T fc84b896d2ae4581bc236b96d5de9de3 P 41268b218b804905a110c86738e74400 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 665f7e09521a4c3f9284c1d8b0e094ff)
I20260709 13:08:19.823292 27901 raft_consensus.cc:515] T fc84b896d2ae4581bc236b96d5de9de3 P 41268b218b804905a110c86738e74400 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "41268b218b804905a110c86738e74400" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 44403 } } peers { permanent_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 38749 } } peers { permanent_uuid: "18435fbb525741328139e84a1e354954" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 40545 } }
I20260709 13:08:19.823711 27865 tablet_bootstrap.cc:654] T 64490a86db8c4f5ca54f4f8085f41319 P 18435fbb525741328139e84a1e354954: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:19.823894 27898 raft_consensus.cc:493] T de531c50b1524ec788b27bc4b883689a P 2513a663afac495eb09126ff55e8b2b0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:19.824518 27898 raft_consensus.cc:515] T de531c50b1524ec788b27bc4b883689a P 2513a663afac495eb09126ff55e8b2b0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "41268b218b804905a110c86738e74400" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 44403 } } peers { permanent_uuid: "18435fbb525741328139e84a1e354954" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 40545 } } peers { permanent_uuid: "2513a663afac495eb09126ff55e8b2b0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40721 } }
I20260709 13:08:19.827443 27863 ts_tablet_manager.cc:1434] T 7b77a53b493f4e979fdf38a0b17176b0 P 41268b218b804905a110c86738e74400: Time spent starting tablet: real 0.014s	user 0.006s	sys 0.000s
I20260709 13:08:19.830229 27863 tablet_bootstrap.cc:492] T 1a26f012cd6e4c4c8bf86b5fda903800 P 41268b218b804905a110c86738e74400: Bootstrap starting.
I20260709 13:08:19.833359 27668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de531c50b1524ec788b27bc4b883689a" candidate_uuid: "2513a663afac495eb09126ff55e8b2b0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "41268b218b804905a110c86738e74400" is_pre_election: true
I20260709 13:08:19.834048 27861 tablet_bootstrap.cc:492] T d0c8b4ec2d844a89b4bb66c0f1bf2c8f P 2513a663afac495eb09126ff55e8b2b0: No bootstrap required, opened a new log
I20260709 13:08:19.834558 27861 ts_tablet_manager.cc:1403] T d0c8b4ec2d844a89b4bb66c0f1bf2c8f P 2513a663afac495eb09126ff55e8b2b0: Time spent bootstrapping tablet: real 0.123s	user 0.012s	sys 0.001s
I20260709 13:08:19.835480 27741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc84b896d2ae4581bc236b96d5de9de3" candidate_uuid: "41268b218b804905a110c86738e74400" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" is_pre_election: true
I20260709 13:08:19.826633 27898 leader_election.cc:290] T de531c50b1524ec788b27bc4b883689a P 2513a663afac495eb09126ff55e8b2b0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 41268b218b804905a110c86738e74400 (127.17.223.2:44403), 18435fbb525741328139e84a1e354954 (127.17.223.4:40545)
I20260709 13:08:19.836738 27935 consensus_queue.cc:1048] T dd959195de1942f7999397a56496f5bc P 41268b218b804905a110c86738e74400 [LEADER]: Connected to new peer: Peer: permanent_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 38749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.010s
I20260709 13:08:19.837996 27816 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de531c50b1524ec788b27bc4b883689a" candidate_uuid: "2513a663afac495eb09126ff55e8b2b0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "18435fbb525741328139e84a1e354954" is_pre_election: true
I20260709 13:08:19.839473 27901 leader_election.cc:290] T fc84b896d2ae4581bc236b96d5de9de3 P 41268b218b804905a110c86738e74400 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 665f7e09521a4c3f9284c1d8b0e094ff (127.17.223.3:38749), 18435fbb525741328139e84a1e354954 (127.17.223.4:40545)
I20260709 13:08:19.841457 27861 raft_consensus.cc:359] T d0c8b4ec2d844a89b4bb66c0f1bf2c8f P 2513a663afac495eb09126ff55e8b2b0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18435fbb525741328139e84a1e354954" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 40545 } } peers { permanent_uuid: "2513a663afac495eb09126ff55e8b2b0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40721 } } peers { permanent_uuid: "41268b218b804905a110c86738e74400" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 44403 } }
I20260709 13:08:19.843533 27815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc84b896d2ae4581bc236b96d5de9de3" candidate_uuid: "41268b218b804905a110c86738e74400" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "18435fbb525741328139e84a1e354954" is_pre_election: true
W20260709 13:08:19.844902 27559 leader_election.cc:343] T de531c50b1524ec788b27bc4b883689a P 2513a663afac495eb09126ff55e8b2b0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 41268b218b804905a110c86738e74400 (127.17.223.2:44403): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:19.851197 27861 raft_consensus.cc:385] T d0c8b4ec2d844a89b4bb66c0f1bf2c8f P 2513a663afac495eb09126ff55e8b2b0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:19.851632 27861 raft_consensus.cc:740] T d0c8b4ec2d844a89b4bb66c0f1bf2c8f P 2513a663afac495eb09126ff55e8b2b0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2513a663afac495eb09126ff55e8b2b0, State: Initialized, Role: FOLLOWER
I20260709 13:08:19.852257 27862 tablet_bootstrap.cc:654] T 456941807b254f5fb32dca4f84bd16ea P 665f7e09521a4c3f9284c1d8b0e094ff: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:19.852555 27861 consensus_queue.cc:260] T d0c8b4ec2d844a89b4bb66c0f1bf2c8f P 2513a663afac495eb09126ff55e8b2b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18435fbb525741328139e84a1e354954" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 40545 } } peers { permanent_uuid: "2513a663afac495eb09126ff55e8b2b0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40721 } } peers { permanent_uuid: "41268b218b804905a110c86738e74400" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 44403 } }
W20260709 13:08:19.854900 27559 leader_election.cc:343] T de531c50b1524ec788b27bc4b883689a P 2513a663afac495eb09126ff55e8b2b0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 18435fbb525741328139e84a1e354954 (127.17.223.4:40545): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:19.855585 27559 leader_election.cc:304] T de531c50b1524ec788b27bc4b883689a P 2513a663afac495eb09126ff55e8b2b0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2513a663afac495eb09126ff55e8b2b0; no voters: 18435fbb525741328139e84a1e354954, 41268b218b804905a110c86738e74400
I20260709 13:08:19.854832 27634 leader_election.cc:304] T fc84b896d2ae4581bc236b96d5de9de3 P 41268b218b804905a110c86738e74400 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 41268b218b804905a110c86738e74400; no voters: 18435fbb525741328139e84a1e354954, 665f7e09521a4c3f9284c1d8b0e094ff
I20260709 13:08:19.856498 27870 raft_consensus.cc:2749] T de531c50b1524ec788b27bc4b883689a P 2513a663afac495eb09126ff55e8b2b0 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:08:19.857694 27489 catalog_manager.cc:5697] T d0c8b4ec2d844a89b4bb66c0f1bf2c8f P 41268b218b804905a110c86738e74400 reported cstate change: term changed from 0 to 1, leader changed from <none> to 41268b218b804905a110c86738e74400 (127.17.223.2). New cstate: current_term: 1 leader_uuid: "41268b218b804905a110c86738e74400" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18435fbb525741328139e84a1e354954" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 40545 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2513a663afac495eb09126ff55e8b2b0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40721 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "41268b218b804905a110c86738e74400" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 44403 } health_report { overall_health: HEALTHY } } }
I20260709 13:08:19.859030 27861 ts_tablet_manager.cc:1434] T d0c8b4ec2d844a89b4bb66c0f1bf2c8f P 2513a663afac495eb09126ff55e8b2b0: Time spent starting tablet: real 0.024s	user 0.007s	sys 0.001s
I20260709 13:08:19.860105 27861 tablet_bootstrap.cc:492] T 18f991bbbf3a4615aab49899c7ef86dc P 2513a663afac495eb09126ff55e8b2b0: Bootstrap starting.
I20260709 13:08:19.860603 27901 raft_consensus.cc:2749] T fc84b896d2ae4581bc236b96d5de9de3 P 41268b218b804905a110c86738e74400 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:08:19.862208 27863 tablet_bootstrap.cc:654] T 1a26f012cd6e4c4c8bf86b5fda903800 P 41268b218b804905a110c86738e74400: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:19.862881 27865 tablet_bootstrap.cc:492] T 64490a86db8c4f5ca54f4f8085f41319 P 18435fbb525741328139e84a1e354954: No bootstrap required, opened a new log
I20260709 13:08:19.863413 27865 ts_tablet_manager.cc:1403] T 64490a86db8c4f5ca54f4f8085f41319 P 18435fbb525741328139e84a1e354954: Time spent bootstrapping tablet: real 0.050s	user 0.020s	sys 0.015s
I20260709 13:08:19.867614 27865 raft_consensus.cc:359] T 64490a86db8c4f5ca54f4f8085f41319 P 18435fbb525741328139e84a1e354954 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 38749 } } peers { permanent_uuid: "18435fbb525741328139e84a1e354954" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 40545 } } peers { permanent_uuid: "2513a663afac495eb09126ff55e8b2b0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40721 } }
I20260709 13:08:19.870632 27861 tablet_bootstrap.cc:654] T 18f991bbbf3a4615aab49899c7ef86dc P 2513a663afac495eb09126ff55e8b2b0: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:19.868779 27865 raft_consensus.cc:385] T 64490a86db8c4f5ca54f4f8085f41319 P 18435fbb525741328139e84a1e354954 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:19.872557 27865 raft_consensus.cc:740] T 64490a86db8c4f5ca54f4f8085f41319 P 18435fbb525741328139e84a1e354954 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 18435fbb525741328139e84a1e354954, State: Initialized, Role: FOLLOWER
I20260709 13:08:19.873360 27865 consensus_queue.cc:260] T 64490a86db8c4f5ca54f4f8085f41319 P 18435fbb525741328139e84a1e354954 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 38749 } } peers { permanent_uuid: "18435fbb525741328139e84a1e354954" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 40545 } } peers { permanent_uuid: "2513a663afac495eb09126ff55e8b2b0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40721 } }
I20260709 13:08:19.875836 27865 ts_tablet_manager.cc:1434] T 64490a86db8c4f5ca54f4f8085f41319 P 18435fbb525741328139e84a1e354954: Time spent starting tablet: real 0.012s	user 0.007s	sys 0.000s
I20260709 13:08:19.878322 27862 tablet_bootstrap.cc:492] T 456941807b254f5fb32dca4f84bd16ea P 665f7e09521a4c3f9284c1d8b0e094ff: No bootstrap required, opened a new log
I20260709 13:08:19.878947 27862 ts_tablet_manager.cc:1403] T 456941807b254f5fb32dca4f84bd16ea P 665f7e09521a4c3f9284c1d8b0e094ff: Time spent bootstrapping tablet: real 0.136s	user 0.012s	sys 0.006s
I20260709 13:08:19.881196 27863 tablet_bootstrap.cc:492] T 1a26f012cd6e4c4c8bf86b5fda903800 P 41268b218b804905a110c86738e74400: No bootstrap required, opened a new log
I20260709 13:08:19.881695 27863 ts_tablet_manager.cc:1403] T 1a26f012cd6e4c4c8bf86b5fda903800 P 41268b218b804905a110c86738e74400: Time spent bootstrapping tablet: real 0.052s	user 0.010s	sys 0.002s
I20260709 13:08:19.882033 27862 raft_consensus.cc:359] T 456941807b254f5fb32dca4f84bd16ea P 665f7e09521a4c3f9284c1d8b0e094ff [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2513a663afac495eb09126ff55e8b2b0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40721 } } peers { permanent_uuid: "41268b218b804905a110c86738e74400" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 44403 } } peers { permanent_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 38749 } }
I20260709 13:08:19.882820 27862 raft_consensus.cc:385] T 456941807b254f5fb32dca4f84bd16ea P 665f7e09521a4c3f9284c1d8b0e094ff [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:19.883116 27862 raft_consensus.cc:740] T 456941807b254f5fb32dca4f84bd16ea P 665f7e09521a4c3f9284c1d8b0e094ff [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 665f7e09521a4c3f9284c1d8b0e094ff, State: Initialized, Role: FOLLOWER
I20260709 13:08:19.883864 27862 consensus_queue.cc:260] T 456941807b254f5fb32dca4f84bd16ea P 665f7e09521a4c3f9284c1d8b0e094ff [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2513a663afac495eb09126ff55e8b2b0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40721 } } peers { permanent_uuid: "41268b218b804905a110c86738e74400" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 44403 } } peers { permanent_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 38749 } }
I20260709 13:08:19.885334 27865 tablet_bootstrap.cc:492] T 56803a5c0dea4efeabafb6829d9215cd P 18435fbb525741328139e84a1e354954: Bootstrap starting.
I20260709 13:08:19.884466 27863 raft_consensus.cc:359] T 1a26f012cd6e4c4c8bf86b5fda903800 P 41268b218b804905a110c86738e74400 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "41268b218b804905a110c86738e74400" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 44403 } } peers { permanent_uuid: "2513a663afac495eb09126ff55e8b2b0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40721 } } peers { permanent_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 38749 } }
I20260709 13:08:19.887447 27863 raft_consensus.cc:385] T 1a26f012cd6e4c4c8bf86b5fda903800 P 41268b218b804905a110c86738e74400 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:19.887717 27863 raft_consensus.cc:740] T 1a26f012cd6e4c4c8bf86b5fda903800 P 41268b218b804905a110c86738e74400 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 41268b218b804905a110c86738e74400, State: Initialized, Role: FOLLOWER
I20260709 13:08:19.888521 27863 consensus_queue.cc:260] T 1a26f012cd6e4c4c8bf86b5fda903800 P 41268b218b804905a110c86738e74400 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "41268b218b804905a110c86738e74400" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 44403 } } peers { permanent_uuid: "2513a663afac495eb09126ff55e8b2b0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40721 } } peers { permanent_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 38749 } }
I20260709 13:08:19.890527 27863 ts_tablet_manager.cc:1434] T 1a26f012cd6e4c4c8bf86b5fda903800 P 41268b218b804905a110c86738e74400: Time spent starting tablet: real 0.009s	user 0.005s	sys 0.001s
I20260709 13:08:19.891590 27865 tablet_bootstrap.cc:654] T 56803a5c0dea4efeabafb6829d9215cd P 18435fbb525741328139e84a1e354954: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:19.896986 27862 ts_tablet_manager.cc:1434] T 456941807b254f5fb32dca4f84bd16ea P 665f7e09521a4c3f9284c1d8b0e094ff: Time spent starting tablet: real 0.018s	user 0.005s	sys 0.001s
I20260709 13:08:19.898026 27862 tablet_bootstrap.cc:492] T 18f991bbbf3a4615aab49899c7ef86dc P 665f7e09521a4c3f9284c1d8b0e094ff: Bootstrap starting.
I20260709 13:08:19.899084 27863 tablet_bootstrap.cc:492] T de531c50b1524ec788b27bc4b883689a P 41268b218b804905a110c86738e74400: Bootstrap starting.
I20260709 13:08:19.906337 27862 tablet_bootstrap.cc:654] T 18f991bbbf3a4615aab49899c7ef86dc P 665f7e09521a4c3f9284c1d8b0e094ff: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:19.906831 27863 tablet_bootstrap.cc:654] T de531c50b1524ec788b27bc4b883689a P 41268b218b804905a110c86738e74400: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:19.909369 27874 raft_consensus.cc:493] T 18f991bbbf3a4615aab49899c7ef86dc P 18435fbb525741328139e84a1e354954 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:19.914992 27874 raft_consensus.cc:515] T 18f991bbbf3a4615aab49899c7ef86dc P 18435fbb525741328139e84a1e354954 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2513a663afac495eb09126ff55e8b2b0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40721 } } peers { permanent_uuid: "18435fbb525741328139e84a1e354954" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 40545 } } peers { permanent_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 38749 } }
I20260709 13:08:19.916534 27901 raft_consensus.cc:493] T 1a26f012cd6e4c4c8bf86b5fda903800 P 41268b218b804905a110c86738e74400 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:19.917315 27874 leader_election.cc:290] T 18f991bbbf3a4615aab49899c7ef86dc P 18435fbb525741328139e84a1e354954 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2513a663afac495eb09126ff55e8b2b0 (127.17.223.1:40721), 665f7e09521a4c3f9284c1d8b0e094ff (127.17.223.3:38749)
I20260709 13:08:19.919262 27861 tablet_bootstrap.cc:492] T 18f991bbbf3a4615aab49899c7ef86dc P 2513a663afac495eb09126ff55e8b2b0: No bootstrap required, opened a new log
I20260709 13:08:19.919728 27861 ts_tablet_manager.cc:1403] T 18f991bbbf3a4615aab49899c7ef86dc P 2513a663afac495eb09126ff55e8b2b0: Time spent bootstrapping tablet: real 0.060s	user 0.017s	sys 0.007s
I20260709 13:08:19.920455 27593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18f991bbbf3a4615aab49899c7ef86dc" candidate_uuid: "18435fbb525741328139e84a1e354954" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2513a663afac495eb09126ff55e8b2b0" is_pre_election: true
I20260709 13:08:19.920733 27865 tablet_bootstrap.cc:492] T 56803a5c0dea4efeabafb6829d9215cd P 18435fbb525741328139e84a1e354954: No bootstrap required, opened a new log
I20260709 13:08:19.921391 27865 ts_tablet_manager.cc:1403] T 56803a5c0dea4efeabafb6829d9215cd P 18435fbb525741328139e84a1e354954: Time spent bootstrapping tablet: real 0.036s	user 0.014s	sys 0.007s
I20260709 13:08:19.921378 27741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18f991bbbf3a4615aab49899c7ef86dc" candidate_uuid: "18435fbb525741328139e84a1e354954" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" is_pre_election: true
I20260709 13:08:19.915012 27935 consensus_queue.cc:1048] T dd959195de1942f7999397a56496f5bc P 41268b218b804905a110c86738e74400 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2513a663afac495eb09126ff55e8b2b0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40721 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.007s
W20260709 13:08:19.923238 27782 leader_election.cc:343] T 18f991bbbf3a4615aab49899c7ef86dc P 18435fbb525741328139e84a1e354954 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 665f7e09521a4c3f9284c1d8b0e094ff (127.17.223.3:38749): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:19.924458 27898 raft_consensus.cc:493] T 456941807b254f5fb32dca4f84bd16ea P 2513a663afac495eb09126ff55e8b2b0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:19.924937 27898 raft_consensus.cc:515] T 456941807b254f5fb32dca4f84bd16ea P 2513a663afac495eb09126ff55e8b2b0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2513a663afac495eb09126ff55e8b2b0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40721 } } peers { permanent_uuid: "41268b218b804905a110c86738e74400" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 44403 } } peers { permanent_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 38749 } }
W20260709 13:08:19.926128 27779 leader_election.cc:343] T 18f991bbbf3a4615aab49899c7ef86dc P 18435fbb525741328139e84a1e354954 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2513a663afac495eb09126ff55e8b2b0 (127.17.223.1:40721): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:19.926591 27779 leader_election.cc:304] T 18f991bbbf3a4615aab49899c7ef86dc P 18435fbb525741328139e84a1e354954 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 18435fbb525741328139e84a1e354954; no voters: 2513a663afac495eb09126ff55e8b2b0, 665f7e09521a4c3f9284c1d8b0e094ff
I20260709 13:08:19.927121 27898 leader_election.cc:290] T 456941807b254f5fb32dca4f84bd16ea P 2513a663afac495eb09126ff55e8b2b0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 41268b218b804905a110c86738e74400 (127.17.223.2:44403), 665f7e09521a4c3f9284c1d8b0e094ff (127.17.223.3:38749)
I20260709 13:08:19.927723 27874 raft_consensus.cc:2749] T 18f991bbbf3a4615aab49899c7ef86dc P 18435fbb525741328139e84a1e354954 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:08:19.929487 27667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "456941807b254f5fb32dca4f84bd16ea" candidate_uuid: "2513a663afac495eb09126ff55e8b2b0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "41268b218b804905a110c86738e74400" is_pre_election: true
I20260709 13:08:19.930160 27667 raft_consensus.cc:2468] T 456941807b254f5fb32dca4f84bd16ea P 41268b218b804905a110c86738e74400 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2513a663afac495eb09126ff55e8b2b0 in term 0.
I20260709 13:08:19.917063 27901 raft_consensus.cc:515] T 1a26f012cd6e4c4c8bf86b5fda903800 P 41268b218b804905a110c86738e74400 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "41268b218b804905a110c86738e74400" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 44403 } } peers { permanent_uuid: "2513a663afac495eb09126ff55e8b2b0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40721 } } peers { permanent_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 38749 } }
I20260709 13:08:19.932426 27901 leader_election.cc:290] T 1a26f012cd6e4c4c8bf86b5fda903800 P 41268b218b804905a110c86738e74400 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2513a663afac495eb09126ff55e8b2b0 (127.17.223.1:40721), 665f7e09521a4c3f9284c1d8b0e094ff (127.17.223.3:38749)
I20260709 13:08:19.932632 27861 raft_consensus.cc:359] T 18f991bbbf3a4615aab49899c7ef86dc P 2513a663afac495eb09126ff55e8b2b0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2513a663afac495eb09126ff55e8b2b0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40721 } } peers { permanent_uuid: "18435fbb525741328139e84a1e354954" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 40545 } } peers { permanent_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 38749 } }
I20260709 13:08:19.934083 27742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a26f012cd6e4c4c8bf86b5fda903800" candidate_uuid: "41268b218b804905a110c86738e74400" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" is_pre_election: true
I20260709 13:08:19.935659 27861 raft_consensus.cc:385] T 18f991bbbf3a4615aab49899c7ef86dc P 2513a663afac495eb09126ff55e8b2b0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:19.936084 27861 raft_consensus.cc:740] T 18f991bbbf3a4615aab49899c7ef86dc P 2513a663afac495eb09126ff55e8b2b0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2513a663afac495eb09126ff55e8b2b0, State: Initialized, Role: FOLLOWER
I20260709 13:08:19.936825 27861 consensus_queue.cc:260] T 18f991bbbf3a4615aab49899c7ef86dc P 2513a663afac495eb09126ff55e8b2b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2513a663afac495eb09126ff55e8b2b0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40721 } } peers { permanent_uuid: "18435fbb525741328139e84a1e354954" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 40545 } } peers { permanent_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 38749 } }
I20260709 13:08:19.936939 27865 raft_consensus.cc:359] T 56803a5c0dea4efeabafb6829d9215cd P 18435fbb525741328139e84a1e354954 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "41268b218b804905a110c86738e74400" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 44403 } } peers { permanent_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 38749 } } peers { permanent_uuid: "18435fbb525741328139e84a1e354954" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 40545 } }
I20260709 13:08:19.937593 27593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a26f012cd6e4c4c8bf86b5fda903800" candidate_uuid: "41268b218b804905a110c86738e74400" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2513a663afac495eb09126ff55e8b2b0" is_pre_election: true
I20260709 13:08:19.939049 27741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "456941807b254f5fb32dca4f84bd16ea" candidate_uuid: "2513a663afac495eb09126ff55e8b2b0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" is_pre_election: true
I20260709 13:08:19.939670 27741 raft_consensus.cc:2468] T 456941807b254f5fb32dca4f84bd16ea P 665f7e09521a4c3f9284c1d8b0e094ff [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2513a663afac495eb09126ff55e8b2b0 in term 0.
I20260709 13:08:19.940357 27865 raft_consensus.cc:385] T 56803a5c0dea4efeabafb6829d9215cd P 18435fbb525741328139e84a1e354954 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:19.940114 27631 leader_election.cc:304] T 1a26f012cd6e4c4c8bf86b5fda903800 P 41268b218b804905a110c86738e74400 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 41268b218b804905a110c86738e74400; no voters: 2513a663afac495eb09126ff55e8b2b0, 665f7e09521a4c3f9284c1d8b0e094ff
I20260709 13:08:19.941027 27865 raft_consensus.cc:740] T 56803a5c0dea4efeabafb6829d9215cd P 18435fbb525741328139e84a1e354954 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 18435fbb525741328139e84a1e354954, State: Initialized, Role: FOLLOWER
I20260709 13:08:19.940452 27861 ts_tablet_manager.cc:1434] T 18f991bbbf3a4615aab49899c7ef86dc P 2513a663afac495eb09126ff55e8b2b0: Time spent starting tablet: real 0.020s	user 0.004s	sys 0.004s
I20260709 13:08:19.941442 27901 raft_consensus.cc:2749] T 1a26f012cd6e4c4c8bf86b5fda903800 P 41268b218b804905a110c86738e74400 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:08:19.942265 27559 leader_election.cc:304] T 456941807b254f5fb32dca4f84bd16ea P 2513a663afac495eb09126ff55e8b2b0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2513a663afac495eb09126ff55e8b2b0, 41268b218b804905a110c86738e74400; no voters: 
I20260709 13:08:19.942476 27861 tablet_bootstrap.cc:492] T bc0b10615ecb4485a9a9de298938697d P 2513a663afac495eb09126ff55e8b2b0: Bootstrap starting.
I20260709 13:08:19.940101 27863 tablet_bootstrap.cc:492] T de531c50b1524ec788b27bc4b883689a P 41268b218b804905a110c86738e74400: No bootstrap required, opened a new log
I20260709 13:08:19.943102 27898 raft_consensus.cc:2804] T 456941807b254f5fb32dca4f84bd16ea P 2513a663afac495eb09126ff55e8b2b0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:08:19.943508 27898 raft_consensus.cc:493] T 456941807b254f5fb32dca4f84bd16ea P 2513a663afac495eb09126ff55e8b2b0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:19.943717 27863 ts_tablet_manager.cc:1403] T de531c50b1524ec788b27bc4b883689a P 41268b218b804905a110c86738e74400: Time spent bootstrapping tablet: real 0.045s	user 0.021s	sys 0.001s
I20260709 13:08:19.943871 27898 raft_consensus.cc:3060] T 456941807b254f5fb32dca4f84bd16ea P 2513a663afac495eb09126ff55e8b2b0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:19.945048 27865 consensus_queue.cc:260] T 56803a5c0dea4efeabafb6829d9215cd P 18435fbb525741328139e84a1e354954 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "41268b218b804905a110c86738e74400" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 44403 } } peers { permanent_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 38749 } } peers { permanent_uuid: "18435fbb525741328139e84a1e354954" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 40545 } }
I20260709 13:08:19.946748 27863 raft_consensus.cc:359] T de531c50b1524ec788b27bc4b883689a P 41268b218b804905a110c86738e74400 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "41268b218b804905a110c86738e74400" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 44403 } } peers { permanent_uuid: "18435fbb525741328139e84a1e354954" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 40545 } } peers { permanent_uuid: "2513a663afac495eb09126ff55e8b2b0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40721 } }
I20260709 13:08:19.947419 27863 raft_consensus.cc:385] T de531c50b1524ec788b27bc4b883689a P 41268b218b804905a110c86738e74400 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:19.947671 27863 raft_consensus.cc:740] T de531c50b1524ec788b27bc4b883689a P 41268b218b804905a110c86738e74400 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 41268b218b804905a110c86738e74400, State: Initialized, Role: FOLLOWER
I20260709 13:08:19.948257 27865 ts_tablet_manager.cc:1434] T 56803a5c0dea4efeabafb6829d9215cd P 18435fbb525741328139e84a1e354954: Time spent starting tablet: real 0.024s	user 0.006s	sys 0.000s
I20260709 13:08:19.948403 27863 consensus_queue.cc:260] T de531c50b1524ec788b27bc4b883689a P 41268b218b804905a110c86738e74400 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "41268b218b804905a110c86738e74400" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 44403 } } peers { permanent_uuid: "18435fbb525741328139e84a1e354954" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 40545 } } peers { permanent_uuid: "2513a663afac495eb09126ff55e8b2b0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40721 } }
I20260709 13:08:19.949185 27865 tablet_bootstrap.cc:492] T de531c50b1524ec788b27bc4b883689a P 18435fbb525741328139e84a1e354954: Bootstrap starting.
I20260709 13:08:19.950870 27863 ts_tablet_manager.cc:1434] T de531c50b1524ec788b27bc4b883689a P 41268b218b804905a110c86738e74400: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:08:19.952085 27863 tablet_bootstrap.cc:492] T bc0b10615ecb4485a9a9de298938697d P 41268b218b804905a110c86738e74400: Bootstrap starting.
I20260709 13:08:19.952122 27898 raft_consensus.cc:515] T 456941807b254f5fb32dca4f84bd16ea P 2513a663afac495eb09126ff55e8b2b0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2513a663afac495eb09126ff55e8b2b0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40721 } } peers { permanent_uuid: "41268b218b804905a110c86738e74400" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 44403 } } peers { permanent_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 38749 } }
I20260709 13:08:19.956652 27898 leader_election.cc:290] T 456941807b254f5fb32dca4f84bd16ea P 2513a663afac495eb09126ff55e8b2b0 [CANDIDATE]: Term 1 election: Requested vote from peers 41268b218b804905a110c86738e74400 (127.17.223.2:44403), 665f7e09521a4c3f9284c1d8b0e094ff (127.17.223.3:38749)
I20260709 13:08:19.959668 27863 tablet_bootstrap.cc:654] T bc0b10615ecb4485a9a9de298938697d P 41268b218b804905a110c86738e74400: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:19.959884 27865 tablet_bootstrap.cc:654] T de531c50b1524ec788b27bc4b883689a P 18435fbb525741328139e84a1e354954: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:19.966300 27861 tablet_bootstrap.cc:654] T bc0b10615ecb4485a9a9de298938697d P 2513a663afac495eb09126ff55e8b2b0: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:19.960057 27741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "456941807b254f5fb32dca4f84bd16ea" candidate_uuid: "2513a663afac495eb09126ff55e8b2b0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "665f7e09521a4c3f9284c1d8b0e094ff"
I20260709 13:08:19.975052 27741 raft_consensus.cc:3060] T 456941807b254f5fb32dca4f84bd16ea P 665f7e09521a4c3f9284c1d8b0e094ff [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:19.960942 27667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "456941807b254f5fb32dca4f84bd16ea" candidate_uuid: "2513a663afac495eb09126ff55e8b2b0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "41268b218b804905a110c86738e74400"
I20260709 13:08:19.978026 27667 raft_consensus.cc:3060] T 456941807b254f5fb32dca4f84bd16ea P 41268b218b804905a110c86738e74400 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:08:19.978930 27539 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:08:19.961391 27870 raft_consensus.cc:493] T 18f991bbbf3a4615aab49899c7ef86dc P 2513a663afac495eb09126ff55e8b2b0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:19.983011 27870 raft_consensus.cc:515] T 18f991bbbf3a4615aab49899c7ef86dc P 2513a663afac495eb09126ff55e8b2b0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2513a663afac495eb09126ff55e8b2b0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40721 } } peers { permanent_uuid: "18435fbb525741328139e84a1e354954" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 40545 } } peers { permanent_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 38749 } }
I20260709 13:08:19.985785 27870 leader_election.cc:290] T 18f991bbbf3a4615aab49899c7ef86dc P 2513a663afac495eb09126ff55e8b2b0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 18435fbb525741328139e84a1e354954 (127.17.223.4:40545), 665f7e09521a4c3f9284c1d8b0e094ff (127.17.223.3:38749)
I20260709 13:08:19.990844 27870 raft_consensus.cc:493] T d0c8b4ec2d844a89b4bb66c0f1bf2c8f P 2513a663afac495eb09126ff55e8b2b0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:19.991967 27815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18f991bbbf3a4615aab49899c7ef86dc" candidate_uuid: "2513a663afac495eb09126ff55e8b2b0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "18435fbb525741328139e84a1e354954" is_pre_election: true
I20260709 13:08:19.934696 27862 tablet_bootstrap.cc:492] T 18f991bbbf3a4615aab49899c7ef86dc P 665f7e09521a4c3f9284c1d8b0e094ff: No bootstrap required, opened a new log
I20260709 13:08:19.992668 27815 raft_consensus.cc:2468] T 18f991bbbf3a4615aab49899c7ef86dc P 18435fbb525741328139e84a1e354954 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2513a663afac495eb09126ff55e8b2b0 in term 0.
I20260709 13:08:19.992863 27742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18f991bbbf3a4615aab49899c7ef86dc" candidate_uuid: "2513a663afac495eb09126ff55e8b2b0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" is_pre_election: true
I20260709 13:08:19.992802 27862 ts_tablet_manager.cc:1403] T 18f991bbbf3a4615aab49899c7ef86dc P 665f7e09521a4c3f9284c1d8b0e094ff: Time spent bootstrapping tablet: real 0.095s	user 0.009s	sys 0.010s
W20260709 13:08:19.994951 27559 leader_election.cc:343] T 18f991bbbf3a4615aab49899c7ef86dc P 2513a663afac495eb09126ff55e8b2b0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 665f7e09521a4c3f9284c1d8b0e094ff (127.17.223.3:38749): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:19.995659 27559 leader_election.cc:304] T 18f991bbbf3a4615aab49899c7ef86dc P 2513a663afac495eb09126ff55e8b2b0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 18435fbb525741328139e84a1e354954, 2513a663afac495eb09126ff55e8b2b0; no voters: 665f7e09521a4c3f9284c1d8b0e094ff
I20260709 13:08:19.996387 27898 raft_consensus.cc:2804] T 18f991bbbf3a4615aab49899c7ef86dc P 2513a663afac495eb09126ff55e8b2b0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:08:19.991483 27870 raft_consensus.cc:515] T d0c8b4ec2d844a89b4bb66c0f1bf2c8f P 2513a663afac495eb09126ff55e8b2b0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18435fbb525741328139e84a1e354954" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 40545 } } peers { permanent_uuid: "2513a663afac495eb09126ff55e8b2b0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40721 } } peers { permanent_uuid: "41268b218b804905a110c86738e74400" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 44403 } }
I20260709 13:08:19.996785 27898 raft_consensus.cc:493] T 18f991bbbf3a4615aab49899c7ef86dc P 2513a663afac495eb09126ff55e8b2b0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:20.000082 27898 raft_consensus.cc:3060] T 18f991bbbf3a4615aab49899c7ef86dc P 2513a663afac495eb09126ff55e8b2b0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:20.000203 27667 raft_consensus.cc:2468] T 456941807b254f5fb32dca4f84bd16ea P 41268b218b804905a110c86738e74400 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2513a663afac495eb09126ff55e8b2b0 in term 1.
I20260709 13:08:20.001855 27559 leader_election.cc:304] T 456941807b254f5fb32dca4f84bd16ea P 2513a663afac495eb09126ff55e8b2b0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2513a663afac495eb09126ff55e8b2b0, 41268b218b804905a110c86738e74400; no voters: 
I20260709 13:08:20.002787 27919 raft_consensus.cc:2804] T 456941807b254f5fb32dca4f84bd16ea P 2513a663afac495eb09126ff55e8b2b0 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:08:20.004215 27863 tablet_bootstrap.cc:492] T bc0b10615ecb4485a9a9de298938697d P 41268b218b804905a110c86738e74400: No bootstrap required, opened a new log
I20260709 13:08:20.004729 27863 ts_tablet_manager.cc:1403] T bc0b10615ecb4485a9a9de298938697d P 41268b218b804905a110c86738e74400: Time spent bootstrapping tablet: real 0.053s	user 0.017s	sys 0.007s
I20260709 13:08:19.997177 27862 raft_consensus.cc:359] T 18f991bbbf3a4615aab49899c7ef86dc P 665f7e09521a4c3f9284c1d8b0e094ff [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2513a663afac495eb09126ff55e8b2b0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40721 } } peers { permanent_uuid: "18435fbb525741328139e84a1e354954" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 40545 } } peers { permanent_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 38749 } }
I20260709 13:08:20.005337 27862 raft_consensus.cc:385] T 18f991bbbf3a4615aab49899c7ef86dc P 665f7e09521a4c3f9284c1d8b0e094ff [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:20.005726 27862 raft_consensus.cc:740] T 18f991bbbf3a4615aab49899c7ef86dc P 665f7e09521a4c3f9284c1d8b0e094ff [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 665f7e09521a4c3f9284c1d8b0e094ff, State: Initialized, Role: FOLLOWER
I20260709 13:08:20.007305 27862 consensus_queue.cc:260] T 18f991bbbf3a4615aab49899c7ef86dc P 665f7e09521a4c3f9284c1d8b0e094ff [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2513a663afac495eb09126ff55e8b2b0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40721 } } peers { permanent_uuid: "18435fbb525741328139e84a1e354954" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 40545 } } peers { permanent_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 38749 } }
I20260709 13:08:20.010108 27862 ts_tablet_manager.cc:1434] T 18f991bbbf3a4615aab49899c7ef86dc P 665f7e09521a4c3f9284c1d8b0e094ff: Time spent starting tablet: real 0.016s	user 0.005s	sys 0.002s
I20260709 13:08:20.011750 27870 leader_election.cc:290] T d0c8b4ec2d844a89b4bb66c0f1bf2c8f P 2513a663afac495eb09126ff55e8b2b0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 18435fbb525741328139e84a1e354954 (127.17.223.4:40545), 41268b218b804905a110c86738e74400 (127.17.223.2:44403)
I20260709 13:08:20.013597 27862 tablet_bootstrap.cc:492] T 866a01285ca8436385f8d16dcfb0d4e3 P 665f7e09521a4c3f9284c1d8b0e094ff: Bootstrap starting.
I20260709 13:08:20.018875 27919 raft_consensus.cc:697] T 456941807b254f5fb32dca4f84bd16ea P 2513a663afac495eb09126ff55e8b2b0 [term 1 LEADER]: Becoming Leader. State: Replica: 2513a663afac495eb09126ff55e8b2b0, State: Running, Role: LEADER
I20260709 13:08:20.019801 27919 consensus_queue.cc:237] T 456941807b254f5fb32dca4f84bd16ea P 2513a663afac495eb09126ff55e8b2b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2513a663afac495eb09126ff55e8b2b0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40721 } } peers { permanent_uuid: "41268b218b804905a110c86738e74400" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 44403 } } peers { permanent_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 38749 } }
I20260709 13:08:20.021054 27865 tablet_bootstrap.cc:492] T de531c50b1524ec788b27bc4b883689a P 18435fbb525741328139e84a1e354954: No bootstrap required, opened a new log
I20260709 13:08:20.021703 27865 ts_tablet_manager.cc:1403] T de531c50b1524ec788b27bc4b883689a P 18435fbb525741328139e84a1e354954: Time spent bootstrapping tablet: real 0.073s	user 0.012s	sys 0.012s
I20260709 13:08:20.014757 27741 raft_consensus.cc:2468] T 456941807b254f5fb32dca4f84bd16ea P 665f7e09521a4c3f9284c1d8b0e094ff [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2513a663afac495eb09126ff55e8b2b0 in term 1.
I20260709 13:08:20.027467 27863 raft_consensus.cc:359] T bc0b10615ecb4485a9a9de298938697d P 41268b218b804905a110c86738e74400 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18435fbb525741328139e84a1e354954" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 40545 } } peers { permanent_uuid: "2513a663afac495eb09126ff55e8b2b0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40721 } } peers { permanent_uuid: "41268b218b804905a110c86738e74400" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 44403 } }
I20260709 13:08:20.028277 27863 raft_consensus.cc:385] T bc0b10615ecb4485a9a9de298938697d P 41268b218b804905a110c86738e74400 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:20.027951 27898 raft_consensus.cc:515] T 18f991bbbf3a4615aab49899c7ef86dc P 2513a663afac495eb09126ff55e8b2b0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2513a663afac495eb09126ff55e8b2b0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40721 } } peers { permanent_uuid: "18435fbb525741328139e84a1e354954" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 40545 } } peers { permanent_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 38749 } }
I20260709 13:08:20.028573 27863 raft_consensus.cc:740] T bc0b10615ecb4485a9a9de298938697d P 41268b218b804905a110c86738e74400 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 41268b218b804905a110c86738e74400, State: Initialized, Role: FOLLOWER
I20260709 13:08:20.029075 27865 raft_consensus.cc:359] T de531c50b1524ec788b27bc4b883689a P 18435fbb525741328139e84a1e354954 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "41268b218b804905a110c86738e74400" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 44403 } } peers { permanent_uuid: "18435fbb525741328139e84a1e354954" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 40545 } } peers { permanent_uuid: "2513a663afac495eb09126ff55e8b2b0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40721 } }
I20260709 13:08:20.029670 27861 tablet_bootstrap.cc:492] T bc0b10615ecb4485a9a9de298938697d P 2513a663afac495eb09126ff55e8b2b0: No bootstrap required, opened a new log
I20260709 13:08:20.029946 27865 raft_consensus.cc:385] T de531c50b1524ec788b27bc4b883689a P 18435fbb525741328139e84a1e354954 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:20.030257 27865 raft_consensus.cc:740] T de531c50b1524ec788b27bc4b883689a P 18435fbb525741328139e84a1e354954 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 18435fbb525741328139e84a1e354954, State: Initialized, Role: FOLLOWER
I20260709 13:08:20.030138 27863 consensus_queue.cc:260] T bc0b10615ecb4485a9a9de298938697d P 41268b218b804905a110c86738e74400 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18435fbb525741328139e84a1e354954" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 40545 } } peers { permanent_uuid: "2513a663afac495eb09126ff55e8b2b0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40721 } } peers { permanent_uuid: "41268b218b804905a110c86738e74400" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 44403 } }
I20260709 13:08:20.030845 27898 leader_election.cc:290] T 18f991bbbf3a4615aab49899c7ef86dc P 2513a663afac495eb09126ff55e8b2b0 [CANDIDATE]: Term 1 election: Requested vote from peers 18435fbb525741328139e84a1e354954 (127.17.223.4:40545), 665f7e09521a4c3f9284c1d8b0e094ff (127.17.223.3:38749)
I20260709 13:08:20.031550 27865 consensus_queue.cc:260] T de531c50b1524ec788b27bc4b883689a P 18435fbb525741328139e84a1e354954 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "41268b218b804905a110c86738e74400" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 44403 } } peers { permanent_uuid: "18435fbb525741328139e84a1e354954" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 40545 } } peers { permanent_uuid: "2513a663afac495eb09126ff55e8b2b0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40721 } }
I20260709 13:08:20.033567 27865 ts_tablet_manager.cc:1434] T de531c50b1524ec788b27bc4b883689a P 18435fbb525741328139e84a1e354954: Time spent starting tablet: real 0.012s	user 0.006s	sys 0.000s
I20260709 13:08:20.034456 27862 tablet_bootstrap.cc:654] T 866a01285ca8436385f8d16dcfb0d4e3 P 665f7e09521a4c3f9284c1d8b0e094ff: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:20.035604 27863 ts_tablet_manager.cc:1434] T bc0b10615ecb4485a9a9de298938697d P 41268b218b804905a110c86738e74400: Time spent starting tablet: real 0.031s	user 0.008s	sys 0.000s
I20260709 13:08:20.030251 27861 ts_tablet_manager.cc:1403] T bc0b10615ecb4485a9a9de298938697d P 2513a663afac495eb09126ff55e8b2b0: Time spent bootstrapping tablet: real 0.088s	user 0.021s	sys 0.020s
I20260709 13:08:20.036698 27863 tablet_bootstrap.cc:492] T df06af11cae7484d969017fcb5b7e753 P 41268b218b804905a110c86738e74400: Bootstrap starting.
I20260709 13:08:20.034461 27865 tablet_bootstrap.cc:492] T 55a3afc21cea43ea85f4a2155552422d P 18435fbb525741328139e84a1e354954: Bootstrap starting.
I20260709 13:08:20.043686 27863 tablet_bootstrap.cc:654] T df06af11cae7484d969017fcb5b7e753 P 41268b218b804905a110c86738e74400: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:20.045276 27862 tablet_bootstrap.cc:492] T 866a01285ca8436385f8d16dcfb0d4e3 P 665f7e09521a4c3f9284c1d8b0e094ff: No bootstrap required, opened a new log
I20260709 13:08:20.045764 27862 ts_tablet_manager.cc:1403] T 866a01285ca8436385f8d16dcfb0d4e3 P 665f7e09521a4c3f9284c1d8b0e094ff: Time spent bootstrapping tablet: real 0.032s	user 0.007s	sys 0.009s
I20260709 13:08:20.079865 27865 tablet_bootstrap.cc:654] T 55a3afc21cea43ea85f4a2155552422d P 18435fbb525741328139e84a1e354954: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:20.040319 27861 raft_consensus.cc:359] T bc0b10615ecb4485a9a9de298938697d P 2513a663afac495eb09126ff55e8b2b0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18435fbb525741328139e84a1e354954" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 40545 } } peers { permanent_uuid: "2513a663afac495eb09126ff55e8b2b0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40721 } } peers { permanent_uuid: "41268b218b804905a110c86738e74400" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 44403 } }
I20260709 13:08:20.081911 27861 raft_consensus.cc:385] T bc0b10615ecb4485a9a9de298938697d P 2513a663afac495eb09126ff55e8b2b0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:20.082646 27861 raft_consensus.cc:740] T bc0b10615ecb4485a9a9de298938697d P 2513a663afac495eb09126ff55e8b2b0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2513a663afac495eb09126ff55e8b2b0, State: Initialized, Role: FOLLOWER
I20260709 13:08:20.086500 27903 raft_consensus.cc:493] T 18f991bbbf3a4615aab49899c7ef86dc P 665f7e09521a4c3f9284c1d8b0e094ff [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:20.087504 27903 raft_consensus.cc:515] T 18f991bbbf3a4615aab49899c7ef86dc P 665f7e09521a4c3f9284c1d8b0e094ff [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2513a663afac495eb09126ff55e8b2b0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40721 } } peers { permanent_uuid: "18435fbb525741328139e84a1e354954" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 40545 } } peers { permanent_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 38749 } }
I20260709 13:08:20.089690 27863 tablet_bootstrap.cc:492] T df06af11cae7484d969017fcb5b7e753 P 41268b218b804905a110c86738e74400: No bootstrap required, opened a new log
I20260709 13:08:20.090950 27815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0c8b4ec2d844a89b4bb66c0f1bf2c8f" candidate_uuid: "2513a663afac495eb09126ff55e8b2b0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "18435fbb525741328139e84a1e354954" is_pre_election: true
I20260709 13:08:20.092851 27901 raft_consensus.cc:493] T 9ac520b68b79484990a8725d6549174e P 41268b218b804905a110c86738e74400 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:20.092926 27592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18f991bbbf3a4615aab49899c7ef86dc" candidate_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2513a663afac495eb09126ff55e8b2b0" is_pre_election: true
I20260709 13:08:20.094342 27592 raft_consensus.cc:2393] T 18f991bbbf3a4615aab49899c7ef86dc P 2513a663afac495eb09126ff55e8b2b0 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 665f7e09521a4c3f9284c1d8b0e094ff in current term 1: Already voted for candidate 2513a663afac495eb09126ff55e8b2b0 in this term.
I20260709 13:08:20.096267 27816 raft_consensus.cc:3060] T 64490a86db8c4f5ca54f4f8085f41319 P 18435fbb525741328139e84a1e354954 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:20.092892 27815 raft_consensus.cc:2393] T d0c8b4ec2d844a89b4bb66c0f1bf2c8f P 18435fbb525741328139e84a1e354954 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2513a663afac495eb09126ff55e8b2b0 in current term 1: Already voted for candidate 41268b218b804905a110c86738e74400 in this term.
I20260709 13:08:20.096899 27903 leader_election.cc:290] T 18f991bbbf3a4615aab49899c7ef86dc P 665f7e09521a4c3f9284c1d8b0e094ff [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2513a663afac495eb09126ff55e8b2b0 (127.17.223.1:40721), 18435fbb525741328139e84a1e354954 (127.17.223.4:40545)
I20260709 13:08:20.099890 27862 raft_consensus.cc:359] T 866a01285ca8436385f8d16dcfb0d4e3 P 665f7e09521a4c3f9284c1d8b0e094ff [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2513a663afac495eb09126ff55e8b2b0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40721 } } peers { permanent_uuid: "41268b218b804905a110c86738e74400" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 44403 } } peers { permanent_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 38749 } }
I20260709 13:08:20.100744 27862 raft_consensus.cc:385] T 866a01285ca8436385f8d16dcfb0d4e3 P 665f7e09521a4c3f9284c1d8b0e094ff [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:20.101045 27862 raft_consensus.cc:740] T 866a01285ca8436385f8d16dcfb0d4e3 P 665f7e09521a4c3f9284c1d8b0e094ff [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 665f7e09521a4c3f9284c1d8b0e094ff, State: Initialized, Role: FOLLOWER
I20260709 13:08:20.101964 27862 consensus_queue.cc:260] T 866a01285ca8436385f8d16dcfb0d4e3 P 665f7e09521a4c3f9284c1d8b0e094ff [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2513a663afac495eb09126ff55e8b2b0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40721 } } peers { permanent_uuid: "41268b218b804905a110c86738e74400" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 44403 } } peers { permanent_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 38749 } }
I20260709 13:08:20.103402 27863 ts_tablet_manager.cc:1403] T df06af11cae7484d969017fcb5b7e753 P 41268b218b804905a110c86738e74400: Time spent bootstrapping tablet: real 0.067s	user 0.011s	sys 0.003s
I20260709 13:08:20.107224 27874 raft_consensus.cc:493] T 56803a5c0dea4efeabafb6829d9215cd P 18435fbb525741328139e84a1e354954 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:20.108165 27874 raft_consensus.cc:515] T 56803a5c0dea4efeabafb6829d9215cd P 18435fbb525741328139e84a1e354954 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "41268b218b804905a110c86738e74400" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 44403 } } peers { permanent_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 38749 } } peers { permanent_uuid: "18435fbb525741328139e84a1e354954" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 40545 } }
I20260709 13:08:20.093958 27901 raft_consensus.cc:515] T 9ac520b68b79484990a8725d6549174e P 41268b218b804905a110c86738e74400 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "41268b218b804905a110c86738e74400" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 44403 } } peers { permanent_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 38749 } } peers { permanent_uuid: "18435fbb525741328139e84a1e354954" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 40545 } }
I20260709 13:08:20.108604 27667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0c8b4ec2d844a89b4bb66c0f1bf2c8f" candidate_uuid: "2513a663afac495eb09126ff55e8b2b0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "41268b218b804905a110c86738e74400" is_pre_election: true
I20260709 13:08:20.109542 27863 raft_consensus.cc:359] T df06af11cae7484d969017fcb5b7e753 P 41268b218b804905a110c86738e74400 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "41268b218b804905a110c86738e74400" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 44403 } } peers { permanent_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 38749 } } peers { permanent_uuid: "18435fbb525741328139e84a1e354954" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 40545 } }
I20260709 13:08:20.113358 27935 raft_consensus.cc:493] T 7b77a53b493f4e979fdf38a0b17176b0 P 41268b218b804905a110c86738e74400 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:20.113504 27741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ac520b68b79484990a8725d6549174e" candidate_uuid: "41268b218b804905a110c86738e74400" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" is_pre_election: true
I20260709 13:08:20.114270 27935 raft_consensus.cc:515] T 7b77a53b493f4e979fdf38a0b17176b0 P 41268b218b804905a110c86738e74400 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2513a663afac495eb09126ff55e8b2b0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40721 } } peers { permanent_uuid: "41268b218b804905a110c86738e74400" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 44403 } } peers { permanent_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 38749 } }
I20260709 13:08:20.115403 27815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18f991bbbf3a4615aab49899c7ef86dc" candidate_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "18435fbb525741328139e84a1e354954" is_pre_election: true
I20260709 13:08:20.115425 27814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18f991bbbf3a4615aab49899c7ef86dc" candidate_uuid: "2513a663afac495eb09126ff55e8b2b0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "18435fbb525741328139e84a1e354954"
I20260709 13:08:20.123310 27815 raft_consensus.cc:2468] T 18f991bbbf3a4615aab49899c7ef86dc P 18435fbb525741328139e84a1e354954 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 665f7e09521a4c3f9284c1d8b0e094ff in term 0.
I20260709 13:08:20.120391 27742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56803a5c0dea4efeabafb6829d9215cd" candidate_uuid: "18435fbb525741328139e84a1e354954" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" is_pre_election: true
I20260709 13:08:20.124570 27742 raft_consensus.cc:2468] T 56803a5c0dea4efeabafb6829d9215cd P 665f7e09521a4c3f9284c1d8b0e094ff [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 18435fbb525741328139e84a1e354954 in term 0.
I20260709 13:08:20.124863 27872 raft_consensus.cc:493] T de531c50b1524ec788b27bc4b883689a P 41268b218b804905a110c86738e74400 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:20.124693 27898 consensus_queue.cc:1048] T 64490a86db8c4f5ca54f4f8085f41319 P 2513a663afac495eb09126ff55e8b2b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 38749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:08:20.129455 27742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18f991bbbf3a4615aab49899c7ef86dc" candidate_uuid: "2513a663afac495eb09126ff55e8b2b0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "665f7e09521a4c3f9284c1d8b0e094ff"
I20260709 13:08:20.130404 27742 raft_consensus.cc:3060] T 18f991bbbf3a4615aab49899c7ef86dc P 665f7e09521a4c3f9284c1d8b0e094ff [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:20.132813 27668 raft_consensus.cc:3060] T 9ac520b68b79484990a8725d6549174e P 41268b218b804905a110c86738e74400 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:20.134382 27667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56803a5c0dea4efeabafb6829d9215cd" candidate_uuid: "18435fbb525741328139e84a1e354954" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "41268b218b804905a110c86738e74400" is_pre_election: true
I20260709 13:08:20.136679 27901 leader_election.cc:290] T 9ac520b68b79484990a8725d6549174e P 41268b218b804905a110c86738e74400 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 665f7e09521a4c3f9284c1d8b0e094ff (127.17.223.3:38749), 18435fbb525741328139e84a1e354954 (127.17.223.4:40545)
I20260709 13:08:20.121009 27861 consensus_queue.cc:260] T bc0b10615ecb4485a9a9de298938697d P 2513a663afac495eb09126ff55e8b2b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18435fbb525741328139e84a1e354954" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 40545 } } peers { permanent_uuid: "2513a663afac495eb09126ff55e8b2b0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40721 } } peers { permanent_uuid: "41268b218b804905a110c86738e74400" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 44403 } }
I20260709 13:08:20.139540 27782 leader_election.cc:304] T 56803a5c0dea4efeabafb6829d9215cd P 18435fbb525741328139e84a1e354954 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 18435fbb525741328139e84a1e354954, 665f7e09521a4c3f9284c1d8b0e094ff; no voters: 
I20260709 13:08:20.134856 27872 raft_consensus.cc:515] T de531c50b1524ec788b27bc4b883689a P 41268b218b804905a110c86738e74400 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "41268b218b804905a110c86738e74400" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 44403 } } peers { permanent_uuid: "18435fbb525741328139e84a1e354954" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 40545 } } peers { permanent_uuid: "2513a663afac495eb09126ff55e8b2b0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40721 } }
I20260709 13:08:20.143158 27708 leader_election.cc:304] T 18f991bbbf3a4615aab49899c7ef86dc P 665f7e09521a4c3f9284c1d8b0e094ff [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 18435fbb525741328139e84a1e354954, 665f7e09521a4c3f9284c1d8b0e094ff; no voters: 2513a663afac495eb09126ff55e8b2b0
I20260709 13:08:20.111585 27874 leader_election.cc:290] T 56803a5c0dea4efeabafb6829d9215cd P 18435fbb525741328139e84a1e354954 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 41268b218b804905a110c86738e74400 (127.17.223.2:44403), 665f7e09521a4c3f9284c1d8b0e094ff (127.17.223.3:38749)
I20260709 13:08:20.110529 27863 raft_consensus.cc:385] T df06af11cae7484d969017fcb5b7e753 P 41268b218b804905a110c86738e74400 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:20.133942 27559 leader_election.cc:304] T d0c8b4ec2d844a89b4bb66c0f1bf2c8f P 2513a663afac495eb09126ff55e8b2b0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2513a663afac495eb09126ff55e8b2b0; no voters: 18435fbb525741328139e84a1e354954, 41268b218b804905a110c86738e74400
I20260709 13:08:20.146721 27592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b77a53b493f4e979fdf38a0b17176b0" candidate_uuid: "41268b218b804905a110c86738e74400" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2513a663afac495eb09126ff55e8b2b0" is_pre_election: true
I20260709 13:08:20.168157 27867 consensus_queue.cc:1048] T 9ac520b68b79484990a8725d6549174e P 665f7e09521a4c3f9284c1d8b0e094ff [LEADER]: Connected to new peer: Peer: permanent_uuid: "41268b218b804905a110c86738e74400" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 44403 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.004s
I20260709 13:08:20.167768 27903 raft_consensus.cc:493] T 866a01285ca8436385f8d16dcfb0d4e3 P 665f7e09521a4c3f9284c1d8b0e094ff [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:08:20.173799 27631 leader_election.cc:343] T 7b77a53b493f4e979fdf38a0b17176b0 P 41268b218b804905a110c86738e74400 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2513a663afac495eb09126ff55e8b2b0 (127.17.223.1:40721): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:08:20.174372 27559 consensus_peers.cc:597] T a9eac7f072de454a8ff2beb019da45d9 P 2513a663afac495eb09126ff55e8b2b0 -> Peer 18435fbb525741328139e84a1e354954 (127.17.223.4:40545): Couldn't send request to peer 18435fbb525741328139e84a1e354954. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:08:20.174031 27903 raft_consensus.cc:515] T 866a01285ca8436385f8d16dcfb0d4e3 P 665f7e09521a4c3f9284c1d8b0e094ff [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2513a663afac495eb09126ff55e8b2b0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40721 } } peers { permanent_uuid: "41268b218b804905a110c86738e74400" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 44403 } } peers { permanent_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 38749 } }
I20260709 13:08:20.149058 27593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de531c50b1524ec788b27bc4b883689a" candidate_uuid: "41268b218b804905a110c86738e74400" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2513a663afac495eb09126ff55e8b2b0" is_pre_election: true
I20260709 13:08:20.149168 27872 leader_election.cc:290] T de531c50b1524ec788b27bc4b883689a P 41268b218b804905a110c86738e74400 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 18435fbb525741328139e84a1e354954 (127.17.223.4:40545), 2513a663afac495eb09126ff55e8b2b0 (127.17.223.1:40721)
I20260709 13:08:20.175428 27593 raft_consensus.cc:2468] T de531c50b1524ec788b27bc4b883689a P 2513a663afac495eb09126ff55e8b2b0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 41268b218b804905a110c86738e74400 in term 0.
I20260709 13:08:20.158957 27862 ts_tablet_manager.cc:1434] T 866a01285ca8436385f8d16dcfb0d4e3 P 665f7e09521a4c3f9284c1d8b0e094ff: Time spent starting tablet: real 0.113s	user 0.010s	sys 0.003s
I20260709 13:08:20.168926 27740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b77a53b493f4e979fdf38a0b17176b0" candidate_uuid: "41268b218b804905a110c86738e74400" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" is_pre_election: true
I20260709 13:08:20.178550 27898 raft_consensus.cc:3060] T d0c8b4ec2d844a89b4bb66c0f1bf2c8f P 2513a663afac495eb09126ff55e8b2b0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:20.179118 27862 tablet_bootstrap.cc:492] T 55a3afc21cea43ea85f4a2155552422d P 665f7e09521a4c3f9284c1d8b0e094ff: Bootstrap starting.
I20260709 13:08:20.144894 27814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ac520b68b79484990a8725d6549174e" candidate_uuid: "41268b218b804905a110c86738e74400" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "18435fbb525741328139e84a1e354954" is_pre_election: true
I20260709 13:08:20.155424 27815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de531c50b1524ec788b27bc4b883689a" candidate_uuid: "41268b218b804905a110c86738e74400" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "18435fbb525741328139e84a1e354954" is_pre_election: true
I20260709 13:08:20.163578 27863 raft_consensus.cc:740] T df06af11cae7484d969017fcb5b7e753 P 41268b218b804905a110c86738e74400 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 41268b218b804905a110c86738e74400, State: Initialized, Role: FOLLOWER
I20260709 13:08:20.145501 27667 raft_consensus.cc:2468] T 56803a5c0dea4efeabafb6829d9215cd P 41268b218b804905a110c86738e74400 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 18435fbb525741328139e84a1e354954 in term 0.
I20260709 13:08:20.183094 27593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "866a01285ca8436385f8d16dcfb0d4e3" candidate_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2513a663afac495eb09126ff55e8b2b0" is_pre_election: true
I20260709 13:08:20.176852 27903 leader_election.cc:290] T 866a01285ca8436385f8d16dcfb0d4e3 P 665f7e09521a4c3f9284c1d8b0e094ff [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2513a663afac495eb09126ff55e8b2b0 (127.17.223.1:40721), 41268b218b804905a110c86738e74400 (127.17.223.2:44403)
I20260709 13:08:20.165390 27935 leader_election.cc:290] T 7b77a53b493f4e979fdf38a0b17176b0 P 41268b218b804905a110c86738e74400 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2513a663afac495eb09126ff55e8b2b0 (127.17.223.1:40721), 665f7e09521a4c3f9284c1d8b0e094ff (127.17.223.3:38749)
I20260709 13:08:20.173357 27742 raft_consensus.cc:2468] T 18f991bbbf3a4615aab49899c7ef86dc P 665f7e09521a4c3f9284c1d8b0e094ff [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2513a663afac495eb09126ff55e8b2b0 in term 1.
I20260709 13:08:20.187925 27665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "866a01285ca8436385f8d16dcfb0d4e3" candidate_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "41268b218b804905a110c86738e74400" is_pre_election: true
I20260709 13:08:20.195609 27957 consensus_queue.cc:1048] T a9eac7f072de454a8ff2beb019da45d9 P 2513a663afac495eb09126ff55e8b2b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "41268b218b804905a110c86738e74400" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 44403 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.008s
I20260709 13:08:20.144330 27861 ts_tablet_manager.cc:1434] T bc0b10615ecb4485a9a9de298938697d P 2513a663afac495eb09126ff55e8b2b0: Time spent starting tablet: real 0.107s	user 0.005s	sys 0.010s
I20260709 13:08:20.177031 27631 leader_election.cc:304] T de531c50b1524ec788b27bc4b883689a P 41268b218b804905a110c86738e74400 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2513a663afac495eb09126ff55e8b2b0, 41268b218b804905a110c86738e74400; no voters: 
I20260709 13:08:20.201359 27897 raft_consensus.cc:2764] T 18f991bbbf3a4615aab49899c7ef86dc P 665f7e09521a4c3f9284c1d8b0e094ff [term 1 FOLLOWER]: Leader pre-election decision vote started in defunct term 0: won
W20260709 13:08:20.201833 27708 leader_election.cc:343] T 866a01285ca8436385f8d16dcfb0d4e3 P 665f7e09521a4c3f9284c1d8b0e094ff [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 41268b218b804905a110c86738e74400 (127.17.223.2:44403): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:20.206465 27559 leader_election.cc:304] T 18f991bbbf3a4615aab49899c7ef86dc P 2513a663afac495eb09126ff55e8b2b0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2513a663afac495eb09126ff55e8b2b0, 665f7e09521a4c3f9284c1d8b0e094ff; no voters: 18435fbb525741328139e84a1e354954
I20260709 13:08:20.206239 27897 consensus_queue.cc:1048] T 9ac520b68b79484990a8725d6549174e P 665f7e09521a4c3f9284c1d8b0e094ff [LEADER]: Connected to new peer: Peer: permanent_uuid: "18435fbb525741328139e84a1e354954" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 40545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:08:20.208235 27957 raft_consensus.cc:2804] T 18f991bbbf3a4615aab49899c7ef86dc P 2513a663afac495eb09126ff55e8b2b0 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:08:20.208846 27957 raft_consensus.cc:697] T 18f991bbbf3a4615aab49899c7ef86dc P 2513a663afac495eb09126ff55e8b2b0 [term 1 LEADER]: Becoming Leader. State: Replica: 2513a663afac495eb09126ff55e8b2b0, State: Running, Role: LEADER
I20260709 13:08:20.210855 27815 raft_consensus.cc:2468] T de531c50b1524ec788b27bc4b883689a P 18435fbb525741328139e84a1e354954 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 41268b218b804905a110c86738e74400 in term 0.
I20260709 13:08:20.211063 27872 raft_consensus.cc:2804] T de531c50b1524ec788b27bc4b883689a P 41268b218b804905a110c86738e74400 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:08:20.211443 27872 raft_consensus.cc:493] T de531c50b1524ec788b27bc4b883689a P 41268b218b804905a110c86738e74400 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:20.211824 27872 raft_consensus.cc:3060] T de531c50b1524ec788b27bc4b883689a P 41268b218b804905a110c86738e74400 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:20.224383 27865 tablet_bootstrap.cc:492] T 55a3afc21cea43ea85f4a2155552422d P 18435fbb525741328139e84a1e354954: No bootstrap required, opened a new log
I20260709 13:08:20.225306 27865 ts_tablet_manager.cc:1403] T 55a3afc21cea43ea85f4a2155552422d P 18435fbb525741328139e84a1e354954: Time spent bootstrapping tablet: real 0.191s	user 0.013s	sys 0.000s
I20260709 13:08:20.221504 27964 raft_consensus.cc:2804] T 56803a5c0dea4efeabafb6829d9215cd P 18435fbb525741328139e84a1e354954 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:08:20.229491 27865 raft_consensus.cc:359] T 55a3afc21cea43ea85f4a2155552422d P 18435fbb525741328139e84a1e354954 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 38749 } } peers { permanent_uuid: "18435fbb525741328139e84a1e354954" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 40545 } } peers { permanent_uuid: "2513a663afac495eb09126ff55e8b2b0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40721 } }
I20260709 13:08:20.229517 27964 raft_consensus.cc:493] T 56803a5c0dea4efeabafb6829d9215cd P 18435fbb525741328139e84a1e354954 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:20.230525 27964 raft_consensus.cc:3060] T 56803a5c0dea4efeabafb6829d9215cd P 18435fbb525741328139e84a1e354954 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:20.210171 27957 consensus_queue.cc:237] T 18f991bbbf3a4615aab49899c7ef86dc P 2513a663afac495eb09126ff55e8b2b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2513a663afac495eb09126ff55e8b2b0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40721 } } peers { permanent_uuid: "18435fbb525741328139e84a1e354954" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 40545 } } peers { permanent_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 38749 } }
I20260709 13:08:20.230317 27865 raft_consensus.cc:385] T 55a3afc21cea43ea85f4a2155552422d P 18435fbb525741328139e84a1e354954 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:20.235972 27865 raft_consensus.cc:740] T 55a3afc21cea43ea85f4a2155552422d P 18435fbb525741328139e84a1e354954 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 18435fbb525741328139e84a1e354954, State: Initialized, Role: FOLLOWER
I20260709 13:08:20.234454 27863 consensus_queue.cc:260] T df06af11cae7484d969017fcb5b7e753 P 41268b218b804905a110c86738e74400 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "41268b218b804905a110c86738e74400" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 44403 } } peers { permanent_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 38749 } } peers { permanent_uuid: "18435fbb525741328139e84a1e354954" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 40545 } }
W20260709 13:08:20.239638 27705 leader_election.cc:343] T 866a01285ca8436385f8d16dcfb0d4e3 P 665f7e09521a4c3f9284c1d8b0e094ff [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2513a663afac495eb09126ff55e8b2b0 (127.17.223.1:40721): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:20.240301 27705 leader_election.cc:304] T 866a01285ca8436385f8d16dcfb0d4e3 P 665f7e09521a4c3f9284c1d8b0e094ff [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 665f7e09521a4c3f9284c1d8b0e094ff; no voters: 2513a663afac495eb09126ff55e8b2b0, 41268b218b804905a110c86738e74400
I20260709 13:08:20.241828 27897 raft_consensus.cc:2749] T 866a01285ca8436385f8d16dcfb0d4e3 P 665f7e09521a4c3f9284c1d8b0e094ff [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:08:20.242287 27863 ts_tablet_manager.cc:1434] T df06af11cae7484d969017fcb5b7e753 P 41268b218b804905a110c86738e74400: Time spent starting tablet: real 0.138s	user 0.007s	sys 0.003s
W20260709 13:08:20.243335 27634 leader_election.cc:343] T 7b77a53b493f4e979fdf38a0b17176b0 P 41268b218b804905a110c86738e74400 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 665f7e09521a4c3f9284c1d8b0e094ff (127.17.223.3:38749): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:20.243768 27863 tablet_bootstrap.cc:492] T 866a01285ca8436385f8d16dcfb0d4e3 P 41268b218b804905a110c86738e74400: Bootstrap starting.
I20260709 13:08:20.256927 27874 raft_consensus.cc:493] T 64490a86db8c4f5ca54f4f8085f41319 P 18435fbb525741328139e84a1e354954 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:20.250077 27634 leader_election.cc:304] T 7b77a53b493f4e979fdf38a0b17176b0 P 41268b218b804905a110c86738e74400 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 41268b218b804905a110c86738e74400; no voters: 2513a663afac495eb09126ff55e8b2b0, 665f7e09521a4c3f9284c1d8b0e094ff
I20260709 13:08:20.257709 27874 raft_consensus.cc:515] T 64490a86db8c4f5ca54f4f8085f41319 P 18435fbb525741328139e84a1e354954 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 38749 } } peers { permanent_uuid: "18435fbb525741328139e84a1e354954" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 40545 } } peers { permanent_uuid: "2513a663afac495eb09126ff55e8b2b0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40721 } }
I20260709 13:08:20.258180 27870 consensus_queue.cc:1048] T 64490a86db8c4f5ca54f4f8085f41319 P 2513a663afac495eb09126ff55e8b2b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "18435fbb525741328139e84a1e354954" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 40545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:08:20.259881 27901 raft_consensus.cc:2749] T 7b77a53b493f4e979fdf38a0b17176b0 P 41268b218b804905a110c86738e74400 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:08:20.260910 27862 tablet_bootstrap.cc:654] T 55a3afc21cea43ea85f4a2155552422d P 665f7e09521a4c3f9284c1d8b0e094ff: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:20.265129 27865 consensus_queue.cc:260] T 55a3afc21cea43ea85f4a2155552422d P 18435fbb525741328139e84a1e354954 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 38749 } } peers { permanent_uuid: "18435fbb525741328139e84a1e354954" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 40545 } } peers { permanent_uuid: "2513a663afac495eb09126ff55e8b2b0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40721 } }
I20260709 13:08:20.271087 27634 leader_election.cc:304] T 9ac520b68b79484990a8725d6549174e P 41268b218b804905a110c86738e74400 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 41268b218b804905a110c86738e74400; no voters: 18435fbb525741328139e84a1e354954, 665f7e09521a4c3f9284c1d8b0e094ff
I20260709 13:08:20.272927 27935 raft_consensus.cc:2749] T 9ac520b68b79484990a8725d6549174e P 41268b218b804905a110c86738e74400 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:08:20.283186 27898 raft_consensus.cc:2749] T d0c8b4ec2d844a89b4bb66c0f1bf2c8f P 2513a663afac495eb09126ff55e8b2b0 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:08:20.294180 27863 tablet_bootstrap.cc:654] T 866a01285ca8436385f8d16dcfb0d4e3 P 41268b218b804905a110c86738e74400: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:20.310909 27872 raft_consensus.cc:515] T de531c50b1524ec788b27bc4b883689a P 41268b218b804905a110c86738e74400 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "41268b218b804905a110c86738e74400" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 44403 } } peers { permanent_uuid: "18435fbb525741328139e84a1e354954" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 40545 } } peers { permanent_uuid: "2513a663afac495eb09126ff55e8b2b0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40721 } }
I20260709 13:08:20.313985 27874 leader_election.cc:290] T 64490a86db8c4f5ca54f4f8085f41319 P 18435fbb525741328139e84a1e354954 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 665f7e09521a4c3f9284c1d8b0e094ff (127.17.223.3:38749), 2513a663afac495eb09126ff55e8b2b0 (127.17.223.1:40721)
I20260709 13:08:20.314792 27741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64490a86db8c4f5ca54f4f8085f41319" candidate_uuid: "18435fbb525741328139e84a1e354954" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" is_pre_election: true
I20260709 13:08:20.314596 27487 catalog_manager.cc:5697] T 456941807b254f5fb32dca4f84bd16ea P 2513a663afac495eb09126ff55e8b2b0 reported cstate change: term changed from 0 to 1, leader changed from <none> to 2513a663afac495eb09126ff55e8b2b0 (127.17.223.1). New cstate: current_term: 1 leader_uuid: "2513a663afac495eb09126ff55e8b2b0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2513a663afac495eb09126ff55e8b2b0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40721 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "41268b218b804905a110c86738e74400" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 44403 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 38749 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:20.313289 27861 tablet_bootstrap.cc:492] T 7b77a53b493f4e979fdf38a0b17176b0 P 2513a663afac495eb09126ff55e8b2b0: Bootstrap starting.
I20260709 13:08:20.323853 27593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64490a86db8c4f5ca54f4f8085f41319" candidate_uuid: "18435fbb525741328139e84a1e354954" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2513a663afac495eb09126ff55e8b2b0" is_pre_election: true
I20260709 13:08:20.325215 27815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de531c50b1524ec788b27bc4b883689a" candidate_uuid: "41268b218b804905a110c86738e74400" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "18435fbb525741328139e84a1e354954"
I20260709 13:08:20.325719 27593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de531c50b1524ec788b27bc4b883689a" candidate_uuid: "41268b218b804905a110c86738e74400" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2513a663afac495eb09126ff55e8b2b0"
I20260709 13:08:20.325855 27815 raft_consensus.cc:3060] T de531c50b1524ec788b27bc4b883689a P 18435fbb525741328139e84a1e354954 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:20.326293 27935 consensus_queue.cc:1048] T d0c8b4ec2d844a89b4bb66c0f1bf2c8f P 41268b218b804905a110c86738e74400 [LEADER]: Connected to new peer: Peer: permanent_uuid: "18435fbb525741328139e84a1e354954" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 40545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:08:20.326339 27593 raft_consensus.cc:3060] T de531c50b1524ec788b27bc4b883689a P 2513a663afac495eb09126ff55e8b2b0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:20.328477 27779 leader_election.cc:304] T 64490a86db8c4f5ca54f4f8085f41319 P 18435fbb525741328139e84a1e354954 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 18435fbb525741328139e84a1e354954; no voters: 2513a663afac495eb09126ff55e8b2b0, 665f7e09521a4c3f9284c1d8b0e094ff
I20260709 13:08:20.327804 27901 consensus_queue.cc:1048] T d0c8b4ec2d844a89b4bb66c0f1bf2c8f P 41268b218b804905a110c86738e74400 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2513a663afac495eb09126ff55e8b2b0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40721 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 13:08:20.333427 27872 leader_election.cc:290] T de531c50b1524ec788b27bc4b883689a P 41268b218b804905a110c86738e74400 [CANDIDATE]: Term 1 election: Requested vote from peers 18435fbb525741328139e84a1e354954 (127.17.223.4:40545), 2513a663afac495eb09126ff55e8b2b0 (127.17.223.1:40721)
I20260709 13:08:20.335906 27870 raft_consensus.cc:493] T bc0b10615ecb4485a9a9de298938697d P 2513a663afac495eb09126ff55e8b2b0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:20.336449 27870 raft_consensus.cc:515] T bc0b10615ecb4485a9a9de298938697d P 2513a663afac495eb09126ff55e8b2b0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18435fbb525741328139e84a1e354954" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 40545 } } peers { permanent_uuid: "2513a663afac495eb09126ff55e8b2b0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40721 } } peers { permanent_uuid: "41268b218b804905a110c86738e74400" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 44403 } }
I20260709 13:08:20.340552 27870 leader_election.cc:290] T bc0b10615ecb4485a9a9de298938697d P 2513a663afac495eb09126ff55e8b2b0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 18435fbb525741328139e84a1e354954 (127.17.223.4:40545), 41268b218b804905a110c86738e74400 (127.17.223.2:44403)
I20260709 13:08:20.343465 27665 raft_consensus.cc:3060] T 1a26f012cd6e4c4c8bf86b5fda903800 P 41268b218b804905a110c86738e74400 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:20.361882 27593 raft_consensus.cc:2468] T de531c50b1524ec788b27bc4b883689a P 2513a663afac495eb09126ff55e8b2b0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 41268b218b804905a110c86738e74400 in term 1.
I20260709 13:08:20.369905 27861 tablet_bootstrap.cc:654] T 7b77a53b493f4e979fdf38a0b17176b0 P 2513a663afac495eb09126ff55e8b2b0: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:20.371574 27631 leader_election.cc:304] T de531c50b1524ec788b27bc4b883689a P 41268b218b804905a110c86738e74400 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2513a663afac495eb09126ff55e8b2b0, 41268b218b804905a110c86738e74400; no voters: 
I20260709 13:08:20.372435 27935 raft_consensus.cc:2804] T de531c50b1524ec788b27bc4b883689a P 41268b218b804905a110c86738e74400 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:08:20.372915 27935 raft_consensus.cc:697] T de531c50b1524ec788b27bc4b883689a P 41268b218b804905a110c86738e74400 [term 1 LEADER]: Becoming Leader. State: Replica: 41268b218b804905a110c86738e74400, State: Running, Role: LEADER
I20260709 13:08:20.362260 27815 raft_consensus.cc:2468] T de531c50b1524ec788b27bc4b883689a P 18435fbb525741328139e84a1e354954 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 41268b218b804905a110c86738e74400 in term 1.
I20260709 13:08:20.364543 27863 tablet_bootstrap.cc:492] T 866a01285ca8436385f8d16dcfb0d4e3 P 41268b218b804905a110c86738e74400: No bootstrap required, opened a new log
I20260709 13:08:20.374482 27863 ts_tablet_manager.cc:1403] T 866a01285ca8436385f8d16dcfb0d4e3 P 41268b218b804905a110c86738e74400: Time spent bootstrapping tablet: real 0.131s	user 0.027s	sys 0.008s
I20260709 13:08:20.374069 27935 consensus_queue.cc:237] T de531c50b1524ec788b27bc4b883689a P 41268b218b804905a110c86738e74400 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "41268b218b804905a110c86738e74400" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 44403 } } peers { permanent_uuid: "18435fbb525741328139e84a1e354954" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 40545 } } peers { permanent_uuid: "2513a663afac495eb09126ff55e8b2b0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40721 } }
I20260709 13:08:20.375741 27865 ts_tablet_manager.cc:1434] T 55a3afc21cea43ea85f4a2155552422d P 18435fbb525741328139e84a1e354954: Time spent starting tablet: real 0.150s	user 0.021s	sys 0.009s
I20260709 13:08:20.377374 27865 tablet_bootstrap.cc:492] T a9eac7f072de454a8ff2beb019da45d9 P 18435fbb525741328139e84a1e354954: Bootstrap starting.
I20260709 13:08:20.365253 27814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc0b10615ecb4485a9a9de298938697d" candidate_uuid: "2513a663afac495eb09126ff55e8b2b0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "18435fbb525741328139e84a1e354954" is_pre_election: true
I20260709 13:08:20.347631 27667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc0b10615ecb4485a9a9de298938697d" candidate_uuid: "2513a663afac495eb09126ff55e8b2b0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "41268b218b804905a110c86738e74400" is_pre_election: true
I20260709 13:08:20.375630 27964 raft_consensus.cc:515] T 56803a5c0dea4efeabafb6829d9215cd P 18435fbb525741328139e84a1e354954 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "41268b218b804905a110c86738e74400" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 44403 } } peers { permanent_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 38749 } } peers { permanent_uuid: "18435fbb525741328139e84a1e354954" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 40545 } }
I20260709 13:08:20.378635 27667 raft_consensus.cc:2468] T bc0b10615ecb4485a9a9de298938697d P 41268b218b804905a110c86738e74400 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2513a663afac495eb09126ff55e8b2b0 in term 0.
I20260709 13:08:20.378760 27814 raft_consensus.cc:2468] T bc0b10615ecb4485a9a9de298938697d P 18435fbb525741328139e84a1e354954 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2513a663afac495eb09126ff55e8b2b0 in term 0.
I20260709 13:08:20.353142 27901 raft_consensus.cc:493] T df06af11cae7484d969017fcb5b7e753 P 41268b218b804905a110c86738e74400 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:20.380016 27863 raft_consensus.cc:359] T 866a01285ca8436385f8d16dcfb0d4e3 P 41268b218b804905a110c86738e74400 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2513a663afac495eb09126ff55e8b2b0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40721 } } peers { permanent_uuid: "41268b218b804905a110c86738e74400" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 44403 } } peers { permanent_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 38749 } }
I20260709 13:08:20.380921 27863 raft_consensus.cc:385] T 866a01285ca8436385f8d16dcfb0d4e3 P 41268b218b804905a110c86738e74400 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:20.381163 27863 raft_consensus.cc:740] T 866a01285ca8436385f8d16dcfb0d4e3 P 41268b218b804905a110c86738e74400 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 41268b218b804905a110c86738e74400, State: Initialized, Role: FOLLOWER
I20260709 13:08:20.380107 27901 raft_consensus.cc:515] T df06af11cae7484d969017fcb5b7e753 P 41268b218b804905a110c86738e74400 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "41268b218b804905a110c86738e74400" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 44403 } } peers { permanent_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 38749 } } peers { permanent_uuid: "18435fbb525741328139e84a1e354954" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 40545 } }
I20260709 13:08:20.388463 27964 leader_election.cc:290] T 56803a5c0dea4efeabafb6829d9215cd P 18435fbb525741328139e84a1e354954 [CANDIDATE]: Term 1 election: Requested vote from peers 41268b218b804905a110c86738e74400 (127.17.223.2:44403), 665f7e09521a4c3f9284c1d8b0e094ff (127.17.223.3:38749)
I20260709 13:08:20.394553 27863 consensus_queue.cc:260] T 866a01285ca8436385f8d16dcfb0d4e3 P 41268b218b804905a110c86738e74400 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2513a663afac495eb09126ff55e8b2b0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40721 } } peers { permanent_uuid: "41268b218b804905a110c86738e74400" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 44403 } } peers { permanent_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 38749 } }
I20260709 13:08:20.379972 27559 leader_election.cc:304] T bc0b10615ecb4485a9a9de298938697d P 2513a663afac495eb09126ff55e8b2b0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2513a663afac495eb09126ff55e8b2b0, 41268b218b804905a110c86738e74400; no voters: 
I20260709 13:08:20.391989 27901 leader_election.cc:290] T df06af11cae7484d969017fcb5b7e753 P 41268b218b804905a110c86738e74400 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 665f7e09521a4c3f9284c1d8b0e094ff (127.17.223.3:38749), 18435fbb525741328139e84a1e354954 (127.17.223.4:40545)
I20260709 13:08:20.397708 27741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56803a5c0dea4efeabafb6829d9215cd" candidate_uuid: "18435fbb525741328139e84a1e354954" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "665f7e09521a4c3f9284c1d8b0e094ff"
I20260709 13:08:20.404628 27741 raft_consensus.cc:3060] T 56803a5c0dea4efeabafb6829d9215cd P 665f7e09521a4c3f9284c1d8b0e094ff [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:20.406032 27863 ts_tablet_manager.cc:1434] T 866a01285ca8436385f8d16dcfb0d4e3 P 41268b218b804905a110c86738e74400: Time spent starting tablet: real 0.031s	user 0.007s	sys 0.000s
I20260709 13:08:20.407184 27863 tablet_bootstrap.cc:492] T e5847d81a5284a44a6b2b21cf6f4351c P 41268b218b804905a110c86738e74400: Bootstrap starting.
I20260709 13:08:20.407531 27742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df06af11cae7484d969017fcb5b7e753" candidate_uuid: "41268b218b804905a110c86738e74400" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" is_pre_election: true
I20260709 13:08:20.409085 27957 raft_consensus.cc:2804] T bc0b10615ecb4485a9a9de298938697d P 2513a663afac495eb09126ff55e8b2b0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:08:20.411947 27957 raft_consensus.cc:493] T bc0b10615ecb4485a9a9de298938697d P 2513a663afac495eb09126ff55e8b2b0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:20.412312 27957 raft_consensus.cc:3060] T bc0b10615ecb4485a9a9de298938697d P 2513a663afac495eb09126ff55e8b2b0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:20.418056 27863 tablet_bootstrap.cc:654] T e5847d81a5284a44a6b2b21cf6f4351c P 41268b218b804905a110c86738e74400: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:20.426647 27874 raft_consensus.cc:2749] T 64490a86db8c4f5ca54f4f8085f41319 P 18435fbb525741328139e84a1e354954 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:08:20.437841 27666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56803a5c0dea4efeabafb6829d9215cd" candidate_uuid: "18435fbb525741328139e84a1e354954" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "41268b218b804905a110c86738e74400"
I20260709 13:08:20.438562 27666 raft_consensus.cc:3060] T 56803a5c0dea4efeabafb6829d9215cd P 41268b218b804905a110c86738e74400 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:20.441220 27489 catalog_manager.cc:5697] T 18f991bbbf3a4615aab49899c7ef86dc P 2513a663afac495eb09126ff55e8b2b0 reported cstate change: term changed from 0 to 1, leader changed from <none> to 2513a663afac495eb09126ff55e8b2b0 (127.17.223.1). New cstate: current_term: 1 leader_uuid: "2513a663afac495eb09126ff55e8b2b0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2513a663afac495eb09126ff55e8b2b0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40721 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "18435fbb525741328139e84a1e354954" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 40545 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 38749 } health_report { overall_health: UNKNOWN } } }
W20260709 13:08:20.443645 27634 leader_election.cc:343] T df06af11cae7484d969017fcb5b7e753 P 41268b218b804905a110c86738e74400 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 665f7e09521a4c3f9284c1d8b0e094ff (127.17.223.3:38749): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:20.446135 27862 tablet_bootstrap.cc:492] T 55a3afc21cea43ea85f4a2155552422d P 665f7e09521a4c3f9284c1d8b0e094ff: No bootstrap required, opened a new log
I20260709 13:08:20.449554 27862 ts_tablet_manager.cc:1403] T 55a3afc21cea43ea85f4a2155552422d P 665f7e09521a4c3f9284c1d8b0e094ff: Time spent bootstrapping tablet: real 0.271s	user 0.016s	sys 0.013s
I20260709 13:08:20.458053 27863 tablet_bootstrap.cc:492] T e5847d81a5284a44a6b2b21cf6f4351c P 41268b218b804905a110c86738e74400: No bootstrap required, opened a new log
I20260709 13:08:20.458647 27863 ts_tablet_manager.cc:1403] T e5847d81a5284a44a6b2b21cf6f4351c P 41268b218b804905a110c86738e74400: Time spent bootstrapping tablet: real 0.052s	user 0.023s	sys 0.004s
I20260709 13:08:20.464238 27813 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df06af11cae7484d969017fcb5b7e753" candidate_uuid: "41268b218b804905a110c86738e74400" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "18435fbb525741328139e84a1e354954" is_pre_election: true
I20260709 13:08:20.465729 27863 raft_consensus.cc:359] T e5847d81a5284a44a6b2b21cf6f4351c P 41268b218b804905a110c86738e74400 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18435fbb525741328139e84a1e354954" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 40545 } } peers { permanent_uuid: "2513a663afac495eb09126ff55e8b2b0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40721 } } peers { permanent_uuid: "41268b218b804905a110c86738e74400" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 44403 } }
I20260709 13:08:20.466609 27863 raft_consensus.cc:385] T e5847d81a5284a44a6b2b21cf6f4351c P 41268b218b804905a110c86738e74400 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:20.466985 27863 raft_consensus.cc:740] T e5847d81a5284a44a6b2b21cf6f4351c P 41268b218b804905a110c86738e74400 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 41268b218b804905a110c86738e74400, State: Initialized, Role: FOLLOWER
I20260709 13:08:20.452435 27862 raft_consensus.cc:359] T 55a3afc21cea43ea85f4a2155552422d P 665f7e09521a4c3f9284c1d8b0e094ff [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 38749 } } peers { permanent_uuid: "18435fbb525741328139e84a1e354954" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 40545 } } peers { permanent_uuid: "2513a663afac495eb09126ff55e8b2b0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40721 } }
I20260709 13:08:20.470741 27862 raft_consensus.cc:385] T 55a3afc21cea43ea85f4a2155552422d P 665f7e09521a4c3f9284c1d8b0e094ff [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:20.471071 27862 raft_consensus.cc:740] T 55a3afc21cea43ea85f4a2155552422d P 665f7e09521a4c3f9284c1d8b0e094ff [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 665f7e09521a4c3f9284c1d8b0e094ff, State: Initialized, Role: FOLLOWER
I20260709 13:08:20.472005 27863 consensus_queue.cc:260] T e5847d81a5284a44a6b2b21cf6f4351c P 41268b218b804905a110c86738e74400 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18435fbb525741328139e84a1e354954" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 40545 } } peers { permanent_uuid: "2513a663afac495eb09126ff55e8b2b0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40721 } } peers { permanent_uuid: "41268b218b804905a110c86738e74400" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 44403 } }
I20260709 13:08:20.444901 27957 raft_consensus.cc:515] T bc0b10615ecb4485a9a9de298938697d P 2513a663afac495eb09126ff55e8b2b0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18435fbb525741328139e84a1e354954" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 40545 } } peers { permanent_uuid: "2513a663afac495eb09126ff55e8b2b0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40721 } } peers { permanent_uuid: "41268b218b804905a110c86738e74400" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 44403 } }
I20260709 13:08:20.475898 27957 leader_election.cc:290] T bc0b10615ecb4485a9a9de298938697d P 2513a663afac495eb09126ff55e8b2b0 [CANDIDATE]: Term 1 election: Requested vote from peers 18435fbb525741328139e84a1e354954 (127.17.223.4:40545), 41268b218b804905a110c86738e74400 (127.17.223.2:44403)
I20260709 13:08:20.476555 27862 consensus_queue.cc:260] T 55a3afc21cea43ea85f4a2155552422d P 665f7e09521a4c3f9284c1d8b0e094ff [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 38749 } } peers { permanent_uuid: "18435fbb525741328139e84a1e354954" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 40545 } } peers { permanent_uuid: "2513a663afac495eb09126ff55e8b2b0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40721 } }
I20260709 13:08:20.479409 27862 ts_tablet_manager.cc:1434] T 55a3afc21cea43ea85f4a2155552422d P 665f7e09521a4c3f9284c1d8b0e094ff: Time spent starting tablet: real 0.030s	user 0.008s	sys 0.000s
I20260709 13:08:20.484807 27862 tablet_bootstrap.cc:492] T 7b77a53b493f4e979fdf38a0b17176b0 P 665f7e09521a4c3f9284c1d8b0e094ff: Bootstrap starting.
I20260709 13:08:20.486598 27816 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc0b10615ecb4485a9a9de298938697d" candidate_uuid: "2513a663afac495eb09126ff55e8b2b0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "18435fbb525741328139e84a1e354954"
I20260709 13:08:20.487334 27816 raft_consensus.cc:3060] T bc0b10615ecb4485a9a9de298938697d P 18435fbb525741328139e84a1e354954 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:20.488476 27863 ts_tablet_manager.cc:1434] T e5847d81a5284a44a6b2b21cf6f4351c P 41268b218b804905a110c86738e74400: Time spent starting tablet: real 0.029s	user 0.004s	sys 0.004s
I20260709 13:08:20.488320 27667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc0b10615ecb4485a9a9de298938697d" candidate_uuid: "2513a663afac495eb09126ff55e8b2b0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "41268b218b804905a110c86738e74400"
I20260709 13:08:20.488937 27667 raft_consensus.cc:3060] T bc0b10615ecb4485a9a9de298938697d P 41268b218b804905a110c86738e74400 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:20.489557 27863 tablet_bootstrap.cc:492] T 68cc2880cf79462c99d9009957eb5fd2 P 41268b218b804905a110c86738e74400: Bootstrap starting.
I20260709 13:08:20.495246 27741 raft_consensus.cc:2468] T 56803a5c0dea4efeabafb6829d9215cd P 665f7e09521a4c3f9284c1d8b0e094ff [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 18435fbb525741328139e84a1e354954 in term 1.
I20260709 13:08:20.496626 27782 leader_election.cc:304] T 56803a5c0dea4efeabafb6829d9215cd P 18435fbb525741328139e84a1e354954 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 18435fbb525741328139e84a1e354954, 665f7e09521a4c3f9284c1d8b0e094ff; no voters: 
I20260709 13:08:20.497828 27874 raft_consensus.cc:2804] T 56803a5c0dea4efeabafb6829d9215cd P 18435fbb525741328139e84a1e354954 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:08:20.498334 27874 raft_consensus.cc:697] T 56803a5c0dea4efeabafb6829d9215cd P 18435fbb525741328139e84a1e354954 [term 1 LEADER]: Becoming Leader. State: Replica: 18435fbb525741328139e84a1e354954, State: Running, Role: LEADER
W20260709 13:08:20.498574 27634 leader_election.cc:343] T df06af11cae7484d969017fcb5b7e753 P 41268b218b804905a110c86738e74400 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 18435fbb525741328139e84a1e354954 (127.17.223.4:40545): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:20.499130 27634 leader_election.cc:304] T df06af11cae7484d969017fcb5b7e753 P 41268b218b804905a110c86738e74400 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 41268b218b804905a110c86738e74400; no voters: 18435fbb525741328139e84a1e354954, 665f7e09521a4c3f9284c1d8b0e094ff
I20260709 13:08:20.499466 27874 consensus_queue.cc:237] T 56803a5c0dea4efeabafb6829d9215cd P 18435fbb525741328139e84a1e354954 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "41268b218b804905a110c86738e74400" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 44403 } } peers { permanent_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 38749 } } peers { permanent_uuid: "18435fbb525741328139e84a1e354954" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 40545 } }
I20260709 13:08:20.500414 27978 raft_consensus.cc:2749] T df06af11cae7484d969017fcb5b7e753 P 41268b218b804905a110c86738e74400 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:08:20.510170 27863 tablet_bootstrap.cc:654] T 68cc2880cf79462c99d9009957eb5fd2 P 41268b218b804905a110c86738e74400: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:20.510259 27816 raft_consensus.cc:2468] T bc0b10615ecb4485a9a9de298938697d P 18435fbb525741328139e84a1e354954 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2513a663afac495eb09126ff55e8b2b0 in term 1.
I20260709 13:08:20.511838 27865 tablet_bootstrap.cc:654] T a9eac7f072de454a8ff2beb019da45d9 P 18435fbb525741328139e84a1e354954: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:20.511871 27559 leader_election.cc:304] T bc0b10615ecb4485a9a9de298938697d P 2513a663afac495eb09126ff55e8b2b0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 18435fbb525741328139e84a1e354954, 2513a663afac495eb09126ff55e8b2b0; no voters: 
I20260709 13:08:20.512981 27957 raft_consensus.cc:2804] T bc0b10615ecb4485a9a9de298938697d P 2513a663afac495eb09126ff55e8b2b0 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:08:20.513574 27957 raft_consensus.cc:697] T bc0b10615ecb4485a9a9de298938697d P 2513a663afac495eb09126ff55e8b2b0 [term 1 LEADER]: Becoming Leader. State: Replica: 2513a663afac495eb09126ff55e8b2b0, State: Running, Role: LEADER
I20260709 13:08:20.514871 27667 raft_consensus.cc:2468] T bc0b10615ecb4485a9a9de298938697d P 41268b218b804905a110c86738e74400 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2513a663afac495eb09126ff55e8b2b0 in term 1.
I20260709 13:08:20.515460 27957 consensus_queue.cc:237] T bc0b10615ecb4485a9a9de298938697d P 2513a663afac495eb09126ff55e8b2b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18435fbb525741328139e84a1e354954" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 40545 } } peers { permanent_uuid: "2513a663afac495eb09126ff55e8b2b0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40721 } } peers { permanent_uuid: "41268b218b804905a110c86738e74400" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 44403 } }
I20260709 13:08:20.522010 27964 raft_consensus.cc:493] T 55a3afc21cea43ea85f4a2155552422d P 18435fbb525741328139e84a1e354954 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:20.522662 27666 raft_consensus.cc:2468] T 56803a5c0dea4efeabafb6829d9215cd P 41268b218b804905a110c86738e74400 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 18435fbb525741328139e84a1e354954 in term 1.
I20260709 13:08:20.522795 27964 raft_consensus.cc:515] T 55a3afc21cea43ea85f4a2155552422d P 18435fbb525741328139e84a1e354954 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 38749 } } peers { permanent_uuid: "18435fbb525741328139e84a1e354954" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 40545 } } peers { permanent_uuid: "2513a663afac495eb09126ff55e8b2b0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40721 } }
I20260709 13:08:20.523939 27898 consensus_queue.cc:1048] T 456941807b254f5fb32dca4f84bd16ea P 2513a663afac495eb09126ff55e8b2b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 38749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:08:20.526619 27964 leader_election.cc:290] T 55a3afc21cea43ea85f4a2155552422d P 18435fbb525741328139e84a1e354954 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 665f7e09521a4c3f9284c1d8b0e094ff (127.17.223.3:38749), 2513a663afac495eb09126ff55e8b2b0 (127.17.223.1:40721)
I20260709 13:08:20.527169 27741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55a3afc21cea43ea85f4a2155552422d" candidate_uuid: "18435fbb525741328139e84a1e354954" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" is_pre_election: true
I20260709 13:08:20.527873 27741 raft_consensus.cc:2468] T 55a3afc21cea43ea85f4a2155552422d P 665f7e09521a4c3f9284c1d8b0e094ff [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 18435fbb525741328139e84a1e354954 in term 0.
I20260709 13:08:20.531071 27861 tablet_bootstrap.cc:492] T 7b77a53b493f4e979fdf38a0b17176b0 P 2513a663afac495eb09126ff55e8b2b0: No bootstrap required, opened a new log
I20260709 13:08:20.531657 27861 ts_tablet_manager.cc:1403] T 7b77a53b493f4e979fdf38a0b17176b0 P 2513a663afac495eb09126ff55e8b2b0: Time spent bootstrapping tablet: real 0.242s	user 0.018s	sys 0.002s
I20260709 13:08:20.544099 27592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55a3afc21cea43ea85f4a2155552422d" candidate_uuid: "18435fbb525741328139e84a1e354954" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2513a663afac495eb09126ff55e8b2b0" is_pre_election: true
I20260709 13:08:20.545034 27592 raft_consensus.cc:2468] T 55a3afc21cea43ea85f4a2155552422d P 2513a663afac495eb09126ff55e8b2b0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 18435fbb525741328139e84a1e354954 in term 0.
I20260709 13:08:20.545950 27861 raft_consensus.cc:359] T 7b77a53b493f4e979fdf38a0b17176b0 P 2513a663afac495eb09126ff55e8b2b0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2513a663afac495eb09126ff55e8b2b0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40721 } } peers { permanent_uuid: "41268b218b804905a110c86738e74400" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 44403 } } peers { permanent_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 38749 } }
I20260709 13:08:20.548734 27865 tablet_bootstrap.cc:492] T a9eac7f072de454a8ff2beb019da45d9 P 18435fbb525741328139e84a1e354954: No bootstrap required, opened a new log
I20260709 13:08:20.548875 27861 raft_consensus.cc:385] T 7b77a53b493f4e979fdf38a0b17176b0 P 2513a663afac495eb09126ff55e8b2b0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:20.549443 27861 raft_consensus.cc:740] T 7b77a53b493f4e979fdf38a0b17176b0 P 2513a663afac495eb09126ff55e8b2b0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2513a663afac495eb09126ff55e8b2b0, State: Initialized, Role: FOLLOWER
I20260709 13:08:20.550920 27782 leader_election.cc:304] T 55a3afc21cea43ea85f4a2155552422d P 18435fbb525741328139e84a1e354954 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 18435fbb525741328139e84a1e354954, 665f7e09521a4c3f9284c1d8b0e094ff; no voters: 
I20260709 13:08:20.558557 27861 consensus_queue.cc:260] T 7b77a53b493f4e979fdf38a0b17176b0 P 2513a663afac495eb09126ff55e8b2b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2513a663afac495eb09126ff55e8b2b0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40721 } } peers { permanent_uuid: "41268b218b804905a110c86738e74400" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 44403 } } peers { permanent_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 38749 } }
I20260709 13:08:20.557981 27862 tablet_bootstrap.cc:654] T 7b77a53b493f4e979fdf38a0b17176b0 P 665f7e09521a4c3f9284c1d8b0e094ff: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:20.561479 27861 ts_tablet_manager.cc:1434] T 7b77a53b493f4e979fdf38a0b17176b0 P 2513a663afac495eb09126ff55e8b2b0: Time spent starting tablet: real 0.029s	user 0.007s	sys 0.000s
I20260709 13:08:20.564211 27964 raft_consensus.cc:2804] T 55a3afc21cea43ea85f4a2155552422d P 18435fbb525741328139e84a1e354954 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:08:20.568849 27964 raft_consensus.cc:493] T 55a3afc21cea43ea85f4a2155552422d P 18435fbb525741328139e84a1e354954 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:20.557510 27489 catalog_manager.cc:5697] T de531c50b1524ec788b27bc4b883689a P 41268b218b804905a110c86738e74400 reported cstate change: term changed from 0 to 1, leader changed from <none> to 41268b218b804905a110c86738e74400 (127.17.223.2). New cstate: current_term: 1 leader_uuid: "41268b218b804905a110c86738e74400" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "41268b218b804905a110c86738e74400" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 44403 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "18435fbb525741328139e84a1e354954" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 40545 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2513a663afac495eb09126ff55e8b2b0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40721 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:20.569203 27964 raft_consensus.cc:3060] T 55a3afc21cea43ea85f4a2155552422d P 18435fbb525741328139e84a1e354954 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:20.572988 27491 catalog_manager.cc:5697] T 56803a5c0dea4efeabafb6829d9215cd P 18435fbb525741328139e84a1e354954 reported cstate change: term changed from 0 to 1, leader changed from <none> to 18435fbb525741328139e84a1e354954 (127.17.223.4). New cstate: current_term: 1 leader_uuid: "18435fbb525741328139e84a1e354954" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "41268b218b804905a110c86738e74400" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 44403 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 38749 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "18435fbb525741328139e84a1e354954" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 40545 } health_report { overall_health: HEALTHY } } }
I20260709 13:08:20.562661 27861 tablet_bootstrap.cc:492] T 11224ef6c00a40cdba4311ceb63bddb9 P 2513a663afac495eb09126ff55e8b2b0: Bootstrap starting.
I20260709 13:08:20.576162 27865 ts_tablet_manager.cc:1403] T a9eac7f072de454a8ff2beb019da45d9 P 18435fbb525741328139e84a1e354954: Time spent bootstrapping tablet: real 0.199s	user 0.008s	sys 0.010s
I20260709 13:08:20.581003 27865 raft_consensus.cc:359] T a9eac7f072de454a8ff2beb019da45d9 P 18435fbb525741328139e84a1e354954 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18435fbb525741328139e84a1e354954" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 40545 } } peers { permanent_uuid: "2513a663afac495eb09126ff55e8b2b0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40721 } } peers { permanent_uuid: "41268b218b804905a110c86738e74400" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 44403 } }
I20260709 13:08:20.581892 27865 raft_consensus.cc:385] T a9eac7f072de454a8ff2beb019da45d9 P 18435fbb525741328139e84a1e354954 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:20.582211 27865 raft_consensus.cc:740] T a9eac7f072de454a8ff2beb019da45d9 P 18435fbb525741328139e84a1e354954 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 18435fbb525741328139e84a1e354954, State: Initialized, Role: FOLLOWER
I20260709 13:08:20.598071 27861 tablet_bootstrap.cc:654] T 11224ef6c00a40cdba4311ceb63bddb9 P 2513a663afac495eb09126ff55e8b2b0: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:20.605437 27964 raft_consensus.cc:515] T 55a3afc21cea43ea85f4a2155552422d P 18435fbb525741328139e84a1e354954 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 38749 } } peers { permanent_uuid: "18435fbb525741328139e84a1e354954" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 40545 } } peers { permanent_uuid: "2513a663afac495eb09126ff55e8b2b0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40721 } }
I20260709 13:08:20.606120 27898 consensus_queue.cc:1048] T 456941807b254f5fb32dca4f84bd16ea P 2513a663afac495eb09126ff55e8b2b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "41268b218b804905a110c86738e74400" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 44403 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:08:20.609994 27964 leader_election.cc:290] T 55a3afc21cea43ea85f4a2155552422d P 18435fbb525741328139e84a1e354954 [CANDIDATE]: Term 1 election: Requested vote from peers 665f7e09521a4c3f9284c1d8b0e094ff (127.17.223.3:38749), 2513a663afac495eb09126ff55e8b2b0 (127.17.223.1:40721)
I20260709 13:08:20.610569 27741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55a3afc21cea43ea85f4a2155552422d" candidate_uuid: "18435fbb525741328139e84a1e354954" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "665f7e09521a4c3f9284c1d8b0e094ff"
I20260709 13:08:20.611215 27741 raft_consensus.cc:3060] T 55a3afc21cea43ea85f4a2155552422d P 665f7e09521a4c3f9284c1d8b0e094ff [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:20.610888 27865 consensus_queue.cc:260] T a9eac7f072de454a8ff2beb019da45d9 P 18435fbb525741328139e84a1e354954 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18435fbb525741328139e84a1e354954" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 40545 } } peers { permanent_uuid: "2513a663afac495eb09126ff55e8b2b0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40721 } } peers { permanent_uuid: "41268b218b804905a110c86738e74400" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 44403 } }
I20260709 13:08:20.613183 27865 ts_tablet_manager.cc:1434] T a9eac7f072de454a8ff2beb019da45d9 P 18435fbb525741328139e84a1e354954: Time spent starting tablet: real 0.037s	user 0.002s	sys 0.005s
I20260709 13:08:20.619860 27865 tablet_bootstrap.cc:492] T df06af11cae7484d969017fcb5b7e753 P 18435fbb525741328139e84a1e354954: Bootstrap starting.
I20260709 13:08:20.614598 27592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55a3afc21cea43ea85f4a2155552422d" candidate_uuid: "18435fbb525741328139e84a1e354954" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2513a663afac495eb09126ff55e8b2b0"
I20260709 13:08:20.620649 27592 raft_consensus.cc:3060] T 55a3afc21cea43ea85f4a2155552422d P 2513a663afac495eb09126ff55e8b2b0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:20.616225 27862 tablet_bootstrap.cc:492] T 7b77a53b493f4e979fdf38a0b17176b0 P 665f7e09521a4c3f9284c1d8b0e094ff: No bootstrap required, opened a new log
I20260709 13:08:20.623445 27862 ts_tablet_manager.cc:1403] T 7b77a53b493f4e979fdf38a0b17176b0 P 665f7e09521a4c3f9284c1d8b0e094ff: Time spent bootstrapping tablet: real 0.139s	user 0.007s	sys 0.010s
I20260709 13:08:20.645977 27741 raft_consensus.cc:2468] T 55a3afc21cea43ea85f4a2155552422d P 665f7e09521a4c3f9284c1d8b0e094ff [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 18435fbb525741328139e84a1e354954 in term 1.
I20260709 13:08:20.646836 27862 raft_consensus.cc:359] T 7b77a53b493f4e979fdf38a0b17176b0 P 665f7e09521a4c3f9284c1d8b0e094ff [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2513a663afac495eb09126ff55e8b2b0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40721 } } peers { permanent_uuid: "41268b218b804905a110c86738e74400" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 44403 } } peers { permanent_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 38749 } }
I20260709 13:08:20.647619 27862 raft_consensus.cc:385] T 7b77a53b493f4e979fdf38a0b17176b0 P 665f7e09521a4c3f9284c1d8b0e094ff [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:20.647761 27782 leader_election.cc:304] T 55a3afc21cea43ea85f4a2155552422d P 18435fbb525741328139e84a1e354954 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 18435fbb525741328139e84a1e354954, 665f7e09521a4c3f9284c1d8b0e094ff; no voters: 
I20260709 13:08:20.647969 27862 raft_consensus.cc:740] T 7b77a53b493f4e979fdf38a0b17176b0 P 665f7e09521a4c3f9284c1d8b0e094ff [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 665f7e09521a4c3f9284c1d8b0e094ff, State: Initialized, Role: FOLLOWER
I20260709 13:08:20.648887 27935 raft_consensus.cc:493] T e5847d81a5284a44a6b2b21cf6f4351c P 41268b218b804905a110c86738e74400 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:20.649303 27964 raft_consensus.cc:2804] T 55a3afc21cea43ea85f4a2155552422d P 18435fbb525741328139e84a1e354954 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:08:20.649456 27935 raft_consensus.cc:515] T e5847d81a5284a44a6b2b21cf6f4351c P 41268b218b804905a110c86738e74400 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18435fbb525741328139e84a1e354954" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 40545 } } peers { permanent_uuid: "2513a663afac495eb09126ff55e8b2b0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40721 } } peers { permanent_uuid: "41268b218b804905a110c86738e74400" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 44403 } }
I20260709 13:08:20.649868 27964 raft_consensus.cc:697] T 55a3afc21cea43ea85f4a2155552422d P 18435fbb525741328139e84a1e354954 [term 1 LEADER]: Becoming Leader. State: Replica: 18435fbb525741328139e84a1e354954, State: Running, Role: LEADER
I20260709 13:08:20.649938 27862 consensus_queue.cc:260] T 7b77a53b493f4e979fdf38a0b17176b0 P 665f7e09521a4c3f9284c1d8b0e094ff [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2513a663afac495eb09126ff55e8b2b0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40721 } } peers { permanent_uuid: "41268b218b804905a110c86738e74400" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 44403 } } peers { permanent_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 38749 } }
I20260709 13:08:20.650838 27964 consensus_queue.cc:237] T 55a3afc21cea43ea85f4a2155552422d P 18435fbb525741328139e84a1e354954 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 38749 } } peers { permanent_uuid: "18435fbb525741328139e84a1e354954" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 40545 } } peers { permanent_uuid: "2513a663afac495eb09126ff55e8b2b0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40721 } }
I20260709 13:08:20.652271 27935 leader_election.cc:290] T e5847d81a5284a44a6b2b21cf6f4351c P 41268b218b804905a110c86738e74400 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 18435fbb525741328139e84a1e354954 (127.17.223.4:40545), 2513a663afac495eb09126ff55e8b2b0 (127.17.223.1:40721)
I20260709 13:08:20.653527 27862 ts_tablet_manager.cc:1434] T 7b77a53b493f4e979fdf38a0b17176b0 P 665f7e09521a4c3f9284c1d8b0e094ff: Time spent starting tablet: real 0.030s	user 0.008s	sys 0.000s
I20260709 13:08:20.653613 27593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5847d81a5284a44a6b2b21cf6f4351c" candidate_uuid: "41268b218b804905a110c86738e74400" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2513a663afac495eb09126ff55e8b2b0" is_pre_election: true
I20260709 13:08:20.654340 27816 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5847d81a5284a44a6b2b21cf6f4351c" candidate_uuid: "41268b218b804905a110c86738e74400" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "18435fbb525741328139e84a1e354954" is_pre_election: true
W20260709 13:08:20.655604 27631 leader_election.cc:343] T e5847d81a5284a44a6b2b21cf6f4351c P 41268b218b804905a110c86738e74400 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2513a663afac495eb09126ff55e8b2b0 (127.17.223.1:40721): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:20.648279 27592 raft_consensus.cc:2468] T 55a3afc21cea43ea85f4a2155552422d P 2513a663afac495eb09126ff55e8b2b0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 18435fbb525741328139e84a1e354954 in term 1.
W20260709 13:08:20.657385 27634 leader_election.cc:343] T e5847d81a5284a44a6b2b21cf6f4351c P 41268b218b804905a110c86738e74400 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 18435fbb525741328139e84a1e354954 (127.17.223.4:40545): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:20.657847 27634 leader_election.cc:304] T e5847d81a5284a44a6b2b21cf6f4351c P 41268b218b804905a110c86738e74400 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 41268b218b804905a110c86738e74400; no voters: 18435fbb525741328139e84a1e354954, 2513a663afac495eb09126ff55e8b2b0
I20260709 13:08:20.660946 27935 raft_consensus.cc:2749] T e5847d81a5284a44a6b2b21cf6f4351c P 41268b218b804905a110c86738e74400 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:08:20.663681 27863 tablet_bootstrap.cc:492] T 68cc2880cf79462c99d9009957eb5fd2 P 41268b218b804905a110c86738e74400: No bootstrap required, opened a new log
I20260709 13:08:20.664214 27863 ts_tablet_manager.cc:1403] T 68cc2880cf79462c99d9009957eb5fd2 P 41268b218b804905a110c86738e74400: Time spent bootstrapping tablet: real 0.175s	user 0.043s	sys 0.061s
I20260709 13:08:20.658116 27862 tablet_bootstrap.cc:492] T 11224ef6c00a40cdba4311ceb63bddb9 P 665f7e09521a4c3f9284c1d8b0e094ff: Bootstrap starting.
I20260709 13:08:20.665624 27861 tablet_bootstrap.cc:492] T 11224ef6c00a40cdba4311ceb63bddb9 P 2513a663afac495eb09126ff55e8b2b0: No bootstrap required, opened a new log
I20260709 13:08:20.666339 27861 ts_tablet_manager.cc:1403] T 11224ef6c00a40cdba4311ceb63bddb9 P 2513a663afac495eb09126ff55e8b2b0: Time spent bootstrapping tablet: real 0.104s	user 0.027s	sys 0.016s
I20260709 13:08:20.667296 27863 raft_consensus.cc:359] T 68cc2880cf79462c99d9009957eb5fd2 P 41268b218b804905a110c86738e74400 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "41268b218b804905a110c86738e74400" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 44403 } } peers { permanent_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 38749 } } peers { permanent_uuid: "18435fbb525741328139e84a1e354954" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 40545 } }
I20260709 13:08:20.668025 27863 raft_consensus.cc:385] T 68cc2880cf79462c99d9009957eb5fd2 P 41268b218b804905a110c86738e74400 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:20.668329 27863 raft_consensus.cc:740] T 68cc2880cf79462c99d9009957eb5fd2 P 41268b218b804905a110c86738e74400 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 41268b218b804905a110c86738e74400, State: Initialized, Role: FOLLOWER
I20260709 13:08:20.671278 27861 raft_consensus.cc:359] T 11224ef6c00a40cdba4311ceb63bddb9 P 2513a663afac495eb09126ff55e8b2b0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 38749 } } peers { permanent_uuid: "18435fbb525741328139e84a1e354954" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 40545 } } peers { permanent_uuid: "2513a663afac495eb09126ff55e8b2b0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40721 } }
I20260709 13:08:20.673000 27862 tablet_bootstrap.cc:654] T 11224ef6c00a40cdba4311ceb63bddb9 P 665f7e09521a4c3f9284c1d8b0e094ff: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:20.673642 27861 raft_consensus.cc:385] T 11224ef6c00a40cdba4311ceb63bddb9 P 2513a663afac495eb09126ff55e8b2b0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:20.674117 27861 raft_consensus.cc:740] T 11224ef6c00a40cdba4311ceb63bddb9 P 2513a663afac495eb09126ff55e8b2b0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2513a663afac495eb09126ff55e8b2b0, State: Initialized, Role: FOLLOWER
I20260709 13:08:20.675154 27861 consensus_queue.cc:260] T 11224ef6c00a40cdba4311ceb63bddb9 P 2513a663afac495eb09126ff55e8b2b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 38749 } } peers { permanent_uuid: "18435fbb525741328139e84a1e354954" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 40545 } } peers { permanent_uuid: "2513a663afac495eb09126ff55e8b2b0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40721 } }
I20260709 13:08:20.672538 27863 consensus_queue.cc:260] T 68cc2880cf79462c99d9009957eb5fd2 P 41268b218b804905a110c86738e74400 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "41268b218b804905a110c86738e74400" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 44403 } } peers { permanent_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 38749 } } peers { permanent_uuid: "18435fbb525741328139e84a1e354954" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 40545 } }
I20260709 13:08:20.682262 27861 ts_tablet_manager.cc:1434] T 11224ef6c00a40cdba4311ceb63bddb9 P 2513a663afac495eb09126ff55e8b2b0: Time spent starting tablet: real 0.015s	user 0.007s	sys 0.000s
I20260709 13:08:20.682627 27863 ts_tablet_manager.cc:1434] T 68cc2880cf79462c99d9009957eb5fd2 P 41268b218b804905a110c86738e74400: Time spent starting tablet: real 0.018s	user 0.007s	sys 0.000s
I20260709 13:08:20.683420 27861 tablet_bootstrap.cc:492] T 765d0bd527c64f74be713c390a018bba P 2513a663afac495eb09126ff55e8b2b0: Bootstrap starting.
I20260709 13:08:20.683926 27863 tablet_bootstrap.cc:492] T 15a4c537259e4b2882a5cc8e723b260a P 41268b218b804905a110c86738e74400: Bootstrap starting.
I20260709 13:08:20.689194 27489 catalog_manager.cc:5697] T bc0b10615ecb4485a9a9de298938697d P 2513a663afac495eb09126ff55e8b2b0 reported cstate change: term changed from 0 to 1, leader changed from <none> to 2513a663afac495eb09126ff55e8b2b0 (127.17.223.1). New cstate: current_term: 1 leader_uuid: "2513a663afac495eb09126ff55e8b2b0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18435fbb525741328139e84a1e354954" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 40545 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2513a663afac495eb09126ff55e8b2b0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40721 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "41268b218b804905a110c86738e74400" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 44403 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:20.695525 27861 tablet_bootstrap.cc:654] T 765d0bd527c64f74be713c390a018bba P 2513a663afac495eb09126ff55e8b2b0: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:20.691155 27863 tablet_bootstrap.cc:654] T 15a4c537259e4b2882a5cc8e723b260a P 41268b218b804905a110c86738e74400: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:20.693552 27865 tablet_bootstrap.cc:654] T df06af11cae7484d969017fcb5b7e753 P 18435fbb525741328139e84a1e354954: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:20.721925 27816 raft_consensus.cc:3060] T 18f991bbbf3a4615aab49899c7ef86dc P 18435fbb525741328139e84a1e354954 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:20.736402 27870 raft_consensus.cc:493] T 7b77a53b493f4e979fdf38a0b17176b0 P 2513a663afac495eb09126ff55e8b2b0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:20.737012 27870 raft_consensus.cc:515] T 7b77a53b493f4e979fdf38a0b17176b0 P 2513a663afac495eb09126ff55e8b2b0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2513a663afac495eb09126ff55e8b2b0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40721 } } peers { permanent_uuid: "41268b218b804905a110c86738e74400" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 44403 } } peers { permanent_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 38749 } }
I20260709 13:08:20.739140 27870 leader_election.cc:290] T 7b77a53b493f4e979fdf38a0b17176b0 P 2513a663afac495eb09126ff55e8b2b0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 41268b218b804905a110c86738e74400 (127.17.223.2:44403), 665f7e09521a4c3f9284c1d8b0e094ff (127.17.223.3:38749)
I20260709 13:08:20.739828 27487 catalog_manager.cc:5697] T 55a3afc21cea43ea85f4a2155552422d P 18435fbb525741328139e84a1e354954 reported cstate change: term changed from 0 to 1, leader changed from <none> to 18435fbb525741328139e84a1e354954 (127.17.223.4). New cstate: current_term: 1 leader_uuid: "18435fbb525741328139e84a1e354954" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 38749 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "18435fbb525741328139e84a1e354954" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 40545 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2513a663afac495eb09126ff55e8b2b0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40721 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:20.741317 27665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b77a53b493f4e979fdf38a0b17176b0" candidate_uuid: "2513a663afac495eb09126ff55e8b2b0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "41268b218b804905a110c86738e74400" is_pre_election: true
I20260709 13:08:20.741391 27741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b77a53b493f4e979fdf38a0b17176b0" candidate_uuid: "2513a663afac495eb09126ff55e8b2b0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" is_pre_election: true
I20260709 13:08:20.742081 27665 raft_consensus.cc:2468] T 7b77a53b493f4e979fdf38a0b17176b0 P 41268b218b804905a110c86738e74400 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2513a663afac495eb09126ff55e8b2b0 in term 0.
I20260709 13:08:20.742321 27741 raft_consensus.cc:2468] T 7b77a53b493f4e979fdf38a0b17176b0 P 665f7e09521a4c3f9284c1d8b0e094ff [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2513a663afac495eb09126ff55e8b2b0 in term 0.
I20260709 13:08:20.743404 27559 leader_election.cc:304] T 7b77a53b493f4e979fdf38a0b17176b0 P 2513a663afac495eb09126ff55e8b2b0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2513a663afac495eb09126ff55e8b2b0, 41268b218b804905a110c86738e74400; no voters: 
I20260709 13:08:20.744284 27898 raft_consensus.cc:2804] T 7b77a53b493f4e979fdf38a0b17176b0 P 2513a663afac495eb09126ff55e8b2b0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:08:20.744654 27898 raft_consensus.cc:493] T 7b77a53b493f4e979fdf38a0b17176b0 P 2513a663afac495eb09126ff55e8b2b0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:20.744987 27898 raft_consensus.cc:3060] T 7b77a53b493f4e979fdf38a0b17176b0 P 2513a663afac495eb09126ff55e8b2b0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:20.752543 27935 raft_consensus.cc:493] T 866a01285ca8436385f8d16dcfb0d4e3 P 41268b218b804905a110c86738e74400 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:20.753160 27935 raft_consensus.cc:515] T 866a01285ca8436385f8d16dcfb0d4e3 P 41268b218b804905a110c86738e74400 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2513a663afac495eb09126ff55e8b2b0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40721 } } peers { permanent_uuid: "41268b218b804905a110c86738e74400" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 44403 } } peers { permanent_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 38749 } }
I20260709 13:08:20.752589 27898 raft_consensus.cc:515] T 7b77a53b493f4e979fdf38a0b17176b0 P 2513a663afac495eb09126ff55e8b2b0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2513a663afac495eb09126ff55e8b2b0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40721 } } peers { permanent_uuid: "41268b218b804905a110c86738e74400" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 44403 } } peers { permanent_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 38749 } }
I20260709 13:08:20.755824 27935 leader_election.cc:290] T 866a01285ca8436385f8d16dcfb0d4e3 P 41268b218b804905a110c86738e74400 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2513a663afac495eb09126ff55e8b2b0 (127.17.223.1:40721), 665f7e09521a4c3f9284c1d8b0e094ff (127.17.223.3:38749)
I20260709 13:08:20.757846 27592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "866a01285ca8436385f8d16dcfb0d4e3" candidate_uuid: "41268b218b804905a110c86738e74400" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2513a663afac495eb09126ff55e8b2b0" is_pre_election: true
W20260709 13:08:20.759341 27631 leader_election.cc:343] T 866a01285ca8436385f8d16dcfb0d4e3 P 41268b218b804905a110c86738e74400 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2513a663afac495eb09126ff55e8b2b0 (127.17.223.1:40721): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:20.761897 27870 consensus_queue.cc:1048] T 18f991bbbf3a4615aab49899c7ef86dc P 2513a663afac495eb09126ff55e8b2b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "18435fbb525741328139e84a1e354954" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 40545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:08:20.763157 27741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "866a01285ca8436385f8d16dcfb0d4e3" candidate_uuid: "41268b218b804905a110c86738e74400" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" is_pre_election: true
I20260709 13:08:20.763948 27741 raft_consensus.cc:2468] T 866a01285ca8436385f8d16dcfb0d4e3 P 665f7e09521a4c3f9284c1d8b0e094ff [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 41268b218b804905a110c86738e74400 in term 0.
I20260709 13:08:20.765744 27665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b77a53b493f4e979fdf38a0b17176b0" candidate_uuid: "2513a663afac495eb09126ff55e8b2b0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "41268b218b804905a110c86738e74400"
I20260709 13:08:20.766316 27665 raft_consensus.cc:3060] T 7b77a53b493f4e979fdf38a0b17176b0 P 41268b218b804905a110c86738e74400 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:20.766191 27634 leader_election.cc:304] T 866a01285ca8436385f8d16dcfb0d4e3 P 41268b218b804905a110c86738e74400 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 41268b218b804905a110c86738e74400, 665f7e09521a4c3f9284c1d8b0e094ff; no voters: 2513a663afac495eb09126ff55e8b2b0
I20260709 13:08:20.767534 27935 raft_consensus.cc:2804] T 866a01285ca8436385f8d16dcfb0d4e3 P 41268b218b804905a110c86738e74400 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:08:20.767906 27935 raft_consensus.cc:493] T 866a01285ca8436385f8d16dcfb0d4e3 P 41268b218b804905a110c86738e74400 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:20.768218 27935 raft_consensus.cc:3060] T 866a01285ca8436385f8d16dcfb0d4e3 P 41268b218b804905a110c86738e74400 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:20.774049 27665 raft_consensus.cc:2468] T 7b77a53b493f4e979fdf38a0b17176b0 P 41268b218b804905a110c86738e74400 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2513a663afac495eb09126ff55e8b2b0 in term 1.
I20260709 13:08:20.781239 27935 raft_consensus.cc:515] T 866a01285ca8436385f8d16dcfb0d4e3 P 41268b218b804905a110c86738e74400 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2513a663afac495eb09126ff55e8b2b0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40721 } } peers { permanent_uuid: "41268b218b804905a110c86738e74400" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 44403 } } peers { permanent_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 38749 } }
I20260709 13:08:20.787201 27957 consensus_queue.cc:1048] T 18f991bbbf3a4615aab49899c7ef86dc P 2513a663afac495eb09126ff55e8b2b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 38749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:08:20.787746 27592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "866a01285ca8436385f8d16dcfb0d4e3" candidate_uuid: "41268b218b804905a110c86738e74400" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2513a663afac495eb09126ff55e8b2b0"
W20260709 13:08:20.789565 27631 leader_election.cc:343] T 866a01285ca8436385f8d16dcfb0d4e3 P 41268b218b804905a110c86738e74400 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 2513a663afac495eb09126ff55e8b2b0 (127.17.223.1:40721): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:20.789855 27559 leader_election.cc:304] T 7b77a53b493f4e979fdf38a0b17176b0 P 2513a663afac495eb09126ff55e8b2b0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2513a663afac495eb09126ff55e8b2b0, 41268b218b804905a110c86738e74400; no voters: 
I20260709 13:08:20.791878 27862 tablet_bootstrap.cc:492] T 11224ef6c00a40cdba4311ceb63bddb9 P 665f7e09521a4c3f9284c1d8b0e094ff: No bootstrap required, opened a new log
I20260709 13:08:20.792395 27862 ts_tablet_manager.cc:1403] T 11224ef6c00a40cdba4311ceb63bddb9 P 665f7e09521a4c3f9284c1d8b0e094ff: Time spent bootstrapping tablet: real 0.138s	user 0.015s	sys 0.044s
I20260709 13:08:20.795162 27742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "866a01285ca8436385f8d16dcfb0d4e3" candidate_uuid: "41268b218b804905a110c86738e74400" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "665f7e09521a4c3f9284c1d8b0e094ff"
I20260709 13:08:20.796021 27742 raft_consensus.cc:3060] T 866a01285ca8436385f8d16dcfb0d4e3 P 665f7e09521a4c3f9284c1d8b0e094ff [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:20.796501 27898 leader_election.cc:290] T 7b77a53b493f4e979fdf38a0b17176b0 P 2513a663afac495eb09126ff55e8b2b0 [CANDIDATE]: Term 1 election: Requested vote from peers 41268b218b804905a110c86738e74400 (127.17.223.2:44403), 665f7e09521a4c3f9284c1d8b0e094ff (127.17.223.3:38749)
I20260709 13:08:20.795236 27862 raft_consensus.cc:359] T 11224ef6c00a40cdba4311ceb63bddb9 P 665f7e09521a4c3f9284c1d8b0e094ff [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 38749 } } peers { permanent_uuid: "18435fbb525741328139e84a1e354954" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 40545 } } peers { permanent_uuid: "2513a663afac495eb09126ff55e8b2b0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40721 } }
I20260709 13:08:20.798059 27740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b77a53b493f4e979fdf38a0b17176b0" candidate_uuid: "2513a663afac495eb09126ff55e8b2b0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "665f7e09521a4c3f9284c1d8b0e094ff"
I20260709 13:08:20.798906 27740 raft_consensus.cc:3060] T 7b77a53b493f4e979fdf38a0b17176b0 P 665f7e09521a4c3f9284c1d8b0e094ff [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:20.795428 27957 raft_consensus.cc:2804] T 7b77a53b493f4e979fdf38a0b17176b0 P 2513a663afac495eb09126ff55e8b2b0 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:08:20.799491 27957 raft_consensus.cc:697] T 7b77a53b493f4e979fdf38a0b17176b0 P 2513a663afac495eb09126ff55e8b2b0 [term 1 LEADER]: Becoming Leader. State: Replica: 2513a663afac495eb09126ff55e8b2b0, State: Running, Role: LEADER
I20260709 13:08:20.800356 27957 consensus_queue.cc:237] T 7b77a53b493f4e979fdf38a0b17176b0 P 2513a663afac495eb09126ff55e8b2b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2513a663afac495eb09126ff55e8b2b0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40721 } } peers { permanent_uuid: "41268b218b804905a110c86738e74400" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 44403 } } peers { permanent_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 38749 } }
I20260709 13:08:20.803728 27870 raft_consensus.cc:493] T 11224ef6c00a40cdba4311ceb63bddb9 P 2513a663afac495eb09126ff55e8b2b0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:20.804226 27870 raft_consensus.cc:515] T 11224ef6c00a40cdba4311ceb63bddb9 P 2513a663afac495eb09126ff55e8b2b0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 38749 } } peers { permanent_uuid: "18435fbb525741328139e84a1e354954" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 40545 } } peers { permanent_uuid: "2513a663afac495eb09126ff55e8b2b0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40721 } }
I20260709 13:08:20.806286 27870 leader_election.cc:290] T 11224ef6c00a40cdba4311ceb63bddb9 P 2513a663afac495eb09126ff55e8b2b0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 665f7e09521a4c3f9284c1d8b0e094ff (127.17.223.3:38749), 18435fbb525741328139e84a1e354954 (127.17.223.4:40545)
I20260709 13:08:20.808192 27739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11224ef6c00a40cdba4311ceb63bddb9" candidate_uuid: "2513a663afac495eb09126ff55e8b2b0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" is_pre_election: true
I20260709 13:08:20.808251 27816 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11224ef6c00a40cdba4311ceb63bddb9" candidate_uuid: "2513a663afac495eb09126ff55e8b2b0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "18435fbb525741328139e84a1e354954" is_pre_election: true
I20260709 13:08:20.798079 27862 raft_consensus.cc:385] T 11224ef6c00a40cdba4311ceb63bddb9 P 665f7e09521a4c3f9284c1d8b0e094ff [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:20.806764 27740 raft_consensus.cc:2468] T 7b77a53b493f4e979fdf38a0b17176b0 P 665f7e09521a4c3f9284c1d8b0e094ff [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2513a663afac495eb09126ff55e8b2b0 in term 1.
I20260709 13:08:20.809221 27816 raft_consensus.cc:2468] T 11224ef6c00a40cdba4311ceb63bddb9 P 18435fbb525741328139e84a1e354954 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2513a663afac495eb09126ff55e8b2b0 in term 0.
I20260709 13:08:20.809237 27862 raft_consensus.cc:740] T 11224ef6c00a40cdba4311ceb63bddb9 P 665f7e09521a4c3f9284c1d8b0e094ff [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 665f7e09521a4c3f9284c1d8b0e094ff, State: Initialized, Role: FOLLOWER
I20260709 13:08:20.810835 27559 leader_election.cc:304] T 11224ef6c00a40cdba4311ceb63bddb9 P 2513a663afac495eb09126ff55e8b2b0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 18435fbb525741328139e84a1e354954, 2513a663afac495eb09126ff55e8b2b0; no voters: 
I20260709 13:08:20.811827 27898 raft_consensus.cc:2804] T 11224ef6c00a40cdba4311ceb63bddb9 P 2513a663afac495eb09126ff55e8b2b0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:08:20.812242 27898 raft_consensus.cc:493] T 11224ef6c00a40cdba4311ceb63bddb9 P 2513a663afac495eb09126ff55e8b2b0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:20.812638 27898 raft_consensus.cc:3060] T 11224ef6c00a40cdba4311ceb63bddb9 P 2513a663afac495eb09126ff55e8b2b0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:20.814617 27865 tablet_bootstrap.cc:492] T df06af11cae7484d969017fcb5b7e753 P 18435fbb525741328139e84a1e354954: No bootstrap required, opened a new log
I20260709 13:08:20.816964 27865 ts_tablet_manager.cc:1403] T df06af11cae7484d969017fcb5b7e753 P 18435fbb525741328139e84a1e354954: Time spent bootstrapping tablet: real 0.197s	user 0.015s	sys 0.026s
I20260709 13:08:20.810568 27742 raft_consensus.cc:2468] T 866a01285ca8436385f8d16dcfb0d4e3 P 665f7e09521a4c3f9284c1d8b0e094ff [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 41268b218b804905a110c86738e74400 in term 1.
I20260709 13:08:20.819693 27634 leader_election.cc:304] T 866a01285ca8436385f8d16dcfb0d4e3 P 41268b218b804905a110c86738e74400 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 41268b218b804905a110c86738e74400, 665f7e09521a4c3f9284c1d8b0e094ff; no voters: 2513a663afac495eb09126ff55e8b2b0
I20260709 13:08:20.819837 27862 consensus_queue.cc:260] T 11224ef6c00a40cdba4311ceb63bddb9 P 665f7e09521a4c3f9284c1d8b0e094ff [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 38749 } } peers { permanent_uuid: "18435fbb525741328139e84a1e354954" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 40545 } } peers { permanent_uuid: "2513a663afac495eb09126ff55e8b2b0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40721 } }
I20260709 13:08:20.820734 27982 raft_consensus.cc:2804] T 866a01285ca8436385f8d16dcfb0d4e3 P 41268b218b804905a110c86738e74400 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:08:20.820914 27739 raft_consensus.cc:2468] T 11224ef6c00a40cdba4311ceb63bddb9 P 665f7e09521a4c3f9284c1d8b0e094ff [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2513a663afac495eb09126ff55e8b2b0 in term 0.
I20260709 13:08:20.821285 27982 raft_consensus.cc:697] T 866a01285ca8436385f8d16dcfb0d4e3 P 41268b218b804905a110c86738e74400 [term 1 LEADER]: Becoming Leader. State: Replica: 41268b218b804905a110c86738e74400, State: Running, Role: LEADER
I20260709 13:08:20.822227 27862 ts_tablet_manager.cc:1434] T 11224ef6c00a40cdba4311ceb63bddb9 P 665f7e09521a4c3f9284c1d8b0e094ff: Time spent starting tablet: real 0.030s	user 0.006s	sys 0.000s
I20260709 13:08:20.822180 27982 consensus_queue.cc:237] T 866a01285ca8436385f8d16dcfb0d4e3 P 41268b218b804905a110c86738e74400 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2513a663afac495eb09126ff55e8b2b0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40721 } } peers { permanent_uuid: "41268b218b804905a110c86738e74400" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 44403 } } peers { permanent_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 38749 } }
I20260709 13:08:20.824558 27862 tablet_bootstrap.cc:492] T 68cc2880cf79462c99d9009957eb5fd2 P 665f7e09521a4c3f9284c1d8b0e094ff: Bootstrap starting.
I20260709 13:08:20.826900 27863 tablet_bootstrap.cc:492] T 15a4c537259e4b2882a5cc8e723b260a P 41268b218b804905a110c86738e74400: No bootstrap required, opened a new log
I20260709 13:08:20.827358 27863 ts_tablet_manager.cc:1403] T 15a4c537259e4b2882a5cc8e723b260a P 41268b218b804905a110c86738e74400: Time spent bootstrapping tablet: real 0.144s	user 0.030s	sys 0.039s
I20260709 13:08:20.833299 27898 raft_consensus.cc:515] T 11224ef6c00a40cdba4311ceb63bddb9 P 2513a663afac495eb09126ff55e8b2b0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 38749 } } peers { permanent_uuid: "18435fbb525741328139e84a1e354954" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 40545 } } peers { permanent_uuid: "2513a663afac495eb09126ff55e8b2b0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40721 } }
I20260709 13:08:20.839308 27742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11224ef6c00a40cdba4311ceb63bddb9" candidate_uuid: "2513a663afac495eb09126ff55e8b2b0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "665f7e09521a4c3f9284c1d8b0e094ff"
I20260709 13:08:20.839184 27863 raft_consensus.cc:359] T 15a4c537259e4b2882a5cc8e723b260a P 41268b218b804905a110c86738e74400 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18435fbb525741328139e84a1e354954" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 40545 } } peers { permanent_uuid: "2513a663afac495eb09126ff55e8b2b0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40721 } } peers { permanent_uuid: "41268b218b804905a110c86738e74400" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 44403 } }
I20260709 13:08:20.839653 27816 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11224ef6c00a40cdba4311ceb63bddb9" candidate_uuid: "2513a663afac495eb09126ff55e8b2b0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "18435fbb525741328139e84a1e354954"
I20260709 13:08:20.840024 27863 raft_consensus.cc:385] T 15a4c537259e4b2882a5cc8e723b260a P 41268b218b804905a110c86738e74400 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:20.840381 27863 raft_consensus.cc:740] T 15a4c537259e4b2882a5cc8e723b260a P 41268b218b804905a110c86738e74400 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 41268b218b804905a110c86738e74400, State: Initialized, Role: FOLLOWER
I20260709 13:08:20.841543 27816 raft_consensus.cc:3060] T 11224ef6c00a40cdba4311ceb63bddb9 P 18435fbb525741328139e84a1e354954 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:20.842157 27863 consensus_queue.cc:260] T 15a4c537259e4b2882a5cc8e723b260a P 41268b218b804905a110c86738e74400 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18435fbb525741328139e84a1e354954" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 40545 } } peers { permanent_uuid: "2513a663afac495eb09126ff55e8b2b0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40721 } } peers { permanent_uuid: "41268b218b804905a110c86738e74400" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 44403 } }
I20260709 13:08:20.844435 27865 raft_consensus.cc:359] T df06af11cae7484d969017fcb5b7e753 P 18435fbb525741328139e84a1e354954 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "41268b218b804905a110c86738e74400" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 44403 } } peers { permanent_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 38749 } } peers { permanent_uuid: "18435fbb525741328139e84a1e354954" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 40545 } }
I20260709 13:08:20.849529 27865 raft_consensus.cc:385] T df06af11cae7484d969017fcb5b7e753 P 18435fbb525741328139e84a1e354954 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:20.850147 27863 ts_tablet_manager.cc:1434] T 15a4c537259e4b2882a5cc8e723b260a P 41268b218b804905a110c86738e74400: Time spent starting tablet: real 0.023s	user 0.008s	sys 0.000s
I20260709 13:08:20.849052 27935 leader_election.cc:290] T 866a01285ca8436385f8d16dcfb0d4e3 P 41268b218b804905a110c86738e74400 [CANDIDATE]: Term 1 election: Requested vote from peers 2513a663afac495eb09126ff55e8b2b0 (127.17.223.1:40721), 665f7e09521a4c3f9284c1d8b0e094ff (127.17.223.3:38749)
I20260709 13:08:20.849874 27865 raft_consensus.cc:740] T df06af11cae7484d969017fcb5b7e753 P 18435fbb525741328139e84a1e354954 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 18435fbb525741328139e84a1e354954, State: Initialized, Role: FOLLOWER
I20260709 13:08:20.854398 27861 tablet_bootstrap.cc:492] T 765d0bd527c64f74be713c390a018bba P 2513a663afac495eb09126ff55e8b2b0: No bootstrap required, opened a new log
I20260709 13:08:20.854934 27861 ts_tablet_manager.cc:1403] T 765d0bd527c64f74be713c390a018bba P 2513a663afac495eb09126ff55e8b2b0: Time spent bootstrapping tablet: real 0.172s	user 0.020s	sys 0.019s
I20260709 13:08:20.851698 27488 catalog_manager.cc:5697] T 866a01285ca8436385f8d16dcfb0d4e3 P 41268b218b804905a110c86738e74400 reported cstate change: term changed from 0 to 1, leader changed from <none> to 41268b218b804905a110c86738e74400 (127.17.223.2). New cstate: current_term: 1 leader_uuid: "41268b218b804905a110c86738e74400" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2513a663afac495eb09126ff55e8b2b0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40721 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "41268b218b804905a110c86738e74400" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 44403 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 38749 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:20.855327 27865 consensus_queue.cc:260] T df06af11cae7484d969017fcb5b7e753 P 18435fbb525741328139e84a1e354954 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "41268b218b804905a110c86738e74400" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 44403 } } peers { permanent_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 38749 } } peers { permanent_uuid: "18435fbb525741328139e84a1e354954" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 40545 } }
I20260709 13:08:20.840022 27742 raft_consensus.cc:3060] T 11224ef6c00a40cdba4311ceb63bddb9 P 665f7e09521a4c3f9284c1d8b0e094ff [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:20.858839 27816 raft_consensus.cc:2468] T 11224ef6c00a40cdba4311ceb63bddb9 P 18435fbb525741328139e84a1e354954 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2513a663afac495eb09126ff55e8b2b0 in term 1.
I20260709 13:08:20.860342 27863 tablet_bootstrap.cc:492] T 765d0bd527c64f74be713c390a018bba P 41268b218b804905a110c86738e74400: Bootstrap starting.
I20260709 13:08:20.862848 27862 tablet_bootstrap.cc:654] T 68cc2880cf79462c99d9009957eb5fd2 P 665f7e09521a4c3f9284c1d8b0e094ff: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:20.840196 27898 leader_election.cc:290] T 11224ef6c00a40cdba4311ceb63bddb9 P 2513a663afac495eb09126ff55e8b2b0 [CANDIDATE]: Term 1 election: Requested vote from peers 665f7e09521a4c3f9284c1d8b0e094ff (127.17.223.3:38749), 18435fbb525741328139e84a1e354954 (127.17.223.4:40545)
I20260709 13:08:20.865173 27861 raft_consensus.cc:359] T 765d0bd527c64f74be713c390a018bba P 2513a663afac495eb09126ff55e8b2b0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2513a663afac495eb09126ff55e8b2b0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40721 } } peers { permanent_uuid: "41268b218b804905a110c86738e74400" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 44403 } } peers { permanent_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 38749 } }
I20260709 13:08:20.867085 27861 raft_consensus.cc:385] T 765d0bd527c64f74be713c390a018bba P 2513a663afac495eb09126ff55e8b2b0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:20.866194 27559 leader_election.cc:304] T 11224ef6c00a40cdba4311ceb63bddb9 P 2513a663afac495eb09126ff55e8b2b0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 18435fbb525741328139e84a1e354954, 2513a663afac495eb09126ff55e8b2b0; no voters: 
I20260709 13:08:20.870188 27898 raft_consensus.cc:2804] T 11224ef6c00a40cdba4311ceb63bddb9 P 2513a663afac495eb09126ff55e8b2b0 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:08:20.871284 27898 raft_consensus.cc:697] T 11224ef6c00a40cdba4311ceb63bddb9 P 2513a663afac495eb09126ff55e8b2b0 [term 1 LEADER]: Becoming Leader. State: Replica: 2513a663afac495eb09126ff55e8b2b0, State: Running, Role: LEADER
I20260709 13:08:20.872104 27898 consensus_queue.cc:237] T 11224ef6c00a40cdba4311ceb63bddb9 P 2513a663afac495eb09126ff55e8b2b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 38749 } } peers { permanent_uuid: "18435fbb525741328139e84a1e354954" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 40545 } } peers { permanent_uuid: "2513a663afac495eb09126ff55e8b2b0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40721 } }
I20260709 13:08:20.874248 27863 tablet_bootstrap.cc:654] T 765d0bd527c64f74be713c390a018bba P 41268b218b804905a110c86738e74400: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:20.867426 27861 raft_consensus.cc:740] T 765d0bd527c64f74be713c390a018bba P 2513a663afac495eb09126ff55e8b2b0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2513a663afac495eb09126ff55e8b2b0, State: Initialized, Role: FOLLOWER
I20260709 13:08:20.877795 27861 consensus_queue.cc:260] T 765d0bd527c64f74be713c390a018bba P 2513a663afac495eb09126ff55e8b2b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2513a663afac495eb09126ff55e8b2b0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40721 } } peers { permanent_uuid: "41268b218b804905a110c86738e74400" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 44403 } } peers { permanent_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 38749 } }
I20260709 13:08:20.880607 27865 ts_tablet_manager.cc:1434] T df06af11cae7484d969017fcb5b7e753 P 18435fbb525741328139e84a1e354954: Time spent starting tablet: real 0.063s	user 0.007s	sys 0.000s
I20260709 13:08:20.881747 27865 tablet_bootstrap.cc:492] T 68cc2880cf79462c99d9009957eb5fd2 P 18435fbb525741328139e84a1e354954: Bootstrap starting.
I20260709 13:08:20.882803 27861 ts_tablet_manager.cc:1434] T 765d0bd527c64f74be713c390a018bba P 2513a663afac495eb09126ff55e8b2b0: Time spent starting tablet: real 0.028s	user 0.007s	sys 0.000s
I20260709 13:08:20.884605 27861 tablet_bootstrap.cc:492] T 866a01285ca8436385f8d16dcfb0d4e3 P 2513a663afac495eb09126ff55e8b2b0: Bootstrap starting.
I20260709 13:08:20.889046 27935 consensus_queue.cc:1048] T de531c50b1524ec788b27bc4b883689a P 41268b218b804905a110c86738e74400 [LEADER]: Connected to new peer: Peer: permanent_uuid: "18435fbb525741328139e84a1e354954" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 40545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:08:20.871285 27489 catalog_manager.cc:5697] T 7b77a53b493f4e979fdf38a0b17176b0 P 2513a663afac495eb09126ff55e8b2b0 reported cstate change: term changed from 0 to 1, leader changed from <none> to 2513a663afac495eb09126ff55e8b2b0 (127.17.223.1). New cstate: current_term: 1 leader_uuid: "2513a663afac495eb09126ff55e8b2b0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2513a663afac495eb09126ff55e8b2b0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40721 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "41268b218b804905a110c86738e74400" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 44403 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 38749 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:20.892868 27742 raft_consensus.cc:2468] T 11224ef6c00a40cdba4311ceb63bddb9 P 665f7e09521a4c3f9284c1d8b0e094ff [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2513a663afac495eb09126ff55e8b2b0 in term 1.
I20260709 13:08:20.898485 27861 tablet_bootstrap.cc:654] T 866a01285ca8436385f8d16dcfb0d4e3 P 2513a663afac495eb09126ff55e8b2b0: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:20.898988 27982 raft_consensus.cc:493] T 68cc2880cf79462c99d9009957eb5fd2 P 41268b218b804905a110c86738e74400 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:20.901225 27865 tablet_bootstrap.cc:654] T 68cc2880cf79462c99d9009957eb5fd2 P 18435fbb525741328139e84a1e354954: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:20.900846 27982 raft_consensus.cc:515] T 68cc2880cf79462c99d9009957eb5fd2 P 41268b218b804905a110c86738e74400 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "41268b218b804905a110c86738e74400" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 44403 } } peers { permanent_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 38749 } } peers { permanent_uuid: "18435fbb525741328139e84a1e354954" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 40545 } }
I20260709 13:08:20.902946 27982 leader_election.cc:290] T 68cc2880cf79462c99d9009957eb5fd2 P 41268b218b804905a110c86738e74400 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 665f7e09521a4c3f9284c1d8b0e094ff (127.17.223.3:38749), 18435fbb525741328139e84a1e354954 (127.17.223.4:40545)
I20260709 13:08:20.908018 27813 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68cc2880cf79462c99d9009957eb5fd2" candidate_uuid: "41268b218b804905a110c86738e74400" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "18435fbb525741328139e84a1e354954" is_pre_election: true
W20260709 13:08:20.910751 27634 leader_election.cc:343] T 68cc2880cf79462c99d9009957eb5fd2 P 41268b218b804905a110c86738e74400 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 18435fbb525741328139e84a1e354954 (127.17.223.4:40545): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:20.914049 27862 tablet_bootstrap.cc:492] T 68cc2880cf79462c99d9009957eb5fd2 P 665f7e09521a4c3f9284c1d8b0e094ff: No bootstrap required, opened a new log
I20260709 13:08:20.914602 27862 ts_tablet_manager.cc:1403] T 68cc2880cf79462c99d9009957eb5fd2 P 665f7e09521a4c3f9284c1d8b0e094ff: Time spent bootstrapping tablet: real 0.090s	user 0.007s	sys 0.010s
I20260709 13:08:20.917341 27862 raft_consensus.cc:359] T 68cc2880cf79462c99d9009957eb5fd2 P 665f7e09521a4c3f9284c1d8b0e094ff [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "41268b218b804905a110c86738e74400" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 44403 } } peers { permanent_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 38749 } } peers { permanent_uuid: "18435fbb525741328139e84a1e354954" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 40545 } }
I20260709 13:08:20.918001 27862 raft_consensus.cc:385] T 68cc2880cf79462c99d9009957eb5fd2 P 665f7e09521a4c3f9284c1d8b0e094ff [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:20.918286 27862 raft_consensus.cc:740] T 68cc2880cf79462c99d9009957eb5fd2 P 665f7e09521a4c3f9284c1d8b0e094ff [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 665f7e09521a4c3f9284c1d8b0e094ff, State: Initialized, Role: FOLLOWER
I20260709 13:08:20.921391 27863 tablet_bootstrap.cc:492] T 765d0bd527c64f74be713c390a018bba P 41268b218b804905a110c86738e74400: No bootstrap required, opened a new log
I20260709 13:08:20.921976 27863 ts_tablet_manager.cc:1403] T 765d0bd527c64f74be713c390a018bba P 41268b218b804905a110c86738e74400: Time spent bootstrapping tablet: real 0.062s	user 0.016s	sys 0.001s
I20260709 13:08:20.924906 27863 raft_consensus.cc:359] T 765d0bd527c64f74be713c390a018bba P 41268b218b804905a110c86738e74400 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2513a663afac495eb09126ff55e8b2b0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40721 } } peers { permanent_uuid: "41268b218b804905a110c86738e74400" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 44403 } } peers { permanent_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 38749 } }
I20260709 13:08:20.925604 27863 raft_consensus.cc:385] T 765d0bd527c64f74be713c390a018bba P 41268b218b804905a110c86738e74400 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:20.925877 27863 raft_consensus.cc:740] T 765d0bd527c64f74be713c390a018bba P 41268b218b804905a110c86738e74400 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 41268b218b804905a110c86738e74400, State: Initialized, Role: FOLLOWER
I20260709 13:08:20.927466 27862 consensus_queue.cc:260] T 68cc2880cf79462c99d9009957eb5fd2 P 665f7e09521a4c3f9284c1d8b0e094ff [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "41268b218b804905a110c86738e74400" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 44403 } } peers { permanent_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 38749 } } peers { permanent_uuid: "18435fbb525741328139e84a1e354954" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 40545 } }
I20260709 13:08:20.930467 27865 tablet_bootstrap.cc:492] T 68cc2880cf79462c99d9009957eb5fd2 P 18435fbb525741328139e84a1e354954: No bootstrap required, opened a new log
I20260709 13:08:20.931037 27865 ts_tablet_manager.cc:1403] T 68cc2880cf79462c99d9009957eb5fd2 P 18435fbb525741328139e84a1e354954: Time spent bootstrapping tablet: real 0.050s	user 0.007s	sys 0.004s
I20260709 13:08:20.933748 27863 consensus_queue.cc:260] T 765d0bd527c64f74be713c390a018bba P 41268b218b804905a110c86738e74400 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2513a663afac495eb09126ff55e8b2b0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40721 } } peers { permanent_uuid: "41268b218b804905a110c86738e74400" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 44403 } } peers { permanent_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 38749 } }
I20260709 13:08:20.937134 27865 raft_consensus.cc:359] T 68cc2880cf79462c99d9009957eb5fd2 P 18435fbb525741328139e84a1e354954 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "41268b218b804905a110c86738e74400" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 44403 } } peers { permanent_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 38749 } } peers { permanent_uuid: "18435fbb525741328139e84a1e354954" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 40545 } }
I20260709 13:08:20.937865 27865 raft_consensus.cc:385] T 68cc2880cf79462c99d9009957eb5fd2 P 18435fbb525741328139e84a1e354954 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:20.938131 27865 raft_consensus.cc:740] T 68cc2880cf79462c99d9009957eb5fd2 P 18435fbb525741328139e84a1e354954 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 18435fbb525741328139e84a1e354954, State: Initialized, Role: FOLLOWER
I20260709 13:08:20.942662 27982 consensus_queue.cc:1048] T de531c50b1524ec788b27bc4b883689a P 41268b218b804905a110c86738e74400 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2513a663afac495eb09126ff55e8b2b0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40721 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:08:20.947424 27742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68cc2880cf79462c99d9009957eb5fd2" candidate_uuid: "41268b218b804905a110c86738e74400" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" is_pre_election: true
I20260709 13:08:20.957567 27742 raft_consensus.cc:2468] T 68cc2880cf79462c99d9009957eb5fd2 P 665f7e09521a4c3f9284c1d8b0e094ff [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 41268b218b804905a110c86738e74400 in term 0.
I20260709 13:08:20.958432 27862 ts_tablet_manager.cc:1434] T 68cc2880cf79462c99d9009957eb5fd2 P 665f7e09521a4c3f9284c1d8b0e094ff: Time spent starting tablet: real 0.044s	user 0.006s	sys 0.000s
I20260709 13:08:20.960464 27865 consensus_queue.cc:260] T 68cc2880cf79462c99d9009957eb5fd2 P 18435fbb525741328139e84a1e354954 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "41268b218b804905a110c86738e74400" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 44403 } } peers { permanent_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 38749 } } peers { permanent_uuid: "18435fbb525741328139e84a1e354954" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 40545 } }
I20260709 13:08:20.957592 27863 ts_tablet_manager.cc:1434] T 765d0bd527c64f74be713c390a018bba P 41268b218b804905a110c86738e74400: Time spent starting tablet: real 0.035s	user 0.003s	sys 0.004s
I20260709 13:08:20.962978 27813 raft_consensus.cc:3060] T a9eac7f072de454a8ff2beb019da45d9 P 18435fbb525741328139e84a1e354954 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:20.961880 27634 leader_election.cc:304] T 68cc2880cf79462c99d9009957eb5fd2 P 41268b218b804905a110c86738e74400 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 41268b218b804905a110c86738e74400, 665f7e09521a4c3f9284c1d8b0e094ff; no voters: 18435fbb525741328139e84a1e354954
I20260709 13:08:20.964079 27982 raft_consensus.cc:2804] T 68cc2880cf79462c99d9009957eb5fd2 P 41268b218b804905a110c86738e74400 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:08:20.964447 27982 raft_consensus.cc:493] T 68cc2880cf79462c99d9009957eb5fd2 P 41268b218b804905a110c86738e74400 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:20.964778 27982 raft_consensus.cc:3060] T 68cc2880cf79462c99d9009957eb5fd2 P 41268b218b804905a110c86738e74400 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:20.972783 27982 raft_consensus.cc:515] T 68cc2880cf79462c99d9009957eb5fd2 P 41268b218b804905a110c86738e74400 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "41268b218b804905a110c86738e74400" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 44403 } } peers { permanent_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 38749 } } peers { permanent_uuid: "18435fbb525741328139e84a1e354954" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 40545 } }
I20260709 13:08:20.974027 27865 ts_tablet_manager.cc:1434] T 68cc2880cf79462c99d9009957eb5fd2 P 18435fbb525741328139e84a1e354954: Time spent starting tablet: real 0.043s	user 0.006s	sys 0.001s
I20260709 13:08:20.975162 27862 tablet_bootstrap.cc:492] T c9ea919812394c7aba307c2ff5b81f51 P 665f7e09521a4c3f9284c1d8b0e094ff: Bootstrap starting.
I20260709 13:08:20.977209 27982 leader_election.cc:290] T 68cc2880cf79462c99d9009957eb5fd2 P 41268b218b804905a110c86738e74400 [CANDIDATE]: Term 1 election: Requested vote from peers 665f7e09521a4c3f9284c1d8b0e094ff (127.17.223.3:38749), 18435fbb525741328139e84a1e354954 (127.17.223.4:40545)
I20260709 13:08:20.979431 27741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68cc2880cf79462c99d9009957eb5fd2" candidate_uuid: "41268b218b804905a110c86738e74400" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "665f7e09521a4c3f9284c1d8b0e094ff"
I20260709 13:08:20.980079 27741 raft_consensus.cc:3060] T 68cc2880cf79462c99d9009957eb5fd2 P 665f7e09521a4c3f9284c1d8b0e094ff [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:20.987159 27814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68cc2880cf79462c99d9009957eb5fd2" candidate_uuid: "41268b218b804905a110c86738e74400" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "18435fbb525741328139e84a1e354954"
I20260709 13:08:20.987610 27964 raft_consensus.cc:493] T 68cc2880cf79462c99d9009957eb5fd2 P 18435fbb525741328139e84a1e354954 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:20.988304 27741 raft_consensus.cc:2468] T 68cc2880cf79462c99d9009957eb5fd2 P 665f7e09521a4c3f9284c1d8b0e094ff [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 41268b218b804905a110c86738e74400 in term 1.
I20260709 13:08:20.988133 27964 raft_consensus.cc:515] T 68cc2880cf79462c99d9009957eb5fd2 P 18435fbb525741328139e84a1e354954 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "41268b218b804905a110c86738e74400" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 44403 } } peers { permanent_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 38749 } } peers { permanent_uuid: "18435fbb525741328139e84a1e354954" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 40545 } }
I20260709 13:08:20.988729 27865 tablet_bootstrap.cc:492] T 15a4c537259e4b2882a5cc8e723b260a P 18435fbb525741328139e84a1e354954: Bootstrap starting.
I20260709 13:08:20.990226 27964 leader_election.cc:290] T 68cc2880cf79462c99d9009957eb5fd2 P 18435fbb525741328139e84a1e354954 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 41268b218b804905a110c86738e74400 (127.17.223.2:44403), 665f7e09521a4c3f9284c1d8b0e094ff (127.17.223.3:38749)
I20260709 13:08:20.991456 27814 raft_consensus.cc:3060] T 68cc2880cf79462c99d9009957eb5fd2 P 18435fbb525741328139e84a1e354954 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:20.993366 27739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68cc2880cf79462c99d9009957eb5fd2" candidate_uuid: "18435fbb525741328139e84a1e354954" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" is_pre_election: true
I20260709 13:08:20.995625 27665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68cc2880cf79462c99d9009957eb5fd2" candidate_uuid: "18435fbb525741328139e84a1e354954" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "41268b218b804905a110c86738e74400" is_pre_election: true
I20260709 13:08:20.996414 27665 raft_consensus.cc:2393] T 68cc2880cf79462c99d9009957eb5fd2 P 41268b218b804905a110c86738e74400 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 18435fbb525741328139e84a1e354954 in current term 1: Already voted for candidate 41268b218b804905a110c86738e74400 in this term.
I20260709 13:08:20.998492 27865 tablet_bootstrap.cc:654] T 15a4c537259e4b2882a5cc8e723b260a P 18435fbb525741328139e84a1e354954: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:21.003204 27964 consensus_queue.cc:1048] T 56803a5c0dea4efeabafb6829d9215cd P 18435fbb525741328139e84a1e354954 [LEADER]: Connected to new peer: Peer: permanent_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 38749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.007s
I20260709 13:08:21.014819 27782 leader_election.cc:304] T 68cc2880cf79462c99d9009957eb5fd2 P 18435fbb525741328139e84a1e354954 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 18435fbb525741328139e84a1e354954; no voters: 41268b218b804905a110c86738e74400, 665f7e09521a4c3f9284c1d8b0e094ff
W20260709 13:08:21.017022 27539 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:08:21.018976 27814 raft_consensus.cc:2468] T 68cc2880cf79462c99d9009957eb5fd2 P 18435fbb525741328139e84a1e354954 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 41268b218b804905a110c86738e74400 in term 1.
I20260709 13:08:21.025436 27861 tablet_bootstrap.cc:492] T 866a01285ca8436385f8d16dcfb0d4e3 P 2513a663afac495eb09126ff55e8b2b0: No bootstrap required, opened a new log
I20260709 13:08:21.025866 27861 ts_tablet_manager.cc:1403] T 866a01285ca8436385f8d16dcfb0d4e3 P 2513a663afac495eb09126ff55e8b2b0: Time spent bootstrapping tablet: real 0.142s	user 0.029s	sys 0.035s
I20260709 13:08:21.022832 27964 raft_consensus.cc:2749] T 68cc2880cf79462c99d9009957eb5fd2 P 18435fbb525741328139e84a1e354954 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:08:21.027971 27634 leader_election.cc:304] T 68cc2880cf79462c99d9009957eb5fd2 P 41268b218b804905a110c86738e74400 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 41268b218b804905a110c86738e74400, 665f7e09521a4c3f9284c1d8b0e094ff; no voters: 
I20260709 13:08:21.028461 27861 raft_consensus.cc:359] T 866a01285ca8436385f8d16dcfb0d4e3 P 2513a663afac495eb09126ff55e8b2b0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2513a663afac495eb09126ff55e8b2b0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40721 } } peers { permanent_uuid: "41268b218b804905a110c86738e74400" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 44403 } } peers { permanent_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 38749 } }
I20260709 13:08:21.030264 27863 tablet_bootstrap.cc:492] T 1d9bdb76a5094186b5ac6c8f8e1c9840 P 41268b218b804905a110c86738e74400: Bootstrap starting.
I20260709 13:08:21.030879 27861 raft_consensus.cc:385] T 866a01285ca8436385f8d16dcfb0d4e3 P 2513a663afac495eb09126ff55e8b2b0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:21.031637 27861 raft_consensus.cc:740] T 866a01285ca8436385f8d16dcfb0d4e3 P 2513a663afac495eb09126ff55e8b2b0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2513a663afac495eb09126ff55e8b2b0, State: Initialized, Role: FOLLOWER
I20260709 13:08:21.035053 27982 raft_consensus.cc:2804] T 68cc2880cf79462c99d9009957eb5fd2 P 41268b218b804905a110c86738e74400 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:08:21.035742 27982 raft_consensus.cc:697] T 68cc2880cf79462c99d9009957eb5fd2 P 41268b218b804905a110c86738e74400 [term 1 LEADER]: Becoming Leader. State: Replica: 41268b218b804905a110c86738e74400, State: Running, Role: LEADER
I20260709 13:08:21.029814 27491 catalog_manager.cc:5697] T 11224ef6c00a40cdba4311ceb63bddb9 P 2513a663afac495eb09126ff55e8b2b0 reported cstate change: term changed from 0 to 1, leader changed from <none> to 2513a663afac495eb09126ff55e8b2b0 (127.17.223.1). New cstate: current_term: 1 leader_uuid: "2513a663afac495eb09126ff55e8b2b0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 38749 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "18435fbb525741328139e84a1e354954" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 40545 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2513a663afac495eb09126ff55e8b2b0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40721 } health_report { overall_health: HEALTHY } } }
I20260709 13:08:21.036604 27982 consensus_queue.cc:237] T 68cc2880cf79462c99d9009957eb5fd2 P 41268b218b804905a110c86738e74400 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "41268b218b804905a110c86738e74400" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 44403 } } peers { permanent_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 38749 } } peers { permanent_uuid: "18435fbb525741328139e84a1e354954" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 40545 } }
I20260709 13:08:21.041608 27862 tablet_bootstrap.cc:654] T c9ea919812394c7aba307c2ff5b81f51 P 665f7e09521a4c3f9284c1d8b0e094ff: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:21.032284 27861 consensus_queue.cc:260] T 866a01285ca8436385f8d16dcfb0d4e3 P 2513a663afac495eb09126ff55e8b2b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2513a663afac495eb09126ff55e8b2b0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40721 } } peers { permanent_uuid: "41268b218b804905a110c86738e74400" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 44403 } } peers { permanent_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 38749 } }
I20260709 13:08:21.052209 27861 ts_tablet_manager.cc:1434] T 866a01285ca8436385f8d16dcfb0d4e3 P 2513a663afac495eb09126ff55e8b2b0: Time spent starting tablet: real 0.026s	user 0.007s	sys 0.000s
I20260709 13:08:21.059283 27861 tablet_bootstrap.cc:492] T c9ea919812394c7aba307c2ff5b81f51 P 2513a663afac495eb09126ff55e8b2b0: Bootstrap starting.
I20260709 13:08:21.076103 27862 tablet_bootstrap.cc:492] T c9ea919812394c7aba307c2ff5b81f51 P 665f7e09521a4c3f9284c1d8b0e094ff: No bootstrap required, opened a new log
I20260709 13:08:21.076700 27862 ts_tablet_manager.cc:1403] T c9ea919812394c7aba307c2ff5b81f51 P 665f7e09521a4c3f9284c1d8b0e094ff: Time spent bootstrapping tablet: real 0.113s	user 0.011s	sys 0.002s
I20260709 13:08:21.077716 27865 tablet_bootstrap.cc:492] T 15a4c537259e4b2882a5cc8e723b260a P 18435fbb525741328139e84a1e354954: No bootstrap required, opened a new log
I20260709 13:08:21.078333 27865 ts_tablet_manager.cc:1403] T 15a4c537259e4b2882a5cc8e723b260a P 18435fbb525741328139e84a1e354954: Time spent bootstrapping tablet: real 0.090s	user 0.012s	sys 0.023s
I20260709 13:08:21.078393 27863 tablet_bootstrap.cc:654] T 1d9bdb76a5094186b5ac6c8f8e1c9840 P 41268b218b804905a110c86738e74400: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:21.079557 27862 raft_consensus.cc:359] T c9ea919812394c7aba307c2ff5b81f51 P 665f7e09521a4c3f9284c1d8b0e094ff [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 38749 } } peers { permanent_uuid: "18435fbb525741328139e84a1e354954" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 40545 } } peers { permanent_uuid: "2513a663afac495eb09126ff55e8b2b0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40721 } }
I20260709 13:08:21.080276 27862 raft_consensus.cc:385] T c9ea919812394c7aba307c2ff5b81f51 P 665f7e09521a4c3f9284c1d8b0e094ff [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:21.080549 27862 raft_consensus.cc:740] T c9ea919812394c7aba307c2ff5b81f51 P 665f7e09521a4c3f9284c1d8b0e094ff [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 665f7e09521a4c3f9284c1d8b0e094ff, State: Initialized, Role: FOLLOWER
I20260709 13:08:21.081991 27862 consensus_queue.cc:260] T c9ea919812394c7aba307c2ff5b81f51 P 665f7e09521a4c3f9284c1d8b0e094ff [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 38749 } } peers { permanent_uuid: "18435fbb525741328139e84a1e354954" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 40545 } } peers { permanent_uuid: "2513a663afac495eb09126ff55e8b2b0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40721 } }
I20260709 13:08:21.085294 27865 raft_consensus.cc:359] T 15a4c537259e4b2882a5cc8e723b260a P 18435fbb525741328139e84a1e354954 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18435fbb525741328139e84a1e354954" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 40545 } } peers { permanent_uuid: "2513a663afac495eb09126ff55e8b2b0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40721 } } peers { permanent_uuid: "41268b218b804905a110c86738e74400" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 44403 } }
I20260709 13:08:21.086102 27865 raft_consensus.cc:385] T 15a4c537259e4b2882a5cc8e723b260a P 18435fbb525741328139e84a1e354954 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:21.086444 27865 raft_consensus.cc:740] T 15a4c537259e4b2882a5cc8e723b260a P 18435fbb525741328139e84a1e354954 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 18435fbb525741328139e84a1e354954, State: Initialized, Role: FOLLOWER
I20260709 13:08:21.091236 27861 tablet_bootstrap.cc:654] T c9ea919812394c7aba307c2ff5b81f51 P 2513a663afac495eb09126ff55e8b2b0: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:21.099632 27862 ts_tablet_manager.cc:1434] T c9ea919812394c7aba307c2ff5b81f51 P 665f7e09521a4c3f9284c1d8b0e094ff: Time spent starting tablet: real 0.023s	user 0.002s	sys 0.006s
I20260709 13:08:21.100713 27862 tablet_bootstrap.cc:492] T df06af11cae7484d969017fcb5b7e753 P 665f7e09521a4c3f9284c1d8b0e094ff: Bootstrap starting.
I20260709 13:08:21.108196 27898 consensus_queue.cc:1048] T bc0b10615ecb4485a9a9de298938697d P 2513a663afac495eb09126ff55e8b2b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "41268b218b804905a110c86738e74400" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 44403 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:08:21.116683 27861 tablet_bootstrap.cc:492] T c9ea919812394c7aba307c2ff5b81f51 P 2513a663afac495eb09126ff55e8b2b0: No bootstrap required, opened a new log
I20260709 13:08:21.117206 27861 ts_tablet_manager.cc:1403] T c9ea919812394c7aba307c2ff5b81f51 P 2513a663afac495eb09126ff55e8b2b0: Time spent bootstrapping tablet: real 0.059s	user 0.009s	sys 0.000s
I20260709 13:08:21.117594 27863 tablet_bootstrap.cc:492] T 1d9bdb76a5094186b5ac6c8f8e1c9840 P 41268b218b804905a110c86738e74400: No bootstrap required, opened a new log
I20260709 13:08:21.118072 27863 ts_tablet_manager.cc:1403] T 1d9bdb76a5094186b5ac6c8f8e1c9840 P 41268b218b804905a110c86738e74400: Time spent bootstrapping tablet: real 0.106s	user 0.011s	sys 0.000s
I20260709 13:08:21.087226 27865 consensus_queue.cc:260] T 15a4c537259e4b2882a5cc8e723b260a P 18435fbb525741328139e84a1e354954 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18435fbb525741328139e84a1e354954" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 40545 } } peers { permanent_uuid: "2513a663afac495eb09126ff55e8b2b0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40721 } } peers { permanent_uuid: "41268b218b804905a110c86738e74400" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 44403 } }
I20260709 13:08:21.123517 27862 tablet_bootstrap.cc:654] T df06af11cae7484d969017fcb5b7e753 P 665f7e09521a4c3f9284c1d8b0e094ff: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:21.124828 27865 ts_tablet_manager.cc:1434] T 15a4c537259e4b2882a5cc8e723b260a P 18435fbb525741328139e84a1e354954: Time spent starting tablet: real 0.046s	user 0.008s	sys 0.000s
I20260709 13:08:21.125864 27865 tablet_bootstrap.cc:492] T e5847d81a5284a44a6b2b21cf6f4351c P 18435fbb525741328139e84a1e354954: Bootstrap starting.
I20260709 13:08:21.122766 27874 consensus_queue.cc:1048] T 56803a5c0dea4efeabafb6829d9215cd P 18435fbb525741328139e84a1e354954 [LEADER]: Connected to new peer: Peer: permanent_uuid: "41268b218b804905a110c86738e74400" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 44403 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:08:21.126727 27861 raft_consensus.cc:359] T c9ea919812394c7aba307c2ff5b81f51 P 2513a663afac495eb09126ff55e8b2b0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 38749 } } peers { permanent_uuid: "18435fbb525741328139e84a1e354954" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 40545 } } peers { permanent_uuid: "2513a663afac495eb09126ff55e8b2b0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40721 } }
I20260709 13:08:21.127458 27861 raft_consensus.cc:385] T c9ea919812394c7aba307c2ff5b81f51 P 2513a663afac495eb09126ff55e8b2b0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:21.127727 27861 raft_consensus.cc:740] T c9ea919812394c7aba307c2ff5b81f51 P 2513a663afac495eb09126ff55e8b2b0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2513a663afac495eb09126ff55e8b2b0, State: Initialized, Role: FOLLOWER
I20260709 13:08:21.128376 27861 consensus_queue.cc:260] T c9ea919812394c7aba307c2ff5b81f51 P 2513a663afac495eb09126ff55e8b2b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 38749 } } peers { permanent_uuid: "18435fbb525741328139e84a1e354954" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 40545 } } peers { permanent_uuid: "2513a663afac495eb09126ff55e8b2b0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40721 } }
I20260709 13:08:21.121112 27489 catalog_manager.cc:5697] T 68cc2880cf79462c99d9009957eb5fd2 P 41268b218b804905a110c86738e74400 reported cstate change: term changed from 0 to 1, leader changed from <none> to 41268b218b804905a110c86738e74400 (127.17.223.2). New cstate: current_term: 1 leader_uuid: "41268b218b804905a110c86738e74400" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "41268b218b804905a110c86738e74400" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 44403 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 38749 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "18435fbb525741328139e84a1e354954" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 40545 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:21.130415 27861 ts_tablet_manager.cc:1434] T c9ea919812394c7aba307c2ff5b81f51 P 2513a663afac495eb09126ff55e8b2b0: Time spent starting tablet: real 0.013s	user 0.005s	sys 0.000s
I20260709 13:08:21.138614 27898 consensus_queue.cc:1048] T bc0b10615ecb4485a9a9de298938697d P 2513a663afac495eb09126ff55e8b2b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "18435fbb525741328139e84a1e354954" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 40545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:08:21.141831 27863 raft_consensus.cc:359] T 1d9bdb76a5094186b5ac6c8f8e1c9840 P 41268b218b804905a110c86738e74400 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "41268b218b804905a110c86738e74400" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 44403 } } peers { permanent_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 38749 } } peers { permanent_uuid: "18435fbb525741328139e84a1e354954" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 40545 } }
I20260709 13:08:21.148321 27863 raft_consensus.cc:385] T 1d9bdb76a5094186b5ac6c8f8e1c9840 P 41268b218b804905a110c86738e74400 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:21.148720 27863 raft_consensus.cc:740] T 1d9bdb76a5094186b5ac6c8f8e1c9840 P 41268b218b804905a110c86738e74400 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 41268b218b804905a110c86738e74400, State: Initialized, Role: FOLLOWER
I20260709 13:08:21.147933 27861 tablet_bootstrap.cc:492] T 15a4c537259e4b2882a5cc8e723b260a P 2513a663afac495eb09126ff55e8b2b0: Bootstrap starting.
I20260709 13:08:21.156581 27874 consensus_queue.cc:1048] T 55a3afc21cea43ea85f4a2155552422d P 18435fbb525741328139e84a1e354954 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2513a663afac495eb09126ff55e8b2b0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40721 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:08:21.159538 27863 consensus_queue.cc:260] T 1d9bdb76a5094186b5ac6c8f8e1c9840 P 41268b218b804905a110c86738e74400 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "41268b218b804905a110c86738e74400" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 44403 } } peers { permanent_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 38749 } } peers { permanent_uuid: "18435fbb525741328139e84a1e354954" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 40545 } }
I20260709 13:08:21.162210 27863 ts_tablet_manager.cc:1434] T 1d9bdb76a5094186b5ac6c8f8e1c9840 P 41268b218b804905a110c86738e74400: Time spent starting tablet: real 0.044s	user 0.004s	sys 0.003s
I20260709 13:08:21.165948 27863 tablet_bootstrap.cc:492] T 5e6f8bdfe11b4af4aa27a711db7cbe7a P 41268b218b804905a110c86738e74400: Bootstrap starting.
I20260709 13:08:21.172181 27862 tablet_bootstrap.cc:492] T df06af11cae7484d969017fcb5b7e753 P 665f7e09521a4c3f9284c1d8b0e094ff: No bootstrap required, opened a new log
I20260709 13:08:21.172703 27862 ts_tablet_manager.cc:1403] T df06af11cae7484d969017fcb5b7e753 P 665f7e09521a4c3f9284c1d8b0e094ff: Time spent bootstrapping tablet: real 0.072s	user 0.008s	sys 0.001s
I20260709 13:08:21.175400 27862 raft_consensus.cc:359] T df06af11cae7484d969017fcb5b7e753 P 665f7e09521a4c3f9284c1d8b0e094ff [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "41268b218b804905a110c86738e74400" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 44403 } } peers { permanent_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 38749 } } peers { permanent_uuid: "18435fbb525741328139e84a1e354954" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 40545 } }
I20260709 13:08:21.176658 27978 raft_consensus.cc:493] T 15a4c537259e4b2882a5cc8e723b260a P 41268b218b804905a110c86738e74400 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:21.177163 27978 raft_consensus.cc:515] T 15a4c537259e4b2882a5cc8e723b260a P 41268b218b804905a110c86738e74400 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18435fbb525741328139e84a1e354954" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 40545 } } peers { permanent_uuid: "2513a663afac495eb09126ff55e8b2b0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40721 } } peers { permanent_uuid: "41268b218b804905a110c86738e74400" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 44403 } }
I20260709 13:08:21.179472 27978 leader_election.cc:290] T 15a4c537259e4b2882a5cc8e723b260a P 41268b218b804905a110c86738e74400 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 18435fbb525741328139e84a1e354954 (127.17.223.4:40545), 2513a663afac495eb09126ff55e8b2b0 (127.17.223.1:40721)
I20260709 13:08:21.176092 27862 raft_consensus.cc:385] T df06af11cae7484d969017fcb5b7e753 P 665f7e09521a4c3f9284c1d8b0e094ff [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:21.181375 27862 raft_consensus.cc:740] T df06af11cae7484d969017fcb5b7e753 P 665f7e09521a4c3f9284c1d8b0e094ff [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 665f7e09521a4c3f9284c1d8b0e094ff, State: Initialized, Role: FOLLOWER
I20260709 13:08:21.181269 27591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15a4c537259e4b2882a5cc8e723b260a" candidate_uuid: "41268b218b804905a110c86738e74400" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2513a663afac495eb09126ff55e8b2b0" is_pre_election: true
I20260709 13:08:21.182339 27897 raft_consensus.cc:493] T c9ea919812394c7aba307c2ff5b81f51 P 665f7e09521a4c3f9284c1d8b0e094ff [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:21.182192 27862 consensus_queue.cc:260] T df06af11cae7484d969017fcb5b7e753 P 665f7e09521a4c3f9284c1d8b0e094ff [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "41268b218b804905a110c86738e74400" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 44403 } } peers { permanent_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 38749 } } peers { permanent_uuid: "18435fbb525741328139e84a1e354954" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 40545 } }
I20260709 13:08:21.182835 27897 raft_consensus.cc:515] T c9ea919812394c7aba307c2ff5b81f51 P 665f7e09521a4c3f9284c1d8b0e094ff [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 38749 } } peers { permanent_uuid: "18435fbb525741328139e84a1e354954" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 40545 } } peers { permanent_uuid: "2513a663afac495eb09126ff55e8b2b0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40721 } }
W20260709 13:08:21.184549 27631 leader_election.cc:343] T 15a4c537259e4b2882a5cc8e723b260a P 41268b218b804905a110c86738e74400 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2513a663afac495eb09126ff55e8b2b0 (127.17.223.1:40721): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:21.184984 27897 leader_election.cc:290] T c9ea919812394c7aba307c2ff5b81f51 P 665f7e09521a4c3f9284c1d8b0e094ff [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 18435fbb525741328139e84a1e354954 (127.17.223.4:40545), 2513a663afac495eb09126ff55e8b2b0 (127.17.223.1:40721)
I20260709 13:08:21.172237 27874 consensus_queue.cc:1048] T 55a3afc21cea43ea85f4a2155552422d P 18435fbb525741328139e84a1e354954 [LEADER]: Connected to new peer: Peer: permanent_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 38749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.014s
I20260709 13:08:21.187044 27592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9ea919812394c7aba307c2ff5b81f51" candidate_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2513a663afac495eb09126ff55e8b2b0" is_pre_election: true
I20260709 13:08:21.187777 27592 raft_consensus.cc:2468] T c9ea919812394c7aba307c2ff5b81f51 P 2513a663afac495eb09126ff55e8b2b0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 665f7e09521a4c3f9284c1d8b0e094ff in term 0.
I20260709 13:08:21.188200 27813 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15a4c537259e4b2882a5cc8e723b260a" candidate_uuid: "41268b218b804905a110c86738e74400" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "18435fbb525741328139e84a1e354954" is_pre_election: true
I20260709 13:08:21.188879 27813 raft_consensus.cc:2468] T 15a4c537259e4b2882a5cc8e723b260a P 18435fbb525741328139e84a1e354954 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 41268b218b804905a110c86738e74400 in term 0.
I20260709 13:08:21.188985 27705 leader_election.cc:304] T c9ea919812394c7aba307c2ff5b81f51 P 665f7e09521a4c3f9284c1d8b0e094ff [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2513a663afac495eb09126ff55e8b2b0, 665f7e09521a4c3f9284c1d8b0e094ff; no voters: 
I20260709 13:08:21.190179 27634 leader_election.cc:304] T 15a4c537259e4b2882a5cc8e723b260a P 41268b218b804905a110c86738e74400 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 18435fbb525741328139e84a1e354954, 41268b218b804905a110c86738e74400; no voters: 2513a663afac495eb09126ff55e8b2b0
I20260709 13:08:21.190932 27897 raft_consensus.cc:2804] T c9ea919812394c7aba307c2ff5b81f51 P 665f7e09521a4c3f9284c1d8b0e094ff [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:08:21.191392 27897 raft_consensus.cc:493] T c9ea919812394c7aba307c2ff5b81f51 P 665f7e09521a4c3f9284c1d8b0e094ff [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:21.192082 27897 raft_consensus.cc:3060] T c9ea919812394c7aba307c2ff5b81f51 P 665f7e09521a4c3f9284c1d8b0e094ff [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:21.193308 27898 consensus_queue.cc:1048] T 7b77a53b493f4e979fdf38a0b17176b0 P 2513a663afac495eb09126ff55e8b2b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "41268b218b804905a110c86738e74400" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 44403 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:08:21.191411 27978 raft_consensus.cc:2804] T 15a4c537259e4b2882a5cc8e723b260a P 41268b218b804905a110c86738e74400 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:08:21.193853 27861 tablet_bootstrap.cc:654] T 15a4c537259e4b2882a5cc8e723b260a P 2513a663afac495eb09126ff55e8b2b0: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:21.194136 27978 raft_consensus.cc:493] T 15a4c537259e4b2882a5cc8e723b260a P 41268b218b804905a110c86738e74400 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:21.194592 27978 raft_consensus.cc:3060] T 15a4c537259e4b2882a5cc8e723b260a P 41268b218b804905a110c86738e74400 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:21.195739 27935 raft_consensus.cc:493] T 765d0bd527c64f74be713c390a018bba P 41268b218b804905a110c86738e74400 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:21.196254 27935 raft_consensus.cc:515] T 765d0bd527c64f74be713c390a018bba P 41268b218b804905a110c86738e74400 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2513a663afac495eb09126ff55e8b2b0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40721 } } peers { permanent_uuid: "41268b218b804905a110c86738e74400" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 44403 } } peers { permanent_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 38749 } }
I20260709 13:08:21.198374 27935 leader_election.cc:290] T 765d0bd527c64f74be713c390a018bba P 41268b218b804905a110c86738e74400 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2513a663afac495eb09126ff55e8b2b0 (127.17.223.1:40721), 665f7e09521a4c3f9284c1d8b0e094ff (127.17.223.3:38749)
I20260709 13:08:21.199280 27863 tablet_bootstrap.cc:654] T 5e6f8bdfe11b4af4aa27a711db7cbe7a P 41268b218b804905a110c86738e74400: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:21.199973 27591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "765d0bd527c64f74be713c390a018bba" candidate_uuid: "41268b218b804905a110c86738e74400" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2513a663afac495eb09126ff55e8b2b0" is_pre_election: true
I20260709 13:08:21.187342 27862 ts_tablet_manager.cc:1434] T df06af11cae7484d969017fcb5b7e753 P 665f7e09521a4c3f9284c1d8b0e094ff: Time spent starting tablet: real 0.014s	user 0.008s	sys 0.000s
I20260709 13:08:21.205049 27591 raft_consensus.cc:2468] T 765d0bd527c64f74be713c390a018bba P 2513a663afac495eb09126ff55e8b2b0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 41268b218b804905a110c86738e74400 in term 0.
I20260709 13:08:21.206534 27631 leader_election.cc:304] T 765d0bd527c64f74be713c390a018bba P 41268b218b804905a110c86738e74400 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2513a663afac495eb09126ff55e8b2b0, 41268b218b804905a110c86738e74400; no voters: 
I20260709 13:08:21.202243 27739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "765d0bd527c64f74be713c390a018bba" candidate_uuid: "41268b218b804905a110c86738e74400" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" is_pre_election: true
I20260709 13:08:21.207579 27865 tablet_bootstrap.cc:654] T e5847d81a5284a44a6b2b21cf6f4351c P 18435fbb525741328139e84a1e354954: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:21.208154 27935 raft_consensus.cc:2804] T 765d0bd527c64f74be713c390a018bba P 41268b218b804905a110c86738e74400 [term 0 FOLLOWER]: Leader pre-election won for term 1
W20260709 13:08:21.208431 27634 leader_election.cc:343] T 765d0bd527c64f74be713c390a018bba P 41268b218b804905a110c86738e74400 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 665f7e09521a4c3f9284c1d8b0e094ff (127.17.223.3:38749): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:21.208765 27935 raft_consensus.cc:493] T 765d0bd527c64f74be713c390a018bba P 41268b218b804905a110c86738e74400 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:21.209338 27935 raft_consensus.cc:3060] T 765d0bd527c64f74be713c390a018bba P 41268b218b804905a110c86738e74400 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:21.209649 27862 tablet_bootstrap.cc:492] T 80e2477670ec4db18ad338931d714544 P 665f7e09521a4c3f9284c1d8b0e094ff: Bootstrap starting.
I20260709 13:08:21.213153 27813 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9ea919812394c7aba307c2ff5b81f51" candidate_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "18435fbb525741328139e84a1e354954" is_pre_election: true
W20260709 13:08:21.214532 27708 leader_election.cc:343] T c9ea919812394c7aba307c2ff5b81f51 P 665f7e09521a4c3f9284c1d8b0e094ff [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 18435fbb525741328139e84a1e354954 (127.17.223.4:40545): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:21.225778 27978 raft_consensus.cc:515] T 15a4c537259e4b2882a5cc8e723b260a P 41268b218b804905a110c86738e74400 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18435fbb525741328139e84a1e354954" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 40545 } } peers { permanent_uuid: "2513a663afac495eb09126ff55e8b2b0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40721 } } peers { permanent_uuid: "41268b218b804905a110c86738e74400" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 44403 } }
I20260709 13:08:21.229065 27813 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15a4c537259e4b2882a5cc8e723b260a" candidate_uuid: "41268b218b804905a110c86738e74400" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "18435fbb525741328139e84a1e354954"
I20260709 13:08:21.229647 27813 raft_consensus.cc:3060] T 15a4c537259e4b2882a5cc8e723b260a P 18435fbb525741328139e84a1e354954 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:21.242865 27813 raft_consensus.cc:2468] T 15a4c537259e4b2882a5cc8e723b260a P 18435fbb525741328139e84a1e354954 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 41268b218b804905a110c86738e74400 in term 1.
I20260709 13:08:21.243989 27863 tablet_bootstrap.cc:492] T 5e6f8bdfe11b4af4aa27a711db7cbe7a P 41268b218b804905a110c86738e74400: No bootstrap required, opened a new log
I20260709 13:08:21.244547 27863 ts_tablet_manager.cc:1403] T 5e6f8bdfe11b4af4aa27a711db7cbe7a P 41268b218b804905a110c86738e74400: Time spent bootstrapping tablet: real 0.079s	user 0.016s	sys 0.010s
I20260709 13:08:21.244633 27897 raft_consensus.cc:515] T c9ea919812394c7aba307c2ff5b81f51 P 665f7e09521a4c3f9284c1d8b0e094ff [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 38749 } } peers { permanent_uuid: "18435fbb525741328139e84a1e354954" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 40545 } } peers { permanent_uuid: "2513a663afac495eb09126ff55e8b2b0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40721 } }
I20260709 13:08:21.244990 27634 leader_election.cc:304] T 15a4c537259e4b2882a5cc8e723b260a P 41268b218b804905a110c86738e74400 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 18435fbb525741328139e84a1e354954, 41268b218b804905a110c86738e74400; no voters: 
I20260709 13:08:21.246022 28014 raft_consensus.cc:2804] T 15a4c537259e4b2882a5cc8e723b260a P 41268b218b804905a110c86738e74400 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:08:21.246562 28014 raft_consensus.cc:697] T 15a4c537259e4b2882a5cc8e723b260a P 41268b218b804905a110c86738e74400 [term 1 LEADER]: Becoming Leader. State: Replica: 41268b218b804905a110c86738e74400, State: Running, Role: LEADER
I20260709 13:08:21.247581 27813 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9ea919812394c7aba307c2ff5b81f51" candidate_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "18435fbb525741328139e84a1e354954"
I20260709 13:08:21.247464 28014 consensus_queue.cc:237] T 15a4c537259e4b2882a5cc8e723b260a P 41268b218b804905a110c86738e74400 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18435fbb525741328139e84a1e354954" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 40545 } } peers { permanent_uuid: "2513a663afac495eb09126ff55e8b2b0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40721 } } peers { permanent_uuid: "41268b218b804905a110c86738e74400" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 44403 } }
W20260709 13:08:21.249244 27708 leader_election.cc:343] T c9ea919812394c7aba307c2ff5b81f51 P 665f7e09521a4c3f9284c1d8b0e094ff [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 18435fbb525741328139e84a1e354954 (127.17.223.4:40545): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:21.251709 27591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15a4c537259e4b2882a5cc8e723b260a" candidate_uuid: "41268b218b804905a110c86738e74400" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2513a663afac495eb09126ff55e8b2b0"
W20260709 13:08:21.253127 27631 leader_election.cc:343] T 15a4c537259e4b2882a5cc8e723b260a P 41268b218b804905a110c86738e74400 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 2513a663afac495eb09126ff55e8b2b0 (127.17.223.1:40721): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:21.253762 27978 leader_election.cc:290] T 15a4c537259e4b2882a5cc8e723b260a P 41268b218b804905a110c86738e74400 [CANDIDATE]: Term 1 election: Requested vote from peers 18435fbb525741328139e84a1e354954 (127.17.223.4:40545), 2513a663afac495eb09126ff55e8b2b0 (127.17.223.1:40721)
I20260709 13:08:21.254663 27897 leader_election.cc:290] T c9ea919812394c7aba307c2ff5b81f51 P 665f7e09521a4c3f9284c1d8b0e094ff [CANDIDATE]: Term 1 election: Requested vote from peers 18435fbb525741328139e84a1e354954 (127.17.223.4:40545), 2513a663afac495eb09126ff55e8b2b0 (127.17.223.1:40721)
I20260709 13:08:21.255900 27591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9ea919812394c7aba307c2ff5b81f51" candidate_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2513a663afac495eb09126ff55e8b2b0"
I20260709 13:08:21.263837 27591 raft_consensus.cc:3060] T c9ea919812394c7aba307c2ff5b81f51 P 2513a663afac495eb09126ff55e8b2b0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:21.258694 27863 raft_consensus.cc:359] T 5e6f8bdfe11b4af4aa27a711db7cbe7a P 41268b218b804905a110c86738e74400 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2513a663afac495eb09126ff55e8b2b0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40721 } } peers { permanent_uuid: "41268b218b804905a110c86738e74400" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 44403 } } peers { permanent_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 38749 } }
I20260709 13:08:21.268455 27863 raft_consensus.cc:385] T 5e6f8bdfe11b4af4aa27a711db7cbe7a P 41268b218b804905a110c86738e74400 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:21.268783 27863 raft_consensus.cc:740] T 5e6f8bdfe11b4af4aa27a711db7cbe7a P 41268b218b804905a110c86738e74400 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 41268b218b804905a110c86738e74400, State: Initialized, Role: FOLLOWER
I20260709 13:08:21.261996 27935 raft_consensus.cc:515] T 765d0bd527c64f74be713c390a018bba P 41268b218b804905a110c86738e74400 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2513a663afac495eb09126ff55e8b2b0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40721 } } peers { permanent_uuid: "41268b218b804905a110c86738e74400" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 44403 } } peers { permanent_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 38749 } }
I20260709 13:08:21.270129 27865 tablet_bootstrap.cc:492] T e5847d81a5284a44a6b2b21cf6f4351c P 18435fbb525741328139e84a1e354954: No bootstrap required, opened a new log
I20260709 13:08:21.270973 27865 ts_tablet_manager.cc:1403] T e5847d81a5284a44a6b2b21cf6f4351c P 18435fbb525741328139e84a1e354954: Time spent bootstrapping tablet: real 0.145s	user 0.012s	sys 0.001s
I20260709 13:08:21.273947 28014 consensus_queue.cc:1048] T 866a01285ca8436385f8d16dcfb0d4e3 P 41268b218b804905a110c86738e74400 [LEADER]: Connected to new peer: Peer: permanent_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 38749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:08:21.274647 27591 raft_consensus.cc:2468] T c9ea919812394c7aba307c2ff5b81f51 P 2513a663afac495eb09126ff55e8b2b0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 665f7e09521a4c3f9284c1d8b0e094ff in term 1.
I20260709 13:08:21.269498 27863 consensus_queue.cc:260] T 5e6f8bdfe11b4af4aa27a711db7cbe7a P 41268b218b804905a110c86738e74400 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2513a663afac495eb09126ff55e8b2b0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40721 } } peers { permanent_uuid: "41268b218b804905a110c86738e74400" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 44403 } } peers { permanent_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 38749 } }
I20260709 13:08:21.278607 27865 raft_consensus.cc:359] T e5847d81a5284a44a6b2b21cf6f4351c P 18435fbb525741328139e84a1e354954 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18435fbb525741328139e84a1e354954" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 40545 } } peers { permanent_uuid: "2513a663afac495eb09126ff55e8b2b0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40721 } } peers { permanent_uuid: "41268b218b804905a110c86738e74400" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 44403 } }
I20260709 13:08:21.281303 27865 raft_consensus.cc:385] T e5847d81a5284a44a6b2b21cf6f4351c P 18435fbb525741328139e84a1e354954 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:21.282507 27865 raft_consensus.cc:740] T e5847d81a5284a44a6b2b21cf6f4351c P 18435fbb525741328139e84a1e354954 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 18435fbb525741328139e84a1e354954, State: Initialized, Role: FOLLOWER
I20260709 13:08:21.284958 27705 leader_election.cc:304] T c9ea919812394c7aba307c2ff5b81f51 P 665f7e09521a4c3f9284c1d8b0e094ff [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2513a663afac495eb09126ff55e8b2b0, 665f7e09521a4c3f9284c1d8b0e094ff; no voters: 18435fbb525741328139e84a1e354954
I20260709 13:08:21.285316 27865 consensus_queue.cc:260] T e5847d81a5284a44a6b2b21cf6f4351c P 18435fbb525741328139e84a1e354954 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18435fbb525741328139e84a1e354954" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 40545 } } peers { permanent_uuid: "2513a663afac495eb09126ff55e8b2b0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40721 } } peers { permanent_uuid: "41268b218b804905a110c86738e74400" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 44403 } }
I20260709 13:08:21.286412 27903 raft_consensus.cc:2804] T c9ea919812394c7aba307c2ff5b81f51 P 665f7e09521a4c3f9284c1d8b0e094ff [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:08:21.286191 27863 ts_tablet_manager.cc:1434] T 5e6f8bdfe11b4af4aa27a711db7cbe7a P 41268b218b804905a110c86738e74400: Time spent starting tablet: real 0.041s	user 0.008s	sys 0.000s
I20260709 13:08:21.273672 27489 catalog_manager.cc:5697] T 15a4c537259e4b2882a5cc8e723b260a P 41268b218b804905a110c86738e74400 reported cstate change: term changed from 0 to 1, leader changed from <none> to 41268b218b804905a110c86738e74400 (127.17.223.2). New cstate: current_term: 1 leader_uuid: "41268b218b804905a110c86738e74400" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18435fbb525741328139e84a1e354954" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 40545 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2513a663afac495eb09126ff55e8b2b0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40721 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "41268b218b804905a110c86738e74400" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 44403 } health_report { overall_health: HEALTHY } } }
I20260709 13:08:21.284583 27862 tablet_bootstrap.cc:654] T 80e2477670ec4db18ad338931d714544 P 665f7e09521a4c3f9284c1d8b0e094ff: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:21.291393 27865 ts_tablet_manager.cc:1434] T e5847d81a5284a44a6b2b21cf6f4351c P 18435fbb525741328139e84a1e354954: Time spent starting tablet: real 0.015s	user 0.006s	sys 0.000s
I20260709 13:08:21.286921 27903 raft_consensus.cc:697] T c9ea919812394c7aba307c2ff5b81f51 P 665f7e09521a4c3f9284c1d8b0e094ff [term 1 LEADER]: Becoming Leader. State: Replica: 665f7e09521a4c3f9284c1d8b0e094ff, State: Running, Role: LEADER
I20260709 13:08:21.292963 27903 consensus_queue.cc:237] T c9ea919812394c7aba307c2ff5b81f51 P 665f7e09521a4c3f9284c1d8b0e094ff [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 38749 } } peers { permanent_uuid: "18435fbb525741328139e84a1e354954" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 40545 } } peers { permanent_uuid: "2513a663afac495eb09126ff55e8b2b0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40721 } }
I20260709 13:08:21.294277 27865 tablet_bootstrap.cc:492] T 1d9bdb76a5094186b5ac6c8f8e1c9840 P 18435fbb525741328139e84a1e354954: Bootstrap starting.
I20260709 13:08:21.297173 27935 leader_election.cc:290] T 765d0bd527c64f74be713c390a018bba P 41268b218b804905a110c86738e74400 [CANDIDATE]: Term 1 election: Requested vote from peers 2513a663afac495eb09126ff55e8b2b0 (127.17.223.1:40721), 665f7e09521a4c3f9284c1d8b0e094ff (127.17.223.3:38749)
I20260709 13:08:21.298111 27863 tablet_bootstrap.cc:492] T 5f4a8242380b4863bf5ad2c055229bb7 P 41268b218b804905a110c86738e74400: Bootstrap starting.
I20260709 13:08:21.298187 27591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "765d0bd527c64f74be713c390a018bba" candidate_uuid: "41268b218b804905a110c86738e74400" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2513a663afac495eb09126ff55e8b2b0"
I20260709 13:08:21.298306 27739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "765d0bd527c64f74be713c390a018bba" candidate_uuid: "41268b218b804905a110c86738e74400" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "665f7e09521a4c3f9284c1d8b0e094ff"
W20260709 13:08:21.299947 27634 leader_election.cc:343] T 765d0bd527c64f74be713c390a018bba P 41268b218b804905a110c86738e74400 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 665f7e09521a4c3f9284c1d8b0e094ff (127.17.223.3:38749): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:21.300590 27591 raft_consensus.cc:3060] T 765d0bd527c64f74be713c390a018bba P 2513a663afac495eb09126ff55e8b2b0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:21.310814 27874 raft_consensus.cc:493] T df06af11cae7484d969017fcb5b7e753 P 18435fbb525741328139e84a1e354954 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:21.324258 27874 raft_consensus.cc:515] T df06af11cae7484d969017fcb5b7e753 P 18435fbb525741328139e84a1e354954 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "41268b218b804905a110c86738e74400" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 44403 } } peers { permanent_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 38749 } } peers { permanent_uuid: "18435fbb525741328139e84a1e354954" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 40545 } }
I20260709 13:08:21.328266 27874 leader_election.cc:290] T df06af11cae7484d969017fcb5b7e753 P 18435fbb525741328139e84a1e354954 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 41268b218b804905a110c86738e74400 (127.17.223.2:44403), 665f7e09521a4c3f9284c1d8b0e094ff (127.17.223.3:38749)
I20260709 13:08:21.328888 27666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df06af11cae7484d969017fcb5b7e753" candidate_uuid: "18435fbb525741328139e84a1e354954" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "41268b218b804905a110c86738e74400" is_pre_election: true
I20260709 13:08:21.334915 27739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df06af11cae7484d969017fcb5b7e753" candidate_uuid: "18435fbb525741328139e84a1e354954" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" is_pre_election: true
I20260709 13:08:21.335605 27739 raft_consensus.cc:2468] T df06af11cae7484d969017fcb5b7e753 P 665f7e09521a4c3f9284c1d8b0e094ff [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 18435fbb525741328139e84a1e354954 in term 0.
I20260709 13:08:21.337469 27862 tablet_bootstrap.cc:492] T 80e2477670ec4db18ad338931d714544 P 665f7e09521a4c3f9284c1d8b0e094ff: No bootstrap required, opened a new log
I20260709 13:08:21.337940 27862 ts_tablet_manager.cc:1403] T 80e2477670ec4db18ad338931d714544 P 665f7e09521a4c3f9284c1d8b0e094ff: Time spent bootstrapping tablet: real 0.130s	user 0.014s	sys 0.005s
I20260709 13:08:21.339685 27782 leader_election.cc:304] T df06af11cae7484d969017fcb5b7e753 P 18435fbb525741328139e84a1e354954 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 18435fbb525741328139e84a1e354954, 665f7e09521a4c3f9284c1d8b0e094ff; no voters: 
I20260709 13:08:21.341307 27874 raft_consensus.cc:2804] T df06af11cae7484d969017fcb5b7e753 P 18435fbb525741328139e84a1e354954 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:08:21.341883 27862 raft_consensus.cc:359] T 80e2477670ec4db18ad338931d714544 P 665f7e09521a4c3f9284c1d8b0e094ff [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 38749 } } peers { permanent_uuid: "18435fbb525741328139e84a1e354954" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 40545 } } peers { permanent_uuid: "2513a663afac495eb09126ff55e8b2b0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40721 } }
I20260709 13:08:21.342692 27862 raft_consensus.cc:385] T 80e2477670ec4db18ad338931d714544 P 665f7e09521a4c3f9284c1d8b0e094ff [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:21.342621 27870 consensus_queue.cc:1048] T 7b77a53b493f4e979fdf38a0b17176b0 P 2513a663afac495eb09126ff55e8b2b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 38749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:08:21.343209 27862 raft_consensus.cc:740] T 80e2477670ec4db18ad338931d714544 P 665f7e09521a4c3f9284c1d8b0e094ff [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 665f7e09521a4c3f9284c1d8b0e094ff, State: Initialized, Role: FOLLOWER
I20260709 13:08:21.343437 27861 tablet_bootstrap.cc:492] T 15a4c537259e4b2882a5cc8e723b260a P 2513a663afac495eb09126ff55e8b2b0: No bootstrap required, opened a new log
I20260709 13:08:21.343954 27861 ts_tablet_manager.cc:1403] T 15a4c537259e4b2882a5cc8e723b260a P 2513a663afac495eb09126ff55e8b2b0: Time spent bootstrapping tablet: real 0.198s	user 0.016s	sys 0.041s
I20260709 13:08:21.332695 27666 raft_consensus.cc:2468] T df06af11cae7484d969017fcb5b7e753 P 41268b218b804905a110c86738e74400 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 18435fbb525741328139e84a1e354954 in term 0.
I20260709 13:08:21.344067 27862 consensus_queue.cc:260] T 80e2477670ec4db18ad338931d714544 P 665f7e09521a4c3f9284c1d8b0e094ff [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 38749 } } peers { permanent_uuid: "18435fbb525741328139e84a1e354954" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 40545 } } peers { permanent_uuid: "2513a663afac495eb09126ff55e8b2b0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40721 } }
I20260709 13:08:21.341678 27874 raft_consensus.cc:493] T df06af11cae7484d969017fcb5b7e753 P 18435fbb525741328139e84a1e354954 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:21.345182 27874 raft_consensus.cc:3060] T df06af11cae7484d969017fcb5b7e753 P 18435fbb525741328139e84a1e354954 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:21.346788 27862 ts_tablet_manager.cc:1434] T 80e2477670ec4db18ad338931d714544 P 665f7e09521a4c3f9284c1d8b0e094ff: Time spent starting tablet: real 0.009s	user 0.008s	sys 0.000s
I20260709 13:08:21.347036 27861 raft_consensus.cc:359] T 15a4c537259e4b2882a5cc8e723b260a P 2513a663afac495eb09126ff55e8b2b0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18435fbb525741328139e84a1e354954" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 40545 } } peers { permanent_uuid: "2513a663afac495eb09126ff55e8b2b0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40721 } } peers { permanent_uuid: "41268b218b804905a110c86738e74400" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 44403 } }
I20260709 13:08:21.347733 27861 raft_consensus.cc:385] T 15a4c537259e4b2882a5cc8e723b260a P 2513a663afac495eb09126ff55e8b2b0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:21.348060 27861 raft_consensus.cc:740] T 15a4c537259e4b2882a5cc8e723b260a P 2513a663afac495eb09126ff55e8b2b0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2513a663afac495eb09126ff55e8b2b0, State: Initialized, Role: FOLLOWER
I20260709 13:08:21.348783 27862 tablet_bootstrap.cc:492] T 1d9bdb76a5094186b5ac6c8f8e1c9840 P 665f7e09521a4c3f9284c1d8b0e094ff: Bootstrap starting.
I20260709 13:08:21.348671 27861 consensus_queue.cc:260] T 15a4c537259e4b2882a5cc8e723b260a P 2513a663afac495eb09126ff55e8b2b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18435fbb525741328139e84a1e354954" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 40545 } } peers { permanent_uuid: "2513a663afac495eb09126ff55e8b2b0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40721 } } peers { permanent_uuid: "41268b218b804905a110c86738e74400" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 44403 } }
I20260709 13:08:21.351007 27861 ts_tablet_manager.cc:1434] T 15a4c537259e4b2882a5cc8e723b260a P 2513a663afac495eb09126ff55e8b2b0: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 13:08:21.362438 27862 tablet_bootstrap.cc:654] T 1d9bdb76a5094186b5ac6c8f8e1c9840 P 665f7e09521a4c3f9284c1d8b0e094ff: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:21.366056 27489 catalog_manager.cc:5697] T c9ea919812394c7aba307c2ff5b81f51 P 665f7e09521a4c3f9284c1d8b0e094ff reported cstate change: term changed from 0 to 1, leader changed from <none> to 665f7e09521a4c3f9284c1d8b0e094ff (127.17.223.3). New cstate: current_term: 1 leader_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 38749 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "18435fbb525741328139e84a1e354954" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 40545 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2513a663afac495eb09126ff55e8b2b0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40721 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:21.374698 27592 raft_consensus.cc:3060] T 866a01285ca8436385f8d16dcfb0d4e3 P 2513a663afac495eb09126ff55e8b2b0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:21.377210 27861 tablet_bootstrap.cc:492] T 80e2477670ec4db18ad338931d714544 P 2513a663afac495eb09126ff55e8b2b0: Bootstrap starting.
I20260709 13:08:21.384474 27870 raft_consensus.cc:493] T 15a4c537259e4b2882a5cc8e723b260a P 2513a663afac495eb09126ff55e8b2b0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:21.385064 27870 raft_consensus.cc:515] T 15a4c537259e4b2882a5cc8e723b260a P 2513a663afac495eb09126ff55e8b2b0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18435fbb525741328139e84a1e354954" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 40545 } } peers { permanent_uuid: "2513a663afac495eb09126ff55e8b2b0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40721 } } peers { permanent_uuid: "41268b218b804905a110c86738e74400" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 44403 } }
I20260709 13:08:21.382340 27865 tablet_bootstrap.cc:654] T 1d9bdb76a5094186b5ac6c8f8e1c9840 P 18435fbb525741328139e84a1e354954: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:21.389568 27870 leader_election.cc:290] T 15a4c537259e4b2882a5cc8e723b260a P 2513a663afac495eb09126ff55e8b2b0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 18435fbb525741328139e84a1e354954 (127.17.223.4:40545), 41268b218b804905a110c86738e74400 (127.17.223.2:44403)
I20260709 13:08:21.390417 27591 raft_consensus.cc:2468] T 765d0bd527c64f74be713c390a018bba P 2513a663afac495eb09126ff55e8b2b0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 41268b218b804905a110c86738e74400 in term 1.
I20260709 13:08:21.392884 27666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15a4c537259e4b2882a5cc8e723b260a" candidate_uuid: "2513a663afac495eb09126ff55e8b2b0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "41268b218b804905a110c86738e74400" is_pre_election: true
I20260709 13:08:21.394212 27631 leader_election.cc:304] T 765d0bd527c64f74be713c390a018bba P 41268b218b804905a110c86738e74400 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2513a663afac495eb09126ff55e8b2b0, 41268b218b804905a110c86738e74400; no voters: 665f7e09521a4c3f9284c1d8b0e094ff
I20260709 13:08:21.392930 27813 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15a4c537259e4b2882a5cc8e723b260a" candidate_uuid: "2513a663afac495eb09126ff55e8b2b0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "18435fbb525741328139e84a1e354954" is_pre_election: true
I20260709 13:08:21.395543 27813 raft_consensus.cc:2393] T 15a4c537259e4b2882a5cc8e723b260a P 18435fbb525741328139e84a1e354954 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2513a663afac495eb09126ff55e8b2b0 in current term 1: Already voted for candidate 41268b218b804905a110c86738e74400 in this term.
I20260709 13:08:21.397640 27935 raft_consensus.cc:2804] T 765d0bd527c64f74be713c390a018bba P 41268b218b804905a110c86738e74400 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:08:21.398298 27935 raft_consensus.cc:697] T 765d0bd527c64f74be713c390a018bba P 41268b218b804905a110c86738e74400 [term 1 LEADER]: Becoming Leader. State: Replica: 41268b218b804905a110c86738e74400, State: Running, Role: LEADER
I20260709 13:08:21.399225 27559 leader_election.cc:304] T 15a4c537259e4b2882a5cc8e723b260a P 2513a663afac495eb09126ff55e8b2b0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2513a663afac495eb09126ff55e8b2b0; no voters: 18435fbb525741328139e84a1e354954, 41268b218b804905a110c86738e74400
I20260709 13:08:21.399166 27935 consensus_queue.cc:237] T 765d0bd527c64f74be713c390a018bba P 41268b218b804905a110c86738e74400 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2513a663afac495eb09126ff55e8b2b0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40721 } } peers { permanent_uuid: "41268b218b804905a110c86738e74400" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 44403 } } peers { permanent_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 38749 } }
I20260709 13:08:21.400074 27870 raft_consensus.cc:3060] T 15a4c537259e4b2882a5cc8e723b260a P 2513a663afac495eb09126ff55e8b2b0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:21.401561 28014 consensus_queue.cc:1048] T 866a01285ca8436385f8d16dcfb0d4e3 P 41268b218b804905a110c86738e74400 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2513a663afac495eb09126ff55e8b2b0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40721 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:08:21.402873 27982 raft_consensus.cc:493] T 1d9bdb76a5094186b5ac6c8f8e1c9840 P 41268b218b804905a110c86738e74400 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:21.403505 27982 raft_consensus.cc:515] T 1d9bdb76a5094186b5ac6c8f8e1c9840 P 41268b218b804905a110c86738e74400 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "41268b218b804905a110c86738e74400" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 44403 } } peers { permanent_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 38749 } } peers { permanent_uuid: "18435fbb525741328139e84a1e354954" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 40545 } }
I20260709 13:08:21.414893 27982 leader_election.cc:290] T 1d9bdb76a5094186b5ac6c8f8e1c9840 P 41268b218b804905a110c86738e74400 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 665f7e09521a4c3f9284c1d8b0e094ff (127.17.223.3:38749), 18435fbb525741328139e84a1e354954 (127.17.223.4:40545)
I20260709 13:08:21.418277 27861 tablet_bootstrap.cc:654] T 80e2477670ec4db18ad338931d714544 P 2513a663afac495eb09126ff55e8b2b0: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:21.423396 27741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d9bdb76a5094186b5ac6c8f8e1c9840" candidate_uuid: "41268b218b804905a110c86738e74400" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" is_pre_election: true
I20260709 13:08:21.434633 27863 tablet_bootstrap.cc:654] T 5f4a8242380b4863bf5ad2c055229bb7 P 41268b218b804905a110c86738e74400: Neither blocks nor log segments found. Creating new log.
W20260709 13:08:21.437795 27634 leader_election.cc:343] T 1d9bdb76a5094186b5ac6c8f8e1c9840 P 41268b218b804905a110c86738e74400 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 665f7e09521a4c3f9284c1d8b0e094ff (127.17.223.3:38749): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:21.438452 27813 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d9bdb76a5094186b5ac6c8f8e1c9840" candidate_uuid: "41268b218b804905a110c86738e74400" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "18435fbb525741328139e84a1e354954" is_pre_election: true
W20260709 13:08:21.440415 27634 leader_election.cc:343] T 1d9bdb76a5094186b5ac6c8f8e1c9840 P 41268b218b804905a110c86738e74400 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 18435fbb525741328139e84a1e354954 (127.17.223.4:40545): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:21.440989 27634 leader_election.cc:304] T 1d9bdb76a5094186b5ac6c8f8e1c9840 P 41268b218b804905a110c86738e74400 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 41268b218b804905a110c86738e74400; no voters: 18435fbb525741328139e84a1e354954, 665f7e09521a4c3f9284c1d8b0e094ff
I20260709 13:08:21.433594 27957 consensus_queue.cc:1048] T 11224ef6c00a40cdba4311ceb63bddb9 P 2513a663afac495eb09126ff55e8b2b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "18435fbb525741328139e84a1e354954" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 40545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.010s
I20260709 13:08:21.444869 27862 tablet_bootstrap.cc:492] T 1d9bdb76a5094186b5ac6c8f8e1c9840 P 665f7e09521a4c3f9284c1d8b0e094ff: No bootstrap required, opened a new log
I20260709 13:08:21.445355 27862 ts_tablet_manager.cc:1403] T 1d9bdb76a5094186b5ac6c8f8e1c9840 P 665f7e09521a4c3f9284c1d8b0e094ff: Time spent bootstrapping tablet: real 0.098s	user 0.019s	sys 0.007s
I20260709 13:08:21.447163 27982 raft_consensus.cc:2749] T 1d9bdb76a5094186b5ac6c8f8e1c9840 P 41268b218b804905a110c86738e74400 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:08:21.448104 27874 raft_consensus.cc:515] T df06af11cae7484d969017fcb5b7e753 P 18435fbb525741328139e84a1e354954 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "41268b218b804905a110c86738e74400" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 44403 } } peers { permanent_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 38749 } } peers { permanent_uuid: "18435fbb525741328139e84a1e354954" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 40545 } }
I20260709 13:08:21.449421 27870 raft_consensus.cc:2749] T 15a4c537259e4b2882a5cc8e723b260a P 2513a663afac495eb09126ff55e8b2b0 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:08:21.460041 27862 raft_consensus.cc:359] T 1d9bdb76a5094186b5ac6c8f8e1c9840 P 665f7e09521a4c3f9284c1d8b0e094ff [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "41268b218b804905a110c86738e74400" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 44403 } } peers { permanent_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 38749 } } peers { permanent_uuid: "18435fbb525741328139e84a1e354954" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 40545 } }
I20260709 13:08:21.461124 27862 raft_consensus.cc:385] T 1d9bdb76a5094186b5ac6c8f8e1c9840 P 665f7e09521a4c3f9284c1d8b0e094ff [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:21.461474 27862 raft_consensus.cc:740] T 1d9bdb76a5094186b5ac6c8f8e1c9840 P 665f7e09521a4c3f9284c1d8b0e094ff [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 665f7e09521a4c3f9284c1d8b0e094ff, State: Initialized, Role: FOLLOWER
I20260709 13:08:21.462332 27862 consensus_queue.cc:260] T 1d9bdb76a5094186b5ac6c8f8e1c9840 P 665f7e09521a4c3f9284c1d8b0e094ff [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "41268b218b804905a110c86738e74400" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 44403 } } peers { permanent_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 38749 } } peers { permanent_uuid: "18435fbb525741328139e84a1e354954" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 40545 } }
I20260709 13:08:21.465564 27862 ts_tablet_manager.cc:1434] T 1d9bdb76a5094186b5ac6c8f8e1c9840 P 665f7e09521a4c3f9284c1d8b0e094ff: Time spent starting tablet: real 0.020s	user 0.007s	sys 0.000s
I20260709 13:08:21.467024 27862 tablet_bootstrap.cc:492] T 765d0bd527c64f74be713c390a018bba P 665f7e09521a4c3f9284c1d8b0e094ff: Bootstrap starting.
I20260709 13:08:21.471611 27666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df06af11cae7484d969017fcb5b7e753" candidate_uuid: "18435fbb525741328139e84a1e354954" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "41268b218b804905a110c86738e74400"
I20260709 13:08:21.472858 27666 raft_consensus.cc:3060] T df06af11cae7484d969017fcb5b7e753 P 41268b218b804905a110c86738e74400 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:21.475416 27870 consensus_queue.cc:1048] T 11224ef6c00a40cdba4311ceb63bddb9 P 2513a663afac495eb09126ff55e8b2b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 38749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:08:21.482025 27742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df06af11cae7484d969017fcb5b7e753" candidate_uuid: "18435fbb525741328139e84a1e354954" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "665f7e09521a4c3f9284c1d8b0e094ff"
I20260709 13:08:21.482888 27742 raft_consensus.cc:3060] T df06af11cae7484d969017fcb5b7e753 P 665f7e09521a4c3f9284c1d8b0e094ff [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:21.489770 27861 tablet_bootstrap.cc:492] T 80e2477670ec4db18ad338931d714544 P 2513a663afac495eb09126ff55e8b2b0: No bootstrap required, opened a new log
I20260709 13:08:21.490356 27861 ts_tablet_manager.cc:1403] T 80e2477670ec4db18ad338931d714544 P 2513a663afac495eb09126ff55e8b2b0: Time spent bootstrapping tablet: real 0.132s	user 0.015s	sys 0.000s
I20260709 13:08:21.497207 27865 tablet_bootstrap.cc:492] T 1d9bdb76a5094186b5ac6c8f8e1c9840 P 18435fbb525741328139e84a1e354954: No bootstrap required, opened a new log
I20260709 13:08:21.497303 27666 raft_consensus.cc:2468] T df06af11cae7484d969017fcb5b7e753 P 41268b218b804905a110c86738e74400 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 18435fbb525741328139e84a1e354954 in term 1.
I20260709 13:08:21.497902 27865 ts_tablet_manager.cc:1403] T 1d9bdb76a5094186b5ac6c8f8e1c9840 P 18435fbb525741328139e84a1e354954: Time spent bootstrapping tablet: real 0.204s	user 0.020s	sys 0.021s
I20260709 13:08:21.497977 27742 raft_consensus.cc:2468] T df06af11cae7484d969017fcb5b7e753 P 665f7e09521a4c3f9284c1d8b0e094ff [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 18435fbb525741328139e84a1e354954 in term 1.
I20260709 13:08:21.500005 27782 leader_election.cc:304] T df06af11cae7484d969017fcb5b7e753 P 18435fbb525741328139e84a1e354954 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 18435fbb525741328139e84a1e354954, 665f7e09521a4c3f9284c1d8b0e094ff; no voters: 
I20260709 13:08:21.480399 27874 leader_election.cc:290] T df06af11cae7484d969017fcb5b7e753 P 18435fbb525741328139e84a1e354954 [CANDIDATE]: Term 1 election: Requested vote from peers 41268b218b804905a110c86738e74400 (127.17.223.2:44403), 665f7e09521a4c3f9284c1d8b0e094ff (127.17.223.3:38749)
I20260709 13:08:21.504789 27863 tablet_bootstrap.cc:492] T 5f4a8242380b4863bf5ad2c055229bb7 P 41268b218b804905a110c86738e74400: No bootstrap required, opened a new log
I20260709 13:08:21.502179 27964 raft_consensus.cc:2804] T df06af11cae7484d969017fcb5b7e753 P 18435fbb525741328139e84a1e354954 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:08:21.505479 27863 ts_tablet_manager.cc:1403] T 5f4a8242380b4863bf5ad2c055229bb7 P 41268b218b804905a110c86738e74400: Time spent bootstrapping tablet: real 0.208s	user 0.024s	sys 0.022s
I20260709 13:08:21.507352 27964 raft_consensus.cc:697] T df06af11cae7484d969017fcb5b7e753 P 18435fbb525741328139e84a1e354954 [term 1 LEADER]: Becoming Leader. State: Replica: 18435fbb525741328139e84a1e354954, State: Running, Role: LEADER
I20260709 13:08:21.509611 27964 consensus_queue.cc:237] T df06af11cae7484d969017fcb5b7e753 P 18435fbb525741328139e84a1e354954 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "41268b218b804905a110c86738e74400" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 44403 } } peers { permanent_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 38749 } } peers { permanent_uuid: "18435fbb525741328139e84a1e354954" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 40545 } }
I20260709 13:08:21.512612 27863 raft_consensus.cc:359] T 5f4a8242380b4863bf5ad2c055229bb7 P 41268b218b804905a110c86738e74400 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "41268b218b804905a110c86738e74400" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 44403 } } peers { permanent_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 38749 } } peers { permanent_uuid: "18435fbb525741328139e84a1e354954" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 40545 } }
I20260709 13:08:21.513304 27863 raft_consensus.cc:385] T 5f4a8242380b4863bf5ad2c055229bb7 P 41268b218b804905a110c86738e74400 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:21.513569 27863 raft_consensus.cc:740] T 5f4a8242380b4863bf5ad2c055229bb7 P 41268b218b804905a110c86738e74400 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 41268b218b804905a110c86738e74400, State: Initialized, Role: FOLLOWER
I20260709 13:08:21.514824 27874 raft_consensus.cc:493] T e5847d81a5284a44a6b2b21cf6f4351c P 18435fbb525741328139e84a1e354954 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:21.515374 27874 raft_consensus.cc:515] T e5847d81a5284a44a6b2b21cf6f4351c P 18435fbb525741328139e84a1e354954 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18435fbb525741328139e84a1e354954" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 40545 } } peers { permanent_uuid: "2513a663afac495eb09126ff55e8b2b0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40721 } } peers { permanent_uuid: "41268b218b804905a110c86738e74400" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 44403 } }
I20260709 13:08:21.518074 27592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5847d81a5284a44a6b2b21cf6f4351c" candidate_uuid: "18435fbb525741328139e84a1e354954" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2513a663afac495eb09126ff55e8b2b0" is_pre_election: true
W20260709 13:08:21.519560 27779 leader_election.cc:343] T e5847d81a5284a44a6b2b21cf6f4351c P 18435fbb525741328139e84a1e354954 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2513a663afac495eb09126ff55e8b2b0 (127.17.223.1:40721): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:21.521188 27874 leader_election.cc:290] T e5847d81a5284a44a6b2b21cf6f4351c P 18435fbb525741328139e84a1e354954 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2513a663afac495eb09126ff55e8b2b0 (127.17.223.1:40721), 41268b218b804905a110c86738e74400 (127.17.223.2:44403)
I20260709 13:08:21.514246 27863 consensus_queue.cc:260] T 5f4a8242380b4863bf5ad2c055229bb7 P 41268b218b804905a110c86738e74400 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "41268b218b804905a110c86738e74400" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 44403 } } peers { permanent_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 38749 } } peers { permanent_uuid: "18435fbb525741328139e84a1e354954" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 40545 } }
I20260709 13:08:21.501437 27865 raft_consensus.cc:359] T 1d9bdb76a5094186b5ac6c8f8e1c9840 P 18435fbb525741328139e84a1e354954 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "41268b218b804905a110c86738e74400" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 44403 } } peers { permanent_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 38749 } } peers { permanent_uuid: "18435fbb525741328139e84a1e354954" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 40545 } }
I20260709 13:08:21.524689 27865 raft_consensus.cc:385] T 1d9bdb76a5094186b5ac6c8f8e1c9840 P 18435fbb525741328139e84a1e354954 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:21.525034 27865 raft_consensus.cc:740] T 1d9bdb76a5094186b5ac6c8f8e1c9840 P 18435fbb525741328139e84a1e354954 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 18435fbb525741328139e84a1e354954, State: Initialized, Role: FOLLOWER
I20260709 13:08:21.525938 27865 consensus_queue.cc:260] T 1d9bdb76a5094186b5ac6c8f8e1c9840 P 18435fbb525741328139e84a1e354954 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "41268b218b804905a110c86738e74400" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 44403 } } peers { permanent_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 38749 } } peers { permanent_uuid: "18435fbb525741328139e84a1e354954" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 40545 } }
I20260709 13:08:21.521890 27488 catalog_manager.cc:5697] T 765d0bd527c64f74be713c390a018bba P 41268b218b804905a110c86738e74400 reported cstate change: term changed from 0 to 1, leader changed from <none> to 41268b218b804905a110c86738e74400 (127.17.223.2). New cstate: current_term: 1 leader_uuid: "41268b218b804905a110c86738e74400" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2513a663afac495eb09126ff55e8b2b0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40721 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "41268b218b804905a110c86738e74400" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 44403 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 38749 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:21.532652 27863 ts_tablet_manager.cc:1434] T 5f4a8242380b4863bf5ad2c055229bb7 P 41268b218b804905a110c86738e74400: Time spent starting tablet: real 0.027s	user 0.009s	sys 0.000s
I20260709 13:08:21.534353 27863 tablet_bootstrap.cc:492] T e9b149d77d9941158ead8e9e592e7b27 P 41268b218b804905a110c86738e74400: Bootstrap starting.
I20260709 13:08:21.534808 27935 raft_consensus.cc:493] T 5e6f8bdfe11b4af4aa27a711db7cbe7a P 41268b218b804905a110c86738e74400 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:21.536815 27935 raft_consensus.cc:515] T 5e6f8bdfe11b4af4aa27a711db7cbe7a P 41268b218b804905a110c86738e74400 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2513a663afac495eb09126ff55e8b2b0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40721 } } peers { permanent_uuid: "41268b218b804905a110c86738e74400" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 44403 } } peers { permanent_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 38749 } }
I20260709 13:08:21.537518 27665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5847d81a5284a44a6b2b21cf6f4351c" candidate_uuid: "18435fbb525741328139e84a1e354954" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "41268b218b804905a110c86738e74400" is_pre_election: true
I20260709 13:08:21.538168 27665 raft_consensus.cc:2468] T e5847d81a5284a44a6b2b21cf6f4351c P 41268b218b804905a110c86738e74400 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 18435fbb525741328139e84a1e354954 in term 0.
I20260709 13:08:21.540216 27782 leader_election.cc:304] T e5847d81a5284a44a6b2b21cf6f4351c P 18435fbb525741328139e84a1e354954 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 18435fbb525741328139e84a1e354954, 41268b218b804905a110c86738e74400; no voters: 2513a663afac495eb09126ff55e8b2b0
I20260709 13:08:21.540438 27592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e6f8bdfe11b4af4aa27a711db7cbe7a" candidate_uuid: "41268b218b804905a110c86738e74400" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2513a663afac495eb09126ff55e8b2b0" is_pre_election: true
W20260709 13:08:21.541874 27631 leader_election.cc:343] T 5e6f8bdfe11b4af4aa27a711db7cbe7a P 41268b218b804905a110c86738e74400 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2513a663afac495eb09126ff55e8b2b0 (127.17.223.1:40721): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:21.543349 28046 raft_consensus.cc:2804] T e5847d81a5284a44a6b2b21cf6f4351c P 18435fbb525741328139e84a1e354954 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:08:21.543776 28046 raft_consensus.cc:493] T e5847d81a5284a44a6b2b21cf6f4351c P 18435fbb525741328139e84a1e354954 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:21.544580 28046 raft_consensus.cc:3060] T e5847d81a5284a44a6b2b21cf6f4351c P 18435fbb525741328139e84a1e354954 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:21.545692 27861 raft_consensus.cc:359] T 80e2477670ec4db18ad338931d714544 P 2513a663afac495eb09126ff55e8b2b0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 38749 } } peers { permanent_uuid: "18435fbb525741328139e84a1e354954" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 40545 } } peers { permanent_uuid: "2513a663afac495eb09126ff55e8b2b0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40721 } }
I20260709 13:08:21.546383 27861 raft_consensus.cc:385] T 80e2477670ec4db18ad338931d714544 P 2513a663afac495eb09126ff55e8b2b0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:21.546628 27861 raft_consensus.cc:740] T 80e2477670ec4db18ad338931d714544 P 2513a663afac495eb09126ff55e8b2b0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2513a663afac495eb09126ff55e8b2b0, State: Initialized, Role: FOLLOWER
I20260709 13:08:21.547415 27861 consensus_queue.cc:260] T 80e2477670ec4db18ad338931d714544 P 2513a663afac495eb09126ff55e8b2b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 38749 } } peers { permanent_uuid: "18435fbb525741328139e84a1e354954" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 40545 } } peers { permanent_uuid: "2513a663afac495eb09126ff55e8b2b0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40721 } }
I20260709 13:08:21.549289 27861 ts_tablet_manager.cc:1434] T 80e2477670ec4db18ad338931d714544 P 2513a663afac495eb09126ff55e8b2b0: Time spent starting tablet: real 0.059s	user 0.007s	sys 0.000s
I20260709 13:08:21.550304 27861 tablet_bootstrap.cc:492] T e5847d81a5284a44a6b2b21cf6f4351c P 2513a663afac495eb09126ff55e8b2b0: Bootstrap starting.
I20260709 13:08:21.551071 27935 leader_election.cc:290] T 5e6f8bdfe11b4af4aa27a711db7cbe7a P 41268b218b804905a110c86738e74400 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2513a663afac495eb09126ff55e8b2b0 (127.17.223.1:40721), 665f7e09521a4c3f9284c1d8b0e094ff (127.17.223.3:38749)
I20260709 13:08:21.551232 27741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e6f8bdfe11b4af4aa27a711db7cbe7a" candidate_uuid: "41268b218b804905a110c86738e74400" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" is_pre_election: true
W20260709 13:08:21.554425 27634 leader_election.cc:343] T 5e6f8bdfe11b4af4aa27a711db7cbe7a P 41268b218b804905a110c86738e74400 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 665f7e09521a4c3f9284c1d8b0e094ff (127.17.223.3:38749): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:21.554970 27634 leader_election.cc:304] T 5e6f8bdfe11b4af4aa27a711db7cbe7a P 41268b218b804905a110c86738e74400 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 41268b218b804905a110c86738e74400; no voters: 2513a663afac495eb09126ff55e8b2b0, 665f7e09521a4c3f9284c1d8b0e094ff
I20260709 13:08:21.556011 28046 raft_consensus.cc:515] T e5847d81a5284a44a6b2b21cf6f4351c P 18435fbb525741328139e84a1e354954 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18435fbb525741328139e84a1e354954" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 40545 } } peers { permanent_uuid: "2513a663afac495eb09126ff55e8b2b0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40721 } } peers { permanent_uuid: "41268b218b804905a110c86738e74400" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 44403 } }
I20260709 13:08:21.558274 27862 tablet_bootstrap.cc:654] T 765d0bd527c64f74be713c390a018bba P 665f7e09521a4c3f9284c1d8b0e094ff: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:21.558959 27863 tablet_bootstrap.cc:654] T e9b149d77d9941158ead8e9e592e7b27 P 41268b218b804905a110c86738e74400: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:21.561717 28046 leader_election.cc:290] T e5847d81a5284a44a6b2b21cf6f4351c P 18435fbb525741328139e84a1e354954 [CANDIDATE]: Term 1 election: Requested vote from peers 2513a663afac495eb09126ff55e8b2b0 (127.17.223.1:40721), 41268b218b804905a110c86738e74400 (127.17.223.2:44403)
I20260709 13:08:21.563865 27592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5847d81a5284a44a6b2b21cf6f4351c" candidate_uuid: "18435fbb525741328139e84a1e354954" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2513a663afac495eb09126ff55e8b2b0"
I20260709 13:08:21.564978 27665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5847d81a5284a44a6b2b21cf6f4351c" candidate_uuid: "18435fbb525741328139e84a1e354954" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "41268b218b804905a110c86738e74400"
W20260709 13:08:21.565635 27779 leader_election.cc:343] T e5847d81a5284a44a6b2b21cf6f4351c P 18435fbb525741328139e84a1e354954 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 2513a663afac495eb09126ff55e8b2b0 (127.17.223.1:40721): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:21.565857 27665 raft_consensus.cc:3060] T e5847d81a5284a44a6b2b21cf6f4351c P 41268b218b804905a110c86738e74400 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:21.565873 27935 raft_consensus.cc:2749] T 5e6f8bdfe11b4af4aa27a711db7cbe7a P 41268b218b804905a110c86738e74400 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:08:21.567168 27865 ts_tablet_manager.cc:1434] T 1d9bdb76a5094186b5ac6c8f8e1c9840 P 18435fbb525741328139e84a1e354954: Time spent starting tablet: real 0.069s	user 0.006s	sys 0.001s
I20260709 13:08:21.568511 27865 tablet_bootstrap.cc:492] T c9ea919812394c7aba307c2ff5b81f51 P 18435fbb525741328139e84a1e354954: Bootstrap starting.
I20260709 13:08:21.570772 27982 raft_consensus.cc:493] T 5f4a8242380b4863bf5ad2c055229bb7 P 41268b218b804905a110c86738e74400 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:21.571323 27982 raft_consensus.cc:515] T 5f4a8242380b4863bf5ad2c055229bb7 P 41268b218b804905a110c86738e74400 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "41268b218b804905a110c86738e74400" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 44403 } } peers { permanent_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 38749 } } peers { permanent_uuid: "18435fbb525741328139e84a1e354954" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 40545 } }
I20260709 13:08:21.573580 27982 leader_election.cc:290] T 5f4a8242380b4863bf5ad2c055229bb7 P 41268b218b804905a110c86738e74400 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 665f7e09521a4c3f9284c1d8b0e094ff (127.17.223.3:38749), 18435fbb525741328139e84a1e354954 (127.17.223.4:40545)
I20260709 13:08:21.549803 27491 catalog_manager.cc:5697] T df06af11cae7484d969017fcb5b7e753 P 18435fbb525741328139e84a1e354954 reported cstate change: term changed from 0 to 1, leader changed from <none> to 18435fbb525741328139e84a1e354954 (127.17.223.4). New cstate: current_term: 1 leader_uuid: "18435fbb525741328139e84a1e354954" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "41268b218b804905a110c86738e74400" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 44403 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 38749 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "18435fbb525741328139e84a1e354954" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 40545 } health_report { overall_health: HEALTHY } } }
I20260709 13:08:21.579114 27665 raft_consensus.cc:2468] T e5847d81a5284a44a6b2b21cf6f4351c P 41268b218b804905a110c86738e74400 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 18435fbb525741328139e84a1e354954 in term 1.
I20260709 13:08:21.579463 28046 raft_consensus.cc:493] T 1d9bdb76a5094186b5ac6c8f8e1c9840 P 18435fbb525741328139e84a1e354954 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:21.581087 27741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f4a8242380b4863bf5ad2c055229bb7" candidate_uuid: "41268b218b804905a110c86738e74400" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" is_pre_election: true
I20260709 13:08:21.581355 27782 leader_election.cc:304] T e5847d81a5284a44a6b2b21cf6f4351c P 18435fbb525741328139e84a1e354954 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 18435fbb525741328139e84a1e354954, 41268b218b804905a110c86738e74400; no voters: 2513a663afac495eb09126ff55e8b2b0
I20260709 13:08:21.581655 28046 raft_consensus.cc:515] T 1d9bdb76a5094186b5ac6c8f8e1c9840 P 18435fbb525741328139e84a1e354954 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "41268b218b804905a110c86738e74400" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 44403 } } peers { permanent_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 38749 } } peers { permanent_uuid: "18435fbb525741328139e84a1e354954" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 40545 } }
I20260709 13:08:21.582561 27814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f4a8242380b4863bf5ad2c055229bb7" candidate_uuid: "41268b218b804905a110c86738e74400" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "18435fbb525741328139e84a1e354954" is_pre_election: true
W20260709 13:08:21.583155 27634 leader_election.cc:343] T 5f4a8242380b4863bf5ad2c055229bb7 P 41268b218b804905a110c86738e74400 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 665f7e09521a4c3f9284c1d8b0e094ff (127.17.223.3:38749): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:21.583971 28046 leader_election.cc:290] T 1d9bdb76a5094186b5ac6c8f8e1c9840 P 18435fbb525741328139e84a1e354954 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 41268b218b804905a110c86738e74400 (127.17.223.2:44403), 665f7e09521a4c3f9284c1d8b0e094ff (127.17.223.3:38749)
I20260709 13:08:21.586092 27741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d9bdb76a5094186b5ac6c8f8e1c9840" candidate_uuid: "18435fbb525741328139e84a1e354954" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" is_pre_election: true
I20260709 13:08:21.588747 27741 raft_consensus.cc:2468] T 1d9bdb76a5094186b5ac6c8f8e1c9840 P 665f7e09521a4c3f9284c1d8b0e094ff [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 18435fbb525741328139e84a1e354954 in term 0.
I20260709 13:08:21.585794 27964 raft_consensus.cc:2804] T e5847d81a5284a44a6b2b21cf6f4351c P 18435fbb525741328139e84a1e354954 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:08:21.589795 27964 raft_consensus.cc:697] T e5847d81a5284a44a6b2b21cf6f4351c P 18435fbb525741328139e84a1e354954 [term 1 LEADER]: Becoming Leader. State: Replica: 18435fbb525741328139e84a1e354954, State: Running, Role: LEADER
I20260709 13:08:21.591114 27665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d9bdb76a5094186b5ac6c8f8e1c9840" candidate_uuid: "18435fbb525741328139e84a1e354954" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "41268b218b804905a110c86738e74400" is_pre_election: true
I20260709 13:08:21.591811 27665 raft_consensus.cc:2468] T 1d9bdb76a5094186b5ac6c8f8e1c9840 P 41268b218b804905a110c86738e74400 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 18435fbb525741328139e84a1e354954 in term 0.
I20260709 13:08:21.590757 27964 consensus_queue.cc:237] T e5847d81a5284a44a6b2b21cf6f4351c P 18435fbb525741328139e84a1e354954 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18435fbb525741328139e84a1e354954" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 40545 } } peers { permanent_uuid: "2513a663afac495eb09126ff55e8b2b0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40721 } } peers { permanent_uuid: "41268b218b804905a110c86738e74400" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 44403 } }
W20260709 13:08:21.586845 27634 leader_election.cc:343] T 5f4a8242380b4863bf5ad2c055229bb7 P 41268b218b804905a110c86738e74400 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 18435fbb525741328139e84a1e354954 (127.17.223.4:40545): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:21.593148 27861 tablet_bootstrap.cc:654] T e5847d81a5284a44a6b2b21cf6f4351c P 2513a663afac495eb09126ff55e8b2b0: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:21.593039 27782 leader_election.cc:304] T 1d9bdb76a5094186b5ac6c8f8e1c9840 P 18435fbb525741328139e84a1e354954 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 18435fbb525741328139e84a1e354954, 665f7e09521a4c3f9284c1d8b0e094ff; no voters: 
I20260709 13:08:21.602049 27865 tablet_bootstrap.cc:654] T c9ea919812394c7aba307c2ff5b81f51 P 18435fbb525741328139e84a1e354954: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:21.601755 28046 raft_consensus.cc:2804] T 1d9bdb76a5094186b5ac6c8f8e1c9840 P 18435fbb525741328139e84a1e354954 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:08:21.608085 27863 tablet_bootstrap.cc:492] T e9b149d77d9941158ead8e9e592e7b27 P 41268b218b804905a110c86738e74400: No bootstrap required, opened a new log
I20260709 13:08:21.596580 27634 leader_election.cc:304] T 5f4a8242380b4863bf5ad2c055229bb7 P 41268b218b804905a110c86738e74400 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 41268b218b804905a110c86738e74400; no voters: 18435fbb525741328139e84a1e354954, 665f7e09521a4c3f9284c1d8b0e094ff
I20260709 13:08:21.608796 28046 raft_consensus.cc:493] T 1d9bdb76a5094186b5ac6c8f8e1c9840 P 18435fbb525741328139e84a1e354954 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:21.608814 27863 ts_tablet_manager.cc:1403] T e9b149d77d9941158ead8e9e592e7b27 P 41268b218b804905a110c86738e74400: Time spent bootstrapping tablet: real 0.075s	user 0.020s	sys 0.001s
I20260709 13:08:21.609221 28046 raft_consensus.cc:3060] T 1d9bdb76a5094186b5ac6c8f8e1c9840 P 18435fbb525741328139e84a1e354954 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:21.610921 27982 raft_consensus.cc:2749] T 5f4a8242380b4863bf5ad2c055229bb7 P 41268b218b804905a110c86738e74400 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:08:21.615196 28037 raft_consensus.cc:493] T 80e2477670ec4db18ad338931d714544 P 2513a663afac495eb09126ff55e8b2b0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:21.616335 28037 raft_consensus.cc:515] T 80e2477670ec4db18ad338931d714544 P 2513a663afac495eb09126ff55e8b2b0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 38749 } } peers { permanent_uuid: "18435fbb525741328139e84a1e354954" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 40545 } } peers { permanent_uuid: "2513a663afac495eb09126ff55e8b2b0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40721 } }
I20260709 13:08:21.628979 27741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80e2477670ec4db18ad338931d714544" candidate_uuid: "2513a663afac495eb09126ff55e8b2b0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" is_pre_election: true
I20260709 13:08:21.630052 27862 tablet_bootstrap.cc:492] T 765d0bd527c64f74be713c390a018bba P 665f7e09521a4c3f9284c1d8b0e094ff: No bootstrap required, opened a new log
I20260709 13:08:21.630360 27741 raft_consensus.cc:2468] T 80e2477670ec4db18ad338931d714544 P 665f7e09521a4c3f9284c1d8b0e094ff [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2513a663afac495eb09126ff55e8b2b0 in term 0.
I20260709 13:08:21.630589 27862 ts_tablet_manager.cc:1403] T 765d0bd527c64f74be713c390a018bba P 665f7e09521a4c3f9284c1d8b0e094ff: Time spent bootstrapping tablet: real 0.164s	user 0.012s	sys 0.005s
I20260709 13:08:21.631580 27863 raft_consensus.cc:359] T e9b149d77d9941158ead8e9e592e7b27 P 41268b218b804905a110c86738e74400 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18435fbb525741328139e84a1e354954" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 40545 } } peers { permanent_uuid: "2513a663afac495eb09126ff55e8b2b0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40721 } } peers { permanent_uuid: "41268b218b804905a110c86738e74400" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 44403 } }
I20260709 13:08:21.632378 27863 raft_consensus.cc:385] T e9b149d77d9941158ead8e9e592e7b27 P 41268b218b804905a110c86738e74400 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:21.632692 27863 raft_consensus.cc:740] T e9b149d77d9941158ead8e9e592e7b27 P 41268b218b804905a110c86738e74400 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 41268b218b804905a110c86738e74400, State: Initialized, Role: FOLLOWER
I20260709 13:08:21.633446 27863 consensus_queue.cc:260] T e9b149d77d9941158ead8e9e592e7b27 P 41268b218b804905a110c86738e74400 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18435fbb525741328139e84a1e354954" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 40545 } } peers { permanent_uuid: "2513a663afac495eb09126ff55e8b2b0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40721 } } peers { permanent_uuid: "41268b218b804905a110c86738e74400" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 44403 } }
I20260709 13:08:21.633589 27862 raft_consensus.cc:359] T 765d0bd527c64f74be713c390a018bba P 665f7e09521a4c3f9284c1d8b0e094ff [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2513a663afac495eb09126ff55e8b2b0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40721 } } peers { permanent_uuid: "41268b218b804905a110c86738e74400" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 44403 } } peers { permanent_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 38749 } }
I20260709 13:08:21.634037 27559 leader_election.cc:304] T 80e2477670ec4db18ad338931d714544 P 2513a663afac495eb09126ff55e8b2b0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2513a663afac495eb09126ff55e8b2b0, 665f7e09521a4c3f9284c1d8b0e094ff; no voters: 
I20260709 13:08:21.634292 27862 raft_consensus.cc:385] T 765d0bd527c64f74be713c390a018bba P 665f7e09521a4c3f9284c1d8b0e094ff [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:21.634927 27862 raft_consensus.cc:740] T 765d0bd527c64f74be713c390a018bba P 665f7e09521a4c3f9284c1d8b0e094ff [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 665f7e09521a4c3f9284c1d8b0e094ff, State: Initialized, Role: FOLLOWER
I20260709 13:08:21.636423 27862 consensus_queue.cc:260] T 765d0bd527c64f74be713c390a018bba P 665f7e09521a4c3f9284c1d8b0e094ff [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2513a663afac495eb09126ff55e8b2b0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40721 } } peers { permanent_uuid: "41268b218b804905a110c86738e74400" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 44403 } } peers { permanent_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 38749 } }
I20260709 13:08:21.636770 27898 raft_consensus.cc:2804] T 80e2477670ec4db18ad338931d714544 P 2513a663afac495eb09126ff55e8b2b0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:08:21.638882 27898 raft_consensus.cc:493] T 80e2477670ec4db18ad338931d714544 P 2513a663afac495eb09126ff55e8b2b0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:21.639171 27898 raft_consensus.cc:3060] T 80e2477670ec4db18ad338931d714544 P 2513a663afac495eb09126ff55e8b2b0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:21.640422 27861 tablet_bootstrap.cc:492] T e5847d81a5284a44a6b2b21cf6f4351c P 2513a663afac495eb09126ff55e8b2b0: No bootstrap required, opened a new log
I20260709 13:08:21.641068 27861 ts_tablet_manager.cc:1403] T e5847d81a5284a44a6b2b21cf6f4351c P 2513a663afac495eb09126ff55e8b2b0: Time spent bootstrapping tablet: real 0.091s	user 0.014s	sys 0.007s
I20260709 13:08:21.637076 28037 leader_election.cc:290] T 80e2477670ec4db18ad338931d714544 P 2513a663afac495eb09126ff55e8b2b0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 665f7e09521a4c3f9284c1d8b0e094ff (127.17.223.3:38749), 18435fbb525741328139e84a1e354954 (127.17.223.4:40545)
I20260709 13:08:21.647037 27861 raft_consensus.cc:359] T e5847d81a5284a44a6b2b21cf6f4351c P 2513a663afac495eb09126ff55e8b2b0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18435fbb525741328139e84a1e354954" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 40545 } } peers { permanent_uuid: "2513a663afac495eb09126ff55e8b2b0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40721 } } peers { permanent_uuid: "41268b218b804905a110c86738e74400" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 44403 } }
I20260709 13:08:21.647671 27861 raft_consensus.cc:385] T e5847d81a5284a44a6b2b21cf6f4351c P 2513a663afac495eb09126ff55e8b2b0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:21.647946 27861 raft_consensus.cc:740] T e5847d81a5284a44a6b2b21cf6f4351c P 2513a663afac495eb09126ff55e8b2b0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2513a663afac495eb09126ff55e8b2b0, State: Initialized, Role: FOLLOWER
I20260709 13:08:21.648613 27861 consensus_queue.cc:260] T e5847d81a5284a44a6b2b21cf6f4351c P 2513a663afac495eb09126ff55e8b2b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18435fbb525741328139e84a1e354954" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 40545 } } peers { permanent_uuid: "2513a663afac495eb09126ff55e8b2b0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40721 } } peers { permanent_uuid: "41268b218b804905a110c86738e74400" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 44403 } }
I20260709 13:08:21.648792 27898 raft_consensus.cc:515] T 80e2477670ec4db18ad338931d714544 P 2513a663afac495eb09126ff55e8b2b0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 38749 } } peers { permanent_uuid: "18435fbb525741328139e84a1e354954" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 40545 } } peers { permanent_uuid: "2513a663afac495eb09126ff55e8b2b0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40721 } }
I20260709 13:08:21.649931 27863 ts_tablet_manager.cc:1434] T e9b149d77d9941158ead8e9e592e7b27 P 41268b218b804905a110c86738e74400: Time spent starting tablet: real 0.040s	user 0.007s	sys 0.000s
I20260709 13:08:21.652804 27861 ts_tablet_manager.cc:1434] T e5847d81a5284a44a6b2b21cf6f4351c P 2513a663afac495eb09126ff55e8b2b0: Time spent starting tablet: real 0.010s	user 0.005s	sys 0.001s
I20260709 13:08:21.657786 27935 consensus_queue.cc:1048] T 68cc2880cf79462c99d9009957eb5fd2 P 41268b218b804905a110c86738e74400 [LEADER]: Connected to new peer: Peer: permanent_uuid: "18435fbb525741328139e84a1e354954" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 40545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:08:21.658409 27861 tablet_bootstrap.cc:492] T 47b65672307641ae81d5f94c639b1a10 P 2513a663afac495eb09126ff55e8b2b0: Bootstrap starting.
I20260709 13:08:21.659507 27814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80e2477670ec4db18ad338931d714544" candidate_uuid: "2513a663afac495eb09126ff55e8b2b0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "18435fbb525741328139e84a1e354954" is_pre_election: true
W20260709 13:08:21.661018 27559 leader_election.cc:343] T 80e2477670ec4db18ad338931d714544 P 2513a663afac495eb09126ff55e8b2b0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 18435fbb525741328139e84a1e354954 (127.17.223.4:40545): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:21.661705 27863 tablet_bootstrap.cc:492] T 47b65672307641ae81d5f94c639b1a10 P 41268b218b804905a110c86738e74400: Bootstrap starting.
I20260709 13:08:21.662885 27487 catalog_manager.cc:5697] T e5847d81a5284a44a6b2b21cf6f4351c P 18435fbb525741328139e84a1e354954 reported cstate change: term changed from 0 to 1, leader changed from <none> to 18435fbb525741328139e84a1e354954 (127.17.223.4). New cstate: current_term: 1 leader_uuid: "18435fbb525741328139e84a1e354954" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18435fbb525741328139e84a1e354954" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 40545 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2513a663afac495eb09126ff55e8b2b0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40721 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "41268b218b804905a110c86738e74400" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 44403 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:21.674748 27862 ts_tablet_manager.cc:1434] T 765d0bd527c64f74be713c390a018bba P 665f7e09521a4c3f9284c1d8b0e094ff: Time spent starting tablet: real 0.044s	user 0.007s	sys 0.000s
I20260709 13:08:21.680116 27739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80e2477670ec4db18ad338931d714544" candidate_uuid: "2513a663afac495eb09126ff55e8b2b0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "665f7e09521a4c3f9284c1d8b0e094ff"
I20260709 13:08:21.680821 27739 raft_consensus.cc:3060] T 80e2477670ec4db18ad338931d714544 P 665f7e09521a4c3f9284c1d8b0e094ff [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:21.687223 27982 consensus_queue.cc:1048] T 68cc2880cf79462c99d9009957eb5fd2 P 41268b218b804905a110c86738e74400 [LEADER]: Connected to new peer: Peer: permanent_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 38749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:08:21.693081 27898 leader_election.cc:290] T 80e2477670ec4db18ad338931d714544 P 2513a663afac495eb09126ff55e8b2b0 [CANDIDATE]: Term 1 election: Requested vote from peers 665f7e09521a4c3f9284c1d8b0e094ff (127.17.223.3:38749), 18435fbb525741328139e84a1e354954 (127.17.223.4:40545)
I20260709 13:08:21.693347 27862 tablet_bootstrap.cc:492] T 5e6f8bdfe11b4af4aa27a711db7cbe7a P 665f7e09521a4c3f9284c1d8b0e094ff: Bootstrap starting.
I20260709 13:08:21.694660 27816 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80e2477670ec4db18ad338931d714544" candidate_uuid: "2513a663afac495eb09126ff55e8b2b0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "18435fbb525741328139e84a1e354954"
W20260709 13:08:21.705417 27559 leader_election.cc:343] T 80e2477670ec4db18ad338931d714544 P 2513a663afac495eb09126ff55e8b2b0 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 18435fbb525741328139e84a1e354954 (127.17.223.4:40545): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:21.706719 27863 tablet_bootstrap.cc:654] T 47b65672307641ae81d5f94c639b1a10 P 41268b218b804905a110c86738e74400: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:21.712133 27865 tablet_bootstrap.cc:492] T c9ea919812394c7aba307c2ff5b81f51 P 18435fbb525741328139e84a1e354954: No bootstrap required, opened a new log
I20260709 13:08:21.712611 27865 ts_tablet_manager.cc:1403] T c9ea919812394c7aba307c2ff5b81f51 P 18435fbb525741328139e84a1e354954: Time spent bootstrapping tablet: real 0.144s	user 0.011s	sys 0.016s
I20260709 13:08:21.712949 28046 raft_consensus.cc:515] T 1d9bdb76a5094186b5ac6c8f8e1c9840 P 18435fbb525741328139e84a1e354954 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "41268b218b804905a110c86738e74400" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 44403 } } peers { permanent_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 38749 } } peers { permanent_uuid: "18435fbb525741328139e84a1e354954" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 40545 } }
I20260709 13:08:21.715137 28046 leader_election.cc:290] T 1d9bdb76a5094186b5ac6c8f8e1c9840 P 18435fbb525741328139e84a1e354954 [CANDIDATE]: Term 1 election: Requested vote from peers 41268b218b804905a110c86738e74400 (127.17.223.2:44403), 665f7e09521a4c3f9284c1d8b0e094ff (127.17.223.3:38749)
I20260709 13:08:21.716185 27741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d9bdb76a5094186b5ac6c8f8e1c9840" candidate_uuid: "18435fbb525741328139e84a1e354954" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "665f7e09521a4c3f9284c1d8b0e094ff"
I20260709 13:08:21.695694 27739 raft_consensus.cc:2468] T 80e2477670ec4db18ad338931d714544 P 665f7e09521a4c3f9284c1d8b0e094ff [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2513a663afac495eb09126ff55e8b2b0 in term 1.
I20260709 13:08:21.680927 27861 tablet_bootstrap.cc:654] T 47b65672307641ae81d5f94c639b1a10 P 2513a663afac495eb09126ff55e8b2b0: Neither blocks nor log segments found. Creating new log.
W20260709 13:08:21.696063 27708 consensus_peers.cc:597] T c9ea919812394c7aba307c2ff5b81f51 P 665f7e09521a4c3f9284c1d8b0e094ff -> Peer 18435fbb525741328139e84a1e354954 (127.17.223.4:40545): Couldn't send request to peer 18435fbb525741328139e84a1e354954. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:08:21.719197 27862 tablet_bootstrap.cc:654] T 5e6f8bdfe11b4af4aa27a711db7cbe7a P 665f7e09521a4c3f9284c1d8b0e094ff: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:21.720660 27559 leader_election.cc:304] T 80e2477670ec4db18ad338931d714544 P 2513a663afac495eb09126ff55e8b2b0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2513a663afac495eb09126ff55e8b2b0, 665f7e09521a4c3f9284c1d8b0e094ff; no voters: 18435fbb525741328139e84a1e354954
I20260709 13:08:21.732177 27870 raft_consensus.cc:2804] T 80e2477670ec4db18ad338931d714544 P 2513a663afac495eb09126ff55e8b2b0 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:08:21.733067 27870 raft_consensus.cc:697] T 80e2477670ec4db18ad338931d714544 P 2513a663afac495eb09126ff55e8b2b0 [term 1 LEADER]: Becoming Leader. State: Replica: 2513a663afac495eb09126ff55e8b2b0, State: Running, Role: LEADER
I20260709 13:08:21.734153 27870 consensus_queue.cc:237] T 80e2477670ec4db18ad338931d714544 P 2513a663afac495eb09126ff55e8b2b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 38749 } } peers { permanent_uuid: "18435fbb525741328139e84a1e354954" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 40545 } } peers { permanent_uuid: "2513a663afac495eb09126ff55e8b2b0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40721 } }
I20260709 13:08:21.716852 27741 raft_consensus.cc:3060] T 1d9bdb76a5094186b5ac6c8f8e1c9840 P 665f7e09521a4c3f9284c1d8b0e094ff [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:21.722869 27666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d9bdb76a5094186b5ac6c8f8e1c9840" candidate_uuid: "18435fbb525741328139e84a1e354954" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "41268b218b804905a110c86738e74400"
I20260709 13:08:21.738976 27666 raft_consensus.cc:3060] T 1d9bdb76a5094186b5ac6c8f8e1c9840 P 41268b218b804905a110c86738e74400 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:21.749859 27898 raft_consensus.cc:493] T e5847d81a5284a44a6b2b21cf6f4351c P 2513a663afac495eb09126ff55e8b2b0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:21.750453 27898 raft_consensus.cc:515] T e5847d81a5284a44a6b2b21cf6f4351c P 2513a663afac495eb09126ff55e8b2b0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18435fbb525741328139e84a1e354954" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 40545 } } peers { permanent_uuid: "2513a663afac495eb09126ff55e8b2b0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40721 } } peers { permanent_uuid: "41268b218b804905a110c86738e74400" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 44403 } }
I20260709 13:08:21.753888 27814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5847d81a5284a44a6b2b21cf6f4351c" candidate_uuid: "2513a663afac495eb09126ff55e8b2b0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "18435fbb525741328139e84a1e354954" is_pre_election: true
I20260709 13:08:21.743172 27865 raft_consensus.cc:359] T c9ea919812394c7aba307c2ff5b81f51 P 18435fbb525741328139e84a1e354954 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 38749 } } peers { permanent_uuid: "18435fbb525741328139e84a1e354954" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 40545 } } peers { permanent_uuid: "2513a663afac495eb09126ff55e8b2b0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40721 } }
I20260709 13:08:21.756577 27865 raft_consensus.cc:385] T c9ea919812394c7aba307c2ff5b81f51 P 18435fbb525741328139e84a1e354954 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:21.756975 27865 raft_consensus.cc:740] T c9ea919812394c7aba307c2ff5b81f51 P 18435fbb525741328139e84a1e354954 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 18435fbb525741328139e84a1e354954, State: Initialized, Role: FOLLOWER
I20260709 13:08:21.757543 27665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5847d81a5284a44a6b2b21cf6f4351c" candidate_uuid: "2513a663afac495eb09126ff55e8b2b0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "41268b218b804905a110c86738e74400" is_pre_election: true
I20260709 13:08:21.758533 27665 raft_consensus.cc:2393] T e5847d81a5284a44a6b2b21cf6f4351c P 41268b218b804905a110c86738e74400 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2513a663afac495eb09126ff55e8b2b0 in current term 1: Already voted for candidate 18435fbb525741328139e84a1e354954 in this term.
I20260709 13:08:21.759816 27559 leader_election.cc:304] T e5847d81a5284a44a6b2b21cf6f4351c P 2513a663afac495eb09126ff55e8b2b0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2513a663afac495eb09126ff55e8b2b0; no voters: 18435fbb525741328139e84a1e354954, 41268b218b804905a110c86738e74400
I20260709 13:08:21.761050 27957 raft_consensus.cc:3060] T e5847d81a5284a44a6b2b21cf6f4351c P 2513a663afac495eb09126ff55e8b2b0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:21.761647 27863 tablet_bootstrap.cc:492] T 47b65672307641ae81d5f94c639b1a10 P 41268b218b804905a110c86738e74400: No bootstrap required, opened a new log
I20260709 13:08:21.762208 27863 ts_tablet_manager.cc:1403] T 47b65672307641ae81d5f94c639b1a10 P 41268b218b804905a110c86738e74400: Time spent bootstrapping tablet: real 0.106s	user 0.020s	sys 0.005s
I20260709 13:08:21.759971 27666 raft_consensus.cc:2468] T 1d9bdb76a5094186b5ac6c8f8e1c9840 P 41268b218b804905a110c86738e74400 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 18435fbb525741328139e84a1e354954 in term 1.
I20260709 13:08:21.765460 27782 leader_election.cc:304] T 1d9bdb76a5094186b5ac6c8f8e1c9840 P 18435fbb525741328139e84a1e354954 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 18435fbb525741328139e84a1e354954, 41268b218b804905a110c86738e74400; no voters: 
I20260709 13:08:21.766351 27964 raft_consensus.cc:2804] T 1d9bdb76a5094186b5ac6c8f8e1c9840 P 18435fbb525741328139e84a1e354954 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:08:21.754010 27898 leader_election.cc:290] T e5847d81a5284a44a6b2b21cf6f4351c P 2513a663afac495eb09126ff55e8b2b0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 18435fbb525741328139e84a1e354954 (127.17.223.4:40545), 41268b218b804905a110c86738e74400 (127.17.223.2:44403)
I20260709 13:08:21.766396 27863 raft_consensus.cc:359] T 47b65672307641ae81d5f94c639b1a10 P 41268b218b804905a110c86738e74400 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2513a663afac495eb09126ff55e8b2b0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40721 } } peers { permanent_uuid: "41268b218b804905a110c86738e74400" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 44403 } } peers { permanent_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 38749 } }
I20260709 13:08:21.767686 27863 raft_consensus.cc:385] T 47b65672307641ae81d5f94c639b1a10 P 41268b218b804905a110c86738e74400 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:21.768021 27863 raft_consensus.cc:740] T 47b65672307641ae81d5f94c639b1a10 P 41268b218b804905a110c86738e74400 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 41268b218b804905a110c86738e74400, State: Initialized, Role: FOLLOWER
I20260709 13:08:21.766981 27964 raft_consensus.cc:697] T 1d9bdb76a5094186b5ac6c8f8e1c9840 P 18435fbb525741328139e84a1e354954 [term 1 LEADER]: Becoming Leader. State: Replica: 18435fbb525741328139e84a1e354954, State: Running, Role: LEADER
I20260709 13:08:21.768765 27865 consensus_queue.cc:260] T c9ea919812394c7aba307c2ff5b81f51 P 18435fbb525741328139e84a1e354954 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 38749 } } peers { permanent_uuid: "18435fbb525741328139e84a1e354954" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 40545 } } peers { permanent_uuid: "2513a663afac495eb09126ff55e8b2b0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40721 } }
I20260709 13:08:21.770171 28046 raft_consensus.cc:493] T c9ea919812394c7aba307c2ff5b81f51 P 18435fbb525741328139e84a1e354954 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:21.770972 28046 raft_consensus.cc:515] T c9ea919812394c7aba307c2ff5b81f51 P 18435fbb525741328139e84a1e354954 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 38749 } } peers { permanent_uuid: "18435fbb525741328139e84a1e354954" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 40545 } } peers { permanent_uuid: "2513a663afac495eb09126ff55e8b2b0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40721 } }
I20260709 13:08:21.771050 27964 consensus_queue.cc:237] T 1d9bdb76a5094186b5ac6c8f8e1c9840 P 18435fbb525741328139e84a1e354954 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "41268b218b804905a110c86738e74400" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 44403 } } peers { permanent_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 38749 } } peers { permanent_uuid: "18435fbb525741328139e84a1e354954" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 40545 } }
I20260709 13:08:21.772400 27741 raft_consensus.cc:2468] T 1d9bdb76a5094186b5ac6c8f8e1c9840 P 665f7e09521a4c3f9284c1d8b0e094ff [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 18435fbb525741328139e84a1e354954 in term 1.
I20260709 13:08:21.779585 27863 consensus_queue.cc:260] T 47b65672307641ae81d5f94c639b1a10 P 41268b218b804905a110c86738e74400 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2513a663afac495eb09126ff55e8b2b0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40721 } } peers { permanent_uuid: "41268b218b804905a110c86738e74400" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 44403 } } peers { permanent_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 38749 } }
I20260709 13:08:21.791497 27957 raft_consensus.cc:2749] T e5847d81a5284a44a6b2b21cf6f4351c P 2513a663afac495eb09126ff55e8b2b0 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:08:21.794378 27861 tablet_bootstrap.cc:492] T 47b65672307641ae81d5f94c639b1a10 P 2513a663afac495eb09126ff55e8b2b0: No bootstrap required, opened a new log
I20260709 13:08:21.794991 27861 ts_tablet_manager.cc:1403] T 47b65672307641ae81d5f94c639b1a10 P 2513a663afac495eb09126ff55e8b2b0: Time spent bootstrapping tablet: real 0.137s	user 0.019s	sys 0.010s
I20260709 13:08:21.799154 28046 leader_election.cc:290] T c9ea919812394c7aba307c2ff5b81f51 P 18435fbb525741328139e84a1e354954 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 665f7e09521a4c3f9284c1d8b0e094ff (127.17.223.3:38749), 2513a663afac495eb09126ff55e8b2b0 (127.17.223.1:40721)
I20260709 13:08:21.801210 27592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9ea919812394c7aba307c2ff5b81f51" candidate_uuid: "18435fbb525741328139e84a1e354954" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2513a663afac495eb09126ff55e8b2b0" is_pre_election: true
I20260709 13:08:21.803117 27592 raft_consensus.cc:2393] T c9ea919812394c7aba307c2ff5b81f51 P 2513a663afac495eb09126ff55e8b2b0 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 18435fbb525741328139e84a1e354954 in current term 1: Already voted for candidate 665f7e09521a4c3f9284c1d8b0e094ff in this term.
I20260709 13:08:21.808951 27865 ts_tablet_manager.cc:1434] T c9ea919812394c7aba307c2ff5b81f51 P 18435fbb525741328139e84a1e354954: Time spent starting tablet: real 0.096s	user 0.006s	sys 0.001s
I20260709 13:08:21.812754 27861 raft_consensus.cc:359] T 47b65672307641ae81d5f94c639b1a10 P 2513a663afac495eb09126ff55e8b2b0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2513a663afac495eb09126ff55e8b2b0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40721 } } peers { permanent_uuid: "41268b218b804905a110c86738e74400" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 44403 } } peers { permanent_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 38749 } }
I20260709 13:08:21.813570 27861 raft_consensus.cc:385] T 47b65672307641ae81d5f94c639b1a10 P 2513a663afac495eb09126ff55e8b2b0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:21.813872 27861 raft_consensus.cc:740] T 47b65672307641ae81d5f94c639b1a10 P 2513a663afac495eb09126ff55e8b2b0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2513a663afac495eb09126ff55e8b2b0, State: Initialized, Role: FOLLOWER
I20260709 13:08:21.814929 27865 tablet_bootstrap.cc:492] T 80e2477670ec4db18ad338931d714544 P 18435fbb525741328139e84a1e354954: Bootstrap starting.
I20260709 13:08:21.818334 27487 catalog_manager.cc:5697] T 1d9bdb76a5094186b5ac6c8f8e1c9840 P 18435fbb525741328139e84a1e354954 reported cstate change: term changed from 0 to 1, leader changed from <none> to 18435fbb525741328139e84a1e354954 (127.17.223.4). New cstate: current_term: 1 leader_uuid: "18435fbb525741328139e84a1e354954" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "41268b218b804905a110c86738e74400" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 44403 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 38749 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "18435fbb525741328139e84a1e354954" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 40545 } health_report { overall_health: HEALTHY } } }
I20260709 13:08:21.821732 27982 consensus_queue.cc:1048] T 15a4c537259e4b2882a5cc8e723b260a P 41268b218b804905a110c86738e74400 [LEADER]: Connected to new peer: Peer: permanent_uuid: "18435fbb525741328139e84a1e354954" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 40545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:08:21.822407 27861 consensus_queue.cc:260] T 47b65672307641ae81d5f94c639b1a10 P 2513a663afac495eb09126ff55e8b2b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2513a663afac495eb09126ff55e8b2b0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40721 } } peers { permanent_uuid: "41268b218b804905a110c86738e74400" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 44403 } } peers { permanent_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 38749 } }
I20260709 13:08:21.824144 27861 ts_tablet_manager.cc:1434] T 47b65672307641ae81d5f94c639b1a10 P 2513a663afac495eb09126ff55e8b2b0: Time spent starting tablet: real 0.029s	user 0.005s	sys 0.001s
I20260709 13:08:21.825199 27861 tablet_bootstrap.cc:492] T 5e6f8bdfe11b4af4aa27a711db7cbe7a P 2513a663afac495eb09126ff55e8b2b0: Bootstrap starting.
I20260709 13:08:21.824610 27488 catalog_manager.cc:5697] T 80e2477670ec4db18ad338931d714544 P 2513a663afac495eb09126ff55e8b2b0 reported cstate change: term changed from 0 to 1, leader changed from <none> to 2513a663afac495eb09126ff55e8b2b0 (127.17.223.1). New cstate: current_term: 1 leader_uuid: "2513a663afac495eb09126ff55e8b2b0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 38749 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "18435fbb525741328139e84a1e354954" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 40545 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2513a663afac495eb09126ff55e8b2b0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40721 } health_report { overall_health: HEALTHY } } }
I20260709 13:08:21.847155 27861 tablet_bootstrap.cc:654] T 5e6f8bdfe11b4af4aa27a711db7cbe7a P 2513a663afac495eb09126ff55e8b2b0: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:21.847600 27865 tablet_bootstrap.cc:654] T 80e2477670ec4db18ad338931d714544 P 18435fbb525741328139e84a1e354954: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:21.849210 27863 ts_tablet_manager.cc:1434] T 47b65672307641ae81d5f94c639b1a10 P 41268b218b804905a110c86738e74400: Time spent starting tablet: real 0.087s	user 0.006s	sys 0.001s
I20260709 13:08:21.843015 27741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9ea919812394c7aba307c2ff5b81f51" candidate_uuid: "18435fbb525741328139e84a1e354954" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" is_pre_election: true
I20260709 13:08:21.859140 27862 tablet_bootstrap.cc:492] T 5e6f8bdfe11b4af4aa27a711db7cbe7a P 665f7e09521a4c3f9284c1d8b0e094ff: No bootstrap required, opened a new log
I20260709 13:08:21.859660 27862 ts_tablet_manager.cc:1403] T 5e6f8bdfe11b4af4aa27a711db7cbe7a P 665f7e09521a4c3f9284c1d8b0e094ff: Time spent bootstrapping tablet: real 0.167s	user 0.011s	sys 0.002s
I20260709 13:08:21.869647 27863 tablet_bootstrap.cc:492] T bc77856749a0473a8b3124ce8c523815 P 41268b218b804905a110c86738e74400: Bootstrap starting.
I20260709 13:08:21.871552 28037 raft_consensus.cc:493] T 47b65672307641ae81d5f94c639b1a10 P 2513a663afac495eb09126ff55e8b2b0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:21.873653 28037 raft_consensus.cc:515] T 47b65672307641ae81d5f94c639b1a10 P 2513a663afac495eb09126ff55e8b2b0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2513a663afac495eb09126ff55e8b2b0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40721 } } peers { permanent_uuid: "41268b218b804905a110c86738e74400" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 44403 } } peers { permanent_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 38749 } }
I20260709 13:08:21.875846 28037 leader_election.cc:290] T 47b65672307641ae81d5f94c639b1a10 P 2513a663afac495eb09126ff55e8b2b0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 41268b218b804905a110c86738e74400 (127.17.223.2:44403), 665f7e09521a4c3f9284c1d8b0e094ff (127.17.223.3:38749)
I20260709 13:08:21.882328 27665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47b65672307641ae81d5f94c639b1a10" candidate_uuid: "2513a663afac495eb09126ff55e8b2b0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "41268b218b804905a110c86738e74400" is_pre_election: true
I20260709 13:08:21.883965 27978 consensus_queue.cc:1048] T 765d0bd527c64f74be713c390a018bba P 41268b218b804905a110c86738e74400 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2513a663afac495eb09126ff55e8b2b0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40721 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:08:21.884171 27665 raft_consensus.cc:2468] T 47b65672307641ae81d5f94c639b1a10 P 41268b218b804905a110c86738e74400 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2513a663afac495eb09126ff55e8b2b0 in term 0.
I20260709 13:08:21.885531 27782 leader_election.cc:304] T c9ea919812394c7aba307c2ff5b81f51 P 18435fbb525741328139e84a1e354954 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 18435fbb525741328139e84a1e354954; no voters: 2513a663afac495eb09126ff55e8b2b0, 665f7e09521a4c3f9284c1d8b0e094ff
I20260709 13:08:21.886217 28060 consensus_queue.cc:1048] T c9ea919812394c7aba307c2ff5b81f51 P 665f7e09521a4c3f9284c1d8b0e094ff [LEADER]: Connected to new peer: Peer: permanent_uuid: "2513a663afac495eb09126ff55e8b2b0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40721 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:08:21.887198 27964 raft_consensus.cc:3060] T c9ea919812394c7aba307c2ff5b81f51 P 18435fbb525741328139e84a1e354954 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:21.889976 27862 raft_consensus.cc:359] T 5e6f8bdfe11b4af4aa27a711db7cbe7a P 665f7e09521a4c3f9284c1d8b0e094ff [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2513a663afac495eb09126ff55e8b2b0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40721 } } peers { permanent_uuid: "41268b218b804905a110c86738e74400" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 44403 } } peers { permanent_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 38749 } }
I20260709 13:08:21.890887 27862 raft_consensus.cc:385] T 5e6f8bdfe11b4af4aa27a711db7cbe7a P 665f7e09521a4c3f9284c1d8b0e094ff [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:21.891230 27862 raft_consensus.cc:740] T 5e6f8bdfe11b4af4aa27a711db7cbe7a P 665f7e09521a4c3f9284c1d8b0e094ff [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 665f7e09521a4c3f9284c1d8b0e094ff, State: Initialized, Role: FOLLOWER
I20260709 13:08:21.894420 27559 leader_election.cc:304] T 47b65672307641ae81d5f94c639b1a10 P 2513a663afac495eb09126ff55e8b2b0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2513a663afac495eb09126ff55e8b2b0, 41268b218b804905a110c86738e74400; no voters: 
I20260709 13:08:21.895303 28037 raft_consensus.cc:2804] T 47b65672307641ae81d5f94c639b1a10 P 2513a663afac495eb09126ff55e8b2b0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:08:21.895838 28037 raft_consensus.cc:493] T 47b65672307641ae81d5f94c639b1a10 P 2513a663afac495eb09126ff55e8b2b0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:21.898056 28037 raft_consensus.cc:3060] T 47b65672307641ae81d5f94c639b1a10 P 2513a663afac495eb09126ff55e8b2b0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:21.906905 27862 consensus_queue.cc:260] T 5e6f8bdfe11b4af4aa27a711db7cbe7a P 665f7e09521a4c3f9284c1d8b0e094ff [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2513a663afac495eb09126ff55e8b2b0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40721 } } peers { permanent_uuid: "41268b218b804905a110c86738e74400" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 44403 } } peers { permanent_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 38749 } }
I20260709 13:08:21.908305 27865 tablet_bootstrap.cc:492] T 80e2477670ec4db18ad338931d714544 P 18435fbb525741328139e84a1e354954: No bootstrap required, opened a new log
I20260709 13:08:21.908795 27865 ts_tablet_manager.cc:1403] T 80e2477670ec4db18ad338931d714544 P 18435fbb525741328139e84a1e354954: Time spent bootstrapping tablet: real 0.094s	user 0.013s	sys 0.001s
I20260709 13:08:21.909476 27861 tablet_bootstrap.cc:492] T 5e6f8bdfe11b4af4aa27a711db7cbe7a P 2513a663afac495eb09126ff55e8b2b0: No bootstrap required, opened a new log
I20260709 13:08:21.909942 27861 ts_tablet_manager.cc:1403] T 5e6f8bdfe11b4af4aa27a711db7cbe7a P 2513a663afac495eb09126ff55e8b2b0: Time spent bootstrapping tablet: real 0.085s	user 0.024s	sys 0.021s
I20260709 13:08:21.910055 27862 ts_tablet_manager.cc:1434] T 5e6f8bdfe11b4af4aa27a711db7cbe7a P 665f7e09521a4c3f9284c1d8b0e094ff: Time spent starting tablet: real 0.050s	user 0.007s	sys 0.001s
I20260709 13:08:21.914260 27862 tablet_bootstrap.cc:492] T 47b65672307641ae81d5f94c639b1a10 P 665f7e09521a4c3f9284c1d8b0e094ff: Bootstrap starting.
I20260709 13:08:21.912564 27861 raft_consensus.cc:359] T 5e6f8bdfe11b4af4aa27a711db7cbe7a P 2513a663afac495eb09126ff55e8b2b0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2513a663afac495eb09126ff55e8b2b0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40721 } } peers { permanent_uuid: "41268b218b804905a110c86738e74400" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 44403 } } peers { permanent_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 38749 } }
I20260709 13:08:21.912918 27964 raft_consensus.cc:2749] T c9ea919812394c7aba307c2ff5b81f51 P 18435fbb525741328139e84a1e354954 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:08:21.914762 27935 consensus_queue.cc:1048] T 15a4c537259e4b2882a5cc8e723b260a P 41268b218b804905a110c86738e74400 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2513a663afac495eb09126ff55e8b2b0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40721 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:08:21.914808 27861 raft_consensus.cc:385] T 5e6f8bdfe11b4af4aa27a711db7cbe7a P 2513a663afac495eb09126ff55e8b2b0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:21.917390 27861 raft_consensus.cc:740] T 5e6f8bdfe11b4af4aa27a711db7cbe7a P 2513a663afac495eb09126ff55e8b2b0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2513a663afac495eb09126ff55e8b2b0, State: Initialized, Role: FOLLOWER
I20260709 13:08:21.920754 28037 raft_consensus.cc:515] T 47b65672307641ae81d5f94c639b1a10 P 2513a663afac495eb09126ff55e8b2b0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2513a663afac495eb09126ff55e8b2b0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40721 } } peers { permanent_uuid: "41268b218b804905a110c86738e74400" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 44403 } } peers { permanent_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 38749 } }
I20260709 13:08:21.924643 27665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47b65672307641ae81d5f94c639b1a10" candidate_uuid: "2513a663afac495eb09126ff55e8b2b0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "41268b218b804905a110c86738e74400"
I20260709 13:08:21.924860 28037 leader_election.cc:290] T 47b65672307641ae81d5f94c639b1a10 P 2513a663afac495eb09126ff55e8b2b0 [CANDIDATE]: Term 1 election: Requested vote from peers 41268b218b804905a110c86738e74400 (127.17.223.2:44403), 665f7e09521a4c3f9284c1d8b0e094ff (127.17.223.3:38749)
I20260709 13:08:21.925225 27665 raft_consensus.cc:3060] T 47b65672307641ae81d5f94c639b1a10 P 41268b218b804905a110c86738e74400 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:21.926486 27862 tablet_bootstrap.cc:654] T 47b65672307641ae81d5f94c639b1a10 P 665f7e09521a4c3f9284c1d8b0e094ff: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:21.929976 27863 tablet_bootstrap.cc:654] T bc77856749a0473a8b3124ce8c523815 P 41268b218b804905a110c86738e74400: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:21.921315 27865 raft_consensus.cc:359] T 80e2477670ec4db18ad338931d714544 P 18435fbb525741328139e84a1e354954 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 38749 } } peers { permanent_uuid: "18435fbb525741328139e84a1e354954" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 40545 } } peers { permanent_uuid: "2513a663afac495eb09126ff55e8b2b0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40721 } }
I20260709 13:08:21.921770 27861 consensus_queue.cc:260] T 5e6f8bdfe11b4af4aa27a711db7cbe7a P 2513a663afac495eb09126ff55e8b2b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2513a663afac495eb09126ff55e8b2b0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40721 } } peers { permanent_uuid: "41268b218b804905a110c86738e74400" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 44403 } } peers { permanent_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 38749 } }
I20260709 13:08:21.934298 27865 raft_consensus.cc:385] T 80e2477670ec4db18ad338931d714544 P 18435fbb525741328139e84a1e354954 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:21.935355 27665 raft_consensus.cc:2468] T 47b65672307641ae81d5f94c639b1a10 P 41268b218b804905a110c86738e74400 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2513a663afac495eb09126ff55e8b2b0 in term 1.
I20260709 13:08:21.936234 27865 raft_consensus.cc:740] T 80e2477670ec4db18ad338931d714544 P 18435fbb525741328139e84a1e354954 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 18435fbb525741328139e84a1e354954, State: Initialized, Role: FOLLOWER
I20260709 13:08:21.939535 27861 ts_tablet_manager.cc:1434] T 5e6f8bdfe11b4af4aa27a711db7cbe7a P 2513a663afac495eb09126ff55e8b2b0: Time spent starting tablet: real 0.029s	user 0.009s	sys 0.000s
I20260709 13:08:21.940186 27865 consensus_queue.cc:260] T 80e2477670ec4db18ad338931d714544 P 18435fbb525741328139e84a1e354954 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 38749 } } peers { permanent_uuid: "18435fbb525741328139e84a1e354954" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 40545 } } peers { permanent_uuid: "2513a663afac495eb09126ff55e8b2b0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40721 } }
I20260709 13:08:21.941712 27861 tablet_bootstrap.cc:492] T bc77856749a0473a8b3124ce8c523815 P 2513a663afac495eb09126ff55e8b2b0: Bootstrap starting.
I20260709 13:08:21.942893 27865 ts_tablet_manager.cc:1434] T 80e2477670ec4db18ad338931d714544 P 18435fbb525741328139e84a1e354954: Time spent starting tablet: real 0.034s	user 0.006s	sys 0.001s
I20260709 13:08:21.944046 27865 tablet_bootstrap.cc:492] T e9b149d77d9941158ead8e9e592e7b27 P 18435fbb525741328139e84a1e354954: Bootstrap starting.
I20260709 13:08:21.955370 28060 raft_consensus.cc:493] T 765d0bd527c64f74be713c390a018bba P 665f7e09521a4c3f9284c1d8b0e094ff [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:21.956403 27559 leader_election.cc:304] T 47b65672307641ae81d5f94c639b1a10 P 2513a663afac495eb09126ff55e8b2b0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2513a663afac495eb09126ff55e8b2b0, 41268b218b804905a110c86738e74400; no voters: 
I20260709 13:08:21.956239 28060 raft_consensus.cc:515] T 765d0bd527c64f74be713c390a018bba P 665f7e09521a4c3f9284c1d8b0e094ff [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2513a663afac495eb09126ff55e8b2b0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40721 } } peers { permanent_uuid: "41268b218b804905a110c86738e74400" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 44403 } } peers { permanent_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 38749 } }
I20260709 13:08:21.963197 28037 raft_consensus.cc:2804] T 47b65672307641ae81d5f94c639b1a10 P 2513a663afac495eb09126ff55e8b2b0 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:08:21.965133 28037 raft_consensus.cc:697] T 47b65672307641ae81d5f94c639b1a10 P 2513a663afac495eb09126ff55e8b2b0 [term 1 LEADER]: Becoming Leader. State: Replica: 2513a663afac495eb09126ff55e8b2b0, State: Running, Role: LEADER
I20260709 13:08:21.966250 28037 consensus_queue.cc:237] T 47b65672307641ae81d5f94c639b1a10 P 2513a663afac495eb09126ff55e8b2b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2513a663afac495eb09126ff55e8b2b0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40721 } } peers { permanent_uuid: "41268b218b804905a110c86738e74400" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 44403 } } peers { permanent_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 38749 } }
I20260709 13:08:21.970088 27964 consensus_queue.cc:1048] T df06af11cae7484d969017fcb5b7e753 P 18435fbb525741328139e84a1e354954 [LEADER]: Connected to new peer: Peer: permanent_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 38749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:08:21.971131 27741 raft_consensus.cc:3060] T 765d0bd527c64f74be713c390a018bba P 665f7e09521a4c3f9284c1d8b0e094ff [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:21.972111 28060 leader_election.cc:290] T 765d0bd527c64f74be713c390a018bba P 665f7e09521a4c3f9284c1d8b0e094ff [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2513a663afac495eb09126ff55e8b2b0 (127.17.223.1:40721), 41268b218b804905a110c86738e74400 (127.17.223.2:44403)
I20260709 13:08:21.973708 27665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "765d0bd527c64f74be713c390a018bba" candidate_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "41268b218b804905a110c86738e74400" is_pre_election: true
I20260709 13:08:21.974334 27590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "765d0bd527c64f74be713c390a018bba" candidate_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2513a663afac495eb09126ff55e8b2b0" is_pre_election: true
I20260709 13:08:21.983899 27861 tablet_bootstrap.cc:654] T bc77856749a0473a8b3124ce8c523815 P 2513a663afac495eb09126ff55e8b2b0: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:21.985036 27705 leader_election.cc:304] T 765d0bd527c64f74be713c390a018bba P 665f7e09521a4c3f9284c1d8b0e094ff [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 665f7e09521a4c3f9284c1d8b0e094ff; no voters: 2513a663afac495eb09126ff55e8b2b0, 41268b218b804905a110c86738e74400
I20260709 13:08:21.986236 27903 raft_consensus.cc:2749] T 765d0bd527c64f74be713c390a018bba P 665f7e09521a4c3f9284c1d8b0e094ff [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:08:21.990852 27740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47b65672307641ae81d5f94c639b1a10" candidate_uuid: "2513a663afac495eb09126ff55e8b2b0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" is_pre_election: true
I20260709 13:08:21.992291 27964 consensus_queue.cc:1048] T df06af11cae7484d969017fcb5b7e753 P 18435fbb525741328139e84a1e354954 [LEADER]: Connected to new peer: Peer: permanent_uuid: "41268b218b804905a110c86738e74400" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 44403 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:08:21.992331 27742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47b65672307641ae81d5f94c639b1a10" candidate_uuid: "2513a663afac495eb09126ff55e8b2b0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "665f7e09521a4c3f9284c1d8b0e094ff"
I20260709 13:08:22.024194 27862 tablet_bootstrap.cc:492] T 47b65672307641ae81d5f94c639b1a10 P 665f7e09521a4c3f9284c1d8b0e094ff: No bootstrap required, opened a new log
I20260709 13:08:22.024672 27862 ts_tablet_manager.cc:1403] T 47b65672307641ae81d5f94c639b1a10 P 665f7e09521a4c3f9284c1d8b0e094ff: Time spent bootstrapping tablet: real 0.111s	user 0.013s	sys 0.039s
I20260709 13:08:22.032907 27863 tablet_bootstrap.cc:492] T bc77856749a0473a8b3124ce8c523815 P 41268b218b804905a110c86738e74400: No bootstrap required, opened a new log
I20260709 13:08:22.023813 28014 consensus_queue.cc:1048] T 765d0bd527c64f74be713c390a018bba P 41268b218b804905a110c86738e74400 [LEADER]: Connected to new peer: Peer: permanent_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 38749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.010s
I20260709 13:08:22.033522 27863 ts_tablet_manager.cc:1403] T bc77856749a0473a8b3124ce8c523815 P 41268b218b804905a110c86738e74400: Time spent bootstrapping tablet: real 0.181s	user 0.010s	sys 0.007s
I20260709 13:08:22.035089 27865 tablet_bootstrap.cc:654] T e9b149d77d9941158ead8e9e592e7b27 P 18435fbb525741328139e84a1e354954: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:22.036603 27863 raft_consensus.cc:359] T bc77856749a0473a8b3124ce8c523815 P 41268b218b804905a110c86738e74400 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18435fbb525741328139e84a1e354954" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 40545 } } peers { permanent_uuid: "2513a663afac495eb09126ff55e8b2b0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40721 } } peers { permanent_uuid: "41268b218b804905a110c86738e74400" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 44403 } }
I20260709 13:08:22.037312 27863 raft_consensus.cc:385] T bc77856749a0473a8b3124ce8c523815 P 41268b218b804905a110c86738e74400 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260709 13:08:22.032894 27559 leader_election.cc:343] T 47b65672307641ae81d5f94c639b1a10 P 2513a663afac495eb09126ff55e8b2b0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 665f7e09521a4c3f9284c1d8b0e094ff (127.17.223.3:38749): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:22.039151 27863 raft_consensus.cc:740] T bc77856749a0473a8b3124ce8c523815 P 41268b218b804905a110c86738e74400 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 41268b218b804905a110c86738e74400, State: Initialized, Role: FOLLOWER
I20260709 13:08:22.040057 27863 consensus_queue.cc:260] T bc77856749a0473a8b3124ce8c523815 P 41268b218b804905a110c86738e74400 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18435fbb525741328139e84a1e354954" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 40545 } } peers { permanent_uuid: "2513a663afac495eb09126ff55e8b2b0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40721 } } peers { permanent_uuid: "41268b218b804905a110c86738e74400" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 44403 } }
I20260709 13:08:22.043406 27863 ts_tablet_manager.cc:1434] T bc77856749a0473a8b3124ce8c523815 P 41268b218b804905a110c86738e74400: Time spent starting tablet: real 0.010s	user 0.007s	sys 0.001s
I20260709 13:08:22.044685 27863 tablet_bootstrap.cc:492] T 106e04f510c741439b91c39d5fac5a23 P 41268b218b804905a110c86738e74400: Bootstrap starting.
I20260709 13:08:22.056792 27487 catalog_manager.cc:5697] T 47b65672307641ae81d5f94c639b1a10 P 2513a663afac495eb09126ff55e8b2b0 reported cstate change: term changed from 0 to 1, leader changed from <none> to 2513a663afac495eb09126ff55e8b2b0 (127.17.223.1). New cstate: current_term: 1 leader_uuid: "2513a663afac495eb09126ff55e8b2b0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2513a663afac495eb09126ff55e8b2b0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40721 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "41268b218b804905a110c86738e74400" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 44403 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 38749 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:22.072867 27862 raft_consensus.cc:359] T 47b65672307641ae81d5f94c639b1a10 P 665f7e09521a4c3f9284c1d8b0e094ff [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2513a663afac495eb09126ff55e8b2b0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40721 } } peers { permanent_uuid: "41268b218b804905a110c86738e74400" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 44403 } } peers { permanent_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 38749 } }
I20260709 13:08:22.073606 27862 raft_consensus.cc:385] T 47b65672307641ae81d5f94c639b1a10 P 665f7e09521a4c3f9284c1d8b0e094ff [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:22.073930 27862 raft_consensus.cc:740] T 47b65672307641ae81d5f94c639b1a10 P 665f7e09521a4c3f9284c1d8b0e094ff [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 665f7e09521a4c3f9284c1d8b0e094ff, State: Initialized, Role: FOLLOWER
I20260709 13:08:22.075584 28014 raft_consensus.cc:493] T bc77856749a0473a8b3124ce8c523815 P 41268b218b804905a110c86738e74400 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:22.076117 28014 raft_consensus.cc:515] T bc77856749a0473a8b3124ce8c523815 P 41268b218b804905a110c86738e74400 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18435fbb525741328139e84a1e354954" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 40545 } } peers { permanent_uuid: "2513a663afac495eb09126ff55e8b2b0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40721 } } peers { permanent_uuid: "41268b218b804905a110c86738e74400" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 44403 } }
I20260709 13:08:22.078356 28014 leader_election.cc:290] T bc77856749a0473a8b3124ce8c523815 P 41268b218b804905a110c86738e74400 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 18435fbb525741328139e84a1e354954 (127.17.223.4:40545), 2513a663afac495eb09126ff55e8b2b0 (127.17.223.1:40721)
I20260709 13:08:22.079218 27861 tablet_bootstrap.cc:492] T bc77856749a0473a8b3124ce8c523815 P 2513a663afac495eb09126ff55e8b2b0: No bootstrap required, opened a new log
I20260709 13:08:22.079085 27978 raft_consensus.cc:493] T e9b149d77d9941158ead8e9e592e7b27 P 41268b218b804905a110c86738e74400 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:22.080130 27863 tablet_bootstrap.cc:654] T 106e04f510c741439b91c39d5fac5a23 P 41268b218b804905a110c86738e74400: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:22.090534 27861 ts_tablet_manager.cc:1403] T bc77856749a0473a8b3124ce8c523815 P 2513a663afac495eb09126ff55e8b2b0: Time spent bootstrapping tablet: real 0.149s	user 0.017s	sys 0.012s
I20260709 13:08:22.090583 27978 raft_consensus.cc:515] T e9b149d77d9941158ead8e9e592e7b27 P 41268b218b804905a110c86738e74400 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18435fbb525741328139e84a1e354954" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 40545 } } peers { permanent_uuid: "2513a663afac495eb09126ff55e8b2b0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40721 } } peers { permanent_uuid: "41268b218b804905a110c86738e74400" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 44403 } }
I20260709 13:08:22.092885 27978 leader_election.cc:290] T e9b149d77d9941158ead8e9e592e7b27 P 41268b218b804905a110c86738e74400 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 18435fbb525741328139e84a1e354954 (127.17.223.4:40545), 2513a663afac495eb09126ff55e8b2b0 (127.17.223.1:40721)
I20260709 13:08:22.093403 27861 raft_consensus.cc:359] T bc77856749a0473a8b3124ce8c523815 P 2513a663afac495eb09126ff55e8b2b0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18435fbb525741328139e84a1e354954" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 40545 } } peers { permanent_uuid: "2513a663afac495eb09126ff55e8b2b0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40721 } } peers { permanent_uuid: "41268b218b804905a110c86738e74400" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 44403 } }
I20260709 13:08:22.094099 27861 raft_consensus.cc:385] T bc77856749a0473a8b3124ce8c523815 P 2513a663afac495eb09126ff55e8b2b0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:22.094383 27861 raft_consensus.cc:740] T bc77856749a0473a8b3124ce8c523815 P 2513a663afac495eb09126ff55e8b2b0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2513a663afac495eb09126ff55e8b2b0, State: Initialized, Role: FOLLOWER
I20260709 13:08:22.094772 27592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9b149d77d9941158ead8e9e592e7b27" candidate_uuid: "41268b218b804905a110c86738e74400" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2513a663afac495eb09126ff55e8b2b0" is_pre_election: true
I20260709 13:08:22.095062 27816 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc77856749a0473a8b3124ce8c523815" candidate_uuid: "41268b218b804905a110c86738e74400" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "18435fbb525741328139e84a1e354954" is_pre_election: true
W20260709 13:08:22.096374 27631 leader_election.cc:343] T e9b149d77d9941158ead8e9e592e7b27 P 41268b218b804905a110c86738e74400 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2513a663afac495eb09126ff55e8b2b0 (127.17.223.1:40721): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:08:22.097259 27634 leader_election.cc:343] T bc77856749a0473a8b3124ce8c523815 P 41268b218b804905a110c86738e74400 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 18435fbb525741328139e84a1e354954 (127.17.223.4:40545): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:22.097661 27816 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9b149d77d9941158ead8e9e592e7b27" candidate_uuid: "41268b218b804905a110c86738e74400" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "18435fbb525741328139e84a1e354954" is_pre_election: true
I20260709 13:08:22.102172 27863 tablet_bootstrap.cc:492] T 106e04f510c741439b91c39d5fac5a23 P 41268b218b804905a110c86738e74400: No bootstrap required, opened a new log
I20260709 13:08:22.102715 27863 ts_tablet_manager.cc:1403] T 106e04f510c741439b91c39d5fac5a23 P 41268b218b804905a110c86738e74400: Time spent bootstrapping tablet: real 0.058s	user 0.016s	sys 0.000s
I20260709 13:08:22.105633 27863 raft_consensus.cc:359] T 106e04f510c741439b91c39d5fac5a23 P 41268b218b804905a110c86738e74400 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "41268b218b804905a110c86738e74400" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 44403 } } peers { permanent_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 38749 } } peers { permanent_uuid: "18435fbb525741328139e84a1e354954" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 40545 } }
I20260709 13:08:22.106474 27863 raft_consensus.cc:385] T 106e04f510c741439b91c39d5fac5a23 P 41268b218b804905a110c86738e74400 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260709 13:08:22.107012 27634 leader_election.cc:343] T e9b149d77d9941158ead8e9e592e7b27 P 41268b218b804905a110c86738e74400 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 18435fbb525741328139e84a1e354954 (127.17.223.4:40545): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:22.106873 27863 raft_consensus.cc:740] T 106e04f510c741439b91c39d5fac5a23 P 41268b218b804905a110c86738e74400 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 41268b218b804905a110c86738e74400, State: Initialized, Role: FOLLOWER
I20260709 13:08:22.107510 27634 leader_election.cc:304] T e9b149d77d9941158ead8e9e592e7b27 P 41268b218b804905a110c86738e74400 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 41268b218b804905a110c86738e74400; no voters: 18435fbb525741328139e84a1e354954, 2513a663afac495eb09126ff55e8b2b0
I20260709 13:08:22.108017 27863 consensus_queue.cc:260] T 106e04f510c741439b91c39d5fac5a23 P 41268b218b804905a110c86738e74400 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "41268b218b804905a110c86738e74400" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 44403 } } peers { permanent_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 38749 } } peers { permanent_uuid: "18435fbb525741328139e84a1e354954" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 40545 } }
I20260709 13:08:22.109118 27982 raft_consensus.cc:2749] T e9b149d77d9941158ead8e9e592e7b27 P 41268b218b804905a110c86738e74400 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:08:22.110407 27863 ts_tablet_manager.cc:1434] T 106e04f510c741439b91c39d5fac5a23 P 41268b218b804905a110c86738e74400: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 13:08:22.111629 27863 tablet_bootstrap.cc:492] T 93c69c92efc3402e8e9546cb961bbcdc P 41268b218b804905a110c86738e74400: Bootstrap starting.
I20260709 13:08:22.118462 27863 tablet_bootstrap.cc:654] T 93c69c92efc3402e8e9546cb961bbcdc P 41268b218b804905a110c86738e74400: Neither blocks nor log segments found. Creating new log.
W20260709 13:08:22.080451 27539 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:08:22.082469 27862 consensus_queue.cc:260] T 47b65672307641ae81d5f94c639b1a10 P 665f7e09521a4c3f9284c1d8b0e094ff [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2513a663afac495eb09126ff55e8b2b0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40721 } } peers { permanent_uuid: "41268b218b804905a110c86738e74400" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 44403 } } peers { permanent_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 38749 } }
I20260709 13:08:22.123870 27862 ts_tablet_manager.cc:1434] T 47b65672307641ae81d5f94c639b1a10 P 665f7e09521a4c3f9284c1d8b0e094ff: Time spent starting tablet: real 0.099s	user 0.006s	sys 0.000s
I20260709 13:08:22.124843 27862 tablet_bootstrap.cc:492] T 5f4a8242380b4863bf5ad2c055229bb7 P 665f7e09521a4c3f9284c1d8b0e094ff: Bootstrap starting.
I20260709 13:08:22.125125 27865 tablet_bootstrap.cc:492] T e9b149d77d9941158ead8e9e592e7b27 P 18435fbb525741328139e84a1e354954: No bootstrap required, opened a new log
I20260709 13:08:22.125694 27865 ts_tablet_manager.cc:1403] T e9b149d77d9941158ead8e9e592e7b27 P 18435fbb525741328139e84a1e354954: Time spent bootstrapping tablet: real 0.182s	user 0.013s	sys 0.003s
I20260709 13:08:22.083827 27593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc77856749a0473a8b3124ce8c523815" candidate_uuid: "41268b218b804905a110c86738e74400" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2513a663afac495eb09126ff55e8b2b0" is_pre_election: true
I20260709 13:08:22.132594 27862 tablet_bootstrap.cc:654] T 5f4a8242380b4863bf5ad2c055229bb7 P 665f7e09521a4c3f9284c1d8b0e094ff: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:22.133205 27865 raft_consensus.cc:359] T e9b149d77d9941158ead8e9e592e7b27 P 18435fbb525741328139e84a1e354954 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18435fbb525741328139e84a1e354954" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 40545 } } peers { permanent_uuid: "2513a663afac495eb09126ff55e8b2b0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40721 } } peers { permanent_uuid: "41268b218b804905a110c86738e74400" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 44403 } }
I20260709 13:08:22.133953 27865 raft_consensus.cc:385] T e9b149d77d9941158ead8e9e592e7b27 P 18435fbb525741328139e84a1e354954 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:22.134236 27865 raft_consensus.cc:740] T e9b149d77d9941158ead8e9e592e7b27 P 18435fbb525741328139e84a1e354954 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 18435fbb525741328139e84a1e354954, State: Initialized, Role: FOLLOWER
I20260709 13:08:22.135044 27861 consensus_queue.cc:260] T bc77856749a0473a8b3124ce8c523815 P 2513a663afac495eb09126ff55e8b2b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18435fbb525741328139e84a1e354954" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 40545 } } peers { permanent_uuid: "2513a663afac495eb09126ff55e8b2b0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40721 } } peers { permanent_uuid: "41268b218b804905a110c86738e74400" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 44403 } }
I20260709 13:08:22.135480 27874 consensus_queue.cc:1048] T e5847d81a5284a44a6b2b21cf6f4351c P 18435fbb525741328139e84a1e354954 [LEADER]: Connected to new peer: Peer: permanent_uuid: "41268b218b804905a110c86738e74400" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 44403 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:08:22.136085 27593 raft_consensus.cc:2468] T bc77856749a0473a8b3124ce8c523815 P 2513a663afac495eb09126ff55e8b2b0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 41268b218b804905a110c86738e74400 in term 0.
I20260709 13:08:22.137390 27861 ts_tablet_manager.cc:1434] T bc77856749a0473a8b3124ce8c523815 P 2513a663afac495eb09126ff55e8b2b0: Time spent starting tablet: real 0.046s	user 0.006s	sys 0.000s
I20260709 13:08:22.138432 27861 tablet_bootstrap.cc:492] T ff09d7e79a3e43918f3c71d10a40d60b P 2513a663afac495eb09126ff55e8b2b0: Bootstrap starting.
I20260709 13:08:22.138995 27631 leader_election.cc:304] T bc77856749a0473a8b3124ce8c523815 P 41268b218b804905a110c86738e74400 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2513a663afac495eb09126ff55e8b2b0, 41268b218b804905a110c86738e74400; no voters: 18435fbb525741328139e84a1e354954
I20260709 13:08:22.140190 27982 raft_consensus.cc:2804] T bc77856749a0473a8b3124ce8c523815 P 41268b218b804905a110c86738e74400 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:08:22.140602 27982 raft_consensus.cc:493] T bc77856749a0473a8b3124ce8c523815 P 41268b218b804905a110c86738e74400 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:22.140957 27982 raft_consensus.cc:3060] T bc77856749a0473a8b3124ce8c523815 P 41268b218b804905a110c86738e74400 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:22.150130 27865 consensus_queue.cc:260] T e9b149d77d9941158ead8e9e592e7b27 P 18435fbb525741328139e84a1e354954 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18435fbb525741328139e84a1e354954" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 40545 } } peers { permanent_uuid: "2513a663afac495eb09126ff55e8b2b0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40721 } } peers { permanent_uuid: "41268b218b804905a110c86738e74400" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 44403 } }
I20260709 13:08:22.152231 27816 raft_consensus.cc:3060] T 80e2477670ec4db18ad338931d714544 P 18435fbb525741328139e84a1e354954 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:22.158362 27863 tablet_bootstrap.cc:492] T 93c69c92efc3402e8e9546cb961bbcdc P 41268b218b804905a110c86738e74400: No bootstrap required, opened a new log
I20260709 13:08:22.158888 27863 ts_tablet_manager.cc:1403] T 93c69c92efc3402e8e9546cb961bbcdc P 41268b218b804905a110c86738e74400: Time spent bootstrapping tablet: real 0.048s	user 0.011s	sys 0.001s
I20260709 13:08:22.159124 28046 consensus_queue.cc:1048] T e5847d81a5284a44a6b2b21cf6f4351c P 18435fbb525741328139e84a1e354954 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2513a663afac495eb09126ff55e8b2b0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40721 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:08:22.161326 28037 consensus_queue.cc:1048] T 80e2477670ec4db18ad338931d714544 P 2513a663afac495eb09126ff55e8b2b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 38749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:08:22.164755 27982 raft_consensus.cc:515] T bc77856749a0473a8b3124ce8c523815 P 41268b218b804905a110c86738e74400 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18435fbb525741328139e84a1e354954" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 40545 } } peers { permanent_uuid: "2513a663afac495eb09126ff55e8b2b0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40721 } } peers { permanent_uuid: "41268b218b804905a110c86738e74400" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 44403 } }
I20260709 13:08:22.167908 27592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc77856749a0473a8b3124ce8c523815" candidate_uuid: "41268b218b804905a110c86738e74400" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2513a663afac495eb09126ff55e8b2b0"
I20260709 13:08:22.168551 27592 raft_consensus.cc:3060] T bc77856749a0473a8b3124ce8c523815 P 2513a663afac495eb09126ff55e8b2b0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:22.168848 27814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc77856749a0473a8b3124ce8c523815" candidate_uuid: "41268b218b804905a110c86738e74400" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "18435fbb525741328139e84a1e354954"
W20260709 13:08:22.170264 27634 leader_election.cc:343] T bc77856749a0473a8b3124ce8c523815 P 41268b218b804905a110c86738e74400 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 18435fbb525741328139e84a1e354954 (127.17.223.4:40545): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:22.172309 27865 ts_tablet_manager.cc:1434] T e9b149d77d9941158ead8e9e592e7b27 P 18435fbb525741328139e84a1e354954: Time spent starting tablet: real 0.046s	user 0.006s	sys 0.000s
I20260709 13:08:22.173593 28037 consensus_queue.cc:1048] T 80e2477670ec4db18ad338931d714544 P 2513a663afac495eb09126ff55e8b2b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "18435fbb525741328139e84a1e354954" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 40545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:08:22.173977 27982 leader_election.cc:290] T bc77856749a0473a8b3124ce8c523815 P 41268b218b804905a110c86738e74400 [CANDIDATE]: Term 1 election: Requested vote from peers 18435fbb525741328139e84a1e354954 (127.17.223.4:40545), 2513a663afac495eb09126ff55e8b2b0 (127.17.223.1:40721)
I20260709 13:08:22.176992 27592 raft_consensus.cc:2468] T bc77856749a0473a8b3124ce8c523815 P 2513a663afac495eb09126ff55e8b2b0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 41268b218b804905a110c86738e74400 in term 1.
I20260709 13:08:22.178354 27631 leader_election.cc:304] T bc77856749a0473a8b3124ce8c523815 P 41268b218b804905a110c86738e74400 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2513a663afac495eb09126ff55e8b2b0, 41268b218b804905a110c86738e74400; no voters: 18435fbb525741328139e84a1e354954
I20260709 13:08:22.180051 27865 tablet_bootstrap.cc:492] T 5f4a8242380b4863bf5ad2c055229bb7 P 18435fbb525741328139e84a1e354954: Bootstrap starting.
I20260709 13:08:22.181911 27982 raft_consensus.cc:2804] T bc77856749a0473a8b3124ce8c523815 P 41268b218b804905a110c86738e74400 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:08:22.182616 27982 raft_consensus.cc:697] T bc77856749a0473a8b3124ce8c523815 P 41268b218b804905a110c86738e74400 [term 1 LEADER]: Becoming Leader. State: Replica: 41268b218b804905a110c86738e74400, State: Running, Role: LEADER
I20260709 13:08:22.183471 27982 consensus_queue.cc:237] T bc77856749a0473a8b3124ce8c523815 P 41268b218b804905a110c86738e74400 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18435fbb525741328139e84a1e354954" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 40545 } } peers { permanent_uuid: "2513a663afac495eb09126ff55e8b2b0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40721 } } peers { permanent_uuid: "41268b218b804905a110c86738e74400" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 44403 } }
I20260709 13:08:22.176260 27863 raft_consensus.cc:359] T 93c69c92efc3402e8e9546cb961bbcdc P 41268b218b804905a110c86738e74400 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2513a663afac495eb09126ff55e8b2b0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40721 } } peers { permanent_uuid: "41268b218b804905a110c86738e74400" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 44403 } } peers { permanent_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 38749 } }
I20260709 13:08:22.191355 27863 raft_consensus.cc:385] T 93c69c92efc3402e8e9546cb961bbcdc P 41268b218b804905a110c86738e74400 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:22.191745 27863 raft_consensus.cc:740] T 93c69c92efc3402e8e9546cb961bbcdc P 41268b218b804905a110c86738e74400 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 41268b218b804905a110c86738e74400, State: Initialized, Role: FOLLOWER
I20260709 13:08:22.208757 28060 raft_consensus.cc:493] T 5e6f8bdfe11b4af4aa27a711db7cbe7a P 665f7e09521a4c3f9284c1d8b0e094ff [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:22.209415 28060 raft_consensus.cc:515] T 5e6f8bdfe11b4af4aa27a711db7cbe7a P 665f7e09521a4c3f9284c1d8b0e094ff [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2513a663afac495eb09126ff55e8b2b0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40721 } } peers { permanent_uuid: "41268b218b804905a110c86738e74400" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 44403 } } peers { permanent_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 38749 } }
I20260709 13:08:22.200003 27863 consensus_queue.cc:260] T 93c69c92efc3402e8e9546cb961bbcdc P 41268b218b804905a110c86738e74400 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2513a663afac495eb09126ff55e8b2b0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40721 } } peers { permanent_uuid: "41268b218b804905a110c86738e74400" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 44403 } } peers { permanent_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 38749 } }
I20260709 13:08:22.213361 28060 leader_election.cc:290] T 5e6f8bdfe11b4af4aa27a711db7cbe7a P 665f7e09521a4c3f9284c1d8b0e094ff [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2513a663afac495eb09126ff55e8b2b0 (127.17.223.1:40721), 41268b218b804905a110c86738e74400 (127.17.223.2:44403)
I20260709 13:08:22.213658 27592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e6f8bdfe11b4af4aa27a711db7cbe7a" candidate_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2513a663afac495eb09126ff55e8b2b0" is_pre_election: true
I20260709 13:08:22.218941 27592 raft_consensus.cc:2468] T 5e6f8bdfe11b4af4aa27a711db7cbe7a P 2513a663afac495eb09126ff55e8b2b0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 665f7e09521a4c3f9284c1d8b0e094ff in term 0.
I20260709 13:08:22.220233 27863 ts_tablet_manager.cc:1434] T 93c69c92efc3402e8e9546cb961bbcdc P 41268b218b804905a110c86738e74400: Time spent starting tablet: real 0.061s	user 0.005s	sys 0.001s
I20260709 13:08:22.220485 27705 leader_election.cc:304] T 5e6f8bdfe11b4af4aa27a711db7cbe7a P 665f7e09521a4c3f9284c1d8b0e094ff [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2513a663afac495eb09126ff55e8b2b0, 665f7e09521a4c3f9284c1d8b0e094ff; no voters: 
I20260709 13:08:22.221264 27863 tablet_bootstrap.cc:492] T 4cd7359accee42808761c37543247321 P 41268b218b804905a110c86738e74400: Bootstrap starting.
I20260709 13:08:22.221566 28060 raft_consensus.cc:2804] T 5e6f8bdfe11b4af4aa27a711db7cbe7a P 665f7e09521a4c3f9284c1d8b0e094ff [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:08:22.222100 28060 raft_consensus.cc:493] T 5e6f8bdfe11b4af4aa27a711db7cbe7a P 665f7e09521a4c3f9284c1d8b0e094ff [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:22.222566 28060 raft_consensus.cc:3060] T 5e6f8bdfe11b4af4aa27a711db7cbe7a P 665f7e09521a4c3f9284c1d8b0e094ff [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:22.224222 27861 tablet_bootstrap.cc:654] T ff09d7e79a3e43918f3c71d10a40d60b P 2513a663afac495eb09126ff55e8b2b0: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:22.225209 27665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e6f8bdfe11b4af4aa27a711db7cbe7a" candidate_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "41268b218b804905a110c86738e74400" is_pre_election: true
I20260709 13:08:22.225944 27665 raft_consensus.cc:2468] T 5e6f8bdfe11b4af4aa27a711db7cbe7a P 41268b218b804905a110c86738e74400 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 665f7e09521a4c3f9284c1d8b0e094ff in term 0.
I20260709 13:08:22.229610 27862 tablet_bootstrap.cc:492] T 5f4a8242380b4863bf5ad2c055229bb7 P 665f7e09521a4c3f9284c1d8b0e094ff: No bootstrap required, opened a new log
I20260709 13:08:22.230151 27862 ts_tablet_manager.cc:1403] T 5f4a8242380b4863bf5ad2c055229bb7 P 665f7e09521a4c3f9284c1d8b0e094ff: Time spent bootstrapping tablet: real 0.106s	user 0.013s	sys 0.000s
I20260709 13:08:22.268435 27865 tablet_bootstrap.cc:654] T 5f4a8242380b4863bf5ad2c055229bb7 P 18435fbb525741328139e84a1e354954: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:22.268335 28060 raft_consensus.cc:515] T 5e6f8bdfe11b4af4aa27a711db7cbe7a P 665f7e09521a4c3f9284c1d8b0e094ff [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2513a663afac495eb09126ff55e8b2b0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40721 } } peers { permanent_uuid: "41268b218b804905a110c86738e74400" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 44403 } } peers { permanent_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 38749 } }
I20260709 13:08:22.270769 28060 leader_election.cc:290] T 5e6f8bdfe11b4af4aa27a711db7cbe7a P 665f7e09521a4c3f9284c1d8b0e094ff [CANDIDATE]: Term 1 election: Requested vote from peers 2513a663afac495eb09126ff55e8b2b0 (127.17.223.1:40721), 41268b218b804905a110c86738e74400 (127.17.223.2:44403)
I20260709 13:08:22.275277 27592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e6f8bdfe11b4af4aa27a711db7cbe7a" candidate_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2513a663afac495eb09126ff55e8b2b0"
I20260709 13:08:22.275945 27592 raft_consensus.cc:3060] T 5e6f8bdfe11b4af4aa27a711db7cbe7a P 2513a663afac495eb09126ff55e8b2b0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:22.280558 27862 raft_consensus.cc:359] T 5f4a8242380b4863bf5ad2c055229bb7 P 665f7e09521a4c3f9284c1d8b0e094ff [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "41268b218b804905a110c86738e74400" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 44403 } } peers { permanent_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 38749 } } peers { permanent_uuid: "18435fbb525741328139e84a1e354954" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 40545 } }
I20260709 13:08:22.281324 27862 raft_consensus.cc:385] T 5f4a8242380b4863bf5ad2c055229bb7 P 665f7e09521a4c3f9284c1d8b0e094ff [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:22.281597 27862 raft_consensus.cc:740] T 5f4a8242380b4863bf5ad2c055229bb7 P 665f7e09521a4c3f9284c1d8b0e094ff [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 665f7e09521a4c3f9284c1d8b0e094ff, State: Initialized, Role: FOLLOWER
I20260709 13:08:22.286335 27666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e6f8bdfe11b4af4aa27a711db7cbe7a" candidate_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "41268b218b804905a110c86738e74400"
I20260709 13:08:22.286960 27666 raft_consensus.cc:3060] T 5e6f8bdfe11b4af4aa27a711db7cbe7a P 41268b218b804905a110c86738e74400 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:22.287416 27863 tablet_bootstrap.cc:654] T 4cd7359accee42808761c37543247321 P 41268b218b804905a110c86738e74400: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:22.288457 27862 consensus_queue.cc:260] T 5f4a8242380b4863bf5ad2c055229bb7 P 665f7e09521a4c3f9284c1d8b0e094ff [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "41268b218b804905a110c86738e74400" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 44403 } } peers { permanent_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 38749 } } peers { permanent_uuid: "18435fbb525741328139e84a1e354954" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 40545 } }
I20260709 13:08:22.290628 27862 ts_tablet_manager.cc:1434] T 5f4a8242380b4863bf5ad2c055229bb7 P 665f7e09521a4c3f9284c1d8b0e094ff: Time spent starting tablet: real 0.060s	user 0.003s	sys 0.011s
I20260709 13:08:22.293689 27861 tablet_bootstrap.cc:492] T ff09d7e79a3e43918f3c71d10a40d60b P 2513a663afac495eb09126ff55e8b2b0: No bootstrap required, opened a new log
I20260709 13:08:22.294111 27862 tablet_bootstrap.cc:492] T 93c69c92efc3402e8e9546cb961bbcdc P 665f7e09521a4c3f9284c1d8b0e094ff: Bootstrap starting.
I20260709 13:08:22.294206 27861 ts_tablet_manager.cc:1403] T ff09d7e79a3e43918f3c71d10a40d60b P 2513a663afac495eb09126ff55e8b2b0: Time spent bootstrapping tablet: real 0.156s	user 0.010s	sys 0.000s
I20260709 13:08:22.296149 27666 raft_consensus.cc:2468] T 5e6f8bdfe11b4af4aa27a711db7cbe7a P 41268b218b804905a110c86738e74400 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 665f7e09521a4c3f9284c1d8b0e094ff in term 1.
I20260709 13:08:22.298650 27978 raft_consensus.cc:493] T 106e04f510c741439b91c39d5fac5a23 P 41268b218b804905a110c86738e74400 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:22.298415 27861 raft_consensus.cc:359] T ff09d7e79a3e43918f3c71d10a40d60b P 2513a663afac495eb09126ff55e8b2b0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 38749 } } peers { permanent_uuid: "18435fbb525741328139e84a1e354954" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 40545 } } peers { permanent_uuid: "2513a663afac495eb09126ff55e8b2b0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40721 } }
I20260709 13:08:22.311579 27861 raft_consensus.cc:385] T ff09d7e79a3e43918f3c71d10a40d60b P 2513a663afac495eb09126ff55e8b2b0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:22.311640 27978 raft_consensus.cc:515] T 106e04f510c741439b91c39d5fac5a23 P 41268b218b804905a110c86738e74400 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "41268b218b804905a110c86738e74400" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 44403 } } peers { permanent_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 38749 } } peers { permanent_uuid: "18435fbb525741328139e84a1e354954" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 40545 } }
I20260709 13:08:22.312031 28046 consensus_queue.cc:1048] T 1d9bdb76a5094186b5ac6c8f8e1c9840 P 18435fbb525741328139e84a1e354954 [LEADER]: Connected to new peer: Peer: permanent_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 38749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:08:22.314411 27978 leader_election.cc:290] T 106e04f510c741439b91c39d5fac5a23 P 41268b218b804905a110c86738e74400 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 665f7e09521a4c3f9284c1d8b0e094ff (127.17.223.3:38749), 18435fbb525741328139e84a1e354954 (127.17.223.4:40545)
I20260709 13:08:22.307696 27862 tablet_bootstrap.cc:654] T 93c69c92efc3402e8e9546cb961bbcdc P 665f7e09521a4c3f9284c1d8b0e094ff: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:22.312019 27861 raft_consensus.cc:740] T ff09d7e79a3e43918f3c71d10a40d60b P 2513a663afac495eb09126ff55e8b2b0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2513a663afac495eb09126ff55e8b2b0, State: Initialized, Role: FOLLOWER
I20260709 13:08:22.315541 27814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "106e04f510c741439b91c39d5fac5a23" candidate_uuid: "41268b218b804905a110c86738e74400" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "18435fbb525741328139e84a1e354954" is_pre_election: true
I20260709 13:08:22.316506 27861 consensus_queue.cc:260] T ff09d7e79a3e43918f3c71d10a40d60b P 2513a663afac495eb09126ff55e8b2b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 38749 } } peers { permanent_uuid: "18435fbb525741328139e84a1e354954" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 40545 } } peers { permanent_uuid: "2513a663afac495eb09126ff55e8b2b0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40721 } }
W20260709 13:08:22.317448 27634 leader_election.cc:343] T 106e04f510c741439b91c39d5fac5a23 P 41268b218b804905a110c86738e74400 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 18435fbb525741328139e84a1e354954 (127.17.223.4:40545): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:22.318701 27861 ts_tablet_manager.cc:1434] T ff09d7e79a3e43918f3c71d10a40d60b P 2513a663afac495eb09126ff55e8b2b0: Time spent starting tablet: real 0.024s	user 0.007s	sys 0.000s
I20260709 13:08:22.324731 27708 leader_election.cc:304] T 5e6f8bdfe11b4af4aa27a711db7cbe7a P 665f7e09521a4c3f9284c1d8b0e094ff [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 41268b218b804905a110c86738e74400, 665f7e09521a4c3f9284c1d8b0e094ff; no voters: 
I20260709 13:08:22.325556 28060 raft_consensus.cc:2804] T 5e6f8bdfe11b4af4aa27a711db7cbe7a P 665f7e09521a4c3f9284c1d8b0e094ff [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:08:22.326100 28060 raft_consensus.cc:697] T 5e6f8bdfe11b4af4aa27a711db7cbe7a P 665f7e09521a4c3f9284c1d8b0e094ff [term 1 LEADER]: Becoming Leader. State: Replica: 665f7e09521a4c3f9284c1d8b0e094ff, State: Running, Role: LEADER
I20260709 13:08:22.326191 27740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "106e04f510c741439b91c39d5fac5a23" candidate_uuid: "41268b218b804905a110c86738e74400" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" is_pre_election: true
I20260709 13:08:22.327311 28060 consensus_queue.cc:237] T 5e6f8bdfe11b4af4aa27a711db7cbe7a P 665f7e09521a4c3f9284c1d8b0e094ff [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2513a663afac495eb09126ff55e8b2b0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40721 } } peers { permanent_uuid: "41268b218b804905a110c86738e74400" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 44403 } } peers { permanent_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 38749 } }
I20260709 13:08:22.327958 28046 consensus_queue.cc:1048] T 1d9bdb76a5094186b5ac6c8f8e1c9840 P 18435fbb525741328139e84a1e354954 [LEADER]: Connected to new peer: Peer: permanent_uuid: "41268b218b804905a110c86738e74400" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 44403 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:08:22.326133 27865 tablet_bootstrap.cc:492] T 5f4a8242380b4863bf5ad2c055229bb7 P 18435fbb525741328139e84a1e354954: No bootstrap required, opened a new log
I20260709 13:08:22.330052 27865 ts_tablet_manager.cc:1403] T 5f4a8242380b4863bf5ad2c055229bb7 P 18435fbb525741328139e84a1e354954: Time spent bootstrapping tablet: real 0.150s	user 0.013s	sys 0.008s
I20260709 13:08:22.333276 27861 tablet_bootstrap.cc:492] T e9b149d77d9941158ead8e9e592e7b27 P 2513a663afac495eb09126ff55e8b2b0: Bootstrap starting.
I20260709 13:08:22.301952 27592 raft_consensus.cc:2468] T 5e6f8bdfe11b4af4aa27a711db7cbe7a P 2513a663afac495eb09126ff55e8b2b0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 665f7e09521a4c3f9284c1d8b0e094ff in term 1.
W20260709 13:08:22.332628 27634 leader_election.cc:343] T 106e04f510c741439b91c39d5fac5a23 P 41268b218b804905a110c86738e74400 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 665f7e09521a4c3f9284c1d8b0e094ff (127.17.223.3:38749): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:22.337592 27634 leader_election.cc:304] T 106e04f510c741439b91c39d5fac5a23 P 41268b218b804905a110c86738e74400 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 41268b218b804905a110c86738e74400; no voters: 18435fbb525741328139e84a1e354954, 665f7e09521a4c3f9284c1d8b0e094ff
I20260709 13:08:22.339141 28082 raft_consensus.cc:493] T 5f4a8242380b4863bf5ad2c055229bb7 P 665f7e09521a4c3f9284c1d8b0e094ff [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:22.339728 28082 raft_consensus.cc:515] T 5f4a8242380b4863bf5ad2c055229bb7 P 665f7e09521a4c3f9284c1d8b0e094ff [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "41268b218b804905a110c86738e74400" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 44403 } } peers { permanent_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 38749 } } peers { permanent_uuid: "18435fbb525741328139e84a1e354954" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 40545 } }
I20260709 13:08:22.340512 27863 tablet_bootstrap.cc:492] T 4cd7359accee42808761c37543247321 P 41268b218b804905a110c86738e74400: No bootstrap required, opened a new log
I20260709 13:08:22.341152 27863 ts_tablet_manager.cc:1403] T 4cd7359accee42808761c37543247321 P 41268b218b804905a110c86738e74400: Time spent bootstrapping tablet: real 0.120s	user 0.013s	sys 0.006s
I20260709 13:08:22.337739 27865 raft_consensus.cc:359] T 5f4a8242380b4863bf5ad2c055229bb7 P 18435fbb525741328139e84a1e354954 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "41268b218b804905a110c86738e74400" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 44403 } } peers { permanent_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 38749 } } peers { permanent_uuid: "18435fbb525741328139e84a1e354954" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 40545 } }
I20260709 13:08:22.342859 27865 raft_consensus.cc:385] T 5f4a8242380b4863bf5ad2c055229bb7 P 18435fbb525741328139e84a1e354954 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:22.343220 27865 raft_consensus.cc:740] T 5f4a8242380b4863bf5ad2c055229bb7 P 18435fbb525741328139e84a1e354954 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 18435fbb525741328139e84a1e354954, State: Initialized, Role: FOLLOWER
I20260709 13:08:22.351634 27865 consensus_queue.cc:260] T 5f4a8242380b4863bf5ad2c055229bb7 P 18435fbb525741328139e84a1e354954 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "41268b218b804905a110c86738e74400" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 44403 } } peers { permanent_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 38749 } } peers { permanent_uuid: "18435fbb525741328139e84a1e354954" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 40545 } }
I20260709 13:08:22.360601 27865 ts_tablet_manager.cc:1434] T 5f4a8242380b4863bf5ad2c055229bb7 P 18435fbb525741328139e84a1e354954: Time spent starting tablet: real 0.030s	user 0.003s	sys 0.006s
I20260709 13:08:22.347299 27982 raft_consensus.cc:2749] T 106e04f510c741439b91c39d5fac5a23 P 41268b218b804905a110c86738e74400 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:08:22.365077 27865 tablet_bootstrap.cc:492] T ff09d7e79a3e43918f3c71d10a40d60b P 18435fbb525741328139e84a1e354954: Bootstrap starting.
I20260709 13:08:22.367255 27862 tablet_bootstrap.cc:492] T 93c69c92efc3402e8e9546cb961bbcdc P 665f7e09521a4c3f9284c1d8b0e094ff: No bootstrap required, opened a new log
I20260709 13:08:22.367738 27862 ts_tablet_manager.cc:1403] T 93c69c92efc3402e8e9546cb961bbcdc P 665f7e09521a4c3f9284c1d8b0e094ff: Time spent bootstrapping tablet: real 0.074s	user 0.018s	sys 0.027s
I20260709 13:08:22.370390 27862 raft_consensus.cc:359] T 93c69c92efc3402e8e9546cb961bbcdc P 665f7e09521a4c3f9284c1d8b0e094ff [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2513a663afac495eb09126ff55e8b2b0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40721 } } peers { permanent_uuid: "41268b218b804905a110c86738e74400" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 44403 } } peers { permanent_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 38749 } }
I20260709 13:08:22.371134 27862 raft_consensus.cc:385] T 93c69c92efc3402e8e9546cb961bbcdc P 665f7e09521a4c3f9284c1d8b0e094ff [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:22.371376 27862 raft_consensus.cc:740] T 93c69c92efc3402e8e9546cb961bbcdc P 665f7e09521a4c3f9284c1d8b0e094ff [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 665f7e09521a4c3f9284c1d8b0e094ff, State: Initialized, Role: FOLLOWER
I20260709 13:08:22.364444 27489 catalog_manager.cc:5697] T bc77856749a0473a8b3124ce8c523815 P 41268b218b804905a110c86738e74400 reported cstate change: term changed from 0 to 1, leader changed from <none> to 41268b218b804905a110c86738e74400 (127.17.223.2). New cstate: current_term: 1 leader_uuid: "41268b218b804905a110c86738e74400" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18435fbb525741328139e84a1e354954" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 40545 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2513a663afac495eb09126ff55e8b2b0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40721 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "41268b218b804905a110c86738e74400" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 44403 } health_report { overall_health: HEALTHY } } }
I20260709 13:08:22.372903 28060 raft_consensus.cc:493] T 47b65672307641ae81d5f94c639b1a10 P 665f7e09521a4c3f9284c1d8b0e094ff [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:22.374624 28060 raft_consensus.cc:515] T 47b65672307641ae81d5f94c639b1a10 P 665f7e09521a4c3f9284c1d8b0e094ff [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2513a663afac495eb09126ff55e8b2b0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40721 } } peers { permanent_uuid: "41268b218b804905a110c86738e74400" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 44403 } } peers { permanent_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 38749 } }
I20260709 13:08:22.372014 27862 consensus_queue.cc:260] T 93c69c92efc3402e8e9546cb961bbcdc P 665f7e09521a4c3f9284c1d8b0e094ff [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2513a663afac495eb09126ff55e8b2b0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40721 } } peers { permanent_uuid: "41268b218b804905a110c86738e74400" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 44403 } } peers { permanent_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 38749 } }
I20260709 13:08:22.380788 27862 ts_tablet_manager.cc:1434] T 93c69c92efc3402e8e9546cb961bbcdc P 665f7e09521a4c3f9284c1d8b0e094ff: Time spent starting tablet: real 0.013s	user 0.007s	sys 0.001s
I20260709 13:08:22.381466 27863 raft_consensus.cc:359] T 4cd7359accee42808761c37543247321 P 41268b218b804905a110c86738e74400 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18435fbb525741328139e84a1e354954" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 40545 } } peers { permanent_uuid: "2513a663afac495eb09126ff55e8b2b0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40721 } } peers { permanent_uuid: "41268b218b804905a110c86738e74400" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 44403 } }
I20260709 13:08:22.381964 27863 raft_consensus.cc:385] T 4cd7359accee42808761c37543247321 P 41268b218b804905a110c86738e74400 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:22.382128 27863 raft_consensus.cc:740] T 4cd7359accee42808761c37543247321 P 41268b218b804905a110c86738e74400 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 41268b218b804905a110c86738e74400, State: Initialized, Role: FOLLOWER
I20260709 13:08:22.384200 27862 tablet_bootstrap.cc:492] T ff09d7e79a3e43918f3c71d10a40d60b P 665f7e09521a4c3f9284c1d8b0e094ff: Bootstrap starting.
I20260709 13:08:22.383987 27592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47b65672307641ae81d5f94c639b1a10" candidate_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2513a663afac495eb09126ff55e8b2b0" is_pre_election: true
I20260709 13:08:22.383987 27666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f4a8242380b4863bf5ad2c055229bb7" candidate_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "41268b218b804905a110c86738e74400" is_pre_election: true
I20260709 13:08:22.385998 27666 raft_consensus.cc:2468] T 5f4a8242380b4863bf5ad2c055229bb7 P 41268b218b804905a110c86738e74400 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 665f7e09521a4c3f9284c1d8b0e094ff in term 0.
I20260709 13:08:22.390564 27862 tablet_bootstrap.cc:654] T ff09d7e79a3e43918f3c71d10a40d60b P 665f7e09521a4c3f9284c1d8b0e094ff: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:22.396735 27708 leader_election.cc:304] T 5f4a8242380b4863bf5ad2c055229bb7 P 665f7e09521a4c3f9284c1d8b0e094ff [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 41268b218b804905a110c86738e74400, 665f7e09521a4c3f9284c1d8b0e094ff; no voters: 
I20260709 13:08:22.397866 27903 raft_consensus.cc:2804] T 5f4a8242380b4863bf5ad2c055229bb7 P 665f7e09521a4c3f9284c1d8b0e094ff [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:08:22.398228 27903 raft_consensus.cc:493] T 5f4a8242380b4863bf5ad2c055229bb7 P 665f7e09521a4c3f9284c1d8b0e094ff [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:22.398526 27903 raft_consensus.cc:3060] T 5f4a8242380b4863bf5ad2c055229bb7 P 665f7e09521a4c3f9284c1d8b0e094ff [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:22.401925 28082 leader_election.cc:290] T 5f4a8242380b4863bf5ad2c055229bb7 P 665f7e09521a4c3f9284c1d8b0e094ff [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 41268b218b804905a110c86738e74400 (127.17.223.2:44403), 18435fbb525741328139e84a1e354954 (127.17.223.4:40545)
I20260709 13:08:22.408144 27865 tablet_bootstrap.cc:654] T ff09d7e79a3e43918f3c71d10a40d60b P 18435fbb525741328139e84a1e354954: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:22.409147 27816 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f4a8242380b4863bf5ad2c055229bb7" candidate_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "18435fbb525741328139e84a1e354954" is_pre_election: true
I20260709 13:08:22.409889 27816 raft_consensus.cc:2468] T 5f4a8242380b4863bf5ad2c055229bb7 P 18435fbb525741328139e84a1e354954 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 665f7e09521a4c3f9284c1d8b0e094ff in term 0.
I20260709 13:08:22.413144 27861 tablet_bootstrap.cc:654] T e9b149d77d9941158ead8e9e592e7b27 P 2513a663afac495eb09126ff55e8b2b0: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:22.419852 27666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47b65672307641ae81d5f94c639b1a10" candidate_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "41268b218b804905a110c86738e74400" is_pre_election: true
I20260709 13:08:22.420698 27666 raft_consensus.cc:2393] T 47b65672307641ae81d5f94c639b1a10 P 41268b218b804905a110c86738e74400 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 665f7e09521a4c3f9284c1d8b0e094ff in current term 1: Already voted for candidate 2513a663afac495eb09126ff55e8b2b0 in this term.
I20260709 13:08:22.422865 28060 leader_election.cc:290] T 47b65672307641ae81d5f94c639b1a10 P 665f7e09521a4c3f9284c1d8b0e094ff [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2513a663afac495eb09126ff55e8b2b0 (127.17.223.1:40721), 41268b218b804905a110c86738e74400 (127.17.223.2:44403)
I20260709 13:08:22.423310 27863 consensus_queue.cc:260] T 4cd7359accee42808761c37543247321 P 41268b218b804905a110c86738e74400 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18435fbb525741328139e84a1e354954" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 40545 } } peers { permanent_uuid: "2513a663afac495eb09126ff55e8b2b0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40721 } } peers { permanent_uuid: "41268b218b804905a110c86738e74400" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 44403 } }
I20260709 13:08:22.406086 27903 raft_consensus.cc:515] T 5f4a8242380b4863bf5ad2c055229bb7 P 665f7e09521a4c3f9284c1d8b0e094ff [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "41268b218b804905a110c86738e74400" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 44403 } } peers { permanent_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 38749 } } peers { permanent_uuid: "18435fbb525741328139e84a1e354954" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 40545 } }
I20260709 13:08:22.427294 27903 leader_election.cc:290] T 5f4a8242380b4863bf5ad2c055229bb7 P 665f7e09521a4c3f9284c1d8b0e094ff [CANDIDATE]: Term 1 election: Requested vote from peers 41268b218b804905a110c86738e74400 (127.17.223.2:44403), 18435fbb525741328139e84a1e354954 (127.17.223.4:40545)
I20260709 13:08:22.426762 27491 catalog_manager.cc:5697] T 5e6f8bdfe11b4af4aa27a711db7cbe7a P 665f7e09521a4c3f9284c1d8b0e094ff reported cstate change: term changed from 0 to 1, leader changed from <none> to 665f7e09521a4c3f9284c1d8b0e094ff (127.17.223.3). New cstate: current_term: 1 leader_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2513a663afac495eb09126ff55e8b2b0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40721 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "41268b218b804905a110c86738e74400" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 44403 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 38749 } health_report { overall_health: HEALTHY } } }
I20260709 13:08:22.432235 27861 tablet_bootstrap.cc:492] T e9b149d77d9941158ead8e9e592e7b27 P 2513a663afac495eb09126ff55e8b2b0: No bootstrap required, opened a new log
I20260709 13:08:22.438315 27861 ts_tablet_manager.cc:1403] T e9b149d77d9941158ead8e9e592e7b27 P 2513a663afac495eb09126ff55e8b2b0: Time spent bootstrapping tablet: real 0.105s	user 0.012s	sys 0.000s
I20260709 13:08:22.440707 27978 raft_consensus.cc:493] T 93c69c92efc3402e8e9546cb961bbcdc P 41268b218b804905a110c86738e74400 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:22.441229 27978 raft_consensus.cc:515] T 93c69c92efc3402e8e9546cb961bbcdc P 41268b218b804905a110c86738e74400 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2513a663afac495eb09126ff55e8b2b0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40721 } } peers { permanent_uuid: "41268b218b804905a110c86738e74400" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 44403 } } peers { permanent_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 38749 } }
I20260709 13:08:22.444348 27593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93c69c92efc3402e8e9546cb961bbcdc" candidate_uuid: "41268b218b804905a110c86738e74400" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2513a663afac495eb09126ff55e8b2b0" is_pre_election: true
W20260709 13:08:22.445822 27631 leader_election.cc:343] T 93c69c92efc3402e8e9546cb961bbcdc P 41268b218b804905a110c86738e74400 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2513a663afac495eb09126ff55e8b2b0 (127.17.223.1:40721): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:22.434119 27863 ts_tablet_manager.cc:1434] T 4cd7359accee42808761c37543247321 P 41268b218b804905a110c86738e74400: Time spent starting tablet: real 0.091s	user 0.006s	sys 0.000s
I20260709 13:08:22.446199 27862 tablet_bootstrap.cc:492] T ff09d7e79a3e43918f3c71d10a40d60b P 665f7e09521a4c3f9284c1d8b0e094ff: No bootstrap required, opened a new log
I20260709 13:08:22.447240 27863 tablet_bootstrap.cc:492] T 85cdd21b7a5f4db7af44327c57c16d43 P 41268b218b804905a110c86738e74400: Bootstrap starting.
I20260709 13:08:22.449191 27862 ts_tablet_manager.cc:1403] T ff09d7e79a3e43918f3c71d10a40d60b P 665f7e09521a4c3f9284c1d8b0e094ff: Time spent bootstrapping tablet: real 0.065s	user 0.015s	sys 0.020s
I20260709 13:08:22.451625 27978 leader_election.cc:290] T 93c69c92efc3402e8e9546cb961bbcdc P 41268b218b804905a110c86738e74400 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2513a663afac495eb09126ff55e8b2b0 (127.17.223.1:40721), 665f7e09521a4c3f9284c1d8b0e094ff (127.17.223.3:38749)
I20260709 13:08:22.453361 27863 tablet_bootstrap.cc:654] T 85cdd21b7a5f4db7af44327c57c16d43 P 41268b218b804905a110c86738e74400: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:22.457036 27862 raft_consensus.cc:359] T ff09d7e79a3e43918f3c71d10a40d60b P 665f7e09521a4c3f9284c1d8b0e094ff [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 38749 } } peers { permanent_uuid: "18435fbb525741328139e84a1e354954" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 40545 } } peers { permanent_uuid: "2513a663afac495eb09126ff55e8b2b0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40721 } }
I20260709 13:08:22.457985 27862 raft_consensus.cc:385] T ff09d7e79a3e43918f3c71d10a40d60b P 665f7e09521a4c3f9284c1d8b0e094ff [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:22.458324 27862 raft_consensus.cc:740] T ff09d7e79a3e43918f3c71d10a40d60b P 665f7e09521a4c3f9284c1d8b0e094ff [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 665f7e09521a4c3f9284c1d8b0e094ff, State: Initialized, Role: FOLLOWER
I20260709 13:08:22.459803 27862 consensus_queue.cc:260] T ff09d7e79a3e43918f3c71d10a40d60b P 665f7e09521a4c3f9284c1d8b0e094ff [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 38749 } } peers { permanent_uuid: "18435fbb525741328139e84a1e354954" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 40545 } } peers { permanent_uuid: "2513a663afac495eb09126ff55e8b2b0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40721 } }
I20260709 13:08:22.460017 28037 consensus_queue.cc:1048] T 47b65672307641ae81d5f94c639b1a10 P 2513a663afac495eb09126ff55e8b2b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "41268b218b804905a110c86738e74400" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 44403 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:08:22.461756 27865 tablet_bootstrap.cc:492] T ff09d7e79a3e43918f3c71d10a40d60b P 18435fbb525741328139e84a1e354954: No bootstrap required, opened a new log
I20260709 13:08:22.462392 27865 ts_tablet_manager.cc:1403] T ff09d7e79a3e43918f3c71d10a40d60b P 18435fbb525741328139e84a1e354954: Time spent bootstrapping tablet: real 0.100s	user 0.011s	sys 0.026s
I20260709 13:08:22.461817 27862 ts_tablet_manager.cc:1434] T ff09d7e79a3e43918f3c71d10a40d60b P 665f7e09521a4c3f9284c1d8b0e094ff: Time spent starting tablet: real 0.012s	user 0.006s	sys 0.000s
I20260709 13:08:22.465525 27862 tablet_bootstrap.cc:492] T 78e19c035a854ee98657bec3edcb3585 P 665f7e09521a4c3f9284c1d8b0e094ff: Bootstrap starting.
I20260709 13:08:22.465969 27865 raft_consensus.cc:359] T ff09d7e79a3e43918f3c71d10a40d60b P 18435fbb525741328139e84a1e354954 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 38749 } } peers { permanent_uuid: "18435fbb525741328139e84a1e354954" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 40545 } } peers { permanent_uuid: "2513a663afac495eb09126ff55e8b2b0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40721 } }
I20260709 13:08:22.466756 27865 raft_consensus.cc:385] T ff09d7e79a3e43918f3c71d10a40d60b P 18435fbb525741328139e84a1e354954 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:22.467023 27865 raft_consensus.cc:740] T ff09d7e79a3e43918f3c71d10a40d60b P 18435fbb525741328139e84a1e354954 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 18435fbb525741328139e84a1e354954, State: Initialized, Role: FOLLOWER
I20260709 13:08:22.467674 27865 consensus_queue.cc:260] T ff09d7e79a3e43918f3c71d10a40d60b P 18435fbb525741328139e84a1e354954 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 38749 } } peers { permanent_uuid: "18435fbb525741328139e84a1e354954" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 40545 } } peers { permanent_uuid: "2513a663afac495eb09126ff55e8b2b0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40721 } }
I20260709 13:08:22.468492 27666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f4a8242380b4863bf5ad2c055229bb7" candidate_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "41268b218b804905a110c86738e74400"
I20260709 13:08:22.469144 27666 raft_consensus.cc:3060] T 5f4a8242380b4863bf5ad2c055229bb7 P 41268b218b804905a110c86738e74400 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:22.470095 27865 ts_tablet_manager.cc:1434] T ff09d7e79a3e43918f3c71d10a40d60b P 18435fbb525741328139e84a1e354954: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 13:08:22.471123 27865 tablet_bootstrap.cc:492] T bc77856749a0473a8b3124ce8c523815 P 18435fbb525741328139e84a1e354954: Bootstrap starting.
I20260709 13:08:22.476717 27666 raft_consensus.cc:2468] T 5f4a8242380b4863bf5ad2c055229bb7 P 41268b218b804905a110c86738e74400 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 665f7e09521a4c3f9284c1d8b0e094ff in term 1.
I20260709 13:08:22.477584 27865 tablet_bootstrap.cc:654] T bc77856749a0473a8b3124ce8c523815 P 18435fbb525741328139e84a1e354954: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:22.478247 27816 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f4a8242380b4863bf5ad2c055229bb7" candidate_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "18435fbb525741328139e84a1e354954"
I20260709 13:08:22.480501 27740 raft_consensus.cc:3060] T 47b65672307641ae81d5f94c639b1a10 P 665f7e09521a4c3f9284c1d8b0e094ff [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:22.484362 27816 raft_consensus.cc:3060] T 5f4a8242380b4863bf5ad2c055229bb7 P 18435fbb525741328139e84a1e354954 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:22.486833 27739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93c69c92efc3402e8e9546cb961bbcdc" candidate_uuid: "41268b218b804905a110c86738e74400" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" is_pre_election: true
I20260709 13:08:22.487488 27739 raft_consensus.cc:2468] T 93c69c92efc3402e8e9546cb961bbcdc P 665f7e09521a4c3f9284c1d8b0e094ff [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 41268b218b804905a110c86738e74400 in term 0.
I20260709 13:08:22.488503 27708 leader_election.cc:304] T 47b65672307641ae81d5f94c639b1a10 P 665f7e09521a4c3f9284c1d8b0e094ff [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 665f7e09521a4c3f9284c1d8b0e094ff; no voters: 2513a663afac495eb09126ff55e8b2b0, 41268b218b804905a110c86738e74400
I20260709 13:08:22.441123 27861 raft_consensus.cc:359] T e9b149d77d9941158ead8e9e592e7b27 P 2513a663afac495eb09126ff55e8b2b0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18435fbb525741328139e84a1e354954" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 40545 } } peers { permanent_uuid: "2513a663afac495eb09126ff55e8b2b0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40721 } } peers { permanent_uuid: "41268b218b804905a110c86738e74400" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 44403 } }
I20260709 13:08:22.489990 27861 raft_consensus.cc:385] T e9b149d77d9941158ead8e9e592e7b27 P 2513a663afac495eb09126ff55e8b2b0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:22.490049 27708 leader_election.cc:304] T 5f4a8242380b4863bf5ad2c055229bb7 P 665f7e09521a4c3f9284c1d8b0e094ff [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 41268b218b804905a110c86738e74400, 665f7e09521a4c3f9284c1d8b0e094ff; no voters: 
I20260709 13:08:22.490374 27861 raft_consensus.cc:740] T e9b149d77d9941158ead8e9e592e7b27 P 2513a663afac495eb09126ff55e8b2b0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2513a663afac495eb09126ff55e8b2b0, State: Initialized, Role: FOLLOWER
I20260709 13:08:22.491565 27861 consensus_queue.cc:260] T e9b149d77d9941158ead8e9e592e7b27 P 2513a663afac495eb09126ff55e8b2b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18435fbb525741328139e84a1e354954" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 40545 } } peers { permanent_uuid: "2513a663afac495eb09126ff55e8b2b0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40721 } } peers { permanent_uuid: "41268b218b804905a110c86738e74400" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 44403 } }
I20260709 13:08:22.494066 27816 raft_consensus.cc:2468] T 5f4a8242380b4863bf5ad2c055229bb7 P 18435fbb525741328139e84a1e354954 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 665f7e09521a4c3f9284c1d8b0e094ff in term 1.
I20260709 13:08:22.495623 27898 consensus_queue.cc:1048] T 47b65672307641ae81d5f94c639b1a10 P 2513a663afac495eb09126ff55e8b2b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 38749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:08:22.496384 28046 raft_consensus.cc:493] T e9b149d77d9941158ead8e9e592e7b27 P 18435fbb525741328139e84a1e354954 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:22.496870 28046 raft_consensus.cc:515] T e9b149d77d9941158ead8e9e592e7b27 P 18435fbb525741328139e84a1e354954 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18435fbb525741328139e84a1e354954" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 40545 } } peers { permanent_uuid: "2513a663afac495eb09126ff55e8b2b0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40721 } } peers { permanent_uuid: "41268b218b804905a110c86738e74400" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 44403 } }
I20260709 13:08:22.499027 28046 leader_election.cc:290] T e9b149d77d9941158ead8e9e592e7b27 P 18435fbb525741328139e84a1e354954 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2513a663afac495eb09126ff55e8b2b0 (127.17.223.1:40721), 41268b218b804905a110c86738e74400 (127.17.223.2:44403)
I20260709 13:08:22.483233 27862 tablet_bootstrap.cc:654] T 78e19c035a854ee98657bec3edcb3585 P 665f7e09521a4c3f9284c1d8b0e094ff: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:22.505116 27593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9b149d77d9941158ead8e9e592e7b27" candidate_uuid: "18435fbb525741328139e84a1e354954" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2513a663afac495eb09126ff55e8b2b0" is_pre_election: true
I20260709 13:08:22.522792 27593 raft_consensus.cc:2468] T e9b149d77d9941158ead8e9e592e7b27 P 2513a663afac495eb09126ff55e8b2b0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 18435fbb525741328139e84a1e354954 in term 0.
I20260709 13:08:22.523094 27865 tablet_bootstrap.cc:492] T bc77856749a0473a8b3124ce8c523815 P 18435fbb525741328139e84a1e354954: No bootstrap required, opened a new log
I20260709 13:08:22.523985 27903 raft_consensus.cc:2749] T 47b65672307641ae81d5f94c639b1a10 P 665f7e09521a4c3f9284c1d8b0e094ff [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:08:22.524709 27779 leader_election.cc:304] T e9b149d77d9941158ead8e9e592e7b27 P 18435fbb525741328139e84a1e354954 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 18435fbb525741328139e84a1e354954, 2513a663afac495eb09126ff55e8b2b0; no voters: 
I20260709 13:08:22.512265 27861 ts_tablet_manager.cc:1434] T e9b149d77d9941158ead8e9e592e7b27 P 2513a663afac495eb09126ff55e8b2b0: Time spent starting tablet: real 0.074s	user 0.006s	sys 0.000s
I20260709 13:08:22.523759 27865 ts_tablet_manager.cc:1403] T bc77856749a0473a8b3124ce8c523815 P 18435fbb525741328139e84a1e354954: Time spent bootstrapping tablet: real 0.053s	user 0.005s	sys 0.007s
I20260709 13:08:22.516366 27666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9b149d77d9941158ead8e9e592e7b27" candidate_uuid: "18435fbb525741328139e84a1e354954" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "41268b218b804905a110c86738e74400" is_pre_election: true
I20260709 13:08:22.517843 27634 leader_election.cc:304] T 93c69c92efc3402e8e9546cb961bbcdc P 41268b218b804905a110c86738e74400 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 41268b218b804905a110c86738e74400, 665f7e09521a4c3f9284c1d8b0e094ff; no voters: 2513a663afac495eb09126ff55e8b2b0
I20260709 13:08:22.526862 28046 raft_consensus.cc:2804] T e9b149d77d9941158ead8e9e592e7b27 P 18435fbb525741328139e84a1e354954 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:08:22.533206 28046 raft_consensus.cc:493] T e9b149d77d9941158ead8e9e592e7b27 P 18435fbb525741328139e84a1e354954 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:22.533582 28046 raft_consensus.cc:3060] T e9b149d77d9941158ead8e9e592e7b27 P 18435fbb525741328139e84a1e354954 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:22.535838 27978 raft_consensus.cc:2804] T 93c69c92efc3402e8e9546cb961bbcdc P 41268b218b804905a110c86738e74400 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:08:22.536310 27978 raft_consensus.cc:493] T 93c69c92efc3402e8e9546cb961bbcdc P 41268b218b804905a110c86738e74400 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:22.536690 27978 raft_consensus.cc:3060] T 93c69c92efc3402e8e9546cb961bbcdc P 41268b218b804905a110c86738e74400 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:22.527009 27861 tablet_bootstrap.cc:492] T 93c69c92efc3402e8e9546cb961bbcdc P 2513a663afac495eb09126ff55e8b2b0: Bootstrap starting.
I20260709 13:08:22.513139 28060 raft_consensus.cc:2804] T 5f4a8242380b4863bf5ad2c055229bb7 P 665f7e09521a4c3f9284c1d8b0e094ff [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:08:22.539605 28060 raft_consensus.cc:697] T 5f4a8242380b4863bf5ad2c055229bb7 P 665f7e09521a4c3f9284c1d8b0e094ff [term 1 LEADER]: Becoming Leader. State: Replica: 665f7e09521a4c3f9284c1d8b0e094ff, State: Running, Role: LEADER
I20260709 13:08:22.540766 28060 consensus_queue.cc:237] T 5f4a8242380b4863bf5ad2c055229bb7 P 665f7e09521a4c3f9284c1d8b0e094ff [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "41268b218b804905a110c86738e74400" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 44403 } } peers { permanent_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 38749 } } peers { permanent_uuid: "18435fbb525741328139e84a1e354954" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 40545 } }
I20260709 13:08:22.541397 28046 raft_consensus.cc:515] T e9b149d77d9941158ead8e9e592e7b27 P 18435fbb525741328139e84a1e354954 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18435fbb525741328139e84a1e354954" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 40545 } } peers { permanent_uuid: "2513a663afac495eb09126ff55e8b2b0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40721 } } peers { permanent_uuid: "41268b218b804905a110c86738e74400" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 44403 } }
I20260709 13:08:22.544838 27667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9b149d77d9941158ead8e9e592e7b27" candidate_uuid: "18435fbb525741328139e84a1e354954" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "41268b218b804905a110c86738e74400"
I20260709 13:08:22.546074 27593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9b149d77d9941158ead8e9e592e7b27" candidate_uuid: "18435fbb525741328139e84a1e354954" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2513a663afac495eb09126ff55e8b2b0"
I20260709 13:08:22.546949 28046 leader_election.cc:290] T e9b149d77d9941158ead8e9e592e7b27 P 18435fbb525741328139e84a1e354954 [CANDIDATE]: Term 1 election: Requested vote from peers 2513a663afac495eb09126ff55e8b2b0 (127.17.223.1:40721), 41268b218b804905a110c86738e74400 (127.17.223.2:44403)
I20260709 13:08:22.546916 27593 raft_consensus.cc:3060] T e9b149d77d9941158ead8e9e592e7b27 P 2513a663afac495eb09126ff55e8b2b0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:22.547720 27666 raft_consensus.cc:2468] T e9b149d77d9941158ead8e9e592e7b27 P 41268b218b804905a110c86738e74400 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 18435fbb525741328139e84a1e354954 in term 0.
I20260709 13:08:22.555469 27862 tablet_bootstrap.cc:492] T 78e19c035a854ee98657bec3edcb3585 P 665f7e09521a4c3f9284c1d8b0e094ff: No bootstrap required, opened a new log
I20260709 13:08:22.557015 27862 ts_tablet_manager.cc:1403] T 78e19c035a854ee98657bec3edcb3585 P 665f7e09521a4c3f9284c1d8b0e094ff: Time spent bootstrapping tablet: real 0.092s	user 0.011s	sys 0.002s
I20260709 13:08:22.562101 27978 raft_consensus.cc:515] T 93c69c92efc3402e8e9546cb961bbcdc P 41268b218b804905a110c86738e74400 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2513a663afac495eb09126ff55e8b2b0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40721 } } peers { permanent_uuid: "41268b218b804905a110c86738e74400" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 44403 } } peers { permanent_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 38749 } }
I20260709 13:08:22.568640 27978 leader_election.cc:290] T 93c69c92efc3402e8e9546cb961bbcdc P 41268b218b804905a110c86738e74400 [CANDIDATE]: Term 1 election: Requested vote from peers 2513a663afac495eb09126ff55e8b2b0 (127.17.223.1:40721), 665f7e09521a4c3f9284c1d8b0e094ff (127.17.223.3:38749)
I20260709 13:08:22.566257 27861 tablet_bootstrap.cc:654] T 93c69c92efc3402e8e9546cb961bbcdc P 2513a663afac495eb09126ff55e8b2b0: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:22.569317 28013 raft_consensus.cc:493] T ff09d7e79a3e43918f3c71d10a40d60b P 18435fbb525741328139e84a1e354954 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:22.569082 27862 raft_consensus.cc:359] T 78e19c035a854ee98657bec3edcb3585 P 665f7e09521a4c3f9284c1d8b0e094ff [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 38749 } } peers { permanent_uuid: "18435fbb525741328139e84a1e354954" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 40545 } } peers { permanent_uuid: "2513a663afac495eb09126ff55e8b2b0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40721 } }
I20260709 13:08:22.570115 27862 raft_consensus.cc:385] T 78e19c035a854ee98657bec3edcb3585 P 665f7e09521a4c3f9284c1d8b0e094ff [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:22.565577 27865 raft_consensus.cc:359] T bc77856749a0473a8b3124ce8c523815 P 18435fbb525741328139e84a1e354954 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18435fbb525741328139e84a1e354954" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 40545 } } peers { permanent_uuid: "2513a663afac495eb09126ff55e8b2b0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40721 } } peers { permanent_uuid: "41268b218b804905a110c86738e74400" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 44403 } }
I20260709 13:08:22.570650 27865 raft_consensus.cc:385] T bc77856749a0473a8b3124ce8c523815 P 18435fbb525741328139e84a1e354954 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:22.571048 27865 raft_consensus.cc:740] T bc77856749a0473a8b3124ce8c523815 P 18435fbb525741328139e84a1e354954 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 18435fbb525741328139e84a1e354954, State: Initialized, Role: FOLLOWER
I20260709 13:08:22.571424 27592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93c69c92efc3402e8e9546cb961bbcdc" candidate_uuid: "41268b218b804905a110c86738e74400" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2513a663afac495eb09126ff55e8b2b0"
I20260709 13:08:22.571947 27865 consensus_queue.cc:260] T bc77856749a0473a8b3124ce8c523815 P 18435fbb525741328139e84a1e354954 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18435fbb525741328139e84a1e354954" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 40545 } } peers { permanent_uuid: "2513a663afac495eb09126ff55e8b2b0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40721 } } peers { permanent_uuid: "41268b218b804905a110c86738e74400" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 44403 } }
W20260709 13:08:22.573232 27631 leader_election.cc:343] T 93c69c92efc3402e8e9546cb961bbcdc P 41268b218b804905a110c86738e74400 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 2513a663afac495eb09126ff55e8b2b0 (127.17.223.1:40721): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:22.569891 28013 raft_consensus.cc:515] T ff09d7e79a3e43918f3c71d10a40d60b P 18435fbb525741328139e84a1e354954 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 38749 } } peers { permanent_uuid: "18435fbb525741328139e84a1e354954" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 40545 } } peers { permanent_uuid: "2513a663afac495eb09126ff55e8b2b0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40721 } }
I20260709 13:08:22.575044 27865 ts_tablet_manager.cc:1434] T bc77856749a0473a8b3124ce8c523815 P 18435fbb525741328139e84a1e354954: Time spent starting tablet: real 0.045s	user 0.004s	sys 0.004s
I20260709 13:08:22.576453 27865 tablet_bootstrap.cc:492] T 78e19c035a854ee98657bec3edcb3585 P 18435fbb525741328139e84a1e354954: Bootstrap starting.
I20260709 13:08:22.576894 28013 leader_election.cc:290] T ff09d7e79a3e43918f3c71d10a40d60b P 18435fbb525741328139e84a1e354954 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 665f7e09521a4c3f9284c1d8b0e094ff (127.17.223.3:38749), 2513a663afac495eb09126ff55e8b2b0 (127.17.223.1:40721)
I20260709 13:08:22.579290 27592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff09d7e79a3e43918f3c71d10a40d60b" candidate_uuid: "18435fbb525741328139e84a1e354954" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2513a663afac495eb09126ff55e8b2b0" is_pre_election: true
I20260709 13:08:22.580111 27592 raft_consensus.cc:2468] T ff09d7e79a3e43918f3c71d10a40d60b P 2513a663afac495eb09126ff55e8b2b0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 18435fbb525741328139e84a1e354954 in term 0.
I20260709 13:08:22.580180 27739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff09d7e79a3e43918f3c71d10a40d60b" candidate_uuid: "18435fbb525741328139e84a1e354954" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" is_pre_election: true
I20260709 13:08:22.581120 27739 raft_consensus.cc:2468] T ff09d7e79a3e43918f3c71d10a40d60b P 665f7e09521a4c3f9284c1d8b0e094ff [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 18435fbb525741328139e84a1e354954 in term 0.
I20260709 13:08:22.584897 27779 leader_election.cc:304] T ff09d7e79a3e43918f3c71d10a40d60b P 18435fbb525741328139e84a1e354954 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 18435fbb525741328139e84a1e354954, 2513a663afac495eb09126ff55e8b2b0; no voters: 
I20260709 13:08:22.585644 27862 raft_consensus.cc:740] T 78e19c035a854ee98657bec3edcb3585 P 665f7e09521a4c3f9284c1d8b0e094ff [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 665f7e09521a4c3f9284c1d8b0e094ff, State: Initialized, Role: FOLLOWER
I20260709 13:08:22.586793 27862 consensus_queue.cc:260] T 78e19c035a854ee98657bec3edcb3585 P 665f7e09521a4c3f9284c1d8b0e094ff [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 38749 } } peers { permanent_uuid: "18435fbb525741328139e84a1e354954" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 40545 } } peers { permanent_uuid: "2513a663afac495eb09126ff55e8b2b0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40721 } }
I20260709 13:08:22.593824 27491 catalog_manager.cc:5697] T 5f4a8242380b4863bf5ad2c055229bb7 P 665f7e09521a4c3f9284c1d8b0e094ff reported cstate change: term changed from 0 to 1, leader changed from <none> to 665f7e09521a4c3f9284c1d8b0e094ff (127.17.223.3). New cstate: current_term: 1 leader_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "41268b218b804905a110c86738e74400" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 44403 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 38749 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "18435fbb525741328139e84a1e354954" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 40545 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:22.599037 28013 raft_consensus.cc:2804] T ff09d7e79a3e43918f3c71d10a40d60b P 18435fbb525741328139e84a1e354954 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:08:22.605950 28013 raft_consensus.cc:493] T ff09d7e79a3e43918f3c71d10a40d60b P 18435fbb525741328139e84a1e354954 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:22.608175 28013 raft_consensus.cc:3060] T ff09d7e79a3e43918f3c71d10a40d60b P 18435fbb525741328139e84a1e354954 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:22.624202 28060 raft_consensus.cc:493] T 78e19c035a854ee98657bec3edcb3585 P 665f7e09521a4c3f9284c1d8b0e094ff [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:22.637908 28060 raft_consensus.cc:515] T 78e19c035a854ee98657bec3edcb3585 P 665f7e09521a4c3f9284c1d8b0e094ff [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 38749 } } peers { permanent_uuid: "18435fbb525741328139e84a1e354954" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 40545 } } peers { permanent_uuid: "2513a663afac495eb09126ff55e8b2b0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40721 } }
I20260709 13:08:22.641961 28060 leader_election.cc:290] T 78e19c035a854ee98657bec3edcb3585 P 665f7e09521a4c3f9284c1d8b0e094ff [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 18435fbb525741328139e84a1e354954 (127.17.223.4:40545), 2513a663afac495eb09126ff55e8b2b0 (127.17.223.1:40721)
I20260709 13:08:22.626969 27862 ts_tablet_manager.cc:1434] T 78e19c035a854ee98657bec3edcb3585 P 665f7e09521a4c3f9284c1d8b0e094ff: Time spent starting tablet: real 0.069s	user 0.012s	sys 0.000s
I20260709 13:08:22.629662 27739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93c69c92efc3402e8e9546cb961bbcdc" candidate_uuid: "41268b218b804905a110c86738e74400" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "665f7e09521a4c3f9284c1d8b0e094ff"
I20260709 13:08:22.647917 27739 raft_consensus.cc:3060] T 93c69c92efc3402e8e9546cb961bbcdc P 665f7e09521a4c3f9284c1d8b0e094ff [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:22.648974 27862 tablet_bootstrap.cc:492] T 106e04f510c741439b91c39d5fac5a23 P 665f7e09521a4c3f9284c1d8b0e094ff: Bootstrap starting.
I20260709 13:08:22.665942 27865 tablet_bootstrap.cc:654] T 78e19c035a854ee98657bec3edcb3585 P 18435fbb525741328139e84a1e354954: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:22.667445 27593 raft_consensus.cc:2468] T e9b149d77d9941158ead8e9e592e7b27 P 2513a663afac495eb09126ff55e8b2b0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 18435fbb525741328139e84a1e354954 in term 1.
I20260709 13:08:22.675673 27779 leader_election.cc:304] T e9b149d77d9941158ead8e9e592e7b27 P 18435fbb525741328139e84a1e354954 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 18435fbb525741328139e84a1e354954, 2513a663afac495eb09126ff55e8b2b0; no voters: 41268b218b804905a110c86738e74400
I20260709 13:08:22.677400 27592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78e19c035a854ee98657bec3edcb3585" candidate_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2513a663afac495eb09126ff55e8b2b0" is_pre_election: true
I20260709 13:08:22.678326 27863 tablet_bootstrap.cc:492] T 85cdd21b7a5f4db7af44327c57c16d43 P 41268b218b804905a110c86738e74400: No bootstrap required, opened a new log
I20260709 13:08:22.678898 27863 ts_tablet_manager.cc:1403] T 85cdd21b7a5f4db7af44327c57c16d43 P 41268b218b804905a110c86738e74400: Time spent bootstrapping tablet: real 0.232s	user 0.041s	sys 0.089s
I20260709 13:08:22.678933 28046 raft_consensus.cc:2804] T e9b149d77d9941158ead8e9e592e7b27 P 18435fbb525741328139e84a1e354954 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:08:22.679530 28046 raft_consensus.cc:697] T e9b149d77d9941158ead8e9e592e7b27 P 18435fbb525741328139e84a1e354954 [term 1 LEADER]: Becoming Leader. State: Replica: 18435fbb525741328139e84a1e354954, State: Running, Role: LEADER
W20260709 13:08:22.680203 27705 leader_election.cc:343] T 78e19c035a854ee98657bec3edcb3585 P 665f7e09521a4c3f9284c1d8b0e094ff [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2513a663afac495eb09126ff55e8b2b0 (127.17.223.1:40721): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:22.680382 28046 consensus_queue.cc:237] T e9b149d77d9941158ead8e9e592e7b27 P 18435fbb525741328139e84a1e354954 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18435fbb525741328139e84a1e354954" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 40545 } } peers { permanent_uuid: "2513a663afac495eb09126ff55e8b2b0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40721 } } peers { permanent_uuid: "41268b218b804905a110c86738e74400" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 44403 } }
I20260709 13:08:22.681984 27863 raft_consensus.cc:359] T 85cdd21b7a5f4db7af44327c57c16d43 P 41268b218b804905a110c86738e74400 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2513a663afac495eb09126ff55e8b2b0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40721 } } peers { permanent_uuid: "41268b218b804905a110c86738e74400" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 44403 } } peers { permanent_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 38749 } }
I20260709 13:08:22.682659 27863 raft_consensus.cc:385] T 85cdd21b7a5f4db7af44327c57c16d43 P 41268b218b804905a110c86738e74400 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:22.682986 27863 raft_consensus.cc:740] T 85cdd21b7a5f4db7af44327c57c16d43 P 41268b218b804905a110c86738e74400 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 41268b218b804905a110c86738e74400, State: Initialized, Role: FOLLOWER
I20260709 13:08:22.683650 27863 consensus_queue.cc:260] T 85cdd21b7a5f4db7af44327c57c16d43 P 41268b218b804905a110c86738e74400 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2513a663afac495eb09126ff55e8b2b0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40721 } } peers { permanent_uuid: "41268b218b804905a110c86738e74400" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 44403 } } peers { permanent_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 38749 } }
I20260709 13:08:22.685636 27863 ts_tablet_manager.cc:1434] T 85cdd21b7a5f4db7af44327c57c16d43 P 41268b218b804905a110c86738e74400: Time spent starting tablet: real 0.006s	user 0.003s	sys 0.000s
I20260709 13:08:22.686998 27863 tablet_bootstrap.cc:492] T 8ee97a8570ae4cb49195d1b977d1cdf4 P 41268b218b804905a110c86738e74400: Bootstrap starting.
I20260709 13:08:22.696040 27739 raft_consensus.cc:2468] T 93c69c92efc3402e8e9546cb961bbcdc P 665f7e09521a4c3f9284c1d8b0e094ff [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 41268b218b804905a110c86738e74400 in term 1.
I20260709 13:08:22.695932 27901 consensus_queue.cc:1048] T bc77856749a0473a8b3124ce8c523815 P 41268b218b804905a110c86738e74400 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2513a663afac495eb09126ff55e8b2b0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40721 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:08:22.696962 28013 raft_consensus.cc:515] T ff09d7e79a3e43918f3c71d10a40d60b P 18435fbb525741328139e84a1e354954 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 38749 } } peers { permanent_uuid: "18435fbb525741328139e84a1e354954" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 40545 } } peers { permanent_uuid: "2513a663afac495eb09126ff55e8b2b0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40721 } }
I20260709 13:08:22.699357 27634 leader_election.cc:304] T 93c69c92efc3402e8e9546cb961bbcdc P 41268b218b804905a110c86738e74400 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 41268b218b804905a110c86738e74400, 665f7e09521a4c3f9284c1d8b0e094ff; no voters: 2513a663afac495eb09126ff55e8b2b0
I20260709 13:08:22.703301 27862 tablet_bootstrap.cc:654] T 106e04f510c741439b91c39d5fac5a23 P 665f7e09521a4c3f9284c1d8b0e094ff: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:22.703447 27861 tablet_bootstrap.cc:492] T 93c69c92efc3402e8e9546cb961bbcdc P 2513a663afac495eb09126ff55e8b2b0: No bootstrap required, opened a new log
I20260709 13:08:22.704010 27861 ts_tablet_manager.cc:1403] T 93c69c92efc3402e8e9546cb961bbcdc P 2513a663afac495eb09126ff55e8b2b0: Time spent bootstrapping tablet: real 0.177s	user 0.041s	sys 0.022s
I20260709 13:08:22.704550 27863 tablet_bootstrap.cc:654] T 8ee97a8570ae4cb49195d1b977d1cdf4 P 41268b218b804905a110c86738e74400: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:22.705858 28014 raft_consensus.cc:2804] T 93c69c92efc3402e8e9546cb961bbcdc P 41268b218b804905a110c86738e74400 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:08:22.706384 28014 raft_consensus.cc:697] T 93c69c92efc3402e8e9546cb961bbcdc P 41268b218b804905a110c86738e74400 [term 1 LEADER]: Becoming Leader. State: Replica: 41268b218b804905a110c86738e74400, State: Running, Role: LEADER
I20260709 13:08:22.707010 27861 raft_consensus.cc:359] T 93c69c92efc3402e8e9546cb961bbcdc P 2513a663afac495eb09126ff55e8b2b0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2513a663afac495eb09126ff55e8b2b0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40721 } } peers { permanent_uuid: "41268b218b804905a110c86738e74400" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 44403 } } peers { permanent_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 38749 } }
I20260709 13:08:22.707237 28014 consensus_queue.cc:237] T 93c69c92efc3402e8e9546cb961bbcdc P 41268b218b804905a110c86738e74400 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2513a663afac495eb09126ff55e8b2b0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40721 } } peers { permanent_uuid: "41268b218b804905a110c86738e74400" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 44403 } } peers { permanent_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 38749 } }
I20260709 13:08:22.707820 27861 raft_consensus.cc:385] T 93c69c92efc3402e8e9546cb961bbcdc P 2513a663afac495eb09126ff55e8b2b0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:22.709239 27861 raft_consensus.cc:740] T 93c69c92efc3402e8e9546cb961bbcdc P 2513a663afac495eb09126ff55e8b2b0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2513a663afac495eb09126ff55e8b2b0, State: Initialized, Role: FOLLOWER
I20260709 13:08:22.712605 27861 consensus_queue.cc:260] T 93c69c92efc3402e8e9546cb961bbcdc P 2513a663afac495eb09126ff55e8b2b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2513a663afac495eb09126ff55e8b2b0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40721 } } peers { permanent_uuid: "41268b218b804905a110c86738e74400" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 44403 } } peers { permanent_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 38749 } }
I20260709 13:08:22.719203 27861 ts_tablet_manager.cc:1434] T 93c69c92efc3402e8e9546cb961bbcdc P 2513a663afac495eb09126ff55e8b2b0: Time spent starting tablet: real 0.015s	user 0.008s	sys 0.001s
I20260709 13:08:22.721881 27861 tablet_bootstrap.cc:492] T 4cd7359accee42808761c37543247321 P 2513a663afac495eb09126ff55e8b2b0: Bootstrap starting.
I20260709 13:08:22.717897 28046 raft_consensus.cc:493] T bc77856749a0473a8b3124ce8c523815 P 18435fbb525741328139e84a1e354954 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:22.726805 28046 raft_consensus.cc:515] T bc77856749a0473a8b3124ce8c523815 P 18435fbb525741328139e84a1e354954 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18435fbb525741328139e84a1e354954" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 40545 } } peers { permanent_uuid: "2513a663afac495eb09126ff55e8b2b0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40721 } } peers { permanent_uuid: "41268b218b804905a110c86738e74400" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 44403 } }
I20260709 13:08:22.730346 27982 raft_consensus.cc:493] T 85cdd21b7a5f4db7af44327c57c16d43 P 41268b218b804905a110c86738e74400 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:22.730849 27982 raft_consensus.cc:515] T 85cdd21b7a5f4db7af44327c57c16d43 P 41268b218b804905a110c86738e74400 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2513a663afac495eb09126ff55e8b2b0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40721 } } peers { permanent_uuid: "41268b218b804905a110c86738e74400" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 44403 } } peers { permanent_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 38749 } }
I20260709 13:08:22.734181 27593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff09d7e79a3e43918f3c71d10a40d60b" candidate_uuid: "18435fbb525741328139e84a1e354954" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2513a663afac495eb09126ff55e8b2b0"
I20260709 13:08:22.734871 27593 raft_consensus.cc:3060] T ff09d7e79a3e43918f3c71d10a40d60b P 2513a663afac495eb09126ff55e8b2b0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:22.737543 27982 leader_election.cc:290] T 85cdd21b7a5f4db7af44327c57c16d43 P 41268b218b804905a110c86738e74400 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2513a663afac495eb09126ff55e8b2b0 (127.17.223.1:40721), 665f7e09521a4c3f9284c1d8b0e094ff (127.17.223.3:38749)
I20260709 13:08:22.737936 27591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85cdd21b7a5f4db7af44327c57c16d43" candidate_uuid: "41268b218b804905a110c86738e74400" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2513a663afac495eb09126ff55e8b2b0" is_pre_election: true
I20260709 13:08:22.738763 27740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85cdd21b7a5f4db7af44327c57c16d43" candidate_uuid: "41268b218b804905a110c86738e74400" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" is_pre_election: true
W20260709 13:08:22.739912 27631 leader_election.cc:343] T 85cdd21b7a5f4db7af44327c57c16d43 P 41268b218b804905a110c86738e74400 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2513a663afac495eb09126ff55e8b2b0 (127.17.223.1:40721): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:08:22.740585 27634 leader_election.cc:343] T 85cdd21b7a5f4db7af44327c57c16d43 P 41268b218b804905a110c86738e74400 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 665f7e09521a4c3f9284c1d8b0e094ff (127.17.223.3:38749): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:22.741030 27634 leader_election.cc:304] T 85cdd21b7a5f4db7af44327c57c16d43 P 41268b218b804905a110c86738e74400 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 41268b218b804905a110c86738e74400; no voters: 2513a663afac495eb09126ff55e8b2b0, 665f7e09521a4c3f9284c1d8b0e094ff
I20260709 13:08:22.742369 27742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff09d7e79a3e43918f3c71d10a40d60b" candidate_uuid: "18435fbb525741328139e84a1e354954" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "665f7e09521a4c3f9284c1d8b0e094ff"
I20260709 13:08:22.743027 27742 raft_consensus.cc:3060] T ff09d7e79a3e43918f3c71d10a40d60b P 665f7e09521a4c3f9284c1d8b0e094ff [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:22.743782 27863 tablet_bootstrap.cc:492] T 8ee97a8570ae4cb49195d1b977d1cdf4 P 41268b218b804905a110c86738e74400: No bootstrap required, opened a new log
I20260709 13:08:22.744390 27863 ts_tablet_manager.cc:1403] T 8ee97a8570ae4cb49195d1b977d1cdf4 P 41268b218b804905a110c86738e74400: Time spent bootstrapping tablet: real 0.058s	user 0.006s	sys 0.011s
I20260709 13:08:22.744359 27982 raft_consensus.cc:2749] T 85cdd21b7a5f4db7af44327c57c16d43 P 41268b218b804905a110c86738e74400 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:08:22.753159 27861 tablet_bootstrap.cc:654] T 4cd7359accee42808761c37543247321 P 2513a663afac495eb09126ff55e8b2b0: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:22.753253 27591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc77856749a0473a8b3124ce8c523815" candidate_uuid: "18435fbb525741328139e84a1e354954" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2513a663afac495eb09126ff55e8b2b0" is_pre_election: true
I20260709 13:08:22.755102 28046 leader_election.cc:290] T bc77856749a0473a8b3124ce8c523815 P 18435fbb525741328139e84a1e354954 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2513a663afac495eb09126ff55e8b2b0 (127.17.223.1:40721), 41268b218b804905a110c86738e74400 (127.17.223.2:44403)
I20260709 13:08:22.720533 28013 leader_election.cc:290] T ff09d7e79a3e43918f3c71d10a40d60b P 18435fbb525741328139e84a1e354954 [CANDIDATE]: Term 1 election: Requested vote from peers 665f7e09521a4c3f9284c1d8b0e094ff (127.17.223.3:38749), 2513a663afac495eb09126ff55e8b2b0 (127.17.223.1:40721)
I20260709 13:08:22.755927 27742 raft_consensus.cc:2468] T ff09d7e79a3e43918f3c71d10a40d60b P 665f7e09521a4c3f9284c1d8b0e094ff [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 18435fbb525741328139e84a1e354954 in term 1.
I20260709 13:08:22.764027 27863 raft_consensus.cc:359] T 8ee97a8570ae4cb49195d1b977d1cdf4 P 41268b218b804905a110c86738e74400 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "41268b218b804905a110c86738e74400" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 44403 } } peers { permanent_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 38749 } } peers { permanent_uuid: "18435fbb525741328139e84a1e354954" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 40545 } }
I20260709 13:08:22.765147 27863 raft_consensus.cc:385] T 8ee97a8570ae4cb49195d1b977d1cdf4 P 41268b218b804905a110c86738e74400 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:22.765513 27863 raft_consensus.cc:740] T 8ee97a8570ae4cb49195d1b977d1cdf4 P 41268b218b804905a110c86738e74400 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 41268b218b804905a110c86738e74400, State: Initialized, Role: FOLLOWER
I20260709 13:08:22.768690 27863 consensus_queue.cc:260] T 8ee97a8570ae4cb49195d1b977d1cdf4 P 41268b218b804905a110c86738e74400 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "41268b218b804905a110c86738e74400" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 44403 } } peers { permanent_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 38749 } } peers { permanent_uuid: "18435fbb525741328139e84a1e354954" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 40545 } }
I20260709 13:08:22.772810 27863 ts_tablet_manager.cc:1434] T 8ee97a8570ae4cb49195d1b977d1cdf4 P 41268b218b804905a110c86738e74400: Time spent starting tablet: real 0.028s	user 0.003s	sys 0.004s
I20260709 13:08:22.765441 27593 raft_consensus.cc:2468] T ff09d7e79a3e43918f3c71d10a40d60b P 2513a663afac495eb09126ff55e8b2b0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 18435fbb525741328139e84a1e354954 in term 1.
W20260709 13:08:22.775147 28102 log.cc:927] Time spent T e9b149d77d9941158ead8e9e592e7b27 P 18435fbb525741328139e84a1e354954: Append to log took a long time: real 0.060s	user 0.001s	sys 0.000s
I20260709 13:08:22.780783 27863 tablet_bootstrap.cc:492] T 3a7da70e9f0f49a9bf60184a8f0b5339 P 41268b218b804905a110c86738e74400: Bootstrap starting.
I20260709 13:08:22.781790 27491 catalog_manager.cc:5697] T e9b149d77d9941158ead8e9e592e7b27 P 18435fbb525741328139e84a1e354954 reported cstate change: term changed from 0 to 1, leader changed from <none> to 18435fbb525741328139e84a1e354954 (127.17.223.4). New cstate: current_term: 1 leader_uuid: "18435fbb525741328139e84a1e354954" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18435fbb525741328139e84a1e354954" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 40545 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2513a663afac495eb09126ff55e8b2b0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40721 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "41268b218b804905a110c86738e74400" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 44403 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:22.783165 27861 tablet_bootstrap.cc:492] T 4cd7359accee42808761c37543247321 P 2513a663afac495eb09126ff55e8b2b0: No bootstrap required, opened a new log
I20260709 13:08:22.783950 27861 ts_tablet_manager.cc:1403] T 4cd7359accee42808761c37543247321 P 2513a663afac495eb09126ff55e8b2b0: Time spent bootstrapping tablet: real 0.062s	user 0.013s	sys 0.004s
I20260709 13:08:22.781880 27488 catalog_manager.cc:5697] T 93c69c92efc3402e8e9546cb961bbcdc P 41268b218b804905a110c86738e74400 reported cstate change: term changed from 0 to 1, leader changed from <none> to 41268b218b804905a110c86738e74400 (127.17.223.2). New cstate: current_term: 1 leader_uuid: "41268b218b804905a110c86738e74400" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2513a663afac495eb09126ff55e8b2b0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40721 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "41268b218b804905a110c86738e74400" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 44403 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 38749 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:22.778344 27782 leader_election.cc:304] T ff09d7e79a3e43918f3c71d10a40d60b P 18435fbb525741328139e84a1e354954 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 18435fbb525741328139e84a1e354954, 665f7e09521a4c3f9284c1d8b0e094ff; no voters: 
I20260709 13:08:22.787755 27865 tablet_bootstrap.cc:492] T 78e19c035a854ee98657bec3edcb3585 P 18435fbb525741328139e84a1e354954: No bootstrap required, opened a new log
I20260709 13:08:22.788264 27865 ts_tablet_manager.cc:1403] T 78e19c035a854ee98657bec3edcb3585 P 18435fbb525741328139e84a1e354954: Time spent bootstrapping tablet: real 0.212s	user 0.020s	sys 0.004s
I20260709 13:08:22.788753 28101 raft_consensus.cc:2804] T ff09d7e79a3e43918f3c71d10a40d60b P 18435fbb525741328139e84a1e354954 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:08:22.789279 28101 raft_consensus.cc:697] T ff09d7e79a3e43918f3c71d10a40d60b P 18435fbb525741328139e84a1e354954 [term 1 LEADER]: Becoming Leader. State: Replica: 18435fbb525741328139e84a1e354954, State: Running, Role: LEADER
I20260709 13:08:22.790117 28101 consensus_queue.cc:237] T ff09d7e79a3e43918f3c71d10a40d60b P 18435fbb525741328139e84a1e354954 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 38749 } } peers { permanent_uuid: "18435fbb525741328139e84a1e354954" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 40545 } } peers { permanent_uuid: "2513a663afac495eb09126ff55e8b2b0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40721 } }
I20260709 13:08:22.791432 27816 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78e19c035a854ee98657bec3edcb3585" candidate_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "18435fbb525741328139e84a1e354954" is_pre_election: true
I20260709 13:08:22.792187 27862 tablet_bootstrap.cc:492] T 106e04f510c741439b91c39d5fac5a23 P 665f7e09521a4c3f9284c1d8b0e094ff: No bootstrap required, opened a new log
I20260709 13:08:22.792670 27862 ts_tablet_manager.cc:1403] T 106e04f510c741439b91c39d5fac5a23 P 665f7e09521a4c3f9284c1d8b0e094ff: Time spent bootstrapping tablet: real 0.144s	user 0.012s	sys 0.003s
I20260709 13:08:22.794214 27666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc77856749a0473a8b3124ce8c523815" candidate_uuid: "18435fbb525741328139e84a1e354954" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "41268b218b804905a110c86738e74400" is_pre_election: true
I20260709 13:08:22.795270 27865 raft_consensus.cc:359] T 78e19c035a854ee98657bec3edcb3585 P 18435fbb525741328139e84a1e354954 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 38749 } } peers { permanent_uuid: "18435fbb525741328139e84a1e354954" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 40545 } } peers { permanent_uuid: "2513a663afac495eb09126ff55e8b2b0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40721 } }
I20260709 13:08:22.796062 27865 raft_consensus.cc:385] T 78e19c035a854ee98657bec3edcb3585 P 18435fbb525741328139e84a1e354954 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:22.796306 27865 raft_consensus.cc:740] T 78e19c035a854ee98657bec3edcb3585 P 18435fbb525741328139e84a1e354954 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 18435fbb525741328139e84a1e354954, State: Initialized, Role: FOLLOWER
I20260709 13:08:22.796988 27865 consensus_queue.cc:260] T 78e19c035a854ee98657bec3edcb3585 P 18435fbb525741328139e84a1e354954 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 38749 } } peers { permanent_uuid: "18435fbb525741328139e84a1e354954" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 40545 } } peers { permanent_uuid: "2513a663afac495eb09126ff55e8b2b0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40721 } }
I20260709 13:08:22.798044 27816 raft_consensus.cc:2468] T 78e19c035a854ee98657bec3edcb3585 P 18435fbb525741328139e84a1e354954 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 665f7e09521a4c3f9284c1d8b0e094ff in term 0.
I20260709 13:08:22.799304 27865 ts_tablet_manager.cc:1434] T 78e19c035a854ee98657bec3edcb3585 P 18435fbb525741328139e84a1e354954: Time spent starting tablet: real 0.011s	user 0.006s	sys 0.001s
I20260709 13:08:22.800940 27865 tablet_bootstrap.cc:492] T 4cd7359accee42808761c37543247321 P 18435fbb525741328139e84a1e354954: Bootstrap starting.
I20260709 13:08:22.801270 27708 leader_election.cc:304] T 78e19c035a854ee98657bec3edcb3585 P 665f7e09521a4c3f9284c1d8b0e094ff [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 18435fbb525741328139e84a1e354954, 665f7e09521a4c3f9284c1d8b0e094ff; no voters: 2513a663afac495eb09126ff55e8b2b0
I20260709 13:08:22.802551 28082 raft_consensus.cc:2804] T 78e19c035a854ee98657bec3edcb3585 P 665f7e09521a4c3f9284c1d8b0e094ff [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:08:22.803043 28082 raft_consensus.cc:493] T 78e19c035a854ee98657bec3edcb3585 P 665f7e09521a4c3f9284c1d8b0e094ff [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:22.803474 28082 raft_consensus.cc:3060] T 78e19c035a854ee98657bec3edcb3585 P 665f7e09521a4c3f9284c1d8b0e094ff [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:22.808053 27865 tablet_bootstrap.cc:654] T 4cd7359accee42808761c37543247321 P 18435fbb525741328139e84a1e354954: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:22.811383 27814 raft_consensus.cc:3060] T bc77856749a0473a8b3124ce8c523815 P 18435fbb525741328139e84a1e354954 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:22.820930 27782 leader_election.cc:304] T bc77856749a0473a8b3124ce8c523815 P 18435fbb525741328139e84a1e354954 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 18435fbb525741328139e84a1e354954; no voters: 2513a663afac495eb09126ff55e8b2b0, 41268b218b804905a110c86738e74400
I20260709 13:08:22.821877 28060 consensus_queue.cc:1048] T 5e6f8bdfe11b4af4aa27a711db7cbe7a P 665f7e09521a4c3f9284c1d8b0e094ff [LEADER]: Connected to new peer: Peer: permanent_uuid: "2513a663afac495eb09126ff55e8b2b0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40721 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:08:22.828018 27861 raft_consensus.cc:359] T 4cd7359accee42808761c37543247321 P 2513a663afac495eb09126ff55e8b2b0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18435fbb525741328139e84a1e354954" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 40545 } } peers { permanent_uuid: "2513a663afac495eb09126ff55e8b2b0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40721 } } peers { permanent_uuid: "41268b218b804905a110c86738e74400" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 44403 } }
I20260709 13:08:22.828773 27861 raft_consensus.cc:385] T 4cd7359accee42808761c37543247321 P 2513a663afac495eb09126ff55e8b2b0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:22.828315 27862 raft_consensus.cc:359] T 106e04f510c741439b91c39d5fac5a23 P 665f7e09521a4c3f9284c1d8b0e094ff [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "41268b218b804905a110c86738e74400" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 44403 } } peers { permanent_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 38749 } } peers { permanent_uuid: "18435fbb525741328139e84a1e354954" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 40545 } }
I20260709 13:08:22.829073 27861 raft_consensus.cc:740] T 4cd7359accee42808761c37543247321 P 2513a663afac495eb09126ff55e8b2b0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2513a663afac495eb09126ff55e8b2b0, State: Initialized, Role: FOLLOWER
I20260709 13:08:22.829996 27863 tablet_bootstrap.cc:654] T 3a7da70e9f0f49a9bf60184a8f0b5339 P 41268b218b804905a110c86738e74400: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:22.833216 27861 consensus_queue.cc:260] T 4cd7359accee42808761c37543247321 P 2513a663afac495eb09126ff55e8b2b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18435fbb525741328139e84a1e354954" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 40545 } } peers { permanent_uuid: "2513a663afac495eb09126ff55e8b2b0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40721 } } peers { permanent_uuid: "41268b218b804905a110c86738e74400" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 44403 } }
I20260709 13:08:22.834070 27862 raft_consensus.cc:385] T 106e04f510c741439b91c39d5fac5a23 P 665f7e09521a4c3f9284c1d8b0e094ff [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:22.834683 27862 raft_consensus.cc:740] T 106e04f510c741439b91c39d5fac5a23 P 665f7e09521a4c3f9284c1d8b0e094ff [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 665f7e09521a4c3f9284c1d8b0e094ff, State: Initialized, Role: FOLLOWER
I20260709 13:08:22.836162 27862 consensus_queue.cc:260] T 106e04f510c741439b91c39d5fac5a23 P 665f7e09521a4c3f9284c1d8b0e094ff [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "41268b218b804905a110c86738e74400" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 44403 } } peers { permanent_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 38749 } } peers { permanent_uuid: "18435fbb525741328139e84a1e354954" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 40545 } }
I20260709 13:08:22.840474 27862 ts_tablet_manager.cc:1434] T 106e04f510c741439b91c39d5fac5a23 P 665f7e09521a4c3f9284c1d8b0e094ff: Time spent starting tablet: real 0.048s	user 0.012s	sys 0.010s
I20260709 13:08:22.838511 27861 ts_tablet_manager.cc:1434] T 4cd7359accee42808761c37543247321 P 2513a663afac495eb09126ff55e8b2b0: Time spent starting tablet: real 0.054s	user 0.004s	sys 0.003s
I20260709 13:08:22.841598 27861 tablet_bootstrap.cc:492] T 78e19c035a854ee98657bec3edcb3585 P 2513a663afac495eb09126ff55e8b2b0: Bootstrap starting.
I20260709 13:08:22.846040 27862 tablet_bootstrap.cc:492] T 8ee97a8570ae4cb49195d1b977d1cdf4 P 665f7e09521a4c3f9284c1d8b0e094ff: Bootstrap starting.
I20260709 13:08:22.849817 27874 raft_consensus.cc:2749] T bc77856749a0473a8b3124ce8c523815 P 18435fbb525741328139e84a1e354954 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:08:22.852936 28014 consensus_queue.cc:1048] T bc77856749a0473a8b3124ce8c523815 P 41268b218b804905a110c86738e74400 [LEADER]: Connected to new peer: Peer: permanent_uuid: "18435fbb525741328139e84a1e354954" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 40545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:08:22.861259 28060 raft_consensus.cc:493] T 106e04f510c741439b91c39d5fac5a23 P 665f7e09521a4c3f9284c1d8b0e094ff [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:22.861730 28060 raft_consensus.cc:515] T 106e04f510c741439b91c39d5fac5a23 P 665f7e09521a4c3f9284c1d8b0e094ff [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "41268b218b804905a110c86738e74400" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 44403 } } peers { permanent_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 38749 } } peers { permanent_uuid: "18435fbb525741328139e84a1e354954" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 40545 } }
I20260709 13:08:22.848007 28082 raft_consensus.cc:515] T 78e19c035a854ee98657bec3edcb3585 P 665f7e09521a4c3f9284c1d8b0e094ff [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 38749 } } peers { permanent_uuid: "18435fbb525741328139e84a1e354954" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 40545 } } peers { permanent_uuid: "2513a663afac495eb09126ff55e8b2b0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40721 } }
I20260709 13:08:22.862367 27863 tablet_bootstrap.cc:492] T 3a7da70e9f0f49a9bf60184a8f0b5339 P 41268b218b804905a110c86738e74400: No bootstrap required, opened a new log
I20260709 13:08:22.863936 27863 ts_tablet_manager.cc:1403] T 3a7da70e9f0f49a9bf60184a8f0b5339 P 41268b218b804905a110c86738e74400: Time spent bootstrapping tablet: real 0.087s	user 0.014s	sys 0.003s
I20260709 13:08:22.864490 28060 leader_election.cc:290] T 106e04f510c741439b91c39d5fac5a23 P 665f7e09521a4c3f9284c1d8b0e094ff [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 41268b218b804905a110c86738e74400 (127.17.223.2:44403), 18435fbb525741328139e84a1e354954 (127.17.223.4:40545)
I20260709 13:08:22.873224 28082 leader_election.cc:290] T 78e19c035a854ee98657bec3edcb3585 P 665f7e09521a4c3f9284c1d8b0e094ff [CANDIDATE]: Term 1 election: Requested vote from peers 18435fbb525741328139e84a1e354954 (127.17.223.4:40545), 2513a663afac495eb09126ff55e8b2b0 (127.17.223.1:40721)
I20260709 13:08:22.875716 27861 tablet_bootstrap.cc:654] T 78e19c035a854ee98657bec3edcb3585 P 2513a663afac495eb09126ff55e8b2b0: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:22.874661 28014 raft_consensus.cc:493] T 4cd7359accee42808761c37543247321 P 41268b218b804905a110c86738e74400 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:22.881868 27667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "106e04f510c741439b91c39d5fac5a23" candidate_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "41268b218b804905a110c86738e74400" is_pre_election: true
I20260709 13:08:22.883764 28014 raft_consensus.cc:515] T 4cd7359accee42808761c37543247321 P 41268b218b804905a110c86738e74400 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18435fbb525741328139e84a1e354954" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 40545 } } peers { permanent_uuid: "2513a663afac495eb09126ff55e8b2b0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40721 } } peers { permanent_uuid: "41268b218b804905a110c86738e74400" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 44403 } }
I20260709 13:08:22.884091 27667 raft_consensus.cc:2468] T 106e04f510c741439b91c39d5fac5a23 P 41268b218b804905a110c86738e74400 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 665f7e09521a4c3f9284c1d8b0e094ff in term 0.
I20260709 13:08:22.875329 27870 raft_consensus.cc:493] T 93c69c92efc3402e8e9546cb961bbcdc P 2513a663afac495eb09126ff55e8b2b0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:22.885179 27870 raft_consensus.cc:515] T 93c69c92efc3402e8e9546cb961bbcdc P 2513a663afac495eb09126ff55e8b2b0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2513a663afac495eb09126ff55e8b2b0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40721 } } peers { permanent_uuid: "41268b218b804905a110c86738e74400" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 44403 } } peers { permanent_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 38749 } }
I20260709 13:08:22.885864 28014 leader_election.cc:290] T 4cd7359accee42808761c37543247321 P 41268b218b804905a110c86738e74400 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 18435fbb525741328139e84a1e354954 (127.17.223.4:40545), 2513a663afac495eb09126ff55e8b2b0 (127.17.223.1:40721)
I20260709 13:08:22.887804 27870 leader_election.cc:290] T 93c69c92efc3402e8e9546cb961bbcdc P 2513a663afac495eb09126ff55e8b2b0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 41268b218b804905a110c86738e74400 (127.17.223.2:44403), 665f7e09521a4c3f9284c1d8b0e094ff (127.17.223.3:38749)
I20260709 13:08:22.887710 27487 catalog_manager.cc:5697] T ff09d7e79a3e43918f3c71d10a40d60b P 18435fbb525741328139e84a1e354954 reported cstate change: term changed from 0 to 1, leader changed from <none> to 18435fbb525741328139e84a1e354954 (127.17.223.4). New cstate: current_term: 1 leader_uuid: "18435fbb525741328139e84a1e354954" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 38749 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "18435fbb525741328139e84a1e354954" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 40545 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2513a663afac495eb09126ff55e8b2b0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40721 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:22.882823 27863 raft_consensus.cc:359] T 3a7da70e9f0f49a9bf60184a8f0b5339 P 41268b218b804905a110c86738e74400 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18435fbb525741328139e84a1e354954" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 40545 } } peers { permanent_uuid: "2513a663afac495eb09126ff55e8b2b0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40721 } } peers { permanent_uuid: "41268b218b804905a110c86738e74400" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 44403 } }
I20260709 13:08:22.889322 27863 raft_consensus.cc:385] T 3a7da70e9f0f49a9bf60184a8f0b5339 P 41268b218b804905a110c86738e74400 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:22.890592 27863 raft_consensus.cc:740] T 3a7da70e9f0f49a9bf60184a8f0b5339 P 41268b218b804905a110c86738e74400 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 41268b218b804905a110c86738e74400, State: Initialized, Role: FOLLOWER
I20260709 13:08:22.891628 27863 consensus_queue.cc:260] T 3a7da70e9f0f49a9bf60184a8f0b5339 P 41268b218b804905a110c86738e74400 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18435fbb525741328139e84a1e354954" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 40545 } } peers { permanent_uuid: "2513a663afac495eb09126ff55e8b2b0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40721 } } peers { permanent_uuid: "41268b218b804905a110c86738e74400" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 44403 } }
I20260709 13:08:22.894555 27591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cd7359accee42808761c37543247321" candidate_uuid: "41268b218b804905a110c86738e74400" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2513a663afac495eb09126ff55e8b2b0" is_pre_election: true
I20260709 13:08:22.895220 27591 raft_consensus.cc:2468] T 4cd7359accee42808761c37543247321 P 2513a663afac495eb09126ff55e8b2b0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 41268b218b804905a110c86738e74400 in term 0.
I20260709 13:08:22.895467 27742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93c69c92efc3402e8e9546cb961bbcdc" candidate_uuid: "2513a663afac495eb09126ff55e8b2b0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" is_pre_election: true
I20260709 13:08:22.897517 27742 raft_consensus.cc:2393] T 93c69c92efc3402e8e9546cb961bbcdc P 665f7e09521a4c3f9284c1d8b0e094ff [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2513a663afac495eb09126ff55e8b2b0 in current term 1: Already voted for candidate 41268b218b804905a110c86738e74400 in this term.
I20260709 13:08:22.897652 27592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78e19c035a854ee98657bec3edcb3585" candidate_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2513a663afac495eb09126ff55e8b2b0"
W20260709 13:08:22.899065 27705 leader_election.cc:343] T 78e19c035a854ee98657bec3edcb3585 P 665f7e09521a4c3f9284c1d8b0e094ff [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 2513a663afac495eb09126ff55e8b2b0 (127.17.223.1:40721): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:22.899896 27813 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cd7359accee42808761c37543247321" candidate_uuid: "41268b218b804905a110c86738e74400" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "18435fbb525741328139e84a1e354954" is_pre_election: true
I20260709 13:08:22.900449 27667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93c69c92efc3402e8e9546cb961bbcdc" candidate_uuid: "2513a663afac495eb09126ff55e8b2b0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "41268b218b804905a110c86738e74400" is_pre_election: true
W20260709 13:08:22.901330 27634 leader_election.cc:343] T 4cd7359accee42808761c37543247321 P 41268b218b804905a110c86738e74400 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 18435fbb525741328139e84a1e354954 (127.17.223.4:40545): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:22.904139 27631 leader_election.cc:304] T 4cd7359accee42808761c37543247321 P 41268b218b804905a110c86738e74400 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2513a663afac495eb09126ff55e8b2b0, 41268b218b804905a110c86738e74400; no voters: 18435fbb525741328139e84a1e354954
I20260709 13:08:22.904914 27982 raft_consensus.cc:2804] T 4cd7359accee42808761c37543247321 P 41268b218b804905a110c86738e74400 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:08:22.905285 27982 raft_consensus.cc:493] T 4cd7359accee42808761c37543247321 P 41268b218b804905a110c86738e74400 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:22.905635 27982 raft_consensus.cc:3060] T 4cd7359accee42808761c37543247321 P 41268b218b804905a110c86738e74400 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:22.905680 27559 leader_election.cc:304] T 93c69c92efc3402e8e9546cb961bbcdc P 2513a663afac495eb09126ff55e8b2b0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2513a663afac495eb09126ff55e8b2b0; no voters: 41268b218b804905a110c86738e74400, 665f7e09521a4c3f9284c1d8b0e094ff
I20260709 13:08:22.906553 27898 raft_consensus.cc:3060] T 93c69c92efc3402e8e9546cb961bbcdc P 2513a663afac495eb09126ff55e8b2b0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:22.911312 27813 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78e19c035a854ee98657bec3edcb3585" candidate_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "18435fbb525741328139e84a1e354954"
I20260709 13:08:22.911954 27813 raft_consensus.cc:3060] T 78e19c035a854ee98657bec3edcb3585 P 18435fbb525741328139e84a1e354954 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:22.916548 27814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "106e04f510c741439b91c39d5fac5a23" candidate_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "18435fbb525741328139e84a1e354954" is_pre_election: true
I20260709 13:08:22.919335 27862 tablet_bootstrap.cc:654] T 8ee97a8570ae4cb49195d1b977d1cdf4 P 665f7e09521a4c3f9284c1d8b0e094ff: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:22.921978 28082 consensus_queue.cc:1048] T 5e6f8bdfe11b4af4aa27a711db7cbe7a P 665f7e09521a4c3f9284c1d8b0e094ff [LEADER]: Connected to new peer: Peer: permanent_uuid: "41268b218b804905a110c86738e74400" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 44403 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:08:22.923015 27708 leader_election.cc:304] T 106e04f510c741439b91c39d5fac5a23 P 665f7e09521a4c3f9284c1d8b0e094ff [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 41268b218b804905a110c86738e74400, 665f7e09521a4c3f9284c1d8b0e094ff; no voters: 
I20260709 13:08:22.923801 28060 raft_consensus.cc:2804] T 106e04f510c741439b91c39d5fac5a23 P 665f7e09521a4c3f9284c1d8b0e094ff [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:08:22.924201 28060 raft_consensus.cc:493] T 106e04f510c741439b91c39d5fac5a23 P 665f7e09521a4c3f9284c1d8b0e094ff [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:22.923972 27982 raft_consensus.cc:515] T 4cd7359accee42808761c37543247321 P 41268b218b804905a110c86738e74400 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18435fbb525741328139e84a1e354954" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 40545 } } peers { permanent_uuid: "2513a663afac495eb09126ff55e8b2b0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40721 } } peers { permanent_uuid: "41268b218b804905a110c86738e74400" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 44403 } }
W20260709 13:08:22.924415 27708 leader_election.cc:343] T 106e04f510c741439b91c39d5fac5a23 P 665f7e09521a4c3f9284c1d8b0e094ff [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 18435fbb525741328139e84a1e354954 (127.17.223.4:40545): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:22.924642 28060 raft_consensus.cc:3060] T 106e04f510c741439b91c39d5fac5a23 P 665f7e09521a4c3f9284c1d8b0e094ff [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:22.926328 27898 raft_consensus.cc:2749] T 93c69c92efc3402e8e9546cb961bbcdc P 2513a663afac495eb09126ff55e8b2b0 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:08:22.929451 27592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cd7359accee42808761c37543247321" candidate_uuid: "41268b218b804905a110c86738e74400" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2513a663afac495eb09126ff55e8b2b0"
I20260709 13:08:22.930095 27592 raft_consensus.cc:3060] T 4cd7359accee42808761c37543247321 P 2513a663afac495eb09126ff55e8b2b0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:22.926918 27814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cd7359accee42808761c37543247321" candidate_uuid: "41268b218b804905a110c86738e74400" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "18435fbb525741328139e84a1e354954"
W20260709 13:08:22.931842 27634 leader_election.cc:343] T 4cd7359accee42808761c37543247321 P 41268b218b804905a110c86738e74400 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 18435fbb525741328139e84a1e354954 (127.17.223.4:40545): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:22.933957 27813 raft_consensus.cc:2468] T 78e19c035a854ee98657bec3edcb3585 P 18435fbb525741328139e84a1e354954 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 665f7e09521a4c3f9284c1d8b0e094ff in term 1.
I20260709 13:08:22.950975 27863 ts_tablet_manager.cc:1434] T 3a7da70e9f0f49a9bf60184a8f0b5339 P 41268b218b804905a110c86738e74400: Time spent starting tablet: real 0.087s	user 0.006s	sys 0.002s
I20260709 13:08:22.952358 27863 tablet_bootstrap.cc:492] T 8e0d496efc3f41f3be82a538ef3cfdac P 41268b218b804905a110c86738e74400: Bootstrap starting.
I20260709 13:08:22.945075 27982 leader_election.cc:290] T 4cd7359accee42808761c37543247321 P 41268b218b804905a110c86738e74400 [CANDIDATE]: Term 1 election: Requested vote from peers 18435fbb525741328139e84a1e354954 (127.17.223.4:40545), 2513a663afac495eb09126ff55e8b2b0 (127.17.223.1:40721)
I20260709 13:08:22.970082 27863 tablet_bootstrap.cc:654] T 8e0d496efc3f41f3be82a538ef3cfdac P 41268b218b804905a110c86738e74400: Neither blocks nor log segments found. Creating new log.
W20260709 13:08:22.976329 28111 log.cc:927] Time spent T 5e6f8bdfe11b4af4aa27a711db7cbe7a P 2513a663afac495eb09126ff55e8b2b0: Append to log took a long time: real 0.053s	user 0.000s	sys 0.000s
I20260709 13:08:22.975952 28060 raft_consensus.cc:515] T 106e04f510c741439b91c39d5fac5a23 P 665f7e09521a4c3f9284c1d8b0e094ff [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "41268b218b804905a110c86738e74400" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 44403 } } peers { permanent_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 38749 } } peers { permanent_uuid: "18435fbb525741328139e84a1e354954" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 40545 } }
I20260709 13:08:22.970146 27592 raft_consensus.cc:2468] T 4cd7359accee42808761c37543247321 P 2513a663afac495eb09126ff55e8b2b0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 41268b218b804905a110c86738e74400 in term 1.
I20260709 13:08:22.983659 27865 tablet_bootstrap.cc:492] T 4cd7359accee42808761c37543247321 P 18435fbb525741328139e84a1e354954: No bootstrap required, opened a new log
I20260709 13:08:22.984114 27865 ts_tablet_manager.cc:1403] T 4cd7359accee42808761c37543247321 P 18435fbb525741328139e84a1e354954: Time spent bootstrapping tablet: real 0.183s	user 0.014s	sys 0.017s
I20260709 13:08:22.978610 28060 leader_election.cc:290] T 106e04f510c741439b91c39d5fac5a23 P 665f7e09521a4c3f9284c1d8b0e094ff [CANDIDATE]: Term 1 election: Requested vote from peers 41268b218b804905a110c86738e74400 (127.17.223.2:44403), 18435fbb525741328139e84a1e354954 (127.17.223.4:40545)
I20260709 13:08:22.974131 27903 consensus_queue.cc:1048] T 5f4a8242380b4863bf5ad2c055229bb7 P 665f7e09521a4c3f9284c1d8b0e094ff [LEADER]: Connected to new peer: Peer: permanent_uuid: "18435fbb525741328139e84a1e354954" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 40545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.012s
I20260709 13:08:22.996105 27666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "106e04f510c741439b91c39d5fac5a23" candidate_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "41268b218b804905a110c86738e74400"
I20260709 13:08:22.996451 27814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "106e04f510c741439b91c39d5fac5a23" candidate_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "18435fbb525741328139e84a1e354954"
I20260709 13:08:22.996822 27666 raft_consensus.cc:3060] T 106e04f510c741439b91c39d5fac5a23 P 41268b218b804905a110c86738e74400 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:22.996919 27708 leader_election.cc:304] T 78e19c035a854ee98657bec3edcb3585 P 665f7e09521a4c3f9284c1d8b0e094ff [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 18435fbb525741328139e84a1e354954, 665f7e09521a4c3f9284c1d8b0e094ff; no voters: 2513a663afac495eb09126ff55e8b2b0
I20260709 13:08:22.997987 28082 raft_consensus.cc:2804] T 78e19c035a854ee98657bec3edcb3585 P 665f7e09521a4c3f9284c1d8b0e094ff [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:08:22.998430 28082 raft_consensus.cc:697] T 78e19c035a854ee98657bec3edcb3585 P 665f7e09521a4c3f9284c1d8b0e094ff [term 1 LEADER]: Becoming Leader. State: Replica: 665f7e09521a4c3f9284c1d8b0e094ff, State: Running, Role: LEADER
I20260709 13:08:22.999271 27861 tablet_bootstrap.cc:492] T 78e19c035a854ee98657bec3edcb3585 P 2513a663afac495eb09126ff55e8b2b0: No bootstrap required, opened a new log
I20260709 13:08:22.999783 27861 ts_tablet_manager.cc:1403] T 78e19c035a854ee98657bec3edcb3585 P 2513a663afac495eb09126ff55e8b2b0: Time spent bootstrapping tablet: real 0.158s	user 0.019s	sys 0.008s
I20260709 13:08:22.999238 28082 consensus_queue.cc:237] T 78e19c035a854ee98657bec3edcb3585 P 665f7e09521a4c3f9284c1d8b0e094ff [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 38749 } } peers { permanent_uuid: "18435fbb525741328139e84a1e354954" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 40545 } } peers { permanent_uuid: "2513a663afac495eb09126ff55e8b2b0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40721 } }
I20260709 13:08:23.000533 27631 leader_election.cc:304] T 4cd7359accee42808761c37543247321 P 41268b218b804905a110c86738e74400 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2513a663afac495eb09126ff55e8b2b0, 41268b218b804905a110c86738e74400; no voters: 18435fbb525741328139e84a1e354954
I20260709 13:08:23.001181 27863 tablet_bootstrap.cc:492] T 8e0d496efc3f41f3be82a538ef3cfdac P 41268b218b804905a110c86738e74400: No bootstrap required, opened a new log
I20260709 13:08:23.001711 27982 raft_consensus.cc:2804] T 4cd7359accee42808761c37543247321 P 41268b218b804905a110c86738e74400 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:08:23.002230 27982 raft_consensus.cc:697] T 4cd7359accee42808761c37543247321 P 41268b218b804905a110c86738e74400 [term 1 LEADER]: Becoming Leader. State: Replica: 41268b218b804905a110c86738e74400, State: Running, Role: LEADER
I20260709 13:08:23.002521 27861 raft_consensus.cc:359] T 78e19c035a854ee98657bec3edcb3585 P 2513a663afac495eb09126ff55e8b2b0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 38749 } } peers { permanent_uuid: "18435fbb525741328139e84a1e354954" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 40545 } } peers { permanent_uuid: "2513a663afac495eb09126ff55e8b2b0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40721 } }
I20260709 13:08:23.003225 27861 raft_consensus.cc:385] T 78e19c035a854ee98657bec3edcb3585 P 2513a663afac495eb09126ff55e8b2b0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:23.003051 27982 consensus_queue.cc:237] T 4cd7359accee42808761c37543247321 P 41268b218b804905a110c86738e74400 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18435fbb525741328139e84a1e354954" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 40545 } } peers { permanent_uuid: "2513a663afac495eb09126ff55e8b2b0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40721 } } peers { permanent_uuid: "41268b218b804905a110c86738e74400" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 44403 } }
W20260709 13:08:23.004282 27708 leader_election.cc:343] T 106e04f510c741439b91c39d5fac5a23 P 665f7e09521a4c3f9284c1d8b0e094ff [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 18435fbb525741328139e84a1e354954 (127.17.223.4:40545): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:23.003536 27861 raft_consensus.cc:740] T 78e19c035a854ee98657bec3edcb3585 P 2513a663afac495eb09126ff55e8b2b0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2513a663afac495eb09126ff55e8b2b0, State: Initialized, Role: FOLLOWER
I20260709 13:08:23.008561 27862 tablet_bootstrap.cc:492] T 8ee97a8570ae4cb49195d1b977d1cdf4 P 665f7e09521a4c3f9284c1d8b0e094ff: No bootstrap required, opened a new log
I20260709 13:08:23.009136 27862 ts_tablet_manager.cc:1403] T 8ee97a8570ae4cb49195d1b977d1cdf4 P 665f7e09521a4c3f9284c1d8b0e094ff: Time spent bootstrapping tablet: real 0.163s	user 0.022s	sys 0.013s
I20260709 13:08:23.001711 27863 ts_tablet_manager.cc:1403] T 8e0d496efc3f41f3be82a538ef3cfdac P 41268b218b804905a110c86738e74400: Time spent bootstrapping tablet: real 0.050s	user 0.011s	sys 0.005s
I20260709 13:08:23.018294 27861 consensus_queue.cc:260] T 78e19c035a854ee98657bec3edcb3585 P 2513a663afac495eb09126ff55e8b2b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 38749 } } peers { permanent_uuid: "18435fbb525741328139e84a1e354954" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 40545 } } peers { permanent_uuid: "2513a663afac495eb09126ff55e8b2b0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40721 } }
I20260709 13:08:23.028326 27861 ts_tablet_manager.cc:1434] T 78e19c035a854ee98657bec3edcb3585 P 2513a663afac495eb09126ff55e8b2b0: Time spent starting tablet: real 0.028s	user 0.008s	sys 0.000s
I20260709 13:08:23.046499 27863 raft_consensus.cc:359] T 8e0d496efc3f41f3be82a538ef3cfdac P 41268b218b804905a110c86738e74400 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "41268b218b804905a110c86738e74400" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 44403 } } peers { permanent_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 38749 } } peers { permanent_uuid: "18435fbb525741328139e84a1e354954" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 40545 } }
I20260709 13:08:23.052539 27863 raft_consensus.cc:385] T 8e0d496efc3f41f3be82a538ef3cfdac P 41268b218b804905a110c86738e74400 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:23.053638 27863 raft_consensus.cc:740] T 8e0d496efc3f41f3be82a538ef3cfdac P 41268b218b804905a110c86738e74400 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 41268b218b804905a110c86738e74400, State: Initialized, Role: FOLLOWER
I20260709 13:08:23.026481 27862 raft_consensus.cc:359] T 8ee97a8570ae4cb49195d1b977d1cdf4 P 665f7e09521a4c3f9284c1d8b0e094ff [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "41268b218b804905a110c86738e74400" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 44403 } } peers { permanent_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 38749 } } peers { permanent_uuid: "18435fbb525741328139e84a1e354954" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 40545 } }
I20260709 13:08:23.054817 27862 raft_consensus.cc:385] T 8ee97a8570ae4cb49195d1b977d1cdf4 P 665f7e09521a4c3f9284c1d8b0e094ff [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:23.055223 27862 raft_consensus.cc:740] T 8ee97a8570ae4cb49195d1b977d1cdf4 P 665f7e09521a4c3f9284c1d8b0e094ff [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 665f7e09521a4c3f9284c1d8b0e094ff, State: Initialized, Role: FOLLOWER
I20260709 13:08:23.061273 27862 consensus_queue.cc:260] T 8ee97a8570ae4cb49195d1b977d1cdf4 P 665f7e09521a4c3f9284c1d8b0e094ff [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "41268b218b804905a110c86738e74400" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 44403 } } peers { permanent_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 38749 } } peers { permanent_uuid: "18435fbb525741328139e84a1e354954" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 40545 } }
I20260709 13:08:23.056751 27863 consensus_queue.cc:260] T 8e0d496efc3f41f3be82a538ef3cfdac P 41268b218b804905a110c86738e74400 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "41268b218b804905a110c86738e74400" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 44403 } } peers { permanent_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 38749 } } peers { permanent_uuid: "18435fbb525741328139e84a1e354954" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 40545 } }
I20260709 13:08:23.097412 27863 ts_tablet_manager.cc:1434] T 8e0d496efc3f41f3be82a538ef3cfdac P 41268b218b804905a110c86738e74400: Time spent starting tablet: real 0.087s	user 0.008s	sys 0.000s
I20260709 13:08:23.102555 27861 tablet_bootstrap.cc:492] T 1cd5e6e9b36d4591961cb379d7065be9 P 2513a663afac495eb09126ff55e8b2b0: Bootstrap starting.
I20260709 13:08:23.105862 27862 ts_tablet_manager.cc:1434] T 8ee97a8570ae4cb49195d1b977d1cdf4 P 665f7e09521a4c3f9284c1d8b0e094ff: Time spent starting tablet: real 0.096s	user 0.010s	sys 0.000s
I20260709 13:08:23.091120 27901 raft_consensus.cc:493] T 8ee97a8570ae4cb49195d1b977d1cdf4 P 41268b218b804905a110c86738e74400 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:23.113523 27863 tablet_bootstrap.cc:492] T 2d994cb13f8f453284bcb1f8b85824a2 P 41268b218b804905a110c86738e74400: Bootstrap starting.
I20260709 13:08:23.101393 27957 raft_consensus.cc:493] T 78e19c035a854ee98657bec3edcb3585 P 2513a663afac495eb09126ff55e8b2b0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:23.121486 27862 tablet_bootstrap.cc:492] T 85cdd21b7a5f4db7af44327c57c16d43 P 665f7e09521a4c3f9284c1d8b0e094ff: Bootstrap starting.
I20260709 13:08:23.114580 27901 raft_consensus.cc:515] T 8ee97a8570ae4cb49195d1b977d1cdf4 P 41268b218b804905a110c86738e74400 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "41268b218b804905a110c86738e74400" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 44403 } } peers { permanent_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 38749 } } peers { permanent_uuid: "18435fbb525741328139e84a1e354954" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 40545 } }
I20260709 13:08:23.139458 27666 raft_consensus.cc:2468] T 106e04f510c741439b91c39d5fac5a23 P 41268b218b804905a110c86738e74400 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 665f7e09521a4c3f9284c1d8b0e094ff in term 1.
I20260709 13:08:23.140671 27901 leader_election.cc:290] T 8ee97a8570ae4cb49195d1b977d1cdf4 P 41268b218b804905a110c86738e74400 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 665f7e09521a4c3f9284c1d8b0e094ff (127.17.223.3:38749), 18435fbb525741328139e84a1e354954 (127.17.223.4:40545)
I20260709 13:08:23.136425 27865 raft_consensus.cc:359] T 4cd7359accee42808761c37543247321 P 18435fbb525741328139e84a1e354954 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18435fbb525741328139e84a1e354954" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 40545 } } peers { permanent_uuid: "2513a663afac495eb09126ff55e8b2b0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40721 } } peers { permanent_uuid: "41268b218b804905a110c86738e74400" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 44403 } }
I20260709 13:08:23.149991 27865 raft_consensus.cc:385] T 4cd7359accee42808761c37543247321 P 18435fbb525741328139e84a1e354954 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:23.150259 27865 raft_consensus.cc:740] T 4cd7359accee42808761c37543247321 P 18435fbb525741328139e84a1e354954 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 18435fbb525741328139e84a1e354954, State: Initialized, Role: FOLLOWER
I20260709 13:08:23.124836 27957 raft_consensus.cc:515] T 78e19c035a854ee98657bec3edcb3585 P 2513a663afac495eb09126ff55e8b2b0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 38749 } } peers { permanent_uuid: "18435fbb525741328139e84a1e354954" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 40545 } } peers { permanent_uuid: "2513a663afac495eb09126ff55e8b2b0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40721 } }
I20260709 13:08:23.154433 27957 leader_election.cc:290] T 78e19c035a854ee98657bec3edcb3585 P 2513a663afac495eb09126ff55e8b2b0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 665f7e09521a4c3f9284c1d8b0e094ff (127.17.223.3:38749), 18435fbb525741328139e84a1e354954 (127.17.223.4:40545)
I20260709 13:08:23.160995 27815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78e19c035a854ee98657bec3edcb3585" candidate_uuid: "2513a663afac495eb09126ff55e8b2b0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "18435fbb525741328139e84a1e354954" is_pre_election: true
I20260709 13:08:23.161355 27739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ee97a8570ae4cb49195d1b977d1cdf4" candidate_uuid: "41268b218b804905a110c86738e74400" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" is_pre_election: true
I20260709 13:08:23.161897 27815 raft_consensus.cc:2393] T 78e19c035a854ee98657bec3edcb3585 P 18435fbb525741328139e84a1e354954 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2513a663afac495eb09126ff55e8b2b0 in current term 1: Already voted for candidate 665f7e09521a4c3f9284c1d8b0e094ff in this term.
I20260709 13:08:23.162083 27739 raft_consensus.cc:2468] T 8ee97a8570ae4cb49195d1b977d1cdf4 P 665f7e09521a4c3f9284c1d8b0e094ff [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 41268b218b804905a110c86738e74400 in term 0.
I20260709 13:08:23.163534 27816 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ee97a8570ae4cb49195d1b977d1cdf4" candidate_uuid: "41268b218b804905a110c86738e74400" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "18435fbb525741328139e84a1e354954" is_pre_election: true
I20260709 13:08:23.164569 27901 raft_consensus.cc:493] T 8e0d496efc3f41f3be82a538ef3cfdac P 41268b218b804905a110c86738e74400 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:23.165182 27901 raft_consensus.cc:515] T 8e0d496efc3f41f3be82a538ef3cfdac P 41268b218b804905a110c86738e74400 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "41268b218b804905a110c86738e74400" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 44403 } } peers { permanent_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 38749 } } peers { permanent_uuid: "18435fbb525741328139e84a1e354954" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 40545 } }
I20260709 13:08:23.164654 27487 catalog_manager.cc:5697] T 78e19c035a854ee98657bec3edcb3585 P 665f7e09521a4c3f9284c1d8b0e094ff reported cstate change: term changed from 0 to 1, leader changed from <none> to 665f7e09521a4c3f9284c1d8b0e094ff (127.17.223.3). New cstate: current_term: 1 leader_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 38749 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "18435fbb525741328139e84a1e354954" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 40545 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2513a663afac495eb09126ff55e8b2b0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40721 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:23.169262 27863 tablet_bootstrap.cc:654] T 2d994cb13f8f453284bcb1f8b85824a2 P 41268b218b804905a110c86738e74400: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:23.172127 27901 leader_election.cc:290] T 8e0d496efc3f41f3be82a538ef3cfdac P 41268b218b804905a110c86738e74400 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 665f7e09521a4c3f9284c1d8b0e094ff (127.17.223.3:38749), 18435fbb525741328139e84a1e354954 (127.17.223.4:40545)
W20260709 13:08:23.173758 27634 leader_election.cc:343] T 8ee97a8570ae4cb49195d1b977d1cdf4 P 41268b218b804905a110c86738e74400 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 18435fbb525741328139e84a1e354954 (127.17.223.4:40545): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:23.174449 27865 consensus_queue.cc:260] T 4cd7359accee42808761c37543247321 P 18435fbb525741328139e84a1e354954 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18435fbb525741328139e84a1e354954" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 40545 } } peers { permanent_uuid: "2513a663afac495eb09126ff55e8b2b0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40721 } } peers { permanent_uuid: "41268b218b804905a110c86738e74400" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 44403 } }
I20260709 13:08:23.161338 27708 leader_election.cc:304] T 106e04f510c741439b91c39d5fac5a23 P 665f7e09521a4c3f9284c1d8b0e094ff [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 41268b218b804905a110c86738e74400, 665f7e09521a4c3f9284c1d8b0e094ff; no voters: 18435fbb525741328139e84a1e354954
I20260709 13:08:23.188081 27865 ts_tablet_manager.cc:1434] T 4cd7359accee42808761c37543247321 P 18435fbb525741328139e84a1e354954: Time spent starting tablet: real 0.204s	user 0.008s	sys 0.000s
I20260709 13:08:23.191401 27742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78e19c035a854ee98657bec3edcb3585" candidate_uuid: "2513a663afac495eb09126ff55e8b2b0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" is_pre_election: true
I20260709 13:08:23.191653 27634 leader_election.cc:304] T 8ee97a8570ae4cb49195d1b977d1cdf4 P 41268b218b804905a110c86738e74400 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 41268b218b804905a110c86738e74400, 665f7e09521a4c3f9284c1d8b0e094ff; no voters: 18435fbb525741328139e84a1e354954
I20260709 13:08:23.194206 28118 raft_consensus.cc:2804] T 106e04f510c741439b91c39d5fac5a23 P 665f7e09521a4c3f9284c1d8b0e094ff [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:08:23.195441 27862 tablet_bootstrap.cc:654] T 85cdd21b7a5f4db7af44327c57c16d43 P 665f7e09521a4c3f9284c1d8b0e094ff: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:23.196614 27559 leader_election.cc:304] T 78e19c035a854ee98657bec3edcb3585 P 2513a663afac495eb09126ff55e8b2b0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2513a663afac495eb09126ff55e8b2b0; no voters: 18435fbb525741328139e84a1e354954, 665f7e09521a4c3f9284c1d8b0e094ff
I20260709 13:08:23.194533 27903 consensus_queue.cc:1048] T 5f4a8242380b4863bf5ad2c055229bb7 P 665f7e09521a4c3f9284c1d8b0e094ff [LEADER]: Connected to new peer: Peer: permanent_uuid: "41268b218b804905a110c86738e74400" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 44403 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:08:23.194854 28118 raft_consensus.cc:697] T 106e04f510c741439b91c39d5fac5a23 P 665f7e09521a4c3f9284c1d8b0e094ff [term 1 LEADER]: Becoming Leader. State: Replica: 665f7e09521a4c3f9284c1d8b0e094ff, State: Running, Role: LEADER
I20260709 13:08:23.201014 27865 tablet_bootstrap.cc:492] T 106e04f510c741439b91c39d5fac5a23 P 18435fbb525741328139e84a1e354954: Bootstrap starting.
I20260709 13:08:23.194860 27816 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e0d496efc3f41f3be82a538ef3cfdac" candidate_uuid: "41268b218b804905a110c86738e74400" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "18435fbb525741328139e84a1e354954" is_pre_election: true
I20260709 13:08:23.197324 27901 raft_consensus.cc:2804] T 8ee97a8570ae4cb49195d1b977d1cdf4 P 41268b218b804905a110c86738e74400 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:08:23.207867 27488 catalog_manager.cc:5697] T 4cd7359accee42808761c37543247321 P 41268b218b804905a110c86738e74400 reported cstate change: term changed from 0 to 1, leader changed from <none> to 41268b218b804905a110c86738e74400 (127.17.223.2). New cstate: current_term: 1 leader_uuid: "41268b218b804905a110c86738e74400" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18435fbb525741328139e84a1e354954" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 40545 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2513a663afac495eb09126ff55e8b2b0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40721 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "41268b218b804905a110c86738e74400" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 44403 } health_report { overall_health: HEALTHY } } }
I20260709 13:08:23.206835 27901 raft_consensus.cc:493] T 8ee97a8570ae4cb49195d1b977d1cdf4 P 41268b218b804905a110c86738e74400 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:23.214409 27901 raft_consensus.cc:3060] T 8ee97a8570ae4cb49195d1b977d1cdf4 P 41268b218b804905a110c86738e74400 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:23.205868 27739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e0d496efc3f41f3be82a538ef3cfdac" candidate_uuid: "41268b218b804905a110c86738e74400" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" is_pre_election: true
I20260709 13:08:23.214532 28118 consensus_queue.cc:237] T 106e04f510c741439b91c39d5fac5a23 P 665f7e09521a4c3f9284c1d8b0e094ff [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "41268b218b804905a110c86738e74400" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 44403 } } peers { permanent_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 38749 } } peers { permanent_uuid: "18435fbb525741328139e84a1e354954" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 40545 } }
I20260709 13:08:23.214008 27861 tablet_bootstrap.cc:654] T 1cd5e6e9b36d4591961cb379d7065be9 P 2513a663afac495eb09126ff55e8b2b0: Neither blocks nor log segments found. Creating new log.
W20260709 13:08:23.218420 27634 leader_election.cc:343] T 8e0d496efc3f41f3be82a538ef3cfdac P 41268b218b804905a110c86738e74400 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 18435fbb525741328139e84a1e354954 (127.17.223.4:40545): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:23.229789 27667 raft_consensus.cc:3060] T e9b149d77d9941158ead8e9e592e7b27 P 41268b218b804905a110c86738e74400 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:08:23.237177 27634 leader_election.cc:343] T 8e0d496efc3f41f3be82a538ef3cfdac P 41268b218b804905a110c86738e74400 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 665f7e09521a4c3f9284c1d8b0e094ff (127.17.223.3:38749): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:23.237635 27634 leader_election.cc:304] T 8e0d496efc3f41f3be82a538ef3cfdac P 41268b218b804905a110c86738e74400 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 41268b218b804905a110c86738e74400; no voters: 18435fbb525741328139e84a1e354954, 665f7e09521a4c3f9284c1d8b0e094ff
I20260709 13:08:23.238736 27982 raft_consensus.cc:2749] T 8e0d496efc3f41f3be82a538ef3cfdac P 41268b218b804905a110c86738e74400 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:08:23.217276 28125 raft_consensus.cc:3060] T 78e19c035a854ee98657bec3edcb3585 P 2513a663afac495eb09126ff55e8b2b0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:23.263847 28046 consensus_queue.cc:1048] T e9b149d77d9941158ead8e9e592e7b27 P 18435fbb525741328139e84a1e354954 [LEADER]: Connected to new peer: Peer: permanent_uuid: "41268b218b804905a110c86738e74400" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 44403 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:08:23.268041 27978 raft_consensus.cc:493] T 3a7da70e9f0f49a9bf60184a8f0b5339 P 41268b218b804905a110c86738e74400 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:23.268584 27978 raft_consensus.cc:515] T 3a7da70e9f0f49a9bf60184a8f0b5339 P 41268b218b804905a110c86738e74400 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18435fbb525741328139e84a1e354954" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 40545 } } peers { permanent_uuid: "2513a663afac495eb09126ff55e8b2b0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40721 } } peers { permanent_uuid: "41268b218b804905a110c86738e74400" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 44403 } }
I20260709 13:08:23.271054 27978 leader_election.cc:290] T 3a7da70e9f0f49a9bf60184a8f0b5339 P 41268b218b804905a110c86738e74400 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 18435fbb525741328139e84a1e354954 (127.17.223.4:40545), 2513a663afac495eb09126ff55e8b2b0 (127.17.223.1:40721)
I20260709 13:08:23.271932 27901 raft_consensus.cc:515] T 8ee97a8570ae4cb49195d1b977d1cdf4 P 41268b218b804905a110c86738e74400 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "41268b218b804905a110c86738e74400" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 44403 } } peers { permanent_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 38749 } } peers { permanent_uuid: "18435fbb525741328139e84a1e354954" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 40545 } }
I20260709 13:08:23.273967 27901 leader_election.cc:290] T 8ee97a8570ae4cb49195d1b977d1cdf4 P 41268b218b804905a110c86738e74400 [CANDIDATE]: Term 1 election: Requested vote from peers 665f7e09521a4c3f9284c1d8b0e094ff (127.17.223.3:38749), 18435fbb525741328139e84a1e354954 (127.17.223.4:40545)
I20260709 13:08:23.275103 27863 tablet_bootstrap.cc:492] T 2d994cb13f8f453284bcb1f8b85824a2 P 41268b218b804905a110c86738e74400: No bootstrap required, opened a new log
I20260709 13:08:23.275740 27863 ts_tablet_manager.cc:1403] T 2d994cb13f8f453284bcb1f8b85824a2 P 41268b218b804905a110c86738e74400: Time spent bootstrapping tablet: real 0.168s	user 0.015s	sys 0.001s
I20260709 13:08:23.283135 27813 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ee97a8570ae4cb49195d1b977d1cdf4" candidate_uuid: "41268b218b804905a110c86738e74400" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "18435fbb525741328139e84a1e354954"
I20260709 13:08:23.287642 27816 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a7da70e9f0f49a9bf60184a8f0b5339" candidate_uuid: "41268b218b804905a110c86738e74400" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "18435fbb525741328139e84a1e354954" is_pre_election: true
I20260709 13:08:23.289103 27865 tablet_bootstrap.cc:654] T 106e04f510c741439b91c39d5fac5a23 P 18435fbb525741328139e84a1e354954: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:23.295521 28046 consensus_queue.cc:1048] T ff09d7e79a3e43918f3c71d10a40d60b P 18435fbb525741328139e84a1e354954 [LEADER]: Connected to new peer: Peer: permanent_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 38749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260709 13:08:23.313829 27634 leader_election.cc:343] T 8ee97a8570ae4cb49195d1b977d1cdf4 P 41268b218b804905a110c86738e74400 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 18435fbb525741328139e84a1e354954 (127.17.223.4:40545): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:08:23.314421 27634 leader_election.cc:343] T 3a7da70e9f0f49a9bf60184a8f0b5339 P 41268b218b804905a110c86738e74400 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 18435fbb525741328139e84a1e354954 (127.17.223.4:40545): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:23.329146 27593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a7da70e9f0f49a9bf60184a8f0b5339" candidate_uuid: "41268b218b804905a110c86738e74400" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2513a663afac495eb09126ff55e8b2b0" is_pre_election: true
I20260709 13:08:23.337879 27901 consensus_queue.cc:1048] T 93c69c92efc3402e8e9546cb961bbcdc P 41268b218b804905a110c86738e74400 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2513a663afac495eb09126ff55e8b2b0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40721 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:08:23.339176 27861 tablet_bootstrap.cc:492] T 1cd5e6e9b36d4591961cb379d7065be9 P 2513a663afac495eb09126ff55e8b2b0: No bootstrap required, opened a new log
I20260709 13:08:23.339687 27861 ts_tablet_manager.cc:1403] T 1cd5e6e9b36d4591961cb379d7065be9 P 2513a663afac495eb09126ff55e8b2b0: Time spent bootstrapping tablet: real 0.246s	user 0.029s	sys 0.010s
I20260709 13:08:23.339102 27739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ee97a8570ae4cb49195d1b977d1cdf4" candidate_uuid: "41268b218b804905a110c86738e74400" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "665f7e09521a4c3f9284c1d8b0e094ff"
I20260709 13:08:23.340440 27739 raft_consensus.cc:3060] T 8ee97a8570ae4cb49195d1b977d1cdf4 P 665f7e09521a4c3f9284c1d8b0e094ff [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:23.342428 27861 raft_consensus.cc:359] T 1cd5e6e9b36d4591961cb379d7065be9 P 2513a663afac495eb09126ff55e8b2b0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 38749 } } peers { permanent_uuid: "18435fbb525741328139e84a1e354954" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 40545 } } peers { permanent_uuid: "2513a663afac495eb09126ff55e8b2b0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40721 } }
I20260709 13:08:23.343109 27861 raft_consensus.cc:385] T 1cd5e6e9b36d4591961cb379d7065be9 P 2513a663afac495eb09126ff55e8b2b0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:23.343369 27861 raft_consensus.cc:740] T 1cd5e6e9b36d4591961cb379d7065be9 P 2513a663afac495eb09126ff55e8b2b0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2513a663afac495eb09126ff55e8b2b0, State: Initialized, Role: FOLLOWER
I20260709 13:08:23.343979 27861 consensus_queue.cc:260] T 1cd5e6e9b36d4591961cb379d7065be9 P 2513a663afac495eb09126ff55e8b2b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 38749 } } peers { permanent_uuid: "18435fbb525741328139e84a1e354954" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 40545 } } peers { permanent_uuid: "2513a663afac495eb09126ff55e8b2b0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40721 } }
I20260709 13:08:23.344511 28013 consensus_queue.cc:1048] T e9b149d77d9941158ead8e9e592e7b27 P 18435fbb525741328139e84a1e354954 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2513a663afac495eb09126ff55e8b2b0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40721 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:08:23.345829 27488 catalog_manager.cc:5697] T 106e04f510c741439b91c39d5fac5a23 P 665f7e09521a4c3f9284c1d8b0e094ff reported cstate change: term changed from 0 to 1, leader changed from <none> to 665f7e09521a4c3f9284c1d8b0e094ff (127.17.223.3). New cstate: current_term: 1 leader_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "41268b218b804905a110c86738e74400" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 44403 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 38749 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "18435fbb525741328139e84a1e354954" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 40545 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:23.347736 27739 raft_consensus.cc:2468] T 8ee97a8570ae4cb49195d1b977d1cdf4 P 665f7e09521a4c3f9284c1d8b0e094ff [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 41268b218b804905a110c86738e74400 in term 1.
I20260709 13:08:23.349329 28125 raft_consensus.cc:2749] T 78e19c035a854ee98657bec3edcb3585 P 2513a663afac495eb09126ff55e8b2b0 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:08:23.350147 27861 ts_tablet_manager.cc:1434] T 1cd5e6e9b36d4591961cb379d7065be9 P 2513a663afac495eb09126ff55e8b2b0: Time spent starting tablet: real 0.010s	user 0.007s	sys 0.000s
W20260709 13:08:23.351063 27631 leader_election.cc:343] T 3a7da70e9f0f49a9bf60184a8f0b5339 P 41268b218b804905a110c86738e74400 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2513a663afac495eb09126ff55e8b2b0 (127.17.223.1:40721): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:23.351655 27631 leader_election.cc:304] T 3a7da70e9f0f49a9bf60184a8f0b5339 P 41268b218b804905a110c86738e74400 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 41268b218b804905a110c86738e74400; no voters: 18435fbb525741328139e84a1e354954, 2513a663afac495eb09126ff55e8b2b0
I20260709 13:08:23.352808 27901 raft_consensus.cc:2749] T 3a7da70e9f0f49a9bf60184a8f0b5339 P 41268b218b804905a110c86738e74400 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:08:23.372761 27863 raft_consensus.cc:359] T 2d994cb13f8f453284bcb1f8b85824a2 P 41268b218b804905a110c86738e74400 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18435fbb525741328139e84a1e354954" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 40545 } } peers { permanent_uuid: "2513a663afac495eb09126ff55e8b2b0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40721 } } peers { permanent_uuid: "41268b218b804905a110c86738e74400" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 44403 } }
I20260709 13:08:23.373796 27863 raft_consensus.cc:385] T 2d994cb13f8f453284bcb1f8b85824a2 P 41268b218b804905a110c86738e74400 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:23.374172 27863 raft_consensus.cc:740] T 2d994cb13f8f453284bcb1f8b85824a2 P 41268b218b804905a110c86738e74400 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 41268b218b804905a110c86738e74400, State: Initialized, Role: FOLLOWER
I20260709 13:08:23.351205 27861 tablet_bootstrap.cc:492] T 85cdd21b7a5f4db7af44327c57c16d43 P 2513a663afac495eb09126ff55e8b2b0: Bootstrap starting.
I20260709 13:08:23.379487 27634 leader_election.cc:304] T 8ee97a8570ae4cb49195d1b977d1cdf4 P 41268b218b804905a110c86738e74400 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 41268b218b804905a110c86738e74400, 665f7e09521a4c3f9284c1d8b0e094ff; no voters: 18435fbb525741328139e84a1e354954
I20260709 13:08:23.381620 28046 raft_consensus.cc:493] T 4cd7359accee42808761c37543247321 P 18435fbb525741328139e84a1e354954 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:23.378549 27863 consensus_queue.cc:260] T 2d994cb13f8f453284bcb1f8b85824a2 P 41268b218b804905a110c86738e74400 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18435fbb525741328139e84a1e354954" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 40545 } } peers { permanent_uuid: "2513a663afac495eb09126ff55e8b2b0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40721 } } peers { permanent_uuid: "41268b218b804905a110c86738e74400" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 44403 } }
I20260709 13:08:23.385564 28046 raft_consensus.cc:515] T 4cd7359accee42808761c37543247321 P 18435fbb525741328139e84a1e354954 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18435fbb525741328139e84a1e354954" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 40545 } } peers { permanent_uuid: "2513a663afac495eb09126ff55e8b2b0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40721 } } peers { permanent_uuid: "41268b218b804905a110c86738e74400" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 44403 } }
I20260709 13:08:23.385337 28014 raft_consensus.cc:2804] T 8ee97a8570ae4cb49195d1b977d1cdf4 P 41268b218b804905a110c86738e74400 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:08:23.395949 27862 tablet_bootstrap.cc:492] T 85cdd21b7a5f4db7af44327c57c16d43 P 665f7e09521a4c3f9284c1d8b0e094ff: No bootstrap required, opened a new log
I20260709 13:08:23.396142 28014 raft_consensus.cc:697] T 8ee97a8570ae4cb49195d1b977d1cdf4 P 41268b218b804905a110c86738e74400 [term 1 LEADER]: Becoming Leader. State: Replica: 41268b218b804905a110c86738e74400, State: Running, Role: LEADER
I20260709 13:08:23.396484 27862 ts_tablet_manager.cc:1403] T 85cdd21b7a5f4db7af44327c57c16d43 P 665f7e09521a4c3f9284c1d8b0e094ff: Time spent bootstrapping tablet: real 0.280s	user 0.011s	sys 0.005s
I20260709 13:08:23.397104 28014 consensus_queue.cc:237] T 8ee97a8570ae4cb49195d1b977d1cdf4 P 41268b218b804905a110c86738e74400 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "41268b218b804905a110c86738e74400" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 44403 } } peers { permanent_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 38749 } } peers { permanent_uuid: "18435fbb525741328139e84a1e354954" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 40545 } }
I20260709 13:08:23.400131 27865 tablet_bootstrap.cc:492] T 106e04f510c741439b91c39d5fac5a23 P 18435fbb525741328139e84a1e354954: No bootstrap required, opened a new log
I20260709 13:08:23.400215 27861 tablet_bootstrap.cc:654] T 85cdd21b7a5f4db7af44327c57c16d43 P 2513a663afac495eb09126ff55e8b2b0: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:23.400718 27865 ts_tablet_manager.cc:1403] T 106e04f510c741439b91c39d5fac5a23 P 18435fbb525741328139e84a1e354954: Time spent bootstrapping tablet: real 0.203s	user 0.015s	sys 0.009s
I20260709 13:08:23.405062 27863 ts_tablet_manager.cc:1434] T 2d994cb13f8f453284bcb1f8b85824a2 P 41268b218b804905a110c86738e74400: Time spent starting tablet: real 0.129s	user 0.010s	sys 0.000s
I20260709 13:08:23.381829 27901 consensus_queue.cc:1048] T 93c69c92efc3402e8e9546cb961bbcdc P 41268b218b804905a110c86738e74400 [LEADER]: Connected to new peer: Peer: permanent_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 38749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.011s
I20260709 13:08:23.410920 27865 raft_consensus.cc:359] T 106e04f510c741439b91c39d5fac5a23 P 18435fbb525741328139e84a1e354954 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "41268b218b804905a110c86738e74400" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 44403 } } peers { permanent_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 38749 } } peers { permanent_uuid: "18435fbb525741328139e84a1e354954" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 40545 } }
I20260709 13:08:23.411651 27865 raft_consensus.cc:385] T 106e04f510c741439b91c39d5fac5a23 P 18435fbb525741328139e84a1e354954 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:23.411947 27865 raft_consensus.cc:740] T 106e04f510c741439b91c39d5fac5a23 P 18435fbb525741328139e84a1e354954 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 18435fbb525741328139e84a1e354954, State: Initialized, Role: FOLLOWER
I20260709 13:08:23.412452 28046 leader_election.cc:290] T 4cd7359accee42808761c37543247321 P 18435fbb525741328139e84a1e354954 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2513a663afac495eb09126ff55e8b2b0 (127.17.223.1:40721), 41268b218b804905a110c86738e74400 (127.17.223.2:44403)
I20260709 13:08:23.412581 27865 consensus_queue.cc:260] T 106e04f510c741439b91c39d5fac5a23 P 18435fbb525741328139e84a1e354954 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "41268b218b804905a110c86738e74400" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 44403 } } peers { permanent_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 38749 } } peers { permanent_uuid: "18435fbb525741328139e84a1e354954" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 40545 } }
I20260709 13:08:23.413066 27862 raft_consensus.cc:359] T 85cdd21b7a5f4db7af44327c57c16d43 P 665f7e09521a4c3f9284c1d8b0e094ff [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2513a663afac495eb09126ff55e8b2b0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40721 } } peers { permanent_uuid: "41268b218b804905a110c86738e74400" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 44403 } } peers { permanent_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 38749 } }
I20260709 13:08:23.413807 27862 raft_consensus.cc:385] T 85cdd21b7a5f4db7af44327c57c16d43 P 665f7e09521a4c3f9284c1d8b0e094ff [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:23.414074 27862 raft_consensus.cc:740] T 85cdd21b7a5f4db7af44327c57c16d43 P 665f7e09521a4c3f9284c1d8b0e094ff [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 665f7e09521a4c3f9284c1d8b0e094ff, State: Initialized, Role: FOLLOWER
I20260709 13:08:23.415262 27862 consensus_queue.cc:260] T 85cdd21b7a5f4db7af44327c57c16d43 P 665f7e09521a4c3f9284c1d8b0e094ff [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2513a663afac495eb09126ff55e8b2b0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40721 } } peers { permanent_uuid: "41268b218b804905a110c86738e74400" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 44403 } } peers { permanent_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 38749 } }
I20260709 13:08:23.418726 27668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cd7359accee42808761c37543247321" candidate_uuid: "18435fbb525741328139e84a1e354954" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "41268b218b804905a110c86738e74400" is_pre_election: true
I20260709 13:08:23.420590 27591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cd7359accee42808761c37543247321" candidate_uuid: "18435fbb525741328139e84a1e354954" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2513a663afac495eb09126ff55e8b2b0" is_pre_election: true
I20260709 13:08:23.421411 27591 raft_consensus.cc:2393] T 4cd7359accee42808761c37543247321 P 2513a663afac495eb09126ff55e8b2b0 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 18435fbb525741328139e84a1e354954 in current term 1: Already voted for candidate 41268b218b804905a110c86738e74400 in this term.
I20260709 13:08:23.416122 28013 consensus_queue.cc:1048] T ff09d7e79a3e43918f3c71d10a40d60b P 18435fbb525741328139e84a1e354954 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2513a663afac495eb09126ff55e8b2b0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40721 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.006s
I20260709 13:08:23.429318 27862 ts_tablet_manager.cc:1434] T 85cdd21b7a5f4db7af44327c57c16d43 P 665f7e09521a4c3f9284c1d8b0e094ff: Time spent starting tablet: real 0.032s	user 0.004s	sys 0.003s
I20260709 13:08:23.430410 27862 tablet_bootstrap.cc:492] T 1cd5e6e9b36d4591961cb379d7065be9 P 665f7e09521a4c3f9284c1d8b0e094ff: Bootstrap starting.
I20260709 13:08:23.438378 27782 leader_election.cc:304] T 4cd7359accee42808761c37543247321 P 18435fbb525741328139e84a1e354954 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 18435fbb525741328139e84a1e354954; no voters: 2513a663afac495eb09126ff55e8b2b0, 41268b218b804905a110c86738e74400
I20260709 13:08:23.440503 28013 raft_consensus.cc:3060] T 4cd7359accee42808761c37543247321 P 18435fbb525741328139e84a1e354954 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:23.442688 27863 tablet_bootstrap.cc:492] T 8e758d59bd4a4eae9f67662e165013f9 P 41268b218b804905a110c86738e74400: Bootstrap starting.
I20260709 13:08:23.456987 27865 ts_tablet_manager.cc:1434] T 106e04f510c741439b91c39d5fac5a23 P 18435fbb525741328139e84a1e354954: Time spent starting tablet: real 0.056s	user 0.005s	sys 0.003s
I20260709 13:08:23.467000 27903 raft_consensus.cc:493] T 85cdd21b7a5f4db7af44327c57c16d43 P 665f7e09521a4c3f9284c1d8b0e094ff [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:23.467754 27903 raft_consensus.cc:515] T 85cdd21b7a5f4db7af44327c57c16d43 P 665f7e09521a4c3f9284c1d8b0e094ff [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2513a663afac495eb09126ff55e8b2b0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40721 } } peers { permanent_uuid: "41268b218b804905a110c86738e74400" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 44403 } } peers { permanent_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 38749 } }
I20260709 13:08:23.469815 27903 leader_election.cc:290] T 85cdd21b7a5f4db7af44327c57c16d43 P 665f7e09521a4c3f9284c1d8b0e094ff [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2513a663afac495eb09126ff55e8b2b0 (127.17.223.1:40721), 41268b218b804905a110c86738e74400 (127.17.223.2:44403)
I20260709 13:08:23.473562 27590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85cdd21b7a5f4db7af44327c57c16d43" candidate_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2513a663afac495eb09126ff55e8b2b0" is_pre_election: true
I20260709 13:08:23.475531 27865 tablet_bootstrap.cc:492] T 8d1aa996b2034de7b2d77545de68e73c P 18435fbb525741328139e84a1e354954: Bootstrap starting.
W20260709 13:08:23.476064 27705 leader_election.cc:343] T 85cdd21b7a5f4db7af44327c57c16d43 P 665f7e09521a4c3f9284c1d8b0e094ff [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2513a663afac495eb09126ff55e8b2b0 (127.17.223.1:40721): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:23.481235 27863 tablet_bootstrap.cc:654] T 8e758d59bd4a4eae9f67662e165013f9 P 41268b218b804905a110c86738e74400: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:23.487452 27978 raft_consensus.cc:493] T 2d994cb13f8f453284bcb1f8b85824a2 P 41268b218b804905a110c86738e74400 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:23.500365 27978 raft_consensus.cc:515] T 2d994cb13f8f453284bcb1f8b85824a2 P 41268b218b804905a110c86738e74400 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18435fbb525741328139e84a1e354954" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 40545 } } peers { permanent_uuid: "2513a663afac495eb09126ff55e8b2b0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40721 } } peers { permanent_uuid: "41268b218b804905a110c86738e74400" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 44403 } }
I20260709 13:08:23.505560 27667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85cdd21b7a5f4db7af44327c57c16d43" candidate_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "41268b218b804905a110c86738e74400" is_pre_election: true
I20260709 13:08:23.506268 27667 raft_consensus.cc:2468] T 85cdd21b7a5f4db7af44327c57c16d43 P 41268b218b804905a110c86738e74400 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 665f7e09521a4c3f9284c1d8b0e094ff in term 0.
I20260709 13:08:23.506749 27978 leader_election.cc:290] T 2d994cb13f8f453284bcb1f8b85824a2 P 41268b218b804905a110c86738e74400 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 18435fbb525741328139e84a1e354954 (127.17.223.4:40545), 2513a663afac495eb09126ff55e8b2b0 (127.17.223.1:40721)
I20260709 13:08:23.499836 28013 raft_consensus.cc:2749] T 4cd7359accee42808761c37543247321 P 18435fbb525741328139e84a1e354954 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:08:23.515677 27813 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d994cb13f8f453284bcb1f8b85824a2" candidate_uuid: "41268b218b804905a110c86738e74400" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "18435fbb525741328139e84a1e354954" is_pre_election: true
I20260709 13:08:23.517956 27590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d994cb13f8f453284bcb1f8b85824a2" candidate_uuid: "41268b218b804905a110c86738e74400" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2513a663afac495eb09126ff55e8b2b0" is_pre_election: true
I20260709 13:08:23.520483 27487 catalog_manager.cc:5697] T 8ee97a8570ae4cb49195d1b977d1cdf4 P 41268b218b804905a110c86738e74400 reported cstate change: term changed from 0 to 1, leader changed from <none> to 41268b218b804905a110c86738e74400 (127.17.223.2). New cstate: current_term: 1 leader_uuid: "41268b218b804905a110c86738e74400" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "41268b218b804905a110c86738e74400" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 44403 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 38749 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "18435fbb525741328139e84a1e354954" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 40545 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:23.529773 27708 leader_election.cc:304] T 85cdd21b7a5f4db7af44327c57c16d43 P 665f7e09521a4c3f9284c1d8b0e094ff [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 41268b218b804905a110c86738e74400, 665f7e09521a4c3f9284c1d8b0e094ff; no voters: 2513a663afac495eb09126ff55e8b2b0
I20260709 13:08:23.531502 27903 raft_consensus.cc:2804] T 85cdd21b7a5f4db7af44327c57c16d43 P 665f7e09521a4c3f9284c1d8b0e094ff [term 0 FOLLOWER]: Leader pre-election won for term 1
W20260709 13:08:23.533473 27634 leader_election.cc:343] T 2d994cb13f8f453284bcb1f8b85824a2 P 41268b218b804905a110c86738e74400 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 18435fbb525741328139e84a1e354954 (127.17.223.4:40545): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:08:23.544179 27631 leader_election.cc:343] T 2d994cb13f8f453284bcb1f8b85824a2 P 41268b218b804905a110c86738e74400 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2513a663afac495eb09126ff55e8b2b0 (127.17.223.1:40721): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:23.544598 27631 leader_election.cc:304] T 2d994cb13f8f453284bcb1f8b85824a2 P 41268b218b804905a110c86738e74400 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 41268b218b804905a110c86738e74400; no voters: 18435fbb525741328139e84a1e354954, 2513a663afac495eb09126ff55e8b2b0
I20260709 13:08:23.549871 27865 tablet_bootstrap.cc:654] T 8d1aa996b2034de7b2d77545de68e73c P 18435fbb525741328139e84a1e354954: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:23.551144 27978 raft_consensus.cc:2749] T 2d994cb13f8f453284bcb1f8b85824a2 P 41268b218b804905a110c86738e74400 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:08:23.552523 27862 tablet_bootstrap.cc:654] T 1cd5e6e9b36d4591961cb379d7065be9 P 665f7e09521a4c3f9284c1d8b0e094ff: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:23.553028 27978 consensus_queue.cc:1048] T 4cd7359accee42808761c37543247321 P 41268b218b804905a110c86738e74400 [LEADER]: Connected to new peer: Peer: permanent_uuid: "18435fbb525741328139e84a1e354954" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 40545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:08:23.531903 27903 raft_consensus.cc:493] T 85cdd21b7a5f4db7af44327c57c16d43 P 665f7e09521a4c3f9284c1d8b0e094ff [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:23.555972 27903 raft_consensus.cc:3060] T 85cdd21b7a5f4db7af44327c57c16d43 P 665f7e09521a4c3f9284c1d8b0e094ff [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:23.565549 28082 consensus_queue.cc:1048] T 78e19c035a854ee98657bec3edcb3585 P 665f7e09521a4c3f9284c1d8b0e094ff [LEADER]: Connected to new peer: Peer: permanent_uuid: "2513a663afac495eb09126ff55e8b2b0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40721 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:08:23.567749 28101 raft_consensus.cc:493] T 106e04f510c741439b91c39d5fac5a23 P 18435fbb525741328139e84a1e354954 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:23.568298 28101 raft_consensus.cc:515] T 106e04f510c741439b91c39d5fac5a23 P 18435fbb525741328139e84a1e354954 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "41268b218b804905a110c86738e74400" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 44403 } } peers { permanent_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 38749 } } peers { permanent_uuid: "18435fbb525741328139e84a1e354954" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 40545 } }
I20260709 13:08:23.575064 27668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "106e04f510c741439b91c39d5fac5a23" candidate_uuid: "18435fbb525741328139e84a1e354954" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "41268b218b804905a110c86738e74400" is_pre_election: true
I20260709 13:08:23.575934 27668 raft_consensus.cc:2393] T 106e04f510c741439b91c39d5fac5a23 P 41268b218b804905a110c86738e74400 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 18435fbb525741328139e84a1e354954 in current term 1: Already voted for candidate 665f7e09521a4c3f9284c1d8b0e094ff in this term.
I20260709 13:08:23.577970 27861 tablet_bootstrap.cc:492] T 85cdd21b7a5f4db7af44327c57c16d43 P 2513a663afac495eb09126ff55e8b2b0: No bootstrap required, opened a new log
I20260709 13:08:23.578485 27861 ts_tablet_manager.cc:1403] T 85cdd21b7a5f4db7af44327c57c16d43 P 2513a663afac495eb09126ff55e8b2b0: Time spent bootstrapping tablet: real 0.228s	user 0.017s	sys 0.022s
I20260709 13:08:23.570472 28101 leader_election.cc:290] T 106e04f510c741439b91c39d5fac5a23 P 18435fbb525741328139e84a1e354954 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 41268b218b804905a110c86738e74400 (127.17.223.2:44403), 665f7e09521a4c3f9284c1d8b0e094ff (127.17.223.3:38749)
I20260709 13:08:23.580084 28118 consensus_queue.cc:1048] T 78e19c035a854ee98657bec3edcb3585 P 665f7e09521a4c3f9284c1d8b0e094ff [LEADER]: Connected to new peer: Peer: permanent_uuid: "18435fbb525741328139e84a1e354954" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 40545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:08:23.581162 27861 raft_consensus.cc:359] T 85cdd21b7a5f4db7af44327c57c16d43 P 2513a663afac495eb09126ff55e8b2b0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2513a663afac495eb09126ff55e8b2b0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40721 } } peers { permanent_uuid: "41268b218b804905a110c86738e74400" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 44403 } } peers { permanent_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 38749 } }
I20260709 13:08:23.581848 27861 raft_consensus.cc:385] T 85cdd21b7a5f4db7af44327c57c16d43 P 2513a663afac495eb09126ff55e8b2b0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:23.582108 27861 raft_consensus.cc:740] T 85cdd21b7a5f4db7af44327c57c16d43 P 2513a663afac495eb09126ff55e8b2b0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2513a663afac495eb09126ff55e8b2b0, State: Initialized, Role: FOLLOWER
I20260709 13:08:23.582770 27861 consensus_queue.cc:260] T 85cdd21b7a5f4db7af44327c57c16d43 P 2513a663afac495eb09126ff55e8b2b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2513a663afac495eb09126ff55e8b2b0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40721 } } peers { permanent_uuid: "41268b218b804905a110c86738e74400" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 44403 } } peers { permanent_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 38749 } }
I20260709 13:08:23.589982 27861 ts_tablet_manager.cc:1434] T 85cdd21b7a5f4db7af44327c57c16d43 P 2513a663afac495eb09126ff55e8b2b0: Time spent starting tablet: real 0.011s	user 0.006s	sys 0.000s
I20260709 13:08:23.591060 27861 tablet_bootstrap.cc:492] T 3a7da70e9f0f49a9bf60184a8f0b5339 P 2513a663afac495eb09126ff55e8b2b0: Bootstrap starting.
W20260709 13:08:23.592654 27539 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:08:23.596776 27861 tablet_bootstrap.cc:654] T 3a7da70e9f0f49a9bf60184a8f0b5339 P 2513a663afac495eb09126ff55e8b2b0: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:23.609196 27862 tablet_bootstrap.cc:492] T 1cd5e6e9b36d4591961cb379d7065be9 P 665f7e09521a4c3f9284c1d8b0e094ff: No bootstrap required, opened a new log
I20260709 13:08:23.609649 27862 ts_tablet_manager.cc:1403] T 1cd5e6e9b36d4591961cb379d7065be9 P 665f7e09521a4c3f9284c1d8b0e094ff: Time spent bootstrapping tablet: real 0.179s	user 0.010s	sys 0.000s
I20260709 13:08:23.613050 27739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "106e04f510c741439b91c39d5fac5a23" candidate_uuid: "18435fbb525741328139e84a1e354954" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" is_pre_election: true
I20260709 13:08:23.622896 27782 leader_election.cc:304] T 106e04f510c741439b91c39d5fac5a23 P 18435fbb525741328139e84a1e354954 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 18435fbb525741328139e84a1e354954; no voters: 41268b218b804905a110c86738e74400, 665f7e09521a4c3f9284c1d8b0e094ff
I20260709 13:08:23.627069 28013 raft_consensus.cc:3060] T 106e04f510c741439b91c39d5fac5a23 P 18435fbb525741328139e84a1e354954 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:23.628607 28082 consensus_queue.cc:1048] T 106e04f510c741439b91c39d5fac5a23 P 665f7e09521a4c3f9284c1d8b0e094ff [LEADER]: Connected to new peer: Peer: permanent_uuid: "41268b218b804905a110c86738e74400" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 44403 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:08:23.617564 27862 raft_consensus.cc:359] T 1cd5e6e9b36d4591961cb379d7065be9 P 665f7e09521a4c3f9284c1d8b0e094ff [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 38749 } } peers { permanent_uuid: "18435fbb525741328139e84a1e354954" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 40545 } } peers { permanent_uuid: "2513a663afac495eb09126ff55e8b2b0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40721 } }
I20260709 13:08:23.629485 27862 raft_consensus.cc:385] T 1cd5e6e9b36d4591961cb379d7065be9 P 665f7e09521a4c3f9284c1d8b0e094ff [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:23.629787 27862 raft_consensus.cc:740] T 1cd5e6e9b36d4591961cb379d7065be9 P 665f7e09521a4c3f9284c1d8b0e094ff [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 665f7e09521a4c3f9284c1d8b0e094ff, State: Initialized, Role: FOLLOWER
I20260709 13:08:23.639387 27862 consensus_queue.cc:260] T 1cd5e6e9b36d4591961cb379d7065be9 P 665f7e09521a4c3f9284c1d8b0e094ff [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 38749 } } peers { permanent_uuid: "18435fbb525741328139e84a1e354954" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 40545 } } peers { permanent_uuid: "2513a663afac495eb09126ff55e8b2b0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40721 } }
I20260709 13:08:23.634219 28136 consensus_queue.cc:1048] T 4cd7359accee42808761c37543247321 P 41268b218b804905a110c86738e74400 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2513a663afac495eb09126ff55e8b2b0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40721 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:08:23.642249 27861 tablet_bootstrap.cc:492] T 3a7da70e9f0f49a9bf60184a8f0b5339 P 2513a663afac495eb09126ff55e8b2b0: No bootstrap required, opened a new log
I20260709 13:08:23.642791 27861 ts_tablet_manager.cc:1403] T 3a7da70e9f0f49a9bf60184a8f0b5339 P 2513a663afac495eb09126ff55e8b2b0: Time spent bootstrapping tablet: real 0.052s	user 0.017s	sys 0.006s
I20260709 13:08:23.646250 27863 tablet_bootstrap.cc:492] T 8e758d59bd4a4eae9f67662e165013f9 P 41268b218b804905a110c86738e74400: No bootstrap required, opened a new log
I20260709 13:08:23.648066 27863 ts_tablet_manager.cc:1403] T 8e758d59bd4a4eae9f67662e165013f9 P 41268b218b804905a110c86738e74400: Time spent bootstrapping tablet: real 0.237s	user 0.013s	sys 0.003s
I20260709 13:08:23.659349 27861 raft_consensus.cc:359] T 3a7da70e9f0f49a9bf60184a8f0b5339 P 2513a663afac495eb09126ff55e8b2b0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18435fbb525741328139e84a1e354954" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 40545 } } peers { permanent_uuid: "2513a663afac495eb09126ff55e8b2b0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40721 } } peers { permanent_uuid: "41268b218b804905a110c86738e74400" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 44403 } }
I20260709 13:08:23.660375 27861 raft_consensus.cc:385] T 3a7da70e9f0f49a9bf60184a8f0b5339 P 2513a663afac495eb09126ff55e8b2b0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:23.660705 27861 raft_consensus.cc:740] T 3a7da70e9f0f49a9bf60184a8f0b5339 P 2513a663afac495eb09126ff55e8b2b0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2513a663afac495eb09126ff55e8b2b0, State: Initialized, Role: FOLLOWER
I20260709 13:08:23.661478 27861 consensus_queue.cc:260] T 3a7da70e9f0f49a9bf60184a8f0b5339 P 2513a663afac495eb09126ff55e8b2b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18435fbb525741328139e84a1e354954" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 40545 } } peers { permanent_uuid: "2513a663afac495eb09126ff55e8b2b0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40721 } } peers { permanent_uuid: "41268b218b804905a110c86738e74400" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 44403 } }
I20260709 13:08:23.665997 27861 ts_tablet_manager.cc:1434] T 3a7da70e9f0f49a9bf60184a8f0b5339 P 2513a663afac495eb09126ff55e8b2b0: Time spent starting tablet: real 0.023s	user 0.006s	sys 0.000s
I20260709 13:08:23.670328 27862 ts_tablet_manager.cc:1434] T 1cd5e6e9b36d4591961cb379d7065be9 P 665f7e09521a4c3f9284c1d8b0e094ff: Time spent starting tablet: real 0.060s	user 0.009s	sys 0.001s
I20260709 13:08:23.671572 28082 raft_consensus.cc:493] T 1cd5e6e9b36d4591961cb379d7065be9 P 665f7e09521a4c3f9284c1d8b0e094ff [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:23.672381 28082 raft_consensus.cc:515] T 1cd5e6e9b36d4591961cb379d7065be9 P 665f7e09521a4c3f9284c1d8b0e094ff [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 38749 } } peers { permanent_uuid: "18435fbb525741328139e84a1e354954" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 40545 } } peers { permanent_uuid: "2513a663afac495eb09126ff55e8b2b0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40721 } }
I20260709 13:08:23.674336 27903 raft_consensus.cc:515] T 85cdd21b7a5f4db7af44327c57c16d43 P 665f7e09521a4c3f9284c1d8b0e094ff [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2513a663afac495eb09126ff55e8b2b0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40721 } } peers { permanent_uuid: "41268b218b804905a110c86738e74400" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 44403 } } peers { permanent_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 38749 } }
I20260709 13:08:23.676393 27816 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cd5e6e9b36d4591961cb379d7065be9" candidate_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "18435fbb525741328139e84a1e354954" is_pre_election: true
I20260709 13:08:23.677317 27903 leader_election.cc:290] T 85cdd21b7a5f4db7af44327c57c16d43 P 665f7e09521a4c3f9284c1d8b0e094ff [CANDIDATE]: Term 1 election: Requested vote from peers 2513a663afac495eb09126ff55e8b2b0 (127.17.223.1:40721), 41268b218b804905a110c86738e74400 (127.17.223.2:44403)
I20260709 13:08:23.679070 27668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85cdd21b7a5f4db7af44327c57c16d43" candidate_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "41268b218b804905a110c86738e74400"
I20260709 13:08:23.679678 27668 raft_consensus.cc:3060] T 85cdd21b7a5f4db7af44327c57c16d43 P 41268b218b804905a110c86738e74400 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:23.671566 27862 tablet_bootstrap.cc:492] T 8d1aa996b2034de7b2d77545de68e73c P 665f7e09521a4c3f9284c1d8b0e094ff: Bootstrap starting.
W20260709 13:08:23.691761 27708 leader_election.cc:343] T 1cd5e6e9b36d4591961cb379d7065be9 P 665f7e09521a4c3f9284c1d8b0e094ff [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 18435fbb525741328139e84a1e354954 (127.17.223.4:40545): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:23.697638 27668 raft_consensus.cc:2468] T 85cdd21b7a5f4db7af44327c57c16d43 P 41268b218b804905a110c86738e74400 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 665f7e09521a4c3f9284c1d8b0e094ff in term 1.
I20260709 13:08:23.700066 27708 leader_election.cc:304] T 85cdd21b7a5f4db7af44327c57c16d43 P 665f7e09521a4c3f9284c1d8b0e094ff [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 41268b218b804905a110c86738e74400, 665f7e09521a4c3f9284c1d8b0e094ff; no voters: 
I20260709 13:08:23.700985 27903 raft_consensus.cc:2804] T 85cdd21b7a5f4db7af44327c57c16d43 P 665f7e09521a4c3f9284c1d8b0e094ff [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:08:23.701849 27903 raft_consensus.cc:697] T 85cdd21b7a5f4db7af44327c57c16d43 P 665f7e09521a4c3f9284c1d8b0e094ff [term 1 LEADER]: Becoming Leader. State: Replica: 665f7e09521a4c3f9284c1d8b0e094ff, State: Running, Role: LEADER
I20260709 13:08:23.703953 28013 raft_consensus.cc:2749] T 106e04f510c741439b91c39d5fac5a23 P 18435fbb525741328139e84a1e354954 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:08:23.703685 27903 consensus_queue.cc:237] T 85cdd21b7a5f4db7af44327c57c16d43 P 665f7e09521a4c3f9284c1d8b0e094ff [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2513a663afac495eb09126ff55e8b2b0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40721 } } peers { permanent_uuid: "41268b218b804905a110c86738e74400" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 44403 } } peers { permanent_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 38749 } }
I20260709 13:08:23.705403 27861 tablet_bootstrap.cc:492] T 8d1aa996b2034de7b2d77545de68e73c P 2513a663afac495eb09126ff55e8b2b0: Bootstrap starting.
I20260709 13:08:23.715611 28082 leader_election.cc:290] T 1cd5e6e9b36d4591961cb379d7065be9 P 665f7e09521a4c3f9284c1d8b0e094ff [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 18435fbb525741328139e84a1e354954 (127.17.223.4:40545), 2513a663afac495eb09126ff55e8b2b0 (127.17.223.1:40721)
I20260709 13:08:23.713934 27593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85cdd21b7a5f4db7af44327c57c16d43" candidate_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2513a663afac495eb09126ff55e8b2b0"
I20260709 13:08:23.717509 27593 raft_consensus.cc:3060] T 85cdd21b7a5f4db7af44327c57c16d43 P 2513a663afac495eb09126ff55e8b2b0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:23.719801 27591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cd5e6e9b36d4591961cb379d7065be9" candidate_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2513a663afac495eb09126ff55e8b2b0" is_pre_election: true
I20260709 13:08:23.720531 27591 raft_consensus.cc:2468] T 1cd5e6e9b36d4591961cb379d7065be9 P 2513a663afac495eb09126ff55e8b2b0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 665f7e09521a4c3f9284c1d8b0e094ff in term 0.
I20260709 13:08:23.726519 27705 leader_election.cc:304] T 1cd5e6e9b36d4591961cb379d7065be9 P 665f7e09521a4c3f9284c1d8b0e094ff [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2513a663afac495eb09126ff55e8b2b0, 665f7e09521a4c3f9284c1d8b0e094ff; no voters: 18435fbb525741328139e84a1e354954
I20260709 13:08:23.745177 27862 tablet_bootstrap.cc:654] T 8d1aa996b2034de7b2d77545de68e73c P 665f7e09521a4c3f9284c1d8b0e094ff: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:23.759112 27863 raft_consensus.cc:359] T 8e758d59bd4a4eae9f67662e165013f9 P 41268b218b804905a110c86738e74400 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2513a663afac495eb09126ff55e8b2b0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40721 } } peers { permanent_uuid: "41268b218b804905a110c86738e74400" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 44403 } } peers { permanent_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 38749 } }
I20260709 13:08:23.761034 27863 raft_consensus.cc:385] T 8e758d59bd4a4eae9f67662e165013f9 P 41268b218b804905a110c86738e74400 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:23.761418 27863 raft_consensus.cc:740] T 8e758d59bd4a4eae9f67662e165013f9 P 41268b218b804905a110c86738e74400 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 41268b218b804905a110c86738e74400, State: Initialized, Role: FOLLOWER
I20260709 13:08:23.762298 27863 consensus_queue.cc:260] T 8e758d59bd4a4eae9f67662e165013f9 P 41268b218b804905a110c86738e74400 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2513a663afac495eb09126ff55e8b2b0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40721 } } peers { permanent_uuid: "41268b218b804905a110c86738e74400" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 44403 } } peers { permanent_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 38749 } }
I20260709 13:08:23.767905 28158 raft_consensus.cc:2804] T 1cd5e6e9b36d4591961cb379d7065be9 P 665f7e09521a4c3f9284c1d8b0e094ff [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:08:23.768453 28158 raft_consensus.cc:493] T 1cd5e6e9b36d4591961cb379d7065be9 P 665f7e09521a4c3f9284c1d8b0e094ff [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:23.768807 28158 raft_consensus.cc:3060] T 1cd5e6e9b36d4591961cb379d7065be9 P 665f7e09521a4c3f9284c1d8b0e094ff [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:23.772833 27863 ts_tablet_manager.cc:1434] T 8e758d59bd4a4eae9f67662e165013f9 P 41268b218b804905a110c86738e74400: Time spent starting tablet: real 0.124s	user 0.009s	sys 0.000s
I20260709 13:08:23.776352 27865 tablet_bootstrap.cc:492] T 8d1aa996b2034de7b2d77545de68e73c P 18435fbb525741328139e84a1e354954: No bootstrap required, opened a new log
I20260709 13:08:23.776890 27865 ts_tablet_manager.cc:1403] T 8d1aa996b2034de7b2d77545de68e73c P 18435fbb525741328139e84a1e354954: Time spent bootstrapping tablet: real 0.302s	user 0.022s	sys 0.022s
I20260709 13:08:23.793553 27863 tablet_bootstrap.cc:492] T ea92a607c73b4d289d081146089a86f9 P 41268b218b804905a110c86738e74400: Bootstrap starting.
I20260709 13:08:23.813263 27489 catalog_manager.cc:5697] T 85cdd21b7a5f4db7af44327c57c16d43 P 665f7e09521a4c3f9284c1d8b0e094ff reported cstate change: term changed from 0 to 1, leader changed from <none> to 665f7e09521a4c3f9284c1d8b0e094ff (127.17.223.3). New cstate: current_term: 1 leader_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2513a663afac495eb09126ff55e8b2b0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40721 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "41268b218b804905a110c86738e74400" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 44403 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 38749 } health_report { overall_health: HEALTHY } } }
I20260709 13:08:23.819082 27593 raft_consensus.cc:2468] T 85cdd21b7a5f4db7af44327c57c16d43 P 2513a663afac495eb09126ff55e8b2b0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 665f7e09521a4c3f9284c1d8b0e094ff in term 1.
I20260709 13:08:23.821741 27865 raft_consensus.cc:359] T 8d1aa996b2034de7b2d77545de68e73c P 18435fbb525741328139e84a1e354954 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 38749 } } peers { permanent_uuid: "18435fbb525741328139e84a1e354954" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 40545 } } peers { permanent_uuid: "2513a663afac495eb09126ff55e8b2b0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40721 } }
I20260709 13:08:23.822476 27865 raft_consensus.cc:385] T 8d1aa996b2034de7b2d77545de68e73c P 18435fbb525741328139e84a1e354954 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:23.822765 27865 raft_consensus.cc:740] T 8d1aa996b2034de7b2d77545de68e73c P 18435fbb525741328139e84a1e354954 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 18435fbb525741328139e84a1e354954, State: Initialized, Role: FOLLOWER
I20260709 13:08:23.823443 27865 consensus_queue.cc:260] T 8d1aa996b2034de7b2d77545de68e73c P 18435fbb525741328139e84a1e354954 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 38749 } } peers { permanent_uuid: "18435fbb525741328139e84a1e354954" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 40545 } } peers { permanent_uuid: "2513a663afac495eb09126ff55e8b2b0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40721 } }
I20260709 13:08:23.831759 27865 ts_tablet_manager.cc:1434] T 8d1aa996b2034de7b2d77545de68e73c P 18435fbb525741328139e84a1e354954: Time spent starting tablet: real 0.055s	user 0.006s	sys 0.000s
I20260709 13:08:23.838335 27861 tablet_bootstrap.cc:654] T 8d1aa996b2034de7b2d77545de68e73c P 2513a663afac495eb09126ff55e8b2b0: Neither blocks nor log segments found. Creating new log.
W20260709 13:08:23.781450 27705 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.1:40721, user_credentials={real_user=slave}} blocked reactor thread for 55029.8us
I20260709 13:08:23.844189 27865 tablet_bootstrap.cc:492] T 8ee97a8570ae4cb49195d1b977d1cdf4 P 18435fbb525741328139e84a1e354954: Bootstrap starting.
I20260709 13:08:23.852774 27865 tablet_bootstrap.cc:654] T 8ee97a8570ae4cb49195d1b977d1cdf4 P 18435fbb525741328139e84a1e354954: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:23.856413 27863 tablet_bootstrap.cc:654] T ea92a607c73b4d289d081146089a86f9 P 41268b218b804905a110c86738e74400: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:23.858840 28127 raft_consensus.cc:493] T 3a7da70e9f0f49a9bf60184a8f0b5339 P 2513a663afac495eb09126ff55e8b2b0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:23.859388 28127 raft_consensus.cc:515] T 3a7da70e9f0f49a9bf60184a8f0b5339 P 2513a663afac495eb09126ff55e8b2b0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18435fbb525741328139e84a1e354954" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 40545 } } peers { permanent_uuid: "2513a663afac495eb09126ff55e8b2b0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40721 } } peers { permanent_uuid: "41268b218b804905a110c86738e74400" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 44403 } }
I20260709 13:08:23.861825 28127 leader_election.cc:290] T 3a7da70e9f0f49a9bf60184a8f0b5339 P 2513a663afac495eb09126ff55e8b2b0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 18435fbb525741328139e84a1e354954 (127.17.223.4:40545), 41268b218b804905a110c86738e74400 (127.17.223.2:44403)
I20260709 13:08:23.875380 27815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a7da70e9f0f49a9bf60184a8f0b5339" candidate_uuid: "2513a663afac495eb09126ff55e8b2b0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "18435fbb525741328139e84a1e354954" is_pre_election: true
I20260709 13:08:23.876581 27668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a7da70e9f0f49a9bf60184a8f0b5339" candidate_uuid: "2513a663afac495eb09126ff55e8b2b0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "41268b218b804905a110c86738e74400" is_pre_election: true
W20260709 13:08:23.876729 27559 leader_election.cc:343] T 3a7da70e9f0f49a9bf60184a8f0b5339 P 2513a663afac495eb09126ff55e8b2b0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 18435fbb525741328139e84a1e354954 (127.17.223.4:40545): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:23.877242 27668 raft_consensus.cc:2468] T 3a7da70e9f0f49a9bf60184a8f0b5339 P 41268b218b804905a110c86738e74400 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2513a663afac495eb09126ff55e8b2b0 in term 0.
I20260709 13:08:23.879181 27559 leader_election.cc:304] T 3a7da70e9f0f49a9bf60184a8f0b5339 P 2513a663afac495eb09126ff55e8b2b0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2513a663afac495eb09126ff55e8b2b0, 41268b218b804905a110c86738e74400; no voters: 18435fbb525741328139e84a1e354954
I20260709 13:08:23.871155 28082 consensus_queue.cc:1048] T 106e04f510c741439b91c39d5fac5a23 P 665f7e09521a4c3f9284c1d8b0e094ff [LEADER]: Connected to new peer: Peer: permanent_uuid: "18435fbb525741328139e84a1e354954" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 40545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.009s
I20260709 13:08:23.880429 28125 raft_consensus.cc:2804] T 3a7da70e9f0f49a9bf60184a8f0b5339 P 2513a663afac495eb09126ff55e8b2b0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:08:23.883826 28125 raft_consensus.cc:493] T 3a7da70e9f0f49a9bf60184a8f0b5339 P 2513a663afac495eb09126ff55e8b2b0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:23.884296 28125 raft_consensus.cc:3060] T 3a7da70e9f0f49a9bf60184a8f0b5339 P 2513a663afac495eb09126ff55e8b2b0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:23.887535 27874 raft_consensus.cc:493] T 8d1aa996b2034de7b2d77545de68e73c P 18435fbb525741328139e84a1e354954 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:23.888057 27874 raft_consensus.cc:515] T 8d1aa996b2034de7b2d77545de68e73c P 18435fbb525741328139e84a1e354954 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 38749 } } peers { permanent_uuid: "18435fbb525741328139e84a1e354954" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 40545 } } peers { permanent_uuid: "2513a663afac495eb09126ff55e8b2b0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40721 } }
I20260709 13:08:23.895083 27862 tablet_bootstrap.cc:492] T 8d1aa996b2034de7b2d77545de68e73c P 665f7e09521a4c3f9284c1d8b0e094ff: No bootstrap required, opened a new log
I20260709 13:08:23.895859 27862 ts_tablet_manager.cc:1403] T 8d1aa996b2034de7b2d77545de68e73c P 665f7e09521a4c3f9284c1d8b0e094ff: Time spent bootstrapping tablet: real 0.225s	user 0.023s	sys 0.021s
I20260709 13:08:23.900740 27874 leader_election.cc:290] T 8d1aa996b2034de7b2d77545de68e73c P 18435fbb525741328139e84a1e354954 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 665f7e09521a4c3f9284c1d8b0e094ff (127.17.223.3:38749), 2513a663afac495eb09126ff55e8b2b0 (127.17.223.1:40721)
I20260709 13:08:23.901876 28158 raft_consensus.cc:515] T 1cd5e6e9b36d4591961cb379d7065be9 P 665f7e09521a4c3f9284c1d8b0e094ff [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 38749 } } peers { permanent_uuid: "18435fbb525741328139e84a1e354954" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 40545 } } peers { permanent_uuid: "2513a663afac495eb09126ff55e8b2b0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40721 } }
I20260709 13:08:23.903008 27593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d1aa996b2034de7b2d77545de68e73c" candidate_uuid: "18435fbb525741328139e84a1e354954" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2513a663afac495eb09126ff55e8b2b0" is_pre_election: true
I20260709 13:08:23.904150 27739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d1aa996b2034de7b2d77545de68e73c" candidate_uuid: "18435fbb525741328139e84a1e354954" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" is_pre_election: true
I20260709 13:08:23.905305 27815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cd5e6e9b36d4591961cb379d7065be9" candidate_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "18435fbb525741328139e84a1e354954"
W20260709 13:08:23.906807 27708 leader_election.cc:343] T 1cd5e6e9b36d4591961cb379d7065be9 P 665f7e09521a4c3f9284c1d8b0e094ff [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 18435fbb525741328139e84a1e354954 (127.17.223.4:40545): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:08:23.908245 27779 leader_election.cc:343] T 8d1aa996b2034de7b2d77545de68e73c P 18435fbb525741328139e84a1e354954 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2513a663afac495eb09126ff55e8b2b0 (127.17.223.1:40721): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:23.914912 28158 leader_election.cc:290] T 1cd5e6e9b36d4591961cb379d7065be9 P 665f7e09521a4c3f9284c1d8b0e094ff [CANDIDATE]: Term 1 election: Requested vote from peers 18435fbb525741328139e84a1e354954 (127.17.223.4:40545), 2513a663afac495eb09126ff55e8b2b0 (127.17.223.1:40721)
W20260709 13:08:23.922746 27782 leader_election.cc:343] T 8d1aa996b2034de7b2d77545de68e73c P 18435fbb525741328139e84a1e354954 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 665f7e09521a4c3f9284c1d8b0e094ff (127.17.223.3:38749): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:23.923252 27782 leader_election.cc:304] T 8d1aa996b2034de7b2d77545de68e73c P 18435fbb525741328139e84a1e354954 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 18435fbb525741328139e84a1e354954; no voters: 2513a663afac495eb09126ff55e8b2b0, 665f7e09521a4c3f9284c1d8b0e094ff
I20260709 13:08:23.927105 27874 raft_consensus.cc:2749] T 8d1aa996b2034de7b2d77545de68e73c P 18435fbb525741328139e84a1e354954 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:08:23.930517 27862 raft_consensus.cc:359] T 8d1aa996b2034de7b2d77545de68e73c P 665f7e09521a4c3f9284c1d8b0e094ff [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 38749 } } peers { permanent_uuid: "18435fbb525741328139e84a1e354954" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 40545 } } peers { permanent_uuid: "2513a663afac495eb09126ff55e8b2b0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40721 } }
I20260709 13:08:23.937990 27865 tablet_bootstrap.cc:492] T 8ee97a8570ae4cb49195d1b977d1cdf4 P 18435fbb525741328139e84a1e354954: No bootstrap required, opened a new log
I20260709 13:08:23.939569 27593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cd5e6e9b36d4591961cb379d7065be9" candidate_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2513a663afac495eb09126ff55e8b2b0"
I20260709 13:08:23.941680 27863 tablet_bootstrap.cc:492] T ea92a607c73b4d289d081146089a86f9 P 41268b218b804905a110c86738e74400: No bootstrap required, opened a new log
I20260709 13:08:23.943723 27862 raft_consensus.cc:385] T 8d1aa996b2034de7b2d77545de68e73c P 665f7e09521a4c3f9284c1d8b0e094ff [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:23.945227 27863 ts_tablet_manager.cc:1403] T ea92a607c73b4d289d081146089a86f9 P 41268b218b804905a110c86738e74400: Time spent bootstrapping tablet: real 0.152s	user 0.017s	sys 0.027s
I20260709 13:08:23.945528 27593 raft_consensus.cc:3060] T 1cd5e6e9b36d4591961cb379d7065be9 P 2513a663afac495eb09126ff55e8b2b0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:23.947563 27863 raft_consensus.cc:359] T ea92a607c73b4d289d081146089a86f9 P 41268b218b804905a110c86738e74400 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2513a663afac495eb09126ff55e8b2b0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40721 } } peers { permanent_uuid: "41268b218b804905a110c86738e74400" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 44403 } } peers { permanent_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 38749 } }
I20260709 13:08:23.948100 27863 raft_consensus.cc:385] T ea92a607c73b4d289d081146089a86f9 P 41268b218b804905a110c86738e74400 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:23.948369 27863 raft_consensus.cc:740] T ea92a607c73b4d289d081146089a86f9 P 41268b218b804905a110c86738e74400 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 41268b218b804905a110c86738e74400, State: Initialized, Role: FOLLOWER
I20260709 13:08:23.944808 28136 consensus_queue.cc:1048] T 8ee97a8570ae4cb49195d1b977d1cdf4 P 41268b218b804905a110c86738e74400 [LEADER]: Connected to new peer: Peer: permanent_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 38749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.004s
I20260709 13:08:23.949365 27863 consensus_queue.cc:260] T ea92a607c73b4d289d081146089a86f9 P 41268b218b804905a110c86738e74400 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2513a663afac495eb09126ff55e8b2b0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40721 } } peers { permanent_uuid: "41268b218b804905a110c86738e74400" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 44403 } } peers { permanent_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 38749 } }
I20260709 13:08:23.951242 27863 ts_tablet_manager.cc:1434] T ea92a607c73b4d289d081146089a86f9 P 41268b218b804905a110c86738e74400: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 13:08:23.952514 27593 raft_consensus.cc:2468] T 1cd5e6e9b36d4591961cb379d7065be9 P 2513a663afac495eb09126ff55e8b2b0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 665f7e09521a4c3f9284c1d8b0e094ff in term 1.
I20260709 13:08:23.945220 27862 raft_consensus.cc:740] T 8d1aa996b2034de7b2d77545de68e73c P 665f7e09521a4c3f9284c1d8b0e094ff [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 665f7e09521a4c3f9284c1d8b0e094ff, State: Initialized, Role: FOLLOWER
I20260709 13:08:23.955462 27861 tablet_bootstrap.cc:492] T 8d1aa996b2034de7b2d77545de68e73c P 2513a663afac495eb09126ff55e8b2b0: No bootstrap required, opened a new log
I20260709 13:08:23.953892 27705 leader_election.cc:304] T 1cd5e6e9b36d4591961cb379d7065be9 P 665f7e09521a4c3f9284c1d8b0e094ff [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2513a663afac495eb09126ff55e8b2b0, 665f7e09521a4c3f9284c1d8b0e094ff; no voters: 18435fbb525741328139e84a1e354954
I20260709 13:08:23.955945 27861 ts_tablet_manager.cc:1403] T 8d1aa996b2034de7b2d77545de68e73c P 2513a663afac495eb09126ff55e8b2b0: Time spent bootstrapping tablet: real 0.265s	user 0.018s	sys 0.010s
I20260709 13:08:23.955669 27862 consensus_queue.cc:260] T 8d1aa996b2034de7b2d77545de68e73c P 665f7e09521a4c3f9284c1d8b0e094ff [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 38749 } } peers { permanent_uuid: "18435fbb525741328139e84a1e354954" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 40545 } } peers { permanent_uuid: "2513a663afac495eb09126ff55e8b2b0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40721 } }
I20260709 13:08:23.956387 28158 raft_consensus.cc:2804] T 1cd5e6e9b36d4591961cb379d7065be9 P 665f7e09521a4c3f9284c1d8b0e094ff [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:08:23.956951 28158 raft_consensus.cc:697] T 1cd5e6e9b36d4591961cb379d7065be9 P 665f7e09521a4c3f9284c1d8b0e094ff [term 1 LEADER]: Becoming Leader. State: Replica: 665f7e09521a4c3f9284c1d8b0e094ff, State: Running, Role: LEADER
I20260709 13:08:23.954598 28125 raft_consensus.cc:515] T 3a7da70e9f0f49a9bf60184a8f0b5339 P 2513a663afac495eb09126ff55e8b2b0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18435fbb525741328139e84a1e354954" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 40545 } } peers { permanent_uuid: "2513a663afac495eb09126ff55e8b2b0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40721 } } peers { permanent_uuid: "41268b218b804905a110c86738e74400" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 44403 } }
I20260709 13:08:23.958141 27863 tablet_bootstrap.cc:492] T 1c5e794c2a0a45fa99bcfde6aeb45d2e P 41268b218b804905a110c86738e74400: Bootstrap starting.
I20260709 13:08:23.957809 28158 consensus_queue.cc:237] T 1cd5e6e9b36d4591961cb379d7065be9 P 665f7e09521a4c3f9284c1d8b0e094ff [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 38749 } } peers { permanent_uuid: "18435fbb525741328139e84a1e354954" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 40545 } } peers { permanent_uuid: "2513a663afac495eb09126ff55e8b2b0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40721 } }
I20260709 13:08:23.959957 27814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a7da70e9f0f49a9bf60184a8f0b5339" candidate_uuid: "2513a663afac495eb09126ff55e8b2b0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "18435fbb525741328139e84a1e354954"
I20260709 13:08:23.960496 28125 leader_election.cc:290] T 3a7da70e9f0f49a9bf60184a8f0b5339 P 2513a663afac495eb09126ff55e8b2b0 [CANDIDATE]: Term 1 election: Requested vote from peers 18435fbb525741328139e84a1e354954 (127.17.223.4:40545), 41268b218b804905a110c86738e74400 (127.17.223.2:44403)
I20260709 13:08:23.957825 27862 ts_tablet_manager.cc:1434] T 8d1aa996b2034de7b2d77545de68e73c P 665f7e09521a4c3f9284c1d8b0e094ff: Time spent starting tablet: real 0.062s	user 0.005s	sys 0.001s
I20260709 13:08:23.961084 27668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a7da70e9f0f49a9bf60184a8f0b5339" candidate_uuid: "2513a663afac495eb09126ff55e8b2b0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "41268b218b804905a110c86738e74400"
W20260709 13:08:23.961304 27559 leader_election.cc:343] T 3a7da70e9f0f49a9bf60184a8f0b5339 P 2513a663afac495eb09126ff55e8b2b0 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 18435fbb525741328139e84a1e354954 (127.17.223.4:40545): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:23.961680 27668 raft_consensus.cc:3060] T 3a7da70e9f0f49a9bf60184a8f0b5339 P 41268b218b804905a110c86738e74400 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:23.962090 27862 tablet_bootstrap.cc:492] T 8e0d496efc3f41f3be82a538ef3cfdac P 665f7e09521a4c3f9284c1d8b0e094ff: Bootstrap starting.
I20260709 13:08:23.964851 27863 tablet_bootstrap.cc:654] T 1c5e794c2a0a45fa99bcfde6aeb45d2e P 41268b218b804905a110c86738e74400: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:23.967527 27865 ts_tablet_manager.cc:1403] T 8ee97a8570ae4cb49195d1b977d1cdf4 P 18435fbb525741328139e84a1e354954: Time spent bootstrapping tablet: real 0.123s	user 0.019s	sys 0.024s
I20260709 13:08:23.970620 27862 tablet_bootstrap.cc:654] T 8e0d496efc3f41f3be82a538ef3cfdac P 665f7e09521a4c3f9284c1d8b0e094ff: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:23.970809 27668 raft_consensus.cc:2468] T 3a7da70e9f0f49a9bf60184a8f0b5339 P 41268b218b804905a110c86738e74400 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2513a663afac495eb09126ff55e8b2b0 in term 1.
I20260709 13:08:23.971834 27559 leader_election.cc:304] T 3a7da70e9f0f49a9bf60184a8f0b5339 P 2513a663afac495eb09126ff55e8b2b0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2513a663afac495eb09126ff55e8b2b0, 41268b218b804905a110c86738e74400; no voters: 18435fbb525741328139e84a1e354954
I20260709 13:08:23.972805 28125 raft_consensus.cc:2804] T 3a7da70e9f0f49a9bf60184a8f0b5339 P 2513a663afac495eb09126ff55e8b2b0 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:08:23.973315 28125 raft_consensus.cc:697] T 3a7da70e9f0f49a9bf60184a8f0b5339 P 2513a663afac495eb09126ff55e8b2b0 [term 1 LEADER]: Becoming Leader. State: Replica: 2513a663afac495eb09126ff55e8b2b0, State: Running, Role: LEADER
I20260709 13:08:23.973083 27865 raft_consensus.cc:359] T 8ee97a8570ae4cb49195d1b977d1cdf4 P 18435fbb525741328139e84a1e354954 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "41268b218b804905a110c86738e74400" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 44403 } } peers { permanent_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 38749 } } peers { permanent_uuid: "18435fbb525741328139e84a1e354954" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 40545 } }
I20260709 13:08:23.973784 27865 raft_consensus.cc:385] T 8ee97a8570ae4cb49195d1b977d1cdf4 P 18435fbb525741328139e84a1e354954 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:23.974071 27865 raft_consensus.cc:740] T 8ee97a8570ae4cb49195d1b977d1cdf4 P 18435fbb525741328139e84a1e354954 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 18435fbb525741328139e84a1e354954, State: Initialized, Role: FOLLOWER
I20260709 13:08:23.974187 28125 consensus_queue.cc:237] T 3a7da70e9f0f49a9bf60184a8f0b5339 P 2513a663afac495eb09126ff55e8b2b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18435fbb525741328139e84a1e354954" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 40545 } } peers { permanent_uuid: "2513a663afac495eb09126ff55e8b2b0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40721 } } peers { permanent_uuid: "41268b218b804905a110c86738e74400" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 44403 } }
I20260709 13:08:23.975390 27865 consensus_queue.cc:260] T 8ee97a8570ae4cb49195d1b977d1cdf4 P 18435fbb525741328139e84a1e354954 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "41268b218b804905a110c86738e74400" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 44403 } } peers { permanent_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 38749 } } peers { permanent_uuid: "18435fbb525741328139e84a1e354954" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 40545 } }
I20260709 13:08:23.978256 27865 ts_tablet_manager.cc:1434] T 8ee97a8570ae4cb49195d1b977d1cdf4 P 18435fbb525741328139e84a1e354954: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.001s
I20260709 13:08:23.979272 27865 tablet_bootstrap.cc:492] T 3a7da70e9f0f49a9bf60184a8f0b5339 P 18435fbb525741328139e84a1e354954: Bootstrap starting.
I20260709 13:08:23.979645 27863 tablet_bootstrap.cc:492] T 1c5e794c2a0a45fa99bcfde6aeb45d2e P 41268b218b804905a110c86738e74400: No bootstrap required, opened a new log
I20260709 13:08:23.980105 27863 ts_tablet_manager.cc:1403] T 1c5e794c2a0a45fa99bcfde6aeb45d2e P 41268b218b804905a110c86738e74400: Time spent bootstrapping tablet: real 0.022s	user 0.010s	sys 0.006s
I20260709 13:08:23.982749 27863 raft_consensus.cc:359] T 1c5e794c2a0a45fa99bcfde6aeb45d2e P 41268b218b804905a110c86738e74400 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "41268b218b804905a110c86738e74400" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 44403 } } peers { permanent_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 38749 } } peers { permanent_uuid: "18435fbb525741328139e84a1e354954" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 40545 } }
I20260709 13:08:23.983379 27863 raft_consensus.cc:385] T 1c5e794c2a0a45fa99bcfde6aeb45d2e P 41268b218b804905a110c86738e74400 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:23.983631 27863 raft_consensus.cc:740] T 1c5e794c2a0a45fa99bcfde6aeb45d2e P 41268b218b804905a110c86738e74400 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 41268b218b804905a110c86738e74400, State: Initialized, Role: FOLLOWER
I20260709 13:08:23.984246 27863 consensus_queue.cc:260] T 1c5e794c2a0a45fa99bcfde6aeb45d2e P 41268b218b804905a110c86738e74400 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "41268b218b804905a110c86738e74400" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 44403 } } peers { permanent_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 38749 } } peers { permanent_uuid: "18435fbb525741328139e84a1e354954" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 40545 } }
I20260709 13:08:23.986270 27863 ts_tablet_manager.cc:1434] T 1c5e794c2a0a45fa99bcfde6aeb45d2e P 41268b218b804905a110c86738e74400: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 13:08:23.987237 27863 tablet_bootstrap.cc:492] T 9e94954fc474414ba7563be776d6c80a P 41268b218b804905a110c86738e74400: Bootstrap starting.
I20260709 13:08:23.989665 27861 raft_consensus.cc:359] T 8d1aa996b2034de7b2d77545de68e73c P 2513a663afac495eb09126ff55e8b2b0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 38749 } } peers { permanent_uuid: "18435fbb525741328139e84a1e354954" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 40545 } } peers { permanent_uuid: "2513a663afac495eb09126ff55e8b2b0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40721 } }
I20260709 13:08:23.990442 27861 raft_consensus.cc:385] T 8d1aa996b2034de7b2d77545de68e73c P 2513a663afac495eb09126ff55e8b2b0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:23.990721 27861 raft_consensus.cc:740] T 8d1aa996b2034de7b2d77545de68e73c P 2513a663afac495eb09126ff55e8b2b0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2513a663afac495eb09126ff55e8b2b0, State: Initialized, Role: FOLLOWER
I20260709 13:08:23.991457 27861 consensus_queue.cc:260] T 8d1aa996b2034de7b2d77545de68e73c P 2513a663afac495eb09126ff55e8b2b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 38749 } } peers { permanent_uuid: "18435fbb525741328139e84a1e354954" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 40545 } } peers { permanent_uuid: "2513a663afac495eb09126ff55e8b2b0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40721 } }
I20260709 13:08:23.997076 27863 tablet_bootstrap.cc:654] T 9e94954fc474414ba7563be776d6c80a P 41268b218b804905a110c86738e74400: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:23.999210 27865 tablet_bootstrap.cc:654] T 3a7da70e9f0f49a9bf60184a8f0b5339 P 18435fbb525741328139e84a1e354954: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:24.003736 27814 raft_consensus.cc:3060] T 8ee97a8570ae4cb49195d1b977d1cdf4 P 18435fbb525741328139e84a1e354954 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:24.008467 27489 catalog_manager.cc:5697] T 3a7da70e9f0f49a9bf60184a8f0b5339 P 2513a663afac495eb09126ff55e8b2b0 reported cstate change: term changed from 0 to 1, leader changed from <none> to 2513a663afac495eb09126ff55e8b2b0 (127.17.223.1). New cstate: current_term: 1 leader_uuid: "2513a663afac495eb09126ff55e8b2b0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18435fbb525741328139e84a1e354954" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 40545 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2513a663afac495eb09126ff55e8b2b0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40721 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "41268b218b804905a110c86738e74400" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 44403 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:24.011165 27978 raft_consensus.cc:493] T 8e758d59bd4a4eae9f67662e165013f9 P 41268b218b804905a110c86738e74400 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:24.011685 27978 raft_consensus.cc:515] T 8e758d59bd4a4eae9f67662e165013f9 P 41268b218b804905a110c86738e74400 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2513a663afac495eb09126ff55e8b2b0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40721 } } peers { permanent_uuid: "41268b218b804905a110c86738e74400" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 44403 } } peers { permanent_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 38749 } }
I20260709 13:08:24.013800 27978 leader_election.cc:290] T 8e758d59bd4a4eae9f67662e165013f9 P 41268b218b804905a110c86738e74400 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2513a663afac495eb09126ff55e8b2b0 (127.17.223.1:40721), 665f7e09521a4c3f9284c1d8b0e094ff (127.17.223.3:38749)
I20260709 13:08:24.014019 27862 tablet_bootstrap.cc:492] T 8e0d496efc3f41f3be82a538ef3cfdac P 665f7e09521a4c3f9284c1d8b0e094ff: No bootstrap required, opened a new log
I20260709 13:08:24.014647 27862 ts_tablet_manager.cc:1403] T 8e0d496efc3f41f3be82a538ef3cfdac P 665f7e09521a4c3f9284c1d8b0e094ff: Time spent bootstrapping tablet: real 0.053s	user 0.008s	sys 0.006s
I20260709 13:08:24.018261 27903 raft_consensus.cc:493] T 8d1aa996b2034de7b2d77545de68e73c P 665f7e09521a4c3f9284c1d8b0e094ff [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:24.019251 27593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e758d59bd4a4eae9f67662e165013f9" candidate_uuid: "41268b218b804905a110c86738e74400" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2513a663afac495eb09126ff55e8b2b0" is_pre_election: true
I20260709 13:08:24.018980 27903 raft_consensus.cc:515] T 8d1aa996b2034de7b2d77545de68e73c P 665f7e09521a4c3f9284c1d8b0e094ff [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 38749 } } peers { permanent_uuid: "18435fbb525741328139e84a1e354954" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 40545 } } peers { permanent_uuid: "2513a663afac495eb09126ff55e8b2b0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40721 } }
W20260709 13:08:24.021204 27631 leader_election.cc:343] T 8e758d59bd4a4eae9f67662e165013f9 P 41268b218b804905a110c86738e74400 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2513a663afac495eb09126ff55e8b2b0 (127.17.223.1:40721): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:24.022603 27903 leader_election.cc:290] T 8d1aa996b2034de7b2d77545de68e73c P 665f7e09521a4c3f9284c1d8b0e094ff [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 18435fbb525741328139e84a1e354954 (127.17.223.4:40545), 2513a663afac495eb09126ff55e8b2b0 (127.17.223.1:40721)
I20260709 13:08:24.018234 27862 raft_consensus.cc:359] T 8e0d496efc3f41f3be82a538ef3cfdac P 665f7e09521a4c3f9284c1d8b0e094ff [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "41268b218b804905a110c86738e74400" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 44403 } } peers { permanent_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 38749 } } peers { permanent_uuid: "18435fbb525741328139e84a1e354954" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 40545 } }
I20260709 13:08:24.023770 27740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e758d59bd4a4eae9f67662e165013f9" candidate_uuid: "41268b218b804905a110c86738e74400" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" is_pre_election: true
I20260709 13:08:24.024147 27487 catalog_manager.cc:5697] T 1cd5e6e9b36d4591961cb379d7065be9 P 665f7e09521a4c3f9284c1d8b0e094ff reported cstate change: term changed from 0 to 1, leader changed from <none> to 665f7e09521a4c3f9284c1d8b0e094ff (127.17.223.3). New cstate: current_term: 1 leader_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 38749 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "18435fbb525741328139e84a1e354954" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 40545 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2513a663afac495eb09126ff55e8b2b0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40721 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:24.025507 27593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d1aa996b2034de7b2d77545de68e73c" candidate_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2513a663afac495eb09126ff55e8b2b0" is_pre_election: true
I20260709 13:08:24.026116 27593 raft_consensus.cc:2468] T 8d1aa996b2034de7b2d77545de68e73c P 2513a663afac495eb09126ff55e8b2b0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 665f7e09521a4c3f9284c1d8b0e094ff in term 0.
I20260709 13:08:24.027171 27705 leader_election.cc:304] T 8d1aa996b2034de7b2d77545de68e73c P 665f7e09521a4c3f9284c1d8b0e094ff [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2513a663afac495eb09126ff55e8b2b0, 665f7e09521a4c3f9284c1d8b0e094ff; no voters: 
I20260709 13:08:24.027972 27903 raft_consensus.cc:2804] T 8d1aa996b2034de7b2d77545de68e73c P 665f7e09521a4c3f9284c1d8b0e094ff [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:08:24.028342 27903 raft_consensus.cc:493] T 8d1aa996b2034de7b2d77545de68e73c P 665f7e09521a4c3f9284c1d8b0e094ff [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:24.028679 27903 raft_consensus.cc:3060] T 8d1aa996b2034de7b2d77545de68e73c P 665f7e09521a4c3f9284c1d8b0e094ff [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:08:24.029441 27634 leader_election.cc:343] T 8e758d59bd4a4eae9f67662e165013f9 P 41268b218b804905a110c86738e74400 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 665f7e09521a4c3f9284c1d8b0e094ff (127.17.223.3:38749): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:24.030068 27634 leader_election.cc:304] T 8e758d59bd4a4eae9f67662e165013f9 P 41268b218b804905a110c86738e74400 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 41268b218b804905a110c86738e74400; no voters: 2513a663afac495eb09126ff55e8b2b0, 665f7e09521a4c3f9284c1d8b0e094ff
I20260709 13:08:24.023950 27862 raft_consensus.cc:385] T 8e0d496efc3f41f3be82a538ef3cfdac P 665f7e09521a4c3f9284c1d8b0e094ff [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:24.035274 27862 raft_consensus.cc:740] T 8e0d496efc3f41f3be82a538ef3cfdac P 665f7e09521a4c3f9284c1d8b0e094ff [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 665f7e09521a4c3f9284c1d8b0e094ff, State: Initialized, Role: FOLLOWER
I20260709 13:08:24.040150 27862 consensus_queue.cc:260] T 8e0d496efc3f41f3be82a538ef3cfdac P 665f7e09521a4c3f9284c1d8b0e094ff [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "41268b218b804905a110c86738e74400" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 44403 } } peers { permanent_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 38749 } } peers { permanent_uuid: "18435fbb525741328139e84a1e354954" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 40545 } }
I20260709 13:08:24.044147 27813 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d1aa996b2034de7b2d77545de68e73c" candidate_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "18435fbb525741328139e84a1e354954" is_pre_election: true
I20260709 13:08:24.044797 27813 raft_consensus.cc:2468] T 8d1aa996b2034de7b2d77545de68e73c P 18435fbb525741328139e84a1e354954 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 665f7e09521a4c3f9284c1d8b0e094ff in term 0.
I20260709 13:08:24.033779 28136 raft_consensus.cc:2749] T 8e758d59bd4a4eae9f67662e165013f9 P 41268b218b804905a110c86738e74400 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:08:24.058746 28136 consensus_queue.cc:1048] T 8ee97a8570ae4cb49195d1b977d1cdf4 P 41268b218b804905a110c86738e74400 [LEADER]: Connected to new peer: Peer: permanent_uuid: "18435fbb525741328139e84a1e354954" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 40545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:08:24.069069 27862 ts_tablet_manager.cc:1434] T 8e0d496efc3f41f3be82a538ef3cfdac P 665f7e09521a4c3f9284c1d8b0e094ff: Time spent starting tablet: real 0.054s	user 0.006s	sys 0.003s
I20260709 13:08:24.070168 27862 tablet_bootstrap.cc:492] T 8e758d59bd4a4eae9f67662e165013f9 P 665f7e09521a4c3f9284c1d8b0e094ff: Bootstrap starting.
I20260709 13:08:24.076251 27861 ts_tablet_manager.cc:1434] T 8d1aa996b2034de7b2d77545de68e73c P 2513a663afac495eb09126ff55e8b2b0: Time spent starting tablet: real 0.120s	user 0.009s	sys 0.000s
I20260709 13:08:24.078596 27861 tablet_bootstrap.cc:492] T 8e758d59bd4a4eae9f67662e165013f9 P 2513a663afac495eb09126ff55e8b2b0: Bootstrap starting.
I20260709 13:08:24.087386 27865 tablet_bootstrap.cc:492] T 3a7da70e9f0f49a9bf60184a8f0b5339 P 18435fbb525741328139e84a1e354954: No bootstrap required, opened a new log
I20260709 13:08:24.088008 27865 ts_tablet_manager.cc:1403] T 3a7da70e9f0f49a9bf60184a8f0b5339 P 18435fbb525741328139e84a1e354954: Time spent bootstrapping tablet: real 0.109s	user 0.034s	sys 0.049s
I20260709 13:08:24.090735 27865 raft_consensus.cc:359] T 3a7da70e9f0f49a9bf60184a8f0b5339 P 18435fbb525741328139e84a1e354954 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18435fbb525741328139e84a1e354954" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 40545 } } peers { permanent_uuid: "2513a663afac495eb09126ff55e8b2b0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40721 } } peers { permanent_uuid: "41268b218b804905a110c86738e74400" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 44403 } }
I20260709 13:08:24.091444 27865 raft_consensus.cc:385] T 3a7da70e9f0f49a9bf60184a8f0b5339 P 18435fbb525741328139e84a1e354954 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:24.091703 27865 raft_consensus.cc:740] T 3a7da70e9f0f49a9bf60184a8f0b5339 P 18435fbb525741328139e84a1e354954 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 18435fbb525741328139e84a1e354954, State: Initialized, Role: FOLLOWER
I20260709 13:08:24.092535 27863 tablet_bootstrap.cc:492] T 9e94954fc474414ba7563be776d6c80a P 41268b218b804905a110c86738e74400: No bootstrap required, opened a new log
I20260709 13:08:24.092324 27865 consensus_queue.cc:260] T 3a7da70e9f0f49a9bf60184a8f0b5339 P 18435fbb525741328139e84a1e354954 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18435fbb525741328139e84a1e354954" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 40545 } } peers { permanent_uuid: "2513a663afac495eb09126ff55e8b2b0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40721 } } peers { permanent_uuid: "41268b218b804905a110c86738e74400" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 44403 } }
I20260709 13:08:24.093035 27863 ts_tablet_manager.cc:1403] T 9e94954fc474414ba7563be776d6c80a P 41268b218b804905a110c86738e74400: Time spent bootstrapping tablet: real 0.106s	user 0.009s	sys 0.013s
I20260709 13:08:24.093880 27865 ts_tablet_manager.cc:1434] T 3a7da70e9f0f49a9bf60184a8f0b5339 P 18435fbb525741328139e84a1e354954: Time spent starting tablet: real 0.006s	user 0.003s	sys 0.000s
I20260709 13:08:24.094815 27861 tablet_bootstrap.cc:654] T 8e758d59bd4a4eae9f67662e165013f9 P 2513a663afac495eb09126ff55e8b2b0: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:24.095127 27862 tablet_bootstrap.cc:654] T 8e758d59bd4a4eae9f67662e165013f9 P 665f7e09521a4c3f9284c1d8b0e094ff: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:24.094858 27865 tablet_bootstrap.cc:492] T 1cd5e6e9b36d4591961cb379d7065be9 P 18435fbb525741328139e84a1e354954: Bootstrap starting.
I20260709 13:08:24.097095 27903 raft_consensus.cc:515] T 8d1aa996b2034de7b2d77545de68e73c P 665f7e09521a4c3f9284c1d8b0e094ff [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 38749 } } peers { permanent_uuid: "18435fbb525741328139e84a1e354954" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 40545 } } peers { permanent_uuid: "2513a663afac495eb09126ff55e8b2b0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40721 } }
I20260709 13:08:24.102087 27815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d1aa996b2034de7b2d77545de68e73c" candidate_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "18435fbb525741328139e84a1e354954"
I20260709 13:08:24.102741 27815 raft_consensus.cc:3060] T 8d1aa996b2034de7b2d77545de68e73c P 18435fbb525741328139e84a1e354954 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:24.103721 27865 tablet_bootstrap.cc:654] T 1cd5e6e9b36d4591961cb379d7065be9 P 18435fbb525741328139e84a1e354954: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:24.106122 27862 tablet_bootstrap.cc:492] T 8e758d59bd4a4eae9f67662e165013f9 P 665f7e09521a4c3f9284c1d8b0e094ff: No bootstrap required, opened a new log
I20260709 13:08:24.106559 27862 ts_tablet_manager.cc:1403] T 8e758d59bd4a4eae9f67662e165013f9 P 665f7e09521a4c3f9284c1d8b0e094ff: Time spent bootstrapping tablet: real 0.037s	user 0.006s	sys 0.003s
I20260709 13:08:24.107507 27863 raft_consensus.cc:359] T 9e94954fc474414ba7563be776d6c80a P 41268b218b804905a110c86738e74400 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "41268b218b804905a110c86738e74400" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 44403 } } peers { permanent_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 38749 } } peers { permanent_uuid: "18435fbb525741328139e84a1e354954" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 40545 } }
I20260709 13:08:24.108198 27863 raft_consensus.cc:385] T 9e94954fc474414ba7563be776d6c80a P 41268b218b804905a110c86738e74400 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:24.108439 27863 raft_consensus.cc:740] T 9e94954fc474414ba7563be776d6c80a P 41268b218b804905a110c86738e74400 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 41268b218b804905a110c86738e74400, State: Initialized, Role: FOLLOWER
I20260709 13:08:24.109155 27863 consensus_queue.cc:260] T 9e94954fc474414ba7563be776d6c80a P 41268b218b804905a110c86738e74400 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "41268b218b804905a110c86738e74400" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 44403 } } peers { permanent_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 38749 } } peers { permanent_uuid: "18435fbb525741328139e84a1e354954" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 40545 } }
I20260709 13:08:24.109592 27903 leader_election.cc:290] T 8d1aa996b2034de7b2d77545de68e73c P 665f7e09521a4c3f9284c1d8b0e094ff [CANDIDATE]: Term 1 election: Requested vote from peers 18435fbb525741328139e84a1e354954 (127.17.223.4:40545), 2513a663afac495eb09126ff55e8b2b0 (127.17.223.1:40721)
I20260709 13:08:24.114465 27861 tablet_bootstrap.cc:492] T 8e758d59bd4a4eae9f67662e165013f9 P 2513a663afac495eb09126ff55e8b2b0: No bootstrap required, opened a new log
I20260709 13:08:24.114547 27593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d1aa996b2034de7b2d77545de68e73c" candidate_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2513a663afac495eb09126ff55e8b2b0"
I20260709 13:08:24.115248 27593 raft_consensus.cc:3060] T 8d1aa996b2034de7b2d77545de68e73c P 2513a663afac495eb09126ff55e8b2b0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:24.114985 27862 raft_consensus.cc:359] T 8e758d59bd4a4eae9f67662e165013f9 P 665f7e09521a4c3f9284c1d8b0e094ff [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2513a663afac495eb09126ff55e8b2b0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40721 } } peers { permanent_uuid: "41268b218b804905a110c86738e74400" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 44403 } } peers { permanent_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 38749 } }
I20260709 13:08:24.115983 27862 raft_consensus.cc:385] T 8e758d59bd4a4eae9f67662e165013f9 P 665f7e09521a4c3f9284c1d8b0e094ff [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:24.116326 27862 raft_consensus.cc:740] T 8e758d59bd4a4eae9f67662e165013f9 P 665f7e09521a4c3f9284c1d8b0e094ff [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 665f7e09521a4c3f9284c1d8b0e094ff, State: Initialized, Role: FOLLOWER
I20260709 13:08:24.115011 27861 ts_tablet_manager.cc:1403] T 8e758d59bd4a4eae9f67662e165013f9 P 2513a663afac495eb09126ff55e8b2b0: Time spent bootstrapping tablet: real 0.037s	user 0.009s	sys 0.001s
I20260709 13:08:24.120965 27861 raft_consensus.cc:359] T 8e758d59bd4a4eae9f67662e165013f9 P 2513a663afac495eb09126ff55e8b2b0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2513a663afac495eb09126ff55e8b2b0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40721 } } peers { permanent_uuid: "41268b218b804905a110c86738e74400" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 44403 } } peers { permanent_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 38749 } }
I20260709 13:08:24.121675 27861 raft_consensus.cc:385] T 8e758d59bd4a4eae9f67662e165013f9 P 2513a663afac495eb09126ff55e8b2b0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:24.114593 27863 ts_tablet_manager.cc:1434] T 9e94954fc474414ba7563be776d6c80a P 41268b218b804905a110c86738e74400: Time spent starting tablet: real 0.021s	user 0.006s	sys 0.001s
I20260709 13:08:24.124670 27863 tablet_bootstrap.cc:492] T 5a55d1bac7374ff6b83cc7bae2d3b1f3 P 41268b218b804905a110c86738e74400: Bootstrap starting.
I20260709 13:08:24.122692 27862 consensus_queue.cc:260] T 8e758d59bd4a4eae9f67662e165013f9 P 665f7e09521a4c3f9284c1d8b0e094ff [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2513a663afac495eb09126ff55e8b2b0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40721 } } peers { permanent_uuid: "41268b218b804905a110c86738e74400" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 44403 } } peers { permanent_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 38749 } }
I20260709 13:08:24.141443 27862 ts_tablet_manager.cc:1434] T 8e758d59bd4a4eae9f67662e165013f9 P 665f7e09521a4c3f9284c1d8b0e094ff: Time spent starting tablet: real 0.035s	user 0.008s	sys 0.000s
I20260709 13:08:24.140671 27861 raft_consensus.cc:740] T 8e758d59bd4a4eae9f67662e165013f9 P 2513a663afac495eb09126ff55e8b2b0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2513a663afac495eb09126ff55e8b2b0, State: Initialized, Role: FOLLOWER
I20260709 13:08:24.147607 27861 consensus_queue.cc:260] T 8e758d59bd4a4eae9f67662e165013f9 P 2513a663afac495eb09126ff55e8b2b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2513a663afac495eb09126ff55e8b2b0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40721 } } peers { permanent_uuid: "41268b218b804905a110c86738e74400" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 44403 } } peers { permanent_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 38749 } }
I20260709 13:08:24.149150 27815 raft_consensus.cc:2468] T 8d1aa996b2034de7b2d77545de68e73c P 18435fbb525741328139e84a1e354954 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 665f7e09521a4c3f9284c1d8b0e094ff in term 1.
I20260709 13:08:24.149681 27861 ts_tablet_manager.cc:1434] T 8e758d59bd4a4eae9f67662e165013f9 P 2513a663afac495eb09126ff55e8b2b0: Time spent starting tablet: real 0.032s	user 0.006s	sys 0.000s
I20260709 13:08:24.151158 27861 tablet_bootstrap.cc:492] T ae05961ab7a94458b1ad2cde9785c63b P 2513a663afac495eb09126ff55e8b2b0: Bootstrap starting.
I20260709 13:08:24.151216 27593 raft_consensus.cc:2468] T 8d1aa996b2034de7b2d77545de68e73c P 2513a663afac495eb09126ff55e8b2b0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 665f7e09521a4c3f9284c1d8b0e094ff in term 1.
I20260709 13:08:24.152633 27705 leader_election.cc:304] T 8d1aa996b2034de7b2d77545de68e73c P 665f7e09521a4c3f9284c1d8b0e094ff [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2513a663afac495eb09126ff55e8b2b0, 665f7e09521a4c3f9284c1d8b0e094ff; no voters: 
I20260709 13:08:24.153465 28158 raft_consensus.cc:2804] T 8d1aa996b2034de7b2d77545de68e73c P 665f7e09521a4c3f9284c1d8b0e094ff [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:08:24.153913 28158 raft_consensus.cc:697] T 8d1aa996b2034de7b2d77545de68e73c P 665f7e09521a4c3f9284c1d8b0e094ff [term 1 LEADER]: Becoming Leader. State: Replica: 665f7e09521a4c3f9284c1d8b0e094ff, State: Running, Role: LEADER
I20260709 13:08:24.154722 28158 consensus_queue.cc:237] T 8d1aa996b2034de7b2d77545de68e73c P 665f7e09521a4c3f9284c1d8b0e094ff [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 38749 } } peers { permanent_uuid: "18435fbb525741328139e84a1e354954" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 40545 } } peers { permanent_uuid: "2513a663afac495eb09126ff55e8b2b0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40721 } }
I20260709 13:08:24.161630 27862 tablet_bootstrap.cc:492] T 1c5e794c2a0a45fa99bcfde6aeb45d2e P 665f7e09521a4c3f9284c1d8b0e094ff: Bootstrap starting.
I20260709 13:08:24.165897 27863 tablet_bootstrap.cc:654] T 5a55d1bac7374ff6b83cc7bae2d3b1f3 P 41268b218b804905a110c86738e74400: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:24.174124 27903 raft_consensus.cc:493] T 8e0d496efc3f41f3be82a538ef3cfdac P 665f7e09521a4c3f9284c1d8b0e094ff [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:24.175172 27903 raft_consensus.cc:515] T 8e0d496efc3f41f3be82a538ef3cfdac P 665f7e09521a4c3f9284c1d8b0e094ff [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "41268b218b804905a110c86738e74400" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 44403 } } peers { permanent_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 38749 } } peers { permanent_uuid: "18435fbb525741328139e84a1e354954" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 40545 } }
I20260709 13:08:24.178310 27903 leader_election.cc:290] T 8e0d496efc3f41f3be82a538ef3cfdac P 665f7e09521a4c3f9284c1d8b0e094ff [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 41268b218b804905a110c86738e74400 (127.17.223.2:44403), 18435fbb525741328139e84a1e354954 (127.17.223.4:40545)
I20260709 13:08:24.179807 27668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e0d496efc3f41f3be82a538ef3cfdac" candidate_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "41268b218b804905a110c86738e74400" is_pre_election: true
I20260709 13:08:24.180653 27668 raft_consensus.cc:2468] T 8e0d496efc3f41f3be82a538ef3cfdac P 41268b218b804905a110c86738e74400 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 665f7e09521a4c3f9284c1d8b0e094ff in term 0.
I20260709 13:08:24.182542 27708 leader_election.cc:304] T 8e0d496efc3f41f3be82a538ef3cfdac P 665f7e09521a4c3f9284c1d8b0e094ff [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 41268b218b804905a110c86738e74400, 665f7e09521a4c3f9284c1d8b0e094ff; no voters: 
I20260709 13:08:24.185132 27861 tablet_bootstrap.cc:654] T ae05961ab7a94458b1ad2cde9785c63b P 2513a663afac495eb09126ff55e8b2b0: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:24.186025 28157 raft_consensus.cc:2804] T 8e0d496efc3f41f3be82a538ef3cfdac P 665f7e09521a4c3f9284c1d8b0e094ff [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:08:24.186976 27862 tablet_bootstrap.cc:654] T 1c5e794c2a0a45fa99bcfde6aeb45d2e P 665f7e09521a4c3f9284c1d8b0e094ff: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:24.186553 28157 raft_consensus.cc:493] T 8e0d496efc3f41f3be82a538ef3cfdac P 665f7e09521a4c3f9284c1d8b0e094ff [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:24.187934 28157 raft_consensus.cc:3060] T 8e0d496efc3f41f3be82a538ef3cfdac P 665f7e09521a4c3f9284c1d8b0e094ff [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:24.191262 27815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e0d496efc3f41f3be82a538ef3cfdac" candidate_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "18435fbb525741328139e84a1e354954" is_pre_election: true
W20260709 13:08:24.194867 27708 leader_election.cc:343] T 8e0d496efc3f41f3be82a538ef3cfdac P 665f7e09521a4c3f9284c1d8b0e094ff [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 18435fbb525741328139e84a1e354954 (127.17.223.4:40545): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:24.207108 28157 raft_consensus.cc:515] T 8e0d496efc3f41f3be82a538ef3cfdac P 665f7e09521a4c3f9284c1d8b0e094ff [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "41268b218b804905a110c86738e74400" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 44403 } } peers { permanent_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 38749 } } peers { permanent_uuid: "18435fbb525741328139e84a1e354954" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 40545 } }
I20260709 13:08:24.209750 27865 tablet_bootstrap.cc:492] T 1cd5e6e9b36d4591961cb379d7065be9 P 18435fbb525741328139e84a1e354954: No bootstrap required, opened a new log
I20260709 13:08:24.210431 27865 ts_tablet_manager.cc:1403] T 1cd5e6e9b36d4591961cb379d7065be9 P 18435fbb525741328139e84a1e354954: Time spent bootstrapping tablet: real 0.116s	user 0.029s	sys 0.075s
I20260709 13:08:24.210337 27668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e0d496efc3f41f3be82a538ef3cfdac" candidate_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "41268b218b804905a110c86738e74400"
I20260709 13:08:24.211179 27668 raft_consensus.cc:3060] T 8e0d496efc3f41f3be82a538ef3cfdac P 41268b218b804905a110c86738e74400 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:24.214622 27862 tablet_bootstrap.cc:492] T 1c5e794c2a0a45fa99bcfde6aeb45d2e P 665f7e09521a4c3f9284c1d8b0e094ff: No bootstrap required, opened a new log
I20260709 13:08:24.215167 27862 ts_tablet_manager.cc:1403] T 1c5e794c2a0a45fa99bcfde6aeb45d2e P 665f7e09521a4c3f9284c1d8b0e094ff: Time spent bootstrapping tablet: real 0.054s	user 0.007s	sys 0.011s
I20260709 13:08:24.220878 27862 raft_consensus.cc:359] T 1c5e794c2a0a45fa99bcfde6aeb45d2e P 665f7e09521a4c3f9284c1d8b0e094ff [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "41268b218b804905a110c86738e74400" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 44403 } } peers { permanent_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 38749 } } peers { permanent_uuid: "18435fbb525741328139e84a1e354954" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 40545 } }
I20260709 13:08:24.226066 27862 raft_consensus.cc:385] T 1c5e794c2a0a45fa99bcfde6aeb45d2e P 665f7e09521a4c3f9284c1d8b0e094ff [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:24.226454 27862 raft_consensus.cc:740] T 1c5e794c2a0a45fa99bcfde6aeb45d2e P 665f7e09521a4c3f9284c1d8b0e094ff [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 665f7e09521a4c3f9284c1d8b0e094ff, State: Initialized, Role: FOLLOWER
I20260709 13:08:24.228641 27862 consensus_queue.cc:260] T 1c5e794c2a0a45fa99bcfde6aeb45d2e P 665f7e09521a4c3f9284c1d8b0e094ff [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "41268b218b804905a110c86738e74400" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 44403 } } peers { permanent_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 38749 } } peers { permanent_uuid: "18435fbb525741328139e84a1e354954" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 40545 } }
I20260709 13:08:24.230396 27862 ts_tablet_manager.cc:1434] T 1c5e794c2a0a45fa99bcfde6aeb45d2e P 665f7e09521a4c3f9284c1d8b0e094ff: Time spent starting tablet: real 0.015s	user 0.010s	sys 0.000s
I20260709 13:08:24.231585 27862 tablet_bootstrap.cc:492] T 2d68b1be563949efbcb4bbe71eddd0d8 P 665f7e09521a4c3f9284c1d8b0e094ff: Bootstrap starting.
I20260709 13:08:24.231851 27865 raft_consensus.cc:359] T 1cd5e6e9b36d4591961cb379d7065be9 P 18435fbb525741328139e84a1e354954 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 38749 } } peers { permanent_uuid: "18435fbb525741328139e84a1e354954" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 40545 } } peers { permanent_uuid: "2513a663afac495eb09126ff55e8b2b0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40721 } }
I20260709 13:08:24.232712 27865 raft_consensus.cc:385] T 1cd5e6e9b36d4591961cb379d7065be9 P 18435fbb525741328139e84a1e354954 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:24.233152 27865 raft_consensus.cc:740] T 1cd5e6e9b36d4591961cb379d7065be9 P 18435fbb525741328139e84a1e354954 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 18435fbb525741328139e84a1e354954, State: Initialized, Role: FOLLOWER
I20260709 13:08:24.233732 27861 tablet_bootstrap.cc:492] T ae05961ab7a94458b1ad2cde9785c63b P 2513a663afac495eb09126ff55e8b2b0: No bootstrap required, opened a new log
I20260709 13:08:24.234274 27861 ts_tablet_manager.cc:1403] T ae05961ab7a94458b1ad2cde9785c63b P 2513a663afac495eb09126ff55e8b2b0: Time spent bootstrapping tablet: real 0.083s	user 0.012s	sys 0.007s
I20260709 13:08:24.233938 27865 consensus_queue.cc:260] T 1cd5e6e9b36d4591961cb379d7065be9 P 18435fbb525741328139e84a1e354954 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 38749 } } peers { permanent_uuid: "18435fbb525741328139e84a1e354954" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 40545 } } peers { permanent_uuid: "2513a663afac495eb09126ff55e8b2b0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40721 } }
I20260709 13:08:24.237123 27863 tablet_bootstrap.cc:492] T 5a55d1bac7374ff6b83cc7bae2d3b1f3 P 41268b218b804905a110c86738e74400: No bootstrap required, opened a new log
I20260709 13:08:24.237636 27863 ts_tablet_manager.cc:1403] T 5a55d1bac7374ff6b83cc7bae2d3b1f3 P 41268b218b804905a110c86738e74400: Time spent bootstrapping tablet: real 0.113s	user 0.011s	sys 0.004s
I20260709 13:08:24.238095 27865 ts_tablet_manager.cc:1434] T 1cd5e6e9b36d4591961cb379d7065be9 P 18435fbb525741328139e84a1e354954: Time spent starting tablet: real 0.027s	user 0.008s	sys 0.001s
I20260709 13:08:24.239420 27865 tablet_bootstrap.cc:492] T 8e0d496efc3f41f3be82a538ef3cfdac P 18435fbb525741328139e84a1e354954: Bootstrap starting.
I20260709 13:08:24.241050 27863 raft_consensus.cc:359] T 5a55d1bac7374ff6b83cc7bae2d3b1f3 P 41268b218b804905a110c86738e74400 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18435fbb525741328139e84a1e354954" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 40545 } } peers { permanent_uuid: "2513a663afac495eb09126ff55e8b2b0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40721 } } peers { permanent_uuid: "41268b218b804905a110c86738e74400" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 44403 } }
I20260709 13:08:24.241794 27863 raft_consensus.cc:385] T 5a55d1bac7374ff6b83cc7bae2d3b1f3 P 41268b218b804905a110c86738e74400 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:24.242060 27863 raft_consensus.cc:740] T 5a55d1bac7374ff6b83cc7bae2d3b1f3 P 41268b218b804905a110c86738e74400 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 41268b218b804905a110c86738e74400, State: Initialized, Role: FOLLOWER
I20260709 13:08:24.248474 27865 tablet_bootstrap.cc:654] T 8e0d496efc3f41f3be82a538ef3cfdac P 18435fbb525741328139e84a1e354954: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:24.248588 27862 tablet_bootstrap.cc:654] T 2d68b1be563949efbcb4bbe71eddd0d8 P 665f7e09521a4c3f9284c1d8b0e094ff: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:24.251911 27863 consensus_queue.cc:260] T 5a55d1bac7374ff6b83cc7bae2d3b1f3 P 41268b218b804905a110c86738e74400 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18435fbb525741328139e84a1e354954" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 40545 } } peers { permanent_uuid: "2513a663afac495eb09126ff55e8b2b0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40721 } } peers { permanent_uuid: "41268b218b804905a110c86738e74400" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 44403 } }
I20260709 13:08:24.254940 28157 leader_election.cc:290] T 8e0d496efc3f41f3be82a538ef3cfdac P 665f7e09521a4c3f9284c1d8b0e094ff [CANDIDATE]: Term 1 election: Requested vote from peers 41268b218b804905a110c86738e74400 (127.17.223.2:44403), 18435fbb525741328139e84a1e354954 (127.17.223.4:40545)
I20260709 13:08:24.252664 27488 catalog_manager.cc:5697] T 8d1aa996b2034de7b2d77545de68e73c P 665f7e09521a4c3f9284c1d8b0e094ff reported cstate change: term changed from 0 to 1, leader changed from <none> to 665f7e09521a4c3f9284c1d8b0e094ff (127.17.223.3). New cstate: current_term: 1 leader_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 38749 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "18435fbb525741328139e84a1e354954" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 40545 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2513a663afac495eb09126ff55e8b2b0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40721 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:24.254194 27815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e0d496efc3f41f3be82a538ef3cfdac" candidate_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "18435fbb525741328139e84a1e354954"
W20260709 13:08:24.257575 27708 leader_election.cc:343] T 8e0d496efc3f41f3be82a538ef3cfdac P 665f7e09521a4c3f9284c1d8b0e094ff [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 18435fbb525741328139e84a1e354954 (127.17.223.4:40545): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:24.255184 27668 raft_consensus.cc:2468] T 8e0d496efc3f41f3be82a538ef3cfdac P 41268b218b804905a110c86738e74400 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 665f7e09521a4c3f9284c1d8b0e094ff in term 1.
I20260709 13:08:24.262593 27708 leader_election.cc:304] T 8e0d496efc3f41f3be82a538ef3cfdac P 665f7e09521a4c3f9284c1d8b0e094ff [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 41268b218b804905a110c86738e74400, 665f7e09521a4c3f9284c1d8b0e094ff; no voters: 18435fbb525741328139e84a1e354954
I20260709 13:08:24.266351 28157 raft_consensus.cc:2804] T 8e0d496efc3f41f3be82a538ef3cfdac P 665f7e09521a4c3f9284c1d8b0e094ff [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:08:24.267180 28157 raft_consensus.cc:697] T 8e0d496efc3f41f3be82a538ef3cfdac P 665f7e09521a4c3f9284c1d8b0e094ff [term 1 LEADER]: Becoming Leader. State: Replica: 665f7e09521a4c3f9284c1d8b0e094ff, State: Running, Role: LEADER
I20260709 13:08:24.268592 27863 ts_tablet_manager.cc:1434] T 5a55d1bac7374ff6b83cc7bae2d3b1f3 P 41268b218b804905a110c86738e74400: Time spent starting tablet: real 0.031s	user 0.008s	sys 0.000s
I20260709 13:08:24.269726 27863 tablet_bootstrap.cc:492] T 585e960f8d0f42268f2fe98e1e7b83f0 P 41268b218b804905a110c86738e74400: Bootstrap starting.
I20260709 13:08:24.268057 28157 consensus_queue.cc:237] T 8e0d496efc3f41f3be82a538ef3cfdac P 665f7e09521a4c3f9284c1d8b0e094ff [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "41268b218b804905a110c86738e74400" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 44403 } } peers { permanent_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 38749 } } peers { permanent_uuid: "18435fbb525741328139e84a1e354954" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 40545 } }
I20260709 13:08:24.247532 27861 raft_consensus.cc:359] T ae05961ab7a94458b1ad2cde9785c63b P 2513a663afac495eb09126ff55e8b2b0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 38749 } } peers { permanent_uuid: "18435fbb525741328139e84a1e354954" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 40545 } } peers { permanent_uuid: "2513a663afac495eb09126ff55e8b2b0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40721 } }
I20260709 13:08:24.274904 27861 raft_consensus.cc:385] T ae05961ab7a94458b1ad2cde9785c63b P 2513a663afac495eb09126ff55e8b2b0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:24.275213 27861 raft_consensus.cc:740] T ae05961ab7a94458b1ad2cde9785c63b P 2513a663afac495eb09126ff55e8b2b0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2513a663afac495eb09126ff55e8b2b0, State: Initialized, Role: FOLLOWER
I20260709 13:08:24.280011 27861 consensus_queue.cc:260] T ae05961ab7a94458b1ad2cde9785c63b P 2513a663afac495eb09126ff55e8b2b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 38749 } } peers { permanent_uuid: "18435fbb525741328139e84a1e354954" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 40545 } } peers { permanent_uuid: "2513a663afac495eb09126ff55e8b2b0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40721 } }
I20260709 13:08:24.289508 28013 raft_consensus.cc:493] T 1cd5e6e9b36d4591961cb379d7065be9 P 18435fbb525741328139e84a1e354954 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:24.290066 28013 raft_consensus.cc:515] T 1cd5e6e9b36d4591961cb379d7065be9 P 18435fbb525741328139e84a1e354954 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 38749 } } peers { permanent_uuid: "18435fbb525741328139e84a1e354954" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 40545 } } peers { permanent_uuid: "2513a663afac495eb09126ff55e8b2b0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40721 } }
I20260709 13:08:24.292280 28013 leader_election.cc:290] T 1cd5e6e9b36d4591961cb379d7065be9 P 18435fbb525741328139e84a1e354954 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 665f7e09521a4c3f9284c1d8b0e094ff (127.17.223.3:38749), 2513a663afac495eb09126ff55e8b2b0 (127.17.223.1:40721)
I20260709 13:08:24.295357 27740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cd5e6e9b36d4591961cb379d7065be9" candidate_uuid: "18435fbb525741328139e84a1e354954" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" is_pre_election: true
I20260709 13:08:24.295810 27593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cd5e6e9b36d4591961cb379d7065be9" candidate_uuid: "18435fbb525741328139e84a1e354954" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2513a663afac495eb09126ff55e8b2b0" is_pre_election: true
I20260709 13:08:24.296591 27593 raft_consensus.cc:2393] T 1cd5e6e9b36d4591961cb379d7065be9 P 2513a663afac495eb09126ff55e8b2b0 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 18435fbb525741328139e84a1e354954 in current term 1: Already voted for candidate 665f7e09521a4c3f9284c1d8b0e094ff in this term.
I20260709 13:08:24.297947 27779 leader_election.cc:304] T 1cd5e6e9b36d4591961cb379d7065be9 P 18435fbb525741328139e84a1e354954 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 18435fbb525741328139e84a1e354954; no voters: 2513a663afac495eb09126ff55e8b2b0, 665f7e09521a4c3f9284c1d8b0e094ff
I20260709 13:08:24.299062 28013 raft_consensus.cc:3060] T 1cd5e6e9b36d4591961cb379d7065be9 P 18435fbb525741328139e84a1e354954 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:24.298969 28158 consensus_queue.cc:1048] T 85cdd21b7a5f4db7af44327c57c16d43 P 665f7e09521a4c3f9284c1d8b0e094ff [LEADER]: Connected to new peer: Peer: permanent_uuid: "41268b218b804905a110c86738e74400" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 44403 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:08:24.304857 27862 tablet_bootstrap.cc:492] T 2d68b1be563949efbcb4bbe71eddd0d8 P 665f7e09521a4c3f9284c1d8b0e094ff: No bootstrap required, opened a new log
I20260709 13:08:24.305413 27862 ts_tablet_manager.cc:1403] T 2d68b1be563949efbcb4bbe71eddd0d8 P 665f7e09521a4c3f9284c1d8b0e094ff: Time spent bootstrapping tablet: real 0.074s	user 0.013s	sys 0.009s
I20260709 13:08:24.305670 27903 consensus_queue.cc:1048] T 85cdd21b7a5f4db7af44327c57c16d43 P 665f7e09521a4c3f9284c1d8b0e094ff [LEADER]: Connected to new peer: Peer: permanent_uuid: "2513a663afac495eb09126ff55e8b2b0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40721 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:08:24.306651 28136 raft_consensus.cc:493] T ea92a607c73b4d289d081146089a86f9 P 41268b218b804905a110c86738e74400 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:24.307176 28136 raft_consensus.cc:515] T ea92a607c73b4d289d081146089a86f9 P 41268b218b804905a110c86738e74400 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2513a663afac495eb09126ff55e8b2b0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40721 } } peers { permanent_uuid: "41268b218b804905a110c86738e74400" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 44403 } } peers { permanent_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 38749 } }
I20260709 13:08:24.308609 27862 raft_consensus.cc:359] T 2d68b1be563949efbcb4bbe71eddd0d8 P 665f7e09521a4c3f9284c1d8b0e094ff [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 38749 } } peers { permanent_uuid: "18435fbb525741328139e84a1e354954" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 40545 } } peers { permanent_uuid: "2513a663afac495eb09126ff55e8b2b0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40721 } }
I20260709 13:08:24.309295 27862 raft_consensus.cc:385] T 2d68b1be563949efbcb4bbe71eddd0d8 P 665f7e09521a4c3f9284c1d8b0e094ff [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:24.309582 27862 raft_consensus.cc:740] T 2d68b1be563949efbcb4bbe71eddd0d8 P 665f7e09521a4c3f9284c1d8b0e094ff [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 665f7e09521a4c3f9284c1d8b0e094ff, State: Initialized, Role: FOLLOWER
I20260709 13:08:24.310043 28136 leader_election.cc:290] T ea92a607c73b4d289d081146089a86f9 P 41268b218b804905a110c86738e74400 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2513a663afac495eb09126ff55e8b2b0 (127.17.223.1:40721), 665f7e09521a4c3f9284c1d8b0e094ff (127.17.223.3:38749)
I20260709 13:08:24.309926 27589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea92a607c73b4d289d081146089a86f9" candidate_uuid: "41268b218b804905a110c86738e74400" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2513a663afac495eb09126ff55e8b2b0" is_pre_election: true
I20260709 13:08:24.310844 27740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea92a607c73b4d289d081146089a86f9" candidate_uuid: "41268b218b804905a110c86738e74400" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" is_pre_election: true
W20260709 13:08:24.311691 27631 leader_election.cc:343] T ea92a607c73b4d289d081146089a86f9 P 41268b218b804905a110c86738e74400 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2513a663afac495eb09126ff55e8b2b0 (127.17.223.1:40721): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:08:24.312487 27634 leader_election.cc:343] T ea92a607c73b4d289d081146089a86f9 P 41268b218b804905a110c86738e74400 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 665f7e09521a4c3f9284c1d8b0e094ff (127.17.223.3:38749): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:24.312894 27634 leader_election.cc:304] T ea92a607c73b4d289d081146089a86f9 P 41268b218b804905a110c86738e74400 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 41268b218b804905a110c86738e74400; no voters: 2513a663afac495eb09126ff55e8b2b0, 665f7e09521a4c3f9284c1d8b0e094ff
I20260709 13:08:24.314200 28139 raft_consensus.cc:2749] T ea92a607c73b4d289d081146089a86f9 P 41268b218b804905a110c86738e74400 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:08:24.314635 28013 raft_consensus.cc:2749] T 1cd5e6e9b36d4591961cb379d7065be9 P 18435fbb525741328139e84a1e354954 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:08:24.317607 27861 ts_tablet_manager.cc:1434] T ae05961ab7a94458b1ad2cde9785c63b P 2513a663afac495eb09126ff55e8b2b0: Time spent starting tablet: real 0.083s	user 0.004s	sys 0.004s
I20260709 13:08:24.318709 27861 tablet_bootstrap.cc:492] T 2d994cb13f8f453284bcb1f8b85824a2 P 2513a663afac495eb09126ff55e8b2b0: Bootstrap starting.
I20260709 13:08:24.321419 27862 consensus_queue.cc:260] T 2d68b1be563949efbcb4bbe71eddd0d8 P 665f7e09521a4c3f9284c1d8b0e094ff [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 38749 } } peers { permanent_uuid: "18435fbb525741328139e84a1e354954" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 40545 } } peers { permanent_uuid: "2513a663afac495eb09126ff55e8b2b0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40721 } }
I20260709 13:08:24.325476 27862 ts_tablet_manager.cc:1434] T 2d68b1be563949efbcb4bbe71eddd0d8 P 665f7e09521a4c3f9284c1d8b0e094ff: Time spent starting tablet: real 0.020s	user 0.006s	sys 0.002s
I20260709 13:08:24.326747 27862 tablet_bootstrap.cc:492] T ae05961ab7a94458b1ad2cde9785c63b P 665f7e09521a4c3f9284c1d8b0e094ff: Bootstrap starting.
I20260709 13:08:24.348905 27863 tablet_bootstrap.cc:654] T 585e960f8d0f42268f2fe98e1e7b83f0 P 41268b218b804905a110c86738e74400: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:24.379014 27488 catalog_manager.cc:5697] T 8e0d496efc3f41f3be82a538ef3cfdac P 665f7e09521a4c3f9284c1d8b0e094ff reported cstate change: term changed from 0 to 1, leader changed from <none> to 665f7e09521a4c3f9284c1d8b0e094ff (127.17.223.3). New cstate: current_term: 1 leader_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "41268b218b804905a110c86738e74400" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 44403 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 38749 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "18435fbb525741328139e84a1e354954" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 40545 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:24.385754 28136 raft_consensus.cc:493] T 5a55d1bac7374ff6b83cc7bae2d3b1f3 P 41268b218b804905a110c86738e74400 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:24.386318 28136 raft_consensus.cc:515] T 5a55d1bac7374ff6b83cc7bae2d3b1f3 P 41268b218b804905a110c86738e74400 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18435fbb525741328139e84a1e354954" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 40545 } } peers { permanent_uuid: "2513a663afac495eb09126ff55e8b2b0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40721 } } peers { permanent_uuid: "41268b218b804905a110c86738e74400" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 44403 } }
I20260709 13:08:24.389928 27593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a55d1bac7374ff6b83cc7bae2d3b1f3" candidate_uuid: "41268b218b804905a110c86738e74400" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2513a663afac495eb09126ff55e8b2b0" is_pre_election: true
W20260709 13:08:24.391353 27631 leader_election.cc:343] T 5a55d1bac7374ff6b83cc7bae2d3b1f3 P 41268b218b804905a110c86738e74400 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2513a663afac495eb09126ff55e8b2b0 (127.17.223.1:40721): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:24.393738 27862 tablet_bootstrap.cc:654] T ae05961ab7a94458b1ad2cde9785c63b P 665f7e09521a4c3f9284c1d8b0e094ff: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:24.393517 27814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a55d1bac7374ff6b83cc7bae2d3b1f3" candidate_uuid: "41268b218b804905a110c86738e74400" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "18435fbb525741328139e84a1e354954" is_pre_election: true
I20260709 13:08:24.394529 28136 leader_election.cc:290] T 5a55d1bac7374ff6b83cc7bae2d3b1f3 P 41268b218b804905a110c86738e74400 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 18435fbb525741328139e84a1e354954 (127.17.223.4:40545), 2513a663afac495eb09126ff55e8b2b0 (127.17.223.1:40721)
W20260709 13:08:24.395560 27634 leader_election.cc:343] T 5a55d1bac7374ff6b83cc7bae2d3b1f3 P 41268b218b804905a110c86738e74400 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 18435fbb525741328139e84a1e354954 (127.17.223.4:40545): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:24.396037 27634 leader_election.cc:304] T 5a55d1bac7374ff6b83cc7bae2d3b1f3 P 41268b218b804905a110c86738e74400 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 41268b218b804905a110c86738e74400; no voters: 18435fbb525741328139e84a1e354954, 2513a663afac495eb09126ff55e8b2b0
I20260709 13:08:24.397774 27861 tablet_bootstrap.cc:654] T 2d994cb13f8f453284bcb1f8b85824a2 P 2513a663afac495eb09126ff55e8b2b0: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:24.399053 27865 tablet_bootstrap.cc:492] T 8e0d496efc3f41f3be82a538ef3cfdac P 18435fbb525741328139e84a1e354954: No bootstrap required, opened a new log
I20260709 13:08:24.399710 27865 ts_tablet_manager.cc:1403] T 8e0d496efc3f41f3be82a538ef3cfdac P 18435fbb525741328139e84a1e354954: Time spent bootstrapping tablet: real 0.160s	user 0.063s	sys 0.069s
I20260709 13:08:24.403455 27865 raft_consensus.cc:359] T 8e0d496efc3f41f3be82a538ef3cfdac P 18435fbb525741328139e84a1e354954 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "41268b218b804905a110c86738e74400" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 44403 } } peers { permanent_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 38749 } } peers { permanent_uuid: "18435fbb525741328139e84a1e354954" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 40545 } }
I20260709 13:08:24.404263 28136 raft_consensus.cc:2749] T 5a55d1bac7374ff6b83cc7bae2d3b1f3 P 41268b218b804905a110c86738e74400 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:08:24.408699 27863 tablet_bootstrap.cc:492] T 585e960f8d0f42268f2fe98e1e7b83f0 P 41268b218b804905a110c86738e74400: No bootstrap required, opened a new log
I20260709 13:08:24.404381 27865 raft_consensus.cc:385] T 8e0d496efc3f41f3be82a538ef3cfdac P 18435fbb525741328139e84a1e354954 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:24.409222 27863 ts_tablet_manager.cc:1403] T 585e960f8d0f42268f2fe98e1e7b83f0 P 41268b218b804905a110c86738e74400: Time spent bootstrapping tablet: real 0.140s	user 0.017s	sys 0.004s
I20260709 13:08:24.409178 27865 raft_consensus.cc:740] T 8e0d496efc3f41f3be82a538ef3cfdac P 18435fbb525741328139e84a1e354954 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 18435fbb525741328139e84a1e354954, State: Initialized, Role: FOLLOWER
I20260709 13:08:24.410131 27865 consensus_queue.cc:260] T 8e0d496efc3f41f3be82a538ef3cfdac P 18435fbb525741328139e84a1e354954 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "41268b218b804905a110c86738e74400" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 44403 } } peers { permanent_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 38749 } } peers { permanent_uuid: "18435fbb525741328139e84a1e354954" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 40545 } }
I20260709 13:08:24.412325 27865 ts_tablet_manager.cc:1434] T 8e0d496efc3f41f3be82a538ef3cfdac P 18435fbb525741328139e84a1e354954: Time spent starting tablet: real 0.012s	user 0.008s	sys 0.000s
I20260709 13:08:24.413486 27865 tablet_bootstrap.cc:492] T 5a55d1bac7374ff6b83cc7bae2d3b1f3 P 18435fbb525741328139e84a1e354954: Bootstrap starting.
I20260709 13:08:24.413751 28082 consensus_queue.cc:1048] T 1cd5e6e9b36d4591961cb379d7065be9 P 665f7e09521a4c3f9284c1d8b0e094ff [LEADER]: Connected to new peer: Peer: permanent_uuid: "2513a663afac495eb09126ff55e8b2b0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40721 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:08:24.414225 27863 raft_consensus.cc:359] T 585e960f8d0f42268f2fe98e1e7b83f0 P 41268b218b804905a110c86738e74400 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2513a663afac495eb09126ff55e8b2b0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40721 } } peers { permanent_uuid: "41268b218b804905a110c86738e74400" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 44403 } } peers { permanent_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 38749 } }
I20260709 13:08:24.414940 27863 raft_consensus.cc:385] T 585e960f8d0f42268f2fe98e1e7b83f0 P 41268b218b804905a110c86738e74400 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:24.415189 27863 raft_consensus.cc:740] T 585e960f8d0f42268f2fe98e1e7b83f0 P 41268b218b804905a110c86738e74400 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 41268b218b804905a110c86738e74400, State: Initialized, Role: FOLLOWER
I20260709 13:08:24.415830 27863 consensus_queue.cc:260] T 585e960f8d0f42268f2fe98e1e7b83f0 P 41268b218b804905a110c86738e74400 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2513a663afac495eb09126ff55e8b2b0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40721 } } peers { permanent_uuid: "41268b218b804905a110c86738e74400" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 44403 } } peers { permanent_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 38749 } }
I20260709 13:08:24.418023 27863 ts_tablet_manager.cc:1434] T 585e960f8d0f42268f2fe98e1e7b83f0 P 41268b218b804905a110c86738e74400: Time spent starting tablet: real 0.006s	user 0.003s	sys 0.000s
I20260709 13:08:24.418992 27863 tablet_bootstrap.cc:492] T afcb3b39d1c9495eab95404687865537 P 41268b218b804905a110c86738e74400: Bootstrap starting.
I20260709 13:08:24.419761 27865 tablet_bootstrap.cc:654] T 5a55d1bac7374ff6b83cc7bae2d3b1f3 P 18435fbb525741328139e84a1e354954: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:24.425221 27863 tablet_bootstrap.cc:654] T afcb3b39d1c9495eab95404687865537 P 41268b218b804905a110c86738e74400: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:24.438544 28082 raft_consensus.cc:493] T 2d68b1be563949efbcb4bbe71eddd0d8 P 665f7e09521a4c3f9284c1d8b0e094ff [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:24.439247 28082 raft_consensus.cc:515] T 2d68b1be563949efbcb4bbe71eddd0d8 P 665f7e09521a4c3f9284c1d8b0e094ff [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 38749 } } peers { permanent_uuid: "18435fbb525741328139e84a1e354954" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 40545 } } peers { permanent_uuid: "2513a663afac495eb09126ff55e8b2b0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40721 } }
I20260709 13:08:24.444012 27814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d68b1be563949efbcb4bbe71eddd0d8" candidate_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "18435fbb525741328139e84a1e354954" is_pre_election: true
I20260709 13:08:24.444202 27593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d68b1be563949efbcb4bbe71eddd0d8" candidate_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2513a663afac495eb09126ff55e8b2b0" is_pre_election: true
W20260709 13:08:24.445638 27705 leader_election.cc:343] T 2d68b1be563949efbcb4bbe71eddd0d8 P 665f7e09521a4c3f9284c1d8b0e094ff [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2513a663afac495eb09126ff55e8b2b0 (127.17.223.1:40721): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:24.446177 28082 leader_election.cc:290] T 2d68b1be563949efbcb4bbe71eddd0d8 P 665f7e09521a4c3f9284c1d8b0e094ff [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 18435fbb525741328139e84a1e354954 (127.17.223.4:40545), 2513a663afac495eb09126ff55e8b2b0 (127.17.223.1:40721)
W20260709 13:08:24.450924 27708 leader_election.cc:343] T 2d68b1be563949efbcb4bbe71eddd0d8 P 665f7e09521a4c3f9284c1d8b0e094ff [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 18435fbb525741328139e84a1e354954 (127.17.223.4:40545): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:24.451455 27708 leader_election.cc:304] T 2d68b1be563949efbcb4bbe71eddd0d8 P 665f7e09521a4c3f9284c1d8b0e094ff [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 665f7e09521a4c3f9284c1d8b0e094ff; no voters: 18435fbb525741328139e84a1e354954, 2513a663afac495eb09126ff55e8b2b0
I20260709 13:08:24.452167 28082 raft_consensus.cc:2749] T 2d68b1be563949efbcb4bbe71eddd0d8 P 665f7e09521a4c3f9284c1d8b0e094ff [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:08:24.463013 28139 raft_consensus.cc:493] T 1c5e794c2a0a45fa99bcfde6aeb45d2e P 41268b218b804905a110c86738e74400 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:24.463969 27865 tablet_bootstrap.cc:492] T 5a55d1bac7374ff6b83cc7bae2d3b1f3 P 18435fbb525741328139e84a1e354954: No bootstrap required, opened a new log
I20260709 13:08:24.463621 28139 raft_consensus.cc:515] T 1c5e794c2a0a45fa99bcfde6aeb45d2e P 41268b218b804905a110c86738e74400 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "41268b218b804905a110c86738e74400" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 44403 } } peers { permanent_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 38749 } } peers { permanent_uuid: "18435fbb525741328139e84a1e354954" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 40545 } }
I20260709 13:08:24.466444 28139 leader_election.cc:290] T 1c5e794c2a0a45fa99bcfde6aeb45d2e P 41268b218b804905a110c86738e74400 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 665f7e09521a4c3f9284c1d8b0e094ff (127.17.223.3:38749), 18435fbb525741328139e84a1e354954 (127.17.223.4:40545)
I20260709 13:08:24.469429 27740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c5e794c2a0a45fa99bcfde6aeb45d2e" candidate_uuid: "41268b218b804905a110c86738e74400" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" is_pre_election: true
I20260709 13:08:24.470165 27740 raft_consensus.cc:2468] T 1c5e794c2a0a45fa99bcfde6aeb45d2e P 665f7e09521a4c3f9284c1d8b0e094ff [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 41268b218b804905a110c86738e74400 in term 0.
I20260709 13:08:24.471580 27865 ts_tablet_manager.cc:1403] T 5a55d1bac7374ff6b83cc7bae2d3b1f3 P 18435fbb525741328139e84a1e354954: Time spent bootstrapping tablet: real 0.058s	user 0.008s	sys 0.005s
I20260709 13:08:24.471700 27634 leader_election.cc:304] T 1c5e794c2a0a45fa99bcfde6aeb45d2e P 41268b218b804905a110c86738e74400 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 41268b218b804905a110c86738e74400, 665f7e09521a4c3f9284c1d8b0e094ff; no voters: 
I20260709 13:08:24.472791 28139 raft_consensus.cc:2804] T 1c5e794c2a0a45fa99bcfde6aeb45d2e P 41268b218b804905a110c86738e74400 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:08:24.473204 28139 raft_consensus.cc:493] T 1c5e794c2a0a45fa99bcfde6aeb45d2e P 41268b218b804905a110c86738e74400 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:24.474398 28139 raft_consensus.cc:3060] T 1c5e794c2a0a45fa99bcfde6aeb45d2e P 41268b218b804905a110c86738e74400 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:24.476320 28082 raft_consensus.cc:493] T 8e758d59bd4a4eae9f67662e165013f9 P 665f7e09521a4c3f9284c1d8b0e094ff [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:24.476794 28082 raft_consensus.cc:515] T 8e758d59bd4a4eae9f67662e165013f9 P 665f7e09521a4c3f9284c1d8b0e094ff [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2513a663afac495eb09126ff55e8b2b0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40721 } } peers { permanent_uuid: "41268b218b804905a110c86738e74400" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 44403 } } peers { permanent_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 38749 } }
I20260709 13:08:24.478830 28082 leader_election.cc:290] T 8e758d59bd4a4eae9f67662e165013f9 P 665f7e09521a4c3f9284c1d8b0e094ff [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2513a663afac495eb09126ff55e8b2b0 (127.17.223.1:40721), 41268b218b804905a110c86738e74400 (127.17.223.2:44403)
I20260709 13:08:24.479737 27593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e758d59bd4a4eae9f67662e165013f9" candidate_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2513a663afac495eb09126ff55e8b2b0" is_pre_election: true
I20260709 13:08:24.480315 27666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e758d59bd4a4eae9f67662e165013f9" candidate_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "41268b218b804905a110c86738e74400" is_pre_election: true
I20260709 13:08:24.480460 27593 raft_consensus.cc:2468] T 8e758d59bd4a4eae9f67662e165013f9 P 2513a663afac495eb09126ff55e8b2b0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 665f7e09521a4c3f9284c1d8b0e094ff in term 0.
I20260709 13:08:24.480958 27666 raft_consensus.cc:2468] T 8e758d59bd4a4eae9f67662e165013f9 P 41268b218b804905a110c86738e74400 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 665f7e09521a4c3f9284c1d8b0e094ff in term 0.
I20260709 13:08:24.468590 27814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c5e794c2a0a45fa99bcfde6aeb45d2e" candidate_uuid: "41268b218b804905a110c86738e74400" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "18435fbb525741328139e84a1e354954" is_pre_election: true
I20260709 13:08:24.481848 27705 leader_election.cc:304] T 8e758d59bd4a4eae9f67662e165013f9 P 665f7e09521a4c3f9284c1d8b0e094ff [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2513a663afac495eb09126ff55e8b2b0, 665f7e09521a4c3f9284c1d8b0e094ff; no voters: 
I20260709 13:08:24.482692 28082 raft_consensus.cc:2804] T 8e758d59bd4a4eae9f67662e165013f9 P 665f7e09521a4c3f9284c1d8b0e094ff [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:08:24.483057 28082 raft_consensus.cc:493] T 8e758d59bd4a4eae9f67662e165013f9 P 665f7e09521a4c3f9284c1d8b0e094ff [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:24.483392 28082 raft_consensus.cc:3060] T 8e758d59bd4a4eae9f67662e165013f9 P 665f7e09521a4c3f9284c1d8b0e094ff [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:24.484694 27870 consensus_queue.cc:1048] T 3a7da70e9f0f49a9bf60184a8f0b5339 P 2513a663afac495eb09126ff55e8b2b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "41268b218b804905a110c86738e74400" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 44403 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:08:24.467849 27861 tablet_bootstrap.cc:492] T 2d994cb13f8f453284bcb1f8b85824a2 P 2513a663afac495eb09126ff55e8b2b0: No bootstrap required, opened a new log
I20260709 13:08:24.486969 27861 ts_tablet_manager.cc:1403] T 2d994cb13f8f453284bcb1f8b85824a2 P 2513a663afac495eb09126ff55e8b2b0: Time spent bootstrapping tablet: real 0.169s	user 0.015s	sys 0.006s
I20260709 13:08:24.489686 27861 raft_consensus.cc:359] T 2d994cb13f8f453284bcb1f8b85824a2 P 2513a663afac495eb09126ff55e8b2b0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18435fbb525741328139e84a1e354954" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 40545 } } peers { permanent_uuid: "2513a663afac495eb09126ff55e8b2b0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40721 } } peers { permanent_uuid: "41268b218b804905a110c86738e74400" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 44403 } }
I20260709 13:08:24.492483 27861 raft_consensus.cc:385] T 2d994cb13f8f453284bcb1f8b85824a2 P 2513a663afac495eb09126ff55e8b2b0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:24.492838 27861 raft_consensus.cc:740] T 2d994cb13f8f453284bcb1f8b85824a2 P 2513a663afac495eb09126ff55e8b2b0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2513a663afac495eb09126ff55e8b2b0, State: Initialized, Role: FOLLOWER
I20260709 13:08:24.492978 27863 tablet_bootstrap.cc:492] T afcb3b39d1c9495eab95404687865537 P 41268b218b804905a110c86738e74400: No bootstrap required, opened a new log
I20260709 13:08:24.493487 27863 ts_tablet_manager.cc:1403] T afcb3b39d1c9495eab95404687865537 P 41268b218b804905a110c86738e74400: Time spent bootstrapping tablet: real 0.075s	user 0.021s	sys 0.029s
I20260709 13:08:24.493757 27861 consensus_queue.cc:260] T 2d994cb13f8f453284bcb1f8b85824a2 P 2513a663afac495eb09126ff55e8b2b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18435fbb525741328139e84a1e354954" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 40545 } } peers { permanent_uuid: "2513a663afac495eb09126ff55e8b2b0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40721 } } peers { permanent_uuid: "41268b218b804905a110c86738e74400" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 44403 } }
I20260709 13:08:24.496512 27861 ts_tablet_manager.cc:1434] T 2d994cb13f8f453284bcb1f8b85824a2 P 2513a663afac495eb09126ff55e8b2b0: Time spent starting tablet: real 0.009s	user 0.005s	sys 0.000s
W20260709 13:08:24.490957 27634 leader_election.cc:343] T 1c5e794c2a0a45fa99bcfde6aeb45d2e P 41268b218b804905a110c86738e74400 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 18435fbb525741328139e84a1e354954 (127.17.223.4:40545): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:24.490147 28082 raft_consensus.cc:515] T 8e758d59bd4a4eae9f67662e165013f9 P 665f7e09521a4c3f9284c1d8b0e094ff [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2513a663afac495eb09126ff55e8b2b0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40721 } } peers { permanent_uuid: "41268b218b804905a110c86738e74400" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 44403 } } peers { permanent_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 38749 } }
I20260709 13:08:24.512632 27861 tablet_bootstrap.cc:492] T ea92a607c73b4d289d081146089a86f9 P 2513a663afac495eb09126ff55e8b2b0: Bootstrap starting.
I20260709 13:08:24.514133 28082 leader_election.cc:290] T 8e758d59bd4a4eae9f67662e165013f9 P 665f7e09521a4c3f9284c1d8b0e094ff [CANDIDATE]: Term 1 election: Requested vote from peers 2513a663afac495eb09126ff55e8b2b0 (127.17.223.1:40721), 41268b218b804905a110c86738e74400 (127.17.223.2:44403)
I20260709 13:08:24.496254 27863 raft_consensus.cc:359] T afcb3b39d1c9495eab95404687865537 P 41268b218b804905a110c86738e74400 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "41268b218b804905a110c86738e74400" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 44403 } } peers { permanent_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 38749 } } peers { permanent_uuid: "18435fbb525741328139e84a1e354954" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 40545 } }
I20260709 13:08:24.480836 27865 raft_consensus.cc:359] T 5a55d1bac7374ff6b83cc7bae2d3b1f3 P 18435fbb525741328139e84a1e354954 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18435fbb525741328139e84a1e354954" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 40545 } } peers { permanent_uuid: "2513a663afac495eb09126ff55e8b2b0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40721 } } peers { permanent_uuid: "41268b218b804905a110c86738e74400" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 44403 } }
I20260709 13:08:24.497172 28136 raft_consensus.cc:493] T 9e94954fc474414ba7563be776d6c80a P 41268b218b804905a110c86738e74400 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:24.514991 27863 raft_consensus.cc:385] T afcb3b39d1c9495eab95404687865537 P 41268b218b804905a110c86738e74400 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:24.515328 27863 raft_consensus.cc:740] T afcb3b39d1c9495eab95404687865537 P 41268b218b804905a110c86738e74400 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 41268b218b804905a110c86738e74400, State: Initialized, Role: FOLLOWER
I20260709 13:08:24.515208 28136 raft_consensus.cc:515] T 9e94954fc474414ba7563be776d6c80a P 41268b218b804905a110c86738e74400 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "41268b218b804905a110c86738e74400" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 44403 } } peers { permanent_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 38749 } } peers { permanent_uuid: "18435fbb525741328139e84a1e354954" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 40545 } }
I20260709 13:08:24.515898 27589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e758d59bd4a4eae9f67662e165013f9" candidate_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2513a663afac495eb09126ff55e8b2b0"
I20260709 13:08:24.516085 27863 consensus_queue.cc:260] T afcb3b39d1c9495eab95404687865537 P 41268b218b804905a110c86738e74400 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "41268b218b804905a110c86738e74400" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 44403 } } peers { permanent_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 38749 } } peers { permanent_uuid: "18435fbb525741328139e84a1e354954" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 40545 } }
I20260709 13:08:24.516554 27589 raft_consensus.cc:3060] T 8e758d59bd4a4eae9f67662e165013f9 P 2513a663afac495eb09126ff55e8b2b0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:24.517392 28136 leader_election.cc:290] T 9e94954fc474414ba7563be776d6c80a P 41268b218b804905a110c86738e74400 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 665f7e09521a4c3f9284c1d8b0e094ff (127.17.223.3:38749), 18435fbb525741328139e84a1e354954 (127.17.223.4:40545)
I20260709 13:08:24.519026 27863 ts_tablet_manager.cc:1434] T afcb3b39d1c9495eab95404687865537 P 41268b218b804905a110c86738e74400: Time spent starting tablet: real 0.025s	user 0.007s	sys 0.001s
I20260709 13:08:24.504454 28013 raft_consensus.cc:493] T 3a7da70e9f0f49a9bf60184a8f0b5339 P 18435fbb525741328139e84a1e354954 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:24.519536 27865 raft_consensus.cc:385] T 5a55d1bac7374ff6b83cc7bae2d3b1f3 P 18435fbb525741328139e84a1e354954 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:24.519469 28013 raft_consensus.cc:515] T 3a7da70e9f0f49a9bf60184a8f0b5339 P 18435fbb525741328139e84a1e354954 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18435fbb525741328139e84a1e354954" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 40545 } } peers { permanent_uuid: "2513a663afac495eb09126ff55e8b2b0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40721 } } peers { permanent_uuid: "41268b218b804905a110c86738e74400" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 44403 } }
I20260709 13:08:24.519948 27865 raft_consensus.cc:740] T 5a55d1bac7374ff6b83cc7bae2d3b1f3 P 18435fbb525741328139e84a1e354954 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 18435fbb525741328139e84a1e354954, State: Initialized, Role: FOLLOWER
I20260709 13:08:24.498087 27862 tablet_bootstrap.cc:492] T ae05961ab7a94458b1ad2cde9785c63b P 665f7e09521a4c3f9284c1d8b0e094ff: No bootstrap required, opened a new log
I20260709 13:08:24.518878 27815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e94954fc474414ba7563be776d6c80a" candidate_uuid: "41268b218b804905a110c86738e74400" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "18435fbb525741328139e84a1e354954" is_pre_election: true
I20260709 13:08:24.521711 28013 leader_election.cc:290] T 3a7da70e9f0f49a9bf60184a8f0b5339 P 18435fbb525741328139e84a1e354954 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2513a663afac495eb09126ff55e8b2b0 (127.17.223.1:40721), 41268b218b804905a110c86738e74400 (127.17.223.2:44403)
I20260709 13:08:24.507994 28160 consensus_queue.cc:1048] T 1cd5e6e9b36d4591961cb379d7065be9 P 665f7e09521a4c3f9284c1d8b0e094ff [LEADER]: Connected to new peer: Peer: permanent_uuid: "18435fbb525741328139e84a1e354954" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 40545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:08:24.522336 27814 raft_consensus.cc:3060] T 3a7da70e9f0f49a9bf60184a8f0b5339 P 18435fbb525741328139e84a1e354954 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:24.522815 27862 ts_tablet_manager.cc:1403] T ae05961ab7a94458b1ad2cde9785c63b P 665f7e09521a4c3f9284c1d8b0e094ff: Time spent bootstrapping tablet: real 0.196s	user 0.019s	sys 0.007s
I20260709 13:08:24.523151 27666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a7da70e9f0f49a9bf60184a8f0b5339" candidate_uuid: "18435fbb525741328139e84a1e354954" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "41268b218b804905a110c86738e74400" is_pre_election: true
I20260709 13:08:24.524879 27593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a7da70e9f0f49a9bf60184a8f0b5339" candidate_uuid: "18435fbb525741328139e84a1e354954" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2513a663afac495eb09126ff55e8b2b0" is_pre_election: true
I20260709 13:08:24.515089 27667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e758d59bd4a4eae9f67662e165013f9" candidate_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "41268b218b804905a110c86738e74400"
I20260709 13:08:24.526194 27667 raft_consensus.cc:3060] T 8e758d59bd4a4eae9f67662e165013f9 P 41268b218b804905a110c86738e74400 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:24.519891 27739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e94954fc474414ba7563be776d6c80a" candidate_uuid: "41268b218b804905a110c86738e74400" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" is_pre_election: true
W20260709 13:08:24.522699 27634 leader_election.cc:343] T 9e94954fc474414ba7563be776d6c80a P 41268b218b804905a110c86738e74400 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 18435fbb525741328139e84a1e354954 (127.17.223.4:40545): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:24.532084 27863 tablet_bootstrap.cc:492] T e23b142958324f69aa0bad3a5828fa83 P 41268b218b804905a110c86738e74400: Bootstrap starting.
W20260709 13:08:24.532354 27634 leader_election.cc:343] T 9e94954fc474414ba7563be776d6c80a P 41268b218b804905a110c86738e74400 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 665f7e09521a4c3f9284c1d8b0e094ff (127.17.223.3:38749): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:24.532841 27634 leader_election.cc:304] T 9e94954fc474414ba7563be776d6c80a P 41268b218b804905a110c86738e74400 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 41268b218b804905a110c86738e74400; no voters: 18435fbb525741328139e84a1e354954, 665f7e09521a4c3f9284c1d8b0e094ff
I20260709 13:08:24.539717 28136 raft_consensus.cc:2749] T 9e94954fc474414ba7563be776d6c80a P 41268b218b804905a110c86738e74400 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:08:24.540674 27779 leader_election.cc:304] T 3a7da70e9f0f49a9bf60184a8f0b5339 P 18435fbb525741328139e84a1e354954 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 18435fbb525741328139e84a1e354954; no voters: 2513a663afac495eb09126ff55e8b2b0, 41268b218b804905a110c86738e74400
I20260709 13:08:24.547170 28013 raft_consensus.cc:2749] T 3a7da70e9f0f49a9bf60184a8f0b5339 P 18435fbb525741328139e84a1e354954 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:08:24.533169 27865 consensus_queue.cc:260] T 5a55d1bac7374ff6b83cc7bae2d3b1f3 P 18435fbb525741328139e84a1e354954 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18435fbb525741328139e84a1e354954" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 40545 } } peers { permanent_uuid: "2513a663afac495eb09126ff55e8b2b0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40721 } } peers { permanent_uuid: "41268b218b804905a110c86738e74400" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 44403 } }
I20260709 13:08:24.505061 28139 raft_consensus.cc:515] T 1c5e794c2a0a45fa99bcfde6aeb45d2e P 41268b218b804905a110c86738e74400 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "41268b218b804905a110c86738e74400" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 44403 } } peers { permanent_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 38749 } } peers { permanent_uuid: "18435fbb525741328139e84a1e354954" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 40545 } }
I20260709 13:08:24.552043 27863 tablet_bootstrap.cc:654] T e23b142958324f69aa0bad3a5828fa83 P 41268b218b804905a110c86738e74400: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:24.564090 27862 raft_consensus.cc:359] T ae05961ab7a94458b1ad2cde9785c63b P 665f7e09521a4c3f9284c1d8b0e094ff [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 38749 } } peers { permanent_uuid: "18435fbb525741328139e84a1e354954" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 40545 } } peers { permanent_uuid: "2513a663afac495eb09126ff55e8b2b0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40721 } }
I20260709 13:08:24.565080 27862 raft_consensus.cc:385] T ae05961ab7a94458b1ad2cde9785c63b P 665f7e09521a4c3f9284c1d8b0e094ff [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:24.565402 27862 raft_consensus.cc:740] T ae05961ab7a94458b1ad2cde9785c63b P 665f7e09521a4c3f9284c1d8b0e094ff [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 665f7e09521a4c3f9284c1d8b0e094ff, State: Initialized, Role: FOLLOWER
I20260709 13:08:24.568720 28139 leader_election.cc:290] T 1c5e794c2a0a45fa99bcfde6aeb45d2e P 41268b218b804905a110c86738e74400 [CANDIDATE]: Term 1 election: Requested vote from peers 665f7e09521a4c3f9284c1d8b0e094ff (127.17.223.3:38749), 18435fbb525741328139e84a1e354954 (127.17.223.4:40545)
I20260709 13:08:24.568990 27739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c5e794c2a0a45fa99bcfde6aeb45d2e" candidate_uuid: "41268b218b804905a110c86738e74400" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "665f7e09521a4c3f9284c1d8b0e094ff"
I20260709 13:08:24.569834 27739 raft_consensus.cc:3060] T 1c5e794c2a0a45fa99bcfde6aeb45d2e P 665f7e09521a4c3f9284c1d8b0e094ff [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:24.576676 27816 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c5e794c2a0a45fa99bcfde6aeb45d2e" candidate_uuid: "41268b218b804905a110c86738e74400" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "18435fbb525741328139e84a1e354954"
I20260709 13:08:24.577504 27865 ts_tablet_manager.cc:1434] T 5a55d1bac7374ff6b83cc7bae2d3b1f3 P 18435fbb525741328139e84a1e354954: Time spent starting tablet: real 0.105s	user 0.005s	sys 0.004s
W20260709 13:08:24.578138 27634 leader_election.cc:343] T 1c5e794c2a0a45fa99bcfde6aeb45d2e P 41268b218b804905a110c86738e74400 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 18435fbb525741328139e84a1e354954 (127.17.223.4:40545): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:24.566252 27862 consensus_queue.cc:260] T ae05961ab7a94458b1ad2cde9785c63b P 665f7e09521a4c3f9284c1d8b0e094ff [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 38749 } } peers { permanent_uuid: "18435fbb525741328139e84a1e354954" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 40545 } } peers { permanent_uuid: "2513a663afac495eb09126ff55e8b2b0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40721 } }
I20260709 13:08:24.588927 27870 consensus_queue.cc:1048] T 3a7da70e9f0f49a9bf60184a8f0b5339 P 2513a663afac495eb09126ff55e8b2b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "18435fbb525741328139e84a1e354954" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 40545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:08:24.589588 27862 ts_tablet_manager.cc:1434] T ae05961ab7a94458b1ad2cde9785c63b P 665f7e09521a4c3f9284c1d8b0e094ff: Time spent starting tablet: real 0.066s	user 0.008s	sys 0.000s
I20260709 13:08:24.597915 27589 raft_consensus.cc:2468] T 8e758d59bd4a4eae9f67662e165013f9 P 2513a663afac495eb09126ff55e8b2b0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 665f7e09521a4c3f9284c1d8b0e094ff in term 1.
I20260709 13:08:24.599174 27705 leader_election.cc:304] T 8e758d59bd4a4eae9f67662e165013f9 P 665f7e09521a4c3f9284c1d8b0e094ff [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2513a663afac495eb09126ff55e8b2b0, 665f7e09521a4c3f9284c1d8b0e094ff; no voters: 
I20260709 13:08:24.600088 28160 raft_consensus.cc:2804] T 8e758d59bd4a4eae9f67662e165013f9 P 665f7e09521a4c3f9284c1d8b0e094ff [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:08:24.600579 28160 raft_consensus.cc:697] T 8e758d59bd4a4eae9f67662e165013f9 P 665f7e09521a4c3f9284c1d8b0e094ff [term 1 LEADER]: Becoming Leader. State: Replica: 665f7e09521a4c3f9284c1d8b0e094ff, State: Running, Role: LEADER
I20260709 13:08:24.601383 28160 consensus_queue.cc:237] T 8e758d59bd4a4eae9f67662e165013f9 P 665f7e09521a4c3f9284c1d8b0e094ff [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2513a663afac495eb09126ff55e8b2b0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40721 } } peers { permanent_uuid: "41268b218b804905a110c86738e74400" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 44403 } } peers { permanent_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 38749 } }
I20260709 13:08:24.604087 27865 tablet_bootstrap.cc:492] T 2d994cb13f8f453284bcb1f8b85824a2 P 18435fbb525741328139e84a1e354954: Bootstrap starting.
I20260709 13:08:24.613554 27862 tablet_bootstrap.cc:492] T ea92a607c73b4d289d081146089a86f9 P 665f7e09521a4c3f9284c1d8b0e094ff: Bootstrap starting.
I20260709 13:08:24.612907 27739 raft_consensus.cc:2468] T 1c5e794c2a0a45fa99bcfde6aeb45d2e P 665f7e09521a4c3f9284c1d8b0e094ff [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 41268b218b804905a110c86738e74400 in term 1.
I20260709 13:08:24.622898 27667 raft_consensus.cc:2468] T 8e758d59bd4a4eae9f67662e165013f9 P 41268b218b804905a110c86738e74400 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 665f7e09521a4c3f9284c1d8b0e094ff in term 1.
I20260709 13:08:24.629580 27634 leader_election.cc:304] T 1c5e794c2a0a45fa99bcfde6aeb45d2e P 41268b218b804905a110c86738e74400 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 41268b218b804905a110c86738e74400, 665f7e09521a4c3f9284c1d8b0e094ff; no voters: 18435fbb525741328139e84a1e354954
I20260709 13:08:24.633262 27978 raft_consensus.cc:2804] T 1c5e794c2a0a45fa99bcfde6aeb45d2e P 41268b218b804905a110c86738e74400 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:08:24.633891 27978 raft_consensus.cc:697] T 1c5e794c2a0a45fa99bcfde6aeb45d2e P 41268b218b804905a110c86738e74400 [term 1 LEADER]: Becoming Leader. State: Replica: 41268b218b804905a110c86738e74400, State: Running, Role: LEADER
I20260709 13:08:24.635326 27865 tablet_bootstrap.cc:654] T 2d994cb13f8f453284bcb1f8b85824a2 P 18435fbb525741328139e84a1e354954: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:24.635821 27978 consensus_queue.cc:237] T 1c5e794c2a0a45fa99bcfde6aeb45d2e P 41268b218b804905a110c86738e74400 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "41268b218b804905a110c86738e74400" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 44403 } } peers { permanent_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 38749 } } peers { permanent_uuid: "18435fbb525741328139e84a1e354954" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 40545 } }
I20260709 13:08:24.647364 27861 tablet_bootstrap.cc:654] T ea92a607c73b4d289d081146089a86f9 P 2513a663afac495eb09126ff55e8b2b0: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:24.652523 27863 tablet_bootstrap.cc:492] T e23b142958324f69aa0bad3a5828fa83 P 41268b218b804905a110c86738e74400: No bootstrap required, opened a new log
I20260709 13:08:24.653203 27863 ts_tablet_manager.cc:1403] T e23b142958324f69aa0bad3a5828fa83 P 41268b218b804905a110c86738e74400: Time spent bootstrapping tablet: real 0.122s	user 0.022s	sys 0.008s
I20260709 13:08:24.665166 27865 tablet_bootstrap.cc:492] T 2d994cb13f8f453284bcb1f8b85824a2 P 18435fbb525741328139e84a1e354954: No bootstrap required, opened a new log
I20260709 13:08:24.662307 28125 raft_consensus.cc:493] T ae05961ab7a94458b1ad2cde9785c63b P 2513a663afac495eb09126ff55e8b2b0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:24.665776 28125 raft_consensus.cc:515] T ae05961ab7a94458b1ad2cde9785c63b P 2513a663afac495eb09126ff55e8b2b0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 38749 } } peers { permanent_uuid: "18435fbb525741328139e84a1e354954" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 40545 } } peers { permanent_uuid: "2513a663afac495eb09126ff55e8b2b0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40721 } }
I20260709 13:08:24.667824 28125 leader_election.cc:290] T ae05961ab7a94458b1ad2cde9785c63b P 2513a663afac495eb09126ff55e8b2b0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 665f7e09521a4c3f9284c1d8b0e094ff (127.17.223.3:38749), 18435fbb525741328139e84a1e354954 (127.17.223.4:40545)
I20260709 13:08:24.670523 27816 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae05961ab7a94458b1ad2cde9785c63b" candidate_uuid: "2513a663afac495eb09126ff55e8b2b0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "18435fbb525741328139e84a1e354954" is_pre_election: true
I20260709 13:08:24.672530 27865 ts_tablet_manager.cc:1403] T 2d994cb13f8f453284bcb1f8b85824a2 P 18435fbb525741328139e84a1e354954: Time spent bootstrapping tablet: real 0.085s	user 0.008s	sys 0.006s
W20260709 13:08:24.671883 27559 leader_election.cc:343] T ae05961ab7a94458b1ad2cde9785c63b P 2513a663afac495eb09126ff55e8b2b0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 18435fbb525741328139e84a1e354954 (127.17.223.4:40545): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:24.675626 27739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae05961ab7a94458b1ad2cde9785c63b" candidate_uuid: "2513a663afac495eb09126ff55e8b2b0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" is_pre_election: true
I20260709 13:08:24.676366 27739 raft_consensus.cc:2468] T ae05961ab7a94458b1ad2cde9785c63b P 665f7e09521a4c3f9284c1d8b0e094ff [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2513a663afac495eb09126ff55e8b2b0 in term 0.
I20260709 13:08:24.679510 27559 leader_election.cc:304] T ae05961ab7a94458b1ad2cde9785c63b P 2513a663afac495eb09126ff55e8b2b0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2513a663afac495eb09126ff55e8b2b0, 665f7e09521a4c3f9284c1d8b0e094ff; no voters: 18435fbb525741328139e84a1e354954
I20260709 13:08:24.679713 27862 tablet_bootstrap.cc:654] T ea92a607c73b4d289d081146089a86f9 P 665f7e09521a4c3f9284c1d8b0e094ff: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:24.679575 27863 raft_consensus.cc:359] T e23b142958324f69aa0bad3a5828fa83 P 41268b218b804905a110c86738e74400 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2513a663afac495eb09126ff55e8b2b0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40721 } } peers { permanent_uuid: "41268b218b804905a110c86738e74400" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 44403 } } peers { permanent_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 38749 } }
I20260709 13:08:24.687139 27863 raft_consensus.cc:385] T e23b142958324f69aa0bad3a5828fa83 P 41268b218b804905a110c86738e74400 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:24.687562 27863 raft_consensus.cc:740] T e23b142958324f69aa0bad3a5828fa83 P 41268b218b804905a110c86738e74400 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 41268b218b804905a110c86738e74400, State: Initialized, Role: FOLLOWER
I20260709 13:08:24.686407 28125 raft_consensus.cc:2804] T ae05961ab7a94458b1ad2cde9785c63b P 2513a663afac495eb09126ff55e8b2b0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:08:24.689828 28125 raft_consensus.cc:493] T ae05961ab7a94458b1ad2cde9785c63b P 2513a663afac495eb09126ff55e8b2b0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:24.690191 28125 raft_consensus.cc:3060] T ae05961ab7a94458b1ad2cde9785c63b P 2513a663afac495eb09126ff55e8b2b0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:24.696360 27863 consensus_queue.cc:260] T e23b142958324f69aa0bad3a5828fa83 P 41268b218b804905a110c86738e74400 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2513a663afac495eb09126ff55e8b2b0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40721 } } peers { permanent_uuid: "41268b218b804905a110c86738e74400" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 44403 } } peers { permanent_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 38749 } }
I20260709 13:08:24.700560 27863 ts_tablet_manager.cc:1434] T e23b142958324f69aa0bad3a5828fa83 P 41268b218b804905a110c86738e74400: Time spent starting tablet: real 0.047s	user 0.007s	sys 0.000s
I20260709 13:08:24.703485 28101 raft_consensus.cc:493] T 5a55d1bac7374ff6b83cc7bae2d3b1f3 P 18435fbb525741328139e84a1e354954 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:24.704172 28101 raft_consensus.cc:515] T 5a55d1bac7374ff6b83cc7bae2d3b1f3 P 18435fbb525741328139e84a1e354954 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18435fbb525741328139e84a1e354954" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 40545 } } peers { permanent_uuid: "2513a663afac495eb09126ff55e8b2b0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40721 } } peers { permanent_uuid: "41268b218b804905a110c86738e74400" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 44403 } }
I20260709 13:08:24.710821 27865 raft_consensus.cc:359] T 2d994cb13f8f453284bcb1f8b85824a2 P 18435fbb525741328139e84a1e354954 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18435fbb525741328139e84a1e354954" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 40545 } } peers { permanent_uuid: "2513a663afac495eb09126ff55e8b2b0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40721 } } peers { permanent_uuid: "41268b218b804905a110c86738e74400" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 44403 } }
I20260709 13:08:24.711540 27865 raft_consensus.cc:385] T 2d994cb13f8f453284bcb1f8b85824a2 P 18435fbb525741328139e84a1e354954 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:24.711782 27865 raft_consensus.cc:740] T 2d994cb13f8f453284bcb1f8b85824a2 P 18435fbb525741328139e84a1e354954 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 18435fbb525741328139e84a1e354954, State: Initialized, Role: FOLLOWER
I20260709 13:08:24.712390 27865 consensus_queue.cc:260] T 2d994cb13f8f453284bcb1f8b85824a2 P 18435fbb525741328139e84a1e354954 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18435fbb525741328139e84a1e354954" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 40545 } } peers { permanent_uuid: "2513a663afac495eb09126ff55e8b2b0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40721 } } peers { permanent_uuid: "41268b218b804905a110c86738e74400" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 44403 } }
I20260709 13:08:24.712662 27592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a55d1bac7374ff6b83cc7bae2d3b1f3" candidate_uuid: "18435fbb525741328139e84a1e354954" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2513a663afac495eb09126ff55e8b2b0" is_pre_election: true
I20260709 13:08:24.713807 27865 ts_tablet_manager.cc:1434] T 2d994cb13f8f453284bcb1f8b85824a2 P 18435fbb525741328139e84a1e354954: Time spent starting tablet: real 0.040s	user 0.003s	sys 0.000s
I20260709 13:08:24.719305 27863 tablet_bootstrap.cc:492] T 28737c73be174729ad3e9d238af7d975 P 41268b218b804905a110c86738e74400: Bootstrap starting.
I20260709 13:08:24.721097 27865 tablet_bootstrap.cc:492] T 1c5e794c2a0a45fa99bcfde6aeb45d2e P 18435fbb525741328139e84a1e354954: Bootstrap starting.
I20260709 13:08:24.721097 27870 raft_consensus.cc:493] T 2d994cb13f8f453284bcb1f8b85824a2 P 2513a663afac495eb09126ff55e8b2b0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:24.721738 27870 raft_consensus.cc:515] T 2d994cb13f8f453284bcb1f8b85824a2 P 2513a663afac495eb09126ff55e8b2b0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18435fbb525741328139e84a1e354954" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 40545 } } peers { permanent_uuid: "2513a663afac495eb09126ff55e8b2b0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40721 } } peers { permanent_uuid: "41268b218b804905a110c86738e74400" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 44403 } }
I20260709 13:08:24.717628 28101 leader_election.cc:290] T 5a55d1bac7374ff6b83cc7bae2d3b1f3 P 18435fbb525741328139e84a1e354954 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2513a663afac495eb09126ff55e8b2b0 (127.17.223.1:40721), 41268b218b804905a110c86738e74400 (127.17.223.2:44403)
I20260709 13:08:24.728065 27667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a55d1bac7374ff6b83cc7bae2d3b1f3" candidate_uuid: "18435fbb525741328139e84a1e354954" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "41268b218b804905a110c86738e74400" is_pre_election: true
I20260709 13:08:24.728772 27667 raft_consensus.cc:2468] T 5a55d1bac7374ff6b83cc7bae2d3b1f3 P 41268b218b804905a110c86738e74400 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 18435fbb525741328139e84a1e354954 in term 0.
I20260709 13:08:24.729983 27782 leader_election.cc:304] T 5a55d1bac7374ff6b83cc7bae2d3b1f3 P 18435fbb525741328139e84a1e354954 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 18435fbb525741328139e84a1e354954, 41268b218b804905a110c86738e74400; no voters: 
I20260709 13:08:24.731596 28160 consensus_queue.cc:1048] T 8d1aa996b2034de7b2d77545de68e73c P 665f7e09521a4c3f9284c1d8b0e094ff [LEADER]: Connected to new peer: Peer: permanent_uuid: "2513a663afac495eb09126ff55e8b2b0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40721 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:08:24.732793 27870 leader_election.cc:290] T 2d994cb13f8f453284bcb1f8b85824a2 P 2513a663afac495eb09126ff55e8b2b0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 18435fbb525741328139e84a1e354954 (127.17.223.4:40545), 41268b218b804905a110c86738e74400 (127.17.223.2:44403)
I20260709 13:08:24.724452 27487 catalog_manager.cc:5697] T 1c5e794c2a0a45fa99bcfde6aeb45d2e P 41268b218b804905a110c86738e74400 reported cstate change: term changed from 0 to 1, leader changed from <none> to 41268b218b804905a110c86738e74400 (127.17.223.2). New cstate: current_term: 1 leader_uuid: "41268b218b804905a110c86738e74400" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "41268b218b804905a110c86738e74400" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 44403 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 38749 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "18435fbb525741328139e84a1e354954" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 40545 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:24.748000 27488 catalog_manager.cc:5697] T 8e758d59bd4a4eae9f67662e165013f9 P 665f7e09521a4c3f9284c1d8b0e094ff reported cstate change: term changed from 0 to 1, leader changed from <none> to 665f7e09521a4c3f9284c1d8b0e094ff (127.17.223.3). New cstate: current_term: 1 leader_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2513a663afac495eb09126ff55e8b2b0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40721 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "41268b218b804905a110c86738e74400" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 44403 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 38749 } health_report { overall_health: HEALTHY } } }
I20260709 13:08:24.752687 28125 raft_consensus.cc:515] T ae05961ab7a94458b1ad2cde9785c63b P 2513a663afac495eb09126ff55e8b2b0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 38749 } } peers { permanent_uuid: "18435fbb525741328139e84a1e354954" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 40545 } } peers { permanent_uuid: "2513a663afac495eb09126ff55e8b2b0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40721 } }
I20260709 13:08:24.761205 27862 tablet_bootstrap.cc:492] T ea92a607c73b4d289d081146089a86f9 P 665f7e09521a4c3f9284c1d8b0e094ff: No bootstrap required, opened a new log
I20260709 13:08:24.761858 27862 ts_tablet_manager.cc:1403] T ea92a607c73b4d289d081146089a86f9 P 665f7e09521a4c3f9284c1d8b0e094ff: Time spent bootstrapping tablet: real 0.149s	user 0.026s	sys 0.001s
I20260709 13:08:24.762830 27813 raft_consensus.cc:3060] T 8e0d496efc3f41f3be82a538ef3cfdac P 18435fbb525741328139e84a1e354954 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:24.776779 27862 raft_consensus.cc:359] T ea92a607c73b4d289d081146089a86f9 P 665f7e09521a4c3f9284c1d8b0e094ff [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2513a663afac495eb09126ff55e8b2b0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40721 } } peers { permanent_uuid: "41268b218b804905a110c86738e74400" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 44403 } } peers { permanent_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 38749 } }
I20260709 13:08:24.777815 27862 raft_consensus.cc:385] T ea92a607c73b4d289d081146089a86f9 P 665f7e09521a4c3f9284c1d8b0e094ff [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:24.778151 27862 raft_consensus.cc:740] T ea92a607c73b4d289d081146089a86f9 P 665f7e09521a4c3f9284c1d8b0e094ff [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 665f7e09521a4c3f9284c1d8b0e094ff, State: Initialized, Role: FOLLOWER
I20260709 13:08:24.780360 27862 consensus_queue.cc:260] T ea92a607c73b4d289d081146089a86f9 P 665f7e09521a4c3f9284c1d8b0e094ff [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2513a663afac495eb09126ff55e8b2b0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40721 } } peers { permanent_uuid: "41268b218b804905a110c86738e74400" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 44403 } } peers { permanent_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 38749 } }
I20260709 13:08:24.784005 28136 raft_consensus.cc:493] T afcb3b39d1c9495eab95404687865537 P 41268b218b804905a110c86738e74400 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:24.781611 27741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae05961ab7a94458b1ad2cde9785c63b" candidate_uuid: "2513a663afac495eb09126ff55e8b2b0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "665f7e09521a4c3f9284c1d8b0e094ff"
I20260709 13:08:24.786175 28136 raft_consensus.cc:515] T afcb3b39d1c9495eab95404687865537 P 41268b218b804905a110c86738e74400 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "41268b218b804905a110c86738e74400" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 44403 } } peers { permanent_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 38749 } } peers { permanent_uuid: "18435fbb525741328139e84a1e354954" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 40545 } }
I20260709 13:08:24.786811 27741 raft_consensus.cc:3060] T ae05961ab7a94458b1ad2cde9785c63b P 665f7e09521a4c3f9284c1d8b0e094ff [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:24.788303 28136 leader_election.cc:290] T afcb3b39d1c9495eab95404687865537 P 41268b218b804905a110c86738e74400 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 665f7e09521a4c3f9284c1d8b0e094ff (127.17.223.3:38749), 18435fbb525741328139e84a1e354954 (127.17.223.4:40545)
I20260709 13:08:24.792096 27739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afcb3b39d1c9495eab95404687865537" candidate_uuid: "41268b218b804905a110c86738e74400" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" is_pre_election: true
I20260709 13:08:24.794417 27862 ts_tablet_manager.cc:1434] T ea92a607c73b4d289d081146089a86f9 P 665f7e09521a4c3f9284c1d8b0e094ff: Time spent starting tablet: real 0.032s	user 0.004s	sys 0.003s
I20260709 13:08:24.768325 27667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d994cb13f8f453284bcb1f8b85824a2" candidate_uuid: "2513a663afac495eb09126ff55e8b2b0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "41268b218b804905a110c86738e74400" is_pre_election: true
I20260709 13:08:24.795653 27667 raft_consensus.cc:2468] T 2d994cb13f8f453284bcb1f8b85824a2 P 41268b218b804905a110c86738e74400 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2513a663afac495eb09126ff55e8b2b0 in term 0.
I20260709 13:08:24.795771 27862 tablet_bootstrap.cc:492] T 9e94954fc474414ba7563be776d6c80a P 665f7e09521a4c3f9284c1d8b0e094ff: Bootstrap starting.
W20260709 13:08:24.796315 27634 leader_election.cc:343] T afcb3b39d1c9495eab95404687865537 P 41268b218b804905a110c86738e74400 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 665f7e09521a4c3f9284c1d8b0e094ff (127.17.223.3:38749): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:24.796765 27559 leader_election.cc:304] T 2d994cb13f8f453284bcb1f8b85824a2 P 2513a663afac495eb09126ff55e8b2b0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2513a663afac495eb09126ff55e8b2b0, 41268b218b804905a110c86738e74400; no voters: 
I20260709 13:08:24.797992 27870 raft_consensus.cc:2804] T 2d994cb13f8f453284bcb1f8b85824a2 P 2513a663afac495eb09126ff55e8b2b0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:08:24.798446 27870 raft_consensus.cc:493] T 2d994cb13f8f453284bcb1f8b85824a2 P 2513a663afac495eb09126ff55e8b2b0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:24.798867 27870 raft_consensus.cc:3060] T 2d994cb13f8f453284bcb1f8b85824a2 P 2513a663afac495eb09126ff55e8b2b0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:24.781401 27978 raft_consensus.cc:493] T 585e960f8d0f42268f2fe98e1e7b83f0 P 41268b218b804905a110c86738e74400 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:24.802368 27978 raft_consensus.cc:515] T 585e960f8d0f42268f2fe98e1e7b83f0 P 41268b218b804905a110c86738e74400 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2513a663afac495eb09126ff55e8b2b0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40721 } } peers { permanent_uuid: "41268b218b804905a110c86738e74400" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 44403 } } peers { permanent_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 38749 } }
I20260709 13:08:24.806641 27978 leader_election.cc:290] T 585e960f8d0f42268f2fe98e1e7b83f0 P 41268b218b804905a110c86738e74400 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2513a663afac495eb09126ff55e8b2b0 (127.17.223.1:40721), 665f7e09521a4c3f9284c1d8b0e094ff (127.17.223.3:38749)
I20260709 13:08:24.787901 27865 tablet_bootstrap.cc:654] T 1c5e794c2a0a45fa99bcfde6aeb45d2e P 18435fbb525741328139e84a1e354954: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:24.807086 27589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "585e960f8d0f42268f2fe98e1e7b83f0" candidate_uuid: "41268b218b804905a110c86738e74400" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2513a663afac495eb09126ff55e8b2b0" is_pre_election: true
W20260709 13:08:24.809366 27631 leader_election.cc:343] T 585e960f8d0f42268f2fe98e1e7b83f0 P 41268b218b804905a110c86738e74400 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2513a663afac495eb09126ff55e8b2b0 (127.17.223.1:40721): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:24.815992 27740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "585e960f8d0f42268f2fe98e1e7b83f0" candidate_uuid: "41268b218b804905a110c86738e74400" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" is_pre_election: true
I20260709 13:08:24.769505 28205 raft_consensus.cc:2804] T 5a55d1bac7374ff6b83cc7bae2d3b1f3 P 18435fbb525741328139e84a1e354954 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:08:24.817915 28205 raft_consensus.cc:493] T 5a55d1bac7374ff6b83cc7bae2d3b1f3 P 18435fbb525741328139e84a1e354954 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:24.818395 28205 raft_consensus.cc:3060] T 5a55d1bac7374ff6b83cc7bae2d3b1f3 P 18435fbb525741328139e84a1e354954 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:08:24.824263 27634 leader_election.cc:343] T 585e960f8d0f42268f2fe98e1e7b83f0 P 41268b218b804905a110c86738e74400 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 665f7e09521a4c3f9284c1d8b0e094ff (127.17.223.3:38749): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:24.824991 27634 leader_election.cc:304] T 585e960f8d0f42268f2fe98e1e7b83f0 P 41268b218b804905a110c86738e74400 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 41268b218b804905a110c86738e74400; no voters: 2513a663afac495eb09126ff55e8b2b0, 665f7e09521a4c3f9284c1d8b0e094ff
I20260709 13:08:24.826045 27978 raft_consensus.cc:2749] T 585e960f8d0f42268f2fe98e1e7b83f0 P 41268b218b804905a110c86738e74400 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:08:24.822522 28101 raft_consensus.cc:493] T 8e0d496efc3f41f3be82a538ef3cfdac P 18435fbb525741328139e84a1e354954 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:24.827353 28101 raft_consensus.cc:515] T 8e0d496efc3f41f3be82a538ef3cfdac P 18435fbb525741328139e84a1e354954 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "41268b218b804905a110c86738e74400" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 44403 } } peers { permanent_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 38749 } } peers { permanent_uuid: "18435fbb525741328139e84a1e354954" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 40545 } }
I20260709 13:08:24.832679 27870 raft_consensus.cc:515] T 2d994cb13f8f453284bcb1f8b85824a2 P 2513a663afac495eb09126ff55e8b2b0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18435fbb525741328139e84a1e354954" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 40545 } } peers { permanent_uuid: "2513a663afac495eb09126ff55e8b2b0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40721 } } peers { permanent_uuid: "41268b218b804905a110c86738e74400" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 44403 } }
I20260709 13:08:24.847357 27861 tablet_bootstrap.cc:492] T ea92a607c73b4d289d081146089a86f9 P 2513a663afac495eb09126ff55e8b2b0: No bootstrap required, opened a new log
I20260709 13:08:24.847927 27861 ts_tablet_manager.cc:1403] T ea92a607c73b4d289d081146089a86f9 P 2513a663afac495eb09126ff55e8b2b0: Time spent bootstrapping tablet: real 0.336s	user 0.010s	sys 0.005s
I20260709 13:08:24.840072 28160 consensus_queue.cc:1048] T 8d1aa996b2034de7b2d77545de68e73c P 665f7e09521a4c3f9284c1d8b0e094ff [LEADER]: Connected to new peer: Peer: permanent_uuid: "18435fbb525741328139e84a1e354954" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 40545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.015s
I20260709 13:08:24.856137 27741 raft_consensus.cc:2468] T ae05961ab7a94458b1ad2cde9785c63b P 665f7e09521a4c3f9284c1d8b0e094ff [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2513a663afac495eb09126ff55e8b2b0 in term 1.
I20260709 13:08:24.857609 27861 raft_consensus.cc:359] T ea92a607c73b4d289d081146089a86f9 P 2513a663afac495eb09126ff55e8b2b0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2513a663afac495eb09126ff55e8b2b0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40721 } } peers { permanent_uuid: "41268b218b804905a110c86738e74400" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 44403 } } peers { permanent_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 38749 } }
I20260709 13:08:24.858300 27861 raft_consensus.cc:385] T ea92a607c73b4d289d081146089a86f9 P 2513a663afac495eb09126ff55e8b2b0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:24.860590 27667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e0d496efc3f41f3be82a538ef3cfdac" candidate_uuid: "18435fbb525741328139e84a1e354954" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "41268b218b804905a110c86738e74400" is_pre_election: true
I20260709 13:08:24.858560 27861 raft_consensus.cc:740] T ea92a607c73b4d289d081146089a86f9 P 2513a663afac495eb09126ff55e8b2b0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2513a663afac495eb09126ff55e8b2b0, State: Initialized, Role: FOLLOWER
I20260709 13:08:24.861531 27667 raft_consensus.cc:2468] T 8e0d496efc3f41f3be82a538ef3cfdac P 41268b218b804905a110c86738e74400 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 18435fbb525741328139e84a1e354954 in term 1.
I20260709 13:08:24.862241 27861 consensus_queue.cc:260] T ea92a607c73b4d289d081146089a86f9 P 2513a663afac495eb09126ff55e8b2b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2513a663afac495eb09126ff55e8b2b0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40721 } } peers { permanent_uuid: "41268b218b804905a110c86738e74400" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 44403 } } peers { permanent_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 38749 } }
I20260709 13:08:24.864207 27861 ts_tablet_manager.cc:1434] T ea92a607c73b4d289d081146089a86f9 P 2513a663afac495eb09126ff55e8b2b0: Time spent starting tablet: real 0.016s	user 0.007s	sys 0.000s
I20260709 13:08:24.865176 27559 leader_election.cc:304] T ae05961ab7a94458b1ad2cde9785c63b P 2513a663afac495eb09126ff55e8b2b0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2513a663afac495eb09126ff55e8b2b0, 665f7e09521a4c3f9284c1d8b0e094ff; no voters: 
I20260709 13:08:24.866232 28194 raft_consensus.cc:2804] T ae05961ab7a94458b1ad2cde9785c63b P 2513a663afac495eb09126ff55e8b2b0 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:08:24.867164 27861 tablet_bootstrap.cc:492] T 5a55d1bac7374ff6b83cc7bae2d3b1f3 P 2513a663afac495eb09126ff55e8b2b0: Bootstrap starting.
I20260709 13:08:24.868353 27782 leader_election.cc:304] T 8e0d496efc3f41f3be82a538ef3cfdac P 18435fbb525741328139e84a1e354954 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 18435fbb525741328139e84a1e354954, 41268b218b804905a110c86738e74400; no voters: 
I20260709 13:08:24.877099 27863 tablet_bootstrap.cc:654] T 28737c73be174729ad3e9d238af7d975 P 41268b218b804905a110c86738e74400: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:24.844360 28125 leader_election.cc:290] T ae05961ab7a94458b1ad2cde9785c63b P 2513a663afac495eb09126ff55e8b2b0 [CANDIDATE]: Term 1 election: Requested vote from peers 665f7e09521a4c3f9284c1d8b0e094ff (127.17.223.3:38749), 18435fbb525741328139e84a1e354954 (127.17.223.4:40545)
W20260709 13:08:24.840277 27779 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.1:40721, user_credentials={real_user=slave}} blocked reactor thread for 124642us
I20260709 13:08:24.840473 28158 consensus_queue.cc:1048] T 8e0d496efc3f41f3be82a538ef3cfdac P 665f7e09521a4c3f9284c1d8b0e094ff [LEADER]: Connected to new peer: Peer: permanent_uuid: "18435fbb525741328139e84a1e354954" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 40545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.034s
I20260709 13:08:24.898963 27870 leader_election.cc:290] T 2d994cb13f8f453284bcb1f8b85824a2 P 2513a663afac495eb09126ff55e8b2b0 [CANDIDATE]: Term 1 election: Requested vote from peers 18435fbb525741328139e84a1e354954 (127.17.223.4:40545), 41268b218b804905a110c86738e74400 (127.17.223.2:44403)
I20260709 13:08:24.851864 28101 leader_election.cc:290] T 8e0d496efc3f41f3be82a538ef3cfdac P 18435fbb525741328139e84a1e354954 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 41268b218b804905a110c86738e74400 (127.17.223.2:44403), 665f7e09521a4c3f9284c1d8b0e094ff (127.17.223.3:38749)
W20260709 13:08:24.921653 27559 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.3:38749, user_credentials={real_user=slave}} blocked reactor thread for 52999.2us
W20260709 13:08:24.917083 27705 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.1:40721, user_credentials={real_user=slave}} blocked reactor thread for 76450.5us
W20260709 13:08:24.931095 27539 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:08:24.921128 28013 raft_consensus.cc:2804] T 8e0d496efc3f41f3be82a538ef3cfdac P 18435fbb525741328139e84a1e354954 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:08:24.947122 27862 tablet_bootstrap.cc:654] T 9e94954fc474414ba7563be776d6c80a P 665f7e09521a4c3f9284c1d8b0e094ff: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:24.949616 27668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d994cb13f8f453284bcb1f8b85824a2" candidate_uuid: "2513a663afac495eb09126ff55e8b2b0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "41268b218b804905a110c86738e74400"
I20260709 13:08:24.950107 27740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e0d496efc3f41f3be82a538ef3cfdac" candidate_uuid: "18435fbb525741328139e84a1e354954" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" is_pre_election: true
I20260709 13:08:24.950290 27668 raft_consensus.cc:3060] T 2d994cb13f8f453284bcb1f8b85824a2 P 41268b218b804905a110c86738e74400 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:08:24.944003 27779 leader_election.cc:343] T 5a55d1bac7374ff6b83cc7bae2d3b1f3 P 18435fbb525741328139e84a1e354954 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2513a663afac495eb09126ff55e8b2b0 (127.17.223.1:40721): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:24.957041 27861 tablet_bootstrap.cc:654] T 5a55d1bac7374ff6b83cc7bae2d3b1f3 P 2513a663afac495eb09126ff55e8b2b0: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:24.933426 28013 raft_consensus.cc:493] T 8e0d496efc3f41f3be82a538ef3cfdac P 18435fbb525741328139e84a1e354954 [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:24.957737 28013 raft_consensus.cc:3060] T 8e0d496efc3f41f3be82a538ef3cfdac P 18435fbb525741328139e84a1e354954 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:24.939707 28194 raft_consensus.cc:697] T ae05961ab7a94458b1ad2cde9785c63b P 2513a663afac495eb09126ff55e8b2b0 [term 1 LEADER]: Becoming Leader. State: Replica: 2513a663afac495eb09126ff55e8b2b0, State: Running, Role: LEADER
I20260709 13:08:24.967144 27978 raft_consensus.cc:493] T e23b142958324f69aa0bad3a5828fa83 P 41268b218b804905a110c86738e74400 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:24.972282 27978 raft_consensus.cc:515] T e23b142958324f69aa0bad3a5828fa83 P 41268b218b804905a110c86738e74400 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2513a663afac495eb09126ff55e8b2b0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40721 } } peers { permanent_uuid: "41268b218b804905a110c86738e74400" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 44403 } } peers { permanent_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 38749 } }
I20260709 13:08:24.976933 27978 leader_election.cc:290] T e23b142958324f69aa0bad3a5828fa83 P 41268b218b804905a110c86738e74400 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2513a663afac495eb09126ff55e8b2b0 (127.17.223.1:40721), 665f7e09521a4c3f9284c1d8b0e094ff (127.17.223.3:38749)
I20260709 13:08:24.962119 28194 consensus_queue.cc:237] T ae05961ab7a94458b1ad2cde9785c63b P 2513a663afac495eb09126ff55e8b2b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 38749 } } peers { permanent_uuid: "18435fbb525741328139e84a1e354954" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 40545 } } peers { permanent_uuid: "2513a663afac495eb09126ff55e8b2b0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40721 } }
I20260709 13:08:24.926458 28215 consensus_queue.cc:1048] T 8e0d496efc3f41f3be82a538ef3cfdac P 665f7e09521a4c3f9284c1d8b0e094ff [LEADER]: Connected to new peer: Peer: permanent_uuid: "41268b218b804905a110c86738e74400" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 44403 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.040s
I20260709 13:08:24.994330 27865 tablet_bootstrap.cc:492] T 1c5e794c2a0a45fa99bcfde6aeb45d2e P 18435fbb525741328139e84a1e354954: No bootstrap required, opened a new log
I20260709 13:08:24.994876 27865 ts_tablet_manager.cc:1403] T 1c5e794c2a0a45fa99bcfde6aeb45d2e P 18435fbb525741328139e84a1e354954: Time spent bootstrapping tablet: real 0.275s	user 0.022s	sys 0.015s
I20260709 13:08:25.000677 27592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e23b142958324f69aa0bad3a5828fa83" candidate_uuid: "41268b218b804905a110c86738e74400" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2513a663afac495eb09126ff55e8b2b0" is_pre_election: true
I20260709 13:08:25.006834 27740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e23b142958324f69aa0bad3a5828fa83" candidate_uuid: "41268b218b804905a110c86738e74400" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" is_pre_election: true
I20260709 13:08:24.999058 28205 raft_consensus.cc:515] T 5a55d1bac7374ff6b83cc7bae2d3b1f3 P 18435fbb525741328139e84a1e354954 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18435fbb525741328139e84a1e354954" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 40545 } } peers { permanent_uuid: "2513a663afac495eb09126ff55e8b2b0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40721 } } peers { permanent_uuid: "41268b218b804905a110c86738e74400" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 44403 } }
W20260709 13:08:25.043491 27634 leader_election.cc:343] T e23b142958324f69aa0bad3a5828fa83 P 41268b218b804905a110c86738e74400 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 665f7e09521a4c3f9284c1d8b0e094ff (127.17.223.3:38749): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:25.022940 27814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afcb3b39d1c9495eab95404687865537" candidate_uuid: "41268b218b804905a110c86738e74400" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "18435fbb525741328139e84a1e354954" is_pre_election: true
I20260709 13:08:25.057360 27668 raft_consensus.cc:2468] T 2d994cb13f8f453284bcb1f8b85824a2 P 41268b218b804905a110c86738e74400 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2513a663afac495eb09126ff55e8b2b0 in term 1.
I20260709 13:08:25.061105 27862 tablet_bootstrap.cc:492] T 9e94954fc474414ba7563be776d6c80a P 665f7e09521a4c3f9284c1d8b0e094ff: No bootstrap required, opened a new log
I20260709 13:08:25.061661 27862 ts_tablet_manager.cc:1403] T 9e94954fc474414ba7563be776d6c80a P 665f7e09521a4c3f9284c1d8b0e094ff: Time spent bootstrapping tablet: real 0.266s	user 0.010s	sys 0.016s
I20260709 13:08:25.064334 27863 tablet_bootstrap.cc:492] T 28737c73be174729ad3e9d238af7d975 P 41268b218b804905a110c86738e74400: No bootstrap required, opened a new log
W20260709 13:08:25.064635 27631 leader_election.cc:343] T e23b142958324f69aa0bad3a5828fa83 P 41268b218b804905a110c86738e74400 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2513a663afac495eb09126ff55e8b2b0 (127.17.223.1:40721): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:25.064930 27863 ts_tablet_manager.cc:1403] T 28737c73be174729ad3e9d238af7d975 P 41268b218b804905a110c86738e74400: Time spent bootstrapping tablet: real 0.346s	user 0.024s	sys 0.041s
I20260709 13:08:25.065147 27631 leader_election.cc:304] T e23b142958324f69aa0bad3a5828fa83 P 41268b218b804905a110c86738e74400 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 41268b218b804905a110c86738e74400; no voters: 2513a663afac495eb09126ff55e8b2b0, 665f7e09521a4c3f9284c1d8b0e094ff
I20260709 13:08:25.067467 28139 raft_consensus.cc:2749] T e23b142958324f69aa0bad3a5828fa83 P 41268b218b804905a110c86738e74400 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:08:25.068974 27861 tablet_bootstrap.cc:492] T 5a55d1bac7374ff6b83cc7bae2d3b1f3 P 2513a663afac495eb09126ff55e8b2b0: No bootstrap required, opened a new log
I20260709 13:08:25.069453 27861 ts_tablet_manager.cc:1403] T 5a55d1bac7374ff6b83cc7bae2d3b1f3 P 2513a663afac495eb09126ff55e8b2b0: Time spent bootstrapping tablet: real 0.203s	user 0.008s	sys 0.018s
I20260709 13:08:25.070845 28013 raft_consensus.cc:515] T 8e0d496efc3f41f3be82a538ef3cfdac P 18435fbb525741328139e84a1e354954 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "41268b218b804905a110c86738e74400" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 44403 } } peers { permanent_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 38749 } } peers { permanent_uuid: "18435fbb525741328139e84a1e354954" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 40545 } }
I20260709 13:08:25.072064 27812 raft_consensus.cc:1240] T 8e0d496efc3f41f3be82a538ef3cfdac P 18435fbb525741328139e84a1e354954 [term 2 FOLLOWER]: Rejecting Update request from peer 665f7e09521a4c3f9284c1d8b0e094ff for earlier term 1. Current term is 2. Ops: [1.1-1.1]
I20260709 13:08:25.077394 28013 leader_election.cc:290] T 8e0d496efc3f41f3be82a538ef3cfdac P 18435fbb525741328139e84a1e354954 [CANDIDATE]: Term 2 election: Requested vote from peers 41268b218b804905a110c86738e74400 (127.17.223.2:44403), 665f7e09521a4c3f9284c1d8b0e094ff (127.17.223.3:38749)
I20260709 13:08:25.084002 27903 consensus_queue.cc:1059] T 8e0d496efc3f41f3be82a538ef3cfdac P 665f7e09521a4c3f9284c1d8b0e094ff [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "18435fbb525741328139e84a1e354954" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 40545 }, Status: INVALID_TERM, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:08:25.084445 27740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e0d496efc3f41f3be82a538ef3cfdac" candidate_uuid: "18435fbb525741328139e84a1e354954" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "665f7e09521a4c3f9284c1d8b0e094ff"
I20260709 13:08:25.085580 27668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e0d496efc3f41f3be82a538ef3cfdac" candidate_uuid: "18435fbb525741328139e84a1e354954" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "41268b218b804905a110c86738e74400"
I20260709 13:08:25.085958 27862 raft_consensus.cc:359] T 9e94954fc474414ba7563be776d6c80a P 665f7e09521a4c3f9284c1d8b0e094ff [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "41268b218b804905a110c86738e74400" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 44403 } } peers { permanent_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 38749 } } peers { permanent_uuid: "18435fbb525741328139e84a1e354954" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 40545 } }
I20260709 13:08:25.086644 27862 raft_consensus.cc:385] T 9e94954fc474414ba7563be776d6c80a P 665f7e09521a4c3f9284c1d8b0e094ff [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:25.088119 27559 leader_election.cc:304] T 2d994cb13f8f453284bcb1f8b85824a2 P 2513a663afac495eb09126ff55e8b2b0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2513a663afac495eb09126ff55e8b2b0, 41268b218b804905a110c86738e74400; no voters: 
I20260709 13:08:25.087462 27861 raft_consensus.cc:359] T 5a55d1bac7374ff6b83cc7bae2d3b1f3 P 2513a663afac495eb09126ff55e8b2b0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18435fbb525741328139e84a1e354954" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 40545 } } peers { permanent_uuid: "2513a663afac495eb09126ff55e8b2b0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40721 } } peers { permanent_uuid: "41268b218b804905a110c86738e74400" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 44403 } }
I20260709 13:08:25.091617 27870 raft_consensus.cc:2804] T 2d994cb13f8f453284bcb1f8b85824a2 P 2513a663afac495eb09126ff55e8b2b0 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:08:25.091387 27861 raft_consensus.cc:385] T 5a55d1bac7374ff6b83cc7bae2d3b1f3 P 2513a663afac495eb09126ff55e8b2b0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:25.092243 27861 raft_consensus.cc:740] T 5a55d1bac7374ff6b83cc7bae2d3b1f3 P 2513a663afac495eb09126ff55e8b2b0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2513a663afac495eb09126ff55e8b2b0, State: Initialized, Role: FOLLOWER
I20260709 13:08:25.092497 27782 leader_election.cc:304] T 8e0d496efc3f41f3be82a538ef3cfdac P 18435fbb525741328139e84a1e354954 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 18435fbb525741328139e84a1e354954; no voters: 41268b218b804905a110c86738e74400, 665f7e09521a4c3f9284c1d8b0e094ff
I20260709 13:08:25.092859 27861 consensus_queue.cc:260] T 5a55d1bac7374ff6b83cc7bae2d3b1f3 P 2513a663afac495eb09126ff55e8b2b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18435fbb525741328139e84a1e354954" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 40545 } } peers { permanent_uuid: "2513a663afac495eb09126ff55e8b2b0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40721 } } peers { permanent_uuid: "41268b218b804905a110c86738e74400" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 44403 } }
I20260709 13:08:25.086949 27862 raft_consensus.cc:740] T 9e94954fc474414ba7563be776d6c80a P 665f7e09521a4c3f9284c1d8b0e094ff [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 665f7e09521a4c3f9284c1d8b0e094ff, State: Initialized, Role: FOLLOWER
I20260709 13:08:25.056488 28216 raft_consensus.cc:493] T 2d994cb13f8f453284bcb1f8b85824a2 P 18435fbb525741328139e84a1e354954 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:25.094743 27870 raft_consensus.cc:697] T 2d994cb13f8f453284bcb1f8b85824a2 P 2513a663afac495eb09126ff55e8b2b0 [term 1 LEADER]: Becoming Leader. State: Replica: 2513a663afac495eb09126ff55e8b2b0, State: Running, Role: LEADER
I20260709 13:08:25.095104 27862 consensus_queue.cc:260] T 9e94954fc474414ba7563be776d6c80a P 665f7e09521a4c3f9284c1d8b0e094ff [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "41268b218b804905a110c86738e74400" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 44403 } } peers { permanent_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 38749 } } peers { permanent_uuid: "18435fbb525741328139e84a1e354954" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 40545 } }
I20260709 13:08:25.072078 27865 raft_consensus.cc:359] T 1c5e794c2a0a45fa99bcfde6aeb45d2e P 18435fbb525741328139e84a1e354954 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "41268b218b804905a110c86738e74400" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 44403 } } peers { permanent_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 38749 } } peers { permanent_uuid: "18435fbb525741328139e84a1e354954" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 40545 } }
I20260709 13:08:25.099363 27865 raft_consensus.cc:385] T 1c5e794c2a0a45fa99bcfde6aeb45d2e P 18435fbb525741328139e84a1e354954 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:25.097491 27870 consensus_queue.cc:237] T 2d994cb13f8f453284bcb1f8b85824a2 P 2513a663afac495eb09126ff55e8b2b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18435fbb525741328139e84a1e354954" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 40545 } } peers { permanent_uuid: "2513a663afac495eb09126ff55e8b2b0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40721 } } peers { permanent_uuid: "41268b218b804905a110c86738e74400" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 44403 } }
I20260709 13:08:25.104518 27863 raft_consensus.cc:359] T 28737c73be174729ad3e9d238af7d975 P 41268b218b804905a110c86738e74400 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18435fbb525741328139e84a1e354954" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 40545 } } peers { permanent_uuid: "2513a663afac495eb09126ff55e8b2b0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40721 } } peers { permanent_uuid: "41268b218b804905a110c86738e74400" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 44403 } }
I20260709 13:08:25.105408 27863 raft_consensus.cc:385] T 28737c73be174729ad3e9d238af7d975 P 41268b218b804905a110c86738e74400 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:25.107928 27862 ts_tablet_manager.cc:1434] T 9e94954fc474414ba7563be776d6c80a P 665f7e09521a4c3f9284c1d8b0e094ff: Time spent starting tablet: real 0.046s	user 0.003s	sys 0.003s
I20260709 13:08:25.105732 27863 raft_consensus.cc:740] T 28737c73be174729ad3e9d238af7d975 P 41268b218b804905a110c86738e74400 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 41268b218b804905a110c86738e74400, State: Initialized, Role: FOLLOWER
I20260709 13:08:25.110157 27863 consensus_queue.cc:260] T 28737c73be174729ad3e9d238af7d975 P 41268b218b804905a110c86738e74400 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18435fbb525741328139e84a1e354954" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 40545 } } peers { permanent_uuid: "2513a663afac495eb09126ff55e8b2b0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40721 } } peers { permanent_uuid: "41268b218b804905a110c86738e74400" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 44403 } }
I20260709 13:08:25.099674 27865 raft_consensus.cc:740] T 1c5e794c2a0a45fa99bcfde6aeb45d2e P 18435fbb525741328139e84a1e354954 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 18435fbb525741328139e84a1e354954, State: Initialized, Role: FOLLOWER
I20260709 13:08:25.094537 28157 raft_consensus.cc:3055] T 8e0d496efc3f41f3be82a538ef3cfdac P 665f7e09521a4c3f9284c1d8b0e094ff [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:08:25.116613 27861 ts_tablet_manager.cc:1434] T 5a55d1bac7374ff6b83cc7bae2d3b1f3 P 2513a663afac495eb09126ff55e8b2b0: Time spent starting tablet: real 0.047s	user 0.008s	sys 0.010s
I20260709 13:08:25.097209 28101 raft_consensus.cc:2749] T 8e0d496efc3f41f3be82a538ef3cfdac P 18435fbb525741328139e84a1e354954 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:08:25.123883 27865 consensus_queue.cc:260] T 1c5e794c2a0a45fa99bcfde6aeb45d2e P 18435fbb525741328139e84a1e354954 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "41268b218b804905a110c86738e74400" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 44403 } } peers { permanent_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 38749 } } peers { permanent_uuid: "18435fbb525741328139e84a1e354954" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 40545 } }
I20260709 13:08:25.128408 27863 ts_tablet_manager.cc:1434] T 28737c73be174729ad3e9d238af7d975 P 41268b218b804905a110c86738e74400: Time spent starting tablet: real 0.063s	user 0.009s	sys 0.000s
I20260709 13:08:25.129662 27865 ts_tablet_manager.cc:1434] T 1c5e794c2a0a45fa99bcfde6aeb45d2e P 18435fbb525741328139e84a1e354954: Time spent starting tablet: real 0.135s	user 0.006s	sys 0.000s
I20260709 13:08:25.122745 28157 raft_consensus.cc:740] T 8e0d496efc3f41f3be82a538ef3cfdac P 665f7e09521a4c3f9284c1d8b0e094ff [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 665f7e09521a4c3f9284c1d8b0e094ff, State: Running, Role: LEADER
I20260709 13:08:25.136395 27862 tablet_bootstrap.cc:492] T 585e960f8d0f42268f2fe98e1e7b83f0 P 665f7e09521a4c3f9284c1d8b0e094ff: Bootstrap starting.
I20260709 13:08:25.137663 27863 tablet_bootstrap.cc:492] T 539b1d2240654c74bd9054a06a8eaac6 P 41268b218b804905a110c86738e74400: Bootstrap starting.
I20260709 13:08:25.140074 27861 tablet_bootstrap.cc:492] T 2d68b1be563949efbcb4bbe71eddd0d8 P 2513a663afac495eb09126ff55e8b2b0: Bootstrap starting.
I20260709 13:08:25.143770 28157 consensus_queue.cc:260] T 8e0d496efc3f41f3be82a538ef3cfdac P 665f7e09521a4c3f9284c1d8b0e094ff [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "41268b218b804905a110c86738e74400" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 44403 } } peers { permanent_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 38749 } } peers { permanent_uuid: "18435fbb525741328139e84a1e354954" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 40545 } }
I20260709 13:08:25.145135 28157 raft_consensus.cc:3060] T 8e0d496efc3f41f3be82a538ef3cfdac P 665f7e09521a4c3f9284c1d8b0e094ff [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:25.130688 27815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d994cb13f8f453284bcb1f8b85824a2" candidate_uuid: "2513a663afac495eb09126ff55e8b2b0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "18435fbb525741328139e84a1e354954" is_pre_election: true
I20260709 13:08:25.147609 27862 tablet_bootstrap.cc:654] T 585e960f8d0f42268f2fe98e1e7b83f0 P 665f7e09521a4c3f9284c1d8b0e094ff: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:25.159088 27814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae05961ab7a94458b1ad2cde9785c63b" candidate_uuid: "2513a663afac495eb09126ff55e8b2b0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "18435fbb525741328139e84a1e354954"
I20260709 13:08:25.160244 28205 leader_election.cc:290] T 5a55d1bac7374ff6b83cc7bae2d3b1f3 P 18435fbb525741328139e84a1e354954 [CANDIDATE]: Term 1 election: Requested vote from peers 2513a663afac495eb09126ff55e8b2b0 (127.17.223.1:40721), 41268b218b804905a110c86738e74400 (127.17.223.2:44403)
I20260709 13:08:25.103609 28216 raft_consensus.cc:515] T 2d994cb13f8f453284bcb1f8b85824a2 P 18435fbb525741328139e84a1e354954 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18435fbb525741328139e84a1e354954" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 40545 } } peers { permanent_uuid: "2513a663afac495eb09126ff55e8b2b0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40721 } } peers { permanent_uuid: "41268b218b804905a110c86738e74400" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 44403 } }
I20260709 13:08:25.165803 27815 raft_consensus.cc:2468] T 2d994cb13f8f453284bcb1f8b85824a2 P 18435fbb525741328139e84a1e354954 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2513a663afac495eb09126ff55e8b2b0 in term 0.
I20260709 13:08:25.166290 28216 leader_election.cc:290] T 2d994cb13f8f453284bcb1f8b85824a2 P 18435fbb525741328139e84a1e354954 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2513a663afac495eb09126ff55e8b2b0 (127.17.223.1:40721), 41268b218b804905a110c86738e74400 (127.17.223.2:44403)
I20260709 13:08:25.166592 27668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a55d1bac7374ff6b83cc7bae2d3b1f3" candidate_uuid: "18435fbb525741328139e84a1e354954" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "41268b218b804905a110c86738e74400"
I20260709 13:08:25.170161 27668 raft_consensus.cc:3060] T 5a55d1bac7374ff6b83cc7bae2d3b1f3 P 41268b218b804905a110c86738e74400 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:25.171813 27865 tablet_bootstrap.cc:492] T ae05961ab7a94458b1ad2cde9785c63b P 18435fbb525741328139e84a1e354954: Bootstrap starting.
I20260709 13:08:25.173759 27903 raft_consensus.cc:493] T ea92a607c73b4d289d081146089a86f9 P 665f7e09521a4c3f9284c1d8b0e094ff [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:25.174230 27903 raft_consensus.cc:515] T ea92a607c73b4d289d081146089a86f9 P 665f7e09521a4c3f9284c1d8b0e094ff [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2513a663afac495eb09126ff55e8b2b0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40721 } } peers { permanent_uuid: "41268b218b804905a110c86738e74400" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 44403 } } peers { permanent_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 38749 } }
I20260709 13:08:25.167511 27816 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d994cb13f8f453284bcb1f8b85824a2" candidate_uuid: "2513a663afac495eb09126ff55e8b2b0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "18435fbb525741328139e84a1e354954"
I20260709 13:08:25.168164 27666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d994cb13f8f453284bcb1f8b85824a2" candidate_uuid: "18435fbb525741328139e84a1e354954" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "41268b218b804905a110c86738e74400" is_pre_election: true
I20260709 13:08:25.178169 27903 leader_election.cc:290] T ea92a607c73b4d289d081146089a86f9 P 665f7e09521a4c3f9284c1d8b0e094ff [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2513a663afac495eb09126ff55e8b2b0 (127.17.223.1:40721), 41268b218b804905a110c86738e74400 (127.17.223.2:44403)
I20260709 13:08:25.178550 27666 raft_consensus.cc:2393] T 2d994cb13f8f453284bcb1f8b85824a2 P 41268b218b804905a110c86738e74400 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 18435fbb525741328139e84a1e354954 in current term 1: Already voted for candidate 2513a663afac495eb09126ff55e8b2b0 in this term.
I20260709 13:08:25.178745 27865 tablet_bootstrap.cc:654] T ae05961ab7a94458b1ad2cde9785c63b P 18435fbb525741328139e84a1e354954: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:25.180599 27861 tablet_bootstrap.cc:654] T 2d68b1be563949efbcb4bbe71eddd0d8 P 2513a663afac495eb09126ff55e8b2b0: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:25.184078 27668 raft_consensus.cc:2468] T 5a55d1bac7374ff6b83cc7bae2d3b1f3 P 41268b218b804905a110c86738e74400 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 18435fbb525741328139e84a1e354954 in term 1.
I20260709 13:08:25.168618 27863 tablet_bootstrap.cc:654] T 539b1d2240654c74bd9054a06a8eaac6 P 41268b218b804905a110c86738e74400: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:25.184450 28212 consensus_queue.cc:1048] T 8e758d59bd4a4eae9f67662e165013f9 P 665f7e09521a4c3f9284c1d8b0e094ff [LEADER]: Connected to new peer: Peer: permanent_uuid: "41268b218b804905a110c86738e74400" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 44403 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:08:25.188587 27668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea92a607c73b4d289d081146089a86f9" candidate_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "41268b218b804905a110c86738e74400" is_pre_election: true
I20260709 13:08:25.190989 27668 raft_consensus.cc:2468] T ea92a607c73b4d289d081146089a86f9 P 41268b218b804905a110c86738e74400 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 665f7e09521a4c3f9284c1d8b0e094ff in term 0.
I20260709 13:08:25.194532 27865 tablet_bootstrap.cc:492] T ae05961ab7a94458b1ad2cde9785c63b P 18435fbb525741328139e84a1e354954: No bootstrap required, opened a new log
I20260709 13:08:25.195061 27865 ts_tablet_manager.cc:1403] T ae05961ab7a94458b1ad2cde9785c63b P 18435fbb525741328139e84a1e354954: Time spent bootstrapping tablet: real 0.023s	user 0.014s	sys 0.003s
I20260709 13:08:25.196410 27708 leader_election.cc:304] T ea92a607c73b4d289d081146089a86f9 P 665f7e09521a4c3f9284c1d8b0e094ff [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 41268b218b804905a110c86738e74400, 665f7e09521a4c3f9284c1d8b0e094ff; no voters: 
I20260709 13:08:25.197803 28212 raft_consensus.cc:2804] T ea92a607c73b4d289d081146089a86f9 P 665f7e09521a4c3f9284c1d8b0e094ff [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:08:25.192134 27782 leader_election.cc:304] T 5a55d1bac7374ff6b83cc7bae2d3b1f3 P 18435fbb525741328139e84a1e354954 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 18435fbb525741328139e84a1e354954, 41268b218b804905a110c86738e74400; no voters: 
I20260709 13:08:25.192471 27862 tablet_bootstrap.cc:492] T 585e960f8d0f42268f2fe98e1e7b83f0 P 665f7e09521a4c3f9284c1d8b0e094ff: No bootstrap required, opened a new log
I20260709 13:08:25.201709 28205 raft_consensus.cc:2804] T 5a55d1bac7374ff6b83cc7bae2d3b1f3 P 18435fbb525741328139e84a1e354954 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:08:25.202080 27592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea92a607c73b4d289d081146089a86f9" candidate_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2513a663afac495eb09126ff55e8b2b0" is_pre_election: true
I20260709 13:08:25.202185 28205 raft_consensus.cc:697] T 5a55d1bac7374ff6b83cc7bae2d3b1f3 P 18435fbb525741328139e84a1e354954 [term 1 LEADER]: Becoming Leader. State: Replica: 18435fbb525741328139e84a1e354954, State: Running, Role: LEADER
I20260709 13:08:25.202337 27487 catalog_manager.cc:5697] T ae05961ab7a94458b1ad2cde9785c63b P 2513a663afac495eb09126ff55e8b2b0 reported cstate change: term changed from 0 to 1, leader changed from <none> to 2513a663afac495eb09126ff55e8b2b0 (127.17.223.1). New cstate: current_term: 1 leader_uuid: "2513a663afac495eb09126ff55e8b2b0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 38749 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "18435fbb525741328139e84a1e354954" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 40545 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2513a663afac495eb09126ff55e8b2b0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40721 } health_report { overall_health: HEALTHY } } }
I20260709 13:08:25.203248 28205 consensus_queue.cc:237] T 5a55d1bac7374ff6b83cc7bae2d3b1f3 P 18435fbb525741328139e84a1e354954 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18435fbb525741328139e84a1e354954" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 40545 } } peers { permanent_uuid: "2513a663afac495eb09126ff55e8b2b0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40721 } } peers { permanent_uuid: "41268b218b804905a110c86738e74400" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 44403 } }
I20260709 13:08:25.198244 28212 raft_consensus.cc:493] T ea92a607c73b4d289d081146089a86f9 P 665f7e09521a4c3f9284c1d8b0e094ff [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:25.205392 28212 raft_consensus.cc:3060] T ea92a607c73b4d289d081146089a86f9 P 665f7e09521a4c3f9284c1d8b0e094ff [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:08:25.189149 27634 leader_election.cc:343] T afcb3b39d1c9495eab95404687865537 P 41268b218b804905a110c86738e74400 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 18435fbb525741328139e84a1e354954 (127.17.223.4:40545): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:25.199177 27862 ts_tablet_manager.cc:1403] T 585e960f8d0f42268f2fe98e1e7b83f0 P 665f7e09521a4c3f9284c1d8b0e094ff: Time spent bootstrapping tablet: real 0.066s	user 0.016s	sys 0.003s
I20260709 13:08:25.210325 27592 raft_consensus.cc:2468] T ea92a607c73b4d289d081146089a86f9 P 2513a663afac495eb09126ff55e8b2b0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 665f7e09521a4c3f9284c1d8b0e094ff in term 0.
I20260709 13:08:25.214823 27634 leader_election.cc:304] T afcb3b39d1c9495eab95404687865537 P 41268b218b804905a110c86738e74400 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 41268b218b804905a110c86738e74400; no voters: 18435fbb525741328139e84a1e354954, 665f7e09521a4c3f9284c1d8b0e094ff
I20260709 13:08:25.217123 28196 raft_consensus.cc:2749] T afcb3b39d1c9495eab95404687865537 P 41268b218b804905a110c86738e74400 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:08:25.217689 27903 consensus_queue.cc:1048] T 8e758d59bd4a4eae9f67662e165013f9 P 665f7e09521a4c3f9284c1d8b0e094ff [LEADER]: Connected to new peer: Peer: permanent_uuid: "2513a663afac495eb09126ff55e8b2b0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40721 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:08:25.197805 27865 raft_consensus.cc:359] T ae05961ab7a94458b1ad2cde9785c63b P 18435fbb525741328139e84a1e354954 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 38749 } } peers { permanent_uuid: "18435fbb525741328139e84a1e354954" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 40545 } } peers { permanent_uuid: "2513a663afac495eb09126ff55e8b2b0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40721 } }
I20260709 13:08:25.218776 27865 raft_consensus.cc:385] T ae05961ab7a94458b1ad2cde9785c63b P 18435fbb525741328139e84a1e354954 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:25.220456 27862 raft_consensus.cc:359] T 585e960f8d0f42268f2fe98e1e7b83f0 P 665f7e09521a4c3f9284c1d8b0e094ff [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2513a663afac495eb09126ff55e8b2b0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40721 } } peers { permanent_uuid: "41268b218b804905a110c86738e74400" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 44403 } } peers { permanent_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 38749 } }
I20260709 13:08:25.221572 27862 raft_consensus.cc:385] T 585e960f8d0f42268f2fe98e1e7b83f0 P 665f7e09521a4c3f9284c1d8b0e094ff [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:25.222510 27862 raft_consensus.cc:740] T 585e960f8d0f42268f2fe98e1e7b83f0 P 665f7e09521a4c3f9284c1d8b0e094ff [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 665f7e09521a4c3f9284c1d8b0e094ff, State: Initialized, Role: FOLLOWER
I20260709 13:08:25.224572 27862 consensus_queue.cc:260] T 585e960f8d0f42268f2fe98e1e7b83f0 P 665f7e09521a4c3f9284c1d8b0e094ff [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2513a663afac495eb09126ff55e8b2b0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40721 } } peers { permanent_uuid: "41268b218b804905a110c86738e74400" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 44403 } } peers { permanent_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 38749 } }
I20260709 13:08:25.229444 27816 raft_consensus.cc:3060] T 1c5e794c2a0a45fa99bcfde6aeb45d2e P 18435fbb525741328139e84a1e354954 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:25.219082 27865 raft_consensus.cc:740] T ae05961ab7a94458b1ad2cde9785c63b P 18435fbb525741328139e84a1e354954 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 18435fbb525741328139e84a1e354954, State: Initialized, Role: FOLLOWER
I20260709 13:08:25.235773 27862 ts_tablet_manager.cc:1434] T 585e960f8d0f42268f2fe98e1e7b83f0 P 665f7e09521a4c3f9284c1d8b0e094ff: Time spent starting tablet: real 0.021s	user 0.006s	sys 0.000s
I20260709 13:08:25.236932 27865 consensus_queue.cc:260] T ae05961ab7a94458b1ad2cde9785c63b P 18435fbb525741328139e84a1e354954 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 38749 } } peers { permanent_uuid: "18435fbb525741328139e84a1e354954" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 40545 } } peers { permanent_uuid: "2513a663afac495eb09126ff55e8b2b0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40721 } }
I20260709 13:08:25.238510 27862 tablet_bootstrap.cc:492] T 9c0f604d66664505aa9469fb058601b6 P 665f7e09521a4c3f9284c1d8b0e094ff: Bootstrap starting.
I20260709 13:08:25.239281 28196 consensus_queue.cc:1048] T 1c5e794c2a0a45fa99bcfde6aeb45d2e P 41268b218b804905a110c86738e74400 [LEADER]: Connected to new peer: Peer: permanent_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 38749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:08:25.241577 28212 raft_consensus.cc:515] T ea92a607c73b4d289d081146089a86f9 P 665f7e09521a4c3f9284c1d8b0e094ff [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2513a663afac495eb09126ff55e8b2b0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40721 } } peers { permanent_uuid: "41268b218b804905a110c86738e74400" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 44403 } } peers { permanent_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 38749 } }
W20260709 13:08:25.244359 27559 leader_election.cc:343] T ae05961ab7a94458b1ad2cde9785c63b P 2513a663afac495eb09126ff55e8b2b0 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 18435fbb525741328139e84a1e354954 (127.17.223.4:40545): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:25.247114 27865 ts_tablet_manager.cc:1434] T ae05961ab7a94458b1ad2cde9785c63b P 18435fbb525741328139e84a1e354954: Time spent starting tablet: real 0.052s	user 0.007s	sys 0.000s
I20260709 13:08:25.256613 27589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a55d1bac7374ff6b83cc7bae2d3b1f3" candidate_uuid: "18435fbb525741328139e84a1e354954" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2513a663afac495eb09126ff55e8b2b0"
I20260709 13:08:25.257302 27589 raft_consensus.cc:3060] T 5a55d1bac7374ff6b83cc7bae2d3b1f3 P 2513a663afac495eb09126ff55e8b2b0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:25.258072 27591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d994cb13f8f453284bcb1f8b85824a2" candidate_uuid: "18435fbb525741328139e84a1e354954" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2513a663afac495eb09126ff55e8b2b0" is_pre_election: true
I20260709 13:08:25.267388 27779 leader_election.cc:304] T 2d994cb13f8f453284bcb1f8b85824a2 P 18435fbb525741328139e84a1e354954 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 18435fbb525741328139e84a1e354954; no voters: 2513a663afac495eb09126ff55e8b2b0, 41268b218b804905a110c86738e74400
I20260709 13:08:25.268515 28205 raft_consensus.cc:3060] T 2d994cb13f8f453284bcb1f8b85824a2 P 18435fbb525741328139e84a1e354954 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:25.263417 28197 consensus_queue.cc:1048] T 1c5e794c2a0a45fa99bcfde6aeb45d2e P 41268b218b804905a110c86738e74400 [LEADER]: Connected to new peer: Peer: permanent_uuid: "18435fbb525741328139e84a1e354954" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 40545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 13:08:25.285439 27861 tablet_bootstrap.cc:492] T 2d68b1be563949efbcb4bbe71eddd0d8 P 2513a663afac495eb09126ff55e8b2b0: No bootstrap required, opened a new log
I20260709 13:08:25.288757 27861 ts_tablet_manager.cc:1403] T 2d68b1be563949efbcb4bbe71eddd0d8 P 2513a663afac495eb09126ff55e8b2b0: Time spent bootstrapping tablet: real 0.153s	user 0.010s	sys 0.005s
I20260709 13:08:25.288214 27489 catalog_manager.cc:5697] T 5a55d1bac7374ff6b83cc7bae2d3b1f3 P 18435fbb525741328139e84a1e354954 reported cstate change: term changed from 0 to 1, leader changed from <none> to 18435fbb525741328139e84a1e354954 (127.17.223.4). New cstate: current_term: 1 leader_uuid: "18435fbb525741328139e84a1e354954" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18435fbb525741328139e84a1e354954" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 40545 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2513a663afac495eb09126ff55e8b2b0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40721 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "41268b218b804905a110c86738e74400" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 44403 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:25.294282 27865 tablet_bootstrap.cc:492] T 2d68b1be563949efbcb4bbe71eddd0d8 P 18435fbb525741328139e84a1e354954: Bootstrap starting.
I20260709 13:08:25.302956 28216 raft_consensus.cc:493] T ae05961ab7a94458b1ad2cde9785c63b P 18435fbb525741328139e84a1e354954 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:25.303521 28216 raft_consensus.cc:515] T ae05961ab7a94458b1ad2cde9785c63b P 18435fbb525741328139e84a1e354954 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 38749 } } peers { permanent_uuid: "18435fbb525741328139e84a1e354954" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 40545 } } peers { permanent_uuid: "2513a663afac495eb09126ff55e8b2b0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40721 } }
I20260709 13:08:25.309674 27740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae05961ab7a94458b1ad2cde9785c63b" candidate_uuid: "18435fbb525741328139e84a1e354954" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" is_pre_election: true
I20260709 13:08:25.310590 27740 raft_consensus.cc:2393] T ae05961ab7a94458b1ad2cde9785c63b P 665f7e09521a4c3f9284c1d8b0e094ff [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 18435fbb525741328139e84a1e354954 in current term 1: Already voted for candidate 2513a663afac495eb09126ff55e8b2b0 in this term.
I20260709 13:08:25.312549 28216 leader_election.cc:290] T ae05961ab7a94458b1ad2cde9785c63b P 18435fbb525741328139e84a1e354954 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 665f7e09521a4c3f9284c1d8b0e094ff (127.17.223.3:38749), 2513a663afac495eb09126ff55e8b2b0 (127.17.223.1:40721)
I20260709 13:08:25.306146 27589 raft_consensus.cc:2468] T 5a55d1bac7374ff6b83cc7bae2d3b1f3 P 2513a663afac495eb09126ff55e8b2b0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 18435fbb525741328139e84a1e354954 in term 1.
I20260709 13:08:25.317201 27865 tablet_bootstrap.cc:654] T 2d68b1be563949efbcb4bbe71eddd0d8 P 18435fbb525741328139e84a1e354954: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:25.317559 27591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae05961ab7a94458b1ad2cde9785c63b" candidate_uuid: "18435fbb525741328139e84a1e354954" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2513a663afac495eb09126ff55e8b2b0" is_pre_election: true
I20260709 13:08:25.313191 27861 raft_consensus.cc:359] T 2d68b1be563949efbcb4bbe71eddd0d8 P 2513a663afac495eb09126ff55e8b2b0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 38749 } } peers { permanent_uuid: "18435fbb525741328139e84a1e354954" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 40545 } } peers { permanent_uuid: "2513a663afac495eb09126ff55e8b2b0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40721 } }
I20260709 13:08:25.319576 27861 raft_consensus.cc:385] T 2d68b1be563949efbcb4bbe71eddd0d8 P 2513a663afac495eb09126ff55e8b2b0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:25.319988 27861 raft_consensus.cc:740] T 2d68b1be563949efbcb4bbe71eddd0d8 P 2513a663afac495eb09126ff55e8b2b0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2513a663afac495eb09126ff55e8b2b0, State: Initialized, Role: FOLLOWER
I20260709 13:08:25.320878 27861 consensus_queue.cc:260] T 2d68b1be563949efbcb4bbe71eddd0d8 P 2513a663afac495eb09126ff55e8b2b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 38749 } } peers { permanent_uuid: "18435fbb525741328139e84a1e354954" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 40545 } } peers { permanent_uuid: "2513a663afac495eb09126ff55e8b2b0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40721 } }
I20260709 13:08:25.330211 27863 tablet_bootstrap.cc:492] T 539b1d2240654c74bd9054a06a8eaac6 P 41268b218b804905a110c86738e74400: No bootstrap required, opened a new log
I20260709 13:08:25.330919 27863 ts_tablet_manager.cc:1403] T 539b1d2240654c74bd9054a06a8eaac6 P 41268b218b804905a110c86738e74400: Time spent bootstrapping tablet: real 0.198s	user 0.009s	sys 0.022s
I20260709 13:08:25.332644 27779 leader_election.cc:304] T ae05961ab7a94458b1ad2cde9785c63b P 18435fbb525741328139e84a1e354954 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 18435fbb525741328139e84a1e354954; no voters: 2513a663afac495eb09126ff55e8b2b0, 665f7e09521a4c3f9284c1d8b0e094ff
I20260709 13:08:25.333933 27861 ts_tablet_manager.cc:1434] T 2d68b1be563949efbcb4bbe71eddd0d8 P 2513a663afac495eb09126ff55e8b2b0: Time spent starting tablet: real 0.045s	user 0.003s	sys 0.005s
I20260709 13:08:25.333953 28216 raft_consensus.cc:3060] T ae05961ab7a94458b1ad2cde9785c63b P 18435fbb525741328139e84a1e354954 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:25.335269 27861 tablet_bootstrap.cc:492] T 28737c73be174729ad3e9d238af7d975 P 2513a663afac495eb09126ff55e8b2b0: Bootstrap starting.
I20260709 13:08:25.341496 27903 raft_consensus.cc:493] T 9e94954fc474414ba7563be776d6c80a P 665f7e09521a4c3f9284c1d8b0e094ff [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:25.341987 27903 raft_consensus.cc:515] T 9e94954fc474414ba7563be776d6c80a P 665f7e09521a4c3f9284c1d8b0e094ff [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "41268b218b804905a110c86738e74400" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 44403 } } peers { permanent_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 38749 } } peers { permanent_uuid: "18435fbb525741328139e84a1e354954" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 40545 } }
I20260709 13:08:25.338543 27489 catalog_manager.cc:5697] T 2d994cb13f8f453284bcb1f8b85824a2 P 2513a663afac495eb09126ff55e8b2b0 reported cstate change: term changed from 0 to 1, leader changed from <none> to 2513a663afac495eb09126ff55e8b2b0 (127.17.223.1). New cstate: current_term: 1 leader_uuid: "2513a663afac495eb09126ff55e8b2b0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18435fbb525741328139e84a1e354954" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 40545 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2513a663afac495eb09126ff55e8b2b0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40721 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "41268b218b804905a110c86738e74400" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 44403 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:25.344703 27903 leader_election.cc:290] T 9e94954fc474414ba7563be776d6c80a P 665f7e09521a4c3f9284c1d8b0e094ff [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 41268b218b804905a110c86738e74400 (127.17.223.2:44403), 18435fbb525741328139e84a1e354954 (127.17.223.4:40545)
I20260709 13:08:25.347527 27815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e94954fc474414ba7563be776d6c80a" candidate_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "18435fbb525741328139e84a1e354954" is_pre_election: true
I20260709 13:08:25.349361 27667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e94954fc474414ba7563be776d6c80a" candidate_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "41268b218b804905a110c86738e74400" is_pre_election: true
I20260709 13:08:25.350013 27667 raft_consensus.cc:2468] T 9e94954fc474414ba7563be776d6c80a P 41268b218b804905a110c86738e74400 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 665f7e09521a4c3f9284c1d8b0e094ff in term 0.
I20260709 13:08:25.353152 27862 tablet_bootstrap.cc:654] T 9c0f604d66664505aa9469fb058601b6 P 665f7e09521a4c3f9284c1d8b0e094ff: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:25.329605 28205 raft_consensus.cc:2749] T 2d994cb13f8f453284bcb1f8b85824a2 P 18435fbb525741328139e84a1e354954 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:08:25.356351 27708 leader_election.cc:304] T 9e94954fc474414ba7563be776d6c80a P 665f7e09521a4c3f9284c1d8b0e094ff [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 41268b218b804905a110c86738e74400, 665f7e09521a4c3f9284c1d8b0e094ff; no voters: 
I20260709 13:08:25.358297 27903 raft_consensus.cc:2804] T 9e94954fc474414ba7563be776d6c80a P 665f7e09521a4c3f9284c1d8b0e094ff [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:08:25.358893 27903 raft_consensus.cc:493] T 9e94954fc474414ba7563be776d6c80a P 665f7e09521a4c3f9284c1d8b0e094ff [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:08:25.358460 27708 leader_election.cc:343] T 9e94954fc474414ba7563be776d6c80a P 665f7e09521a4c3f9284c1d8b0e094ff [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 18435fbb525741328139e84a1e354954 (127.17.223.4:40545): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:25.359294 27903 raft_consensus.cc:3060] T 9e94954fc474414ba7563be776d6c80a P 665f7e09521a4c3f9284c1d8b0e094ff [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:25.372438 28212 leader_election.cc:290] T ea92a607c73b4d289d081146089a86f9 P 665f7e09521a4c3f9284c1d8b0e094ff [CANDIDATE]: Term 1 election: Requested vote from peers 2513a663afac495eb09126ff55e8b2b0 (127.17.223.1:40721), 41268b218b804905a110c86738e74400 (127.17.223.2:44403)
I20260709 13:08:25.377753 27667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea92a607c73b4d289d081146089a86f9" candidate_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "41268b218b804905a110c86738e74400"
I20260709 13:08:25.378366 27667 raft_consensus.cc:3060] T ea92a607c73b4d289d081146089a86f9 P 41268b218b804905a110c86738e74400 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:25.382053 27861 tablet_bootstrap.cc:654] T 28737c73be174729ad3e9d238af7d975 P 2513a663afac495eb09126ff55e8b2b0: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:25.377554 27903 raft_consensus.cc:515] T 9e94954fc474414ba7563be776d6c80a P 665f7e09521a4c3f9284c1d8b0e094ff [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "41268b218b804905a110c86738e74400" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 44403 } } peers { permanent_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 38749 } } peers { permanent_uuid: "18435fbb525741328139e84a1e354954" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 40545 } }
I20260709 13:08:25.385929 27903 leader_election.cc:290] T 9e94954fc474414ba7563be776d6c80a P 665f7e09521a4c3f9284c1d8b0e094ff [CANDIDATE]: Term 1 election: Requested vote from peers 41268b218b804905a110c86738e74400 (127.17.223.2:44403), 18435fbb525741328139e84a1e354954 (127.17.223.4:40545)
I20260709 13:08:25.388661 27865 tablet_bootstrap.cc:492] T 2d68b1be563949efbcb4bbe71eddd0d8 P 18435fbb525741328139e84a1e354954: No bootstrap required, opened a new log
I20260709 13:08:25.389194 27865 ts_tablet_manager.cc:1403] T 2d68b1be563949efbcb4bbe71eddd0d8 P 18435fbb525741328139e84a1e354954: Time spent bootstrapping tablet: real 0.123s	user 0.013s	sys 0.012s
I20260709 13:08:25.390955 27816 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e94954fc474414ba7563be776d6c80a" candidate_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "18435fbb525741328139e84a1e354954"
W20260709 13:08:25.392486 27708 leader_election.cc:343] T 9e94954fc474414ba7563be776d6c80a P 665f7e09521a4c3f9284c1d8b0e094ff [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 18435fbb525741328139e84a1e354954 (127.17.223.4:40545): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:25.394024 27865 raft_consensus.cc:359] T 2d68b1be563949efbcb4bbe71eddd0d8 P 18435fbb525741328139e84a1e354954 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 38749 } } peers { permanent_uuid: "18435fbb525741328139e84a1e354954" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 40545 } } peers { permanent_uuid: "2513a663afac495eb09126ff55e8b2b0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40721 } }
I20260709 13:08:25.394742 27865 raft_consensus.cc:385] T 2d68b1be563949efbcb4bbe71eddd0d8 P 18435fbb525741328139e84a1e354954 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:25.399052 27865 raft_consensus.cc:740] T 2d68b1be563949efbcb4bbe71eddd0d8 P 18435fbb525741328139e84a1e354954 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 18435fbb525741328139e84a1e354954, State: Initialized, Role: FOLLOWER
I20260709 13:08:25.399699 27865 consensus_queue.cc:260] T 2d68b1be563949efbcb4bbe71eddd0d8 P 18435fbb525741328139e84a1e354954 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 38749 } } peers { permanent_uuid: "18435fbb525741328139e84a1e354954" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 40545 } } peers { permanent_uuid: "2513a663afac495eb09126ff55e8b2b0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40721 } }
I20260709 13:08:25.401826 27865 ts_tablet_manager.cc:1434] T 2d68b1be563949efbcb4bbe71eddd0d8 P 18435fbb525741328139e84a1e354954: Time spent starting tablet: real 0.010s	user 0.003s	sys 0.000s
I20260709 13:08:25.402886 27592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea92a607c73b4d289d081146089a86f9" candidate_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2513a663afac495eb09126ff55e8b2b0"
I20260709 13:08:25.403538 27592 raft_consensus.cc:3060] T ea92a607c73b4d289d081146089a86f9 P 2513a663afac495eb09126ff55e8b2b0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:25.404908 28213 raft_consensus.cc:493] T 2d68b1be563949efbcb4bbe71eddd0d8 P 2513a663afac495eb09126ff55e8b2b0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:25.405418 28213 raft_consensus.cc:515] T 2d68b1be563949efbcb4bbe71eddd0d8 P 2513a663afac495eb09126ff55e8b2b0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 38749 } } peers { permanent_uuid: "18435fbb525741328139e84a1e354954" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 40545 } } peers { permanent_uuid: "2513a663afac495eb09126ff55e8b2b0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40721 } }
I20260709 13:08:25.407588 28213 leader_election.cc:290] T 2d68b1be563949efbcb4bbe71eddd0d8 P 2513a663afac495eb09126ff55e8b2b0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 665f7e09521a4c3f9284c1d8b0e094ff (127.17.223.3:38749), 18435fbb525741328139e84a1e354954 (127.17.223.4:40545)
I20260709 13:08:25.410267 27865 tablet_bootstrap.cc:492] T 9e94954fc474414ba7563be776d6c80a P 18435fbb525741328139e84a1e354954: Bootstrap starting.
I20260709 13:08:25.411242 27740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d68b1be563949efbcb4bbe71eddd0d8" candidate_uuid: "2513a663afac495eb09126ff55e8b2b0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" is_pre_election: true
I20260709 13:08:25.412778 27740 raft_consensus.cc:2468] T 2d68b1be563949efbcb4bbe71eddd0d8 P 665f7e09521a4c3f9284c1d8b0e094ff [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2513a663afac495eb09126ff55e8b2b0 in term 0.
I20260709 13:08:25.413697 27668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e94954fc474414ba7563be776d6c80a" candidate_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "41268b218b804905a110c86738e74400"
I20260709 13:08:25.414312 27668 raft_consensus.cc:3060] T 9e94954fc474414ba7563be776d6c80a P 41268b218b804905a110c86738e74400 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:25.414966 27559 leader_election.cc:304] T 2d68b1be563949efbcb4bbe71eddd0d8 P 2513a663afac495eb09126ff55e8b2b0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2513a663afac495eb09126ff55e8b2b0, 665f7e09521a4c3f9284c1d8b0e094ff; no voters: 
I20260709 13:08:25.415782 28213 raft_consensus.cc:2804] T 2d68b1be563949efbcb4bbe71eddd0d8 P 2513a663afac495eb09126ff55e8b2b0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:08:25.416501 28213 raft_consensus.cc:493] T 2d68b1be563949efbcb4bbe71eddd0d8 P 2513a663afac495eb09126ff55e8b2b0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:25.416466 27816 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d68b1be563949efbcb4bbe71eddd0d8" candidate_uuid: "2513a663afac495eb09126ff55e8b2b0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "18435fbb525741328139e84a1e354954" is_pre_election: true
I20260709 13:08:25.417210 28213 raft_consensus.cc:3060] T 2d68b1be563949efbcb4bbe71eddd0d8 P 2513a663afac495eb09126ff55e8b2b0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:25.417582 27816 raft_consensus.cc:2468] T 2d68b1be563949efbcb4bbe71eddd0d8 P 18435fbb525741328139e84a1e354954 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2513a663afac495eb09126ff55e8b2b0 in term 0.
I20260709 13:08:25.419878 27667 raft_consensus.cc:2468] T ea92a607c73b4d289d081146089a86f9 P 41268b218b804905a110c86738e74400 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 665f7e09521a4c3f9284c1d8b0e094ff in term 1.
I20260709 13:08:25.423254 27708 leader_election.cc:304] T ea92a607c73b4d289d081146089a86f9 P 665f7e09521a4c3f9284c1d8b0e094ff [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 41268b218b804905a110c86738e74400, 665f7e09521a4c3f9284c1d8b0e094ff; no voters: 
I20260709 13:08:25.424870 27903 raft_consensus.cc:2804] T ea92a607c73b4d289d081146089a86f9 P 665f7e09521a4c3f9284c1d8b0e094ff [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:08:25.426546 27903 raft_consensus.cc:697] T ea92a607c73b4d289d081146089a86f9 P 665f7e09521a4c3f9284c1d8b0e094ff [term 1 LEADER]: Becoming Leader. State: Replica: 665f7e09521a4c3f9284c1d8b0e094ff, State: Running, Role: LEADER
I20260709 13:08:25.427201 27668 raft_consensus.cc:2468] T 9e94954fc474414ba7563be776d6c80a P 41268b218b804905a110c86738e74400 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 665f7e09521a4c3f9284c1d8b0e094ff in term 1.
I20260709 13:08:25.428375 27708 leader_election.cc:304] T 9e94954fc474414ba7563be776d6c80a P 665f7e09521a4c3f9284c1d8b0e094ff [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 41268b218b804905a110c86738e74400, 665f7e09521a4c3f9284c1d8b0e094ff; no voters: 18435fbb525741328139e84a1e354954
I20260709 13:08:25.429118 28212 raft_consensus.cc:2804] T 9e94954fc474414ba7563be776d6c80a P 665f7e09521a4c3f9284c1d8b0e094ff [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:08:25.429608 28212 raft_consensus.cc:697] T 9e94954fc474414ba7563be776d6c80a P 665f7e09521a4c3f9284c1d8b0e094ff [term 1 LEADER]: Becoming Leader. State: Replica: 665f7e09521a4c3f9284c1d8b0e094ff, State: Running, Role: LEADER
I20260709 13:08:25.425031 27592 raft_consensus.cc:2468] T ea92a607c73b4d289d081146089a86f9 P 2513a663afac495eb09126ff55e8b2b0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 665f7e09521a4c3f9284c1d8b0e094ff in term 1.
I20260709 13:08:25.425438 28196 raft_consensus.cc:493] T 28737c73be174729ad3e9d238af7d975 P 41268b218b804905a110c86738e74400 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:25.427335 27903 consensus_queue.cc:237] T ea92a607c73b4d289d081146089a86f9 P 665f7e09521a4c3f9284c1d8b0e094ff [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2513a663afac495eb09126ff55e8b2b0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40721 } } peers { permanent_uuid: "41268b218b804905a110c86738e74400" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 44403 } } peers { permanent_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 38749 } }
I20260709 13:08:25.431384 28196 raft_consensus.cc:515] T 28737c73be174729ad3e9d238af7d975 P 41268b218b804905a110c86738e74400 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18435fbb525741328139e84a1e354954" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 40545 } } peers { permanent_uuid: "2513a663afac495eb09126ff55e8b2b0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40721 } } peers { permanent_uuid: "41268b218b804905a110c86738e74400" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 44403 } }
I20260709 13:08:25.430397 28212 consensus_queue.cc:237] T 9e94954fc474414ba7563be776d6c80a P 665f7e09521a4c3f9284c1d8b0e094ff [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "41268b218b804905a110c86738e74400" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 44403 } } peers { permanent_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 38749 } } peers { permanent_uuid: "18435fbb525741328139e84a1e354954" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 40545 } }
I20260709 13:08:25.446492 28216 raft_consensus.cc:2749] T ae05961ab7a94458b1ad2cde9785c63b P 18435fbb525741328139e84a1e354954 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:08:25.450449 27863 raft_consensus.cc:359] T 539b1d2240654c74bd9054a06a8eaac6 P 41268b218b804905a110c86738e74400 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "41268b218b804905a110c86738e74400" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 44403 } } peers { permanent_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 38749 } } peers { permanent_uuid: "18435fbb525741328139e84a1e354954" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 40545 } }
I20260709 13:08:25.454430 27863 raft_consensus.cc:385] T 539b1d2240654c74bd9054a06a8eaac6 P 41268b218b804905a110c86738e74400 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:25.460942 27862 tablet_bootstrap.cc:492] T 9c0f604d66664505aa9469fb058601b6 P 665f7e09521a4c3f9284c1d8b0e094ff: No bootstrap required, opened a new log
I20260709 13:08:25.461444 27862 ts_tablet_manager.cc:1403] T 9c0f604d66664505aa9469fb058601b6 P 665f7e09521a4c3f9284c1d8b0e094ff: Time spent bootstrapping tablet: real 0.223s	user 0.015s	sys 0.016s
I20260709 13:08:25.461349 27816 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28737c73be174729ad3e9d238af7d975" candidate_uuid: "41268b218b804905a110c86738e74400" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "18435fbb525741328139e84a1e354954" is_pre_election: true
I20260709 13:08:25.463212 27861 tablet_bootstrap.cc:492] T 28737c73be174729ad3e9d238af7d975 P 2513a663afac495eb09126ff55e8b2b0: No bootstrap required, opened a new log
W20260709 13:08:25.463380 27634 leader_election.cc:343] T 28737c73be174729ad3e9d238af7d975 P 41268b218b804905a110c86738e74400 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 18435fbb525741328139e84a1e354954 (127.17.223.4:40545): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:25.463701 27861 ts_tablet_manager.cc:1403] T 28737c73be174729ad3e9d238af7d975 P 2513a663afac495eb09126ff55e8b2b0: Time spent bootstrapping tablet: real 0.129s	user 0.013s	sys 0.002s
I20260709 13:08:25.464152 27862 raft_consensus.cc:359] T 9c0f604d66664505aa9469fb058601b6 P 665f7e09521a4c3f9284c1d8b0e094ff [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 38749 } } peers { permanent_uuid: "18435fbb525741328139e84a1e354954" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 40545 } } peers { permanent_uuid: "2513a663afac495eb09126ff55e8b2b0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40721 } }
I20260709 13:08:25.464829 27862 raft_consensus.cc:385] T 9c0f604d66664505aa9469fb058601b6 P 665f7e09521a4c3f9284c1d8b0e094ff [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:25.465093 27862 raft_consensus.cc:740] T 9c0f604d66664505aa9469fb058601b6 P 665f7e09521a4c3f9284c1d8b0e094ff [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 665f7e09521a4c3f9284c1d8b0e094ff, State: Initialized, Role: FOLLOWER
I20260709 13:08:25.465747 27862 consensus_queue.cc:260] T 9c0f604d66664505aa9469fb058601b6 P 665f7e09521a4c3f9284c1d8b0e094ff [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 38749 } } peers { permanent_uuid: "18435fbb525741328139e84a1e354954" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 40545 } } peers { permanent_uuid: "2513a663afac495eb09126ff55e8b2b0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40721 } }
I20260709 13:08:25.454727 27863 raft_consensus.cc:740] T 539b1d2240654c74bd9054a06a8eaac6 P 41268b218b804905a110c86738e74400 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 41268b218b804905a110c86738e74400, State: Initialized, Role: FOLLOWER
I20260709 13:08:25.469992 27863 consensus_queue.cc:260] T 539b1d2240654c74bd9054a06a8eaac6 P 41268b218b804905a110c86738e74400 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "41268b218b804905a110c86738e74400" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 44403 } } peers { permanent_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 38749 } } peers { permanent_uuid: "18435fbb525741328139e84a1e354954" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 40545 } }
I20260709 13:08:25.467872 27862 ts_tablet_manager.cc:1434] T 9c0f604d66664505aa9469fb058601b6 P 665f7e09521a4c3f9284c1d8b0e094ff: Time spent starting tablet: real 0.006s	user 0.007s	sys 0.000s
I20260709 13:08:25.471673 27862 tablet_bootstrap.cc:492] T e23b142958324f69aa0bad3a5828fa83 P 665f7e09521a4c3f9284c1d8b0e094ff: Bootstrap starting.
I20260709 13:08:25.468355 27861 raft_consensus.cc:359] T 28737c73be174729ad3e9d238af7d975 P 2513a663afac495eb09126ff55e8b2b0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18435fbb525741328139e84a1e354954" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 40545 } } peers { permanent_uuid: "2513a663afac495eb09126ff55e8b2b0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40721 } } peers { permanent_uuid: "41268b218b804905a110c86738e74400" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 44403 } }
I20260709 13:08:25.472227 28213 raft_consensus.cc:515] T 2d68b1be563949efbcb4bbe71eddd0d8 P 2513a663afac495eb09126ff55e8b2b0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 38749 } } peers { permanent_uuid: "18435fbb525741328139e84a1e354954" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 40545 } } peers { permanent_uuid: "2513a663afac495eb09126ff55e8b2b0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40721 } }
I20260709 13:08:25.472288 27861 raft_consensus.cc:385] T 28737c73be174729ad3e9d238af7d975 P 2513a663afac495eb09126ff55e8b2b0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:25.473675 27861 raft_consensus.cc:740] T 28737c73be174729ad3e9d238af7d975 P 2513a663afac495eb09126ff55e8b2b0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2513a663afac495eb09126ff55e8b2b0, State: Initialized, Role: FOLLOWER
I20260709 13:08:25.474306 27861 consensus_queue.cc:260] T 28737c73be174729ad3e9d238af7d975 P 2513a663afac495eb09126ff55e8b2b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18435fbb525741328139e84a1e354954" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 40545 } } peers { permanent_uuid: "2513a663afac495eb09126ff55e8b2b0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40721 } } peers { permanent_uuid: "41268b218b804905a110c86738e74400" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 44403 } }
I20260709 13:08:25.475138 27741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d68b1be563949efbcb4bbe71eddd0d8" candidate_uuid: "2513a663afac495eb09126ff55e8b2b0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "665f7e09521a4c3f9284c1d8b0e094ff"
I20260709 13:08:25.475728 27741 raft_consensus.cc:3060] T 2d68b1be563949efbcb4bbe71eddd0d8 P 665f7e09521a4c3f9284c1d8b0e094ff [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:25.476284 27863 ts_tablet_manager.cc:1434] T 539b1d2240654c74bd9054a06a8eaac6 P 41268b218b804905a110c86738e74400: Time spent starting tablet: real 0.145s	user 0.008s	sys 0.001s
I20260709 13:08:25.477296 27863 tablet_bootstrap.cc:492] T b6be829f6d3f40c99a3c5be18b0c259c P 41268b218b804905a110c86738e74400: Bootstrap starting.
I20260709 13:08:25.482519 27592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28737c73be174729ad3e9d238af7d975" candidate_uuid: "41268b218b804905a110c86738e74400" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2513a663afac495eb09126ff55e8b2b0" is_pre_election: true
I20260709 13:08:25.483219 27592 raft_consensus.cc:2468] T 28737c73be174729ad3e9d238af7d975 P 2513a663afac495eb09126ff55e8b2b0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 41268b218b804905a110c86738e74400 in term 0.
I20260709 13:08:25.484503 27631 leader_election.cc:304] T 28737c73be174729ad3e9d238af7d975 P 41268b218b804905a110c86738e74400 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2513a663afac495eb09126ff55e8b2b0, 41268b218b804905a110c86738e74400; no voters: 18435fbb525741328139e84a1e354954
I20260709 13:08:25.485265 28197 raft_consensus.cc:2804] T 28737c73be174729ad3e9d238af7d975 P 41268b218b804905a110c86738e74400 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:08:25.485620 28197 raft_consensus.cc:493] T 28737c73be174729ad3e9d238af7d975 P 41268b218b804905a110c86738e74400 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:25.485949 28197 raft_consensus.cc:3060] T 28737c73be174729ad3e9d238af7d975 P 41268b218b804905a110c86738e74400 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:25.485280 28196 leader_election.cc:290] T 28737c73be174729ad3e9d238af7d975 P 41268b218b804905a110c86738e74400 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 18435fbb525741328139e84a1e354954 (127.17.223.4:40545), 2513a663afac495eb09126ff55e8b2b0 (127.17.223.1:40721)
I20260709 13:08:25.489395 27861 ts_tablet_manager.cc:1434] T 28737c73be174729ad3e9d238af7d975 P 2513a663afac495eb09126ff55e8b2b0: Time spent starting tablet: real 0.025s	user 0.006s	sys 0.002s
I20260709 13:08:25.493794 27865 tablet_bootstrap.cc:654] T 9e94954fc474414ba7563be776d6c80a P 18435fbb525741328139e84a1e354954: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:25.493921 28197 raft_consensus.cc:515] T 28737c73be174729ad3e9d238af7d975 P 41268b218b804905a110c86738e74400 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18435fbb525741328139e84a1e354954" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 40545 } } peers { permanent_uuid: "2513a663afac495eb09126ff55e8b2b0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40721 } } peers { permanent_uuid: "41268b218b804905a110c86738e74400" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 44403 } }
I20260709 13:08:25.495245 27861 tablet_bootstrap.cc:492] T 9c0f604d66664505aa9469fb058601b6 P 2513a663afac495eb09126ff55e8b2b0: Bootstrap starting.
I20260709 13:08:25.496220 28197 leader_election.cc:290] T 28737c73be174729ad3e9d238af7d975 P 41268b218b804905a110c86738e74400 [CANDIDATE]: Term 1 election: Requested vote from peers 18435fbb525741328139e84a1e354954 (127.17.223.4:40545), 2513a663afac495eb09126ff55e8b2b0 (127.17.223.1:40721)
I20260709 13:08:25.496933 27862 tablet_bootstrap.cc:654] T e23b142958324f69aa0bad3a5828fa83 P 665f7e09521a4c3f9284c1d8b0e094ff: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:25.497670 27816 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28737c73be174729ad3e9d238af7d975" candidate_uuid: "41268b218b804905a110c86738e74400" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "18435fbb525741328139e84a1e354954"
I20260709 13:08:25.498917 27592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28737c73be174729ad3e9d238af7d975" candidate_uuid: "41268b218b804905a110c86738e74400" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2513a663afac495eb09126ff55e8b2b0"
I20260709 13:08:25.499532 27592 raft_consensus.cc:3060] T 28737c73be174729ad3e9d238af7d975 P 2513a663afac495eb09126ff55e8b2b0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:25.500511 27863 tablet_bootstrap.cc:654] T b6be829f6d3f40c99a3c5be18b0c259c P 41268b218b804905a110c86738e74400: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:25.506122 27741 raft_consensus.cc:2468] T 2d68b1be563949efbcb4bbe71eddd0d8 P 665f7e09521a4c3f9284c1d8b0e094ff [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2513a663afac495eb09126ff55e8b2b0 in term 1.
W20260709 13:08:25.508152 27634 leader_election.cc:343] T 28737c73be174729ad3e9d238af7d975 P 41268b218b804905a110c86738e74400 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 18435fbb525741328139e84a1e354954 (127.17.223.4:40545): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:25.511777 27559 leader_election.cc:304] T 2d68b1be563949efbcb4bbe71eddd0d8 P 2513a663afac495eb09126ff55e8b2b0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2513a663afac495eb09126ff55e8b2b0, 665f7e09521a4c3f9284c1d8b0e094ff; no voters: 
I20260709 13:08:25.512075 27862 tablet_bootstrap.cc:492] T e23b142958324f69aa0bad3a5828fa83 P 665f7e09521a4c3f9284c1d8b0e094ff: No bootstrap required, opened a new log
I20260709 13:08:25.512665 28229 raft_consensus.cc:2804] T 2d68b1be563949efbcb4bbe71eddd0d8 P 2513a663afac495eb09126ff55e8b2b0 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:08:25.513217 27862 ts_tablet_manager.cc:1403] T e23b142958324f69aa0bad3a5828fa83 P 665f7e09521a4c3f9284c1d8b0e094ff: Time spent bootstrapping tablet: real 0.042s	user 0.008s	sys 0.005s
I20260709 13:08:25.513424 28229 raft_consensus.cc:697] T 2d68b1be563949efbcb4bbe71eddd0d8 P 2513a663afac495eb09126ff55e8b2b0 [term 1 LEADER]: Becoming Leader. State: Replica: 2513a663afac495eb09126ff55e8b2b0, State: Running, Role: LEADER
I20260709 13:08:25.515143 28213 leader_election.cc:290] T 2d68b1be563949efbcb4bbe71eddd0d8 P 2513a663afac495eb09126ff55e8b2b0 [CANDIDATE]: Term 1 election: Requested vote from peers 665f7e09521a4c3f9284c1d8b0e094ff (127.17.223.3:38749), 18435fbb525741328139e84a1e354954 (127.17.223.4:40545)
I20260709 13:08:25.515401 28229 consensus_queue.cc:237] T 2d68b1be563949efbcb4bbe71eddd0d8 P 2513a663afac495eb09126ff55e8b2b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 38749 } } peers { permanent_uuid: "18435fbb525741328139e84a1e354954" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 40545 } } peers { permanent_uuid: "2513a663afac495eb09126ff55e8b2b0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40721 } }
I20260709 13:08:25.520891 28214 consensus_queue.cc:1048] T 2d994cb13f8f453284bcb1f8b85824a2 P 2513a663afac495eb09126ff55e8b2b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "41268b218b804905a110c86738e74400" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 44403 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:08:25.515992 27862 raft_consensus.cc:359] T e23b142958324f69aa0bad3a5828fa83 P 665f7e09521a4c3f9284c1d8b0e094ff [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2513a663afac495eb09126ff55e8b2b0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40721 } } peers { permanent_uuid: "41268b218b804905a110c86738e74400" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 44403 } } peers { permanent_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 38749 } }
I20260709 13:08:25.516471 28215 raft_consensus.cc:493] T 585e960f8d0f42268f2fe98e1e7b83f0 P 665f7e09521a4c3f9284c1d8b0e094ff [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:25.529285 28215 raft_consensus.cc:515] T 585e960f8d0f42268f2fe98e1e7b83f0 P 665f7e09521a4c3f9284c1d8b0e094ff [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2513a663afac495eb09126ff55e8b2b0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40721 } } peers { permanent_uuid: "41268b218b804905a110c86738e74400" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 44403 } } peers { permanent_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 38749 } }
I20260709 13:08:25.518189 27816 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d68b1be563949efbcb4bbe71eddd0d8" candidate_uuid: "2513a663afac495eb09126ff55e8b2b0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "18435fbb525741328139e84a1e354954"
I20260709 13:08:25.531558 28215 leader_election.cc:290] T 585e960f8d0f42268f2fe98e1e7b83f0 P 665f7e09521a4c3f9284c1d8b0e094ff [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2513a663afac495eb09126ff55e8b2b0 (127.17.223.1:40721), 41268b218b804905a110c86738e74400 (127.17.223.2:44403)
I20260709 13:08:25.532177 27591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "585e960f8d0f42268f2fe98e1e7b83f0" candidate_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2513a663afac495eb09126ff55e8b2b0" is_pre_election: true
I20260709 13:08:25.532819 27862 raft_consensus.cc:385] T e23b142958324f69aa0bad3a5828fa83 P 665f7e09521a4c3f9284c1d8b0e094ff [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:25.532646 27668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "585e960f8d0f42268f2fe98e1e7b83f0" candidate_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "41268b218b804905a110c86738e74400" is_pre_election: true
W20260709 13:08:25.534080 27705 leader_election.cc:343] T 585e960f8d0f42268f2fe98e1e7b83f0 P 665f7e09521a4c3f9284c1d8b0e094ff [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2513a663afac495eb09126ff55e8b2b0 (127.17.223.1:40721): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:25.534363 27668 raft_consensus.cc:2468] T 585e960f8d0f42268f2fe98e1e7b83f0 P 41268b218b804905a110c86738e74400 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 665f7e09521a4c3f9284c1d8b0e094ff in term 0.
I20260709 13:08:25.534313 27862 raft_consensus.cc:740] T e23b142958324f69aa0bad3a5828fa83 P 665f7e09521a4c3f9284c1d8b0e094ff [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 665f7e09521a4c3f9284c1d8b0e094ff, State: Initialized, Role: FOLLOWER
I20260709 13:08:25.530939 27816 raft_consensus.cc:3060] T 2d68b1be563949efbcb4bbe71eddd0d8 P 18435fbb525741328139e84a1e354954 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:25.537393 27708 leader_election.cc:304] T 585e960f8d0f42268f2fe98e1e7b83f0 P 665f7e09521a4c3f9284c1d8b0e094ff [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 41268b218b804905a110c86738e74400, 665f7e09521a4c3f9284c1d8b0e094ff; no voters: 2513a663afac495eb09126ff55e8b2b0
I20260709 13:08:25.539583 28082 raft_consensus.cc:2804] T 585e960f8d0f42268f2fe98e1e7b83f0 P 665f7e09521a4c3f9284c1d8b0e094ff [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:08:25.539968 28082 raft_consensus.cc:493] T 585e960f8d0f42268f2fe98e1e7b83f0 P 665f7e09521a4c3f9284c1d8b0e094ff [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:25.540305 28082 raft_consensus.cc:3060] T 585e960f8d0f42268f2fe98e1e7b83f0 P 665f7e09521a4c3f9284c1d8b0e094ff [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:25.544665 27861 tablet_bootstrap.cc:654] T 9c0f604d66664505aa9469fb058601b6 P 2513a663afac495eb09126ff55e8b2b0: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:25.537236 27862 consensus_queue.cc:260] T e23b142958324f69aa0bad3a5828fa83 P 665f7e09521a4c3f9284c1d8b0e094ff [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2513a663afac495eb09126ff55e8b2b0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40721 } } peers { permanent_uuid: "41268b218b804905a110c86738e74400" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 44403 } } peers { permanent_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 38749 } }
I20260709 13:08:25.536171 27592 raft_consensus.cc:2468] T 28737c73be174729ad3e9d238af7d975 P 2513a663afac495eb09126ff55e8b2b0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 41268b218b804905a110c86738e74400 in term 1.
I20260709 13:08:25.548161 27631 leader_election.cc:304] T 28737c73be174729ad3e9d238af7d975 P 41268b218b804905a110c86738e74400 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2513a663afac495eb09126ff55e8b2b0, 41268b218b804905a110c86738e74400; no voters: 18435fbb525741328139e84a1e354954
I20260709 13:08:25.549171 27862 ts_tablet_manager.cc:1434] T e23b142958324f69aa0bad3a5828fa83 P 665f7e09521a4c3f9284c1d8b0e094ff: Time spent starting tablet: real 0.036s	user 0.006s	sys 0.001s
I20260709 13:08:25.551204 27862 tablet_bootstrap.cc:492] T afcb3b39d1c9495eab95404687865537 P 665f7e09521a4c3f9284c1d8b0e094ff: Bootstrap starting.
I20260709 13:08:25.559036 27865 tablet_bootstrap.cc:492] T 9e94954fc474414ba7563be776d6c80a P 18435fbb525741328139e84a1e354954: No bootstrap required, opened a new log
I20260709 13:08:25.559486 27865 ts_tablet_manager.cc:1403] T 9e94954fc474414ba7563be776d6c80a P 18435fbb525741328139e84a1e354954: Time spent bootstrapping tablet: real 0.149s	user 0.006s	sys 0.005s
I20260709 13:08:25.551517 27816 raft_consensus.cc:2468] T 2d68b1be563949efbcb4bbe71eddd0d8 P 18435fbb525741328139e84a1e354954 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2513a663afac495eb09126ff55e8b2b0 in term 1.
I20260709 13:08:25.549598 28196 raft_consensus.cc:2804] T 28737c73be174729ad3e9d238af7d975 P 41268b218b804905a110c86738e74400 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:08:25.563247 28196 raft_consensus.cc:697] T 28737c73be174729ad3e9d238af7d975 P 41268b218b804905a110c86738e74400 [term 1 LEADER]: Becoming Leader. State: Replica: 41268b218b804905a110c86738e74400, State: Running, Role: LEADER
I20260709 13:08:25.563431 27865 raft_consensus.cc:359] T 9e94954fc474414ba7563be776d6c80a P 18435fbb525741328139e84a1e354954 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "41268b218b804905a110c86738e74400" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 44403 } } peers { permanent_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 38749 } } peers { permanent_uuid: "18435fbb525741328139e84a1e354954" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 40545 } }
I20260709 13:08:25.564123 28196 consensus_queue.cc:237] T 28737c73be174729ad3e9d238af7d975 P 41268b218b804905a110c86738e74400 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18435fbb525741328139e84a1e354954" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 40545 } } peers { permanent_uuid: "2513a663afac495eb09126ff55e8b2b0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40721 } } peers { permanent_uuid: "41268b218b804905a110c86738e74400" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 44403 } }
I20260709 13:08:25.565053 27862 tablet_bootstrap.cc:654] T afcb3b39d1c9495eab95404687865537 P 665f7e09521a4c3f9284c1d8b0e094ff: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:25.566062 27861 tablet_bootstrap.cc:492] T 9c0f604d66664505aa9469fb058601b6 P 2513a663afac495eb09126ff55e8b2b0: No bootstrap required, opened a new log
I20260709 13:08:25.566522 27861 ts_tablet_manager.cc:1403] T 9c0f604d66664505aa9469fb058601b6 P 2513a663afac495eb09126ff55e8b2b0: Time spent bootstrapping tablet: real 0.072s	user 0.008s	sys 0.002s
I20260709 13:08:25.558419 27863 tablet_bootstrap.cc:492] T b6be829f6d3f40c99a3c5be18b0c259c P 41268b218b804905a110c86738e74400: No bootstrap required, opened a new log
I20260709 13:08:25.567775 27863 ts_tablet_manager.cc:1403] T b6be829f6d3f40c99a3c5be18b0c259c P 41268b218b804905a110c86738e74400: Time spent bootstrapping tablet: real 0.091s	user 0.014s	sys 0.009s
I20260709 13:08:25.569700 27489 catalog_manager.cc:5697] T ea92a607c73b4d289d081146089a86f9 P 665f7e09521a4c3f9284c1d8b0e094ff reported cstate change: term changed from 0 to 1, leader changed from <none> to 665f7e09521a4c3f9284c1d8b0e094ff (127.17.223.3). New cstate: current_term: 1 leader_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2513a663afac495eb09126ff55e8b2b0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40721 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "41268b218b804905a110c86738e74400" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 44403 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 38749 } health_report { overall_health: HEALTHY } } }
I20260709 13:08:25.564137 27865 raft_consensus.cc:385] T 9e94954fc474414ba7563be776d6c80a P 18435fbb525741328139e84a1e354954 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:25.573297 27865 raft_consensus.cc:740] T 9e94954fc474414ba7563be776d6c80a P 18435fbb525741328139e84a1e354954 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 18435fbb525741328139e84a1e354954, State: Initialized, Role: FOLLOWER
I20260709 13:08:25.573973 27865 consensus_queue.cc:260] T 9e94954fc474414ba7563be776d6c80a P 18435fbb525741328139e84a1e354954 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "41268b218b804905a110c86738e74400" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 44403 } } peers { permanent_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 38749 } } peers { permanent_uuid: "18435fbb525741328139e84a1e354954" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 40545 } }
I20260709 13:08:25.570428 27863 raft_consensus.cc:359] T b6be829f6d3f40c99a3c5be18b0c259c P 41268b218b804905a110c86738e74400 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18435fbb525741328139e84a1e354954" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 40545 } } peers { permanent_uuid: "2513a663afac495eb09126ff55e8b2b0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40721 } } peers { permanent_uuid: "41268b218b804905a110c86738e74400" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 44403 } }
I20260709 13:08:25.576224 27863 raft_consensus.cc:385] T b6be829f6d3f40c99a3c5be18b0c259c P 41268b218b804905a110c86738e74400 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:25.576509 27863 raft_consensus.cc:740] T b6be829f6d3f40c99a3c5be18b0c259c P 41268b218b804905a110c86738e74400 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 41268b218b804905a110c86738e74400, State: Initialized, Role: FOLLOWER
I20260709 13:08:25.577174 27863 consensus_queue.cc:260] T b6be829f6d3f40c99a3c5be18b0c259c P 41268b218b804905a110c86738e74400 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18435fbb525741328139e84a1e354954" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 40545 } } peers { permanent_uuid: "2513a663afac495eb09126ff55e8b2b0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40721 } } peers { permanent_uuid: "41268b218b804905a110c86738e74400" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 44403 } }
I20260709 13:08:25.580907 27865 ts_tablet_manager.cc:1434] T 9e94954fc474414ba7563be776d6c80a P 18435fbb525741328139e84a1e354954: Time spent starting tablet: real 0.021s	user 0.006s	sys 0.000s
I20260709 13:08:25.580601 27861 raft_consensus.cc:359] T 9c0f604d66664505aa9469fb058601b6 P 2513a663afac495eb09126ff55e8b2b0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 38749 } } peers { permanent_uuid: "18435fbb525741328139e84a1e354954" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 40545 } } peers { permanent_uuid: "2513a663afac495eb09126ff55e8b2b0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40721 } }
I20260709 13:08:25.581583 27861 raft_consensus.cc:385] T 9c0f604d66664505aa9469fb058601b6 P 2513a663afac495eb09126ff55e8b2b0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:25.581974 27861 raft_consensus.cc:740] T 9c0f604d66664505aa9469fb058601b6 P 2513a663afac495eb09126ff55e8b2b0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2513a663afac495eb09126ff55e8b2b0, State: Initialized, Role: FOLLOWER
I20260709 13:08:25.583650 27863 ts_tablet_manager.cc:1434] T b6be829f6d3f40c99a3c5be18b0c259c P 41268b218b804905a110c86738e74400: Time spent starting tablet: real 0.016s	user 0.005s	sys 0.000s
I20260709 13:08:25.583351 27861 consensus_queue.cc:260] T 9c0f604d66664505aa9469fb058601b6 P 2513a663afac495eb09126ff55e8b2b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 38749 } } peers { permanent_uuid: "18435fbb525741328139e84a1e354954" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 40545 } } peers { permanent_uuid: "2513a663afac495eb09126ff55e8b2b0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40721 } }
I20260709 13:08:25.580909 27491 catalog_manager.cc:5697] T 2d68b1be563949efbcb4bbe71eddd0d8 P 2513a663afac495eb09126ff55e8b2b0 reported cstate change: term changed from 0 to 1, leader changed from <none> to 2513a663afac495eb09126ff55e8b2b0 (127.17.223.1). New cstate: current_term: 1 leader_uuid: "2513a663afac495eb09126ff55e8b2b0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 38749 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "18435fbb525741328139e84a1e354954" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 40545 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2513a663afac495eb09126ff55e8b2b0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40721 } health_report { overall_health: HEALTHY } } }
I20260709 13:08:25.594499 27861 ts_tablet_manager.cc:1434] T 9c0f604d66664505aa9469fb058601b6 P 2513a663afac495eb09126ff55e8b2b0: Time spent starting tablet: real 0.028s	user 0.006s	sys 0.000s
I20260709 13:08:25.595963 27861 tablet_bootstrap.cc:492] T 585e960f8d0f42268f2fe98e1e7b83f0 P 2513a663afac495eb09126ff55e8b2b0: Bootstrap starting.
I20260709 13:08:25.581974 27865 tablet_bootstrap.cc:492] T 28737c73be174729ad3e9d238af7d975 P 18435fbb525741328139e84a1e354954: Bootstrap starting.
I20260709 13:08:25.601109 27862 tablet_bootstrap.cc:492] T afcb3b39d1c9495eab95404687865537 P 665f7e09521a4c3f9284c1d8b0e094ff: No bootstrap required, opened a new log
I20260709 13:08:25.601591 27862 ts_tablet_manager.cc:1403] T afcb3b39d1c9495eab95404687865537 P 665f7e09521a4c3f9284c1d8b0e094ff: Time spent bootstrapping tablet: real 0.051s	user 0.012s	sys 0.027s
I20260709 13:08:25.606148 28212 raft_consensus.cc:493] T e23b142958324f69aa0bad3a5828fa83 P 665f7e09521a4c3f9284c1d8b0e094ff [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:25.606779 28212 raft_consensus.cc:515] T e23b142958324f69aa0bad3a5828fa83 P 665f7e09521a4c3f9284c1d8b0e094ff [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2513a663afac495eb09126ff55e8b2b0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40721 } } peers { permanent_uuid: "41268b218b804905a110c86738e74400" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 44403 } } peers { permanent_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 38749 } }
I20260709 13:08:25.609247 28212 leader_election.cc:290] T e23b142958324f69aa0bad3a5828fa83 P 665f7e09521a4c3f9284c1d8b0e094ff [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2513a663afac495eb09126ff55e8b2b0 (127.17.223.1:40721), 41268b218b804905a110c86738e74400 (127.17.223.2:44403)
I20260709 13:08:25.610050 27861 tablet_bootstrap.cc:654] T 585e960f8d0f42268f2fe98e1e7b83f0 P 2513a663afac495eb09126ff55e8b2b0: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:25.612699 27865 tablet_bootstrap.cc:654] T 28737c73be174729ad3e9d238af7d975 P 18435fbb525741328139e84a1e354954: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:25.616259 27592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e23b142958324f69aa0bad3a5828fa83" candidate_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2513a663afac495eb09126ff55e8b2b0" is_pre_election: true
W20260709 13:08:25.618125 27705 leader_election.cc:343] T e23b142958324f69aa0bad3a5828fa83 P 665f7e09521a4c3f9284c1d8b0e094ff [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2513a663afac495eb09126ff55e8b2b0 (127.17.223.1:40721): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:25.621181 27667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e23b142958324f69aa0bad3a5828fa83" candidate_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "41268b218b804905a110c86738e74400" is_pre_election: true
I20260709 13:08:25.621971 27667 raft_consensus.cc:2468] T e23b142958324f69aa0bad3a5828fa83 P 41268b218b804905a110c86738e74400 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 665f7e09521a4c3f9284c1d8b0e094ff in term 0.
I20260709 13:08:25.626953 27865 tablet_bootstrap.cc:492] T 28737c73be174729ad3e9d238af7d975 P 18435fbb525741328139e84a1e354954: No bootstrap required, opened a new log
I20260709 13:08:25.627442 27865 ts_tablet_manager.cc:1403] T 28737c73be174729ad3e9d238af7d975 P 18435fbb525741328139e84a1e354954: Time spent bootstrapping tablet: real 0.046s	user 0.011s	sys 0.003s
I20260709 13:08:25.627893 27708 leader_election.cc:304] T e23b142958324f69aa0bad3a5828fa83 P 665f7e09521a4c3f9284c1d8b0e094ff [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 41268b218b804905a110c86738e74400, 665f7e09521a4c3f9284c1d8b0e094ff; no voters: 2513a663afac495eb09126ff55e8b2b0
I20260709 13:08:25.632277 28212 raft_consensus.cc:2804] T e23b142958324f69aa0bad3a5828fa83 P 665f7e09521a4c3f9284c1d8b0e094ff [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:08:25.632845 28212 raft_consensus.cc:493] T e23b142958324f69aa0bad3a5828fa83 P 665f7e09521a4c3f9284c1d8b0e094ff [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:25.633239 28212 raft_consensus.cc:3060] T e23b142958324f69aa0bad3a5828fa83 P 665f7e09521a4c3f9284c1d8b0e094ff [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:25.636584 27862 raft_consensus.cc:359] T afcb3b39d1c9495eab95404687865537 P 665f7e09521a4c3f9284c1d8b0e094ff [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "41268b218b804905a110c86738e74400" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 44403 } } peers { permanent_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 38749 } } peers { permanent_uuid: "18435fbb525741328139e84a1e354954" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 40545 } }
I20260709 13:08:25.637322 27862 raft_consensus.cc:385] T afcb3b39d1c9495eab95404687865537 P 665f7e09521a4c3f9284c1d8b0e094ff [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:25.637583 27862 raft_consensus.cc:740] T afcb3b39d1c9495eab95404687865537 P 665f7e09521a4c3f9284c1d8b0e094ff [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 665f7e09521a4c3f9284c1d8b0e094ff, State: Initialized, Role: FOLLOWER
I20260709 13:08:25.641328 27863 tablet_bootstrap.cc:492] T 86af954f570648969cbc47c03d15c447 P 41268b218b804905a110c86738e74400: Bootstrap starting.
I20260709 13:08:25.642424 28214 consensus_queue.cc:1048] T ae05961ab7a94458b1ad2cde9785c63b P 2513a663afac495eb09126ff55e8b2b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 38749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:08:25.643587 27865 raft_consensus.cc:359] T 28737c73be174729ad3e9d238af7d975 P 18435fbb525741328139e84a1e354954 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18435fbb525741328139e84a1e354954" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 40545 } } peers { permanent_uuid: "2513a663afac495eb09126ff55e8b2b0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40721 } } peers { permanent_uuid: "41268b218b804905a110c86738e74400" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 44403 } }
I20260709 13:08:25.644260 27865 raft_consensus.cc:385] T 28737c73be174729ad3e9d238af7d975 P 18435fbb525741328139e84a1e354954 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:25.644531 27865 raft_consensus.cc:740] T 28737c73be174729ad3e9d238af7d975 P 18435fbb525741328139e84a1e354954 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 18435fbb525741328139e84a1e354954, State: Initialized, Role: FOLLOWER
I20260709 13:08:25.645180 27865 consensus_queue.cc:260] T 28737c73be174729ad3e9d238af7d975 P 18435fbb525741328139e84a1e354954 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18435fbb525741328139e84a1e354954" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 40545 } } peers { permanent_uuid: "2513a663afac495eb09126ff55e8b2b0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40721 } } peers { permanent_uuid: "41268b218b804905a110c86738e74400" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 44403 } }
I20260709 13:08:25.646445 28219 raft_consensus.cc:493] T 9e94954fc474414ba7563be776d6c80a P 18435fbb525741328139e84a1e354954 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:25.646996 28214 consensus_queue.cc:1048] T ae05961ab7a94458b1ad2cde9785c63b P 2513a663afac495eb09126ff55e8b2b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "18435fbb525741328139e84a1e354954" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 40545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:08:25.646922 28219 raft_consensus.cc:515] T 9e94954fc474414ba7563be776d6c80a P 18435fbb525741328139e84a1e354954 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "41268b218b804905a110c86738e74400" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 44403 } } peers { permanent_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 38749 } } peers { permanent_uuid: "18435fbb525741328139e84a1e354954" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 40545 } }
I20260709 13:08:25.649490 28219 leader_election.cc:290] T 9e94954fc474414ba7563be776d6c80a P 18435fbb525741328139e84a1e354954 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 41268b218b804905a110c86738e74400 (127.17.223.2:44403), 665f7e09521a4c3f9284c1d8b0e094ff (127.17.223.3:38749)
I20260709 13:08:25.558561 28082 raft_consensus.cc:515] T 585e960f8d0f42268f2fe98e1e7b83f0 P 665f7e09521a4c3f9284c1d8b0e094ff [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2513a663afac495eb09126ff55e8b2b0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40721 } } peers { permanent_uuid: "41268b218b804905a110c86738e74400" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 44403 } } peers { permanent_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 38749 } }
I20260709 13:08:25.653718 28232 consensus_queue.cc:1048] T 2d994cb13f8f453284bcb1f8b85824a2 P 2513a663afac495eb09126ff55e8b2b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "18435fbb525741328139e84a1e354954" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 40545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:08:25.654067 27740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e94954fc474414ba7563be776d6c80a" candidate_uuid: "18435fbb525741328139e84a1e354954" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" is_pre_election: true
I20260709 13:08:25.657656 27862 consensus_queue.cc:260] T afcb3b39d1c9495eab95404687865537 P 665f7e09521a4c3f9284c1d8b0e094ff [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "41268b218b804905a110c86738e74400" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 44403 } } peers { permanent_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 38749 } } peers { permanent_uuid: "18435fbb525741328139e84a1e354954" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 40545 } }
I20260709 13:08:25.665958 27865 ts_tablet_manager.cc:1434] T 28737c73be174729ad3e9d238af7d975 P 18435fbb525741328139e84a1e354954: Time spent starting tablet: real 0.038s	user 0.008s	sys 0.002s
I20260709 13:08:25.668670 28212 raft_consensus.cc:515] T e23b142958324f69aa0bad3a5828fa83 P 665f7e09521a4c3f9284c1d8b0e094ff [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2513a663afac495eb09126ff55e8b2b0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40721 } } peers { permanent_uuid: "41268b218b804905a110c86738e74400" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 44403 } } peers { permanent_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 38749 } }
I20260709 13:08:25.652473 27667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e94954fc474414ba7563be776d6c80a" candidate_uuid: "18435fbb525741328139e84a1e354954" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "41268b218b804905a110c86738e74400" is_pre_election: true
I20260709 13:08:25.676432 27862 ts_tablet_manager.cc:1434] T afcb3b39d1c9495eab95404687865537 P 665f7e09521a4c3f9284c1d8b0e094ff: Time spent starting tablet: real 0.075s	user 0.007s	sys 0.002s
I20260709 13:08:25.682557 27667 raft_consensus.cc:2393] T 9e94954fc474414ba7563be776d6c80a P 41268b218b804905a110c86738e74400 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 18435fbb525741328139e84a1e354954 in current term 1: Already voted for candidate 665f7e09521a4c3f9284c1d8b0e094ff in this term.
I20260709 13:08:25.688210 27782 leader_election.cc:304] T 9e94954fc474414ba7563be776d6c80a P 18435fbb525741328139e84a1e354954 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 18435fbb525741328139e84a1e354954; no voters: 41268b218b804905a110c86738e74400, 665f7e09521a4c3f9284c1d8b0e094ff
I20260709 13:08:25.695254 27865 tablet_bootstrap.cc:492] T afcb3b39d1c9495eab95404687865537 P 18435fbb525741328139e84a1e354954: Bootstrap starting.
I20260709 13:08:25.696846 27591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "585e960f8d0f42268f2fe98e1e7b83f0" candidate_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2513a663afac495eb09126ff55e8b2b0"
I20260709 13:08:25.695250 28208 raft_consensus.cc:3060] T 9e94954fc474414ba7563be776d6c80a P 18435fbb525741328139e84a1e354954 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:25.698258 27861 tablet_bootstrap.cc:492] T 585e960f8d0f42268f2fe98e1e7b83f0 P 2513a663afac495eb09126ff55e8b2b0: No bootstrap required, opened a new log
I20260709 13:08:25.698794 27861 ts_tablet_manager.cc:1403] T 585e960f8d0f42268f2fe98e1e7b83f0 P 2513a663afac495eb09126ff55e8b2b0: Time spent bootstrapping tablet: real 0.103s	user 0.017s	sys 0.015s
I20260709 13:08:25.701000 27862 tablet_bootstrap.cc:492] T 9db60240699a4db2ba5faa2c50a742da P 665f7e09521a4c3f9284c1d8b0e094ff: Bootstrap starting.
I20260709 13:08:25.705447 27667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e23b142958324f69aa0bad3a5828fa83" candidate_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "41268b218b804905a110c86738e74400"
W20260709 13:08:25.705751 27705 leader_election.cc:343] T 585e960f8d0f42268f2fe98e1e7b83f0 P 665f7e09521a4c3f9284c1d8b0e094ff [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 2513a663afac495eb09126ff55e8b2b0 (127.17.223.1:40721): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:25.706101 27667 raft_consensus.cc:3060] T e23b142958324f69aa0bad3a5828fa83 P 41268b218b804905a110c86738e74400 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:25.709683 27591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e23b142958324f69aa0bad3a5828fa83" candidate_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2513a663afac495eb09126ff55e8b2b0"
W20260709 13:08:25.711133 27705 leader_election.cc:343] T e23b142958324f69aa0bad3a5828fa83 P 665f7e09521a4c3f9284c1d8b0e094ff [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 2513a663afac495eb09126ff55e8b2b0 (127.17.223.1:40721): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:25.722987 28082 leader_election.cc:290] T 585e960f8d0f42268f2fe98e1e7b83f0 P 665f7e09521a4c3f9284c1d8b0e094ff [CANDIDATE]: Term 1 election: Requested vote from peers 2513a663afac495eb09126ff55e8b2b0 (127.17.223.1:40721), 41268b218b804905a110c86738e74400 (127.17.223.2:44403)
I20260709 13:08:25.719424 28212 leader_election.cc:290] T e23b142958324f69aa0bad3a5828fa83 P 665f7e09521a4c3f9284c1d8b0e094ff [CANDIDATE]: Term 1 election: Requested vote from peers 2513a663afac495eb09126ff55e8b2b0 (127.17.223.1:40721), 41268b218b804905a110c86738e74400 (127.17.223.2:44403)
I20260709 13:08:25.731001 27666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "585e960f8d0f42268f2fe98e1e7b83f0" candidate_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "41268b218b804905a110c86738e74400"
I20260709 13:08:25.731346 27667 raft_consensus.cc:2468] T e23b142958324f69aa0bad3a5828fa83 P 41268b218b804905a110c86738e74400 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 665f7e09521a4c3f9284c1d8b0e094ff in term 1.
I20260709 13:08:25.731980 27666 raft_consensus.cc:3060] T 585e960f8d0f42268f2fe98e1e7b83f0 P 41268b218b804905a110c86738e74400 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:25.733167 27708 leader_election.cc:304] T e23b142958324f69aa0bad3a5828fa83 P 665f7e09521a4c3f9284c1d8b0e094ff [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 41268b218b804905a110c86738e74400, 665f7e09521a4c3f9284c1d8b0e094ff; no voters: 2513a663afac495eb09126ff55e8b2b0
I20260709 13:08:25.735467 27865 tablet_bootstrap.cc:654] T afcb3b39d1c9495eab95404687865537 P 18435fbb525741328139e84a1e354954: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:25.736219 28212 raft_consensus.cc:2804] T e23b142958324f69aa0bad3a5828fa83 P 665f7e09521a4c3f9284c1d8b0e094ff [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:08:25.736824 28212 raft_consensus.cc:697] T e23b142958324f69aa0bad3a5828fa83 P 665f7e09521a4c3f9284c1d8b0e094ff [term 1 LEADER]: Becoming Leader. State: Replica: 665f7e09521a4c3f9284c1d8b0e094ff, State: Running, Role: LEADER
I20260709 13:08:25.738166 27862 tablet_bootstrap.cc:654] T 9db60240699a4db2ba5faa2c50a742da P 665f7e09521a4c3f9284c1d8b0e094ff: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:25.737799 28212 consensus_queue.cc:237] T e23b142958324f69aa0bad3a5828fa83 P 665f7e09521a4c3f9284c1d8b0e094ff [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2513a663afac495eb09126ff55e8b2b0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40721 } } peers { permanent_uuid: "41268b218b804905a110c86738e74400" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 44403 } } peers { permanent_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 38749 } }
I20260709 13:08:25.742244 27861 raft_consensus.cc:359] T 585e960f8d0f42268f2fe98e1e7b83f0 P 2513a663afac495eb09126ff55e8b2b0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2513a663afac495eb09126ff55e8b2b0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40721 } } peers { permanent_uuid: "41268b218b804905a110c86738e74400" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 44403 } } peers { permanent_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 38749 } }
I20260709 13:08:25.743130 27861 raft_consensus.cc:385] T 585e960f8d0f42268f2fe98e1e7b83f0 P 2513a663afac495eb09126ff55e8b2b0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:25.743571 27861 raft_consensus.cc:740] T 585e960f8d0f42268f2fe98e1e7b83f0 P 2513a663afac495eb09126ff55e8b2b0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2513a663afac495eb09126ff55e8b2b0, State: Initialized, Role: FOLLOWER
I20260709 13:08:25.744550 27861 consensus_queue.cc:260] T 585e960f8d0f42268f2fe98e1e7b83f0 P 2513a663afac495eb09126ff55e8b2b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2513a663afac495eb09126ff55e8b2b0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40721 } } peers { permanent_uuid: "41268b218b804905a110c86738e74400" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 44403 } } peers { permanent_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 38749 } }
I20260709 13:08:25.750389 28196 raft_consensus.cc:493] T b6be829f6d3f40c99a3c5be18b0c259c P 41268b218b804905a110c86738e74400 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:25.751091 28196 raft_consensus.cc:515] T b6be829f6d3f40c99a3c5be18b0c259c P 41268b218b804905a110c86738e74400 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18435fbb525741328139e84a1e354954" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 40545 } } peers { permanent_uuid: "2513a663afac495eb09126ff55e8b2b0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40721 } } peers { permanent_uuid: "41268b218b804905a110c86738e74400" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 44403 } }
I20260709 13:08:25.752394 27861 ts_tablet_manager.cc:1434] T 585e960f8d0f42268f2fe98e1e7b83f0 P 2513a663afac495eb09126ff55e8b2b0: Time spent starting tablet: real 0.053s	user 0.004s	sys 0.004s
I20260709 13:08:25.753561 27861 tablet_bootstrap.cc:492] T b6be829f6d3f40c99a3c5be18b0c259c P 2513a663afac495eb09126ff55e8b2b0: Bootstrap starting.
I20260709 13:08:25.754146 28196 leader_election.cc:290] T b6be829f6d3f40c99a3c5be18b0c259c P 41268b218b804905a110c86738e74400 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 18435fbb525741328139e84a1e354954 (127.17.223.4:40545), 2513a663afac495eb09126ff55e8b2b0 (127.17.223.1:40721)
I20260709 13:08:25.757846 27865 tablet_bootstrap.cc:492] T afcb3b39d1c9495eab95404687865537 P 18435fbb525741328139e84a1e354954: No bootstrap required, opened a new log
I20260709 13:08:25.758400 27865 ts_tablet_manager.cc:1403] T afcb3b39d1c9495eab95404687865537 P 18435fbb525741328139e84a1e354954: Time spent bootstrapping tablet: real 0.080s	user 0.010s	sys 0.005s
I20260709 13:08:25.760196 27861 tablet_bootstrap.cc:654] T b6be829f6d3f40c99a3c5be18b0c259c P 2513a663afac495eb09126ff55e8b2b0: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:25.761170 27865 raft_consensus.cc:359] T afcb3b39d1c9495eab95404687865537 P 18435fbb525741328139e84a1e354954 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "41268b218b804905a110c86738e74400" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 44403 } } peers { permanent_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 38749 } } peers { permanent_uuid: "18435fbb525741328139e84a1e354954" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 40545 } }
I20260709 13:08:25.761894 27865 raft_consensus.cc:385] T afcb3b39d1c9495eab95404687865537 P 18435fbb525741328139e84a1e354954 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:25.762194 27865 raft_consensus.cc:740] T afcb3b39d1c9495eab95404687865537 P 18435fbb525741328139e84a1e354954 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 18435fbb525741328139e84a1e354954, State: Initialized, Role: FOLLOWER
I20260709 13:08:25.762912 27865 consensus_queue.cc:260] T afcb3b39d1c9495eab95404687865537 P 18435fbb525741328139e84a1e354954 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "41268b218b804905a110c86738e74400" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 44403 } } peers { permanent_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 38749 } } peers { permanent_uuid: "18435fbb525741328139e84a1e354954" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 40545 } }
I20260709 13:08:25.772094 27863 tablet_bootstrap.cc:654] T 86af954f570648969cbc47c03d15c447 P 41268b218b804905a110c86738e74400: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:25.773118 27862 tablet_bootstrap.cc:492] T 9db60240699a4db2ba5faa2c50a742da P 665f7e09521a4c3f9284c1d8b0e094ff: No bootstrap required, opened a new log
I20260709 13:08:25.773782 27862 ts_tablet_manager.cc:1403] T 9db60240699a4db2ba5faa2c50a742da P 665f7e09521a4c3f9284c1d8b0e094ff: Time spent bootstrapping tablet: real 0.073s	user 0.007s	sys 0.008s
I20260709 13:08:25.776865 28208 raft_consensus.cc:2749] T 9e94954fc474414ba7563be776d6c80a P 18435fbb525741328139e84a1e354954 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:08:25.785468 27666 raft_consensus.cc:2468] T 585e960f8d0f42268f2fe98e1e7b83f0 P 41268b218b804905a110c86738e74400 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 665f7e09521a4c3f9284c1d8b0e094ff in term 1.
I20260709 13:08:25.786662 27708 leader_election.cc:304] T 585e960f8d0f42268f2fe98e1e7b83f0 P 665f7e09521a4c3f9284c1d8b0e094ff [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 41268b218b804905a110c86738e74400, 665f7e09521a4c3f9284c1d8b0e094ff; no voters: 2513a663afac495eb09126ff55e8b2b0
I20260709 13:08:25.787489 28082 raft_consensus.cc:2804] T 585e960f8d0f42268f2fe98e1e7b83f0 P 665f7e09521a4c3f9284c1d8b0e094ff [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:08:25.788208 28082 raft_consensus.cc:697] T 585e960f8d0f42268f2fe98e1e7b83f0 P 665f7e09521a4c3f9284c1d8b0e094ff [term 1 LEADER]: Becoming Leader. State: Replica: 665f7e09521a4c3f9284c1d8b0e094ff, State: Running, Role: LEADER
I20260709 13:08:25.789132 28082 consensus_queue.cc:237] T 585e960f8d0f42268f2fe98e1e7b83f0 P 665f7e09521a4c3f9284c1d8b0e094ff [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2513a663afac495eb09126ff55e8b2b0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40721 } } peers { permanent_uuid: "41268b218b804905a110c86738e74400" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 44403 } } peers { permanent_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 38749 } }
I20260709 13:08:25.790076 27862 raft_consensus.cc:359] T 9db60240699a4db2ba5faa2c50a742da P 665f7e09521a4c3f9284c1d8b0e094ff [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 38749 } } peers { permanent_uuid: "18435fbb525741328139e84a1e354954" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 40545 } } peers { permanent_uuid: "2513a663afac495eb09126ff55e8b2b0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40721 } }
I20260709 13:08:25.791039 27862 raft_consensus.cc:385] T 9db60240699a4db2ba5faa2c50a742da P 665f7e09521a4c3f9284c1d8b0e094ff [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:25.791378 27862 raft_consensus.cc:740] T 9db60240699a4db2ba5faa2c50a742da P 665f7e09521a4c3f9284c1d8b0e094ff [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 665f7e09521a4c3f9284c1d8b0e094ff, State: Initialized, Role: FOLLOWER
I20260709 13:08:25.793812 27811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6be829f6d3f40c99a3c5be18b0c259c" candidate_uuid: "41268b218b804905a110c86738e74400" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "18435fbb525741328139e84a1e354954" is_pre_election: true
W20260709 13:08:25.800381 27634 leader_election.cc:343] T b6be829f6d3f40c99a3c5be18b0c259c P 41268b218b804905a110c86738e74400 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 18435fbb525741328139e84a1e354954 (127.17.223.4:40545): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:25.802493 28101 consensus_queue.cc:1048] T 5a55d1bac7374ff6b83cc7bae2d3b1f3 P 18435fbb525741328139e84a1e354954 [LEADER]: Connected to new peer: Peer: permanent_uuid: "41268b218b804905a110c86738e74400" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 44403 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:08:25.812008 27865 ts_tablet_manager.cc:1434] T afcb3b39d1c9495eab95404687865537 P 18435fbb525741328139e84a1e354954: Time spent starting tablet: real 0.053s	user 0.005s	sys 0.002s
I20260709 13:08:25.813483 27865 tablet_bootstrap.cc:492] T 9db60240699a4db2ba5faa2c50a742da P 18435fbb525741328139e84a1e354954: Bootstrap starting.
I20260709 13:08:25.810541 27591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6be829f6d3f40c99a3c5be18b0c259c" candidate_uuid: "41268b218b804905a110c86738e74400" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2513a663afac495eb09126ff55e8b2b0" is_pre_election: true
I20260709 13:08:25.817704 27862 consensus_queue.cc:260] T 9db60240699a4db2ba5faa2c50a742da P 665f7e09521a4c3f9284c1d8b0e094ff [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 38749 } } peers { permanent_uuid: "18435fbb525741328139e84a1e354954" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 40545 } } peers { permanent_uuid: "2513a663afac495eb09126ff55e8b2b0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40721 } }
I20260709 13:08:25.827014 27861 tablet_bootstrap.cc:492] T b6be829f6d3f40c99a3c5be18b0c259c P 2513a663afac495eb09126ff55e8b2b0: No bootstrap required, opened a new log
I20260709 13:08:25.827802 27861 ts_tablet_manager.cc:1403] T b6be829f6d3f40c99a3c5be18b0c259c P 2513a663afac495eb09126ff55e8b2b0: Time spent bootstrapping tablet: real 0.074s	user 0.020s	sys 0.023s
W20260709 13:08:25.840575 27559 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.3:38749, user_credentials={real_user=slave}} blocked reactor thread for 57745us
I20260709 13:08:25.879638 27863 tablet_bootstrap.cc:492] T 86af954f570648969cbc47c03d15c447 P 41268b218b804905a110c86738e74400: No bootstrap required, opened a new log
I20260709 13:08:25.880280 27863 ts_tablet_manager.cc:1403] T 86af954f570648969cbc47c03d15c447 P 41268b218b804905a110c86738e74400: Time spent bootstrapping tablet: real 0.239s	user 0.009s	sys 0.022s
I20260709 13:08:25.883297 27863 raft_consensus.cc:359] T 86af954f570648969cbc47c03d15c447 P 41268b218b804905a110c86738e74400 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18435fbb525741328139e84a1e354954" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 40545 } } peers { permanent_uuid: "2513a663afac495eb09126ff55e8b2b0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40721 } } peers { permanent_uuid: "41268b218b804905a110c86738e74400" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 44403 } }
I20260709 13:08:25.883981 27863 raft_consensus.cc:385] T 86af954f570648969cbc47c03d15c447 P 41268b218b804905a110c86738e74400 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:25.884253 27863 raft_consensus.cc:740] T 86af954f570648969cbc47c03d15c447 P 41268b218b804905a110c86738e74400 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 41268b218b804905a110c86738e74400, State: Initialized, Role: FOLLOWER
I20260709 13:08:25.884939 27863 consensus_queue.cc:260] T 86af954f570648969cbc47c03d15c447 P 41268b218b804905a110c86738e74400 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18435fbb525741328139e84a1e354954" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 40545 } } peers { permanent_uuid: "2513a663afac495eb09126ff55e8b2b0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40721 } } peers { permanent_uuid: "41268b218b804905a110c86738e74400" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 44403 } }
I20260709 13:08:25.887056 27863 ts_tablet_manager.cc:1434] T 86af954f570648969cbc47c03d15c447 P 41268b218b804905a110c86738e74400: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.002s
I20260709 13:08:25.888034 27863 tablet_bootstrap.cc:492] T bbd0bdc9640c4956a5d60406841ef0f0 P 41268b218b804905a110c86738e74400: Bootstrap starting.
I20260709 13:08:25.893910 27863 tablet_bootstrap.cc:654] T bbd0bdc9640c4956a5d60406841ef0f0 P 41268b218b804905a110c86738e74400: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:25.900090 27863 tablet_bootstrap.cc:492] T bbd0bdc9640c4956a5d60406841ef0f0 P 41268b218b804905a110c86738e74400: No bootstrap required, opened a new log
I20260709 13:08:25.900580 27863 ts_tablet_manager.cc:1403] T bbd0bdc9640c4956a5d60406841ef0f0 P 41268b218b804905a110c86738e74400: Time spent bootstrapping tablet: real 0.013s	user 0.005s	sys 0.005s
I20260709 13:08:25.903172 27863 raft_consensus.cc:359] T bbd0bdc9640c4956a5d60406841ef0f0 P 41268b218b804905a110c86738e74400 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2513a663afac495eb09126ff55e8b2b0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40721 } } peers { permanent_uuid: "41268b218b804905a110c86738e74400" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 44403 } } peers { permanent_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 38749 } }
I20260709 13:08:25.904028 27863 raft_consensus.cc:385] T bbd0bdc9640c4956a5d60406841ef0f0 P 41268b218b804905a110c86738e74400 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:25.904321 27863 raft_consensus.cc:740] T bbd0bdc9640c4956a5d60406841ef0f0 P 41268b218b804905a110c86738e74400 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 41268b218b804905a110c86738e74400, State: Initialized, Role: FOLLOWER
I20260709 13:08:25.905081 27863 consensus_queue.cc:260] T bbd0bdc9640c4956a5d60406841ef0f0 P 41268b218b804905a110c86738e74400 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2513a663afac495eb09126ff55e8b2b0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40721 } } peers { permanent_uuid: "41268b218b804905a110c86738e74400" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 44403 } } peers { permanent_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 38749 } }
I20260709 13:08:25.907485 27863 ts_tablet_manager.cc:1434] T bbd0bdc9640c4956a5d60406841ef0f0 P 41268b218b804905a110c86738e74400: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 13:08:25.953079 28269 consensus_queue.cc:1048] T 2d68b1be563949efbcb4bbe71eddd0d8 P 2513a663afac495eb09126ff55e8b2b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "18435fbb525741328139e84a1e354954" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 40545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:08:25.970268 28269 raft_consensus.cc:493] T 9c0f604d66664505aa9469fb058601b6 P 2513a663afac495eb09126ff55e8b2b0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:25.972586 28269 raft_consensus.cc:515] T 9c0f604d66664505aa9469fb058601b6 P 2513a663afac495eb09126ff55e8b2b0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 38749 } } peers { permanent_uuid: "18435fbb525741328139e84a1e354954" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 40545 } } peers { permanent_uuid: "2513a663afac495eb09126ff55e8b2b0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40721 } }
I20260709 13:08:25.982707 28269 leader_election.cc:290] T 9c0f604d66664505aa9469fb058601b6 P 2513a663afac495eb09126ff55e8b2b0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 665f7e09521a4c3f9284c1d8b0e094ff (127.17.223.3:38749), 18435fbb525741328139e84a1e354954 (127.17.223.4:40545)
I20260709 13:08:25.984012 27812 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c0f604d66664505aa9469fb058601b6" candidate_uuid: "2513a663afac495eb09126ff55e8b2b0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "18435fbb525741328139e84a1e354954" is_pre_election: true
W20260709 13:08:25.985550 27559 leader_election.cc:343] T 9c0f604d66664505aa9469fb058601b6 P 2513a663afac495eb09126ff55e8b2b0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 18435fbb525741328139e84a1e354954 (127.17.223.4:40545): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:25.986809 28205 raft_consensus.cc:493] T 28737c73be174729ad3e9d238af7d975 P 18435fbb525741328139e84a1e354954 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:25.987362 28205 raft_consensus.cc:515] T 28737c73be174729ad3e9d238af7d975 P 18435fbb525741328139e84a1e354954 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18435fbb525741328139e84a1e354954" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 40545 } } peers { permanent_uuid: "2513a663afac495eb09126ff55e8b2b0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40721 } } peers { permanent_uuid: "41268b218b804905a110c86738e74400" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 44403 } }
I20260709 13:08:25.987557 28208 consensus_queue.cc:1048] T 5a55d1bac7374ff6b83cc7bae2d3b1f3 P 18435fbb525741328139e84a1e354954 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2513a663afac495eb09126ff55e8b2b0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40721 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:08:25.989328 28205 leader_election.cc:290] T 28737c73be174729ad3e9d238af7d975 P 18435fbb525741328139e84a1e354954 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2513a663afac495eb09126ff55e8b2b0 (127.17.223.1:40721), 41268b218b804905a110c86738e74400 (127.17.223.2:44403)
I20260709 13:08:25.994187 27589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28737c73be174729ad3e9d238af7d975" candidate_uuid: "18435fbb525741328139e84a1e354954" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2513a663afac495eb09126ff55e8b2b0" is_pre_election: true
I20260709 13:08:25.995184 27589 raft_consensus.cc:2393] T 28737c73be174729ad3e9d238af7d975 P 2513a663afac495eb09126ff55e8b2b0 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 18435fbb525741328139e84a1e354954 in current term 1: Already voted for candidate 41268b218b804905a110c86738e74400 in this term.
I20260709 13:08:25.997470 28196 raft_consensus.cc:493] T 539b1d2240654c74bd9054a06a8eaac6 P 41268b218b804905a110c86738e74400 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:25.997982 28196 raft_consensus.cc:515] T 539b1d2240654c74bd9054a06a8eaac6 P 41268b218b804905a110c86738e74400 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "41268b218b804905a110c86738e74400" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 44403 } } peers { permanent_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 38749 } } peers { permanent_uuid: "18435fbb525741328139e84a1e354954" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 40545 } }
I20260709 13:08:26.001211 27488 catalog_manager.cc:5697] T 9e94954fc474414ba7563be776d6c80a P 665f7e09521a4c3f9284c1d8b0e094ff reported cstate change: term changed from 0 to 1, leader changed from <none> to 665f7e09521a4c3f9284c1d8b0e094ff (127.17.223.3). New cstate: current_term: 1 leader_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "41268b218b804905a110c86738e74400" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 44403 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 38749 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "18435fbb525741328139e84a1e354954" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 40545 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:26.005468 28196 leader_election.cc:290] T 539b1d2240654c74bd9054a06a8eaac6 P 41268b218b804905a110c86738e74400 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 665f7e09521a4c3f9284c1d8b0e094ff (127.17.223.3:38749), 18435fbb525741328139e84a1e354954 (127.17.223.4:40545)
I20260709 13:08:26.005858 28215 raft_consensus.cc:493] T 9c0f604d66664505aa9469fb058601b6 P 665f7e09521a4c3f9284c1d8b0e094ff [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:26.012104 27488 catalog_manager.cc:5697] T e23b142958324f69aa0bad3a5828fa83 P 665f7e09521a4c3f9284c1d8b0e094ff reported cstate change: term changed from 0 to 1, leader changed from <none> to 665f7e09521a4c3f9284c1d8b0e094ff (127.17.223.3). New cstate: current_term: 1 leader_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2513a663afac495eb09126ff55e8b2b0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40721 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "41268b218b804905a110c86738e74400" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 44403 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 38749 } health_report { overall_health: HEALTHY } } }
I20260709 13:08:26.013897 28215 raft_consensus.cc:515] T 9c0f604d66664505aa9469fb058601b6 P 665f7e09521a4c3f9284c1d8b0e094ff [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 38749 } } peers { permanent_uuid: "18435fbb525741328139e84a1e354954" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 40545 } } peers { permanent_uuid: "2513a663afac495eb09126ff55e8b2b0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40721 } }
I20260709 13:08:26.008615 27903 raft_consensus.cc:493] T afcb3b39d1c9495eab95404687865537 P 665f7e09521a4c3f9284c1d8b0e094ff [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:26.015902 28215 leader_election.cc:290] T 9c0f604d66664505aa9469fb058601b6 P 665f7e09521a4c3f9284c1d8b0e094ff [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 18435fbb525741328139e84a1e354954 (127.17.223.4:40545), 2513a663afac495eb09126ff55e8b2b0 (127.17.223.1:40721)
I20260709 13:08:26.016283 27903 raft_consensus.cc:515] T afcb3b39d1c9495eab95404687865537 P 665f7e09521a4c3f9284c1d8b0e094ff [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "41268b218b804905a110c86738e74400" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 44403 } } peers { permanent_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 38749 } } peers { permanent_uuid: "18435fbb525741328139e84a1e354954" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 40545 } }
I20260709 13:08:26.017926 27903 leader_election.cc:290] T afcb3b39d1c9495eab95404687865537 P 665f7e09521a4c3f9284c1d8b0e094ff [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 41268b218b804905a110c86738e74400 (127.17.223.2:44403), 18435fbb525741328139e84a1e354954 (127.17.223.4:40545)
I20260709 13:08:25.827071 27862 ts_tablet_manager.cc:1434] T 9db60240699a4db2ba5faa2c50a742da P 665f7e09521a4c3f9284c1d8b0e094ff: Time spent starting tablet: real 0.053s	user 0.013s	sys 0.000s
I20260709 13:08:26.023078 27862 tablet_bootstrap.cc:492] T 539b1d2240654c74bd9054a06a8eaac6 P 665f7e09521a4c3f9284c1d8b0e094ff: Bootstrap starting.
I20260709 13:08:26.026839 28208 raft_consensus.cc:493] T afcb3b39d1c9495eab95404687865537 P 18435fbb525741328139e84a1e354954 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:26.027205 27862 tablet_bootstrap.cc:654] T 539b1d2240654c74bd9054a06a8eaac6 P 665f7e09521a4c3f9284c1d8b0e094ff: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:26.027516 28208 raft_consensus.cc:515] T afcb3b39d1c9495eab95404687865537 P 18435fbb525741328139e84a1e354954 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "41268b218b804905a110c86738e74400" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 44403 } } peers { permanent_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 38749 } } peers { permanent_uuid: "18435fbb525741328139e84a1e354954" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 40545 } }
I20260709 13:08:26.035481 27862 tablet_bootstrap.cc:492] T 539b1d2240654c74bd9054a06a8eaac6 P 665f7e09521a4c3f9284c1d8b0e094ff: No bootstrap required, opened a new log
I20260709 13:08:26.036141 27862 ts_tablet_manager.cc:1403] T 539b1d2240654c74bd9054a06a8eaac6 P 665f7e09521a4c3f9284c1d8b0e094ff: Time spent bootstrapping tablet: real 0.013s	user 0.008s	sys 0.001s
I20260709 13:08:26.038962 27862 raft_consensus.cc:359] T 539b1d2240654c74bd9054a06a8eaac6 P 665f7e09521a4c3f9284c1d8b0e094ff [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "41268b218b804905a110c86738e74400" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 44403 } } peers { permanent_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 38749 } } peers { permanent_uuid: "18435fbb525741328139e84a1e354954" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 40545 } }
I20260709 13:08:26.039456 27862 raft_consensus.cc:385] T 539b1d2240654c74bd9054a06a8eaac6 P 665f7e09521a4c3f9284c1d8b0e094ff [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:26.039686 27862 raft_consensus.cc:740] T 539b1d2240654c74bd9054a06a8eaac6 P 665f7e09521a4c3f9284c1d8b0e094ff [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 665f7e09521a4c3f9284c1d8b0e094ff, State: Initialized, Role: FOLLOWER
I20260709 13:08:26.040153 27862 consensus_queue.cc:260] T 539b1d2240654c74bd9054a06a8eaac6 P 665f7e09521a4c3f9284c1d8b0e094ff [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "41268b218b804905a110c86738e74400" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 44403 } } peers { permanent_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 38749 } } peers { permanent_uuid: "18435fbb525741328139e84a1e354954" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 40545 } }
I20260709 13:08:26.041787 27862 ts_tablet_manager.cc:1434] T 539b1d2240654c74bd9054a06a8eaac6 P 665f7e09521a4c3f9284c1d8b0e094ff: Time spent starting tablet: real 0.005s	user 0.003s	sys 0.000s
I20260709 13:08:26.042241 27816 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "539b1d2240654c74bd9054a06a8eaac6" candidate_uuid: "41268b218b804905a110c86738e74400" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "18435fbb525741328139e84a1e354954" is_pre_election: true
I20260709 13:08:26.042797 27862 tablet_bootstrap.cc:492] T bbd0bdc9640c4956a5d60406841ef0f0 P 665f7e09521a4c3f9284c1d8b0e094ff: Bootstrap starting.
I20260709 13:08:26.046041 27667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afcb3b39d1c9495eab95404687865537" candidate_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "41268b218b804905a110c86738e74400" is_pre_election: true
I20260709 13:08:26.046653 27667 raft_consensus.cc:2468] T afcb3b39d1c9495eab95404687865537 P 41268b218b804905a110c86738e74400 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 665f7e09521a4c3f9284c1d8b0e094ff in term 0.
I20260709 13:08:26.047928 27668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28737c73be174729ad3e9d238af7d975" candidate_uuid: "18435fbb525741328139e84a1e354954" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "41268b218b804905a110c86738e74400" is_pre_election: true
I20260709 13:08:26.048635 27862 tablet_bootstrap.cc:654] T bbd0bdc9640c4956a5d60406841ef0f0 P 665f7e09521a4c3f9284c1d8b0e094ff: Neither blocks nor log segments found. Creating new log.
W20260709 13:08:26.050822 27634 leader_election.cc:343] T 539b1d2240654c74bd9054a06a8eaac6 P 41268b218b804905a110c86738e74400 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 18435fbb525741328139e84a1e354954 (127.17.223.4:40545): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:26.051724 28208 leader_election.cc:290] T afcb3b39d1c9495eab95404687865537 P 18435fbb525741328139e84a1e354954 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 41268b218b804905a110c86738e74400 (127.17.223.2:44403), 665f7e09521a4c3f9284c1d8b0e094ff (127.17.223.3:38749)
I20260709 13:08:26.053337 27742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "539b1d2240654c74bd9054a06a8eaac6" candidate_uuid: "41268b218b804905a110c86738e74400" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" is_pre_election: true
I20260709 13:08:26.053937 27742 raft_consensus.cc:2468] T 539b1d2240654c74bd9054a06a8eaac6 P 665f7e09521a4c3f9284c1d8b0e094ff [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 41268b218b804905a110c86738e74400 in term 0.
W20260709 13:08:26.056190 27631 leader_election.cc:343] T b6be829f6d3f40c99a3c5be18b0c259c P 41268b218b804905a110c86738e74400 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2513a663afac495eb09126ff55e8b2b0 (127.17.223.1:40721): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:26.056831 27631 leader_election.cc:304] T b6be829f6d3f40c99a3c5be18b0c259c P 41268b218b804905a110c86738e74400 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 41268b218b804905a110c86738e74400; no voters: 18435fbb525741328139e84a1e354954, 2513a663afac495eb09126ff55e8b2b0
I20260709 13:08:26.060384 27782 leader_election.cc:304] T 28737c73be174729ad3e9d238af7d975 P 18435fbb525741328139e84a1e354954 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 18435fbb525741328139e84a1e354954; no voters: 2513a663afac495eb09126ff55e8b2b0, 41268b218b804905a110c86738e74400
I20260709 13:08:26.062635 28208 raft_consensus.cc:3060] T 28737c73be174729ad3e9d238af7d975 P 18435fbb525741328139e84a1e354954 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:26.066619 28197 raft_consensus.cc:2749] T b6be829f6d3f40c99a3c5be18b0c259c P 41268b218b804905a110c86738e74400 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:08:26.072539 27815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c0f604d66664505aa9469fb058601b6" candidate_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "18435fbb525741328139e84a1e354954" is_pre_election: true
I20260709 13:08:26.073612 27816 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afcb3b39d1c9495eab95404687865537" candidate_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "18435fbb525741328139e84a1e354954" is_pre_election: true
I20260709 13:08:26.074793 27865 tablet_bootstrap.cc:654] T 9db60240699a4db2ba5faa2c50a742da P 18435fbb525741328139e84a1e354954: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:26.075140 27816 raft_consensus.cc:2468] T afcb3b39d1c9495eab95404687865537 P 18435fbb525741328139e84a1e354954 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 665f7e09521a4c3f9284c1d8b0e094ff in term 0.
I20260709 13:08:26.068220 27708 leader_election.cc:304] T afcb3b39d1c9495eab95404687865537 P 665f7e09521a4c3f9284c1d8b0e094ff [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 41268b218b804905a110c86738e74400, 665f7e09521a4c3f9284c1d8b0e094ff; no voters: 
I20260709 13:08:26.076534 28157 raft_consensus.cc:2804] T afcb3b39d1c9495eab95404687865537 P 665f7e09521a4c3f9284c1d8b0e094ff [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:08:26.076915 28157 raft_consensus.cc:493] T afcb3b39d1c9495eab95404687865537 P 665f7e09521a4c3f9284c1d8b0e094ff [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:26.077244 28157 raft_consensus.cc:3060] T afcb3b39d1c9495eab95404687865537 P 665f7e09521a4c3f9284c1d8b0e094ff [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:26.077836 28215 consensus_queue.cc:1048] T 9e94954fc474414ba7563be776d6c80a P 665f7e09521a4c3f9284c1d8b0e094ff [LEADER]: Connected to new peer: Peer: permanent_uuid: "18435fbb525741328139e84a1e354954" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 40545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:08:26.085289 28157 raft_consensus.cc:515] T afcb3b39d1c9495eab95404687865537 P 665f7e09521a4c3f9284c1d8b0e094ff [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "41268b218b804905a110c86738e74400" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 44403 } } peers { permanent_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 38749 } } peers { permanent_uuid: "18435fbb525741328139e84a1e354954" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 40545 } }
I20260709 13:08:26.086989 27668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afcb3b39d1c9495eab95404687865537" candidate_uuid: "18435fbb525741328139e84a1e354954" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "41268b218b804905a110c86738e74400" is_pre_election: true
I20260709 13:08:26.087585 27668 raft_consensus.cc:2468] T afcb3b39d1c9495eab95404687865537 P 41268b218b804905a110c86738e74400 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 18435fbb525741328139e84a1e354954 in term 0.
I20260709 13:08:26.089112 27634 leader_election.cc:304] T 539b1d2240654c74bd9054a06a8eaac6 P 41268b218b804905a110c86738e74400 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 41268b218b804905a110c86738e74400, 665f7e09521a4c3f9284c1d8b0e094ff; no voters: 18435fbb525741328139e84a1e354954
I20260709 13:08:26.096225 28157 leader_election.cc:290] T afcb3b39d1c9495eab95404687865537 P 665f7e09521a4c3f9284c1d8b0e094ff [CANDIDATE]: Term 1 election: Requested vote from peers 41268b218b804905a110c86738e74400 (127.17.223.2:44403), 18435fbb525741328139e84a1e354954 (127.17.223.4:40545)
I20260709 13:08:26.098886 28232 raft_consensus.cc:493] T 585e960f8d0f42268f2fe98e1e7b83f0 P 2513a663afac495eb09126ff55e8b2b0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:26.099596 28232 raft_consensus.cc:515] T 585e960f8d0f42268f2fe98e1e7b83f0 P 2513a663afac495eb09126ff55e8b2b0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2513a663afac495eb09126ff55e8b2b0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40721 } } peers { permanent_uuid: "41268b218b804905a110c86738e74400" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 44403 } } peers { permanent_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 38749 } }
I20260709 13:08:26.104384 27668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "585e960f8d0f42268f2fe98e1e7b83f0" candidate_uuid: "2513a663afac495eb09126ff55e8b2b0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "41268b218b804905a110c86738e74400" is_pre_election: true
I20260709 13:08:26.105424 27668 raft_consensus.cc:2393] T 585e960f8d0f42268f2fe98e1e7b83f0 P 41268b218b804905a110c86738e74400 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2513a663afac495eb09126ff55e8b2b0 in current term 1: Already voted for candidate 665f7e09521a4c3f9284c1d8b0e094ff in this term.
I20260709 13:08:26.102326 28232 leader_election.cc:290] T 585e960f8d0f42268f2fe98e1e7b83f0 P 2513a663afac495eb09126ff55e8b2b0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 41268b218b804905a110c86738e74400 (127.17.223.2:44403), 665f7e09521a4c3f9284c1d8b0e094ff (127.17.223.3:38749)
I20260709 13:08:26.116205 28197 raft_consensus.cc:2804] T 539b1d2240654c74bd9054a06a8eaac6 P 41268b218b804905a110c86738e74400 [term 0 FOLLOWER]: Leader pre-election won for term 1
W20260709 13:08:26.116400 27708 leader_election.cc:343] T 9c0f604d66664505aa9469fb058601b6 P 665f7e09521a4c3f9284c1d8b0e094ff [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 18435fbb525741328139e84a1e354954 (127.17.223.4:40545): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:26.116739 28197 raft_consensus.cc:493] T 539b1d2240654c74bd9054a06a8eaac6 P 41268b218b804905a110c86738e74400 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:26.117085 28197 raft_consensus.cc:3060] T 539b1d2240654c74bd9054a06a8eaac6 P 41268b218b804905a110c86738e74400 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:26.116984 27593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c0f604d66664505aa9469fb058601b6" candidate_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2513a663afac495eb09126ff55e8b2b0" is_pre_election: true
I20260709 13:08:26.118455 27782 leader_election.cc:304] T afcb3b39d1c9495eab95404687865537 P 18435fbb525741328139e84a1e354954 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 18435fbb525741328139e84a1e354954, 41268b218b804905a110c86738e74400; no voters: 
I20260709 13:08:26.119057 27593 raft_consensus.cc:2468] T 9c0f604d66664505aa9469fb058601b6 P 2513a663afac495eb09126ff55e8b2b0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 665f7e09521a4c3f9284c1d8b0e094ff in term 0.
I20260709 13:08:26.119228 28219 raft_consensus.cc:2804] T afcb3b39d1c9495eab95404687865537 P 18435fbb525741328139e84a1e354954 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:08:26.119609 28219 raft_consensus.cc:493] T afcb3b39d1c9495eab95404687865537 P 18435fbb525741328139e84a1e354954 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:26.120002 28219 raft_consensus.cc:3060] T afcb3b39d1c9495eab95404687865537 P 18435fbb525741328139e84a1e354954 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:08:26.121124 27539 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:08:26.122810 27741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afcb3b39d1c9495eab95404687865537" candidate_uuid: "18435fbb525741328139e84a1e354954" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" is_pre_election: true
I20260709 13:08:26.123509 27741 raft_consensus.cc:2393] T afcb3b39d1c9495eab95404687865537 P 665f7e09521a4c3f9284c1d8b0e094ff [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 18435fbb525741328139e84a1e354954 in current term 1: Already voted for candidate 665f7e09521a4c3f9284c1d8b0e094ff in this term.
I20260709 13:08:26.146018 28208 raft_consensus.cc:2749] T 28737c73be174729ad3e9d238af7d975 P 18435fbb525741328139e84a1e354954 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:08:26.166021 27861 raft_consensus.cc:359] T b6be829f6d3f40c99a3c5be18b0c259c P 2513a663afac495eb09126ff55e8b2b0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18435fbb525741328139e84a1e354954" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 40545 } } peers { permanent_uuid: "2513a663afac495eb09126ff55e8b2b0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40721 } } peers { permanent_uuid: "41268b218b804905a110c86738e74400" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 44403 } }
I20260709 13:08:26.167331 27861 raft_consensus.cc:385] T b6be829f6d3f40c99a3c5be18b0c259c P 2513a663afac495eb09126ff55e8b2b0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:26.168423 27861 raft_consensus.cc:740] T b6be829f6d3f40c99a3c5be18b0c259c P 2513a663afac495eb09126ff55e8b2b0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2513a663afac495eb09126ff55e8b2b0, State: Initialized, Role: FOLLOWER
I20260709 13:08:26.172104 27861 consensus_queue.cc:260] T b6be829f6d3f40c99a3c5be18b0c259c P 2513a663afac495eb09126ff55e8b2b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18435fbb525741328139e84a1e354954" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 40545 } } peers { permanent_uuid: "2513a663afac495eb09126ff55e8b2b0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40721 } } peers { permanent_uuid: "41268b218b804905a110c86738e74400" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 44403 } }
I20260709 13:08:26.176752 27865 tablet_bootstrap.cc:492] T 9db60240699a4db2ba5faa2c50a742da P 18435fbb525741328139e84a1e354954: No bootstrap required, opened a new log
W20260709 13:08:26.177066 27782 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.3:38749, user_credentials={real_user=slave}} blocked reactor thread for 44275.6us
I20260709 13:08:26.177347 27865 ts_tablet_manager.cc:1403] T 9db60240699a4db2ba5faa2c50a742da P 18435fbb525741328139e84a1e354954: Time spent bootstrapping tablet: real 0.364s	user 0.016s	sys 0.020s
I20260709 13:08:26.188041 27861 ts_tablet_manager.cc:1434] T b6be829f6d3f40c99a3c5be18b0c259c P 2513a663afac495eb09126ff55e8b2b0: Time spent starting tablet: real 0.360s	user 0.007s	sys 0.003s
I20260709 13:08:26.189568 27811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afcb3b39d1c9495eab95404687865537" candidate_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "18435fbb525741328139e84a1e354954"
I20260709 13:08:26.192121 27861 tablet_bootstrap.cc:492] T e23b142958324f69aa0bad3a5828fa83 P 2513a663afac495eb09126ff55e8b2b0: Bootstrap starting.
I20260709 13:08:26.193436 28219 raft_consensus.cc:515] T afcb3b39d1c9495eab95404687865537 P 18435fbb525741328139e84a1e354954 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "41268b218b804905a110c86738e74400" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 44403 } } peers { permanent_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 38749 } } peers { permanent_uuid: "18435fbb525741328139e84a1e354954" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 40545 } }
I20260709 13:08:26.178376 28196 consensus_queue.cc:1048] T 28737c73be174729ad3e9d238af7d975 P 41268b218b804905a110c86738e74400 [LEADER]: Connected to new peer: Peer: permanent_uuid: "18435fbb525741328139e84a1e354954" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 40545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.010s
I20260709 13:08:26.196970 27862 tablet_bootstrap.cc:492] T bbd0bdc9640c4956a5d60406841ef0f0 P 665f7e09521a4c3f9284c1d8b0e094ff: No bootstrap required, opened a new log
I20260709 13:08:26.197438 27862 ts_tablet_manager.cc:1403] T bbd0bdc9640c4956a5d60406841ef0f0 P 665f7e09521a4c3f9284c1d8b0e094ff: Time spent bootstrapping tablet: real 0.155s	user 0.014s	sys 0.032s
I20260709 13:08:26.203895 27865 raft_consensus.cc:359] T 9db60240699a4db2ba5faa2c50a742da P 18435fbb525741328139e84a1e354954 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 38749 } } peers { permanent_uuid: "18435fbb525741328139e84a1e354954" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 40545 } } peers { permanent_uuid: "2513a663afac495eb09126ff55e8b2b0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40721 } }
I20260709 13:08:26.204192 27738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c0f604d66664505aa9469fb058601b6" candidate_uuid: "2513a663afac495eb09126ff55e8b2b0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" is_pre_election: true
I20260709 13:08:26.208063 28139 raft_consensus.cc:493] T 86af954f570648969cbc47c03d15c447 P 41268b218b804905a110c86738e74400 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:26.209190 27865 raft_consensus.cc:385] T 9db60240699a4db2ba5faa2c50a742da P 18435fbb525741328139e84a1e354954 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:26.209719 27865 raft_consensus.cc:740] T 9db60240699a4db2ba5faa2c50a742da P 18435fbb525741328139e84a1e354954 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 18435fbb525741328139e84a1e354954, State: Initialized, Role: FOLLOWER
I20260709 13:08:26.210719 27865 consensus_queue.cc:260] T 9db60240699a4db2ba5faa2c50a742da P 18435fbb525741328139e84a1e354954 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 38749 } } peers { permanent_uuid: "18435fbb525741328139e84a1e354954" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 40545 } } peers { permanent_uuid: "2513a663afac495eb09126ff55e8b2b0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40721 } }
W20260709 13:08:26.226877 27705 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.1:40721, user_credentials={real_user=slave}} blocked reactor thread for 61398.5us
I20260709 13:08:26.237643 27668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afcb3b39d1c9495eab95404687865537" candidate_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "41268b218b804905a110c86738e74400"
I20260709 13:08:26.238300 27668 raft_consensus.cc:3060] T afcb3b39d1c9495eab95404687865537 P 41268b218b804905a110c86738e74400 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:26.242478 27865 ts_tablet_manager.cc:1434] T 9db60240699a4db2ba5faa2c50a742da P 18435fbb525741328139e84a1e354954: Time spent starting tablet: real 0.065s	user 0.006s	sys 0.001s
I20260709 13:08:26.230980 27738 raft_consensus.cc:2468] T 9c0f604d66664505aa9469fb058601b6 P 665f7e09521a4c3f9284c1d8b0e094ff [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2513a663afac495eb09126ff55e8b2b0 in term 0.
I20260709 13:08:26.231746 27811 raft_consensus.cc:2393] T afcb3b39d1c9495eab95404687865537 P 18435fbb525741328139e84a1e354954 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 665f7e09521a4c3f9284c1d8b0e094ff in current term 1: Already voted for candidate 18435fbb525741328139e84a1e354954 in this term.
I20260709 13:08:26.228905 28139 raft_consensus.cc:515] T 86af954f570648969cbc47c03d15c447 P 41268b218b804905a110c86738e74400 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18435fbb525741328139e84a1e354954" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 40545 } } peers { permanent_uuid: "2513a663afac495eb09126ff55e8b2b0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40721 } } peers { permanent_uuid: "41268b218b804905a110c86738e74400" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 44403 } }
I20260709 13:08:26.246460 28139 leader_election.cc:290] T 86af954f570648969cbc47c03d15c447 P 41268b218b804905a110c86738e74400 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 18435fbb525741328139e84a1e354954 (127.17.223.4:40545), 2513a663afac495eb09126ff55e8b2b0 (127.17.223.1:40721)
I20260709 13:08:26.249300 27668 raft_consensus.cc:2468] T afcb3b39d1c9495eab95404687865537 P 41268b218b804905a110c86738e74400 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 665f7e09521a4c3f9284c1d8b0e094ff in term 1.
I20260709 13:08:26.251984 28219 leader_election.cc:290] T afcb3b39d1c9495eab95404687865537 P 18435fbb525741328139e84a1e354954 [CANDIDATE]: Term 1 election: Requested vote from peers 41268b218b804905a110c86738e74400 (127.17.223.2:44403), 665f7e09521a4c3f9284c1d8b0e094ff (127.17.223.3:38749)
I20260709 13:08:26.254181 27861 tablet_bootstrap.cc:654] T e23b142958324f69aa0bad3a5828fa83 P 2513a663afac495eb09126ff55e8b2b0: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:26.258548 27668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afcb3b39d1c9495eab95404687865537" candidate_uuid: "18435fbb525741328139e84a1e354954" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "41268b218b804905a110c86738e74400"
I20260709 13:08:26.259559 27668 raft_consensus.cc:2393] T afcb3b39d1c9495eab95404687865537 P 41268b218b804905a110c86738e74400 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 18435fbb525741328139e84a1e354954 in current term 1: Already voted for candidate 665f7e09521a4c3f9284c1d8b0e094ff in this term.
I20260709 13:08:26.261157 27862 raft_consensus.cc:359] T bbd0bdc9640c4956a5d60406841ef0f0 P 665f7e09521a4c3f9284c1d8b0e094ff [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2513a663afac495eb09126ff55e8b2b0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40721 } } peers { permanent_uuid: "41268b218b804905a110c86738e74400" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 44403 } } peers { permanent_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 38749 } }
I20260709 13:08:26.263592 27862 raft_consensus.cc:385] T bbd0bdc9640c4956a5d60406841ef0f0 P 665f7e09521a4c3f9284c1d8b0e094ff [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:26.263888 27862 raft_consensus.cc:740] T bbd0bdc9640c4956a5d60406841ef0f0 P 665f7e09521a4c3f9284c1d8b0e094ff [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 665f7e09521a4c3f9284c1d8b0e094ff, State: Initialized, Role: FOLLOWER
I20260709 13:08:26.266515 27903 raft_consensus.cc:493] T 9db60240699a4db2ba5faa2c50a742da P 665f7e09521a4c3f9284c1d8b0e094ff [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:26.266969 27865 tablet_bootstrap.cc:492] T b6be829f6d3f40c99a3c5be18b0c259c P 18435fbb525741328139e84a1e354954: Bootstrap starting.
I20260709 13:08:26.267063 28157 consensus_queue.cc:1048] T 9e94954fc474414ba7563be776d6c80a P 665f7e09521a4c3f9284c1d8b0e094ff [LEADER]: Connected to new peer: Peer: permanent_uuid: "41268b218b804905a110c86738e74400" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 44403 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:08:26.268612 27705 leader_election.cc:304] T 9c0f604d66664505aa9469fb058601b6 P 665f7e09521a4c3f9284c1d8b0e094ff [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2513a663afac495eb09126ff55e8b2b0, 665f7e09521a4c3f9284c1d8b0e094ff; no voters: 18435fbb525741328139e84a1e354954
I20260709 13:08:26.266992 27903 raft_consensus.cc:515] T 9db60240699a4db2ba5faa2c50a742da P 665f7e09521a4c3f9284c1d8b0e094ff [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 38749 } } peers { permanent_uuid: "18435fbb525741328139e84a1e354954" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 40545 } } peers { permanent_uuid: "2513a663afac495eb09126ff55e8b2b0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40721 } }
I20260709 13:08:26.270155 28082 raft_consensus.cc:2804] T 9c0f604d66664505aa9469fb058601b6 P 665f7e09521a4c3f9284c1d8b0e094ff [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:08:26.270529 28082 raft_consensus.cc:493] T 9c0f604d66664505aa9469fb058601b6 P 665f7e09521a4c3f9284c1d8b0e094ff [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:26.271070 28082 raft_consensus.cc:3060] T 9c0f604d66664505aa9469fb058601b6 P 665f7e09521a4c3f9284c1d8b0e094ff [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:26.271410 27903 leader_election.cc:290] T 9db60240699a4db2ba5faa2c50a742da P 665f7e09521a4c3f9284c1d8b0e094ff [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 18435fbb525741328139e84a1e354954 (127.17.223.4:40545), 2513a663afac495eb09126ff55e8b2b0 (127.17.223.1:40721)
I20260709 13:08:26.272842 27708 leader_election.cc:304] T afcb3b39d1c9495eab95404687865537 P 665f7e09521a4c3f9284c1d8b0e094ff [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 41268b218b804905a110c86738e74400, 665f7e09521a4c3f9284c1d8b0e094ff; no voters: 
I20260709 13:08:26.273903 28212 raft_consensus.cc:2804] T afcb3b39d1c9495eab95404687865537 P 665f7e09521a4c3f9284c1d8b0e094ff [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:08:26.273708 28215 consensus_queue.cc:1048] T ea92a607c73b4d289d081146089a86f9 P 665f7e09521a4c3f9284c1d8b0e094ff [LEADER]: Connected to new peer: Peer: permanent_uuid: "41268b218b804905a110c86738e74400" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 44403 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:08:26.274448 28212 raft_consensus.cc:697] T afcb3b39d1c9495eab95404687865537 P 665f7e09521a4c3f9284c1d8b0e094ff [term 1 LEADER]: Becoming Leader. State: Replica: 665f7e09521a4c3f9284c1d8b0e094ff, State: Running, Role: LEADER
I20260709 13:08:26.275401 28212 consensus_queue.cc:237] T afcb3b39d1c9495eab95404687865537 P 665f7e09521a4c3f9284c1d8b0e094ff [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "41268b218b804905a110c86738e74400" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 44403 } } peers { permanent_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 38749 } } peers { permanent_uuid: "18435fbb525741328139e84a1e354954" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 40545 } }
I20260709 13:08:26.281320 28082 raft_consensus.cc:515] T 9c0f604d66664505aa9469fb058601b6 P 665f7e09521a4c3f9284c1d8b0e094ff [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 38749 } } peers { permanent_uuid: "18435fbb525741328139e84a1e354954" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 40545 } } peers { permanent_uuid: "2513a663afac495eb09126ff55e8b2b0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40721 } }
I20260709 13:08:26.283504 28082 leader_election.cc:290] T 9c0f604d66664505aa9469fb058601b6 P 665f7e09521a4c3f9284c1d8b0e094ff [CANDIDATE]: Term 1 election: Requested vote from peers 18435fbb525741328139e84a1e354954 (127.17.223.4:40545), 2513a663afac495eb09126ff55e8b2b0 (127.17.223.1:40721)
I20260709 13:08:26.256881 27742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "585e960f8d0f42268f2fe98e1e7b83f0" candidate_uuid: "2513a663afac495eb09126ff55e8b2b0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" is_pre_election: true
I20260709 13:08:26.287652 27559 leader_election.cc:304] T 9c0f604d66664505aa9469fb058601b6 P 2513a663afac495eb09126ff55e8b2b0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2513a663afac495eb09126ff55e8b2b0, 665f7e09521a4c3f9284c1d8b0e094ff; no voters: 18435fbb525741328139e84a1e354954
I20260709 13:08:26.289007 28214 raft_consensus.cc:2804] T 9c0f604d66664505aa9469fb058601b6 P 2513a663afac495eb09126ff55e8b2b0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:08:26.291487 28214 raft_consensus.cc:493] T 9c0f604d66664505aa9469fb058601b6 P 2513a663afac495eb09126ff55e8b2b0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:26.291849 28214 raft_consensus.cc:3060] T 9c0f604d66664505aa9469fb058601b6 P 2513a663afac495eb09126ff55e8b2b0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:26.294004 27862 consensus_queue.cc:260] T bbd0bdc9640c4956a5d60406841ef0f0 P 665f7e09521a4c3f9284c1d8b0e094ff [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2513a663afac495eb09126ff55e8b2b0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40721 } } peers { permanent_uuid: "41268b218b804905a110c86738e74400" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 44403 } } peers { permanent_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 38749 } }
I20260709 13:08:26.217623 28229 consensus_queue.cc:1048] T 2d68b1be563949efbcb4bbe71eddd0d8 P 2513a663afac495eb09126ff55e8b2b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 38749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.048s
I20260709 13:08:26.264175 28219 raft_consensus.cc:493] T 9db60240699a4db2ba5faa2c50a742da P 18435fbb525741328139e84a1e354954 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:26.310120 27812 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c0f604d66664505aa9469fb058601b6" candidate_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "18435fbb525741328139e84a1e354954"
I20260709 13:08:26.310593 27738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afcb3b39d1c9495eab95404687865537" candidate_uuid: "18435fbb525741328139e84a1e354954" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "665f7e09521a4c3f9284c1d8b0e094ff"
I20260709 13:08:26.311405 27593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c0f604d66664505aa9469fb058601b6" candidate_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2513a663afac495eb09126ff55e8b2b0"
W20260709 13:08:26.311604 27708 leader_election.cc:343] T 9c0f604d66664505aa9469fb058601b6 P 665f7e09521a4c3f9284c1d8b0e094ff [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 18435fbb525741328139e84a1e354954 (127.17.223.4:40545): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:26.312188 27815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9db60240699a4db2ba5faa2c50a742da" candidate_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "18435fbb525741328139e84a1e354954" is_pre_election: true
I20260709 13:08:26.312800 27592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9db60240699a4db2ba5faa2c50a742da" candidate_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2513a663afac495eb09126ff55e8b2b0" is_pre_election: true
I20260709 13:08:26.313150 28215 consensus_queue.cc:1048] T ea92a607c73b4d289d081146089a86f9 P 665f7e09521a4c3f9284c1d8b0e094ff [LEADER]: Connected to new peer: Peer: permanent_uuid: "2513a663afac495eb09126ff55e8b2b0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40721 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 13:08:26.316083 27705 leader_election.cc:343] T 9db60240699a4db2ba5faa2c50a742da P 665f7e09521a4c3f9284c1d8b0e094ff [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2513a663afac495eb09126ff55e8b2b0 (127.17.223.1:40721): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:26.316212 27811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86af954f570648969cbc47c03d15c447" candidate_uuid: "41268b218b804905a110c86738e74400" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "18435fbb525741328139e84a1e354954" is_pre_election: true
I20260709 13:08:26.316973 27782 leader_election.cc:304] T afcb3b39d1c9495eab95404687865537 P 18435fbb525741328139e84a1e354954 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 18435fbb525741328139e84a1e354954; no voters: 41268b218b804905a110c86738e74400, 665f7e09521a4c3f9284c1d8b0e094ff
I20260709 13:08:26.318282 28101 raft_consensus.cc:2749] T afcb3b39d1c9495eab95404687865537 P 18435fbb525741328139e84a1e354954 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
W20260709 13:08:26.318411 27634 leader_election.cc:343] T 86af954f570648969cbc47c03d15c447 P 41268b218b804905a110c86738e74400 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 18435fbb525741328139e84a1e354954 (127.17.223.4:40545): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:26.321235 27862 ts_tablet_manager.cc:1434] T bbd0bdc9640c4956a5d60406841ef0f0 P 665f7e09521a4c3f9284c1d8b0e094ff: Time spent starting tablet: real 0.124s	user 0.008s	sys 0.001s
I20260709 13:08:26.322710 27903 consensus_queue.cc:1048] T 585e960f8d0f42268f2fe98e1e7b83f0 P 665f7e09521a4c3f9284c1d8b0e094ff [LEADER]: Connected to new peer: Peer: permanent_uuid: "41268b218b804905a110c86738e74400" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 44403 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:08:26.354799 27588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86af954f570648969cbc47c03d15c447" candidate_uuid: "41268b218b804905a110c86738e74400" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2513a663afac495eb09126ff55e8b2b0" is_pre_election: true
I20260709 13:08:26.354959 28214 raft_consensus.cc:515] T 9c0f604d66664505aa9469fb058601b6 P 2513a663afac495eb09126ff55e8b2b0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 38749 } } peers { permanent_uuid: "18435fbb525741328139e84a1e354954" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 40545 } } peers { permanent_uuid: "2513a663afac495eb09126ff55e8b2b0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40721 } }
I20260709 13:08:26.356367 27593 raft_consensus.cc:2393] T 9c0f604d66664505aa9469fb058601b6 P 2513a663afac495eb09126ff55e8b2b0 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 665f7e09521a4c3f9284c1d8b0e094ff in current term 1: Already voted for candidate 2513a663afac495eb09126ff55e8b2b0 in this term.
I20260709 13:08:26.359236 27865 tablet_bootstrap.cc:654] T b6be829f6d3f40c99a3c5be18b0c259c P 18435fbb525741328139e84a1e354954: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:26.366343 28197 raft_consensus.cc:515] T 539b1d2240654c74bd9054a06a8eaac6 P 41268b218b804905a110c86738e74400 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "41268b218b804905a110c86738e74400" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 44403 } } peers { permanent_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 38749 } } peers { permanent_uuid: "18435fbb525741328139e84a1e354954" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 40545 } }
I20260709 13:08:26.322540 28219 raft_consensus.cc:515] T 9db60240699a4db2ba5faa2c50a742da P 18435fbb525741328139e84a1e354954 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 38749 } } peers { permanent_uuid: "18435fbb525741328139e84a1e354954" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 40545 } } peers { permanent_uuid: "2513a663afac495eb09126ff55e8b2b0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40721 } }
I20260709 13:08:26.378930 27862 tablet_bootstrap.cc:492] T fb246ce2984c4a6393f12f75083c9fcf P 665f7e09521a4c3f9284c1d8b0e094ff: Bootstrap starting.
I20260709 13:08:26.394708 27741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "539b1d2240654c74bd9054a06a8eaac6" candidate_uuid: "41268b218b804905a110c86738e74400" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "665f7e09521a4c3f9284c1d8b0e094ff"
I20260709 13:08:26.395601 27741 raft_consensus.cc:3060] T 539b1d2240654c74bd9054a06a8eaac6 P 665f7e09521a4c3f9284c1d8b0e094ff [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:26.400384 27815 raft_consensus.cc:2468] T 9db60240699a4db2ba5faa2c50a742da P 18435fbb525741328139e84a1e354954 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 665f7e09521a4c3f9284c1d8b0e094ff in term 0.
W20260709 13:08:26.408298 27631 leader_election.cc:343] T 86af954f570648969cbc47c03d15c447 P 41268b218b804905a110c86738e74400 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2513a663afac495eb09126ff55e8b2b0 (127.17.223.1:40721): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:26.409014 27631 leader_election.cc:304] T 86af954f570648969cbc47c03d15c447 P 41268b218b804905a110c86738e74400 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 41268b218b804905a110c86738e74400; no voters: 18435fbb525741328139e84a1e354954, 2513a663afac495eb09126ff55e8b2b0
I20260709 13:08:26.410857 28136 raft_consensus.cc:2749] T 86af954f570648969cbc47c03d15c447 P 41268b218b804905a110c86738e74400 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:08:26.414011 27861 tablet_bootstrap.cc:492] T e23b142958324f69aa0bad3a5828fa83 P 2513a663afac495eb09126ff55e8b2b0: No bootstrap required, opened a new log
I20260709 13:08:26.413533 28139 consensus_queue.cc:1048] T 28737c73be174729ad3e9d238af7d975 P 41268b218b804905a110c86738e74400 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2513a663afac495eb09126ff55e8b2b0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40721 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:08:26.414582 27861 ts_tablet_manager.cc:1403] T e23b142958324f69aa0bad3a5828fa83 P 2513a663afac495eb09126ff55e8b2b0: Time spent bootstrapping tablet: real 0.223s	user 0.008s	sys 0.024s
I20260709 13:08:26.417093 28270 raft_consensus.cc:493] T b6be829f6d3f40c99a3c5be18b0c259c P 2513a663afac495eb09126ff55e8b2b0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:26.422610 28270 raft_consensus.cc:515] T b6be829f6d3f40c99a3c5be18b0c259c P 2513a663afac495eb09126ff55e8b2b0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18435fbb525741328139e84a1e354954" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 40545 } } peers { permanent_uuid: "2513a663afac495eb09126ff55e8b2b0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40721 } } peers { permanent_uuid: "41268b218b804905a110c86738e74400" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 44403 } }
I20260709 13:08:26.424655 28270 leader_election.cc:290] T b6be829f6d3f40c99a3c5be18b0c259c P 2513a663afac495eb09126ff55e8b2b0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 18435fbb525741328139e84a1e354954 (127.17.223.4:40545), 41268b218b804905a110c86738e74400 (127.17.223.2:44403)
I20260709 13:08:26.437091 27741 raft_consensus.cc:2468] T 539b1d2240654c74bd9054a06a8eaac6 P 665f7e09521a4c3f9284c1d8b0e094ff [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 41268b218b804905a110c86738e74400 in term 1.
W20260709 13:08:26.416288 28286 log.cc:927] Time spent T 28737c73be174729ad3e9d238af7d975 P 18435fbb525741328139e84a1e354954: Append to log took a long time: real 0.096s	user 0.001s	sys 0.000s
I20260709 13:08:26.420266 28197 leader_election.cc:290] T 539b1d2240654c74bd9054a06a8eaac6 P 41268b218b804905a110c86738e74400 [CANDIDATE]: Term 1 election: Requested vote from peers 665f7e09521a4c3f9284c1d8b0e094ff (127.17.223.3:38749), 18435fbb525741328139e84a1e354954 (127.17.223.4:40545)
I20260709 13:08:26.446154 27861 raft_consensus.cc:359] T e23b142958324f69aa0bad3a5828fa83 P 2513a663afac495eb09126ff55e8b2b0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2513a663afac495eb09126ff55e8b2b0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40721 } } peers { permanent_uuid: "41268b218b804905a110c86738e74400" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 44403 } } peers { permanent_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 38749 } }
I20260709 13:08:26.449836 27861 raft_consensus.cc:385] T e23b142958324f69aa0bad3a5828fa83 P 2513a663afac495eb09126ff55e8b2b0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:26.450210 27861 raft_consensus.cc:740] T e23b142958324f69aa0bad3a5828fa83 P 2513a663afac495eb09126ff55e8b2b0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2513a663afac495eb09126ff55e8b2b0, State: Initialized, Role: FOLLOWER
I20260709 13:08:26.451097 27861 consensus_queue.cc:260] T e23b142958324f69aa0bad3a5828fa83 P 2513a663afac495eb09126ff55e8b2b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2513a663afac495eb09126ff55e8b2b0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40721 } } peers { permanent_uuid: "41268b218b804905a110c86738e74400" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 44403 } } peers { permanent_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 38749 } }
I20260709 13:08:26.460551 27708 leader_election.cc:304] T 9db60240699a4db2ba5faa2c50a742da P 665f7e09521a4c3f9284c1d8b0e094ff [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 18435fbb525741328139e84a1e354954, 665f7e09521a4c3f9284c1d8b0e094ff; no voters: 2513a663afac495eb09126ff55e8b2b0
I20260709 13:08:26.463416 27903 raft_consensus.cc:2804] T 9db60240699a4db2ba5faa2c50a742da P 665f7e09521a4c3f9284c1d8b0e094ff [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:08:26.463868 27903 raft_consensus.cc:493] T 9db60240699a4db2ba5faa2c50a742da P 665f7e09521a4c3f9284c1d8b0e094ff [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:26.464251 27903 raft_consensus.cc:3060] T 9db60240699a4db2ba5faa2c50a742da P 665f7e09521a4c3f9284c1d8b0e094ff [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:26.455570 27634 leader_election.cc:304] T 539b1d2240654c74bd9054a06a8eaac6 P 41268b218b804905a110c86738e74400 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 41268b218b804905a110c86738e74400, 665f7e09521a4c3f9284c1d8b0e094ff; no voters: 
I20260709 13:08:26.448390 27585 raft_consensus.cc:3060] T 585e960f8d0f42268f2fe98e1e7b83f0 P 2513a663afac495eb09126ff55e8b2b0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:26.493125 27861 ts_tablet_manager.cc:1434] T e23b142958324f69aa0bad3a5828fa83 P 2513a663afac495eb09126ff55e8b2b0: Time spent starting tablet: real 0.072s	user 0.007s	sys 0.001s
I20260709 13:08:26.476465 28197 raft_consensus.cc:2804] T 539b1d2240654c74bd9054a06a8eaac6 P 41268b218b804905a110c86738e74400 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:08:26.477902 28196 raft_consensus.cc:493] T bbd0bdc9640c4956a5d60406841ef0f0 P 41268b218b804905a110c86738e74400 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:26.507952 27861 tablet_bootstrap.cc:492] T 86af954f570648969cbc47c03d15c447 P 2513a663afac495eb09126ff55e8b2b0: Bootstrap starting.
I20260709 13:08:26.462280 28157 consensus_queue.cc:1048] T e23b142958324f69aa0bad3a5828fa83 P 665f7e09521a4c3f9284c1d8b0e094ff [LEADER]: Connected to new peer: Peer: permanent_uuid: "41268b218b804905a110c86738e74400" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 44403 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.036s
I20260709 13:08:26.510982 27903 raft_consensus.cc:515] T 9db60240699a4db2ba5faa2c50a742da P 665f7e09521a4c3f9284c1d8b0e094ff [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 38749 } } peers { permanent_uuid: "18435fbb525741328139e84a1e354954" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 40545 } } peers { permanent_uuid: "2513a663afac495eb09126ff55e8b2b0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40721 } }
I20260709 13:08:26.488348 27738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9db60240699a4db2ba5faa2c50a742da" candidate_uuid: "18435fbb525741328139e84a1e354954" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" is_pre_election: true
I20260709 13:08:26.516203 27903 leader_election.cc:290] T 9db60240699a4db2ba5faa2c50a742da P 665f7e09521a4c3f9284c1d8b0e094ff [CANDIDATE]: Term 1 election: Requested vote from peers 18435fbb525741328139e84a1e354954 (127.17.223.4:40545), 2513a663afac495eb09126ff55e8b2b0 (127.17.223.1:40721)
I20260709 13:08:26.524580 27816 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9db60240699a4db2ba5faa2c50a742da" candidate_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "18435fbb525741328139e84a1e354954"
I20260709 13:08:26.525436 27816 raft_consensus.cc:3060] T 9db60240699a4db2ba5faa2c50a742da P 18435fbb525741328139e84a1e354954 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:26.516779 28197 raft_consensus.cc:697] T 539b1d2240654c74bd9054a06a8eaac6 P 41268b218b804905a110c86738e74400 [term 1 LEADER]: Becoming Leader. State: Replica: 41268b218b804905a110c86738e74400, State: Running, Role: LEADER
I20260709 13:08:26.533540 27865 tablet_bootstrap.cc:492] T b6be829f6d3f40c99a3c5be18b0c259c P 18435fbb525741328139e84a1e354954: No bootstrap required, opened a new log
I20260709 13:08:26.516101 28196 raft_consensus.cc:515] T bbd0bdc9640c4956a5d60406841ef0f0 P 41268b218b804905a110c86738e74400 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2513a663afac495eb09126ff55e8b2b0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40721 } } peers { permanent_uuid: "41268b218b804905a110c86738e74400" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 44403 } } peers { permanent_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 38749 } }
I20260709 13:08:26.534061 27865 ts_tablet_manager.cc:1403] T b6be829f6d3f40c99a3c5be18b0c259c P 18435fbb525741328139e84a1e354954: Time spent bootstrapping tablet: real 0.267s	user 0.031s	sys 0.039s
I20260709 13:08:26.535560 28196 leader_election.cc:290] T bbd0bdc9640c4956a5d60406841ef0f0 P 41268b218b804905a110c86738e74400 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2513a663afac495eb09126ff55e8b2b0 (127.17.223.1:40721), 665f7e09521a4c3f9284c1d8b0e094ff (127.17.223.3:38749)
W20260709 13:08:26.544649 27705 consensus_peers.cc:597] T e23b142958324f69aa0bad3a5828fa83 P 665f7e09521a4c3f9284c1d8b0e094ff -> Peer 2513a663afac495eb09126ff55e8b2b0 (127.17.223.1:40721): Couldn't send request to peer 2513a663afac495eb09126ff55e8b2b0. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:08:26.545835 27738 raft_consensus.cc:2393] T 9db60240699a4db2ba5faa2c50a742da P 665f7e09521a4c3f9284c1d8b0e094ff [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 18435fbb525741328139e84a1e354954 in current term 1: Already voted for candidate 665f7e09521a4c3f9284c1d8b0e094ff in this term.
I20260709 13:08:26.532739 27814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "539b1d2240654c74bd9054a06a8eaac6" candidate_uuid: "41268b218b804905a110c86738e74400" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "18435fbb525741328139e84a1e354954"
I20260709 13:08:26.555660 27862 tablet_bootstrap.cc:654] T fb246ce2984c4a6393f12f75083c9fcf P 665f7e09521a4c3f9284c1d8b0e094ff: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:26.556269 27865 raft_consensus.cc:359] T b6be829f6d3f40c99a3c5be18b0c259c P 18435fbb525741328139e84a1e354954 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18435fbb525741328139e84a1e354954" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 40545 } } peers { permanent_uuid: "2513a663afac495eb09126ff55e8b2b0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40721 } } peers { permanent_uuid: "41268b218b804905a110c86738e74400" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 44403 } }
I20260709 13:08:26.557077 27865 raft_consensus.cc:385] T b6be829f6d3f40c99a3c5be18b0c259c P 18435fbb525741328139e84a1e354954 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:26.557411 27865 raft_consensus.cc:740] T b6be829f6d3f40c99a3c5be18b0c259c P 18435fbb525741328139e84a1e354954 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 18435fbb525741328139e84a1e354954, State: Initialized, Role: FOLLOWER
I20260709 13:08:26.558247 27865 consensus_queue.cc:260] T b6be829f6d3f40c99a3c5be18b0c259c P 18435fbb525741328139e84a1e354954 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18435fbb525741328139e84a1e354954" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 40545 } } peers { permanent_uuid: "2513a663afac495eb09126ff55e8b2b0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40721 } } peers { permanent_uuid: "41268b218b804905a110c86738e74400" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 44403 } }
I20260709 13:08:26.561611 27559 leader_election.cc:304] T 585e960f8d0f42268f2fe98e1e7b83f0 P 2513a663afac495eb09126ff55e8b2b0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2513a663afac495eb09126ff55e8b2b0; no voters: 41268b218b804905a110c86738e74400, 665f7e09521a4c3f9284c1d8b0e094ff
I20260709 13:08:26.565466 27816 raft_consensus.cc:2468] T 9db60240699a4db2ba5faa2c50a742da P 18435fbb525741328139e84a1e354954 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 665f7e09521a4c3f9284c1d8b0e094ff in term 1.
I20260709 13:08:26.574306 27865 ts_tablet_manager.cc:1434] T b6be829f6d3f40c99a3c5be18b0c259c P 18435fbb525741328139e84a1e354954: Time spent starting tablet: real 0.040s	user 0.008s	sys 0.000s
I20260709 13:08:26.575624 27865 tablet_bootstrap.cc:492] T 9c0f604d66664505aa9469fb058601b6 P 18435fbb525741328139e84a1e354954: Bootstrap starting.
I20260709 13:08:26.570501 28232 raft_consensus.cc:2749] T 585e960f8d0f42268f2fe98e1e7b83f0 P 2513a663afac495eb09126ff55e8b2b0 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:08:26.579959 28214 leader_election.cc:290] T 9c0f604d66664505aa9469fb058601b6 P 2513a663afac495eb09126ff55e8b2b0 [CANDIDATE]: Term 1 election: Requested vote from peers 665f7e09521a4c3f9284c1d8b0e094ff (127.17.223.3:38749), 18435fbb525741328139e84a1e354954 (127.17.223.4:40545)
I20260709 13:08:26.579983 28295 raft_consensus.cc:493] T bbd0bdc9640c4956a5d60406841ef0f0 P 665f7e09521a4c3f9284c1d8b0e094ff [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:26.581810 28295 raft_consensus.cc:515] T bbd0bdc9640c4956a5d60406841ef0f0 P 665f7e09521a4c3f9284c1d8b0e094ff [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2513a663afac495eb09126ff55e8b2b0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40721 } } peers { permanent_uuid: "41268b218b804905a110c86738e74400" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 44403 } } peers { permanent_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 38749 } }
I20260709 13:08:26.582281 27593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9db60240699a4db2ba5faa2c50a742da" candidate_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2513a663afac495eb09126ff55e8b2b0"
I20260709 13:08:26.583830 28295 leader_election.cc:290] T bbd0bdc9640c4956a5d60406841ef0f0 P 665f7e09521a4c3f9284c1d8b0e094ff [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2513a663afac495eb09126ff55e8b2b0 (127.17.223.1:40721), 41268b218b804905a110c86738e74400 (127.17.223.2:44403)
I20260709 13:08:26.568460 28136 raft_consensus.cc:493] T 8e0d496efc3f41f3be82a538ef3cfdac P 41268b218b804905a110c86738e74400 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 665f7e09521a4c3f9284c1d8b0e094ff)
I20260709 13:08:26.589993 27592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbd0bdc9640c4956a5d60406841ef0f0" candidate_uuid: "41268b218b804905a110c86738e74400" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2513a663afac495eb09126ff55e8b2b0" is_pre_election: true
I20260709 13:08:26.596158 27489 catalog_manager.cc:5697] T 28737c73be174729ad3e9d238af7d975 P 41268b218b804905a110c86738e74400 reported cstate change: term changed from 0 to 1, leader changed from <none> to 41268b218b804905a110c86738e74400 (127.17.223.2). New cstate: current_term: 1 leader_uuid: "41268b218b804905a110c86738e74400" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18435fbb525741328139e84a1e354954" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 40545 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2513a663afac495eb09126ff55e8b2b0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40721 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "41268b218b804905a110c86738e74400" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 44403 } health_report { overall_health: HEALTHY } } }
I20260709 13:08:26.597206 27664 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6be829f6d3f40c99a3c5be18b0c259c" candidate_uuid: "2513a663afac495eb09126ff55e8b2b0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "41268b218b804905a110c86738e74400" is_pre_election: true
I20260709 13:08:26.597908 27664 raft_consensus.cc:2468] T b6be829f6d3f40c99a3c5be18b0c259c P 41268b218b804905a110c86738e74400 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2513a663afac495eb09126ff55e8b2b0 in term 0.
I20260709 13:08:26.600004 27816 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6be829f6d3f40c99a3c5be18b0c259c" candidate_uuid: "2513a663afac495eb09126ff55e8b2b0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "18435fbb525741328139e84a1e354954" is_pre_election: true
I20260709 13:08:26.589304 28197 consensus_queue.cc:237] T 539b1d2240654c74bd9054a06a8eaac6 P 41268b218b804905a110c86738e74400 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "41268b218b804905a110c86738e74400" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 44403 } } peers { permanent_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 38749 } } peers { permanent_uuid: "18435fbb525741328139e84a1e354954" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 40545 } }
I20260709 13:08:26.600726 27491 catalog_manager.cc:5697] T 585e960f8d0f42268f2fe98e1e7b83f0 P 665f7e09521a4c3f9284c1d8b0e094ff reported cstate change: term changed from 0 to 1, leader changed from <none> to 665f7e09521a4c3f9284c1d8b0e094ff (127.17.223.3). New cstate: current_term: 1 leader_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2513a663afac495eb09126ff55e8b2b0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40721 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "41268b218b804905a110c86738e74400" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 44403 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 38749 } health_report { overall_health: HEALTHY } } }
W20260709 13:08:26.607134 27634 leader_election.cc:343] T 539b1d2240654c74bd9054a06a8eaac6 P 41268b218b804905a110c86738e74400 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 18435fbb525741328139e84a1e354954 (127.17.223.4:40545): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:26.586510 28219 leader_election.cc:290] T 9db60240699a4db2ba5faa2c50a742da P 18435fbb525741328139e84a1e354954 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 665f7e09521a4c3f9284c1d8b0e094ff (127.17.223.3:38749), 2513a663afac495eb09126ff55e8b2b0 (127.17.223.1:40721)
I20260709 13:08:26.608567 27903 consensus_queue.cc:1048] T 585e960f8d0f42268f2fe98e1e7b83f0 P 665f7e09521a4c3f9284c1d8b0e094ff [LEADER]: Connected to new peer: Peer: permanent_uuid: "2513a663afac495eb09126ff55e8b2b0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40721 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:08:26.601643 27738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c0f604d66664505aa9469fb058601b6" candidate_uuid: "2513a663afac495eb09126ff55e8b2b0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "665f7e09521a4c3f9284c1d8b0e094ff"
I20260709 13:08:26.600634 27816 raft_consensus.cc:2468] T b6be829f6d3f40c99a3c5be18b0c259c P 18435fbb525741328139e84a1e354954 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2513a663afac495eb09126ff55e8b2b0 in term 0.
W20260709 13:08:26.614401 27708 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.2:44403, user_credentials={real_user=slave}} blocked reactor thread for 59800.3us
W20260709 13:08:26.629442 27559 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.3:38749, user_credentials={real_user=slave}} blocked reactor thread for 61226.6us
I20260709 13:08:26.593180 28136 raft_consensus.cc:515] T 8e0d496efc3f41f3be82a538ef3cfdac P 41268b218b804905a110c86738e74400 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "41268b218b804905a110c86738e74400" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 44403 } } peers { permanent_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 38749 } } peers { permanent_uuid: "18435fbb525741328139e84a1e354954" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 40545 } }
I20260709 13:08:26.624079 27705 leader_election.cc:304] T 9c0f604d66664505aa9469fb058601b6 P 665f7e09521a4c3f9284c1d8b0e094ff [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 665f7e09521a4c3f9284c1d8b0e094ff; no voters: 18435fbb525741328139e84a1e354954, 2513a663afac495eb09126ff55e8b2b0
I20260709 13:08:26.636502 27861 tablet_bootstrap.cc:654] T 86af954f570648969cbc47c03d15c447 P 2513a663afac495eb09126ff55e8b2b0: Neither blocks nor log segments found. Creating new log.
W20260709 13:08:26.637682 27631 leader_election.cc:343] T bbd0bdc9640c4956a5d60406841ef0f0 P 41268b218b804905a110c86738e74400 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2513a663afac495eb09126ff55e8b2b0 (127.17.223.1:40721): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:26.641983 27559 leader_election.cc:304] T b6be829f6d3f40c99a3c5be18b0c259c P 2513a663afac495eb09126ff55e8b2b0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2513a663afac495eb09126ff55e8b2b0, 41268b218b804905a110c86738e74400; no voters: 
I20260709 13:08:26.642762 27708 leader_election.cc:304] T 9db60240699a4db2ba5faa2c50a742da P 665f7e09521a4c3f9284c1d8b0e094ff [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 18435fbb525741328139e84a1e354954, 665f7e09521a4c3f9284c1d8b0e094ff; no voters: 
I20260709 13:08:26.658535 28302 raft_consensus.cc:2804] T b6be829f6d3f40c99a3c5be18b0c259c P 2513a663afac495eb09126ff55e8b2b0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:08:26.658921 27663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbd0bdc9640c4956a5d60406841ef0f0" candidate_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "41268b218b804905a110c86738e74400" is_pre_election: true
I20260709 13:08:26.659657 27663 raft_consensus.cc:2468] T bbd0bdc9640c4956a5d60406841ef0f0 P 41268b218b804905a110c86738e74400 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 665f7e09521a4c3f9284c1d8b0e094ff in term 0.
I20260709 13:08:26.659740 28304 raft_consensus.cc:2804] T 9db60240699a4db2ba5faa2c50a742da P 665f7e09521a4c3f9284c1d8b0e094ff [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:08:26.660521 28304 raft_consensus.cc:697] T 9db60240699a4db2ba5faa2c50a742da P 665f7e09521a4c3f9284c1d8b0e094ff [term 1 LEADER]: Becoming Leader. State: Replica: 665f7e09521a4c3f9284c1d8b0e094ff, State: Running, Role: LEADER
I20260709 13:08:26.659080 28302 raft_consensus.cc:493] T b6be829f6d3f40c99a3c5be18b0c259c P 2513a663afac495eb09126ff55e8b2b0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:26.662396 28302 raft_consensus.cc:3060] T b6be829f6d3f40c99a3c5be18b0c259c P 2513a663afac495eb09126ff55e8b2b0 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:08:26.666890 27705 leader_election.cc:343] T 9db60240699a4db2ba5faa2c50a742da P 665f7e09521a4c3f9284c1d8b0e094ff [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 2513a663afac495eb09126ff55e8b2b0 (127.17.223.1:40721): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:26.651298 27738 raft_consensus.cc:2393] T 9c0f604d66664505aa9469fb058601b6 P 665f7e09521a4c3f9284c1d8b0e094ff [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 2513a663afac495eb09126ff55e8b2b0 in current term 1: Already voted for candidate 665f7e09521a4c3f9284c1d8b0e094ff in this term.
I20260709 13:08:26.674933 27741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbd0bdc9640c4956a5d60406841ef0f0" candidate_uuid: "41268b218b804905a110c86738e74400" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" is_pre_election: true
I20260709 13:08:26.675777 27741 raft_consensus.cc:2468] T bbd0bdc9640c4956a5d60406841ef0f0 P 665f7e09521a4c3f9284c1d8b0e094ff [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 41268b218b804905a110c86738e74400 in term 0.
I20260709 13:08:26.686012 27865 tablet_bootstrap.cc:654] T 9c0f604d66664505aa9469fb058601b6 P 18435fbb525741328139e84a1e354954: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:26.681193 27588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9db60240699a4db2ba5faa2c50a742da" candidate_uuid: "18435fbb525741328139e84a1e354954" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2513a663afac495eb09126ff55e8b2b0" is_pre_election: true
I20260709 13:08:26.681679 28082 raft_consensus.cc:2749] T 9c0f604d66664505aa9469fb058601b6 P 665f7e09521a4c3f9284c1d8b0e094ff [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:08:26.703572 28136 leader_election.cc:290] T 8e0d496efc3f41f3be82a538ef3cfdac P 41268b218b804905a110c86738e74400 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 665f7e09521a4c3f9284c1d8b0e094ff (127.17.223.3:38749), 18435fbb525741328139e84a1e354954 (127.17.223.4:40545)
I20260709 13:08:26.701000 27590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbd0bdc9640c4956a5d60406841ef0f0" candidate_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2513a663afac495eb09126ff55e8b2b0" is_pre_election: true
I20260709 13:08:26.662194 28304 consensus_queue.cc:237] T 9db60240699a4db2ba5faa2c50a742da P 665f7e09521a4c3f9284c1d8b0e094ff [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 38749 } } peers { permanent_uuid: "18435fbb525741328139e84a1e354954" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 40545 } } peers { permanent_uuid: "2513a663afac495eb09126ff55e8b2b0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40721 } }
I20260709 13:08:26.716583 27708 leader_election.cc:304] T bbd0bdc9640c4956a5d60406841ef0f0 P 665f7e09521a4c3f9284c1d8b0e094ff [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 41268b218b804905a110c86738e74400, 665f7e09521a4c3f9284c1d8b0e094ff; no voters: 
I20260709 13:08:26.749643 27742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e0d496efc3f41f3be82a538ef3cfdac" candidate_uuid: "41268b218b804905a110c86738e74400" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" is_pre_election: true
I20260709 13:08:26.750316 27742 raft_consensus.cc:2468] T 8e0d496efc3f41f3be82a538ef3cfdac P 665f7e09521a4c3f9284c1d8b0e094ff [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 41268b218b804905a110c86738e74400 in term 2.
W20260709 13:08:26.750805 27779 leader_election.cc:343] T 9db60240699a4db2ba5faa2c50a742da P 18435fbb525741328139e84a1e354954 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2513a663afac495eb09126ff55e8b2b0 (127.17.223.1:40721): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:26.751322 27779 leader_election.cc:304] T 9db60240699a4db2ba5faa2c50a742da P 18435fbb525741328139e84a1e354954 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 18435fbb525741328139e84a1e354954; no voters: 2513a663afac495eb09126ff55e8b2b0, 665f7e09521a4c3f9284c1d8b0e094ff
I20260709 13:08:26.755497 28205 raft_consensus.cc:2749] T 9db60240699a4db2ba5faa2c50a742da P 18435fbb525741328139e84a1e354954 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:08:26.755237 27634 leader_election.cc:304] T bbd0bdc9640c4956a5d60406841ef0f0 P 41268b218b804905a110c86738e74400 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 41268b218b804905a110c86738e74400, 665f7e09521a4c3f9284c1d8b0e094ff; no voters: 2513a663afac495eb09126ff55e8b2b0
I20260709 13:08:26.756878 28280 raft_consensus.cc:2804] T bbd0bdc9640c4956a5d60406841ef0f0 P 41268b218b804905a110c86738e74400 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:08:26.757230 28280 raft_consensus.cc:493] T bbd0bdc9640c4956a5d60406841ef0f0 P 41268b218b804905a110c86738e74400 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:26.759900 28280 raft_consensus.cc:3060] T bbd0bdc9640c4956a5d60406841ef0f0 P 41268b218b804905a110c86738e74400 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:26.757804 27634 leader_election.cc:304] T 8e0d496efc3f41f3be82a538ef3cfdac P 41268b218b804905a110c86738e74400 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 41268b218b804905a110c86738e74400, 665f7e09521a4c3f9284c1d8b0e094ff; no voters: 
I20260709 13:08:26.770813 28197 raft_consensus.cc:2804] T 8e0d496efc3f41f3be82a538ef3cfdac P 41268b218b804905a110c86738e74400 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:08:26.773857 28197 raft_consensus.cc:493] T 8e0d496efc3f41f3be82a538ef3cfdac P 41268b218b804905a110c86738e74400 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 665f7e09521a4c3f9284c1d8b0e094ff)
I20260709 13:08:26.773754 27814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e0d496efc3f41f3be82a538ef3cfdac" candidate_uuid: "41268b218b804905a110c86738e74400" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "18435fbb525741328139e84a1e354954" is_pre_election: true
I20260709 13:08:26.774371 28197 raft_consensus.cc:3060] T 8e0d496efc3f41f3be82a538ef3cfdac P 41268b218b804905a110c86738e74400 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:26.774731 27814 raft_consensus.cc:2393] T 8e0d496efc3f41f3be82a538ef3cfdac P 18435fbb525741328139e84a1e354954 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 41268b218b804905a110c86738e74400 in current term 2: Already voted for candidate 18435fbb525741328139e84a1e354954 in this term.
I20260709 13:08:26.784061 28197 raft_consensus.cc:515] T 8e0d496efc3f41f3be82a538ef3cfdac P 41268b218b804905a110c86738e74400 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "41268b218b804905a110c86738e74400" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 44403 } } peers { permanent_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 38749 } } peers { permanent_uuid: "18435fbb525741328139e84a1e354954" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 40545 } }
W20260709 13:08:26.784854 28307 log.cc:927] Time spent T 539b1d2240654c74bd9054a06a8eaac6 P 41268b218b804905a110c86738e74400: Append to log took a long time: real 0.076s	user 0.000s	sys 0.000s
I20260709 13:08:26.786083 28197 leader_election.cc:290] T 8e0d496efc3f41f3be82a538ef3cfdac P 41268b218b804905a110c86738e74400 [CANDIDATE]: Term 2 election: Requested vote from peers 665f7e09521a4c3f9284c1d8b0e094ff (127.17.223.3:38749), 18435fbb525741328139e84a1e354954 (127.17.223.4:40545)
I20260709 13:08:26.787031 27815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c0f604d66664505aa9469fb058601b6" candidate_uuid: "2513a663afac495eb09126ff55e8b2b0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "18435fbb525741328139e84a1e354954"
I20260709 13:08:26.787897 28301 raft_consensus.cc:2804] T bbd0bdc9640c4956a5d60406841ef0f0 P 665f7e09521a4c3f9284c1d8b0e094ff [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:08:26.788331 28301 raft_consensus.cc:493] T bbd0bdc9640c4956a5d60406841ef0f0 P 665f7e09521a4c3f9284c1d8b0e094ff [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:26.788642 28301 raft_consensus.cc:3060] T bbd0bdc9640c4956a5d60406841ef0f0 P 665f7e09521a4c3f9284c1d8b0e094ff [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:26.792407 27737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e0d496efc3f41f3be82a538ef3cfdac" candidate_uuid: "41268b218b804905a110c86738e74400" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "665f7e09521a4c3f9284c1d8b0e094ff"
I20260709 13:08:26.791469 28302 raft_consensus.cc:515] T b6be829f6d3f40c99a3c5be18b0c259c P 2513a663afac495eb09126ff55e8b2b0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18435fbb525741328139e84a1e354954" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 40545 } } peers { permanent_uuid: "2513a663afac495eb09126ff55e8b2b0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40721 } } peers { permanent_uuid: "41268b218b804905a110c86738e74400" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 44403 } }
I20260709 13:08:26.796835 28302 leader_election.cc:290] T b6be829f6d3f40c99a3c5be18b0c259c P 2513a663afac495eb09126ff55e8b2b0 [CANDIDATE]: Term 1 election: Requested vote from peers 18435fbb525741328139e84a1e354954 (127.17.223.4:40545), 41268b218b804905a110c86738e74400 (127.17.223.2:44403)
W20260709 13:08:26.798535 27705 leader_election.cc:343] T bbd0bdc9640c4956a5d60406841ef0f0 P 665f7e09521a4c3f9284c1d8b0e094ff [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2513a663afac495eb09126ff55e8b2b0 (127.17.223.1:40721): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:26.801779 27666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6be829f6d3f40c99a3c5be18b0c259c" candidate_uuid: "2513a663afac495eb09126ff55e8b2b0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "41268b218b804905a110c86738e74400"
I20260709 13:08:26.802405 27666 raft_consensus.cc:3060] T b6be829f6d3f40c99a3c5be18b0c259c P 41268b218b804905a110c86738e74400 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:26.805799 28280 raft_consensus.cc:515] T bbd0bdc9640c4956a5d60406841ef0f0 P 41268b218b804905a110c86738e74400 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2513a663afac495eb09126ff55e8b2b0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40721 } } peers { permanent_uuid: "41268b218b804905a110c86738e74400" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 44403 } } peers { permanent_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 38749 } }
I20260709 13:08:26.810263 27666 raft_consensus.cc:2468] T b6be829f6d3f40c99a3c5be18b0c259c P 41268b218b804905a110c86738e74400 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2513a663afac495eb09126ff55e8b2b0 in term 1.
I20260709 13:08:26.819375 28301 raft_consensus.cc:515] T bbd0bdc9640c4956a5d60406841ef0f0 P 665f7e09521a4c3f9284c1d8b0e094ff [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2513a663afac495eb09126ff55e8b2b0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40721 } } peers { permanent_uuid: "41268b218b804905a110c86738e74400" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 44403 } } peers { permanent_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 38749 } }
I20260709 13:08:26.820400 27813 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6be829f6d3f40c99a3c5be18b0c259c" candidate_uuid: "2513a663afac495eb09126ff55e8b2b0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "18435fbb525741328139e84a1e354954"
I20260709 13:08:26.821422 27813 raft_consensus.cc:3060] T b6be829f6d3f40c99a3c5be18b0c259c P 18435fbb525741328139e84a1e354954 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:26.828953 27667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbd0bdc9640c4956a5d60406841ef0f0" candidate_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "41268b218b804905a110c86738e74400"
I20260709 13:08:26.829793 27667 raft_consensus.cc:2393] T bbd0bdc9640c4956a5d60406841ef0f0 P 41268b218b804905a110c86738e74400 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 665f7e09521a4c3f9284c1d8b0e094ff in current term 1: Already voted for candidate 41268b218b804905a110c86738e74400 in this term.
I20260709 13:08:26.810712 27865 tablet_bootstrap.cc:492] T 9c0f604d66664505aa9469fb058601b6 P 18435fbb525741328139e84a1e354954: No bootstrap required, opened a new log
I20260709 13:08:26.833344 27865 ts_tablet_manager.cc:1403] T 9c0f604d66664505aa9469fb058601b6 P 18435fbb525741328139e84a1e354954: Time spent bootstrapping tablet: real 0.258s	user 0.022s	sys 0.015s
I20260709 13:08:26.844939 27559 leader_election.cc:304] T b6be829f6d3f40c99a3c5be18b0c259c P 2513a663afac495eb09126ff55e8b2b0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2513a663afac495eb09126ff55e8b2b0, 41268b218b804905a110c86738e74400; no voters: 
I20260709 13:08:26.857874 27593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbd0bdc9640c4956a5d60406841ef0f0" candidate_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2513a663afac495eb09126ff55e8b2b0"
I20260709 13:08:26.821626 28301 leader_election.cc:290] T bbd0bdc9640c4956a5d60406841ef0f0 P 665f7e09521a4c3f9284c1d8b0e094ff [CANDIDATE]: Term 1 election: Requested vote from peers 2513a663afac495eb09126ff55e8b2b0 (127.17.223.1:40721), 41268b218b804905a110c86738e74400 (127.17.223.2:44403)
W20260709 13:08:26.862257 27559 leader_election.cc:343] T 9c0f604d66664505aa9469fb058601b6 P 2513a663afac495eb09126ff55e8b2b0 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 18435fbb525741328139e84a1e354954 (127.17.223.4:40545): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:26.853201 28232 raft_consensus.cc:2804] T b6be829f6d3f40c99a3c5be18b0c259c P 2513a663afac495eb09126ff55e8b2b0 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:08:26.862977 27559 leader_election.cc:304] T 9c0f604d66664505aa9469fb058601b6 P 2513a663afac495eb09126ff55e8b2b0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2513a663afac495eb09126ff55e8b2b0; no voters: 18435fbb525741328139e84a1e354954, 665f7e09521a4c3f9284c1d8b0e094ff
W20260709 13:08:26.854295 27614 debug-util.cc:398] Leaking SignalData structure 0x7b08003c23a0 after lost signal to thread 18303
I20260709 13:08:26.870002 28269 raft_consensus.cc:2749] T 9c0f604d66664505aa9469fb058601b6 P 2513a663afac495eb09126ff55e8b2b0 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
W20260709 13:08:26.872375 27705 leader_election.cc:343] T bbd0bdc9640c4956a5d60406841ef0f0 P 665f7e09521a4c3f9284c1d8b0e094ff [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 2513a663afac495eb09126ff55e8b2b0 (127.17.223.1:40721): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:26.873351 27862 tablet_bootstrap.cc:492] T fb246ce2984c4a6393f12f75083c9fcf P 665f7e09521a4c3f9284c1d8b0e094ff: No bootstrap required, opened a new log
I20260709 13:08:26.873092 27705 leader_election.cc:304] T bbd0bdc9640c4956a5d60406841ef0f0 P 665f7e09521a4c3f9284c1d8b0e094ff [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 665f7e09521a4c3f9284c1d8b0e094ff; no voters: 2513a663afac495eb09126ff55e8b2b0, 41268b218b804905a110c86738e74400
I20260709 13:08:26.873629 27813 raft_consensus.cc:2468] T b6be829f6d3f40c99a3c5be18b0c259c P 18435fbb525741328139e84a1e354954 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2513a663afac495eb09126ff55e8b2b0 in term 1.
I20260709 13:08:26.873842 27862 ts_tablet_manager.cc:1403] T fb246ce2984c4a6393f12f75083c9fcf P 665f7e09521a4c3f9284c1d8b0e094ff: Time spent bootstrapping tablet: real 0.539s	user 0.011s	sys 0.011s
I20260709 13:08:26.861869 28194 raft_consensus.cc:493] T e23b142958324f69aa0bad3a5828fa83 P 2513a663afac495eb09126ff55e8b2b0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:08:26.874617 27614 debug-util.cc:398] Leaking SignalData structure 0x7b08002d15e0 after lost signal to thread 27525
I20260709 13:08:26.888295 28303 consensus_queue.cc:1048] T afcb3b39d1c9495eab95404687865537 P 665f7e09521a4c3f9284c1d8b0e094ff [LEADER]: Connected to new peer: Peer: permanent_uuid: "18435fbb525741328139e84a1e354954" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 40545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.006s
I20260709 13:08:26.890798 27593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbd0bdc9640c4956a5d60406841ef0f0" candidate_uuid: "41268b218b804905a110c86738e74400" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2513a663afac495eb09126ff55e8b2b0"
I20260709 13:08:26.874629 28232 raft_consensus.cc:697] T b6be829f6d3f40c99a3c5be18b0c259c P 2513a663afac495eb09126ff55e8b2b0 [term 1 LEADER]: Becoming Leader. State: Replica: 2513a663afac495eb09126ff55e8b2b0, State: Running, Role: LEADER
I20260709 13:08:26.876897 28157 raft_consensus.cc:2749] T bbd0bdc9640c4956a5d60406841ef0f0 P 665f7e09521a4c3f9284c1d8b0e094ff [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:08:26.874384 28280 leader_election.cc:290] T bbd0bdc9640c4956a5d60406841ef0f0 P 41268b218b804905a110c86738e74400 [CANDIDATE]: Term 1 election: Requested vote from peers 2513a663afac495eb09126ff55e8b2b0 (127.17.223.1:40721), 665f7e09521a4c3f9284c1d8b0e094ff (127.17.223.3:38749)
I20260709 13:08:26.892546 27738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbd0bdc9640c4956a5d60406841ef0f0" candidate_uuid: "41268b218b804905a110c86738e74400" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "665f7e09521a4c3f9284c1d8b0e094ff"
I20260709 13:08:26.880283 27737 raft_consensus.cc:2468] T 8e0d496efc3f41f3be82a538ef3cfdac P 665f7e09521a4c3f9284c1d8b0e094ff [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 41268b218b804905a110c86738e74400 in term 2.
I20260709 13:08:26.909672 28232 consensus_queue.cc:237] T b6be829f6d3f40c99a3c5be18b0c259c P 2513a663afac495eb09126ff55e8b2b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18435fbb525741328139e84a1e354954" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 40545 } } peers { permanent_uuid: "2513a663afac495eb09126ff55e8b2b0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40721 } } peers { permanent_uuid: "41268b218b804905a110c86738e74400" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 44403 } }
I20260709 13:08:26.912676 27738 raft_consensus.cc:2393] T bbd0bdc9640c4956a5d60406841ef0f0 P 665f7e09521a4c3f9284c1d8b0e094ff [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 41268b218b804905a110c86738e74400 in current term 1: Already voted for candidate 665f7e09521a4c3f9284c1d8b0e094ff in this term.
I20260709 13:08:26.912418 28303 consensus_queue.cc:1048] T afcb3b39d1c9495eab95404687865537 P 665f7e09521a4c3f9284c1d8b0e094ff [LEADER]: Connected to new peer: Peer: permanent_uuid: "41268b218b804905a110c86738e74400" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 44403 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:08:26.915560 27634 leader_election.cc:304] T 8e0d496efc3f41f3be82a538ef3cfdac P 41268b218b804905a110c86738e74400 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 41268b218b804905a110c86738e74400, 665f7e09521a4c3f9284c1d8b0e094ff; no voters: 
I20260709 13:08:26.922751 27861 tablet_bootstrap.cc:492] T 86af954f570648969cbc47c03d15c447 P 2513a663afac495eb09126ff55e8b2b0: No bootstrap required, opened a new log
W20260709 13:08:26.902953 27631 leader_election.cc:343] T bbd0bdc9640c4956a5d60406841ef0f0 P 41268b218b804905a110c86738e74400 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 2513a663afac495eb09126ff55e8b2b0 (127.17.223.1:40721): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:26.923424 27861 ts_tablet_manager.cc:1403] T 86af954f570648969cbc47c03d15c447 P 2513a663afac495eb09126ff55e8b2b0: Time spent bootstrapping tablet: real 0.422s	user 0.023s	sys 0.001s
I20260709 13:08:26.932425 27634 leader_election.cc:304] T bbd0bdc9640c4956a5d60406841ef0f0 P 41268b218b804905a110c86738e74400 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 41268b218b804905a110c86738e74400; no voters: 2513a663afac495eb09126ff55e8b2b0, 665f7e09521a4c3f9284c1d8b0e094ff
I20260709 13:08:26.932734 27861 raft_consensus.cc:359] T 86af954f570648969cbc47c03d15c447 P 2513a663afac495eb09126ff55e8b2b0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18435fbb525741328139e84a1e354954" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 40545 } } peers { permanent_uuid: "2513a663afac495eb09126ff55e8b2b0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40721 } } peers { permanent_uuid: "41268b218b804905a110c86738e74400" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 44403 } }
I20260709 13:08:26.933328 27978 raft_consensus.cc:2749] T bbd0bdc9640c4956a5d60406841ef0f0 P 41268b218b804905a110c86738e74400 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:08:26.933698 27865 raft_consensus.cc:359] T 9c0f604d66664505aa9469fb058601b6 P 18435fbb525741328139e84a1e354954 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 38749 } } peers { permanent_uuid: "18435fbb525741328139e84a1e354954" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 40545 } } peers { permanent_uuid: "2513a663afac495eb09126ff55e8b2b0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40721 } }
I20260709 13:08:26.929414 28298 raft_consensus.cc:2804] T 8e0d496efc3f41f3be82a538ef3cfdac P 41268b218b804905a110c86738e74400 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:08:26.933439 27861 raft_consensus.cc:385] T 86af954f570648969cbc47c03d15c447 P 2513a663afac495eb09126ff55e8b2b0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:26.928381 27811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e0d496efc3f41f3be82a538ef3cfdac" candidate_uuid: "41268b218b804905a110c86738e74400" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "18435fbb525741328139e84a1e354954"
I20260709 13:08:26.883826 28194 raft_consensus.cc:515] T e23b142958324f69aa0bad3a5828fa83 P 2513a663afac495eb09126ff55e8b2b0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2513a663afac495eb09126ff55e8b2b0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40721 } } peers { permanent_uuid: "41268b218b804905a110c86738e74400" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 44403 } } peers { permanent_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 38749 } }
I20260709 13:08:26.934638 27865 raft_consensus.cc:385] T 9c0f604d66664505aa9469fb058601b6 P 18435fbb525741328139e84a1e354954 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:26.942340 27865 raft_consensus.cc:740] T 9c0f604d66664505aa9469fb058601b6 P 18435fbb525741328139e84a1e354954 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 18435fbb525741328139e84a1e354954, State: Initialized, Role: FOLLOWER
I20260709 13:08:26.943374 27865 consensus_queue.cc:260] T 9c0f604d66664505aa9469fb058601b6 P 18435fbb525741328139e84a1e354954 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 38749 } } peers { permanent_uuid: "18435fbb525741328139e84a1e354954" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 40545 } } peers { permanent_uuid: "2513a663afac495eb09126ff55e8b2b0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40721 } }
W20260709 13:08:26.945077 27559 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.4:40545, user_credentials={real_user=slave}} blocked reactor thread for 76858.3us
I20260709 13:08:26.937558 27811 raft_consensus.cc:2393] T 8e0d496efc3f41f3be82a538ef3cfdac P 18435fbb525741328139e84a1e354954 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 41268b218b804905a110c86738e74400 in current term 2: Already voted for candidate 18435fbb525741328139e84a1e354954 in this term.
W20260709 13:08:26.945077 27614 debug-util.cc:398] Leaking SignalData structure 0x7b08001b5200 after lost signal to thread 27617
I20260709 13:08:26.937107 27861 raft_consensus.cc:740] T 86af954f570648969cbc47c03d15c447 P 2513a663afac495eb09126ff55e8b2b0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2513a663afac495eb09126ff55e8b2b0, State: Initialized, Role: FOLLOWER
W20260709 13:08:26.949831 27614 debug-util.cc:398] Leaking SignalData structure 0x7b08003abf40 after lost signal to thread 27692
I20260709 13:08:26.937235 28298 raft_consensus.cc:697] T 8e0d496efc3f41f3be82a538ef3cfdac P 41268b218b804905a110c86738e74400 [term 2 LEADER]: Becoming Leader. State: Replica: 41268b218b804905a110c86738e74400, State: Running, Role: LEADER
W20260709 13:08:26.951071 27614 debug-util.cc:398] Leaking SignalData structure 0x7b0800408b40 after lost signal to thread 27766
I20260709 13:08:26.951519 28298 consensus_queue.cc:237] T 8e0d496efc3f41f3be82a538ef3cfdac P 41268b218b804905a110c86738e74400 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "41268b218b804905a110c86738e74400" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 44403 } } peers { permanent_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 38749 } } peers { permanent_uuid: "18435fbb525741328139e84a1e354954" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 40545 } }
W20260709 13:08:26.952267 27614 debug-util.cc:398] Leaking SignalData structure 0x7b08002db4a0 after lost signal to thread 27840
I20260709 13:08:26.939369 28194 leader_election.cc:290] T e23b142958324f69aa0bad3a5828fa83 P 2513a663afac495eb09126ff55e8b2b0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 41268b218b804905a110c86738e74400 (127.17.223.2:44403), 665f7e09521a4c3f9284c1d8b0e094ff (127.17.223.3:38749)
I20260709 13:08:26.953549 27862 raft_consensus.cc:359] T fb246ce2984c4a6393f12f75083c9fcf P 665f7e09521a4c3f9284c1d8b0e094ff [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 38749 } } peers { permanent_uuid: "18435fbb525741328139e84a1e354954" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 40545 } } peers { permanent_uuid: "2513a663afac495eb09126ff55e8b2b0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40721 } }
I20260709 13:08:26.954255 27862 raft_consensus.cc:385] T fb246ce2984c4a6393f12f75083c9fcf P 665f7e09521a4c3f9284c1d8b0e094ff [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:26.954510 27862 raft_consensus.cc:740] T fb246ce2984c4a6393f12f75083c9fcf P 665f7e09521a4c3f9284c1d8b0e094ff [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 665f7e09521a4c3f9284c1d8b0e094ff, State: Initialized, Role: FOLLOWER
I20260709 13:08:26.950249 27861 consensus_queue.cc:260] T 86af954f570648969cbc47c03d15c447 P 2513a663afac495eb09126ff55e8b2b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18435fbb525741328139e84a1e354954" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 40545 } } peers { permanent_uuid: "2513a663afac495eb09126ff55e8b2b0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40721 } } peers { permanent_uuid: "41268b218b804905a110c86738e74400" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 44403 } }
I20260709 13:08:26.956061 27862 consensus_queue.cc:260] T fb246ce2984c4a6393f12f75083c9fcf P 665f7e09521a4c3f9284c1d8b0e094ff [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 38749 } } peers { permanent_uuid: "18435fbb525741328139e84a1e354954" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 40545 } } peers { permanent_uuid: "2513a663afac495eb09126ff55e8b2b0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40721 } }
I20260709 13:08:26.958292 27865 ts_tablet_manager.cc:1434] T 9c0f604d66664505aa9469fb058601b6 P 18435fbb525741328139e84a1e354954: Time spent starting tablet: real 0.125s	user 0.005s	sys 0.003s
I20260709 13:08:26.962123 27861 ts_tablet_manager.cc:1434] T 86af954f570648969cbc47c03d15c447 P 2513a663afac495eb09126ff55e8b2b0: Time spent starting tablet: real 0.032s	user 0.007s	sys 0.000s
I20260709 13:08:26.971086 27737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e23b142958324f69aa0bad3a5828fa83" candidate_uuid: "2513a663afac495eb09126ff55e8b2b0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" is_pre_election: true
I20260709 13:08:26.971441 27667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e23b142958324f69aa0bad3a5828fa83" candidate_uuid: "2513a663afac495eb09126ff55e8b2b0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "41268b218b804905a110c86738e74400" is_pre_election: true
I20260709 13:08:26.961787 27590 raft_consensus.cc:3060] T e23b142958324f69aa0bad3a5828fa83 P 2513a663afac495eb09126ff55e8b2b0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:26.975914 27861 tablet_bootstrap.cc:492] T fb246ce2984c4a6393f12f75083c9fcf P 2513a663afac495eb09126ff55e8b2b0: Bootstrap starting.
I20260709 13:08:26.976270 27865 tablet_bootstrap.cc:492] T fb246ce2984c4a6393f12f75083c9fcf P 18435fbb525741328139e84a1e354954: Bootstrap starting.
I20260709 13:08:26.980708 27862 ts_tablet_manager.cc:1434] T fb246ce2984c4a6393f12f75083c9fcf P 665f7e09521a4c3f9284c1d8b0e094ff: Time spent starting tablet: real 0.106s	user 0.006s	sys 0.001s
I20260709 13:08:26.986249 27559 leader_election.cc:304] T e23b142958324f69aa0bad3a5828fa83 P 2513a663afac495eb09126ff55e8b2b0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2513a663afac495eb09126ff55e8b2b0; no voters: 41268b218b804905a110c86738e74400, 665f7e09521a4c3f9284c1d8b0e094ff
I20260709 13:08:26.991765 27861 tablet_bootstrap.cc:654] T fb246ce2984c4a6393f12f75083c9fcf P 2513a663afac495eb09126ff55e8b2b0: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:27.001993 28101 raft_consensus.cc:493] T 8e0d496efc3f41f3be82a538ef3cfdac P 18435fbb525741328139e84a1e354954 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:27.002564 28101 raft_consensus.cc:515] T 8e0d496efc3f41f3be82a538ef3cfdac P 18435fbb525741328139e84a1e354954 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "41268b218b804905a110c86738e74400" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 44403 } } peers { permanent_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 38749 } } peers { permanent_uuid: "18435fbb525741328139e84a1e354954" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 40545 } }
I20260709 13:08:27.004694 28101 leader_election.cc:290] T 8e0d496efc3f41f3be82a538ef3cfdac P 18435fbb525741328139e84a1e354954 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 41268b218b804905a110c86738e74400 (127.17.223.2:44403), 665f7e09521a4c3f9284c1d8b0e094ff (127.17.223.3:38749)
W20260709 13:08:27.004118 27634 consensus_peers.cc:597] T 539b1d2240654c74bd9054a06a8eaac6 P 41268b218b804905a110c86738e74400 -> Peer 18435fbb525741328139e84a1e354954 (127.17.223.4:40545): Couldn't send request to peer 18435fbb525741328139e84a1e354954. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:08:27.005775 27742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e0d496efc3f41f3be82a538ef3cfdac" candidate_uuid: "18435fbb525741328139e84a1e354954" candidate_term: 3 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" is_pre_election: true
I20260709 13:08:27.007007 27667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e0d496efc3f41f3be82a538ef3cfdac" candidate_uuid: "18435fbb525741328139e84a1e354954" candidate_term: 3 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "41268b218b804905a110c86738e74400" is_pre_election: true
I20260709 13:08:27.007122 27742 raft_consensus.cc:2410] T 8e0d496efc3f41f3be82a538ef3cfdac P 665f7e09521a4c3f9284c1d8b0e094ff [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 18435fbb525741328139e84a1e354954 for term 3 because replica has last-logged OpId of term: 1 index: 1, which is greater than that of the candidate, which has last-logged OpId of term: 0 index: 0.
I20260709 13:08:27.009548 27782 leader_election.cc:304] T 8e0d496efc3f41f3be82a538ef3cfdac P 18435fbb525741328139e84a1e354954 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 18435fbb525741328139e84a1e354954; no voters: 41268b218b804905a110c86738e74400, 665f7e09521a4c3f9284c1d8b0e094ff
I20260709 13:08:27.014295 28101 raft_consensus.cc:2749] T 8e0d496efc3f41f3be82a538ef3cfdac P 18435fbb525741328139e84a1e354954 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:08:27.055646 27865 tablet_bootstrap.cc:654] T fb246ce2984c4a6393f12f75083c9fcf P 18435fbb525741328139e84a1e354954: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:27.058233 27489 catalog_manager.cc:5697] T 9db60240699a4db2ba5faa2c50a742da P 665f7e09521a4c3f9284c1d8b0e094ff reported cstate change: term changed from 0 to 1, leader changed from <none> to 665f7e09521a4c3f9284c1d8b0e094ff (127.17.223.3). New cstate: current_term: 1 leader_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 38749 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "18435fbb525741328139e84a1e354954" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 40545 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2513a663afac495eb09126ff55e8b2b0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40721 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:27.073048 27489 catalog_manager.cc:5697] T afcb3b39d1c9495eab95404687865537 P 665f7e09521a4c3f9284c1d8b0e094ff reported cstate change: term changed from 0 to 1, leader changed from <none> to 665f7e09521a4c3f9284c1d8b0e094ff (127.17.223.3). New cstate: current_term: 1 leader_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "41268b218b804905a110c86738e74400" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 44403 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 38749 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "18435fbb525741328139e84a1e354954" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 40545 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:27.090456 28306 raft_consensus.cc:2749] T e23b142958324f69aa0bad3a5828fa83 P 2513a663afac495eb09126ff55e8b2b0 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:08:27.135855 27708 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.4:40545, user_credentials={real_user=slave}} blocked reactor thread for 44896.1us
W20260709 13:08:27.142830 28325 log.cc:927] Time spent T afcb3b39d1c9495eab95404687865537 P 41268b218b804905a110c86738e74400: Append to log took a long time: real 0.121s	user 0.001s	sys 0.000s
W20260709 13:08:27.159109 28320 log.cc:927] Time spent T e23b142958324f69aa0bad3a5828fa83 P 665f7e09521a4c3f9284c1d8b0e094ff: Append to log took a long time: real 0.191s	user 0.004s	sys 0.000s
I20260709 13:08:27.185495 27865 tablet_bootstrap.cc:492] T fb246ce2984c4a6393f12f75083c9fcf P 18435fbb525741328139e84a1e354954: No bootstrap required, opened a new log
I20260709 13:08:27.186075 27865 ts_tablet_manager.cc:1403] T fb246ce2984c4a6393f12f75083c9fcf P 18435fbb525741328139e84a1e354954: Time spent bootstrapping tablet: real 0.210s	user 0.038s	sys 0.026s
W20260709 13:08:27.194319 27539 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:08:27.196036 27865 raft_consensus.cc:359] T fb246ce2984c4a6393f12f75083c9fcf P 18435fbb525741328139e84a1e354954 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 38749 } } peers { permanent_uuid: "18435fbb525741328139e84a1e354954" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 40545 } } peers { permanent_uuid: "2513a663afac495eb09126ff55e8b2b0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40721 } }
I20260709 13:08:27.196789 27865 raft_consensus.cc:385] T fb246ce2984c4a6393f12f75083c9fcf P 18435fbb525741328139e84a1e354954 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:27.196983 27865 raft_consensus.cc:740] T fb246ce2984c4a6393f12f75083c9fcf P 18435fbb525741328139e84a1e354954 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 18435fbb525741328139e84a1e354954, State: Initialized, Role: FOLLOWER
I20260709 13:08:27.198335 27865 consensus_queue.cc:260] T fb246ce2984c4a6393f12f75083c9fcf P 18435fbb525741328139e84a1e354954 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 38749 } } peers { permanent_uuid: "18435fbb525741328139e84a1e354954" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 40545 } } peers { permanent_uuid: "2513a663afac495eb09126ff55e8b2b0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40721 } }
I20260709 13:08:27.199386 27861 tablet_bootstrap.cc:492] T fb246ce2984c4a6393f12f75083c9fcf P 2513a663afac495eb09126ff55e8b2b0: No bootstrap required, opened a new log
I20260709 13:08:27.199893 27861 ts_tablet_manager.cc:1403] T fb246ce2984c4a6393f12f75083c9fcf P 2513a663afac495eb09126ff55e8b2b0: Time spent bootstrapping tablet: real 0.224s	user 0.043s	sys 0.040s
I20260709 13:08:27.202616 27861 raft_consensus.cc:359] T fb246ce2984c4a6393f12f75083c9fcf P 2513a663afac495eb09126ff55e8b2b0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 38749 } } peers { permanent_uuid: "18435fbb525741328139e84a1e354954" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 40545 } } peers { permanent_uuid: "2513a663afac495eb09126ff55e8b2b0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40721 } }
I20260709 13:08:27.215723 27861 raft_consensus.cc:385] T fb246ce2984c4a6393f12f75083c9fcf P 2513a663afac495eb09126ff55e8b2b0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:27.220185 27865 ts_tablet_manager.cc:1434] T fb246ce2984c4a6393f12f75083c9fcf P 18435fbb525741328139e84a1e354954: Time spent starting tablet: real 0.034s	user 0.003s	sys 0.004s
I20260709 13:08:27.226796 27861 raft_consensus.cc:740] T fb246ce2984c4a6393f12f75083c9fcf P 2513a663afac495eb09126ff55e8b2b0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2513a663afac495eb09126ff55e8b2b0, State: Initialized, Role: FOLLOWER
I20260709 13:08:27.227854 27865 tablet_bootstrap.cc:492] T 86af954f570648969cbc47c03d15c447 P 18435fbb525741328139e84a1e354954: Bootstrap starting.
W20260709 13:08:27.228737 28329 log.cc:927] Time spent T e23b142958324f69aa0bad3a5828fa83 P 2513a663afac495eb09126ff55e8b2b0: Append to log took a long time: real 0.080s	user 0.000s	sys 0.000s
I20260709 13:08:27.227733 27861 consensus_queue.cc:260] T fb246ce2984c4a6393f12f75083c9fcf P 2513a663afac495eb09126ff55e8b2b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 38749 } } peers { permanent_uuid: "18435fbb525741328139e84a1e354954" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 40545 } } peers { permanent_uuid: "2513a663afac495eb09126ff55e8b2b0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40721 } }
I20260709 13:08:27.297850 27861 ts_tablet_manager.cc:1434] T fb246ce2984c4a6393f12f75083c9fcf P 2513a663afac495eb09126ff55e8b2b0: Time spent starting tablet: real 0.098s	user 0.008s	sys 0.001s
I20260709 13:08:27.298424 28232 raft_consensus.cc:493] T 86af954f570648969cbc47c03d15c447 P 2513a663afac495eb09126ff55e8b2b0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:27.299070 28232 raft_consensus.cc:515] T 86af954f570648969cbc47c03d15c447 P 2513a663afac495eb09126ff55e8b2b0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18435fbb525741328139e84a1e354954" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 40545 } } peers { permanent_uuid: "2513a663afac495eb09126ff55e8b2b0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40721 } } peers { permanent_uuid: "41268b218b804905a110c86738e74400" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 44403 } }
I20260709 13:08:27.300596 28101 raft_consensus.cc:493] T 9c0f604d66664505aa9469fb058601b6 P 18435fbb525741328139e84a1e354954 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:27.301030 28232 leader_election.cc:290] T 86af954f570648969cbc47c03d15c447 P 2513a663afac495eb09126ff55e8b2b0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 18435fbb525741328139e84a1e354954 (127.17.223.4:40545), 41268b218b804905a110c86738e74400 (127.17.223.2:44403)
I20260709 13:08:27.301115 28101 raft_consensus.cc:515] T 9c0f604d66664505aa9469fb058601b6 P 18435fbb525741328139e84a1e354954 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 38749 } } peers { permanent_uuid: "18435fbb525741328139e84a1e354954" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 40545 } } peers { permanent_uuid: "2513a663afac495eb09126ff55e8b2b0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40721 } }
I20260709 13:08:27.303333 28101 leader_election.cc:290] T 9c0f604d66664505aa9469fb058601b6 P 18435fbb525741328139e84a1e354954 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 665f7e09521a4c3f9284c1d8b0e094ff (127.17.223.3:38749), 2513a663afac495eb09126ff55e8b2b0 (127.17.223.1:40721)
I20260709 13:08:27.307976 27590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c0f604d66664505aa9469fb058601b6" candidate_uuid: "18435fbb525741328139e84a1e354954" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2513a663afac495eb09126ff55e8b2b0" is_pre_election: true
I20260709 13:08:27.307988 27667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86af954f570648969cbc47c03d15c447" candidate_uuid: "2513a663afac495eb09126ff55e8b2b0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "41268b218b804905a110c86738e74400" is_pre_election: true
I20260709 13:08:27.308887 27590 raft_consensus.cc:2393] T 9c0f604d66664505aa9469fb058601b6 P 2513a663afac495eb09126ff55e8b2b0 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 18435fbb525741328139e84a1e354954 in current term 1: Already voted for candidate 2513a663afac495eb09126ff55e8b2b0 in this term.
I20260709 13:08:27.309302 27667 raft_consensus.cc:2468] T 86af954f570648969cbc47c03d15c447 P 41268b218b804905a110c86738e74400 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2513a663afac495eb09126ff55e8b2b0 in term 0.
I20260709 13:08:27.309677 27861 tablet_bootstrap.cc:492] T 9db60240699a4db2ba5faa2c50a742da P 2513a663afac495eb09126ff55e8b2b0: Bootstrap starting.
I20260709 13:08:27.310724 27811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86af954f570648969cbc47c03d15c447" candidate_uuid: "2513a663afac495eb09126ff55e8b2b0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "18435fbb525741328139e84a1e354954" is_pre_election: true
W20260709 13:08:27.316918 27559 leader_election.cc:343] T 86af954f570648969cbc47c03d15c447 P 2513a663afac495eb09126ff55e8b2b0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 18435fbb525741328139e84a1e354954 (127.17.223.4:40545): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:27.317948 27559 leader_election.cc:304] T 86af954f570648969cbc47c03d15c447 P 2513a663afac495eb09126ff55e8b2b0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2513a663afac495eb09126ff55e8b2b0, 41268b218b804905a110c86738e74400; no voters: 18435fbb525741328139e84a1e354954
I20260709 13:08:27.319845 27490 catalog_manager.cc:5697] T 539b1d2240654c74bd9054a06a8eaac6 P 41268b218b804905a110c86738e74400 reported cstate change: term changed from 0 to 1, leader changed from <none> to 41268b218b804905a110c86738e74400 (127.17.223.2). New cstate: current_term: 1 leader_uuid: "41268b218b804905a110c86738e74400" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "41268b218b804905a110c86738e74400" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 44403 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 38749 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "18435fbb525741328139e84a1e354954" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 40545 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:27.324239 27490 catalog_manager.cc:5697] T 8e0d496efc3f41f3be82a538ef3cfdac P 41268b218b804905a110c86738e74400 reported cstate change: term changed from 1 to 2, leader changed from 665f7e09521a4c3f9284c1d8b0e094ff (127.17.223.3) to 41268b218b804905a110c86738e74400 (127.17.223.2). New cstate: current_term: 2 leader_uuid: "41268b218b804905a110c86738e74400" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "41268b218b804905a110c86738e74400" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 44403 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 38749 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "18435fbb525741328139e84a1e354954" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 40545 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:27.325059 27861 tablet_bootstrap.cc:654] T 9db60240699a4db2ba5faa2c50a742da P 2513a663afac495eb09126ff55e8b2b0: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:27.325554 27742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c0f604d66664505aa9469fb058601b6" candidate_uuid: "18435fbb525741328139e84a1e354954" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" is_pre_election: true
I20260709 13:08:27.326411 27742 raft_consensus.cc:2393] T 9c0f604d66664505aa9469fb058601b6 P 665f7e09521a4c3f9284c1d8b0e094ff [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 18435fbb525741328139e84a1e354954 in current term 1: Already voted for candidate 665f7e09521a4c3f9284c1d8b0e094ff in this term.
I20260709 13:08:27.333504 28277 raft_consensus.cc:493] T fb246ce2984c4a6393f12f75083c9fcf P 665f7e09521a4c3f9284c1d8b0e094ff [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:27.333748 27782 leader_election.cc:304] T 9c0f604d66664505aa9469fb058601b6 P 18435fbb525741328139e84a1e354954 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 18435fbb525741328139e84a1e354954; no voters: 2513a663afac495eb09126ff55e8b2b0, 665f7e09521a4c3f9284c1d8b0e094ff
I20260709 13:08:27.333982 28277 raft_consensus.cc:515] T fb246ce2984c4a6393f12f75083c9fcf P 665f7e09521a4c3f9284c1d8b0e094ff [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 38749 } } peers { permanent_uuid: "18435fbb525741328139e84a1e354954" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 40545 } } peers { permanent_uuid: "2513a663afac495eb09126ff55e8b2b0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40721 } }
I20260709 13:08:27.334766 28219 raft_consensus.cc:3060] T 9c0f604d66664505aa9469fb058601b6 P 18435fbb525741328139e84a1e354954 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:27.339953 28277 leader_election.cc:290] T fb246ce2984c4a6393f12f75083c9fcf P 665f7e09521a4c3f9284c1d8b0e094ff [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 18435fbb525741328139e84a1e354954 (127.17.223.4:40545), 2513a663afac495eb09126ff55e8b2b0 (127.17.223.1:40721)
I20260709 13:08:27.342139 27865 tablet_bootstrap.cc:654] T 86af954f570648969cbc47c03d15c447 P 18435fbb525741328139e84a1e354954: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:27.342281 28219 raft_consensus.cc:2749] T 9c0f604d66664505aa9469fb058601b6 P 18435fbb525741328139e84a1e354954 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:08:27.351866 27491 catalog_manager.cc:5697] T b6be829f6d3f40c99a3c5be18b0c259c P 2513a663afac495eb09126ff55e8b2b0 reported cstate change: term changed from 0 to 1, leader changed from <none> to 2513a663afac495eb09126ff55e8b2b0 (127.17.223.1). New cstate: current_term: 1 leader_uuid: "2513a663afac495eb09126ff55e8b2b0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18435fbb525741328139e84a1e354954" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 40545 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2513a663afac495eb09126ff55e8b2b0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40721 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "41268b218b804905a110c86738e74400" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 44403 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:27.355454 27811 raft_consensus.cc:1275] T 8e0d496efc3f41f3be82a538ef3cfdac P 18435fbb525741328139e84a1e354954 [term 2 FOLLOWER]: Refusing update from remote peer 41268b218b804905a110c86738e74400: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:08:27.357219 28309 consensus_queue.cc:1048] T 8e0d496efc3f41f3be82a538ef3cfdac P 41268b218b804905a110c86738e74400 [LEADER]: Connected to new peer: Peer: permanent_uuid: "18435fbb525741328139e84a1e354954" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 40545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:08:27.359031 28306 raft_consensus.cc:2804] T 86af954f570648969cbc47c03d15c447 P 2513a663afac495eb09126ff55e8b2b0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:08:27.359513 28306 raft_consensus.cc:493] T 86af954f570648969cbc47c03d15c447 P 2513a663afac495eb09126ff55e8b2b0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:27.359858 28306 raft_consensus.cc:3060] T 86af954f570648969cbc47c03d15c447 P 2513a663afac495eb09126ff55e8b2b0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:27.377076 27592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb246ce2984c4a6393f12f75083c9fcf" candidate_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2513a663afac495eb09126ff55e8b2b0" is_pre_election: true
I20260709 13:08:27.377792 27592 raft_consensus.cc:2468] T fb246ce2984c4a6393f12f75083c9fcf P 2513a663afac495eb09126ff55e8b2b0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 665f7e09521a4c3f9284c1d8b0e094ff in term 0.
I20260709 13:08:27.383343 27813 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb246ce2984c4a6393f12f75083c9fcf" candidate_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "18435fbb525741328139e84a1e354954" is_pre_election: true
I20260709 13:08:27.383481 27705 leader_election.cc:304] T fb246ce2984c4a6393f12f75083c9fcf P 665f7e09521a4c3f9284c1d8b0e094ff [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2513a663afac495eb09126ff55e8b2b0, 665f7e09521a4c3f9284c1d8b0e094ff; no voters: 
I20260709 13:08:27.383992 27813 raft_consensus.cc:2468] T fb246ce2984c4a6393f12f75083c9fcf P 18435fbb525741328139e84a1e354954 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 665f7e09521a4c3f9284c1d8b0e094ff in term 0.
I20260709 13:08:27.384733 28157 raft_consensus.cc:2804] T fb246ce2984c4a6393f12f75083c9fcf P 665f7e09521a4c3f9284c1d8b0e094ff [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:08:27.385169 28157 raft_consensus.cc:493] T fb246ce2984c4a6393f12f75083c9fcf P 665f7e09521a4c3f9284c1d8b0e094ff [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:27.385490 28157 raft_consensus.cc:3060] T fb246ce2984c4a6393f12f75083c9fcf P 665f7e09521a4c3f9284c1d8b0e094ff [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:27.396875 28306 raft_consensus.cc:515] T 86af954f570648969cbc47c03d15c447 P 2513a663afac495eb09126ff55e8b2b0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18435fbb525741328139e84a1e354954" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 40545 } } peers { permanent_uuid: "2513a663afac495eb09126ff55e8b2b0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40721 } } peers { permanent_uuid: "41268b218b804905a110c86738e74400" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 44403 } }
I20260709 13:08:27.398937 28306 leader_election.cc:290] T 86af954f570648969cbc47c03d15c447 P 2513a663afac495eb09126ff55e8b2b0 [CANDIDATE]: Term 1 election: Requested vote from peers 18435fbb525741328139e84a1e354954 (127.17.223.4:40545), 41268b218b804905a110c86738e74400 (127.17.223.2:44403)
W20260709 13:08:27.399724 27559 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.2:44403, user_credentials={real_user=slave}} blocked reactor thread for 81830.6us
I20260709 13:08:27.404745 27978 consensus_queue.cc:1048] T 539b1d2240654c74bd9054a06a8eaac6 P 41268b218b804905a110c86738e74400 [LEADER]: Connected to new peer: Peer: permanent_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 38749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:08:27.399765 27861 tablet_bootstrap.cc:492] T 9db60240699a4db2ba5faa2c50a742da P 2513a663afac495eb09126ff55e8b2b0: No bootstrap required, opened a new log
I20260709 13:08:27.407052 27861 ts_tablet_manager.cc:1403] T 9db60240699a4db2ba5faa2c50a742da P 2513a663afac495eb09126ff55e8b2b0: Time spent bootstrapping tablet: real 0.098s	user 0.011s	sys 0.000s
I20260709 13:08:27.394311 28157 raft_consensus.cc:515] T fb246ce2984c4a6393f12f75083c9fcf P 665f7e09521a4c3f9284c1d8b0e094ff [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 38749 } } peers { permanent_uuid: "18435fbb525741328139e84a1e354954" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 40545 } } peers { permanent_uuid: "2513a663afac495eb09126ff55e8b2b0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40721 } }
I20260709 13:08:27.411563 27592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb246ce2984c4a6393f12f75083c9fcf" candidate_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2513a663afac495eb09126ff55e8b2b0"
I20260709 13:08:27.412160 27592 raft_consensus.cc:3060] T fb246ce2984c4a6393f12f75083c9fcf P 2513a663afac495eb09126ff55e8b2b0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:27.411669 27813 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86af954f570648969cbc47c03d15c447" candidate_uuid: "2513a663afac495eb09126ff55e8b2b0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "18435fbb525741328139e84a1e354954"
I20260709 13:08:27.415971 27667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86af954f570648969cbc47c03d15c447" candidate_uuid: "2513a663afac495eb09126ff55e8b2b0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "41268b218b804905a110c86738e74400"
I20260709 13:08:27.416601 27667 raft_consensus.cc:3060] T 86af954f570648969cbc47c03d15c447 P 41268b218b804905a110c86738e74400 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:27.420627 28157 leader_election.cc:290] T fb246ce2984c4a6393f12f75083c9fcf P 665f7e09521a4c3f9284c1d8b0e094ff [CANDIDATE]: Term 1 election: Requested vote from peers 18435fbb525741328139e84a1e354954 (127.17.223.4:40545), 2513a663afac495eb09126ff55e8b2b0 (127.17.223.1:40721)
I20260709 13:08:27.422039 27861 raft_consensus.cc:359] T 9db60240699a4db2ba5faa2c50a742da P 2513a663afac495eb09126ff55e8b2b0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 38749 } } peers { permanent_uuid: "18435fbb525741328139e84a1e354954" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 40545 } } peers { permanent_uuid: "2513a663afac495eb09126ff55e8b2b0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40721 } }
I20260709 13:08:27.422266 27592 raft_consensus.cc:2468] T fb246ce2984c4a6393f12f75083c9fcf P 2513a663afac495eb09126ff55e8b2b0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 665f7e09521a4c3f9284c1d8b0e094ff in term 1.
I20260709 13:08:27.422765 27861 raft_consensus.cc:385] T 9db60240699a4db2ba5faa2c50a742da P 2513a663afac495eb09126ff55e8b2b0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:27.424072 27865 tablet_bootstrap.cc:492] T 86af954f570648969cbc47c03d15c447 P 18435fbb525741328139e84a1e354954: No bootstrap required, opened a new log
I20260709 13:08:27.455039 27737 raft_consensus.cc:1275] T 8e0d496efc3f41f3be82a538ef3cfdac P 665f7e09521a4c3f9284c1d8b0e094ff [term 2 FOLLOWER]: Refusing update from remote peer 41268b218b804905a110c86738e74400: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:08:27.426954 27667 raft_consensus.cc:2468] T 86af954f570648969cbc47c03d15c447 P 41268b218b804905a110c86738e74400 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2513a663afac495eb09126ff55e8b2b0 in term 1.
I20260709 13:08:27.430912 27813 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb246ce2984c4a6393f12f75083c9fcf" candidate_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "18435fbb525741328139e84a1e354954"
W20260709 13:08:27.444643 27559 leader_election.cc:343] T 86af954f570648969cbc47c03d15c447 P 2513a663afac495eb09126ff55e8b2b0 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 18435fbb525741328139e84a1e354954 (127.17.223.4:40545): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:27.455222 27865 ts_tablet_manager.cc:1403] T 86af954f570648969cbc47c03d15c447 P 18435fbb525741328139e84a1e354954: Time spent bootstrapping tablet: real 0.228s	user 0.017s	sys 0.006s
I20260709 13:08:27.456333 27813 raft_consensus.cc:3060] T fb246ce2984c4a6393f12f75083c9fcf P 18435fbb525741328139e84a1e354954 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:27.458828 27865 raft_consensus.cc:359] T 86af954f570648969cbc47c03d15c447 P 18435fbb525741328139e84a1e354954 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18435fbb525741328139e84a1e354954" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 40545 } } peers { permanent_uuid: "2513a663afac495eb09126ff55e8b2b0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40721 } } peers { permanent_uuid: "41268b218b804905a110c86738e74400" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 44403 } }
I20260709 13:08:27.459508 27865 raft_consensus.cc:385] T 86af954f570648969cbc47c03d15c447 P 18435fbb525741328139e84a1e354954 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:27.459760 27865 raft_consensus.cc:740] T 86af954f570648969cbc47c03d15c447 P 18435fbb525741328139e84a1e354954 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 18435fbb525741328139e84a1e354954, State: Initialized, Role: FOLLOWER
I20260709 13:08:27.426411 27705 leader_election.cc:304] T fb246ce2984c4a6393f12f75083c9fcf P 665f7e09521a4c3f9284c1d8b0e094ff [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2513a663afac495eb09126ff55e8b2b0, 665f7e09521a4c3f9284c1d8b0e094ff; no voters: 
I20260709 13:08:27.460686 28194 consensus_queue.cc:1048] T b6be829f6d3f40c99a3c5be18b0c259c P 2513a663afac495eb09126ff55e8b2b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "41268b218b804905a110c86738e74400" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 44403 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:08:27.460390 27865 consensus_queue.cc:260] T 86af954f570648969cbc47c03d15c447 P 18435fbb525741328139e84a1e354954 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18435fbb525741328139e84a1e354954" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 40545 } } peers { permanent_uuid: "2513a663afac495eb09126ff55e8b2b0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40721 } } peers { permanent_uuid: "41268b218b804905a110c86738e74400" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 44403 } }
I20260709 13:08:27.462008 27861 raft_consensus.cc:740] T 9db60240699a4db2ba5faa2c50a742da P 2513a663afac495eb09126ff55e8b2b0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2513a663afac495eb09126ff55e8b2b0, State: Initialized, Role: FOLLOWER
I20260709 13:08:27.463145 27559 leader_election.cc:304] T 86af954f570648969cbc47c03d15c447 P 2513a663afac495eb09126ff55e8b2b0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2513a663afac495eb09126ff55e8b2b0, 41268b218b804905a110c86738e74400; no voters: 18435fbb525741328139e84a1e354954
I20260709 13:08:27.463966 28194 raft_consensus.cc:2804] T 86af954f570648969cbc47c03d15c447 P 2513a663afac495eb09126ff55e8b2b0 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:08:27.464444 28194 raft_consensus.cc:697] T 86af954f570648969cbc47c03d15c447 P 2513a663afac495eb09126ff55e8b2b0 [term 1 LEADER]: Becoming Leader. State: Replica: 2513a663afac495eb09126ff55e8b2b0, State: Running, Role: LEADER
I20260709 13:08:27.464876 27865 ts_tablet_manager.cc:1434] T 86af954f570648969cbc47c03d15c447 P 18435fbb525741328139e84a1e354954: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 13:08:27.465939 27865 tablet_bootstrap.cc:492] T 539b1d2240654c74bd9054a06a8eaac6 P 18435fbb525741328139e84a1e354954: Bootstrap starting.
I20260709 13:08:27.465205 28194 consensus_queue.cc:237] T 86af954f570648969cbc47c03d15c447 P 2513a663afac495eb09126ff55e8b2b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18435fbb525741328139e84a1e354954" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 40545 } } peers { permanent_uuid: "2513a663afac495eb09126ff55e8b2b0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40721 } } peers { permanent_uuid: "41268b218b804905a110c86738e74400" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 44403 } }
I20260709 13:08:27.468029 27813 raft_consensus.cc:2468] T fb246ce2984c4a6393f12f75083c9fcf P 18435fbb525741328139e84a1e354954 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 665f7e09521a4c3f9284c1d8b0e094ff in term 1.
W20260709 13:08:27.470891 27705 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.1:40721, user_credentials={real_user=slave}} blocked reactor thread for 44561.6us
I20260709 13:08:27.472263 28304 raft_consensus.cc:2804] T fb246ce2984c4a6393f12f75083c9fcf P 665f7e09521a4c3f9284c1d8b0e094ff [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:08:27.472754 28304 raft_consensus.cc:697] T fb246ce2984c4a6393f12f75083c9fcf P 665f7e09521a4c3f9284c1d8b0e094ff [term 1 LEADER]: Becoming Leader. State: Replica: 665f7e09521a4c3f9284c1d8b0e094ff, State: Running, Role: LEADER
I20260709 13:08:27.473554 28304 consensus_queue.cc:237] T fb246ce2984c4a6393f12f75083c9fcf P 665f7e09521a4c3f9284c1d8b0e094ff [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 38749 } } peers { permanent_uuid: "18435fbb525741328139e84a1e354954" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 40545 } } peers { permanent_uuid: "2513a663afac495eb09126ff55e8b2b0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40721 } }
I20260709 13:08:27.462750 27861 consensus_queue.cc:260] T 9db60240699a4db2ba5faa2c50a742da P 2513a663afac495eb09126ff55e8b2b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 38749 } } peers { permanent_uuid: "18435fbb525741328139e84a1e354954" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 40545 } } peers { permanent_uuid: "2513a663afac495eb09126ff55e8b2b0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40721 } }
I20260709 13:08:27.487869 27861 ts_tablet_manager.cc:1434] T 9db60240699a4db2ba5faa2c50a742da P 2513a663afac495eb09126ff55e8b2b0: Time spent starting tablet: real 0.080s	user 0.005s	sys 0.000s
I20260709 13:08:27.488824 27861 tablet_bootstrap.cc:492] T bbd0bdc9640c4956a5d60406841ef0f0 P 2513a663afac495eb09126ff55e8b2b0: Bootstrap starting.
I20260709 13:08:27.491339 27903 consensus_queue.cc:1048] T 9db60240699a4db2ba5faa2c50a742da P 665f7e09521a4c3f9284c1d8b0e094ff [LEADER]: Connected to new peer: Peer: permanent_uuid: "18435fbb525741328139e84a1e354954" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 40545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:08:27.507412 27865 tablet_bootstrap.cc:654] T 539b1d2240654c74bd9054a06a8eaac6 P 18435fbb525741328139e84a1e354954: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:27.518007 28270 consensus_queue.cc:1048] T b6be829f6d3f40c99a3c5be18b0c259c P 2513a663afac495eb09126ff55e8b2b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "18435fbb525741328139e84a1e354954" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 40545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:08:27.525324 28280 consensus_queue.cc:1048] T 8e0d496efc3f41f3be82a538ef3cfdac P 41268b218b804905a110c86738e74400 [LEADER]: Connected to new peer: Peer: permanent_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 38749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:08:27.549397 27592 raft_consensus.cc:3060] T 9db60240699a4db2ba5faa2c50a742da P 2513a663afac495eb09126ff55e8b2b0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:27.559036 27903 consensus_queue.cc:1048] T 9db60240699a4db2ba5faa2c50a742da P 665f7e09521a4c3f9284c1d8b0e094ff [LEADER]: Connected to new peer: Peer: permanent_uuid: "2513a663afac495eb09126ff55e8b2b0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40721 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:08:27.571791 27861 tablet_bootstrap.cc:654] T bbd0bdc9640c4956a5d60406841ef0f0 P 2513a663afac495eb09126ff55e8b2b0: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:27.599462 27865 tablet_bootstrap.cc:492] T 539b1d2240654c74bd9054a06a8eaac6 P 18435fbb525741328139e84a1e354954: No bootstrap required, opened a new log
I20260709 13:08:27.599108 27491 catalog_manager.cc:5697] T 86af954f570648969cbc47c03d15c447 P 2513a663afac495eb09126ff55e8b2b0 reported cstate change: term changed from 0 to 1, leader changed from <none> to 2513a663afac495eb09126ff55e8b2b0 (127.17.223.1). New cstate: current_term: 1 leader_uuid: "2513a663afac495eb09126ff55e8b2b0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18435fbb525741328139e84a1e354954" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 40545 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2513a663afac495eb09126ff55e8b2b0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40721 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "41268b218b804905a110c86738e74400" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 44403 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:27.600011 27865 ts_tablet_manager.cc:1403] T 539b1d2240654c74bd9054a06a8eaac6 P 18435fbb525741328139e84a1e354954: Time spent bootstrapping tablet: real 0.134s	user 0.008s	sys 0.004s
I20260709 13:08:27.608755 27861 tablet_bootstrap.cc:492] T bbd0bdc9640c4956a5d60406841ef0f0 P 2513a663afac495eb09126ff55e8b2b0: No bootstrap required, opened a new log
I20260709 13:08:27.609330 27861 ts_tablet_manager.cc:1403] T bbd0bdc9640c4956a5d60406841ef0f0 P 2513a663afac495eb09126ff55e8b2b0: Time spent bootstrapping tablet: real 0.121s	user 0.009s	sys 0.000s
I20260709 13:08:27.617225 27865 raft_consensus.cc:359] T 539b1d2240654c74bd9054a06a8eaac6 P 18435fbb525741328139e84a1e354954 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "41268b218b804905a110c86738e74400" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 44403 } } peers { permanent_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 38749 } } peers { permanent_uuid: "18435fbb525741328139e84a1e354954" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 40545 } }
I20260709 13:08:27.617986 27865 raft_consensus.cc:385] T 539b1d2240654c74bd9054a06a8eaac6 P 18435fbb525741328139e84a1e354954 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:27.618239 27865 raft_consensus.cc:740] T 539b1d2240654c74bd9054a06a8eaac6 P 18435fbb525741328139e84a1e354954 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 18435fbb525741328139e84a1e354954, State: Initialized, Role: FOLLOWER
I20260709 13:08:27.623328 27861 raft_consensus.cc:359] T bbd0bdc9640c4956a5d60406841ef0f0 P 2513a663afac495eb09126ff55e8b2b0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2513a663afac495eb09126ff55e8b2b0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40721 } } peers { permanent_uuid: "41268b218b804905a110c86738e74400" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 44403 } } peers { permanent_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 38749 } }
I20260709 13:08:27.634047 27865 consensus_queue.cc:260] T 539b1d2240654c74bd9054a06a8eaac6 P 18435fbb525741328139e84a1e354954 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "41268b218b804905a110c86738e74400" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 44403 } } peers { permanent_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 38749 } } peers { permanent_uuid: "18435fbb525741328139e84a1e354954" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 40545 } }
I20260709 13:08:27.635679 27865 ts_tablet_manager.cc:1434] T 539b1d2240654c74bd9054a06a8eaac6 P 18435fbb525741328139e84a1e354954: Time spent starting tablet: real 0.035s	user 0.005s	sys 0.001s
I20260709 13:08:27.624032 27861 raft_consensus.cc:385] T bbd0bdc9640c4956a5d60406841ef0f0 P 2513a663afac495eb09126ff55e8b2b0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:27.636587 27861 raft_consensus.cc:740] T bbd0bdc9640c4956a5d60406841ef0f0 P 2513a663afac495eb09126ff55e8b2b0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2513a663afac495eb09126ff55e8b2b0, State: Initialized, Role: FOLLOWER
I20260709 13:08:27.637195 27861 consensus_queue.cc:260] T bbd0bdc9640c4956a5d60406841ef0f0 P 2513a663afac495eb09126ff55e8b2b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2513a663afac495eb09126ff55e8b2b0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40721 } } peers { permanent_uuid: "41268b218b804905a110c86738e74400" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 44403 } } peers { permanent_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 38749 } }
I20260709 13:08:27.639214 27861 ts_tablet_manager.cc:1434] T bbd0bdc9640c4956a5d60406841ef0f0 P 2513a663afac495eb09126ff55e8b2b0: Time spent starting tablet: real 0.030s	user 0.007s	sys 0.000s
I20260709 13:08:27.639448 27489 catalog_manager.cc:5697] T fb246ce2984c4a6393f12f75083c9fcf P 665f7e09521a4c3f9284c1d8b0e094ff reported cstate change: term changed from 0 to 1, leader changed from <none> to 665f7e09521a4c3f9284c1d8b0e094ff (127.17.223.3). New cstate: current_term: 1 leader_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 38749 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "18435fbb525741328139e84a1e354954" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 40545 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2513a663afac495eb09126ff55e8b2b0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40721 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:27.854386 28101 raft_consensus.cc:493] T 86af954f570648969cbc47c03d15c447 P 18435fbb525741328139e84a1e354954 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:27.854981 28101 raft_consensus.cc:515] T 86af954f570648969cbc47c03d15c447 P 18435fbb525741328139e84a1e354954 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18435fbb525741328139e84a1e354954" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 40545 } } peers { permanent_uuid: "2513a663afac495eb09126ff55e8b2b0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40721 } } peers { permanent_uuid: "41268b218b804905a110c86738e74400" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 44403 } }
I20260709 13:08:27.857347 27592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86af954f570648969cbc47c03d15c447" candidate_uuid: "18435fbb525741328139e84a1e354954" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2513a663afac495eb09126ff55e8b2b0" is_pre_election: true
I20260709 13:08:27.857694 27663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86af954f570648969cbc47c03d15c447" candidate_uuid: "18435fbb525741328139e84a1e354954" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "41268b218b804905a110c86738e74400" is_pre_election: true
I20260709 13:08:27.858982 27663 raft_consensus.cc:2393] T 86af954f570648969cbc47c03d15c447 P 41268b218b804905a110c86738e74400 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 18435fbb525741328139e84a1e354954 in current term 1: Already voted for candidate 2513a663afac495eb09126ff55e8b2b0 in this term.
I20260709 13:08:27.860101 27782 leader_election.cc:304] T 86af954f570648969cbc47c03d15c447 P 18435fbb525741328139e84a1e354954 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 18435fbb525741328139e84a1e354954; no voters: 2513a663afac495eb09126ff55e8b2b0, 41268b218b804905a110c86738e74400
I20260709 13:08:27.860805 28219 raft_consensus.cc:3060] T 86af954f570648969cbc47c03d15c447 P 18435fbb525741328139e84a1e354954 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:27.871920 28219 raft_consensus.cc:2749] T 86af954f570648969cbc47c03d15c447 P 18435fbb525741328139e84a1e354954 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:08:27.856787 28101 leader_election.cc:290] T 86af954f570648969cbc47c03d15c447 P 18435fbb525741328139e84a1e354954 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2513a663afac495eb09126ff55e8b2b0 (127.17.223.1:40721), 41268b218b804905a110c86738e74400 (127.17.223.2:44403)
I20260709 13:08:27.879215 28270 consensus_queue.cc:1048] T 86af954f570648969cbc47c03d15c447 P 2513a663afac495eb09126ff55e8b2b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "18435fbb525741328139e84a1e354954" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 40545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:08:27.902217 28270 consensus_queue.cc:1048] T 86af954f570648969cbc47c03d15c447 P 2513a663afac495eb09126ff55e8b2b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "41268b218b804905a110c86738e74400" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 44403 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:08:27.921774 27813 raft_consensus.cc:3060] T 539b1d2240654c74bd9054a06a8eaac6 P 18435fbb525741328139e84a1e354954 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:27.977401 28157 consensus_queue.cc:1048] T fb246ce2984c4a6393f12f75083c9fcf P 665f7e09521a4c3f9284c1d8b0e094ff [LEADER]: Connected to new peer: Peer: permanent_uuid: "2513a663afac495eb09126ff55e8b2b0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40721 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:08:27.983031 28194 raft_consensus.cc:493] T bbd0bdc9640c4956a5d60406841ef0f0 P 2513a663afac495eb09126ff55e8b2b0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:27.983572 28194 raft_consensus.cc:515] T bbd0bdc9640c4956a5d60406841ef0f0 P 2513a663afac495eb09126ff55e8b2b0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2513a663afac495eb09126ff55e8b2b0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40721 } } peers { permanent_uuid: "41268b218b804905a110c86738e74400" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 44403 } } peers { permanent_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 38749 } }
I20260709 13:08:27.992190 28331 consensus_queue.cc:1048] T fb246ce2984c4a6393f12f75083c9fcf P 665f7e09521a4c3f9284c1d8b0e094ff [LEADER]: Connected to new peer: Peer: permanent_uuid: "18435fbb525741328139e84a1e354954" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 40545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:08:27.992619 28194 leader_election.cc:290] T bbd0bdc9640c4956a5d60406841ef0f0 P 2513a663afac495eb09126ff55e8b2b0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 41268b218b804905a110c86738e74400 (127.17.223.2:44403), 665f7e09521a4c3f9284c1d8b0e094ff (127.17.223.3:38749)
I20260709 13:08:27.996773 27740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbd0bdc9640c4956a5d60406841ef0f0" candidate_uuid: "2513a663afac495eb09126ff55e8b2b0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" is_pre_election: true
I20260709 13:08:27.997720 27740 raft_consensus.cc:2393] T bbd0bdc9640c4956a5d60406841ef0f0 P 665f7e09521a4c3f9284c1d8b0e094ff [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2513a663afac495eb09126ff55e8b2b0 in current term 1: Already voted for candidate 665f7e09521a4c3f9284c1d8b0e094ff in this term.
I20260709 13:08:27.999537 27667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbd0bdc9640c4956a5d60406841ef0f0" candidate_uuid: "2513a663afac495eb09126ff55e8b2b0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "41268b218b804905a110c86738e74400" is_pre_election: true
I20260709 13:08:28.000365 27667 raft_consensus.cc:2393] T bbd0bdc9640c4956a5d60406841ef0f0 P 41268b218b804905a110c86738e74400 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2513a663afac495eb09126ff55e8b2b0 in current term 1: Already voted for candidate 41268b218b804905a110c86738e74400 in this term.
I20260709 13:08:28.001987 27559 leader_election.cc:304] T bbd0bdc9640c4956a5d60406841ef0f0 P 2513a663afac495eb09126ff55e8b2b0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2513a663afac495eb09126ff55e8b2b0; no voters: 41268b218b804905a110c86738e74400, 665f7e09521a4c3f9284c1d8b0e094ff
I20260709 13:08:28.003249 28194 raft_consensus.cc:3060] T bbd0bdc9640c4956a5d60406841ef0f0 P 2513a663afac495eb09126ff55e8b2b0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:28.027707 28194 raft_consensus.cc:2749] T bbd0bdc9640c4956a5d60406841ef0f0 P 2513a663afac495eb09126ff55e8b2b0 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:08:28.238420 27539 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:08:28.333523 28082 raft_consensus.cc:493] T 9c0f604d66664505aa9469fb058601b6 P 665f7e09521a4c3f9284c1d8b0e094ff [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:28.334085 28082 raft_consensus.cc:515] T 9c0f604d66664505aa9469fb058601b6 P 665f7e09521a4c3f9284c1d8b0e094ff [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 38749 } } peers { permanent_uuid: "18435fbb525741328139e84a1e354954" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 40545 } } peers { permanent_uuid: "2513a663afac495eb09126ff55e8b2b0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40721 } }
I20260709 13:08:28.336150 28082 leader_election.cc:290] T 9c0f604d66664505aa9469fb058601b6 P 665f7e09521a4c3f9284c1d8b0e094ff [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 18435fbb525741328139e84a1e354954 (127.17.223.4:40545), 2513a663afac495eb09126ff55e8b2b0 (127.17.223.1:40721)
I20260709 13:08:28.336476 27813 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c0f604d66664505aa9469fb058601b6" candidate_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "18435fbb525741328139e84a1e354954" is_pre_election: true
I20260709 13:08:28.337085 27813 raft_consensus.cc:2468] T 9c0f604d66664505aa9469fb058601b6 P 18435fbb525741328139e84a1e354954 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 665f7e09521a4c3f9284c1d8b0e094ff in term 1.
I20260709 13:08:28.337198 27588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c0f604d66664505aa9469fb058601b6" candidate_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2513a663afac495eb09126ff55e8b2b0" is_pre_election: true
I20260709 13:08:28.337831 27588 raft_consensus.cc:2468] T 9c0f604d66664505aa9469fb058601b6 P 2513a663afac495eb09126ff55e8b2b0 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 665f7e09521a4c3f9284c1d8b0e094ff in term 1.
I20260709 13:08:28.338263 27708 leader_election.cc:304] T 9c0f604d66664505aa9469fb058601b6 P 665f7e09521a4c3f9284c1d8b0e094ff [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 18435fbb525741328139e84a1e354954, 665f7e09521a4c3f9284c1d8b0e094ff; no voters: 
I20260709 13:08:28.339095 28082 raft_consensus.cc:2804] T 9c0f604d66664505aa9469fb058601b6 P 665f7e09521a4c3f9284c1d8b0e094ff [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:08:28.339449 28082 raft_consensus.cc:493] T 9c0f604d66664505aa9469fb058601b6 P 665f7e09521a4c3f9284c1d8b0e094ff [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:28.339747 28082 raft_consensus.cc:3060] T 9c0f604d66664505aa9469fb058601b6 P 665f7e09521a4c3f9284c1d8b0e094ff [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:28.356288 28082 raft_consensus.cc:515] T 9c0f604d66664505aa9469fb058601b6 P 665f7e09521a4c3f9284c1d8b0e094ff [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 38749 } } peers { permanent_uuid: "18435fbb525741328139e84a1e354954" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 40545 } } peers { permanent_uuid: "2513a663afac495eb09126ff55e8b2b0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40721 } }
I20260709 13:08:28.360662 28082 leader_election.cc:290] T 9c0f604d66664505aa9469fb058601b6 P 665f7e09521a4c3f9284c1d8b0e094ff [CANDIDATE]: Term 2 election: Requested vote from peers 18435fbb525741328139e84a1e354954 (127.17.223.4:40545), 2513a663afac495eb09126ff55e8b2b0 (127.17.223.1:40721)
I20260709 13:08:28.361343 27813 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c0f604d66664505aa9469fb058601b6" candidate_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "18435fbb525741328139e84a1e354954"
I20260709 13:08:28.361948 27813 raft_consensus.cc:3060] T 9c0f604d66664505aa9469fb058601b6 P 18435fbb525741328139e84a1e354954 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:28.361810 27588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c0f604d66664505aa9469fb058601b6" candidate_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2513a663afac495eb09126ff55e8b2b0"
I20260709 13:08:28.362419 27588 raft_consensus.cc:3060] T 9c0f604d66664505aa9469fb058601b6 P 2513a663afac495eb09126ff55e8b2b0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:28.369969 27813 raft_consensus.cc:2468] T 9c0f604d66664505aa9469fb058601b6 P 18435fbb525741328139e84a1e354954 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 665f7e09521a4c3f9284c1d8b0e094ff in term 2.
I20260709 13:08:28.371552 27588 raft_consensus.cc:2468] T 9c0f604d66664505aa9469fb058601b6 P 2513a663afac495eb09126ff55e8b2b0 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 665f7e09521a4c3f9284c1d8b0e094ff in term 2.
I20260709 13:08:28.372778 27705 leader_election.cc:304] T 9c0f604d66664505aa9469fb058601b6 P 665f7e09521a4c3f9284c1d8b0e094ff [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2513a663afac495eb09126ff55e8b2b0, 665f7e09521a4c3f9284c1d8b0e094ff; no voters: 
I20260709 13:08:28.373906 28082 raft_consensus.cc:2804] T 9c0f604d66664505aa9469fb058601b6 P 665f7e09521a4c3f9284c1d8b0e094ff [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:08:28.374333 28082 raft_consensus.cc:697] T 9c0f604d66664505aa9469fb058601b6 P 665f7e09521a4c3f9284c1d8b0e094ff [term 2 LEADER]: Becoming Leader. State: Replica: 665f7e09521a4c3f9284c1d8b0e094ff, State: Running, Role: LEADER
I20260709 13:08:28.375072 28082 consensus_queue.cc:237] T 9c0f604d66664505aa9469fb058601b6 P 665f7e09521a4c3f9284c1d8b0e094ff [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 38749 } } peers { permanent_uuid: "18435fbb525741328139e84a1e354954" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 40545 } } peers { permanent_uuid: "2513a663afac495eb09126ff55e8b2b0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40721 } }
I20260709 13:08:28.384018 27489 catalog_manager.cc:5697] T 9c0f604d66664505aa9469fb058601b6 P 665f7e09521a4c3f9284c1d8b0e094ff reported cstate change: term changed from 0 to 2, leader changed from <none> to 665f7e09521a4c3f9284c1d8b0e094ff (127.17.223.3). New cstate: current_term: 2 leader_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 38749 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "18435fbb525741328139e84a1e354954" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 40545 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2513a663afac495eb09126ff55e8b2b0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40721 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:28.754186 27813 raft_consensus.cc:1275] T 9c0f604d66664505aa9469fb058601b6 P 18435fbb525741328139e84a1e354954 [term 2 FOLLOWER]: Refusing update from remote peer 665f7e09521a4c3f9284c1d8b0e094ff: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 13:08:28.755594 28331 consensus_queue.cc:1048] T 9c0f604d66664505aa9469fb058601b6 P 665f7e09521a4c3f9284c1d8b0e094ff [LEADER]: Connected to new peer: Peer: permanent_uuid: "18435fbb525741328139e84a1e354954" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 40545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:08:28.783772 27588 raft_consensus.cc:1275] T 9c0f604d66664505aa9469fb058601b6 P 2513a663afac495eb09126ff55e8b2b0 [term 2 FOLLOWER]: Refusing update from remote peer 665f7e09521a4c3f9284c1d8b0e094ff: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 13:08:28.787341 28082 consensus_queue.cc:1048] T 9c0f604d66664505aa9469fb058601b6 P 665f7e09521a4c3f9284c1d8b0e094ff [LEADER]: Connected to new peer: Peer: permanent_uuid: "2513a663afac495eb09126ff55e8b2b0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40721 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:08:28.840332 28280 raft_consensus.cc:493] T bbd0bdc9640c4956a5d60406841ef0f0 P 41268b218b804905a110c86738e74400 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:28.841352 28280 raft_consensus.cc:515] T bbd0bdc9640c4956a5d60406841ef0f0 P 41268b218b804905a110c86738e74400 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2513a663afac495eb09126ff55e8b2b0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40721 } } peers { permanent_uuid: "41268b218b804905a110c86738e74400" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 44403 } } peers { permanent_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 38749 } }
I20260709 13:08:28.843241 28280 leader_election.cc:290] T bbd0bdc9640c4956a5d60406841ef0f0 P 41268b218b804905a110c86738e74400 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2513a663afac495eb09126ff55e8b2b0 (127.17.223.1:40721), 665f7e09521a4c3f9284c1d8b0e094ff (127.17.223.3:38749)
I20260709 13:08:28.843945 27588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbd0bdc9640c4956a5d60406841ef0f0" candidate_uuid: "41268b218b804905a110c86738e74400" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2513a663afac495eb09126ff55e8b2b0" is_pre_election: true
I20260709 13:08:28.844156 27741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbd0bdc9640c4956a5d60406841ef0f0" candidate_uuid: "41268b218b804905a110c86738e74400" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" is_pre_election: true
I20260709 13:08:28.844753 27741 raft_consensus.cc:2468] T bbd0bdc9640c4956a5d60406841ef0f0 P 665f7e09521a4c3f9284c1d8b0e094ff [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 41268b218b804905a110c86738e74400 in term 1.
I20260709 13:08:28.844714 27588 raft_consensus.cc:2468] T bbd0bdc9640c4956a5d60406841ef0f0 P 2513a663afac495eb09126ff55e8b2b0 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 41268b218b804905a110c86738e74400 in term 1.
I20260709 13:08:28.845888 27634 leader_election.cc:304] T bbd0bdc9640c4956a5d60406841ef0f0 P 41268b218b804905a110c86738e74400 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 41268b218b804905a110c86738e74400, 665f7e09521a4c3f9284c1d8b0e094ff; no voters: 
I20260709 13:08:28.846470 28280 raft_consensus.cc:2804] T bbd0bdc9640c4956a5d60406841ef0f0 P 41268b218b804905a110c86738e74400 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:08:28.846855 28280 raft_consensus.cc:493] T bbd0bdc9640c4956a5d60406841ef0f0 P 41268b218b804905a110c86738e74400 [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:28.847180 28280 raft_consensus.cc:3060] T bbd0bdc9640c4956a5d60406841ef0f0 P 41268b218b804905a110c86738e74400 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:28.855705 28280 raft_consensus.cc:515] T bbd0bdc9640c4956a5d60406841ef0f0 P 41268b218b804905a110c86738e74400 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2513a663afac495eb09126ff55e8b2b0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40721 } } peers { permanent_uuid: "41268b218b804905a110c86738e74400" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 44403 } } peers { permanent_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 38749 } }
I20260709 13:08:28.859043 27588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbd0bdc9640c4956a5d60406841ef0f0" candidate_uuid: "41268b218b804905a110c86738e74400" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2513a663afac495eb09126ff55e8b2b0"
I20260709 13:08:28.860009 28280 leader_election.cc:290] T bbd0bdc9640c4956a5d60406841ef0f0 P 41268b218b804905a110c86738e74400 [CANDIDATE]: Term 2 election: Requested vote from peers 2513a663afac495eb09126ff55e8b2b0 (127.17.223.1:40721), 665f7e09521a4c3f9284c1d8b0e094ff (127.17.223.3:38749)
I20260709 13:08:28.860174 27741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbd0bdc9640c4956a5d60406841ef0f0" candidate_uuid: "41268b218b804905a110c86738e74400" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "665f7e09521a4c3f9284c1d8b0e094ff"
I20260709 13:08:28.860653 27741 raft_consensus.cc:3060] T bbd0bdc9640c4956a5d60406841ef0f0 P 665f7e09521a4c3f9284c1d8b0e094ff [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:28.865978 27741 raft_consensus.cc:2468] T bbd0bdc9640c4956a5d60406841ef0f0 P 665f7e09521a4c3f9284c1d8b0e094ff [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 41268b218b804905a110c86738e74400 in term 2.
I20260709 13:08:28.859704 27588 raft_consensus.cc:3060] T bbd0bdc9640c4956a5d60406841ef0f0 P 2513a663afac495eb09126ff55e8b2b0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:28.868466 27634 leader_election.cc:304] T bbd0bdc9640c4956a5d60406841ef0f0 P 41268b218b804905a110c86738e74400 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 41268b218b804905a110c86738e74400, 665f7e09521a4c3f9284c1d8b0e094ff; no voters: 
I20260709 13:08:28.869199 28280 raft_consensus.cc:2804] T bbd0bdc9640c4956a5d60406841ef0f0 P 41268b218b804905a110c86738e74400 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:08:28.869704 28280 raft_consensus.cc:697] T bbd0bdc9640c4956a5d60406841ef0f0 P 41268b218b804905a110c86738e74400 [term 2 LEADER]: Becoming Leader. State: Replica: 41268b218b804905a110c86738e74400, State: Running, Role: LEADER
I20260709 13:08:28.870591 28280 consensus_queue.cc:237] T bbd0bdc9640c4956a5d60406841ef0f0 P 41268b218b804905a110c86738e74400 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2513a663afac495eb09126ff55e8b2b0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40721 } } peers { permanent_uuid: "41268b218b804905a110c86738e74400" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 44403 } } peers { permanent_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 38749 } }
I20260709 13:08:28.872921 27588 raft_consensus.cc:2468] T bbd0bdc9640c4956a5d60406841ef0f0 P 2513a663afac495eb09126ff55e8b2b0 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 41268b218b804905a110c86738e74400 in term 2.
I20260709 13:08:28.882426 27489 catalog_manager.cc:5697] T bbd0bdc9640c4956a5d60406841ef0f0 P 41268b218b804905a110c86738e74400 reported cstate change: term changed from 0 to 2, leader changed from <none> to 41268b218b804905a110c86738e74400 (127.17.223.2). New cstate: current_term: 2 leader_uuid: "41268b218b804905a110c86738e74400" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2513a663afac495eb09126ff55e8b2b0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40721 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "41268b218b804905a110c86738e74400" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 44403 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 38749 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:29.251937 27588 raft_consensus.cc:1275] T bbd0bdc9640c4956a5d60406841ef0f0 P 2513a663afac495eb09126ff55e8b2b0 [term 2 FOLLOWER]: Refusing update from remote peer 41268b218b804905a110c86738e74400: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 13:08:29.253674 28298 consensus_queue.cc:1048] T bbd0bdc9640c4956a5d60406841ef0f0 P 41268b218b804905a110c86738e74400 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2513a663afac495eb09126ff55e8b2b0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40721 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:08:29.304204 27741 raft_consensus.cc:1275] T bbd0bdc9640c4956a5d60406841ef0f0 P 665f7e09521a4c3f9284c1d8b0e094ff [term 2 FOLLOWER]: Refusing update from remote peer 41268b218b804905a110c86738e74400: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 13:08:29.306813 28280 consensus_queue.cc:1048] T bbd0bdc9640c4956a5d60406841ef0f0 P 41268b218b804905a110c86738e74400 [LEADER]: Connected to new peer: Peer: permanent_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 38749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:08:30.123212 18300 tablet_server.cc:179] TabletServer@127.17.223.1:0 shutting down...
W20260709 13:08:30.136650 27631 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:08:30.143944 27631 consensus_peers.cc:597] T 93c69c92efc3402e8e9546cb961bbcdc P 41268b218b804905a110c86738e74400 -> Peer 2513a663afac495eb09126ff55e8b2b0 (127.17.223.1:40721): Couldn't send request to peer 2513a663afac495eb09126ff55e8b2b0. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:08:30.172101 27631 consensus_peers.cc:597] T bbd0bdc9640c4956a5d60406841ef0f0 P 41268b218b804905a110c86738e74400 -> Peer 2513a663afac495eb09126ff55e8b2b0 (127.17.223.1:40721): Couldn't send request to peer 2513a663afac495eb09126ff55e8b2b0. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:08:30.298260 27705 consensus_peers.cc:597] T 8d1aa996b2034de7b2d77545de68e73c P 665f7e09521a4c3f9284c1d8b0e094ff -> Peer 2513a663afac495eb09126ff55e8b2b0 (127.17.223.1:40721): Couldn't send request to peer 2513a663afac495eb09126ff55e8b2b0. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:08:30.299968 27705 consensus_peers.cc:597] T 8e758d59bd4a4eae9f67662e165013f9 P 665f7e09521a4c3f9284c1d8b0e094ff -> Peer 2513a663afac495eb09126ff55e8b2b0 (127.17.223.1:40721): Couldn't send request to peer 2513a663afac495eb09126ff55e8b2b0. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:08:30.300865 18300 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:08:30.310739 18300 tablet_replica.cc:333] T bbd0bdc9640c4956a5d60406841ef0f0 P 2513a663afac495eb09126ff55e8b2b0: stopping tablet replica
I20260709 13:08:30.327370 18300 raft_consensus.cc:2243] T bbd0bdc9640c4956a5d60406841ef0f0 P 2513a663afac495eb09126ff55e8b2b0 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:30.331418 18300 raft_consensus.cc:2272] T bbd0bdc9640c4956a5d60406841ef0f0 P 2513a663afac495eb09126ff55e8b2b0 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:08:30.339732 27705 consensus_peers.cc:597] T 9db60240699a4db2ba5faa2c50a742da P 665f7e09521a4c3f9284c1d8b0e094ff -> Peer 2513a663afac495eb09126ff55e8b2b0 (127.17.223.1:40721): Couldn't send request to peer 2513a663afac495eb09126ff55e8b2b0. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:08:30.345337 27631 consensus_peers.cc:597] T 15a4c537259e4b2882a5cc8e723b260a P 41268b218b804905a110c86738e74400 -> Peer 2513a663afac495eb09126ff55e8b2b0 (127.17.223.1:40721): Couldn't send request to peer 2513a663afac495eb09126ff55e8b2b0. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:08:30.347066 18300 tablet_replica.cc:333] T b6be829f6d3f40c99a3c5be18b0c259c P 2513a663afac495eb09126ff55e8b2b0: stopping tablet replica
W20260709 13:08:30.347774 27631 consensus_peers.cc:597] T 28737c73be174729ad3e9d238af7d975 P 41268b218b804905a110c86738e74400 -> Peer 2513a663afac495eb09126ff55e8b2b0 (127.17.223.1:40721): Couldn't send request to peer 2513a663afac495eb09126ff55e8b2b0. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:08:30.352317 18300 raft_consensus.cc:2243] T b6be829f6d3f40c99a3c5be18b0c259c P 2513a663afac495eb09126ff55e8b2b0 [term 1 LEADER]: Raft consensus shutting down.
W20260709 13:08:30.355553 27705 consensus_peers.cc:597] T 1cd5e6e9b36d4591961cb379d7065be9 P 665f7e09521a4c3f9284c1d8b0e094ff -> Peer 2513a663afac495eb09126ff55e8b2b0 (127.17.223.1:40721): Couldn't send request to peer 2513a663afac495eb09126ff55e8b2b0. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:08:30.355440 27631 consensus_peers.cc:597] T 866a01285ca8436385f8d16dcfb0d4e3 P 41268b218b804905a110c86738e74400 -> Peer 2513a663afac495eb09126ff55e8b2b0 (127.17.223.1:40721): Couldn't send request to peer 2513a663afac495eb09126ff55e8b2b0. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:08:30.373993 27634 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.4:40545, user_credentials={real_user=slave}} blocked reactor thread for 43974us
W20260709 13:08:30.357875 27705 consensus_peers.cc:597] T ea92a607c73b4d289d081146089a86f9 P 665f7e09521a4c3f9284c1d8b0e094ff -> Peer 2513a663afac495eb09126ff55e8b2b0 (127.17.223.1:40721): Couldn't send request to peer 2513a663afac495eb09126ff55e8b2b0. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:08:30.425992 27705 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.1:40721, user_credentials={real_user=slave}} blocked reactor thread for 68579.7us
W20260709 13:08:30.431066 27559 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.3:38749, user_credentials={real_user=slave}} blocked reactor thread for 89914.2us
I20260709 13:08:30.444348 18300 raft_consensus.cc:2272] T b6be829f6d3f40c99a3c5be18b0c259c P 2513a663afac495eb09126ff55e8b2b0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:30.449543 18300 tablet_replica.cc:333] T 9c0f604d66664505aa9469fb058601b6 P 2513a663afac495eb09126ff55e8b2b0: stopping tablet replica
I20260709 13:08:30.455631 18300 raft_consensus.cc:2243] T 9c0f604d66664505aa9469fb058601b6 P 2513a663afac495eb09126ff55e8b2b0 [term 2 FOLLOWER]: Raft consensus shutting down.
W20260709 13:08:30.456429 27631 consensus_peers.cc:597] T dd959195de1942f7999397a56496f5bc P 41268b218b804905a110c86738e74400 -> Peer 2513a663afac495eb09126ff55e8b2b0 (127.17.223.1:40721): Couldn't send request to peer 2513a663afac495eb09126ff55e8b2b0. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:08:30.471408 27631 consensus_peers.cc:597] T 4cd7359accee42808761c37543247321 P 41268b218b804905a110c86738e74400 -> Peer 2513a663afac495eb09126ff55e8b2b0 (127.17.223.1:40721): Couldn't send request to peer 2513a663afac495eb09126ff55e8b2b0. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:08:30.476073 27631 consensus_peers.cc:597] T d0c8b4ec2d844a89b4bb66c0f1bf2c8f P 41268b218b804905a110c86738e74400 -> Peer 2513a663afac495eb09126ff55e8b2b0 (127.17.223.1:40721): Couldn't send request to peer 2513a663afac495eb09126ff55e8b2b0. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:08:30.477304 27631 consensus_peers.cc:597] T de531c50b1524ec788b27bc4b883689a P 41268b218b804905a110c86738e74400 -> Peer 2513a663afac495eb09126ff55e8b2b0 (127.17.223.1:40721): Couldn't send request to peer 2513a663afac495eb09126ff55e8b2b0. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:08:30.478485 18300 raft_consensus.cc:2272] T 9c0f604d66664505aa9469fb058601b6 P 2513a663afac495eb09126ff55e8b2b0 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:08:30.506093 27705 consensus_peers.cc:597] T 5e6f8bdfe11b4af4aa27a711db7cbe7a P 665f7e09521a4c3f9284c1d8b0e094ff -> Peer 2513a663afac495eb09126ff55e8b2b0 (127.17.223.1:40721): Couldn't send request to peer 2513a663afac495eb09126ff55e8b2b0. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:08:30.520056 27634 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.4:40545, user_credentials={real_user=slave}} blocked reactor thread for 58703.3us
W20260709 13:08:30.521562 27705 consensus_peers.cc:597] T 1a26f012cd6e4c4c8bf86b5fda903800 P 665f7e09521a4c3f9284c1d8b0e094ff -> Peer 2513a663afac495eb09126ff55e8b2b0 (127.17.223.1:40721): Couldn't send request to peer 2513a663afac495eb09126ff55e8b2b0. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:08:30.539250 18300 tablet_replica.cc:333] T 5a55d1bac7374ff6b83cc7bae2d3b1f3 P 2513a663afac495eb09126ff55e8b2b0: stopping tablet replica
I20260709 13:08:30.541476 18300 raft_consensus.cc:2243] T 5a55d1bac7374ff6b83cc7bae2d3b1f3 P 2513a663afac495eb09126ff55e8b2b0 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:30.542482 18300 raft_consensus.cc:2272] T 5a55d1bac7374ff6b83cc7bae2d3b1f3 P 2513a663afac495eb09126ff55e8b2b0 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:08:30.553606 27705 consensus_peers.cc:597] T 78e19c035a854ee98657bec3edcb3585 P 665f7e09521a4c3f9284c1d8b0e094ff -> Peer 2513a663afac495eb09126ff55e8b2b0 (127.17.223.1:40721): Couldn't send request to peer 2513a663afac495eb09126ff55e8b2b0. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:08:30.555807 18300 tablet_replica.cc:333] T ea92a607c73b4d289d081146089a86f9 P 2513a663afac495eb09126ff55e8b2b0: stopping tablet replica
I20260709 13:08:30.557948 18300 raft_consensus.cc:2243] T ea92a607c73b4d289d081146089a86f9 P 2513a663afac495eb09126ff55e8b2b0 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:30.559109 18300 raft_consensus.cc:2272] T ea92a607c73b4d289d081146089a86f9 P 2513a663afac495eb09126ff55e8b2b0 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:08:30.559338 27705 consensus_peers.cc:597] T 9c0f604d66664505aa9469fb058601b6 P 665f7e09521a4c3f9284c1d8b0e094ff -> Peer 2513a663afac495eb09126ff55e8b2b0 (127.17.223.1:40721): Couldn't send request to peer 2513a663afac495eb09126ff55e8b2b0. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:08:30.560048 27705 consensus_peers.cc:597] T 85cdd21b7a5f4db7af44327c57c16d43 P 665f7e09521a4c3f9284c1d8b0e094ff -> Peer 2513a663afac495eb09126ff55e8b2b0 (127.17.223.1:40721): Couldn't send request to peer 2513a663afac495eb09126ff55e8b2b0. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:08:30.563035 18300 tablet_replica.cc:333] T ae05961ab7a94458b1ad2cde9785c63b P 2513a663afac495eb09126ff55e8b2b0: stopping tablet replica
W20260709 13:08:30.563035 27705 consensus_peers.cc:597] T c9ea919812394c7aba307c2ff5b81f51 P 665f7e09521a4c3f9284c1d8b0e094ff -> Peer 2513a663afac495eb09126ff55e8b2b0 (127.17.223.1:40721): Couldn't send request to peer 2513a663afac495eb09126ff55e8b2b0. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:08:30.565637 27705 consensus_peers.cc:597] T e23b142958324f69aa0bad3a5828fa83 P 665f7e09521a4c3f9284c1d8b0e094ff -> Peer 2513a663afac495eb09126ff55e8b2b0 (127.17.223.1:40721): Couldn't send request to peer 2513a663afac495eb09126ff55e8b2b0. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:08:30.566391 27705 consensus_peers.cc:597] T fb246ce2984c4a6393f12f75083c9fcf P 665f7e09521a4c3f9284c1d8b0e094ff -> Peer 2513a663afac495eb09126ff55e8b2b0 (127.17.223.1:40721): Couldn't send request to peer 2513a663afac495eb09126ff55e8b2b0. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:08:30.568006 18300 raft_consensus.cc:2243] T ae05961ab7a94458b1ad2cde9785c63b P 2513a663afac495eb09126ff55e8b2b0 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:08:30.570041 18300 raft_consensus.cc:2272] T ae05961ab7a94458b1ad2cde9785c63b P 2513a663afac495eb09126ff55e8b2b0 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:08:30.580633 27631 consensus_peers.cc:597] T bc77856749a0473a8b3124ce8c523815 P 41268b218b804905a110c86738e74400 -> Peer 2513a663afac495eb09126ff55e8b2b0 (127.17.223.1:40721): Couldn't send request to peer 2513a663afac495eb09126ff55e8b2b0. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:08:30.581607 18300 tablet_replica.cc:333] T 8e758d59bd4a4eae9f67662e165013f9 P 2513a663afac495eb09126ff55e8b2b0: stopping tablet replica
I20260709 13:08:30.583482 18300 raft_consensus.cc:2243] T 8e758d59bd4a4eae9f67662e165013f9 P 2513a663afac495eb09126ff55e8b2b0 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:30.584357 18300 raft_consensus.cc:2272] T 8e758d59bd4a4eae9f67662e165013f9 P 2513a663afac495eb09126ff55e8b2b0 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:08:30.587620 27779 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.1:40721, user_credentials={real_user=slave}} blocked reactor thread for 83897.7us
I20260709 13:08:30.592144 18300 tablet_replica.cc:333] T fb246ce2984c4a6393f12f75083c9fcf P 2513a663afac495eb09126ff55e8b2b0: stopping tablet replica
I20260709 13:08:30.594148 18300 raft_consensus.cc:2243] T fb246ce2984c4a6393f12f75083c9fcf P 2513a663afac495eb09126ff55e8b2b0 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:30.595167 18300 raft_consensus.cc:2272] T fb246ce2984c4a6393f12f75083c9fcf P 2513a663afac495eb09126ff55e8b2b0 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:08:30.597808 27631 consensus_peers.cc:597] T 765d0bd527c64f74be713c390a018bba P 41268b218b804905a110c86738e74400 -> Peer 2513a663afac495eb09126ff55e8b2b0 (127.17.223.1:40721): Couldn't send request to peer 2513a663afac495eb09126ff55e8b2b0. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:08:30.600069 18300 tablet_replica.cc:333] T 8d1aa996b2034de7b2d77545de68e73c P 2513a663afac495eb09126ff55e8b2b0: stopping tablet replica
I20260709 13:08:30.601612 18300 raft_consensus.cc:2243] T 8d1aa996b2034de7b2d77545de68e73c P 2513a663afac495eb09126ff55e8b2b0 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:30.602730 18300 raft_consensus.cc:2272] T 8d1aa996b2034de7b2d77545de68e73c P 2513a663afac495eb09126ff55e8b2b0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:30.606879 18300 tablet_replica.cc:333] T 85cdd21b7a5f4db7af44327c57c16d43 P 2513a663afac495eb09126ff55e8b2b0: stopping tablet replica
I20260709 13:08:30.608147 18300 raft_consensus.cc:2243] T 85cdd21b7a5f4db7af44327c57c16d43 P 2513a663afac495eb09126ff55e8b2b0 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:30.608933 18300 raft_consensus.cc:2272] T 85cdd21b7a5f4db7af44327c57c16d43 P 2513a663afac495eb09126ff55e8b2b0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:30.612874 18300 tablet_replica.cc:333] T 585e960f8d0f42268f2fe98e1e7b83f0 P 2513a663afac495eb09126ff55e8b2b0: stopping tablet replica
I20260709 13:08:30.613961 18300 raft_consensus.cc:2243] T 585e960f8d0f42268f2fe98e1e7b83f0 P 2513a663afac495eb09126ff55e8b2b0 [term 1 FOLLOWER]: Raft consensus shutting down.
W20260709 13:08:30.614197 27779 consensus_peers.cc:597] T ff09d7e79a3e43918f3c71d10a40d60b P 18435fbb525741328139e84a1e354954 -> Peer 2513a663afac495eb09126ff55e8b2b0 (127.17.223.1:40721): Couldn't send request to peer 2513a663afac495eb09126ff55e8b2b0. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:08:30.614816 18300 raft_consensus.cc:2272] T 585e960f8d0f42268f2fe98e1e7b83f0 P 2513a663afac495eb09126ff55e8b2b0 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:08:30.618532 27779 consensus_peers.cc:597] T e9b149d77d9941158ead8e9e592e7b27 P 18435fbb525741328139e84a1e354954 -> Peer 2513a663afac495eb09126ff55e8b2b0 (127.17.223.1:40721): Couldn't send request to peer 2513a663afac495eb09126ff55e8b2b0. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:08:30.619299 27779 consensus_peers.cc:597] T 5a55d1bac7374ff6b83cc7bae2d3b1f3 P 18435fbb525741328139e84a1e354954 -> Peer 2513a663afac495eb09126ff55e8b2b0 (127.17.223.1:40721): Couldn't send request to peer 2513a663afac495eb09126ff55e8b2b0. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:08:30.619963 27779 consensus_peers.cc:597] T 55a3afc21cea43ea85f4a2155552422d P 18435fbb525741328139e84a1e354954 -> Peer 2513a663afac495eb09126ff55e8b2b0 (127.17.223.1:40721): Couldn't send request to peer 2513a663afac495eb09126ff55e8b2b0. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:08:30.620641 27779 consensus_peers.cc:597] T e5847d81a5284a44a6b2b21cf6f4351c P 18435fbb525741328139e84a1e354954 -> Peer 2513a663afac495eb09126ff55e8b2b0 (127.17.223.1:40721): Couldn't send request to peer 2513a663afac495eb09126ff55e8b2b0. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:08:30.622370 18300 tablet_replica.cc:333] T 1cd5e6e9b36d4591961cb379d7065be9 P 2513a663afac495eb09126ff55e8b2b0: stopping tablet replica
I20260709 13:08:30.624063 18300 raft_consensus.cc:2243] T 1cd5e6e9b36d4591961cb379d7065be9 P 2513a663afac495eb09126ff55e8b2b0 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:30.625402 18300 raft_consensus.cc:2272] T 1cd5e6e9b36d4591961cb379d7065be9 P 2513a663afac495eb09126ff55e8b2b0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:30.630980 18300 tablet_replica.cc:333] T 4cd7359accee42808761c37543247321 P 2513a663afac495eb09126ff55e8b2b0: stopping tablet replica
I20260709 13:08:30.632128 18300 raft_consensus.cc:2243] T 4cd7359accee42808761c37543247321 P 2513a663afac495eb09126ff55e8b2b0 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:30.632911 18300 raft_consensus.cc:2272] T 4cd7359accee42808761c37543247321 P 2513a663afac495eb09126ff55e8b2b0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:30.636644 18300 tablet_replica.cc:333] T 93c69c92efc3402e8e9546cb961bbcdc P 2513a663afac495eb09126ff55e8b2b0: stopping tablet replica
I20260709 13:08:30.637537 18300 raft_consensus.cc:2243] T 93c69c92efc3402e8e9546cb961bbcdc P 2513a663afac495eb09126ff55e8b2b0 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:30.638271 18300 raft_consensus.cc:2272] T 93c69c92efc3402e8e9546cb961bbcdc P 2513a663afac495eb09126ff55e8b2b0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:30.641597 18300 tablet_replica.cc:333] T 2d68b1be563949efbcb4bbe71eddd0d8 P 2513a663afac495eb09126ff55e8b2b0: stopping tablet replica
I20260709 13:08:30.642534 18300 raft_consensus.cc:2243] T 2d68b1be563949efbcb4bbe71eddd0d8 P 2513a663afac495eb09126ff55e8b2b0 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:08:30.643703 18300 raft_consensus.cc:2272] T 2d68b1be563949efbcb4bbe71eddd0d8 P 2513a663afac495eb09126ff55e8b2b0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:30.646723 18300 tablet_replica.cc:333] T dd959195de1942f7999397a56496f5bc P 2513a663afac495eb09126ff55e8b2b0: stopping tablet replica
I20260709 13:08:30.648043 18300 raft_consensus.cc:2243] T dd959195de1942f7999397a56496f5bc P 2513a663afac495eb09126ff55e8b2b0 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:30.648787 18300 raft_consensus.cc:2272] T dd959195de1942f7999397a56496f5bc P 2513a663afac495eb09126ff55e8b2b0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:30.652096 18300 tablet_replica.cc:333] T e5847d81a5284a44a6b2b21cf6f4351c P 2513a663afac495eb09126ff55e8b2b0: stopping tablet replica
I20260709 13:08:30.653334 18300 raft_consensus.cc:2243] T e5847d81a5284a44a6b2b21cf6f4351c P 2513a663afac495eb09126ff55e8b2b0 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:30.654011 18300 raft_consensus.cc:2272] T e5847d81a5284a44a6b2b21cf6f4351c P 2513a663afac495eb09126ff55e8b2b0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:30.657584 18300 tablet_replica.cc:333] T 80e2477670ec4db18ad338931d714544 P 2513a663afac495eb09126ff55e8b2b0: stopping tablet replica
I20260709 13:08:30.658473 18300 raft_consensus.cc:2243] T 80e2477670ec4db18ad338931d714544 P 2513a663afac495eb09126ff55e8b2b0 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:08:30.659699 18300 raft_consensus.cc:2272] T 80e2477670ec4db18ad338931d714544 P 2513a663afac495eb09126ff55e8b2b0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:30.663050 18300 tablet_replica.cc:333] T 15a4c537259e4b2882a5cc8e723b260a P 2513a663afac495eb09126ff55e8b2b0: stopping tablet replica
I20260709 13:08:30.664034 18300 raft_consensus.cc:2243] T 15a4c537259e4b2882a5cc8e723b260a P 2513a663afac495eb09126ff55e8b2b0 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:30.664690 18300 raft_consensus.cc:2272] T 15a4c537259e4b2882a5cc8e723b260a P 2513a663afac495eb09126ff55e8b2b0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:30.667637 18300 tablet_replica.cc:333] T 2d994cb13f8f453284bcb1f8b85824a2 P 2513a663afac495eb09126ff55e8b2b0: stopping tablet replica
I20260709 13:08:30.668521 18300 raft_consensus.cc:2243] T 2d994cb13f8f453284bcb1f8b85824a2 P 2513a663afac495eb09126ff55e8b2b0 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:08:30.669461 18300 raft_consensus.cc:2272] T 2d994cb13f8f453284bcb1f8b85824a2 P 2513a663afac495eb09126ff55e8b2b0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:30.672165 18300 tablet_replica.cc:333] T c9ea919812394c7aba307c2ff5b81f51 P 2513a663afac495eb09126ff55e8b2b0: stopping tablet replica
I20260709 13:08:30.672968 18300 raft_consensus.cc:2243] T c9ea919812394c7aba307c2ff5b81f51 P 2513a663afac495eb09126ff55e8b2b0 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:30.673586 18300 raft_consensus.cc:2272] T c9ea919812394c7aba307c2ff5b81f51 P 2513a663afac495eb09126ff55e8b2b0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:30.676245 18300 tablet_replica.cc:333] T 9db60240699a4db2ba5faa2c50a742da P 2513a663afac495eb09126ff55e8b2b0: stopping tablet replica
I20260709 13:08:30.676944 18300 raft_consensus.cc:2243] T 9db60240699a4db2ba5faa2c50a742da P 2513a663afac495eb09126ff55e8b2b0 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:30.677572 18300 raft_consensus.cc:2272] T 9db60240699a4db2ba5faa2c50a742da P 2513a663afac495eb09126ff55e8b2b0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:30.680107 18300 tablet_replica.cc:333] T 86af954f570648969cbc47c03d15c447 P 2513a663afac495eb09126ff55e8b2b0: stopping tablet replica
I20260709 13:08:30.680759 18300 raft_consensus.cc:2243] T 86af954f570648969cbc47c03d15c447 P 2513a663afac495eb09126ff55e8b2b0 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:08:30.681725 18300 raft_consensus.cc:2272] T 86af954f570648969cbc47c03d15c447 P 2513a663afac495eb09126ff55e8b2b0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:30.684399 18300 tablet_replica.cc:333] T ff09d7e79a3e43918f3c71d10a40d60b P 2513a663afac495eb09126ff55e8b2b0: stopping tablet replica
I20260709 13:08:30.685030 18300 raft_consensus.cc:2243] T ff09d7e79a3e43918f3c71d10a40d60b P 2513a663afac495eb09126ff55e8b2b0 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:30.685686 18300 raft_consensus.cc:2272] T ff09d7e79a3e43918f3c71d10a40d60b P 2513a663afac495eb09126ff55e8b2b0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:30.688866 18300 tablet_replica.cc:333] T bc77856749a0473a8b3124ce8c523815 P 2513a663afac495eb09126ff55e8b2b0: stopping tablet replica
I20260709 13:08:30.689460 18300 raft_consensus.cc:2243] T bc77856749a0473a8b3124ce8c523815 P 2513a663afac495eb09126ff55e8b2b0 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:30.690110 18300 raft_consensus.cc:2272] T bc77856749a0473a8b3124ce8c523815 P 2513a663afac495eb09126ff55e8b2b0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:30.692965 18300 tablet_replica.cc:333] T 5e6f8bdfe11b4af4aa27a711db7cbe7a P 2513a663afac495eb09126ff55e8b2b0: stopping tablet replica
I20260709 13:08:30.693861 18300 raft_consensus.cc:2243] T 5e6f8bdfe11b4af4aa27a711db7cbe7a P 2513a663afac495eb09126ff55e8b2b0 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:30.694475 18300 raft_consensus.cc:2272] T 5e6f8bdfe11b4af4aa27a711db7cbe7a P 2513a663afac495eb09126ff55e8b2b0 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:08:30.697124 27705 consensus_peers.cc:597] T 585e960f8d0f42268f2fe98e1e7b83f0 P 665f7e09521a4c3f9284c1d8b0e094ff -> Peer 2513a663afac495eb09126ff55e8b2b0 (127.17.223.1:40721): Couldn't send request to peer 2513a663afac495eb09126ff55e8b2b0. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:08:30.697631 18300 tablet_replica.cc:333] T 11224ef6c00a40cdba4311ceb63bddb9 P 2513a663afac495eb09126ff55e8b2b0: stopping tablet replica
I20260709 13:08:30.698691 18300 raft_consensus.cc:2243] T 11224ef6c00a40cdba4311ceb63bddb9 P 2513a663afac495eb09126ff55e8b2b0 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:08:30.702409 18300 raft_consensus.cc:2272] T 11224ef6c00a40cdba4311ceb63bddb9 P 2513a663afac495eb09126ff55e8b2b0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:30.706969 18300 tablet_replica.cc:333] T 866a01285ca8436385f8d16dcfb0d4e3 P 2513a663afac495eb09126ff55e8b2b0: stopping tablet replica
I20260709 13:08:30.707895 18300 raft_consensus.cc:2243] T 866a01285ca8436385f8d16dcfb0d4e3 P 2513a663afac495eb09126ff55e8b2b0 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:30.708585 18300 raft_consensus.cc:2272] T 866a01285ca8436385f8d16dcfb0d4e3 P 2513a663afac495eb09126ff55e8b2b0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:30.711786 18300 tablet_replica.cc:333] T 28737c73be174729ad3e9d238af7d975 P 2513a663afac495eb09126ff55e8b2b0: stopping tablet replica
I20260709 13:08:30.712705 18300 raft_consensus.cc:2243] T 28737c73be174729ad3e9d238af7d975 P 2513a663afac495eb09126ff55e8b2b0 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:30.713408 18300 raft_consensus.cc:2272] T 28737c73be174729ad3e9d238af7d975 P 2513a663afac495eb09126ff55e8b2b0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:30.716770 18300 tablet_replica.cc:333] T 765d0bd527c64f74be713c390a018bba P 2513a663afac495eb09126ff55e8b2b0: stopping tablet replica
I20260709 13:08:30.717691 18300 raft_consensus.cc:2243] T 765d0bd527c64f74be713c390a018bba P 2513a663afac495eb09126ff55e8b2b0 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:30.718287 18300 raft_consensus.cc:2272] T 765d0bd527c64f74be713c390a018bba P 2513a663afac495eb09126ff55e8b2b0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:30.721428 18300 tablet_replica.cc:333] T 7b77a53b493f4e979fdf38a0b17176b0 P 2513a663afac495eb09126ff55e8b2b0: stopping tablet replica
I20260709 13:08:30.722467 18300 raft_consensus.cc:2243] T 7b77a53b493f4e979fdf38a0b17176b0 P 2513a663afac495eb09126ff55e8b2b0 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:08:30.723752 18300 raft_consensus.cc:2272] T 7b77a53b493f4e979fdf38a0b17176b0 P 2513a663afac495eb09126ff55e8b2b0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:30.727061 18300 tablet_replica.cc:333] T 47b65672307641ae81d5f94c639b1a10 P 2513a663afac495eb09126ff55e8b2b0: stopping tablet replica
I20260709 13:08:30.728015 18300 raft_consensus.cc:2243] T 47b65672307641ae81d5f94c639b1a10 P 2513a663afac495eb09126ff55e8b2b0 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:08:30.729187 18300 raft_consensus.cc:2272] T 47b65672307641ae81d5f94c639b1a10 P 2513a663afac495eb09126ff55e8b2b0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:30.733665 18300 tablet_replica.cc:333] T 55a3afc21cea43ea85f4a2155552422d P 2513a663afac495eb09126ff55e8b2b0: stopping tablet replica
I20260709 13:08:30.734601 18300 raft_consensus.cc:2243] T 55a3afc21cea43ea85f4a2155552422d P 2513a663afac495eb09126ff55e8b2b0 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:30.735471 18300 raft_consensus.cc:2272] T 55a3afc21cea43ea85f4a2155552422d P 2513a663afac495eb09126ff55e8b2b0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:30.738901 18300 tablet_replica.cc:333] T bc0b10615ecb4485a9a9de298938697d P 2513a663afac495eb09126ff55e8b2b0: stopping tablet replica
I20260709 13:08:30.739822 18300 raft_consensus.cc:2243] T bc0b10615ecb4485a9a9de298938697d P 2513a663afac495eb09126ff55e8b2b0 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:08:30.740936 18300 raft_consensus.cc:2272] T bc0b10615ecb4485a9a9de298938697d P 2513a663afac495eb09126ff55e8b2b0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:30.744724 18300 tablet_replica.cc:333] T e23b142958324f69aa0bad3a5828fa83 P 2513a663afac495eb09126ff55e8b2b0: stopping tablet replica
I20260709 13:08:30.745688 18300 raft_consensus.cc:2243] T e23b142958324f69aa0bad3a5828fa83 P 2513a663afac495eb09126ff55e8b2b0 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:30.746362 18300 raft_consensus.cc:2272] T e23b142958324f69aa0bad3a5828fa83 P 2513a663afac495eb09126ff55e8b2b0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:30.749643 18300 tablet_replica.cc:333] T 18f991bbbf3a4615aab49899c7ef86dc P 2513a663afac495eb09126ff55e8b2b0: stopping tablet replica
I20260709 13:08:30.750594 18300 raft_consensus.cc:2243] T 18f991bbbf3a4615aab49899c7ef86dc P 2513a663afac495eb09126ff55e8b2b0 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:08:30.751754 18300 raft_consensus.cc:2272] T 18f991bbbf3a4615aab49899c7ef86dc P 2513a663afac495eb09126ff55e8b2b0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:30.755081 18300 tablet_replica.cc:333] T 78e19c035a854ee98657bec3edcb3585 P 2513a663afac495eb09126ff55e8b2b0: stopping tablet replica
I20260709 13:08:30.755959 18300 raft_consensus.cc:2243] T 78e19c035a854ee98657bec3edcb3585 P 2513a663afac495eb09126ff55e8b2b0 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:30.756649 18300 raft_consensus.cc:2272] T 78e19c035a854ee98657bec3edcb3585 P 2513a663afac495eb09126ff55e8b2b0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:30.760077 18300 tablet_replica.cc:333] T a9eac7f072de454a8ff2beb019da45d9 P 2513a663afac495eb09126ff55e8b2b0: stopping tablet replica
I20260709 13:08:30.760877 18300 raft_consensus.cc:2243] T a9eac7f072de454a8ff2beb019da45d9 P 2513a663afac495eb09126ff55e8b2b0 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:08:30.761991 18300 raft_consensus.cc:2272] T a9eac7f072de454a8ff2beb019da45d9 P 2513a663afac495eb09126ff55e8b2b0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:30.765627 18300 tablet_replica.cc:333] T d0c8b4ec2d844a89b4bb66c0f1bf2c8f P 2513a663afac495eb09126ff55e8b2b0: stopping tablet replica
I20260709 13:08:30.766547 18300 raft_consensus.cc:2243] T d0c8b4ec2d844a89b4bb66c0f1bf2c8f P 2513a663afac495eb09126ff55e8b2b0 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:30.767621 18300 raft_consensus.cc:2272] T d0c8b4ec2d844a89b4bb66c0f1bf2c8f P 2513a663afac495eb09126ff55e8b2b0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:30.770975 18300 tablet_replica.cc:333] T 3a7da70e9f0f49a9bf60184a8f0b5339 P 2513a663afac495eb09126ff55e8b2b0: stopping tablet replica
I20260709 13:08:30.771886 18300 raft_consensus.cc:2243] T 3a7da70e9f0f49a9bf60184a8f0b5339 P 2513a663afac495eb09126ff55e8b2b0 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:08:30.773118 18300 raft_consensus.cc:2272] T 3a7da70e9f0f49a9bf60184a8f0b5339 P 2513a663afac495eb09126ff55e8b2b0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:30.776451 18300 tablet_replica.cc:333] T 456941807b254f5fb32dca4f84bd16ea P 2513a663afac495eb09126ff55e8b2b0: stopping tablet replica
I20260709 13:08:30.777307 18300 raft_consensus.cc:2243] T 456941807b254f5fb32dca4f84bd16ea P 2513a663afac495eb09126ff55e8b2b0 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:08:30.778568 18300 raft_consensus.cc:2272] T 456941807b254f5fb32dca4f84bd16ea P 2513a663afac495eb09126ff55e8b2b0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:30.781967 18300 tablet_replica.cc:333] T de531c50b1524ec788b27bc4b883689a P 2513a663afac495eb09126ff55e8b2b0: stopping tablet replica
I20260709 13:08:30.782778 18300 raft_consensus.cc:2243] T de531c50b1524ec788b27bc4b883689a P 2513a663afac495eb09126ff55e8b2b0 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:30.783535 18300 raft_consensus.cc:2272] T de531c50b1524ec788b27bc4b883689a P 2513a663afac495eb09126ff55e8b2b0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:30.786794 18300 tablet_replica.cc:333] T 1a26f012cd6e4c4c8bf86b5fda903800 P 2513a663afac495eb09126ff55e8b2b0: stopping tablet replica
I20260709 13:08:30.787552 18300 raft_consensus.cc:2243] T 1a26f012cd6e4c4c8bf86b5fda903800 P 2513a663afac495eb09126ff55e8b2b0 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:30.788264 18300 raft_consensus.cc:2272] T 1a26f012cd6e4c4c8bf86b5fda903800 P 2513a663afac495eb09126ff55e8b2b0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:30.791612 18300 tablet_replica.cc:333] T 64490a86db8c4f5ca54f4f8085f41319 P 2513a663afac495eb09126ff55e8b2b0: stopping tablet replica
I20260709 13:08:30.792387 18300 raft_consensus.cc:2243] T 64490a86db8c4f5ca54f4f8085f41319 P 2513a663afac495eb09126ff55e8b2b0 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:08:30.793651 18300 raft_consensus.cc:2272] T 64490a86db8c4f5ca54f4f8085f41319 P 2513a663afac495eb09126ff55e8b2b0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:30.796965 18300 tablet_replica.cc:333] T e9b149d77d9941158ead8e9e592e7b27 P 2513a663afac495eb09126ff55e8b2b0: stopping tablet replica
I20260709 13:08:30.797686 18300 raft_consensus.cc:2243] T e9b149d77d9941158ead8e9e592e7b27 P 2513a663afac495eb09126ff55e8b2b0 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:30.798316 18300 raft_consensus.cc:2272] T e9b149d77d9941158ead8e9e592e7b27 P 2513a663afac495eb09126ff55e8b2b0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:31.565956 28379 raft_consensus.cc:493] T b6be829f6d3f40c99a3c5be18b0c259c P 18435fbb525741328139e84a1e354954 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2513a663afac495eb09126ff55e8b2b0)
I20260709 13:08:31.566615 28379 raft_consensus.cc:515] T b6be829f6d3f40c99a3c5be18b0c259c P 18435fbb525741328139e84a1e354954 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18435fbb525741328139e84a1e354954" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 40545 } } peers { permanent_uuid: "2513a663afac495eb09126ff55e8b2b0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40721 } } peers { permanent_uuid: "41268b218b804905a110c86738e74400" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 44403 } }
I20260709 13:08:31.569224 28379 leader_election.cc:290] T b6be829f6d3f40c99a3c5be18b0c259c P 18435fbb525741328139e84a1e354954 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2513a663afac495eb09126ff55e8b2b0 (127.17.223.1:40721), 41268b218b804905a110c86738e74400 (127.17.223.2:44403)
I20260709 13:08:31.570420 27666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6be829f6d3f40c99a3c5be18b0c259c" candidate_uuid: "18435fbb525741328139e84a1e354954" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "41268b218b804905a110c86738e74400" is_pre_election: true
W20260709 13:08:31.573360 27779 leader_election.cc:336] T b6be829f6d3f40c99a3c5be18b0c259c P 18435fbb525741328139e84a1e354954 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 2513a663afac495eb09126ff55e8b2b0 (127.17.223.1:40721): Network error: Client connection negotiation failed: client connection to 127.17.223.1:40721: connect: Connection refused (error 111)
I20260709 13:08:31.573784 27779 leader_election.cc:304] T b6be829f6d3f40c99a3c5be18b0c259c P 18435fbb525741328139e84a1e354954 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 18435fbb525741328139e84a1e354954; no voters: 2513a663afac495eb09126ff55e8b2b0, 41268b218b804905a110c86738e74400
I20260709 13:08:31.574471 28379 raft_consensus.cc:2749] T b6be829f6d3f40c99a3c5be18b0c259c P 18435fbb525741328139e84a1e354954 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:08:31.765604 28377 raft_consensus.cc:493] T a9eac7f072de454a8ff2beb019da45d9 P 41268b218b804905a110c86738e74400 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2513a663afac495eb09126ff55e8b2b0)
I20260709 13:08:31.766142 28377 raft_consensus.cc:515] T a9eac7f072de454a8ff2beb019da45d9 P 41268b218b804905a110c86738e74400 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18435fbb525741328139e84a1e354954" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 40545 } } peers { permanent_uuid: "2513a663afac495eb09126ff55e8b2b0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40721 } } peers { permanent_uuid: "41268b218b804905a110c86738e74400" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 44403 } }
I20260709 13:08:31.768543 28377 leader_election.cc:290] T a9eac7f072de454a8ff2beb019da45d9 P 41268b218b804905a110c86738e74400 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 18435fbb525741328139e84a1e354954 (127.17.223.4:40545), 2513a663afac495eb09126ff55e8b2b0 (127.17.223.1:40721)
I20260709 13:08:31.770781 27813 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9eac7f072de454a8ff2beb019da45d9" candidate_uuid: "41268b218b804905a110c86738e74400" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "18435fbb525741328139e84a1e354954" is_pre_election: true
W20260709 13:08:31.774189 27631 leader_election.cc:336] T a9eac7f072de454a8ff2beb019da45d9 P 41268b218b804905a110c86738e74400 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 2513a663afac495eb09126ff55e8b2b0 (127.17.223.1:40721): Network error: Client connection negotiation failed: client connection to 127.17.223.1:40721: connect: Connection refused (error 111)
I20260709 13:08:31.774610 27631 leader_election.cc:304] T a9eac7f072de454a8ff2beb019da45d9 P 41268b218b804905a110c86738e74400 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 41268b218b804905a110c86738e74400; no voters: 18435fbb525741328139e84a1e354954, 2513a663afac495eb09126ff55e8b2b0
I20260709 13:08:31.776309 28377 raft_consensus.cc:2749] T a9eac7f072de454a8ff2beb019da45d9 P 41268b218b804905a110c86738e74400 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:08:31.780907 28331 raft_consensus.cc:493] T ae05961ab7a94458b1ad2cde9785c63b P 665f7e09521a4c3f9284c1d8b0e094ff [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2513a663afac495eb09126ff55e8b2b0)
I20260709 13:08:31.781431 28331 raft_consensus.cc:515] T ae05961ab7a94458b1ad2cde9785c63b P 665f7e09521a4c3f9284c1d8b0e094ff [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 38749 } } peers { permanent_uuid: "18435fbb525741328139e84a1e354954" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 40545 } } peers { permanent_uuid: "2513a663afac495eb09126ff55e8b2b0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40721 } }
I20260709 13:08:31.782341 28381 raft_consensus.cc:493] T 7b77a53b493f4e979fdf38a0b17176b0 P 665f7e09521a4c3f9284c1d8b0e094ff [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2513a663afac495eb09126ff55e8b2b0)
I20260709 13:08:31.782871 28381 raft_consensus.cc:515] T 7b77a53b493f4e979fdf38a0b17176b0 P 665f7e09521a4c3f9284c1d8b0e094ff [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2513a663afac495eb09126ff55e8b2b0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40721 } } peers { permanent_uuid: "41268b218b804905a110c86738e74400" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 44403 } } peers { permanent_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 38749 } }
I20260709 13:08:31.783756 28331 leader_election.cc:290] T ae05961ab7a94458b1ad2cde9785c63b P 665f7e09521a4c3f9284c1d8b0e094ff [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 18435fbb525741328139e84a1e354954 (127.17.223.4:40545), 2513a663afac495eb09126ff55e8b2b0 (127.17.223.1:40721)
I20260709 13:08:31.784535 27813 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae05961ab7a94458b1ad2cde9785c63b" candidate_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "18435fbb525741328139e84a1e354954" is_pre_election: true
I20260709 13:08:31.784970 28381 leader_election.cc:290] T 7b77a53b493f4e979fdf38a0b17176b0 P 665f7e09521a4c3f9284c1d8b0e094ff [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2513a663afac495eb09126ff55e8b2b0 (127.17.223.1:40721), 41268b218b804905a110c86738e74400 (127.17.223.2:44403)
I20260709 13:08:31.787060 27666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b77a53b493f4e979fdf38a0b17176b0" candidate_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "41268b218b804905a110c86738e74400" is_pre_election: true
W20260709 13:08:31.789095 27705 leader_election.cc:336] T ae05961ab7a94458b1ad2cde9785c63b P 665f7e09521a4c3f9284c1d8b0e094ff [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 2513a663afac495eb09126ff55e8b2b0 (127.17.223.1:40721): Network error: Client connection negotiation failed: client connection to 127.17.223.1:40721: connect: Connection refused (error 111)
I20260709 13:08:31.789499 27705 leader_election.cc:304] T ae05961ab7a94458b1ad2cde9785c63b P 665f7e09521a4c3f9284c1d8b0e094ff [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 665f7e09521a4c3f9284c1d8b0e094ff; no voters: 18435fbb525741328139e84a1e354954, 2513a663afac495eb09126ff55e8b2b0
W20260709 13:08:31.790131 27705 leader_election.cc:336] T 7b77a53b493f4e979fdf38a0b17176b0 P 665f7e09521a4c3f9284c1d8b0e094ff [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 2513a663afac495eb09126ff55e8b2b0 (127.17.223.1:40721): Network error: Client connection negotiation failed: client connection to 127.17.223.1:40721: connect: Connection refused (error 111)
I20260709 13:08:31.790068 28381 raft_consensus.cc:2749] T ae05961ab7a94458b1ad2cde9785c63b P 665f7e09521a4c3f9284c1d8b0e094ff [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:08:31.790644 27705 leader_election.cc:304] T 7b77a53b493f4e979fdf38a0b17176b0 P 665f7e09521a4c3f9284c1d8b0e094ff [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 665f7e09521a4c3f9284c1d8b0e094ff; no voters: 2513a663afac495eb09126ff55e8b2b0, 41268b218b804905a110c86738e74400
I20260709 13:08:31.791330 28381 raft_consensus.cc:2749] T 7b77a53b493f4e979fdf38a0b17176b0 P 665f7e09521a4c3f9284c1d8b0e094ff [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:08:31.802033 28280 raft_consensus.cc:493] T b6be829f6d3f40c99a3c5be18b0c259c P 41268b218b804905a110c86738e74400 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2513a663afac495eb09126ff55e8b2b0)
I20260709 13:08:31.802515 28280 raft_consensus.cc:515] T b6be829f6d3f40c99a3c5be18b0c259c P 41268b218b804905a110c86738e74400 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18435fbb525741328139e84a1e354954" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 40545 } } peers { permanent_uuid: "2513a663afac495eb09126ff55e8b2b0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40721 } } peers { permanent_uuid: "41268b218b804905a110c86738e74400" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 44403 } }
I20260709 13:08:31.804343 28280 leader_election.cc:290] T b6be829f6d3f40c99a3c5be18b0c259c P 41268b218b804905a110c86738e74400 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 18435fbb525741328139e84a1e354954 (127.17.223.4:40545), 2513a663afac495eb09126ff55e8b2b0 (127.17.223.1:40721)
I20260709 13:08:31.805007 27815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6be829f6d3f40c99a3c5be18b0c259c" candidate_uuid: "41268b218b804905a110c86738e74400" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "18435fbb525741328139e84a1e354954" is_pre_election: true
I20260709 13:08:31.806318 27815 raft_consensus.cc:2468] T b6be829f6d3f40c99a3c5be18b0c259c P 18435fbb525741328139e84a1e354954 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 41268b218b804905a110c86738e74400 in term 1.
I20260709 13:08:31.808060 27634 leader_election.cc:304] T b6be829f6d3f40c99a3c5be18b0c259c P 41268b218b804905a110c86738e74400 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 18435fbb525741328139e84a1e354954, 41268b218b804905a110c86738e74400; no voters: 
I20260709 13:08:31.809998 28377 raft_consensus.cc:2804] T b6be829f6d3f40c99a3c5be18b0c259c P 41268b218b804905a110c86738e74400 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:08:31.810339 28377 raft_consensus.cc:493] T b6be829f6d3f40c99a3c5be18b0c259c P 41268b218b804905a110c86738e74400 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 2513a663afac495eb09126ff55e8b2b0)
I20260709 13:08:31.810624 28377 raft_consensus.cc:3060] T b6be829f6d3f40c99a3c5be18b0c259c P 41268b218b804905a110c86738e74400 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:08:31.815229 27631 leader_election.cc:336] T b6be829f6d3f40c99a3c5be18b0c259c P 41268b218b804905a110c86738e74400 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 2513a663afac495eb09126ff55e8b2b0 (127.17.223.1:40721): Network error: Client connection negotiation failed: client connection to 127.17.223.1:40721: connect: Connection refused (error 111)
I20260709 13:08:31.815528 28381 raft_consensus.cc:493] T 47b65672307641ae81d5f94c639b1a10 P 665f7e09521a4c3f9284c1d8b0e094ff [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2513a663afac495eb09126ff55e8b2b0)
I20260709 13:08:31.816174 28381 raft_consensus.cc:515] T 47b65672307641ae81d5f94c639b1a10 P 665f7e09521a4c3f9284c1d8b0e094ff [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2513a663afac495eb09126ff55e8b2b0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40721 } } peers { permanent_uuid: "41268b218b804905a110c86738e74400" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 44403 } } peers { permanent_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 38749 } }
I20260709 13:08:31.817489 28377 raft_consensus.cc:515] T b6be829f6d3f40c99a3c5be18b0c259c P 41268b218b804905a110c86738e74400 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18435fbb525741328139e84a1e354954" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 40545 } } peers { permanent_uuid: "2513a663afac495eb09126ff55e8b2b0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40721 } } peers { permanent_uuid: "41268b218b804905a110c86738e74400" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 44403 } }
I20260709 13:08:31.819593 28377 leader_election.cc:290] T b6be829f6d3f40c99a3c5be18b0c259c P 41268b218b804905a110c86738e74400 [CANDIDATE]: Term 2 election: Requested vote from peers 18435fbb525741328139e84a1e354954 (127.17.223.4:40545), 2513a663afac495eb09126ff55e8b2b0 (127.17.223.1:40721)
I20260709 13:08:31.819736 27666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47b65672307641ae81d5f94c639b1a10" candidate_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "41268b218b804905a110c86738e74400" is_pre_election: true
I20260709 13:08:31.824643 27815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6be829f6d3f40c99a3c5be18b0c259c" candidate_uuid: "41268b218b804905a110c86738e74400" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "18435fbb525741328139e84a1e354954"
W20260709 13:08:31.825059 27631 leader_election.cc:336] T b6be829f6d3f40c99a3c5be18b0c259c P 41268b218b804905a110c86738e74400 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 2513a663afac495eb09126ff55e8b2b0 (127.17.223.1:40721): Network error: Client connection negotiation failed: client connection to 127.17.223.1:40721: connect: Connection refused (error 111)
I20260709 13:08:31.826802 27815 raft_consensus.cc:3060] T b6be829f6d3f40c99a3c5be18b0c259c P 18435fbb525741328139e84a1e354954 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:08:31.828600 27705 leader_election.cc:336] T 47b65672307641ae81d5f94c639b1a10 P 665f7e09521a4c3f9284c1d8b0e094ff [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 2513a663afac495eb09126ff55e8b2b0 (127.17.223.1:40721): Network error: Client connection negotiation failed: client connection to 127.17.223.1:40721: connect: Connection refused (error 111)
I20260709 13:08:31.834044 27815 raft_consensus.cc:2468] T b6be829f6d3f40c99a3c5be18b0c259c P 18435fbb525741328139e84a1e354954 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 41268b218b804905a110c86738e74400 in term 2.
I20260709 13:08:31.818423 28381 leader_election.cc:290] T 47b65672307641ae81d5f94c639b1a10 P 665f7e09521a4c3f9284c1d8b0e094ff [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2513a663afac495eb09126ff55e8b2b0 (127.17.223.1:40721), 41268b218b804905a110c86738e74400 (127.17.223.2:44403)
I20260709 13:08:31.836143 27634 leader_election.cc:304] T b6be829f6d3f40c99a3c5be18b0c259c P 41268b218b804905a110c86738e74400 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 18435fbb525741328139e84a1e354954, 41268b218b804905a110c86738e74400; no voters: 2513a663afac495eb09126ff55e8b2b0
I20260709 13:08:31.838248 27708 leader_election.cc:304] T 47b65672307641ae81d5f94c639b1a10 P 665f7e09521a4c3f9284c1d8b0e094ff [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 665f7e09521a4c3f9284c1d8b0e094ff; no voters: 2513a663afac495eb09126ff55e8b2b0, 41268b218b804905a110c86738e74400
I20260709 13:08:31.839087 28381 raft_consensus.cc:2749] T 47b65672307641ae81d5f94c639b1a10 P 665f7e09521a4c3f9284c1d8b0e094ff [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:08:31.839102 28377 raft_consensus.cc:2804] T b6be829f6d3f40c99a3c5be18b0c259c P 41268b218b804905a110c86738e74400 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:08:31.839969 28377 raft_consensus.cc:697] T b6be829f6d3f40c99a3c5be18b0c259c P 41268b218b804905a110c86738e74400 [term 2 LEADER]: Becoming Leader. State: Replica: 41268b218b804905a110c86738e74400, State: Running, Role: LEADER
I20260709 13:08:31.840895 28377 consensus_queue.cc:237] T b6be829f6d3f40c99a3c5be18b0c259c P 41268b218b804905a110c86738e74400 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18435fbb525741328139e84a1e354954" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 40545 } } peers { permanent_uuid: "2513a663afac495eb09126ff55e8b2b0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40721 } } peers { permanent_uuid: "41268b218b804905a110c86738e74400" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 44403 } }
I20260709 13:08:31.854421 27491 catalog_manager.cc:5697] T b6be829f6d3f40c99a3c5be18b0c259c P 41268b218b804905a110c86738e74400 reported cstate change: term changed from 1 to 2, leader changed from 2513a663afac495eb09126ff55e8b2b0 (127.17.223.1) to 41268b218b804905a110c86738e74400 (127.17.223.2). New cstate: current_term: 2 leader_uuid: "41268b218b804905a110c86738e74400" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18435fbb525741328139e84a1e354954" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 40545 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2513a663afac495eb09126ff55e8b2b0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40721 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "41268b218b804905a110c86738e74400" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 44403 } health_report { overall_health: HEALTHY } } }
W20260709 13:08:31.922653 18300 thread.cc:527] Waited for 1000ms trying to join with diag-logger (tid 27614)
I20260709 13:08:31.936131 28377 raft_consensus.cc:493] T 7b77a53b493f4e979fdf38a0b17176b0 P 41268b218b804905a110c86738e74400 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2513a663afac495eb09126ff55e8b2b0)
I20260709 13:08:31.936863 28377 raft_consensus.cc:515] T 7b77a53b493f4e979fdf38a0b17176b0 P 41268b218b804905a110c86738e74400 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2513a663afac495eb09126ff55e8b2b0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40721 } } peers { permanent_uuid: "41268b218b804905a110c86738e74400" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 44403 } } peers { permanent_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 38749 } }
I20260709 13:08:31.939091 28377 leader_election.cc:290] T 7b77a53b493f4e979fdf38a0b17176b0 P 41268b218b804905a110c86738e74400 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2513a663afac495eb09126ff55e8b2b0 (127.17.223.1:40721), 665f7e09521a4c3f9284c1d8b0e094ff (127.17.223.3:38749)
I20260709 13:08:31.940532 27740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b77a53b493f4e979fdf38a0b17176b0" candidate_uuid: "41268b218b804905a110c86738e74400" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" is_pre_election: true
I20260709 13:08:31.941176 27740 raft_consensus.cc:2468] T 7b77a53b493f4e979fdf38a0b17176b0 P 665f7e09521a4c3f9284c1d8b0e094ff [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 41268b218b804905a110c86738e74400 in term 1.
I20260709 13:08:31.942454 27634 leader_election.cc:304] T 7b77a53b493f4e979fdf38a0b17176b0 P 41268b218b804905a110c86738e74400 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 41268b218b804905a110c86738e74400, 665f7e09521a4c3f9284c1d8b0e094ff; no voters: 
I20260709 13:08:31.943333 28377 raft_consensus.cc:2804] T 7b77a53b493f4e979fdf38a0b17176b0 P 41268b218b804905a110c86738e74400 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:08:31.943821 28377 raft_consensus.cc:493] T 7b77a53b493f4e979fdf38a0b17176b0 P 41268b218b804905a110c86738e74400 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 2513a663afac495eb09126ff55e8b2b0)
I20260709 13:08:31.944123 28383 raft_consensus.cc:493] T 2d994cb13f8f453284bcb1f8b85824a2 P 18435fbb525741328139e84a1e354954 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2513a663afac495eb09126ff55e8b2b0)
I20260709 13:08:31.944334 28377 raft_consensus.cc:3060] T 7b77a53b493f4e979fdf38a0b17176b0 P 41268b218b804905a110c86738e74400 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:31.944881 28383 raft_consensus.cc:515] T 2d994cb13f8f453284bcb1f8b85824a2 P 18435fbb525741328139e84a1e354954 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18435fbb525741328139e84a1e354954" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 40545 } } peers { permanent_uuid: "2513a663afac495eb09126ff55e8b2b0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40721 } } peers { permanent_uuid: "41268b218b804905a110c86738e74400" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 44403 } }
I20260709 13:08:31.946823 28383 leader_election.cc:290] T 2d994cb13f8f453284bcb1f8b85824a2 P 18435fbb525741328139e84a1e354954 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2513a663afac495eb09126ff55e8b2b0 (127.17.223.1:40721), 41268b218b804905a110c86738e74400 (127.17.223.2:44403)
W20260709 13:08:31.948377 27631 leader_election.cc:336] T 7b77a53b493f4e979fdf38a0b17176b0 P 41268b218b804905a110c86738e74400 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 2513a663afac495eb09126ff55e8b2b0 (127.17.223.1:40721): Network error: Client connection negotiation failed: client connection to 127.17.223.1:40721: connect: Connection refused (error 111)
I20260709 13:08:31.948272 27666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d994cb13f8f453284bcb1f8b85824a2" candidate_uuid: "18435fbb525741328139e84a1e354954" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "41268b218b804905a110c86738e74400" is_pre_election: true
W20260709 13:08:31.951040 27779 leader_election.cc:336] T 2d994cb13f8f453284bcb1f8b85824a2 P 18435fbb525741328139e84a1e354954 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 2513a663afac495eb09126ff55e8b2b0 (127.17.223.1:40721): Network error: Client connection negotiation failed: client connection to 127.17.223.1:40721: connect: Connection refused (error 111)
I20260709 13:08:31.951197 28383 raft_consensus.cc:493] T ae05961ab7a94458b1ad2cde9785c63b P 18435fbb525741328139e84a1e354954 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2513a663afac495eb09126ff55e8b2b0)
I20260709 13:08:31.951503 27779 leader_election.cc:304] T 2d994cb13f8f453284bcb1f8b85824a2 P 18435fbb525741328139e84a1e354954 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 18435fbb525741328139e84a1e354954; no voters: 2513a663afac495eb09126ff55e8b2b0, 41268b218b804905a110c86738e74400
I20260709 13:08:31.952210 28379 raft_consensus.cc:2749] T 2d994cb13f8f453284bcb1f8b85824a2 P 18435fbb525741328139e84a1e354954 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:08:31.951997 28383 raft_consensus.cc:515] T ae05961ab7a94458b1ad2cde9785c63b P 18435fbb525741328139e84a1e354954 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 38749 } } peers { permanent_uuid: "18435fbb525741328139e84a1e354954" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 40545 } } peers { permanent_uuid: "2513a663afac495eb09126ff55e8b2b0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40721 } }
I20260709 13:08:31.954998 28377 raft_consensus.cc:515] T 7b77a53b493f4e979fdf38a0b17176b0 P 41268b218b804905a110c86738e74400 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2513a663afac495eb09126ff55e8b2b0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40721 } } peers { permanent_uuid: "41268b218b804905a110c86738e74400" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 44403 } } peers { permanent_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 38749 } }
I20260709 13:08:31.955524 28383 leader_election.cc:290] T ae05961ab7a94458b1ad2cde9785c63b P 18435fbb525741328139e84a1e354954 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 665f7e09521a4c3f9284c1d8b0e094ff (127.17.223.3:38749), 2513a663afac495eb09126ff55e8b2b0 (127.17.223.1:40721)
I20260709 13:08:31.957616 28377 leader_election.cc:290] T 7b77a53b493f4e979fdf38a0b17176b0 P 41268b218b804905a110c86738e74400 [CANDIDATE]: Term 2 election: Requested vote from peers 2513a663afac495eb09126ff55e8b2b0 (127.17.223.1:40721), 665f7e09521a4c3f9284c1d8b0e094ff (127.17.223.3:38749)
I20260709 13:08:31.958165 27740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b77a53b493f4e979fdf38a0b17176b0" candidate_uuid: "41268b218b804905a110c86738e74400" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "665f7e09521a4c3f9284c1d8b0e094ff"
I20260709 13:08:31.958761 27740 raft_consensus.cc:3060] T 7b77a53b493f4e979fdf38a0b17176b0 P 665f7e09521a4c3f9284c1d8b0e094ff [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:31.961735 27742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae05961ab7a94458b1ad2cde9785c63b" candidate_uuid: "18435fbb525741328139e84a1e354954" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" is_pre_election: true
I20260709 13:08:31.962437 27742 raft_consensus.cc:2468] T ae05961ab7a94458b1ad2cde9785c63b P 665f7e09521a4c3f9284c1d8b0e094ff [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 18435fbb525741328139e84a1e354954 in term 1.
I20260709 13:08:31.964020 27782 leader_election.cc:304] T ae05961ab7a94458b1ad2cde9785c63b P 18435fbb525741328139e84a1e354954 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 18435fbb525741328139e84a1e354954, 665f7e09521a4c3f9284c1d8b0e094ff; no voters: 
I20260709 13:08:31.965566 28377 raft_consensus.cc:493] T 3a7da70e9f0f49a9bf60184a8f0b5339 P 41268b218b804905a110c86738e74400 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2513a663afac495eb09126ff55e8b2b0)
I20260709 13:08:31.966080 28377 raft_consensus.cc:515] T 3a7da70e9f0f49a9bf60184a8f0b5339 P 41268b218b804905a110c86738e74400 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18435fbb525741328139e84a1e354954" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 40545 } } peers { permanent_uuid: "2513a663afac495eb09126ff55e8b2b0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40721 } } peers { permanent_uuid: "41268b218b804905a110c86738e74400" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 44403 } }
I20260709 13:08:31.966391 27740 raft_consensus.cc:2468] T 7b77a53b493f4e979fdf38a0b17176b0 P 665f7e09521a4c3f9284c1d8b0e094ff [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 41268b218b804905a110c86738e74400 in term 2.
W20260709 13:08:31.967301 27779 leader_election.cc:336] T ae05961ab7a94458b1ad2cde9785c63b P 18435fbb525741328139e84a1e354954 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 2513a663afac495eb09126ff55e8b2b0 (127.17.223.1:40721): Network error: Client connection negotiation failed: client connection to 127.17.223.1:40721: connect: Connection refused (error 111)
I20260709 13:08:31.967402 27634 leader_election.cc:304] T 7b77a53b493f4e979fdf38a0b17176b0 P 41268b218b804905a110c86738e74400 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 41268b218b804905a110c86738e74400, 665f7e09521a4c3f9284c1d8b0e094ff; no voters: 
I20260709 13:08:31.968683 28280 raft_consensus.cc:2804] T 7b77a53b493f4e979fdf38a0b17176b0 P 41268b218b804905a110c86738e74400 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:08:31.968997 28377 leader_election.cc:290] T 3a7da70e9f0f49a9bf60184a8f0b5339 P 41268b218b804905a110c86738e74400 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 18435fbb525741328139e84a1e354954 (127.17.223.4:40545), 2513a663afac495eb09126ff55e8b2b0 (127.17.223.1:40721)
I20260709 13:08:31.969095 28280 raft_consensus.cc:697] T 7b77a53b493f4e979fdf38a0b17176b0 P 41268b218b804905a110c86738e74400 [term 2 LEADER]: Becoming Leader. State: Replica: 41268b218b804905a110c86738e74400, State: Running, Role: LEADER
I20260709 13:08:31.969996 28280 consensus_queue.cc:237] T 7b77a53b493f4e979fdf38a0b17176b0 P 41268b218b804905a110c86738e74400 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2513a663afac495eb09126ff55e8b2b0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40721 } } peers { permanent_uuid: "41268b218b804905a110c86738e74400" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 44403 } } peers { permanent_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 38749 } }
I20260709 13:08:31.971530 27815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a7da70e9f0f49a9bf60184a8f0b5339" candidate_uuid: "41268b218b804905a110c86738e74400" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "18435fbb525741328139e84a1e354954" is_pre_election: true
I20260709 13:08:31.972047 28395 raft_consensus.cc:493] T 18f991bbbf3a4615aab49899c7ef86dc P 18435fbb525741328139e84a1e354954 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2513a663afac495eb09126ff55e8b2b0)
I20260709 13:08:31.971396 28379 raft_consensus.cc:2804] T ae05961ab7a94458b1ad2cde9785c63b P 18435fbb525741328139e84a1e354954 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:08:31.976558 28379 raft_consensus.cc:493] T ae05961ab7a94458b1ad2cde9785c63b P 18435fbb525741328139e84a1e354954 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 2513a663afac495eb09126ff55e8b2b0)
I20260709 13:08:31.976979 28379 raft_consensus.cc:3060] T ae05961ab7a94458b1ad2cde9785c63b P 18435fbb525741328139e84a1e354954 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:31.976714 28395 raft_consensus.cc:515] T 18f991bbbf3a4615aab49899c7ef86dc P 18435fbb525741328139e84a1e354954 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2513a663afac495eb09126ff55e8b2b0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40721 } } peers { permanent_uuid: "18435fbb525741328139e84a1e354954" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 40545 } } peers { permanent_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 38749 } }
I20260709 13:08:31.977180 28377 raft_consensus.cc:493] T 47b65672307641ae81d5f94c639b1a10 P 41268b218b804905a110c86738e74400 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2513a663afac495eb09126ff55e8b2b0)
I20260709 13:08:31.977823 28377 raft_consensus.cc:515] T 47b65672307641ae81d5f94c639b1a10 P 41268b218b804905a110c86738e74400 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2513a663afac495eb09126ff55e8b2b0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40721 } } peers { permanent_uuid: "41268b218b804905a110c86738e74400" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 44403 } } peers { permanent_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 38749 } }
W20260709 13:08:31.978513 27631 leader_election.cc:336] T 7b77a53b493f4e979fdf38a0b17176b0 P 41268b218b804905a110c86738e74400 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 2513a663afac495eb09126ff55e8b2b0 (127.17.223.1:40721): Network error: Client connection negotiation failed: client connection to 127.17.223.1:40721: connect: Connection refused (error 111)
I20260709 13:08:31.979952 28377 leader_election.cc:290] T 47b65672307641ae81d5f94c639b1a10 P 41268b218b804905a110c86738e74400 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2513a663afac495eb09126ff55e8b2b0 (127.17.223.1:40721), 665f7e09521a4c3f9284c1d8b0e094ff (127.17.223.3:38749)
W20260709 13:08:31.981045 27631 leader_election.cc:336] T 3a7da70e9f0f49a9bf60184a8f0b5339 P 41268b218b804905a110c86738e74400 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 2513a663afac495eb09126ff55e8b2b0 (127.17.223.1:40721): Network error: Client connection negotiation failed: client connection to 127.17.223.1:40721: connect: Connection refused (error 111)
I20260709 13:08:31.981544 27631 leader_election.cc:304] T 3a7da70e9f0f49a9bf60184a8f0b5339 P 41268b218b804905a110c86738e74400 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 41268b218b804905a110c86738e74400; no voters: 18435fbb525741328139e84a1e354954, 2513a663afac495eb09126ff55e8b2b0
I20260709 13:08:31.982285 28377 raft_consensus.cc:2749] T 3a7da70e9f0f49a9bf60184a8f0b5339 P 41268b218b804905a110c86738e74400 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:08:31.984437 27740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47b65672307641ae81d5f94c639b1a10" candidate_uuid: "41268b218b804905a110c86738e74400" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" is_pre_election: true
I20260709 13:08:31.985035 27740 raft_consensus.cc:2468] T 47b65672307641ae81d5f94c639b1a10 P 665f7e09521a4c3f9284c1d8b0e094ff [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 41268b218b804905a110c86738e74400 in term 1.
I20260709 13:08:31.986114 27634 leader_election.cc:304] T 47b65672307641ae81d5f94c639b1a10 P 41268b218b804905a110c86738e74400 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 41268b218b804905a110c86738e74400, 665f7e09521a4c3f9284c1d8b0e094ff; no voters: 
I20260709 13:08:31.989365 28395 leader_election.cc:290] T 18f991bbbf3a4615aab49899c7ef86dc P 18435fbb525741328139e84a1e354954 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2513a663afac495eb09126ff55e8b2b0 (127.17.223.1:40721), 665f7e09521a4c3f9284c1d8b0e094ff (127.17.223.3:38749)
I20260709 13:08:31.990298 27740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18f991bbbf3a4615aab49899c7ef86dc" candidate_uuid: "18435fbb525741328139e84a1e354954" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" is_pre_election: true
I20260709 13:08:31.990991 28381 raft_consensus.cc:493] T 80e2477670ec4db18ad338931d714544 P 665f7e09521a4c3f9284c1d8b0e094ff [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2513a663afac495eb09126ff55e8b2b0)
I20260709 13:08:31.991379 28396 raft_consensus.cc:2804] T 47b65672307641ae81d5f94c639b1a10 P 41268b218b804905a110c86738e74400 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:08:31.991858 28396 raft_consensus.cc:493] T 47b65672307641ae81d5f94c639b1a10 P 41268b218b804905a110c86738e74400 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 2513a663afac495eb09126ff55e8b2b0)
I20260709 13:08:31.991591 28381 raft_consensus.cc:515] T 80e2477670ec4db18ad338931d714544 P 665f7e09521a4c3f9284c1d8b0e094ff [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 38749 } } peers { permanent_uuid: "18435fbb525741328139e84a1e354954" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 40545 } } peers { permanent_uuid: "2513a663afac495eb09126ff55e8b2b0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40721 } }
I20260709 13:08:31.992245 28396 raft_consensus.cc:3060] T 47b65672307641ae81d5f94c639b1a10 P 41268b218b804905a110c86738e74400 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:31.993777 28381 leader_election.cc:290] T 80e2477670ec4db18ad338931d714544 P 665f7e09521a4c3f9284c1d8b0e094ff [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 18435fbb525741328139e84a1e354954 (127.17.223.4:40545), 2513a663afac495eb09126ff55e8b2b0 (127.17.223.1:40721)
I20260709 13:08:31.995010 27740 raft_consensus.cc:2468] T 18f991bbbf3a4615aab49899c7ef86dc P 665f7e09521a4c3f9284c1d8b0e094ff [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 18435fbb525741328139e84a1e354954 in term 1.
I20260709 13:08:31.995491 28331 raft_consensus.cc:493] T 18f991bbbf3a4615aab49899c7ef86dc P 665f7e09521a4c3f9284c1d8b0e094ff [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2513a663afac495eb09126ff55e8b2b0)
I20260709 13:08:31.995913 28331 raft_consensus.cc:515] T 18f991bbbf3a4615aab49899c7ef86dc P 665f7e09521a4c3f9284c1d8b0e094ff [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2513a663afac495eb09126ff55e8b2b0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40721 } } peers { permanent_uuid: "18435fbb525741328139e84a1e354954" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 40545 } } peers { permanent_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 38749 } }
I20260709 13:08:31.998463 28379 raft_consensus.cc:515] T ae05961ab7a94458b1ad2cde9785c63b P 18435fbb525741328139e84a1e354954 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 38749 } } peers { permanent_uuid: "18435fbb525741328139e84a1e354954" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 40545 } } peers { permanent_uuid: "2513a663afac495eb09126ff55e8b2b0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40721 } }
I20260709 13:08:31.999383 28331 leader_election.cc:290] T 18f991bbbf3a4615aab49899c7ef86dc P 665f7e09521a4c3f9284c1d8b0e094ff [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2513a663afac495eb09126ff55e8b2b0 (127.17.223.1:40721), 18435fbb525741328139e84a1e354954 (127.17.223.4:40545)
I20260709 13:08:32.000320 28396 raft_consensus.cc:515] T 47b65672307641ae81d5f94c639b1a10 P 41268b218b804905a110c86738e74400 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2513a663afac495eb09126ff55e8b2b0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40721 } } peers { permanent_uuid: "41268b218b804905a110c86738e74400" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 44403 } } peers { permanent_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 38749 } }
I20260709 13:08:32.000589 28377 raft_consensus.cc:493] T 86af954f570648969cbc47c03d15c447 P 41268b218b804905a110c86738e74400 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2513a663afac495eb09126ff55e8b2b0)
I20260709 13:08:32.001721 27815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80e2477670ec4db18ad338931d714544" candidate_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "18435fbb525741328139e84a1e354954" is_pre_election: true
I20260709 13:08:32.002043 28383 raft_consensus.cc:493] T 86af954f570648969cbc47c03d15c447 P 18435fbb525741328139e84a1e354954 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2513a663afac495eb09126ff55e8b2b0)
I20260709 13:08:32.001745 28377 raft_consensus.cc:515] T 86af954f570648969cbc47c03d15c447 P 41268b218b804905a110c86738e74400 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18435fbb525741328139e84a1e354954" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 40545 } } peers { permanent_uuid: "2513a663afac495eb09126ff55e8b2b0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40721 } } peers { permanent_uuid: "41268b218b804905a110c86738e74400" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 44403 } }
I20260709 13:08:32.003153 28396 leader_election.cc:290] T 47b65672307641ae81d5f94c639b1a10 P 41268b218b804905a110c86738e74400 [CANDIDATE]: Term 2 election: Requested vote from peers 2513a663afac495eb09126ff55e8b2b0 (127.17.223.1:40721), 665f7e09521a4c3f9284c1d8b0e094ff (127.17.223.3:38749)
I20260709 13:08:32.004643 28396 raft_consensus.cc:493] T 456941807b254f5fb32dca4f84bd16ea P 41268b218b804905a110c86738e74400 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2513a663afac495eb09126ff55e8b2b0)
W20260709 13:08:32.004768 27705 leader_election.cc:336] T 80e2477670ec4db18ad338931d714544 P 665f7e09521a4c3f9284c1d8b0e094ff [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 2513a663afac495eb09126ff55e8b2b0 (127.17.223.1:40721): Network error: Client connection negotiation failed: client connection to 127.17.223.1:40721: connect: Connection refused (error 111)
I20260709 13:08:32.005182 28396 raft_consensus.cc:515] T 456941807b254f5fb32dca4f84bd16ea P 41268b218b804905a110c86738e74400 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2513a663afac495eb09126ff55e8b2b0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40721 } } peers { permanent_uuid: "41268b218b804905a110c86738e74400" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 44403 } } peers { permanent_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 38749 } }
I20260709 13:08:32.002619 28383 raft_consensus.cc:515] T 86af954f570648969cbc47c03d15c447 P 18435fbb525741328139e84a1e354954 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18435fbb525741328139e84a1e354954" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 40545 } } peers { permanent_uuid: "2513a663afac495eb09126ff55e8b2b0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40721 } } peers { permanent_uuid: "41268b218b804905a110c86738e74400" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 44403 } }
I20260709 13:08:32.007648 28383 leader_election.cc:290] T 86af954f570648969cbc47c03d15c447 P 18435fbb525741328139e84a1e354954 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2513a663afac495eb09126ff55e8b2b0 (127.17.223.1:40721), 41268b218b804905a110c86738e74400 (127.17.223.2:44403)
I20260709 13:08:32.007962 27815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86af954f570648969cbc47c03d15c447" candidate_uuid: "41268b218b804905a110c86738e74400" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "18435fbb525741328139e84a1e354954" is_pre_election: true
I20260709 13:08:32.007642 28396 leader_election.cc:290] T 456941807b254f5fb32dca4f84bd16ea P 41268b218b804905a110c86738e74400 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2513a663afac495eb09126ff55e8b2b0 (127.17.223.1:40721), 665f7e09521a4c3f9284c1d8b0e094ff (127.17.223.3:38749)
I20260709 13:08:32.008637 27815 raft_consensus.cc:2468] T 86af954f570648969cbc47c03d15c447 P 18435fbb525741328139e84a1e354954 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 41268b218b804905a110c86738e74400 in term 1.
I20260709 13:08:32.009709 27634 leader_election.cc:304] T 86af954f570648969cbc47c03d15c447 P 41268b218b804905a110c86738e74400 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 18435fbb525741328139e84a1e354954, 41268b218b804905a110c86738e74400; no voters: 
I20260709 13:08:32.010485 28396 raft_consensus.cc:2804] T 86af954f570648969cbc47c03d15c447 P 41268b218b804905a110c86738e74400 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:08:32.010898 28396 raft_consensus.cc:493] T 86af954f570648969cbc47c03d15c447 P 41268b218b804905a110c86738e74400 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 2513a663afac495eb09126ff55e8b2b0)
I20260709 13:08:32.011263 28396 raft_consensus.cc:3060] T 86af954f570648969cbc47c03d15c447 P 41268b218b804905a110c86738e74400 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:32.014516 27815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18f991bbbf3a4615aab49899c7ef86dc" candidate_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "18435fbb525741328139e84a1e354954" is_pre_election: true
I20260709 13:08:32.015364 27815 raft_consensus.cc:2468] T 18f991bbbf3a4615aab49899c7ef86dc P 18435fbb525741328139e84a1e354954 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 665f7e09521a4c3f9284c1d8b0e094ff in term 1.
I20260709 13:08:32.015920 28383 raft_consensus.cc:493] T 2d68b1be563949efbcb4bbe71eddd0d8 P 18435fbb525741328139e84a1e354954 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2513a663afac495eb09126ff55e8b2b0)
I20260709 13:08:32.016546 28383 raft_consensus.cc:515] T 2d68b1be563949efbcb4bbe71eddd0d8 P 18435fbb525741328139e84a1e354954 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 38749 } } peers { permanent_uuid: "18435fbb525741328139e84a1e354954" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 40545 } } peers { permanent_uuid: "2513a663afac495eb09126ff55e8b2b0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40721 } }
I20260709 13:08:32.017174 27782 leader_election.cc:304] T 18f991bbbf3a4615aab49899c7ef86dc P 18435fbb525741328139e84a1e354954 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 18435fbb525741328139e84a1e354954, 665f7e09521a4c3f9284c1d8b0e094ff; no voters: 
W20260709 13:08:32.017627 27705 leader_election.cc:336] T 18f991bbbf3a4615aab49899c7ef86dc P 665f7e09521a4c3f9284c1d8b0e094ff [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 2513a663afac495eb09126ff55e8b2b0 (127.17.223.1:40721): Network error: Client connection negotiation failed: client connection to 127.17.223.1:40721: connect: Connection refused (error 111)
I20260709 13:08:32.018606 28383 leader_election.cc:290] T 2d68b1be563949efbcb4bbe71eddd0d8 P 18435fbb525741328139e84a1e354954 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 665f7e09521a4c3f9284c1d8b0e094ff (127.17.223.3:38749), 2513a663afac495eb09126ff55e8b2b0 (127.17.223.1:40721)
I20260709 13:08:32.020282 27666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86af954f570648969cbc47c03d15c447" candidate_uuid: "18435fbb525741328139e84a1e354954" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "41268b218b804905a110c86738e74400" is_pre_election: true
I20260709 13:08:32.015980 28379 leader_election.cc:290] T ae05961ab7a94458b1ad2cde9785c63b P 18435fbb525741328139e84a1e354954 [CANDIDATE]: Term 2 election: Requested vote from peers 665f7e09521a4c3f9284c1d8b0e094ff (127.17.223.3:38749), 2513a663afac495eb09126ff55e8b2b0 (127.17.223.1:40721)
I20260709 13:08:32.019260 28383 raft_consensus.cc:2804] T 18f991bbbf3a4615aab49899c7ef86dc P 18435fbb525741328139e84a1e354954 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:08:32.021946 28383 raft_consensus.cc:493] T 18f991bbbf3a4615aab49899c7ef86dc P 18435fbb525741328139e84a1e354954 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 2513a663afac495eb09126ff55e8b2b0)
I20260709 13:08:32.022333 28383 raft_consensus.cc:3060] T 18f991bbbf3a4615aab49899c7ef86dc P 18435fbb525741328139e84a1e354954 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:32.023706 27491 catalog_manager.cc:5697] T 7b77a53b493f4e979fdf38a0b17176b0 P 41268b218b804905a110c86738e74400 reported cstate change: term changed from 1 to 2, leader changed from 2513a663afac495eb09126ff55e8b2b0 (127.17.223.1) to 41268b218b804905a110c86738e74400 (127.17.223.2). New cstate: current_term: 2 leader_uuid: "41268b218b804905a110c86738e74400" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2513a663afac495eb09126ff55e8b2b0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40721 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "41268b218b804905a110c86738e74400" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 44403 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 38749 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:32.019245 27740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae05961ab7a94458b1ad2cde9785c63b" candidate_uuid: "18435fbb525741328139e84a1e354954" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "665f7e09521a4c3f9284c1d8b0e094ff"
I20260709 13:08:32.027740 27742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d68b1be563949efbcb4bbe71eddd0d8" candidate_uuid: "18435fbb525741328139e84a1e354954" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" is_pre_election: true
I20260709 13:08:32.027884 27740 raft_consensus.cc:3060] T ae05961ab7a94458b1ad2cde9785c63b P 665f7e09521a4c3f9284c1d8b0e094ff [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:32.030917 28377 leader_election.cc:290] T 86af954f570648969cbc47c03d15c447 P 41268b218b804905a110c86738e74400 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 18435fbb525741328139e84a1e354954 (127.17.223.4:40545), 2513a663afac495eb09126ff55e8b2b0 (127.17.223.1:40721)
W20260709 13:08:32.030920 27631 leader_election.cc:336] T 47b65672307641ae81d5f94c639b1a10 P 41268b218b804905a110c86738e74400 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 2513a663afac495eb09126ff55e8b2b0 (127.17.223.1:40721): Network error: Client connection negotiation failed: client connection to 127.17.223.1:40721: connect: Connection refused (error 111)
I20260709 13:08:32.032871 27708 leader_election.cc:304] T 80e2477670ec4db18ad338931d714544 P 665f7e09521a4c3f9284c1d8b0e094ff [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 665f7e09521a4c3f9284c1d8b0e094ff; no voters: 18435fbb525741328139e84a1e354954, 2513a663afac495eb09126ff55e8b2b0
I20260709 13:08:32.034376 28331 raft_consensus.cc:2749] T 80e2477670ec4db18ad338931d714544 P 665f7e09521a4c3f9284c1d8b0e094ff [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:08:32.034825 27708 leader_election.cc:304] T 18f991bbbf3a4615aab49899c7ef86dc P 665f7e09521a4c3f9284c1d8b0e094ff [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 18435fbb525741328139e84a1e354954, 665f7e09521a4c3f9284c1d8b0e094ff; no voters: 2513a663afac495eb09126ff55e8b2b0
I20260709 13:08:32.037155 27738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47b65672307641ae81d5f94c639b1a10" candidate_uuid: "41268b218b804905a110c86738e74400" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "665f7e09521a4c3f9284c1d8b0e094ff"
I20260709 13:08:32.037722 27738 raft_consensus.cc:3060] T 47b65672307641ae81d5f94c639b1a10 P 665f7e09521a4c3f9284c1d8b0e094ff [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:32.030697 28383 raft_consensus.cc:515] T 18f991bbbf3a4615aab49899c7ef86dc P 18435fbb525741328139e84a1e354954 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2513a663afac495eb09126ff55e8b2b0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40721 } } peers { permanent_uuid: "18435fbb525741328139e84a1e354954" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 40545 } } peers { permanent_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 38749 } }
I20260709 13:08:32.037823 28396 raft_consensus.cc:515] T 86af954f570648969cbc47c03d15c447 P 41268b218b804905a110c86738e74400 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18435fbb525741328139e84a1e354954" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 40545 } } peers { permanent_uuid: "2513a663afac495eb09126ff55e8b2b0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40721 } } peers { permanent_uuid: "41268b218b804905a110c86738e74400" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 44403 } }
I20260709 13:08:32.040318 27666 raft_consensus.cc:2393] T 86af954f570648969cbc47c03d15c447 P 41268b218b804905a110c86738e74400 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 18435fbb525741328139e84a1e354954 in current term 2: Already voted for candidate 41268b218b804905a110c86738e74400 in this term.
I20260709 13:08:32.042865 28381 raft_consensus.cc:2804] T 18f991bbbf3a4615aab49899c7ef86dc P 665f7e09521a4c3f9284c1d8b0e094ff [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:08:32.043344 28381 raft_consensus.cc:493] T 18f991bbbf3a4615aab49899c7ef86dc P 665f7e09521a4c3f9284c1d8b0e094ff [term 1 FOLLOWER]: Starting leader election (detected failure of leader 2513a663afac495eb09126ff55e8b2b0)
I20260709 13:08:32.043767 28381 raft_consensus.cc:3060] T 18f991bbbf3a4615aab49899c7ef86dc P 665f7e09521a4c3f9284c1d8b0e094ff [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:32.045539 28383 leader_election.cc:290] T 18f991bbbf3a4615aab49899c7ef86dc P 18435fbb525741328139e84a1e354954 [CANDIDATE]: Term 2 election: Requested vote from peers 2513a663afac495eb09126ff55e8b2b0 (127.17.223.1:40721), 665f7e09521a4c3f9284c1d8b0e094ff (127.17.223.3:38749)
I20260709 13:08:32.046566 28396 leader_election.cc:290] T 86af954f570648969cbc47c03d15c447 P 41268b218b804905a110c86738e74400 [CANDIDATE]: Term 2 election: Requested vote from peers 18435fbb525741328139e84a1e354954 (127.17.223.4:40545), 2513a663afac495eb09126ff55e8b2b0 (127.17.223.1:40721)
I20260709 13:08:32.047883 27815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86af954f570648969cbc47c03d15c447" candidate_uuid: "41268b218b804905a110c86738e74400" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "18435fbb525741328139e84a1e354954"
I20260709 13:08:32.048483 27815 raft_consensus.cc:3060] T 86af954f570648969cbc47c03d15c447 P 18435fbb525741328139e84a1e354954 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:32.050590 28389 raft_consensus.cc:493] T 2d68b1be563949efbcb4bbe71eddd0d8 P 665f7e09521a4c3f9284c1d8b0e094ff [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2513a663afac495eb09126ff55e8b2b0)
I20260709 13:08:32.051199 28389 raft_consensus.cc:515] T 2d68b1be563949efbcb4bbe71eddd0d8 P 665f7e09521a4c3f9284c1d8b0e094ff [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 38749 } } peers { permanent_uuid: "18435fbb525741328139e84a1e354954" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 40545 } } peers { permanent_uuid: "2513a663afac495eb09126ff55e8b2b0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40721 } }
I20260709 13:08:32.052456 27741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18f991bbbf3a4615aab49899c7ef86dc" candidate_uuid: "18435fbb525741328139e84a1e354954" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "665f7e09521a4c3f9284c1d8b0e094ff"
I20260709 13:08:32.053447 28389 leader_election.cc:290] T 2d68b1be563949efbcb4bbe71eddd0d8 P 665f7e09521a4c3f9284c1d8b0e094ff [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 18435fbb525741328139e84a1e354954 (127.17.223.4:40545), 2513a663afac495eb09126ff55e8b2b0 (127.17.223.1:40721)
I20260709 13:08:32.056949 27738 raft_consensus.cc:2468] T 47b65672307641ae81d5f94c639b1a10 P 665f7e09521a4c3f9284c1d8b0e094ff [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 41268b218b804905a110c86738e74400 in term 2.
I20260709 13:08:32.057433 27815 raft_consensus.cc:2468] T 86af954f570648969cbc47c03d15c447 P 18435fbb525741328139e84a1e354954 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 41268b218b804905a110c86738e74400 in term 2.
I20260709 13:08:32.058429 27634 leader_election.cc:304] T 86af954f570648969cbc47c03d15c447 P 41268b218b804905a110c86738e74400 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 18435fbb525741328139e84a1e354954, 41268b218b804905a110c86738e74400; no voters: 
I20260709 13:08:32.059401 28396 raft_consensus.cc:2804] T 86af954f570648969cbc47c03d15c447 P 41268b218b804905a110c86738e74400 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:08:32.060585 28396 raft_consensus.cc:697] T 86af954f570648969cbc47c03d15c447 P 41268b218b804905a110c86738e74400 [term 2 LEADER]: Becoming Leader. State: Replica: 41268b218b804905a110c86738e74400, State: Running, Role: LEADER
I20260709 13:08:32.061578 28396 consensus_queue.cc:237] T 86af954f570648969cbc47c03d15c447 P 41268b218b804905a110c86738e74400 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18435fbb525741328139e84a1e354954" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 40545 } } peers { permanent_uuid: "2513a663afac495eb09126ff55e8b2b0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40721 } } peers { permanent_uuid: "41268b218b804905a110c86738e74400" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 44403 } }
I20260709 13:08:32.064100 27737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "456941807b254f5fb32dca4f84bd16ea" candidate_uuid: "41268b218b804905a110c86738e74400" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" is_pre_election: true
W20260709 13:08:32.065083 27705 leader_election.cc:336] T 2d68b1be563949efbcb4bbe71eddd0d8 P 665f7e09521a4c3f9284c1d8b0e094ff [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 2513a663afac495eb09126ff55e8b2b0 (127.17.223.1:40721): Network error: Client connection negotiation failed: client connection to 127.17.223.1:40721: connect: Connection refused (error 111)
I20260709 13:08:32.067456 28280 raft_consensus.cc:493] T bc0b10615ecb4485a9a9de298938697d P 41268b218b804905a110c86738e74400 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2513a663afac495eb09126ff55e8b2b0)
I20260709 13:08:32.067936 28280 raft_consensus.cc:515] T bc0b10615ecb4485a9a9de298938697d P 41268b218b804905a110c86738e74400 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18435fbb525741328139e84a1e354954" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 40545 } } peers { permanent_uuid: "2513a663afac495eb09126ff55e8b2b0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40721 } } peers { permanent_uuid: "41268b218b804905a110c86738e74400" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 44403 } }
I20260709 13:08:32.070494 27634 leader_election.cc:304] T 47b65672307641ae81d5f94c639b1a10 P 41268b218b804905a110c86738e74400 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 41268b218b804905a110c86738e74400, 665f7e09521a4c3f9284c1d8b0e094ff; no voters: 
I20260709 13:08:32.071161 28383 raft_consensus.cc:493] T 80e2477670ec4db18ad338931d714544 P 18435fbb525741328139e84a1e354954 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2513a663afac495eb09126ff55e8b2b0)
I20260709 13:08:32.071483 28377 raft_consensus.cc:2804] T 47b65672307641ae81d5f94c639b1a10 P 41268b218b804905a110c86738e74400 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:08:32.071868 28383 raft_consensus.cc:515] T 80e2477670ec4db18ad338931d714544 P 18435fbb525741328139e84a1e354954 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 38749 } } peers { permanent_uuid: "18435fbb525741328139e84a1e354954" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 40545 } } peers { permanent_uuid: "2513a663afac495eb09126ff55e8b2b0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40721 } }
I20260709 13:08:32.072988 27813 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc0b10615ecb4485a9a9de298938697d" candidate_uuid: "41268b218b804905a110c86738e74400" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "18435fbb525741328139e84a1e354954" is_pre_election: true
I20260709 13:08:32.074497 28331 raft_consensus.cc:493] T 64490a86db8c4f5ca54f4f8085f41319 P 665f7e09521a4c3f9284c1d8b0e094ff [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2513a663afac495eb09126ff55e8b2b0)
I20260709 13:08:32.075063 28331 raft_consensus.cc:515] T 64490a86db8c4f5ca54f4f8085f41319 P 665f7e09521a4c3f9284c1d8b0e094ff [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 38749 } } peers { permanent_uuid: "18435fbb525741328139e84a1e354954" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 40545 } } peers { permanent_uuid: "2513a663afac495eb09126ff55e8b2b0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40721 } }
I20260709 13:08:32.075632 27740 raft_consensus.cc:2468] T ae05961ab7a94458b1ad2cde9785c63b P 665f7e09521a4c3f9284c1d8b0e094ff [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 18435fbb525741328139e84a1e354954 in term 2.
I20260709 13:08:32.076611 27815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d68b1be563949efbcb4bbe71eddd0d8" candidate_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "18435fbb525741328139e84a1e354954" is_pre_election: true
I20260709 13:08:32.077219 27815 raft_consensus.cc:2468] T 2d68b1be563949efbcb4bbe71eddd0d8 P 18435fbb525741328139e84a1e354954 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 665f7e09521a4c3f9284c1d8b0e094ff in term 1.
I20260709 13:08:32.078459 28383 leader_election.cc:290] T 80e2477670ec4db18ad338931d714544 P 18435fbb525741328139e84a1e354954 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 665f7e09521a4c3f9284c1d8b0e094ff (127.17.223.3:38749), 2513a663afac495eb09126ff55e8b2b0 (127.17.223.1:40721)
I20260709 13:08:32.079061 28331 leader_election.cc:290] T 64490a86db8c4f5ca54f4f8085f41319 P 665f7e09521a4c3f9284c1d8b0e094ff [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 18435fbb525741328139e84a1e354954 (127.17.223.4:40545), 2513a663afac495eb09126ff55e8b2b0 (127.17.223.1:40721)
I20260709 13:08:32.080754 27782 leader_election.cc:304] T ae05961ab7a94458b1ad2cde9785c63b P 18435fbb525741328139e84a1e354954 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 18435fbb525741328139e84a1e354954, 665f7e09521a4c3f9284c1d8b0e094ff; no voters: 
I20260709 13:08:32.081866 27708 leader_election.cc:304] T 2d68b1be563949efbcb4bbe71eddd0d8 P 665f7e09521a4c3f9284c1d8b0e094ff [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 18435fbb525741328139e84a1e354954, 665f7e09521a4c3f9284c1d8b0e094ff; no voters: 2513a663afac495eb09126ff55e8b2b0
I20260709 13:08:32.082758 27815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64490a86db8c4f5ca54f4f8085f41319" candidate_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "18435fbb525741328139e84a1e354954" is_pre_election: true
I20260709 13:08:32.082799 28377 raft_consensus.cc:697] T 47b65672307641ae81d5f94c639b1a10 P 41268b218b804905a110c86738e74400 [term 2 LEADER]: Becoming Leader. State: Replica: 41268b218b804905a110c86738e74400, State: Running, Role: LEADER
I20260709 13:08:32.075506 28280 leader_election.cc:290] T bc0b10615ecb4485a9a9de298938697d P 41268b218b804905a110c86738e74400 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 18435fbb525741328139e84a1e354954 (127.17.223.4:40545), 2513a663afac495eb09126ff55e8b2b0 (127.17.223.1:40721)
I20260709 13:08:32.084064 28383 raft_consensus.cc:2804] T ae05961ab7a94458b1ad2cde9785c63b P 18435fbb525741328139e84a1e354954 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:08:32.084009 28377 consensus_queue.cc:237] T 47b65672307641ae81d5f94c639b1a10 P 41268b218b804905a110c86738e74400 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2513a663afac495eb09126ff55e8b2b0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40721 } } peers { permanent_uuid: "41268b218b804905a110c86738e74400" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 44403 } } peers { permanent_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 38749 } }
I20260709 13:08:32.084832 28389 raft_consensus.cc:2804] T 2d68b1be563949efbcb4bbe71eddd0d8 P 665f7e09521a4c3f9284c1d8b0e094ff [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:08:32.085283 28389 raft_consensus.cc:493] T 2d68b1be563949efbcb4bbe71eddd0d8 P 665f7e09521a4c3f9284c1d8b0e094ff [term 1 FOLLOWER]: Starting leader election (detected failure of leader 2513a663afac495eb09126ff55e8b2b0)
I20260709 13:08:32.085662 28389 raft_consensus.cc:3060] T 2d68b1be563949efbcb4bbe71eddd0d8 P 665f7e09521a4c3f9284c1d8b0e094ff [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:32.085863 27740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80e2477670ec4db18ad338931d714544" candidate_uuid: "18435fbb525741328139e84a1e354954" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" is_pre_election: true
I20260709 13:08:32.086562 27740 raft_consensus.cc:2468] T 80e2477670ec4db18ad338931d714544 P 665f7e09521a4c3f9284c1d8b0e094ff [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 18435fbb525741328139e84a1e354954 in term 1.
I20260709 13:08:32.092711 28381 raft_consensus.cc:515] T 18f991bbbf3a4615aab49899c7ef86dc P 665f7e09521a4c3f9284c1d8b0e094ff [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2513a663afac495eb09126ff55e8b2b0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40721 } } peers { permanent_uuid: "18435fbb525741328139e84a1e354954" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 40545 } } peers { permanent_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 38749 } }
I20260709 13:08:32.102898 27741 raft_consensus.cc:2393] T 18f991bbbf3a4615aab49899c7ef86dc P 665f7e09521a4c3f9284c1d8b0e094ff [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 18435fbb525741328139e84a1e354954 in current term 2: Already voted for candidate 665f7e09521a4c3f9284c1d8b0e094ff in this term.
W20260709 13:08:32.094312 27705 leader_election.cc:336] T 64490a86db8c4f5ca54f4f8085f41319 P 665f7e09521a4c3f9284c1d8b0e094ff [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 2513a663afac495eb09126ff55e8b2b0 (127.17.223.1:40721): Network error: Client connection negotiation failed: client connection to 127.17.223.1:40721: connect: Connection refused (error 111)
I20260709 13:08:32.099076 28395 raft_consensus.cc:493] T bc0b10615ecb4485a9a9de298938697d P 18435fbb525741328139e84a1e354954 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2513a663afac495eb09126ff55e8b2b0)
I20260709 13:08:32.104514 28395 raft_consensus.cc:515] T bc0b10615ecb4485a9a9de298938697d P 18435fbb525741328139e84a1e354954 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18435fbb525741328139e84a1e354954" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 40545 } } peers { permanent_uuid: "2513a663afac495eb09126ff55e8b2b0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40721 } } peers { permanent_uuid: "41268b218b804905a110c86738e74400" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 44403 } }
I20260709 13:08:32.107738 28389 raft_consensus.cc:515] T 2d68b1be563949efbcb4bbe71eddd0d8 P 665f7e09521a4c3f9284c1d8b0e094ff [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 38749 } } peers { permanent_uuid: "18435fbb525741328139e84a1e354954" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 40545 } } peers { permanent_uuid: "2513a663afac495eb09126ff55e8b2b0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40721 } }
I20260709 13:08:32.109874 28389 leader_election.cc:290] T 2d68b1be563949efbcb4bbe71eddd0d8 P 665f7e09521a4c3f9284c1d8b0e094ff [CANDIDATE]: Term 2 election: Requested vote from peers 18435fbb525741328139e84a1e354954 (127.17.223.4:40545), 2513a663afac495eb09126ff55e8b2b0 (127.17.223.1:40721)
I20260709 13:08:32.106477 28395 leader_election.cc:290] T bc0b10615ecb4485a9a9de298938697d P 18435fbb525741328139e84a1e354954 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2513a663afac495eb09126ff55e8b2b0 (127.17.223.1:40721), 41268b218b804905a110c86738e74400 (127.17.223.2:44403)
I20260709 13:08:32.112325 27666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc0b10615ecb4485a9a9de298938697d" candidate_uuid: "18435fbb525741328139e84a1e354954" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "41268b218b804905a110c86738e74400" is_pre_election: true
W20260709 13:08:32.101315 27779 leader_election.cc:336] T 18f991bbbf3a4615aab49899c7ef86dc P 18435fbb525741328139e84a1e354954 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 2513a663afac495eb09126ff55e8b2b0 (127.17.223.1:40721): Network error: Client connection negotiation failed: client connection to 127.17.223.1:40721: connect: Connection refused (error 111)
W20260709 13:08:32.115475 27779 leader_election.cc:336] T 86af954f570648969cbc47c03d15c447 P 18435fbb525741328139e84a1e354954 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 2513a663afac495eb09126ff55e8b2b0 (127.17.223.1:40721): Network error: Client connection negotiation failed: client connection to 127.17.223.1:40721: connect: Connection refused (error 111)
I20260709 13:08:32.113020 27666 raft_consensus.cc:2468] T bc0b10615ecb4485a9a9de298938697d P 41268b218b804905a110c86738e74400 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 18435fbb525741328139e84a1e354954 in term 1.
I20260709 13:08:32.122334 27779 leader_election.cc:304] T 86af954f570648969cbc47c03d15c447 P 18435fbb525741328139e84a1e354954 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 18435fbb525741328139e84a1e354954; no voters: 2513a663afac495eb09126ff55e8b2b0, 41268b218b804905a110c86738e74400
I20260709 13:08:32.114969 27491 catalog_manager.cc:5697] T 86af954f570648969cbc47c03d15c447 P 41268b218b804905a110c86738e74400 reported cstate change: term changed from 1 to 2, leader changed from 2513a663afac495eb09126ff55e8b2b0 (127.17.223.1) to 41268b218b804905a110c86738e74400 (127.17.223.2). New cstate: current_term: 2 leader_uuid: "41268b218b804905a110c86738e74400" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18435fbb525741328139e84a1e354954" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 40545 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2513a663afac495eb09126ff55e8b2b0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40721 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "41268b218b804905a110c86738e74400" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 44403 } health_report { overall_health: HEALTHY } } }
I20260709 13:08:32.124809 28379 raft_consensus.cc:2749] T 86af954f570648969cbc47c03d15c447 P 18435fbb525741328139e84a1e354954 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:08:32.101724 28383 raft_consensus.cc:697] T ae05961ab7a94458b1ad2cde9785c63b P 18435fbb525741328139e84a1e354954 [term 2 LEADER]: Becoming Leader. State: Replica: 18435fbb525741328139e84a1e354954, State: Running, Role: LEADER
I20260709 13:08:32.126363 28383 consensus_queue.cc:237] T ae05961ab7a94458b1ad2cde9785c63b P 18435fbb525741328139e84a1e354954 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 38749 } } peers { permanent_uuid: "18435fbb525741328139e84a1e354954" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 40545 } } peers { permanent_uuid: "2513a663afac495eb09126ff55e8b2b0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40721 } }
W20260709 13:08:32.119177 27631 leader_election.cc:336] T 47b65672307641ae81d5f94c639b1a10 P 41268b218b804905a110c86738e74400 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 2513a663afac495eb09126ff55e8b2b0 (127.17.223.1:40721): Network error: Client connection negotiation failed: client connection to 127.17.223.1:40721: connect: Connection refused (error 111)
W20260709 13:08:32.129452 27631 leader_election.cc:336] T 456941807b254f5fb32dca4f84bd16ea P 41268b218b804905a110c86738e74400 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 2513a663afac495eb09126ff55e8b2b0 (127.17.223.1:40721): Network error: Client connection negotiation failed: client connection to 127.17.223.1:40721: connect: Connection refused (error 111)
I20260709 13:08:32.115971 28398 raft_consensus.cc:493] T 2d994cb13f8f453284bcb1f8b85824a2 P 41268b218b804905a110c86738e74400 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2513a663afac495eb09126ff55e8b2b0)
I20260709 13:08:32.129892 27631 leader_election.cc:304] T 456941807b254f5fb32dca4f84bd16ea P 41268b218b804905a110c86738e74400 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 41268b218b804905a110c86738e74400; no voters: 2513a663afac495eb09126ff55e8b2b0, 665f7e09521a4c3f9284c1d8b0e094ff
I20260709 13:08:32.131610 28398 raft_consensus.cc:515] T 2d994cb13f8f453284bcb1f8b85824a2 P 41268b218b804905a110c86738e74400 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18435fbb525741328139e84a1e354954" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 40545 } } peers { permanent_uuid: "2513a663afac495eb09126ff55e8b2b0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40721 } } peers { permanent_uuid: "41268b218b804905a110c86738e74400" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 44403 } }
I20260709 13:08:32.134011 28405 raft_consensus.cc:2749] T 456941807b254f5fb32dca4f84bd16ea P 41268b218b804905a110c86738e74400 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:08:32.135279 27705 leader_election.cc:336] T 2d68b1be563949efbcb4bbe71eddd0d8 P 665f7e09521a4c3f9284c1d8b0e094ff [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 2513a663afac495eb09126ff55e8b2b0 (127.17.223.1:40721): Network error: Client connection negotiation failed: client connection to 127.17.223.1:40721: connect: Connection refused (error 111)
I20260709 13:08:32.113518 27782 leader_election.cc:304] T 80e2477670ec4db18ad338931d714544 P 18435fbb525741328139e84a1e354954 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 18435fbb525741328139e84a1e354954, 665f7e09521a4c3f9284c1d8b0e094ff; no voters: 
I20260709 13:08:32.123440 28381 leader_election.cc:290] T 18f991bbbf3a4615aab49899c7ef86dc P 665f7e09521a4c3f9284c1d8b0e094ff [CANDIDATE]: Term 2 election: Requested vote from peers 2513a663afac495eb09126ff55e8b2b0 (127.17.223.1:40721), 18435fbb525741328139e84a1e354954 (127.17.223.4:40545)
I20260709 13:08:32.137151 28379 raft_consensus.cc:2804] T 80e2477670ec4db18ad338931d714544 P 18435fbb525741328139e84a1e354954 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:08:32.139135 28379 raft_consensus.cc:493] T 80e2477670ec4db18ad338931d714544 P 18435fbb525741328139e84a1e354954 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 2513a663afac495eb09126ff55e8b2b0)
I20260709 13:08:32.139482 28379 raft_consensus.cc:3060] T 80e2477670ec4db18ad338931d714544 P 18435fbb525741328139e84a1e354954 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:32.138224 27782 leader_election.cc:304] T bc0b10615ecb4485a9a9de298938697d P 18435fbb525741328139e84a1e354954 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 18435fbb525741328139e84a1e354954, 41268b218b804905a110c86738e74400; no voters: 
I20260709 13:08:32.118574 27708 leader_election.cc:304] T 64490a86db8c4f5ca54f4f8085f41319 P 665f7e09521a4c3f9284c1d8b0e094ff [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 665f7e09521a4c3f9284c1d8b0e094ff; no voters: 18435fbb525741328139e84a1e354954, 2513a663afac495eb09126ff55e8b2b0
W20260709 13:08:32.143926 27708 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.4:40545, user_credentials={real_user=slave}} blocked reactor thread for 48220.2us
I20260709 13:08:32.145680 28331 raft_consensus.cc:2749] T 64490a86db8c4f5ca54f4f8085f41319 P 665f7e09521a4c3f9284c1d8b0e094ff [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:08:32.149475 28379 raft_consensus.cc:515] T 80e2477670ec4db18ad338931d714544 P 18435fbb525741328139e84a1e354954 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 38749 } } peers { permanent_uuid: "18435fbb525741328139e84a1e354954" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 40545 } } peers { permanent_uuid: "2513a663afac495eb09126ff55e8b2b0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40721 } }
I20260709 13:08:32.123018 28395 raft_consensus.cc:493] T a9eac7f072de454a8ff2beb019da45d9 P 18435fbb525741328139e84a1e354954 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2513a663afac495eb09126ff55e8b2b0)
I20260709 13:08:32.158314 28379 leader_election.cc:290] T 80e2477670ec4db18ad338931d714544 P 18435fbb525741328139e84a1e354954 [CANDIDATE]: Term 2 election: Requested vote from peers 665f7e09521a4c3f9284c1d8b0e094ff (127.17.223.3:38749), 2513a663afac495eb09126ff55e8b2b0 (127.17.223.1:40721)
I20260709 13:08:32.158576 28395 raft_consensus.cc:515] T a9eac7f072de454a8ff2beb019da45d9 P 18435fbb525741328139e84a1e354954 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18435fbb525741328139e84a1e354954" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 40545 } } peers { permanent_uuid: "2513a663afac495eb09126ff55e8b2b0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40721 } } peers { permanent_uuid: "41268b218b804905a110c86738e74400" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 44403 } }
I20260709 13:08:32.168643 28395 leader_election.cc:290] T a9eac7f072de454a8ff2beb019da45d9 P 18435fbb525741328139e84a1e354954 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2513a663afac495eb09126ff55e8b2b0 (127.17.223.1:40721), 41268b218b804905a110c86738e74400 (127.17.223.2:44403)
I20260709 13:08:32.170045 28395 raft_consensus.cc:2804] T bc0b10615ecb4485a9a9de298938697d P 18435fbb525741328139e84a1e354954 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:08:32.169466 27491 catalog_manager.cc:5697] T 47b65672307641ae81d5f94c639b1a10 P 41268b218b804905a110c86738e74400 reported cstate change: term changed from 1 to 2, leader changed from 2513a663afac495eb09126ff55e8b2b0 (127.17.223.1) to 41268b218b804905a110c86738e74400 (127.17.223.2). New cstate: current_term: 2 leader_uuid: "41268b218b804905a110c86738e74400" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2513a663afac495eb09126ff55e8b2b0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40721 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "41268b218b804905a110c86738e74400" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 44403 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 38749 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:32.170449 28395 raft_consensus.cc:493] T bc0b10615ecb4485a9a9de298938697d P 18435fbb525741328139e84a1e354954 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 2513a663afac495eb09126ff55e8b2b0)
I20260709 13:08:32.172973 28395 raft_consensus.cc:3060] T bc0b10615ecb4485a9a9de298938697d P 18435fbb525741328139e84a1e354954 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:32.137027 28398 leader_election.cc:290] T 2d994cb13f8f453284bcb1f8b85824a2 P 41268b218b804905a110c86738e74400 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 18435fbb525741328139e84a1e354954 (127.17.223.4:40545), 2513a663afac495eb09126ff55e8b2b0 (127.17.223.1:40721)
W20260709 13:08:32.160342 27705 leader_election.cc:336] T 18f991bbbf3a4615aab49899c7ef86dc P 665f7e09521a4c3f9284c1d8b0e094ff [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 2513a663afac495eb09126ff55e8b2b0 (127.17.223.1:40721): Network error: Client connection negotiation failed: client connection to 127.17.223.1:40721: connect: Connection refused (error 111)
W20260709 13:08:32.134163 27631 leader_election.cc:336] T 86af954f570648969cbc47c03d15c447 P 41268b218b804905a110c86738e74400 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 2513a663afac495eb09126ff55e8b2b0 (127.17.223.1:40721): Network error: Client connection negotiation failed: client connection to 127.17.223.1:40721: connect: Connection refused (error 111)
W20260709 13:08:32.177896 27631 leader_election.cc:336] T 86af954f570648969cbc47c03d15c447 P 41268b218b804905a110c86738e74400 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 2513a663afac495eb09126ff55e8b2b0 (127.17.223.1:40721): Network error: Client connection negotiation failed: client connection to 127.17.223.1:40721: connect: Connection refused (error 111)
I20260709 13:08:32.182018 27666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9eac7f072de454a8ff2beb019da45d9" candidate_uuid: "18435fbb525741328139e84a1e354954" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "41268b218b804905a110c86738e74400" is_pre_election: true
I20260709 13:08:32.182721 27666 raft_consensus.cc:2468] T a9eac7f072de454a8ff2beb019da45d9 P 41268b218b804905a110c86738e74400 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 18435fbb525741328139e84a1e354954 in term 1.
W20260709 13:08:32.132566 27779 leader_election.cc:336] T ae05961ab7a94458b1ad2cde9785c63b P 18435fbb525741328139e84a1e354954 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 2513a663afac495eb09126ff55e8b2b0 (127.17.223.1:40721): Network error: Client connection negotiation failed: client connection to 127.17.223.1:40721: connect: Connection refused (error 111)
W20260709 13:08:32.183943 27779 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.1:40721, user_credentials={real_user=slave}} blocked reactor thread for 51402.4us
I20260709 13:08:32.184043 27813 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d68b1be563949efbcb4bbe71eddd0d8" candidate_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "18435fbb525741328139e84a1e354954"
W20260709 13:08:32.184432 27779 leader_election.cc:336] T 2d68b1be563949efbcb4bbe71eddd0d8 P 18435fbb525741328139e84a1e354954 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 2513a663afac495eb09126ff55e8b2b0 (127.17.223.1:40721): Network error: Client connection negotiation failed: client connection to 127.17.223.1:40721: connect: Connection refused (error 111)
I20260709 13:08:32.184621 27813 raft_consensus.cc:3060] T 2d68b1be563949efbcb4bbe71eddd0d8 P 18435fbb525741328139e84a1e354954 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:32.184834 27779 leader_election.cc:304] T 2d68b1be563949efbcb4bbe71eddd0d8 P 18435fbb525741328139e84a1e354954 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 18435fbb525741328139e84a1e354954; no voters: 2513a663afac495eb09126ff55e8b2b0, 665f7e09521a4c3f9284c1d8b0e094ff
I20260709 13:08:32.123522 28389 raft_consensus.cc:493] T 11224ef6c00a40cdba4311ceb63bddb9 P 665f7e09521a4c3f9284c1d8b0e094ff [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2513a663afac495eb09126ff55e8b2b0)
I20260709 13:08:32.186930 28389 raft_consensus.cc:515] T 11224ef6c00a40cdba4311ceb63bddb9 P 665f7e09521a4c3f9284c1d8b0e094ff [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 38749 } } peers { permanent_uuid: "18435fbb525741328139e84a1e354954" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 40545 } } peers { permanent_uuid: "2513a663afac495eb09126ff55e8b2b0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40721 } }
I20260709 13:08:32.188028 28400 raft_consensus.cc:493] T 456941807b254f5fb32dca4f84bd16ea P 665f7e09521a4c3f9284c1d8b0e094ff [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2513a663afac495eb09126ff55e8b2b0)
I20260709 13:08:32.188602 28400 raft_consensus.cc:515] T 456941807b254f5fb32dca4f84bd16ea P 665f7e09521a4c3f9284c1d8b0e094ff [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2513a663afac495eb09126ff55e8b2b0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40721 } } peers { permanent_uuid: "41268b218b804905a110c86738e74400" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 44403 } } peers { permanent_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 38749 } }
I20260709 13:08:32.189204 28389 leader_election.cc:290] T 11224ef6c00a40cdba4311ceb63bddb9 P 665f7e09521a4c3f9284c1d8b0e094ff [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 18435fbb525741328139e84a1e354954 (127.17.223.4:40545), 2513a663afac495eb09126ff55e8b2b0 (127.17.223.1:40721)
I20260709 13:08:32.191839 27811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18f991bbbf3a4615aab49899c7ef86dc" candidate_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "18435fbb525741328139e84a1e354954"
I20260709 13:08:32.190814 28400 leader_election.cc:290] T 456941807b254f5fb32dca4f84bd16ea P 665f7e09521a4c3f9284c1d8b0e094ff [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2513a663afac495eb09126ff55e8b2b0 (127.17.223.1:40721), 41268b218b804905a110c86738e74400 (127.17.223.2:44403)
I20260709 13:08:32.192644 27811 raft_consensus.cc:2393] T 18f991bbbf3a4615aab49899c7ef86dc P 18435fbb525741328139e84a1e354954 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 665f7e09521a4c3f9284c1d8b0e094ff in current term 2: Already voted for candidate 18435fbb525741328139e84a1e354954 in this term.
I20260709 13:08:32.194253 27813 raft_consensus.cc:2468] T 2d68b1be563949efbcb4bbe71eddd0d8 P 18435fbb525741328139e84a1e354954 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 665f7e09521a4c3f9284c1d8b0e094ff in term 2.
I20260709 13:08:32.196337 28379 raft_consensus.cc:2749] T 2d68b1be563949efbcb4bbe71eddd0d8 P 18435fbb525741328139e84a1e354954 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:08:32.197203 27631 leader_election.cc:336] T bc0b10615ecb4485a9a9de298938697d P 41268b218b804905a110c86738e74400 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 2513a663afac495eb09126ff55e8b2b0 (127.17.223.1:40721): Network error: Client connection negotiation failed: client connection to 127.17.223.1:40721: connect: Connection refused (error 111)
I20260709 13:08:32.197665 27631 leader_election.cc:304] T bc0b10615ecb4485a9a9de298938697d P 41268b218b804905a110c86738e74400 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 41268b218b804905a110c86738e74400; no voters: 18435fbb525741328139e84a1e354954, 2513a663afac495eb09126ff55e8b2b0
I20260709 13:08:32.199441 28405 raft_consensus.cc:2749] T bc0b10615ecb4485a9a9de298938697d P 41268b218b804905a110c86738e74400 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:08:32.204931 27666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "456941807b254f5fb32dca4f84bd16ea" candidate_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "41268b218b804905a110c86738e74400" is_pre_election: true
I20260709 13:08:32.205562 27666 raft_consensus.cc:2468] T 456941807b254f5fb32dca4f84bd16ea P 41268b218b804905a110c86738e74400 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 665f7e09521a4c3f9284c1d8b0e094ff in term 1.
I20260709 13:08:32.212204 27740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80e2477670ec4db18ad338931d714544" candidate_uuid: "18435fbb525741328139e84a1e354954" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "665f7e09521a4c3f9284c1d8b0e094ff"
I20260709 13:08:32.212764 27740 raft_consensus.cc:3060] T 80e2477670ec4db18ad338931d714544 P 665f7e09521a4c3f9284c1d8b0e094ff [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:08:32.213642 27779 leader_election.cc:336] T 18f991bbbf3a4615aab49899c7ef86dc P 18435fbb525741328139e84a1e354954 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 2513a663afac495eb09126ff55e8b2b0 (127.17.223.1:40721): Network error: Client connection negotiation failed: client connection to 127.17.223.1:40721: connect: Connection refused (error 111)
I20260709 13:08:32.214447 27779 leader_election.cc:304] T 18f991bbbf3a4615aab49899c7ef86dc P 18435fbb525741328139e84a1e354954 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 18435fbb525741328139e84a1e354954; no voters: 2513a663afac495eb09126ff55e8b2b0, 665f7e09521a4c3f9284c1d8b0e094ff
W20260709 13:08:32.217612 27779 leader_election.cc:336] T 80e2477670ec4db18ad338931d714544 P 18435fbb525741328139e84a1e354954 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 2513a663afac495eb09126ff55e8b2b0 (127.17.223.1:40721): Network error: Client connection negotiation failed: client connection to 127.17.223.1:40721: connect: Connection refused (error 111)
I20260709 13:08:32.220443 27740 raft_consensus.cc:2468] T 80e2477670ec4db18ad338931d714544 P 665f7e09521a4c3f9284c1d8b0e094ff [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 18435fbb525741328139e84a1e354954 in term 2.
I20260709 13:08:32.218436 28409 raft_consensus.cc:2749] T 18f991bbbf3a4615aab49899c7ef86dc P 18435fbb525741328139e84a1e354954 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:08:32.225077 28379 raft_consensus.cc:493] T 3a7da70e9f0f49a9bf60184a8f0b5339 P 18435fbb525741328139e84a1e354954 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2513a663afac495eb09126ff55e8b2b0)
I20260709 13:08:32.225674 28379 raft_consensus.cc:515] T 3a7da70e9f0f49a9bf60184a8f0b5339 P 18435fbb525741328139e84a1e354954 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18435fbb525741328139e84a1e354954" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 40545 } } peers { permanent_uuid: "2513a663afac495eb09126ff55e8b2b0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40721 } } peers { permanent_uuid: "41268b218b804905a110c86738e74400" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 44403 } }
I20260709 13:08:32.227790 28379 leader_election.cc:290] T 3a7da70e9f0f49a9bf60184a8f0b5339 P 18435fbb525741328139e84a1e354954 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2513a663afac495eb09126ff55e8b2b0 (127.17.223.1:40721), 41268b218b804905a110c86738e74400 (127.17.223.2:44403)
W20260709 13:08:32.233462 27631 leader_election.cc:336] T 2d994cb13f8f453284bcb1f8b85824a2 P 41268b218b804905a110c86738e74400 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 2513a663afac495eb09126ff55e8b2b0 (127.17.223.1:40721): Network error: Client connection negotiation failed: client connection to 127.17.223.1:40721: connect: Connection refused (error 111)
W20260709 13:08:32.237179 27705 leader_election.cc:336] T 11224ef6c00a40cdba4311ceb63bddb9 P 665f7e09521a4c3f9284c1d8b0e094ff [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 2513a663afac495eb09126ff55e8b2b0 (127.17.223.1:40721): Network error: Client connection negotiation failed: client connection to 127.17.223.1:40721: connect: Connection refused (error 111)
I20260709 13:08:32.233109 27708 leader_election.cc:304] T 456941807b254f5fb32dca4f84bd16ea P 665f7e09521a4c3f9284c1d8b0e094ff [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 41268b218b804905a110c86738e74400, 665f7e09521a4c3f9284c1d8b0e094ff; no voters: 
W20260709 13:08:32.239208 27705 leader_election.cc:336] T 456941807b254f5fb32dca4f84bd16ea P 665f7e09521a4c3f9284c1d8b0e094ff [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 2513a663afac495eb09126ff55e8b2b0 (127.17.223.1:40721): Network error: Client connection negotiation failed: client connection to 127.17.223.1:40721: connect: Connection refused (error 111)
I20260709 13:08:32.239560 28400 raft_consensus.cc:2804] T 456941807b254f5fb32dca4f84bd16ea P 665f7e09521a4c3f9284c1d8b0e094ff [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:08:32.240270 28400 raft_consensus.cc:493] T 456941807b254f5fb32dca4f84bd16ea P 665f7e09521a4c3f9284c1d8b0e094ff [term 1 FOLLOWER]: Starting leader election (detected failure of leader 2513a663afac495eb09126ff55e8b2b0)
I20260709 13:08:32.240401 28383 raft_consensus.cc:493] T 11224ef6c00a40cdba4311ceb63bddb9 P 18435fbb525741328139e84a1e354954 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2513a663afac495eb09126ff55e8b2b0)
I20260709 13:08:32.240613 28400 raft_consensus.cc:3060] T 456941807b254f5fb32dca4f84bd16ea P 665f7e09521a4c3f9284c1d8b0e094ff [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:32.240962 28383 raft_consensus.cc:515] T 11224ef6c00a40cdba4311ceb63bddb9 P 18435fbb525741328139e84a1e354954 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 38749 } } peers { permanent_uuid: "18435fbb525741328139e84a1e354954" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 40545 } } peers { permanent_uuid: "2513a663afac495eb09126ff55e8b2b0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40721 } }
I20260709 13:08:32.243184 28383 leader_election.cc:290] T 11224ef6c00a40cdba4311ceb63bddb9 P 18435fbb525741328139e84a1e354954 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 665f7e09521a4c3f9284c1d8b0e094ff (127.17.223.3:38749), 2513a663afac495eb09126ff55e8b2b0 (127.17.223.1:40721)
I20260709 13:08:32.244091 27813 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d994cb13f8f453284bcb1f8b85824a2" candidate_uuid: "41268b218b804905a110c86738e74400" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "18435fbb525741328139e84a1e354954" is_pre_election: true
I20260709 13:08:32.244745 27813 raft_consensus.cc:2468] T 2d994cb13f8f453284bcb1f8b85824a2 P 18435fbb525741328139e84a1e354954 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 41268b218b804905a110c86738e74400 in term 1.
I20260709 13:08:32.247331 28395 raft_consensus.cc:515] T bc0b10615ecb4485a9a9de298938697d P 18435fbb525741328139e84a1e354954 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18435fbb525741328139e84a1e354954" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 40545 } } peers { permanent_uuid: "2513a663afac495eb09126ff55e8b2b0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40721 } } peers { permanent_uuid: "41268b218b804905a110c86738e74400" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 44403 } }
I20260709 13:08:32.248047 27634 leader_election.cc:304] T 2d994cb13f8f453284bcb1f8b85824a2 P 41268b218b804905a110c86738e74400 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 18435fbb525741328139e84a1e354954, 41268b218b804905a110c86738e74400; no voters: 2513a663afac495eb09126ff55e8b2b0
I20260709 13:08:32.249341 28395 leader_election.cc:290] T bc0b10615ecb4485a9a9de298938697d P 18435fbb525741328139e84a1e354954 [CANDIDATE]: Term 2 election: Requested vote from peers 2513a663afac495eb09126ff55e8b2b0 (127.17.223.1:40721), 41268b218b804905a110c86738e74400 (127.17.223.2:44403)
I20260709 13:08:32.250187 28377 raft_consensus.cc:2804] T 2d994cb13f8f453284bcb1f8b85824a2 P 41268b218b804905a110c86738e74400 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:08:32.250873 27814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11224ef6c00a40cdba4311ceb63bddb9" candidate_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "18435fbb525741328139e84a1e354954" is_pre_election: true
I20260709 13:08:32.251513 27814 raft_consensus.cc:2468] T 11224ef6c00a40cdba4311ceb63bddb9 P 18435fbb525741328139e84a1e354954 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 665f7e09521a4c3f9284c1d8b0e094ff in term 1.
I20260709 13:08:32.250694 28377 raft_consensus.cc:493] T 2d994cb13f8f453284bcb1f8b85824a2 P 41268b218b804905a110c86738e74400 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 2513a663afac495eb09126ff55e8b2b0)
I20260709 13:08:32.252240 28377 raft_consensus.cc:3060] T 2d994cb13f8f453284bcb1f8b85824a2 P 41268b218b804905a110c86738e74400 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:32.253548 28400 raft_consensus.cc:515] T 456941807b254f5fb32dca4f84bd16ea P 665f7e09521a4c3f9284c1d8b0e094ff [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2513a663afac495eb09126ff55e8b2b0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40721 } } peers { permanent_uuid: "41268b218b804905a110c86738e74400" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 44403 } } peers { permanent_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 38749 } }
I20260709 13:08:32.256083 27666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a7da70e9f0f49a9bf60184a8f0b5339" candidate_uuid: "18435fbb525741328139e84a1e354954" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "41268b218b804905a110c86738e74400" is_pre_election: true
I20260709 13:08:32.256726 28400 leader_election.cc:290] T 456941807b254f5fb32dca4f84bd16ea P 665f7e09521a4c3f9284c1d8b0e094ff [CANDIDATE]: Term 2 election: Requested vote from peers 2513a663afac495eb09126ff55e8b2b0 (127.17.223.1:40721), 41268b218b804905a110c86738e74400 (127.17.223.2:44403)
I20260709 13:08:32.256731 27666 raft_consensus.cc:2468] T 3a7da70e9f0f49a9bf60184a8f0b5339 P 41268b218b804905a110c86738e74400 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 18435fbb525741328139e84a1e354954 in term 1.
I20260709 13:08:32.257900 27667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc0b10615ecb4485a9a9de298938697d" candidate_uuid: "18435fbb525741328139e84a1e354954" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "41268b218b804905a110c86738e74400"
I20260709 13:08:32.258386 27667 raft_consensus.cc:3060] T bc0b10615ecb4485a9a9de298938697d P 41268b218b804905a110c86738e74400 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:32.260463 27782 leader_election.cc:304] T 80e2477670ec4db18ad338931d714544 P 18435fbb525741328139e84a1e354954 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 18435fbb525741328139e84a1e354954, 665f7e09521a4c3f9284c1d8b0e094ff; no voters: 
W20260709 13:08:32.260816 27779 leader_election.cc:336] T bc0b10615ecb4485a9a9de298938697d P 18435fbb525741328139e84a1e354954 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 2513a663afac495eb09126ff55e8b2b0 (127.17.223.1:40721): Network error: Client connection negotiation failed: client connection to 127.17.223.1:40721: connect: Connection refused (error 111)
I20260709 13:08:32.263028 28408 raft_consensus.cc:493] T 64490a86db8c4f5ca54f4f8085f41319 P 18435fbb525741328139e84a1e354954 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2513a663afac495eb09126ff55e8b2b0)
I20260709 13:08:32.263638 28408 raft_consensus.cc:515] T 64490a86db8c4f5ca54f4f8085f41319 P 18435fbb525741328139e84a1e354954 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 38749 } } peers { permanent_uuid: "18435fbb525741328139e84a1e354954" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 40545 } } peers { permanent_uuid: "2513a663afac495eb09126ff55e8b2b0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40721 } }
I20260709 13:08:32.263026 27741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11224ef6c00a40cdba4311ceb63bddb9" candidate_uuid: "18435fbb525741328139e84a1e354954" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" is_pre_election: true
I20260709 13:08:32.264623 27741 raft_consensus.cc:2468] T 11224ef6c00a40cdba4311ceb63bddb9 P 665f7e09521a4c3f9284c1d8b0e094ff [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 18435fbb525741328139e84a1e354954 in term 1.
W20260709 13:08:32.265344 27705 leader_election.cc:336] T 456941807b254f5fb32dca4f84bd16ea P 665f7e09521a4c3f9284c1d8b0e094ff [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 2513a663afac495eb09126ff55e8b2b0 (127.17.223.1:40721): Network error: Client connection negotiation failed: client connection to 127.17.223.1:40721: connect: Connection refused (error 111)
I20260709 13:08:32.265793 28408 leader_election.cc:290] T 64490a86db8c4f5ca54f4f8085f41319 P 18435fbb525741328139e84a1e354954 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 665f7e09521a4c3f9284c1d8b0e094ff (127.17.223.3:38749), 2513a663afac495eb09126ff55e8b2b0 (127.17.223.1:40721)
I20260709 13:08:32.267385 28395 raft_consensus.cc:2804] T 80e2477670ec4db18ad338931d714544 P 18435fbb525741328139e84a1e354954 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:08:32.267918 28395 raft_consensus.cc:697] T 80e2477670ec4db18ad338931d714544 P 18435fbb525741328139e84a1e354954 [term 2 LEADER]: Becoming Leader. State: Replica: 18435fbb525741328139e84a1e354954, State: Running, Role: LEADER
I20260709 13:08:32.268728 28395 consensus_queue.cc:237] T 80e2477670ec4db18ad338931d714544 P 18435fbb525741328139e84a1e354954 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 38749 } } peers { permanent_uuid: "18435fbb525741328139e84a1e354954" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 40545 } } peers { permanent_uuid: "2513a663afac495eb09126ff55e8b2b0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40721 } }
I20260709 13:08:32.270605 27667 raft_consensus.cc:2468] T bc0b10615ecb4485a9a9de298938697d P 41268b218b804905a110c86738e74400 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 18435fbb525741328139e84a1e354954 in term 2.
I20260709 13:08:32.273241 27782 leader_election.cc:304] T a9eac7f072de454a8ff2beb019da45d9 P 18435fbb525741328139e84a1e354954 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 18435fbb525741328139e84a1e354954, 41268b218b804905a110c86738e74400; no voters: 
I20260709 13:08:32.274192 27782 leader_election.cc:304] T 3a7da70e9f0f49a9bf60184a8f0b5339 P 18435fbb525741328139e84a1e354954 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 18435fbb525741328139e84a1e354954, 41268b218b804905a110c86738e74400; no voters: 
I20260709 13:08:32.274858 28408 raft_consensus.cc:2804] T a9eac7f072de454a8ff2beb019da45d9 P 18435fbb525741328139e84a1e354954 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:08:32.275321 28408 raft_consensus.cc:493] T a9eac7f072de454a8ff2beb019da45d9 P 18435fbb525741328139e84a1e354954 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 2513a663afac495eb09126ff55e8b2b0)
I20260709 13:08:32.275681 28408 raft_consensus.cc:3060] T a9eac7f072de454a8ff2beb019da45d9 P 18435fbb525741328139e84a1e354954 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:32.276072 27667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "456941807b254f5fb32dca4f84bd16ea" candidate_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "41268b218b804905a110c86738e74400"
I20260709 13:08:32.276715 27667 raft_consensus.cc:3060] T 456941807b254f5fb32dca4f84bd16ea P 41268b218b804905a110c86738e74400 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:08:32.280087 27779 leader_election.cc:336] T 80e2477670ec4db18ad338931d714544 P 18435fbb525741328139e84a1e354954 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 2513a663afac495eb09126ff55e8b2b0 (127.17.223.1:40721): Network error: Client connection negotiation failed: client connection to 127.17.223.1:40721: connect: Connection refused (error 111)
W20260709 13:08:32.281075 27779 leader_election.cc:336] T a9eac7f072de454a8ff2beb019da45d9 P 18435fbb525741328139e84a1e354954 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 2513a663afac495eb09126ff55e8b2b0 (127.17.223.1:40721): Network error: Client connection negotiation failed: client connection to 127.17.223.1:40721: connect: Connection refused (error 111)
I20260709 13:08:32.283375 27782 leader_election.cc:304] T bc0b10615ecb4485a9a9de298938697d P 18435fbb525741328139e84a1e354954 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 18435fbb525741328139e84a1e354954, 41268b218b804905a110c86738e74400; no voters: 
I20260709 13:08:32.285159 28395 raft_consensus.cc:2804] T 3a7da70e9f0f49a9bf60184a8f0b5339 P 18435fbb525741328139e84a1e354954 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:08:32.285285 27741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64490a86db8c4f5ca54f4f8085f41319" candidate_uuid: "18435fbb525741328139e84a1e354954" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" is_pre_election: true
I20260709 13:08:32.285691 28395 raft_consensus.cc:493] T 3a7da70e9f0f49a9bf60184a8f0b5339 P 18435fbb525741328139e84a1e354954 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 2513a663afac495eb09126ff55e8b2b0)
I20260709 13:08:32.286021 27741 raft_consensus.cc:2468] T 64490a86db8c4f5ca54f4f8085f41319 P 665f7e09521a4c3f9284c1d8b0e094ff [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 18435fbb525741328139e84a1e354954 in term 1.
I20260709 13:08:32.286109 28395 raft_consensus.cc:3060] T 3a7da70e9f0f49a9bf60184a8f0b5339 P 18435fbb525741328139e84a1e354954 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:32.287079 28383 raft_consensus.cc:2804] T bc0b10615ecb4485a9a9de298938697d P 18435fbb525741328139e84a1e354954 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:08:32.287812 28383 raft_consensus.cc:697] T bc0b10615ecb4485a9a9de298938697d P 18435fbb525741328139e84a1e354954 [term 2 LEADER]: Becoming Leader. State: Replica: 18435fbb525741328139e84a1e354954, State: Running, Role: LEADER
I20260709 13:08:32.284358 27491 catalog_manager.cc:5697] T ae05961ab7a94458b1ad2cde9785c63b P 18435fbb525741328139e84a1e354954 reported cstate change: term changed from 1 to 2, leader changed from 2513a663afac495eb09126ff55e8b2b0 (127.17.223.1) to 18435fbb525741328139e84a1e354954 (127.17.223.4). New cstate: current_term: 2 leader_uuid: "18435fbb525741328139e84a1e354954" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 38749 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "18435fbb525741328139e84a1e354954" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 40545 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2513a663afac495eb09126ff55e8b2b0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40721 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:32.293457 27708 leader_election.cc:304] T 18f991bbbf3a4615aab49899c7ef86dc P 665f7e09521a4c3f9284c1d8b0e094ff [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 665f7e09521a4c3f9284c1d8b0e094ff; no voters: 18435fbb525741328139e84a1e354954, 2513a663afac495eb09126ff55e8b2b0
I20260709 13:08:32.294258 28383 consensus_queue.cc:237] T bc0b10615ecb4485a9a9de298938697d P 18435fbb525741328139e84a1e354954 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18435fbb525741328139e84a1e354954" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 40545 } } peers { permanent_uuid: "2513a663afac495eb09126ff55e8b2b0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40721 } } peers { permanent_uuid: "41268b218b804905a110c86738e74400" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 44403 } }
I20260709 13:08:32.294757 28389 raft_consensus.cc:2749] T 18f991bbbf3a4615aab49899c7ef86dc P 665f7e09521a4c3f9284c1d8b0e094ff [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:08:32.295845 27708 leader_election.cc:304] T 2d68b1be563949efbcb4bbe71eddd0d8 P 665f7e09521a4c3f9284c1d8b0e094ff [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 18435fbb525741328139e84a1e354954, 665f7e09521a4c3f9284c1d8b0e094ff; no voters: 2513a663afac495eb09126ff55e8b2b0
I20260709 13:08:32.298430 28389 raft_consensus.cc:2804] T 2d68b1be563949efbcb4bbe71eddd0d8 P 665f7e09521a4c3f9284c1d8b0e094ff [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:08:32.298928 28389 raft_consensus.cc:697] T 2d68b1be563949efbcb4bbe71eddd0d8 P 665f7e09521a4c3f9284c1d8b0e094ff [term 2 LEADER]: Becoming Leader. State: Replica: 665f7e09521a4c3f9284c1d8b0e094ff, State: Running, Role: LEADER
I20260709 13:08:32.299782 28389 consensus_queue.cc:237] T 2d68b1be563949efbcb4bbe71eddd0d8 P 665f7e09521a4c3f9284c1d8b0e094ff [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 38749 } } peers { permanent_uuid: "18435fbb525741328139e84a1e354954" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 40545 } } peers { permanent_uuid: "2513a663afac495eb09126ff55e8b2b0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40721 } }
I20260709 13:08:32.307679 27782 leader_election.cc:304] T 11224ef6c00a40cdba4311ceb63bddb9 P 18435fbb525741328139e84a1e354954 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 18435fbb525741328139e84a1e354954, 665f7e09521a4c3f9284c1d8b0e094ff; no voters: 
I20260709 13:08:32.308559 28379 raft_consensus.cc:2804] T 11224ef6c00a40cdba4311ceb63bddb9 P 18435fbb525741328139e84a1e354954 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:08:32.308601 27782 leader_election.cc:304] T 64490a86db8c4f5ca54f4f8085f41319 P 18435fbb525741328139e84a1e354954 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 18435fbb525741328139e84a1e354954, 665f7e09521a4c3f9284c1d8b0e094ff; no voters: 
I20260709 13:08:32.308777 27708 leader_election.cc:304] T 11224ef6c00a40cdba4311ceb63bddb9 P 665f7e09521a4c3f9284c1d8b0e094ff [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 18435fbb525741328139e84a1e354954, 665f7e09521a4c3f9284c1d8b0e094ff; no voters: 2513a663afac495eb09126ff55e8b2b0
I20260709 13:08:32.309046 28379 raft_consensus.cc:493] T 11224ef6c00a40cdba4311ceb63bddb9 P 18435fbb525741328139e84a1e354954 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 2513a663afac495eb09126ff55e8b2b0)
I20260709 13:08:32.309598 28379 raft_consensus.cc:3060] T 11224ef6c00a40cdba4311ceb63bddb9 P 18435fbb525741328139e84a1e354954 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:32.309955 28377 raft_consensus.cc:515] T 2d994cb13f8f453284bcb1f8b85824a2 P 41268b218b804905a110c86738e74400 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18435fbb525741328139e84a1e354954" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 40545 } } peers { permanent_uuid: "2513a663afac495eb09126ff55e8b2b0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40721 } } peers { permanent_uuid: "41268b218b804905a110c86738e74400" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 44403 } }
I20260709 13:08:32.311009 27667 raft_consensus.cc:2468] T 456941807b254f5fb32dca4f84bd16ea P 41268b218b804905a110c86738e74400 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 665f7e09521a4c3f9284c1d8b0e094ff in term 2.
W20260709 13:08:32.312778 27779 leader_election.cc:336] T 3a7da70e9f0f49a9bf60184a8f0b5339 P 18435fbb525741328139e84a1e354954 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 2513a663afac495eb09126ff55e8b2b0 (127.17.223.1:40721): Network error: Client connection negotiation failed: client connection to 127.17.223.1:40721: connect: Connection refused (error 111)
I20260709 13:08:32.313387 28403 raft_consensus.cc:2804] T 11224ef6c00a40cdba4311ceb63bddb9 P 665f7e09521a4c3f9284c1d8b0e094ff [term 1 FOLLOWER]: Leader pre-election won for term 2
W20260709 13:08:32.313571 27779 leader_election.cc:336] T 11224ef6c00a40cdba4311ceb63bddb9 P 18435fbb525741328139e84a1e354954 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 2513a663afac495eb09126ff55e8b2b0 (127.17.223.1:40721): Network error: Client connection negotiation failed: client connection to 127.17.223.1:40721: connect: Connection refused (error 111)
I20260709 13:08:32.313836 28403 raft_consensus.cc:493] T 11224ef6c00a40cdba4311ceb63bddb9 P 665f7e09521a4c3f9284c1d8b0e094ff [term 1 FOLLOWER]: Starting leader election (detected failure of leader 2513a663afac495eb09126ff55e8b2b0)
I20260709 13:08:32.314244 28403 raft_consensus.cc:3060] T 11224ef6c00a40cdba4311ceb63bddb9 P 665f7e09521a4c3f9284c1d8b0e094ff [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:08:32.314381 27779 leader_election.cc:336] T bc0b10615ecb4485a9a9de298938697d P 18435fbb525741328139e84a1e354954 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 2513a663afac495eb09126ff55e8b2b0 (127.17.223.1:40721): Network error: Client connection negotiation failed: client connection to 127.17.223.1:40721: connect: Connection refused (error 111)
I20260709 13:08:32.319075 28379 raft_consensus.cc:515] T 11224ef6c00a40cdba4311ceb63bddb9 P 18435fbb525741328139e84a1e354954 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 38749 } } peers { permanent_uuid: "18435fbb525741328139e84a1e354954" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 40545 } } peers { permanent_uuid: "2513a663afac495eb09126ff55e8b2b0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40721 } }
I20260709 13:08:32.321345 28379 leader_election.cc:290] T 11224ef6c00a40cdba4311ceb63bddb9 P 18435fbb525741328139e84a1e354954 [CANDIDATE]: Term 2 election: Requested vote from peers 665f7e09521a4c3f9284c1d8b0e094ff (127.17.223.3:38749), 2513a663afac495eb09126ff55e8b2b0 (127.17.223.1:40721)
I20260709 13:08:32.321556 28409 raft_consensus.cc:2804] T 64490a86db8c4f5ca54f4f8085f41319 P 18435fbb525741328139e84a1e354954 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:08:32.322520 28409 raft_consensus.cc:493] T 64490a86db8c4f5ca54f4f8085f41319 P 18435fbb525741328139e84a1e354954 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 2513a663afac495eb09126ff55e8b2b0)
I20260709 13:08:32.322974 28409 raft_consensus.cc:3060] T 64490a86db8c4f5ca54f4f8085f41319 P 18435fbb525741328139e84a1e354954 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:32.323243 28408 raft_consensus.cc:515] T a9eac7f072de454a8ff2beb019da45d9 P 18435fbb525741328139e84a1e354954 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18435fbb525741328139e84a1e354954" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 40545 } } peers { permanent_uuid: "2513a663afac495eb09126ff55e8b2b0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40721 } } peers { permanent_uuid: "41268b218b804905a110c86738e74400" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 44403 } }
I20260709 13:08:32.325341 28408 leader_election.cc:290] T a9eac7f072de454a8ff2beb019da45d9 P 18435fbb525741328139e84a1e354954 [CANDIDATE]: Term 2 election: Requested vote from peers 2513a663afac495eb09126ff55e8b2b0 (127.17.223.1:40721), 41268b218b804905a110c86738e74400 (127.17.223.2:44403)
I20260709 13:08:32.326068 28403 raft_consensus.cc:515] T 11224ef6c00a40cdba4311ceb63bddb9 P 665f7e09521a4c3f9284c1d8b0e094ff [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 38749 } } peers { permanent_uuid: "18435fbb525741328139e84a1e354954" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 40545 } } peers { permanent_uuid: "2513a663afac495eb09126ff55e8b2b0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40721 } }
W20260709 13:08:32.331912 27779 leader_election.cc:336] T 64490a86db8c4f5ca54f4f8085f41319 P 18435fbb525741328139e84a1e354954 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 2513a663afac495eb09126ff55e8b2b0 (127.17.223.1:40721): Network error: Client connection negotiation failed: client connection to 127.17.223.1:40721: connect: Connection refused (error 111)
I20260709 13:08:32.320673 28395 raft_consensus.cc:515] T 3a7da70e9f0f49a9bf60184a8f0b5339 P 18435fbb525741328139e84a1e354954 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18435fbb525741328139e84a1e354954" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 40545 } } peers { permanent_uuid: "2513a663afac495eb09126ff55e8b2b0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40721 } } peers { permanent_uuid: "41268b218b804905a110c86738e74400" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 44403 } }
I20260709 13:08:32.334420 27813 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d994cb13f8f453284bcb1f8b85824a2" candidate_uuid: "41268b218b804905a110c86738e74400" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "18435fbb525741328139e84a1e354954"
I20260709 13:08:32.335013 27813 raft_consensus.cc:3060] T 2d994cb13f8f453284bcb1f8b85824a2 P 18435fbb525741328139e84a1e354954 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:32.336905 27666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9eac7f072de454a8ff2beb019da45d9" candidate_uuid: "18435fbb525741328139e84a1e354954" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "41268b218b804905a110c86738e74400"
I20260709 13:08:32.337464 27666 raft_consensus.cc:3060] T a9eac7f072de454a8ff2beb019da45d9 P 41268b218b804905a110c86738e74400 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:32.340284 27663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a7da70e9f0f49a9bf60184a8f0b5339" candidate_uuid: "18435fbb525741328139e84a1e354954" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "41268b218b804905a110c86738e74400"
I20260709 13:08:32.340902 27663 raft_consensus.cc:3060] T 3a7da70e9f0f49a9bf60184a8f0b5339 P 41268b218b804905a110c86738e74400 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:32.343250 27813 raft_consensus.cc:2468] T 2d994cb13f8f453284bcb1f8b85824a2 P 18435fbb525741328139e84a1e354954 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 41268b218b804905a110c86738e74400 in term 2.
I20260709 13:08:32.330195 28403 leader_election.cc:290] T 11224ef6c00a40cdba4311ceb63bddb9 P 665f7e09521a4c3f9284c1d8b0e094ff [CANDIDATE]: Term 2 election: Requested vote from peers 18435fbb525741328139e84a1e354954 (127.17.223.4:40545), 2513a663afac495eb09126ff55e8b2b0 (127.17.223.1:40721)
I20260709 13:08:32.344511 27634 leader_election.cc:304] T 2d994cb13f8f453284bcb1f8b85824a2 P 41268b218b804905a110c86738e74400 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 18435fbb525741328139e84a1e354954, 41268b218b804905a110c86738e74400; no voters: 
I20260709 13:08:32.345314 28398 raft_consensus.cc:2804] T 2d994cb13f8f453284bcb1f8b85824a2 P 41268b218b804905a110c86738e74400 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:08:32.345817 28398 raft_consensus.cc:697] T 2d994cb13f8f453284bcb1f8b85824a2 P 41268b218b804905a110c86738e74400 [term 2 LEADER]: Becoming Leader. State: Replica: 41268b218b804905a110c86738e74400, State: Running, Role: LEADER
I20260709 13:08:32.347654 28377 leader_election.cc:290] T 2d994cb13f8f453284bcb1f8b85824a2 P 41268b218b804905a110c86738e74400 [CANDIDATE]: Term 2 election: Requested vote from peers 18435fbb525741328139e84a1e354954 (127.17.223.4:40545), 2513a663afac495eb09126ff55e8b2b0 (127.17.223.1:40721)
I20260709 13:08:32.346622 28398 consensus_queue.cc:237] T 2d994cb13f8f453284bcb1f8b85824a2 P 41268b218b804905a110c86738e74400 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18435fbb525741328139e84a1e354954" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 40545 } } peers { permanent_uuid: "2513a663afac495eb09126ff55e8b2b0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40721 } } peers { permanent_uuid: "41268b218b804905a110c86738e74400" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 44403 } }
I20260709 13:08:32.352109 27815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11224ef6c00a40cdba4311ceb63bddb9" candidate_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "18435fbb525741328139e84a1e354954"
I20260709 13:08:32.352938 27815 raft_consensus.cc:2393] T 11224ef6c00a40cdba4311ceb63bddb9 P 18435fbb525741328139e84a1e354954 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 665f7e09521a4c3f9284c1d8b0e094ff in current term 2: Already voted for candidate 18435fbb525741328139e84a1e354954 in this term.
I20260709 13:08:32.355345 28395 leader_election.cc:290] T 3a7da70e9f0f49a9bf60184a8f0b5339 P 18435fbb525741328139e84a1e354954 [CANDIDATE]: Term 2 election: Requested vote from peers 2513a663afac495eb09126ff55e8b2b0 (127.17.223.1:40721), 41268b218b804905a110c86738e74400 (127.17.223.2:44403)
I20260709 13:08:32.355967 27663 raft_consensus.cc:2468] T 3a7da70e9f0f49a9bf60184a8f0b5339 P 41268b218b804905a110c86738e74400 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 18435fbb525741328139e84a1e354954 in term 2.
I20260709 13:08:32.355858 27491 catalog_manager.cc:5697] T 80e2477670ec4db18ad338931d714544 P 18435fbb525741328139e84a1e354954 reported cstate change: term changed from 1 to 2, leader changed from 2513a663afac495eb09126ff55e8b2b0 (127.17.223.1) to 18435fbb525741328139e84a1e354954 (127.17.223.4). New cstate: current_term: 2 leader_uuid: "18435fbb525741328139e84a1e354954" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 38749 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "18435fbb525741328139e84a1e354954" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 40545 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2513a663afac495eb09126ff55e8b2b0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40721 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:32.357479 27491 catalog_manager.cc:5697] T bc0b10615ecb4485a9a9de298938697d P 18435fbb525741328139e84a1e354954 reported cstate change: term changed from 1 to 2, leader changed from 2513a663afac495eb09126ff55e8b2b0 (127.17.223.1) to 18435fbb525741328139e84a1e354954 (127.17.223.4). New cstate: current_term: 2 leader_uuid: "18435fbb525741328139e84a1e354954" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18435fbb525741328139e84a1e354954" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 40545 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2513a663afac495eb09126ff55e8b2b0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40721 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "41268b218b804905a110c86738e74400" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 44403 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:32.358826 27782 leader_election.cc:304] T 3a7da70e9f0f49a9bf60184a8f0b5339 P 18435fbb525741328139e84a1e354954 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 18435fbb525741328139e84a1e354954, 41268b218b804905a110c86738e74400; no voters: 
I20260709 13:08:32.359712 28395 raft_consensus.cc:2804] T 3a7da70e9f0f49a9bf60184a8f0b5339 P 18435fbb525741328139e84a1e354954 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:08:32.360190 28395 raft_consensus.cc:697] T 3a7da70e9f0f49a9bf60184a8f0b5339 P 18435fbb525741328139e84a1e354954 [term 2 LEADER]: Becoming Leader. State: Replica: 18435fbb525741328139e84a1e354954, State: Running, Role: LEADER
I20260709 13:08:32.361090 28395 consensus_queue.cc:237] T 3a7da70e9f0f49a9bf60184a8f0b5339 P 18435fbb525741328139e84a1e354954 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18435fbb525741328139e84a1e354954" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 40545 } } peers { permanent_uuid: "2513a663afac495eb09126ff55e8b2b0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40721 } } peers { permanent_uuid: "41268b218b804905a110c86738e74400" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 44403 } }
I20260709 13:08:32.362253 27708 leader_election.cc:304] T 456941807b254f5fb32dca4f84bd16ea P 665f7e09521a4c3f9284c1d8b0e094ff [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 41268b218b804905a110c86738e74400, 665f7e09521a4c3f9284c1d8b0e094ff; no voters: 2513a663afac495eb09126ff55e8b2b0
I20260709 13:08:32.363564 28389 raft_consensus.cc:2804] T 456941807b254f5fb32dca4f84bd16ea P 665f7e09521a4c3f9284c1d8b0e094ff [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:08:32.364063 28389 raft_consensus.cc:697] T 456941807b254f5fb32dca4f84bd16ea P 665f7e09521a4c3f9284c1d8b0e094ff [term 2 LEADER]: Becoming Leader. State: Replica: 665f7e09521a4c3f9284c1d8b0e094ff, State: Running, Role: LEADER
W20260709 13:08:32.363776 27779 leader_election.cc:336] T 11224ef6c00a40cdba4311ceb63bddb9 P 18435fbb525741328139e84a1e354954 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 2513a663afac495eb09126ff55e8b2b0 (127.17.223.1:40721): Network error: Client connection negotiation failed: client connection to 127.17.223.1:40721: connect: Connection refused (error 111)
I20260709 13:08:32.364955 28389 consensus_queue.cc:237] T 456941807b254f5fb32dca4f84bd16ea P 665f7e09521a4c3f9284c1d8b0e094ff [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2513a663afac495eb09126ff55e8b2b0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40721 } } peers { permanent_uuid: "41268b218b804905a110c86738e74400" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 44403 } } peers { permanent_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 38749 } }
I20260709 13:08:32.367828 27666 raft_consensus.cc:2468] T a9eac7f072de454a8ff2beb019da45d9 P 41268b218b804905a110c86738e74400 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 18435fbb525741328139e84a1e354954 in term 2.
W20260709 13:08:32.368705 27779 leader_election.cc:336] T a9eac7f072de454a8ff2beb019da45d9 P 18435fbb525741328139e84a1e354954 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 2513a663afac495eb09126ff55e8b2b0 (127.17.223.1:40721): Network error: Client connection negotiation failed: client connection to 127.17.223.1:40721: connect: Connection refused (error 111)
I20260709 13:08:32.369746 27741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11224ef6c00a40cdba4311ceb63bddb9" candidate_uuid: "18435fbb525741328139e84a1e354954" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "665f7e09521a4c3f9284c1d8b0e094ff"
I20260709 13:08:32.370512 27741 raft_consensus.cc:2393] T 11224ef6c00a40cdba4311ceb63bddb9 P 665f7e09521a4c3f9284c1d8b0e094ff [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 18435fbb525741328139e84a1e354954 in current term 2: Already voted for candidate 665f7e09521a4c3f9284c1d8b0e094ff in this term.
W20260709 13:08:32.374948 27705 leader_election.cc:336] T 11224ef6c00a40cdba4311ceb63bddb9 P 665f7e09521a4c3f9284c1d8b0e094ff [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 2513a663afac495eb09126ff55e8b2b0 (127.17.223.1:40721): Network error: Client connection negotiation failed: client connection to 127.17.223.1:40721: connect: Connection refused (error 111)
W20260709 13:08:32.375154 27779 leader_election.cc:336] T 3a7da70e9f0f49a9bf60184a8f0b5339 P 18435fbb525741328139e84a1e354954 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 2513a663afac495eb09126ff55e8b2b0 (127.17.223.1:40721): Network error: Client connection negotiation failed: client connection to 127.17.223.1:40721: connect: Connection refused (error 111)
I20260709 13:08:32.379624 27782 leader_election.cc:304] T a9eac7f072de454a8ff2beb019da45d9 P 18435fbb525741328139e84a1e354954 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 18435fbb525741328139e84a1e354954, 41268b218b804905a110c86738e74400; no voters: 2513a663afac495eb09126ff55e8b2b0
I20260709 13:08:32.382012 28409 raft_consensus.cc:515] T 64490a86db8c4f5ca54f4f8085f41319 P 18435fbb525741328139e84a1e354954 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 38749 } } peers { permanent_uuid: "18435fbb525741328139e84a1e354954" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 40545 } } peers { permanent_uuid: "2513a663afac495eb09126ff55e8b2b0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40721 } }
I20260709 13:08:32.384137 28409 leader_election.cc:290] T 64490a86db8c4f5ca54f4f8085f41319 P 18435fbb525741328139e84a1e354954 [CANDIDATE]: Term 2 election: Requested vote from peers 665f7e09521a4c3f9284c1d8b0e094ff (127.17.223.3:38749), 2513a663afac495eb09126ff55e8b2b0 (127.17.223.1:40721)
I20260709 13:08:32.389673 27782 leader_election.cc:304] T 11224ef6c00a40cdba4311ceb63bddb9 P 18435fbb525741328139e84a1e354954 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 18435fbb525741328139e84a1e354954; no voters: 2513a663afac495eb09126ff55e8b2b0, 665f7e09521a4c3f9284c1d8b0e094ff
W20260709 13:08:32.390479 27631 leader_election.cc:336] T 2d994cb13f8f453284bcb1f8b85824a2 P 41268b218b804905a110c86738e74400 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 2513a663afac495eb09126ff55e8b2b0 (127.17.223.1:40721): Network error: Client connection negotiation failed: client connection to 127.17.223.1:40721: connect: Connection refused (error 111)
I20260709 13:08:32.391394 27741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64490a86db8c4f5ca54f4f8085f41319" candidate_uuid: "18435fbb525741328139e84a1e354954" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "665f7e09521a4c3f9284c1d8b0e094ff"
I20260709 13:08:32.393152 27741 raft_consensus.cc:3060] T 64490a86db8c4f5ca54f4f8085f41319 P 665f7e09521a4c3f9284c1d8b0e094ff [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:32.394785 27708 leader_election.cc:304] T 11224ef6c00a40cdba4311ceb63bddb9 P 665f7e09521a4c3f9284c1d8b0e094ff [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 665f7e09521a4c3f9284c1d8b0e094ff; no voters: 18435fbb525741328139e84a1e354954, 2513a663afac495eb09126ff55e8b2b0
I20260709 13:08:32.395911 28331 raft_consensus.cc:2749] T 11224ef6c00a40cdba4311ceb63bddb9 P 665f7e09521a4c3f9284c1d8b0e094ff [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:08:32.398077 28413 raft_consensus.cc:2804] T a9eac7f072de454a8ff2beb019da45d9 P 18435fbb525741328139e84a1e354954 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:08:32.398610 28413 raft_consensus.cc:697] T a9eac7f072de454a8ff2beb019da45d9 P 18435fbb525741328139e84a1e354954 [term 2 LEADER]: Becoming Leader. State: Replica: 18435fbb525741328139e84a1e354954, State: Running, Role: LEADER
I20260709 13:08:32.399801 28413 consensus_queue.cc:237] T a9eac7f072de454a8ff2beb019da45d9 P 18435fbb525741328139e84a1e354954 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18435fbb525741328139e84a1e354954" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 40545 } } peers { permanent_uuid: "2513a663afac495eb09126ff55e8b2b0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40721 } } peers { permanent_uuid: "41268b218b804905a110c86738e74400" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 44403 } }
I20260709 13:08:32.402570 27490 catalog_manager.cc:5697] T 2d68b1be563949efbcb4bbe71eddd0d8 P 665f7e09521a4c3f9284c1d8b0e094ff reported cstate change: term changed from 1 to 2, leader changed from 2513a663afac495eb09126ff55e8b2b0 (127.17.223.1) to 665f7e09521a4c3f9284c1d8b0e094ff (127.17.223.3). New cstate: current_term: 2 leader_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 38749 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "18435fbb525741328139e84a1e354954" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 40545 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2513a663afac495eb09126ff55e8b2b0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40721 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:32.404079 27489 catalog_manager.cc:5697] T 2d994cb13f8f453284bcb1f8b85824a2 P 41268b218b804905a110c86738e74400 reported cstate change: term changed from 1 to 2, leader changed from 2513a663afac495eb09126ff55e8b2b0 (127.17.223.1) to 41268b218b804905a110c86738e74400 (127.17.223.2). New cstate: current_term: 2 leader_uuid: "41268b218b804905a110c86738e74400" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18435fbb525741328139e84a1e354954" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 40545 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2513a663afac495eb09126ff55e8b2b0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40721 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "41268b218b804905a110c86738e74400" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 44403 } health_report { overall_health: HEALTHY } } }
W20260709 13:08:32.405272 27779 leader_election.cc:336] T 64490a86db8c4f5ca54f4f8085f41319 P 18435fbb525741328139e84a1e354954 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 2513a663afac495eb09126ff55e8b2b0 (127.17.223.1:40721): Network error: Client connection negotiation failed: client connection to 127.17.223.1:40721: connect: Connection refused (error 111)
I20260709 13:08:32.414780 27741 raft_consensus.cc:2468] T 64490a86db8c4f5ca54f4f8085f41319 P 665f7e09521a4c3f9284c1d8b0e094ff [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 18435fbb525741328139e84a1e354954 in term 2.
I20260709 13:08:32.418658 27782 leader_election.cc:304] T 64490a86db8c4f5ca54f4f8085f41319 P 18435fbb525741328139e84a1e354954 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 18435fbb525741328139e84a1e354954, 665f7e09521a4c3f9284c1d8b0e094ff; no voters: 2513a663afac495eb09126ff55e8b2b0
I20260709 13:08:32.419494 28408 raft_consensus.cc:2804] T 64490a86db8c4f5ca54f4f8085f41319 P 18435fbb525741328139e84a1e354954 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:08:32.419945 28408 raft_consensus.cc:697] T 64490a86db8c4f5ca54f4f8085f41319 P 18435fbb525741328139e84a1e354954 [term 2 LEADER]: Becoming Leader. State: Replica: 18435fbb525741328139e84a1e354954, State: Running, Role: LEADER
I20260709 13:08:32.421211 28408 consensus_queue.cc:237] T 64490a86db8c4f5ca54f4f8085f41319 P 18435fbb525741328139e84a1e354954 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 38749 } } peers { permanent_uuid: "18435fbb525741328139e84a1e354954" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 40545 } } peers { permanent_uuid: "2513a663afac495eb09126ff55e8b2b0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40721 } }
W20260709 13:08:32.394390 27631 consensus_peers.cc:597] T bbd0bdc9640c4956a5d60406841ef0f0 P 41268b218b804905a110c86738e74400 -> Peer 2513a663afac495eb09126ff55e8b2b0 (127.17.223.1:40721): Couldn't send request to peer 2513a663afac495eb09126ff55e8b2b0. Status: Network error: Client connection negotiation failed: client connection to 127.17.223.1:40721: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:08:32.393793 28409 raft_consensus.cc:2749] T 11224ef6c00a40cdba4311ceb63bddb9 P 18435fbb525741328139e84a1e354954 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:08:32.443837 27815 raft_consensus.cc:1275] T b6be829f6d3f40c99a3c5be18b0c259c P 18435fbb525741328139e84a1e354954 [term 2 FOLLOWER]: Refusing update from remote peer 41268b218b804905a110c86738e74400: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:08:32.445966 28396 consensus_queue.cc:1048] T b6be829f6d3f40c99a3c5be18b0c259c P 41268b218b804905a110c86738e74400 [LEADER]: Connected to new peer: Peer: permanent_uuid: "18435fbb525741328139e84a1e354954" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 40545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:08:32.449395 28412 log.cc:927] Time spent T bc0b10615ecb4485a9a9de298938697d P 18435fbb525741328139e84a1e354954: Append to log took a long time: real 0.063s	user 0.001s	sys 0.000s
W20260709 13:08:32.450852 27631 consensus_peers.cc:597] T b6be829f6d3f40c99a3c5be18b0c259c P 41268b218b804905a110c86738e74400 -> Peer 2513a663afac495eb09126ff55e8b2b0 (127.17.223.1:40721): Couldn't send request to peer 2513a663afac495eb09126ff55e8b2b0. Status: Network error: Client connection negotiation failed: client connection to 127.17.223.1:40721: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:08:32.462868 27490 catalog_manager.cc:5697] T 3a7da70e9f0f49a9bf60184a8f0b5339 P 18435fbb525741328139e84a1e354954 reported cstate change: term changed from 1 to 2, leader changed from 2513a663afac495eb09126ff55e8b2b0 (127.17.223.1) to 18435fbb525741328139e84a1e354954 (127.17.223.4). New cstate: current_term: 2 leader_uuid: "18435fbb525741328139e84a1e354954" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18435fbb525741328139e84a1e354954" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 40545 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2513a663afac495eb09126ff55e8b2b0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40721 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "41268b218b804905a110c86738e74400" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 44403 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:32.467891 27489 catalog_manager.cc:5697] T 456941807b254f5fb32dca4f84bd16ea P 665f7e09521a4c3f9284c1d8b0e094ff reported cstate change: term changed from 1 to 2, leader changed from 2513a663afac495eb09126ff55e8b2b0 (127.17.223.1) to 665f7e09521a4c3f9284c1d8b0e094ff (127.17.223.3). New cstate: current_term: 2 leader_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2513a663afac495eb09126ff55e8b2b0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40721 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "41268b218b804905a110c86738e74400" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 44403 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 38749 } health_report { overall_health: HEALTHY } } }
I20260709 13:08:32.464510 27490 catalog_manager.cc:5697] T a9eac7f072de454a8ff2beb019da45d9 P 18435fbb525741328139e84a1e354954 reported cstate change: term changed from 1 to 2, leader changed from 2513a663afac495eb09126ff55e8b2b0 (127.17.223.1) to 18435fbb525741328139e84a1e354954 (127.17.223.4). New cstate: current_term: 2 leader_uuid: "18435fbb525741328139e84a1e354954" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18435fbb525741328139e84a1e354954" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 40545 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2513a663afac495eb09126ff55e8b2b0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40721 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "41268b218b804905a110c86738e74400" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 44403 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:32.528085 27813 raft_consensus.cc:1275] T 86af954f570648969cbc47c03d15c447 P 18435fbb525741328139e84a1e354954 [term 2 FOLLOWER]: Refusing update from remote peer 41268b218b804905a110c86738e74400: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:08:32.531250 28396 consensus_queue.cc:1048] T 86af954f570648969cbc47c03d15c447 P 41268b218b804905a110c86738e74400 [LEADER]: Connected to new peer: Peer: permanent_uuid: "18435fbb525741328139e84a1e354954" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 40545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:08:32.538808 27740 raft_consensus.cc:1275] T 47b65672307641ae81d5f94c639b1a10 P 665f7e09521a4c3f9284c1d8b0e094ff [term 2 FOLLOWER]: Refusing update from remote peer 41268b218b804905a110c86738e74400: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:08:32.540521 28398 consensus_queue.cc:1048] T 47b65672307641ae81d5f94c639b1a10 P 41268b218b804905a110c86738e74400 [LEADER]: Connected to new peer: Peer: permanent_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 38749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:08:32.553278 27741 raft_consensus.cc:1275] T 7b77a53b493f4e979fdf38a0b17176b0 P 665f7e09521a4c3f9284c1d8b0e094ff [term 2 FOLLOWER]: Refusing update from remote peer 41268b218b804905a110c86738e74400: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:08:32.559489 28396 consensus_queue.cc:1048] T 7b77a53b493f4e979fdf38a0b17176b0 P 41268b218b804905a110c86738e74400 [LEADER]: Connected to new peer: Peer: permanent_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 38749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:08:32.561534 27705 consensus_peers.cc:597] T 9c0f604d66664505aa9469fb058601b6 P 665f7e09521a4c3f9284c1d8b0e094ff -> Peer 2513a663afac495eb09126ff55e8b2b0 (127.17.223.1:40721): Couldn't send request to peer 2513a663afac495eb09126ff55e8b2b0. Status: Network error: Client connection negotiation failed: client connection to 127.17.223.1:40721: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:08:32.563836 27741 raft_consensus.cc:1275] T ae05961ab7a94458b1ad2cde9785c63b P 665f7e09521a4c3f9284c1d8b0e094ff [term 2 FOLLOWER]: Refusing update from remote peer 18435fbb525741328139e84a1e354954: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 13:08:32.565900 27631 consensus_peers.cc:597] T 86af954f570648969cbc47c03d15c447 P 41268b218b804905a110c86738e74400 -> Peer 2513a663afac495eb09126ff55e8b2b0 (127.17.223.1:40721): Couldn't send request to peer 2513a663afac495eb09126ff55e8b2b0. Status: Network error: Client connection negotiation failed: client connection to 127.17.223.1:40721: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:08:32.568038 27631 consensus_peers.cc:597] T 7b77a53b493f4e979fdf38a0b17176b0 P 41268b218b804905a110c86738e74400 -> Peer 2513a663afac495eb09126ff55e8b2b0 (127.17.223.1:40721): Couldn't send request to peer 2513a663afac495eb09126ff55e8b2b0. Status: Network error: Client connection negotiation failed: client connection to 127.17.223.1:40721: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:08:32.573513 28413 consensus_queue.cc:1048] T ae05961ab7a94458b1ad2cde9785c63b P 18435fbb525741328139e84a1e354954 [LEADER]: Connected to new peer: Peer: permanent_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 38749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:08:32.586225 27490 catalog_manager.cc:5697] T 64490a86db8c4f5ca54f4f8085f41319 P 18435fbb525741328139e84a1e354954 reported cstate change: term changed from 1 to 2, leader changed from 2513a663afac495eb09126ff55e8b2b0 (127.17.223.1) to 18435fbb525741328139e84a1e354954 (127.17.223.4). New cstate: current_term: 2 leader_uuid: "18435fbb525741328139e84a1e354954" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 38749 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "18435fbb525741328139e84a1e354954" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 40545 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2513a663afac495eb09126ff55e8b2b0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40721 } health_report { overall_health: UNKNOWN } } }
W20260709 13:08:32.610545 27779 consensus_peers.cc:597] T ae05961ab7a94458b1ad2cde9785c63b P 18435fbb525741328139e84a1e354954 -> Peer 2513a663afac495eb09126ff55e8b2b0 (127.17.223.1:40721): Couldn't send request to peer 2513a663afac495eb09126ff55e8b2b0. Status: Network error: Client connection negotiation failed: client connection to 127.17.223.1:40721: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:08:32.618440 27631 consensus_peers.cc:597] T 47b65672307641ae81d5f94c639b1a10 P 41268b218b804905a110c86738e74400 -> Peer 2513a663afac495eb09126ff55e8b2b0 (127.17.223.1:40721): Couldn't send request to peer 2513a663afac495eb09126ff55e8b2b0. Status: Network error: Client connection negotiation failed: client connection to 127.17.223.1:40721: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:08:32.676827 27779 consensus_peers.cc:597] T 5a55d1bac7374ff6b83cc7bae2d3b1f3 P 18435fbb525741328139e84a1e354954 -> Peer 2513a663afac495eb09126ff55e8b2b0 (127.17.223.1:40721): Couldn't send request to peer 2513a663afac495eb09126ff55e8b2b0. Status: Network error: Client connection negotiation failed: client connection to 127.17.223.1:40721: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:08:32.681890 27631 consensus_peers.cc:597] T 15a4c537259e4b2882a5cc8e723b260a P 41268b218b804905a110c86738e74400 -> Peer 2513a663afac495eb09126ff55e8b2b0 (127.17.223.1:40721): Couldn't send request to peer 2513a663afac495eb09126ff55e8b2b0. Status: Network error: Client connection negotiation failed: client connection to 127.17.223.1:40721: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:08:32.710803 27705 consensus_peers.cc:597] T 8e758d59bd4a4eae9f67662e165013f9 P 665f7e09521a4c3f9284c1d8b0e094ff -> Peer 2513a663afac495eb09126ff55e8b2b0 (127.17.223.1:40721): Couldn't send request to peer 2513a663afac495eb09126ff55e8b2b0. Status: Network error: Client connection negotiation failed: client connection to 127.17.223.1:40721: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:08:32.711289 27705 consensus_peers.cc:597] T 2d68b1be563949efbcb4bbe71eddd0d8 P 665f7e09521a4c3f9284c1d8b0e094ff -> Peer 2513a663afac495eb09126ff55e8b2b0 (127.17.223.1:40721): Couldn't send request to peer 2513a663afac495eb09126ff55e8b2b0. Status: Network error: Client connection negotiation failed: client connection to 127.17.223.1:40721: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:08:32.712357 27631 consensus_peers.cc:597] T 28737c73be174729ad3e9d238af7d975 P 41268b218b804905a110c86738e74400 -> Peer 2513a663afac495eb09126ff55e8b2b0 (127.17.223.1:40721): Couldn't send request to peer 2513a663afac495eb09126ff55e8b2b0. Status: Network error: Client connection negotiation failed: client connection to 127.17.223.1:40721: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:08:32.719465 27815 raft_consensus.cc:1275] T 2d68b1be563949efbcb4bbe71eddd0d8 P 18435fbb525741328139e84a1e354954 [term 2 FOLLOWER]: Refusing update from remote peer 665f7e09521a4c3f9284c1d8b0e094ff: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:08:32.720726 28389 consensus_queue.cc:1048] T 2d68b1be563949efbcb4bbe71eddd0d8 P 665f7e09521a4c3f9284c1d8b0e094ff [LEADER]: Connected to new peer: Peer: permanent_uuid: "18435fbb525741328139e84a1e354954" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 40545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:08:32.738750 27705 consensus_peers.cc:597] T c9ea919812394c7aba307c2ff5b81f51 P 665f7e09521a4c3f9284c1d8b0e094ff -> Peer 2513a663afac495eb09126ff55e8b2b0 (127.17.223.1:40721): Couldn't send request to peer 2513a663afac495eb09126ff55e8b2b0. Status: Network error: Client connection negotiation failed: client connection to 127.17.223.1:40721: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:08:32.743427 27779 consensus_peers.cc:597] T bc0b10615ecb4485a9a9de298938697d P 18435fbb525741328139e84a1e354954 -> Peer 2513a663afac495eb09126ff55e8b2b0 (127.17.223.1:40721): Couldn't send request to peer 2513a663afac495eb09126ff55e8b2b0. Status: Network error: Client connection negotiation failed: client connection to 127.17.223.1:40721: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:08:32.757462 27779 consensus_peers.cc:597] T e5847d81a5284a44a6b2b21cf6f4351c P 18435fbb525741328139e84a1e354954 -> Peer 2513a663afac495eb09126ff55e8b2b0 (127.17.223.1:40721): Couldn't send request to peer 2513a663afac495eb09126ff55e8b2b0. Status: Network error: Client connection negotiation failed: client connection to 127.17.223.1:40721: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:08:32.764925 27705 consensus_peers.cc:597] T 456941807b254f5fb32dca4f84bd16ea P 665f7e09521a4c3f9284c1d8b0e094ff -> Peer 2513a663afac495eb09126ff55e8b2b0 (127.17.223.1:40721): Couldn't send request to peer 2513a663afac495eb09126ff55e8b2b0. Status: Network error: Client connection negotiation failed: client connection to 127.17.223.1:40721: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:08:32.769565 27705 consensus_peers.cc:597] T ea92a607c73b4d289d081146089a86f9 P 665f7e09521a4c3f9284c1d8b0e094ff -> Peer 2513a663afac495eb09126ff55e8b2b0 (127.17.223.1:40721): Couldn't send request to peer 2513a663afac495eb09126ff55e8b2b0. Status: Network error: Client connection negotiation failed: client connection to 127.17.223.1:40721: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:08:32.771405 27779 consensus_peers.cc:597] T ff09d7e79a3e43918f3c71d10a40d60b P 18435fbb525741328139e84a1e354954 -> Peer 2513a663afac495eb09126ff55e8b2b0 (127.17.223.1:40721): Couldn't send request to peer 2513a663afac495eb09126ff55e8b2b0. Status: Network error: Client connection negotiation failed: client connection to 127.17.223.1:40721: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:08:32.774017 27779 consensus_peers.cc:597] T 80e2477670ec4db18ad338931d714544 P 18435fbb525741328139e84a1e354954 -> Peer 2513a663afac495eb09126ff55e8b2b0 (127.17.223.1:40721): Couldn't send request to peer 2513a663afac495eb09126ff55e8b2b0. Status: Network error: Client connection negotiation failed: client connection to 127.17.223.1:40721: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:08:32.786525 27705 consensus_peers.cc:597] T 85cdd21b7a5f4db7af44327c57c16d43 P 665f7e09521a4c3f9284c1d8b0e094ff -> Peer 2513a663afac495eb09126ff55e8b2b0 (127.17.223.1:40721): Couldn't send request to peer 2513a663afac495eb09126ff55e8b2b0. Status: Network error: Client connection negotiation failed: client connection to 127.17.223.1:40721: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:08:32.790642 27631 consensus_peers.cc:597] T bc77856749a0473a8b3124ce8c523815 P 41268b218b804905a110c86738e74400 -> Peer 2513a663afac495eb09126ff55e8b2b0 (127.17.223.1:40721): Couldn't send request to peer 2513a663afac495eb09126ff55e8b2b0. Status: Network error: Client connection negotiation failed: client connection to 127.17.223.1:40721: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:08:32.796937 27779 consensus_peers.cc:597] T e9b149d77d9941158ead8e9e592e7b27 P 18435fbb525741328139e84a1e354954 -> Peer 2513a663afac495eb09126ff55e8b2b0 (127.17.223.1:40721): Couldn't send request to peer 2513a663afac495eb09126ff55e8b2b0. Status: Network error: Client connection negotiation failed: client connection to 127.17.223.1:40721: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:08:32.807487 27667 raft_consensus.cc:1275] T 456941807b254f5fb32dca4f84bd16ea P 41268b218b804905a110c86738e74400 [term 2 FOLLOWER]: Refusing update from remote peer 665f7e09521a4c3f9284c1d8b0e094ff: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:08:32.810192 28400 consensus_queue.cc:1048] T 456941807b254f5fb32dca4f84bd16ea P 665f7e09521a4c3f9284c1d8b0e094ff [LEADER]: Connected to new peer: Peer: permanent_uuid: "41268b218b804905a110c86738e74400" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 44403 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:08:32.817440 27705 consensus_peers.cc:597] T 1a26f012cd6e4c4c8bf86b5fda903800 P 665f7e09521a4c3f9284c1d8b0e094ff -> Peer 2513a663afac495eb09126ff55e8b2b0 (127.17.223.1:40721): Couldn't send request to peer 2513a663afac495eb09126ff55e8b2b0. Status: Network error: Client connection negotiation failed: client connection to 127.17.223.1:40721: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:08:32.831439 27631 consensus_peers.cc:597] T 2d994cb13f8f453284bcb1f8b85824a2 P 41268b218b804905a110c86738e74400 -> Peer 2513a663afac495eb09126ff55e8b2b0 (127.17.223.1:40721): Couldn't send request to peer 2513a663afac495eb09126ff55e8b2b0. Status: Network error: Client connection negotiation failed: client connection to 127.17.223.1:40721: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:08:32.834204 27815 raft_consensus.cc:1275] T 2d994cb13f8f453284bcb1f8b85824a2 P 18435fbb525741328139e84a1e354954 [term 2 FOLLOWER]: Refusing update from remote peer 41268b218b804905a110c86738e74400: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:08:32.837544 28405 consensus_queue.cc:1048] T 2d994cb13f8f453284bcb1f8b85824a2 P 41268b218b804905a110c86738e74400 [LEADER]: Connected to new peer: Peer: permanent_uuid: "18435fbb525741328139e84a1e354954" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 40545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:08:32.857051 27666 raft_consensus.cc:1275] T bc0b10615ecb4485a9a9de298938697d P 41268b218b804905a110c86738e74400 [term 2 FOLLOWER]: Refusing update from remote peer 18435fbb525741328139e84a1e354954: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 13:08:32.857050 27779 consensus_peers.cc:597] T a9eac7f072de454a8ff2beb019da45d9 P 18435fbb525741328139e84a1e354954 -> Peer 2513a663afac495eb09126ff55e8b2b0 (127.17.223.1:40721): Couldn't send request to peer 2513a663afac495eb09126ff55e8b2b0. Status: Network error: Client connection negotiation failed: client connection to 127.17.223.1:40721: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:08:32.860178 28409 consensus_queue.cc:1048] T bc0b10615ecb4485a9a9de298938697d P 18435fbb525741328139e84a1e354954 [LEADER]: Connected to new peer: Peer: permanent_uuid: "41268b218b804905a110c86738e74400" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 44403 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:08:32.867568 27665 raft_consensus.cc:1275] T a9eac7f072de454a8ff2beb019da45d9 P 41268b218b804905a110c86738e74400 [term 2 FOLLOWER]: Refusing update from remote peer 18435fbb525741328139e84a1e354954: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 13:08:32.863497 27631 consensus_peers.cc:597] T dd959195de1942f7999397a56496f5bc P 41268b218b804905a110c86738e74400 -> Peer 2513a663afac495eb09126ff55e8b2b0 (127.17.223.1:40721): Couldn't send request to peer 2513a663afac495eb09126ff55e8b2b0. Status: Network error: Client connection negotiation failed: client connection to 127.17.223.1:40721: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:08:32.874157 28409 consensus_queue.cc:1048] T a9eac7f072de454a8ff2beb019da45d9 P 18435fbb525741328139e84a1e354954 [LEADER]: Connected to new peer: Peer: permanent_uuid: "41268b218b804905a110c86738e74400" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 44403 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.007s
I20260709 13:08:32.881013 27737 raft_consensus.cc:1275] T 80e2477670ec4db18ad338931d714544 P 665f7e09521a4c3f9284c1d8b0e094ff [term 2 FOLLOWER]: Refusing update from remote peer 18435fbb525741328139e84a1e354954: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:08:32.885059 27740 raft_consensus.cc:1275] T 64490a86db8c4f5ca54f4f8085f41319 P 665f7e09521a4c3f9284c1d8b0e094ff [term 2 FOLLOWER]: Refusing update from remote peer 18435fbb525741328139e84a1e354954: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 13:08:32.885259 27631 consensus_peers.cc:597] T 93c69c92efc3402e8e9546cb961bbcdc P 41268b218b804905a110c86738e74400 -> Peer 2513a663afac495eb09126ff55e8b2b0 (127.17.223.1:40721): Couldn't send request to peer 2513a663afac495eb09126ff55e8b2b0. Status: Network error: Client connection negotiation failed: client connection to 127.17.223.1:40721: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:08:32.887120 27667 raft_consensus.cc:1275] T 3a7da70e9f0f49a9bf60184a8f0b5339 P 41268b218b804905a110c86738e74400 [term 2 FOLLOWER]: Refusing update from remote peer 18435fbb525741328139e84a1e354954: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:08:32.893935 28379 consensus_queue.cc:1048] T 80e2477670ec4db18ad338931d714544 P 18435fbb525741328139e84a1e354954 [LEADER]: Connected to new peer: Peer: permanent_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 38749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:08:32.896021 28379 consensus_queue.cc:1048] T 64490a86db8c4f5ca54f4f8085f41319 P 18435fbb525741328139e84a1e354954 [LEADER]: Connected to new peer: Peer: permanent_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 38749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:08:32.894744 27705 consensus_peers.cc:597] T 5e6f8bdfe11b4af4aa27a711db7cbe7a P 665f7e09521a4c3f9284c1d8b0e094ff -> Peer 2513a663afac495eb09126ff55e8b2b0 (127.17.223.1:40721): Couldn't send request to peer 2513a663afac495eb09126ff55e8b2b0. Status: Network error: Client connection negotiation failed: client connection to 127.17.223.1:40721: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:08:32.915994 28409 consensus_queue.cc:1048] T 3a7da70e9f0f49a9bf60184a8f0b5339 P 18435fbb525741328139e84a1e354954 [LEADER]: Connected to new peer: Peer: permanent_uuid: "41268b218b804905a110c86738e74400" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 44403 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
W20260709 13:08:32.923187 18300 thread.cc:527] Waited for 2000ms trying to join with diag-logger (tid 27614)
W20260709 13:08:32.962311 27705 consensus_peers.cc:597] T 8d1aa996b2034de7b2d77545de68e73c P 665f7e09521a4c3f9284c1d8b0e094ff -> Peer 2513a663afac495eb09126ff55e8b2b0 (127.17.223.1:40721): Couldn't send request to peer 2513a663afac495eb09126ff55e8b2b0. Status: Network error: Client connection negotiation failed: client connection to 127.17.223.1:40721: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:08:32.962908 27705 consensus_peers.cc:597] T fb246ce2984c4a6393f12f75083c9fcf P 665f7e09521a4c3f9284c1d8b0e094ff -> Peer 2513a663afac495eb09126ff55e8b2b0 (127.17.223.1:40721): Couldn't send request to peer 2513a663afac495eb09126ff55e8b2b0. Status: Network error: Client connection negotiation failed: client connection to 127.17.223.1:40721: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:08:32.967053 27705 consensus_peers.cc:597] T 1cd5e6e9b36d4591961cb379d7065be9 P 665f7e09521a4c3f9284c1d8b0e094ff -> Peer 2513a663afac495eb09126ff55e8b2b0 (127.17.223.1:40721): Couldn't send request to peer 2513a663afac495eb09126ff55e8b2b0. Status: Network error: Client connection negotiation failed: client connection to 127.17.223.1:40721: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:08:32.971158 27705 consensus_peers.cc:597] T 9db60240699a4db2ba5faa2c50a742da P 665f7e09521a4c3f9284c1d8b0e094ff -> Peer 2513a663afac495eb09126ff55e8b2b0 (127.17.223.1:40721): Couldn't send request to peer 2513a663afac495eb09126ff55e8b2b0. Status: Network error: Client connection negotiation failed: client connection to 127.17.223.1:40721: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:08:32.982831 27779 consensus_peers.cc:597] T 55a3afc21cea43ea85f4a2155552422d P 18435fbb525741328139e84a1e354954 -> Peer 2513a663afac495eb09126ff55e8b2b0 (127.17.223.1:40721): Couldn't send request to peer 2513a663afac495eb09126ff55e8b2b0. Status: Network error: Client connection negotiation failed: client connection to 127.17.223.1:40721: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:08:32.983403 27779 consensus_peers.cc:597] T 3a7da70e9f0f49a9bf60184a8f0b5339 P 18435fbb525741328139e84a1e354954 -> Peer 2513a663afac495eb09126ff55e8b2b0 (127.17.223.1:40721): Couldn't send request to peer 2513a663afac495eb09126ff55e8b2b0. Status: Network error: Client connection negotiation failed: client connection to 127.17.223.1:40721: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:08:32.986907 27782 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.2:44403, user_credentials={real_user=slave}} blocked reactor thread for 51015.5us
W20260709 13:08:33.000267 27631 consensus_peers.cc:597] T 4cd7359accee42808761c37543247321 P 41268b218b804905a110c86738e74400 -> Peer 2513a663afac495eb09126ff55e8b2b0 (127.17.223.1:40721): Couldn't send request to peer 2513a663afac495eb09126ff55e8b2b0. Status: Network error: Client connection negotiation failed: client connection to 127.17.223.1:40721: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:08:33.011426 27779 consensus_peers.cc:597] T 64490a86db8c4f5ca54f4f8085f41319 P 18435fbb525741328139e84a1e354954 -> Peer 2513a663afac495eb09126ff55e8b2b0 (127.17.223.1:40721): Couldn't send request to peer 2513a663afac495eb09126ff55e8b2b0. Status: Network error: Client connection negotiation failed: client connection to 127.17.223.1:40721: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:08:33.019222 27705 consensus_peers.cc:597] T e23b142958324f69aa0bad3a5828fa83 P 665f7e09521a4c3f9284c1d8b0e094ff -> Peer 2513a663afac495eb09126ff55e8b2b0 (127.17.223.1:40721): Couldn't send request to peer 2513a663afac495eb09126ff55e8b2b0. Status: Network error: Client connection negotiation failed: client connection to 127.17.223.1:40721: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:08:33.043540 27631 consensus_peers.cc:597] T d0c8b4ec2d844a89b4bb66c0f1bf2c8f P 41268b218b804905a110c86738e74400 -> Peer 2513a663afac495eb09126ff55e8b2b0 (127.17.223.1:40721): Couldn't send request to peer 2513a663afac495eb09126ff55e8b2b0. Status: Network error: Client connection negotiation failed: client connection to 127.17.223.1:40721: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:08:33.065127 27631 consensus_peers.cc:597] T 866a01285ca8436385f8d16dcfb0d4e3 P 41268b218b804905a110c86738e74400 -> Peer 2513a663afac495eb09126ff55e8b2b0 (127.17.223.1:40721): Couldn't send request to peer 2513a663afac495eb09126ff55e8b2b0. Status: Network error: Client connection negotiation failed: client connection to 127.17.223.1:40721: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:08:33.119019 27705 consensus_peers.cc:597] T 78e19c035a854ee98657bec3edcb3585 P 665f7e09521a4c3f9284c1d8b0e094ff -> Peer 2513a663afac495eb09126ff55e8b2b0 (127.17.223.1:40721): Couldn't send request to peer 2513a663afac495eb09126ff55e8b2b0. Status: Network error: Client connection negotiation failed: client connection to 127.17.223.1:40721: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:08:33.123054 27631 consensus_peers.cc:597] T de531c50b1524ec788b27bc4b883689a P 41268b218b804905a110c86738e74400 -> Peer 2513a663afac495eb09126ff55e8b2b0 (127.17.223.1:40721): Couldn't send request to peer 2513a663afac495eb09126ff55e8b2b0. Status: Network error: Client connection negotiation failed: client connection to 127.17.223.1:40721: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:08:33.177784 27631 consensus_peers.cc:597] T 765d0bd527c64f74be713c390a018bba P 41268b218b804905a110c86738e74400 -> Peer 2513a663afac495eb09126ff55e8b2b0 (127.17.223.1:40721): Couldn't send request to peer 2513a663afac495eb09126ff55e8b2b0. Status: Network error: Client connection negotiation failed: client connection to 127.17.223.1:40721: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:08:33.296823 27705 consensus_peers.cc:597] T 585e960f8d0f42268f2fe98e1e7b83f0 P 665f7e09521a4c3f9284c1d8b0e094ff -> Peer 2513a663afac495eb09126ff55e8b2b0 (127.17.223.1:40721): Couldn't send request to peer 2513a663afac495eb09126ff55e8b2b0. Status: Network error: Client connection negotiation failed: client connection to 127.17.223.1:40721: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:08:33.926754 18300 thread.cc:527] Waited for 3000ms trying to join with diag-logger (tid 27614)
I20260709 13:08:33.932219 28446 raft_consensus.cc:493] T 18f991bbbf3a4615aab49899c7ef86dc P 665f7e09521a4c3f9284c1d8b0e094ff [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:33.932816 28446 raft_consensus.cc:515] T 18f991bbbf3a4615aab49899c7ef86dc P 665f7e09521a4c3f9284c1d8b0e094ff [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2513a663afac495eb09126ff55e8b2b0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40721 } } peers { permanent_uuid: "18435fbb525741328139e84a1e354954" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 40545 } } peers { permanent_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 38749 } }
I20260709 13:08:33.935007 28446 leader_election.cc:290] T 18f991bbbf3a4615aab49899c7ef86dc P 665f7e09521a4c3f9284c1d8b0e094ff [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2513a663afac495eb09126ff55e8b2b0 (127.17.223.1:40721), 18435fbb525741328139e84a1e354954 (127.17.223.4:40545)
I20260709 13:08:33.936321 27813 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18f991bbbf3a4615aab49899c7ef86dc" candidate_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "18435fbb525741328139e84a1e354954" is_pre_election: true
I20260709 13:08:33.937021 27813 raft_consensus.cc:2468] T 18f991bbbf3a4615aab49899c7ef86dc P 18435fbb525741328139e84a1e354954 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 665f7e09521a4c3f9284c1d8b0e094ff in term 2.
I20260709 13:08:33.938184 27708 leader_election.cc:304] T 18f991bbbf3a4615aab49899c7ef86dc P 665f7e09521a4c3f9284c1d8b0e094ff [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 18435fbb525741328139e84a1e354954, 665f7e09521a4c3f9284c1d8b0e094ff; no voters: 
I20260709 13:08:33.939018 28446 raft_consensus.cc:2804] T 18f991bbbf3a4615aab49899c7ef86dc P 665f7e09521a4c3f9284c1d8b0e094ff [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:08:33.939407 28446 raft_consensus.cc:493] T 18f991bbbf3a4615aab49899c7ef86dc P 665f7e09521a4c3f9284c1d8b0e094ff [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:33.939749 28446 raft_consensus.cc:3060] T 18f991bbbf3a4615aab49899c7ef86dc P 665f7e09521a4c3f9284c1d8b0e094ff [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:08:33.941274 27705 leader_election.cc:336] T 18f991bbbf3a4615aab49899c7ef86dc P 665f7e09521a4c3f9284c1d8b0e094ff [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 2513a663afac495eb09126ff55e8b2b0 (127.17.223.1:40721): Network error: Client connection negotiation failed: client connection to 127.17.223.1:40721: connect: Connection refused (error 111)
I20260709 13:08:33.949347 28446 raft_consensus.cc:515] T 18f991bbbf3a4615aab49899c7ef86dc P 665f7e09521a4c3f9284c1d8b0e094ff [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2513a663afac495eb09126ff55e8b2b0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40721 } } peers { permanent_uuid: "18435fbb525741328139e84a1e354954" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 40545 } } peers { permanent_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 38749 } }
I20260709 13:08:33.971400 27813 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18f991bbbf3a4615aab49899c7ef86dc" candidate_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "18435fbb525741328139e84a1e354954"
I20260709 13:08:33.972016 27813 raft_consensus.cc:3060] T 18f991bbbf3a4615aab49899c7ef86dc P 18435fbb525741328139e84a1e354954 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:33.980357 28446 leader_election.cc:290] T 18f991bbbf3a4615aab49899c7ef86dc P 665f7e09521a4c3f9284c1d8b0e094ff [CANDIDATE]: Term 3 election: Requested vote from peers 2513a663afac495eb09126ff55e8b2b0 (127.17.223.1:40721), 18435fbb525741328139e84a1e354954 (127.17.223.4:40545)
W20260709 13:08:33.981223 27705 leader_election.cc:336] T 18f991bbbf3a4615aab49899c7ef86dc P 665f7e09521a4c3f9284c1d8b0e094ff [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer 2513a663afac495eb09126ff55e8b2b0 (127.17.223.1:40721): Network error: Client connection negotiation failed: client connection to 127.17.223.1:40721: connect: Connection refused (error 111)
I20260709 13:08:33.982453 27813 raft_consensus.cc:2468] T 18f991bbbf3a4615aab49899c7ef86dc P 18435fbb525741328139e84a1e354954 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 665f7e09521a4c3f9284c1d8b0e094ff in term 3.
I20260709 13:08:33.985038 27708 leader_election.cc:304] T 18f991bbbf3a4615aab49899c7ef86dc P 665f7e09521a4c3f9284c1d8b0e094ff [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 18435fbb525741328139e84a1e354954, 665f7e09521a4c3f9284c1d8b0e094ff; no voters: 2513a663afac495eb09126ff55e8b2b0
I20260709 13:08:33.985855 28446 raft_consensus.cc:2804] T 18f991bbbf3a4615aab49899c7ef86dc P 665f7e09521a4c3f9284c1d8b0e094ff [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:08:33.986400 28446 raft_consensus.cc:697] T 18f991bbbf3a4615aab49899c7ef86dc P 665f7e09521a4c3f9284c1d8b0e094ff [term 3 LEADER]: Becoming Leader. State: Replica: 665f7e09521a4c3f9284c1d8b0e094ff, State: Running, Role: LEADER
I20260709 13:08:33.987425 28446 consensus_queue.cc:237] T 18f991bbbf3a4615aab49899c7ef86dc P 665f7e09521a4c3f9284c1d8b0e094ff [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2513a663afac495eb09126ff55e8b2b0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40721 } } peers { permanent_uuid: "18435fbb525741328139e84a1e354954" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 40545 } } peers { permanent_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 38749 } }
I20260709 13:08:34.000224 27489 catalog_manager.cc:5697] T 18f991bbbf3a4615aab49899c7ef86dc P 665f7e09521a4c3f9284c1d8b0e094ff reported cstate change: term changed from 1 to 3, leader changed from 2513a663afac495eb09126ff55e8b2b0 (127.17.223.1) to 665f7e09521a4c3f9284c1d8b0e094ff (127.17.223.3). New cstate: current_term: 3 leader_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2513a663afac495eb09126ff55e8b2b0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40721 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "18435fbb525741328139e84a1e354954" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 40545 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 38749 } health_report { overall_health: HEALTHY } } }
I20260709 13:08:34.040668 28408 raft_consensus.cc:493] T 11224ef6c00a40cdba4311ceb63bddb9 P 18435fbb525741328139e84a1e354954 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:34.041286 28408 raft_consensus.cc:515] T 11224ef6c00a40cdba4311ceb63bddb9 P 18435fbb525741328139e84a1e354954 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 38749 } } peers { permanent_uuid: "18435fbb525741328139e84a1e354954" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 40545 } } peers { permanent_uuid: "2513a663afac495eb09126ff55e8b2b0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40721 } }
I20260709 13:08:34.043579 28408 leader_election.cc:290] T 11224ef6c00a40cdba4311ceb63bddb9 P 18435fbb525741328139e84a1e354954 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 665f7e09521a4c3f9284c1d8b0e094ff (127.17.223.3:38749), 2513a663afac495eb09126ff55e8b2b0 (127.17.223.1:40721)
I20260709 13:08:34.044436 27737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11224ef6c00a40cdba4311ceb63bddb9" candidate_uuid: "18435fbb525741328139e84a1e354954" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" is_pre_election: true
I20260709 13:08:34.047950 27737 raft_consensus.cc:2468] T 11224ef6c00a40cdba4311ceb63bddb9 P 665f7e09521a4c3f9284c1d8b0e094ff [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 18435fbb525741328139e84a1e354954 in term 2.
W20260709 13:08:34.048700 27779 leader_election.cc:336] T 11224ef6c00a40cdba4311ceb63bddb9 P 18435fbb525741328139e84a1e354954 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 2513a663afac495eb09126ff55e8b2b0 (127.17.223.1:40721): Network error: Client connection negotiation failed: client connection to 127.17.223.1:40721: connect: Connection refused (error 111)
I20260709 13:08:34.049280 27782 leader_election.cc:304] T 11224ef6c00a40cdba4311ceb63bddb9 P 18435fbb525741328139e84a1e354954 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 18435fbb525741328139e84a1e354954, 665f7e09521a4c3f9284c1d8b0e094ff; no voters: 2513a663afac495eb09126ff55e8b2b0
I20260709 13:08:34.049985 28408 raft_consensus.cc:2804] T 11224ef6c00a40cdba4311ceb63bddb9 P 18435fbb525741328139e84a1e354954 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:08:34.050380 28408 raft_consensus.cc:493] T 11224ef6c00a40cdba4311ceb63bddb9 P 18435fbb525741328139e84a1e354954 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:34.050709 28408 raft_consensus.cc:3060] T 11224ef6c00a40cdba4311ceb63bddb9 P 18435fbb525741328139e84a1e354954 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:34.058341 28408 raft_consensus.cc:515] T 11224ef6c00a40cdba4311ceb63bddb9 P 18435fbb525741328139e84a1e354954 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 38749 } } peers { permanent_uuid: "18435fbb525741328139e84a1e354954" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 40545 } } peers { permanent_uuid: "2513a663afac495eb09126ff55e8b2b0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40721 } }
I20260709 13:08:34.061401 27737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11224ef6c00a40cdba4311ceb63bddb9" candidate_uuid: "18435fbb525741328139e84a1e354954" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "665f7e09521a4c3f9284c1d8b0e094ff"
I20260709 13:08:34.062012 27737 raft_consensus.cc:3060] T 11224ef6c00a40cdba4311ceb63bddb9 P 665f7e09521a4c3f9284c1d8b0e094ff [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:08:34.065757 27779 leader_election.cc:336] T 11224ef6c00a40cdba4311ceb63bddb9 P 18435fbb525741328139e84a1e354954 [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer 2513a663afac495eb09126ff55e8b2b0 (127.17.223.1:40721): Network error: Client connection negotiation failed: client connection to 127.17.223.1:40721: connect: Connection refused (error 111)
I20260709 13:08:34.068040 28408 leader_election.cc:290] T 11224ef6c00a40cdba4311ceb63bddb9 P 18435fbb525741328139e84a1e354954 [CANDIDATE]: Term 3 election: Requested vote from peers 665f7e09521a4c3f9284c1d8b0e094ff (127.17.223.3:38749), 2513a663afac495eb09126ff55e8b2b0 (127.17.223.1:40721)
I20260709 13:08:34.069473 27737 raft_consensus.cc:2468] T 11224ef6c00a40cdba4311ceb63bddb9 P 665f7e09521a4c3f9284c1d8b0e094ff [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 18435fbb525741328139e84a1e354954 in term 3.
I20260709 13:08:34.070690 27782 leader_election.cc:304] T 11224ef6c00a40cdba4311ceb63bddb9 P 18435fbb525741328139e84a1e354954 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 18435fbb525741328139e84a1e354954, 665f7e09521a4c3f9284c1d8b0e094ff; no voters: 2513a663afac495eb09126ff55e8b2b0
I20260709 13:08:34.071416 28408 raft_consensus.cc:2804] T 11224ef6c00a40cdba4311ceb63bddb9 P 18435fbb525741328139e84a1e354954 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:08:34.071987 28408 raft_consensus.cc:697] T 11224ef6c00a40cdba4311ceb63bddb9 P 18435fbb525741328139e84a1e354954 [term 3 LEADER]: Becoming Leader. State: Replica: 18435fbb525741328139e84a1e354954, State: Running, Role: LEADER
I20260709 13:08:34.072964 28408 consensus_queue.cc:237] T 11224ef6c00a40cdba4311ceb63bddb9 P 18435fbb525741328139e84a1e354954 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 38749 } } peers { permanent_uuid: "18435fbb525741328139e84a1e354954" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 40545 } } peers { permanent_uuid: "2513a663afac495eb09126ff55e8b2b0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40721 } }
I20260709 13:08:34.084888 27489 catalog_manager.cc:5697] T 11224ef6c00a40cdba4311ceb63bddb9 P 18435fbb525741328139e84a1e354954 reported cstate change: term changed from 1 to 3, leader changed from 2513a663afac495eb09126ff55e8b2b0 (127.17.223.1) to 18435fbb525741328139e84a1e354954 (127.17.223.4). New cstate: current_term: 3 leader_uuid: "18435fbb525741328139e84a1e354954" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 38749 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "18435fbb525741328139e84a1e354954" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 40545 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2513a663afac495eb09126ff55e8b2b0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40721 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:34.402750 27813 raft_consensus.cc:1275] T 18f991bbbf3a4615aab49899c7ef86dc P 18435fbb525741328139e84a1e354954 [term 3 FOLLOWER]: Refusing update from remote peer 665f7e09521a4c3f9284c1d8b0e094ff: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:08:34.404114 28403 consensus_queue.cc:1048] T 18f991bbbf3a4615aab49899c7ef86dc P 665f7e09521a4c3f9284c1d8b0e094ff [LEADER]: Connected to new peer: Peer: permanent_uuid: "18435fbb525741328139e84a1e354954" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 40545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:08:34.432578 27705 consensus_peers.cc:597] T 18f991bbbf3a4615aab49899c7ef86dc P 665f7e09521a4c3f9284c1d8b0e094ff -> Peer 2513a663afac495eb09126ff55e8b2b0 (127.17.223.1:40721): Couldn't send request to peer 2513a663afac495eb09126ff55e8b2b0. Status: Network error: Client connection negotiation failed: client connection to 127.17.223.1:40721: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:08:34.469019 27779 consensus_peers.cc:597] T 11224ef6c00a40cdba4311ceb63bddb9 P 18435fbb525741328139e84a1e354954 -> Peer 2513a663afac495eb09126ff55e8b2b0 (127.17.223.1:40721): Couldn't send request to peer 2513a663afac495eb09126ff55e8b2b0. Status: Network error: Client connection negotiation failed: client connection to 127.17.223.1:40721: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:08:34.508288 27740 raft_consensus.cc:1275] T 11224ef6c00a40cdba4311ceb63bddb9 P 665f7e09521a4c3f9284c1d8b0e094ff [term 3 FOLLOWER]: Refusing update from remote peer 18435fbb525741328139e84a1e354954: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:08:34.510171 28408 consensus_queue.cc:1048] T 11224ef6c00a40cdba4311ceb63bddb9 P 18435fbb525741328139e84a1e354954 [LEADER]: Connected to new peer: Peer: permanent_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 38749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
W20260709 13:08:34.827394 27631 consensus_peers.cc:597] T bbd0bdc9640c4956a5d60406841ef0f0 P 41268b218b804905a110c86738e74400 -> Peer 2513a663afac495eb09126ff55e8b2b0 (127.17.223.1:40721): Couldn't send request to peer 2513a663afac495eb09126ff55e8b2b0. Status: Network error: Client connection negotiation failed: client connection to 127.17.223.1:40721: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:08:34.866719 27631 consensus_peers.cc:597] T b6be829f6d3f40c99a3c5be18b0c259c P 41268b218b804905a110c86738e74400 -> Peer 2513a663afac495eb09126ff55e8b2b0 (127.17.223.1:40721): Couldn't send request to peer 2513a663afac495eb09126ff55e8b2b0. Status: Network error: Client connection negotiation failed: client connection to 127.17.223.1:40721: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:08:34.908880 27705 consensus_peers.cc:597] T 8e758d59bd4a4eae9f67662e165013f9 P 665f7e09521a4c3f9284c1d8b0e094ff -> Peer 2513a663afac495eb09126ff55e8b2b0 (127.17.223.1:40721): Couldn't send request to peer 2513a663afac495eb09126ff55e8b2b0. Status: Network error: Client connection negotiation failed: client connection to 127.17.223.1:40721: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:08:34.927286 18300 thread.cc:527] Waited for 4000ms trying to join with diag-logger (tid 27614)
W20260709 13:08:35.080278 27779 consensus_peers.cc:597] T e9b149d77d9941158ead8e9e592e7b27 P 18435fbb525741328139e84a1e354954 -> Peer 2513a663afac495eb09126ff55e8b2b0 (127.17.223.1:40721): Couldn't send request to peer 2513a663afac495eb09126ff55e8b2b0. Status: Network error: Client connection negotiation failed: client connection to 127.17.223.1:40721: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:08:35.080976 27631 consensus_peers.cc:597] T 2d994cb13f8f453284bcb1f8b85824a2 P 41268b218b804905a110c86738e74400 -> Peer 2513a663afac495eb09126ff55e8b2b0 (127.17.223.1:40721): Couldn't send request to peer 2513a663afac495eb09126ff55e8b2b0. Status: Network error: Client connection negotiation failed: client connection to 127.17.223.1:40721: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:08:35.081399 27631 consensus_peers.cc:597] T 15a4c537259e4b2882a5cc8e723b260a P 41268b218b804905a110c86738e74400 -> Peer 2513a663afac495eb09126ff55e8b2b0 (127.17.223.1:40721): Couldn't send request to peer 2513a663afac495eb09126ff55e8b2b0. Status: Network error: Client connection negotiation failed: client connection to 127.17.223.1:40721: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:08:35.088856 27705 consensus_peers.cc:597] T 5e6f8bdfe11b4af4aa27a711db7cbe7a P 665f7e09521a4c3f9284c1d8b0e094ff -> Peer 2513a663afac495eb09126ff55e8b2b0 (127.17.223.1:40721): Couldn't send request to peer 2513a663afac495eb09126ff55e8b2b0. Status: Network error: Client connection negotiation failed: client connection to 127.17.223.1:40721: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:08:35.106199 27779 consensus_peers.cc:597] T a9eac7f072de454a8ff2beb019da45d9 P 18435fbb525741328139e84a1e354954 -> Peer 2513a663afac495eb09126ff55e8b2b0 (127.17.223.1:40721): Couldn't send request to peer 2513a663afac495eb09126ff55e8b2b0. Status: Network error: Client connection negotiation failed: client connection to 127.17.223.1:40721: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:08:35.115489 27631 consensus_peers.cc:597] T 7b77a53b493f4e979fdf38a0b17176b0 P 41268b218b804905a110c86738e74400 -> Peer 2513a663afac495eb09126ff55e8b2b0 (127.17.223.1:40721): Couldn't send request to peer 2513a663afac495eb09126ff55e8b2b0. Status: Network error: Client connection negotiation failed: client connection to 127.17.223.1:40721: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:08:35.137858 27631 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.17.223.1:40721: connect: Connection refused (error 111) [suppressed 425 similar messages]
W20260709 13:08:35.139886 27705 consensus_peers.cc:597] T fb246ce2984c4a6393f12f75083c9fcf P 665f7e09521a4c3f9284c1d8b0e094ff -> Peer 2513a663afac495eb09126ff55e8b2b0 (127.17.223.1:40721): Couldn't send request to peer 2513a663afac495eb09126ff55e8b2b0. Status: Network error: Client connection negotiation failed: client connection to 127.17.223.1:40721: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:08:35.155869 27631 consensus_peers.cc:597] T 28737c73be174729ad3e9d238af7d975 P 41268b218b804905a110c86738e74400 -> Peer 2513a663afac495eb09126ff55e8b2b0 (127.17.223.1:40721): Couldn't send request to peer 2513a663afac495eb09126ff55e8b2b0. Status: Network error: Client connection negotiation failed: client connection to 127.17.223.1:40721: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:08:35.180615 27705 consensus_peers.cc:597] T c9ea919812394c7aba307c2ff5b81f51 P 665f7e09521a4c3f9284c1d8b0e094ff -> Peer 2513a663afac495eb09126ff55e8b2b0 (127.17.223.1:40721): Couldn't send request to peer 2513a663afac495eb09126ff55e8b2b0. Status: Network error: Client connection negotiation failed: client connection to 127.17.223.1:40721: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:08:35.194908 27631 consensus_peers.cc:597] T 47b65672307641ae81d5f94c639b1a10 P 41268b218b804905a110c86738e74400 -> Peer 2513a663afac495eb09126ff55e8b2b0 (127.17.223.1:40721): Couldn't send request to peer 2513a663afac495eb09126ff55e8b2b0. Status: Network error: Client connection negotiation failed: client connection to 127.17.223.1:40721: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:08:35.205943 27631 consensus_peers.cc:597] T 86af954f570648969cbc47c03d15c447 P 41268b218b804905a110c86738e74400 -> Peer 2513a663afac495eb09126ff55e8b2b0 (127.17.223.1:40721): Couldn't send request to peer 2513a663afac495eb09126ff55e8b2b0. Status: Network error: Client connection negotiation failed: client connection to 127.17.223.1:40721: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:08:35.232728 27631 consensus_peers.cc:597] T dd959195de1942f7999397a56496f5bc P 41268b218b804905a110c86738e74400 -> Peer 2513a663afac495eb09126ff55e8b2b0 (127.17.223.1:40721): Couldn't send request to peer 2513a663afac495eb09126ff55e8b2b0. Status: Network error: Client connection negotiation failed: client connection to 127.17.223.1:40721: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:08:35.247061 27705 consensus_peers.cc:597] T 456941807b254f5fb32dca4f84bd16ea P 665f7e09521a4c3f9284c1d8b0e094ff -> Peer 2513a663afac495eb09126ff55e8b2b0 (127.17.223.1:40721): Couldn't send request to peer 2513a663afac495eb09126ff55e8b2b0. Status: Network error: Client connection negotiation failed: client connection to 127.17.223.1:40721: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:08:35.252085 27705 consensus_peers.cc:597] T 9c0f604d66664505aa9469fb058601b6 P 665f7e09521a4c3f9284c1d8b0e094ff -> Peer 2513a663afac495eb09126ff55e8b2b0 (127.17.223.1:40721): Couldn't send request to peer 2513a663afac495eb09126ff55e8b2b0. Status: Network error: Client connection negotiation failed: client connection to 127.17.223.1:40721: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:08:35.253201 27631 consensus_peers.cc:597] T 4cd7359accee42808761c37543247321 P 41268b218b804905a110c86738e74400 -> Peer 2513a663afac495eb09126ff55e8b2b0 (127.17.223.1:40721): Couldn't send request to peer 2513a663afac495eb09126ff55e8b2b0. Status: Network error: Client connection negotiation failed: client connection to 127.17.223.1:40721: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:08:35.257718 27779 consensus_peers.cc:597] T 80e2477670ec4db18ad338931d714544 P 18435fbb525741328139e84a1e354954 -> Peer 2513a663afac495eb09126ff55e8b2b0 (127.17.223.1:40721): Couldn't send request to peer 2513a663afac495eb09126ff55e8b2b0. Status: Network error: Client connection negotiation failed: client connection to 127.17.223.1:40721: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:08:35.278481 27779 consensus_peers.cc:597] T e5847d81a5284a44a6b2b21cf6f4351c P 18435fbb525741328139e84a1e354954 -> Peer 2513a663afac495eb09126ff55e8b2b0 (127.17.223.1:40721): Couldn't send request to peer 2513a663afac495eb09126ff55e8b2b0. Status: Network error: Client connection negotiation failed: client connection to 127.17.223.1:40721: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:08:35.287858 27705 consensus_peers.cc:597] T 85cdd21b7a5f4db7af44327c57c16d43 P 665f7e09521a4c3f9284c1d8b0e094ff -> Peer 2513a663afac495eb09126ff55e8b2b0 (127.17.223.1:40721): Couldn't send request to peer 2513a663afac495eb09126ff55e8b2b0. Status: Network error: Client connection negotiation failed: client connection to 127.17.223.1:40721: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:08:35.300379 27779 consensus_peers.cc:597] T 5a55d1bac7374ff6b83cc7bae2d3b1f3 P 18435fbb525741328139e84a1e354954 -> Peer 2513a663afac495eb09126ff55e8b2b0 (127.17.223.1:40721): Couldn't send request to peer 2513a663afac495eb09126ff55e8b2b0. Status: Network error: Client connection negotiation failed: client connection to 127.17.223.1:40721: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:08:35.306371 27631 consensus_peers.cc:597] T 93c69c92efc3402e8e9546cb961bbcdc P 41268b218b804905a110c86738e74400 -> Peer 2513a663afac495eb09126ff55e8b2b0 (127.17.223.1:40721): Couldn't send request to peer 2513a663afac495eb09126ff55e8b2b0. Status: Network error: Client connection negotiation failed: client connection to 127.17.223.1:40721: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:08:35.306856 27705 consensus_peers.cc:597] T ea92a607c73b4d289d081146089a86f9 P 665f7e09521a4c3f9284c1d8b0e094ff -> Peer 2513a663afac495eb09126ff55e8b2b0 (127.17.223.1:40721): Couldn't send request to peer 2513a663afac495eb09126ff55e8b2b0. Status: Network error: Client connection negotiation failed: client connection to 127.17.223.1:40721: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:08:35.317587 27779 consensus_peers.cc:597] T ae05961ab7a94458b1ad2cde9785c63b P 18435fbb525741328139e84a1e354954 -> Peer 2513a663afac495eb09126ff55e8b2b0 (127.17.223.1:40721): Couldn't send request to peer 2513a663afac495eb09126ff55e8b2b0. Status: Network error: Client connection negotiation failed: client connection to 127.17.223.1:40721: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:08:35.333287 27705 consensus_peers.cc:597] T 1a26f012cd6e4c4c8bf86b5fda903800 P 665f7e09521a4c3f9284c1d8b0e094ff -> Peer 2513a663afac495eb09126ff55e8b2b0 (127.17.223.1:40721): Couldn't send request to peer 2513a663afac495eb09126ff55e8b2b0. Status: Network error: Client connection negotiation failed: client connection to 127.17.223.1:40721: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:08:35.334991 27631 consensus_peers.cc:597] T bc77856749a0473a8b3124ce8c523815 P 41268b218b804905a110c86738e74400 -> Peer 2513a663afac495eb09126ff55e8b2b0 (127.17.223.1:40721): Couldn't send request to peer 2513a663afac495eb09126ff55e8b2b0. Status: Network error: Client connection negotiation failed: client connection to 127.17.223.1:40721: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:08:35.336908 27779 consensus_peers.cc:597] T 64490a86db8c4f5ca54f4f8085f41319 P 18435fbb525741328139e84a1e354954 -> Peer 2513a663afac495eb09126ff55e8b2b0 (127.17.223.1:40721): Couldn't send request to peer 2513a663afac495eb09126ff55e8b2b0. Status: Network error: Client connection negotiation failed: client connection to 127.17.223.1:40721: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:08:35.370947 27705 consensus_peers.cc:597] T 1cd5e6e9b36d4591961cb379d7065be9 P 665f7e09521a4c3f9284c1d8b0e094ff -> Peer 2513a663afac495eb09126ff55e8b2b0 (127.17.223.1:40721): Couldn't send request to peer 2513a663afac495eb09126ff55e8b2b0. Status: Network error: Client connection negotiation failed: client connection to 127.17.223.1:40721: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:08:35.373698 27705 consensus_peers.cc:597] T 2d68b1be563949efbcb4bbe71eddd0d8 P 665f7e09521a4c3f9284c1d8b0e094ff -> Peer 2513a663afac495eb09126ff55e8b2b0 (127.17.223.1:40721): Couldn't send request to peer 2513a663afac495eb09126ff55e8b2b0. Status: Network error: Client connection negotiation failed: client connection to 127.17.223.1:40721: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:08:35.414276 27779 consensus_peers.cc:597] T 3a7da70e9f0f49a9bf60184a8f0b5339 P 18435fbb525741328139e84a1e354954 -> Peer 2513a663afac495eb09126ff55e8b2b0 (127.17.223.1:40721): Couldn't send request to peer 2513a663afac495eb09126ff55e8b2b0. Status: Network error: Client connection negotiation failed: client connection to 127.17.223.1:40721: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:08:35.435256 27631 consensus_peers.cc:597] T d0c8b4ec2d844a89b4bb66c0f1bf2c8f P 41268b218b804905a110c86738e74400 -> Peer 2513a663afac495eb09126ff55e8b2b0 (127.17.223.1:40721): Couldn't send request to peer 2513a663afac495eb09126ff55e8b2b0. Status: Network error: Client connection negotiation failed: client connection to 127.17.223.1:40721: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:08:35.439419 27705 consensus_peers.cc:597] T 8d1aa996b2034de7b2d77545de68e73c P 665f7e09521a4c3f9284c1d8b0e094ff -> Peer 2513a663afac495eb09126ff55e8b2b0 (127.17.223.1:40721): Couldn't send request to peer 2513a663afac495eb09126ff55e8b2b0. Status: Network error: Client connection negotiation failed: client connection to 127.17.223.1:40721: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:08:35.494378 27705 consensus_peers.cc:597] T e23b142958324f69aa0bad3a5828fa83 P 665f7e09521a4c3f9284c1d8b0e094ff -> Peer 2513a663afac495eb09126ff55e8b2b0 (127.17.223.1:40721): Couldn't send request to peer 2513a663afac495eb09126ff55e8b2b0. Status: Network error: Client connection negotiation failed: client connection to 127.17.223.1:40721: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:08:35.513324 27779 consensus_peers.cc:597] T bc0b10615ecb4485a9a9de298938697d P 18435fbb525741328139e84a1e354954 -> Peer 2513a663afac495eb09126ff55e8b2b0 (127.17.223.1:40721): Couldn't send request to peer 2513a663afac495eb09126ff55e8b2b0. Status: Network error: Client connection negotiation failed: client connection to 127.17.223.1:40721: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:08:35.543320 27705 consensus_peers.cc:597] T 9db60240699a4db2ba5faa2c50a742da P 665f7e09521a4c3f9284c1d8b0e094ff -> Peer 2513a663afac495eb09126ff55e8b2b0 (127.17.223.1:40721): Couldn't send request to peer 2513a663afac495eb09126ff55e8b2b0. Status: Network error: Client connection negotiation failed: client connection to 127.17.223.1:40721: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:08:35.549757 27779 consensus_peers.cc:597] T ff09d7e79a3e43918f3c71d10a40d60b P 18435fbb525741328139e84a1e354954 -> Peer 2513a663afac495eb09126ff55e8b2b0 (127.17.223.1:40721): Couldn't send request to peer 2513a663afac495eb09126ff55e8b2b0. Status: Network error: Client connection negotiation failed: client connection to 127.17.223.1:40721: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:08:35.608582 18300 tablet_server.cc:196] TabletServer@127.17.223.1:0 shutdown complete.
W20260709 13:08:35.662357 27631 consensus_peers.cc:597] T de531c50b1524ec788b27bc4b883689a P 41268b218b804905a110c86738e74400 -> Peer 2513a663afac495eb09126ff55e8b2b0 (127.17.223.1:40721): Couldn't send request to peer 2513a663afac495eb09126ff55e8b2b0. Status: Network error: Client connection negotiation failed: client connection to 127.17.223.1:40721: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:08:35.662537 27705 consensus_peers.cc:597] T 78e19c035a854ee98657bec3edcb3585 P 665f7e09521a4c3f9284c1d8b0e094ff -> Peer 2513a663afac495eb09126ff55e8b2b0 (127.17.223.1:40721): Couldn't send request to peer 2513a663afac495eb09126ff55e8b2b0. Status: Network error: Client connection negotiation failed: client connection to 127.17.223.1:40721: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:08:35.674352 27631 consensus_peers.cc:597] T 765d0bd527c64f74be713c390a018bba P 41268b218b804905a110c86738e74400 -> Peer 2513a663afac495eb09126ff55e8b2b0 (127.17.223.1:40721): Couldn't send request to peer 2513a663afac495eb09126ff55e8b2b0. Status: Network error: Client connection negotiation failed: client connection to 127.17.223.1:40721: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:08:35.705080 18300 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:08:35.723915 28459 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:08:35.725078 28460 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:08:35.728418 28462 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:08:35.729344 18300 server_base.cc:1061] running on GCE node
I20260709 13:08:35.731397 18300 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:08:35.731743 18300 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:08:35.732060 18300 hybrid_clock.cc:648] HybridClock initialized: now 1783602515732041 us; error 0 us; skew 500 ppm
I20260709 13:08:35.732969 18300 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:08:35.739754 18300 webserver.cc:533] Webserver started at http://127.17.223.1:37355/ using document root <none> and password file <none>
I20260709 13:08:35.740681 18300 fs_manager.cc:362] Metadata directory not provided
I20260709 13:08:35.741108 18300 fs_manager.cc:365] Using existing metadata directory in first data directory
W20260709 13:08:35.742352 27779 consensus_peers.cc:597] T 55a3afc21cea43ea85f4a2155552422d P 18435fbb525741328139e84a1e354954 -> Peer 2513a663afac495eb09126ff55e8b2b0 (127.17.223.1:40721): Couldn't send request to peer 2513a663afac495eb09126ff55e8b2b0. Status: Network error: Client connection negotiation failed: client connection to 127.17.223.1:40721: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:08:35.747109 18300 fs_manager.cc:714] Time spent opening directory manager: real 0.005s	user 0.005s	sys 0.000s
I20260709 13:08:35.782436 28468 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:08:35.785081 18300 fs_manager.cc:730] Time spent opening block manager: real 0.008s	user 0.002s	sys 0.000s
I20260709 13:08:35.785513 18300 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskKd2k48/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602220613947-18300-0/minicluster-data/ts-0-root
uuid: "2513a663afac495eb09126ff55e8b2b0"
format_stamp: "Formatted at 2026-07-09 13:08:17 on dist-test-slave-vl1s"
I20260709 13:08:35.786046 18300 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskKd2k48/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602220613947-18300-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskKd2k48/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602220613947-18300-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskKd2k48/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602220613947-18300-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
W20260709 13:08:35.808590 27631 consensus_peers.cc:597] T 866a01285ca8436385f8d16dcfb0d4e3 P 41268b218b804905a110c86738e74400 -> Peer 2513a663afac495eb09126ff55e8b2b0 (127.17.223.1:40721): Couldn't send request to peer 2513a663afac495eb09126ff55e8b2b0. Status: Network error: Client connection negotiation failed: client connection to 127.17.223.1:40721: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:08:35.809252 18300 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:08:35.811259 18300 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:08:35.813740 18300 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:08:35.819229 28476 ts_tablet_manager.cc:548] Loading tablet metadata (0/45 complete)
W20260709 13:08:35.894188 27705 consensus_peers.cc:597] T 585e960f8d0f42268f2fe98e1e7b83f0 P 665f7e09521a4c3f9284c1d8b0e094ff -> Peer 2513a663afac495eb09126ff55e8b2b0 (127.17.223.1:40721): Couldn't send request to peer 2513a663afac495eb09126ff55e8b2b0. Status: Network error: Client connection negotiation failed: client connection to 127.17.223.1:40721: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:08:36.068403 18300 ts_tablet_manager.cc:585] Loaded tablet metadata (45 total tablets, 45 live tablets)
I20260709 13:08:36.068842 18300 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.251s	user 0.009s	sys 0.000s
I20260709 13:08:36.069236 18300 ts_tablet_manager.cc:600] Registering tablets (0/45 complete)
I20260709 13:08:36.073956 28476 tablet_bootstrap.cc:492] T e5847d81a5284a44a6b2b21cf6f4351c P 2513a663afac495eb09126ff55e8b2b0: Bootstrap starting.
I20260709 13:08:36.095944 28476 tablet_bootstrap.cc:492] T e5847d81a5284a44a6b2b21cf6f4351c P 2513a663afac495eb09126ff55e8b2b0: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:08:36.096944 28476 tablet_bootstrap.cc:492] T e5847d81a5284a44a6b2b21cf6f4351c P 2513a663afac495eb09126ff55e8b2b0: Bootstrap complete.
I20260709 13:08:36.097617 28476 ts_tablet_manager.cc:1403] T e5847d81a5284a44a6b2b21cf6f4351c P 2513a663afac495eb09126ff55e8b2b0: Time spent bootstrapping tablet: real 0.024s	user 0.018s	sys 0.004s
I20260709 13:08:36.100250 28476 raft_consensus.cc:359] T e5847d81a5284a44a6b2b21cf6f4351c P 2513a663afac495eb09126ff55e8b2b0 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18435fbb525741328139e84a1e354954" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 40545 } } peers { permanent_uuid: "2513a663afac495eb09126ff55e8b2b0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40721 } } peers { permanent_uuid: "41268b218b804905a110c86738e74400" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 44403 } }
I20260709 13:08:36.100946 28476 raft_consensus.cc:740] T e5847d81a5284a44a6b2b21cf6f4351c P 2513a663afac495eb09126ff55e8b2b0 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2513a663afac495eb09126ff55e8b2b0, State: Initialized, Role: FOLLOWER
I20260709 13:08:36.102039 28476 consensus_queue.cc:260] T e5847d81a5284a44a6b2b21cf6f4351c P 2513a663afac495eb09126ff55e8b2b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18435fbb525741328139e84a1e354954" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 40545 } } peers { permanent_uuid: "2513a663afac495eb09126ff55e8b2b0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40721 } } peers { permanent_uuid: "41268b218b804905a110c86738e74400" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 44403 } }
I20260709 13:08:36.107724 28476 ts_tablet_manager.cc:1434] T e5847d81a5284a44a6b2b21cf6f4351c P 2513a663afac495eb09126ff55e8b2b0: Time spent starting tablet: real 0.010s	user 0.008s	sys 0.000s
I20260709 13:08:36.108502 28476 tablet_bootstrap.cc:492] T 1cd5e6e9b36d4591961cb379d7065be9 P 2513a663afac495eb09126ff55e8b2b0: Bootstrap starting.
I20260709 13:08:36.151211 28476 tablet_bootstrap.cc:492] T 1cd5e6e9b36d4591961cb379d7065be9 P 2513a663afac495eb09126ff55e8b2b0: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:08:36.151947 28476 tablet_bootstrap.cc:492] T 1cd5e6e9b36d4591961cb379d7065be9 P 2513a663afac495eb09126ff55e8b2b0: Bootstrap complete.
I20260709 13:08:36.152474 28476 ts_tablet_manager.cc:1403] T 1cd5e6e9b36d4591961cb379d7065be9 P 2513a663afac495eb09126ff55e8b2b0: Time spent bootstrapping tablet: real 0.044s	user 0.025s	sys 0.016s
I20260709 13:08:36.154369 28476 raft_consensus.cc:359] T 1cd5e6e9b36d4591961cb379d7065be9 P 2513a663afac495eb09126ff55e8b2b0 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 38749 } } peers { permanent_uuid: "18435fbb525741328139e84a1e354954" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 40545 } } peers { permanent_uuid: "2513a663afac495eb09126ff55e8b2b0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40721 } }
I20260709 13:08:36.154968 28476 raft_consensus.cc:740] T 1cd5e6e9b36d4591961cb379d7065be9 P 2513a663afac495eb09126ff55e8b2b0 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2513a663afac495eb09126ff55e8b2b0, State: Initialized, Role: FOLLOWER
I20260709 13:08:36.155539 28476 consensus_queue.cc:260] T 1cd5e6e9b36d4591961cb379d7065be9 P 2513a663afac495eb09126ff55e8b2b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 38749 } } peers { permanent_uuid: "18435fbb525741328139e84a1e354954" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 40545 } } peers { permanent_uuid: "2513a663afac495eb09126ff55e8b2b0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40721 } }
I20260709 13:08:36.157286 28476 ts_tablet_manager.cc:1434] T 1cd5e6e9b36d4591961cb379d7065be9 P 2513a663afac495eb09126ff55e8b2b0: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 13:08:36.157997 28476 tablet_bootstrap.cc:492] T bc0b10615ecb4485a9a9de298938697d P 2513a663afac495eb09126ff55e8b2b0: Bootstrap starting.
I20260709 13:08:36.176731 28476 tablet_bootstrap.cc:492] T bc0b10615ecb4485a9a9de298938697d P 2513a663afac495eb09126ff55e8b2b0: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:08:36.177539 28476 tablet_bootstrap.cc:492] T bc0b10615ecb4485a9a9de298938697d P 2513a663afac495eb09126ff55e8b2b0: Bootstrap complete.
I20260709 13:08:36.178126 28476 ts_tablet_manager.cc:1403] T bc0b10615ecb4485a9a9de298938697d P 2513a663afac495eb09126ff55e8b2b0: Time spent bootstrapping tablet: real 0.020s	user 0.012s	sys 0.004s
I20260709 13:08:36.180217 28476 raft_consensus.cc:359] T bc0b10615ecb4485a9a9de298938697d P 2513a663afac495eb09126ff55e8b2b0 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18435fbb525741328139e84a1e354954" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 40545 } } peers { permanent_uuid: "2513a663afac495eb09126ff55e8b2b0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40721 } } peers { permanent_uuid: "41268b218b804905a110c86738e74400" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 44403 } }
I20260709 13:08:36.180712 28476 raft_consensus.cc:740] T bc0b10615ecb4485a9a9de298938697d P 2513a663afac495eb09126ff55e8b2b0 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2513a663afac495eb09126ff55e8b2b0, State: Initialized, Role: FOLLOWER
I20260709 13:08:36.181300 28476 consensus_queue.cc:260] T bc0b10615ecb4485a9a9de298938697d P 2513a663afac495eb09126ff55e8b2b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18435fbb525741328139e84a1e354954" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 40545 } } peers { permanent_uuid: "2513a663afac495eb09126ff55e8b2b0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40721 } } peers { permanent_uuid: "41268b218b804905a110c86738e74400" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 44403 } }
I20260709 13:08:36.182823 28476 ts_tablet_manager.cc:1434] T bc0b10615ecb4485a9a9de298938697d P 2513a663afac495eb09126ff55e8b2b0: Time spent starting tablet: real 0.004s	user 0.008s	sys 0.000s
I20260709 13:08:36.183544 28476 tablet_bootstrap.cc:492] T 11224ef6c00a40cdba4311ceb63bddb9 P 2513a663afac495eb09126ff55e8b2b0: Bootstrap starting.
I20260709 13:08:36.196633 28476 tablet_bootstrap.cc:492] T 11224ef6c00a40cdba4311ceb63bddb9 P 2513a663afac495eb09126ff55e8b2b0: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:08:36.197507 28476 tablet_bootstrap.cc:492] T 11224ef6c00a40cdba4311ceb63bddb9 P 2513a663afac495eb09126ff55e8b2b0: Bootstrap complete.
I20260709 13:08:36.198167 28476 ts_tablet_manager.cc:1403] T 11224ef6c00a40cdba4311ceb63bddb9 P 2513a663afac495eb09126ff55e8b2b0: Time spent bootstrapping tablet: real 0.015s	user 0.010s	sys 0.000s
I20260709 13:08:36.200564 28476 raft_consensus.cc:359] T 11224ef6c00a40cdba4311ceb63bddb9 P 2513a663afac495eb09126ff55e8b2b0 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 38749 } } peers { permanent_uuid: "18435fbb525741328139e84a1e354954" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 40545 } } peers { permanent_uuid: "2513a663afac495eb09126ff55e8b2b0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40721 } }
I20260709 13:08:36.201082 28476 raft_consensus.cc:740] T 11224ef6c00a40cdba4311ceb63bddb9 P 2513a663afac495eb09126ff55e8b2b0 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2513a663afac495eb09126ff55e8b2b0, State: Initialized, Role: FOLLOWER
I20260709 13:08:36.201684 28476 consensus_queue.cc:260] T 11224ef6c00a40cdba4311ceb63bddb9 P 2513a663afac495eb09126ff55e8b2b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 38749 } } peers { permanent_uuid: "18435fbb525741328139e84a1e354954" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 40545 } } peers { permanent_uuid: "2513a663afac495eb09126ff55e8b2b0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40721 } }
I20260709 13:08:36.203375 28476 ts_tablet_manager.cc:1434] T 11224ef6c00a40cdba4311ceb63bddb9 P 2513a663afac495eb09126ff55e8b2b0: Time spent starting tablet: real 0.005s	user 0.008s	sys 0.000s
I20260709 13:08:36.204150 28476 tablet_bootstrap.cc:492] T c9ea919812394c7aba307c2ff5b81f51 P 2513a663afac495eb09126ff55e8b2b0: Bootstrap starting.
I20260709 13:08:36.218273 28476 tablet_bootstrap.cc:492] T c9ea919812394c7aba307c2ff5b81f51 P 2513a663afac495eb09126ff55e8b2b0: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:08:36.219208 28476 tablet_bootstrap.cc:492] T c9ea919812394c7aba307c2ff5b81f51 P 2513a663afac495eb09126ff55e8b2b0: Bootstrap complete.
I20260709 13:08:36.219803 28476 ts_tablet_manager.cc:1403] T c9ea919812394c7aba307c2ff5b81f51 P 2513a663afac495eb09126ff55e8b2b0: Time spent bootstrapping tablet: real 0.016s	user 0.014s	sys 0.000s
I20260709 13:08:36.222234 28476 raft_consensus.cc:359] T c9ea919812394c7aba307c2ff5b81f51 P 2513a663afac495eb09126ff55e8b2b0 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 38749 } } peers { permanent_uuid: "18435fbb525741328139e84a1e354954" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 40545 } } peers { permanent_uuid: "2513a663afac495eb09126ff55e8b2b0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40721 } }
I20260709 13:08:36.222916 28476 raft_consensus.cc:740] T c9ea919812394c7aba307c2ff5b81f51 P 2513a663afac495eb09126ff55e8b2b0 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2513a663afac495eb09126ff55e8b2b0, State: Initialized, Role: FOLLOWER
I20260709 13:08:36.223668 28476 consensus_queue.cc:260] T c9ea919812394c7aba307c2ff5b81f51 P 2513a663afac495eb09126ff55e8b2b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 38749 } } peers { permanent_uuid: "18435fbb525741328139e84a1e354954" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 40545 } } peers { permanent_uuid: "2513a663afac495eb09126ff55e8b2b0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40721 } }
I20260709 13:08:36.226195 28476 ts_tablet_manager.cc:1434] T c9ea919812394c7aba307c2ff5b81f51 P 2513a663afac495eb09126ff55e8b2b0: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
I20260709 13:08:36.226984 28476 tablet_bootstrap.cc:492] T e9b149d77d9941158ead8e9e592e7b27 P 2513a663afac495eb09126ff55e8b2b0: Bootstrap starting.
I20260709 13:08:36.256045 28476 tablet_bootstrap.cc:492] T e9b149d77d9941158ead8e9e592e7b27 P 2513a663afac495eb09126ff55e8b2b0: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:08:36.256987 28476 tablet_bootstrap.cc:492] T e9b149d77d9941158ead8e9e592e7b27 P 2513a663afac495eb09126ff55e8b2b0: Bootstrap complete.
I20260709 13:08:36.257614 28476 ts_tablet_manager.cc:1403] T e9b149d77d9941158ead8e9e592e7b27 P 2513a663afac495eb09126ff55e8b2b0: Time spent bootstrapping tablet: real 0.031s	user 0.019s	sys 0.008s
I20260709 13:08:36.260103 28476 raft_consensus.cc:359] T e9b149d77d9941158ead8e9e592e7b27 P 2513a663afac495eb09126ff55e8b2b0 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18435fbb525741328139e84a1e354954" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 40545 } } peers { permanent_uuid: "2513a663afac495eb09126ff55e8b2b0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40721 } } peers { permanent_uuid: "41268b218b804905a110c86738e74400" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 44403 } }
I20260709 13:08:36.260782 28476 raft_consensus.cc:740] T e9b149d77d9941158ead8e9e592e7b27 P 2513a663afac495eb09126ff55e8b2b0 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2513a663afac495eb09126ff55e8b2b0, State: Initialized, Role: FOLLOWER
I20260709 13:08:36.261545 28476 consensus_queue.cc:260] T e9b149d77d9941158ead8e9e592e7b27 P 2513a663afac495eb09126ff55e8b2b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18435fbb525741328139e84a1e354954" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 40545 } } peers { permanent_uuid: "2513a663afac495eb09126ff55e8b2b0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40721 } } peers { permanent_uuid: "41268b218b804905a110c86738e74400" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 44403 } }
I20260709 13:08:36.263579 28476 ts_tablet_manager.cc:1434] T e9b149d77d9941158ead8e9e592e7b27 P 2513a663afac495eb09126ff55e8b2b0: Time spent starting tablet: real 0.006s	user 0.008s	sys 0.000s
I20260709 13:08:36.264343 28476 tablet_bootstrap.cc:492] T 55a3afc21cea43ea85f4a2155552422d P 2513a663afac495eb09126ff55e8b2b0: Bootstrap starting.
I20260709 13:08:36.304507 28476 tablet_bootstrap.cc:492] T 55a3afc21cea43ea85f4a2155552422d P 2513a663afac495eb09126ff55e8b2b0: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:08:36.306416 28476 tablet_bootstrap.cc:492] T 55a3afc21cea43ea85f4a2155552422d P 2513a663afac495eb09126ff55e8b2b0: Bootstrap complete.
I20260709 13:08:36.307144 28476 ts_tablet_manager.cc:1403] T 55a3afc21cea43ea85f4a2155552422d P 2513a663afac495eb09126ff55e8b2b0: Time spent bootstrapping tablet: real 0.043s	user 0.019s	sys 0.012s
I20260709 13:08:36.309602 28476 raft_consensus.cc:359] T 55a3afc21cea43ea85f4a2155552422d P 2513a663afac495eb09126ff55e8b2b0 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 38749 } } peers { permanent_uuid: "18435fbb525741328139e84a1e354954" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 40545 } } peers { permanent_uuid: "2513a663afac495eb09126ff55e8b2b0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40721 } }
I20260709 13:08:36.310240 28476 raft_consensus.cc:740] T 55a3afc21cea43ea85f4a2155552422d P 2513a663afac495eb09126ff55e8b2b0 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2513a663afac495eb09126ff55e8b2b0, State: Initialized, Role: FOLLOWER
I20260709 13:08:36.310925 28476 consensus_queue.cc:260] T 55a3afc21cea43ea85f4a2155552422d P 2513a663afac495eb09126ff55e8b2b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 38749 } } peers { permanent_uuid: "18435fbb525741328139e84a1e354954" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 40545 } } peers { permanent_uuid: "2513a663afac495eb09126ff55e8b2b0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40721 } }
I20260709 13:08:36.312811 28476 ts_tablet_manager.cc:1434] T 55a3afc21cea43ea85f4a2155552422d P 2513a663afac495eb09126ff55e8b2b0: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 13:08:36.313529 28476 tablet_bootstrap.cc:492] T ff09d7e79a3e43918f3c71d10a40d60b P 2513a663afac495eb09126ff55e8b2b0: Bootstrap starting.
I20260709 13:08:36.327517 28476 tablet_bootstrap.cc:492] T ff09d7e79a3e43918f3c71d10a40d60b P 2513a663afac495eb09126ff55e8b2b0: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:08:36.328404 28476 tablet_bootstrap.cc:492] T ff09d7e79a3e43918f3c71d10a40d60b P 2513a663afac495eb09126ff55e8b2b0: Bootstrap complete.
I20260709 13:08:36.329006 28476 ts_tablet_manager.cc:1403] T ff09d7e79a3e43918f3c71d10a40d60b P 2513a663afac495eb09126ff55e8b2b0: Time spent bootstrapping tablet: real 0.016s	user 0.010s	sys 0.003s
I20260709 13:08:36.331436 28476 raft_consensus.cc:359] T ff09d7e79a3e43918f3c71d10a40d60b P 2513a663afac495eb09126ff55e8b2b0 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 38749 } } peers { permanent_uuid: "18435fbb525741328139e84a1e354954" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 40545 } } peers { permanent_uuid: "2513a663afac495eb09126ff55e8b2b0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40721 } }
I20260709 13:08:36.332131 28476 raft_consensus.cc:740] T ff09d7e79a3e43918f3c71d10a40d60b P 2513a663afac495eb09126ff55e8b2b0 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2513a663afac495eb09126ff55e8b2b0, State: Initialized, Role: FOLLOWER
I20260709 13:08:36.332813 28476 consensus_queue.cc:260] T ff09d7e79a3e43918f3c71d10a40d60b P 2513a663afac495eb09126ff55e8b2b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 38749 } } peers { permanent_uuid: "18435fbb525741328139e84a1e354954" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 40545 } } peers { permanent_uuid: "2513a663afac495eb09126ff55e8b2b0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40721 } }
I20260709 13:08:36.335711 28476 ts_tablet_manager.cc:1434] T ff09d7e79a3e43918f3c71d10a40d60b P 2513a663afac495eb09126ff55e8b2b0: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.002s
I20260709 13:08:36.337332 28476 tablet_bootstrap.cc:492] T 456941807b254f5fb32dca4f84bd16ea P 2513a663afac495eb09126ff55e8b2b0: Bootstrap starting.
I20260709 13:08:36.344741 18300 ts_tablet_manager.cc:616] Registered 45 tablets
I20260709 13:08:36.345116 18300 ts_tablet_manager.cc:595] Time spent register tablets: real 0.276s	user 0.237s	sys 0.000s
I20260709 13:08:36.360743 28476 tablet_bootstrap.cc:492] T 456941807b254f5fb32dca4f84bd16ea P 2513a663afac495eb09126ff55e8b2b0: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:08:36.361742 28476 tablet_bootstrap.cc:492] T 456941807b254f5fb32dca4f84bd16ea P 2513a663afac495eb09126ff55e8b2b0: Bootstrap complete.
I20260709 13:08:36.362397 28476 ts_tablet_manager.cc:1403] T 456941807b254f5fb32dca4f84bd16ea P 2513a663afac495eb09126ff55e8b2b0: Time spent bootstrapping tablet: real 0.026s	user 0.011s	sys 0.009s
I20260709 13:08:36.364595 28476 raft_consensus.cc:359] T 456941807b254f5fb32dca4f84bd16ea P 2513a663afac495eb09126ff55e8b2b0 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2513a663afac495eb09126ff55e8b2b0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40721 } } peers { permanent_uuid: "41268b218b804905a110c86738e74400" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 44403 } } peers { permanent_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 38749 } }
I20260709 13:08:36.365096 28476 raft_consensus.cc:740] T 456941807b254f5fb32dca4f84bd16ea P 2513a663afac495eb09126ff55e8b2b0 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2513a663afac495eb09126ff55e8b2b0, State: Initialized, Role: FOLLOWER
I20260709 13:08:36.365752 28476 consensus_queue.cc:260] T 456941807b254f5fb32dca4f84bd16ea P 2513a663afac495eb09126ff55e8b2b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2513a663afac495eb09126ff55e8b2b0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40721 } } peers { permanent_uuid: "41268b218b804905a110c86738e74400" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 44403 } } peers { permanent_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 38749 } }
I20260709 13:08:36.367637 28476 ts_tablet_manager.cc:1434] T 456941807b254f5fb32dca4f84bd16ea P 2513a663afac495eb09126ff55e8b2b0: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 13:08:36.368300 28476 tablet_bootstrap.cc:492] T 15a4c537259e4b2882a5cc8e723b260a P 2513a663afac495eb09126ff55e8b2b0: Bootstrap starting.
I20260709 13:08:36.387333 28476 tablet_bootstrap.cc:492] T 15a4c537259e4b2882a5cc8e723b260a P 2513a663afac495eb09126ff55e8b2b0: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:08:36.388558 28476 tablet_bootstrap.cc:492] T 15a4c537259e4b2882a5cc8e723b260a P 2513a663afac495eb09126ff55e8b2b0: Bootstrap complete.
I20260709 13:08:36.389382 28476 ts_tablet_manager.cc:1403] T 15a4c537259e4b2882a5cc8e723b260a P 2513a663afac495eb09126ff55e8b2b0: Time spent bootstrapping tablet: real 0.021s	user 0.017s	sys 0.000s
I20260709 13:08:36.392689 28476 raft_consensus.cc:359] T 15a4c537259e4b2882a5cc8e723b260a P 2513a663afac495eb09126ff55e8b2b0 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18435fbb525741328139e84a1e354954" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 40545 } } peers { permanent_uuid: "2513a663afac495eb09126ff55e8b2b0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40721 } } peers { permanent_uuid: "41268b218b804905a110c86738e74400" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 44403 } }
I20260709 13:08:36.393579 28476 raft_consensus.cc:740] T 15a4c537259e4b2882a5cc8e723b260a P 2513a663afac495eb09126ff55e8b2b0 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2513a663afac495eb09126ff55e8b2b0, State: Initialized, Role: FOLLOWER
I20260709 13:08:36.394451 28476 consensus_queue.cc:260] T 15a4c537259e4b2882a5cc8e723b260a P 2513a663afac495eb09126ff55e8b2b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18435fbb525741328139e84a1e354954" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 40545 } } peers { permanent_uuid: "2513a663afac495eb09126ff55e8b2b0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40721 } } peers { permanent_uuid: "41268b218b804905a110c86738e74400" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 44403 } }
I20260709 13:08:36.397164 28476 ts_tablet_manager.cc:1434] T 15a4c537259e4b2882a5cc8e723b260a P 2513a663afac495eb09126ff55e8b2b0: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 13:08:36.398162 28476 tablet_bootstrap.cc:492] T dd959195de1942f7999397a56496f5bc P 2513a663afac495eb09126ff55e8b2b0: Bootstrap starting.
I20260709 13:08:36.418119 28476 tablet_bootstrap.cc:492] T dd959195de1942f7999397a56496f5bc P 2513a663afac495eb09126ff55e8b2b0: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:08:36.419272 28476 tablet_bootstrap.cc:492] T dd959195de1942f7999397a56496f5bc P 2513a663afac495eb09126ff55e8b2b0: Bootstrap complete.
I20260709 13:08:36.420055 28476 ts_tablet_manager.cc:1403] T dd959195de1942f7999397a56496f5bc P 2513a663afac495eb09126ff55e8b2b0: Time spent bootstrapping tablet: real 0.022s	user 0.012s	sys 0.008s
I20260709 13:08:36.423218 28476 raft_consensus.cc:359] T dd959195de1942f7999397a56496f5bc P 2513a663afac495eb09126ff55e8b2b0 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2513a663afac495eb09126ff55e8b2b0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40721 } } peers { permanent_uuid: "41268b218b804905a110c86738e74400" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 44403 } } peers { permanent_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 38749 } }
I20260709 13:08:36.424005 28476 raft_consensus.cc:740] T dd959195de1942f7999397a56496f5bc P 2513a663afac495eb09126ff55e8b2b0 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2513a663afac495eb09126ff55e8b2b0, State: Initialized, Role: FOLLOWER
I20260709 13:08:36.424906 28476 consensus_queue.cc:260] T dd959195de1942f7999397a56496f5bc P 2513a663afac495eb09126ff55e8b2b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2513a663afac495eb09126ff55e8b2b0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40721 } } peers { permanent_uuid: "41268b218b804905a110c86738e74400" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 44403 } } peers { permanent_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 38749 } }
I20260709 13:08:36.427574 28476 ts_tablet_manager.cc:1434] T dd959195de1942f7999397a56496f5bc P 2513a663afac495eb09126ff55e8b2b0: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 13:08:36.429448 28476 tablet_bootstrap.cc:492] T 5a55d1bac7374ff6b83cc7bae2d3b1f3 P 2513a663afac495eb09126ff55e8b2b0: Bootstrap starting.
I20260709 13:08:36.446992 28476 tablet_bootstrap.cc:492] T 5a55d1bac7374ff6b83cc7bae2d3b1f3 P 2513a663afac495eb09126ff55e8b2b0: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:08:36.448086 28476 tablet_bootstrap.cc:492] T 5a55d1bac7374ff6b83cc7bae2d3b1f3 P 2513a663afac495eb09126ff55e8b2b0: Bootstrap complete.
I20260709 13:08:36.448848 28476 ts_tablet_manager.cc:1403] T 5a55d1bac7374ff6b83cc7bae2d3b1f3 P 2513a663afac495eb09126ff55e8b2b0: Time spent bootstrapping tablet: real 0.020s	user 0.017s	sys 0.000s
I20260709 13:08:36.451692 28476 raft_consensus.cc:359] T 5a55d1bac7374ff6b83cc7bae2d3b1f3 P 2513a663afac495eb09126ff55e8b2b0 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18435fbb525741328139e84a1e354954" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 40545 } } peers { permanent_uuid: "2513a663afac495eb09126ff55e8b2b0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40721 } } peers { permanent_uuid: "41268b218b804905a110c86738e74400" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 44403 } }
I20260709 13:08:36.452484 28476 raft_consensus.cc:740] T 5a55d1bac7374ff6b83cc7bae2d3b1f3 P 2513a663afac495eb09126ff55e8b2b0 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2513a663afac495eb09126ff55e8b2b0, State: Initialized, Role: FOLLOWER
I20260709 13:08:36.453311 28476 consensus_queue.cc:260] T 5a55d1bac7374ff6b83cc7bae2d3b1f3 P 2513a663afac495eb09126ff55e8b2b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18435fbb525741328139e84a1e354954" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 40545 } } peers { permanent_uuid: "2513a663afac495eb09126ff55e8b2b0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40721 } } peers { permanent_uuid: "41268b218b804905a110c86738e74400" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 44403 } }
I20260709 13:08:36.455262 18300 rpc_server.cc:307] RPC server started. Bound to: 127.17.223.1:40721
I20260709 13:08:36.455341 28550 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.17.223.1:40721 every 8 connection(s)
I20260709 13:08:36.455617 28476 ts_tablet_manager.cc:1434] T 5a55d1bac7374ff6b83cc7bae2d3b1f3 P 2513a663afac495eb09126ff55e8b2b0: Time spent starting tablet: real 0.006s	user 0.008s	sys 0.000s
I20260709 13:08:36.456557 28476 tablet_bootstrap.cc:492] T ae05961ab7a94458b1ad2cde9785c63b P 2513a663afac495eb09126ff55e8b2b0: Bootstrap starting.
I20260709 13:08:36.474815 28476 tablet_bootstrap.cc:492] T ae05961ab7a94458b1ad2cde9785c63b P 2513a663afac495eb09126ff55e8b2b0: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:08:36.475801 28476 tablet_bootstrap.cc:492] T ae05961ab7a94458b1ad2cde9785c63b P 2513a663afac495eb09126ff55e8b2b0: Bootstrap complete.
I20260709 13:08:36.476498 28476 ts_tablet_manager.cc:1403] T ae05961ab7a94458b1ad2cde9785c63b P 2513a663afac495eb09126ff55e8b2b0: Time spent bootstrapping tablet: real 0.020s	user 0.018s	sys 0.000s
I20260709 13:08:36.478523 28476 raft_consensus.cc:359] T ae05961ab7a94458b1ad2cde9785c63b P 2513a663afac495eb09126ff55e8b2b0 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 38749 } } peers { permanent_uuid: "18435fbb525741328139e84a1e354954" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 40545 } } peers { permanent_uuid: "2513a663afac495eb09126ff55e8b2b0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40721 } }
I20260709 13:08:36.479060 28476 raft_consensus.cc:740] T ae05961ab7a94458b1ad2cde9785c63b P 2513a663afac495eb09126ff55e8b2b0 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2513a663afac495eb09126ff55e8b2b0, State: Initialized, Role: FOLLOWER
I20260709 13:08:36.479701 28476 consensus_queue.cc:260] T ae05961ab7a94458b1ad2cde9785c63b P 2513a663afac495eb09126ff55e8b2b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 38749 } } peers { permanent_uuid: "18435fbb525741328139e84a1e354954" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 40545 } } peers { permanent_uuid: "2513a663afac495eb09126ff55e8b2b0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40721 } }
I20260709 13:08:36.481315 28476 ts_tablet_manager.cc:1434] T ae05961ab7a94458b1ad2cde9785c63b P 2513a663afac495eb09126ff55e8b2b0: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 13:08:36.481972 28476 tablet_bootstrap.cc:492] T bc77856749a0473a8b3124ce8c523815 P 2513a663afac495eb09126ff55e8b2b0: Bootstrap starting.
I20260709 13:08:36.487558 28551 heartbeater.cc:344] Connected to a master server at 127.17.223.62:40677
I20260709 13:08:36.488131 28551 heartbeater.cc:461] Registering TS with master...
I20260709 13:08:36.488926 28551 heartbeater.cc:507] Master 127.17.223.62:40677 requested a full tablet report, sending...
I20260709 13:08:36.496284 28476 tablet_bootstrap.cc:492] T bc77856749a0473a8b3124ce8c523815 P 2513a663afac495eb09126ff55e8b2b0: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:08:36.497284 28476 tablet_bootstrap.cc:492] T bc77856749a0473a8b3124ce8c523815 P 2513a663afac495eb09126ff55e8b2b0: Bootstrap complete.
I20260709 13:08:36.497920 28476 ts_tablet_manager.cc:1403] T bc77856749a0473a8b3124ce8c523815 P 2513a663afac495eb09126ff55e8b2b0: Time spent bootstrapping tablet: real 0.016s	user 0.008s	sys 0.004s
I20260709 13:08:36.500344 28476 raft_consensus.cc:359] T bc77856749a0473a8b3124ce8c523815 P 2513a663afac495eb09126ff55e8b2b0 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18435fbb525741328139e84a1e354954" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 40545 } } peers { permanent_uuid: "2513a663afac495eb09126ff55e8b2b0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40721 } } peers { permanent_uuid: "41268b218b804905a110c86738e74400" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 44403 } }
I20260709 13:08:36.501021 28476 raft_consensus.cc:740] T bc77856749a0473a8b3124ce8c523815 P 2513a663afac495eb09126ff55e8b2b0 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2513a663afac495eb09126ff55e8b2b0, State: Initialized, Role: FOLLOWER
I20260709 13:08:36.501619 28476 consensus_queue.cc:260] T bc77856749a0473a8b3124ce8c523815 P 2513a663afac495eb09126ff55e8b2b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18435fbb525741328139e84a1e354954" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 40545 } } peers { permanent_uuid: "2513a663afac495eb09126ff55e8b2b0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40721 } } peers { permanent_uuid: "41268b218b804905a110c86738e74400" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 44403 } }
I20260709 13:08:36.503603 28476 ts_tablet_manager.cc:1434] T bc77856749a0473a8b3124ce8c523815 P 2513a663afac495eb09126ff55e8b2b0: Time spent starting tablet: real 0.005s	user 0.008s	sys 0.000s
I20260709 13:08:36.504352 28476 tablet_bootstrap.cc:492] T ea92a607c73b4d289d081146089a86f9 P 2513a663afac495eb09126ff55e8b2b0: Bootstrap starting.
I20260709 13:08:36.519191 28476 tablet_bootstrap.cc:492] T ea92a607c73b4d289d081146089a86f9 P 2513a663afac495eb09126ff55e8b2b0: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:08:36.520061 28476 tablet_bootstrap.cc:492] T ea92a607c73b4d289d081146089a86f9 P 2513a663afac495eb09126ff55e8b2b0: Bootstrap complete.
I20260709 13:08:36.520716 28476 ts_tablet_manager.cc:1403] T ea92a607c73b4d289d081146089a86f9 P 2513a663afac495eb09126ff55e8b2b0: Time spent bootstrapping tablet: real 0.017s	user 0.014s	sys 0.000s
I20260709 13:08:36.523147 28476 raft_consensus.cc:359] T ea92a607c73b4d289d081146089a86f9 P 2513a663afac495eb09126ff55e8b2b0 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2513a663afac495eb09126ff55e8b2b0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40721 } } peers { permanent_uuid: "41268b218b804905a110c86738e74400" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 44403 } } peers { permanent_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 38749 } }
I20260709 13:08:36.523818 28476 raft_consensus.cc:740] T ea92a607c73b4d289d081146089a86f9 P 2513a663afac495eb09126ff55e8b2b0 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2513a663afac495eb09126ff55e8b2b0, State: Initialized, Role: FOLLOWER
I20260709 13:08:36.524580 28476 consensus_queue.cc:260] T ea92a607c73b4d289d081146089a86f9 P 2513a663afac495eb09126ff55e8b2b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2513a663afac495eb09126ff55e8b2b0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40721 } } peers { permanent_uuid: "41268b218b804905a110c86738e74400" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 44403 } } peers { permanent_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 38749 } }
I20260709 13:08:36.526595 28476 ts_tablet_manager.cc:1434] T ea92a607c73b4d289d081146089a86f9 P 2513a663afac495eb09126ff55e8b2b0: Time spent starting tablet: real 0.006s	user 0.007s	sys 0.000s
I20260709 13:08:36.527395 28476 tablet_bootstrap.cc:492] T 866a01285ca8436385f8d16dcfb0d4e3 P 2513a663afac495eb09126ff55e8b2b0: Bootstrap starting.
I20260709 13:08:36.527832 28525 raft_consensus.cc:3060] T 11224ef6c00a40cdba4311ceb63bddb9 P 2513a663afac495eb09126ff55e8b2b0 [term 1 FOLLOWER]: Advancing to term 3
I20260709 13:08:36.536453 27490 ts_manager.cc:194] Re-registered known tserver with Master: 2513a663afac495eb09126ff55e8b2b0 (127.17.223.1:40721)
I20260709 13:08:36.549563 28476 tablet_bootstrap.cc:492] T 866a01285ca8436385f8d16dcfb0d4e3 P 2513a663afac495eb09126ff55e8b2b0: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:08:36.551316 28476 tablet_bootstrap.cc:492] T 866a01285ca8436385f8d16dcfb0d4e3 P 2513a663afac495eb09126ff55e8b2b0: Bootstrap complete.
I20260709 13:08:36.551967 28476 ts_tablet_manager.cc:1403] T 866a01285ca8436385f8d16dcfb0d4e3 P 2513a663afac495eb09126ff55e8b2b0: Time spent bootstrapping tablet: real 0.025s	user 0.015s	sys 0.000s
I20260709 13:08:36.556886 28476 raft_consensus.cc:359] T 866a01285ca8436385f8d16dcfb0d4e3 P 2513a663afac495eb09126ff55e8b2b0 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2513a663afac495eb09126ff55e8b2b0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40721 } } peers { permanent_uuid: "41268b218b804905a110c86738e74400" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 44403 } } peers { permanent_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 38749 } }
I20260709 13:08:36.557624 28476 raft_consensus.cc:740] T 866a01285ca8436385f8d16dcfb0d4e3 P 2513a663afac495eb09126ff55e8b2b0 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2513a663afac495eb09126ff55e8b2b0, State: Initialized, Role: FOLLOWER
I20260709 13:08:36.561969 28476 consensus_queue.cc:260] T 866a01285ca8436385f8d16dcfb0d4e3 P 2513a663afac495eb09126ff55e8b2b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2513a663afac495eb09126ff55e8b2b0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40721 } } peers { permanent_uuid: "41268b218b804905a110c86738e74400" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 44403 } } peers { permanent_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 38749 } }
I20260709 13:08:36.564137 28476 ts_tablet_manager.cc:1434] T 866a01285ca8436385f8d16dcfb0d4e3 P 2513a663afac495eb09126ff55e8b2b0: Time spent starting tablet: real 0.012s	user 0.006s	sys 0.000s
I20260709 13:08:36.564950 28476 tablet_bootstrap.cc:492] T 585e960f8d0f42268f2fe98e1e7b83f0 P 2513a663afac495eb09126ff55e8b2b0: Bootstrap starting.
I20260709 13:08:36.581720 28476 tablet_bootstrap.cc:492] T 585e960f8d0f42268f2fe98e1e7b83f0 P 2513a663afac495eb09126ff55e8b2b0: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:08:36.582743 28476 tablet_bootstrap.cc:492] T 585e960f8d0f42268f2fe98e1e7b83f0 P 2513a663afac495eb09126ff55e8b2b0: Bootstrap complete.
I20260709 13:08:36.583395 28476 ts_tablet_manager.cc:1403] T 585e960f8d0f42268f2fe98e1e7b83f0 P 2513a663afac495eb09126ff55e8b2b0: Time spent bootstrapping tablet: real 0.019s	user 0.010s	sys 0.008s
I20260709 13:08:36.586047 28476 raft_consensus.cc:359] T 585e960f8d0f42268f2fe98e1e7b83f0 P 2513a663afac495eb09126ff55e8b2b0 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2513a663afac495eb09126ff55e8b2b0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40721 } } peers { permanent_uuid: "41268b218b804905a110c86738e74400" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 44403 } } peers { permanent_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 38749 } }
I20260709 13:08:36.586781 28476 raft_consensus.cc:740] T 585e960f8d0f42268f2fe98e1e7b83f0 P 2513a663afac495eb09126ff55e8b2b0 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2513a663afac495eb09126ff55e8b2b0, State: Initialized, Role: FOLLOWER
I20260709 13:08:36.587468 28476 consensus_queue.cc:260] T 585e960f8d0f42268f2fe98e1e7b83f0 P 2513a663afac495eb09126ff55e8b2b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2513a663afac495eb09126ff55e8b2b0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40721 } } peers { permanent_uuid: "41268b218b804905a110c86738e74400" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 44403 } } peers { permanent_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 38749 } }
I20260709 13:08:36.589656 28476 ts_tablet_manager.cc:1434] T 585e960f8d0f42268f2fe98e1e7b83f0 P 2513a663afac495eb09126ff55e8b2b0: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 13:08:36.590606 28476 tablet_bootstrap.cc:492] T d0c8b4ec2d844a89b4bb66c0f1bf2c8f P 2513a663afac495eb09126ff55e8b2b0: Bootstrap starting.
I20260709 13:08:36.603623 27490 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:44934
I20260709 13:08:36.607201 28476 tablet_bootstrap.cc:492] T d0c8b4ec2d844a89b4bb66c0f1bf2c8f P 2513a663afac495eb09126ff55e8b2b0: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:08:36.608166 28476 tablet_bootstrap.cc:492] T d0c8b4ec2d844a89b4bb66c0f1bf2c8f P 2513a663afac495eb09126ff55e8b2b0: Bootstrap complete.
I20260709 13:08:36.608789 28476 ts_tablet_manager.cc:1403] T d0c8b4ec2d844a89b4bb66c0f1bf2c8f P 2513a663afac495eb09126ff55e8b2b0: Time spent bootstrapping tablet: real 0.018s	user 0.016s	sys 0.000s
I20260709 13:08:36.608667 28551 heartbeater.cc:499] Master 127.17.223.62:40677 was elected leader, sending a full tablet report...
I20260709 13:08:36.611367 28476 raft_consensus.cc:359] T d0c8b4ec2d844a89b4bb66c0f1bf2c8f P 2513a663afac495eb09126ff55e8b2b0 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18435fbb525741328139e84a1e354954" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 40545 } } peers { permanent_uuid: "2513a663afac495eb09126ff55e8b2b0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40721 } } peers { permanent_uuid: "41268b218b804905a110c86738e74400" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 44403 } }
I20260709 13:08:36.612010 28476 raft_consensus.cc:740] T d0c8b4ec2d844a89b4bb66c0f1bf2c8f P 2513a663afac495eb09126ff55e8b2b0 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2513a663afac495eb09126ff55e8b2b0, State: Initialized, Role: FOLLOWER
I20260709 13:08:36.612607 28476 consensus_queue.cc:260] T d0c8b4ec2d844a89b4bb66c0f1bf2c8f P 2513a663afac495eb09126ff55e8b2b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18435fbb525741328139e84a1e354954" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 40545 } } peers { permanent_uuid: "2513a663afac495eb09126ff55e8b2b0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40721 } } peers { permanent_uuid: "41268b218b804905a110c86738e74400" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 44403 } }
I20260709 13:08:36.614856 28476 ts_tablet_manager.cc:1434] T d0c8b4ec2d844a89b4bb66c0f1bf2c8f P 2513a663afac495eb09126ff55e8b2b0: Time spent starting tablet: real 0.006s	user 0.008s	sys 0.000s
I20260709 13:08:36.615500 28476 tablet_bootstrap.cc:492] T 18f991bbbf3a4615aab49899c7ef86dc P 2513a663afac495eb09126ff55e8b2b0: Bootstrap starting.
I20260709 13:08:36.629078 28476 tablet_bootstrap.cc:492] T 18f991bbbf3a4615aab49899c7ef86dc P 2513a663afac495eb09126ff55e8b2b0: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:08:36.630126 28476 tablet_bootstrap.cc:492] T 18f991bbbf3a4615aab49899c7ef86dc P 2513a663afac495eb09126ff55e8b2b0: Bootstrap complete.
I20260709 13:08:36.630795 28476 ts_tablet_manager.cc:1403] T 18f991bbbf3a4615aab49899c7ef86dc P 2513a663afac495eb09126ff55e8b2b0: Time spent bootstrapping tablet: real 0.015s	user 0.010s	sys 0.004s
I20260709 13:08:36.633056 28476 raft_consensus.cc:359] T 18f991bbbf3a4615aab49899c7ef86dc P 2513a663afac495eb09126ff55e8b2b0 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2513a663afac495eb09126ff55e8b2b0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40721 } } peers { permanent_uuid: "18435fbb525741328139e84a1e354954" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 40545 } } peers { permanent_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 38749 } }
I20260709 13:08:36.633703 28476 raft_consensus.cc:740] T 18f991bbbf3a4615aab49899c7ef86dc P 2513a663afac495eb09126ff55e8b2b0 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2513a663afac495eb09126ff55e8b2b0, State: Initialized, Role: FOLLOWER
I20260709 13:08:36.634405 28476 consensus_queue.cc:260] T 18f991bbbf3a4615aab49899c7ef86dc P 2513a663afac495eb09126ff55e8b2b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2513a663afac495eb09126ff55e8b2b0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40721 } } peers { permanent_uuid: "18435fbb525741328139e84a1e354954" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 40545 } } peers { permanent_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 38749 } }
I20260709 13:08:36.636416 28476 ts_tablet_manager.cc:1434] T 18f991bbbf3a4615aab49899c7ef86dc P 2513a663afac495eb09126ff55e8b2b0: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 13:08:36.637115 28476 tablet_bootstrap.cc:492] T de531c50b1524ec788b27bc4b883689a P 2513a663afac495eb09126ff55e8b2b0: Bootstrap starting.
I20260709 13:08:36.646872 28523 raft_consensus.cc:3060] T ae05961ab7a94458b1ad2cde9785c63b P 2513a663afac495eb09126ff55e8b2b0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:36.651033 28476 tablet_bootstrap.cc:492] T de531c50b1524ec788b27bc4b883689a P 2513a663afac495eb09126ff55e8b2b0: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:08:36.652134 28476 tablet_bootstrap.cc:492] T de531c50b1524ec788b27bc4b883689a P 2513a663afac495eb09126ff55e8b2b0: Bootstrap complete.
I20260709 13:08:36.652797 28476 ts_tablet_manager.cc:1403] T de531c50b1524ec788b27bc4b883689a P 2513a663afac495eb09126ff55e8b2b0: Time spent bootstrapping tablet: real 0.016s	user 0.011s	sys 0.000s
I20260709 13:08:36.658948 28476 raft_consensus.cc:359] T de531c50b1524ec788b27bc4b883689a P 2513a663afac495eb09126ff55e8b2b0 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "41268b218b804905a110c86738e74400" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 44403 } } peers { permanent_uuid: "18435fbb525741328139e84a1e354954" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 40545 } } peers { permanent_uuid: "2513a663afac495eb09126ff55e8b2b0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40721 } }
I20260709 13:08:36.659687 28476 raft_consensus.cc:740] T de531c50b1524ec788b27bc4b883689a P 2513a663afac495eb09126ff55e8b2b0 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2513a663afac495eb09126ff55e8b2b0, State: Initialized, Role: FOLLOWER
I20260709 13:08:36.660440 28476 consensus_queue.cc:260] T de531c50b1524ec788b27bc4b883689a P 2513a663afac495eb09126ff55e8b2b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "41268b218b804905a110c86738e74400" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 44403 } } peers { permanent_uuid: "18435fbb525741328139e84a1e354954" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 40545 } } peers { permanent_uuid: "2513a663afac495eb09126ff55e8b2b0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40721 } }
I20260709 13:08:36.662626 28476 ts_tablet_manager.cc:1434] T de531c50b1524ec788b27bc4b883689a P 2513a663afac495eb09126ff55e8b2b0: Time spent starting tablet: real 0.010s	user 0.005s	sys 0.000s
I20260709 13:08:36.663471 28476 tablet_bootstrap.cc:492] T 1a26f012cd6e4c4c8bf86b5fda903800 P 2513a663afac495eb09126ff55e8b2b0: Bootstrap starting.
I20260709 13:08:36.679980 28476 tablet_bootstrap.cc:492] T 1a26f012cd6e4c4c8bf86b5fda903800 P 2513a663afac495eb09126ff55e8b2b0: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:08:36.680862 28476 tablet_bootstrap.cc:492] T 1a26f012cd6e4c4c8bf86b5fda903800 P 2513a663afac495eb09126ff55e8b2b0: Bootstrap complete.
I20260709 13:08:36.681491 28476 ts_tablet_manager.cc:1403] T 1a26f012cd6e4c4c8bf86b5fda903800 P 2513a663afac495eb09126ff55e8b2b0: Time spent bootstrapping tablet: real 0.018s	user 0.014s	sys 0.000s
I20260709 13:08:36.683923 28476 raft_consensus.cc:359] T 1a26f012cd6e4c4c8bf86b5fda903800 P 2513a663afac495eb09126ff55e8b2b0 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "41268b218b804905a110c86738e74400" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 44403 } } peers { permanent_uuid: "2513a663afac495eb09126ff55e8b2b0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40721 } } peers { permanent_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 38749 } }
I20260709 13:08:36.684571 28476 raft_consensus.cc:740] T 1a26f012cd6e4c4c8bf86b5fda903800 P 2513a663afac495eb09126ff55e8b2b0 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2513a663afac495eb09126ff55e8b2b0, State: Initialized, Role: FOLLOWER
I20260709 13:08:36.685179 28476 consensus_queue.cc:260] T 1a26f012cd6e4c4c8bf86b5fda903800 P 2513a663afac495eb09126ff55e8b2b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "41268b218b804905a110c86738e74400" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 44403 } } peers { permanent_uuid: "2513a663afac495eb09126ff55e8b2b0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40721 } } peers { permanent_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 38749 } }
I20260709 13:08:36.686646 28476 ts_tablet_manager.cc:1434] T 1a26f012cd6e4c4c8bf86b5fda903800 P 2513a663afac495eb09126ff55e8b2b0: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 13:08:36.688206 28476 tablet_bootstrap.cc:492] T 8d1aa996b2034de7b2d77545de68e73c P 2513a663afac495eb09126ff55e8b2b0: Bootstrap starting.
I20260709 13:08:36.700450 28476 tablet_bootstrap.cc:492] T 8d1aa996b2034de7b2d77545de68e73c P 2513a663afac495eb09126ff55e8b2b0: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:08:36.701114 28476 tablet_bootstrap.cc:492] T 8d1aa996b2034de7b2d77545de68e73c P 2513a663afac495eb09126ff55e8b2b0: Bootstrap complete.
I20260709 13:08:36.701568 28476 ts_tablet_manager.cc:1403] T 8d1aa996b2034de7b2d77545de68e73c P 2513a663afac495eb09126ff55e8b2b0: Time spent bootstrapping tablet: real 0.014s	user 0.006s	sys 0.004s
I20260709 13:08:36.703379 28476 raft_consensus.cc:359] T 8d1aa996b2034de7b2d77545de68e73c P 2513a663afac495eb09126ff55e8b2b0 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 38749 } } peers { permanent_uuid: "18435fbb525741328139e84a1e354954" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 40545 } } peers { permanent_uuid: "2513a663afac495eb09126ff55e8b2b0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40721 } }
I20260709 13:08:36.703836 28476 raft_consensus.cc:740] T 8d1aa996b2034de7b2d77545de68e73c P 2513a663afac495eb09126ff55e8b2b0 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2513a663afac495eb09126ff55e8b2b0, State: Initialized, Role: FOLLOWER
I20260709 13:08:36.704348 28476 consensus_queue.cc:260] T 8d1aa996b2034de7b2d77545de68e73c P 2513a663afac495eb09126ff55e8b2b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 38749 } } peers { permanent_uuid: "18435fbb525741328139e84a1e354954" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 40545 } } peers { permanent_uuid: "2513a663afac495eb09126ff55e8b2b0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40721 } }
I20260709 13:08:36.705632 28476 ts_tablet_manager.cc:1434] T 8d1aa996b2034de7b2d77545de68e73c P 2513a663afac495eb09126ff55e8b2b0: Time spent starting tablet: real 0.004s	user 0.004s	sys 0.000s
I20260709 13:08:36.706485 28476 tablet_bootstrap.cc:492] T e23b142958324f69aa0bad3a5828fa83 P 2513a663afac495eb09126ff55e8b2b0: Bootstrap starting.
I20260709 13:08:36.727365 28476 tablet_bootstrap.cc:492] T e23b142958324f69aa0bad3a5828fa83 P 2513a663afac495eb09126ff55e8b2b0: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:08:36.728219 28476 tablet_bootstrap.cc:492] T e23b142958324f69aa0bad3a5828fa83 P 2513a663afac495eb09126ff55e8b2b0: Bootstrap complete.
I20260709 13:08:36.728915 28476 ts_tablet_manager.cc:1403] T e23b142958324f69aa0bad3a5828fa83 P 2513a663afac495eb09126ff55e8b2b0: Time spent bootstrapping tablet: real 0.023s	user 0.011s	sys 0.006s
I20260709 13:08:36.731102 28476 raft_consensus.cc:359] T e23b142958324f69aa0bad3a5828fa83 P 2513a663afac495eb09126ff55e8b2b0 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2513a663afac495eb09126ff55e8b2b0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40721 } } peers { permanent_uuid: "41268b218b804905a110c86738e74400" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 44403 } } peers { permanent_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 38749 } }
I20260709 13:08:36.731741 28476 raft_consensus.cc:740] T e23b142958324f69aa0bad3a5828fa83 P 2513a663afac495eb09126ff55e8b2b0 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2513a663afac495eb09126ff55e8b2b0, State: Initialized, Role: FOLLOWER
I20260709 13:08:36.732337 28476 consensus_queue.cc:260] T e23b142958324f69aa0bad3a5828fa83 P 2513a663afac495eb09126ff55e8b2b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2513a663afac495eb09126ff55e8b2b0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40721 } } peers { permanent_uuid: "41268b218b804905a110c86738e74400" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 44403 } } peers { permanent_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 38749 } }
I20260709 13:08:36.734643 28523 raft_consensus.cc:3060] T bc0b10615ecb4485a9a9de298938697d P 2513a663afac495eb09126ff55e8b2b0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:36.735399 28476 ts_tablet_manager.cc:1434] T e23b142958324f69aa0bad3a5828fa83 P 2513a663afac495eb09126ff55e8b2b0: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.002s
I20260709 13:08:36.736199 28476 tablet_bootstrap.cc:492] T 3a7da70e9f0f49a9bf60184a8f0b5339 P 2513a663afac495eb09126ff55e8b2b0: Bootstrap starting.
I20260709 13:08:36.759159 28476 tablet_bootstrap.cc:492] T 3a7da70e9f0f49a9bf60184a8f0b5339 P 2513a663afac495eb09126ff55e8b2b0: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:08:36.760210 28476 tablet_bootstrap.cc:492] T 3a7da70e9f0f49a9bf60184a8f0b5339 P 2513a663afac495eb09126ff55e8b2b0: Bootstrap complete.
I20260709 13:08:36.760861 28476 ts_tablet_manager.cc:1403] T 3a7da70e9f0f49a9bf60184a8f0b5339 P 2513a663afac495eb09126ff55e8b2b0: Time spent bootstrapping tablet: real 0.025s	user 0.017s	sys 0.004s
I20260709 13:08:36.766979 28476 raft_consensus.cc:359] T 3a7da70e9f0f49a9bf60184a8f0b5339 P 2513a663afac495eb09126ff55e8b2b0 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18435fbb525741328139e84a1e354954" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 40545 } } peers { permanent_uuid: "2513a663afac495eb09126ff55e8b2b0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40721 } } peers { permanent_uuid: "41268b218b804905a110c86738e74400" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 44403 } }
I20260709 13:08:36.767760 28476 raft_consensus.cc:740] T 3a7da70e9f0f49a9bf60184a8f0b5339 P 2513a663afac495eb09126ff55e8b2b0 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2513a663afac495eb09126ff55e8b2b0, State: Initialized, Role: FOLLOWER
I20260709 13:08:36.768514 28476 consensus_queue.cc:260] T 3a7da70e9f0f49a9bf60184a8f0b5339 P 2513a663afac495eb09126ff55e8b2b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18435fbb525741328139e84a1e354954" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 40545 } } peers { permanent_uuid: "2513a663afac495eb09126ff55e8b2b0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40721 } } peers { permanent_uuid: "41268b218b804905a110c86738e74400" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 44403 } }
I20260709 13:08:36.771531 28476 ts_tablet_manager.cc:1434] T 3a7da70e9f0f49a9bf60184a8f0b5339 P 2513a663afac495eb09126ff55e8b2b0: Time spent starting tablet: real 0.010s	user 0.008s	sys 0.000s
I20260709 13:08:36.772428 28476 tablet_bootstrap.cc:492] T 80e2477670ec4db18ad338931d714544 P 2513a663afac495eb09126ff55e8b2b0: Bootstrap starting.
I20260709 13:08:36.788574 28476 tablet_bootstrap.cc:492] T 80e2477670ec4db18ad338931d714544 P 2513a663afac495eb09126ff55e8b2b0: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:08:36.789654 28476 tablet_bootstrap.cc:492] T 80e2477670ec4db18ad338931d714544 P 2513a663afac495eb09126ff55e8b2b0: Bootstrap complete.
I20260709 13:08:36.790274 28476 ts_tablet_manager.cc:1403] T 80e2477670ec4db18ad338931d714544 P 2513a663afac495eb09126ff55e8b2b0: Time spent bootstrapping tablet: real 0.018s	user 0.014s	sys 0.000s
I20260709 13:08:36.792711 28476 raft_consensus.cc:359] T 80e2477670ec4db18ad338931d714544 P 2513a663afac495eb09126ff55e8b2b0 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 38749 } } peers { permanent_uuid: "18435fbb525741328139e84a1e354954" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 40545 } } peers { permanent_uuid: "2513a663afac495eb09126ff55e8b2b0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40721 } }
I20260709 13:08:36.793519 28476 raft_consensus.cc:740] T 80e2477670ec4db18ad338931d714544 P 2513a663afac495eb09126ff55e8b2b0 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2513a663afac495eb09126ff55e8b2b0, State: Initialized, Role: FOLLOWER
I20260709 13:08:36.794430 28476 consensus_queue.cc:260] T 80e2477670ec4db18ad338931d714544 P 2513a663afac495eb09126ff55e8b2b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 38749 } } peers { permanent_uuid: "18435fbb525741328139e84a1e354954" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 40545 } } peers { permanent_uuid: "2513a663afac495eb09126ff55e8b2b0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40721 } }
I20260709 13:08:36.796840 28476 ts_tablet_manager.cc:1434] T 80e2477670ec4db18ad338931d714544 P 2513a663afac495eb09126ff55e8b2b0: Time spent starting tablet: real 0.006s	user 0.008s	sys 0.000s
I20260709 13:08:36.797812 28476 tablet_bootstrap.cc:492] T 28737c73be174729ad3e9d238af7d975 P 2513a663afac495eb09126ff55e8b2b0: Bootstrap starting.
I20260709 13:08:36.812561 28476 tablet_bootstrap.cc:492] T 28737c73be174729ad3e9d238af7d975 P 2513a663afac495eb09126ff55e8b2b0: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:08:36.813460 28476 tablet_bootstrap.cc:492] T 28737c73be174729ad3e9d238af7d975 P 2513a663afac495eb09126ff55e8b2b0: Bootstrap complete.
I20260709 13:08:36.814168 28476 ts_tablet_manager.cc:1403] T 28737c73be174729ad3e9d238af7d975 P 2513a663afac495eb09126ff55e8b2b0: Time spent bootstrapping tablet: real 0.017s	user 0.012s	sys 0.000s
I20260709 13:08:36.817691 28476 raft_consensus.cc:359] T 28737c73be174729ad3e9d238af7d975 P 2513a663afac495eb09126ff55e8b2b0 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18435fbb525741328139e84a1e354954" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 40545 } } peers { permanent_uuid: "2513a663afac495eb09126ff55e8b2b0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40721 } } peers { permanent_uuid: "41268b218b804905a110c86738e74400" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 44403 } }
I20260709 13:08:36.818470 28476 raft_consensus.cc:740] T 28737c73be174729ad3e9d238af7d975 P 2513a663afac495eb09126ff55e8b2b0 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2513a663afac495eb09126ff55e8b2b0, State: Initialized, Role: FOLLOWER
I20260709 13:08:36.819139 28476 consensus_queue.cc:260] T 28737c73be174729ad3e9d238af7d975 P 2513a663afac495eb09126ff55e8b2b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18435fbb525741328139e84a1e354954" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 40545 } } peers { permanent_uuid: "2513a663afac495eb09126ff55e8b2b0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40721 } } peers { permanent_uuid: "41268b218b804905a110c86738e74400" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 44403 } }
I20260709 13:08:36.821202 28476 ts_tablet_manager.cc:1434] T 28737c73be174729ad3e9d238af7d975 P 2513a663afac495eb09126ff55e8b2b0: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.003s
I20260709 13:08:36.822412 28476 tablet_bootstrap.cc:492] T 765d0bd527c64f74be713c390a018bba P 2513a663afac495eb09126ff55e8b2b0: Bootstrap starting.
I20260709 13:08:36.839421 28476 tablet_bootstrap.cc:492] T 765d0bd527c64f74be713c390a018bba P 2513a663afac495eb09126ff55e8b2b0: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:08:36.840320 28476 tablet_bootstrap.cc:492] T 765d0bd527c64f74be713c390a018bba P 2513a663afac495eb09126ff55e8b2b0: Bootstrap complete.
I20260709 13:08:36.840935 28476 ts_tablet_manager.cc:1403] T 765d0bd527c64f74be713c390a018bba P 2513a663afac495eb09126ff55e8b2b0: Time spent bootstrapping tablet: real 0.019s	user 0.016s	sys 0.000s
I20260709 13:08:36.843339 28476 raft_consensus.cc:359] T 765d0bd527c64f74be713c390a018bba P 2513a663afac495eb09126ff55e8b2b0 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2513a663afac495eb09126ff55e8b2b0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40721 } } peers { permanent_uuid: "41268b218b804905a110c86738e74400" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 44403 } } peers { permanent_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 38749 } }
I20260709 13:08:36.843957 28476 raft_consensus.cc:740] T 765d0bd527c64f74be713c390a018bba P 2513a663afac495eb09126ff55e8b2b0 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2513a663afac495eb09126ff55e8b2b0, State: Initialized, Role: FOLLOWER
I20260709 13:08:36.845247 28476 consensus_queue.cc:260] T 765d0bd527c64f74be713c390a018bba P 2513a663afac495eb09126ff55e8b2b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2513a663afac495eb09126ff55e8b2b0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40721 } } peers { permanent_uuid: "41268b218b804905a110c86738e74400" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 44403 } } peers { permanent_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 38749 } }
I20260709 13:08:36.847958 28476 ts_tablet_manager.cc:1434] T 765d0bd527c64f74be713c390a018bba P 2513a663afac495eb09126ff55e8b2b0: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 13:08:36.848906 28476 tablet_bootstrap.cc:492] T 86af954f570648969cbc47c03d15c447 P 2513a663afac495eb09126ff55e8b2b0: Bootstrap starting.
I20260709 13:08:36.865464 28476 tablet_bootstrap.cc:492] T 86af954f570648969cbc47c03d15c447 P 2513a663afac495eb09126ff55e8b2b0: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:08:36.866245 28476 tablet_bootstrap.cc:492] T 86af954f570648969cbc47c03d15c447 P 2513a663afac495eb09126ff55e8b2b0: Bootstrap complete.
I20260709 13:08:36.866950 28476 ts_tablet_manager.cc:1403] T 86af954f570648969cbc47c03d15c447 P 2513a663afac495eb09126ff55e8b2b0: Time spent bootstrapping tablet: real 0.018s	user 0.014s	sys 0.003s
I20260709 13:08:36.869351 28476 raft_consensus.cc:359] T 86af954f570648969cbc47c03d15c447 P 2513a663afac495eb09126ff55e8b2b0 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18435fbb525741328139e84a1e354954" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 40545 } } peers { permanent_uuid: "2513a663afac495eb09126ff55e8b2b0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40721 } } peers { permanent_uuid: "41268b218b804905a110c86738e74400" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 44403 } }
I20260709 13:08:36.869988 28476 raft_consensus.cc:740] T 86af954f570648969cbc47c03d15c447 P 2513a663afac495eb09126ff55e8b2b0 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2513a663afac495eb09126ff55e8b2b0, State: Initialized, Role: FOLLOWER
I20260709 13:08:36.870645 28476 consensus_queue.cc:260] T 86af954f570648969cbc47c03d15c447 P 2513a663afac495eb09126ff55e8b2b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18435fbb525741328139e84a1e354954" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 40545 } } peers { permanent_uuid: "2513a663afac495eb09126ff55e8b2b0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40721 } } peers { permanent_uuid: "41268b218b804905a110c86738e74400" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 44403 } }
I20260709 13:08:36.872347 28476 ts_tablet_manager.cc:1434] T 86af954f570648969cbc47c03d15c447 P 2513a663afac495eb09126ff55e8b2b0: Time spent starting tablet: real 0.005s	user 0.000s	sys 0.004s
I20260709 13:08:36.873558 28476 tablet_bootstrap.cc:492] T b6be829f6d3f40c99a3c5be18b0c259c P 2513a663afac495eb09126ff55e8b2b0: Bootstrap starting.
I20260709 13:08:36.887820 28476 tablet_bootstrap.cc:492] T b6be829f6d3f40c99a3c5be18b0c259c P 2513a663afac495eb09126ff55e8b2b0: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:08:36.888691 28476 tablet_bootstrap.cc:492] T b6be829f6d3f40c99a3c5be18b0c259c P 2513a663afac495eb09126ff55e8b2b0: Bootstrap complete.
I20260709 13:08:36.889317 28476 ts_tablet_manager.cc:1403] T b6be829f6d3f40c99a3c5be18b0c259c P 2513a663afac495eb09126ff55e8b2b0: Time spent bootstrapping tablet: real 0.016s	user 0.009s	sys 0.004s
I20260709 13:08:36.889806 28523 raft_consensus.cc:3060] T 86af954f570648969cbc47c03d15c447 P 2513a663afac495eb09126ff55e8b2b0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:36.891755 28476 raft_consensus.cc:359] T b6be829f6d3f40c99a3c5be18b0c259c P 2513a663afac495eb09126ff55e8b2b0 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18435fbb525741328139e84a1e354954" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 40545 } } peers { permanent_uuid: "2513a663afac495eb09126ff55e8b2b0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40721 } } peers { permanent_uuid: "41268b218b804905a110c86738e74400" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 44403 } }
I20260709 13:08:36.892467 28476 raft_consensus.cc:740] T b6be829f6d3f40c99a3c5be18b0c259c P 2513a663afac495eb09126ff55e8b2b0 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2513a663afac495eb09126ff55e8b2b0, State: Initialized, Role: FOLLOWER
I20260709 13:08:36.893157 28476 consensus_queue.cc:260] T b6be829f6d3f40c99a3c5be18b0c259c P 2513a663afac495eb09126ff55e8b2b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18435fbb525741328139e84a1e354954" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 40545 } } peers { permanent_uuid: "2513a663afac495eb09126ff55e8b2b0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40721 } } peers { permanent_uuid: "41268b218b804905a110c86738e74400" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 44403 } }
I20260709 13:08:36.895272 28476 ts_tablet_manager.cc:1434] T b6be829f6d3f40c99a3c5be18b0c259c P 2513a663afac495eb09126ff55e8b2b0: Time spent starting tablet: real 0.006s	user 0.008s	sys 0.000s
I20260709 13:08:36.896021 28476 tablet_bootstrap.cc:492] T 93c69c92efc3402e8e9546cb961bbcdc P 2513a663afac495eb09126ff55e8b2b0: Bootstrap starting.
I20260709 13:08:36.914636 28476 tablet_bootstrap.cc:492] T 93c69c92efc3402e8e9546cb961bbcdc P 2513a663afac495eb09126ff55e8b2b0: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:08:36.915423 28476 tablet_bootstrap.cc:492] T 93c69c92efc3402e8e9546cb961bbcdc P 2513a663afac495eb09126ff55e8b2b0: Bootstrap complete.
I20260709 13:08:36.915946 28476 ts_tablet_manager.cc:1403] T 93c69c92efc3402e8e9546cb961bbcdc P 2513a663afac495eb09126ff55e8b2b0: Time spent bootstrapping tablet: real 0.020s	user 0.013s	sys 0.004s
I20260709 13:08:36.918176 28476 raft_consensus.cc:359] T 93c69c92efc3402e8e9546cb961bbcdc P 2513a663afac495eb09126ff55e8b2b0 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2513a663afac495eb09126ff55e8b2b0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40721 } } peers { permanent_uuid: "41268b218b804905a110c86738e74400" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 44403 } } peers { permanent_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 38749 } }
I20260709 13:08:36.918774 28476 raft_consensus.cc:740] T 93c69c92efc3402e8e9546cb961bbcdc P 2513a663afac495eb09126ff55e8b2b0 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2513a663afac495eb09126ff55e8b2b0, State: Initialized, Role: FOLLOWER
I20260709 13:08:36.919404 28476 consensus_queue.cc:260] T 93c69c92efc3402e8e9546cb961bbcdc P 2513a663afac495eb09126ff55e8b2b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2513a663afac495eb09126ff55e8b2b0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40721 } } peers { permanent_uuid: "41268b218b804905a110c86738e74400" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 44403 } } peers { permanent_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 38749 } }
I20260709 13:08:36.921228 28476 ts_tablet_manager.cc:1434] T 93c69c92efc3402e8e9546cb961bbcdc P 2513a663afac495eb09126ff55e8b2b0: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 13:08:36.922032 28476 tablet_bootstrap.cc:492] T 78e19c035a854ee98657bec3edcb3585 P 2513a663afac495eb09126ff55e8b2b0: Bootstrap starting.
I20260709 13:08:36.932505 28523 raft_consensus.cc:3060] T 80e2477670ec4db18ad338931d714544 P 2513a663afac495eb09126ff55e8b2b0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:36.935408 28476 tablet_bootstrap.cc:492] T 78e19c035a854ee98657bec3edcb3585 P 2513a663afac495eb09126ff55e8b2b0: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:08:36.936471 28476 tablet_bootstrap.cc:492] T 78e19c035a854ee98657bec3edcb3585 P 2513a663afac495eb09126ff55e8b2b0: Bootstrap complete.
I20260709 13:08:36.937147 28476 ts_tablet_manager.cc:1403] T 78e19c035a854ee98657bec3edcb3585 P 2513a663afac495eb09126ff55e8b2b0: Time spent bootstrapping tablet: real 0.015s	user 0.008s	sys 0.004s
I20260709 13:08:36.939697 28476 raft_consensus.cc:359] T 78e19c035a854ee98657bec3edcb3585 P 2513a663afac495eb09126ff55e8b2b0 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 38749 } } peers { permanent_uuid: "18435fbb525741328139e84a1e354954" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 40545 } } peers { permanent_uuid: "2513a663afac495eb09126ff55e8b2b0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40721 } }
I20260709 13:08:36.940335 28476 raft_consensus.cc:740] T 78e19c035a854ee98657bec3edcb3585 P 2513a663afac495eb09126ff55e8b2b0 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2513a663afac495eb09126ff55e8b2b0, State: Initialized, Role: FOLLOWER
I20260709 13:08:36.941143 28476 consensus_queue.cc:260] T 78e19c035a854ee98657bec3edcb3585 P 2513a663afac495eb09126ff55e8b2b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 38749 } } peers { permanent_uuid: "18435fbb525741328139e84a1e354954" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 40545 } } peers { permanent_uuid: "2513a663afac495eb09126ff55e8b2b0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40721 } }
I20260709 13:08:36.943405 28476 ts_tablet_manager.cc:1434] T 78e19c035a854ee98657bec3edcb3585 P 2513a663afac495eb09126ff55e8b2b0: Time spent starting tablet: real 0.006s	user 0.008s	sys 0.000s
I20260709 13:08:36.944751 28476 tablet_bootstrap.cc:492] T 85cdd21b7a5f4db7af44327c57c16d43 P 2513a663afac495eb09126ff55e8b2b0: Bootstrap starting.
I20260709 13:08:36.956988 28476 tablet_bootstrap.cc:492] T 85cdd21b7a5f4db7af44327c57c16d43 P 2513a663afac495eb09126ff55e8b2b0: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:08:36.957737 28476 tablet_bootstrap.cc:492] T 85cdd21b7a5f4db7af44327c57c16d43 P 2513a663afac495eb09126ff55e8b2b0: Bootstrap complete.
I20260709 13:08:36.958267 28476 ts_tablet_manager.cc:1403] T 85cdd21b7a5f4db7af44327c57c16d43 P 2513a663afac495eb09126ff55e8b2b0: Time spent bootstrapping tablet: real 0.014s	user 0.009s	sys 0.000s
I20260709 13:08:36.960086 28476 raft_consensus.cc:359] T 85cdd21b7a5f4db7af44327c57c16d43 P 2513a663afac495eb09126ff55e8b2b0 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2513a663afac495eb09126ff55e8b2b0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40721 } } peers { permanent_uuid: "41268b218b804905a110c86738e74400" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 44403 } } peers { permanent_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 38749 } }
I20260709 13:08:36.960594 28476 raft_consensus.cc:740] T 85cdd21b7a5f4db7af44327c57c16d43 P 2513a663afac495eb09126ff55e8b2b0 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2513a663afac495eb09126ff55e8b2b0, State: Initialized, Role: FOLLOWER
I20260709 13:08:36.961133 28476 consensus_queue.cc:260] T 85cdd21b7a5f4db7af44327c57c16d43 P 2513a663afac495eb09126ff55e8b2b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2513a663afac495eb09126ff55e8b2b0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40721 } } peers { permanent_uuid: "41268b218b804905a110c86738e74400" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 44403 } } peers { permanent_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 38749 } }
I20260709 13:08:36.963023 28476 ts_tablet_manager.cc:1434] T 85cdd21b7a5f4db7af44327c57c16d43 P 2513a663afac495eb09126ff55e8b2b0: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.004s
I20260709 13:08:36.964196 28476 tablet_bootstrap.cc:492] T 7b77a53b493f4e979fdf38a0b17176b0 P 2513a663afac495eb09126ff55e8b2b0: Bootstrap starting.
I20260709 13:08:36.976951 28476 tablet_bootstrap.cc:492] T 7b77a53b493f4e979fdf38a0b17176b0 P 2513a663afac495eb09126ff55e8b2b0: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:08:36.977689 28476 tablet_bootstrap.cc:492] T 7b77a53b493f4e979fdf38a0b17176b0 P 2513a663afac495eb09126ff55e8b2b0: Bootstrap complete.
I20260709 13:08:36.978209 28476 ts_tablet_manager.cc:1403] T 7b77a53b493f4e979fdf38a0b17176b0 P 2513a663afac495eb09126ff55e8b2b0: Time spent bootstrapping tablet: real 0.014s	user 0.010s	sys 0.000s
I20260709 13:08:36.980108 28476 raft_consensus.cc:359] T 7b77a53b493f4e979fdf38a0b17176b0 P 2513a663afac495eb09126ff55e8b2b0 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2513a663afac495eb09126ff55e8b2b0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40721 } } peers { permanent_uuid: "41268b218b804905a110c86738e74400" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 44403 } } peers { permanent_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 38749 } }
I20260709 13:08:36.980758 28476 raft_consensus.cc:740] T 7b77a53b493f4e979fdf38a0b17176b0 P 2513a663afac495eb09126ff55e8b2b0 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2513a663afac495eb09126ff55e8b2b0, State: Initialized, Role: FOLLOWER
I20260709 13:08:36.981267 28476 consensus_queue.cc:260] T 7b77a53b493f4e979fdf38a0b17176b0 P 2513a663afac495eb09126ff55e8b2b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2513a663afac495eb09126ff55e8b2b0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40721 } } peers { permanent_uuid: "41268b218b804905a110c86738e74400" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 44403 } } peers { permanent_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 38749 } }
I20260709 13:08:36.982810 28476 ts_tablet_manager.cc:1434] T 7b77a53b493f4e979fdf38a0b17176b0 P 2513a663afac495eb09126ff55e8b2b0: Time spent starting tablet: real 0.004s	user 0.008s	sys 0.000s
I20260709 13:08:36.983664 28476 tablet_bootstrap.cc:492] T bbd0bdc9640c4956a5d60406841ef0f0 P 2513a663afac495eb09126ff55e8b2b0: Bootstrap starting.
I20260709 13:08:37.002421 28523 raft_consensus.cc:3060] T 3a7da70e9f0f49a9bf60184a8f0b5339 P 2513a663afac495eb09126ff55e8b2b0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:37.008502 28476 tablet_bootstrap.cc:492] T bbd0bdc9640c4956a5d60406841ef0f0 P 2513a663afac495eb09126ff55e8b2b0: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:08:37.011483 28476 tablet_bootstrap.cc:492] T bbd0bdc9640c4956a5d60406841ef0f0 P 2513a663afac495eb09126ff55e8b2b0: Bootstrap complete.
I20260709 13:08:37.012115 28476 ts_tablet_manager.cc:1403] T bbd0bdc9640c4956a5d60406841ef0f0 P 2513a663afac495eb09126ff55e8b2b0: Time spent bootstrapping tablet: real 0.029s	user 0.017s	sys 0.008s
I20260709 13:08:37.015051 28476 raft_consensus.cc:359] T bbd0bdc9640c4956a5d60406841ef0f0 P 2513a663afac495eb09126ff55e8b2b0 [term 2 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2513a663afac495eb09126ff55e8b2b0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40721 } } peers { permanent_uuid: "41268b218b804905a110c86738e74400" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 44403 } } peers { permanent_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 38749 } }
I20260709 13:08:37.015663 28476 raft_consensus.cc:740] T bbd0bdc9640c4956a5d60406841ef0f0 P 2513a663afac495eb09126ff55e8b2b0 [term 2 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2513a663afac495eb09126ff55e8b2b0, State: Initialized, Role: FOLLOWER
I20260709 13:08:37.016311 28476 consensus_queue.cc:260] T bbd0bdc9640c4956a5d60406841ef0f0 P 2513a663afac495eb09126ff55e8b2b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2513a663afac495eb09126ff55e8b2b0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40721 } } peers { permanent_uuid: "41268b218b804905a110c86738e74400" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 44403 } } peers { permanent_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 38749 } }
I20260709 13:08:37.018373 28476 ts_tablet_manager.cc:1434] T bbd0bdc9640c4956a5d60406841ef0f0 P 2513a663afac495eb09126ff55e8b2b0: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 13:08:37.019192 28476 tablet_bootstrap.cc:492] T 2d994cb13f8f453284bcb1f8b85824a2 P 2513a663afac495eb09126ff55e8b2b0: Bootstrap starting.
I20260709 13:08:37.031554 28476 tablet_bootstrap.cc:492] T 2d994cb13f8f453284bcb1f8b85824a2 P 2513a663afac495eb09126ff55e8b2b0: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:08:37.032415 28476 tablet_bootstrap.cc:492] T 2d994cb13f8f453284bcb1f8b85824a2 P 2513a663afac495eb09126ff55e8b2b0: Bootstrap complete.
I20260709 13:08:37.033075 28476 ts_tablet_manager.cc:1403] T 2d994cb13f8f453284bcb1f8b85824a2 P 2513a663afac495eb09126ff55e8b2b0: Time spent bootstrapping tablet: real 0.014s	user 0.011s	sys 0.000s
I20260709 13:08:37.035133 28476 raft_consensus.cc:359] T 2d994cb13f8f453284bcb1f8b85824a2 P 2513a663afac495eb09126ff55e8b2b0 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18435fbb525741328139e84a1e354954" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 40545 } } peers { permanent_uuid: "2513a663afac495eb09126ff55e8b2b0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40721 } } peers { permanent_uuid: "41268b218b804905a110c86738e74400" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 44403 } }
I20260709 13:08:37.035766 28476 raft_consensus.cc:740] T 2d994cb13f8f453284bcb1f8b85824a2 P 2513a663afac495eb09126ff55e8b2b0 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2513a663afac495eb09126ff55e8b2b0, State: Initialized, Role: FOLLOWER
I20260709 13:08:37.036324 28476 consensus_queue.cc:260] T 2d994cb13f8f453284bcb1f8b85824a2 P 2513a663afac495eb09126ff55e8b2b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18435fbb525741328139e84a1e354954" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 40545 } } peers { permanent_uuid: "2513a663afac495eb09126ff55e8b2b0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40721 } } peers { permanent_uuid: "41268b218b804905a110c86738e74400" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 44403 } }
I20260709 13:08:37.038123 28476 ts_tablet_manager.cc:1434] T 2d994cb13f8f453284bcb1f8b85824a2 P 2513a663afac495eb09126ff55e8b2b0: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 13:08:37.039263 28476 tablet_bootstrap.cc:492] T 64490a86db8c4f5ca54f4f8085f41319 P 2513a663afac495eb09126ff55e8b2b0: Bootstrap starting.
I20260709 13:08:37.059247 28476 tablet_bootstrap.cc:492] T 64490a86db8c4f5ca54f4f8085f41319 P 2513a663afac495eb09126ff55e8b2b0: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:08:37.060103 28476 tablet_bootstrap.cc:492] T 64490a86db8c4f5ca54f4f8085f41319 P 2513a663afac495eb09126ff55e8b2b0: Bootstrap complete.
I20260709 13:08:37.060873 28476 ts_tablet_manager.cc:1403] T 64490a86db8c4f5ca54f4f8085f41319 P 2513a663afac495eb09126ff55e8b2b0: Time spent bootstrapping tablet: real 0.022s	user 0.010s	sys 0.004s
I20260709 13:08:37.063782 28476 raft_consensus.cc:359] T 64490a86db8c4f5ca54f4f8085f41319 P 2513a663afac495eb09126ff55e8b2b0 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 38749 } } peers { permanent_uuid: "18435fbb525741328139e84a1e354954" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 40545 } } peers { permanent_uuid: "2513a663afac495eb09126ff55e8b2b0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40721 } }
I20260709 13:08:37.064494 28476 raft_consensus.cc:740] T 64490a86db8c4f5ca54f4f8085f41319 P 2513a663afac495eb09126ff55e8b2b0 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2513a663afac495eb09126ff55e8b2b0, State: Initialized, Role: FOLLOWER
I20260709 13:08:37.065213 28476 consensus_queue.cc:260] T 64490a86db8c4f5ca54f4f8085f41319 P 2513a663afac495eb09126ff55e8b2b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 38749 } } peers { permanent_uuid: "18435fbb525741328139e84a1e354954" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 40545 } } peers { permanent_uuid: "2513a663afac495eb09126ff55e8b2b0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40721 } }
I20260709 13:08:37.067242 28476 ts_tablet_manager.cc:1434] T 64490a86db8c4f5ca54f4f8085f41319 P 2513a663afac495eb09126ff55e8b2b0: Time spent starting tablet: real 0.006s	user 0.008s	sys 0.000s
I20260709 13:08:37.068171 28476 tablet_bootstrap.cc:492] T 9c0f604d66664505aa9469fb058601b6 P 2513a663afac495eb09126ff55e8b2b0: Bootstrap starting.
I20260709 13:08:37.084614 28476 tablet_bootstrap.cc:492] T 9c0f604d66664505aa9469fb058601b6 P 2513a663afac495eb09126ff55e8b2b0: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:08:37.085412 28476 tablet_bootstrap.cc:492] T 9c0f604d66664505aa9469fb058601b6 P 2513a663afac495eb09126ff55e8b2b0: Bootstrap complete.
I20260709 13:08:37.086046 28476 ts_tablet_manager.cc:1403] T 9c0f604d66664505aa9469fb058601b6 P 2513a663afac495eb09126ff55e8b2b0: Time spent bootstrapping tablet: real 0.018s	user 0.011s	sys 0.000s
I20260709 13:08:37.088784 28476 raft_consensus.cc:359] T 9c0f604d66664505aa9469fb058601b6 P 2513a663afac495eb09126ff55e8b2b0 [term 2 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 38749 } } peers { permanent_uuid: "18435fbb525741328139e84a1e354954" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 40545 } } peers { permanent_uuid: "2513a663afac495eb09126ff55e8b2b0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40721 } }
I20260709 13:08:37.089437 28476 raft_consensus.cc:740] T 9c0f604d66664505aa9469fb058601b6 P 2513a663afac495eb09126ff55e8b2b0 [term 2 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2513a663afac495eb09126ff55e8b2b0, State: Initialized, Role: FOLLOWER
I20260709 13:08:37.090096 28476 consensus_queue.cc:260] T 9c0f604d66664505aa9469fb058601b6 P 2513a663afac495eb09126ff55e8b2b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 38749 } } peers { permanent_uuid: "18435fbb525741328139e84a1e354954" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 40545 } } peers { permanent_uuid: "2513a663afac495eb09126ff55e8b2b0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40721 } }
I20260709 13:08:37.092288 28476 ts_tablet_manager.cc:1434] T 9c0f604d66664505aa9469fb058601b6 P 2513a663afac495eb09126ff55e8b2b0: Time spent starting tablet: real 0.006s	user 0.008s	sys 0.000s
I20260709 13:08:37.093703 28476 tablet_bootstrap.cc:492] T 8e758d59bd4a4eae9f67662e165013f9 P 2513a663afac495eb09126ff55e8b2b0: Bootstrap starting.
I20260709 13:08:37.126533 28476 tablet_bootstrap.cc:492] T 8e758d59bd4a4eae9f67662e165013f9 P 2513a663afac495eb09126ff55e8b2b0: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:08:37.127452 28476 tablet_bootstrap.cc:492] T 8e758d59bd4a4eae9f67662e165013f9 P 2513a663afac495eb09126ff55e8b2b0: Bootstrap complete.
I20260709 13:08:37.128099 28476 ts_tablet_manager.cc:1403] T 8e758d59bd4a4eae9f67662e165013f9 P 2513a663afac495eb09126ff55e8b2b0: Time spent bootstrapping tablet: real 0.035s	user 0.014s	sys 0.000s
I20260709 13:08:37.130406 28476 raft_consensus.cc:359] T 8e758d59bd4a4eae9f67662e165013f9 P 2513a663afac495eb09126ff55e8b2b0 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2513a663afac495eb09126ff55e8b2b0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40721 } } peers { permanent_uuid: "41268b218b804905a110c86738e74400" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 44403 } } peers { permanent_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 38749 } }
I20260709 13:08:37.131098 28476 raft_consensus.cc:740] T 8e758d59bd4a4eae9f67662e165013f9 P 2513a663afac495eb09126ff55e8b2b0 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2513a663afac495eb09126ff55e8b2b0, State: Initialized, Role: FOLLOWER
I20260709 13:08:37.131866 28476 consensus_queue.cc:260] T 8e758d59bd4a4eae9f67662e165013f9 P 2513a663afac495eb09126ff55e8b2b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2513a663afac495eb09126ff55e8b2b0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40721 } } peers { permanent_uuid: "41268b218b804905a110c86738e74400" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 44403 } } peers { permanent_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 38749 } }
I20260709 13:08:37.133970 28476 ts_tablet_manager.cc:1434] T 8e758d59bd4a4eae9f67662e165013f9 P 2513a663afac495eb09126ff55e8b2b0: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
I20260709 13:08:37.135023 28476 tablet_bootstrap.cc:492] T 4cd7359accee42808761c37543247321 P 2513a663afac495eb09126ff55e8b2b0: Bootstrap starting.
I20260709 13:08:37.154062 28476 tablet_bootstrap.cc:492] T 4cd7359accee42808761c37543247321 P 2513a663afac495eb09126ff55e8b2b0: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:08:37.155025 28476 tablet_bootstrap.cc:492] T 4cd7359accee42808761c37543247321 P 2513a663afac495eb09126ff55e8b2b0: Bootstrap complete.
I20260709 13:08:37.155655 28476 ts_tablet_manager.cc:1403] T 4cd7359accee42808761c37543247321 P 2513a663afac495eb09126ff55e8b2b0: Time spent bootstrapping tablet: real 0.021s	user 0.016s	sys 0.000s
I20260709 13:08:37.158236 28476 raft_consensus.cc:359] T 4cd7359accee42808761c37543247321 P 2513a663afac495eb09126ff55e8b2b0 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18435fbb525741328139e84a1e354954" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 40545 } } peers { permanent_uuid: "2513a663afac495eb09126ff55e8b2b0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40721 } } peers { permanent_uuid: "41268b218b804905a110c86738e74400" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 44403 } }
I20260709 13:08:37.158895 28476 raft_consensus.cc:740] T 4cd7359accee42808761c37543247321 P 2513a663afac495eb09126ff55e8b2b0 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2513a663afac495eb09126ff55e8b2b0, State: Initialized, Role: FOLLOWER
I20260709 13:08:37.159585 28523 raft_consensus.cc:3060] T 7b77a53b493f4e979fdf38a0b17176b0 P 2513a663afac495eb09126ff55e8b2b0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:37.159551 28476 consensus_queue.cc:260] T 4cd7359accee42808761c37543247321 P 2513a663afac495eb09126ff55e8b2b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18435fbb525741328139e84a1e354954" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 40545 } } peers { permanent_uuid: "2513a663afac495eb09126ff55e8b2b0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40721 } } peers { permanent_uuid: "41268b218b804905a110c86738e74400" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 44403 } }
I20260709 13:08:37.164563 28476 ts_tablet_manager.cc:1434] T 4cd7359accee42808761c37543247321 P 2513a663afac495eb09126ff55e8b2b0: Time spent starting tablet: real 0.009s	user 0.005s	sys 0.000s
I20260709 13:08:37.167450 28476 tablet_bootstrap.cc:492] T 2d68b1be563949efbcb4bbe71eddd0d8 P 2513a663afac495eb09126ff55e8b2b0: Bootstrap starting.
I20260709 13:08:37.201917 28524 raft_consensus.cc:3060] T b6be829f6d3f40c99a3c5be18b0c259c P 2513a663afac495eb09126ff55e8b2b0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:37.233506 28525 raft_consensus.cc:3060] T 2d994cb13f8f453284bcb1f8b85824a2 P 2513a663afac495eb09126ff55e8b2b0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:37.262418 28476 tablet_bootstrap.cc:492] T 2d68b1be563949efbcb4bbe71eddd0d8 P 2513a663afac495eb09126ff55e8b2b0: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:08:37.263377 28476 tablet_bootstrap.cc:492] T 2d68b1be563949efbcb4bbe71eddd0d8 P 2513a663afac495eb09126ff55e8b2b0: Bootstrap complete.
I20260709 13:08:37.264060 28476 ts_tablet_manager.cc:1403] T 2d68b1be563949efbcb4bbe71eddd0d8 P 2513a663afac495eb09126ff55e8b2b0: Time spent bootstrapping tablet: real 0.097s	user 0.034s	sys 0.056s
I20260709 13:08:37.280881 28476 raft_consensus.cc:359] T 2d68b1be563949efbcb4bbe71eddd0d8 P 2513a663afac495eb09126ff55e8b2b0 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 38749 } } peers { permanent_uuid: "18435fbb525741328139e84a1e354954" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 40545 } } peers { permanent_uuid: "2513a663afac495eb09126ff55e8b2b0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40721 } }
I20260709 13:08:37.281556 28476 raft_consensus.cc:740] T 2d68b1be563949efbcb4bbe71eddd0d8 P 2513a663afac495eb09126ff55e8b2b0 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2513a663afac495eb09126ff55e8b2b0, State: Initialized, Role: FOLLOWER
I20260709 13:08:37.282316 28476 consensus_queue.cc:260] T 2d68b1be563949efbcb4bbe71eddd0d8 P 2513a663afac495eb09126ff55e8b2b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 38749 } } peers { permanent_uuid: "18435fbb525741328139e84a1e354954" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 40545 } } peers { permanent_uuid: "2513a663afac495eb09126ff55e8b2b0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40721 } }
I20260709 13:08:37.284040 28476 ts_tablet_manager.cc:1434] T 2d68b1be563949efbcb4bbe71eddd0d8 P 2513a663afac495eb09126ff55e8b2b0: Time spent starting tablet: real 0.020s	user 0.006s	sys 0.000s
I20260709 13:08:37.284825 28476 tablet_bootstrap.cc:492] T fb246ce2984c4a6393f12f75083c9fcf P 2513a663afac495eb09126ff55e8b2b0: Bootstrap starting.
I20260709 13:08:37.301388 28521 raft_consensus.cc:3060] T 64490a86db8c4f5ca54f4f8085f41319 P 2513a663afac495eb09126ff55e8b2b0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:37.382560 28476 tablet_bootstrap.cc:492] T fb246ce2984c4a6393f12f75083c9fcf P 2513a663afac495eb09126ff55e8b2b0: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:08:37.383410 28476 tablet_bootstrap.cc:492] T fb246ce2984c4a6393f12f75083c9fcf P 2513a663afac495eb09126ff55e8b2b0: Bootstrap complete.
I20260709 13:08:37.384009 28476 ts_tablet_manager.cc:1403] T fb246ce2984c4a6393f12f75083c9fcf P 2513a663afac495eb09126ff55e8b2b0: Time spent bootstrapping tablet: real 0.099s	user 0.015s	sys 0.009s
I20260709 13:08:37.393067 28476 raft_consensus.cc:359] T fb246ce2984c4a6393f12f75083c9fcf P 2513a663afac495eb09126ff55e8b2b0 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 38749 } } peers { permanent_uuid: "18435fbb525741328139e84a1e354954" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 40545 } } peers { permanent_uuid: "2513a663afac495eb09126ff55e8b2b0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40721 } }
I20260709 13:08:37.393748 28476 raft_consensus.cc:740] T fb246ce2984c4a6393f12f75083c9fcf P 2513a663afac495eb09126ff55e8b2b0 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2513a663afac495eb09126ff55e8b2b0, State: Initialized, Role: FOLLOWER
I20260709 13:08:37.394340 28476 consensus_queue.cc:260] T fb246ce2984c4a6393f12f75083c9fcf P 2513a663afac495eb09126ff55e8b2b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 38749 } } peers { permanent_uuid: "18435fbb525741328139e84a1e354954" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 40545 } } peers { permanent_uuid: "2513a663afac495eb09126ff55e8b2b0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40721 } }
I20260709 13:08:37.396234 28476 ts_tablet_manager.cc:1434] T fb246ce2984c4a6393f12f75083c9fcf P 2513a663afac495eb09126ff55e8b2b0: Time spent starting tablet: real 0.012s	user 0.005s	sys 0.000s
I20260709 13:08:37.397356 28476 tablet_bootstrap.cc:492] T 47b65672307641ae81d5f94c639b1a10 P 2513a663afac495eb09126ff55e8b2b0: Bootstrap starting.
I20260709 13:08:37.409793 28476 tablet_bootstrap.cc:492] T 47b65672307641ae81d5f94c639b1a10 P 2513a663afac495eb09126ff55e8b2b0: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:08:37.410806 28476 tablet_bootstrap.cc:492] T 47b65672307641ae81d5f94c639b1a10 P 2513a663afac495eb09126ff55e8b2b0: Bootstrap complete.
I20260709 13:08:37.411341 28476 ts_tablet_manager.cc:1403] T 47b65672307641ae81d5f94c639b1a10 P 2513a663afac495eb09126ff55e8b2b0: Time spent bootstrapping tablet: real 0.014s	user 0.009s	sys 0.004s
I20260709 13:08:37.414004 28476 raft_consensus.cc:359] T 47b65672307641ae81d5f94c639b1a10 P 2513a663afac495eb09126ff55e8b2b0 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2513a663afac495eb09126ff55e8b2b0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40721 } } peers { permanent_uuid: "41268b218b804905a110c86738e74400" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 44403 } } peers { permanent_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 38749 } }
I20260709 13:08:37.414664 28476 raft_consensus.cc:740] T 47b65672307641ae81d5f94c639b1a10 P 2513a663afac495eb09126ff55e8b2b0 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2513a663afac495eb09126ff55e8b2b0, State: Initialized, Role: FOLLOWER
I20260709 13:08:37.415352 28476 consensus_queue.cc:260] T 47b65672307641ae81d5f94c639b1a10 P 2513a663afac495eb09126ff55e8b2b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2513a663afac495eb09126ff55e8b2b0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40721 } } peers { permanent_uuid: "41268b218b804905a110c86738e74400" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 44403 } } peers { permanent_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 38749 } }
I20260709 13:08:37.417544 28476 ts_tablet_manager.cc:1434] T 47b65672307641ae81d5f94c639b1a10 P 2513a663afac495eb09126ff55e8b2b0: Time spent starting tablet: real 0.006s	user 0.001s	sys 0.004s
I20260709 13:08:37.418303 28476 tablet_bootstrap.cc:492] T 9db60240699a4db2ba5faa2c50a742da P 2513a663afac495eb09126ff55e8b2b0: Bootstrap starting.
I20260709 13:08:37.438212 28476 tablet_bootstrap.cc:492] T 9db60240699a4db2ba5faa2c50a742da P 2513a663afac495eb09126ff55e8b2b0: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:08:37.439083 28476 tablet_bootstrap.cc:492] T 9db60240699a4db2ba5faa2c50a742da P 2513a663afac495eb09126ff55e8b2b0: Bootstrap complete.
I20260709 13:08:37.439651 28476 ts_tablet_manager.cc:1403] T 9db60240699a4db2ba5faa2c50a742da P 2513a663afac495eb09126ff55e8b2b0: Time spent bootstrapping tablet: real 0.022s	user 0.016s	sys 0.003s
I20260709 13:08:37.441380 28476 raft_consensus.cc:359] T 9db60240699a4db2ba5faa2c50a742da P 2513a663afac495eb09126ff55e8b2b0 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 38749 } } peers { permanent_uuid: "18435fbb525741328139e84a1e354954" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 40545 } } peers { permanent_uuid: "2513a663afac495eb09126ff55e8b2b0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40721 } }
I20260709 13:08:37.441877 28476 raft_consensus.cc:740] T 9db60240699a4db2ba5faa2c50a742da P 2513a663afac495eb09126ff55e8b2b0 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2513a663afac495eb09126ff55e8b2b0, State: Initialized, Role: FOLLOWER
I20260709 13:08:37.442358 28476 consensus_queue.cc:260] T 9db60240699a4db2ba5faa2c50a742da P 2513a663afac495eb09126ff55e8b2b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 38749 } } peers { permanent_uuid: "18435fbb525741328139e84a1e354954" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 40545 } } peers { permanent_uuid: "2513a663afac495eb09126ff55e8b2b0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40721 } }
I20260709 13:08:37.443924 28476 ts_tablet_manager.cc:1434] T 9db60240699a4db2ba5faa2c50a742da P 2513a663afac495eb09126ff55e8b2b0: Time spent starting tablet: real 0.004s	user 0.003s	sys 0.001s
I20260709 13:08:37.444734 28476 tablet_bootstrap.cc:492] T 5e6f8bdfe11b4af4aa27a711db7cbe7a P 2513a663afac495eb09126ff55e8b2b0: Bootstrap starting.
I20260709 13:08:37.477223 28476 tablet_bootstrap.cc:492] T 5e6f8bdfe11b4af4aa27a711db7cbe7a P 2513a663afac495eb09126ff55e8b2b0: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:08:37.477989 28476 tablet_bootstrap.cc:492] T 5e6f8bdfe11b4af4aa27a711db7cbe7a P 2513a663afac495eb09126ff55e8b2b0: Bootstrap complete.
I20260709 13:08:37.478613 28476 ts_tablet_manager.cc:1403] T 5e6f8bdfe11b4af4aa27a711db7cbe7a P 2513a663afac495eb09126ff55e8b2b0: Time spent bootstrapping tablet: real 0.034s	user 0.021s	sys 0.009s
I20260709 13:08:37.481040 28476 raft_consensus.cc:359] T 5e6f8bdfe11b4af4aa27a711db7cbe7a P 2513a663afac495eb09126ff55e8b2b0 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2513a663afac495eb09126ff55e8b2b0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40721 } } peers { permanent_uuid: "41268b218b804905a110c86738e74400" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 44403 } } peers { permanent_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 38749 } }
I20260709 13:08:37.481705 28476 raft_consensus.cc:740] T 5e6f8bdfe11b4af4aa27a711db7cbe7a P 2513a663afac495eb09126ff55e8b2b0 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2513a663afac495eb09126ff55e8b2b0, State: Initialized, Role: FOLLOWER
I20260709 13:08:37.482388 28476 consensus_queue.cc:260] T 5e6f8bdfe11b4af4aa27a711db7cbe7a P 2513a663afac495eb09126ff55e8b2b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2513a663afac495eb09126ff55e8b2b0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40721 } } peers { permanent_uuid: "41268b218b804905a110c86738e74400" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 44403 } } peers { permanent_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 38749 } }
I20260709 13:08:37.484436 28476 ts_tablet_manager.cc:1434] T 5e6f8bdfe11b4af4aa27a711db7cbe7a P 2513a663afac495eb09126ff55e8b2b0: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 13:08:37.485134 28476 tablet_bootstrap.cc:492] T a9eac7f072de454a8ff2beb019da45d9 P 2513a663afac495eb09126ff55e8b2b0: Bootstrap starting.
I20260709 13:08:37.497648 28523 raft_consensus.cc:3060] T 456941807b254f5fb32dca4f84bd16ea P 2513a663afac495eb09126ff55e8b2b0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:37.525885 28476 tablet_bootstrap.cc:492] T a9eac7f072de454a8ff2beb019da45d9 P 2513a663afac495eb09126ff55e8b2b0: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:08:37.526896 28476 tablet_bootstrap.cc:492] T a9eac7f072de454a8ff2beb019da45d9 P 2513a663afac495eb09126ff55e8b2b0: Bootstrap complete.
I20260709 13:08:37.527529 28476 ts_tablet_manager.cc:1403] T a9eac7f072de454a8ff2beb019da45d9 P 2513a663afac495eb09126ff55e8b2b0: Time spent bootstrapping tablet: real 0.043s	user 0.019s	sys 0.003s
I20260709 13:08:37.527895 28522 raft_consensus.cc:3060] T 47b65672307641ae81d5f94c639b1a10 P 2513a663afac495eb09126ff55e8b2b0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:37.530433 28476 raft_consensus.cc:359] T a9eac7f072de454a8ff2beb019da45d9 P 2513a663afac495eb09126ff55e8b2b0 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18435fbb525741328139e84a1e354954" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 40545 } } peers { permanent_uuid: "2513a663afac495eb09126ff55e8b2b0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40721 } } peers { permanent_uuid: "41268b218b804905a110c86738e74400" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 44403 } }
I20260709 13:08:37.531378 28476 raft_consensus.cc:740] T a9eac7f072de454a8ff2beb019da45d9 P 2513a663afac495eb09126ff55e8b2b0 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2513a663afac495eb09126ff55e8b2b0, State: Initialized, Role: FOLLOWER
I20260709 13:08:37.532035 28476 consensus_queue.cc:260] T a9eac7f072de454a8ff2beb019da45d9 P 2513a663afac495eb09126ff55e8b2b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18435fbb525741328139e84a1e354954" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 40545 } } peers { permanent_uuid: "2513a663afac495eb09126ff55e8b2b0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40721 } } peers { permanent_uuid: "41268b218b804905a110c86738e74400" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 44403 } }
I20260709 13:08:37.534405 28476 ts_tablet_manager.cc:1434] T a9eac7f072de454a8ff2beb019da45d9 P 2513a663afac495eb09126ff55e8b2b0: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 13:08:37.535120 28521 raft_consensus.cc:3060] T 2d68b1be563949efbcb4bbe71eddd0d8 P 2513a663afac495eb09126ff55e8b2b0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:37.536576 28517 raft_consensus.cc:3060] T 18f991bbbf3a4615aab49899c7ef86dc P 2513a663afac495eb09126ff55e8b2b0 [term 1 FOLLOWER]: Advancing to term 3
I20260709 13:08:37.868875 28517 raft_consensus.cc:3060] T a9eac7f072de454a8ff2beb019da45d9 P 2513a663afac495eb09126ff55e8b2b0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:46.461184 18300 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:08:46.514360 27666 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7b77a53b493f4e979fdf38a0b17176b0"
dest_uuid: "41268b218b804905a110c86738e74400"
mode: GRACEFUL
new_leader_uuid: "2513a663afac495eb09126ff55e8b2b0"
 from {username='slave'} at 127.0.0.1:59040
I20260709 13:08:46.515324 27666 raft_consensus.cc:606] T 7b77a53b493f4e979fdf38a0b17176b0 P 41268b218b804905a110c86738e74400 [term 2 LEADER]: Received request to transfer leadership to TS 2513a663afac495eb09126ff55e8b2b0
I20260709 13:08:46.518347 27666 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "86af954f570648969cbc47c03d15c447"
dest_uuid: "41268b218b804905a110c86738e74400"
mode: GRACEFUL
new_leader_uuid: "2513a663afac495eb09126ff55e8b2b0"
 from {username='slave'} at 127.0.0.1:59040
I20260709 13:08:46.518805 27666 raft_consensus.cc:606] T 86af954f570648969cbc47c03d15c447 P 41268b218b804905a110c86738e74400 [term 2 LEADER]: Received request to transfer leadership to TS 2513a663afac495eb09126ff55e8b2b0
I20260709 13:08:46.521423 27666 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b6be829f6d3f40c99a3c5be18b0c259c"
dest_uuid: "41268b218b804905a110c86738e74400"
mode: GRACEFUL
new_leader_uuid: "2513a663afac495eb09126ff55e8b2b0"
 from {username='slave'} at 127.0.0.1:59040
I20260709 13:08:46.522022 27666 raft_consensus.cc:606] T b6be829f6d3f40c99a3c5be18b0c259c P 41268b218b804905a110c86738e74400 [term 2 LEADER]: Received request to transfer leadership to TS 2513a663afac495eb09126ff55e8b2b0
I20260709 13:08:46.524384 27666 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "bc77856749a0473a8b3124ce8c523815"
dest_uuid: "41268b218b804905a110c86738e74400"
mode: GRACEFUL
new_leader_uuid: "2513a663afac495eb09126ff55e8b2b0"
 from {username='slave'} at 127.0.0.1:59040
I20260709 13:08:46.524863 27666 raft_consensus.cc:606] T bc77856749a0473a8b3124ce8c523815 P 41268b218b804905a110c86738e74400 [term 1 LEADER]: Received request to transfer leadership to TS 2513a663afac495eb09126ff55e8b2b0
I20260709 13:08:46.542860 27741 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c9ea919812394c7aba307c2ff5b81f51"
dest_uuid: "665f7e09521a4c3f9284c1d8b0e094ff"
mode: GRACEFUL
new_leader_uuid: "2513a663afac495eb09126ff55e8b2b0"
 from {username='slave'} at 127.0.0.1:33604
I20260709 13:08:46.543344 27741 raft_consensus.cc:606] T c9ea919812394c7aba307c2ff5b81f51 P 665f7e09521a4c3f9284c1d8b0e094ff [term 1 LEADER]: Received request to transfer leadership to TS 2513a663afac495eb09126ff55e8b2b0
I20260709 13:08:46.546141 27666 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "de531c50b1524ec788b27bc4b883689a"
dest_uuid: "41268b218b804905a110c86738e74400"
mode: GRACEFUL
new_leader_uuid: "2513a663afac495eb09126ff55e8b2b0"
 from {username='slave'} at 127.0.0.1:59040
I20260709 13:08:46.546733 27666 raft_consensus.cc:606] T de531c50b1524ec788b27bc4b883689a P 41268b218b804905a110c86738e74400 [term 1 LEADER]: Received request to transfer leadership to TS 2513a663afac495eb09126ff55e8b2b0
I20260709 13:08:46.547857 18300 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 13:08:46.549194 18300 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:08:46.831624 28642 raft_consensus.cc:993] T b6be829f6d3f40c99a3c5be18b0c259c P 41268b218b804905a110c86738e74400: : Instructing follower 2513a663afac495eb09126ff55e8b2b0 to start an election
I20260709 13:08:46.832279 28638 raft_consensus.cc:1081] T b6be829f6d3f40c99a3c5be18b0c259c P 41268b218b804905a110c86738e74400 [term 2 LEADER]: Signalling peer 2513a663afac495eb09126ff55e8b2b0 to start an election
I20260709 13:08:46.833827 28517 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b6be829f6d3f40c99a3c5be18b0c259c"
dest_uuid: "2513a663afac495eb09126ff55e8b2b0"
 from {username='slave'} at 127.0.0.1:57676
I20260709 13:08:46.834268 28517 raft_consensus.cc:493] T b6be829f6d3f40c99a3c5be18b0c259c P 2513a663afac495eb09126ff55e8b2b0 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:08:46.834524 28517 raft_consensus.cc:3060] T b6be829f6d3f40c99a3c5be18b0c259c P 2513a663afac495eb09126ff55e8b2b0 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:46.842180 28517 raft_consensus.cc:515] T b6be829f6d3f40c99a3c5be18b0c259c P 2513a663afac495eb09126ff55e8b2b0 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18435fbb525741328139e84a1e354954" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 40545 } } peers { permanent_uuid: "2513a663afac495eb09126ff55e8b2b0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40721 } } peers { permanent_uuid: "41268b218b804905a110c86738e74400" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 44403 } }
I20260709 13:08:46.844452 28649 raft_consensus.cc:993] T bc77856749a0473a8b3124ce8c523815 P 41268b218b804905a110c86738e74400: : Instructing follower 2513a663afac495eb09126ff55e8b2b0 to start an election
I20260709 13:08:46.845050 28638 raft_consensus.cc:1081] T bc77856749a0473a8b3124ce8c523815 P 41268b218b804905a110c86738e74400 [term 1 LEADER]: Signalling peer 2513a663afac495eb09126ff55e8b2b0 to start an election
I20260709 13:08:46.845733 28517 leader_election.cc:290] T b6be829f6d3f40c99a3c5be18b0c259c P 2513a663afac495eb09126ff55e8b2b0 [CANDIDATE]: Term 3 election: Requested vote from peers 18435fbb525741328139e84a1e354954 (127.17.223.4:40545), 41268b218b804905a110c86738e74400 (127.17.223.2:44403)
I20260709 13:08:46.846838 28523 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "bc77856749a0473a8b3124ce8c523815"
dest_uuid: "2513a663afac495eb09126ff55e8b2b0"
 from {username='slave'} at 127.0.0.1:57676
I20260709 13:08:46.847426 28523 raft_consensus.cc:493] T bc77856749a0473a8b3124ce8c523815 P 2513a663afac495eb09126ff55e8b2b0 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:08:46.847748 28523 raft_consensus.cc:3060] T bc77856749a0473a8b3124ce8c523815 P 2513a663afac495eb09126ff55e8b2b0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:46.856345 28523 raft_consensus.cc:515] T bc77856749a0473a8b3124ce8c523815 P 2513a663afac495eb09126ff55e8b2b0 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18435fbb525741328139e84a1e354954" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 40545 } } peers { permanent_uuid: "2513a663afac495eb09126ff55e8b2b0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40721 } } peers { permanent_uuid: "41268b218b804905a110c86738e74400" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 44403 } }
I20260709 13:08:46.861965 28642 raft_consensus.cc:993] T 7b77a53b493f4e979fdf38a0b17176b0 P 41268b218b804905a110c86738e74400: : Instructing follower 2513a663afac495eb09126ff55e8b2b0 to start an election
I20260709 13:08:46.862120 28523 leader_election.cc:290] T bc77856749a0473a8b3124ce8c523815 P 2513a663afac495eb09126ff55e8b2b0 [CANDIDATE]: Term 2 election: Requested vote from peers 18435fbb525741328139e84a1e354954 (127.17.223.4:40545), 41268b218b804905a110c86738e74400 (127.17.223.2:44403)
I20260709 13:08:46.870246 28649 raft_consensus.cc:1081] T 7b77a53b493f4e979fdf38a0b17176b0 P 41268b218b804905a110c86738e74400 [term 2 LEADER]: Signalling peer 2513a663afac495eb09126ff55e8b2b0 to start an election
I20260709 13:08:46.873788 28523 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "7b77a53b493f4e979fdf38a0b17176b0"
dest_uuid: "2513a663afac495eb09126ff55e8b2b0"
 from {username='slave'} at 127.0.0.1:57676
I20260709 13:08:46.874470 28523 raft_consensus.cc:493] T 7b77a53b493f4e979fdf38a0b17176b0 P 2513a663afac495eb09126ff55e8b2b0 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:08:46.874884 28523 raft_consensus.cc:3060] T 7b77a53b493f4e979fdf38a0b17176b0 P 2513a663afac495eb09126ff55e8b2b0 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:46.893563 28523 raft_consensus.cc:515] T 7b77a53b493f4e979fdf38a0b17176b0 P 2513a663afac495eb09126ff55e8b2b0 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2513a663afac495eb09126ff55e8b2b0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40721 } } peers { permanent_uuid: "41268b218b804905a110c86738e74400" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 44403 } } peers { permanent_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 38749 } }
I20260709 13:08:46.907877 28523 leader_election.cc:290] T 7b77a53b493f4e979fdf38a0b17176b0 P 2513a663afac495eb09126ff55e8b2b0 [CANDIDATE]: Term 3 election: Requested vote from peers 41268b218b804905a110c86738e74400 (127.17.223.2:44403), 665f7e09521a4c3f9284c1d8b0e094ff (127.17.223.3:38749)
I20260709 13:08:46.911594 27815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6be829f6d3f40c99a3c5be18b0c259c" candidate_uuid: "2513a663afac495eb09126ff55e8b2b0" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "18435fbb525741328139e84a1e354954"
I20260709 13:08:46.912133 27666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc77856749a0473a8b3124ce8c523815" candidate_uuid: "2513a663afac495eb09126ff55e8b2b0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "41268b218b804905a110c86738e74400"
I20260709 13:08:46.912371 27815 raft_consensus.cc:3060] T b6be829f6d3f40c99a3c5be18b0c259c P 18435fbb525741328139e84a1e354954 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:46.912755 27666 raft_consensus.cc:3055] T bc77856749a0473a8b3124ce8c523815 P 41268b218b804905a110c86738e74400 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:08:46.913579 27665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6be829f6d3f40c99a3c5be18b0c259c" candidate_uuid: "2513a663afac495eb09126ff55e8b2b0" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "41268b218b804905a110c86738e74400"
I20260709 13:08:46.913681 27663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b77a53b493f4e979fdf38a0b17176b0" candidate_uuid: "2513a663afac495eb09126ff55e8b2b0" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "41268b218b804905a110c86738e74400"
I20260709 13:08:46.913975 27666 raft_consensus.cc:740] T bc77856749a0473a8b3124ce8c523815 P 41268b218b804905a110c86738e74400 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 41268b218b804905a110c86738e74400, State: Running, Role: LEADER
I20260709 13:08:46.914131 27665 raft_consensus.cc:3055] T b6be829f6d3f40c99a3c5be18b0c259c P 41268b218b804905a110c86738e74400 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:08:46.914320 27663 raft_consensus.cc:3055] T 7b77a53b493f4e979fdf38a0b17176b0 P 41268b218b804905a110c86738e74400 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:08:46.914502 27665 raft_consensus.cc:740] T b6be829f6d3f40c99a3c5be18b0c259c P 41268b218b804905a110c86738e74400 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 41268b218b804905a110c86738e74400, State: Running, Role: LEADER
I20260709 13:08:46.914826 27663 raft_consensus.cc:740] T 7b77a53b493f4e979fdf38a0b17176b0 P 41268b218b804905a110c86738e74400 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 41268b218b804905a110c86738e74400, State: Running, Role: LEADER
I20260709 13:08:46.915114 27666 consensus_queue.cc:260] T bc77856749a0473a8b3124ce8c523815 P 41268b218b804905a110c86738e74400 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18435fbb525741328139e84a1e354954" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 40545 } } peers { permanent_uuid: "2513a663afac495eb09126ff55e8b2b0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40721 } } peers { permanent_uuid: "41268b218b804905a110c86738e74400" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 44403 } }
I20260709 13:08:46.915470 27665 consensus_queue.cc:260] T b6be829f6d3f40c99a3c5be18b0c259c P 41268b218b804905a110c86738e74400 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18435fbb525741328139e84a1e354954" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 40545 } } peers { permanent_uuid: "2513a663afac495eb09126ff55e8b2b0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40721 } } peers { permanent_uuid: "41268b218b804905a110c86738e74400" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 44403 } }
I20260709 13:08:46.915812 27663 consensus_queue.cc:260] T 7b77a53b493f4e979fdf38a0b17176b0 P 41268b218b804905a110c86738e74400 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2513a663afac495eb09126ff55e8b2b0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40721 } } peers { permanent_uuid: "41268b218b804905a110c86738e74400" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 44403 } } peers { permanent_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 38749 } }
I20260709 13:08:46.916699 27666 raft_consensus.cc:3060] T bc77856749a0473a8b3124ce8c523815 P 41268b218b804905a110c86738e74400 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:46.916942 27665 raft_consensus.cc:3060] T b6be829f6d3f40c99a3c5be18b0c259c P 41268b218b804905a110c86738e74400 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:46.917361 27663 raft_consensus.cc:3060] T 7b77a53b493f4e979fdf38a0b17176b0 P 41268b218b804905a110c86738e74400 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:46.921139 27740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b77a53b493f4e979fdf38a0b17176b0" candidate_uuid: "2513a663afac495eb09126ff55e8b2b0" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "665f7e09521a4c3f9284c1d8b0e094ff"
I20260709 13:08:46.921761 27740 raft_consensus.cc:3060] T 7b77a53b493f4e979fdf38a0b17176b0 P 665f7e09521a4c3f9284c1d8b0e094ff [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:46.926106 27665 raft_consensus.cc:2468] T b6be829f6d3f40c99a3c5be18b0c259c P 41268b218b804905a110c86738e74400 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2513a663afac495eb09126ff55e8b2b0 in term 3.
I20260709 13:08:46.929011 27740 raft_consensus.cc:2468] T 7b77a53b493f4e979fdf38a0b17176b0 P 665f7e09521a4c3f9284c1d8b0e094ff [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2513a663afac495eb09126ff55e8b2b0 in term 3.
I20260709 13:08:46.933754 27815 raft_consensus.cc:2468] T b6be829f6d3f40c99a3c5be18b0c259c P 18435fbb525741328139e84a1e354954 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2513a663afac495eb09126ff55e8b2b0 in term 3.
I20260709 13:08:46.935199 27814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc77856749a0473a8b3124ce8c523815" candidate_uuid: "2513a663afac495eb09126ff55e8b2b0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "18435fbb525741328139e84a1e354954"
I20260709 13:08:46.941500 27814 raft_consensus.cc:3060] T bc77856749a0473a8b3124ce8c523815 P 18435fbb525741328139e84a1e354954 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:46.946163 27666 raft_consensus.cc:2468] T bc77856749a0473a8b3124ce8c523815 P 41268b218b804905a110c86738e74400 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2513a663afac495eb09126ff55e8b2b0 in term 2.
I20260709 13:08:46.939893 28472 leader_election.cc:304] T 7b77a53b493f4e979fdf38a0b17176b0 P 2513a663afac495eb09126ff55e8b2b0 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2513a663afac495eb09126ff55e8b2b0, 665f7e09521a4c3f9284c1d8b0e094ff; no voters: 
I20260709 13:08:46.949216 27814 raft_consensus.cc:2468] T bc77856749a0473a8b3124ce8c523815 P 18435fbb525741328139e84a1e354954 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2513a663afac495eb09126ff55e8b2b0 in term 2.
I20260709 13:08:46.951226 27663 raft_consensus.cc:2468] T 7b77a53b493f4e979fdf38a0b17176b0 P 41268b218b804905a110c86738e74400 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2513a663afac495eb09126ff55e8b2b0 in term 3.
I20260709 13:08:46.951781 28657 raft_consensus.cc:2804] T 7b77a53b493f4e979fdf38a0b17176b0 P 2513a663afac495eb09126ff55e8b2b0 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:08:46.952322 28472 leader_election.cc:304] T b6be829f6d3f40c99a3c5be18b0c259c P 2513a663afac495eb09126ff55e8b2b0 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2513a663afac495eb09126ff55e8b2b0, 41268b218b804905a110c86738e74400; no voters: 
I20260709 13:08:46.958912 28657 raft_consensus.cc:697] T 7b77a53b493f4e979fdf38a0b17176b0 P 2513a663afac495eb09126ff55e8b2b0 [term 3 LEADER]: Becoming Leader. State: Replica: 2513a663afac495eb09126ff55e8b2b0, State: Running, Role: LEADER
I20260709 13:08:46.959538 28658 raft_consensus.cc:2804] T b6be829f6d3f40c99a3c5be18b0c259c P 2513a663afac495eb09126ff55e8b2b0 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:08:46.959775 28655 raft_consensus.cc:993] T de531c50b1524ec788b27bc4b883689a P 41268b218b804905a110c86738e74400: : Instructing follower 2513a663afac495eb09126ff55e8b2b0 to start an election
I20260709 13:08:46.960532 28472 leader_election.cc:304] T bc77856749a0473a8b3124ce8c523815 P 2513a663afac495eb09126ff55e8b2b0 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2513a663afac495eb09126ff55e8b2b0, 41268b218b804905a110c86738e74400; no voters: 
I20260709 13:08:46.960178 28657 consensus_queue.cc:237] T 7b77a53b493f4e979fdf38a0b17176b0 P 2513a663afac495eb09126ff55e8b2b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2513a663afac495eb09126ff55e8b2b0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40721 } } peers { permanent_uuid: "41268b218b804905a110c86738e74400" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 44403 } } peers { permanent_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 38749 } }
I20260709 13:08:46.960889 28649 raft_consensus.cc:1081] T de531c50b1524ec788b27bc4b883689a P 41268b218b804905a110c86738e74400 [term 1 LEADER]: Signalling peer 2513a663afac495eb09126ff55e8b2b0 to start an election
I20260709 13:08:46.961073 28658 raft_consensus.cc:697] T b6be829f6d3f40c99a3c5be18b0c259c P 2513a663afac495eb09126ff55e8b2b0 [term 3 LEADER]: Becoming Leader. State: Replica: 2513a663afac495eb09126ff55e8b2b0, State: Running, Role: LEADER
I20260709 13:08:46.964216 28658 consensus_queue.cc:237] T b6be829f6d3f40c99a3c5be18b0c259c P 2513a663afac495eb09126ff55e8b2b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18435fbb525741328139e84a1e354954" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 40545 } } peers { permanent_uuid: "2513a663afac495eb09126ff55e8b2b0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40721 } } peers { permanent_uuid: "41268b218b804905a110c86738e74400" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 44403 } }
I20260709 13:08:46.967213 28523 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "de531c50b1524ec788b27bc4b883689a"
dest_uuid: "2513a663afac495eb09126ff55e8b2b0"
 from {username='slave'} at 127.0.0.1:57676
I20260709 13:08:46.963235 28659 raft_consensus.cc:2804] T bc77856749a0473a8b3124ce8c523815 P 2513a663afac495eb09126ff55e8b2b0 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:08:46.967823 28523 raft_consensus.cc:493] T de531c50b1524ec788b27bc4b883689a P 2513a663afac495eb09126ff55e8b2b0 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:08:46.968196 28523 raft_consensus.cc:3060] T de531c50b1524ec788b27bc4b883689a P 2513a663afac495eb09126ff55e8b2b0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:46.968215 28659 raft_consensus.cc:697] T bc77856749a0473a8b3124ce8c523815 P 2513a663afac495eb09126ff55e8b2b0 [term 2 LEADER]: Becoming Leader. State: Replica: 2513a663afac495eb09126ff55e8b2b0, State: Running, Role: LEADER
I20260709 13:08:46.969326 28659 consensus_queue.cc:237] T bc77856749a0473a8b3124ce8c523815 P 2513a663afac495eb09126ff55e8b2b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18435fbb525741328139e84a1e354954" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 40545 } } peers { permanent_uuid: "2513a663afac495eb09126ff55e8b2b0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40721 } } peers { permanent_uuid: "41268b218b804905a110c86738e74400" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 44403 } }
I20260709 13:08:46.978855 28523 raft_consensus.cc:515] T de531c50b1524ec788b27bc4b883689a P 2513a663afac495eb09126ff55e8b2b0 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "41268b218b804905a110c86738e74400" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 44403 } } peers { permanent_uuid: "18435fbb525741328139e84a1e354954" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 40545 } } peers { permanent_uuid: "2513a663afac495eb09126ff55e8b2b0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40721 } }
I20260709 13:08:46.987061 28523 leader_election.cc:290] T de531c50b1524ec788b27bc4b883689a P 2513a663afac495eb09126ff55e8b2b0 [CANDIDATE]: Term 2 election: Requested vote from peers 41268b218b804905a110c86738e74400 (127.17.223.2:44403), 18435fbb525741328139e84a1e354954 (127.17.223.4:40545)
I20260709 13:08:47.004107 28655 raft_consensus.cc:993] T 86af954f570648969cbc47c03d15c447 P 41268b218b804905a110c86738e74400: : Instructing follower 2513a663afac495eb09126ff55e8b2b0 to start an election
I20260709 13:08:47.004611 28655 raft_consensus.cc:1081] T 86af954f570648969cbc47c03d15c447 P 41268b218b804905a110c86738e74400 [term 2 LEADER]: Signalling peer 2513a663afac495eb09126ff55e8b2b0 to start an election
I20260709 13:08:47.009337 28518 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "86af954f570648969cbc47c03d15c447"
dest_uuid: "2513a663afac495eb09126ff55e8b2b0"
 from {username='slave'} at 127.0.0.1:57676
I20260709 13:08:47.009991 28518 raft_consensus.cc:493] T 86af954f570648969cbc47c03d15c447 P 2513a663afac495eb09126ff55e8b2b0 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:08:47.010409 28518 raft_consensus.cc:3060] T 86af954f570648969cbc47c03d15c447 P 2513a663afac495eb09126ff55e8b2b0 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:47.016422 28518 raft_consensus.cc:515] T 86af954f570648969cbc47c03d15c447 P 2513a663afac495eb09126ff55e8b2b0 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18435fbb525741328139e84a1e354954" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 40545 } } peers { permanent_uuid: "2513a663afac495eb09126ff55e8b2b0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40721 } } peers { permanent_uuid: "41268b218b804905a110c86738e74400" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 44403 } }
I20260709 13:08:47.018710 28518 leader_election.cc:290] T 86af954f570648969cbc47c03d15c447 P 2513a663afac495eb09126ff55e8b2b0 [CANDIDATE]: Term 3 election: Requested vote from peers 18435fbb525741328139e84a1e354954 (127.17.223.4:40545), 41268b218b804905a110c86738e74400 (127.17.223.2:44403)
W20260709 13:08:47.020345 28472 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.2:44403, user_credentials={real_user=slave}} blocked reactor thread for 59869.5us
I20260709 13:08:47.023864 28640 raft_consensus.cc:993] T c9ea919812394c7aba307c2ff5b81f51 P 665f7e09521a4c3f9284c1d8b0e094ff: : Instructing follower 2513a663afac495eb09126ff55e8b2b0 to start an election
I20260709 13:08:47.025199 27666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de531c50b1524ec788b27bc4b883689a" candidate_uuid: "2513a663afac495eb09126ff55e8b2b0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "41268b218b804905a110c86738e74400"
I20260709 13:08:47.025692 28632 raft_consensus.cc:1081] T c9ea919812394c7aba307c2ff5b81f51 P 665f7e09521a4c3f9284c1d8b0e094ff [term 1 LEADER]: Signalling peer 2513a663afac495eb09126ff55e8b2b0 to start an election
I20260709 13:08:47.025808 27666 raft_consensus.cc:3055] T de531c50b1524ec788b27bc4b883689a P 41268b218b804905a110c86738e74400 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:08:47.026211 27666 raft_consensus.cc:740] T de531c50b1524ec788b27bc4b883689a P 41268b218b804905a110c86738e74400 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 41268b218b804905a110c86738e74400, State: Running, Role: LEADER
I20260709 13:08:47.027151 27666 consensus_queue.cc:260] T de531c50b1524ec788b27bc4b883689a P 41268b218b804905a110c86738e74400 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "41268b218b804905a110c86738e74400" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 44403 } } peers { permanent_uuid: "18435fbb525741328139e84a1e354954" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 40545 } } peers { permanent_uuid: "2513a663afac495eb09126ff55e8b2b0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40721 } }
I20260709 13:08:47.028466 27666 raft_consensus.cc:3060] T de531c50b1524ec788b27bc4b883689a P 41268b218b804905a110c86738e74400 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:47.032364 27815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de531c50b1524ec788b27bc4b883689a" candidate_uuid: "2513a663afac495eb09126ff55e8b2b0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "18435fbb525741328139e84a1e354954"
I20260709 13:08:47.033160 27815 raft_consensus.cc:3060] T de531c50b1524ec788b27bc4b883689a P 18435fbb525741328139e84a1e354954 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:47.034039 27814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86af954f570648969cbc47c03d15c447" candidate_uuid: "2513a663afac495eb09126ff55e8b2b0" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "18435fbb525741328139e84a1e354954"
I20260709 13:08:47.034618 27814 raft_consensus.cc:3060] T 86af954f570648969cbc47c03d15c447 P 18435fbb525741328139e84a1e354954 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:47.038941 28523 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c9ea919812394c7aba307c2ff5b81f51"
dest_uuid: "2513a663afac495eb09126ff55e8b2b0"
 from {username='slave'} at 127.0.0.1:57666
I20260709 13:08:47.039551 28523 raft_consensus.cc:493] T c9ea919812394c7aba307c2ff5b81f51 P 2513a663afac495eb09126ff55e8b2b0 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:08:47.039928 28523 raft_consensus.cc:3060] T c9ea919812394c7aba307c2ff5b81f51 P 2513a663afac495eb09126ff55e8b2b0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:47.047302 28523 raft_consensus.cc:515] T c9ea919812394c7aba307c2ff5b81f51 P 2513a663afac495eb09126ff55e8b2b0 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 38749 } } peers { permanent_uuid: "18435fbb525741328139e84a1e354954" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 40545 } } peers { permanent_uuid: "2513a663afac495eb09126ff55e8b2b0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40721 } }
I20260709 13:08:47.049266 28523 leader_election.cc:290] T c9ea919812394c7aba307c2ff5b81f51 P 2513a663afac495eb09126ff55e8b2b0 [CANDIDATE]: Term 2 election: Requested vote from peers 665f7e09521a4c3f9284c1d8b0e094ff (127.17.223.3:38749), 18435fbb525741328139e84a1e354954 (127.17.223.4:40545)
I20260709 13:08:47.047663 27814 raft_consensus.cc:2468] T 86af954f570648969cbc47c03d15c447 P 18435fbb525741328139e84a1e354954 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2513a663afac495eb09126ff55e8b2b0 in term 3.
I20260709 13:08:47.049892 27740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9ea919812394c7aba307c2ff5b81f51" candidate_uuid: "2513a663afac495eb09126ff55e8b2b0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "665f7e09521a4c3f9284c1d8b0e094ff"
I20260709 13:08:47.050532 27740 raft_consensus.cc:3055] T c9ea919812394c7aba307c2ff5b81f51 P 665f7e09521a4c3f9284c1d8b0e094ff [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:08:47.050845 27740 raft_consensus.cc:740] T c9ea919812394c7aba307c2ff5b81f51 P 665f7e09521a4c3f9284c1d8b0e094ff [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 665f7e09521a4c3f9284c1d8b0e094ff, State: Running, Role: LEADER
I20260709 13:08:47.051148 27814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9ea919812394c7aba307c2ff5b81f51" candidate_uuid: "2513a663afac495eb09126ff55e8b2b0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "18435fbb525741328139e84a1e354954"
I20260709 13:08:47.051761 27666 raft_consensus.cc:2468] T de531c50b1524ec788b27bc4b883689a P 41268b218b804905a110c86738e74400 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2513a663afac495eb09126ff55e8b2b0 in term 2.
I20260709 13:08:47.053763 27815 raft_consensus.cc:2468] T de531c50b1524ec788b27bc4b883689a P 18435fbb525741328139e84a1e354954 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2513a663afac495eb09126ff55e8b2b0 in term 2.
I20260709 13:08:47.051710 27814 raft_consensus.cc:3060] T c9ea919812394c7aba307c2ff5b81f51 P 18435fbb525741328139e84a1e354954 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:47.051599 27740 consensus_queue.cc:260] T c9ea919812394c7aba307c2ff5b81f51 P 665f7e09521a4c3f9284c1d8b0e094ff [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 38749 } } peers { permanent_uuid: "18435fbb525741328139e84a1e354954" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 40545 } } peers { permanent_uuid: "2513a663afac495eb09126ff55e8b2b0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40721 } }
I20260709 13:08:47.056681 28472 leader_election.cc:304] T 86af954f570648969cbc47c03d15c447 P 2513a663afac495eb09126ff55e8b2b0 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 18435fbb525741328139e84a1e354954, 2513a663afac495eb09126ff55e8b2b0; no voters: 
I20260709 13:08:47.058120 27740 raft_consensus.cc:3060] T c9ea919812394c7aba307c2ff5b81f51 P 665f7e09521a4c3f9284c1d8b0e094ff [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:47.058144 28659 raft_consensus.cc:2804] T 86af954f570648969cbc47c03d15c447 P 2513a663afac495eb09126ff55e8b2b0 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:08:47.062959 28659 raft_consensus.cc:697] T 86af954f570648969cbc47c03d15c447 P 2513a663afac495eb09126ff55e8b2b0 [term 3 LEADER]: Becoming Leader. State: Replica: 2513a663afac495eb09126ff55e8b2b0, State: Running, Role: LEADER
I20260709 13:08:47.063405 27814 raft_consensus.cc:2468] T c9ea919812394c7aba307c2ff5b81f51 P 18435fbb525741328139e84a1e354954 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2513a663afac495eb09126ff55e8b2b0 in term 2.
I20260709 13:08:47.064110 28659 consensus_queue.cc:237] T 86af954f570648969cbc47c03d15c447 P 2513a663afac495eb09126ff55e8b2b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18435fbb525741328139e84a1e354954" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 40545 } } peers { permanent_uuid: "2513a663afac495eb09126ff55e8b2b0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40721 } } peers { permanent_uuid: "41268b218b804905a110c86738e74400" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 44403 } }
I20260709 13:08:47.065641 27490 catalog_manager.cc:5697] T 7b77a53b493f4e979fdf38a0b17176b0 P 2513a663afac495eb09126ff55e8b2b0 reported cstate change: term changed from 2 to 3, leader changed from 41268b218b804905a110c86738e74400 (127.17.223.2) to 2513a663afac495eb09126ff55e8b2b0 (127.17.223.1). New cstate: current_term: 3 leader_uuid: "2513a663afac495eb09126ff55e8b2b0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2513a663afac495eb09126ff55e8b2b0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40721 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "41268b218b804905a110c86738e74400" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 44403 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 38749 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:47.067322 27490 catalog_manager.cc:5697] T b6be829f6d3f40c99a3c5be18b0c259c P 2513a663afac495eb09126ff55e8b2b0 reported cstate change: term changed from 2 to 3, leader changed from 41268b218b804905a110c86738e74400 (127.17.223.2) to 2513a663afac495eb09126ff55e8b2b0 (127.17.223.1). New cstate: current_term: 3 leader_uuid: "2513a663afac495eb09126ff55e8b2b0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18435fbb525741328139e84a1e354954" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 40545 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2513a663afac495eb09126ff55e8b2b0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40721 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "41268b218b804905a110c86738e74400" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 44403 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:47.068902 27490 catalog_manager.cc:5697] T bc77856749a0473a8b3124ce8c523815 P 2513a663afac495eb09126ff55e8b2b0 reported cstate change: term changed from 1 to 2, leader changed from 41268b218b804905a110c86738e74400 (127.17.223.2) to 2513a663afac495eb09126ff55e8b2b0 (127.17.223.1). New cstate: current_term: 2 leader_uuid: "2513a663afac495eb09126ff55e8b2b0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18435fbb525741328139e84a1e354954" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 40545 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2513a663afac495eb09126ff55e8b2b0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40721 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "41268b218b804905a110c86738e74400" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 44403 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:47.058302 28472 leader_election.cc:304] T de531c50b1524ec788b27bc4b883689a P 2513a663afac495eb09126ff55e8b2b0 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2513a663afac495eb09126ff55e8b2b0, 41268b218b804905a110c86738e74400; no voters: 
I20260709 13:08:47.040071 27663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86af954f570648969cbc47c03d15c447" candidate_uuid: "2513a663afac495eb09126ff55e8b2b0" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "41268b218b804905a110c86738e74400"
I20260709 13:08:47.072309 27663 raft_consensus.cc:3055] T 86af954f570648969cbc47c03d15c447 P 41268b218b804905a110c86738e74400 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:08:47.072662 27663 raft_consensus.cc:740] T 86af954f570648969cbc47c03d15c447 P 41268b218b804905a110c86738e74400 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 41268b218b804905a110c86738e74400, State: Running, Role: LEADER
I20260709 13:08:47.072984 28472 leader_election.cc:304] T c9ea919812394c7aba307c2ff5b81f51 P 2513a663afac495eb09126ff55e8b2b0 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 18435fbb525741328139e84a1e354954, 2513a663afac495eb09126ff55e8b2b0; no voters: 
I20260709 13:08:47.073443 27663 consensus_queue.cc:260] T 86af954f570648969cbc47c03d15c447 P 41268b218b804905a110c86738e74400 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18435fbb525741328139e84a1e354954" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 40545 } } peers { permanent_uuid: "2513a663afac495eb09126ff55e8b2b0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40721 } } peers { permanent_uuid: "41268b218b804905a110c86738e74400" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 44403 } }
I20260709 13:08:47.074131 28660 raft_consensus.cc:2804] T c9ea919812394c7aba307c2ff5b81f51 P 2513a663afac495eb09126ff55e8b2b0 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:08:47.074714 28660 raft_consensus.cc:697] T c9ea919812394c7aba307c2ff5b81f51 P 2513a663afac495eb09126ff55e8b2b0 [term 2 LEADER]: Becoming Leader. State: Replica: 2513a663afac495eb09126ff55e8b2b0, State: Running, Role: LEADER
I20260709 13:08:47.075197 27663 raft_consensus.cc:3060] T 86af954f570648969cbc47c03d15c447 P 41268b218b804905a110c86738e74400 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:47.075666 28660 consensus_queue.cc:237] T c9ea919812394c7aba307c2ff5b81f51 P 2513a663afac495eb09126ff55e8b2b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 38749 } } peers { permanent_uuid: "18435fbb525741328139e84a1e354954" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 40545 } } peers { permanent_uuid: "2513a663afac495eb09126ff55e8b2b0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40721 } }
I20260709 13:08:47.072889 28658 raft_consensus.cc:2804] T de531c50b1524ec788b27bc4b883689a P 2513a663afac495eb09126ff55e8b2b0 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:08:47.078048 28658 raft_consensus.cc:697] T de531c50b1524ec788b27bc4b883689a P 2513a663afac495eb09126ff55e8b2b0 [term 2 LEADER]: Becoming Leader. State: Replica: 2513a663afac495eb09126ff55e8b2b0, State: Running, Role: LEADER
I20260709 13:08:47.079273 28658 consensus_queue.cc:237] T de531c50b1524ec788b27bc4b883689a P 2513a663afac495eb09126ff55e8b2b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "41268b218b804905a110c86738e74400" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 44403 } } peers { permanent_uuid: "18435fbb525741328139e84a1e354954" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 40545 } } peers { permanent_uuid: "2513a663afac495eb09126ff55e8b2b0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40721 } }
I20260709 13:08:47.085819 27663 raft_consensus.cc:2468] T 86af954f570648969cbc47c03d15c447 P 41268b218b804905a110c86738e74400 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2513a663afac495eb09126ff55e8b2b0 in term 3.
I20260709 13:08:47.117595 27740 raft_consensus.cc:2468] T c9ea919812394c7aba307c2ff5b81f51 P 665f7e09521a4c3f9284c1d8b0e094ff [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2513a663afac495eb09126ff55e8b2b0 in term 2.
I20260709 13:08:47.146368 27490 catalog_manager.cc:5697] T 86af954f570648969cbc47c03d15c447 P 2513a663afac495eb09126ff55e8b2b0 reported cstate change: term changed from 2 to 3, leader changed from 41268b218b804905a110c86738e74400 (127.17.223.2) to 2513a663afac495eb09126ff55e8b2b0 (127.17.223.1). New cstate: current_term: 3 leader_uuid: "2513a663afac495eb09126ff55e8b2b0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18435fbb525741328139e84a1e354954" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 40545 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2513a663afac495eb09126ff55e8b2b0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40721 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "41268b218b804905a110c86738e74400" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 44403 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:47.147897 27490 catalog_manager.cc:5697] T c9ea919812394c7aba307c2ff5b81f51 P 2513a663afac495eb09126ff55e8b2b0 reported cstate change: term changed from 1 to 2, leader changed from 665f7e09521a4c3f9284c1d8b0e094ff (127.17.223.3) to 2513a663afac495eb09126ff55e8b2b0 (127.17.223.1). New cstate: current_term: 2 leader_uuid: "2513a663afac495eb09126ff55e8b2b0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 38749 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "18435fbb525741328139e84a1e354954" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 40545 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2513a663afac495eb09126ff55e8b2b0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40721 } health_report { overall_health: HEALTHY } } }
I20260709 13:08:47.149371 27490 catalog_manager.cc:5697] T de531c50b1524ec788b27bc4b883689a P 2513a663afac495eb09126ff55e8b2b0 reported cstate change: term changed from 1 to 2, leader changed from 41268b218b804905a110c86738e74400 (127.17.223.2) to 2513a663afac495eb09126ff55e8b2b0 (127.17.223.1). New cstate: current_term: 2 leader_uuid: "2513a663afac495eb09126ff55e8b2b0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "41268b218b804905a110c86738e74400" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 44403 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "18435fbb525741328139e84a1e354954" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 40545 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2513a663afac495eb09126ff55e8b2b0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40721 } health_report { overall_health: HEALTHY } } }
I20260709 13:08:47.368770 27666 raft_consensus.cc:1275] T bc77856749a0473a8b3124ce8c523815 P 41268b218b804905a110c86738e74400 [term 2 FOLLOWER]: Refusing update from remote peer 2513a663afac495eb09126ff55e8b2b0: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:08:47.369900 28658 consensus_queue.cc:1048] T bc77856749a0473a8b3124ce8c523815 P 2513a663afac495eb09126ff55e8b2b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "41268b218b804905a110c86738e74400" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 44403 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:08:47.380347 27814 raft_consensus.cc:1275] T bc77856749a0473a8b3124ce8c523815 P 18435fbb525741328139e84a1e354954 [term 2 FOLLOWER]: Refusing update from remote peer 2513a663afac495eb09126ff55e8b2b0: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:08:47.384770 28660 consensus_queue.cc:1048] T bc77856749a0473a8b3124ce8c523815 P 2513a663afac495eb09126ff55e8b2b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "18435fbb525741328139e84a1e354954" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 40545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:08:47.466149 27666 raft_consensus.cc:1275] T 86af954f570648969cbc47c03d15c447 P 41268b218b804905a110c86738e74400 [term 3 FOLLOWER]: Refusing update from remote peer 2513a663afac495eb09126ff55e8b2b0: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:08:47.467401 28660 consensus_queue.cc:1048] T 86af954f570648969cbc47c03d15c447 P 2513a663afac495eb09126ff55e8b2b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "41268b218b804905a110c86738e74400" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 44403 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:08:47.474321 27815 raft_consensus.cc:1275] T b6be829f6d3f40c99a3c5be18b0c259c P 18435fbb525741328139e84a1e354954 [term 3 FOLLOWER]: Refusing update from remote peer 2513a663afac495eb09126ff55e8b2b0: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:08:47.480629 27815 raft_consensus.cc:1275] T 86af954f570648969cbc47c03d15c447 P 18435fbb525741328139e84a1e354954 [term 3 FOLLOWER]: Refusing update from remote peer 2513a663afac495eb09126ff55e8b2b0: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:08:47.482929 28657 consensus_queue.cc:1048] T b6be829f6d3f40c99a3c5be18b0c259c P 2513a663afac495eb09126ff55e8b2b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "18435fbb525741328139e84a1e354954" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 40545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:08:47.484553 28658 consensus_queue.cc:1048] T 86af954f570648969cbc47c03d15c447 P 2513a663afac495eb09126ff55e8b2b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "18435fbb525741328139e84a1e354954" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 40545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:08:47.503862 27666 raft_consensus.cc:1275] T b6be829f6d3f40c99a3c5be18b0c259c P 41268b218b804905a110c86738e74400 [term 3 FOLLOWER]: Refusing update from remote peer 2513a663afac495eb09126ff55e8b2b0: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:08:47.505134 28658 consensus_queue.cc:1048] T b6be829f6d3f40c99a3c5be18b0c259c P 2513a663afac495eb09126ff55e8b2b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "41268b218b804905a110c86738e74400" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 44403 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:08:47.520004 27814 raft_consensus.cc:1275] T c9ea919812394c7aba307c2ff5b81f51 P 18435fbb525741328139e84a1e354954 [term 2 FOLLOWER]: Refusing update from remote peer 2513a663afac495eb09126ff55e8b2b0: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:08:47.521173 28658 consensus_queue.cc:1048] T c9ea919812394c7aba307c2ff5b81f51 P 2513a663afac495eb09126ff55e8b2b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "18435fbb525741328139e84a1e354954" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 40545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:08:47.530961 27741 raft_consensus.cc:1275] T c9ea919812394c7aba307c2ff5b81f51 P 665f7e09521a4c3f9284c1d8b0e094ff [term 2 FOLLOWER]: Refusing update from remote peer 2513a663afac495eb09126ff55e8b2b0: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:08:47.532621 28657 consensus_queue.cc:1048] T c9ea919812394c7aba307c2ff5b81f51 P 2513a663afac495eb09126ff55e8b2b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 38749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:08:47.544838 27666 raft_consensus.cc:1275] T 7b77a53b493f4e979fdf38a0b17176b0 P 41268b218b804905a110c86738e74400 [term 3 FOLLOWER]: Refusing update from remote peer 2513a663afac495eb09126ff55e8b2b0: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:08:47.547863 28658 consensus_queue.cc:1048] T 7b77a53b493f4e979fdf38a0b17176b0 P 2513a663afac495eb09126ff55e8b2b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "41268b218b804905a110c86738e74400" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 44403 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:08:47.550100 18300 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:08:47.579523 27741 raft_consensus.cc:1275] T 7b77a53b493f4e979fdf38a0b17176b0 P 665f7e09521a4c3f9284c1d8b0e094ff [term 3 FOLLOWER]: Refusing update from remote peer 2513a663afac495eb09126ff55e8b2b0: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:08:47.584873 27663 raft_consensus.cc:1275] T de531c50b1524ec788b27bc4b883689a P 41268b218b804905a110c86738e74400 [term 2 FOLLOWER]: Refusing update from remote peer 2513a663afac495eb09126ff55e8b2b0: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:08:47.586298 28658 consensus_queue.cc:1048] T 7b77a53b493f4e979fdf38a0b17176b0 P 2513a663afac495eb09126ff55e8b2b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 38749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:08:47.598831 28657 consensus_queue.cc:1048] T de531c50b1524ec788b27bc4b883689a P 2513a663afac495eb09126ff55e8b2b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "41268b218b804905a110c86738e74400" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 44403 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:08:47.611624 27815 raft_consensus.cc:1275] T de531c50b1524ec788b27bc4b883689a P 18435fbb525741328139e84a1e354954 [term 2 FOLLOWER]: Refusing update from remote peer 2513a663afac495eb09126ff55e8b2b0: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:08:47.613462 28657 consensus_queue.cc:1048] T de531c50b1524ec788b27bc4b883689a P 2513a663afac495eb09126ff55e8b2b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "18435fbb525741328139e84a1e354954" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 40545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:08:47.723867 18300 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:08:47.760882 27741 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1cd5e6e9b36d4591961cb379d7065be9"
dest_uuid: "665f7e09521a4c3f9284c1d8b0e094ff"
mode: GRACEFUL
new_leader_uuid: "2513a663afac495eb09126ff55e8b2b0"
 from {username='slave'} at 127.0.0.1:33604
I20260709 13:08:47.761493 27741 raft_consensus.cc:606] T 1cd5e6e9b36d4591961cb379d7065be9 P 665f7e09521a4c3f9284c1d8b0e094ff [term 1 LEADER]: Received request to transfer leadership to TS 2513a663afac495eb09126ff55e8b2b0
I20260709 13:08:47.763926 27741 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "585e960f8d0f42268f2fe98e1e7b83f0"
dest_uuid: "665f7e09521a4c3f9284c1d8b0e094ff"
mode: GRACEFUL
new_leader_uuid: "2513a663afac495eb09126ff55e8b2b0"
 from {username='slave'} at 127.0.0.1:33604
I20260709 13:08:47.764367 27741 raft_consensus.cc:606] T 585e960f8d0f42268f2fe98e1e7b83f0 P 665f7e09521a4c3f9284c1d8b0e094ff [term 1 LEADER]: Received request to transfer leadership to TS 2513a663afac495eb09126ff55e8b2b0
I20260709 13:08:47.766410 27666 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "765d0bd527c64f74be713c390a018bba"
dest_uuid: "41268b218b804905a110c86738e74400"
mode: GRACEFUL
new_leader_uuid: "2513a663afac495eb09126ff55e8b2b0"
 from {username='slave'} at 127.0.0.1:59040
I20260709 13:08:47.766870 27666 raft_consensus.cc:606] T 765d0bd527c64f74be713c390a018bba P 41268b218b804905a110c86738e74400 [term 1 LEADER]: Received request to transfer leadership to TS 2513a663afac495eb09126ff55e8b2b0
I20260709 13:08:47.768996 27741 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9db60240699a4db2ba5faa2c50a742da"
dest_uuid: "665f7e09521a4c3f9284c1d8b0e094ff"
mode: GRACEFUL
new_leader_uuid: "2513a663afac495eb09126ff55e8b2b0"
 from {username='slave'} at 127.0.0.1:33604
I20260709 13:08:47.769416 27741 raft_consensus.cc:606] T 9db60240699a4db2ba5faa2c50a742da P 665f7e09521a4c3f9284c1d8b0e094ff [term 1 LEADER]: Received request to transfer leadership to TS 2513a663afac495eb09126ff55e8b2b0
I20260709 13:08:47.771595 27741 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ea92a607c73b4d289d081146089a86f9"
dest_uuid: "665f7e09521a4c3f9284c1d8b0e094ff"
mode: GRACEFUL
new_leader_uuid: "2513a663afac495eb09126ff55e8b2b0"
 from {username='slave'} at 127.0.0.1:33604
I20260709 13:08:47.772019 27741 raft_consensus.cc:606] T ea92a607c73b4d289d081146089a86f9 P 665f7e09521a4c3f9284c1d8b0e094ff [term 1 LEADER]: Received request to transfer leadership to TS 2513a663afac495eb09126ff55e8b2b0
I20260709 13:08:47.773000 18300 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:08:47.774199 18300 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:08:47.974826 28632 raft_consensus.cc:993] T 9db60240699a4db2ba5faa2c50a742da P 665f7e09521a4c3f9284c1d8b0e094ff: : Instructing follower 2513a663afac495eb09126ff55e8b2b0 to start an election
I20260709 13:08:47.975356 28648 raft_consensus.cc:1081] T 9db60240699a4db2ba5faa2c50a742da P 665f7e09521a4c3f9284c1d8b0e094ff [term 1 LEADER]: Signalling peer 2513a663afac495eb09126ff55e8b2b0 to start an election
I20260709 13:08:47.976944 28518 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "9db60240699a4db2ba5faa2c50a742da"
dest_uuid: "2513a663afac495eb09126ff55e8b2b0"
 from {username='slave'} at 127.0.0.1:57666
I20260709 13:08:47.977455 28518 raft_consensus.cc:493] T 9db60240699a4db2ba5faa2c50a742da P 2513a663afac495eb09126ff55e8b2b0 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:08:47.977756 28518 raft_consensus.cc:3060] T 9db60240699a4db2ba5faa2c50a742da P 2513a663afac495eb09126ff55e8b2b0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:47.982882 28518 raft_consensus.cc:515] T 9db60240699a4db2ba5faa2c50a742da P 2513a663afac495eb09126ff55e8b2b0 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 38749 } } peers { permanent_uuid: "18435fbb525741328139e84a1e354954" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 40545 } } peers { permanent_uuid: "2513a663afac495eb09126ff55e8b2b0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40721 } }
I20260709 13:08:47.987210 28518 leader_election.cc:290] T 9db60240699a4db2ba5faa2c50a742da P 2513a663afac495eb09126ff55e8b2b0 [CANDIDATE]: Term 2 election: Requested vote from peers 665f7e09521a4c3f9284c1d8b0e094ff (127.17.223.3:38749), 18435fbb525741328139e84a1e354954 (127.17.223.4:40545)
I20260709 13:08:47.989404 27815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9db60240699a4db2ba5faa2c50a742da" candidate_uuid: "2513a663afac495eb09126ff55e8b2b0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "18435fbb525741328139e84a1e354954"
I20260709 13:08:47.989621 27740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9db60240699a4db2ba5faa2c50a742da" candidate_uuid: "2513a663afac495eb09126ff55e8b2b0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "665f7e09521a4c3f9284c1d8b0e094ff"
I20260709 13:08:47.990015 27815 raft_consensus.cc:3060] T 9db60240699a4db2ba5faa2c50a742da P 18435fbb525741328139e84a1e354954 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:47.990208 27740 raft_consensus.cc:3055] T 9db60240699a4db2ba5faa2c50a742da P 665f7e09521a4c3f9284c1d8b0e094ff [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:08:47.990572 27740 raft_consensus.cc:740] T 9db60240699a4db2ba5faa2c50a742da P 665f7e09521a4c3f9284c1d8b0e094ff [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 665f7e09521a4c3f9284c1d8b0e094ff, State: Running, Role: LEADER
I20260709 13:08:47.991326 27740 consensus_queue.cc:260] T 9db60240699a4db2ba5faa2c50a742da P 665f7e09521a4c3f9284c1d8b0e094ff [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 38749 } } peers { permanent_uuid: "18435fbb525741328139e84a1e354954" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 40545 } } peers { permanent_uuid: "2513a663afac495eb09126ff55e8b2b0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40721 } }
I20260709 13:08:47.992640 27740 raft_consensus.cc:3060] T 9db60240699a4db2ba5faa2c50a742da P 665f7e09521a4c3f9284c1d8b0e094ff [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:48.001447 27740 raft_consensus.cc:2468] T 9db60240699a4db2ba5faa2c50a742da P 665f7e09521a4c3f9284c1d8b0e094ff [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2513a663afac495eb09126ff55e8b2b0 in term 2.
I20260709 13:08:48.002557 28472 leader_election.cc:304] T 9db60240699a4db2ba5faa2c50a742da P 2513a663afac495eb09126ff55e8b2b0 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2513a663afac495eb09126ff55e8b2b0, 665f7e09521a4c3f9284c1d8b0e094ff; no voters: 
I20260709 13:08:48.003545 28660 raft_consensus.cc:2804] T 9db60240699a4db2ba5faa2c50a742da P 2513a663afac495eb09126ff55e8b2b0 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:08:48.003479 27815 raft_consensus.cc:2468] T 9db60240699a4db2ba5faa2c50a742da P 18435fbb525741328139e84a1e354954 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2513a663afac495eb09126ff55e8b2b0 in term 2.
I20260709 13:08:48.004276 28660 raft_consensus.cc:697] T 9db60240699a4db2ba5faa2c50a742da P 2513a663afac495eb09126ff55e8b2b0 [term 2 LEADER]: Becoming Leader. State: Replica: 2513a663afac495eb09126ff55e8b2b0, State: Running, Role: LEADER
I20260709 13:08:48.005191 28660 consensus_queue.cc:237] T 9db60240699a4db2ba5faa2c50a742da P 2513a663afac495eb09126ff55e8b2b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 38749 } } peers { permanent_uuid: "18435fbb525741328139e84a1e354954" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 40545 } } peers { permanent_uuid: "2513a663afac495eb09126ff55e8b2b0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40721 } }
I20260709 13:08:48.020810 27491 catalog_manager.cc:5697] T 9db60240699a4db2ba5faa2c50a742da P 2513a663afac495eb09126ff55e8b2b0 reported cstate change: term changed from 1 to 2, leader changed from 665f7e09521a4c3f9284c1d8b0e094ff (127.17.223.3) to 2513a663afac495eb09126ff55e8b2b0 (127.17.223.1). New cstate: current_term: 2 leader_uuid: "2513a663afac495eb09126ff55e8b2b0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 38749 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "18435fbb525741328139e84a1e354954" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 40545 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2513a663afac495eb09126ff55e8b2b0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40721 } health_report { overall_health: HEALTHY } } }
I20260709 13:08:48.029795 28690 raft_consensus.cc:993] T 765d0bd527c64f74be713c390a018bba P 41268b218b804905a110c86738e74400: : Instructing follower 2513a663afac495eb09126ff55e8b2b0 to start an election
I20260709 13:08:48.030468 28642 raft_consensus.cc:1081] T 765d0bd527c64f74be713c390a018bba P 41268b218b804905a110c86738e74400 [term 1 LEADER]: Signalling peer 2513a663afac495eb09126ff55e8b2b0 to start an election
I20260709 13:08:48.032239 28523 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "765d0bd527c64f74be713c390a018bba"
dest_uuid: "2513a663afac495eb09126ff55e8b2b0"
 from {username='slave'} at 127.0.0.1:57676
I20260709 13:08:48.033003 28523 raft_consensus.cc:493] T 765d0bd527c64f74be713c390a018bba P 2513a663afac495eb09126ff55e8b2b0 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:08:48.033489 28523 raft_consensus.cc:3060] T 765d0bd527c64f74be713c390a018bba P 2513a663afac495eb09126ff55e8b2b0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:48.040604 28523 raft_consensus.cc:515] T 765d0bd527c64f74be713c390a018bba P 2513a663afac495eb09126ff55e8b2b0 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2513a663afac495eb09126ff55e8b2b0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40721 } } peers { permanent_uuid: "41268b218b804905a110c86738e74400" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 44403 } } peers { permanent_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 38749 } }
I20260709 13:08:48.042520 28523 leader_election.cc:290] T 765d0bd527c64f74be713c390a018bba P 2513a663afac495eb09126ff55e8b2b0 [CANDIDATE]: Term 2 election: Requested vote from peers 41268b218b804905a110c86738e74400 (127.17.223.2:44403), 665f7e09521a4c3f9284c1d8b0e094ff (127.17.223.3:38749)
I20260709 13:08:48.043443 27666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "765d0bd527c64f74be713c390a018bba" candidate_uuid: "2513a663afac495eb09126ff55e8b2b0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "41268b218b804905a110c86738e74400"
I20260709 13:08:48.044050 27666 raft_consensus.cc:3055] T 765d0bd527c64f74be713c390a018bba P 41268b218b804905a110c86738e74400 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:08:48.044315 27666 raft_consensus.cc:740] T 765d0bd527c64f74be713c390a018bba P 41268b218b804905a110c86738e74400 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 41268b218b804905a110c86738e74400, State: Running, Role: LEADER
I20260709 13:08:48.044241 27740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "765d0bd527c64f74be713c390a018bba" candidate_uuid: "2513a663afac495eb09126ff55e8b2b0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "665f7e09521a4c3f9284c1d8b0e094ff"
I20260709 13:08:48.045056 27740 raft_consensus.cc:3060] T 765d0bd527c64f74be713c390a018bba P 665f7e09521a4c3f9284c1d8b0e094ff [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:48.045322 27666 consensus_queue.cc:260] T 765d0bd527c64f74be713c390a018bba P 41268b218b804905a110c86738e74400 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2513a663afac495eb09126ff55e8b2b0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40721 } } peers { permanent_uuid: "41268b218b804905a110c86738e74400" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 44403 } } peers { permanent_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 38749 } }
I20260709 13:08:48.046603 27666 raft_consensus.cc:3060] T 765d0bd527c64f74be713c390a018bba P 41268b218b804905a110c86738e74400 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:48.050203 27740 raft_consensus.cc:2468] T 765d0bd527c64f74be713c390a018bba P 665f7e09521a4c3f9284c1d8b0e094ff [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2513a663afac495eb09126ff55e8b2b0 in term 2.
I20260709 13:08:48.051110 27666 raft_consensus.cc:2468] T 765d0bd527c64f74be713c390a018bba P 41268b218b804905a110c86738e74400 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2513a663afac495eb09126ff55e8b2b0 in term 2.
I20260709 13:08:48.051586 28472 leader_election.cc:304] T 765d0bd527c64f74be713c390a018bba P 2513a663afac495eb09126ff55e8b2b0 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2513a663afac495eb09126ff55e8b2b0, 665f7e09521a4c3f9284c1d8b0e094ff; no voters: 
I20260709 13:08:48.052364 28660 raft_consensus.cc:2804] T 765d0bd527c64f74be713c390a018bba P 2513a663afac495eb09126ff55e8b2b0 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:08:48.052770 28660 raft_consensus.cc:697] T 765d0bd527c64f74be713c390a018bba P 2513a663afac495eb09126ff55e8b2b0 [term 2 LEADER]: Becoming Leader. State: Replica: 2513a663afac495eb09126ff55e8b2b0, State: Running, Role: LEADER
I20260709 13:08:48.053530 28660 consensus_queue.cc:237] T 765d0bd527c64f74be713c390a018bba P 2513a663afac495eb09126ff55e8b2b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2513a663afac495eb09126ff55e8b2b0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40721 } } peers { permanent_uuid: "41268b218b804905a110c86738e74400" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 44403 } } peers { permanent_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 38749 } }
I20260709 13:08:48.062462 27491 catalog_manager.cc:5697] T 765d0bd527c64f74be713c390a018bba P 2513a663afac495eb09126ff55e8b2b0 reported cstate change: term changed from 1 to 2, leader changed from 41268b218b804905a110c86738e74400 (127.17.223.2) to 2513a663afac495eb09126ff55e8b2b0 (127.17.223.1). New cstate: current_term: 2 leader_uuid: "2513a663afac495eb09126ff55e8b2b0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2513a663afac495eb09126ff55e8b2b0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40721 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "41268b218b804905a110c86738e74400" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 44403 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 38749 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:48.140178 28665 raft_consensus.cc:993] T ea92a607c73b4d289d081146089a86f9 P 665f7e09521a4c3f9284c1d8b0e094ff: : Instructing follower 2513a663afac495eb09126ff55e8b2b0 to start an election
I20260709 13:08:48.140754 28632 raft_consensus.cc:1081] T ea92a607c73b4d289d081146089a86f9 P 665f7e09521a4c3f9284c1d8b0e094ff [term 1 LEADER]: Signalling peer 2513a663afac495eb09126ff55e8b2b0 to start an election
I20260709 13:08:48.142274 28518 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ea92a607c73b4d289d081146089a86f9"
dest_uuid: "2513a663afac495eb09126ff55e8b2b0"
 from {username='slave'} at 127.0.0.1:57666
I20260709 13:08:48.142836 28518 raft_consensus.cc:493] T ea92a607c73b4d289d081146089a86f9 P 2513a663afac495eb09126ff55e8b2b0 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:08:48.143193 28518 raft_consensus.cc:3060] T ea92a607c73b4d289d081146089a86f9 P 2513a663afac495eb09126ff55e8b2b0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:48.148391 28518 raft_consensus.cc:515] T ea92a607c73b4d289d081146089a86f9 P 2513a663afac495eb09126ff55e8b2b0 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2513a663afac495eb09126ff55e8b2b0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40721 } } peers { permanent_uuid: "41268b218b804905a110c86738e74400" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 44403 } } peers { permanent_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 38749 } }
I20260709 13:08:48.150067 28518 leader_election.cc:290] T ea92a607c73b4d289d081146089a86f9 P 2513a663afac495eb09126ff55e8b2b0 [CANDIDATE]: Term 2 election: Requested vote from peers 41268b218b804905a110c86738e74400 (127.17.223.2:44403), 665f7e09521a4c3f9284c1d8b0e094ff (127.17.223.3:38749)
I20260709 13:08:48.151017 27740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea92a607c73b4d289d081146089a86f9" candidate_uuid: "2513a663afac495eb09126ff55e8b2b0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "665f7e09521a4c3f9284c1d8b0e094ff"
I20260709 13:08:48.151157 27666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea92a607c73b4d289d081146089a86f9" candidate_uuid: "2513a663afac495eb09126ff55e8b2b0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "41268b218b804905a110c86738e74400"
I20260709 13:08:48.151561 27740 raft_consensus.cc:3055] T ea92a607c73b4d289d081146089a86f9 P 665f7e09521a4c3f9284c1d8b0e094ff [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:08:48.151753 27666 raft_consensus.cc:3060] T ea92a607c73b4d289d081146089a86f9 P 41268b218b804905a110c86738e74400 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:48.151998 27740 raft_consensus.cc:740] T ea92a607c73b4d289d081146089a86f9 P 665f7e09521a4c3f9284c1d8b0e094ff [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 665f7e09521a4c3f9284c1d8b0e094ff, State: Running, Role: LEADER
I20260709 13:08:48.152953 27740 consensus_queue.cc:260] T ea92a607c73b4d289d081146089a86f9 P 665f7e09521a4c3f9284c1d8b0e094ff [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2513a663afac495eb09126ff55e8b2b0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40721 } } peers { permanent_uuid: "41268b218b804905a110c86738e74400" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 44403 } } peers { permanent_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 38749 } }
I20260709 13:08:48.153945 27740 raft_consensus.cc:3060] T ea92a607c73b4d289d081146089a86f9 P 665f7e09521a4c3f9284c1d8b0e094ff [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:48.156913 27666 raft_consensus.cc:2468] T ea92a607c73b4d289d081146089a86f9 P 41268b218b804905a110c86738e74400 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2513a663afac495eb09126ff55e8b2b0 in term 2.
I20260709 13:08:48.158041 28472 leader_election.cc:304] T ea92a607c73b4d289d081146089a86f9 P 2513a663afac495eb09126ff55e8b2b0 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2513a663afac495eb09126ff55e8b2b0, 41268b218b804905a110c86738e74400; no voters: 
I20260709 13:08:48.158476 27740 raft_consensus.cc:2468] T ea92a607c73b4d289d081146089a86f9 P 665f7e09521a4c3f9284c1d8b0e094ff [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2513a663afac495eb09126ff55e8b2b0 in term 2.
I20260709 13:08:48.158941 28657 raft_consensus.cc:2804] T ea92a607c73b4d289d081146089a86f9 P 2513a663afac495eb09126ff55e8b2b0 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:08:48.159428 28657 raft_consensus.cc:697] T ea92a607c73b4d289d081146089a86f9 P 2513a663afac495eb09126ff55e8b2b0 [term 2 LEADER]: Becoming Leader. State: Replica: 2513a663afac495eb09126ff55e8b2b0, State: Running, Role: LEADER
I20260709 13:08:48.160326 28657 consensus_queue.cc:237] T ea92a607c73b4d289d081146089a86f9 P 2513a663afac495eb09126ff55e8b2b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2513a663afac495eb09126ff55e8b2b0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40721 } } peers { permanent_uuid: "41268b218b804905a110c86738e74400" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 44403 } } peers { permanent_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 38749 } }
I20260709 13:08:48.168888 27491 catalog_manager.cc:5697] T ea92a607c73b4d289d081146089a86f9 P 2513a663afac495eb09126ff55e8b2b0 reported cstate change: term changed from 1 to 2, leader changed from 665f7e09521a4c3f9284c1d8b0e094ff (127.17.223.3) to 2513a663afac495eb09126ff55e8b2b0 (127.17.223.1). New cstate: current_term: 2 leader_uuid: "2513a663afac495eb09126ff55e8b2b0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2513a663afac495eb09126ff55e8b2b0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40721 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "41268b218b804905a110c86738e74400" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 44403 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 38749 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:48.186575 28632 raft_consensus.cc:993] T 1cd5e6e9b36d4591961cb379d7065be9 P 665f7e09521a4c3f9284c1d8b0e094ff: : Instructing follower 2513a663afac495eb09126ff55e8b2b0 to start an election
I20260709 13:08:48.187508 28665 raft_consensus.cc:1081] T 1cd5e6e9b36d4591961cb379d7065be9 P 665f7e09521a4c3f9284c1d8b0e094ff [term 1 LEADER]: Signalling peer 2513a663afac495eb09126ff55e8b2b0 to start an election
I20260709 13:08:48.189178 28518 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "1cd5e6e9b36d4591961cb379d7065be9"
dest_uuid: "2513a663afac495eb09126ff55e8b2b0"
 from {username='slave'} at 127.0.0.1:57666
I20260709 13:08:48.189695 28518 raft_consensus.cc:493] T 1cd5e6e9b36d4591961cb379d7065be9 P 2513a663afac495eb09126ff55e8b2b0 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:08:48.190037 28518 raft_consensus.cc:3060] T 1cd5e6e9b36d4591961cb379d7065be9 P 2513a663afac495eb09126ff55e8b2b0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:48.198696 28518 raft_consensus.cc:515] T 1cd5e6e9b36d4591961cb379d7065be9 P 2513a663afac495eb09126ff55e8b2b0 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 38749 } } peers { permanent_uuid: "18435fbb525741328139e84a1e354954" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 40545 } } peers { permanent_uuid: "2513a663afac495eb09126ff55e8b2b0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40721 } }
I20260709 13:08:48.200080 28518 leader_election.cc:290] T 1cd5e6e9b36d4591961cb379d7065be9 P 2513a663afac495eb09126ff55e8b2b0 [CANDIDATE]: Term 2 election: Requested vote from peers 665f7e09521a4c3f9284c1d8b0e094ff (127.17.223.3:38749), 18435fbb525741328139e84a1e354954 (127.17.223.4:40545)
I20260709 13:08:48.200851 27740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cd5e6e9b36d4591961cb379d7065be9" candidate_uuid: "2513a663afac495eb09126ff55e8b2b0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "665f7e09521a4c3f9284c1d8b0e094ff"
I20260709 13:08:48.201115 27815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cd5e6e9b36d4591961cb379d7065be9" candidate_uuid: "2513a663afac495eb09126ff55e8b2b0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "18435fbb525741328139e84a1e354954"
I20260709 13:08:48.201500 27740 raft_consensus.cc:3055] T 1cd5e6e9b36d4591961cb379d7065be9 P 665f7e09521a4c3f9284c1d8b0e094ff [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:08:48.201707 27815 raft_consensus.cc:3060] T 1cd5e6e9b36d4591961cb379d7065be9 P 18435fbb525741328139e84a1e354954 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:48.201851 27740 raft_consensus.cc:740] T 1cd5e6e9b36d4591961cb379d7065be9 P 665f7e09521a4c3f9284c1d8b0e094ff [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 665f7e09521a4c3f9284c1d8b0e094ff, State: Running, Role: LEADER
I20260709 13:08:48.202765 27740 consensus_queue.cc:260] T 1cd5e6e9b36d4591961cb379d7065be9 P 665f7e09521a4c3f9284c1d8b0e094ff [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 38749 } } peers { permanent_uuid: "18435fbb525741328139e84a1e354954" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 40545 } } peers { permanent_uuid: "2513a663afac495eb09126ff55e8b2b0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40721 } }
I20260709 13:08:48.203794 27740 raft_consensus.cc:3060] T 1cd5e6e9b36d4591961cb379d7065be9 P 665f7e09521a4c3f9284c1d8b0e094ff [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:48.207552 27815 raft_consensus.cc:2468] T 1cd5e6e9b36d4591961cb379d7065be9 P 18435fbb525741328139e84a1e354954 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2513a663afac495eb09126ff55e8b2b0 in term 2.
I20260709 13:08:48.208696 28472 leader_election.cc:304] T 1cd5e6e9b36d4591961cb379d7065be9 P 2513a663afac495eb09126ff55e8b2b0 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 18435fbb525741328139e84a1e354954, 2513a663afac495eb09126ff55e8b2b0; no voters: 
I20260709 13:08:48.209415 28657 raft_consensus.cc:2804] T 1cd5e6e9b36d4591961cb379d7065be9 P 2513a663afac495eb09126ff55e8b2b0 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:08:48.209875 28657 raft_consensus.cc:697] T 1cd5e6e9b36d4591961cb379d7065be9 P 2513a663afac495eb09126ff55e8b2b0 [term 2 LEADER]: Becoming Leader. State: Replica: 2513a663afac495eb09126ff55e8b2b0, State: Running, Role: LEADER
I20260709 13:08:48.210048 27740 raft_consensus.cc:2468] T 1cd5e6e9b36d4591961cb379d7065be9 P 665f7e09521a4c3f9284c1d8b0e094ff [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2513a663afac495eb09126ff55e8b2b0 in term 2.
I20260709 13:08:48.210817 28657 consensus_queue.cc:237] T 1cd5e6e9b36d4591961cb379d7065be9 P 2513a663afac495eb09126ff55e8b2b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 38749 } } peers { permanent_uuid: "18435fbb525741328139e84a1e354954" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 40545 } } peers { permanent_uuid: "2513a663afac495eb09126ff55e8b2b0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40721 } }
I20260709 13:08:48.221518 27491 catalog_manager.cc:5697] T 1cd5e6e9b36d4591961cb379d7065be9 P 2513a663afac495eb09126ff55e8b2b0 reported cstate change: term changed from 1 to 2, leader changed from 665f7e09521a4c3f9284c1d8b0e094ff (127.17.223.3) to 2513a663afac495eb09126ff55e8b2b0 (127.17.223.1). New cstate: current_term: 2 leader_uuid: "2513a663afac495eb09126ff55e8b2b0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 38749 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "18435fbb525741328139e84a1e354954" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 40545 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2513a663afac495eb09126ff55e8b2b0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40721 } health_report { overall_health: HEALTHY } } }
I20260709 13:08:48.282226 28632 raft_consensus.cc:993] T 585e960f8d0f42268f2fe98e1e7b83f0 P 665f7e09521a4c3f9284c1d8b0e094ff: : Instructing follower 2513a663afac495eb09126ff55e8b2b0 to start an election
I20260709 13:08:48.282737 28699 raft_consensus.cc:1081] T 585e960f8d0f42268f2fe98e1e7b83f0 P 665f7e09521a4c3f9284c1d8b0e094ff [term 1 LEADER]: Signalling peer 2513a663afac495eb09126ff55e8b2b0 to start an election
I20260709 13:08:48.284139 28518 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "585e960f8d0f42268f2fe98e1e7b83f0"
dest_uuid: "2513a663afac495eb09126ff55e8b2b0"
 from {username='slave'} at 127.0.0.1:57666
I20260709 13:08:48.284605 28518 raft_consensus.cc:493] T 585e960f8d0f42268f2fe98e1e7b83f0 P 2513a663afac495eb09126ff55e8b2b0 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:08:48.284886 28518 raft_consensus.cc:3060] T 585e960f8d0f42268f2fe98e1e7b83f0 P 2513a663afac495eb09126ff55e8b2b0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:48.292127 28518 raft_consensus.cc:515] T 585e960f8d0f42268f2fe98e1e7b83f0 P 2513a663afac495eb09126ff55e8b2b0 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2513a663afac495eb09126ff55e8b2b0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40721 } } peers { permanent_uuid: "41268b218b804905a110c86738e74400" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 44403 } } peers { permanent_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 38749 } }
I20260709 13:08:48.293608 28518 leader_election.cc:290] T 585e960f8d0f42268f2fe98e1e7b83f0 P 2513a663afac495eb09126ff55e8b2b0 [CANDIDATE]: Term 2 election: Requested vote from peers 41268b218b804905a110c86738e74400 (127.17.223.2:44403), 665f7e09521a4c3f9284c1d8b0e094ff (127.17.223.3:38749)
I20260709 13:08:48.294178 27666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "585e960f8d0f42268f2fe98e1e7b83f0" candidate_uuid: "2513a663afac495eb09126ff55e8b2b0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "41268b218b804905a110c86738e74400"
I20260709 13:08:48.294770 27666 raft_consensus.cc:3060] T 585e960f8d0f42268f2fe98e1e7b83f0 P 41268b218b804905a110c86738e74400 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:48.296195 27740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "585e960f8d0f42268f2fe98e1e7b83f0" candidate_uuid: "2513a663afac495eb09126ff55e8b2b0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "665f7e09521a4c3f9284c1d8b0e094ff"
I20260709 13:08:48.296785 27740 raft_consensus.cc:3055] T 585e960f8d0f42268f2fe98e1e7b83f0 P 665f7e09521a4c3f9284c1d8b0e094ff [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:08:48.297116 27740 raft_consensus.cc:740] T 585e960f8d0f42268f2fe98e1e7b83f0 P 665f7e09521a4c3f9284c1d8b0e094ff [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 665f7e09521a4c3f9284c1d8b0e094ff, State: Running, Role: LEADER
I20260709 13:08:48.297827 27740 consensus_queue.cc:260] T 585e960f8d0f42268f2fe98e1e7b83f0 P 665f7e09521a4c3f9284c1d8b0e094ff [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2513a663afac495eb09126ff55e8b2b0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40721 } } peers { permanent_uuid: "41268b218b804905a110c86738e74400" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 44403 } } peers { permanent_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 38749 } }
I20260709 13:08:48.299023 27740 raft_consensus.cc:3060] T 585e960f8d0f42268f2fe98e1e7b83f0 P 665f7e09521a4c3f9284c1d8b0e094ff [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:48.301324 27666 raft_consensus.cc:2468] T 585e960f8d0f42268f2fe98e1e7b83f0 P 41268b218b804905a110c86738e74400 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2513a663afac495eb09126ff55e8b2b0 in term 2.
I20260709 13:08:48.302320 28472 leader_election.cc:304] T 585e960f8d0f42268f2fe98e1e7b83f0 P 2513a663afac495eb09126ff55e8b2b0 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2513a663afac495eb09126ff55e8b2b0, 41268b218b804905a110c86738e74400; no voters: 
I20260709 13:08:48.302984 28657 raft_consensus.cc:2804] T 585e960f8d0f42268f2fe98e1e7b83f0 P 2513a663afac495eb09126ff55e8b2b0 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:08:48.303445 28657 raft_consensus.cc:697] T 585e960f8d0f42268f2fe98e1e7b83f0 P 2513a663afac495eb09126ff55e8b2b0 [term 2 LEADER]: Becoming Leader. State: Replica: 2513a663afac495eb09126ff55e8b2b0, State: Running, Role: LEADER
I20260709 13:08:48.304234 28657 consensus_queue.cc:237] T 585e960f8d0f42268f2fe98e1e7b83f0 P 2513a663afac495eb09126ff55e8b2b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2513a663afac495eb09126ff55e8b2b0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40721 } } peers { permanent_uuid: "41268b218b804905a110c86738e74400" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 44403 } } peers { permanent_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 38749 } }
I20260709 13:08:48.304706 27740 raft_consensus.cc:2468] T 585e960f8d0f42268f2fe98e1e7b83f0 P 665f7e09521a4c3f9284c1d8b0e094ff [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2513a663afac495eb09126ff55e8b2b0 in term 2.
I20260709 13:08:48.314561 27491 catalog_manager.cc:5697] T 585e960f8d0f42268f2fe98e1e7b83f0 P 2513a663afac495eb09126ff55e8b2b0 reported cstate change: term changed from 1 to 2, leader changed from 665f7e09521a4c3f9284c1d8b0e094ff (127.17.223.3) to 2513a663afac495eb09126ff55e8b2b0 (127.17.223.1). New cstate: current_term: 2 leader_uuid: "2513a663afac495eb09126ff55e8b2b0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2513a663afac495eb09126ff55e8b2b0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40721 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "41268b218b804905a110c86738e74400" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 44403 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 38749 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:48.439163 27666 raft_consensus.cc:1275] T 765d0bd527c64f74be713c390a018bba P 41268b218b804905a110c86738e74400 [term 2 FOLLOWER]: Refusing update from remote peer 2513a663afac495eb09126ff55e8b2b0: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:08:48.440305 28657 consensus_queue.cc:1048] T 765d0bd527c64f74be713c390a018bba P 2513a663afac495eb09126ff55e8b2b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "41268b218b804905a110c86738e74400" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 44403 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:08:48.453554 27741 raft_consensus.cc:1275] T 765d0bd527c64f74be713c390a018bba P 665f7e09521a4c3f9284c1d8b0e094ff [term 2 FOLLOWER]: Refusing update from remote peer 2513a663afac495eb09126ff55e8b2b0: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:08:48.455144 28657 consensus_queue.cc:1048] T 765d0bd527c64f74be713c390a018bba P 2513a663afac495eb09126ff55e8b2b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 38749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:08:48.596837 27741 raft_consensus.cc:1275] T 9db60240699a4db2ba5faa2c50a742da P 665f7e09521a4c3f9284c1d8b0e094ff [term 2 FOLLOWER]: Refusing update from remote peer 2513a663afac495eb09126ff55e8b2b0: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:08:48.597867 28657 consensus_queue.cc:1048] T 9db60240699a4db2ba5faa2c50a742da P 2513a663afac495eb09126ff55e8b2b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 38749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:08:48.600838 27740 raft_consensus.cc:1275] T ea92a607c73b4d289d081146089a86f9 P 665f7e09521a4c3f9284c1d8b0e094ff [term 2 FOLLOWER]: Refusing update from remote peer 2513a663afac495eb09126ff55e8b2b0: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:08:48.602284 28658 consensus_queue.cc:1048] T ea92a607c73b4d289d081146089a86f9 P 2513a663afac495eb09126ff55e8b2b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 38749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:08:48.621476 27815 raft_consensus.cc:1275] T 9db60240699a4db2ba5faa2c50a742da P 18435fbb525741328139e84a1e354954 [term 2 FOLLOWER]: Refusing update from remote peer 2513a663afac495eb09126ff55e8b2b0: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:08:48.625311 28657 consensus_queue.cc:1048] T 9db60240699a4db2ba5faa2c50a742da P 2513a663afac495eb09126ff55e8b2b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "18435fbb525741328139e84a1e354954" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 40545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:08:48.638550 27663 raft_consensus.cc:1275] T ea92a607c73b4d289d081146089a86f9 P 41268b218b804905a110c86738e74400 [term 2 FOLLOWER]: Refusing update from remote peer 2513a663afac495eb09126ff55e8b2b0: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:08:48.640636 28657 consensus_queue.cc:1048] T ea92a607c73b4d289d081146089a86f9 P 2513a663afac495eb09126ff55e8b2b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "41268b218b804905a110c86738e74400" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 44403 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:08:48.713272 27740 raft_consensus.cc:1275] T 1cd5e6e9b36d4591961cb379d7065be9 P 665f7e09521a4c3f9284c1d8b0e094ff [term 2 FOLLOWER]: Refusing update from remote peer 2513a663afac495eb09126ff55e8b2b0: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:08:48.714403 28660 consensus_queue.cc:1048] T 1cd5e6e9b36d4591961cb379d7065be9 P 2513a663afac495eb09126ff55e8b2b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 38749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:08:48.728078 27815 raft_consensus.cc:1275] T 1cd5e6e9b36d4591961cb379d7065be9 P 18435fbb525741328139e84a1e354954 [term 2 FOLLOWER]: Refusing update from remote peer 2513a663afac495eb09126ff55e8b2b0: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:08:48.729467 28660 consensus_queue.cc:1048] T 1cd5e6e9b36d4591961cb379d7065be9 P 2513a663afac495eb09126ff55e8b2b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "18435fbb525741328139e84a1e354954" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 40545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:08:48.775063 18300 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:08:48.814857 18300 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:08:48.853292 27740 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9e94954fc474414ba7563be776d6c80a"
dest_uuid: "665f7e09521a4c3f9284c1d8b0e094ff"
mode: GRACEFUL
new_leader_uuid: "18435fbb525741328139e84a1e354954"
 from {username='slave'} at 127.0.0.1:33604
I20260709 13:08:48.853924 27740 raft_consensus.cc:606] T 9e94954fc474414ba7563be776d6c80a P 665f7e09521a4c3f9284c1d8b0e094ff [term 1 LEADER]: Received request to transfer leadership to TS 18435fbb525741328139e84a1e354954
I20260709 13:08:48.856792 27740 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "afcb3b39d1c9495eab95404687865537"
dest_uuid: "665f7e09521a4c3f9284c1d8b0e094ff"
mode: GRACEFUL
new_leader_uuid: "41268b218b804905a110c86738e74400"
 from {username='slave'} at 127.0.0.1:33604
I20260709 13:08:48.857285 27740 raft_consensus.cc:606] T afcb3b39d1c9495eab95404687865537 P 665f7e09521a4c3f9284c1d8b0e094ff [term 1 LEADER]: Received request to transfer leadership to TS 41268b218b804905a110c86738e74400
I20260709 13:08:48.859601 27740 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e23b142958324f69aa0bad3a5828fa83"
dest_uuid: "665f7e09521a4c3f9284c1d8b0e094ff"
mode: GRACEFUL
new_leader_uuid: "2513a663afac495eb09126ff55e8b2b0"
 from {username='slave'} at 127.0.0.1:33604
I20260709 13:08:48.860054 27740 raft_consensus.cc:606] T e23b142958324f69aa0bad3a5828fa83 P 665f7e09521a4c3f9284c1d8b0e094ff [term 1 LEADER]: Received request to transfer leadership to TS 2513a663afac495eb09126ff55e8b2b0
I20260709 13:08:48.861056 18300 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 13:08:48.862466 18300 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:08:48.894273 28699 raft_consensus.cc:993] T e23b142958324f69aa0bad3a5828fa83 P 665f7e09521a4c3f9284c1d8b0e094ff: : Instructing follower 2513a663afac495eb09126ff55e8b2b0 to start an election
I20260709 13:08:48.894842 28632 raft_consensus.cc:1081] T e23b142958324f69aa0bad3a5828fa83 P 665f7e09521a4c3f9284c1d8b0e094ff [term 1 LEADER]: Signalling peer 2513a663afac495eb09126ff55e8b2b0 to start an election
I20260709 13:08:48.896209 28518 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e23b142958324f69aa0bad3a5828fa83"
dest_uuid: "2513a663afac495eb09126ff55e8b2b0"
 from {username='slave'} at 127.0.0.1:57666
I20260709 13:08:48.896651 28518 raft_consensus.cc:493] T e23b142958324f69aa0bad3a5828fa83 P 2513a663afac495eb09126ff55e8b2b0 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:08:48.896894 28518 raft_consensus.cc:3060] T e23b142958324f69aa0bad3a5828fa83 P 2513a663afac495eb09126ff55e8b2b0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:48.901603 28518 raft_consensus.cc:515] T e23b142958324f69aa0bad3a5828fa83 P 2513a663afac495eb09126ff55e8b2b0 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2513a663afac495eb09126ff55e8b2b0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40721 } } peers { permanent_uuid: "41268b218b804905a110c86738e74400" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 44403 } } peers { permanent_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 38749 } }
I20260709 13:08:48.903539 28518 leader_election.cc:290] T e23b142958324f69aa0bad3a5828fa83 P 2513a663afac495eb09126ff55e8b2b0 [CANDIDATE]: Term 2 election: Requested vote from peers 41268b218b804905a110c86738e74400 (127.17.223.2:44403), 665f7e09521a4c3f9284c1d8b0e094ff (127.17.223.3:38749)
I20260709 13:08:48.904497 27740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e23b142958324f69aa0bad3a5828fa83" candidate_uuid: "2513a663afac495eb09126ff55e8b2b0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "665f7e09521a4c3f9284c1d8b0e094ff"
I20260709 13:08:48.905445 27740 raft_consensus.cc:3055] T e23b142958324f69aa0bad3a5828fa83 P 665f7e09521a4c3f9284c1d8b0e094ff [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:08:48.905952 27740 raft_consensus.cc:740] T e23b142958324f69aa0bad3a5828fa83 P 665f7e09521a4c3f9284c1d8b0e094ff [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 665f7e09521a4c3f9284c1d8b0e094ff, State: Running, Role: LEADER
I20260709 13:08:48.905362 27663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e23b142958324f69aa0bad3a5828fa83" candidate_uuid: "2513a663afac495eb09126ff55e8b2b0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "41268b218b804905a110c86738e74400"
I20260709 13:08:48.906891 27663 raft_consensus.cc:3060] T e23b142958324f69aa0bad3a5828fa83 P 41268b218b804905a110c86738e74400 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:48.907410 27740 consensus_queue.cc:260] T e23b142958324f69aa0bad3a5828fa83 P 665f7e09521a4c3f9284c1d8b0e094ff [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2513a663afac495eb09126ff55e8b2b0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40721 } } peers { permanent_uuid: "41268b218b804905a110c86738e74400" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 44403 } } peers { permanent_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 38749 } }
I20260709 13:08:48.908748 27740 raft_consensus.cc:3060] T e23b142958324f69aa0bad3a5828fa83 P 665f7e09521a4c3f9284c1d8b0e094ff [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:48.910050 27741 raft_consensus.cc:1275] T 585e960f8d0f42268f2fe98e1e7b83f0 P 665f7e09521a4c3f9284c1d8b0e094ff [term 2 FOLLOWER]: Refusing update from remote peer 2513a663afac495eb09126ff55e8b2b0: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:08:48.911466 28660 consensus_queue.cc:1048] T 585e960f8d0f42268f2fe98e1e7b83f0 P 2513a663afac495eb09126ff55e8b2b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 38749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:08:48.915544 27740 raft_consensus.cc:2468] T e23b142958324f69aa0bad3a5828fa83 P 665f7e09521a4c3f9284c1d8b0e094ff [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2513a663afac495eb09126ff55e8b2b0 in term 2.
I20260709 13:08:48.916796 28472 leader_election.cc:304] T e23b142958324f69aa0bad3a5828fa83 P 2513a663afac495eb09126ff55e8b2b0 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2513a663afac495eb09126ff55e8b2b0, 665f7e09521a4c3f9284c1d8b0e094ff; no voters: 
I20260709 13:08:48.917659 28660 raft_consensus.cc:2804] T e23b142958324f69aa0bad3a5828fa83 P 2513a663afac495eb09126ff55e8b2b0 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:08:48.918114 28660 raft_consensus.cc:697] T e23b142958324f69aa0bad3a5828fa83 P 2513a663afac495eb09126ff55e8b2b0 [term 2 LEADER]: Becoming Leader. State: Replica: 2513a663afac495eb09126ff55e8b2b0, State: Running, Role: LEADER
I20260709 13:08:48.919726 28660 consensus_queue.cc:237] T e23b142958324f69aa0bad3a5828fa83 P 2513a663afac495eb09126ff55e8b2b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2513a663afac495eb09126ff55e8b2b0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40721 } } peers { permanent_uuid: "41268b218b804905a110c86738e74400" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 44403 } } peers { permanent_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 38749 } }
I20260709 13:08:48.921497 27663 raft_consensus.cc:2468] T e23b142958324f69aa0bad3a5828fa83 P 41268b218b804905a110c86738e74400 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2513a663afac495eb09126ff55e8b2b0 in term 2.
I20260709 13:08:48.927076 27663 raft_consensus.cc:1275] T 585e960f8d0f42268f2fe98e1e7b83f0 P 41268b218b804905a110c86738e74400 [term 2 FOLLOWER]: Refusing update from remote peer 2513a663afac495eb09126ff55e8b2b0: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:08:48.928522 28657 consensus_queue.cc:1048] T 585e960f8d0f42268f2fe98e1e7b83f0 P 2513a663afac495eb09126ff55e8b2b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "41268b218b804905a110c86738e74400" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 44403 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:08:48.941802 27488 catalog_manager.cc:5697] T e23b142958324f69aa0bad3a5828fa83 P 2513a663afac495eb09126ff55e8b2b0 reported cstate change: term changed from 1 to 2, leader changed from 665f7e09521a4c3f9284c1d8b0e094ff (127.17.223.3) to 2513a663afac495eb09126ff55e8b2b0 (127.17.223.1). New cstate: current_term: 2 leader_uuid: "2513a663afac495eb09126ff55e8b2b0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2513a663afac495eb09126ff55e8b2b0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40721 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "41268b218b804905a110c86738e74400" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 44403 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 38749 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:49.015690 28699 raft_consensus.cc:993] T afcb3b39d1c9495eab95404687865537 P 665f7e09521a4c3f9284c1d8b0e094ff: : Instructing follower 41268b218b804905a110c86738e74400 to start an election
I20260709 13:08:49.016191 28699 raft_consensus.cc:1081] T afcb3b39d1c9495eab95404687865537 P 665f7e09521a4c3f9284c1d8b0e094ff [term 1 LEADER]: Signalling peer 41268b218b804905a110c86738e74400 to start an election
I20260709 13:08:49.017627 27663 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "afcb3b39d1c9495eab95404687865537"
dest_uuid: "41268b218b804905a110c86738e74400"
 from {username='slave'} at 127.0.0.1:35320
I20260709 13:08:49.018038 27663 raft_consensus.cc:493] T afcb3b39d1c9495eab95404687865537 P 41268b218b804905a110c86738e74400 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:08:49.018252 27663 raft_consensus.cc:3060] T afcb3b39d1c9495eab95404687865537 P 41268b218b804905a110c86738e74400 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:49.023701 27663 raft_consensus.cc:515] T afcb3b39d1c9495eab95404687865537 P 41268b218b804905a110c86738e74400 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "41268b218b804905a110c86738e74400" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 44403 } } peers { permanent_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 38749 } } peers { permanent_uuid: "18435fbb525741328139e84a1e354954" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 40545 } }
I20260709 13:08:49.025962 27663 leader_election.cc:290] T afcb3b39d1c9495eab95404687865537 P 41268b218b804905a110c86738e74400 [CANDIDATE]: Term 2 election: Requested vote from peers 665f7e09521a4c3f9284c1d8b0e094ff (127.17.223.3:38749), 18435fbb525741328139e84a1e354954 (127.17.223.4:40545)
I20260709 13:08:49.026568 27741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afcb3b39d1c9495eab95404687865537" candidate_uuid: "41268b218b804905a110c86738e74400" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "665f7e09521a4c3f9284c1d8b0e094ff"
I20260709 13:08:49.026829 27814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afcb3b39d1c9495eab95404687865537" candidate_uuid: "41268b218b804905a110c86738e74400" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "18435fbb525741328139e84a1e354954"
I20260709 13:08:49.027205 27741 raft_consensus.cc:3055] T afcb3b39d1c9495eab95404687865537 P 665f7e09521a4c3f9284c1d8b0e094ff [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:08:49.027464 27814 raft_consensus.cc:3060] T afcb3b39d1c9495eab95404687865537 P 18435fbb525741328139e84a1e354954 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:49.027522 27741 raft_consensus.cc:740] T afcb3b39d1c9495eab95404687865537 P 665f7e09521a4c3f9284c1d8b0e094ff [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 665f7e09521a4c3f9284c1d8b0e094ff, State: Running, Role: LEADER
I20260709 13:08:49.028415 27741 consensus_queue.cc:260] T afcb3b39d1c9495eab95404687865537 P 665f7e09521a4c3f9284c1d8b0e094ff [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "41268b218b804905a110c86738e74400" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 44403 } } peers { permanent_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 38749 } } peers { permanent_uuid: "18435fbb525741328139e84a1e354954" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 40545 } }
I20260709 13:08:49.029353 27741 raft_consensus.cc:3060] T afcb3b39d1c9495eab95404687865537 P 665f7e09521a4c3f9284c1d8b0e094ff [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:49.034034 27814 raft_consensus.cc:2468] T afcb3b39d1c9495eab95404687865537 P 18435fbb525741328139e84a1e354954 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 41268b218b804905a110c86738e74400 in term 2.
I20260709 13:08:49.035367 27634 leader_election.cc:304] T afcb3b39d1c9495eab95404687865537 P 41268b218b804905a110c86738e74400 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 18435fbb525741328139e84a1e354954, 41268b218b804905a110c86738e74400; no voters: 
I20260709 13:08:49.036358 28642 raft_consensus.cc:2804] T afcb3b39d1c9495eab95404687865537 P 41268b218b804905a110c86738e74400 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:08:49.036820 28642 raft_consensus.cc:697] T afcb3b39d1c9495eab95404687865537 P 41268b218b804905a110c86738e74400 [term 2 LEADER]: Becoming Leader. State: Replica: 41268b218b804905a110c86738e74400, State: Running, Role: LEADER
I20260709 13:08:49.037652 28642 consensus_queue.cc:237] T afcb3b39d1c9495eab95404687865537 P 41268b218b804905a110c86738e74400 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "41268b218b804905a110c86738e74400" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 44403 } } peers { permanent_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 38749 } } peers { permanent_uuid: "18435fbb525741328139e84a1e354954" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 40545 } }
I20260709 13:08:49.043869 27741 raft_consensus.cc:2468] T afcb3b39d1c9495eab95404687865537 P 665f7e09521a4c3f9284c1d8b0e094ff [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 41268b218b804905a110c86738e74400 in term 2.
I20260709 13:08:49.050253 27489 catalog_manager.cc:5697] T afcb3b39d1c9495eab95404687865537 P 41268b218b804905a110c86738e74400 reported cstate change: term changed from 1 to 2, leader changed from 665f7e09521a4c3f9284c1d8b0e094ff (127.17.223.3) to 41268b218b804905a110c86738e74400 (127.17.223.2). New cstate: current_term: 2 leader_uuid: "41268b218b804905a110c86738e74400" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "41268b218b804905a110c86738e74400" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 44403 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 38749 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "18435fbb525741328139e84a1e354954" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 40545 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:49.107878 28722 raft_consensus.cc:993] T 9e94954fc474414ba7563be776d6c80a P 665f7e09521a4c3f9284c1d8b0e094ff: : Instructing follower 18435fbb525741328139e84a1e354954 to start an election
I20260709 13:08:49.108337 28699 raft_consensus.cc:1081] T 9e94954fc474414ba7563be776d6c80a P 665f7e09521a4c3f9284c1d8b0e094ff [term 1 LEADER]: Signalling peer 18435fbb525741328139e84a1e354954 to start an election
I20260709 13:08:49.109882 27814 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "9e94954fc474414ba7563be776d6c80a"
dest_uuid: "18435fbb525741328139e84a1e354954"
 from {username='slave'} at 127.0.0.1:48584
I20260709 13:08:49.110436 27814 raft_consensus.cc:493] T 9e94954fc474414ba7563be776d6c80a P 18435fbb525741328139e84a1e354954 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:08:49.110826 27814 raft_consensus.cc:3060] T 9e94954fc474414ba7563be776d6c80a P 18435fbb525741328139e84a1e354954 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:49.117080 27814 raft_consensus.cc:515] T 9e94954fc474414ba7563be776d6c80a P 18435fbb525741328139e84a1e354954 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "41268b218b804905a110c86738e74400" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 44403 } } peers { permanent_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 38749 } } peers { permanent_uuid: "18435fbb525741328139e84a1e354954" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 40545 } }
I20260709 13:08:49.120584 27814 leader_election.cc:290] T 9e94954fc474414ba7563be776d6c80a P 18435fbb525741328139e84a1e354954 [CANDIDATE]: Term 2 election: Requested vote from peers 41268b218b804905a110c86738e74400 (127.17.223.2:44403), 665f7e09521a4c3f9284c1d8b0e094ff (127.17.223.3:38749)
I20260709 13:08:49.121260 27663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e94954fc474414ba7563be776d6c80a" candidate_uuid: "18435fbb525741328139e84a1e354954" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "41268b218b804905a110c86738e74400"
I20260709 13:08:49.121518 27740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e94954fc474414ba7563be776d6c80a" candidate_uuid: "18435fbb525741328139e84a1e354954" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "665f7e09521a4c3f9284c1d8b0e094ff"
I20260709 13:08:49.121843 27663 raft_consensus.cc:3060] T 9e94954fc474414ba7563be776d6c80a P 41268b218b804905a110c86738e74400 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:49.122193 27740 raft_consensus.cc:3055] T 9e94954fc474414ba7563be776d6c80a P 665f7e09521a4c3f9284c1d8b0e094ff [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:08:49.122514 27740 raft_consensus.cc:740] T 9e94954fc474414ba7563be776d6c80a P 665f7e09521a4c3f9284c1d8b0e094ff [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 665f7e09521a4c3f9284c1d8b0e094ff, State: Running, Role: LEADER
I20260709 13:08:49.123291 27740 consensus_queue.cc:260] T 9e94954fc474414ba7563be776d6c80a P 665f7e09521a4c3f9284c1d8b0e094ff [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "41268b218b804905a110c86738e74400" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 44403 } } peers { permanent_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 38749 } } peers { permanent_uuid: "18435fbb525741328139e84a1e354954" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 40545 } }
I20260709 13:08:49.124595 27740 raft_consensus.cc:3060] T 9e94954fc474414ba7563be776d6c80a P 665f7e09521a4c3f9284c1d8b0e094ff [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:49.128007 27663 raft_consensus.cc:2468] T 9e94954fc474414ba7563be776d6c80a P 41268b218b804905a110c86738e74400 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 18435fbb525741328139e84a1e354954 in term 2.
I20260709 13:08:49.129153 27782 leader_election.cc:304] T 9e94954fc474414ba7563be776d6c80a P 18435fbb525741328139e84a1e354954 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 18435fbb525741328139e84a1e354954, 41268b218b804905a110c86738e74400; no voters: 
I20260709 13:08:49.130179 28712 raft_consensus.cc:2804] T 9e94954fc474414ba7563be776d6c80a P 18435fbb525741328139e84a1e354954 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:08:49.130677 28712 raft_consensus.cc:697] T 9e94954fc474414ba7563be776d6c80a P 18435fbb525741328139e84a1e354954 [term 2 LEADER]: Becoming Leader. State: Replica: 18435fbb525741328139e84a1e354954, State: Running, Role: LEADER
I20260709 13:08:49.130960 27740 raft_consensus.cc:2468] T 9e94954fc474414ba7563be776d6c80a P 665f7e09521a4c3f9284c1d8b0e094ff [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 18435fbb525741328139e84a1e354954 in term 2.
I20260709 13:08:49.131516 28712 consensus_queue.cc:237] T 9e94954fc474414ba7563be776d6c80a P 18435fbb525741328139e84a1e354954 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "41268b218b804905a110c86738e74400" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 44403 } } peers { permanent_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 38749 } } peers { permanent_uuid: "18435fbb525741328139e84a1e354954" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 40545 } }
I20260709 13:08:49.143054 27489 catalog_manager.cc:5697] T 9e94954fc474414ba7563be776d6c80a P 18435fbb525741328139e84a1e354954 reported cstate change: term changed from 1 to 2, leader changed from 665f7e09521a4c3f9284c1d8b0e094ff (127.17.223.3) to 18435fbb525741328139e84a1e354954 (127.17.223.4). New cstate: current_term: 2 leader_uuid: "18435fbb525741328139e84a1e354954" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "41268b218b804905a110c86738e74400" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 44403 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 38749 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "18435fbb525741328139e84a1e354954" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 40545 } health_report { overall_health: HEALTHY } } }
I20260709 13:08:49.426059 27741 raft_consensus.cc:1275] T afcb3b39d1c9495eab95404687865537 P 665f7e09521a4c3f9284c1d8b0e094ff [term 2 FOLLOWER]: Refusing update from remote peer 41268b218b804905a110c86738e74400: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:08:49.427141 28642 consensus_queue.cc:1048] T afcb3b39d1c9495eab95404687865537 P 41268b218b804905a110c86738e74400 [LEADER]: Connected to new peer: Peer: permanent_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 38749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:08:49.435930 27815 raft_consensus.cc:1275] T afcb3b39d1c9495eab95404687865537 P 18435fbb525741328139e84a1e354954 [term 2 FOLLOWER]: Refusing update from remote peer 41268b218b804905a110c86738e74400: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:08:49.437659 28642 consensus_queue.cc:1048] T afcb3b39d1c9495eab95404687865537 P 41268b218b804905a110c86738e74400 [LEADER]: Connected to new peer: Peer: permanent_uuid: "18435fbb525741328139e84a1e354954" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 40545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:08:49.452306 27666 raft_consensus.cc:1275] T e23b142958324f69aa0bad3a5828fa83 P 41268b218b804905a110c86738e74400 [term 2 FOLLOWER]: Refusing update from remote peer 2513a663afac495eb09126ff55e8b2b0: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:08:49.453719 28657 consensus_queue.cc:1048] T e23b142958324f69aa0bad3a5828fa83 P 2513a663afac495eb09126ff55e8b2b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "41268b218b804905a110c86738e74400" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 44403 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:08:49.462726 27741 raft_consensus.cc:1275] T e23b142958324f69aa0bad3a5828fa83 P 665f7e09521a4c3f9284c1d8b0e094ff [term 2 FOLLOWER]: Refusing update from remote peer 2513a663afac495eb09126ff55e8b2b0: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:08:49.467383 28714 consensus_queue.cc:1048] T e23b142958324f69aa0bad3a5828fa83 P 2513a663afac495eb09126ff55e8b2b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 38749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:08:49.734897 27666 raft_consensus.cc:1275] T 9e94954fc474414ba7563be776d6c80a P 41268b218b804905a110c86738e74400 [term 2 FOLLOWER]: Refusing update from remote peer 18435fbb525741328139e84a1e354954: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:08:49.736120 28712 consensus_queue.cc:1048] T 9e94954fc474414ba7563be776d6c80a P 18435fbb525741328139e84a1e354954 [LEADER]: Connected to new peer: Peer: permanent_uuid: "41268b218b804905a110c86738e74400" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 44403 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:08:49.743920 27740 raft_consensus.cc:1275] T 9e94954fc474414ba7563be776d6c80a P 665f7e09521a4c3f9284c1d8b0e094ff [term 2 FOLLOWER]: Refusing update from remote peer 18435fbb525741328139e84a1e354954: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:08:49.745748 28643 consensus_queue.cc:1048] T 9e94954fc474414ba7563be776d6c80a P 18435fbb525741328139e84a1e354954 [LEADER]: Connected to new peer: Peer: permanent_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 38749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:08:49.863447 18300 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:08:49.911530 18300 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:08:49.951027 27666 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "15a4c537259e4b2882a5cc8e723b260a"
dest_uuid: "41268b218b804905a110c86738e74400"
mode: GRACEFUL
new_leader_uuid: "2513a663afac495eb09126ff55e8b2b0"
 from {username='slave'} at 127.0.0.1:59040
I20260709 13:08:49.951570 27666 raft_consensus.cc:606] T 15a4c537259e4b2882a5cc8e723b260a P 41268b218b804905a110c86738e74400 [term 1 LEADER]: Received request to transfer leadership to TS 2513a663afac495eb09126ff55e8b2b0
I20260709 13:08:49.967610 27815 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a9eac7f072de454a8ff2beb019da45d9"
dest_uuid: "18435fbb525741328139e84a1e354954"
mode: GRACEFUL
new_leader_uuid: "2513a663afac495eb09126ff55e8b2b0"
 from {username='slave'} at 127.0.0.1:54308
I20260709 13:08:49.968101 27815 raft_consensus.cc:606] T a9eac7f072de454a8ff2beb019da45d9 P 18435fbb525741328139e84a1e354954 [term 2 LEADER]: Received request to transfer leadership to TS 2513a663afac495eb09126ff55e8b2b0
I20260709 13:08:49.969075 18300 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 13:08:49.970232 18300 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:08:50.008476 28741 raft_consensus.cc:993] T 15a4c537259e4b2882a5cc8e723b260a P 41268b218b804905a110c86738e74400: : Instructing follower 2513a663afac495eb09126ff55e8b2b0 to start an election
I20260709 13:08:50.009195 28741 raft_consensus.cc:1081] T 15a4c537259e4b2882a5cc8e723b260a P 41268b218b804905a110c86738e74400 [term 1 LEADER]: Signalling peer 2513a663afac495eb09126ff55e8b2b0 to start an election
I20260709 13:08:50.012668 28518 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "15a4c537259e4b2882a5cc8e723b260a"
dest_uuid: "2513a663afac495eb09126ff55e8b2b0"
 from {username='slave'} at 127.0.0.1:57676
I20260709 13:08:50.013172 28518 raft_consensus.cc:493] T 15a4c537259e4b2882a5cc8e723b260a P 2513a663afac495eb09126ff55e8b2b0 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:08:50.013512 28518 raft_consensus.cc:3060] T 15a4c537259e4b2882a5cc8e723b260a P 2513a663afac495eb09126ff55e8b2b0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:50.020063 28518 raft_consensus.cc:515] T 15a4c537259e4b2882a5cc8e723b260a P 2513a663afac495eb09126ff55e8b2b0 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18435fbb525741328139e84a1e354954" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 40545 } } peers { permanent_uuid: "2513a663afac495eb09126ff55e8b2b0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40721 } } peers { permanent_uuid: "41268b218b804905a110c86738e74400" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 44403 } }
I20260709 13:08:50.021821 28518 leader_election.cc:290] T 15a4c537259e4b2882a5cc8e723b260a P 2513a663afac495eb09126ff55e8b2b0 [CANDIDATE]: Term 2 election: Requested vote from peers 18435fbb525741328139e84a1e354954 (127.17.223.4:40545), 41268b218b804905a110c86738e74400 (127.17.223.2:44403)
I20260709 13:08:50.022306 27814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15a4c537259e4b2882a5cc8e723b260a" candidate_uuid: "2513a663afac495eb09126ff55e8b2b0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "18435fbb525741328139e84a1e354954"
I20260709 13:08:50.022742 27666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15a4c537259e4b2882a5cc8e723b260a" candidate_uuid: "2513a663afac495eb09126ff55e8b2b0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "41268b218b804905a110c86738e74400"
I20260709 13:08:50.023113 27814 raft_consensus.cc:3060] T 15a4c537259e4b2882a5cc8e723b260a P 18435fbb525741328139e84a1e354954 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:50.023310 27666 raft_consensus.cc:3055] T 15a4c537259e4b2882a5cc8e723b260a P 41268b218b804905a110c86738e74400 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:08:50.023623 27666 raft_consensus.cc:740] T 15a4c537259e4b2882a5cc8e723b260a P 41268b218b804905a110c86738e74400 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 41268b218b804905a110c86738e74400, State: Running, Role: LEADER
I20260709 13:08:50.024437 27666 consensus_queue.cc:260] T 15a4c537259e4b2882a5cc8e723b260a P 41268b218b804905a110c86738e74400 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18435fbb525741328139e84a1e354954" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 40545 } } peers { permanent_uuid: "2513a663afac495eb09126ff55e8b2b0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40721 } } peers { permanent_uuid: "41268b218b804905a110c86738e74400" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 44403 } }
I20260709 13:08:50.025862 27666 raft_consensus.cc:3060] T 15a4c537259e4b2882a5cc8e723b260a P 41268b218b804905a110c86738e74400 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:50.029760 27814 raft_consensus.cc:2468] T 15a4c537259e4b2882a5cc8e723b260a P 18435fbb525741328139e84a1e354954 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2513a663afac495eb09126ff55e8b2b0 in term 2.
I20260709 13:08:50.030959 28472 leader_election.cc:304] T 15a4c537259e4b2882a5cc8e723b260a P 2513a663afac495eb09126ff55e8b2b0 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 18435fbb525741328139e84a1e354954, 2513a663afac495eb09126ff55e8b2b0; no voters: 
I20260709 13:08:50.031699 28732 raft_consensus.cc:2804] T 15a4c537259e4b2882a5cc8e723b260a P 2513a663afac495eb09126ff55e8b2b0 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:08:50.032505 28732 raft_consensus.cc:697] T 15a4c537259e4b2882a5cc8e723b260a P 2513a663afac495eb09126ff55e8b2b0 [term 2 LEADER]: Becoming Leader. State: Replica: 2513a663afac495eb09126ff55e8b2b0, State: Running, Role: LEADER
I20260709 13:08:50.033409 27666 raft_consensus.cc:2468] T 15a4c537259e4b2882a5cc8e723b260a P 41268b218b804905a110c86738e74400 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2513a663afac495eb09126ff55e8b2b0 in term 2.
I20260709 13:08:50.033442 28732 consensus_queue.cc:237] T 15a4c537259e4b2882a5cc8e723b260a P 2513a663afac495eb09126ff55e8b2b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18435fbb525741328139e84a1e354954" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 40545 } } peers { permanent_uuid: "2513a663afac495eb09126ff55e8b2b0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40721 } } peers { permanent_uuid: "41268b218b804905a110c86738e74400" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 44403 } }
I20260709 13:08:50.045907 27491 catalog_manager.cc:5697] T 15a4c537259e4b2882a5cc8e723b260a P 2513a663afac495eb09126ff55e8b2b0 reported cstate change: term changed from 1 to 2, leader changed from 41268b218b804905a110c86738e74400 (127.17.223.2) to 2513a663afac495eb09126ff55e8b2b0 (127.17.223.1). New cstate: current_term: 2 leader_uuid: "2513a663afac495eb09126ff55e8b2b0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18435fbb525741328139e84a1e354954" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 40545 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2513a663afac495eb09126ff55e8b2b0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40721 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "41268b218b804905a110c86738e74400" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 44403 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:50.401199 28736 raft_consensus.cc:993] T a9eac7f072de454a8ff2beb019da45d9 P 18435fbb525741328139e84a1e354954: : Instructing follower 2513a663afac495eb09126ff55e8b2b0 to start an election
I20260709 13:08:50.401687 28735 raft_consensus.cc:1081] T a9eac7f072de454a8ff2beb019da45d9 P 18435fbb525741328139e84a1e354954 [term 2 LEADER]: Signalling peer 2513a663afac495eb09126ff55e8b2b0 to start an election
I20260709 13:08:50.403148 28518 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a9eac7f072de454a8ff2beb019da45d9"
dest_uuid: "2513a663afac495eb09126ff55e8b2b0"
 from {username='slave'} at 127.0.0.1:57672
I20260709 13:08:50.403669 28518 raft_consensus.cc:493] T a9eac7f072de454a8ff2beb019da45d9 P 2513a663afac495eb09126ff55e8b2b0 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:08:50.403966 28518 raft_consensus.cc:3060] T a9eac7f072de454a8ff2beb019da45d9 P 2513a663afac495eb09126ff55e8b2b0 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:50.409912 28518 raft_consensus.cc:515] T a9eac7f072de454a8ff2beb019da45d9 P 2513a663afac495eb09126ff55e8b2b0 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18435fbb525741328139e84a1e354954" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 40545 } } peers { permanent_uuid: "2513a663afac495eb09126ff55e8b2b0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40721 } } peers { permanent_uuid: "41268b218b804905a110c86738e74400" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 44403 } }
I20260709 13:08:50.411844 28518 leader_election.cc:290] T a9eac7f072de454a8ff2beb019da45d9 P 2513a663afac495eb09126ff55e8b2b0 [CANDIDATE]: Term 3 election: Requested vote from peers 18435fbb525741328139e84a1e354954 (127.17.223.4:40545), 41268b218b804905a110c86738e74400 (127.17.223.2:44403)
I20260709 13:08:50.412261 27815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9eac7f072de454a8ff2beb019da45d9" candidate_uuid: "2513a663afac495eb09126ff55e8b2b0" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "18435fbb525741328139e84a1e354954"
I20260709 13:08:50.412770 27666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9eac7f072de454a8ff2beb019da45d9" candidate_uuid: "2513a663afac495eb09126ff55e8b2b0" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "41268b218b804905a110c86738e74400"
I20260709 13:08:50.412915 27815 raft_consensus.cc:3055] T a9eac7f072de454a8ff2beb019da45d9 P 18435fbb525741328139e84a1e354954 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:08:50.413339 27815 raft_consensus.cc:740] T a9eac7f072de454a8ff2beb019da45d9 P 18435fbb525741328139e84a1e354954 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 18435fbb525741328139e84a1e354954, State: Running, Role: LEADER
I20260709 13:08:50.413368 27666 raft_consensus.cc:3060] T a9eac7f072de454a8ff2beb019da45d9 P 41268b218b804905a110c86738e74400 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:50.414275 27815 consensus_queue.cc:260] T a9eac7f072de454a8ff2beb019da45d9 P 18435fbb525741328139e84a1e354954 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18435fbb525741328139e84a1e354954" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 40545 } } peers { permanent_uuid: "2513a663afac495eb09126ff55e8b2b0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40721 } } peers { permanent_uuid: "41268b218b804905a110c86738e74400" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 44403 } }
I20260709 13:08:50.415504 27815 raft_consensus.cc:3060] T a9eac7f072de454a8ff2beb019da45d9 P 18435fbb525741328139e84a1e354954 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:50.421978 27815 raft_consensus.cc:2468] T a9eac7f072de454a8ff2beb019da45d9 P 18435fbb525741328139e84a1e354954 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2513a663afac495eb09126ff55e8b2b0 in term 3.
I20260709 13:08:50.423324 28472 leader_election.cc:304] T a9eac7f072de454a8ff2beb019da45d9 P 2513a663afac495eb09126ff55e8b2b0 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 18435fbb525741328139e84a1e354954, 2513a663afac495eb09126ff55e8b2b0; no voters: 
I20260709 13:08:50.424311 28731 raft_consensus.cc:2804] T a9eac7f072de454a8ff2beb019da45d9 P 2513a663afac495eb09126ff55e8b2b0 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:08:50.424412 27666 raft_consensus.cc:2468] T a9eac7f072de454a8ff2beb019da45d9 P 41268b218b804905a110c86738e74400 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2513a663afac495eb09126ff55e8b2b0 in term 3.
I20260709 13:08:50.424830 28731 raft_consensus.cc:697] T a9eac7f072de454a8ff2beb019da45d9 P 2513a663afac495eb09126ff55e8b2b0 [term 3 LEADER]: Becoming Leader. State: Replica: 2513a663afac495eb09126ff55e8b2b0, State: Running, Role: LEADER
I20260709 13:08:50.425812 28731 consensus_queue.cc:237] T a9eac7f072de454a8ff2beb019da45d9 P 2513a663afac495eb09126ff55e8b2b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18435fbb525741328139e84a1e354954" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 40545 } } peers { permanent_uuid: "2513a663afac495eb09126ff55e8b2b0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40721 } } peers { permanent_uuid: "41268b218b804905a110c86738e74400" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 44403 } }
I20260709 13:08:50.461706 27491 catalog_manager.cc:5697] T a9eac7f072de454a8ff2beb019da45d9 P 2513a663afac495eb09126ff55e8b2b0 reported cstate change: term changed from 2 to 3, leader changed from 18435fbb525741328139e84a1e354954 (127.17.223.4) to 2513a663afac495eb09126ff55e8b2b0 (127.17.223.1). New cstate: current_term: 3 leader_uuid: "2513a663afac495eb09126ff55e8b2b0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18435fbb525741328139e84a1e354954" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 40545 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2513a663afac495eb09126ff55e8b2b0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40721 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "41268b218b804905a110c86738e74400" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 44403 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:50.489135 27815 raft_consensus.cc:1275] T 15a4c537259e4b2882a5cc8e723b260a P 18435fbb525741328139e84a1e354954 [term 2 FOLLOWER]: Refusing update from remote peer 2513a663afac495eb09126ff55e8b2b0: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:08:50.493813 28732 consensus_queue.cc:1048] T 15a4c537259e4b2882a5cc8e723b260a P 2513a663afac495eb09126ff55e8b2b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "18435fbb525741328139e84a1e354954" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 40545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
W20260709 13:08:50.560024 27634 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.3:38749, user_credentials={real_user=slave}} blocked reactor thread for 48134.4us
I20260709 13:08:50.624576 27666 raft_consensus.cc:1275] T 15a4c537259e4b2882a5cc8e723b260a P 41268b218b804905a110c86738e74400 [term 2 FOLLOWER]: Refusing update from remote peer 2513a663afac495eb09126ff55e8b2b0: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:08:50.631321 28731 consensus_queue.cc:1048] T 15a4c537259e4b2882a5cc8e723b260a P 2513a663afac495eb09126ff55e8b2b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "41268b218b804905a110c86738e74400" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 44403 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:08:50.845556 27666 raft_consensus.cc:1275] T a9eac7f072de454a8ff2beb019da45d9 P 41268b218b804905a110c86738e74400 [term 3 FOLLOWER]: Refusing update from remote peer 2513a663afac495eb09126ff55e8b2b0: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:08:50.845839 27814 raft_consensus.cc:1275] T a9eac7f072de454a8ff2beb019da45d9 P 18435fbb525741328139e84a1e354954 [term 3 FOLLOWER]: Refusing update from remote peer 2513a663afac495eb09126ff55e8b2b0: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:08:50.847169 28732 consensus_queue.cc:1048] T a9eac7f072de454a8ff2beb019da45d9 P 2513a663afac495eb09126ff55e8b2b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "41268b218b804905a110c86738e74400" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 44403 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:08:50.847846 28731 consensus_queue.cc:1048] T a9eac7f072de454a8ff2beb019da45d9 P 2513a663afac495eb09126ff55e8b2b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "18435fbb525741328139e84a1e354954" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 40545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:08:50.971319 18300 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:08:51.013149 18300 tablet_server.cc:179] TabletServer@127.17.223.1:40721 shutting down...
W20260709 13:08:51.023962 27705 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 116 similar messages]
W20260709 13:08:51.040637 27705 consensus_peers.cc:597] T 2d68b1be563949efbcb4bbe71eddd0d8 P 665f7e09521a4c3f9284c1d8b0e094ff -> Peer 2513a663afac495eb09126ff55e8b2b0 (127.17.223.1:40721): Couldn't send request to peer 2513a663afac495eb09126ff55e8b2b0. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:08:51.054657 18300 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:08:51.055565 18300 tablet_replica.cc:333] stopping tablet replica
I20260709 13:08:51.056447 18300 raft_consensus.cc:2243] T 5e6f8bdfe11b4af4aa27a711db7cbe7a P 2513a663afac495eb09126ff55e8b2b0 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:51.057044 18300 raft_consensus.cc:2272] T 5e6f8bdfe11b4af4aa27a711db7cbe7a P 2513a663afac495eb09126ff55e8b2b0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:51.060708 18300 tablet_replica.cc:333] stopping tablet replica
I20260709 13:08:51.061861 18300 raft_consensus.cc:2243] T 47b65672307641ae81d5f94c639b1a10 P 2513a663afac495eb09126ff55e8b2b0 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:51.062610 18300 raft_consensus.cc:2272] T 47b65672307641ae81d5f94c639b1a10 P 2513a663afac495eb09126ff55e8b2b0 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:51.066113 18300 tablet_replica.cc:333] stopping tablet replica
I20260709 13:08:51.067137 18300 raft_consensus.cc:2243] T 4cd7359accee42808761c37543247321 P 2513a663afac495eb09126ff55e8b2b0 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:51.067749 18300 raft_consensus.cc:2272] T 4cd7359accee42808761c37543247321 P 2513a663afac495eb09126ff55e8b2b0 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:08:51.068753 27631 consensus_peers.cc:597] T d0c8b4ec2d844a89b4bb66c0f1bf2c8f P 41268b218b804905a110c86738e74400 -> Peer 2513a663afac495eb09126ff55e8b2b0 (127.17.223.1:40721): Couldn't send request to peer 2513a663afac495eb09126ff55e8b2b0. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:08:51.071024 18300 tablet_replica.cc:333] stopping tablet replica
I20260709 13:08:51.071962 18300 raft_consensus.cc:2243] T 8e758d59bd4a4eae9f67662e165013f9 P 2513a663afac495eb09126ff55e8b2b0 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:51.072365 18300 raft_consensus.cc:2272] T 8e758d59bd4a4eae9f67662e165013f9 P 2513a663afac495eb09126ff55e8b2b0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:51.075564 18300 tablet_replica.cc:333] stopping tablet replica
I20260709 13:08:51.076541 18300 raft_consensus.cc:2243] T 9c0f604d66664505aa9469fb058601b6 P 2513a663afac495eb09126ff55e8b2b0 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:51.077231 18300 raft_consensus.cc:2272] T 9c0f604d66664505aa9469fb058601b6 P 2513a663afac495eb09126ff55e8b2b0 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:08:51.078934 27779 consensus_peers.cc:597] T 55a3afc21cea43ea85f4a2155552422d P 18435fbb525741328139e84a1e354954 -> Peer 2513a663afac495eb09126ff55e8b2b0 (127.17.223.1:40721): Couldn't send request to peer 2513a663afac495eb09126ff55e8b2b0. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:08:51.080040 18300 tablet_replica.cc:333] stopping tablet replica
I20260709 13:08:51.080626 18300 raft_consensus.cc:2243] T 64490a86db8c4f5ca54f4f8085f41319 P 2513a663afac495eb09126ff55e8b2b0 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:51.081178 18300 raft_consensus.cc:2272] T 64490a86db8c4f5ca54f4f8085f41319 P 2513a663afac495eb09126ff55e8b2b0 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:51.083580 18300 tablet_replica.cc:333] stopping tablet replica
I20260709 13:08:51.084160 18300 raft_consensus.cc:2243] T bbd0bdc9640c4956a5d60406841ef0f0 P 2513a663afac495eb09126ff55e8b2b0 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:51.084604 18300 raft_consensus.cc:2272] T bbd0bdc9640c4956a5d60406841ef0f0 P 2513a663afac495eb09126ff55e8b2b0 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:51.087348 18300 tablet_replica.cc:333] stopping tablet replica
I20260709 13:08:51.088153 18300 raft_consensus.cc:2243] T 7b77a53b493f4e979fdf38a0b17176b0 P 2513a663afac495eb09126ff55e8b2b0 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:08:51.089524 18300 raft_consensus.cc:2272] T 7b77a53b493f4e979fdf38a0b17176b0 P 2513a663afac495eb09126ff55e8b2b0 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:51.092826 18300 tablet_replica.cc:333] stopping tablet replica
W20260709 13:08:51.093397 27779 consensus_peers.cc:597] T e9b149d77d9941158ead8e9e592e7b27 P 18435fbb525741328139e84a1e354954 -> Peer 2513a663afac495eb09126ff55e8b2b0 (127.17.223.1:40721): Couldn't send request to peer 2513a663afac495eb09126ff55e8b2b0. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:08:51.093652 27705 consensus_peers.cc:597] T 85cdd21b7a5f4db7af44327c57c16d43 P 665f7e09521a4c3f9284c1d8b0e094ff -> Peer 2513a663afac495eb09126ff55e8b2b0 (127.17.223.1:40721): Couldn't send request to peer 2513a663afac495eb09126ff55e8b2b0. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:08:51.093724 18300 raft_consensus.cc:2243] T 85cdd21b7a5f4db7af44327c57c16d43 P 2513a663afac495eb09126ff55e8b2b0 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:51.094455 18300 raft_consensus.cc:2272] T 85cdd21b7a5f4db7af44327c57c16d43 P 2513a663afac495eb09126ff55e8b2b0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:51.097193 18300 tablet_replica.cc:333] stopping tablet replica
I20260709 13:08:51.097715 18300 raft_consensus.cc:2243] T 93c69c92efc3402e8e9546cb961bbcdc P 2513a663afac495eb09126ff55e8b2b0 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:51.098054 18300 raft_consensus.cc:2272] T 93c69c92efc3402e8e9546cb961bbcdc P 2513a663afac495eb09126ff55e8b2b0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:51.100498 18300 tablet_replica.cc:333] stopping tablet replica
I20260709 13:08:51.100992 18300 raft_consensus.cc:2243] T b6be829f6d3f40c99a3c5be18b0c259c P 2513a663afac495eb09126ff55e8b2b0 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:08:51.101784 18300 raft_consensus.cc:2272] T b6be829f6d3f40c99a3c5be18b0c259c P 2513a663afac495eb09126ff55e8b2b0 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:51.104146 18300 tablet_replica.cc:333] stopping tablet replica
I20260709 13:08:51.104707 18300 raft_consensus.cc:2243] T 765d0bd527c64f74be713c390a018bba P 2513a663afac495eb09126ff55e8b2b0 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:08:51.105481 18300 raft_consensus.cc:2272] T 765d0bd527c64f74be713c390a018bba P 2513a663afac495eb09126ff55e8b2b0 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:51.108192 18300 tablet_replica.cc:333] stopping tablet replica
I20260709 13:08:51.108970 18300 raft_consensus.cc:2243] T 28737c73be174729ad3e9d238af7d975 P 2513a663afac495eb09126ff55e8b2b0 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:51.109525 18300 raft_consensus.cc:2272] T 28737c73be174729ad3e9d238af7d975 P 2513a663afac495eb09126ff55e8b2b0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:51.112219 18300 tablet_replica.cc:333] stopping tablet replica
I20260709 13:08:51.112848 18300 raft_consensus.cc:2243] T 18f991bbbf3a4615aab49899c7ef86dc P 2513a663afac495eb09126ff55e8b2b0 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:51.113337 18300 raft_consensus.cc:2272] T 18f991bbbf3a4615aab49899c7ef86dc P 2513a663afac495eb09126ff55e8b2b0 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:51.115698 18300 tablet_replica.cc:333] stopping tablet replica
I20260709 13:08:51.116461 18300 raft_consensus.cc:2243] T e23b142958324f69aa0bad3a5828fa83 P 2513a663afac495eb09126ff55e8b2b0 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:08:51.117455 18300 raft_consensus.cc:2272] T e23b142958324f69aa0bad3a5828fa83 P 2513a663afac495eb09126ff55e8b2b0 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:51.120839 18300 tablet_replica.cc:333] stopping tablet replica
I20260709 13:08:51.121641 18300 raft_consensus.cc:2243] T a9eac7f072de454a8ff2beb019da45d9 P 2513a663afac495eb09126ff55e8b2b0 [term 3 LEADER]: Raft consensus shutting down.
W20260709 13:08:51.121704 27705 consensus_peers.cc:597] T fb246ce2984c4a6393f12f75083c9fcf P 665f7e09521a4c3f9284c1d8b0e094ff -> Peer 2513a663afac495eb09126ff55e8b2b0 (127.17.223.1:40721): Couldn't send request to peer 2513a663afac495eb09126ff55e8b2b0. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:08:51.122550 18300 raft_consensus.cc:2272] T a9eac7f072de454a8ff2beb019da45d9 P 2513a663afac495eb09126ff55e8b2b0 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:51.125037 18300 tablet_replica.cc:333] stopping tablet replica
I20260709 13:08:51.125602 18300 raft_consensus.cc:2243] T 78e19c035a854ee98657bec3edcb3585 P 2513a663afac495eb09126ff55e8b2b0 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:51.126106 18300 raft_consensus.cc:2272] T 78e19c035a854ee98657bec3edcb3585 P 2513a663afac495eb09126ff55e8b2b0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:51.128980 18300 tablet_replica.cc:333] stopping tablet replica
I20260709 13:08:51.129817 18300 raft_consensus.cc:2243] T d0c8b4ec2d844a89b4bb66c0f1bf2c8f P 2513a663afac495eb09126ff55e8b2b0 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:51.130405 18300 raft_consensus.cc:2272] T d0c8b4ec2d844a89b4bb66c0f1bf2c8f P 2513a663afac495eb09126ff55e8b2b0 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:08:51.131386 27779 consensus_peers.cc:597] T ff09d7e79a3e43918f3c71d10a40d60b P 18435fbb525741328139e84a1e354954 -> Peer 2513a663afac495eb09126ff55e8b2b0 (127.17.223.1:40721): Couldn't send request to peer 2513a663afac495eb09126ff55e8b2b0. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:08:51.137269 27631 consensus_peers.cc:597] T dd959195de1942f7999397a56496f5bc P 41268b218b804905a110c86738e74400 -> Peer 2513a663afac495eb09126ff55e8b2b0 (127.17.223.1:40721): Couldn't send request to peer 2513a663afac495eb09126ff55e8b2b0. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:08:51.139691 18300 tablet_replica.cc:333] stopping tablet replica
I20260709 13:08:51.140791 18300 raft_consensus.cc:2243] T ea92a607c73b4d289d081146089a86f9 P 2513a663afac495eb09126ff55e8b2b0 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:08:51.142006 18300 raft_consensus.cc:2272] T ea92a607c73b4d289d081146089a86f9 P 2513a663afac495eb09126ff55e8b2b0 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:51.145892 18300 tablet_replica.cc:333] stopping tablet replica
W20260709 13:08:51.146174 27705 consensus_peers.cc:597] T 18f991bbbf3a4615aab49899c7ef86dc P 665f7e09521a4c3f9284c1d8b0e094ff -> Peer 2513a663afac495eb09126ff55e8b2b0 (127.17.223.1:40721): Couldn't send request to peer 2513a663afac495eb09126ff55e8b2b0. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:08:51.146924 18300 raft_consensus.cc:2243] T 1a26f012cd6e4c4c8bf86b5fda903800 P 2513a663afac495eb09126ff55e8b2b0 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:51.147692 18300 raft_consensus.cc:2272] T 1a26f012cd6e4c4c8bf86b5fda903800 P 2513a663afac495eb09126ff55e8b2b0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:51.151387 18300 tablet_replica.cc:333] stopping tablet replica
I20260709 13:08:51.152374 18300 raft_consensus.cc:2243] T de531c50b1524ec788b27bc4b883689a P 2513a663afac495eb09126ff55e8b2b0 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:08:51.153690 18300 raft_consensus.cc:2272] T de531c50b1524ec788b27bc4b883689a P 2513a663afac495eb09126ff55e8b2b0 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:51.157079 18300 tablet_replica.cc:333] stopping tablet replica
I20260709 13:08:51.157744 18300 raft_consensus.cc:2243] T 3a7da70e9f0f49a9bf60184a8f0b5339 P 2513a663afac495eb09126ff55e8b2b0 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:51.158265 18300 raft_consensus.cc:2272] T 3a7da70e9f0f49a9bf60184a8f0b5339 P 2513a663afac495eb09126ff55e8b2b0 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:51.161777 18300 tablet_replica.cc:333] stopping tablet replica
I20260709 13:08:51.162691 18300 raft_consensus.cc:2243] T 456941807b254f5fb32dca4f84bd16ea P 2513a663afac495eb09126ff55e8b2b0 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:51.163439 18300 raft_consensus.cc:2272] T 456941807b254f5fb32dca4f84bd16ea P 2513a663afac495eb09126ff55e8b2b0 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:51.167097 18300 tablet_replica.cc:333] stopping tablet replica
I20260709 13:08:51.168061 18300 raft_consensus.cc:2243] T 11224ef6c00a40cdba4311ceb63bddb9 P 2513a663afac495eb09126ff55e8b2b0 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:51.168718 18300 raft_consensus.cc:2272] T 11224ef6c00a40cdba4311ceb63bddb9 P 2513a663afac495eb09126ff55e8b2b0 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:51.172451 18300 tablet_replica.cc:333] stopping tablet replica
I20260709 13:08:51.173388 18300 raft_consensus.cc:2243] T 866a01285ca8436385f8d16dcfb0d4e3 P 2513a663afac495eb09126ff55e8b2b0 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:51.174019 18300 raft_consensus.cc:2272] T 866a01285ca8436385f8d16dcfb0d4e3 P 2513a663afac495eb09126ff55e8b2b0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:51.179127 18300 tablet_replica.cc:333] stopping tablet replica
I20260709 13:08:51.180033 18300 raft_consensus.cc:2243] T bc77856749a0473a8b3124ce8c523815 P 2513a663afac495eb09126ff55e8b2b0 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:08:51.181304 18300 raft_consensus.cc:2272] T bc77856749a0473a8b3124ce8c523815 P 2513a663afac495eb09126ff55e8b2b0 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:51.185020 18300 tablet_replica.cc:333] stopping tablet replica
I20260709 13:08:51.185844 18300 raft_consensus.cc:2243] T 9db60240699a4db2ba5faa2c50a742da P 2513a663afac495eb09126ff55e8b2b0 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:08:51.187160 18300 raft_consensus.cc:2272] T 9db60240699a4db2ba5faa2c50a742da P 2513a663afac495eb09126ff55e8b2b0 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:08:51.190063 27631 consensus_peers.cc:597] T bbd0bdc9640c4956a5d60406841ef0f0 P 41268b218b804905a110c86738e74400 -> Peer 2513a663afac495eb09126ff55e8b2b0 (127.17.223.1:40721): Couldn't send request to peer 2513a663afac495eb09126ff55e8b2b0. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:08:51.191177 18300 tablet_replica.cc:333] stopping tablet replica
I20260709 13:08:51.192189 18300 raft_consensus.cc:2243] T 86af954f570648969cbc47c03d15c447 P 2513a663afac495eb09126ff55e8b2b0 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:08:51.193534 18300 raft_consensus.cc:2272] T 86af954f570648969cbc47c03d15c447 P 2513a663afac495eb09126ff55e8b2b0 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:51.197211 18300 tablet_replica.cc:333] stopping tablet replica
I20260709 13:08:51.198086 18300 raft_consensus.cc:2243] T ff09d7e79a3e43918f3c71d10a40d60b P 2513a663afac495eb09126ff55e8b2b0 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:51.198661 18300 raft_consensus.cc:2272] T ff09d7e79a3e43918f3c71d10a40d60b P 2513a663afac495eb09126ff55e8b2b0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:51.202160 18300 tablet_replica.cc:333] stopping tablet replica
I20260709 13:08:51.203073 18300 raft_consensus.cc:2243] T 2d68b1be563949efbcb4bbe71eddd0d8 P 2513a663afac495eb09126ff55e8b2b0 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:51.203703 18300 raft_consensus.cc:2272] T 2d68b1be563949efbcb4bbe71eddd0d8 P 2513a663afac495eb09126ff55e8b2b0 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:51.207449 18300 tablet_replica.cc:333] stopping tablet replica
I20260709 13:08:51.208364 18300 raft_consensus.cc:2243] T dd959195de1942f7999397a56496f5bc P 2513a663afac495eb09126ff55e8b2b0 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:51.209059 18300 raft_consensus.cc:2272] T dd959195de1942f7999397a56496f5bc P 2513a663afac495eb09126ff55e8b2b0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:51.212836 18300 tablet_replica.cc:333] stopping tablet replica
I20260709 13:08:51.213714 18300 raft_consensus.cc:2243] T e5847d81a5284a44a6b2b21cf6f4351c P 2513a663afac495eb09126ff55e8b2b0 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:51.214330 18300 raft_consensus.cc:2272] T e5847d81a5284a44a6b2b21cf6f4351c P 2513a663afac495eb09126ff55e8b2b0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:51.218206 18300 tablet_replica.cc:333] stopping tablet replica
I20260709 13:08:51.219089 18300 raft_consensus.cc:2243] T 2d994cb13f8f453284bcb1f8b85824a2 P 2513a663afac495eb09126ff55e8b2b0 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:51.219744 18300 raft_consensus.cc:2272] T 2d994cb13f8f453284bcb1f8b85824a2 P 2513a663afac495eb09126ff55e8b2b0 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:51.223260 18300 tablet_replica.cc:333] stopping tablet replica
I20260709 13:08:51.224144 18300 raft_consensus.cc:2243] T c9ea919812394c7aba307c2ff5b81f51 P 2513a663afac495eb09126ff55e8b2b0 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:08:51.225302 18300 raft_consensus.cc:2272] T c9ea919812394c7aba307c2ff5b81f51 P 2513a663afac495eb09126ff55e8b2b0 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:08:51.228029 27779 consensus_peers.cc:597] T 64490a86db8c4f5ca54f4f8085f41319 P 18435fbb525741328139e84a1e354954 -> Peer 2513a663afac495eb09126ff55e8b2b0 (127.17.223.1:40721): Couldn't send request to peer 2513a663afac495eb09126ff55e8b2b0. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:08:51.228945 18300 tablet_replica.cc:333] stopping tablet replica
I20260709 13:08:51.229933 18300 raft_consensus.cc:2243] T fb246ce2984c4a6393f12f75083c9fcf P 2513a663afac495eb09126ff55e8b2b0 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:51.230554 18300 raft_consensus.cc:2272] T fb246ce2984c4a6393f12f75083c9fcf P 2513a663afac495eb09126ff55e8b2b0 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:08:51.233716 27631 consensus_peers.cc:597] T 2d994cb13f8f453284bcb1f8b85824a2 P 41268b218b804905a110c86738e74400 -> Peer 2513a663afac495eb09126ff55e8b2b0 (127.17.223.1:40721): Couldn't send request to peer 2513a663afac495eb09126ff55e8b2b0. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:08:51.234202 18300 tablet_replica.cc:333] stopping tablet replica
I20260709 13:08:51.235227 18300 raft_consensus.cc:2243] T 8d1aa996b2034de7b2d77545de68e73c P 2513a663afac495eb09126ff55e8b2b0 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:51.235903 18300 raft_consensus.cc:2272] T 8d1aa996b2034de7b2d77545de68e73c P 2513a663afac495eb09126ff55e8b2b0 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:08:51.238298 27705 consensus_peers.cc:597] T 456941807b254f5fb32dca4f84bd16ea P 665f7e09521a4c3f9284c1d8b0e094ff -> Peer 2513a663afac495eb09126ff55e8b2b0 (127.17.223.1:40721): Couldn't send request to peer 2513a663afac495eb09126ff55e8b2b0. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:08:51.239475 18300 tablet_replica.cc:333] stopping tablet replica
I20260709 13:08:51.240442 18300 raft_consensus.cc:2243] T 5a55d1bac7374ff6b83cc7bae2d3b1f3 P 2513a663afac495eb09126ff55e8b2b0 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:51.241012 18300 raft_consensus.cc:2272] T 5a55d1bac7374ff6b83cc7bae2d3b1f3 P 2513a663afac495eb09126ff55e8b2b0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:51.244769 18300 tablet_replica.cc:333] stopping tablet replica
I20260709 13:08:51.245640 18300 raft_consensus.cc:2243] T 80e2477670ec4db18ad338931d714544 P 2513a663afac495eb09126ff55e8b2b0 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:51.246308 18300 raft_consensus.cc:2272] T 80e2477670ec4db18ad338931d714544 P 2513a663afac495eb09126ff55e8b2b0 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:51.249853 18300 tablet_replica.cc:333] stopping tablet replica
W20260709 13:08:51.249946 27705 consensus_peers.cc:597] T 1a26f012cd6e4c4c8bf86b5fda903800 P 665f7e09521a4c3f9284c1d8b0e094ff -> Peer 2513a663afac495eb09126ff55e8b2b0 (127.17.223.1:40721): Couldn't send request to peer 2513a663afac495eb09126ff55e8b2b0. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:08:51.250787 18300 raft_consensus.cc:2243] T 15a4c537259e4b2882a5cc8e723b260a P 2513a663afac495eb09126ff55e8b2b0 [term 2 LEADER]: Raft consensus shutting down.
W20260709 13:08:51.251963 27631 consensus_peers.cc:597] T 93c69c92efc3402e8e9546cb961bbcdc P 41268b218b804905a110c86738e74400 -> Peer 2513a663afac495eb09126ff55e8b2b0 (127.17.223.1:40721): Couldn't send request to peer 2513a663afac495eb09126ff55e8b2b0. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:08:51.252012 18300 raft_consensus.cc:2272] T 15a4c537259e4b2882a5cc8e723b260a P 2513a663afac495eb09126ff55e8b2b0 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:51.256386 18300 tablet_replica.cc:333] stopping tablet replica
W20260709 13:08:51.256667 27705 consensus_peers.cc:597] T 9c0f604d66664505aa9469fb058601b6 P 665f7e09521a4c3f9284c1d8b0e094ff -> Peer 2513a663afac495eb09126ff55e8b2b0 (127.17.223.1:40721): Couldn't send request to peer 2513a663afac495eb09126ff55e8b2b0. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:08:51.257133 18300 raft_consensus.cc:2243] T ae05961ab7a94458b1ad2cde9785c63b P 2513a663afac495eb09126ff55e8b2b0 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:51.257730 18300 raft_consensus.cc:2272] T ae05961ab7a94458b1ad2cde9785c63b P 2513a663afac495eb09126ff55e8b2b0 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:51.260936 18300 tablet_replica.cc:333] stopping tablet replica
I20260709 13:08:51.261813 18300 raft_consensus.cc:2243] T e9b149d77d9941158ead8e9e592e7b27 P 2513a663afac495eb09126ff55e8b2b0 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:51.262250 18300 raft_consensus.cc:2272] T e9b149d77d9941158ead8e9e592e7b27 P 2513a663afac495eb09126ff55e8b2b0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:51.264708 18300 tablet_replica.cc:333] stopping tablet replica
I20260709 13:08:51.265280 18300 raft_consensus.cc:2243] T bc0b10615ecb4485a9a9de298938697d P 2513a663afac495eb09126ff55e8b2b0 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:51.265761 18300 raft_consensus.cc:2272] T bc0b10615ecb4485a9a9de298938697d P 2513a663afac495eb09126ff55e8b2b0 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:51.268949 18300 tablet_replica.cc:333] stopping tablet replica
I20260709 13:08:51.270004 18300 raft_consensus.cc:2243] T 55a3afc21cea43ea85f4a2155552422d P 2513a663afac495eb09126ff55e8b2b0 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:51.270650 18300 raft_consensus.cc:2272] T 55a3afc21cea43ea85f4a2155552422d P 2513a663afac495eb09126ff55e8b2b0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:51.274221 18300 tablet_replica.cc:333] stopping tablet replica
I20260709 13:08:51.274936 18300 raft_consensus.cc:2243] T 585e960f8d0f42268f2fe98e1e7b83f0 P 2513a663afac495eb09126ff55e8b2b0 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:08:51.275895 18300 raft_consensus.cc:2272] T 585e960f8d0f42268f2fe98e1e7b83f0 P 2513a663afac495eb09126ff55e8b2b0 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:51.278497 18300 tablet_replica.cc:333] stopping tablet replica
I20260709 13:08:51.279066 18300 raft_consensus.cc:2243] T 1cd5e6e9b36d4591961cb379d7065be9 P 2513a663afac495eb09126ff55e8b2b0 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:08:51.279994 18300 raft_consensus.cc:2272] T 1cd5e6e9b36d4591961cb379d7065be9 P 2513a663afac495eb09126ff55e8b2b0 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:08:51.284765 27705 consensus_peers.cc:597] T 5e6f8bdfe11b4af4aa27a711db7cbe7a P 665f7e09521a4c3f9284c1d8b0e094ff -> Peer 2513a663afac495eb09126ff55e8b2b0 (127.17.223.1:40721): Couldn't send request to peer 2513a663afac495eb09126ff55e8b2b0. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:08:51.288030 27705 consensus_peers.cc:597] T 78e19c035a854ee98657bec3edcb3585 P 665f7e09521a4c3f9284c1d8b0e094ff -> Peer 2513a663afac495eb09126ff55e8b2b0 (127.17.223.1:40721): Couldn't send request to peer 2513a663afac495eb09126ff55e8b2b0. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:08:51.291487 27631 consensus_peers.cc:597] T 4cd7359accee42808761c37543247321 P 41268b218b804905a110c86738e74400 -> Peer 2513a663afac495eb09126ff55e8b2b0 (127.17.223.1:40721): Couldn't send request to peer 2513a663afac495eb09126ff55e8b2b0. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:08:51.305606 27631 consensus_peers.cc:597] T 866a01285ca8436385f8d16dcfb0d4e3 P 41268b218b804905a110c86738e74400 -> Peer 2513a663afac495eb09126ff55e8b2b0 (127.17.223.1:40721): Couldn't send request to peer 2513a663afac495eb09126ff55e8b2b0. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:08:51.309851 27631 consensus_peers.cc:597] T 47b65672307641ae81d5f94c639b1a10 P 41268b218b804905a110c86738e74400 -> Peer 2513a663afac495eb09126ff55e8b2b0 (127.17.223.1:40721): Couldn't send request to peer 2513a663afac495eb09126ff55e8b2b0. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:08:51.338426 27779 consensus_peers.cc:597] T 80e2477670ec4db18ad338931d714544 P 18435fbb525741328139e84a1e354954 -> Peer 2513a663afac495eb09126ff55e8b2b0 (127.17.223.1:40721): Couldn't send request to peer 2513a663afac495eb09126ff55e8b2b0. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:08:51.346280 27631 connection.cc:573] client connection to 127.17.223.1:40721 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260709 13:08:51.346963 27631 consensus_peers.cc:597] T 28737c73be174729ad3e9d238af7d975 P 41268b218b804905a110c86738e74400 -> Peer 2513a663afac495eb09126ff55e8b2b0 (127.17.223.1:40721): Couldn't send request to peer 2513a663afac495eb09126ff55e8b2b0. Status: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:08:51.363761 18300 tablet_server.cc:196] TabletServer@127.17.223.1:40721 shutdown complete.
W20260709 13:08:51.368798 27779 consensus_peers.cc:597] T 5a55d1bac7374ff6b83cc7bae2d3b1f3 P 18435fbb525741328139e84a1e354954 -> Peer 2513a663afac495eb09126ff55e8b2b0 (127.17.223.1:40721): Couldn't send request to peer 2513a663afac495eb09126ff55e8b2b0. Status: Network error: Client connection negotiation failed: client connection to 127.17.223.1:40721: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:08:51.380932 27779 consensus_peers.cc:597] T e5847d81a5284a44a6b2b21cf6f4351c P 18435fbb525741328139e84a1e354954 -> Peer 2513a663afac495eb09126ff55e8b2b0 (127.17.223.1:40721): Couldn't send request to peer 2513a663afac495eb09126ff55e8b2b0. Status: Network error: Client connection negotiation failed: client connection to 127.17.223.1:40721: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:08:51.384130 27779 consensus_peers.cc:597] T bc0b10615ecb4485a9a9de298938697d P 18435fbb525741328139e84a1e354954 -> Peer 2513a663afac495eb09126ff55e8b2b0 (127.17.223.1:40721): Couldn't send request to peer 2513a663afac495eb09126ff55e8b2b0. Status: Network error: Client connection negotiation failed: client connection to 127.17.223.1:40721: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:08:51.414161 27705 consensus_peers.cc:597] T 8d1aa996b2034de7b2d77545de68e73c P 665f7e09521a4c3f9284c1d8b0e094ff -> Peer 2513a663afac495eb09126ff55e8b2b0 (127.17.223.1:40721): Couldn't send request to peer 2513a663afac495eb09126ff55e8b2b0. Status: Network error: Client connection negotiation failed: client connection to 127.17.223.1:40721: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:08:51.454900 18300 tablet_server.cc:179] TabletServer@127.17.223.2:0 shutting down...
W20260709 13:08:51.459475 27779 consensus_peers.cc:597] T 3a7da70e9f0f49a9bf60184a8f0b5339 P 18435fbb525741328139e84a1e354954 -> Peer 2513a663afac495eb09126ff55e8b2b0 (127.17.223.1:40721): Couldn't send request to peer 2513a663afac495eb09126ff55e8b2b0. Status: Network error: Client connection negotiation failed: client connection to 127.17.223.1:40721: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:08:51.481389 27782 consensus_peers.cc:597] T 3a7da70e9f0f49a9bf60184a8f0b5339 P 18435fbb525741328139e84a1e354954 -> Peer 41268b218b804905a110c86738e74400 (127.17.223.2:44403): Couldn't send request to peer 41268b218b804905a110c86738e74400. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:08:51.485714 27779 consensus_peers.cc:597] T ae05961ab7a94458b1ad2cde9785c63b P 18435fbb525741328139e84a1e354954 -> Peer 2513a663afac495eb09126ff55e8b2b0 (127.17.223.1:40721): Couldn't send request to peer 2513a663afac495eb09126ff55e8b2b0. Status: Network error: Client connection negotiation failed: client connection to 127.17.223.1:40721: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:08:51.494814 18300 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:08:51.495882 18300 tablet_replica.cc:333] T b6be829f6d3f40c99a3c5be18b0c259c P 41268b218b804905a110c86738e74400: stopping tablet replica
I20260709 13:08:51.496938 18300 raft_consensus.cc:2243] T b6be829f6d3f40c99a3c5be18b0c259c P 41268b218b804905a110c86738e74400 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:51.497661 18300 raft_consensus.cc:2272] T b6be829f6d3f40c99a3c5be18b0c259c P 41268b218b804905a110c86738e74400 [term 3 FOLLOWER]: Raft consensus is shut down!
W20260709 13:08:51.500248 27779 consensus_peers.cc:597] T 11224ef6c00a40cdba4311ceb63bddb9 P 18435fbb525741328139e84a1e354954 -> Peer 2513a663afac495eb09126ff55e8b2b0 (127.17.223.1:40721): Couldn't send request to peer 2513a663afac495eb09126ff55e8b2b0. Status: Network error: Client connection negotiation failed: client connection to 127.17.223.1:40721: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:08:51.500734 18300 tablet_replica.cc:333] T 539b1d2240654c74bd9054a06a8eaac6 P 41268b218b804905a110c86738e74400: stopping tablet replica
I20260709 13:08:51.501531 18300 raft_consensus.cc:2243] T 539b1d2240654c74bd9054a06a8eaac6 P 41268b218b804905a110c86738e74400 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:08:51.502383 18300 raft_consensus.cc:2272] T 539b1d2240654c74bd9054a06a8eaac6 P 41268b218b804905a110c86738e74400 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:51.504366 18300 tablet_replica.cc:333] T e23b142958324f69aa0bad3a5828fa83 P 41268b218b804905a110c86738e74400: stopping tablet replica
I20260709 13:08:51.504971 18300 raft_consensus.cc:2243] T e23b142958324f69aa0bad3a5828fa83 P 41268b218b804905a110c86738e74400 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:51.505435 18300 raft_consensus.cc:2272] T e23b142958324f69aa0bad3a5828fa83 P 41268b218b804905a110c86738e74400 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:51.507457 18300 tablet_replica.cc:333] T 585e960f8d0f42268f2fe98e1e7b83f0 P 41268b218b804905a110c86738e74400: stopping tablet replica
I20260709 13:08:51.508118 18300 raft_consensus.cc:2243] T 585e960f8d0f42268f2fe98e1e7b83f0 P 41268b218b804905a110c86738e74400 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:51.508545 18300 raft_consensus.cc:2272] T 585e960f8d0f42268f2fe98e1e7b83f0 P 41268b218b804905a110c86738e74400 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:51.510744 18300 tablet_replica.cc:333] T 5a55d1bac7374ff6b83cc7bae2d3b1f3 P 41268b218b804905a110c86738e74400: stopping tablet replica
I20260709 13:08:51.511287 18300 raft_consensus.cc:2243] T 5a55d1bac7374ff6b83cc7bae2d3b1f3 P 41268b218b804905a110c86738e74400 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:51.511771 18300 raft_consensus.cc:2272] T 5a55d1bac7374ff6b83cc7bae2d3b1f3 P 41268b218b804905a110c86738e74400 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:51.513861 18300 tablet_replica.cc:333] T 9e94954fc474414ba7563be776d6c80a P 41268b218b804905a110c86738e74400: stopping tablet replica
I20260709 13:08:51.514488 18300 raft_consensus.cc:2243] T 9e94954fc474414ba7563be776d6c80a P 41268b218b804905a110c86738e74400 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:51.515079 18300 raft_consensus.cc:2272] T 9e94954fc474414ba7563be776d6c80a P 41268b218b804905a110c86738e74400 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:51.517171 18300 tablet_replica.cc:333] T 1c5e794c2a0a45fa99bcfde6aeb45d2e P 41268b218b804905a110c86738e74400: stopping tablet replica
I20260709 13:08:51.517705 18300 raft_consensus.cc:2243] T 1c5e794c2a0a45fa99bcfde6aeb45d2e P 41268b218b804905a110c86738e74400 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:08:51.518532 18300 raft_consensus.cc:2272] T 1c5e794c2a0a45fa99bcfde6aeb45d2e P 41268b218b804905a110c86738e74400 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:51.520521 18300 tablet_replica.cc:333] T ea92a607c73b4d289d081146089a86f9 P 41268b218b804905a110c86738e74400: stopping tablet replica
I20260709 13:08:51.521070 18300 raft_consensus.cc:2243] T ea92a607c73b4d289d081146089a86f9 P 41268b218b804905a110c86738e74400 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:51.521450 18300 raft_consensus.cc:2272] T ea92a607c73b4d289d081146089a86f9 P 41268b218b804905a110c86738e74400 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:51.523805 18300 tablet_replica.cc:333] T 8e758d59bd4a4eae9f67662e165013f9 P 41268b218b804905a110c86738e74400: stopping tablet replica
I20260709 13:08:51.524369 18300 raft_consensus.cc:2243] T 8e758d59bd4a4eae9f67662e165013f9 P 41268b218b804905a110c86738e74400 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:51.524829 18300 raft_consensus.cc:2272] T 8e758d59bd4a4eae9f67662e165013f9 P 41268b218b804905a110c86738e74400 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:51.526875 18300 tablet_replica.cc:333] T 2d994cb13f8f453284bcb1f8b85824a2 P 41268b218b804905a110c86738e74400: stopping tablet replica
I20260709 13:08:51.527555 18300 raft_consensus.cc:2243] T 2d994cb13f8f453284bcb1f8b85824a2 P 41268b218b804905a110c86738e74400 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:08:51.528573 18300 raft_consensus.cc:2272] T 2d994cb13f8f453284bcb1f8b85824a2 P 41268b218b804905a110c86738e74400 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:51.531664 18300 tablet_replica.cc:333] T 86af954f570648969cbc47c03d15c447 P 41268b218b804905a110c86738e74400: stopping tablet replica
I20260709 13:08:51.533077 18300 raft_consensus.cc:2243] T 86af954f570648969cbc47c03d15c447 P 41268b218b804905a110c86738e74400 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:51.533692 18300 raft_consensus.cc:2272] T 86af954f570648969cbc47c03d15c447 P 41268b218b804905a110c86738e74400 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:51.536800 18300 tablet_replica.cc:333] T 8ee97a8570ae4cb49195d1b977d1cdf4 P 41268b218b804905a110c86738e74400: stopping tablet replica
I20260709 13:08:51.537655 18300 raft_consensus.cc:2243] T 8ee97a8570ae4cb49195d1b977d1cdf4 P 41268b218b804905a110c86738e74400 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:08:51.538993 18300 raft_consensus.cc:2272] T 8ee97a8570ae4cb49195d1b977d1cdf4 P 41268b218b804905a110c86738e74400 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:51.542177 18300 tablet_replica.cc:333] T 85cdd21b7a5f4db7af44327c57c16d43 P 41268b218b804905a110c86738e74400: stopping tablet replica
I20260709 13:08:51.542862 18300 raft_consensus.cc:2243] T 85cdd21b7a5f4db7af44327c57c16d43 P 41268b218b804905a110c86738e74400 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:51.543308 18300 raft_consensus.cc:2272] T 85cdd21b7a5f4db7af44327c57c16d43 P 41268b218b804905a110c86738e74400 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:51.545126 18300 tablet_replica.cc:333] T 4cd7359accee42808761c37543247321 P 41268b218b804905a110c86738e74400: stopping tablet replica
I20260709 13:08:51.545817 18300 raft_consensus.cc:2243] T 4cd7359accee42808761c37543247321 P 41268b218b804905a110c86738e74400 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:08:51.546761 18300 raft_consensus.cc:2272] T 4cd7359accee42808761c37543247321 P 41268b218b804905a110c86738e74400 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:51.548624 18300 tablet_replica.cc:333] T 93c69c92efc3402e8e9546cb961bbcdc P 41268b218b804905a110c86738e74400: stopping tablet replica
I20260709 13:08:51.549202 18300 raft_consensus.cc:2243] T 93c69c92efc3402e8e9546cb961bbcdc P 41268b218b804905a110c86738e74400 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:08:51.549968 18300 raft_consensus.cc:2272] T 93c69c92efc3402e8e9546cb961bbcdc P 41268b218b804905a110c86738e74400 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:51.551949 18300 tablet_replica.cc:333] T 5f4a8242380b4863bf5ad2c055229bb7 P 41268b218b804905a110c86738e74400: stopping tablet replica
I20260709 13:08:51.552525 18300 raft_consensus.cc:2243] T 5f4a8242380b4863bf5ad2c055229bb7 P 41268b218b804905a110c86738e74400 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:51.552994 18300 raft_consensus.cc:2272] T 5f4a8242380b4863bf5ad2c055229bb7 P 41268b218b804905a110c86738e74400 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:51.555894 18300 tablet_replica.cc:333] T e9b149d77d9941158ead8e9e592e7b27 P 41268b218b804905a110c86738e74400: stopping tablet replica
I20260709 13:08:51.556692 18300 raft_consensus.cc:2243] T e9b149d77d9941158ead8e9e592e7b27 P 41268b218b804905a110c86738e74400 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:51.557258 18300 raft_consensus.cc:2272] T e9b149d77d9941158ead8e9e592e7b27 P 41268b218b804905a110c86738e74400 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:08:51.558300 27705 consensus_peers.cc:597] T 8e758d59bd4a4eae9f67662e165013f9 P 665f7e09521a4c3f9284c1d8b0e094ff -> Peer 2513a663afac495eb09126ff55e8b2b0 (127.17.223.1:40721): Couldn't send request to peer 2513a663afac495eb09126ff55e8b2b0. Status: Network error: Client connection negotiation failed: client connection to 127.17.223.1:40721: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:08:51.559775 18300 tablet_replica.cc:333] T bbd0bdc9640c4956a5d60406841ef0f0 P 41268b218b804905a110c86738e74400: stopping tablet replica
I20260709 13:08:51.560660 18300 raft_consensus.cc:2243] T bbd0bdc9640c4956a5d60406841ef0f0 P 41268b218b804905a110c86738e74400 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:08:51.561640 18300 raft_consensus.cc:2272] T bbd0bdc9640c4956a5d60406841ef0f0 P 41268b218b804905a110c86738e74400 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:51.563916 18300 tablet_replica.cc:333] T 1d9bdb76a5094186b5ac6c8f8e1c9840 P 41268b218b804905a110c86738e74400: stopping tablet replica
I20260709 13:08:51.564478 18300 raft_consensus.cc:2243] T 1d9bdb76a5094186b5ac6c8f8e1c9840 P 41268b218b804905a110c86738e74400 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:51.564909 18300 raft_consensus.cc:2272] T 1d9bdb76a5094186b5ac6c8f8e1c9840 P 41268b218b804905a110c86738e74400 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:51.566871 18300 tablet_replica.cc:333] T 28737c73be174729ad3e9d238af7d975 P 41268b218b804905a110c86738e74400: stopping tablet replica
I20260709 13:08:51.567415 18300 raft_consensus.cc:2243] T 28737c73be174729ad3e9d238af7d975 P 41268b218b804905a110c86738e74400 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:08:51.568190 18300 raft_consensus.cc:2272] T 28737c73be174729ad3e9d238af7d975 P 41268b218b804905a110c86738e74400 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:51.569995 18300 tablet_replica.cc:333] T 765d0bd527c64f74be713c390a018bba P 41268b218b804905a110c86738e74400: stopping tablet replica
I20260709 13:08:51.570779 18300 raft_consensus.cc:2243] T 765d0bd527c64f74be713c390a018bba P 41268b218b804905a110c86738e74400 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:51.571377 18300 raft_consensus.cc:2272] T 765d0bd527c64f74be713c390a018bba P 41268b218b804905a110c86738e74400 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:51.574028 18300 tablet_replica.cc:333] T 15a4c537259e4b2882a5cc8e723b260a P 41268b218b804905a110c86738e74400: stopping tablet replica
I20260709 13:08:51.574756 18300 raft_consensus.cc:2243] T 15a4c537259e4b2882a5cc8e723b260a P 41268b218b804905a110c86738e74400 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:51.575269 18300 raft_consensus.cc:2272] T 15a4c537259e4b2882a5cc8e723b260a P 41268b218b804905a110c86738e74400 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:51.578953 18300 tablet_replica.cc:333] T 47b65672307641ae81d5f94c639b1a10 P 41268b218b804905a110c86738e74400: stopping tablet replica
I20260709 13:08:51.580132 18300 raft_consensus.cc:2243] T 47b65672307641ae81d5f94c639b1a10 P 41268b218b804905a110c86738e74400 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:08:51.581983 18300 raft_consensus.cc:2272] T 47b65672307641ae81d5f94c639b1a10 P 41268b218b804905a110c86738e74400 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:51.585076 18300 tablet_replica.cc:333] T 68cc2880cf79462c99d9009957eb5fd2 P 41268b218b804905a110c86738e74400: stopping tablet replica
I20260709 13:08:51.585850 18300 raft_consensus.cc:2243] T 68cc2880cf79462c99d9009957eb5fd2 P 41268b218b804905a110c86738e74400 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:08:51.586930 18300 raft_consensus.cc:2272] T 68cc2880cf79462c99d9009957eb5fd2 P 41268b218b804905a110c86738e74400 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:51.589915 18300 tablet_replica.cc:333] T bc77856749a0473a8b3124ce8c523815 P 41268b218b804905a110c86738e74400: stopping tablet replica
I20260709 13:08:51.590575 18300 raft_consensus.cc:2243] T bc77856749a0473a8b3124ce8c523815 P 41268b218b804905a110c86738e74400 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:51.591150 18300 raft_consensus.cc:2272] T bc77856749a0473a8b3124ce8c523815 P 41268b218b804905a110c86738e74400 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:51.593833 18300 tablet_replica.cc:333] T 5e6f8bdfe11b4af4aa27a711db7cbe7a P 41268b218b804905a110c86738e74400: stopping tablet replica
I20260709 13:08:51.594444 18300 raft_consensus.cc:2243] T 5e6f8bdfe11b4af4aa27a711db7cbe7a P 41268b218b804905a110c86738e74400 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:51.594974 18300 raft_consensus.cc:2272] T 5e6f8bdfe11b4af4aa27a711db7cbe7a P 41268b218b804905a110c86738e74400 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:08:51.596143 27708 consensus_peers.cc:597] T 85cdd21b7a5f4db7af44327c57c16d43 P 665f7e09521a4c3f9284c1d8b0e094ff -> Peer 41268b218b804905a110c86738e74400 (127.17.223.2:44403): Couldn't send request to peer 41268b218b804905a110c86738e74400. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:08:51.597759 18300 tablet_replica.cc:333] T 866a01285ca8436385f8d16dcfb0d4e3 P 41268b218b804905a110c86738e74400: stopping tablet replica
I20260709 13:08:51.599512 18300 raft_consensus.cc:2243] T 866a01285ca8436385f8d16dcfb0d4e3 P 41268b218b804905a110c86738e74400 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:08:51.600543 18300 raft_consensus.cc:2272] T 866a01285ca8436385f8d16dcfb0d4e3 P 41268b218b804905a110c86738e74400 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:51.602931 18300 tablet_replica.cc:333] T df06af11cae7484d969017fcb5b7e753 P 41268b218b804905a110c86738e74400: stopping tablet replica
I20260709 13:08:51.603418 18300 raft_consensus.cc:2243] T df06af11cae7484d969017fcb5b7e753 P 41268b218b804905a110c86738e74400 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:51.603842 18300 raft_consensus.cc:2272] T df06af11cae7484d969017fcb5b7e753 P 41268b218b804905a110c86738e74400 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:51.605901 18300 tablet_replica.cc:333] T 8e0d496efc3f41f3be82a538ef3cfdac P 41268b218b804905a110c86738e74400: stopping tablet replica
I20260709 13:08:51.606395 18300 raft_consensus.cc:2243] T 8e0d496efc3f41f3be82a538ef3cfdac P 41268b218b804905a110c86738e74400 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:08:51.607390 18300 raft_consensus.cc:2272] T 8e0d496efc3f41f3be82a538ef3cfdac P 41268b218b804905a110c86738e74400 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:51.609298 18300 tablet_replica.cc:333] T 3a7da70e9f0f49a9bf60184a8f0b5339 P 41268b218b804905a110c86738e74400: stopping tablet replica
I20260709 13:08:51.609793 18300 raft_consensus.cc:2243] T 3a7da70e9f0f49a9bf60184a8f0b5339 P 41268b218b804905a110c86738e74400 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:51.610232 18300 raft_consensus.cc:2272] T 3a7da70e9f0f49a9bf60184a8f0b5339 P 41268b218b804905a110c86738e74400 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:51.612181 18300 tablet_replica.cc:333] T 456941807b254f5fb32dca4f84bd16ea P 41268b218b804905a110c86738e74400: stopping tablet replica
I20260709 13:08:51.612690 18300 raft_consensus.cc:2243] T 456941807b254f5fb32dca4f84bd16ea P 41268b218b804905a110c86738e74400 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:51.613081 18300 raft_consensus.cc:2272] T 456941807b254f5fb32dca4f84bd16ea P 41268b218b804905a110c86738e74400 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:51.614995 18300 tablet_replica.cc:333] T 56803a5c0dea4efeabafb6829d9215cd P 41268b218b804905a110c86738e74400: stopping tablet replica
I20260709 13:08:51.615475 18300 raft_consensus.cc:2243] T 56803a5c0dea4efeabafb6829d9215cd P 41268b218b804905a110c86738e74400 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:51.615866 18300 raft_consensus.cc:2272] T 56803a5c0dea4efeabafb6829d9215cd P 41268b218b804905a110c86738e74400 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:51.617856 18300 tablet_replica.cc:333] T de531c50b1524ec788b27bc4b883689a P 41268b218b804905a110c86738e74400: stopping tablet replica
I20260709 13:08:51.618371 18300 raft_consensus.cc:2243] T de531c50b1524ec788b27bc4b883689a P 41268b218b804905a110c86738e74400 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:51.618819 18300 raft_consensus.cc:2272] T de531c50b1524ec788b27bc4b883689a P 41268b218b804905a110c86738e74400 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:51.620800 18300 tablet_replica.cc:333] T 106e04f510c741439b91c39d5fac5a23 P 41268b218b804905a110c86738e74400: stopping tablet replica
I20260709 13:08:51.621322 18300 raft_consensus.cc:2243] T 106e04f510c741439b91c39d5fac5a23 P 41268b218b804905a110c86738e74400 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:51.621718 18300 raft_consensus.cc:2272] T 106e04f510c741439b91c39d5fac5a23 P 41268b218b804905a110c86738e74400 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:51.623844 18300 tablet_replica.cc:333] T 1a26f012cd6e4c4c8bf86b5fda903800 P 41268b218b804905a110c86738e74400: stopping tablet replica
I20260709 13:08:51.624368 18300 raft_consensus.cc:2243] T 1a26f012cd6e4c4c8bf86b5fda903800 P 41268b218b804905a110c86738e74400 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:51.624836 18300 raft_consensus.cc:2272] T 1a26f012cd6e4c4c8bf86b5fda903800 P 41268b218b804905a110c86738e74400 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:51.627370 18300 tablet_replica.cc:333] T 7b77a53b493f4e979fdf38a0b17176b0 P 41268b218b804905a110c86738e74400: stopping tablet replica
I20260709 13:08:51.627887 18300 raft_consensus.cc:2243] T 7b77a53b493f4e979fdf38a0b17176b0 P 41268b218b804905a110c86738e74400 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:51.628334 18300 raft_consensus.cc:2272] T 7b77a53b493f4e979fdf38a0b17176b0 P 41268b218b804905a110c86738e74400 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:51.630790 18300 tablet_replica.cc:333] T bc0b10615ecb4485a9a9de298938697d P 41268b218b804905a110c86738e74400: stopping tablet replica
I20260709 13:08:51.631290 18300 raft_consensus.cc:2243] T bc0b10615ecb4485a9a9de298938697d P 41268b218b804905a110c86738e74400 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:51.631742 18300 raft_consensus.cc:2272] T bc0b10615ecb4485a9a9de298938697d P 41268b218b804905a110c86738e74400 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:51.633569 18300 tablet_replica.cc:333] T e5847d81a5284a44a6b2b21cf6f4351c P 41268b218b804905a110c86738e74400: stopping tablet replica
I20260709 13:08:51.634092 18300 raft_consensus.cc:2243] T e5847d81a5284a44a6b2b21cf6f4351c P 41268b218b804905a110c86738e74400 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:51.634488 18300 raft_consensus.cc:2272] T e5847d81a5284a44a6b2b21cf6f4351c P 41268b218b804905a110c86738e74400 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:51.636490 18300 tablet_replica.cc:333] T dd959195de1942f7999397a56496f5bc P 41268b218b804905a110c86738e74400: stopping tablet replica
I20260709 13:08:51.636963 18300 raft_consensus.cc:2243] T dd959195de1942f7999397a56496f5bc P 41268b218b804905a110c86738e74400 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:08:51.637739 18300 raft_consensus.cc:2272] T dd959195de1942f7999397a56496f5bc P 41268b218b804905a110c86738e74400 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:51.639635 18300 tablet_replica.cc:333] T fc84b896d2ae4581bc236b96d5de9de3 P 41268b218b804905a110c86738e74400: stopping tablet replica
I20260709 13:08:51.640102 18300 raft_consensus.cc:2243] T fc84b896d2ae4581bc236b96d5de9de3 P 41268b218b804905a110c86738e74400 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:51.640501 18300 raft_consensus.cc:2272] T fc84b896d2ae4581bc236b96d5de9de3 P 41268b218b804905a110c86738e74400 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:51.642244 18300 tablet_replica.cc:333] T afcb3b39d1c9495eab95404687865537 P 41268b218b804905a110c86738e74400: stopping tablet replica
I20260709 13:08:51.642805 18300 raft_consensus.cc:2243] T afcb3b39d1c9495eab95404687865537 P 41268b218b804905a110c86738e74400 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:08:51.643563 18300 raft_consensus.cc:2272] T afcb3b39d1c9495eab95404687865537 P 41268b218b804905a110c86738e74400 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:51.645453 18300 tablet_replica.cc:333] T a9eac7f072de454a8ff2beb019da45d9 P 41268b218b804905a110c86738e74400: stopping tablet replica
I20260709 13:08:51.645961 18300 raft_consensus.cc:2243] T a9eac7f072de454a8ff2beb019da45d9 P 41268b218b804905a110c86738e74400 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:51.646389 18300 raft_consensus.cc:2272] T a9eac7f072de454a8ff2beb019da45d9 P 41268b218b804905a110c86738e74400 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:51.648659 18300 tablet_replica.cc:333] T d0c8b4ec2d844a89b4bb66c0f1bf2c8f P 41268b218b804905a110c86738e74400: stopping tablet replica
I20260709 13:08:51.649142 18300 raft_consensus.cc:2243] T d0c8b4ec2d844a89b4bb66c0f1bf2c8f P 41268b218b804905a110c86738e74400 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:08:51.649945 18300 raft_consensus.cc:2272] T d0c8b4ec2d844a89b4bb66c0f1bf2c8f P 41268b218b804905a110c86738e74400 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:51.651909 18300 tablet_replica.cc:333] T 9ac520b68b79484990a8725d6549174e P 41268b218b804905a110c86738e74400: stopping tablet replica
I20260709 13:08:51.652362 18300 raft_consensus.cc:2243] T 9ac520b68b79484990a8725d6549174e P 41268b218b804905a110c86738e74400 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:51.652864 18300 raft_consensus.cc:2272] T 9ac520b68b79484990a8725d6549174e P 41268b218b804905a110c86738e74400 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:08:51.656970 27782 consensus_peers.cc:597] T 1d9bdb76a5094186b5ac6c8f8e1c9840 P 18435fbb525741328139e84a1e354954 -> Peer 41268b218b804905a110c86738e74400 (127.17.223.2:44403): Couldn't send request to peer 41268b218b804905a110c86738e74400. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:08:51.659607 27782 consensus_peers.cc:597] T df06af11cae7484d969017fcb5b7e753 P 18435fbb525741328139e84a1e354954 -> Peer 41268b218b804905a110c86738e74400 (127.17.223.2:44403): Couldn't send request to peer 41268b218b804905a110c86738e74400. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:08:51.660447 27782 consensus_peers.cc:597] T e5847d81a5284a44a6b2b21cf6f4351c P 18435fbb525741328139e84a1e354954 -> Peer 41268b218b804905a110c86738e74400 (127.17.223.2:44403): Couldn't send request to peer 41268b218b804905a110c86738e74400. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:08:51.716804 27782 consensus_peers.cc:597] T 5a55d1bac7374ff6b83cc7bae2d3b1f3 P 18435fbb525741328139e84a1e354954 -> Peer 41268b218b804905a110c86738e74400 (127.17.223.2:44403): Couldn't send request to peer 41268b218b804905a110c86738e74400. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:08:51.744800 18300 tablet_server.cc:196] TabletServer@127.17.223.2:0 shutdown complete.
W20260709 13:08:51.762056 27708 consensus_peers.cc:597] T 1a26f012cd6e4c4c8bf86b5fda903800 P 665f7e09521a4c3f9284c1d8b0e094ff -> Peer 41268b218b804905a110c86738e74400 (127.17.223.2:44403): Couldn't send request to peer 41268b218b804905a110c86738e74400. Status: Network error: Client connection negotiation failed: client connection to 127.17.223.2:44403: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:08:51.807366 27708 consensus_peers.cc:597] T 5e6f8bdfe11b4af4aa27a711db7cbe7a P 665f7e09521a4c3f9284c1d8b0e094ff -> Peer 41268b218b804905a110c86738e74400 (127.17.223.2:44403): Couldn't send request to peer 41268b218b804905a110c86738e74400. Status: Network error: Client connection negotiation failed: client connection to 127.17.223.2:44403: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:08:51.807902 27708 consensus_peers.cc:597] T 106e04f510c741439b91c39d5fac5a23 P 665f7e09521a4c3f9284c1d8b0e094ff -> Peer 41268b218b804905a110c86738e74400 (127.17.223.2:44403): Couldn't send request to peer 41268b218b804905a110c86738e74400. Status: Network error: Client connection negotiation failed: client connection to 127.17.223.2:44403: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:08:51.823531 18300 tablet_server.cc:179] TabletServer@127.17.223.3:0 shutting down...
W20260709 13:08:51.836167 27782 consensus_peers.cc:597] T 56803a5c0dea4efeabafb6829d9215cd P 18435fbb525741328139e84a1e354954 -> Peer 41268b218b804905a110c86738e74400 (127.17.223.2:44403): Couldn't send request to peer 41268b218b804905a110c86738e74400. Status: Network error: Client connection negotiation failed: client connection to 127.17.223.2:44403: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:08:51.837513 27782 consensus_peers.cc:597] T 64490a86db8c4f5ca54f4f8085f41319 P 18435fbb525741328139e84a1e354954 -> Peer 665f7e09521a4c3f9284c1d8b0e094ff (127.17.223.3:38749): Couldn't send request to peer 665f7e09521a4c3f9284c1d8b0e094ff. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:08:51.846866 27708 consensus_peers.cc:597] T 8e758d59bd4a4eae9f67662e165013f9 P 665f7e09521a4c3f9284c1d8b0e094ff -> Peer 41268b218b804905a110c86738e74400 (127.17.223.2:44403): Couldn't send request to peer 41268b218b804905a110c86738e74400. Status: Network error: Client connection negotiation failed: client connection to 127.17.223.2:44403: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:08:51.855219 27708 consensus_peers.cc:597] T 9ac520b68b79484990a8725d6549174e P 665f7e09521a4c3f9284c1d8b0e094ff -> Peer 41268b218b804905a110c86738e74400 (127.17.223.2:44403): Couldn't send request to peer 41268b218b804905a110c86738e74400. Status: Network error: Client connection negotiation failed: client connection to 127.17.223.2:44403: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:08:51.861259 27782 consensus_peers.cc:597] T e9b149d77d9941158ead8e9e592e7b27 P 18435fbb525741328139e84a1e354954 -> Peer 41268b218b804905a110c86738e74400 (127.17.223.2:44403): Couldn't send request to peer 41268b218b804905a110c86738e74400. Status: Network error: Client connection negotiation failed: client connection to 127.17.223.2:44403: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:08:51.862618 27782 consensus_peers.cc:597] T ae05961ab7a94458b1ad2cde9785c63b P 18435fbb525741328139e84a1e354954 -> Peer 665f7e09521a4c3f9284c1d8b0e094ff (127.17.223.3:38749): Couldn't send request to peer 665f7e09521a4c3f9284c1d8b0e094ff. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:08:51.880246 18300 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:08:51.881141 18300 tablet_replica.cc:333] T 539b1d2240654c74bd9054a06a8eaac6 P 665f7e09521a4c3f9284c1d8b0e094ff: stopping tablet replica
I20260709 13:08:51.881996 18300 raft_consensus.cc:2243] T 539b1d2240654c74bd9054a06a8eaac6 P 665f7e09521a4c3f9284c1d8b0e094ff [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:51.882647 18300 raft_consensus.cc:2272] T 539b1d2240654c74bd9054a06a8eaac6 P 665f7e09521a4c3f9284c1d8b0e094ff [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:08:51.883574 27782 consensus_peers.cc:597] T 9e94954fc474414ba7563be776d6c80a P 18435fbb525741328139e84a1e354954 -> Peer 41268b218b804905a110c86738e74400 (127.17.223.2:44403): Couldn't send request to peer 41268b218b804905a110c86738e74400. Status: Network error: Client connection negotiation failed: client connection to 127.17.223.2:44403: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:08:51.885207 18300 tablet_replica.cc:333] T 9c0f604d66664505aa9469fb058601b6 P 665f7e09521a4c3f9284c1d8b0e094ff: stopping tablet replica
I20260709 13:08:51.885864 18300 raft_consensus.cc:2243] T 9c0f604d66664505aa9469fb058601b6 P 665f7e09521a4c3f9284c1d8b0e094ff [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:08:51.886577 18300 raft_consensus.cc:2272] T 9c0f604d66664505aa9469fb058601b6 P 665f7e09521a4c3f9284c1d8b0e094ff [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:51.888432 18300 tablet_replica.cc:333] T 9e94954fc474414ba7563be776d6c80a P 665f7e09521a4c3f9284c1d8b0e094ff: stopping tablet replica
I20260709 13:08:51.889024 18300 raft_consensus.cc:2243] T 9e94954fc474414ba7563be776d6c80a P 665f7e09521a4c3f9284c1d8b0e094ff [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:51.889437 18300 raft_consensus.cc:2272] T 9e94954fc474414ba7563be776d6c80a P 665f7e09521a4c3f9284c1d8b0e094ff [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:51.891314 18300 tablet_replica.cc:333] T ea92a607c73b4d289d081146089a86f9 P 665f7e09521a4c3f9284c1d8b0e094ff: stopping tablet replica
I20260709 13:08:51.891845 18300 raft_consensus.cc:2243] T ea92a607c73b4d289d081146089a86f9 P 665f7e09521a4c3f9284c1d8b0e094ff [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:51.892223 18300 raft_consensus.cc:2272] T ea92a607c73b4d289d081146089a86f9 P 665f7e09521a4c3f9284c1d8b0e094ff [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:51.893929 18300 tablet_replica.cc:333] T 1c5e794c2a0a45fa99bcfde6aeb45d2e P 665f7e09521a4c3f9284c1d8b0e094ff: stopping tablet replica
I20260709 13:08:51.894412 18300 raft_consensus.cc:2243] T 1c5e794c2a0a45fa99bcfde6aeb45d2e P 665f7e09521a4c3f9284c1d8b0e094ff [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:51.894806 18300 raft_consensus.cc:2272] T 1c5e794c2a0a45fa99bcfde6aeb45d2e P 665f7e09521a4c3f9284c1d8b0e094ff [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:51.896598 18300 tablet_replica.cc:333] T 8e758d59bd4a4eae9f67662e165013f9 P 665f7e09521a4c3f9284c1d8b0e094ff: stopping tablet replica
I20260709 13:08:51.897097 18300 raft_consensus.cc:2243] T 8e758d59bd4a4eae9f67662e165013f9 P 665f7e09521a4c3f9284c1d8b0e094ff [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:08:51.897785 18300 raft_consensus.cc:2272] T 8e758d59bd4a4eae9f67662e165013f9 P 665f7e09521a4c3f9284c1d8b0e094ff [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:51.899794 18300 tablet_replica.cc:333] T fb246ce2984c4a6393f12f75083c9fcf P 665f7e09521a4c3f9284c1d8b0e094ff: stopping tablet replica
I20260709 13:08:51.900483 18300 raft_consensus.cc:2243] T fb246ce2984c4a6393f12f75083c9fcf P 665f7e09521a4c3f9284c1d8b0e094ff [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:08:51.901327 18300 raft_consensus.cc:2272] T fb246ce2984c4a6393f12f75083c9fcf P 665f7e09521a4c3f9284c1d8b0e094ff [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:51.903844 18300 tablet_replica.cc:333] T 8d1aa996b2034de7b2d77545de68e73c P 665f7e09521a4c3f9284c1d8b0e094ff: stopping tablet replica
W20260709 13:08:51.903967 27708 consensus_peers.cc:597] T 5f4a8242380b4863bf5ad2c055229bb7 P 665f7e09521a4c3f9284c1d8b0e094ff -> Peer 41268b218b804905a110c86738e74400 (127.17.223.2:44403): Couldn't send request to peer 41268b218b804905a110c86738e74400. Status: Network error: Client connection negotiation failed: client connection to 127.17.223.2:44403: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:08:51.904621 18300 raft_consensus.cc:2243] T 8d1aa996b2034de7b2d77545de68e73c P 665f7e09521a4c3f9284c1d8b0e094ff [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:08:51.905614 18300 raft_consensus.cc:2272] T 8d1aa996b2034de7b2d77545de68e73c P 665f7e09521a4c3f9284c1d8b0e094ff [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:51.908449 18300 tablet_replica.cc:333] T 85cdd21b7a5f4db7af44327c57c16d43 P 665f7e09521a4c3f9284c1d8b0e094ff: stopping tablet replica
I20260709 13:08:51.909363 18300 raft_consensus.cc:2243] T 85cdd21b7a5f4db7af44327c57c16d43 P 665f7e09521a4c3f9284c1d8b0e094ff [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:08:51.910399 18300 raft_consensus.cc:2272] T 85cdd21b7a5f4db7af44327c57c16d43 P 665f7e09521a4c3f9284c1d8b0e094ff [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:51.912925 18300 tablet_replica.cc:333] T 585e960f8d0f42268f2fe98e1e7b83f0 P 665f7e09521a4c3f9284c1d8b0e094ff: stopping tablet replica
I20260709 13:08:51.913527 18300 raft_consensus.cc:2243] T 585e960f8d0f42268f2fe98e1e7b83f0 P 665f7e09521a4c3f9284c1d8b0e094ff [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:51.913933 18300 raft_consensus.cc:2272] T 585e960f8d0f42268f2fe98e1e7b83f0 P 665f7e09521a4c3f9284c1d8b0e094ff [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:51.915818 18300 tablet_replica.cc:333] T 1cd5e6e9b36d4591961cb379d7065be9 P 665f7e09521a4c3f9284c1d8b0e094ff: stopping tablet replica
I20260709 13:08:51.916363 18300 raft_consensus.cc:2243] T 1cd5e6e9b36d4591961cb379d7065be9 P 665f7e09521a4c3f9284c1d8b0e094ff [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:51.916879 18300 raft_consensus.cc:2272] T 1cd5e6e9b36d4591961cb379d7065be9 P 665f7e09521a4c3f9284c1d8b0e094ff [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:51.919504 18300 tablet_replica.cc:333] T afcb3b39d1c9495eab95404687865537 P 665f7e09521a4c3f9284c1d8b0e094ff: stopping tablet replica
I20260709 13:08:51.920303 18300 raft_consensus.cc:2243] T afcb3b39d1c9495eab95404687865537 P 665f7e09521a4c3f9284c1d8b0e094ff [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:51.920786 18300 raft_consensus.cc:2272] T afcb3b39d1c9495eab95404687865537 P 665f7e09521a4c3f9284c1d8b0e094ff [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:51.923338 18300 tablet_replica.cc:333] T 78e19c035a854ee98657bec3edcb3585 P 665f7e09521a4c3f9284c1d8b0e094ff: stopping tablet replica
I20260709 13:08:51.924139 18300 raft_consensus.cc:2243] T 78e19c035a854ee98657bec3edcb3585 P 665f7e09521a4c3f9284c1d8b0e094ff [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:08:51.925083 18300 raft_consensus.cc:2272] T 78e19c035a854ee98657bec3edcb3585 P 665f7e09521a4c3f9284c1d8b0e094ff [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:51.927557 18300 tablet_replica.cc:333] T 93c69c92efc3402e8e9546cb961bbcdc P 665f7e09521a4c3f9284c1d8b0e094ff: stopping tablet replica
I20260709 13:08:51.928303 18300 raft_consensus.cc:2243] T 93c69c92efc3402e8e9546cb961bbcdc P 665f7e09521a4c3f9284c1d8b0e094ff [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:51.928781 18300 raft_consensus.cc:2272] T 93c69c92efc3402e8e9546cb961bbcdc P 665f7e09521a4c3f9284c1d8b0e094ff [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:51.931074 18300 tablet_replica.cc:333] T 5f4a8242380b4863bf5ad2c055229bb7 P 665f7e09521a4c3f9284c1d8b0e094ff: stopping tablet replica
I20260709 13:08:51.931877 18300 raft_consensus.cc:2243] T 5f4a8242380b4863bf5ad2c055229bb7 P 665f7e09521a4c3f9284c1d8b0e094ff [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:08:51.932745 18300 raft_consensus.cc:2272] T 5f4a8242380b4863bf5ad2c055229bb7 P 665f7e09521a4c3f9284c1d8b0e094ff [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:08:51.933643 27708 consensus_peers.cc:597] T fc84b896d2ae4581bc236b96d5de9de3 P 665f7e09521a4c3f9284c1d8b0e094ff -> Peer 41268b218b804905a110c86738e74400 (127.17.223.2:44403): Couldn't send request to peer 41268b218b804905a110c86738e74400. Status: Network error: Client connection negotiation failed: client connection to 127.17.223.2:44403: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:08:51.934376 27782 consensus_peers.cc:597] T 56803a5c0dea4efeabafb6829d9215cd P 18435fbb525741328139e84a1e354954 -> Peer 665f7e09521a4c3f9284c1d8b0e094ff (127.17.223.3:38749): Couldn't send request to peer 665f7e09521a4c3f9284c1d8b0e094ff. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:08:51.935130 18300 tablet_replica.cc:333] T 765d0bd527c64f74be713c390a018bba P 665f7e09521a4c3f9284c1d8b0e094ff: stopping tablet replica
I20260709 13:08:51.935849 18300 raft_consensus.cc:2243] T 765d0bd527c64f74be713c390a018bba P 665f7e09521a4c3f9284c1d8b0e094ff [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:51.936311 18300 raft_consensus.cc:2272] T 765d0bd527c64f74be713c390a018bba P 665f7e09521a4c3f9284c1d8b0e094ff [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:51.938364 18300 tablet_replica.cc:333] T 80e2477670ec4db18ad338931d714544 P 665f7e09521a4c3f9284c1d8b0e094ff: stopping tablet replica
I20260709 13:08:51.939528 18300 raft_consensus.cc:2243] T 80e2477670ec4db18ad338931d714544 P 665f7e09521a4c3f9284c1d8b0e094ff [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:51.940025 18300 raft_consensus.cc:2272] T 80e2477670ec4db18ad338931d714544 P 665f7e09521a4c3f9284c1d8b0e094ff [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:08:51.941079 27782 consensus_peers.cc:597] T 1d9bdb76a5094186b5ac6c8f8e1c9840 P 18435fbb525741328139e84a1e354954 -> Peer 665f7e09521a4c3f9284c1d8b0e094ff (127.17.223.3:38749): Couldn't send request to peer 665f7e09521a4c3f9284c1d8b0e094ff. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:08:51.942202 18300 tablet_replica.cc:333] T ae05961ab7a94458b1ad2cde9785c63b P 665f7e09521a4c3f9284c1d8b0e094ff: stopping tablet replica
I20260709 13:08:51.942800 18300 raft_consensus.cc:2243] T ae05961ab7a94458b1ad2cde9785c63b P 665f7e09521a4c3f9284c1d8b0e094ff [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:51.943181 18300 raft_consensus.cc:2272] T ae05961ab7a94458b1ad2cde9785c63b P 665f7e09521a4c3f9284c1d8b0e094ff [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:51.944998 18300 tablet_replica.cc:333] T df06af11cae7484d969017fcb5b7e753 P 665f7e09521a4c3f9284c1d8b0e094ff: stopping tablet replica
I20260709 13:08:51.945466 18300 raft_consensus.cc:2243] T df06af11cae7484d969017fcb5b7e753 P 665f7e09521a4c3f9284c1d8b0e094ff [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:51.945815 18300 raft_consensus.cc:2272] T df06af11cae7484d969017fcb5b7e753 P 665f7e09521a4c3f9284c1d8b0e094ff [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:51.947731 18300 tablet_replica.cc:333] T c9ea919812394c7aba307c2ff5b81f51 P 665f7e09521a4c3f9284c1d8b0e094ff: stopping tablet replica
I20260709 13:08:51.948210 18300 raft_consensus.cc:2243] T c9ea919812394c7aba307c2ff5b81f51 P 665f7e09521a4c3f9284c1d8b0e094ff [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:51.948570 18300 raft_consensus.cc:2272] T c9ea919812394c7aba307c2ff5b81f51 P 665f7e09521a4c3f9284c1d8b0e094ff [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:51.950523 18300 tablet_replica.cc:333] T 47b65672307641ae81d5f94c639b1a10 P 665f7e09521a4c3f9284c1d8b0e094ff: stopping tablet replica
I20260709 13:08:51.951066 18300 raft_consensus.cc:2243] T 47b65672307641ae81d5f94c639b1a10 P 665f7e09521a4c3f9284c1d8b0e094ff [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:51.951408 18300 raft_consensus.cc:2272] T 47b65672307641ae81d5f94c639b1a10 P 665f7e09521a4c3f9284c1d8b0e094ff [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:51.953212 18300 tablet_replica.cc:333] T 68cc2880cf79462c99d9009957eb5fd2 P 665f7e09521a4c3f9284c1d8b0e094ff: stopping tablet replica
I20260709 13:08:51.953716 18300 raft_consensus.cc:2243] T 68cc2880cf79462c99d9009957eb5fd2 P 665f7e09521a4c3f9284c1d8b0e094ff [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:51.954111 18300 raft_consensus.cc:2272] T 68cc2880cf79462c99d9009957eb5fd2 P 665f7e09521a4c3f9284c1d8b0e094ff [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:51.956004 18300 tablet_replica.cc:333] T 9db60240699a4db2ba5faa2c50a742da P 665f7e09521a4c3f9284c1d8b0e094ff: stopping tablet replica
I20260709 13:08:51.956511 18300 raft_consensus.cc:2243] T 9db60240699a4db2ba5faa2c50a742da P 665f7e09521a4c3f9284c1d8b0e094ff [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:51.956887 18300 raft_consensus.cc:2272] T 9db60240699a4db2ba5faa2c50a742da P 665f7e09521a4c3f9284c1d8b0e094ff [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:51.958745 18300 tablet_replica.cc:333] T 8ee97a8570ae4cb49195d1b977d1cdf4 P 665f7e09521a4c3f9284c1d8b0e094ff: stopping tablet replica
I20260709 13:08:51.959226 18300 raft_consensus.cc:2243] T 8ee97a8570ae4cb49195d1b977d1cdf4 P 665f7e09521a4c3f9284c1d8b0e094ff [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:51.959630 18300 raft_consensus.cc:2272] T 8ee97a8570ae4cb49195d1b977d1cdf4 P 665f7e09521a4c3f9284c1d8b0e094ff [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:51.961730 18300 tablet_replica.cc:333] T ff09d7e79a3e43918f3c71d10a40d60b P 665f7e09521a4c3f9284c1d8b0e094ff: stopping tablet replica
I20260709 13:08:51.962229 18300 raft_consensus.cc:2243] T ff09d7e79a3e43918f3c71d10a40d60b P 665f7e09521a4c3f9284c1d8b0e094ff [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:51.962625 18300 raft_consensus.cc:2272] T ff09d7e79a3e43918f3c71d10a40d60b P 665f7e09521a4c3f9284c1d8b0e094ff [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:51.964444 18300 tablet_replica.cc:333] T 5e6f8bdfe11b4af4aa27a711db7cbe7a P 665f7e09521a4c3f9284c1d8b0e094ff: stopping tablet replica
I20260709 13:08:51.964931 18300 raft_consensus.cc:2243] T 5e6f8bdfe11b4af4aa27a711db7cbe7a P 665f7e09521a4c3f9284c1d8b0e094ff [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:08:51.965633 18300 raft_consensus.cc:2272] T 5e6f8bdfe11b4af4aa27a711db7cbe7a P 665f7e09521a4c3f9284c1d8b0e094ff [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:51.967377 18300 tablet_replica.cc:333] T 11224ef6c00a40cdba4311ceb63bddb9 P 665f7e09521a4c3f9284c1d8b0e094ff: stopping tablet replica
I20260709 13:08:51.967866 18300 raft_consensus.cc:2243] T 11224ef6c00a40cdba4311ceb63bddb9 P 665f7e09521a4c3f9284c1d8b0e094ff [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:51.968248 18300 raft_consensus.cc:2272] T 11224ef6c00a40cdba4311ceb63bddb9 P 665f7e09521a4c3f9284c1d8b0e094ff [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:51.969897 18300 tablet_replica.cc:333] T 866a01285ca8436385f8d16dcfb0d4e3 P 665f7e09521a4c3f9284c1d8b0e094ff: stopping tablet replica
I20260709 13:08:51.970397 18300 raft_consensus.cc:2243] T 866a01285ca8436385f8d16dcfb0d4e3 P 665f7e09521a4c3f9284c1d8b0e094ff [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:51.970824 18300 raft_consensus.cc:2272] T 866a01285ca8436385f8d16dcfb0d4e3 P 665f7e09521a4c3f9284c1d8b0e094ff [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:51.972648 18300 tablet_replica.cc:333] T 7b77a53b493f4e979fdf38a0b17176b0 P 665f7e09521a4c3f9284c1d8b0e094ff: stopping tablet replica
I20260709 13:08:51.973179 18300 raft_consensus.cc:2243] T 7b77a53b493f4e979fdf38a0b17176b0 P 665f7e09521a4c3f9284c1d8b0e094ff [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:51.973749 18300 raft_consensus.cc:2272] T 7b77a53b493f4e979fdf38a0b17176b0 P 665f7e09521a4c3f9284c1d8b0e094ff [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:51.976342 18300 tablet_replica.cc:333] T e23b142958324f69aa0bad3a5828fa83 P 665f7e09521a4c3f9284c1d8b0e094ff: stopping tablet replica
I20260709 13:08:51.977043 18300 raft_consensus.cc:2243] T e23b142958324f69aa0bad3a5828fa83 P 665f7e09521a4c3f9284c1d8b0e094ff [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:51.977591 18300 raft_consensus.cc:2272] T e23b142958324f69aa0bad3a5828fa83 P 665f7e09521a4c3f9284c1d8b0e094ff [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:51.980201 18300 tablet_replica.cc:333] T 18f991bbbf3a4615aab49899c7ef86dc P 665f7e09521a4c3f9284c1d8b0e094ff: stopping tablet replica
I20260709 13:08:51.980943 18300 raft_consensus.cc:2243] T 18f991bbbf3a4615aab49899c7ef86dc P 665f7e09521a4c3f9284c1d8b0e094ff [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:08:51.981832 18300 raft_consensus.cc:2272] T 18f991bbbf3a4615aab49899c7ef86dc P 665f7e09521a4c3f9284c1d8b0e094ff [term 3 FOLLOWER]: Raft consensus is shut down!
W20260709 13:08:51.983919 27708 consensus_peers.cc:597] T 456941807b254f5fb32dca4f84bd16ea P 665f7e09521a4c3f9284c1d8b0e094ff -> Peer 41268b218b804905a110c86738e74400 (127.17.223.2:44403): Couldn't send request to peer 41268b218b804905a110c86738e74400. Status: Network error: Client connection negotiation failed: client connection to 127.17.223.2:44403: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:08:51.984464 18300 tablet_replica.cc:333] T 64490a86db8c4f5ca54f4f8085f41319 P 665f7e09521a4c3f9284c1d8b0e094ff: stopping tablet replica
I20260709 13:08:51.985291 18300 raft_consensus.cc:2243] T 64490a86db8c4f5ca54f4f8085f41319 P 665f7e09521a4c3f9284c1d8b0e094ff [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:51.985826 18300 raft_consensus.cc:2272] T 64490a86db8c4f5ca54f4f8085f41319 P 665f7e09521a4c3f9284c1d8b0e094ff [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:08:51.985988 27782 consensus_peers.cc:597] T bc0b10615ecb4485a9a9de298938697d P 18435fbb525741328139e84a1e354954 -> Peer 41268b218b804905a110c86738e74400 (127.17.223.2:44403): Couldn't send request to peer 41268b218b804905a110c86738e74400. Status: Network error: Client connection negotiation failed: client connection to 127.17.223.2:44403: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:08:51.988045 18300 tablet_replica.cc:333] T 2d68b1be563949efbcb4bbe71eddd0d8 P 665f7e09521a4c3f9284c1d8b0e094ff: stopping tablet replica
I20260709 13:08:51.988629 18300 raft_consensus.cc:2243] T 2d68b1be563949efbcb4bbe71eddd0d8 P 665f7e09521a4c3f9284c1d8b0e094ff [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:08:51.989342 18300 raft_consensus.cc:2272] T 2d68b1be563949efbcb4bbe71eddd0d8 P 665f7e09521a4c3f9284c1d8b0e094ff [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:51.991343 18300 tablet_replica.cc:333] T dd959195de1942f7999397a56496f5bc P 665f7e09521a4c3f9284c1d8b0e094ff: stopping tablet replica
I20260709 13:08:51.991848 18300 raft_consensus.cc:2243] T dd959195de1942f7999397a56496f5bc P 665f7e09521a4c3f9284c1d8b0e094ff [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:51.992238 18300 raft_consensus.cc:2272] T dd959195de1942f7999397a56496f5bc P 665f7e09521a4c3f9284c1d8b0e094ff [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:51.994113 18300 tablet_replica.cc:333] T bbd0bdc9640c4956a5d60406841ef0f0 P 665f7e09521a4c3f9284c1d8b0e094ff: stopping tablet replica
I20260709 13:08:51.994630 18300 raft_consensus.cc:2243] T bbd0bdc9640c4956a5d60406841ef0f0 P 665f7e09521a4c3f9284c1d8b0e094ff [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:51.995081 18300 raft_consensus.cc:2272] T bbd0bdc9640c4956a5d60406841ef0f0 P 665f7e09521a4c3f9284c1d8b0e094ff [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:51.996845 18300 tablet_replica.cc:333] T 1d9bdb76a5094186b5ac6c8f8e1c9840 P 665f7e09521a4c3f9284c1d8b0e094ff: stopping tablet replica
I20260709 13:08:51.997349 18300 raft_consensus.cc:2243] T 1d9bdb76a5094186b5ac6c8f8e1c9840 P 665f7e09521a4c3f9284c1d8b0e094ff [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:51.997742 18300 raft_consensus.cc:2272] T 1d9bdb76a5094186b5ac6c8f8e1c9840 P 665f7e09521a4c3f9284c1d8b0e094ff [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:51.999521 18300 tablet_replica.cc:333] T 55a3afc21cea43ea85f4a2155552422d P 665f7e09521a4c3f9284c1d8b0e094ff: stopping tablet replica
I20260709 13:08:52.000020 18300 raft_consensus.cc:2243] T 55a3afc21cea43ea85f4a2155552422d P 665f7e09521a4c3f9284c1d8b0e094ff [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:52.000380 18300 raft_consensus.cc:2272] T 55a3afc21cea43ea85f4a2155552422d P 665f7e09521a4c3f9284c1d8b0e094ff [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:52.002143 18300 tablet_replica.cc:333] T fc84b896d2ae4581bc236b96d5de9de3 P 665f7e09521a4c3f9284c1d8b0e094ff: stopping tablet replica
I20260709 13:08:52.002651 18300 raft_consensus.cc:2243] T fc84b896d2ae4581bc236b96d5de9de3 P 665f7e09521a4c3f9284c1d8b0e094ff [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:08:52.003451 18300 raft_consensus.cc:2272] T fc84b896d2ae4581bc236b96d5de9de3 P 665f7e09521a4c3f9284c1d8b0e094ff [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:52.005239 18300 tablet_replica.cc:333] T 56803a5c0dea4efeabafb6829d9215cd P 665f7e09521a4c3f9284c1d8b0e094ff: stopping tablet replica
I20260709 13:08:52.005725 18300 raft_consensus.cc:2243] T 56803a5c0dea4efeabafb6829d9215cd P 665f7e09521a4c3f9284c1d8b0e094ff [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:52.006165 18300 raft_consensus.cc:2272] T 56803a5c0dea4efeabafb6829d9215cd P 665f7e09521a4c3f9284c1d8b0e094ff [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:52.007858 18300 tablet_replica.cc:333] T 9ac520b68b79484990a8725d6549174e P 665f7e09521a4c3f9284c1d8b0e094ff: stopping tablet replica
I20260709 13:08:52.008311 18300 raft_consensus.cc:2243] T 9ac520b68b79484990a8725d6549174e P 665f7e09521a4c3f9284c1d8b0e094ff [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:08:52.009037 18300 raft_consensus.cc:2272] T 9ac520b68b79484990a8725d6549174e P 665f7e09521a4c3f9284c1d8b0e094ff [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:52.011138 18300 tablet_replica.cc:333] T 106e04f510c741439b91c39d5fac5a23 P 665f7e09521a4c3f9284c1d8b0e094ff: stopping tablet replica
I20260709 13:08:52.011682 18300 raft_consensus.cc:2243] T 106e04f510c741439b91c39d5fac5a23 P 665f7e09521a4c3f9284c1d8b0e094ff [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:08:52.012542 18300 raft_consensus.cc:2272] T 106e04f510c741439b91c39d5fac5a23 P 665f7e09521a4c3f9284c1d8b0e094ff [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:08:52.013801 27782 consensus_peers.cc:597] T ff09d7e79a3e43918f3c71d10a40d60b P 18435fbb525741328139e84a1e354954 -> Peer 665f7e09521a4c3f9284c1d8b0e094ff (127.17.223.3:38749): Couldn't send request to peer 665f7e09521a4c3f9284c1d8b0e094ff. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:08:52.014964 18300 tablet_replica.cc:333] T 1a26f012cd6e4c4c8bf86b5fda903800 P 665f7e09521a4c3f9284c1d8b0e094ff: stopping tablet replica
I20260709 13:08:52.015614 18300 raft_consensus.cc:2243] T 1a26f012cd6e4c4c8bf86b5fda903800 P 665f7e09521a4c3f9284c1d8b0e094ff [term 1 LEADER]: Raft consensus shutting down.
W20260709 13:08:52.015965 27782 consensus_peers.cc:597] T 55a3afc21cea43ea85f4a2155552422d P 18435fbb525741328139e84a1e354954 -> Peer 665f7e09521a4c3f9284c1d8b0e094ff (127.17.223.3:38749): Couldn't send request to peer 665f7e09521a4c3f9284c1d8b0e094ff. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:08:52.016510 18300 raft_consensus.cc:2272] T 1a26f012cd6e4c4c8bf86b5fda903800 P 665f7e09521a4c3f9284c1d8b0e094ff [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:52.018420 18300 tablet_replica.cc:333] T 8e0d496efc3f41f3be82a538ef3cfdac P 665f7e09521a4c3f9284c1d8b0e094ff: stopping tablet replica
I20260709 13:08:52.018908 18300 raft_consensus.cc:2243] T 8e0d496efc3f41f3be82a538ef3cfdac P 665f7e09521a4c3f9284c1d8b0e094ff [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:52.019275 18300 raft_consensus.cc:2272] T 8e0d496efc3f41f3be82a538ef3cfdac P 665f7e09521a4c3f9284c1d8b0e094ff [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:52.021023 18300 tablet_replica.cc:333] T 456941807b254f5fb32dca4f84bd16ea P 665f7e09521a4c3f9284c1d8b0e094ff: stopping tablet replica
I20260709 13:08:52.021415 18300 raft_consensus.cc:2243] T 456941807b254f5fb32dca4f84bd16ea P 665f7e09521a4c3f9284c1d8b0e094ff [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:08:52.022109 18300 raft_consensus.cc:2272] T 456941807b254f5fb32dca4f84bd16ea P 665f7e09521a4c3f9284c1d8b0e094ff [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:52.053268 28771 raft_consensus.cc:493] T b6be829f6d3f40c99a3c5be18b0c259c P 18435fbb525741328139e84a1e354954 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 2513a663afac495eb09126ff55e8b2b0)
I20260709 13:08:52.054059 28771 raft_consensus.cc:515] T b6be829f6d3f40c99a3c5be18b0c259c P 18435fbb525741328139e84a1e354954 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18435fbb525741328139e84a1e354954" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 40545 } } peers { permanent_uuid: "2513a663afac495eb09126ff55e8b2b0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40721 } } peers { permanent_uuid: "41268b218b804905a110c86738e74400" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 44403 } }
I20260709 13:08:52.056257 28771 leader_election.cc:290] T b6be829f6d3f40c99a3c5be18b0c259c P 18435fbb525741328139e84a1e354954 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2513a663afac495eb09126ff55e8b2b0 (127.17.223.1:40721), 41268b218b804905a110c86738e74400 (127.17.223.2:44403)
W20260709 13:08:52.060262 27782 leader_election.cc:336] T b6be829f6d3f40c99a3c5be18b0c259c P 18435fbb525741328139e84a1e354954 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 41268b218b804905a110c86738e74400 (127.17.223.2:44403): Network error: Client connection negotiation failed: client connection to 127.17.223.2:44403: connect: Connection refused (error 111)
W20260709 13:08:52.061947 27779 leader_election.cc:336] T b6be829f6d3f40c99a3c5be18b0c259c P 18435fbb525741328139e84a1e354954 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 2513a663afac495eb09126ff55e8b2b0 (127.17.223.1:40721): Network error: Client connection negotiation failed: client connection to 127.17.223.1:40721: connect: Connection refused (error 111)
I20260709 13:08:52.062398 27779 leader_election.cc:304] T b6be829f6d3f40c99a3c5be18b0c259c P 18435fbb525741328139e84a1e354954 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 18435fbb525741328139e84a1e354954; no voters: 2513a663afac495eb09126ff55e8b2b0, 41268b218b804905a110c86738e74400
I20260709 13:08:52.062990 28771 raft_consensus.cc:2749] T b6be829f6d3f40c99a3c5be18b0c259c P 18435fbb525741328139e84a1e354954 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 13:08:52.106513 27782 consensus_peers.cc:597] T df06af11cae7484d969017fcb5b7e753 P 18435fbb525741328139e84a1e354954 -> Peer 665f7e09521a4c3f9284c1d8b0e094ff (127.17.223.3:38749): Couldn't send request to peer 665f7e09521a4c3f9284c1d8b0e094ff. Status: Network error: Client connection negotiation failed: client connection to 127.17.223.3:38749: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:08:52.121377 18300 tablet_server.cc:196] TabletServer@127.17.223.3:0 shutdown complete.
W20260709 13:08:52.133936 27782 consensus_peers.cc:597] T 9e94954fc474414ba7563be776d6c80a P 18435fbb525741328139e84a1e354954 -> Peer 665f7e09521a4c3f9284c1d8b0e094ff (127.17.223.3:38749): Couldn't send request to peer 665f7e09521a4c3f9284c1d8b0e094ff. Status: Network error: Client connection negotiation failed: client connection to 127.17.223.3:38749: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:08:52.192687 18300 tablet_server.cc:179] TabletServer@127.17.223.4:0 shutting down...
I20260709 13:08:52.227950 28771 raft_consensus.cc:493] T 9db60240699a4db2ba5faa2c50a742da P 18435fbb525741328139e84a1e354954 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 2513a663afac495eb09126ff55e8b2b0)
I20260709 13:08:52.228579 28771 raft_consensus.cc:515] T 9db60240699a4db2ba5faa2c50a742da P 18435fbb525741328139e84a1e354954 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "665f7e09521a4c3f9284c1d8b0e094ff" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 38749 } } peers { permanent_uuid: "18435fbb525741328139e84a1e354954" member_type: VOTER last_known_addr { host: "127.17.223.4" port: 40545 } } peers { permanent_uuid: "2513a663afac495eb09126ff55e8b2b0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 40721 } }
I20260709 13:08:52.230472 28771 leader_election.cc:290] T 9db60240699a4db2ba5faa2c50a742da P 18435fbb525741328139e84a1e354954 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 665f7e09521a4c3f9284c1d8b0e094ff (127.17.223.3:38749), 2513a663afac495eb09126ff55e8b2b0 (127.17.223.1:40721)
I20260709 13:08:52.233301 18300 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:08:52.234328 18300 tablet_replica.cc:333] T 9c0f604d66664505aa9469fb058601b6 P 18435fbb525741328139e84a1e354954: stopping tablet replica
I20260709 13:08:52.235350 18300 raft_consensus.cc:2243] T 9c0f604d66664505aa9469fb058601b6 P 18435fbb525741328139e84a1e354954 [term 2 FOLLOWER]: Raft consensus shutting down.
W20260709 13:08:52.235422 27779 leader_election.cc:336] T 9db60240699a4db2ba5faa2c50a742da P 18435fbb525741328139e84a1e354954 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 2513a663afac495eb09126ff55e8b2b0 (127.17.223.1:40721): Network error: Client connection negotiation failed: client connection to 127.17.223.1:40721: connect: Connection refused (error 111)
I20260709 13:08:52.235966 18300 raft_consensus.cc:2272] T 9c0f604d66664505aa9469fb058601b6 P 18435fbb525741328139e84a1e354954 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:08:52.236016 27782 leader_election.cc:336] T 9db60240699a4db2ba5faa2c50a742da P 18435fbb525741328139e84a1e354954 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 665f7e09521a4c3f9284c1d8b0e094ff (127.17.223.3:38749): Network error: Client connection negotiation failed: client connection to 127.17.223.3:38749: connect: Connection refused (error 111)
I20260709 13:08:52.236528 27782 leader_election.cc:304] T 9db60240699a4db2ba5faa2c50a742da P 18435fbb525741328139e84a1e354954 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 18435fbb525741328139e84a1e354954; no voters: 2513a663afac495eb09126ff55e8b2b0, 665f7e09521a4c3f9284c1d8b0e094ff
I20260709 13:08:52.237212 28771 raft_consensus.cc:2749] T 9db60240699a4db2ba5faa2c50a742da P 18435fbb525741328139e84a1e354954 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:08:52.238631 18300 tablet_replica.cc:333] T 539b1d2240654c74bd9054a06a8eaac6 P 18435fbb525741328139e84a1e354954: stopping tablet replica
I20260709 13:08:52.239327 18300 raft_consensus.cc:2243] T 539b1d2240654c74bd9054a06a8eaac6 P 18435fbb525741328139e84a1e354954 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:52.239720 18300 raft_consensus.cc:2272] T 539b1d2240654c74bd9054a06a8eaac6 P 18435fbb525741328139e84a1e354954 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:52.241798 18300 tablet_replica.cc:333] T b6be829f6d3f40c99a3c5be18b0c259c P 18435fbb525741328139e84a1e354954: stopping tablet replica
I20260709 13:08:52.242344 18300 raft_consensus.cc:2243] T b6be829f6d3f40c99a3c5be18b0c259c P 18435fbb525741328139e84a1e354954 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:52.242837 18300 raft_consensus.cc:2272] T b6be829f6d3f40c99a3c5be18b0c259c P 18435fbb525741328139e84a1e354954 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:52.245062 18300 tablet_replica.cc:333] T 28737c73be174729ad3e9d238af7d975 P 18435fbb525741328139e84a1e354954: stopping tablet replica
I20260709 13:08:52.245628 18300 raft_consensus.cc:2243] T 28737c73be174729ad3e9d238af7d975 P 18435fbb525741328139e84a1e354954 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:52.246031 18300 raft_consensus.cc:2272] T 28737c73be174729ad3e9d238af7d975 P 18435fbb525741328139e84a1e354954 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:52.248030 18300 tablet_replica.cc:333] T 9e94954fc474414ba7563be776d6c80a P 18435fbb525741328139e84a1e354954: stopping tablet replica
I20260709 13:08:52.248534 18300 raft_consensus.cc:2243] T 9e94954fc474414ba7563be776d6c80a P 18435fbb525741328139e84a1e354954 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:08:52.249243 18300 raft_consensus.cc:2272] T 9e94954fc474414ba7563be776d6c80a P 18435fbb525741328139e84a1e354954 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:52.250991 18300 tablet_replica.cc:333] T 1c5e794c2a0a45fa99bcfde6aeb45d2e P 18435fbb525741328139e84a1e354954: stopping tablet replica
I20260709 13:08:52.251515 18300 raft_consensus.cc:2243] T 1c5e794c2a0a45fa99bcfde6aeb45d2e P 18435fbb525741328139e84a1e354954 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:52.251912 18300 raft_consensus.cc:2272] T 1c5e794c2a0a45fa99bcfde6aeb45d2e P 18435fbb525741328139e84a1e354954 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:52.253768 18300 tablet_replica.cc:333] T 5a55d1bac7374ff6b83cc7bae2d3b1f3 P 18435fbb525741328139e84a1e354954: stopping tablet replica
I20260709 13:08:52.254320 18300 raft_consensus.cc:2243] T 5a55d1bac7374ff6b83cc7bae2d3b1f3 P 18435fbb525741328139e84a1e354954 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:08:52.255278 18300 raft_consensus.cc:2272] T 5a55d1bac7374ff6b83cc7bae2d3b1f3 P 18435fbb525741328139e84a1e354954 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:52.258119 18300 tablet_replica.cc:333] T 1cd5e6e9b36d4591961cb379d7065be9 P 18435fbb525741328139e84a1e354954: stopping tablet replica
I20260709 13:08:52.258980 18300 raft_consensus.cc:2243] T 1cd5e6e9b36d4591961cb379d7065be9 P 18435fbb525741328139e84a1e354954 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:52.259509 18300 raft_consensus.cc:2272] T 1cd5e6e9b36d4591961cb379d7065be9 P 18435fbb525741328139e84a1e354954 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:52.261602 18300 tablet_replica.cc:333] T 8e0d496efc3f41f3be82a538ef3cfdac P 18435fbb525741328139e84a1e354954: stopping tablet replica
I20260709 13:08:52.262127 18300 raft_consensus.cc:2243] T 8e0d496efc3f41f3be82a538ef3cfdac P 18435fbb525741328139e84a1e354954 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:52.262647 18300 raft_consensus.cc:2272] T 8e0d496efc3f41f3be82a538ef3cfdac P 18435fbb525741328139e84a1e354954 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:52.264603 18300 tablet_replica.cc:333] T 3a7da70e9f0f49a9bf60184a8f0b5339 P 18435fbb525741328139e84a1e354954: stopping tablet replica
I20260709 13:08:52.265153 18300 raft_consensus.cc:2243] T 3a7da70e9f0f49a9bf60184a8f0b5339 P 18435fbb525741328139e84a1e354954 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:08:52.265894 18300 raft_consensus.cc:2272] T 3a7da70e9f0f49a9bf60184a8f0b5339 P 18435fbb525741328139e84a1e354954 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:52.268033 18300 tablet_replica.cc:333] T fb246ce2984c4a6393f12f75083c9fcf P 18435fbb525741328139e84a1e354954: stopping tablet replica
I20260709 13:08:52.268572 18300 raft_consensus.cc:2243] T fb246ce2984c4a6393f12f75083c9fcf P 18435fbb525741328139e84a1e354954 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:52.268991 18300 raft_consensus.cc:2272] T fb246ce2984c4a6393f12f75083c9fcf P 18435fbb525741328139e84a1e354954 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:52.271106 18300 tablet_replica.cc:333] T 8d1aa996b2034de7b2d77545de68e73c P 18435fbb525741328139e84a1e354954: stopping tablet replica
I20260709 13:08:52.271713 18300 raft_consensus.cc:2243] T 8d1aa996b2034de7b2d77545de68e73c P 18435fbb525741328139e84a1e354954 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:52.272127 18300 raft_consensus.cc:2272] T 8d1aa996b2034de7b2d77545de68e73c P 18435fbb525741328139e84a1e354954 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:52.274132 18300 tablet_replica.cc:333] T 106e04f510c741439b91c39d5fac5a23 P 18435fbb525741328139e84a1e354954: stopping tablet replica
I20260709 13:08:52.274736 18300 raft_consensus.cc:2243] T 106e04f510c741439b91c39d5fac5a23 P 18435fbb525741328139e84a1e354954 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:52.275141 18300 raft_consensus.cc:2272] T 106e04f510c741439b91c39d5fac5a23 P 18435fbb525741328139e84a1e354954 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:52.277112 18300 tablet_replica.cc:333] T 4cd7359accee42808761c37543247321 P 18435fbb525741328139e84a1e354954: stopping tablet replica
I20260709 13:08:52.277657 18300 raft_consensus.cc:2243] T 4cd7359accee42808761c37543247321 P 18435fbb525741328139e84a1e354954 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:52.278082 18300 raft_consensus.cc:2272] T 4cd7359accee42808761c37543247321 P 18435fbb525741328139e84a1e354954 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:52.280535 18300 tablet_replica.cc:333] T bc77856749a0473a8b3124ce8c523815 P 18435fbb525741328139e84a1e354954: stopping tablet replica
I20260709 13:08:52.281121 18300 raft_consensus.cc:2243] T bc77856749a0473a8b3124ce8c523815 P 18435fbb525741328139e84a1e354954 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:52.281558 18300 raft_consensus.cc:2272] T bc77856749a0473a8b3124ce8c523815 P 18435fbb525741328139e84a1e354954 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:52.283622 18300 tablet_replica.cc:333] T 86af954f570648969cbc47c03d15c447 P 18435fbb525741328139e84a1e354954: stopping tablet replica
I20260709 13:08:52.284162 18300 raft_consensus.cc:2243] T 86af954f570648969cbc47c03d15c447 P 18435fbb525741328139e84a1e354954 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:52.284598 18300 raft_consensus.cc:2272] T 86af954f570648969cbc47c03d15c447 P 18435fbb525741328139e84a1e354954 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:52.286656 18300 tablet_replica.cc:333] T 9db60240699a4db2ba5faa2c50a742da P 18435fbb525741328139e84a1e354954: stopping tablet replica
I20260709 13:08:52.287207 18300 raft_consensus.cc:2243] T 9db60240699a4db2ba5faa2c50a742da P 18435fbb525741328139e84a1e354954 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:52.287595 18300 raft_consensus.cc:2272] T 9db60240699a4db2ba5faa2c50a742da P 18435fbb525741328139e84a1e354954 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:52.289619 18300 tablet_replica.cc:333] T 8ee97a8570ae4cb49195d1b977d1cdf4 P 18435fbb525741328139e84a1e354954: stopping tablet replica
I20260709 13:08:52.290225 18300 raft_consensus.cc:2243] T 8ee97a8570ae4cb49195d1b977d1cdf4 P 18435fbb525741328139e84a1e354954 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:52.290635 18300 raft_consensus.cc:2272] T 8ee97a8570ae4cb49195d1b977d1cdf4 P 18435fbb525741328139e84a1e354954 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:52.292703 18300 tablet_replica.cc:333] T ff09d7e79a3e43918f3c71d10a40d60b P 18435fbb525741328139e84a1e354954: stopping tablet replica
I20260709 13:08:52.293233 18300 raft_consensus.cc:2243] T ff09d7e79a3e43918f3c71d10a40d60b P 18435fbb525741328139e84a1e354954 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:08:52.294013 18300 raft_consensus.cc:2272] T ff09d7e79a3e43918f3c71d10a40d60b P 18435fbb525741328139e84a1e354954 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:52.296090 18300 tablet_replica.cc:333] T 5f4a8242380b4863bf5ad2c055229bb7 P 18435fbb525741328139e84a1e354954: stopping tablet replica
I20260709 13:08:52.296708 18300 raft_consensus.cc:2243] T 5f4a8242380b4863bf5ad2c055229bb7 P 18435fbb525741328139e84a1e354954 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:52.297165 18300 raft_consensus.cc:2272] T 5f4a8242380b4863bf5ad2c055229bb7 P 18435fbb525741328139e84a1e354954 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:52.299274 18300 tablet_replica.cc:333] T 15a4c537259e4b2882a5cc8e723b260a P 18435fbb525741328139e84a1e354954: stopping tablet replica
I20260709 13:08:52.299857 18300 raft_consensus.cc:2243] T 15a4c537259e4b2882a5cc8e723b260a P 18435fbb525741328139e84a1e354954 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:52.300307 18300 raft_consensus.cc:2272] T 15a4c537259e4b2882a5cc8e723b260a P 18435fbb525741328139e84a1e354954 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:52.302253 18300 tablet_replica.cc:333] T 80e2477670ec4db18ad338931d714544 P 18435fbb525741328139e84a1e354954: stopping tablet replica
I20260709 13:08:52.302896 18300 raft_consensus.cc:2243] T 80e2477670ec4db18ad338931d714544 P 18435fbb525741328139e84a1e354954 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:08:52.303792 18300 raft_consensus.cc:2272] T 80e2477670ec4db18ad338931d714544 P 18435fbb525741328139e84a1e354954 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:52.305807 18300 tablet_replica.cc:333] T 2d994cb13f8f453284bcb1f8b85824a2 P 18435fbb525741328139e84a1e354954: stopping tablet replica
I20260709 13:08:52.306340 18300 raft_consensus.cc:2243] T 2d994cb13f8f453284bcb1f8b85824a2 P 18435fbb525741328139e84a1e354954 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:52.306809 18300 raft_consensus.cc:2272] T 2d994cb13f8f453284bcb1f8b85824a2 P 18435fbb525741328139e84a1e354954 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:52.309202 18300 tablet_replica.cc:333] T c9ea919812394c7aba307c2ff5b81f51 P 18435fbb525741328139e84a1e354954: stopping tablet replica
I20260709 13:08:52.309856 18300 raft_consensus.cc:2243] T c9ea919812394c7aba307c2ff5b81f51 P 18435fbb525741328139e84a1e354954 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:52.310407 18300 raft_consensus.cc:2272] T c9ea919812394c7aba307c2ff5b81f51 P 18435fbb525741328139e84a1e354954 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:52.312378 18300 tablet_replica.cc:333] T 68cc2880cf79462c99d9009957eb5fd2 P 18435fbb525741328139e84a1e354954: stopping tablet replica
I20260709 13:08:52.312942 18300 raft_consensus.cc:2243] T 68cc2880cf79462c99d9009957eb5fd2 P 18435fbb525741328139e84a1e354954 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:52.313309 18300 raft_consensus.cc:2272] T 68cc2880cf79462c99d9009957eb5fd2 P 18435fbb525741328139e84a1e354954 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:52.315488 18300 tablet_replica.cc:333] T ae05961ab7a94458b1ad2cde9785c63b P 18435fbb525741328139e84a1e354954: stopping tablet replica
I20260709 13:08:52.316219 18300 raft_consensus.cc:2243] T ae05961ab7a94458b1ad2cde9785c63b P 18435fbb525741328139e84a1e354954 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:08:52.317253 18300 raft_consensus.cc:2272] T ae05961ab7a94458b1ad2cde9785c63b P 18435fbb525741328139e84a1e354954 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:52.320081 18300 tablet_replica.cc:333] T df06af11cae7484d969017fcb5b7e753 P 18435fbb525741328139e84a1e354954: stopping tablet replica
I20260709 13:08:52.320807 18300 raft_consensus.cc:2243] T df06af11cae7484d969017fcb5b7e753 P 18435fbb525741328139e84a1e354954 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:08:52.321599 18300 raft_consensus.cc:2272] T df06af11cae7484d969017fcb5b7e753 P 18435fbb525741328139e84a1e354954 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:52.324061 18300 tablet_replica.cc:333] T afcb3b39d1c9495eab95404687865537 P 18435fbb525741328139e84a1e354954: stopping tablet replica
I20260709 13:08:52.324856 18300 raft_consensus.cc:2243] T afcb3b39d1c9495eab95404687865537 P 18435fbb525741328139e84a1e354954 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:52.325368 18300 raft_consensus.cc:2272] T afcb3b39d1c9495eab95404687865537 P 18435fbb525741328139e84a1e354954 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:52.327916 18300 tablet_replica.cc:333] T d0c8b4ec2d844a89b4bb66c0f1bf2c8f P 18435fbb525741328139e84a1e354954: stopping tablet replica
I20260709 13:08:52.328617 18300 raft_consensus.cc:2243] T d0c8b4ec2d844a89b4bb66c0f1bf2c8f P 18435fbb525741328139e84a1e354954 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:52.329052 18300 raft_consensus.cc:2272] T d0c8b4ec2d844a89b4bb66c0f1bf2c8f P 18435fbb525741328139e84a1e354954 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:52.331120 18300 tablet_replica.cc:333] T 78e19c035a854ee98657bec3edcb3585 P 18435fbb525741328139e84a1e354954: stopping tablet replica
I20260709 13:08:52.331717 18300 raft_consensus.cc:2243] T 78e19c035a854ee98657bec3edcb3585 P 18435fbb525741328139e84a1e354954 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:52.332180 18300 raft_consensus.cc:2272] T 78e19c035a854ee98657bec3edcb3585 P 18435fbb525741328139e84a1e354954 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:52.334120 18300 tablet_replica.cc:333] T a9eac7f072de454a8ff2beb019da45d9 P 18435fbb525741328139e84a1e354954: stopping tablet replica
I20260709 13:08:52.334657 18300 raft_consensus.cc:2243] T a9eac7f072de454a8ff2beb019da45d9 P 18435fbb525741328139e84a1e354954 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:52.335153 18300 raft_consensus.cc:2272] T a9eac7f072de454a8ff2beb019da45d9 P 18435fbb525741328139e84a1e354954 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:52.336946 18300 tablet_replica.cc:333] T 56803a5c0dea4efeabafb6829d9215cd P 18435fbb525741328139e84a1e354954: stopping tablet replica
I20260709 13:08:52.337481 18300 raft_consensus.cc:2243] T 56803a5c0dea4efeabafb6829d9215cd P 18435fbb525741328139e84a1e354954 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:08:52.338264 18300 raft_consensus.cc:2272] T 56803a5c0dea4efeabafb6829d9215cd P 18435fbb525741328139e84a1e354954 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:52.340330 18300 tablet_replica.cc:333] T de531c50b1524ec788b27bc4b883689a P 18435fbb525741328139e84a1e354954: stopping tablet replica
I20260709 13:08:52.340881 18300 raft_consensus.cc:2243] T de531c50b1524ec788b27bc4b883689a P 18435fbb525741328139e84a1e354954 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:52.341306 18300 raft_consensus.cc:2272] T de531c50b1524ec788b27bc4b883689a P 18435fbb525741328139e84a1e354954 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:52.343092 18300 tablet_replica.cc:333] T 11224ef6c00a40cdba4311ceb63bddb9 P 18435fbb525741328139e84a1e354954: stopping tablet replica
I20260709 13:08:52.343602 18300 raft_consensus.cc:2243] T 11224ef6c00a40cdba4311ceb63bddb9 P 18435fbb525741328139e84a1e354954 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:08:52.344352 18300 raft_consensus.cc:2272] T 11224ef6c00a40cdba4311ceb63bddb9 P 18435fbb525741328139e84a1e354954 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:52.346130 18300 tablet_replica.cc:333] T 64490a86db8c4f5ca54f4f8085f41319 P 18435fbb525741328139e84a1e354954: stopping tablet replica
I20260709 13:08:52.346606 18300 raft_consensus.cc:2243] T 64490a86db8c4f5ca54f4f8085f41319 P 18435fbb525741328139e84a1e354954 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:08:52.347324 18300 raft_consensus.cc:2272] T 64490a86db8c4f5ca54f4f8085f41319 P 18435fbb525741328139e84a1e354954 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:52.349337 18300 tablet_replica.cc:333] T 55a3afc21cea43ea85f4a2155552422d P 18435fbb525741328139e84a1e354954: stopping tablet replica
I20260709 13:08:52.349855 18300 raft_consensus.cc:2243] T 55a3afc21cea43ea85f4a2155552422d P 18435fbb525741328139e84a1e354954 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:08:52.350540 18300 raft_consensus.cc:2272] T 55a3afc21cea43ea85f4a2155552422d P 18435fbb525741328139e84a1e354954 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:52.352332 18300 tablet_replica.cc:333] T bc0b10615ecb4485a9a9de298938697d P 18435fbb525741328139e84a1e354954: stopping tablet replica
I20260709 13:08:52.352839 18300 raft_consensus.cc:2243] T bc0b10615ecb4485a9a9de298938697d P 18435fbb525741328139e84a1e354954 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:08:52.353544 18300 raft_consensus.cc:2272] T bc0b10615ecb4485a9a9de298938697d P 18435fbb525741328139e84a1e354954 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:52.355419 18300 tablet_replica.cc:333] T 18f991bbbf3a4615aab49899c7ef86dc P 18435fbb525741328139e84a1e354954: stopping tablet replica
I20260709 13:08:52.355919 18300 raft_consensus.cc:2243] T 18f991bbbf3a4615aab49899c7ef86dc P 18435fbb525741328139e84a1e354954 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:52.356317 18300 raft_consensus.cc:2272] T 18f991bbbf3a4615aab49899c7ef86dc P 18435fbb525741328139e84a1e354954 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:52.358069 18300 tablet_replica.cc:333] T e9b149d77d9941158ead8e9e592e7b27 P 18435fbb525741328139e84a1e354954: stopping tablet replica
I20260709 13:08:52.358562 18300 raft_consensus.cc:2243] T e9b149d77d9941158ead8e9e592e7b27 P 18435fbb525741328139e84a1e354954 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:08:52.359364 18300 raft_consensus.cc:2272] T e9b149d77d9941158ead8e9e592e7b27 P 18435fbb525741328139e84a1e354954 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:52.361093 18300 tablet_replica.cc:333] T 1d9bdb76a5094186b5ac6c8f8e1c9840 P 18435fbb525741328139e84a1e354954: stopping tablet replica
I20260709 13:08:52.361547 18300 raft_consensus.cc:2243] T 1d9bdb76a5094186b5ac6c8f8e1c9840 P 18435fbb525741328139e84a1e354954 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:08:52.362236 18300 raft_consensus.cc:2272] T 1d9bdb76a5094186b5ac6c8f8e1c9840 P 18435fbb525741328139e84a1e354954 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:52.363955 18300 tablet_replica.cc:333] T fc84b896d2ae4581bc236b96d5de9de3 P 18435fbb525741328139e84a1e354954: stopping tablet replica
I20260709 13:08:52.364429 18300 raft_consensus.cc:2243] T fc84b896d2ae4581bc236b96d5de9de3 P 18435fbb525741328139e84a1e354954 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:52.364825 18300 raft_consensus.cc:2272] T fc84b896d2ae4581bc236b96d5de9de3 P 18435fbb525741328139e84a1e354954 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:52.366528 18300 tablet_replica.cc:333] T 2d68b1be563949efbcb4bbe71eddd0d8 P 18435fbb525741328139e84a1e354954: stopping tablet replica
I20260709 13:08:52.367010 18300 raft_consensus.cc:2243] T 2d68b1be563949efbcb4bbe71eddd0d8 P 18435fbb525741328139e84a1e354954 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:52.367365 18300 raft_consensus.cc:2272] T 2d68b1be563949efbcb4bbe71eddd0d8 P 18435fbb525741328139e84a1e354954 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:52.369027 18300 tablet_replica.cc:333] T e5847d81a5284a44a6b2b21cf6f4351c P 18435fbb525741328139e84a1e354954: stopping tablet replica
I20260709 13:08:52.369431 18300 raft_consensus.cc:2243] T e5847d81a5284a44a6b2b21cf6f4351c P 18435fbb525741328139e84a1e354954 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:08:52.370162 18300 raft_consensus.cc:2272] T e5847d81a5284a44a6b2b21cf6f4351c P 18435fbb525741328139e84a1e354954 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:52.372116 18300 tablet_replica.cc:333] T 9ac520b68b79484990a8725d6549174e P 18435fbb525741328139e84a1e354954: stopping tablet replica
I20260709 13:08:52.372512 18300 raft_consensus.cc:2243] T 9ac520b68b79484990a8725d6549174e P 18435fbb525741328139e84a1e354954 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:52.372851 18300 raft_consensus.cc:2272] T 9ac520b68b79484990a8725d6549174e P 18435fbb525741328139e84a1e354954 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:52.441478 18300 tablet_server.cc:196] TabletServer@127.17.223.4:0 shutdown complete.
I20260709 13:08:52.501284 18300 master.cc:562] Master@127.17.223.62:40677 shutting down...
I20260709 13:08:52.525332 18300 raft_consensus.cc:2243] T 00000000000000000000000000000000 P dee8111901394f00bf3594b0450fcadb [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:08:52.525960 18300 raft_consensus.cc:2272] T 00000000000000000000000000000000 P dee8111901394f00bf3594b0450fcadb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:52.526335 18300 tablet_replica.cc:333] T 00000000000000000000000000000000 P dee8111901394f00bf3594b0450fcadb: stopping tablet replica
I20260709 13:08:52.548195 18300 master.cc:584] Master@127.17.223.62:40677 shutdown complete.
[       OK ] LeaderRebalancerTest.RestartTserver (35855 ms)
[ RUN      ] LeaderRebalancerTest.TestMaintenanceMode
I20260709 13:08:52.658092 18300 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.17.223.62:35571
I20260709 13:08:52.659497 18300 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:08:52.665856 28773 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:08:52.665982 28772 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:08:52.666184 28775 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:08:52.667611 18300 server_base.cc:1061] running on GCE node
I20260709 13:08:52.668841 18300 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:08:52.669020 18300 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:08:52.669217 18300 hybrid_clock.cc:648] HybridClock initialized: now 1783602532669186 us; error 0 us; skew 500 ppm
I20260709 13:08:52.669785 18300 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:08:52.672431 18300 webserver.cc:533] Webserver started at http://127.17.223.62:39233/ using document root <none> and password file <none>
I20260709 13:08:52.673005 18300 fs_manager.cc:362] Metadata directory not provided
I20260709 13:08:52.673219 18300 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:08:52.673533 18300 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:08:52.674886 18300 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskKd2k48/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602220613947-18300-0/minicluster-data/master-0-root/instance:
uuid: "1601ddfd353d4cc3823bd78b5353aa5c"
format_stamp: "Formatted at 2026-07-09 13:08:52 on dist-test-slave-vl1s"
I20260709 13:08:52.679754 18300 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.004s	sys 0.000s
I20260709 13:08:52.683295 28780 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:08:52.684237 18300 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.001s
I20260709 13:08:52.684504 18300 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskKd2k48/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602220613947-18300-0/minicluster-data/master-0-root
uuid: "1601ddfd353d4cc3823bd78b5353aa5c"
format_stamp: "Formatted at 2026-07-09 13:08:52 on dist-test-slave-vl1s"
I20260709 13:08:52.684801 18300 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskKd2k48/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602220613947-18300-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskKd2k48/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602220613947-18300-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskKd2k48/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602220613947-18300-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:08:52.721160 18300 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:08:52.722349 18300 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:08:52.763391 18300 rpc_server.cc:307] RPC server started. Bound to: 127.17.223.62:35571
I20260709 13:08:52.763507 28831 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.17.223.62:35571 every 8 connection(s)
I20260709 13:08:52.767237 28832 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:52.777988 28832 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1601ddfd353d4cc3823bd78b5353aa5c: Bootstrap starting.
I20260709 13:08:52.782992 28832 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 1601ddfd353d4cc3823bd78b5353aa5c: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:52.787570 28832 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1601ddfd353d4cc3823bd78b5353aa5c: No bootstrap required, opened a new log
I20260709 13:08:52.789790 28832 raft_consensus.cc:359] T 00000000000000000000000000000000 P 1601ddfd353d4cc3823bd78b5353aa5c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1601ddfd353d4cc3823bd78b5353aa5c" member_type: VOTER }
I20260709 13:08:52.790210 28832 raft_consensus.cc:385] T 00000000000000000000000000000000 P 1601ddfd353d4cc3823bd78b5353aa5c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:52.790431 28832 raft_consensus.cc:740] T 00000000000000000000000000000000 P 1601ddfd353d4cc3823bd78b5353aa5c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1601ddfd353d4cc3823bd78b5353aa5c, State: Initialized, Role: FOLLOWER
I20260709 13:08:52.791090 28832 consensus_queue.cc:260] T 00000000000000000000000000000000 P 1601ddfd353d4cc3823bd78b5353aa5c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1601ddfd353d4cc3823bd78b5353aa5c" member_type: VOTER }
I20260709 13:08:52.791536 28832 raft_consensus.cc:399] T 00000000000000000000000000000000 P 1601ddfd353d4cc3823bd78b5353aa5c [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 13:08:52.791738 28832 raft_consensus.cc:493] T 00000000000000000000000000000000 P 1601ddfd353d4cc3823bd78b5353aa5c [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 13:08:52.792004 28832 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 1601ddfd353d4cc3823bd78b5353aa5c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:52.796641 28832 raft_consensus.cc:515] T 00000000000000000000000000000000 P 1601ddfd353d4cc3823bd78b5353aa5c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1601ddfd353d4cc3823bd78b5353aa5c" member_type: VOTER }
I20260709 13:08:52.797171 28832 leader_election.cc:304] T 00000000000000000000000000000000 P 1601ddfd353d4cc3823bd78b5353aa5c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 1601ddfd353d4cc3823bd78b5353aa5c; no voters: 
I20260709 13:08:52.798300 28832 leader_election.cc:290] T 00000000000000000000000000000000 P 1601ddfd353d4cc3823bd78b5353aa5c [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 13:08:52.798864 28835 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 1601ddfd353d4cc3823bd78b5353aa5c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:08:52.800516 28835 raft_consensus.cc:697] T 00000000000000000000000000000000 P 1601ddfd353d4cc3823bd78b5353aa5c [term 1 LEADER]: Becoming Leader. State: Replica: 1601ddfd353d4cc3823bd78b5353aa5c, State: Running, Role: LEADER
I20260709 13:08:52.801287 28835 consensus_queue.cc:237] T 00000000000000000000000000000000 P 1601ddfd353d4cc3823bd78b5353aa5c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1601ddfd353d4cc3823bd78b5353aa5c" member_type: VOTER }
I20260709 13:08:52.801918 28832 sys_catalog.cc:565] T 00000000000000000000000000000000 P 1601ddfd353d4cc3823bd78b5353aa5c [sys.catalog]: configured and running, proceeding with master startup.
I20260709 13:08:52.806294 28836 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1601ddfd353d4cc3823bd78b5353aa5c [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "1601ddfd353d4cc3823bd78b5353aa5c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1601ddfd353d4cc3823bd78b5353aa5c" member_type: VOTER } }
I20260709 13:08:52.807593 28836 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1601ddfd353d4cc3823bd78b5353aa5c [sys.catalog]: This master's current role is: LEADER
I20260709 13:08:52.806432 28837 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1601ddfd353d4cc3823bd78b5353aa5c [sys.catalog]: SysCatalogTable state changed. Reason: New leader 1601ddfd353d4cc3823bd78b5353aa5c. Latest consensus state: current_term: 1 leader_uuid: "1601ddfd353d4cc3823bd78b5353aa5c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1601ddfd353d4cc3823bd78b5353aa5c" member_type: VOTER } }
I20260709 13:08:52.809316 28837 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1601ddfd353d4cc3823bd78b5353aa5c [sys.catalog]: This master's current role is: LEADER
I20260709 13:08:52.813217 28841 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 13:08:52.818432 28841 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 13:08:52.822727 18300 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 13:08:52.827158 28841 catalog_manager.cc:1383] Generated new cluster ID: c03f5c33fb4e4d92ac99d39eb61049e6
I20260709 13:08:52.827498 28841 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 13:08:52.863307 28841 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 13:08:52.864615 28841 catalog_manager.cc:1540] Loading token signing keys...
I20260709 13:08:52.882202 28841 catalog_manager.cc:6070] T 00000000000000000000000000000000 P 1601ddfd353d4cc3823bd78b5353aa5c: Generated new TSK 0
I20260709 13:08:52.882915 28841 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 13:08:52.889175 18300 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:08:52.895499 28853 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:08:52.896471 28854 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:08:52.898702 18300 server_base.cc:1061] running on GCE node
W20260709 13:08:52.898895 28856 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:08:52.899922 18300 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:08:52.900141 18300 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:08:52.900342 18300 hybrid_clock.cc:648] HybridClock initialized: now 1783602532900322 us; error 0 us; skew 500 ppm
I20260709 13:08:52.900911 18300 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:08:52.903535 18300 webserver.cc:533] Webserver started at http://127.17.223.1:46733/ using document root <none> and password file <none>
I20260709 13:08:52.904062 18300 fs_manager.cc:362] Metadata directory not provided
I20260709 13:08:52.904268 18300 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:08:52.904531 18300 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:08:52.905592 18300 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskKd2k48/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602220613947-18300-0/minicluster-data/ts-0-root/instance:
uuid: "0284f1db8c204657b7b423bab5b2eb4f"
format_stamp: "Formatted at 2026-07-09 13:08:52 on dist-test-slave-vl1s"
I20260709 13:08:52.910331 18300 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.003s	sys 0.004s
I20260709 13:08:52.913722 28861 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:08:52.914499 18300 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260709 13:08:52.914837 18300 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskKd2k48/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602220613947-18300-0/minicluster-data/ts-0-root
uuid: "0284f1db8c204657b7b423bab5b2eb4f"
format_stamp: "Formatted at 2026-07-09 13:08:52 on dist-test-slave-vl1s"
I20260709 13:08:52.915113 18300 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskKd2k48/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602220613947-18300-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskKd2k48/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602220613947-18300-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskKd2k48/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602220613947-18300-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:08:52.932051 18300 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:08:52.933243 18300 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:08:52.934662 18300 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:08:52.937019 18300 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:08:52.937222 18300 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:08:52.937476 18300 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:08:52.937635 18300 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:08:52.978488 18300 rpc_server.cc:307] RPC server started. Bound to: 127.17.223.1:39279
I20260709 13:08:52.978587 28923 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.17.223.1:39279 every 8 connection(s)
I20260709 13:08:52.983541 18300 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:08:52.990620 28928 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:08:52.993266 28929 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:08:52.994139 28931 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:08:52.994604 18300 server_base.cc:1061] running on GCE node
I20260709 13:08:52.995761 18300 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:08:52.995944 18300 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:08:52.996066 18300 hybrid_clock.cc:648] HybridClock initialized: now 1783602532996055 us; error 0 us; skew 500 ppm
I20260709 13:08:52.996522 18300 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:08:52.999539 18300 webserver.cc:533] Webserver started at http://127.17.223.2:33823/ using document root <none> and password file <none>
I20260709 13:08:53.000180 18300 fs_manager.cc:362] Metadata directory not provided
I20260709 13:08:53.000401 18300 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:08:53.000691 18300 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:08:53.000941 28924 heartbeater.cc:344] Connected to a master server at 127.17.223.62:35571
I20260709 13:08:53.001376 28924 heartbeater.cc:461] Registering TS with master...
I20260709 13:08:53.001915 18300 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskKd2k48/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602220613947-18300-0/minicluster-data/ts-1-root/instance:
uuid: "ee4d8c8df06e4c04ad53ac25013d8a78"
format_stamp: "Formatted at 2026-07-09 13:08:52 on dist-test-slave-vl1s"
I20260709 13:08:53.002087 28924 heartbeater.cc:507] Master 127.17.223.62:35571 requested a full tablet report, sending...
I20260709 13:08:53.004297 28797 ts_manager.cc:194] Registered new tserver with Master: 0284f1db8c204657b7b423bab5b2eb4f (127.17.223.1:39279)
I20260709 13:08:53.006134 28797 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:38592
I20260709 13:08:53.008093 18300 fs_manager.cc:696] Time spent creating directory manager: real 0.006s	user 0.000s	sys 0.007s
I20260709 13:08:53.011938 28936 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:08:53.012741 18300 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.001s
I20260709 13:08:53.013000 18300 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskKd2k48/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602220613947-18300-0/minicluster-data/ts-1-root
uuid: "ee4d8c8df06e4c04ad53ac25013d8a78"
format_stamp: "Formatted at 2026-07-09 13:08:52 on dist-test-slave-vl1s"
I20260709 13:08:53.013247 18300 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskKd2k48/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602220613947-18300-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskKd2k48/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602220613947-18300-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskKd2k48/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602220613947-18300-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:08:53.050841 18300 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:08:53.051992 18300 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:08:53.053334 18300 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:08:53.055526 18300 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:08:53.055740 18300 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:08:53.055992 18300 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:08:53.056137 18300 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:08:53.099406 18300 rpc_server.cc:307] RPC server started. Bound to: 127.17.223.2:41821
I20260709 13:08:53.099596 28998 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.17.223.2:41821 every 8 connection(s)
I20260709 13:08:53.104441 18300 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:08:53.112375 29003 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:08:53.112505 29002 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:08:53.116871 18300 server_base.cc:1061] running on GCE node
I20260709 13:08:53.118135 28999 heartbeater.cc:344] Connected to a master server at 127.17.223.62:35571
I20260709 13:08:53.118623 28999 heartbeater.cc:461] Registering TS with master...
W20260709 13:08:53.118547 29005 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:08:53.119781 18300 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
I20260709 13:08:53.119818 28999 heartbeater.cc:507] Master 127.17.223.62:35571 requested a full tablet report, sending...
W20260709 13:08:53.120041 18300 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:08:53.120298 18300 hybrid_clock.cc:648] HybridClock initialized: now 1783602533120282 us; error 0 us; skew 500 ppm
I20260709 13:08:53.121169 18300 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:08:53.122156 28797 ts_manager.cc:194] Registered new tserver with Master: ee4d8c8df06e4c04ad53ac25013d8a78 (127.17.223.2:41821)
I20260709 13:08:53.123764 28797 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:38594
I20260709 13:08:53.124114 18300 webserver.cc:533] Webserver started at http://127.17.223.3:37647/ using document root <none> and password file <none>
I20260709 13:08:53.124748 18300 fs_manager.cc:362] Metadata directory not provided
I20260709 13:08:53.125012 18300 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:08:53.125281 18300 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:08:53.126411 18300 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskKd2k48/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602220613947-18300-0/minicluster-data/ts-2-root/instance:
uuid: "e3fc42b9680245f3b66db70446830a2f"
format_stamp: "Formatted at 2026-07-09 13:08:53 on dist-test-slave-vl1s"
I20260709 13:08:53.131313 18300 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.004s	sys 0.000s
I20260709 13:08:53.134827 29010 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:08:53.135703 18300 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.001s
I20260709 13:08:53.136046 18300 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskKd2k48/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602220613947-18300-0/minicluster-data/ts-2-root
uuid: "e3fc42b9680245f3b66db70446830a2f"
format_stamp: "Formatted at 2026-07-09 13:08:53 on dist-test-slave-vl1s"
I20260709 13:08:53.136337 18300 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskKd2k48/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602220613947-18300-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskKd2k48/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602220613947-18300-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskKd2k48/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602220613947-18300-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:08:53.152364 18300 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:08:53.153594 18300 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:08:53.155143 18300 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:08:53.157491 18300 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:08:53.157691 18300 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:08:53.157985 18300 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:08:53.158131 18300 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:08:53.199381 18300 rpc_server.cc:307] RPC server started. Bound to: 127.17.223.3:39203
I20260709 13:08:53.199487 29072 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.17.223.3:39203 every 8 connection(s)
I20260709 13:08:53.213378 29073 heartbeater.cc:344] Connected to a master server at 127.17.223.62:35571
I20260709 13:08:53.213869 29073 heartbeater.cc:461] Registering TS with master...
I20260709 13:08:53.214550 29073 heartbeater.cc:507] Master 127.17.223.62:35571 requested a full tablet report, sending...
I20260709 13:08:53.216917 28797 ts_manager.cc:194] Registered new tserver with Master: e3fc42b9680245f3b66db70446830a2f (127.17.223.3:39203)
I20260709 13:08:53.217476 18300 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.014990854s
I20260709 13:08:53.218323 28797 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:38608
I20260709 13:08:53.244267 28797 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:38616:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\314\314\314\014\004\001\000\230\231\231\031\004\001\000dff&\004\001\0000333\004\001\000\374\377\377?\004\001\000\310\314\314L\004\001\000\224\231\231Y\004\001\000`fff\004\001\000,33s""\004\001\000\314\314\314\014\004\001\000\230\231\231\031\004\001\000dff&\004\001\0000333\004\001\000\374\377\377?\004\001\000\310\314\314L\004\001\000\224\231\231Y\004\001\000`fff\004\001\000,33s"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:08:53.247267 28797 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:08:53.347056 28964 tablet_service.cc:1511] Processing CreateTablet for tablet 2b38eb974fe54bb6a799876978d3ba4c (DEFAULT_TABLE table=test-workload [id=7d80cccba607419aae77352a0bf3f4e9]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 13:08:53.348626 28963 tablet_service.cc:1511] Processing CreateTablet for tablet eb8f9bf7e0d24af88a04bda489298395 (DEFAULT_TABLE table=test-workload [id=7d80cccba607419aae77352a0bf3f4e9]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 13:08:53.349917 28961 tablet_service.cc:1511] Processing CreateTablet for tablet 777f2e0112c34108b367c8a2ad2641e1 (DEFAULT_TABLE table=test-workload [id=7d80cccba607419aae77352a0bf3f4e9]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 13:08:53.351011 28962 tablet_service.cc:1511] Processing CreateTablet for tablet 879bbeb7e3244e8a8e5ee375c020cb16 (DEFAULT_TABLE table=test-workload [id=7d80cccba607419aae77352a0bf3f4e9]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 13:08:53.352052 28960 tablet_service.cc:1511] Processing CreateTablet for tablet 9f5d8f2d6f684a5b9702935fc8fd85a1 (DEFAULT_TABLE table=test-workload [id=7d80cccba607419aae77352a0bf3f4e9]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 13:08:53.352339 29038 tablet_service.cc:1511] Processing CreateTablet for tablet 2b38eb974fe54bb6a799876978d3ba4c (DEFAULT_TABLE table=test-workload [id=7d80cccba607419aae77352a0bf3f4e9]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 13:08:53.354301 29038 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2b38eb974fe54bb6a799876978d3ba4c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:53.355751 28964 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2b38eb974fe54bb6a799876978d3ba4c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:53.369822 29034 tablet_service.cc:1511] Processing CreateTablet for tablet 9f5d8f2d6f684a5b9702935fc8fd85a1 (DEFAULT_TABLE table=test-workload [id=7d80cccba607419aae77352a0bf3f4e9]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 13:08:53.369998 29036 tablet_service.cc:1511] Processing CreateTablet for tablet 879bbeb7e3244e8a8e5ee375c020cb16 (DEFAULT_TABLE table=test-workload [id=7d80cccba607419aae77352a0bf3f4e9]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 13:08:53.370198 29035 tablet_service.cc:1511] Processing CreateTablet for tablet 777f2e0112c34108b367c8a2ad2641e1 (DEFAULT_TABLE table=test-workload [id=7d80cccba607419aae77352a0bf3f4e9]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 13:08:53.371379 29034 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9f5d8f2d6f684a5b9702935fc8fd85a1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:53.371933 29036 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 879bbeb7e3244e8a8e5ee375c020cb16. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:53.372696 29035 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 777f2e0112c34108b367c8a2ad2641e1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:53.371407 28960 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9f5d8f2d6f684a5b9702935fc8fd85a1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:53.367274 29037 tablet_service.cc:1511] Processing CreateTablet for tablet eb8f9bf7e0d24af88a04bda489298395 (DEFAULT_TABLE table=test-workload [id=7d80cccba607419aae77352a0bf3f4e9]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 13:08:53.375217 28962 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 879bbeb7e3244e8a8e5ee375c020cb16. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:53.375676 29037 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet eb8f9bf7e0d24af88a04bda489298395. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:53.378257 28961 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 777f2e0112c34108b367c8a2ad2641e1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:53.382302 28959 tablet_service.cc:1511] Processing CreateTablet for tablet 451e3f8929ef4287a9eaa8941486e9cc (DEFAULT_TABLE table=test-workload [id=7d80cccba607419aae77352a0bf3f4e9]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 13:08:53.383864 28959 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 451e3f8929ef4287a9eaa8941486e9cc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:53.412187 28963 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet eb8f9bf7e0d24af88a04bda489298395. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:53.412483 28889 tablet_service.cc:1511] Processing CreateTablet for tablet 2b38eb974fe54bb6a799876978d3ba4c (DEFAULT_TABLE table=test-workload [id=7d80cccba607419aae77352a0bf3f4e9]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 13:08:53.424094 28888 tablet_service.cc:1511] Processing CreateTablet for tablet eb8f9bf7e0d24af88a04bda489298395 (DEFAULT_TABLE table=test-workload [id=7d80cccba607419aae77352a0bf3f4e9]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 13:08:53.425048 28887 tablet_service.cc:1511] Processing CreateTablet for tablet 879bbeb7e3244e8a8e5ee375c020cb16 (DEFAULT_TABLE table=test-workload [id=7d80cccba607419aae77352a0bf3f4e9]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 13:08:53.426096 29032 tablet_service.cc:1511] Processing CreateTablet for tablet 7087f0eae49f4f71b5769071b817f8f2 (DEFAULT_TABLE table=test-workload [id=7d80cccba607419aae77352a0bf3f4e9]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 13:08:53.428076 29032 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7087f0eae49f4f71b5769071b817f8f2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:53.429486 28957 tablet_service.cc:1511] Processing CreateTablet for tablet 4b9944472adf4cec929d98a95851bef9 (DEFAULT_TABLE table=test-workload [id=7d80cccba607419aae77352a0bf3f4e9]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 13:08:53.430786 28884 tablet_service.cc:1511] Processing CreateTablet for tablet 451e3f8929ef4287a9eaa8941486e9cc (DEFAULT_TABLE table=test-workload [id=7d80cccba607419aae77352a0bf3f4e9]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 13:08:53.431275 29033 tablet_service.cc:1511] Processing CreateTablet for tablet 451e3f8929ef4287a9eaa8941486e9cc (DEFAULT_TABLE table=test-workload [id=7d80cccba607419aae77352a0bf3f4e9]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 13:08:53.429569 28883 tablet_service.cc:1511] Processing CreateTablet for tablet 7087f0eae49f4f71b5769071b817f8f2 (DEFAULT_TABLE table=test-workload [id=7d80cccba607419aae77352a0bf3f4e9]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 13:08:53.432632 29033 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 451e3f8929ef4287a9eaa8941486e9cc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:53.432107 28886 tablet_service.cc:1511] Processing CreateTablet for tablet 777f2e0112c34108b367c8a2ad2641e1 (DEFAULT_TABLE table=test-workload [id=7d80cccba607419aae77352a0bf3f4e9]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 13:08:53.427824 28885 tablet_service.cc:1511] Processing CreateTablet for tablet 9f5d8f2d6f684a5b9702935fc8fd85a1 (DEFAULT_TABLE table=test-workload [id=7d80cccba607419aae77352a0bf3f4e9]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 13:08:53.433531 28889 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2b38eb974fe54bb6a799876978d3ba4c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:53.427724 28958 tablet_service.cc:1511] Processing CreateTablet for tablet 7087f0eae49f4f71b5769071b817f8f2 (DEFAULT_TABLE table=test-workload [id=7d80cccba607419aae77352a0bf3f4e9]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 13:08:53.435148 28882 tablet_service.cc:1511] Processing CreateTablet for tablet 4b9944472adf4cec929d98a95851bef9 (DEFAULT_TABLE table=test-workload [id=7d80cccba607419aae77352a0bf3f4e9]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 13:08:53.435964 28887 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 879bbeb7e3244e8a8e5ee375c020cb16. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:53.436578 28886 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 777f2e0112c34108b367c8a2ad2641e1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:53.438261 28888 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet eb8f9bf7e0d24af88a04bda489298395. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:53.443003 28957 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4b9944472adf4cec929d98a95851bef9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:53.443452 28882 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4b9944472adf4cec929d98a95851bef9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:53.447053 28958 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7087f0eae49f4f71b5769071b817f8f2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:53.447057 28884 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 451e3f8929ef4287a9eaa8941486e9cc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:53.458726 28885 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9f5d8f2d6f684a5b9702935fc8fd85a1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:53.459492 28883 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7087f0eae49f4f71b5769071b817f8f2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:53.469187 28881 tablet_service.cc:1511] Processing CreateTablet for tablet 0dfbae90dbc4407a9e01872b7d688d55 (DEFAULT_TABLE table=test-workload [id=7d80cccba607419aae77352a0bf3f4e9]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 13:08:53.470765 29087 tablet_bootstrap.cc:492] T 879bbeb7e3244e8a8e5ee375c020cb16 P ee4d8c8df06e4c04ad53ac25013d8a78: Bootstrap starting.
I20260709 13:08:53.470974 28881 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0dfbae90dbc4407a9e01872b7d688d55. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:53.469148 29034 tablet_service.cc:1511] Processing CreateTablet for tablet 4b9944472adf4cec929d98a95851bef9 (DEFAULT_TABLE table=test-workload [id=7d80cccba607419aae77352a0bf3f4e9]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 13:08:53.472971 29034 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4b9944472adf4cec929d98a95851bef9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:53.491600 29088 tablet_bootstrap.cc:492] T 2b38eb974fe54bb6a799876978d3ba4c P e3fc42b9680245f3b66db70446830a2f: Bootstrap starting.
I20260709 13:08:53.527688 29087 tablet_bootstrap.cc:654] T 879bbeb7e3244e8a8e5ee375c020cb16 P ee4d8c8df06e4c04ad53ac25013d8a78: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:53.529244 28963 tablet_service.cc:1511] Processing CreateTablet for tablet 0dfbae90dbc4407a9e01872b7d688d55 (DEFAULT_TABLE table=test-workload [id=7d80cccba607419aae77352a0bf3f4e9]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 13:08:53.530651 28963 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0dfbae90dbc4407a9e01872b7d688d55. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:53.553927 29089 tablet_bootstrap.cc:492] T 879bbeb7e3244e8a8e5ee375c020cb16 P 0284f1db8c204657b7b423bab5b2eb4f: Bootstrap starting.
I20260709 13:08:53.561075 29087 tablet_bootstrap.cc:492] T 879bbeb7e3244e8a8e5ee375c020cb16 P ee4d8c8df06e4c04ad53ac25013d8a78: No bootstrap required, opened a new log
I20260709 13:08:53.561708 29087 ts_tablet_manager.cc:1403] T 879bbeb7e3244e8a8e5ee375c020cb16 P ee4d8c8df06e4c04ad53ac25013d8a78: Time spent bootstrapping tablet: real 0.091s	user 0.009s	sys 0.006s
I20260709 13:08:53.561847 29089 tablet_bootstrap.cc:654] T 879bbeb7e3244e8a8e5ee375c020cb16 P 0284f1db8c204657b7b423bab5b2eb4f: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:53.569521 29088 tablet_bootstrap.cc:654] T 2b38eb974fe54bb6a799876978d3ba4c P e3fc42b9680245f3b66db70446830a2f: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:53.571933 29089 tablet_bootstrap.cc:492] T 879bbeb7e3244e8a8e5ee375c020cb16 P 0284f1db8c204657b7b423bab5b2eb4f: No bootstrap required, opened a new log
I20260709 13:08:53.572404 29089 ts_tablet_manager.cc:1403] T 879bbeb7e3244e8a8e5ee375c020cb16 P 0284f1db8c204657b7b423bab5b2eb4f: Time spent bootstrapping tablet: real 0.019s	user 0.012s	sys 0.000s
I20260709 13:08:53.574604 29089 raft_consensus.cc:359] T 879bbeb7e3244e8a8e5ee375c020cb16 P 0284f1db8c204657b7b423bab5b2eb4f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0284f1db8c204657b7b423bab5b2eb4f" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 39279 } } peers { permanent_uuid: "ee4d8c8df06e4c04ad53ac25013d8a78" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 41821 } } peers { permanent_uuid: "e3fc42b9680245f3b66db70446830a2f" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 39203 } }
I20260709 13:08:53.575323 29089 raft_consensus.cc:385] T 879bbeb7e3244e8a8e5ee375c020cb16 P 0284f1db8c204657b7b423bab5b2eb4f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:53.575619 29089 raft_consensus.cc:740] T 879bbeb7e3244e8a8e5ee375c020cb16 P 0284f1db8c204657b7b423bab5b2eb4f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0284f1db8c204657b7b423bab5b2eb4f, State: Initialized, Role: FOLLOWER
I20260709 13:08:53.576290 29089 consensus_queue.cc:260] T 879bbeb7e3244e8a8e5ee375c020cb16 P 0284f1db8c204657b7b423bab5b2eb4f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0284f1db8c204657b7b423bab5b2eb4f" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 39279 } } peers { permanent_uuid: "ee4d8c8df06e4c04ad53ac25013d8a78" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 41821 } } peers { permanent_uuid: "e3fc42b9680245f3b66db70446830a2f" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 39203 } }
I20260709 13:08:53.576445 29033 tablet_service.cc:1511] Processing CreateTablet for tablet 0dfbae90dbc4407a9e01872b7d688d55 (DEFAULT_TABLE table=test-workload [id=7d80cccba607419aae77352a0bf3f4e9]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 13:08:53.577904 29033 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0dfbae90dbc4407a9e01872b7d688d55. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:53.577448 29087 raft_consensus.cc:359] T 879bbeb7e3244e8a8e5ee375c020cb16 P ee4d8c8df06e4c04ad53ac25013d8a78 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0284f1db8c204657b7b423bab5b2eb4f" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 39279 } } peers { permanent_uuid: "ee4d8c8df06e4c04ad53ac25013d8a78" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 41821 } } peers { permanent_uuid: "e3fc42b9680245f3b66db70446830a2f" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 39203 } }
I20260709 13:08:53.578842 29087 raft_consensus.cc:385] T 879bbeb7e3244e8a8e5ee375c020cb16 P ee4d8c8df06e4c04ad53ac25013d8a78 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:53.579211 29087 raft_consensus.cc:740] T 879bbeb7e3244e8a8e5ee375c020cb16 P ee4d8c8df06e4c04ad53ac25013d8a78 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ee4d8c8df06e4c04ad53ac25013d8a78, State: Initialized, Role: FOLLOWER
I20260709 13:08:53.580245 28963 tablet_service.cc:1511] Processing CreateTablet for tablet 5d6b9266d4e74616b08d4e9697a83924 (DEFAULT_TABLE table=test-workload [id=7d80cccba607419aae77352a0bf3f4e9]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 13:08:53.580760 29032 tablet_service.cc:1511] Processing CreateTablet for tablet 5d6b9266d4e74616b08d4e9697a83924 (DEFAULT_TABLE table=test-workload [id=7d80cccba607419aae77352a0bf3f4e9]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 13:08:53.581827 28963 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5d6b9266d4e74616b08d4e9697a83924. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:53.582046 29032 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5d6b9266d4e74616b08d4e9697a83924. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:53.584828 28887 tablet_service.cc:1511] Processing CreateTablet for tablet 5d6b9266d4e74616b08d4e9697a83924 (DEFAULT_TABLE table=test-workload [id=7d80cccba607419aae77352a0bf3f4e9]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 13:08:53.586079 28887 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5d6b9266d4e74616b08d4e9697a83924. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:53.580219 29087 consensus_queue.cc:260] T 879bbeb7e3244e8a8e5ee375c020cb16 P ee4d8c8df06e4c04ad53ac25013d8a78 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0284f1db8c204657b7b423bab5b2eb4f" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 39279 } } peers { permanent_uuid: "ee4d8c8df06e4c04ad53ac25013d8a78" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 41821 } } peers { permanent_uuid: "e3fc42b9680245f3b66db70446830a2f" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 39203 } }
I20260709 13:08:53.603708 29088 tablet_bootstrap.cc:492] T 2b38eb974fe54bb6a799876978d3ba4c P e3fc42b9680245f3b66db70446830a2f: No bootstrap required, opened a new log
I20260709 13:08:53.604171 28924 heartbeater.cc:499] Master 127.17.223.62:35571 was elected leader, sending a full tablet report...
I20260709 13:08:53.604346 29088 ts_tablet_manager.cc:1403] T 2b38eb974fe54bb6a799876978d3ba4c P e3fc42b9680245f3b66db70446830a2f: Time spent bootstrapping tablet: real 0.113s	user 0.009s	sys 0.005s
I20260709 13:08:53.604761 29089 ts_tablet_manager.cc:1434] T 879bbeb7e3244e8a8e5ee375c020cb16 P 0284f1db8c204657b7b423bab5b2eb4f: Time spent starting tablet: real 0.032s	user 0.012s	sys 0.008s
I20260709 13:08:53.605844 29089 tablet_bootstrap.cc:492] T 2b38eb974fe54bb6a799876978d3ba4c P 0284f1db8c204657b7b423bab5b2eb4f: Bootstrap starting.
I20260709 13:08:53.607949 29088 raft_consensus.cc:359] T 2b38eb974fe54bb6a799876978d3ba4c P e3fc42b9680245f3b66db70446830a2f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee4d8c8df06e4c04ad53ac25013d8a78" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 41821 } } peers { permanent_uuid: "e3fc42b9680245f3b66db70446830a2f" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 39203 } } peers { permanent_uuid: "0284f1db8c204657b7b423bab5b2eb4f" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 39279 } }
I20260709 13:08:53.608793 29088 raft_consensus.cc:385] T 2b38eb974fe54bb6a799876978d3ba4c P e3fc42b9680245f3b66db70446830a2f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:53.609131 29088 raft_consensus.cc:740] T 2b38eb974fe54bb6a799876978d3ba4c P e3fc42b9680245f3b66db70446830a2f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e3fc42b9680245f3b66db70446830a2f, State: Initialized, Role: FOLLOWER
I20260709 13:08:53.613885 29089 tablet_bootstrap.cc:654] T 2b38eb974fe54bb6a799876978d3ba4c P 0284f1db8c204657b7b423bab5b2eb4f: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:53.615589 29088 consensus_queue.cc:260] T 2b38eb974fe54bb6a799876978d3ba4c P e3fc42b9680245f3b66db70446830a2f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee4d8c8df06e4c04ad53ac25013d8a78" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 41821 } } peers { permanent_uuid: "e3fc42b9680245f3b66db70446830a2f" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 39203 } } peers { permanent_uuid: "0284f1db8c204657b7b423bab5b2eb4f" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 39279 } }
I20260709 13:08:53.618510 28999 heartbeater.cc:499] Master 127.17.223.62:35571 was elected leader, sending a full tablet report...
I20260709 13:08:53.619766 29087 ts_tablet_manager.cc:1434] T 879bbeb7e3244e8a8e5ee375c020cb16 P ee4d8c8df06e4c04ad53ac25013d8a78: Time spent starting tablet: real 0.058s	user 0.005s	sys 0.007s
I20260709 13:08:53.620918 29087 tablet_bootstrap.cc:492] T 2b38eb974fe54bb6a799876978d3ba4c P ee4d8c8df06e4c04ad53ac25013d8a78: Bootstrap starting.
I20260709 13:08:53.628054 29087 tablet_bootstrap.cc:654] T 2b38eb974fe54bb6a799876978d3ba4c P ee4d8c8df06e4c04ad53ac25013d8a78: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:53.634203 29089 tablet_bootstrap.cc:492] T 2b38eb974fe54bb6a799876978d3ba4c P 0284f1db8c204657b7b423bab5b2eb4f: No bootstrap required, opened a new log
I20260709 13:08:53.635079 29089 ts_tablet_manager.cc:1403] T 2b38eb974fe54bb6a799876978d3ba4c P 0284f1db8c204657b7b423bab5b2eb4f: Time spent bootstrapping tablet: real 0.029s	user 0.013s	sys 0.005s
I20260709 13:08:53.639252 29089 raft_consensus.cc:359] T 2b38eb974fe54bb6a799876978d3ba4c P 0284f1db8c204657b7b423bab5b2eb4f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee4d8c8df06e4c04ad53ac25013d8a78" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 41821 } } peers { permanent_uuid: "e3fc42b9680245f3b66db70446830a2f" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 39203 } } peers { permanent_uuid: "0284f1db8c204657b7b423bab5b2eb4f" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 39279 } }
I20260709 13:08:53.640359 29089 raft_consensus.cc:385] T 2b38eb974fe54bb6a799876978d3ba4c P 0284f1db8c204657b7b423bab5b2eb4f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:53.640827 29089 raft_consensus.cc:740] T 2b38eb974fe54bb6a799876978d3ba4c P 0284f1db8c204657b7b423bab5b2eb4f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0284f1db8c204657b7b423bab5b2eb4f, State: Initialized, Role: FOLLOWER
I20260709 13:08:53.642081 29089 consensus_queue.cc:260] T 2b38eb974fe54bb6a799876978d3ba4c P 0284f1db8c204657b7b423bab5b2eb4f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee4d8c8df06e4c04ad53ac25013d8a78" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 41821 } } peers { permanent_uuid: "e3fc42b9680245f3b66db70446830a2f" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 39203 } } peers { permanent_uuid: "0284f1db8c204657b7b423bab5b2eb4f" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 39279 } }
I20260709 13:08:53.650483 29089 ts_tablet_manager.cc:1434] T 2b38eb974fe54bb6a799876978d3ba4c P 0284f1db8c204657b7b423bab5b2eb4f: Time spent starting tablet: real 0.015s	user 0.004s	sys 0.004s
I20260709 13:08:53.652077 29089 tablet_bootstrap.cc:492] T 9f5d8f2d6f684a5b9702935fc8fd85a1 P 0284f1db8c204657b7b423bab5b2eb4f: Bootstrap starting.
I20260709 13:08:53.661341 29089 tablet_bootstrap.cc:654] T 9f5d8f2d6f684a5b9702935fc8fd85a1 P 0284f1db8c204657b7b423bab5b2eb4f: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:53.674962 29089 tablet_bootstrap.cc:492] T 9f5d8f2d6f684a5b9702935fc8fd85a1 P 0284f1db8c204657b7b423bab5b2eb4f: No bootstrap required, opened a new log
I20260709 13:08:53.675812 29089 ts_tablet_manager.cc:1403] T 9f5d8f2d6f684a5b9702935fc8fd85a1 P 0284f1db8c204657b7b423bab5b2eb4f: Time spent bootstrapping tablet: real 0.024s	user 0.015s	sys 0.007s
I20260709 13:08:53.677495 29073 heartbeater.cc:499] Master 127.17.223.62:35571 was elected leader, sending a full tablet report...
I20260709 13:08:53.679309 29089 raft_consensus.cc:359] T 9f5d8f2d6f684a5b9702935fc8fd85a1 P 0284f1db8c204657b7b423bab5b2eb4f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0284f1db8c204657b7b423bab5b2eb4f" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 39279 } } peers { permanent_uuid: "ee4d8c8df06e4c04ad53ac25013d8a78" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 41821 } } peers { permanent_uuid: "e3fc42b9680245f3b66db70446830a2f" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 39203 } }
I20260709 13:08:53.680203 29089 raft_consensus.cc:385] T 9f5d8f2d6f684a5b9702935fc8fd85a1 P 0284f1db8c204657b7b423bab5b2eb4f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:53.680555 29089 raft_consensus.cc:740] T 9f5d8f2d6f684a5b9702935fc8fd85a1 P 0284f1db8c204657b7b423bab5b2eb4f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0284f1db8c204657b7b423bab5b2eb4f, State: Initialized, Role: FOLLOWER
I20260709 13:08:53.681597 29087 tablet_bootstrap.cc:492] T 2b38eb974fe54bb6a799876978d3ba4c P ee4d8c8df06e4c04ad53ac25013d8a78: No bootstrap required, opened a new log
I20260709 13:08:53.681475 29089 consensus_queue.cc:260] T 9f5d8f2d6f684a5b9702935fc8fd85a1 P 0284f1db8c204657b7b423bab5b2eb4f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0284f1db8c204657b7b423bab5b2eb4f" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 39279 } } peers { permanent_uuid: "ee4d8c8df06e4c04ad53ac25013d8a78" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 41821 } } peers { permanent_uuid: "e3fc42b9680245f3b66db70446830a2f" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 39203 } }
I20260709 13:08:53.682178 29087 ts_tablet_manager.cc:1403] T 2b38eb974fe54bb6a799876978d3ba4c P ee4d8c8df06e4c04ad53ac25013d8a78: Time spent bootstrapping tablet: real 0.062s	user 0.026s	sys 0.031s
I20260709 13:08:53.684966 29087 raft_consensus.cc:359] T 2b38eb974fe54bb6a799876978d3ba4c P ee4d8c8df06e4c04ad53ac25013d8a78 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee4d8c8df06e4c04ad53ac25013d8a78" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 41821 } } peers { permanent_uuid: "e3fc42b9680245f3b66db70446830a2f" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 39203 } } peers { permanent_uuid: "0284f1db8c204657b7b423bab5b2eb4f" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 39279 } }
I20260709 13:08:53.685685 29087 raft_consensus.cc:385] T 2b38eb974fe54bb6a799876978d3ba4c P ee4d8c8df06e4c04ad53ac25013d8a78 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:53.685976 29087 raft_consensus.cc:740] T 2b38eb974fe54bb6a799876978d3ba4c P ee4d8c8df06e4c04ad53ac25013d8a78 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ee4d8c8df06e4c04ad53ac25013d8a78, State: Initialized, Role: FOLLOWER
I20260709 13:08:53.687044 29089 ts_tablet_manager.cc:1434] T 9f5d8f2d6f684a5b9702935fc8fd85a1 P 0284f1db8c204657b7b423bab5b2eb4f: Time spent starting tablet: real 0.011s	user 0.007s	sys 0.000s
I20260709 13:08:53.686944 29087 consensus_queue.cc:260] T 2b38eb974fe54bb6a799876978d3ba4c P ee4d8c8df06e4c04ad53ac25013d8a78 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee4d8c8df06e4c04ad53ac25013d8a78" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 41821 } } peers { permanent_uuid: "e3fc42b9680245f3b66db70446830a2f" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 39203 } } peers { permanent_uuid: "0284f1db8c204657b7b423bab5b2eb4f" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 39279 } }
I20260709 13:08:53.688259 29089 tablet_bootstrap.cc:492] T 0dfbae90dbc4407a9e01872b7d688d55 P 0284f1db8c204657b7b423bab5b2eb4f: Bootstrap starting.
I20260709 13:08:53.689457 29087 ts_tablet_manager.cc:1434] T 2b38eb974fe54bb6a799876978d3ba4c P ee4d8c8df06e4c04ad53ac25013d8a78: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.002s
I20260709 13:08:53.690132 29088 ts_tablet_manager.cc:1434] T 2b38eb974fe54bb6a799876978d3ba4c P e3fc42b9680245f3b66db70446830a2f: Time spent starting tablet: real 0.085s	user 0.017s	sys 0.041s
I20260709 13:08:53.690593 29087 tablet_bootstrap.cc:492] T 777f2e0112c34108b367c8a2ad2641e1 P ee4d8c8df06e4c04ad53ac25013d8a78: Bootstrap starting.
I20260709 13:08:53.691193 29088 tablet_bootstrap.cc:492] T 9f5d8f2d6f684a5b9702935fc8fd85a1 P e3fc42b9680245f3b66db70446830a2f: Bootstrap starting.
I20260709 13:08:53.697861 29087 tablet_bootstrap.cc:654] T 777f2e0112c34108b367c8a2ad2641e1 P ee4d8c8df06e4c04ad53ac25013d8a78: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:53.698143 29088 tablet_bootstrap.cc:654] T 9f5d8f2d6f684a5b9702935fc8fd85a1 P e3fc42b9680245f3b66db70446830a2f: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:53.699394 29089 tablet_bootstrap.cc:654] T 0dfbae90dbc4407a9e01872b7d688d55 P 0284f1db8c204657b7b423bab5b2eb4f: Neither blocks nor log segments found. Creating new log.
W20260709 13:08:53.704643 29074 tablet.cc:2406] T 2b38eb974fe54bb6a799876978d3ba4c P e3fc42b9680245f3b66db70446830a2f: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260709 13:08:53.709836 29087 tablet_bootstrap.cc:492] T 777f2e0112c34108b367c8a2ad2641e1 P ee4d8c8df06e4c04ad53ac25013d8a78: No bootstrap required, opened a new log
I20260709 13:08:53.710464 29087 ts_tablet_manager.cc:1403] T 777f2e0112c34108b367c8a2ad2641e1 P ee4d8c8df06e4c04ad53ac25013d8a78: Time spent bootstrapping tablet: real 0.020s	user 0.011s	sys 0.007s
I20260709 13:08:53.713590 29087 raft_consensus.cc:359] T 777f2e0112c34108b367c8a2ad2641e1 P ee4d8c8df06e4c04ad53ac25013d8a78 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0284f1db8c204657b7b423bab5b2eb4f" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 39279 } } peers { permanent_uuid: "ee4d8c8df06e4c04ad53ac25013d8a78" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 41821 } } peers { permanent_uuid: "e3fc42b9680245f3b66db70446830a2f" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 39203 } }
I20260709 13:08:53.714294 29087 raft_consensus.cc:385] T 777f2e0112c34108b367c8a2ad2641e1 P ee4d8c8df06e4c04ad53ac25013d8a78 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:53.714591 29087 raft_consensus.cc:740] T 777f2e0112c34108b367c8a2ad2641e1 P ee4d8c8df06e4c04ad53ac25013d8a78 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ee4d8c8df06e4c04ad53ac25013d8a78, State: Initialized, Role: FOLLOWER
I20260709 13:08:53.715567 29087 consensus_queue.cc:260] T 777f2e0112c34108b367c8a2ad2641e1 P ee4d8c8df06e4c04ad53ac25013d8a78 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0284f1db8c204657b7b423bab5b2eb4f" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 39279 } } peers { permanent_uuid: "ee4d8c8df06e4c04ad53ac25013d8a78" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 41821 } } peers { permanent_uuid: "e3fc42b9680245f3b66db70446830a2f" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 39203 } }
I20260709 13:08:53.720275 29087 ts_tablet_manager.cc:1434] T 777f2e0112c34108b367c8a2ad2641e1 P ee4d8c8df06e4c04ad53ac25013d8a78: Time spent starting tablet: real 0.009s	user 0.004s	sys 0.002s
I20260709 13:08:53.721273 29087 tablet_bootstrap.cc:492] T 4b9944472adf4cec929d98a95851bef9 P ee4d8c8df06e4c04ad53ac25013d8a78: Bootstrap starting.
I20260709 13:08:53.724542 29089 tablet_bootstrap.cc:492] T 0dfbae90dbc4407a9e01872b7d688d55 P 0284f1db8c204657b7b423bab5b2eb4f: No bootstrap required, opened a new log
I20260709 13:08:53.725080 29089 ts_tablet_manager.cc:1403] T 0dfbae90dbc4407a9e01872b7d688d55 P 0284f1db8c204657b7b423bab5b2eb4f: Time spent bootstrapping tablet: real 0.037s	user 0.015s	sys 0.011s
I20260709 13:08:53.728003 29089 raft_consensus.cc:359] T 0dfbae90dbc4407a9e01872b7d688d55 P 0284f1db8c204657b7b423bab5b2eb4f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0284f1db8c204657b7b423bab5b2eb4f" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 39279 } } peers { permanent_uuid: "ee4d8c8df06e4c04ad53ac25013d8a78" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 41821 } } peers { permanent_uuid: "e3fc42b9680245f3b66db70446830a2f" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 39203 } }
I20260709 13:08:53.729617 29089 raft_consensus.cc:385] T 0dfbae90dbc4407a9e01872b7d688d55 P 0284f1db8c204657b7b423bab5b2eb4f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:53.729943 29089 raft_consensus.cc:740] T 0dfbae90dbc4407a9e01872b7d688d55 P 0284f1db8c204657b7b423bab5b2eb4f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0284f1db8c204657b7b423bab5b2eb4f, State: Initialized, Role: FOLLOWER
I20260709 13:08:53.730090 29087 tablet_bootstrap.cc:654] T 4b9944472adf4cec929d98a95851bef9 P ee4d8c8df06e4c04ad53ac25013d8a78: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:53.730882 29089 consensus_queue.cc:260] T 0dfbae90dbc4407a9e01872b7d688d55 P 0284f1db8c204657b7b423bab5b2eb4f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0284f1db8c204657b7b423bab5b2eb4f" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 39279 } } peers { permanent_uuid: "ee4d8c8df06e4c04ad53ac25013d8a78" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 41821 } } peers { permanent_uuid: "e3fc42b9680245f3b66db70446830a2f" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 39203 } }
I20260709 13:08:53.731693 29088 tablet_bootstrap.cc:492] T 9f5d8f2d6f684a5b9702935fc8fd85a1 P e3fc42b9680245f3b66db70446830a2f: No bootstrap required, opened a new log
I20260709 13:08:53.732203 29088 ts_tablet_manager.cc:1403] T 9f5d8f2d6f684a5b9702935fc8fd85a1 P e3fc42b9680245f3b66db70446830a2f: Time spent bootstrapping tablet: real 0.041s	user 0.018s	sys 0.019s
I20260709 13:08:53.735168 29088 raft_consensus.cc:359] T 9f5d8f2d6f684a5b9702935fc8fd85a1 P e3fc42b9680245f3b66db70446830a2f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0284f1db8c204657b7b423bab5b2eb4f" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 39279 } } peers { permanent_uuid: "ee4d8c8df06e4c04ad53ac25013d8a78" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 41821 } } peers { permanent_uuid: "e3fc42b9680245f3b66db70446830a2f" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 39203 } }
I20260709 13:08:53.736235 29088 raft_consensus.cc:385] T 9f5d8f2d6f684a5b9702935fc8fd85a1 P e3fc42b9680245f3b66db70446830a2f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:53.736498 29088 raft_consensus.cc:740] T 9f5d8f2d6f684a5b9702935fc8fd85a1 P e3fc42b9680245f3b66db70446830a2f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e3fc42b9680245f3b66db70446830a2f, State: Initialized, Role: FOLLOWER
I20260709 13:08:53.737190 29088 consensus_queue.cc:260] T 9f5d8f2d6f684a5b9702935fc8fd85a1 P e3fc42b9680245f3b66db70446830a2f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0284f1db8c204657b7b423bab5b2eb4f" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 39279 } } peers { permanent_uuid: "ee4d8c8df06e4c04ad53ac25013d8a78" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 41821 } } peers { permanent_uuid: "e3fc42b9680245f3b66db70446830a2f" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 39203 } }
I20260709 13:08:53.739357 29088 ts_tablet_manager.cc:1434] T 9f5d8f2d6f684a5b9702935fc8fd85a1 P e3fc42b9680245f3b66db70446830a2f: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 13:08:53.740291 29088 tablet_bootstrap.cc:492] T eb8f9bf7e0d24af88a04bda489298395 P e3fc42b9680245f3b66db70446830a2f: Bootstrap starting.
I20260709 13:08:53.741887 29089 ts_tablet_manager.cc:1434] T 0dfbae90dbc4407a9e01872b7d688d55 P 0284f1db8c204657b7b423bab5b2eb4f: Time spent starting tablet: real 0.017s	user 0.008s	sys 0.000s
I20260709 13:08:53.743149 29087 tablet_bootstrap.cc:492] T 4b9944472adf4cec929d98a95851bef9 P ee4d8c8df06e4c04ad53ac25013d8a78: No bootstrap required, opened a new log
I20260709 13:08:53.743690 29087 ts_tablet_manager.cc:1403] T 4b9944472adf4cec929d98a95851bef9 P ee4d8c8df06e4c04ad53ac25013d8a78: Time spent bootstrapping tablet: real 0.023s	user 0.010s	sys 0.008s
I20260709 13:08:53.746397 29088 tablet_bootstrap.cc:654] T eb8f9bf7e0d24af88a04bda489298395 P e3fc42b9680245f3b66db70446830a2f: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:53.746502 29087 raft_consensus.cc:359] T 4b9944472adf4cec929d98a95851bef9 P ee4d8c8df06e4c04ad53ac25013d8a78 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0284f1db8c204657b7b423bab5b2eb4f" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 39279 } } peers { permanent_uuid: "ee4d8c8df06e4c04ad53ac25013d8a78" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 41821 } } peers { permanent_uuid: "e3fc42b9680245f3b66db70446830a2f" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 39203 } }
I20260709 13:08:53.747346 29087 raft_consensus.cc:385] T 4b9944472adf4cec929d98a95851bef9 P ee4d8c8df06e4c04ad53ac25013d8a78 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:53.747654 29087 raft_consensus.cc:740] T 4b9944472adf4cec929d98a95851bef9 P ee4d8c8df06e4c04ad53ac25013d8a78 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ee4d8c8df06e4c04ad53ac25013d8a78, State: Initialized, Role: FOLLOWER
I20260709 13:08:53.748661 29087 consensus_queue.cc:260] T 4b9944472adf4cec929d98a95851bef9 P ee4d8c8df06e4c04ad53ac25013d8a78 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0284f1db8c204657b7b423bab5b2eb4f" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 39279 } } peers { permanent_uuid: "ee4d8c8df06e4c04ad53ac25013d8a78" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 41821 } } peers { permanent_uuid: "e3fc42b9680245f3b66db70446830a2f" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 39203 } }
I20260709 13:08:53.749421 29089 tablet_bootstrap.cc:492] T 7087f0eae49f4f71b5769071b817f8f2 P 0284f1db8c204657b7b423bab5b2eb4f: Bootstrap starting.
I20260709 13:08:53.753182 29087 ts_tablet_manager.cc:1434] T 4b9944472adf4cec929d98a95851bef9 P ee4d8c8df06e4c04ad53ac25013d8a78: Time spent starting tablet: real 0.009s	user 0.004s	sys 0.003s
I20260709 13:08:53.754377 29087 tablet_bootstrap.cc:492] T eb8f9bf7e0d24af88a04bda489298395 P ee4d8c8df06e4c04ad53ac25013d8a78: Bootstrap starting.
I20260709 13:08:53.756604 29089 tablet_bootstrap.cc:654] T 7087f0eae49f4f71b5769071b817f8f2 P 0284f1db8c204657b7b423bab5b2eb4f: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:53.761453 29087 tablet_bootstrap.cc:654] T eb8f9bf7e0d24af88a04bda489298395 P ee4d8c8df06e4c04ad53ac25013d8a78: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:53.768159 29088 tablet_bootstrap.cc:492] T eb8f9bf7e0d24af88a04bda489298395 P e3fc42b9680245f3b66db70446830a2f: No bootstrap required, opened a new log
I20260709 13:08:53.768595 29088 ts_tablet_manager.cc:1403] T eb8f9bf7e0d24af88a04bda489298395 P e3fc42b9680245f3b66db70446830a2f: Time spent bootstrapping tablet: real 0.029s	user 0.018s	sys 0.008s
I20260709 13:08:53.769989 29087 tablet_bootstrap.cc:492] T eb8f9bf7e0d24af88a04bda489298395 P ee4d8c8df06e4c04ad53ac25013d8a78: No bootstrap required, opened a new log
I20260709 13:08:53.770709 29087 ts_tablet_manager.cc:1403] T eb8f9bf7e0d24af88a04bda489298395 P ee4d8c8df06e4c04ad53ac25013d8a78: Time spent bootstrapping tablet: real 0.017s	user 0.011s	sys 0.000s
I20260709 13:08:53.770859 29088 raft_consensus.cc:359] T eb8f9bf7e0d24af88a04bda489298395 P e3fc42b9680245f3b66db70446830a2f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0284f1db8c204657b7b423bab5b2eb4f" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 39279 } } peers { permanent_uuid: "ee4d8c8df06e4c04ad53ac25013d8a78" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 41821 } } peers { permanent_uuid: "e3fc42b9680245f3b66db70446830a2f" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 39203 } }
I20260709 13:08:53.771277 29096 raft_consensus.cc:493] T 9f5d8f2d6f684a5b9702935fc8fd85a1 P e3fc42b9680245f3b66db70446830a2f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:53.771716 29088 raft_consensus.cc:385] T eb8f9bf7e0d24af88a04bda489298395 P e3fc42b9680245f3b66db70446830a2f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:53.772033 29088 raft_consensus.cc:740] T eb8f9bf7e0d24af88a04bda489298395 P e3fc42b9680245f3b66db70446830a2f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e3fc42b9680245f3b66db70446830a2f, State: Initialized, Role: FOLLOWER
I20260709 13:08:53.771844 29096 raft_consensus.cc:515] T 9f5d8f2d6f684a5b9702935fc8fd85a1 P e3fc42b9680245f3b66db70446830a2f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0284f1db8c204657b7b423bab5b2eb4f" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 39279 } } peers { permanent_uuid: "ee4d8c8df06e4c04ad53ac25013d8a78" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 41821 } } peers { permanent_uuid: "e3fc42b9680245f3b66db70446830a2f" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 39203 } }
I20260709 13:08:53.772914 29088 consensus_queue.cc:260] T eb8f9bf7e0d24af88a04bda489298395 P e3fc42b9680245f3b66db70446830a2f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0284f1db8c204657b7b423bab5b2eb4f" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 39279 } } peers { permanent_uuid: "ee4d8c8df06e4c04ad53ac25013d8a78" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 41821 } } peers { permanent_uuid: "e3fc42b9680245f3b66db70446830a2f" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 39203 } }
I20260709 13:08:53.774478 29096 leader_election.cc:290] T 9f5d8f2d6f684a5b9702935fc8fd85a1 P e3fc42b9680245f3b66db70446830a2f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0284f1db8c204657b7b423bab5b2eb4f (127.17.223.1:39279), ee4d8c8df06e4c04ad53ac25013d8a78 (127.17.223.2:41821)
I20260709 13:08:53.774718 29094 raft_consensus.cc:493] T 4b9944472adf4cec929d98a95851bef9 P ee4d8c8df06e4c04ad53ac25013d8a78 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:53.774603 29087 raft_consensus.cc:359] T eb8f9bf7e0d24af88a04bda489298395 P ee4d8c8df06e4c04ad53ac25013d8a78 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0284f1db8c204657b7b423bab5b2eb4f" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 39279 } } peers { permanent_uuid: "ee4d8c8df06e4c04ad53ac25013d8a78" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 41821 } } peers { permanent_uuid: "e3fc42b9680245f3b66db70446830a2f" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 39203 } }
I20260709 13:08:53.775439 29094 raft_consensus.cc:515] T 4b9944472adf4cec929d98a95851bef9 P ee4d8c8df06e4c04ad53ac25013d8a78 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0284f1db8c204657b7b423bab5b2eb4f" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 39279 } } peers { permanent_uuid: "ee4d8c8df06e4c04ad53ac25013d8a78" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 41821 } } peers { permanent_uuid: "e3fc42b9680245f3b66db70446830a2f" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 39203 } }
I20260709 13:08:53.775883 29087 raft_consensus.cc:385] T eb8f9bf7e0d24af88a04bda489298395 P ee4d8c8df06e4c04ad53ac25013d8a78 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:53.776329 29087 raft_consensus.cc:740] T eb8f9bf7e0d24af88a04bda489298395 P ee4d8c8df06e4c04ad53ac25013d8a78 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ee4d8c8df06e4c04ad53ac25013d8a78, State: Initialized, Role: FOLLOWER
I20260709 13:08:53.777997 29094 leader_election.cc:290] T 4b9944472adf4cec929d98a95851bef9 P ee4d8c8df06e4c04ad53ac25013d8a78 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0284f1db8c204657b7b423bab5b2eb4f (127.17.223.1:39279), e3fc42b9680245f3b66db70446830a2f (127.17.223.3:39203)
I20260709 13:08:53.781500 29087 consensus_queue.cc:260] T eb8f9bf7e0d24af88a04bda489298395 P ee4d8c8df06e4c04ad53ac25013d8a78 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0284f1db8c204657b7b423bab5b2eb4f" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 39279 } } peers { permanent_uuid: "ee4d8c8df06e4c04ad53ac25013d8a78" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 41821 } } peers { permanent_uuid: "e3fc42b9680245f3b66db70446830a2f" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 39203 } }
I20260709 13:08:53.783443 29089 tablet_bootstrap.cc:492] T 7087f0eae49f4f71b5769071b817f8f2 P 0284f1db8c204657b7b423bab5b2eb4f: No bootstrap required, opened a new log
I20260709 13:08:53.783815 29087 ts_tablet_manager.cc:1434] T eb8f9bf7e0d24af88a04bda489298395 P ee4d8c8df06e4c04ad53ac25013d8a78: Time spent starting tablet: real 0.013s	user 0.004s	sys 0.004s
I20260709 13:08:53.783978 29089 ts_tablet_manager.cc:1403] T 7087f0eae49f4f71b5769071b817f8f2 P 0284f1db8c204657b7b423bab5b2eb4f: Time spent bootstrapping tablet: real 0.035s	user 0.021s	sys 0.012s
I20260709 13:08:53.784828 29087 tablet_bootstrap.cc:492] T 451e3f8929ef4287a9eaa8941486e9cc P ee4d8c8df06e4c04ad53ac25013d8a78: Bootstrap starting.
I20260709 13:08:53.787161 29089 raft_consensus.cc:359] T 7087f0eae49f4f71b5769071b817f8f2 P 0284f1db8c204657b7b423bab5b2eb4f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0284f1db8c204657b7b423bab5b2eb4f" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 39279 } } peers { permanent_uuid: "ee4d8c8df06e4c04ad53ac25013d8a78" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 41821 } } peers { permanent_uuid: "e3fc42b9680245f3b66db70446830a2f" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 39203 } }
I20260709 13:08:53.787942 29089 raft_consensus.cc:385] T 7087f0eae49f4f71b5769071b817f8f2 P 0284f1db8c204657b7b423bab5b2eb4f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:53.788244 29089 raft_consensus.cc:740] T 7087f0eae49f4f71b5769071b817f8f2 P 0284f1db8c204657b7b423bab5b2eb4f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0284f1db8c204657b7b423bab5b2eb4f, State: Initialized, Role: FOLLOWER
I20260709 13:08:53.789011 29089 consensus_queue.cc:260] T 7087f0eae49f4f71b5769071b817f8f2 P 0284f1db8c204657b7b423bab5b2eb4f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0284f1db8c204657b7b423bab5b2eb4f" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 39279 } } peers { permanent_uuid: "ee4d8c8df06e4c04ad53ac25013d8a78" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 41821 } } peers { permanent_uuid: "e3fc42b9680245f3b66db70446830a2f" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 39203 } }
I20260709 13:08:53.791205 29087 tablet_bootstrap.cc:654] T 451e3f8929ef4287a9eaa8941486e9cc P ee4d8c8df06e4c04ad53ac25013d8a78: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:53.800221 29089 ts_tablet_manager.cc:1434] T 7087f0eae49f4f71b5769071b817f8f2 P 0284f1db8c204657b7b423bab5b2eb4f: Time spent starting tablet: real 0.010s	user 0.003s	sys 0.004s
I20260709 13:08:53.803424 29087 tablet_bootstrap.cc:492] T 451e3f8929ef4287a9eaa8941486e9cc P ee4d8c8df06e4c04ad53ac25013d8a78: No bootstrap required, opened a new log
I20260709 13:08:53.803951 29087 ts_tablet_manager.cc:1403] T 451e3f8929ef4287a9eaa8941486e9cc P ee4d8c8df06e4c04ad53ac25013d8a78: Time spent bootstrapping tablet: real 0.019s	user 0.017s	sys 0.000s
I20260709 13:08:53.804134 29089 tablet_bootstrap.cc:492] T 777f2e0112c34108b367c8a2ad2641e1 P 0284f1db8c204657b7b423bab5b2eb4f: Bootstrap starting.
I20260709 13:08:53.807108 29087 raft_consensus.cc:359] T 451e3f8929ef4287a9eaa8941486e9cc P ee4d8c8df06e4c04ad53ac25013d8a78 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0284f1db8c204657b7b423bab5b2eb4f" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 39279 } } peers { permanent_uuid: "ee4d8c8df06e4c04ad53ac25013d8a78" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 41821 } } peers { permanent_uuid: "e3fc42b9680245f3b66db70446830a2f" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 39203 } }
I20260709 13:08:53.807880 29087 raft_consensus.cc:385] T 451e3f8929ef4287a9eaa8941486e9cc P ee4d8c8df06e4c04ad53ac25013d8a78 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:53.808211 29087 raft_consensus.cc:740] T 451e3f8929ef4287a9eaa8941486e9cc P ee4d8c8df06e4c04ad53ac25013d8a78 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ee4d8c8df06e4c04ad53ac25013d8a78, State: Initialized, Role: FOLLOWER
I20260709 13:08:53.808873 29087 consensus_queue.cc:260] T 451e3f8929ef4287a9eaa8941486e9cc P ee4d8c8df06e4c04ad53ac25013d8a78 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0284f1db8c204657b7b423bab5b2eb4f" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 39279 } } peers { permanent_uuid: "ee4d8c8df06e4c04ad53ac25013d8a78" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 41821 } } peers { permanent_uuid: "e3fc42b9680245f3b66db70446830a2f" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 39203 } }
I20260709 13:08:53.811189 29089 tablet_bootstrap.cc:654] T 777f2e0112c34108b367c8a2ad2641e1 P 0284f1db8c204657b7b423bab5b2eb4f: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:53.811421 29087 ts_tablet_manager.cc:1434] T 451e3f8929ef4287a9eaa8941486e9cc P ee4d8c8df06e4c04ad53ac25013d8a78: Time spent starting tablet: real 0.007s	user 0.003s	sys 0.004s
I20260709 13:08:53.812497 29087 tablet_bootstrap.cc:492] T 0dfbae90dbc4407a9e01872b7d688d55 P ee4d8c8df06e4c04ad53ac25013d8a78: Bootstrap starting.
I20260709 13:08:53.814178 29088 ts_tablet_manager.cc:1434] T eb8f9bf7e0d24af88a04bda489298395 P e3fc42b9680245f3b66db70446830a2f: Time spent starting tablet: real 0.045s	user 0.007s	sys 0.011s
W20260709 13:08:53.818043 28845 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:08:53.819698 28899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f5d8f2d6f684a5b9702935fc8fd85a1" candidate_uuid: "e3fc42b9680245f3b66db70446830a2f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0284f1db8c204657b7b423bab5b2eb4f" is_pre_election: true
I20260709 13:08:53.820448 28899 raft_consensus.cc:2468] T 9f5d8f2d6f684a5b9702935fc8fd85a1 P 0284f1db8c204657b7b423bab5b2eb4f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3fc42b9680245f3b66db70446830a2f in term 0.
I20260709 13:08:53.824347 29094 raft_consensus.cc:493] T 879bbeb7e3244e8a8e5ee375c020cb16 P ee4d8c8df06e4c04ad53ac25013d8a78 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:53.824709 29088 tablet_bootstrap.cc:492] T 777f2e0112c34108b367c8a2ad2641e1 P e3fc42b9680245f3b66db70446830a2f: Bootstrap starting.
I20260709 13:08:53.824849 29094 raft_consensus.cc:515] T 879bbeb7e3244e8a8e5ee375c020cb16 P ee4d8c8df06e4c04ad53ac25013d8a78 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0284f1db8c204657b7b423bab5b2eb4f" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 39279 } } peers { permanent_uuid: "ee4d8c8df06e4c04ad53ac25013d8a78" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 41821 } } peers { permanent_uuid: "e3fc42b9680245f3b66db70446830a2f" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 39203 } }
I20260709 13:08:53.826527 29087 tablet_bootstrap.cc:654] T 0dfbae90dbc4407a9e01872b7d688d55 P ee4d8c8df06e4c04ad53ac25013d8a78: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:53.828065 29094 leader_election.cc:290] T 879bbeb7e3244e8a8e5ee375c020cb16 P ee4d8c8df06e4c04ad53ac25013d8a78 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0284f1db8c204657b7b423bab5b2eb4f (127.17.223.1:39279), e3fc42b9680245f3b66db70446830a2f (127.17.223.3:39203)
I20260709 13:08:53.836081 29012 leader_election.cc:304] T 9f5d8f2d6f684a5b9702935fc8fd85a1 P e3fc42b9680245f3b66db70446830a2f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0284f1db8c204657b7b423bab5b2eb4f, e3fc42b9680245f3b66db70446830a2f; no voters: 
I20260709 13:08:53.838961 29106 raft_consensus.cc:2804] T 9f5d8f2d6f684a5b9702935fc8fd85a1 P e3fc42b9680245f3b66db70446830a2f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:08:53.839355 29106 raft_consensus.cc:493] T 9f5d8f2d6f684a5b9702935fc8fd85a1 P e3fc42b9680245f3b66db70446830a2f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:53.839660 29106 raft_consensus.cc:3060] T 9f5d8f2d6f684a5b9702935fc8fd85a1 P e3fc42b9680245f3b66db70446830a2f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:53.844009 29096 raft_consensus.cc:493] T eb8f9bf7e0d24af88a04bda489298395 P e3fc42b9680245f3b66db70446830a2f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:53.844513 29096 raft_consensus.cc:515] T eb8f9bf7e0d24af88a04bda489298395 P e3fc42b9680245f3b66db70446830a2f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0284f1db8c204657b7b423bab5b2eb4f" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 39279 } } peers { permanent_uuid: "ee4d8c8df06e4c04ad53ac25013d8a78" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 41821 } } peers { permanent_uuid: "e3fc42b9680245f3b66db70446830a2f" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 39203 } }
I20260709 13:08:53.846549 29096 leader_election.cc:290] T eb8f9bf7e0d24af88a04bda489298395 P e3fc42b9680245f3b66db70446830a2f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0284f1db8c204657b7b423bab5b2eb4f (127.17.223.1:39279), ee4d8c8df06e4c04ad53ac25013d8a78 (127.17.223.2:41821)
I20260709 13:08:53.848121 28899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb8f9bf7e0d24af88a04bda489298395" candidate_uuid: "e3fc42b9680245f3b66db70446830a2f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0284f1db8c204657b7b423bab5b2eb4f" is_pre_election: true
I20260709 13:08:53.851401 29106 raft_consensus.cc:515] T 9f5d8f2d6f684a5b9702935fc8fd85a1 P e3fc42b9680245f3b66db70446830a2f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0284f1db8c204657b7b423bab5b2eb4f" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 39279 } } peers { permanent_uuid: "ee4d8c8df06e4c04ad53ac25013d8a78" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 41821 } } peers { permanent_uuid: "e3fc42b9680245f3b66db70446830a2f" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 39203 } }
W20260709 13:08:53.852380 29012 leader_election.cc:343] T eb8f9bf7e0d24af88a04bda489298395 P e3fc42b9680245f3b66db70446830a2f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0284f1db8c204657b7b423bab5b2eb4f (127.17.223.1:39279): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:53.853518 29106 leader_election.cc:290] T 9f5d8f2d6f684a5b9702935fc8fd85a1 P e3fc42b9680245f3b66db70446830a2f [CANDIDATE]: Term 1 election: Requested vote from peers 0284f1db8c204657b7b423bab5b2eb4f (127.17.223.1:39279), ee4d8c8df06e4c04ad53ac25013d8a78 (127.17.223.2:41821)
I20260709 13:08:53.854099 28899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f5d8f2d6f684a5b9702935fc8fd85a1" candidate_uuid: "e3fc42b9680245f3b66db70446830a2f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0284f1db8c204657b7b423bab5b2eb4f"
I20260709 13:08:53.854874 28899 raft_consensus.cc:3060] T 9f5d8f2d6f684a5b9702935fc8fd85a1 P 0284f1db8c204657b7b423bab5b2eb4f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:53.856700 29088 tablet_bootstrap.cc:654] T 777f2e0112c34108b367c8a2ad2641e1 P e3fc42b9680245f3b66db70446830a2f: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:53.859822 29089 tablet_bootstrap.cc:492] T 777f2e0112c34108b367c8a2ad2641e1 P 0284f1db8c204657b7b423bab5b2eb4f: No bootstrap required, opened a new log
I20260709 13:08:53.860478 29089 ts_tablet_manager.cc:1403] T 777f2e0112c34108b367c8a2ad2641e1 P 0284f1db8c204657b7b423bab5b2eb4f: Time spent bootstrapping tablet: real 0.057s	user 0.026s	sys 0.020s
I20260709 13:08:53.864307 29089 raft_consensus.cc:359] T 777f2e0112c34108b367c8a2ad2641e1 P 0284f1db8c204657b7b423bab5b2eb4f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0284f1db8c204657b7b423bab5b2eb4f" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 39279 } } peers { permanent_uuid: "ee4d8c8df06e4c04ad53ac25013d8a78" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 41821 } } peers { permanent_uuid: "e3fc42b9680245f3b66db70446830a2f" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 39203 } }
I20260709 13:08:53.865257 29089 raft_consensus.cc:385] T 777f2e0112c34108b367c8a2ad2641e1 P 0284f1db8c204657b7b423bab5b2eb4f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:53.865638 29089 raft_consensus.cc:740] T 777f2e0112c34108b367c8a2ad2641e1 P 0284f1db8c204657b7b423bab5b2eb4f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0284f1db8c204657b7b423bab5b2eb4f, State: Initialized, Role: FOLLOWER
I20260709 13:08:53.866750 29089 consensus_queue.cc:260] T 777f2e0112c34108b367c8a2ad2641e1 P 0284f1db8c204657b7b423bab5b2eb4f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0284f1db8c204657b7b423bab5b2eb4f" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 39279 } } peers { permanent_uuid: "ee4d8c8df06e4c04ad53ac25013d8a78" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 41821 } } peers { permanent_uuid: "e3fc42b9680245f3b66db70446830a2f" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 39203 } }
I20260709 13:08:53.870194 29089 ts_tablet_manager.cc:1434] T 777f2e0112c34108b367c8a2ad2641e1 P 0284f1db8c204657b7b423bab5b2eb4f: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.003s
I20260709 13:08:53.871573 29089 tablet_bootstrap.cc:492] T eb8f9bf7e0d24af88a04bda489298395 P 0284f1db8c204657b7b423bab5b2eb4f: Bootstrap starting.
I20260709 13:08:53.880252 29089 tablet_bootstrap.cc:654] T eb8f9bf7e0d24af88a04bda489298395 P 0284f1db8c204657b7b423bab5b2eb4f: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:53.890445 29087 tablet_bootstrap.cc:492] T 0dfbae90dbc4407a9e01872b7d688d55 P ee4d8c8df06e4c04ad53ac25013d8a78: No bootstrap required, opened a new log
I20260709 13:08:53.891183 29087 ts_tablet_manager.cc:1403] T 0dfbae90dbc4407a9e01872b7d688d55 P ee4d8c8df06e4c04ad53ac25013d8a78: Time spent bootstrapping tablet: real 0.079s	user 0.033s	sys 0.017s
I20260709 13:08:53.895002 29087 raft_consensus.cc:359] T 0dfbae90dbc4407a9e01872b7d688d55 P ee4d8c8df06e4c04ad53ac25013d8a78 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0284f1db8c204657b7b423bab5b2eb4f" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 39279 } } peers { permanent_uuid: "ee4d8c8df06e4c04ad53ac25013d8a78" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 41821 } } peers { permanent_uuid: "e3fc42b9680245f3b66db70446830a2f" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 39203 } }
I20260709 13:08:53.896039 29087 raft_consensus.cc:385] T 0dfbae90dbc4407a9e01872b7d688d55 P ee4d8c8df06e4c04ad53ac25013d8a78 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:53.896432 29087 raft_consensus.cc:740] T 0dfbae90dbc4407a9e01872b7d688d55 P ee4d8c8df06e4c04ad53ac25013d8a78 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ee4d8c8df06e4c04ad53ac25013d8a78, State: Initialized, Role: FOLLOWER
I20260709 13:08:53.897318 29087 consensus_queue.cc:260] T 0dfbae90dbc4407a9e01872b7d688d55 P ee4d8c8df06e4c04ad53ac25013d8a78 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0284f1db8c204657b7b423bab5b2eb4f" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 39279 } } peers { permanent_uuid: "ee4d8c8df06e4c04ad53ac25013d8a78" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 41821 } } peers { permanent_uuid: "e3fc42b9680245f3b66db70446830a2f" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 39203 } }
I20260709 13:08:53.902918 28899 raft_consensus.cc:2468] T 9f5d8f2d6f684a5b9702935fc8fd85a1 P 0284f1db8c204657b7b423bab5b2eb4f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3fc42b9680245f3b66db70446830a2f in term 1.
I20260709 13:08:53.903550 29087 ts_tablet_manager.cc:1434] T 0dfbae90dbc4407a9e01872b7d688d55 P ee4d8c8df06e4c04ad53ac25013d8a78: Time spent starting tablet: real 0.012s	user 0.009s	sys 0.001s
I20260709 13:08:53.904376 29012 leader_election.cc:304] T 9f5d8f2d6f684a5b9702935fc8fd85a1 P e3fc42b9680245f3b66db70446830a2f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0284f1db8c204657b7b423bab5b2eb4f, e3fc42b9680245f3b66db70446830a2f; no voters: 
I20260709 13:08:53.904951 29087 tablet_bootstrap.cc:492] T 9f5d8f2d6f684a5b9702935fc8fd85a1 P ee4d8c8df06e4c04ad53ac25013d8a78: Bootstrap starting.
I20260709 13:08:53.905364 29106 raft_consensus.cc:2804] T 9f5d8f2d6f684a5b9702935fc8fd85a1 P e3fc42b9680245f3b66db70446830a2f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:08:53.905887 29106 raft_consensus.cc:697] T 9f5d8f2d6f684a5b9702935fc8fd85a1 P e3fc42b9680245f3b66db70446830a2f [term 1 LEADER]: Becoming Leader. State: Replica: e3fc42b9680245f3b66db70446830a2f, State: Running, Role: LEADER
I20260709 13:08:53.907459 29106 consensus_queue.cc:237] T 9f5d8f2d6f684a5b9702935fc8fd85a1 P e3fc42b9680245f3b66db70446830a2f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0284f1db8c204657b7b423bab5b2eb4f" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 39279 } } peers { permanent_uuid: "ee4d8c8df06e4c04ad53ac25013d8a78" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 41821 } } peers { permanent_uuid: "e3fc42b9680245f3b66db70446830a2f" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 39203 } }
I20260709 13:08:53.909571 29048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b9944472adf4cec929d98a95851bef9" candidate_uuid: "ee4d8c8df06e4c04ad53ac25013d8a78" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3fc42b9680245f3b66db70446830a2f" is_pre_election: true
I20260709 13:08:53.912017 29089 tablet_bootstrap.cc:492] T eb8f9bf7e0d24af88a04bda489298395 P 0284f1db8c204657b7b423bab5b2eb4f: No bootstrap required, opened a new log
I20260709 13:08:53.912533 29089 ts_tablet_manager.cc:1403] T eb8f9bf7e0d24af88a04bda489298395 P 0284f1db8c204657b7b423bab5b2eb4f: Time spent bootstrapping tablet: real 0.041s	user 0.018s	sys 0.021s
I20260709 13:08:53.913053 29047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "879bbeb7e3244e8a8e5ee375c020cb16" candidate_uuid: "ee4d8c8df06e4c04ad53ac25013d8a78" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3fc42b9680245f3b66db70446830a2f" is_pre_election: true
W20260709 13:08:53.915258 28938 leader_election.cc:343] T 4b9944472adf4cec929d98a95851bef9 P ee4d8c8df06e4c04ad53ac25013d8a78 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e3fc42b9680245f3b66db70446830a2f (127.17.223.3:39203): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:53.915601 29089 raft_consensus.cc:359] T eb8f9bf7e0d24af88a04bda489298395 P 0284f1db8c204657b7b423bab5b2eb4f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0284f1db8c204657b7b423bab5b2eb4f" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 39279 } } peers { permanent_uuid: "ee4d8c8df06e4c04ad53ac25013d8a78" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 41821 } } peers { permanent_uuid: "e3fc42b9680245f3b66db70446830a2f" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 39203 } }
W20260709 13:08:53.916374 28938 leader_election.cc:343] T 879bbeb7e3244e8a8e5ee375c020cb16 P ee4d8c8df06e4c04ad53ac25013d8a78 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e3fc42b9680245f3b66db70446830a2f (127.17.223.3:39203): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:53.916488 29089 raft_consensus.cc:385] T eb8f9bf7e0d24af88a04bda489298395 P 0284f1db8c204657b7b423bab5b2eb4f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:53.917196 29089 raft_consensus.cc:740] T eb8f9bf7e0d24af88a04bda489298395 P 0284f1db8c204657b7b423bab5b2eb4f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0284f1db8c204657b7b423bab5b2eb4f, State: Initialized, Role: FOLLOWER
I20260709 13:08:53.918074 29089 consensus_queue.cc:260] T eb8f9bf7e0d24af88a04bda489298395 P 0284f1db8c204657b7b423bab5b2eb4f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0284f1db8c204657b7b423bab5b2eb4f" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 39279 } } peers { permanent_uuid: "ee4d8c8df06e4c04ad53ac25013d8a78" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 41821 } } peers { permanent_uuid: "e3fc42b9680245f3b66db70446830a2f" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 39203 } }
I20260709 13:08:53.920331 29089 ts_tablet_manager.cc:1434] T eb8f9bf7e0d24af88a04bda489298395 P 0284f1db8c204657b7b423bab5b2eb4f: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.002s
I20260709 13:08:53.921311 29089 tablet_bootstrap.cc:492] T 451e3f8929ef4287a9eaa8941486e9cc P 0284f1db8c204657b7b423bab5b2eb4f: Bootstrap starting.
I20260709 13:08:53.925628 28898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "879bbeb7e3244e8a8e5ee375c020cb16" candidate_uuid: "ee4d8c8df06e4c04ad53ac25013d8a78" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0284f1db8c204657b7b423bab5b2eb4f" is_pre_election: true
I20260709 13:08:53.926424 28898 raft_consensus.cc:2468] T 879bbeb7e3244e8a8e5ee375c020cb16 P 0284f1db8c204657b7b423bab5b2eb4f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee4d8c8df06e4c04ad53ac25013d8a78 in term 0.
I20260709 13:08:53.926160 28794 catalog_manager.cc:5697] T 9f5d8f2d6f684a5b9702935fc8fd85a1 P e3fc42b9680245f3b66db70446830a2f reported cstate change: term changed from 0 to 1, leader changed from <none> to e3fc42b9680245f3b66db70446830a2f (127.17.223.3). New cstate: current_term: 1 leader_uuid: "e3fc42b9680245f3b66db70446830a2f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0284f1db8c204657b7b423bab5b2eb4f" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 39279 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ee4d8c8df06e4c04ad53ac25013d8a78" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 41821 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e3fc42b9680245f3b66db70446830a2f" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 39203 } health_report { overall_health: HEALTHY } } }
I20260709 13:08:53.927734 29089 tablet_bootstrap.cc:654] T 451e3f8929ef4287a9eaa8941486e9cc P 0284f1db8c204657b7b423bab5b2eb4f: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:53.927086 29087 tablet_bootstrap.cc:654] T 9f5d8f2d6f684a5b9702935fc8fd85a1 P ee4d8c8df06e4c04ad53ac25013d8a78: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:53.929759 29092 raft_consensus.cc:493] T 7087f0eae49f4f71b5769071b817f8f2 P 0284f1db8c204657b7b423bab5b2eb4f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:53.935261 29092 raft_consensus.cc:515] T 7087f0eae49f4f71b5769071b817f8f2 P 0284f1db8c204657b7b423bab5b2eb4f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0284f1db8c204657b7b423bab5b2eb4f" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 39279 } } peers { permanent_uuid: "ee4d8c8df06e4c04ad53ac25013d8a78" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 41821 } } peers { permanent_uuid: "e3fc42b9680245f3b66db70446830a2f" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 39203 } }
I20260709 13:08:53.940723 29092 leader_election.cc:290] T 7087f0eae49f4f71b5769071b817f8f2 P 0284f1db8c204657b7b423bab5b2eb4f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ee4d8c8df06e4c04ad53ac25013d8a78 (127.17.223.2:41821), e3fc42b9680245f3b66db70446830a2f (127.17.223.3:39203)
I20260709 13:08:53.942618 29087 tablet_bootstrap.cc:492] T 9f5d8f2d6f684a5b9702935fc8fd85a1 P ee4d8c8df06e4c04ad53ac25013d8a78: No bootstrap required, opened a new log
I20260709 13:08:53.944118 29087 ts_tablet_manager.cc:1403] T 9f5d8f2d6f684a5b9702935fc8fd85a1 P ee4d8c8df06e4c04ad53ac25013d8a78: Time spent bootstrapping tablet: real 0.039s	user 0.008s	sys 0.006s
I20260709 13:08:53.932931 28899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b9944472adf4cec929d98a95851bef9" candidate_uuid: "ee4d8c8df06e4c04ad53ac25013d8a78" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0284f1db8c204657b7b423bab5b2eb4f" is_pre_election: true
I20260709 13:08:53.946143 29094 raft_consensus.cc:493] T 2b38eb974fe54bb6a799876978d3ba4c P ee4d8c8df06e4c04ad53ac25013d8a78 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:53.947263 29087 raft_consensus.cc:359] T 9f5d8f2d6f684a5b9702935fc8fd85a1 P ee4d8c8df06e4c04ad53ac25013d8a78 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0284f1db8c204657b7b423bab5b2eb4f" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 39279 } } peers { permanent_uuid: "ee4d8c8df06e4c04ad53ac25013d8a78" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 41821 } } peers { permanent_uuid: "e3fc42b9680245f3b66db70446830a2f" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 39203 } }
I20260709 13:08:53.947472 29094 raft_consensus.cc:515] T 2b38eb974fe54bb6a799876978d3ba4c P ee4d8c8df06e4c04ad53ac25013d8a78 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee4d8c8df06e4c04ad53ac25013d8a78" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 41821 } } peers { permanent_uuid: "e3fc42b9680245f3b66db70446830a2f" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 39203 } } peers { permanent_uuid: "0284f1db8c204657b7b423bab5b2eb4f" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 39279 } }
I20260709 13:08:53.947957 29087 raft_consensus.cc:385] T 9f5d8f2d6f684a5b9702935fc8fd85a1 P ee4d8c8df06e4c04ad53ac25013d8a78 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:53.948238 29087 raft_consensus.cc:740] T 9f5d8f2d6f684a5b9702935fc8fd85a1 P ee4d8c8df06e4c04ad53ac25013d8a78 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ee4d8c8df06e4c04ad53ac25013d8a78, State: Initialized, Role: FOLLOWER
I20260709 13:08:53.948879 29087 consensus_queue.cc:260] T 9f5d8f2d6f684a5b9702935fc8fd85a1 P ee4d8c8df06e4c04ad53ac25013d8a78 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0284f1db8c204657b7b423bab5b2eb4f" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 39279 } } peers { permanent_uuid: "ee4d8c8df06e4c04ad53ac25013d8a78" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 41821 } } peers { permanent_uuid: "e3fc42b9680245f3b66db70446830a2f" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 39203 } }
I20260709 13:08:53.949374 29094 leader_election.cc:290] T 2b38eb974fe54bb6a799876978d3ba4c P ee4d8c8df06e4c04ad53ac25013d8a78 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e3fc42b9680245f3b66db70446830a2f (127.17.223.3:39203), 0284f1db8c204657b7b423bab5b2eb4f (127.17.223.1:39279)
I20260709 13:08:53.942747 29089 tablet_bootstrap.cc:492] T 451e3f8929ef4287a9eaa8941486e9cc P 0284f1db8c204657b7b423bab5b2eb4f: No bootstrap required, opened a new log
I20260709 13:08:53.951247 29089 ts_tablet_manager.cc:1403] T 451e3f8929ef4287a9eaa8941486e9cc P 0284f1db8c204657b7b423bab5b2eb4f: Time spent bootstrapping tablet: real 0.030s	user 0.013s	sys 0.007s
I20260709 13:08:53.927973 28938 leader_election.cc:304] T 879bbeb7e3244e8a8e5ee375c020cb16 P ee4d8c8df06e4c04ad53ac25013d8a78 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0284f1db8c204657b7b423bab5b2eb4f, ee4d8c8df06e4c04ad53ac25013d8a78; no voters: e3fc42b9680245f3b66db70446830a2f
I20260709 13:08:53.955878 29094 raft_consensus.cc:2804] T 879bbeb7e3244e8a8e5ee375c020cb16 P ee4d8c8df06e4c04ad53ac25013d8a78 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:08:53.956449 29094 raft_consensus.cc:493] T 879bbeb7e3244e8a8e5ee375c020cb16 P ee4d8c8df06e4c04ad53ac25013d8a78 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:53.956943 29094 raft_consensus.cc:3060] T 879bbeb7e3244e8a8e5ee375c020cb16 P ee4d8c8df06e4c04ad53ac25013d8a78 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:53.961383 29089 raft_consensus.cc:359] T 451e3f8929ef4287a9eaa8941486e9cc P 0284f1db8c204657b7b423bab5b2eb4f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0284f1db8c204657b7b423bab5b2eb4f" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 39279 } } peers { permanent_uuid: "ee4d8c8df06e4c04ad53ac25013d8a78" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 41821 } } peers { permanent_uuid: "e3fc42b9680245f3b66db70446830a2f" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 39203 } }
I20260709 13:08:53.962455 29089 raft_consensus.cc:385] T 451e3f8929ef4287a9eaa8941486e9cc P 0284f1db8c204657b7b423bab5b2eb4f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:53.962828 29089 raft_consensus.cc:740] T 451e3f8929ef4287a9eaa8941486e9cc P 0284f1db8c204657b7b423bab5b2eb4f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0284f1db8c204657b7b423bab5b2eb4f, State: Initialized, Role: FOLLOWER
I20260709 13:08:53.963721 29089 consensus_queue.cc:260] T 451e3f8929ef4287a9eaa8941486e9cc P 0284f1db8c204657b7b423bab5b2eb4f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0284f1db8c204657b7b423bab5b2eb4f" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 39279 } } peers { permanent_uuid: "ee4d8c8df06e4c04ad53ac25013d8a78" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 41821 } } peers { permanent_uuid: "e3fc42b9680245f3b66db70446830a2f" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 39203 } }
I20260709 13:08:53.966542 29047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b38eb974fe54bb6a799876978d3ba4c" candidate_uuid: "ee4d8c8df06e4c04ad53ac25013d8a78" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3fc42b9680245f3b66db70446830a2f" is_pre_election: true
I20260709 13:08:53.967540 29047 raft_consensus.cc:2468] T 2b38eb974fe54bb6a799876978d3ba4c P e3fc42b9680245f3b66db70446830a2f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee4d8c8df06e4c04ad53ac25013d8a78 in term 0.
I20260709 13:08:53.970144 29089 ts_tablet_manager.cc:1434] T 451e3f8929ef4287a9eaa8941486e9cc P 0284f1db8c204657b7b423bab5b2eb4f: Time spent starting tablet: real 0.019s	user 0.008s	sys 0.000s
I20260709 13:08:53.971206 29089 tablet_bootstrap.cc:492] T 4b9944472adf4cec929d98a95851bef9 P 0284f1db8c204657b7b423bab5b2eb4f: Bootstrap starting.
I20260709 13:08:53.972776 28898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b38eb974fe54bb6a799876978d3ba4c" candidate_uuid: "ee4d8c8df06e4c04ad53ac25013d8a78" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0284f1db8c204657b7b423bab5b2eb4f" is_pre_election: true
I20260709 13:08:53.973717 28898 raft_consensus.cc:2468] T 2b38eb974fe54bb6a799876978d3ba4c P 0284f1db8c204657b7b423bab5b2eb4f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee4d8c8df06e4c04ad53ac25013d8a78 in term 0.
I20260709 13:08:53.976789 29089 tablet_bootstrap.cc:654] T 4b9944472adf4cec929d98a95851bef9 P 0284f1db8c204657b7b423bab5b2eb4f: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:53.977814 28938 leader_election.cc:304] T 2b38eb974fe54bb6a799876978d3ba4c P ee4d8c8df06e4c04ad53ac25013d8a78 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e3fc42b9680245f3b66db70446830a2f, ee4d8c8df06e4c04ad53ac25013d8a78; no voters: 
I20260709 13:08:53.980197 29124 raft_consensus.cc:493] T eb8f9bf7e0d24af88a04bda489298395 P ee4d8c8df06e4c04ad53ac25013d8a78 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:53.983408 29124 raft_consensus.cc:515] T eb8f9bf7e0d24af88a04bda489298395 P ee4d8c8df06e4c04ad53ac25013d8a78 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0284f1db8c204657b7b423bab5b2eb4f" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 39279 } } peers { permanent_uuid: "ee4d8c8df06e4c04ad53ac25013d8a78" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 41821 } } peers { permanent_uuid: "e3fc42b9680245f3b66db70446830a2f" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 39203 } }
I20260709 13:08:53.981040 29087 ts_tablet_manager.cc:1434] T 9f5d8f2d6f684a5b9702935fc8fd85a1 P ee4d8c8df06e4c04ad53ac25013d8a78: Time spent starting tablet: real 0.037s	user 0.009s	sys 0.027s
I20260709 13:08:53.986143 29124 leader_election.cc:290] T eb8f9bf7e0d24af88a04bda489298395 P ee4d8c8df06e4c04ad53ac25013d8a78 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0284f1db8c204657b7b423bab5b2eb4f (127.17.223.1:39279), e3fc42b9680245f3b66db70446830a2f (127.17.223.3:39203)
W20260709 13:08:53.989349 28938 leader_election.cc:343] T 4b9944472adf4cec929d98a95851bef9 P ee4d8c8df06e4c04ad53ac25013d8a78 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0284f1db8c204657b7b423bab5b2eb4f (127.17.223.1:39279): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:53.989960 28938 leader_election.cc:304] T 4b9944472adf4cec929d98a95851bef9 P ee4d8c8df06e4c04ad53ac25013d8a78 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee4d8c8df06e4c04ad53ac25013d8a78; no voters: 0284f1db8c204657b7b423bab5b2eb4f, e3fc42b9680245f3b66db70446830a2f
I20260709 13:08:53.991535 29124 raft_consensus.cc:2804] T 2b38eb974fe54bb6a799876978d3ba4c P ee4d8c8df06e4c04ad53ac25013d8a78 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:08:53.992035 29124 raft_consensus.cc:493] T 2b38eb974fe54bb6a799876978d3ba4c P ee4d8c8df06e4c04ad53ac25013d8a78 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:53.992460 29124 raft_consensus.cc:3060] T 2b38eb974fe54bb6a799876978d3ba4c P ee4d8c8df06e4c04ad53ac25013d8a78 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:54.001928 29087 tablet_bootstrap.cc:492] T 7087f0eae49f4f71b5769071b817f8f2 P ee4d8c8df06e4c04ad53ac25013d8a78: Bootstrap starting.
I20260709 13:08:54.005215 29092 raft_consensus.cc:493] T 0dfbae90dbc4407a9e01872b7d688d55 P 0284f1db8c204657b7b423bab5b2eb4f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:54.005810 29092 raft_consensus.cc:515] T 0dfbae90dbc4407a9e01872b7d688d55 P 0284f1db8c204657b7b423bab5b2eb4f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0284f1db8c204657b7b423bab5b2eb4f" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 39279 } } peers { permanent_uuid: "ee4d8c8df06e4c04ad53ac25013d8a78" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 41821 } } peers { permanent_uuid: "e3fc42b9680245f3b66db70446830a2f" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 39203 } }
I20260709 13:08:54.007930 29092 leader_election.cc:290] T 0dfbae90dbc4407a9e01872b7d688d55 P 0284f1db8c204657b7b423bab5b2eb4f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ee4d8c8df06e4c04ad53ac25013d8a78 (127.17.223.2:41821), e3fc42b9680245f3b66db70446830a2f (127.17.223.3:39203)
I20260709 13:08:54.009143 29087 tablet_bootstrap.cc:654] T 7087f0eae49f4f71b5769071b817f8f2 P ee4d8c8df06e4c04ad53ac25013d8a78: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:54.013023 29094 raft_consensus.cc:515] T 879bbeb7e3244e8a8e5ee375c020cb16 P ee4d8c8df06e4c04ad53ac25013d8a78 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0284f1db8c204657b7b423bab5b2eb4f" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 39279 } } peers { permanent_uuid: "ee4d8c8df06e4c04ad53ac25013d8a78" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 41821 } } peers { permanent_uuid: "e3fc42b9680245f3b66db70446830a2f" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 39203 } }
I20260709 13:08:54.014165 29089 tablet_bootstrap.cc:492] T 4b9944472adf4cec929d98a95851bef9 P 0284f1db8c204657b7b423bab5b2eb4f: No bootstrap required, opened a new log
I20260709 13:08:54.014804 29089 ts_tablet_manager.cc:1403] T 4b9944472adf4cec929d98a95851bef9 P 0284f1db8c204657b7b423bab5b2eb4f: Time spent bootstrapping tablet: real 0.044s	user 0.010s	sys 0.010s
I20260709 13:08:54.015177 29094 leader_election.cc:290] T 879bbeb7e3244e8a8e5ee375c020cb16 P ee4d8c8df06e4c04ad53ac25013d8a78 [CANDIDATE]: Term 1 election: Requested vote from peers 0284f1db8c204657b7b423bab5b2eb4f (127.17.223.1:39279), e3fc42b9680245f3b66db70446830a2f (127.17.223.3:39203)
I20260709 13:08:54.015769 29094 raft_consensus.cc:2749] T 4b9944472adf4cec929d98a95851bef9 P ee4d8c8df06e4c04ad53ac25013d8a78 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:08:54.016178 29088 tablet_bootstrap.cc:492] T 777f2e0112c34108b367c8a2ad2641e1 P e3fc42b9680245f3b66db70446830a2f: No bootstrap required, opened a new log
I20260709 13:08:54.017642 29088 ts_tablet_manager.cc:1403] T 777f2e0112c34108b367c8a2ad2641e1 P e3fc42b9680245f3b66db70446830a2f: Time spent bootstrapping tablet: real 0.193s	user 0.076s	sys 0.044s
I20260709 13:08:54.019078 28899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb8f9bf7e0d24af88a04bda489298395" candidate_uuid: "ee4d8c8df06e4c04ad53ac25013d8a78" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0284f1db8c204657b7b423bab5b2eb4f" is_pre_election: true
I20260709 13:08:54.019761 28899 raft_consensus.cc:2468] T eb8f9bf7e0d24af88a04bda489298395 P 0284f1db8c204657b7b423bab5b2eb4f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee4d8c8df06e4c04ad53ac25013d8a78 in term 0.
I20260709 13:08:54.019789 29047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb8f9bf7e0d24af88a04bda489298395" candidate_uuid: "ee4d8c8df06e4c04ad53ac25013d8a78" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3fc42b9680245f3b66db70446830a2f" is_pre_election: true
I20260709 13:08:54.020555 29047 raft_consensus.cc:2468] T eb8f9bf7e0d24af88a04bda489298395 P e3fc42b9680245f3b66db70446830a2f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee4d8c8df06e4c04ad53ac25013d8a78 in term 0.
I20260709 13:08:54.021827 28899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "879bbeb7e3244e8a8e5ee375c020cb16" candidate_uuid: "ee4d8c8df06e4c04ad53ac25013d8a78" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0284f1db8c204657b7b423bab5b2eb4f"
I20260709 13:08:54.022099 29047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "879bbeb7e3244e8a8e5ee375c020cb16" candidate_uuid: "ee4d8c8df06e4c04ad53ac25013d8a78" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3fc42b9680245f3b66db70446830a2f"
I20260709 13:08:54.022639 28899 raft_consensus.cc:3060] T 879bbeb7e3244e8a8e5ee375c020cb16 P 0284f1db8c204657b7b423bab5b2eb4f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:54.023476 29128 raft_consensus.cc:493] T 0dfbae90dbc4407a9e01872b7d688d55 P ee4d8c8df06e4c04ad53ac25013d8a78 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:54.023952 29128 raft_consensus.cc:515] T 0dfbae90dbc4407a9e01872b7d688d55 P ee4d8c8df06e4c04ad53ac25013d8a78 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0284f1db8c204657b7b423bab5b2eb4f" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 39279 } } peers { permanent_uuid: "ee4d8c8df06e4c04ad53ac25013d8a78" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 41821 } } peers { permanent_uuid: "e3fc42b9680245f3b66db70446830a2f" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 39203 } }
I20260709 13:08:54.025108 29124 raft_consensus.cc:515] T 2b38eb974fe54bb6a799876978d3ba4c P ee4d8c8df06e4c04ad53ac25013d8a78 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee4d8c8df06e4c04ad53ac25013d8a78" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 41821 } } peers { permanent_uuid: "e3fc42b9680245f3b66db70446830a2f" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 39203 } } peers { permanent_uuid: "0284f1db8c204657b7b423bab5b2eb4f" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 39279 } }
I20260709 13:08:54.026075 29128 leader_election.cc:290] T 0dfbae90dbc4407a9e01872b7d688d55 P ee4d8c8df06e4c04ad53ac25013d8a78 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0284f1db8c204657b7b423bab5b2eb4f (127.17.223.1:39279), e3fc42b9680245f3b66db70446830a2f (127.17.223.3:39203)
I20260709 13:08:54.027171 29124 leader_election.cc:290] T 2b38eb974fe54bb6a799876978d3ba4c P ee4d8c8df06e4c04ad53ac25013d8a78 [CANDIDATE]: Term 1 election: Requested vote from peers e3fc42b9680245f3b66db70446830a2f (127.17.223.3:39203), 0284f1db8c204657b7b423bab5b2eb4f (127.17.223.1:39279)
I20260709 13:08:54.027215 28974 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f5d8f2d6f684a5b9702935fc8fd85a1" candidate_uuid: "e3fc42b9680245f3b66db70446830a2f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ee4d8c8df06e4c04ad53ac25013d8a78" is_pre_election: true
I20260709 13:08:54.027817 28973 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb8f9bf7e0d24af88a04bda489298395" candidate_uuid: "e3fc42b9680245f3b66db70446830a2f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ee4d8c8df06e4c04ad53ac25013d8a78" is_pre_election: true
I20260709 13:08:54.028117 28974 raft_consensus.cc:2468] T 9f5d8f2d6f684a5b9702935fc8fd85a1 P ee4d8c8df06e4c04ad53ac25013d8a78 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3fc42b9680245f3b66db70446830a2f in term 0.
I20260709 13:08:54.028211 28938 leader_election.cc:304] T eb8f9bf7e0d24af88a04bda489298395 P ee4d8c8df06e4c04ad53ac25013d8a78 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0284f1db8c204657b7b423bab5b2eb4f, ee4d8c8df06e4c04ad53ac25013d8a78; no voters: 
I20260709 13:08:54.028494 28973 raft_consensus.cc:2468] T eb8f9bf7e0d24af88a04bda489298395 P ee4d8c8df06e4c04ad53ac25013d8a78 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3fc42b9680245f3b66db70446830a2f in term 0.
I20260709 13:08:54.029011 29087 tablet_bootstrap.cc:492] T 7087f0eae49f4f71b5769071b817f8f2 P ee4d8c8df06e4c04ad53ac25013d8a78: No bootstrap required, opened a new log
I20260709 13:08:54.029505 29087 ts_tablet_manager.cc:1403] T 7087f0eae49f4f71b5769071b817f8f2 P ee4d8c8df06e4c04ad53ac25013d8a78: Time spent bootstrapping tablet: real 0.028s	user 0.016s	sys 0.000s
I20260709 13:08:54.029564 28972 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f5d8f2d6f684a5b9702935fc8fd85a1" candidate_uuid: "e3fc42b9680245f3b66db70446830a2f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ee4d8c8df06e4c04ad53ac25013d8a78"
I20260709 13:08:54.029958 29094 raft_consensus.cc:2804] T eb8f9bf7e0d24af88a04bda489298395 P ee4d8c8df06e4c04ad53ac25013d8a78 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:08:54.030084 28898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0dfbae90dbc4407a9e01872b7d688d55" candidate_uuid: "ee4d8c8df06e4c04ad53ac25013d8a78" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0284f1db8c204657b7b423bab5b2eb4f" is_pre_election: true
I20260709 13:08:54.030503 29094 raft_consensus.cc:493] T eb8f9bf7e0d24af88a04bda489298395 P ee4d8c8df06e4c04ad53ac25013d8a78 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:54.030936 28898 raft_consensus.cc:2468] T 0dfbae90dbc4407a9e01872b7d688d55 P 0284f1db8c204657b7b423bab5b2eb4f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee4d8c8df06e4c04ad53ac25013d8a78 in term 0.
I20260709 13:08:54.030256 28972 raft_consensus.cc:3060] T 9f5d8f2d6f684a5b9702935fc8fd85a1 P ee4d8c8df06e4c04ad53ac25013d8a78 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:54.032405 29047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0dfbae90dbc4407a9e01872b7d688d55" candidate_uuid: "ee4d8c8df06e4c04ad53ac25013d8a78" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3fc42b9680245f3b66db70446830a2f" is_pre_election: true
I20260709 13:08:54.033102 29048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b38eb974fe54bb6a799876978d3ba4c" candidate_uuid: "ee4d8c8df06e4c04ad53ac25013d8a78" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3fc42b9680245f3b66db70446830a2f"
I20260709 13:08:54.033661 29048 raft_consensus.cc:3060] T 2b38eb974fe54bb6a799876978d3ba4c P e3fc42b9680245f3b66db70446830a2f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:54.033816 28898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b38eb974fe54bb6a799876978d3ba4c" candidate_uuid: "ee4d8c8df06e4c04ad53ac25013d8a78" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0284f1db8c204657b7b423bab5b2eb4f"
I20260709 13:08:54.034372 28898 raft_consensus.cc:3060] T 2b38eb974fe54bb6a799876978d3ba4c P 0284f1db8c204657b7b423bab5b2eb4f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:54.039160 28972 raft_consensus.cc:2468] T 9f5d8f2d6f684a5b9702935fc8fd85a1 P ee4d8c8df06e4c04ad53ac25013d8a78 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3fc42b9680245f3b66db70446830a2f in term 1.
I20260709 13:08:54.030989 29094 raft_consensus.cc:3060] T eb8f9bf7e0d24af88a04bda489298395 P ee4d8c8df06e4c04ad53ac25013d8a78 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:54.039470 28899 raft_consensus.cc:2468] T 879bbeb7e3244e8a8e5ee375c020cb16 P 0284f1db8c204657b7b423bab5b2eb4f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee4d8c8df06e4c04ad53ac25013d8a78 in term 1.
I20260709 13:08:54.042392 29048 raft_consensus.cc:2468] T 2b38eb974fe54bb6a799876978d3ba4c P e3fc42b9680245f3b66db70446830a2f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee4d8c8df06e4c04ad53ac25013d8a78 in term 1.
I20260709 13:08:54.042801 29012 leader_election.cc:304] T eb8f9bf7e0d24af88a04bda489298395 P e3fc42b9680245f3b66db70446830a2f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e3fc42b9680245f3b66db70446830a2f, ee4d8c8df06e4c04ad53ac25013d8a78; no voters: 0284f1db8c204657b7b423bab5b2eb4f
I20260709 13:08:54.042948 29087 raft_consensus.cc:359] T 7087f0eae49f4f71b5769071b817f8f2 P ee4d8c8df06e4c04ad53ac25013d8a78 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0284f1db8c204657b7b423bab5b2eb4f" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 39279 } } peers { permanent_uuid: "ee4d8c8df06e4c04ad53ac25013d8a78" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 41821 } } peers { permanent_uuid: "e3fc42b9680245f3b66db70446830a2f" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 39203 } }
I20260709 13:08:54.043655 29087 raft_consensus.cc:385] T 7087f0eae49f4f71b5769071b817f8f2 P ee4d8c8df06e4c04ad53ac25013d8a78 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:54.043776 29106 raft_consensus.cc:2804] T eb8f9bf7e0d24af88a04bda489298395 P e3fc42b9680245f3b66db70446830a2f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:08:54.043591 29089 raft_consensus.cc:359] T 4b9944472adf4cec929d98a95851bef9 P 0284f1db8c204657b7b423bab5b2eb4f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0284f1db8c204657b7b423bab5b2eb4f" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 39279 } } peers { permanent_uuid: "ee4d8c8df06e4c04ad53ac25013d8a78" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 41821 } } peers { permanent_uuid: "e3fc42b9680245f3b66db70446830a2f" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 39203 } }
I20260709 13:08:54.044284 29087 raft_consensus.cc:740] T 7087f0eae49f4f71b5769071b817f8f2 P ee4d8c8df06e4c04ad53ac25013d8a78 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ee4d8c8df06e4c04ad53ac25013d8a78, State: Initialized, Role: FOLLOWER
I20260709 13:08:54.042817 29088 raft_consensus.cc:359] T 777f2e0112c34108b367c8a2ad2641e1 P e3fc42b9680245f3b66db70446830a2f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0284f1db8c204657b7b423bab5b2eb4f" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 39279 } } peers { permanent_uuid: "ee4d8c8df06e4c04ad53ac25013d8a78" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 41821 } } peers { permanent_uuid: "e3fc42b9680245f3b66db70446830a2f" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 39203 } }
I20260709 13:08:54.044497 29106 raft_consensus.cc:493] T eb8f9bf7e0d24af88a04bda489298395 P e3fc42b9680245f3b66db70446830a2f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:54.044596 29089 raft_consensus.cc:385] T 4b9944472adf4cec929d98a95851bef9 P 0284f1db8c204657b7b423bab5b2eb4f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:54.044850 29088 raft_consensus.cc:385] T 777f2e0112c34108b367c8a2ad2641e1 P e3fc42b9680245f3b66db70446830a2f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:54.045027 29106 raft_consensus.cc:3060] T eb8f9bf7e0d24af88a04bda489298395 P e3fc42b9680245f3b66db70446830a2f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:54.045069 29089 raft_consensus.cc:740] T 4b9944472adf4cec929d98a95851bef9 P 0284f1db8c204657b7b423bab5b2eb4f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0284f1db8c204657b7b423bab5b2eb4f, State: Initialized, Role: FOLLOWER
I20260709 13:08:54.045324 29088 raft_consensus.cc:740] T 777f2e0112c34108b367c8a2ad2641e1 P e3fc42b9680245f3b66db70446830a2f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e3fc42b9680245f3b66db70446830a2f, State: Initialized, Role: FOLLOWER
I20260709 13:08:54.046144 29089 consensus_queue.cc:260] T 4b9944472adf4cec929d98a95851bef9 P 0284f1db8c204657b7b423bab5b2eb4f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0284f1db8c204657b7b423bab5b2eb4f" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 39279 } } peers { permanent_uuid: "ee4d8c8df06e4c04ad53ac25013d8a78" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 41821 } } peers { permanent_uuid: "e3fc42b9680245f3b66db70446830a2f" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 39203 } }
I20260709 13:08:54.046432 29088 consensus_queue.cc:260] T 777f2e0112c34108b367c8a2ad2641e1 P e3fc42b9680245f3b66db70446830a2f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0284f1db8c204657b7b423bab5b2eb4f" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 39279 } } peers { permanent_uuid: "ee4d8c8df06e4c04ad53ac25013d8a78" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 41821 } } peers { permanent_uuid: "e3fc42b9680245f3b66db70446830a2f" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 39203 } }
I20260709 13:08:54.048388 29089 ts_tablet_manager.cc:1434] T 4b9944472adf4cec929d98a95851bef9 P 0284f1db8c204657b7b423bab5b2eb4f: Time spent starting tablet: real 0.033s	user 0.006s	sys 0.000s
I20260709 13:08:54.048709 29088 ts_tablet_manager.cc:1434] T 777f2e0112c34108b367c8a2ad2641e1 P e3fc42b9680245f3b66db70446830a2f: Time spent starting tablet: real 0.031s	user 0.004s	sys 0.002s
I20260709 13:08:54.049603 29089 tablet_bootstrap.cc:492] T 5d6b9266d4e74616b08d4e9697a83924 P 0284f1db8c204657b7b423bab5b2eb4f: Bootstrap starting.
I20260709 13:08:54.045254 29087 consensus_queue.cc:260] T 7087f0eae49f4f71b5769071b817f8f2 P ee4d8c8df06e4c04ad53ac25013d8a78 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0284f1db8c204657b7b423bab5b2eb4f" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 39279 } } peers { permanent_uuid: "ee4d8c8df06e4c04ad53ac25013d8a78" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 41821 } } peers { permanent_uuid: "e3fc42b9680245f3b66db70446830a2f" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 39203 } }
W20260709 13:08:54.051029 28938 leader_election.cc:343] T 879bbeb7e3244e8a8e5ee375c020cb16 P ee4d8c8df06e4c04ad53ac25013d8a78 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer e3fc42b9680245f3b66db70446830a2f (127.17.223.3:39203): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:08:54.051725 28938 leader_election.cc:343] T 0dfbae90dbc4407a9e01872b7d688d55 P ee4d8c8df06e4c04ad53ac25013d8a78 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e3fc42b9680245f3b66db70446830a2f (127.17.223.3:39203): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:54.052366 28938 leader_election.cc:304] T 2b38eb974fe54bb6a799876978d3ba4c P ee4d8c8df06e4c04ad53ac25013d8a78 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e3fc42b9680245f3b66db70446830a2f, ee4d8c8df06e4c04ad53ac25013d8a78; no voters: 
I20260709 13:08:54.053978 28898 raft_consensus.cc:2468] T 2b38eb974fe54bb6a799876978d3ba4c P 0284f1db8c204657b7b423bab5b2eb4f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee4d8c8df06e4c04ad53ac25013d8a78 in term 1.
I20260709 13:08:54.049808 29088 tablet_bootstrap.cc:492] T 4b9944472adf4cec929d98a95851bef9 P e3fc42b9680245f3b66db70446830a2f: Bootstrap starting.
I20260709 13:08:54.056071 29087 ts_tablet_manager.cc:1434] T 7087f0eae49f4f71b5769071b817f8f2 P ee4d8c8df06e4c04ad53ac25013d8a78: Time spent starting tablet: real 0.026s	user 0.008s	sys 0.000s
I20260709 13:08:54.056437 29089 tablet_bootstrap.cc:654] T 5d6b9266d4e74616b08d4e9697a83924 P 0284f1db8c204657b7b423bab5b2eb4f: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:54.057049 29087 tablet_bootstrap.cc:492] T 5d6b9266d4e74616b08d4e9697a83924 P ee4d8c8df06e4c04ad53ac25013d8a78: Bootstrap starting.
I20260709 13:08:54.061674 29128 raft_consensus.cc:2804] T 2b38eb974fe54bb6a799876978d3ba4c P ee4d8c8df06e4c04ad53ac25013d8a78 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:08:54.069445 29094 raft_consensus.cc:515] T eb8f9bf7e0d24af88a04bda489298395 P ee4d8c8df06e4c04ad53ac25013d8a78 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0284f1db8c204657b7b423bab5b2eb4f" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 39279 } } peers { permanent_uuid: "ee4d8c8df06e4c04ad53ac25013d8a78" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 41821 } } peers { permanent_uuid: "e3fc42b9680245f3b66db70446830a2f" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 39203 } }
I20260709 13:08:54.070106 29124 raft_consensus.cc:493] T 777f2e0112c34108b367c8a2ad2641e1 P ee4d8c8df06e4c04ad53ac25013d8a78 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:54.070755 29124 raft_consensus.cc:515] T 777f2e0112c34108b367c8a2ad2641e1 P ee4d8c8df06e4c04ad53ac25013d8a78 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0284f1db8c204657b7b423bab5b2eb4f" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 39279 } } peers { permanent_uuid: "ee4d8c8df06e4c04ad53ac25013d8a78" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 41821 } } peers { permanent_uuid: "e3fc42b9680245f3b66db70446830a2f" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 39203 } }
I20260709 13:08:54.071907 29094 leader_election.cc:290] T eb8f9bf7e0d24af88a04bda489298395 P ee4d8c8df06e4c04ad53ac25013d8a78 [CANDIDATE]: Term 1 election: Requested vote from peers 0284f1db8c204657b7b423bab5b2eb4f (127.17.223.1:39279), e3fc42b9680245f3b66db70446830a2f (127.17.223.3:39203)
I20260709 13:08:54.072825 29124 leader_election.cc:290] T 777f2e0112c34108b367c8a2ad2641e1 P ee4d8c8df06e4c04ad53ac25013d8a78 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0284f1db8c204657b7b423bab5b2eb4f (127.17.223.1:39279), e3fc42b9680245f3b66db70446830a2f (127.17.223.3:39203)
I20260709 13:08:54.072980 29087 tablet_bootstrap.cc:654] T 5d6b9266d4e74616b08d4e9697a83924 P ee4d8c8df06e4c04ad53ac25013d8a78: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:54.085388 29106 raft_consensus.cc:515] T eb8f9bf7e0d24af88a04bda489298395 P e3fc42b9680245f3b66db70446830a2f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0284f1db8c204657b7b423bab5b2eb4f" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 39279 } } peers { permanent_uuid: "ee4d8c8df06e4c04ad53ac25013d8a78" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 41821 } } peers { permanent_uuid: "e3fc42b9680245f3b66db70446830a2f" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 39203 } }
I20260709 13:08:54.095464 29088 tablet_bootstrap.cc:654] T 4b9944472adf4cec929d98a95851bef9 P e3fc42b9680245f3b66db70446830a2f: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:54.101133 28898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb8f9bf7e0d24af88a04bda489298395" candidate_uuid: "ee4d8c8df06e4c04ad53ac25013d8a78" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0284f1db8c204657b7b423bab5b2eb4f"
I20260709 13:08:54.101850 28898 raft_consensus.cc:3060] T eb8f9bf7e0d24af88a04bda489298395 P 0284f1db8c204657b7b423bab5b2eb4f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:54.103139 28899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "777f2e0112c34108b367c8a2ad2641e1" candidate_uuid: "ee4d8c8df06e4c04ad53ac25013d8a78" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0284f1db8c204657b7b423bab5b2eb4f" is_pre_election: true
I20260709 13:08:54.103886 28899 raft_consensus.cc:2468] T 777f2e0112c34108b367c8a2ad2641e1 P 0284f1db8c204657b7b423bab5b2eb4f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee4d8c8df06e4c04ad53ac25013d8a78 in term 0.
I20260709 13:08:54.104190 29047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "777f2e0112c34108b367c8a2ad2641e1" candidate_uuid: "ee4d8c8df06e4c04ad53ac25013d8a78" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3fc42b9680245f3b66db70446830a2f" is_pre_election: true
I20260709 13:08:54.104823 29047 raft_consensus.cc:2468] T 777f2e0112c34108b367c8a2ad2641e1 P e3fc42b9680245f3b66db70446830a2f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee4d8c8df06e4c04ad53ac25013d8a78 in term 0.
I20260709 13:08:54.108355 28899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb8f9bf7e0d24af88a04bda489298395" candidate_uuid: "e3fc42b9680245f3b66db70446830a2f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0284f1db8c204657b7b423bab5b2eb4f"
I20260709 13:08:54.108408 28972 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7087f0eae49f4f71b5769071b817f8f2" candidate_uuid: "0284f1db8c204657b7b423bab5b2eb4f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ee4d8c8df06e4c04ad53ac25013d8a78" is_pre_election: true
I20260709 13:08:54.108556 29048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb8f9bf7e0d24af88a04bda489298395" candidate_uuid: "ee4d8c8df06e4c04ad53ac25013d8a78" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3fc42b9680245f3b66db70446830a2f"
I20260709 13:08:54.109351 28972 raft_consensus.cc:2468] T 7087f0eae49f4f71b5769071b817f8f2 P ee4d8c8df06e4c04ad53ac25013d8a78 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0284f1db8c204657b7b423bab5b2eb4f in term 0.
I20260709 13:08:54.109576 29048 raft_consensus.cc:2393] T eb8f9bf7e0d24af88a04bda489298395 P e3fc42b9680245f3b66db70446830a2f [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate ee4d8c8df06e4c04ad53ac25013d8a78 in current term 1: Already voted for candidate e3fc42b9680245f3b66db70446830a2f in this term.
I20260709 13:08:54.111099 28972 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0dfbae90dbc4407a9e01872b7d688d55" candidate_uuid: "0284f1db8c204657b7b423bab5b2eb4f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ee4d8c8df06e4c04ad53ac25013d8a78" is_pre_election: true
I20260709 13:08:54.111714 28972 raft_consensus.cc:2468] T 0dfbae90dbc4407a9e01872b7d688d55 P ee4d8c8df06e4c04ad53ac25013d8a78 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0284f1db8c204657b7b423bab5b2eb4f in term 0.
I20260709 13:08:54.112586 28938 leader_election.cc:304] T 0dfbae90dbc4407a9e01872b7d688d55 P ee4d8c8df06e4c04ad53ac25013d8a78 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0284f1db8c204657b7b423bab5b2eb4f, ee4d8c8df06e4c04ad53ac25013d8a78; no voters: e3fc42b9680245f3b66db70446830a2f
I20260709 13:08:54.113765 29124 raft_consensus.cc:2804] T 0dfbae90dbc4407a9e01872b7d688d55 P ee4d8c8df06e4c04ad53ac25013d8a78 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:08:54.114125 29124 raft_consensus.cc:493] T 0dfbae90dbc4407a9e01872b7d688d55 P ee4d8c8df06e4c04ad53ac25013d8a78 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:54.114459 29124 raft_consensus.cc:3060] T 0dfbae90dbc4407a9e01872b7d688d55 P ee4d8c8df06e4c04ad53ac25013d8a78 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:54.117300 29106 leader_election.cc:290] T eb8f9bf7e0d24af88a04bda489298395 P e3fc42b9680245f3b66db70446830a2f [CANDIDATE]: Term 1 election: Requested vote from peers 0284f1db8c204657b7b423bab5b2eb4f (127.17.223.1:39279), ee4d8c8df06e4c04ad53ac25013d8a78 (127.17.223.2:41821)
I20260709 13:08:54.117409 29092 raft_consensus.cc:493] T 451e3f8929ef4287a9eaa8941486e9cc P 0284f1db8c204657b7b423bab5b2eb4f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:54.117976 29092 raft_consensus.cc:515] T 451e3f8929ef4287a9eaa8941486e9cc P 0284f1db8c204657b7b423bab5b2eb4f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0284f1db8c204657b7b423bab5b2eb4f" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 39279 } } peers { permanent_uuid: "ee4d8c8df06e4c04ad53ac25013d8a78" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 41821 } } peers { permanent_uuid: "e3fc42b9680245f3b66db70446830a2f" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 39203 } }
I20260709 13:08:54.120286 29092 leader_election.cc:290] T 451e3f8929ef4287a9eaa8941486e9cc P 0284f1db8c204657b7b423bab5b2eb4f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ee4d8c8df06e4c04ad53ac25013d8a78 (127.17.223.2:41821), e3fc42b9680245f3b66db70446830a2f (127.17.223.3:39203)
I20260709 13:08:54.121410 29128 raft_consensus.cc:697] T 2b38eb974fe54bb6a799876978d3ba4c P ee4d8c8df06e4c04ad53ac25013d8a78 [term 1 LEADER]: Becoming Leader. State: Replica: ee4d8c8df06e4c04ad53ac25013d8a78, State: Running, Role: LEADER
I20260709 13:08:54.121502 29046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "451e3f8929ef4287a9eaa8941486e9cc" candidate_uuid: "0284f1db8c204657b7b423bab5b2eb4f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3fc42b9680245f3b66db70446830a2f" is_pre_election: true
I20260709 13:08:54.122058 29124 raft_consensus.cc:515] T 0dfbae90dbc4407a9e01872b7d688d55 P ee4d8c8df06e4c04ad53ac25013d8a78 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0284f1db8c204657b7b423bab5b2eb4f" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 39279 } } peers { permanent_uuid: "ee4d8c8df06e4c04ad53ac25013d8a78" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 41821 } } peers { permanent_uuid: "e3fc42b9680245f3b66db70446830a2f" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 39203 } }
I20260709 13:08:54.122362 29128 consensus_queue.cc:237] T 2b38eb974fe54bb6a799876978d3ba4c P ee4d8c8df06e4c04ad53ac25013d8a78 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee4d8c8df06e4c04ad53ac25013d8a78" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 41821 } } peers { permanent_uuid: "e3fc42b9680245f3b66db70446830a2f" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 39203 } } peers { permanent_uuid: "0284f1db8c204657b7b423bab5b2eb4f" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 39279 } }
I20260709 13:08:54.123394 29048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7087f0eae49f4f71b5769071b817f8f2" candidate_uuid: "0284f1db8c204657b7b423bab5b2eb4f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3fc42b9680245f3b66db70446830a2f" is_pre_election: true
I20260709 13:08:54.124927 29047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0dfbae90dbc4407a9e01872b7d688d55" candidate_uuid: "0284f1db8c204657b7b423bab5b2eb4f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3fc42b9680245f3b66db70446830a2f" is_pre_election: true
I20260709 13:08:54.113775 28938 leader_election.cc:304] T 879bbeb7e3244e8a8e5ee375c020cb16 P ee4d8c8df06e4c04ad53ac25013d8a78 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0284f1db8c204657b7b423bab5b2eb4f, ee4d8c8df06e4c04ad53ac25013d8a78; no voters: e3fc42b9680245f3b66db70446830a2f
I20260709 13:08:54.127655 28898 raft_consensus.cc:2468] T eb8f9bf7e0d24af88a04bda489298395 P 0284f1db8c204657b7b423bab5b2eb4f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee4d8c8df06e4c04ad53ac25013d8a78 in term 1.
I20260709 13:08:54.126108 29124 leader_election.cc:290] T 0dfbae90dbc4407a9e01872b7d688d55 P ee4d8c8df06e4c04ad53ac25013d8a78 [CANDIDATE]: Term 1 election: Requested vote from peers 0284f1db8c204657b7b423bab5b2eb4f (127.17.223.1:39279), e3fc42b9680245f3b66db70446830a2f (127.17.223.3:39203)
W20260709 13:08:54.126497 28863 leader_election.cc:343] T 451e3f8929ef4287a9eaa8941486e9cc P 0284f1db8c204657b7b423bab5b2eb4f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e3fc42b9680245f3b66db70446830a2f (127.17.223.3:39203): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:54.128767 29132 raft_consensus.cc:2804] T 879bbeb7e3244e8a8e5ee375c020cb16 P ee4d8c8df06e4c04ad53ac25013d8a78 [term 1 FOLLOWER]: Leader election won for term 1
W20260709 13:08:54.128906 28863 leader_election.cc:343] T 7087f0eae49f4f71b5769071b817f8f2 P 0284f1db8c204657b7b423bab5b2eb4f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e3fc42b9680245f3b66db70446830a2f (127.17.223.3:39203): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:54.129366 29132 raft_consensus.cc:697] T 879bbeb7e3244e8a8e5ee375c020cb16 P ee4d8c8df06e4c04ad53ac25013d8a78 [term 1 LEADER]: Becoming Leader. State: Replica: ee4d8c8df06e4c04ad53ac25013d8a78, State: Running, Role: LEADER
W20260709 13:08:54.129609 28863 leader_election.cc:343] T 0dfbae90dbc4407a9e01872b7d688d55 P 0284f1db8c204657b7b423bab5b2eb4f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e3fc42b9680245f3b66db70446830a2f (127.17.223.3:39203): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:54.130239 29132 consensus_queue.cc:237] T 879bbeb7e3244e8a8e5ee375c020cb16 P ee4d8c8df06e4c04ad53ac25013d8a78 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0284f1db8c204657b7b423bab5b2eb4f" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 39279 } } peers { permanent_uuid: "ee4d8c8df06e4c04ad53ac25013d8a78" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 41821 } } peers { permanent_uuid: "e3fc42b9680245f3b66db70446830a2f" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 39203 } }
I20260709 13:08:54.128093 28938 leader_election.cc:304] T 777f2e0112c34108b367c8a2ad2641e1 P ee4d8c8df06e4c04ad53ac25013d8a78 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0284f1db8c204657b7b423bab5b2eb4f, ee4d8c8df06e4c04ad53ac25013d8a78; no voters: 
I20260709 13:08:54.133371 28863 leader_election.cc:304] T 7087f0eae49f4f71b5769071b817f8f2 P 0284f1db8c204657b7b423bab5b2eb4f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0284f1db8c204657b7b423bab5b2eb4f, ee4d8c8df06e4c04ad53ac25013d8a78; no voters: e3fc42b9680245f3b66db70446830a2f
I20260709 13:08:54.134222 29092 raft_consensus.cc:2804] T 7087f0eae49f4f71b5769071b817f8f2 P 0284f1db8c204657b7b423bab5b2eb4f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:08:54.134600 29092 raft_consensus.cc:493] T 7087f0eae49f4f71b5769071b817f8f2 P 0284f1db8c204657b7b423bab5b2eb4f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:54.134961 29092 raft_consensus.cc:3060] T 7087f0eae49f4f71b5769071b817f8f2 P 0284f1db8c204657b7b423bab5b2eb4f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:54.135308 28863 leader_election.cc:304] T 0dfbae90dbc4407a9e01872b7d688d55 P 0284f1db8c204657b7b423bab5b2eb4f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0284f1db8c204657b7b423bab5b2eb4f, ee4d8c8df06e4c04ad53ac25013d8a78; no voters: e3fc42b9680245f3b66db70446830a2f
I20260709 13:08:54.135340 29087 tablet_bootstrap.cc:492] T 5d6b9266d4e74616b08d4e9697a83924 P ee4d8c8df06e4c04ad53ac25013d8a78: No bootstrap required, opened a new log
I20260709 13:08:54.136704 29087 ts_tablet_manager.cc:1403] T 5d6b9266d4e74616b08d4e9697a83924 P ee4d8c8df06e4c04ad53ac25013d8a78: Time spent bootstrapping tablet: real 0.080s	user 0.016s	sys 0.014s
I20260709 13:08:54.140168 29087 raft_consensus.cc:359] T 5d6b9266d4e74616b08d4e9697a83924 P ee4d8c8df06e4c04ad53ac25013d8a78 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0284f1db8c204657b7b423bab5b2eb4f" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 39279 } } peers { permanent_uuid: "ee4d8c8df06e4c04ad53ac25013d8a78" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 41821 } } peers { permanent_uuid: "e3fc42b9680245f3b66db70446830a2f" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 39203 } }
I20260709 13:08:54.140969 29087 raft_consensus.cc:385] T 5d6b9266d4e74616b08d4e9697a83924 P ee4d8c8df06e4c04ad53ac25013d8a78 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:54.141276 29087 raft_consensus.cc:740] T 5d6b9266d4e74616b08d4e9697a83924 P ee4d8c8df06e4c04ad53ac25013d8a78 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ee4d8c8df06e4c04ad53ac25013d8a78, State: Initialized, Role: FOLLOWER
I20260709 13:08:54.142292 29128 raft_consensus.cc:2804] T 777f2e0112c34108b367c8a2ad2641e1 P ee4d8c8df06e4c04ad53ac25013d8a78 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:08:54.142302 29087 consensus_queue.cc:260] T 5d6b9266d4e74616b08d4e9697a83924 P ee4d8c8df06e4c04ad53ac25013d8a78 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0284f1db8c204657b7b423bab5b2eb4f" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 39279 } } peers { permanent_uuid: "ee4d8c8df06e4c04ad53ac25013d8a78" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 41821 } } peers { permanent_uuid: "e3fc42b9680245f3b66db70446830a2f" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 39203 } }
I20260709 13:08:54.140300 28796 catalog_manager.cc:5697] T 2b38eb974fe54bb6a799876978d3ba4c P ee4d8c8df06e4c04ad53ac25013d8a78 reported cstate change: term changed from 0 to 1, leader changed from <none> to ee4d8c8df06e4c04ad53ac25013d8a78 (127.17.223.2). New cstate: current_term: 1 leader_uuid: "ee4d8c8df06e4c04ad53ac25013d8a78" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee4d8c8df06e4c04ad53ac25013d8a78" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 41821 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e3fc42b9680245f3b66db70446830a2f" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 39203 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0284f1db8c204657b7b423bab5b2eb4f" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 39279 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:54.144706 29087 ts_tablet_manager.cc:1434] T 5d6b9266d4e74616b08d4e9697a83924 P ee4d8c8df06e4c04ad53ac25013d8a78: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 13:08:54.145900 28898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0dfbae90dbc4407a9e01872b7d688d55" candidate_uuid: "ee4d8c8df06e4c04ad53ac25013d8a78" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0284f1db8c204657b7b423bab5b2eb4f"
I20260709 13:08:54.145746 29092 raft_consensus.cc:515] T 7087f0eae49f4f71b5769071b817f8f2 P 0284f1db8c204657b7b423bab5b2eb4f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0284f1db8c204657b7b423bab5b2eb4f" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 39279 } } peers { permanent_uuid: "ee4d8c8df06e4c04ad53ac25013d8a78" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 41821 } } peers { permanent_uuid: "e3fc42b9680245f3b66db70446830a2f" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 39203 } }
I20260709 13:08:54.146653 29047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0dfbae90dbc4407a9e01872b7d688d55" candidate_uuid: "ee4d8c8df06e4c04ad53ac25013d8a78" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3fc42b9680245f3b66db70446830a2f"
I20260709 13:08:54.144289 29136 raft_consensus.cc:2804] T 0dfbae90dbc4407a9e01872b7d688d55 P 0284f1db8c204657b7b423bab5b2eb4f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:08:54.147855 28898 raft_consensus.cc:3060] T 0dfbae90dbc4407a9e01872b7d688d55 P 0284f1db8c204657b7b423bab5b2eb4f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:54.148808 29088 tablet_bootstrap.cc:492] T 4b9944472adf4cec929d98a95851bef9 P e3fc42b9680245f3b66db70446830a2f: No bootstrap required, opened a new log
I20260709 13:08:54.149324 29088 ts_tablet_manager.cc:1403] T 4b9944472adf4cec929d98a95851bef9 P e3fc42b9680245f3b66db70446830a2f: Time spent bootstrapping tablet: real 0.100s	user 0.012s	sys 0.002s
I20260709 13:08:54.149891 29092 leader_election.cc:290] T 7087f0eae49f4f71b5769071b817f8f2 P 0284f1db8c204657b7b423bab5b2eb4f [CANDIDATE]: Term 1 election: Requested vote from peers ee4d8c8df06e4c04ad53ac25013d8a78 (127.17.223.2:41821), e3fc42b9680245f3b66db70446830a2f (127.17.223.3:39203)
I20260709 13:08:54.143177 29128 raft_consensus.cc:493] T 777f2e0112c34108b367c8a2ad2641e1 P ee4d8c8df06e4c04ad53ac25013d8a78 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:54.150871 29128 raft_consensus.cc:3060] T 777f2e0112c34108b367c8a2ad2641e1 P ee4d8c8df06e4c04ad53ac25013d8a78 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:54.152364 29088 raft_consensus.cc:359] T 4b9944472adf4cec929d98a95851bef9 P e3fc42b9680245f3b66db70446830a2f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0284f1db8c204657b7b423bab5b2eb4f" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 39279 } } peers { permanent_uuid: "ee4d8c8df06e4c04ad53ac25013d8a78" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 41821 } } peers { permanent_uuid: "e3fc42b9680245f3b66db70446830a2f" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 39203 } }
I20260709 13:08:54.153086 29088 raft_consensus.cc:385] T 4b9944472adf4cec929d98a95851bef9 P e3fc42b9680245f3b66db70446830a2f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:54.153378 29088 raft_consensus.cc:740] T 4b9944472adf4cec929d98a95851bef9 P e3fc42b9680245f3b66db70446830a2f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e3fc42b9680245f3b66db70446830a2f, State: Initialized, Role: FOLLOWER
I20260709 13:08:54.154161 29088 consensus_queue.cc:260] T 4b9944472adf4cec929d98a95851bef9 P e3fc42b9680245f3b66db70446830a2f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0284f1db8c204657b7b423bab5b2eb4f" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 39279 } } peers { permanent_uuid: "ee4d8c8df06e4c04ad53ac25013d8a78" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 41821 } } peers { permanent_uuid: "e3fc42b9680245f3b66db70446830a2f" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 39203 } }
I20260709 13:08:54.155802 29047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7087f0eae49f4f71b5769071b817f8f2" candidate_uuid: "0284f1db8c204657b7b423bab5b2eb4f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3fc42b9680245f3b66db70446830a2f"
I20260709 13:08:54.156750 29088 ts_tablet_manager.cc:1434] T 4b9944472adf4cec929d98a95851bef9 P e3fc42b9680245f3b66db70446830a2f: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.004s
I20260709 13:08:54.157812 29088 tablet_bootstrap.cc:492] T 879bbeb7e3244e8a8e5ee375c020cb16 P e3fc42b9680245f3b66db70446830a2f: Bootstrap starting.
W20260709 13:08:54.157850 28863 leader_election.cc:343] T 7087f0eae49f4f71b5769071b817f8f2 P 0284f1db8c204657b7b423bab5b2eb4f [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer e3fc42b9680245f3b66db70446830a2f (127.17.223.3:39203): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:54.159389 28972 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb8f9bf7e0d24af88a04bda489298395" candidate_uuid: "e3fc42b9680245f3b66db70446830a2f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ee4d8c8df06e4c04ad53ac25013d8a78"
I20260709 13:08:54.160280 28972 raft_consensus.cc:2393] T eb8f9bf7e0d24af88a04bda489298395 P ee4d8c8df06e4c04ad53ac25013d8a78 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate e3fc42b9680245f3b66db70446830a2f in current term 1: Already voted for candidate ee4d8c8df06e4c04ad53ac25013d8a78 in this term.
W20260709 13:08:54.162276 28938 leader_election.cc:343] T 0dfbae90dbc4407a9e01872b7d688d55 P ee4d8c8df06e4c04ad53ac25013d8a78 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer e3fc42b9680245f3b66db70446830a2f (127.17.223.3:39203): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:54.165159 29088 tablet_bootstrap.cc:654] T 879bbeb7e3244e8a8e5ee375c020cb16 P e3fc42b9680245f3b66db70446830a2f: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:54.165616 28898 raft_consensus.cc:2468] T 0dfbae90dbc4407a9e01872b7d688d55 P 0284f1db8c204657b7b423bab5b2eb4f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee4d8c8df06e4c04ad53ac25013d8a78 in term 1.
I20260709 13:08:54.165179 29128 raft_consensus.cc:515] T 777f2e0112c34108b367c8a2ad2641e1 P ee4d8c8df06e4c04ad53ac25013d8a78 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0284f1db8c204657b7b423bab5b2eb4f" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 39279 } } peers { permanent_uuid: "ee4d8c8df06e4c04ad53ac25013d8a78" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 41821 } } peers { permanent_uuid: "e3fc42b9680245f3b66db70446830a2f" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 39203 } }
I20260709 13:08:54.166090 29136 raft_consensus.cc:493] T 0dfbae90dbc4407a9e01872b7d688d55 P 0284f1db8c204657b7b423bab5b2eb4f [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:54.166461 29136 raft_consensus.cc:3060] T 0dfbae90dbc4407a9e01872b7d688d55 P 0284f1db8c204657b7b423bab5b2eb4f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:54.167586 29128 leader_election.cc:290] T 777f2e0112c34108b367c8a2ad2641e1 P ee4d8c8df06e4c04ad53ac25013d8a78 [CANDIDATE]: Term 1 election: Requested vote from peers 0284f1db8c204657b7b423bab5b2eb4f (127.17.223.1:39279), e3fc42b9680245f3b66db70446830a2f (127.17.223.3:39203)
I20260709 13:08:54.172127 28972 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "451e3f8929ef4287a9eaa8941486e9cc" candidate_uuid: "0284f1db8c204657b7b423bab5b2eb4f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ee4d8c8df06e4c04ad53ac25013d8a78" is_pre_election: true
I20260709 13:08:54.173128 29089 tablet_bootstrap.cc:492] T 5d6b9266d4e74616b08d4e9697a83924 P 0284f1db8c204657b7b423bab5b2eb4f: No bootstrap required, opened a new log
I20260709 13:08:54.173040 28972 raft_consensus.cc:2468] T 451e3f8929ef4287a9eaa8941486e9cc P ee4d8c8df06e4c04ad53ac25013d8a78 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0284f1db8c204657b7b423bab5b2eb4f in term 0.
I20260709 13:08:54.173719 29089 ts_tablet_manager.cc:1403] T 5d6b9266d4e74616b08d4e9697a83924 P 0284f1db8c204657b7b423bab5b2eb4f: Time spent bootstrapping tablet: real 0.124s	user 0.028s	sys 0.044s
I20260709 13:08:54.174911 28972 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7087f0eae49f4f71b5769071b817f8f2" candidate_uuid: "0284f1db8c204657b7b423bab5b2eb4f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ee4d8c8df06e4c04ad53ac25013d8a78"
I20260709 13:08:54.175705 28972 raft_consensus.cc:3060] T 7087f0eae49f4f71b5769071b817f8f2 P ee4d8c8df06e4c04ad53ac25013d8a78 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:54.177284 29089 raft_consensus.cc:359] T 5d6b9266d4e74616b08d4e9697a83924 P 0284f1db8c204657b7b423bab5b2eb4f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0284f1db8c204657b7b423bab5b2eb4f" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 39279 } } peers { permanent_uuid: "ee4d8c8df06e4c04ad53ac25013d8a78" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 41821 } } peers { permanent_uuid: "e3fc42b9680245f3b66db70446830a2f" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 39203 } }
I20260709 13:08:54.178169 29089 raft_consensus.cc:385] T 5d6b9266d4e74616b08d4e9697a83924 P 0284f1db8c204657b7b423bab5b2eb4f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:54.178524 29089 raft_consensus.cc:740] T 5d6b9266d4e74616b08d4e9697a83924 P 0284f1db8c204657b7b423bab5b2eb4f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0284f1db8c204657b7b423bab5b2eb4f, State: Initialized, Role: FOLLOWER
I20260709 13:08:54.179490 29089 consensus_queue.cc:260] T 5d6b9266d4e74616b08d4e9697a83924 P 0284f1db8c204657b7b423bab5b2eb4f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0284f1db8c204657b7b423bab5b2eb4f" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 39279 } } peers { permanent_uuid: "ee4d8c8df06e4c04ad53ac25013d8a78" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 41821 } } peers { permanent_uuid: "e3fc42b9680245f3b66db70446830a2f" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 39203 } }
I20260709 13:08:54.183176 29088 tablet_bootstrap.cc:492] T 879bbeb7e3244e8a8e5ee375c020cb16 P e3fc42b9680245f3b66db70446830a2f: No bootstrap required, opened a new log
I20260709 13:08:54.183753 29088 ts_tablet_manager.cc:1403] T 879bbeb7e3244e8a8e5ee375c020cb16 P e3fc42b9680245f3b66db70446830a2f: Time spent bootstrapping tablet: real 0.026s	user 0.018s	sys 0.001s
I20260709 13:08:54.187342 28938 leader_election.cc:304] T eb8f9bf7e0d24af88a04bda489298395 P ee4d8c8df06e4c04ad53ac25013d8a78 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0284f1db8c204657b7b423bab5b2eb4f, ee4d8c8df06e4c04ad53ac25013d8a78; no voters: e3fc42b9680245f3b66db70446830a2f
I20260709 13:08:54.187577 29088 raft_consensus.cc:359] T 879bbeb7e3244e8a8e5ee375c020cb16 P e3fc42b9680245f3b66db70446830a2f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0284f1db8c204657b7b423bab5b2eb4f" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 39279 } } peers { permanent_uuid: "ee4d8c8df06e4c04ad53ac25013d8a78" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 41821 } } peers { permanent_uuid: "e3fc42b9680245f3b66db70446830a2f" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 39203 } }
I20260709 13:08:54.188608 29128 raft_consensus.cc:2804] T eb8f9bf7e0d24af88a04bda489298395 P ee4d8c8df06e4c04ad53ac25013d8a78 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:08:54.188649 29088 raft_consensus.cc:385] T 879bbeb7e3244e8a8e5ee375c020cb16 P e3fc42b9680245f3b66db70446830a2f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:54.189304 29128 raft_consensus.cc:697] T eb8f9bf7e0d24af88a04bda489298395 P ee4d8c8df06e4c04ad53ac25013d8a78 [term 1 LEADER]: Becoming Leader. State: Replica: ee4d8c8df06e4c04ad53ac25013d8a78, State: Running, Role: LEADER
I20260709 13:08:54.189281 29088 raft_consensus.cc:740] T 879bbeb7e3244e8a8e5ee375c020cb16 P e3fc42b9680245f3b66db70446830a2f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e3fc42b9680245f3b66db70446830a2f, State: Initialized, Role: FOLLOWER
I20260709 13:08:54.190590 29089 ts_tablet_manager.cc:1434] T 5d6b9266d4e74616b08d4e9697a83924 P 0284f1db8c204657b7b423bab5b2eb4f: Time spent starting tablet: real 0.017s	user 0.008s	sys 0.000s
I20260709 13:08:54.190583 29128 consensus_queue.cc:237] T eb8f9bf7e0d24af88a04bda489298395 P ee4d8c8df06e4c04ad53ac25013d8a78 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0284f1db8c204657b7b423bab5b2eb4f" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 39279 } } peers { permanent_uuid: "ee4d8c8df06e4c04ad53ac25013d8a78" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 41821 } } peers { permanent_uuid: "e3fc42b9680245f3b66db70446830a2f" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 39203 } }
I20260709 13:08:54.190912 29088 consensus_queue.cc:260] T 879bbeb7e3244e8a8e5ee375c020cb16 P e3fc42b9680245f3b66db70446830a2f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0284f1db8c204657b7b423bab5b2eb4f" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 39279 } } peers { permanent_uuid: "ee4d8c8df06e4c04ad53ac25013d8a78" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 41821 } } peers { permanent_uuid: "e3fc42b9680245f3b66db70446830a2f" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 39203 } }
I20260709 13:08:54.189242 29012 leader_election.cc:304] T eb8f9bf7e0d24af88a04bda489298395 P e3fc42b9680245f3b66db70446830a2f [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3fc42b9680245f3b66db70446830a2f; no voters: 0284f1db8c204657b7b423bab5b2eb4f, ee4d8c8df06e4c04ad53ac25013d8a78
I20260709 13:08:54.193715 29096 raft_consensus.cc:2749] T eb8f9bf7e0d24af88a04bda489298395 P e3fc42b9680245f3b66db70446830a2f [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:08:54.193763 29088 ts_tablet_manager.cc:1434] T 879bbeb7e3244e8a8e5ee375c020cb16 P e3fc42b9680245f3b66db70446830a2f: Time spent starting tablet: real 0.010s	user 0.004s	sys 0.003s
I20260709 13:08:54.195365 29088 tablet_bootstrap.cc:492] T 7087f0eae49f4f71b5769071b817f8f2 P e3fc42b9680245f3b66db70446830a2f: Bootstrap starting.
I20260709 13:08:54.196892 28899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "777f2e0112c34108b367c8a2ad2641e1" candidate_uuid: "ee4d8c8df06e4c04ad53ac25013d8a78" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0284f1db8c204657b7b423bab5b2eb4f"
I20260709 13:08:54.197500 28899 raft_consensus.cc:3060] T 777f2e0112c34108b367c8a2ad2641e1 P 0284f1db8c204657b7b423bab5b2eb4f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:54.201543 29088 tablet_bootstrap.cc:654] T 7087f0eae49f4f71b5769071b817f8f2 P e3fc42b9680245f3b66db70446830a2f: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:54.206815 28899 raft_consensus.cc:2468] T 777f2e0112c34108b367c8a2ad2641e1 P 0284f1db8c204657b7b423bab5b2eb4f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee4d8c8df06e4c04ad53ac25013d8a78 in term 1.
I20260709 13:08:54.208271 29088 tablet_bootstrap.cc:492] T 7087f0eae49f4f71b5769071b817f8f2 P e3fc42b9680245f3b66db70446830a2f: No bootstrap required, opened a new log
I20260709 13:08:54.208747 29047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "777f2e0112c34108b367c8a2ad2641e1" candidate_uuid: "ee4d8c8df06e4c04ad53ac25013d8a78" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3fc42b9680245f3b66db70446830a2f"
I20260709 13:08:54.208314 28938 leader_election.cc:304] T 0dfbae90dbc4407a9e01872b7d688d55 P ee4d8c8df06e4c04ad53ac25013d8a78 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0284f1db8c204657b7b423bab5b2eb4f, ee4d8c8df06e4c04ad53ac25013d8a78; no voters: e3fc42b9680245f3b66db70446830a2f
I20260709 13:08:54.209540 29047 raft_consensus.cc:3060] T 777f2e0112c34108b367c8a2ad2641e1 P e3fc42b9680245f3b66db70446830a2f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:54.210036 29128 raft_consensus.cc:2804] T 0dfbae90dbc4407a9e01872b7d688d55 P ee4d8c8df06e4c04ad53ac25013d8a78 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:08:54.210573 29128 raft_consensus.cc:697] T 0dfbae90dbc4407a9e01872b7d688d55 P ee4d8c8df06e4c04ad53ac25013d8a78 [term 1 LEADER]: Becoming Leader. State: Replica: ee4d8c8df06e4c04ad53ac25013d8a78, State: Running, Role: LEADER
I20260709 13:08:54.211522 28863 leader_election.cc:304] T 451e3f8929ef4287a9eaa8941486e9cc P 0284f1db8c204657b7b423bab5b2eb4f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0284f1db8c204657b7b423bab5b2eb4f, ee4d8c8df06e4c04ad53ac25013d8a78; no voters: e3fc42b9680245f3b66db70446830a2f
I20260709 13:08:54.211390 29128 consensus_queue.cc:237] T 0dfbae90dbc4407a9e01872b7d688d55 P ee4d8c8df06e4c04ad53ac25013d8a78 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0284f1db8c204657b7b423bab5b2eb4f" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 39279 } } peers { permanent_uuid: "ee4d8c8df06e4c04ad53ac25013d8a78" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 41821 } } peers { permanent_uuid: "e3fc42b9680245f3b66db70446830a2f" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 39203 } }
I20260709 13:08:54.212350 29092 raft_consensus.cc:2804] T 451e3f8929ef4287a9eaa8941486e9cc P 0284f1db8c204657b7b423bab5b2eb4f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:08:54.212744 29092 raft_consensus.cc:493] T 451e3f8929ef4287a9eaa8941486e9cc P 0284f1db8c204657b7b423bab5b2eb4f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:54.208825 29088 ts_tablet_manager.cc:1403] T 7087f0eae49f4f71b5769071b817f8f2 P e3fc42b9680245f3b66db70446830a2f: Time spent bootstrapping tablet: real 0.014s	user 0.012s	sys 0.001s
I20260709 13:08:54.213339 29092 raft_consensus.cc:3060] T 451e3f8929ef4287a9eaa8941486e9cc P 0284f1db8c204657b7b423bab5b2eb4f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:54.215287 29136 raft_consensus.cc:515] T 0dfbae90dbc4407a9e01872b7d688d55 P 0284f1db8c204657b7b423bab5b2eb4f [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0284f1db8c204657b7b423bab5b2eb4f" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 39279 } } peers { permanent_uuid: "ee4d8c8df06e4c04ad53ac25013d8a78" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 41821 } } peers { permanent_uuid: "e3fc42b9680245f3b66db70446830a2f" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 39203 } }
I20260709 13:08:54.217896 29047 raft_consensus.cc:2468] T 777f2e0112c34108b367c8a2ad2641e1 P e3fc42b9680245f3b66db70446830a2f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee4d8c8df06e4c04ad53ac25013d8a78 in term 1.
I20260709 13:08:54.219527 29136 leader_election.cc:290] T 0dfbae90dbc4407a9e01872b7d688d55 P 0284f1db8c204657b7b423bab5b2eb4f [CANDIDATE]: Term 2 election: Requested vote from peers ee4d8c8df06e4c04ad53ac25013d8a78 (127.17.223.2:41821), e3fc42b9680245f3b66db70446830a2f (127.17.223.3:39203)
I20260709 13:08:54.220947 28794 catalog_manager.cc:5697] T 879bbeb7e3244e8a8e5ee375c020cb16 P ee4d8c8df06e4c04ad53ac25013d8a78 reported cstate change: term changed from 0 to 1, leader changed from <none> to ee4d8c8df06e4c04ad53ac25013d8a78 (127.17.223.2). New cstate: current_term: 1 leader_uuid: "ee4d8c8df06e4c04ad53ac25013d8a78" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0284f1db8c204657b7b423bab5b2eb4f" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 39279 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ee4d8c8df06e4c04ad53ac25013d8a78" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 41821 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e3fc42b9680245f3b66db70446830a2f" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 39203 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:54.221920 29092 raft_consensus.cc:515] T 451e3f8929ef4287a9eaa8941486e9cc P 0284f1db8c204657b7b423bab5b2eb4f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0284f1db8c204657b7b423bab5b2eb4f" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 39279 } } peers { permanent_uuid: "ee4d8c8df06e4c04ad53ac25013d8a78" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 41821 } } peers { permanent_uuid: "e3fc42b9680245f3b66db70446830a2f" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 39203 } }
I20260709 13:08:54.224591 29047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0dfbae90dbc4407a9e01872b7d688d55" candidate_uuid: "0284f1db8c204657b7b423bab5b2eb4f" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3fc42b9680245f3b66db70446830a2f"
I20260709 13:08:54.225442 28972 raft_consensus.cc:2468] T 7087f0eae49f4f71b5769071b817f8f2 P ee4d8c8df06e4c04ad53ac25013d8a78 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0284f1db8c204657b7b423bab5b2eb4f in term 1.
W20260709 13:08:54.225875 28863 leader_election.cc:343] T 0dfbae90dbc4407a9e01872b7d688d55 P 0284f1db8c204657b7b423bab5b2eb4f [CANDIDATE]: Term 2 election: Tablet error from VoteRequest() call to peer e3fc42b9680245f3b66db70446830a2f (127.17.223.3:39203): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:54.226096 29092 leader_election.cc:290] T 451e3f8929ef4287a9eaa8941486e9cc P 0284f1db8c204657b7b423bab5b2eb4f [CANDIDATE]: Term 1 election: Requested vote from peers ee4d8c8df06e4c04ad53ac25013d8a78 (127.17.223.2:41821), e3fc42b9680245f3b66db70446830a2f (127.17.223.3:39203)
I20260709 13:08:54.213785 28938 leader_election.cc:304] T 777f2e0112c34108b367c8a2ad2641e1 P ee4d8c8df06e4c04ad53ac25013d8a78 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0284f1db8c204657b7b423bab5b2eb4f, ee4d8c8df06e4c04ad53ac25013d8a78; no voters: 
I20260709 13:08:54.227679 28863 leader_election.cc:304] T 7087f0eae49f4f71b5769071b817f8f2 P 0284f1db8c204657b7b423bab5b2eb4f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0284f1db8c204657b7b423bab5b2eb4f, ee4d8c8df06e4c04ad53ac25013d8a78; no voters: e3fc42b9680245f3b66db70446830a2f
I20260709 13:08:54.227739 29088 raft_consensus.cc:359] T 7087f0eae49f4f71b5769071b817f8f2 P e3fc42b9680245f3b66db70446830a2f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0284f1db8c204657b7b423bab5b2eb4f" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 39279 } } peers { permanent_uuid: "ee4d8c8df06e4c04ad53ac25013d8a78" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 41821 } } peers { permanent_uuid: "e3fc42b9680245f3b66db70446830a2f" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 39203 } }
I20260709 13:08:54.228658 29088 raft_consensus.cc:385] T 7087f0eae49f4f71b5769071b817f8f2 P e3fc42b9680245f3b66db70446830a2f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:54.228262 29132 raft_consensus.cc:2804] T 777f2e0112c34108b367c8a2ad2641e1 P ee4d8c8df06e4c04ad53ac25013d8a78 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:08:54.228888 28972 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0dfbae90dbc4407a9e01872b7d688d55" candidate_uuid: "0284f1db8c204657b7b423bab5b2eb4f" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ee4d8c8df06e4c04ad53ac25013d8a78"
I20260709 13:08:54.229570 29132 raft_consensus.cc:697] T 777f2e0112c34108b367c8a2ad2641e1 P ee4d8c8df06e4c04ad53ac25013d8a78 [term 1 LEADER]: Becoming Leader. State: Replica: ee4d8c8df06e4c04ad53ac25013d8a78, State: Running, Role: LEADER
I20260709 13:08:54.230159 29092 raft_consensus.cc:2804] T 7087f0eae49f4f71b5769071b817f8f2 P 0284f1db8c204657b7b423bab5b2eb4f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:08:54.232997 29132 consensus_queue.cc:237] T 777f2e0112c34108b367c8a2ad2641e1 P ee4d8c8df06e4c04ad53ac25013d8a78 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0284f1db8c204657b7b423bab5b2eb4f" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 39279 } } peers { permanent_uuid: "ee4d8c8df06e4c04ad53ac25013d8a78" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 41821 } } peers { permanent_uuid: "e3fc42b9680245f3b66db70446830a2f" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 39203 } }
I20260709 13:08:54.233695 29092 raft_consensus.cc:697] T 7087f0eae49f4f71b5769071b817f8f2 P 0284f1db8c204657b7b423bab5b2eb4f [term 1 LEADER]: Becoming Leader. State: Replica: 0284f1db8c204657b7b423bab5b2eb4f, State: Running, Role: LEADER
I20260709 13:08:54.229033 29088 raft_consensus.cc:740] T 7087f0eae49f4f71b5769071b817f8f2 P e3fc42b9680245f3b66db70446830a2f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e3fc42b9680245f3b66db70446830a2f, State: Initialized, Role: FOLLOWER
I20260709 13:08:54.230891 28973 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "451e3f8929ef4287a9eaa8941486e9cc" candidate_uuid: "0284f1db8c204657b7b423bab5b2eb4f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ee4d8c8df06e4c04ad53ac25013d8a78"
I20260709 13:08:54.234571 29092 consensus_queue.cc:237] T 7087f0eae49f4f71b5769071b817f8f2 P 0284f1db8c204657b7b423bab5b2eb4f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0284f1db8c204657b7b423bab5b2eb4f" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 39279 } } peers { permanent_uuid: "ee4d8c8df06e4c04ad53ac25013d8a78" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 41821 } } peers { permanent_uuid: "e3fc42b9680245f3b66db70446830a2f" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 39203 } }
I20260709 13:08:54.235103 28973 raft_consensus.cc:3060] T 451e3f8929ef4287a9eaa8941486e9cc P ee4d8c8df06e4c04ad53ac25013d8a78 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:54.229025 29047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "451e3f8929ef4287a9eaa8941486e9cc" candidate_uuid: "0284f1db8c204657b7b423bab5b2eb4f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3fc42b9680245f3b66db70446830a2f"
I20260709 13:08:54.235684 29088 consensus_queue.cc:260] T 7087f0eae49f4f71b5769071b817f8f2 P e3fc42b9680245f3b66db70446830a2f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0284f1db8c204657b7b423bab5b2eb4f" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 39279 } } peers { permanent_uuid: "ee4d8c8df06e4c04ad53ac25013d8a78" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 41821 } } peers { permanent_uuid: "e3fc42b9680245f3b66db70446830a2f" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 39203 } }
I20260709 13:08:54.233371 28863 leader_election.cc:304] T 0dfbae90dbc4407a9e01872b7d688d55 P 0284f1db8c204657b7b423bab5b2eb4f [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0284f1db8c204657b7b423bab5b2eb4f; no voters: e3fc42b9680245f3b66db70446830a2f, ee4d8c8df06e4c04ad53ac25013d8a78
I20260709 13:08:54.243201 29136 raft_consensus.cc:2749] T 0dfbae90dbc4407a9e01872b7d688d55 P 0284f1db8c204657b7b423bab5b2eb4f [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:08:54.245024 28973 raft_consensus.cc:2468] T 451e3f8929ef4287a9eaa8941486e9cc P ee4d8c8df06e4c04ad53ac25013d8a78 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0284f1db8c204657b7b423bab5b2eb4f in term 1.
I20260709 13:08:54.245858 29088 ts_tablet_manager.cc:1434] T 7087f0eae49f4f71b5769071b817f8f2 P e3fc42b9680245f3b66db70446830a2f: Time spent starting tablet: real 0.024s	user 0.008s	sys 0.000s
W20260709 13:08:54.246109 28863 leader_election.cc:343] T 451e3f8929ef4287a9eaa8941486e9cc P 0284f1db8c204657b7b423bab5b2eb4f [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer e3fc42b9680245f3b66db70446830a2f (127.17.223.3:39203): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:54.246891 28863 leader_election.cc:304] T 451e3f8929ef4287a9eaa8941486e9cc P 0284f1db8c204657b7b423bab5b2eb4f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0284f1db8c204657b7b423bab5b2eb4f, ee4d8c8df06e4c04ad53ac25013d8a78; no voters: e3fc42b9680245f3b66db70446830a2f
I20260709 13:08:54.247771 29136 raft_consensus.cc:2804] T 451e3f8929ef4287a9eaa8941486e9cc P 0284f1db8c204657b7b423bab5b2eb4f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:08:54.256811 29088 tablet_bootstrap.cc:492] T 451e3f8929ef4287a9eaa8941486e9cc P e3fc42b9680245f3b66db70446830a2f: Bootstrap starting.
I20260709 13:08:54.261664 29136 raft_consensus.cc:697] T 451e3f8929ef4287a9eaa8941486e9cc P 0284f1db8c204657b7b423bab5b2eb4f [term 1 LEADER]: Becoming Leader. State: Replica: 0284f1db8c204657b7b423bab5b2eb4f, State: Running, Role: LEADER
I20260709 13:08:54.262908 29136 consensus_queue.cc:237] T 451e3f8929ef4287a9eaa8941486e9cc P 0284f1db8c204657b7b423bab5b2eb4f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0284f1db8c204657b7b423bab5b2eb4f" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 39279 } } peers { permanent_uuid: "ee4d8c8df06e4c04ad53ac25013d8a78" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 41821 } } peers { permanent_uuid: "e3fc42b9680245f3b66db70446830a2f" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 39203 } }
I20260709 13:08:54.267062 29088 tablet_bootstrap.cc:654] T 451e3f8929ef4287a9eaa8941486e9cc P e3fc42b9680245f3b66db70446830a2f: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:54.269513 29096 raft_consensus.cc:493] T 4b9944472adf4cec929d98a95851bef9 P e3fc42b9680245f3b66db70446830a2f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:54.270112 29096 raft_consensus.cc:515] T 4b9944472adf4cec929d98a95851bef9 P e3fc42b9680245f3b66db70446830a2f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0284f1db8c204657b7b423bab5b2eb4f" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 39279 } } peers { permanent_uuid: "ee4d8c8df06e4c04ad53ac25013d8a78" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 41821 } } peers { permanent_uuid: "e3fc42b9680245f3b66db70446830a2f" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 39203 } }
I20260709 13:08:54.272104 29096 leader_election.cc:290] T 4b9944472adf4cec929d98a95851bef9 P e3fc42b9680245f3b66db70446830a2f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0284f1db8c204657b7b423bab5b2eb4f (127.17.223.1:39279), ee4d8c8df06e4c04ad53ac25013d8a78 (127.17.223.2:41821)
I20260709 13:08:54.273651 28899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b9944472adf4cec929d98a95851bef9" candidate_uuid: "e3fc42b9680245f3b66db70446830a2f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0284f1db8c204657b7b423bab5b2eb4f" is_pre_election: true
I20260709 13:08:54.274297 28899 raft_consensus.cc:2468] T 4b9944472adf4cec929d98a95851bef9 P 0284f1db8c204657b7b423bab5b2eb4f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3fc42b9680245f3b66db70446830a2f in term 0.
I20260709 13:08:54.275753 28973 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b9944472adf4cec929d98a95851bef9" candidate_uuid: "e3fc42b9680245f3b66db70446830a2f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ee4d8c8df06e4c04ad53ac25013d8a78" is_pre_election: true
I20260709 13:08:54.276459 28973 raft_consensus.cc:2468] T 4b9944472adf4cec929d98a95851bef9 P ee4d8c8df06e4c04ad53ac25013d8a78 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3fc42b9680245f3b66db70446830a2f in term 0.
I20260709 13:08:54.276108 28794 catalog_manager.cc:5697] T 7087f0eae49f4f71b5769071b817f8f2 P 0284f1db8c204657b7b423bab5b2eb4f reported cstate change: term changed from 0 to 1, leader changed from <none> to 0284f1db8c204657b7b423bab5b2eb4f (127.17.223.1). New cstate: current_term: 1 leader_uuid: "0284f1db8c204657b7b423bab5b2eb4f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0284f1db8c204657b7b423bab5b2eb4f" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 39279 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ee4d8c8df06e4c04ad53ac25013d8a78" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 41821 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e3fc42b9680245f3b66db70446830a2f" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 39203 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:54.277817 29012 leader_election.cc:304] T 4b9944472adf4cec929d98a95851bef9 P e3fc42b9680245f3b66db70446830a2f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e3fc42b9680245f3b66db70446830a2f, ee4d8c8df06e4c04ad53ac25013d8a78; no voters: 
I20260709 13:08:54.278623 29096 raft_consensus.cc:2804] T 4b9944472adf4cec929d98a95851bef9 P e3fc42b9680245f3b66db70446830a2f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:08:54.279023 29096 raft_consensus.cc:493] T 4b9944472adf4cec929d98a95851bef9 P e3fc42b9680245f3b66db70446830a2f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:54.279341 29096 raft_consensus.cc:3060] T 4b9944472adf4cec929d98a95851bef9 P e3fc42b9680245f3b66db70446830a2f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:54.281355 28796 catalog_manager.cc:5697] T eb8f9bf7e0d24af88a04bda489298395 P ee4d8c8df06e4c04ad53ac25013d8a78 reported cstate change: term changed from 0 to 1, leader changed from <none> to ee4d8c8df06e4c04ad53ac25013d8a78 (127.17.223.2). New cstate: current_term: 1 leader_uuid: "ee4d8c8df06e4c04ad53ac25013d8a78" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0284f1db8c204657b7b423bab5b2eb4f" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 39279 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ee4d8c8df06e4c04ad53ac25013d8a78" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 41821 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e3fc42b9680245f3b66db70446830a2f" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 39203 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:54.283264 28796 catalog_manager.cc:5697] T 777f2e0112c34108b367c8a2ad2641e1 P ee4d8c8df06e4c04ad53ac25013d8a78 reported cstate change: term changed from 0 to 1, leader changed from <none> to ee4d8c8df06e4c04ad53ac25013d8a78 (127.17.223.2). New cstate: current_term: 1 leader_uuid: "ee4d8c8df06e4c04ad53ac25013d8a78" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0284f1db8c204657b7b423bab5b2eb4f" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 39279 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ee4d8c8df06e4c04ad53ac25013d8a78" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 41821 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e3fc42b9680245f3b66db70446830a2f" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 39203 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:54.285121 28796 catalog_manager.cc:5697] T 0dfbae90dbc4407a9e01872b7d688d55 P ee4d8c8df06e4c04ad53ac25013d8a78 reported cstate change: term changed from 0 to 1, leader changed from <none> to ee4d8c8df06e4c04ad53ac25013d8a78 (127.17.223.2). New cstate: current_term: 1 leader_uuid: "ee4d8c8df06e4c04ad53ac25013d8a78" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0284f1db8c204657b7b423bab5b2eb4f" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 39279 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ee4d8c8df06e4c04ad53ac25013d8a78" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 41821 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e3fc42b9680245f3b66db70446830a2f" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 39203 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:54.288317 29088 tablet_bootstrap.cc:492] T 451e3f8929ef4287a9eaa8941486e9cc P e3fc42b9680245f3b66db70446830a2f: No bootstrap required, opened a new log
I20260709 13:08:54.288796 29088 ts_tablet_manager.cc:1403] T 451e3f8929ef4287a9eaa8941486e9cc P e3fc42b9680245f3b66db70446830a2f: Time spent bootstrapping tablet: real 0.032s	user 0.006s	sys 0.009s
I20260709 13:08:54.290735 29088 raft_consensus.cc:359] T 451e3f8929ef4287a9eaa8941486e9cc P e3fc42b9680245f3b66db70446830a2f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0284f1db8c204657b7b423bab5b2eb4f" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 39279 } } peers { permanent_uuid: "ee4d8c8df06e4c04ad53ac25013d8a78" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 41821 } } peers { permanent_uuid: "e3fc42b9680245f3b66db70446830a2f" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 39203 } }
I20260709 13:08:54.291342 29088 raft_consensus.cc:385] T 451e3f8929ef4287a9eaa8941486e9cc P e3fc42b9680245f3b66db70446830a2f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:54.291584 29088 raft_consensus.cc:740] T 451e3f8929ef4287a9eaa8941486e9cc P e3fc42b9680245f3b66db70446830a2f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e3fc42b9680245f3b66db70446830a2f, State: Initialized, Role: FOLLOWER
I20260709 13:08:54.292073 29096 raft_consensus.cc:515] T 4b9944472adf4cec929d98a95851bef9 P e3fc42b9680245f3b66db70446830a2f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0284f1db8c204657b7b423bab5b2eb4f" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 39279 } } peers { permanent_uuid: "ee4d8c8df06e4c04ad53ac25013d8a78" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 41821 } } peers { permanent_uuid: "e3fc42b9680245f3b66db70446830a2f" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 39203 } }
I20260709 13:08:54.292331 29088 consensus_queue.cc:260] T 451e3f8929ef4287a9eaa8941486e9cc P e3fc42b9680245f3b66db70446830a2f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0284f1db8c204657b7b423bab5b2eb4f" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 39279 } } peers { permanent_uuid: "ee4d8c8df06e4c04ad53ac25013d8a78" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 41821 } } peers { permanent_uuid: "e3fc42b9680245f3b66db70446830a2f" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 39203 } }
I20260709 13:08:54.295050 29096 leader_election.cc:290] T 4b9944472adf4cec929d98a95851bef9 P e3fc42b9680245f3b66db70446830a2f [CANDIDATE]: Term 1 election: Requested vote from peers 0284f1db8c204657b7b423bab5b2eb4f (127.17.223.1:39279), ee4d8c8df06e4c04ad53ac25013d8a78 (127.17.223.2:41821)
I20260709 13:08:54.295735 28899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b9944472adf4cec929d98a95851bef9" candidate_uuid: "e3fc42b9680245f3b66db70446830a2f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0284f1db8c204657b7b423bab5b2eb4f"
I20260709 13:08:54.296376 28899 raft_consensus.cc:3060] T 4b9944472adf4cec929d98a95851bef9 P 0284f1db8c204657b7b423bab5b2eb4f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:54.296629 29088 ts_tablet_manager.cc:1434] T 451e3f8929ef4287a9eaa8941486e9cc P e3fc42b9680245f3b66db70446830a2f: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.001s
I20260709 13:08:54.296758 28794 catalog_manager.cc:5697] T 451e3f8929ef4287a9eaa8941486e9cc P 0284f1db8c204657b7b423bab5b2eb4f reported cstate change: term changed from 0 to 1, leader changed from <none> to 0284f1db8c204657b7b423bab5b2eb4f (127.17.223.1). New cstate: current_term: 1 leader_uuid: "0284f1db8c204657b7b423bab5b2eb4f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0284f1db8c204657b7b423bab5b2eb4f" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 39279 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ee4d8c8df06e4c04ad53ac25013d8a78" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 41821 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e3fc42b9680245f3b66db70446830a2f" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 39203 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:54.298347 28973 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b9944472adf4cec929d98a95851bef9" candidate_uuid: "e3fc42b9680245f3b66db70446830a2f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ee4d8c8df06e4c04ad53ac25013d8a78"
I20260709 13:08:54.299005 28973 raft_consensus.cc:3060] T 4b9944472adf4cec929d98a95851bef9 P ee4d8c8df06e4c04ad53ac25013d8a78 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:54.297768 29088 tablet_bootstrap.cc:492] T 0dfbae90dbc4407a9e01872b7d688d55 P e3fc42b9680245f3b66db70446830a2f: Bootstrap starting.
I20260709 13:08:54.303788 28899 raft_consensus.cc:2468] T 4b9944472adf4cec929d98a95851bef9 P 0284f1db8c204657b7b423bab5b2eb4f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3fc42b9680245f3b66db70446830a2f in term 1.
I20260709 13:08:54.304886 29012 leader_election.cc:304] T 4b9944472adf4cec929d98a95851bef9 P e3fc42b9680245f3b66db70446830a2f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0284f1db8c204657b7b423bab5b2eb4f, e3fc42b9680245f3b66db70446830a2f; no voters: 
I20260709 13:08:54.306973 28973 raft_consensus.cc:2468] T 4b9944472adf4cec929d98a95851bef9 P ee4d8c8df06e4c04ad53ac25013d8a78 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3fc42b9680245f3b66db70446830a2f in term 1.
I20260709 13:08:54.307318 29096 raft_consensus.cc:2804] T 4b9944472adf4cec929d98a95851bef9 P e3fc42b9680245f3b66db70446830a2f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:08:54.308678 29096 raft_consensus.cc:697] T 4b9944472adf4cec929d98a95851bef9 P e3fc42b9680245f3b66db70446830a2f [term 1 LEADER]: Becoming Leader. State: Replica: e3fc42b9680245f3b66db70446830a2f, State: Running, Role: LEADER
I20260709 13:08:54.309633 29088 tablet_bootstrap.cc:654] T 0dfbae90dbc4407a9e01872b7d688d55 P e3fc42b9680245f3b66db70446830a2f: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:54.309516 29096 consensus_queue.cc:237] T 4b9944472adf4cec929d98a95851bef9 P e3fc42b9680245f3b66db70446830a2f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0284f1db8c204657b7b423bab5b2eb4f" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 39279 } } peers { permanent_uuid: "ee4d8c8df06e4c04ad53ac25013d8a78" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 41821 } } peers { permanent_uuid: "e3fc42b9680245f3b66db70446830a2f" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 39203 } }
I20260709 13:08:54.314661 29088 tablet_bootstrap.cc:492] T 0dfbae90dbc4407a9e01872b7d688d55 P e3fc42b9680245f3b66db70446830a2f: No bootstrap required, opened a new log
I20260709 13:08:54.315246 29088 ts_tablet_manager.cc:1403] T 0dfbae90dbc4407a9e01872b7d688d55 P e3fc42b9680245f3b66db70446830a2f: Time spent bootstrapping tablet: real 0.018s	user 0.008s	sys 0.003s
I20260709 13:08:54.318297 29088 raft_consensus.cc:359] T 0dfbae90dbc4407a9e01872b7d688d55 P e3fc42b9680245f3b66db70446830a2f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0284f1db8c204657b7b423bab5b2eb4f" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 39279 } } peers { permanent_uuid: "ee4d8c8df06e4c04ad53ac25013d8a78" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 41821 } } peers { permanent_uuid: "e3fc42b9680245f3b66db70446830a2f" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 39203 } }
I20260709 13:08:54.319212 29088 raft_consensus.cc:385] T 0dfbae90dbc4407a9e01872b7d688d55 P e3fc42b9680245f3b66db70446830a2f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:54.319468 29088 raft_consensus.cc:740] T 0dfbae90dbc4407a9e01872b7d688d55 P e3fc42b9680245f3b66db70446830a2f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e3fc42b9680245f3b66db70446830a2f, State: Initialized, Role: FOLLOWER
I20260709 13:08:54.320106 29088 consensus_queue.cc:260] T 0dfbae90dbc4407a9e01872b7d688d55 P e3fc42b9680245f3b66db70446830a2f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0284f1db8c204657b7b423bab5b2eb4f" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 39279 } } peers { permanent_uuid: "ee4d8c8df06e4c04ad53ac25013d8a78" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 41821 } } peers { permanent_uuid: "e3fc42b9680245f3b66db70446830a2f" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 39203 } }
I20260709 13:08:54.321666 29088 ts_tablet_manager.cc:1434] T 0dfbae90dbc4407a9e01872b7d688d55 P e3fc42b9680245f3b66db70446830a2f: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 13:08:54.322419 29088 tablet_bootstrap.cc:492] T 5d6b9266d4e74616b08d4e9697a83924 P e3fc42b9680245f3b66db70446830a2f: Bootstrap starting.
I20260709 13:08:54.321959 28795 catalog_manager.cc:5697] T 4b9944472adf4cec929d98a95851bef9 P e3fc42b9680245f3b66db70446830a2f reported cstate change: term changed from 0 to 1, leader changed from <none> to e3fc42b9680245f3b66db70446830a2f (127.17.223.3). New cstate: current_term: 1 leader_uuid: "e3fc42b9680245f3b66db70446830a2f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0284f1db8c204657b7b423bab5b2eb4f" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 39279 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ee4d8c8df06e4c04ad53ac25013d8a78" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 41821 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e3fc42b9680245f3b66db70446830a2f" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 39203 } health_report { overall_health: HEALTHY } } }
I20260709 13:08:54.326767 29088 tablet_bootstrap.cc:654] T 5d6b9266d4e74616b08d4e9697a83924 P e3fc42b9680245f3b66db70446830a2f: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:54.331453 29088 tablet_bootstrap.cc:492] T 5d6b9266d4e74616b08d4e9697a83924 P e3fc42b9680245f3b66db70446830a2f: No bootstrap required, opened a new log
I20260709 13:08:54.331898 29088 ts_tablet_manager.cc:1403] T 5d6b9266d4e74616b08d4e9697a83924 P e3fc42b9680245f3b66db70446830a2f: Time spent bootstrapping tablet: real 0.010s	user 0.008s	sys 0.000s
I20260709 13:08:54.333999 29088 raft_consensus.cc:359] T 5d6b9266d4e74616b08d4e9697a83924 P e3fc42b9680245f3b66db70446830a2f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0284f1db8c204657b7b423bab5b2eb4f" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 39279 } } peers { permanent_uuid: "ee4d8c8df06e4c04ad53ac25013d8a78" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 41821 } } peers { permanent_uuid: "e3fc42b9680245f3b66db70446830a2f" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 39203 } }
I20260709 13:08:54.334472 29088 raft_consensus.cc:385] T 5d6b9266d4e74616b08d4e9697a83924 P e3fc42b9680245f3b66db70446830a2f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:54.334707 29088 raft_consensus.cc:740] T 5d6b9266d4e74616b08d4e9697a83924 P e3fc42b9680245f3b66db70446830a2f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e3fc42b9680245f3b66db70446830a2f, State: Initialized, Role: FOLLOWER
I20260709 13:08:54.335250 29088 consensus_queue.cc:260] T 5d6b9266d4e74616b08d4e9697a83924 P e3fc42b9680245f3b66db70446830a2f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0284f1db8c204657b7b423bab5b2eb4f" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 39279 } } peers { permanent_uuid: "ee4d8c8df06e4c04ad53ac25013d8a78" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 41821 } } peers { permanent_uuid: "e3fc42b9680245f3b66db70446830a2f" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 39203 } }
I20260709 13:08:54.336597 29088 ts_tablet_manager.cc:1434] T 5d6b9266d4e74616b08d4e9697a83924 P e3fc42b9680245f3b66db70446830a2f: Time spent starting tablet: real 0.004s	user 0.004s	sys 0.000s
I20260709 13:08:54.410802 29096 consensus_queue.cc:1048] T 9f5d8f2d6f684a5b9702935fc8fd85a1 P e3fc42b9680245f3b66db70446830a2f [LEADER]: Connected to new peer: Peer: permanent_uuid: "0284f1db8c204657b7b423bab5b2eb4f" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 39279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:08:54.424158 29096 consensus_queue.cc:1048] T 9f5d8f2d6f684a5b9702935fc8fd85a1 P e3fc42b9680245f3b66db70446830a2f [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee4d8c8df06e4c04ad53ac25013d8a78" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 41821 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:08:54.474645 29136 raft_consensus.cc:493] T 5d6b9266d4e74616b08d4e9697a83924 P 0284f1db8c204657b7b423bab5b2eb4f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:54.475144 29136 raft_consensus.cc:515] T 5d6b9266d4e74616b08d4e9697a83924 P 0284f1db8c204657b7b423bab5b2eb4f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0284f1db8c204657b7b423bab5b2eb4f" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 39279 } } peers { permanent_uuid: "ee4d8c8df06e4c04ad53ac25013d8a78" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 41821 } } peers { permanent_uuid: "e3fc42b9680245f3b66db70446830a2f" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 39203 } }
I20260709 13:08:54.476869 29136 leader_election.cc:290] T 5d6b9266d4e74616b08d4e9697a83924 P 0284f1db8c204657b7b423bab5b2eb4f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ee4d8c8df06e4c04ad53ac25013d8a78 (127.17.223.2:41821), e3fc42b9680245f3b66db70446830a2f (127.17.223.3:39203)
I20260709 13:08:54.477733 28973 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d6b9266d4e74616b08d4e9697a83924" candidate_uuid: "0284f1db8c204657b7b423bab5b2eb4f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ee4d8c8df06e4c04ad53ac25013d8a78" is_pre_election: true
I20260709 13:08:54.478008 29047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d6b9266d4e74616b08d4e9697a83924" candidate_uuid: "0284f1db8c204657b7b423bab5b2eb4f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3fc42b9680245f3b66db70446830a2f" is_pre_election: true
I20260709 13:08:54.478348 28973 raft_consensus.cc:2468] T 5d6b9266d4e74616b08d4e9697a83924 P ee4d8c8df06e4c04ad53ac25013d8a78 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0284f1db8c204657b7b423bab5b2eb4f in term 0.
I20260709 13:08:54.478715 29047 raft_consensus.cc:2468] T 5d6b9266d4e74616b08d4e9697a83924 P e3fc42b9680245f3b66db70446830a2f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0284f1db8c204657b7b423bab5b2eb4f in term 0.
I20260709 13:08:54.479498 28863 leader_election.cc:304] T 5d6b9266d4e74616b08d4e9697a83924 P 0284f1db8c204657b7b423bab5b2eb4f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0284f1db8c204657b7b423bab5b2eb4f, ee4d8c8df06e4c04ad53ac25013d8a78; no voters: 
I20260709 13:08:54.480176 29136 raft_consensus.cc:2804] T 5d6b9266d4e74616b08d4e9697a83924 P 0284f1db8c204657b7b423bab5b2eb4f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:08:54.480535 29136 raft_consensus.cc:493] T 5d6b9266d4e74616b08d4e9697a83924 P 0284f1db8c204657b7b423bab5b2eb4f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:54.480921 29136 raft_consensus.cc:3060] T 5d6b9266d4e74616b08d4e9697a83924 P 0284f1db8c204657b7b423bab5b2eb4f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:54.486209 29136 raft_consensus.cc:515] T 5d6b9266d4e74616b08d4e9697a83924 P 0284f1db8c204657b7b423bab5b2eb4f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0284f1db8c204657b7b423bab5b2eb4f" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 39279 } } peers { permanent_uuid: "ee4d8c8df06e4c04ad53ac25013d8a78" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 41821 } } peers { permanent_uuid: "e3fc42b9680245f3b66db70446830a2f" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 39203 } }
I20260709 13:08:54.488076 29136 leader_election.cc:290] T 5d6b9266d4e74616b08d4e9697a83924 P 0284f1db8c204657b7b423bab5b2eb4f [CANDIDATE]: Term 1 election: Requested vote from peers ee4d8c8df06e4c04ad53ac25013d8a78 (127.17.223.2:41821), e3fc42b9680245f3b66db70446830a2f (127.17.223.3:39203)
I20260709 13:08:54.488832 28973 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d6b9266d4e74616b08d4e9697a83924" candidate_uuid: "0284f1db8c204657b7b423bab5b2eb4f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ee4d8c8df06e4c04ad53ac25013d8a78"
I20260709 13:08:54.489157 29047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d6b9266d4e74616b08d4e9697a83924" candidate_uuid: "0284f1db8c204657b7b423bab5b2eb4f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3fc42b9680245f3b66db70446830a2f"
I20260709 13:08:54.489377 28973 raft_consensus.cc:3060] T 5d6b9266d4e74616b08d4e9697a83924 P ee4d8c8df06e4c04ad53ac25013d8a78 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:54.489779 29047 raft_consensus.cc:3060] T 5d6b9266d4e74616b08d4e9697a83924 P e3fc42b9680245f3b66db70446830a2f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:54.494508 28973 raft_consensus.cc:2468] T 5d6b9266d4e74616b08d4e9697a83924 P ee4d8c8df06e4c04ad53ac25013d8a78 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0284f1db8c204657b7b423bab5b2eb4f in term 1.
I20260709 13:08:54.494880 29047 raft_consensus.cc:2468] T 5d6b9266d4e74616b08d4e9697a83924 P e3fc42b9680245f3b66db70446830a2f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0284f1db8c204657b7b423bab5b2eb4f in term 1.
I20260709 13:08:54.495857 28863 leader_election.cc:304] T 5d6b9266d4e74616b08d4e9697a83924 P 0284f1db8c204657b7b423bab5b2eb4f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0284f1db8c204657b7b423bab5b2eb4f, ee4d8c8df06e4c04ad53ac25013d8a78; no voters: 
I20260709 13:08:54.496658 29136 raft_consensus.cc:2804] T 5d6b9266d4e74616b08d4e9697a83924 P 0284f1db8c204657b7b423bab5b2eb4f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:08:54.497089 29136 raft_consensus.cc:697] T 5d6b9266d4e74616b08d4e9697a83924 P 0284f1db8c204657b7b423bab5b2eb4f [term 1 LEADER]: Becoming Leader. State: Replica: 0284f1db8c204657b7b423bab5b2eb4f, State: Running, Role: LEADER
I20260709 13:08:54.497807 29136 consensus_queue.cc:237] T 5d6b9266d4e74616b08d4e9697a83924 P 0284f1db8c204657b7b423bab5b2eb4f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0284f1db8c204657b7b423bab5b2eb4f" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 39279 } } peers { permanent_uuid: "ee4d8c8df06e4c04ad53ac25013d8a78" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 41821 } } peers { permanent_uuid: "e3fc42b9680245f3b66db70446830a2f" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 39203 } }
I20260709 13:08:54.505317 28794 catalog_manager.cc:5697] T 5d6b9266d4e74616b08d4e9697a83924 P 0284f1db8c204657b7b423bab5b2eb4f reported cstate change: term changed from 0 to 1, leader changed from <none> to 0284f1db8c204657b7b423bab5b2eb4f (127.17.223.1). New cstate: current_term: 1 leader_uuid: "0284f1db8c204657b7b423bab5b2eb4f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0284f1db8c204657b7b423bab5b2eb4f" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 39279 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ee4d8c8df06e4c04ad53ac25013d8a78" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 41821 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e3fc42b9680245f3b66db70446830a2f" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 39203 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:54.524109 29132 consensus_queue.cc:1048] T 2b38eb974fe54bb6a799876978d3ba4c P ee4d8c8df06e4c04ad53ac25013d8a78 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3fc42b9680245f3b66db70446830a2f" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 39203 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:08:54.526136 29132 consensus_queue.cc:1048] T 879bbeb7e3244e8a8e5ee375c020cb16 P ee4d8c8df06e4c04ad53ac25013d8a78 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0284f1db8c204657b7b423bab5b2eb4f" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 39279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:08:54.541177 29048 raft_consensus.cc:3060] T 879bbeb7e3244e8a8e5ee375c020cb16 P e3fc42b9680245f3b66db70446830a2f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:54.541230 29094 consensus_queue.cc:1048] T 2b38eb974fe54bb6a799876978d3ba4c P ee4d8c8df06e4c04ad53ac25013d8a78 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0284f1db8c204657b7b423bab5b2eb4f" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 39279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:08:54.545580 29096 raft_consensus.cc:493] T 7087f0eae49f4f71b5769071b817f8f2 P e3fc42b9680245f3b66db70446830a2f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:54.546139 29096 raft_consensus.cc:515] T 7087f0eae49f4f71b5769071b817f8f2 P e3fc42b9680245f3b66db70446830a2f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0284f1db8c204657b7b423bab5b2eb4f" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 39279 } } peers { permanent_uuid: "ee4d8c8df06e4c04ad53ac25013d8a78" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 41821 } } peers { permanent_uuid: "e3fc42b9680245f3b66db70446830a2f" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 39203 } }
I20260709 13:08:54.549338 29096 leader_election.cc:290] T 7087f0eae49f4f71b5769071b817f8f2 P e3fc42b9680245f3b66db70446830a2f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0284f1db8c204657b7b423bab5b2eb4f (127.17.223.1:39279), ee4d8c8df06e4c04ad53ac25013d8a78 (127.17.223.2:41821)
I20260709 13:08:54.550757 28973 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7087f0eae49f4f71b5769071b817f8f2" candidate_uuid: "e3fc42b9680245f3b66db70446830a2f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ee4d8c8df06e4c04ad53ac25013d8a78" is_pre_election: true
I20260709 13:08:54.551479 28899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7087f0eae49f4f71b5769071b817f8f2" candidate_uuid: "e3fc42b9680245f3b66db70446830a2f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0284f1db8c204657b7b423bab5b2eb4f" is_pre_election: true
I20260709 13:08:54.551719 28973 raft_consensus.cc:2393] T 7087f0eae49f4f71b5769071b817f8f2 P ee4d8c8df06e4c04ad53ac25013d8a78 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e3fc42b9680245f3b66db70446830a2f in current term 1: Already voted for candidate 0284f1db8c204657b7b423bab5b2eb4f in this term.
I20260709 13:08:54.555251 29012 leader_election.cc:304] T 7087f0eae49f4f71b5769071b817f8f2 P e3fc42b9680245f3b66db70446830a2f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3fc42b9680245f3b66db70446830a2f; no voters: 0284f1db8c204657b7b423bab5b2eb4f, ee4d8c8df06e4c04ad53ac25013d8a78
I20260709 13:08:54.556728 29106 raft_consensus.cc:3060] T 7087f0eae49f4f71b5769071b817f8f2 P e3fc42b9680245f3b66db70446830a2f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:54.562856 29096 raft_consensus.cc:493] T 451e3f8929ef4287a9eaa8941486e9cc P e3fc42b9680245f3b66db70446830a2f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:54.563395 29096 raft_consensus.cc:515] T 451e3f8929ef4287a9eaa8941486e9cc P e3fc42b9680245f3b66db70446830a2f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0284f1db8c204657b7b423bab5b2eb4f" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 39279 } } peers { permanent_uuid: "ee4d8c8df06e4c04ad53ac25013d8a78" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 41821 } } peers { permanent_uuid: "e3fc42b9680245f3b66db70446830a2f" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 39203 } }
I20260709 13:08:54.564440 29158 consensus_queue.cc:1048] T 879bbeb7e3244e8a8e5ee375c020cb16 P ee4d8c8df06e4c04ad53ac25013d8a78 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3fc42b9680245f3b66db70446830a2f" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 39203 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:08:54.565389 29096 leader_election.cc:290] T 451e3f8929ef4287a9eaa8941486e9cc P e3fc42b9680245f3b66db70446830a2f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0284f1db8c204657b7b423bab5b2eb4f (127.17.223.1:39279), ee4d8c8df06e4c04ad53ac25013d8a78 (127.17.223.2:41821)
I20260709 13:08:54.566324 28973 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "451e3f8929ef4287a9eaa8941486e9cc" candidate_uuid: "e3fc42b9680245f3b66db70446830a2f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ee4d8c8df06e4c04ad53ac25013d8a78" is_pre_election: true
I20260709 13:08:54.567032 28973 raft_consensus.cc:2393] T 451e3f8929ef4287a9eaa8941486e9cc P ee4d8c8df06e4c04ad53ac25013d8a78 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e3fc42b9680245f3b66db70446830a2f in current term 1: Already voted for candidate 0284f1db8c204657b7b423bab5b2eb4f in this term.
I20260709 13:08:54.569144 28898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "451e3f8929ef4287a9eaa8941486e9cc" candidate_uuid: "e3fc42b9680245f3b66db70446830a2f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0284f1db8c204657b7b423bab5b2eb4f" is_pre_election: true
I20260709 13:08:54.574816 29106 raft_consensus.cc:2749] T 7087f0eae49f4f71b5769071b817f8f2 P e3fc42b9680245f3b66db70446830a2f [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:08:54.575402 29012 leader_election.cc:304] T 451e3f8929ef4287a9eaa8941486e9cc P e3fc42b9680245f3b66db70446830a2f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3fc42b9680245f3b66db70446830a2f; no voters: 0284f1db8c204657b7b423bab5b2eb4f, ee4d8c8df06e4c04ad53ac25013d8a78
I20260709 13:08:54.576333 29106 raft_consensus.cc:3060] T 451e3f8929ef4287a9eaa8941486e9cc P e3fc42b9680245f3b66db70446830a2f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:54.576872 29096 raft_consensus.cc:493] T 0dfbae90dbc4407a9e01872b7d688d55 P e3fc42b9680245f3b66db70446830a2f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:54.577416 29096 raft_consensus.cc:515] T 0dfbae90dbc4407a9e01872b7d688d55 P e3fc42b9680245f3b66db70446830a2f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0284f1db8c204657b7b423bab5b2eb4f" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 39279 } } peers { permanent_uuid: "ee4d8c8df06e4c04ad53ac25013d8a78" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 41821 } } peers { permanent_uuid: "e3fc42b9680245f3b66db70446830a2f" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 39203 } }
I20260709 13:08:54.580720 28898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0dfbae90dbc4407a9e01872b7d688d55" candidate_uuid: "e3fc42b9680245f3b66db70446830a2f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0284f1db8c204657b7b423bab5b2eb4f" is_pre_election: true
I20260709 13:08:54.581199 29096 leader_election.cc:290] T 0dfbae90dbc4407a9e01872b7d688d55 P e3fc42b9680245f3b66db70446830a2f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0284f1db8c204657b7b423bab5b2eb4f (127.17.223.1:39279), ee4d8c8df06e4c04ad53ac25013d8a78 (127.17.223.2:41821)
I20260709 13:08:54.581493 28898 raft_consensus.cc:2368] T 0dfbae90dbc4407a9e01872b7d688d55 P 0284f1db8c204657b7b423bab5b2eb4f [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e3fc42b9680245f3b66db70446830a2f for earlier term 1. Current term is 2.
I20260709 13:08:54.582347 28973 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0dfbae90dbc4407a9e01872b7d688d55" candidate_uuid: "e3fc42b9680245f3b66db70446830a2f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ee4d8c8df06e4c04ad53ac25013d8a78" is_pre_election: true
I20260709 13:08:54.583231 29012 leader_election.cc:400] T 0dfbae90dbc4407a9e01872b7d688d55 P e3fc42b9680245f3b66db70446830a2f [CANDIDATE]: Term 1 pre-election: Vote denied by peer 0284f1db8c204657b7b423bab5b2eb4f (127.17.223.1:39279) with higher term. Message: Invalid argument: T 0dfbae90dbc4407a9e01872b7d688d55 P 0284f1db8c204657b7b423bab5b2eb4f [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e3fc42b9680245f3b66db70446830a2f for earlier term 1. Current term is 2.
I20260709 13:08:54.583578 29012 leader_election.cc:403] T 0dfbae90dbc4407a9e01872b7d688d55 P e3fc42b9680245f3b66db70446830a2f [CANDIDATE]: Term 1 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:08:54.584089 29096 raft_consensus.cc:3060] T 0dfbae90dbc4407a9e01872b7d688d55 P e3fc42b9680245f3b66db70446830a2f [term 0 FOLLOWER]: Advancing to term 2
I20260709 13:08:54.588222 29106 raft_consensus.cc:2749] T 451e3f8929ef4287a9eaa8941486e9cc P e3fc42b9680245f3b66db70446830a2f [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:08:54.589962 29096 raft_consensus.cc:2749] T 0dfbae90dbc4407a9e01872b7d688d55 P e3fc42b9680245f3b66db70446830a2f [term 2 FOLLOWER]: Leader pre-election lost for term 1. Reason: Vote denied by peer 0284f1db8c204657b7b423bab5b2eb4f (127.17.223.1:39279) with higher term. Message: Invalid argument: T 0dfbae90dbc4407a9e01872b7d688d55 P 0284f1db8c204657b7b423bab5b2eb4f [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e3fc42b9680245f3b66db70446830a2f for earlier term 1. Current term is 2.
I20260709 13:08:54.591440 28898 raft_consensus.cc:1240] T 0dfbae90dbc4407a9e01872b7d688d55 P 0284f1db8c204657b7b423bab5b2eb4f [term 2 FOLLOWER]: Rejecting Update request from peer ee4d8c8df06e4c04ad53ac25013d8a78 for earlier term 1. Current term is 2. Ops: []
I20260709 13:08:54.592651 29158 consensus_queue.cc:1059] T 0dfbae90dbc4407a9e01872b7d688d55 P ee4d8c8df06e4c04ad53ac25013d8a78 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0284f1db8c204657b7b423bab5b2eb4f" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 39279 }, Status: INVALID_TERM, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:08:54.593353 29128 raft_consensus.cc:3055] T 0dfbae90dbc4407a9e01872b7d688d55 P ee4d8c8df06e4c04ad53ac25013d8a78 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:08:54.593638 29128 raft_consensus.cc:740] T 0dfbae90dbc4407a9e01872b7d688d55 P ee4d8c8df06e4c04ad53ac25013d8a78 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ee4d8c8df06e4c04ad53ac25013d8a78, State: Running, Role: LEADER
I20260709 13:08:54.594327 29128 consensus_queue.cc:260] T 0dfbae90dbc4407a9e01872b7d688d55 P ee4d8c8df06e4c04ad53ac25013d8a78 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0284f1db8c204657b7b423bab5b2eb4f" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 39279 } } peers { permanent_uuid: "ee4d8c8df06e4c04ad53ac25013d8a78" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 41821 } } peers { permanent_uuid: "e3fc42b9680245f3b66db70446830a2f" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 39203 } }
I20260709 13:08:54.594867 29158 consensus_queue.cc:1048] T eb8f9bf7e0d24af88a04bda489298395 P ee4d8c8df06e4c04ad53ac25013d8a78 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0284f1db8c204657b7b423bab5b2eb4f" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 39279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:08:54.595413 29128 raft_consensus.cc:3060] T 0dfbae90dbc4407a9e01872b7d688d55 P ee4d8c8df06e4c04ad53ac25013d8a78 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:54.608536 29128 consensus_queue.cc:1048] T eb8f9bf7e0d24af88a04bda489298395 P ee4d8c8df06e4c04ad53ac25013d8a78 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3fc42b9680245f3b66db70446830a2f" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 39203 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:08:54.649775 18300 ts_manager.cc:295] Set tserver state for 0284f1db8c204657b7b423bab5b2eb4f to MAINTENANCE_MODE
I20260709 13:08:54.650486 18300 tablet_server.cc:179] TabletServer@127.17.223.1:0 shutting down...
I20260709 13:08:54.669859 18300 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:08:54.670637 18300 tablet_replica.cc:333] T 5d6b9266d4e74616b08d4e9697a83924 P 0284f1db8c204657b7b423bab5b2eb4f: stopping tablet replica
I20260709 13:08:54.671312 18300 raft_consensus.cc:2243] T 5d6b9266d4e74616b08d4e9697a83924 P 0284f1db8c204657b7b423bab5b2eb4f [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:08:54.671972 18300 pending_rounds.cc:70] T 5d6b9266d4e74616b08d4e9697a83924 P 0284f1db8c204657b7b423bab5b2eb4f: Trying to abort 1 pending ops.
I20260709 13:08:54.672201 18300 pending_rounds.cc:77] T 5d6b9266d4e74616b08d4e9697a83924 P 0284f1db8c204657b7b423bab5b2eb4f: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7305635981310570496 op_type: NO_OP noop_request { }
I20260709 13:08:54.672533 18300 raft_consensus.cc:2889] T 5d6b9266d4e74616b08d4e9697a83924 P 0284f1db8c204657b7b423bab5b2eb4f [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260709 13:08:54.672807 18300 raft_consensus.cc:2272] T 5d6b9266d4e74616b08d4e9697a83924 P 0284f1db8c204657b7b423bab5b2eb4f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:54.675127 18300 tablet_replica.cc:333] T 4b9944472adf4cec929d98a95851bef9 P 0284f1db8c204657b7b423bab5b2eb4f: stopping tablet replica
I20260709 13:08:54.675701 18300 raft_consensus.cc:2243] T 4b9944472adf4cec929d98a95851bef9 P 0284f1db8c204657b7b423bab5b2eb4f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:54.676079 18300 raft_consensus.cc:2272] T 4b9944472adf4cec929d98a95851bef9 P 0284f1db8c204657b7b423bab5b2eb4f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:54.677850 18300 tablet_replica.cc:333] T 451e3f8929ef4287a9eaa8941486e9cc P 0284f1db8c204657b7b423bab5b2eb4f: stopping tablet replica
I20260709 13:08:54.678387 18300 raft_consensus.cc:2243] T 451e3f8929ef4287a9eaa8941486e9cc P 0284f1db8c204657b7b423bab5b2eb4f [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:08:54.679028 18300 pending_rounds.cc:70] T 451e3f8929ef4287a9eaa8941486e9cc P 0284f1db8c204657b7b423bab5b2eb4f: Trying to abort 1 pending ops.
I20260709 13:08:54.679246 18300 pending_rounds.cc:77] T 451e3f8929ef4287a9eaa8941486e9cc P 0284f1db8c204657b7b423bab5b2eb4f: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7305635980355809280 op_type: NO_OP noop_request { }
I20260709 13:08:54.679518 18300 raft_consensus.cc:2889] T 451e3f8929ef4287a9eaa8941486e9cc P 0284f1db8c204657b7b423bab5b2eb4f [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260709 13:08:54.679782 18300 raft_consensus.cc:2272] T 451e3f8929ef4287a9eaa8941486e9cc P 0284f1db8c204657b7b423bab5b2eb4f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:54.681919 18300 tablet_replica.cc:333] T 9f5d8f2d6f684a5b9702935fc8fd85a1 P 0284f1db8c204657b7b423bab5b2eb4f: stopping tablet replica
I20260709 13:08:54.682479 18300 raft_consensus.cc:2243] T 9f5d8f2d6f684a5b9702935fc8fd85a1 P 0284f1db8c204657b7b423bab5b2eb4f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:54.682953 18300 raft_consensus.cc:2272] T 9f5d8f2d6f684a5b9702935fc8fd85a1 P 0284f1db8c204657b7b423bab5b2eb4f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:54.685140 18300 tablet_replica.cc:333] T 7087f0eae49f4f71b5769071b817f8f2 P 0284f1db8c204657b7b423bab5b2eb4f: stopping tablet replica
I20260709 13:08:54.685927 18300 raft_consensus.cc:2243] T 7087f0eae49f4f71b5769071b817f8f2 P 0284f1db8c204657b7b423bab5b2eb4f [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:08:54.686566 18300 pending_rounds.cc:70] T 7087f0eae49f4f71b5769071b817f8f2 P 0284f1db8c204657b7b423bab5b2eb4f: Trying to abort 1 pending ops.
I20260709 13:08:54.686825 18300 pending_rounds.cc:77] T 7087f0eae49f4f71b5769071b817f8f2 P 0284f1db8c204657b7b423bab5b2eb4f: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7305635980235358208 op_type: NO_OP noop_request { }
I20260709 13:08:54.687115 18300 raft_consensus.cc:2889] T 7087f0eae49f4f71b5769071b817f8f2 P 0284f1db8c204657b7b423bab5b2eb4f [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260709 13:08:54.687415 18300 raft_consensus.cc:2272] T 7087f0eae49f4f71b5769071b817f8f2 P 0284f1db8c204657b7b423bab5b2eb4f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:54.689519 18300 tablet_replica.cc:333] T eb8f9bf7e0d24af88a04bda489298395 P 0284f1db8c204657b7b423bab5b2eb4f: stopping tablet replica
I20260709 13:08:54.690049 18300 raft_consensus.cc:2243] T eb8f9bf7e0d24af88a04bda489298395 P 0284f1db8c204657b7b423bab5b2eb4f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:54.690459 18300 raft_consensus.cc:2272] T eb8f9bf7e0d24af88a04bda489298395 P 0284f1db8c204657b7b423bab5b2eb4f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:54.692734 18300 tablet_replica.cc:333] T 777f2e0112c34108b367c8a2ad2641e1 P 0284f1db8c204657b7b423bab5b2eb4f: stopping tablet replica
I20260709 13:08:54.693420 18300 raft_consensus.cc:2243] T 777f2e0112c34108b367c8a2ad2641e1 P 0284f1db8c204657b7b423bab5b2eb4f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:54.693866 18300 raft_consensus.cc:2272] T 777f2e0112c34108b367c8a2ad2641e1 P 0284f1db8c204657b7b423bab5b2eb4f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:54.695750 18300 tablet_replica.cc:333] T 0dfbae90dbc4407a9e01872b7d688d55 P 0284f1db8c204657b7b423bab5b2eb4f: stopping tablet replica
I20260709 13:08:54.696318 18300 raft_consensus.cc:2243] T 0dfbae90dbc4407a9e01872b7d688d55 P 0284f1db8c204657b7b423bab5b2eb4f [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:54.696733 18300 raft_consensus.cc:2272] T 0dfbae90dbc4407a9e01872b7d688d55 P 0284f1db8c204657b7b423bab5b2eb4f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:54.698534 18300 tablet_replica.cc:333] T 2b38eb974fe54bb6a799876978d3ba4c P 0284f1db8c204657b7b423bab5b2eb4f: stopping tablet replica
I20260709 13:08:54.699122 18300 raft_consensus.cc:2243] T 2b38eb974fe54bb6a799876978d3ba4c P 0284f1db8c204657b7b423bab5b2eb4f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:54.699582 18300 raft_consensus.cc:2272] T 2b38eb974fe54bb6a799876978d3ba4c P 0284f1db8c204657b7b423bab5b2eb4f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:54.701992 18300 tablet_replica.cc:333] T 879bbeb7e3244e8a8e5ee375c020cb16 P 0284f1db8c204657b7b423bab5b2eb4f: stopping tablet replica
I20260709 13:08:54.702534 18300 raft_consensus.cc:2243] T 879bbeb7e3244e8a8e5ee375c020cb16 P 0284f1db8c204657b7b423bab5b2eb4f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:54.703054 18300 raft_consensus.cc:2272] T 879bbeb7e3244e8a8e5ee375c020cb16 P 0284f1db8c204657b7b423bab5b2eb4f [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:08:54.713692 28938 consensus_peers.cc:597] T 777f2e0112c34108b367c8a2ad2641e1 P ee4d8c8df06e4c04ad53ac25013d8a78 -> Peer 0284f1db8c204657b7b423bab5b2eb4f (127.17.223.1:39279): Couldn't send request to peer 0284f1db8c204657b7b423bab5b2eb4f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:08:54.735301 18300 tablet_server.cc:196] TabletServer@127.17.223.1:0 shutdown complete.
W20260709 13:08:54.819203 28845 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 13:08:54.846988 29128 consensus_queue.cc:1048] T 777f2e0112c34108b367c8a2ad2641e1 P ee4d8c8df06e4c04ad53ac25013d8a78 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3fc42b9680245f3b66db70446830a2f" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 39203 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 13:08:54.874929 29012 consensus_peers.cc:597] T 9f5d8f2d6f684a5b9702935fc8fd85a1 P e3fc42b9680245f3b66db70446830a2f -> Peer 0284f1db8c204657b7b423bab5b2eb4f (127.17.223.1:39279): Couldn't send request to peer 0284f1db8c204657b7b423bab5b2eb4f. Status: Network error: Client connection negotiation failed: client connection to 127.17.223.1:39279: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:08:54.875355 29012 consensus_peers.cc:597] T 4b9944472adf4cec929d98a95851bef9 P e3fc42b9680245f3b66db70446830a2f -> Peer 0284f1db8c204657b7b423bab5b2eb4f (127.17.223.1:39279): Couldn't send request to peer 0284f1db8c204657b7b423bab5b2eb4f. Status: Network error: Client connection negotiation failed: client connection to 127.17.223.1:39279: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:08:54.929235 29096 consensus_queue.cc:1048] T 4b9944472adf4cec929d98a95851bef9 P e3fc42b9680245f3b66db70446830a2f [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee4d8c8df06e4c04ad53ac25013d8a78" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 41821 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 13:08:54.980000 28938 consensus_peers.cc:597] T 879bbeb7e3244e8a8e5ee375c020cb16 P ee4d8c8df06e4c04ad53ac25013d8a78 -> Peer 0284f1db8c204657b7b423bab5b2eb4f (127.17.223.1:39279): Couldn't send request to peer 0284f1db8c204657b7b423bab5b2eb4f. Status: Network error: Client connection negotiation failed: client connection to 127.17.223.1:39279: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:08:54.989470 28938 consensus_peers.cc:597] T 2b38eb974fe54bb6a799876978d3ba4c P ee4d8c8df06e4c04ad53ac25013d8a78 -> Peer 0284f1db8c204657b7b423bab5b2eb4f (127.17.223.1:39279): Couldn't send request to peer 0284f1db8c204657b7b423bab5b2eb4f. Status: Network error: Client connection negotiation failed: client connection to 127.17.223.1:39279: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:08:55.145466 28938 consensus_peers.cc:597] T eb8f9bf7e0d24af88a04bda489298395 P ee4d8c8df06e4c04ad53ac25013d8a78 -> Peer 0284f1db8c204657b7b423bab5b2eb4f (127.17.223.1:39279): Couldn't send request to peer 0284f1db8c204657b7b423bab5b2eb4f. Status: Network error: Client connection negotiation failed: client connection to 127.17.223.1:39279: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:08:55.820217 28845 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 13:08:55.945284 29128 raft_consensus.cc:493] T 7087f0eae49f4f71b5769071b817f8f2 P ee4d8c8df06e4c04ad53ac25013d8a78 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:55.945863 29128 raft_consensus.cc:515] T 7087f0eae49f4f71b5769071b817f8f2 P ee4d8c8df06e4c04ad53ac25013d8a78 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0284f1db8c204657b7b423bab5b2eb4f" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 39279 } } peers { permanent_uuid: "ee4d8c8df06e4c04ad53ac25013d8a78" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 41821 } } peers { permanent_uuid: "e3fc42b9680245f3b66db70446830a2f" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 39203 } }
I20260709 13:08:55.947788 29128 leader_election.cc:290] T 7087f0eae49f4f71b5769071b817f8f2 P ee4d8c8df06e4c04ad53ac25013d8a78 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0284f1db8c204657b7b423bab5b2eb4f (127.17.223.1:39279), e3fc42b9680245f3b66db70446830a2f (127.17.223.3:39203)
I20260709 13:08:55.949265 29048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7087f0eae49f4f71b5769071b817f8f2" candidate_uuid: "ee4d8c8df06e4c04ad53ac25013d8a78" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3fc42b9680245f3b66db70446830a2f" is_pre_election: true
I20260709 13:08:55.949965 29048 raft_consensus.cc:2468] T 7087f0eae49f4f71b5769071b817f8f2 P e3fc42b9680245f3b66db70446830a2f [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee4d8c8df06e4c04ad53ac25013d8a78 in term 1.
I20260709 13:08:55.951064 28938 leader_election.cc:304] T 7087f0eae49f4f71b5769071b817f8f2 P ee4d8c8df06e4c04ad53ac25013d8a78 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e3fc42b9680245f3b66db70446830a2f, ee4d8c8df06e4c04ad53ac25013d8a78; no voters: 
I20260709 13:08:55.951694 29128 raft_consensus.cc:2804] T 7087f0eae49f4f71b5769071b817f8f2 P ee4d8c8df06e4c04ad53ac25013d8a78 [term 1 FOLLOWER]: Leader pre-election won for term 2
W20260709 13:08:55.951706 28938 leader_election.cc:336] T 7087f0eae49f4f71b5769071b817f8f2 P ee4d8c8df06e4c04ad53ac25013d8a78 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 0284f1db8c204657b7b423bab5b2eb4f (127.17.223.1:39279): Network error: Client connection negotiation failed: client connection to 127.17.223.1:39279: connect: Connection refused (error 111)
I20260709 13:08:55.952047 29128 raft_consensus.cc:493] T 7087f0eae49f4f71b5769071b817f8f2 P ee4d8c8df06e4c04ad53ac25013d8a78 [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:55.952414 29128 raft_consensus.cc:3060] T 7087f0eae49f4f71b5769071b817f8f2 P ee4d8c8df06e4c04ad53ac25013d8a78 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:55.957655 29128 raft_consensus.cc:515] T 7087f0eae49f4f71b5769071b817f8f2 P ee4d8c8df06e4c04ad53ac25013d8a78 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0284f1db8c204657b7b423bab5b2eb4f" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 39279 } } peers { permanent_uuid: "ee4d8c8df06e4c04ad53ac25013d8a78" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 41821 } } peers { permanent_uuid: "e3fc42b9680245f3b66db70446830a2f" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 39203 } }
I20260709 13:08:55.959338 29128 leader_election.cc:290] T 7087f0eae49f4f71b5769071b817f8f2 P ee4d8c8df06e4c04ad53ac25013d8a78 [CANDIDATE]: Term 2 election: Requested vote from peers 0284f1db8c204657b7b423bab5b2eb4f (127.17.223.1:39279), e3fc42b9680245f3b66db70446830a2f (127.17.223.3:39203)
I20260709 13:08:55.960980 29048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7087f0eae49f4f71b5769071b817f8f2" candidate_uuid: "ee4d8c8df06e4c04ad53ac25013d8a78" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3fc42b9680245f3b66db70446830a2f"
I20260709 13:08:55.961650 29048 raft_consensus.cc:3060] T 7087f0eae49f4f71b5769071b817f8f2 P e3fc42b9680245f3b66db70446830a2f [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:08:55.962960 28938 leader_election.cc:336] T 7087f0eae49f4f71b5769071b817f8f2 P ee4d8c8df06e4c04ad53ac25013d8a78 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 0284f1db8c204657b7b423bab5b2eb4f (127.17.223.1:39279): Network error: Client connection negotiation failed: client connection to 127.17.223.1:39279: connect: Connection refused (error 111)
I20260709 13:08:55.967474 29048 raft_consensus.cc:2468] T 7087f0eae49f4f71b5769071b817f8f2 P e3fc42b9680245f3b66db70446830a2f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee4d8c8df06e4c04ad53ac25013d8a78 in term 2.
I20260709 13:08:55.968461 28938 leader_election.cc:304] T 7087f0eae49f4f71b5769071b817f8f2 P ee4d8c8df06e4c04ad53ac25013d8a78 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e3fc42b9680245f3b66db70446830a2f, ee4d8c8df06e4c04ad53ac25013d8a78; no voters: 0284f1db8c204657b7b423bab5b2eb4f
I20260709 13:08:55.969129 29128 raft_consensus.cc:2804] T 7087f0eae49f4f71b5769071b817f8f2 P ee4d8c8df06e4c04ad53ac25013d8a78 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:08:55.969515 29128 raft_consensus.cc:697] T 7087f0eae49f4f71b5769071b817f8f2 P ee4d8c8df06e4c04ad53ac25013d8a78 [term 2 LEADER]: Becoming Leader. State: Replica: ee4d8c8df06e4c04ad53ac25013d8a78, State: Running, Role: LEADER
I20260709 13:08:55.970259 29128 consensus_queue.cc:237] T 7087f0eae49f4f71b5769071b817f8f2 P ee4d8c8df06e4c04ad53ac25013d8a78 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0284f1db8c204657b7b423bab5b2eb4f" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 39279 } } peers { permanent_uuid: "ee4d8c8df06e4c04ad53ac25013d8a78" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 41821 } } peers { permanent_uuid: "e3fc42b9680245f3b66db70446830a2f" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 39203 } }
I20260709 13:08:55.977283 28797 catalog_manager.cc:5697] T 7087f0eae49f4f71b5769071b817f8f2 P ee4d8c8df06e4c04ad53ac25013d8a78 reported cstate change: term changed from 1 to 2, leader changed from 0284f1db8c204657b7b423bab5b2eb4f (127.17.223.1) to ee4d8c8df06e4c04ad53ac25013d8a78 (127.17.223.2). New cstate: current_term: 2 leader_uuid: "ee4d8c8df06e4c04ad53ac25013d8a78" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0284f1db8c204657b7b423bab5b2eb4f" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 39279 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ee4d8c8df06e4c04ad53ac25013d8a78" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 41821 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e3fc42b9680245f3b66db70446830a2f" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 39203 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:56.085155 29158 raft_consensus.cc:493] T 0dfbae90dbc4407a9e01872b7d688d55 P ee4d8c8df06e4c04ad53ac25013d8a78 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:56.085734 29158 raft_consensus.cc:515] T 0dfbae90dbc4407a9e01872b7d688d55 P ee4d8c8df06e4c04ad53ac25013d8a78 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0284f1db8c204657b7b423bab5b2eb4f" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 39279 } } peers { permanent_uuid: "ee4d8c8df06e4c04ad53ac25013d8a78" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 41821 } } peers { permanent_uuid: "e3fc42b9680245f3b66db70446830a2f" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 39203 } }
I20260709 13:08:56.087779 29158 leader_election.cc:290] T 0dfbae90dbc4407a9e01872b7d688d55 P ee4d8c8df06e4c04ad53ac25013d8a78 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0284f1db8c204657b7b423bab5b2eb4f (127.17.223.1:39279), e3fc42b9680245f3b66db70446830a2f (127.17.223.3:39203)
W20260709 13:08:56.088992 28938 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.17.223.1:39279: connect: Connection refused (error 111) [suppressed 111 similar messages]
I20260709 13:08:56.089143 29048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0dfbae90dbc4407a9e01872b7d688d55" candidate_uuid: "ee4d8c8df06e4c04ad53ac25013d8a78" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e3fc42b9680245f3b66db70446830a2f" is_pre_election: true
I20260709 13:08:56.089860 29048 raft_consensus.cc:2468] T 0dfbae90dbc4407a9e01872b7d688d55 P e3fc42b9680245f3b66db70446830a2f [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee4d8c8df06e4c04ad53ac25013d8a78 in term 2.
I20260709 13:08:56.091105 28938 leader_election.cc:304] T 0dfbae90dbc4407a9e01872b7d688d55 P ee4d8c8df06e4c04ad53ac25013d8a78 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e3fc42b9680245f3b66db70446830a2f, ee4d8c8df06e4c04ad53ac25013d8a78; no voters: 
I20260709 13:08:56.091857 29158 raft_consensus.cc:2804] T 0dfbae90dbc4407a9e01872b7d688d55 P ee4d8c8df06e4c04ad53ac25013d8a78 [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 13:08:56.091871 28938 leader_election.cc:336] T 0dfbae90dbc4407a9e01872b7d688d55 P ee4d8c8df06e4c04ad53ac25013d8a78 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 0284f1db8c204657b7b423bab5b2eb4f (127.17.223.1:39279): Network error: Client connection negotiation failed: client connection to 127.17.223.1:39279: connect: Connection refused (error 111)
I20260709 13:08:56.092197 29158 raft_consensus.cc:493] T 0dfbae90dbc4407a9e01872b7d688d55 P ee4d8c8df06e4c04ad53ac25013d8a78 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:56.092573 29158 raft_consensus.cc:3060] T 0dfbae90dbc4407a9e01872b7d688d55 P ee4d8c8df06e4c04ad53ac25013d8a78 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:56.097615 29158 raft_consensus.cc:515] T 0dfbae90dbc4407a9e01872b7d688d55 P ee4d8c8df06e4c04ad53ac25013d8a78 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0284f1db8c204657b7b423bab5b2eb4f" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 39279 } } peers { permanent_uuid: "ee4d8c8df06e4c04ad53ac25013d8a78" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 41821 } } peers { permanent_uuid: "e3fc42b9680245f3b66db70446830a2f" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 39203 } }
I20260709 13:08:56.099352 29158 leader_election.cc:290] T 0dfbae90dbc4407a9e01872b7d688d55 P ee4d8c8df06e4c04ad53ac25013d8a78 [CANDIDATE]: Term 3 election: Requested vote from peers 0284f1db8c204657b7b423bab5b2eb4f (127.17.223.1:39279), e3fc42b9680245f3b66db70446830a2f (127.17.223.3:39203)
I20260709 13:08:56.101029 29048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0dfbae90dbc4407a9e01872b7d688d55" candidate_uuid: "ee4d8c8df06e4c04ad53ac25013d8a78" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e3fc42b9680245f3b66db70446830a2f"
I20260709 13:08:56.101658 29048 raft_consensus.cc:3060] T 0dfbae90dbc4407a9e01872b7d688d55 P e3fc42b9680245f3b66db70446830a2f [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:08:56.103433 28938 leader_election.cc:336] T 0dfbae90dbc4407a9e01872b7d688d55 P ee4d8c8df06e4c04ad53ac25013d8a78 [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer 0284f1db8c204657b7b423bab5b2eb4f (127.17.223.1:39279): Network error: Client connection negotiation failed: client connection to 127.17.223.1:39279: connect: Connection refused (error 111)
I20260709 13:08:56.107611 29048 raft_consensus.cc:2468] T 0dfbae90dbc4407a9e01872b7d688d55 P e3fc42b9680245f3b66db70446830a2f [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee4d8c8df06e4c04ad53ac25013d8a78 in term 3.
I20260709 13:08:56.108692 28938 leader_election.cc:304] T 0dfbae90dbc4407a9e01872b7d688d55 P ee4d8c8df06e4c04ad53ac25013d8a78 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e3fc42b9680245f3b66db70446830a2f, ee4d8c8df06e4c04ad53ac25013d8a78; no voters: 0284f1db8c204657b7b423bab5b2eb4f
I20260709 13:08:56.109400 29158 raft_consensus.cc:2804] T 0dfbae90dbc4407a9e01872b7d688d55 P ee4d8c8df06e4c04ad53ac25013d8a78 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:08:56.109935 29158 raft_consensus.cc:697] T 0dfbae90dbc4407a9e01872b7d688d55 P ee4d8c8df06e4c04ad53ac25013d8a78 [term 3 LEADER]: Becoming Leader. State: Replica: ee4d8c8df06e4c04ad53ac25013d8a78, State: Running, Role: LEADER
I20260709 13:08:56.110790 29158 consensus_queue.cc:237] T 0dfbae90dbc4407a9e01872b7d688d55 P ee4d8c8df06e4c04ad53ac25013d8a78 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0284f1db8c204657b7b423bab5b2eb4f" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 39279 } } peers { permanent_uuid: "ee4d8c8df06e4c04ad53ac25013d8a78" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 41821 } } peers { permanent_uuid: "e3fc42b9680245f3b66db70446830a2f" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 39203 } }
I20260709 13:08:56.119160 28797 catalog_manager.cc:5697] T 0dfbae90dbc4407a9e01872b7d688d55 P ee4d8c8df06e4c04ad53ac25013d8a78 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "ee4d8c8df06e4c04ad53ac25013d8a78" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0284f1db8c204657b7b423bab5b2eb4f" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 39279 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ee4d8c8df06e4c04ad53ac25013d8a78" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 41821 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e3fc42b9680245f3b66db70446830a2f" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 39203 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:56.126022 29172 raft_consensus.cc:493] T 451e3f8929ef4287a9eaa8941486e9cc P e3fc42b9680245f3b66db70446830a2f [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:56.126578 29172 raft_consensus.cc:515] T 451e3f8929ef4287a9eaa8941486e9cc P e3fc42b9680245f3b66db70446830a2f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0284f1db8c204657b7b423bab5b2eb4f" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 39279 } } peers { permanent_uuid: "ee4d8c8df06e4c04ad53ac25013d8a78" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 41821 } } peers { permanent_uuid: "e3fc42b9680245f3b66db70446830a2f" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 39203 } }
I20260709 13:08:56.128803 29172 leader_election.cc:290] T 451e3f8929ef4287a9eaa8941486e9cc P e3fc42b9680245f3b66db70446830a2f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0284f1db8c204657b7b423bab5b2eb4f (127.17.223.1:39279), ee4d8c8df06e4c04ad53ac25013d8a78 (127.17.223.2:41821)
I20260709 13:08:56.130182 28973 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "451e3f8929ef4287a9eaa8941486e9cc" candidate_uuid: "e3fc42b9680245f3b66db70446830a2f" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ee4d8c8df06e4c04ad53ac25013d8a78" is_pre_election: true
I20260709 13:08:56.130931 28973 raft_consensus.cc:2468] T 451e3f8929ef4287a9eaa8941486e9cc P ee4d8c8df06e4c04ad53ac25013d8a78 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3fc42b9680245f3b66db70446830a2f in term 1.
I20260709 13:08:56.132002 29012 leader_election.cc:304] T 451e3f8929ef4287a9eaa8941486e9cc P e3fc42b9680245f3b66db70446830a2f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e3fc42b9680245f3b66db70446830a2f, ee4d8c8df06e4c04ad53ac25013d8a78; no voters: 
I20260709 13:08:56.132869 29172 raft_consensus.cc:2804] T 451e3f8929ef4287a9eaa8941486e9cc P e3fc42b9680245f3b66db70446830a2f [term 1 FOLLOWER]: Leader pre-election won for term 2
W20260709 13:08:56.132879 29012 leader_election.cc:336] T 451e3f8929ef4287a9eaa8941486e9cc P e3fc42b9680245f3b66db70446830a2f [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 0284f1db8c204657b7b423bab5b2eb4f (127.17.223.1:39279): Network error: Client connection negotiation failed: client connection to 127.17.223.1:39279: connect: Connection refused (error 111)
I20260709 13:08:56.133358 29172 raft_consensus.cc:493] T 451e3f8929ef4287a9eaa8941486e9cc P e3fc42b9680245f3b66db70446830a2f [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:56.133735 29172 raft_consensus.cc:3060] T 451e3f8929ef4287a9eaa8941486e9cc P e3fc42b9680245f3b66db70446830a2f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:56.139596 29172 raft_consensus.cc:515] T 451e3f8929ef4287a9eaa8941486e9cc P e3fc42b9680245f3b66db70446830a2f [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0284f1db8c204657b7b423bab5b2eb4f" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 39279 } } peers { permanent_uuid: "ee4d8c8df06e4c04ad53ac25013d8a78" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 41821 } } peers { permanent_uuid: "e3fc42b9680245f3b66db70446830a2f" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 39203 } }
I20260709 13:08:56.141283 29172 leader_election.cc:290] T 451e3f8929ef4287a9eaa8941486e9cc P e3fc42b9680245f3b66db70446830a2f [CANDIDATE]: Term 2 election: Requested vote from peers 0284f1db8c204657b7b423bab5b2eb4f (127.17.223.1:39279), ee4d8c8df06e4c04ad53ac25013d8a78 (127.17.223.2:41821)
I20260709 13:08:56.142791 28973 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "451e3f8929ef4287a9eaa8941486e9cc" candidate_uuid: "e3fc42b9680245f3b66db70446830a2f" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ee4d8c8df06e4c04ad53ac25013d8a78"
I20260709 13:08:56.143440 28973 raft_consensus.cc:3060] T 451e3f8929ef4287a9eaa8941486e9cc P ee4d8c8df06e4c04ad53ac25013d8a78 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:08:56.144708 29012 leader_election.cc:336] T 451e3f8929ef4287a9eaa8941486e9cc P e3fc42b9680245f3b66db70446830a2f [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 0284f1db8c204657b7b423bab5b2eb4f (127.17.223.1:39279): Network error: Client connection negotiation failed: client connection to 127.17.223.1:39279: connect: Connection refused (error 111)
I20260709 13:08:56.148326 28973 raft_consensus.cc:2468] T 451e3f8929ef4287a9eaa8941486e9cc P ee4d8c8df06e4c04ad53ac25013d8a78 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3fc42b9680245f3b66db70446830a2f in term 2.
I20260709 13:08:56.149386 29012 leader_election.cc:304] T 451e3f8929ef4287a9eaa8941486e9cc P e3fc42b9680245f3b66db70446830a2f [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e3fc42b9680245f3b66db70446830a2f, ee4d8c8df06e4c04ad53ac25013d8a78; no voters: 0284f1db8c204657b7b423bab5b2eb4f
I20260709 13:08:56.150069 29172 raft_consensus.cc:2804] T 451e3f8929ef4287a9eaa8941486e9cc P e3fc42b9680245f3b66db70446830a2f [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:08:56.151165 29172 raft_consensus.cc:697] T 451e3f8929ef4287a9eaa8941486e9cc P e3fc42b9680245f3b66db70446830a2f [term 2 LEADER]: Becoming Leader. State: Replica: e3fc42b9680245f3b66db70446830a2f, State: Running, Role: LEADER
I20260709 13:08:56.151850 29172 consensus_queue.cc:237] T 451e3f8929ef4287a9eaa8941486e9cc P e3fc42b9680245f3b66db70446830a2f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0284f1db8c204657b7b423bab5b2eb4f" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 39279 } } peers { permanent_uuid: "ee4d8c8df06e4c04ad53ac25013d8a78" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 41821 } } peers { permanent_uuid: "e3fc42b9680245f3b66db70446830a2f" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 39203 } }
I20260709 13:08:56.158720 28797 catalog_manager.cc:5697] T 451e3f8929ef4287a9eaa8941486e9cc P e3fc42b9680245f3b66db70446830a2f reported cstate change: term changed from 1 to 2, leader changed from 0284f1db8c204657b7b423bab5b2eb4f (127.17.223.1) to e3fc42b9680245f3b66db70446830a2f (127.17.223.3). New cstate: current_term: 2 leader_uuid: "e3fc42b9680245f3b66db70446830a2f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0284f1db8c204657b7b423bab5b2eb4f" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 39279 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ee4d8c8df06e4c04ad53ac25013d8a78" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 41821 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e3fc42b9680245f3b66db70446830a2f" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 39203 } health_report { overall_health: HEALTHY } } }
I20260709 13:08:56.420431 29128 raft_consensus.cc:493] T 5d6b9266d4e74616b08d4e9697a83924 P ee4d8c8df06e4c04ad53ac25013d8a78 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:56.420890 29128 raft_consensus.cc:515] T 5d6b9266d4e74616b08d4e9697a83924 P ee4d8c8df06e4c04ad53ac25013d8a78 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0284f1db8c204657b7b423bab5b2eb4f" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 39279 } } peers { permanent_uuid: "ee4d8c8df06e4c04ad53ac25013d8a78" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 41821 } } peers { permanent_uuid: "e3fc42b9680245f3b66db70446830a2f" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 39203 } }
I20260709 13:08:56.423076 29128 leader_election.cc:290] T 5d6b9266d4e74616b08d4e9697a83924 P ee4d8c8df06e4c04ad53ac25013d8a78 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0284f1db8c204657b7b423bab5b2eb4f (127.17.223.1:39279), e3fc42b9680245f3b66db70446830a2f (127.17.223.3:39203)
W20260709 13:08:56.424921 28938 consensus_peers.cc:597] T 7087f0eae49f4f71b5769071b817f8f2 P ee4d8c8df06e4c04ad53ac25013d8a78 -> Peer 0284f1db8c204657b7b423bab5b2eb4f (127.17.223.1:39279): Couldn't send request to peer 0284f1db8c204657b7b423bab5b2eb4f. Status: Network error: Client connection negotiation failed: client connection to 127.17.223.1:39279: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:08:56.424826 29048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d6b9266d4e74616b08d4e9697a83924" candidate_uuid: "ee4d8c8df06e4c04ad53ac25013d8a78" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3fc42b9680245f3b66db70446830a2f" is_pre_election: true
I20260709 13:08:56.425741 29048 raft_consensus.cc:2468] T 5d6b9266d4e74616b08d4e9697a83924 P e3fc42b9680245f3b66db70446830a2f [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee4d8c8df06e4c04ad53ac25013d8a78 in term 1.
I20260709 13:08:56.427388 28938 leader_election.cc:304] T 5d6b9266d4e74616b08d4e9697a83924 P ee4d8c8df06e4c04ad53ac25013d8a78 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e3fc42b9680245f3b66db70446830a2f, ee4d8c8df06e4c04ad53ac25013d8a78; no voters: 
I20260709 13:08:56.428077 29128 raft_consensus.cc:2804] T 5d6b9266d4e74616b08d4e9697a83924 P ee4d8c8df06e4c04ad53ac25013d8a78 [term 1 FOLLOWER]: Leader pre-election won for term 2
W20260709 13:08:56.428141 28938 leader_election.cc:336] T 5d6b9266d4e74616b08d4e9697a83924 P ee4d8c8df06e4c04ad53ac25013d8a78 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 0284f1db8c204657b7b423bab5b2eb4f (127.17.223.1:39279): Network error: Client connection negotiation failed: client connection to 127.17.223.1:39279: connect: Connection refused (error 111)
I20260709 13:08:56.428424 29128 raft_consensus.cc:493] T 5d6b9266d4e74616b08d4e9697a83924 P ee4d8c8df06e4c04ad53ac25013d8a78 [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:56.428807 29128 raft_consensus.cc:3060] T 5d6b9266d4e74616b08d4e9697a83924 P ee4d8c8df06e4c04ad53ac25013d8a78 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:56.433651 29128 raft_consensus.cc:515] T 5d6b9266d4e74616b08d4e9697a83924 P ee4d8c8df06e4c04ad53ac25013d8a78 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0284f1db8c204657b7b423bab5b2eb4f" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 39279 } } peers { permanent_uuid: "ee4d8c8df06e4c04ad53ac25013d8a78" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 41821 } } peers { permanent_uuid: "e3fc42b9680245f3b66db70446830a2f" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 39203 } }
I20260709 13:08:56.435245 29128 leader_election.cc:290] T 5d6b9266d4e74616b08d4e9697a83924 P ee4d8c8df06e4c04ad53ac25013d8a78 [CANDIDATE]: Term 2 election: Requested vote from peers 0284f1db8c204657b7b423bab5b2eb4f (127.17.223.1:39279), e3fc42b9680245f3b66db70446830a2f (127.17.223.3:39203)
I20260709 13:08:56.437000 29048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d6b9266d4e74616b08d4e9697a83924" candidate_uuid: "ee4d8c8df06e4c04ad53ac25013d8a78" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3fc42b9680245f3b66db70446830a2f"
I20260709 13:08:56.437644 29048 raft_consensus.cc:3060] T 5d6b9266d4e74616b08d4e9697a83924 P e3fc42b9680245f3b66db70446830a2f [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:08:56.439286 28938 leader_election.cc:336] T 5d6b9266d4e74616b08d4e9697a83924 P ee4d8c8df06e4c04ad53ac25013d8a78 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 0284f1db8c204657b7b423bab5b2eb4f (127.17.223.1:39279): Network error: Client connection negotiation failed: client connection to 127.17.223.1:39279: connect: Connection refused (error 111)
I20260709 13:08:56.442888 29048 raft_consensus.cc:2468] T 5d6b9266d4e74616b08d4e9697a83924 P e3fc42b9680245f3b66db70446830a2f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee4d8c8df06e4c04ad53ac25013d8a78 in term 2.
I20260709 13:08:56.443972 28938 leader_election.cc:304] T 5d6b9266d4e74616b08d4e9697a83924 P ee4d8c8df06e4c04ad53ac25013d8a78 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e3fc42b9680245f3b66db70446830a2f, ee4d8c8df06e4c04ad53ac25013d8a78; no voters: 0284f1db8c204657b7b423bab5b2eb4f
I20260709 13:08:56.444645 29128 raft_consensus.cc:2804] T 5d6b9266d4e74616b08d4e9697a83924 P ee4d8c8df06e4c04ad53ac25013d8a78 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:08:56.445122 29128 raft_consensus.cc:697] T 5d6b9266d4e74616b08d4e9697a83924 P ee4d8c8df06e4c04ad53ac25013d8a78 [term 2 LEADER]: Becoming Leader. State: Replica: ee4d8c8df06e4c04ad53ac25013d8a78, State: Running, Role: LEADER
I20260709 13:08:56.445736 29128 consensus_queue.cc:237] T 5d6b9266d4e74616b08d4e9697a83924 P ee4d8c8df06e4c04ad53ac25013d8a78 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0284f1db8c204657b7b423bab5b2eb4f" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 39279 } } peers { permanent_uuid: "ee4d8c8df06e4c04ad53ac25013d8a78" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 41821 } } peers { permanent_uuid: "e3fc42b9680245f3b66db70446830a2f" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 39203 } }
I20260709 13:08:56.453577 28797 catalog_manager.cc:5697] T 5d6b9266d4e74616b08d4e9697a83924 P ee4d8c8df06e4c04ad53ac25013d8a78 reported cstate change: term changed from 1 to 2, leader changed from 0284f1db8c204657b7b423bab5b2eb4f (127.17.223.1) to ee4d8c8df06e4c04ad53ac25013d8a78 (127.17.223.2). New cstate: current_term: 2 leader_uuid: "ee4d8c8df06e4c04ad53ac25013d8a78" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0284f1db8c204657b7b423bab5b2eb4f" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 39279 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ee4d8c8df06e4c04ad53ac25013d8a78" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 41821 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e3fc42b9680245f3b66db70446830a2f" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 39203 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:56.508474 29048 raft_consensus.cc:1275] T 7087f0eae49f4f71b5769071b817f8f2 P e3fc42b9680245f3b66db70446830a2f [term 2 FOLLOWER]: Refusing update from remote peer ee4d8c8df06e4c04ad53ac25013d8a78: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 13:08:56.509728 29128 consensus_queue.cc:1048] T 7087f0eae49f4f71b5769071b817f8f2 P ee4d8c8df06e4c04ad53ac25013d8a78 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3fc42b9680245f3b66db70446830a2f" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 39203 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 13:08:56.609970 28938 consensus_peers.cc:597] T 0dfbae90dbc4407a9e01872b7d688d55 P ee4d8c8df06e4c04ad53ac25013d8a78 -> Peer 0284f1db8c204657b7b423bab5b2eb4f (127.17.223.1:39279): Couldn't send request to peer 0284f1db8c204657b7b423bab5b2eb4f. Status: Network error: Client connection negotiation failed: client connection to 127.17.223.1:39279: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:08:56.696921 29048 raft_consensus.cc:1275] T 0dfbae90dbc4407a9e01872b7d688d55 P e3fc42b9680245f3b66db70446830a2f [term 3 FOLLOWER]: Refusing update from remote peer ee4d8c8df06e4c04ad53ac25013d8a78: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:08:56.698177 29128 consensus_queue.cc:1048] T 0dfbae90dbc4407a9e01872b7d688d55 P ee4d8c8df06e4c04ad53ac25013d8a78 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3fc42b9680245f3b66db70446830a2f" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 39203 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 13:08:56.710752 29012 consensus_peers.cc:597] T 451e3f8929ef4287a9eaa8941486e9cc P e3fc42b9680245f3b66db70446830a2f -> Peer 0284f1db8c204657b7b423bab5b2eb4f (127.17.223.1:39279): Couldn't send request to peer 0284f1db8c204657b7b423bab5b2eb4f. Status: Network error: Client connection negotiation failed: client connection to 127.17.223.1:39279: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:08:56.776777 28973 raft_consensus.cc:1275] T 451e3f8929ef4287a9eaa8941486e9cc P ee4d8c8df06e4c04ad53ac25013d8a78 [term 2 FOLLOWER]: Refusing update from remote peer e3fc42b9680245f3b66db70446830a2f: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 13:08:56.778012 29172 consensus_queue.cc:1048] T 451e3f8929ef4287a9eaa8941486e9cc P e3fc42b9680245f3b66db70446830a2f [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee4d8c8df06e4c04ad53ac25013d8a78" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 41821 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 13:08:56.821192 28845 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
W20260709 13:08:56.869761 28938 consensus_peers.cc:597] T 5d6b9266d4e74616b08d4e9697a83924 P ee4d8c8df06e4c04ad53ac25013d8a78 -> Peer 0284f1db8c204657b7b423bab5b2eb4f (127.17.223.1:39279): Couldn't send request to peer 0284f1db8c204657b7b423bab5b2eb4f. Status: Network error: Client connection negotiation failed: client connection to 127.17.223.1:39279: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:08:57.056985 29048 raft_consensus.cc:1275] T 5d6b9266d4e74616b08d4e9697a83924 P e3fc42b9680245f3b66db70446830a2f [term 2 FOLLOWER]: Refusing update from remote peer ee4d8c8df06e4c04ad53ac25013d8a78: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 13:08:57.058182 29158 consensus_queue.cc:1048] T 5d6b9266d4e74616b08d4e9697a83924 P ee4d8c8df06e4c04ad53ac25013d8a78 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3fc42b9680245f3b66db70446830a2f" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 39203 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 13:08:57.124383 28938 consensus_peers.cc:597] T 777f2e0112c34108b367c8a2ad2641e1 P ee4d8c8df06e4c04ad53ac25013d8a78 -> Peer 0284f1db8c204657b7b423bab5b2eb4f (127.17.223.1:39279): Couldn't send request to peer 0284f1db8c204657b7b423bab5b2eb4f. Status: Network error: Client connection negotiation failed: client connection to 127.17.223.1:39279: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:08:57.215688 29012 consensus_peers.cc:597] T 4b9944472adf4cec929d98a95851bef9 P e3fc42b9680245f3b66db70446830a2f -> Peer 0284f1db8c204657b7b423bab5b2eb4f (127.17.223.1:39279): Couldn't send request to peer 0284f1db8c204657b7b423bab5b2eb4f. Status: Network error: Client connection negotiation failed: client connection to 127.17.223.1:39279: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:08:57.326285 28938 consensus_peers.cc:597] T 2b38eb974fe54bb6a799876978d3ba4c P ee4d8c8df06e4c04ad53ac25013d8a78 -> Peer 0284f1db8c204657b7b423bab5b2eb4f (127.17.223.1:39279): Couldn't send request to peer 0284f1db8c204657b7b423bab5b2eb4f. Status: Network error: Client connection negotiation failed: client connection to 127.17.223.1:39279: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:08:57.403141 29012 consensus_peers.cc:597] T 9f5d8f2d6f684a5b9702935fc8fd85a1 P e3fc42b9680245f3b66db70446830a2f -> Peer 0284f1db8c204657b7b423bab5b2eb4f (127.17.223.1:39279): Couldn't send request to peer 0284f1db8c204657b7b423bab5b2eb4f. Status: Network error: Client connection negotiation failed: client connection to 127.17.223.1:39279: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:08:57.513772 28938 consensus_peers.cc:597] T eb8f9bf7e0d24af88a04bda489298395 P ee4d8c8df06e4c04ad53ac25013d8a78 -> Peer 0284f1db8c204657b7b423bab5b2eb4f (127.17.223.1:39279): Couldn't send request to peer 0284f1db8c204657b7b423bab5b2eb4f. Status: Network error: Client connection negotiation failed: client connection to 127.17.223.1:39279: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:08:57.576486 28938 consensus_peers.cc:597] T 879bbeb7e3244e8a8e5ee375c020cb16 P ee4d8c8df06e4c04ad53ac25013d8a78 -> Peer 0284f1db8c204657b7b423bab5b2eb4f (127.17.223.1:39279): Couldn't send request to peer 0284f1db8c204657b7b423bab5b2eb4f. Status: Network error: Client connection negotiation failed: client connection to 127.17.223.1:39279: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:08:57.822105 28845 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
W20260709 13:08:58.823153 28845 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
W20260709 13:08:58.980769 28938 consensus_peers.cc:597] T 7087f0eae49f4f71b5769071b817f8f2 P ee4d8c8df06e4c04ad53ac25013d8a78 -> Peer 0284f1db8c204657b7b423bab5b2eb4f (127.17.223.1:39279): Couldn't send request to peer 0284f1db8c204657b7b423bab5b2eb4f. Status: Network error: Client connection negotiation failed: client connection to 127.17.223.1:39279: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:08:59.015450 29012 consensus_peers.cc:597] T 451e3f8929ef4287a9eaa8941486e9cc P e3fc42b9680245f3b66db70446830a2f -> Peer 0284f1db8c204657b7b423bab5b2eb4f (127.17.223.1:39279): Couldn't send request to peer 0284f1db8c204657b7b423bab5b2eb4f. Status: Network error: Client connection negotiation failed: client connection to 127.17.223.1:39279: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:08:59.128603 28938 consensus_peers.cc:597] T 0dfbae90dbc4407a9e01872b7d688d55 P ee4d8c8df06e4c04ad53ac25013d8a78 -> Peer 0284f1db8c204657b7b423bab5b2eb4f (127.17.223.1:39279): Couldn't send request to peer 0284f1db8c204657b7b423bab5b2eb4f. Status: Network error: Client connection negotiation failed: client connection to 127.17.223.1:39279: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:08:59.493603 28938 consensus_peers.cc:597] T 5d6b9266d4e74616b08d4e9697a83924 P ee4d8c8df06e4c04ad53ac25013d8a78 -> Peer 0284f1db8c204657b7b423bab5b2eb4f (127.17.223.1:39279): Couldn't send request to peer 0284f1db8c204657b7b423bab5b2eb4f. Status: Network error: Client connection negotiation failed: client connection to 127.17.223.1:39279: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:08:59.662846 28938 consensus_peers.cc:597] T 777f2e0112c34108b367c8a2ad2641e1 P ee4d8c8df06e4c04ad53ac25013d8a78 -> Peer 0284f1db8c204657b7b423bab5b2eb4f (127.17.223.1:39279): Couldn't send request to peer 0284f1db8c204657b7b423bab5b2eb4f. Status: Network error: Client connection negotiation failed: client connection to 127.17.223.1:39279: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:08:59.752609 18300 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:08:59.758610 29191 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:08:59.759256 29192 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:08:59.761260 29194 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:08:59.762755 18300 server_base.cc:1061] running on GCE node
I20260709 13:08:59.763903 18300 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:08:59.764169 18300 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:08:59.764366 18300 hybrid_clock.cc:648] HybridClock initialized: now 1783602539764329 us; error 0 us; skew 500 ppm
I20260709 13:08:59.764914 18300 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:08:59.767503 18300 webserver.cc:533] Webserver started at http://127.17.223.1:46733/ using document root <none> and password file <none>
I20260709 13:08:59.768005 18300 fs_manager.cc:362] Metadata directory not provided
I20260709 13:08:59.768184 18300 fs_manager.cc:365] Using existing metadata directory in first data directory
I20260709 13:08:59.771932 18300 fs_manager.cc:714] Time spent opening directory manager: real 0.003s	user 0.004s	sys 0.000s
I20260709 13:08:59.776481 29199 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:08:59.777455 18300 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.004s	sys 0.000s
I20260709 13:08:59.777913 18300 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskKd2k48/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602220613947-18300-0/minicluster-data/ts-0-root
uuid: "0284f1db8c204657b7b423bab5b2eb4f"
format_stamp: "Formatted at 2026-07-09 13:08:52 on dist-test-slave-vl1s"
I20260709 13:08:59.778368 18300 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskKd2k48/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602220613947-18300-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskKd2k48/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602220613947-18300-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskKd2k48/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602220613947-18300-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:08:59.793728 18300 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:08:59.794843 18300 kserver.cc:163] Server-wide thread pool size limit: 3276
W20260709 13:08:59.796478 29012 consensus_peers.cc:597] T 9f5d8f2d6f684a5b9702935fc8fd85a1 P e3fc42b9680245f3b66db70446830a2f -> Peer 0284f1db8c204657b7b423bab5b2eb4f (127.17.223.1:39279): Couldn't send request to peer 0284f1db8c204657b7b423bab5b2eb4f. Status: Network error: Client connection negotiation failed: client connection to 127.17.223.1:39279: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:08:59.796547 18300 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:08:59.800169 29206 ts_tablet_manager.cc:548] Loading tablet metadata (0/10 complete)
W20260709 13:08:59.824133 28845 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 13:08:59.853833 18300 ts_tablet_manager.cc:585] Loaded tablet metadata (10 total tablets, 10 live tablets)
I20260709 13:08:59.854280 18300 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.055s	user 0.002s	sys 0.000s
I20260709 13:08:59.854641 18300 ts_tablet_manager.cc:600] Registering tablets (0/10 complete)
I20260709 13:08:59.860069 29206 tablet_bootstrap.cc:492] T 879bbeb7e3244e8a8e5ee375c020cb16 P 0284f1db8c204657b7b423bab5b2eb4f: Bootstrap starting.
W20260709 13:08:59.869405 28938 consensus_peers.cc:597] T 2b38eb974fe54bb6a799876978d3ba4c P ee4d8c8df06e4c04ad53ac25013d8a78 -> Peer 0284f1db8c204657b7b423bab5b2eb4f (127.17.223.1:39279): Couldn't send request to peer 0284f1db8c204657b7b423bab5b2eb4f. Status: Network error: Client connection negotiation failed: client connection to 127.17.223.1:39279: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:08:59.875964 29206 tablet_bootstrap.cc:492] T 879bbeb7e3244e8a8e5ee375c020cb16 P 0284f1db8c204657b7b423bab5b2eb4f: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:08:59.877090 29206 tablet_bootstrap.cc:492] T 879bbeb7e3244e8a8e5ee375c020cb16 P 0284f1db8c204657b7b423bab5b2eb4f: Bootstrap complete.
I20260709 13:08:59.877744 29206 ts_tablet_manager.cc:1403] T 879bbeb7e3244e8a8e5ee375c020cb16 P 0284f1db8c204657b7b423bab5b2eb4f: Time spent bootstrapping tablet: real 0.018s	user 0.012s	sys 0.003s
I20260709 13:08:59.880389 29206 raft_consensus.cc:359] T 879bbeb7e3244e8a8e5ee375c020cb16 P 0284f1db8c204657b7b423bab5b2eb4f [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0284f1db8c204657b7b423bab5b2eb4f" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 39279 } } peers { permanent_uuid: "ee4d8c8df06e4c04ad53ac25013d8a78" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 41821 } } peers { permanent_uuid: "e3fc42b9680245f3b66db70446830a2f" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 39203 } }
I20260709 13:08:59.881103 29206 raft_consensus.cc:740] T 879bbeb7e3244e8a8e5ee375c020cb16 P 0284f1db8c204657b7b423bab5b2eb4f [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0284f1db8c204657b7b423bab5b2eb4f, State: Initialized, Role: FOLLOWER
I20260709 13:08:59.881865 29206 consensus_queue.cc:260] T 879bbeb7e3244e8a8e5ee375c020cb16 P 0284f1db8c204657b7b423bab5b2eb4f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0284f1db8c204657b7b423bab5b2eb4f" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 39279 } } peers { permanent_uuid: "ee4d8c8df06e4c04ad53ac25013d8a78" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 41821 } } peers { permanent_uuid: "e3fc42b9680245f3b66db70446830a2f" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 39203 } }
W20260709 13:08:59.882308 29012 consensus_peers.cc:597] T 4b9944472adf4cec929d98a95851bef9 P e3fc42b9680245f3b66db70446830a2f -> Peer 0284f1db8c204657b7b423bab5b2eb4f (127.17.223.1:39279): Couldn't send request to peer 0284f1db8c204657b7b423bab5b2eb4f. Status: Network error: Client connection negotiation failed: client connection to 127.17.223.1:39279: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:08:59.884536 29206 ts_tablet_manager.cc:1434] T 879bbeb7e3244e8a8e5ee375c020cb16 P 0284f1db8c204657b7b423bab5b2eb4f: Time spent starting tablet: real 0.006s	user 0.003s	sys 0.005s
I20260709 13:08:59.885402 29206 tablet_bootstrap.cc:492] T 777f2e0112c34108b367c8a2ad2641e1 P 0284f1db8c204657b7b423bab5b2eb4f: Bootstrap starting.
I20260709 13:08:59.898618 29206 tablet_bootstrap.cc:492] T 777f2e0112c34108b367c8a2ad2641e1 P 0284f1db8c204657b7b423bab5b2eb4f: Bootstrap replayed 1/1 log segments. Stats: ops{read=0 overwritten=0 applied=0 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:08:59.899616 29206 tablet_bootstrap.cc:492] T 777f2e0112c34108b367c8a2ad2641e1 P 0284f1db8c204657b7b423bab5b2eb4f: Bootstrap complete.
I20260709 13:08:59.900353 29206 ts_tablet_manager.cc:1403] T 777f2e0112c34108b367c8a2ad2641e1 P 0284f1db8c204657b7b423bab5b2eb4f: Time spent bootstrapping tablet: real 0.015s	user 0.013s	sys 0.000s
I20260709 13:08:59.903120 29206 raft_consensus.cc:359] T 777f2e0112c34108b367c8a2ad2641e1 P 0284f1db8c204657b7b423bab5b2eb4f [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0284f1db8c204657b7b423bab5b2eb4f" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 39279 } } peers { permanent_uuid: "ee4d8c8df06e4c04ad53ac25013d8a78" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 41821 } } peers { permanent_uuid: "e3fc42b9680245f3b66db70446830a2f" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 39203 } }
I20260709 13:08:59.903954 29206 raft_consensus.cc:740] T 777f2e0112c34108b367c8a2ad2641e1 P 0284f1db8c204657b7b423bab5b2eb4f [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0284f1db8c204657b7b423bab5b2eb4f, State: Initialized, Role: FOLLOWER
I20260709 13:08:59.904745 29206 consensus_queue.cc:260] T 777f2e0112c34108b367c8a2ad2641e1 P 0284f1db8c204657b7b423bab5b2eb4f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0284f1db8c204657b7b423bab5b2eb4f" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 39279 } } peers { permanent_uuid: "ee4d8c8df06e4c04ad53ac25013d8a78" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 41821 } } peers { permanent_uuid: "e3fc42b9680245f3b66db70446830a2f" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 39203 } }
I20260709 13:08:59.907029 29206 ts_tablet_manager.cc:1434] T 777f2e0112c34108b367c8a2ad2641e1 P 0284f1db8c204657b7b423bab5b2eb4f: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.002s
I20260709 13:08:59.907898 29206 tablet_bootstrap.cc:492] T 5d6b9266d4e74616b08d4e9697a83924 P 0284f1db8c204657b7b423bab5b2eb4f: Bootstrap starting.
I20260709 13:08:59.918850 18300 ts_tablet_manager.cc:616] Registered 10 tablets
I20260709 13:08:59.919248 18300 ts_tablet_manager.cc:595] Time spent register tablets: real 0.065s	user 0.065s	sys 0.000s
W20260709 13:08:59.919821 28938 consensus_peers.cc:597] T 879bbeb7e3244e8a8e5ee375c020cb16 P ee4d8c8df06e4c04ad53ac25013d8a78 -> Peer 0284f1db8c204657b7b423bab5b2eb4f (127.17.223.1:39279): Couldn't send request to peer 0284f1db8c204657b7b423bab5b2eb4f. Status: Network error: Client connection negotiation failed: client connection to 127.17.223.1:39279: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:08:59.926610 29206 tablet_bootstrap.cc:492] T 5d6b9266d4e74616b08d4e9697a83924 P 0284f1db8c204657b7b423bab5b2eb4f: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=0 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 1 replicates
I20260709 13:08:59.928125 29206 tablet_bootstrap.cc:492] T 5d6b9266d4e74616b08d4e9697a83924 P 0284f1db8c204657b7b423bab5b2eb4f: Bootstrap complete.
I20260709 13:08:59.929199 29206 ts_tablet_manager.cc:1403] T 5d6b9266d4e74616b08d4e9697a83924 P 0284f1db8c204657b7b423bab5b2eb4f: Time spent bootstrapping tablet: real 0.022s	user 0.018s	sys 0.000s
I20260709 13:08:59.932718 29206 raft_consensus.cc:359] T 5d6b9266d4e74616b08d4e9697a83924 P 0284f1db8c204657b7b423bab5b2eb4f [term 1 FOLLOWER]: Replica starting. Triggering 1 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0284f1db8c204657b7b423bab5b2eb4f" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 39279 } } peers { permanent_uuid: "ee4d8c8df06e4c04ad53ac25013d8a78" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 41821 } } peers { permanent_uuid: "e3fc42b9680245f3b66db70446830a2f" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 39203 } }
I20260709 13:08:59.933856 29206 raft_consensus.cc:740] T 5d6b9266d4e74616b08d4e9697a83924 P 0284f1db8c204657b7b423bab5b2eb4f [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0284f1db8c204657b7b423bab5b2eb4f, State: Initialized, Role: FOLLOWER
I20260709 13:08:59.934782 29206 consensus_queue.cc:260] T 5d6b9266d4e74616b08d4e9697a83924 P 0284f1db8c204657b7b423bab5b2eb4f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0284f1db8c204657b7b423bab5b2eb4f" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 39279 } } peers { permanent_uuid: "ee4d8c8df06e4c04ad53ac25013d8a78" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 41821 } } peers { permanent_uuid: "e3fc42b9680245f3b66db70446830a2f" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 39203 } }
I20260709 13:08:59.937444 29206 ts_tablet_manager.cc:1434] T 5d6b9266d4e74616b08d4e9697a83924 P 0284f1db8c204657b7b423bab5b2eb4f: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 13:08:59.938586 29206 tablet_bootstrap.cc:492] T 0dfbae90dbc4407a9e01872b7d688d55 P 0284f1db8c204657b7b423bab5b2eb4f: Bootstrap starting.
I20260709 13:08:59.952656 29206 tablet_bootstrap.cc:492] T 0dfbae90dbc4407a9e01872b7d688d55 P 0284f1db8c204657b7b423bab5b2eb4f: Bootstrap replayed 1/1 log segments. Stats: ops{read=0 overwritten=0 applied=0 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:08:59.953310 29206 tablet_bootstrap.cc:492] T 0dfbae90dbc4407a9e01872b7d688d55 P 0284f1db8c204657b7b423bab5b2eb4f: Bootstrap complete.
I20260709 13:08:59.953876 29206 ts_tablet_manager.cc:1403] T 0dfbae90dbc4407a9e01872b7d688d55 P 0284f1db8c204657b7b423bab5b2eb4f: Time spent bootstrapping tablet: real 0.016s	user 0.009s	sys 0.003s
I20260709 13:08:59.956310 29206 raft_consensus.cc:359] T 0dfbae90dbc4407a9e01872b7d688d55 P 0284f1db8c204657b7b423bab5b2eb4f [term 2 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0284f1db8c204657b7b423bab5b2eb4f" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 39279 } } peers { permanent_uuid: "ee4d8c8df06e4c04ad53ac25013d8a78" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 41821 } } peers { permanent_uuid: "e3fc42b9680245f3b66db70446830a2f" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 39203 } }
I20260709 13:08:59.956864 29206 raft_consensus.cc:740] T 0dfbae90dbc4407a9e01872b7d688d55 P 0284f1db8c204657b7b423bab5b2eb4f [term 2 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0284f1db8c204657b7b423bab5b2eb4f, State: Initialized, Role: FOLLOWER
I20260709 13:08:59.957507 29206 consensus_queue.cc:260] T 0dfbae90dbc4407a9e01872b7d688d55 P 0284f1db8c204657b7b423bab5b2eb4f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0284f1db8c204657b7b423bab5b2eb4f" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 39279 } } peers { permanent_uuid: "ee4d8c8df06e4c04ad53ac25013d8a78" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 41821 } } peers { permanent_uuid: "e3fc42b9680245f3b66db70446830a2f" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 39203 } }
I20260709 13:08:59.958930 29206 ts_tablet_manager.cc:1434] T 0dfbae90dbc4407a9e01872b7d688d55 P 0284f1db8c204657b7b423bab5b2eb4f: Time spent starting tablet: real 0.005s	user 0.007s	sys 0.000s
I20260709 13:08:59.959548 29206 tablet_bootstrap.cc:492] T 9f5d8f2d6f684a5b9702935fc8fd85a1 P 0284f1db8c204657b7b423bab5b2eb4f: Bootstrap starting.
I20260709 13:08:59.972110 29206 tablet_bootstrap.cc:492] T 9f5d8f2d6f684a5b9702935fc8fd85a1 P 0284f1db8c204657b7b423bab5b2eb4f: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:08:59.973165 29206 tablet_bootstrap.cc:492] T 9f5d8f2d6f684a5b9702935fc8fd85a1 P 0284f1db8c204657b7b423bab5b2eb4f: Bootstrap complete.
I20260709 13:08:59.973778 29206 ts_tablet_manager.cc:1403] T 9f5d8f2d6f684a5b9702935fc8fd85a1 P 0284f1db8c204657b7b423bab5b2eb4f: Time spent bootstrapping tablet: real 0.014s	user 0.009s	sys 0.004s
I20260709 13:08:59.974567 18300 rpc_server.cc:307] RPC server started. Bound to: 127.17.223.1:39279
I20260709 13:08:59.974701 29268 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.17.223.1:39279 every 8 connection(s)
I20260709 13:08:59.975754 29206 raft_consensus.cc:359] T 9f5d8f2d6f684a5b9702935fc8fd85a1 P 0284f1db8c204657b7b423bab5b2eb4f [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0284f1db8c204657b7b423bab5b2eb4f" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 39279 } } peers { permanent_uuid: "ee4d8c8df06e4c04ad53ac25013d8a78" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 41821 } } peers { permanent_uuid: "e3fc42b9680245f3b66db70446830a2f" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 39203 } }
I20260709 13:08:59.976320 29206 raft_consensus.cc:740] T 9f5d8f2d6f684a5b9702935fc8fd85a1 P 0284f1db8c204657b7b423bab5b2eb4f [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0284f1db8c204657b7b423bab5b2eb4f, State: Initialized, Role: FOLLOWER
I20260709 13:08:59.976933 29206 consensus_queue.cc:260] T 9f5d8f2d6f684a5b9702935fc8fd85a1 P 0284f1db8c204657b7b423bab5b2eb4f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0284f1db8c204657b7b423bab5b2eb4f" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 39279 } } peers { permanent_uuid: "ee4d8c8df06e4c04ad53ac25013d8a78" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 41821 } } peers { permanent_uuid: "e3fc42b9680245f3b66db70446830a2f" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 39203 } }
I20260709 13:08:59.978358 29206 ts_tablet_manager.cc:1434] T 9f5d8f2d6f684a5b9702935fc8fd85a1 P 0284f1db8c204657b7b423bab5b2eb4f: Time spent starting tablet: real 0.004s	user 0.001s	sys 0.000s
I20260709 13:08:59.979158 29206 tablet_bootstrap.cc:492] T 4b9944472adf4cec929d98a95851bef9 P 0284f1db8c204657b7b423bab5b2eb4f: Bootstrap starting.
I20260709 13:08:59.979976 18300 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:08:59.999325 29206 tablet_bootstrap.cc:492] T 4b9944472adf4cec929d98a95851bef9 P 0284f1db8c204657b7b423bab5b2eb4f: Bootstrap replayed 1/1 log segments. Stats: ops{read=0 overwritten=0 applied=0 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:09:00.000550 29206 tablet_bootstrap.cc:492] T 4b9944472adf4cec929d98a95851bef9 P 0284f1db8c204657b7b423bab5b2eb4f: Bootstrap complete.
I20260709 13:09:00.001564 29206 ts_tablet_manager.cc:1403] T 4b9944472adf4cec929d98a95851bef9 P 0284f1db8c204657b7b423bab5b2eb4f: Time spent bootstrapping tablet: real 0.023s	user 0.016s	sys 0.004s
I20260709 13:09:00.005180 29206 raft_consensus.cc:359] T 4b9944472adf4cec929d98a95851bef9 P 0284f1db8c204657b7b423bab5b2eb4f [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0284f1db8c204657b7b423bab5b2eb4f" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 39279 } } peers { permanent_uuid: "ee4d8c8df06e4c04ad53ac25013d8a78" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 41821 } } peers { permanent_uuid: "e3fc42b9680245f3b66db70446830a2f" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 39203 } }
I20260709 13:09:00.006209 29206 raft_consensus.cc:740] T 4b9944472adf4cec929d98a95851bef9 P 0284f1db8c204657b7b423bab5b2eb4f [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0284f1db8c204657b7b423bab5b2eb4f, State: Initialized, Role: FOLLOWER
I20260709 13:09:00.007413 29206 consensus_queue.cc:260] T 4b9944472adf4cec929d98a95851bef9 P 0284f1db8c204657b7b423bab5b2eb4f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0284f1db8c204657b7b423bab5b2eb4f" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 39279 } } peers { permanent_uuid: "ee4d8c8df06e4c04ad53ac25013d8a78" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 41821 } } peers { permanent_uuid: "e3fc42b9680245f3b66db70446830a2f" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 39203 } }
I20260709 13:09:00.010701 29206 ts_tablet_manager.cc:1434] T 4b9944472adf4cec929d98a95851bef9 P 0284f1db8c204657b7b423bab5b2eb4f: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.000s
I20260709 13:09:00.011670 29206 tablet_bootstrap.cc:492] T 7087f0eae49f4f71b5769071b817f8f2 P 0284f1db8c204657b7b423bab5b2eb4f: Bootstrap starting.
I20260709 13:09:00.018736 29269 heartbeater.cc:344] Connected to a master server at 127.17.223.62:35571
I20260709 13:09:00.019608 29269 heartbeater.cc:461] Registering TS with master...
I20260709 13:09:00.020453 29269 heartbeater.cc:507] Master 127.17.223.62:35571 requested a full tablet report, sending...
I20260709 13:09:00.023604 28972 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "777f2e0112c34108b367c8a2ad2641e1"
dest_uuid: "ee4d8c8df06e4c04ad53ac25013d8a78"
mode: GRACEFUL
new_leader_uuid: "e3fc42b9680245f3b66db70446830a2f"
 from {username='slave'} at 127.0.0.1:60718
I20260709 13:09:00.024380 28972 raft_consensus.cc:606] T 777f2e0112c34108b367c8a2ad2641e1 P ee4d8c8df06e4c04ad53ac25013d8a78 [term 1 LEADER]: Received request to transfer leadership to TS e3fc42b9680245f3b66db70446830a2f
I20260709 13:09:00.025832 29206 tablet_bootstrap.cc:492] T 7087f0eae49f4f71b5769071b817f8f2 P 0284f1db8c204657b7b423bab5b2eb4f: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=0 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 1 replicates
I20260709 13:09:00.026342 28797 ts_manager.cc:194] Re-registered known tserver with Master: 0284f1db8c204657b7b423bab5b2eb4f (127.17.223.1:39279)
I20260709 13:09:00.026804 29206 tablet_bootstrap.cc:492] T 7087f0eae49f4f71b5769071b817f8f2 P 0284f1db8c204657b7b423bab5b2eb4f: Bootstrap complete.
I20260709 13:09:00.027534 29206 ts_tablet_manager.cc:1403] T 7087f0eae49f4f71b5769071b817f8f2 P 0284f1db8c204657b7b423bab5b2eb4f: Time spent bootstrapping tablet: real 0.016s	user 0.011s	sys 0.004s
I20260709 13:09:00.028144 28972 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "879bbeb7e3244e8a8e5ee375c020cb16"
dest_uuid: "ee4d8c8df06e4c04ad53ac25013d8a78"
mode: GRACEFUL
new_leader_uuid: "e3fc42b9680245f3b66db70446830a2f"
 from {username='slave'} at 127.0.0.1:60718
I20260709 13:09:00.028743 28972 raft_consensus.cc:606] T 879bbeb7e3244e8a8e5ee375c020cb16 P ee4d8c8df06e4c04ad53ac25013d8a78 [term 1 LEADER]: Received request to transfer leadership to TS e3fc42b9680245f3b66db70446830a2f
I20260709 13:09:00.030030 29206 raft_consensus.cc:359] T 7087f0eae49f4f71b5769071b817f8f2 P 0284f1db8c204657b7b423bab5b2eb4f [term 1 FOLLOWER]: Replica starting. Triggering 1 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0284f1db8c204657b7b423bab5b2eb4f" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 39279 } } peers { permanent_uuid: "ee4d8c8df06e4c04ad53ac25013d8a78" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 41821 } } peers { permanent_uuid: "e3fc42b9680245f3b66db70446830a2f" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 39203 } }
I20260709 13:09:00.030941 29206 raft_consensus.cc:740] T 7087f0eae49f4f71b5769071b817f8f2 P 0284f1db8c204657b7b423bab5b2eb4f [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0284f1db8c204657b7b423bab5b2eb4f, State: Initialized, Role: FOLLOWER
I20260709 13:09:00.031878 28972 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "eb8f9bf7e0d24af88a04bda489298395"
dest_uuid: "ee4d8c8df06e4c04ad53ac25013d8a78"
mode: GRACEFUL
new_leader_uuid: "e3fc42b9680245f3b66db70446830a2f"
 from {username='slave'} at 127.0.0.1:60718
I20260709 13:09:00.031818 29206 consensus_queue.cc:260] T 7087f0eae49f4f71b5769071b817f8f2 P 0284f1db8c204657b7b423bab5b2eb4f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0284f1db8c204657b7b423bab5b2eb4f" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 39279 } } peers { permanent_uuid: "ee4d8c8df06e4c04ad53ac25013d8a78" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 41821 } } peers { permanent_uuid: "e3fc42b9680245f3b66db70446830a2f" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 39203 } }
I20260709 13:09:00.032533 28972 raft_consensus.cc:606] T eb8f9bf7e0d24af88a04bda489298395 P ee4d8c8df06e4c04ad53ac25013d8a78 [term 1 LEADER]: Received request to transfer leadership to TS e3fc42b9680245f3b66db70446830a2f
I20260709 13:09:00.033739 18300 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 13:09:00.034225 29206 ts_tablet_manager.cc:1434] T 7087f0eae49f4f71b5769071b817f8f2 P 0284f1db8c204657b7b423bab5b2eb4f: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.001s
I20260709 13:09:00.034541 18300 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:09:00.035130 29206 tablet_bootstrap.cc:492] T eb8f9bf7e0d24af88a04bda489298395 P 0284f1db8c204657b7b423bab5b2eb4f: Bootstrap starting.
I20260709 13:09:00.035333 18300 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:09:00.036505 28797 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:38618
I20260709 13:09:00.039870 29269 heartbeater.cc:499] Master 127.17.223.62:35571 was elected leader, sending a full tablet report...
I20260709 13:09:00.055588 29206 tablet_bootstrap.cc:492] T eb8f9bf7e0d24af88a04bda489298395 P 0284f1db8c204657b7b423bab5b2eb4f: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:09:00.056973 29206 tablet_bootstrap.cc:492] T eb8f9bf7e0d24af88a04bda489298395 P 0284f1db8c204657b7b423bab5b2eb4f: Bootstrap complete.
I20260709 13:09:00.057981 29206 ts_tablet_manager.cc:1403] T eb8f9bf7e0d24af88a04bda489298395 P 0284f1db8c204657b7b423bab5b2eb4f: Time spent bootstrapping tablet: real 0.023s	user 0.017s	sys 0.004s
I20260709 13:09:00.060621 29206 raft_consensus.cc:359] T eb8f9bf7e0d24af88a04bda489298395 P 0284f1db8c204657b7b423bab5b2eb4f [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0284f1db8c204657b7b423bab5b2eb4f" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 39279 } } peers { permanent_uuid: "ee4d8c8df06e4c04ad53ac25013d8a78" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 41821 } } peers { permanent_uuid: "e3fc42b9680245f3b66db70446830a2f" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 39203 } }
I20260709 13:09:00.061110 29206 raft_consensus.cc:740] T eb8f9bf7e0d24af88a04bda489298395 P 0284f1db8c204657b7b423bab5b2eb4f [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0284f1db8c204657b7b423bab5b2eb4f, State: Initialized, Role: FOLLOWER
I20260709 13:09:00.061733 29206 consensus_queue.cc:260] T eb8f9bf7e0d24af88a04bda489298395 P 0284f1db8c204657b7b423bab5b2eb4f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0284f1db8c204657b7b423bab5b2eb4f" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 39279 } } peers { permanent_uuid: "ee4d8c8df06e4c04ad53ac25013d8a78" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 41821 } } peers { permanent_uuid: "e3fc42b9680245f3b66db70446830a2f" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 39203 } }
I20260709 13:09:00.063149 29206 ts_tablet_manager.cc:1434] T eb8f9bf7e0d24af88a04bda489298395 P 0284f1db8c204657b7b423bab5b2eb4f: Time spent starting tablet: real 0.005s	user 0.005s	sys 0.000s
I20260709 13:09:00.063797 29206 tablet_bootstrap.cc:492] T 2b38eb974fe54bb6a799876978d3ba4c P 0284f1db8c204657b7b423bab5b2eb4f: Bootstrap starting.
I20260709 13:09:00.074918 29206 tablet_bootstrap.cc:492] T 2b38eb974fe54bb6a799876978d3ba4c P 0284f1db8c204657b7b423bab5b2eb4f: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:09:00.075672 29206 tablet_bootstrap.cc:492] T 2b38eb974fe54bb6a799876978d3ba4c P 0284f1db8c204657b7b423bab5b2eb4f: Bootstrap complete.
I20260709 13:09:00.076285 29206 ts_tablet_manager.cc:1403] T 2b38eb974fe54bb6a799876978d3ba4c P 0284f1db8c204657b7b423bab5b2eb4f: Time spent bootstrapping tablet: real 0.013s	user 0.011s	sys 0.000s
I20260709 13:09:00.078037 29206 raft_consensus.cc:359] T 2b38eb974fe54bb6a799876978d3ba4c P 0284f1db8c204657b7b423bab5b2eb4f [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee4d8c8df06e4c04ad53ac25013d8a78" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 41821 } } peers { permanent_uuid: "e3fc42b9680245f3b66db70446830a2f" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 39203 } } peers { permanent_uuid: "0284f1db8c204657b7b423bab5b2eb4f" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 39279 } }
I20260709 13:09:00.078554 29206 raft_consensus.cc:740] T 2b38eb974fe54bb6a799876978d3ba4c P 0284f1db8c204657b7b423bab5b2eb4f [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0284f1db8c204657b7b423bab5b2eb4f, State: Initialized, Role: FOLLOWER
I20260709 13:09:00.079125 29206 consensus_queue.cc:260] T 2b38eb974fe54bb6a799876978d3ba4c P 0284f1db8c204657b7b423bab5b2eb4f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee4d8c8df06e4c04ad53ac25013d8a78" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 41821 } } peers { permanent_uuid: "e3fc42b9680245f3b66db70446830a2f" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 39203 } } peers { permanent_uuid: "0284f1db8c204657b7b423bab5b2eb4f" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 39279 } }
I20260709 13:09:00.080569 29206 ts_tablet_manager.cc:1434] T 2b38eb974fe54bb6a799876978d3ba4c P 0284f1db8c204657b7b423bab5b2eb4f: Time spent starting tablet: real 0.004s	user 0.004s	sys 0.000s
I20260709 13:09:00.081380 29206 tablet_bootstrap.cc:492] T 451e3f8929ef4287a9eaa8941486e9cc P 0284f1db8c204657b7b423bab5b2eb4f: Bootstrap starting.
I20260709 13:09:00.092358 29206 tablet_bootstrap.cc:492] T 451e3f8929ef4287a9eaa8941486e9cc P 0284f1db8c204657b7b423bab5b2eb4f: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=0 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 1 replicates
I20260709 13:09:00.093192 29206 tablet_bootstrap.cc:492] T 451e3f8929ef4287a9eaa8941486e9cc P 0284f1db8c204657b7b423bab5b2eb4f: Bootstrap complete.
I20260709 13:09:00.093808 29206 ts_tablet_manager.cc:1403] T 451e3f8929ef4287a9eaa8941486e9cc P 0284f1db8c204657b7b423bab5b2eb4f: Time spent bootstrapping tablet: real 0.013s	user 0.009s	sys 0.000s
I20260709 13:09:00.095594 29206 raft_consensus.cc:359] T 451e3f8929ef4287a9eaa8941486e9cc P 0284f1db8c204657b7b423bab5b2eb4f [term 1 FOLLOWER]: Replica starting. Triggering 1 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0284f1db8c204657b7b423bab5b2eb4f" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 39279 } } peers { permanent_uuid: "ee4d8c8df06e4c04ad53ac25013d8a78" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 41821 } } peers { permanent_uuid: "e3fc42b9680245f3b66db70446830a2f" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 39203 } }
I20260709 13:09:00.096236 29206 raft_consensus.cc:740] T 451e3f8929ef4287a9eaa8941486e9cc P 0284f1db8c204657b7b423bab5b2eb4f [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0284f1db8c204657b7b423bab5b2eb4f, State: Initialized, Role: FOLLOWER
I20260709 13:09:00.096779 29206 consensus_queue.cc:260] T 451e3f8929ef4287a9eaa8941486e9cc P 0284f1db8c204657b7b423bab5b2eb4f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0284f1db8c204657b7b423bab5b2eb4f" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 39279 } } peers { permanent_uuid: "ee4d8c8df06e4c04ad53ac25013d8a78" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 41821 } } peers { permanent_uuid: "e3fc42b9680245f3b66db70446830a2f" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 39203 } }
I20260709 13:09:00.098583 29206 ts_tablet_manager.cc:1434] T 451e3f8929ef4287a9eaa8941486e9cc P 0284f1db8c204657b7b423bab5b2eb4f: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 13:09:00.127964 29242 raft_consensus.cc:3060] T 451e3f8929ef4287a9eaa8941486e9cc P 0284f1db8c204657b7b423bab5b2eb4f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:00.133229 29242 pending_rounds.cc:85] T 451e3f8929ef4287a9eaa8941486e9cc P 0284f1db8c204657b7b423bab5b2eb4f: Aborting all ops after (but not including) 0
I20260709 13:09:00.133507 29242 pending_rounds.cc:107] T 451e3f8929ef4287a9eaa8941486e9cc P 0284f1db8c204657b7b423bab5b2eb4f: Aborting uncommitted NO_OP operation due to leader change: 1.1
I20260709 13:09:00.133775 29242 raft_consensus.cc:2889] T 451e3f8929ef4287a9eaa8941486e9cc P 0284f1db8c204657b7b423bab5b2eb4f [term 2 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:09:00.173964 29242 raft_consensus.cc:3060] T 0dfbae90dbc4407a9e01872b7d688d55 P 0284f1db8c204657b7b423bab5b2eb4f [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:00.180589 29190 consensus_queue.cc:1050] T 0dfbae90dbc4407a9e01872b7d688d55 P ee4d8c8df06e4c04ad53ac25013d8a78 [LEADER]: Got LMP mismatch error from peer: Peer: permanent_uuid: "0284f1db8c204657b7b423bab5b2eb4f" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 39279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:00.209496 29285 raft_consensus.cc:993] T 777f2e0112c34108b367c8a2ad2641e1 P ee4d8c8df06e4c04ad53ac25013d8a78: : Instructing follower e3fc42b9680245f3b66db70446830a2f to start an election
I20260709 13:09:00.210115 29285 raft_consensus.cc:1081] T 777f2e0112c34108b367c8a2ad2641e1 P ee4d8c8df06e4c04ad53ac25013d8a78 [term 1 LEADER]: Signalling peer e3fc42b9680245f3b66db70446830a2f to start an election
I20260709 13:09:00.211859 29048 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "777f2e0112c34108b367c8a2ad2641e1"
dest_uuid: "e3fc42b9680245f3b66db70446830a2f"
 from {username='slave'} at 127.0.0.1:38528
I20260709 13:09:00.212417 29048 raft_consensus.cc:493] T 777f2e0112c34108b367c8a2ad2641e1 P e3fc42b9680245f3b66db70446830a2f [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:09:00.212759 29048 raft_consensus.cc:3060] T 777f2e0112c34108b367c8a2ad2641e1 P e3fc42b9680245f3b66db70446830a2f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:00.219280 29048 raft_consensus.cc:515] T 777f2e0112c34108b367c8a2ad2641e1 P e3fc42b9680245f3b66db70446830a2f [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0284f1db8c204657b7b423bab5b2eb4f" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 39279 } } peers { permanent_uuid: "ee4d8c8df06e4c04ad53ac25013d8a78" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 41821 } } peers { permanent_uuid: "e3fc42b9680245f3b66db70446830a2f" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 39203 } }
I20260709 13:09:00.220952 29048 leader_election.cc:290] T 777f2e0112c34108b367c8a2ad2641e1 P e3fc42b9680245f3b66db70446830a2f [CANDIDATE]: Term 2 election: Requested vote from peers 0284f1db8c204657b7b423bab5b2eb4f (127.17.223.1:39279), ee4d8c8df06e4c04ad53ac25013d8a78 (127.17.223.2:41821)
I20260709 13:09:00.221810 29242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "777f2e0112c34108b367c8a2ad2641e1" candidate_uuid: "e3fc42b9680245f3b66db70446830a2f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0284f1db8c204657b7b423bab5b2eb4f"
I20260709 13:09:00.222052 28972 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "777f2e0112c34108b367c8a2ad2641e1" candidate_uuid: "e3fc42b9680245f3b66db70446830a2f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ee4d8c8df06e4c04ad53ac25013d8a78"
I20260709 13:09:00.222499 29242 raft_consensus.cc:3060] T 777f2e0112c34108b367c8a2ad2641e1 P 0284f1db8c204657b7b423bab5b2eb4f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:00.222735 28972 raft_consensus.cc:3055] T 777f2e0112c34108b367c8a2ad2641e1 P ee4d8c8df06e4c04ad53ac25013d8a78 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:09:00.223129 28972 raft_consensus.cc:740] T 777f2e0112c34108b367c8a2ad2641e1 P ee4d8c8df06e4c04ad53ac25013d8a78 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ee4d8c8df06e4c04ad53ac25013d8a78, State: Running, Role: LEADER
I20260709 13:09:00.223872 28972 consensus_queue.cc:260] T 777f2e0112c34108b367c8a2ad2641e1 P ee4d8c8df06e4c04ad53ac25013d8a78 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0284f1db8c204657b7b423bab5b2eb4f" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 39279 } } peers { permanent_uuid: "ee4d8c8df06e4c04ad53ac25013d8a78" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 41821 } } peers { permanent_uuid: "e3fc42b9680245f3b66db70446830a2f" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 39203 } }
I20260709 13:09:00.224871 28972 raft_consensus.cc:3060] T 777f2e0112c34108b367c8a2ad2641e1 P ee4d8c8df06e4c04ad53ac25013d8a78 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:00.228256 29242 raft_consensus.cc:2468] T 777f2e0112c34108b367c8a2ad2641e1 P 0284f1db8c204657b7b423bab5b2eb4f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3fc42b9680245f3b66db70446830a2f in term 2.
I20260709 13:09:00.229460 29012 leader_election.cc:304] T 777f2e0112c34108b367c8a2ad2641e1 P e3fc42b9680245f3b66db70446830a2f [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0284f1db8c204657b7b423bab5b2eb4f, e3fc42b9680245f3b66db70446830a2f; no voters: 
I20260709 13:09:00.230203 29172 raft_consensus.cc:2804] T 777f2e0112c34108b367c8a2ad2641e1 P e3fc42b9680245f3b66db70446830a2f [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:09:00.230353 28972 raft_consensus.cc:2468] T 777f2e0112c34108b367c8a2ad2641e1 P ee4d8c8df06e4c04ad53ac25013d8a78 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3fc42b9680245f3b66db70446830a2f in term 2.
I20260709 13:09:00.231390 29172 raft_consensus.cc:697] T 777f2e0112c34108b367c8a2ad2641e1 P e3fc42b9680245f3b66db70446830a2f [term 2 LEADER]: Becoming Leader. State: Replica: e3fc42b9680245f3b66db70446830a2f, State: Running, Role: LEADER
I20260709 13:09:00.232339 29172 consensus_queue.cc:237] T 777f2e0112c34108b367c8a2ad2641e1 P e3fc42b9680245f3b66db70446830a2f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0284f1db8c204657b7b423bab5b2eb4f" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 39279 } } peers { permanent_uuid: "ee4d8c8df06e4c04ad53ac25013d8a78" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 41821 } } peers { permanent_uuid: "e3fc42b9680245f3b66db70446830a2f" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 39203 } }
I20260709 13:09:00.239591 28795 catalog_manager.cc:5697] T 777f2e0112c34108b367c8a2ad2641e1 P e3fc42b9680245f3b66db70446830a2f reported cstate change: term changed from 1 to 2, leader changed from ee4d8c8df06e4c04ad53ac25013d8a78 (127.17.223.2) to e3fc42b9680245f3b66db70446830a2f (127.17.223.3). New cstate: current_term: 2 leader_uuid: "e3fc42b9680245f3b66db70446830a2f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0284f1db8c204657b7b423bab5b2eb4f" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 39279 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ee4d8c8df06e4c04ad53ac25013d8a78" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 41821 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e3fc42b9680245f3b66db70446830a2f" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 39203 } health_report { overall_health: HEALTHY } } }
I20260709 13:09:00.296149 29242 raft_consensus.cc:3060] T 7087f0eae49f4f71b5769071b817f8f2 P 0284f1db8c204657b7b423bab5b2eb4f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:00.301262 29242 pending_rounds.cc:85] T 7087f0eae49f4f71b5769071b817f8f2 P 0284f1db8c204657b7b423bab5b2eb4f: Aborting all ops after (but not including) 0
I20260709 13:09:00.301483 29242 pending_rounds.cc:107] T 7087f0eae49f4f71b5769071b817f8f2 P 0284f1db8c204657b7b423bab5b2eb4f: Aborting uncommitted NO_OP operation due to leader change: 1.1
I20260709 13:09:00.301666 29242 raft_consensus.cc:2889] T 7087f0eae49f4f71b5769071b817f8f2 P 0284f1db8c204657b7b423bab5b2eb4f [term 2 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:09:00.347324 29286 raft_consensus.cc:993] T eb8f9bf7e0d24af88a04bda489298395 P ee4d8c8df06e4c04ad53ac25013d8a78: : Instructing follower e3fc42b9680245f3b66db70446830a2f to start an election
I20260709 13:09:00.347800 29285 raft_consensus.cc:1081] T eb8f9bf7e0d24af88a04bda489298395 P ee4d8c8df06e4c04ad53ac25013d8a78 [term 1 LEADER]: Signalling peer e3fc42b9680245f3b66db70446830a2f to start an election
I20260709 13:09:00.349280 29048 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "eb8f9bf7e0d24af88a04bda489298395"
dest_uuid: "e3fc42b9680245f3b66db70446830a2f"
 from {username='slave'} at 127.0.0.1:38528
I20260709 13:09:00.349844 29048 raft_consensus.cc:493] T eb8f9bf7e0d24af88a04bda489298395 P e3fc42b9680245f3b66db70446830a2f [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:09:00.350172 29048 raft_consensus.cc:3060] T eb8f9bf7e0d24af88a04bda489298395 P e3fc42b9680245f3b66db70446830a2f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:00.354866 29048 raft_consensus.cc:515] T eb8f9bf7e0d24af88a04bda489298395 P e3fc42b9680245f3b66db70446830a2f [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0284f1db8c204657b7b423bab5b2eb4f" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 39279 } } peers { permanent_uuid: "ee4d8c8df06e4c04ad53ac25013d8a78" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 41821 } } peers { permanent_uuid: "e3fc42b9680245f3b66db70446830a2f" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 39203 } }
I20260709 13:09:00.356501 29048 leader_election.cc:290] T eb8f9bf7e0d24af88a04bda489298395 P e3fc42b9680245f3b66db70446830a2f [CANDIDATE]: Term 2 election: Requested vote from peers 0284f1db8c204657b7b423bab5b2eb4f (127.17.223.1:39279), ee4d8c8df06e4c04ad53ac25013d8a78 (127.17.223.2:41821)
I20260709 13:09:00.357527 29242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb8f9bf7e0d24af88a04bda489298395" candidate_uuid: "e3fc42b9680245f3b66db70446830a2f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0284f1db8c204657b7b423bab5b2eb4f"
I20260709 13:09:00.357627 28972 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb8f9bf7e0d24af88a04bda489298395" candidate_uuid: "e3fc42b9680245f3b66db70446830a2f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ee4d8c8df06e4c04ad53ac25013d8a78"
I20260709 13:09:00.358142 29242 raft_consensus.cc:3060] T eb8f9bf7e0d24af88a04bda489298395 P 0284f1db8c204657b7b423bab5b2eb4f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:00.358263 28972 raft_consensus.cc:3055] T eb8f9bf7e0d24af88a04bda489298395 P ee4d8c8df06e4c04ad53ac25013d8a78 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:09:00.358697 28972 raft_consensus.cc:740] T eb8f9bf7e0d24af88a04bda489298395 P ee4d8c8df06e4c04ad53ac25013d8a78 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ee4d8c8df06e4c04ad53ac25013d8a78, State: Running, Role: LEADER
I20260709 13:09:00.359530 28972 consensus_queue.cc:260] T eb8f9bf7e0d24af88a04bda489298395 P ee4d8c8df06e4c04ad53ac25013d8a78 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0284f1db8c204657b7b423bab5b2eb4f" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 39279 } } peers { permanent_uuid: "ee4d8c8df06e4c04ad53ac25013d8a78" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 41821 } } peers { permanent_uuid: "e3fc42b9680245f3b66db70446830a2f" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 39203 } }
I20260709 13:09:00.360783 28972 raft_consensus.cc:3060] T eb8f9bf7e0d24af88a04bda489298395 P ee4d8c8df06e4c04ad53ac25013d8a78 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:00.365020 29242 raft_consensus.cc:2468] T eb8f9bf7e0d24af88a04bda489298395 P 0284f1db8c204657b7b423bab5b2eb4f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3fc42b9680245f3b66db70446830a2f in term 2.
I20260709 13:09:00.366492 29012 leader_election.cc:304] T eb8f9bf7e0d24af88a04bda489298395 P e3fc42b9680245f3b66db70446830a2f [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0284f1db8c204657b7b423bab5b2eb4f, e3fc42b9680245f3b66db70446830a2f; no voters: 
I20260709 13:09:00.367475 29172 raft_consensus.cc:2804] T eb8f9bf7e0d24af88a04bda489298395 P e3fc42b9680245f3b66db70446830a2f [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:09:00.367962 29172 raft_consensus.cc:697] T eb8f9bf7e0d24af88a04bda489298395 P e3fc42b9680245f3b66db70446830a2f [term 2 LEADER]: Becoming Leader. State: Replica: e3fc42b9680245f3b66db70446830a2f, State: Running, Role: LEADER
I20260709 13:09:00.368914 29172 consensus_queue.cc:237] T eb8f9bf7e0d24af88a04bda489298395 P e3fc42b9680245f3b66db70446830a2f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0284f1db8c204657b7b423bab5b2eb4f" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 39279 } } peers { permanent_uuid: "ee4d8c8df06e4c04ad53ac25013d8a78" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 41821 } } peers { permanent_uuid: "e3fc42b9680245f3b66db70446830a2f" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 39203 } }
I20260709 13:09:00.367951 28972 raft_consensus.cc:2468] T eb8f9bf7e0d24af88a04bda489298395 P ee4d8c8df06e4c04ad53ac25013d8a78 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3fc42b9680245f3b66db70446830a2f in term 2.
I20260709 13:09:00.376775 28795 catalog_manager.cc:5697] T eb8f9bf7e0d24af88a04bda489298395 P e3fc42b9680245f3b66db70446830a2f reported cstate change: term changed from 1 to 2, leader changed from ee4d8c8df06e4c04ad53ac25013d8a78 (127.17.223.2) to e3fc42b9680245f3b66db70446830a2f (127.17.223.3). New cstate: current_term: 2 leader_uuid: "e3fc42b9680245f3b66db70446830a2f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0284f1db8c204657b7b423bab5b2eb4f" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 39279 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ee4d8c8df06e4c04ad53ac25013d8a78" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 41821 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e3fc42b9680245f3b66db70446830a2f" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 39203 } health_report { overall_health: HEALTHY } } }
I20260709 13:09:00.472633 29286 raft_consensus.cc:993] T 879bbeb7e3244e8a8e5ee375c020cb16 P ee4d8c8df06e4c04ad53ac25013d8a78: : Instructing follower e3fc42b9680245f3b66db70446830a2f to start an election
I20260709 13:09:00.473047 29285 raft_consensus.cc:1081] T 879bbeb7e3244e8a8e5ee375c020cb16 P ee4d8c8df06e4c04ad53ac25013d8a78 [term 1 LEADER]: Signalling peer e3fc42b9680245f3b66db70446830a2f to start an election
I20260709 13:09:00.474490 29048 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "879bbeb7e3244e8a8e5ee375c020cb16"
dest_uuid: "e3fc42b9680245f3b66db70446830a2f"
 from {username='slave'} at 127.0.0.1:38528
I20260709 13:09:00.475049 29048 raft_consensus.cc:493] T 879bbeb7e3244e8a8e5ee375c020cb16 P e3fc42b9680245f3b66db70446830a2f [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:09:00.475347 29048 raft_consensus.cc:3060] T 879bbeb7e3244e8a8e5ee375c020cb16 P e3fc42b9680245f3b66db70446830a2f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:00.479802 29048 raft_consensus.cc:515] T 879bbeb7e3244e8a8e5ee375c020cb16 P e3fc42b9680245f3b66db70446830a2f [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0284f1db8c204657b7b423bab5b2eb4f" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 39279 } } peers { permanent_uuid: "ee4d8c8df06e4c04ad53ac25013d8a78" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 41821 } } peers { permanent_uuid: "e3fc42b9680245f3b66db70446830a2f" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 39203 } }
I20260709 13:09:00.481508 29048 leader_election.cc:290] T 879bbeb7e3244e8a8e5ee375c020cb16 P e3fc42b9680245f3b66db70446830a2f [CANDIDATE]: Term 2 election: Requested vote from peers 0284f1db8c204657b7b423bab5b2eb4f (127.17.223.1:39279), ee4d8c8df06e4c04ad53ac25013d8a78 (127.17.223.2:41821)
I20260709 13:09:00.482398 29242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "879bbeb7e3244e8a8e5ee375c020cb16" candidate_uuid: "e3fc42b9680245f3b66db70446830a2f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0284f1db8c204657b7b423bab5b2eb4f"
I20260709 13:09:00.482614 28972 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "879bbeb7e3244e8a8e5ee375c020cb16" candidate_uuid: "e3fc42b9680245f3b66db70446830a2f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ee4d8c8df06e4c04ad53ac25013d8a78"
I20260709 13:09:00.483110 29242 raft_consensus.cc:3060] T 879bbeb7e3244e8a8e5ee375c020cb16 P 0284f1db8c204657b7b423bab5b2eb4f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:00.483174 28972 raft_consensus.cc:3055] T 879bbeb7e3244e8a8e5ee375c020cb16 P ee4d8c8df06e4c04ad53ac25013d8a78 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:09:00.483603 28972 raft_consensus.cc:740] T 879bbeb7e3244e8a8e5ee375c020cb16 P ee4d8c8df06e4c04ad53ac25013d8a78 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ee4d8c8df06e4c04ad53ac25013d8a78, State: Running, Role: LEADER
I20260709 13:09:00.484453 28972 consensus_queue.cc:260] T 879bbeb7e3244e8a8e5ee375c020cb16 P ee4d8c8df06e4c04ad53ac25013d8a78 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0284f1db8c204657b7b423bab5b2eb4f" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 39279 } } peers { permanent_uuid: "ee4d8c8df06e4c04ad53ac25013d8a78" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 41821 } } peers { permanent_uuid: "e3fc42b9680245f3b66db70446830a2f" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 39203 } }
I20260709 13:09:00.485725 28972 raft_consensus.cc:3060] T 879bbeb7e3244e8a8e5ee375c020cb16 P ee4d8c8df06e4c04ad53ac25013d8a78 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:00.490590 29242 raft_consensus.cc:2468] T 879bbeb7e3244e8a8e5ee375c020cb16 P 0284f1db8c204657b7b423bab5b2eb4f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3fc42b9680245f3b66db70446830a2f in term 2.
I20260709 13:09:00.492005 29012 leader_election.cc:304] T 879bbeb7e3244e8a8e5ee375c020cb16 P e3fc42b9680245f3b66db70446830a2f [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0284f1db8c204657b7b423bab5b2eb4f, e3fc42b9680245f3b66db70446830a2f; no voters: 
I20260709 13:09:00.492906 29172 raft_consensus.cc:2804] T 879bbeb7e3244e8a8e5ee375c020cb16 P e3fc42b9680245f3b66db70446830a2f [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:09:00.493076 28972 raft_consensus.cc:2468] T 879bbeb7e3244e8a8e5ee375c020cb16 P ee4d8c8df06e4c04ad53ac25013d8a78 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3fc42b9680245f3b66db70446830a2f in term 2.
I20260709 13:09:00.494146 29172 raft_consensus.cc:697] T 879bbeb7e3244e8a8e5ee375c020cb16 P e3fc42b9680245f3b66db70446830a2f [term 2 LEADER]: Becoming Leader. State: Replica: e3fc42b9680245f3b66db70446830a2f, State: Running, Role: LEADER
I20260709 13:09:00.495132 29172 consensus_queue.cc:237] T 879bbeb7e3244e8a8e5ee375c020cb16 P e3fc42b9680245f3b66db70446830a2f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0284f1db8c204657b7b423bab5b2eb4f" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 39279 } } peers { permanent_uuid: "ee4d8c8df06e4c04ad53ac25013d8a78" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 41821 } } peers { permanent_uuid: "e3fc42b9680245f3b66db70446830a2f" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 39203 } }
I20260709 13:09:00.547537 29242 raft_consensus.cc:3060] T 5d6b9266d4e74616b08d4e9697a83924 P 0284f1db8c204657b7b423bab5b2eb4f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:00.561471 28795 catalog_manager.cc:5697] T 879bbeb7e3244e8a8e5ee375c020cb16 P e3fc42b9680245f3b66db70446830a2f reported cstate change: term changed from 1 to 2, leader changed from ee4d8c8df06e4c04ad53ac25013d8a78 (127.17.223.2) to e3fc42b9680245f3b66db70446830a2f (127.17.223.3). New cstate: current_term: 2 leader_uuid: "e3fc42b9680245f3b66db70446830a2f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0284f1db8c204657b7b423bab5b2eb4f" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 39279 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ee4d8c8df06e4c04ad53ac25013d8a78" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 41821 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e3fc42b9680245f3b66db70446830a2f" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 39203 } health_report { overall_health: HEALTHY } } }
I20260709 13:09:00.566972 29242 pending_rounds.cc:85] T 5d6b9266d4e74616b08d4e9697a83924 P 0284f1db8c204657b7b423bab5b2eb4f: Aborting all ops after (but not including) 0
I20260709 13:09:00.567389 29242 pending_rounds.cc:107] T 5d6b9266d4e74616b08d4e9697a83924 P 0284f1db8c204657b7b423bab5b2eb4f: Aborting uncommitted NO_OP operation due to leader change: 1.1
I20260709 13:09:00.567754 29242 raft_consensus.cc:2889] T 5d6b9266d4e74616b08d4e9697a83924 P 0284f1db8c204657b7b423bab5b2eb4f [term 2 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:09:00.616750 29242 raft_consensus.cc:1275] T 777f2e0112c34108b367c8a2ad2641e1 P 0284f1db8c204657b7b423bab5b2eb4f [term 2 FOLLOWER]: Refusing update from remote peer e3fc42b9680245f3b66db70446830a2f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:00.618181 29172 consensus_queue.cc:1048] T 777f2e0112c34108b367c8a2ad2641e1 P e3fc42b9680245f3b66db70446830a2f [LEADER]: Connected to new peer: Peer: permanent_uuid: "0284f1db8c204657b7b423bab5b2eb4f" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 39279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:09:00.631187 28972 raft_consensus.cc:1275] T 777f2e0112c34108b367c8a2ad2641e1 P ee4d8c8df06e4c04ad53ac25013d8a78 [term 2 FOLLOWER]: Refusing update from remote peer e3fc42b9680245f3b66db70446830a2f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:00.633193 29172 consensus_queue.cc:1048] T 777f2e0112c34108b367c8a2ad2641e1 P e3fc42b9680245f3b66db70446830a2f [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee4d8c8df06e4c04ad53ac25013d8a78" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 41821 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:09:00.770902 29242 raft_consensus.cc:1275] T eb8f9bf7e0d24af88a04bda489298395 P 0284f1db8c204657b7b423bab5b2eb4f [term 2 FOLLOWER]: Refusing update from remote peer e3fc42b9680245f3b66db70446830a2f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:00.772432 29301 consensus_queue.cc:1048] T eb8f9bf7e0d24af88a04bda489298395 P e3fc42b9680245f3b66db70446830a2f [LEADER]: Connected to new peer: Peer: permanent_uuid: "0284f1db8c204657b7b423bab5b2eb4f" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 39279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:09:00.783171 28972 raft_consensus.cc:1275] T eb8f9bf7e0d24af88a04bda489298395 P ee4d8c8df06e4c04ad53ac25013d8a78 [term 2 FOLLOWER]: Refusing update from remote peer e3fc42b9680245f3b66db70446830a2f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:00.784965 29172 consensus_queue.cc:1048] T eb8f9bf7e0d24af88a04bda489298395 P e3fc42b9680245f3b66db70446830a2f [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee4d8c8df06e4c04ad53ac25013d8a78" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 41821 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:09:00.825439 28845 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 13:09:01.017473 29242 raft_consensus.cc:1275] T 879bbeb7e3244e8a8e5ee375c020cb16 P 0284f1db8c204657b7b423bab5b2eb4f [term 2 FOLLOWER]: Refusing update from remote peer e3fc42b9680245f3b66db70446830a2f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:01.019105 29172 consensus_queue.cc:1048] T 879bbeb7e3244e8a8e5ee375c020cb16 P e3fc42b9680245f3b66db70446830a2f [LEADER]: Connected to new peer: Peer: permanent_uuid: "0284f1db8c204657b7b423bab5b2eb4f" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 39279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:09:01.030664 28972 raft_consensus.cc:1275] T 879bbeb7e3244e8a8e5ee375c020cb16 P ee4d8c8df06e4c04ad53ac25013d8a78 [term 2 FOLLOWER]: Refusing update from remote peer e3fc42b9680245f3b66db70446830a2f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:01.032372 29307 consensus_queue.cc:1048] T 879bbeb7e3244e8a8e5ee375c020cb16 P e3fc42b9680245f3b66db70446830a2f [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee4d8c8df06e4c04ad53ac25013d8a78" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 41821 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:09:01.048522 18300 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:09:01.056892 28972 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7087f0eae49f4f71b5769071b817f8f2"
dest_uuid: "ee4d8c8df06e4c04ad53ac25013d8a78"
mode: GRACEFUL
new_leader_uuid: "e3fc42b9680245f3b66db70446830a2f"
 from {username='slave'} at 127.0.0.1:60718
I20260709 13:09:01.057564 28972 raft_consensus.cc:606] T 7087f0eae49f4f71b5769071b817f8f2 P ee4d8c8df06e4c04ad53ac25013d8a78 [term 2 LEADER]: Received request to transfer leadership to TS e3fc42b9680245f3b66db70446830a2f
I20260709 13:09:01.076570 29048 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "777f2e0112c34108b367c8a2ad2641e1"
dest_uuid: "e3fc42b9680245f3b66db70446830a2f"
mode: GRACEFUL
new_leader_uuid: "ee4d8c8df06e4c04ad53ac25013d8a78"
 from {username='slave'} at 127.0.0.1:38536
I20260709 13:09:01.077036 29048 raft_consensus.cc:606] T 777f2e0112c34108b367c8a2ad2641e1 P e3fc42b9680245f3b66db70446830a2f [term 2 LEADER]: Received request to transfer leadership to TS ee4d8c8df06e4c04ad53ac25013d8a78
I20260709 13:09:01.079466 29048 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "eb8f9bf7e0d24af88a04bda489298395"
dest_uuid: "e3fc42b9680245f3b66db70446830a2f"
mode: GRACEFUL
new_leader_uuid: "ee4d8c8df06e4c04ad53ac25013d8a78"
 from {username='slave'} at 127.0.0.1:38536
I20260709 13:09:01.079946 29048 raft_consensus.cc:606] T eb8f9bf7e0d24af88a04bda489298395 P e3fc42b9680245f3b66db70446830a2f [term 2 LEADER]: Received request to transfer leadership to TS ee4d8c8df06e4c04ad53ac25013d8a78
I20260709 13:09:01.080961 18300 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 13:09:01.081471 18300 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:09:01.082188 18300 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:09:01.103713 29301 raft_consensus.cc:993] T 777f2e0112c34108b367c8a2ad2641e1 P e3fc42b9680245f3b66db70446830a2f: : Instructing follower ee4d8c8df06e4c04ad53ac25013d8a78 to start an election
I20260709 13:09:01.104292 29301 raft_consensus.cc:1081] T 777f2e0112c34108b367c8a2ad2641e1 P e3fc42b9680245f3b66db70446830a2f [term 2 LEADER]: Signalling peer ee4d8c8df06e4c04ad53ac25013d8a78 to start an election
I20260709 13:09:01.105785 28972 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "777f2e0112c34108b367c8a2ad2641e1"
dest_uuid: "ee4d8c8df06e4c04ad53ac25013d8a78"
 from {username='slave'} at 127.0.0.1:60700
I20260709 13:09:01.106458 28972 raft_consensus.cc:493] T 777f2e0112c34108b367c8a2ad2641e1 P ee4d8c8df06e4c04ad53ac25013d8a78 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:09:01.106837 28972 raft_consensus.cc:3060] T 777f2e0112c34108b367c8a2ad2641e1 P ee4d8c8df06e4c04ad53ac25013d8a78 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:01.114104 28972 raft_consensus.cc:515] T 777f2e0112c34108b367c8a2ad2641e1 P ee4d8c8df06e4c04ad53ac25013d8a78 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0284f1db8c204657b7b423bab5b2eb4f" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 39279 } } peers { permanent_uuid: "ee4d8c8df06e4c04ad53ac25013d8a78" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 41821 } } peers { permanent_uuid: "e3fc42b9680245f3b66db70446830a2f" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 39203 } }
I20260709 13:09:01.115875 28972 leader_election.cc:290] T 777f2e0112c34108b367c8a2ad2641e1 P ee4d8c8df06e4c04ad53ac25013d8a78 [CANDIDATE]: Term 3 election: Requested vote from peers 0284f1db8c204657b7b423bab5b2eb4f (127.17.223.1:39279), e3fc42b9680245f3b66db70446830a2f (127.17.223.3:39203)
I20260709 13:09:01.116881 29242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "777f2e0112c34108b367c8a2ad2641e1" candidate_uuid: "ee4d8c8df06e4c04ad53ac25013d8a78" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "0284f1db8c204657b7b423bab5b2eb4f"
I20260709 13:09:01.117055 29048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "777f2e0112c34108b367c8a2ad2641e1" candidate_uuid: "ee4d8c8df06e4c04ad53ac25013d8a78" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "e3fc42b9680245f3b66db70446830a2f"
I20260709 13:09:01.117586 29242 raft_consensus.cc:3060] T 777f2e0112c34108b367c8a2ad2641e1 P 0284f1db8c204657b7b423bab5b2eb4f [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:01.117630 29048 raft_consensus.cc:3055] T 777f2e0112c34108b367c8a2ad2641e1 P e3fc42b9680245f3b66db70446830a2f [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:09:01.118036 29048 raft_consensus.cc:740] T 777f2e0112c34108b367c8a2ad2641e1 P e3fc42b9680245f3b66db70446830a2f [term 2 LEADER]: Becoming Follower/Learner. State: Replica: e3fc42b9680245f3b66db70446830a2f, State: Running, Role: LEADER
I20260709 13:09:01.118839 29048 consensus_queue.cc:260] T 777f2e0112c34108b367c8a2ad2641e1 P e3fc42b9680245f3b66db70446830a2f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0284f1db8c204657b7b423bab5b2eb4f" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 39279 } } peers { permanent_uuid: "ee4d8c8df06e4c04ad53ac25013d8a78" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 41821 } } peers { permanent_uuid: "e3fc42b9680245f3b66db70446830a2f" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 39203 } }
I20260709 13:09:01.119796 29048 raft_consensus.cc:3060] T 777f2e0112c34108b367c8a2ad2641e1 P e3fc42b9680245f3b66db70446830a2f [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:01.123405 29242 raft_consensus.cc:2468] T 777f2e0112c34108b367c8a2ad2641e1 P 0284f1db8c204657b7b423bab5b2eb4f [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee4d8c8df06e4c04ad53ac25013d8a78 in term 3.
I20260709 13:09:01.124756 28938 leader_election.cc:304] T 777f2e0112c34108b367c8a2ad2641e1 P ee4d8c8df06e4c04ad53ac25013d8a78 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0284f1db8c204657b7b423bab5b2eb4f, ee4d8c8df06e4c04ad53ac25013d8a78; no voters: 
I20260709 13:09:01.125610 29190 raft_consensus.cc:2804] T 777f2e0112c34108b367c8a2ad2641e1 P ee4d8c8df06e4c04ad53ac25013d8a78 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:09:01.126032 29190 raft_consensus.cc:697] T 777f2e0112c34108b367c8a2ad2641e1 P ee4d8c8df06e4c04ad53ac25013d8a78 [term 3 LEADER]: Becoming Leader. State: Replica: ee4d8c8df06e4c04ad53ac25013d8a78, State: Running, Role: LEADER
I20260709 13:09:01.126305 29048 raft_consensus.cc:2468] T 777f2e0112c34108b367c8a2ad2641e1 P e3fc42b9680245f3b66db70446830a2f [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee4d8c8df06e4c04ad53ac25013d8a78 in term 3.
I20260709 13:09:01.127043 29190 consensus_queue.cc:237] T 777f2e0112c34108b367c8a2ad2641e1 P ee4d8c8df06e4c04ad53ac25013d8a78 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0284f1db8c204657b7b423bab5b2eb4f" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 39279 } } peers { permanent_uuid: "ee4d8c8df06e4c04ad53ac25013d8a78" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 41821 } } peers { permanent_uuid: "e3fc42b9680245f3b66db70446830a2f" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 39203 } }
I20260709 13:09:01.133564 28797 catalog_manager.cc:5697] T 777f2e0112c34108b367c8a2ad2641e1 P ee4d8c8df06e4c04ad53ac25013d8a78 reported cstate change: term changed from 2 to 3, leader changed from e3fc42b9680245f3b66db70446830a2f (127.17.223.3) to ee4d8c8df06e4c04ad53ac25013d8a78 (127.17.223.2). New cstate: current_term: 3 leader_uuid: "ee4d8c8df06e4c04ad53ac25013d8a78" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0284f1db8c204657b7b423bab5b2eb4f" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 39279 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ee4d8c8df06e4c04ad53ac25013d8a78" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 41821 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e3fc42b9680245f3b66db70446830a2f" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 39203 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:01.311805 29307 raft_consensus.cc:993] T eb8f9bf7e0d24af88a04bda489298395 P e3fc42b9680245f3b66db70446830a2f: : Instructing follower ee4d8c8df06e4c04ad53ac25013d8a78 to start an election
I20260709 13:09:01.312284 29172 raft_consensus.cc:1081] T eb8f9bf7e0d24af88a04bda489298395 P e3fc42b9680245f3b66db70446830a2f [term 2 LEADER]: Signalling peer ee4d8c8df06e4c04ad53ac25013d8a78 to start an election
I20260709 13:09:01.313874 28972 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "eb8f9bf7e0d24af88a04bda489298395"
dest_uuid: "ee4d8c8df06e4c04ad53ac25013d8a78"
 from {username='slave'} at 127.0.0.1:60700
I20260709 13:09:01.314433 28972 raft_consensus.cc:493] T eb8f9bf7e0d24af88a04bda489298395 P ee4d8c8df06e4c04ad53ac25013d8a78 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:09:01.314813 28972 raft_consensus.cc:3060] T eb8f9bf7e0d24af88a04bda489298395 P ee4d8c8df06e4c04ad53ac25013d8a78 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:01.320741 28972 raft_consensus.cc:515] T eb8f9bf7e0d24af88a04bda489298395 P ee4d8c8df06e4c04ad53ac25013d8a78 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0284f1db8c204657b7b423bab5b2eb4f" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 39279 } } peers { permanent_uuid: "ee4d8c8df06e4c04ad53ac25013d8a78" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 41821 } } peers { permanent_uuid: "e3fc42b9680245f3b66db70446830a2f" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 39203 } }
I20260709 13:09:01.322499 28972 leader_election.cc:290] T eb8f9bf7e0d24af88a04bda489298395 P ee4d8c8df06e4c04ad53ac25013d8a78 [CANDIDATE]: Term 3 election: Requested vote from peers 0284f1db8c204657b7b423bab5b2eb4f (127.17.223.1:39279), e3fc42b9680245f3b66db70446830a2f (127.17.223.3:39203)
I20260709 13:09:01.323467 29048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb8f9bf7e0d24af88a04bda489298395" candidate_uuid: "ee4d8c8df06e4c04ad53ac25013d8a78" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "e3fc42b9680245f3b66db70446830a2f"
I20260709 13:09:01.323451 29241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb8f9bf7e0d24af88a04bda489298395" candidate_uuid: "ee4d8c8df06e4c04ad53ac25013d8a78" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "0284f1db8c204657b7b423bab5b2eb4f"
I20260709 13:09:01.324082 29048 raft_consensus.cc:3055] T eb8f9bf7e0d24af88a04bda489298395 P e3fc42b9680245f3b66db70446830a2f [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:09:01.324280 29241 raft_consensus.cc:3060] T eb8f9bf7e0d24af88a04bda489298395 P 0284f1db8c204657b7b423bab5b2eb4f [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:01.324399 29048 raft_consensus.cc:740] T eb8f9bf7e0d24af88a04bda489298395 P e3fc42b9680245f3b66db70446830a2f [term 2 LEADER]: Becoming Follower/Learner. State: Replica: e3fc42b9680245f3b66db70446830a2f, State: Running, Role: LEADER
I20260709 13:09:01.325394 29048 consensus_queue.cc:260] T eb8f9bf7e0d24af88a04bda489298395 P e3fc42b9680245f3b66db70446830a2f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0284f1db8c204657b7b423bab5b2eb4f" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 39279 } } peers { permanent_uuid: "ee4d8c8df06e4c04ad53ac25013d8a78" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 41821 } } peers { permanent_uuid: "e3fc42b9680245f3b66db70446830a2f" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 39203 } }
I20260709 13:09:01.326479 29048 raft_consensus.cc:3060] T eb8f9bf7e0d24af88a04bda489298395 P e3fc42b9680245f3b66db70446830a2f [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:01.331630 29048 raft_consensus.cc:2468] T eb8f9bf7e0d24af88a04bda489298395 P e3fc42b9680245f3b66db70446830a2f [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee4d8c8df06e4c04ad53ac25013d8a78 in term 3.
I20260709 13:09:01.331689 29241 raft_consensus.cc:2468] T eb8f9bf7e0d24af88a04bda489298395 P 0284f1db8c204657b7b423bab5b2eb4f [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee4d8c8df06e4c04ad53ac25013d8a78 in term 3.
I20260709 13:09:01.332846 28938 leader_election.cc:304] T eb8f9bf7e0d24af88a04bda489298395 P ee4d8c8df06e4c04ad53ac25013d8a78 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e3fc42b9680245f3b66db70446830a2f, ee4d8c8df06e4c04ad53ac25013d8a78; no voters: 
I20260709 13:09:01.333586 29285 raft_consensus.cc:2804] T eb8f9bf7e0d24af88a04bda489298395 P ee4d8c8df06e4c04ad53ac25013d8a78 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:09:01.334028 29285 raft_consensus.cc:697] T eb8f9bf7e0d24af88a04bda489298395 P ee4d8c8df06e4c04ad53ac25013d8a78 [term 3 LEADER]: Becoming Leader. State: Replica: ee4d8c8df06e4c04ad53ac25013d8a78, State: Running, Role: LEADER
I20260709 13:09:01.334867 29285 consensus_queue.cc:237] T eb8f9bf7e0d24af88a04bda489298395 P ee4d8c8df06e4c04ad53ac25013d8a78 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0284f1db8c204657b7b423bab5b2eb4f" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 39279 } } peers { permanent_uuid: "ee4d8c8df06e4c04ad53ac25013d8a78" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 41821 } } peers { permanent_uuid: "e3fc42b9680245f3b66db70446830a2f" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 39203 } }
I20260709 13:09:01.340824 28797 catalog_manager.cc:5697] T eb8f9bf7e0d24af88a04bda489298395 P ee4d8c8df06e4c04ad53ac25013d8a78 reported cstate change: term changed from 2 to 3, leader changed from e3fc42b9680245f3b66db70446830a2f (127.17.223.3) to ee4d8c8df06e4c04ad53ac25013d8a78 (127.17.223.2). New cstate: current_term: 3 leader_uuid: "ee4d8c8df06e4c04ad53ac25013d8a78" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0284f1db8c204657b7b423bab5b2eb4f" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 39279 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ee4d8c8df06e4c04ad53ac25013d8a78" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 41821 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e3fc42b9680245f3b66db70446830a2f" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 39203 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:01.527022 29048 raft_consensus.cc:1275] T 777f2e0112c34108b367c8a2ad2641e1 P e3fc42b9680245f3b66db70446830a2f [term 3 FOLLOWER]: Refusing update from remote peer ee4d8c8df06e4c04ad53ac25013d8a78: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:09:01.528131 29285 consensus_queue.cc:1048] T 777f2e0112c34108b367c8a2ad2641e1 P ee4d8c8df06e4c04ad53ac25013d8a78 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3fc42b9680245f3b66db70446830a2f" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 39203 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:09:01.535678 29241 raft_consensus.cc:1275] T 777f2e0112c34108b367c8a2ad2641e1 P 0284f1db8c204657b7b423bab5b2eb4f [term 3 FOLLOWER]: Refusing update from remote peer ee4d8c8df06e4c04ad53ac25013d8a78: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:09:01.536995 29190 consensus_queue.cc:1048] T 777f2e0112c34108b367c8a2ad2641e1 P ee4d8c8df06e4c04ad53ac25013d8a78 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0284f1db8c204657b7b423bab5b2eb4f" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 39279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:09:01.544446 29190 raft_consensus.cc:993] T 7087f0eae49f4f71b5769071b817f8f2 P ee4d8c8df06e4c04ad53ac25013d8a78: : Instructing follower e3fc42b9680245f3b66db70446830a2f to start an election
I20260709 13:09:01.544927 29190 raft_consensus.cc:1081] T 7087f0eae49f4f71b5769071b817f8f2 P ee4d8c8df06e4c04ad53ac25013d8a78 [term 2 LEADER]: Signalling peer e3fc42b9680245f3b66db70446830a2f to start an election
I20260709 13:09:01.546799 29047 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "7087f0eae49f4f71b5769071b817f8f2"
dest_uuid: "e3fc42b9680245f3b66db70446830a2f"
 from {username='slave'} at 127.0.0.1:38528
I20260709 13:09:01.547358 29047 raft_consensus.cc:493] T 7087f0eae49f4f71b5769071b817f8f2 P e3fc42b9680245f3b66db70446830a2f [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:09:01.547717 29047 raft_consensus.cc:3060] T 7087f0eae49f4f71b5769071b817f8f2 P e3fc42b9680245f3b66db70446830a2f [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:01.554945 29047 raft_consensus.cc:515] T 7087f0eae49f4f71b5769071b817f8f2 P e3fc42b9680245f3b66db70446830a2f [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0284f1db8c204657b7b423bab5b2eb4f" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 39279 } } peers { permanent_uuid: "ee4d8c8df06e4c04ad53ac25013d8a78" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 41821 } } peers { permanent_uuid: "e3fc42b9680245f3b66db70446830a2f" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 39203 } }
I20260709 13:09:01.556748 29047 leader_election.cc:290] T 7087f0eae49f4f71b5769071b817f8f2 P e3fc42b9680245f3b66db70446830a2f [CANDIDATE]: Term 3 election: Requested vote from peers 0284f1db8c204657b7b423bab5b2eb4f (127.17.223.1:39279), ee4d8c8df06e4c04ad53ac25013d8a78 (127.17.223.2:41821)
I20260709 13:09:01.557607 29241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7087f0eae49f4f71b5769071b817f8f2" candidate_uuid: "e3fc42b9680245f3b66db70446830a2f" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: true dest_uuid: "0284f1db8c204657b7b423bab5b2eb4f"
I20260709 13:09:01.557847 28972 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7087f0eae49f4f71b5769071b817f8f2" candidate_uuid: "e3fc42b9680245f3b66db70446830a2f" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: true dest_uuid: "ee4d8c8df06e4c04ad53ac25013d8a78"
I20260709 13:09:01.558341 29241 raft_consensus.cc:3060] T 7087f0eae49f4f71b5769071b817f8f2 P 0284f1db8c204657b7b423bab5b2eb4f [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:01.558509 28972 raft_consensus.cc:3055] T 7087f0eae49f4f71b5769071b817f8f2 P ee4d8c8df06e4c04ad53ac25013d8a78 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:09:01.559078 28972 raft_consensus.cc:740] T 7087f0eae49f4f71b5769071b817f8f2 P ee4d8c8df06e4c04ad53ac25013d8a78 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: ee4d8c8df06e4c04ad53ac25013d8a78, State: Running, Role: LEADER
I20260709 13:09:01.559916 28972 consensus_queue.cc:260] T 7087f0eae49f4f71b5769071b817f8f2 P ee4d8c8df06e4c04ad53ac25013d8a78 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0284f1db8c204657b7b423bab5b2eb4f" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 39279 } } peers { permanent_uuid: "ee4d8c8df06e4c04ad53ac25013d8a78" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 41821 } } peers { permanent_uuid: "e3fc42b9680245f3b66db70446830a2f" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 39203 } }
I20260709 13:09:01.560905 28972 raft_consensus.cc:3060] T 7087f0eae49f4f71b5769071b817f8f2 P ee4d8c8df06e4c04ad53ac25013d8a78 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:01.563827 29241 raft_consensus.cc:2468] T 7087f0eae49f4f71b5769071b817f8f2 P 0284f1db8c204657b7b423bab5b2eb4f [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3fc42b9680245f3b66db70446830a2f in term 3.
I20260709 13:09:01.565016 29012 leader_election.cc:304] T 7087f0eae49f4f71b5769071b817f8f2 P e3fc42b9680245f3b66db70446830a2f [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0284f1db8c204657b7b423bab5b2eb4f, e3fc42b9680245f3b66db70446830a2f; no voters: 
I20260709 13:09:01.565795 29172 raft_consensus.cc:2804] T 7087f0eae49f4f71b5769071b817f8f2 P e3fc42b9680245f3b66db70446830a2f [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:09:01.566201 29172 raft_consensus.cc:697] T 7087f0eae49f4f71b5769071b817f8f2 P e3fc42b9680245f3b66db70446830a2f [term 3 LEADER]: Becoming Leader. State: Replica: e3fc42b9680245f3b66db70446830a2f, State: Running, Role: LEADER
I20260709 13:09:01.566211 28972 raft_consensus.cc:2468] T 7087f0eae49f4f71b5769071b817f8f2 P ee4d8c8df06e4c04ad53ac25013d8a78 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3fc42b9680245f3b66db70446830a2f in term 3.
I20260709 13:09:01.567233 29172 consensus_queue.cc:237] T 7087f0eae49f4f71b5769071b817f8f2 P e3fc42b9680245f3b66db70446830a2f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0284f1db8c204657b7b423bab5b2eb4f" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 39279 } } peers { permanent_uuid: "ee4d8c8df06e4c04ad53ac25013d8a78" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 41821 } } peers { permanent_uuid: "e3fc42b9680245f3b66db70446830a2f" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 39203 } }
I20260709 13:09:01.575738 28795 catalog_manager.cc:5697] T 7087f0eae49f4f71b5769071b817f8f2 P e3fc42b9680245f3b66db70446830a2f reported cstate change: term changed from 2 to 3, leader changed from ee4d8c8df06e4c04ad53ac25013d8a78 (127.17.223.2) to e3fc42b9680245f3b66db70446830a2f (127.17.223.3). New cstate: current_term: 3 leader_uuid: "e3fc42b9680245f3b66db70446830a2f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0284f1db8c204657b7b423bab5b2eb4f" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 39279 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ee4d8c8df06e4c04ad53ac25013d8a78" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 41821 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e3fc42b9680245f3b66db70446830a2f" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 39203 } health_report { overall_health: HEALTHY } } }
I20260709 13:09:01.759680 29241 raft_consensus.cc:1275] T eb8f9bf7e0d24af88a04bda489298395 P 0284f1db8c204657b7b423bab5b2eb4f [term 3 FOLLOWER]: Refusing update from remote peer ee4d8c8df06e4c04ad53ac25013d8a78: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:09:01.760995 29314 consensus_queue.cc:1048] T eb8f9bf7e0d24af88a04bda489298395 P ee4d8c8df06e4c04ad53ac25013d8a78 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0284f1db8c204657b7b423bab5b2eb4f" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 39279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:09:01.768896 29047 raft_consensus.cc:1275] T eb8f9bf7e0d24af88a04bda489298395 P e3fc42b9680245f3b66db70446830a2f [term 3 FOLLOWER]: Refusing update from remote peer ee4d8c8df06e4c04ad53ac25013d8a78: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:09:01.770612 29285 consensus_queue.cc:1048] T eb8f9bf7e0d24af88a04bda489298395 P ee4d8c8df06e4c04ad53ac25013d8a78 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3fc42b9680245f3b66db70446830a2f" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 39203 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
W20260709 13:09:01.826427 28845 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 13:09:01.982859 28972 raft_consensus.cc:1275] T 7087f0eae49f4f71b5769071b817f8f2 P ee4d8c8df06e4c04ad53ac25013d8a78 [term 3 FOLLOWER]: Refusing update from remote peer e3fc42b9680245f3b66db70446830a2f: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:09:01.984100 29172 consensus_queue.cc:1048] T 7087f0eae49f4f71b5769071b817f8f2 P e3fc42b9680245f3b66db70446830a2f [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee4d8c8df06e4c04ad53ac25013d8a78" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 41821 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:09:01.995179 29241 raft_consensus.cc:1275] T 7087f0eae49f4f71b5769071b817f8f2 P 0284f1db8c204657b7b423bab5b2eb4f [term 3 FOLLOWER]: Refusing update from remote peer e3fc42b9680245f3b66db70446830a2f: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:09:01.996984 29172 consensus_queue.cc:1048] T 7087f0eae49f4f71b5769071b817f8f2 P e3fc42b9680245f3b66db70446830a2f [LEADER]: Connected to new peer: Peer: permanent_uuid: "0284f1db8c204657b7b423bab5b2eb4f" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 39279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:09:02.089483 18300 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:09:02.097259 28972 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "777f2e0112c34108b367c8a2ad2641e1"
dest_uuid: "ee4d8c8df06e4c04ad53ac25013d8a78"
mode: GRACEFUL
new_leader_uuid: "e3fc42b9680245f3b66db70446830a2f"
 from {username='slave'} at 127.0.0.1:60718
I20260709 13:09:02.097990 28972 raft_consensus.cc:606] T 777f2e0112c34108b367c8a2ad2641e1 P ee4d8c8df06e4c04ad53ac25013d8a78 [term 3 LEADER]: Received request to transfer leadership to TS e3fc42b9680245f3b66db70446830a2f
I20260709 13:09:02.100857 29047 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9f5d8f2d6f684a5b9702935fc8fd85a1"
dest_uuid: "e3fc42b9680245f3b66db70446830a2f"
mode: GRACEFUL
new_leader_uuid: "ee4d8c8df06e4c04ad53ac25013d8a78"
 from {username='slave'} at 127.0.0.1:38536
I20260709 13:09:02.101366 29047 raft_consensus.cc:606] T 9f5d8f2d6f684a5b9702935fc8fd85a1 P e3fc42b9680245f3b66db70446830a2f [term 1 LEADER]: Received request to transfer leadership to TS ee4d8c8df06e4c04ad53ac25013d8a78
I20260709 13:09:02.104103 28972 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "eb8f9bf7e0d24af88a04bda489298395"
dest_uuid: "ee4d8c8df06e4c04ad53ac25013d8a78"
mode: GRACEFUL
new_leader_uuid: "e3fc42b9680245f3b66db70446830a2f"
 from {username='slave'} at 127.0.0.1:60718
I20260709 13:09:02.104620 28972 raft_consensus.cc:606] T eb8f9bf7e0d24af88a04bda489298395 P ee4d8c8df06e4c04ad53ac25013d8a78 [term 3 LEADER]: Received request to transfer leadership to TS e3fc42b9680245f3b66db70446830a2f
I20260709 13:09:02.105608 18300 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 13:09:02.106060 18300 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:09:02.106556 18300 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:09:02.168910 29285 raft_consensus.cc:993] T eb8f9bf7e0d24af88a04bda489298395 P ee4d8c8df06e4c04ad53ac25013d8a78: : Instructing follower e3fc42b9680245f3b66db70446830a2f to start an election
I20260709 13:09:02.169483 29190 raft_consensus.cc:1081] T eb8f9bf7e0d24af88a04bda489298395 P ee4d8c8df06e4c04ad53ac25013d8a78 [term 3 LEADER]: Signalling peer e3fc42b9680245f3b66db70446830a2f to start an election
I20260709 13:09:02.171124 29047 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "eb8f9bf7e0d24af88a04bda489298395"
dest_uuid: "e3fc42b9680245f3b66db70446830a2f"
 from {username='slave'} at 127.0.0.1:38528
I20260709 13:09:02.171651 29047 raft_consensus.cc:493] T eb8f9bf7e0d24af88a04bda489298395 P e3fc42b9680245f3b66db70446830a2f [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:09:02.172014 29047 raft_consensus.cc:3060] T eb8f9bf7e0d24af88a04bda489298395 P e3fc42b9680245f3b66db70446830a2f [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:09:02.177206 29047 raft_consensus.cc:515] T eb8f9bf7e0d24af88a04bda489298395 P e3fc42b9680245f3b66db70446830a2f [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0284f1db8c204657b7b423bab5b2eb4f" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 39279 } } peers { permanent_uuid: "ee4d8c8df06e4c04ad53ac25013d8a78" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 41821 } } peers { permanent_uuid: "e3fc42b9680245f3b66db70446830a2f" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 39203 } }
I20260709 13:09:02.178898 29047 leader_election.cc:290] T eb8f9bf7e0d24af88a04bda489298395 P e3fc42b9680245f3b66db70446830a2f [CANDIDATE]: Term 4 election: Requested vote from peers 0284f1db8c204657b7b423bab5b2eb4f (127.17.223.1:39279), ee4d8c8df06e4c04ad53ac25013d8a78 (127.17.223.2:41821)
I20260709 13:09:02.179831 29241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb8f9bf7e0d24af88a04bda489298395" candidate_uuid: "e3fc42b9680245f3b66db70446830a2f" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "0284f1db8c204657b7b423bab5b2eb4f"
I20260709 13:09:02.180080 28972 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb8f9bf7e0d24af88a04bda489298395" candidate_uuid: "e3fc42b9680245f3b66db70446830a2f" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "ee4d8c8df06e4c04ad53ac25013d8a78"
I20260709 13:09:02.180570 29241 raft_consensus.cc:3060] T eb8f9bf7e0d24af88a04bda489298395 P 0284f1db8c204657b7b423bab5b2eb4f [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:09:02.180660 28972 raft_consensus.cc:3055] T eb8f9bf7e0d24af88a04bda489298395 P ee4d8c8df06e4c04ad53ac25013d8a78 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:09:02.181105 28972 raft_consensus.cc:740] T eb8f9bf7e0d24af88a04bda489298395 P ee4d8c8df06e4c04ad53ac25013d8a78 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: ee4d8c8df06e4c04ad53ac25013d8a78, State: Running, Role: LEADER
I20260709 13:09:02.181975 28972 consensus_queue.cc:260] T eb8f9bf7e0d24af88a04bda489298395 P ee4d8c8df06e4c04ad53ac25013d8a78 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0284f1db8c204657b7b423bab5b2eb4f" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 39279 } } peers { permanent_uuid: "ee4d8c8df06e4c04ad53ac25013d8a78" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 41821 } } peers { permanent_uuid: "e3fc42b9680245f3b66db70446830a2f" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 39203 } }
I20260709 13:09:02.183322 28972 raft_consensus.cc:3060] T eb8f9bf7e0d24af88a04bda489298395 P ee4d8c8df06e4c04ad53ac25013d8a78 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:09:02.188802 29241 raft_consensus.cc:2468] T eb8f9bf7e0d24af88a04bda489298395 P 0284f1db8c204657b7b423bab5b2eb4f [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3fc42b9680245f3b66db70446830a2f in term 4.
I20260709 13:09:02.190330 29012 leader_election.cc:304] T eb8f9bf7e0d24af88a04bda489298395 P e3fc42b9680245f3b66db70446830a2f [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0284f1db8c204657b7b423bab5b2eb4f, e3fc42b9680245f3b66db70446830a2f; no voters: 
I20260709 13:09:02.191126 29172 raft_consensus.cc:2804] T eb8f9bf7e0d24af88a04bda489298395 P e3fc42b9680245f3b66db70446830a2f [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:09:02.191390 28972 raft_consensus.cc:2468] T eb8f9bf7e0d24af88a04bda489298395 P ee4d8c8df06e4c04ad53ac25013d8a78 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3fc42b9680245f3b66db70446830a2f in term 4.
I20260709 13:09:02.191576 29172 raft_consensus.cc:697] T eb8f9bf7e0d24af88a04bda489298395 P e3fc42b9680245f3b66db70446830a2f [term 4 LEADER]: Becoming Leader. State: Replica: e3fc42b9680245f3b66db70446830a2f, State: Running, Role: LEADER
I20260709 13:09:02.192713 29172 consensus_queue.cc:237] T eb8f9bf7e0d24af88a04bda489298395 P e3fc42b9680245f3b66db70446830a2f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0284f1db8c204657b7b423bab5b2eb4f" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 39279 } } peers { permanent_uuid: "ee4d8c8df06e4c04ad53ac25013d8a78" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 41821 } } peers { permanent_uuid: "e3fc42b9680245f3b66db70446830a2f" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 39203 } }
I20260709 13:09:02.198887 28797 catalog_manager.cc:5697] T eb8f9bf7e0d24af88a04bda489298395 P e3fc42b9680245f3b66db70446830a2f reported cstate change: term changed from 3 to 4, leader changed from ee4d8c8df06e4c04ad53ac25013d8a78 (127.17.223.2) to e3fc42b9680245f3b66db70446830a2f (127.17.223.3). New cstate: current_term: 4 leader_uuid: "e3fc42b9680245f3b66db70446830a2f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0284f1db8c204657b7b423bab5b2eb4f" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 39279 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ee4d8c8df06e4c04ad53ac25013d8a78" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 41821 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e3fc42b9680245f3b66db70446830a2f" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 39203 } health_report { overall_health: HEALTHY } } }
I20260709 13:09:02.449591 29285 raft_consensus.cc:993] T 777f2e0112c34108b367c8a2ad2641e1 P ee4d8c8df06e4c04ad53ac25013d8a78: : Instructing follower e3fc42b9680245f3b66db70446830a2f to start an election
I20260709 13:09:02.450251 29285 raft_consensus.cc:1081] T 777f2e0112c34108b367c8a2ad2641e1 P ee4d8c8df06e4c04ad53ac25013d8a78 [term 3 LEADER]: Signalling peer e3fc42b9680245f3b66db70446830a2f to start an election
I20260709 13:09:02.452126 29047 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "777f2e0112c34108b367c8a2ad2641e1"
dest_uuid: "e3fc42b9680245f3b66db70446830a2f"
 from {username='slave'} at 127.0.0.1:38528
I20260709 13:09:02.452663 29047 raft_consensus.cc:493] T 777f2e0112c34108b367c8a2ad2641e1 P e3fc42b9680245f3b66db70446830a2f [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:09:02.453013 29047 raft_consensus.cc:3060] T 777f2e0112c34108b367c8a2ad2641e1 P e3fc42b9680245f3b66db70446830a2f [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:09:02.458774 29047 raft_consensus.cc:515] T 777f2e0112c34108b367c8a2ad2641e1 P e3fc42b9680245f3b66db70446830a2f [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0284f1db8c204657b7b423bab5b2eb4f" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 39279 } } peers { permanent_uuid: "ee4d8c8df06e4c04ad53ac25013d8a78" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 41821 } } peers { permanent_uuid: "e3fc42b9680245f3b66db70446830a2f" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 39203 } }
I20260709 13:09:02.460613 29047 leader_election.cc:290] T 777f2e0112c34108b367c8a2ad2641e1 P e3fc42b9680245f3b66db70446830a2f [CANDIDATE]: Term 4 election: Requested vote from peers 0284f1db8c204657b7b423bab5b2eb4f (127.17.223.1:39279), ee4d8c8df06e4c04ad53ac25013d8a78 (127.17.223.2:41821)
I20260709 13:09:02.461227 29241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "777f2e0112c34108b367c8a2ad2641e1" candidate_uuid: "e3fc42b9680245f3b66db70446830a2f" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "0284f1db8c204657b7b423bab5b2eb4f"
I20260709 13:09:02.461889 28972 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "777f2e0112c34108b367c8a2ad2641e1" candidate_uuid: "e3fc42b9680245f3b66db70446830a2f" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "ee4d8c8df06e4c04ad53ac25013d8a78"
I20260709 13:09:02.461907 29241 raft_consensus.cc:3060] T 777f2e0112c34108b367c8a2ad2641e1 P 0284f1db8c204657b7b423bab5b2eb4f [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:09:02.462445 28972 raft_consensus.cc:3055] T 777f2e0112c34108b367c8a2ad2641e1 P ee4d8c8df06e4c04ad53ac25013d8a78 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:09:02.462826 28972 raft_consensus.cc:740] T 777f2e0112c34108b367c8a2ad2641e1 P ee4d8c8df06e4c04ad53ac25013d8a78 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: ee4d8c8df06e4c04ad53ac25013d8a78, State: Running, Role: LEADER
I20260709 13:09:02.463600 28972 consensus_queue.cc:260] T 777f2e0112c34108b367c8a2ad2641e1 P ee4d8c8df06e4c04ad53ac25013d8a78 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0284f1db8c204657b7b423bab5b2eb4f" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 39279 } } peers { permanent_uuid: "ee4d8c8df06e4c04ad53ac25013d8a78" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 41821 } } peers { permanent_uuid: "e3fc42b9680245f3b66db70446830a2f" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 39203 } }
I20260709 13:09:02.464514 28972 raft_consensus.cc:3060] T 777f2e0112c34108b367c8a2ad2641e1 P ee4d8c8df06e4c04ad53ac25013d8a78 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:09:02.467252 29241 raft_consensus.cc:2468] T 777f2e0112c34108b367c8a2ad2641e1 P 0284f1db8c204657b7b423bab5b2eb4f [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3fc42b9680245f3b66db70446830a2f in term 4.
I20260709 13:09:02.468346 29012 leader_election.cc:304] T 777f2e0112c34108b367c8a2ad2641e1 P e3fc42b9680245f3b66db70446830a2f [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0284f1db8c204657b7b423bab5b2eb4f, e3fc42b9680245f3b66db70446830a2f; no voters: 
I20260709 13:09:02.468988 29307 raft_consensus.cc:2804] T 777f2e0112c34108b367c8a2ad2641e1 P e3fc42b9680245f3b66db70446830a2f [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:09:02.469169 28972 raft_consensus.cc:2468] T 777f2e0112c34108b367c8a2ad2641e1 P ee4d8c8df06e4c04ad53ac25013d8a78 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3fc42b9680245f3b66db70446830a2f in term 4.
I20260709 13:09:02.469400 29307 raft_consensus.cc:697] T 777f2e0112c34108b367c8a2ad2641e1 P e3fc42b9680245f3b66db70446830a2f [term 4 LEADER]: Becoming Leader. State: Replica: e3fc42b9680245f3b66db70446830a2f, State: Running, Role: LEADER
I20260709 13:09:02.470345 29307 consensus_queue.cc:237] T 777f2e0112c34108b367c8a2ad2641e1 P e3fc42b9680245f3b66db70446830a2f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0284f1db8c204657b7b423bab5b2eb4f" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 39279 } } peers { permanent_uuid: "ee4d8c8df06e4c04ad53ac25013d8a78" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 41821 } } peers { permanent_uuid: "e3fc42b9680245f3b66db70446830a2f" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 39203 } }
I20260709 13:09:02.476455 28797 catalog_manager.cc:5697] T 777f2e0112c34108b367c8a2ad2641e1 P e3fc42b9680245f3b66db70446830a2f reported cstate change: term changed from 3 to 4, leader changed from ee4d8c8df06e4c04ad53ac25013d8a78 (127.17.223.2) to e3fc42b9680245f3b66db70446830a2f (127.17.223.3). New cstate: current_term: 4 leader_uuid: "e3fc42b9680245f3b66db70446830a2f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0284f1db8c204657b7b423bab5b2eb4f" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 39279 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ee4d8c8df06e4c04ad53ac25013d8a78" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 41821 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e3fc42b9680245f3b66db70446830a2f" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 39203 } health_report { overall_health: HEALTHY } } }
I20260709 13:09:02.630398 29172 raft_consensus.cc:993] T 9f5d8f2d6f684a5b9702935fc8fd85a1 P e3fc42b9680245f3b66db70446830a2f: : Instructing follower ee4d8c8df06e4c04ad53ac25013d8a78 to start an election
I20260709 13:09:02.630903 29307 raft_consensus.cc:1081] T 9f5d8f2d6f684a5b9702935fc8fd85a1 P e3fc42b9680245f3b66db70446830a2f [term 1 LEADER]: Signalling peer ee4d8c8df06e4c04ad53ac25013d8a78 to start an election
I20260709 13:09:02.632280 28972 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "9f5d8f2d6f684a5b9702935fc8fd85a1"
dest_uuid: "ee4d8c8df06e4c04ad53ac25013d8a78"
 from {username='slave'} at 127.0.0.1:60700
I20260709 13:09:02.632721 28972 raft_consensus.cc:493] T 9f5d8f2d6f684a5b9702935fc8fd85a1 P ee4d8c8df06e4c04ad53ac25013d8a78 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:09:02.633018 28972 raft_consensus.cc:3060] T 9f5d8f2d6f684a5b9702935fc8fd85a1 P ee4d8c8df06e4c04ad53ac25013d8a78 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:02.637746 28972 raft_consensus.cc:515] T 9f5d8f2d6f684a5b9702935fc8fd85a1 P ee4d8c8df06e4c04ad53ac25013d8a78 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0284f1db8c204657b7b423bab5b2eb4f" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 39279 } } peers { permanent_uuid: "ee4d8c8df06e4c04ad53ac25013d8a78" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 41821 } } peers { permanent_uuid: "e3fc42b9680245f3b66db70446830a2f" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 39203 } }
I20260709 13:09:02.639194 28972 leader_election.cc:290] T 9f5d8f2d6f684a5b9702935fc8fd85a1 P ee4d8c8df06e4c04ad53ac25013d8a78 [CANDIDATE]: Term 2 election: Requested vote from peers 0284f1db8c204657b7b423bab5b2eb4f (127.17.223.1:39279), e3fc42b9680245f3b66db70446830a2f (127.17.223.3:39203)
I20260709 13:09:02.640025 29241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f5d8f2d6f684a5b9702935fc8fd85a1" candidate_uuid: "ee4d8c8df06e4c04ad53ac25013d8a78" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0284f1db8c204657b7b423bab5b2eb4f"
I20260709 13:09:02.640300 29047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f5d8f2d6f684a5b9702935fc8fd85a1" candidate_uuid: "ee4d8c8df06e4c04ad53ac25013d8a78" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e3fc42b9680245f3b66db70446830a2f"
I20260709 13:09:02.640755 29241 raft_consensus.cc:3060] T 9f5d8f2d6f684a5b9702935fc8fd85a1 P 0284f1db8c204657b7b423bab5b2eb4f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:02.640992 29047 raft_consensus.cc:3055] T 9f5d8f2d6f684a5b9702935fc8fd85a1 P e3fc42b9680245f3b66db70446830a2f [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:09:02.641390 29047 raft_consensus.cc:740] T 9f5d8f2d6f684a5b9702935fc8fd85a1 P e3fc42b9680245f3b66db70446830a2f [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e3fc42b9680245f3b66db70446830a2f, State: Running, Role: LEADER
I20260709 13:09:02.642150 29047 consensus_queue.cc:260] T 9f5d8f2d6f684a5b9702935fc8fd85a1 P e3fc42b9680245f3b66db70446830a2f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0284f1db8c204657b7b423bab5b2eb4f" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 39279 } } peers { permanent_uuid: "ee4d8c8df06e4c04ad53ac25013d8a78" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 41821 } } peers { permanent_uuid: "e3fc42b9680245f3b66db70446830a2f" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 39203 } }
I20260709 13:09:02.643245 29047 raft_consensus.cc:3060] T 9f5d8f2d6f684a5b9702935fc8fd85a1 P e3fc42b9680245f3b66db70446830a2f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:02.646425 29241 raft_consensus.cc:2468] T 9f5d8f2d6f684a5b9702935fc8fd85a1 P 0284f1db8c204657b7b423bab5b2eb4f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee4d8c8df06e4c04ad53ac25013d8a78 in term 2.
I20260709 13:09:02.647621 28938 leader_election.cc:304] T 9f5d8f2d6f684a5b9702935fc8fd85a1 P ee4d8c8df06e4c04ad53ac25013d8a78 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0284f1db8c204657b7b423bab5b2eb4f, ee4d8c8df06e4c04ad53ac25013d8a78; no voters: 
I20260709 13:09:02.648386 29285 raft_consensus.cc:2804] T 9f5d8f2d6f684a5b9702935fc8fd85a1 P ee4d8c8df06e4c04ad53ac25013d8a78 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:09:02.648569 29047 raft_consensus.cc:2468] T 9f5d8f2d6f684a5b9702935fc8fd85a1 P e3fc42b9680245f3b66db70446830a2f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee4d8c8df06e4c04ad53ac25013d8a78 in term 2.
I20260709 13:09:02.648881 29285 raft_consensus.cc:697] T 9f5d8f2d6f684a5b9702935fc8fd85a1 P ee4d8c8df06e4c04ad53ac25013d8a78 [term 2 LEADER]: Becoming Leader. State: Replica: ee4d8c8df06e4c04ad53ac25013d8a78, State: Running, Role: LEADER
I20260709 13:09:02.649992 29285 consensus_queue.cc:237] T 9f5d8f2d6f684a5b9702935fc8fd85a1 P ee4d8c8df06e4c04ad53ac25013d8a78 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0284f1db8c204657b7b423bab5b2eb4f" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 39279 } } peers { permanent_uuid: "ee4d8c8df06e4c04ad53ac25013d8a78" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 41821 } } peers { permanent_uuid: "e3fc42b9680245f3b66db70446830a2f" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 39203 } }
I20260709 13:09:02.657166 28797 catalog_manager.cc:5697] T 9f5d8f2d6f684a5b9702935fc8fd85a1 P ee4d8c8df06e4c04ad53ac25013d8a78 reported cstate change: term changed from 1 to 2, leader changed from e3fc42b9680245f3b66db70446830a2f (127.17.223.3) to ee4d8c8df06e4c04ad53ac25013d8a78 (127.17.223.2). New cstate: current_term: 2 leader_uuid: "ee4d8c8df06e4c04ad53ac25013d8a78" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0284f1db8c204657b7b423bab5b2eb4f" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 39279 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ee4d8c8df06e4c04ad53ac25013d8a78" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 41821 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e3fc42b9680245f3b66db70446830a2f" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 39203 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:02.661087 29241 raft_consensus.cc:1275] T eb8f9bf7e0d24af88a04bda489298395 P 0284f1db8c204657b7b423bab5b2eb4f [term 4 FOLLOWER]: Refusing update from remote peer e3fc42b9680245f3b66db70446830a2f: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:09:02.662533 29307 consensus_queue.cc:1048] T eb8f9bf7e0d24af88a04bda489298395 P e3fc42b9680245f3b66db70446830a2f [LEADER]: Connected to new peer: Peer: permanent_uuid: "0284f1db8c204657b7b423bab5b2eb4f" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 39279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:09:02.673178 28972 raft_consensus.cc:1275] T eb8f9bf7e0d24af88a04bda489298395 P ee4d8c8df06e4c04ad53ac25013d8a78 [term 4 FOLLOWER]: Refusing update from remote peer e3fc42b9680245f3b66db70446830a2f: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:09:02.674471 29307 consensus_queue.cc:1048] T eb8f9bf7e0d24af88a04bda489298395 P e3fc42b9680245f3b66db70446830a2f [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee4d8c8df06e4c04ad53ac25013d8a78" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 41821 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
W20260709 13:09:02.827364 28845 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 13:09:02.923019 29241 raft_consensus.cc:1275] T 777f2e0112c34108b367c8a2ad2641e1 P 0284f1db8c204657b7b423bab5b2eb4f [term 4 FOLLOWER]: Refusing update from remote peer e3fc42b9680245f3b66db70446830a2f: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:09:02.924350 29307 consensus_queue.cc:1048] T 777f2e0112c34108b367c8a2ad2641e1 P e3fc42b9680245f3b66db70446830a2f [LEADER]: Connected to new peer: Peer: permanent_uuid: "0284f1db8c204657b7b423bab5b2eb4f" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 39279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:09:02.933094 28972 raft_consensus.cc:1275] T 777f2e0112c34108b367c8a2ad2641e1 P ee4d8c8df06e4c04ad53ac25013d8a78 [term 4 FOLLOWER]: Refusing update from remote peer e3fc42b9680245f3b66db70446830a2f: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:09:02.935113 29301 consensus_queue.cc:1048] T 777f2e0112c34108b367c8a2ad2641e1 P e3fc42b9680245f3b66db70446830a2f [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee4d8c8df06e4c04ad53ac25013d8a78" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 41821 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:09:03.041786 29241 raft_consensus.cc:1275] T 9f5d8f2d6f684a5b9702935fc8fd85a1 P 0284f1db8c204657b7b423bab5b2eb4f [term 2 FOLLOWER]: Refusing update from remote peer ee4d8c8df06e4c04ad53ac25013d8a78: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:03.043102 29285 consensus_queue.cc:1048] T 9f5d8f2d6f684a5b9702935fc8fd85a1 P ee4d8c8df06e4c04ad53ac25013d8a78 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0284f1db8c204657b7b423bab5b2eb4f" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 39279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:09:03.052284 29047 raft_consensus.cc:1275] T 9f5d8f2d6f684a5b9702935fc8fd85a1 P e3fc42b9680245f3b66db70446830a2f [term 2 FOLLOWER]: Refusing update from remote peer ee4d8c8df06e4c04ad53ac25013d8a78: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:03.053894 29332 consensus_queue.cc:1048] T 9f5d8f2d6f684a5b9702935fc8fd85a1 P ee4d8c8df06e4c04ad53ac25013d8a78 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3fc42b9680245f3b66db70446830a2f" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 39203 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:09:03.112834 18300 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:09:03.120319 28972 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2b38eb974fe54bb6a799876978d3ba4c"
dest_uuid: "ee4d8c8df06e4c04ad53ac25013d8a78"
mode: GRACEFUL
new_leader_uuid: "e3fc42b9680245f3b66db70446830a2f"
 from {username='slave'} at 127.0.0.1:60718
I20260709 13:09:03.120847 28972 raft_consensus.cc:606] T 2b38eb974fe54bb6a799876978d3ba4c P ee4d8c8df06e4c04ad53ac25013d8a78 [term 1 LEADER]: Received request to transfer leadership to TS e3fc42b9680245f3b66db70446830a2f
I20260709 13:09:03.123550 29047 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "451e3f8929ef4287a9eaa8941486e9cc"
dest_uuid: "e3fc42b9680245f3b66db70446830a2f"
mode: GRACEFUL
new_leader_uuid: "ee4d8c8df06e4c04ad53ac25013d8a78"
 from {username='slave'} at 127.0.0.1:38536
I20260709 13:09:03.124169 29047 raft_consensus.cc:606] T 451e3f8929ef4287a9eaa8941486e9cc P e3fc42b9680245f3b66db70446830a2f [term 2 LEADER]: Received request to transfer leadership to TS ee4d8c8df06e4c04ad53ac25013d8a78
I20260709 13:09:03.126893 29047 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4b9944472adf4cec929d98a95851bef9"
dest_uuid: "e3fc42b9680245f3b66db70446830a2f"
mode: GRACEFUL
new_leader_uuid: "ee4d8c8df06e4c04ad53ac25013d8a78"
 from {username='slave'} at 127.0.0.1:38536
I20260709 13:09:03.127358 29047 raft_consensus.cc:606] T 4b9944472adf4cec929d98a95851bef9 P e3fc42b9680245f3b66db70446830a2f [term 1 LEADER]: Received request to transfer leadership to TS ee4d8c8df06e4c04ad53ac25013d8a78
I20260709 13:09:03.128539 18300 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 13:09:03.129099 18300 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:09:03.129787 18300 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:09:03.430611 29172 raft_consensus.cc:993] T 4b9944472adf4cec929d98a95851bef9 P e3fc42b9680245f3b66db70446830a2f: : Instructing follower ee4d8c8df06e4c04ad53ac25013d8a78 to start an election
I20260709 13:09:03.431293 29172 raft_consensus.cc:1081] T 4b9944472adf4cec929d98a95851bef9 P e3fc42b9680245f3b66db70446830a2f [term 1 LEADER]: Signalling peer ee4d8c8df06e4c04ad53ac25013d8a78 to start an election
I20260709 13:09:03.432857 28972 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "4b9944472adf4cec929d98a95851bef9"
dest_uuid: "ee4d8c8df06e4c04ad53ac25013d8a78"
 from {username='slave'} at 127.0.0.1:60700
I20260709 13:09:03.433367 28972 raft_consensus.cc:493] T 4b9944472adf4cec929d98a95851bef9 P ee4d8c8df06e4c04ad53ac25013d8a78 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:09:03.433717 28972 raft_consensus.cc:3060] T 4b9944472adf4cec929d98a95851bef9 P ee4d8c8df06e4c04ad53ac25013d8a78 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:03.438583 28972 raft_consensus.cc:515] T 4b9944472adf4cec929d98a95851bef9 P ee4d8c8df06e4c04ad53ac25013d8a78 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0284f1db8c204657b7b423bab5b2eb4f" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 39279 } } peers { permanent_uuid: "ee4d8c8df06e4c04ad53ac25013d8a78" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 41821 } } peers { permanent_uuid: "e3fc42b9680245f3b66db70446830a2f" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 39203 } }
I20260709 13:09:03.439996 28972 leader_election.cc:290] T 4b9944472adf4cec929d98a95851bef9 P ee4d8c8df06e4c04ad53ac25013d8a78 [CANDIDATE]: Term 2 election: Requested vote from peers 0284f1db8c204657b7b423bab5b2eb4f (127.17.223.1:39279), e3fc42b9680245f3b66db70446830a2f (127.17.223.3:39203)
I20260709 13:09:03.440909 29241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b9944472adf4cec929d98a95851bef9" candidate_uuid: "ee4d8c8df06e4c04ad53ac25013d8a78" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0284f1db8c204657b7b423bab5b2eb4f"
I20260709 13:09:03.440929 29047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b9944472adf4cec929d98a95851bef9" candidate_uuid: "ee4d8c8df06e4c04ad53ac25013d8a78" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e3fc42b9680245f3b66db70446830a2f"
I20260709 13:09:03.441773 29241 raft_consensus.cc:3060] T 4b9944472adf4cec929d98a95851bef9 P 0284f1db8c204657b7b423bab5b2eb4f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:03.441804 29047 raft_consensus.cc:3055] T 4b9944472adf4cec929d98a95851bef9 P e3fc42b9680245f3b66db70446830a2f [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:09:03.442332 29047 raft_consensus.cc:740] T 4b9944472adf4cec929d98a95851bef9 P e3fc42b9680245f3b66db70446830a2f [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e3fc42b9680245f3b66db70446830a2f, State: Running, Role: LEADER
I20260709 13:09:03.443162 29047 consensus_queue.cc:260] T 4b9944472adf4cec929d98a95851bef9 P e3fc42b9680245f3b66db70446830a2f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0284f1db8c204657b7b423bab5b2eb4f" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 39279 } } peers { permanent_uuid: "ee4d8c8df06e4c04ad53ac25013d8a78" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 41821 } } peers { permanent_uuid: "e3fc42b9680245f3b66db70446830a2f" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 39203 } }
I20260709 13:09:03.444083 29047 raft_consensus.cc:3060] T 4b9944472adf4cec929d98a95851bef9 P e3fc42b9680245f3b66db70446830a2f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:03.450390 29047 raft_consensus.cc:2468] T 4b9944472adf4cec929d98a95851bef9 P e3fc42b9680245f3b66db70446830a2f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee4d8c8df06e4c04ad53ac25013d8a78 in term 2.
I20260709 13:09:03.452132 28938 leader_election.cc:304] T 4b9944472adf4cec929d98a95851bef9 P ee4d8c8df06e4c04ad53ac25013d8a78 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e3fc42b9680245f3b66db70446830a2f, ee4d8c8df06e4c04ad53ac25013d8a78; no voters: 
I20260709 13:09:03.452919 29332 raft_consensus.cc:2804] T 4b9944472adf4cec929d98a95851bef9 P ee4d8c8df06e4c04ad53ac25013d8a78 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:09:03.453272 29241 raft_consensus.cc:2468] T 4b9944472adf4cec929d98a95851bef9 P 0284f1db8c204657b7b423bab5b2eb4f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee4d8c8df06e4c04ad53ac25013d8a78 in term 2.
I20260709 13:09:03.453334 29332 raft_consensus.cc:697] T 4b9944472adf4cec929d98a95851bef9 P ee4d8c8df06e4c04ad53ac25013d8a78 [term 2 LEADER]: Becoming Leader. State: Replica: ee4d8c8df06e4c04ad53ac25013d8a78, State: Running, Role: LEADER
I20260709 13:09:03.454635 29332 consensus_queue.cc:237] T 4b9944472adf4cec929d98a95851bef9 P ee4d8c8df06e4c04ad53ac25013d8a78 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0284f1db8c204657b7b423bab5b2eb4f" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 39279 } } peers { permanent_uuid: "ee4d8c8df06e4c04ad53ac25013d8a78" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 41821 } } peers { permanent_uuid: "e3fc42b9680245f3b66db70446830a2f" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 39203 } }
I20260709 13:09:03.461170 28797 catalog_manager.cc:5697] T 4b9944472adf4cec929d98a95851bef9 P ee4d8c8df06e4c04ad53ac25013d8a78 reported cstate change: term changed from 1 to 2, leader changed from e3fc42b9680245f3b66db70446830a2f (127.17.223.3) to ee4d8c8df06e4c04ad53ac25013d8a78 (127.17.223.2). New cstate: current_term: 2 leader_uuid: "ee4d8c8df06e4c04ad53ac25013d8a78" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0284f1db8c204657b7b423bab5b2eb4f" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 39279 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ee4d8c8df06e4c04ad53ac25013d8a78" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 41821 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e3fc42b9680245f3b66db70446830a2f" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 39203 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:03.500056 29172 raft_consensus.cc:993] T 451e3f8929ef4287a9eaa8941486e9cc P e3fc42b9680245f3b66db70446830a2f: : Instructing follower ee4d8c8df06e4c04ad53ac25013d8a78 to start an election
I20260709 13:09:03.500515 29301 raft_consensus.cc:1081] T 451e3f8929ef4287a9eaa8941486e9cc P e3fc42b9680245f3b66db70446830a2f [term 2 LEADER]: Signalling peer ee4d8c8df06e4c04ad53ac25013d8a78 to start an election
I20260709 13:09:03.501929 28972 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "451e3f8929ef4287a9eaa8941486e9cc"
dest_uuid: "ee4d8c8df06e4c04ad53ac25013d8a78"
 from {username='slave'} at 127.0.0.1:60700
I20260709 13:09:03.502442 28972 raft_consensus.cc:493] T 451e3f8929ef4287a9eaa8941486e9cc P ee4d8c8df06e4c04ad53ac25013d8a78 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:09:03.502765 28972 raft_consensus.cc:3060] T 451e3f8929ef4287a9eaa8941486e9cc P ee4d8c8df06e4c04ad53ac25013d8a78 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:03.507529 28972 raft_consensus.cc:515] T 451e3f8929ef4287a9eaa8941486e9cc P ee4d8c8df06e4c04ad53ac25013d8a78 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0284f1db8c204657b7b423bab5b2eb4f" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 39279 } } peers { permanent_uuid: "ee4d8c8df06e4c04ad53ac25013d8a78" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 41821 } } peers { permanent_uuid: "e3fc42b9680245f3b66db70446830a2f" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 39203 } }
I20260709 13:09:03.508960 28972 leader_election.cc:290] T 451e3f8929ef4287a9eaa8941486e9cc P ee4d8c8df06e4c04ad53ac25013d8a78 [CANDIDATE]: Term 3 election: Requested vote from peers 0284f1db8c204657b7b423bab5b2eb4f (127.17.223.1:39279), e3fc42b9680245f3b66db70446830a2f (127.17.223.3:39203)
I20260709 13:09:03.509959 29241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "451e3f8929ef4287a9eaa8941486e9cc" candidate_uuid: "ee4d8c8df06e4c04ad53ac25013d8a78" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: true dest_uuid: "0284f1db8c204657b7b423bab5b2eb4f"
I20260709 13:09:03.510219 29047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "451e3f8929ef4287a9eaa8941486e9cc" candidate_uuid: "ee4d8c8df06e4c04ad53ac25013d8a78" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: true dest_uuid: "e3fc42b9680245f3b66db70446830a2f"
I20260709 13:09:03.510703 29241 raft_consensus.cc:3060] T 451e3f8929ef4287a9eaa8941486e9cc P 0284f1db8c204657b7b423bab5b2eb4f [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:03.510816 29047 raft_consensus.cc:3055] T 451e3f8929ef4287a9eaa8941486e9cc P e3fc42b9680245f3b66db70446830a2f [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:09:03.511240 29047 raft_consensus.cc:740] T 451e3f8929ef4287a9eaa8941486e9cc P e3fc42b9680245f3b66db70446830a2f [term 2 LEADER]: Becoming Follower/Learner. State: Replica: e3fc42b9680245f3b66db70446830a2f, State: Running, Role: LEADER
I20260709 13:09:03.512112 29047 consensus_queue.cc:260] T 451e3f8929ef4287a9eaa8941486e9cc P e3fc42b9680245f3b66db70446830a2f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0284f1db8c204657b7b423bab5b2eb4f" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 39279 } } peers { permanent_uuid: "ee4d8c8df06e4c04ad53ac25013d8a78" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 41821 } } peers { permanent_uuid: "e3fc42b9680245f3b66db70446830a2f" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 39203 } }
I20260709 13:09:03.513399 29047 raft_consensus.cc:3060] T 451e3f8929ef4287a9eaa8941486e9cc P e3fc42b9680245f3b66db70446830a2f [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:03.518172 29241 raft_consensus.cc:2468] T 451e3f8929ef4287a9eaa8941486e9cc P 0284f1db8c204657b7b423bab5b2eb4f [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee4d8c8df06e4c04ad53ac25013d8a78 in term 3.
I20260709 13:09:03.519186 29190 raft_consensus.cc:993] T 2b38eb974fe54bb6a799876978d3ba4c P ee4d8c8df06e4c04ad53ac25013d8a78: : Instructing follower e3fc42b9680245f3b66db70446830a2f to start an election
I20260709 13:09:03.519752 29332 raft_consensus.cc:1081] T 2b38eb974fe54bb6a799876978d3ba4c P ee4d8c8df06e4c04ad53ac25013d8a78 [term 1 LEADER]: Signalling peer e3fc42b9680245f3b66db70446830a2f to start an election
I20260709 13:09:03.519743 28938 leader_election.cc:304] T 451e3f8929ef4287a9eaa8941486e9cc P ee4d8c8df06e4c04ad53ac25013d8a78 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0284f1db8c204657b7b423bab5b2eb4f, ee4d8c8df06e4c04ad53ac25013d8a78; no voters: 
I20260709 13:09:03.520684 29190 raft_consensus.cc:2804] T 451e3f8929ef4287a9eaa8941486e9cc P ee4d8c8df06e4c04ad53ac25013d8a78 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:09:03.521013 29047 raft_consensus.cc:2468] T 451e3f8929ef4287a9eaa8941486e9cc P e3fc42b9680245f3b66db70446830a2f [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee4d8c8df06e4c04ad53ac25013d8a78 in term 3.
I20260709 13:09:03.521095 29190 raft_consensus.cc:697] T 451e3f8929ef4287a9eaa8941486e9cc P ee4d8c8df06e4c04ad53ac25013d8a78 [term 3 LEADER]: Becoming Leader. State: Replica: ee4d8c8df06e4c04ad53ac25013d8a78, State: Running, Role: LEADER
I20260709 13:09:03.521534 29048 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "2b38eb974fe54bb6a799876978d3ba4c"
dest_uuid: "e3fc42b9680245f3b66db70446830a2f"
 from {username='slave'} at 127.0.0.1:38528
I20260709 13:09:03.522176 29048 raft_consensus.cc:493] T 2b38eb974fe54bb6a799876978d3ba4c P e3fc42b9680245f3b66db70446830a2f [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:09:03.522500 29048 raft_consensus.cc:3060] T 2b38eb974fe54bb6a799876978d3ba4c P e3fc42b9680245f3b66db70446830a2f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:03.522383 29190 consensus_queue.cc:237] T 451e3f8929ef4287a9eaa8941486e9cc P ee4d8c8df06e4c04ad53ac25013d8a78 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0284f1db8c204657b7b423bab5b2eb4f" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 39279 } } peers { permanent_uuid: "ee4d8c8df06e4c04ad53ac25013d8a78" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 41821 } } peers { permanent_uuid: "e3fc42b9680245f3b66db70446830a2f" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 39203 } }
I20260709 13:09:03.528263 29048 raft_consensus.cc:515] T 2b38eb974fe54bb6a799876978d3ba4c P e3fc42b9680245f3b66db70446830a2f [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee4d8c8df06e4c04ad53ac25013d8a78" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 41821 } } peers { permanent_uuid: "e3fc42b9680245f3b66db70446830a2f" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 39203 } } peers { permanent_uuid: "0284f1db8c204657b7b423bab5b2eb4f" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 39279 } }
I20260709 13:09:03.530063 29048 leader_election.cc:290] T 2b38eb974fe54bb6a799876978d3ba4c P e3fc42b9680245f3b66db70446830a2f [CANDIDATE]: Term 2 election: Requested vote from peers ee4d8c8df06e4c04ad53ac25013d8a78 (127.17.223.2:41821), 0284f1db8c204657b7b423bab5b2eb4f (127.17.223.1:39279)
I20260709 13:09:03.530041 28797 catalog_manager.cc:5697] T 451e3f8929ef4287a9eaa8941486e9cc P ee4d8c8df06e4c04ad53ac25013d8a78 reported cstate change: term changed from 2 to 3, leader changed from e3fc42b9680245f3b66db70446830a2f (127.17.223.3) to ee4d8c8df06e4c04ad53ac25013d8a78 (127.17.223.2). New cstate: current_term: 3 leader_uuid: "ee4d8c8df06e4c04ad53ac25013d8a78" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0284f1db8c204657b7b423bab5b2eb4f" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 39279 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ee4d8c8df06e4c04ad53ac25013d8a78" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 41821 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e3fc42b9680245f3b66db70446830a2f" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 39203 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:03.531519 28973 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b38eb974fe54bb6a799876978d3ba4c" candidate_uuid: "e3fc42b9680245f3b66db70446830a2f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ee4d8c8df06e4c04ad53ac25013d8a78"
I20260709 13:09:03.532290 28973 raft_consensus.cc:3055] T 2b38eb974fe54bb6a799876978d3ba4c P ee4d8c8df06e4c04ad53ac25013d8a78 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:09:03.532588 28973 raft_consensus.cc:740] T 2b38eb974fe54bb6a799876978d3ba4c P ee4d8c8df06e4c04ad53ac25013d8a78 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ee4d8c8df06e4c04ad53ac25013d8a78, State: Running, Role: LEADER
I20260709 13:09:03.533926 29241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b38eb974fe54bb6a799876978d3ba4c" candidate_uuid: "e3fc42b9680245f3b66db70446830a2f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0284f1db8c204657b7b423bab5b2eb4f"
I20260709 13:09:03.533474 28973 consensus_queue.cc:260] T 2b38eb974fe54bb6a799876978d3ba4c P ee4d8c8df06e4c04ad53ac25013d8a78 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee4d8c8df06e4c04ad53ac25013d8a78" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 41821 } } peers { permanent_uuid: "e3fc42b9680245f3b66db70446830a2f" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 39203 } } peers { permanent_uuid: "0284f1db8c204657b7b423bab5b2eb4f" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 39279 } }
I20260709 13:09:03.534533 29241 raft_consensus.cc:3060] T 2b38eb974fe54bb6a799876978d3ba4c P 0284f1db8c204657b7b423bab5b2eb4f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:03.535174 28973 raft_consensus.cc:3060] T 2b38eb974fe54bb6a799876978d3ba4c P ee4d8c8df06e4c04ad53ac25013d8a78 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:03.541694 29241 raft_consensus.cc:2468] T 2b38eb974fe54bb6a799876978d3ba4c P 0284f1db8c204657b7b423bab5b2eb4f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3fc42b9680245f3b66db70446830a2f in term 2.
I20260709 13:09:03.541873 28973 raft_consensus.cc:2468] T 2b38eb974fe54bb6a799876978d3ba4c P ee4d8c8df06e4c04ad53ac25013d8a78 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3fc42b9680245f3b66db70446830a2f in term 2.
I20260709 13:09:03.542868 29012 leader_election.cc:304] T 2b38eb974fe54bb6a799876978d3ba4c P e3fc42b9680245f3b66db70446830a2f [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0284f1db8c204657b7b423bab5b2eb4f, e3fc42b9680245f3b66db70446830a2f; no voters: 
I20260709 13:09:03.543464 29301 raft_consensus.cc:2804] T 2b38eb974fe54bb6a799876978d3ba4c P e3fc42b9680245f3b66db70446830a2f [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:09:03.543898 29301 raft_consensus.cc:697] T 2b38eb974fe54bb6a799876978d3ba4c P e3fc42b9680245f3b66db70446830a2f [term 2 LEADER]: Becoming Leader. State: Replica: e3fc42b9680245f3b66db70446830a2f, State: Running, Role: LEADER
I20260709 13:09:03.544677 29301 consensus_queue.cc:237] T 2b38eb974fe54bb6a799876978d3ba4c P e3fc42b9680245f3b66db70446830a2f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee4d8c8df06e4c04ad53ac25013d8a78" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 41821 } } peers { permanent_uuid: "e3fc42b9680245f3b66db70446830a2f" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 39203 } } peers { permanent_uuid: "0284f1db8c204657b7b423bab5b2eb4f" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 39279 } }
I20260709 13:09:03.551061 28797 catalog_manager.cc:5697] T 2b38eb974fe54bb6a799876978d3ba4c P e3fc42b9680245f3b66db70446830a2f reported cstate change: term changed from 1 to 2, leader changed from ee4d8c8df06e4c04ad53ac25013d8a78 (127.17.223.2) to e3fc42b9680245f3b66db70446830a2f (127.17.223.3). New cstate: current_term: 2 leader_uuid: "e3fc42b9680245f3b66db70446830a2f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee4d8c8df06e4c04ad53ac25013d8a78" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 41821 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e3fc42b9680245f3b66db70446830a2f" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 39203 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0284f1db8c204657b7b423bab5b2eb4f" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 39279 } health_report { overall_health: UNKNOWN } } }
W20260709 13:09:03.828318 28845 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 13:09:03.903776 29048 raft_consensus.cc:1275] T 4b9944472adf4cec929d98a95851bef9 P e3fc42b9680245f3b66db70446830a2f [term 2 FOLLOWER]: Refusing update from remote peer ee4d8c8df06e4c04ad53ac25013d8a78: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:03.905184 29190 consensus_queue.cc:1048] T 4b9944472adf4cec929d98a95851bef9 P ee4d8c8df06e4c04ad53ac25013d8a78 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3fc42b9680245f3b66db70446830a2f" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 39203 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:09:03.915783 29241 raft_consensus.cc:1275] T 4b9944472adf4cec929d98a95851bef9 P 0284f1db8c204657b7b423bab5b2eb4f [term 2 FOLLOWER]: Refusing update from remote peer ee4d8c8df06e4c04ad53ac25013d8a78: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:03.917095 29190 consensus_queue.cc:1048] T 4b9944472adf4cec929d98a95851bef9 P ee4d8c8df06e4c04ad53ac25013d8a78 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0284f1db8c204657b7b423bab5b2eb4f" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 39279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:09:03.929870 29241 raft_consensus.cc:1275] T 451e3f8929ef4287a9eaa8941486e9cc P 0284f1db8c204657b7b423bab5b2eb4f [term 3 FOLLOWER]: Refusing update from remote peer ee4d8c8df06e4c04ad53ac25013d8a78: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:09:03.931203 29190 consensus_queue.cc:1048] T 451e3f8929ef4287a9eaa8941486e9cc P ee4d8c8df06e4c04ad53ac25013d8a78 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0284f1db8c204657b7b423bab5b2eb4f" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 39279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:09:03.941474 29048 raft_consensus.cc:1275] T 451e3f8929ef4287a9eaa8941486e9cc P e3fc42b9680245f3b66db70446830a2f [term 3 FOLLOWER]: Refusing update from remote peer ee4d8c8df06e4c04ad53ac25013d8a78: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:09:03.942974 29190 consensus_queue.cc:1048] T 451e3f8929ef4287a9eaa8941486e9cc P ee4d8c8df06e4c04ad53ac25013d8a78 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3fc42b9680245f3b66db70446830a2f" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 39203 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:09:03.978874 29241 raft_consensus.cc:1275] T 2b38eb974fe54bb6a799876978d3ba4c P 0284f1db8c204657b7b423bab5b2eb4f [term 2 FOLLOWER]: Refusing update from remote peer e3fc42b9680245f3b66db70446830a2f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:03.980310 29301 consensus_queue.cc:1048] T 2b38eb974fe54bb6a799876978d3ba4c P e3fc42b9680245f3b66db70446830a2f [LEADER]: Connected to new peer: Peer: permanent_uuid: "0284f1db8c204657b7b423bab5b2eb4f" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 39279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:09:03.990346 28973 raft_consensus.cc:1275] T 2b38eb974fe54bb6a799876978d3ba4c P ee4d8c8df06e4c04ad53ac25013d8a78 [term 2 FOLLOWER]: Refusing update from remote peer e3fc42b9680245f3b66db70446830a2f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:03.991827 29172 consensus_queue.cc:1048] T 2b38eb974fe54bb6a799876978d3ba4c P e3fc42b9680245f3b66db70446830a2f [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee4d8c8df06e4c04ad53ac25013d8a78" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 41821 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:09:04.136421 18300 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:09:04.144603 28973 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0dfbae90dbc4407a9e01872b7d688d55"
dest_uuid: "ee4d8c8df06e4c04ad53ac25013d8a78"
mode: GRACEFUL
new_leader_uuid: "e3fc42b9680245f3b66db70446830a2f"
 from {username='slave'} at 127.0.0.1:60718
I20260709 13:09:04.145105 28973 raft_consensus.cc:606] T 0dfbae90dbc4407a9e01872b7d688d55 P ee4d8c8df06e4c04ad53ac25013d8a78 [term 3 LEADER]: Received request to transfer leadership to TS e3fc42b9680245f3b66db70446830a2f
I20260709 13:09:04.147620 28973 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5d6b9266d4e74616b08d4e9697a83924"
dest_uuid: "ee4d8c8df06e4c04ad53ac25013d8a78"
mode: GRACEFUL
new_leader_uuid: "e3fc42b9680245f3b66db70446830a2f"
 from {username='slave'} at 127.0.0.1:60718
I20260709 13:09:04.148065 28973 raft_consensus.cc:606] T 5d6b9266d4e74616b08d4e9697a83924 P ee4d8c8df06e4c04ad53ac25013d8a78 [term 2 LEADER]: Received request to transfer leadership to TS e3fc42b9680245f3b66db70446830a2f
I20260709 13:09:04.150311 29047 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "777f2e0112c34108b367c8a2ad2641e1"
dest_uuid: "e3fc42b9680245f3b66db70446830a2f"
mode: GRACEFUL
new_leader_uuid: "ee4d8c8df06e4c04ad53ac25013d8a78"
 from {username='slave'} at 127.0.0.1:38536
I20260709 13:09:04.150820 29047 raft_consensus.cc:606] T 777f2e0112c34108b367c8a2ad2641e1 P e3fc42b9680245f3b66db70446830a2f [term 4 LEADER]: Received request to transfer leadership to TS ee4d8c8df06e4c04ad53ac25013d8a78
I20260709 13:09:04.151981 18300 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 13:09:04.152455 18300 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:09:04.153127 18300 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:09:04.481737 29352 raft_consensus.cc:993] T 777f2e0112c34108b367c8a2ad2641e1 P e3fc42b9680245f3b66db70446830a2f: : Instructing follower ee4d8c8df06e4c04ad53ac25013d8a78 to start an election
I20260709 13:09:04.482187 29352 raft_consensus.cc:1081] T 777f2e0112c34108b367c8a2ad2641e1 P e3fc42b9680245f3b66db70446830a2f [term 4 LEADER]: Signalling peer ee4d8c8df06e4c04ad53ac25013d8a78 to start an election
I20260709 13:09:04.483623 28972 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "777f2e0112c34108b367c8a2ad2641e1"
dest_uuid: "ee4d8c8df06e4c04ad53ac25013d8a78"
 from {username='slave'} at 127.0.0.1:60700
I20260709 13:09:04.484081 28972 raft_consensus.cc:493] T 777f2e0112c34108b367c8a2ad2641e1 P ee4d8c8df06e4c04ad53ac25013d8a78 [term 4 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:09:04.484336 28972 raft_consensus.cc:3060] T 777f2e0112c34108b367c8a2ad2641e1 P ee4d8c8df06e4c04ad53ac25013d8a78 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:09:04.489593 28972 raft_consensus.cc:515] T 777f2e0112c34108b367c8a2ad2641e1 P ee4d8c8df06e4c04ad53ac25013d8a78 [term 5 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0284f1db8c204657b7b423bab5b2eb4f" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 39279 } } peers { permanent_uuid: "ee4d8c8df06e4c04ad53ac25013d8a78" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 41821 } } peers { permanent_uuid: "e3fc42b9680245f3b66db70446830a2f" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 39203 } }
I20260709 13:09:04.491252 28972 leader_election.cc:290] T 777f2e0112c34108b367c8a2ad2641e1 P ee4d8c8df06e4c04ad53ac25013d8a78 [CANDIDATE]: Term 5 election: Requested vote from peers 0284f1db8c204657b7b423bab5b2eb4f (127.17.223.1:39279), e3fc42b9680245f3b66db70446830a2f (127.17.223.3:39203)
I20260709 13:09:04.492456 29047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "777f2e0112c34108b367c8a2ad2641e1" candidate_uuid: "ee4d8c8df06e4c04ad53ac25013d8a78" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: true dest_uuid: "e3fc42b9680245f3b66db70446830a2f"
I20260709 13:09:04.492780 29355 raft_consensus.cc:993] T 0dfbae90dbc4407a9e01872b7d688d55 P ee4d8c8df06e4c04ad53ac25013d8a78: : Instructing follower e3fc42b9680245f3b66db70446830a2f to start an election
I20260709 13:09:04.492517 29242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "777f2e0112c34108b367c8a2ad2641e1" candidate_uuid: "ee4d8c8df06e4c04ad53ac25013d8a78" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: true dest_uuid: "0284f1db8c204657b7b423bab5b2eb4f"
I20260709 13:09:04.493327 29047 raft_consensus.cc:3055] T 777f2e0112c34108b367c8a2ad2641e1 P e3fc42b9680245f3b66db70446830a2f [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:09:04.495118 29047 raft_consensus.cc:740] T 777f2e0112c34108b367c8a2ad2641e1 P e3fc42b9680245f3b66db70446830a2f [term 4 LEADER]: Becoming Follower/Learner. State: Replica: e3fc42b9680245f3b66db70446830a2f, State: Running, Role: LEADER
I20260709 13:09:04.495142 29190 raft_consensus.cc:1081] T 0dfbae90dbc4407a9e01872b7d688d55 P ee4d8c8df06e4c04ad53ac25013d8a78 [term 3 LEADER]: Signalling peer e3fc42b9680245f3b66db70446830a2f to start an election
I20260709 13:09:04.496191 29047 consensus_queue.cc:260] T 777f2e0112c34108b367c8a2ad2641e1 P e3fc42b9680245f3b66db70446830a2f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0284f1db8c204657b7b423bab5b2eb4f" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 39279 } } peers { permanent_uuid: "ee4d8c8df06e4c04ad53ac25013d8a78" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 41821 } } peers { permanent_uuid: "e3fc42b9680245f3b66db70446830a2f" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 39203 } }
I20260709 13:09:04.496712 29242 raft_consensus.cc:3060] T 777f2e0112c34108b367c8a2ad2641e1 P 0284f1db8c204657b7b423bab5b2eb4f [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:09:04.497282 29048 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "0dfbae90dbc4407a9e01872b7d688d55"
dest_uuid: "e3fc42b9680245f3b66db70446830a2f"
 from {username='slave'} at 127.0.0.1:38528
I20260709 13:09:04.497668 29047 raft_consensus.cc:3060] T 777f2e0112c34108b367c8a2ad2641e1 P e3fc42b9680245f3b66db70446830a2f [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:09:04.497902 29048 raft_consensus.cc:493] T 0dfbae90dbc4407a9e01872b7d688d55 P e3fc42b9680245f3b66db70446830a2f [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:09:04.498337 29048 raft_consensus.cc:3060] T 0dfbae90dbc4407a9e01872b7d688d55 P e3fc42b9680245f3b66db70446830a2f [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:09:04.502760 29242 raft_consensus.cc:2468] T 777f2e0112c34108b367c8a2ad2641e1 P 0284f1db8c204657b7b423bab5b2eb4f [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee4d8c8df06e4c04ad53ac25013d8a78 in term 5.
I20260709 13:09:04.504066 28938 leader_election.cc:304] T 777f2e0112c34108b367c8a2ad2641e1 P ee4d8c8df06e4c04ad53ac25013d8a78 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0284f1db8c204657b7b423bab5b2eb4f, ee4d8c8df06e4c04ad53ac25013d8a78; no voters: 
I20260709 13:09:04.504786 29190 raft_consensus.cc:2804] T 777f2e0112c34108b367c8a2ad2641e1 P ee4d8c8df06e4c04ad53ac25013d8a78 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:09:04.505270 29190 raft_consensus.cc:697] T 777f2e0112c34108b367c8a2ad2641e1 P ee4d8c8df06e4c04ad53ac25013d8a78 [term 5 LEADER]: Becoming Leader. State: Replica: ee4d8c8df06e4c04ad53ac25013d8a78, State: Running, Role: LEADER
I20260709 13:09:04.505339 29047 raft_consensus.cc:2468] T 777f2e0112c34108b367c8a2ad2641e1 P e3fc42b9680245f3b66db70446830a2f [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee4d8c8df06e4c04ad53ac25013d8a78 in term 5.
I20260709 13:09:04.506026 29048 raft_consensus.cc:515] T 0dfbae90dbc4407a9e01872b7d688d55 P e3fc42b9680245f3b66db70446830a2f [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0284f1db8c204657b7b423bab5b2eb4f" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 39279 } } peers { permanent_uuid: "ee4d8c8df06e4c04ad53ac25013d8a78" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 41821 } } peers { permanent_uuid: "e3fc42b9680245f3b66db70446830a2f" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 39203 } }
I20260709 13:09:04.506332 29190 consensus_queue.cc:237] T 777f2e0112c34108b367c8a2ad2641e1 P ee4d8c8df06e4c04ad53ac25013d8a78 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0284f1db8c204657b7b423bab5b2eb4f" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 39279 } } peers { permanent_uuid: "ee4d8c8df06e4c04ad53ac25013d8a78" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 41821 } } peers { permanent_uuid: "e3fc42b9680245f3b66db70446830a2f" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 39203 } }
I20260709 13:09:04.507949 29048 leader_election.cc:290] T 0dfbae90dbc4407a9e01872b7d688d55 P e3fc42b9680245f3b66db70446830a2f [CANDIDATE]: Term 4 election: Requested vote from peers 0284f1db8c204657b7b423bab5b2eb4f (127.17.223.1:39279), ee4d8c8df06e4c04ad53ac25013d8a78 (127.17.223.2:41821)
I20260709 13:09:04.508800 29242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0dfbae90dbc4407a9e01872b7d688d55" candidate_uuid: "e3fc42b9680245f3b66db70446830a2f" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: true dest_uuid: "0284f1db8c204657b7b423bab5b2eb4f"
I20260709 13:09:04.509044 28972 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0dfbae90dbc4407a9e01872b7d688d55" candidate_uuid: "e3fc42b9680245f3b66db70446830a2f" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: true dest_uuid: "ee4d8c8df06e4c04ad53ac25013d8a78"
I20260709 13:09:04.509806 29242 raft_consensus.cc:3060] T 0dfbae90dbc4407a9e01872b7d688d55 P 0284f1db8c204657b7b423bab5b2eb4f [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:09:04.509889 28972 raft_consensus.cc:3055] T 0dfbae90dbc4407a9e01872b7d688d55 P ee4d8c8df06e4c04ad53ac25013d8a78 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:09:04.510632 28972 raft_consensus.cc:740] T 0dfbae90dbc4407a9e01872b7d688d55 P ee4d8c8df06e4c04ad53ac25013d8a78 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: ee4d8c8df06e4c04ad53ac25013d8a78, State: Running, Role: LEADER
I20260709 13:09:04.511757 28972 consensus_queue.cc:260] T 0dfbae90dbc4407a9e01872b7d688d55 P ee4d8c8df06e4c04ad53ac25013d8a78 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0284f1db8c204657b7b423bab5b2eb4f" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 39279 } } peers { permanent_uuid: "ee4d8c8df06e4c04ad53ac25013d8a78" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 41821 } } peers { permanent_uuid: "e3fc42b9680245f3b66db70446830a2f" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 39203 } }
I20260709 13:09:04.513414 28972 raft_consensus.cc:3060] T 0dfbae90dbc4407a9e01872b7d688d55 P ee4d8c8df06e4c04ad53ac25013d8a78 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:09:04.515368 28797 catalog_manager.cc:5697] T 777f2e0112c34108b367c8a2ad2641e1 P ee4d8c8df06e4c04ad53ac25013d8a78 reported cstate change: term changed from 4 to 5, leader changed from e3fc42b9680245f3b66db70446830a2f (127.17.223.3) to ee4d8c8df06e4c04ad53ac25013d8a78 (127.17.223.2). New cstate: current_term: 5 leader_uuid: "ee4d8c8df06e4c04ad53ac25013d8a78" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0284f1db8c204657b7b423bab5b2eb4f" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 39279 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ee4d8c8df06e4c04ad53ac25013d8a78" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 41821 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e3fc42b9680245f3b66db70446830a2f" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 39203 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:04.517522 29242 raft_consensus.cc:2468] T 0dfbae90dbc4407a9e01872b7d688d55 P 0284f1db8c204657b7b423bab5b2eb4f [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3fc42b9680245f3b66db70446830a2f in term 4.
I20260709 13:09:04.518723 28972 raft_consensus.cc:2468] T 0dfbae90dbc4407a9e01872b7d688d55 P ee4d8c8df06e4c04ad53ac25013d8a78 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3fc42b9680245f3b66db70446830a2f in term 4.
I20260709 13:09:04.518852 29012 leader_election.cc:304] T 0dfbae90dbc4407a9e01872b7d688d55 P e3fc42b9680245f3b66db70446830a2f [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0284f1db8c204657b7b423bab5b2eb4f, e3fc42b9680245f3b66db70446830a2f; no voters: 
I20260709 13:09:04.519924 29352 raft_consensus.cc:2804] T 0dfbae90dbc4407a9e01872b7d688d55 P e3fc42b9680245f3b66db70446830a2f [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:09:04.520443 29352 raft_consensus.cc:697] T 0dfbae90dbc4407a9e01872b7d688d55 P e3fc42b9680245f3b66db70446830a2f [term 4 LEADER]: Becoming Leader. State: Replica: e3fc42b9680245f3b66db70446830a2f, State: Running, Role: LEADER
I20260709 13:09:04.521503 29352 consensus_queue.cc:237] T 0dfbae90dbc4407a9e01872b7d688d55 P e3fc42b9680245f3b66db70446830a2f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0284f1db8c204657b7b423bab5b2eb4f" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 39279 } } peers { permanent_uuid: "ee4d8c8df06e4c04ad53ac25013d8a78" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 41821 } } peers { permanent_uuid: "e3fc42b9680245f3b66db70446830a2f" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 39203 } }
I20260709 13:09:04.530941 28797 catalog_manager.cc:5697] T 0dfbae90dbc4407a9e01872b7d688d55 P e3fc42b9680245f3b66db70446830a2f reported cstate change: term changed from 3 to 4, leader changed from ee4d8c8df06e4c04ad53ac25013d8a78 (127.17.223.2) to e3fc42b9680245f3b66db70446830a2f (127.17.223.3). New cstate: current_term: 4 leader_uuid: "e3fc42b9680245f3b66db70446830a2f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0284f1db8c204657b7b423bab5b2eb4f" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 39279 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ee4d8c8df06e4c04ad53ac25013d8a78" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 41821 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e3fc42b9680245f3b66db70446830a2f" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 39203 } health_report { overall_health: HEALTHY } } }
I20260709 13:09:04.624933 29354 raft_consensus.cc:993] T 5d6b9266d4e74616b08d4e9697a83924 P ee4d8c8df06e4c04ad53ac25013d8a78: : Instructing follower e3fc42b9680245f3b66db70446830a2f to start an election
I20260709 13:09:04.625382 29190 raft_consensus.cc:1081] T 5d6b9266d4e74616b08d4e9697a83924 P ee4d8c8df06e4c04ad53ac25013d8a78 [term 2 LEADER]: Signalling peer e3fc42b9680245f3b66db70446830a2f to start an election
I20260709 13:09:04.626776 29048 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "5d6b9266d4e74616b08d4e9697a83924"
dest_uuid: "e3fc42b9680245f3b66db70446830a2f"
 from {username='slave'} at 127.0.0.1:38528
I20260709 13:09:04.627171 29048 raft_consensus.cc:493] T 5d6b9266d4e74616b08d4e9697a83924 P e3fc42b9680245f3b66db70446830a2f [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:09:04.627406 29048 raft_consensus.cc:3060] T 5d6b9266d4e74616b08d4e9697a83924 P e3fc42b9680245f3b66db70446830a2f [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:04.631963 29048 raft_consensus.cc:515] T 5d6b9266d4e74616b08d4e9697a83924 P e3fc42b9680245f3b66db70446830a2f [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0284f1db8c204657b7b423bab5b2eb4f" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 39279 } } peers { permanent_uuid: "ee4d8c8df06e4c04ad53ac25013d8a78" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 41821 } } peers { permanent_uuid: "e3fc42b9680245f3b66db70446830a2f" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 39203 } }
I20260709 13:09:04.633278 29048 leader_election.cc:290] T 5d6b9266d4e74616b08d4e9697a83924 P e3fc42b9680245f3b66db70446830a2f [CANDIDATE]: Term 3 election: Requested vote from peers 0284f1db8c204657b7b423bab5b2eb4f (127.17.223.1:39279), ee4d8c8df06e4c04ad53ac25013d8a78 (127.17.223.2:41821)
I20260709 13:09:04.634163 29242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d6b9266d4e74616b08d4e9697a83924" candidate_uuid: "e3fc42b9680245f3b66db70446830a2f" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: true dest_uuid: "0284f1db8c204657b7b423bab5b2eb4f"
I20260709 13:09:04.634384 28972 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d6b9266d4e74616b08d4e9697a83924" candidate_uuid: "e3fc42b9680245f3b66db70446830a2f" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: true dest_uuid: "ee4d8c8df06e4c04ad53ac25013d8a78"
I20260709 13:09:04.634891 29242 raft_consensus.cc:3060] T 5d6b9266d4e74616b08d4e9697a83924 P 0284f1db8c204657b7b423bab5b2eb4f [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:04.634967 28972 raft_consensus.cc:3055] T 5d6b9266d4e74616b08d4e9697a83924 P ee4d8c8df06e4c04ad53ac25013d8a78 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:09:04.635367 28972 raft_consensus.cc:740] T 5d6b9266d4e74616b08d4e9697a83924 P ee4d8c8df06e4c04ad53ac25013d8a78 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: ee4d8c8df06e4c04ad53ac25013d8a78, State: Running, Role: LEADER
I20260709 13:09:04.635982 28972 consensus_queue.cc:260] T 5d6b9266d4e74616b08d4e9697a83924 P ee4d8c8df06e4c04ad53ac25013d8a78 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0284f1db8c204657b7b423bab5b2eb4f" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 39279 } } peers { permanent_uuid: "ee4d8c8df06e4c04ad53ac25013d8a78" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 41821 } } peers { permanent_uuid: "e3fc42b9680245f3b66db70446830a2f" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 39203 } }
I20260709 13:09:04.636935 28972 raft_consensus.cc:3060] T 5d6b9266d4e74616b08d4e9697a83924 P ee4d8c8df06e4c04ad53ac25013d8a78 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:04.640600 29242 raft_consensus.cc:2468] T 5d6b9266d4e74616b08d4e9697a83924 P 0284f1db8c204657b7b423bab5b2eb4f [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3fc42b9680245f3b66db70446830a2f in term 3.
I20260709 13:09:04.641479 28972 raft_consensus.cc:2468] T 5d6b9266d4e74616b08d4e9697a83924 P ee4d8c8df06e4c04ad53ac25013d8a78 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3fc42b9680245f3b66db70446830a2f in term 3.
I20260709 13:09:04.641772 29012 leader_election.cc:304] T 5d6b9266d4e74616b08d4e9697a83924 P e3fc42b9680245f3b66db70446830a2f [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0284f1db8c204657b7b423bab5b2eb4f, e3fc42b9680245f3b66db70446830a2f; no voters: 
I20260709 13:09:04.642537 29352 raft_consensus.cc:2804] T 5d6b9266d4e74616b08d4e9697a83924 P e3fc42b9680245f3b66db70446830a2f [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:09:04.643004 29352 raft_consensus.cc:697] T 5d6b9266d4e74616b08d4e9697a83924 P e3fc42b9680245f3b66db70446830a2f [term 3 LEADER]: Becoming Leader. State: Replica: e3fc42b9680245f3b66db70446830a2f, State: Running, Role: LEADER
I20260709 13:09:04.643827 29352 consensus_queue.cc:237] T 5d6b9266d4e74616b08d4e9697a83924 P e3fc42b9680245f3b66db70446830a2f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0284f1db8c204657b7b423bab5b2eb4f" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 39279 } } peers { permanent_uuid: "ee4d8c8df06e4c04ad53ac25013d8a78" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 41821 } } peers { permanent_uuid: "e3fc42b9680245f3b66db70446830a2f" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 39203 } }
I20260709 13:09:04.650928 28797 catalog_manager.cc:5697] T 5d6b9266d4e74616b08d4e9697a83924 P e3fc42b9680245f3b66db70446830a2f reported cstate change: term changed from 2 to 3, leader changed from ee4d8c8df06e4c04ad53ac25013d8a78 (127.17.223.2) to e3fc42b9680245f3b66db70446830a2f (127.17.223.3). New cstate: current_term: 3 leader_uuid: "e3fc42b9680245f3b66db70446830a2f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0284f1db8c204657b7b423bab5b2eb4f" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 39279 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ee4d8c8df06e4c04ad53ac25013d8a78" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 41821 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e3fc42b9680245f3b66db70446830a2f" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 39203 } health_report { overall_health: HEALTHY } } }
W20260709 13:09:04.829353 28845 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 13:09:04.923187 29242 raft_consensus.cc:1275] T 0dfbae90dbc4407a9e01872b7d688d55 P 0284f1db8c204657b7b423bab5b2eb4f [term 4 FOLLOWER]: Refusing update from remote peer e3fc42b9680245f3b66db70446830a2f: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:09:04.924996 29352 consensus_queue.cc:1048] T 0dfbae90dbc4407a9e01872b7d688d55 P e3fc42b9680245f3b66db70446830a2f [LEADER]: Connected to new peer: Peer: permanent_uuid: "0284f1db8c204657b7b423bab5b2eb4f" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 39279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:09:04.938266 28972 raft_consensus.cc:1275] T 0dfbae90dbc4407a9e01872b7d688d55 P ee4d8c8df06e4c04ad53ac25013d8a78 [term 4 FOLLOWER]: Refusing update from remote peer e3fc42b9680245f3b66db70446830a2f: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:09:04.940169 29172 consensus_queue.cc:1048] T 0dfbae90dbc4407a9e01872b7d688d55 P e3fc42b9680245f3b66db70446830a2f [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee4d8c8df06e4c04ad53ac25013d8a78" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 41821 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:09:05.019254 29048 raft_consensus.cc:1275] T 777f2e0112c34108b367c8a2ad2641e1 P e3fc42b9680245f3b66db70446830a2f [term 5 FOLLOWER]: Refusing update from remote peer ee4d8c8df06e4c04ad53ac25013d8a78: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 13:09:05.020394 29190 consensus_queue.cc:1048] T 777f2e0112c34108b367c8a2ad2641e1 P ee4d8c8df06e4c04ad53ac25013d8a78 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3fc42b9680245f3b66db70446830a2f" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 39203 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:09:05.030540 29242 raft_consensus.cc:1275] T 777f2e0112c34108b367c8a2ad2641e1 P 0284f1db8c204657b7b423bab5b2eb4f [term 5 FOLLOWER]: Refusing update from remote peer ee4d8c8df06e4c04ad53ac25013d8a78: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 13:09:05.031903 29355 consensus_queue.cc:1048] T 777f2e0112c34108b367c8a2ad2641e1 P ee4d8c8df06e4c04ad53ac25013d8a78 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0284f1db8c204657b7b423bab5b2eb4f" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 39279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:09:05.155547 29242 raft_consensus.cc:1275] T 5d6b9266d4e74616b08d4e9697a83924 P 0284f1db8c204657b7b423bab5b2eb4f [term 3 FOLLOWER]: Refusing update from remote peer e3fc42b9680245f3b66db70446830a2f: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:09:05.156833 29172 consensus_queue.cc:1048] T 5d6b9266d4e74616b08d4e9697a83924 P e3fc42b9680245f3b66db70446830a2f [LEADER]: Connected to new peer: Peer: permanent_uuid: "0284f1db8c204657b7b423bab5b2eb4f" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 39279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:09:05.159341 18300 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:09:05.165584 28972 raft_consensus.cc:1275] T 5d6b9266d4e74616b08d4e9697a83924 P ee4d8c8df06e4c04ad53ac25013d8a78 [term 3 FOLLOWER]: Refusing update from remote peer e3fc42b9680245f3b66db70446830a2f: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:09:05.167296 29301 consensus_queue.cc:1048] T 5d6b9266d4e74616b08d4e9697a83924 P e3fc42b9680245f3b66db70446830a2f [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee4d8c8df06e4c04ad53ac25013d8a78" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 41821 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:09:05.207011 18300 tablet_server.cc:179] TabletServer@127.17.223.1:39279 shutting down...
I20260709 13:09:05.229388 18300 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:09:05.230273 18300 tablet_replica.cc:333] stopping tablet replica
I20260709 13:09:05.231120 18300 raft_consensus.cc:2243] T 451e3f8929ef4287a9eaa8941486e9cc P 0284f1db8c204657b7b423bab5b2eb4f [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:05.231602 18300 raft_consensus.cc:2272] T 451e3f8929ef4287a9eaa8941486e9cc P 0284f1db8c204657b7b423bab5b2eb4f [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:05.233901 18300 tablet_replica.cc:333] stopping tablet replica
I20260709 13:09:05.234541 18300 raft_consensus.cc:2243] T 4b9944472adf4cec929d98a95851bef9 P 0284f1db8c204657b7b423bab5b2eb4f [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:05.235030 18300 raft_consensus.cc:2272] T 4b9944472adf4cec929d98a95851bef9 P 0284f1db8c204657b7b423bab5b2eb4f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:05.237244 18300 tablet_replica.cc:333] stopping tablet replica
I20260709 13:09:05.237871 18300 raft_consensus.cc:2243] T eb8f9bf7e0d24af88a04bda489298395 P 0284f1db8c204657b7b423bab5b2eb4f [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:05.238379 18300 raft_consensus.cc:2272] T eb8f9bf7e0d24af88a04bda489298395 P 0284f1db8c204657b7b423bab5b2eb4f [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:05.240545 18300 tablet_replica.cc:333] stopping tablet replica
I20260709 13:09:05.241156 18300 raft_consensus.cc:2243] T 777f2e0112c34108b367c8a2ad2641e1 P 0284f1db8c204657b7b423bab5b2eb4f [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:05.241614 18300 raft_consensus.cc:2272] T 777f2e0112c34108b367c8a2ad2641e1 P 0284f1db8c204657b7b423bab5b2eb4f [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:05.244349 18300 tablet_replica.cc:333] stopping tablet replica
I20260709 13:09:05.244997 18300 raft_consensus.cc:2243] T 0dfbae90dbc4407a9e01872b7d688d55 P 0284f1db8c204657b7b423bab5b2eb4f [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:05.245461 18300 raft_consensus.cc:2272] T 0dfbae90dbc4407a9e01872b7d688d55 P 0284f1db8c204657b7b423bab5b2eb4f [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:05.248195 18300 tablet_replica.cc:333] stopping tablet replica
I20260709 13:09:05.248733 18300 raft_consensus.cc:2243] T 5d6b9266d4e74616b08d4e9697a83924 P 0284f1db8c204657b7b423bab5b2eb4f [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:05.249167 18300 raft_consensus.cc:2272] T 5d6b9266d4e74616b08d4e9697a83924 P 0284f1db8c204657b7b423bab5b2eb4f [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:05.251988 18300 tablet_replica.cc:333] stopping tablet replica
I20260709 13:09:05.252713 18300 raft_consensus.cc:2243] T 7087f0eae49f4f71b5769071b817f8f2 P 0284f1db8c204657b7b423bab5b2eb4f [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:05.253271 18300 raft_consensus.cc:2272] T 7087f0eae49f4f71b5769071b817f8f2 P 0284f1db8c204657b7b423bab5b2eb4f [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:05.255894 18300 tablet_replica.cc:333] stopping tablet replica
I20260709 13:09:05.256377 18300 raft_consensus.cc:2243] T 9f5d8f2d6f684a5b9702935fc8fd85a1 P 0284f1db8c204657b7b423bab5b2eb4f [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:05.256747 18300 raft_consensus.cc:2272] T 9f5d8f2d6f684a5b9702935fc8fd85a1 P 0284f1db8c204657b7b423bab5b2eb4f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:05.258948 18300 tablet_replica.cc:333] stopping tablet replica
I20260709 13:09:05.259377 18300 raft_consensus.cc:2243] T 2b38eb974fe54bb6a799876978d3ba4c P 0284f1db8c204657b7b423bab5b2eb4f [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:05.259730 18300 raft_consensus.cc:2272] T 2b38eb974fe54bb6a799876978d3ba4c P 0284f1db8c204657b7b423bab5b2eb4f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:05.261652 18300 tablet_replica.cc:333] stopping tablet replica
I20260709 13:09:05.262045 18300 raft_consensus.cc:2243] T 879bbeb7e3244e8a8e5ee375c020cb16 P 0284f1db8c204657b7b423bab5b2eb4f [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:05.262394 18300 raft_consensus.cc:2272] T 879bbeb7e3244e8a8e5ee375c020cb16 P 0284f1db8c204657b7b423bab5b2eb4f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:05.292395 18300 tablet_server.cc:196] TabletServer@127.17.223.1:39279 shutdown complete.
I20260709 13:09:05.320817 18300 tablet_server.cc:179] TabletServer@127.17.223.2:0 shutting down...
I20260709 13:09:05.349289 18300 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:09:05.350049 18300 tablet_replica.cc:333] T 5d6b9266d4e74616b08d4e9697a83924 P ee4d8c8df06e4c04ad53ac25013d8a78: stopping tablet replica
I20260709 13:09:05.351168 18300 raft_consensus.cc:2243] T 5d6b9266d4e74616b08d4e9697a83924 P ee4d8c8df06e4c04ad53ac25013d8a78 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:05.351760 18300 raft_consensus.cc:2272] T 5d6b9266d4e74616b08d4e9697a83924 P ee4d8c8df06e4c04ad53ac25013d8a78 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:05.354657 18300 tablet_replica.cc:333] T 7087f0eae49f4f71b5769071b817f8f2 P ee4d8c8df06e4c04ad53ac25013d8a78: stopping tablet replica
I20260709 13:09:05.355244 18300 raft_consensus.cc:2243] T 7087f0eae49f4f71b5769071b817f8f2 P ee4d8c8df06e4c04ad53ac25013d8a78 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:05.355667 18300 raft_consensus.cc:2272] T 7087f0eae49f4f71b5769071b817f8f2 P ee4d8c8df06e4c04ad53ac25013d8a78 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:05.357779 18300 tablet_replica.cc:333] T 9f5d8f2d6f684a5b9702935fc8fd85a1 P ee4d8c8df06e4c04ad53ac25013d8a78: stopping tablet replica
I20260709 13:09:05.358346 18300 raft_consensus.cc:2243] T 9f5d8f2d6f684a5b9702935fc8fd85a1 P ee4d8c8df06e4c04ad53ac25013d8a78 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:09:05.359189 18300 raft_consensus.cc:2272] T 9f5d8f2d6f684a5b9702935fc8fd85a1 P ee4d8c8df06e4c04ad53ac25013d8a78 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:05.361304 18300 tablet_replica.cc:333] T 451e3f8929ef4287a9eaa8941486e9cc P ee4d8c8df06e4c04ad53ac25013d8a78: stopping tablet replica
I20260709 13:09:05.361999 18300 raft_consensus.cc:2243] T 451e3f8929ef4287a9eaa8941486e9cc P ee4d8c8df06e4c04ad53ac25013d8a78 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:09:05.362843 18300 raft_consensus.cc:2272] T 451e3f8929ef4287a9eaa8941486e9cc P ee4d8c8df06e4c04ad53ac25013d8a78 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:05.365043 18300 tablet_replica.cc:333] T 0dfbae90dbc4407a9e01872b7d688d55 P ee4d8c8df06e4c04ad53ac25013d8a78: stopping tablet replica
I20260709 13:09:05.365609 18300 raft_consensus.cc:2243] T 0dfbae90dbc4407a9e01872b7d688d55 P ee4d8c8df06e4c04ad53ac25013d8a78 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:05.366019 18300 raft_consensus.cc:2272] T 0dfbae90dbc4407a9e01872b7d688d55 P ee4d8c8df06e4c04ad53ac25013d8a78 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:05.368587 18300 tablet_replica.cc:333] T eb8f9bf7e0d24af88a04bda489298395 P ee4d8c8df06e4c04ad53ac25013d8a78: stopping tablet replica
I20260709 13:09:05.369115 18300 raft_consensus.cc:2243] T eb8f9bf7e0d24af88a04bda489298395 P ee4d8c8df06e4c04ad53ac25013d8a78 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:05.369527 18300 raft_consensus.cc:2272] T eb8f9bf7e0d24af88a04bda489298395 P ee4d8c8df06e4c04ad53ac25013d8a78 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:05.371716 18300 tablet_replica.cc:333] T 777f2e0112c34108b367c8a2ad2641e1 P ee4d8c8df06e4c04ad53ac25013d8a78: stopping tablet replica
I20260709 13:09:05.372308 18300 raft_consensus.cc:2243] T 777f2e0112c34108b367c8a2ad2641e1 P ee4d8c8df06e4c04ad53ac25013d8a78 [term 5 LEADER]: Raft consensus shutting down.
I20260709 13:09:05.373180 18300 raft_consensus.cc:2272] T 777f2e0112c34108b367c8a2ad2641e1 P ee4d8c8df06e4c04ad53ac25013d8a78 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:05.376137 18300 tablet_replica.cc:333] T 4b9944472adf4cec929d98a95851bef9 P ee4d8c8df06e4c04ad53ac25013d8a78: stopping tablet replica
I20260709 13:09:05.376729 18300 raft_consensus.cc:2243] T 4b9944472adf4cec929d98a95851bef9 P ee4d8c8df06e4c04ad53ac25013d8a78 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:09:05.377506 18300 raft_consensus.cc:2272] T 4b9944472adf4cec929d98a95851bef9 P ee4d8c8df06e4c04ad53ac25013d8a78 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:05.379844 18300 tablet_replica.cc:333] T 2b38eb974fe54bb6a799876978d3ba4c P ee4d8c8df06e4c04ad53ac25013d8a78: stopping tablet replica
I20260709 13:09:05.380335 18300 raft_consensus.cc:2243] T 2b38eb974fe54bb6a799876978d3ba4c P ee4d8c8df06e4c04ad53ac25013d8a78 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:05.380755 18300 raft_consensus.cc:2272] T 2b38eb974fe54bb6a799876978d3ba4c P ee4d8c8df06e4c04ad53ac25013d8a78 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:05.383003 18300 tablet_replica.cc:333] T 879bbeb7e3244e8a8e5ee375c020cb16 P ee4d8c8df06e4c04ad53ac25013d8a78: stopping tablet replica
I20260709 13:09:05.383571 18300 raft_consensus.cc:2243] T 879bbeb7e3244e8a8e5ee375c020cb16 P ee4d8c8df06e4c04ad53ac25013d8a78 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:05.383996 18300 raft_consensus.cc:2272] T 879bbeb7e3244e8a8e5ee375c020cb16 P ee4d8c8df06e4c04ad53ac25013d8a78 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:05.407944 18300 tablet_server.cc:196] TabletServer@127.17.223.2:0 shutdown complete.
W20260709 13:09:05.411791 29012 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.17.223.2:41821: connect: Connection refused (error 111) [suppressed 82 similar messages]
W20260709 13:09:05.415442 29012 consensus_peers.cc:597] T 0dfbae90dbc4407a9e01872b7d688d55 P e3fc42b9680245f3b66db70446830a2f -> Peer ee4d8c8df06e4c04ad53ac25013d8a78 (127.17.223.2:41821): Couldn't send request to peer ee4d8c8df06e4c04ad53ac25013d8a78. Status: Network error: Client connection negotiation failed: client connection to 127.17.223.2:41821: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:05.432641 18300 tablet_server.cc:179] TabletServer@127.17.223.3:0 shutting down...
W20260709 13:09:05.449059 29012 consensus_peers.cc:597] T 2b38eb974fe54bb6a799876978d3ba4c P e3fc42b9680245f3b66db70446830a2f -> Peer ee4d8c8df06e4c04ad53ac25013d8a78 (127.17.223.2:41821): Couldn't send request to peer ee4d8c8df06e4c04ad53ac25013d8a78. Status: Network error: Client connection negotiation failed: client connection to 127.17.223.2:41821: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:09:05.455092 29012 consensus_peers.cc:597] T 0dfbae90dbc4407a9e01872b7d688d55 P e3fc42b9680245f3b66db70446830a2f -> Peer 0284f1db8c204657b7b423bab5b2eb4f (127.17.223.1:39279): Couldn't send request to peer 0284f1db8c204657b7b423bab5b2eb4f. Status: Network error: Client connection negotiation failed: client connection to 127.17.223.1:39279: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:05.463479 18300 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:09:05.464227 18300 tablet_replica.cc:333] T 5d6b9266d4e74616b08d4e9697a83924 P e3fc42b9680245f3b66db70446830a2f: stopping tablet replica
I20260709 13:09:05.464859 18300 raft_consensus.cc:2243] T 5d6b9266d4e74616b08d4e9697a83924 P e3fc42b9680245f3b66db70446830a2f [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:09:05.465687 18300 raft_consensus.cc:2272] T 5d6b9266d4e74616b08d4e9697a83924 P e3fc42b9680245f3b66db70446830a2f [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:05.468356 18300 tablet_replica.cc:333] T 451e3f8929ef4287a9eaa8941486e9cc P e3fc42b9680245f3b66db70446830a2f: stopping tablet replica
I20260709 13:09:05.468899 18300 raft_consensus.cc:2243] T 451e3f8929ef4287a9eaa8941486e9cc P e3fc42b9680245f3b66db70446830a2f [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:05.469300 18300 raft_consensus.cc:2272] T 451e3f8929ef4287a9eaa8941486e9cc P e3fc42b9680245f3b66db70446830a2f [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:05.471236 18300 tablet_replica.cc:333] T 0dfbae90dbc4407a9e01872b7d688d55 P e3fc42b9680245f3b66db70446830a2f: stopping tablet replica
I20260709 13:09:05.471789 18300 raft_consensus.cc:2243] T 0dfbae90dbc4407a9e01872b7d688d55 P e3fc42b9680245f3b66db70446830a2f [term 4 LEADER]: Raft consensus shutting down.
I20260709 13:09:05.472581 18300 raft_consensus.cc:2272] T 0dfbae90dbc4407a9e01872b7d688d55 P e3fc42b9680245f3b66db70446830a2f [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:05.475047 18300 tablet_replica.cc:333] T 777f2e0112c34108b367c8a2ad2641e1 P e3fc42b9680245f3b66db70446830a2f: stopping tablet replica
I20260709 13:09:05.475589 18300 raft_consensus.cc:2243] T 777f2e0112c34108b367c8a2ad2641e1 P e3fc42b9680245f3b66db70446830a2f [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:05.475986 18300 raft_consensus.cc:2272] T 777f2e0112c34108b367c8a2ad2641e1 P e3fc42b9680245f3b66db70446830a2f [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:05.478380 18300 tablet_replica.cc:333] T eb8f9bf7e0d24af88a04bda489298395 P e3fc42b9680245f3b66db70446830a2f: stopping tablet replica
I20260709 13:09:05.479039 18300 raft_consensus.cc:2243] T eb8f9bf7e0d24af88a04bda489298395 P e3fc42b9680245f3b66db70446830a2f [term 4 LEADER]: Raft consensus shutting down.
I20260709 13:09:05.479869 18300 raft_consensus.cc:2272] T eb8f9bf7e0d24af88a04bda489298395 P e3fc42b9680245f3b66db70446830a2f [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:05.481805 18300 tablet_replica.cc:333] T 7087f0eae49f4f71b5769071b817f8f2 P e3fc42b9680245f3b66db70446830a2f: stopping tablet replica
I20260709 13:09:05.482295 18300 raft_consensus.cc:2243] T 7087f0eae49f4f71b5769071b817f8f2 P e3fc42b9680245f3b66db70446830a2f [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:09:05.483053 18300 raft_consensus.cc:2272] T 7087f0eae49f4f71b5769071b817f8f2 P e3fc42b9680245f3b66db70446830a2f [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:05.484966 18300 tablet_replica.cc:333] T 9f5d8f2d6f684a5b9702935fc8fd85a1 P e3fc42b9680245f3b66db70446830a2f: stopping tablet replica
I20260709 13:09:05.485456 18300 raft_consensus.cc:2243] T 9f5d8f2d6f684a5b9702935fc8fd85a1 P e3fc42b9680245f3b66db70446830a2f [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:05.485853 18300 raft_consensus.cc:2272] T 9f5d8f2d6f684a5b9702935fc8fd85a1 P e3fc42b9680245f3b66db70446830a2f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:05.488015 18300 tablet_replica.cc:333] T 4b9944472adf4cec929d98a95851bef9 P e3fc42b9680245f3b66db70446830a2f: stopping tablet replica
I20260709 13:09:05.488487 18300 raft_consensus.cc:2243] T 4b9944472adf4cec929d98a95851bef9 P e3fc42b9680245f3b66db70446830a2f [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:05.488888 18300 raft_consensus.cc:2272] T 4b9944472adf4cec929d98a95851bef9 P e3fc42b9680245f3b66db70446830a2f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:05.490872 18300 tablet_replica.cc:333] T 879bbeb7e3244e8a8e5ee375c020cb16 P e3fc42b9680245f3b66db70446830a2f: stopping tablet replica
I20260709 13:09:05.491513 18300 raft_consensus.cc:2243] T 879bbeb7e3244e8a8e5ee375c020cb16 P e3fc42b9680245f3b66db70446830a2f [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:09:05.492333 18300 raft_consensus.cc:2272] T 879bbeb7e3244e8a8e5ee375c020cb16 P e3fc42b9680245f3b66db70446830a2f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:05.494449 18300 tablet_replica.cc:333] T 2b38eb974fe54bb6a799876978d3ba4c P e3fc42b9680245f3b66db70446830a2f: stopping tablet replica
I20260709 13:09:05.495041 18300 raft_consensus.cc:2243] T 2b38eb974fe54bb6a799876978d3ba4c P e3fc42b9680245f3b66db70446830a2f [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:09:05.495819 18300 raft_consensus.cc:2272] T 2b38eb974fe54bb6a799876978d3ba4c P e3fc42b9680245f3b66db70446830a2f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:05.526830 18300 tablet_server.cc:196] TabletServer@127.17.223.3:0 shutdown complete.
I20260709 13:09:05.549299 18300 master.cc:562] Master@127.17.223.62:35571 shutting down...
I20260709 13:09:05.573583 18300 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 1601ddfd353d4cc3823bd78b5353aa5c [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:09:05.574185 18300 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 1601ddfd353d4cc3823bd78b5353aa5c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:05.574555 18300 tablet_replica.cc:333] T 00000000000000000000000000000000 P 1601ddfd353d4cc3823bd78b5353aa5c: stopping tablet replica
I20260709 13:09:05.597241 18300 master.cc:584] Master@127.17.223.62:35571 shutdown complete.
[       OK ] LeaderRebalancerTest.TestMaintenanceMode (12987 ms)
[ RUN      ] LeaderRebalancerTest.MultiTableLeaderBalance
I20260709 13:09:05.645021 18300 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.17.223.62:44981
I20260709 13:09:05.646209 18300 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:09:05.651814 29376 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:09:05.651849 29377 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:09:05.653124 29379 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:09:05.653815 18300 server_base.cc:1061] running on GCE node
I20260709 13:09:05.654832 18300 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:09:05.655004 18300 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:09:05.655169 18300 hybrid_clock.cc:648] HybridClock initialized: now 1783602545655155 us; error 0 us; skew 500 ppm
I20260709 13:09:05.655720 18300 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:09:05.658198 18300 webserver.cc:533] Webserver started at http://127.17.223.62:35739/ using document root <none> and password file <none>
I20260709 13:09:05.658790 18300 fs_manager.cc:362] Metadata directory not provided
I20260709 13:09:05.659009 18300 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:09:05.659292 18300 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:09:05.660425 18300 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskKd2k48/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602220613947-18300-0/minicluster-data/master-0-root/instance:
uuid: "0f6cdb3dee6d46eab44fcbe0c41a2510"
format_stamp: "Formatted at 2026-07-09 13:09:05 on dist-test-slave-vl1s"
I20260709 13:09:05.664938 18300 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.006s	sys 0.000s
I20260709 13:09:05.668280 29384 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:09:05.668989 18300 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.001s	sys 0.000s
I20260709 13:09:05.669284 18300 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskKd2k48/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602220613947-18300-0/minicluster-data/master-0-root
uuid: "0f6cdb3dee6d46eab44fcbe0c41a2510"
format_stamp: "Formatted at 2026-07-09 13:09:05 on dist-test-slave-vl1s"
I20260709 13:09:05.669556 18300 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskKd2k48/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602220613947-18300-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskKd2k48/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602220613947-18300-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskKd2k48/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602220613947-18300-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:09:05.690315 18300 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:09:05.691591 18300 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:09:05.729674 18300 rpc_server.cc:307] RPC server started. Bound to: 127.17.223.62:44981
I20260709 13:09:05.729792 29435 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.17.223.62:44981 every 8 connection(s)
I20260709 13:09:05.733745 29436 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:05.745807 29436 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0f6cdb3dee6d46eab44fcbe0c41a2510: Bootstrap starting.
I20260709 13:09:05.751148 29436 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 0f6cdb3dee6d46eab44fcbe0c41a2510: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:05.755802 29436 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0f6cdb3dee6d46eab44fcbe0c41a2510: No bootstrap required, opened a new log
I20260709 13:09:05.758065 29436 raft_consensus.cc:359] T 00000000000000000000000000000000 P 0f6cdb3dee6d46eab44fcbe0c41a2510 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0f6cdb3dee6d46eab44fcbe0c41a2510" member_type: VOTER }
I20260709 13:09:05.758630 29436 raft_consensus.cc:385] T 00000000000000000000000000000000 P 0f6cdb3dee6d46eab44fcbe0c41a2510 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:05.758852 29436 raft_consensus.cc:740] T 00000000000000000000000000000000 P 0f6cdb3dee6d46eab44fcbe0c41a2510 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0f6cdb3dee6d46eab44fcbe0c41a2510, State: Initialized, Role: FOLLOWER
I20260709 13:09:05.759469 29436 consensus_queue.cc:260] T 00000000000000000000000000000000 P 0f6cdb3dee6d46eab44fcbe0c41a2510 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0f6cdb3dee6d46eab44fcbe0c41a2510" member_type: VOTER }
I20260709 13:09:05.759883 29436 raft_consensus.cc:399] T 00000000000000000000000000000000 P 0f6cdb3dee6d46eab44fcbe0c41a2510 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 13:09:05.760082 29436 raft_consensus.cc:493] T 00000000000000000000000000000000 P 0f6cdb3dee6d46eab44fcbe0c41a2510 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 13:09:05.760298 29436 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 0f6cdb3dee6d46eab44fcbe0c41a2510 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:05.765220 29436 raft_consensus.cc:515] T 00000000000000000000000000000000 P 0f6cdb3dee6d46eab44fcbe0c41a2510 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0f6cdb3dee6d46eab44fcbe0c41a2510" member_type: VOTER }
I20260709 13:09:05.765743 29436 leader_election.cc:304] T 00000000000000000000000000000000 P 0f6cdb3dee6d46eab44fcbe0c41a2510 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 0f6cdb3dee6d46eab44fcbe0c41a2510; no voters: 
I20260709 13:09:05.767019 29436 leader_election.cc:290] T 00000000000000000000000000000000 P 0f6cdb3dee6d46eab44fcbe0c41a2510 [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 13:09:05.767354 29439 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 0f6cdb3dee6d46eab44fcbe0c41a2510 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:05.768707 29439 raft_consensus.cc:697] T 00000000000000000000000000000000 P 0f6cdb3dee6d46eab44fcbe0c41a2510 [term 1 LEADER]: Becoming Leader. State: Replica: 0f6cdb3dee6d46eab44fcbe0c41a2510, State: Running, Role: LEADER
I20260709 13:09:05.769402 29439 consensus_queue.cc:237] T 00000000000000000000000000000000 P 0f6cdb3dee6d46eab44fcbe0c41a2510 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0f6cdb3dee6d46eab44fcbe0c41a2510" member_type: VOTER }
I20260709 13:09:05.770176 29436 sys_catalog.cc:565] T 00000000000000000000000000000000 P 0f6cdb3dee6d46eab44fcbe0c41a2510 [sys.catalog]: configured and running, proceeding with master startup.
I20260709 13:09:05.774631 29441 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0f6cdb3dee6d46eab44fcbe0c41a2510 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 0f6cdb3dee6d46eab44fcbe0c41a2510. Latest consensus state: current_term: 1 leader_uuid: "0f6cdb3dee6d46eab44fcbe0c41a2510" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0f6cdb3dee6d46eab44fcbe0c41a2510" member_type: VOTER } }
I20260709 13:09:05.775547 29441 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0f6cdb3dee6d46eab44fcbe0c41a2510 [sys.catalog]: This master's current role is: LEADER
I20260709 13:09:05.775765 29440 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0f6cdb3dee6d46eab44fcbe0c41a2510 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "0f6cdb3dee6d46eab44fcbe0c41a2510" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0f6cdb3dee6d46eab44fcbe0c41a2510" member_type: VOTER } }
I20260709 13:09:05.776405 29440 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0f6cdb3dee6d46eab44fcbe0c41a2510 [sys.catalog]: This master's current role is: LEADER
I20260709 13:09:05.777771 29447 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 13:09:05.782611 29447 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 13:09:05.786707 18300 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 13:09:05.791322 29447 catalog_manager.cc:1383] Generated new cluster ID: 605c2aa0fb7145fbb3761ae20a3dbedb
I20260709 13:09:05.791638 29447 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 13:09:05.810169 29447 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 13:09:05.811636 29447 catalog_manager.cc:1540] Loading token signing keys...
I20260709 13:09:05.825173 29447 catalog_manager.cc:6070] T 00000000000000000000000000000000 P 0f6cdb3dee6d46eab44fcbe0c41a2510: Generated new TSK 0
I20260709 13:09:05.825829 29447 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 13:09:05.853202 18300 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:09:05.859467 29457 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:09:05.860641 29458 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:09:05.862329 29460 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:09:05.862774 18300 server_base.cc:1061] running on GCE node
I20260709 13:09:05.863787 18300 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:09:05.864004 18300 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:09:05.864195 18300 hybrid_clock.cc:648] HybridClock initialized: now 1783602545864178 us; error 0 us; skew 500 ppm
I20260709 13:09:05.864776 18300 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:09:05.867164 18300 webserver.cc:533] Webserver started at http://127.17.223.1:45879/ using document root <none> and password file <none>
I20260709 13:09:05.867648 18300 fs_manager.cc:362] Metadata directory not provided
I20260709 13:09:05.867862 18300 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:09:05.868129 18300 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:09:05.869235 18300 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskKd2k48/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602220613947-18300-0/minicluster-data/ts-0-root/instance:
uuid: "2294471e25ca4bb286453b98d9a4bfca"
format_stamp: "Formatted at 2026-07-09 13:09:05 on dist-test-slave-vl1s"
I20260709 13:09:05.873894 18300 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.003s	sys 0.003s
I20260709 13:09:05.877290 29465 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:09:05.878186 18300 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260709 13:09:05.878439 18300 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskKd2k48/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602220613947-18300-0/minicluster-data/ts-0-root
uuid: "2294471e25ca4bb286453b98d9a4bfca"
format_stamp: "Formatted at 2026-07-09 13:09:05 on dist-test-slave-vl1s"
I20260709 13:09:05.878744 18300 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskKd2k48/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602220613947-18300-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskKd2k48/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602220613947-18300-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskKd2k48/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602220613947-18300-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:09:05.908980 18300 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:09:05.910161 18300 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:09:05.911569 18300 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:09:05.913862 18300 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:09:05.914042 18300 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:09:05.914342 18300 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:09:05.914532 18300 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:09:05.954346 18300 rpc_server.cc:307] RPC server started. Bound to: 127.17.223.1:42727
I20260709 13:09:05.954447 29527 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.17.223.1:42727 every 8 connection(s)
I20260709 13:09:05.959611 18300 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:09:05.966349 29532 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:09:05.967880 29533 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:09:05.969704 29535 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:09:05.970577 18300 server_base.cc:1061] running on GCE node
I20260709 13:09:05.971654 18300 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
I20260709 13:09:05.971789 29528 heartbeater.cc:344] Connected to a master server at 127.17.223.62:44981
W20260709 13:09:05.971951 18300 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:09:05.972268 18300 hybrid_clock.cc:648] HybridClock initialized: now 1783602545972250 us; error 0 us; skew 500 ppm
I20260709 13:09:05.972344 29528 heartbeater.cc:461] Registering TS with master...
I20260709 13:09:05.973047 18300 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:09:05.973294 29528 heartbeater.cc:507] Master 127.17.223.62:44981 requested a full tablet report, sending...
I20260709 13:09:05.975860 18300 webserver.cc:533] Webserver started at http://127.17.223.2:33579/ using document root <none> and password file <none>
I20260709 13:09:05.976064 29401 ts_manager.cc:194] Registered new tserver with Master: 2294471e25ca4bb286453b98d9a4bfca (127.17.223.1:42727)
I20260709 13:09:05.976475 18300 fs_manager.cc:362] Metadata directory not provided
I20260709 13:09:05.976747 18300 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:09:05.977010 18300 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:09:05.978118 18300 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskKd2k48/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602220613947-18300-0/minicluster-data/ts-1-root/instance:
uuid: "a005646a2679426a872350e51a876514"
format_stamp: "Formatted at 2026-07-09 13:09:05 on dist-test-slave-vl1s"
I20260709 13:09:05.978250 29401 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:52672
I20260709 13:09:05.983180 18300 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.007s	sys 0.000s
I20260709 13:09:05.986542 29540 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:09:05.987434 18300 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.001s
I20260709 13:09:05.987767 18300 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskKd2k48/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602220613947-18300-0/minicluster-data/ts-1-root
uuid: "a005646a2679426a872350e51a876514"
format_stamp: "Formatted at 2026-07-09 13:09:05 on dist-test-slave-vl1s"
I20260709 13:09:05.988062 18300 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskKd2k48/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602220613947-18300-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskKd2k48/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602220613947-18300-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskKd2k48/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602220613947-18300-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:09:06.005550 18300 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:09:06.006846 18300 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:09:06.008289 18300 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:09:06.010457 18300 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:09:06.010684 18300 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:09:06.010987 18300 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:09:06.011158 18300 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:09:06.050405 18300 rpc_server.cc:307] RPC server started. Bound to: 127.17.223.2:41721
I20260709 13:09:06.050531 29602 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.17.223.2:41721 every 8 connection(s)
I20260709 13:09:06.055466 18300 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:09:06.063093 29606 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:09:06.063488 29607 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:09:06.067035 29609 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:09:06.067637 18300 server_base.cc:1061] running on GCE node
I20260709 13:09:06.068732 18300 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:09:06.068965 18300 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:09:06.068981 29603 heartbeater.cc:344] Connected to a master server at 127.17.223.62:44981
I20260709 13:09:06.069175 18300 hybrid_clock.cc:648] HybridClock initialized: now 1783602546069160 us; error 0 us; skew 500 ppm
I20260709 13:09:06.069615 29603 heartbeater.cc:461] Registering TS with master...
I20260709 13:09:06.070011 18300 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:09:06.070508 29603 heartbeater.cc:507] Master 127.17.223.62:44981 requested a full tablet report, sending...
I20260709 13:09:06.072940 29401 ts_manager.cc:194] Registered new tserver with Master: a005646a2679426a872350e51a876514 (127.17.223.2:41721)
I20260709 13:09:06.072942 18300 webserver.cc:533] Webserver started at http://127.17.223.3:37643/ using document root <none> and password file <none>
I20260709 13:09:06.073825 18300 fs_manager.cc:362] Metadata directory not provided
I20260709 13:09:06.074091 18300 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:09:06.074397 18300 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:09:06.074962 29401 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:52680
I20260709 13:09:06.076066 18300 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskKd2k48/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602220613947-18300-0/minicluster-data/ts-2-root/instance:
uuid: "f29e7e3afcd84fd886e4ae87c6f11fa5"
format_stamp: "Formatted at 2026-07-09 13:09:06 on dist-test-slave-vl1s"
I20260709 13:09:06.080869 18300 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.005s	sys 0.000s
I20260709 13:09:06.084112 29614 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:09:06.084798 18300 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.001s	sys 0.000s
I20260709 13:09:06.085114 18300 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskKd2k48/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602220613947-18300-0/minicluster-data/ts-2-root
uuid: "f29e7e3afcd84fd886e4ae87c6f11fa5"
format_stamp: "Formatted at 2026-07-09 13:09:06 on dist-test-slave-vl1s"
I20260709 13:09:06.085358 18300 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskKd2k48/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602220613947-18300-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskKd2k48/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602220613947-18300-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskKd2k48/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602220613947-18300-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:09:06.096457 18300 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:09:06.097631 18300 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:09:06.099092 18300 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:09:06.101214 18300 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:09:06.101435 18300 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:09:06.101677 18300 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:09:06.101848 18300 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:09:06.141588 18300 rpc_server.cc:307] RPC server started. Bound to: 127.17.223.3:44583
I20260709 13:09:06.141686 29676 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.17.223.3:44583 every 8 connection(s)
I20260709 13:09:06.156021 29677 heartbeater.cc:344] Connected to a master server at 127.17.223.62:44981
I20260709 13:09:06.156378 29677 heartbeater.cc:461] Registering TS with master...
I20260709 13:09:06.157059 29677 heartbeater.cc:507] Master 127.17.223.62:44981 requested a full tablet report, sending...
I20260709 13:09:06.159087 29401 ts_manager.cc:194] Registered new tserver with Master: f29e7e3afcd84fd886e4ae87c6f11fa5 (127.17.223.3:44583)
I20260709 13:09:06.159397 18300 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.014753373s
I20260709 13:09:06.160985 29401 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:52684
I20260709 13:09:06.185250 29401 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:52688:
name: "multi_table_leader_balance_table1"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\377\377\377?""\004\001\000\377\377\377?"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:09:06.187426 29401 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table multi_table_leader_balance_table1 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:09:06.235203 29568 tablet_service.cc:1511] Processing CreateTablet for tablet 4ca42effaa054b1ba471720fc3e5df74 (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=fb65ada211674a0185596669f8df2c21]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 13:09:06.235659 29567 tablet_service.cc:1511] Processing CreateTablet for tablet 17fdbe28610741beabfd7b7f8835d70c (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=fb65ada211674a0185596669f8df2c21]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 13:09:06.236725 29568 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4ca42effaa054b1ba471720fc3e5df74. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:06.237388 29567 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 17fdbe28610741beabfd7b7f8835d70c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:06.249356 29493 tablet_service.cc:1511] Processing CreateTablet for tablet 4ca42effaa054b1ba471720fc3e5df74 (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=fb65ada211674a0185596669f8df2c21]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 13:09:06.251926 29492 tablet_service.cc:1511] Processing CreateTablet for tablet 17fdbe28610741beabfd7b7f8835d70c (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=fb65ada211674a0185596669f8df2c21]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 13:09:06.253432 29493 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4ca42effaa054b1ba471720fc3e5df74. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:06.257447 29492 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 17fdbe28610741beabfd7b7f8835d70c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:06.262898 29691 tablet_bootstrap.cc:492] T 4ca42effaa054b1ba471720fc3e5df74 P a005646a2679426a872350e51a876514: Bootstrap starting.
I20260709 13:09:06.265777 29642 tablet_service.cc:1511] Processing CreateTablet for tablet 4ca42effaa054b1ba471720fc3e5df74 (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=fb65ada211674a0185596669f8df2c21]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 13:09:06.267263 29642 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4ca42effaa054b1ba471720fc3e5df74. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:06.271991 29641 tablet_service.cc:1511] Processing CreateTablet for tablet 17fdbe28610741beabfd7b7f8835d70c (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=fb65ada211674a0185596669f8df2c21]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 13:09:06.273581 29641 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 17fdbe28610741beabfd7b7f8835d70c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:06.270609 29691 tablet_bootstrap.cc:654] T 4ca42effaa054b1ba471720fc3e5df74 P a005646a2679426a872350e51a876514: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:06.282912 29692 tablet_bootstrap.cc:492] T 4ca42effaa054b1ba471720fc3e5df74 P 2294471e25ca4bb286453b98d9a4bfca: Bootstrap starting.
I20260709 13:09:06.290840 29691 tablet_bootstrap.cc:492] T 4ca42effaa054b1ba471720fc3e5df74 P a005646a2679426a872350e51a876514: No bootstrap required, opened a new log
I20260709 13:09:06.291399 29691 ts_tablet_manager.cc:1403] T 4ca42effaa054b1ba471720fc3e5df74 P a005646a2679426a872350e51a876514: Time spent bootstrapping tablet: real 0.029s	user 0.012s	sys 0.008s
I20260709 13:09:06.292577 29692 tablet_bootstrap.cc:654] T 4ca42effaa054b1ba471720fc3e5df74 P 2294471e25ca4bb286453b98d9a4bfca: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:06.294452 29691 raft_consensus.cc:359] T 4ca42effaa054b1ba471720fc3e5df74 P a005646a2679426a872350e51a876514 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a005646a2679426a872350e51a876514" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 41721 } } peers { permanent_uuid: "2294471e25ca4bb286453b98d9a4bfca" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 42727 } } peers { permanent_uuid: "f29e7e3afcd84fd886e4ae87c6f11fa5" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 44583 } }
I20260709 13:09:06.295305 29691 raft_consensus.cc:385] T 4ca42effaa054b1ba471720fc3e5df74 P a005646a2679426a872350e51a876514 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:06.295746 29691 raft_consensus.cc:740] T 4ca42effaa054b1ba471720fc3e5df74 P a005646a2679426a872350e51a876514 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a005646a2679426a872350e51a876514, State: Initialized, Role: FOLLOWER
I20260709 13:09:06.296681 29691 consensus_queue.cc:260] T 4ca42effaa054b1ba471720fc3e5df74 P a005646a2679426a872350e51a876514 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a005646a2679426a872350e51a876514" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 41721 } } peers { permanent_uuid: "2294471e25ca4bb286453b98d9a4bfca" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 42727 } } peers { permanent_uuid: "f29e7e3afcd84fd886e4ae87c6f11fa5" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 44583 } }
I20260709 13:09:06.300566 29694 tablet_bootstrap.cc:492] T 4ca42effaa054b1ba471720fc3e5df74 P f29e7e3afcd84fd886e4ae87c6f11fa5: Bootstrap starting.
I20260709 13:09:06.302487 29603 heartbeater.cc:499] Master 127.17.223.62:44981 was elected leader, sending a full tablet report...
I20260709 13:09:06.303118 29691 ts_tablet_manager.cc:1434] T 4ca42effaa054b1ba471720fc3e5df74 P a005646a2679426a872350e51a876514: Time spent starting tablet: real 0.011s	user 0.009s	sys 0.002s
I20260709 13:09:06.304175 29691 tablet_bootstrap.cc:492] T 17fdbe28610741beabfd7b7f8835d70c P a005646a2679426a872350e51a876514: Bootstrap starting.
I20260709 13:09:06.304517 29692 tablet_bootstrap.cc:492] T 4ca42effaa054b1ba471720fc3e5df74 P 2294471e25ca4bb286453b98d9a4bfca: No bootstrap required, opened a new log
I20260709 13:09:06.305123 29692 ts_tablet_manager.cc:1403] T 4ca42effaa054b1ba471720fc3e5df74 P 2294471e25ca4bb286453b98d9a4bfca: Time spent bootstrapping tablet: real 0.023s	user 0.013s	sys 0.003s
I20260709 13:09:06.308346 29692 raft_consensus.cc:359] T 4ca42effaa054b1ba471720fc3e5df74 P 2294471e25ca4bb286453b98d9a4bfca [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a005646a2679426a872350e51a876514" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 41721 } } peers { permanent_uuid: "2294471e25ca4bb286453b98d9a4bfca" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 42727 } } peers { permanent_uuid: "f29e7e3afcd84fd886e4ae87c6f11fa5" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 44583 } }
I20260709 13:09:06.309190 29692 raft_consensus.cc:385] T 4ca42effaa054b1ba471720fc3e5df74 P 2294471e25ca4bb286453b98d9a4bfca [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:06.309496 29692 raft_consensus.cc:740] T 4ca42effaa054b1ba471720fc3e5df74 P 2294471e25ca4bb286453b98d9a4bfca [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2294471e25ca4bb286453b98d9a4bfca, State: Initialized, Role: FOLLOWER
I20260709 13:09:06.310184 29691 tablet_bootstrap.cc:654] T 17fdbe28610741beabfd7b7f8835d70c P a005646a2679426a872350e51a876514: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:06.310274 29692 consensus_queue.cc:260] T 4ca42effaa054b1ba471720fc3e5df74 P 2294471e25ca4bb286453b98d9a4bfca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a005646a2679426a872350e51a876514" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 41721 } } peers { permanent_uuid: "2294471e25ca4bb286453b98d9a4bfca" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 42727 } } peers { permanent_uuid: "f29e7e3afcd84fd886e4ae87c6f11fa5" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 44583 } }
I20260709 13:09:06.316649 29694 tablet_bootstrap.cc:654] T 4ca42effaa054b1ba471720fc3e5df74 P f29e7e3afcd84fd886e4ae87c6f11fa5: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:06.323822 29528 heartbeater.cc:499] Master 127.17.223.62:44981 was elected leader, sending a full tablet report...
I20260709 13:09:06.324357 29692 ts_tablet_manager.cc:1434] T 4ca42effaa054b1ba471720fc3e5df74 P 2294471e25ca4bb286453b98d9a4bfca: Time spent starting tablet: real 0.019s	user 0.012s	sys 0.008s
I20260709 13:09:06.325563 29692 tablet_bootstrap.cc:492] T 17fdbe28610741beabfd7b7f8835d70c P 2294471e25ca4bb286453b98d9a4bfca: Bootstrap starting.
I20260709 13:09:06.326462 29694 tablet_bootstrap.cc:492] T 4ca42effaa054b1ba471720fc3e5df74 P f29e7e3afcd84fd886e4ae87c6f11fa5: No bootstrap required, opened a new log
I20260709 13:09:06.326860 29691 tablet_bootstrap.cc:492] T 17fdbe28610741beabfd7b7f8835d70c P a005646a2679426a872350e51a876514: No bootstrap required, opened a new log
I20260709 13:09:06.327059 29694 ts_tablet_manager.cc:1403] T 4ca42effaa054b1ba471720fc3e5df74 P f29e7e3afcd84fd886e4ae87c6f11fa5: Time spent bootstrapping tablet: real 0.027s	user 0.011s	sys 0.006s
I20260709 13:09:06.327386 29691 ts_tablet_manager.cc:1403] T 17fdbe28610741beabfd7b7f8835d70c P a005646a2679426a872350e51a876514: Time spent bootstrapping tablet: real 0.023s	user 0.007s	sys 0.015s
I20260709 13:09:06.330762 29691 raft_consensus.cc:359] T 17fdbe28610741beabfd7b7f8835d70c P a005646a2679426a872350e51a876514 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2294471e25ca4bb286453b98d9a4bfca" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 42727 } } peers { permanent_uuid: "a005646a2679426a872350e51a876514" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 41721 } } peers { permanent_uuid: "f29e7e3afcd84fd886e4ae87c6f11fa5" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 44583 } }
I20260709 13:09:06.331563 29691 raft_consensus.cc:385] T 17fdbe28610741beabfd7b7f8835d70c P a005646a2679426a872350e51a876514 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:06.331164 29694 raft_consensus.cc:359] T 4ca42effaa054b1ba471720fc3e5df74 P f29e7e3afcd84fd886e4ae87c6f11fa5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a005646a2679426a872350e51a876514" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 41721 } } peers { permanent_uuid: "2294471e25ca4bb286453b98d9a4bfca" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 42727 } } peers { permanent_uuid: "f29e7e3afcd84fd886e4ae87c6f11fa5" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 44583 } }
I20260709 13:09:06.331895 29691 raft_consensus.cc:740] T 17fdbe28610741beabfd7b7f8835d70c P a005646a2679426a872350e51a876514 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a005646a2679426a872350e51a876514, State: Initialized, Role: FOLLOWER
I20260709 13:09:06.332250 29694 raft_consensus.cc:385] T 4ca42effaa054b1ba471720fc3e5df74 P f29e7e3afcd84fd886e4ae87c6f11fa5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:06.332369 29692 tablet_bootstrap.cc:654] T 17fdbe28610741beabfd7b7f8835d70c P 2294471e25ca4bb286453b98d9a4bfca: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:06.332738 29694 raft_consensus.cc:740] T 4ca42effaa054b1ba471720fc3e5df74 P f29e7e3afcd84fd886e4ae87c6f11fa5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f29e7e3afcd84fd886e4ae87c6f11fa5, State: Initialized, Role: FOLLOWER
I20260709 13:09:06.332890 29691 consensus_queue.cc:260] T 17fdbe28610741beabfd7b7f8835d70c P a005646a2679426a872350e51a876514 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2294471e25ca4bb286453b98d9a4bfca" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 42727 } } peers { permanent_uuid: "a005646a2679426a872350e51a876514" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 41721 } } peers { permanent_uuid: "f29e7e3afcd84fd886e4ae87c6f11fa5" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 44583 } }
I20260709 13:09:06.333835 29694 consensus_queue.cc:260] T 4ca42effaa054b1ba471720fc3e5df74 P f29e7e3afcd84fd886e4ae87c6f11fa5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a005646a2679426a872350e51a876514" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 41721 } } peers { permanent_uuid: "2294471e25ca4bb286453b98d9a4bfca" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 42727 } } peers { permanent_uuid: "f29e7e3afcd84fd886e4ae87c6f11fa5" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 44583 } }
I20260709 13:09:06.335340 29691 ts_tablet_manager.cc:1434] T 17fdbe28610741beabfd7b7f8835d70c P a005646a2679426a872350e51a876514: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 13:09:06.343248 29694 ts_tablet_manager.cc:1434] T 4ca42effaa054b1ba471720fc3e5df74 P f29e7e3afcd84fd886e4ae87c6f11fa5: Time spent starting tablet: real 0.016s	user 0.009s	sys 0.004s
I20260709 13:09:06.345155 29677 heartbeater.cc:499] Master 127.17.223.62:44981 was elected leader, sending a full tablet report...
I20260709 13:09:06.346457 29692 tablet_bootstrap.cc:492] T 17fdbe28610741beabfd7b7f8835d70c P 2294471e25ca4bb286453b98d9a4bfca: No bootstrap required, opened a new log
I20260709 13:09:06.346995 29692 ts_tablet_manager.cc:1403] T 17fdbe28610741beabfd7b7f8835d70c P 2294471e25ca4bb286453b98d9a4bfca: Time spent bootstrapping tablet: real 0.022s	user 0.017s	sys 0.004s
I20260709 13:09:06.347563 29694 tablet_bootstrap.cc:492] T 17fdbe28610741beabfd7b7f8835d70c P f29e7e3afcd84fd886e4ae87c6f11fa5: Bootstrap starting.
I20260709 13:09:06.350044 29692 raft_consensus.cc:359] T 17fdbe28610741beabfd7b7f8835d70c P 2294471e25ca4bb286453b98d9a4bfca [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2294471e25ca4bb286453b98d9a4bfca" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 42727 } } peers { permanent_uuid: "a005646a2679426a872350e51a876514" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 41721 } } peers { permanent_uuid: "f29e7e3afcd84fd886e4ae87c6f11fa5" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 44583 } }
I20260709 13:09:06.351086 29692 raft_consensus.cc:385] T 17fdbe28610741beabfd7b7f8835d70c P 2294471e25ca4bb286453b98d9a4bfca [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:06.351413 29692 raft_consensus.cc:740] T 17fdbe28610741beabfd7b7f8835d70c P 2294471e25ca4bb286453b98d9a4bfca [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2294471e25ca4bb286453b98d9a4bfca, State: Initialized, Role: FOLLOWER
I20260709 13:09:06.352255 29692 consensus_queue.cc:260] T 17fdbe28610741beabfd7b7f8835d70c P 2294471e25ca4bb286453b98d9a4bfca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2294471e25ca4bb286453b98d9a4bfca" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 42727 } } peers { permanent_uuid: "a005646a2679426a872350e51a876514" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 41721 } } peers { permanent_uuid: "f29e7e3afcd84fd886e4ae87c6f11fa5" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 44583 } }
I20260709 13:09:06.354245 29692 ts_tablet_manager.cc:1434] T 17fdbe28610741beabfd7b7f8835d70c P 2294471e25ca4bb286453b98d9a4bfca: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 13:09:06.357162 29694 tablet_bootstrap.cc:654] T 17fdbe28610741beabfd7b7f8835d70c P f29e7e3afcd84fd886e4ae87c6f11fa5: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:06.363325 29694 tablet_bootstrap.cc:492] T 17fdbe28610741beabfd7b7f8835d70c P f29e7e3afcd84fd886e4ae87c6f11fa5: No bootstrap required, opened a new log
I20260709 13:09:06.363941 29694 ts_tablet_manager.cc:1403] T 17fdbe28610741beabfd7b7f8835d70c P f29e7e3afcd84fd886e4ae87c6f11fa5: Time spent bootstrapping tablet: real 0.017s	user 0.000s	sys 0.013s
I20260709 13:09:06.366503 29694 raft_consensus.cc:359] T 17fdbe28610741beabfd7b7f8835d70c P f29e7e3afcd84fd886e4ae87c6f11fa5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2294471e25ca4bb286453b98d9a4bfca" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 42727 } } peers { permanent_uuid: "a005646a2679426a872350e51a876514" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 41721 } } peers { permanent_uuid: "f29e7e3afcd84fd886e4ae87c6f11fa5" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 44583 } }
I20260709 13:09:06.367010 29696 raft_consensus.cc:493] T 17fdbe28610741beabfd7b7f8835d70c P a005646a2679426a872350e51a876514 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:06.367338 29694 raft_consensus.cc:385] T 17fdbe28610741beabfd7b7f8835d70c P f29e7e3afcd84fd886e4ae87c6f11fa5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:06.367723 29694 raft_consensus.cc:740] T 17fdbe28610741beabfd7b7f8835d70c P f29e7e3afcd84fd886e4ae87c6f11fa5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f29e7e3afcd84fd886e4ae87c6f11fa5, State: Initialized, Role: FOLLOWER
I20260709 13:09:06.367631 29696 raft_consensus.cc:515] T 17fdbe28610741beabfd7b7f8835d70c P a005646a2679426a872350e51a876514 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2294471e25ca4bb286453b98d9a4bfca" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 42727 } } peers { permanent_uuid: "a005646a2679426a872350e51a876514" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 41721 } } peers { permanent_uuid: "f29e7e3afcd84fd886e4ae87c6f11fa5" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 44583 } }
I20260709 13:09:06.368728 29694 consensus_queue.cc:260] T 17fdbe28610741beabfd7b7f8835d70c P f29e7e3afcd84fd886e4ae87c6f11fa5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2294471e25ca4bb286453b98d9a4bfca" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 42727 } } peers { permanent_uuid: "a005646a2679426a872350e51a876514" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 41721 } } peers { permanent_uuid: "f29e7e3afcd84fd886e4ae87c6f11fa5" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 44583 } }
I20260709 13:09:06.371582 29694 ts_tablet_manager.cc:1434] T 17fdbe28610741beabfd7b7f8835d70c P f29e7e3afcd84fd886e4ae87c6f11fa5: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.002s
I20260709 13:09:06.370725 29696 leader_election.cc:290] T 17fdbe28610741beabfd7b7f8835d70c P a005646a2679426a872350e51a876514 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2294471e25ca4bb286453b98d9a4bfca (127.17.223.1:42727), f29e7e3afcd84fd886e4ae87c6f11fa5 (127.17.223.3:44583)
I20260709 13:09:06.382107 29503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17fdbe28610741beabfd7b7f8835d70c" candidate_uuid: "a005646a2679426a872350e51a876514" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2294471e25ca4bb286453b98d9a4bfca" is_pre_election: true
I20260709 13:09:06.382886 29503 raft_consensus.cc:2468] T 17fdbe28610741beabfd7b7f8835d70c P 2294471e25ca4bb286453b98d9a4bfca [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a005646a2679426a872350e51a876514 in term 0.
I20260709 13:09:06.384268 29542 leader_election.cc:304] T 17fdbe28610741beabfd7b7f8835d70c P a005646a2679426a872350e51a876514 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2294471e25ca4bb286453b98d9a4bfca, a005646a2679426a872350e51a876514; no voters: 
I20260709 13:09:06.384160 29652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17fdbe28610741beabfd7b7f8835d70c" candidate_uuid: "a005646a2679426a872350e51a876514" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f29e7e3afcd84fd886e4ae87c6f11fa5" is_pre_election: true
I20260709 13:09:06.385179 29652 raft_consensus.cc:2468] T 17fdbe28610741beabfd7b7f8835d70c P f29e7e3afcd84fd886e4ae87c6f11fa5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a005646a2679426a872350e51a876514 in term 0.
I20260709 13:09:06.385325 29696 raft_consensus.cc:2804] T 17fdbe28610741beabfd7b7f8835d70c P a005646a2679426a872350e51a876514 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:06.385764 29696 raft_consensus.cc:493] T 17fdbe28610741beabfd7b7f8835d70c P a005646a2679426a872350e51a876514 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:06.386149 29696 raft_consensus.cc:3060] T 17fdbe28610741beabfd7b7f8835d70c P a005646a2679426a872350e51a876514 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:06.392469 29696 raft_consensus.cc:515] T 17fdbe28610741beabfd7b7f8835d70c P a005646a2679426a872350e51a876514 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2294471e25ca4bb286453b98d9a4bfca" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 42727 } } peers { permanent_uuid: "a005646a2679426a872350e51a876514" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 41721 } } peers { permanent_uuid: "f29e7e3afcd84fd886e4ae87c6f11fa5" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 44583 } }
I20260709 13:09:06.394327 29696 leader_election.cc:290] T 17fdbe28610741beabfd7b7f8835d70c P a005646a2679426a872350e51a876514 [CANDIDATE]: Term 1 election: Requested vote from peers 2294471e25ca4bb286453b98d9a4bfca (127.17.223.1:42727), f29e7e3afcd84fd886e4ae87c6f11fa5 (127.17.223.3:44583)
I20260709 13:09:06.395107 29503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17fdbe28610741beabfd7b7f8835d70c" candidate_uuid: "a005646a2679426a872350e51a876514" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2294471e25ca4bb286453b98d9a4bfca"
I20260709 13:09:06.395545 29652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17fdbe28610741beabfd7b7f8835d70c" candidate_uuid: "a005646a2679426a872350e51a876514" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f29e7e3afcd84fd886e4ae87c6f11fa5"
I20260709 13:09:06.395838 29503 raft_consensus.cc:3060] T 17fdbe28610741beabfd7b7f8835d70c P 2294471e25ca4bb286453b98d9a4bfca [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:06.396167 29652 raft_consensus.cc:3060] T 17fdbe28610741beabfd7b7f8835d70c P f29e7e3afcd84fd886e4ae87c6f11fa5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:06.404168 29503 raft_consensus.cc:2468] T 17fdbe28610741beabfd7b7f8835d70c P 2294471e25ca4bb286453b98d9a4bfca [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a005646a2679426a872350e51a876514 in term 1.
I20260709 13:09:06.404170 29652 raft_consensus.cc:2468] T 17fdbe28610741beabfd7b7f8835d70c P f29e7e3afcd84fd886e4ae87c6f11fa5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a005646a2679426a872350e51a876514 in term 1.
I20260709 13:09:06.405259 29700 raft_consensus.cc:493] T 4ca42effaa054b1ba471720fc3e5df74 P f29e7e3afcd84fd886e4ae87c6f11fa5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:06.405789 29700 raft_consensus.cc:515] T 4ca42effaa054b1ba471720fc3e5df74 P f29e7e3afcd84fd886e4ae87c6f11fa5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a005646a2679426a872350e51a876514" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 41721 } } peers { permanent_uuid: "2294471e25ca4bb286453b98d9a4bfca" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 42727 } } peers { permanent_uuid: "f29e7e3afcd84fd886e4ae87c6f11fa5" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 44583 } }
I20260709 13:09:06.405972 29542 leader_election.cc:304] T 17fdbe28610741beabfd7b7f8835d70c P a005646a2679426a872350e51a876514 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2294471e25ca4bb286453b98d9a4bfca, a005646a2679426a872350e51a876514; no voters: 
I20260709 13:09:06.406829 29696 raft_consensus.cc:2804] T 17fdbe28610741beabfd7b7f8835d70c P a005646a2679426a872350e51a876514 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:06.408166 29700 leader_election.cc:290] T 4ca42effaa054b1ba471720fc3e5df74 P f29e7e3afcd84fd886e4ae87c6f11fa5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a005646a2679426a872350e51a876514 (127.17.223.2:41721), 2294471e25ca4bb286453b98d9a4bfca (127.17.223.1:42727)
I20260709 13:09:06.408056 29696 raft_consensus.cc:697] T 17fdbe28610741beabfd7b7f8835d70c P a005646a2679426a872350e51a876514 [term 1 LEADER]: Becoming Leader. State: Replica: a005646a2679426a872350e51a876514, State: Running, Role: LEADER
I20260709 13:09:06.409646 29696 consensus_queue.cc:237] T 17fdbe28610741beabfd7b7f8835d70c P a005646a2679426a872350e51a876514 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2294471e25ca4bb286453b98d9a4bfca" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 42727 } } peers { permanent_uuid: "a005646a2679426a872350e51a876514" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 41721 } } peers { permanent_uuid: "f29e7e3afcd84fd886e4ae87c6f11fa5" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 44583 } }
I20260709 13:09:06.419880 29578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ca42effaa054b1ba471720fc3e5df74" candidate_uuid: "f29e7e3afcd84fd886e4ae87c6f11fa5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a005646a2679426a872350e51a876514" is_pre_election: true
I20260709 13:09:06.420531 29578 raft_consensus.cc:2468] T 4ca42effaa054b1ba471720fc3e5df74 P a005646a2679426a872350e51a876514 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f29e7e3afcd84fd886e4ae87c6f11fa5 in term 0.
I20260709 13:09:06.420325 29399 catalog_manager.cc:5697] T 17fdbe28610741beabfd7b7f8835d70c P a005646a2679426a872350e51a876514 reported cstate change: term changed from 0 to 1, leader changed from <none> to a005646a2679426a872350e51a876514 (127.17.223.2). New cstate: current_term: 1 leader_uuid: "a005646a2679426a872350e51a876514" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2294471e25ca4bb286453b98d9a4bfca" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 42727 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a005646a2679426a872350e51a876514" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 41721 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f29e7e3afcd84fd886e4ae87c6f11fa5" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 44583 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:06.421731 29618 leader_election.cc:304] T 4ca42effaa054b1ba471720fc3e5df74 P f29e7e3afcd84fd886e4ae87c6f11fa5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a005646a2679426a872350e51a876514, f29e7e3afcd84fd886e4ae87c6f11fa5; no voters: 
I20260709 13:09:06.421761 29503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ca42effaa054b1ba471720fc3e5df74" candidate_uuid: "f29e7e3afcd84fd886e4ae87c6f11fa5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2294471e25ca4bb286453b98d9a4bfca" is_pre_election: true
I20260709 13:09:06.422544 29700 raft_consensus.cc:2804] T 4ca42effaa054b1ba471720fc3e5df74 P f29e7e3afcd84fd886e4ae87c6f11fa5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:06.422506 29503 raft_consensus.cc:2468] T 4ca42effaa054b1ba471720fc3e5df74 P 2294471e25ca4bb286453b98d9a4bfca [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f29e7e3afcd84fd886e4ae87c6f11fa5 in term 0.
I20260709 13:09:06.423113 29700 raft_consensus.cc:493] T 4ca42effaa054b1ba471720fc3e5df74 P f29e7e3afcd84fd886e4ae87c6f11fa5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:06.423511 29700 raft_consensus.cc:3060] T 4ca42effaa054b1ba471720fc3e5df74 P f29e7e3afcd84fd886e4ae87c6f11fa5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:06.429924 29700 raft_consensus.cc:515] T 4ca42effaa054b1ba471720fc3e5df74 P f29e7e3afcd84fd886e4ae87c6f11fa5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a005646a2679426a872350e51a876514" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 41721 } } peers { permanent_uuid: "2294471e25ca4bb286453b98d9a4bfca" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 42727 } } peers { permanent_uuid: "f29e7e3afcd84fd886e4ae87c6f11fa5" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 44583 } }
I20260709 13:09:06.431916 29700 leader_election.cc:290] T 4ca42effaa054b1ba471720fc3e5df74 P f29e7e3afcd84fd886e4ae87c6f11fa5 [CANDIDATE]: Term 1 election: Requested vote from peers a005646a2679426a872350e51a876514 (127.17.223.2:41721), 2294471e25ca4bb286453b98d9a4bfca (127.17.223.1:42727)
I20260709 13:09:06.432582 29578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ca42effaa054b1ba471720fc3e5df74" candidate_uuid: "f29e7e3afcd84fd886e4ae87c6f11fa5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a005646a2679426a872350e51a876514"
I20260709 13:09:06.433087 29503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ca42effaa054b1ba471720fc3e5df74" candidate_uuid: "f29e7e3afcd84fd886e4ae87c6f11fa5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2294471e25ca4bb286453b98d9a4bfca"
I20260709 13:09:06.433135 29578 raft_consensus.cc:3060] T 4ca42effaa054b1ba471720fc3e5df74 P a005646a2679426a872350e51a876514 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:06.433689 29503 raft_consensus.cc:3060] T 4ca42effaa054b1ba471720fc3e5df74 P 2294471e25ca4bb286453b98d9a4bfca [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:06.438612 29578 raft_consensus.cc:2468] T 4ca42effaa054b1ba471720fc3e5df74 P a005646a2679426a872350e51a876514 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f29e7e3afcd84fd886e4ae87c6f11fa5 in term 1.
I20260709 13:09:06.438622 29503 raft_consensus.cc:2468] T 4ca42effaa054b1ba471720fc3e5df74 P 2294471e25ca4bb286453b98d9a4bfca [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f29e7e3afcd84fd886e4ae87c6f11fa5 in term 1.
I20260709 13:09:06.439893 29618 leader_election.cc:304] T 4ca42effaa054b1ba471720fc3e5df74 P f29e7e3afcd84fd886e4ae87c6f11fa5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a005646a2679426a872350e51a876514, f29e7e3afcd84fd886e4ae87c6f11fa5; no voters: 
I20260709 13:09:06.440589 29700 raft_consensus.cc:2804] T 4ca42effaa054b1ba471720fc3e5df74 P f29e7e3afcd84fd886e4ae87c6f11fa5 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:06.441686 29700 raft_consensus.cc:697] T 4ca42effaa054b1ba471720fc3e5df74 P f29e7e3afcd84fd886e4ae87c6f11fa5 [term 1 LEADER]: Becoming Leader. State: Replica: f29e7e3afcd84fd886e4ae87c6f11fa5, State: Running, Role: LEADER
I20260709 13:09:06.442500 29700 consensus_queue.cc:237] T 4ca42effaa054b1ba471720fc3e5df74 P f29e7e3afcd84fd886e4ae87c6f11fa5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a005646a2679426a872350e51a876514" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 41721 } } peers { permanent_uuid: "2294471e25ca4bb286453b98d9a4bfca" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 42727 } } peers { permanent_uuid: "f29e7e3afcd84fd886e4ae87c6f11fa5" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 44583 } }
I20260709 13:09:06.449220 29399 catalog_manager.cc:5697] T 4ca42effaa054b1ba471720fc3e5df74 P f29e7e3afcd84fd886e4ae87c6f11fa5 reported cstate change: term changed from 0 to 1, leader changed from <none> to f29e7e3afcd84fd886e4ae87c6f11fa5 (127.17.223.3). New cstate: current_term: 1 leader_uuid: "f29e7e3afcd84fd886e4ae87c6f11fa5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a005646a2679426a872350e51a876514" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 41721 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2294471e25ca4bb286453b98d9a4bfca" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 42727 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f29e7e3afcd84fd886e4ae87c6f11fa5" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 44583 } health_report { overall_health: HEALTHY } } }
I20260709 13:09:06.501906 29399 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:52698:
name: "multi_table_leader_balance_table2"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\377\377\377?""\004\001\000\377\377\377?"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:09:06.503896 29399 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table multi_table_leader_balance_table2 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:09:06.527763 29493 tablet_service.cc:1511] Processing CreateTablet for tablet 0d733091c3aa499bb26dfe5f169a9845 (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=0c254d6a934c431e946f18dc6a352a94]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 13:09:06.529054 29493 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0d733091c3aa499bb26dfe5f169a9845. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:06.528894 29568 tablet_service.cc:1511] Processing CreateTablet for tablet 0d733091c3aa499bb26dfe5f169a9845 (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=0c254d6a934c431e946f18dc6a352a94]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 13:09:06.530242 29568 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0d733091c3aa499bb26dfe5f169a9845. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:06.530323 29642 tablet_service.cc:1511] Processing CreateTablet for tablet 0d733091c3aa499bb26dfe5f169a9845 (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=0c254d6a934c431e946f18dc6a352a94]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 13:09:06.531605 29642 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0d733091c3aa499bb26dfe5f169a9845. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:06.535807 29641 tablet_service.cc:1511] Processing CreateTablet for tablet 61cc7ed9d640485ea43008cd1e0a94b0 (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=0c254d6a934c431e946f18dc6a352a94]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 13:09:06.536844 29567 tablet_service.cc:1511] Processing CreateTablet for tablet 61cc7ed9d640485ea43008cd1e0a94b0 (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=0c254d6a934c431e946f18dc6a352a94]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 13:09:06.537346 29641 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 61cc7ed9d640485ea43008cd1e0a94b0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:06.538199 29567 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 61cc7ed9d640485ea43008cd1e0a94b0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:06.536844 29492 tablet_service.cc:1511] Processing CreateTablet for tablet 61cc7ed9d640485ea43008cd1e0a94b0 (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=0c254d6a934c431e946f18dc6a352a94]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 13:09:06.541231 29492 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 61cc7ed9d640485ea43008cd1e0a94b0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:06.547956 29692 tablet_bootstrap.cc:492] T 0d733091c3aa499bb26dfe5f169a9845 P 2294471e25ca4bb286453b98d9a4bfca: Bootstrap starting.
I20260709 13:09:06.552472 29694 tablet_bootstrap.cc:492] T 0d733091c3aa499bb26dfe5f169a9845 P f29e7e3afcd84fd886e4ae87c6f11fa5: Bootstrap starting.
I20260709 13:09:06.555585 29692 tablet_bootstrap.cc:654] T 0d733091c3aa499bb26dfe5f169a9845 P 2294471e25ca4bb286453b98d9a4bfca: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:06.559031 29694 tablet_bootstrap.cc:654] T 0d733091c3aa499bb26dfe5f169a9845 P f29e7e3afcd84fd886e4ae87c6f11fa5: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:06.569417 29694 tablet_bootstrap.cc:492] T 0d733091c3aa499bb26dfe5f169a9845 P f29e7e3afcd84fd886e4ae87c6f11fa5: No bootstrap required, opened a new log
I20260709 13:09:06.570724 29691 tablet_bootstrap.cc:492] T 0d733091c3aa499bb26dfe5f169a9845 P a005646a2679426a872350e51a876514: Bootstrap starting.
I20260709 13:09:06.571058 29694 ts_tablet_manager.cc:1403] T 0d733091c3aa499bb26dfe5f169a9845 P f29e7e3afcd84fd886e4ae87c6f11fa5: Time spent bootstrapping tablet: real 0.019s	user 0.007s	sys 0.009s
I20260709 13:09:06.573112 29692 tablet_bootstrap.cc:492] T 0d733091c3aa499bb26dfe5f169a9845 P 2294471e25ca4bb286453b98d9a4bfca: No bootstrap required, opened a new log
I20260709 13:09:06.573679 29692 ts_tablet_manager.cc:1403] T 0d733091c3aa499bb26dfe5f169a9845 P 2294471e25ca4bb286453b98d9a4bfca: Time spent bootstrapping tablet: real 0.026s	user 0.009s	sys 0.008s
I20260709 13:09:06.574934 29694 raft_consensus.cc:359] T 0d733091c3aa499bb26dfe5f169a9845 P f29e7e3afcd84fd886e4ae87c6f11fa5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2294471e25ca4bb286453b98d9a4bfca" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 42727 } } peers { permanent_uuid: "a005646a2679426a872350e51a876514" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 41721 } } peers { permanent_uuid: "f29e7e3afcd84fd886e4ae87c6f11fa5" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 44583 } }
I20260709 13:09:06.575788 29694 raft_consensus.cc:385] T 0d733091c3aa499bb26dfe5f169a9845 P f29e7e3afcd84fd886e4ae87c6f11fa5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:06.576097 29694 raft_consensus.cc:740] T 0d733091c3aa499bb26dfe5f169a9845 P f29e7e3afcd84fd886e4ae87c6f11fa5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f29e7e3afcd84fd886e4ae87c6f11fa5, State: Initialized, Role: FOLLOWER
I20260709 13:09:06.577909 29691 tablet_bootstrap.cc:654] T 0d733091c3aa499bb26dfe5f169a9845 P a005646a2679426a872350e51a876514: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:06.577505 29694 consensus_queue.cc:260] T 0d733091c3aa499bb26dfe5f169a9845 P f29e7e3afcd84fd886e4ae87c6f11fa5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2294471e25ca4bb286453b98d9a4bfca" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 42727 } } peers { permanent_uuid: "a005646a2679426a872350e51a876514" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 41721 } } peers { permanent_uuid: "f29e7e3afcd84fd886e4ae87c6f11fa5" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 44583 } }
I20260709 13:09:06.576716 29692 raft_consensus.cc:359] T 0d733091c3aa499bb26dfe5f169a9845 P 2294471e25ca4bb286453b98d9a4bfca [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2294471e25ca4bb286453b98d9a4bfca" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 42727 } } peers { permanent_uuid: "a005646a2679426a872350e51a876514" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 41721 } } peers { permanent_uuid: "f29e7e3afcd84fd886e4ae87c6f11fa5" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 44583 } }
I20260709 13:09:06.583492 29692 raft_consensus.cc:385] T 0d733091c3aa499bb26dfe5f169a9845 P 2294471e25ca4bb286453b98d9a4bfca [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:06.584268 29692 raft_consensus.cc:740] T 0d733091c3aa499bb26dfe5f169a9845 P 2294471e25ca4bb286453b98d9a4bfca [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2294471e25ca4bb286453b98d9a4bfca, State: Initialized, Role: FOLLOWER
I20260709 13:09:06.585289 29694 ts_tablet_manager.cc:1434] T 0d733091c3aa499bb26dfe5f169a9845 P f29e7e3afcd84fd886e4ae87c6f11fa5: Time spent starting tablet: real 0.014s	user 0.006s	sys 0.000s
I20260709 13:09:06.585382 29692 consensus_queue.cc:260] T 0d733091c3aa499bb26dfe5f169a9845 P 2294471e25ca4bb286453b98d9a4bfca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2294471e25ca4bb286453b98d9a4bfca" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 42727 } } peers { permanent_uuid: "a005646a2679426a872350e51a876514" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 41721 } } peers { permanent_uuid: "f29e7e3afcd84fd886e4ae87c6f11fa5" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 44583 } }
I20260709 13:09:06.586755 29694 tablet_bootstrap.cc:492] T 61cc7ed9d640485ea43008cd1e0a94b0 P f29e7e3afcd84fd886e4ae87c6f11fa5: Bootstrap starting.
I20260709 13:09:06.592063 29692 ts_tablet_manager.cc:1434] T 0d733091c3aa499bb26dfe5f169a9845 P 2294471e25ca4bb286453b98d9a4bfca: Time spent starting tablet: real 0.018s	user 0.008s	sys 0.001s
I20260709 13:09:06.593000 29692 tablet_bootstrap.cc:492] T 61cc7ed9d640485ea43008cd1e0a94b0 P 2294471e25ca4bb286453b98d9a4bfca: Bootstrap starting.
I20260709 13:09:06.594563 29694 tablet_bootstrap.cc:654] T 61cc7ed9d640485ea43008cd1e0a94b0 P f29e7e3afcd84fd886e4ae87c6f11fa5: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:06.602466 29691 tablet_bootstrap.cc:492] T 0d733091c3aa499bb26dfe5f169a9845 P a005646a2679426a872350e51a876514: No bootstrap required, opened a new log
I20260709 13:09:06.602946 29691 ts_tablet_manager.cc:1403] T 0d733091c3aa499bb26dfe5f169a9845 P a005646a2679426a872350e51a876514: Time spent bootstrapping tablet: real 0.032s	user 0.012s	sys 0.011s
I20260709 13:09:06.605504 29691 raft_consensus.cc:359] T 0d733091c3aa499bb26dfe5f169a9845 P a005646a2679426a872350e51a876514 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2294471e25ca4bb286453b98d9a4bfca" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 42727 } } peers { permanent_uuid: "a005646a2679426a872350e51a876514" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 41721 } } peers { permanent_uuid: "f29e7e3afcd84fd886e4ae87c6f11fa5" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 44583 } }
I20260709 13:09:06.606238 29691 raft_consensus.cc:385] T 0d733091c3aa499bb26dfe5f169a9845 P a005646a2679426a872350e51a876514 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:06.606343 29692 tablet_bootstrap.cc:654] T 61cc7ed9d640485ea43008cd1e0a94b0 P 2294471e25ca4bb286453b98d9a4bfca: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:06.606426 29694 tablet_bootstrap.cc:492] T 61cc7ed9d640485ea43008cd1e0a94b0 P f29e7e3afcd84fd886e4ae87c6f11fa5: No bootstrap required, opened a new log
I20260709 13:09:06.606596 29691 raft_consensus.cc:740] T 0d733091c3aa499bb26dfe5f169a9845 P a005646a2679426a872350e51a876514 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a005646a2679426a872350e51a876514, State: Initialized, Role: FOLLOWER
I20260709 13:09:06.607391 29694 ts_tablet_manager.cc:1403] T 61cc7ed9d640485ea43008cd1e0a94b0 P f29e7e3afcd84fd886e4ae87c6f11fa5: Time spent bootstrapping tablet: real 0.021s	user 0.017s	sys 0.002s
I20260709 13:09:06.607759 29691 consensus_queue.cc:260] T 0d733091c3aa499bb26dfe5f169a9845 P a005646a2679426a872350e51a876514 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2294471e25ca4bb286453b98d9a4bfca" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 42727 } } peers { permanent_uuid: "a005646a2679426a872350e51a876514" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 41721 } } peers { permanent_uuid: "f29e7e3afcd84fd886e4ae87c6f11fa5" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 44583 } }
I20260709 13:09:06.611629 29691 ts_tablet_manager.cc:1434] T 0d733091c3aa499bb26dfe5f169a9845 P a005646a2679426a872350e51a876514: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 13:09:06.612409 29692 tablet_bootstrap.cc:492] T 61cc7ed9d640485ea43008cd1e0a94b0 P 2294471e25ca4bb286453b98d9a4bfca: No bootstrap required, opened a new log
I20260709 13:09:06.612756 29691 tablet_bootstrap.cc:492] T 61cc7ed9d640485ea43008cd1e0a94b0 P a005646a2679426a872350e51a876514: Bootstrap starting.
I20260709 13:09:06.612937 29692 ts_tablet_manager.cc:1403] T 61cc7ed9d640485ea43008cd1e0a94b0 P 2294471e25ca4bb286453b98d9a4bfca: Time spent bootstrapping tablet: real 0.020s	user 0.007s	sys 0.004s
I20260709 13:09:06.610705 29694 raft_consensus.cc:359] T 61cc7ed9d640485ea43008cd1e0a94b0 P f29e7e3afcd84fd886e4ae87c6f11fa5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2294471e25ca4bb286453b98d9a4bfca" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 42727 } } peers { permanent_uuid: "a005646a2679426a872350e51a876514" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 41721 } } peers { permanent_uuid: "f29e7e3afcd84fd886e4ae87c6f11fa5" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 44583 } }
I20260709 13:09:06.614825 29694 raft_consensus.cc:385] T 61cc7ed9d640485ea43008cd1e0a94b0 P f29e7e3afcd84fd886e4ae87c6f11fa5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:06.615207 29694 raft_consensus.cc:740] T 61cc7ed9d640485ea43008cd1e0a94b0 P f29e7e3afcd84fd886e4ae87c6f11fa5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f29e7e3afcd84fd886e4ae87c6f11fa5, State: Initialized, Role: FOLLOWER
I20260709 13:09:06.616132 29692 raft_consensus.cc:359] T 61cc7ed9d640485ea43008cd1e0a94b0 P 2294471e25ca4bb286453b98d9a4bfca [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2294471e25ca4bb286453b98d9a4bfca" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 42727 } } peers { permanent_uuid: "a005646a2679426a872350e51a876514" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 41721 } } peers { permanent_uuid: "f29e7e3afcd84fd886e4ae87c6f11fa5" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 44583 } }
I20260709 13:09:06.616164 29694 consensus_queue.cc:260] T 61cc7ed9d640485ea43008cd1e0a94b0 P f29e7e3afcd84fd886e4ae87c6f11fa5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2294471e25ca4bb286453b98d9a4bfca" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 42727 } } peers { permanent_uuid: "a005646a2679426a872350e51a876514" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 41721 } } peers { permanent_uuid: "f29e7e3afcd84fd886e4ae87c6f11fa5" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 44583 } }
I20260709 13:09:06.617108 29692 raft_consensus.cc:385] T 61cc7ed9d640485ea43008cd1e0a94b0 P 2294471e25ca4bb286453b98d9a4bfca [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:06.617468 29692 raft_consensus.cc:740] T 61cc7ed9d640485ea43008cd1e0a94b0 P 2294471e25ca4bb286453b98d9a4bfca [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2294471e25ca4bb286453b98d9a4bfca, State: Initialized, Role: FOLLOWER
I20260709 13:09:06.618366 29692 consensus_queue.cc:260] T 61cc7ed9d640485ea43008cd1e0a94b0 P 2294471e25ca4bb286453b98d9a4bfca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2294471e25ca4bb286453b98d9a4bfca" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 42727 } } peers { permanent_uuid: "a005646a2679426a872350e51a876514" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 41721 } } peers { permanent_uuid: "f29e7e3afcd84fd886e4ae87c6f11fa5" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 44583 } }
I20260709 13:09:06.620072 29691 tablet_bootstrap.cc:654] T 61cc7ed9d640485ea43008cd1e0a94b0 P a005646a2679426a872350e51a876514: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:06.621241 29694 ts_tablet_manager.cc:1434] T 61cc7ed9d640485ea43008cd1e0a94b0 P f29e7e3afcd84fd886e4ae87c6f11fa5: Time spent starting tablet: real 0.013s	user 0.006s	sys 0.000s
I20260709 13:09:06.623760 29692 ts_tablet_manager.cc:1434] T 61cc7ed9d640485ea43008cd1e0a94b0 P 2294471e25ca4bb286453b98d9a4bfca: Time spent starting tablet: real 0.010s	user 0.009s	sys 0.000s
I20260709 13:09:06.627058 29691 tablet_bootstrap.cc:492] T 61cc7ed9d640485ea43008cd1e0a94b0 P a005646a2679426a872350e51a876514: No bootstrap required, opened a new log
I20260709 13:09:06.627619 29691 ts_tablet_manager.cc:1403] T 61cc7ed9d640485ea43008cd1e0a94b0 P a005646a2679426a872350e51a876514: Time spent bootstrapping tablet: real 0.015s	user 0.009s	sys 0.003s
I20260709 13:09:06.630641 29691 raft_consensus.cc:359] T 61cc7ed9d640485ea43008cd1e0a94b0 P a005646a2679426a872350e51a876514 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2294471e25ca4bb286453b98d9a4bfca" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 42727 } } peers { permanent_uuid: "a005646a2679426a872350e51a876514" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 41721 } } peers { permanent_uuid: "f29e7e3afcd84fd886e4ae87c6f11fa5" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 44583 } }
I20260709 13:09:06.631417 29691 raft_consensus.cc:385] T 61cc7ed9d640485ea43008cd1e0a94b0 P a005646a2679426a872350e51a876514 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:06.631740 29691 raft_consensus.cc:740] T 61cc7ed9d640485ea43008cd1e0a94b0 P a005646a2679426a872350e51a876514 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a005646a2679426a872350e51a876514, State: Initialized, Role: FOLLOWER
I20260709 13:09:06.632318 29691 consensus_queue.cc:260] T 61cc7ed9d640485ea43008cd1e0a94b0 P a005646a2679426a872350e51a876514 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2294471e25ca4bb286453b98d9a4bfca" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 42727 } } peers { permanent_uuid: "a005646a2679426a872350e51a876514" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 41721 } } peers { permanent_uuid: "f29e7e3afcd84fd886e4ae87c6f11fa5" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 44583 } }
I20260709 13:09:06.634251 29691 ts_tablet_manager.cc:1434] T 61cc7ed9d640485ea43008cd1e0a94b0 P a005646a2679426a872350e51a876514: Time spent starting tablet: real 0.006s	user 0.001s	sys 0.003s
I20260709 13:09:06.700157 29700 raft_consensus.cc:493] T 0d733091c3aa499bb26dfe5f169a9845 P f29e7e3afcd84fd886e4ae87c6f11fa5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:06.700731 29700 raft_consensus.cc:515] T 0d733091c3aa499bb26dfe5f169a9845 P f29e7e3afcd84fd886e4ae87c6f11fa5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2294471e25ca4bb286453b98d9a4bfca" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 42727 } } peers { permanent_uuid: "a005646a2679426a872350e51a876514" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 41721 } } peers { permanent_uuid: "f29e7e3afcd84fd886e4ae87c6f11fa5" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 44583 } }
I20260709 13:09:06.702385 29700 leader_election.cc:290] T 0d733091c3aa499bb26dfe5f169a9845 P f29e7e3afcd84fd886e4ae87c6f11fa5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2294471e25ca4bb286453b98d9a4bfca (127.17.223.1:42727), a005646a2679426a872350e51a876514 (127.17.223.2:41721)
I20260709 13:09:06.703569 29578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d733091c3aa499bb26dfe5f169a9845" candidate_uuid: "f29e7e3afcd84fd886e4ae87c6f11fa5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a005646a2679426a872350e51a876514" is_pre_election: true
I20260709 13:09:06.703480 29503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d733091c3aa499bb26dfe5f169a9845" candidate_uuid: "f29e7e3afcd84fd886e4ae87c6f11fa5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2294471e25ca4bb286453b98d9a4bfca" is_pre_election: true
I20260709 13:09:06.704401 29578 raft_consensus.cc:2468] T 0d733091c3aa499bb26dfe5f169a9845 P a005646a2679426a872350e51a876514 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f29e7e3afcd84fd886e4ae87c6f11fa5 in term 0.
I20260709 13:09:06.704530 29503 raft_consensus.cc:2468] T 0d733091c3aa499bb26dfe5f169a9845 P 2294471e25ca4bb286453b98d9a4bfca [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f29e7e3afcd84fd886e4ae87c6f11fa5 in term 0.
I20260709 13:09:06.705404 29618 leader_election.cc:304] T 0d733091c3aa499bb26dfe5f169a9845 P f29e7e3afcd84fd886e4ae87c6f11fa5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a005646a2679426a872350e51a876514, f29e7e3afcd84fd886e4ae87c6f11fa5; no voters: 
I20260709 13:09:06.706095 29700 raft_consensus.cc:2804] T 0d733091c3aa499bb26dfe5f169a9845 P f29e7e3afcd84fd886e4ae87c6f11fa5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:06.706470 29700 raft_consensus.cc:493] T 0d733091c3aa499bb26dfe5f169a9845 P f29e7e3afcd84fd886e4ae87c6f11fa5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:06.706791 29700 raft_consensus.cc:3060] T 0d733091c3aa499bb26dfe5f169a9845 P f29e7e3afcd84fd886e4ae87c6f11fa5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:06.712554 29700 raft_consensus.cc:515] T 0d733091c3aa499bb26dfe5f169a9845 P f29e7e3afcd84fd886e4ae87c6f11fa5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2294471e25ca4bb286453b98d9a4bfca" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 42727 } } peers { permanent_uuid: "a005646a2679426a872350e51a876514" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 41721 } } peers { permanent_uuid: "f29e7e3afcd84fd886e4ae87c6f11fa5" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 44583 } }
I20260709 13:09:06.714197 29700 leader_election.cc:290] T 0d733091c3aa499bb26dfe5f169a9845 P f29e7e3afcd84fd886e4ae87c6f11fa5 [CANDIDATE]: Term 1 election: Requested vote from peers 2294471e25ca4bb286453b98d9a4bfca (127.17.223.1:42727), a005646a2679426a872350e51a876514 (127.17.223.2:41721)
I20260709 13:09:06.715097 29503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d733091c3aa499bb26dfe5f169a9845" candidate_uuid: "f29e7e3afcd84fd886e4ae87c6f11fa5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2294471e25ca4bb286453b98d9a4bfca"
I20260709 13:09:06.715248 29578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d733091c3aa499bb26dfe5f169a9845" candidate_uuid: "f29e7e3afcd84fd886e4ae87c6f11fa5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a005646a2679426a872350e51a876514"
I20260709 13:09:06.715730 29503 raft_consensus.cc:3060] T 0d733091c3aa499bb26dfe5f169a9845 P 2294471e25ca4bb286453b98d9a4bfca [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:06.715855 29578 raft_consensus.cc:3060] T 0d733091c3aa499bb26dfe5f169a9845 P a005646a2679426a872350e51a876514 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:06.720641 29503 raft_consensus.cc:2468] T 0d733091c3aa499bb26dfe5f169a9845 P 2294471e25ca4bb286453b98d9a4bfca [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f29e7e3afcd84fd886e4ae87c6f11fa5 in term 1.
I20260709 13:09:06.720656 29578 raft_consensus.cc:2468] T 0d733091c3aa499bb26dfe5f169a9845 P a005646a2679426a872350e51a876514 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f29e7e3afcd84fd886e4ae87c6f11fa5 in term 1.
I20260709 13:09:06.721825 29616 leader_election.cc:304] T 0d733091c3aa499bb26dfe5f169a9845 P f29e7e3afcd84fd886e4ae87c6f11fa5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2294471e25ca4bb286453b98d9a4bfca, f29e7e3afcd84fd886e4ae87c6f11fa5; no voters: 
I20260709 13:09:06.722582 29700 raft_consensus.cc:2804] T 0d733091c3aa499bb26dfe5f169a9845 P f29e7e3afcd84fd886e4ae87c6f11fa5 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:06.723119 29700 raft_consensus.cc:697] T 0d733091c3aa499bb26dfe5f169a9845 P f29e7e3afcd84fd886e4ae87c6f11fa5 [term 1 LEADER]: Becoming Leader. State: Replica: f29e7e3afcd84fd886e4ae87c6f11fa5, State: Running, Role: LEADER
I20260709 13:09:06.723973 29700 consensus_queue.cc:237] T 0d733091c3aa499bb26dfe5f169a9845 P f29e7e3afcd84fd886e4ae87c6f11fa5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2294471e25ca4bb286453b98d9a4bfca" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 42727 } } peers { permanent_uuid: "a005646a2679426a872350e51a876514" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 41721 } } peers { permanent_uuid: "f29e7e3afcd84fd886e4ae87c6f11fa5" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 44583 } }
I20260709 13:09:06.731317 29399 catalog_manager.cc:5697] T 0d733091c3aa499bb26dfe5f169a9845 P f29e7e3afcd84fd886e4ae87c6f11fa5 reported cstate change: term changed from 0 to 1, leader changed from <none> to f29e7e3afcd84fd886e4ae87c6f11fa5 (127.17.223.3). New cstate: current_term: 1 leader_uuid: "f29e7e3afcd84fd886e4ae87c6f11fa5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2294471e25ca4bb286453b98d9a4bfca" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 42727 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a005646a2679426a872350e51a876514" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 41721 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f29e7e3afcd84fd886e4ae87c6f11fa5" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 44583 } health_report { overall_health: HEALTHY } } }
W20260709 13:09:06.781800 29449 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:09:06.806028 29696 consensus_queue.cc:1048] T 17fdbe28610741beabfd7b7f8835d70c P a005646a2679426a872350e51a876514 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f29e7e3afcd84fd886e4ae87c6f11fa5" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 44583 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:06.819039 29704 consensus_queue.cc:1048] T 17fdbe28610741beabfd7b7f8835d70c P a005646a2679426a872350e51a876514 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2294471e25ca4bb286453b98d9a4bfca" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 42727 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:09:06.867710 29723 raft_consensus.cc:493] T 61cc7ed9d640485ea43008cd1e0a94b0 P a005646a2679426a872350e51a876514 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:06.868180 29723 raft_consensus.cc:515] T 61cc7ed9d640485ea43008cd1e0a94b0 P a005646a2679426a872350e51a876514 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2294471e25ca4bb286453b98d9a4bfca" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 42727 } } peers { permanent_uuid: "a005646a2679426a872350e51a876514" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 41721 } } peers { permanent_uuid: "f29e7e3afcd84fd886e4ae87c6f11fa5" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 44583 } }
I20260709 13:09:06.870155 29723 leader_election.cc:290] T 61cc7ed9d640485ea43008cd1e0a94b0 P a005646a2679426a872350e51a876514 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2294471e25ca4bb286453b98d9a4bfca (127.17.223.1:42727), f29e7e3afcd84fd886e4ae87c6f11fa5 (127.17.223.3:44583)
I20260709 13:09:06.870898 29503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61cc7ed9d640485ea43008cd1e0a94b0" candidate_uuid: "a005646a2679426a872350e51a876514" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2294471e25ca4bb286453b98d9a4bfca" is_pre_election: true
I20260709 13:09:06.871260 29652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61cc7ed9d640485ea43008cd1e0a94b0" candidate_uuid: "a005646a2679426a872350e51a876514" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f29e7e3afcd84fd886e4ae87c6f11fa5" is_pre_election: true
I20260709 13:09:06.871649 29503 raft_consensus.cc:2468] T 61cc7ed9d640485ea43008cd1e0a94b0 P 2294471e25ca4bb286453b98d9a4bfca [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a005646a2679426a872350e51a876514 in term 0.
I20260709 13:09:06.872037 29652 raft_consensus.cc:2468] T 61cc7ed9d640485ea43008cd1e0a94b0 P f29e7e3afcd84fd886e4ae87c6f11fa5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a005646a2679426a872350e51a876514 in term 0.
I20260709 13:09:06.872982 29542 leader_election.cc:304] T 61cc7ed9d640485ea43008cd1e0a94b0 P a005646a2679426a872350e51a876514 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2294471e25ca4bb286453b98d9a4bfca, a005646a2679426a872350e51a876514; no voters: 
I20260709 13:09:06.873639 29723 raft_consensus.cc:2804] T 61cc7ed9d640485ea43008cd1e0a94b0 P a005646a2679426a872350e51a876514 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:06.873970 29723 raft_consensus.cc:493] T 61cc7ed9d640485ea43008cd1e0a94b0 P a005646a2679426a872350e51a876514 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:06.874248 29723 raft_consensus.cc:3060] T 61cc7ed9d640485ea43008cd1e0a94b0 P a005646a2679426a872350e51a876514 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:06.879626 29723 raft_consensus.cc:515] T 61cc7ed9d640485ea43008cd1e0a94b0 P a005646a2679426a872350e51a876514 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2294471e25ca4bb286453b98d9a4bfca" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 42727 } } peers { permanent_uuid: "a005646a2679426a872350e51a876514" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 41721 } } peers { permanent_uuid: "f29e7e3afcd84fd886e4ae87c6f11fa5" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 44583 } }
I20260709 13:09:06.881569 29723 leader_election.cc:290] T 61cc7ed9d640485ea43008cd1e0a94b0 P a005646a2679426a872350e51a876514 [CANDIDATE]: Term 1 election: Requested vote from peers 2294471e25ca4bb286453b98d9a4bfca (127.17.223.1:42727), f29e7e3afcd84fd886e4ae87c6f11fa5 (127.17.223.3:44583)
I20260709 13:09:06.882462 29503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61cc7ed9d640485ea43008cd1e0a94b0" candidate_uuid: "a005646a2679426a872350e51a876514" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2294471e25ca4bb286453b98d9a4bfca"
I20260709 13:09:06.882804 29652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61cc7ed9d640485ea43008cd1e0a94b0" candidate_uuid: "a005646a2679426a872350e51a876514" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f29e7e3afcd84fd886e4ae87c6f11fa5"
I20260709 13:09:06.883656 29503 raft_consensus.cc:3060] T 61cc7ed9d640485ea43008cd1e0a94b0 P 2294471e25ca4bb286453b98d9a4bfca [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:06.883692 29652 raft_consensus.cc:3060] T 61cc7ed9d640485ea43008cd1e0a94b0 P f29e7e3afcd84fd886e4ae87c6f11fa5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:06.888913 29652 raft_consensus.cc:2468] T 61cc7ed9d640485ea43008cd1e0a94b0 P f29e7e3afcd84fd886e4ae87c6f11fa5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a005646a2679426a872350e51a876514 in term 1.
I20260709 13:09:06.888913 29503 raft_consensus.cc:2468] T 61cc7ed9d640485ea43008cd1e0a94b0 P 2294471e25ca4bb286453b98d9a4bfca [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a005646a2679426a872350e51a876514 in term 1.
I20260709 13:09:06.890141 29542 leader_election.cc:304] T 61cc7ed9d640485ea43008cd1e0a94b0 P a005646a2679426a872350e51a876514 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a005646a2679426a872350e51a876514, f29e7e3afcd84fd886e4ae87c6f11fa5; no voters: 
I20260709 13:09:06.890892 29723 raft_consensus.cc:2804] T 61cc7ed9d640485ea43008cd1e0a94b0 P a005646a2679426a872350e51a876514 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:06.891299 29723 raft_consensus.cc:697] T 61cc7ed9d640485ea43008cd1e0a94b0 P a005646a2679426a872350e51a876514 [term 1 LEADER]: Becoming Leader. State: Replica: a005646a2679426a872350e51a876514, State: Running, Role: LEADER
I20260709 13:09:06.891935 29723 consensus_queue.cc:237] T 61cc7ed9d640485ea43008cd1e0a94b0 P a005646a2679426a872350e51a876514 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2294471e25ca4bb286453b98d9a4bfca" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 42727 } } peers { permanent_uuid: "a005646a2679426a872350e51a876514" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 41721 } } peers { permanent_uuid: "f29e7e3afcd84fd886e4ae87c6f11fa5" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 44583 } }
I20260709 13:09:06.899931 29400 catalog_manager.cc:5697] T 61cc7ed9d640485ea43008cd1e0a94b0 P a005646a2679426a872350e51a876514 reported cstate change: term changed from 0 to 1, leader changed from <none> to a005646a2679426a872350e51a876514 (127.17.223.2). New cstate: current_term: 1 leader_uuid: "a005646a2679426a872350e51a876514" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2294471e25ca4bb286453b98d9a4bfca" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 42727 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a005646a2679426a872350e51a876514" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 41721 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f29e7e3afcd84fd886e4ae87c6f11fa5" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 44583 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:06.955747 29652 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4ca42effaa054b1ba471720fc3e5df74"
dest_uuid: "f29e7e3afcd84fd886e4ae87c6f11fa5"
mode: GRACEFUL
new_leader_uuid: "2294471e25ca4bb286453b98d9a4bfca"
 from {username='slave'} at 127.0.0.1:44402
I20260709 13:09:06.956319 29652 raft_consensus.cc:606] T 4ca42effaa054b1ba471720fc3e5df74 P f29e7e3afcd84fd886e4ae87c6f11fa5 [term 1 LEADER]: Received request to transfer leadership to TS 2294471e25ca4bb286453b98d9a4bfca
I20260709 13:09:06.965369 29652 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0d733091c3aa499bb26dfe5f169a9845"
dest_uuid: "f29e7e3afcd84fd886e4ae87c6f11fa5"
mode: GRACEFUL
new_leader_uuid: "2294471e25ca4bb286453b98d9a4bfca"
 from {username='slave'} at 127.0.0.1:44402
I20260709 13:09:06.965619 29700 consensus_queue.cc:1048] T 4ca42effaa054b1ba471720fc3e5df74 P f29e7e3afcd84fd886e4ae87c6f11fa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a005646a2679426a872350e51a876514" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 41721 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:06.965956 29652 raft_consensus.cc:606] T 0d733091c3aa499bb26dfe5f169a9845 P f29e7e3afcd84fd886e4ae87c6f11fa5 [term 1 LEADER]: Received request to transfer leadership to TS 2294471e25ca4bb286453b98d9a4bfca
I20260709 13:09:06.977530 29700 consensus_queue.cc:1048] T 4ca42effaa054b1ba471720fc3e5df74 P f29e7e3afcd84fd886e4ae87c6f11fa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2294471e25ca4bb286453b98d9a4bfca" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 42727 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:06.985399 29578 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "61cc7ed9d640485ea43008cd1e0a94b0"
dest_uuid: "a005646a2679426a872350e51a876514"
mode: GRACEFUL
new_leader_uuid: "2294471e25ca4bb286453b98d9a4bfca"
 from {username='slave'} at 127.0.0.1:37048
I20260709 13:09:06.986099 29578 raft_consensus.cc:606] T 61cc7ed9d640485ea43008cd1e0a94b0 P a005646a2679426a872350e51a876514 [term 1 LEADER]: Received request to transfer leadership to TS 2294471e25ca4bb286453b98d9a4bfca
I20260709 13:09:06.990904 29700 raft_consensus.cc:993] T 4ca42effaa054b1ba471720fc3e5df74 P f29e7e3afcd84fd886e4ae87c6f11fa5: : Instructing follower 2294471e25ca4bb286453b98d9a4bfca to start an election
I20260709 13:09:06.991391 29700 raft_consensus.cc:1081] T 4ca42effaa054b1ba471720fc3e5df74 P f29e7e3afcd84fd886e4ae87c6f11fa5 [term 1 LEADER]: Signalling peer 2294471e25ca4bb286453b98d9a4bfca to start an election
I20260709 13:09:06.995194 29502 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "4ca42effaa054b1ba471720fc3e5df74"
dest_uuid: "2294471e25ca4bb286453b98d9a4bfca"
 from {username='slave'} at 127.0.0.1:37312
I20260709 13:09:06.995922 29502 raft_consensus.cc:493] T 4ca42effaa054b1ba471720fc3e5df74 P 2294471e25ca4bb286453b98d9a4bfca [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:09:06.996323 29502 raft_consensus.cc:3060] T 4ca42effaa054b1ba471720fc3e5df74 P 2294471e25ca4bb286453b98d9a4bfca [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:07.003952 29502 raft_consensus.cc:515] T 4ca42effaa054b1ba471720fc3e5df74 P 2294471e25ca4bb286453b98d9a4bfca [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a005646a2679426a872350e51a876514" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 41721 } } peers { permanent_uuid: "2294471e25ca4bb286453b98d9a4bfca" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 42727 } } peers { permanent_uuid: "f29e7e3afcd84fd886e4ae87c6f11fa5" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 44583 } }
I20260709 13:09:07.011152 29502 leader_election.cc:290] T 4ca42effaa054b1ba471720fc3e5df74 P 2294471e25ca4bb286453b98d9a4bfca [CANDIDATE]: Term 2 election: Requested vote from peers a005646a2679426a872350e51a876514 (127.17.223.2:41721), f29e7e3afcd84fd886e4ae87c6f11fa5 (127.17.223.3:44583)
I20260709 13:09:07.019356 29578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ca42effaa054b1ba471720fc3e5df74" candidate_uuid: "2294471e25ca4bb286453b98d9a4bfca" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "a005646a2679426a872350e51a876514"
I20260709 13:09:07.020018 29578 raft_consensus.cc:3060] T 4ca42effaa054b1ba471720fc3e5df74 P a005646a2679426a872350e51a876514 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:07.021512 29652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ca42effaa054b1ba471720fc3e5df74" candidate_uuid: "2294471e25ca4bb286453b98d9a4bfca" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f29e7e3afcd84fd886e4ae87c6f11fa5"
I20260709 13:09:07.022184 29652 raft_consensus.cc:3055] T 4ca42effaa054b1ba471720fc3e5df74 P f29e7e3afcd84fd886e4ae87c6f11fa5 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:09:07.022521 29652 raft_consensus.cc:740] T 4ca42effaa054b1ba471720fc3e5df74 P f29e7e3afcd84fd886e4ae87c6f11fa5 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: f29e7e3afcd84fd886e4ae87c6f11fa5, State: Running, Role: LEADER
I20260709 13:09:07.023368 29652 consensus_queue.cc:260] T 4ca42effaa054b1ba471720fc3e5df74 P f29e7e3afcd84fd886e4ae87c6f11fa5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a005646a2679426a872350e51a876514" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 41721 } } peers { permanent_uuid: "2294471e25ca4bb286453b98d9a4bfca" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 42727 } } peers { permanent_uuid: "f29e7e3afcd84fd886e4ae87c6f11fa5" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 44583 } }
I20260709 13:09:07.024555 29652 raft_consensus.cc:3060] T 4ca42effaa054b1ba471720fc3e5df74 P f29e7e3afcd84fd886e4ae87c6f11fa5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:07.026388 29578 raft_consensus.cc:2468] T 4ca42effaa054b1ba471720fc3e5df74 P a005646a2679426a872350e51a876514 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2294471e25ca4bb286453b98d9a4bfca in term 2.
I20260709 13:09:07.027812 29469 leader_election.cc:304] T 4ca42effaa054b1ba471720fc3e5df74 P 2294471e25ca4bb286453b98d9a4bfca [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2294471e25ca4bb286453b98d9a4bfca, a005646a2679426a872350e51a876514; no voters: 
I20260709 13:09:07.028649 29697 raft_consensus.cc:2804] T 4ca42effaa054b1ba471720fc3e5df74 P 2294471e25ca4bb286453b98d9a4bfca [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:09:07.030035 29697 raft_consensus.cc:697] T 4ca42effaa054b1ba471720fc3e5df74 P 2294471e25ca4bb286453b98d9a4bfca [term 2 LEADER]: Becoming Leader. State: Replica: 2294471e25ca4bb286453b98d9a4bfca, State: Running, Role: LEADER
I20260709 13:09:07.030915 29697 consensus_queue.cc:237] T 4ca42effaa054b1ba471720fc3e5df74 P 2294471e25ca4bb286453b98d9a4bfca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a005646a2679426a872350e51a876514" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 41721 } } peers { permanent_uuid: "2294471e25ca4bb286453b98d9a4bfca" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 42727 } } peers { permanent_uuid: "f29e7e3afcd84fd886e4ae87c6f11fa5" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 44583 } }
I20260709 13:09:07.031654 29652 raft_consensus.cc:2468] T 4ca42effaa054b1ba471720fc3e5df74 P f29e7e3afcd84fd886e4ae87c6f11fa5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2294471e25ca4bb286453b98d9a4bfca in term 2.
I20260709 13:09:07.037232 29401 catalog_manager.cc:5697] T 4ca42effaa054b1ba471720fc3e5df74 P 2294471e25ca4bb286453b98d9a4bfca reported cstate change: term changed from 1 to 2, leader changed from f29e7e3afcd84fd886e4ae87c6f11fa5 (127.17.223.3) to 2294471e25ca4bb286453b98d9a4bfca (127.17.223.1). New cstate: current_term: 2 leader_uuid: "2294471e25ca4bb286453b98d9a4bfca" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a005646a2679426a872350e51a876514" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 41721 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2294471e25ca4bb286453b98d9a4bfca" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 42727 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f29e7e3afcd84fd886e4ae87c6f11fa5" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 44583 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:07.246269 29732 consensus_queue.cc:1048] T 0d733091c3aa499bb26dfe5f169a9845 P f29e7e3afcd84fd886e4ae87c6f11fa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a005646a2679426a872350e51a876514" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 41721 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:07.259068 29707 consensus_queue.cc:1048] T 0d733091c3aa499bb26dfe5f169a9845 P f29e7e3afcd84fd886e4ae87c6f11fa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2294471e25ca4bb286453b98d9a4bfca" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 42727 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:07.266582 29738 raft_consensus.cc:993] T 0d733091c3aa499bb26dfe5f169a9845 P f29e7e3afcd84fd886e4ae87c6f11fa5: : Instructing follower 2294471e25ca4bb286453b98d9a4bfca to start an election
I20260709 13:09:07.267151 29707 raft_consensus.cc:1081] T 0d733091c3aa499bb26dfe5f169a9845 P f29e7e3afcd84fd886e4ae87c6f11fa5 [term 1 LEADER]: Signalling peer 2294471e25ca4bb286453b98d9a4bfca to start an election
I20260709 13:09:07.268937 29502 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "0d733091c3aa499bb26dfe5f169a9845"
dest_uuid: "2294471e25ca4bb286453b98d9a4bfca"
 from {username='slave'} at 127.0.0.1:37312
I20260709 13:09:07.269611 29502 raft_consensus.cc:493] T 0d733091c3aa499bb26dfe5f169a9845 P 2294471e25ca4bb286453b98d9a4bfca [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:09:07.270112 29502 raft_consensus.cc:3060] T 0d733091c3aa499bb26dfe5f169a9845 P 2294471e25ca4bb286453b98d9a4bfca [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:07.277034 29502 raft_consensus.cc:515] T 0d733091c3aa499bb26dfe5f169a9845 P 2294471e25ca4bb286453b98d9a4bfca [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2294471e25ca4bb286453b98d9a4bfca" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 42727 } } peers { permanent_uuid: "a005646a2679426a872350e51a876514" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 41721 } } peers { permanent_uuid: "f29e7e3afcd84fd886e4ae87c6f11fa5" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 44583 } }
I20260709 13:09:07.279768 29578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d733091c3aa499bb26dfe5f169a9845" candidate_uuid: "2294471e25ca4bb286453b98d9a4bfca" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "a005646a2679426a872350e51a876514"
I20260709 13:09:07.280398 29578 raft_consensus.cc:3060] T 0d733091c3aa499bb26dfe5f169a9845 P a005646a2679426a872350e51a876514 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:07.281595 29652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d733091c3aa499bb26dfe5f169a9845" candidate_uuid: "2294471e25ca4bb286453b98d9a4bfca" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f29e7e3afcd84fd886e4ae87c6f11fa5"
I20260709 13:09:07.282235 29652 raft_consensus.cc:3055] T 0d733091c3aa499bb26dfe5f169a9845 P f29e7e3afcd84fd886e4ae87c6f11fa5 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:09:07.282546 29652 raft_consensus.cc:740] T 0d733091c3aa499bb26dfe5f169a9845 P f29e7e3afcd84fd886e4ae87c6f11fa5 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: f29e7e3afcd84fd886e4ae87c6f11fa5, State: Running, Role: LEADER
I20260709 13:09:07.283464 29652 consensus_queue.cc:260] T 0d733091c3aa499bb26dfe5f169a9845 P f29e7e3afcd84fd886e4ae87c6f11fa5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2294471e25ca4bb286453b98d9a4bfca" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 42727 } } peers { permanent_uuid: "a005646a2679426a872350e51a876514" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 41721 } } peers { permanent_uuid: "f29e7e3afcd84fd886e4ae87c6f11fa5" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 44583 } }
I20260709 13:09:07.284582 29652 raft_consensus.cc:3060] T 0d733091c3aa499bb26dfe5f169a9845 P f29e7e3afcd84fd886e4ae87c6f11fa5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:07.285410 29502 leader_election.cc:290] T 0d733091c3aa499bb26dfe5f169a9845 P 2294471e25ca4bb286453b98d9a4bfca [CANDIDATE]: Term 2 election: Requested vote from peers a005646a2679426a872350e51a876514 (127.17.223.2:41721), f29e7e3afcd84fd886e4ae87c6f11fa5 (127.17.223.3:44583)
I20260709 13:09:07.288120 29578 raft_consensus.cc:2468] T 0d733091c3aa499bb26dfe5f169a9845 P a005646a2679426a872350e51a876514 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2294471e25ca4bb286453b98d9a4bfca in term 2.
I20260709 13:09:07.289364 29469 leader_election.cc:304] T 0d733091c3aa499bb26dfe5f169a9845 P 2294471e25ca4bb286453b98d9a4bfca [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2294471e25ca4bb286453b98d9a4bfca, a005646a2679426a872350e51a876514; no voters: 
I20260709 13:09:07.290278 29697 raft_consensus.cc:2804] T 0d733091c3aa499bb26dfe5f169a9845 P 2294471e25ca4bb286453b98d9a4bfca [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:09:07.290756 29697 raft_consensus.cc:697] T 0d733091c3aa499bb26dfe5f169a9845 P 2294471e25ca4bb286453b98d9a4bfca [term 2 LEADER]: Becoming Leader. State: Replica: 2294471e25ca4bb286453b98d9a4bfca, State: Running, Role: LEADER
I20260709 13:09:07.291669 29652 raft_consensus.cc:2468] T 0d733091c3aa499bb26dfe5f169a9845 P f29e7e3afcd84fd886e4ae87c6f11fa5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2294471e25ca4bb286453b98d9a4bfca in term 2.
I20260709 13:09:07.291538 29697 consensus_queue.cc:237] T 0d733091c3aa499bb26dfe5f169a9845 P 2294471e25ca4bb286453b98d9a4bfca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2294471e25ca4bb286453b98d9a4bfca" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 42727 } } peers { permanent_uuid: "a005646a2679426a872350e51a876514" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 41721 } } peers { permanent_uuid: "f29e7e3afcd84fd886e4ae87c6f11fa5" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 44583 } }
I20260709 13:09:07.297942 29400 catalog_manager.cc:5697] T 0d733091c3aa499bb26dfe5f169a9845 P 2294471e25ca4bb286453b98d9a4bfca reported cstate change: term changed from 1 to 2, leader changed from f29e7e3afcd84fd886e4ae87c6f11fa5 (127.17.223.3) to 2294471e25ca4bb286453b98d9a4bfca (127.17.223.1). New cstate: current_term: 2 leader_uuid: "2294471e25ca4bb286453b98d9a4bfca" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2294471e25ca4bb286453b98d9a4bfca" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 42727 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a005646a2679426a872350e51a876514" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 41721 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f29e7e3afcd84fd886e4ae87c6f11fa5" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 44583 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:07.362882 29723 consensus_queue.cc:1048] T 61cc7ed9d640485ea43008cd1e0a94b0 P a005646a2679426a872350e51a876514 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f29e7e3afcd84fd886e4ae87c6f11fa5" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 44583 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:07.376854 29742 consensus_queue.cc:1048] T 61cc7ed9d640485ea43008cd1e0a94b0 P a005646a2679426a872350e51a876514 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2294471e25ca4bb286453b98d9a4bfca" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 42727 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:07.384929 29704 raft_consensus.cc:993] T 61cc7ed9d640485ea43008cd1e0a94b0 P a005646a2679426a872350e51a876514: : Instructing follower 2294471e25ca4bb286453b98d9a4bfca to start an election
I20260709 13:09:07.385459 29742 raft_consensus.cc:1081] T 61cc7ed9d640485ea43008cd1e0a94b0 P a005646a2679426a872350e51a876514 [term 1 LEADER]: Signalling peer 2294471e25ca4bb286453b98d9a4bfca to start an election
I20260709 13:09:07.387084 29502 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "61cc7ed9d640485ea43008cd1e0a94b0"
dest_uuid: "2294471e25ca4bb286453b98d9a4bfca"
 from {username='slave'} at 127.0.0.1:37300
I20260709 13:09:07.387665 29502 raft_consensus.cc:493] T 61cc7ed9d640485ea43008cd1e0a94b0 P 2294471e25ca4bb286453b98d9a4bfca [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:09:07.388098 29502 raft_consensus.cc:3060] T 61cc7ed9d640485ea43008cd1e0a94b0 P 2294471e25ca4bb286453b98d9a4bfca [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:07.394277 29502 raft_consensus.cc:515] T 61cc7ed9d640485ea43008cd1e0a94b0 P 2294471e25ca4bb286453b98d9a4bfca [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2294471e25ca4bb286453b98d9a4bfca" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 42727 } } peers { permanent_uuid: "a005646a2679426a872350e51a876514" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 41721 } } peers { permanent_uuid: "f29e7e3afcd84fd886e4ae87c6f11fa5" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 44583 } }
I20260709 13:09:07.396260 29502 leader_election.cc:290] T 61cc7ed9d640485ea43008cd1e0a94b0 P 2294471e25ca4bb286453b98d9a4bfca [CANDIDATE]: Term 2 election: Requested vote from peers a005646a2679426a872350e51a876514 (127.17.223.2:41721), f29e7e3afcd84fd886e4ae87c6f11fa5 (127.17.223.3:44583)
I20260709 13:09:07.397125 29578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61cc7ed9d640485ea43008cd1e0a94b0" candidate_uuid: "2294471e25ca4bb286453b98d9a4bfca" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "a005646a2679426a872350e51a876514"
I20260709 13:09:07.397472 29651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61cc7ed9d640485ea43008cd1e0a94b0" candidate_uuid: "2294471e25ca4bb286453b98d9a4bfca" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f29e7e3afcd84fd886e4ae87c6f11fa5"
I20260709 13:09:07.397789 29578 raft_consensus.cc:3055] T 61cc7ed9d640485ea43008cd1e0a94b0 P a005646a2679426a872350e51a876514 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:09:07.398171 29651 raft_consensus.cc:3060] T 61cc7ed9d640485ea43008cd1e0a94b0 P f29e7e3afcd84fd886e4ae87c6f11fa5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:07.398177 29578 raft_consensus.cc:740] T 61cc7ed9d640485ea43008cd1e0a94b0 P a005646a2679426a872350e51a876514 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: a005646a2679426a872350e51a876514, State: Running, Role: LEADER
I20260709 13:09:07.399257 29578 consensus_queue.cc:260] T 61cc7ed9d640485ea43008cd1e0a94b0 P a005646a2679426a872350e51a876514 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2294471e25ca4bb286453b98d9a4bfca" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 42727 } } peers { permanent_uuid: "a005646a2679426a872350e51a876514" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 41721 } } peers { permanent_uuid: "f29e7e3afcd84fd886e4ae87c6f11fa5" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 44583 } }
I20260709 13:09:07.400616 29578 raft_consensus.cc:3060] T 61cc7ed9d640485ea43008cd1e0a94b0 P a005646a2679426a872350e51a876514 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:07.404717 29651 raft_consensus.cc:2468] T 61cc7ed9d640485ea43008cd1e0a94b0 P f29e7e3afcd84fd886e4ae87c6f11fa5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2294471e25ca4bb286453b98d9a4bfca in term 2.
I20260709 13:09:07.405841 29578 raft_consensus.cc:2468] T 61cc7ed9d640485ea43008cd1e0a94b0 P a005646a2679426a872350e51a876514 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2294471e25ca4bb286453b98d9a4bfca in term 2.
I20260709 13:09:07.406131 29467 leader_election.cc:304] T 61cc7ed9d640485ea43008cd1e0a94b0 P 2294471e25ca4bb286453b98d9a4bfca [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2294471e25ca4bb286453b98d9a4bfca, f29e7e3afcd84fd886e4ae87c6f11fa5; no voters: 
I20260709 13:09:07.407075 29697 raft_consensus.cc:2804] T 61cc7ed9d640485ea43008cd1e0a94b0 P 2294471e25ca4bb286453b98d9a4bfca [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:09:07.407471 29697 raft_consensus.cc:697] T 61cc7ed9d640485ea43008cd1e0a94b0 P 2294471e25ca4bb286453b98d9a4bfca [term 2 LEADER]: Becoming Leader. State: Replica: 2294471e25ca4bb286453b98d9a4bfca, State: Running, Role: LEADER
I20260709 13:09:07.408241 29697 consensus_queue.cc:237] T 61cc7ed9d640485ea43008cd1e0a94b0 P 2294471e25ca4bb286453b98d9a4bfca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2294471e25ca4bb286453b98d9a4bfca" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 42727 } } peers { permanent_uuid: "a005646a2679426a872350e51a876514" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 41721 } } peers { permanent_uuid: "f29e7e3afcd84fd886e4ae87c6f11fa5" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 44583 } }
I20260709 13:09:07.413990 29401 catalog_manager.cc:5697] T 61cc7ed9d640485ea43008cd1e0a94b0 P 2294471e25ca4bb286453b98d9a4bfca reported cstate change: term changed from 1 to 2, leader changed from a005646a2679426a872350e51a876514 (127.17.223.2) to 2294471e25ca4bb286453b98d9a4bfca (127.17.223.1). New cstate: current_term: 2 leader_uuid: "2294471e25ca4bb286453b98d9a4bfca" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2294471e25ca4bb286453b98d9a4bfca" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 42727 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a005646a2679426a872350e51a876514" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 41721 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f29e7e3afcd84fd886e4ae87c6f11fa5" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 44583 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:07.429642 29578 raft_consensus.cc:1275] T 4ca42effaa054b1ba471720fc3e5df74 P a005646a2679426a872350e51a876514 [term 2 FOLLOWER]: Refusing update from remote peer 2294471e25ca4bb286453b98d9a4bfca: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:07.430863 29697 consensus_queue.cc:1048] T 4ca42effaa054b1ba471720fc3e5df74 P 2294471e25ca4bb286453b98d9a4bfca [LEADER]: Connected to new peer: Peer: permanent_uuid: "a005646a2679426a872350e51a876514" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 41721 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:09:07.440835 29651 raft_consensus.cc:1275] T 4ca42effaa054b1ba471720fc3e5df74 P f29e7e3afcd84fd886e4ae87c6f11fa5 [term 2 FOLLOWER]: Refusing update from remote peer 2294471e25ca4bb286453b98d9a4bfca: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:07.442440 29697 consensus_queue.cc:1048] T 4ca42effaa054b1ba471720fc3e5df74 P 2294471e25ca4bb286453b98d9a4bfca [LEADER]: Connected to new peer: Peer: permanent_uuid: "f29e7e3afcd84fd886e4ae87c6f11fa5" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 44583 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:09:07.449493 18300 auto_leader_rebalancer.cc:141] leader rebalance for table multi_table_leader_balance_table1
I20260709 13:09:07.451952 18300 auto_leader_rebalancer.cc:452] table: multi_table_leader_balance_table1, leader rebalance finish, leader transfer count: 0
I20260709 13:09:07.452514 18300 auto_leader_rebalancer.cc:141] leader rebalance for table multi_table_leader_balance_table2
I20260709 13:09:07.468065 29502 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0d733091c3aa499bb26dfe5f169a9845"
dest_uuid: "2294471e25ca4bb286453b98d9a4bfca"
mode: GRACEFUL
new_leader_uuid: "f29e7e3afcd84fd886e4ae87c6f11fa5"
 from {username='slave'} at 127.0.0.1:37320
I20260709 13:09:07.468611 29502 raft_consensus.cc:606] T 0d733091c3aa499bb26dfe5f169a9845 P 2294471e25ca4bb286453b98d9a4bfca [term 2 LEADER]: Received request to transfer leadership to TS f29e7e3afcd84fd886e4ae87c6f11fa5
I20260709 13:09:07.469772 18300 auto_leader_rebalancer.cc:452] table: multi_table_leader_balance_table2, leader rebalance finish, leader transfer count: 1
I20260709 13:09:07.776996 29651 raft_consensus.cc:1275] T 0d733091c3aa499bb26dfe5f169a9845 P f29e7e3afcd84fd886e4ae87c6f11fa5 [term 2 FOLLOWER]: Refusing update from remote peer 2294471e25ca4bb286453b98d9a4bfca: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:07.778194 29736 consensus_queue.cc:1048] T 0d733091c3aa499bb26dfe5f169a9845 P 2294471e25ca4bb286453b98d9a4bfca [LEADER]: Connected to new peer: Peer: permanent_uuid: "f29e7e3afcd84fd886e4ae87c6f11fa5" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 44583 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:09:07.783533 29697 raft_consensus.cc:993] T 0d733091c3aa499bb26dfe5f169a9845 P 2294471e25ca4bb286453b98d9a4bfca: : Instructing follower f29e7e3afcd84fd886e4ae87c6f11fa5 to start an election
I20260709 13:09:07.784047 29744 raft_consensus.cc:1081] T 0d733091c3aa499bb26dfe5f169a9845 P 2294471e25ca4bb286453b98d9a4bfca [term 2 LEADER]: Signalling peer f29e7e3afcd84fd886e4ae87c6f11fa5 to start an election
I20260709 13:09:07.786263 29652 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "0d733091c3aa499bb26dfe5f169a9845"
dest_uuid: "f29e7e3afcd84fd886e4ae87c6f11fa5"
 from {username='slave'} at 127.0.0.1:44408
I20260709 13:09:07.786936 29652 raft_consensus.cc:493] T 0d733091c3aa499bb26dfe5f169a9845 P f29e7e3afcd84fd886e4ae87c6f11fa5 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:09:07.787385 29652 raft_consensus.cc:3060] T 0d733091c3aa499bb26dfe5f169a9845 P f29e7e3afcd84fd886e4ae87c6f11fa5 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:07.789742 29578 raft_consensus.cc:1275] T 0d733091c3aa499bb26dfe5f169a9845 P a005646a2679426a872350e51a876514 [term 2 FOLLOWER]: Refusing update from remote peer 2294471e25ca4bb286453b98d9a4bfca: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:07.791478 29697 consensus_queue.cc:1048] T 0d733091c3aa499bb26dfe5f169a9845 P 2294471e25ca4bb286453b98d9a4bfca [LEADER]: Connected to new peer: Peer: permanent_uuid: "a005646a2679426a872350e51a876514" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 41721 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:09:07.795089 29652 raft_consensus.cc:515] T 0d733091c3aa499bb26dfe5f169a9845 P f29e7e3afcd84fd886e4ae87c6f11fa5 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2294471e25ca4bb286453b98d9a4bfca" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 42727 } } peers { permanent_uuid: "a005646a2679426a872350e51a876514" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 41721 } } peers { permanent_uuid: "f29e7e3afcd84fd886e4ae87c6f11fa5" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 44583 } }
I20260709 13:09:07.798282 29651 raft_consensus.cc:1240] T 0d733091c3aa499bb26dfe5f169a9845 P f29e7e3afcd84fd886e4ae87c6f11fa5 [term 3 FOLLOWER]: Rejecting Update request from peer 2294471e25ca4bb286453b98d9a4bfca for earlier term 2. Current term is 3. Ops: []
I20260709 13:09:07.798480 29502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d733091c3aa499bb26dfe5f169a9845" candidate_uuid: "f29e7e3afcd84fd886e4ae87c6f11fa5" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "2294471e25ca4bb286453b98d9a4bfca"
I20260709 13:09:07.799153 29502 raft_consensus.cc:3055] T 0d733091c3aa499bb26dfe5f169a9845 P 2294471e25ca4bb286453b98d9a4bfca [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:09:07.799444 29502 raft_consensus.cc:740] T 0d733091c3aa499bb26dfe5f169a9845 P 2294471e25ca4bb286453b98d9a4bfca [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 2294471e25ca4bb286453b98d9a4bfca, State: Running, Role: LEADER
I20260709 13:09:07.800238 29502 consensus_queue.cc:260] T 0d733091c3aa499bb26dfe5f169a9845 P 2294471e25ca4bb286453b98d9a4bfca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2294471e25ca4bb286453b98d9a4bfca" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 42727 } } peers { permanent_uuid: "a005646a2679426a872350e51a876514" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 41721 } } peers { permanent_uuid: "f29e7e3afcd84fd886e4ae87c6f11fa5" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 44583 } }
I20260709 13:09:07.801012 29652 leader_election.cc:290] T 0d733091c3aa499bb26dfe5f169a9845 P f29e7e3afcd84fd886e4ae87c6f11fa5 [CANDIDATE]: Term 3 election: Requested vote from peers 2294471e25ca4bb286453b98d9a4bfca (127.17.223.1:42727), a005646a2679426a872350e51a876514 (127.17.223.2:41721)
I20260709 13:09:07.801220 29502 raft_consensus.cc:3060] T 0d733091c3aa499bb26dfe5f169a9845 P 2294471e25ca4bb286453b98d9a4bfca [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:07.802726 29577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d733091c3aa499bb26dfe5f169a9845" candidate_uuid: "f29e7e3afcd84fd886e4ae87c6f11fa5" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "a005646a2679426a872350e51a876514"
I20260709 13:09:07.803333 29577 raft_consensus.cc:3060] T 0d733091c3aa499bb26dfe5f169a9845 P a005646a2679426a872350e51a876514 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:09:07.803717 29697 consensus_queue.cc:1175] T 0d733091c3aa499bb26dfe5f169a9845 P 2294471e25ca4bb286453b98d9a4bfca [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "f29e7e3afcd84fd886e4ae87c6f11fa5" responder_term: 3 status { last_received { term: 2 index: 2 } last_committed_idx: 1 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer 2294471e25ca4bb286453b98d9a4bfca for earlier term 2. Current term is 3. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 13:09:07.805866 29578 raft_consensus.cc:1275] T 61cc7ed9d640485ea43008cd1e0a94b0 P a005646a2679426a872350e51a876514 [term 2 FOLLOWER]: Refusing update from remote peer 2294471e25ca4bb286453b98d9a4bfca: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:07.807231 29697 consensus_queue.cc:1048] T 61cc7ed9d640485ea43008cd1e0a94b0 P 2294471e25ca4bb286453b98d9a4bfca [LEADER]: Connected to new peer: Peer: permanent_uuid: "a005646a2679426a872350e51a876514" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 41721 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:09:07.809840 29577 raft_consensus.cc:2468] T 0d733091c3aa499bb26dfe5f169a9845 P a005646a2679426a872350e51a876514 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f29e7e3afcd84fd886e4ae87c6f11fa5 in term 3.
I20260709 13:09:07.810806 29652 raft_consensus.cc:1275] T 61cc7ed9d640485ea43008cd1e0a94b0 P f29e7e3afcd84fd886e4ae87c6f11fa5 [term 2 FOLLOWER]: Refusing update from remote peer 2294471e25ca4bb286453b98d9a4bfca: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:07.811211 29618 leader_election.cc:304] T 0d733091c3aa499bb26dfe5f169a9845 P f29e7e3afcd84fd886e4ae87c6f11fa5 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a005646a2679426a872350e51a876514, f29e7e3afcd84fd886e4ae87c6f11fa5; no voters: 
I20260709 13:09:07.812122 29707 raft_consensus.cc:2804] T 0d733091c3aa499bb26dfe5f169a9845 P f29e7e3afcd84fd886e4ae87c6f11fa5 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:09:07.813284 29697 consensus_queue.cc:1048] T 61cc7ed9d640485ea43008cd1e0a94b0 P 2294471e25ca4bb286453b98d9a4bfca [LEADER]: Connected to new peer: Peer: permanent_uuid: "f29e7e3afcd84fd886e4ae87c6f11fa5" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 44583 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:09:07.822798 29502 raft_consensus.cc:2468] T 0d733091c3aa499bb26dfe5f169a9845 P 2294471e25ca4bb286453b98d9a4bfca [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f29e7e3afcd84fd886e4ae87c6f11fa5 in term 3.
I20260709 13:09:07.824126 29707 raft_consensus.cc:697] T 0d733091c3aa499bb26dfe5f169a9845 P f29e7e3afcd84fd886e4ae87c6f11fa5 [term 3 LEADER]: Becoming Leader. State: Replica: f29e7e3afcd84fd886e4ae87c6f11fa5, State: Running, Role: LEADER
I20260709 13:09:07.825150 29707 consensus_queue.cc:237] T 0d733091c3aa499bb26dfe5f169a9845 P f29e7e3afcd84fd886e4ae87c6f11fa5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2294471e25ca4bb286453b98d9a4bfca" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 42727 } } peers { permanent_uuid: "a005646a2679426a872350e51a876514" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 41721 } } peers { permanent_uuid: "f29e7e3afcd84fd886e4ae87c6f11fa5" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 44583 } }
I20260709 13:09:07.838402 29401 catalog_manager.cc:5697] T 0d733091c3aa499bb26dfe5f169a9845 P f29e7e3afcd84fd886e4ae87c6f11fa5 reported cstate change: term changed from 2 to 3, leader changed from 2294471e25ca4bb286453b98d9a4bfca (127.17.223.1) to f29e7e3afcd84fd886e4ae87c6f11fa5 (127.17.223.3). New cstate: current_term: 3 leader_uuid: "f29e7e3afcd84fd886e4ae87c6f11fa5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2294471e25ca4bb286453b98d9a4bfca" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 42727 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a005646a2679426a872350e51a876514" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 41721 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f29e7e3afcd84fd886e4ae87c6f11fa5" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 44583 } health_report { overall_health: HEALTHY } } }
I20260709 13:09:08.101192 18300 tablet_server.cc:179] TabletServer@127.17.223.1:0 shutting down...
I20260709 13:09:08.120805 18300 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:09:08.121383 18300 tablet_replica.cc:333] T 61cc7ed9d640485ea43008cd1e0a94b0 P 2294471e25ca4bb286453b98d9a4bfca: stopping tablet replica
I20260709 13:09:08.121891 18300 raft_consensus.cc:2243] T 61cc7ed9d640485ea43008cd1e0a94b0 P 2294471e25ca4bb286453b98d9a4bfca [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:09:08.122633 18300 raft_consensus.cc:2272] T 61cc7ed9d640485ea43008cd1e0a94b0 P 2294471e25ca4bb286453b98d9a4bfca [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:08.124963 18300 tablet_replica.cc:333] T 0d733091c3aa499bb26dfe5f169a9845 P 2294471e25ca4bb286453b98d9a4bfca: stopping tablet replica
I20260709 13:09:08.125437 18300 raft_consensus.cc:2243] T 0d733091c3aa499bb26dfe5f169a9845 P 2294471e25ca4bb286453b98d9a4bfca [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:08.125823 18300 raft_consensus.cc:2272] T 0d733091c3aa499bb26dfe5f169a9845 P 2294471e25ca4bb286453b98d9a4bfca [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:08.128477 18300 tablet_replica.cc:333] T 17fdbe28610741beabfd7b7f8835d70c P 2294471e25ca4bb286453b98d9a4bfca: stopping tablet replica
I20260709 13:09:08.128947 18300 raft_consensus.cc:2243] T 17fdbe28610741beabfd7b7f8835d70c P 2294471e25ca4bb286453b98d9a4bfca [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:08.129292 18300 raft_consensus.cc:2272] T 17fdbe28610741beabfd7b7f8835d70c P 2294471e25ca4bb286453b98d9a4bfca [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:08.131114 18300 tablet_replica.cc:333] T 4ca42effaa054b1ba471720fc3e5df74 P 2294471e25ca4bb286453b98d9a4bfca: stopping tablet replica
I20260709 13:09:08.131515 18300 raft_consensus.cc:2243] T 4ca42effaa054b1ba471720fc3e5df74 P 2294471e25ca4bb286453b98d9a4bfca [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:09:08.132205 18300 raft_consensus.cc:2272] T 4ca42effaa054b1ba471720fc3e5df74 P 2294471e25ca4bb286453b98d9a4bfca [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:08.145303 18300 tablet_server.cc:196] TabletServer@127.17.223.1:0 shutdown complete.
I20260709 13:09:08.157326 18300 tablet_server.cc:179] TabletServer@127.17.223.2:0 shutting down...
I20260709 13:09:08.178180 18300 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:09:08.178936 18300 tablet_replica.cc:333] T 61cc7ed9d640485ea43008cd1e0a94b0 P a005646a2679426a872350e51a876514: stopping tablet replica
I20260709 13:09:08.179601 18300 raft_consensus.cc:2243] T 61cc7ed9d640485ea43008cd1e0a94b0 P a005646a2679426a872350e51a876514 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:08.180099 18300 raft_consensus.cc:2272] T 61cc7ed9d640485ea43008cd1e0a94b0 P a005646a2679426a872350e51a876514 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:08.182518 18300 tablet_replica.cc:333] T 0d733091c3aa499bb26dfe5f169a9845 P a005646a2679426a872350e51a876514: stopping tablet replica
I20260709 13:09:08.183096 18300 raft_consensus.cc:2243] T 0d733091c3aa499bb26dfe5f169a9845 P a005646a2679426a872350e51a876514 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:08.183534 18300 raft_consensus.cc:2272] T 0d733091c3aa499bb26dfe5f169a9845 P a005646a2679426a872350e51a876514 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:08.186148 18300 tablet_replica.cc:333] T 17fdbe28610741beabfd7b7f8835d70c P a005646a2679426a872350e51a876514: stopping tablet replica
I20260709 13:09:08.186724 18300 raft_consensus.cc:2243] T 17fdbe28610741beabfd7b7f8835d70c P a005646a2679426a872350e51a876514 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:09:08.187572 18300 raft_consensus.cc:2272] T 17fdbe28610741beabfd7b7f8835d70c P a005646a2679426a872350e51a876514 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:08.189437 18300 tablet_replica.cc:333] T 4ca42effaa054b1ba471720fc3e5df74 P a005646a2679426a872350e51a876514: stopping tablet replica
I20260709 13:09:08.190001 18300 raft_consensus.cc:2243] T 4ca42effaa054b1ba471720fc3e5df74 P a005646a2679426a872350e51a876514 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:08.190423 18300 raft_consensus.cc:2272] T 4ca42effaa054b1ba471720fc3e5df74 P a005646a2679426a872350e51a876514 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:08.203953 18300 tablet_server.cc:196] TabletServer@127.17.223.2:0 shutdown complete.
I20260709 13:09:08.217027 18300 tablet_server.cc:179] TabletServer@127.17.223.3:0 shutting down...
W20260709 13:09:08.219879 29618 consensus_peers.cc:597] T 0d733091c3aa499bb26dfe5f169a9845 P f29e7e3afcd84fd886e4ae87c6f11fa5 -> Peer a005646a2679426a872350e51a876514 (127.17.223.2:41721): Couldn't send request to peer a005646a2679426a872350e51a876514. Status: Network error: Client connection negotiation failed: client connection to 127.17.223.2:41721: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:08.241056 18300 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:09:08.241783 18300 tablet_replica.cc:333] T 61cc7ed9d640485ea43008cd1e0a94b0 P f29e7e3afcd84fd886e4ae87c6f11fa5: stopping tablet replica
I20260709 13:09:08.242342 18300 raft_consensus.cc:2243] T 61cc7ed9d640485ea43008cd1e0a94b0 P f29e7e3afcd84fd886e4ae87c6f11fa5 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:08.242878 18300 raft_consensus.cc:2272] T 61cc7ed9d640485ea43008cd1e0a94b0 P f29e7e3afcd84fd886e4ae87c6f11fa5 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:08.245229 18300 tablet_replica.cc:333] T 0d733091c3aa499bb26dfe5f169a9845 P f29e7e3afcd84fd886e4ae87c6f11fa5: stopping tablet replica
I20260709 13:09:08.245774 18300 raft_consensus.cc:2243] T 0d733091c3aa499bb26dfe5f169a9845 P f29e7e3afcd84fd886e4ae87c6f11fa5 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:09:08.246506 18300 pending_rounds.cc:70] T 0d733091c3aa499bb26dfe5f169a9845 P f29e7e3afcd84fd886e4ae87c6f11fa5: Trying to abort 2 pending ops.
I20260709 13:09:08.246766 18300 pending_rounds.cc:77] T 0d733091c3aa499bb26dfe5f169a9845 P f29e7e3afcd84fd886e4ae87c6f11fa5: Aborting op as it isn't in flight: id { term: 3 index: 3 } timestamp: 7305636035910242304 op_type: NO_OP noop_request { }
I20260709 13:09:08.247087 18300 raft_consensus.cc:2889] T 0d733091c3aa499bb26dfe5f169a9845 P f29e7e3afcd84fd886e4ae87c6f11fa5 [term 3 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260709 13:09:08.247325 18300 pending_rounds.cc:77] T 0d733091c3aa499bb26dfe5f169a9845 P f29e7e3afcd84fd886e4ae87c6f11fa5: Aborting op as it isn't in flight: id { term: 2 index: 2 } timestamp: 7305636033714581504 op_type: NO_OP noop_request { }
I20260709 13:09:08.247571 18300 raft_consensus.cc:2889] T 0d733091c3aa499bb26dfe5f169a9845 P f29e7e3afcd84fd886e4ae87c6f11fa5 [term 3 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260709 13:09:08.247843 18300 raft_consensus.cc:2272] T 0d733091c3aa499bb26dfe5f169a9845 P f29e7e3afcd84fd886e4ae87c6f11fa5 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:08.250278 18300 tablet_replica.cc:333] T 17fdbe28610741beabfd7b7f8835d70c P f29e7e3afcd84fd886e4ae87c6f11fa5: stopping tablet replica
I20260709 13:09:08.250919 18300 raft_consensus.cc:2243] T 17fdbe28610741beabfd7b7f8835d70c P f29e7e3afcd84fd886e4ae87c6f11fa5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:08.251367 18300 raft_consensus.cc:2272] T 17fdbe28610741beabfd7b7f8835d70c P f29e7e3afcd84fd886e4ae87c6f11fa5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:08.253208 18300 tablet_replica.cc:333] T 4ca42effaa054b1ba471720fc3e5df74 P f29e7e3afcd84fd886e4ae87c6f11fa5: stopping tablet replica
I20260709 13:09:08.253681 18300 raft_consensus.cc:2243] T 4ca42effaa054b1ba471720fc3e5df74 P f29e7e3afcd84fd886e4ae87c6f11fa5 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:08.254117 18300 raft_consensus.cc:2272] T 4ca42effaa054b1ba471720fc3e5df74 P f29e7e3afcd84fd886e4ae87c6f11fa5 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:08.277794 18300 tablet_server.cc:196] TabletServer@127.17.223.3:0 shutdown complete.
I20260709 13:09:08.291596 18300 master.cc:562] Master@127.17.223.62:44981 shutting down...
I20260709 13:09:08.308954 18300 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 0f6cdb3dee6d46eab44fcbe0c41a2510 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:09:08.309650 18300 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 0f6cdb3dee6d46eab44fcbe0c41a2510 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:08.309983 18300 tablet_replica.cc:333] T 00000000000000000000000000000000 P 0f6cdb3dee6d46eab44fcbe0c41a2510: stopping tablet replica
I20260709 13:09:08.329622 18300 master.cc:584] Master@127.17.223.62:44981 shutdown complete.
[       OK ] LeaderRebalancerTest.MultiTableLeaderBalance (2712 ms)
[----------] 6 tests from LeaderRebalancerTest (327582 ms total)

[----------] 2 tests from FilterSoftDeletedTableTest
[ RUN      ] FilterSoftDeletedTableTest.TestFilterSofteDeletedTable/0
I20260709 13:09:08.358114 18300 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.17.223.62:40001
I20260709 13:09:08.359298 18300 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:09:08.364133 29751 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:09:08.364398 29752 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:09:08.365456 29754 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:09:08.366779 18300 server_base.cc:1061] running on GCE node
I20260709 13:09:08.367669 18300 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:09:08.367856 18300 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:09:08.368052 18300 hybrid_clock.cc:648] HybridClock initialized: now 1783602548368018 us; error 0 us; skew 500 ppm
I20260709 13:09:08.368607 18300 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:09:08.371059 18300 webserver.cc:533] Webserver started at http://127.17.223.62:41131/ using document root <none> and password file <none>
I20260709 13:09:08.371567 18300 fs_manager.cc:362] Metadata directory not provided
I20260709 13:09:08.371760 18300 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:09:08.372032 18300 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:09:08.373096 18300 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskKd2k48/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602220613947-18300-0/minicluster-data/master-0-root/instance:
uuid: "badd4c5e4acc4940a67cc8f85f2a187d"
format_stamp: "Formatted at 2026-07-09 13:09:08 on dist-test-slave-vl1s"
I20260709 13:09:08.378237 18300 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.001s	sys 0.006s
I20260709 13:09:08.381968 29759 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:09:08.382977 18300 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.003s	sys 0.000s
I20260709 13:09:08.383314 18300 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskKd2k48/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602220613947-18300-0/minicluster-data/master-0-root
uuid: "badd4c5e4acc4940a67cc8f85f2a187d"
format_stamp: "Formatted at 2026-07-09 13:09:08 on dist-test-slave-vl1s"
I20260709 13:09:08.383610 18300 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskKd2k48/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602220613947-18300-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskKd2k48/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602220613947-18300-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskKd2k48/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602220613947-18300-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:09:08.427466 18300 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:09:08.428540 18300 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:09:08.464695 18300 rpc_server.cc:307] RPC server started. Bound to: 127.17.223.62:40001
I20260709 13:09:08.464781 29810 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.17.223.62:40001 every 8 connection(s)
I20260709 13:09:08.468881 29811 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:08.480757 29811 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P badd4c5e4acc4940a67cc8f85f2a187d: Bootstrap starting.
I20260709 13:09:08.485402 29811 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P badd4c5e4acc4940a67cc8f85f2a187d: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:08.489471 29811 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P badd4c5e4acc4940a67cc8f85f2a187d: No bootstrap required, opened a new log
I20260709 13:09:08.491608 29811 raft_consensus.cc:359] T 00000000000000000000000000000000 P badd4c5e4acc4940a67cc8f85f2a187d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "badd4c5e4acc4940a67cc8f85f2a187d" member_type: VOTER }
I20260709 13:09:08.492036 29811 raft_consensus.cc:385] T 00000000000000000000000000000000 P badd4c5e4acc4940a67cc8f85f2a187d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:08.492265 29811 raft_consensus.cc:740] T 00000000000000000000000000000000 P badd4c5e4acc4940a67cc8f85f2a187d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: badd4c5e4acc4940a67cc8f85f2a187d, State: Initialized, Role: FOLLOWER
I20260709 13:09:08.492918 29811 consensus_queue.cc:260] T 00000000000000000000000000000000 P badd4c5e4acc4940a67cc8f85f2a187d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "badd4c5e4acc4940a67cc8f85f2a187d" member_type: VOTER }
I20260709 13:09:08.493369 29811 raft_consensus.cc:399] T 00000000000000000000000000000000 P badd4c5e4acc4940a67cc8f85f2a187d [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 13:09:08.493618 29811 raft_consensus.cc:493] T 00000000000000000000000000000000 P badd4c5e4acc4940a67cc8f85f2a187d [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 13:09:08.493881 29811 raft_consensus.cc:3060] T 00000000000000000000000000000000 P badd4c5e4acc4940a67cc8f85f2a187d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:08.498490 29811 raft_consensus.cc:515] T 00000000000000000000000000000000 P badd4c5e4acc4940a67cc8f85f2a187d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "badd4c5e4acc4940a67cc8f85f2a187d" member_type: VOTER }
I20260709 13:09:08.499042 29811 leader_election.cc:304] T 00000000000000000000000000000000 P badd4c5e4acc4940a67cc8f85f2a187d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: badd4c5e4acc4940a67cc8f85f2a187d; no voters: 
I20260709 13:09:08.500188 29811 leader_election.cc:290] T 00000000000000000000000000000000 P badd4c5e4acc4940a67cc8f85f2a187d [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 13:09:08.500586 29814 raft_consensus.cc:2804] T 00000000000000000000000000000000 P badd4c5e4acc4940a67cc8f85f2a187d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:08.501973 29814 raft_consensus.cc:697] T 00000000000000000000000000000000 P badd4c5e4acc4940a67cc8f85f2a187d [term 1 LEADER]: Becoming Leader. State: Replica: badd4c5e4acc4940a67cc8f85f2a187d, State: Running, Role: LEADER
I20260709 13:09:08.502642 29814 consensus_queue.cc:237] T 00000000000000000000000000000000 P badd4c5e4acc4940a67cc8f85f2a187d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "badd4c5e4acc4940a67cc8f85f2a187d" member_type: VOTER }
I20260709 13:09:08.503294 29811 sys_catalog.cc:565] T 00000000000000000000000000000000 P badd4c5e4acc4940a67cc8f85f2a187d [sys.catalog]: configured and running, proceeding with master startup.
I20260709 13:09:08.505467 29816 sys_catalog.cc:455] T 00000000000000000000000000000000 P badd4c5e4acc4940a67cc8f85f2a187d [sys.catalog]: SysCatalogTable state changed. Reason: New leader badd4c5e4acc4940a67cc8f85f2a187d. Latest consensus state: current_term: 1 leader_uuid: "badd4c5e4acc4940a67cc8f85f2a187d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "badd4c5e4acc4940a67cc8f85f2a187d" member_type: VOTER } }
I20260709 13:09:08.505440 29815 sys_catalog.cc:455] T 00000000000000000000000000000000 P badd4c5e4acc4940a67cc8f85f2a187d [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "badd4c5e4acc4940a67cc8f85f2a187d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "badd4c5e4acc4940a67cc8f85f2a187d" member_type: VOTER } }
I20260709 13:09:08.506276 29816 sys_catalog.cc:458] T 00000000000000000000000000000000 P badd4c5e4acc4940a67cc8f85f2a187d [sys.catalog]: This master's current role is: LEADER
I20260709 13:09:08.506363 29815 sys_catalog.cc:458] T 00000000000000000000000000000000 P badd4c5e4acc4940a67cc8f85f2a187d [sys.catalog]: This master's current role is: LEADER
I20260709 13:09:08.514837 29819 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 13:09:08.519564 29819 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 13:09:08.520569 18300 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 13:09:08.528064 29819 catalog_manager.cc:1383] Generated new cluster ID: 894d12351ee8426491d1c74ef1c83f27
I20260709 13:09:08.528373 29819 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 13:09:08.550396 29819 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 13:09:08.551697 29819 catalog_manager.cc:1540] Loading token signing keys...
I20260709 13:09:08.564054 29819 catalog_manager.cc:6070] T 00000000000000000000000000000000 P badd4c5e4acc4940a67cc8f85f2a187d: Generated new TSK 0
I20260709 13:09:08.564663 29819 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 13:09:08.587420 18300 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:09:08.593230 29832 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:09:08.594491 29833 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:09:08.596518 18300 server_base.cc:1061] running on GCE node
W20260709 13:09:08.596699 29835 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:09:08.597697 18300 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:09:08.597882 18300 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:09:08.598104 18300 hybrid_clock.cc:648] HybridClock initialized: now 1783602548598082 us; error 0 us; skew 500 ppm
I20260709 13:09:08.598646 18300 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:09:08.601035 18300 webserver.cc:533] Webserver started at http://127.17.223.1:36145/ using document root <none> and password file <none>
I20260709 13:09:08.601531 18300 fs_manager.cc:362] Metadata directory not provided
I20260709 13:09:08.601724 18300 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:09:08.602017 18300 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:09:08.603143 18300 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskKd2k48/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602220613947-18300-0/minicluster-data/ts-0-root/instance:
uuid: "58a7cda73b3542718987bf815eed9b79"
format_stamp: "Formatted at 2026-07-09 13:09:08 on dist-test-slave-vl1s"
I20260709 13:09:08.607725 18300 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.004s	sys 0.000s
I20260709 13:09:08.611150 29840 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:09:08.611937 18300 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260709 13:09:08.612227 18300 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskKd2k48/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602220613947-18300-0/minicluster-data/ts-0-root
uuid: "58a7cda73b3542718987bf815eed9b79"
format_stamp: "Formatted at 2026-07-09 13:09:08 on dist-test-slave-vl1s"
I20260709 13:09:08.612569 18300 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskKd2k48/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602220613947-18300-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskKd2k48/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602220613947-18300-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskKd2k48/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602220613947-18300-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:09:08.634492 18300 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:09:08.635673 18300 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:09:08.637091 18300 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:09:08.639289 18300 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:09:08.639508 18300 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:09:08.639747 18300 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:09:08.639911 18300 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:09:08.676885 18300 rpc_server.cc:307] RPC server started. Bound to: 127.17.223.1:37953
I20260709 13:09:08.677000 29902 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.17.223.1:37953 every 8 connection(s)
I20260709 13:09:08.683025 18300 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:09:08.691111 29907 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:09:08.692245 29908 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:09:08.694446 29910 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:09:08.695739 29903 heartbeater.cc:344] Connected to a master server at 127.17.223.62:40001
I20260709 13:09:08.696159 29903 heartbeater.cc:461] Registering TS with master...
I20260709 13:09:08.696569 18300 server_base.cc:1061] running on GCE node
I20260709 13:09:08.697021 29903 heartbeater.cc:507] Master 127.17.223.62:40001 requested a full tablet report, sending...
I20260709 13:09:08.698360 18300 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:09:08.698698 18300 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:09:08.698930 18300 hybrid_clock.cc:648] HybridClock initialized: now 1783602548698911 us; error 0 us; skew 500 ppm
I20260709 13:09:08.699407 29776 ts_manager.cc:194] Registered new tserver with Master: 58a7cda73b3542718987bf815eed9b79 (127.17.223.1:37953)
I20260709 13:09:08.699538 18300 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:09:08.701546 29776 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:58638
I20260709 13:09:08.702163 18300 webserver.cc:533] Webserver started at http://127.17.223.2:41201/ using document root <none> and password file <none>
I20260709 13:09:08.702791 18300 fs_manager.cc:362] Metadata directory not provided
I20260709 13:09:08.703028 18300 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:09:08.703346 18300 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:09:08.704640 18300 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskKd2k48/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602220613947-18300-0/minicluster-data/ts-1-root/instance:
uuid: "4bc679ad21a64bfe93bf64ff1b6ba3b2"
format_stamp: "Formatted at 2026-07-09 13:09:08 on dist-test-slave-vl1s"
I20260709 13:09:08.708900 18300 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.003s	sys 0.000s
I20260709 13:09:08.712126 29915 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:09:08.712953 18300 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.001s	sys 0.000s
I20260709 13:09:08.713214 18300 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskKd2k48/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602220613947-18300-0/minicluster-data/ts-1-root
uuid: "4bc679ad21a64bfe93bf64ff1b6ba3b2"
format_stamp: "Formatted at 2026-07-09 13:09:08 on dist-test-slave-vl1s"
I20260709 13:09:08.713445 18300 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskKd2k48/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602220613947-18300-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskKd2k48/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602220613947-18300-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskKd2k48/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602220613947-18300-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:09:08.728652 18300 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:09:08.729621 18300 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:09:08.730966 18300 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:09:08.733129 18300 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:09:08.733320 18300 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:09:08.733588 18300 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:09:08.733744 18300 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:09:08.771003 18300 rpc_server.cc:307] RPC server started. Bound to: 127.17.223.2:33075
I20260709 13:09:08.771095 29977 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.17.223.2:33075 every 8 connection(s)
I20260709 13:09:08.775785 18300 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:09:08.782724 29981 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:09:08.785108 29982 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:09:08.785833 18300 server_base.cc:1061] running on GCE node
W20260709 13:09:08.786657 29984 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:09:08.787833 18300 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:09:08.788105 18300 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:09:08.788314 18300 hybrid_clock.cc:648] HybridClock initialized: now 1783602548788295 us; error 0 us; skew 500 ppm
I20260709 13:09:08.788407 29978 heartbeater.cc:344] Connected to a master server at 127.17.223.62:40001
I20260709 13:09:08.788935 29978 heartbeater.cc:461] Registering TS with master...
I20260709 13:09:08.789235 18300 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:09:08.789703 29978 heartbeater.cc:507] Master 127.17.223.62:40001 requested a full tablet report, sending...
I20260709 13:09:08.792085 29776 ts_manager.cc:194] Registered new tserver with Master: 4bc679ad21a64bfe93bf64ff1b6ba3b2 (127.17.223.2:33075)
I20260709 13:09:08.792219 18300 webserver.cc:533] Webserver started at http://127.17.223.3:35089/ using document root <none> and password file <none>
I20260709 13:09:08.792907 18300 fs_manager.cc:362] Metadata directory not provided
I20260709 13:09:08.793136 18300 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:09:08.793442 18300 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:09:08.793942 29776 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:58650
I20260709 13:09:08.794983 18300 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskKd2k48/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602220613947-18300-0/minicluster-data/ts-2-root/instance:
uuid: "37897779fb894afb8129dcf5d269bd54"
format_stamp: "Formatted at 2026-07-09 13:09:08 on dist-test-slave-vl1s"
I20260709 13:09:08.799533 18300 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.001s	sys 0.003s
I20260709 13:09:08.802860 29989 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:09:08.803611 18300 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.001s
I20260709 13:09:08.803911 18300 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskKd2k48/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602220613947-18300-0/minicluster-data/ts-2-root
uuid: "37897779fb894afb8129dcf5d269bd54"
format_stamp: "Formatted at 2026-07-09 13:09:08 on dist-test-slave-vl1s"
I20260709 13:09:08.804256 18300 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskKd2k48/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602220613947-18300-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskKd2k48/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602220613947-18300-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskKd2k48/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602220613947-18300-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:09:08.822254 18300 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:09:08.823282 18300 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:09:08.824579 18300 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:09:08.826762 18300 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:09:08.826973 18300 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:09:08.827220 18300 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:09:08.827394 18300 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:09:08.864897 18300 rpc_server.cc:307] RPC server started. Bound to: 127.17.223.3:42765
I20260709 13:09:08.865013 30051 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.17.223.3:42765 every 8 connection(s)
I20260709 13:09:08.878336 30052 heartbeater.cc:344] Connected to a master server at 127.17.223.62:40001
I20260709 13:09:08.878816 30052 heartbeater.cc:461] Registering TS with master...
I20260709 13:09:08.879482 30052 heartbeater.cc:507] Master 127.17.223.62:40001 requested a full tablet report, sending...
I20260709 13:09:08.881528 29776 ts_manager.cc:194] Registered new tserver with Master: 37897779fb894afb8129dcf5d269bd54 (127.17.223.3:42765)
I20260709 13:09:08.882182 18300 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.014169115s
I20260709 13:09:08.883209 29776 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:58654
I20260709 13:09:08.907159 29776 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:58656:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q""\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:09:08.909534 29776 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:09:08.993566 29868 tablet_service.cc:1511] Processing CreateTablet for tablet 6d4b64688b8949c89f8f7b7aa871efed (DEFAULT_TABLE table=test-workload [id=8068abd65e484402ad1729c9402bd896]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:09:08.995015 29868 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6d4b64688b8949c89f8f7b7aa871efed. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:08.994658 29866 tablet_service.cc:1511] Processing CreateTablet for tablet 5ab64e7b83584196b9e6c6d1bc634351 (DEFAULT_TABLE table=test-workload [id=8068abd65e484402ad1729c9402bd896]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:09:08.996135 29866 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5ab64e7b83584196b9e6c6d1bc634351. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:08.998811 29867 tablet_service.cc:1511] Processing CreateTablet for tablet 8f557a35c94b4b2b917d69463fc69be9 (DEFAULT_TABLE table=test-workload [id=8068abd65e484402ad1729c9402bd896]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:09:08.999612 30015 tablet_service.cc:1511] Processing CreateTablet for tablet 5ab64e7b83584196b9e6c6d1bc634351 (DEFAULT_TABLE table=test-workload [id=8068abd65e484402ad1729c9402bd896]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:09:09.000276 29867 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8f557a35c94b4b2b917d69463fc69be9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:09.000975 30015 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5ab64e7b83584196b9e6c6d1bc634351. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:09.002031 30016 tablet_service.cc:1511] Processing CreateTablet for tablet 8f557a35c94b4b2b917d69463fc69be9 (DEFAULT_TABLE table=test-workload [id=8068abd65e484402ad1729c9402bd896]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:09:09.003377 30016 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8f557a35c94b4b2b917d69463fc69be9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:08.999641 30017 tablet_service.cc:1511] Processing CreateTablet for tablet 6d4b64688b8949c89f8f7b7aa871efed (DEFAULT_TABLE table=test-workload [id=8068abd65e484402ad1729c9402bd896]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:09:09.003400 30014 tablet_service.cc:1511] Processing CreateTablet for tablet e347ac4792b04c198fb6829a4a87078b (DEFAULT_TABLE table=test-workload [id=8068abd65e484402ad1729c9402bd896]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:09:09.005899 30017 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6d4b64688b8949c89f8f7b7aa871efed. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:09.007805 30013 tablet_service.cc:1511] Processing CreateTablet for tablet bb9da524d5b84f09b0c5853761aa5886 (DEFAULT_TABLE table=test-workload [id=8068abd65e484402ad1729c9402bd896]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:09:09.009553 29865 tablet_service.cc:1511] Processing CreateTablet for tablet e347ac4792b04c198fb6829a4a87078b (DEFAULT_TABLE table=test-workload [id=8068abd65e484402ad1729c9402bd896]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:09:09.010856 29865 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e347ac4792b04c198fb6829a4a87078b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:09.015715 29863 tablet_service.cc:1511] Processing CreateTablet for tablet f814d836f0bd46a4aa7d660d8ff4b2d5 (DEFAULT_TABLE table=test-workload [id=8068abd65e484402ad1729c9402bd896]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:09:09.017027 29863 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f814d836f0bd46a4aa7d660d8ff4b2d5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:09.020203 30012 tablet_service.cc:1511] Processing CreateTablet for tablet f814d836f0bd46a4aa7d660d8ff4b2d5 (DEFAULT_TABLE table=test-workload [id=8068abd65e484402ad1729c9402bd896]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:09:09.014257 29864 tablet_service.cc:1511] Processing CreateTablet for tablet bb9da524d5b84f09b0c5853761aa5886 (DEFAULT_TABLE table=test-workload [id=8068abd65e484402ad1729c9402bd896]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:09:09.034860 29864 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bb9da524d5b84f09b0c5853761aa5886. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:09.040145 30012 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f814d836f0bd46a4aa7d660d8ff4b2d5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:09.042224 30014 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e347ac4792b04c198fb6829a4a87078b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:09.043933 30013 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bb9da524d5b84f09b0c5853761aa5886. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:09.065233 29943 tablet_service.cc:1511] Processing CreateTablet for tablet 6d4b64688b8949c89f8f7b7aa871efed (DEFAULT_TABLE table=test-workload [id=8068abd65e484402ad1729c9402bd896]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:09:09.066740 29943 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6d4b64688b8949c89f8f7b7aa871efed. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:09.072991 30011 tablet_service.cc:1511] Processing CreateTablet for tablet 6450825bf8ba4ebaa0e631b1dea6538e (DEFAULT_TABLE table=test-workload [id=8068abd65e484402ad1729c9402bd896]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:09:09.074476 30011 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6450825bf8ba4ebaa0e631b1dea6538e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:09.080379 29940 tablet_service.cc:1511] Processing CreateTablet for tablet e347ac4792b04c198fb6829a4a87078b (DEFAULT_TABLE table=test-workload [id=8068abd65e484402ad1729c9402bd896]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:09:09.081750 29940 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e347ac4792b04c198fb6829a4a87078b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:09.075842 30010 tablet_service.cc:1511] Processing CreateTablet for tablet 968909b990764b0c8c388a63060c8130 (DEFAULT_TABLE table=test-workload [id=8068abd65e484402ad1729c9402bd896]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:09:09.082751 29866 tablet_service.cc:1511] Processing CreateTablet for tablet 6450825bf8ba4ebaa0e631b1dea6538e (DEFAULT_TABLE table=test-workload [id=8068abd65e484402ad1729c9402bd896]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:09:09.083804 30010 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 968909b990764b0c8c388a63060c8130. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:09.084033 29866 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6450825bf8ba4ebaa0e631b1dea6538e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:09.076223 29942 tablet_service.cc:1511] Processing CreateTablet for tablet 8f557a35c94b4b2b917d69463fc69be9 (DEFAULT_TABLE table=test-workload [id=8068abd65e484402ad1729c9402bd896]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:09:09.085893 29942 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8f557a35c94b4b2b917d69463fc69be9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:09.077559 30009 tablet_service.cc:1511] Processing CreateTablet for tablet 59abb803b8ce4d28967bf12c46d66c0d (DEFAULT_TABLE table=test-workload [id=8068abd65e484402ad1729c9402bd896]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:09:09.086796 29939 tablet_service.cc:1511] Processing CreateTablet for tablet bb9da524d5b84f09b0c5853761aa5886 (DEFAULT_TABLE table=test-workload [id=8068abd65e484402ad1729c9402bd896]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:09:09.087570 30009 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 59abb803b8ce4d28967bf12c46d66c0d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:09.088140 29939 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bb9da524d5b84f09b0c5853761aa5886. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:09.078291 29941 tablet_service.cc:1511] Processing CreateTablet for tablet 5ab64e7b83584196b9e6c6d1bc634351 (DEFAULT_TABLE table=test-workload [id=8068abd65e484402ad1729c9402bd896]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:09:09.089247 29941 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5ab64e7b83584196b9e6c6d1bc634351. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:09.109004 29862 tablet_service.cc:1511] Processing CreateTablet for tablet 968909b990764b0c8c388a63060c8130 (DEFAULT_TABLE table=test-workload [id=8068abd65e484402ad1729c9402bd896]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:09:09.119014 29862 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 968909b990764b0c8c388a63060c8130. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:09.122932 29938 tablet_service.cc:1511] Processing CreateTablet for tablet f814d836f0bd46a4aa7d660d8ff4b2d5 (DEFAULT_TABLE table=test-workload [id=8068abd65e484402ad1729c9402bd896]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:09:09.124440 29938 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f814d836f0bd46a4aa7d660d8ff4b2d5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:09.127101 29861 tablet_service.cc:1511] Processing CreateTablet for tablet 59abb803b8ce4d28967bf12c46d66c0d (DEFAULT_TABLE table=test-workload [id=8068abd65e484402ad1729c9402bd896]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:09:09.128542 29861 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 59abb803b8ce4d28967bf12c46d66c0d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:09.155498 30067 tablet_bootstrap.cc:492] T 8f557a35c94b4b2b917d69463fc69be9 P 58a7cda73b3542718987bf815eed9b79: Bootstrap starting.
I20260709 13:09:09.176116 29942 tablet_service.cc:1511] Processing CreateTablet for tablet 6450825bf8ba4ebaa0e631b1dea6538e (DEFAULT_TABLE table=test-workload [id=8068abd65e484402ad1729c9402bd896]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:09:09.177625 29942 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6450825bf8ba4ebaa0e631b1dea6538e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:09.177137 29937 tablet_service.cc:1511] Processing CreateTablet for tablet 968909b990764b0c8c388a63060c8130 (DEFAULT_TABLE table=test-workload [id=8068abd65e484402ad1729c9402bd896]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:09:09.179073 29937 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 968909b990764b0c8c388a63060c8130. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:09.207324 29936 tablet_service.cc:1511] Processing CreateTablet for tablet 59abb803b8ce4d28967bf12c46d66c0d (DEFAULT_TABLE table=test-workload [id=8068abd65e484402ad1729c9402bd896]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:09:09.208731 29936 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 59abb803b8ce4d28967bf12c46d66c0d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:09.216022 30067 tablet_bootstrap.cc:654] T 8f557a35c94b4b2b917d69463fc69be9 P 58a7cda73b3542718987bf815eed9b79: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:09.211436 30069 tablet_bootstrap.cc:492] T 6d4b64688b8949c89f8f7b7aa871efed P 4bc679ad21a64bfe93bf64ff1b6ba3b2: Bootstrap starting.
I20260709 13:09:09.220119 30068 tablet_bootstrap.cc:492] T 8f557a35c94b4b2b917d69463fc69be9 P 37897779fb894afb8129dcf5d269bd54: Bootstrap starting.
I20260709 13:09:09.249085 30068 tablet_bootstrap.cc:654] T 8f557a35c94b4b2b917d69463fc69be9 P 37897779fb894afb8129dcf5d269bd54: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:09.249460 30069 tablet_bootstrap.cc:654] T 6d4b64688b8949c89f8f7b7aa871efed P 4bc679ad21a64bfe93bf64ff1b6ba3b2: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:09.263592 30067 tablet_bootstrap.cc:492] T 8f557a35c94b4b2b917d69463fc69be9 P 58a7cda73b3542718987bf815eed9b79: No bootstrap required, opened a new log
I20260709 13:09:09.264101 30067 ts_tablet_manager.cc:1403] T 8f557a35c94b4b2b917d69463fc69be9 P 58a7cda73b3542718987bf815eed9b79: Time spent bootstrapping tablet: real 0.126s	user 0.013s	sys 0.014s
I20260709 13:09:09.266845 30067 raft_consensus.cc:359] T 8f557a35c94b4b2b917d69463fc69be9 P 58a7cda73b3542718987bf815eed9b79 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "58a7cda73b3542718987bf815eed9b79" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 37953 } } peers { permanent_uuid: "4bc679ad21a64bfe93bf64ff1b6ba3b2" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 33075 } } peers { permanent_uuid: "37897779fb894afb8129dcf5d269bd54" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 42765 } }
I20260709 13:09:09.267567 30067 raft_consensus.cc:385] T 8f557a35c94b4b2b917d69463fc69be9 P 58a7cda73b3542718987bf815eed9b79 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:09.267858 30067 raft_consensus.cc:740] T 8f557a35c94b4b2b917d69463fc69be9 P 58a7cda73b3542718987bf815eed9b79 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 58a7cda73b3542718987bf815eed9b79, State: Initialized, Role: FOLLOWER
I20260709 13:09:09.268579 30067 consensus_queue.cc:260] T 8f557a35c94b4b2b917d69463fc69be9 P 58a7cda73b3542718987bf815eed9b79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "58a7cda73b3542718987bf815eed9b79" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 37953 } } peers { permanent_uuid: "4bc679ad21a64bfe93bf64ff1b6ba3b2" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 33075 } } peers { permanent_uuid: "37897779fb894afb8129dcf5d269bd54" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 42765 } }
I20260709 13:09:09.269440 30069 tablet_bootstrap.cc:492] T 6d4b64688b8949c89f8f7b7aa871efed P 4bc679ad21a64bfe93bf64ff1b6ba3b2: No bootstrap required, opened a new log
I20260709 13:09:09.270257 30069 ts_tablet_manager.cc:1403] T 6d4b64688b8949c89f8f7b7aa871efed P 4bc679ad21a64bfe93bf64ff1b6ba3b2: Time spent bootstrapping tablet: real 0.059s	user 0.009s	sys 0.003s
I20260709 13:09:09.270733 29903 heartbeater.cc:499] Master 127.17.223.62:40001 was elected leader, sending a full tablet report...
I20260709 13:09:09.271237 30067 ts_tablet_manager.cc:1434] T 8f557a35c94b4b2b917d69463fc69be9 P 58a7cda73b3542718987bf815eed9b79: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.001s
I20260709 13:09:09.272228 30067 tablet_bootstrap.cc:492] T 5ab64e7b83584196b9e6c6d1bc634351 P 58a7cda73b3542718987bf815eed9b79: Bootstrap starting.
I20260709 13:09:09.272781 30068 tablet_bootstrap.cc:492] T 8f557a35c94b4b2b917d69463fc69be9 P 37897779fb894afb8129dcf5d269bd54: No bootstrap required, opened a new log
I20260709 13:09:09.273325 30068 ts_tablet_manager.cc:1403] T 8f557a35c94b4b2b917d69463fc69be9 P 37897779fb894afb8129dcf5d269bd54: Time spent bootstrapping tablet: real 0.062s	user 0.015s	sys 0.000s
I20260709 13:09:09.276206 30068 raft_consensus.cc:359] T 8f557a35c94b4b2b917d69463fc69be9 P 37897779fb894afb8129dcf5d269bd54 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "58a7cda73b3542718987bf815eed9b79" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 37953 } } peers { permanent_uuid: "4bc679ad21a64bfe93bf64ff1b6ba3b2" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 33075 } } peers { permanent_uuid: "37897779fb894afb8129dcf5d269bd54" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 42765 } }
I20260709 13:09:09.278373 30067 tablet_bootstrap.cc:654] T 5ab64e7b83584196b9e6c6d1bc634351 P 58a7cda73b3542718987bf815eed9b79: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:09.278469 30068 raft_consensus.cc:385] T 8f557a35c94b4b2b917d69463fc69be9 P 37897779fb894afb8129dcf5d269bd54 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:09.279003 30068 raft_consensus.cc:740] T 8f557a35c94b4b2b917d69463fc69be9 P 37897779fb894afb8129dcf5d269bd54 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 37897779fb894afb8129dcf5d269bd54, State: Initialized, Role: FOLLOWER
I20260709 13:09:09.274606 30069 raft_consensus.cc:359] T 6d4b64688b8949c89f8f7b7aa871efed P 4bc679ad21a64bfe93bf64ff1b6ba3b2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "58a7cda73b3542718987bf815eed9b79" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 37953 } } peers { permanent_uuid: "4bc679ad21a64bfe93bf64ff1b6ba3b2" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 33075 } } peers { permanent_uuid: "37897779fb894afb8129dcf5d269bd54" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 42765 } }
I20260709 13:09:09.279738 30069 raft_consensus.cc:385] T 6d4b64688b8949c89f8f7b7aa871efed P 4bc679ad21a64bfe93bf64ff1b6ba3b2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:09.280073 30069 raft_consensus.cc:740] T 6d4b64688b8949c89f8f7b7aa871efed P 4bc679ad21a64bfe93bf64ff1b6ba3b2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4bc679ad21a64bfe93bf64ff1b6ba3b2, State: Initialized, Role: FOLLOWER
I20260709 13:09:09.280511 30068 consensus_queue.cc:260] T 8f557a35c94b4b2b917d69463fc69be9 P 37897779fb894afb8129dcf5d269bd54 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "58a7cda73b3542718987bf815eed9b79" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 37953 } } peers { permanent_uuid: "4bc679ad21a64bfe93bf64ff1b6ba3b2" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 33075 } } peers { permanent_uuid: "37897779fb894afb8129dcf5d269bd54" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 42765 } }
I20260709 13:09:09.281000 30069 consensus_queue.cc:260] T 6d4b64688b8949c89f8f7b7aa871efed P 4bc679ad21a64bfe93bf64ff1b6ba3b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "58a7cda73b3542718987bf815eed9b79" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 37953 } } peers { permanent_uuid: "4bc679ad21a64bfe93bf64ff1b6ba3b2" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 33075 } } peers { permanent_uuid: "37897779fb894afb8129dcf5d269bd54" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 42765 } }
I20260709 13:09:09.287650 30069 ts_tablet_manager.cc:1434] T 6d4b64688b8949c89f8f7b7aa871efed P 4bc679ad21a64bfe93bf64ff1b6ba3b2: Time spent starting tablet: real 0.017s	user 0.001s	sys 0.010s
I20260709 13:09:09.289391 29978 heartbeater.cc:499] Master 127.17.223.62:40001 was elected leader, sending a full tablet report...
I20260709 13:09:09.295184 30069 tablet_bootstrap.cc:492] T 8f557a35c94b4b2b917d69463fc69be9 P 4bc679ad21a64bfe93bf64ff1b6ba3b2: Bootstrap starting.
I20260709 13:09:09.301399 30068 ts_tablet_manager.cc:1434] T 8f557a35c94b4b2b917d69463fc69be9 P 37897779fb894afb8129dcf5d269bd54: Time spent starting tablet: real 0.028s	user 0.015s	sys 0.004s
I20260709 13:09:09.301780 30052 heartbeater.cc:499] Master 127.17.223.62:40001 was elected leader, sending a full tablet report...
I20260709 13:09:09.302500 30068 tablet_bootstrap.cc:492] T 6450825bf8ba4ebaa0e631b1dea6538e P 37897779fb894afb8129dcf5d269bd54: Bootstrap starting.
I20260709 13:09:09.302731 30067 tablet_bootstrap.cc:492] T 5ab64e7b83584196b9e6c6d1bc634351 P 58a7cda73b3542718987bf815eed9b79: No bootstrap required, opened a new log
I20260709 13:09:09.303252 30067 ts_tablet_manager.cc:1403] T 5ab64e7b83584196b9e6c6d1bc634351 P 58a7cda73b3542718987bf815eed9b79: Time spent bootstrapping tablet: real 0.031s	user 0.027s	sys 0.002s
I20260709 13:09:09.306021 30067 raft_consensus.cc:359] T 5ab64e7b83584196b9e6c6d1bc634351 P 58a7cda73b3542718987bf815eed9b79 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "58a7cda73b3542718987bf815eed9b79" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 37953 } } peers { permanent_uuid: "4bc679ad21a64bfe93bf64ff1b6ba3b2" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 33075 } } peers { permanent_uuid: "37897779fb894afb8129dcf5d269bd54" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 42765 } }
I20260709 13:09:09.306789 30067 raft_consensus.cc:385] T 5ab64e7b83584196b9e6c6d1bc634351 P 58a7cda73b3542718987bf815eed9b79 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:09.307097 30067 raft_consensus.cc:740] T 5ab64e7b83584196b9e6c6d1bc634351 P 58a7cda73b3542718987bf815eed9b79 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 58a7cda73b3542718987bf815eed9b79, State: Initialized, Role: FOLLOWER
I20260709 13:09:09.307806 30067 consensus_queue.cc:260] T 5ab64e7b83584196b9e6c6d1bc634351 P 58a7cda73b3542718987bf815eed9b79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "58a7cda73b3542718987bf815eed9b79" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 37953 } } peers { permanent_uuid: "4bc679ad21a64bfe93bf64ff1b6ba3b2" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 33075 } } peers { permanent_uuid: "37897779fb894afb8129dcf5d269bd54" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 42765 } }
I20260709 13:09:09.309952 30067 ts_tablet_manager.cc:1434] T 5ab64e7b83584196b9e6c6d1bc634351 P 58a7cda73b3542718987bf815eed9b79: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 13:09:09.310966 30067 tablet_bootstrap.cc:492] T bb9da524d5b84f09b0c5853761aa5886 P 58a7cda73b3542718987bf815eed9b79: Bootstrap starting.
I20260709 13:09:09.313335 30068 tablet_bootstrap.cc:654] T 6450825bf8ba4ebaa0e631b1dea6538e P 37897779fb894afb8129dcf5d269bd54: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:09.317338 30067 tablet_bootstrap.cc:654] T bb9da524d5b84f09b0c5853761aa5886 P 58a7cda73b3542718987bf815eed9b79: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:09.320271 30069 tablet_bootstrap.cc:654] T 8f557a35c94b4b2b917d69463fc69be9 P 4bc679ad21a64bfe93bf64ff1b6ba3b2: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:09.322395 30073 raft_consensus.cc:493] T 5ab64e7b83584196b9e6c6d1bc634351 P 58a7cda73b3542718987bf815eed9b79 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:09.323006 30073 raft_consensus.cc:515] T 5ab64e7b83584196b9e6c6d1bc634351 P 58a7cda73b3542718987bf815eed9b79 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "58a7cda73b3542718987bf815eed9b79" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 37953 } } peers { permanent_uuid: "4bc679ad21a64bfe93bf64ff1b6ba3b2" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 33075 } } peers { permanent_uuid: "37897779fb894afb8129dcf5d269bd54" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 42765 } }
I20260709 13:09:09.330230 30073 leader_election.cc:290] T 5ab64e7b83584196b9e6c6d1bc634351 P 58a7cda73b3542718987bf815eed9b79 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4bc679ad21a64bfe93bf64ff1b6ba3b2 (127.17.223.2:33075), 37897779fb894afb8129dcf5d269bd54 (127.17.223.3:42765)
I20260709 13:09:09.330659 30067 tablet_bootstrap.cc:492] T bb9da524d5b84f09b0c5853761aa5886 P 58a7cda73b3542718987bf815eed9b79: No bootstrap required, opened a new log
I20260709 13:09:09.331576 30067 ts_tablet_manager.cc:1403] T bb9da524d5b84f09b0c5853761aa5886 P 58a7cda73b3542718987bf815eed9b79: Time spent bootstrapping tablet: real 0.021s	user 0.014s	sys 0.004s
I20260709 13:09:09.332283 30069 tablet_bootstrap.cc:492] T 8f557a35c94b4b2b917d69463fc69be9 P 4bc679ad21a64bfe93bf64ff1b6ba3b2: No bootstrap required, opened a new log
I20260709 13:09:09.334182 30069 ts_tablet_manager.cc:1403] T 8f557a35c94b4b2b917d69463fc69be9 P 4bc679ad21a64bfe93bf64ff1b6ba3b2: Time spent bootstrapping tablet: real 0.039s	user 0.013s	sys 0.002s
I20260709 13:09:09.335369 30067 raft_consensus.cc:359] T bb9da524d5b84f09b0c5853761aa5886 P 58a7cda73b3542718987bf815eed9b79 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "58a7cda73b3542718987bf815eed9b79" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 37953 } } peers { permanent_uuid: "4bc679ad21a64bfe93bf64ff1b6ba3b2" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 33075 } } peers { permanent_uuid: "37897779fb894afb8129dcf5d269bd54" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 42765 } }
I20260709 13:09:09.337728 30069 raft_consensus.cc:359] T 8f557a35c94b4b2b917d69463fc69be9 P 4bc679ad21a64bfe93bf64ff1b6ba3b2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "58a7cda73b3542718987bf815eed9b79" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 37953 } } peers { permanent_uuid: "4bc679ad21a64bfe93bf64ff1b6ba3b2" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 33075 } } peers { permanent_uuid: "37897779fb894afb8129dcf5d269bd54" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 42765 } }
I20260709 13:09:09.336494 30067 raft_consensus.cc:385] T bb9da524d5b84f09b0c5853761aa5886 P 58a7cda73b3542718987bf815eed9b79 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:09.343439 30067 raft_consensus.cc:740] T bb9da524d5b84f09b0c5853761aa5886 P 58a7cda73b3542718987bf815eed9b79 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 58a7cda73b3542718987bf815eed9b79, State: Initialized, Role: FOLLOWER
I20260709 13:09:09.343868 30068 tablet_bootstrap.cc:492] T 6450825bf8ba4ebaa0e631b1dea6538e P 37897779fb894afb8129dcf5d269bd54: No bootstrap required, opened a new log
I20260709 13:09:09.344097 30069 raft_consensus.cc:385] T 8f557a35c94b4b2b917d69463fc69be9 P 4bc679ad21a64bfe93bf64ff1b6ba3b2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:09.344487 30068 ts_tablet_manager.cc:1403] T 6450825bf8ba4ebaa0e631b1dea6538e P 37897779fb894afb8129dcf5d269bd54: Time spent bootstrapping tablet: real 0.042s	user 0.013s	sys 0.013s
I20260709 13:09:09.344236 30067 consensus_queue.cc:260] T bb9da524d5b84f09b0c5853761aa5886 P 58a7cda73b3542718987bf815eed9b79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "58a7cda73b3542718987bf815eed9b79" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 37953 } } peers { permanent_uuid: "4bc679ad21a64bfe93bf64ff1b6ba3b2" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 33075 } } peers { permanent_uuid: "37897779fb894afb8129dcf5d269bd54" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 42765 } }
I20260709 13:09:09.346590 30067 ts_tablet_manager.cc:1434] T bb9da524d5b84f09b0c5853761aa5886 P 58a7cda73b3542718987bf815eed9b79: Time spent starting tablet: real 0.015s	user 0.006s	sys 0.000s
I20260709 13:09:09.344542 30069 raft_consensus.cc:740] T 8f557a35c94b4b2b917d69463fc69be9 P 4bc679ad21a64bfe93bf64ff1b6ba3b2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4bc679ad21a64bfe93bf64ff1b6ba3b2, State: Initialized, Role: FOLLOWER
I20260709 13:09:09.347805 30067 tablet_bootstrap.cc:492] T e347ac4792b04c198fb6829a4a87078b P 58a7cda73b3542718987bf815eed9b79: Bootstrap starting.
I20260709 13:09:09.348608 30069 consensus_queue.cc:260] T 8f557a35c94b4b2b917d69463fc69be9 P 4bc679ad21a64bfe93bf64ff1b6ba3b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "58a7cda73b3542718987bf815eed9b79" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 37953 } } peers { permanent_uuid: "4bc679ad21a64bfe93bf64ff1b6ba3b2" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 33075 } } peers { permanent_uuid: "37897779fb894afb8129dcf5d269bd54" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 42765 } }
I20260709 13:09:09.347752 30068 raft_consensus.cc:359] T 6450825bf8ba4ebaa0e631b1dea6538e P 37897779fb894afb8129dcf5d269bd54 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "58a7cda73b3542718987bf815eed9b79" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 37953 } } peers { permanent_uuid: "4bc679ad21a64bfe93bf64ff1b6ba3b2" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 33075 } } peers { permanent_uuid: "37897779fb894afb8129dcf5d269bd54" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 42765 } }
I20260709 13:09:09.355036 30067 tablet_bootstrap.cc:654] T e347ac4792b04c198fb6829a4a87078b P 58a7cda73b3542718987bf815eed9b79: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:09.350337 30068 raft_consensus.cc:385] T 6450825bf8ba4ebaa0e631b1dea6538e P 37897779fb894afb8129dcf5d269bd54 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:09.358620 30068 raft_consensus.cc:740] T 6450825bf8ba4ebaa0e631b1dea6538e P 37897779fb894afb8129dcf5d269bd54 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 37897779fb894afb8129dcf5d269bd54, State: Initialized, Role: FOLLOWER
I20260709 13:09:09.358916 30027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ab64e7b83584196b9e6c6d1bc634351" candidate_uuid: "58a7cda73b3542718987bf815eed9b79" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "37897779fb894afb8129dcf5d269bd54" is_pre_election: true
W20260709 13:09:09.360574 29841 leader_election.cc:343] T 5ab64e7b83584196b9e6c6d1bc634351 P 58a7cda73b3542718987bf815eed9b79 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 37897779fb894afb8129dcf5d269bd54 (127.17.223.3:42765): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:09.359853 30068 consensus_queue.cc:260] T 6450825bf8ba4ebaa0e631b1dea6538e P 37897779fb894afb8129dcf5d269bd54 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "58a7cda73b3542718987bf815eed9b79" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 37953 } } peers { permanent_uuid: "4bc679ad21a64bfe93bf64ff1b6ba3b2" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 33075 } } peers { permanent_uuid: "37897779fb894afb8129dcf5d269bd54" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 42765 } }
I20260709 13:09:09.363524 30069 ts_tablet_manager.cc:1434] T 8f557a35c94b4b2b917d69463fc69be9 P 4bc679ad21a64bfe93bf64ff1b6ba3b2: Time spent starting tablet: real 0.029s	user 0.007s	sys 0.001s
I20260709 13:09:09.364693 30069 tablet_bootstrap.cc:492] T bb9da524d5b84f09b0c5853761aa5886 P 4bc679ad21a64bfe93bf64ff1b6ba3b2: Bootstrap starting.
I20260709 13:09:09.366597 30068 ts_tablet_manager.cc:1434] T 6450825bf8ba4ebaa0e631b1dea6538e P 37897779fb894afb8129dcf5d269bd54: Time spent starting tablet: real 0.022s	user 0.006s	sys 0.004s
I20260709 13:09:09.368057 30068 tablet_bootstrap.cc:492] T 59abb803b8ce4d28967bf12c46d66c0d P 37897779fb894afb8129dcf5d269bd54: Bootstrap starting.
I20260709 13:09:09.372316 29953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ab64e7b83584196b9e6c6d1bc634351" candidate_uuid: "58a7cda73b3542718987bf815eed9b79" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4bc679ad21a64bfe93bf64ff1b6ba3b2" is_pre_election: true
W20260709 13:09:09.374238 29842 leader_election.cc:343] T 5ab64e7b83584196b9e6c6d1bc634351 P 58a7cda73b3542718987bf815eed9b79 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4bc679ad21a64bfe93bf64ff1b6ba3b2 (127.17.223.2:33075): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:09.374758 29842 leader_election.cc:304] T 5ab64e7b83584196b9e6c6d1bc634351 P 58a7cda73b3542718987bf815eed9b79 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 58a7cda73b3542718987bf815eed9b79; no voters: 37897779fb894afb8129dcf5d269bd54, 4bc679ad21a64bfe93bf64ff1b6ba3b2
I20260709 13:09:09.375998 30073 raft_consensus.cc:2749] T 5ab64e7b83584196b9e6c6d1bc634351 P 58a7cda73b3542718987bf815eed9b79 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:09.378898 30068 tablet_bootstrap.cc:654] T 59abb803b8ce4d28967bf12c46d66c0d P 37897779fb894afb8129dcf5d269bd54: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:09.380678 30067 tablet_bootstrap.cc:492] T e347ac4792b04c198fb6829a4a87078b P 58a7cda73b3542718987bf815eed9b79: No bootstrap required, opened a new log
I20260709 13:09:09.381192 30067 ts_tablet_manager.cc:1403] T e347ac4792b04c198fb6829a4a87078b P 58a7cda73b3542718987bf815eed9b79: Time spent bootstrapping tablet: real 0.034s	user 0.010s	sys 0.021s
I20260709 13:09:09.381990 30069 tablet_bootstrap.cc:654] T bb9da524d5b84f09b0c5853761aa5886 P 4bc679ad21a64bfe93bf64ff1b6ba3b2: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:09.385138 30075 raft_consensus.cc:493] T 8f557a35c94b4b2b917d69463fc69be9 P 37897779fb894afb8129dcf5d269bd54 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:09.385937 30075 raft_consensus.cc:515] T 8f557a35c94b4b2b917d69463fc69be9 P 37897779fb894afb8129dcf5d269bd54 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "58a7cda73b3542718987bf815eed9b79" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 37953 } } peers { permanent_uuid: "4bc679ad21a64bfe93bf64ff1b6ba3b2" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 33075 } } peers { permanent_uuid: "37897779fb894afb8129dcf5d269bd54" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 42765 } }
I20260709 13:09:09.385111 30067 raft_consensus.cc:359] T e347ac4792b04c198fb6829a4a87078b P 58a7cda73b3542718987bf815eed9b79 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "58a7cda73b3542718987bf815eed9b79" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 37953 } } peers { permanent_uuid: "4bc679ad21a64bfe93bf64ff1b6ba3b2" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 33075 } } peers { permanent_uuid: "37897779fb894afb8129dcf5d269bd54" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 42765 } }
I20260709 13:09:09.388967 30067 raft_consensus.cc:385] T e347ac4792b04c198fb6829a4a87078b P 58a7cda73b3542718987bf815eed9b79 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:09.389281 30067 raft_consensus.cc:740] T e347ac4792b04c198fb6829a4a87078b P 58a7cda73b3542718987bf815eed9b79 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 58a7cda73b3542718987bf815eed9b79, State: Initialized, Role: FOLLOWER
I20260709 13:09:09.390115 30067 consensus_queue.cc:260] T e347ac4792b04c198fb6829a4a87078b P 58a7cda73b3542718987bf815eed9b79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "58a7cda73b3542718987bf815eed9b79" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 37953 } } peers { permanent_uuid: "4bc679ad21a64bfe93bf64ff1b6ba3b2" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 33075 } } peers { permanent_uuid: "37897779fb894afb8129dcf5d269bd54" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 42765 } }
I20260709 13:09:09.391508 30068 tablet_bootstrap.cc:492] T 59abb803b8ce4d28967bf12c46d66c0d P 37897779fb894afb8129dcf5d269bd54: No bootstrap required, opened a new log
I20260709 13:09:09.391834 30069 tablet_bootstrap.cc:492] T bb9da524d5b84f09b0c5853761aa5886 P 4bc679ad21a64bfe93bf64ff1b6ba3b2: No bootstrap required, opened a new log
I20260709 13:09:09.392083 30068 ts_tablet_manager.cc:1403] T 59abb803b8ce4d28967bf12c46d66c0d P 37897779fb894afb8129dcf5d269bd54: Time spent bootstrapping tablet: real 0.024s	user 0.016s	sys 0.003s
I20260709 13:09:09.392470 30069 ts_tablet_manager.cc:1403] T bb9da524d5b84f09b0c5853761aa5886 P 4bc679ad21a64bfe93bf64ff1b6ba3b2: Time spent bootstrapping tablet: real 0.028s	user 0.008s	sys 0.006s
I20260709 13:09:09.395162 30068 raft_consensus.cc:359] T 59abb803b8ce4d28967bf12c46d66c0d P 37897779fb894afb8129dcf5d269bd54 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "58a7cda73b3542718987bf815eed9b79" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 37953 } } peers { permanent_uuid: "4bc679ad21a64bfe93bf64ff1b6ba3b2" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 33075 } } peers { permanent_uuid: "37897779fb894afb8129dcf5d269bd54" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 42765 } }
I20260709 13:09:09.395462 30069 raft_consensus.cc:359] T bb9da524d5b84f09b0c5853761aa5886 P 4bc679ad21a64bfe93bf64ff1b6ba3b2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "58a7cda73b3542718987bf815eed9b79" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 37953 } } peers { permanent_uuid: "4bc679ad21a64bfe93bf64ff1b6ba3b2" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 33075 } } peers { permanent_uuid: "37897779fb894afb8129dcf5d269bd54" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 42765 } }
I20260709 13:09:09.396337 30069 raft_consensus.cc:385] T bb9da524d5b84f09b0c5853761aa5886 P 4bc679ad21a64bfe93bf64ff1b6ba3b2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:09.396618 30069 raft_consensus.cc:740] T bb9da524d5b84f09b0c5853761aa5886 P 4bc679ad21a64bfe93bf64ff1b6ba3b2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4bc679ad21a64bfe93bf64ff1b6ba3b2, State: Initialized, Role: FOLLOWER
I20260709 13:09:09.397310 30069 consensus_queue.cc:260] T bb9da524d5b84f09b0c5853761aa5886 P 4bc679ad21a64bfe93bf64ff1b6ba3b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "58a7cda73b3542718987bf815eed9b79" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 37953 } } peers { permanent_uuid: "4bc679ad21a64bfe93bf64ff1b6ba3b2" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 33075 } } peers { permanent_uuid: "37897779fb894afb8129dcf5d269bd54" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 42765 } }
I20260709 13:09:09.395991 30068 raft_consensus.cc:385] T 59abb803b8ce4d28967bf12c46d66c0d P 37897779fb894afb8129dcf5d269bd54 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:09.399348 30068 raft_consensus.cc:740] T 59abb803b8ce4d28967bf12c46d66c0d P 37897779fb894afb8129dcf5d269bd54 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 37897779fb894afb8129dcf5d269bd54, State: Initialized, Role: FOLLOWER
I20260709 13:09:09.399716 30075 leader_election.cc:290] T 8f557a35c94b4b2b917d69463fc69be9 P 37897779fb894afb8129dcf5d269bd54 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 58a7cda73b3542718987bf815eed9b79 (127.17.223.1:37953), 4bc679ad21a64bfe93bf64ff1b6ba3b2 (127.17.223.2:33075)
I20260709 13:09:09.401269 30069 ts_tablet_manager.cc:1434] T bb9da524d5b84f09b0c5853761aa5886 P 4bc679ad21a64bfe93bf64ff1b6ba3b2: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 13:09:09.401149 30068 consensus_queue.cc:260] T 59abb803b8ce4d28967bf12c46d66c0d P 37897779fb894afb8129dcf5d269bd54 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "58a7cda73b3542718987bf815eed9b79" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 37953 } } peers { permanent_uuid: "4bc679ad21a64bfe93bf64ff1b6ba3b2" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 33075 } } peers { permanent_uuid: "37897779fb894afb8129dcf5d269bd54" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 42765 } }
I20260709 13:09:09.402302 30069 tablet_bootstrap.cc:492] T f814d836f0bd46a4aa7d660d8ff4b2d5 P 4bc679ad21a64bfe93bf64ff1b6ba3b2: Bootstrap starting.
I20260709 13:09:09.404129 30068 ts_tablet_manager.cc:1434] T 59abb803b8ce4d28967bf12c46d66c0d P 37897779fb894afb8129dcf5d269bd54: Time spent starting tablet: real 0.012s	user 0.008s	sys 0.000s
I20260709 13:09:09.405694 30068 tablet_bootstrap.cc:492] T 968909b990764b0c8c388a63060c8130 P 37897779fb894afb8129dcf5d269bd54: Bootstrap starting.
I20260709 13:09:09.406234 30067 ts_tablet_manager.cc:1434] T e347ac4792b04c198fb6829a4a87078b P 58a7cda73b3542718987bf815eed9b79: Time spent starting tablet: real 0.025s	user 0.009s	sys 0.000s
I20260709 13:09:09.410244 30067 tablet_bootstrap.cc:492] T 6450825bf8ba4ebaa0e631b1dea6538e P 58a7cda73b3542718987bf815eed9b79: Bootstrap starting.
I20260709 13:09:09.412079 30069 tablet_bootstrap.cc:654] T f814d836f0bd46a4aa7d660d8ff4b2d5 P 4bc679ad21a64bfe93bf64ff1b6ba3b2: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:09.416805 30067 tablet_bootstrap.cc:654] T 6450825bf8ba4ebaa0e631b1dea6538e P 58a7cda73b3542718987bf815eed9b79: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:09.420467 30068 tablet_bootstrap.cc:654] T 968909b990764b0c8c388a63060c8130 P 37897779fb894afb8129dcf5d269bd54: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:09.428610 29878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f557a35c94b4b2b917d69463fc69be9" candidate_uuid: "37897779fb894afb8129dcf5d269bd54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "58a7cda73b3542718987bf815eed9b79" is_pre_election: true
I20260709 13:09:09.429107 29953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f557a35c94b4b2b917d69463fc69be9" candidate_uuid: "37897779fb894afb8129dcf5d269bd54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4bc679ad21a64bfe93bf64ff1b6ba3b2" is_pre_election: true
I20260709 13:09:09.429467 29878 raft_consensus.cc:2468] T 8f557a35c94b4b2b917d69463fc69be9 P 58a7cda73b3542718987bf815eed9b79 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 37897779fb894afb8129dcf5d269bd54 in term 0.
I20260709 13:09:09.430022 29953 raft_consensus.cc:2468] T 8f557a35c94b4b2b917d69463fc69be9 P 4bc679ad21a64bfe93bf64ff1b6ba3b2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 37897779fb894afb8129dcf5d269bd54 in term 0.
I20260709 13:09:09.430914 29993 leader_election.cc:304] T 8f557a35c94b4b2b917d69463fc69be9 P 37897779fb894afb8129dcf5d269bd54 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 37897779fb894afb8129dcf5d269bd54, 58a7cda73b3542718987bf815eed9b79; no voters: 
I20260709 13:09:09.431779 30075 raft_consensus.cc:2804] T 8f557a35c94b4b2b917d69463fc69be9 P 37897779fb894afb8129dcf5d269bd54 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:09.432148 30075 raft_consensus.cc:493] T 8f557a35c94b4b2b917d69463fc69be9 P 37897779fb894afb8129dcf5d269bd54 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:09.432471 30075 raft_consensus.cc:3060] T 8f557a35c94b4b2b917d69463fc69be9 P 37897779fb894afb8129dcf5d269bd54 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:09.442298 30069 tablet_bootstrap.cc:492] T f814d836f0bd46a4aa7d660d8ff4b2d5 P 4bc679ad21a64bfe93bf64ff1b6ba3b2: No bootstrap required, opened a new log
I20260709 13:09:09.442566 30075 raft_consensus.cc:515] T 8f557a35c94b4b2b917d69463fc69be9 P 37897779fb894afb8129dcf5d269bd54 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "58a7cda73b3542718987bf815eed9b79" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 37953 } } peers { permanent_uuid: "4bc679ad21a64bfe93bf64ff1b6ba3b2" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 33075 } } peers { permanent_uuid: "37897779fb894afb8129dcf5d269bd54" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 42765 } }
I20260709 13:09:09.443186 30069 ts_tablet_manager.cc:1403] T f814d836f0bd46a4aa7d660d8ff4b2d5 P 4bc679ad21a64bfe93bf64ff1b6ba3b2: Time spent bootstrapping tablet: real 0.041s	user 0.010s	sys 0.012s
I20260709 13:09:09.444013 30067 tablet_bootstrap.cc:492] T 6450825bf8ba4ebaa0e631b1dea6538e P 58a7cda73b3542718987bf815eed9b79: No bootstrap required, opened a new log
I20260709 13:09:09.444612 30067 ts_tablet_manager.cc:1403] T 6450825bf8ba4ebaa0e631b1dea6538e P 58a7cda73b3542718987bf815eed9b79: Time spent bootstrapping tablet: real 0.035s	user 0.013s	sys 0.018s
I20260709 13:09:09.445677 29878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f557a35c94b4b2b917d69463fc69be9" candidate_uuid: "37897779fb894afb8129dcf5d269bd54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "58a7cda73b3542718987bf815eed9b79"
I20260709 13:09:09.446283 30068 tablet_bootstrap.cc:492] T 968909b990764b0c8c388a63060c8130 P 37897779fb894afb8129dcf5d269bd54: No bootstrap required, opened a new log
I20260709 13:09:09.446298 29878 raft_consensus.cc:3060] T 8f557a35c94b4b2b917d69463fc69be9 P 58a7cda73b3542718987bf815eed9b79 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:09.446378 30069 raft_consensus.cc:359] T f814d836f0bd46a4aa7d660d8ff4b2d5 P 4bc679ad21a64bfe93bf64ff1b6ba3b2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "58a7cda73b3542718987bf815eed9b79" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 37953 } } peers { permanent_uuid: "4bc679ad21a64bfe93bf64ff1b6ba3b2" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 33075 } } peers { permanent_uuid: "37897779fb894afb8129dcf5d269bd54" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 42765 } }
I20260709 13:09:09.447286 30068 ts_tablet_manager.cc:1403] T 968909b990764b0c8c388a63060c8130 P 37897779fb894afb8129dcf5d269bd54: Time spent bootstrapping tablet: real 0.042s	user 0.013s	sys 0.001s
I20260709 13:09:09.447710 30069 raft_consensus.cc:385] T f814d836f0bd46a4aa7d660d8ff4b2d5 P 4bc679ad21a64bfe93bf64ff1b6ba3b2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:09.448105 30069 raft_consensus.cc:740] T f814d836f0bd46a4aa7d660d8ff4b2d5 P 4bc679ad21a64bfe93bf64ff1b6ba3b2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4bc679ad21a64bfe93bf64ff1b6ba3b2, State: Initialized, Role: FOLLOWER
I20260709 13:09:09.448109 30067 raft_consensus.cc:359] T 6450825bf8ba4ebaa0e631b1dea6538e P 58a7cda73b3542718987bf815eed9b79 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "58a7cda73b3542718987bf815eed9b79" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 37953 } } peers { permanent_uuid: "4bc679ad21a64bfe93bf64ff1b6ba3b2" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 33075 } } peers { permanent_uuid: "37897779fb894afb8129dcf5d269bd54" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 42765 } }
I20260709 13:09:09.449123 30067 raft_consensus.cc:385] T 6450825bf8ba4ebaa0e631b1dea6538e P 58a7cda73b3542718987bf815eed9b79 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:09.449494 30067 raft_consensus.cc:740] T 6450825bf8ba4ebaa0e631b1dea6538e P 58a7cda73b3542718987bf815eed9b79 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 58a7cda73b3542718987bf815eed9b79, State: Initialized, Role: FOLLOWER
I20260709 13:09:09.449215 30069 consensus_queue.cc:260] T f814d836f0bd46a4aa7d660d8ff4b2d5 P 4bc679ad21a64bfe93bf64ff1b6ba3b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "58a7cda73b3542718987bf815eed9b79" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 37953 } } peers { permanent_uuid: "4bc679ad21a64bfe93bf64ff1b6ba3b2" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 33075 } } peers { permanent_uuid: "37897779fb894afb8129dcf5d269bd54" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 42765 } }
I20260709 13:09:09.450471 30067 consensus_queue.cc:260] T 6450825bf8ba4ebaa0e631b1dea6538e P 58a7cda73b3542718987bf815eed9b79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "58a7cda73b3542718987bf815eed9b79" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 37953 } } peers { permanent_uuid: "4bc679ad21a64bfe93bf64ff1b6ba3b2" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 33075 } } peers { permanent_uuid: "37897779fb894afb8129dcf5d269bd54" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 42765 } }
I20260709 13:09:09.452075 30068 raft_consensus.cc:359] T 968909b990764b0c8c388a63060c8130 P 37897779fb894afb8129dcf5d269bd54 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "58a7cda73b3542718987bf815eed9b79" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 37953 } } peers { permanent_uuid: "4bc679ad21a64bfe93bf64ff1b6ba3b2" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 33075 } } peers { permanent_uuid: "37897779fb894afb8129dcf5d269bd54" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 42765 } }
I20260709 13:09:09.452831 30068 raft_consensus.cc:385] T 968909b990764b0c8c388a63060c8130 P 37897779fb894afb8129dcf5d269bd54 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:09.453135 30068 raft_consensus.cc:740] T 968909b990764b0c8c388a63060c8130 P 37897779fb894afb8129dcf5d269bd54 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 37897779fb894afb8129dcf5d269bd54, State: Initialized, Role: FOLLOWER
I20260709 13:09:09.453186 29953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f557a35c94b4b2b917d69463fc69be9" candidate_uuid: "37897779fb894afb8129dcf5d269bd54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4bc679ad21a64bfe93bf64ff1b6ba3b2"
I20260709 13:09:09.453863 29953 raft_consensus.cc:3060] T 8f557a35c94b4b2b917d69463fc69be9 P 4bc679ad21a64bfe93bf64ff1b6ba3b2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:09.454312 30075 leader_election.cc:290] T 8f557a35c94b4b2b917d69463fc69be9 P 37897779fb894afb8129dcf5d269bd54 [CANDIDATE]: Term 1 election: Requested vote from peers 58a7cda73b3542718987bf815eed9b79 (127.17.223.1:37953), 4bc679ad21a64bfe93bf64ff1b6ba3b2 (127.17.223.2:33075)
I20260709 13:09:09.453904 30068 consensus_queue.cc:260] T 968909b990764b0c8c388a63060c8130 P 37897779fb894afb8129dcf5d269bd54 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "58a7cda73b3542718987bf815eed9b79" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 37953 } } peers { permanent_uuid: "4bc679ad21a64bfe93bf64ff1b6ba3b2" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 33075 } } peers { permanent_uuid: "37897779fb894afb8129dcf5d269bd54" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 42765 } }
I20260709 13:09:09.455760 30075 raft_consensus.cc:493] T 59abb803b8ce4d28967bf12c46d66c0d P 37897779fb894afb8129dcf5d269bd54 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:09.456296 30075 raft_consensus.cc:515] T 59abb803b8ce4d28967bf12c46d66c0d P 37897779fb894afb8129dcf5d269bd54 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "58a7cda73b3542718987bf815eed9b79" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 37953 } } peers { permanent_uuid: "4bc679ad21a64bfe93bf64ff1b6ba3b2" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 33075 } } peers { permanent_uuid: "37897779fb894afb8129dcf5d269bd54" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 42765 } }
I20260709 13:09:09.457084 30068 ts_tablet_manager.cc:1434] T 968909b990764b0c8c388a63060c8130 P 37897779fb894afb8129dcf5d269bd54: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.000s
I20260709 13:09:09.455185 30069 ts_tablet_manager.cc:1434] T f814d836f0bd46a4aa7d660d8ff4b2d5 P 4bc679ad21a64bfe93bf64ff1b6ba3b2: Time spent starting tablet: real 0.012s	user 0.007s	sys 0.001s
I20260709 13:09:09.458461 30069 tablet_bootstrap.cc:492] T 5ab64e7b83584196b9e6c6d1bc634351 P 4bc679ad21a64bfe93bf64ff1b6ba3b2: Bootstrap starting.
I20260709 13:09:09.458591 30075 leader_election.cc:290] T 59abb803b8ce4d28967bf12c46d66c0d P 37897779fb894afb8129dcf5d269bd54 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 58a7cda73b3542718987bf815eed9b79 (127.17.223.1:37953), 4bc679ad21a64bfe93bf64ff1b6ba3b2 (127.17.223.2:33075)
I20260709 13:09:09.459857 29952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59abb803b8ce4d28967bf12c46d66c0d" candidate_uuid: "37897779fb894afb8129dcf5d269bd54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4bc679ad21a64bfe93bf64ff1b6ba3b2" is_pre_election: true
W20260709 13:09:09.461427 29991 leader_election.cc:343] T 59abb803b8ce4d28967bf12c46d66c0d P 37897779fb894afb8129dcf5d269bd54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4bc679ad21a64bfe93bf64ff1b6ba3b2 (127.17.223.2:33075): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:09.462635 29953 raft_consensus.cc:2468] T 8f557a35c94b4b2b917d69463fc69be9 P 4bc679ad21a64bfe93bf64ff1b6ba3b2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 37897779fb894afb8129dcf5d269bd54 in term 1.
I20260709 13:09:09.453343 30067 ts_tablet_manager.cc:1434] T 6450825bf8ba4ebaa0e631b1dea6538e P 58a7cda73b3542718987bf815eed9b79: Time spent starting tablet: real 0.008s	user 0.010s	sys 0.000s
I20260709 13:09:09.464413 30067 tablet_bootstrap.cc:492] T 6d4b64688b8949c89f8f7b7aa871efed P 58a7cda73b3542718987bf815eed9b79: Bootstrap starting.
I20260709 13:09:09.465981 30068 tablet_bootstrap.cc:492] T 5ab64e7b83584196b9e6c6d1bc634351 P 37897779fb894afb8129dcf5d269bd54: Bootstrap starting.
I20260709 13:09:09.466789 29877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59abb803b8ce4d28967bf12c46d66c0d" candidate_uuid: "37897779fb894afb8129dcf5d269bd54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "58a7cda73b3542718987bf815eed9b79" is_pre_election: true
I20260709 13:09:09.465917 29991 leader_election.cc:304] T 8f557a35c94b4b2b917d69463fc69be9 P 37897779fb894afb8129dcf5d269bd54 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 37897779fb894afb8129dcf5d269bd54, 4bc679ad21a64bfe93bf64ff1b6ba3b2; no voters: 
W20260709 13:09:09.468748 29993 leader_election.cc:343] T 59abb803b8ce4d28967bf12c46d66c0d P 37897779fb894afb8129dcf5d269bd54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 58a7cda73b3542718987bf815eed9b79 (127.17.223.1:37953): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:09.469226 29993 leader_election.cc:304] T 59abb803b8ce4d28967bf12c46d66c0d P 37897779fb894afb8129dcf5d269bd54 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 37897779fb894afb8129dcf5d269bd54; no voters: 4bc679ad21a64bfe93bf64ff1b6ba3b2, 58a7cda73b3542718987bf815eed9b79
I20260709 13:09:09.471477 30067 tablet_bootstrap.cc:654] T 6d4b64688b8949c89f8f7b7aa871efed P 58a7cda73b3542718987bf815eed9b79: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:09.473388 30069 tablet_bootstrap.cc:654] T 5ab64e7b83584196b9e6c6d1bc634351 P 4bc679ad21a64bfe93bf64ff1b6ba3b2: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:09.478816 30068 tablet_bootstrap.cc:654] T 5ab64e7b83584196b9e6c6d1bc634351 P 37897779fb894afb8129dcf5d269bd54: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:09.479939 29878 raft_consensus.cc:2468] T 8f557a35c94b4b2b917d69463fc69be9 P 58a7cda73b3542718987bf815eed9b79 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 37897779fb894afb8129dcf5d269bd54 in term 1.
I20260709 13:09:09.488040 30075 raft_consensus.cc:2749] T 59abb803b8ce4d28967bf12c46d66c0d P 37897779fb894afb8129dcf5d269bd54 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:09.491070 30090 raft_consensus.cc:2804] T 8f557a35c94b4b2b917d69463fc69be9 P 37897779fb894afb8129dcf5d269bd54 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:09.491873 30090 raft_consensus.cc:697] T 8f557a35c94b4b2b917d69463fc69be9 P 37897779fb894afb8129dcf5d269bd54 [term 1 LEADER]: Becoming Leader. State: Replica: 37897779fb894afb8129dcf5d269bd54, State: Running, Role: LEADER
I20260709 13:09:09.492974 30090 consensus_queue.cc:237] T 8f557a35c94b4b2b917d69463fc69be9 P 37897779fb894afb8129dcf5d269bd54 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "58a7cda73b3542718987bf815eed9b79" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 37953 } } peers { permanent_uuid: "4bc679ad21a64bfe93bf64ff1b6ba3b2" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 33075 } } peers { permanent_uuid: "37897779fb894afb8129dcf5d269bd54" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 42765 } }
I20260709 13:09:09.498754 30068 tablet_bootstrap.cc:492] T 5ab64e7b83584196b9e6c6d1bc634351 P 37897779fb894afb8129dcf5d269bd54: No bootstrap required, opened a new log
I20260709 13:09:09.499401 30068 ts_tablet_manager.cc:1403] T 5ab64e7b83584196b9e6c6d1bc634351 P 37897779fb894afb8129dcf5d269bd54: Time spent bootstrapping tablet: real 0.034s	user 0.013s	sys 0.007s
I20260709 13:09:09.500293 30069 tablet_bootstrap.cc:492] T 5ab64e7b83584196b9e6c6d1bc634351 P 4bc679ad21a64bfe93bf64ff1b6ba3b2: No bootstrap required, opened a new log
I20260709 13:09:09.500655 30067 tablet_bootstrap.cc:492] T 6d4b64688b8949c89f8f7b7aa871efed P 58a7cda73b3542718987bf815eed9b79: No bootstrap required, opened a new log
I20260709 13:09:09.500890 30069 ts_tablet_manager.cc:1403] T 5ab64e7b83584196b9e6c6d1bc634351 P 4bc679ad21a64bfe93bf64ff1b6ba3b2: Time spent bootstrapping tablet: real 0.043s	user 0.011s	sys 0.007s
I20260709 13:09:09.501183 30067 ts_tablet_manager.cc:1403] T 6d4b64688b8949c89f8f7b7aa871efed P 58a7cda73b3542718987bf815eed9b79: Time spent bootstrapping tablet: real 0.037s	user 0.017s	sys 0.016s
I20260709 13:09:09.502476 30068 raft_consensus.cc:359] T 5ab64e7b83584196b9e6c6d1bc634351 P 37897779fb894afb8129dcf5d269bd54 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "58a7cda73b3542718987bf815eed9b79" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 37953 } } peers { permanent_uuid: "4bc679ad21a64bfe93bf64ff1b6ba3b2" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 33075 } } peers { permanent_uuid: "37897779fb894afb8129dcf5d269bd54" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 42765 } }
I20260709 13:09:09.503304 30068 raft_consensus.cc:385] T 5ab64e7b83584196b9e6c6d1bc634351 P 37897779fb894afb8129dcf5d269bd54 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:09.503598 30068 raft_consensus.cc:740] T 5ab64e7b83584196b9e6c6d1bc634351 P 37897779fb894afb8129dcf5d269bd54 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 37897779fb894afb8129dcf5d269bd54, State: Initialized, Role: FOLLOWER
I20260709 13:09:09.504344 30067 raft_consensus.cc:359] T 6d4b64688b8949c89f8f7b7aa871efed P 58a7cda73b3542718987bf815eed9b79 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "58a7cda73b3542718987bf815eed9b79" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 37953 } } peers { permanent_uuid: "4bc679ad21a64bfe93bf64ff1b6ba3b2" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 33075 } } peers { permanent_uuid: "37897779fb894afb8129dcf5d269bd54" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 42765 } }
I20260709 13:09:09.504505 30068 consensus_queue.cc:260] T 5ab64e7b83584196b9e6c6d1bc634351 P 37897779fb894afb8129dcf5d269bd54 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "58a7cda73b3542718987bf815eed9b79" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 37953 } } peers { permanent_uuid: "4bc679ad21a64bfe93bf64ff1b6ba3b2" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 33075 } } peers { permanent_uuid: "37897779fb894afb8129dcf5d269bd54" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 42765 } }
I20260709 13:09:09.505174 30067 raft_consensus.cc:385] T 6d4b64688b8949c89f8f7b7aa871efed P 58a7cda73b3542718987bf815eed9b79 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:09.505645 30067 raft_consensus.cc:740] T 6d4b64688b8949c89f8f7b7aa871efed P 58a7cda73b3542718987bf815eed9b79 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 58a7cda73b3542718987bf815eed9b79, State: Initialized, Role: FOLLOWER
I20260709 13:09:09.505079 30069 raft_consensus.cc:359] T 5ab64e7b83584196b9e6c6d1bc634351 P 4bc679ad21a64bfe93bf64ff1b6ba3b2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "58a7cda73b3542718987bf815eed9b79" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 37953 } } peers { permanent_uuid: "4bc679ad21a64bfe93bf64ff1b6ba3b2" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 33075 } } peers { permanent_uuid: "37897779fb894afb8129dcf5d269bd54" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 42765 } }
I20260709 13:09:09.506842 30069 raft_consensus.cc:385] T 5ab64e7b83584196b9e6c6d1bc634351 P 4bc679ad21a64bfe93bf64ff1b6ba3b2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:09.506600 30067 consensus_queue.cc:260] T 6d4b64688b8949c89f8f7b7aa871efed P 58a7cda73b3542718987bf815eed9b79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "58a7cda73b3542718987bf815eed9b79" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 37953 } } peers { permanent_uuid: "4bc679ad21a64bfe93bf64ff1b6ba3b2" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 33075 } } peers { permanent_uuid: "37897779fb894afb8129dcf5d269bd54" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 42765 } }
I20260709 13:09:09.507269 30068 ts_tablet_manager.cc:1434] T 5ab64e7b83584196b9e6c6d1bc634351 P 37897779fb894afb8129dcf5d269bd54: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.001s
I20260709 13:09:09.508375 30068 tablet_bootstrap.cc:492] T e347ac4792b04c198fb6829a4a87078b P 37897779fb894afb8129dcf5d269bd54: Bootstrap starting.
I20260709 13:09:09.509295 30067 ts_tablet_manager.cc:1434] T 6d4b64688b8949c89f8f7b7aa871efed P 58a7cda73b3542718987bf815eed9b79: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 13:09:09.510315 30067 tablet_bootstrap.cc:492] T f814d836f0bd46a4aa7d660d8ff4b2d5 P 58a7cda73b3542718987bf815eed9b79: Bootstrap starting.
I20260709 13:09:09.507290 30069 raft_consensus.cc:740] T 5ab64e7b83584196b9e6c6d1bc634351 P 4bc679ad21a64bfe93bf64ff1b6ba3b2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4bc679ad21a64bfe93bf64ff1b6ba3b2, State: Initialized, Role: FOLLOWER
W20260709 13:09:09.513411 29824 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:09:09.513695 30069 consensus_queue.cc:260] T 5ab64e7b83584196b9e6c6d1bc634351 P 4bc679ad21a64bfe93bf64ff1b6ba3b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "58a7cda73b3542718987bf815eed9b79" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 37953 } } peers { permanent_uuid: "4bc679ad21a64bfe93bf64ff1b6ba3b2" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 33075 } } peers { permanent_uuid: "37897779fb894afb8129dcf5d269bd54" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 42765 } }
I20260709 13:09:09.516320 30069 ts_tablet_manager.cc:1434] T 5ab64e7b83584196b9e6c6d1bc634351 P 4bc679ad21a64bfe93bf64ff1b6ba3b2: Time spent starting tablet: real 0.015s	user 0.010s	sys 0.000s
I20260709 13:09:09.517268 30067 tablet_bootstrap.cc:654] T f814d836f0bd46a4aa7d660d8ff4b2d5 P 58a7cda73b3542718987bf815eed9b79: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:09.521914 30068 tablet_bootstrap.cc:654] T e347ac4792b04c198fb6829a4a87078b P 37897779fb894afb8129dcf5d269bd54: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:09.523089 29774 catalog_manager.cc:5697] T 8f557a35c94b4b2b917d69463fc69be9 P 37897779fb894afb8129dcf5d269bd54 reported cstate change: term changed from 0 to 1, leader changed from <none> to 37897779fb894afb8129dcf5d269bd54 (127.17.223.3). New cstate: current_term: 1 leader_uuid: "37897779fb894afb8129dcf5d269bd54" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "58a7cda73b3542718987bf815eed9b79" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 37953 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4bc679ad21a64bfe93bf64ff1b6ba3b2" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 33075 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "37897779fb894afb8129dcf5d269bd54" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 42765 } health_report { overall_health: HEALTHY } } }
I20260709 13:09:09.539830 30069 tablet_bootstrap.cc:492] T 6450825bf8ba4ebaa0e631b1dea6538e P 4bc679ad21a64bfe93bf64ff1b6ba3b2: Bootstrap starting.
I20260709 13:09:09.544014 30067 tablet_bootstrap.cc:492] T f814d836f0bd46a4aa7d660d8ff4b2d5 P 58a7cda73b3542718987bf815eed9b79: No bootstrap required, opened a new log
I20260709 13:09:09.544653 30067 ts_tablet_manager.cc:1403] T f814d836f0bd46a4aa7d660d8ff4b2d5 P 58a7cda73b3542718987bf815eed9b79: Time spent bootstrapping tablet: real 0.035s	user 0.014s	sys 0.017s
I20260709 13:09:09.545225 30068 tablet_bootstrap.cc:492] T e347ac4792b04c198fb6829a4a87078b P 37897779fb894afb8129dcf5d269bd54: No bootstrap required, opened a new log
I20260709 13:09:09.545955 30068 ts_tablet_manager.cc:1403] T e347ac4792b04c198fb6829a4a87078b P 37897779fb894afb8129dcf5d269bd54: Time spent bootstrapping tablet: real 0.038s	user 0.010s	sys 0.018s
I20260709 13:09:09.548058 30067 raft_consensus.cc:359] T f814d836f0bd46a4aa7d660d8ff4b2d5 P 58a7cda73b3542718987bf815eed9b79 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "58a7cda73b3542718987bf815eed9b79" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 37953 } } peers { permanent_uuid: "4bc679ad21a64bfe93bf64ff1b6ba3b2" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 33075 } } peers { permanent_uuid: "37897779fb894afb8129dcf5d269bd54" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 42765 } }
I20260709 13:09:09.548833 30067 raft_consensus.cc:385] T f814d836f0bd46a4aa7d660d8ff4b2d5 P 58a7cda73b3542718987bf815eed9b79 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:09.549057 30069 tablet_bootstrap.cc:654] T 6450825bf8ba4ebaa0e631b1dea6538e P 4bc679ad21a64bfe93bf64ff1b6ba3b2: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:09.549144 30067 raft_consensus.cc:740] T f814d836f0bd46a4aa7d660d8ff4b2d5 P 58a7cda73b3542718987bf815eed9b79 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 58a7cda73b3542718987bf815eed9b79, State: Initialized, Role: FOLLOWER
I20260709 13:09:09.548964 30068 raft_consensus.cc:359] T e347ac4792b04c198fb6829a4a87078b P 37897779fb894afb8129dcf5d269bd54 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "58a7cda73b3542718987bf815eed9b79" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 37953 } } peers { permanent_uuid: "4bc679ad21a64bfe93bf64ff1b6ba3b2" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 33075 } } peers { permanent_uuid: "37897779fb894afb8129dcf5d269bd54" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 42765 } }
I20260709 13:09:09.550006 30068 raft_consensus.cc:385] T e347ac4792b04c198fb6829a4a87078b P 37897779fb894afb8129dcf5d269bd54 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:09.550326 30068 raft_consensus.cc:740] T e347ac4792b04c198fb6829a4a87078b P 37897779fb894afb8129dcf5d269bd54 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 37897779fb894afb8129dcf5d269bd54, State: Initialized, Role: FOLLOWER
I20260709 13:09:09.550345 30067 consensus_queue.cc:260] T f814d836f0bd46a4aa7d660d8ff4b2d5 P 58a7cda73b3542718987bf815eed9b79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "58a7cda73b3542718987bf815eed9b79" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 37953 } } peers { permanent_uuid: "4bc679ad21a64bfe93bf64ff1b6ba3b2" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 33075 } } peers { permanent_uuid: "37897779fb894afb8129dcf5d269bd54" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 42765 } }
I20260709 13:09:09.550872 30073 raft_consensus.cc:493] T 6450825bf8ba4ebaa0e631b1dea6538e P 58a7cda73b3542718987bf815eed9b79 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:09.551254 30068 consensus_queue.cc:260] T e347ac4792b04c198fb6829a4a87078b P 37897779fb894afb8129dcf5d269bd54 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "58a7cda73b3542718987bf815eed9b79" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 37953 } } peers { permanent_uuid: "4bc679ad21a64bfe93bf64ff1b6ba3b2" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 33075 } } peers { permanent_uuid: "37897779fb894afb8129dcf5d269bd54" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 42765 } }
I20260709 13:09:09.551432 30073 raft_consensus.cc:515] T 6450825bf8ba4ebaa0e631b1dea6538e P 58a7cda73b3542718987bf815eed9b79 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "58a7cda73b3542718987bf815eed9b79" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 37953 } } peers { permanent_uuid: "4bc679ad21a64bfe93bf64ff1b6ba3b2" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 33075 } } peers { permanent_uuid: "37897779fb894afb8129dcf5d269bd54" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 42765 } }
I20260709 13:09:09.554136 30068 ts_tablet_manager.cc:1434] T e347ac4792b04c198fb6829a4a87078b P 37897779fb894afb8129dcf5d269bd54: Time spent starting tablet: real 0.008s	user 0.002s	sys 0.003s
I20260709 13:09:09.554975 30090 raft_consensus.cc:493] T e347ac4792b04c198fb6829a4a87078b P 37897779fb894afb8129dcf5d269bd54 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:09.555572 30090 raft_consensus.cc:515] T e347ac4792b04c198fb6829a4a87078b P 37897779fb894afb8129dcf5d269bd54 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "58a7cda73b3542718987bf815eed9b79" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 37953 } } peers { permanent_uuid: "4bc679ad21a64bfe93bf64ff1b6ba3b2" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 33075 } } peers { permanent_uuid: "37897779fb894afb8129dcf5d269bd54" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 42765 } }
I20260709 13:09:09.555904 30068 tablet_bootstrap.cc:492] T bb9da524d5b84f09b0c5853761aa5886 P 37897779fb894afb8129dcf5d269bd54: Bootstrap starting.
I20260709 13:09:09.559724 29878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e347ac4792b04c198fb6829a4a87078b" candidate_uuid: "37897779fb894afb8129dcf5d269bd54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "58a7cda73b3542718987bf815eed9b79" is_pre_election: true
I20260709 13:09:09.560179 29953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6450825bf8ba4ebaa0e631b1dea6538e" candidate_uuid: "58a7cda73b3542718987bf815eed9b79" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4bc679ad21a64bfe93bf64ff1b6ba3b2" is_pre_election: true
I20260709 13:09:09.560428 29878 raft_consensus.cc:2468] T e347ac4792b04c198fb6829a4a87078b P 58a7cda73b3542718987bf815eed9b79 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 37897779fb894afb8129dcf5d269bd54 in term 0.
I20260709 13:09:09.561299 30069 tablet_bootstrap.cc:492] T 6450825bf8ba4ebaa0e631b1dea6538e P 4bc679ad21a64bfe93bf64ff1b6ba3b2: No bootstrap required, opened a new log
I20260709 13:09:09.561851 30069 ts_tablet_manager.cc:1403] T 6450825bf8ba4ebaa0e631b1dea6538e P 4bc679ad21a64bfe93bf64ff1b6ba3b2: Time spent bootstrapping tablet: real 0.023s	user 0.013s	sys 0.004s
I20260709 13:09:09.562220 29993 leader_election.cc:304] T e347ac4792b04c198fb6829a4a87078b P 37897779fb894afb8129dcf5d269bd54 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 37897779fb894afb8129dcf5d269bd54, 58a7cda73b3542718987bf815eed9b79; no voters: 
I20260709 13:09:09.563246 30075 raft_consensus.cc:2804] T e347ac4792b04c198fb6829a4a87078b P 37897779fb894afb8129dcf5d269bd54 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:09.563728 30075 raft_consensus.cc:493] T e347ac4792b04c198fb6829a4a87078b P 37897779fb894afb8129dcf5d269bd54 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:09.564090 30075 raft_consensus.cc:3060] T e347ac4792b04c198fb6829a4a87078b P 37897779fb894afb8129dcf5d269bd54 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:09:09.567415 29842 leader_election.cc:343] T 6450825bf8ba4ebaa0e631b1dea6538e P 58a7cda73b3542718987bf815eed9b79 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4bc679ad21a64bfe93bf64ff1b6ba3b2 (127.17.223.2:33075): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:09.567338 30068 tablet_bootstrap.cc:654] T bb9da524d5b84f09b0c5853761aa5886 P 37897779fb894afb8129dcf5d269bd54: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:09.569373 30027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6450825bf8ba4ebaa0e631b1dea6538e" candidate_uuid: "58a7cda73b3542718987bf815eed9b79" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "37897779fb894afb8129dcf5d269bd54" is_pre_election: true
I20260709 13:09:09.567629 30073 leader_election.cc:290] T 6450825bf8ba4ebaa0e631b1dea6538e P 58a7cda73b3542718987bf815eed9b79 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4bc679ad21a64bfe93bf64ff1b6ba3b2 (127.17.223.2:33075), 37897779fb894afb8129dcf5d269bd54 (127.17.223.3:42765)
I20260709 13:09:09.570103 30027 raft_consensus.cc:2468] T 6450825bf8ba4ebaa0e631b1dea6538e P 37897779fb894afb8129dcf5d269bd54 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 58a7cda73b3542718987bf815eed9b79 in term 0.
I20260709 13:09:09.574725 29841 leader_election.cc:304] T 6450825bf8ba4ebaa0e631b1dea6538e P 58a7cda73b3542718987bf815eed9b79 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 37897779fb894afb8129dcf5d269bd54, 58a7cda73b3542718987bf815eed9b79; no voters: 4bc679ad21a64bfe93bf64ff1b6ba3b2
I20260709 13:09:09.578274 29953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e347ac4792b04c198fb6829a4a87078b" candidate_uuid: "37897779fb894afb8129dcf5d269bd54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4bc679ad21a64bfe93bf64ff1b6ba3b2" is_pre_election: true
W20260709 13:09:09.580444 29991 leader_election.cc:343] T e347ac4792b04c198fb6829a4a87078b P 37897779fb894afb8129dcf5d269bd54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4bc679ad21a64bfe93bf64ff1b6ba3b2 (127.17.223.2:33075): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:09.581162 30090 leader_election.cc:290] T e347ac4792b04c198fb6829a4a87078b P 37897779fb894afb8129dcf5d269bd54 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 58a7cda73b3542718987bf815eed9b79 (127.17.223.1:37953), 4bc679ad21a64bfe93bf64ff1b6ba3b2 (127.17.223.2:33075)
I20260709 13:09:09.582229 30073 raft_consensus.cc:2804] T 6450825bf8ba4ebaa0e631b1dea6538e P 58a7cda73b3542718987bf815eed9b79 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:09.582650 30073 raft_consensus.cc:493] T 6450825bf8ba4ebaa0e631b1dea6538e P 58a7cda73b3542718987bf815eed9b79 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:09.583015 30073 raft_consensus.cc:3060] T 6450825bf8ba4ebaa0e631b1dea6538e P 58a7cda73b3542718987bf815eed9b79 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:09.579173 30069 raft_consensus.cc:359] T 6450825bf8ba4ebaa0e631b1dea6538e P 4bc679ad21a64bfe93bf64ff1b6ba3b2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "58a7cda73b3542718987bf815eed9b79" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 37953 } } peers { permanent_uuid: "4bc679ad21a64bfe93bf64ff1b6ba3b2" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 33075 } } peers { permanent_uuid: "37897779fb894afb8129dcf5d269bd54" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 42765 } }
I20260709 13:09:09.589077 30069 raft_consensus.cc:385] T 6450825bf8ba4ebaa0e631b1dea6538e P 4bc679ad21a64bfe93bf64ff1b6ba3b2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:09.589808 30069 raft_consensus.cc:740] T 6450825bf8ba4ebaa0e631b1dea6538e P 4bc679ad21a64bfe93bf64ff1b6ba3b2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4bc679ad21a64bfe93bf64ff1b6ba3b2, State: Initialized, Role: FOLLOWER
I20260709 13:09:09.591502 30069 consensus_queue.cc:260] T 6450825bf8ba4ebaa0e631b1dea6538e P 4bc679ad21a64bfe93bf64ff1b6ba3b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "58a7cda73b3542718987bf815eed9b79" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 37953 } } peers { permanent_uuid: "4bc679ad21a64bfe93bf64ff1b6ba3b2" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 33075 } } peers { permanent_uuid: "37897779fb894afb8129dcf5d269bd54" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 42765 } }
I20260709 13:09:09.595041 30076 raft_consensus.cc:493] T 6450825bf8ba4ebaa0e631b1dea6538e P 4bc679ad21a64bfe93bf64ff1b6ba3b2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:09.595613 30076 raft_consensus.cc:515] T 6450825bf8ba4ebaa0e631b1dea6538e P 4bc679ad21a64bfe93bf64ff1b6ba3b2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "58a7cda73b3542718987bf815eed9b79" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 37953 } } peers { permanent_uuid: "4bc679ad21a64bfe93bf64ff1b6ba3b2" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 33075 } } peers { permanent_uuid: "37897779fb894afb8129dcf5d269bd54" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 42765 } }
I20260709 13:09:09.598381 30068 tablet_bootstrap.cc:492] T bb9da524d5b84f09b0c5853761aa5886 P 37897779fb894afb8129dcf5d269bd54: No bootstrap required, opened a new log
I20260709 13:09:09.599196 30068 ts_tablet_manager.cc:1403] T bb9da524d5b84f09b0c5853761aa5886 P 37897779fb894afb8129dcf5d269bd54: Time spent bootstrapping tablet: real 0.044s	user 0.011s	sys 0.012s
I20260709 13:09:09.603372 30068 raft_consensus.cc:359] T bb9da524d5b84f09b0c5853761aa5886 P 37897779fb894afb8129dcf5d269bd54 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "58a7cda73b3542718987bf815eed9b79" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 37953 } } peers { permanent_uuid: "4bc679ad21a64bfe93bf64ff1b6ba3b2" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 33075 } } peers { permanent_uuid: "37897779fb894afb8129dcf5d269bd54" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 42765 } }
I20260709 13:09:09.604399 30068 raft_consensus.cc:385] T bb9da524d5b84f09b0c5853761aa5886 P 37897779fb894afb8129dcf5d269bd54 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:09.605027 30076 leader_election.cc:290] T 6450825bf8ba4ebaa0e631b1dea6538e P 4bc679ad21a64bfe93bf64ff1b6ba3b2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 58a7cda73b3542718987bf815eed9b79 (127.17.223.1:37953), 37897779fb894afb8129dcf5d269bd54 (127.17.223.3:42765)
I20260709 13:09:09.606735 30067 ts_tablet_manager.cc:1434] T f814d836f0bd46a4aa7d660d8ff4b2d5 P 58a7cda73b3542718987bf815eed9b79: Time spent starting tablet: real 0.062s	user 0.031s	sys 0.031s
I20260709 13:09:09.605646 30099 raft_consensus.cc:493] T bb9da524d5b84f09b0c5853761aa5886 P 58a7cda73b3542718987bf815eed9b79 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:09.609323 30099 raft_consensus.cc:515] T bb9da524d5b84f09b0c5853761aa5886 P 58a7cda73b3542718987bf815eed9b79 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "58a7cda73b3542718987bf815eed9b79" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 37953 } } peers { permanent_uuid: "4bc679ad21a64bfe93bf64ff1b6ba3b2" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 33075 } } peers { permanent_uuid: "37897779fb894afb8129dcf5d269bd54" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 42765 } }
I20260709 13:09:09.610222 30068 raft_consensus.cc:740] T bb9da524d5b84f09b0c5853761aa5886 P 37897779fb894afb8129dcf5d269bd54 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 37897779fb894afb8129dcf5d269bd54, State: Initialized, Role: FOLLOWER
I20260709 13:09:09.614125 30068 consensus_queue.cc:260] T bb9da524d5b84f09b0c5853761aa5886 P 37897779fb894afb8129dcf5d269bd54 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "58a7cda73b3542718987bf815eed9b79" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 37953 } } peers { permanent_uuid: "4bc679ad21a64bfe93bf64ff1b6ba3b2" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 33075 } } peers { permanent_uuid: "37897779fb894afb8129dcf5d269bd54" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 42765 } }
I20260709 13:09:09.592229 30075 raft_consensus.cc:515] T e347ac4792b04c198fb6829a4a87078b P 37897779fb894afb8129dcf5d269bd54 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "58a7cda73b3542718987bf815eed9b79" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 37953 } } peers { permanent_uuid: "4bc679ad21a64bfe93bf64ff1b6ba3b2" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 33075 } } peers { permanent_uuid: "37897779fb894afb8129dcf5d269bd54" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 42765 } }
I20260709 13:09:09.616621 30068 ts_tablet_manager.cc:1434] T bb9da524d5b84f09b0c5853761aa5886 P 37897779fb894afb8129dcf5d269bd54: Time spent starting tablet: real 0.017s	user 0.004s	sys 0.003s
I20260709 13:09:09.617689 30068 tablet_bootstrap.cc:492] T 6d4b64688b8949c89f8f7b7aa871efed P 37897779fb894afb8129dcf5d269bd54: Bootstrap starting.
I20260709 13:09:09.618732 29878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e347ac4792b04c198fb6829a4a87078b" candidate_uuid: "37897779fb894afb8129dcf5d269bd54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "58a7cda73b3542718987bf815eed9b79"
I20260709 13:09:09.619431 29878 raft_consensus.cc:3060] T e347ac4792b04c198fb6829a4a87078b P 58a7cda73b3542718987bf815eed9b79 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:09.620021 30099 leader_election.cc:290] T bb9da524d5b84f09b0c5853761aa5886 P 58a7cda73b3542718987bf815eed9b79 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4bc679ad21a64bfe93bf64ff1b6ba3b2 (127.17.223.2:33075), 37897779fb894afb8129dcf5d269bd54 (127.17.223.3:42765)
I20260709 13:09:09.624321 30068 tablet_bootstrap.cc:654] T 6d4b64688b8949c89f8f7b7aa871efed P 37897779fb894afb8129dcf5d269bd54: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:09.610963 30067 tablet_bootstrap.cc:492] T 968909b990764b0c8c388a63060c8130 P 58a7cda73b3542718987bf815eed9b79: Bootstrap starting.
I20260709 13:09:09.626607 30027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb9da524d5b84f09b0c5853761aa5886" candidate_uuid: "58a7cda73b3542718987bf815eed9b79" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "37897779fb894afb8129dcf5d269bd54" is_pre_election: true
I20260709 13:09:09.627557 30027 raft_consensus.cc:2468] T bb9da524d5b84f09b0c5853761aa5886 P 37897779fb894afb8129dcf5d269bd54 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 58a7cda73b3542718987bf815eed9b79 in term 0.
I20260709 13:09:09.629187 29841 leader_election.cc:304] T bb9da524d5b84f09b0c5853761aa5886 P 58a7cda73b3542718987bf815eed9b79 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 37897779fb894afb8129dcf5d269bd54, 58a7cda73b3542718987bf815eed9b79; no voters: 
I20260709 13:09:09.630228 30099 raft_consensus.cc:2804] T bb9da524d5b84f09b0c5853761aa5886 P 58a7cda73b3542718987bf815eed9b79 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:09.630728 30099 raft_consensus.cc:493] T bb9da524d5b84f09b0c5853761aa5886 P 58a7cda73b3542718987bf815eed9b79 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:09.631150 30099 raft_consensus.cc:3060] T bb9da524d5b84f09b0c5853761aa5886 P 58a7cda73b3542718987bf815eed9b79 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:09.631102 29953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb9da524d5b84f09b0c5853761aa5886" candidate_uuid: "58a7cda73b3542718987bf815eed9b79" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4bc679ad21a64bfe93bf64ff1b6ba3b2" is_pre_election: true
I20260709 13:09:09.632187 29953 raft_consensus.cc:2468] T bb9da524d5b84f09b0c5853761aa5886 P 4bc679ad21a64bfe93bf64ff1b6ba3b2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 58a7cda73b3542718987bf815eed9b79 in term 0.
I20260709 13:09:09.633795 30067 tablet_bootstrap.cc:654] T 968909b990764b0c8c388a63060c8130 P 58a7cda73b3542718987bf815eed9b79: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:09.629182 30027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6450825bf8ba4ebaa0e631b1dea6538e" candidate_uuid: "4bc679ad21a64bfe93bf64ff1b6ba3b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "37897779fb894afb8129dcf5d269bd54" is_pre_election: true
I20260709 13:09:09.634977 30027 raft_consensus.cc:2468] T 6450825bf8ba4ebaa0e631b1dea6538e P 37897779fb894afb8129dcf5d269bd54 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4bc679ad21a64bfe93bf64ff1b6ba3b2 in term 0.
I20260709 13:09:09.636284 29916 leader_election.cc:304] T 6450825bf8ba4ebaa0e631b1dea6538e P 4bc679ad21a64bfe93bf64ff1b6ba3b2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 37897779fb894afb8129dcf5d269bd54, 4bc679ad21a64bfe93bf64ff1b6ba3b2; no voters: 
I20260709 13:09:09.637346 30076 raft_consensus.cc:2804] T 6450825bf8ba4ebaa0e631b1dea6538e P 4bc679ad21a64bfe93bf64ff1b6ba3b2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:09.637857 30076 raft_consensus.cc:493] T 6450825bf8ba4ebaa0e631b1dea6538e P 4bc679ad21a64bfe93bf64ff1b6ba3b2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:09.638329 30076 raft_consensus.cc:3060] T 6450825bf8ba4ebaa0e631b1dea6538e P 4bc679ad21a64bfe93bf64ff1b6ba3b2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:09.652688 30099 raft_consensus.cc:515] T bb9da524d5b84f09b0c5853761aa5886 P 58a7cda73b3542718987bf815eed9b79 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "58a7cda73b3542718987bf815eed9b79" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 37953 } } peers { permanent_uuid: "4bc679ad21a64bfe93bf64ff1b6ba3b2" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 33075 } } peers { permanent_uuid: "37897779fb894afb8129dcf5d269bd54" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 42765 } }
I20260709 13:09:09.657816 29878 raft_consensus.cc:2468] T e347ac4792b04c198fb6829a4a87078b P 58a7cda73b3542718987bf815eed9b79 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 37897779fb894afb8129dcf5d269bd54 in term 1.
I20260709 13:09:09.659606 30068 tablet_bootstrap.cc:492] T 6d4b64688b8949c89f8f7b7aa871efed P 37897779fb894afb8129dcf5d269bd54: No bootstrap required, opened a new log
I20260709 13:09:09.660121 30068 ts_tablet_manager.cc:1403] T 6d4b64688b8949c89f8f7b7aa871efed P 37897779fb894afb8129dcf5d269bd54: Time spent bootstrapping tablet: real 0.043s	user 0.017s	sys 0.003s
I20260709 13:09:09.660907 30099 leader_election.cc:290] T bb9da524d5b84f09b0c5853761aa5886 P 58a7cda73b3542718987bf815eed9b79 [CANDIDATE]: Term 1 election: Requested vote from peers 4bc679ad21a64bfe93bf64ff1b6ba3b2 (127.17.223.2:33075), 37897779fb894afb8129dcf5d269bd54 (127.17.223.3:42765)
I20260709 13:09:09.661542 30099 raft_consensus.cc:493] T f814d836f0bd46a4aa7d660d8ff4b2d5 P 58a7cda73b3542718987bf815eed9b79 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:09.661490 29953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e347ac4792b04c198fb6829a4a87078b" candidate_uuid: "37897779fb894afb8129dcf5d269bd54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4bc679ad21a64bfe93bf64ff1b6ba3b2"
I20260709 13:09:09.662355 30099 raft_consensus.cc:515] T f814d836f0bd46a4aa7d660d8ff4b2d5 P 58a7cda73b3542718987bf815eed9b79 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "58a7cda73b3542718987bf815eed9b79" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 37953 } } peers { permanent_uuid: "4bc679ad21a64bfe93bf64ff1b6ba3b2" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 33075 } } peers { permanent_uuid: "37897779fb894afb8129dcf5d269bd54" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 42765 } }
I20260709 13:09:09.663043 30068 raft_consensus.cc:359] T 6d4b64688b8949c89f8f7b7aa871efed P 37897779fb894afb8129dcf5d269bd54 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "58a7cda73b3542718987bf815eed9b79" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 37953 } } peers { permanent_uuid: "4bc679ad21a64bfe93bf64ff1b6ba3b2" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 33075 } } peers { permanent_uuid: "37897779fb894afb8129dcf5d269bd54" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 42765 } }
W20260709 13:09:09.663375 29991 leader_election.cc:343] T e347ac4792b04c198fb6829a4a87078b P 37897779fb894afb8129dcf5d269bd54 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 4bc679ad21a64bfe93bf64ff1b6ba3b2 (127.17.223.2:33075): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:09.663759 30068 raft_consensus.cc:385] T 6d4b64688b8949c89f8f7b7aa871efed P 37897779fb894afb8129dcf5d269bd54 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:09.664089 30068 raft_consensus.cc:740] T 6d4b64688b8949c89f8f7b7aa871efed P 37897779fb894afb8129dcf5d269bd54 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 37897779fb894afb8129dcf5d269bd54, State: Initialized, Role: FOLLOWER
I20260709 13:09:09.656522 30067 tablet_bootstrap.cc:492] T 968909b990764b0c8c388a63060c8130 P 58a7cda73b3542718987bf815eed9b79: No bootstrap required, opened a new log
I20260709 13:09:09.664780 30027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb9da524d5b84f09b0c5853761aa5886" candidate_uuid: "58a7cda73b3542718987bf815eed9b79" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "37897779fb894afb8129dcf5d269bd54"
I20260709 13:09:09.665182 30067 ts_tablet_manager.cc:1403] T 968909b990764b0c8c388a63060c8130 P 58a7cda73b3542718987bf815eed9b79: Time spent bootstrapping tablet: real 0.054s	user 0.013s	sys 0.008s
I20260709 13:09:09.657138 30076 raft_consensus.cc:515] T 6450825bf8ba4ebaa0e631b1dea6538e P 4bc679ad21a64bfe93bf64ff1b6ba3b2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "58a7cda73b3542718987bf815eed9b79" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 37953 } } peers { permanent_uuid: "4bc679ad21a64bfe93bf64ff1b6ba3b2" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 33075 } } peers { permanent_uuid: "37897779fb894afb8129dcf5d269bd54" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 42765 } }
I20260709 13:09:09.666146 30026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f814d836f0bd46a4aa7d660d8ff4b2d5" candidate_uuid: "58a7cda73b3542718987bf815eed9b79" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "37897779fb894afb8129dcf5d269bd54" is_pre_election: true
I20260709 13:09:09.668184 30067 raft_consensus.cc:359] T 968909b990764b0c8c388a63060c8130 P 58a7cda73b3542718987bf815eed9b79 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "58a7cda73b3542718987bf815eed9b79" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 37953 } } peers { permanent_uuid: "4bc679ad21a64bfe93bf64ff1b6ba3b2" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 33075 } } peers { permanent_uuid: "37897779fb894afb8129dcf5d269bd54" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 42765 } }
I20260709 13:09:09.669121 30025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6450825bf8ba4ebaa0e631b1dea6538e" candidate_uuid: "4bc679ad21a64bfe93bf64ff1b6ba3b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "37897779fb894afb8129dcf5d269bd54"
I20260709 13:09:09.664816 30068 consensus_queue.cc:260] T 6d4b64688b8949c89f8f7b7aa871efed P 37897779fb894afb8129dcf5d269bd54 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "58a7cda73b3542718987bf815eed9b79" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 37953 } } peers { permanent_uuid: "4bc679ad21a64bfe93bf64ff1b6ba3b2" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 33075 } } peers { permanent_uuid: "37897779fb894afb8129dcf5d269bd54" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 42765 } }
I20260709 13:09:09.669956 30025 raft_consensus.cc:3060] T 6450825bf8ba4ebaa0e631b1dea6538e P 37897779fb894afb8129dcf5d269bd54 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:09:09.670436 29841 leader_election.cc:343] T f814d836f0bd46a4aa7d660d8ff4b2d5 P 58a7cda73b3542718987bf815eed9b79 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 37897779fb894afb8129dcf5d269bd54 (127.17.223.3:42765): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:09.671171 30076 leader_election.cc:290] T 6450825bf8ba4ebaa0e631b1dea6538e P 4bc679ad21a64bfe93bf64ff1b6ba3b2 [CANDIDATE]: Term 1 election: Requested vote from peers 58a7cda73b3542718987bf815eed9b79 (127.17.223.1:37953), 37897779fb894afb8129dcf5d269bd54 (127.17.223.3:42765)
I20260709 13:09:09.671777 30068 ts_tablet_manager.cc:1434] T 6d4b64688b8949c89f8f7b7aa871efed P 37897779fb894afb8129dcf5d269bd54: Time spent starting tablet: real 0.011s	user 0.007s	sys 0.000s
I20260709 13:09:09.671777 30099 leader_election.cc:290] T f814d836f0bd46a4aa7d660d8ff4b2d5 P 58a7cda73b3542718987bf815eed9b79 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4bc679ad21a64bfe93bf64ff1b6ba3b2 (127.17.223.2:33075), 37897779fb894afb8129dcf5d269bd54 (127.17.223.3:42765)
I20260709 13:09:09.672837 30068 tablet_bootstrap.cc:492] T f814d836f0bd46a4aa7d660d8ff4b2d5 P 37897779fb894afb8129dcf5d269bd54: Bootstrap starting.
I20260709 13:09:09.669452 30067 raft_consensus.cc:385] T 968909b990764b0c8c388a63060c8130 P 58a7cda73b3542718987bf815eed9b79 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:09.674949 30067 raft_consensus.cc:740] T 968909b990764b0c8c388a63060c8130 P 58a7cda73b3542718987bf815eed9b79 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 58a7cda73b3542718987bf815eed9b79, State: Initialized, Role: FOLLOWER
I20260709 13:09:09.675923 30067 consensus_queue.cc:260] T 968909b990764b0c8c388a63060c8130 P 58a7cda73b3542718987bf815eed9b79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "58a7cda73b3542718987bf815eed9b79" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 37953 } } peers { permanent_uuid: "4bc679ad21a64bfe93bf64ff1b6ba3b2" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 33075 } } peers { permanent_uuid: "37897779fb894afb8129dcf5d269bd54" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 42765 } }
I20260709 13:09:09.677939 30067 ts_tablet_manager.cc:1434] T 968909b990764b0c8c388a63060c8130 P 58a7cda73b3542718987bf815eed9b79: Time spent starting tablet: real 0.012s	user 0.005s	sys 0.001s
I20260709 13:09:09.678323 30068 tablet_bootstrap.cc:654] T f814d836f0bd46a4aa7d660d8ff4b2d5 P 37897779fb894afb8129dcf5d269bd54: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:09.679157 30067 tablet_bootstrap.cc:492] T 59abb803b8ce4d28967bf12c46d66c0d P 58a7cda73b3542718987bf815eed9b79: Bootstrap starting.
I20260709 13:09:09.665602 30027 raft_consensus.cc:3060] T bb9da524d5b84f09b0c5853761aa5886 P 37897779fb894afb8129dcf5d269bd54 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:09.682331 30025 raft_consensus.cc:2468] T 6450825bf8ba4ebaa0e631b1dea6538e P 37897779fb894afb8129dcf5d269bd54 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4bc679ad21a64bfe93bf64ff1b6ba3b2 in term 1.
I20260709 13:09:09.684229 29916 leader_election.cc:304] T 6450825bf8ba4ebaa0e631b1dea6538e P 4bc679ad21a64bfe93bf64ff1b6ba3b2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 37897779fb894afb8129dcf5d269bd54, 4bc679ad21a64bfe93bf64ff1b6ba3b2; no voters: 
I20260709 13:09:09.686137 30076 raft_consensus.cc:2804] T 6450825bf8ba4ebaa0e631b1dea6538e P 4bc679ad21a64bfe93bf64ff1b6ba3b2 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:09.686780 30076 raft_consensus.cc:697] T 6450825bf8ba4ebaa0e631b1dea6538e P 4bc679ad21a64bfe93bf64ff1b6ba3b2 [term 1 LEADER]: Becoming Leader. State: Replica: 4bc679ad21a64bfe93bf64ff1b6ba3b2, State: Running, Role: LEADER
I20260709 13:09:09.687688 30076 consensus_queue.cc:237] T 6450825bf8ba4ebaa0e631b1dea6538e P 4bc679ad21a64bfe93bf64ff1b6ba3b2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "58a7cda73b3542718987bf815eed9b79" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 37953 } } peers { permanent_uuid: "4bc679ad21a64bfe93bf64ff1b6ba3b2" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 33075 } } peers { permanent_uuid: "37897779fb894afb8129dcf5d269bd54" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 42765 } }
I20260709 13:09:09.666880 30075 leader_election.cc:290] T e347ac4792b04c198fb6829a4a87078b P 37897779fb894afb8129dcf5d269bd54 [CANDIDATE]: Term 1 election: Requested vote from peers 58a7cda73b3542718987bf815eed9b79 (127.17.223.1:37953), 4bc679ad21a64bfe93bf64ff1b6ba3b2 (127.17.223.2:33075)
I20260709 13:09:09.694334 29876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6450825bf8ba4ebaa0e631b1dea6538e" candidate_uuid: "4bc679ad21a64bfe93bf64ff1b6ba3b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "58a7cda73b3542718987bf815eed9b79"
I20260709 13:09:09.696708 30067 tablet_bootstrap.cc:654] T 59abb803b8ce4d28967bf12c46d66c0d P 58a7cda73b3542718987bf815eed9b79: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:09.699091 29952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f814d836f0bd46a4aa7d660d8ff4b2d5" candidate_uuid: "58a7cda73b3542718987bf815eed9b79" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4bc679ad21a64bfe93bf64ff1b6ba3b2" is_pre_election: true
I20260709 13:09:09.696768 30027 raft_consensus.cc:2468] T bb9da524d5b84f09b0c5853761aa5886 P 37897779fb894afb8129dcf5d269bd54 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 58a7cda73b3542718987bf815eed9b79 in term 1.
I20260709 13:09:09.701809 29841 leader_election.cc:304] T bb9da524d5b84f09b0c5853761aa5886 P 58a7cda73b3542718987bf815eed9b79 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 37897779fb894afb8129dcf5d269bd54, 58a7cda73b3542718987bf815eed9b79; no voters: 
I20260709 13:09:09.698591 29953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb9da524d5b84f09b0c5853761aa5886" candidate_uuid: "58a7cda73b3542718987bf815eed9b79" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4bc679ad21a64bfe93bf64ff1b6ba3b2"
I20260709 13:09:09.700359 29952 raft_consensus.cc:2468] T f814d836f0bd46a4aa7d660d8ff4b2d5 P 4bc679ad21a64bfe93bf64ff1b6ba3b2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 58a7cda73b3542718987bf815eed9b79 in term 0.
I20260709 13:09:09.702589 29953 raft_consensus.cc:3060] T bb9da524d5b84f09b0c5853761aa5886 P 4bc679ad21a64bfe93bf64ff1b6ba3b2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:09.703485 30108 raft_consensus.cc:2804] T bb9da524d5b84f09b0c5853761aa5886 P 58a7cda73b3542718987bf815eed9b79 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:09.704458 30108 raft_consensus.cc:697] T bb9da524d5b84f09b0c5853761aa5886 P 58a7cda73b3542718987bf815eed9b79 [term 1 LEADER]: Becoming Leader. State: Replica: 58a7cda73b3542718987bf815eed9b79, State: Running, Role: LEADER
I20260709 13:09:09.694610 29877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6450825bf8ba4ebaa0e631b1dea6538e" candidate_uuid: "4bc679ad21a64bfe93bf64ff1b6ba3b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "58a7cda73b3542718987bf815eed9b79" is_pre_election: true
I20260709 13:09:09.710975 29953 raft_consensus.cc:2468] T bb9da524d5b84f09b0c5853761aa5886 P 4bc679ad21a64bfe93bf64ff1b6ba3b2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 58a7cda73b3542718987bf815eed9b79 in term 1.
I20260709 13:09:09.696807 29993 leader_election.cc:304] T e347ac4792b04c198fb6829a4a87078b P 37897779fb894afb8129dcf5d269bd54 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 37897779fb894afb8129dcf5d269bd54, 58a7cda73b3542718987bf815eed9b79; no voters: 4bc679ad21a64bfe93bf64ff1b6ba3b2
I20260709 13:09:09.705639 30108 consensus_queue.cc:237] T bb9da524d5b84f09b0c5853761aa5886 P 58a7cda73b3542718987bf815eed9b79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "58a7cda73b3542718987bf815eed9b79" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 37953 } } peers { permanent_uuid: "4bc679ad21a64bfe93bf64ff1b6ba3b2" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 33075 } } peers { permanent_uuid: "37897779fb894afb8129dcf5d269bd54" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 42765 } }
I20260709 13:09:09.705936 30069 ts_tablet_manager.cc:1434] T 6450825bf8ba4ebaa0e631b1dea6538e P 4bc679ad21a64bfe93bf64ff1b6ba3b2: Time spent starting tablet: real 0.144s	user 0.021s	sys 0.033s
I20260709 13:09:09.713212 30099 raft_consensus.cc:493] T 968909b990764b0c8c388a63060c8130 P 58a7cda73b3542718987bf815eed9b79 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:09.715363 30075 raft_consensus.cc:2804] T e347ac4792b04c198fb6829a4a87078b P 37897779fb894afb8129dcf5d269bd54 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:09.716253 30075 raft_consensus.cc:697] T e347ac4792b04c198fb6829a4a87078b P 37897779fb894afb8129dcf5d269bd54 [term 1 LEADER]: Becoming Leader. State: Replica: 37897779fb894afb8129dcf5d269bd54, State: Running, Role: LEADER
I20260709 13:09:09.715672 30099 raft_consensus.cc:515] T 968909b990764b0c8c388a63060c8130 P 58a7cda73b3542718987bf815eed9b79 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "58a7cda73b3542718987bf815eed9b79" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 37953 } } peers { permanent_uuid: "4bc679ad21a64bfe93bf64ff1b6ba3b2" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 33075 } } peers { permanent_uuid: "37897779fb894afb8129dcf5d269bd54" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 42765 } }
I20260709 13:09:09.717451 30075 consensus_queue.cc:237] T e347ac4792b04c198fb6829a4a87078b P 37897779fb894afb8129dcf5d269bd54 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "58a7cda73b3542718987bf815eed9b79" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 37953 } } peers { permanent_uuid: "4bc679ad21a64bfe93bf64ff1b6ba3b2" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 33075 } } peers { permanent_uuid: "37897779fb894afb8129dcf5d269bd54" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 42765 } }
I20260709 13:09:09.654245 30073 raft_consensus.cc:515] T 6450825bf8ba4ebaa0e631b1dea6538e P 58a7cda73b3542718987bf815eed9b79 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "58a7cda73b3542718987bf815eed9b79" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 37953 } } peers { permanent_uuid: "4bc679ad21a64bfe93bf64ff1b6ba3b2" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 33075 } } peers { permanent_uuid: "37897779fb894afb8129dcf5d269bd54" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 42765 } }
I20260709 13:09:09.720902 29842 leader_election.cc:304] T f814d836f0bd46a4aa7d660d8ff4b2d5 P 58a7cda73b3542718987bf815eed9b79 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4bc679ad21a64bfe93bf64ff1b6ba3b2, 58a7cda73b3542718987bf815eed9b79; no voters: 37897779fb894afb8129dcf5d269bd54
I20260709 13:09:09.722812 30027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "968909b990764b0c8c388a63060c8130" candidate_uuid: "58a7cda73b3542718987bf815eed9b79" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "37897779fb894afb8129dcf5d269bd54" is_pre_election: true
I20260709 13:09:09.723577 30027 raft_consensus.cc:2468] T 968909b990764b0c8c388a63060c8130 P 37897779fb894afb8129dcf5d269bd54 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 58a7cda73b3542718987bf815eed9b79 in term 0.
I20260709 13:09:09.724740 29841 leader_election.cc:304] T 968909b990764b0c8c388a63060c8130 P 58a7cda73b3542718987bf815eed9b79 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 37897779fb894afb8129dcf5d269bd54, 58a7cda73b3542718987bf815eed9b79; no voters: 
I20260709 13:09:09.722190 30069 tablet_bootstrap.cc:492] T e347ac4792b04c198fb6829a4a87078b P 4bc679ad21a64bfe93bf64ff1b6ba3b2: Bootstrap starting.
I20260709 13:09:09.728818 29876 raft_consensus.cc:2393] T 6450825bf8ba4ebaa0e631b1dea6538e P 58a7cda73b3542718987bf815eed9b79 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 4bc679ad21a64bfe93bf64ff1b6ba3b2 in current term 1: Already voted for candidate 58a7cda73b3542718987bf815eed9b79 in this term.
I20260709 13:09:09.731065 30068 tablet_bootstrap.cc:492] T f814d836f0bd46a4aa7d660d8ff4b2d5 P 37897779fb894afb8129dcf5d269bd54: No bootstrap required, opened a new log
I20260709 13:09:09.731828 30068 ts_tablet_manager.cc:1403] T f814d836f0bd46a4aa7d660d8ff4b2d5 P 37897779fb894afb8129dcf5d269bd54: Time spent bootstrapping tablet: real 0.059s	user 0.009s	sys 0.007s
I20260709 13:09:09.720779 30099 leader_election.cc:290] T 968909b990764b0c8c388a63060c8130 P 58a7cda73b3542718987bf815eed9b79 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4bc679ad21a64bfe93bf64ff1b6ba3b2 (127.17.223.2:33075), 37897779fb894afb8129dcf5d269bd54 (127.17.223.3:42765)
I20260709 13:09:09.735126 30099 raft_consensus.cc:2804] T f814d836f0bd46a4aa7d660d8ff4b2d5 P 58a7cda73b3542718987bf815eed9b79 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:09.735697 30099 raft_consensus.cc:493] T f814d836f0bd46a4aa7d660d8ff4b2d5 P 58a7cda73b3542718987bf815eed9b79 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:09.736161 30099 raft_consensus.cc:3060] T f814d836f0bd46a4aa7d660d8ff4b2d5 P 58a7cda73b3542718987bf815eed9b79 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:09.734884 29776 catalog_manager.cc:5697] T 6450825bf8ba4ebaa0e631b1dea6538e P 4bc679ad21a64bfe93bf64ff1b6ba3b2 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4bc679ad21a64bfe93bf64ff1b6ba3b2 (127.17.223.2). New cstate: current_term: 1 leader_uuid: "4bc679ad21a64bfe93bf64ff1b6ba3b2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "58a7cda73b3542718987bf815eed9b79" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 37953 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4bc679ad21a64bfe93bf64ff1b6ba3b2" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 33075 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "37897779fb894afb8129dcf5d269bd54" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 42765 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:09.744611 30073 leader_election.cc:290] T 6450825bf8ba4ebaa0e631b1dea6538e P 58a7cda73b3542718987bf815eed9b79 [CANDIDATE]: Term 1 election: Requested vote from peers 4bc679ad21a64bfe93bf64ff1b6ba3b2 (127.17.223.2:33075), 37897779fb894afb8129dcf5d269bd54 (127.17.223.3:42765)
I20260709 13:09:09.745594 30073 raft_consensus.cc:2804] T 968909b990764b0c8c388a63060c8130 P 58a7cda73b3542718987bf815eed9b79 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:09.745774 30069 tablet_bootstrap.cc:654] T e347ac4792b04c198fb6829a4a87078b P 4bc679ad21a64bfe93bf64ff1b6ba3b2: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:09.746114 30073 raft_consensus.cc:493] T 968909b990764b0c8c388a63060c8130 P 58a7cda73b3542718987bf815eed9b79 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:09.751045 29953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "968909b990764b0c8c388a63060c8130" candidate_uuid: "58a7cda73b3542718987bf815eed9b79" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4bc679ad21a64bfe93bf64ff1b6ba3b2" is_pre_election: true
I20260709 13:09:09.756194 30068 raft_consensus.cc:359] T f814d836f0bd46a4aa7d660d8ff4b2d5 P 37897779fb894afb8129dcf5d269bd54 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "58a7cda73b3542718987bf815eed9b79" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 37953 } } peers { permanent_uuid: "4bc679ad21a64bfe93bf64ff1b6ba3b2" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 33075 } } peers { permanent_uuid: "37897779fb894afb8129dcf5d269bd54" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 42765 } }
I20260709 13:09:09.758565 30076 raft_consensus.cc:493] T 6d4b64688b8949c89f8f7b7aa871efed P 4bc679ad21a64bfe93bf64ff1b6ba3b2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:09.759523 30068 raft_consensus.cc:385] T f814d836f0bd46a4aa7d660d8ff4b2d5 P 37897779fb894afb8129dcf5d269bd54 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:09.759987 30068 raft_consensus.cc:740] T f814d836f0bd46a4aa7d660d8ff4b2d5 P 37897779fb894afb8129dcf5d269bd54 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 37897779fb894afb8129dcf5d269bd54, State: Initialized, Role: FOLLOWER
I20260709 13:09:09.759799 30076 raft_consensus.cc:515] T 6d4b64688b8949c89f8f7b7aa871efed P 4bc679ad21a64bfe93bf64ff1b6ba3b2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "58a7cda73b3542718987bf815eed9b79" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 37953 } } peers { permanent_uuid: "4bc679ad21a64bfe93bf64ff1b6ba3b2" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 33075 } } peers { permanent_uuid: "37897779fb894afb8129dcf5d269bd54" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 42765 } }
I20260709 13:09:09.761298 30068 consensus_queue.cc:260] T f814d836f0bd46a4aa7d660d8ff4b2d5 P 37897779fb894afb8129dcf5d269bd54 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "58a7cda73b3542718987bf815eed9b79" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 37953 } } peers { permanent_uuid: "4bc679ad21a64bfe93bf64ff1b6ba3b2" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 33075 } } peers { permanent_uuid: "37897779fb894afb8129dcf5d269bd54" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 42765 } }
I20260709 13:09:09.746661 30073 raft_consensus.cc:3060] T 968909b990764b0c8c388a63060c8130 P 58a7cda73b3542718987bf815eed9b79 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:09.751681 29952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6450825bf8ba4ebaa0e631b1dea6538e" candidate_uuid: "58a7cda73b3542718987bf815eed9b79" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4bc679ad21a64bfe93bf64ff1b6ba3b2"
I20260709 13:09:09.766490 29876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d4b64688b8949c89f8f7b7aa871efed" candidate_uuid: "4bc679ad21a64bfe93bf64ff1b6ba3b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "58a7cda73b3542718987bf815eed9b79" is_pre_election: true
I20260709 13:09:09.767369 29876 raft_consensus.cc:2468] T 6d4b64688b8949c89f8f7b7aa871efed P 58a7cda73b3542718987bf815eed9b79 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4bc679ad21a64bfe93bf64ff1b6ba3b2 in term 0.
I20260709 13:09:09.770483 29919 leader_election.cc:304] T 6d4b64688b8949c89f8f7b7aa871efed P 4bc679ad21a64bfe93bf64ff1b6ba3b2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4bc679ad21a64bfe93bf64ff1b6ba3b2, 58a7cda73b3542718987bf815eed9b79; no voters: 
I20260709 13:09:09.770684 30027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d4b64688b8949c89f8f7b7aa871efed" candidate_uuid: "4bc679ad21a64bfe93bf64ff1b6ba3b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "37897779fb894afb8129dcf5d269bd54" is_pre_election: true
I20260709 13:09:09.771937 30103 raft_consensus.cc:2804] T 6d4b64688b8949c89f8f7b7aa871efed P 4bc679ad21a64bfe93bf64ff1b6ba3b2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:09.772464 30103 raft_consensus.cc:493] T 6d4b64688b8949c89f8f7b7aa871efed P 4bc679ad21a64bfe93bf64ff1b6ba3b2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:09.772912 30103 raft_consensus.cc:3060] T 6d4b64688b8949c89f8f7b7aa871efed P 4bc679ad21a64bfe93bf64ff1b6ba3b2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:09.769270 30076 leader_election.cc:290] T 6d4b64688b8949c89f8f7b7aa871efed P 4bc679ad21a64bfe93bf64ff1b6ba3b2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 58a7cda73b3542718987bf815eed9b79 (127.17.223.1:37953), 37897779fb894afb8129dcf5d269bd54 (127.17.223.3:42765)
W20260709 13:09:09.777014 29841 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.3:42765, user_credentials={real_user=slave}} blocked reactor thread for 52354.8us
W20260709 13:09:09.777619 29842 leader_election.cc:343] T 968909b990764b0c8c388a63060c8130 P 58a7cda73b3542718987bf815eed9b79 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4bc679ad21a64bfe93bf64ff1b6ba3b2 (127.17.223.2:33075): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:09.778844 30027 raft_consensus.cc:2468] T 6d4b64688b8949c89f8f7b7aa871efed P 37897779fb894afb8129dcf5d269bd54 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4bc679ad21a64bfe93bf64ff1b6ba3b2 in term 0.
I20260709 13:09:09.778990 30025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6450825bf8ba4ebaa0e631b1dea6538e" candidate_uuid: "58a7cda73b3542718987bf815eed9b79" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "37897779fb894afb8129dcf5d269bd54"
I20260709 13:09:09.779770 30025 raft_consensus.cc:2393] T 6450825bf8ba4ebaa0e631b1dea6538e P 37897779fb894afb8129dcf5d269bd54 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 58a7cda73b3542718987bf815eed9b79 in current term 1: Already voted for candidate 4bc679ad21a64bfe93bf64ff1b6ba3b2 in this term.
I20260709 13:09:09.781107 29841 leader_election.cc:304] T 6450825bf8ba4ebaa0e631b1dea6538e P 58a7cda73b3542718987bf815eed9b79 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 58a7cda73b3542718987bf815eed9b79; no voters: 37897779fb894afb8129dcf5d269bd54, 4bc679ad21a64bfe93bf64ff1b6ba3b2
I20260709 13:09:09.782410 30112 raft_consensus.cc:2749] T 6450825bf8ba4ebaa0e631b1dea6538e P 58a7cda73b3542718987bf815eed9b79 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:09:09.783566 30067 tablet_bootstrap.cc:492] T 59abb803b8ce4d28967bf12c46d66c0d P 58a7cda73b3542718987bf815eed9b79: No bootstrap required, opened a new log
I20260709 13:09:09.783668 30103 raft_consensus.cc:515] T 6d4b64688b8949c89f8f7b7aa871efed P 4bc679ad21a64bfe93bf64ff1b6ba3b2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "58a7cda73b3542718987bf815eed9b79" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 37953 } } peers { permanent_uuid: "4bc679ad21a64bfe93bf64ff1b6ba3b2" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 33075 } } peers { permanent_uuid: "37897779fb894afb8129dcf5d269bd54" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 42765 } }
I20260709 13:09:09.784879 30067 ts_tablet_manager.cc:1403] T 59abb803b8ce4d28967bf12c46d66c0d P 58a7cda73b3542718987bf815eed9b79: Time spent bootstrapping tablet: real 0.106s	user 0.010s	sys 0.004s
I20260709 13:09:09.785787 30068 ts_tablet_manager.cc:1434] T f814d836f0bd46a4aa7d660d8ff4b2d5 P 37897779fb894afb8129dcf5d269bd54: Time spent starting tablet: real 0.054s	user 0.009s	sys 0.000s
I20260709 13:09:09.786782 30076 raft_consensus.cc:493] T 5ab64e7b83584196b9e6c6d1bc634351 P 4bc679ad21a64bfe93bf64ff1b6ba3b2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:09.787410 29876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d4b64688b8949c89f8f7b7aa871efed" candidate_uuid: "4bc679ad21a64bfe93bf64ff1b6ba3b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "58a7cda73b3542718987bf815eed9b79"
I20260709 13:09:09.787362 30076 raft_consensus.cc:515] T 5ab64e7b83584196b9e6c6d1bc634351 P 4bc679ad21a64bfe93bf64ff1b6ba3b2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "58a7cda73b3542718987bf815eed9b79" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 37953 } } peers { permanent_uuid: "4bc679ad21a64bfe93bf64ff1b6ba3b2" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 33075 } } peers { permanent_uuid: "37897779fb894afb8129dcf5d269bd54" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 42765 } }
I20260709 13:09:09.788057 29876 raft_consensus.cc:3060] T 6d4b64688b8949c89f8f7b7aa871efed P 58a7cda73b3542718987bf815eed9b79 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:09.789160 30099 raft_consensus.cc:515] T f814d836f0bd46a4aa7d660d8ff4b2d5 P 58a7cda73b3542718987bf815eed9b79 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "58a7cda73b3542718987bf815eed9b79" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 37953 } } peers { permanent_uuid: "4bc679ad21a64bfe93bf64ff1b6ba3b2" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 33075 } } peers { permanent_uuid: "37897779fb894afb8129dcf5d269bd54" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 42765 } }
I20260709 13:09:09.791078 29877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ab64e7b83584196b9e6c6d1bc634351" candidate_uuid: "4bc679ad21a64bfe93bf64ff1b6ba3b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "58a7cda73b3542718987bf815eed9b79" is_pre_election: true
I20260709 13:09:09.791764 29877 raft_consensus.cc:2468] T 5ab64e7b83584196b9e6c6d1bc634351 P 58a7cda73b3542718987bf815eed9b79 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4bc679ad21a64bfe93bf64ff1b6ba3b2 in term 0.
I20260709 13:09:09.793064 29919 leader_election.cc:304] T 5ab64e7b83584196b9e6c6d1bc634351 P 4bc679ad21a64bfe93bf64ff1b6ba3b2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4bc679ad21a64bfe93bf64ff1b6ba3b2, 58a7cda73b3542718987bf815eed9b79; no voters: 
I20260709 13:09:09.793164 30025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ab64e7b83584196b9e6c6d1bc634351" candidate_uuid: "4bc679ad21a64bfe93bf64ff1b6ba3b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "37897779fb894afb8129dcf5d269bd54" is_pre_election: true
I20260709 13:09:09.794231 30025 raft_consensus.cc:2468] T 5ab64e7b83584196b9e6c6d1bc634351 P 37897779fb894afb8129dcf5d269bd54 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4bc679ad21a64bfe93bf64ff1b6ba3b2 in term 0.
I20260709 13:09:09.796667 30076 leader_election.cc:290] T 5ab64e7b83584196b9e6c6d1bc634351 P 4bc679ad21a64bfe93bf64ff1b6ba3b2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 58a7cda73b3542718987bf815eed9b79 (127.17.223.1:37953), 37897779fb894afb8129dcf5d269bd54 (127.17.223.3:42765)
I20260709 13:09:09.797055 29876 raft_consensus.cc:2468] T 6d4b64688b8949c89f8f7b7aa871efed P 58a7cda73b3542718987bf815eed9b79 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4bc679ad21a64bfe93bf64ff1b6ba3b2 in term 1.
I20260709 13:09:09.797736 30076 raft_consensus.cc:2804] T 5ab64e7b83584196b9e6c6d1bc634351 P 4bc679ad21a64bfe93bf64ff1b6ba3b2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:09.798247 30076 raft_consensus.cc:493] T 5ab64e7b83584196b9e6c6d1bc634351 P 4bc679ad21a64bfe93bf64ff1b6ba3b2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:09.798727 30076 raft_consensus.cc:3060] T 5ab64e7b83584196b9e6c6d1bc634351 P 4bc679ad21a64bfe93bf64ff1b6ba3b2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:09.800251 30025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d4b64688b8949c89f8f7b7aa871efed" candidate_uuid: "4bc679ad21a64bfe93bf64ff1b6ba3b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "37897779fb894afb8129dcf5d269bd54"
I20260709 13:09:09.801017 30025 raft_consensus.cc:3060] T 6d4b64688b8949c89f8f7b7aa871efed P 37897779fb894afb8129dcf5d269bd54 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:09.808027 30069 tablet_bootstrap.cc:492] T e347ac4792b04c198fb6829a4a87078b P 4bc679ad21a64bfe93bf64ff1b6ba3b2: No bootstrap required, opened a new log
I20260709 13:09:09.807471 29776 catalog_manager.cc:5697] T e347ac4792b04c198fb6829a4a87078b P 37897779fb894afb8129dcf5d269bd54 reported cstate change: term changed from 0 to 1, leader changed from <none> to 37897779fb894afb8129dcf5d269bd54 (127.17.223.3). New cstate: current_term: 1 leader_uuid: "37897779fb894afb8129dcf5d269bd54" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "58a7cda73b3542718987bf815eed9b79" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 37953 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4bc679ad21a64bfe93bf64ff1b6ba3b2" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 33075 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "37897779fb894afb8129dcf5d269bd54" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 42765 } health_report { overall_health: HEALTHY } } }
I20260709 13:09:09.809556 30027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f814d836f0bd46a4aa7d660d8ff4b2d5" candidate_uuid: "58a7cda73b3542718987bf815eed9b79" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "37897779fb894afb8129dcf5d269bd54"
I20260709 13:09:09.810134 30067 raft_consensus.cc:359] T 59abb803b8ce4d28967bf12c46d66c0d P 58a7cda73b3542718987bf815eed9b79 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "58a7cda73b3542718987bf815eed9b79" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 37953 } } peers { permanent_uuid: "4bc679ad21a64bfe93bf64ff1b6ba3b2" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 33075 } } peers { permanent_uuid: "37897779fb894afb8129dcf5d269bd54" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 42765 } }
I20260709 13:09:09.808790 30069 ts_tablet_manager.cc:1403] T e347ac4792b04c198fb6829a4a87078b P 4bc679ad21a64bfe93bf64ff1b6ba3b2: Time spent bootstrapping tablet: real 0.087s	user 0.005s	sys 0.015s
I20260709 13:09:09.810444 30103 leader_election.cc:290] T 6d4b64688b8949c89f8f7b7aa871efed P 4bc679ad21a64bfe93bf64ff1b6ba3b2 [CANDIDATE]: Term 1 election: Requested vote from peers 58a7cda73b3542718987bf815eed9b79 (127.17.223.1:37953), 37897779fb894afb8129dcf5d269bd54 (127.17.223.3:42765)
I20260709 13:09:09.810350 30027 raft_consensus.cc:3060] T f814d836f0bd46a4aa7d660d8ff4b2d5 P 37897779fb894afb8129dcf5d269bd54 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:09.808920 30025 raft_consensus.cc:2468] T 6d4b64688b8949c89f8f7b7aa871efed P 37897779fb894afb8129dcf5d269bd54 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4bc679ad21a64bfe93bf64ff1b6ba3b2 in term 1.
I20260709 13:09:09.811838 30067 raft_consensus.cc:385] T 59abb803b8ce4d28967bf12c46d66c0d P 58a7cda73b3542718987bf815eed9b79 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:09.810252 30099 leader_election.cc:290] T f814d836f0bd46a4aa7d660d8ff4b2d5 P 58a7cda73b3542718987bf815eed9b79 [CANDIDATE]: Term 1 election: Requested vote from peers 4bc679ad21a64bfe93bf64ff1b6ba3b2 (127.17.223.2:33075), 37897779fb894afb8129dcf5d269bd54 (127.17.223.3:42765)
I20260709 13:09:09.813134 30073 raft_consensus.cc:515] T 968909b990764b0c8c388a63060c8130 P 58a7cda73b3542718987bf815eed9b79 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "58a7cda73b3542718987bf815eed9b79" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 37953 } } peers { permanent_uuid: "4bc679ad21a64bfe93bf64ff1b6ba3b2" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 33075 } } peers { permanent_uuid: "37897779fb894afb8129dcf5d269bd54" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 42765 } }
I20260709 13:09:09.812263 30067 raft_consensus.cc:740] T 59abb803b8ce4d28967bf12c46d66c0d P 58a7cda73b3542718987bf815eed9b79 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 58a7cda73b3542718987bf815eed9b79, State: Initialized, Role: FOLLOWER
I20260709 13:09:09.812285 29919 leader_election.cc:304] T 6d4b64688b8949c89f8f7b7aa871efed P 4bc679ad21a64bfe93bf64ff1b6ba3b2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4bc679ad21a64bfe93bf64ff1b6ba3b2, 58a7cda73b3542718987bf815eed9b79; no voters: 
I20260709 13:09:09.810262 29953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f814d836f0bd46a4aa7d660d8ff4b2d5" candidate_uuid: "58a7cda73b3542718987bf815eed9b79" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4bc679ad21a64bfe93bf64ff1b6ba3b2"
I20260709 13:09:09.814873 29953 raft_consensus.cc:3060] T f814d836f0bd46a4aa7d660d8ff4b2d5 P 4bc679ad21a64bfe93bf64ff1b6ba3b2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:09.816422 30073 leader_election.cc:290] T 968909b990764b0c8c388a63060c8130 P 58a7cda73b3542718987bf815eed9b79 [CANDIDATE]: Term 1 election: Requested vote from peers 4bc679ad21a64bfe93bf64ff1b6ba3b2 (127.17.223.2:33075), 37897779fb894afb8129dcf5d269bd54 (127.17.223.3:42765)
I20260709 13:09:09.816293 30069 raft_consensus.cc:359] T e347ac4792b04c198fb6829a4a87078b P 4bc679ad21a64bfe93bf64ff1b6ba3b2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "58a7cda73b3542718987bf815eed9b79" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 37953 } } peers { permanent_uuid: "4bc679ad21a64bfe93bf64ff1b6ba3b2" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 33075 } } peers { permanent_uuid: "37897779fb894afb8129dcf5d269bd54" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 42765 } }
I20260709 13:09:09.817291 30069 raft_consensus.cc:385] T e347ac4792b04c198fb6829a4a87078b P 4bc679ad21a64bfe93bf64ff1b6ba3b2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:09.815110 30067 consensus_queue.cc:260] T 59abb803b8ce4d28967bf12c46d66c0d P 58a7cda73b3542718987bf815eed9b79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "58a7cda73b3542718987bf815eed9b79" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 37953 } } peers { permanent_uuid: "4bc679ad21a64bfe93bf64ff1b6ba3b2" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 33075 } } peers { permanent_uuid: "37897779fb894afb8129dcf5d269bd54" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 42765 } }
I20260709 13:09:09.817649 30069 raft_consensus.cc:740] T e347ac4792b04c198fb6829a4a87078b P 4bc679ad21a64bfe93bf64ff1b6ba3b2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4bc679ad21a64bfe93bf64ff1b6ba3b2, State: Initialized, Role: FOLLOWER
I20260709 13:09:09.819382 30067 ts_tablet_manager.cc:1434] T 59abb803b8ce4d28967bf12c46d66c0d P 58a7cda73b3542718987bf815eed9b79: Time spent starting tablet: real 0.034s	user 0.007s	sys 0.000s
I20260709 13:09:09.819682 30117 raft_consensus.cc:2804] T 6d4b64688b8949c89f8f7b7aa871efed P 4bc679ad21a64bfe93bf64ff1b6ba3b2 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:09.820310 30117 raft_consensus.cc:697] T 6d4b64688b8949c89f8f7b7aa871efed P 4bc679ad21a64bfe93bf64ff1b6ba3b2 [term 1 LEADER]: Becoming Leader. State: Replica: 4bc679ad21a64bfe93bf64ff1b6ba3b2, State: Running, Role: LEADER
I20260709 13:09:09.820338 29952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "968909b990764b0c8c388a63060c8130" candidate_uuid: "58a7cda73b3542718987bf815eed9b79" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4bc679ad21a64bfe93bf64ff1b6ba3b2"
I20260709 13:09:09.820475 30025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "968909b990764b0c8c388a63060c8130" candidate_uuid: "58a7cda73b3542718987bf815eed9b79" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "37897779fb894afb8129dcf5d269bd54"
I20260709 13:09:09.822139 30025 raft_consensus.cc:3060] T 968909b990764b0c8c388a63060c8130 P 37897779fb894afb8129dcf5d269bd54 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:09:09.822151 29842 leader_election.cc:343] T 968909b990764b0c8c388a63060c8130 P 58a7cda73b3542718987bf815eed9b79 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 4bc679ad21a64bfe93bf64ff1b6ba3b2 (127.17.223.2:33075): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:09.824002 29775 catalog_manager.cc:5697] T bb9da524d5b84f09b0c5853761aa5886 P 58a7cda73b3542718987bf815eed9b79 reported cstate change: term changed from 0 to 1, leader changed from <none> to 58a7cda73b3542718987bf815eed9b79 (127.17.223.1). New cstate: current_term: 1 leader_uuid: "58a7cda73b3542718987bf815eed9b79" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "58a7cda73b3542718987bf815eed9b79" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 37953 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4bc679ad21a64bfe93bf64ff1b6ba3b2" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 33075 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "37897779fb894afb8129dcf5d269bd54" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 42765 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:09.826575 30076 raft_consensus.cc:515] T 5ab64e7b83584196b9e6c6d1bc634351 P 4bc679ad21a64bfe93bf64ff1b6ba3b2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "58a7cda73b3542718987bf815eed9b79" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 37953 } } peers { permanent_uuid: "4bc679ad21a64bfe93bf64ff1b6ba3b2" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 33075 } } peers { permanent_uuid: "37897779fb894afb8129dcf5d269bd54" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 42765 } }
I20260709 13:09:09.827217 30069 consensus_queue.cc:260] T e347ac4792b04c198fb6829a4a87078b P 4bc679ad21a64bfe93bf64ff1b6ba3b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "58a7cda73b3542718987bf815eed9b79" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 37953 } } peers { permanent_uuid: "4bc679ad21a64bfe93bf64ff1b6ba3b2" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 33075 } } peers { permanent_uuid: "37897779fb894afb8129dcf5d269bd54" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 42765 } }
I20260709 13:09:09.830175 30076 leader_election.cc:290] T 5ab64e7b83584196b9e6c6d1bc634351 P 4bc679ad21a64bfe93bf64ff1b6ba3b2 [CANDIDATE]: Term 1 election: Requested vote from peers 58a7cda73b3542718987bf815eed9b79 (127.17.223.1:37953), 37897779fb894afb8129dcf5d269bd54 (127.17.223.3:42765)
I20260709 13:09:09.830360 29876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ab64e7b83584196b9e6c6d1bc634351" candidate_uuid: "4bc679ad21a64bfe93bf64ff1b6ba3b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "58a7cda73b3542718987bf815eed9b79"
I20260709 13:09:09.831099 29876 raft_consensus.cc:3060] T 5ab64e7b83584196b9e6c6d1bc634351 P 58a7cda73b3542718987bf815eed9b79 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:09.821470 30117 consensus_queue.cc:237] T 6d4b64688b8949c89f8f7b7aa871efed P 4bc679ad21a64bfe93bf64ff1b6ba3b2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "58a7cda73b3542718987bf815eed9b79" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 37953 } } peers { permanent_uuid: "4bc679ad21a64bfe93bf64ff1b6ba3b2" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 33075 } } peers { permanent_uuid: "37897779fb894afb8129dcf5d269bd54" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 42765 } }
I20260709 13:09:09.835119 30069 ts_tablet_manager.cc:1434] T e347ac4792b04c198fb6829a4a87078b P 4bc679ad21a64bfe93bf64ff1b6ba3b2: Time spent starting tablet: real 0.022s	user 0.002s	sys 0.006s
I20260709 13:09:09.836395 30069 tablet_bootstrap.cc:492] T 968909b990764b0c8c388a63060c8130 P 4bc679ad21a64bfe93bf64ff1b6ba3b2: Bootstrap starting.
I20260709 13:09:09.836899 30027 raft_consensus.cc:2468] T f814d836f0bd46a4aa7d660d8ff4b2d5 P 37897779fb894afb8129dcf5d269bd54 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 58a7cda73b3542718987bf815eed9b79 in term 1.
I20260709 13:09:09.838320 29841 leader_election.cc:304] T f814d836f0bd46a4aa7d660d8ff4b2d5 P 58a7cda73b3542718987bf815eed9b79 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 37897779fb894afb8129dcf5d269bd54, 58a7cda73b3542718987bf815eed9b79; no voters: 
I20260709 13:09:09.839241 30073 raft_consensus.cc:2804] T f814d836f0bd46a4aa7d660d8ff4b2d5 P 58a7cda73b3542718987bf815eed9b79 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:09.828953 30025 raft_consensus.cc:2468] T 968909b990764b0c8c388a63060c8130 P 37897779fb894afb8129dcf5d269bd54 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 58a7cda73b3542718987bf815eed9b79 in term 1.
I20260709 13:09:09.840173 30073 raft_consensus.cc:697] T f814d836f0bd46a4aa7d660d8ff4b2d5 P 58a7cda73b3542718987bf815eed9b79 [term 1 LEADER]: Becoming Leader. State: Replica: 58a7cda73b3542718987bf815eed9b79, State: Running, Role: LEADER
I20260709 13:09:09.840895 29841 leader_election.cc:304] T 968909b990764b0c8c388a63060c8130 P 58a7cda73b3542718987bf815eed9b79 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 37897779fb894afb8129dcf5d269bd54, 58a7cda73b3542718987bf815eed9b79; no voters: 4bc679ad21a64bfe93bf64ff1b6ba3b2
I20260709 13:09:09.841694 29953 raft_consensus.cc:2468] T f814d836f0bd46a4aa7d660d8ff4b2d5 P 4bc679ad21a64bfe93bf64ff1b6ba3b2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 58a7cda73b3542718987bf815eed9b79 in term 1.
I20260709 13:09:09.842381 30027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ab64e7b83584196b9e6c6d1bc634351" candidate_uuid: "4bc679ad21a64bfe93bf64ff1b6ba3b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "37897779fb894afb8129dcf5d269bd54"
I20260709 13:09:09.841789 30099 raft_consensus.cc:2804] T 968909b990764b0c8c388a63060c8130 P 58a7cda73b3542718987bf815eed9b79 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:09.843091 30027 raft_consensus.cc:3060] T 5ab64e7b83584196b9e6c6d1bc634351 P 37897779fb894afb8129dcf5d269bd54 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:09.843456 30099 raft_consensus.cc:697] T 968909b990764b0c8c388a63060c8130 P 58a7cda73b3542718987bf815eed9b79 [term 1 LEADER]: Becoming Leader. State: Replica: 58a7cda73b3542718987bf815eed9b79, State: Running, Role: LEADER
I20260709 13:09:09.844336 30099 consensus_queue.cc:237] T 968909b990764b0c8c388a63060c8130 P 58a7cda73b3542718987bf815eed9b79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "58a7cda73b3542718987bf815eed9b79" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 37953 } } peers { permanent_uuid: "4bc679ad21a64bfe93bf64ff1b6ba3b2" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 33075 } } peers { permanent_uuid: "37897779fb894afb8129dcf5d269bd54" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 42765 } }
I20260709 13:09:09.841125 30073 consensus_queue.cc:237] T f814d836f0bd46a4aa7d660d8ff4b2d5 P 58a7cda73b3542718987bf815eed9b79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "58a7cda73b3542718987bf815eed9b79" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 37953 } } peers { permanent_uuid: "4bc679ad21a64bfe93bf64ff1b6ba3b2" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 33075 } } peers { permanent_uuid: "37897779fb894afb8129dcf5d269bd54" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 42765 } }
I20260709 13:09:09.850297 29876 raft_consensus.cc:2468] T 5ab64e7b83584196b9e6c6d1bc634351 P 58a7cda73b3542718987bf815eed9b79 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4bc679ad21a64bfe93bf64ff1b6ba3b2 in term 1.
I20260709 13:09:09.851859 29919 leader_election.cc:304] T 5ab64e7b83584196b9e6c6d1bc634351 P 4bc679ad21a64bfe93bf64ff1b6ba3b2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4bc679ad21a64bfe93bf64ff1b6ba3b2, 58a7cda73b3542718987bf815eed9b79; no voters: 
I20260709 13:09:09.852952 30076 raft_consensus.cc:2804] T 5ab64e7b83584196b9e6c6d1bc634351 P 4bc679ad21a64bfe93bf64ff1b6ba3b2 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:09.853417 30076 raft_consensus.cc:697] T 5ab64e7b83584196b9e6c6d1bc634351 P 4bc679ad21a64bfe93bf64ff1b6ba3b2 [term 1 LEADER]: Becoming Leader. State: Replica: 4bc679ad21a64bfe93bf64ff1b6ba3b2, State: Running, Role: LEADER
I20260709 13:09:09.854247 30076 consensus_queue.cc:237] T 5ab64e7b83584196b9e6c6d1bc634351 P 4bc679ad21a64bfe93bf64ff1b6ba3b2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "58a7cda73b3542718987bf815eed9b79" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 37953 } } peers { permanent_uuid: "4bc679ad21a64bfe93bf64ff1b6ba3b2" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 33075 } } peers { permanent_uuid: "37897779fb894afb8129dcf5d269bd54" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 42765 } }
I20260709 13:09:09.851112 30027 raft_consensus.cc:2468] T 5ab64e7b83584196b9e6c6d1bc634351 P 37897779fb894afb8129dcf5d269bd54 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4bc679ad21a64bfe93bf64ff1b6ba3b2 in term 1.
I20260709 13:09:09.857978 29775 catalog_manager.cc:5697] T 6d4b64688b8949c89f8f7b7aa871efed P 4bc679ad21a64bfe93bf64ff1b6ba3b2 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4bc679ad21a64bfe93bf64ff1b6ba3b2 (127.17.223.2). New cstate: current_term: 1 leader_uuid: "4bc679ad21a64bfe93bf64ff1b6ba3b2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "58a7cda73b3542718987bf815eed9b79" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 37953 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4bc679ad21a64bfe93bf64ff1b6ba3b2" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 33075 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "37897779fb894afb8129dcf5d269bd54" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 42765 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:09.865423 30069 tablet_bootstrap.cc:654] T 968909b990764b0c8c388a63060c8130 P 4bc679ad21a64bfe93bf64ff1b6ba3b2: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:09.871729 30069 tablet_bootstrap.cc:492] T 968909b990764b0c8c388a63060c8130 P 4bc679ad21a64bfe93bf64ff1b6ba3b2: No bootstrap required, opened a new log
I20260709 13:09:09.872223 30069 ts_tablet_manager.cc:1403] T 968909b990764b0c8c388a63060c8130 P 4bc679ad21a64bfe93bf64ff1b6ba3b2: Time spent bootstrapping tablet: real 0.036s	user 0.011s	sys 0.003s
I20260709 13:09:09.873262 29774 catalog_manager.cc:5697] T 968909b990764b0c8c388a63060c8130 P 58a7cda73b3542718987bf815eed9b79 reported cstate change: term changed from 0 to 1, leader changed from <none> to 58a7cda73b3542718987bf815eed9b79 (127.17.223.1). New cstate: current_term: 1 leader_uuid: "58a7cda73b3542718987bf815eed9b79" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "58a7cda73b3542718987bf815eed9b79" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 37953 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4bc679ad21a64bfe93bf64ff1b6ba3b2" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 33075 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "37897779fb894afb8129dcf5d269bd54" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 42765 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:09.875938 29774 catalog_manager.cc:5697] T f814d836f0bd46a4aa7d660d8ff4b2d5 P 58a7cda73b3542718987bf815eed9b79 reported cstate change: term changed from 0 to 1, leader changed from <none> to 58a7cda73b3542718987bf815eed9b79 (127.17.223.1). New cstate: current_term: 1 leader_uuid: "58a7cda73b3542718987bf815eed9b79" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "58a7cda73b3542718987bf815eed9b79" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 37953 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4bc679ad21a64bfe93bf64ff1b6ba3b2" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 33075 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "37897779fb894afb8129dcf5d269bd54" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 42765 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:09.876508 30069 raft_consensus.cc:359] T 968909b990764b0c8c388a63060c8130 P 4bc679ad21a64bfe93bf64ff1b6ba3b2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "58a7cda73b3542718987bf815eed9b79" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 37953 } } peers { permanent_uuid: "4bc679ad21a64bfe93bf64ff1b6ba3b2" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 33075 } } peers { permanent_uuid: "37897779fb894afb8129dcf5d269bd54" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 42765 } }
I20260709 13:09:09.877767 30069 raft_consensus.cc:385] T 968909b990764b0c8c388a63060c8130 P 4bc679ad21a64bfe93bf64ff1b6ba3b2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:09.878062 30069 raft_consensus.cc:740] T 968909b990764b0c8c388a63060c8130 P 4bc679ad21a64bfe93bf64ff1b6ba3b2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4bc679ad21a64bfe93bf64ff1b6ba3b2, State: Initialized, Role: FOLLOWER
I20260709 13:09:09.879241 30076 raft_consensus.cc:493] T e347ac4792b04c198fb6829a4a87078b P 4bc679ad21a64bfe93bf64ff1b6ba3b2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:09.879820 30076 raft_consensus.cc:515] T e347ac4792b04c198fb6829a4a87078b P 4bc679ad21a64bfe93bf64ff1b6ba3b2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "58a7cda73b3542718987bf815eed9b79" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 37953 } } peers { permanent_uuid: "4bc679ad21a64bfe93bf64ff1b6ba3b2" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 33075 } } peers { permanent_uuid: "37897779fb894afb8129dcf5d269bd54" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 42765 } }
I20260709 13:09:09.879904 29775 catalog_manager.cc:5697] T 5ab64e7b83584196b9e6c6d1bc634351 P 4bc679ad21a64bfe93bf64ff1b6ba3b2 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4bc679ad21a64bfe93bf64ff1b6ba3b2 (127.17.223.2). New cstate: current_term: 1 leader_uuid: "4bc679ad21a64bfe93bf64ff1b6ba3b2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "58a7cda73b3542718987bf815eed9b79" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 37953 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4bc679ad21a64bfe93bf64ff1b6ba3b2" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 33075 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "37897779fb894afb8129dcf5d269bd54" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 42765 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:09.882717 30076 leader_election.cc:290] T e347ac4792b04c198fb6829a4a87078b P 4bc679ad21a64bfe93bf64ff1b6ba3b2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 58a7cda73b3542718987bf815eed9b79 (127.17.223.1:37953), 37897779fb894afb8129dcf5d269bd54 (127.17.223.3:42765)
I20260709 13:09:09.879228 30069 consensus_queue.cc:260] T 968909b990764b0c8c388a63060c8130 P 4bc679ad21a64bfe93bf64ff1b6ba3b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "58a7cda73b3542718987bf815eed9b79" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 37953 } } peers { permanent_uuid: "4bc679ad21a64bfe93bf64ff1b6ba3b2" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 33075 } } peers { permanent_uuid: "37897779fb894afb8129dcf5d269bd54" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 42765 } }
I20260709 13:09:09.883502 29876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e347ac4792b04c198fb6829a4a87078b" candidate_uuid: "4bc679ad21a64bfe93bf64ff1b6ba3b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "58a7cda73b3542718987bf815eed9b79" is_pre_election: true
I20260709 13:09:09.883911 30027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e347ac4792b04c198fb6829a4a87078b" candidate_uuid: "4bc679ad21a64bfe93bf64ff1b6ba3b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "37897779fb894afb8129dcf5d269bd54" is_pre_election: true
I20260709 13:09:09.884455 29876 raft_consensus.cc:2393] T e347ac4792b04c198fb6829a4a87078b P 58a7cda73b3542718987bf815eed9b79 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4bc679ad21a64bfe93bf64ff1b6ba3b2 in current term 1: Already voted for candidate 37897779fb894afb8129dcf5d269bd54 in this term.
I20260709 13:09:09.884878 30069 ts_tablet_manager.cc:1434] T 968909b990764b0c8c388a63060c8130 P 4bc679ad21a64bfe93bf64ff1b6ba3b2: Time spent starting tablet: real 0.012s	user 0.006s	sys 0.000s
I20260709 13:09:09.885963 30069 tablet_bootstrap.cc:492] T 59abb803b8ce4d28967bf12c46d66c0d P 4bc679ad21a64bfe93bf64ff1b6ba3b2: Bootstrap starting.
I20260709 13:09:09.885757 29919 leader_election.cc:304] T e347ac4792b04c198fb6829a4a87078b P 4bc679ad21a64bfe93bf64ff1b6ba3b2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4bc679ad21a64bfe93bf64ff1b6ba3b2; no voters: 37897779fb894afb8129dcf5d269bd54, 58a7cda73b3542718987bf815eed9b79
I20260709 13:09:09.886596 30076 raft_consensus.cc:3060] T e347ac4792b04c198fb6829a4a87078b P 4bc679ad21a64bfe93bf64ff1b6ba3b2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:09.890152 30069 tablet_bootstrap.cc:654] T 59abb803b8ce4d28967bf12c46d66c0d P 4bc679ad21a64bfe93bf64ff1b6ba3b2: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:09.897773 30069 tablet_bootstrap.cc:492] T 59abb803b8ce4d28967bf12c46d66c0d P 4bc679ad21a64bfe93bf64ff1b6ba3b2: No bootstrap required, opened a new log
I20260709 13:09:09.898283 30069 ts_tablet_manager.cc:1403] T 59abb803b8ce4d28967bf12c46d66c0d P 4bc679ad21a64bfe93bf64ff1b6ba3b2: Time spent bootstrapping tablet: real 0.013s	user 0.003s	sys 0.007s
I20260709 13:09:09.898319 30076 raft_consensus.cc:2749] T e347ac4792b04c198fb6829a4a87078b P 4bc679ad21a64bfe93bf64ff1b6ba3b2 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:09.900522 30069 raft_consensus.cc:359] T 59abb803b8ce4d28967bf12c46d66c0d P 4bc679ad21a64bfe93bf64ff1b6ba3b2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "58a7cda73b3542718987bf815eed9b79" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 37953 } } peers { permanent_uuid: "4bc679ad21a64bfe93bf64ff1b6ba3b2" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 33075 } } peers { permanent_uuid: "37897779fb894afb8129dcf5d269bd54" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 42765 } }
I20260709 13:09:09.900969 30069 raft_consensus.cc:385] T 59abb803b8ce4d28967bf12c46d66c0d P 4bc679ad21a64bfe93bf64ff1b6ba3b2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:09.901233 30069 raft_consensus.cc:740] T 59abb803b8ce4d28967bf12c46d66c0d P 4bc679ad21a64bfe93bf64ff1b6ba3b2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4bc679ad21a64bfe93bf64ff1b6ba3b2, State: Initialized, Role: FOLLOWER
I20260709 13:09:09.902400 30069 consensus_queue.cc:260] T 59abb803b8ce4d28967bf12c46d66c0d P 4bc679ad21a64bfe93bf64ff1b6ba3b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "58a7cda73b3542718987bf815eed9b79" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 37953 } } peers { permanent_uuid: "4bc679ad21a64bfe93bf64ff1b6ba3b2" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 33075 } } peers { permanent_uuid: "37897779fb894afb8129dcf5d269bd54" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 42765 } }
I20260709 13:09:09.904078 30069 ts_tablet_manager.cc:1434] T 59abb803b8ce4d28967bf12c46d66c0d P 4bc679ad21a64bfe93bf64ff1b6ba3b2: Time spent starting tablet: real 0.005s	user 0.006s	sys 0.000s
I20260709 13:09:09.973802 30076 raft_consensus.cc:493] T 968909b990764b0c8c388a63060c8130 P 4bc679ad21a64bfe93bf64ff1b6ba3b2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:09.974488 30076 raft_consensus.cc:515] T 968909b990764b0c8c388a63060c8130 P 4bc679ad21a64bfe93bf64ff1b6ba3b2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "58a7cda73b3542718987bf815eed9b79" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 37953 } } peers { permanent_uuid: "4bc679ad21a64bfe93bf64ff1b6ba3b2" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 33075 } } peers { permanent_uuid: "37897779fb894afb8129dcf5d269bd54" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 42765 } }
I20260709 13:09:09.976298 30076 leader_election.cc:290] T 968909b990764b0c8c388a63060c8130 P 4bc679ad21a64bfe93bf64ff1b6ba3b2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 58a7cda73b3542718987bf815eed9b79 (127.17.223.1:37953), 37897779fb894afb8129dcf5d269bd54 (127.17.223.3:42765)
I20260709 13:09:09.977149 29876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "968909b990764b0c8c388a63060c8130" candidate_uuid: "4bc679ad21a64bfe93bf64ff1b6ba3b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "58a7cda73b3542718987bf815eed9b79" is_pre_election: true
I20260709 13:09:09.977267 30027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "968909b990764b0c8c388a63060c8130" candidate_uuid: "4bc679ad21a64bfe93bf64ff1b6ba3b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "37897779fb894afb8129dcf5d269bd54" is_pre_election: true
I20260709 13:09:09.978024 30027 raft_consensus.cc:2393] T 968909b990764b0c8c388a63060c8130 P 37897779fb894afb8129dcf5d269bd54 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4bc679ad21a64bfe93bf64ff1b6ba3b2 in current term 1: Already voted for candidate 58a7cda73b3542718987bf815eed9b79 in this term.
I20260709 13:09:09.979023 29916 leader_election.cc:304] T 968909b990764b0c8c388a63060c8130 P 4bc679ad21a64bfe93bf64ff1b6ba3b2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4bc679ad21a64bfe93bf64ff1b6ba3b2; no voters: 37897779fb894afb8129dcf5d269bd54, 58a7cda73b3542718987bf815eed9b79
I20260709 13:09:09.980278 30076 raft_consensus.cc:3060] T 968909b990764b0c8c388a63060c8130 P 4bc679ad21a64bfe93bf64ff1b6ba3b2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:09.985456 30076 raft_consensus.cc:2749] T 968909b990764b0c8c388a63060c8130 P 4bc679ad21a64bfe93bf64ff1b6ba3b2 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:10.002071 30073 raft_consensus.cc:493] T 59abb803b8ce4d28967bf12c46d66c0d P 58a7cda73b3542718987bf815eed9b79 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:10.002661 30073 raft_consensus.cc:515] T 59abb803b8ce4d28967bf12c46d66c0d P 58a7cda73b3542718987bf815eed9b79 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "58a7cda73b3542718987bf815eed9b79" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 37953 } } peers { permanent_uuid: "4bc679ad21a64bfe93bf64ff1b6ba3b2" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 33075 } } peers { permanent_uuid: "37897779fb894afb8129dcf5d269bd54" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 42765 } }
I20260709 13:09:10.004452 30073 leader_election.cc:290] T 59abb803b8ce4d28967bf12c46d66c0d P 58a7cda73b3542718987bf815eed9b79 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4bc679ad21a64bfe93bf64ff1b6ba3b2 (127.17.223.2:33075), 37897779fb894afb8129dcf5d269bd54 (127.17.223.3:42765)
I20260709 13:09:10.005533 30027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59abb803b8ce4d28967bf12c46d66c0d" candidate_uuid: "58a7cda73b3542718987bf815eed9b79" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "37897779fb894afb8129dcf5d269bd54" is_pre_election: true
I20260709 13:09:10.005533 29953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59abb803b8ce4d28967bf12c46d66c0d" candidate_uuid: "58a7cda73b3542718987bf815eed9b79" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4bc679ad21a64bfe93bf64ff1b6ba3b2" is_pre_election: true
I20260709 13:09:10.006538 30027 raft_consensus.cc:2468] T 59abb803b8ce4d28967bf12c46d66c0d P 37897779fb894afb8129dcf5d269bd54 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 58a7cda73b3542718987bf815eed9b79 in term 0.
I20260709 13:09:10.006551 29953 raft_consensus.cc:2468] T 59abb803b8ce4d28967bf12c46d66c0d P 4bc679ad21a64bfe93bf64ff1b6ba3b2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 58a7cda73b3542718987bf815eed9b79 in term 0.
I20260709 13:09:10.007807 29841 leader_election.cc:304] T 59abb803b8ce4d28967bf12c46d66c0d P 58a7cda73b3542718987bf815eed9b79 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 37897779fb894afb8129dcf5d269bd54, 58a7cda73b3542718987bf815eed9b79; no voters: 
I20260709 13:09:10.008493 30073 raft_consensus.cc:2804] T 59abb803b8ce4d28967bf12c46d66c0d P 58a7cda73b3542718987bf815eed9b79 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:10.008811 30073 raft_consensus.cc:493] T 59abb803b8ce4d28967bf12c46d66c0d P 58a7cda73b3542718987bf815eed9b79 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:10.009106 30073 raft_consensus.cc:3060] T 59abb803b8ce4d28967bf12c46d66c0d P 58a7cda73b3542718987bf815eed9b79 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:10.014830 30073 raft_consensus.cc:515] T 59abb803b8ce4d28967bf12c46d66c0d P 58a7cda73b3542718987bf815eed9b79 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "58a7cda73b3542718987bf815eed9b79" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 37953 } } peers { permanent_uuid: "4bc679ad21a64bfe93bf64ff1b6ba3b2" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 33075 } } peers { permanent_uuid: "37897779fb894afb8129dcf5d269bd54" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 42765 } }
I20260709 13:09:10.015710 30075 consensus_queue.cc:1048] T 8f557a35c94b4b2b917d69463fc69be9 P 37897779fb894afb8129dcf5d269bd54 [LEADER]: Connected to new peer: Peer: permanent_uuid: "58a7cda73b3542718987bf815eed9b79" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 37953 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:10.016667 30073 leader_election.cc:290] T 59abb803b8ce4d28967bf12c46d66c0d P 58a7cda73b3542718987bf815eed9b79 [CANDIDATE]: Term 1 election: Requested vote from peers 4bc679ad21a64bfe93bf64ff1b6ba3b2 (127.17.223.2:33075), 37897779fb894afb8129dcf5d269bd54 (127.17.223.3:42765)
I20260709 13:09:10.017614 29953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59abb803b8ce4d28967bf12c46d66c0d" candidate_uuid: "58a7cda73b3542718987bf815eed9b79" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4bc679ad21a64bfe93bf64ff1b6ba3b2"
I20260709 13:09:10.017791 30027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59abb803b8ce4d28967bf12c46d66c0d" candidate_uuid: "58a7cda73b3542718987bf815eed9b79" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "37897779fb894afb8129dcf5d269bd54"
I20260709 13:09:10.018358 30027 raft_consensus.cc:3060] T 59abb803b8ce4d28967bf12c46d66c0d P 37897779fb894afb8129dcf5d269bd54 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:10.018257 29953 raft_consensus.cc:3060] T 59abb803b8ce4d28967bf12c46d66c0d P 4bc679ad21a64bfe93bf64ff1b6ba3b2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:10.026791 30027 raft_consensus.cc:2468] T 59abb803b8ce4d28967bf12c46d66c0d P 37897779fb894afb8129dcf5d269bd54 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 58a7cda73b3542718987bf815eed9b79 in term 1.
I20260709 13:09:10.026366 29953 raft_consensus.cc:2468] T 59abb803b8ce4d28967bf12c46d66c0d P 4bc679ad21a64bfe93bf64ff1b6ba3b2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 58a7cda73b3542718987bf815eed9b79 in term 1.
I20260709 13:09:10.029534 29842 leader_election.cc:304] T 59abb803b8ce4d28967bf12c46d66c0d P 58a7cda73b3542718987bf815eed9b79 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4bc679ad21a64bfe93bf64ff1b6ba3b2, 58a7cda73b3542718987bf815eed9b79; no voters: 
I20260709 13:09:10.030390 30073 raft_consensus.cc:2804] T 59abb803b8ce4d28967bf12c46d66c0d P 58a7cda73b3542718987bf815eed9b79 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:10.030902 30073 raft_consensus.cc:697] T 59abb803b8ce4d28967bf12c46d66c0d P 58a7cda73b3542718987bf815eed9b79 [term 1 LEADER]: Becoming Leader. State: Replica: 58a7cda73b3542718987bf815eed9b79, State: Running, Role: LEADER
I20260709 13:09:10.031769 30073 consensus_queue.cc:237] T 59abb803b8ce4d28967bf12c46d66c0d P 58a7cda73b3542718987bf815eed9b79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "58a7cda73b3542718987bf815eed9b79" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 37953 } } peers { permanent_uuid: "4bc679ad21a64bfe93bf64ff1b6ba3b2" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 33075 } } peers { permanent_uuid: "37897779fb894afb8129dcf5d269bd54" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 42765 } }
I20260709 13:09:10.033643 30090 consensus_queue.cc:1048] T 8f557a35c94b4b2b917d69463fc69be9 P 37897779fb894afb8129dcf5d269bd54 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4bc679ad21a64bfe93bf64ff1b6ba3b2" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 33075 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:10.045308 29775 catalog_manager.cc:5697] T 59abb803b8ce4d28967bf12c46d66c0d P 58a7cda73b3542718987bf815eed9b79 reported cstate change: term changed from 0 to 1, leader changed from <none> to 58a7cda73b3542718987bf815eed9b79 (127.17.223.1). New cstate: current_term: 1 leader_uuid: "58a7cda73b3542718987bf815eed9b79" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "58a7cda73b3542718987bf815eed9b79" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 37953 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4bc679ad21a64bfe93bf64ff1b6ba3b2" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 33075 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "37897779fb894afb8129dcf5d269bd54" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 42765 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:10.103253 29952 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6d4b64688b8949c89f8f7b7aa871efed"
dest_uuid: "4bc679ad21a64bfe93bf64ff1b6ba3b2"
mode: GRACEFUL
new_leader_uuid: "58a7cda73b3542718987bf815eed9b79"
 from {username='slave'} at 127.0.0.1:48686
I20260709 13:09:10.103789 29952 raft_consensus.cc:606] T 6d4b64688b8949c89f8f7b7aa871efed P 4bc679ad21a64bfe93bf64ff1b6ba3b2 [term 1 LEADER]: Received request to transfer leadership to TS 58a7cda73b3542718987bf815eed9b79
I20260709 13:09:10.116717 30027 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8f557a35c94b4b2b917d69463fc69be9"
dest_uuid: "37897779fb894afb8129dcf5d269bd54"
mode: GRACEFUL
new_leader_uuid: "58a7cda73b3542718987bf815eed9b79"
 from {username='slave'} at 127.0.0.1:58228
I20260709 13:09:10.117316 30027 raft_consensus.cc:606] T 8f557a35c94b4b2b917d69463fc69be9 P 37897779fb894afb8129dcf5d269bd54 [term 1 LEADER]: Received request to transfer leadership to TS 58a7cda73b3542718987bf815eed9b79
I20260709 13:09:10.122512 29952 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5ab64e7b83584196b9e6c6d1bc634351"
dest_uuid: "4bc679ad21a64bfe93bf64ff1b6ba3b2"
mode: GRACEFUL
new_leader_uuid: "58a7cda73b3542718987bf815eed9b79"
 from {username='slave'} at 127.0.0.1:48686
I20260709 13:09:10.123121 29952 raft_consensus.cc:606] T 5ab64e7b83584196b9e6c6d1bc634351 P 4bc679ad21a64bfe93bf64ff1b6ba3b2 [term 1 LEADER]: Received request to transfer leadership to TS 58a7cda73b3542718987bf815eed9b79
I20260709 13:09:10.124387 30076 consensus_queue.cc:1048] T 6450825bf8ba4ebaa0e631b1dea6538e P 4bc679ad21a64bfe93bf64ff1b6ba3b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "37897779fb894afb8129dcf5d269bd54" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 42765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:10.128760 30025 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e347ac4792b04c198fb6829a4a87078b"
dest_uuid: "37897779fb894afb8129dcf5d269bd54"
mode: GRACEFUL
new_leader_uuid: "58a7cda73b3542718987bf815eed9b79"
 from {username='slave'} at 127.0.0.1:58228
I20260709 13:09:10.129519 30025 raft_consensus.cc:606] T e347ac4792b04c198fb6829a4a87078b P 37897779fb894afb8129dcf5d269bd54 [term 1 LEADER]: Received request to transfer leadership to TS 58a7cda73b3542718987bf815eed9b79
I20260709 13:09:10.138407 30117 consensus_queue.cc:1048] T 6450825bf8ba4ebaa0e631b1dea6538e P 4bc679ad21a64bfe93bf64ff1b6ba3b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "58a7cda73b3542718987bf815eed9b79" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 37953 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:10.154402 29876 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "bb9da524d5b84f09b0c5853761aa5886"
dest_uuid: "58a7cda73b3542718987bf815eed9b79"
mode: GRACEFUL
new_leader_uuid: "4bc679ad21a64bfe93bf64ff1b6ba3b2"
 from {username='slave'} at 127.0.0.1:36148
I20260709 13:09:10.154991 29876 raft_consensus.cc:606] T bb9da524d5b84f09b0c5853761aa5886 P 58a7cda73b3542718987bf815eed9b79 [term 1 LEADER]: Received request to transfer leadership to TS 4bc679ad21a64bfe93bf64ff1b6ba3b2
I20260709 13:09:10.160380 29876 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f814d836f0bd46a4aa7d660d8ff4b2d5"
dest_uuid: "58a7cda73b3542718987bf815eed9b79"
mode: GRACEFUL
new_leader_uuid: "4bc679ad21a64bfe93bf64ff1b6ba3b2"
 from {username='slave'} at 127.0.0.1:36148
I20260709 13:09:10.161000 29876 raft_consensus.cc:606] T f814d836f0bd46a4aa7d660d8ff4b2d5 P 58a7cda73b3542718987bf815eed9b79 [term 1 LEADER]: Received request to transfer leadership to TS 4bc679ad21a64bfe93bf64ff1b6ba3b2
I20260709 13:09:10.167382 30090 consensus_queue.cc:1048] T e347ac4792b04c198fb6829a4a87078b P 37897779fb894afb8129dcf5d269bd54 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4bc679ad21a64bfe93bf64ff1b6ba3b2" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 33075 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:10.168855 29876 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "968909b990764b0c8c388a63060c8130"
dest_uuid: "58a7cda73b3542718987bf815eed9b79"
mode: GRACEFUL
new_leader_uuid: "4bc679ad21a64bfe93bf64ff1b6ba3b2"
 from {username='slave'} at 127.0.0.1:36148
I20260709 13:09:10.169462 29876 raft_consensus.cc:606] T 968909b990764b0c8c388a63060c8130 P 58a7cda73b3542718987bf815eed9b79 [term 1 LEADER]: Received request to transfer leadership to TS 4bc679ad21a64bfe93bf64ff1b6ba3b2
I20260709 13:09:10.175123 29876 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "59abb803b8ce4d28967bf12c46d66c0d"
dest_uuid: "58a7cda73b3542718987bf815eed9b79"
mode: GRACEFUL
new_leader_uuid: "37897779fb894afb8129dcf5d269bd54"
 from {username='slave'} at 127.0.0.1:36148
I20260709 13:09:10.175706 29876 raft_consensus.cc:606] T 59abb803b8ce4d28967bf12c46d66c0d P 58a7cda73b3542718987bf815eed9b79 [term 1 LEADER]: Received request to transfer leadership to TS 37897779fb894afb8129dcf5d269bd54
I20260709 13:09:10.179806 30075 consensus_queue.cc:1048] T e347ac4792b04c198fb6829a4a87078b P 37897779fb894afb8129dcf5d269bd54 [LEADER]: Connected to new peer: Peer: permanent_uuid: "58a7cda73b3542718987bf815eed9b79" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 37953 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:10.187297 30136 raft_consensus.cc:993] T e347ac4792b04c198fb6829a4a87078b P 37897779fb894afb8129dcf5d269bd54: : Instructing follower 58a7cda73b3542718987bf815eed9b79 to start an election
I20260709 13:09:10.187803 30136 raft_consensus.cc:1081] T e347ac4792b04c198fb6829a4a87078b P 37897779fb894afb8129dcf5d269bd54 [term 1 LEADER]: Signalling peer 58a7cda73b3542718987bf815eed9b79 to start an election
I20260709 13:09:10.189391 29876 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e347ac4792b04c198fb6829a4a87078b"
dest_uuid: "58a7cda73b3542718987bf815eed9b79"
 from {username='slave'} at 127.0.0.1:36128
I20260709 13:09:10.189946 29876 raft_consensus.cc:493] T e347ac4792b04c198fb6829a4a87078b P 58a7cda73b3542718987bf815eed9b79 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:09:10.190248 29876 raft_consensus.cc:3060] T e347ac4792b04c198fb6829a4a87078b P 58a7cda73b3542718987bf815eed9b79 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:10.195441 29876 raft_consensus.cc:515] T e347ac4792b04c198fb6829a4a87078b P 58a7cda73b3542718987bf815eed9b79 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "58a7cda73b3542718987bf815eed9b79" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 37953 } } peers { permanent_uuid: "4bc679ad21a64bfe93bf64ff1b6ba3b2" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 33075 } } peers { permanent_uuid: "37897779fb894afb8129dcf5d269bd54" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 42765 } }
I20260709 13:09:10.197032 29876 leader_election.cc:290] T e347ac4792b04c198fb6829a4a87078b P 58a7cda73b3542718987bf815eed9b79 [CANDIDATE]: Term 2 election: Requested vote from peers 4bc679ad21a64bfe93bf64ff1b6ba3b2 (127.17.223.2:33075), 37897779fb894afb8129dcf5d269bd54 (127.17.223.3:42765)
I20260709 13:09:10.197930 29952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e347ac4792b04c198fb6829a4a87078b" candidate_uuid: "58a7cda73b3542718987bf815eed9b79" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "4bc679ad21a64bfe93bf64ff1b6ba3b2"
I20260709 13:09:10.198098 30027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e347ac4792b04c198fb6829a4a87078b" candidate_uuid: "58a7cda73b3542718987bf815eed9b79" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "37897779fb894afb8129dcf5d269bd54"
I20260709 13:09:10.198566 29952 raft_consensus.cc:3060] T e347ac4792b04c198fb6829a4a87078b P 4bc679ad21a64bfe93bf64ff1b6ba3b2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:10.198736 30027 raft_consensus.cc:3055] T e347ac4792b04c198fb6829a4a87078b P 37897779fb894afb8129dcf5d269bd54 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:09:10.199164 30027 raft_consensus.cc:740] T e347ac4792b04c198fb6829a4a87078b P 37897779fb894afb8129dcf5d269bd54 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 37897779fb894afb8129dcf5d269bd54, State: Running, Role: LEADER
I20260709 13:09:10.199827 30027 consensus_queue.cc:260] T e347ac4792b04c198fb6829a4a87078b P 37897779fb894afb8129dcf5d269bd54 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "58a7cda73b3542718987bf815eed9b79" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 37953 } } peers { permanent_uuid: "4bc679ad21a64bfe93bf64ff1b6ba3b2" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 33075 } } peers { permanent_uuid: "37897779fb894afb8129dcf5d269bd54" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 42765 } }
I20260709 13:09:10.200775 30027 raft_consensus.cc:3060] T e347ac4792b04c198fb6829a4a87078b P 37897779fb894afb8129dcf5d269bd54 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:10.203838 29952 raft_consensus.cc:2468] T e347ac4792b04c198fb6829a4a87078b P 4bc679ad21a64bfe93bf64ff1b6ba3b2 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 58a7cda73b3542718987bf815eed9b79 in term 2.
I20260709 13:09:10.204909 29842 leader_election.cc:304] T e347ac4792b04c198fb6829a4a87078b P 58a7cda73b3542718987bf815eed9b79 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4bc679ad21a64bfe93bf64ff1b6ba3b2, 58a7cda73b3542718987bf815eed9b79; no voters: 
I20260709 13:09:10.205683 30073 raft_consensus.cc:2804] T e347ac4792b04c198fb6829a4a87078b P 58a7cda73b3542718987bf815eed9b79 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:09:10.206141 30073 raft_consensus.cc:697] T e347ac4792b04c198fb6829a4a87078b P 58a7cda73b3542718987bf815eed9b79 [term 2 LEADER]: Becoming Leader. State: Replica: 58a7cda73b3542718987bf815eed9b79, State: Running, Role: LEADER
I20260709 13:09:10.206074 30027 raft_consensus.cc:2468] T e347ac4792b04c198fb6829a4a87078b P 37897779fb894afb8129dcf5d269bd54 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 58a7cda73b3542718987bf815eed9b79 in term 2.
I20260709 13:09:10.207209 30073 consensus_queue.cc:237] T e347ac4792b04c198fb6829a4a87078b P 58a7cda73b3542718987bf815eed9b79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "58a7cda73b3542718987bf815eed9b79" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 37953 } } peers { permanent_uuid: "4bc679ad21a64bfe93bf64ff1b6ba3b2" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 33075 } } peers { permanent_uuid: "37897779fb894afb8129dcf5d269bd54" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 42765 } }
I20260709 13:09:10.213617 29776 catalog_manager.cc:5697] T e347ac4792b04c198fb6829a4a87078b P 58a7cda73b3542718987bf815eed9b79 reported cstate change: term changed from 1 to 2, leader changed from 37897779fb894afb8129dcf5d269bd54 (127.17.223.3) to 58a7cda73b3542718987bf815eed9b79 (127.17.223.1). New cstate: current_term: 2 leader_uuid: "58a7cda73b3542718987bf815eed9b79" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "58a7cda73b3542718987bf815eed9b79" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 37953 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4bc679ad21a64bfe93bf64ff1b6ba3b2" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 33075 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "37897779fb894afb8129dcf5d269bd54" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 42765 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:10.272745 30117 consensus_queue.cc:1048] T 6d4b64688b8949c89f8f7b7aa871efed P 4bc679ad21a64bfe93bf64ff1b6ba3b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "37897779fb894afb8129dcf5d269bd54" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 42765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:10.283658 30117 consensus_queue.cc:1048] T 6d4b64688b8949c89f8f7b7aa871efed P 4bc679ad21a64bfe93bf64ff1b6ba3b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "58a7cda73b3542718987bf815eed9b79" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 37953 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:10.292346 30103 raft_consensus.cc:993] T 6d4b64688b8949c89f8f7b7aa871efed P 4bc679ad21a64bfe93bf64ff1b6ba3b2: : Instructing follower 58a7cda73b3542718987bf815eed9b79 to start an election
I20260709 13:09:10.292863 30117 raft_consensus.cc:1081] T 6d4b64688b8949c89f8f7b7aa871efed P 4bc679ad21a64bfe93bf64ff1b6ba3b2 [term 1 LEADER]: Signalling peer 58a7cda73b3542718987bf815eed9b79 to start an election
I20260709 13:09:10.294453 29876 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "6d4b64688b8949c89f8f7b7aa871efed"
dest_uuid: "58a7cda73b3542718987bf815eed9b79"
 from {username='slave'} at 127.0.0.1:36140
I20260709 13:09:10.295092 29876 raft_consensus.cc:493] T 6d4b64688b8949c89f8f7b7aa871efed P 58a7cda73b3542718987bf815eed9b79 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:09:10.295472 29876 raft_consensus.cc:3060] T 6d4b64688b8949c89f8f7b7aa871efed P 58a7cda73b3542718987bf815eed9b79 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:10.300874 29876 raft_consensus.cc:515] T 6d4b64688b8949c89f8f7b7aa871efed P 58a7cda73b3542718987bf815eed9b79 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "58a7cda73b3542718987bf815eed9b79" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 37953 } } peers { permanent_uuid: "4bc679ad21a64bfe93bf64ff1b6ba3b2" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 33075 } } peers { permanent_uuid: "37897779fb894afb8129dcf5d269bd54" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 42765 } }
I20260709 13:09:10.303051 29876 leader_election.cc:290] T 6d4b64688b8949c89f8f7b7aa871efed P 58a7cda73b3542718987bf815eed9b79 [CANDIDATE]: Term 2 election: Requested vote from peers 4bc679ad21a64bfe93bf64ff1b6ba3b2 (127.17.223.2:33075), 37897779fb894afb8129dcf5d269bd54 (127.17.223.3:42765)
I20260709 13:09:10.303448 29952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d4b64688b8949c89f8f7b7aa871efed" candidate_uuid: "58a7cda73b3542718987bf815eed9b79" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "4bc679ad21a64bfe93bf64ff1b6ba3b2"
I20260709 13:09:10.303637 30027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d4b64688b8949c89f8f7b7aa871efed" candidate_uuid: "58a7cda73b3542718987bf815eed9b79" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "37897779fb894afb8129dcf5d269bd54"
I20260709 13:09:10.304160 29952 raft_consensus.cc:3055] T 6d4b64688b8949c89f8f7b7aa871efed P 4bc679ad21a64bfe93bf64ff1b6ba3b2 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:09:10.304245 30027 raft_consensus.cc:3060] T 6d4b64688b8949c89f8f7b7aa871efed P 37897779fb894afb8129dcf5d269bd54 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:10.304559 29952 raft_consensus.cc:740] T 6d4b64688b8949c89f8f7b7aa871efed P 4bc679ad21a64bfe93bf64ff1b6ba3b2 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 4bc679ad21a64bfe93bf64ff1b6ba3b2, State: Running, Role: LEADER
I20260709 13:09:10.306391 29952 consensus_queue.cc:260] T 6d4b64688b8949c89f8f7b7aa871efed P 4bc679ad21a64bfe93bf64ff1b6ba3b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "58a7cda73b3542718987bf815eed9b79" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 37953 } } peers { permanent_uuid: "4bc679ad21a64bfe93bf64ff1b6ba3b2" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 33075 } } peers { permanent_uuid: "37897779fb894afb8129dcf5d269bd54" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 42765 } }
I20260709 13:09:10.307855 29952 raft_consensus.cc:3060] T 6d4b64688b8949c89f8f7b7aa871efed P 4bc679ad21a64bfe93bf64ff1b6ba3b2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:10.308534 30073 consensus_queue.cc:1048] T 968909b990764b0c8c388a63060c8130 P 58a7cda73b3542718987bf815eed9b79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "37897779fb894afb8129dcf5d269bd54" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 42765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:10.313608 30027 raft_consensus.cc:2468] T 6d4b64688b8949c89f8f7b7aa871efed P 37897779fb894afb8129dcf5d269bd54 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 58a7cda73b3542718987bf815eed9b79 in term 2.
I20260709 13:09:10.315011 29841 leader_election.cc:304] T 6d4b64688b8949c89f8f7b7aa871efed P 58a7cda73b3542718987bf815eed9b79 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 37897779fb894afb8129dcf5d269bd54, 58a7cda73b3542718987bf815eed9b79; no voters: 
I20260709 13:09:10.315359 30073 consensus_queue.cc:1048] T bb9da524d5b84f09b0c5853761aa5886 P 58a7cda73b3542718987bf815eed9b79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4bc679ad21a64bfe93bf64ff1b6ba3b2" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 33075 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:10.315899 30099 raft_consensus.cc:2804] T 6d4b64688b8949c89f8f7b7aa871efed P 58a7cda73b3542718987bf815eed9b79 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:09:10.316375 30099 raft_consensus.cc:697] T 6d4b64688b8949c89f8f7b7aa871efed P 58a7cda73b3542718987bf815eed9b79 [term 2 LEADER]: Becoming Leader. State: Replica: 58a7cda73b3542718987bf815eed9b79, State: Running, Role: LEADER
I20260709 13:09:10.317243 30099 consensus_queue.cc:237] T 6d4b64688b8949c89f8f7b7aa871efed P 58a7cda73b3542718987bf815eed9b79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "58a7cda73b3542718987bf815eed9b79" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 37953 } } peers { permanent_uuid: "4bc679ad21a64bfe93bf64ff1b6ba3b2" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 33075 } } peers { permanent_uuid: "37897779fb894afb8129dcf5d269bd54" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 42765 } }
I20260709 13:09:10.318397 29952 raft_consensus.cc:2468] T 6d4b64688b8949c89f8f7b7aa871efed P 4bc679ad21a64bfe93bf64ff1b6ba3b2 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 58a7cda73b3542718987bf815eed9b79 in term 2.
I20260709 13:09:10.324323 30108 consensus_queue.cc:1048] T 968909b990764b0c8c388a63060c8130 P 58a7cda73b3542718987bf815eed9b79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4bc679ad21a64bfe93bf64ff1b6ba3b2" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 33075 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:09:10.336762 30099 raft_consensus.cc:993] T bb9da524d5b84f09b0c5853761aa5886 P 58a7cda73b3542718987bf815eed9b79: : Instructing follower 4bc679ad21a64bfe93bf64ff1b6ba3b2 to start an election
I20260709 13:09:10.337244 30099 raft_consensus.cc:1081] T bb9da524d5b84f09b0c5853761aa5886 P 58a7cda73b3542718987bf815eed9b79 [term 1 LEADER]: Signalling peer 4bc679ad21a64bfe93bf64ff1b6ba3b2 to start an election
I20260709 13:09:10.338732 29775 catalog_manager.cc:5697] T 6d4b64688b8949c89f8f7b7aa871efed P 58a7cda73b3542718987bf815eed9b79 reported cstate change: term changed from 1 to 2, leader changed from 4bc679ad21a64bfe93bf64ff1b6ba3b2 (127.17.223.2) to 58a7cda73b3542718987bf815eed9b79 (127.17.223.1). New cstate: current_term: 2 leader_uuid: "58a7cda73b3542718987bf815eed9b79" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "58a7cda73b3542718987bf815eed9b79" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 37953 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4bc679ad21a64bfe93bf64ff1b6ba3b2" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 33075 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "37897779fb894afb8129dcf5d269bd54" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 42765 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:10.345429 29951 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "bb9da524d5b84f09b0c5853761aa5886"
dest_uuid: "4bc679ad21a64bfe93bf64ff1b6ba3b2"
 from {username='slave'} at 127.0.0.1:48676
I20260709 13:09:10.346035 29951 raft_consensus.cc:493] T bb9da524d5b84f09b0c5853761aa5886 P 4bc679ad21a64bfe93bf64ff1b6ba3b2 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:09:10.346429 29951 raft_consensus.cc:3060] T bb9da524d5b84f09b0c5853761aa5886 P 4bc679ad21a64bfe93bf64ff1b6ba3b2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:10.346467 30108 raft_consensus.cc:993] T 968909b990764b0c8c388a63060c8130 P 58a7cda73b3542718987bf815eed9b79: : Instructing follower 4bc679ad21a64bfe93bf64ff1b6ba3b2 to start an election
I20260709 13:09:10.348577 30108 raft_consensus.cc:1081] T 968909b990764b0c8c388a63060c8130 P 58a7cda73b3542718987bf815eed9b79 [term 1 LEADER]: Signalling peer 4bc679ad21a64bfe93bf64ff1b6ba3b2 to start an election
I20260709 13:09:10.353833 29952 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "968909b990764b0c8c388a63060c8130"
dest_uuid: "4bc679ad21a64bfe93bf64ff1b6ba3b2"
 from {username='slave'} at 127.0.0.1:48676
I20260709 13:09:10.354516 29952 raft_consensus.cc:493] T 968909b990764b0c8c388a63060c8130 P 4bc679ad21a64bfe93bf64ff1b6ba3b2 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:09:10.355005 29952 raft_consensus.cc:3060] T 968909b990764b0c8c388a63060c8130 P 4bc679ad21a64bfe93bf64ff1b6ba3b2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:10.363916 30099 consensus_queue.cc:1048] T bb9da524d5b84f09b0c5853761aa5886 P 58a7cda73b3542718987bf815eed9b79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "37897779fb894afb8129dcf5d269bd54" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 42765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:09:10.365691 29951 raft_consensus.cc:515] T bb9da524d5b84f09b0c5853761aa5886 P 4bc679ad21a64bfe93bf64ff1b6ba3b2 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "58a7cda73b3542718987bf815eed9b79" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 37953 } } peers { permanent_uuid: "4bc679ad21a64bfe93bf64ff1b6ba3b2" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 33075 } } peers { permanent_uuid: "37897779fb894afb8129dcf5d269bd54" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 42765 } }
I20260709 13:09:10.369467 29952 raft_consensus.cc:515] T 968909b990764b0c8c388a63060c8130 P 4bc679ad21a64bfe93bf64ff1b6ba3b2 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "58a7cda73b3542718987bf815eed9b79" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 37953 } } peers { permanent_uuid: "4bc679ad21a64bfe93bf64ff1b6ba3b2" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 33075 } } peers { permanent_uuid: "37897779fb894afb8129dcf5d269bd54" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 42765 } }
I20260709 13:09:10.374853 29876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb9da524d5b84f09b0c5853761aa5886" candidate_uuid: "4bc679ad21a64bfe93bf64ff1b6ba3b2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "58a7cda73b3542718987bf815eed9b79"
I20260709 13:09:10.375466 29876 raft_consensus.cc:3055] T bb9da524d5b84f09b0c5853761aa5886 P 58a7cda73b3542718987bf815eed9b79 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:09:10.375808 29876 raft_consensus.cc:740] T bb9da524d5b84f09b0c5853761aa5886 P 58a7cda73b3542718987bf815eed9b79 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 58a7cda73b3542718987bf815eed9b79, State: Running, Role: LEADER
I20260709 13:09:10.375880 30025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb9da524d5b84f09b0c5853761aa5886" candidate_uuid: "4bc679ad21a64bfe93bf64ff1b6ba3b2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "37897779fb894afb8129dcf5d269bd54"
I20260709 13:09:10.376636 30025 raft_consensus.cc:3060] T bb9da524d5b84f09b0c5853761aa5886 P 37897779fb894afb8129dcf5d269bd54 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:10.376710 29876 consensus_queue.cc:260] T bb9da524d5b84f09b0c5853761aa5886 P 58a7cda73b3542718987bf815eed9b79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "58a7cda73b3542718987bf815eed9b79" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 37953 } } peers { permanent_uuid: "4bc679ad21a64bfe93bf64ff1b6ba3b2" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 33075 } } peers { permanent_uuid: "37897779fb894afb8129dcf5d269bd54" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 42765 } }
I20260709 13:09:10.377950 29876 raft_consensus.cc:3060] T bb9da524d5b84f09b0c5853761aa5886 P 58a7cda73b3542718987bf815eed9b79 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:10.379374 29951 leader_election.cc:290] T bb9da524d5b84f09b0c5853761aa5886 P 4bc679ad21a64bfe93bf64ff1b6ba3b2 [CANDIDATE]: Term 2 election: Requested vote from peers 58a7cda73b3542718987bf815eed9b79 (127.17.223.1:37953), 37897779fb894afb8129dcf5d269bd54 (127.17.223.3:42765)
I20260709 13:09:10.382791 29877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "968909b990764b0c8c388a63060c8130" candidate_uuid: "4bc679ad21a64bfe93bf64ff1b6ba3b2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "58a7cda73b3542718987bf815eed9b79"
I20260709 13:09:10.383371 29877 raft_consensus.cc:3055] T 968909b990764b0c8c388a63060c8130 P 58a7cda73b3542718987bf815eed9b79 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:09:10.383678 29877 raft_consensus.cc:740] T 968909b990764b0c8c388a63060c8130 P 58a7cda73b3542718987bf815eed9b79 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 58a7cda73b3542718987bf815eed9b79, State: Running, Role: LEADER
I20260709 13:09:10.384507 29877 consensus_queue.cc:260] T 968909b990764b0c8c388a63060c8130 P 58a7cda73b3542718987bf815eed9b79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "58a7cda73b3542718987bf815eed9b79" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 37953 } } peers { permanent_uuid: "4bc679ad21a64bfe93bf64ff1b6ba3b2" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 33075 } } peers { permanent_uuid: "37897779fb894afb8129dcf5d269bd54" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 42765 } }
I20260709 13:09:10.385718 29877 raft_consensus.cc:3060] T 968909b990764b0c8c388a63060c8130 P 58a7cda73b3542718987bf815eed9b79 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:10.386873 30025 raft_consensus.cc:2468] T bb9da524d5b84f09b0c5853761aa5886 P 37897779fb894afb8129dcf5d269bd54 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4bc679ad21a64bfe93bf64ff1b6ba3b2 in term 2.
I20260709 13:09:10.388559 29916 leader_election.cc:304] T bb9da524d5b84f09b0c5853761aa5886 P 4bc679ad21a64bfe93bf64ff1b6ba3b2 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 37897779fb894afb8129dcf5d269bd54, 4bc679ad21a64bfe93bf64ff1b6ba3b2; no voters: 
I20260709 13:09:10.388929 29952 leader_election.cc:290] T 968909b990764b0c8c388a63060c8130 P 4bc679ad21a64bfe93bf64ff1b6ba3b2 [CANDIDATE]: Term 2 election: Requested vote from peers 58a7cda73b3542718987bf815eed9b79 (127.17.223.1:37953), 37897779fb894afb8129dcf5d269bd54 (127.17.223.3:42765)
I20260709 13:09:10.390046 30117 raft_consensus.cc:2804] T bb9da524d5b84f09b0c5853761aa5886 P 4bc679ad21a64bfe93bf64ff1b6ba3b2 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:09:10.390581 30117 raft_consensus.cc:697] T bb9da524d5b84f09b0c5853761aa5886 P 4bc679ad21a64bfe93bf64ff1b6ba3b2 [term 2 LEADER]: Becoming Leader. State: Replica: 4bc679ad21a64bfe93bf64ff1b6ba3b2, State: Running, Role: LEADER
I20260709 13:09:10.391456 30027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "968909b990764b0c8c388a63060c8130" candidate_uuid: "4bc679ad21a64bfe93bf64ff1b6ba3b2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "37897779fb894afb8129dcf5d269bd54"
I20260709 13:09:10.392164 30027 raft_consensus.cc:3060] T 968909b990764b0c8c388a63060c8130 P 37897779fb894afb8129dcf5d269bd54 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:10.391511 30117 consensus_queue.cc:237] T bb9da524d5b84f09b0c5853761aa5886 P 4bc679ad21a64bfe93bf64ff1b6ba3b2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "58a7cda73b3542718987bf815eed9b79" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 37953 } } peers { permanent_uuid: "4bc679ad21a64bfe93bf64ff1b6ba3b2" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 33075 } } peers { permanent_uuid: "37897779fb894afb8129dcf5d269bd54" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 42765 } }
I20260709 13:09:10.394219 29876 raft_consensus.cc:2468] T bb9da524d5b84f09b0c5853761aa5886 P 58a7cda73b3542718987bf815eed9b79 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4bc679ad21a64bfe93bf64ff1b6ba3b2 in term 2.
I20260709 13:09:10.397236 29877 raft_consensus.cc:2468] T 968909b990764b0c8c388a63060c8130 P 58a7cda73b3542718987bf815eed9b79 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4bc679ad21a64bfe93bf64ff1b6ba3b2 in term 2.
I20260709 13:09:10.398494 30143 consensus_queue.cc:1048] T f814d836f0bd46a4aa7d660d8ff4b2d5 P 58a7cda73b3542718987bf815eed9b79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4bc679ad21a64bfe93bf64ff1b6ba3b2" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 33075 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:09:10.398579 29919 leader_election.cc:304] T 968909b990764b0c8c388a63060c8130 P 4bc679ad21a64bfe93bf64ff1b6ba3b2 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4bc679ad21a64bfe93bf64ff1b6ba3b2, 58a7cda73b3542718987bf815eed9b79; no voters: 
I20260709 13:09:10.400245 30117 raft_consensus.cc:2804] T 968909b990764b0c8c388a63060c8130 P 4bc679ad21a64bfe93bf64ff1b6ba3b2 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:09:10.400975 30117 raft_consensus.cc:697] T 968909b990764b0c8c388a63060c8130 P 4bc679ad21a64bfe93bf64ff1b6ba3b2 [term 2 LEADER]: Becoming Leader. State: Replica: 4bc679ad21a64bfe93bf64ff1b6ba3b2, State: Running, Role: LEADER
I20260709 13:09:10.401466 30027 raft_consensus.cc:2468] T 968909b990764b0c8c388a63060c8130 P 37897779fb894afb8129dcf5d269bd54 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4bc679ad21a64bfe93bf64ff1b6ba3b2 in term 2.
I20260709 13:09:10.401847 30117 consensus_queue.cc:237] T 968909b990764b0c8c388a63060c8130 P 4bc679ad21a64bfe93bf64ff1b6ba3b2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "58a7cda73b3542718987bf815eed9b79" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 37953 } } peers { permanent_uuid: "4bc679ad21a64bfe93bf64ff1b6ba3b2" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 33075 } } peers { permanent_uuid: "37897779fb894afb8129dcf5d269bd54" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 42765 } }
I20260709 13:09:10.402431 29776 catalog_manager.cc:5697] T bb9da524d5b84f09b0c5853761aa5886 P 4bc679ad21a64bfe93bf64ff1b6ba3b2 reported cstate change: term changed from 1 to 2, leader changed from 58a7cda73b3542718987bf815eed9b79 (127.17.223.1) to 4bc679ad21a64bfe93bf64ff1b6ba3b2 (127.17.223.2). New cstate: current_term: 2 leader_uuid: "4bc679ad21a64bfe93bf64ff1b6ba3b2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "58a7cda73b3542718987bf815eed9b79" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 37953 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4bc679ad21a64bfe93bf64ff1b6ba3b2" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 33075 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "37897779fb894afb8129dcf5d269bd54" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 42765 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:10.403975 30103 consensus_queue.cc:1048] T 5ab64e7b83584196b9e6c6d1bc634351 P 4bc679ad21a64bfe93bf64ff1b6ba3b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "58a7cda73b3542718987bf815eed9b79" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 37953 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:10.414040 30076 raft_consensus.cc:993] T 5ab64e7b83584196b9e6c6d1bc634351 P 4bc679ad21a64bfe93bf64ff1b6ba3b2: : Instructing follower 58a7cda73b3542718987bf815eed9b79 to start an election
I20260709 13:09:10.414531 30117 raft_consensus.cc:1081] T 5ab64e7b83584196b9e6c6d1bc634351 P 4bc679ad21a64bfe93bf64ff1b6ba3b2 [term 1 LEADER]: Signalling peer 58a7cda73b3542718987bf815eed9b79 to start an election
I20260709 13:09:10.418376 30144 raft_consensus.cc:993] T f814d836f0bd46a4aa7d660d8ff4b2d5 P 58a7cda73b3542718987bf815eed9b79: : Instructing follower 4bc679ad21a64bfe93bf64ff1b6ba3b2 to start an election
I20260709 13:09:10.418874 30073 raft_consensus.cc:1081] T f814d836f0bd46a4aa7d660d8ff4b2d5 P 58a7cda73b3542718987bf815eed9b79 [term 1 LEADER]: Signalling peer 4bc679ad21a64bfe93bf64ff1b6ba3b2 to start an election
I20260709 13:09:10.419876 29876 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "5ab64e7b83584196b9e6c6d1bc634351"
dest_uuid: "58a7cda73b3542718987bf815eed9b79"
 from {username='slave'} at 127.0.0.1:36140
I20260709 13:09:10.422640 29951 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f814d836f0bd46a4aa7d660d8ff4b2d5"
dest_uuid: "4bc679ad21a64bfe93bf64ff1b6ba3b2"
 from {username='slave'} at 127.0.0.1:48676
I20260709 13:09:10.422243 29774 catalog_manager.cc:5697] T 968909b990764b0c8c388a63060c8130 P 4bc679ad21a64bfe93bf64ff1b6ba3b2 reported cstate change: term changed from 1 to 2, leader changed from 58a7cda73b3542718987bf815eed9b79 (127.17.223.1) to 4bc679ad21a64bfe93bf64ff1b6ba3b2 (127.17.223.2). New cstate: current_term: 2 leader_uuid: "4bc679ad21a64bfe93bf64ff1b6ba3b2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "58a7cda73b3542718987bf815eed9b79" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 37953 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4bc679ad21a64bfe93bf64ff1b6ba3b2" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 33075 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "37897779fb894afb8129dcf5d269bd54" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 42765 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:10.423298 29876 raft_consensus.cc:493] T 5ab64e7b83584196b9e6c6d1bc634351 P 58a7cda73b3542718987bf815eed9b79 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:09:10.423806 29876 raft_consensus.cc:3060] T 5ab64e7b83584196b9e6c6d1bc634351 P 58a7cda73b3542718987bf815eed9b79 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:10.425663 29951 raft_consensus.cc:493] T f814d836f0bd46a4aa7d660d8ff4b2d5 P 4bc679ad21a64bfe93bf64ff1b6ba3b2 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:09:10.426175 29951 raft_consensus.cc:3060] T f814d836f0bd46a4aa7d660d8ff4b2d5 P 4bc679ad21a64bfe93bf64ff1b6ba3b2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:10.427561 30143 consensus_queue.cc:1048] T f814d836f0bd46a4aa7d660d8ff4b2d5 P 58a7cda73b3542718987bf815eed9b79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "37897779fb894afb8129dcf5d269bd54" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 42765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:10.428120 30117 consensus_queue.cc:1048] T 5ab64e7b83584196b9e6c6d1bc634351 P 4bc679ad21a64bfe93bf64ff1b6ba3b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "37897779fb894afb8129dcf5d269bd54" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 42765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:10.430866 29876 raft_consensus.cc:515] T 5ab64e7b83584196b9e6c6d1bc634351 P 58a7cda73b3542718987bf815eed9b79 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "58a7cda73b3542718987bf815eed9b79" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 37953 } } peers { permanent_uuid: "4bc679ad21a64bfe93bf64ff1b6ba3b2" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 33075 } } peers { permanent_uuid: "37897779fb894afb8129dcf5d269bd54" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 42765 } }
I20260709 13:09:10.440141 29951 raft_consensus.cc:515] T f814d836f0bd46a4aa7d660d8ff4b2d5 P 4bc679ad21a64bfe93bf64ff1b6ba3b2 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "58a7cda73b3542718987bf815eed9b79" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 37953 } } peers { permanent_uuid: "4bc679ad21a64bfe93bf64ff1b6ba3b2" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 33075 } } peers { permanent_uuid: "37897779fb894afb8129dcf5d269bd54" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 42765 } }
I20260709 13:09:10.444762 29877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f814d836f0bd46a4aa7d660d8ff4b2d5" candidate_uuid: "4bc679ad21a64bfe93bf64ff1b6ba3b2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "58a7cda73b3542718987bf815eed9b79"
I20260709 13:09:10.445472 29877 raft_consensus.cc:3055] T f814d836f0bd46a4aa7d660d8ff4b2d5 P 58a7cda73b3542718987bf815eed9b79 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:09:10.445822 29877 raft_consensus.cc:740] T f814d836f0bd46a4aa7d660d8ff4b2d5 P 58a7cda73b3542718987bf815eed9b79 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 58a7cda73b3542718987bf815eed9b79, State: Running, Role: LEADER
I20260709 13:09:10.446864 29877 consensus_queue.cc:260] T f814d836f0bd46a4aa7d660d8ff4b2d5 P 58a7cda73b3542718987bf815eed9b79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "58a7cda73b3542718987bf815eed9b79" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 37953 } } peers { permanent_uuid: "4bc679ad21a64bfe93bf64ff1b6ba3b2" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 33075 } } peers { permanent_uuid: "37897779fb894afb8129dcf5d269bd54" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 42765 } }
I20260709 13:09:10.448295 29877 raft_consensus.cc:3060] T f814d836f0bd46a4aa7d660d8ff4b2d5 P 58a7cda73b3542718987bf815eed9b79 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:10.454784 30136 raft_consensus.cc:993] T 8f557a35c94b4b2b917d69463fc69be9 P 37897779fb894afb8129dcf5d269bd54: : Instructing follower 58a7cda73b3542718987bf815eed9b79 to start an election
I20260709 13:09:10.455453 30136 raft_consensus.cc:1081] T 8f557a35c94b4b2b917d69463fc69be9 P 37897779fb894afb8129dcf5d269bd54 [term 1 LEADER]: Signalling peer 58a7cda73b3542718987bf815eed9b79 to start an election
I20260709 13:09:10.458072 29878 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "8f557a35c94b4b2b917d69463fc69be9"
dest_uuid: "58a7cda73b3542718987bf815eed9b79"
 from {username='slave'} at 127.0.0.1:36128
I20260709 13:09:10.458792 29878 raft_consensus.cc:493] T 8f557a35c94b4b2b917d69463fc69be9 P 58a7cda73b3542718987bf815eed9b79 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:09:10.459208 29878 raft_consensus.cc:3060] T 8f557a35c94b4b2b917d69463fc69be9 P 58a7cda73b3542718987bf815eed9b79 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:10.462014 30027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ab64e7b83584196b9e6c6d1bc634351" candidate_uuid: "58a7cda73b3542718987bf815eed9b79" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "37897779fb894afb8129dcf5d269bd54"
I20260709 13:09:10.464174 29952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ab64e7b83584196b9e6c6d1bc634351" candidate_uuid: "58a7cda73b3542718987bf815eed9b79" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "4bc679ad21a64bfe93bf64ff1b6ba3b2"
I20260709 13:09:10.464565 29951 leader_election.cc:290] T f814d836f0bd46a4aa7d660d8ff4b2d5 P 4bc679ad21a64bfe93bf64ff1b6ba3b2 [CANDIDATE]: Term 2 election: Requested vote from peers 58a7cda73b3542718987bf815eed9b79 (127.17.223.1:37953), 37897779fb894afb8129dcf5d269bd54 (127.17.223.3:42765)
I20260709 13:09:10.464847 29952 raft_consensus.cc:3055] T 5ab64e7b83584196b9e6c6d1bc634351 P 4bc679ad21a64bfe93bf64ff1b6ba3b2 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:09:10.465219 29952 raft_consensus.cc:740] T 5ab64e7b83584196b9e6c6d1bc634351 P 4bc679ad21a64bfe93bf64ff1b6ba3b2 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 4bc679ad21a64bfe93bf64ff1b6ba3b2, State: Running, Role: LEADER
I20260709 13:09:10.466773 30025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f814d836f0bd46a4aa7d660d8ff4b2d5" candidate_uuid: "4bc679ad21a64bfe93bf64ff1b6ba3b2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "37897779fb894afb8129dcf5d269bd54"
I20260709 13:09:10.466704 29952 consensus_queue.cc:260] T 5ab64e7b83584196b9e6c6d1bc634351 P 4bc679ad21a64bfe93bf64ff1b6ba3b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "58a7cda73b3542718987bf815eed9b79" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 37953 } } peers { permanent_uuid: "4bc679ad21a64bfe93bf64ff1b6ba3b2" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 33075 } } peers { permanent_uuid: "37897779fb894afb8129dcf5d269bd54" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 42765 } }
I20260709 13:09:10.467499 30025 raft_consensus.cc:3060] T f814d836f0bd46a4aa7d660d8ff4b2d5 P 37897779fb894afb8129dcf5d269bd54 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:10.467823 29952 raft_consensus.cc:3060] T 5ab64e7b83584196b9e6c6d1bc634351 P 4bc679ad21a64bfe93bf64ff1b6ba3b2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:10.470376 29877 raft_consensus.cc:2468] T f814d836f0bd46a4aa7d660d8ff4b2d5 P 58a7cda73b3542718987bf815eed9b79 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4bc679ad21a64bfe93bf64ff1b6ba3b2 in term 2.
I20260709 13:09:10.462005 29876 leader_election.cc:290] T 5ab64e7b83584196b9e6c6d1bc634351 P 58a7cda73b3542718987bf815eed9b79 [CANDIDATE]: Term 2 election: Requested vote from peers 4bc679ad21a64bfe93bf64ff1b6ba3b2 (127.17.223.2:33075), 37897779fb894afb8129dcf5d269bd54 (127.17.223.3:42765)
I20260709 13:09:10.471904 29919 leader_election.cc:304] T f814d836f0bd46a4aa7d660d8ff4b2d5 P 4bc679ad21a64bfe93bf64ff1b6ba3b2 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4bc679ad21a64bfe93bf64ff1b6ba3b2, 58a7cda73b3542718987bf815eed9b79; no voters: 
I20260709 13:09:10.473039 30076 raft_consensus.cc:2804] T f814d836f0bd46a4aa7d660d8ff4b2d5 P 4bc679ad21a64bfe93bf64ff1b6ba3b2 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:09:10.473592 30076 raft_consensus.cc:697] T f814d836f0bd46a4aa7d660d8ff4b2d5 P 4bc679ad21a64bfe93bf64ff1b6ba3b2 [term 2 LEADER]: Becoming Leader. State: Replica: 4bc679ad21a64bfe93bf64ff1b6ba3b2, State: Running, Role: LEADER
I20260709 13:09:10.474545 30076 consensus_queue.cc:237] T f814d836f0bd46a4aa7d660d8ff4b2d5 P 4bc679ad21a64bfe93bf64ff1b6ba3b2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "58a7cda73b3542718987bf815eed9b79" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 37953 } } peers { permanent_uuid: "4bc679ad21a64bfe93bf64ff1b6ba3b2" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 33075 } } peers { permanent_uuid: "37897779fb894afb8129dcf5d269bd54" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 42765 } }
I20260709 13:09:10.475796 29952 raft_consensus.cc:2468] T 5ab64e7b83584196b9e6c6d1bc634351 P 4bc679ad21a64bfe93bf64ff1b6ba3b2 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 58a7cda73b3542718987bf815eed9b79 in term 2.
I20260709 13:09:10.474967 29878 raft_consensus.cc:515] T 8f557a35c94b4b2b917d69463fc69be9 P 58a7cda73b3542718987bf815eed9b79 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "58a7cda73b3542718987bf815eed9b79" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 37953 } } peers { permanent_uuid: "4bc679ad21a64bfe93bf64ff1b6ba3b2" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 33075 } } peers { permanent_uuid: "37897779fb894afb8129dcf5d269bd54" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 42765 } }
I20260709 13:09:10.477505 29842 leader_election.cc:304] T 5ab64e7b83584196b9e6c6d1bc634351 P 58a7cda73b3542718987bf815eed9b79 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4bc679ad21a64bfe93bf64ff1b6ba3b2, 58a7cda73b3542718987bf815eed9b79; no voters: 37897779fb894afb8129dcf5d269bd54
I20260709 13:09:10.479672 29878 leader_election.cc:290] T 8f557a35c94b4b2b917d69463fc69be9 P 58a7cda73b3542718987bf815eed9b79 [CANDIDATE]: Term 2 election: Requested vote from peers 4bc679ad21a64bfe93bf64ff1b6ba3b2 (127.17.223.2:33075), 37897779fb894afb8129dcf5d269bd54 (127.17.223.3:42765)
I20260709 13:09:10.479192 30026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f557a35c94b4b2b917d69463fc69be9" candidate_uuid: "58a7cda73b3542718987bf815eed9b79" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "37897779fb894afb8129dcf5d269bd54"
I20260709 13:09:10.480368 30143 raft_consensus.cc:2804] T 5ab64e7b83584196b9e6c6d1bc634351 P 58a7cda73b3542718987bf815eed9b79 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:09:10.480755 30026 raft_consensus.cc:3055] T 8f557a35c94b4b2b917d69463fc69be9 P 37897779fb894afb8129dcf5d269bd54 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:09:10.480855 30143 raft_consensus.cc:697] T 5ab64e7b83584196b9e6c6d1bc634351 P 58a7cda73b3542718987bf815eed9b79 [term 2 LEADER]: Becoming Leader. State: Replica: 58a7cda73b3542718987bf815eed9b79, State: Running, Role: LEADER
I20260709 13:09:10.481282 30026 raft_consensus.cc:740] T 8f557a35c94b4b2b917d69463fc69be9 P 37897779fb894afb8129dcf5d269bd54 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 37897779fb894afb8129dcf5d269bd54, State: Running, Role: LEADER
I20260709 13:09:10.481997 30143 consensus_queue.cc:237] T 5ab64e7b83584196b9e6c6d1bc634351 P 58a7cda73b3542718987bf815eed9b79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "58a7cda73b3542718987bf815eed9b79" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 37953 } } peers { permanent_uuid: "4bc679ad21a64bfe93bf64ff1b6ba3b2" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 33075 } } peers { permanent_uuid: "37897779fb894afb8129dcf5d269bd54" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 42765 } }
I20260709 13:09:10.482143 30026 consensus_queue.cc:260] T 8f557a35c94b4b2b917d69463fc69be9 P 37897779fb894afb8129dcf5d269bd54 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "58a7cda73b3542718987bf815eed9b79" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 37953 } } peers { permanent_uuid: "4bc679ad21a64bfe93bf64ff1b6ba3b2" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 33075 } } peers { permanent_uuid: "37897779fb894afb8129dcf5d269bd54" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 42765 } }
I20260709 13:09:10.480922 30025 raft_consensus.cc:2468] T f814d836f0bd46a4aa7d660d8ff4b2d5 P 37897779fb894afb8129dcf5d269bd54 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4bc679ad21a64bfe93bf64ff1b6ba3b2 in term 2.
I20260709 13:09:10.484377 30026 raft_consensus.cc:3060] T 8f557a35c94b4b2b917d69463fc69be9 P 37897779fb894afb8129dcf5d269bd54 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:10.486310 29952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f557a35c94b4b2b917d69463fc69be9" candidate_uuid: "58a7cda73b3542718987bf815eed9b79" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "4bc679ad21a64bfe93bf64ff1b6ba3b2"
I20260709 13:09:10.487030 29952 raft_consensus.cc:3060] T 8f557a35c94b4b2b917d69463fc69be9 P 4bc679ad21a64bfe93bf64ff1b6ba3b2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:10.492408 30026 raft_consensus.cc:2468] T 8f557a35c94b4b2b917d69463fc69be9 P 37897779fb894afb8129dcf5d269bd54 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 58a7cda73b3542718987bf815eed9b79 in term 2.
I20260709 13:09:10.493755 29841 leader_election.cc:304] T 8f557a35c94b4b2b917d69463fc69be9 P 58a7cda73b3542718987bf815eed9b79 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 37897779fb894afb8129dcf5d269bd54, 58a7cda73b3542718987bf815eed9b79; no voters: 
I20260709 13:09:10.494626 30143 raft_consensus.cc:2804] T 8f557a35c94b4b2b917d69463fc69be9 P 58a7cda73b3542718987bf815eed9b79 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:09:10.495375 30143 raft_consensus.cc:697] T 8f557a35c94b4b2b917d69463fc69be9 P 58a7cda73b3542718987bf815eed9b79 [term 2 LEADER]: Becoming Leader. State: Replica: 58a7cda73b3542718987bf815eed9b79, State: Running, Role: LEADER
I20260709 13:09:10.494758 29774 catalog_manager.cc:5697] T f814d836f0bd46a4aa7d660d8ff4b2d5 P 4bc679ad21a64bfe93bf64ff1b6ba3b2 reported cstate change: term changed from 1 to 2, leader changed from 58a7cda73b3542718987bf815eed9b79 (127.17.223.1) to 4bc679ad21a64bfe93bf64ff1b6ba3b2 (127.17.223.2). New cstate: current_term: 2 leader_uuid: "4bc679ad21a64bfe93bf64ff1b6ba3b2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "58a7cda73b3542718987bf815eed9b79" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 37953 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4bc679ad21a64bfe93bf64ff1b6ba3b2" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 33075 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "37897779fb894afb8129dcf5d269bd54" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 42765 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:10.495887 29952 raft_consensus.cc:2468] T 8f557a35c94b4b2b917d69463fc69be9 P 4bc679ad21a64bfe93bf64ff1b6ba3b2 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 58a7cda73b3542718987bf815eed9b79 in term 2.
I20260709 13:09:10.496268 30143 consensus_queue.cc:237] T 8f557a35c94b4b2b917d69463fc69be9 P 58a7cda73b3542718987bf815eed9b79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "58a7cda73b3542718987bf815eed9b79" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 37953 } } peers { permanent_uuid: "4bc679ad21a64bfe93bf64ff1b6ba3b2" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 33075 } } peers { permanent_uuid: "37897779fb894afb8129dcf5d269bd54" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 42765 } }
I20260709 13:09:10.496034 29773 catalog_manager.cc:5697] T 5ab64e7b83584196b9e6c6d1bc634351 P 58a7cda73b3542718987bf815eed9b79 reported cstate change: term changed from 1 to 2, leader changed from 4bc679ad21a64bfe93bf64ff1b6ba3b2 (127.17.223.2) to 58a7cda73b3542718987bf815eed9b79 (127.17.223.1). New cstate: current_term: 2 leader_uuid: "58a7cda73b3542718987bf815eed9b79" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "58a7cda73b3542718987bf815eed9b79" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 37953 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4bc679ad21a64bfe93bf64ff1b6ba3b2" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 33075 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "37897779fb894afb8129dcf5d269bd54" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 42765 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:10.509151 30143 consensus_queue.cc:1048] T 59abb803b8ce4d28967bf12c46d66c0d P 58a7cda73b3542718987bf815eed9b79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4bc679ad21a64bfe93bf64ff1b6ba3b2" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 33075 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:10.511699 29776 catalog_manager.cc:5697] T 8f557a35c94b4b2b917d69463fc69be9 P 58a7cda73b3542718987bf815eed9b79 reported cstate change: term changed from 1 to 2, leader changed from 37897779fb894afb8129dcf5d269bd54 (127.17.223.3) to 58a7cda73b3542718987bf815eed9b79 (127.17.223.1). New cstate: current_term: 2 leader_uuid: "58a7cda73b3542718987bf815eed9b79" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "58a7cda73b3542718987bf815eed9b79" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 37953 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4bc679ad21a64bfe93bf64ff1b6ba3b2" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 33075 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "37897779fb894afb8129dcf5d269bd54" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 42765 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:10.521368 30073 consensus_queue.cc:1048] T 59abb803b8ce4d28967bf12c46d66c0d P 58a7cda73b3542718987bf815eed9b79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "37897779fb894afb8129dcf5d269bd54" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 42765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:09:10.536859 30073 raft_consensus.cc:993] T 59abb803b8ce4d28967bf12c46d66c0d P 58a7cda73b3542718987bf815eed9b79: : Instructing follower 37897779fb894afb8129dcf5d269bd54 to start an election
I20260709 13:09:10.537374 30143 raft_consensus.cc:1081] T 59abb803b8ce4d28967bf12c46d66c0d P 58a7cda73b3542718987bf815eed9b79 [term 1 LEADER]: Signalling peer 37897779fb894afb8129dcf5d269bd54 to start an election
I20260709 13:09:10.538924 30026 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "59abb803b8ce4d28967bf12c46d66c0d"
dest_uuid: "37897779fb894afb8129dcf5d269bd54"
 from {username='slave'} at 127.0.0.1:58216
I20260709 13:09:10.539480 30026 raft_consensus.cc:493] T 59abb803b8ce4d28967bf12c46d66c0d P 37897779fb894afb8129dcf5d269bd54 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:09:10.539852 30026 raft_consensus.cc:3060] T 59abb803b8ce4d28967bf12c46d66c0d P 37897779fb894afb8129dcf5d269bd54 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:10.544824 30026 raft_consensus.cc:515] T 59abb803b8ce4d28967bf12c46d66c0d P 37897779fb894afb8129dcf5d269bd54 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "58a7cda73b3542718987bf815eed9b79" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 37953 } } peers { permanent_uuid: "4bc679ad21a64bfe93bf64ff1b6ba3b2" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 33075 } } peers { permanent_uuid: "37897779fb894afb8129dcf5d269bd54" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 42765 } }
I20260709 13:09:10.546630 30026 leader_election.cc:290] T 59abb803b8ce4d28967bf12c46d66c0d P 37897779fb894afb8129dcf5d269bd54 [CANDIDATE]: Term 2 election: Requested vote from peers 58a7cda73b3542718987bf815eed9b79 (127.17.223.1:37953), 4bc679ad21a64bfe93bf64ff1b6ba3b2 (127.17.223.2:33075)
I20260709 13:09:10.547765 29878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59abb803b8ce4d28967bf12c46d66c0d" candidate_uuid: "37897779fb894afb8129dcf5d269bd54" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "58a7cda73b3542718987bf815eed9b79"
I20260709 13:09:10.548264 29952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59abb803b8ce4d28967bf12c46d66c0d" candidate_uuid: "37897779fb894afb8129dcf5d269bd54" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "4bc679ad21a64bfe93bf64ff1b6ba3b2"
I20260709 13:09:10.548429 29878 raft_consensus.cc:3055] T 59abb803b8ce4d28967bf12c46d66c0d P 58a7cda73b3542718987bf815eed9b79 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:09:10.548722 29952 raft_consensus.cc:3060] T 59abb803b8ce4d28967bf12c46d66c0d P 4bc679ad21a64bfe93bf64ff1b6ba3b2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:10.548849 29878 raft_consensus.cc:740] T 59abb803b8ce4d28967bf12c46d66c0d P 58a7cda73b3542718987bf815eed9b79 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 58a7cda73b3542718987bf815eed9b79, State: Running, Role: LEADER
I20260709 13:09:10.549763 29878 consensus_queue.cc:260] T 59abb803b8ce4d28967bf12c46d66c0d P 58a7cda73b3542718987bf815eed9b79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "58a7cda73b3542718987bf815eed9b79" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 37953 } } peers { permanent_uuid: "4bc679ad21a64bfe93bf64ff1b6ba3b2" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 33075 } } peers { permanent_uuid: "37897779fb894afb8129dcf5d269bd54" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 42765 } }
I20260709 13:09:10.550882 29878 raft_consensus.cc:3060] T 59abb803b8ce4d28967bf12c46d66c0d P 58a7cda73b3542718987bf815eed9b79 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:10.555138 29952 raft_consensus.cc:2468] T 59abb803b8ce4d28967bf12c46d66c0d P 4bc679ad21a64bfe93bf64ff1b6ba3b2 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 37897779fb894afb8129dcf5d269bd54 in term 2.
I20260709 13:09:10.556324 29991 leader_election.cc:304] T 59abb803b8ce4d28967bf12c46d66c0d P 37897779fb894afb8129dcf5d269bd54 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 37897779fb894afb8129dcf5d269bd54, 4bc679ad21a64bfe93bf64ff1b6ba3b2; no voters: 
I20260709 13:09:10.556324 29878 raft_consensus.cc:2468] T 59abb803b8ce4d28967bf12c46d66c0d P 58a7cda73b3542718987bf815eed9b79 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 37897779fb894afb8129dcf5d269bd54 in term 2.
I20260709 13:09:10.557363 30075 raft_consensus.cc:2804] T 59abb803b8ce4d28967bf12c46d66c0d P 37897779fb894afb8129dcf5d269bd54 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:09:10.557864 30075 raft_consensus.cc:697] T 59abb803b8ce4d28967bf12c46d66c0d P 37897779fb894afb8129dcf5d269bd54 [term 2 LEADER]: Becoming Leader. State: Replica: 37897779fb894afb8129dcf5d269bd54, State: Running, Role: LEADER
I20260709 13:09:10.558663 30075 consensus_queue.cc:237] T 59abb803b8ce4d28967bf12c46d66c0d P 37897779fb894afb8129dcf5d269bd54 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "58a7cda73b3542718987bf815eed9b79" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 37953 } } peers { permanent_uuid: "4bc679ad21a64bfe93bf64ff1b6ba3b2" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 33075 } } peers { permanent_uuid: "37897779fb894afb8129dcf5d269bd54" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 42765 } }
I20260709 13:09:10.602880 29776 catalog_manager.cc:5697] T 59abb803b8ce4d28967bf12c46d66c0d P 37897779fb894afb8129dcf5d269bd54 reported cstate change: term changed from 1 to 2, leader changed from 58a7cda73b3542718987bf815eed9b79 (127.17.223.1) to 37897779fb894afb8129dcf5d269bd54 (127.17.223.3). New cstate: current_term: 2 leader_uuid: "37897779fb894afb8129dcf5d269bd54" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "58a7cda73b3542718987bf815eed9b79" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 37953 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4bc679ad21a64bfe93bf64ff1b6ba3b2" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 33075 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "37897779fb894afb8129dcf5d269bd54" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 42765 } health_report { overall_health: HEALTHY } } }
I20260709 13:09:10.684762 30026 raft_consensus.cc:1275] T e347ac4792b04c198fb6829a4a87078b P 37897779fb894afb8129dcf5d269bd54 [term 2 FOLLOWER]: Refusing update from remote peer 58a7cda73b3542718987bf815eed9b79: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:10.686396 30143 consensus_queue.cc:1048] T e347ac4792b04c198fb6829a4a87078b P 58a7cda73b3542718987bf815eed9b79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "37897779fb894afb8129dcf5d269bd54" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 42765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:09:10.702919 29952 raft_consensus.cc:1275] T e347ac4792b04c198fb6829a4a87078b P 4bc679ad21a64bfe93bf64ff1b6ba3b2 [term 2 FOLLOWER]: Refusing update from remote peer 58a7cda73b3542718987bf815eed9b79: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:10.705392 30143 consensus_queue.cc:1048] T e347ac4792b04c198fb6829a4a87078b P 58a7cda73b3542718987bf815eed9b79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4bc679ad21a64bfe93bf64ff1b6ba3b2" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 33075 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:09:10.841605 29878 raft_consensus.cc:1275] T 968909b990764b0c8c388a63060c8130 P 58a7cda73b3542718987bf815eed9b79 [term 2 FOLLOWER]: Refusing update from remote peer 4bc679ad21a64bfe93bf64ff1b6ba3b2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:10.843357 30103 consensus_queue.cc:1048] T 968909b990764b0c8c388a63060c8130 P 4bc679ad21a64bfe93bf64ff1b6ba3b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "58a7cda73b3542718987bf815eed9b79" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 37953 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:09:10.843573 30026 raft_consensus.cc:1275] T 968909b990764b0c8c388a63060c8130 P 37897779fb894afb8129dcf5d269bd54 [term 2 FOLLOWER]: Refusing update from remote peer 4bc679ad21a64bfe93bf64ff1b6ba3b2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:10.845162 30103 consensus_queue.cc:1048] T 968909b990764b0c8c388a63060c8130 P 4bc679ad21a64bfe93bf64ff1b6ba3b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "37897779fb894afb8129dcf5d269bd54" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 42765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:09:10.870303 29952 raft_consensus.cc:1275] T 6d4b64688b8949c89f8f7b7aa871efed P 4bc679ad21a64bfe93bf64ff1b6ba3b2 [term 2 FOLLOWER]: Refusing update from remote peer 58a7cda73b3542718987bf815eed9b79: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:10.871572 30143 consensus_queue.cc:1048] T 6d4b64688b8949c89f8f7b7aa871efed P 58a7cda73b3542718987bf815eed9b79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4bc679ad21a64bfe93bf64ff1b6ba3b2" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 33075 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:09:10.881897 30026 raft_consensus.cc:1275] T 6d4b64688b8949c89f8f7b7aa871efed P 37897779fb894afb8129dcf5d269bd54 [term 2 FOLLOWER]: Refusing update from remote peer 58a7cda73b3542718987bf815eed9b79: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:10.883539 30144 consensus_queue.cc:1048] T 6d4b64688b8949c89f8f7b7aa871efed P 58a7cda73b3542718987bf815eed9b79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "37897779fb894afb8129dcf5d269bd54" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 42765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:09:10.927103 29878 raft_consensus.cc:1275] T f814d836f0bd46a4aa7d660d8ff4b2d5 P 58a7cda73b3542718987bf815eed9b79 [term 2 FOLLOWER]: Refusing update from remote peer 4bc679ad21a64bfe93bf64ff1b6ba3b2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:10.928462 30117 consensus_queue.cc:1048] T f814d836f0bd46a4aa7d660d8ff4b2d5 P 4bc679ad21a64bfe93bf64ff1b6ba3b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "58a7cda73b3542718987bf815eed9b79" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 37953 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:09:10.932670 29876 raft_consensus.cc:1275] T bb9da524d5b84f09b0c5853761aa5886 P 58a7cda73b3542718987bf815eed9b79 [term 2 FOLLOWER]: Refusing update from remote peer 4bc679ad21a64bfe93bf64ff1b6ba3b2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:10.934382 30117 consensus_queue.cc:1048] T bb9da524d5b84f09b0c5853761aa5886 P 4bc679ad21a64bfe93bf64ff1b6ba3b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "58a7cda73b3542718987bf815eed9b79" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 37953 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:09:10.941547 30026 raft_consensus.cc:1275] T f814d836f0bd46a4aa7d660d8ff4b2d5 P 37897779fb894afb8129dcf5d269bd54 [term 2 FOLLOWER]: Refusing update from remote peer 4bc679ad21a64bfe93bf64ff1b6ba3b2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:10.943200 30076 consensus_queue.cc:1048] T f814d836f0bd46a4aa7d660d8ff4b2d5 P 4bc679ad21a64bfe93bf64ff1b6ba3b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "37897779fb894afb8129dcf5d269bd54" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 42765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:09:10.948452 30025 raft_consensus.cc:1275] T bb9da524d5b84f09b0c5853761aa5886 P 37897779fb894afb8129dcf5d269bd54 [term 2 FOLLOWER]: Refusing update from remote peer 4bc679ad21a64bfe93bf64ff1b6ba3b2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:10.954006 30153 consensus_queue.cc:1048] T bb9da524d5b84f09b0c5853761aa5886 P 4bc679ad21a64bfe93bf64ff1b6ba3b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "37897779fb894afb8129dcf5d269bd54" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 42765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:09:10.954932 29952 raft_consensus.cc:1275] T 8f557a35c94b4b2b917d69463fc69be9 P 4bc679ad21a64bfe93bf64ff1b6ba3b2 [term 2 FOLLOWER]: Refusing update from remote peer 58a7cda73b3542718987bf815eed9b79: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:10.956617 30144 consensus_queue.cc:1048] T 8f557a35c94b4b2b917d69463fc69be9 P 58a7cda73b3542718987bf815eed9b79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4bc679ad21a64bfe93bf64ff1b6ba3b2" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 33075 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:09:10.971356 30026 raft_consensus.cc:1275] T 8f557a35c94b4b2b917d69463fc69be9 P 37897779fb894afb8129dcf5d269bd54 [term 2 FOLLOWER]: Refusing update from remote peer 58a7cda73b3542718987bf815eed9b79: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:10.976225 30073 consensus_queue.cc:1048] T 8f557a35c94b4b2b917d69463fc69be9 P 58a7cda73b3542718987bf815eed9b79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "37897779fb894afb8129dcf5d269bd54" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 42765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:09:10.987012 30026 raft_consensus.cc:3060] T 5ab64e7b83584196b9e6c6d1bc634351 P 37897779fb894afb8129dcf5d269bd54 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:10.997627 30026 raft_consensus.cc:1275] T 5ab64e7b83584196b9e6c6d1bc634351 P 37897779fb894afb8129dcf5d269bd54 [term 2 FOLLOWER]: Refusing update from remote peer 58a7cda73b3542718987bf815eed9b79: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:11.001832 30144 consensus_queue.cc:1048] T 5ab64e7b83584196b9e6c6d1bc634351 P 58a7cda73b3542718987bf815eed9b79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "37897779fb894afb8129dcf5d269bd54" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 42765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:09:11.014493 29952 raft_consensus.cc:1275] T 5ab64e7b83584196b9e6c6d1bc634351 P 4bc679ad21a64bfe93bf64ff1b6ba3b2 [term 2 FOLLOWER]: Refusing update from remote peer 58a7cda73b3542718987bf815eed9b79: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:11.017099 30144 consensus_queue.cc:1048] T 5ab64e7b83584196b9e6c6d1bc634351 P 58a7cda73b3542718987bf815eed9b79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4bc679ad21a64bfe93bf64ff1b6ba3b2" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 33075 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:09:11.072563 29952 raft_consensus.cc:1275] T 59abb803b8ce4d28967bf12c46d66c0d P 4bc679ad21a64bfe93bf64ff1b6ba3b2 [term 2 FOLLOWER]: Refusing update from remote peer 37897779fb894afb8129dcf5d269bd54: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:11.074226 30075 consensus_queue.cc:1048] T 59abb803b8ce4d28967bf12c46d66c0d P 37897779fb894afb8129dcf5d269bd54 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4bc679ad21a64bfe93bf64ff1b6ba3b2" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 33075 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:09:11.095211 29878 raft_consensus.cc:1275] T 59abb803b8ce4d28967bf12c46d66c0d P 58a7cda73b3542718987bf815eed9b79 [term 2 FOLLOWER]: Refusing update from remote peer 37897779fb894afb8129dcf5d269bd54: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:11.097146 30155 consensus_queue.cc:1048] T 59abb803b8ce4d28967bf12c46d66c0d P 37897779fb894afb8129dcf5d269bd54 [LEADER]: Connected to new peer: Peer: permanent_uuid: "58a7cda73b3542718987bf815eed9b79" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 37953 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:09:13.214838 29774 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47206:
name: "soft_deleted_table"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q""\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:09:13.218060 29774 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table soft_deleted_table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:09:13.268563 29861 tablet_service.cc:1511] Processing CreateTablet for tablet 40017481861c42efa46273995f000081 (DEFAULT_TABLE table=soft_deleted_table [id=11782eedd8bc47698011ca881498b05e]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:09:13.270512 29861 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 40017481861c42efa46273995f000081. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:13.270166 29936 tablet_service.cc:1511] Processing CreateTablet for tablet 40017481861c42efa46273995f000081 (DEFAULT_TABLE table=soft_deleted_table [id=11782eedd8bc47698011ca881498b05e]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:09:13.271533 30012 tablet_service.cc:1511] Processing CreateTablet for tablet 40017481861c42efa46273995f000081 (DEFAULT_TABLE table=soft_deleted_table [id=11782eedd8bc47698011ca881498b05e]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:09:13.272028 29936 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 40017481861c42efa46273995f000081. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:13.273172 30012 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 40017481861c42efa46273995f000081. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:13.275974 29937 tablet_service.cc:1511] Processing CreateTablet for tablet 797710d1534045c3a8597c9800a09ea6 (DEFAULT_TABLE table=soft_deleted_table [id=11782eedd8bc47698011ca881498b05e]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:09:13.277505 29937 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 797710d1534045c3a8597c9800a09ea6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:13.280965 29862 tablet_service.cc:1511] Processing CreateTablet for tablet 797710d1534045c3a8597c9800a09ea6 (DEFAULT_TABLE table=soft_deleted_table [id=11782eedd8bc47698011ca881498b05e]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:09:13.282469 29862 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 797710d1534045c3a8597c9800a09ea6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:13.283970 29868 tablet_service.cc:1511] Processing CreateTablet for tablet ea945f01fa404ea29878b0cd26af4e1e (DEFAULT_TABLE table=soft_deleted_table [id=11782eedd8bc47698011ca881498b05e]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:09:13.290867 29868 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ea945f01fa404ea29878b0cd26af4e1e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:13.291175 30013 tablet_service.cc:1511] Processing CreateTablet for tablet ea945f01fa404ea29878b0cd26af4e1e (DEFAULT_TABLE table=soft_deleted_table [id=11782eedd8bc47698011ca881498b05e]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:09:13.292634 30013 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ea945f01fa404ea29878b0cd26af4e1e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:13.292963 29942 tablet_service.cc:1511] Processing CreateTablet for tablet d8a815244f7c485b980dfa0adb0fd2a9 (DEFAULT_TABLE table=soft_deleted_table [id=11782eedd8bc47698011ca881498b05e]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:09:13.294303 29942 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d8a815244f7c485b980dfa0adb0fd2a9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:13.284749 29940 tablet_service.cc:1511] Processing CreateTablet for tablet ea945f01fa404ea29878b0cd26af4e1e (DEFAULT_TABLE table=soft_deleted_table [id=11782eedd8bc47698011ca881498b05e]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:09:13.296852 29866 tablet_service.cc:1511] Processing CreateTablet for tablet 2351aaf3431e4d18906f7f7fa8bb4f5c (DEFAULT_TABLE table=soft_deleted_table [id=11782eedd8bc47698011ca881498b05e]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:09:13.298328 29866 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2351aaf3431e4d18906f7f7fa8bb4f5c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:13.291227 29863 tablet_service.cc:1511] Processing CreateTablet for tablet d8a815244f7c485b980dfa0adb0fd2a9 (DEFAULT_TABLE table=soft_deleted_table [id=11782eedd8bc47698011ca881498b05e]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:09:13.300835 30014 tablet_service.cc:1511] Processing CreateTablet for tablet d8a815244f7c485b980dfa0adb0fd2a9 (DEFAULT_TABLE table=soft_deleted_table [id=11782eedd8bc47698011ca881498b05e]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:09:13.302243 30014 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d8a815244f7c485b980dfa0adb0fd2a9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:13.304121 29941 tablet_service.cc:1511] Processing CreateTablet for tablet 2351aaf3431e4d18906f7f7fa8bb4f5c (DEFAULT_TABLE table=soft_deleted_table [id=11782eedd8bc47698011ca881498b05e]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:09:13.286386 30017 tablet_service.cc:1511] Processing CreateTablet for tablet 797710d1534045c3a8597c9800a09ea6 (DEFAULT_TABLE table=soft_deleted_table [id=11782eedd8bc47698011ca881498b05e]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:09:13.305025 29864 tablet_service.cc:1511] Processing CreateTablet for tablet fa4b1db9a2d44d45bc9935975428592e (DEFAULT_TABLE table=soft_deleted_table [id=11782eedd8bc47698011ca881498b05e]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:09:13.307317 29938 tablet_service.cc:1511] Processing CreateTablet for tablet fa4b1db9a2d44d45bc9935975428592e (DEFAULT_TABLE table=soft_deleted_table [id=11782eedd8bc47698011ca881498b05e]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:09:13.309749 30015 tablet_service.cc:1511] Processing CreateTablet for tablet 2351aaf3431e4d18906f7f7fa8bb4f5c (DEFAULT_TABLE table=soft_deleted_table [id=11782eedd8bc47698011ca881498b05e]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:09:13.313182 29867 tablet_service.cc:1511] Processing CreateTablet for tablet 5ccb587267a8414180b1f5474e4e2728 (DEFAULT_TABLE table=soft_deleted_table [id=11782eedd8bc47698011ca881498b05e]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:09:13.314577 30016 tablet_service.cc:1511] Processing CreateTablet for tablet fa4b1db9a2d44d45bc9935975428592e (DEFAULT_TABLE table=soft_deleted_table [id=11782eedd8bc47698011ca881498b05e]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:09:13.317276 29938 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fa4b1db9a2d44d45bc9935975428592e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:13.317992 30017 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 797710d1534045c3a8597c9800a09ea6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:13.319144 30015 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2351aaf3431e4d18906f7f7fa8bb4f5c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:13.319314 29939 tablet_service.cc:1511] Processing CreateTablet for tablet 5ccb587267a8414180b1f5474e4e2728 (DEFAULT_TABLE table=soft_deleted_table [id=11782eedd8bc47698011ca881498b05e]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:09:13.319857 29940 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ea945f01fa404ea29878b0cd26af4e1e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:13.320745 29939 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5ccb587267a8414180b1f5474e4e2728. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:13.321233 30016 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fa4b1db9a2d44d45bc9935975428592e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:13.331079 29863 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d8a815244f7c485b980dfa0adb0fd2a9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:13.332505 30010 tablet_service.cc:1511] Processing CreateTablet for tablet 5ccb587267a8414180b1f5474e4e2728 (DEFAULT_TABLE table=soft_deleted_table [id=11782eedd8bc47698011ca881498b05e]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:09:13.333985 30010 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5ccb587267a8414180b1f5474e4e2728. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:13.335055 29867 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5ccb587267a8414180b1f5474e4e2728. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:13.339071 29864 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fa4b1db9a2d44d45bc9935975428592e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:13.345546 29865 tablet_service.cc:1511] Processing CreateTablet for tablet 273ea248a58742f998fd8e9dc55097fc (DEFAULT_TABLE table=soft_deleted_table [id=11782eedd8bc47698011ca881498b05e]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:09:13.346748 29941 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2351aaf3431e4d18906f7f7fa8bb4f5c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:13.347054 29865 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 273ea248a58742f998fd8e9dc55097fc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:13.361299 29943 tablet_service.cc:1511] Processing CreateTablet for tablet 273ea248a58742f998fd8e9dc55097fc (DEFAULT_TABLE table=soft_deleted_table [id=11782eedd8bc47698011ca881498b05e]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:09:13.363741 29943 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 273ea248a58742f998fd8e9dc55097fc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:13.377310 30009 tablet_service.cc:1511] Processing CreateTablet for tablet 273ea248a58742f998fd8e9dc55097fc (DEFAULT_TABLE table=soft_deleted_table [id=11782eedd8bc47698011ca881498b05e]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:09:13.379205 30009 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 273ea248a58742f998fd8e9dc55097fc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:13.379902 30169 tablet_bootstrap.cc:492] T 40017481861c42efa46273995f000081 P 4bc679ad21a64bfe93bf64ff1b6ba3b2: Bootstrap starting.
I20260709 13:09:13.442022 30172 tablet_bootstrap.cc:492] T 40017481861c42efa46273995f000081 P 58a7cda73b3542718987bf815eed9b79: Bootstrap starting.
I20260709 13:09:13.443215 29860 tablet_service.cc:1511] Processing CreateTablet for tablet d90287f9e65f48c9b8ebdcaf7fe0dde2 (DEFAULT_TABLE table=soft_deleted_table [id=11782eedd8bc47698011ca881498b05e]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:09:13.444645 29860 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d90287f9e65f48c9b8ebdcaf7fe0dde2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:13.442060 29936 tablet_service.cc:1511] Processing CreateTablet for tablet d90287f9e65f48c9b8ebdcaf7fe0dde2 (DEFAULT_TABLE table=soft_deleted_table [id=11782eedd8bc47698011ca881498b05e]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:09:13.449019 29936 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d90287f9e65f48c9b8ebdcaf7fe0dde2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:13.451217 30171 tablet_bootstrap.cc:492] T d8a815244f7c485b980dfa0adb0fd2a9 P 37897779fb894afb8129dcf5d269bd54: Bootstrap starting.
I20260709 13:09:13.462095 30013 tablet_service.cc:1511] Processing CreateTablet for tablet d90287f9e65f48c9b8ebdcaf7fe0dde2 (DEFAULT_TABLE table=soft_deleted_table [id=11782eedd8bc47698011ca881498b05e]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:09:13.463551 30013 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d90287f9e65f48c9b8ebdcaf7fe0dde2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:13.465988 30169 tablet_bootstrap.cc:654] T 40017481861c42efa46273995f000081 P 4bc679ad21a64bfe93bf64ff1b6ba3b2: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:13.472210 30172 tablet_bootstrap.cc:654] T 40017481861c42efa46273995f000081 P 58a7cda73b3542718987bf815eed9b79: Neither blocks nor log segments found. Creating new log.
W20260709 13:09:13.467041 29919 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.1:37953, user_credentials={real_user=slave}} blocked reactor thread for 86336.1us
I20260709 13:09:13.533242 30171 tablet_bootstrap.cc:654] T d8a815244f7c485b980dfa0adb0fd2a9 P 37897779fb894afb8129dcf5d269bd54: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:13.540185 30172 tablet_bootstrap.cc:492] T 40017481861c42efa46273995f000081 P 58a7cda73b3542718987bf815eed9b79: No bootstrap required, opened a new log
I20260709 13:09:13.540895 30172 ts_tablet_manager.cc:1403] T 40017481861c42efa46273995f000081 P 58a7cda73b3542718987bf815eed9b79: Time spent bootstrapping tablet: real 0.099s	user 0.012s	sys 0.005s
I20260709 13:09:13.539002 30169 tablet_bootstrap.cc:492] T 40017481861c42efa46273995f000081 P 4bc679ad21a64bfe93bf64ff1b6ba3b2: No bootstrap required, opened a new log
I20260709 13:09:13.543056 30169 ts_tablet_manager.cc:1403] T 40017481861c42efa46273995f000081 P 4bc679ad21a64bfe93bf64ff1b6ba3b2: Time spent bootstrapping tablet: real 0.163s	user 0.002s	sys 0.020s
I20260709 13:09:13.546571 30169 raft_consensus.cc:359] T 40017481861c42efa46273995f000081 P 4bc679ad21a64bfe93bf64ff1b6ba3b2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "58a7cda73b3542718987bf815eed9b79" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 37953 } } peers { permanent_uuid: "4bc679ad21a64bfe93bf64ff1b6ba3b2" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 33075 } } peers { permanent_uuid: "37897779fb894afb8129dcf5d269bd54" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 42765 } }
I20260709 13:09:13.547380 30169 raft_consensus.cc:385] T 40017481861c42efa46273995f000081 P 4bc679ad21a64bfe93bf64ff1b6ba3b2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:13.547092 30172 raft_consensus.cc:359] T 40017481861c42efa46273995f000081 P 58a7cda73b3542718987bf815eed9b79 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "58a7cda73b3542718987bf815eed9b79" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 37953 } } peers { permanent_uuid: "4bc679ad21a64bfe93bf64ff1b6ba3b2" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 33075 } } peers { permanent_uuid: "37897779fb894afb8129dcf5d269bd54" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 42765 } }
I20260709 13:09:13.547761 30169 raft_consensus.cc:740] T 40017481861c42efa46273995f000081 P 4bc679ad21a64bfe93bf64ff1b6ba3b2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4bc679ad21a64bfe93bf64ff1b6ba3b2, State: Initialized, Role: FOLLOWER
I20260709 13:09:13.547935 30172 raft_consensus.cc:385] T 40017481861c42efa46273995f000081 P 58a7cda73b3542718987bf815eed9b79 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:13.548282 30172 raft_consensus.cc:740] T 40017481861c42efa46273995f000081 P 58a7cda73b3542718987bf815eed9b79 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 58a7cda73b3542718987bf815eed9b79, State: Initialized, Role: FOLLOWER
I20260709 13:09:13.548403 30171 tablet_bootstrap.cc:492] T d8a815244f7c485b980dfa0adb0fd2a9 P 37897779fb894afb8129dcf5d269bd54: No bootstrap required, opened a new log
I20260709 13:09:13.548645 30169 consensus_queue.cc:260] T 40017481861c42efa46273995f000081 P 4bc679ad21a64bfe93bf64ff1b6ba3b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "58a7cda73b3542718987bf815eed9b79" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 37953 } } peers { permanent_uuid: "4bc679ad21a64bfe93bf64ff1b6ba3b2" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 33075 } } peers { permanent_uuid: "37897779fb894afb8129dcf5d269bd54" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 42765 } }
I20260709 13:09:13.549063 30171 ts_tablet_manager.cc:1403] T d8a815244f7c485b980dfa0adb0fd2a9 P 37897779fb894afb8129dcf5d269bd54: Time spent bootstrapping tablet: real 0.098s	user 0.013s	sys 0.006s
I20260709 13:09:13.549045 30172 consensus_queue.cc:260] T 40017481861c42efa46273995f000081 P 58a7cda73b3542718987bf815eed9b79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "58a7cda73b3542718987bf815eed9b79" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 37953 } } peers { permanent_uuid: "4bc679ad21a64bfe93bf64ff1b6ba3b2" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 33075 } } peers { permanent_uuid: "37897779fb894afb8129dcf5d269bd54" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 42765 } }
I20260709 13:09:13.551403 30169 ts_tablet_manager.cc:1434] T 40017481861c42efa46273995f000081 P 4bc679ad21a64bfe93bf64ff1b6ba3b2: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.002s
I20260709 13:09:13.552358 30169 tablet_bootstrap.cc:492] T ea945f01fa404ea29878b0cd26af4e1e P 4bc679ad21a64bfe93bf64ff1b6ba3b2: Bootstrap starting.
I20260709 13:09:13.552711 30171 raft_consensus.cc:359] T d8a815244f7c485b980dfa0adb0fd2a9 P 37897779fb894afb8129dcf5d269bd54 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "58a7cda73b3542718987bf815eed9b79" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 37953 } } peers { permanent_uuid: "4bc679ad21a64bfe93bf64ff1b6ba3b2" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 33075 } } peers { permanent_uuid: "37897779fb894afb8129dcf5d269bd54" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 42765 } }
I20260709 13:09:13.553488 30171 raft_consensus.cc:385] T d8a815244f7c485b980dfa0adb0fd2a9 P 37897779fb894afb8129dcf5d269bd54 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:13.553768 30171 raft_consensus.cc:740] T d8a815244f7c485b980dfa0adb0fd2a9 P 37897779fb894afb8129dcf5d269bd54 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 37897779fb894afb8129dcf5d269bd54, State: Initialized, Role: FOLLOWER
I20260709 13:09:13.554528 30171 consensus_queue.cc:260] T d8a815244f7c485b980dfa0adb0fd2a9 P 37897779fb894afb8129dcf5d269bd54 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "58a7cda73b3542718987bf815eed9b79" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 37953 } } peers { permanent_uuid: "4bc679ad21a64bfe93bf64ff1b6ba3b2" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 33075 } } peers { permanent_uuid: "37897779fb894afb8129dcf5d269bd54" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 42765 } }
I20260709 13:09:13.558794 30172 ts_tablet_manager.cc:1434] T 40017481861c42efa46273995f000081 P 58a7cda73b3542718987bf815eed9b79: Time spent starting tablet: real 0.018s	user 0.008s	sys 0.000s
W20260709 13:09:13.561620 29824 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:09:13.562342 30172 tablet_bootstrap.cc:492] T ea945f01fa404ea29878b0cd26af4e1e P 58a7cda73b3542718987bf815eed9b79: Bootstrap starting.
I20260709 13:09:13.563190 30169 tablet_bootstrap.cc:654] T ea945f01fa404ea29878b0cd26af4e1e P 4bc679ad21a64bfe93bf64ff1b6ba3b2: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:13.566954 30171 ts_tablet_manager.cc:1434] T d8a815244f7c485b980dfa0adb0fd2a9 P 37897779fb894afb8129dcf5d269bd54: Time spent starting tablet: real 0.017s	user 0.007s	sys 0.000s
I20260709 13:09:13.567955 30171 tablet_bootstrap.cc:492] T ea945f01fa404ea29878b0cd26af4e1e P 37897779fb894afb8129dcf5d269bd54: Bootstrap starting.
I20260709 13:09:13.569391 30172 tablet_bootstrap.cc:654] T ea945f01fa404ea29878b0cd26af4e1e P 58a7cda73b3542718987bf815eed9b79: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:13.572147 30169 tablet_bootstrap.cc:492] T ea945f01fa404ea29878b0cd26af4e1e P 4bc679ad21a64bfe93bf64ff1b6ba3b2: No bootstrap required, opened a new log
I20260709 13:09:13.572846 30169 ts_tablet_manager.cc:1403] T ea945f01fa404ea29878b0cd26af4e1e P 4bc679ad21a64bfe93bf64ff1b6ba3b2: Time spent bootstrapping tablet: real 0.021s	user 0.012s	sys 0.000s
I20260709 13:09:13.574384 30171 tablet_bootstrap.cc:654] T ea945f01fa404ea29878b0cd26af4e1e P 37897779fb894afb8129dcf5d269bd54: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:13.576226 30169 raft_consensus.cc:359] T ea945f01fa404ea29878b0cd26af4e1e P 4bc679ad21a64bfe93bf64ff1b6ba3b2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "58a7cda73b3542718987bf815eed9b79" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 37953 } } peers { permanent_uuid: "4bc679ad21a64bfe93bf64ff1b6ba3b2" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 33075 } } peers { permanent_uuid: "37897779fb894afb8129dcf5d269bd54" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 42765 } }
I20260709 13:09:13.577118 30169 raft_consensus.cc:385] T ea945f01fa404ea29878b0cd26af4e1e P 4bc679ad21a64bfe93bf64ff1b6ba3b2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:13.577526 30169 raft_consensus.cc:740] T ea945f01fa404ea29878b0cd26af4e1e P 4bc679ad21a64bfe93bf64ff1b6ba3b2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4bc679ad21a64bfe93bf64ff1b6ba3b2, State: Initialized, Role: FOLLOWER
I20260709 13:09:13.578794 30169 consensus_queue.cc:260] T ea945f01fa404ea29878b0cd26af4e1e P 4bc679ad21a64bfe93bf64ff1b6ba3b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "58a7cda73b3542718987bf815eed9b79" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 37953 } } peers { permanent_uuid: "4bc679ad21a64bfe93bf64ff1b6ba3b2" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 33075 } } peers { permanent_uuid: "37897779fb894afb8129dcf5d269bd54" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 42765 } }
I20260709 13:09:13.588557 30169 ts_tablet_manager.cc:1434] T ea945f01fa404ea29878b0cd26af4e1e P 4bc679ad21a64bfe93bf64ff1b6ba3b2: Time spent starting tablet: real 0.015s	user 0.008s	sys 0.000s
I20260709 13:09:13.590029 30169 tablet_bootstrap.cc:492] T 273ea248a58742f998fd8e9dc55097fc P 4bc679ad21a64bfe93bf64ff1b6ba3b2: Bootstrap starting.
I20260709 13:09:13.604841 30170 raft_consensus.cc:493] T ea945f01fa404ea29878b0cd26af4e1e P 4bc679ad21a64bfe93bf64ff1b6ba3b2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:13.605415 30171 tablet_bootstrap.cc:492] T ea945f01fa404ea29878b0cd26af4e1e P 37897779fb894afb8129dcf5d269bd54: No bootstrap required, opened a new log
I20260709 13:09:13.605415 30170 raft_consensus.cc:515] T ea945f01fa404ea29878b0cd26af4e1e P 4bc679ad21a64bfe93bf64ff1b6ba3b2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "58a7cda73b3542718987bf815eed9b79" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 37953 } } peers { permanent_uuid: "4bc679ad21a64bfe93bf64ff1b6ba3b2" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 33075 } } peers { permanent_uuid: "37897779fb894afb8129dcf5d269bd54" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 42765 } }
I20260709 13:09:13.606593 30171 ts_tablet_manager.cc:1403] T ea945f01fa404ea29878b0cd26af4e1e P 37897779fb894afb8129dcf5d269bd54: Time spent bootstrapping tablet: real 0.039s	user 0.023s	sys 0.014s
I20260709 13:09:13.607312 30169 tablet_bootstrap.cc:654] T 273ea248a58742f998fd8e9dc55097fc P 4bc679ad21a64bfe93bf64ff1b6ba3b2: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:13.609336 29878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea945f01fa404ea29878b0cd26af4e1e" candidate_uuid: "4bc679ad21a64bfe93bf64ff1b6ba3b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "58a7cda73b3542718987bf815eed9b79" is_pre_election: true
I20260709 13:09:13.609514 30026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea945f01fa404ea29878b0cd26af4e1e" candidate_uuid: "4bc679ad21a64bfe93bf64ff1b6ba3b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "37897779fb894afb8129dcf5d269bd54" is_pre_election: true
I20260709 13:09:13.609964 30171 raft_consensus.cc:359] T ea945f01fa404ea29878b0cd26af4e1e P 37897779fb894afb8129dcf5d269bd54 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "58a7cda73b3542718987bf815eed9b79" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 37953 } } peers { permanent_uuid: "4bc679ad21a64bfe93bf64ff1b6ba3b2" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 33075 } } peers { permanent_uuid: "37897779fb894afb8129dcf5d269bd54" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 42765 } }
I20260709 13:09:13.610306 30170 leader_election.cc:290] T ea945f01fa404ea29878b0cd26af4e1e P 4bc679ad21a64bfe93bf64ff1b6ba3b2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 58a7cda73b3542718987bf815eed9b79 (127.17.223.1:37953), 37897779fb894afb8129dcf5d269bd54 (127.17.223.3:42765)
I20260709 13:09:13.611002 30171 raft_consensus.cc:385] T ea945f01fa404ea29878b0cd26af4e1e P 37897779fb894afb8129dcf5d269bd54 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260709 13:09:13.611976 29919 leader_election.cc:343] T ea945f01fa404ea29878b0cd26af4e1e P 4bc679ad21a64bfe93bf64ff1b6ba3b2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 58a7cda73b3542718987bf815eed9b79 (127.17.223.1:37953): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:13.611343 30171 raft_consensus.cc:740] T ea945f01fa404ea29878b0cd26af4e1e P 37897779fb894afb8129dcf5d269bd54 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 37897779fb894afb8129dcf5d269bd54, State: Initialized, Role: FOLLOWER
I20260709 13:09:13.613277 30171 consensus_queue.cc:260] T ea945f01fa404ea29878b0cd26af4e1e P 37897779fb894afb8129dcf5d269bd54 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "58a7cda73b3542718987bf815eed9b79" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 37953 } } peers { permanent_uuid: "4bc679ad21a64bfe93bf64ff1b6ba3b2" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 33075 } } peers { permanent_uuid: "37897779fb894afb8129dcf5d269bd54" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 42765 } }
I20260709 13:09:13.614207 30026 raft_consensus.cc:2468] T ea945f01fa404ea29878b0cd26af4e1e P 37897779fb894afb8129dcf5d269bd54 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4bc679ad21a64bfe93bf64ff1b6ba3b2 in term 0.
I20260709 13:09:13.614529 30172 tablet_bootstrap.cc:492] T ea945f01fa404ea29878b0cd26af4e1e P 58a7cda73b3542718987bf815eed9b79: No bootstrap required, opened a new log
I20260709 13:09:13.614521 30169 tablet_bootstrap.cc:492] T 273ea248a58742f998fd8e9dc55097fc P 4bc679ad21a64bfe93bf64ff1b6ba3b2: No bootstrap required, opened a new log
I20260709 13:09:13.615360 30172 ts_tablet_manager.cc:1403] T ea945f01fa404ea29878b0cd26af4e1e P 58a7cda73b3542718987bf815eed9b79: Time spent bootstrapping tablet: real 0.053s	user 0.027s	sys 0.015s
I20260709 13:09:13.615435 30169 ts_tablet_manager.cc:1403] T 273ea248a58742f998fd8e9dc55097fc P 4bc679ad21a64bfe93bf64ff1b6ba3b2: Time spent bootstrapping tablet: real 0.026s	user 0.013s	sys 0.002s
I20260709 13:09:13.616675 29916 leader_election.cc:304] T ea945f01fa404ea29878b0cd26af4e1e P 4bc679ad21a64bfe93bf64ff1b6ba3b2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 37897779fb894afb8129dcf5d269bd54, 4bc679ad21a64bfe93bf64ff1b6ba3b2; no voters: 58a7cda73b3542718987bf815eed9b79
I20260709 13:09:13.617893 30170 raft_consensus.cc:2804] T ea945f01fa404ea29878b0cd26af4e1e P 4bc679ad21a64bfe93bf64ff1b6ba3b2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:13.618265 30170 raft_consensus.cc:493] T ea945f01fa404ea29878b0cd26af4e1e P 4bc679ad21a64bfe93bf64ff1b6ba3b2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:13.618599 30170 raft_consensus.cc:3060] T ea945f01fa404ea29878b0cd26af4e1e P 4bc679ad21a64bfe93bf64ff1b6ba3b2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:13.618862 30172 raft_consensus.cc:359] T ea945f01fa404ea29878b0cd26af4e1e P 58a7cda73b3542718987bf815eed9b79 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "58a7cda73b3542718987bf815eed9b79" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 37953 } } peers { permanent_uuid: "4bc679ad21a64bfe93bf64ff1b6ba3b2" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 33075 } } peers { permanent_uuid: "37897779fb894afb8129dcf5d269bd54" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 42765 } }
I20260709 13:09:13.619678 30172 raft_consensus.cc:385] T ea945f01fa404ea29878b0cd26af4e1e P 58a7cda73b3542718987bf815eed9b79 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:13.619290 30169 raft_consensus.cc:359] T 273ea248a58742f998fd8e9dc55097fc P 4bc679ad21a64bfe93bf64ff1b6ba3b2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "58a7cda73b3542718987bf815eed9b79" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 37953 } } peers { permanent_uuid: "4bc679ad21a64bfe93bf64ff1b6ba3b2" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 33075 } } peers { permanent_uuid: "37897779fb894afb8129dcf5d269bd54" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 42765 } }
I20260709 13:09:13.620002 30172 raft_consensus.cc:740] T ea945f01fa404ea29878b0cd26af4e1e P 58a7cda73b3542718987bf815eed9b79 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 58a7cda73b3542718987bf815eed9b79, State: Initialized, Role: FOLLOWER
I20260709 13:09:13.620201 30169 raft_consensus.cc:385] T 273ea248a58742f998fd8e9dc55097fc P 4bc679ad21a64bfe93bf64ff1b6ba3b2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:13.620628 30169 raft_consensus.cc:740] T 273ea248a58742f998fd8e9dc55097fc P 4bc679ad21a64bfe93bf64ff1b6ba3b2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4bc679ad21a64bfe93bf64ff1b6ba3b2, State: Initialized, Role: FOLLOWER
I20260709 13:09:13.620800 30172 consensus_queue.cc:260] T ea945f01fa404ea29878b0cd26af4e1e P 58a7cda73b3542718987bf815eed9b79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "58a7cda73b3542718987bf815eed9b79" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 37953 } } peers { permanent_uuid: "4bc679ad21a64bfe93bf64ff1b6ba3b2" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 33075 } } peers { permanent_uuid: "37897779fb894afb8129dcf5d269bd54" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 42765 } }
I20260709 13:09:13.621481 30169 consensus_queue.cc:260] T 273ea248a58742f998fd8e9dc55097fc P 4bc679ad21a64bfe93bf64ff1b6ba3b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "58a7cda73b3542718987bf815eed9b79" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 37953 } } peers { permanent_uuid: "4bc679ad21a64bfe93bf64ff1b6ba3b2" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 33075 } } peers { permanent_uuid: "37897779fb894afb8129dcf5d269bd54" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 42765 } }
I20260709 13:09:13.623311 30172 ts_tablet_manager.cc:1434] T ea945f01fa404ea29878b0cd26af4e1e P 58a7cda73b3542718987bf815eed9b79: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.003s
I20260709 13:09:13.623966 30169 ts_tablet_manager.cc:1434] T 273ea248a58742f998fd8e9dc55097fc P 4bc679ad21a64bfe93bf64ff1b6ba3b2: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 13:09:13.624434 30172 tablet_bootstrap.cc:492] T d8a815244f7c485b980dfa0adb0fd2a9 P 58a7cda73b3542718987bf815eed9b79: Bootstrap starting.
I20260709 13:09:13.625128 30169 tablet_bootstrap.cc:492] T d8a815244f7c485b980dfa0adb0fd2a9 P 4bc679ad21a64bfe93bf64ff1b6ba3b2: Bootstrap starting.
I20260709 13:09:13.634414 30170 raft_consensus.cc:515] T ea945f01fa404ea29878b0cd26af4e1e P 4bc679ad21a64bfe93bf64ff1b6ba3b2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "58a7cda73b3542718987bf815eed9b79" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 37953 } } peers { permanent_uuid: "4bc679ad21a64bfe93bf64ff1b6ba3b2" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 33075 } } peers { permanent_uuid: "37897779fb894afb8129dcf5d269bd54" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 42765 } }
I20260709 13:09:13.635875 30172 tablet_bootstrap.cc:654] T d8a815244f7c485b980dfa0adb0fd2a9 P 58a7cda73b3542718987bf815eed9b79: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:13.637295 29878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea945f01fa404ea29878b0cd26af4e1e" candidate_uuid: "4bc679ad21a64bfe93bf64ff1b6ba3b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "58a7cda73b3542718987bf815eed9b79"
I20260709 13:09:13.637961 29878 raft_consensus.cc:3060] T ea945f01fa404ea29878b0cd26af4e1e P 58a7cda73b3542718987bf815eed9b79 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:13.635875 30169 tablet_bootstrap.cc:654] T d8a815244f7c485b980dfa0adb0fd2a9 P 4bc679ad21a64bfe93bf64ff1b6ba3b2: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:13.639703 30171 ts_tablet_manager.cc:1434] T ea945f01fa404ea29878b0cd26af4e1e P 37897779fb894afb8129dcf5d269bd54: Time spent starting tablet: real 0.033s	user 0.010s	sys 0.000s
I20260709 13:09:13.645920 29878 raft_consensus.cc:2468] T ea945f01fa404ea29878b0cd26af4e1e P 58a7cda73b3542718987bf815eed9b79 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4bc679ad21a64bfe93bf64ff1b6ba3b2 in term 1.
I20260709 13:09:13.647238 29919 leader_election.cc:304] T ea945f01fa404ea29878b0cd26af4e1e P 4bc679ad21a64bfe93bf64ff1b6ba3b2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4bc679ad21a64bfe93bf64ff1b6ba3b2, 58a7cda73b3542718987bf815eed9b79; no voters: 
I20260709 13:09:13.648154 30103 raft_consensus.cc:2804] T ea945f01fa404ea29878b0cd26af4e1e P 4bc679ad21a64bfe93bf64ff1b6ba3b2 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:13.648304 30171 tablet_bootstrap.cc:492] T 2351aaf3431e4d18906f7f7fa8bb4f5c P 37897779fb894afb8129dcf5d269bd54: Bootstrap starting.
I20260709 13:09:13.648643 30172 tablet_bootstrap.cc:492] T d8a815244f7c485b980dfa0adb0fd2a9 P 58a7cda73b3542718987bf815eed9b79: No bootstrap required, opened a new log
I20260709 13:09:13.648764 30103 raft_consensus.cc:697] T ea945f01fa404ea29878b0cd26af4e1e P 4bc679ad21a64bfe93bf64ff1b6ba3b2 [term 1 LEADER]: Becoming Leader. State: Replica: 4bc679ad21a64bfe93bf64ff1b6ba3b2, State: Running, Role: LEADER
I20260709 13:09:13.649665 30172 ts_tablet_manager.cc:1403] T d8a815244f7c485b980dfa0adb0fd2a9 P 58a7cda73b3542718987bf815eed9b79: Time spent bootstrapping tablet: real 0.025s	user 0.013s	sys 0.008s
I20260709 13:09:13.650135 30103 consensus_queue.cc:237] T ea945f01fa404ea29878b0cd26af4e1e P 4bc679ad21a64bfe93bf64ff1b6ba3b2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "58a7cda73b3542718987bf815eed9b79" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 37953 } } peers { permanent_uuid: "4bc679ad21a64bfe93bf64ff1b6ba3b2" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 33075 } } peers { permanent_uuid: "37897779fb894afb8129dcf5d269bd54" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 42765 } }
I20260709 13:09:13.654102 30172 raft_consensus.cc:359] T d8a815244f7c485b980dfa0adb0fd2a9 P 58a7cda73b3542718987bf815eed9b79 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "58a7cda73b3542718987bf815eed9b79" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 37953 } } peers { permanent_uuid: "4bc679ad21a64bfe93bf64ff1b6ba3b2" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 33075 } } peers { permanent_uuid: "37897779fb894afb8129dcf5d269bd54" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 42765 } }
I20260709 13:09:13.655228 30172 raft_consensus.cc:385] T d8a815244f7c485b980dfa0adb0fd2a9 P 58a7cda73b3542718987bf815eed9b79 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:13.655524 30172 raft_consensus.cc:740] T d8a815244f7c485b980dfa0adb0fd2a9 P 58a7cda73b3542718987bf815eed9b79 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 58a7cda73b3542718987bf815eed9b79, State: Initialized, Role: FOLLOWER
I20260709 13:09:13.656258 30171 tablet_bootstrap.cc:654] T 2351aaf3431e4d18906f7f7fa8bb4f5c P 37897779fb894afb8129dcf5d269bd54: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:13.668725 30172 consensus_queue.cc:260] T d8a815244f7c485b980dfa0adb0fd2a9 P 58a7cda73b3542718987bf815eed9b79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "58a7cda73b3542718987bf815eed9b79" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 37953 } } peers { permanent_uuid: "4bc679ad21a64bfe93bf64ff1b6ba3b2" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 33075 } } peers { permanent_uuid: "37897779fb894afb8129dcf5d269bd54" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 42765 } }
I20260709 13:09:13.670375 30026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea945f01fa404ea29878b0cd26af4e1e" candidate_uuid: "4bc679ad21a64bfe93bf64ff1b6ba3b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "37897779fb894afb8129dcf5d269bd54"
I20260709 13:09:13.671123 30026 raft_consensus.cc:3060] T ea945f01fa404ea29878b0cd26af4e1e P 37897779fb894afb8129dcf5d269bd54 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:13.671489 30172 ts_tablet_manager.cc:1434] T d8a815244f7c485b980dfa0adb0fd2a9 P 58a7cda73b3542718987bf815eed9b79: Time spent starting tablet: real 0.021s	user 0.014s	sys 0.004s
I20260709 13:09:13.672776 30172 tablet_bootstrap.cc:492] T 5ccb587267a8414180b1f5474e4e2728 P 58a7cda73b3542718987bf815eed9b79: Bootstrap starting.
I20260709 13:09:13.681234 30169 tablet_bootstrap.cc:492] T d8a815244f7c485b980dfa0adb0fd2a9 P 4bc679ad21a64bfe93bf64ff1b6ba3b2: No bootstrap required, opened a new log
I20260709 13:09:13.681272 30172 tablet_bootstrap.cc:654] T 5ccb587267a8414180b1f5474e4e2728 P 58a7cda73b3542718987bf815eed9b79: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:13.682377 30169 ts_tablet_manager.cc:1403] T d8a815244f7c485b980dfa0adb0fd2a9 P 4bc679ad21a64bfe93bf64ff1b6ba3b2: Time spent bootstrapping tablet: real 0.057s	user 0.005s	sys 0.026s
I20260709 13:09:13.683331 30026 raft_consensus.cc:2468] T ea945f01fa404ea29878b0cd26af4e1e P 37897779fb894afb8129dcf5d269bd54 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4bc679ad21a64bfe93bf64ff1b6ba3b2 in term 1.
I20260709 13:09:13.686604 30169 raft_consensus.cc:359] T d8a815244f7c485b980dfa0adb0fd2a9 P 4bc679ad21a64bfe93bf64ff1b6ba3b2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "58a7cda73b3542718987bf815eed9b79" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 37953 } } peers { permanent_uuid: "4bc679ad21a64bfe93bf64ff1b6ba3b2" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 33075 } } peers { permanent_uuid: "37897779fb894afb8129dcf5d269bd54" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 42765 } }
I20260709 13:09:13.687800 30169 raft_consensus.cc:385] T d8a815244f7c485b980dfa0adb0fd2a9 P 4bc679ad21a64bfe93bf64ff1b6ba3b2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:13.688246 30169 raft_consensus.cc:740] T d8a815244f7c485b980dfa0adb0fd2a9 P 4bc679ad21a64bfe93bf64ff1b6ba3b2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4bc679ad21a64bfe93bf64ff1b6ba3b2, State: Initialized, Role: FOLLOWER
I20260709 13:09:13.689623 30169 consensus_queue.cc:260] T d8a815244f7c485b980dfa0adb0fd2a9 P 4bc679ad21a64bfe93bf64ff1b6ba3b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "58a7cda73b3542718987bf815eed9b79" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 37953 } } peers { permanent_uuid: "4bc679ad21a64bfe93bf64ff1b6ba3b2" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 33075 } } peers { permanent_uuid: "37897779fb894afb8129dcf5d269bd54" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 42765 } }
I20260709 13:09:13.690704 29775 catalog_manager.cc:5697] T ea945f01fa404ea29878b0cd26af4e1e P 4bc679ad21a64bfe93bf64ff1b6ba3b2 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4bc679ad21a64bfe93bf64ff1b6ba3b2 (127.17.223.2). New cstate: current_term: 1 leader_uuid: "4bc679ad21a64bfe93bf64ff1b6ba3b2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "58a7cda73b3542718987bf815eed9b79" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 37953 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4bc679ad21a64bfe93bf64ff1b6ba3b2" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 33075 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "37897779fb894afb8129dcf5d269bd54" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 42765 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:13.693343 30169 ts_tablet_manager.cc:1434] T d8a815244f7c485b980dfa0adb0fd2a9 P 4bc679ad21a64bfe93bf64ff1b6ba3b2: Time spent starting tablet: real 0.010s	user 0.008s	sys 0.000s
I20260709 13:09:13.695117 30169 tablet_bootstrap.cc:492] T 2351aaf3431e4d18906f7f7fa8bb4f5c P 4bc679ad21a64bfe93bf64ff1b6ba3b2: Bootstrap starting.
I20260709 13:09:13.708777 30169 tablet_bootstrap.cc:654] T 2351aaf3431e4d18906f7f7fa8bb4f5c P 4bc679ad21a64bfe93bf64ff1b6ba3b2: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:13.717710 30172 tablet_bootstrap.cc:492] T 5ccb587267a8414180b1f5474e4e2728 P 58a7cda73b3542718987bf815eed9b79: No bootstrap required, opened a new log
I20260709 13:09:13.718278 30172 ts_tablet_manager.cc:1403] T 5ccb587267a8414180b1f5474e4e2728 P 58a7cda73b3542718987bf815eed9b79: Time spent bootstrapping tablet: real 0.046s	user 0.024s	sys 0.004s
I20260709 13:09:13.719503 30170 leader_election.cc:290] T ea945f01fa404ea29878b0cd26af4e1e P 4bc679ad21a64bfe93bf64ff1b6ba3b2 [CANDIDATE]: Term 1 election: Requested vote from peers 58a7cda73b3542718987bf815eed9b79 (127.17.223.1:37953), 37897779fb894afb8129dcf5d269bd54 (127.17.223.3:42765)
I20260709 13:09:13.719794 30169 tablet_bootstrap.cc:492] T 2351aaf3431e4d18906f7f7fa8bb4f5c P 4bc679ad21a64bfe93bf64ff1b6ba3b2: No bootstrap required, opened a new log
I20260709 13:09:13.720453 30169 ts_tablet_manager.cc:1403] T 2351aaf3431e4d18906f7f7fa8bb4f5c P 4bc679ad21a64bfe93bf64ff1b6ba3b2: Time spent bootstrapping tablet: real 0.026s	user 0.014s	sys 0.000s
I20260709 13:09:13.721457 30172 raft_consensus.cc:359] T 5ccb587267a8414180b1f5474e4e2728 P 58a7cda73b3542718987bf815eed9b79 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "58a7cda73b3542718987bf815eed9b79" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 37953 } } peers { permanent_uuid: "4bc679ad21a64bfe93bf64ff1b6ba3b2" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 33075 } } peers { permanent_uuid: "37897779fb894afb8129dcf5d269bd54" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 42765 } }
I20260709 13:09:13.722270 30172 raft_consensus.cc:385] T 5ccb587267a8414180b1f5474e4e2728 P 58a7cda73b3542718987bf815eed9b79 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:13.722581 30172 raft_consensus.cc:740] T 5ccb587267a8414180b1f5474e4e2728 P 58a7cda73b3542718987bf815eed9b79 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 58a7cda73b3542718987bf815eed9b79, State: Initialized, Role: FOLLOWER
I20260709 13:09:13.723343 30172 consensus_queue.cc:260] T 5ccb587267a8414180b1f5474e4e2728 P 58a7cda73b3542718987bf815eed9b79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "58a7cda73b3542718987bf815eed9b79" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 37953 } } peers { permanent_uuid: "4bc679ad21a64bfe93bf64ff1b6ba3b2" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 33075 } } peers { permanent_uuid: "37897779fb894afb8129dcf5d269bd54" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 42765 } }
I20260709 13:09:13.725631 30172 ts_tablet_manager.cc:1434] T 5ccb587267a8414180b1f5474e4e2728 P 58a7cda73b3542718987bf815eed9b79: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 13:09:13.725916 30169 raft_consensus.cc:359] T 2351aaf3431e4d18906f7f7fa8bb4f5c P 4bc679ad21a64bfe93bf64ff1b6ba3b2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "58a7cda73b3542718987bf815eed9b79" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 37953 } } peers { permanent_uuid: "4bc679ad21a64bfe93bf64ff1b6ba3b2" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 33075 } } peers { permanent_uuid: "37897779fb894afb8129dcf5d269bd54" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 42765 } }
I20260709 13:09:13.726768 30169 raft_consensus.cc:385] T 2351aaf3431e4d18906f7f7fa8bb4f5c P 4bc679ad21a64bfe93bf64ff1b6ba3b2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:13.726801 30172 tablet_bootstrap.cc:492] T 797710d1534045c3a8597c9800a09ea6 P 58a7cda73b3542718987bf815eed9b79: Bootstrap starting.
I20260709 13:09:13.727262 30169 raft_consensus.cc:740] T 2351aaf3431e4d18906f7f7fa8bb4f5c P 4bc679ad21a64bfe93bf64ff1b6ba3b2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4bc679ad21a64bfe93bf64ff1b6ba3b2, State: Initialized, Role: FOLLOWER
I20260709 13:09:13.728078 30169 consensus_queue.cc:260] T 2351aaf3431e4d18906f7f7fa8bb4f5c P 4bc679ad21a64bfe93bf64ff1b6ba3b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "58a7cda73b3542718987bf815eed9b79" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 37953 } } peers { permanent_uuid: "4bc679ad21a64bfe93bf64ff1b6ba3b2" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 33075 } } peers { permanent_uuid: "37897779fb894afb8129dcf5d269bd54" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 42765 } }
I20260709 13:09:13.730460 30169 ts_tablet_manager.cc:1434] T 2351aaf3431e4d18906f7f7fa8bb4f5c P 4bc679ad21a64bfe93bf64ff1b6ba3b2: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.000s
I20260709 13:09:13.731676 30169 tablet_bootstrap.cc:492] T 5ccb587267a8414180b1f5474e4e2728 P 4bc679ad21a64bfe93bf64ff1b6ba3b2: Bootstrap starting.
I20260709 13:09:13.738615 30169 tablet_bootstrap.cc:654] T 5ccb587267a8414180b1f5474e4e2728 P 4bc679ad21a64bfe93bf64ff1b6ba3b2: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:13.740156 30172 tablet_bootstrap.cc:654] T 797710d1534045c3a8597c9800a09ea6 P 58a7cda73b3542718987bf815eed9b79: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:13.740469 30144 raft_consensus.cc:493] T 40017481861c42efa46273995f000081 P 58a7cda73b3542718987bf815eed9b79 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:13.741191 30144 raft_consensus.cc:515] T 40017481861c42efa46273995f000081 P 58a7cda73b3542718987bf815eed9b79 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "58a7cda73b3542718987bf815eed9b79" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 37953 } } peers { permanent_uuid: "4bc679ad21a64bfe93bf64ff1b6ba3b2" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 33075 } } peers { permanent_uuid: "37897779fb894afb8129dcf5d269bd54" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 42765 } }
I20260709 13:09:13.745095 30144 leader_election.cc:290] T 40017481861c42efa46273995f000081 P 58a7cda73b3542718987bf815eed9b79 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4bc679ad21a64bfe93bf64ff1b6ba3b2 (127.17.223.2:33075), 37897779fb894afb8129dcf5d269bd54 (127.17.223.3:42765)
I20260709 13:09:13.746311 29952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40017481861c42efa46273995f000081" candidate_uuid: "58a7cda73b3542718987bf815eed9b79" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4bc679ad21a64bfe93bf64ff1b6ba3b2" is_pre_election: true
I20260709 13:09:13.747046 29952 raft_consensus.cc:2468] T 40017481861c42efa46273995f000081 P 4bc679ad21a64bfe93bf64ff1b6ba3b2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 58a7cda73b3542718987bf815eed9b79 in term 0.
I20260709 13:09:13.747048 30026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40017481861c42efa46273995f000081" candidate_uuid: "58a7cda73b3542718987bf815eed9b79" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "37897779fb894afb8129dcf5d269bd54" is_pre_election: true
W20260709 13:09:13.750561 29841 leader_election.cc:343] T 40017481861c42efa46273995f000081 P 58a7cda73b3542718987bf815eed9b79 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 37897779fb894afb8129dcf5d269bd54 (127.17.223.3:42765): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:13.752624 29842 leader_election.cc:304] T 40017481861c42efa46273995f000081 P 58a7cda73b3542718987bf815eed9b79 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4bc679ad21a64bfe93bf64ff1b6ba3b2, 58a7cda73b3542718987bf815eed9b79; no voters: 37897779fb894afb8129dcf5d269bd54
I20260709 13:09:13.754719 30170 raft_consensus.cc:493] T d8a815244f7c485b980dfa0adb0fd2a9 P 4bc679ad21a64bfe93bf64ff1b6ba3b2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:13.755263 30170 raft_consensus.cc:515] T d8a815244f7c485b980dfa0adb0fd2a9 P 4bc679ad21a64bfe93bf64ff1b6ba3b2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "58a7cda73b3542718987bf815eed9b79" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 37953 } } peers { permanent_uuid: "4bc679ad21a64bfe93bf64ff1b6ba3b2" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 33075 } } peers { permanent_uuid: "37897779fb894afb8129dcf5d269bd54" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 42765 } }
I20260709 13:09:13.757279 30170 leader_election.cc:290] T d8a815244f7c485b980dfa0adb0fd2a9 P 4bc679ad21a64bfe93bf64ff1b6ba3b2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 58a7cda73b3542718987bf815eed9b79 (127.17.223.1:37953), 37897779fb894afb8129dcf5d269bd54 (127.17.223.3:42765)
I20260709 13:09:13.757745 30144 raft_consensus.cc:2804] T 40017481861c42efa46273995f000081 P 58a7cda73b3542718987bf815eed9b79 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:13.758179 30144 raft_consensus.cc:493] T 40017481861c42efa46273995f000081 P 58a7cda73b3542718987bf815eed9b79 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:13.758505 30144 raft_consensus.cc:3060] T 40017481861c42efa46273995f000081 P 58a7cda73b3542718987bf815eed9b79 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:13.759717 30026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8a815244f7c485b980dfa0adb0fd2a9" candidate_uuid: "4bc679ad21a64bfe93bf64ff1b6ba3b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "37897779fb894afb8129dcf5d269bd54" is_pre_election: true
I20260709 13:09:13.760416 30026 raft_consensus.cc:2468] T d8a815244f7c485b980dfa0adb0fd2a9 P 37897779fb894afb8129dcf5d269bd54 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4bc679ad21a64bfe93bf64ff1b6ba3b2 in term 0.
I20260709 13:09:13.761688 29916 leader_election.cc:304] T d8a815244f7c485b980dfa0adb0fd2a9 P 4bc679ad21a64bfe93bf64ff1b6ba3b2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 37897779fb894afb8129dcf5d269bd54, 4bc679ad21a64bfe93bf64ff1b6ba3b2; no voters: 
I20260709 13:09:13.762523 30170 raft_consensus.cc:2804] T d8a815244f7c485b980dfa0adb0fd2a9 P 4bc679ad21a64bfe93bf64ff1b6ba3b2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:13.762917 30170 raft_consensus.cc:493] T d8a815244f7c485b980dfa0adb0fd2a9 P 4bc679ad21a64bfe93bf64ff1b6ba3b2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:13.763236 30170 raft_consensus.cc:3060] T d8a815244f7c485b980dfa0adb0fd2a9 P 4bc679ad21a64bfe93bf64ff1b6ba3b2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:13.769004 30144 raft_consensus.cc:515] T 40017481861c42efa46273995f000081 P 58a7cda73b3542718987bf815eed9b79 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "58a7cda73b3542718987bf815eed9b79" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 37953 } } peers { permanent_uuid: "4bc679ad21a64bfe93bf64ff1b6ba3b2" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 33075 } } peers { permanent_uuid: "37897779fb894afb8129dcf5d269bd54" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 42765 } }
I20260709 13:09:13.771061 29878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8a815244f7c485b980dfa0adb0fd2a9" candidate_uuid: "4bc679ad21a64bfe93bf64ff1b6ba3b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "58a7cda73b3542718987bf815eed9b79" is_pre_election: true
I20260709 13:09:13.771736 29878 raft_consensus.cc:2468] T d8a815244f7c485b980dfa0adb0fd2a9 P 58a7cda73b3542718987bf815eed9b79 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4bc679ad21a64bfe93bf64ff1b6ba3b2 in term 0.
I20260709 13:09:13.770232 30170 raft_consensus.cc:515] T d8a815244f7c485b980dfa0adb0fd2a9 P 4bc679ad21a64bfe93bf64ff1b6ba3b2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "58a7cda73b3542718987bf815eed9b79" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 37953 } } peers { permanent_uuid: "4bc679ad21a64bfe93bf64ff1b6ba3b2" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 33075 } } peers { permanent_uuid: "37897779fb894afb8129dcf5d269bd54" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 42765 } }
I20260709 13:09:13.775595 29878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8a815244f7c485b980dfa0adb0fd2a9" candidate_uuid: "4bc679ad21a64bfe93bf64ff1b6ba3b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "58a7cda73b3542718987bf815eed9b79"
I20260709 13:09:13.776171 29878 raft_consensus.cc:3060] T d8a815244f7c485b980dfa0adb0fd2a9 P 58a7cda73b3542718987bf815eed9b79 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:13.778561 29952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40017481861c42efa46273995f000081" candidate_uuid: "58a7cda73b3542718987bf815eed9b79" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4bc679ad21a64bfe93bf64ff1b6ba3b2"
I20260709 13:09:13.779207 29952 raft_consensus.cc:3060] T 40017481861c42efa46273995f000081 P 4bc679ad21a64bfe93bf64ff1b6ba3b2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:13.783784 29878 raft_consensus.cc:2468] T d8a815244f7c485b980dfa0adb0fd2a9 P 58a7cda73b3542718987bf815eed9b79 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4bc679ad21a64bfe93bf64ff1b6ba3b2 in term 1.
I20260709 13:09:13.784996 29919 leader_election.cc:304] T d8a815244f7c485b980dfa0adb0fd2a9 P 4bc679ad21a64bfe93bf64ff1b6ba3b2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4bc679ad21a64bfe93bf64ff1b6ba3b2, 58a7cda73b3542718987bf815eed9b79; no voters: 
I20260709 13:09:13.786032 30103 raft_consensus.cc:2804] T d8a815244f7c485b980dfa0adb0fd2a9 P 4bc679ad21a64bfe93bf64ff1b6ba3b2 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:13.786522 30103 raft_consensus.cc:697] T d8a815244f7c485b980dfa0adb0fd2a9 P 4bc679ad21a64bfe93bf64ff1b6ba3b2 [term 1 LEADER]: Becoming Leader. State: Replica: 4bc679ad21a64bfe93bf64ff1b6ba3b2, State: Running, Role: LEADER
I20260709 13:09:13.787353 30103 consensus_queue.cc:237] T d8a815244f7c485b980dfa0adb0fd2a9 P 4bc679ad21a64bfe93bf64ff1b6ba3b2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "58a7cda73b3542718987bf815eed9b79" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 37953 } } peers { permanent_uuid: "4bc679ad21a64bfe93bf64ff1b6ba3b2" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 33075 } } peers { permanent_uuid: "37897779fb894afb8129dcf5d269bd54" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 42765 } }
I20260709 13:09:13.797616 29952 raft_consensus.cc:2468] T 40017481861c42efa46273995f000081 P 4bc679ad21a64bfe93bf64ff1b6ba3b2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 58a7cda73b3542718987bf815eed9b79 in term 1.
I20260709 13:09:13.798203 30171 tablet_bootstrap.cc:492] T 2351aaf3431e4d18906f7f7fa8bb4f5c P 37897779fb894afb8129dcf5d269bd54: No bootstrap required, opened a new log
I20260709 13:09:13.798807 30171 ts_tablet_manager.cc:1403] T 2351aaf3431e4d18906f7f7fa8bb4f5c P 37897779fb894afb8129dcf5d269bd54: Time spent bootstrapping tablet: real 0.151s	user 0.028s	sys 0.047s
I20260709 13:09:13.799139 29842 leader_election.cc:304] T 40017481861c42efa46273995f000081 P 58a7cda73b3542718987bf815eed9b79 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4bc679ad21a64bfe93bf64ff1b6ba3b2, 58a7cda73b3542718987bf815eed9b79; no voters: 
I20260709 13:09:13.804895 30026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8a815244f7c485b980dfa0adb0fd2a9" candidate_uuid: "4bc679ad21a64bfe93bf64ff1b6ba3b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "37897779fb894afb8129dcf5d269bd54"
I20260709 13:09:13.805667 30026 raft_consensus.cc:3060] T d8a815244f7c485b980dfa0adb0fd2a9 P 37897779fb894afb8129dcf5d269bd54 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:13.815096 30170 leader_election.cc:290] T d8a815244f7c485b980dfa0adb0fd2a9 P 4bc679ad21a64bfe93bf64ff1b6ba3b2 [CANDIDATE]: Term 1 election: Requested vote from peers 58a7cda73b3542718987bf815eed9b79 (127.17.223.1:37953), 37897779fb894afb8129dcf5d269bd54 (127.17.223.3:42765)
I20260709 13:09:13.814277 30026 raft_consensus.cc:2468] T d8a815244f7c485b980dfa0adb0fd2a9 P 37897779fb894afb8129dcf5d269bd54 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4bc679ad21a64bfe93bf64ff1b6ba3b2 in term 1.
I20260709 13:09:13.816705 30025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40017481861c42efa46273995f000081" candidate_uuid: "58a7cda73b3542718987bf815eed9b79" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "37897779fb894afb8129dcf5d269bd54"
W20260709 13:09:13.818210 29841 leader_election.cc:343] T 40017481861c42efa46273995f000081 P 58a7cda73b3542718987bf815eed9b79 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 37897779fb894afb8129dcf5d269bd54 (127.17.223.3:42765): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:13.802570 30171 raft_consensus.cc:359] T 2351aaf3431e4d18906f7f7fa8bb4f5c P 37897779fb894afb8129dcf5d269bd54 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "58a7cda73b3542718987bf815eed9b79" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 37953 } } peers { permanent_uuid: "4bc679ad21a64bfe93bf64ff1b6ba3b2" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 33075 } } peers { permanent_uuid: "37897779fb894afb8129dcf5d269bd54" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 42765 } }
I20260709 13:09:13.819255 30171 raft_consensus.cc:385] T 2351aaf3431e4d18906f7f7fa8bb4f5c P 37897779fb894afb8129dcf5d269bd54 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:13.819269 30144 leader_election.cc:290] T 40017481861c42efa46273995f000081 P 58a7cda73b3542718987bf815eed9b79 [CANDIDATE]: Term 1 election: Requested vote from peers 4bc679ad21a64bfe93bf64ff1b6ba3b2 (127.17.223.2:33075), 37897779fb894afb8129dcf5d269bd54 (127.17.223.3:42765)
I20260709 13:09:13.819443 30172 tablet_bootstrap.cc:492] T 797710d1534045c3a8597c9800a09ea6 P 58a7cda73b3542718987bf815eed9b79: No bootstrap required, opened a new log
I20260709 13:09:13.819636 30171 raft_consensus.cc:740] T 2351aaf3431e4d18906f7f7fa8bb4f5c P 37897779fb894afb8129dcf5d269bd54 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 37897779fb894afb8129dcf5d269bd54, State: Initialized, Role: FOLLOWER
I20260709 13:09:13.820799 30172 ts_tablet_manager.cc:1403] T 797710d1534045c3a8597c9800a09ea6 P 58a7cda73b3542718987bf815eed9b79: Time spent bootstrapping tablet: real 0.094s	user 0.034s	sys 0.052s
I20260709 13:09:13.821112 30171 consensus_queue.cc:260] T 2351aaf3431e4d18906f7f7fa8bb4f5c P 37897779fb894afb8129dcf5d269bd54 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "58a7cda73b3542718987bf815eed9b79" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 37953 } } peers { permanent_uuid: "4bc679ad21a64bfe93bf64ff1b6ba3b2" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 33075 } } peers { permanent_uuid: "37897779fb894afb8129dcf5d269bd54" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 42765 } }
I20260709 13:09:13.820101 30144 raft_consensus.cc:2804] T 40017481861c42efa46273995f000081 P 58a7cda73b3542718987bf815eed9b79 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:13.823693 30171 ts_tablet_manager.cc:1434] T 2351aaf3431e4d18906f7f7fa8bb4f5c P 37897779fb894afb8129dcf5d269bd54: Time spent starting tablet: real 0.025s	user 0.008s	sys 0.000s
I20260709 13:09:13.824750 30171 tablet_bootstrap.cc:492] T fa4b1db9a2d44d45bc9935975428592e P 37897779fb894afb8129dcf5d269bd54: Bootstrap starting.
I20260709 13:09:13.825490 30172 raft_consensus.cc:359] T 797710d1534045c3a8597c9800a09ea6 P 58a7cda73b3542718987bf815eed9b79 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "58a7cda73b3542718987bf815eed9b79" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 37953 } } peers { permanent_uuid: "4bc679ad21a64bfe93bf64ff1b6ba3b2" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 33075 } } peers { permanent_uuid: "37897779fb894afb8129dcf5d269bd54" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 42765 } }
I20260709 13:09:13.826622 30172 raft_consensus.cc:385] T 797710d1534045c3a8597c9800a09ea6 P 58a7cda73b3542718987bf815eed9b79 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:13.827099 30172 raft_consensus.cc:740] T 797710d1534045c3a8597c9800a09ea6 P 58a7cda73b3542718987bf815eed9b79 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 58a7cda73b3542718987bf815eed9b79, State: Initialized, Role: FOLLOWER
I20260709 13:09:13.828135 30172 consensus_queue.cc:260] T 797710d1534045c3a8597c9800a09ea6 P 58a7cda73b3542718987bf815eed9b79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "58a7cda73b3542718987bf815eed9b79" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 37953 } } peers { permanent_uuid: "4bc679ad21a64bfe93bf64ff1b6ba3b2" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 33075 } } peers { permanent_uuid: "37897779fb894afb8129dcf5d269bd54" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 42765 } }
I20260709 13:09:13.831977 30171 tablet_bootstrap.cc:654] T fa4b1db9a2d44d45bc9935975428592e P 37897779fb894afb8129dcf5d269bd54: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:13.833267 30172 ts_tablet_manager.cc:1434] T 797710d1534045c3a8597c9800a09ea6 P 58a7cda73b3542718987bf815eed9b79: Time spent starting tablet: real 0.012s	user 0.009s	sys 0.000s
I20260709 13:09:13.834724 30172 tablet_bootstrap.cc:492] T 2351aaf3431e4d18906f7f7fa8bb4f5c P 58a7cda73b3542718987bf815eed9b79: Bootstrap starting.
I20260709 13:09:13.844099 30171 tablet_bootstrap.cc:492] T fa4b1db9a2d44d45bc9935975428592e P 37897779fb894afb8129dcf5d269bd54: No bootstrap required, opened a new log
I20260709 13:09:13.844712 30171 ts_tablet_manager.cc:1403] T fa4b1db9a2d44d45bc9935975428592e P 37897779fb894afb8129dcf5d269bd54: Time spent bootstrapping tablet: real 0.020s	user 0.010s	sys 0.007s
W20260709 13:09:13.845082 29842 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.223.2:33075, user_credentials={real_user=slave}} blocked reactor thread for 46048.3us
I20260709 13:09:13.847693 30171 raft_consensus.cc:359] T fa4b1db9a2d44d45bc9935975428592e P 37897779fb894afb8129dcf5d269bd54 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "58a7cda73b3542718987bf815eed9b79" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 37953 } } peers { permanent_uuid: "4bc679ad21a64bfe93bf64ff1b6ba3b2" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 33075 } } peers { permanent_uuid: "37897779fb894afb8129dcf5d269bd54" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 42765 } }
I20260709 13:09:13.848505 30171 raft_consensus.cc:385] T fa4b1db9a2d44d45bc9935975428592e P 37897779fb894afb8129dcf5d269bd54 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:13.848794 30171 raft_consensus.cc:740] T fa4b1db9a2d44d45bc9935975428592e P 37897779fb894afb8129dcf5d269bd54 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 37897779fb894afb8129dcf5d269bd54, State: Initialized, Role: FOLLOWER
I20260709 13:09:13.849556 30172 tablet_bootstrap.cc:654] T 2351aaf3431e4d18906f7f7fa8bb4f5c P 58a7cda73b3542718987bf815eed9b79: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:13.849581 30171 consensus_queue.cc:260] T fa4b1db9a2d44d45bc9935975428592e P 37897779fb894afb8129dcf5d269bd54 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "58a7cda73b3542718987bf815eed9b79" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 37953 } } peers { permanent_uuid: "4bc679ad21a64bfe93bf64ff1b6ba3b2" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 33075 } } peers { permanent_uuid: "37897779fb894afb8129dcf5d269bd54" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 42765 } }
I20260709 13:09:13.852275 30171 ts_tablet_manager.cc:1434] T fa4b1db9a2d44d45bc9935975428592e P 37897779fb894afb8129dcf5d269bd54: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 13:09:13.852234 30157 raft_consensus.cc:493] T 2351aaf3431e4d18906f7f7fa8bb4f5c P 37897779fb894afb8129dcf5d269bd54 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:13.852784 30157 raft_consensus.cc:515] T 2351aaf3431e4d18906f7f7fa8bb4f5c P 37897779fb894afb8129dcf5d269bd54 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "58a7cda73b3542718987bf815eed9b79" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 37953 } } peers { permanent_uuid: "4bc679ad21a64bfe93bf64ff1b6ba3b2" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 33075 } } peers { permanent_uuid: "37897779fb894afb8129dcf5d269bd54" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 42765 } }
I20260709 13:09:13.854775 30171 tablet_bootstrap.cc:492] T 273ea248a58742f998fd8e9dc55097fc P 37897779fb894afb8129dcf5d269bd54: Bootstrap starting.
I20260709 13:09:13.854892 30157 leader_election.cc:290] T 2351aaf3431e4d18906f7f7fa8bb4f5c P 37897779fb894afb8129dcf5d269bd54 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 58a7cda73b3542718987bf815eed9b79 (127.17.223.1:37953), 4bc679ad21a64bfe93bf64ff1b6ba3b2 (127.17.223.2:33075)
I20260709 13:09:13.862481 30171 tablet_bootstrap.cc:654] T 273ea248a58742f998fd8e9dc55097fc P 37897779fb894afb8129dcf5d269bd54: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:13.864790 30172 tablet_bootstrap.cc:492] T 2351aaf3431e4d18906f7f7fa8bb4f5c P 58a7cda73b3542718987bf815eed9b79: No bootstrap required, opened a new log
I20260709 13:09:13.864797 29952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2351aaf3431e4d18906f7f7fa8bb4f5c" candidate_uuid: "37897779fb894afb8129dcf5d269bd54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4bc679ad21a64bfe93bf64ff1b6ba3b2" is_pre_election: true
I20260709 13:09:13.865764 29952 raft_consensus.cc:2468] T 2351aaf3431e4d18906f7f7fa8bb4f5c P 4bc679ad21a64bfe93bf64ff1b6ba3b2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 37897779fb894afb8129dcf5d269bd54 in term 0.
I20260709 13:09:13.865878 30172 ts_tablet_manager.cc:1403] T 2351aaf3431e4d18906f7f7fa8bb4f5c P 58a7cda73b3542718987bf815eed9b79: Time spent bootstrapping tablet: real 0.031s	user 0.014s	sys 0.010s
I20260709 13:09:13.867062 29991 leader_election.cc:304] T 2351aaf3431e4d18906f7f7fa8bb4f5c P 37897779fb894afb8129dcf5d269bd54 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 37897779fb894afb8129dcf5d269bd54, 4bc679ad21a64bfe93bf64ff1b6ba3b2; no voters: 
I20260709 13:09:13.868106 30157 raft_consensus.cc:2804] T 2351aaf3431e4d18906f7f7fa8bb4f5c P 37897779fb894afb8129dcf5d269bd54 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:13.868604 30157 raft_consensus.cc:493] T 2351aaf3431e4d18906f7f7fa8bb4f5c P 37897779fb894afb8129dcf5d269bd54 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:13.869040 30157 raft_consensus.cc:3060] T 2351aaf3431e4d18906f7f7fa8bb4f5c P 37897779fb894afb8129dcf5d269bd54 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:13.870926 30172 raft_consensus.cc:359] T 2351aaf3431e4d18906f7f7fa8bb4f5c P 58a7cda73b3542718987bf815eed9b79 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "58a7cda73b3542718987bf815eed9b79" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 37953 } } peers { permanent_uuid: "4bc679ad21a64bfe93bf64ff1b6ba3b2" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 33075 } } peers { permanent_uuid: "37897779fb894afb8129dcf5d269bd54" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 42765 } }
I20260709 13:09:13.872062 30172 raft_consensus.cc:385] T 2351aaf3431e4d18906f7f7fa8bb4f5c P 58a7cda73b3542718987bf815eed9b79 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:13.872503 30172 raft_consensus.cc:740] T 2351aaf3431e4d18906f7f7fa8bb4f5c P 58a7cda73b3542718987bf815eed9b79 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 58a7cda73b3542718987bf815eed9b79, State: Initialized, Role: FOLLOWER
I20260709 13:09:13.873591 30172 consensus_queue.cc:260] T 2351aaf3431e4d18906f7f7fa8bb4f5c P 58a7cda73b3542718987bf815eed9b79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "58a7cda73b3542718987bf815eed9b79" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 37953 } } peers { permanent_uuid: "4bc679ad21a64bfe93bf64ff1b6ba3b2" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 33075 } } peers { permanent_uuid: "37897779fb894afb8129dcf5d269bd54" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 42765 } }
I20260709 13:09:13.876881 30172 ts_tablet_manager.cc:1434] T 2351aaf3431e4d18906f7f7fa8bb4f5c P 58a7cda73b3542718987bf815eed9b79: Time spent starting tablet: real 0.010s	user 0.008s	sys 0.000s
I20260709 13:09:13.878342 30172 tablet_bootstrap.cc:492] T d90287f9e65f48c9b8ebdcaf7fe0dde2 P 58a7cda73b3542718987bf815eed9b79: Bootstrap starting.
I20260709 13:09:13.879817 29878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2351aaf3431e4d18906f7f7fa8bb4f5c" candidate_uuid: "37897779fb894afb8129dcf5d269bd54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "58a7cda73b3542718987bf815eed9b79" is_pre_election: true
I20260709 13:09:13.880524 29878 raft_consensus.cc:2468] T 2351aaf3431e4d18906f7f7fa8bb4f5c P 58a7cda73b3542718987bf815eed9b79 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 37897779fb894afb8129dcf5d269bd54 in term 0.
I20260709 13:09:13.888996 30172 tablet_bootstrap.cc:654] T d90287f9e65f48c9b8ebdcaf7fe0dde2 P 58a7cda73b3542718987bf815eed9b79: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:13.890125 30144 raft_consensus.cc:697] T 40017481861c42efa46273995f000081 P 58a7cda73b3542718987bf815eed9b79 [term 1 LEADER]: Becoming Leader. State: Replica: 58a7cda73b3542718987bf815eed9b79, State: Running, Role: LEADER
I20260709 13:09:13.903601 30172 tablet_bootstrap.cc:492] T d90287f9e65f48c9b8ebdcaf7fe0dde2 P 58a7cda73b3542718987bf815eed9b79: No bootstrap required, opened a new log
I20260709 13:09:13.904529 30172 ts_tablet_manager.cc:1403] T d90287f9e65f48c9b8ebdcaf7fe0dde2 P 58a7cda73b3542718987bf815eed9b79: Time spent bootstrapping tablet: real 0.027s	user 0.017s	sys 0.007s
I20260709 13:09:13.906216 30144 consensus_queue.cc:237] T 40017481861c42efa46273995f000081 P 58a7cda73b3542718987bf815eed9b79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "58a7cda73b3542718987bf815eed9b79" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 37953 } } peers { permanent_uuid: "4bc679ad21a64bfe93bf64ff1b6ba3b2" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 33075 } } peers { permanent_uuid: "37897779fb894afb8129dcf5d269bd54" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 42765 } }
I20260709 13:09:13.912763 30172 raft_consensus.cc:359] T d90287f9e65f48c9b8ebdcaf7fe0dde2 P 58a7cda73b3542718987bf815eed9b79 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "58a7cda73b3542718987bf815eed9b79" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 37953 } } peers { permanent_uuid: "4bc679ad21a64bfe93bf64ff1b6ba3b2" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 33075 } } peers { permanent_uuid: "37897779fb894afb8129dcf5d269bd54" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 42765 } }
I20260709 13:09:13.914124 30172 raft_consensus.cc:385] T d90287f9e65f48c9b8ebdcaf7fe0dde2 P 58a7cda73b3542718987bf815eed9b79 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:13.914773 30172 raft_consensus.cc:740] T d90287f9e65f48c9b8ebdcaf7fe0dde2 P 58a7cda73b3542718987bf815eed9b79 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 58a7cda73b3542718987bf815eed9b79, State: Initialized, Role: FOLLOWER
I20260709 13:09:13.916023 30169 tablet_bootstrap.cc:492] T 5ccb587267a8414180b1f5474e4e2728 P 4bc679ad21a64bfe93bf64ff1b6ba3b2: No bootstrap required, opened a new log
I20260709 13:09:13.915869 30172 consensus_queue.cc:260] T d90287f9e65f48c9b8ebdcaf7fe0dde2 P 58a7cda73b3542718987bf815eed9b79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "58a7cda73b3542718987bf815eed9b79" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 37953 } } peers { permanent_uuid: "4bc679ad21a64bfe93bf64ff1b6ba3b2" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 33075 } } peers { permanent_uuid: "37897779fb894afb8129dcf5d269bd54" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 42765 } }
I20260709 13:09:13.916674 30169 ts_tablet_manager.cc:1403] T 5ccb587267a8414180b1f5474e4e2728 P 4bc679ad21a64bfe93bf64ff1b6ba3b2: Time spent bootstrapping tablet: real 0.185s	user 0.051s	sys 0.121s
I20260709 13:09:13.919404 30172 ts_tablet_manager.cc:1434] T d90287f9e65f48c9b8ebdcaf7fe0dde2 P 58a7cda73b3542718987bf815eed9b79: Time spent starting tablet: real 0.014s	user 0.006s	sys 0.005s
I20260709 13:09:13.919986 30169 raft_consensus.cc:359] T 5ccb587267a8414180b1f5474e4e2728 P 4bc679ad21a64bfe93bf64ff1b6ba3b2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "58a7cda73b3542718987bf815eed9b79" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 37953 } } peers { permanent_uuid: "4bc679ad21a64bfe93bf64ff1b6ba3b2" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 33075 } } peers { permanent_uuid: "37897779fb894afb8129dcf5d269bd54" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 42765 } }
I20260709 13:09:13.920748 30169 raft_consensus.cc:385] T 5ccb587267a8414180b1f5474e4e2728 P 4bc679ad21a64bfe93bf64ff1b6ba3b2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:13.920770 30172 tablet_bootstrap.cc:492] T 273ea248a58742f998fd8e9dc55097fc P 58a7cda73b3542718987bf815eed9b79: Bootstrap starting.
I20260709 13:09:13.921082 30169 raft_consensus.cc:740] T 5ccb587267a8414180b1f5474e4e2728 P 4bc679ad21a64bfe93bf64ff1b6ba3b2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4bc679ad21a64bfe93bf64ff1b6ba3b2, State: Initialized, Role: FOLLOWER
I20260709 13:09:13.921950 30169 consensus_queue.cc:260] T 5ccb587267a8414180b1f5474e4e2728 P 4bc679ad21a64bfe93bf64ff1b6ba3b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "58a7cda73b3542718987bf815eed9b79" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 37953 } } peers { permanent_uuid: "4bc679ad21a64bfe93bf64ff1b6ba3b2" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 33075 } } peers { permanent_uuid: "37897779fb894afb8129dcf5d269bd54" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 42765 } }
I20260709 13:09:13.924363 30169 ts_tablet_manager.cc:1434] T 5ccb587267a8414180b1f5474e4e2728 P 4bc679ad21a64bfe93bf64ff1b6ba3b2: Time spent starting tablet: real 0.007s	user 0.003s	sys 0.003s
I20260709 13:09:13.925338 30169 tablet_bootstrap.cc:492] T 797710d1534045c3a8597c9800a09ea6 P 4bc679ad21a64bfe93bf64ff1b6ba3b2: Bootstrap starting.
I20260709 13:09:13.924716 29775 catalog_manager.cc:5697] T d8a815244f7c485b980dfa0adb0fd2a9 P 4bc679ad21a64bfe93bf64ff1b6ba3b2 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4bc679ad21a64bfe93bf64ff1b6ba3b2 (127.17.223.2). New cstate: current_term: 1 leader_uuid: "4bc679ad21a64bfe93bf64ff1b6ba3b2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "58a7cda73b3542718987bf815eed9b79" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 37953 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4bc679ad21a64bfe93bf64ff1b6ba3b2" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 33075 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "37897779fb894afb8129dcf5d269bd54" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 42765 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:13.932143 30189 raft_consensus.cc:493] T 273ea248a58742f998fd8e9dc55097fc P 4bc679ad21a64bfe93bf64ff1b6ba3b2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:13.932601 30169 tablet_bootstrap.cc:654] T 797710d1534045c3a8597c9800a09ea6 P 4bc679ad21a64bfe93bf64ff1b6ba3b2: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:13.932711 30189 raft_consensus.cc:515] T 273ea248a58742f998fd8e9dc55097fc P 4bc679ad21a64bfe93bf64ff1b6ba3b2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "58a7cda73b3542718987bf815eed9b79" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 37953 } } peers { permanent_uuid: "4bc679ad21a64bfe93bf64ff1b6ba3b2" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 33075 } } peers { permanent_uuid: "37897779fb894afb8129dcf5d269bd54" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 42765 } }
I20260709 13:09:13.934737 30172 tablet_bootstrap.cc:654] T 273ea248a58742f998fd8e9dc55097fc P 58a7cda73b3542718987bf815eed9b79: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:13.936322 30026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "273ea248a58742f998fd8e9dc55097fc" candidate_uuid: "4bc679ad21a64bfe93bf64ff1b6ba3b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "37897779fb894afb8129dcf5d269bd54" is_pre_election: true
W20260709 13:09:13.938028 29916 leader_election.cc:343] T 273ea248a58742f998fd8e9dc55097fc P 4bc679ad21a64bfe93bf64ff1b6ba3b2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 37897779fb894afb8129dcf5d269bd54 (127.17.223.3:42765): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:13.938858 30189 leader_election.cc:290] T 273ea248a58742f998fd8e9dc55097fc P 4bc679ad21a64bfe93bf64ff1b6ba3b2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 58a7cda73b3542718987bf815eed9b79 (127.17.223.1:37953), 37897779fb894afb8129dcf5d269bd54 (127.17.223.3:42765)
I20260709 13:09:13.944661 30169 tablet_bootstrap.cc:492] T 797710d1534045c3a8597c9800a09ea6 P 4bc679ad21a64bfe93bf64ff1b6ba3b2: No bootstrap required, opened a new log
I20260709 13:09:13.945320 30169 ts_tablet_manager.cc:1403] T 797710d1534045c3a8597c9800a09ea6 P 4bc679ad21a64bfe93bf64ff1b6ba3b2: Time spent bootstrapping tablet: real 0.020s	user 0.016s	sys 0.000s
I20260709 13:09:13.948822 30169 raft_consensus.cc:359] T 797710d1534045c3a8597c9800a09ea6 P 4bc679ad21a64bfe93bf64ff1b6ba3b2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "58a7cda73b3542718987bf815eed9b79" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 37953 } } peers { permanent_uuid: "4bc679ad21a64bfe93bf64ff1b6ba3b2" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 33075 } } peers { permanent_uuid: "37897779fb894afb8129dcf5d269bd54" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 42765 } }
I20260709 13:09:13.949638 30169 raft_consensus.cc:385] T 797710d1534045c3a8597c9800a09ea6 P 4bc679ad21a64bfe93bf64ff1b6ba3b2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:13.949951 30169 raft_consensus.cc:740] T 797710d1534045c3a8597c9800a09ea6 P 4bc679ad21a64bfe93bf64ff1b6ba3b2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4bc679ad21a64bfe93bf64ff1b6ba3b2, State: Initialized, Role: FOLLOWER
I20260709 13:09:13.950717 30169 consensus_queue.cc:260] T 797710d1534045c3a8597c9800a09ea6 P 4bc679ad21a64bfe93bf64ff1b6ba3b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "58a7cda73b3542718987bf815eed9b79" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 37953 } } peers { permanent_uuid: "4bc679ad21a64bfe93bf64ff1b6ba3b2" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 33075 } } peers { permanent_uuid: "37897779fb894afb8129dcf5d269bd54" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 42765 } }
I20260709 13:09:13.953322 30169 ts_tablet_manager.cc:1434] T 797710d1534045c3a8597c9800a09ea6 P 4bc679ad21a64bfe93bf64ff1b6ba3b2: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 13:09:13.953855 30193 raft_consensus.cc:493] T d90287f9e65f48c9b8ebdcaf7fe0dde2 P 58a7cda73b3542718987bf815eed9b79 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:13.954428 30169 tablet_bootstrap.cc:492] T fa4b1db9a2d44d45bc9935975428592e P 4bc679ad21a64bfe93bf64ff1b6ba3b2: Bootstrap starting.
I20260709 13:09:13.954428 30193 raft_consensus.cc:515] T d90287f9e65f48c9b8ebdcaf7fe0dde2 P 58a7cda73b3542718987bf815eed9b79 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "58a7cda73b3542718987bf815eed9b79" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 37953 } } peers { permanent_uuid: "4bc679ad21a64bfe93bf64ff1b6ba3b2" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 33075 } } peers { permanent_uuid: "37897779fb894afb8129dcf5d269bd54" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 42765 } }
I20260709 13:09:13.959017 29952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d90287f9e65f48c9b8ebdcaf7fe0dde2" candidate_uuid: "58a7cda73b3542718987bf815eed9b79" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4bc679ad21a64bfe93bf64ff1b6ba3b2" is_pre_election: true
W20260709 13:09:13.960604 29842 leader_election.cc:343] T d90287f9e65f48c9b8ebdcaf7fe0dde2 P 58a7cda73b3542718987bf815eed9b79 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4bc679ad21a64bfe93bf64ff1b6ba3b2 (127.17.223.2:33075): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:13.961794 30169 tablet_bootstrap.cc:654] T fa4b1db9a2d44d45bc9935975428592e P 4bc679ad21a64bfe93bf64ff1b6ba3b2: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:13.962774 30026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d90287f9e65f48c9b8ebdcaf7fe0dde2" candidate_uuid: "58a7cda73b3542718987bf815eed9b79" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "37897779fb894afb8129dcf5d269bd54" is_pre_election: true
W20260709 13:09:13.964325 29841 leader_election.cc:343] T d90287f9e65f48c9b8ebdcaf7fe0dde2 P 58a7cda73b3542718987bf815eed9b79 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 37897779fb894afb8129dcf5d269bd54 (127.17.223.3:42765): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:13.964910 29841 leader_election.cc:304] T d90287f9e65f48c9b8ebdcaf7fe0dde2 P 58a7cda73b3542718987bf815eed9b79 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 58a7cda73b3542718987bf815eed9b79; no voters: 37897779fb894afb8129dcf5d269bd54, 4bc679ad21a64bfe93bf64ff1b6ba3b2
I20260709 13:09:13.966207 30191 raft_consensus.cc:2749] T d90287f9e65f48c9b8ebdcaf7fe0dde2 P 58a7cda73b3542718987bf815eed9b79 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:13.967715 30157 raft_consensus.cc:515] T 2351aaf3431e4d18906f7f7fa8bb4f5c P 37897779fb894afb8129dcf5d269bd54 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "58a7cda73b3542718987bf815eed9b79" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 37953 } } peers { permanent_uuid: "4bc679ad21a64bfe93bf64ff1b6ba3b2" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 33075 } } peers { permanent_uuid: "37897779fb894afb8129dcf5d269bd54" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 42765 } }
I20260709 13:09:13.971661 29878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2351aaf3431e4d18906f7f7fa8bb4f5c" candidate_uuid: "37897779fb894afb8129dcf5d269bd54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "58a7cda73b3542718987bf815eed9b79"
I20260709 13:09:13.972676 29878 raft_consensus.cc:3060] T 2351aaf3431e4d18906f7f7fa8bb4f5c P 58a7cda73b3542718987bf815eed9b79 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:13.972802 29952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2351aaf3431e4d18906f7f7fa8bb4f5c" candidate_uuid: "37897779fb894afb8129dcf5d269bd54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4bc679ad21a64bfe93bf64ff1b6ba3b2"
I20260709 13:09:13.973291 30169 tablet_bootstrap.cc:492] T fa4b1db9a2d44d45bc9935975428592e P 4bc679ad21a64bfe93bf64ff1b6ba3b2: No bootstrap required, opened a new log
I20260709 13:09:13.973474 29952 raft_consensus.cc:3060] T 2351aaf3431e4d18906f7f7fa8bb4f5c P 4bc679ad21a64bfe93bf64ff1b6ba3b2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:13.973824 30169 ts_tablet_manager.cc:1403] T fa4b1db9a2d44d45bc9935975428592e P 4bc679ad21a64bfe93bf64ff1b6ba3b2: Time spent bootstrapping tablet: real 0.020s	user 0.008s	sys 0.008s
I20260709 13:09:13.976954 30169 raft_consensus.cc:359] T fa4b1db9a2d44d45bc9935975428592e P 4bc679ad21a64bfe93bf64ff1b6ba3b2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "58a7cda73b3542718987bf815eed9b79" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 37953 } } peers { permanent_uuid: "4bc679ad21a64bfe93bf64ff1b6ba3b2" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 33075 } } peers { permanent_uuid: "37897779fb894afb8129dcf5d269bd54" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 42765 } }
I20260709 13:09:13.977644 30169 raft_consensus.cc:385] T fa4b1db9a2d44d45bc9935975428592e P 4bc679ad21a64bfe93bf64ff1b6ba3b2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:13.977916 30169 raft_consensus.cc:740] T fa4b1db9a2d44d45bc9935975428592e P 4bc679ad21a64bfe93bf64ff1b6ba3b2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4bc679ad21a64bfe93bf64ff1b6ba3b2, State: Initialized, Role: FOLLOWER
I20260709 13:09:13.978886 30169 consensus_queue.cc:260] T fa4b1db9a2d44d45bc9935975428592e P 4bc679ad21a64bfe93bf64ff1b6ba3b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "58a7cda73b3542718987bf815eed9b79" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 37953 } } peers { permanent_uuid: "4bc679ad21a64bfe93bf64ff1b6ba3b2" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 33075 } } peers { permanent_uuid: "37897779fb894afb8129dcf5d269bd54" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 42765 } }
I20260709 13:09:13.981011 30169 ts_tablet_manager.cc:1434] T fa4b1db9a2d44d45bc9935975428592e P 4bc679ad21a64bfe93bf64ff1b6ba3b2: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 13:09:13.982008 30169 tablet_bootstrap.cc:492] T d90287f9e65f48c9b8ebdcaf7fe0dde2 P 4bc679ad21a64bfe93bf64ff1b6ba3b2: Bootstrap starting.
I20260709 13:09:13.982302 29952 raft_consensus.cc:2468] T 2351aaf3431e4d18906f7f7fa8bb4f5c P 4bc679ad21a64bfe93bf64ff1b6ba3b2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 37897779fb894afb8129dcf5d269bd54 in term 1.
I20260709 13:09:13.983664 29991 leader_election.cc:304] T 2351aaf3431e4d18906f7f7fa8bb4f5c P 37897779fb894afb8129dcf5d269bd54 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 37897779fb894afb8129dcf5d269bd54, 4bc679ad21a64bfe93bf64ff1b6ba3b2; no voters: 
I20260709 13:09:13.989436 30169 tablet_bootstrap.cc:654] T d90287f9e65f48c9b8ebdcaf7fe0dde2 P 4bc679ad21a64bfe93bf64ff1b6ba3b2: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:13.989915 29878 raft_consensus.cc:2468] T 2351aaf3431e4d18906f7f7fa8bb4f5c P 58a7cda73b3542718987bf815eed9b79 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 37897779fb894afb8129dcf5d269bd54 in term 1.
W20260709 13:09:13.990075 29919 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.1:37953, user_credentials={real_user=slave}} blocked reactor thread for 203620us
I20260709 13:09:13.992616 29876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "273ea248a58742f998fd8e9dc55097fc" candidate_uuid: "4bc679ad21a64bfe93bf64ff1b6ba3b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "58a7cda73b3542718987bf815eed9b79" is_pre_election: true
I20260709 13:09:14.001858 30169 tablet_bootstrap.cc:492] T d90287f9e65f48c9b8ebdcaf7fe0dde2 P 4bc679ad21a64bfe93bf64ff1b6ba3b2: No bootstrap required, opened a new log
I20260709 13:09:14.002584 30169 ts_tablet_manager.cc:1403] T d90287f9e65f48c9b8ebdcaf7fe0dde2 P 4bc679ad21a64bfe93bf64ff1b6ba3b2: Time spent bootstrapping tablet: real 0.021s	user 0.015s	sys 0.003s
I20260709 13:09:14.006161 30169 raft_consensus.cc:359] T d90287f9e65f48c9b8ebdcaf7fe0dde2 P 4bc679ad21a64bfe93bf64ff1b6ba3b2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "58a7cda73b3542718987bf815eed9b79" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 37953 } } peers { permanent_uuid: "4bc679ad21a64bfe93bf64ff1b6ba3b2" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 33075 } } peers { permanent_uuid: "37897779fb894afb8129dcf5d269bd54" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 42765 } }
I20260709 13:09:14.007092 30169 raft_consensus.cc:385] T d90287f9e65f48c9b8ebdcaf7fe0dde2 P 4bc679ad21a64bfe93bf64ff1b6ba3b2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:14.007412 30169 raft_consensus.cc:740] T d90287f9e65f48c9b8ebdcaf7fe0dde2 P 4bc679ad21a64bfe93bf64ff1b6ba3b2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4bc679ad21a64bfe93bf64ff1b6ba3b2, State: Initialized, Role: FOLLOWER
I20260709 13:09:14.008347 30169 consensus_queue.cc:260] T d90287f9e65f48c9b8ebdcaf7fe0dde2 P 4bc679ad21a64bfe93bf64ff1b6ba3b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "58a7cda73b3542718987bf815eed9b79" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 37953 } } peers { permanent_uuid: "4bc679ad21a64bfe93bf64ff1b6ba3b2" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 33075 } } peers { permanent_uuid: "37897779fb894afb8129dcf5d269bd54" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 42765 } }
I20260709 13:09:14.010704 30169 ts_tablet_manager.cc:1434] T d90287f9e65f48c9b8ebdcaf7fe0dde2 P 4bc679ad21a64bfe93bf64ff1b6ba3b2: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 13:09:14.022826 30201 raft_consensus.cc:2804] T 2351aaf3431e4d18906f7f7fa8bb4f5c P 37897779fb894afb8129dcf5d269bd54 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:14.024734 30193 leader_election.cc:290] T d90287f9e65f48c9b8ebdcaf7fe0dde2 P 58a7cda73b3542718987bf815eed9b79 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4bc679ad21a64bfe93bf64ff1b6ba3b2 (127.17.223.2:33075), 37897779fb894afb8129dcf5d269bd54 (127.17.223.3:42765)
I20260709 13:09:14.025369 30205 raft_consensus.cc:493] T fa4b1db9a2d44d45bc9935975428592e P 37897779fb894afb8129dcf5d269bd54 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:09:14.012517 29919 leader_election.cc:343] T 273ea248a58742f998fd8e9dc55097fc P 4bc679ad21a64bfe93bf64ff1b6ba3b2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 58a7cda73b3542718987bf815eed9b79 (127.17.223.1:37953): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:14.027118 29919 leader_election.cc:304] T 273ea248a58742f998fd8e9dc55097fc P 4bc679ad21a64bfe93bf64ff1b6ba3b2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4bc679ad21a64bfe93bf64ff1b6ba3b2; no voters: 37897779fb894afb8129dcf5d269bd54, 58a7cda73b3542718987bf815eed9b79
I20260709 13:09:14.028162 30157 leader_election.cc:290] T 2351aaf3431e4d18906f7f7fa8bb4f5c P 37897779fb894afb8129dcf5d269bd54 [CANDIDATE]: Term 1 election: Requested vote from peers 58a7cda73b3542718987bf815eed9b79 (127.17.223.1:37953), 4bc679ad21a64bfe93bf64ff1b6ba3b2 (127.17.223.2:33075)
I20260709 13:09:14.026162 30205 raft_consensus.cc:515] T fa4b1db9a2d44d45bc9935975428592e P 37897779fb894afb8129dcf5d269bd54 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "58a7cda73b3542718987bf815eed9b79" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 37953 } } peers { permanent_uuid: "4bc679ad21a64bfe93bf64ff1b6ba3b2" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 33075 } } peers { permanent_uuid: "37897779fb894afb8129dcf5d269bd54" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 42765 } }
I20260709 13:09:14.031064 30173 raft_consensus.cc:2749] T 273ea248a58742f998fd8e9dc55097fc P 4bc679ad21a64bfe93bf64ff1b6ba3b2 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:14.036190 29876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa4b1db9a2d44d45bc9935975428592e" candidate_uuid: "37897779fb894afb8129dcf5d269bd54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "58a7cda73b3542718987bf815eed9b79" is_pre_election: true
I20260709 13:09:14.037483 30201 raft_consensus.cc:697] T 2351aaf3431e4d18906f7f7fa8bb4f5c P 37897779fb894afb8129dcf5d269bd54 [term 1 LEADER]: Becoming Leader. State: Replica: 37897779fb894afb8129dcf5d269bd54, State: Running, Role: LEADER
W20260709 13:09:14.037859 29993 leader_election.cc:343] T fa4b1db9a2d44d45bc9935975428592e P 37897779fb894afb8129dcf5d269bd54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 58a7cda73b3542718987bf815eed9b79 (127.17.223.1:37953): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:14.038830 30201 consensus_queue.cc:237] T 2351aaf3431e4d18906f7f7fa8bb4f5c P 37897779fb894afb8129dcf5d269bd54 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "58a7cda73b3542718987bf815eed9b79" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 37953 } } peers { permanent_uuid: "4bc679ad21a64bfe93bf64ff1b6ba3b2" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 33075 } } peers { permanent_uuid: "37897779fb894afb8129dcf5d269bd54" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 42765 } }
I20260709 13:09:14.039433 30171 tablet_bootstrap.cc:492] T 273ea248a58742f998fd8e9dc55097fc P 37897779fb894afb8129dcf5d269bd54: No bootstrap required, opened a new log
I20260709 13:09:14.040179 30171 ts_tablet_manager.cc:1403] T 273ea248a58742f998fd8e9dc55097fc P 37897779fb894afb8129dcf5d269bd54: Time spent bootstrapping tablet: real 0.186s	user 0.059s	sys 0.065s
I20260709 13:09:14.036816 30205 leader_election.cc:290] T fa4b1db9a2d44d45bc9935975428592e P 37897779fb894afb8129dcf5d269bd54 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 58a7cda73b3542718987bf815eed9b79 (127.17.223.1:37953), 4bc679ad21a64bfe93bf64ff1b6ba3b2 (127.17.223.2:33075)
I20260709 13:09:14.044988 30171 raft_consensus.cc:359] T 273ea248a58742f998fd8e9dc55097fc P 37897779fb894afb8129dcf5d269bd54 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "58a7cda73b3542718987bf815eed9b79" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 37953 } } peers { permanent_uuid: "4bc679ad21a64bfe93bf64ff1b6ba3b2" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 33075 } } peers { permanent_uuid: "37897779fb894afb8129dcf5d269bd54" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 42765 } }
I20260709 13:09:14.048852 30171 raft_consensus.cc:385] T 273ea248a58742f998fd8e9dc55097fc P 37897779fb894afb8129dcf5d269bd54 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:14.050230 30171 raft_consensus.cc:740] T 273ea248a58742f998fd8e9dc55097fc P 37897779fb894afb8129dcf5d269bd54 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 37897779fb894afb8129dcf5d269bd54, State: Initialized, Role: FOLLOWER
I20260709 13:09:14.050640 29952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa4b1db9a2d44d45bc9935975428592e" candidate_uuid: "37897779fb894afb8129dcf5d269bd54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4bc679ad21a64bfe93bf64ff1b6ba3b2" is_pre_election: true
I20260709 13:09:14.051241 30171 consensus_queue.cc:260] T 273ea248a58742f998fd8e9dc55097fc P 37897779fb894afb8129dcf5d269bd54 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "58a7cda73b3542718987bf815eed9b79" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 37953 } } peers { permanent_uuid: "4bc679ad21a64bfe93bf64ff1b6ba3b2" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 33075 } } peers { permanent_uuid: "37897779fb894afb8129dcf5d269bd54" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 42765 } }
I20260709 13:09:14.051697 29952 raft_consensus.cc:2468] T fa4b1db9a2d44d45bc9935975428592e P 4bc679ad21a64bfe93bf64ff1b6ba3b2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 37897779fb894afb8129dcf5d269bd54 in term 0.
I20260709 13:09:14.053440 29991 leader_election.cc:304] T fa4b1db9a2d44d45bc9935975428592e P 37897779fb894afb8129dcf5d269bd54 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 37897779fb894afb8129dcf5d269bd54, 4bc679ad21a64bfe93bf64ff1b6ba3b2; no voters: 58a7cda73b3542718987bf815eed9b79
I20260709 13:09:14.054042 30171 ts_tablet_manager.cc:1434] T 273ea248a58742f998fd8e9dc55097fc P 37897779fb894afb8129dcf5d269bd54: Time spent starting tablet: real 0.013s	user 0.007s	sys 0.000s
I20260709 13:09:14.054456 30172 tablet_bootstrap.cc:492] T 273ea248a58742f998fd8e9dc55097fc P 58a7cda73b3542718987bf815eed9b79: No bootstrap required, opened a new log
I20260709 13:09:14.054332 30201 raft_consensus.cc:2804] T fa4b1db9a2d44d45bc9935975428592e P 37897779fb894afb8129dcf5d269bd54 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:14.055097 30172 ts_tablet_manager.cc:1403] T 273ea248a58742f998fd8e9dc55097fc P 58a7cda73b3542718987bf815eed9b79: Time spent bootstrapping tablet: real 0.135s	user 0.049s	sys 0.065s
I20260709 13:09:14.055124 30171 tablet_bootstrap.cc:492] T 40017481861c42efa46273995f000081 P 37897779fb894afb8129dcf5d269bd54: Bootstrap starting.
I20260709 13:09:14.055328 30201 raft_consensus.cc:493] T fa4b1db9a2d44d45bc9935975428592e P 37897779fb894afb8129dcf5d269bd54 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:14.055951 30201 raft_consensus.cc:3060] T fa4b1db9a2d44d45bc9935975428592e P 37897779fb894afb8129dcf5d269bd54 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:14.058578 30172 raft_consensus.cc:359] T 273ea248a58742f998fd8e9dc55097fc P 58a7cda73b3542718987bf815eed9b79 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "58a7cda73b3542718987bf815eed9b79" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 37953 } } peers { permanent_uuid: "4bc679ad21a64bfe93bf64ff1b6ba3b2" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 33075 } } peers { permanent_uuid: "37897779fb894afb8129dcf5d269bd54" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 42765 } }
I20260709 13:09:14.059504 30172 raft_consensus.cc:385] T 273ea248a58742f998fd8e9dc55097fc P 58a7cda73b3542718987bf815eed9b79 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:14.059917 30172 raft_consensus.cc:740] T 273ea248a58742f998fd8e9dc55097fc P 58a7cda73b3542718987bf815eed9b79 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 58a7cda73b3542718987bf815eed9b79, State: Initialized, Role: FOLLOWER
I20260709 13:09:14.060767 30172 consensus_queue.cc:260] T 273ea248a58742f998fd8e9dc55097fc P 58a7cda73b3542718987bf815eed9b79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "58a7cda73b3542718987bf815eed9b79" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 37953 } } peers { permanent_uuid: "4bc679ad21a64bfe93bf64ff1b6ba3b2" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 33075 } } peers { permanent_uuid: "37897779fb894afb8129dcf5d269bd54" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 42765 } }
I20260709 13:09:14.063035 30172 ts_tablet_manager.cc:1434] T 273ea248a58742f998fd8e9dc55097fc P 58a7cda73b3542718987bf815eed9b79: Time spent starting tablet: real 0.007s	user 0.002s	sys 0.004s
I20260709 13:09:14.063710 30171 tablet_bootstrap.cc:654] T 40017481861c42efa46273995f000081 P 37897779fb894afb8129dcf5d269bd54: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:14.064095 30172 tablet_bootstrap.cc:492] T fa4b1db9a2d44d45bc9935975428592e P 58a7cda73b3542718987bf815eed9b79: Bootstrap starting.
I20260709 13:09:14.063674 30189 consensus_queue.cc:1048] T ea945f01fa404ea29878b0cd26af4e1e P 4bc679ad21a64bfe93bf64ff1b6ba3b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "58a7cda73b3542718987bf815eed9b79" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 37953 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:09:14.066587 30205 raft_consensus.cc:493] T 273ea248a58742f998fd8e9dc55097fc P 37897779fb894afb8129dcf5d269bd54 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:14.067175 30205 raft_consensus.cc:515] T 273ea248a58742f998fd8e9dc55097fc P 37897779fb894afb8129dcf5d269bd54 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "58a7cda73b3542718987bf815eed9b79" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 37953 } } peers { permanent_uuid: "4bc679ad21a64bfe93bf64ff1b6ba3b2" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 33075 } } peers { permanent_uuid: "37897779fb894afb8129dcf5d269bd54" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 42765 } }
I20260709 13:09:14.069527 30205 leader_election.cc:290] T 273ea248a58742f998fd8e9dc55097fc P 37897779fb894afb8129dcf5d269bd54 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 58a7cda73b3542718987bf815eed9b79 (127.17.223.1:37953), 4bc679ad21a64bfe93bf64ff1b6ba3b2 (127.17.223.2:33075)
I20260709 13:09:14.071631 29878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "273ea248a58742f998fd8e9dc55097fc" candidate_uuid: "37897779fb894afb8129dcf5d269bd54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "58a7cda73b3542718987bf815eed9b79" is_pre_election: true
I20260709 13:09:14.072232 30172 tablet_bootstrap.cc:654] T fa4b1db9a2d44d45bc9935975428592e P 58a7cda73b3542718987bf815eed9b79: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:14.072415 29878 raft_consensus.cc:2468] T 273ea248a58742f998fd8e9dc55097fc P 58a7cda73b3542718987bf815eed9b79 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 37897779fb894afb8129dcf5d269bd54 in term 0.
I20260709 13:09:14.073920 29993 leader_election.cc:304] T 273ea248a58742f998fd8e9dc55097fc P 37897779fb894afb8129dcf5d269bd54 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 37897779fb894afb8129dcf5d269bd54, 58a7cda73b3542718987bf815eed9b79; no voters: 
I20260709 13:09:14.076237 29776 catalog_manager.cc:5697] T 40017481861c42efa46273995f000081 P 58a7cda73b3542718987bf815eed9b79 reported cstate change: term changed from 0 to 1, leader changed from <none> to 58a7cda73b3542718987bf815eed9b79 (127.17.223.1). New cstate: current_term: 1 leader_uuid: "58a7cda73b3542718987bf815eed9b79" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "58a7cda73b3542718987bf815eed9b79" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 37953 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4bc679ad21a64bfe93bf64ff1b6ba3b2" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 33075 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "37897779fb894afb8129dcf5d269bd54" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 42765 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:14.078930 30205 raft_consensus.cc:2804] T 273ea248a58742f998fd8e9dc55097fc P 37897779fb894afb8129dcf5d269bd54 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:14.079573 30205 raft_consensus.cc:493] T 273ea248a58742f998fd8e9dc55097fc P 37897779fb894afb8129dcf5d269bd54 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:14.079906 30205 raft_consensus.cc:3060] T 273ea248a58742f998fd8e9dc55097fc P 37897779fb894afb8129dcf5d269bd54 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:14.090811 30205 raft_consensus.cc:515] T 273ea248a58742f998fd8e9dc55097fc P 37897779fb894afb8129dcf5d269bd54 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "58a7cda73b3542718987bf815eed9b79" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 37953 } } peers { permanent_uuid: "4bc679ad21a64bfe93bf64ff1b6ba3b2" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 33075 } } peers { permanent_uuid: "37897779fb894afb8129dcf5d269bd54" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 42765 } }
I20260709 13:09:14.094828 29878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "273ea248a58742f998fd8e9dc55097fc" candidate_uuid: "37897779fb894afb8129dcf5d269bd54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "58a7cda73b3542718987bf815eed9b79"
I20260709 13:09:14.095983 29878 raft_consensus.cc:3060] T 273ea248a58742f998fd8e9dc55097fc P 58a7cda73b3542718987bf815eed9b79 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:14.096159 29952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "273ea248a58742f998fd8e9dc55097fc" candidate_uuid: "37897779fb894afb8129dcf5d269bd54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4bc679ad21a64bfe93bf64ff1b6ba3b2" is_pre_election: true
I20260709 13:09:14.108497 29952 raft_consensus.cc:2468] T 273ea248a58742f998fd8e9dc55097fc P 4bc679ad21a64bfe93bf64ff1b6ba3b2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 37897779fb894afb8129dcf5d269bd54 in term 0.
I20260709 13:09:14.103312 30189 raft_consensus.cc:493] T 797710d1534045c3a8597c9800a09ea6 P 4bc679ad21a64bfe93bf64ff1b6ba3b2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:14.109212 30205 leader_election.cc:290] T 273ea248a58742f998fd8e9dc55097fc P 37897779fb894afb8129dcf5d269bd54 [CANDIDATE]: Term 1 election: Requested vote from peers 58a7cda73b3542718987bf815eed9b79 (127.17.223.1:37953), 4bc679ad21a64bfe93bf64ff1b6ba3b2 (127.17.223.2:33075)
I20260709 13:09:14.109599 30189 raft_consensus.cc:515] T 797710d1534045c3a8597c9800a09ea6 P 4bc679ad21a64bfe93bf64ff1b6ba3b2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "58a7cda73b3542718987bf815eed9b79" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 37953 } } peers { permanent_uuid: "4bc679ad21a64bfe93bf64ff1b6ba3b2" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 33075 } } peers { permanent_uuid: "37897779fb894afb8129dcf5d269bd54" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 42765 } }
I20260709 13:09:14.100252 29774 catalog_manager.cc:5697] T 2351aaf3431e4d18906f7f7fa8bb4f5c P 37897779fb894afb8129dcf5d269bd54 reported cstate change: term changed from 0 to 1, leader changed from <none> to 37897779fb894afb8129dcf5d269bd54 (127.17.223.3). New cstate: current_term: 1 leader_uuid: "37897779fb894afb8129dcf5d269bd54" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "58a7cda73b3542718987bf815eed9b79" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 37953 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4bc679ad21a64bfe93bf64ff1b6ba3b2" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 33075 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "37897779fb894afb8129dcf5d269bd54" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 42765 } health_report { overall_health: HEALTHY } } }
I20260709 13:09:14.115518 29875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "797710d1534045c3a8597c9800a09ea6" candidate_uuid: "4bc679ad21a64bfe93bf64ff1b6ba3b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "58a7cda73b3542718987bf815eed9b79" is_pre_election: true
I20260709 13:09:14.116271 29875 raft_consensus.cc:2468] T 797710d1534045c3a8597c9800a09ea6 P 58a7cda73b3542718987bf815eed9b79 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4bc679ad21a64bfe93bf64ff1b6ba3b2 in term 0.
I20260709 13:09:14.120687 29919 leader_election.cc:304] T 797710d1534045c3a8597c9800a09ea6 P 4bc679ad21a64bfe93bf64ff1b6ba3b2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4bc679ad21a64bfe93bf64ff1b6ba3b2, 58a7cda73b3542718987bf815eed9b79; no voters: 
I20260709 13:09:14.121654 30170 raft_consensus.cc:2804] T 797710d1534045c3a8597c9800a09ea6 P 4bc679ad21a64bfe93bf64ff1b6ba3b2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:14.122046 30170 raft_consensus.cc:493] T 797710d1534045c3a8597c9800a09ea6 P 4bc679ad21a64bfe93bf64ff1b6ba3b2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:14.122468 30170 raft_consensus.cc:3060] T 797710d1534045c3a8597c9800a09ea6 P 4bc679ad21a64bfe93bf64ff1b6ba3b2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:14.125386 30026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "797710d1534045c3a8597c9800a09ea6" candidate_uuid: "4bc679ad21a64bfe93bf64ff1b6ba3b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "37897779fb894afb8129dcf5d269bd54" is_pre_election: true
I20260709 13:09:14.130129 30191 raft_consensus.cc:493] T 5ccb587267a8414180b1f5474e4e2728 P 58a7cda73b3542718987bf815eed9b79 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:14.130131 29878 raft_consensus.cc:2468] T 273ea248a58742f998fd8e9dc55097fc P 58a7cda73b3542718987bf815eed9b79 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 37897779fb894afb8129dcf5d269bd54 in term 1.
I20260709 13:09:14.130959 30191 raft_consensus.cc:515] T 5ccb587267a8414180b1f5474e4e2728 P 58a7cda73b3542718987bf815eed9b79 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "58a7cda73b3542718987bf815eed9b79" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 37953 } } peers { permanent_uuid: "4bc679ad21a64bfe93bf64ff1b6ba3b2" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 33075 } } peers { permanent_uuid: "37897779fb894afb8129dcf5d269bd54" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 42765 } }
I20260709 13:09:14.133222 30191 leader_election.cc:290] T 5ccb587267a8414180b1f5474e4e2728 P 58a7cda73b3542718987bf815eed9b79 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4bc679ad21a64bfe93bf64ff1b6ba3b2 (127.17.223.2:33075), 37897779fb894afb8129dcf5d269bd54 (127.17.223.3:42765)
I20260709 13:09:14.138121 30189 leader_election.cc:290] T 797710d1534045c3a8597c9800a09ea6 P 4bc679ad21a64bfe93bf64ff1b6ba3b2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 58a7cda73b3542718987bf815eed9b79 (127.17.223.1:37953), 37897779fb894afb8129dcf5d269bd54 (127.17.223.3:42765)
W20260709 13:09:14.139150 29916 leader_election.cc:343] T 797710d1534045c3a8597c9800a09ea6 P 4bc679ad21a64bfe93bf64ff1b6ba3b2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 37897779fb894afb8129dcf5d269bd54 (127.17.223.3:42765): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:14.103003 29951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "273ea248a58742f998fd8e9dc55097fc" candidate_uuid: "37897779fb894afb8129dcf5d269bd54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4bc679ad21a64bfe93bf64ff1b6ba3b2"
I20260709 13:09:14.140321 29951 raft_consensus.cc:3060] T 273ea248a58742f998fd8e9dc55097fc P 4bc679ad21a64bfe93bf64ff1b6ba3b2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:14.137766 30170 raft_consensus.cc:515] T 797710d1534045c3a8597c9800a09ea6 P 4bc679ad21a64bfe93bf64ff1b6ba3b2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "58a7cda73b3542718987bf815eed9b79" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 37953 } } peers { permanent_uuid: "4bc679ad21a64bfe93bf64ff1b6ba3b2" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 33075 } } peers { permanent_uuid: "37897779fb894afb8129dcf5d269bd54" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 42765 } }
I20260709 13:09:14.143210 30026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ccb587267a8414180b1f5474e4e2728" candidate_uuid: "58a7cda73b3542718987bf815eed9b79" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "37897779fb894afb8129dcf5d269bd54" is_pre_election: true
I20260709 13:09:14.143484 30170 leader_election.cc:290] T 797710d1534045c3a8597c9800a09ea6 P 4bc679ad21a64bfe93bf64ff1b6ba3b2 [CANDIDATE]: Term 1 election: Requested vote from peers 58a7cda73b3542718987bf815eed9b79 (127.17.223.1:37953), 37897779fb894afb8129dcf5d269bd54 (127.17.223.3:42765)
W20260709 13:09:14.144824 29841 leader_election.cc:343] T 5ccb587267a8414180b1f5474e4e2728 P 58a7cda73b3542718987bf815eed9b79 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 37897779fb894afb8129dcf5d269bd54 (127.17.223.3:42765): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:14.146559 29875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "797710d1534045c3a8597c9800a09ea6" candidate_uuid: "4bc679ad21a64bfe93bf64ff1b6ba3b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "58a7cda73b3542718987bf815eed9b79"
I20260709 13:09:14.147349 29875 raft_consensus.cc:3060] T 797710d1534045c3a8597c9800a09ea6 P 58a7cda73b3542718987bf815eed9b79 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:14.147710 30026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "797710d1534045c3a8597c9800a09ea6" candidate_uuid: "4bc679ad21a64bfe93bf64ff1b6ba3b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "37897779fb894afb8129dcf5d269bd54"
I20260709 13:09:14.147878 29952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ccb587267a8414180b1f5474e4e2728" candidate_uuid: "58a7cda73b3542718987bf815eed9b79" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4bc679ad21a64bfe93bf64ff1b6ba3b2" is_pre_election: true
W20260709 13:09:14.149143 29916 leader_election.cc:343] T 797710d1534045c3a8597c9800a09ea6 P 4bc679ad21a64bfe93bf64ff1b6ba3b2 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 37897779fb894afb8129dcf5d269bd54 (127.17.223.3:42765): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:14.148404 29952 raft_consensus.cc:2468] T 5ccb587267a8414180b1f5474e4e2728 P 4bc679ad21a64bfe93bf64ff1b6ba3b2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 58a7cda73b3542718987bf815eed9b79 in term 0.
I20260709 13:09:14.097430 30201 raft_consensus.cc:515] T fa4b1db9a2d44d45bc9935975428592e P 37897779fb894afb8129dcf5d269bd54 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "58a7cda73b3542718987bf815eed9b79" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 37953 } } peers { permanent_uuid: "4bc679ad21a64bfe93bf64ff1b6ba3b2" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 33075 } } peers { permanent_uuid: "37897779fb894afb8129dcf5d269bd54" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 42765 } }
I20260709 13:09:14.150871 29842 leader_election.cc:304] T 5ccb587267a8414180b1f5474e4e2728 P 58a7cda73b3542718987bf815eed9b79 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4bc679ad21a64bfe93bf64ff1b6ba3b2, 58a7cda73b3542718987bf815eed9b79; no voters: 37897779fb894afb8129dcf5d269bd54
I20260709 13:09:14.152086 30191 raft_consensus.cc:2804] T 5ccb587267a8414180b1f5474e4e2728 P 58a7cda73b3542718987bf815eed9b79 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:14.152433 30191 raft_consensus.cc:493] T 5ccb587267a8414180b1f5474e4e2728 P 58a7cda73b3542718987bf815eed9b79 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:14.152741 30191 raft_consensus.cc:3060] T 5ccb587267a8414180b1f5474e4e2728 P 58a7cda73b3542718987bf815eed9b79 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:14.155972 29993 leader_election.cc:304] T 273ea248a58742f998fd8e9dc55097fc P 37897779fb894afb8129dcf5d269bd54 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 37897779fb894afb8129dcf5d269bd54, 58a7cda73b3542718987bf815eed9b79; no voters: 
I20260709 13:09:14.156973 30205 raft_consensus.cc:2804] T 273ea248a58742f998fd8e9dc55097fc P 37897779fb894afb8129dcf5d269bd54 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:14.157485 30205 raft_consensus.cc:697] T 273ea248a58742f998fd8e9dc55097fc P 37897779fb894afb8129dcf5d269bd54 [term 1 LEADER]: Becoming Leader. State: Replica: 37897779fb894afb8129dcf5d269bd54, State: Running, Role: LEADER
I20260709 13:09:14.158283 30205 consensus_queue.cc:237] T 273ea248a58742f998fd8e9dc55097fc P 37897779fb894afb8129dcf5d269bd54 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "58a7cda73b3542718987bf815eed9b79" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 37953 } } peers { permanent_uuid: "4bc679ad21a64bfe93bf64ff1b6ba3b2" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 33075 } } peers { permanent_uuid: "37897779fb894afb8129dcf5d269bd54" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 42765 } }
I20260709 13:09:14.161954 29875 raft_consensus.cc:2468] T 797710d1534045c3a8597c9800a09ea6 P 58a7cda73b3542718987bf815eed9b79 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4bc679ad21a64bfe93bf64ff1b6ba3b2 in term 1.
I20260709 13:09:14.162065 30191 raft_consensus.cc:515] T 5ccb587267a8414180b1f5474e4e2728 P 58a7cda73b3542718987bf815eed9b79 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "58a7cda73b3542718987bf815eed9b79" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 37953 } } peers { permanent_uuid: "4bc679ad21a64bfe93bf64ff1b6ba3b2" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 33075 } } peers { permanent_uuid: "37897779fb894afb8129dcf5d269bd54" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 42765 } }
I20260709 13:09:14.163908 29919 leader_election.cc:304] T 797710d1534045c3a8597c9800a09ea6 P 4bc679ad21a64bfe93bf64ff1b6ba3b2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4bc679ad21a64bfe93bf64ff1b6ba3b2, 58a7cda73b3542718987bf815eed9b79; no voters: 37897779fb894afb8129dcf5d269bd54
I20260709 13:09:14.165460 30170 raft_consensus.cc:2804] T 797710d1534045c3a8597c9800a09ea6 P 4bc679ad21a64bfe93bf64ff1b6ba3b2 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:14.166034 30170 raft_consensus.cc:697] T 797710d1534045c3a8597c9800a09ea6 P 4bc679ad21a64bfe93bf64ff1b6ba3b2 [term 1 LEADER]: Becoming Leader. State: Replica: 4bc679ad21a64bfe93bf64ff1b6ba3b2, State: Running, Role: LEADER
I20260709 13:09:14.166915 30170 consensus_queue.cc:237] T 797710d1534045c3a8597c9800a09ea6 P 4bc679ad21a64bfe93bf64ff1b6ba3b2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "58a7cda73b3542718987bf815eed9b79" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 37953 } } peers { permanent_uuid: "4bc679ad21a64bfe93bf64ff1b6ba3b2" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 33075 } } peers { permanent_uuid: "37897779fb894afb8129dcf5d269bd54" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 42765 } }
I20260709 13:09:14.168810 29878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa4b1db9a2d44d45bc9935975428592e" candidate_uuid: "37897779fb894afb8129dcf5d269bd54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "58a7cda73b3542718987bf815eed9b79"
I20260709 13:09:14.173377 30172 tablet_bootstrap.cc:492] T fa4b1db9a2d44d45bc9935975428592e P 58a7cda73b3542718987bf815eed9b79: No bootstrap required, opened a new log
I20260709 13:09:14.173910 30172 ts_tablet_manager.cc:1403] T fa4b1db9a2d44d45bc9935975428592e P 58a7cda73b3542718987bf815eed9b79: Time spent bootstrapping tablet: real 0.110s	user 0.018s	sys 0.030s
I20260709 13:09:14.177184 30172 raft_consensus.cc:359] T fa4b1db9a2d44d45bc9935975428592e P 58a7cda73b3542718987bf815eed9b79 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "58a7cda73b3542718987bf815eed9b79" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 37953 } } peers { permanent_uuid: "4bc679ad21a64bfe93bf64ff1b6ba3b2" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 33075 } } peers { permanent_uuid: "37897779fb894afb8129dcf5d269bd54" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 42765 } }
I20260709 13:09:14.178246 30172 raft_consensus.cc:385] T fa4b1db9a2d44d45bc9935975428592e P 58a7cda73b3542718987bf815eed9b79 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:14.177044 29775 catalog_manager.cc:5697] T 273ea248a58742f998fd8e9dc55097fc P 37897779fb894afb8129dcf5d269bd54 reported cstate change: term changed from 0 to 1, leader changed from <none> to 37897779fb894afb8129dcf5d269bd54 (127.17.223.3). New cstate: current_term: 1 leader_uuid: "37897779fb894afb8129dcf5d269bd54" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "58a7cda73b3542718987bf815eed9b79" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 37953 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4bc679ad21a64bfe93bf64ff1b6ba3b2" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 33075 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "37897779fb894afb8129dcf5d269bd54" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 42765 } health_report { overall_health: HEALTHY } } }
W20260709 13:09:14.181578 29993 leader_election.cc:343] T fa4b1db9a2d44d45bc9935975428592e P 37897779fb894afb8129dcf5d269bd54 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 58a7cda73b3542718987bf815eed9b79 (127.17.223.1:37953): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:14.165465 29952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ccb587267a8414180b1f5474e4e2728" candidate_uuid: "58a7cda73b3542718987bf815eed9b79" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4bc679ad21a64bfe93bf64ff1b6ba3b2"
I20260709 13:09:14.183360 29952 raft_consensus.cc:3060] T 5ccb587267a8414180b1f5474e4e2728 P 4bc679ad21a64bfe93bf64ff1b6ba3b2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:14.181717 29951 raft_consensus.cc:2468] T 273ea248a58742f998fd8e9dc55097fc P 4bc679ad21a64bfe93bf64ff1b6ba3b2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 37897779fb894afb8129dcf5d269bd54 in term 1.
I20260709 13:09:14.178617 30172 raft_consensus.cc:740] T fa4b1db9a2d44d45bc9935975428592e P 58a7cda73b3542718987bf815eed9b79 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 58a7cda73b3542718987bf815eed9b79, State: Initialized, Role: FOLLOWER
I20260709 13:09:14.188728 30172 consensus_queue.cc:260] T fa4b1db9a2d44d45bc9935975428592e P 58a7cda73b3542718987bf815eed9b79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "58a7cda73b3542718987bf815eed9b79" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 37953 } } peers { permanent_uuid: "4bc679ad21a64bfe93bf64ff1b6ba3b2" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 33075 } } peers { permanent_uuid: "37897779fb894afb8129dcf5d269bd54" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 42765 } }
I20260709 13:09:14.191514 30172 ts_tablet_manager.cc:1434] T fa4b1db9a2d44d45bc9935975428592e P 58a7cda73b3542718987bf815eed9b79: Time spent starting tablet: real 0.017s	user 0.009s	sys 0.000s
I20260709 13:09:14.194921 30191 leader_election.cc:290] T 5ccb587267a8414180b1f5474e4e2728 P 58a7cda73b3542718987bf815eed9b79 [CANDIDATE]: Term 1 election: Requested vote from peers 4bc679ad21a64bfe93bf64ff1b6ba3b2 (127.17.223.2:33075), 37897779fb894afb8129dcf5d269bd54 (127.17.223.3:42765)
I20260709 13:09:14.198761 30026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ccb587267a8414180b1f5474e4e2728" candidate_uuid: "58a7cda73b3542718987bf815eed9b79" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "37897779fb894afb8129dcf5d269bd54"
I20260709 13:09:14.199765 30201 leader_election.cc:290] T fa4b1db9a2d44d45bc9935975428592e P 37897779fb894afb8129dcf5d269bd54 [CANDIDATE]: Term 1 election: Requested vote from peers 58a7cda73b3542718987bf815eed9b79 (127.17.223.1:37953), 4bc679ad21a64bfe93bf64ff1b6ba3b2 (127.17.223.2:33075)
W20260709 13:09:14.200634 29841 leader_election.cc:343] T 5ccb587267a8414180b1f5474e4e2728 P 58a7cda73b3542718987bf815eed9b79 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 37897779fb894afb8129dcf5d269bd54 (127.17.223.3:42765): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:14.200866 29953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa4b1db9a2d44d45bc9935975428592e" candidate_uuid: "37897779fb894afb8129dcf5d269bd54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4bc679ad21a64bfe93bf64ff1b6ba3b2"
I20260709 13:09:14.201578 29953 raft_consensus.cc:3060] T fa4b1db9a2d44d45bc9935975428592e P 4bc679ad21a64bfe93bf64ff1b6ba3b2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:14.204239 30171 tablet_bootstrap.cc:492] T 40017481861c42efa46273995f000081 P 37897779fb894afb8129dcf5d269bd54: No bootstrap required, opened a new log
I20260709 13:09:14.204802 30171 ts_tablet_manager.cc:1403] T 40017481861c42efa46273995f000081 P 37897779fb894afb8129dcf5d269bd54: Time spent bootstrapping tablet: real 0.150s	user 0.016s	sys 0.011s
I20260709 13:09:14.208141 30171 raft_consensus.cc:359] T 40017481861c42efa46273995f000081 P 37897779fb894afb8129dcf5d269bd54 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "58a7cda73b3542718987bf815eed9b79" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 37953 } } peers { permanent_uuid: "4bc679ad21a64bfe93bf64ff1b6ba3b2" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 33075 } } peers { permanent_uuid: "37897779fb894afb8129dcf5d269bd54" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 42765 } }
I20260709 13:09:14.208841 30171 raft_consensus.cc:385] T 40017481861c42efa46273995f000081 P 37897779fb894afb8129dcf5d269bd54 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:14.209129 30171 raft_consensus.cc:740] T 40017481861c42efa46273995f000081 P 37897779fb894afb8129dcf5d269bd54 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 37897779fb894afb8129dcf5d269bd54, State: Initialized, Role: FOLLOWER
I20260709 13:09:14.209801 29953 raft_consensus.cc:2468] T fa4b1db9a2d44d45bc9935975428592e P 4bc679ad21a64bfe93bf64ff1b6ba3b2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 37897779fb894afb8129dcf5d269bd54 in term 1.
I20260709 13:09:14.209906 30171 consensus_queue.cc:260] T 40017481861c42efa46273995f000081 P 37897779fb894afb8129dcf5d269bd54 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "58a7cda73b3542718987bf815eed9b79" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 37953 } } peers { permanent_uuid: "4bc679ad21a64bfe93bf64ff1b6ba3b2" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 33075 } } peers { permanent_uuid: "37897779fb894afb8129dcf5d269bd54" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 42765 } }
I20260709 13:09:14.199934 30210 consensus_queue.cc:1048] T ea945f01fa404ea29878b0cd26af4e1e P 4bc679ad21a64bfe93bf64ff1b6ba3b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "37897779fb894afb8129dcf5d269bd54" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 42765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:09:14.211098 29991 leader_election.cc:304] T fa4b1db9a2d44d45bc9935975428592e P 37897779fb894afb8129dcf5d269bd54 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 37897779fb894afb8129dcf5d269bd54, 4bc679ad21a64bfe93bf64ff1b6ba3b2; no voters: 58a7cda73b3542718987bf815eed9b79
I20260709 13:09:14.212568 30205 raft_consensus.cc:2804] T fa4b1db9a2d44d45bc9935975428592e P 37897779fb894afb8129dcf5d269bd54 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:14.213101 30205 raft_consensus.cc:697] T fa4b1db9a2d44d45bc9935975428592e P 37897779fb894afb8129dcf5d269bd54 [term 1 LEADER]: Becoming Leader. State: Replica: 37897779fb894afb8129dcf5d269bd54, State: Running, Role: LEADER
I20260709 13:09:14.213950 30205 consensus_queue.cc:237] T fa4b1db9a2d44d45bc9935975428592e P 37897779fb894afb8129dcf5d269bd54 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "58a7cda73b3542718987bf815eed9b79" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 37953 } } peers { permanent_uuid: "4bc679ad21a64bfe93bf64ff1b6ba3b2" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 33075 } } peers { permanent_uuid: "37897779fb894afb8129dcf5d269bd54" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 42765 } }
I20260709 13:09:14.220495 29952 raft_consensus.cc:2468] T 5ccb587267a8414180b1f5474e4e2728 P 4bc679ad21a64bfe93bf64ff1b6ba3b2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 58a7cda73b3542718987bf815eed9b79 in term 1.
I20260709 13:09:14.214882 30171 ts_tablet_manager.cc:1434] T 40017481861c42efa46273995f000081 P 37897779fb894afb8129dcf5d269bd54: Time spent starting tablet: real 0.010s	user 0.007s	sys 0.000s
I20260709 13:09:14.221930 29842 leader_election.cc:304] T 5ccb587267a8414180b1f5474e4e2728 P 58a7cda73b3542718987bf815eed9b79 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4bc679ad21a64bfe93bf64ff1b6ba3b2, 58a7cda73b3542718987bf815eed9b79; no voters: 37897779fb894afb8129dcf5d269bd54
I20260709 13:09:14.222313 30171 tablet_bootstrap.cc:492] T 5ccb587267a8414180b1f5474e4e2728 P 37897779fb894afb8129dcf5d269bd54: Bootstrap starting.
I20260709 13:09:14.224807 30191 raft_consensus.cc:2804] T 5ccb587267a8414180b1f5474e4e2728 P 58a7cda73b3542718987bf815eed9b79 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:14.227610 30191 raft_consensus.cc:697] T 5ccb587267a8414180b1f5474e4e2728 P 58a7cda73b3542718987bf815eed9b79 [term 1 LEADER]: Becoming Leader. State: Replica: 58a7cda73b3542718987bf815eed9b79, State: Running, Role: LEADER
I20260709 13:09:14.228485 30191 consensus_queue.cc:237] T 5ccb587267a8414180b1f5474e4e2728 P 58a7cda73b3542718987bf815eed9b79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "58a7cda73b3542718987bf815eed9b79" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 37953 } } peers { permanent_uuid: "4bc679ad21a64bfe93bf64ff1b6ba3b2" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 33075 } } peers { permanent_uuid: "37897779fb894afb8129dcf5d269bd54" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 42765 } }
I20260709 13:09:14.240444 29774 catalog_manager.cc:5697] T 797710d1534045c3a8597c9800a09ea6 P 4bc679ad21a64bfe93bf64ff1b6ba3b2 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4bc679ad21a64bfe93bf64ff1b6ba3b2 (127.17.223.2). New cstate: current_term: 1 leader_uuid: "4bc679ad21a64bfe93bf64ff1b6ba3b2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "58a7cda73b3542718987bf815eed9b79" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 37953 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4bc679ad21a64bfe93bf64ff1b6ba3b2" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 33075 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "37897779fb894afb8129dcf5d269bd54" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 42765 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:14.243633 30171 tablet_bootstrap.cc:654] T 5ccb587267a8414180b1f5474e4e2728 P 37897779fb894afb8129dcf5d269bd54: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:14.254287 29775 catalog_manager.cc:5697] T fa4b1db9a2d44d45bc9935975428592e P 37897779fb894afb8129dcf5d269bd54 reported cstate change: term changed from 0 to 1, leader changed from <none> to 37897779fb894afb8129dcf5d269bd54 (127.17.223.3). New cstate: current_term: 1 leader_uuid: "37897779fb894afb8129dcf5d269bd54" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "58a7cda73b3542718987bf815eed9b79" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 37953 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4bc679ad21a64bfe93bf64ff1b6ba3b2" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 33075 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "37897779fb894afb8129dcf5d269bd54" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 42765 } health_report { overall_health: HEALTHY } } }
I20260709 13:09:14.253440 29776 catalog_manager.cc:5697] T 5ccb587267a8414180b1f5474e4e2728 P 58a7cda73b3542718987bf815eed9b79 reported cstate change: term changed from 0 to 1, leader changed from <none> to 58a7cda73b3542718987bf815eed9b79 (127.17.223.1). New cstate: current_term: 1 leader_uuid: "58a7cda73b3542718987bf815eed9b79" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "58a7cda73b3542718987bf815eed9b79" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 37953 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4bc679ad21a64bfe93bf64ff1b6ba3b2" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 33075 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "37897779fb894afb8129dcf5d269bd54" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 42765 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:14.279465 30171 tablet_bootstrap.cc:492] T 5ccb587267a8414180b1f5474e4e2728 P 37897779fb894afb8129dcf5d269bd54: No bootstrap required, opened a new log
I20260709 13:09:14.280094 30171 ts_tablet_manager.cc:1403] T 5ccb587267a8414180b1f5474e4e2728 P 37897779fb894afb8129dcf5d269bd54: Time spent bootstrapping tablet: real 0.058s	user 0.015s	sys 0.023s
I20260709 13:09:14.282752 30171 raft_consensus.cc:359] T 5ccb587267a8414180b1f5474e4e2728 P 37897779fb894afb8129dcf5d269bd54 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "58a7cda73b3542718987bf815eed9b79" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 37953 } } peers { permanent_uuid: "4bc679ad21a64bfe93bf64ff1b6ba3b2" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 33075 } } peers { permanent_uuid: "37897779fb894afb8129dcf5d269bd54" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 42765 } }
I20260709 13:09:14.283427 30171 raft_consensus.cc:385] T 5ccb587267a8414180b1f5474e4e2728 P 37897779fb894afb8129dcf5d269bd54 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:14.283792 30171 raft_consensus.cc:740] T 5ccb587267a8414180b1f5474e4e2728 P 37897779fb894afb8129dcf5d269bd54 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 37897779fb894afb8129dcf5d269bd54, State: Initialized, Role: FOLLOWER
I20260709 13:09:14.284578 30171 consensus_queue.cc:260] T 5ccb587267a8414180b1f5474e4e2728 P 37897779fb894afb8129dcf5d269bd54 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "58a7cda73b3542718987bf815eed9b79" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 37953 } } peers { permanent_uuid: "4bc679ad21a64bfe93bf64ff1b6ba3b2" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 33075 } } peers { permanent_uuid: "37897779fb894afb8129dcf5d269bd54" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 42765 } }
I20260709 13:09:14.286978 30171 ts_tablet_manager.cc:1434] T 5ccb587267a8414180b1f5474e4e2728 P 37897779fb894afb8129dcf5d269bd54: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 13:09:14.288468 30171 tablet_bootstrap.cc:492] T 797710d1534045c3a8597c9800a09ea6 P 37897779fb894afb8129dcf5d269bd54: Bootstrap starting.
I20260709 13:09:14.292104 30191 raft_consensus.cc:493] T fa4b1db9a2d44d45bc9935975428592e P 58a7cda73b3542718987bf815eed9b79 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:14.292698 30191 raft_consensus.cc:515] T fa4b1db9a2d44d45bc9935975428592e P 58a7cda73b3542718987bf815eed9b79 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "58a7cda73b3542718987bf815eed9b79" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 37953 } } peers { permanent_uuid: "4bc679ad21a64bfe93bf64ff1b6ba3b2" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 33075 } } peers { permanent_uuid: "37897779fb894afb8129dcf5d269bd54" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 42765 } }
I20260709 13:09:14.295001 30191 leader_election.cc:290] T fa4b1db9a2d44d45bc9935975428592e P 58a7cda73b3542718987bf815eed9b79 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4bc679ad21a64bfe93bf64ff1b6ba3b2 (127.17.223.2:33075), 37897779fb894afb8129dcf5d269bd54 (127.17.223.3:42765)
I20260709 13:09:14.296090 29952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa4b1db9a2d44d45bc9935975428592e" candidate_uuid: "58a7cda73b3542718987bf815eed9b79" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4bc679ad21a64bfe93bf64ff1b6ba3b2" is_pre_election: true
I20260709 13:09:14.296700 30026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa4b1db9a2d44d45bc9935975428592e" candidate_uuid: "58a7cda73b3542718987bf815eed9b79" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "37897779fb894afb8129dcf5d269bd54" is_pre_election: true
I20260709 13:09:14.296916 29952 raft_consensus.cc:2393] T fa4b1db9a2d44d45bc9935975428592e P 4bc679ad21a64bfe93bf64ff1b6ba3b2 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 58a7cda73b3542718987bf815eed9b79 in current term 1: Already voted for candidate 37897779fb894afb8129dcf5d269bd54 in this term.
I20260709 13:09:14.296974 30171 tablet_bootstrap.cc:654] T 797710d1534045c3a8597c9800a09ea6 P 37897779fb894afb8129dcf5d269bd54: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:14.298820 29841 leader_election.cc:304] T fa4b1db9a2d44d45bc9935975428592e P 58a7cda73b3542718987bf815eed9b79 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 58a7cda73b3542718987bf815eed9b79; no voters: 37897779fb894afb8129dcf5d269bd54, 4bc679ad21a64bfe93bf64ff1b6ba3b2
I20260709 13:09:14.300120 30191 raft_consensus.cc:3060] T fa4b1db9a2d44d45bc9935975428592e P 58a7cda73b3542718987bf815eed9b79 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:14.308158 30171 tablet_bootstrap.cc:492] T 797710d1534045c3a8597c9800a09ea6 P 37897779fb894afb8129dcf5d269bd54: No bootstrap required, opened a new log
I20260709 13:09:14.308483 30191 raft_consensus.cc:2749] T fa4b1db9a2d44d45bc9935975428592e P 58a7cda73b3542718987bf815eed9b79 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:14.308686 30171 ts_tablet_manager.cc:1403] T 797710d1534045c3a8597c9800a09ea6 P 37897779fb894afb8129dcf5d269bd54: Time spent bootstrapping tablet: real 0.020s	user 0.012s	sys 0.003s
I20260709 13:09:14.311025 30171 raft_consensus.cc:359] T 797710d1534045c3a8597c9800a09ea6 P 37897779fb894afb8129dcf5d269bd54 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "58a7cda73b3542718987bf815eed9b79" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 37953 } } peers { permanent_uuid: "4bc679ad21a64bfe93bf64ff1b6ba3b2" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 33075 } } peers { permanent_uuid: "37897779fb894afb8129dcf5d269bd54" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 42765 } }
I20260709 13:09:14.311529 30171 raft_consensus.cc:385] T 797710d1534045c3a8597c9800a09ea6 P 37897779fb894afb8129dcf5d269bd54 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:14.311746 30171 raft_consensus.cc:740] T 797710d1534045c3a8597c9800a09ea6 P 37897779fb894afb8129dcf5d269bd54 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 37897779fb894afb8129dcf5d269bd54, State: Initialized, Role: FOLLOWER
I20260709 13:09:14.312346 30171 consensus_queue.cc:260] T 797710d1534045c3a8597c9800a09ea6 P 37897779fb894afb8129dcf5d269bd54 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "58a7cda73b3542718987bf815eed9b79" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 37953 } } peers { permanent_uuid: "4bc679ad21a64bfe93bf64ff1b6ba3b2" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 33075 } } peers { permanent_uuid: "37897779fb894afb8129dcf5d269bd54" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 42765 } }
I20260709 13:09:14.314180 30171 ts_tablet_manager.cc:1434] T 797710d1534045c3a8597c9800a09ea6 P 37897779fb894afb8129dcf5d269bd54: Time spent starting tablet: real 0.005s	user 0.003s	sys 0.000s
I20260709 13:09:14.315492 30171 tablet_bootstrap.cc:492] T d90287f9e65f48c9b8ebdcaf7fe0dde2 P 37897779fb894afb8129dcf5d269bd54: Bootstrap starting.
I20260709 13:09:14.321425 30171 tablet_bootstrap.cc:654] T d90287f9e65f48c9b8ebdcaf7fe0dde2 P 37897779fb894afb8129dcf5d269bd54: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:14.328941 30171 tablet_bootstrap.cc:492] T d90287f9e65f48c9b8ebdcaf7fe0dde2 P 37897779fb894afb8129dcf5d269bd54: No bootstrap required, opened a new log
I20260709 13:09:14.329432 30171 ts_tablet_manager.cc:1403] T d90287f9e65f48c9b8ebdcaf7fe0dde2 P 37897779fb894afb8129dcf5d269bd54: Time spent bootstrapping tablet: real 0.014s	user 0.008s	sys 0.004s
I20260709 13:09:14.331437 30171 raft_consensus.cc:359] T d90287f9e65f48c9b8ebdcaf7fe0dde2 P 37897779fb894afb8129dcf5d269bd54 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "58a7cda73b3542718987bf815eed9b79" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 37953 } } peers { permanent_uuid: "4bc679ad21a64bfe93bf64ff1b6ba3b2" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 33075 } } peers { permanent_uuid: "37897779fb894afb8129dcf5d269bd54" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 42765 } }
I20260709 13:09:14.331948 30171 raft_consensus.cc:385] T d90287f9e65f48c9b8ebdcaf7fe0dde2 P 37897779fb894afb8129dcf5d269bd54 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:14.332171 30171 raft_consensus.cc:740] T d90287f9e65f48c9b8ebdcaf7fe0dde2 P 37897779fb894afb8129dcf5d269bd54 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 37897779fb894afb8129dcf5d269bd54, State: Initialized, Role: FOLLOWER
I20260709 13:09:14.332684 30171 consensus_queue.cc:260] T d90287f9e65f48c9b8ebdcaf7fe0dde2 P 37897779fb894afb8129dcf5d269bd54 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "58a7cda73b3542718987bf815eed9b79" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 37953 } } peers { permanent_uuid: "4bc679ad21a64bfe93bf64ff1b6ba3b2" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 33075 } } peers { permanent_uuid: "37897779fb894afb8129dcf5d269bd54" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 42765 } }
I20260709 13:09:14.333048 30205 raft_consensus.cc:493] T 5ccb587267a8414180b1f5474e4e2728 P 37897779fb894afb8129dcf5d269bd54 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:14.333674 30205 raft_consensus.cc:515] T 5ccb587267a8414180b1f5474e4e2728 P 37897779fb894afb8129dcf5d269bd54 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "58a7cda73b3542718987bf815eed9b79" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 37953 } } peers { permanent_uuid: "4bc679ad21a64bfe93bf64ff1b6ba3b2" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 33075 } } peers { permanent_uuid: "37897779fb894afb8129dcf5d269bd54" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 42765 } }
I20260709 13:09:14.334709 30171 ts_tablet_manager.cc:1434] T d90287f9e65f48c9b8ebdcaf7fe0dde2 P 37897779fb894afb8129dcf5d269bd54: Time spent starting tablet: real 0.005s	user 0.003s	sys 0.000s
I20260709 13:09:14.336076 30205 leader_election.cc:290] T 5ccb587267a8414180b1f5474e4e2728 P 37897779fb894afb8129dcf5d269bd54 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 58a7cda73b3542718987bf815eed9b79 (127.17.223.1:37953), 4bc679ad21a64bfe93bf64ff1b6ba3b2 (127.17.223.2:33075)
I20260709 13:09:14.337327 29952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ccb587267a8414180b1f5474e4e2728" candidate_uuid: "37897779fb894afb8129dcf5d269bd54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4bc679ad21a64bfe93bf64ff1b6ba3b2" is_pre_election: true
I20260709 13:09:14.337715 29875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ccb587267a8414180b1f5474e4e2728" candidate_uuid: "37897779fb894afb8129dcf5d269bd54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "58a7cda73b3542718987bf815eed9b79" is_pre_election: true
I20260709 13:09:14.338138 29952 raft_consensus.cc:2393] T 5ccb587267a8414180b1f5474e4e2728 P 4bc679ad21a64bfe93bf64ff1b6ba3b2 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 37897779fb894afb8129dcf5d269bd54 in current term 1: Already voted for candidate 58a7cda73b3542718987bf815eed9b79 in this term.
I20260709 13:09:14.339404 29993 leader_election.cc:304] T 5ccb587267a8414180b1f5474e4e2728 P 37897779fb894afb8129dcf5d269bd54 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 37897779fb894afb8129dcf5d269bd54; no voters: 4bc679ad21a64bfe93bf64ff1b6ba3b2, 58a7cda73b3542718987bf815eed9b79
I20260709 13:09:14.340292 30205 raft_consensus.cc:3060] T 5ccb587267a8414180b1f5474e4e2728 P 37897779fb894afb8129dcf5d269bd54 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:14.346208 30205 raft_consensus.cc:2749] T 5ccb587267a8414180b1f5474e4e2728 P 37897779fb894afb8129dcf5d269bd54 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:14.357982 30191 consensus_queue.cc:1048] T 40017481861c42efa46273995f000081 P 58a7cda73b3542718987bf815eed9b79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4bc679ad21a64bfe93bf64ff1b6ba3b2" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 33075 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:09:14.371968 30025 raft_consensus.cc:3060] T 40017481861c42efa46273995f000081 P 37897779fb894afb8129dcf5d269bd54 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:14.373641 30173 consensus_queue.cc:1048] T d8a815244f7c485b980dfa0adb0fd2a9 P 4bc679ad21a64bfe93bf64ff1b6ba3b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "37897779fb894afb8129dcf5d269bd54" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 42765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:09:14.381862 30191 consensus_queue.cc:1048] T 40017481861c42efa46273995f000081 P 58a7cda73b3542718987bf815eed9b79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "37897779fb894afb8129dcf5d269bd54" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 42765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:14.396694 30173 consensus_queue.cc:1048] T d8a815244f7c485b980dfa0adb0fd2a9 P 4bc679ad21a64bfe93bf64ff1b6ba3b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "58a7cda73b3542718987bf815eed9b79" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 37953 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:14.481804 30173 raft_consensus.cc:493] T d90287f9e65f48c9b8ebdcaf7fe0dde2 P 4bc679ad21a64bfe93bf64ff1b6ba3b2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:14.482339 30173 raft_consensus.cc:515] T d90287f9e65f48c9b8ebdcaf7fe0dde2 P 4bc679ad21a64bfe93bf64ff1b6ba3b2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "58a7cda73b3542718987bf815eed9b79" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 37953 } } peers { permanent_uuid: "4bc679ad21a64bfe93bf64ff1b6ba3b2" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 33075 } } peers { permanent_uuid: "37897779fb894afb8129dcf5d269bd54" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 42765 } }
I20260709 13:09:14.484481 30173 leader_election.cc:290] T d90287f9e65f48c9b8ebdcaf7fe0dde2 P 4bc679ad21a64bfe93bf64ff1b6ba3b2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 58a7cda73b3542718987bf815eed9b79 (127.17.223.1:37953), 37897779fb894afb8129dcf5d269bd54 (127.17.223.3:42765)
I20260709 13:09:14.485195 29875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d90287f9e65f48c9b8ebdcaf7fe0dde2" candidate_uuid: "4bc679ad21a64bfe93bf64ff1b6ba3b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "58a7cda73b3542718987bf815eed9b79" is_pre_election: true
I20260709 13:09:14.485523 30026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d90287f9e65f48c9b8ebdcaf7fe0dde2" candidate_uuid: "4bc679ad21a64bfe93bf64ff1b6ba3b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "37897779fb894afb8129dcf5d269bd54" is_pre_election: true
I20260709 13:09:14.485913 29875 raft_consensus.cc:2468] T d90287f9e65f48c9b8ebdcaf7fe0dde2 P 58a7cda73b3542718987bf815eed9b79 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4bc679ad21a64bfe93bf64ff1b6ba3b2 in term 0.
I20260709 13:09:14.486374 30026 raft_consensus.cc:2468] T d90287f9e65f48c9b8ebdcaf7fe0dde2 P 37897779fb894afb8129dcf5d269bd54 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4bc679ad21a64bfe93bf64ff1b6ba3b2 in term 0.
I20260709 13:09:14.487493 29919 leader_election.cc:304] T d90287f9e65f48c9b8ebdcaf7fe0dde2 P 4bc679ad21a64bfe93bf64ff1b6ba3b2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4bc679ad21a64bfe93bf64ff1b6ba3b2, 58a7cda73b3542718987bf815eed9b79; no voters: 
I20260709 13:09:14.488193 30173 raft_consensus.cc:2804] T d90287f9e65f48c9b8ebdcaf7fe0dde2 P 4bc679ad21a64bfe93bf64ff1b6ba3b2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:14.488626 30173 raft_consensus.cc:493] T d90287f9e65f48c9b8ebdcaf7fe0dde2 P 4bc679ad21a64bfe93bf64ff1b6ba3b2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:14.488897 30173 raft_consensus.cc:3060] T d90287f9e65f48c9b8ebdcaf7fe0dde2 P 4bc679ad21a64bfe93bf64ff1b6ba3b2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:14.495553 30173 raft_consensus.cc:515] T d90287f9e65f48c9b8ebdcaf7fe0dde2 P 4bc679ad21a64bfe93bf64ff1b6ba3b2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "58a7cda73b3542718987bf815eed9b79" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 37953 } } peers { permanent_uuid: "4bc679ad21a64bfe93bf64ff1b6ba3b2" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 33075 } } peers { permanent_uuid: "37897779fb894afb8129dcf5d269bd54" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 42765 } }
I20260709 13:09:14.497366 30173 leader_election.cc:290] T d90287f9e65f48c9b8ebdcaf7fe0dde2 P 4bc679ad21a64bfe93bf64ff1b6ba3b2 [CANDIDATE]: Term 1 election: Requested vote from peers 58a7cda73b3542718987bf815eed9b79 (127.17.223.1:37953), 37897779fb894afb8129dcf5d269bd54 (127.17.223.3:42765)
I20260709 13:09:14.497959 30205 consensus_queue.cc:1048] T 2351aaf3431e4d18906f7f7fa8bb4f5c P 37897779fb894afb8129dcf5d269bd54 [LEADER]: Connected to new peer: Peer: permanent_uuid: "58a7cda73b3542718987bf815eed9b79" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 37953 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:14.498273 30026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d90287f9e65f48c9b8ebdcaf7fe0dde2" candidate_uuid: "4bc679ad21a64bfe93bf64ff1b6ba3b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "37897779fb894afb8129dcf5d269bd54"
I20260709 13:09:14.498308 29875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d90287f9e65f48c9b8ebdcaf7fe0dde2" candidate_uuid: "4bc679ad21a64bfe93bf64ff1b6ba3b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "58a7cda73b3542718987bf815eed9b79"
I20260709 13:09:14.499018 30026 raft_consensus.cc:3060] T d90287f9e65f48c9b8ebdcaf7fe0dde2 P 37897779fb894afb8129dcf5d269bd54 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:14.499107 29875 raft_consensus.cc:3060] T d90287f9e65f48c9b8ebdcaf7fe0dde2 P 58a7cda73b3542718987bf815eed9b79 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:14.508246 29875 raft_consensus.cc:2468] T d90287f9e65f48c9b8ebdcaf7fe0dde2 P 58a7cda73b3542718987bf815eed9b79 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4bc679ad21a64bfe93bf64ff1b6ba3b2 in term 1.
I20260709 13:09:14.509178 29919 leader_election.cc:304] T d90287f9e65f48c9b8ebdcaf7fe0dde2 P 4bc679ad21a64bfe93bf64ff1b6ba3b2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4bc679ad21a64bfe93bf64ff1b6ba3b2, 58a7cda73b3542718987bf815eed9b79; no voters: 
I20260709 13:09:14.510026 30173 raft_consensus.cc:2804] T d90287f9e65f48c9b8ebdcaf7fe0dde2 P 4bc679ad21a64bfe93bf64ff1b6ba3b2 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:14.509851 30201 consensus_queue.cc:1048] T 2351aaf3431e4d18906f7f7fa8bb4f5c P 37897779fb894afb8129dcf5d269bd54 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4bc679ad21a64bfe93bf64ff1b6ba3b2" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 33075 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:14.510528 30173 raft_consensus.cc:697] T d90287f9e65f48c9b8ebdcaf7fe0dde2 P 4bc679ad21a64bfe93bf64ff1b6ba3b2 [term 1 LEADER]: Becoming Leader. State: Replica: 4bc679ad21a64bfe93bf64ff1b6ba3b2, State: Running, Role: LEADER
I20260709 13:09:14.511390 30173 consensus_queue.cc:237] T d90287f9e65f48c9b8ebdcaf7fe0dde2 P 4bc679ad21a64bfe93bf64ff1b6ba3b2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "58a7cda73b3542718987bf815eed9b79" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 37953 } } peers { permanent_uuid: "4bc679ad21a64bfe93bf64ff1b6ba3b2" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 33075 } } peers { permanent_uuid: "37897779fb894afb8129dcf5d269bd54" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 42765 } }
I20260709 13:09:14.520031 30026 raft_consensus.cc:2468] T d90287f9e65f48c9b8ebdcaf7fe0dde2 P 37897779fb894afb8129dcf5d269bd54 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4bc679ad21a64bfe93bf64ff1b6ba3b2 in term 1.
I20260709 13:09:14.521426 29776 catalog_manager.cc:5697] T d90287f9e65f48c9b8ebdcaf7fe0dde2 P 4bc679ad21a64bfe93bf64ff1b6ba3b2 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4bc679ad21a64bfe93bf64ff1b6ba3b2 (127.17.223.2). New cstate: current_term: 1 leader_uuid: "4bc679ad21a64bfe93bf64ff1b6ba3b2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "58a7cda73b3542718987bf815eed9b79" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 37953 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4bc679ad21a64bfe93bf64ff1b6ba3b2" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 33075 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "37897779fb894afb8129dcf5d269bd54" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 42765 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:14.569259 30201 consensus_queue.cc:1048] T 273ea248a58742f998fd8e9dc55097fc P 37897779fb894afb8129dcf5d269bd54 [LEADER]: Connected to new peer: Peer: permanent_uuid: "58a7cda73b3542718987bf815eed9b79" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 37953 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:14.581089 30205 consensus_queue.cc:1048] T 273ea248a58742f998fd8e9dc55097fc P 37897779fb894afb8129dcf5d269bd54 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4bc679ad21a64bfe93bf64ff1b6ba3b2" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 33075 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:14.648257 30026 raft_consensus.cc:3060] T 797710d1534045c3a8597c9800a09ea6 P 37897779fb894afb8129dcf5d269bd54 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:14.654358 30205 consensus_queue.cc:1048] T fa4b1db9a2d44d45bc9935975428592e P 37897779fb894afb8129dcf5d269bd54 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4bc679ad21a64bfe93bf64ff1b6ba3b2" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 33075 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:09:14.655241 30210 consensus_queue.cc:1048] T 797710d1534045c3a8597c9800a09ea6 P 4bc679ad21a64bfe93bf64ff1b6ba3b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "37897779fb894afb8129dcf5d269bd54" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 42765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:14.655334 30191 consensus_queue.cc:1048] T 5ccb587267a8414180b1f5474e4e2728 P 58a7cda73b3542718987bf815eed9b79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4bc679ad21a64bfe93bf64ff1b6ba3b2" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 33075 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:14.662402 30205 consensus_queue.cc:1048] T fa4b1db9a2d44d45bc9935975428592e P 37897779fb894afb8129dcf5d269bd54 [LEADER]: Connected to new peer: Peer: permanent_uuid: "58a7cda73b3542718987bf815eed9b79" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 37953 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:14.672217 30203 consensus_queue.cc:1048] T 5ccb587267a8414180b1f5474e4e2728 P 58a7cda73b3542718987bf815eed9b79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "37897779fb894afb8129dcf5d269bd54" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 42765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:14.673768 30170 consensus_queue.cc:1048] T 797710d1534045c3a8597c9800a09ea6 P 4bc679ad21a64bfe93bf64ff1b6ba3b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "58a7cda73b3542718987bf815eed9b79" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 37953 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:14.744031 29952 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "797710d1534045c3a8597c9800a09ea6"
dest_uuid: "4bc679ad21a64bfe93bf64ff1b6ba3b2"
mode: GRACEFUL
new_leader_uuid: "58a7cda73b3542718987bf815eed9b79"
 from {username='slave'} at 127.0.0.1:48686
I20260709 13:09:14.744644 29952 raft_consensus.cc:606] T 797710d1534045c3a8597c9800a09ea6 P 4bc679ad21a64bfe93bf64ff1b6ba3b2 [term 1 LEADER]: Received request to transfer leadership to TS 58a7cda73b3542718987bf815eed9b79
I20260709 13:09:14.749616 29952 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ea945f01fa404ea29878b0cd26af4e1e"
dest_uuid: "4bc679ad21a64bfe93bf64ff1b6ba3b2"
mode: GRACEFUL
new_leader_uuid: "58a7cda73b3542718987bf815eed9b79"
 from {username='slave'} at 127.0.0.1:48686
I20260709 13:09:14.750088 29952 raft_consensus.cc:606] T ea945f01fa404ea29878b0cd26af4e1e P 4bc679ad21a64bfe93bf64ff1b6ba3b2 [term 1 LEADER]: Received request to transfer leadership to TS 58a7cda73b3542718987bf815eed9b79
I20260709 13:09:14.754640 29952 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d8a815244f7c485b980dfa0adb0fd2a9"
dest_uuid: "4bc679ad21a64bfe93bf64ff1b6ba3b2"
mode: GRACEFUL
new_leader_uuid: "58a7cda73b3542718987bf815eed9b79"
 from {username='slave'} at 127.0.0.1:48686
I20260709 13:09:14.755156 29952 raft_consensus.cc:606] T d8a815244f7c485b980dfa0adb0fd2a9 P 4bc679ad21a64bfe93bf64ff1b6ba3b2 [term 1 LEADER]: Received request to transfer leadership to TS 58a7cda73b3542718987bf815eed9b79
I20260709 13:09:14.759995 30025 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2351aaf3431e4d18906f7f7fa8bb4f5c"
dest_uuid: "37897779fb894afb8129dcf5d269bd54"
mode: GRACEFUL
new_leader_uuid: "4bc679ad21a64bfe93bf64ff1b6ba3b2"
 from {username='slave'} at 127.0.0.1:58228
I20260709 13:09:14.760506 30025 raft_consensus.cc:606] T 2351aaf3431e4d18906f7f7fa8bb4f5c P 37897779fb894afb8129dcf5d269bd54 [term 1 LEADER]: Received request to transfer leadership to TS 4bc679ad21a64bfe93bf64ff1b6ba3b2
I20260709 13:09:14.765051 30025 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "fa4b1db9a2d44d45bc9935975428592e"
dest_uuid: "37897779fb894afb8129dcf5d269bd54"
mode: GRACEFUL
new_leader_uuid: "4bc679ad21a64bfe93bf64ff1b6ba3b2"
 from {username='slave'} at 127.0.0.1:58228
I20260709 13:09:14.765551 30025 raft_consensus.cc:606] T fa4b1db9a2d44d45bc9935975428592e P 37897779fb894afb8129dcf5d269bd54 [term 1 LEADER]: Received request to transfer leadership to TS 4bc679ad21a64bfe93bf64ff1b6ba3b2
I20260709 13:09:14.770159 29875 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5ccb587267a8414180b1f5474e4e2728"
dest_uuid: "58a7cda73b3542718987bf815eed9b79"
mode: GRACEFUL
new_leader_uuid: "4bc679ad21a64bfe93bf64ff1b6ba3b2"
 from {username='slave'} at 127.0.0.1:36148
I20260709 13:09:14.770732 29875 raft_consensus.cc:606] T 5ccb587267a8414180b1f5474e4e2728 P 58a7cda73b3542718987bf815eed9b79 [term 1 LEADER]: Received request to transfer leadership to TS 4bc679ad21a64bfe93bf64ff1b6ba3b2
I20260709 13:09:14.775436 30025 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "273ea248a58742f998fd8e9dc55097fc"
dest_uuid: "37897779fb894afb8129dcf5d269bd54"
mode: GRACEFUL
new_leader_uuid: "4bc679ad21a64bfe93bf64ff1b6ba3b2"
 from {username='slave'} at 127.0.0.1:58228
I20260709 13:09:14.776054 30025 raft_consensus.cc:606] T 273ea248a58742f998fd8e9dc55097fc P 37897779fb894afb8129dcf5d269bd54 [term 1 LEADER]: Received request to transfer leadership to TS 4bc679ad21a64bfe93bf64ff1b6ba3b2
I20260709 13:09:14.781692 29952 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d90287f9e65f48c9b8ebdcaf7fe0dde2"
dest_uuid: "4bc679ad21a64bfe93bf64ff1b6ba3b2"
mode: GRACEFUL
new_leader_uuid: "37897779fb894afb8129dcf5d269bd54"
 from {username='slave'} at 127.0.0.1:48686
I20260709 13:09:14.782182 29952 raft_consensus.cc:606] T d90287f9e65f48c9b8ebdcaf7fe0dde2 P 4bc679ad21a64bfe93bf64ff1b6ba3b2 [term 1 LEADER]: Received request to transfer leadership to TS 37897779fb894afb8129dcf5d269bd54
I20260709 13:09:14.798966 30210 raft_consensus.cc:993] T d8a815244f7c485b980dfa0adb0fd2a9 P 4bc679ad21a64bfe93bf64ff1b6ba3b2: : Instructing follower 58a7cda73b3542718987bf815eed9b79 to start an election
I20260709 13:09:14.799454 30173 raft_consensus.cc:1081] T d8a815244f7c485b980dfa0adb0fd2a9 P 4bc679ad21a64bfe93bf64ff1b6ba3b2 [term 1 LEADER]: Signalling peer 58a7cda73b3542718987bf815eed9b79 to start an election
I20260709 13:09:14.800880 29875 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d8a815244f7c485b980dfa0adb0fd2a9"
dest_uuid: "58a7cda73b3542718987bf815eed9b79"
 from {username='slave'} at 127.0.0.1:36140
I20260709 13:09:14.801394 29875 raft_consensus.cc:493] T d8a815244f7c485b980dfa0adb0fd2a9 P 58a7cda73b3542718987bf815eed9b79 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:09:14.801723 29875 raft_consensus.cc:3060] T d8a815244f7c485b980dfa0adb0fd2a9 P 58a7cda73b3542718987bf815eed9b79 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:14.806947 29875 raft_consensus.cc:515] T d8a815244f7c485b980dfa0adb0fd2a9 P 58a7cda73b3542718987bf815eed9b79 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "58a7cda73b3542718987bf815eed9b79" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 37953 } } peers { permanent_uuid: "4bc679ad21a64bfe93bf64ff1b6ba3b2" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 33075 } } peers { permanent_uuid: "37897779fb894afb8129dcf5d269bd54" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 42765 } }
I20260709 13:09:14.808614 29875 leader_election.cc:290] T d8a815244f7c485b980dfa0adb0fd2a9 P 58a7cda73b3542718987bf815eed9b79 [CANDIDATE]: Term 2 election: Requested vote from peers 4bc679ad21a64bfe93bf64ff1b6ba3b2 (127.17.223.2:33075), 37897779fb894afb8129dcf5d269bd54 (127.17.223.3:42765)
I20260709 13:09:14.809391 29952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8a815244f7c485b980dfa0adb0fd2a9" candidate_uuid: "58a7cda73b3542718987bf815eed9b79" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "4bc679ad21a64bfe93bf64ff1b6ba3b2"
I20260709 13:09:14.809571 30026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8a815244f7c485b980dfa0adb0fd2a9" candidate_uuid: "58a7cda73b3542718987bf815eed9b79" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "37897779fb894afb8129dcf5d269bd54"
I20260709 13:09:14.810074 29952 raft_consensus.cc:3055] T d8a815244f7c485b980dfa0adb0fd2a9 P 4bc679ad21a64bfe93bf64ff1b6ba3b2 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:09:14.810159 30026 raft_consensus.cc:3060] T d8a815244f7c485b980dfa0adb0fd2a9 P 37897779fb894afb8129dcf5d269bd54 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:14.810381 29952 raft_consensus.cc:740] T d8a815244f7c485b980dfa0adb0fd2a9 P 4bc679ad21a64bfe93bf64ff1b6ba3b2 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 4bc679ad21a64bfe93bf64ff1b6ba3b2, State: Running, Role: LEADER
I20260709 13:09:14.811198 29952 consensus_queue.cc:260] T d8a815244f7c485b980dfa0adb0fd2a9 P 4bc679ad21a64bfe93bf64ff1b6ba3b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "58a7cda73b3542718987bf815eed9b79" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 37953 } } peers { permanent_uuid: "4bc679ad21a64bfe93bf64ff1b6ba3b2" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 33075 } } peers { permanent_uuid: "37897779fb894afb8129dcf5d269bd54" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 42765 } }
I20260709 13:09:14.812077 29952 raft_consensus.cc:3060] T d8a815244f7c485b980dfa0adb0fd2a9 P 4bc679ad21a64bfe93bf64ff1b6ba3b2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:14.815361 30026 raft_consensus.cc:2468] T d8a815244f7c485b980dfa0adb0fd2a9 P 37897779fb894afb8129dcf5d269bd54 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 58a7cda73b3542718987bf815eed9b79 in term 2.
I20260709 13:09:14.816592 29952 raft_consensus.cc:2468] T d8a815244f7c485b980dfa0adb0fd2a9 P 4bc679ad21a64bfe93bf64ff1b6ba3b2 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 58a7cda73b3542718987bf815eed9b79 in term 2.
I20260709 13:09:14.816609 29841 leader_election.cc:304] T d8a815244f7c485b980dfa0adb0fd2a9 P 58a7cda73b3542718987bf815eed9b79 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 37897779fb894afb8129dcf5d269bd54, 58a7cda73b3542718987bf815eed9b79; no voters: 
I20260709 13:09:14.817672 30191 raft_consensus.cc:2804] T d8a815244f7c485b980dfa0adb0fd2a9 P 58a7cda73b3542718987bf815eed9b79 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:09:14.818218 30191 raft_consensus.cc:697] T d8a815244f7c485b980dfa0adb0fd2a9 P 58a7cda73b3542718987bf815eed9b79 [term 2 LEADER]: Becoming Leader. State: Replica: 58a7cda73b3542718987bf815eed9b79, State: Running, Role: LEADER
I20260709 13:09:14.819026 30191 consensus_queue.cc:237] T d8a815244f7c485b980dfa0adb0fd2a9 P 58a7cda73b3542718987bf815eed9b79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "58a7cda73b3542718987bf815eed9b79" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 37953 } } peers { permanent_uuid: "4bc679ad21a64bfe93bf64ff1b6ba3b2" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 33075 } } peers { permanent_uuid: "37897779fb894afb8129dcf5d269bd54" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 42765 } }
I20260709 13:09:14.825181 29776 catalog_manager.cc:5697] T d8a815244f7c485b980dfa0adb0fd2a9 P 58a7cda73b3542718987bf815eed9b79 reported cstate change: term changed from 1 to 2, leader changed from 4bc679ad21a64bfe93bf64ff1b6ba3b2 (127.17.223.2) to 58a7cda73b3542718987bf815eed9b79 (127.17.223.1). New cstate: current_term: 2 leader_uuid: "58a7cda73b3542718987bf815eed9b79" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "58a7cda73b3542718987bf815eed9b79" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 37953 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4bc679ad21a64bfe93bf64ff1b6ba3b2" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 33075 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "37897779fb894afb8129dcf5d269bd54" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 42765 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:14.893961 30173 consensus_queue.cc:1048] T d90287f9e65f48c9b8ebdcaf7fe0dde2 P 4bc679ad21a64bfe93bf64ff1b6ba3b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "58a7cda73b3542718987bf815eed9b79" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 37953 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:14.903625 30210 consensus_queue.cc:1048] T d90287f9e65f48c9b8ebdcaf7fe0dde2 P 4bc679ad21a64bfe93bf64ff1b6ba3b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "37897779fb894afb8129dcf5d269bd54" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 42765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:14.911206 30170 raft_consensus.cc:993] T d90287f9e65f48c9b8ebdcaf7fe0dde2 P 4bc679ad21a64bfe93bf64ff1b6ba3b2: : Instructing follower 37897779fb894afb8129dcf5d269bd54 to start an election
I20260709 13:09:14.911680 30210 raft_consensus.cc:1081] T d90287f9e65f48c9b8ebdcaf7fe0dde2 P 4bc679ad21a64bfe93bf64ff1b6ba3b2 [term 1 LEADER]: Signalling peer 37897779fb894afb8129dcf5d269bd54 to start an election
I20260709 13:09:14.915091 30026 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d90287f9e65f48c9b8ebdcaf7fe0dde2"
dest_uuid: "37897779fb894afb8129dcf5d269bd54"
 from {username='slave'} at 127.0.0.1:58218
I20260709 13:09:14.915614 30026 raft_consensus.cc:493] T d90287f9e65f48c9b8ebdcaf7fe0dde2 P 37897779fb894afb8129dcf5d269bd54 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:09:14.915947 30026 raft_consensus.cc:3060] T d90287f9e65f48c9b8ebdcaf7fe0dde2 P 37897779fb894afb8129dcf5d269bd54 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:14.920373 30026 raft_consensus.cc:515] T d90287f9e65f48c9b8ebdcaf7fe0dde2 P 37897779fb894afb8129dcf5d269bd54 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "58a7cda73b3542718987bf815eed9b79" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 37953 } } peers { permanent_uuid: "4bc679ad21a64bfe93bf64ff1b6ba3b2" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 33075 } } peers { permanent_uuid: "37897779fb894afb8129dcf5d269bd54" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 42765 } }
I20260709 13:09:14.922106 30026 leader_election.cc:290] T d90287f9e65f48c9b8ebdcaf7fe0dde2 P 37897779fb894afb8129dcf5d269bd54 [CANDIDATE]: Term 2 election: Requested vote from peers 58a7cda73b3542718987bf815eed9b79 (127.17.223.1:37953), 4bc679ad21a64bfe93bf64ff1b6ba3b2 (127.17.223.2:33075)
I20260709 13:09:14.923153 29875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d90287f9e65f48c9b8ebdcaf7fe0dde2" candidate_uuid: "37897779fb894afb8129dcf5d269bd54" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "58a7cda73b3542718987bf815eed9b79"
I20260709 13:09:14.923807 29952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d90287f9e65f48c9b8ebdcaf7fe0dde2" candidate_uuid: "37897779fb894afb8129dcf5d269bd54" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "4bc679ad21a64bfe93bf64ff1b6ba3b2"
I20260709 13:09:14.925208 29952 raft_consensus.cc:3055] T d90287f9e65f48c9b8ebdcaf7fe0dde2 P 4bc679ad21a64bfe93bf64ff1b6ba3b2 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:09:14.925518 29952 raft_consensus.cc:740] T d90287f9e65f48c9b8ebdcaf7fe0dde2 P 4bc679ad21a64bfe93bf64ff1b6ba3b2 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 4bc679ad21a64bfe93bf64ff1b6ba3b2, State: Running, Role: LEADER
I20260709 13:09:14.926278 29952 consensus_queue.cc:260] T d90287f9e65f48c9b8ebdcaf7fe0dde2 P 4bc679ad21a64bfe93bf64ff1b6ba3b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "58a7cda73b3542718987bf815eed9b79" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 37953 } } peers { permanent_uuid: "4bc679ad21a64bfe93bf64ff1b6ba3b2" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 33075 } } peers { permanent_uuid: "37897779fb894afb8129dcf5d269bd54" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 42765 } }
I20260709 13:09:14.927546 29952 raft_consensus.cc:3060] T d90287f9e65f48c9b8ebdcaf7fe0dde2 P 4bc679ad21a64bfe93bf64ff1b6ba3b2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:14.924721 29875 raft_consensus.cc:3060] T d90287f9e65f48c9b8ebdcaf7fe0dde2 P 58a7cda73b3542718987bf815eed9b79 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:14.934929 29952 raft_consensus.cc:2468] T d90287f9e65f48c9b8ebdcaf7fe0dde2 P 4bc679ad21a64bfe93bf64ff1b6ba3b2 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 37897779fb894afb8129dcf5d269bd54 in term 2.
I20260709 13:09:14.936113 29991 leader_election.cc:304] T d90287f9e65f48c9b8ebdcaf7fe0dde2 P 37897779fb894afb8129dcf5d269bd54 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 37897779fb894afb8129dcf5d269bd54, 4bc679ad21a64bfe93bf64ff1b6ba3b2; no voters: 
I20260709 13:09:14.936342 29875 raft_consensus.cc:2468] T d90287f9e65f48c9b8ebdcaf7fe0dde2 P 58a7cda73b3542718987bf815eed9b79 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 37897779fb894afb8129dcf5d269bd54 in term 2.
I20260709 13:09:14.937023 30205 raft_consensus.cc:2804] T d90287f9e65f48c9b8ebdcaf7fe0dde2 P 37897779fb894afb8129dcf5d269bd54 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:09:14.937570 30205 raft_consensus.cc:697] T d90287f9e65f48c9b8ebdcaf7fe0dde2 P 37897779fb894afb8129dcf5d269bd54 [term 2 LEADER]: Becoming Leader. State: Replica: 37897779fb894afb8129dcf5d269bd54, State: Running, Role: LEADER
I20260709 13:09:14.938725 30205 consensus_queue.cc:237] T d90287f9e65f48c9b8ebdcaf7fe0dde2 P 37897779fb894afb8129dcf5d269bd54 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "58a7cda73b3542718987bf815eed9b79" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 37953 } } peers { permanent_uuid: "4bc679ad21a64bfe93bf64ff1b6ba3b2" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 33075 } } peers { permanent_uuid: "37897779fb894afb8129dcf5d269bd54" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 42765 } }
I20260709 13:09:14.945047 29776 catalog_manager.cc:5697] T d90287f9e65f48c9b8ebdcaf7fe0dde2 P 37897779fb894afb8129dcf5d269bd54 reported cstate change: term changed from 1 to 2, leader changed from 4bc679ad21a64bfe93bf64ff1b6ba3b2 (127.17.223.2) to 37897779fb894afb8129dcf5d269bd54 (127.17.223.3). New cstate: current_term: 2 leader_uuid: "37897779fb894afb8129dcf5d269bd54" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "58a7cda73b3542718987bf815eed9b79" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 37953 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4bc679ad21a64bfe93bf64ff1b6ba3b2" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 33075 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "37897779fb894afb8129dcf5d269bd54" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 42765 } health_report { overall_health: HEALTHY } } }
I20260709 13:09:14.990410 30204 raft_consensus.cc:993] T 2351aaf3431e4d18906f7f7fa8bb4f5c P 37897779fb894afb8129dcf5d269bd54: : Instructing follower 4bc679ad21a64bfe93bf64ff1b6ba3b2 to start an election
I20260709 13:09:14.990929 30204 raft_consensus.cc:1081] T 2351aaf3431e4d18906f7f7fa8bb4f5c P 37897779fb894afb8129dcf5d269bd54 [term 1 LEADER]: Signalling peer 4bc679ad21a64bfe93bf64ff1b6ba3b2 to start an election
I20260709 13:09:14.992529 29952 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "2351aaf3431e4d18906f7f7fa8bb4f5c"
dest_uuid: "4bc679ad21a64bfe93bf64ff1b6ba3b2"
 from {username='slave'} at 127.0.0.1:48678
I20260709 13:09:14.993044 29952 raft_consensus.cc:493] T 2351aaf3431e4d18906f7f7fa8bb4f5c P 4bc679ad21a64bfe93bf64ff1b6ba3b2 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:09:14.993388 29952 raft_consensus.cc:3060] T 2351aaf3431e4d18906f7f7fa8bb4f5c P 4bc679ad21a64bfe93bf64ff1b6ba3b2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:14.998266 29952 raft_consensus.cc:515] T 2351aaf3431e4d18906f7f7fa8bb4f5c P 4bc679ad21a64bfe93bf64ff1b6ba3b2 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "58a7cda73b3542718987bf815eed9b79" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 37953 } } peers { permanent_uuid: "4bc679ad21a64bfe93bf64ff1b6ba3b2" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 33075 } } peers { permanent_uuid: "37897779fb894afb8129dcf5d269bd54" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 42765 } }
I20260709 13:09:14.999687 29952 leader_election.cc:290] T 2351aaf3431e4d18906f7f7fa8bb4f5c P 4bc679ad21a64bfe93bf64ff1b6ba3b2 [CANDIDATE]: Term 2 election: Requested vote from peers 58a7cda73b3542718987bf815eed9b79 (127.17.223.1:37953), 37897779fb894afb8129dcf5d269bd54 (127.17.223.3:42765)
I20260709 13:09:15.000703 29875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2351aaf3431e4d18906f7f7fa8bb4f5c" candidate_uuid: "4bc679ad21a64bfe93bf64ff1b6ba3b2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "58a7cda73b3542718987bf815eed9b79"
I20260709 13:09:15.000710 30026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2351aaf3431e4d18906f7f7fa8bb4f5c" candidate_uuid: "4bc679ad21a64bfe93bf64ff1b6ba3b2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "37897779fb894afb8129dcf5d269bd54"
I20260709 13:09:15.001701 29875 raft_consensus.cc:3060] T 2351aaf3431e4d18906f7f7fa8bb4f5c P 58a7cda73b3542718987bf815eed9b79 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:15.001740 30026 raft_consensus.cc:3055] T 2351aaf3431e4d18906f7f7fa8bb4f5c P 37897779fb894afb8129dcf5d269bd54 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:09:15.002225 30026 raft_consensus.cc:740] T 2351aaf3431e4d18906f7f7fa8bb4f5c P 37897779fb894afb8129dcf5d269bd54 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 37897779fb894afb8129dcf5d269bd54, State: Running, Role: LEADER
I20260709 13:09:15.003063 30026 consensus_queue.cc:260] T 2351aaf3431e4d18906f7f7fa8bb4f5c P 37897779fb894afb8129dcf5d269bd54 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "58a7cda73b3542718987bf815eed9b79" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 37953 } } peers { permanent_uuid: "4bc679ad21a64bfe93bf64ff1b6ba3b2" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 33075 } } peers { permanent_uuid: "37897779fb894afb8129dcf5d269bd54" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 42765 } }
I20260709 13:09:15.004211 30026 raft_consensus.cc:3060] T 2351aaf3431e4d18906f7f7fa8bb4f5c P 37897779fb894afb8129dcf5d269bd54 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:15.009467 29875 raft_consensus.cc:2468] T 2351aaf3431e4d18906f7f7fa8bb4f5c P 58a7cda73b3542718987bf815eed9b79 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4bc679ad21a64bfe93bf64ff1b6ba3b2 in term 2.
I20260709 13:09:15.011109 29919 leader_election.cc:304] T 2351aaf3431e4d18906f7f7fa8bb4f5c P 4bc679ad21a64bfe93bf64ff1b6ba3b2 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4bc679ad21a64bfe93bf64ff1b6ba3b2, 58a7cda73b3542718987bf815eed9b79; no voters: 
I20260709 13:09:15.011368 30026 raft_consensus.cc:2468] T 2351aaf3431e4d18906f7f7fa8bb4f5c P 37897779fb894afb8129dcf5d269bd54 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4bc679ad21a64bfe93bf64ff1b6ba3b2 in term 2.
I20260709 13:09:15.011897 30210 raft_consensus.cc:2804] T 2351aaf3431e4d18906f7f7fa8bb4f5c P 4bc679ad21a64bfe93bf64ff1b6ba3b2 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:09:15.012372 30210 raft_consensus.cc:697] T 2351aaf3431e4d18906f7f7fa8bb4f5c P 4bc679ad21a64bfe93bf64ff1b6ba3b2 [term 2 LEADER]: Becoming Leader. State: Replica: 4bc679ad21a64bfe93bf64ff1b6ba3b2, State: Running, Role: LEADER
I20260709 13:09:15.013229 30210 consensus_queue.cc:237] T 2351aaf3431e4d18906f7f7fa8bb4f5c P 4bc679ad21a64bfe93bf64ff1b6ba3b2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "58a7cda73b3542718987bf815eed9b79" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 37953 } } peers { permanent_uuid: "4bc679ad21a64bfe93bf64ff1b6ba3b2" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 33075 } } peers { permanent_uuid: "37897779fb894afb8129dcf5d269bd54" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 42765 } }
I20260709 13:09:15.017766 30204 raft_consensus.cc:993] T 273ea248a58742f998fd8e9dc55097fc P 37897779fb894afb8129dcf5d269bd54: : Instructing follower 4bc679ad21a64bfe93bf64ff1b6ba3b2 to start an election
I20260709 13:09:15.018303 30204 raft_consensus.cc:1081] T 273ea248a58742f998fd8e9dc55097fc P 37897779fb894afb8129dcf5d269bd54 [term 1 LEADER]: Signalling peer 4bc679ad21a64bfe93bf64ff1b6ba3b2 to start an election
I20260709 13:09:15.019796 29952 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "273ea248a58742f998fd8e9dc55097fc"
dest_uuid: "4bc679ad21a64bfe93bf64ff1b6ba3b2"
 from {username='slave'} at 127.0.0.1:48678
I20260709 13:09:15.020351 29952 raft_consensus.cc:493] T 273ea248a58742f998fd8e9dc55097fc P 4bc679ad21a64bfe93bf64ff1b6ba3b2 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:09:15.020658 29952 raft_consensus.cc:3060] T 273ea248a58742f998fd8e9dc55097fc P 4bc679ad21a64bfe93bf64ff1b6ba3b2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:15.022293 29773 catalog_manager.cc:5697] T 2351aaf3431e4d18906f7f7fa8bb4f5c P 4bc679ad21a64bfe93bf64ff1b6ba3b2 reported cstate change: term changed from 1 to 2, leader changed from 37897779fb894afb8129dcf5d269bd54 (127.17.223.3) to 4bc679ad21a64bfe93bf64ff1b6ba3b2 (127.17.223.2). New cstate: current_term: 2 leader_uuid: "4bc679ad21a64bfe93bf64ff1b6ba3b2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "58a7cda73b3542718987bf815eed9b79" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 37953 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4bc679ad21a64bfe93bf64ff1b6ba3b2" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 33075 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "37897779fb894afb8129dcf5d269bd54" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 42765 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:15.026000 29952 raft_consensus.cc:515] T 273ea248a58742f998fd8e9dc55097fc P 4bc679ad21a64bfe93bf64ff1b6ba3b2 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "58a7cda73b3542718987bf815eed9b79" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 37953 } } peers { permanent_uuid: "4bc679ad21a64bfe93bf64ff1b6ba3b2" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 33075 } } peers { permanent_uuid: "37897779fb894afb8129dcf5d269bd54" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 42765 } }
I20260709 13:09:15.027747 29952 leader_election.cc:290] T 273ea248a58742f998fd8e9dc55097fc P 4bc679ad21a64bfe93bf64ff1b6ba3b2 [CANDIDATE]: Term 2 election: Requested vote from peers 58a7cda73b3542718987bf815eed9b79 (127.17.223.1:37953), 37897779fb894afb8129dcf5d269bd54 (127.17.223.3:42765)
I20260709 13:09:15.028784 29875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "273ea248a58742f998fd8e9dc55097fc" candidate_uuid: "4bc679ad21a64bfe93bf64ff1b6ba3b2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "58a7cda73b3542718987bf815eed9b79"
I20260709 13:09:15.029488 29875 raft_consensus.cc:3060] T 273ea248a58742f998fd8e9dc55097fc P 58a7cda73b3542718987bf815eed9b79 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:15.029580 30026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "273ea248a58742f998fd8e9dc55097fc" candidate_uuid: "4bc679ad21a64bfe93bf64ff1b6ba3b2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "37897779fb894afb8129dcf5d269bd54"
I20260709 13:09:15.030217 30026 raft_consensus.cc:3055] T 273ea248a58742f998fd8e9dc55097fc P 37897779fb894afb8129dcf5d269bd54 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:09:15.030532 30026 raft_consensus.cc:740] T 273ea248a58742f998fd8e9dc55097fc P 37897779fb894afb8129dcf5d269bd54 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 37897779fb894afb8129dcf5d269bd54, State: Running, Role: LEADER
I20260709 13:09:15.031291 30026 consensus_queue.cc:260] T 273ea248a58742f998fd8e9dc55097fc P 37897779fb894afb8129dcf5d269bd54 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "58a7cda73b3542718987bf815eed9b79" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 37953 } } peers { permanent_uuid: "4bc679ad21a64bfe93bf64ff1b6ba3b2" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 33075 } } peers { permanent_uuid: "37897779fb894afb8129dcf5d269bd54" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 42765 } }
I20260709 13:09:15.032439 30026 raft_consensus.cc:3060] T 273ea248a58742f998fd8e9dc55097fc P 37897779fb894afb8129dcf5d269bd54 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:15.036339 29875 raft_consensus.cc:2468] T 273ea248a58742f998fd8e9dc55097fc P 58a7cda73b3542718987bf815eed9b79 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4bc679ad21a64bfe93bf64ff1b6ba3b2 in term 2.
I20260709 13:09:15.038043 30026 raft_consensus.cc:2468] T 273ea248a58742f998fd8e9dc55097fc P 37897779fb894afb8129dcf5d269bd54 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4bc679ad21a64bfe93bf64ff1b6ba3b2 in term 2.
I20260709 13:09:15.038730 29919 leader_election.cc:304] T 273ea248a58742f998fd8e9dc55097fc P 4bc679ad21a64bfe93bf64ff1b6ba3b2 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4bc679ad21a64bfe93bf64ff1b6ba3b2, 58a7cda73b3542718987bf815eed9b79; no voters: 
I20260709 13:09:15.039891 30210 raft_consensus.cc:2804] T 273ea248a58742f998fd8e9dc55097fc P 4bc679ad21a64bfe93bf64ff1b6ba3b2 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:09:15.041397 30210 raft_consensus.cc:697] T 273ea248a58742f998fd8e9dc55097fc P 4bc679ad21a64bfe93bf64ff1b6ba3b2 [term 2 LEADER]: Becoming Leader. State: Replica: 4bc679ad21a64bfe93bf64ff1b6ba3b2, State: Running, Role: LEADER
I20260709 13:09:15.042265 30210 consensus_queue.cc:237] T 273ea248a58742f998fd8e9dc55097fc P 4bc679ad21a64bfe93bf64ff1b6ba3b2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "58a7cda73b3542718987bf815eed9b79" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 37953 } } peers { permanent_uuid: "4bc679ad21a64bfe93bf64ff1b6ba3b2" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 33075 } } peers { permanent_uuid: "37897779fb894afb8129dcf5d269bd54" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 42765 } }
I20260709 13:09:15.049432 29773 catalog_manager.cc:5697] T 273ea248a58742f998fd8e9dc55097fc P 4bc679ad21a64bfe93bf64ff1b6ba3b2 reported cstate change: term changed from 1 to 2, leader changed from 37897779fb894afb8129dcf5d269bd54 (127.17.223.3) to 4bc679ad21a64bfe93bf64ff1b6ba3b2 (127.17.223.2). New cstate: current_term: 2 leader_uuid: "4bc679ad21a64bfe93bf64ff1b6ba3b2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "58a7cda73b3542718987bf815eed9b79" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 37953 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4bc679ad21a64bfe93bf64ff1b6ba3b2" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 33075 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "37897779fb894afb8129dcf5d269bd54" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 42765 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:15.074601 30239 raft_consensus.cc:993] T 797710d1534045c3a8597c9800a09ea6 P 4bc679ad21a64bfe93bf64ff1b6ba3b2: : Instructing follower 58a7cda73b3542718987bf815eed9b79 to start an election
I20260709 13:09:15.075145 30210 raft_consensus.cc:1081] T 797710d1534045c3a8597c9800a09ea6 P 4bc679ad21a64bfe93bf64ff1b6ba3b2 [term 1 LEADER]: Signalling peer 58a7cda73b3542718987bf815eed9b79 to start an election
I20260709 13:09:15.076655 29878 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "797710d1534045c3a8597c9800a09ea6"
dest_uuid: "58a7cda73b3542718987bf815eed9b79"
 from {username='slave'} at 127.0.0.1:36140
I20260709 13:09:15.077222 29878 raft_consensus.cc:493] T 797710d1534045c3a8597c9800a09ea6 P 58a7cda73b3542718987bf815eed9b79 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:09:15.077596 29878 raft_consensus.cc:3060] T 797710d1534045c3a8597c9800a09ea6 P 58a7cda73b3542718987bf815eed9b79 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:15.082927 29878 raft_consensus.cc:515] T 797710d1534045c3a8597c9800a09ea6 P 58a7cda73b3542718987bf815eed9b79 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "58a7cda73b3542718987bf815eed9b79" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 37953 } } peers { permanent_uuid: "4bc679ad21a64bfe93bf64ff1b6ba3b2" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 33075 } } peers { permanent_uuid: "37897779fb894afb8129dcf5d269bd54" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 42765 } }
I20260709 13:09:15.084548 29878 leader_election.cc:290] T 797710d1534045c3a8597c9800a09ea6 P 58a7cda73b3542718987bf815eed9b79 [CANDIDATE]: Term 2 election: Requested vote from peers 4bc679ad21a64bfe93bf64ff1b6ba3b2 (127.17.223.2:33075), 37897779fb894afb8129dcf5d269bd54 (127.17.223.3:42765)
I20260709 13:09:15.085502 29952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "797710d1534045c3a8597c9800a09ea6" candidate_uuid: "58a7cda73b3542718987bf815eed9b79" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "4bc679ad21a64bfe93bf64ff1b6ba3b2"
I20260709 13:09:15.085665 30025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "797710d1534045c3a8597c9800a09ea6" candidate_uuid: "58a7cda73b3542718987bf815eed9b79" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "37897779fb894afb8129dcf5d269bd54"
I20260709 13:09:15.086135 29952 raft_consensus.cc:3055] T 797710d1534045c3a8597c9800a09ea6 P 4bc679ad21a64bfe93bf64ff1b6ba3b2 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:09:15.086304 30025 raft_consensus.cc:3060] T 797710d1534045c3a8597c9800a09ea6 P 37897779fb894afb8129dcf5d269bd54 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:15.086462 29952 raft_consensus.cc:740] T 797710d1534045c3a8597c9800a09ea6 P 4bc679ad21a64bfe93bf64ff1b6ba3b2 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 4bc679ad21a64bfe93bf64ff1b6ba3b2, State: Running, Role: LEADER
I20260709 13:09:15.087337 29952 consensus_queue.cc:260] T 797710d1534045c3a8597c9800a09ea6 P 4bc679ad21a64bfe93bf64ff1b6ba3b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "58a7cda73b3542718987bf815eed9b79" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 37953 } } peers { permanent_uuid: "4bc679ad21a64bfe93bf64ff1b6ba3b2" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 33075 } } peers { permanent_uuid: "37897779fb894afb8129dcf5d269bd54" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 42765 } }
I20260709 13:09:15.088238 29952 raft_consensus.cc:3060] T 797710d1534045c3a8597c9800a09ea6 P 4bc679ad21a64bfe93bf64ff1b6ba3b2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:15.092083 30025 raft_consensus.cc:2468] T 797710d1534045c3a8597c9800a09ea6 P 37897779fb894afb8129dcf5d269bd54 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 58a7cda73b3542718987bf815eed9b79 in term 2.
I20260709 13:09:15.092810 29952 raft_consensus.cc:2468] T 797710d1534045c3a8597c9800a09ea6 P 4bc679ad21a64bfe93bf64ff1b6ba3b2 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 58a7cda73b3542718987bf815eed9b79 in term 2.
I20260709 13:09:15.093394 29841 leader_election.cc:304] T 797710d1534045c3a8597c9800a09ea6 P 58a7cda73b3542718987bf815eed9b79 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 37897779fb894afb8129dcf5d269bd54, 58a7cda73b3542718987bf815eed9b79; no voters: 
I20260709 13:09:15.094312 30191 raft_consensus.cc:2804] T 797710d1534045c3a8597c9800a09ea6 P 58a7cda73b3542718987bf815eed9b79 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:09:15.094823 30191 raft_consensus.cc:697] T 797710d1534045c3a8597c9800a09ea6 P 58a7cda73b3542718987bf815eed9b79 [term 2 LEADER]: Becoming Leader. State: Replica: 58a7cda73b3542718987bf815eed9b79, State: Running, Role: LEADER
I20260709 13:09:15.095935 30205 raft_consensus.cc:993] T fa4b1db9a2d44d45bc9935975428592e P 37897779fb894afb8129dcf5d269bd54: : Instructing follower 4bc679ad21a64bfe93bf64ff1b6ba3b2 to start an election
I20260709 13:09:15.095651 30191 consensus_queue.cc:237] T 797710d1534045c3a8597c9800a09ea6 P 58a7cda73b3542718987bf815eed9b79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "58a7cda73b3542718987bf815eed9b79" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 37953 } } peers { permanent_uuid: "4bc679ad21a64bfe93bf64ff1b6ba3b2" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 33075 } } peers { permanent_uuid: "37897779fb894afb8129dcf5d269bd54" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 42765 } }
I20260709 13:09:15.096446 30205 raft_consensus.cc:1081] T fa4b1db9a2d44d45bc9935975428592e P 37897779fb894afb8129dcf5d269bd54 [term 1 LEADER]: Signalling peer 4bc679ad21a64bfe93bf64ff1b6ba3b2 to start an election
I20260709 13:09:15.098054 29952 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "fa4b1db9a2d44d45bc9935975428592e"
dest_uuid: "4bc679ad21a64bfe93bf64ff1b6ba3b2"
 from {username='slave'} at 127.0.0.1:48678
I20260709 13:09:15.098560 29952 raft_consensus.cc:493] T fa4b1db9a2d44d45bc9935975428592e P 4bc679ad21a64bfe93bf64ff1b6ba3b2 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:09:15.098903 29952 raft_consensus.cc:3060] T fa4b1db9a2d44d45bc9935975428592e P 4bc679ad21a64bfe93bf64ff1b6ba3b2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:15.103281 29952 raft_consensus.cc:515] T fa4b1db9a2d44d45bc9935975428592e P 4bc679ad21a64bfe93bf64ff1b6ba3b2 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "58a7cda73b3542718987bf815eed9b79" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 37953 } } peers { permanent_uuid: "4bc679ad21a64bfe93bf64ff1b6ba3b2" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 33075 } } peers { permanent_uuid: "37897779fb894afb8129dcf5d269bd54" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 42765 } }
I20260709 13:09:15.103474 29773 catalog_manager.cc:5697] T 797710d1534045c3a8597c9800a09ea6 P 58a7cda73b3542718987bf815eed9b79 reported cstate change: term changed from 1 to 2, leader changed from 4bc679ad21a64bfe93bf64ff1b6ba3b2 (127.17.223.2) to 58a7cda73b3542718987bf815eed9b79 (127.17.223.1). New cstate: current_term: 2 leader_uuid: "58a7cda73b3542718987bf815eed9b79" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "58a7cda73b3542718987bf815eed9b79" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 37953 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4bc679ad21a64bfe93bf64ff1b6ba3b2" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 33075 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "37897779fb894afb8129dcf5d269bd54" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 42765 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:15.105396 29952 leader_election.cc:290] T fa4b1db9a2d44d45bc9935975428592e P 4bc679ad21a64bfe93bf64ff1b6ba3b2 [CANDIDATE]: Term 2 election: Requested vote from peers 58a7cda73b3542718987bf815eed9b79 (127.17.223.1:37953), 37897779fb894afb8129dcf5d269bd54 (127.17.223.3:42765)
I20260709 13:09:15.106462 29878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa4b1db9a2d44d45bc9935975428592e" candidate_uuid: "4bc679ad21a64bfe93bf64ff1b6ba3b2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "58a7cda73b3542718987bf815eed9b79"
I20260709 13:09:15.106864 30025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa4b1db9a2d44d45bc9935975428592e" candidate_uuid: "4bc679ad21a64bfe93bf64ff1b6ba3b2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "37897779fb894afb8129dcf5d269bd54"
I20260709 13:09:15.107189 29878 raft_consensus.cc:3060] T fa4b1db9a2d44d45bc9935975428592e P 58a7cda73b3542718987bf815eed9b79 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:15.107537 30025 raft_consensus.cc:3055] T fa4b1db9a2d44d45bc9935975428592e P 37897779fb894afb8129dcf5d269bd54 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:09:15.107933 30025 raft_consensus.cc:740] T fa4b1db9a2d44d45bc9935975428592e P 37897779fb894afb8129dcf5d269bd54 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 37897779fb894afb8129dcf5d269bd54, State: Running, Role: LEADER
I20260709 13:09:15.108726 30025 consensus_queue.cc:260] T fa4b1db9a2d44d45bc9935975428592e P 37897779fb894afb8129dcf5d269bd54 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "58a7cda73b3542718987bf815eed9b79" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 37953 } } peers { permanent_uuid: "4bc679ad21a64bfe93bf64ff1b6ba3b2" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 33075 } } peers { permanent_uuid: "37897779fb894afb8129dcf5d269bd54" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 42765 } }
I20260709 13:09:15.109834 30025 raft_consensus.cc:3060] T fa4b1db9a2d44d45bc9935975428592e P 37897779fb894afb8129dcf5d269bd54 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:15.113561 29878 raft_consensus.cc:2468] T fa4b1db9a2d44d45bc9935975428592e P 58a7cda73b3542718987bf815eed9b79 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4bc679ad21a64bfe93bf64ff1b6ba3b2 in term 2.
I20260709 13:09:15.114773 29919 leader_election.cc:304] T fa4b1db9a2d44d45bc9935975428592e P 4bc679ad21a64bfe93bf64ff1b6ba3b2 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4bc679ad21a64bfe93bf64ff1b6ba3b2, 58a7cda73b3542718987bf815eed9b79; no voters: 
I20260709 13:09:15.115546 30210 raft_consensus.cc:2804] T fa4b1db9a2d44d45bc9935975428592e P 4bc679ad21a64bfe93bf64ff1b6ba3b2 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:09:15.116039 30210 raft_consensus.cc:697] T fa4b1db9a2d44d45bc9935975428592e P 4bc679ad21a64bfe93bf64ff1b6ba3b2 [term 2 LEADER]: Becoming Leader. State: Replica: 4bc679ad21a64bfe93bf64ff1b6ba3b2, State: Running, Role: LEADER
I20260709 13:09:15.116855 30210 consensus_queue.cc:237] T fa4b1db9a2d44d45bc9935975428592e P 4bc679ad21a64bfe93bf64ff1b6ba3b2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "58a7cda73b3542718987bf815eed9b79" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 37953 } } peers { permanent_uuid: "4bc679ad21a64bfe93bf64ff1b6ba3b2" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 33075 } } peers { permanent_uuid: "37897779fb894afb8129dcf5d269bd54" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 42765 } }
I20260709 13:09:15.117951 30025 raft_consensus.cc:2468] T fa4b1db9a2d44d45bc9935975428592e P 37897779fb894afb8129dcf5d269bd54 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4bc679ad21a64bfe93bf64ff1b6ba3b2 in term 2.
I20260709 13:09:15.124862 29773 catalog_manager.cc:5697] T fa4b1db9a2d44d45bc9935975428592e P 4bc679ad21a64bfe93bf64ff1b6ba3b2 reported cstate change: term changed from 1 to 2, leader changed from 37897779fb894afb8129dcf5d269bd54 (127.17.223.3) to 4bc679ad21a64bfe93bf64ff1b6ba3b2 (127.17.223.2). New cstate: current_term: 2 leader_uuid: "4bc679ad21a64bfe93bf64ff1b6ba3b2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "58a7cda73b3542718987bf815eed9b79" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 37953 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4bc679ad21a64bfe93bf64ff1b6ba3b2" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 33075 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "37897779fb894afb8129dcf5d269bd54" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 42765 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:15.174551 30203 raft_consensus.cc:993] T 5ccb587267a8414180b1f5474e4e2728 P 58a7cda73b3542718987bf815eed9b79: : Instructing follower 4bc679ad21a64bfe93bf64ff1b6ba3b2 to start an election
I20260709 13:09:15.175084 30191 raft_consensus.cc:1081] T 5ccb587267a8414180b1f5474e4e2728 P 58a7cda73b3542718987bf815eed9b79 [term 1 LEADER]: Signalling peer 4bc679ad21a64bfe93bf64ff1b6ba3b2 to start an election
I20260709 13:09:15.176433 29951 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "5ccb587267a8414180b1f5474e4e2728"
dest_uuid: "4bc679ad21a64bfe93bf64ff1b6ba3b2"
 from {username='slave'} at 127.0.0.1:48676
I20260709 13:09:15.176903 29951 raft_consensus.cc:493] T 5ccb587267a8414180b1f5474e4e2728 P 4bc679ad21a64bfe93bf64ff1b6ba3b2 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:09:15.177194 29951 raft_consensus.cc:3060] T 5ccb587267a8414180b1f5474e4e2728 P 4bc679ad21a64bfe93bf64ff1b6ba3b2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:15.182247 29951 raft_consensus.cc:515] T 5ccb587267a8414180b1f5474e4e2728 P 4bc679ad21a64bfe93bf64ff1b6ba3b2 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "58a7cda73b3542718987bf815eed9b79" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 37953 } } peers { permanent_uuid: "4bc679ad21a64bfe93bf64ff1b6ba3b2" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 33075 } } peers { permanent_uuid: "37897779fb894afb8129dcf5d269bd54" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 42765 } }
I20260709 13:09:15.184079 29951 leader_election.cc:290] T 5ccb587267a8414180b1f5474e4e2728 P 4bc679ad21a64bfe93bf64ff1b6ba3b2 [CANDIDATE]: Term 2 election: Requested vote from peers 58a7cda73b3542718987bf815eed9b79 (127.17.223.1:37953), 37897779fb894afb8129dcf5d269bd54 (127.17.223.3:42765)
I20260709 13:09:15.184844 29878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ccb587267a8414180b1f5474e4e2728" candidate_uuid: "4bc679ad21a64bfe93bf64ff1b6ba3b2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "58a7cda73b3542718987bf815eed9b79"
I20260709 13:09:15.185161 30025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ccb587267a8414180b1f5474e4e2728" candidate_uuid: "4bc679ad21a64bfe93bf64ff1b6ba3b2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "37897779fb894afb8129dcf5d269bd54"
I20260709 13:09:15.185462 29878 raft_consensus.cc:3055] T 5ccb587267a8414180b1f5474e4e2728 P 58a7cda73b3542718987bf815eed9b79 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:09:15.185802 30025 raft_consensus.cc:3060] T 5ccb587267a8414180b1f5474e4e2728 P 37897779fb894afb8129dcf5d269bd54 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:15.185845 29878 raft_consensus.cc:740] T 5ccb587267a8414180b1f5474e4e2728 P 58a7cda73b3542718987bf815eed9b79 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 58a7cda73b3542718987bf815eed9b79, State: Running, Role: LEADER
I20260709 13:09:15.186602 29878 consensus_queue.cc:260] T 5ccb587267a8414180b1f5474e4e2728 P 58a7cda73b3542718987bf815eed9b79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "58a7cda73b3542718987bf815eed9b79" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 37953 } } peers { permanent_uuid: "4bc679ad21a64bfe93bf64ff1b6ba3b2" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 33075 } } peers { permanent_uuid: "37897779fb894afb8129dcf5d269bd54" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 42765 } }
I20260709 13:09:15.187536 29878 raft_consensus.cc:3060] T 5ccb587267a8414180b1f5474e4e2728 P 58a7cda73b3542718987bf815eed9b79 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:15.191079 30025 raft_consensus.cc:2468] T 5ccb587267a8414180b1f5474e4e2728 P 37897779fb894afb8129dcf5d269bd54 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4bc679ad21a64bfe93bf64ff1b6ba3b2 in term 2.
I20260709 13:09:15.192255 29916 leader_election.cc:304] T 5ccb587267a8414180b1f5474e4e2728 P 4bc679ad21a64bfe93bf64ff1b6ba3b2 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 37897779fb894afb8129dcf5d269bd54, 4bc679ad21a64bfe93bf64ff1b6ba3b2; no voters: 
I20260709 13:09:15.192271 29878 raft_consensus.cc:2468] T 5ccb587267a8414180b1f5474e4e2728 P 58a7cda73b3542718987bf815eed9b79 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4bc679ad21a64bfe93bf64ff1b6ba3b2 in term 2.
I20260709 13:09:15.193043 30210 raft_consensus.cc:2804] T 5ccb587267a8414180b1f5474e4e2728 P 4bc679ad21a64bfe93bf64ff1b6ba3b2 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:09:15.193612 30210 raft_consensus.cc:697] T 5ccb587267a8414180b1f5474e4e2728 P 4bc679ad21a64bfe93bf64ff1b6ba3b2 [term 2 LEADER]: Becoming Leader. State: Replica: 4bc679ad21a64bfe93bf64ff1b6ba3b2, State: Running, Role: LEADER
I20260709 13:09:15.194406 30210 consensus_queue.cc:237] T 5ccb587267a8414180b1f5474e4e2728 P 4bc679ad21a64bfe93bf64ff1b6ba3b2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "58a7cda73b3542718987bf815eed9b79" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 37953 } } peers { permanent_uuid: "4bc679ad21a64bfe93bf64ff1b6ba3b2" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 33075 } } peers { permanent_uuid: "37897779fb894afb8129dcf5d269bd54" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 42765 } }
I20260709 13:09:15.202546 29773 catalog_manager.cc:5697] T 5ccb587267a8414180b1f5474e4e2728 P 4bc679ad21a64bfe93bf64ff1b6ba3b2 reported cstate change: term changed from 1 to 2, leader changed from 58a7cda73b3542718987bf815eed9b79 (127.17.223.1) to 4bc679ad21a64bfe93bf64ff1b6ba3b2 (127.17.223.2). New cstate: current_term: 2 leader_uuid: "4bc679ad21a64bfe93bf64ff1b6ba3b2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "58a7cda73b3542718987bf815eed9b79" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 37953 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4bc679ad21a64bfe93bf64ff1b6ba3b2" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 33075 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "37897779fb894afb8129dcf5d269bd54" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 42765 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:15.208055 30239 raft_consensus.cc:993] T ea945f01fa404ea29878b0cd26af4e1e P 4bc679ad21a64bfe93bf64ff1b6ba3b2: : Instructing follower 58a7cda73b3542718987bf815eed9b79 to start an election
I20260709 13:09:15.208534 30210 raft_consensus.cc:1081] T ea945f01fa404ea29878b0cd26af4e1e P 4bc679ad21a64bfe93bf64ff1b6ba3b2 [term 1 LEADER]: Signalling peer 58a7cda73b3542718987bf815eed9b79 to start an election
I20260709 13:09:15.209965 29878 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ea945f01fa404ea29878b0cd26af4e1e"
dest_uuid: "58a7cda73b3542718987bf815eed9b79"
 from {username='slave'} at 127.0.0.1:36140
I20260709 13:09:15.210390 29878 raft_consensus.cc:493] T ea945f01fa404ea29878b0cd26af4e1e P 58a7cda73b3542718987bf815eed9b79 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:09:15.210722 29878 raft_consensus.cc:3060] T ea945f01fa404ea29878b0cd26af4e1e P 58a7cda73b3542718987bf815eed9b79 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:15.215859 29878 raft_consensus.cc:515] T ea945f01fa404ea29878b0cd26af4e1e P 58a7cda73b3542718987bf815eed9b79 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "58a7cda73b3542718987bf815eed9b79" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 37953 } } peers { permanent_uuid: "4bc679ad21a64bfe93bf64ff1b6ba3b2" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 33075 } } peers { permanent_uuid: "37897779fb894afb8129dcf5d269bd54" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 42765 } }
I20260709 13:09:15.217255 29878 leader_election.cc:290] T ea945f01fa404ea29878b0cd26af4e1e P 58a7cda73b3542718987bf815eed9b79 [CANDIDATE]: Term 2 election: Requested vote from peers 4bc679ad21a64bfe93bf64ff1b6ba3b2 (127.17.223.2:33075), 37897779fb894afb8129dcf5d269bd54 (127.17.223.3:42765)
I20260709 13:09:15.218349 30025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea945f01fa404ea29878b0cd26af4e1e" candidate_uuid: "58a7cda73b3542718987bf815eed9b79" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "37897779fb894afb8129dcf5d269bd54"
I20260709 13:09:15.218343 29951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea945f01fa404ea29878b0cd26af4e1e" candidate_uuid: "58a7cda73b3542718987bf815eed9b79" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "4bc679ad21a64bfe93bf64ff1b6ba3b2"
I20260709 13:09:15.219034 30025 raft_consensus.cc:3060] T ea945f01fa404ea29878b0cd26af4e1e P 37897779fb894afb8129dcf5d269bd54 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:15.219094 29951 raft_consensus.cc:3055] T ea945f01fa404ea29878b0cd26af4e1e P 4bc679ad21a64bfe93bf64ff1b6ba3b2 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:09:15.219547 29951 raft_consensus.cc:740] T ea945f01fa404ea29878b0cd26af4e1e P 4bc679ad21a64bfe93bf64ff1b6ba3b2 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 4bc679ad21a64bfe93bf64ff1b6ba3b2, State: Running, Role: LEADER
I20260709 13:09:15.220182 29951 consensus_queue.cc:260] T ea945f01fa404ea29878b0cd26af4e1e P 4bc679ad21a64bfe93bf64ff1b6ba3b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "58a7cda73b3542718987bf815eed9b79" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 37953 } } peers { permanent_uuid: "4bc679ad21a64bfe93bf64ff1b6ba3b2" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 33075 } } peers { permanent_uuid: "37897779fb894afb8129dcf5d269bd54" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 42765 } }
I20260709 13:09:15.221108 29951 raft_consensus.cc:3060] T ea945f01fa404ea29878b0cd26af4e1e P 4bc679ad21a64bfe93bf64ff1b6ba3b2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:15.224403 30025 raft_consensus.cc:2468] T ea945f01fa404ea29878b0cd26af4e1e P 37897779fb894afb8129dcf5d269bd54 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 58a7cda73b3542718987bf815eed9b79 in term 2.
I20260709 13:09:15.225711 29841 leader_election.cc:304] T ea945f01fa404ea29878b0cd26af4e1e P 58a7cda73b3542718987bf815eed9b79 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 37897779fb894afb8129dcf5d269bd54, 58a7cda73b3542718987bf815eed9b79; no voters: 
I20260709 13:09:15.226325 29951 raft_consensus.cc:2468] T ea945f01fa404ea29878b0cd26af4e1e P 4bc679ad21a64bfe93bf64ff1b6ba3b2 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 58a7cda73b3542718987bf815eed9b79 in term 2.
I20260709 13:09:15.226454 30191 raft_consensus.cc:2804] T ea945f01fa404ea29878b0cd26af4e1e P 58a7cda73b3542718987bf815eed9b79 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:09:15.227290 30191 raft_consensus.cc:697] T ea945f01fa404ea29878b0cd26af4e1e P 58a7cda73b3542718987bf815eed9b79 [term 2 LEADER]: Becoming Leader. State: Replica: 58a7cda73b3542718987bf815eed9b79, State: Running, Role: LEADER
I20260709 13:09:15.228113 30191 consensus_queue.cc:237] T ea945f01fa404ea29878b0cd26af4e1e P 58a7cda73b3542718987bf815eed9b79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "58a7cda73b3542718987bf815eed9b79" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 37953 } } peers { permanent_uuid: "4bc679ad21a64bfe93bf64ff1b6ba3b2" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 33075 } } peers { permanent_uuid: "37897779fb894afb8129dcf5d269bd54" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 42765 } }
I20260709 13:09:15.235293 29773 catalog_manager.cc:5697] T ea945f01fa404ea29878b0cd26af4e1e P 58a7cda73b3542718987bf815eed9b79 reported cstate change: term changed from 1 to 2, leader changed from 4bc679ad21a64bfe93bf64ff1b6ba3b2 (127.17.223.2) to 58a7cda73b3542718987bf815eed9b79 (127.17.223.1). New cstate: current_term: 2 leader_uuid: "58a7cda73b3542718987bf815eed9b79" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "58a7cda73b3542718987bf815eed9b79" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 37953 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4bc679ad21a64bfe93bf64ff1b6ba3b2" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 33075 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "37897779fb894afb8129dcf5d269bd54" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 42765 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:15.255606 30025 raft_consensus.cc:1275] T d8a815244f7c485b980dfa0adb0fd2a9 P 37897779fb894afb8129dcf5d269bd54 [term 2 FOLLOWER]: Refusing update from remote peer 58a7cda73b3542718987bf815eed9b79: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:15.256839 30191 consensus_queue.cc:1048] T d8a815244f7c485b980dfa0adb0fd2a9 P 58a7cda73b3542718987bf815eed9b79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "37897779fb894afb8129dcf5d269bd54" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 42765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:09:15.263934 29951 raft_consensus.cc:1275] T d8a815244f7c485b980dfa0adb0fd2a9 P 4bc679ad21a64bfe93bf64ff1b6ba3b2 [term 2 FOLLOWER]: Refusing update from remote peer 58a7cda73b3542718987bf815eed9b79: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:15.265694 30203 consensus_queue.cc:1048] T d8a815244f7c485b980dfa0adb0fd2a9 P 58a7cda73b3542718987bf815eed9b79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4bc679ad21a64bfe93bf64ff1b6ba3b2" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 33075 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:09:15.385488 29878 raft_consensus.cc:1275] T d90287f9e65f48c9b8ebdcaf7fe0dde2 P 58a7cda73b3542718987bf815eed9b79 [term 2 FOLLOWER]: Refusing update from remote peer 37897779fb894afb8129dcf5d269bd54: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:15.387037 30205 consensus_queue.cc:1048] T d90287f9e65f48c9b8ebdcaf7fe0dde2 P 37897779fb894afb8129dcf5d269bd54 [LEADER]: Connected to new peer: Peer: permanent_uuid: "58a7cda73b3542718987bf815eed9b79" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 37953 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:09:15.395387 29951 raft_consensus.cc:1275] T d90287f9e65f48c9b8ebdcaf7fe0dde2 P 4bc679ad21a64bfe93bf64ff1b6ba3b2 [term 2 FOLLOWER]: Refusing update from remote peer 37897779fb894afb8129dcf5d269bd54: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:15.397358 30205 consensus_queue.cc:1048] T d90287f9e65f48c9b8ebdcaf7fe0dde2 P 37897779fb894afb8129dcf5d269bd54 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4bc679ad21a64bfe93bf64ff1b6ba3b2" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 33075 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:09:15.476200 30026 raft_consensus.cc:1275] T 273ea248a58742f998fd8e9dc55097fc P 37897779fb894afb8129dcf5d269bd54 [term 2 FOLLOWER]: Refusing update from remote peer 4bc679ad21a64bfe93bf64ff1b6ba3b2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:15.477391 30239 consensus_queue.cc:1048] T 273ea248a58742f998fd8e9dc55097fc P 4bc679ad21a64bfe93bf64ff1b6ba3b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "37897779fb894afb8129dcf5d269bd54" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 42765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:09:15.485357 29878 raft_consensus.cc:1275] T 273ea248a58742f998fd8e9dc55097fc P 58a7cda73b3542718987bf815eed9b79 [term 2 FOLLOWER]: Refusing update from remote peer 4bc679ad21a64bfe93bf64ff1b6ba3b2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:15.486959 30239 consensus_queue.cc:1048] T 273ea248a58742f998fd8e9dc55097fc P 4bc679ad21a64bfe93bf64ff1b6ba3b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "58a7cda73b3542718987bf815eed9b79" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 37953 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:09:15.500415 30026 raft_consensus.cc:1275] T 2351aaf3431e4d18906f7f7fa8bb4f5c P 37897779fb894afb8129dcf5d269bd54 [term 2 FOLLOWER]: Refusing update from remote peer 4bc679ad21a64bfe93bf64ff1b6ba3b2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:15.501901 30239 consensus_queue.cc:1048] T 2351aaf3431e4d18906f7f7fa8bb4f5c P 4bc679ad21a64bfe93bf64ff1b6ba3b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "37897779fb894afb8129dcf5d269bd54" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 42765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:09:15.510231 29878 raft_consensus.cc:1275] T 2351aaf3431e4d18906f7f7fa8bb4f5c P 58a7cda73b3542718987bf815eed9b79 [term 2 FOLLOWER]: Refusing update from remote peer 4bc679ad21a64bfe93bf64ff1b6ba3b2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:15.511595 30173 consensus_queue.cc:1048] T 2351aaf3431e4d18906f7f7fa8bb4f5c P 4bc679ad21a64bfe93bf64ff1b6ba3b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "58a7cda73b3542718987bf815eed9b79" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 37953 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:09:15.614744 30026 raft_consensus.cc:1275] T ea945f01fa404ea29878b0cd26af4e1e P 37897779fb894afb8129dcf5d269bd54 [term 2 FOLLOWER]: Refusing update from remote peer 58a7cda73b3542718987bf815eed9b79: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:15.616020 30203 consensus_queue.cc:1048] T ea945f01fa404ea29878b0cd26af4e1e P 58a7cda73b3542718987bf815eed9b79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "37897779fb894afb8129dcf5d269bd54" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 42765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:09:15.625022 29951 raft_consensus.cc:1275] T ea945f01fa404ea29878b0cd26af4e1e P 4bc679ad21a64bfe93bf64ff1b6ba3b2 [term 2 FOLLOWER]: Refusing update from remote peer 58a7cda73b3542718987bf815eed9b79: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:15.626607 30193 consensus_queue.cc:1048] T ea945f01fa404ea29878b0cd26af4e1e P 58a7cda73b3542718987bf815eed9b79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4bc679ad21a64bfe93bf64ff1b6ba3b2" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 33075 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:09:15.662851 29951 raft_consensus.cc:1275] T 797710d1534045c3a8597c9800a09ea6 P 4bc679ad21a64bfe93bf64ff1b6ba3b2 [term 2 FOLLOWER]: Refusing update from remote peer 58a7cda73b3542718987bf815eed9b79: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:15.664227 30193 consensus_queue.cc:1048] T 797710d1534045c3a8597c9800a09ea6 P 58a7cda73b3542718987bf815eed9b79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4bc679ad21a64bfe93bf64ff1b6ba3b2" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 33075 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:09:15.665119 30026 raft_consensus.cc:1275] T 797710d1534045c3a8597c9800a09ea6 P 37897779fb894afb8129dcf5d269bd54 [term 2 FOLLOWER]: Refusing update from remote peer 58a7cda73b3542718987bf815eed9b79: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:15.666519 30193 consensus_queue.cc:1048] T 797710d1534045c3a8597c9800a09ea6 P 58a7cda73b3542718987bf815eed9b79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "37897779fb894afb8129dcf5d269bd54" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 42765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:09:15.679401 30025 raft_consensus.cc:1275] T fa4b1db9a2d44d45bc9935975428592e P 37897779fb894afb8129dcf5d269bd54 [term 2 FOLLOWER]: Refusing update from remote peer 4bc679ad21a64bfe93bf64ff1b6ba3b2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:15.680881 30239 consensus_queue.cc:1048] T fa4b1db9a2d44d45bc9935975428592e P 4bc679ad21a64bfe93bf64ff1b6ba3b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "37897779fb894afb8129dcf5d269bd54" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 42765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:09:15.697376 29878 raft_consensus.cc:1275] T fa4b1db9a2d44d45bc9935975428592e P 58a7cda73b3542718987bf815eed9b79 [term 2 FOLLOWER]: Refusing update from remote peer 4bc679ad21a64bfe93bf64ff1b6ba3b2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:15.698869 30210 consensus_queue.cc:1048] T fa4b1db9a2d44d45bc9935975428592e P 4bc679ad21a64bfe93bf64ff1b6ba3b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "58a7cda73b3542718987bf815eed9b79" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 37953 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:09:15.759979 29878 raft_consensus.cc:1275] T 5ccb587267a8414180b1f5474e4e2728 P 58a7cda73b3542718987bf815eed9b79 [term 2 FOLLOWER]: Refusing update from remote peer 4bc679ad21a64bfe93bf64ff1b6ba3b2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:15.761229 30210 consensus_queue.cc:1048] T 5ccb587267a8414180b1f5474e4e2728 P 4bc679ad21a64bfe93bf64ff1b6ba3b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "58a7cda73b3542718987bf815eed9b79" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 37953 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:09:15.769680 30026 raft_consensus.cc:1275] T 5ccb587267a8414180b1f5474e4e2728 P 37897779fb894afb8129dcf5d269bd54 [term 2 FOLLOWER]: Refusing update from remote peer 4bc679ad21a64bfe93bf64ff1b6ba3b2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:15.771224 30173 consensus_queue.cc:1048] T 5ccb587267a8414180b1f5474e4e2728 P 4bc679ad21a64bfe93bf64ff1b6ba3b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "37897779fb894afb8129dcf5d269bd54" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 42765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:09:17.786007 29774 catalog_manager.cc:2533] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:47206:
table { table_name: "soft_deleted_table" } modify_external_catalogs: true reserve_seconds: 3600
I20260709 13:09:17.817675 29774 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:47206:
table { table_name: "soft_deleted_table" } new_extra_configs { key: "kudu.table.disable_compaction" value: "true" }
I20260709 13:09:17.937552 18300 auto_leader_rebalancer.cc:141] leader rebalance for table soft_deleted_table
W20260709 13:09:18.011091 29916 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.3:42765, user_credentials={real_user=slave}} blocked reactor thread for 46089.5us
W20260709 13:09:18.035482 30267 log.cc:927] Time spent T fa4b1db9a2d44d45bc9935975428592e P 4bc679ad21a64bfe93bf64ff1b6ba3b2: Append to log took a long time: real 0.061s	user 0.001s	sys 0.000s
W20260709 13:09:18.101334 30275 log.cc:927] Time spent T 5ccb587267a8414180b1f5474e4e2728 P 4bc679ad21a64bfe93bf64ff1b6ba3b2: Append to log took a long time: real 0.132s	user 0.000s	sys 0.006s
W20260709 13:09:18.102880 29841 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.3:42765, user_credentials={real_user=slave}} blocked reactor thread for 63366.5us
W20260709 13:09:18.112031 30287 log.cc:927] Time spent T 40017481861c42efa46273995f000081 P 4bc679ad21a64bfe93bf64ff1b6ba3b2: Append to log took a long time: real 0.093s	user 0.002s	sys 0.000s
I20260709 13:09:18.119499 30299 tablet.cc:1724] T 40017481861c42efa46273995f000081 P 58a7cda73b3542718987bf815eed9b79: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 13:09:18.123862 29842 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.2:33075, user_credentials={real_user=slave}} blocked reactor thread for 75069.4us
I20260709 13:09:18.134076 30306 tablet.cc:1724] T d8a815244f7c485b980dfa0adb0fd2a9 P 58a7cda73b3542718987bf815eed9b79: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:09:18.139777 30300 tablet.cc:1724] T d90287f9e65f48c9b8ebdcaf7fe0dde2 P 37897779fb894afb8129dcf5d269bd54: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 13:09:18.205413 29841 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.3:42765, user_credentials={real_user=slave}} blocked reactor thread for 90402.5us
I20260709 13:09:18.217259 30312 tablet.cc:1724] T 5ccb587267a8414180b1f5474e4e2728 P 4bc679ad21a64bfe93bf64ff1b6ba3b2: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:09:18.207098 30310 tablet.cc:1724] T 2351aaf3431e4d18906f7f7fa8bb4f5c P 58a7cda73b3542718987bf815eed9b79: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:09:18.166805 30309 tablet.cc:1724] T 40017481861c42efa46273995f000081 P 37897779fb894afb8129dcf5d269bd54: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:09:18.218338 30316 tablet.cc:1724] T 797710d1534045c3a8597c9800a09ea6 P 58a7cda73b3542718987bf815eed9b79: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 13:09:18.242404 30292 log.cc:927] Time spent T ea945f01fa404ea29878b0cd26af4e1e P 37897779fb894afb8129dcf5d269bd54: Append to log took a long time: real 0.115s	user 0.001s	sys 0.000s
I20260709 13:09:18.223910 30317 tablet.cc:1724] T 2351aaf3431e4d18906f7f7fa8bb4f5c P 4bc679ad21a64bfe93bf64ff1b6ba3b2: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 13:09:18.219759 30305 log.cc:927] Time spent T 273ea248a58742f998fd8e9dc55097fc P 37897779fb894afb8129dcf5d269bd54: Append to log took a long time: real 0.056s	user 0.001s	sys 0.000s
I20260709 13:09:18.259714 30321 tablet.cc:1724] T 2351aaf3431e4d18906f7f7fa8bb4f5c P 37897779fb894afb8129dcf5d269bd54: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 13:09:18.292297 29979 tablet_mm_ops.cc:139] Rowset compaction is disabled (check --enable_rowset_compaction and disable_compaction in extra_config for tablet:2351aaf3431e4d18906f7f7fa8bb4f5c)
I20260709 13:09:18.218712 30319 tablet.cc:1724] T 5ccb587267a8414180b1f5474e4e2728 P 37897779fb894afb8129dcf5d269bd54: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:09:18.298225 29949 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2351aaf3431e4d18906f7f7fa8bb4f5c"
dest_uuid: "4bc679ad21a64bfe93bf64ff1b6ba3b2"
mode: GRACEFUL
new_leader_uuid: "37897779fb894afb8129dcf5d269bd54"
 from {username='slave'} at 127.0.0.1:34888
I20260709 13:09:18.299001 29949 raft_consensus.cc:606] T 2351aaf3431e4d18906f7f7fa8bb4f5c P 4bc679ad21a64bfe93bf64ff1b6ba3b2 [term 2 LEADER]: Received request to transfer leadership to TS 37897779fb894afb8129dcf5d269bd54
I20260709 13:09:18.257668 30320 tablet.cc:1724] T 797710d1534045c3a8597c9800a09ea6 P 4bc679ad21a64bfe93bf64ff1b6ba3b2: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 13:09:18.353188 29979 tablet_mm_ops.cc:304] Major delta compaction is disabled (check --enable_major_delta_compaction and disable_compaction in extra_config for tablet:2351aaf3431e4d18906f7f7fa8bb4f5c)
I20260709 13:09:18.347074 30323 tablet.cc:1724] T fa4b1db9a2d44d45bc9935975428592e P 4bc679ad21a64bfe93bf64ff1b6ba3b2: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 13:09:18.353973 30053 tablet_mm_ops.cc:220] Minor delta compaction is disabled (check --enable_minor_delta_compaction and disable_compaction in extra_config for tablet:2351aaf3431e4d18906f7f7fa8bb4f5c)
I20260709 13:09:18.358732 30310 tablet.cc:1724] T ea945f01fa404ea29878b0cd26af4e1e P 58a7cda73b3542718987bf815eed9b79: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:09:18.362800 30309 tablet.cc:1724] T d8a815244f7c485b980dfa0adb0fd2a9 P 37897779fb894afb8129dcf5d269bd54: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 13:09:18.305960 29916 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.3:42765, user_credentials={real_user=slave}} blocked reactor thread for 50059.2us
I20260709 13:09:18.370990 30310 tablet.cc:1724] T d90287f9e65f48c9b8ebdcaf7fe0dde2 P 58a7cda73b3542718987bf815eed9b79: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:09:18.287865 30306 tablet.cc:1724] T 5ccb587267a8414180b1f5474e4e2728 P 58a7cda73b3542718987bf815eed9b79: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 13:09:18.376734 29919 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.1:37953, user_credentials={real_user=slave}} blocked reactor thread for 108374us
W20260709 13:09:18.376734 29842 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.2:33075, user_credentials={real_user=slave}} blocked reactor thread for 70262us
W20260709 13:09:18.383260 29841 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.3:42765, user_credentials={real_user=slave}} blocked reactor thread for 57367us
I20260709 13:09:18.391902 30324 raft_consensus.cc:993] T 2351aaf3431e4d18906f7f7fa8bb4f5c P 4bc679ad21a64bfe93bf64ff1b6ba3b2: : Instructing follower 37897779fb894afb8129dcf5d269bd54 to start an election
I20260709 13:09:18.388505 30300 tablet.cc:1724] T fa4b1db9a2d44d45bc9935975428592e P 37897779fb894afb8129dcf5d269bd54: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:09:18.392510 30324 raft_consensus.cc:1081] T 2351aaf3431e4d18906f7f7fa8bb4f5c P 4bc679ad21a64bfe93bf64ff1b6ba3b2 [term 2 LEADER]: Signalling peer 37897779fb894afb8129dcf5d269bd54 to start an election
I20260709 13:09:18.382251 30317 tablet.cc:1724] T 273ea248a58742f998fd8e9dc55097fc P 4bc679ad21a64bfe93bf64ff1b6ba3b2: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:09:18.404485 30027 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "2351aaf3431e4d18906f7f7fa8bb4f5c"
dest_uuid: "37897779fb894afb8129dcf5d269bd54"
 from {username='slave'} at 127.0.0.1:58218
I20260709 13:09:18.405130 30027 raft_consensus.cc:493] T 2351aaf3431e4d18906f7f7fa8bb4f5c P 37897779fb894afb8129dcf5d269bd54 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:09:18.405529 30027 raft_consensus.cc:3060] T 2351aaf3431e4d18906f7f7fa8bb4f5c P 37897779fb894afb8129dcf5d269bd54 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:18.406018 30300 tablet.cc:1724] T ea945f01fa404ea29878b0cd26af4e1e P 37897779fb894afb8129dcf5d269bd54: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:09:18.413889 30310 tablet.cc:1724] T 273ea248a58742f998fd8e9dc55097fc P 58a7cda73b3542718987bf815eed9b79: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:09:18.418843 30299 tablet.cc:1724] T fa4b1db9a2d44d45bc9935975428592e P 58a7cda73b3542718987bf815eed9b79: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:09:18.424918 30300 tablet.cc:1724] T 797710d1534045c3a8597c9800a09ea6 P 37897779fb894afb8129dcf5d269bd54: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:09:18.432680 30309 tablet.cc:1724] T 273ea248a58742f998fd8e9dc55097fc P 37897779fb894afb8129dcf5d269bd54: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:09:18.432698 30027 raft_consensus.cc:515] T 2351aaf3431e4d18906f7f7fa8bb4f5c P 37897779fb894afb8129dcf5d269bd54 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "58a7cda73b3542718987bf815eed9b79" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 37953 } } peers { permanent_uuid: "4bc679ad21a64bfe93bf64ff1b6ba3b2" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 33075 } } peers { permanent_uuid: "37897779fb894afb8129dcf5d269bd54" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 42765 } }
I20260709 13:09:18.439061 29949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2351aaf3431e4d18906f7f7fa8bb4f5c" candidate_uuid: "37897779fb894afb8129dcf5d269bd54" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: true dest_uuid: "4bc679ad21a64bfe93bf64ff1b6ba3b2"
I20260709 13:09:18.439725 29949 raft_consensus.cc:3055] T 2351aaf3431e4d18906f7f7fa8bb4f5c P 4bc679ad21a64bfe93bf64ff1b6ba3b2 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:09:18.440043 29949 raft_consensus.cc:740] T 2351aaf3431e4d18906f7f7fa8bb4f5c P 4bc679ad21a64bfe93bf64ff1b6ba3b2 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 4bc679ad21a64bfe93bf64ff1b6ba3b2, State: Running, Role: LEADER
I20260709 13:09:18.440261 29874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2351aaf3431e4d18906f7f7fa8bb4f5c" candidate_uuid: "37897779fb894afb8129dcf5d269bd54" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: true dest_uuid: "58a7cda73b3542718987bf815eed9b79"
I20260709 13:09:18.440977 29874 raft_consensus.cc:3060] T 2351aaf3431e4d18906f7f7fa8bb4f5c P 58a7cda73b3542718987bf815eed9b79 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:18.440838 29949 consensus_queue.cc:260] T 2351aaf3431e4d18906f7f7fa8bb4f5c P 4bc679ad21a64bfe93bf64ff1b6ba3b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "58a7cda73b3542718987bf815eed9b79" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 37953 } } peers { permanent_uuid: "4bc679ad21a64bfe93bf64ff1b6ba3b2" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 33075 } } peers { permanent_uuid: "37897779fb894afb8129dcf5d269bd54" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 42765 } }
I20260709 13:09:18.441817 29949 raft_consensus.cc:3060] T 2351aaf3431e4d18906f7f7fa8bb4f5c P 4bc679ad21a64bfe93bf64ff1b6ba3b2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:18.446951 29949 raft_consensus.cc:2468] T 2351aaf3431e4d18906f7f7fa8bb4f5c P 4bc679ad21a64bfe93bf64ff1b6ba3b2 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 37897779fb894afb8129dcf5d269bd54 in term 3.
I20260709 13:09:18.448138 29991 leader_election.cc:304] T 2351aaf3431e4d18906f7f7fa8bb4f5c P 37897779fb894afb8129dcf5d269bd54 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 37897779fb894afb8129dcf5d269bd54, 4bc679ad21a64bfe93bf64ff1b6ba3b2; no voters: 
I20260709 13:09:18.448211 30312 tablet.cc:1724] T ea945f01fa404ea29878b0cd26af4e1e P 4bc679ad21a64bfe93bf64ff1b6ba3b2: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:09:18.449074 30027 leader_election.cc:290] T 2351aaf3431e4d18906f7f7fa8bb4f5c P 37897779fb894afb8129dcf5d269bd54 [CANDIDATE]: Term 3 election: Requested vote from peers 58a7cda73b3542718987bf815eed9b79 (127.17.223.1:37953), 4bc679ad21a64bfe93bf64ff1b6ba3b2 (127.17.223.2:33075)
I20260709 13:09:18.449213 30283 raft_consensus.cc:2804] T 2351aaf3431e4d18906f7f7fa8bb4f5c P 37897779fb894afb8129dcf5d269bd54 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:09:18.449783 30283 raft_consensus.cc:697] T 2351aaf3431e4d18906f7f7fa8bb4f5c P 37897779fb894afb8129dcf5d269bd54 [term 3 LEADER]: Becoming Leader. State: Replica: 37897779fb894afb8129dcf5d269bd54, State: Running, Role: LEADER
I20260709 13:09:18.450645 30283 consensus_queue.cc:237] T 2351aaf3431e4d18906f7f7fa8bb4f5c P 37897779fb894afb8129dcf5d269bd54 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "58a7cda73b3542718987bf815eed9b79" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 37953 } } peers { permanent_uuid: "4bc679ad21a64bfe93bf64ff1b6ba3b2" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 33075 } } peers { permanent_uuid: "37897779fb894afb8129dcf5d269bd54" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 42765 } }
I20260709 13:09:18.449793 29874 raft_consensus.cc:2468] T 2351aaf3431e4d18906f7f7fa8bb4f5c P 58a7cda73b3542718987bf815eed9b79 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 37897779fb894afb8129dcf5d269bd54 in term 3.
I20260709 13:09:18.466012 30320 tablet.cc:1724] T d90287f9e65f48c9b8ebdcaf7fe0dde2 P 4bc679ad21a64bfe93bf64ff1b6ba3b2: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:09:18.466926 29776 catalog_manager.cc:5697] T 2351aaf3431e4d18906f7f7fa8bb4f5c P 37897779fb894afb8129dcf5d269bd54 reported cstate change: term changed from 2 to 3, leader changed from 4bc679ad21a64bfe93bf64ff1b6ba3b2 (127.17.223.2) to 37897779fb894afb8129dcf5d269bd54 (127.17.223.3). New cstate: current_term: 3 leader_uuid: "37897779fb894afb8129dcf5d269bd54" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "58a7cda73b3542718987bf815eed9b79" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 37953 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4bc679ad21a64bfe93bf64ff1b6ba3b2" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 33075 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "37897779fb894afb8129dcf5d269bd54" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 42765 } health_report { overall_health: HEALTHY } } }
I20260709 13:09:18.468428 29875 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d8a815244f7c485b980dfa0adb0fd2a9"
dest_uuid: "58a7cda73b3542718987bf815eed9b79"
mode: GRACEFUL
new_leader_uuid: "37897779fb894afb8129dcf5d269bd54"
 from {username='slave'} at 127.0.0.1:56330
I20260709 13:09:18.469063 29875 raft_consensus.cc:606] T d8a815244f7c485b980dfa0adb0fd2a9 P 58a7cda73b3542718987bf815eed9b79 [term 2 LEADER]: Received request to transfer leadership to TS 37897779fb894afb8129dcf5d269bd54
I20260709 13:09:18.470937 18300 auto_leader_rebalancer.cc:452] table: soft_deleted_table, leader rebalance finish, leader transfer count: 2
I20260709 13:09:18.471575 18300 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:09:18.472117 30317 tablet.cc:1724] T 40017481861c42efa46273995f000081 P 4bc679ad21a64bfe93bf64ff1b6ba3b2: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:09:18.489567 30323 tablet.cc:1724] T d8a815244f7c485b980dfa0adb0fd2a9 P 4bc679ad21a64bfe93bf64ff1b6ba3b2: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:09:18.497244 29874 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8f557a35c94b4b2b917d69463fc69be9"
dest_uuid: "58a7cda73b3542718987bf815eed9b79"
mode: GRACEFUL
new_leader_uuid: "37897779fb894afb8129dcf5d269bd54"
 from {username='slave'} at 127.0.0.1:56330
I20260709 13:09:18.498050 29874 raft_consensus.cc:606] T 8f557a35c94b4b2b917d69463fc69be9 P 58a7cda73b3542718987bf815eed9b79 [term 2 LEADER]: Received request to transfer leadership to TS 37897779fb894afb8129dcf5d269bd54
I20260709 13:09:18.501830 29949 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "bb9da524d5b84f09b0c5853761aa5886"
dest_uuid: "4bc679ad21a64bfe93bf64ff1b6ba3b2"
mode: GRACEFUL
new_leader_uuid: "37897779fb894afb8129dcf5d269bd54"
 from {username='slave'} at 127.0.0.1:34888
I20260709 13:09:18.502444 29949 raft_consensus.cc:606] T bb9da524d5b84f09b0c5853761aa5886 P 4bc679ad21a64bfe93bf64ff1b6ba3b2 [term 2 LEADER]: Received request to transfer leadership to TS 37897779fb894afb8129dcf5d269bd54
I20260709 13:09:18.503690 18300 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 13:09:18.504231 18300 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:09:18.507654 29776 catalog_manager.cc:6242] T 00000000000000000000000000000000 P badd4c5e4acc4940a67cc8f85f2a187d: soft_deleted_table [id=11782eedd8bc47698011ca881498b05e] alter complete (version 1)
I20260709 13:09:18.622787 30325 raft_consensus.cc:993] T bb9da524d5b84f09b0c5853761aa5886 P 4bc679ad21a64bfe93bf64ff1b6ba3b2: : Instructing follower 37897779fb894afb8129dcf5d269bd54 to start an election
I20260709 13:09:18.623363 30326 raft_consensus.cc:1081] T bb9da524d5b84f09b0c5853761aa5886 P 4bc679ad21a64bfe93bf64ff1b6ba3b2 [term 2 LEADER]: Signalling peer 37897779fb894afb8129dcf5d269bd54 to start an election
I20260709 13:09:18.624779 30027 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "bb9da524d5b84f09b0c5853761aa5886"
dest_uuid: "37897779fb894afb8129dcf5d269bd54"
 from {username='slave'} at 127.0.0.1:58218
I20260709 13:09:18.625278 30027 raft_consensus.cc:493] T bb9da524d5b84f09b0c5853761aa5886 P 37897779fb894afb8129dcf5d269bd54 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:09:18.625660 30027 raft_consensus.cc:3060] T bb9da524d5b84f09b0c5853761aa5886 P 37897779fb894afb8129dcf5d269bd54 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:18.630663 30027 raft_consensus.cc:515] T bb9da524d5b84f09b0c5853761aa5886 P 37897779fb894afb8129dcf5d269bd54 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "58a7cda73b3542718987bf815eed9b79" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 37953 } } peers { permanent_uuid: "4bc679ad21a64bfe93bf64ff1b6ba3b2" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 33075 } } peers { permanent_uuid: "37897779fb894afb8129dcf5d269bd54" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 42765 } }
I20260709 13:09:18.632349 30027 leader_election.cc:290] T bb9da524d5b84f09b0c5853761aa5886 P 37897779fb894afb8129dcf5d269bd54 [CANDIDATE]: Term 3 election: Requested vote from peers 58a7cda73b3542718987bf815eed9b79 (127.17.223.1:37953), 4bc679ad21a64bfe93bf64ff1b6ba3b2 (127.17.223.2:33075)
I20260709 13:09:18.633080 29874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb9da524d5b84f09b0c5853761aa5886" candidate_uuid: "37897779fb894afb8129dcf5d269bd54" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "58a7cda73b3542718987bf815eed9b79"
I20260709 13:09:18.633369 29949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb9da524d5b84f09b0c5853761aa5886" candidate_uuid: "37897779fb894afb8129dcf5d269bd54" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "4bc679ad21a64bfe93bf64ff1b6ba3b2"
I20260709 13:09:18.633718 29874 raft_consensus.cc:3060] T bb9da524d5b84f09b0c5853761aa5886 P 58a7cda73b3542718987bf815eed9b79 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:18.633981 29949 raft_consensus.cc:3055] T bb9da524d5b84f09b0c5853761aa5886 P 4bc679ad21a64bfe93bf64ff1b6ba3b2 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:09:18.634315 29949 raft_consensus.cc:740] T bb9da524d5b84f09b0c5853761aa5886 P 4bc679ad21a64bfe93bf64ff1b6ba3b2 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 4bc679ad21a64bfe93bf64ff1b6ba3b2, State: Running, Role: LEADER
I20260709 13:09:18.635110 29949 consensus_queue.cc:260] T bb9da524d5b84f09b0c5853761aa5886 P 4bc679ad21a64bfe93bf64ff1b6ba3b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "58a7cda73b3542718987bf815eed9b79" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 37953 } } peers { permanent_uuid: "4bc679ad21a64bfe93bf64ff1b6ba3b2" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 33075 } } peers { permanent_uuid: "37897779fb894afb8129dcf5d269bd54" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 42765 } }
I20260709 13:09:18.636106 29949 raft_consensus.cc:3060] T bb9da524d5b84f09b0c5853761aa5886 P 4bc679ad21a64bfe93bf64ff1b6ba3b2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:18.639068 29874 raft_consensus.cc:2468] T bb9da524d5b84f09b0c5853761aa5886 P 58a7cda73b3542718987bf815eed9b79 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 37897779fb894afb8129dcf5d269bd54 in term 3.
I20260709 13:09:18.640630 29993 leader_election.cc:304] T bb9da524d5b84f09b0c5853761aa5886 P 37897779fb894afb8129dcf5d269bd54 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 37897779fb894afb8129dcf5d269bd54, 58a7cda73b3542718987bf815eed9b79; no voters: 
I20260709 13:09:18.641315 30283 raft_consensus.cc:2804] T bb9da524d5b84f09b0c5853761aa5886 P 37897779fb894afb8129dcf5d269bd54 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:09:18.641753 30283 raft_consensus.cc:697] T bb9da524d5b84f09b0c5853761aa5886 P 37897779fb894afb8129dcf5d269bd54 [term 3 LEADER]: Becoming Leader. State: Replica: 37897779fb894afb8129dcf5d269bd54, State: Running, Role: LEADER
I20260709 13:09:18.641902 29949 raft_consensus.cc:2468] T bb9da524d5b84f09b0c5853761aa5886 P 4bc679ad21a64bfe93bf64ff1b6ba3b2 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 37897779fb894afb8129dcf5d269bd54 in term 3.
I20260709 13:09:18.642617 30283 consensus_queue.cc:237] T bb9da524d5b84f09b0c5853761aa5886 P 37897779fb894afb8129dcf5d269bd54 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "58a7cda73b3542718987bf815eed9b79" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 37953 } } peers { permanent_uuid: "4bc679ad21a64bfe93bf64ff1b6ba3b2" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 33075 } } peers { permanent_uuid: "37897779fb894afb8129dcf5d269bd54" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 42765 } }
I20260709 13:09:18.649657 29773 catalog_manager.cc:5697] T bb9da524d5b84f09b0c5853761aa5886 P 37897779fb894afb8129dcf5d269bd54 reported cstate change: term changed from 2 to 3, leader changed from 4bc679ad21a64bfe93bf64ff1b6ba3b2 (127.17.223.2) to 37897779fb894afb8129dcf5d269bd54 (127.17.223.3). New cstate: current_term: 3 leader_uuid: "37897779fb894afb8129dcf5d269bd54" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "58a7cda73b3542718987bf815eed9b79" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 37953 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4bc679ad21a64bfe93bf64ff1b6ba3b2" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 33075 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "37897779fb894afb8129dcf5d269bd54" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 42765 } health_report { overall_health: HEALTHY } } }
I20260709 13:09:18.762112 30296 raft_consensus.cc:993] T d8a815244f7c485b980dfa0adb0fd2a9 P 58a7cda73b3542718987bf815eed9b79: : Instructing follower 37897779fb894afb8129dcf5d269bd54 to start an election
I20260709 13:09:18.762722 30322 raft_consensus.cc:1081] T d8a815244f7c485b980dfa0adb0fd2a9 P 58a7cda73b3542718987bf815eed9b79 [term 2 LEADER]: Signalling peer 37897779fb894afb8129dcf5d269bd54 to start an election
I20260709 13:09:18.764364 30023 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d8a815244f7c485b980dfa0adb0fd2a9"
dest_uuid: "37897779fb894afb8129dcf5d269bd54"
 from {username='slave'} at 127.0.0.1:58216
I20260709 13:09:18.765008 30023 raft_consensus.cc:493] T d8a815244f7c485b980dfa0adb0fd2a9 P 37897779fb894afb8129dcf5d269bd54 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:09:18.765362 30023 raft_consensus.cc:3060] T d8a815244f7c485b980dfa0adb0fd2a9 P 37897779fb894afb8129dcf5d269bd54 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:18.771987 30023 raft_consensus.cc:515] T d8a815244f7c485b980dfa0adb0fd2a9 P 37897779fb894afb8129dcf5d269bd54 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "58a7cda73b3542718987bf815eed9b79" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 37953 } } peers { permanent_uuid: "4bc679ad21a64bfe93bf64ff1b6ba3b2" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 33075 } } peers { permanent_uuid: "37897779fb894afb8129dcf5d269bd54" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 42765 } }
I20260709 13:09:18.773959 30023 leader_election.cc:290] T d8a815244f7c485b980dfa0adb0fd2a9 P 37897779fb894afb8129dcf5d269bd54 [CANDIDATE]: Term 3 election: Requested vote from peers 58a7cda73b3542718987bf815eed9b79 (127.17.223.1:37953), 4bc679ad21a64bfe93bf64ff1b6ba3b2 (127.17.223.2:33075)
I20260709 13:09:18.774574 29874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8a815244f7c485b980dfa0adb0fd2a9" candidate_uuid: "37897779fb894afb8129dcf5d269bd54" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: true dest_uuid: "58a7cda73b3542718987bf815eed9b79"
I20260709 13:09:18.775223 29874 raft_consensus.cc:3055] T d8a815244f7c485b980dfa0adb0fd2a9 P 58a7cda73b3542718987bf815eed9b79 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:09:18.775108 29949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8a815244f7c485b980dfa0adb0fd2a9" candidate_uuid: "37897779fb894afb8129dcf5d269bd54" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: true dest_uuid: "4bc679ad21a64bfe93bf64ff1b6ba3b2"
I20260709 13:09:18.775713 29874 raft_consensus.cc:740] T d8a815244f7c485b980dfa0adb0fd2a9 P 58a7cda73b3542718987bf815eed9b79 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 58a7cda73b3542718987bf815eed9b79, State: Running, Role: LEADER
I20260709 13:09:18.775923 29949 raft_consensus.cc:3060] T d8a815244f7c485b980dfa0adb0fd2a9 P 4bc679ad21a64bfe93bf64ff1b6ba3b2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:18.776589 29874 consensus_queue.cc:260] T d8a815244f7c485b980dfa0adb0fd2a9 P 58a7cda73b3542718987bf815eed9b79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "58a7cda73b3542718987bf815eed9b79" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 37953 } } peers { permanent_uuid: "4bc679ad21a64bfe93bf64ff1b6ba3b2" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 33075 } } peers { permanent_uuid: "37897779fb894afb8129dcf5d269bd54" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 42765 } }
I20260709 13:09:18.777853 29874 raft_consensus.cc:3060] T d8a815244f7c485b980dfa0adb0fd2a9 P 58a7cda73b3542718987bf815eed9b79 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:18.782980 29949 raft_consensus.cc:2468] T d8a815244f7c485b980dfa0adb0fd2a9 P 4bc679ad21a64bfe93bf64ff1b6ba3b2 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 37897779fb894afb8129dcf5d269bd54 in term 3.
I20260709 13:09:18.784134 29991 leader_election.cc:304] T d8a815244f7c485b980dfa0adb0fd2a9 P 37897779fb894afb8129dcf5d269bd54 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 37897779fb894afb8129dcf5d269bd54, 4bc679ad21a64bfe93bf64ff1b6ba3b2; no voters: 
I20260709 13:09:18.784646 29874 raft_consensus.cc:2468] T d8a815244f7c485b980dfa0adb0fd2a9 P 58a7cda73b3542718987bf815eed9b79 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 37897779fb894afb8129dcf5d269bd54 in term 3.
I20260709 13:09:18.784837 30283 raft_consensus.cc:2804] T d8a815244f7c485b980dfa0adb0fd2a9 P 37897779fb894afb8129dcf5d269bd54 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:09:18.785493 30283 raft_consensus.cc:697] T d8a815244f7c485b980dfa0adb0fd2a9 P 37897779fb894afb8129dcf5d269bd54 [term 3 LEADER]: Becoming Leader. State: Replica: 37897779fb894afb8129dcf5d269bd54, State: Running, Role: LEADER
I20260709 13:09:18.786244 30283 consensus_queue.cc:237] T d8a815244f7c485b980dfa0adb0fd2a9 P 37897779fb894afb8129dcf5d269bd54 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "58a7cda73b3542718987bf815eed9b79" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 37953 } } peers { permanent_uuid: "4bc679ad21a64bfe93bf64ff1b6ba3b2" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 33075 } } peers { permanent_uuid: "37897779fb894afb8129dcf5d269bd54" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 42765 } }
I20260709 13:09:18.792670 29773 catalog_manager.cc:5697] T d8a815244f7c485b980dfa0adb0fd2a9 P 37897779fb894afb8129dcf5d269bd54 reported cstate change: term changed from 2 to 3, leader changed from 58a7cda73b3542718987bf815eed9b79 (127.17.223.1) to 37897779fb894afb8129dcf5d269bd54 (127.17.223.3). New cstate: current_term: 3 leader_uuid: "37897779fb894afb8129dcf5d269bd54" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "58a7cda73b3542718987bf815eed9b79" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 37953 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4bc679ad21a64bfe93bf64ff1b6ba3b2" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 33075 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "37897779fb894afb8129dcf5d269bd54" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 42765 } health_report { overall_health: HEALTHY } } }
I20260709 13:09:18.833796 29874 raft_consensus.cc:1275] T 2351aaf3431e4d18906f7f7fa8bb4f5c P 58a7cda73b3542718987bf815eed9b79 [term 3 FOLLOWER]: Refusing update from remote peer 37897779fb894afb8129dcf5d269bd54: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 13:09:18.834949 30283 consensus_queue.cc:1048] T 2351aaf3431e4d18906f7f7fa8bb4f5c P 37897779fb894afb8129dcf5d269bd54 [LEADER]: Connected to new peer: Peer: permanent_uuid: "58a7cda73b3542718987bf815eed9b79" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 37953 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:09:18.843461 29949 raft_consensus.cc:1275] T 2351aaf3431e4d18906f7f7fa8bb4f5c P 4bc679ad21a64bfe93bf64ff1b6ba3b2 [term 3 FOLLOWER]: Refusing update from remote peer 37897779fb894afb8129dcf5d269bd54: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 13:09:18.844988 30248 consensus_queue.cc:1048] T 2351aaf3431e4d18906f7f7fa8bb4f5c P 37897779fb894afb8129dcf5d269bd54 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4bc679ad21a64bfe93bf64ff1b6ba3b2" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 33075 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:09:18.872452 30296 raft_consensus.cc:993] T 8f557a35c94b4b2b917d69463fc69be9 P 58a7cda73b3542718987bf815eed9b79: : Instructing follower 37897779fb894afb8129dcf5d269bd54 to start an election
I20260709 13:09:18.872887 30322 raft_consensus.cc:1081] T 8f557a35c94b4b2b917d69463fc69be9 P 58a7cda73b3542718987bf815eed9b79 [term 2 LEADER]: Signalling peer 37897779fb894afb8129dcf5d269bd54 to start an election
I20260709 13:09:18.874156 30023 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "8f557a35c94b4b2b917d69463fc69be9"
dest_uuid: "37897779fb894afb8129dcf5d269bd54"
 from {username='slave'} at 127.0.0.1:58216
I20260709 13:09:18.874635 30023 raft_consensus.cc:493] T 8f557a35c94b4b2b917d69463fc69be9 P 37897779fb894afb8129dcf5d269bd54 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:09:18.874969 30023 raft_consensus.cc:3060] T 8f557a35c94b4b2b917d69463fc69be9 P 37897779fb894afb8129dcf5d269bd54 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:18.879623 30023 raft_consensus.cc:515] T 8f557a35c94b4b2b917d69463fc69be9 P 37897779fb894afb8129dcf5d269bd54 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "58a7cda73b3542718987bf815eed9b79" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 37953 } } peers { permanent_uuid: "4bc679ad21a64bfe93bf64ff1b6ba3b2" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 33075 } } peers { permanent_uuid: "37897779fb894afb8129dcf5d269bd54" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 42765 } }
I20260709 13:09:18.881292 30023 leader_election.cc:290] T 8f557a35c94b4b2b917d69463fc69be9 P 37897779fb894afb8129dcf5d269bd54 [CANDIDATE]: Term 3 election: Requested vote from peers 58a7cda73b3542718987bf815eed9b79 (127.17.223.1:37953), 4bc679ad21a64bfe93bf64ff1b6ba3b2 (127.17.223.2:33075)
I20260709 13:09:18.882113 29874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f557a35c94b4b2b917d69463fc69be9" candidate_uuid: "37897779fb894afb8129dcf5d269bd54" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "58a7cda73b3542718987bf815eed9b79"
I20260709 13:09:18.882323 29949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f557a35c94b4b2b917d69463fc69be9" candidate_uuid: "37897779fb894afb8129dcf5d269bd54" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "4bc679ad21a64bfe93bf64ff1b6ba3b2"
I20260709 13:09:18.882754 29874 raft_consensus.cc:3055] T 8f557a35c94b4b2b917d69463fc69be9 P 58a7cda73b3542718987bf815eed9b79 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:09:18.883002 29949 raft_consensus.cc:3060] T 8f557a35c94b4b2b917d69463fc69be9 P 4bc679ad21a64bfe93bf64ff1b6ba3b2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:18.883183 29874 raft_consensus.cc:740] T 8f557a35c94b4b2b917d69463fc69be9 P 58a7cda73b3542718987bf815eed9b79 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 58a7cda73b3542718987bf815eed9b79, State: Running, Role: LEADER
I20260709 13:09:18.884019 29874 consensus_queue.cc:260] T 8f557a35c94b4b2b917d69463fc69be9 P 58a7cda73b3542718987bf815eed9b79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "58a7cda73b3542718987bf815eed9b79" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 37953 } } peers { permanent_uuid: "4bc679ad21a64bfe93bf64ff1b6ba3b2" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 33075 } } peers { permanent_uuid: "37897779fb894afb8129dcf5d269bd54" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 42765 } }
I20260709 13:09:18.884963 29874 raft_consensus.cc:3060] T 8f557a35c94b4b2b917d69463fc69be9 P 58a7cda73b3542718987bf815eed9b79 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:18.889535 29949 raft_consensus.cc:2468] T 8f557a35c94b4b2b917d69463fc69be9 P 4bc679ad21a64bfe93bf64ff1b6ba3b2 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 37897779fb894afb8129dcf5d269bd54 in term 3.
I20260709 13:09:18.891054 29991 leader_election.cc:304] T 8f557a35c94b4b2b917d69463fc69be9 P 37897779fb894afb8129dcf5d269bd54 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 37897779fb894afb8129dcf5d269bd54, 4bc679ad21a64bfe93bf64ff1b6ba3b2; no voters: 
I20260709 13:09:18.891736 30248 raft_consensus.cc:2804] T 8f557a35c94b4b2b917d69463fc69be9 P 37897779fb894afb8129dcf5d269bd54 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:09:18.892233 30248 raft_consensus.cc:697] T 8f557a35c94b4b2b917d69463fc69be9 P 37897779fb894afb8129dcf5d269bd54 [term 3 LEADER]: Becoming Leader. State: Replica: 37897779fb894afb8129dcf5d269bd54, State: Running, Role: LEADER
I20260709 13:09:18.892410 29874 raft_consensus.cc:2468] T 8f557a35c94b4b2b917d69463fc69be9 P 58a7cda73b3542718987bf815eed9b79 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 37897779fb894afb8129dcf5d269bd54 in term 3.
I20260709 13:09:18.893401 30248 consensus_queue.cc:237] T 8f557a35c94b4b2b917d69463fc69be9 P 37897779fb894afb8129dcf5d269bd54 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "58a7cda73b3542718987bf815eed9b79" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 37953 } } peers { permanent_uuid: "4bc679ad21a64bfe93bf64ff1b6ba3b2" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 33075 } } peers { permanent_uuid: "37897779fb894afb8129dcf5d269bd54" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 42765 } }
I20260709 13:09:18.901053 29773 catalog_manager.cc:5697] T 8f557a35c94b4b2b917d69463fc69be9 P 37897779fb894afb8129dcf5d269bd54 reported cstate change: term changed from 2 to 3, leader changed from 58a7cda73b3542718987bf815eed9b79 (127.17.223.1) to 37897779fb894afb8129dcf5d269bd54 (127.17.223.3). New cstate: current_term: 3 leader_uuid: "37897779fb894afb8129dcf5d269bd54" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "58a7cda73b3542718987bf815eed9b79" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 37953 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4bc679ad21a64bfe93bf64ff1b6ba3b2" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 33075 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "37897779fb894afb8129dcf5d269bd54" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 42765 } health_report { overall_health: HEALTHY } } }
I20260709 13:09:19.047509 29949 raft_consensus.cc:1275] T bb9da524d5b84f09b0c5853761aa5886 P 4bc679ad21a64bfe93bf64ff1b6ba3b2 [term 3 FOLLOWER]: Refusing update from remote peer 37897779fb894afb8129dcf5d269bd54: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:09:19.048739 30248 consensus_queue.cc:1048] T bb9da524d5b84f09b0c5853761aa5886 P 37897779fb894afb8129dcf5d269bd54 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4bc679ad21a64bfe93bf64ff1b6ba3b2" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 33075 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:09:19.056828 29874 raft_consensus.cc:1275] T bb9da524d5b84f09b0c5853761aa5886 P 58a7cda73b3542718987bf815eed9b79 [term 3 FOLLOWER]: Refusing update from remote peer 37897779fb894afb8129dcf5d269bd54: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:09:19.058609 30338 consensus_queue.cc:1048] T bb9da524d5b84f09b0c5853761aa5886 P 37897779fb894afb8129dcf5d269bd54 [LEADER]: Connected to new peer: Peer: permanent_uuid: "58a7cda73b3542718987bf815eed9b79" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 37953 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:09:19.231658 29949 raft_consensus.cc:1275] T d8a815244f7c485b980dfa0adb0fd2a9 P 4bc679ad21a64bfe93bf64ff1b6ba3b2 [term 3 FOLLOWER]: Refusing update from remote peer 37897779fb894afb8129dcf5d269bd54: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 13:09:19.232941 30283 consensus_queue.cc:1048] T d8a815244f7c485b980dfa0adb0fd2a9 P 37897779fb894afb8129dcf5d269bd54 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4bc679ad21a64bfe93bf64ff1b6ba3b2" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 33075 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:09:19.241663 29874 raft_consensus.cc:1275] T d8a815244f7c485b980dfa0adb0fd2a9 P 58a7cda73b3542718987bf815eed9b79 [term 3 FOLLOWER]: Refusing update from remote peer 37897779fb894afb8129dcf5d269bd54: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 13:09:19.243052 30283 consensus_queue.cc:1048] T d8a815244f7c485b980dfa0adb0fd2a9 P 37897779fb894afb8129dcf5d269bd54 [LEADER]: Connected to new peer: Peer: permanent_uuid: "58a7cda73b3542718987bf815eed9b79" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 37953 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:09:19.395982 29951 raft_consensus.cc:1275] T 8f557a35c94b4b2b917d69463fc69be9 P 4bc679ad21a64bfe93bf64ff1b6ba3b2 [term 3 FOLLOWER]: Refusing update from remote peer 37897779fb894afb8129dcf5d269bd54: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:09:19.397135 30248 consensus_queue.cc:1048] T 8f557a35c94b4b2b917d69463fc69be9 P 37897779fb894afb8129dcf5d269bd54 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4bc679ad21a64bfe93bf64ff1b6ba3b2" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 33075 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:09:19.405771 29874 raft_consensus.cc:1275] T 8f557a35c94b4b2b917d69463fc69be9 P 58a7cda73b3542718987bf815eed9b79 [term 3 FOLLOWER]: Refusing update from remote peer 37897779fb894afb8129dcf5d269bd54: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:09:19.408263 30248 consensus_queue.cc:1048] T 8f557a35c94b4b2b917d69463fc69be9 P 37897779fb894afb8129dcf5d269bd54 [LEADER]: Connected to new peer: Peer: permanent_uuid: "58a7cda73b3542718987bf815eed9b79" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 37953 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.003s
I20260709 13:09:19.560936 18300 auto_leader_rebalancer.cc:141] leader rebalance for table soft_deleted_table
I20260709 13:09:19.565591 18300 auto_leader_rebalancer.cc:452] table: soft_deleted_table, leader rebalance finish, leader transfer count: 0
I20260709 13:09:19.565935 18300 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:09:19.570746 18300 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 13:09:19.571226 18300 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:09:20.598124 18300 tablet_server.cc:179] TabletServer@127.17.223.1:0 shutting down...
W20260709 13:09:20.620090 29919 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 3 similar messages]
I20260709 13:09:20.626319 18300 ts_tablet_manager.cc:1507] Shutting down tablet manager...
W20260709 13:09:20.626231 29919 consensus_peers.cc:597] T 5ccb587267a8414180b1f5474e4e2728 P 4bc679ad21a64bfe93bf64ff1b6ba3b2 -> Peer 58a7cda73b3542718987bf815eed9b79 (127.17.223.1:37953): Couldn't send request to peer 58a7cda73b3542718987bf815eed9b79. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:20.627369 18300 tablet_replica.cc:333] T fa4b1db9a2d44d45bc9935975428592e P 58a7cda73b3542718987bf815eed9b79: stopping tablet replica
I20260709 13:09:20.628379 18300 raft_consensus.cc:2243] T fa4b1db9a2d44d45bc9935975428592e P 58a7cda73b3542718987bf815eed9b79 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:20.628983 18300 raft_consensus.cc:2272] T fa4b1db9a2d44d45bc9935975428592e P 58a7cda73b3542718987bf815eed9b79 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:20.631006 18300 tablet_replica.cc:333] T 273ea248a58742f998fd8e9dc55097fc P 58a7cda73b3542718987bf815eed9b79: stopping tablet replica
I20260709 13:09:20.631588 18300 raft_consensus.cc:2243] T 273ea248a58742f998fd8e9dc55097fc P 58a7cda73b3542718987bf815eed9b79 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:20.632019 18300 raft_consensus.cc:2272] T 273ea248a58742f998fd8e9dc55097fc P 58a7cda73b3542718987bf815eed9b79 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:20.633827 18300 tablet_replica.cc:333] T 5ccb587267a8414180b1f5474e4e2728 P 58a7cda73b3542718987bf815eed9b79: stopping tablet replica
I20260709 13:09:20.634361 18300 raft_consensus.cc:2243] T 5ccb587267a8414180b1f5474e4e2728 P 58a7cda73b3542718987bf815eed9b79 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:20.665788 18300 raft_consensus.cc:2272] T 5ccb587267a8414180b1f5474e4e2728 P 58a7cda73b3542718987bf815eed9b79 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:20.672163 18300 tablet_replica.cc:333] T f814d836f0bd46a4aa7d660d8ff4b2d5 P 58a7cda73b3542718987bf815eed9b79: stopping tablet replica
I20260709 13:09:20.676553 18300 raft_consensus.cc:2243] T f814d836f0bd46a4aa7d660d8ff4b2d5 P 58a7cda73b3542718987bf815eed9b79 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:20.678128 18300 raft_consensus.cc:2272] T f814d836f0bd46a4aa7d660d8ff4b2d5 P 58a7cda73b3542718987bf815eed9b79 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:20.685950 18300 tablet_replica.cc:333] T 968909b990764b0c8c388a63060c8130 P 58a7cda73b3542718987bf815eed9b79: stopping tablet replica
I20260709 13:09:20.687950 18300 raft_consensus.cc:2243] T 968909b990764b0c8c388a63060c8130 P 58a7cda73b3542718987bf815eed9b79 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:20.688817 18300 raft_consensus.cc:2272] T 968909b990764b0c8c388a63060c8130 P 58a7cda73b3542718987bf815eed9b79 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:20.692731 18300 tablet_replica.cc:333] T 2351aaf3431e4d18906f7f7fa8bb4f5c P 58a7cda73b3542718987bf815eed9b79: stopping tablet replica
I20260709 13:09:20.693710 18300 raft_consensus.cc:2243] T 2351aaf3431e4d18906f7f7fa8bb4f5c P 58a7cda73b3542718987bf815eed9b79 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:20.694774 18300 raft_consensus.cc:2272] T 2351aaf3431e4d18906f7f7fa8bb4f5c P 58a7cda73b3542718987bf815eed9b79 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:20.699918 18300 tablet_replica.cc:333] T 6d4b64688b8949c89f8f7b7aa871efed P 58a7cda73b3542718987bf815eed9b79: stopping tablet replica
I20260709 13:09:20.701745 18300 raft_consensus.cc:2243] T 6d4b64688b8949c89f8f7b7aa871efed P 58a7cda73b3542718987bf815eed9b79 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:09:20.704329 18300 raft_consensus.cc:2272] T 6d4b64688b8949c89f8f7b7aa871efed P 58a7cda73b3542718987bf815eed9b79 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:09:20.705515 29993 consensus_peers.cc:597] T bb9da524d5b84f09b0c5853761aa5886 P 37897779fb894afb8129dcf5d269bd54 -> Peer 58a7cda73b3542718987bf815eed9b79 (127.17.223.1:37953): Couldn't send request to peer 58a7cda73b3542718987bf815eed9b79. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:20.708624 18300 tablet_replica.cc:333] T d90287f9e65f48c9b8ebdcaf7fe0dde2 P 58a7cda73b3542718987bf815eed9b79: stopping tablet replica
I20260709 13:09:20.709759 18300 raft_consensus.cc:2243] T d90287f9e65f48c9b8ebdcaf7fe0dde2 P 58a7cda73b3542718987bf815eed9b79 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:20.710758 18300 raft_consensus.cc:2272] T d90287f9e65f48c9b8ebdcaf7fe0dde2 P 58a7cda73b3542718987bf815eed9b79 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:20.715632 18300 tablet_replica.cc:333] T d8a815244f7c485b980dfa0adb0fd2a9 P 58a7cda73b3542718987bf815eed9b79: stopping tablet replica
I20260709 13:09:20.716405 18300 raft_consensus.cc:2243] T d8a815244f7c485b980dfa0adb0fd2a9 P 58a7cda73b3542718987bf815eed9b79 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:20.717542 18300 raft_consensus.cc:2272] T d8a815244f7c485b980dfa0adb0fd2a9 P 58a7cda73b3542718987bf815eed9b79 [term 3 FOLLOWER]: Raft consensus is shut down!
W20260709 13:09:20.719493 29919 consensus_peers.cc:597] T 273ea248a58742f998fd8e9dc55097fc P 4bc679ad21a64bfe93bf64ff1b6ba3b2 -> Peer 58a7cda73b3542718987bf815eed9b79 (127.17.223.1:37953): Couldn't send request to peer 58a7cda73b3542718987bf815eed9b79. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:20.721616 18300 tablet_replica.cc:333] T 6450825bf8ba4ebaa0e631b1dea6538e P 58a7cda73b3542718987bf815eed9b79: stopping tablet replica
I20260709 13:09:20.722906 18300 raft_consensus.cc:2243] T 6450825bf8ba4ebaa0e631b1dea6538e P 58a7cda73b3542718987bf815eed9b79 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:20.723871 18300 raft_consensus.cc:2272] T 6450825bf8ba4ebaa0e631b1dea6538e P 58a7cda73b3542718987bf815eed9b79 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:20.728159 18300 tablet_replica.cc:333] T 59abb803b8ce4d28967bf12c46d66c0d P 58a7cda73b3542718987bf815eed9b79: stopping tablet replica
I20260709 13:09:20.729285 18300 raft_consensus.cc:2243] T 59abb803b8ce4d28967bf12c46d66c0d P 58a7cda73b3542718987bf815eed9b79 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:20.730026 18300 raft_consensus.cc:2272] T 59abb803b8ce4d28967bf12c46d66c0d P 58a7cda73b3542718987bf815eed9b79 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:20.732734 18300 tablet_replica.cc:333] T e347ac4792b04c198fb6829a4a87078b P 58a7cda73b3542718987bf815eed9b79: stopping tablet replica
I20260709 13:09:20.733300 18300 raft_consensus.cc:2243] T e347ac4792b04c198fb6829a4a87078b P 58a7cda73b3542718987bf815eed9b79 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:09:20.734454 18300 raft_consensus.cc:2272] T e347ac4792b04c198fb6829a4a87078b P 58a7cda73b3542718987bf815eed9b79 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:20.737124 18300 tablet_replica.cc:333] T 797710d1534045c3a8597c9800a09ea6 P 58a7cda73b3542718987bf815eed9b79: stopping tablet replica
I20260709 13:09:20.737773 18300 raft_consensus.cc:2243] T 797710d1534045c3a8597c9800a09ea6 P 58a7cda73b3542718987bf815eed9b79 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:09:20.739151 18300 raft_consensus.cc:2272] T 797710d1534045c3a8597c9800a09ea6 P 58a7cda73b3542718987bf815eed9b79 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:20.741734 18300 tablet_replica.cc:333] T ea945f01fa404ea29878b0cd26af4e1e P 58a7cda73b3542718987bf815eed9b79: stopping tablet replica
I20260709 13:09:20.742324 18300 raft_consensus.cc:2243] T ea945f01fa404ea29878b0cd26af4e1e P 58a7cda73b3542718987bf815eed9b79 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:09:20.743608 18300 raft_consensus.cc:2272] T ea945f01fa404ea29878b0cd26af4e1e P 58a7cda73b3542718987bf815eed9b79 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:20.746116 18300 tablet_replica.cc:333] T bb9da524d5b84f09b0c5853761aa5886 P 58a7cda73b3542718987bf815eed9b79: stopping tablet replica
I20260709 13:09:20.746876 18300 raft_consensus.cc:2243] T bb9da524d5b84f09b0c5853761aa5886 P 58a7cda73b3542718987bf815eed9b79 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:20.747557 18300 raft_consensus.cc:2272] T bb9da524d5b84f09b0c5853761aa5886 P 58a7cda73b3542718987bf815eed9b79 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:20.750195 18300 tablet_replica.cc:333] T 5ab64e7b83584196b9e6c6d1bc634351 P 58a7cda73b3542718987bf815eed9b79: stopping tablet replica
I20260709 13:09:20.750834 18300 raft_consensus.cc:2243] T 5ab64e7b83584196b9e6c6d1bc634351 P 58a7cda73b3542718987bf815eed9b79 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:09:20.752239 18300 raft_consensus.cc:2272] T 5ab64e7b83584196b9e6c6d1bc634351 P 58a7cda73b3542718987bf815eed9b79 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:20.754984 18300 tablet_replica.cc:333] T 40017481861c42efa46273995f000081 P 58a7cda73b3542718987bf815eed9b79: stopping tablet replica
I20260709 13:09:20.755568 18300 raft_consensus.cc:2243] T 40017481861c42efa46273995f000081 P 58a7cda73b3542718987bf815eed9b79 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:09:20.756867 18300 raft_consensus.cc:2272] T 40017481861c42efa46273995f000081 P 58a7cda73b3542718987bf815eed9b79 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:20.759371 18300 tablet_replica.cc:333] T 8f557a35c94b4b2b917d69463fc69be9 P 58a7cda73b3542718987bf815eed9b79: stopping tablet replica
I20260709 13:09:20.759918 18300 raft_consensus.cc:2243] T 8f557a35c94b4b2b917d69463fc69be9 P 58a7cda73b3542718987bf815eed9b79 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:20.760502 18300 raft_consensus.cc:2272] T 8f557a35c94b4b2b917d69463fc69be9 P 58a7cda73b3542718987bf815eed9b79 [term 3 FOLLOWER]: Raft consensus is shut down!
W20260709 13:09:20.790424 29993 consensus_peers.cc:597] T 8f557a35c94b4b2b917d69463fc69be9 P 37897779fb894afb8129dcf5d269bd54 -> Peer 58a7cda73b3542718987bf815eed9b79 (127.17.223.1:37953): Couldn't send request to peer 58a7cda73b3542718987bf815eed9b79. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:20.807416 18300 tablet_server.cc:196] TabletServer@127.17.223.1:0 shutdown complete.
W20260709 13:09:20.832708 29993 consensus_peers.cc:597] T 2351aaf3431e4d18906f7f7fa8bb4f5c P 37897779fb894afb8129dcf5d269bd54 -> Peer 58a7cda73b3542718987bf815eed9b79 (127.17.223.1:37953): Couldn't send request to peer 58a7cda73b3542718987bf815eed9b79. Status: Network error: Client connection negotiation failed: client connection to 127.17.223.1:37953: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:20.860018 18300 tablet_server.cc:179] TabletServer@127.17.223.2:0 shutting down...
W20260709 13:09:20.868532 29993 consensus_peers.cc:597] T 59abb803b8ce4d28967bf12c46d66c0d P 37897779fb894afb8129dcf5d269bd54 -> Peer 58a7cda73b3542718987bf815eed9b79 (127.17.223.1:37953): Couldn't send request to peer 58a7cda73b3542718987bf815eed9b79. Status: Network error: Client connection negotiation failed: client connection to 127.17.223.1:37953: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:09:20.887212 29919 consensus_peers.cc:597] T 6450825bf8ba4ebaa0e631b1dea6538e P 4bc679ad21a64bfe93bf64ff1b6ba3b2 -> Peer 58a7cda73b3542718987bf815eed9b79 (127.17.223.1:37953): Couldn't send request to peer 58a7cda73b3542718987bf815eed9b79. Status: Network error: Client connection negotiation failed: client connection to 127.17.223.1:37953: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:09:20.888020 29993 consensus_peers.cc:597] T d8a815244f7c485b980dfa0adb0fd2a9 P 37897779fb894afb8129dcf5d269bd54 -> Peer 58a7cda73b3542718987bf815eed9b79 (127.17.223.1:37953): Couldn't send request to peer 58a7cda73b3542718987bf815eed9b79. Status: Network error: Client connection negotiation failed: client connection to 127.17.223.1:37953: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:20.897516 18300 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:09:20.898365 18300 tablet_replica.cc:333] T fa4b1db9a2d44d45bc9935975428592e P 4bc679ad21a64bfe93bf64ff1b6ba3b2: stopping tablet replica
I20260709 13:09:20.899449 18300 raft_consensus.cc:2243] T fa4b1db9a2d44d45bc9935975428592e P 4bc679ad21a64bfe93bf64ff1b6ba3b2 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:09:20.900696 18300 raft_consensus.cc:2272] T fa4b1db9a2d44d45bc9935975428592e P 4bc679ad21a64bfe93bf64ff1b6ba3b2 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:20.903453 18300 tablet_replica.cc:333] T 5ccb587267a8414180b1f5474e4e2728 P 4bc679ad21a64bfe93bf64ff1b6ba3b2: stopping tablet replica
I20260709 13:09:20.904058 18300 raft_consensus.cc:2243] T 5ccb587267a8414180b1f5474e4e2728 P 4bc679ad21a64bfe93bf64ff1b6ba3b2 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:09:20.905246 18300 raft_consensus.cc:2272] T 5ccb587267a8414180b1f5474e4e2728 P 4bc679ad21a64bfe93bf64ff1b6ba3b2 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:20.907843 18300 tablet_replica.cc:333] T 273ea248a58742f998fd8e9dc55097fc P 4bc679ad21a64bfe93bf64ff1b6ba3b2: stopping tablet replica
I20260709 13:09:20.908491 18300 raft_consensus.cc:2243] T 273ea248a58742f998fd8e9dc55097fc P 4bc679ad21a64bfe93bf64ff1b6ba3b2 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:09:20.909629 18300 raft_consensus.cc:2272] T 273ea248a58742f998fd8e9dc55097fc P 4bc679ad21a64bfe93bf64ff1b6ba3b2 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:20.912917 18300 tablet_replica.cc:333] T 59abb803b8ce4d28967bf12c46d66c0d P 4bc679ad21a64bfe93bf64ff1b6ba3b2: stopping tablet replica
I20260709 13:09:20.913673 18300 raft_consensus.cc:2243] T 59abb803b8ce4d28967bf12c46d66c0d P 4bc679ad21a64bfe93bf64ff1b6ba3b2 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:20.914384 18300 raft_consensus.cc:2272] T 59abb803b8ce4d28967bf12c46d66c0d P 4bc679ad21a64bfe93bf64ff1b6ba3b2 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:09:20.914280 29919 consensus_peers.cc:597] T f814d836f0bd46a4aa7d660d8ff4b2d5 P 4bc679ad21a64bfe93bf64ff1b6ba3b2 -> Peer 58a7cda73b3542718987bf815eed9b79 (127.17.223.1:37953): Couldn't send request to peer 58a7cda73b3542718987bf815eed9b79. Status: Network error: Client connection negotiation failed: client connection to 127.17.223.1:37953: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:20.917016 18300 tablet_replica.cc:333] T e347ac4792b04c198fb6829a4a87078b P 4bc679ad21a64bfe93bf64ff1b6ba3b2: stopping tablet replica
I20260709 13:09:20.917717 18300 raft_consensus.cc:2243] T e347ac4792b04c198fb6829a4a87078b P 4bc679ad21a64bfe93bf64ff1b6ba3b2 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:20.918298 18300 raft_consensus.cc:2272] T e347ac4792b04c198fb6829a4a87078b P 4bc679ad21a64bfe93bf64ff1b6ba3b2 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:20.921731 18300 tablet_replica.cc:333] T d90287f9e65f48c9b8ebdcaf7fe0dde2 P 4bc679ad21a64bfe93bf64ff1b6ba3b2: stopping tablet replica
I20260709 13:09:20.922324 18300 raft_consensus.cc:2243] T d90287f9e65f48c9b8ebdcaf7fe0dde2 P 4bc679ad21a64bfe93bf64ff1b6ba3b2 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:20.923199 18300 raft_consensus.cc:2272] T d90287f9e65f48c9b8ebdcaf7fe0dde2 P 4bc679ad21a64bfe93bf64ff1b6ba3b2 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:09:20.924818 29991 consensus_peers.cc:597] T bb9da524d5b84f09b0c5853761aa5886 P 37897779fb894afb8129dcf5d269bd54 -> Peer 4bc679ad21a64bfe93bf64ff1b6ba3b2 (127.17.223.2:33075): Couldn't send request to peer 4bc679ad21a64bfe93bf64ff1b6ba3b2. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:20.926151 18300 tablet_replica.cc:333] T d8a815244f7c485b980dfa0adb0fd2a9 P 4bc679ad21a64bfe93bf64ff1b6ba3b2: stopping tablet replica
I20260709 13:09:20.926887 18300 raft_consensus.cc:2243] T d8a815244f7c485b980dfa0adb0fd2a9 P 4bc679ad21a64bfe93bf64ff1b6ba3b2 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:20.927456 18300 raft_consensus.cc:2272] T d8a815244f7c485b980dfa0adb0fd2a9 P 4bc679ad21a64bfe93bf64ff1b6ba3b2 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:20.929708 18300 tablet_replica.cc:333] T 6450825bf8ba4ebaa0e631b1dea6538e P 4bc679ad21a64bfe93bf64ff1b6ba3b2: stopping tablet replica
I20260709 13:09:20.930267 18300 raft_consensus.cc:2243] T 6450825bf8ba4ebaa0e631b1dea6538e P 4bc679ad21a64bfe93bf64ff1b6ba3b2 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:09:20.931348 18300 raft_consensus.cc:2272] T 6450825bf8ba4ebaa0e631b1dea6538e P 4bc679ad21a64bfe93bf64ff1b6ba3b2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:20.933499 18300 tablet_replica.cc:333] T bb9da524d5b84f09b0c5853761aa5886 P 4bc679ad21a64bfe93bf64ff1b6ba3b2: stopping tablet replica
I20260709 13:09:20.934113 18300 raft_consensus.cc:2243] T bb9da524d5b84f09b0c5853761aa5886 P 4bc679ad21a64bfe93bf64ff1b6ba3b2 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:20.934597 18300 raft_consensus.cc:2272] T bb9da524d5b84f09b0c5853761aa5886 P 4bc679ad21a64bfe93bf64ff1b6ba3b2 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:20.936985 18300 tablet_replica.cc:333] T 5ab64e7b83584196b9e6c6d1bc634351 P 4bc679ad21a64bfe93bf64ff1b6ba3b2: stopping tablet replica
I20260709 13:09:20.937528 18300 raft_consensus.cc:2243] T 5ab64e7b83584196b9e6c6d1bc634351 P 4bc679ad21a64bfe93bf64ff1b6ba3b2 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:20.938068 18300 raft_consensus.cc:2272] T 5ab64e7b83584196b9e6c6d1bc634351 P 4bc679ad21a64bfe93bf64ff1b6ba3b2 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:20.940791 18300 tablet_replica.cc:333] T 797710d1534045c3a8597c9800a09ea6 P 4bc679ad21a64bfe93bf64ff1b6ba3b2: stopping tablet replica
I20260709 13:09:20.941438 18300 raft_consensus.cc:2243] T 797710d1534045c3a8597c9800a09ea6 P 4bc679ad21a64bfe93bf64ff1b6ba3b2 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:20.942117 18300 raft_consensus.cc:2272] T 797710d1534045c3a8597c9800a09ea6 P 4bc679ad21a64bfe93bf64ff1b6ba3b2 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:20.944239 18300 tablet_replica.cc:333] T ea945f01fa404ea29878b0cd26af4e1e P 4bc679ad21a64bfe93bf64ff1b6ba3b2: stopping tablet replica
I20260709 13:09:20.944780 18300 raft_consensus.cc:2243] T ea945f01fa404ea29878b0cd26af4e1e P 4bc679ad21a64bfe93bf64ff1b6ba3b2 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:20.945366 18300 raft_consensus.cc:2272] T ea945f01fa404ea29878b0cd26af4e1e P 4bc679ad21a64bfe93bf64ff1b6ba3b2 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:20.947785 18300 tablet_replica.cc:333] T f814d836f0bd46a4aa7d660d8ff4b2d5 P 4bc679ad21a64bfe93bf64ff1b6ba3b2: stopping tablet replica
I20260709 13:09:20.948345 18300 raft_consensus.cc:2243] T f814d836f0bd46a4aa7d660d8ff4b2d5 P 4bc679ad21a64bfe93bf64ff1b6ba3b2 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:09:20.949308 18300 raft_consensus.cc:2272] T f814d836f0bd46a4aa7d660d8ff4b2d5 P 4bc679ad21a64bfe93bf64ff1b6ba3b2 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:20.951587 18300 tablet_replica.cc:333] T 40017481861c42efa46273995f000081 P 4bc679ad21a64bfe93bf64ff1b6ba3b2: stopping tablet replica
I20260709 13:09:20.952122 18300 raft_consensus.cc:2243] T 40017481861c42efa46273995f000081 P 4bc679ad21a64bfe93bf64ff1b6ba3b2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:20.952849 18300 raft_consensus.cc:2272] T 40017481861c42efa46273995f000081 P 4bc679ad21a64bfe93bf64ff1b6ba3b2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:20.955860 18300 tablet_replica.cc:333] T 8f557a35c94b4b2b917d69463fc69be9 P 4bc679ad21a64bfe93bf64ff1b6ba3b2: stopping tablet replica
W20260709 13:09:20.956452 29991 consensus_peers.cc:597] T 8f557a35c94b4b2b917d69463fc69be9 P 37897779fb894afb8129dcf5d269bd54 -> Peer 4bc679ad21a64bfe93bf64ff1b6ba3b2 (127.17.223.2:33075): Couldn't send request to peer 4bc679ad21a64bfe93bf64ff1b6ba3b2. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:20.956461 18300 raft_consensus.cc:2243] T 8f557a35c94b4b2b917d69463fc69be9 P 4bc679ad21a64bfe93bf64ff1b6ba3b2 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:20.957305 18300 raft_consensus.cc:2272] T 8f557a35c94b4b2b917d69463fc69be9 P 4bc679ad21a64bfe93bf64ff1b6ba3b2 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:20.959651 18300 tablet_replica.cc:333] T 968909b990764b0c8c388a63060c8130 P 4bc679ad21a64bfe93bf64ff1b6ba3b2: stopping tablet replica
I20260709 13:09:20.960189 18300 raft_consensus.cc:2243] T 968909b990764b0c8c388a63060c8130 P 4bc679ad21a64bfe93bf64ff1b6ba3b2 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:09:20.961194 18300 raft_consensus.cc:2272] T 968909b990764b0c8c388a63060c8130 P 4bc679ad21a64bfe93bf64ff1b6ba3b2 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:20.963325 18300 tablet_replica.cc:333] T 2351aaf3431e4d18906f7f7fa8bb4f5c P 4bc679ad21a64bfe93bf64ff1b6ba3b2: stopping tablet replica
I20260709 13:09:20.963824 18300 raft_consensus.cc:2243] T 2351aaf3431e4d18906f7f7fa8bb4f5c P 4bc679ad21a64bfe93bf64ff1b6ba3b2 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:20.964285 18300 raft_consensus.cc:2272] T 2351aaf3431e4d18906f7f7fa8bb4f5c P 4bc679ad21a64bfe93bf64ff1b6ba3b2 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:20.966316 18300 tablet_replica.cc:333] T 6d4b64688b8949c89f8f7b7aa871efed P 4bc679ad21a64bfe93bf64ff1b6ba3b2: stopping tablet replica
I20260709 13:09:20.966836 18300 raft_consensus.cc:2243] T 6d4b64688b8949c89f8f7b7aa871efed P 4bc679ad21a64bfe93bf64ff1b6ba3b2 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:20.967409 18300 raft_consensus.cc:2272] T 6d4b64688b8949c89f8f7b7aa871efed P 4bc679ad21a64bfe93bf64ff1b6ba3b2 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:09:20.988659 29991 consensus_peers.cc:597] T d90287f9e65f48c9b8ebdcaf7fe0dde2 P 37897779fb894afb8129dcf5d269bd54 -> Peer 4bc679ad21a64bfe93bf64ff1b6ba3b2 (127.17.223.2:33075): Couldn't send request to peer 4bc679ad21a64bfe93bf64ff1b6ba3b2. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:21.012307 18300 tablet_server.cc:196] TabletServer@127.17.223.2:0 shutdown complete.
W20260709 13:09:21.050166 29993 consensus_peers.cc:597] T d90287f9e65f48c9b8ebdcaf7fe0dde2 P 37897779fb894afb8129dcf5d269bd54 -> Peer 58a7cda73b3542718987bf815eed9b79 (127.17.223.1:37953): Couldn't send request to peer 58a7cda73b3542718987bf815eed9b79. Status: Network error: Client connection negotiation failed: client connection to 127.17.223.1:37953: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:21.053984 18300 tablet_server.cc:179] TabletServer@127.17.223.3:0 shutting down...
I20260709 13:09:21.086644 18300 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:09:21.087352 18300 tablet_replica.cc:333] T 5ccb587267a8414180b1f5474e4e2728 P 37897779fb894afb8129dcf5d269bd54: stopping tablet replica
I20260709 13:09:21.088102 18300 raft_consensus.cc:2243] T 5ccb587267a8414180b1f5474e4e2728 P 37897779fb894afb8129dcf5d269bd54 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:21.088737 18300 raft_consensus.cc:2272] T 5ccb587267a8414180b1f5474e4e2728 P 37897779fb894afb8129dcf5d269bd54 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:21.091148 18300 tablet_replica.cc:333] T 40017481861c42efa46273995f000081 P 37897779fb894afb8129dcf5d269bd54: stopping tablet replica
I20260709 13:09:21.091710 18300 raft_consensus.cc:2243] T 40017481861c42efa46273995f000081 P 37897779fb894afb8129dcf5d269bd54 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:21.092269 18300 raft_consensus.cc:2272] T 40017481861c42efa46273995f000081 P 37897779fb894afb8129dcf5d269bd54 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:21.094460 18300 tablet_replica.cc:333] T 273ea248a58742f998fd8e9dc55097fc P 37897779fb894afb8129dcf5d269bd54: stopping tablet replica
I20260709 13:09:21.095027 18300 raft_consensus.cc:2243] T 273ea248a58742f998fd8e9dc55097fc P 37897779fb894afb8129dcf5d269bd54 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:21.095551 18300 raft_consensus.cc:2272] T 273ea248a58742f998fd8e9dc55097fc P 37897779fb894afb8129dcf5d269bd54 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:21.097621 18300 tablet_replica.cc:333] T fa4b1db9a2d44d45bc9935975428592e P 37897779fb894afb8129dcf5d269bd54: stopping tablet replica
I20260709 13:09:21.098169 18300 raft_consensus.cc:2243] T fa4b1db9a2d44d45bc9935975428592e P 37897779fb894afb8129dcf5d269bd54 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:21.098753 18300 raft_consensus.cc:2272] T fa4b1db9a2d44d45bc9935975428592e P 37897779fb894afb8129dcf5d269bd54 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:21.100858 18300 tablet_replica.cc:333] T f814d836f0bd46a4aa7d660d8ff4b2d5 P 37897779fb894afb8129dcf5d269bd54: stopping tablet replica
I20260709 13:09:21.101379 18300 raft_consensus.cc:2243] T f814d836f0bd46a4aa7d660d8ff4b2d5 P 37897779fb894afb8129dcf5d269bd54 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:21.101881 18300 raft_consensus.cc:2272] T f814d836f0bd46a4aa7d660d8ff4b2d5 P 37897779fb894afb8129dcf5d269bd54 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:21.104121 18300 tablet_replica.cc:333] T 797710d1534045c3a8597c9800a09ea6 P 37897779fb894afb8129dcf5d269bd54: stopping tablet replica
I20260709 13:09:21.104724 18300 raft_consensus.cc:2243] T 797710d1534045c3a8597c9800a09ea6 P 37897779fb894afb8129dcf5d269bd54 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:21.105346 18300 raft_consensus.cc:2272] T 797710d1534045c3a8597c9800a09ea6 P 37897779fb894afb8129dcf5d269bd54 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:21.107658 18300 tablet_replica.cc:333] T ea945f01fa404ea29878b0cd26af4e1e P 37897779fb894afb8129dcf5d269bd54: stopping tablet replica
I20260709 13:09:21.108179 18300 raft_consensus.cc:2243] T ea945f01fa404ea29878b0cd26af4e1e P 37897779fb894afb8129dcf5d269bd54 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:21.108736 18300 raft_consensus.cc:2272] T ea945f01fa404ea29878b0cd26af4e1e P 37897779fb894afb8129dcf5d269bd54 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:21.110929 18300 tablet_replica.cc:333] T 5ab64e7b83584196b9e6c6d1bc634351 P 37897779fb894afb8129dcf5d269bd54: stopping tablet replica
I20260709 13:09:21.111472 18300 raft_consensus.cc:2243] T 5ab64e7b83584196b9e6c6d1bc634351 P 37897779fb894afb8129dcf5d269bd54 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:21.111986 18300 raft_consensus.cc:2272] T 5ab64e7b83584196b9e6c6d1bc634351 P 37897779fb894afb8129dcf5d269bd54 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:21.114147 18300 tablet_replica.cc:333] T bb9da524d5b84f09b0c5853761aa5886 P 37897779fb894afb8129dcf5d269bd54: stopping tablet replica
I20260709 13:09:21.114787 18300 raft_consensus.cc:2243] T bb9da524d5b84f09b0c5853761aa5886 P 37897779fb894afb8129dcf5d269bd54 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:09:21.115692 18300 raft_consensus.cc:2272] T bb9da524d5b84f09b0c5853761aa5886 P 37897779fb894afb8129dcf5d269bd54 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:21.117731 18300 tablet_replica.cc:333] T d90287f9e65f48c9b8ebdcaf7fe0dde2 P 37897779fb894afb8129dcf5d269bd54: stopping tablet replica
I20260709 13:09:21.118274 18300 raft_consensus.cc:2243] T d90287f9e65f48c9b8ebdcaf7fe0dde2 P 37897779fb894afb8129dcf5d269bd54 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:09:21.119139 18300 raft_consensus.cc:2272] T d90287f9e65f48c9b8ebdcaf7fe0dde2 P 37897779fb894afb8129dcf5d269bd54 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:21.121147 18300 tablet_replica.cc:333] T 6450825bf8ba4ebaa0e631b1dea6538e P 37897779fb894afb8129dcf5d269bd54: stopping tablet replica
I20260709 13:09:21.121641 18300 raft_consensus.cc:2243] T 6450825bf8ba4ebaa0e631b1dea6538e P 37897779fb894afb8129dcf5d269bd54 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:21.122082 18300 raft_consensus.cc:2272] T 6450825bf8ba4ebaa0e631b1dea6538e P 37897779fb894afb8129dcf5d269bd54 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:21.124082 18300 tablet_replica.cc:333] T d8a815244f7c485b980dfa0adb0fd2a9 P 37897779fb894afb8129dcf5d269bd54: stopping tablet replica
I20260709 13:09:21.124584 18300 raft_consensus.cc:2243] T d8a815244f7c485b980dfa0adb0fd2a9 P 37897779fb894afb8129dcf5d269bd54 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:09:21.125409 18300 raft_consensus.cc:2272] T d8a815244f7c485b980dfa0adb0fd2a9 P 37897779fb894afb8129dcf5d269bd54 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:21.127429 18300 tablet_replica.cc:333] T e347ac4792b04c198fb6829a4a87078b P 37897779fb894afb8129dcf5d269bd54: stopping tablet replica
I20260709 13:09:21.127911 18300 raft_consensus.cc:2243] T e347ac4792b04c198fb6829a4a87078b P 37897779fb894afb8129dcf5d269bd54 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:21.128384 18300 raft_consensus.cc:2272] T e347ac4792b04c198fb6829a4a87078b P 37897779fb894afb8129dcf5d269bd54 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:21.130429 18300 tablet_replica.cc:333] T 59abb803b8ce4d28967bf12c46d66c0d P 37897779fb894afb8129dcf5d269bd54: stopping tablet replica
I20260709 13:09:21.130904 18300 raft_consensus.cc:2243] T 59abb803b8ce4d28967bf12c46d66c0d P 37897779fb894afb8129dcf5d269bd54 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:09:21.131798 18300 raft_consensus.cc:2272] T 59abb803b8ce4d28967bf12c46d66c0d P 37897779fb894afb8129dcf5d269bd54 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:21.133821 18300 tablet_replica.cc:333] T 2351aaf3431e4d18906f7f7fa8bb4f5c P 37897779fb894afb8129dcf5d269bd54: stopping tablet replica
I20260709 13:09:21.134294 18300 raft_consensus.cc:2243] T 2351aaf3431e4d18906f7f7fa8bb4f5c P 37897779fb894afb8129dcf5d269bd54 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:09:21.135115 18300 raft_consensus.cc:2272] T 2351aaf3431e4d18906f7f7fa8bb4f5c P 37897779fb894afb8129dcf5d269bd54 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:21.136981 18300 tablet_replica.cc:333] T 6d4b64688b8949c89f8f7b7aa871efed P 37897779fb894afb8129dcf5d269bd54: stopping tablet replica
I20260709 13:09:21.137449 18300 raft_consensus.cc:2243] T 6d4b64688b8949c89f8f7b7aa871efed P 37897779fb894afb8129dcf5d269bd54 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:21.137945 18300 raft_consensus.cc:2272] T 6d4b64688b8949c89f8f7b7aa871efed P 37897779fb894afb8129dcf5d269bd54 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:21.139971 18300 tablet_replica.cc:333] T 968909b990764b0c8c388a63060c8130 P 37897779fb894afb8129dcf5d269bd54: stopping tablet replica
I20260709 13:09:21.140440 18300 raft_consensus.cc:2243] T 968909b990764b0c8c388a63060c8130 P 37897779fb894afb8129dcf5d269bd54 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:21.140923 18300 raft_consensus.cc:2272] T 968909b990764b0c8c388a63060c8130 P 37897779fb894afb8129dcf5d269bd54 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:21.142937 18300 tablet_replica.cc:333] T 8f557a35c94b4b2b917d69463fc69be9 P 37897779fb894afb8129dcf5d269bd54: stopping tablet replica
I20260709 13:09:21.143378 18300 raft_consensus.cc:2243] T 8f557a35c94b4b2b917d69463fc69be9 P 37897779fb894afb8129dcf5d269bd54 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:09:21.144248 18300 raft_consensus.cc:2272] T 8f557a35c94b4b2b917d69463fc69be9 P 37897779fb894afb8129dcf5d269bd54 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:21.184803 18300 tablet_server.cc:196] TabletServer@127.17.223.3:0 shutdown complete.
I20260709 13:09:21.221391 18300 master.cc:562] Master@127.17.223.62:40001 shutting down...
I20260709 13:09:21.245019 18300 raft_consensus.cc:2243] T 00000000000000000000000000000000 P badd4c5e4acc4940a67cc8f85f2a187d [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:09:21.245692 18300 raft_consensus.cc:2272] T 00000000000000000000000000000000 P badd4c5e4acc4940a67cc8f85f2a187d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:21.246012 18300 tablet_replica.cc:333] T 00000000000000000000000000000000 P badd4c5e4acc4940a67cc8f85f2a187d: stopping tablet replica
I20260709 13:09:21.267345 18300 master.cc:584] Master@127.17.223.62:40001 shutdown complete.
[       OK ] FilterSoftDeletedTableTest.TestFilterSofteDeletedTable/0 (12964 ms)
[ RUN      ] FilterSoftDeletedTableTest.TestFilterSofteDeletedTable/1
I20260709 13:09:21.323047 18300 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.17.223.62:33533
I20260709 13:09:21.324172 18300 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:09:21.330628 30349 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:09:21.330767 30350 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:09:21.331600 30352 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:09:21.332273 18300 server_base.cc:1061] running on GCE node
I20260709 13:09:21.333256 18300 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:09:21.333432 18300 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:09:21.333637 18300 hybrid_clock.cc:648] HybridClock initialized: now 1783602561333602 us; error 0 us; skew 500 ppm
I20260709 13:09:21.334173 18300 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:09:21.336951 18300 webserver.cc:533] Webserver started at http://127.17.223.62:44113/ using document root <none> and password file <none>
I20260709 13:09:21.337445 18300 fs_manager.cc:362] Metadata directory not provided
I20260709 13:09:21.337625 18300 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:09:21.337918 18300 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:09:21.339128 18300 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskKd2k48/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602220613947-18300-0/minicluster-data/master-0-root/instance:
uuid: "35ae1a007c404b71bd68dd0180693be7"
format_stamp: "Formatted at 2026-07-09 13:09:21 on dist-test-slave-vl1s"
I20260709 13:09:21.343482 18300 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.000s	sys 0.004s
I20260709 13:09:21.346740 30357 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:09:21.347553 18300 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.001s
I20260709 13:09:21.347865 18300 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskKd2k48/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602220613947-18300-0/minicluster-data/master-0-root
uuid: "35ae1a007c404b71bd68dd0180693be7"
format_stamp: "Formatted at 2026-07-09 13:09:21 on dist-test-slave-vl1s"
I20260709 13:09:21.348179 18300 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskKd2k48/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602220613947-18300-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskKd2k48/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602220613947-18300-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskKd2k48/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602220613947-18300-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:09:21.358206 18300 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:09:21.359570 18300 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:09:21.398790 18300 rpc_server.cc:307] RPC server started. Bound to: 127.17.223.62:33533
I20260709 13:09:21.398835 30408 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.17.223.62:33533 every 8 connection(s)
I20260709 13:09:21.402968 30409 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:21.414482 30409 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 35ae1a007c404b71bd68dd0180693be7: Bootstrap starting.
I20260709 13:09:21.419449 30409 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 35ae1a007c404b71bd68dd0180693be7: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:21.423637 30409 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 35ae1a007c404b71bd68dd0180693be7: No bootstrap required, opened a new log
I20260709 13:09:21.425864 30409 raft_consensus.cc:359] T 00000000000000000000000000000000 P 35ae1a007c404b71bd68dd0180693be7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "35ae1a007c404b71bd68dd0180693be7" member_type: VOTER }
I20260709 13:09:21.426321 30409 raft_consensus.cc:385] T 00000000000000000000000000000000 P 35ae1a007c404b71bd68dd0180693be7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:21.426564 30409 raft_consensus.cc:740] T 00000000000000000000000000000000 P 35ae1a007c404b71bd68dd0180693be7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 35ae1a007c404b71bd68dd0180693be7, State: Initialized, Role: FOLLOWER
I20260709 13:09:21.427188 30409 consensus_queue.cc:260] T 00000000000000000000000000000000 P 35ae1a007c404b71bd68dd0180693be7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "35ae1a007c404b71bd68dd0180693be7" member_type: VOTER }
I20260709 13:09:21.427651 30409 raft_consensus.cc:399] T 00000000000000000000000000000000 P 35ae1a007c404b71bd68dd0180693be7 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 13:09:21.427903 30409 raft_consensus.cc:493] T 00000000000000000000000000000000 P 35ae1a007c404b71bd68dd0180693be7 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 13:09:21.428189 30409 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 35ae1a007c404b71bd68dd0180693be7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:21.433115 30409 raft_consensus.cc:515] T 00000000000000000000000000000000 P 35ae1a007c404b71bd68dd0180693be7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "35ae1a007c404b71bd68dd0180693be7" member_type: VOTER }
I20260709 13:09:21.433655 30409 leader_election.cc:304] T 00000000000000000000000000000000 P 35ae1a007c404b71bd68dd0180693be7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 35ae1a007c404b71bd68dd0180693be7; no voters: 
I20260709 13:09:21.434836 30409 leader_election.cc:290] T 00000000000000000000000000000000 P 35ae1a007c404b71bd68dd0180693be7 [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 13:09:21.435262 30412 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 35ae1a007c404b71bd68dd0180693be7 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:21.436652 30412 raft_consensus.cc:697] T 00000000000000000000000000000000 P 35ae1a007c404b71bd68dd0180693be7 [term 1 LEADER]: Becoming Leader. State: Replica: 35ae1a007c404b71bd68dd0180693be7, State: Running, Role: LEADER
I20260709 13:09:21.437352 30412 consensus_queue.cc:237] T 00000000000000000000000000000000 P 35ae1a007c404b71bd68dd0180693be7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "35ae1a007c404b71bd68dd0180693be7" member_type: VOTER }
I20260709 13:09:21.437783 30409 sys_catalog.cc:565] T 00000000000000000000000000000000 P 35ae1a007c404b71bd68dd0180693be7 [sys.catalog]: configured and running, proceeding with master startup.
I20260709 13:09:21.443778 30414 sys_catalog.cc:455] T 00000000000000000000000000000000 P 35ae1a007c404b71bd68dd0180693be7 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 35ae1a007c404b71bd68dd0180693be7. Latest consensus state: current_term: 1 leader_uuid: "35ae1a007c404b71bd68dd0180693be7" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "35ae1a007c404b71bd68dd0180693be7" member_type: VOTER } }
I20260709 13:09:21.444456 30414 sys_catalog.cc:458] T 00000000000000000000000000000000 P 35ae1a007c404b71bd68dd0180693be7 [sys.catalog]: This master's current role is: LEADER
I20260709 13:09:21.444595 30413 sys_catalog.cc:455] T 00000000000000000000000000000000 P 35ae1a007c404b71bd68dd0180693be7 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "35ae1a007c404b71bd68dd0180693be7" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "35ae1a007c404b71bd68dd0180693be7" member_type: VOTER } }
I20260709 13:09:21.445320 30413 sys_catalog.cc:458] T 00000000000000000000000000000000 P 35ae1a007c404b71bd68dd0180693be7 [sys.catalog]: This master's current role is: LEADER
I20260709 13:09:21.446389 30420 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 13:09:21.451907 30420 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 13:09:21.453851 18300 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 13:09:21.461122 30420 catalog_manager.cc:1383] Generated new cluster ID: b5adbb5cc7a34dc987867e5ccda4dc4c
I20260709 13:09:21.461410 30420 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 13:09:21.478394 30420 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 13:09:21.479714 30420 catalog_manager.cc:1540] Loading token signing keys...
I20260709 13:09:21.494516 30420 catalog_manager.cc:6070] T 00000000000000000000000000000000 P 35ae1a007c404b71bd68dd0180693be7: Generated new TSK 0
I20260709 13:09:21.495172 30420 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 13:09:21.520620 18300 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:09:21.526611 30430 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:09:21.527874 30431 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:09:21.529891 30433 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:09:21.529963 18300 server_base.cc:1061] running on GCE node
I20260709 13:09:21.531131 18300 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:09:21.531342 18300 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:09:21.531490 18300 hybrid_clock.cc:648] HybridClock initialized: now 1783602561531477 us; error 0 us; skew 500 ppm
I20260709 13:09:21.532027 18300 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:09:21.534276 18300 webserver.cc:533] Webserver started at http://127.17.223.1:34229/ using document root <none> and password file <none>
I20260709 13:09:21.534807 18300 fs_manager.cc:362] Metadata directory not provided
I20260709 13:09:21.535006 18300 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:09:21.535275 18300 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:09:21.536381 18300 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskKd2k48/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602220613947-18300-0/minicluster-data/ts-0-root/instance:
uuid: "b1daf23b3538498bb795a60d627b6ac0"
format_stamp: "Formatted at 2026-07-09 13:09:21 on dist-test-slave-vl1s"
I20260709 13:09:21.540822 18300 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.005s	sys 0.000s
I20260709 13:09:21.544126 30438 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:09:21.544844 18300 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.001s	sys 0.000s
I20260709 13:09:21.545151 18300 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskKd2k48/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602220613947-18300-0/minicluster-data/ts-0-root
uuid: "b1daf23b3538498bb795a60d627b6ac0"
format_stamp: "Formatted at 2026-07-09 13:09:21 on dist-test-slave-vl1s"
I20260709 13:09:21.545423 18300 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskKd2k48/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602220613947-18300-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskKd2k48/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602220613947-18300-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskKd2k48/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602220613947-18300-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:09:21.561328 18300 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:09:21.562503 18300 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:09:21.563966 18300 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:09:21.566134 18300 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:09:21.566303 18300 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:09:21.566572 18300 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:09:21.566748 18300 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.001s
I20260709 13:09:21.606660 18300 rpc_server.cc:307] RPC server started. Bound to: 127.17.223.1:36109
I20260709 13:09:21.606866 30500 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.17.223.1:36109 every 8 connection(s)
I20260709 13:09:21.611799 18300 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:09:21.619553 30505 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:09:21.621795 30506 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:09:21.623325 30508 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:09:21.624794 30501 heartbeater.cc:344] Connected to a master server at 127.17.223.62:33533
I20260709 13:09:21.625201 18300 server_base.cc:1061] running on GCE node
I20260709 13:09:21.625259 30501 heartbeater.cc:461] Registering TS with master...
I20260709 13:09:21.626196 30501 heartbeater.cc:507] Master 127.17.223.62:33533 requested a full tablet report, sending...
I20260709 13:09:21.626251 18300 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:09:21.626613 18300 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:09:21.626844 18300 hybrid_clock.cc:648] HybridClock initialized: now 1783602561626826 us; error 0 us; skew 500 ppm
I20260709 13:09:21.627619 18300 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:09:21.628412 30374 ts_manager.cc:194] Registered new tserver with Master: b1daf23b3538498bb795a60d627b6ac0 (127.17.223.1:36109)
I20260709 13:09:21.630154 18300 webserver.cc:533] Webserver started at http://127.17.223.2:35821/ using document root <none> and password file <none>
I20260709 13:09:21.630591 30374 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:52742
I20260709 13:09:21.630749 18300 fs_manager.cc:362] Metadata directory not provided
I20260709 13:09:21.631070 18300 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:09:21.631356 18300 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:09:21.632772 18300 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskKd2k48/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602220613947-18300-0/minicluster-data/ts-1-root/instance:
uuid: "d7def43826924f03b8858383f0dc69f4"
format_stamp: "Formatted at 2026-07-09 13:09:21 on dist-test-slave-vl1s"
I20260709 13:09:21.637064 18300 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.006s	sys 0.000s
I20260709 13:09:21.640482 30513 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:09:21.641242 18300 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.001s	sys 0.000s
I20260709 13:09:21.641549 18300 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskKd2k48/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602220613947-18300-0/minicluster-data/ts-1-root
uuid: "d7def43826924f03b8858383f0dc69f4"
format_stamp: "Formatted at 2026-07-09 13:09:21 on dist-test-slave-vl1s"
I20260709 13:09:21.641839 18300 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskKd2k48/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602220613947-18300-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskKd2k48/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602220613947-18300-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskKd2k48/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602220613947-18300-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:09:21.667431 18300 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:09:21.668643 18300 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:09:21.670073 18300 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:09:21.672317 18300 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:09:21.672544 18300 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:09:21.672776 18300 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:09:21.672945 18300 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:09:21.712499 18300 rpc_server.cc:307] RPC server started. Bound to: 127.17.223.2:40053
I20260709 13:09:21.712618 30575 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.17.223.2:40053 every 8 connection(s)
I20260709 13:09:21.717701 18300 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:09:21.725037 30579 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:09:21.726047 30580 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:09:21.728844 30582 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:09:21.729434 30576 heartbeater.cc:344] Connected to a master server at 127.17.223.62:33533
I20260709 13:09:21.729737 18300 server_base.cc:1061] running on GCE node
I20260709 13:09:21.729928 30576 heartbeater.cc:461] Registering TS with master...
I20260709 13:09:21.730787 18300 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
I20260709 13:09:21.730829 30576 heartbeater.cc:507] Master 127.17.223.62:33533 requested a full tablet report, sending...
W20260709 13:09:21.731033 18300 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:09:21.731320 18300 hybrid_clock.cc:648] HybridClock initialized: now 1783602561731301 us; error 0 us; skew 500 ppm
I20260709 13:09:21.732038 18300 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:09:21.733314 30374 ts_manager.cc:194] Registered new tserver with Master: d7def43826924f03b8858383f0dc69f4 (127.17.223.2:40053)
I20260709 13:09:21.734761 18300 webserver.cc:533] Webserver started at http://127.17.223.3:38707/ using document root <none> and password file <none>
I20260709 13:09:21.735077 30374 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:52746
I20260709 13:09:21.735322 18300 fs_manager.cc:362] Metadata directory not provided
I20260709 13:09:21.735641 18300 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:09:21.735937 18300 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:09:21.737593 18300 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskKd2k48/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602220613947-18300-0/minicluster-data/ts-2-root/instance:
uuid: "eaa6f3dc13d643b9acfd8df1263a456d"
format_stamp: "Formatted at 2026-07-09 13:09:21 on dist-test-slave-vl1s"
I20260709 13:09:21.742172 18300 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.003s	sys 0.003s
I20260709 13:09:21.745801 30587 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:09:21.746721 18300 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260709 13:09:21.747047 18300 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskKd2k48/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602220613947-18300-0/minicluster-data/ts-2-root
uuid: "eaa6f3dc13d643b9acfd8df1263a456d"
format_stamp: "Formatted at 2026-07-09 13:09:21 on dist-test-slave-vl1s"
I20260709 13:09:21.747362 18300 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskKd2k48/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602220613947-18300-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskKd2k48/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602220613947-18300-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskKd2k48/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602220613947-18300-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:09:21.760898 18300 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:09:21.762022 18300 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:09:21.763489 18300 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:09:21.765625 18300 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:09:21.765810 18300 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:09:21.766112 18300 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:09:21.766294 18300 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:09:21.807031 18300 rpc_server.cc:307] RPC server started. Bound to: 127.17.223.3:41395
I20260709 13:09:21.807147 30649 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.17.223.3:41395 every 8 connection(s)
I20260709 13:09:21.820778 30650 heartbeater.cc:344] Connected to a master server at 127.17.223.62:33533
I20260709 13:09:21.821290 30650 heartbeater.cc:461] Registering TS with master...
I20260709 13:09:21.822024 30650 heartbeater.cc:507] Master 127.17.223.62:33533 requested a full tablet report, sending...
I20260709 13:09:21.824117 30374 ts_manager.cc:194] Registered new tserver with Master: eaa6f3dc13d643b9acfd8df1263a456d (127.17.223.3:41395)
I20260709 13:09:21.824714 18300 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.014518401s
I20260709 13:09:21.825713 30374 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:52754
I20260709 13:09:21.851194 30374 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:52768:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q""\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:09:21.853947 30374 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:09:21.925535 30541 tablet_service.cc:1511] Processing CreateTablet for tablet 131d025784b94fe8bab12c27e5176e73 (DEFAULT_TABLE table=test-workload [id=d18d9920f6024f5ab2f7ef93f8ee1de0]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:09:21.927026 30541 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 131d025784b94fe8bab12c27e5176e73. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:21.930962 30537 tablet_service.cc:1511] Processing CreateTablet for tablet 687db47721c34eb3918dc02f98170722 (DEFAULT_TABLE table=test-workload [id=d18d9920f6024f5ab2f7ef93f8ee1de0]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:09:21.931901 30539 tablet_service.cc:1511] Processing CreateTablet for tablet f406da2fcdaa4facbd59848fdd5eeeb3 (DEFAULT_TABLE table=test-workload [id=d18d9920f6024f5ab2f7ef93f8ee1de0]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:09:21.932511 30537 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 687db47721c34eb3918dc02f98170722. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:21.931900 30466 tablet_service.cc:1511] Processing CreateTablet for tablet 131d025784b94fe8bab12c27e5176e73 (DEFAULT_TABLE table=test-workload [id=d18d9920f6024f5ab2f7ef93f8ee1de0]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:09:21.933383 30539 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f406da2fcdaa4facbd59848fdd5eeeb3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:21.933655 30466 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 131d025784b94fe8bab12c27e5176e73. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:21.935276 30536 tablet_service.cc:1511] Processing CreateTablet for tablet 734911241b624e74aadb0e38ed5b0362 (DEFAULT_TABLE table=test-workload [id=d18d9920f6024f5ab2f7ef93f8ee1de0]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:09:21.935932 30540 tablet_service.cc:1511] Processing CreateTablet for tablet d121c37db92f49c4a789269d64b00a12 (DEFAULT_TABLE table=test-workload [id=d18d9920f6024f5ab2f7ef93f8ee1de0]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:09:21.936686 30536 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 734911241b624e74aadb0e38ed5b0362. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:21.937346 30540 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d121c37db92f49c4a789269d64b00a12. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:21.940960 30538 tablet_service.cc:1511] Processing CreateTablet for tablet 17519d8368db4b08a84e4d7335c6fc4f (DEFAULT_TABLE table=test-workload [id=d18d9920f6024f5ab2f7ef93f8ee1de0]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:09:21.941692 30535 tablet_service.cc:1511] Processing CreateTablet for tablet d6e07afd07294d7d80ca32fa1f97e4a1 (DEFAULT_TABLE table=test-workload [id=d18d9920f6024f5ab2f7ef93f8ee1de0]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:09:21.942404 30538 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 17519d8368db4b08a84e4d7335c6fc4f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:21.943964 30465 tablet_service.cc:1511] Processing CreateTablet for tablet d121c37db92f49c4a789269d64b00a12 (DEFAULT_TABLE table=test-workload [id=d18d9920f6024f5ab2f7ef93f8ee1de0]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:09:21.944428 30535 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d6e07afd07294d7d80ca32fa1f97e4a1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:21.945408 30465 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d121c37db92f49c4a789269d64b00a12. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:21.949734 30534 tablet_service.cc:1511] Processing CreateTablet for tablet 4ad6f5c1312c488b8d331c1ecb412800 (DEFAULT_TABLE table=test-workload [id=d18d9920f6024f5ab2f7ef93f8ee1de0]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:09:21.951108 30464 tablet_service.cc:1511] Processing CreateTablet for tablet f406da2fcdaa4facbd59848fdd5eeeb3 (DEFAULT_TABLE table=test-workload [id=d18d9920f6024f5ab2f7ef93f8ee1de0]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:09:21.952579 30464 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f406da2fcdaa4facbd59848fdd5eeeb3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:21.951212 30534 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4ad6f5c1312c488b8d331c1ecb412800. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:21.957412 30463 tablet_service.cc:1511] Processing CreateTablet for tablet 17519d8368db4b08a84e4d7335c6fc4f (DEFAULT_TABLE table=test-workload [id=d18d9920f6024f5ab2f7ef93f8ee1de0]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:09:21.958851 30463 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 17519d8368db4b08a84e4d7335c6fc4f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:21.967334 30533 tablet_service.cc:1511] Processing CreateTablet for tablet ad8233fe86c64f6380f513881e6c3268 (DEFAULT_TABLE table=test-workload [id=d18d9920f6024f5ab2f7ef93f8ee1de0]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:09:21.968678 30462 tablet_service.cc:1511] Processing CreateTablet for tablet 687db47721c34eb3918dc02f98170722 (DEFAULT_TABLE table=test-workload [id=d18d9920f6024f5ab2f7ef93f8ee1de0]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:09:21.969467 30533 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ad8233fe86c64f6380f513881e6c3268. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:21.970260 30462 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 687db47721c34eb3918dc02f98170722. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:21.973929 30458 tablet_service.cc:1511] Processing CreateTablet for tablet ad8233fe86c64f6380f513881e6c3268 (DEFAULT_TABLE table=test-workload [id=d18d9920f6024f5ab2f7ef93f8ee1de0]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:09:21.985298 30458 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ad8233fe86c64f6380f513881e6c3268. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:21.975929 30459 tablet_service.cc:1511] Processing CreateTablet for tablet 4ad6f5c1312c488b8d331c1ecb412800 (DEFAULT_TABLE table=test-workload [id=d18d9920f6024f5ab2f7ef93f8ee1de0]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:09:21.987788 30459 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4ad6f5c1312c488b8d331c1ecb412800. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:21.977618 30461 tablet_service.cc:1511] Processing CreateTablet for tablet 734911241b624e74aadb0e38ed5b0362 (DEFAULT_TABLE table=test-workload [id=d18d9920f6024f5ab2f7ef93f8ee1de0]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:09:21.991600 30461 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 734911241b624e74aadb0e38ed5b0362. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:21.979223 30460 tablet_service.cc:1511] Processing CreateTablet for tablet d6e07afd07294d7d80ca32fa1f97e4a1 (DEFAULT_TABLE table=test-workload [id=d18d9920f6024f5ab2f7ef93f8ee1de0]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:09:21.995608 30460 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d6e07afd07294d7d80ca32fa1f97e4a1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:22.065866 30664 tablet_bootstrap.cc:492] T d121c37db92f49c4a789269d64b00a12 P b1daf23b3538498bb795a60d627b6ac0: Bootstrap starting.
I20260709 13:09:22.081424 30615 tablet_service.cc:1511] Processing CreateTablet for tablet 131d025784b94fe8bab12c27e5176e73 (DEFAULT_TABLE table=test-workload [id=d18d9920f6024f5ab2f7ef93f8ee1de0]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:09:22.083864 30614 tablet_service.cc:1511] Processing CreateTablet for tablet d121c37db92f49c4a789269d64b00a12 (DEFAULT_TABLE table=test-workload [id=d18d9920f6024f5ab2f7ef93f8ee1de0]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:09:22.084403 30664 tablet_bootstrap.cc:654] T d121c37db92f49c4a789269d64b00a12 P b1daf23b3538498bb795a60d627b6ac0: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:22.086279 30613 tablet_service.cc:1511] Processing CreateTablet for tablet f406da2fcdaa4facbd59848fdd5eeeb3 (DEFAULT_TABLE table=test-workload [id=d18d9920f6024f5ab2f7ef93f8ee1de0]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:09:22.088613 30612 tablet_service.cc:1511] Processing CreateTablet for tablet 17519d8368db4b08a84e4d7335c6fc4f (DEFAULT_TABLE table=test-workload [id=d18d9920f6024f5ab2f7ef93f8ee1de0]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:09:22.090823 30608 tablet_service.cc:1511] Processing CreateTablet for tablet 4ad6f5c1312c488b8d331c1ecb412800 (DEFAULT_TABLE table=test-workload [id=d18d9920f6024f5ab2f7ef93f8ee1de0]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:09:22.091073 30611 tablet_service.cc:1511] Processing CreateTablet for tablet 687db47721c34eb3918dc02f98170722 (DEFAULT_TABLE table=test-workload [id=d18d9920f6024f5ab2f7ef93f8ee1de0]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:09:22.091774 30665 tablet_bootstrap.cc:492] T 734911241b624e74aadb0e38ed5b0362 P d7def43826924f03b8858383f0dc69f4: Bootstrap starting.
I20260709 13:09:22.093021 30610 tablet_service.cc:1511] Processing CreateTablet for tablet 734911241b624e74aadb0e38ed5b0362 (DEFAULT_TABLE table=test-workload [id=d18d9920f6024f5ab2f7ef93f8ee1de0]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:09:22.093305 30609 tablet_service.cc:1511] Processing CreateTablet for tablet d6e07afd07294d7d80ca32fa1f97e4a1 (DEFAULT_TABLE table=test-workload [id=d18d9920f6024f5ab2f7ef93f8ee1de0]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:09:22.094617 30615 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 131d025784b94fe8bab12c27e5176e73. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:22.095289 30609 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d6e07afd07294d7d80ca32fa1f97e4a1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:22.097718 30614 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d121c37db92f49c4a789269d64b00a12. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:22.103080 30611 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 687db47721c34eb3918dc02f98170722. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:22.103747 30608 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4ad6f5c1312c488b8d331c1ecb412800. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:22.104112 30665 tablet_bootstrap.cc:654] T 734911241b624e74aadb0e38ed5b0362 P d7def43826924f03b8858383f0dc69f4: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:22.105990 30613 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f406da2fcdaa4facbd59848fdd5eeeb3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:22.108305 30607 tablet_service.cc:1511] Processing CreateTablet for tablet ad8233fe86c64f6380f513881e6c3268 (DEFAULT_TABLE table=test-workload [id=d18d9920f6024f5ab2f7ef93f8ee1de0]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:09:22.110250 30607 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ad8233fe86c64f6380f513881e6c3268. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:22.111850 30610 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 734911241b624e74aadb0e38ed5b0362. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:22.113286 30612 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 17519d8368db4b08a84e4d7335c6fc4f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:22.123514 30665 tablet_bootstrap.cc:492] T 734911241b624e74aadb0e38ed5b0362 P d7def43826924f03b8858383f0dc69f4: No bootstrap required, opened a new log
I20260709 13:09:22.124145 30665 ts_tablet_manager.cc:1403] T 734911241b624e74aadb0e38ed5b0362 P d7def43826924f03b8858383f0dc69f4: Time spent bootstrapping tablet: real 0.033s	user 0.008s	sys 0.013s
I20260709 13:09:22.127103 30665 raft_consensus.cc:359] T 734911241b624e74aadb0e38ed5b0362 P d7def43826924f03b8858383f0dc69f4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1daf23b3538498bb795a60d627b6ac0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 36109 } } peers { permanent_uuid: "d7def43826924f03b8858383f0dc69f4" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 40053 } } peers { permanent_uuid: "eaa6f3dc13d643b9acfd8df1263a456d" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 41395 } }
I20260709 13:09:22.127849 30665 raft_consensus.cc:385] T 734911241b624e74aadb0e38ed5b0362 P d7def43826924f03b8858383f0dc69f4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:22.128145 30665 raft_consensus.cc:740] T 734911241b624e74aadb0e38ed5b0362 P d7def43826924f03b8858383f0dc69f4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d7def43826924f03b8858383f0dc69f4, State: Initialized, Role: FOLLOWER
I20260709 13:09:22.129304 30665 consensus_queue.cc:260] T 734911241b624e74aadb0e38ed5b0362 P d7def43826924f03b8858383f0dc69f4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1daf23b3538498bb795a60d627b6ac0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 36109 } } peers { permanent_uuid: "d7def43826924f03b8858383f0dc69f4" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 40053 } } peers { permanent_uuid: "eaa6f3dc13d643b9acfd8df1263a456d" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 41395 } }
I20260709 13:09:22.150092 30664 tablet_bootstrap.cc:492] T d121c37db92f49c4a789269d64b00a12 P b1daf23b3538498bb795a60d627b6ac0: No bootstrap required, opened a new log
I20260709 13:09:22.151057 30664 ts_tablet_manager.cc:1403] T d121c37db92f49c4a789269d64b00a12 P b1daf23b3538498bb795a60d627b6ac0: Time spent bootstrapping tablet: real 0.085s	user 0.012s	sys 0.003s
I20260709 13:09:22.155277 30664 raft_consensus.cc:359] T d121c37db92f49c4a789269d64b00a12 P b1daf23b3538498bb795a60d627b6ac0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1daf23b3538498bb795a60d627b6ac0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 36109 } } peers { permanent_uuid: "d7def43826924f03b8858383f0dc69f4" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 40053 } } peers { permanent_uuid: "eaa6f3dc13d643b9acfd8df1263a456d" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 41395 } }
I20260709 13:09:22.156265 30664 raft_consensus.cc:385] T d121c37db92f49c4a789269d64b00a12 P b1daf23b3538498bb795a60d627b6ac0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:22.156653 30664 raft_consensus.cc:740] T d121c37db92f49c4a789269d64b00a12 P b1daf23b3538498bb795a60d627b6ac0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b1daf23b3538498bb795a60d627b6ac0, State: Initialized, Role: FOLLOWER
I20260709 13:09:22.166965 30664 consensus_queue.cc:260] T d121c37db92f49c4a789269d64b00a12 P b1daf23b3538498bb795a60d627b6ac0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1daf23b3538498bb795a60d627b6ac0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 36109 } } peers { permanent_uuid: "d7def43826924f03b8858383f0dc69f4" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 40053 } } peers { permanent_uuid: "eaa6f3dc13d643b9acfd8df1263a456d" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 41395 } }
I20260709 13:09:22.167490 30665 ts_tablet_manager.cc:1434] T 734911241b624e74aadb0e38ed5b0362 P d7def43826924f03b8858383f0dc69f4: Time spent starting tablet: real 0.043s	user 0.020s	sys 0.017s
I20260709 13:09:22.168543 30576 heartbeater.cc:499] Master 127.17.223.62:33533 was elected leader, sending a full tablet report...
I20260709 13:09:22.174688 30665 tablet_bootstrap.cc:492] T d6e07afd07294d7d80ca32fa1f97e4a1 P d7def43826924f03b8858383f0dc69f4: Bootstrap starting.
I20260709 13:09:22.181550 30665 tablet_bootstrap.cc:654] T d6e07afd07294d7d80ca32fa1f97e4a1 P d7def43826924f03b8858383f0dc69f4: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:22.189090 30664 ts_tablet_manager.cc:1434] T d121c37db92f49c4a789269d64b00a12 P b1daf23b3538498bb795a60d627b6ac0: Time spent starting tablet: real 0.038s	user 0.003s	sys 0.011s
I20260709 13:09:22.194931 30501 heartbeater.cc:499] Master 127.17.223.62:33533 was elected leader, sending a full tablet report...
I20260709 13:09:22.205093 30665 tablet_bootstrap.cc:492] T d6e07afd07294d7d80ca32fa1f97e4a1 P d7def43826924f03b8858383f0dc69f4: No bootstrap required, opened a new log
I20260709 13:09:22.206808 30665 ts_tablet_manager.cc:1403] T d6e07afd07294d7d80ca32fa1f97e4a1 P d7def43826924f03b8858383f0dc69f4: Time spent bootstrapping tablet: real 0.032s	user 0.017s	sys 0.001s
I20260709 13:09:22.207125 30668 raft_consensus.cc:493] T 734911241b624e74aadb0e38ed5b0362 P d7def43826924f03b8858383f0dc69f4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:22.207676 30668 raft_consensus.cc:515] T 734911241b624e74aadb0e38ed5b0362 P d7def43826924f03b8858383f0dc69f4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1daf23b3538498bb795a60d627b6ac0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 36109 } } peers { permanent_uuid: "d7def43826924f03b8858383f0dc69f4" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 40053 } } peers { permanent_uuid: "eaa6f3dc13d643b9acfd8df1263a456d" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 41395 } }
I20260709 13:09:22.210345 30668 leader_election.cc:290] T 734911241b624e74aadb0e38ed5b0362 P d7def43826924f03b8858383f0dc69f4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b1daf23b3538498bb795a60d627b6ac0 (127.17.223.1:36109), eaa6f3dc13d643b9acfd8df1263a456d (127.17.223.3:41395)
I20260709 13:09:22.210042 30665 raft_consensus.cc:359] T d6e07afd07294d7d80ca32fa1f97e4a1 P d7def43826924f03b8858383f0dc69f4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1daf23b3538498bb795a60d627b6ac0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 36109 } } peers { permanent_uuid: "d7def43826924f03b8858383f0dc69f4" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 40053 } } peers { permanent_uuid: "eaa6f3dc13d643b9acfd8df1263a456d" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 41395 } }
I20260709 13:09:22.222978 30665 raft_consensus.cc:385] T d6e07afd07294d7d80ca32fa1f97e4a1 P d7def43826924f03b8858383f0dc69f4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:22.223547 30665 raft_consensus.cc:740] T d6e07afd07294d7d80ca32fa1f97e4a1 P d7def43826924f03b8858383f0dc69f4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d7def43826924f03b8858383f0dc69f4, State: Initialized, Role: FOLLOWER
I20260709 13:09:22.224489 30665 consensus_queue.cc:260] T d6e07afd07294d7d80ca32fa1f97e4a1 P d7def43826924f03b8858383f0dc69f4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1daf23b3538498bb795a60d627b6ac0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 36109 } } peers { permanent_uuid: "d7def43826924f03b8858383f0dc69f4" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 40053 } } peers { permanent_uuid: "eaa6f3dc13d643b9acfd8df1263a456d" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 41395 } }
I20260709 13:09:22.221362 30669 tablet_bootstrap.cc:492] T 4ad6f5c1312c488b8d331c1ecb412800 P eaa6f3dc13d643b9acfd8df1263a456d: Bootstrap starting.
I20260709 13:09:22.218912 30664 tablet_bootstrap.cc:492] T 131d025784b94fe8bab12c27e5176e73 P b1daf23b3538498bb795a60d627b6ac0: Bootstrap starting.
I20260709 13:09:22.232244 30665 ts_tablet_manager.cc:1434] T d6e07afd07294d7d80ca32fa1f97e4a1 P d7def43826924f03b8858383f0dc69f4: Time spent starting tablet: real 0.025s	user 0.007s	sys 0.000s
I20260709 13:09:22.233364 30665 tablet_bootstrap.cc:492] T 687db47721c34eb3918dc02f98170722 P d7def43826924f03b8858383f0dc69f4: Bootstrap starting.
I20260709 13:09:22.236199 30476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "734911241b624e74aadb0e38ed5b0362" candidate_uuid: "d7def43826924f03b8858383f0dc69f4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1daf23b3538498bb795a60d627b6ac0" is_pre_election: true
W20260709 13:09:22.238026 30514 leader_election.cc:343] T 734911241b624e74aadb0e38ed5b0362 P d7def43826924f03b8858383f0dc69f4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b1daf23b3538498bb795a60d627b6ac0 (127.17.223.1:36109): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:22.242596 30664 tablet_bootstrap.cc:654] T 131d025784b94fe8bab12c27e5176e73 P b1daf23b3538498bb795a60d627b6ac0: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:22.243594 30665 tablet_bootstrap.cc:654] T 687db47721c34eb3918dc02f98170722 P d7def43826924f03b8858383f0dc69f4: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:22.246619 30669 tablet_bootstrap.cc:654] T 4ad6f5c1312c488b8d331c1ecb412800 P eaa6f3dc13d643b9acfd8df1263a456d: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:22.246394 30625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "734911241b624e74aadb0e38ed5b0362" candidate_uuid: "d7def43826924f03b8858383f0dc69f4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eaa6f3dc13d643b9acfd8df1263a456d" is_pre_election: true
W20260709 13:09:22.248158 30514 leader_election.cc:343] T 734911241b624e74aadb0e38ed5b0362 P d7def43826924f03b8858383f0dc69f4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer eaa6f3dc13d643b9acfd8df1263a456d (127.17.223.3:41395): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:22.248615 30514 leader_election.cc:304] T 734911241b624e74aadb0e38ed5b0362 P d7def43826924f03b8858383f0dc69f4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d7def43826924f03b8858383f0dc69f4; no voters: b1daf23b3538498bb795a60d627b6ac0, eaa6f3dc13d643b9acfd8df1263a456d
I20260709 13:09:22.249636 30665 tablet_bootstrap.cc:492] T 687db47721c34eb3918dc02f98170722 P d7def43826924f03b8858383f0dc69f4: No bootstrap required, opened a new log
I20260709 13:09:22.249931 30668 raft_consensus.cc:2749] T 734911241b624e74aadb0e38ed5b0362 P d7def43826924f03b8858383f0dc69f4 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:22.250433 30665 ts_tablet_manager.cc:1403] T 687db47721c34eb3918dc02f98170722 P d7def43826924f03b8858383f0dc69f4: Time spent bootstrapping tablet: real 0.017s	user 0.008s	sys 0.004s
I20260709 13:09:22.254343 30665 raft_consensus.cc:359] T 687db47721c34eb3918dc02f98170722 P d7def43826924f03b8858383f0dc69f4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1daf23b3538498bb795a60d627b6ac0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 36109 } } peers { permanent_uuid: "d7def43826924f03b8858383f0dc69f4" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 40053 } } peers { permanent_uuid: "eaa6f3dc13d643b9acfd8df1263a456d" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 41395 } }
I20260709 13:09:22.254985 30665 raft_consensus.cc:385] T 687db47721c34eb3918dc02f98170722 P d7def43826924f03b8858383f0dc69f4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:22.255229 30665 raft_consensus.cc:740] T 687db47721c34eb3918dc02f98170722 P d7def43826924f03b8858383f0dc69f4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d7def43826924f03b8858383f0dc69f4, State: Initialized, Role: FOLLOWER
I20260709 13:09:22.255477 30669 tablet_bootstrap.cc:492] T 4ad6f5c1312c488b8d331c1ecb412800 P eaa6f3dc13d643b9acfd8df1263a456d: No bootstrap required, opened a new log
I20260709 13:09:22.256021 30669 ts_tablet_manager.cc:1403] T 4ad6f5c1312c488b8d331c1ecb412800 P eaa6f3dc13d643b9acfd8df1263a456d: Time spent bootstrapping tablet: real 0.035s	user 0.014s	sys 0.000s
I20260709 13:09:22.256094 30665 consensus_queue.cc:260] T 687db47721c34eb3918dc02f98170722 P d7def43826924f03b8858383f0dc69f4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1daf23b3538498bb795a60d627b6ac0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 36109 } } peers { permanent_uuid: "d7def43826924f03b8858383f0dc69f4" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 40053 } } peers { permanent_uuid: "eaa6f3dc13d643b9acfd8df1263a456d" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 41395 } }
I20260709 13:09:22.256917 30664 tablet_bootstrap.cc:492] T 131d025784b94fe8bab12c27e5176e73 P b1daf23b3538498bb795a60d627b6ac0: No bootstrap required, opened a new log
I20260709 13:09:22.258431 30665 ts_tablet_manager.cc:1434] T 687db47721c34eb3918dc02f98170722 P d7def43826924f03b8858383f0dc69f4: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.000s
I20260709 13:09:22.258416 30669 raft_consensus.cc:359] T 4ad6f5c1312c488b8d331c1ecb412800 P eaa6f3dc13d643b9acfd8df1263a456d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1daf23b3538498bb795a60d627b6ac0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 36109 } } peers { permanent_uuid: "d7def43826924f03b8858383f0dc69f4" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 40053 } } peers { permanent_uuid: "eaa6f3dc13d643b9acfd8df1263a456d" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 41395 } }
I20260709 13:09:22.258991 30664 ts_tablet_manager.cc:1403] T 131d025784b94fe8bab12c27e5176e73 P b1daf23b3538498bb795a60d627b6ac0: Time spent bootstrapping tablet: real 0.040s	user 0.013s	sys 0.005s
I20260709 13:09:22.259238 30669 raft_consensus.cc:385] T 4ad6f5c1312c488b8d331c1ecb412800 P eaa6f3dc13d643b9acfd8df1263a456d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:22.259559 30669 raft_consensus.cc:740] T 4ad6f5c1312c488b8d331c1ecb412800 P eaa6f3dc13d643b9acfd8df1263a456d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eaa6f3dc13d643b9acfd8df1263a456d, State: Initialized, Role: FOLLOWER
I20260709 13:09:22.259660 30665 tablet_bootstrap.cc:492] T f406da2fcdaa4facbd59848fdd5eeeb3 P d7def43826924f03b8858383f0dc69f4: Bootstrap starting.
I20260709 13:09:22.260553 30669 consensus_queue.cc:260] T 4ad6f5c1312c488b8d331c1ecb412800 P eaa6f3dc13d643b9acfd8df1263a456d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1daf23b3538498bb795a60d627b6ac0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 36109 } } peers { permanent_uuid: "d7def43826924f03b8858383f0dc69f4" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 40053 } } peers { permanent_uuid: "eaa6f3dc13d643b9acfd8df1263a456d" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 41395 } }
I20260709 13:09:22.262689 30664 raft_consensus.cc:359] T 131d025784b94fe8bab12c27e5176e73 P b1daf23b3538498bb795a60d627b6ac0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7def43826924f03b8858383f0dc69f4" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 40053 } } peers { permanent_uuid: "b1daf23b3538498bb795a60d627b6ac0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 36109 } } peers { permanent_uuid: "eaa6f3dc13d643b9acfd8df1263a456d" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 41395 } }
I20260709 13:09:22.263761 30664 raft_consensus.cc:385] T 131d025784b94fe8bab12c27e5176e73 P b1daf23b3538498bb795a60d627b6ac0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:22.264199 30664 raft_consensus.cc:740] T 131d025784b94fe8bab12c27e5176e73 P b1daf23b3538498bb795a60d627b6ac0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b1daf23b3538498bb795a60d627b6ac0, State: Initialized, Role: FOLLOWER
I20260709 13:09:22.266306 30664 consensus_queue.cc:260] T 131d025784b94fe8bab12c27e5176e73 P b1daf23b3538498bb795a60d627b6ac0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7def43826924f03b8858383f0dc69f4" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 40053 } } peers { permanent_uuid: "b1daf23b3538498bb795a60d627b6ac0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 36109 } } peers { permanent_uuid: "eaa6f3dc13d643b9acfd8df1263a456d" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 41395 } }
I20260709 13:09:22.266870 30665 tablet_bootstrap.cc:654] T f406da2fcdaa4facbd59848fdd5eeeb3 P d7def43826924f03b8858383f0dc69f4: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:22.268841 30664 ts_tablet_manager.cc:1434] T 131d025784b94fe8bab12c27e5176e73 P b1daf23b3538498bb795a60d627b6ac0: Time spent starting tablet: real 0.009s	user 0.003s	sys 0.003s
I20260709 13:09:22.270282 30664 tablet_bootstrap.cc:492] T ad8233fe86c64f6380f513881e6c3268 P b1daf23b3538498bb795a60d627b6ac0: Bootstrap starting.
I20260709 13:09:22.272658 30669 ts_tablet_manager.cc:1434] T 4ad6f5c1312c488b8d331c1ecb412800 P eaa6f3dc13d643b9acfd8df1263a456d: Time spent starting tablet: real 0.016s	user 0.007s	sys 0.007s
I20260709 13:09:22.273453 30650 heartbeater.cc:499] Master 127.17.223.62:33533 was elected leader, sending a full tablet report...
I20260709 13:09:22.277050 30664 tablet_bootstrap.cc:654] T ad8233fe86c64f6380f513881e6c3268 P b1daf23b3538498bb795a60d627b6ac0: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:22.284543 30669 tablet_bootstrap.cc:492] T f406da2fcdaa4facbd59848fdd5eeeb3 P eaa6f3dc13d643b9acfd8df1263a456d: Bootstrap starting.
I20260709 13:09:22.284997 30665 tablet_bootstrap.cc:492] T f406da2fcdaa4facbd59848fdd5eeeb3 P d7def43826924f03b8858383f0dc69f4: No bootstrap required, opened a new log
I20260709 13:09:22.285562 30665 ts_tablet_manager.cc:1403] T f406da2fcdaa4facbd59848fdd5eeeb3 P d7def43826924f03b8858383f0dc69f4: Time spent bootstrapping tablet: real 0.026s	user 0.017s	sys 0.005s
I20260709 13:09:22.285871 30664 tablet_bootstrap.cc:492] T ad8233fe86c64f6380f513881e6c3268 P b1daf23b3538498bb795a60d627b6ac0: No bootstrap required, opened a new log
I20260709 13:09:22.286393 30664 ts_tablet_manager.cc:1403] T ad8233fe86c64f6380f513881e6c3268 P b1daf23b3538498bb795a60d627b6ac0: Time spent bootstrapping tablet: real 0.016s	user 0.011s	sys 0.003s
I20260709 13:09:22.287353 30668 raft_consensus.cc:493] T d6e07afd07294d7d80ca32fa1f97e4a1 P d7def43826924f03b8858383f0dc69f4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:22.287868 30668 raft_consensus.cc:515] T d6e07afd07294d7d80ca32fa1f97e4a1 P d7def43826924f03b8858383f0dc69f4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1daf23b3538498bb795a60d627b6ac0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 36109 } } peers { permanent_uuid: "d7def43826924f03b8858383f0dc69f4" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 40053 } } peers { permanent_uuid: "eaa6f3dc13d643b9acfd8df1263a456d" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 41395 } }
I20260709 13:09:22.289258 30664 raft_consensus.cc:359] T ad8233fe86c64f6380f513881e6c3268 P b1daf23b3538498bb795a60d627b6ac0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1daf23b3538498bb795a60d627b6ac0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 36109 } } peers { permanent_uuid: "d7def43826924f03b8858383f0dc69f4" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 40053 } } peers { permanent_uuid: "eaa6f3dc13d643b9acfd8df1263a456d" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 41395 } }
I20260709 13:09:22.290019 30664 raft_consensus.cc:385] T ad8233fe86c64f6380f513881e6c3268 P b1daf23b3538498bb795a60d627b6ac0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:22.290328 30664 raft_consensus.cc:740] T ad8233fe86c64f6380f513881e6c3268 P b1daf23b3538498bb795a60d627b6ac0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b1daf23b3538498bb795a60d627b6ac0, State: Initialized, Role: FOLLOWER
I20260709 13:09:22.291124 30664 consensus_queue.cc:260] T ad8233fe86c64f6380f513881e6c3268 P b1daf23b3538498bb795a60d627b6ac0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1daf23b3538498bb795a60d627b6ac0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 36109 } } peers { permanent_uuid: "d7def43826924f03b8858383f0dc69f4" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 40053 } } peers { permanent_uuid: "eaa6f3dc13d643b9acfd8df1263a456d" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 41395 } }
I20260709 13:09:22.291591 30476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6e07afd07294d7d80ca32fa1f97e4a1" candidate_uuid: "d7def43826924f03b8858383f0dc69f4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1daf23b3538498bb795a60d627b6ac0" is_pre_election: true
I20260709 13:09:22.292613 30669 tablet_bootstrap.cc:654] T f406da2fcdaa4facbd59848fdd5eeeb3 P eaa6f3dc13d643b9acfd8df1263a456d: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:22.293251 30625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6e07afd07294d7d80ca32fa1f97e4a1" candidate_uuid: "d7def43826924f03b8858383f0dc69f4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eaa6f3dc13d643b9acfd8df1263a456d" is_pre_election: true
I20260709 13:09:22.293674 30664 ts_tablet_manager.cc:1434] T ad8233fe86c64f6380f513881e6c3268 P b1daf23b3538498bb795a60d627b6ac0: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 13:09:22.294700 30664 tablet_bootstrap.cc:492] T d6e07afd07294d7d80ca32fa1f97e4a1 P b1daf23b3538498bb795a60d627b6ac0: Bootstrap starting.
I20260709 13:09:22.290019 30668 leader_election.cc:290] T d6e07afd07294d7d80ca32fa1f97e4a1 P d7def43826924f03b8858383f0dc69f4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b1daf23b3538498bb795a60d627b6ac0 (127.17.223.1:36109), eaa6f3dc13d643b9acfd8df1263a456d (127.17.223.3:41395)
W20260709 13:09:22.294852 30514 leader_election.cc:343] T d6e07afd07294d7d80ca32fa1f97e4a1 P d7def43826924f03b8858383f0dc69f4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b1daf23b3538498bb795a60d627b6ac0 (127.17.223.1:36109): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:09:22.296454 30514 leader_election.cc:343] T d6e07afd07294d7d80ca32fa1f97e4a1 P d7def43826924f03b8858383f0dc69f4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer eaa6f3dc13d643b9acfd8df1263a456d (127.17.223.3:41395): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:22.296864 30514 leader_election.cc:304] T d6e07afd07294d7d80ca32fa1f97e4a1 P d7def43826924f03b8858383f0dc69f4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d7def43826924f03b8858383f0dc69f4; no voters: b1daf23b3538498bb795a60d627b6ac0, eaa6f3dc13d643b9acfd8df1263a456d
I20260709 13:09:22.297945 30668 raft_consensus.cc:2749] T d6e07afd07294d7d80ca32fa1f97e4a1 P d7def43826924f03b8858383f0dc69f4 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:22.300308 30665 raft_consensus.cc:359] T f406da2fcdaa4facbd59848fdd5eeeb3 P d7def43826924f03b8858383f0dc69f4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1daf23b3538498bb795a60d627b6ac0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 36109 } } peers { permanent_uuid: "d7def43826924f03b8858383f0dc69f4" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 40053 } } peers { permanent_uuid: "eaa6f3dc13d643b9acfd8df1263a456d" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 41395 } }
I20260709 13:09:22.301054 30665 raft_consensus.cc:385] T f406da2fcdaa4facbd59848fdd5eeeb3 P d7def43826924f03b8858383f0dc69f4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:22.301340 30665 raft_consensus.cc:740] T f406da2fcdaa4facbd59848fdd5eeeb3 P d7def43826924f03b8858383f0dc69f4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d7def43826924f03b8858383f0dc69f4, State: Initialized, Role: FOLLOWER
I20260709 13:09:22.301817 30664 tablet_bootstrap.cc:654] T d6e07afd07294d7d80ca32fa1f97e4a1 P b1daf23b3538498bb795a60d627b6ac0: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:22.302213 30665 consensus_queue.cc:260] T f406da2fcdaa4facbd59848fdd5eeeb3 P d7def43826924f03b8858383f0dc69f4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1daf23b3538498bb795a60d627b6ac0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 36109 } } peers { permanent_uuid: "d7def43826924f03b8858383f0dc69f4" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 40053 } } peers { permanent_uuid: "eaa6f3dc13d643b9acfd8df1263a456d" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 41395 } }
I20260709 13:09:22.312088 30665 ts_tablet_manager.cc:1434] T f406da2fcdaa4facbd59848fdd5eeeb3 P d7def43826924f03b8858383f0dc69f4: Time spent starting tablet: real 0.026s	user 0.010s	sys 0.000s
I20260709 13:09:22.313630 30665 tablet_bootstrap.cc:492] T d121c37db92f49c4a789269d64b00a12 P d7def43826924f03b8858383f0dc69f4: Bootstrap starting.
I20260709 13:09:22.322888 30664 tablet_bootstrap.cc:492] T d6e07afd07294d7d80ca32fa1f97e4a1 P b1daf23b3538498bb795a60d627b6ac0: No bootstrap required, opened a new log
I20260709 13:09:22.323064 30665 tablet_bootstrap.cc:654] T d121c37db92f49c4a789269d64b00a12 P d7def43826924f03b8858383f0dc69f4: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:22.323577 30664 ts_tablet_manager.cc:1403] T d6e07afd07294d7d80ca32fa1f97e4a1 P b1daf23b3538498bb795a60d627b6ac0: Time spent bootstrapping tablet: real 0.029s	user 0.016s	sys 0.011s
I20260709 13:09:22.329550 30664 raft_consensus.cc:359] T d6e07afd07294d7d80ca32fa1f97e4a1 P b1daf23b3538498bb795a60d627b6ac0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1daf23b3538498bb795a60d627b6ac0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 36109 } } peers { permanent_uuid: "d7def43826924f03b8858383f0dc69f4" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 40053 } } peers { permanent_uuid: "eaa6f3dc13d643b9acfd8df1263a456d" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 41395 } }
I20260709 13:09:22.330451 30664 raft_consensus.cc:385] T d6e07afd07294d7d80ca32fa1f97e4a1 P b1daf23b3538498bb795a60d627b6ac0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:22.330842 30664 raft_consensus.cc:740] T d6e07afd07294d7d80ca32fa1f97e4a1 P b1daf23b3538498bb795a60d627b6ac0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b1daf23b3538498bb795a60d627b6ac0, State: Initialized, Role: FOLLOWER
I20260709 13:09:22.331070 30669 tablet_bootstrap.cc:492] T f406da2fcdaa4facbd59848fdd5eeeb3 P eaa6f3dc13d643b9acfd8df1263a456d: No bootstrap required, opened a new log
I20260709 13:09:22.331710 30669 ts_tablet_manager.cc:1403] T f406da2fcdaa4facbd59848fdd5eeeb3 P eaa6f3dc13d643b9acfd8df1263a456d: Time spent bootstrapping tablet: real 0.047s	user 0.025s	sys 0.019s
I20260709 13:09:22.331795 30665 tablet_bootstrap.cc:492] T d121c37db92f49c4a789269d64b00a12 P d7def43826924f03b8858383f0dc69f4: No bootstrap required, opened a new log
I20260709 13:09:22.331784 30664 consensus_queue.cc:260] T d6e07afd07294d7d80ca32fa1f97e4a1 P b1daf23b3538498bb795a60d627b6ac0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1daf23b3538498bb795a60d627b6ac0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 36109 } } peers { permanent_uuid: "d7def43826924f03b8858383f0dc69f4" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 40053 } } peers { permanent_uuid: "eaa6f3dc13d643b9acfd8df1263a456d" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 41395 } }
I20260709 13:09:22.332643 30665 ts_tablet_manager.cc:1403] T d121c37db92f49c4a789269d64b00a12 P d7def43826924f03b8858383f0dc69f4: Time spent bootstrapping tablet: real 0.019s	user 0.006s	sys 0.011s
I20260709 13:09:22.334714 30664 ts_tablet_manager.cc:1434] T d6e07afd07294d7d80ca32fa1f97e4a1 P b1daf23b3538498bb795a60d627b6ac0: Time spent starting tablet: real 0.011s	user 0.009s	sys 0.000s
I20260709 13:09:22.335929 30664 tablet_bootstrap.cc:492] T 734911241b624e74aadb0e38ed5b0362 P b1daf23b3538498bb795a60d627b6ac0: Bootstrap starting.
I20260709 13:09:22.336371 30665 raft_consensus.cc:359] T d121c37db92f49c4a789269d64b00a12 P d7def43826924f03b8858383f0dc69f4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1daf23b3538498bb795a60d627b6ac0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 36109 } } peers { permanent_uuid: "d7def43826924f03b8858383f0dc69f4" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 40053 } } peers { permanent_uuid: "eaa6f3dc13d643b9acfd8df1263a456d" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 41395 } }
I20260709 13:09:22.337321 30665 raft_consensus.cc:385] T d121c37db92f49c4a789269d64b00a12 P d7def43826924f03b8858383f0dc69f4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:22.337723 30665 raft_consensus.cc:740] T d121c37db92f49c4a789269d64b00a12 P d7def43826924f03b8858383f0dc69f4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d7def43826924f03b8858383f0dc69f4, State: Initialized, Role: FOLLOWER
I20260709 13:09:22.338902 30665 consensus_queue.cc:260] T d121c37db92f49c4a789269d64b00a12 P d7def43826924f03b8858383f0dc69f4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1daf23b3538498bb795a60d627b6ac0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 36109 } } peers { permanent_uuid: "d7def43826924f03b8858383f0dc69f4" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 40053 } } peers { permanent_uuid: "eaa6f3dc13d643b9acfd8df1263a456d" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 41395 } }
I20260709 13:09:22.337800 30669 raft_consensus.cc:359] T f406da2fcdaa4facbd59848fdd5eeeb3 P eaa6f3dc13d643b9acfd8df1263a456d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1daf23b3538498bb795a60d627b6ac0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 36109 } } peers { permanent_uuid: "d7def43826924f03b8858383f0dc69f4" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 40053 } } peers { permanent_uuid: "eaa6f3dc13d643b9acfd8df1263a456d" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 41395 } }
I20260709 13:09:22.341316 30669 raft_consensus.cc:385] T f406da2fcdaa4facbd59848fdd5eeeb3 P eaa6f3dc13d643b9acfd8df1263a456d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:22.341641 30669 raft_consensus.cc:740] T f406da2fcdaa4facbd59848fdd5eeeb3 P eaa6f3dc13d643b9acfd8df1263a456d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eaa6f3dc13d643b9acfd8df1263a456d, State: Initialized, Role: FOLLOWER
I20260709 13:09:22.342522 30669 consensus_queue.cc:260] T f406da2fcdaa4facbd59848fdd5eeeb3 P eaa6f3dc13d643b9acfd8df1263a456d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1daf23b3538498bb795a60d627b6ac0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 36109 } } peers { permanent_uuid: "d7def43826924f03b8858383f0dc69f4" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 40053 } } peers { permanent_uuid: "eaa6f3dc13d643b9acfd8df1263a456d" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 41395 } }
I20260709 13:09:22.344600 30665 ts_tablet_manager.cc:1434] T d121c37db92f49c4a789269d64b00a12 P d7def43826924f03b8858383f0dc69f4: Time spent starting tablet: real 0.011s	user 0.004s	sys 0.004s
I20260709 13:09:22.345347 30664 tablet_bootstrap.cc:654] T 734911241b624e74aadb0e38ed5b0362 P b1daf23b3538498bb795a60d627b6ac0: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:22.346057 30665 tablet_bootstrap.cc:492] T 17519d8368db4b08a84e4d7335c6fc4f P d7def43826924f03b8858383f0dc69f4: Bootstrap starting.
I20260709 13:09:22.346197 30668 raft_consensus.cc:493] T f406da2fcdaa4facbd59848fdd5eeeb3 P d7def43826924f03b8858383f0dc69f4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:22.346781 30668 raft_consensus.cc:515] T f406da2fcdaa4facbd59848fdd5eeeb3 P d7def43826924f03b8858383f0dc69f4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1daf23b3538498bb795a60d627b6ac0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 36109 } } peers { permanent_uuid: "d7def43826924f03b8858383f0dc69f4" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 40053 } } peers { permanent_uuid: "eaa6f3dc13d643b9acfd8df1263a456d" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 41395 } }
I20260709 13:09:22.347131 30669 ts_tablet_manager.cc:1434] T f406da2fcdaa4facbd59848fdd5eeeb3 P eaa6f3dc13d643b9acfd8df1263a456d: Time spent starting tablet: real 0.015s	user 0.004s	sys 0.004s
I20260709 13:09:22.348513 30669 tablet_bootstrap.cc:492] T ad8233fe86c64f6380f513881e6c3268 P eaa6f3dc13d643b9acfd8df1263a456d: Bootstrap starting.
I20260709 13:09:22.349042 30668 leader_election.cc:290] T f406da2fcdaa4facbd59848fdd5eeeb3 P d7def43826924f03b8858383f0dc69f4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b1daf23b3538498bb795a60d627b6ac0 (127.17.223.1:36109), eaa6f3dc13d643b9acfd8df1263a456d (127.17.223.3:41395)
I20260709 13:09:22.351579 30625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f406da2fcdaa4facbd59848fdd5eeeb3" candidate_uuid: "d7def43826924f03b8858383f0dc69f4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eaa6f3dc13d643b9acfd8df1263a456d" is_pre_election: true
I20260709 13:09:22.352401 30625 raft_consensus.cc:2468] T f406da2fcdaa4facbd59848fdd5eeeb3 P eaa6f3dc13d643b9acfd8df1263a456d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d7def43826924f03b8858383f0dc69f4 in term 0.
I20260709 13:09:22.353845 30476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f406da2fcdaa4facbd59848fdd5eeeb3" candidate_uuid: "d7def43826924f03b8858383f0dc69f4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1daf23b3538498bb795a60d627b6ac0" is_pre_election: true
I20260709 13:09:22.356149 30669 tablet_bootstrap.cc:654] T ad8233fe86c64f6380f513881e6c3268 P eaa6f3dc13d643b9acfd8df1263a456d: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:22.356487 30665 tablet_bootstrap.cc:654] T 17519d8368db4b08a84e4d7335c6fc4f P d7def43826924f03b8858383f0dc69f4: Neither blocks nor log segments found. Creating new log.
W20260709 13:09:22.359918 30514 leader_election.cc:343] T f406da2fcdaa4facbd59848fdd5eeeb3 P d7def43826924f03b8858383f0dc69f4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b1daf23b3538498bb795a60d627b6ac0 (127.17.223.1:36109): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:22.360944 30514 leader_election.cc:304] T f406da2fcdaa4facbd59848fdd5eeeb3 P d7def43826924f03b8858383f0dc69f4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d7def43826924f03b8858383f0dc69f4, eaa6f3dc13d643b9acfd8df1263a456d; no voters: b1daf23b3538498bb795a60d627b6ac0
I20260709 13:09:22.361790 30664 tablet_bootstrap.cc:492] T 734911241b624e74aadb0e38ed5b0362 P b1daf23b3538498bb795a60d627b6ac0: No bootstrap required, opened a new log
I20260709 13:09:22.362329 30664 ts_tablet_manager.cc:1403] T 734911241b624e74aadb0e38ed5b0362 P b1daf23b3538498bb795a60d627b6ac0: Time spent bootstrapping tablet: real 0.027s	user 0.018s	sys 0.004s
I20260709 13:09:22.365626 30668 raft_consensus.cc:2804] T f406da2fcdaa4facbd59848fdd5eeeb3 P d7def43826924f03b8858383f0dc69f4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:22.365517 30664 raft_consensus.cc:359] T 734911241b624e74aadb0e38ed5b0362 P b1daf23b3538498bb795a60d627b6ac0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1daf23b3538498bb795a60d627b6ac0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 36109 } } peers { permanent_uuid: "d7def43826924f03b8858383f0dc69f4" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 40053 } } peers { permanent_uuid: "eaa6f3dc13d643b9acfd8df1263a456d" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 41395 } }
I20260709 13:09:22.366093 30668 raft_consensus.cc:493] T f406da2fcdaa4facbd59848fdd5eeeb3 P d7def43826924f03b8858383f0dc69f4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:22.366294 30664 raft_consensus.cc:385] T 734911241b624e74aadb0e38ed5b0362 P b1daf23b3538498bb795a60d627b6ac0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:22.366539 30668 raft_consensus.cc:3060] T f406da2fcdaa4facbd59848fdd5eeeb3 P d7def43826924f03b8858383f0dc69f4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:22.367689 30664 raft_consensus.cc:740] T 734911241b624e74aadb0e38ed5b0362 P b1daf23b3538498bb795a60d627b6ac0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b1daf23b3538498bb795a60d627b6ac0, State: Initialized, Role: FOLLOWER
I20260709 13:09:22.368757 30664 consensus_queue.cc:260] T 734911241b624e74aadb0e38ed5b0362 P b1daf23b3538498bb795a60d627b6ac0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1daf23b3538498bb795a60d627b6ac0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 36109 } } peers { permanent_uuid: "d7def43826924f03b8858383f0dc69f4" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 40053 } } peers { permanent_uuid: "eaa6f3dc13d643b9acfd8df1263a456d" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 41395 } }
I20260709 13:09:22.369451 30665 tablet_bootstrap.cc:492] T 17519d8368db4b08a84e4d7335c6fc4f P d7def43826924f03b8858383f0dc69f4: No bootstrap required, opened a new log
I20260709 13:09:22.370172 30665 ts_tablet_manager.cc:1403] T 17519d8368db4b08a84e4d7335c6fc4f P d7def43826924f03b8858383f0dc69f4: Time spent bootstrapping tablet: real 0.024s	user 0.016s	sys 0.004s
I20260709 13:09:22.370317 30670 raft_consensus.cc:493] T d6e07afd07294d7d80ca32fa1f97e4a1 P b1daf23b3538498bb795a60d627b6ac0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:22.370915 30670 raft_consensus.cc:515] T d6e07afd07294d7d80ca32fa1f97e4a1 P b1daf23b3538498bb795a60d627b6ac0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1daf23b3538498bb795a60d627b6ac0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 36109 } } peers { permanent_uuid: "d7def43826924f03b8858383f0dc69f4" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 40053 } } peers { permanent_uuid: "eaa6f3dc13d643b9acfd8df1263a456d" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 41395 } }
I20260709 13:09:22.373879 30670 leader_election.cc:290] T d6e07afd07294d7d80ca32fa1f97e4a1 P b1daf23b3538498bb795a60d627b6ac0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d7def43826924f03b8858383f0dc69f4 (127.17.223.2:40053), eaa6f3dc13d643b9acfd8df1263a456d (127.17.223.3:41395)
I20260709 13:09:22.373986 30665 raft_consensus.cc:359] T 17519d8368db4b08a84e4d7335c6fc4f P d7def43826924f03b8858383f0dc69f4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1daf23b3538498bb795a60d627b6ac0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 36109 } } peers { permanent_uuid: "d7def43826924f03b8858383f0dc69f4" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 40053 } } peers { permanent_uuid: "eaa6f3dc13d643b9acfd8df1263a456d" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 41395 } }
I20260709 13:09:22.375759 30665 raft_consensus.cc:385] T 17519d8368db4b08a84e4d7335c6fc4f P d7def43826924f03b8858383f0dc69f4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:22.376191 30665 raft_consensus.cc:740] T 17519d8368db4b08a84e4d7335c6fc4f P d7def43826924f03b8858383f0dc69f4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d7def43826924f03b8858383f0dc69f4, State: Initialized, Role: FOLLOWER
I20260709 13:09:22.377290 30665 consensus_queue.cc:260] T 17519d8368db4b08a84e4d7335c6fc4f P d7def43826924f03b8858383f0dc69f4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1daf23b3538498bb795a60d627b6ac0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 36109 } } peers { permanent_uuid: "d7def43826924f03b8858383f0dc69f4" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 40053 } } peers { permanent_uuid: "eaa6f3dc13d643b9acfd8df1263a456d" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 41395 } }
I20260709 13:09:22.378216 30664 ts_tablet_manager.cc:1434] T 734911241b624e74aadb0e38ed5b0362 P b1daf23b3538498bb795a60d627b6ac0: Time spent starting tablet: real 0.016s	user 0.009s	sys 0.001s
I20260709 13:09:22.379693 30664 tablet_bootstrap.cc:492] T 4ad6f5c1312c488b8d331c1ecb412800 P b1daf23b3538498bb795a60d627b6ac0: Bootstrap starting.
I20260709 13:09:22.388298 30665 ts_tablet_manager.cc:1434] T 17519d8368db4b08a84e4d7335c6fc4f P d7def43826924f03b8858383f0dc69f4: Time spent starting tablet: real 0.018s	user 0.002s	sys 0.011s
I20260709 13:09:22.389635 30665 tablet_bootstrap.cc:492] T ad8233fe86c64f6380f513881e6c3268 P d7def43826924f03b8858383f0dc69f4: Bootstrap starting.
I20260709 13:09:22.388480 30664 tablet_bootstrap.cc:654] T 4ad6f5c1312c488b8d331c1ecb412800 P b1daf23b3538498bb795a60d627b6ac0: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:22.400938 30664 tablet_bootstrap.cc:492] T 4ad6f5c1312c488b8d331c1ecb412800 P b1daf23b3538498bb795a60d627b6ac0: No bootstrap required, opened a new log
I20260709 13:09:22.401525 30664 ts_tablet_manager.cc:1403] T 4ad6f5c1312c488b8d331c1ecb412800 P b1daf23b3538498bb795a60d627b6ac0: Time spent bootstrapping tablet: real 0.022s	user 0.014s	sys 0.000s
I20260709 13:09:22.404793 30664 raft_consensus.cc:359] T 4ad6f5c1312c488b8d331c1ecb412800 P b1daf23b3538498bb795a60d627b6ac0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1daf23b3538498bb795a60d627b6ac0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 36109 } } peers { permanent_uuid: "d7def43826924f03b8858383f0dc69f4" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 40053 } } peers { permanent_uuid: "eaa6f3dc13d643b9acfd8df1263a456d" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 41395 } }
I20260709 13:09:22.405591 30664 raft_consensus.cc:385] T 4ad6f5c1312c488b8d331c1ecb412800 P b1daf23b3538498bb795a60d627b6ac0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:22.405920 30664 raft_consensus.cc:740] T 4ad6f5c1312c488b8d331c1ecb412800 P b1daf23b3538498bb795a60d627b6ac0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b1daf23b3538498bb795a60d627b6ac0, State: Initialized, Role: FOLLOWER
I20260709 13:09:22.406967 30664 consensus_queue.cc:260] T 4ad6f5c1312c488b8d331c1ecb412800 P b1daf23b3538498bb795a60d627b6ac0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1daf23b3538498bb795a60d627b6ac0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 36109 } } peers { permanent_uuid: "d7def43826924f03b8858383f0dc69f4" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 40053 } } peers { permanent_uuid: "eaa6f3dc13d643b9acfd8df1263a456d" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 41395 } }
I20260709 13:09:22.409642 30664 ts_tablet_manager.cc:1434] T 4ad6f5c1312c488b8d331c1ecb412800 P b1daf23b3538498bb795a60d627b6ac0: Time spent starting tablet: real 0.008s	user 0.004s	sys 0.004s
I20260709 13:09:22.410897 30665 tablet_bootstrap.cc:654] T ad8233fe86c64f6380f513881e6c3268 P d7def43826924f03b8858383f0dc69f4: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:22.414515 30664 tablet_bootstrap.cc:492] T f406da2fcdaa4facbd59848fdd5eeeb3 P b1daf23b3538498bb795a60d627b6ac0: Bootstrap starting.
I20260709 13:09:22.419397 30685 raft_consensus.cc:493] T ad8233fe86c64f6380f513881e6c3268 P b1daf23b3538498bb795a60d627b6ac0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:22.420265 30685 raft_consensus.cc:515] T ad8233fe86c64f6380f513881e6c3268 P b1daf23b3538498bb795a60d627b6ac0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1daf23b3538498bb795a60d627b6ac0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 36109 } } peers { permanent_uuid: "d7def43826924f03b8858383f0dc69f4" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 40053 } } peers { permanent_uuid: "eaa6f3dc13d643b9acfd8df1263a456d" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 41395 } }
I20260709 13:09:22.423588 30685 leader_election.cc:290] T ad8233fe86c64f6380f513881e6c3268 P b1daf23b3538498bb795a60d627b6ac0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d7def43826924f03b8858383f0dc69f4 (127.17.223.2:40053), eaa6f3dc13d643b9acfd8df1263a456d (127.17.223.3:41395)
I20260709 13:09:22.429102 30664 tablet_bootstrap.cc:654] T f406da2fcdaa4facbd59848fdd5eeeb3 P b1daf23b3538498bb795a60d627b6ac0: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:22.435092 30669 tablet_bootstrap.cc:492] T ad8233fe86c64f6380f513881e6c3268 P eaa6f3dc13d643b9acfd8df1263a456d: No bootstrap required, opened a new log
I20260709 13:09:22.435380 30664 tablet_bootstrap.cc:492] T f406da2fcdaa4facbd59848fdd5eeeb3 P b1daf23b3538498bb795a60d627b6ac0: No bootstrap required, opened a new log
I20260709 13:09:22.435644 30669 ts_tablet_manager.cc:1403] T ad8233fe86c64f6380f513881e6c3268 P eaa6f3dc13d643b9acfd8df1263a456d: Time spent bootstrapping tablet: real 0.087s	user 0.025s	sys 0.037s
I20260709 13:09:22.435902 30664 ts_tablet_manager.cc:1403] T f406da2fcdaa4facbd59848fdd5eeeb3 P b1daf23b3538498bb795a60d627b6ac0: Time spent bootstrapping tablet: real 0.022s	user 0.010s	sys 0.003s
I20260709 13:09:22.439225 30664 raft_consensus.cc:359] T f406da2fcdaa4facbd59848fdd5eeeb3 P b1daf23b3538498bb795a60d627b6ac0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1daf23b3538498bb795a60d627b6ac0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 36109 } } peers { permanent_uuid: "d7def43826924f03b8858383f0dc69f4" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 40053 } } peers { permanent_uuid: "eaa6f3dc13d643b9acfd8df1263a456d" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 41395 } }
I20260709 13:09:22.423986 30668 raft_consensus.cc:515] T f406da2fcdaa4facbd59848fdd5eeeb3 P d7def43826924f03b8858383f0dc69f4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1daf23b3538498bb795a60d627b6ac0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 36109 } } peers { permanent_uuid: "d7def43826924f03b8858383f0dc69f4" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 40053 } } peers { permanent_uuid: "eaa6f3dc13d643b9acfd8df1263a456d" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 41395 } }
I20260709 13:09:22.440080 30664 raft_consensus.cc:385] T f406da2fcdaa4facbd59848fdd5eeeb3 P b1daf23b3538498bb795a60d627b6ac0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:22.440838 30625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6e07afd07294d7d80ca32fa1f97e4a1" candidate_uuid: "b1daf23b3538498bb795a60d627b6ac0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eaa6f3dc13d643b9acfd8df1263a456d" is_pre_election: true
I20260709 13:09:22.441322 30624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad8233fe86c64f6380f513881e6c3268" candidate_uuid: "b1daf23b3538498bb795a60d627b6ac0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eaa6f3dc13d643b9acfd8df1263a456d" is_pre_election: true
I20260709 13:09:22.438963 30669 raft_consensus.cc:359] T ad8233fe86c64f6380f513881e6c3268 P eaa6f3dc13d643b9acfd8df1263a456d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1daf23b3538498bb795a60d627b6ac0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 36109 } } peers { permanent_uuid: "d7def43826924f03b8858383f0dc69f4" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 40053 } } peers { permanent_uuid: "eaa6f3dc13d643b9acfd8df1263a456d" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 41395 } }
W20260709 13:09:22.442497 30439 leader_election.cc:343] T d6e07afd07294d7d80ca32fa1f97e4a1 P b1daf23b3538498bb795a60d627b6ac0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer eaa6f3dc13d643b9acfd8df1263a456d (127.17.223.3:41395): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:22.442906 30669 raft_consensus.cc:385] T ad8233fe86c64f6380f513881e6c3268 P eaa6f3dc13d643b9acfd8df1263a456d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:22.440433 30664 raft_consensus.cc:740] T f406da2fcdaa4facbd59848fdd5eeeb3 P b1daf23b3538498bb795a60d627b6ac0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b1daf23b3538498bb795a60d627b6ac0, State: Initialized, Role: FOLLOWER
I20260709 13:09:22.443228 30669 raft_consensus.cc:740] T ad8233fe86c64f6380f513881e6c3268 P eaa6f3dc13d643b9acfd8df1263a456d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eaa6f3dc13d643b9acfd8df1263a456d, State: Initialized, Role: FOLLOWER
I20260709 13:09:22.444133 30664 consensus_queue.cc:260] T f406da2fcdaa4facbd59848fdd5eeeb3 P b1daf23b3538498bb795a60d627b6ac0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1daf23b3538498bb795a60d627b6ac0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 36109 } } peers { permanent_uuid: "d7def43826924f03b8858383f0dc69f4" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 40053 } } peers { permanent_uuid: "eaa6f3dc13d643b9acfd8df1263a456d" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 41395 } }
I20260709 13:09:22.444188 30669 consensus_queue.cc:260] T ad8233fe86c64f6380f513881e6c3268 P eaa6f3dc13d643b9acfd8df1263a456d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1daf23b3538498bb795a60d627b6ac0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 36109 } } peers { permanent_uuid: "d7def43826924f03b8858383f0dc69f4" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 40053 } } peers { permanent_uuid: "eaa6f3dc13d643b9acfd8df1263a456d" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 41395 } }
I20260709 13:09:22.445302 30624 raft_consensus.cc:2468] T ad8233fe86c64f6380f513881e6c3268 P eaa6f3dc13d643b9acfd8df1263a456d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1daf23b3538498bb795a60d627b6ac0 in term 0.
I20260709 13:09:22.449170 30439 leader_election.cc:304] T ad8233fe86c64f6380f513881e6c3268 P b1daf23b3538498bb795a60d627b6ac0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b1daf23b3538498bb795a60d627b6ac0, eaa6f3dc13d643b9acfd8df1263a456d; no voters: 
I20260709 13:09:22.449405 30664 ts_tablet_manager.cc:1434] T f406da2fcdaa4facbd59848fdd5eeeb3 P b1daf23b3538498bb795a60d627b6ac0: Time spent starting tablet: real 0.013s	user 0.008s	sys 0.000s
W20260709 13:09:22.450093 30422 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:09:22.450316 30685 raft_consensus.cc:2804] T ad8233fe86c64f6380f513881e6c3268 P b1daf23b3538498bb795a60d627b6ac0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:22.450749 30664 tablet_bootstrap.cc:492] T 17519d8368db4b08a84e4d7335c6fc4f P b1daf23b3538498bb795a60d627b6ac0: Bootstrap starting.
I20260709 13:09:22.450819 30685 raft_consensus.cc:493] T ad8233fe86c64f6380f513881e6c3268 P b1daf23b3538498bb795a60d627b6ac0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:22.451392 30685 raft_consensus.cc:3060] T ad8233fe86c64f6380f513881e6c3268 P b1daf23b3538498bb795a60d627b6ac0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:22.457970 30664 tablet_bootstrap.cc:654] T 17519d8368db4b08a84e4d7335c6fc4f P b1daf23b3538498bb795a60d627b6ac0: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:22.459612 30685 raft_consensus.cc:515] T ad8233fe86c64f6380f513881e6c3268 P b1daf23b3538498bb795a60d627b6ac0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1daf23b3538498bb795a60d627b6ac0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 36109 } } peers { permanent_uuid: "d7def43826924f03b8858383f0dc69f4" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 40053 } } peers { permanent_uuid: "eaa6f3dc13d643b9acfd8df1263a456d" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 41395 } }
I20260709 13:09:22.464345 30665 tablet_bootstrap.cc:492] T ad8233fe86c64f6380f513881e6c3268 P d7def43826924f03b8858383f0dc69f4: No bootstrap required, opened a new log
I20260709 13:09:22.465081 30665 ts_tablet_manager.cc:1403] T ad8233fe86c64f6380f513881e6c3268 P d7def43826924f03b8858383f0dc69f4: Time spent bootstrapping tablet: real 0.076s	user 0.019s	sys 0.041s
I20260709 13:09:22.468593 30665 raft_consensus.cc:359] T ad8233fe86c64f6380f513881e6c3268 P d7def43826924f03b8858383f0dc69f4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1daf23b3538498bb795a60d627b6ac0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 36109 } } peers { permanent_uuid: "d7def43826924f03b8858383f0dc69f4" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 40053 } } peers { permanent_uuid: "eaa6f3dc13d643b9acfd8df1263a456d" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 41395 } }
I20260709 13:09:22.469612 30665 raft_consensus.cc:385] T ad8233fe86c64f6380f513881e6c3268 P d7def43826924f03b8858383f0dc69f4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:22.470010 30665 raft_consensus.cc:740] T ad8233fe86c64f6380f513881e6c3268 P d7def43826924f03b8858383f0dc69f4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d7def43826924f03b8858383f0dc69f4, State: Initialized, Role: FOLLOWER
I20260709 13:09:22.471019 30665 consensus_queue.cc:260] T ad8233fe86c64f6380f513881e6c3268 P d7def43826924f03b8858383f0dc69f4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1daf23b3538498bb795a60d627b6ac0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 36109 } } peers { permanent_uuid: "d7def43826924f03b8858383f0dc69f4" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 40053 } } peers { permanent_uuid: "eaa6f3dc13d643b9acfd8df1263a456d" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 41395 } }
I20260709 13:09:22.471598 30476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f406da2fcdaa4facbd59848fdd5eeeb3" candidate_uuid: "d7def43826924f03b8858383f0dc69f4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1daf23b3538498bb795a60d627b6ac0"
I20260709 13:09:22.472362 30476 raft_consensus.cc:3060] T f406da2fcdaa4facbd59848fdd5eeeb3 P b1daf23b3538498bb795a60d627b6ac0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:22.473331 30669 ts_tablet_manager.cc:1434] T ad8233fe86c64f6380f513881e6c3268 P eaa6f3dc13d643b9acfd8df1263a456d: Time spent starting tablet: real 0.037s	user 0.007s	sys 0.000s
I20260709 13:09:22.474895 30664 tablet_bootstrap.cc:492] T 17519d8368db4b08a84e4d7335c6fc4f P b1daf23b3538498bb795a60d627b6ac0: No bootstrap required, opened a new log
I20260709 13:09:22.475469 30664 ts_tablet_manager.cc:1403] T 17519d8368db4b08a84e4d7335c6fc4f P b1daf23b3538498bb795a60d627b6ac0: Time spent bootstrapping tablet: real 0.025s	user 0.013s	sys 0.011s
I20260709 13:09:22.477839 30665 ts_tablet_manager.cc:1434] T ad8233fe86c64f6380f513881e6c3268 P d7def43826924f03b8858383f0dc69f4: Time spent starting tablet: real 0.012s	user 0.006s	sys 0.001s
I20260709 13:09:22.478507 30664 raft_consensus.cc:359] T 17519d8368db4b08a84e4d7335c6fc4f P b1daf23b3538498bb795a60d627b6ac0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1daf23b3538498bb795a60d627b6ac0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 36109 } } peers { permanent_uuid: "d7def43826924f03b8858383f0dc69f4" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 40053 } } peers { permanent_uuid: "eaa6f3dc13d643b9acfd8df1263a456d" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 41395 } }
I20260709 13:09:22.479084 30665 tablet_bootstrap.cc:492] T 131d025784b94fe8bab12c27e5176e73 P d7def43826924f03b8858383f0dc69f4: Bootstrap starting.
I20260709 13:09:22.479422 30664 raft_consensus.cc:385] T 17519d8368db4b08a84e4d7335c6fc4f P b1daf23b3538498bb795a60d627b6ac0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:22.479805 30664 raft_consensus.cc:740] T 17519d8368db4b08a84e4d7335c6fc4f P b1daf23b3538498bb795a60d627b6ac0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b1daf23b3538498bb795a60d627b6ac0, State: Initialized, Role: FOLLOWER
I20260709 13:09:22.480659 30664 consensus_queue.cc:260] T 17519d8368db4b08a84e4d7335c6fc4f P b1daf23b3538498bb795a60d627b6ac0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1daf23b3538498bb795a60d627b6ac0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 36109 } } peers { permanent_uuid: "d7def43826924f03b8858383f0dc69f4" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 40053 } } peers { permanent_uuid: "eaa6f3dc13d643b9acfd8df1263a456d" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 41395 } }
I20260709 13:09:22.481949 30685 leader_election.cc:290] T ad8233fe86c64f6380f513881e6c3268 P b1daf23b3538498bb795a60d627b6ac0 [CANDIDATE]: Term 1 election: Requested vote from peers d7def43826924f03b8858383f0dc69f4 (127.17.223.2:40053), eaa6f3dc13d643b9acfd8df1263a456d (127.17.223.3:41395)
I20260709 13:09:22.481142 30669 tablet_bootstrap.cc:492] T d121c37db92f49c4a789269d64b00a12 P eaa6f3dc13d643b9acfd8df1263a456d: Bootstrap starting.
I20260709 13:09:22.482852 30686 raft_consensus.cc:493] T 17519d8368db4b08a84e4d7335c6fc4f P d7def43826924f03b8858383f0dc69f4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:22.483153 30624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad8233fe86c64f6380f513881e6c3268" candidate_uuid: "b1daf23b3538498bb795a60d627b6ac0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eaa6f3dc13d643b9acfd8df1263a456d"
I20260709 13:09:22.483445 30686 raft_consensus.cc:515] T 17519d8368db4b08a84e4d7335c6fc4f P d7def43826924f03b8858383f0dc69f4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1daf23b3538498bb795a60d627b6ac0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 36109 } } peers { permanent_uuid: "d7def43826924f03b8858383f0dc69f4" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 40053 } } peers { permanent_uuid: "eaa6f3dc13d643b9acfd8df1263a456d" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 41395 } }
I20260709 13:09:22.483867 30624 raft_consensus.cc:3060] T ad8233fe86c64f6380f513881e6c3268 P eaa6f3dc13d643b9acfd8df1263a456d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:22.485422 30664 ts_tablet_manager.cc:1434] T 17519d8368db4b08a84e4d7335c6fc4f P b1daf23b3538498bb795a60d627b6ac0: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.000s
I20260709 13:09:22.485868 30686 leader_election.cc:290] T 17519d8368db4b08a84e4d7335c6fc4f P d7def43826924f03b8858383f0dc69f4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b1daf23b3538498bb795a60d627b6ac0 (127.17.223.1:36109), eaa6f3dc13d643b9acfd8df1263a456d (127.17.223.3:41395)
I20260709 13:09:22.486646 30664 tablet_bootstrap.cc:492] T 687db47721c34eb3918dc02f98170722 P b1daf23b3538498bb795a60d627b6ac0: Bootstrap starting.
I20260709 13:09:22.488054 30625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17519d8368db4b08a84e4d7335c6fc4f" candidate_uuid: "d7def43826924f03b8858383f0dc69f4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eaa6f3dc13d643b9acfd8df1263a456d" is_pre_election: true
I20260709 13:09:22.489307 30669 tablet_bootstrap.cc:654] T d121c37db92f49c4a789269d64b00a12 P eaa6f3dc13d643b9acfd8df1263a456d: Neither blocks nor log segments found. Creating new log.
W20260709 13:09:22.489727 30514 leader_election.cc:343] T 17519d8368db4b08a84e4d7335c6fc4f P d7def43826924f03b8858383f0dc69f4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer eaa6f3dc13d643b9acfd8df1263a456d (127.17.223.3:41395): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:22.491878 30475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17519d8368db4b08a84e4d7335c6fc4f" candidate_uuid: "d7def43826924f03b8858383f0dc69f4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1daf23b3538498bb795a60d627b6ac0" is_pre_election: true
I20260709 13:09:22.492731 30475 raft_consensus.cc:2468] T 17519d8368db4b08a84e4d7335c6fc4f P b1daf23b3538498bb795a60d627b6ac0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d7def43826924f03b8858383f0dc69f4 in term 0.
I20260709 13:09:22.493950 30514 leader_election.cc:304] T 17519d8368db4b08a84e4d7335c6fc4f P d7def43826924f03b8858383f0dc69f4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b1daf23b3538498bb795a60d627b6ac0, d7def43826924f03b8858383f0dc69f4; no voters: eaa6f3dc13d643b9acfd8df1263a456d
I20260709 13:09:22.495139 30665 tablet_bootstrap.cc:654] T 131d025784b94fe8bab12c27e5176e73 P d7def43826924f03b8858383f0dc69f4: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:22.495674 30686 raft_consensus.cc:2804] T 17519d8368db4b08a84e4d7335c6fc4f P d7def43826924f03b8858383f0dc69f4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:22.496258 30686 raft_consensus.cc:493] T 17519d8368db4b08a84e4d7335c6fc4f P d7def43826924f03b8858383f0dc69f4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:22.496658 30686 raft_consensus.cc:3060] T 17519d8368db4b08a84e4d7335c6fc4f P d7def43826924f03b8858383f0dc69f4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:22.501094 30669 tablet_bootstrap.cc:492] T d121c37db92f49c4a789269d64b00a12 P eaa6f3dc13d643b9acfd8df1263a456d: No bootstrap required, opened a new log
I20260709 13:09:22.501662 30669 ts_tablet_manager.cc:1403] T d121c37db92f49c4a789269d64b00a12 P eaa6f3dc13d643b9acfd8df1263a456d: Time spent bootstrapping tablet: real 0.021s	user 0.013s	sys 0.004s
I20260709 13:09:22.504922 30669 raft_consensus.cc:359] T d121c37db92f49c4a789269d64b00a12 P eaa6f3dc13d643b9acfd8df1263a456d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1daf23b3538498bb795a60d627b6ac0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 36109 } } peers { permanent_uuid: "d7def43826924f03b8858383f0dc69f4" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 40053 } } peers { permanent_uuid: "eaa6f3dc13d643b9acfd8df1263a456d" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 41395 } }
I20260709 13:09:22.493922 30664 tablet_bootstrap.cc:654] T 687db47721c34eb3918dc02f98170722 P b1daf23b3538498bb795a60d627b6ac0: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:22.505726 30669 raft_consensus.cc:385] T d121c37db92f49c4a789269d64b00a12 P eaa6f3dc13d643b9acfd8df1263a456d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:22.505795 30624 raft_consensus.cc:2468] T ad8233fe86c64f6380f513881e6c3268 P eaa6f3dc13d643b9acfd8df1263a456d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b1daf23b3538498bb795a60d627b6ac0 in term 1.
I20260709 13:09:22.506210 30669 raft_consensus.cc:740] T d121c37db92f49c4a789269d64b00a12 P eaa6f3dc13d643b9acfd8df1263a456d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eaa6f3dc13d643b9acfd8df1263a456d, State: Initialized, Role: FOLLOWER
I20260709 13:09:22.507390 30669 consensus_queue.cc:260] T d121c37db92f49c4a789269d64b00a12 P eaa6f3dc13d643b9acfd8df1263a456d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1daf23b3538498bb795a60d627b6ac0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 36109 } } peers { permanent_uuid: "d7def43826924f03b8858383f0dc69f4" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 40053 } } peers { permanent_uuid: "eaa6f3dc13d643b9acfd8df1263a456d" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 41395 } }
I20260709 13:09:22.505290 30686 raft_consensus.cc:515] T 17519d8368db4b08a84e4d7335c6fc4f P d7def43826924f03b8858383f0dc69f4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1daf23b3538498bb795a60d627b6ac0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 36109 } } peers { permanent_uuid: "d7def43826924f03b8858383f0dc69f4" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 40053 } } peers { permanent_uuid: "eaa6f3dc13d643b9acfd8df1263a456d" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 41395 } }
I20260709 13:09:22.510759 30475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17519d8368db4b08a84e4d7335c6fc4f" candidate_uuid: "d7def43826924f03b8858383f0dc69f4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1daf23b3538498bb795a60d627b6ac0"
I20260709 13:09:22.511315 30475 raft_consensus.cc:3060] T 17519d8368db4b08a84e4d7335c6fc4f P b1daf23b3538498bb795a60d627b6ac0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:22.511463 30665 tablet_bootstrap.cc:492] T 131d025784b94fe8bab12c27e5176e73 P d7def43826924f03b8858383f0dc69f4: No bootstrap required, opened a new log
I20260709 13:09:22.512002 30665 ts_tablet_manager.cc:1403] T 131d025784b94fe8bab12c27e5176e73 P d7def43826924f03b8858383f0dc69f4: Time spent bootstrapping tablet: real 0.033s	user 0.014s	sys 0.004s
I20260709 13:09:22.512331 30625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17519d8368db4b08a84e4d7335c6fc4f" candidate_uuid: "d7def43826924f03b8858383f0dc69f4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eaa6f3dc13d643b9acfd8df1263a456d"
I20260709 13:09:22.513664 30669 ts_tablet_manager.cc:1434] T d121c37db92f49c4a789269d64b00a12 P eaa6f3dc13d643b9acfd8df1263a456d: Time spent starting tablet: real 0.012s	user 0.008s	sys 0.000s
W20260709 13:09:22.513823 30514 leader_election.cc:343] T 17519d8368db4b08a84e4d7335c6fc4f P d7def43826924f03b8858383f0dc69f4 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer eaa6f3dc13d643b9acfd8df1263a456d (127.17.223.3:41395): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:22.514451 30686 leader_election.cc:290] T 17519d8368db4b08a84e4d7335c6fc4f P d7def43826924f03b8858383f0dc69f4 [CANDIDATE]: Term 1 election: Requested vote from peers b1daf23b3538498bb795a60d627b6ac0 (127.17.223.1:36109), eaa6f3dc13d643b9acfd8df1263a456d (127.17.223.3:41395)
I20260709 13:09:22.514786 30669 tablet_bootstrap.cc:492] T 131d025784b94fe8bab12c27e5176e73 P eaa6f3dc13d643b9acfd8df1263a456d: Bootstrap starting.
I20260709 13:09:22.514948 30685 raft_consensus.cc:493] T d121c37db92f49c4a789269d64b00a12 P b1daf23b3538498bb795a60d627b6ac0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:22.514856 30665 raft_consensus.cc:359] T 131d025784b94fe8bab12c27e5176e73 P d7def43826924f03b8858383f0dc69f4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7def43826924f03b8858383f0dc69f4" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 40053 } } peers { permanent_uuid: "b1daf23b3538498bb795a60d627b6ac0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 36109 } } peers { permanent_uuid: "eaa6f3dc13d643b9acfd8df1263a456d" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 41395 } }
I20260709 13:09:22.515810 30665 raft_consensus.cc:385] T 131d025784b94fe8bab12c27e5176e73 P d7def43826924f03b8858383f0dc69f4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:22.515585 30685 raft_consensus.cc:515] T d121c37db92f49c4a789269d64b00a12 P b1daf23b3538498bb795a60d627b6ac0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1daf23b3538498bb795a60d627b6ac0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 36109 } } peers { permanent_uuid: "d7def43826924f03b8858383f0dc69f4" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 40053 } } peers { permanent_uuid: "eaa6f3dc13d643b9acfd8df1263a456d" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 41395 } }
I20260709 13:09:22.516124 30665 raft_consensus.cc:740] T 131d025784b94fe8bab12c27e5176e73 P d7def43826924f03b8858383f0dc69f4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d7def43826924f03b8858383f0dc69f4, State: Initialized, Role: FOLLOWER
I20260709 13:09:22.516841 30665 consensus_queue.cc:260] T 131d025784b94fe8bab12c27e5176e73 P d7def43826924f03b8858383f0dc69f4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7def43826924f03b8858383f0dc69f4" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 40053 } } peers { permanent_uuid: "b1daf23b3538498bb795a60d627b6ac0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 36109 } } peers { permanent_uuid: "eaa6f3dc13d643b9acfd8df1263a456d" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 41395 } }
I20260709 13:09:22.517634 30685 leader_election.cc:290] T d121c37db92f49c4a789269d64b00a12 P b1daf23b3538498bb795a60d627b6ac0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d7def43826924f03b8858383f0dc69f4 (127.17.223.2:40053), eaa6f3dc13d643b9acfd8df1263a456d (127.17.223.3:41395)
I20260709 13:09:22.518982 30665 ts_tablet_manager.cc:1434] T 131d025784b94fe8bab12c27e5176e73 P d7def43826924f03b8858383f0dc69f4: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 13:09:22.519457 30625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d121c37db92f49c4a789269d64b00a12" candidate_uuid: "b1daf23b3538498bb795a60d627b6ac0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eaa6f3dc13d643b9acfd8df1263a456d" is_pre_election: true
I20260709 13:09:22.519951 30665 tablet_bootstrap.cc:492] T 4ad6f5c1312c488b8d331c1ecb412800 P d7def43826924f03b8858383f0dc69f4: Bootstrap starting.
I20260709 13:09:22.521095 30664 tablet_bootstrap.cc:492] T 687db47721c34eb3918dc02f98170722 P b1daf23b3538498bb795a60d627b6ac0: No bootstrap required, opened a new log
I20260709 13:09:22.521193 30685 raft_consensus.cc:493] T 131d025784b94fe8bab12c27e5176e73 P b1daf23b3538498bb795a60d627b6ac0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:22.521749 30664 ts_tablet_manager.cc:1403] T 687db47721c34eb3918dc02f98170722 P b1daf23b3538498bb795a60d627b6ac0: Time spent bootstrapping tablet: real 0.035s	user 0.007s	sys 0.008s
I20260709 13:09:22.521718 30685 raft_consensus.cc:515] T 131d025784b94fe8bab12c27e5176e73 P b1daf23b3538498bb795a60d627b6ac0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7def43826924f03b8858383f0dc69f4" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 40053 } } peers { permanent_uuid: "b1daf23b3538498bb795a60d627b6ac0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 36109 } } peers { permanent_uuid: "eaa6f3dc13d643b9acfd8df1263a456d" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 41395 } }
I20260709 13:09:22.520097 30625 raft_consensus.cc:2468] T d121c37db92f49c4a789269d64b00a12 P eaa6f3dc13d643b9acfd8df1263a456d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1daf23b3538498bb795a60d627b6ac0 in term 0.
I20260709 13:09:22.523865 30685 leader_election.cc:290] T 131d025784b94fe8bab12c27e5176e73 P b1daf23b3538498bb795a60d627b6ac0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d7def43826924f03b8858383f0dc69f4 (127.17.223.2:40053), eaa6f3dc13d643b9acfd8df1263a456d (127.17.223.3:41395)
I20260709 13:09:22.524962 30664 raft_consensus.cc:359] T 687db47721c34eb3918dc02f98170722 P b1daf23b3538498bb795a60d627b6ac0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1daf23b3538498bb795a60d627b6ac0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 36109 } } peers { permanent_uuid: "d7def43826924f03b8858383f0dc69f4" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 40053 } } peers { permanent_uuid: "eaa6f3dc13d643b9acfd8df1263a456d" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 41395 } }
I20260709 13:09:22.525756 30664 raft_consensus.cc:385] T 687db47721c34eb3918dc02f98170722 P b1daf23b3538498bb795a60d627b6ac0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:22.526086 30664 raft_consensus.cc:740] T 687db47721c34eb3918dc02f98170722 P b1daf23b3538498bb795a60d627b6ac0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b1daf23b3538498bb795a60d627b6ac0, State: Initialized, Role: FOLLOWER
I20260709 13:09:22.526245 30669 tablet_bootstrap.cc:654] T 131d025784b94fe8bab12c27e5176e73 P eaa6f3dc13d643b9acfd8df1263a456d: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:22.526459 30665 tablet_bootstrap.cc:654] T 4ad6f5c1312c488b8d331c1ecb412800 P d7def43826924f03b8858383f0dc69f4: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:22.526489 30625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "131d025784b94fe8bab12c27e5176e73" candidate_uuid: "b1daf23b3538498bb795a60d627b6ac0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eaa6f3dc13d643b9acfd8df1263a456d" is_pre_election: true
I20260709 13:09:22.527123 30664 consensus_queue.cc:260] T 687db47721c34eb3918dc02f98170722 P b1daf23b3538498bb795a60d627b6ac0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1daf23b3538498bb795a60d627b6ac0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 36109 } } peers { permanent_uuid: "d7def43826924f03b8858383f0dc69f4" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 40053 } } peers { permanent_uuid: "eaa6f3dc13d643b9acfd8df1263a456d" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 41395 } }
I20260709 13:09:22.528427 30439 leader_election.cc:304] T d121c37db92f49c4a789269d64b00a12 P b1daf23b3538498bb795a60d627b6ac0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b1daf23b3538498bb795a60d627b6ac0, eaa6f3dc13d643b9acfd8df1263a456d; no voters: 
I20260709 13:09:22.529340 30664 ts_tablet_manager.cc:1434] T 687db47721c34eb3918dc02f98170722 P b1daf23b3538498bb795a60d627b6ac0: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.001s
I20260709 13:09:22.529254 30670 raft_consensus.cc:2804] T d121c37db92f49c4a789269d64b00a12 P b1daf23b3538498bb795a60d627b6ac0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:22.529911 30670 raft_consensus.cc:493] T d121c37db92f49c4a789269d64b00a12 P b1daf23b3538498bb795a60d627b6ac0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:22.530409 30670 raft_consensus.cc:3060] T d121c37db92f49c4a789269d64b00a12 P b1daf23b3538498bb795a60d627b6ac0 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:09:22.535211 30439 leader_election.cc:343] T 131d025784b94fe8bab12c27e5176e73 P b1daf23b3538498bb795a60d627b6ac0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer eaa6f3dc13d643b9acfd8df1263a456d (127.17.223.3:41395): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:22.540360 30669 tablet_bootstrap.cc:492] T 131d025784b94fe8bab12c27e5176e73 P eaa6f3dc13d643b9acfd8df1263a456d: No bootstrap required, opened a new log
I20260709 13:09:22.541005 30669 ts_tablet_manager.cc:1403] T 131d025784b94fe8bab12c27e5176e73 P eaa6f3dc13d643b9acfd8df1263a456d: Time spent bootstrapping tablet: real 0.026s	user 0.014s	sys 0.003s
I20260709 13:09:22.542590 30475 raft_consensus.cc:2468] T 17519d8368db4b08a84e4d7335c6fc4f P b1daf23b3538498bb795a60d627b6ac0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d7def43826924f03b8858383f0dc69f4 in term 1.
I20260709 13:09:22.544217 30669 raft_consensus.cc:359] T 131d025784b94fe8bab12c27e5176e73 P eaa6f3dc13d643b9acfd8df1263a456d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7def43826924f03b8858383f0dc69f4" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 40053 } } peers { permanent_uuid: "b1daf23b3538498bb795a60d627b6ac0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 36109 } } peers { permanent_uuid: "eaa6f3dc13d643b9acfd8df1263a456d" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 41395 } }
I20260709 13:09:22.544842 30669 raft_consensus.cc:385] T 131d025784b94fe8bab12c27e5176e73 P eaa6f3dc13d643b9acfd8df1263a456d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:22.545054 30668 leader_election.cc:290] T f406da2fcdaa4facbd59848fdd5eeeb3 P d7def43826924f03b8858383f0dc69f4 [CANDIDATE]: Term 1 election: Requested vote from peers b1daf23b3538498bb795a60d627b6ac0 (127.17.223.1:36109), eaa6f3dc13d643b9acfd8df1263a456d (127.17.223.3:41395)
I20260709 13:09:22.545099 30669 raft_consensus.cc:740] T 131d025784b94fe8bab12c27e5176e73 P eaa6f3dc13d643b9acfd8df1263a456d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eaa6f3dc13d643b9acfd8df1263a456d, State: Initialized, Role: FOLLOWER
I20260709 13:09:22.546300 30625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f406da2fcdaa4facbd59848fdd5eeeb3" candidate_uuid: "d7def43826924f03b8858383f0dc69f4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eaa6f3dc13d643b9acfd8df1263a456d"
I20260709 13:09:22.546345 30669 consensus_queue.cc:260] T 131d025784b94fe8bab12c27e5176e73 P eaa6f3dc13d643b9acfd8df1263a456d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7def43826924f03b8858383f0dc69f4" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 40053 } } peers { permanent_uuid: "b1daf23b3538498bb795a60d627b6ac0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 36109 } } peers { permanent_uuid: "eaa6f3dc13d643b9acfd8df1263a456d" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 41395 } }
I20260709 13:09:22.547183 30514 leader_election.cc:304] T 17519d8368db4b08a84e4d7335c6fc4f P d7def43826924f03b8858383f0dc69f4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b1daf23b3538498bb795a60d627b6ac0, d7def43826924f03b8858383f0dc69f4; no voters: eaa6f3dc13d643b9acfd8df1263a456d
I20260709 13:09:22.547425 30625 raft_consensus.cc:3060] T f406da2fcdaa4facbd59848fdd5eeeb3 P eaa6f3dc13d643b9acfd8df1263a456d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:22.548765 30686 raft_consensus.cc:2804] T 17519d8368db4b08a84e4d7335c6fc4f P d7def43826924f03b8858383f0dc69f4 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:22.549113 30669 ts_tablet_manager.cc:1434] T 131d025784b94fe8bab12c27e5176e73 P eaa6f3dc13d643b9acfd8df1263a456d: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 13:09:22.550351 30669 tablet_bootstrap.cc:492] T 687db47721c34eb3918dc02f98170722 P eaa6f3dc13d643b9acfd8df1263a456d: Bootstrap starting.
I20260709 13:09:22.555943 30476 raft_consensus.cc:2468] T f406da2fcdaa4facbd59848fdd5eeeb3 P b1daf23b3538498bb795a60d627b6ac0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d7def43826924f03b8858383f0dc69f4 in term 1.
I20260709 13:09:22.558416 30669 tablet_bootstrap.cc:654] T 687db47721c34eb3918dc02f98170722 P eaa6f3dc13d643b9acfd8df1263a456d: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:22.559141 30514 leader_election.cc:304] T f406da2fcdaa4facbd59848fdd5eeeb3 P d7def43826924f03b8858383f0dc69f4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b1daf23b3538498bb795a60d627b6ac0, d7def43826924f03b8858383f0dc69f4; no voters: 
I20260709 13:09:22.557744 30668 raft_consensus.cc:493] T d121c37db92f49c4a789269d64b00a12 P d7def43826924f03b8858383f0dc69f4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:22.564556 30668 raft_consensus.cc:515] T d121c37db92f49c4a789269d64b00a12 P d7def43826924f03b8858383f0dc69f4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1daf23b3538498bb795a60d627b6ac0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 36109 } } peers { permanent_uuid: "d7def43826924f03b8858383f0dc69f4" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 40053 } } peers { permanent_uuid: "eaa6f3dc13d643b9acfd8df1263a456d" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 41395 } }
I20260709 13:09:22.567482 30550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad8233fe86c64f6380f513881e6c3268" candidate_uuid: "b1daf23b3538498bb795a60d627b6ac0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d7def43826924f03b8858383f0dc69f4" is_pre_election: true
I20260709 13:09:22.592101 30550 raft_consensus.cc:2468] T ad8233fe86c64f6380f513881e6c3268 P d7def43826924f03b8858383f0dc69f4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1daf23b3538498bb795a60d627b6ac0 in term 0.
I20260709 13:09:22.568660 30549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad8233fe86c64f6380f513881e6c3268" candidate_uuid: "b1daf23b3538498bb795a60d627b6ac0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d7def43826924f03b8858383f0dc69f4"
I20260709 13:09:22.593355 30549 raft_consensus.cc:3060] T ad8233fe86c64f6380f513881e6c3268 P d7def43826924f03b8858383f0dc69f4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:22.597554 30624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d121c37db92f49c4a789269d64b00a12" candidate_uuid: "d7def43826924f03b8858383f0dc69f4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eaa6f3dc13d643b9acfd8df1263a456d" is_pre_election: true
I20260709 13:09:22.569227 30547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "131d025784b94fe8bab12c27e5176e73" candidate_uuid: "b1daf23b3538498bb795a60d627b6ac0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d7def43826924f03b8858383f0dc69f4" is_pre_election: true
I20260709 13:09:22.598800 30624 raft_consensus.cc:2468] T d121c37db92f49c4a789269d64b00a12 P eaa6f3dc13d643b9acfd8df1263a456d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d7def43826924f03b8858383f0dc69f4 in term 0.
I20260709 13:09:22.568704 30551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6e07afd07294d7d80ca32fa1f97e4a1" candidate_uuid: "b1daf23b3538498bb795a60d627b6ac0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d7def43826924f03b8858383f0dc69f4" is_pre_election: true
I20260709 13:09:22.599152 30547 raft_consensus.cc:2468] T 131d025784b94fe8bab12c27e5176e73 P d7def43826924f03b8858383f0dc69f4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1daf23b3538498bb795a60d627b6ac0 in term 0.
I20260709 13:09:22.599767 30551 raft_consensus.cc:2468] T d6e07afd07294d7d80ca32fa1f97e4a1 P d7def43826924f03b8858383f0dc69f4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1daf23b3538498bb795a60d627b6ac0 in term 0.
I20260709 13:09:22.573618 30686 raft_consensus.cc:697] T 17519d8368db4b08a84e4d7335c6fc4f P d7def43826924f03b8858383f0dc69f4 [term 1 LEADER]: Becoming Leader. State: Replica: d7def43826924f03b8858383f0dc69f4, State: Running, Role: LEADER
I20260709 13:09:22.572642 30670 raft_consensus.cc:515] T d121c37db92f49c4a789269d64b00a12 P b1daf23b3538498bb795a60d627b6ac0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1daf23b3538498bb795a60d627b6ac0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 36109 } } peers { permanent_uuid: "d7def43826924f03b8858383f0dc69f4" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 40053 } } peers { permanent_uuid: "eaa6f3dc13d643b9acfd8df1263a456d" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 41395 } }
I20260709 13:09:22.576327 30676 raft_consensus.cc:493] T 4ad6f5c1312c488b8d331c1ecb412800 P eaa6f3dc13d643b9acfd8df1263a456d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:22.604449 30676 raft_consensus.cc:515] T 4ad6f5c1312c488b8d331c1ecb412800 P eaa6f3dc13d643b9acfd8df1263a456d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1daf23b3538498bb795a60d627b6ac0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 36109 } } peers { permanent_uuid: "d7def43826924f03b8858383f0dc69f4" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 40053 } } peers { permanent_uuid: "eaa6f3dc13d643b9acfd8df1263a456d" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 41395 } }
I20260709 13:09:22.603401 30668 leader_election.cc:290] T d121c37db92f49c4a789269d64b00a12 P d7def43826924f03b8858383f0dc69f4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b1daf23b3538498bb795a60d627b6ac0 (127.17.223.1:36109), eaa6f3dc13d643b9acfd8df1263a456d (127.17.223.3:41395)
I20260709 13:09:22.607007 30676 leader_election.cc:290] T 4ad6f5c1312c488b8d331c1ecb412800 P eaa6f3dc13d643b9acfd8df1263a456d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b1daf23b3538498bb795a60d627b6ac0 (127.17.223.1:36109), d7def43826924f03b8858383f0dc69f4 (127.17.223.2:40053)
I20260709 13:09:22.607231 30669 tablet_bootstrap.cc:492] T 687db47721c34eb3918dc02f98170722 P eaa6f3dc13d643b9acfd8df1263a456d: No bootstrap required, opened a new log
I20260709 13:09:22.569679 30548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d121c37db92f49c4a789269d64b00a12" candidate_uuid: "b1daf23b3538498bb795a60d627b6ac0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d7def43826924f03b8858383f0dc69f4" is_pre_election: true
I20260709 13:09:22.607767 30669 ts_tablet_manager.cc:1403] T 687db47721c34eb3918dc02f98170722 P eaa6f3dc13d643b9acfd8df1263a456d: Time spent bootstrapping tablet: real 0.058s	user 0.029s	sys 0.024s
I20260709 13:09:22.607824 30548 raft_consensus.cc:2468] T d121c37db92f49c4a789269d64b00a12 P d7def43826924f03b8858383f0dc69f4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1daf23b3538498bb795a60d627b6ac0 in term 0.
I20260709 13:09:22.575461 30439 leader_election.cc:304] T ad8233fe86c64f6380f513881e6c3268 P b1daf23b3538498bb795a60d627b6ac0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b1daf23b3538498bb795a60d627b6ac0, eaa6f3dc13d643b9acfd8df1263a456d; no voters: 
I20260709 13:09:22.574214 30698 raft_consensus.cc:2804] T f406da2fcdaa4facbd59848fdd5eeeb3 P d7def43826924f03b8858383f0dc69f4 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:22.611956 30698 raft_consensus.cc:697] T f406da2fcdaa4facbd59848fdd5eeeb3 P d7def43826924f03b8858383f0dc69f4 [term 1 LEADER]: Becoming Leader. State: Replica: d7def43826924f03b8858383f0dc69f4, State: Running, Role: LEADER
I20260709 13:09:22.612887 30698 consensus_queue.cc:237] T f406da2fcdaa4facbd59848fdd5eeeb3 P d7def43826924f03b8858383f0dc69f4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1daf23b3538498bb795a60d627b6ac0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 36109 } } peers { permanent_uuid: "d7def43826924f03b8858383f0dc69f4" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 40053 } } peers { permanent_uuid: "eaa6f3dc13d643b9acfd8df1263a456d" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 41395 } }
I20260709 13:09:22.613660 30548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d121c37db92f49c4a789269d64b00a12" candidate_uuid: "b1daf23b3538498bb795a60d627b6ac0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d7def43826924f03b8858383f0dc69f4"
I20260709 13:09:22.614305 30548 raft_consensus.cc:3060] T d121c37db92f49c4a789269d64b00a12 P d7def43826924f03b8858383f0dc69f4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:22.614835 30685 raft_consensus.cc:2804] T ad8233fe86c64f6380f513881e6c3268 P b1daf23b3538498bb795a60d627b6ac0 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:22.608014 30670 leader_election.cc:290] T d121c37db92f49c4a789269d64b00a12 P b1daf23b3538498bb795a60d627b6ac0 [CANDIDATE]: Term 1 election: Requested vote from peers d7def43826924f03b8858383f0dc69f4 (127.17.223.2:40053), eaa6f3dc13d643b9acfd8df1263a456d (127.17.223.3:41395)
I20260709 13:09:22.602432 30625 raft_consensus.cc:2468] T f406da2fcdaa4facbd59848fdd5eeeb3 P eaa6f3dc13d643b9acfd8df1263a456d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d7def43826924f03b8858383f0dc69f4 in term 1.
I20260709 13:09:22.615656 30549 raft_consensus.cc:2468] T ad8233fe86c64f6380f513881e6c3268 P d7def43826924f03b8858383f0dc69f4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b1daf23b3538498bb795a60d627b6ac0 in term 1.
I20260709 13:09:22.619426 30514 leader_election.cc:304] T d121c37db92f49c4a789269d64b00a12 P d7def43826924f03b8858383f0dc69f4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d7def43826924f03b8858383f0dc69f4, eaa6f3dc13d643b9acfd8df1263a456d; no voters: 
I20260709 13:09:22.621062 30439 leader_election.cc:304] T 131d025784b94fe8bab12c27e5176e73 P b1daf23b3538498bb795a60d627b6ac0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b1daf23b3538498bb795a60d627b6ac0, d7def43826924f03b8858383f0dc69f4; no voters: eaa6f3dc13d643b9acfd8df1263a456d
I20260709 13:09:22.626065 30624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d121c37db92f49c4a789269d64b00a12" candidate_uuid: "b1daf23b3538498bb795a60d627b6ac0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eaa6f3dc13d643b9acfd8df1263a456d"
I20260709 13:09:22.626796 30624 raft_consensus.cc:3060] T d121c37db92f49c4a789269d64b00a12 P eaa6f3dc13d643b9acfd8df1263a456d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:22.625440 30686 consensus_queue.cc:237] T 17519d8368db4b08a84e4d7335c6fc4f P d7def43826924f03b8858383f0dc69f4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1daf23b3538498bb795a60d627b6ac0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 36109 } } peers { permanent_uuid: "d7def43826924f03b8858383f0dc69f4" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 40053 } } peers { permanent_uuid: "eaa6f3dc13d643b9acfd8df1263a456d" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 41395 } }
I20260709 13:09:22.625516 30670 raft_consensus.cc:2804] T 131d025784b94fe8bab12c27e5176e73 P b1daf23b3538498bb795a60d627b6ac0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:22.629534 30670 raft_consensus.cc:493] T 131d025784b94fe8bab12c27e5176e73 P b1daf23b3538498bb795a60d627b6ac0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:22.629951 30670 raft_consensus.cc:3060] T 131d025784b94fe8bab12c27e5176e73 P b1daf23b3538498bb795a60d627b6ac0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:22.634807 30685 raft_consensus.cc:697] T ad8233fe86c64f6380f513881e6c3268 P b1daf23b3538498bb795a60d627b6ac0 [term 1 LEADER]: Becoming Leader. State: Replica: b1daf23b3538498bb795a60d627b6ac0, State: Running, Role: LEADER
I20260709 13:09:22.635964 30685 consensus_queue.cc:237] T ad8233fe86c64f6380f513881e6c3268 P b1daf23b3538498bb795a60d627b6ac0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1daf23b3538498bb795a60d627b6ac0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 36109 } } peers { permanent_uuid: "d7def43826924f03b8858383f0dc69f4" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 40053 } } peers { permanent_uuid: "eaa6f3dc13d643b9acfd8df1263a456d" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 41395 } }
I20260709 13:09:22.642153 30548 raft_consensus.cc:2468] T d121c37db92f49c4a789269d64b00a12 P d7def43826924f03b8858383f0dc69f4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b1daf23b3538498bb795a60d627b6ac0 in term 1.
I20260709 13:09:22.639679 30669 raft_consensus.cc:359] T 687db47721c34eb3918dc02f98170722 P eaa6f3dc13d643b9acfd8df1263a456d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1daf23b3538498bb795a60d627b6ac0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 36109 } } peers { permanent_uuid: "d7def43826924f03b8858383f0dc69f4" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 40053 } } peers { permanent_uuid: "eaa6f3dc13d643b9acfd8df1263a456d" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 41395 } }
I20260709 13:09:22.645340 30669 raft_consensus.cc:385] T 687db47721c34eb3918dc02f98170722 P eaa6f3dc13d643b9acfd8df1263a456d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:22.645502 30699 raft_consensus.cc:2764] T d121c37db92f49c4a789269d64b00a12 P d7def43826924f03b8858383f0dc69f4 [term 1 FOLLOWER]: Leader pre-election decision vote started in defunct term 0: won
I20260709 13:09:22.645750 30669 raft_consensus.cc:740] T 687db47721c34eb3918dc02f98170722 P eaa6f3dc13d643b9acfd8df1263a456d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eaa6f3dc13d643b9acfd8df1263a456d, State: Initialized, Role: FOLLOWER
I20260709 13:09:22.647011 30669 consensus_queue.cc:260] T 687db47721c34eb3918dc02f98170722 P eaa6f3dc13d643b9acfd8df1263a456d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1daf23b3538498bb795a60d627b6ac0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 36109 } } peers { permanent_uuid: "d7def43826924f03b8858383f0dc69f4" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 40053 } } peers { permanent_uuid: "eaa6f3dc13d643b9acfd8df1263a456d" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 41395 } }
I20260709 13:09:22.644336 30439 leader_election.cc:304] T d6e07afd07294d7d80ca32fa1f97e4a1 P b1daf23b3538498bb795a60d627b6ac0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b1daf23b3538498bb795a60d627b6ac0, d7def43826924f03b8858383f0dc69f4; no voters: eaa6f3dc13d643b9acfd8df1263a456d
I20260709 13:09:22.654462 30439 leader_election.cc:304] T d121c37db92f49c4a789269d64b00a12 P b1daf23b3538498bb795a60d627b6ac0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b1daf23b3538498bb795a60d627b6ac0, d7def43826924f03b8858383f0dc69f4; no voters: 
I20260709 13:09:22.657349 30665 tablet_bootstrap.cc:492] T 4ad6f5c1312c488b8d331c1ecb412800 P d7def43826924f03b8858383f0dc69f4: No bootstrap required, opened a new log
I20260709 13:09:22.657884 30665 ts_tablet_manager.cc:1403] T 4ad6f5c1312c488b8d331c1ecb412800 P d7def43826924f03b8858383f0dc69f4: Time spent bootstrapping tablet: real 0.138s	user 0.035s	sys 0.047s
I20260709 13:09:22.662135 30476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ad6f5c1312c488b8d331c1ecb412800" candidate_uuid: "eaa6f3dc13d643b9acfd8df1263a456d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1daf23b3538498bb795a60d627b6ac0" is_pre_election: true
I20260709 13:09:22.663116 30476 raft_consensus.cc:2468] T 4ad6f5c1312c488b8d331c1ecb412800 P b1daf23b3538498bb795a60d627b6ac0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eaa6f3dc13d643b9acfd8df1263a456d in term 0.
I20260709 13:09:22.665026 30588 leader_election.cc:304] T 4ad6f5c1312c488b8d331c1ecb412800 P eaa6f3dc13d643b9acfd8df1263a456d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b1daf23b3538498bb795a60d627b6ac0, eaa6f3dc13d643b9acfd8df1263a456d; no voters: 
I20260709 13:09:22.665529 30665 raft_consensus.cc:359] T 4ad6f5c1312c488b8d331c1ecb412800 P d7def43826924f03b8858383f0dc69f4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1daf23b3538498bb795a60d627b6ac0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 36109 } } peers { permanent_uuid: "d7def43826924f03b8858383f0dc69f4" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 40053 } } peers { permanent_uuid: "eaa6f3dc13d643b9acfd8df1263a456d" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 41395 } }
I20260709 13:09:22.666483 30665 raft_consensus.cc:385] T 4ad6f5c1312c488b8d331c1ecb412800 P d7def43826924f03b8858383f0dc69f4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:22.667014 30665 raft_consensus.cc:740] T 4ad6f5c1312c488b8d331c1ecb412800 P d7def43826924f03b8858383f0dc69f4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d7def43826924f03b8858383f0dc69f4, State: Initialized, Role: FOLLOWER
I20260709 13:09:22.659152 30669 ts_tablet_manager.cc:1434] T 687db47721c34eb3918dc02f98170722 P eaa6f3dc13d643b9acfd8df1263a456d: Time spent starting tablet: real 0.051s	user 0.010s	sys 0.000s
I20260709 13:09:22.656150 30624 raft_consensus.cc:2468] T d121c37db92f49c4a789269d64b00a12 P eaa6f3dc13d643b9acfd8df1263a456d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b1daf23b3538498bb795a60d627b6ac0 in term 1.
I20260709 13:09:22.668637 30676 raft_consensus.cc:2804] T 4ad6f5c1312c488b8d331c1ecb412800 P eaa6f3dc13d643b9acfd8df1263a456d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:22.671674 30676 raft_consensus.cc:493] T 4ad6f5c1312c488b8d331c1ecb412800 P eaa6f3dc13d643b9acfd8df1263a456d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:22.672088 30676 raft_consensus.cc:3060] T 4ad6f5c1312c488b8d331c1ecb412800 P eaa6f3dc13d643b9acfd8df1263a456d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:22.672416 30669 tablet_bootstrap.cc:492] T d6e07afd07294d7d80ca32fa1f97e4a1 P eaa6f3dc13d643b9acfd8df1263a456d: Bootstrap starting.
I20260709 13:09:22.669072 30665 consensus_queue.cc:260] T 4ad6f5c1312c488b8d331c1ecb412800 P d7def43826924f03b8858383f0dc69f4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1daf23b3538498bb795a60d627b6ac0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 36109 } } peers { permanent_uuid: "d7def43826924f03b8858383f0dc69f4" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 40053 } } peers { permanent_uuid: "eaa6f3dc13d643b9acfd8df1263a456d" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 41395 } }
I20260709 13:09:22.680087 30665 ts_tablet_manager.cc:1434] T 4ad6f5c1312c488b8d331c1ecb412800 P d7def43826924f03b8858383f0dc69f4: Time spent starting tablet: real 0.022s	user 0.008s	sys 0.000s
I20260709 13:09:22.675297 30670 raft_consensus.cc:515] T 131d025784b94fe8bab12c27e5176e73 P b1daf23b3538498bb795a60d627b6ac0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7def43826924f03b8858383f0dc69f4" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 40053 } } peers { permanent_uuid: "b1daf23b3538498bb795a60d627b6ac0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 36109 } } peers { permanent_uuid: "eaa6f3dc13d643b9acfd8df1263a456d" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 41395 } }
I20260709 13:09:22.680830 30548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ad6f5c1312c488b8d331c1ecb412800" candidate_uuid: "eaa6f3dc13d643b9acfd8df1263a456d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d7def43826924f03b8858383f0dc69f4" is_pre_election: true
I20260709 13:09:22.682350 30548 raft_consensus.cc:2468] T 4ad6f5c1312c488b8d331c1ecb412800 P d7def43826924f03b8858383f0dc69f4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eaa6f3dc13d643b9acfd8df1263a456d in term 0.
I20260709 13:09:22.677618 30702 raft_consensus.cc:2804] T d6e07afd07294d7d80ca32fa1f97e4a1 P b1daf23b3538498bb795a60d627b6ac0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:22.683102 30702 raft_consensus.cc:493] T d6e07afd07294d7d80ca32fa1f97e4a1 P b1daf23b3538498bb795a60d627b6ac0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:22.683483 30702 raft_consensus.cc:3060] T d6e07afd07294d7d80ca32fa1f97e4a1 P b1daf23b3538498bb795a60d627b6ac0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:22.677955 30372 catalog_manager.cc:5697] T 17519d8368db4b08a84e4d7335c6fc4f P d7def43826924f03b8858383f0dc69f4 reported cstate change: term changed from 0 to 1, leader changed from <none> to d7def43826924f03b8858383f0dc69f4 (127.17.223.2). New cstate: current_term: 1 leader_uuid: "d7def43826924f03b8858383f0dc69f4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1daf23b3538498bb795a60d627b6ac0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 36109 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d7def43826924f03b8858383f0dc69f4" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 40053 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "eaa6f3dc13d643b9acfd8df1263a456d" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 41395 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:22.688362 30476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d121c37db92f49c4a789269d64b00a12" candidate_uuid: "d7def43826924f03b8858383f0dc69f4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1daf23b3538498bb795a60d627b6ac0" is_pre_election: true
I20260709 13:09:22.689213 30476 raft_consensus.cc:2393] T d121c37db92f49c4a789269d64b00a12 P b1daf23b3538498bb795a60d627b6ac0 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d7def43826924f03b8858383f0dc69f4 in current term 1: Already voted for candidate b1daf23b3538498bb795a60d627b6ac0 in this term.
I20260709 13:09:22.689465 30669 tablet_bootstrap.cc:654] T d6e07afd07294d7d80ca32fa1f97e4a1 P eaa6f3dc13d643b9acfd8df1263a456d: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:22.691123 30676 raft_consensus.cc:515] T 4ad6f5c1312c488b8d331c1ecb412800 P eaa6f3dc13d643b9acfd8df1263a456d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1daf23b3538498bb795a60d627b6ac0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 36109 } } peers { permanent_uuid: "d7def43826924f03b8858383f0dc69f4" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 40053 } } peers { permanent_uuid: "eaa6f3dc13d643b9acfd8df1263a456d" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 41395 } }
I20260709 13:09:22.692194 30706 raft_consensus.cc:2804] T d121c37db92f49c4a789269d64b00a12 P b1daf23b3538498bb795a60d627b6ac0 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:22.700946 30548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "131d025784b94fe8bab12c27e5176e73" candidate_uuid: "b1daf23b3538498bb795a60d627b6ac0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d7def43826924f03b8858383f0dc69f4"
I20260709 13:09:22.701447 30670 leader_election.cc:290] T 131d025784b94fe8bab12c27e5176e73 P b1daf23b3538498bb795a60d627b6ac0 [CANDIDATE]: Term 1 election: Requested vote from peers d7def43826924f03b8858383f0dc69f4 (127.17.223.2:40053), eaa6f3dc13d643b9acfd8df1263a456d (127.17.223.3:41395)
I20260709 13:09:22.701704 30548 raft_consensus.cc:3060] T 131d025784b94fe8bab12c27e5176e73 P d7def43826924f03b8858383f0dc69f4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:22.698423 30476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ad6f5c1312c488b8d331c1ecb412800" candidate_uuid: "eaa6f3dc13d643b9acfd8df1263a456d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1daf23b3538498bb795a60d627b6ac0"
I20260709 13:09:22.703377 30476 raft_consensus.cc:3060] T 4ad6f5c1312c488b8d331c1ecb412800 P b1daf23b3538498bb795a60d627b6ac0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:22.707670 30548 raft_consensus.cc:2468] T 131d025784b94fe8bab12c27e5176e73 P d7def43826924f03b8858383f0dc69f4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b1daf23b3538498bb795a60d627b6ac0 in term 1.
I20260709 13:09:22.707932 30624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "131d025784b94fe8bab12c27e5176e73" candidate_uuid: "b1daf23b3538498bb795a60d627b6ac0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eaa6f3dc13d643b9acfd8df1263a456d"
I20260709 13:09:22.708611 30624 raft_consensus.cc:3060] T 131d025784b94fe8bab12c27e5176e73 P eaa6f3dc13d643b9acfd8df1263a456d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:22.709990 30702 raft_consensus.cc:515] T d6e07afd07294d7d80ca32fa1f97e4a1 P b1daf23b3538498bb795a60d627b6ac0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1daf23b3538498bb795a60d627b6ac0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 36109 } } peers { permanent_uuid: "d7def43826924f03b8858383f0dc69f4" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 40053 } } peers { permanent_uuid: "eaa6f3dc13d643b9acfd8df1263a456d" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 41395 } }
I20260709 13:09:22.712797 30702 leader_election.cc:290] T d6e07afd07294d7d80ca32fa1f97e4a1 P b1daf23b3538498bb795a60d627b6ac0 [CANDIDATE]: Term 1 election: Requested vote from peers d7def43826924f03b8858383f0dc69f4 (127.17.223.2:40053), eaa6f3dc13d643b9acfd8df1263a456d (127.17.223.3:41395)
I20260709 13:09:22.715520 30624 raft_consensus.cc:2468] T 131d025784b94fe8bab12c27e5176e73 P eaa6f3dc13d643b9acfd8df1263a456d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b1daf23b3538498bb795a60d627b6ac0 in term 1.
I20260709 13:09:22.717365 30676 leader_election.cc:290] T 4ad6f5c1312c488b8d331c1ecb412800 P eaa6f3dc13d643b9acfd8df1263a456d [CANDIDATE]: Term 1 election: Requested vote from peers b1daf23b3538498bb795a60d627b6ac0 (127.17.223.1:36109), d7def43826924f03b8858383f0dc69f4 (127.17.223.2:40053)
I20260709 13:09:22.717984 30549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ad6f5c1312c488b8d331c1ecb412800" candidate_uuid: "eaa6f3dc13d643b9acfd8df1263a456d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d7def43826924f03b8858383f0dc69f4"
I20260709 13:09:22.698001 30706 raft_consensus.cc:697] T d121c37db92f49c4a789269d64b00a12 P b1daf23b3538498bb795a60d627b6ac0 [term 1 LEADER]: Becoming Leader. State: Replica: b1daf23b3538498bb795a60d627b6ac0, State: Running, Role: LEADER
I20260709 13:09:22.719457 30549 raft_consensus.cc:3060] T 4ad6f5c1312c488b8d331c1ecb412800 P d7def43826924f03b8858383f0dc69f4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:22.720551 30439 leader_election.cc:304] T 131d025784b94fe8bab12c27e5176e73 P b1daf23b3538498bb795a60d627b6ac0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b1daf23b3538498bb795a60d627b6ac0, d7def43826924f03b8858383f0dc69f4; no voters: 
I20260709 13:09:22.721728 30709 raft_consensus.cc:2804] T 131d025784b94fe8bab12c27e5176e73 P b1daf23b3538498bb795a60d627b6ac0 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:22.722095 30476 raft_consensus.cc:2468] T 4ad6f5c1312c488b8d331c1ecb412800 P b1daf23b3538498bb795a60d627b6ac0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eaa6f3dc13d643b9acfd8df1263a456d in term 1.
I20260709 13:09:22.722204 30709 raft_consensus.cc:697] T 131d025784b94fe8bab12c27e5176e73 P b1daf23b3538498bb795a60d627b6ac0 [term 1 LEADER]: Becoming Leader. State: Replica: b1daf23b3538498bb795a60d627b6ac0, State: Running, Role: LEADER
I20260709 13:09:22.723549 30588 leader_election.cc:304] T 4ad6f5c1312c488b8d331c1ecb412800 P eaa6f3dc13d643b9acfd8df1263a456d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b1daf23b3538498bb795a60d627b6ac0, eaa6f3dc13d643b9acfd8df1263a456d; no voters: 
I20260709 13:09:22.723462 30709 consensus_queue.cc:237] T 131d025784b94fe8bab12c27e5176e73 P b1daf23b3538498bb795a60d627b6ac0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7def43826924f03b8858383f0dc69f4" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 40053 } } peers { permanent_uuid: "b1daf23b3538498bb795a60d627b6ac0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 36109 } } peers { permanent_uuid: "eaa6f3dc13d643b9acfd8df1263a456d" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 41395 } }
I20260709 13:09:22.724640 30676 raft_consensus.cc:2804] T 4ad6f5c1312c488b8d331c1ecb412800 P eaa6f3dc13d643b9acfd8df1263a456d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:22.720155 30548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6e07afd07294d7d80ca32fa1f97e4a1" candidate_uuid: "b1daf23b3538498bb795a60d627b6ac0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d7def43826924f03b8858383f0dc69f4"
I20260709 13:09:22.727991 30624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6e07afd07294d7d80ca32fa1f97e4a1" candidate_uuid: "b1daf23b3538498bb795a60d627b6ac0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eaa6f3dc13d643b9acfd8df1263a456d"
I20260709 13:09:22.731290 30548 raft_consensus.cc:3060] T d6e07afd07294d7d80ca32fa1f97e4a1 P d7def43826924f03b8858383f0dc69f4 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:09:22.733696 30439 leader_election.cc:343] T d6e07afd07294d7d80ca32fa1f97e4a1 P b1daf23b3538498bb795a60d627b6ac0 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer eaa6f3dc13d643b9acfd8df1263a456d (127.17.223.3:41395): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:22.737512 30549 raft_consensus.cc:2468] T 4ad6f5c1312c488b8d331c1ecb412800 P d7def43826924f03b8858383f0dc69f4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eaa6f3dc13d643b9acfd8df1263a456d in term 1.
I20260709 13:09:22.739066 30706 consensus_queue.cc:237] T d121c37db92f49c4a789269d64b00a12 P b1daf23b3538498bb795a60d627b6ac0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1daf23b3538498bb795a60d627b6ac0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 36109 } } peers { permanent_uuid: "d7def43826924f03b8858383f0dc69f4" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 40053 } } peers { permanent_uuid: "eaa6f3dc13d643b9acfd8df1263a456d" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 41395 } }
I20260709 13:09:22.750341 30686 raft_consensus.cc:493] T 687db47721c34eb3918dc02f98170722 P d7def43826924f03b8858383f0dc69f4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:22.752815 30686 raft_consensus.cc:515] T 687db47721c34eb3918dc02f98170722 P d7def43826924f03b8858383f0dc69f4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1daf23b3538498bb795a60d627b6ac0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 36109 } } peers { permanent_uuid: "d7def43826924f03b8858383f0dc69f4" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 40053 } } peers { permanent_uuid: "eaa6f3dc13d643b9acfd8df1263a456d" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 41395 } }
I20260709 13:09:22.753245 30669 tablet_bootstrap.cc:492] T d6e07afd07294d7d80ca32fa1f97e4a1 P eaa6f3dc13d643b9acfd8df1263a456d: No bootstrap required, opened a new log
I20260709 13:09:22.753803 30669 ts_tablet_manager.cc:1403] T d6e07afd07294d7d80ca32fa1f97e4a1 P eaa6f3dc13d643b9acfd8df1263a456d: Time spent bootstrapping tablet: real 0.082s	user 0.024s	sys 0.010s
I20260709 13:09:22.755003 30686 leader_election.cc:290] T 687db47721c34eb3918dc02f98170722 P d7def43826924f03b8858383f0dc69f4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b1daf23b3538498bb795a60d627b6ac0 (127.17.223.1:36109), eaa6f3dc13d643b9acfd8df1263a456d (127.17.223.3:41395)
I20260709 13:09:22.756023 30548 raft_consensus.cc:2468] T d6e07afd07294d7d80ca32fa1f97e4a1 P d7def43826924f03b8858383f0dc69f4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b1daf23b3538498bb795a60d627b6ac0 in term 1.
I20260709 13:09:22.756903 30669 raft_consensus.cc:359] T d6e07afd07294d7d80ca32fa1f97e4a1 P eaa6f3dc13d643b9acfd8df1263a456d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1daf23b3538498bb795a60d627b6ac0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 36109 } } peers { permanent_uuid: "d7def43826924f03b8858383f0dc69f4" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 40053 } } peers { permanent_uuid: "eaa6f3dc13d643b9acfd8df1263a456d" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 41395 } }
I20260709 13:09:22.757654 30669 raft_consensus.cc:385] T d6e07afd07294d7d80ca32fa1f97e4a1 P eaa6f3dc13d643b9acfd8df1263a456d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:22.757573 30624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "687db47721c34eb3918dc02f98170722" candidate_uuid: "d7def43826924f03b8858383f0dc69f4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eaa6f3dc13d643b9acfd8df1263a456d" is_pre_election: true
I20260709 13:09:22.758090 30669 raft_consensus.cc:740] T d6e07afd07294d7d80ca32fa1f97e4a1 P eaa6f3dc13d643b9acfd8df1263a456d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eaa6f3dc13d643b9acfd8df1263a456d, State: Initialized, Role: FOLLOWER
I20260709 13:09:22.758330 30624 raft_consensus.cc:2468] T 687db47721c34eb3918dc02f98170722 P eaa6f3dc13d643b9acfd8df1263a456d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d7def43826924f03b8858383f0dc69f4 in term 0.
I20260709 13:09:22.758945 30669 consensus_queue.cc:260] T d6e07afd07294d7d80ca32fa1f97e4a1 P eaa6f3dc13d643b9acfd8df1263a456d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1daf23b3538498bb795a60d627b6ac0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 36109 } } peers { permanent_uuid: "d7def43826924f03b8858383f0dc69f4" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 40053 } } peers { permanent_uuid: "eaa6f3dc13d643b9acfd8df1263a456d" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 41395 } }
I20260709 13:09:22.759655 30514 leader_election.cc:304] T 687db47721c34eb3918dc02f98170722 P d7def43826924f03b8858383f0dc69f4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d7def43826924f03b8858383f0dc69f4, eaa6f3dc13d643b9acfd8df1263a456d; no voters: 
I20260709 13:09:22.759135 30373 catalog_manager.cc:5697] T ad8233fe86c64f6380f513881e6c3268 P b1daf23b3538498bb795a60d627b6ac0 reported cstate change: term changed from 0 to 1, leader changed from <none> to b1daf23b3538498bb795a60d627b6ac0 (127.17.223.1). New cstate: current_term: 1 leader_uuid: "b1daf23b3538498bb795a60d627b6ac0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1daf23b3538498bb795a60d627b6ac0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 36109 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d7def43826924f03b8858383f0dc69f4" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 40053 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "eaa6f3dc13d643b9acfd8df1263a456d" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 41395 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:22.760529 30686 raft_consensus.cc:2804] T 687db47721c34eb3918dc02f98170722 P d7def43826924f03b8858383f0dc69f4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:22.760921 30686 raft_consensus.cc:493] T 687db47721c34eb3918dc02f98170722 P d7def43826924f03b8858383f0dc69f4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:22.761263 30686 raft_consensus.cc:3060] T 687db47721c34eb3918dc02f98170722 P d7def43826924f03b8858383f0dc69f4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:22.761380 30669 ts_tablet_manager.cc:1434] T d6e07afd07294d7d80ca32fa1f97e4a1 P eaa6f3dc13d643b9acfd8df1263a456d: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 13:09:22.762425 30706 raft_consensus.cc:493] T 734911241b624e74aadb0e38ed5b0362 P b1daf23b3538498bb795a60d627b6ac0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:22.762639 30439 leader_election.cc:304] T d6e07afd07294d7d80ca32fa1f97e4a1 P b1daf23b3538498bb795a60d627b6ac0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b1daf23b3538498bb795a60d627b6ac0, d7def43826924f03b8858383f0dc69f4; no voters: eaa6f3dc13d643b9acfd8df1263a456d
I20260709 13:09:22.762975 30706 raft_consensus.cc:515] T 734911241b624e74aadb0e38ed5b0362 P b1daf23b3538498bb795a60d627b6ac0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1daf23b3538498bb795a60d627b6ac0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 36109 } } peers { permanent_uuid: "d7def43826924f03b8858383f0dc69f4" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 40053 } } peers { permanent_uuid: "eaa6f3dc13d643b9acfd8df1263a456d" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 41395 } }
I20260709 13:09:22.763818 30709 raft_consensus.cc:2804] T d6e07afd07294d7d80ca32fa1f97e4a1 P b1daf23b3538498bb795a60d627b6ac0 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:22.764272 30709 raft_consensus.cc:697] T d6e07afd07294d7d80ca32fa1f97e4a1 P b1daf23b3538498bb795a60d627b6ac0 [term 1 LEADER]: Becoming Leader. State: Replica: b1daf23b3538498bb795a60d627b6ac0, State: Running, Role: LEADER
I20260709 13:09:22.765115 30706 leader_election.cc:290] T 734911241b624e74aadb0e38ed5b0362 P b1daf23b3538498bb795a60d627b6ac0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d7def43826924f03b8858383f0dc69f4 (127.17.223.2:40053), eaa6f3dc13d643b9acfd8df1263a456d (127.17.223.3:41395)
I20260709 13:09:22.765091 30709 consensus_queue.cc:237] T d6e07afd07294d7d80ca32fa1f97e4a1 P b1daf23b3538498bb795a60d627b6ac0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1daf23b3538498bb795a60d627b6ac0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 36109 } } peers { permanent_uuid: "d7def43826924f03b8858383f0dc69f4" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 40053 } } peers { permanent_uuid: "eaa6f3dc13d643b9acfd8df1263a456d" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 41395 } }
I20260709 13:09:22.766055 30669 tablet_bootstrap.cc:492] T 17519d8368db4b08a84e4d7335c6fc4f P eaa6f3dc13d643b9acfd8df1263a456d: Bootstrap starting.
I20260709 13:09:22.767266 30548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "734911241b624e74aadb0e38ed5b0362" candidate_uuid: "b1daf23b3538498bb795a60d627b6ac0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d7def43826924f03b8858383f0dc69f4" is_pre_election: true
I20260709 13:09:22.767820 30624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "734911241b624e74aadb0e38ed5b0362" candidate_uuid: "b1daf23b3538498bb795a60d627b6ac0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eaa6f3dc13d643b9acfd8df1263a456d" is_pre_election: true
I20260709 13:09:22.767998 30548 raft_consensus.cc:2468] T 734911241b624e74aadb0e38ed5b0362 P d7def43826924f03b8858383f0dc69f4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1daf23b3538498bb795a60d627b6ac0 in term 0.
I20260709 13:09:22.768697 30476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "687db47721c34eb3918dc02f98170722" candidate_uuid: "d7def43826924f03b8858383f0dc69f4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1daf23b3538498bb795a60d627b6ac0" is_pre_election: true
I20260709 13:09:22.769348 30476 raft_consensus.cc:2468] T 687db47721c34eb3918dc02f98170722 P b1daf23b3538498bb795a60d627b6ac0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d7def43826924f03b8858383f0dc69f4 in term 0.
I20260709 13:09:22.770191 30439 leader_election.cc:304] T 734911241b624e74aadb0e38ed5b0362 P b1daf23b3538498bb795a60d627b6ac0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b1daf23b3538498bb795a60d627b6ac0, d7def43826924f03b8858383f0dc69f4; no voters: 
I20260709 13:09:22.771016 30706 raft_consensus.cc:2804] T 734911241b624e74aadb0e38ed5b0362 P b1daf23b3538498bb795a60d627b6ac0 [term 0 FOLLOWER]: Leader pre-election won for term 1
W20260709 13:09:22.771122 30439 leader_election.cc:343] T 734911241b624e74aadb0e38ed5b0362 P b1daf23b3538498bb795a60d627b6ac0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer eaa6f3dc13d643b9acfd8df1263a456d (127.17.223.3:41395): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:22.771430 30706 raft_consensus.cc:493] T 734911241b624e74aadb0e38ed5b0362 P b1daf23b3538498bb795a60d627b6ac0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:22.771816 30706 raft_consensus.cc:3060] T 734911241b624e74aadb0e38ed5b0362 P b1daf23b3538498bb795a60d627b6ac0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:22.749768 30676 raft_consensus.cc:697] T 4ad6f5c1312c488b8d331c1ecb412800 P eaa6f3dc13d643b9acfd8df1263a456d [term 1 LEADER]: Becoming Leader. State: Replica: eaa6f3dc13d643b9acfd8df1263a456d, State: Running, Role: LEADER
I20260709 13:09:22.776754 30676 consensus_queue.cc:237] T 4ad6f5c1312c488b8d331c1ecb412800 P eaa6f3dc13d643b9acfd8df1263a456d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1daf23b3538498bb795a60d627b6ac0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 36109 } } peers { permanent_uuid: "d7def43826924f03b8858383f0dc69f4" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 40053 } } peers { permanent_uuid: "eaa6f3dc13d643b9acfd8df1263a456d" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 41395 } }
I20260709 13:09:22.777362 30669 tablet_bootstrap.cc:654] T 17519d8368db4b08a84e4d7335c6fc4f P eaa6f3dc13d643b9acfd8df1263a456d: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:22.779768 30706 raft_consensus.cc:515] T 734911241b624e74aadb0e38ed5b0362 P b1daf23b3538498bb795a60d627b6ac0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1daf23b3538498bb795a60d627b6ac0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 36109 } } peers { permanent_uuid: "d7def43826924f03b8858383f0dc69f4" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 40053 } } peers { permanent_uuid: "eaa6f3dc13d643b9acfd8df1263a456d" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 41395 } }
I20260709 13:09:22.781262 30686 raft_consensus.cc:515] T 687db47721c34eb3918dc02f98170722 P d7def43826924f03b8858383f0dc69f4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1daf23b3538498bb795a60d627b6ac0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 36109 } } peers { permanent_uuid: "d7def43826924f03b8858383f0dc69f4" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 40053 } } peers { permanent_uuid: "eaa6f3dc13d643b9acfd8df1263a456d" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 41395 } }
I20260709 13:09:22.785403 30624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "734911241b624e74aadb0e38ed5b0362" candidate_uuid: "b1daf23b3538498bb795a60d627b6ac0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eaa6f3dc13d643b9acfd8df1263a456d"
I20260709 13:09:22.786119 30706 leader_election.cc:290] T 734911241b624e74aadb0e38ed5b0362 P b1daf23b3538498bb795a60d627b6ac0 [CANDIDATE]: Term 1 election: Requested vote from peers d7def43826924f03b8858383f0dc69f4 (127.17.223.2:40053), eaa6f3dc13d643b9acfd8df1263a456d (127.17.223.3:41395)
I20260709 13:09:22.786989 30548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "734911241b624e74aadb0e38ed5b0362" candidate_uuid: "b1daf23b3538498bb795a60d627b6ac0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d7def43826924f03b8858383f0dc69f4"
W20260709 13:09:22.787192 30439 leader_election.cc:343] T 734911241b624e74aadb0e38ed5b0362 P b1daf23b3538498bb795a60d627b6ac0 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer eaa6f3dc13d643b9acfd8df1263a456d (127.17.223.3:41395): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:22.787599 30548 raft_consensus.cc:3060] T 734911241b624e74aadb0e38ed5b0362 P d7def43826924f03b8858383f0dc69f4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:22.794332 30476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "687db47721c34eb3918dc02f98170722" candidate_uuid: "d7def43826924f03b8858383f0dc69f4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1daf23b3538498bb795a60d627b6ac0"
I20260709 13:09:22.795004 30476 raft_consensus.cc:3060] T 687db47721c34eb3918dc02f98170722 P b1daf23b3538498bb795a60d627b6ac0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:22.795534 30548 raft_consensus.cc:2468] T 734911241b624e74aadb0e38ed5b0362 P d7def43826924f03b8858383f0dc69f4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b1daf23b3538498bb795a60d627b6ac0 in term 1.
I20260709 13:09:22.797055 30439 leader_election.cc:304] T 734911241b624e74aadb0e38ed5b0362 P b1daf23b3538498bb795a60d627b6ac0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b1daf23b3538498bb795a60d627b6ac0, d7def43826924f03b8858383f0dc69f4; no voters: eaa6f3dc13d643b9acfd8df1263a456d
I20260709 13:09:22.799008 30711 raft_consensus.cc:493] T d6e07afd07294d7d80ca32fa1f97e4a1 P eaa6f3dc13d643b9acfd8df1263a456d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:22.799793 30711 raft_consensus.cc:515] T d6e07afd07294d7d80ca32fa1f97e4a1 P eaa6f3dc13d643b9acfd8df1263a456d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1daf23b3538498bb795a60d627b6ac0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 36109 } } peers { permanent_uuid: "d7def43826924f03b8858383f0dc69f4" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 40053 } } peers { permanent_uuid: "eaa6f3dc13d643b9acfd8df1263a456d" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 41395 } }
I20260709 13:09:22.802922 30706 raft_consensus.cc:2804] T 734911241b624e74aadb0e38ed5b0362 P b1daf23b3538498bb795a60d627b6ac0 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:22.804333 30475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6e07afd07294d7d80ca32fa1f97e4a1" candidate_uuid: "eaa6f3dc13d643b9acfd8df1263a456d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1daf23b3538498bb795a60d627b6ac0" is_pre_election: true
I20260709 13:09:22.809317 30476 raft_consensus.cc:2468] T 687db47721c34eb3918dc02f98170722 P b1daf23b3538498bb795a60d627b6ac0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d7def43826924f03b8858383f0dc69f4 in term 1.
I20260709 13:09:22.810163 30548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6e07afd07294d7d80ca32fa1f97e4a1" candidate_uuid: "eaa6f3dc13d643b9acfd8df1263a456d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d7def43826924f03b8858383f0dc69f4" is_pre_election: true
I20260709 13:09:22.810298 30711 leader_election.cc:290] T d6e07afd07294d7d80ca32fa1f97e4a1 P eaa6f3dc13d643b9acfd8df1263a456d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b1daf23b3538498bb795a60d627b6ac0 (127.17.223.1:36109), d7def43826924f03b8858383f0dc69f4 (127.17.223.2:40053)
I20260709 13:09:22.810745 30514 leader_election.cc:304] T 687db47721c34eb3918dc02f98170722 P d7def43826924f03b8858383f0dc69f4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b1daf23b3538498bb795a60d627b6ac0, d7def43826924f03b8858383f0dc69f4; no voters: 
I20260709 13:09:22.811053 30548 raft_consensus.cc:2393] T d6e07afd07294d7d80ca32fa1f97e4a1 P d7def43826924f03b8858383f0dc69f4 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate eaa6f3dc13d643b9acfd8df1263a456d in current term 1: Already voted for candidate b1daf23b3538498bb795a60d627b6ac0 in this term.
I20260709 13:09:22.811247 30706 raft_consensus.cc:697] T 734911241b624e74aadb0e38ed5b0362 P b1daf23b3538498bb795a60d627b6ac0 [term 1 LEADER]: Becoming Leader. State: Replica: b1daf23b3538498bb795a60d627b6ac0, State: Running, Role: LEADER
I20260709 13:09:22.811896 30698 raft_consensus.cc:2804] T 687db47721c34eb3918dc02f98170722 P d7def43826924f03b8858383f0dc69f4 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:22.812417 30588 leader_election.cc:304] T d6e07afd07294d7d80ca32fa1f97e4a1 P eaa6f3dc13d643b9acfd8df1263a456d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eaa6f3dc13d643b9acfd8df1263a456d; no voters: b1daf23b3538498bb795a60d627b6ac0, d7def43826924f03b8858383f0dc69f4
I20260709 13:09:22.812177 30706 consensus_queue.cc:237] T 734911241b624e74aadb0e38ed5b0362 P b1daf23b3538498bb795a60d627b6ac0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1daf23b3538498bb795a60d627b6ac0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 36109 } } peers { permanent_uuid: "d7def43826924f03b8858383f0dc69f4" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 40053 } } peers { permanent_uuid: "eaa6f3dc13d643b9acfd8df1263a456d" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 41395 } }
I20260709 13:09:22.812601 30698 raft_consensus.cc:697] T 687db47721c34eb3918dc02f98170722 P d7def43826924f03b8858383f0dc69f4 [term 1 LEADER]: Becoming Leader. State: Replica: d7def43826924f03b8858383f0dc69f4, State: Running, Role: LEADER
I20260709 13:09:22.813849 30698 consensus_queue.cc:237] T 687db47721c34eb3918dc02f98170722 P d7def43826924f03b8858383f0dc69f4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1daf23b3538498bb795a60d627b6ac0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 36109 } } peers { permanent_uuid: "d7def43826924f03b8858383f0dc69f4" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 40053 } } peers { permanent_uuid: "eaa6f3dc13d643b9acfd8df1263a456d" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 41395 } }
I20260709 13:09:22.815500 30686 leader_election.cc:290] T 687db47721c34eb3918dc02f98170722 P d7def43826924f03b8858383f0dc69f4 [CANDIDATE]: Term 1 election: Requested vote from peers b1daf23b3538498bb795a60d627b6ac0 (127.17.223.1:36109), eaa6f3dc13d643b9acfd8df1263a456d (127.17.223.3:41395)
I20260709 13:09:22.818230 30624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "687db47721c34eb3918dc02f98170722" candidate_uuid: "d7def43826924f03b8858383f0dc69f4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eaa6f3dc13d643b9acfd8df1263a456d"
I20260709 13:09:22.819132 30624 raft_consensus.cc:3060] T 687db47721c34eb3918dc02f98170722 P eaa6f3dc13d643b9acfd8df1263a456d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:22.819134 30711 raft_consensus.cc:3060] T d6e07afd07294d7d80ca32fa1f97e4a1 P eaa6f3dc13d643b9acfd8df1263a456d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:22.820533 30669 tablet_bootstrap.cc:492] T 17519d8368db4b08a84e4d7335c6fc4f P eaa6f3dc13d643b9acfd8df1263a456d: No bootstrap required, opened a new log
I20260709 13:09:22.821169 30669 ts_tablet_manager.cc:1403] T 17519d8368db4b08a84e4d7335c6fc4f P eaa6f3dc13d643b9acfd8df1263a456d: Time spent bootstrapping tablet: real 0.055s	user 0.024s	sys 0.024s
I20260709 13:09:22.824622 30669 raft_consensus.cc:359] T 17519d8368db4b08a84e4d7335c6fc4f P eaa6f3dc13d643b9acfd8df1263a456d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1daf23b3538498bb795a60d627b6ac0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 36109 } } peers { permanent_uuid: "d7def43826924f03b8858383f0dc69f4" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 40053 } } peers { permanent_uuid: "eaa6f3dc13d643b9acfd8df1263a456d" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 41395 } }
I20260709 13:09:22.825475 30669 raft_consensus.cc:385] T 17519d8368db4b08a84e4d7335c6fc4f P eaa6f3dc13d643b9acfd8df1263a456d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:22.827658 30624 raft_consensus.cc:2468] T 687db47721c34eb3918dc02f98170722 P eaa6f3dc13d643b9acfd8df1263a456d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d7def43826924f03b8858383f0dc69f4 in term 1.
I20260709 13:09:22.825799 30669 raft_consensus.cc:740] T 17519d8368db4b08a84e4d7335c6fc4f P eaa6f3dc13d643b9acfd8df1263a456d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eaa6f3dc13d643b9acfd8df1263a456d, State: Initialized, Role: FOLLOWER
I20260709 13:09:22.827502 30372 catalog_manager.cc:5697] T f406da2fcdaa4facbd59848fdd5eeeb3 P d7def43826924f03b8858383f0dc69f4 reported cstate change: term changed from 0 to 1, leader changed from <none> to d7def43826924f03b8858383f0dc69f4 (127.17.223.2). New cstate: current_term: 1 leader_uuid: "d7def43826924f03b8858383f0dc69f4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1daf23b3538498bb795a60d627b6ac0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 36109 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d7def43826924f03b8858383f0dc69f4" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 40053 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "eaa6f3dc13d643b9acfd8df1263a456d" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 41395 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:22.832491 30669 consensus_queue.cc:260] T 17519d8368db4b08a84e4d7335c6fc4f P eaa6f3dc13d643b9acfd8df1263a456d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1daf23b3538498bb795a60d627b6ac0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 36109 } } peers { permanent_uuid: "d7def43826924f03b8858383f0dc69f4" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 40053 } } peers { permanent_uuid: "eaa6f3dc13d643b9acfd8df1263a456d" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 41395 } }
I20260709 13:09:22.836139 30669 ts_tablet_manager.cc:1434] T 17519d8368db4b08a84e4d7335c6fc4f P eaa6f3dc13d643b9acfd8df1263a456d: Time spent starting tablet: real 0.015s	user 0.008s	sys 0.002s
I20260709 13:09:22.837119 30669 tablet_bootstrap.cc:492] T 734911241b624e74aadb0e38ed5b0362 P eaa6f3dc13d643b9acfd8df1263a456d: Bootstrap starting.
I20260709 13:09:22.837934 30711 raft_consensus.cc:2749] T d6e07afd07294d7d80ca32fa1f97e4a1 P eaa6f3dc13d643b9acfd8df1263a456d [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:22.841923 30669 tablet_bootstrap.cc:654] T 734911241b624e74aadb0e38ed5b0362 P eaa6f3dc13d643b9acfd8df1263a456d: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:22.842407 30370 catalog_manager.cc:5697] T d121c37db92f49c4a789269d64b00a12 P b1daf23b3538498bb795a60d627b6ac0 reported cstate change: term changed from 0 to 1, leader changed from <none> to b1daf23b3538498bb795a60d627b6ac0 (127.17.223.1). New cstate: current_term: 1 leader_uuid: "b1daf23b3538498bb795a60d627b6ac0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1daf23b3538498bb795a60d627b6ac0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 36109 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d7def43826924f03b8858383f0dc69f4" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 40053 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "eaa6f3dc13d643b9acfd8df1263a456d" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 41395 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:22.844323 30370 catalog_manager.cc:5697] T 131d025784b94fe8bab12c27e5176e73 P b1daf23b3538498bb795a60d627b6ac0 reported cstate change: term changed from 0 to 1, leader changed from <none> to b1daf23b3538498bb795a60d627b6ac0 (127.17.223.1). New cstate: current_term: 1 leader_uuid: "b1daf23b3538498bb795a60d627b6ac0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7def43826924f03b8858383f0dc69f4" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 40053 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b1daf23b3538498bb795a60d627b6ac0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 36109 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "eaa6f3dc13d643b9acfd8df1263a456d" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 41395 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:22.847457 30669 tablet_bootstrap.cc:492] T 734911241b624e74aadb0e38ed5b0362 P eaa6f3dc13d643b9acfd8df1263a456d: No bootstrap required, opened a new log
I20260709 13:09:22.847923 30669 ts_tablet_manager.cc:1403] T 734911241b624e74aadb0e38ed5b0362 P eaa6f3dc13d643b9acfd8df1263a456d: Time spent bootstrapping tablet: real 0.011s	user 0.009s	sys 0.000s
I20260709 13:09:22.847138 30370 catalog_manager.cc:5697] T d6e07afd07294d7d80ca32fa1f97e4a1 P b1daf23b3538498bb795a60d627b6ac0 reported cstate change: term changed from 0 to 1, leader changed from <none> to b1daf23b3538498bb795a60d627b6ac0 (127.17.223.1). New cstate: current_term: 1 leader_uuid: "b1daf23b3538498bb795a60d627b6ac0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1daf23b3538498bb795a60d627b6ac0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 36109 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d7def43826924f03b8858383f0dc69f4" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 40053 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "eaa6f3dc13d643b9acfd8df1263a456d" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 41395 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:22.849036 30370 catalog_manager.cc:5697] T 734911241b624e74aadb0e38ed5b0362 P b1daf23b3538498bb795a60d627b6ac0 reported cstate change: term changed from 0 to 1, leader changed from <none> to b1daf23b3538498bb795a60d627b6ac0 (127.17.223.1). New cstate: current_term: 1 leader_uuid: "b1daf23b3538498bb795a60d627b6ac0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1daf23b3538498bb795a60d627b6ac0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 36109 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d7def43826924f03b8858383f0dc69f4" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 40053 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "eaa6f3dc13d643b9acfd8df1263a456d" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 41395 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:22.849187 30373 catalog_manager.cc:5697] T 4ad6f5c1312c488b8d331c1ecb412800 P eaa6f3dc13d643b9acfd8df1263a456d reported cstate change: term changed from 0 to 1, leader changed from <none> to eaa6f3dc13d643b9acfd8df1263a456d (127.17.223.3). New cstate: current_term: 1 leader_uuid: "eaa6f3dc13d643b9acfd8df1263a456d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1daf23b3538498bb795a60d627b6ac0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 36109 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d7def43826924f03b8858383f0dc69f4" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 40053 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "eaa6f3dc13d643b9acfd8df1263a456d" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 41395 } health_report { overall_health: HEALTHY } } }
I20260709 13:09:22.850761 30669 raft_consensus.cc:359] T 734911241b624e74aadb0e38ed5b0362 P eaa6f3dc13d643b9acfd8df1263a456d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1daf23b3538498bb795a60d627b6ac0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 36109 } } peers { permanent_uuid: "d7def43826924f03b8858383f0dc69f4" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 40053 } } peers { permanent_uuid: "eaa6f3dc13d643b9acfd8df1263a456d" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 41395 } }
I20260709 13:09:22.851462 30669 raft_consensus.cc:385] T 734911241b624e74aadb0e38ed5b0362 P eaa6f3dc13d643b9acfd8df1263a456d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:22.851734 30669 raft_consensus.cc:740] T 734911241b624e74aadb0e38ed5b0362 P eaa6f3dc13d643b9acfd8df1263a456d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eaa6f3dc13d643b9acfd8df1263a456d, State: Initialized, Role: FOLLOWER
I20260709 13:09:22.852497 30669 consensus_queue.cc:260] T 734911241b624e74aadb0e38ed5b0362 P eaa6f3dc13d643b9acfd8df1263a456d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1daf23b3538498bb795a60d627b6ac0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 36109 } } peers { permanent_uuid: "d7def43826924f03b8858383f0dc69f4" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 40053 } } peers { permanent_uuid: "eaa6f3dc13d643b9acfd8df1263a456d" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 41395 } }
I20260709 13:09:22.854161 30669 ts_tablet_manager.cc:1434] T 734911241b624e74aadb0e38ed5b0362 P eaa6f3dc13d643b9acfd8df1263a456d: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 13:09:22.853991 30372 catalog_manager.cc:5697] T 687db47721c34eb3918dc02f98170722 P d7def43826924f03b8858383f0dc69f4 reported cstate change: term changed from 0 to 1, leader changed from <none> to d7def43826924f03b8858383f0dc69f4 (127.17.223.2). New cstate: current_term: 1 leader_uuid: "d7def43826924f03b8858383f0dc69f4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1daf23b3538498bb795a60d627b6ac0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 36109 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d7def43826924f03b8858383f0dc69f4" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 40053 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "eaa6f3dc13d643b9acfd8df1263a456d" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 41395 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:22.916788 30548 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f406da2fcdaa4facbd59848fdd5eeeb3"
dest_uuid: "d7def43826924f03b8858383f0dc69f4"
mode: GRACEFUL
new_leader_uuid: "b1daf23b3538498bb795a60d627b6ac0"
 from {username='slave'} at 127.0.0.1:52322
I20260709 13:09:22.917407 30548 raft_consensus.cc:606] T f406da2fcdaa4facbd59848fdd5eeeb3 P d7def43826924f03b8858383f0dc69f4 [term 1 LEADER]: Received request to transfer leadership to TS b1daf23b3538498bb795a60d627b6ac0
I20260709 13:09:22.922340 30548 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "17519d8368db4b08a84e4d7335c6fc4f"
dest_uuid: "d7def43826924f03b8858383f0dc69f4"
mode: GRACEFUL
new_leader_uuid: "b1daf23b3538498bb795a60d627b6ac0"
 from {username='slave'} at 127.0.0.1:52322
I20260709 13:09:22.922876 30548 raft_consensus.cc:606] T 17519d8368db4b08a84e4d7335c6fc4f P d7def43826924f03b8858383f0dc69f4 [term 1 LEADER]: Received request to transfer leadership to TS b1daf23b3538498bb795a60d627b6ac0
I20260709 13:09:22.937302 30476 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "734911241b624e74aadb0e38ed5b0362"
dest_uuid: "b1daf23b3538498bb795a60d627b6ac0"
mode: GRACEFUL
new_leader_uuid: "d7def43826924f03b8858383f0dc69f4"
 from {username='slave'} at 127.0.0.1:43194
I20260709 13:09:22.937775 30476 raft_consensus.cc:606] T 734911241b624e74aadb0e38ed5b0362 P b1daf23b3538498bb795a60d627b6ac0 [term 1 LEADER]: Received request to transfer leadership to TS d7def43826924f03b8858383f0dc69f4
I20260709 13:09:22.942948 30476 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d6e07afd07294d7d80ca32fa1f97e4a1"
dest_uuid: "b1daf23b3538498bb795a60d627b6ac0"
mode: GRACEFUL
new_leader_uuid: "d7def43826924f03b8858383f0dc69f4"
 from {username='slave'} at 127.0.0.1:43194
I20260709 13:09:22.943548 30476 raft_consensus.cc:606] T d6e07afd07294d7d80ca32fa1f97e4a1 P b1daf23b3538498bb795a60d627b6ac0 [term 1 LEADER]: Received request to transfer leadership to TS d7def43826924f03b8858383f0dc69f4
I20260709 13:09:22.957191 30624 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4ad6f5c1312c488b8d331c1ecb412800"
dest_uuid: "eaa6f3dc13d643b9acfd8df1263a456d"
mode: GRACEFUL
new_leader_uuid: "d7def43826924f03b8858383f0dc69f4"
 from {username='slave'} at 127.0.0.1:37554
I20260709 13:09:22.957778 30624 raft_consensus.cc:606] T 4ad6f5c1312c488b8d331c1ecb412800 P eaa6f3dc13d643b9acfd8df1263a456d [term 1 LEADER]: Received request to transfer leadership to TS d7def43826924f03b8858383f0dc69f4
I20260709 13:09:22.962836 30476 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ad8233fe86c64f6380f513881e6c3268"
dest_uuid: "b1daf23b3538498bb795a60d627b6ac0"
mode: GRACEFUL
new_leader_uuid: "eaa6f3dc13d643b9acfd8df1263a456d"
 from {username='slave'} at 127.0.0.1:43194
I20260709 13:09:22.963366 30476 raft_consensus.cc:606] T ad8233fe86c64f6380f513881e6c3268 P b1daf23b3538498bb795a60d627b6ac0 [term 1 LEADER]: Received request to transfer leadership to TS eaa6f3dc13d643b9acfd8df1263a456d
I20260709 13:09:23.018501 30698 consensus_queue.cc:1048] T f406da2fcdaa4facbd59848fdd5eeeb3 P d7def43826924f03b8858383f0dc69f4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1daf23b3538498bb795a60d627b6ac0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 36109 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:23.024827 30686 raft_consensus.cc:993] T f406da2fcdaa4facbd59848fdd5eeeb3 P d7def43826924f03b8858383f0dc69f4: : Instructing follower b1daf23b3538498bb795a60d627b6ac0 to start an election
I20260709 13:09:23.025342 30699 raft_consensus.cc:1081] T f406da2fcdaa4facbd59848fdd5eeeb3 P d7def43826924f03b8858383f0dc69f4 [term 1 LEADER]: Signalling peer b1daf23b3538498bb795a60d627b6ac0 to start an election
I20260709 13:09:23.028015 30475 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f406da2fcdaa4facbd59848fdd5eeeb3"
dest_uuid: "b1daf23b3538498bb795a60d627b6ac0"
 from {username='slave'} at 127.0.0.1:43172
I20260709 13:09:23.030850 30475 raft_consensus.cc:493] T f406da2fcdaa4facbd59848fdd5eeeb3 P b1daf23b3538498bb795a60d627b6ac0 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:09:23.031287 30475 raft_consensus.cc:3060] T f406da2fcdaa4facbd59848fdd5eeeb3 P b1daf23b3538498bb795a60d627b6ac0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:23.034214 30686 consensus_queue.cc:1048] T f406da2fcdaa4facbd59848fdd5eeeb3 P d7def43826924f03b8858383f0dc69f4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eaa6f3dc13d643b9acfd8df1263a456d" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 41395 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:23.038434 30475 raft_consensus.cc:515] T f406da2fcdaa4facbd59848fdd5eeeb3 P b1daf23b3538498bb795a60d627b6ac0 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1daf23b3538498bb795a60d627b6ac0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 36109 } } peers { permanent_uuid: "d7def43826924f03b8858383f0dc69f4" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 40053 } } peers { permanent_uuid: "eaa6f3dc13d643b9acfd8df1263a456d" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 41395 } }
I20260709 13:09:23.044497 30475 leader_election.cc:290] T f406da2fcdaa4facbd59848fdd5eeeb3 P b1daf23b3538498bb795a60d627b6ac0 [CANDIDATE]: Term 2 election: Requested vote from peers d7def43826924f03b8858383f0dc69f4 (127.17.223.2:40053), eaa6f3dc13d643b9acfd8df1263a456d (127.17.223.3:41395)
I20260709 13:09:23.045990 30548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f406da2fcdaa4facbd59848fdd5eeeb3" candidate_uuid: "b1daf23b3538498bb795a60d627b6ac0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d7def43826924f03b8858383f0dc69f4"
I20260709 13:09:23.046609 30548 raft_consensus.cc:3055] T f406da2fcdaa4facbd59848fdd5eeeb3 P d7def43826924f03b8858383f0dc69f4 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:09:23.047006 30548 raft_consensus.cc:740] T f406da2fcdaa4facbd59848fdd5eeeb3 P d7def43826924f03b8858383f0dc69f4 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: d7def43826924f03b8858383f0dc69f4, State: Running, Role: LEADER
I20260709 13:09:23.047479 30624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f406da2fcdaa4facbd59848fdd5eeeb3" candidate_uuid: "b1daf23b3538498bb795a60d627b6ac0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "eaa6f3dc13d643b9acfd8df1263a456d"
I20260709 13:09:23.048125 30624 raft_consensus.cc:3060] T f406da2fcdaa4facbd59848fdd5eeeb3 P eaa6f3dc13d643b9acfd8df1263a456d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:23.047796 30548 consensus_queue.cc:260] T f406da2fcdaa4facbd59848fdd5eeeb3 P d7def43826924f03b8858383f0dc69f4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1daf23b3538498bb795a60d627b6ac0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 36109 } } peers { permanent_uuid: "d7def43826924f03b8858383f0dc69f4" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 40053 } } peers { permanent_uuid: "eaa6f3dc13d643b9acfd8df1263a456d" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 41395 } }
I20260709 13:09:23.049171 30548 raft_consensus.cc:3060] T f406da2fcdaa4facbd59848fdd5eeeb3 P d7def43826924f03b8858383f0dc69f4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:23.054255 30624 raft_consensus.cc:2468] T f406da2fcdaa4facbd59848fdd5eeeb3 P eaa6f3dc13d643b9acfd8df1263a456d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b1daf23b3538498bb795a60d627b6ac0 in term 2.
I20260709 13:09:23.054294 30548 raft_consensus.cc:2468] T f406da2fcdaa4facbd59848fdd5eeeb3 P d7def43826924f03b8858383f0dc69f4 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b1daf23b3538498bb795a60d627b6ac0 in term 2.
I20260709 13:09:23.055395 30439 leader_election.cc:304] T f406da2fcdaa4facbd59848fdd5eeeb3 P b1daf23b3538498bb795a60d627b6ac0 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b1daf23b3538498bb795a60d627b6ac0, eaa6f3dc13d643b9acfd8df1263a456d; no voters: 
I20260709 13:09:23.056106 30706 raft_consensus.cc:2804] T f406da2fcdaa4facbd59848fdd5eeeb3 P b1daf23b3538498bb795a60d627b6ac0 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:09:23.056607 30706 raft_consensus.cc:697] T f406da2fcdaa4facbd59848fdd5eeeb3 P b1daf23b3538498bb795a60d627b6ac0 [term 2 LEADER]: Becoming Leader. State: Replica: b1daf23b3538498bb795a60d627b6ac0, State: Running, Role: LEADER
I20260709 13:09:23.057405 30706 consensus_queue.cc:237] T f406da2fcdaa4facbd59848fdd5eeeb3 P b1daf23b3538498bb795a60d627b6ac0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1daf23b3538498bb795a60d627b6ac0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 36109 } } peers { permanent_uuid: "d7def43826924f03b8858383f0dc69f4" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 40053 } } peers { permanent_uuid: "eaa6f3dc13d643b9acfd8df1263a456d" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 41395 } }
I20260709 13:09:23.073717 30686 consensus_queue.cc:1048] T 17519d8368db4b08a84e4d7335c6fc4f P d7def43826924f03b8858383f0dc69f4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1daf23b3538498bb795a60d627b6ac0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 36109 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:23.075923 30370 catalog_manager.cc:5697] T f406da2fcdaa4facbd59848fdd5eeeb3 P b1daf23b3538498bb795a60d627b6ac0 reported cstate change: term changed from 1 to 2, leader changed from d7def43826924f03b8858383f0dc69f4 (127.17.223.2) to b1daf23b3538498bb795a60d627b6ac0 (127.17.223.1). New cstate: current_term: 2 leader_uuid: "b1daf23b3538498bb795a60d627b6ac0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1daf23b3538498bb795a60d627b6ac0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 36109 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d7def43826924f03b8858383f0dc69f4" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 40053 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "eaa6f3dc13d643b9acfd8df1263a456d" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 41395 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:23.080080 30699 raft_consensus.cc:993] T 17519d8368db4b08a84e4d7335c6fc4f P d7def43826924f03b8858383f0dc69f4: : Instructing follower b1daf23b3538498bb795a60d627b6ac0 to start an election
I20260709 13:09:23.080600 30698 raft_consensus.cc:1081] T 17519d8368db4b08a84e4d7335c6fc4f P d7def43826924f03b8858383f0dc69f4 [term 1 LEADER]: Signalling peer b1daf23b3538498bb795a60d627b6ac0 to start an election
I20260709 13:09:23.083724 30476 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "17519d8368db4b08a84e4d7335c6fc4f"
dest_uuid: "b1daf23b3538498bb795a60d627b6ac0"
 from {username='slave'} at 127.0.0.1:43172
I20260709 13:09:23.083917 30624 raft_consensus.cc:3060] T 17519d8368db4b08a84e4d7335c6fc4f P eaa6f3dc13d643b9acfd8df1263a456d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:23.089089 30476 raft_consensus.cc:493] T 17519d8368db4b08a84e4d7335c6fc4f P b1daf23b3538498bb795a60d627b6ac0 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:09:23.089548 30476 raft_consensus.cc:3060] T 17519d8368db4b08a84e4d7335c6fc4f P b1daf23b3538498bb795a60d627b6ac0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:23.092264 30698 consensus_queue.cc:1048] T 17519d8368db4b08a84e4d7335c6fc4f P d7def43826924f03b8858383f0dc69f4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eaa6f3dc13d643b9acfd8df1263a456d" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 41395 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:23.096680 30476 raft_consensus.cc:515] T 17519d8368db4b08a84e4d7335c6fc4f P b1daf23b3538498bb795a60d627b6ac0 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1daf23b3538498bb795a60d627b6ac0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 36109 } } peers { permanent_uuid: "d7def43826924f03b8858383f0dc69f4" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 40053 } } peers { permanent_uuid: "eaa6f3dc13d643b9acfd8df1263a456d" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 41395 } }
I20260709 13:09:23.099476 30476 leader_election.cc:290] T 17519d8368db4b08a84e4d7335c6fc4f P b1daf23b3538498bb795a60d627b6ac0 [CANDIDATE]: Term 2 election: Requested vote from peers d7def43826924f03b8858383f0dc69f4 (127.17.223.2:40053), eaa6f3dc13d643b9acfd8df1263a456d (127.17.223.3:41395)
I20260709 13:09:23.100186 30548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17519d8368db4b08a84e4d7335c6fc4f" candidate_uuid: "b1daf23b3538498bb795a60d627b6ac0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d7def43826924f03b8858383f0dc69f4"
I20260709 13:09:23.100870 30548 raft_consensus.cc:3055] T 17519d8368db4b08a84e4d7335c6fc4f P d7def43826924f03b8858383f0dc69f4 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:09:23.101044 30624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17519d8368db4b08a84e4d7335c6fc4f" candidate_uuid: "b1daf23b3538498bb795a60d627b6ac0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "eaa6f3dc13d643b9acfd8df1263a456d"
I20260709 13:09:23.101249 30548 raft_consensus.cc:740] T 17519d8368db4b08a84e4d7335c6fc4f P d7def43826924f03b8858383f0dc69f4 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: d7def43826924f03b8858383f0dc69f4, State: Running, Role: LEADER
I20260709 13:09:23.101666 30624 raft_consensus.cc:3060] T 17519d8368db4b08a84e4d7335c6fc4f P eaa6f3dc13d643b9acfd8df1263a456d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:23.102133 30548 consensus_queue.cc:260] T 17519d8368db4b08a84e4d7335c6fc4f P d7def43826924f03b8858383f0dc69f4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1daf23b3538498bb795a60d627b6ac0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 36109 } } peers { permanent_uuid: "d7def43826924f03b8858383f0dc69f4" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 40053 } } peers { permanent_uuid: "eaa6f3dc13d643b9acfd8df1263a456d" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 41395 } }
I20260709 13:09:23.103488 30548 raft_consensus.cc:3060] T 17519d8368db4b08a84e4d7335c6fc4f P d7def43826924f03b8858383f0dc69f4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:23.108959 30624 raft_consensus.cc:2468] T 17519d8368db4b08a84e4d7335c6fc4f P eaa6f3dc13d643b9acfd8df1263a456d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b1daf23b3538498bb795a60d627b6ac0 in term 2.
I20260709 13:09:23.110466 30548 raft_consensus.cc:2468] T 17519d8368db4b08a84e4d7335c6fc4f P d7def43826924f03b8858383f0dc69f4 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b1daf23b3538498bb795a60d627b6ac0 in term 2.
I20260709 13:09:23.111548 30439 leader_election.cc:304] T 17519d8368db4b08a84e4d7335c6fc4f P b1daf23b3538498bb795a60d627b6ac0 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b1daf23b3538498bb795a60d627b6ac0, eaa6f3dc13d643b9acfd8df1263a456d; no voters: 
I20260709 13:09:23.112272 30706 raft_consensus.cc:2804] T 17519d8368db4b08a84e4d7335c6fc4f P b1daf23b3538498bb795a60d627b6ac0 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:09:23.112733 30706 raft_consensus.cc:697] T 17519d8368db4b08a84e4d7335c6fc4f P b1daf23b3538498bb795a60d627b6ac0 [term 2 LEADER]: Becoming Leader. State: Replica: b1daf23b3538498bb795a60d627b6ac0, State: Running, Role: LEADER
I20260709 13:09:23.113533 30706 consensus_queue.cc:237] T 17519d8368db4b08a84e4d7335c6fc4f P b1daf23b3538498bb795a60d627b6ac0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1daf23b3538498bb795a60d627b6ac0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 36109 } } peers { permanent_uuid: "d7def43826924f03b8858383f0dc69f4" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 40053 } } peers { permanent_uuid: "eaa6f3dc13d643b9acfd8df1263a456d" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 41395 } }
I20260709 13:09:23.120401 30372 catalog_manager.cc:5697] T 17519d8368db4b08a84e4d7335c6fc4f P b1daf23b3538498bb795a60d627b6ac0 reported cstate change: term changed from 1 to 2, leader changed from d7def43826924f03b8858383f0dc69f4 (127.17.223.2) to b1daf23b3538498bb795a60d627b6ac0 (127.17.223.1). New cstate: current_term: 2 leader_uuid: "b1daf23b3538498bb795a60d627b6ac0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1daf23b3538498bb795a60d627b6ac0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 36109 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d7def43826924f03b8858383f0dc69f4" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 40053 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "eaa6f3dc13d643b9acfd8df1263a456d" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 41395 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:23.130687 30706 consensus_queue.cc:1048] T ad8233fe86c64f6380f513881e6c3268 P b1daf23b3538498bb795a60d627b6ac0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eaa6f3dc13d643b9acfd8df1263a456d" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 41395 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:23.136833 30709 raft_consensus.cc:993] T ad8233fe86c64f6380f513881e6c3268 P b1daf23b3538498bb795a60d627b6ac0: : Instructing follower eaa6f3dc13d643b9acfd8df1263a456d to start an election
I20260709 13:09:23.137344 30702 raft_consensus.cc:1081] T ad8233fe86c64f6380f513881e6c3268 P b1daf23b3538498bb795a60d627b6ac0 [term 1 LEADER]: Signalling peer eaa6f3dc13d643b9acfd8df1263a456d to start an election
I20260709 13:09:23.139003 30625 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ad8233fe86c64f6380f513881e6c3268"
dest_uuid: "eaa6f3dc13d643b9acfd8df1263a456d"
 from {username='slave'} at 127.0.0.1:37548
I20260709 13:09:23.140131 30625 raft_consensus.cc:493] T ad8233fe86c64f6380f513881e6c3268 P eaa6f3dc13d643b9acfd8df1263a456d [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:09:23.140551 30625 raft_consensus.cc:3060] T ad8233fe86c64f6380f513881e6c3268 P eaa6f3dc13d643b9acfd8df1263a456d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:23.143512 30702 consensus_queue.cc:1048] T ad8233fe86c64f6380f513881e6c3268 P b1daf23b3538498bb795a60d627b6ac0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7def43826924f03b8858383f0dc69f4" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 40053 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:23.148550 30625 raft_consensus.cc:515] T ad8233fe86c64f6380f513881e6c3268 P eaa6f3dc13d643b9acfd8df1263a456d [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1daf23b3538498bb795a60d627b6ac0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 36109 } } peers { permanent_uuid: "d7def43826924f03b8858383f0dc69f4" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 40053 } } peers { permanent_uuid: "eaa6f3dc13d643b9acfd8df1263a456d" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 41395 } }
I20260709 13:09:23.154299 30625 leader_election.cc:290] T ad8233fe86c64f6380f513881e6c3268 P eaa6f3dc13d643b9acfd8df1263a456d [CANDIDATE]: Term 2 election: Requested vote from peers b1daf23b3538498bb795a60d627b6ac0 (127.17.223.1:36109), d7def43826924f03b8858383f0dc69f4 (127.17.223.2:40053)
I20260709 13:09:23.156303 30548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad8233fe86c64f6380f513881e6c3268" candidate_uuid: "eaa6f3dc13d643b9acfd8df1263a456d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d7def43826924f03b8858383f0dc69f4"
I20260709 13:09:23.156940 30548 raft_consensus.cc:3060] T ad8233fe86c64f6380f513881e6c3268 P d7def43826924f03b8858383f0dc69f4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:23.157423 30476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad8233fe86c64f6380f513881e6c3268" candidate_uuid: "eaa6f3dc13d643b9acfd8df1263a456d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b1daf23b3538498bb795a60d627b6ac0"
I20260709 13:09:23.158087 30476 raft_consensus.cc:3055] T ad8233fe86c64f6380f513881e6c3268 P b1daf23b3538498bb795a60d627b6ac0 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:09:23.158428 30476 raft_consensus.cc:740] T ad8233fe86c64f6380f513881e6c3268 P b1daf23b3538498bb795a60d627b6ac0 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b1daf23b3538498bb795a60d627b6ac0, State: Running, Role: LEADER
I20260709 13:09:23.159307 30476 consensus_queue.cc:260] T ad8233fe86c64f6380f513881e6c3268 P b1daf23b3538498bb795a60d627b6ac0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1daf23b3538498bb795a60d627b6ac0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 36109 } } peers { permanent_uuid: "d7def43826924f03b8858383f0dc69f4" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 40053 } } peers { permanent_uuid: "eaa6f3dc13d643b9acfd8df1263a456d" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 41395 } }
I20260709 13:09:23.160851 30476 raft_consensus.cc:3060] T ad8233fe86c64f6380f513881e6c3268 P b1daf23b3538498bb795a60d627b6ac0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:23.165046 30548 raft_consensus.cc:2468] T ad8233fe86c64f6380f513881e6c3268 P d7def43826924f03b8858383f0dc69f4 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eaa6f3dc13d643b9acfd8df1263a456d in term 2.
I20260709 13:09:23.165539 30702 consensus_queue.cc:1048] T d121c37db92f49c4a789269d64b00a12 P b1daf23b3538498bb795a60d627b6ac0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eaa6f3dc13d643b9acfd8df1263a456d" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 41395 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:23.166323 30588 leader_election.cc:304] T ad8233fe86c64f6380f513881e6c3268 P eaa6f3dc13d643b9acfd8df1263a456d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d7def43826924f03b8858383f0dc69f4, eaa6f3dc13d643b9acfd8df1263a456d; no voters: 
I20260709 13:09:23.167217 30711 raft_consensus.cc:2804] T ad8233fe86c64f6380f513881e6c3268 P eaa6f3dc13d643b9acfd8df1263a456d [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:09:23.167742 30711 raft_consensus.cc:697] T ad8233fe86c64f6380f513881e6c3268 P eaa6f3dc13d643b9acfd8df1263a456d [term 2 LEADER]: Becoming Leader. State: Replica: eaa6f3dc13d643b9acfd8df1263a456d, State: Running, Role: LEADER
I20260709 13:09:23.168408 30476 raft_consensus.cc:2468] T ad8233fe86c64f6380f513881e6c3268 P b1daf23b3538498bb795a60d627b6ac0 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eaa6f3dc13d643b9acfd8df1263a456d in term 2.
I20260709 13:09:23.168565 30711 consensus_queue.cc:237] T ad8233fe86c64f6380f513881e6c3268 P eaa6f3dc13d643b9acfd8df1263a456d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1daf23b3538498bb795a60d627b6ac0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 36109 } } peers { permanent_uuid: "d7def43826924f03b8858383f0dc69f4" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 40053 } } peers { permanent_uuid: "eaa6f3dc13d643b9acfd8df1263a456d" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 41395 } }
I20260709 13:09:23.176468 30370 catalog_manager.cc:5697] T ad8233fe86c64f6380f513881e6c3268 P eaa6f3dc13d643b9acfd8df1263a456d reported cstate change: term changed from 1 to 2, leader changed from b1daf23b3538498bb795a60d627b6ac0 (127.17.223.1) to eaa6f3dc13d643b9acfd8df1263a456d (127.17.223.3). New cstate: current_term: 2 leader_uuid: "eaa6f3dc13d643b9acfd8df1263a456d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1daf23b3538498bb795a60d627b6ac0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 36109 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d7def43826924f03b8858383f0dc69f4" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 40053 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "eaa6f3dc13d643b9acfd8df1263a456d" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 41395 } health_report { overall_health: HEALTHY } } }
I20260709 13:09:23.178453 30670 consensus_queue.cc:1048] T d121c37db92f49c4a789269d64b00a12 P b1daf23b3538498bb795a60d627b6ac0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7def43826924f03b8858383f0dc69f4" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 40053 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:23.201843 30686 consensus_queue.cc:1048] T 687db47721c34eb3918dc02f98170722 P d7def43826924f03b8858383f0dc69f4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1daf23b3538498bb795a60d627b6ac0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 36109 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:23.207571 30711 raft_consensus.cc:493] T 734911241b624e74aadb0e38ed5b0362 P eaa6f3dc13d643b9acfd8df1263a456d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:23.208173 30711 raft_consensus.cc:515] T 734911241b624e74aadb0e38ed5b0362 P eaa6f3dc13d643b9acfd8df1263a456d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1daf23b3538498bb795a60d627b6ac0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 36109 } } peers { permanent_uuid: "d7def43826924f03b8858383f0dc69f4" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 40053 } } peers { permanent_uuid: "eaa6f3dc13d643b9acfd8df1263a456d" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 41395 } }
I20260709 13:09:23.210217 30711 leader_election.cc:290] T 734911241b624e74aadb0e38ed5b0362 P eaa6f3dc13d643b9acfd8df1263a456d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b1daf23b3538498bb795a60d627b6ac0 (127.17.223.1:36109), d7def43826924f03b8858383f0dc69f4 (127.17.223.2:40053)
I20260709 13:09:23.211721 30476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "734911241b624e74aadb0e38ed5b0362" candidate_uuid: "eaa6f3dc13d643b9acfd8df1263a456d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1daf23b3538498bb795a60d627b6ac0" is_pre_election: true
I20260709 13:09:23.211941 30548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "734911241b624e74aadb0e38ed5b0362" candidate_uuid: "eaa6f3dc13d643b9acfd8df1263a456d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d7def43826924f03b8858383f0dc69f4" is_pre_election: true
I20260709 13:09:23.212666 30548 raft_consensus.cc:2393] T 734911241b624e74aadb0e38ed5b0362 P d7def43826924f03b8858383f0dc69f4 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate eaa6f3dc13d643b9acfd8df1263a456d in current term 1: Already voted for candidate b1daf23b3538498bb795a60d627b6ac0 in this term.
I20260709 13:09:23.213428 30698 consensus_queue.cc:1048] T 687db47721c34eb3918dc02f98170722 P d7def43826924f03b8858383f0dc69f4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eaa6f3dc13d643b9acfd8df1263a456d" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 41395 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:23.214340 30588 leader_election.cc:304] T 734911241b624e74aadb0e38ed5b0362 P eaa6f3dc13d643b9acfd8df1263a456d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eaa6f3dc13d643b9acfd8df1263a456d; no voters: b1daf23b3538498bb795a60d627b6ac0, d7def43826924f03b8858383f0dc69f4
I20260709 13:09:23.215504 30711 raft_consensus.cc:3060] T 734911241b624e74aadb0e38ed5b0362 P eaa6f3dc13d643b9acfd8df1263a456d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:23.225378 30711 raft_consensus.cc:2749] T 734911241b624e74aadb0e38ed5b0362 P eaa6f3dc13d643b9acfd8df1263a456d [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:23.232618 30670 consensus_queue.cc:1048] T d6e07afd07294d7d80ca32fa1f97e4a1 P b1daf23b3538498bb795a60d627b6ac0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eaa6f3dc13d643b9acfd8df1263a456d" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 41395 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:23.235633 30670 consensus_queue.cc:1048] T 131d025784b94fe8bab12c27e5176e73 P b1daf23b3538498bb795a60d627b6ac0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7def43826924f03b8858383f0dc69f4" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 40053 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:23.246834 30670 consensus_queue.cc:1048] T d6e07afd07294d7d80ca32fa1f97e4a1 P b1daf23b3538498bb795a60d627b6ac0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7def43826924f03b8858383f0dc69f4" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 40053 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:09:23.257779 30670 consensus_queue.cc:1048] T 131d025784b94fe8bab12c27e5176e73 P b1daf23b3538498bb795a60d627b6ac0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eaa6f3dc13d643b9acfd8df1263a456d" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 41395 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:23.261142 30706 raft_consensus.cc:993] T d6e07afd07294d7d80ca32fa1f97e4a1 P b1daf23b3538498bb795a60d627b6ac0: : Instructing follower d7def43826924f03b8858383f0dc69f4 to start an election
I20260709 13:09:23.261775 30706 raft_consensus.cc:1081] T d6e07afd07294d7d80ca32fa1f97e4a1 P b1daf23b3538498bb795a60d627b6ac0 [term 1 LEADER]: Signalling peer d7def43826924f03b8858383f0dc69f4 to start an election
I20260709 13:09:23.264140 30549 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d6e07afd07294d7d80ca32fa1f97e4a1"
dest_uuid: "d7def43826924f03b8858383f0dc69f4"
 from {username='slave'} at 127.0.0.1:52294
I20260709 13:09:23.264808 30549 raft_consensus.cc:493] T d6e07afd07294d7d80ca32fa1f97e4a1 P d7def43826924f03b8858383f0dc69f4 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:09:23.265179 30549 raft_consensus.cc:3060] T d6e07afd07294d7d80ca32fa1f97e4a1 P d7def43826924f03b8858383f0dc69f4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:23.272428 30549 raft_consensus.cc:515] T d6e07afd07294d7d80ca32fa1f97e4a1 P d7def43826924f03b8858383f0dc69f4 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1daf23b3538498bb795a60d627b6ac0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 36109 } } peers { permanent_uuid: "d7def43826924f03b8858383f0dc69f4" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 40053 } } peers { permanent_uuid: "eaa6f3dc13d643b9acfd8df1263a456d" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 41395 } }
I20260709 13:09:23.274096 30549 leader_election.cc:290] T d6e07afd07294d7d80ca32fa1f97e4a1 P d7def43826924f03b8858383f0dc69f4 [CANDIDATE]: Term 2 election: Requested vote from peers b1daf23b3538498bb795a60d627b6ac0 (127.17.223.1:36109), eaa6f3dc13d643b9acfd8df1263a456d (127.17.223.3:41395)
I20260709 13:09:23.274917 30475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6e07afd07294d7d80ca32fa1f97e4a1" candidate_uuid: "d7def43826924f03b8858383f0dc69f4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b1daf23b3538498bb795a60d627b6ac0"
I20260709 13:09:23.275089 30625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6e07afd07294d7d80ca32fa1f97e4a1" candidate_uuid: "d7def43826924f03b8858383f0dc69f4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "eaa6f3dc13d643b9acfd8df1263a456d"
I20260709 13:09:23.275514 30475 raft_consensus.cc:3055] T d6e07afd07294d7d80ca32fa1f97e4a1 P b1daf23b3538498bb795a60d627b6ac0 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:09:23.275660 30625 raft_consensus.cc:3060] T d6e07afd07294d7d80ca32fa1f97e4a1 P eaa6f3dc13d643b9acfd8df1263a456d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:23.275826 30475 raft_consensus.cc:740] T d6e07afd07294d7d80ca32fa1f97e4a1 P b1daf23b3538498bb795a60d627b6ac0 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b1daf23b3538498bb795a60d627b6ac0, State: Running, Role: LEADER
I20260709 13:09:23.276654 30475 consensus_queue.cc:260] T d6e07afd07294d7d80ca32fa1f97e4a1 P b1daf23b3538498bb795a60d627b6ac0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1daf23b3538498bb795a60d627b6ac0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 36109 } } peers { permanent_uuid: "d7def43826924f03b8858383f0dc69f4" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 40053 } } peers { permanent_uuid: "eaa6f3dc13d643b9acfd8df1263a456d" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 41395 } }
I20260709 13:09:23.277499 30475 raft_consensus.cc:3060] T d6e07afd07294d7d80ca32fa1f97e4a1 P b1daf23b3538498bb795a60d627b6ac0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:23.281105 30625 raft_consensus.cc:2468] T d6e07afd07294d7d80ca32fa1f97e4a1 P eaa6f3dc13d643b9acfd8df1263a456d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d7def43826924f03b8858383f0dc69f4 in term 2.
I20260709 13:09:23.282351 30514 leader_election.cc:304] T d6e07afd07294d7d80ca32fa1f97e4a1 P d7def43826924f03b8858383f0dc69f4 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d7def43826924f03b8858383f0dc69f4, eaa6f3dc13d643b9acfd8df1263a456d; no voters: 
I20260709 13:09:23.282708 30475 raft_consensus.cc:2468] T d6e07afd07294d7d80ca32fa1f97e4a1 P b1daf23b3538498bb795a60d627b6ac0 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d7def43826924f03b8858383f0dc69f4 in term 2.
I20260709 13:09:23.283098 30698 raft_consensus.cc:2804] T d6e07afd07294d7d80ca32fa1f97e4a1 P d7def43826924f03b8858383f0dc69f4 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:09:23.283638 30698 raft_consensus.cc:697] T d6e07afd07294d7d80ca32fa1f97e4a1 P d7def43826924f03b8858383f0dc69f4 [term 2 LEADER]: Becoming Leader. State: Replica: d7def43826924f03b8858383f0dc69f4, State: Running, Role: LEADER
I20260709 13:09:23.284821 30698 consensus_queue.cc:237] T d6e07afd07294d7d80ca32fa1f97e4a1 P d7def43826924f03b8858383f0dc69f4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1daf23b3538498bb795a60d627b6ac0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 36109 } } peers { permanent_uuid: "d7def43826924f03b8858383f0dc69f4" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 40053 } } peers { permanent_uuid: "eaa6f3dc13d643b9acfd8df1263a456d" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 41395 } }
I20260709 13:09:23.291762 30374 catalog_manager.cc:5697] T d6e07afd07294d7d80ca32fa1f97e4a1 P d7def43826924f03b8858383f0dc69f4 reported cstate change: term changed from 1 to 2, leader changed from b1daf23b3538498bb795a60d627b6ac0 (127.17.223.1) to d7def43826924f03b8858383f0dc69f4 (127.17.223.2). New cstate: current_term: 2 leader_uuid: "d7def43826924f03b8858383f0dc69f4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1daf23b3538498bb795a60d627b6ac0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 36109 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d7def43826924f03b8858383f0dc69f4" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 40053 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "eaa6f3dc13d643b9acfd8df1263a456d" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 41395 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:23.306278 30711 consensus_queue.cc:1048] T 4ad6f5c1312c488b8d331c1ecb412800 P eaa6f3dc13d643b9acfd8df1263a456d [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7def43826924f03b8858383f0dc69f4" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 40053 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:23.313314 30719 raft_consensus.cc:993] T 4ad6f5c1312c488b8d331c1ecb412800 P eaa6f3dc13d643b9acfd8df1263a456d: : Instructing follower d7def43826924f03b8858383f0dc69f4 to start an election
I20260709 13:09:23.313831 30676 raft_consensus.cc:1081] T 4ad6f5c1312c488b8d331c1ecb412800 P eaa6f3dc13d643b9acfd8df1263a456d [term 1 LEADER]: Signalling peer d7def43826924f03b8858383f0dc69f4 to start an election
I20260709 13:09:23.315508 30548 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "4ad6f5c1312c488b8d331c1ecb412800"
dest_uuid: "d7def43826924f03b8858383f0dc69f4"
 from {username='slave'} at 127.0.0.1:52310
I20260709 13:09:23.319645 30711 consensus_queue.cc:1048] T 4ad6f5c1312c488b8d331c1ecb412800 P eaa6f3dc13d643b9acfd8df1263a456d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1daf23b3538498bb795a60d627b6ac0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 36109 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:23.320163 30548 raft_consensus.cc:493] T 4ad6f5c1312c488b8d331c1ecb412800 P d7def43826924f03b8858383f0dc69f4 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:09:23.320641 30548 raft_consensus.cc:3060] T 4ad6f5c1312c488b8d331c1ecb412800 P d7def43826924f03b8858383f0dc69f4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:23.328974 30548 raft_consensus.cc:515] T 4ad6f5c1312c488b8d331c1ecb412800 P d7def43826924f03b8858383f0dc69f4 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1daf23b3538498bb795a60d627b6ac0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 36109 } } peers { permanent_uuid: "d7def43826924f03b8858383f0dc69f4" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 40053 } } peers { permanent_uuid: "eaa6f3dc13d643b9acfd8df1263a456d" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 41395 } }
I20260709 13:09:23.331687 30548 leader_election.cc:290] T 4ad6f5c1312c488b8d331c1ecb412800 P d7def43826924f03b8858383f0dc69f4 [CANDIDATE]: Term 2 election: Requested vote from peers b1daf23b3538498bb795a60d627b6ac0 (127.17.223.1:36109), eaa6f3dc13d643b9acfd8df1263a456d (127.17.223.3:41395)
I20260709 13:09:23.332701 30475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ad6f5c1312c488b8d331c1ecb412800" candidate_uuid: "d7def43826924f03b8858383f0dc69f4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b1daf23b3538498bb795a60d627b6ac0"
I20260709 13:09:23.333402 30475 raft_consensus.cc:3060] T 4ad6f5c1312c488b8d331c1ecb412800 P b1daf23b3538498bb795a60d627b6ac0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:23.333598 30625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ad6f5c1312c488b8d331c1ecb412800" candidate_uuid: "d7def43826924f03b8858383f0dc69f4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "eaa6f3dc13d643b9acfd8df1263a456d"
I20260709 13:09:23.334233 30625 raft_consensus.cc:3055] T 4ad6f5c1312c488b8d331c1ecb412800 P eaa6f3dc13d643b9acfd8df1263a456d [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:09:23.338070 30625 raft_consensus.cc:740] T 4ad6f5c1312c488b8d331c1ecb412800 P eaa6f3dc13d643b9acfd8df1263a456d [term 1 LEADER]: Becoming Follower/Learner. State: Replica: eaa6f3dc13d643b9acfd8df1263a456d, State: Running, Role: LEADER
I20260709 13:09:23.338557 30702 consensus_queue.cc:1048] T 734911241b624e74aadb0e38ed5b0362 P b1daf23b3538498bb795a60d627b6ac0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eaa6f3dc13d643b9acfd8df1263a456d" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 41395 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:09:23.338919 30625 consensus_queue.cc:260] T 4ad6f5c1312c488b8d331c1ecb412800 P eaa6f3dc13d643b9acfd8df1263a456d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1daf23b3538498bb795a60d627b6ac0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 36109 } } peers { permanent_uuid: "d7def43826924f03b8858383f0dc69f4" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 40053 } } peers { permanent_uuid: "eaa6f3dc13d643b9acfd8df1263a456d" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 41395 } }
I20260709 13:09:23.340263 30625 raft_consensus.cc:3060] T 4ad6f5c1312c488b8d331c1ecb412800 P eaa6f3dc13d643b9acfd8df1263a456d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:23.341104 30475 raft_consensus.cc:2468] T 4ad6f5c1312c488b8d331c1ecb412800 P b1daf23b3538498bb795a60d627b6ac0 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d7def43826924f03b8858383f0dc69f4 in term 2.
I20260709 13:09:23.342391 30514 leader_election.cc:304] T 4ad6f5c1312c488b8d331c1ecb412800 P d7def43826924f03b8858383f0dc69f4 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b1daf23b3538498bb795a60d627b6ac0, d7def43826924f03b8858383f0dc69f4; no voters: 
I20260709 13:09:23.343217 30698 raft_consensus.cc:2804] T 4ad6f5c1312c488b8d331c1ecb412800 P d7def43826924f03b8858383f0dc69f4 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:09:23.343695 30698 raft_consensus.cc:697] T 4ad6f5c1312c488b8d331c1ecb412800 P d7def43826924f03b8858383f0dc69f4 [term 2 LEADER]: Becoming Leader. State: Replica: d7def43826924f03b8858383f0dc69f4, State: Running, Role: LEADER
I20260709 13:09:23.344525 30698 consensus_queue.cc:237] T 4ad6f5c1312c488b8d331c1ecb412800 P d7def43826924f03b8858383f0dc69f4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1daf23b3538498bb795a60d627b6ac0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 36109 } } peers { permanent_uuid: "d7def43826924f03b8858383f0dc69f4" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 40053 } } peers { permanent_uuid: "eaa6f3dc13d643b9acfd8df1263a456d" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 41395 } }
I20260709 13:09:23.351490 30625 raft_consensus.cc:2468] T 4ad6f5c1312c488b8d331c1ecb412800 P eaa6f3dc13d643b9acfd8df1263a456d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d7def43826924f03b8858383f0dc69f4 in term 2.
I20260709 13:09:23.352445 30370 catalog_manager.cc:5697] T 4ad6f5c1312c488b8d331c1ecb412800 P d7def43826924f03b8858383f0dc69f4 reported cstate change: term changed from 1 to 2, leader changed from eaa6f3dc13d643b9acfd8df1263a456d (127.17.223.3) to d7def43826924f03b8858383f0dc69f4 (127.17.223.2). New cstate: current_term: 2 leader_uuid: "d7def43826924f03b8858383f0dc69f4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1daf23b3538498bb795a60d627b6ac0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 36109 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d7def43826924f03b8858383f0dc69f4" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 40053 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "eaa6f3dc13d643b9acfd8df1263a456d" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 41395 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:23.357757 30670 consensus_queue.cc:1048] T 734911241b624e74aadb0e38ed5b0362 P b1daf23b3538498bb795a60d627b6ac0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7def43826924f03b8858383f0dc69f4" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 40053 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:09:23.365062 30670 raft_consensus.cc:993] T 734911241b624e74aadb0e38ed5b0362 P b1daf23b3538498bb795a60d627b6ac0: : Instructing follower d7def43826924f03b8858383f0dc69f4 to start an election
I20260709 13:09:23.365558 30706 raft_consensus.cc:1081] T 734911241b624e74aadb0e38ed5b0362 P b1daf23b3538498bb795a60d627b6ac0 [term 1 LEADER]: Signalling peer d7def43826924f03b8858383f0dc69f4 to start an election
I20260709 13:09:23.367256 30548 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "734911241b624e74aadb0e38ed5b0362"
dest_uuid: "d7def43826924f03b8858383f0dc69f4"
 from {username='slave'} at 127.0.0.1:52294
I20260709 13:09:23.367729 30548 raft_consensus.cc:493] T 734911241b624e74aadb0e38ed5b0362 P d7def43826924f03b8858383f0dc69f4 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:09:23.368050 30548 raft_consensus.cc:3060] T 734911241b624e74aadb0e38ed5b0362 P d7def43826924f03b8858383f0dc69f4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:23.374272 30548 raft_consensus.cc:515] T 734911241b624e74aadb0e38ed5b0362 P d7def43826924f03b8858383f0dc69f4 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1daf23b3538498bb795a60d627b6ac0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 36109 } } peers { permanent_uuid: "d7def43826924f03b8858383f0dc69f4" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 40053 } } peers { permanent_uuid: "eaa6f3dc13d643b9acfd8df1263a456d" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 41395 } }
I20260709 13:09:23.376012 30548 leader_election.cc:290] T 734911241b624e74aadb0e38ed5b0362 P d7def43826924f03b8858383f0dc69f4 [CANDIDATE]: Term 2 election: Requested vote from peers b1daf23b3538498bb795a60d627b6ac0 (127.17.223.1:36109), eaa6f3dc13d643b9acfd8df1263a456d (127.17.223.3:41395)
I20260709 13:09:23.376709 30475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "734911241b624e74aadb0e38ed5b0362" candidate_uuid: "d7def43826924f03b8858383f0dc69f4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b1daf23b3538498bb795a60d627b6ac0"
I20260709 13:09:23.377056 30624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "734911241b624e74aadb0e38ed5b0362" candidate_uuid: "d7def43826924f03b8858383f0dc69f4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "eaa6f3dc13d643b9acfd8df1263a456d"
I20260709 13:09:23.377431 30475 raft_consensus.cc:3055] T 734911241b624e74aadb0e38ed5b0362 P b1daf23b3538498bb795a60d627b6ac0 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:09:23.377629 30624 raft_consensus.cc:3060] T 734911241b624e74aadb0e38ed5b0362 P eaa6f3dc13d643b9acfd8df1263a456d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:23.377816 30475 raft_consensus.cc:740] T 734911241b624e74aadb0e38ed5b0362 P b1daf23b3538498bb795a60d627b6ac0 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b1daf23b3538498bb795a60d627b6ac0, State: Running, Role: LEADER
I20260709 13:09:23.378722 30475 consensus_queue.cc:260] T 734911241b624e74aadb0e38ed5b0362 P b1daf23b3538498bb795a60d627b6ac0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1daf23b3538498bb795a60d627b6ac0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 36109 } } peers { permanent_uuid: "d7def43826924f03b8858383f0dc69f4" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 40053 } } peers { permanent_uuid: "eaa6f3dc13d643b9acfd8df1263a456d" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 41395 } }
I20260709 13:09:23.380025 30475 raft_consensus.cc:3060] T 734911241b624e74aadb0e38ed5b0362 P b1daf23b3538498bb795a60d627b6ac0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:23.384961 30624 raft_consensus.cc:2468] T 734911241b624e74aadb0e38ed5b0362 P eaa6f3dc13d643b9acfd8df1263a456d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d7def43826924f03b8858383f0dc69f4 in term 2.
I20260709 13:09:23.386186 30514 leader_election.cc:304] T 734911241b624e74aadb0e38ed5b0362 P d7def43826924f03b8858383f0dc69f4 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d7def43826924f03b8858383f0dc69f4, eaa6f3dc13d643b9acfd8df1263a456d; no voters: 
I20260709 13:09:23.386761 30475 raft_consensus.cc:2468] T 734911241b624e74aadb0e38ed5b0362 P b1daf23b3538498bb795a60d627b6ac0 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d7def43826924f03b8858383f0dc69f4 in term 2.
I20260709 13:09:23.386953 30698 raft_consensus.cc:2804] T 734911241b624e74aadb0e38ed5b0362 P d7def43826924f03b8858383f0dc69f4 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:09:23.387544 30698 raft_consensus.cc:697] T 734911241b624e74aadb0e38ed5b0362 P d7def43826924f03b8858383f0dc69f4 [term 2 LEADER]: Becoming Leader. State: Replica: d7def43826924f03b8858383f0dc69f4, State: Running, Role: LEADER
I20260709 13:09:23.388285 30698 consensus_queue.cc:237] T 734911241b624e74aadb0e38ed5b0362 P d7def43826924f03b8858383f0dc69f4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1daf23b3538498bb795a60d627b6ac0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 36109 } } peers { permanent_uuid: "d7def43826924f03b8858383f0dc69f4" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 40053 } } peers { permanent_uuid: "eaa6f3dc13d643b9acfd8df1263a456d" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 41395 } }
I20260709 13:09:23.394148 30372 catalog_manager.cc:5697] T 734911241b624e74aadb0e38ed5b0362 P d7def43826924f03b8858383f0dc69f4 reported cstate change: term changed from 1 to 2, leader changed from b1daf23b3538498bb795a60d627b6ac0 (127.17.223.1) to d7def43826924f03b8858383f0dc69f4 (127.17.223.2). New cstate: current_term: 2 leader_uuid: "d7def43826924f03b8858383f0dc69f4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1daf23b3538498bb795a60d627b6ac0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 36109 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d7def43826924f03b8858383f0dc69f4" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 40053 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "eaa6f3dc13d643b9acfd8df1263a456d" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 41395 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:23.443392 30548 raft_consensus.cc:1275] T f406da2fcdaa4facbd59848fdd5eeeb3 P d7def43826924f03b8858383f0dc69f4 [term 2 FOLLOWER]: Refusing update from remote peer b1daf23b3538498bb795a60d627b6ac0: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:23.444689 30670 consensus_queue.cc:1048] T f406da2fcdaa4facbd59848fdd5eeeb3 P b1daf23b3538498bb795a60d627b6ac0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7def43826924f03b8858383f0dc69f4" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 40053 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:09:23.452565 30624 raft_consensus.cc:1275] T f406da2fcdaa4facbd59848fdd5eeeb3 P eaa6f3dc13d643b9acfd8df1263a456d [term 2 FOLLOWER]: Refusing update from remote peer b1daf23b3538498bb795a60d627b6ac0: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:23.454282 30702 consensus_queue.cc:1048] T f406da2fcdaa4facbd59848fdd5eeeb3 P b1daf23b3538498bb795a60d627b6ac0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eaa6f3dc13d643b9acfd8df1263a456d" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 41395 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:09:23.494266 30624 raft_consensus.cc:1275] T 17519d8368db4b08a84e4d7335c6fc4f P eaa6f3dc13d643b9acfd8df1263a456d [term 2 FOLLOWER]: Refusing update from remote peer b1daf23b3538498bb795a60d627b6ac0: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:23.495883 30702 consensus_queue.cc:1048] T 17519d8368db4b08a84e4d7335c6fc4f P b1daf23b3538498bb795a60d627b6ac0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eaa6f3dc13d643b9acfd8df1263a456d" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 41395 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:09:23.503959 30548 raft_consensus.cc:1275] T 17519d8368db4b08a84e4d7335c6fc4f P d7def43826924f03b8858383f0dc69f4 [term 2 FOLLOWER]: Refusing update from remote peer b1daf23b3538498bb795a60d627b6ac0: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:23.505582 30670 consensus_queue.cc:1048] T 17519d8368db4b08a84e4d7335c6fc4f P b1daf23b3538498bb795a60d627b6ac0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7def43826924f03b8858383f0dc69f4" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 40053 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:09:23.686403 30475 raft_consensus.cc:1275] T ad8233fe86c64f6380f513881e6c3268 P b1daf23b3538498bb795a60d627b6ac0 [term 2 FOLLOWER]: Refusing update from remote peer eaa6f3dc13d643b9acfd8df1263a456d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:23.687855 30711 consensus_queue.cc:1048] T ad8233fe86c64f6380f513881e6c3268 P eaa6f3dc13d643b9acfd8df1263a456d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1daf23b3538498bb795a60d627b6ac0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 36109 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:09:23.695945 30548 raft_consensus.cc:1275] T ad8233fe86c64f6380f513881e6c3268 P d7def43826924f03b8858383f0dc69f4 [term 2 FOLLOWER]: Refusing update from remote peer eaa6f3dc13d643b9acfd8df1263a456d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:23.697610 30676 consensus_queue.cc:1048] T ad8233fe86c64f6380f513881e6c3268 P eaa6f3dc13d643b9acfd8df1263a456d [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7def43826924f03b8858383f0dc69f4" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 40053 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:09:23.772439 30475 raft_consensus.cc:1275] T d6e07afd07294d7d80ca32fa1f97e4a1 P b1daf23b3538498bb795a60d627b6ac0 [term 2 FOLLOWER]: Refusing update from remote peer d7def43826924f03b8858383f0dc69f4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:23.773826 30698 consensus_queue.cc:1048] T d6e07afd07294d7d80ca32fa1f97e4a1 P d7def43826924f03b8858383f0dc69f4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1daf23b3538498bb795a60d627b6ac0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 36109 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:09:23.781428 30624 raft_consensus.cc:1275] T d6e07afd07294d7d80ca32fa1f97e4a1 P eaa6f3dc13d643b9acfd8df1263a456d [term 2 FOLLOWER]: Refusing update from remote peer d7def43826924f03b8858383f0dc69f4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:23.783787 30686 consensus_queue.cc:1048] T d6e07afd07294d7d80ca32fa1f97e4a1 P d7def43826924f03b8858383f0dc69f4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eaa6f3dc13d643b9acfd8df1263a456d" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 41395 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:09:23.875849 30624 raft_consensus.cc:1275] T 734911241b624e74aadb0e38ed5b0362 P eaa6f3dc13d643b9acfd8df1263a456d [term 2 FOLLOWER]: Refusing update from remote peer d7def43826924f03b8858383f0dc69f4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:23.877161 30686 consensus_queue.cc:1048] T 734911241b624e74aadb0e38ed5b0362 P d7def43826924f03b8858383f0dc69f4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eaa6f3dc13d643b9acfd8df1263a456d" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 41395 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:09:23.884601 30475 raft_consensus.cc:1275] T 734911241b624e74aadb0e38ed5b0362 P b1daf23b3538498bb795a60d627b6ac0 [term 2 FOLLOWER]: Refusing update from remote peer d7def43826924f03b8858383f0dc69f4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:23.889281 30698 consensus_queue.cc:1048] T 734911241b624e74aadb0e38ed5b0362 P d7def43826924f03b8858383f0dc69f4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1daf23b3538498bb795a60d627b6ac0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 36109 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:09:23.930311 30475 raft_consensus.cc:1275] T 4ad6f5c1312c488b8d331c1ecb412800 P b1daf23b3538498bb795a60d627b6ac0 [term 2 FOLLOWER]: Refusing update from remote peer d7def43826924f03b8858383f0dc69f4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:23.931623 30699 consensus_queue.cc:1048] T 4ad6f5c1312c488b8d331c1ecb412800 P d7def43826924f03b8858383f0dc69f4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1daf23b3538498bb795a60d627b6ac0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 36109 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:09:23.939586 30624 raft_consensus.cc:1275] T 4ad6f5c1312c488b8d331c1ecb412800 P eaa6f3dc13d643b9acfd8df1263a456d [term 2 FOLLOWER]: Refusing update from remote peer d7def43826924f03b8858383f0dc69f4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:23.941452 30699 consensus_queue.cc:1048] T 4ad6f5c1312c488b8d331c1ecb412800 P d7def43826924f03b8858383f0dc69f4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eaa6f3dc13d643b9acfd8df1263a456d" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 41395 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:09:25.993970 30370 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:52772:
name: "soft_deleted_table"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q""\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:09:25.996127 30370 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table soft_deleted_table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:09:26.044402 30462 tablet_service.cc:1511] Processing CreateTablet for tablet 052373021b584e2e84d1d9dee352aebd (DEFAULT_TABLE table=soft_deleted_table [id=65e66abd0d394269850b2b2e733a3169]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:09:26.045655 30462 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 052373021b584e2e84d1d9dee352aebd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:26.046502 30612 tablet_service.cc:1511] Processing CreateTablet for tablet 052373021b584e2e84d1d9dee352aebd (DEFAULT_TABLE table=soft_deleted_table [id=65e66abd0d394269850b2b2e733a3169]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:09:26.047747 30612 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 052373021b584e2e84d1d9dee352aebd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:26.047612 30536 tablet_service.cc:1511] Processing CreateTablet for tablet 052373021b584e2e84d1d9dee352aebd (DEFAULT_TABLE table=soft_deleted_table [id=65e66abd0d394269850b2b2e733a3169]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:09:26.048861 30536 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 052373021b584e2e84d1d9dee352aebd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:26.052397 30463 tablet_service.cc:1511] Processing CreateTablet for tablet b90351987d7741299d85cc7599d58d07 (DEFAULT_TABLE table=soft_deleted_table [id=65e66abd0d394269850b2b2e733a3169]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:09:26.053259 30610 tablet_service.cc:1511] Processing CreateTablet for tablet b90351987d7741299d85cc7599d58d07 (DEFAULT_TABLE table=soft_deleted_table [id=65e66abd0d394269850b2b2e733a3169]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:09:26.053692 30463 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b90351987d7741299d85cc7599d58d07. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:26.054484 30610 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b90351987d7741299d85cc7599d58d07. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:26.052408 30534 tablet_service.cc:1511] Processing CreateTablet for tablet b90351987d7741299d85cc7599d58d07 (DEFAULT_TABLE table=soft_deleted_table [id=65e66abd0d394269850b2b2e733a3169]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:09:26.060127 30534 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b90351987d7741299d85cc7599d58d07. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:26.062395 30541 tablet_service.cc:1511] Processing CreateTablet for tablet f657c3787a9d497f91e05a50c36622f2 (DEFAULT_TABLE table=soft_deleted_table [id=65e66abd0d394269850b2b2e733a3169]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:09:26.063623 30464 tablet_service.cc:1511] Processing CreateTablet for tablet f657c3787a9d497f91e05a50c36622f2 (DEFAULT_TABLE table=soft_deleted_table [id=65e66abd0d394269850b2b2e733a3169]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:09:26.064858 30464 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f657c3787a9d497f91e05a50c36622f2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:26.067646 30459 tablet_service.cc:1511] Processing CreateTablet for tablet 7ce7118b2aff46f38de8e9d6f5301e41 (DEFAULT_TABLE table=soft_deleted_table [id=65e66abd0d394269850b2b2e733a3169]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:09:26.068878 30459 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7ce7118b2aff46f38de8e9d6f5301e41. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:26.071545 30608 tablet_service.cc:1511] Processing CreateTablet for tablet f657c3787a9d497f91e05a50c36622f2 (DEFAULT_TABLE table=soft_deleted_table [id=65e66abd0d394269850b2b2e733a3169]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:09:26.072767 30608 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f657c3787a9d497f91e05a50c36622f2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:26.075651 30533 tablet_service.cc:1511] Processing CreateTablet for tablet 7ce7118b2aff46f38de8e9d6f5301e41 (DEFAULT_TABLE table=soft_deleted_table [id=65e66abd0d394269850b2b2e733a3169]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:09:26.063676 30541 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f657c3787a9d497f91e05a50c36622f2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:26.079026 30533 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7ce7118b2aff46f38de8e9d6f5301e41. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:26.081414 30458 tablet_service.cc:1511] Processing CreateTablet for tablet 905b37e519a4428995623c0c8357fc0f (DEFAULT_TABLE table=soft_deleted_table [id=65e66abd0d394269850b2b2e733a3169]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:09:26.081848 30538 tablet_service.cc:1511] Processing CreateTablet for tablet 905b37e519a4428995623c0c8357fc0f (DEFAULT_TABLE table=soft_deleted_table [id=65e66abd0d394269850b2b2e733a3169]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:09:26.082763 30458 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 905b37e519a4428995623c0c8357fc0f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:26.082547 30611 tablet_service.cc:1511] Processing CreateTablet for tablet 905b37e519a4428995623c0c8357fc0f (DEFAULT_TABLE table=soft_deleted_table [id=65e66abd0d394269850b2b2e733a3169]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:09:26.083071 30538 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 905b37e519a4428995623c0c8357fc0f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:26.083840 30611 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 905b37e519a4428995623c0c8357fc0f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:26.083642 30609 tablet_service.cc:1511] Processing CreateTablet for tablet 7ce7118b2aff46f38de8e9d6f5301e41 (DEFAULT_TABLE table=soft_deleted_table [id=65e66abd0d394269850b2b2e733a3169]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:09:26.084847 30609 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7ce7118b2aff46f38de8e9d6f5301e41. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:26.096381 30461 tablet_service.cc:1511] Processing CreateTablet for tablet 19335986fe9c4f738db226a45653127a (DEFAULT_TABLE table=soft_deleted_table [id=65e66abd0d394269850b2b2e733a3169]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:09:26.097720 30461 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 19335986fe9c4f738db226a45653127a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:26.097383 30540 tablet_service.cc:1511] Processing CreateTablet for tablet 19335986fe9c4f738db226a45653127a (DEFAULT_TABLE table=soft_deleted_table [id=65e66abd0d394269850b2b2e733a3169]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:09:26.098724 30540 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 19335986fe9c4f738db226a45653127a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:26.099048 30615 tablet_service.cc:1511] Processing CreateTablet for tablet 19335986fe9c4f738db226a45653127a (DEFAULT_TABLE table=soft_deleted_table [id=65e66abd0d394269850b2b2e733a3169]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:09:26.100251 30615 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 19335986fe9c4f738db226a45653127a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:26.112334 30458 tablet_service.cc:1511] Processing CreateTablet for tablet c9a02595d5e340be8cf9484066cf9cc7 (DEFAULT_TABLE table=soft_deleted_table [id=65e66abd0d394269850b2b2e733a3169]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:09:26.113922 30458 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c9a02595d5e340be8cf9484066cf9cc7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:26.120517 30539 tablet_service.cc:1511] Processing CreateTablet for tablet c9a02595d5e340be8cf9484066cf9cc7 (DEFAULT_TABLE table=soft_deleted_table [id=65e66abd0d394269850b2b2e733a3169]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:09:26.121850 30539 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c9a02595d5e340be8cf9484066cf9cc7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:26.133713 30614 tablet_service.cc:1511] Processing CreateTablet for tablet c9a02595d5e340be8cf9484066cf9cc7 (DEFAULT_TABLE table=soft_deleted_table [id=65e66abd0d394269850b2b2e733a3169]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:09:26.135144 30614 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c9a02595d5e340be8cf9484066cf9cc7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:26.140743 30465 tablet_service.cc:1511] Processing CreateTablet for tablet 035d977bcb604138a0c5e70d38013012 (DEFAULT_TABLE table=soft_deleted_table [id=65e66abd0d394269850b2b2e733a3169]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:09:26.142076 30465 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 035d977bcb604138a0c5e70d38013012. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:26.156865 30538 tablet_service.cc:1511] Processing CreateTablet for tablet 035d977bcb604138a0c5e70d38013012 (DEFAULT_TABLE table=soft_deleted_table [id=65e66abd0d394269850b2b2e733a3169]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:09:26.157377 30607 tablet_service.cc:1511] Processing CreateTablet for tablet 035d977bcb604138a0c5e70d38013012 (DEFAULT_TABLE table=soft_deleted_table [id=65e66abd0d394269850b2b2e733a3169]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:09:26.158073 30460 tablet_service.cc:1511] Processing CreateTablet for tablet 93f7bd85158a4f47aabfeb6b20b664e7 (DEFAULT_TABLE table=soft_deleted_table [id=65e66abd0d394269850b2b2e733a3169]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:09:26.158612 30607 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 035d977bcb604138a0c5e70d38013012. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:26.159332 30460 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 93f7bd85158a4f47aabfeb6b20b664e7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:26.159498 30613 tablet_service.cc:1511] Processing CreateTablet for tablet 93f7bd85158a4f47aabfeb6b20b664e7 (DEFAULT_TABLE table=soft_deleted_table [id=65e66abd0d394269850b2b2e733a3169]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:09:26.160715 30613 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 93f7bd85158a4f47aabfeb6b20b664e7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:26.161955 30537 tablet_service.cc:1511] Processing CreateTablet for tablet 93f7bd85158a4f47aabfeb6b20b664e7 (DEFAULT_TABLE table=soft_deleted_table [id=65e66abd0d394269850b2b2e733a3169]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:09:26.158324 30538 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 035d977bcb604138a0c5e70d38013012. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:26.164975 30537 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 93f7bd85158a4f47aabfeb6b20b664e7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:26.204249 30762 tablet_bootstrap.cc:492] T 052373021b584e2e84d1d9dee352aebd P b1daf23b3538498bb795a60d627b6ac0: Bootstrap starting.
I20260709 13:09:26.238607 30763 tablet_bootstrap.cc:492] T 035d977bcb604138a0c5e70d38013012 P eaa6f3dc13d643b9acfd8df1263a456d: Bootstrap starting.
I20260709 13:09:26.243496 30761 tablet_bootstrap.cc:492] T 052373021b584e2e84d1d9dee352aebd P d7def43826924f03b8858383f0dc69f4: Bootstrap starting.
I20260709 13:09:26.245774 30763 tablet_bootstrap.cc:654] T 035d977bcb604138a0c5e70d38013012 P eaa6f3dc13d643b9acfd8df1263a456d: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:26.232549 30762 tablet_bootstrap.cc:654] T 052373021b584e2e84d1d9dee352aebd P b1daf23b3538498bb795a60d627b6ac0: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:26.259574 30761 tablet_bootstrap.cc:654] T 052373021b584e2e84d1d9dee352aebd P d7def43826924f03b8858383f0dc69f4: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:26.279482 30763 tablet_bootstrap.cc:492] T 035d977bcb604138a0c5e70d38013012 P eaa6f3dc13d643b9acfd8df1263a456d: No bootstrap required, opened a new log
I20260709 13:09:26.279963 30763 ts_tablet_manager.cc:1403] T 035d977bcb604138a0c5e70d38013012 P eaa6f3dc13d643b9acfd8df1263a456d: Time spent bootstrapping tablet: real 0.042s	user 0.008s	sys 0.010s
I20260709 13:09:26.282083 30763 raft_consensus.cc:359] T 035d977bcb604138a0c5e70d38013012 P eaa6f3dc13d643b9acfd8df1263a456d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1daf23b3538498bb795a60d627b6ac0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 36109 } } peers { permanent_uuid: "d7def43826924f03b8858383f0dc69f4" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 40053 } } peers { permanent_uuid: "eaa6f3dc13d643b9acfd8df1263a456d" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 41395 } }
I20260709 13:09:26.282652 30763 raft_consensus.cc:385] T 035d977bcb604138a0c5e70d38013012 P eaa6f3dc13d643b9acfd8df1263a456d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:26.282955 30763 raft_consensus.cc:740] T 035d977bcb604138a0c5e70d38013012 P eaa6f3dc13d643b9acfd8df1263a456d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eaa6f3dc13d643b9acfd8df1263a456d, State: Initialized, Role: FOLLOWER
I20260709 13:09:26.283795 30763 consensus_queue.cc:260] T 035d977bcb604138a0c5e70d38013012 P eaa6f3dc13d643b9acfd8df1263a456d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1daf23b3538498bb795a60d627b6ac0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 36109 } } peers { permanent_uuid: "d7def43826924f03b8858383f0dc69f4" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 40053 } } peers { permanent_uuid: "eaa6f3dc13d643b9acfd8df1263a456d" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 41395 } }
I20260709 13:09:26.284411 30761 tablet_bootstrap.cc:492] T 052373021b584e2e84d1d9dee352aebd P d7def43826924f03b8858383f0dc69f4: No bootstrap required, opened a new log
I20260709 13:09:26.284976 30761 ts_tablet_manager.cc:1403] T 052373021b584e2e84d1d9dee352aebd P d7def43826924f03b8858383f0dc69f4: Time spent bootstrapping tablet: real 0.042s	user 0.009s	sys 0.002s
I20260709 13:09:26.288077 30761 raft_consensus.cc:359] T 052373021b584e2e84d1d9dee352aebd P d7def43826924f03b8858383f0dc69f4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1daf23b3538498bb795a60d627b6ac0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 36109 } } peers { permanent_uuid: "d7def43826924f03b8858383f0dc69f4" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 40053 } } peers { permanent_uuid: "eaa6f3dc13d643b9acfd8df1263a456d" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 41395 } }
I20260709 13:09:26.292656 30761 raft_consensus.cc:385] T 052373021b584e2e84d1d9dee352aebd P d7def43826924f03b8858383f0dc69f4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:26.293045 30761 raft_consensus.cc:740] T 052373021b584e2e84d1d9dee352aebd P d7def43826924f03b8858383f0dc69f4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d7def43826924f03b8858383f0dc69f4, State: Initialized, Role: FOLLOWER
I20260709 13:09:26.293968 30763 ts_tablet_manager.cc:1434] T 035d977bcb604138a0c5e70d38013012 P eaa6f3dc13d643b9acfd8df1263a456d: Time spent starting tablet: real 0.014s	user 0.006s	sys 0.000s
I20260709 13:09:26.293929 30761 consensus_queue.cc:260] T 052373021b584e2e84d1d9dee352aebd P d7def43826924f03b8858383f0dc69f4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1daf23b3538498bb795a60d627b6ac0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 36109 } } peers { permanent_uuid: "d7def43826924f03b8858383f0dc69f4" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 40053 } } peers { permanent_uuid: "eaa6f3dc13d643b9acfd8df1263a456d" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 41395 } }
I20260709 13:09:26.296741 30761 ts_tablet_manager.cc:1434] T 052373021b584e2e84d1d9dee352aebd P d7def43826924f03b8858383f0dc69f4: Time spent starting tablet: real 0.011s	user 0.003s	sys 0.005s
I20260709 13:09:26.298525 30761 tablet_bootstrap.cc:492] T 905b37e519a4428995623c0c8357fc0f P d7def43826924f03b8858383f0dc69f4: Bootstrap starting.
I20260709 13:09:26.300400 30762 tablet_bootstrap.cc:492] T 052373021b584e2e84d1d9dee352aebd P b1daf23b3538498bb795a60d627b6ac0: No bootstrap required, opened a new log
I20260709 13:09:26.300968 30762 ts_tablet_manager.cc:1403] T 052373021b584e2e84d1d9dee352aebd P b1daf23b3538498bb795a60d627b6ac0: Time spent bootstrapping tablet: real 0.097s	user 0.012s	sys 0.000s
I20260709 13:09:26.302340 30763 tablet_bootstrap.cc:492] T 052373021b584e2e84d1d9dee352aebd P eaa6f3dc13d643b9acfd8df1263a456d: Bootstrap starting.
I20260709 13:09:26.303977 30762 raft_consensus.cc:359] T 052373021b584e2e84d1d9dee352aebd P b1daf23b3538498bb795a60d627b6ac0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1daf23b3538498bb795a60d627b6ac0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 36109 } } peers { permanent_uuid: "d7def43826924f03b8858383f0dc69f4" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 40053 } } peers { permanent_uuid: "eaa6f3dc13d643b9acfd8df1263a456d" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 41395 } }
I20260709 13:09:26.304721 30762 raft_consensus.cc:385] T 052373021b584e2e84d1d9dee352aebd P b1daf23b3538498bb795a60d627b6ac0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:26.305017 30762 raft_consensus.cc:740] T 052373021b584e2e84d1d9dee352aebd P b1daf23b3538498bb795a60d627b6ac0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b1daf23b3538498bb795a60d627b6ac0, State: Initialized, Role: FOLLOWER
I20260709 13:09:26.305270 30761 tablet_bootstrap.cc:654] T 905b37e519a4428995623c0c8357fc0f P d7def43826924f03b8858383f0dc69f4: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:26.305742 30762 consensus_queue.cc:260] T 052373021b584e2e84d1d9dee352aebd P b1daf23b3538498bb795a60d627b6ac0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1daf23b3538498bb795a60d627b6ac0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 36109 } } peers { permanent_uuid: "d7def43826924f03b8858383f0dc69f4" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 40053 } } peers { permanent_uuid: "eaa6f3dc13d643b9acfd8df1263a456d" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 41395 } }
I20260709 13:09:26.310088 30763 tablet_bootstrap.cc:654] T 052373021b584e2e84d1d9dee352aebd P eaa6f3dc13d643b9acfd8df1263a456d: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:26.315364 30762 ts_tablet_manager.cc:1434] T 052373021b584e2e84d1d9dee352aebd P b1daf23b3538498bb795a60d627b6ac0: Time spent starting tablet: real 0.014s	user 0.004s	sys 0.004s
I20260709 13:09:26.319257 30762 tablet_bootstrap.cc:492] T 905b37e519a4428995623c0c8357fc0f P b1daf23b3538498bb795a60d627b6ac0: Bootstrap starting.
I20260709 13:09:26.319399 30761 tablet_bootstrap.cc:492] T 905b37e519a4428995623c0c8357fc0f P d7def43826924f03b8858383f0dc69f4: No bootstrap required, opened a new log
I20260709 13:09:26.319983 30761 ts_tablet_manager.cc:1403] T 905b37e519a4428995623c0c8357fc0f P d7def43826924f03b8858383f0dc69f4: Time spent bootstrapping tablet: real 0.022s	user 0.012s	sys 0.004s
I20260709 13:09:26.320402 30763 tablet_bootstrap.cc:492] T 052373021b584e2e84d1d9dee352aebd P eaa6f3dc13d643b9acfd8df1263a456d: No bootstrap required, opened a new log
I20260709 13:09:26.321004 30763 ts_tablet_manager.cc:1403] T 052373021b584e2e84d1d9dee352aebd P eaa6f3dc13d643b9acfd8df1263a456d: Time spent bootstrapping tablet: real 0.019s	user 0.006s	sys 0.010s
I20260709 13:09:26.322962 30761 raft_consensus.cc:359] T 905b37e519a4428995623c0c8357fc0f P d7def43826924f03b8858383f0dc69f4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1daf23b3538498bb795a60d627b6ac0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 36109 } } peers { permanent_uuid: "d7def43826924f03b8858383f0dc69f4" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 40053 } } peers { permanent_uuid: "eaa6f3dc13d643b9acfd8df1263a456d" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 41395 } }
I20260709 13:09:26.323743 30761 raft_consensus.cc:385] T 905b37e519a4428995623c0c8357fc0f P d7def43826924f03b8858383f0dc69f4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:26.324034 30761 raft_consensus.cc:740] T 905b37e519a4428995623c0c8357fc0f P d7def43826924f03b8858383f0dc69f4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d7def43826924f03b8858383f0dc69f4, State: Initialized, Role: FOLLOWER
I20260709 13:09:26.324208 30763 raft_consensus.cc:359] T 052373021b584e2e84d1d9dee352aebd P eaa6f3dc13d643b9acfd8df1263a456d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1daf23b3538498bb795a60d627b6ac0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 36109 } } peers { permanent_uuid: "d7def43826924f03b8858383f0dc69f4" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 40053 } } peers { permanent_uuid: "eaa6f3dc13d643b9acfd8df1263a456d" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 41395 } }
I20260709 13:09:26.325084 30763 raft_consensus.cc:385] T 052373021b584e2e84d1d9dee352aebd P eaa6f3dc13d643b9acfd8df1263a456d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:26.324903 30761 consensus_queue.cc:260] T 905b37e519a4428995623c0c8357fc0f P d7def43826924f03b8858383f0dc69f4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1daf23b3538498bb795a60d627b6ac0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 36109 } } peers { permanent_uuid: "d7def43826924f03b8858383f0dc69f4" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 40053 } } peers { permanent_uuid: "eaa6f3dc13d643b9acfd8df1263a456d" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 41395 } }
I20260709 13:09:26.325465 30763 raft_consensus.cc:740] T 052373021b584e2e84d1d9dee352aebd P eaa6f3dc13d643b9acfd8df1263a456d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eaa6f3dc13d643b9acfd8df1263a456d, State: Initialized, Role: FOLLOWER
I20260709 13:09:26.326339 30762 tablet_bootstrap.cc:654] T 905b37e519a4428995623c0c8357fc0f P b1daf23b3538498bb795a60d627b6ac0: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:26.326421 30763 consensus_queue.cc:260] T 052373021b584e2e84d1d9dee352aebd P eaa6f3dc13d643b9acfd8df1263a456d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1daf23b3538498bb795a60d627b6ac0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 36109 } } peers { permanent_uuid: "d7def43826924f03b8858383f0dc69f4" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 40053 } } peers { permanent_uuid: "eaa6f3dc13d643b9acfd8df1263a456d" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 41395 } }
I20260709 13:09:26.329444 30763 ts_tablet_manager.cc:1434] T 052373021b584e2e84d1d9dee352aebd P eaa6f3dc13d643b9acfd8df1263a456d: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.001s
I20260709 13:09:26.330500 30763 tablet_bootstrap.cc:492] T c9a02595d5e340be8cf9484066cf9cc7 P eaa6f3dc13d643b9acfd8df1263a456d: Bootstrap starting.
I20260709 13:09:26.327666 30761 ts_tablet_manager.cc:1434] T 905b37e519a4428995623c0c8357fc0f P d7def43826924f03b8858383f0dc69f4: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 13:09:26.335587 30761 tablet_bootstrap.cc:492] T 19335986fe9c4f738db226a45653127a P d7def43826924f03b8858383f0dc69f4: Bootstrap starting.
I20260709 13:09:26.338096 30763 tablet_bootstrap.cc:654] T c9a02595d5e340be8cf9484066cf9cc7 P eaa6f3dc13d643b9acfd8df1263a456d: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:26.341207 30762 tablet_bootstrap.cc:492] T 905b37e519a4428995623c0c8357fc0f P b1daf23b3538498bb795a60d627b6ac0: No bootstrap required, opened a new log
I20260709 13:09:26.341686 30762 ts_tablet_manager.cc:1403] T 905b37e519a4428995623c0c8357fc0f P b1daf23b3538498bb795a60d627b6ac0: Time spent bootstrapping tablet: real 0.023s	user 0.008s	sys 0.009s
I20260709 13:09:26.344805 30762 raft_consensus.cc:359] T 905b37e519a4428995623c0c8357fc0f P b1daf23b3538498bb795a60d627b6ac0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1daf23b3538498bb795a60d627b6ac0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 36109 } } peers { permanent_uuid: "d7def43826924f03b8858383f0dc69f4" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 40053 } } peers { permanent_uuid: "eaa6f3dc13d643b9acfd8df1263a456d" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 41395 } }
I20260709 13:09:26.345534 30762 raft_consensus.cc:385] T 905b37e519a4428995623c0c8357fc0f P b1daf23b3538498bb795a60d627b6ac0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:26.345835 30762 raft_consensus.cc:740] T 905b37e519a4428995623c0c8357fc0f P b1daf23b3538498bb795a60d627b6ac0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b1daf23b3538498bb795a60d627b6ac0, State: Initialized, Role: FOLLOWER
I20260709 13:09:26.346776 30762 consensus_queue.cc:260] T 905b37e519a4428995623c0c8357fc0f P b1daf23b3538498bb795a60d627b6ac0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1daf23b3538498bb795a60d627b6ac0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 36109 } } peers { permanent_uuid: "d7def43826924f03b8858383f0dc69f4" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 40053 } } peers { permanent_uuid: "eaa6f3dc13d643b9acfd8df1263a456d" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 41395 } }
I20260709 13:09:26.349097 30761 tablet_bootstrap.cc:654] T 19335986fe9c4f738db226a45653127a P d7def43826924f03b8858383f0dc69f4: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:26.351002 30763 tablet_bootstrap.cc:492] T c9a02595d5e340be8cf9484066cf9cc7 P eaa6f3dc13d643b9acfd8df1263a456d: No bootstrap required, opened a new log
I20260709 13:09:26.351483 30762 ts_tablet_manager.cc:1434] T 905b37e519a4428995623c0c8357fc0f P b1daf23b3538498bb795a60d627b6ac0: Time spent starting tablet: real 0.009s	user 0.002s	sys 0.005s
I20260709 13:09:26.351543 30763 ts_tablet_manager.cc:1403] T c9a02595d5e340be8cf9484066cf9cc7 P eaa6f3dc13d643b9acfd8df1263a456d: Time spent bootstrapping tablet: real 0.021s	user 0.007s	sys 0.011s
I20260709 13:09:26.352650 30762 tablet_bootstrap.cc:492] T 7ce7118b2aff46f38de8e9d6f5301e41 P b1daf23b3538498bb795a60d627b6ac0: Bootstrap starting.
I20260709 13:09:26.354871 30763 raft_consensus.cc:359] T c9a02595d5e340be8cf9484066cf9cc7 P eaa6f3dc13d643b9acfd8df1263a456d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1daf23b3538498bb795a60d627b6ac0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 36109 } } peers { permanent_uuid: "d7def43826924f03b8858383f0dc69f4" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 40053 } } peers { permanent_uuid: "eaa6f3dc13d643b9acfd8df1263a456d" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 41395 } }
I20260709 13:09:26.355590 30763 raft_consensus.cc:385] T c9a02595d5e340be8cf9484066cf9cc7 P eaa6f3dc13d643b9acfd8df1263a456d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:26.355876 30763 raft_consensus.cc:740] T c9a02595d5e340be8cf9484066cf9cc7 P eaa6f3dc13d643b9acfd8df1263a456d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eaa6f3dc13d643b9acfd8df1263a456d, State: Initialized, Role: FOLLOWER
I20260709 13:09:26.356702 30763 consensus_queue.cc:260] T c9a02595d5e340be8cf9484066cf9cc7 P eaa6f3dc13d643b9acfd8df1263a456d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1daf23b3538498bb795a60d627b6ac0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 36109 } } peers { permanent_uuid: "d7def43826924f03b8858383f0dc69f4" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 40053 } } peers { permanent_uuid: "eaa6f3dc13d643b9acfd8df1263a456d" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 41395 } }
I20260709 13:09:26.359102 30763 ts_tablet_manager.cc:1434] T c9a02595d5e340be8cf9484066cf9cc7 P eaa6f3dc13d643b9acfd8df1263a456d: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 13:09:26.359735 30762 tablet_bootstrap.cc:654] T 7ce7118b2aff46f38de8e9d6f5301e41 P b1daf23b3538498bb795a60d627b6ac0: Neither blocks nor log segments found. Creating new log.
W20260709 13:09:26.360744 30651 tablet.cc:2406] T 035d977bcb604138a0c5e70d38013012 P eaa6f3dc13d643b9acfd8df1263a456d: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260709 13:09:26.362546 30763 tablet_bootstrap.cc:492] T b90351987d7741299d85cc7599d58d07 P eaa6f3dc13d643b9acfd8df1263a456d: Bootstrap starting.
I20260709 13:09:26.369643 30763 tablet_bootstrap.cc:654] T b90351987d7741299d85cc7599d58d07 P eaa6f3dc13d643b9acfd8df1263a456d: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:26.372541 30761 tablet_bootstrap.cc:492] T 19335986fe9c4f738db226a45653127a P d7def43826924f03b8858383f0dc69f4: No bootstrap required, opened a new log
I20260709 13:09:26.373049 30761 ts_tablet_manager.cc:1403] T 19335986fe9c4f738db226a45653127a P d7def43826924f03b8858383f0dc69f4: Time spent bootstrapping tablet: real 0.038s	user 0.018s	sys 0.007s
I20260709 13:09:26.375149 30764 raft_consensus.cc:493] T 052373021b584e2e84d1d9dee352aebd P d7def43826924f03b8858383f0dc69f4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:26.375655 30764 raft_consensus.cc:515] T 052373021b584e2e84d1d9dee352aebd P d7def43826924f03b8858383f0dc69f4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1daf23b3538498bb795a60d627b6ac0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 36109 } } peers { permanent_uuid: "d7def43826924f03b8858383f0dc69f4" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 40053 } } peers { permanent_uuid: "eaa6f3dc13d643b9acfd8df1263a456d" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 41395 } }
I20260709 13:09:26.377506 30762 tablet_bootstrap.cc:492] T 7ce7118b2aff46f38de8e9d6f5301e41 P b1daf23b3538498bb795a60d627b6ac0: No bootstrap required, opened a new log
I20260709 13:09:26.377884 30764 leader_election.cc:290] T 052373021b584e2e84d1d9dee352aebd P d7def43826924f03b8858383f0dc69f4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b1daf23b3538498bb795a60d627b6ac0 (127.17.223.1:36109), eaa6f3dc13d643b9acfd8df1263a456d (127.17.223.3:41395)
I20260709 13:09:26.378098 30762 ts_tablet_manager.cc:1403] T 7ce7118b2aff46f38de8e9d6f5301e41 P b1daf23b3538498bb795a60d627b6ac0: Time spent bootstrapping tablet: real 0.026s	user 0.008s	sys 0.007s
I20260709 13:09:26.378537 30763 tablet_bootstrap.cc:492] T b90351987d7741299d85cc7599d58d07 P eaa6f3dc13d643b9acfd8df1263a456d: No bootstrap required, opened a new log
I20260709 13:09:26.378990 30475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "052373021b584e2e84d1d9dee352aebd" candidate_uuid: "d7def43826924f03b8858383f0dc69f4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1daf23b3538498bb795a60d627b6ac0" is_pre_election: true
I20260709 13:09:26.379352 30624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "052373021b584e2e84d1d9dee352aebd" candidate_uuid: "d7def43826924f03b8858383f0dc69f4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eaa6f3dc13d643b9acfd8df1263a456d" is_pre_election: true
I20260709 13:09:26.379619 30475 raft_consensus.cc:2468] T 052373021b584e2e84d1d9dee352aebd P b1daf23b3538498bb795a60d627b6ac0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d7def43826924f03b8858383f0dc69f4 in term 0.
I20260709 13:09:26.379875 30763 ts_tablet_manager.cc:1403] T b90351987d7741299d85cc7599d58d07 P eaa6f3dc13d643b9acfd8df1263a456d: Time spent bootstrapping tablet: real 0.018s	user 0.014s	sys 0.002s
I20260709 13:09:26.379992 30624 raft_consensus.cc:2468] T 052373021b584e2e84d1d9dee352aebd P eaa6f3dc13d643b9acfd8df1263a456d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d7def43826924f03b8858383f0dc69f4 in term 0.
I20260709 13:09:26.380976 30514 leader_election.cc:304] T 052373021b584e2e84d1d9dee352aebd P d7def43826924f03b8858383f0dc69f4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b1daf23b3538498bb795a60d627b6ac0, d7def43826924f03b8858383f0dc69f4; no voters: 
I20260709 13:09:26.381718 30764 raft_consensus.cc:2804] T 052373021b584e2e84d1d9dee352aebd P d7def43826924f03b8858383f0dc69f4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:26.382129 30764 raft_consensus.cc:493] T 052373021b584e2e84d1d9dee352aebd P d7def43826924f03b8858383f0dc69f4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:26.382521 30764 raft_consensus.cc:3060] T 052373021b584e2e84d1d9dee352aebd P d7def43826924f03b8858383f0dc69f4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:26.383009 30763 raft_consensus.cc:359] T b90351987d7741299d85cc7599d58d07 P eaa6f3dc13d643b9acfd8df1263a456d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1daf23b3538498bb795a60d627b6ac0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 36109 } } peers { permanent_uuid: "d7def43826924f03b8858383f0dc69f4" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 40053 } } peers { permanent_uuid: "eaa6f3dc13d643b9acfd8df1263a456d" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 41395 } }
I20260709 13:09:26.383378 30761 raft_consensus.cc:359] T 19335986fe9c4f738db226a45653127a P d7def43826924f03b8858383f0dc69f4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1daf23b3538498bb795a60d627b6ac0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 36109 } } peers { permanent_uuid: "d7def43826924f03b8858383f0dc69f4" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 40053 } } peers { permanent_uuid: "eaa6f3dc13d643b9acfd8df1263a456d" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 41395 } }
I20260709 13:09:26.383805 30763 raft_consensus.cc:385] T b90351987d7741299d85cc7599d58d07 P eaa6f3dc13d643b9acfd8df1263a456d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:26.383652 30762 raft_consensus.cc:359] T 7ce7118b2aff46f38de8e9d6f5301e41 P b1daf23b3538498bb795a60d627b6ac0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1daf23b3538498bb795a60d627b6ac0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 36109 } } peers { permanent_uuid: "d7def43826924f03b8858383f0dc69f4" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 40053 } } peers { permanent_uuid: "eaa6f3dc13d643b9acfd8df1263a456d" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 41395 } }
I20260709 13:09:26.384173 30761 raft_consensus.cc:385] T 19335986fe9c4f738db226a45653127a P d7def43826924f03b8858383f0dc69f4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:26.384253 30763 raft_consensus.cc:740] T b90351987d7741299d85cc7599d58d07 P eaa6f3dc13d643b9acfd8df1263a456d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eaa6f3dc13d643b9acfd8df1263a456d, State: Initialized, Role: FOLLOWER
I20260709 13:09:26.384476 30762 raft_consensus.cc:385] T 7ce7118b2aff46f38de8e9d6f5301e41 P b1daf23b3538498bb795a60d627b6ac0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:26.384635 30761 raft_consensus.cc:740] T 19335986fe9c4f738db226a45653127a P d7def43826924f03b8858383f0dc69f4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d7def43826924f03b8858383f0dc69f4, State: Initialized, Role: FOLLOWER
I20260709 13:09:26.384943 30762 raft_consensus.cc:740] T 7ce7118b2aff46f38de8e9d6f5301e41 P b1daf23b3538498bb795a60d627b6ac0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b1daf23b3538498bb795a60d627b6ac0, State: Initialized, Role: FOLLOWER
I20260709 13:09:26.385244 30763 consensus_queue.cc:260] T b90351987d7741299d85cc7599d58d07 P eaa6f3dc13d643b9acfd8df1263a456d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1daf23b3538498bb795a60d627b6ac0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 36109 } } peers { permanent_uuid: "d7def43826924f03b8858383f0dc69f4" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 40053 } } peers { permanent_uuid: "eaa6f3dc13d643b9acfd8df1263a456d" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 41395 } }
I20260709 13:09:26.385552 30761 consensus_queue.cc:260] T 19335986fe9c4f738db226a45653127a P d7def43826924f03b8858383f0dc69f4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1daf23b3538498bb795a60d627b6ac0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 36109 } } peers { permanent_uuid: "d7def43826924f03b8858383f0dc69f4" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 40053 } } peers { permanent_uuid: "eaa6f3dc13d643b9acfd8df1263a456d" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 41395 } }
I20260709 13:09:26.390381 30761 ts_tablet_manager.cc:1434] T 19335986fe9c4f738db226a45653127a P d7def43826924f03b8858383f0dc69f4: Time spent starting tablet: real 0.017s	user 0.004s	sys 0.004s
I20260709 13:09:26.390960 30764 raft_consensus.cc:515] T 052373021b584e2e84d1d9dee352aebd P d7def43826924f03b8858383f0dc69f4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1daf23b3538498bb795a60d627b6ac0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 36109 } } peers { permanent_uuid: "d7def43826924f03b8858383f0dc69f4" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 40053 } } peers { permanent_uuid: "eaa6f3dc13d643b9acfd8df1263a456d" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 41395 } }
I20260709 13:09:26.392977 30764 leader_election.cc:290] T 052373021b584e2e84d1d9dee352aebd P d7def43826924f03b8858383f0dc69f4 [CANDIDATE]: Term 1 election: Requested vote from peers b1daf23b3538498bb795a60d627b6ac0 (127.17.223.1:36109), eaa6f3dc13d643b9acfd8df1263a456d (127.17.223.3:41395)
I20260709 13:09:26.385878 30762 consensus_queue.cc:260] T 7ce7118b2aff46f38de8e9d6f5301e41 P b1daf23b3538498bb795a60d627b6ac0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1daf23b3538498bb795a60d627b6ac0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 36109 } } peers { permanent_uuid: "d7def43826924f03b8858383f0dc69f4" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 40053 } } peers { permanent_uuid: "eaa6f3dc13d643b9acfd8df1263a456d" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 41395 } }
I20260709 13:09:26.387938 30763 ts_tablet_manager.cc:1434] T b90351987d7741299d85cc7599d58d07 P eaa6f3dc13d643b9acfd8df1263a456d: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 13:09:26.393594 30475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "052373021b584e2e84d1d9dee352aebd" candidate_uuid: "d7def43826924f03b8858383f0dc69f4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1daf23b3538498bb795a60d627b6ac0"
I20260709 13:09:26.393996 30624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "052373021b584e2e84d1d9dee352aebd" candidate_uuid: "d7def43826924f03b8858383f0dc69f4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eaa6f3dc13d643b9acfd8df1263a456d"
I20260709 13:09:26.394245 30475 raft_consensus.cc:3060] T 052373021b584e2e84d1d9dee352aebd P b1daf23b3538498bb795a60d627b6ac0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:26.395138 30763 tablet_bootstrap.cc:492] T 905b37e519a4428995623c0c8357fc0f P eaa6f3dc13d643b9acfd8df1263a456d: Bootstrap starting.
I20260709 13:09:26.395479 30762 ts_tablet_manager.cc:1434] T 7ce7118b2aff46f38de8e9d6f5301e41 P b1daf23b3538498bb795a60d627b6ac0: Time spent starting tablet: real 0.017s	user 0.001s	sys 0.008s
I20260709 13:09:26.396567 30761 tablet_bootstrap.cc:492] T c9a02595d5e340be8cf9484066cf9cc7 P d7def43826924f03b8858383f0dc69f4: Bootstrap starting.
I20260709 13:09:26.401751 30475 raft_consensus.cc:2468] T 052373021b584e2e84d1d9dee352aebd P b1daf23b3538498bb795a60d627b6ac0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d7def43826924f03b8858383f0dc69f4 in term 1.
I20260709 13:09:26.394579 30624 raft_consensus.cc:3060] T 052373021b584e2e84d1d9dee352aebd P eaa6f3dc13d643b9acfd8df1263a456d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:26.402998 30514 leader_election.cc:304] T 052373021b584e2e84d1d9dee352aebd P d7def43826924f03b8858383f0dc69f4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b1daf23b3538498bb795a60d627b6ac0, d7def43826924f03b8858383f0dc69f4; no voters: 
I20260709 13:09:26.403411 30763 tablet_bootstrap.cc:654] T 905b37e519a4428995623c0c8357fc0f P eaa6f3dc13d643b9acfd8df1263a456d: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:26.404212 30762 tablet_bootstrap.cc:492] T c9a02595d5e340be8cf9484066cf9cc7 P b1daf23b3538498bb795a60d627b6ac0: Bootstrap starting.
I20260709 13:09:26.407455 30764 raft_consensus.cc:2804] T 052373021b584e2e84d1d9dee352aebd P d7def43826924f03b8858383f0dc69f4 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:26.408165 30764 raft_consensus.cc:697] T 052373021b584e2e84d1d9dee352aebd P d7def43826924f03b8858383f0dc69f4 [term 1 LEADER]: Becoming Leader. State: Replica: d7def43826924f03b8858383f0dc69f4, State: Running, Role: LEADER
I20260709 13:09:26.409176 30764 consensus_queue.cc:237] T 052373021b584e2e84d1d9dee352aebd P d7def43826924f03b8858383f0dc69f4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1daf23b3538498bb795a60d627b6ac0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 36109 } } peers { permanent_uuid: "d7def43826924f03b8858383f0dc69f4" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 40053 } } peers { permanent_uuid: "eaa6f3dc13d643b9acfd8df1263a456d" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 41395 } }
I20260709 13:09:26.411077 30762 tablet_bootstrap.cc:654] T c9a02595d5e340be8cf9484066cf9cc7 P b1daf23b3538498bb795a60d627b6ac0: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:26.403229 30761 tablet_bootstrap.cc:654] T c9a02595d5e340be8cf9484066cf9cc7 P d7def43826924f03b8858383f0dc69f4: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:26.435449 30763 tablet_bootstrap.cc:492] T 905b37e519a4428995623c0c8357fc0f P eaa6f3dc13d643b9acfd8df1263a456d: No bootstrap required, opened a new log
I20260709 13:09:26.436437 30763 ts_tablet_manager.cc:1403] T 905b37e519a4428995623c0c8357fc0f P eaa6f3dc13d643b9acfd8df1263a456d: Time spent bootstrapping tablet: real 0.042s	user 0.015s	sys 0.004s
I20260709 13:09:26.441164 30624 raft_consensus.cc:2468] T 052373021b584e2e84d1d9dee352aebd P eaa6f3dc13d643b9acfd8df1263a456d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d7def43826924f03b8858383f0dc69f4 in term 1.
I20260709 13:09:26.432122 30370 catalog_manager.cc:5697] T 052373021b584e2e84d1d9dee352aebd P d7def43826924f03b8858383f0dc69f4 reported cstate change: term changed from 0 to 1, leader changed from <none> to d7def43826924f03b8858383f0dc69f4 (127.17.223.2). New cstate: current_term: 1 leader_uuid: "d7def43826924f03b8858383f0dc69f4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1daf23b3538498bb795a60d627b6ac0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 36109 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d7def43826924f03b8858383f0dc69f4" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 40053 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "eaa6f3dc13d643b9acfd8df1263a456d" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 41395 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:26.443483 30762 tablet_bootstrap.cc:492] T c9a02595d5e340be8cf9484066cf9cc7 P b1daf23b3538498bb795a60d627b6ac0: No bootstrap required, opened a new log
I20260709 13:09:26.443568 30761 tablet_bootstrap.cc:492] T c9a02595d5e340be8cf9484066cf9cc7 P d7def43826924f03b8858383f0dc69f4: No bootstrap required, opened a new log
I20260709 13:09:26.444188 30762 ts_tablet_manager.cc:1403] T c9a02595d5e340be8cf9484066cf9cc7 P b1daf23b3538498bb795a60d627b6ac0: Time spent bootstrapping tablet: real 0.040s	user 0.013s	sys 0.023s
I20260709 13:09:26.444252 30761 ts_tablet_manager.cc:1403] T c9a02595d5e340be8cf9484066cf9cc7 P d7def43826924f03b8858383f0dc69f4: Time spent bootstrapping tablet: real 0.048s	user 0.022s	sys 0.009s
I20260709 13:09:26.447557 30763 raft_consensus.cc:359] T 905b37e519a4428995623c0c8357fc0f P eaa6f3dc13d643b9acfd8df1263a456d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1daf23b3538498bb795a60d627b6ac0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 36109 } } peers { permanent_uuid: "d7def43826924f03b8858383f0dc69f4" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 40053 } } peers { permanent_uuid: "eaa6f3dc13d643b9acfd8df1263a456d" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 41395 } }
I20260709 13:09:26.448392 30763 raft_consensus.cc:385] T 905b37e519a4428995623c0c8357fc0f P eaa6f3dc13d643b9acfd8df1263a456d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:26.448336 30762 raft_consensus.cc:359] T c9a02595d5e340be8cf9484066cf9cc7 P b1daf23b3538498bb795a60d627b6ac0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1daf23b3538498bb795a60d627b6ac0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 36109 } } peers { permanent_uuid: "d7def43826924f03b8858383f0dc69f4" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 40053 } } peers { permanent_uuid: "eaa6f3dc13d643b9acfd8df1263a456d" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 41395 } }
I20260709 13:09:26.448549 30761 raft_consensus.cc:359] T c9a02595d5e340be8cf9484066cf9cc7 P d7def43826924f03b8858383f0dc69f4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1daf23b3538498bb795a60d627b6ac0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 36109 } } peers { permanent_uuid: "d7def43826924f03b8858383f0dc69f4" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 40053 } } peers { permanent_uuid: "eaa6f3dc13d643b9acfd8df1263a456d" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 41395 } }
I20260709 13:09:26.449151 30763 raft_consensus.cc:740] T 905b37e519a4428995623c0c8357fc0f P eaa6f3dc13d643b9acfd8df1263a456d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eaa6f3dc13d643b9acfd8df1263a456d, State: Initialized, Role: FOLLOWER
I20260709 13:09:26.449354 30762 raft_consensus.cc:385] T c9a02595d5e340be8cf9484066cf9cc7 P b1daf23b3538498bb795a60d627b6ac0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:26.449527 30761 raft_consensus.cc:385] T c9a02595d5e340be8cf9484066cf9cc7 P d7def43826924f03b8858383f0dc69f4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:26.449914 30762 raft_consensus.cc:740] T c9a02595d5e340be8cf9484066cf9cc7 P b1daf23b3538498bb795a60d627b6ac0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b1daf23b3538498bb795a60d627b6ac0, State: Initialized, Role: FOLLOWER
I20260709 13:09:26.450136 30761 raft_consensus.cc:740] T c9a02595d5e340be8cf9484066cf9cc7 P d7def43826924f03b8858383f0dc69f4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d7def43826924f03b8858383f0dc69f4, State: Initialized, Role: FOLLOWER
I20260709 13:09:26.449990 30763 consensus_queue.cc:260] T 905b37e519a4428995623c0c8357fc0f P eaa6f3dc13d643b9acfd8df1263a456d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1daf23b3538498bb795a60d627b6ac0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 36109 } } peers { permanent_uuid: "d7def43826924f03b8858383f0dc69f4" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 40053 } } peers { permanent_uuid: "eaa6f3dc13d643b9acfd8df1263a456d" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 41395 } }
I20260709 13:09:26.451304 30761 consensus_queue.cc:260] T c9a02595d5e340be8cf9484066cf9cc7 P d7def43826924f03b8858383f0dc69f4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1daf23b3538498bb795a60d627b6ac0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 36109 } } peers { permanent_uuid: "d7def43826924f03b8858383f0dc69f4" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 40053 } } peers { permanent_uuid: "eaa6f3dc13d643b9acfd8df1263a456d" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 41395 } }
I20260709 13:09:26.452776 30763 ts_tablet_manager.cc:1434] T 905b37e519a4428995623c0c8357fc0f P eaa6f3dc13d643b9acfd8df1263a456d: Time spent starting tablet: real 0.016s	user 0.004s	sys 0.002s
I20260709 13:09:26.453795 30763 tablet_bootstrap.cc:492] T 7ce7118b2aff46f38de8e9d6f5301e41 P eaa6f3dc13d643b9acfd8df1263a456d: Bootstrap starting.
I20260709 13:09:26.453833 30761 ts_tablet_manager.cc:1434] T c9a02595d5e340be8cf9484066cf9cc7 P d7def43826924f03b8858383f0dc69f4: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.000s
I20260709 13:09:26.450765 30762 consensus_queue.cc:260] T c9a02595d5e340be8cf9484066cf9cc7 P b1daf23b3538498bb795a60d627b6ac0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1daf23b3538498bb795a60d627b6ac0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 36109 } } peers { permanent_uuid: "d7def43826924f03b8858383f0dc69f4" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 40053 } } peers { permanent_uuid: "eaa6f3dc13d643b9acfd8df1263a456d" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 41395 } }
I20260709 13:09:26.456561 30762 ts_tablet_manager.cc:1434] T c9a02595d5e340be8cf9484066cf9cc7 P b1daf23b3538498bb795a60d627b6ac0: Time spent starting tablet: real 0.012s	user 0.008s	sys 0.000s
I20260709 13:09:26.457571 30762 tablet_bootstrap.cc:492] T f657c3787a9d497f91e05a50c36622f2 P b1daf23b3538498bb795a60d627b6ac0: Bootstrap starting.
I20260709 13:09:26.459372 30761 tablet_bootstrap.cc:492] T 93f7bd85158a4f47aabfeb6b20b664e7 P d7def43826924f03b8858383f0dc69f4: Bootstrap starting.
I20260709 13:09:26.463852 30762 tablet_bootstrap.cc:654] T f657c3787a9d497f91e05a50c36622f2 P b1daf23b3538498bb795a60d627b6ac0: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:26.465749 30763 tablet_bootstrap.cc:654] T 7ce7118b2aff46f38de8e9d6f5301e41 P eaa6f3dc13d643b9acfd8df1263a456d: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:26.467047 30764 raft_consensus.cc:493] T 905b37e519a4428995623c0c8357fc0f P d7def43826924f03b8858383f0dc69f4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:26.467747 30764 raft_consensus.cc:515] T 905b37e519a4428995623c0c8357fc0f P d7def43826924f03b8858383f0dc69f4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1daf23b3538498bb795a60d627b6ac0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 36109 } } peers { permanent_uuid: "d7def43826924f03b8858383f0dc69f4" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 40053 } } peers { permanent_uuid: "eaa6f3dc13d643b9acfd8df1263a456d" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 41395 } }
I20260709 13:09:26.471463 30475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "905b37e519a4428995623c0c8357fc0f" candidate_uuid: "d7def43826924f03b8858383f0dc69f4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1daf23b3538498bb795a60d627b6ac0" is_pre_election: true
I20260709 13:09:26.472363 30475 raft_consensus.cc:2468] T 905b37e519a4428995623c0c8357fc0f P b1daf23b3538498bb795a60d627b6ac0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d7def43826924f03b8858383f0dc69f4 in term 0.
I20260709 13:09:26.473743 30514 leader_election.cc:304] T 905b37e519a4428995623c0c8357fc0f P d7def43826924f03b8858383f0dc69f4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b1daf23b3538498bb795a60d627b6ac0, d7def43826924f03b8858383f0dc69f4; no voters: 
I20260709 13:09:26.474625 30749 raft_consensus.cc:2804] T 905b37e519a4428995623c0c8357fc0f P d7def43826924f03b8858383f0dc69f4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:26.474973 30764 leader_election.cc:290] T 905b37e519a4428995623c0c8357fc0f P d7def43826924f03b8858383f0dc69f4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b1daf23b3538498bb795a60d627b6ac0 (127.17.223.1:36109), eaa6f3dc13d643b9acfd8df1263a456d (127.17.223.3:41395)
I20260709 13:09:26.475041 30749 raft_consensus.cc:493] T 905b37e519a4428995623c0c8357fc0f P d7def43826924f03b8858383f0dc69f4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:26.475495 30762 tablet_bootstrap.cc:492] T f657c3787a9d497f91e05a50c36622f2 P b1daf23b3538498bb795a60d627b6ac0: No bootstrap required, opened a new log
I20260709 13:09:26.475620 30749 raft_consensus.cc:3060] T 905b37e519a4428995623c0c8357fc0f P d7def43826924f03b8858383f0dc69f4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:26.476051 30762 ts_tablet_manager.cc:1403] T f657c3787a9d497f91e05a50c36622f2 P b1daf23b3538498bb795a60d627b6ac0: Time spent bootstrapping tablet: real 0.019s	user 0.009s	sys 0.007s
I20260709 13:09:26.477249 30763 tablet_bootstrap.cc:492] T 7ce7118b2aff46f38de8e9d6f5301e41 P eaa6f3dc13d643b9acfd8df1263a456d: No bootstrap required, opened a new log
I20260709 13:09:26.483093 30763 ts_tablet_manager.cc:1403] T 7ce7118b2aff46f38de8e9d6f5301e41 P eaa6f3dc13d643b9acfd8df1263a456d: Time spent bootstrapping tablet: real 0.030s	user 0.019s	sys 0.004s
I20260709 13:09:26.483381 30762 raft_consensus.cc:359] T f657c3787a9d497f91e05a50c36622f2 P b1daf23b3538498bb795a60d627b6ac0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1daf23b3538498bb795a60d627b6ac0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 36109 } } peers { permanent_uuid: "d7def43826924f03b8858383f0dc69f4" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 40053 } } peers { permanent_uuid: "eaa6f3dc13d643b9acfd8df1263a456d" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 41395 } }
I20260709 13:09:26.483987 30762 raft_consensus.cc:385] T f657c3787a9d497f91e05a50c36622f2 P b1daf23b3538498bb795a60d627b6ac0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:26.484236 30762 raft_consensus.cc:740] T f657c3787a9d497f91e05a50c36622f2 P b1daf23b3538498bb795a60d627b6ac0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b1daf23b3538498bb795a60d627b6ac0, State: Initialized, Role: FOLLOWER
I20260709 13:09:26.484882 30762 consensus_queue.cc:260] T f657c3787a9d497f91e05a50c36622f2 P b1daf23b3538498bb795a60d627b6ac0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1daf23b3538498bb795a60d627b6ac0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 36109 } } peers { permanent_uuid: "d7def43826924f03b8858383f0dc69f4" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 40053 } } peers { permanent_uuid: "eaa6f3dc13d643b9acfd8df1263a456d" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 41395 } }
I20260709 13:09:26.481818 30761 tablet_bootstrap.cc:654] T 93f7bd85158a4f47aabfeb6b20b664e7 P d7def43826924f03b8858383f0dc69f4: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:26.486732 30762 ts_tablet_manager.cc:1434] T f657c3787a9d497f91e05a50c36622f2 P b1daf23b3538498bb795a60d627b6ac0: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
I20260709 13:09:26.488368 30762 tablet_bootstrap.cc:492] T b90351987d7741299d85cc7599d58d07 P b1daf23b3538498bb795a60d627b6ac0: Bootstrap starting.
I20260709 13:09:26.476598 30624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "905b37e519a4428995623c0c8357fc0f" candidate_uuid: "d7def43826924f03b8858383f0dc69f4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eaa6f3dc13d643b9acfd8df1263a456d" is_pre_election: true
I20260709 13:09:26.486083 30763 raft_consensus.cc:359] T 7ce7118b2aff46f38de8e9d6f5301e41 P eaa6f3dc13d643b9acfd8df1263a456d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1daf23b3538498bb795a60d627b6ac0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 36109 } } peers { permanent_uuid: "d7def43826924f03b8858383f0dc69f4" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 40053 } } peers { permanent_uuid: "eaa6f3dc13d643b9acfd8df1263a456d" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 41395 } }
I20260709 13:09:26.490463 30624 raft_consensus.cc:2468] T 905b37e519a4428995623c0c8357fc0f P eaa6f3dc13d643b9acfd8df1263a456d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d7def43826924f03b8858383f0dc69f4 in term 0.
I20260709 13:09:26.490592 30763 raft_consensus.cc:385] T 7ce7118b2aff46f38de8e9d6f5301e41 P eaa6f3dc13d643b9acfd8df1263a456d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:26.491024 30763 raft_consensus.cc:740] T 7ce7118b2aff46f38de8e9d6f5301e41 P eaa6f3dc13d643b9acfd8df1263a456d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eaa6f3dc13d643b9acfd8df1263a456d, State: Initialized, Role: FOLLOWER
I20260709 13:09:26.492049 30763 consensus_queue.cc:260] T 7ce7118b2aff46f38de8e9d6f5301e41 P eaa6f3dc13d643b9acfd8df1263a456d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1daf23b3538498bb795a60d627b6ac0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 36109 } } peers { permanent_uuid: "d7def43826924f03b8858383f0dc69f4" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 40053 } } peers { permanent_uuid: "eaa6f3dc13d643b9acfd8df1263a456d" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 41395 } }
W20260709 13:09:26.497602 30422 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:09:26.498706 30763 ts_tablet_manager.cc:1434] T 7ce7118b2aff46f38de8e9d6f5301e41 P eaa6f3dc13d643b9acfd8df1263a456d: Time spent starting tablet: real 0.015s	user 0.006s	sys 0.001s
I20260709 13:09:26.499811 30763 tablet_bootstrap.cc:492] T 19335986fe9c4f738db226a45653127a P eaa6f3dc13d643b9acfd8df1263a456d: Bootstrap starting.
I20260709 13:09:26.499868 30762 tablet_bootstrap.cc:654] T b90351987d7741299d85cc7599d58d07 P b1daf23b3538498bb795a60d627b6ac0: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:26.500604 30749 raft_consensus.cc:515] T 905b37e519a4428995623c0c8357fc0f P d7def43826924f03b8858383f0dc69f4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1daf23b3538498bb795a60d627b6ac0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 36109 } } peers { permanent_uuid: "d7def43826924f03b8858383f0dc69f4" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 40053 } } peers { permanent_uuid: "eaa6f3dc13d643b9acfd8df1263a456d" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 41395 } }
I20260709 13:09:26.502655 30749 leader_election.cc:290] T 905b37e519a4428995623c0c8357fc0f P d7def43826924f03b8858383f0dc69f4 [CANDIDATE]: Term 1 election: Requested vote from peers b1daf23b3538498bb795a60d627b6ac0 (127.17.223.1:36109), eaa6f3dc13d643b9acfd8df1263a456d (127.17.223.3:41395)
I20260709 13:09:26.504591 30475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "905b37e519a4428995623c0c8357fc0f" candidate_uuid: "d7def43826924f03b8858383f0dc69f4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1daf23b3538498bb795a60d627b6ac0"
I20260709 13:09:26.505411 30475 raft_consensus.cc:3060] T 905b37e519a4428995623c0c8357fc0f P b1daf23b3538498bb795a60d627b6ac0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:26.507148 30763 tablet_bootstrap.cc:654] T 19335986fe9c4f738db226a45653127a P eaa6f3dc13d643b9acfd8df1263a456d: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:26.507720 30624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "905b37e519a4428995623c0c8357fc0f" candidate_uuid: "d7def43826924f03b8858383f0dc69f4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eaa6f3dc13d643b9acfd8df1263a456d"
I20260709 13:09:26.508437 30766 raft_consensus.cc:493] T b90351987d7741299d85cc7599d58d07 P eaa6f3dc13d643b9acfd8df1263a456d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:26.509006 30766 raft_consensus.cc:515] T b90351987d7741299d85cc7599d58d07 P eaa6f3dc13d643b9acfd8df1263a456d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1daf23b3538498bb795a60d627b6ac0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 36109 } } peers { permanent_uuid: "d7def43826924f03b8858383f0dc69f4" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 40053 } } peers { permanent_uuid: "eaa6f3dc13d643b9acfd8df1263a456d" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 41395 } }
I20260709 13:09:26.510175 30762 tablet_bootstrap.cc:492] T b90351987d7741299d85cc7599d58d07 P b1daf23b3538498bb795a60d627b6ac0: No bootstrap required, opened a new log
I20260709 13:09:26.510718 30762 ts_tablet_manager.cc:1403] T b90351987d7741299d85cc7599d58d07 P b1daf23b3538498bb795a60d627b6ac0: Time spent bootstrapping tablet: real 0.023s	user 0.008s	sys 0.006s
I20260709 13:09:26.510874 30766 leader_election.cc:290] T b90351987d7741299d85cc7599d58d07 P eaa6f3dc13d643b9acfd8df1263a456d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b1daf23b3538498bb795a60d627b6ac0 (127.17.223.1:36109), d7def43826924f03b8858383f0dc69f4 (127.17.223.2:40053)
I20260709 13:09:26.508463 30624 raft_consensus.cc:3060] T 905b37e519a4428995623c0c8357fc0f P eaa6f3dc13d643b9acfd8df1263a456d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:26.513669 30762 raft_consensus.cc:359] T b90351987d7741299d85cc7599d58d07 P b1daf23b3538498bb795a60d627b6ac0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1daf23b3538498bb795a60d627b6ac0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 36109 } } peers { permanent_uuid: "d7def43826924f03b8858383f0dc69f4" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 40053 } } peers { permanent_uuid: "eaa6f3dc13d643b9acfd8df1263a456d" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 41395 } }
I20260709 13:09:26.514398 30762 raft_consensus.cc:385] T b90351987d7741299d85cc7599d58d07 P b1daf23b3538498bb795a60d627b6ac0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:26.514696 30762 raft_consensus.cc:740] T b90351987d7741299d85cc7599d58d07 P b1daf23b3538498bb795a60d627b6ac0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b1daf23b3538498bb795a60d627b6ac0, State: Initialized, Role: FOLLOWER
I20260709 13:09:26.515048 30548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b90351987d7741299d85cc7599d58d07" candidate_uuid: "eaa6f3dc13d643b9acfd8df1263a456d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d7def43826924f03b8858383f0dc69f4" is_pre_election: true
I20260709 13:09:26.517782 30624 raft_consensus.cc:2468] T 905b37e519a4428995623c0c8357fc0f P eaa6f3dc13d643b9acfd8df1263a456d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d7def43826924f03b8858383f0dc69f4 in term 1.
I20260709 13:09:26.515048 30476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b90351987d7741299d85cc7599d58d07" candidate_uuid: "eaa6f3dc13d643b9acfd8df1263a456d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1daf23b3538498bb795a60d627b6ac0" is_pre_election: true
I20260709 13:09:26.518828 30749 raft_consensus.cc:493] T 19335986fe9c4f738db226a45653127a P d7def43826924f03b8858383f0dc69f4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:09:26.518887 30588 leader_election.cc:343] T b90351987d7741299d85cc7599d58d07 P eaa6f3dc13d643b9acfd8df1263a456d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d7def43826924f03b8858383f0dc69f4 (127.17.223.2:40053): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:26.519534 30514 leader_election.cc:304] T 905b37e519a4428995623c0c8357fc0f P d7def43826924f03b8858383f0dc69f4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d7def43826924f03b8858383f0dc69f4, eaa6f3dc13d643b9acfd8df1263a456d; no voters: 
I20260709 13:09:26.519701 30749 raft_consensus.cc:515] T 19335986fe9c4f738db226a45653127a P d7def43826924f03b8858383f0dc69f4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1daf23b3538498bb795a60d627b6ac0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 36109 } } peers { permanent_uuid: "d7def43826924f03b8858383f0dc69f4" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 40053 } } peers { permanent_uuid: "eaa6f3dc13d643b9acfd8df1263a456d" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 41395 } }
I20260709 13:09:26.520486 30764 raft_consensus.cc:2804] T 905b37e519a4428995623c0c8357fc0f P d7def43826924f03b8858383f0dc69f4 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:26.521821 30749 leader_election.cc:290] T 19335986fe9c4f738db226a45653127a P d7def43826924f03b8858383f0dc69f4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b1daf23b3538498bb795a60d627b6ac0 (127.17.223.1:36109), eaa6f3dc13d643b9acfd8df1263a456d (127.17.223.3:41395)
I20260709 13:09:26.522917 30762 consensus_queue.cc:260] T b90351987d7741299d85cc7599d58d07 P b1daf23b3538498bb795a60d627b6ac0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1daf23b3538498bb795a60d627b6ac0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 36109 } } peers { permanent_uuid: "d7def43826924f03b8858383f0dc69f4" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 40053 } } peers { permanent_uuid: "eaa6f3dc13d643b9acfd8df1263a456d" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 41395 } }
I20260709 13:09:26.523027 30474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19335986fe9c4f738db226a45653127a" candidate_uuid: "d7def43826924f03b8858383f0dc69f4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1daf23b3538498bb795a60d627b6ac0" is_pre_election: true
I20260709 13:09:26.523797 30476 raft_consensus.cc:2468] T b90351987d7741299d85cc7599d58d07 P b1daf23b3538498bb795a60d627b6ac0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eaa6f3dc13d643b9acfd8df1263a456d in term 0.
W20260709 13:09:26.524712 30514 leader_election.cc:343] T 19335986fe9c4f738db226a45653127a P d7def43826924f03b8858383f0dc69f4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b1daf23b3538498bb795a60d627b6ac0 (127.17.223.1:36109): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:26.525249 30762 ts_tablet_manager.cc:1434] T b90351987d7741299d85cc7599d58d07 P b1daf23b3538498bb795a60d627b6ac0: Time spent starting tablet: real 0.014s	user 0.005s	sys 0.000s
I20260709 13:09:26.525626 30761 tablet_bootstrap.cc:492] T 93f7bd85158a4f47aabfeb6b20b664e7 P d7def43826924f03b8858383f0dc69f4: No bootstrap required, opened a new log
I20260709 13:09:26.526151 30761 ts_tablet_manager.cc:1403] T 93f7bd85158a4f47aabfeb6b20b664e7 P d7def43826924f03b8858383f0dc69f4: Time spent bootstrapping tablet: real 0.067s	user 0.018s	sys 0.004s
I20260709 13:09:26.526386 30762 tablet_bootstrap.cc:492] T 035d977bcb604138a0c5e70d38013012 P b1daf23b3538498bb795a60d627b6ac0: Bootstrap starting.
I20260709 13:09:26.527171 30588 leader_election.cc:304] T b90351987d7741299d85cc7599d58d07 P eaa6f3dc13d643b9acfd8df1263a456d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b1daf23b3538498bb795a60d627b6ac0, eaa6f3dc13d643b9acfd8df1263a456d; no voters: d7def43826924f03b8858383f0dc69f4
I20260709 13:09:26.528415 30766 raft_consensus.cc:2804] T b90351987d7741299d85cc7599d58d07 P eaa6f3dc13d643b9acfd8df1263a456d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:26.528631 30475 raft_consensus.cc:2468] T 905b37e519a4428995623c0c8357fc0f P b1daf23b3538498bb795a60d627b6ac0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d7def43826924f03b8858383f0dc69f4 in term 1.
I20260709 13:09:26.528800 30766 raft_consensus.cc:493] T b90351987d7741299d85cc7599d58d07 P eaa6f3dc13d643b9acfd8df1263a456d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:26.529237 30766 raft_consensus.cc:3060] T b90351987d7741299d85cc7599d58d07 P eaa6f3dc13d643b9acfd8df1263a456d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:26.533430 30761 raft_consensus.cc:359] T 93f7bd85158a4f47aabfeb6b20b664e7 P d7def43826924f03b8858383f0dc69f4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1daf23b3538498bb795a60d627b6ac0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 36109 } } peers { permanent_uuid: "d7def43826924f03b8858383f0dc69f4" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 40053 } } peers { permanent_uuid: "eaa6f3dc13d643b9acfd8df1263a456d" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 41395 } }
I20260709 13:09:26.534181 30761 raft_consensus.cc:385] T 93f7bd85158a4f47aabfeb6b20b664e7 P d7def43826924f03b8858383f0dc69f4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:26.534471 30761 raft_consensus.cc:740] T 93f7bd85158a4f47aabfeb6b20b664e7 P d7def43826924f03b8858383f0dc69f4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d7def43826924f03b8858383f0dc69f4, State: Initialized, Role: FOLLOWER
I20260709 13:09:26.538810 30762 tablet_bootstrap.cc:654] T 035d977bcb604138a0c5e70d38013012 P b1daf23b3538498bb795a60d627b6ac0: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:26.539484 30761 consensus_queue.cc:260] T 93f7bd85158a4f47aabfeb6b20b664e7 P d7def43826924f03b8858383f0dc69f4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1daf23b3538498bb795a60d627b6ac0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 36109 } } peers { permanent_uuid: "d7def43826924f03b8858383f0dc69f4" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 40053 } } peers { permanent_uuid: "eaa6f3dc13d643b9acfd8df1263a456d" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 41395 } }
I20260709 13:09:26.541356 30624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19335986fe9c4f738db226a45653127a" candidate_uuid: "d7def43826924f03b8858383f0dc69f4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eaa6f3dc13d643b9acfd8df1263a456d" is_pre_election: true
I20260709 13:09:26.542323 30761 ts_tablet_manager.cc:1434] T 93f7bd85158a4f47aabfeb6b20b664e7 P d7def43826924f03b8858383f0dc69f4: Time spent starting tablet: real 0.016s	user 0.008s	sys 0.000s
I20260709 13:09:26.542973 30764 raft_consensus.cc:697] T 905b37e519a4428995623c0c8357fc0f P d7def43826924f03b8858383f0dc69f4 [term 1 LEADER]: Becoming Leader. State: Replica: d7def43826924f03b8858383f0dc69f4, State: Running, Role: LEADER
W20260709 13:09:26.543033 30514 leader_election.cc:343] T 19335986fe9c4f738db226a45653127a P d7def43826924f03b8858383f0dc69f4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer eaa6f3dc13d643b9acfd8df1263a456d (127.17.223.3:41395): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:26.543710 30514 leader_election.cc:304] T 19335986fe9c4f738db226a45653127a P d7def43826924f03b8858383f0dc69f4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d7def43826924f03b8858383f0dc69f4; no voters: b1daf23b3538498bb795a60d627b6ac0, eaa6f3dc13d643b9acfd8df1263a456d
I20260709 13:09:26.543936 30761 tablet_bootstrap.cc:492] T f657c3787a9d497f91e05a50c36622f2 P d7def43826924f03b8858383f0dc69f4: Bootstrap starting.
I20260709 13:09:26.544158 30764 consensus_queue.cc:237] T 905b37e519a4428995623c0c8357fc0f P d7def43826924f03b8858383f0dc69f4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1daf23b3538498bb795a60d627b6ac0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 36109 } } peers { permanent_uuid: "d7def43826924f03b8858383f0dc69f4" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 40053 } } peers { permanent_uuid: "eaa6f3dc13d643b9acfd8df1263a456d" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 41395 } }
I20260709 13:09:26.544896 30784 raft_consensus.cc:2749] T 19335986fe9c4f738db226a45653127a P d7def43826924f03b8858383f0dc69f4 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:26.545166 30766 raft_consensus.cc:515] T b90351987d7741299d85cc7599d58d07 P eaa6f3dc13d643b9acfd8df1263a456d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1daf23b3538498bb795a60d627b6ac0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 36109 } } peers { permanent_uuid: "d7def43826924f03b8858383f0dc69f4" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 40053 } } peers { permanent_uuid: "eaa6f3dc13d643b9acfd8df1263a456d" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 41395 } }
I20260709 13:09:26.549937 30475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b90351987d7741299d85cc7599d58d07" candidate_uuid: "eaa6f3dc13d643b9acfd8df1263a456d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1daf23b3538498bb795a60d627b6ac0"
I20260709 13:09:26.549844 30762 tablet_bootstrap.cc:492] T 035d977bcb604138a0c5e70d38013012 P b1daf23b3538498bb795a60d627b6ac0: No bootstrap required, opened a new log
I20260709 13:09:26.550763 30475 raft_consensus.cc:3060] T b90351987d7741299d85cc7599d58d07 P b1daf23b3538498bb795a60d627b6ac0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:26.551009 30762 ts_tablet_manager.cc:1403] T 035d977bcb604138a0c5e70d38013012 P b1daf23b3538498bb795a60d627b6ac0: Time spent bootstrapping tablet: real 0.025s	user 0.013s	sys 0.000s
I20260709 13:09:26.551663 30761 tablet_bootstrap.cc:654] T f657c3787a9d497f91e05a50c36622f2 P d7def43826924f03b8858383f0dc69f4: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:26.555212 30762 raft_consensus.cc:359] T 035d977bcb604138a0c5e70d38013012 P b1daf23b3538498bb795a60d627b6ac0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1daf23b3538498bb795a60d627b6ac0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 36109 } } peers { permanent_uuid: "d7def43826924f03b8858383f0dc69f4" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 40053 } } peers { permanent_uuid: "eaa6f3dc13d643b9acfd8df1263a456d" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 41395 } }
I20260709 13:09:26.556219 30762 raft_consensus.cc:385] T 035d977bcb604138a0c5e70d38013012 P b1daf23b3538498bb795a60d627b6ac0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:26.556605 30762 raft_consensus.cc:740] T 035d977bcb604138a0c5e70d38013012 P b1daf23b3538498bb795a60d627b6ac0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b1daf23b3538498bb795a60d627b6ac0, State: Initialized, Role: FOLLOWER
I20260709 13:09:26.557566 30762 consensus_queue.cc:260] T 035d977bcb604138a0c5e70d38013012 P b1daf23b3538498bb795a60d627b6ac0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1daf23b3538498bb795a60d627b6ac0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 36109 } } peers { permanent_uuid: "d7def43826924f03b8858383f0dc69f4" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 40053 } } peers { permanent_uuid: "eaa6f3dc13d643b9acfd8df1263a456d" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 41395 } }
I20260709 13:09:26.560273 30548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b90351987d7741299d85cc7599d58d07" candidate_uuid: "eaa6f3dc13d643b9acfd8df1263a456d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d7def43826924f03b8858383f0dc69f4"
I20260709 13:09:26.560732 30762 ts_tablet_manager.cc:1434] T 035d977bcb604138a0c5e70d38013012 P b1daf23b3538498bb795a60d627b6ac0: Time spent starting tablet: real 0.009s	user 0.003s	sys 0.005s
W20260709 13:09:26.561683 30588 leader_election.cc:343] T b90351987d7741299d85cc7599d58d07 P eaa6f3dc13d643b9acfd8df1263a456d [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer d7def43826924f03b8858383f0dc69f4 (127.17.223.2:40053): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:26.561926 30762 tablet_bootstrap.cc:492] T 19335986fe9c4f738db226a45653127a P b1daf23b3538498bb795a60d627b6ac0: Bootstrap starting.
I20260709 13:09:26.562644 30766 leader_election.cc:290] T b90351987d7741299d85cc7599d58d07 P eaa6f3dc13d643b9acfd8df1263a456d [CANDIDATE]: Term 1 election: Requested vote from peers b1daf23b3538498bb795a60d627b6ac0 (127.17.223.1:36109), d7def43826924f03b8858383f0dc69f4 (127.17.223.2:40053)
I20260709 13:09:26.565003 30475 raft_consensus.cc:2468] T b90351987d7741299d85cc7599d58d07 P b1daf23b3538498bb795a60d627b6ac0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eaa6f3dc13d643b9acfd8df1263a456d in term 1.
I20260709 13:09:26.568878 30588 leader_election.cc:304] T b90351987d7741299d85cc7599d58d07 P eaa6f3dc13d643b9acfd8df1263a456d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b1daf23b3538498bb795a60d627b6ac0, eaa6f3dc13d643b9acfd8df1263a456d; no voters: d7def43826924f03b8858383f0dc69f4
I20260709 13:09:26.567792 30763 tablet_bootstrap.cc:492] T 19335986fe9c4f738db226a45653127a P eaa6f3dc13d643b9acfd8df1263a456d: No bootstrap required, opened a new log
I20260709 13:09:26.570250 30763 ts_tablet_manager.cc:1403] T 19335986fe9c4f738db226a45653127a P eaa6f3dc13d643b9acfd8df1263a456d: Time spent bootstrapping tablet: real 0.071s	user 0.013s	sys 0.000s
I20260709 13:09:26.570650 30766 raft_consensus.cc:2804] T b90351987d7741299d85cc7599d58d07 P eaa6f3dc13d643b9acfd8df1263a456d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:26.573506 30766 raft_consensus.cc:697] T b90351987d7741299d85cc7599d58d07 P eaa6f3dc13d643b9acfd8df1263a456d [term 1 LEADER]: Becoming Leader. State: Replica: eaa6f3dc13d643b9acfd8df1263a456d, State: Running, Role: LEADER
I20260709 13:09:26.576573 30763 raft_consensus.cc:359] T 19335986fe9c4f738db226a45653127a P eaa6f3dc13d643b9acfd8df1263a456d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1daf23b3538498bb795a60d627b6ac0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 36109 } } peers { permanent_uuid: "d7def43826924f03b8858383f0dc69f4" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 40053 } } peers { permanent_uuid: "eaa6f3dc13d643b9acfd8df1263a456d" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 41395 } }
I20260709 13:09:26.577919 30763 raft_consensus.cc:385] T 19335986fe9c4f738db226a45653127a P eaa6f3dc13d643b9acfd8df1263a456d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:26.578357 30763 raft_consensus.cc:740] T 19335986fe9c4f738db226a45653127a P eaa6f3dc13d643b9acfd8df1263a456d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eaa6f3dc13d643b9acfd8df1263a456d, State: Initialized, Role: FOLLOWER
I20260709 13:09:26.578545 30762 tablet_bootstrap.cc:654] T 19335986fe9c4f738db226a45653127a P b1daf23b3538498bb795a60d627b6ac0: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:26.574584 30766 consensus_queue.cc:237] T b90351987d7741299d85cc7599d58d07 P eaa6f3dc13d643b9acfd8df1263a456d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1daf23b3538498bb795a60d627b6ac0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 36109 } } peers { permanent_uuid: "d7def43826924f03b8858383f0dc69f4" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 40053 } } peers { permanent_uuid: "eaa6f3dc13d643b9acfd8df1263a456d" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 41395 } }
I20260709 13:09:26.580847 30761 tablet_bootstrap.cc:492] T f657c3787a9d497f91e05a50c36622f2 P d7def43826924f03b8858383f0dc69f4: No bootstrap required, opened a new log
I20260709 13:09:26.582585 30761 ts_tablet_manager.cc:1403] T f657c3787a9d497f91e05a50c36622f2 P d7def43826924f03b8858383f0dc69f4: Time spent bootstrapping tablet: real 0.039s	user 0.016s	sys 0.003s
I20260709 13:09:26.585251 30761 raft_consensus.cc:359] T f657c3787a9d497f91e05a50c36622f2 P d7def43826924f03b8858383f0dc69f4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1daf23b3538498bb795a60d627b6ac0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 36109 } } peers { permanent_uuid: "d7def43826924f03b8858383f0dc69f4" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 40053 } } peers { permanent_uuid: "eaa6f3dc13d643b9acfd8df1263a456d" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 41395 } }
I20260709 13:09:26.585855 30761 raft_consensus.cc:385] T f657c3787a9d497f91e05a50c36622f2 P d7def43826924f03b8858383f0dc69f4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:26.586126 30761 raft_consensus.cc:740] T f657c3787a9d497f91e05a50c36622f2 P d7def43826924f03b8858383f0dc69f4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d7def43826924f03b8858383f0dc69f4, State: Initialized, Role: FOLLOWER
I20260709 13:09:26.586831 30761 consensus_queue.cc:260] T f657c3787a9d497f91e05a50c36622f2 P d7def43826924f03b8858383f0dc69f4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1daf23b3538498bb795a60d627b6ac0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 36109 } } peers { permanent_uuid: "d7def43826924f03b8858383f0dc69f4" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 40053 } } peers { permanent_uuid: "eaa6f3dc13d643b9acfd8df1263a456d" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 41395 } }
I20260709 13:09:26.579298 30763 consensus_queue.cc:260] T 19335986fe9c4f738db226a45653127a P eaa6f3dc13d643b9acfd8df1263a456d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1daf23b3538498bb795a60d627b6ac0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 36109 } } peers { permanent_uuid: "d7def43826924f03b8858383f0dc69f4" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 40053 } } peers { permanent_uuid: "eaa6f3dc13d643b9acfd8df1263a456d" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 41395 } }
I20260709 13:09:26.590078 30761 ts_tablet_manager.cc:1434] T f657c3787a9d497f91e05a50c36622f2 P d7def43826924f03b8858383f0dc69f4: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:09:26.591151 30761 tablet_bootstrap.cc:492] T b90351987d7741299d85cc7599d58d07 P d7def43826924f03b8858383f0dc69f4: Bootstrap starting.
I20260709 13:09:26.592815 30762 tablet_bootstrap.cc:492] T 19335986fe9c4f738db226a45653127a P b1daf23b3538498bb795a60d627b6ac0: No bootstrap required, opened a new log
I20260709 13:09:26.593542 30762 ts_tablet_manager.cc:1403] T 19335986fe9c4f738db226a45653127a P b1daf23b3538498bb795a60d627b6ac0: Time spent bootstrapping tablet: real 0.032s	user 0.012s	sys 0.008s
I20260709 13:09:26.595140 30763 ts_tablet_manager.cc:1434] T 19335986fe9c4f738db226a45653127a P eaa6f3dc13d643b9acfd8df1263a456d: Time spent starting tablet: real 0.024s	user 0.006s	sys 0.001s
I20260709 13:09:26.596395 30763 tablet_bootstrap.cc:492] T f657c3787a9d497f91e05a50c36622f2 P eaa6f3dc13d643b9acfd8df1263a456d: Bootstrap starting.
I20260709 13:09:26.597210 30762 raft_consensus.cc:359] T 19335986fe9c4f738db226a45653127a P b1daf23b3538498bb795a60d627b6ac0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1daf23b3538498bb795a60d627b6ac0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 36109 } } peers { permanent_uuid: "d7def43826924f03b8858383f0dc69f4" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 40053 } } peers { permanent_uuid: "eaa6f3dc13d643b9acfd8df1263a456d" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 41395 } }
I20260709 13:09:26.598246 30762 raft_consensus.cc:385] T 19335986fe9c4f738db226a45653127a P b1daf23b3538498bb795a60d627b6ac0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:26.598613 30762 raft_consensus.cc:740] T 19335986fe9c4f738db226a45653127a P b1daf23b3538498bb795a60d627b6ac0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b1daf23b3538498bb795a60d627b6ac0, State: Initialized, Role: FOLLOWER
I20260709 13:09:26.599668 30762 consensus_queue.cc:260] T 19335986fe9c4f738db226a45653127a P b1daf23b3538498bb795a60d627b6ac0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1daf23b3538498bb795a60d627b6ac0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 36109 } } peers { permanent_uuid: "d7def43826924f03b8858383f0dc69f4" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 40053 } } peers { permanent_uuid: "eaa6f3dc13d643b9acfd8df1263a456d" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 41395 } }
I20260709 13:09:26.597920 30761 tablet_bootstrap.cc:654] T b90351987d7741299d85cc7599d58d07 P d7def43826924f03b8858383f0dc69f4: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:26.603677 30762 ts_tablet_manager.cc:1434] T 19335986fe9c4f738db226a45653127a P b1daf23b3538498bb795a60d627b6ac0: Time spent starting tablet: real 0.010s	user 0.009s	sys 0.001s
I20260709 13:09:26.608345 30374 catalog_manager.cc:5697] T 905b37e519a4428995623c0c8357fc0f P d7def43826924f03b8858383f0dc69f4 reported cstate change: term changed from 0 to 1, leader changed from <none> to d7def43826924f03b8858383f0dc69f4 (127.17.223.2). New cstate: current_term: 1 leader_uuid: "d7def43826924f03b8858383f0dc69f4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1daf23b3538498bb795a60d627b6ac0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 36109 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d7def43826924f03b8858383f0dc69f4" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 40053 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "eaa6f3dc13d643b9acfd8df1263a456d" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 41395 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:26.646152 30748 raft_consensus.cc:493] T c9a02595d5e340be8cf9484066cf9cc7 P eaa6f3dc13d643b9acfd8df1263a456d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:26.646996 30748 raft_consensus.cc:515] T c9a02595d5e340be8cf9484066cf9cc7 P eaa6f3dc13d643b9acfd8df1263a456d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1daf23b3538498bb795a60d627b6ac0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 36109 } } peers { permanent_uuid: "d7def43826924f03b8858383f0dc69f4" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 40053 } } peers { permanent_uuid: "eaa6f3dc13d643b9acfd8df1263a456d" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 41395 } }
I20260709 13:09:26.652026 30548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9a02595d5e340be8cf9484066cf9cc7" candidate_uuid: "eaa6f3dc13d643b9acfd8df1263a456d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d7def43826924f03b8858383f0dc69f4" is_pre_election: true
I20260709 13:09:26.652840 30548 raft_consensus.cc:2468] T c9a02595d5e340be8cf9484066cf9cc7 P d7def43826924f03b8858383f0dc69f4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eaa6f3dc13d643b9acfd8df1263a456d in term 0.
I20260709 13:09:26.655622 30475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9a02595d5e340be8cf9484066cf9cc7" candidate_uuid: "eaa6f3dc13d643b9acfd8df1263a456d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1daf23b3538498bb795a60d627b6ac0" is_pre_election: true
I20260709 13:09:26.656536 30475 raft_consensus.cc:2468] T c9a02595d5e340be8cf9484066cf9cc7 P b1daf23b3538498bb795a60d627b6ac0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eaa6f3dc13d643b9acfd8df1263a456d in term 0.
I20260709 13:09:26.658699 30748 leader_election.cc:290] T c9a02595d5e340be8cf9484066cf9cc7 P eaa6f3dc13d643b9acfd8df1263a456d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b1daf23b3538498bb795a60d627b6ac0 (127.17.223.1:36109), d7def43826924f03b8858383f0dc69f4 (127.17.223.2:40053)
I20260709 13:09:26.659452 30748 raft_consensus.cc:493] T 7ce7118b2aff46f38de8e9d6f5301e41 P eaa6f3dc13d643b9acfd8df1263a456d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:26.659991 30748 raft_consensus.cc:515] T 7ce7118b2aff46f38de8e9d6f5301e41 P eaa6f3dc13d643b9acfd8df1263a456d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1daf23b3538498bb795a60d627b6ac0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 36109 } } peers { permanent_uuid: "d7def43826924f03b8858383f0dc69f4" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 40053 } } peers { permanent_uuid: "eaa6f3dc13d643b9acfd8df1263a456d" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 41395 } }
I20260709 13:09:26.662662 30588 leader_election.cc:304] T c9a02595d5e340be8cf9484066cf9cc7 P eaa6f3dc13d643b9acfd8df1263a456d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d7def43826924f03b8858383f0dc69f4, eaa6f3dc13d643b9acfd8df1263a456d; no voters: 
I20260709 13:09:26.665323 30762 tablet_bootstrap.cc:492] T 93f7bd85158a4f47aabfeb6b20b664e7 P b1daf23b3538498bb795a60d627b6ac0: Bootstrap starting.
I20260709 13:09:26.669723 30748 leader_election.cc:290] T 7ce7118b2aff46f38de8e9d6f5301e41 P eaa6f3dc13d643b9acfd8df1263a456d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b1daf23b3538498bb795a60d627b6ac0 (127.17.223.1:36109), d7def43826924f03b8858383f0dc69f4 (127.17.223.2:40053)
I20260709 13:09:26.670580 30748 raft_consensus.cc:493] T 035d977bcb604138a0c5e70d38013012 P eaa6f3dc13d643b9acfd8df1263a456d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:26.671249 30748 raft_consensus.cc:515] T 035d977bcb604138a0c5e70d38013012 P eaa6f3dc13d643b9acfd8df1263a456d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1daf23b3538498bb795a60d627b6ac0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 36109 } } peers { permanent_uuid: "d7def43826924f03b8858383f0dc69f4" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 40053 } } peers { permanent_uuid: "eaa6f3dc13d643b9acfd8df1263a456d" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 41395 } }
I20260709 13:09:26.673385 30795 raft_consensus.cc:2804] T c9a02595d5e340be8cf9484066cf9cc7 P eaa6f3dc13d643b9acfd8df1263a456d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:26.673602 30748 leader_election.cc:290] T 035d977bcb604138a0c5e70d38013012 P eaa6f3dc13d643b9acfd8df1263a456d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b1daf23b3538498bb795a60d627b6ac0 (127.17.223.1:36109), d7def43826924f03b8858383f0dc69f4 (127.17.223.2:40053)
I20260709 13:09:26.676656 30475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ce7118b2aff46f38de8e9d6f5301e41" candidate_uuid: "eaa6f3dc13d643b9acfd8df1263a456d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1daf23b3538498bb795a60d627b6ac0" is_pre_election: true
I20260709 13:09:26.677147 30761 tablet_bootstrap.cc:492] T b90351987d7741299d85cc7599d58d07 P d7def43826924f03b8858383f0dc69f4: No bootstrap required, opened a new log
I20260709 13:09:26.677520 30475 raft_consensus.cc:2468] T 7ce7118b2aff46f38de8e9d6f5301e41 P b1daf23b3538498bb795a60d627b6ac0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eaa6f3dc13d643b9acfd8df1263a456d in term 0.
I20260709 13:09:26.677732 30761 ts_tablet_manager.cc:1403] T b90351987d7741299d85cc7599d58d07 P d7def43826924f03b8858383f0dc69f4: Time spent bootstrapping tablet: real 0.087s	user 0.026s	sys 0.037s
I20260709 13:09:26.678274 30792 raft_consensus.cc:493] T 035d977bcb604138a0c5e70d38013012 P b1daf23b3538498bb795a60d627b6ac0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:26.678861 30792 raft_consensus.cc:515] T 035d977bcb604138a0c5e70d38013012 P b1daf23b3538498bb795a60d627b6ac0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1daf23b3538498bb795a60d627b6ac0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 36109 } } peers { permanent_uuid: "d7def43826924f03b8858383f0dc69f4" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 40053 } } peers { permanent_uuid: "eaa6f3dc13d643b9acfd8df1263a456d" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 41395 } }
I20260709 13:09:26.679759 30548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ce7118b2aff46f38de8e9d6f5301e41" candidate_uuid: "eaa6f3dc13d643b9acfd8df1263a456d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d7def43826924f03b8858383f0dc69f4" is_pre_election: true
I20260709 13:09:26.681874 30475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "035d977bcb604138a0c5e70d38013012" candidate_uuid: "eaa6f3dc13d643b9acfd8df1263a456d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1daf23b3538498bb795a60d627b6ac0" is_pre_election: true
I20260709 13:09:26.682469 30475 raft_consensus.cc:2468] T 035d977bcb604138a0c5e70d38013012 P b1daf23b3538498bb795a60d627b6ac0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eaa6f3dc13d643b9acfd8df1263a456d in term 0.
I20260709 13:09:26.684342 30548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "035d977bcb604138a0c5e70d38013012" candidate_uuid: "eaa6f3dc13d643b9acfd8df1263a456d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d7def43826924f03b8858383f0dc69f4" is_pre_election: true
I20260709 13:09:26.684438 30792 leader_election.cc:290] T 035d977bcb604138a0c5e70d38013012 P b1daf23b3538498bb795a60d627b6ac0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d7def43826924f03b8858383f0dc69f4 (127.17.223.2:40053), eaa6f3dc13d643b9acfd8df1263a456d (127.17.223.3:41395)
I20260709 13:09:26.685731 30792 raft_consensus.cc:493] T 7ce7118b2aff46f38de8e9d6f5301e41 P b1daf23b3538498bb795a60d627b6ac0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:26.687081 30793 raft_consensus.cc:493] T c9a02595d5e340be8cf9484066cf9cc7 P b1daf23b3538498bb795a60d627b6ac0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:09:26.685892 30588 leader_election.cc:343] T 7ce7118b2aff46f38de8e9d6f5301e41 P eaa6f3dc13d643b9acfd8df1263a456d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d7def43826924f03b8858383f0dc69f4 (127.17.223.2:40053): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:26.687579 30793 raft_consensus.cc:515] T c9a02595d5e340be8cf9484066cf9cc7 P b1daf23b3538498bb795a60d627b6ac0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1daf23b3538498bb795a60d627b6ac0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 36109 } } peers { permanent_uuid: "d7def43826924f03b8858383f0dc69f4" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 40053 } } peers { permanent_uuid: "eaa6f3dc13d643b9acfd8df1263a456d" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 41395 } }
W20260709 13:09:26.687925 30588 leader_election.cc:343] T 035d977bcb604138a0c5e70d38013012 P eaa6f3dc13d643b9acfd8df1263a456d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d7def43826924f03b8858383f0dc69f4 (127.17.223.2:40053): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:26.689041 30588 leader_election.cc:304] T 7ce7118b2aff46f38de8e9d6f5301e41 P eaa6f3dc13d643b9acfd8df1263a456d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b1daf23b3538498bb795a60d627b6ac0, eaa6f3dc13d643b9acfd8df1263a456d; no voters: d7def43826924f03b8858383f0dc69f4
I20260709 13:09:26.695648 30588 leader_election.cc:304] T 035d977bcb604138a0c5e70d38013012 P eaa6f3dc13d643b9acfd8df1263a456d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b1daf23b3538498bb795a60d627b6ac0, eaa6f3dc13d643b9acfd8df1263a456d; no voters: d7def43826924f03b8858383f0dc69f4
I20260709 13:09:26.689004 30761 raft_consensus.cc:359] T b90351987d7741299d85cc7599d58d07 P d7def43826924f03b8858383f0dc69f4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1daf23b3538498bb795a60d627b6ac0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 36109 } } peers { permanent_uuid: "d7def43826924f03b8858383f0dc69f4" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 40053 } } peers { permanent_uuid: "eaa6f3dc13d643b9acfd8df1263a456d" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 41395 } }
I20260709 13:09:26.696949 30761 raft_consensus.cc:385] T b90351987d7741299d85cc7599d58d07 P d7def43826924f03b8858383f0dc69f4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:26.697257 30761 raft_consensus.cc:740] T b90351987d7741299d85cc7599d58d07 P d7def43826924f03b8858383f0dc69f4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d7def43826924f03b8858383f0dc69f4, State: Initialized, Role: FOLLOWER
I20260709 13:09:26.691087 30793 leader_election.cc:290] T c9a02595d5e340be8cf9484066cf9cc7 P b1daf23b3538498bb795a60d627b6ac0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d7def43826924f03b8858383f0dc69f4 (127.17.223.2:40053), eaa6f3dc13d643b9acfd8df1263a456d (127.17.223.3:41395)
I20260709 13:09:26.689507 30762 tablet_bootstrap.cc:654] T 93f7bd85158a4f47aabfeb6b20b664e7 P b1daf23b3538498bb795a60d627b6ac0: Neither blocks nor log segments found. Creating new log.
W20260709 13:09:26.694238 30439 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.3:41395, user_credentials={real_user=slave}} blocked reactor thread for 92129.3us
I20260709 13:09:26.697988 30761 consensus_queue.cc:260] T b90351987d7741299d85cc7599d58d07 P d7def43826924f03b8858383f0dc69f4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1daf23b3538498bb795a60d627b6ac0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 36109 } } peers { permanent_uuid: "d7def43826924f03b8858383f0dc69f4" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 40053 } } peers { permanent_uuid: "eaa6f3dc13d643b9acfd8df1263a456d" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 41395 } }
I20260709 13:09:26.699873 30548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "035d977bcb604138a0c5e70d38013012" candidate_uuid: "b1daf23b3538498bb795a60d627b6ac0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d7def43826924f03b8858383f0dc69f4" is_pre_election: true
I20260709 13:09:26.700405 30761 ts_tablet_manager.cc:1434] T b90351987d7741299d85cc7599d58d07 P d7def43826924f03b8858383f0dc69f4: Time spent starting tablet: real 0.022s	user 0.008s	sys 0.000s
I20260709 13:09:26.700935 30624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "035d977bcb604138a0c5e70d38013012" candidate_uuid: "b1daf23b3538498bb795a60d627b6ac0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eaa6f3dc13d643b9acfd8df1263a456d" is_pre_election: true
I20260709 13:09:26.701577 30624 raft_consensus.cc:2468] T 035d977bcb604138a0c5e70d38013012 P eaa6f3dc13d643b9acfd8df1263a456d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1daf23b3538498bb795a60d627b6ac0 in term 0.
W20260709 13:09:26.703516 30439 leader_election.cc:343] T 035d977bcb604138a0c5e70d38013012 P b1daf23b3538498bb795a60d627b6ac0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d7def43826924f03b8858383f0dc69f4 (127.17.223.2:40053): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:26.701647 30761 tablet_bootstrap.cc:492] T 7ce7118b2aff46f38de8e9d6f5301e41 P d7def43826924f03b8858383f0dc69f4: Bootstrap starting.
I20260709 13:09:26.696341 30748 raft_consensus.cc:2804] T 7ce7118b2aff46f38de8e9d6f5301e41 P eaa6f3dc13d643b9acfd8df1263a456d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:26.692759 30763 tablet_bootstrap.cc:654] T f657c3787a9d497f91e05a50c36622f2 P eaa6f3dc13d643b9acfd8df1263a456d: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:26.714093 30761 tablet_bootstrap.cc:654] T 7ce7118b2aff46f38de8e9d6f5301e41 P d7def43826924f03b8858383f0dc69f4: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:26.720957 30748 raft_consensus.cc:493] T 7ce7118b2aff46f38de8e9d6f5301e41 P eaa6f3dc13d643b9acfd8df1263a456d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:26.721717 30748 raft_consensus.cc:3060] T 7ce7118b2aff46f38de8e9d6f5301e41 P eaa6f3dc13d643b9acfd8df1263a456d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:26.722883 30374 catalog_manager.cc:5697] T b90351987d7741299d85cc7599d58d07 P eaa6f3dc13d643b9acfd8df1263a456d reported cstate change: term changed from 0 to 1, leader changed from <none> to eaa6f3dc13d643b9acfd8df1263a456d (127.17.223.3). New cstate: current_term: 1 leader_uuid: "eaa6f3dc13d643b9acfd8df1263a456d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1daf23b3538498bb795a60d627b6ac0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 36109 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d7def43826924f03b8858383f0dc69f4" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 40053 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "eaa6f3dc13d643b9acfd8df1263a456d" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 41395 } health_report { overall_health: HEALTHY } } }
I20260709 13:09:26.704685 30795 raft_consensus.cc:493] T c9a02595d5e340be8cf9484066cf9cc7 P eaa6f3dc13d643b9acfd8df1263a456d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:26.704413 30439 leader_election.cc:304] T 035d977bcb604138a0c5e70d38013012 P b1daf23b3538498bb795a60d627b6ac0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b1daf23b3538498bb795a60d627b6ac0, eaa6f3dc13d643b9acfd8df1263a456d; no voters: d7def43826924f03b8858383f0dc69f4
I20260709 13:09:26.724364 30795 raft_consensus.cc:3060] T c9a02595d5e340be8cf9484066cf9cc7 P eaa6f3dc13d643b9acfd8df1263a456d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:26.725003 30670 raft_consensus.cc:2804] T 035d977bcb604138a0c5e70d38013012 P b1daf23b3538498bb795a60d627b6ac0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:26.725358 30670 raft_consensus.cc:493] T 035d977bcb604138a0c5e70d38013012 P b1daf23b3538498bb795a60d627b6ac0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:26.709313 30624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9a02595d5e340be8cf9484066cf9cc7" candidate_uuid: "b1daf23b3538498bb795a60d627b6ac0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eaa6f3dc13d643b9acfd8df1263a456d" is_pre_election: true
I20260709 13:09:26.725782 30670 raft_consensus.cc:3060] T 035d977bcb604138a0c5e70d38013012 P b1daf23b3538498bb795a60d627b6ac0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:26.686848 30792 raft_consensus.cc:515] T 7ce7118b2aff46f38de8e9d6f5301e41 P b1daf23b3538498bb795a60d627b6ac0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1daf23b3538498bb795a60d627b6ac0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 36109 } } peers { permanent_uuid: "d7def43826924f03b8858383f0dc69f4" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 40053 } } peers { permanent_uuid: "eaa6f3dc13d643b9acfd8df1263a456d" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 41395 } }
I20260709 13:09:26.727618 30792 leader_election.cc:290] T 7ce7118b2aff46f38de8e9d6f5301e41 P b1daf23b3538498bb795a60d627b6ac0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d7def43826924f03b8858383f0dc69f4 (127.17.223.2:40053), eaa6f3dc13d643b9acfd8df1263a456d (127.17.223.3:41395)
I20260709 13:09:26.708860 30548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9a02595d5e340be8cf9484066cf9cc7" candidate_uuid: "b1daf23b3538498bb795a60d627b6ac0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d7def43826924f03b8858383f0dc69f4" is_pre_election: true
I20260709 13:09:26.728614 30548 raft_consensus.cc:2468] T c9a02595d5e340be8cf9484066cf9cc7 P d7def43826924f03b8858383f0dc69f4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1daf23b3538498bb795a60d627b6ac0 in term 0.
I20260709 13:09:26.704380 30766 raft_consensus.cc:2804] T 035d977bcb604138a0c5e70d38013012 P eaa6f3dc13d643b9acfd8df1263a456d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:26.731184 30766 raft_consensus.cc:493] T 035d977bcb604138a0c5e70d38013012 P eaa6f3dc13d643b9acfd8df1263a456d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:26.731624 30766 raft_consensus.cc:3060] T 035d977bcb604138a0c5e70d38013012 P eaa6f3dc13d643b9acfd8df1263a456d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:26.732997 30762 tablet_bootstrap.cc:492] T 93f7bd85158a4f47aabfeb6b20b664e7 P b1daf23b3538498bb795a60d627b6ac0: No bootstrap required, opened a new log
I20260709 13:09:26.733517 30762 ts_tablet_manager.cc:1403] T 93f7bd85158a4f47aabfeb6b20b664e7 P b1daf23b3538498bb795a60d627b6ac0: Time spent bootstrapping tablet: real 0.069s	user 0.009s	sys 0.005s
I20260709 13:09:26.736136 30762 raft_consensus.cc:359] T 93f7bd85158a4f47aabfeb6b20b664e7 P b1daf23b3538498bb795a60d627b6ac0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1daf23b3538498bb795a60d627b6ac0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 36109 } } peers { permanent_uuid: "d7def43826924f03b8858383f0dc69f4" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 40053 } } peers { permanent_uuid: "eaa6f3dc13d643b9acfd8df1263a456d" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 41395 } }
I20260709 13:09:26.736769 30762 raft_consensus.cc:385] T 93f7bd85158a4f47aabfeb6b20b664e7 P b1daf23b3538498bb795a60d627b6ac0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:26.737011 30762 raft_consensus.cc:740] T 93f7bd85158a4f47aabfeb6b20b664e7 P b1daf23b3538498bb795a60d627b6ac0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b1daf23b3538498bb795a60d627b6ac0, State: Initialized, Role: FOLLOWER
I20260709 13:09:26.737721 30762 consensus_queue.cc:260] T 93f7bd85158a4f47aabfeb6b20b664e7 P b1daf23b3538498bb795a60d627b6ac0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1daf23b3538498bb795a60d627b6ac0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 36109 } } peers { permanent_uuid: "d7def43826924f03b8858383f0dc69f4" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 40053 } } peers { permanent_uuid: "eaa6f3dc13d643b9acfd8df1263a456d" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 41395 } }
I20260709 13:09:26.740072 30762 ts_tablet_manager.cc:1434] T 93f7bd85158a4f47aabfeb6b20b664e7 P b1daf23b3538498bb795a60d627b6ac0: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.001s
I20260709 13:09:26.744293 30623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ce7118b2aff46f38de8e9d6f5301e41" candidate_uuid: "b1daf23b3538498bb795a60d627b6ac0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eaa6f3dc13d643b9acfd8df1263a456d" is_pre_election: true
I20260709 13:09:26.746253 30548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ce7118b2aff46f38de8e9d6f5301e41" candidate_uuid: "b1daf23b3538498bb795a60d627b6ac0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d7def43826924f03b8858383f0dc69f4" is_pre_election: true
I20260709 13:09:26.749163 30763 tablet_bootstrap.cc:492] T f657c3787a9d497f91e05a50c36622f2 P eaa6f3dc13d643b9acfd8df1263a456d: No bootstrap required, opened a new log
I20260709 13:09:26.749974 30763 ts_tablet_manager.cc:1403] T f657c3787a9d497f91e05a50c36622f2 P eaa6f3dc13d643b9acfd8df1263a456d: Time spent bootstrapping tablet: real 0.154s	user 0.014s	sys 0.019s
I20260709 13:09:26.751614 30670 raft_consensus.cc:515] T 035d977bcb604138a0c5e70d38013012 P b1daf23b3538498bb795a60d627b6ac0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1daf23b3538498bb795a60d627b6ac0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 36109 } } peers { permanent_uuid: "d7def43826924f03b8858383f0dc69f4" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 40053 } } peers { permanent_uuid: "eaa6f3dc13d643b9acfd8df1263a456d" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 41395 } }
I20260709 13:09:26.753309 30670 leader_election.cc:290] T 035d977bcb604138a0c5e70d38013012 P b1daf23b3538498bb795a60d627b6ac0 [CANDIDATE]: Term 1 election: Requested vote from peers d7def43826924f03b8858383f0dc69f4 (127.17.223.2:40053), eaa6f3dc13d643b9acfd8df1263a456d (127.17.223.3:41395)
I20260709 13:09:26.753676 30763 raft_consensus.cc:359] T f657c3787a9d497f91e05a50c36622f2 P eaa6f3dc13d643b9acfd8df1263a456d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1daf23b3538498bb795a60d627b6ac0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 36109 } } peers { permanent_uuid: "d7def43826924f03b8858383f0dc69f4" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 40053 } } peers { permanent_uuid: "eaa6f3dc13d643b9acfd8df1263a456d" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 41395 } }
I20260709 13:09:26.754684 30763 raft_consensus.cc:385] T f657c3787a9d497f91e05a50c36622f2 P eaa6f3dc13d643b9acfd8df1263a456d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:26.755066 30763 raft_consensus.cc:740] T f657c3787a9d497f91e05a50c36622f2 P eaa6f3dc13d643b9acfd8df1263a456d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eaa6f3dc13d643b9acfd8df1263a456d, State: Initialized, Role: FOLLOWER
I20260709 13:09:26.754105 30439 leader_election.cc:304] T c9a02595d5e340be8cf9484066cf9cc7 P b1daf23b3538498bb795a60d627b6ac0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b1daf23b3538498bb795a60d627b6ac0, d7def43826924f03b8858383f0dc69f4; no voters: 
I20260709 13:09:26.755930 30763 consensus_queue.cc:260] T f657c3787a9d497f91e05a50c36622f2 P eaa6f3dc13d643b9acfd8df1263a456d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1daf23b3538498bb795a60d627b6ac0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 36109 } } peers { permanent_uuid: "d7def43826924f03b8858383f0dc69f4" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 40053 } } peers { permanent_uuid: "eaa6f3dc13d643b9acfd8df1263a456d" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 41395 } }
I20260709 13:09:26.760078 30764 raft_consensus.cc:493] T b90351987d7741299d85cc7599d58d07 P d7def43826924f03b8858383f0dc69f4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:26.760699 30764 raft_consensus.cc:515] T b90351987d7741299d85cc7599d58d07 P d7def43826924f03b8858383f0dc69f4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1daf23b3538498bb795a60d627b6ac0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 36109 } } peers { permanent_uuid: "d7def43826924f03b8858383f0dc69f4" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 40053 } } peers { permanent_uuid: "eaa6f3dc13d643b9acfd8df1263a456d" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 41395 } }
I20260709 13:09:26.761948 30795 raft_consensus.cc:515] T c9a02595d5e340be8cf9484066cf9cc7 P eaa6f3dc13d643b9acfd8df1263a456d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1daf23b3538498bb795a60d627b6ac0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 36109 } } peers { permanent_uuid: "d7def43826924f03b8858383f0dc69f4" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 40053 } } peers { permanent_uuid: "eaa6f3dc13d643b9acfd8df1263a456d" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 41395 } }
I20260709 13:09:26.762917 30764 leader_election.cc:290] T b90351987d7741299d85cc7599d58d07 P d7def43826924f03b8858383f0dc69f4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b1daf23b3538498bb795a60d627b6ac0 (127.17.223.1:36109), eaa6f3dc13d643b9acfd8df1263a456d (127.17.223.3:41395)
I20260709 13:09:26.763504 30624 raft_consensus.cc:2393] T c9a02595d5e340be8cf9484066cf9cc7 P eaa6f3dc13d643b9acfd8df1263a456d [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b1daf23b3538498bb795a60d627b6ac0 in current term 1: Already voted for candidate eaa6f3dc13d643b9acfd8df1263a456d in this term.
I20260709 13:09:26.765324 30625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b90351987d7741299d85cc7599d58d07" candidate_uuid: "d7def43826924f03b8858383f0dc69f4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eaa6f3dc13d643b9acfd8df1263a456d" is_pre_election: true
I20260709 13:09:26.766111 30793 raft_consensus.cc:2804] T c9a02595d5e340be8cf9484066cf9cc7 P b1daf23b3538498bb795a60d627b6ac0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:26.766480 30793 raft_consensus.cc:493] T c9a02595d5e340be8cf9484066cf9cc7 P b1daf23b3538498bb795a60d627b6ac0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:26.766860 30793 raft_consensus.cc:3060] T c9a02595d5e340be8cf9484066cf9cc7 P b1daf23b3538498bb795a60d627b6ac0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:26.759295 30748 raft_consensus.cc:515] T 7ce7118b2aff46f38de8e9d6f5301e41 P eaa6f3dc13d643b9acfd8df1263a456d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1daf23b3538498bb795a60d627b6ac0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 36109 } } peers { permanent_uuid: "d7def43826924f03b8858383f0dc69f4" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 40053 } } peers { permanent_uuid: "eaa6f3dc13d643b9acfd8df1263a456d" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 41395 } }
I20260709 13:09:26.769310 30623 raft_consensus.cc:2393] T 7ce7118b2aff46f38de8e9d6f5301e41 P eaa6f3dc13d643b9acfd8df1263a456d [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b1daf23b3538498bb795a60d627b6ac0 in current term 1: Already voted for candidate eaa6f3dc13d643b9acfd8df1263a456d in this term.
I20260709 13:09:26.770503 30766 raft_consensus.cc:515] T 035d977bcb604138a0c5e70d38013012 P eaa6f3dc13d643b9acfd8df1263a456d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1daf23b3538498bb795a60d627b6ac0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 36109 } } peers { permanent_uuid: "d7def43826924f03b8858383f0dc69f4" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 40053 } } peers { permanent_uuid: "eaa6f3dc13d643b9acfd8df1263a456d" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 41395 } }
I20260709 13:09:26.772892 30475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ce7118b2aff46f38de8e9d6f5301e41" candidate_uuid: "eaa6f3dc13d643b9acfd8df1263a456d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1daf23b3538498bb795a60d627b6ac0"
I20260709 13:09:26.773554 30475 raft_consensus.cc:3060] T 7ce7118b2aff46f38de8e9d6f5301e41 P b1daf23b3538498bb795a60d627b6ac0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:26.774056 30476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "035d977bcb604138a0c5e70d38013012" candidate_uuid: "eaa6f3dc13d643b9acfd8df1263a456d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1daf23b3538498bb795a60d627b6ac0"
I20260709 13:09:26.774893 30476 raft_consensus.cc:2393] T 035d977bcb604138a0c5e70d38013012 P b1daf23b3538498bb795a60d627b6ac0 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate eaa6f3dc13d643b9acfd8df1263a456d in current term 1: Already voted for candidate b1daf23b3538498bb795a60d627b6ac0 in this term.
I20260709 13:09:26.774892 30793 raft_consensus.cc:515] T c9a02595d5e340be8cf9484066cf9cc7 P b1daf23b3538498bb795a60d627b6ac0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1daf23b3538498bb795a60d627b6ac0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 36109 } } peers { permanent_uuid: "d7def43826924f03b8858383f0dc69f4" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 40053 } } peers { permanent_uuid: "eaa6f3dc13d643b9acfd8df1263a456d" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 41395 } }
W20260709 13:09:26.779026 30439 leader_election.cc:343] T 7ce7118b2aff46f38de8e9d6f5301e41 P b1daf23b3538498bb795a60d627b6ac0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d7def43826924f03b8858383f0dc69f4 (127.17.223.2:40053): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:26.779682 30794 raft_consensus.cc:493] T f657c3787a9d497f91e05a50c36622f2 P eaa6f3dc13d643b9acfd8df1263a456d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:26.780649 30548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "035d977bcb604138a0c5e70d38013012" candidate_uuid: "b1daf23b3538498bb795a60d627b6ac0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d7def43826924f03b8858383f0dc69f4"
I20260709 13:09:26.780368 30794 raft_consensus.cc:515] T f657c3787a9d497f91e05a50c36622f2 P eaa6f3dc13d643b9acfd8df1263a456d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1daf23b3538498bb795a60d627b6ac0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 36109 } } peers { permanent_uuid: "d7def43826924f03b8858383f0dc69f4" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 40053 } } peers { permanent_uuid: "eaa6f3dc13d643b9acfd8df1263a456d" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 41395 } }
I20260709 13:09:26.782433 30475 raft_consensus.cc:2468] T 7ce7118b2aff46f38de8e9d6f5301e41 P b1daf23b3538498bb795a60d627b6ac0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eaa6f3dc13d643b9acfd8df1263a456d in term 1.
I20260709 13:09:26.783814 30748 leader_election.cc:290] T 7ce7118b2aff46f38de8e9d6f5301e41 P eaa6f3dc13d643b9acfd8df1263a456d [CANDIDATE]: Term 1 election: Requested vote from peers b1daf23b3538498bb795a60d627b6ac0 (127.17.223.1:36109), d7def43826924f03b8858383f0dc69f4 (127.17.223.2:40053)
I20260709 13:09:26.784430 30588 leader_election.cc:304] T 7ce7118b2aff46f38de8e9d6f5301e41 P eaa6f3dc13d643b9acfd8df1263a456d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b1daf23b3538498bb795a60d627b6ac0, eaa6f3dc13d643b9acfd8df1263a456d; no voters: 
I20260709 13:09:26.784657 30794 leader_election.cc:290] T f657c3787a9d497f91e05a50c36622f2 P eaa6f3dc13d643b9acfd8df1263a456d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b1daf23b3538498bb795a60d627b6ac0 (127.17.223.1:36109), d7def43826924f03b8858383f0dc69f4 (127.17.223.2:40053)
I20260709 13:09:26.784740 30476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9a02595d5e340be8cf9484066cf9cc7" candidate_uuid: "eaa6f3dc13d643b9acfd8df1263a456d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1daf23b3538498bb795a60d627b6ac0"
I20260709 13:09:26.785246 30794 raft_consensus.cc:2804] T 7ce7118b2aff46f38de8e9d6f5301e41 P eaa6f3dc13d643b9acfd8df1263a456d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:26.785763 30794 raft_consensus.cc:697] T 7ce7118b2aff46f38de8e9d6f5301e41 P eaa6f3dc13d643b9acfd8df1263a456d [term 1 LEADER]: Becoming Leader. State: Replica: eaa6f3dc13d643b9acfd8df1263a456d, State: Running, Role: LEADER
I20260709 13:09:26.785876 30476 raft_consensus.cc:2393] T c9a02595d5e340be8cf9484066cf9cc7 P b1daf23b3538498bb795a60d627b6ac0 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate eaa6f3dc13d643b9acfd8df1263a456d in current term 1: Already voted for candidate b1daf23b3538498bb795a60d627b6ac0 in this term.
I20260709 13:09:26.786607 30794 consensus_queue.cc:237] T 7ce7118b2aff46f38de8e9d6f5301e41 P eaa6f3dc13d643b9acfd8df1263a456d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1daf23b3538498bb795a60d627b6ac0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 36109 } } peers { permanent_uuid: "d7def43826924f03b8858383f0dc69f4" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 40053 } } peers { permanent_uuid: "eaa6f3dc13d643b9acfd8df1263a456d" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 41395 } }
I20260709 13:09:26.789057 30623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "035d977bcb604138a0c5e70d38013012" candidate_uuid: "b1daf23b3538498bb795a60d627b6ac0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eaa6f3dc13d643b9acfd8df1263a456d"
I20260709 13:09:26.789917 30623 raft_consensus.cc:2393] T 035d977bcb604138a0c5e70d38013012 P eaa6f3dc13d643b9acfd8df1263a456d [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate b1daf23b3538498bb795a60d627b6ac0 in current term 1: Already voted for candidate eaa6f3dc13d643b9acfd8df1263a456d in this term.
I20260709 13:09:26.791355 30548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ce7118b2aff46f38de8e9d6f5301e41" candidate_uuid: "eaa6f3dc13d643b9acfd8df1263a456d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d7def43826924f03b8858383f0dc69f4"
I20260709 13:09:26.778384 30793 leader_election.cc:290] T c9a02595d5e340be8cf9484066cf9cc7 P b1daf23b3538498bb795a60d627b6ac0 [CANDIDATE]: Term 1 election: Requested vote from peers d7def43826924f03b8858383f0dc69f4 (127.17.223.2:40053), eaa6f3dc13d643b9acfd8df1263a456d (127.17.223.3:41395)
I20260709 13:09:26.791774 30549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f657c3787a9d497f91e05a50c36622f2" candidate_uuid: "eaa6f3dc13d643b9acfd8df1263a456d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d7def43826924f03b8858383f0dc69f4" is_pre_election: true
I20260709 13:09:26.792451 30549 raft_consensus.cc:2468] T f657c3787a9d497f91e05a50c36622f2 P d7def43826924f03b8858383f0dc69f4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eaa6f3dc13d643b9acfd8df1263a456d in term 0.
I20260709 13:09:26.792891 30763 ts_tablet_manager.cc:1434] T f657c3787a9d497f91e05a50c36622f2 P eaa6f3dc13d643b9acfd8df1263a456d: Time spent starting tablet: real 0.043s	user 0.004s	sys 0.004s
W20260709 13:09:26.792802 30588 leader_election.cc:343] T 7ce7118b2aff46f38de8e9d6f5301e41 P eaa6f3dc13d643b9acfd8df1263a456d [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer d7def43826924f03b8858383f0dc69f4 (127.17.223.2:40053): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:26.793926 30623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9a02595d5e340be8cf9484066cf9cc7" candidate_uuid: "b1daf23b3538498bb795a60d627b6ac0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eaa6f3dc13d643b9acfd8df1263a456d"
I20260709 13:09:26.794762 30623 raft_consensus.cc:2393] T c9a02595d5e340be8cf9484066cf9cc7 P eaa6f3dc13d643b9acfd8df1263a456d [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate b1daf23b3538498bb795a60d627b6ac0 in current term 1: Already voted for candidate eaa6f3dc13d643b9acfd8df1263a456d in this term.
I20260709 13:09:26.794867 30475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f657c3787a9d497f91e05a50c36622f2" candidate_uuid: "eaa6f3dc13d643b9acfd8df1263a456d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1daf23b3538498bb795a60d627b6ac0" is_pre_election: true
I20260709 13:09:26.795526 30475 raft_consensus.cc:2468] T f657c3787a9d497f91e05a50c36622f2 P b1daf23b3538498bb795a60d627b6ac0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eaa6f3dc13d643b9acfd8df1263a456d in term 0.
I20260709 13:09:26.796067 30549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9a02595d5e340be8cf9484066cf9cc7" candidate_uuid: "b1daf23b3538498bb795a60d627b6ac0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d7def43826924f03b8858383f0dc69f4"
I20260709 13:09:26.796720 30549 raft_consensus.cc:3060] T c9a02595d5e340be8cf9484066cf9cc7 P d7def43826924f03b8858383f0dc69f4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:26.796924 30766 leader_election.cc:290] T 035d977bcb604138a0c5e70d38013012 P eaa6f3dc13d643b9acfd8df1263a456d [CANDIDATE]: Term 1 election: Requested vote from peers b1daf23b3538498bb795a60d627b6ac0 (127.17.223.1:36109), d7def43826924f03b8858383f0dc69f4 (127.17.223.2:40053)
I20260709 13:09:26.797755 30795 leader_election.cc:290] T c9a02595d5e340be8cf9484066cf9cc7 P eaa6f3dc13d643b9acfd8df1263a456d [CANDIDATE]: Term 1 election: Requested vote from peers b1daf23b3538498bb795a60d627b6ac0 (127.17.223.1:36109), d7def43826924f03b8858383f0dc69f4 (127.17.223.2:40053)
I20260709 13:09:26.798168 30763 tablet_bootstrap.cc:492] T 93f7bd85158a4f47aabfeb6b20b664e7 P eaa6f3dc13d643b9acfd8df1263a456d: Bootstrap starting.
I20260709 13:09:26.799247 30588 leader_election.cc:304] T f657c3787a9d497f91e05a50c36622f2 P eaa6f3dc13d643b9acfd8df1263a456d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b1daf23b3538498bb795a60d627b6ac0, eaa6f3dc13d643b9acfd8df1263a456d; no voters: 
I20260709 13:09:26.800493 30795 raft_consensus.cc:2804] T f657c3787a9d497f91e05a50c36622f2 P eaa6f3dc13d643b9acfd8df1263a456d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:26.800845 30795 raft_consensus.cc:493] T f657c3787a9d497f91e05a50c36622f2 P eaa6f3dc13d643b9acfd8df1263a456d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:26.801187 30551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "035d977bcb604138a0c5e70d38013012" candidate_uuid: "eaa6f3dc13d643b9acfd8df1263a456d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d7def43826924f03b8858383f0dc69f4"
I20260709 13:09:26.801952 30548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9a02595d5e340be8cf9484066cf9cc7" candidate_uuid: "eaa6f3dc13d643b9acfd8df1263a456d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d7def43826924f03b8858383f0dc69f4"
W20260709 13:09:26.803763 30588 leader_election.cc:343] T 035d977bcb604138a0c5e70d38013012 P eaa6f3dc13d643b9acfd8df1263a456d [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer d7def43826924f03b8858383f0dc69f4 (127.17.223.2:40053): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:26.801170 30795 raft_consensus.cc:3060] T f657c3787a9d497f91e05a50c36622f2 P eaa6f3dc13d643b9acfd8df1263a456d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:26.804260 30588 leader_election.cc:304] T 035d977bcb604138a0c5e70d38013012 P eaa6f3dc13d643b9acfd8df1263a456d [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eaa6f3dc13d643b9acfd8df1263a456d; no voters: b1daf23b3538498bb795a60d627b6ac0, d7def43826924f03b8858383f0dc69f4
I20260709 13:09:26.806824 30549 raft_consensus.cc:2468] T c9a02595d5e340be8cf9484066cf9cc7 P d7def43826924f03b8858383f0dc69f4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b1daf23b3538498bb795a60d627b6ac0 in term 1.
I20260709 13:09:26.807603 30766 raft_consensus.cc:2749] T 035d977bcb604138a0c5e70d38013012 P eaa6f3dc13d643b9acfd8df1263a456d [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:09:26.808302 30588 leader_election.cc:304] T c9a02595d5e340be8cf9484066cf9cc7 P eaa6f3dc13d643b9acfd8df1263a456d [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eaa6f3dc13d643b9acfd8df1263a456d; no voters: b1daf23b3538498bb795a60d627b6ac0, d7def43826924f03b8858383f0dc69f4
I20260709 13:09:26.807909 30793 raft_consensus.cc:493] T 93f7bd85158a4f47aabfeb6b20b664e7 P b1daf23b3538498bb795a60d627b6ac0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:26.809341 30793 raft_consensus.cc:515] T 93f7bd85158a4f47aabfeb6b20b664e7 P b1daf23b3538498bb795a60d627b6ac0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1daf23b3538498bb795a60d627b6ac0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 36109 } } peers { permanent_uuid: "d7def43826924f03b8858383f0dc69f4" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 40053 } } peers { permanent_uuid: "eaa6f3dc13d643b9acfd8df1263a456d" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 41395 } }
I20260709 13:09:26.810490 30761 tablet_bootstrap.cc:492] T 7ce7118b2aff46f38de8e9d6f5301e41 P d7def43826924f03b8858383f0dc69f4: No bootstrap required, opened a new log
I20260709 13:09:26.811118 30761 ts_tablet_manager.cc:1403] T 7ce7118b2aff46f38de8e9d6f5301e41 P d7def43826924f03b8858383f0dc69f4: Time spent bootstrapping tablet: real 0.110s	user 0.047s	sys 0.038s
I20260709 13:09:26.809607 30766 raft_consensus.cc:2749] T c9a02595d5e340be8cf9484066cf9cc7 P eaa6f3dc13d643b9acfd8df1263a456d [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:09:26.813120 30763 tablet_bootstrap.cc:654] T 93f7bd85158a4f47aabfeb6b20b664e7 P eaa6f3dc13d643b9acfd8df1263a456d: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:26.814002 30761 raft_consensus.cc:359] T 7ce7118b2aff46f38de8e9d6f5301e41 P d7def43826924f03b8858383f0dc69f4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1daf23b3538498bb795a60d627b6ac0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 36109 } } peers { permanent_uuid: "d7def43826924f03b8858383f0dc69f4" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 40053 } } peers { permanent_uuid: "eaa6f3dc13d643b9acfd8df1263a456d" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 41395 } }
I20260709 13:09:26.814793 30761 raft_consensus.cc:385] T 7ce7118b2aff46f38de8e9d6f5301e41 P d7def43826924f03b8858383f0dc69f4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:26.815068 30761 raft_consensus.cc:740] T 7ce7118b2aff46f38de8e9d6f5301e41 P d7def43826924f03b8858383f0dc69f4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d7def43826924f03b8858383f0dc69f4, State: Initialized, Role: FOLLOWER
I20260709 13:09:26.815723 30761 consensus_queue.cc:260] T 7ce7118b2aff46f38de8e9d6f5301e41 P d7def43826924f03b8858383f0dc69f4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1daf23b3538498bb795a60d627b6ac0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 36109 } } peers { permanent_uuid: "d7def43826924f03b8858383f0dc69f4" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 40053 } } peers { permanent_uuid: "eaa6f3dc13d643b9acfd8df1263a456d" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 41395 } }
I20260709 13:09:26.818429 30761 ts_tablet_manager.cc:1434] T 7ce7118b2aff46f38de8e9d6f5301e41 P d7def43826924f03b8858383f0dc69f4: Time spent starting tablet: real 0.007s	user 0.001s	sys 0.003s
I20260709 13:09:26.819726 30761 tablet_bootstrap.cc:492] T 035d977bcb604138a0c5e70d38013012 P d7def43826924f03b8858383f0dc69f4: Bootstrap starting.
I20260709 13:09:26.823056 30793 leader_election.cc:290] T 93f7bd85158a4f47aabfeb6b20b664e7 P b1daf23b3538498bb795a60d627b6ac0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d7def43826924f03b8858383f0dc69f4 (127.17.223.2:40053), eaa6f3dc13d643b9acfd8df1263a456d (127.17.223.3:41395)
I20260709 13:09:26.824787 30475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b90351987d7741299d85cc7599d58d07" candidate_uuid: "d7def43826924f03b8858383f0dc69f4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1daf23b3538498bb795a60d627b6ac0" is_pre_election: true
I20260709 13:09:26.825672 30475 raft_consensus.cc:2393] T b90351987d7741299d85cc7599d58d07 P b1daf23b3538498bb795a60d627b6ac0 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d7def43826924f03b8858383f0dc69f4 in current term 1: Already voted for candidate eaa6f3dc13d643b9acfd8df1263a456d in this term.
I20260709 13:09:26.825704 30439 leader_election.cc:304] T 7ce7118b2aff46f38de8e9d6f5301e41 P b1daf23b3538498bb795a60d627b6ac0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1daf23b3538498bb795a60d627b6ac0; no voters: d7def43826924f03b8858383f0dc69f4, eaa6f3dc13d643b9acfd8df1263a456d
I20260709 13:09:26.827005 30761 tablet_bootstrap.cc:654] T 035d977bcb604138a0c5e70d38013012 P d7def43826924f03b8858383f0dc69f4: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:26.827078 30670 raft_consensus.cc:2749] T 7ce7118b2aff46f38de8e9d6f5301e41 P b1daf23b3538498bb795a60d627b6ac0 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:26.830194 30623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93f7bd85158a4f47aabfeb6b20b664e7" candidate_uuid: "b1daf23b3538498bb795a60d627b6ac0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eaa6f3dc13d643b9acfd8df1263a456d" is_pre_election: true
I20260709 13:09:26.831025 30549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93f7bd85158a4f47aabfeb6b20b664e7" candidate_uuid: "b1daf23b3538498bb795a60d627b6ac0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d7def43826924f03b8858383f0dc69f4" is_pre_election: true
I20260709 13:09:26.831744 30549 raft_consensus.cc:2468] T 93f7bd85158a4f47aabfeb6b20b664e7 P d7def43826924f03b8858383f0dc69f4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1daf23b3538498bb795a60d627b6ac0 in term 0.
I20260709 13:09:26.831812 30514 leader_election.cc:304] T b90351987d7741299d85cc7599d58d07 P d7def43826924f03b8858383f0dc69f4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d7def43826924f03b8858383f0dc69f4; no voters: b1daf23b3538498bb795a60d627b6ac0, eaa6f3dc13d643b9acfd8df1263a456d
I20260709 13:09:26.831924 30795 raft_consensus.cc:515] T f657c3787a9d497f91e05a50c36622f2 P eaa6f3dc13d643b9acfd8df1263a456d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1daf23b3538498bb795a60d627b6ac0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 36109 } } peers { permanent_uuid: "d7def43826924f03b8858383f0dc69f4" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 40053 } } peers { permanent_uuid: "eaa6f3dc13d643b9acfd8df1263a456d" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 41395 } }
I20260709 13:09:26.833101 30784 raft_consensus.cc:3060] T b90351987d7741299d85cc7599d58d07 P d7def43826924f03b8858383f0dc69f4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:26.835532 30549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f657c3787a9d497f91e05a50c36622f2" candidate_uuid: "eaa6f3dc13d643b9acfd8df1263a456d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d7def43826924f03b8858383f0dc69f4"
I20260709 13:09:26.836128 30549 raft_consensus.cc:3060] T f657c3787a9d497f91e05a50c36622f2 P d7def43826924f03b8858383f0dc69f4 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:09:26.837692 30439 leader_election.cc:343] T 035d977bcb604138a0c5e70d38013012 P b1daf23b3538498bb795a60d627b6ac0 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer d7def43826924f03b8858383f0dc69f4 (127.17.223.2:40053): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:26.838405 30439 leader_election.cc:304] T 035d977bcb604138a0c5e70d38013012 P b1daf23b3538498bb795a60d627b6ac0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1daf23b3538498bb795a60d627b6ac0; no voters: d7def43826924f03b8858383f0dc69f4, eaa6f3dc13d643b9acfd8df1263a456d
I20260709 13:09:26.839180 30793 raft_consensus.cc:2749] T 035d977bcb604138a0c5e70d38013012 P b1daf23b3538498bb795a60d627b6ac0 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:09:26.839428 30475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f657c3787a9d497f91e05a50c36622f2" candidate_uuid: "eaa6f3dc13d643b9acfd8df1263a456d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1daf23b3538498bb795a60d627b6ac0"
I20260709 13:09:26.840081 30475 raft_consensus.cc:3060] T f657c3787a9d497f91e05a50c36622f2 P b1daf23b3538498bb795a60d627b6ac0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:26.840931 30784 raft_consensus.cc:2749] T b90351987d7741299d85cc7599d58d07 P d7def43826924f03b8858383f0dc69f4 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:26.842312 30439 leader_election.cc:304] T c9a02595d5e340be8cf9484066cf9cc7 P b1daf23b3538498bb795a60d627b6ac0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b1daf23b3538498bb795a60d627b6ac0, d7def43826924f03b8858383f0dc69f4; no voters: eaa6f3dc13d643b9acfd8df1263a456d
I20260709 13:09:26.842768 30795 leader_election.cc:290] T f657c3787a9d497f91e05a50c36622f2 P eaa6f3dc13d643b9acfd8df1263a456d [CANDIDATE]: Term 1 election: Requested vote from peers b1daf23b3538498bb795a60d627b6ac0 (127.17.223.1:36109), d7def43826924f03b8858383f0dc69f4 (127.17.223.2:40053)
I20260709 13:09:26.843066 30670 raft_consensus.cc:2804] T c9a02595d5e340be8cf9484066cf9cc7 P b1daf23b3538498bb795a60d627b6ac0 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:26.843609 30670 raft_consensus.cc:697] T c9a02595d5e340be8cf9484066cf9cc7 P b1daf23b3538498bb795a60d627b6ac0 [term 1 LEADER]: Becoming Leader. State: Replica: b1daf23b3538498bb795a60d627b6ac0, State: Running, Role: LEADER
I20260709 13:09:26.844291 30549 raft_consensus.cc:2468] T f657c3787a9d497f91e05a50c36622f2 P d7def43826924f03b8858383f0dc69f4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eaa6f3dc13d643b9acfd8df1263a456d in term 1.
I20260709 13:09:26.844437 30670 consensus_queue.cc:237] T c9a02595d5e340be8cf9484066cf9cc7 P b1daf23b3538498bb795a60d627b6ac0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1daf23b3538498bb795a60d627b6ac0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 36109 } } peers { permanent_uuid: "d7def43826924f03b8858383f0dc69f4" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 40053 } } peers { permanent_uuid: "eaa6f3dc13d643b9acfd8df1263a456d" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 41395 } }
I20260709 13:09:26.845506 30763 tablet_bootstrap.cc:492] T 93f7bd85158a4f47aabfeb6b20b664e7 P eaa6f3dc13d643b9acfd8df1263a456d: No bootstrap required, opened a new log
I20260709 13:09:26.846009 30763 ts_tablet_manager.cc:1403] T 93f7bd85158a4f47aabfeb6b20b664e7 P eaa6f3dc13d643b9acfd8df1263a456d: Time spent bootstrapping tablet: real 0.048s	user 0.014s	sys 0.003s
I20260709 13:09:26.846884 30588 leader_election.cc:304] T f657c3787a9d497f91e05a50c36622f2 P eaa6f3dc13d643b9acfd8df1263a456d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d7def43826924f03b8858383f0dc69f4, eaa6f3dc13d643b9acfd8df1263a456d; no voters: 
I20260709 13:09:26.848181 30475 raft_consensus.cc:2468] T f657c3787a9d497f91e05a50c36622f2 P b1daf23b3538498bb795a60d627b6ac0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eaa6f3dc13d643b9acfd8df1263a456d in term 1.
I20260709 13:09:26.848485 30761 tablet_bootstrap.cc:492] T 035d977bcb604138a0c5e70d38013012 P d7def43826924f03b8858383f0dc69f4: No bootstrap required, opened a new log
I20260709 13:09:26.849205 30761 ts_tablet_manager.cc:1403] T 035d977bcb604138a0c5e70d38013012 P d7def43826924f03b8858383f0dc69f4: Time spent bootstrapping tablet: real 0.030s	user 0.012s	sys 0.001s
I20260709 13:09:26.848318 30795 raft_consensus.cc:2804] T f657c3787a9d497f91e05a50c36622f2 P eaa6f3dc13d643b9acfd8df1263a456d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:26.851065 30795 raft_consensus.cc:697] T f657c3787a9d497f91e05a50c36622f2 P eaa6f3dc13d643b9acfd8df1263a456d [term 1 LEADER]: Becoming Leader. State: Replica: eaa6f3dc13d643b9acfd8df1263a456d, State: Running, Role: LEADER
I20260709 13:09:26.852195 30761 raft_consensus.cc:359] T 035d977bcb604138a0c5e70d38013012 P d7def43826924f03b8858383f0dc69f4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1daf23b3538498bb795a60d627b6ac0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 36109 } } peers { permanent_uuid: "d7def43826924f03b8858383f0dc69f4" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 40053 } } peers { permanent_uuid: "eaa6f3dc13d643b9acfd8df1263a456d" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 41395 } }
I20260709 13:09:26.852082 30795 consensus_queue.cc:237] T f657c3787a9d497f91e05a50c36622f2 P eaa6f3dc13d643b9acfd8df1263a456d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1daf23b3538498bb795a60d627b6ac0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 36109 } } peers { permanent_uuid: "d7def43826924f03b8858383f0dc69f4" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 40053 } } peers { permanent_uuid: "eaa6f3dc13d643b9acfd8df1263a456d" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 41395 } }
I20260709 13:09:26.852967 30761 raft_consensus.cc:385] T 035d977bcb604138a0c5e70d38013012 P d7def43826924f03b8858383f0dc69f4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:26.853322 30761 raft_consensus.cc:740] T 035d977bcb604138a0c5e70d38013012 P d7def43826924f03b8858383f0dc69f4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d7def43826924f03b8858383f0dc69f4, State: Initialized, Role: FOLLOWER
I20260709 13:09:26.854089 30761 consensus_queue.cc:260] T 035d977bcb604138a0c5e70d38013012 P d7def43826924f03b8858383f0dc69f4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1daf23b3538498bb795a60d627b6ac0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 36109 } } peers { permanent_uuid: "d7def43826924f03b8858383f0dc69f4" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 40053 } } peers { permanent_uuid: "eaa6f3dc13d643b9acfd8df1263a456d" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 41395 } }
I20260709 13:09:26.852594 30763 raft_consensus.cc:359] T 93f7bd85158a4f47aabfeb6b20b664e7 P eaa6f3dc13d643b9acfd8df1263a456d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1daf23b3538498bb795a60d627b6ac0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 36109 } } peers { permanent_uuid: "d7def43826924f03b8858383f0dc69f4" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 40053 } } peers { permanent_uuid: "eaa6f3dc13d643b9acfd8df1263a456d" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 41395 } }
I20260709 13:09:26.855893 30763 raft_consensus.cc:385] T 93f7bd85158a4f47aabfeb6b20b664e7 P eaa6f3dc13d643b9acfd8df1263a456d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:26.856196 30763 raft_consensus.cc:740] T 93f7bd85158a4f47aabfeb6b20b664e7 P eaa6f3dc13d643b9acfd8df1263a456d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eaa6f3dc13d643b9acfd8df1263a456d, State: Initialized, Role: FOLLOWER
I20260709 13:09:26.856716 30761 ts_tablet_manager.cc:1434] T 035d977bcb604138a0c5e70d38013012 P d7def43826924f03b8858383f0dc69f4: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:09:26.857075 30439 leader_election.cc:304] T 93f7bd85158a4f47aabfeb6b20b664e7 P b1daf23b3538498bb795a60d627b6ac0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b1daf23b3538498bb795a60d627b6ac0, d7def43826924f03b8858383f0dc69f4; no voters: 
I20260709 13:09:26.856973 30763 consensus_queue.cc:260] T 93f7bd85158a4f47aabfeb6b20b664e7 P eaa6f3dc13d643b9acfd8df1263a456d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1daf23b3538498bb795a60d627b6ac0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 36109 } } peers { permanent_uuid: "d7def43826924f03b8858383f0dc69f4" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 40053 } } peers { permanent_uuid: "eaa6f3dc13d643b9acfd8df1263a456d" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 41395 } }
I20260709 13:09:26.857981 30793 raft_consensus.cc:2804] T 93f7bd85158a4f47aabfeb6b20b664e7 P b1daf23b3538498bb795a60d627b6ac0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:26.858424 30793 raft_consensus.cc:493] T 93f7bd85158a4f47aabfeb6b20b664e7 P b1daf23b3538498bb795a60d627b6ac0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:26.857798 30370 catalog_manager.cc:5697] T 7ce7118b2aff46f38de8e9d6f5301e41 P eaa6f3dc13d643b9acfd8df1263a456d reported cstate change: term changed from 0 to 1, leader changed from <none> to eaa6f3dc13d643b9acfd8df1263a456d (127.17.223.3). New cstate: current_term: 1 leader_uuid: "eaa6f3dc13d643b9acfd8df1263a456d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1daf23b3538498bb795a60d627b6ac0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 36109 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d7def43826924f03b8858383f0dc69f4" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 40053 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "eaa6f3dc13d643b9acfd8df1263a456d" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 41395 } health_report { overall_health: HEALTHY } } }
I20260709 13:09:26.858734 30793 raft_consensus.cc:3060] T 93f7bd85158a4f47aabfeb6b20b664e7 P b1daf23b3538498bb795a60d627b6ac0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:26.859297 30763 ts_tablet_manager.cc:1434] T 93f7bd85158a4f47aabfeb6b20b664e7 P eaa6f3dc13d643b9acfd8df1263a456d: Time spent starting tablet: real 0.013s	user 0.003s	sys 0.005s
I20260709 13:09:26.866274 30374 catalog_manager.cc:5697] T c9a02595d5e340be8cf9484066cf9cc7 P b1daf23b3538498bb795a60d627b6ac0 reported cstate change: term changed from 0 to 1, leader changed from <none> to b1daf23b3538498bb795a60d627b6ac0 (127.17.223.1). New cstate: current_term: 1 leader_uuid: "b1daf23b3538498bb795a60d627b6ac0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1daf23b3538498bb795a60d627b6ac0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 36109 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d7def43826924f03b8858383f0dc69f4" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 40053 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "eaa6f3dc13d643b9acfd8df1263a456d" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 41395 } health_report { overall_health: UNKNOWN } } }
W20260709 13:09:26.867997 30439 leader_election.cc:343] T 93f7bd85158a4f47aabfeb6b20b664e7 P b1daf23b3538498bb795a60d627b6ac0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer eaa6f3dc13d643b9acfd8df1263a456d (127.17.223.3:41395): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:26.870222 30793 raft_consensus.cc:515] T 93f7bd85158a4f47aabfeb6b20b664e7 P b1daf23b3538498bb795a60d627b6ac0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1daf23b3538498bb795a60d627b6ac0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 36109 } } peers { permanent_uuid: "d7def43826924f03b8858383f0dc69f4" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 40053 } } peers { permanent_uuid: "eaa6f3dc13d643b9acfd8df1263a456d" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 41395 } }
I20260709 13:09:26.872401 30793 leader_election.cc:290] T 93f7bd85158a4f47aabfeb6b20b664e7 P b1daf23b3538498bb795a60d627b6ac0 [CANDIDATE]: Term 1 election: Requested vote from peers d7def43826924f03b8858383f0dc69f4 (127.17.223.2:40053), eaa6f3dc13d643b9acfd8df1263a456d (127.17.223.3:41395)
I20260709 13:09:26.873847 30549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93f7bd85158a4f47aabfeb6b20b664e7" candidate_uuid: "b1daf23b3538498bb795a60d627b6ac0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d7def43826924f03b8858383f0dc69f4"
I20260709 13:09:26.874477 30549 raft_consensus.cc:3060] T 93f7bd85158a4f47aabfeb6b20b664e7 P d7def43826924f03b8858383f0dc69f4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:26.874533 30623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93f7bd85158a4f47aabfeb6b20b664e7" candidate_uuid: "b1daf23b3538498bb795a60d627b6ac0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eaa6f3dc13d643b9acfd8df1263a456d"
I20260709 13:09:26.875277 30623 raft_consensus.cc:3060] T 93f7bd85158a4f47aabfeb6b20b664e7 P eaa6f3dc13d643b9acfd8df1263a456d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:26.880236 30372 catalog_manager.cc:5697] T f657c3787a9d497f91e05a50c36622f2 P eaa6f3dc13d643b9acfd8df1263a456d reported cstate change: term changed from 0 to 1, leader changed from <none> to eaa6f3dc13d643b9acfd8df1263a456d (127.17.223.3). New cstate: current_term: 1 leader_uuid: "eaa6f3dc13d643b9acfd8df1263a456d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1daf23b3538498bb795a60d627b6ac0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 36109 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d7def43826924f03b8858383f0dc69f4" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 40053 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "eaa6f3dc13d643b9acfd8df1263a456d" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 41395 } health_report { overall_health: HEALTHY } } }
I20260709 13:09:26.882114 30549 raft_consensus.cc:2468] T 93f7bd85158a4f47aabfeb6b20b664e7 P d7def43826924f03b8858383f0dc69f4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b1daf23b3538498bb795a60d627b6ac0 in term 1.
I20260709 13:09:26.883026 30623 raft_consensus.cc:2468] T 93f7bd85158a4f47aabfeb6b20b664e7 P eaa6f3dc13d643b9acfd8df1263a456d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b1daf23b3538498bb795a60d627b6ac0 in term 1.
I20260709 13:09:26.883347 30439 leader_election.cc:304] T 93f7bd85158a4f47aabfeb6b20b664e7 P b1daf23b3538498bb795a60d627b6ac0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b1daf23b3538498bb795a60d627b6ac0, d7def43826924f03b8858383f0dc69f4; no voters: 
I20260709 13:09:26.884241 30793 raft_consensus.cc:2804] T 93f7bd85158a4f47aabfeb6b20b664e7 P b1daf23b3538498bb795a60d627b6ac0 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:26.884711 30793 raft_consensus.cc:697] T 93f7bd85158a4f47aabfeb6b20b664e7 P b1daf23b3538498bb795a60d627b6ac0 [term 1 LEADER]: Becoming Leader. State: Replica: b1daf23b3538498bb795a60d627b6ac0, State: Running, Role: LEADER
I20260709 13:09:26.885459 30793 consensus_queue.cc:237] T 93f7bd85158a4f47aabfeb6b20b664e7 P b1daf23b3538498bb795a60d627b6ac0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1daf23b3538498bb795a60d627b6ac0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 36109 } } peers { permanent_uuid: "d7def43826924f03b8858383f0dc69f4" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 40053 } } peers { permanent_uuid: "eaa6f3dc13d643b9acfd8df1263a456d" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 41395 } }
I20260709 13:09:26.890827 30764 raft_consensus.cc:493] T 035d977bcb604138a0c5e70d38013012 P d7def43826924f03b8858383f0dc69f4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:26.891486 30764 raft_consensus.cc:515] T 035d977bcb604138a0c5e70d38013012 P d7def43826924f03b8858383f0dc69f4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1daf23b3538498bb795a60d627b6ac0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 36109 } } peers { permanent_uuid: "d7def43826924f03b8858383f0dc69f4" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 40053 } } peers { permanent_uuid: "eaa6f3dc13d643b9acfd8df1263a456d" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 41395 } }
I20260709 13:09:26.893500 30764 leader_election.cc:290] T 035d977bcb604138a0c5e70d38013012 P d7def43826924f03b8858383f0dc69f4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b1daf23b3538498bb795a60d627b6ac0 (127.17.223.1:36109), eaa6f3dc13d643b9acfd8df1263a456d (127.17.223.3:41395)
I20260709 13:09:26.894837 30764 consensus_queue.cc:1048] T 052373021b584e2e84d1d9dee352aebd P d7def43826924f03b8858383f0dc69f4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1daf23b3538498bb795a60d627b6ac0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 36109 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:26.895165 30475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "035d977bcb604138a0c5e70d38013012" candidate_uuid: "d7def43826924f03b8858383f0dc69f4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1daf23b3538498bb795a60d627b6ac0" is_pre_election: true
I20260709 13:09:26.894553 30623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "035d977bcb604138a0c5e70d38013012" candidate_uuid: "d7def43826924f03b8858383f0dc69f4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eaa6f3dc13d643b9acfd8df1263a456d" is_pre_election: true
I20260709 13:09:26.895876 30475 raft_consensus.cc:2393] T 035d977bcb604138a0c5e70d38013012 P b1daf23b3538498bb795a60d627b6ac0 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d7def43826924f03b8858383f0dc69f4 in current term 1: Already voted for candidate b1daf23b3538498bb795a60d627b6ac0 in this term.
I20260709 13:09:26.896384 30623 raft_consensus.cc:2393] T 035d977bcb604138a0c5e70d38013012 P eaa6f3dc13d643b9acfd8df1263a456d [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d7def43826924f03b8858383f0dc69f4 in current term 1: Already voted for candidate eaa6f3dc13d643b9acfd8df1263a456d in this term.
I20260709 13:09:26.896054 30372 catalog_manager.cc:5697] T 93f7bd85158a4f47aabfeb6b20b664e7 P b1daf23b3538498bb795a60d627b6ac0 reported cstate change: term changed from 0 to 1, leader changed from <none> to b1daf23b3538498bb795a60d627b6ac0 (127.17.223.1). New cstate: current_term: 1 leader_uuid: "b1daf23b3538498bb795a60d627b6ac0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1daf23b3538498bb795a60d627b6ac0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 36109 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d7def43826924f03b8858383f0dc69f4" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 40053 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "eaa6f3dc13d643b9acfd8df1263a456d" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 41395 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:26.897507 30514 leader_election.cc:304] T 035d977bcb604138a0c5e70d38013012 P d7def43826924f03b8858383f0dc69f4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d7def43826924f03b8858383f0dc69f4; no voters: b1daf23b3538498bb795a60d627b6ac0, eaa6f3dc13d643b9acfd8df1263a456d
I20260709 13:09:26.898218 30764 raft_consensus.cc:3060] T 035d977bcb604138a0c5e70d38013012 P d7def43826924f03b8858383f0dc69f4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:26.905786 30764 raft_consensus.cc:2749] T 035d977bcb604138a0c5e70d38013012 P d7def43826924f03b8858383f0dc69f4 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:26.912349 30784 consensus_queue.cc:1048] T 052373021b584e2e84d1d9dee352aebd P d7def43826924f03b8858383f0dc69f4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eaa6f3dc13d643b9acfd8df1263a456d" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 41395 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:26.933318 30784 consensus_queue.cc:1048] T 905b37e519a4428995623c0c8357fc0f P d7def43826924f03b8858383f0dc69f4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1daf23b3538498bb795a60d627b6ac0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 36109 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:26.945276 30764 consensus_queue.cc:1048] T 905b37e519a4428995623c0c8357fc0f P d7def43826924f03b8858383f0dc69f4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eaa6f3dc13d643b9acfd8df1263a456d" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 41395 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:26.996102 30795 consensus_queue.cc:1048] T b90351987d7741299d85cc7599d58d07 P eaa6f3dc13d643b9acfd8df1263a456d [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7def43826924f03b8858383f0dc69f4" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 40053 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:27.007037 30794 consensus_queue.cc:1048] T b90351987d7741299d85cc7599d58d07 P eaa6f3dc13d643b9acfd8df1263a456d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1daf23b3538498bb795a60d627b6ac0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 36109 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:27.044180 30795 raft_consensus.cc:493] T 19335986fe9c4f738db226a45653127a P eaa6f3dc13d643b9acfd8df1263a456d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:27.044608 30795 raft_consensus.cc:515] T 19335986fe9c4f738db226a45653127a P eaa6f3dc13d643b9acfd8df1263a456d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1daf23b3538498bb795a60d627b6ac0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 36109 } } peers { permanent_uuid: "d7def43826924f03b8858383f0dc69f4" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 40053 } } peers { permanent_uuid: "eaa6f3dc13d643b9acfd8df1263a456d" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 41395 } }
I20260709 13:09:27.046131 30795 leader_election.cc:290] T 19335986fe9c4f738db226a45653127a P eaa6f3dc13d643b9acfd8df1263a456d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b1daf23b3538498bb795a60d627b6ac0 (127.17.223.1:36109), d7def43826924f03b8858383f0dc69f4 (127.17.223.2:40053)
I20260709 13:09:27.047073 30476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19335986fe9c4f738db226a45653127a" candidate_uuid: "eaa6f3dc13d643b9acfd8df1263a456d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1daf23b3538498bb795a60d627b6ac0" is_pre_election: true
I20260709 13:09:27.047214 30549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19335986fe9c4f738db226a45653127a" candidate_uuid: "eaa6f3dc13d643b9acfd8df1263a456d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d7def43826924f03b8858383f0dc69f4" is_pre_election: true
I20260709 13:09:27.047941 30476 raft_consensus.cc:2468] T 19335986fe9c4f738db226a45653127a P b1daf23b3538498bb795a60d627b6ac0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eaa6f3dc13d643b9acfd8df1263a456d in term 0.
I20260709 13:09:27.048067 30549 raft_consensus.cc:2468] T 19335986fe9c4f738db226a45653127a P d7def43826924f03b8858383f0dc69f4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eaa6f3dc13d643b9acfd8df1263a456d in term 0.
I20260709 13:09:27.049072 30588 leader_election.cc:304] T 19335986fe9c4f738db226a45653127a P eaa6f3dc13d643b9acfd8df1263a456d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b1daf23b3538498bb795a60d627b6ac0, eaa6f3dc13d643b9acfd8df1263a456d; no voters: 
I20260709 13:09:27.049882 30795 raft_consensus.cc:2804] T 19335986fe9c4f738db226a45653127a P eaa6f3dc13d643b9acfd8df1263a456d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:27.050215 30795 raft_consensus.cc:493] T 19335986fe9c4f738db226a45653127a P eaa6f3dc13d643b9acfd8df1263a456d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:27.050496 30795 raft_consensus.cc:3060] T 19335986fe9c4f738db226a45653127a P eaa6f3dc13d643b9acfd8df1263a456d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:27.055222 30795 raft_consensus.cc:515] T 19335986fe9c4f738db226a45653127a P eaa6f3dc13d643b9acfd8df1263a456d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1daf23b3538498bb795a60d627b6ac0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 36109 } } peers { permanent_uuid: "d7def43826924f03b8858383f0dc69f4" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 40053 } } peers { permanent_uuid: "eaa6f3dc13d643b9acfd8df1263a456d" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 41395 } }
I20260709 13:09:27.056768 30795 leader_election.cc:290] T 19335986fe9c4f738db226a45653127a P eaa6f3dc13d643b9acfd8df1263a456d [CANDIDATE]: Term 1 election: Requested vote from peers b1daf23b3538498bb795a60d627b6ac0 (127.17.223.1:36109), d7def43826924f03b8858383f0dc69f4 (127.17.223.2:40053)
I20260709 13:09:27.057497 30476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19335986fe9c4f738db226a45653127a" candidate_uuid: "eaa6f3dc13d643b9acfd8df1263a456d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1daf23b3538498bb795a60d627b6ac0"
I20260709 13:09:27.057639 30549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19335986fe9c4f738db226a45653127a" candidate_uuid: "eaa6f3dc13d643b9acfd8df1263a456d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d7def43826924f03b8858383f0dc69f4"
I20260709 13:09:27.058069 30476 raft_consensus.cc:3060] T 19335986fe9c4f738db226a45653127a P b1daf23b3538498bb795a60d627b6ac0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:27.058198 30549 raft_consensus.cc:3060] T 19335986fe9c4f738db226a45653127a P d7def43826924f03b8858383f0dc69f4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:27.065294 30549 raft_consensus.cc:2468] T 19335986fe9c4f738db226a45653127a P d7def43826924f03b8858383f0dc69f4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eaa6f3dc13d643b9acfd8df1263a456d in term 1.
I20260709 13:09:27.065426 30476 raft_consensus.cc:2468] T 19335986fe9c4f738db226a45653127a P b1daf23b3538498bb795a60d627b6ac0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eaa6f3dc13d643b9acfd8df1263a456d in term 1.
I20260709 13:09:27.066848 30588 leader_election.cc:304] T 19335986fe9c4f738db226a45653127a P eaa6f3dc13d643b9acfd8df1263a456d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d7def43826924f03b8858383f0dc69f4, eaa6f3dc13d643b9acfd8df1263a456d; no voters: 
I20260709 13:09:27.067580 30795 raft_consensus.cc:2804] T 19335986fe9c4f738db226a45653127a P eaa6f3dc13d643b9acfd8df1263a456d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:27.068122 30795 raft_consensus.cc:697] T 19335986fe9c4f738db226a45653127a P eaa6f3dc13d643b9acfd8df1263a456d [term 1 LEADER]: Becoming Leader. State: Replica: eaa6f3dc13d643b9acfd8df1263a456d, State: Running, Role: LEADER
I20260709 13:09:27.068909 30795 consensus_queue.cc:237] T 19335986fe9c4f738db226a45653127a P eaa6f3dc13d643b9acfd8df1263a456d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1daf23b3538498bb795a60d627b6ac0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 36109 } } peers { permanent_uuid: "d7def43826924f03b8858383f0dc69f4" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 40053 } } peers { permanent_uuid: "eaa6f3dc13d643b9acfd8df1263a456d" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 41395 } }
I20260709 13:09:27.075882 30372 catalog_manager.cc:5697] T 19335986fe9c4f738db226a45653127a P eaa6f3dc13d643b9acfd8df1263a456d reported cstate change: term changed from 0 to 1, leader changed from <none> to eaa6f3dc13d643b9acfd8df1263a456d (127.17.223.3). New cstate: current_term: 1 leader_uuid: "eaa6f3dc13d643b9acfd8df1263a456d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1daf23b3538498bb795a60d627b6ac0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 36109 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d7def43826924f03b8858383f0dc69f4" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 40053 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "eaa6f3dc13d643b9acfd8df1263a456d" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 41395 } health_report { overall_health: HEALTHY } } }
I20260709 13:09:27.142050 30784 raft_consensus.cc:493] T 7ce7118b2aff46f38de8e9d6f5301e41 P d7def43826924f03b8858383f0dc69f4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:27.142516 30784 raft_consensus.cc:515] T 7ce7118b2aff46f38de8e9d6f5301e41 P d7def43826924f03b8858383f0dc69f4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1daf23b3538498bb795a60d627b6ac0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 36109 } } peers { permanent_uuid: "d7def43826924f03b8858383f0dc69f4" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 40053 } } peers { permanent_uuid: "eaa6f3dc13d643b9acfd8df1263a456d" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 41395 } }
I20260709 13:09:27.144466 30784 leader_election.cc:290] T 7ce7118b2aff46f38de8e9d6f5301e41 P d7def43826924f03b8858383f0dc69f4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b1daf23b3538498bb795a60d627b6ac0 (127.17.223.1:36109), eaa6f3dc13d643b9acfd8df1263a456d (127.17.223.3:41395)
I20260709 13:09:27.145264 30476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ce7118b2aff46f38de8e9d6f5301e41" candidate_uuid: "d7def43826924f03b8858383f0dc69f4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1daf23b3538498bb795a60d627b6ac0" is_pre_election: true
I20260709 13:09:27.145545 30623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ce7118b2aff46f38de8e9d6f5301e41" candidate_uuid: "d7def43826924f03b8858383f0dc69f4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eaa6f3dc13d643b9acfd8df1263a456d" is_pre_election: true
I20260709 13:09:27.146164 30476 raft_consensus.cc:2393] T 7ce7118b2aff46f38de8e9d6f5301e41 P b1daf23b3538498bb795a60d627b6ac0 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d7def43826924f03b8858383f0dc69f4 in current term 1: Already voted for candidate eaa6f3dc13d643b9acfd8df1263a456d in this term.
I20260709 13:09:27.147425 30514 leader_election.cc:304] T 7ce7118b2aff46f38de8e9d6f5301e41 P d7def43826924f03b8858383f0dc69f4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d7def43826924f03b8858383f0dc69f4; no voters: b1daf23b3538498bb795a60d627b6ac0, eaa6f3dc13d643b9acfd8df1263a456d
I20260709 13:09:27.148226 30784 raft_consensus.cc:3060] T 7ce7118b2aff46f38de8e9d6f5301e41 P d7def43826924f03b8858383f0dc69f4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:27.153899 30784 raft_consensus.cc:2749] T 7ce7118b2aff46f38de8e9d6f5301e41 P d7def43826924f03b8858383f0dc69f4 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:27.233255 30795 consensus_queue.cc:1048] T 7ce7118b2aff46f38de8e9d6f5301e41 P eaa6f3dc13d643b9acfd8df1263a456d [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7def43826924f03b8858383f0dc69f4" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 40053 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:27.244343 30795 consensus_queue.cc:1048] T 7ce7118b2aff46f38de8e9d6f5301e41 P eaa6f3dc13d643b9acfd8df1263a456d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1daf23b3538498bb795a60d627b6ac0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 36109 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:27.271201 30793 consensus_queue.cc:1048] T 93f7bd85158a4f47aabfeb6b20b664e7 P b1daf23b3538498bb795a60d627b6ac0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7def43826924f03b8858383f0dc69f4" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 40053 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:27.274494 30795 consensus_queue.cc:1048] T f657c3787a9d497f91e05a50c36622f2 P eaa6f3dc13d643b9acfd8df1263a456d [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7def43826924f03b8858383f0dc69f4" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 40053 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:27.288491 30670 consensus_queue.cc:1048] T 93f7bd85158a4f47aabfeb6b20b664e7 P b1daf23b3538498bb795a60d627b6ac0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eaa6f3dc13d643b9acfd8df1263a456d" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 41395 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:27.299234 30748 consensus_queue.cc:1048] T f657c3787a9d497f91e05a50c36622f2 P eaa6f3dc13d643b9acfd8df1263a456d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1daf23b3538498bb795a60d627b6ac0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 36109 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:09:27.356292 30820 consensus_queue.cc:1048] T c9a02595d5e340be8cf9484066cf9cc7 P b1daf23b3538498bb795a60d627b6ac0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7def43826924f03b8858383f0dc69f4" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 40053 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:27.367379 30670 consensus_queue.cc:1048] T c9a02595d5e340be8cf9484066cf9cc7 P b1daf23b3538498bb795a60d627b6ac0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eaa6f3dc13d643b9acfd8df1263a456d" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 41395 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 13:09:27.505158 30422 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:09:27.544734 30748 consensus_queue.cc:1048] T 19335986fe9c4f738db226a45653127a P eaa6f3dc13d643b9acfd8df1263a456d [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7def43826924f03b8858383f0dc69f4" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 40053 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:09:27.556507 30794 consensus_queue.cc:1048] T 19335986fe9c4f738db226a45653127a P eaa6f3dc13d643b9acfd8df1263a456d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1daf23b3538498bb795a60d627b6ac0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 36109 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:28.391383 30670 raft_consensus.cc:493] T 035d977bcb604138a0c5e70d38013012 P b1daf23b3538498bb795a60d627b6ac0 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:28.391958 30670 raft_consensus.cc:515] T 035d977bcb604138a0c5e70d38013012 P b1daf23b3538498bb795a60d627b6ac0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1daf23b3538498bb795a60d627b6ac0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 36109 } } peers { permanent_uuid: "d7def43826924f03b8858383f0dc69f4" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 40053 } } peers { permanent_uuid: "eaa6f3dc13d643b9acfd8df1263a456d" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 41395 } }
I20260709 13:09:28.393392 30670 leader_election.cc:290] T 035d977bcb604138a0c5e70d38013012 P b1daf23b3538498bb795a60d627b6ac0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d7def43826924f03b8858383f0dc69f4 (127.17.223.2:40053), eaa6f3dc13d643b9acfd8df1263a456d (127.17.223.3:41395)
I20260709 13:09:28.394244 30549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "035d977bcb604138a0c5e70d38013012" candidate_uuid: "b1daf23b3538498bb795a60d627b6ac0" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d7def43826924f03b8858383f0dc69f4" is_pre_election: true
I20260709 13:09:28.394529 30623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "035d977bcb604138a0c5e70d38013012" candidate_uuid: "b1daf23b3538498bb795a60d627b6ac0" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eaa6f3dc13d643b9acfd8df1263a456d" is_pre_election: true
I20260709 13:09:28.395031 30549 raft_consensus.cc:2468] T 035d977bcb604138a0c5e70d38013012 P d7def43826924f03b8858383f0dc69f4 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1daf23b3538498bb795a60d627b6ac0 in term 1.
I20260709 13:09:28.395145 30623 raft_consensus.cc:2468] T 035d977bcb604138a0c5e70d38013012 P eaa6f3dc13d643b9acfd8df1263a456d [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1daf23b3538498bb795a60d627b6ac0 in term 1.
I20260709 13:09:28.396194 30439 leader_election.cc:304] T 035d977bcb604138a0c5e70d38013012 P b1daf23b3538498bb795a60d627b6ac0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b1daf23b3538498bb795a60d627b6ac0, eaa6f3dc13d643b9acfd8df1263a456d; no voters: 
I20260709 13:09:28.396744 30670 raft_consensus.cc:2804] T 035d977bcb604138a0c5e70d38013012 P b1daf23b3538498bb795a60d627b6ac0 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:09:28.397073 30670 raft_consensus.cc:493] T 035d977bcb604138a0c5e70d38013012 P b1daf23b3538498bb795a60d627b6ac0 [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:28.397326 30670 raft_consensus.cc:3060] T 035d977bcb604138a0c5e70d38013012 P b1daf23b3538498bb795a60d627b6ac0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:28.401880 30670 raft_consensus.cc:515] T 035d977bcb604138a0c5e70d38013012 P b1daf23b3538498bb795a60d627b6ac0 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1daf23b3538498bb795a60d627b6ac0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 36109 } } peers { permanent_uuid: "d7def43826924f03b8858383f0dc69f4" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 40053 } } peers { permanent_uuid: "eaa6f3dc13d643b9acfd8df1263a456d" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 41395 } }
I20260709 13:09:28.403324 30670 leader_election.cc:290] T 035d977bcb604138a0c5e70d38013012 P b1daf23b3538498bb795a60d627b6ac0 [CANDIDATE]: Term 2 election: Requested vote from peers d7def43826924f03b8858383f0dc69f4 (127.17.223.2:40053), eaa6f3dc13d643b9acfd8df1263a456d (127.17.223.3:41395)
I20260709 13:09:28.404219 30549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "035d977bcb604138a0c5e70d38013012" candidate_uuid: "b1daf23b3538498bb795a60d627b6ac0" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d7def43826924f03b8858383f0dc69f4"
I20260709 13:09:28.404464 30623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "035d977bcb604138a0c5e70d38013012" candidate_uuid: "b1daf23b3538498bb795a60d627b6ac0" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eaa6f3dc13d643b9acfd8df1263a456d"
I20260709 13:09:28.404920 30549 raft_consensus.cc:3060] T 035d977bcb604138a0c5e70d38013012 P d7def43826924f03b8858383f0dc69f4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:28.404982 30623 raft_consensus.cc:3060] T 035d977bcb604138a0c5e70d38013012 P eaa6f3dc13d643b9acfd8df1263a456d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:28.412182 30623 raft_consensus.cc:2468] T 035d977bcb604138a0c5e70d38013012 P eaa6f3dc13d643b9acfd8df1263a456d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b1daf23b3538498bb795a60d627b6ac0 in term 2.
I20260709 13:09:28.412182 30549 raft_consensus.cc:2468] T 035d977bcb604138a0c5e70d38013012 P d7def43826924f03b8858383f0dc69f4 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b1daf23b3538498bb795a60d627b6ac0 in term 2.
I20260709 13:09:28.413671 30439 leader_election.cc:304] T 035d977bcb604138a0c5e70d38013012 P b1daf23b3538498bb795a60d627b6ac0 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b1daf23b3538498bb795a60d627b6ac0, eaa6f3dc13d643b9acfd8df1263a456d; no voters: 
I20260709 13:09:28.414587 30670 raft_consensus.cc:2804] T 035d977bcb604138a0c5e70d38013012 P b1daf23b3538498bb795a60d627b6ac0 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:09:28.415519 30670 raft_consensus.cc:697] T 035d977bcb604138a0c5e70d38013012 P b1daf23b3538498bb795a60d627b6ac0 [term 2 LEADER]: Becoming Leader. State: Replica: b1daf23b3538498bb795a60d627b6ac0, State: Running, Role: LEADER
I20260709 13:09:28.416244 30670 consensus_queue.cc:237] T 035d977bcb604138a0c5e70d38013012 P b1daf23b3538498bb795a60d627b6ac0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1daf23b3538498bb795a60d627b6ac0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 36109 } } peers { permanent_uuid: "d7def43826924f03b8858383f0dc69f4" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 40053 } } peers { permanent_uuid: "eaa6f3dc13d643b9acfd8df1263a456d" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 41395 } }
I20260709 13:09:28.424158 30370 catalog_manager.cc:5697] T 035d977bcb604138a0c5e70d38013012 P b1daf23b3538498bb795a60d627b6ac0 reported cstate change: term changed from 0 to 2, leader changed from <none> to b1daf23b3538498bb795a60d627b6ac0 (127.17.223.1). New cstate: current_term: 2 leader_uuid: "b1daf23b3538498bb795a60d627b6ac0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1daf23b3538498bb795a60d627b6ac0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 36109 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d7def43826924f03b8858383f0dc69f4" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 40053 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "eaa6f3dc13d643b9acfd8df1263a456d" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 41395 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:28.847084 30623 raft_consensus.cc:1275] T 035d977bcb604138a0c5e70d38013012 P eaa6f3dc13d643b9acfd8df1263a456d [term 2 FOLLOWER]: Refusing update from remote peer b1daf23b3538498bb795a60d627b6ac0: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 13:09:28.848318 30670 consensus_queue.cc:1048] T 035d977bcb604138a0c5e70d38013012 P b1daf23b3538498bb795a60d627b6ac0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eaa6f3dc13d643b9acfd8df1263a456d" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 41395 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:28.858148 30549 raft_consensus.cc:1275] T 035d977bcb604138a0c5e70d38013012 P d7def43826924f03b8858383f0dc69f4 [term 2 FOLLOWER]: Refusing update from remote peer b1daf23b3538498bb795a60d627b6ac0: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 13:09:28.859496 30836 consensus_queue.cc:1048] T 035d977bcb604138a0c5e70d38013012 P b1daf23b3538498bb795a60d627b6ac0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7def43826924f03b8858383f0dc69f4" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 40053 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:28.875313 30549 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "052373021b584e2e84d1d9dee352aebd"
dest_uuid: "d7def43826924f03b8858383f0dc69f4"
mode: GRACEFUL
new_leader_uuid: "b1daf23b3538498bb795a60d627b6ac0"
 from {username='slave'} at 127.0.0.1:52322
I20260709 13:09:28.875959 30549 raft_consensus.cc:606] T 052373021b584e2e84d1d9dee352aebd P d7def43826924f03b8858383f0dc69f4 [term 1 LEADER]: Received request to transfer leadership to TS b1daf23b3538498bb795a60d627b6ac0
I20260709 13:09:28.881114 30625 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b90351987d7741299d85cc7599d58d07"
dest_uuid: "eaa6f3dc13d643b9acfd8df1263a456d"
mode: GRACEFUL
new_leader_uuid: "b1daf23b3538498bb795a60d627b6ac0"
 from {username='slave'} at 127.0.0.1:37554
I20260709 13:09:28.881762 30625 raft_consensus.cc:606] T b90351987d7741299d85cc7599d58d07 P eaa6f3dc13d643b9acfd8df1263a456d [term 1 LEADER]: Received request to transfer leadership to TS b1daf23b3538498bb795a60d627b6ac0
I20260709 13:09:28.886188 30625 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f657c3787a9d497f91e05a50c36622f2"
dest_uuid: "eaa6f3dc13d643b9acfd8df1263a456d"
mode: GRACEFUL
new_leader_uuid: "b1daf23b3538498bb795a60d627b6ac0"
 from {username='slave'} at 127.0.0.1:37554
I20260709 13:09:28.886650 30625 raft_consensus.cc:606] T f657c3787a9d497f91e05a50c36622f2 P eaa6f3dc13d643b9acfd8df1263a456d [term 1 LEADER]: Received request to transfer leadership to TS b1daf23b3538498bb795a60d627b6ac0
I20260709 13:09:28.891477 30625 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7ce7118b2aff46f38de8e9d6f5301e41"
dest_uuid: "eaa6f3dc13d643b9acfd8df1263a456d"
mode: GRACEFUL
new_leader_uuid: "b1daf23b3538498bb795a60d627b6ac0"
 from {username='slave'} at 127.0.0.1:37554
I20260709 13:09:28.891974 30625 raft_consensus.cc:606] T 7ce7118b2aff46f38de8e9d6f5301e41 P eaa6f3dc13d643b9acfd8df1263a456d [term 1 LEADER]: Received request to transfer leadership to TS b1daf23b3538498bb795a60d627b6ac0
I20260709 13:09:28.898607 30625 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "19335986fe9c4f738db226a45653127a"
dest_uuid: "eaa6f3dc13d643b9acfd8df1263a456d"
mode: GRACEFUL
new_leader_uuid: "d7def43826924f03b8858383f0dc69f4"
 from {username='slave'} at 127.0.0.1:37554
I20260709 13:09:28.899066 30625 raft_consensus.cc:606] T 19335986fe9c4f738db226a45653127a P eaa6f3dc13d643b9acfd8df1263a456d [term 1 LEADER]: Received request to transfer leadership to TS d7def43826924f03b8858383f0dc69f4
I20260709 13:09:28.903445 30476 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c9a02595d5e340be8cf9484066cf9cc7"
dest_uuid: "b1daf23b3538498bb795a60d627b6ac0"
mode: GRACEFUL
new_leader_uuid: "d7def43826924f03b8858383f0dc69f4"
 from {username='slave'} at 127.0.0.1:43194
I20260709 13:09:28.903941 30476 raft_consensus.cc:606] T c9a02595d5e340be8cf9484066cf9cc7 P b1daf23b3538498bb795a60d627b6ac0 [term 1 LEADER]: Received request to transfer leadership to TS d7def43826924f03b8858383f0dc69f4
I20260709 13:09:28.908644 30476 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "035d977bcb604138a0c5e70d38013012"
dest_uuid: "b1daf23b3538498bb795a60d627b6ac0"
mode: GRACEFUL
new_leader_uuid: "d7def43826924f03b8858383f0dc69f4"
 from {username='slave'} at 127.0.0.1:43194
I20260709 13:09:28.909130 30476 raft_consensus.cc:606] T 035d977bcb604138a0c5e70d38013012 P b1daf23b3538498bb795a60d627b6ac0 [term 2 LEADER]: Received request to transfer leadership to TS d7def43826924f03b8858383f0dc69f4
I20260709 13:09:28.913390 30476 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "93f7bd85158a4f47aabfeb6b20b664e7"
dest_uuid: "b1daf23b3538498bb795a60d627b6ac0"
mode: GRACEFUL
new_leader_uuid: "eaa6f3dc13d643b9acfd8df1263a456d"
 from {username='slave'} at 127.0.0.1:43194
I20260709 13:09:28.913859 30476 raft_consensus.cc:606] T 93f7bd85158a4f47aabfeb6b20b664e7 P b1daf23b3538498bb795a60d627b6ac0 [term 1 LEADER]: Received request to transfer leadership to TS eaa6f3dc13d643b9acfd8df1263a456d
I20260709 13:09:28.935945 30840 raft_consensus.cc:993] T 052373021b584e2e84d1d9dee352aebd P d7def43826924f03b8858383f0dc69f4: : Instructing follower b1daf23b3538498bb795a60d627b6ac0 to start an election
I20260709 13:09:28.936363 30764 raft_consensus.cc:1081] T 052373021b584e2e84d1d9dee352aebd P d7def43826924f03b8858383f0dc69f4 [term 1 LEADER]: Signalling peer b1daf23b3538498bb795a60d627b6ac0 to start an election
I20260709 13:09:28.937635 30476 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "052373021b584e2e84d1d9dee352aebd"
dest_uuid: "b1daf23b3538498bb795a60d627b6ac0"
 from {username='slave'} at 127.0.0.1:43172
I20260709 13:09:28.938104 30476 raft_consensus.cc:493] T 052373021b584e2e84d1d9dee352aebd P b1daf23b3538498bb795a60d627b6ac0 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:09:28.938410 30476 raft_consensus.cc:3060] T 052373021b584e2e84d1d9dee352aebd P b1daf23b3538498bb795a60d627b6ac0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:28.943429 30476 raft_consensus.cc:515] T 052373021b584e2e84d1d9dee352aebd P b1daf23b3538498bb795a60d627b6ac0 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1daf23b3538498bb795a60d627b6ac0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 36109 } } peers { permanent_uuid: "d7def43826924f03b8858383f0dc69f4" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 40053 } } peers { permanent_uuid: "eaa6f3dc13d643b9acfd8df1263a456d" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 41395 } }
I20260709 13:09:28.944963 30476 leader_election.cc:290] T 052373021b584e2e84d1d9dee352aebd P b1daf23b3538498bb795a60d627b6ac0 [CANDIDATE]: Term 2 election: Requested vote from peers d7def43826924f03b8858383f0dc69f4 (127.17.223.2:40053), eaa6f3dc13d643b9acfd8df1263a456d (127.17.223.3:41395)
I20260709 13:09:28.945730 30549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "052373021b584e2e84d1d9dee352aebd" candidate_uuid: "b1daf23b3538498bb795a60d627b6ac0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d7def43826924f03b8858383f0dc69f4"
I20260709 13:09:28.945940 30625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "052373021b584e2e84d1d9dee352aebd" candidate_uuid: "b1daf23b3538498bb795a60d627b6ac0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "eaa6f3dc13d643b9acfd8df1263a456d"
I20260709 13:09:28.946415 30549 raft_consensus.cc:3055] T 052373021b584e2e84d1d9dee352aebd P d7def43826924f03b8858383f0dc69f4 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:09:28.946499 30625 raft_consensus.cc:3060] T 052373021b584e2e84d1d9dee352aebd P eaa6f3dc13d643b9acfd8df1263a456d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:28.946760 30549 raft_consensus.cc:740] T 052373021b584e2e84d1d9dee352aebd P d7def43826924f03b8858383f0dc69f4 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: d7def43826924f03b8858383f0dc69f4, State: Running, Role: LEADER
I20260709 13:09:28.947644 30549 consensus_queue.cc:260] T 052373021b584e2e84d1d9dee352aebd P d7def43826924f03b8858383f0dc69f4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1daf23b3538498bb795a60d627b6ac0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 36109 } } peers { permanent_uuid: "d7def43826924f03b8858383f0dc69f4" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 40053 } } peers { permanent_uuid: "eaa6f3dc13d643b9acfd8df1263a456d" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 41395 } }
I20260709 13:09:28.948858 30549 raft_consensus.cc:3060] T 052373021b584e2e84d1d9dee352aebd P d7def43826924f03b8858383f0dc69f4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:28.952211 30625 raft_consensus.cc:2468] T 052373021b584e2e84d1d9dee352aebd P eaa6f3dc13d643b9acfd8df1263a456d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b1daf23b3538498bb795a60d627b6ac0 in term 2.
I20260709 13:09:28.953347 30439 leader_election.cc:304] T 052373021b584e2e84d1d9dee352aebd P b1daf23b3538498bb795a60d627b6ac0 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b1daf23b3538498bb795a60d627b6ac0, eaa6f3dc13d643b9acfd8df1263a456d; no voters: 
I20260709 13:09:28.954051 30836 raft_consensus.cc:2804] T 052373021b584e2e84d1d9dee352aebd P b1daf23b3538498bb795a60d627b6ac0 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:09:28.954313 30549 raft_consensus.cc:2468] T 052373021b584e2e84d1d9dee352aebd P d7def43826924f03b8858383f0dc69f4 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b1daf23b3538498bb795a60d627b6ac0 in term 2.
I20260709 13:09:28.954429 30836 raft_consensus.cc:697] T 052373021b584e2e84d1d9dee352aebd P b1daf23b3538498bb795a60d627b6ac0 [term 2 LEADER]: Becoming Leader. State: Replica: b1daf23b3538498bb795a60d627b6ac0, State: Running, Role: LEADER
I20260709 13:09:28.955453 30836 consensus_queue.cc:237] T 052373021b584e2e84d1d9dee352aebd P b1daf23b3538498bb795a60d627b6ac0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1daf23b3538498bb795a60d627b6ac0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 36109 } } peers { permanent_uuid: "d7def43826924f03b8858383f0dc69f4" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 40053 } } peers { permanent_uuid: "eaa6f3dc13d643b9acfd8df1263a456d" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 41395 } }
I20260709 13:09:28.962191 30370 catalog_manager.cc:5697] T 052373021b584e2e84d1d9dee352aebd P b1daf23b3538498bb795a60d627b6ac0 reported cstate change: term changed from 1 to 2, leader changed from d7def43826924f03b8858383f0dc69f4 (127.17.223.2) to b1daf23b3538498bb795a60d627b6ac0 (127.17.223.1). New cstate: current_term: 2 leader_uuid: "b1daf23b3538498bb795a60d627b6ac0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1daf23b3538498bb795a60d627b6ac0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 36109 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d7def43826924f03b8858383f0dc69f4" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 40053 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "eaa6f3dc13d643b9acfd8df1263a456d" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 41395 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:29.023134 30670 raft_consensus.cc:993] T c9a02595d5e340be8cf9484066cf9cc7 P b1daf23b3538498bb795a60d627b6ac0: : Instructing follower d7def43826924f03b8858383f0dc69f4 to start an election
I20260709 13:09:29.023576 30836 raft_consensus.cc:1081] T c9a02595d5e340be8cf9484066cf9cc7 P b1daf23b3538498bb795a60d627b6ac0 [term 1 LEADER]: Signalling peer d7def43826924f03b8858383f0dc69f4 to start an election
I20260709 13:09:29.024856 30549 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c9a02595d5e340be8cf9484066cf9cc7"
dest_uuid: "d7def43826924f03b8858383f0dc69f4"
 from {username='slave'} at 127.0.0.1:52294
I20260709 13:09:29.025312 30549 raft_consensus.cc:493] T c9a02595d5e340be8cf9484066cf9cc7 P d7def43826924f03b8858383f0dc69f4 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:09:29.025592 30549 raft_consensus.cc:3060] T c9a02595d5e340be8cf9484066cf9cc7 P d7def43826924f03b8858383f0dc69f4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:29.030263 30549 raft_consensus.cc:515] T c9a02595d5e340be8cf9484066cf9cc7 P d7def43826924f03b8858383f0dc69f4 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1daf23b3538498bb795a60d627b6ac0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 36109 } } peers { permanent_uuid: "d7def43826924f03b8858383f0dc69f4" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 40053 } } peers { permanent_uuid: "eaa6f3dc13d643b9acfd8df1263a456d" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 41395 } }
I20260709 13:09:29.031859 30549 leader_election.cc:290] T c9a02595d5e340be8cf9484066cf9cc7 P d7def43826924f03b8858383f0dc69f4 [CANDIDATE]: Term 2 election: Requested vote from peers b1daf23b3538498bb795a60d627b6ac0 (127.17.223.1:36109), eaa6f3dc13d643b9acfd8df1263a456d (127.17.223.3:41395)
I20260709 13:09:29.032747 30476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9a02595d5e340be8cf9484066cf9cc7" candidate_uuid: "d7def43826924f03b8858383f0dc69f4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b1daf23b3538498bb795a60d627b6ac0"
I20260709 13:09:29.033001 30625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9a02595d5e340be8cf9484066cf9cc7" candidate_uuid: "d7def43826924f03b8858383f0dc69f4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "eaa6f3dc13d643b9acfd8df1263a456d"
I20260709 13:09:29.033517 30476 raft_consensus.cc:3055] T c9a02595d5e340be8cf9484066cf9cc7 P b1daf23b3538498bb795a60d627b6ac0 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:09:29.033607 30625 raft_consensus.cc:3060] T c9a02595d5e340be8cf9484066cf9cc7 P eaa6f3dc13d643b9acfd8df1263a456d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:29.033892 30476 raft_consensus.cc:740] T c9a02595d5e340be8cf9484066cf9cc7 P b1daf23b3538498bb795a60d627b6ac0 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b1daf23b3538498bb795a60d627b6ac0, State: Running, Role: LEADER
I20260709 13:09:29.034925 30476 consensus_queue.cc:260] T c9a02595d5e340be8cf9484066cf9cc7 P b1daf23b3538498bb795a60d627b6ac0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1daf23b3538498bb795a60d627b6ac0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 36109 } } peers { permanent_uuid: "d7def43826924f03b8858383f0dc69f4" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 40053 } } peers { permanent_uuid: "eaa6f3dc13d643b9acfd8df1263a456d" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 41395 } }
I20260709 13:09:29.036072 30476 raft_consensus.cc:3060] T c9a02595d5e340be8cf9484066cf9cc7 P b1daf23b3538498bb795a60d627b6ac0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:29.042996 30766 raft_consensus.cc:993] T 19335986fe9c4f738db226a45653127a P eaa6f3dc13d643b9acfd8df1263a456d: : Instructing follower d7def43826924f03b8858383f0dc69f4 to start an election
I20260709 13:09:29.043546 30766 raft_consensus.cc:1081] T 19335986fe9c4f738db226a45653127a P eaa6f3dc13d643b9acfd8df1263a456d [term 1 LEADER]: Signalling peer d7def43826924f03b8858383f0dc69f4 to start an election
I20260709 13:09:29.043388 30625 raft_consensus.cc:2468] T c9a02595d5e340be8cf9484066cf9cc7 P eaa6f3dc13d643b9acfd8df1263a456d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d7def43826924f03b8858383f0dc69f4 in term 2.
I20260709 13:09:29.044914 30476 raft_consensus.cc:2468] T c9a02595d5e340be8cf9484066cf9cc7 P b1daf23b3538498bb795a60d627b6ac0 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d7def43826924f03b8858383f0dc69f4 in term 2.
I20260709 13:09:29.045102 30514 leader_election.cc:304] T c9a02595d5e340be8cf9484066cf9cc7 P d7def43826924f03b8858383f0dc69f4 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d7def43826924f03b8858383f0dc69f4, eaa6f3dc13d643b9acfd8df1263a456d; no voters: 
I20260709 13:09:29.045260 30549 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "19335986fe9c4f738db226a45653127a"
dest_uuid: "d7def43826924f03b8858383f0dc69f4"
 from {username='slave'} at 127.0.0.1:52310
I20260709 13:09:29.045943 30549 raft_consensus.cc:493] T 19335986fe9c4f738db226a45653127a P d7def43826924f03b8858383f0dc69f4 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:09:29.046001 30764 raft_consensus.cc:2804] T c9a02595d5e340be8cf9484066cf9cc7 P d7def43826924f03b8858383f0dc69f4 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:09:29.046383 30549 raft_consensus.cc:3060] T 19335986fe9c4f738db226a45653127a P d7def43826924f03b8858383f0dc69f4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:29.046574 30764 raft_consensus.cc:697] T c9a02595d5e340be8cf9484066cf9cc7 P d7def43826924f03b8858383f0dc69f4 [term 2 LEADER]: Becoming Leader. State: Replica: d7def43826924f03b8858383f0dc69f4, State: Running, Role: LEADER
I20260709 13:09:29.047465 30764 consensus_queue.cc:237] T c9a02595d5e340be8cf9484066cf9cc7 P d7def43826924f03b8858383f0dc69f4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1daf23b3538498bb795a60d627b6ac0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 36109 } } peers { permanent_uuid: "d7def43826924f03b8858383f0dc69f4" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 40053 } } peers { permanent_uuid: "eaa6f3dc13d643b9acfd8df1263a456d" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 41395 } }
I20260709 13:09:29.052320 30549 raft_consensus.cc:515] T 19335986fe9c4f738db226a45653127a P d7def43826924f03b8858383f0dc69f4 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1daf23b3538498bb795a60d627b6ac0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 36109 } } peers { permanent_uuid: "d7def43826924f03b8858383f0dc69f4" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 40053 } } peers { permanent_uuid: "eaa6f3dc13d643b9acfd8df1263a456d" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 41395 } }
I20260709 13:09:29.054301 30549 leader_election.cc:290] T 19335986fe9c4f738db226a45653127a P d7def43826924f03b8858383f0dc69f4 [CANDIDATE]: Term 2 election: Requested vote from peers b1daf23b3538498bb795a60d627b6ac0 (127.17.223.1:36109), eaa6f3dc13d643b9acfd8df1263a456d (127.17.223.3:41395)
I20260709 13:09:29.055219 30476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19335986fe9c4f738db226a45653127a" candidate_uuid: "d7def43826924f03b8858383f0dc69f4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b1daf23b3538498bb795a60d627b6ac0"
I20260709 13:09:29.055852 30476 raft_consensus.cc:3060] T 19335986fe9c4f738db226a45653127a P b1daf23b3538498bb795a60d627b6ac0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:29.055786 30625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19335986fe9c4f738db226a45653127a" candidate_uuid: "d7def43826924f03b8858383f0dc69f4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "eaa6f3dc13d643b9acfd8df1263a456d"
I20260709 13:09:29.056622 30625 raft_consensus.cc:3055] T 19335986fe9c4f738db226a45653127a P eaa6f3dc13d643b9acfd8df1263a456d [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:09:29.057081 30625 raft_consensus.cc:740] T 19335986fe9c4f738db226a45653127a P eaa6f3dc13d643b9acfd8df1263a456d [term 1 LEADER]: Becoming Follower/Learner. State: Replica: eaa6f3dc13d643b9acfd8df1263a456d, State: Running, Role: LEADER
I20260709 13:09:29.056667 30370 catalog_manager.cc:5697] T c9a02595d5e340be8cf9484066cf9cc7 P d7def43826924f03b8858383f0dc69f4 reported cstate change: term changed from 1 to 2, leader changed from b1daf23b3538498bb795a60d627b6ac0 (127.17.223.1) to d7def43826924f03b8858383f0dc69f4 (127.17.223.2). New cstate: current_term: 2 leader_uuid: "d7def43826924f03b8858383f0dc69f4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1daf23b3538498bb795a60d627b6ac0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 36109 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d7def43826924f03b8858383f0dc69f4" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 40053 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "eaa6f3dc13d643b9acfd8df1263a456d" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 41395 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:29.057931 30625 consensus_queue.cc:260] T 19335986fe9c4f738db226a45653127a P eaa6f3dc13d643b9acfd8df1263a456d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1daf23b3538498bb795a60d627b6ac0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 36109 } } peers { permanent_uuid: "d7def43826924f03b8858383f0dc69f4" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 40053 } } peers { permanent_uuid: "eaa6f3dc13d643b9acfd8df1263a456d" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 41395 } }
I20260709 13:09:29.059314 30625 raft_consensus.cc:3060] T 19335986fe9c4f738db226a45653127a P eaa6f3dc13d643b9acfd8df1263a456d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:29.067055 30625 raft_consensus.cc:2468] T 19335986fe9c4f738db226a45653127a P eaa6f3dc13d643b9acfd8df1263a456d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d7def43826924f03b8858383f0dc69f4 in term 2.
I20260709 13:09:29.067430 30476 raft_consensus.cc:2468] T 19335986fe9c4f738db226a45653127a P b1daf23b3538498bb795a60d627b6ac0 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d7def43826924f03b8858383f0dc69f4 in term 2.
I20260709 13:09:29.071102 30514 leader_election.cc:304] T 19335986fe9c4f738db226a45653127a P d7def43826924f03b8858383f0dc69f4 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b1daf23b3538498bb795a60d627b6ac0, d7def43826924f03b8858383f0dc69f4; no voters: 
I20260709 13:09:29.072489 30764 raft_consensus.cc:2804] T 19335986fe9c4f738db226a45653127a P d7def43826924f03b8858383f0dc69f4 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:09:29.077215 30764 raft_consensus.cc:697] T 19335986fe9c4f738db226a45653127a P d7def43826924f03b8858383f0dc69f4 [term 2 LEADER]: Becoming Leader. State: Replica: d7def43826924f03b8858383f0dc69f4, State: Running, Role: LEADER
I20260709 13:09:29.078548 30764 consensus_queue.cc:237] T 19335986fe9c4f738db226a45653127a P d7def43826924f03b8858383f0dc69f4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1daf23b3538498bb795a60d627b6ac0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 36109 } } peers { permanent_uuid: "d7def43826924f03b8858383f0dc69f4" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 40053 } } peers { permanent_uuid: "eaa6f3dc13d643b9acfd8df1263a456d" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 41395 } }
I20260709 13:09:29.085685 30370 catalog_manager.cc:5697] T 19335986fe9c4f738db226a45653127a P d7def43826924f03b8858383f0dc69f4 reported cstate change: term changed from 1 to 2, leader changed from eaa6f3dc13d643b9acfd8df1263a456d (127.17.223.3) to d7def43826924f03b8858383f0dc69f4 (127.17.223.2). New cstate: current_term: 2 leader_uuid: "d7def43826924f03b8858383f0dc69f4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1daf23b3538498bb795a60d627b6ac0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 36109 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d7def43826924f03b8858383f0dc69f4" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 40053 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "eaa6f3dc13d643b9acfd8df1263a456d" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 41395 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:29.132882 30845 raft_consensus.cc:993] T f657c3787a9d497f91e05a50c36622f2 P eaa6f3dc13d643b9acfd8df1263a456d: : Instructing follower b1daf23b3538498bb795a60d627b6ac0 to start an election
I20260709 13:09:29.133344 30766 raft_consensus.cc:1081] T f657c3787a9d497f91e05a50c36622f2 P eaa6f3dc13d643b9acfd8df1263a456d [term 1 LEADER]: Signalling peer b1daf23b3538498bb795a60d627b6ac0 to start an election
I20260709 13:09:29.134742 30476 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f657c3787a9d497f91e05a50c36622f2"
dest_uuid: "b1daf23b3538498bb795a60d627b6ac0"
 from {username='slave'} at 127.0.0.1:43180
I20260709 13:09:29.135140 30476 raft_consensus.cc:493] T f657c3787a9d497f91e05a50c36622f2 P b1daf23b3538498bb795a60d627b6ac0 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:09:29.135370 30476 raft_consensus.cc:3060] T f657c3787a9d497f91e05a50c36622f2 P b1daf23b3538498bb795a60d627b6ac0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:29.139920 30476 raft_consensus.cc:515] T f657c3787a9d497f91e05a50c36622f2 P b1daf23b3538498bb795a60d627b6ac0 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1daf23b3538498bb795a60d627b6ac0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 36109 } } peers { permanent_uuid: "d7def43826924f03b8858383f0dc69f4" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 40053 } } peers { permanent_uuid: "eaa6f3dc13d643b9acfd8df1263a456d" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 41395 } }
I20260709 13:09:29.141225 30476 leader_election.cc:290] T f657c3787a9d497f91e05a50c36622f2 P b1daf23b3538498bb795a60d627b6ac0 [CANDIDATE]: Term 2 election: Requested vote from peers d7def43826924f03b8858383f0dc69f4 (127.17.223.2:40053), eaa6f3dc13d643b9acfd8df1263a456d (127.17.223.3:41395)
I20260709 13:09:29.142068 30549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f657c3787a9d497f91e05a50c36622f2" candidate_uuid: "b1daf23b3538498bb795a60d627b6ac0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d7def43826924f03b8858383f0dc69f4"
I20260709 13:09:29.142373 30625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f657c3787a9d497f91e05a50c36622f2" candidate_uuid: "b1daf23b3538498bb795a60d627b6ac0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "eaa6f3dc13d643b9acfd8df1263a456d"
I20260709 13:09:29.142699 30549 raft_consensus.cc:3060] T f657c3787a9d497f91e05a50c36622f2 P d7def43826924f03b8858383f0dc69f4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:29.142993 30625 raft_consensus.cc:3055] T f657c3787a9d497f91e05a50c36622f2 P eaa6f3dc13d643b9acfd8df1263a456d [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:09:29.143307 30625 raft_consensus.cc:740] T f657c3787a9d497f91e05a50c36622f2 P eaa6f3dc13d643b9acfd8df1263a456d [term 1 LEADER]: Becoming Follower/Learner. State: Replica: eaa6f3dc13d643b9acfd8df1263a456d, State: Running, Role: LEADER
I20260709 13:09:29.144094 30625 consensus_queue.cc:260] T f657c3787a9d497f91e05a50c36622f2 P eaa6f3dc13d643b9acfd8df1263a456d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1daf23b3538498bb795a60d627b6ac0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 36109 } } peers { permanent_uuid: "d7def43826924f03b8858383f0dc69f4" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 40053 } } peers { permanent_uuid: "eaa6f3dc13d643b9acfd8df1263a456d" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 41395 } }
I20260709 13:09:29.145292 30625 raft_consensus.cc:3060] T f657c3787a9d497f91e05a50c36622f2 P eaa6f3dc13d643b9acfd8df1263a456d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:29.149127 30549 raft_consensus.cc:2468] T f657c3787a9d497f91e05a50c36622f2 P d7def43826924f03b8858383f0dc69f4 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b1daf23b3538498bb795a60d627b6ac0 in term 2.
I20260709 13:09:29.150238 30439 leader_election.cc:304] T f657c3787a9d497f91e05a50c36622f2 P b1daf23b3538498bb795a60d627b6ac0 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b1daf23b3538498bb795a60d627b6ac0, d7def43826924f03b8858383f0dc69f4; no voters: 
I20260709 13:09:29.151006 30836 raft_consensus.cc:2804] T f657c3787a9d497f91e05a50c36622f2 P b1daf23b3538498bb795a60d627b6ac0 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:09:29.151530 30836 raft_consensus.cc:697] T f657c3787a9d497f91e05a50c36622f2 P b1daf23b3538498bb795a60d627b6ac0 [term 2 LEADER]: Becoming Leader. State: Replica: b1daf23b3538498bb795a60d627b6ac0, State: Running, Role: LEADER
I20260709 13:09:29.152441 30625 raft_consensus.cc:2468] T f657c3787a9d497f91e05a50c36622f2 P eaa6f3dc13d643b9acfd8df1263a456d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b1daf23b3538498bb795a60d627b6ac0 in term 2.
I20260709 13:09:29.152288 30836 consensus_queue.cc:237] T f657c3787a9d497f91e05a50c36622f2 P b1daf23b3538498bb795a60d627b6ac0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1daf23b3538498bb795a60d627b6ac0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 36109 } } peers { permanent_uuid: "d7def43826924f03b8858383f0dc69f4" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 40053 } } peers { permanent_uuid: "eaa6f3dc13d643b9acfd8df1263a456d" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 41395 } }
I20260709 13:09:29.159848 30370 catalog_manager.cc:5697] T f657c3787a9d497f91e05a50c36622f2 P b1daf23b3538498bb795a60d627b6ac0 reported cstate change: term changed from 1 to 2, leader changed from eaa6f3dc13d643b9acfd8df1263a456d (127.17.223.3) to b1daf23b3538498bb795a60d627b6ac0 (127.17.223.1). New cstate: current_term: 2 leader_uuid: "b1daf23b3538498bb795a60d627b6ac0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1daf23b3538498bb795a60d627b6ac0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 36109 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d7def43826924f03b8858383f0dc69f4" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 40053 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "eaa6f3dc13d643b9acfd8df1263a456d" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 41395 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:29.261369 30845 raft_consensus.cc:993] T 7ce7118b2aff46f38de8e9d6f5301e41 P eaa6f3dc13d643b9acfd8df1263a456d: : Instructing follower b1daf23b3538498bb795a60d627b6ac0 to start an election
I20260709 13:09:29.261850 30766 raft_consensus.cc:1081] T 7ce7118b2aff46f38de8e9d6f5301e41 P eaa6f3dc13d643b9acfd8df1263a456d [term 1 LEADER]: Signalling peer b1daf23b3538498bb795a60d627b6ac0 to start an election
I20260709 13:09:29.263229 30476 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "7ce7118b2aff46f38de8e9d6f5301e41"
dest_uuid: "b1daf23b3538498bb795a60d627b6ac0"
 from {username='slave'} at 127.0.0.1:43180
I20260709 13:09:29.263622 30476 raft_consensus.cc:493] T 7ce7118b2aff46f38de8e9d6f5301e41 P b1daf23b3538498bb795a60d627b6ac0 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:09:29.263836 30476 raft_consensus.cc:3060] T 7ce7118b2aff46f38de8e9d6f5301e41 P b1daf23b3538498bb795a60d627b6ac0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:29.269412 30845 raft_consensus.cc:993] T b90351987d7741299d85cc7599d58d07 P eaa6f3dc13d643b9acfd8df1263a456d: : Instructing follower b1daf23b3538498bb795a60d627b6ac0 to start an election
I20260709 13:09:29.271095 30845 raft_consensus.cc:1081] T b90351987d7741299d85cc7599d58d07 P eaa6f3dc13d643b9acfd8df1263a456d [term 1 LEADER]: Signalling peer b1daf23b3538498bb795a60d627b6ac0 to start an election
I20260709 13:09:29.270277 30476 raft_consensus.cc:515] T 7ce7118b2aff46f38de8e9d6f5301e41 P b1daf23b3538498bb795a60d627b6ac0 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1daf23b3538498bb795a60d627b6ac0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 36109 } } peers { permanent_uuid: "d7def43826924f03b8858383f0dc69f4" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 40053 } } peers { permanent_uuid: "eaa6f3dc13d643b9acfd8df1263a456d" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 41395 } }
I20260709 13:09:29.272991 30475 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b90351987d7741299d85cc7599d58d07"
dest_uuid: "b1daf23b3538498bb795a60d627b6ac0"
 from {username='slave'} at 127.0.0.1:43180
I20260709 13:09:29.273315 30476 leader_election.cc:290] T 7ce7118b2aff46f38de8e9d6f5301e41 P b1daf23b3538498bb795a60d627b6ac0 [CANDIDATE]: Term 2 election: Requested vote from peers d7def43826924f03b8858383f0dc69f4 (127.17.223.2:40053), eaa6f3dc13d643b9acfd8df1263a456d (127.17.223.3:41395)
I20260709 13:09:29.273526 30475 raft_consensus.cc:493] T b90351987d7741299d85cc7599d58d07 P b1daf23b3538498bb795a60d627b6ac0 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:09:29.273991 30475 raft_consensus.cc:3060] T b90351987d7741299d85cc7599d58d07 P b1daf23b3538498bb795a60d627b6ac0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:29.274401 30549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ce7118b2aff46f38de8e9d6f5301e41" candidate_uuid: "b1daf23b3538498bb795a60d627b6ac0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d7def43826924f03b8858383f0dc69f4"
I20260709 13:09:29.274873 30623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ce7118b2aff46f38de8e9d6f5301e41" candidate_uuid: "b1daf23b3538498bb795a60d627b6ac0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "eaa6f3dc13d643b9acfd8df1263a456d"
I20260709 13:09:29.275002 30549 raft_consensus.cc:3060] T 7ce7118b2aff46f38de8e9d6f5301e41 P d7def43826924f03b8858383f0dc69f4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:29.275444 30623 raft_consensus.cc:3055] T 7ce7118b2aff46f38de8e9d6f5301e41 P eaa6f3dc13d643b9acfd8df1263a456d [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:09:29.275746 30623 raft_consensus.cc:740] T 7ce7118b2aff46f38de8e9d6f5301e41 P eaa6f3dc13d643b9acfd8df1263a456d [term 1 LEADER]: Becoming Follower/Learner. State: Replica: eaa6f3dc13d643b9acfd8df1263a456d, State: Running, Role: LEADER
I20260709 13:09:29.276497 30623 consensus_queue.cc:260] T 7ce7118b2aff46f38de8e9d6f5301e41 P eaa6f3dc13d643b9acfd8df1263a456d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1daf23b3538498bb795a60d627b6ac0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 36109 } } peers { permanent_uuid: "d7def43826924f03b8858383f0dc69f4" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 40053 } } peers { permanent_uuid: "eaa6f3dc13d643b9acfd8df1263a456d" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 41395 } }
I20260709 13:09:29.277436 30623 raft_consensus.cc:3060] T 7ce7118b2aff46f38de8e9d6f5301e41 P eaa6f3dc13d643b9acfd8df1263a456d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:29.280441 30475 raft_consensus.cc:515] T b90351987d7741299d85cc7599d58d07 P b1daf23b3538498bb795a60d627b6ac0 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1daf23b3538498bb795a60d627b6ac0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 36109 } } peers { permanent_uuid: "d7def43826924f03b8858383f0dc69f4" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 40053 } } peers { permanent_uuid: "eaa6f3dc13d643b9acfd8df1263a456d" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 41395 } }
I20260709 13:09:29.281289 30549 raft_consensus.cc:2468] T 7ce7118b2aff46f38de8e9d6f5301e41 P d7def43826924f03b8858383f0dc69f4 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b1daf23b3538498bb795a60d627b6ac0 in term 2.
I20260709 13:09:29.282356 30475 leader_election.cc:290] T b90351987d7741299d85cc7599d58d07 P b1daf23b3538498bb795a60d627b6ac0 [CANDIDATE]: Term 2 election: Requested vote from peers d7def43826924f03b8858383f0dc69f4 (127.17.223.2:40053), eaa6f3dc13d643b9acfd8df1263a456d (127.17.223.3:41395)
I20260709 13:09:29.282878 30439 leader_election.cc:304] T 7ce7118b2aff46f38de8e9d6f5301e41 P b1daf23b3538498bb795a60d627b6ac0 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b1daf23b3538498bb795a60d627b6ac0, d7def43826924f03b8858383f0dc69f4; no voters: 
I20260709 13:09:29.282408 30623 raft_consensus.cc:2468] T 7ce7118b2aff46f38de8e9d6f5301e41 P eaa6f3dc13d643b9acfd8df1263a456d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b1daf23b3538498bb795a60d627b6ac0 in term 2.
I20260709 13:09:29.283066 30549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b90351987d7741299d85cc7599d58d07" candidate_uuid: "b1daf23b3538498bb795a60d627b6ac0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d7def43826924f03b8858383f0dc69f4"
I20260709 13:09:29.283828 30549 raft_consensus.cc:3060] T b90351987d7741299d85cc7599d58d07 P d7def43826924f03b8858383f0dc69f4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:29.284001 30625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b90351987d7741299d85cc7599d58d07" candidate_uuid: "b1daf23b3538498bb795a60d627b6ac0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "eaa6f3dc13d643b9acfd8df1263a456d"
I20260709 13:09:29.283707 30836 raft_consensus.cc:2804] T 7ce7118b2aff46f38de8e9d6f5301e41 P b1daf23b3538498bb795a60d627b6ac0 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:09:29.284646 30625 raft_consensus.cc:3055] T b90351987d7741299d85cc7599d58d07 P eaa6f3dc13d643b9acfd8df1263a456d [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:09:29.284758 30836 raft_consensus.cc:697] T 7ce7118b2aff46f38de8e9d6f5301e41 P b1daf23b3538498bb795a60d627b6ac0 [term 2 LEADER]: Becoming Leader. State: Replica: b1daf23b3538498bb795a60d627b6ac0, State: Running, Role: LEADER
I20260709 13:09:29.285025 30625 raft_consensus.cc:740] T b90351987d7741299d85cc7599d58d07 P eaa6f3dc13d643b9acfd8df1263a456d [term 1 LEADER]: Becoming Follower/Learner. State: Replica: eaa6f3dc13d643b9acfd8df1263a456d, State: Running, Role: LEADER
I20260709 13:09:29.285678 30836 consensus_queue.cc:237] T 7ce7118b2aff46f38de8e9d6f5301e41 P b1daf23b3538498bb795a60d627b6ac0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1daf23b3538498bb795a60d627b6ac0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 36109 } } peers { permanent_uuid: "d7def43826924f03b8858383f0dc69f4" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 40053 } } peers { permanent_uuid: "eaa6f3dc13d643b9acfd8df1263a456d" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 41395 } }
I20260709 13:09:29.285851 30625 consensus_queue.cc:260] T b90351987d7741299d85cc7599d58d07 P eaa6f3dc13d643b9acfd8df1263a456d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1daf23b3538498bb795a60d627b6ac0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 36109 } } peers { permanent_uuid: "d7def43826924f03b8858383f0dc69f4" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 40053 } } peers { permanent_uuid: "eaa6f3dc13d643b9acfd8df1263a456d" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 41395 } }
I20260709 13:09:29.289309 30549 raft_consensus.cc:2468] T b90351987d7741299d85cc7599d58d07 P d7def43826924f03b8858383f0dc69f4 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b1daf23b3538498bb795a60d627b6ac0 in term 2.
I20260709 13:09:29.290932 30625 raft_consensus.cc:3060] T b90351987d7741299d85cc7599d58d07 P eaa6f3dc13d643b9acfd8df1263a456d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:29.292536 30828 raft_consensus.cc:993] T 035d977bcb604138a0c5e70d38013012 P b1daf23b3538498bb795a60d627b6ac0: : Instructing follower d7def43826924f03b8858383f0dc69f4 to start an election
I20260709 13:09:29.292582 30439 leader_election.cc:304] T b90351987d7741299d85cc7599d58d07 P b1daf23b3538498bb795a60d627b6ac0 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b1daf23b3538498bb795a60d627b6ac0, d7def43826924f03b8858383f0dc69f4; no voters: 
I20260709 13:09:29.293048 30828 raft_consensus.cc:1081] T 035d977bcb604138a0c5e70d38013012 P b1daf23b3538498bb795a60d627b6ac0 [term 2 LEADER]: Signalling peer d7def43826924f03b8858383f0dc69f4 to start an election
I20260709 13:09:29.293581 30836 raft_consensus.cc:2804] T b90351987d7741299d85cc7599d58d07 P b1daf23b3538498bb795a60d627b6ac0 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:09:29.294034 30836 raft_consensus.cc:697] T b90351987d7741299d85cc7599d58d07 P b1daf23b3538498bb795a60d627b6ac0 [term 2 LEADER]: Becoming Leader. State: Replica: b1daf23b3538498bb795a60d627b6ac0, State: Running, Role: LEADER
I20260709 13:09:29.294920 30549 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "035d977bcb604138a0c5e70d38013012"
dest_uuid: "d7def43826924f03b8858383f0dc69f4"
 from {username='slave'} at 127.0.0.1:52294
I20260709 13:09:29.294822 30836 consensus_queue.cc:237] T b90351987d7741299d85cc7599d58d07 P b1daf23b3538498bb795a60d627b6ac0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1daf23b3538498bb795a60d627b6ac0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 36109 } } peers { permanent_uuid: "d7def43826924f03b8858383f0dc69f4" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 40053 } } peers { permanent_uuid: "eaa6f3dc13d643b9acfd8df1263a456d" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 41395 } }
I20260709 13:09:29.295461 30549 raft_consensus.cc:493] T 035d977bcb604138a0c5e70d38013012 P d7def43826924f03b8858383f0dc69f4 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:09:29.295849 30549 raft_consensus.cc:3060] T 035d977bcb604138a0c5e70d38013012 P d7def43826924f03b8858383f0dc69f4 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:29.295759 30370 catalog_manager.cc:5697] T 7ce7118b2aff46f38de8e9d6f5301e41 P b1daf23b3538498bb795a60d627b6ac0 reported cstate change: term changed from 1 to 2, leader changed from eaa6f3dc13d643b9acfd8df1263a456d (127.17.223.3) to b1daf23b3538498bb795a60d627b6ac0 (127.17.223.1). New cstate: current_term: 2 leader_uuid: "b1daf23b3538498bb795a60d627b6ac0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1daf23b3538498bb795a60d627b6ac0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 36109 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d7def43826924f03b8858383f0dc69f4" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 40053 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "eaa6f3dc13d643b9acfd8df1263a456d" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 41395 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:29.298131 30625 raft_consensus.cc:2468] T b90351987d7741299d85cc7599d58d07 P eaa6f3dc13d643b9acfd8df1263a456d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b1daf23b3538498bb795a60d627b6ac0 in term 2.
I20260709 13:09:29.302099 30549 raft_consensus.cc:515] T 035d977bcb604138a0c5e70d38013012 P d7def43826924f03b8858383f0dc69f4 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1daf23b3538498bb795a60d627b6ac0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 36109 } } peers { permanent_uuid: "d7def43826924f03b8858383f0dc69f4" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 40053 } } peers { permanent_uuid: "eaa6f3dc13d643b9acfd8df1263a456d" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 41395 } }
I20260709 13:09:29.303789 30549 leader_election.cc:290] T 035d977bcb604138a0c5e70d38013012 P d7def43826924f03b8858383f0dc69f4 [CANDIDATE]: Term 3 election: Requested vote from peers b1daf23b3538498bb795a60d627b6ac0 (127.17.223.1:36109), eaa6f3dc13d643b9acfd8df1263a456d (127.17.223.3:41395)
I20260709 13:09:29.304832 30475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "035d977bcb604138a0c5e70d38013012" candidate_uuid: "d7def43826924f03b8858383f0dc69f4" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: true dest_uuid: "b1daf23b3538498bb795a60d627b6ac0"
I20260709 13:09:29.304852 30625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "035d977bcb604138a0c5e70d38013012" candidate_uuid: "d7def43826924f03b8858383f0dc69f4" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: true dest_uuid: "eaa6f3dc13d643b9acfd8df1263a456d"
I20260709 13:09:29.305461 30475 raft_consensus.cc:3055] T 035d977bcb604138a0c5e70d38013012 P b1daf23b3538498bb795a60d627b6ac0 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:09:29.305837 30625 raft_consensus.cc:3060] T 035d977bcb604138a0c5e70d38013012 P eaa6f3dc13d643b9acfd8df1263a456d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:29.305830 30475 raft_consensus.cc:740] T 035d977bcb604138a0c5e70d38013012 P b1daf23b3538498bb795a60d627b6ac0 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: b1daf23b3538498bb795a60d627b6ac0, State: Running, Role: LEADER
I20260709 13:09:29.306895 30475 consensus_queue.cc:260] T 035d977bcb604138a0c5e70d38013012 P b1daf23b3538498bb795a60d627b6ac0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1daf23b3538498bb795a60d627b6ac0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 36109 } } peers { permanent_uuid: "d7def43826924f03b8858383f0dc69f4" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 40053 } } peers { permanent_uuid: "eaa6f3dc13d643b9acfd8df1263a456d" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 41395 } }
I20260709 13:09:29.307960 30851 raft_consensus.cc:993] T 93f7bd85158a4f47aabfeb6b20b664e7 P b1daf23b3538498bb795a60d627b6ac0: : Instructing follower eaa6f3dc13d643b9acfd8df1263a456d to start an election
I20260709 13:09:29.308140 30475 raft_consensus.cc:3060] T 035d977bcb604138a0c5e70d38013012 P b1daf23b3538498bb795a60d627b6ac0 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:29.308486 30836 raft_consensus.cc:1081] T 93f7bd85158a4f47aabfeb6b20b664e7 P b1daf23b3538498bb795a60d627b6ac0 [term 1 LEADER]: Signalling peer eaa6f3dc13d643b9acfd8df1263a456d to start an election
I20260709 13:09:29.310088 30623 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "93f7bd85158a4f47aabfeb6b20b664e7"
dest_uuid: "eaa6f3dc13d643b9acfd8df1263a456d"
 from {username='slave'} at 127.0.0.1:37548
I20260709 13:09:29.310706 30623 raft_consensus.cc:493] T 93f7bd85158a4f47aabfeb6b20b664e7 P eaa6f3dc13d643b9acfd8df1263a456d [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:09:29.311106 30623 raft_consensus.cc:3060] T 93f7bd85158a4f47aabfeb6b20b664e7 P eaa6f3dc13d643b9acfd8df1263a456d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:29.311962 30625 raft_consensus.cc:2468] T 035d977bcb604138a0c5e70d38013012 P eaa6f3dc13d643b9acfd8df1263a456d [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d7def43826924f03b8858383f0dc69f4 in term 3.
I20260709 13:09:29.313024 30514 leader_election.cc:304] T 035d977bcb604138a0c5e70d38013012 P d7def43826924f03b8858383f0dc69f4 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d7def43826924f03b8858383f0dc69f4, eaa6f3dc13d643b9acfd8df1263a456d; no voters: 
I20260709 13:09:29.313661 30764 raft_consensus.cc:2804] T 035d977bcb604138a0c5e70d38013012 P d7def43826924f03b8858383f0dc69f4 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:09:29.314085 30764 raft_consensus.cc:697] T 035d977bcb604138a0c5e70d38013012 P d7def43826924f03b8858383f0dc69f4 [term 3 LEADER]: Becoming Leader. State: Replica: d7def43826924f03b8858383f0dc69f4, State: Running, Role: LEADER
I20260709 13:09:29.314602 30475 raft_consensus.cc:2468] T 035d977bcb604138a0c5e70d38013012 P b1daf23b3538498bb795a60d627b6ac0 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d7def43826924f03b8858383f0dc69f4 in term 3.
I20260709 13:09:29.314889 30764 consensus_queue.cc:237] T 035d977bcb604138a0c5e70d38013012 P d7def43826924f03b8858383f0dc69f4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1daf23b3538498bb795a60d627b6ac0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 36109 } } peers { permanent_uuid: "d7def43826924f03b8858383f0dc69f4" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 40053 } } peers { permanent_uuid: "eaa6f3dc13d643b9acfd8df1263a456d" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 41395 } }
I20260709 13:09:29.317991 30623 raft_consensus.cc:515] T 93f7bd85158a4f47aabfeb6b20b664e7 P eaa6f3dc13d643b9acfd8df1263a456d [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1daf23b3538498bb795a60d627b6ac0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 36109 } } peers { permanent_uuid: "d7def43826924f03b8858383f0dc69f4" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 40053 } } peers { permanent_uuid: "eaa6f3dc13d643b9acfd8df1263a456d" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 41395 } }
I20260709 13:09:29.320073 30623 leader_election.cc:290] T 93f7bd85158a4f47aabfeb6b20b664e7 P eaa6f3dc13d643b9acfd8df1263a456d [CANDIDATE]: Term 2 election: Requested vote from peers b1daf23b3538498bb795a60d627b6ac0 (127.17.223.1:36109), d7def43826924f03b8858383f0dc69f4 (127.17.223.2:40053)
I20260709 13:09:29.321308 30370 catalog_manager.cc:5697] T b90351987d7741299d85cc7599d58d07 P b1daf23b3538498bb795a60d627b6ac0 reported cstate change: term changed from 1 to 2, leader changed from eaa6f3dc13d643b9acfd8df1263a456d (127.17.223.3) to b1daf23b3538498bb795a60d627b6ac0 (127.17.223.1). New cstate: current_term: 2 leader_uuid: "b1daf23b3538498bb795a60d627b6ac0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1daf23b3538498bb795a60d627b6ac0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 36109 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d7def43826924f03b8858383f0dc69f4" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 40053 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "eaa6f3dc13d643b9acfd8df1263a456d" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 41395 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:29.322213 30549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93f7bd85158a4f47aabfeb6b20b664e7" candidate_uuid: "eaa6f3dc13d643b9acfd8df1263a456d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d7def43826924f03b8858383f0dc69f4"
I20260709 13:09:29.322909 30549 raft_consensus.cc:3060] T 93f7bd85158a4f47aabfeb6b20b664e7 P d7def43826924f03b8858383f0dc69f4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:29.322997 30475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93f7bd85158a4f47aabfeb6b20b664e7" candidate_uuid: "eaa6f3dc13d643b9acfd8df1263a456d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b1daf23b3538498bb795a60d627b6ac0"
I20260709 13:09:29.324009 30475 raft_consensus.cc:3055] T 93f7bd85158a4f47aabfeb6b20b664e7 P b1daf23b3538498bb795a60d627b6ac0 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:09:29.324288 30475 raft_consensus.cc:740] T 93f7bd85158a4f47aabfeb6b20b664e7 P b1daf23b3538498bb795a60d627b6ac0 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b1daf23b3538498bb795a60d627b6ac0, State: Running, Role: LEADER
I20260709 13:09:29.324985 30475 consensus_queue.cc:260] T 93f7bd85158a4f47aabfeb6b20b664e7 P b1daf23b3538498bb795a60d627b6ac0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1daf23b3538498bb795a60d627b6ac0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 36109 } } peers { permanent_uuid: "d7def43826924f03b8858383f0dc69f4" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 40053 } } peers { permanent_uuid: "eaa6f3dc13d643b9acfd8df1263a456d" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 41395 } }
I20260709 13:09:29.326100 30475 raft_consensus.cc:3060] T 93f7bd85158a4f47aabfeb6b20b664e7 P b1daf23b3538498bb795a60d627b6ac0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:29.328998 30549 raft_consensus.cc:2468] T 93f7bd85158a4f47aabfeb6b20b664e7 P d7def43826924f03b8858383f0dc69f4 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eaa6f3dc13d643b9acfd8df1263a456d in term 2.
I20260709 13:09:29.330097 30588 leader_election.cc:304] T 93f7bd85158a4f47aabfeb6b20b664e7 P eaa6f3dc13d643b9acfd8df1263a456d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d7def43826924f03b8858383f0dc69f4, eaa6f3dc13d643b9acfd8df1263a456d; no voters: 
I20260709 13:09:29.329972 30374 catalog_manager.cc:5697] T 035d977bcb604138a0c5e70d38013012 P d7def43826924f03b8858383f0dc69f4 reported cstate change: term changed from 2 to 3, leader changed from b1daf23b3538498bb795a60d627b6ac0 (127.17.223.1) to d7def43826924f03b8858383f0dc69f4 (127.17.223.2). New cstate: current_term: 3 leader_uuid: "d7def43826924f03b8858383f0dc69f4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1daf23b3538498bb795a60d627b6ac0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 36109 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d7def43826924f03b8858383f0dc69f4" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 40053 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "eaa6f3dc13d643b9acfd8df1263a456d" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 41395 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:29.330806 30845 raft_consensus.cc:2804] T 93f7bd85158a4f47aabfeb6b20b664e7 P eaa6f3dc13d643b9acfd8df1263a456d [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:09:29.331230 30845 raft_consensus.cc:697] T 93f7bd85158a4f47aabfeb6b20b664e7 P eaa6f3dc13d643b9acfd8df1263a456d [term 2 LEADER]: Becoming Leader. State: Replica: eaa6f3dc13d643b9acfd8df1263a456d, State: Running, Role: LEADER
I20260709 13:09:29.331837 30475 raft_consensus.cc:2468] T 93f7bd85158a4f47aabfeb6b20b664e7 P b1daf23b3538498bb795a60d627b6ac0 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eaa6f3dc13d643b9acfd8df1263a456d in term 2.
I20260709 13:09:29.331856 30845 consensus_queue.cc:237] T 93f7bd85158a4f47aabfeb6b20b664e7 P eaa6f3dc13d643b9acfd8df1263a456d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1daf23b3538498bb795a60d627b6ac0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 36109 } } peers { permanent_uuid: "d7def43826924f03b8858383f0dc69f4" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 40053 } } peers { permanent_uuid: "eaa6f3dc13d643b9acfd8df1263a456d" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 41395 } }
I20260709 13:09:29.341445 30370 catalog_manager.cc:5697] T 93f7bd85158a4f47aabfeb6b20b664e7 P eaa6f3dc13d643b9acfd8df1263a456d reported cstate change: term changed from 1 to 2, leader changed from b1daf23b3538498bb795a60d627b6ac0 (127.17.223.1) to eaa6f3dc13d643b9acfd8df1263a456d (127.17.223.3). New cstate: current_term: 2 leader_uuid: "eaa6f3dc13d643b9acfd8df1263a456d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1daf23b3538498bb795a60d627b6ac0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 36109 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d7def43826924f03b8858383f0dc69f4" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 40053 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "eaa6f3dc13d643b9acfd8df1263a456d" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 41395 } health_report { overall_health: HEALTHY } } }
I20260709 13:09:29.347421 30549 raft_consensus.cc:1275] T 052373021b584e2e84d1d9dee352aebd P d7def43826924f03b8858383f0dc69f4 [term 2 FOLLOWER]: Refusing update from remote peer b1daf23b3538498bb795a60d627b6ac0: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:29.348845 30836 consensus_queue.cc:1048] T 052373021b584e2e84d1d9dee352aebd P b1daf23b3538498bb795a60d627b6ac0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7def43826924f03b8858383f0dc69f4" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 40053 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:09:29.360275 30623 raft_consensus.cc:1275] T 052373021b584e2e84d1d9dee352aebd P eaa6f3dc13d643b9acfd8df1263a456d [term 2 FOLLOWER]: Refusing update from remote peer b1daf23b3538498bb795a60d627b6ac0: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:29.361907 30836 consensus_queue.cc:1048] T 052373021b584e2e84d1d9dee352aebd P b1daf23b3538498bb795a60d627b6ac0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eaa6f3dc13d643b9acfd8df1263a456d" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 41395 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:09:29.516271 30623 raft_consensus.cc:1275] T 19335986fe9c4f738db226a45653127a P eaa6f3dc13d643b9acfd8df1263a456d [term 2 FOLLOWER]: Refusing update from remote peer d7def43826924f03b8858383f0dc69f4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:29.517470 30764 consensus_queue.cc:1048] T 19335986fe9c4f738db226a45653127a P d7def43826924f03b8858383f0dc69f4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eaa6f3dc13d643b9acfd8df1263a456d" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 41395 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:09:29.529614 30475 raft_consensus.cc:1275] T 19335986fe9c4f738db226a45653127a P b1daf23b3538498bb795a60d627b6ac0 [term 2 FOLLOWER]: Refusing update from remote peer d7def43826924f03b8858383f0dc69f4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:29.531188 30840 consensus_queue.cc:1048] T 19335986fe9c4f738db226a45653127a P d7def43826924f03b8858383f0dc69f4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1daf23b3538498bb795a60d627b6ac0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 36109 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:09:29.617035 30475 raft_consensus.cc:1275] T c9a02595d5e340be8cf9484066cf9cc7 P b1daf23b3538498bb795a60d627b6ac0 [term 2 FOLLOWER]: Refusing update from remote peer d7def43826924f03b8858383f0dc69f4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:29.618217 30840 consensus_queue.cc:1048] T c9a02595d5e340be8cf9484066cf9cc7 P d7def43826924f03b8858383f0dc69f4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1daf23b3538498bb795a60d627b6ac0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 36109 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:09:29.628147 30623 raft_consensus.cc:1275] T c9a02595d5e340be8cf9484066cf9cc7 P eaa6f3dc13d643b9acfd8df1263a456d [term 2 FOLLOWER]: Refusing update from remote peer d7def43826924f03b8858383f0dc69f4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:29.628927 30625 raft_consensus.cc:1275] T f657c3787a9d497f91e05a50c36622f2 P eaa6f3dc13d643b9acfd8df1263a456d [term 2 FOLLOWER]: Refusing update from remote peer b1daf23b3538498bb795a60d627b6ac0: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:29.629949 30764 consensus_queue.cc:1048] T c9a02595d5e340be8cf9484066cf9cc7 P d7def43826924f03b8858383f0dc69f4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eaa6f3dc13d643b9acfd8df1263a456d" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 41395 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:09:29.630801 30828 consensus_queue.cc:1048] T f657c3787a9d497f91e05a50c36622f2 P b1daf23b3538498bb795a60d627b6ac0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eaa6f3dc13d643b9acfd8df1263a456d" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 41395 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:09:29.633522 30549 raft_consensus.cc:1275] T f657c3787a9d497f91e05a50c36622f2 P d7def43826924f03b8858383f0dc69f4 [term 2 FOLLOWER]: Refusing update from remote peer b1daf23b3538498bb795a60d627b6ac0: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:29.634984 30851 consensus_queue.cc:1048] T f657c3787a9d497f91e05a50c36622f2 P b1daf23b3538498bb795a60d627b6ac0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7def43826924f03b8858383f0dc69f4" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 40053 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:09:29.762044 30549 raft_consensus.cc:1275] T 7ce7118b2aff46f38de8e9d6f5301e41 P d7def43826924f03b8858383f0dc69f4 [term 2 FOLLOWER]: Refusing update from remote peer b1daf23b3538498bb795a60d627b6ac0: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:29.763201 30828 consensus_queue.cc:1048] T 7ce7118b2aff46f38de8e9d6f5301e41 P b1daf23b3538498bb795a60d627b6ac0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7def43826924f03b8858383f0dc69f4" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 40053 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:09:29.772876 30623 raft_consensus.cc:1275] T 7ce7118b2aff46f38de8e9d6f5301e41 P eaa6f3dc13d643b9acfd8df1263a456d [term 2 FOLLOWER]: Refusing update from remote peer b1daf23b3538498bb795a60d627b6ac0: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:29.774544 30851 consensus_queue.cc:1048] T 7ce7118b2aff46f38de8e9d6f5301e41 P b1daf23b3538498bb795a60d627b6ac0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eaa6f3dc13d643b9acfd8df1263a456d" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 41395 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:09:29.828472 30475 raft_consensus.cc:1275] T 93f7bd85158a4f47aabfeb6b20b664e7 P b1daf23b3538498bb795a60d627b6ac0 [term 2 FOLLOWER]: Refusing update from remote peer eaa6f3dc13d643b9acfd8df1263a456d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:29.829854 30845 consensus_queue.cc:1048] T 93f7bd85158a4f47aabfeb6b20b664e7 P eaa6f3dc13d643b9acfd8df1263a456d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1daf23b3538498bb795a60d627b6ac0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 36109 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:09:29.839874 30549 raft_consensus.cc:1275] T 93f7bd85158a4f47aabfeb6b20b664e7 P d7def43826924f03b8858383f0dc69f4 [term 2 FOLLOWER]: Refusing update from remote peer eaa6f3dc13d643b9acfd8df1263a456d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:29.841185 30869 consensus_queue.cc:1048] T 93f7bd85158a4f47aabfeb6b20b664e7 P eaa6f3dc13d643b9acfd8df1263a456d [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7def43826924f03b8858383f0dc69f4" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 40053 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:09:29.858862 30625 raft_consensus.cc:1275] T 035d977bcb604138a0c5e70d38013012 P eaa6f3dc13d643b9acfd8df1263a456d [term 3 FOLLOWER]: Refusing update from remote peer d7def43826924f03b8858383f0dc69f4: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:09:29.860181 30764 consensus_queue.cc:1048] T 035d977bcb604138a0c5e70d38013012 P d7def43826924f03b8858383f0dc69f4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eaa6f3dc13d643b9acfd8df1263a456d" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 41395 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:09:29.869247 30475 raft_consensus.cc:1275] T 035d977bcb604138a0c5e70d38013012 P b1daf23b3538498bb795a60d627b6ac0 [term 3 FOLLOWER]: Refusing update from remote peer d7def43826924f03b8858383f0dc69f4: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:09:29.871623 30840 consensus_queue.cc:1048] T 035d977bcb604138a0c5e70d38013012 P d7def43826924f03b8858383f0dc69f4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1daf23b3538498bb795a60d627b6ac0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 36109 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:09:29.913585 30549 raft_consensus.cc:1275] T b90351987d7741299d85cc7599d58d07 P d7def43826924f03b8858383f0dc69f4 [term 2 FOLLOWER]: Refusing update from remote peer b1daf23b3538498bb795a60d627b6ac0: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:29.914839 30828 consensus_queue.cc:1048] T b90351987d7741299d85cc7599d58d07 P b1daf23b3538498bb795a60d627b6ac0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7def43826924f03b8858383f0dc69f4" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 40053 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:09:29.917303 30623 raft_consensus.cc:1275] T b90351987d7741299d85cc7599d58d07 P eaa6f3dc13d643b9acfd8df1263a456d [term 2 FOLLOWER]: Refusing update from remote peer b1daf23b3538498bb795a60d627b6ac0: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:29.918577 30828 consensus_queue.cc:1048] T b90351987d7741299d85cc7599d58d07 P b1daf23b3538498bb795a60d627b6ac0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eaa6f3dc13d643b9acfd8df1263a456d" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 41395 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:09:31.917544 30372 catalog_manager.cc:2533] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:52772:
table { table_name: "soft_deleted_table" } modify_external_catalogs: true reserve_seconds: 3600
I20260709 13:09:31.941675 30372 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:52772:
table { table_name: "soft_deleted_table" } new_extra_configs { key: "kudu.table.disable_compaction" value: "true" }
I20260709 13:09:31.996064 18300 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:09:32.059234 30905 tablet.cc:1724] T b90351987d7741299d85cc7599d58d07 P b1daf23b3538498bb795a60d627b6ac0: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 13:09:32.110330 30514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.1:36109, user_credentials={real_user=slave}} blocked reactor thread for 85791.3us
W20260709 13:09:32.146687 30904 log.cc:927] Time spent T f657c3787a9d497f91e05a50c36622f2 P eaa6f3dc13d643b9acfd8df1263a456d: Append to log took a long time: real 0.064s	user 0.000s	sys 0.001s
I20260709 13:09:32.169965 30909 tablet.cc:1724] T b90351987d7741299d85cc7599d58d07 P d7def43826924f03b8858383f0dc69f4: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:09:32.205056 30923 tablet.cc:1724] T 19335986fe9c4f738db226a45653127a P d7def43826924f03b8858383f0dc69f4: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 13:09:32.271039 30908 log.cc:927] Time spent T b90351987d7741299d85cc7599d58d07 P eaa6f3dc13d643b9acfd8df1263a456d: Append to log took a long time: real 0.114s	user 0.000s	sys 0.001s
I20260709 13:09:32.273123 30547 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "687db47721c34eb3918dc02f98170722"
dest_uuid: "d7def43826924f03b8858383f0dc69f4"
mode: GRACEFUL
new_leader_uuid: "eaa6f3dc13d643b9acfd8df1263a456d"
 from {username='slave'} at 127.0.0.1:37132
I20260709 13:09:32.274358 30547 raft_consensus.cc:606] T 687db47721c34eb3918dc02f98170722 P d7def43826924f03b8858383f0dc69f4 [term 1 LEADER]: Received request to transfer leadership to TS eaa6f3dc13d643b9acfd8df1263a456d
W20260709 13:09:32.270987 30919 log.cc:927] Time spent T 035d977bcb604138a0c5e70d38013012 P d7def43826924f03b8858383f0dc69f4: Append to log took a long time: real 0.057s	user 0.001s	sys 0.000s
I20260709 13:09:32.317046 30930 tablet.cc:1724] T c9a02595d5e340be8cf9484066cf9cc7 P d7def43826924f03b8858383f0dc69f4: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 13:09:32.358285 30514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.223.3:41395, user_credentials={real_user=slave}} blocked reactor thread for 95766.4us
I20260709 13:09:32.339879 30372 catalog_manager.cc:5789] TS b1daf23b3538498bb795a60d627b6ac0 (127.17.223.1:36109) does not have the latest schema for tablet f657c3787a9d497f91e05a50c36622f2 (table soft_deleted_table [id=65e66abd0d394269850b2b2e733a3169]). Expected version 1 got 0
I20260709 13:09:32.365597 30372 catalog_manager.cc:5789] TS b1daf23b3538498bb795a60d627b6ac0 (127.17.223.1:36109) does not have the latest schema for tablet 7ce7118b2aff46f38de8e9d6f5301e41 (table soft_deleted_table [id=65e66abd0d394269850b2b2e733a3169]). Expected version 1 got 0
W20260709 13:09:32.373617 30924 log.cc:927] Time spent T 93f7bd85158a4f47aabfeb6b20b664e7 P d7def43826924f03b8858383f0dc69f4: Append to log took a long time: real 0.123s	user 0.000s	sys 0.001s
I20260709 13:09:32.372960 30937 tablet.cc:1724] T 93f7bd85158a4f47aabfeb6b20b664e7 P eaa6f3dc13d643b9acfd8df1263a456d: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 13:09:32.379552 30918 log.cc:927] Time spent T 905b37e519a4428995623c0c8357fc0f P eaa6f3dc13d643b9acfd8df1263a456d: Append to log took a long time: real 0.138s	user 0.000s	sys 0.001s
I20260709 13:09:32.382627 30905 tablet.cc:1724] T 052373021b584e2e84d1d9dee352aebd P b1daf23b3538498bb795a60d627b6ac0: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:09:32.386605 30925 tablet.cc:1724] T 19335986fe9c4f738db226a45653127a P eaa6f3dc13d643b9acfd8df1263a456d: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:09:32.391821 30938 tablet.cc:1724] T 93f7bd85158a4f47aabfeb6b20b664e7 P b1daf23b3538498bb795a60d627b6ac0: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:09:32.396817 30933 tablet.cc:1724] T c9a02595d5e340be8cf9484066cf9cc7 P eaa6f3dc13d643b9acfd8df1263a456d: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:09:32.400183 30942 tablet.cc:1724] T 19335986fe9c4f738db226a45653127a P b1daf23b3538498bb795a60d627b6ac0: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:09:32.403998 30931 tablet.cc:1724] T f657c3787a9d497f91e05a50c36622f2 P b1daf23b3538498bb795a60d627b6ac0: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:09:32.407328 30941 tablet.cc:1724] T 052373021b584e2e84d1d9dee352aebd P d7def43826924f03b8858383f0dc69f4: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:09:32.432315 30909 tablet.cc:1724] T f657c3787a9d497f91e05a50c36622f2 P d7def43826924f03b8858383f0dc69f4: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:09:32.460950 30370 catalog_manager.cc:5789] TS d7def43826924f03b8858383f0dc69f4 (127.17.223.2:40053) does not have the latest schema for tablet 035d977bcb604138a0c5e70d38013012 (table soft_deleted_table [id=65e66abd0d394269850b2b2e733a3169]). Expected version 1 got 0
I20260709 13:09:32.473183 30938 tablet.cc:1724] T 7ce7118b2aff46f38de8e9d6f5301e41 P b1daf23b3538498bb795a60d627b6ac0: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:09:32.476631 30930 tablet.cc:1724] T 905b37e519a4428995623c0c8357fc0f P d7def43826924f03b8858383f0dc69f4: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:09:32.477567 30946 tablet.cc:1724] T f657c3787a9d497f91e05a50c36622f2 P eaa6f3dc13d643b9acfd8df1263a456d: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:09:32.484912 30905 tablet.cc:1724] T c9a02595d5e340be8cf9484066cf9cc7 P b1daf23b3538498bb795a60d627b6ac0: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:09:32.487812 30840 raft_consensus.cc:993] T 687db47721c34eb3918dc02f98170722 P d7def43826924f03b8858383f0dc69f4: : Instructing follower eaa6f3dc13d643b9acfd8df1263a456d to start an election
I20260709 13:09:32.491523 30937 tablet.cc:1724] T b90351987d7741299d85cc7599d58d07 P eaa6f3dc13d643b9acfd8df1263a456d: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:09:32.499536 30840 raft_consensus.cc:1081] T 687db47721c34eb3918dc02f98170722 P d7def43826924f03b8858383f0dc69f4 [term 1 LEADER]: Signalling peer eaa6f3dc13d643b9acfd8df1263a456d to start an election
I20260709 13:09:32.503913 30933 tablet.cc:1724] T 7ce7118b2aff46f38de8e9d6f5301e41 P eaa6f3dc13d643b9acfd8df1263a456d: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:09:32.506177 30620 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "687db47721c34eb3918dc02f98170722"
dest_uuid: "eaa6f3dc13d643b9acfd8df1263a456d"
 from {username='slave'} at 127.0.0.1:37536
I20260709 13:09:32.506906 30620 raft_consensus.cc:493] T 687db47721c34eb3918dc02f98170722 P eaa6f3dc13d643b9acfd8df1263a456d [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:09:32.507346 30620 raft_consensus.cc:3060] T 687db47721c34eb3918dc02f98170722 P eaa6f3dc13d643b9acfd8df1263a456d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:32.507751 30931 tablet.cc:1724] T 035d977bcb604138a0c5e70d38013012 P b1daf23b3538498bb795a60d627b6ac0: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:09:32.497133 30923 tablet.cc:1724] T 035d977bcb604138a0c5e70d38013012 P d7def43826924f03b8858383f0dc69f4: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:09:32.532851 30941 tablet.cc:1724] T 93f7bd85158a4f47aabfeb6b20b664e7 P d7def43826924f03b8858383f0dc69f4: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:09:32.534583 30930 tablet.cc:1724] T 7ce7118b2aff46f38de8e9d6f5301e41 P d7def43826924f03b8858383f0dc69f4: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:09:32.526268 30620 raft_consensus.cc:515] T 687db47721c34eb3918dc02f98170722 P eaa6f3dc13d643b9acfd8df1263a456d [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1daf23b3538498bb795a60d627b6ac0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 36109 } } peers { permanent_uuid: "d7def43826924f03b8858383f0dc69f4" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 40053 } } peers { permanent_uuid: "eaa6f3dc13d643b9acfd8df1263a456d" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 41395 } }
I20260709 13:09:32.473623 30942 tablet.cc:1724] T 905b37e519a4428995623c0c8357fc0f P b1daf23b3538498bb795a60d627b6ac0: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:09:32.540153 30620 leader_election.cc:290] T 687db47721c34eb3918dc02f98170722 P eaa6f3dc13d643b9acfd8df1263a456d [CANDIDATE]: Term 2 election: Requested vote from peers b1daf23b3538498bb795a60d627b6ac0 (127.17.223.1:36109), d7def43826924f03b8858383f0dc69f4 (127.17.223.2:40053)
I20260709 13:09:32.541215 30551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "687db47721c34eb3918dc02f98170722" candidate_uuid: "eaa6f3dc13d643b9acfd8df1263a456d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d7def43826924f03b8858383f0dc69f4"
I20260709 13:09:32.542044 30551 raft_consensus.cc:3055] T 687db47721c34eb3918dc02f98170722 P d7def43826924f03b8858383f0dc69f4 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:09:32.541571 30946 tablet.cc:1724] T 905b37e519a4428995623c0c8357fc0f P eaa6f3dc13d643b9acfd8df1263a456d: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:09:32.542430 30551 raft_consensus.cc:740] T 687db47721c34eb3918dc02f98170722 P d7def43826924f03b8858383f0dc69f4 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: d7def43826924f03b8858383f0dc69f4, State: Running, Role: LEADER
I20260709 13:09:32.543545 30551 consensus_queue.cc:260] T 687db47721c34eb3918dc02f98170722 P d7def43826924f03b8858383f0dc69f4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1daf23b3538498bb795a60d627b6ac0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 36109 } } peers { permanent_uuid: "d7def43826924f03b8858383f0dc69f4" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 40053 } } peers { permanent_uuid: "eaa6f3dc13d643b9acfd8df1263a456d" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 41395 } }
I20260709 13:09:32.544956 30551 raft_consensus.cc:3060] T 687db47721c34eb3918dc02f98170722 P d7def43826924f03b8858383f0dc69f4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:32.540117 30472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "687db47721c34eb3918dc02f98170722" candidate_uuid: "eaa6f3dc13d643b9acfd8df1263a456d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b1daf23b3538498bb795a60d627b6ac0"
I20260709 13:09:32.548804 30472 raft_consensus.cc:3060] T 687db47721c34eb3918dc02f98170722 P b1daf23b3538498bb795a60d627b6ac0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:32.549595 30933 tablet.cc:1724] T 035d977bcb604138a0c5e70d38013012 P eaa6f3dc13d643b9acfd8df1263a456d: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:09:32.556797 30472 raft_consensus.cc:2468] T 687db47721c34eb3918dc02f98170722 P b1daf23b3538498bb795a60d627b6ac0 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eaa6f3dc13d643b9acfd8df1263a456d in term 2.
I20260709 13:09:32.561175 30588 leader_election.cc:304] T 687db47721c34eb3918dc02f98170722 P eaa6f3dc13d643b9acfd8df1263a456d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b1daf23b3538498bb795a60d627b6ac0, eaa6f3dc13d643b9acfd8df1263a456d; no voters: 
I20260709 13:09:32.562214 30874 raft_consensus.cc:2804] T 687db47721c34eb3918dc02f98170722 P eaa6f3dc13d643b9acfd8df1263a456d [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:09:32.562721 30874 raft_consensus.cc:697] T 687db47721c34eb3918dc02f98170722 P eaa6f3dc13d643b9acfd8df1263a456d [term 2 LEADER]: Becoming Leader. State: Replica: eaa6f3dc13d643b9acfd8df1263a456d, State: Running, Role: LEADER
I20260709 13:09:32.563680 30874 consensus_queue.cc:237] T 687db47721c34eb3918dc02f98170722 P eaa6f3dc13d643b9acfd8df1263a456d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1daf23b3538498bb795a60d627b6ac0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 36109 } } peers { permanent_uuid: "d7def43826924f03b8858383f0dc69f4" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 40053 } } peers { permanent_uuid: "eaa6f3dc13d643b9acfd8df1263a456d" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 41395 } }
I20260709 13:09:32.536427 30925 tablet.cc:1724] T 052373021b584e2e84d1d9dee352aebd P eaa6f3dc13d643b9acfd8df1263a456d: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:09:32.572630 30474 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f406da2fcdaa4facbd59848fdd5eeeb3"
dest_uuid: "b1daf23b3538498bb795a60d627b6ac0"
mode: GRACEFUL
new_leader_uuid: "eaa6f3dc13d643b9acfd8df1263a456d"
 from {username='slave'} at 127.0.0.1:50402
I20260709 13:09:32.577378 30551 raft_consensus.cc:2468] T 687db47721c34eb3918dc02f98170722 P d7def43826924f03b8858383f0dc69f4 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eaa6f3dc13d643b9acfd8df1263a456d in term 2.
I20260709 13:09:32.577526 30474 raft_consensus.cc:606] T f406da2fcdaa4facbd59848fdd5eeeb3 P b1daf23b3538498bb795a60d627b6ac0 [term 2 LEADER]: Received request to transfer leadership to TS eaa6f3dc13d643b9acfd8df1263a456d
I20260709 13:09:32.579473 18300 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 13:09:32.580109 18300 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:09:32.608865 30372 catalog_manager.cc:5697] T 687db47721c34eb3918dc02f98170722 P eaa6f3dc13d643b9acfd8df1263a456d reported cstate change: term changed from 1 to 2, leader changed from d7def43826924f03b8858383f0dc69f4 (127.17.223.2) to eaa6f3dc13d643b9acfd8df1263a456d (127.17.223.3). New cstate: current_term: 2 leader_uuid: "eaa6f3dc13d643b9acfd8df1263a456d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1daf23b3538498bb795a60d627b6ac0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 36109 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d7def43826924f03b8858383f0dc69f4" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 40053 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "eaa6f3dc13d643b9acfd8df1263a456d" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 41395 } health_report { overall_health: HEALTHY } } }
I20260709 13:09:32.615284 30370 catalog_manager.cc:6242] T 00000000000000000000000000000000 P 35ae1a007c404b71bd68dd0180693be7: soft_deleted_table [id=65e66abd0d394269850b2b2e733a3169] alter complete (version 1)
I20260709 13:09:32.954131 30551 raft_consensus.cc:1275] T 687db47721c34eb3918dc02f98170722 P d7def43826924f03b8858383f0dc69f4 [term 2 FOLLOWER]: Refusing update from remote peer eaa6f3dc13d643b9acfd8df1263a456d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:32.955384 30874 consensus_queue.cc:1048] T 687db47721c34eb3918dc02f98170722 P eaa6f3dc13d643b9acfd8df1263a456d [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7def43826924f03b8858383f0dc69f4" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 40053 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:09:32.964594 30472 raft_consensus.cc:1275] T 687db47721c34eb3918dc02f98170722 P b1daf23b3538498bb795a60d627b6ac0 [term 2 FOLLOWER]: Refusing update from remote peer eaa6f3dc13d643b9acfd8df1263a456d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:32.966161 30954 consensus_queue.cc:1048] T 687db47721c34eb3918dc02f98170722 P eaa6f3dc13d643b9acfd8df1263a456d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1daf23b3538498bb795a60d627b6ac0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 36109 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:09:33.069940 30916 raft_consensus.cc:993] T f406da2fcdaa4facbd59848fdd5eeeb3 P b1daf23b3538498bb795a60d627b6ac0: : Instructing follower eaa6f3dc13d643b9acfd8df1263a456d to start an election
I20260709 13:09:33.070482 30876 raft_consensus.cc:1081] T f406da2fcdaa4facbd59848fdd5eeeb3 P b1daf23b3538498bb795a60d627b6ac0 [term 2 LEADER]: Signalling peer eaa6f3dc13d643b9acfd8df1263a456d to start an election
I20260709 13:09:33.072033 30620 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f406da2fcdaa4facbd59848fdd5eeeb3"
dest_uuid: "eaa6f3dc13d643b9acfd8df1263a456d"
 from {username='slave'} at 127.0.0.1:37548
I20260709 13:09:33.072506 30620 raft_consensus.cc:493] T f406da2fcdaa4facbd59848fdd5eeeb3 P eaa6f3dc13d643b9acfd8df1263a456d [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:09:33.072809 30620 raft_consensus.cc:3060] T f406da2fcdaa4facbd59848fdd5eeeb3 P eaa6f3dc13d643b9acfd8df1263a456d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:33.078140 30620 raft_consensus.cc:515] T f406da2fcdaa4facbd59848fdd5eeeb3 P eaa6f3dc13d643b9acfd8df1263a456d [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1daf23b3538498bb795a60d627b6ac0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 36109 } } peers { permanent_uuid: "d7def43826924f03b8858383f0dc69f4" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 40053 } } peers { permanent_uuid: "eaa6f3dc13d643b9acfd8df1263a456d" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 41395 } }
I20260709 13:09:33.079923 30620 leader_election.cc:290] T f406da2fcdaa4facbd59848fdd5eeeb3 P eaa6f3dc13d643b9acfd8df1263a456d [CANDIDATE]: Term 3 election: Requested vote from peers b1daf23b3538498bb795a60d627b6ac0 (127.17.223.1:36109), d7def43826924f03b8858383f0dc69f4 (127.17.223.2:40053)
I20260709 13:09:33.081122 30551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f406da2fcdaa4facbd59848fdd5eeeb3" candidate_uuid: "eaa6f3dc13d643b9acfd8df1263a456d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "d7def43826924f03b8858383f0dc69f4"
I20260709 13:09:33.081416 30472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f406da2fcdaa4facbd59848fdd5eeeb3" candidate_uuid: "eaa6f3dc13d643b9acfd8df1263a456d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "b1daf23b3538498bb795a60d627b6ac0"
I20260709 13:09:33.081750 30551 raft_consensus.cc:3060] T f406da2fcdaa4facbd59848fdd5eeeb3 P d7def43826924f03b8858383f0dc69f4 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:33.082212 30472 raft_consensus.cc:3055] T f406da2fcdaa4facbd59848fdd5eeeb3 P b1daf23b3538498bb795a60d627b6ac0 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:09:33.082507 30472 raft_consensus.cc:740] T f406da2fcdaa4facbd59848fdd5eeeb3 P b1daf23b3538498bb795a60d627b6ac0 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: b1daf23b3538498bb795a60d627b6ac0, State: Running, Role: LEADER
I20260709 13:09:33.083307 30472 consensus_queue.cc:260] T f406da2fcdaa4facbd59848fdd5eeeb3 P b1daf23b3538498bb795a60d627b6ac0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1daf23b3538498bb795a60d627b6ac0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 36109 } } peers { permanent_uuid: "d7def43826924f03b8858383f0dc69f4" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 40053 } } peers { permanent_uuid: "eaa6f3dc13d643b9acfd8df1263a456d" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 41395 } }
I20260709 13:09:33.084354 30472 raft_consensus.cc:3060] T f406da2fcdaa4facbd59848fdd5eeeb3 P b1daf23b3538498bb795a60d627b6ac0 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:33.087124 30551 raft_consensus.cc:2468] T f406da2fcdaa4facbd59848fdd5eeeb3 P d7def43826924f03b8858383f0dc69f4 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eaa6f3dc13d643b9acfd8df1263a456d in term 3.
I20260709 13:09:33.088451 30588 leader_election.cc:304] T f406da2fcdaa4facbd59848fdd5eeeb3 P eaa6f3dc13d643b9acfd8df1263a456d [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d7def43826924f03b8858383f0dc69f4, eaa6f3dc13d643b9acfd8df1263a456d; no voters: 
I20260709 13:09:33.089278 30954 raft_consensus.cc:2804] T f406da2fcdaa4facbd59848fdd5eeeb3 P eaa6f3dc13d643b9acfd8df1263a456d [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:09:33.089706 30954 raft_consensus.cc:697] T f406da2fcdaa4facbd59848fdd5eeeb3 P eaa6f3dc13d643b9acfd8df1263a456d [term 3 LEADER]: Becoming Leader. State: Replica: eaa6f3dc13d643b9acfd8df1263a456d, State: Running, Role: LEADER
I20260709 13:09:33.089902 30472 raft_consensus.cc:2468] T f406da2fcdaa4facbd59848fdd5eeeb3 P b1daf23b3538498bb795a60d627b6ac0 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eaa6f3dc13d643b9acfd8df1263a456d in term 3.
I20260709 13:09:33.090595 30954 consensus_queue.cc:237] T f406da2fcdaa4facbd59848fdd5eeeb3 P eaa6f3dc13d643b9acfd8df1263a456d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1daf23b3538498bb795a60d627b6ac0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 36109 } } peers { permanent_uuid: "d7def43826924f03b8858383f0dc69f4" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 40053 } } peers { permanent_uuid: "eaa6f3dc13d643b9acfd8df1263a456d" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 41395 } }
I20260709 13:09:33.098467 30371 catalog_manager.cc:5697] T f406da2fcdaa4facbd59848fdd5eeeb3 P eaa6f3dc13d643b9acfd8df1263a456d reported cstate change: term changed from 2 to 3, leader changed from b1daf23b3538498bb795a60d627b6ac0 (127.17.223.1) to eaa6f3dc13d643b9acfd8df1263a456d (127.17.223.3). New cstate: current_term: 3 leader_uuid: "eaa6f3dc13d643b9acfd8df1263a456d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1daf23b3538498bb795a60d627b6ac0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 36109 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d7def43826924f03b8858383f0dc69f4" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 40053 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "eaa6f3dc13d643b9acfd8df1263a456d" member_type: VOTER last_known_addr { host: "127.17.223.3" port: 41395 } health_report { overall_health: HEALTHY } } }
I20260709 13:09:33.500792 30472 raft_consensus.cc:1275] T f406da2fcdaa4facbd59848fdd5eeeb3 P b1daf23b3538498bb795a60d627b6ac0 [term 3 FOLLOWER]: Refusing update from remote peer eaa6f3dc13d643b9acfd8df1263a456d: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:09:33.502039 30954 consensus_queue.cc:1048] T f406da2fcdaa4facbd59848fdd5eeeb3 P eaa6f3dc13d643b9acfd8df1263a456d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1daf23b3538498bb795a60d627b6ac0" member_type: VOTER last_known_addr { host: "127.17.223.1" port: 36109 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:09:33.511920 30551 raft_consensus.cc:1275] T f406da2fcdaa4facbd59848fdd5eeeb3 P d7def43826924f03b8858383f0dc69f4 [term 3 FOLLOWER]: Refusing update from remote peer eaa6f3dc13d643b9acfd8df1263a456d: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:09:33.513551 30954 consensus_queue.cc:1048] T f406da2fcdaa4facbd59848fdd5eeeb3 P eaa6f3dc13d643b9acfd8df1263a456d [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7def43826924f03b8858383f0dc69f4" member_type: VOTER last_known_addr { host: "127.17.223.2" port: 40053 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:09:33.640422 18300 tablet_server.cc:179] TabletServer@127.17.223.1:0 shutting down...
I20260709 13:09:33.673069 18300 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:09:33.673847 18300 tablet_replica.cc:333] T 035d977bcb604138a0c5e70d38013012 P b1daf23b3538498bb795a60d627b6ac0: stopping tablet replica
I20260709 13:09:33.674826 18300 raft_consensus.cc:2243] T 035d977bcb604138a0c5e70d38013012 P b1daf23b3538498bb795a60d627b6ac0 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:33.675295 18300 raft_consensus.cc:2272] T 035d977bcb604138a0c5e70d38013012 P b1daf23b3538498bb795a60d627b6ac0 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:33.677462 18300 tablet_replica.cc:333] T b90351987d7741299d85cc7599d58d07 P b1daf23b3538498bb795a60d627b6ac0: stopping tablet replica
I20260709 13:09:33.678066 18300 raft_consensus.cc:2243] T b90351987d7741299d85cc7599d58d07 P b1daf23b3538498bb795a60d627b6ac0 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:09:33.679080 18300 raft_consensus.cc:2272] T b90351987d7741299d85cc7599d58d07 P b1daf23b3538498bb795a60d627b6ac0 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:33.681140 18300 tablet_replica.cc:333] T f657c3787a9d497f91e05a50c36622f2 P b1daf23b3538498bb795a60d627b6ac0: stopping tablet replica
I20260709 13:09:33.681876 18300 raft_consensus.cc:2243] T f657c3787a9d497f91e05a50c36622f2 P b1daf23b3538498bb795a60d627b6ac0 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:09:33.682627 18300 raft_consensus.cc:2272] T f657c3787a9d497f91e05a50c36622f2 P b1daf23b3538498bb795a60d627b6ac0 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:09:33.684973 30514 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 12 similar messages]
I20260709 13:09:33.685349 18300 tablet_replica.cc:333] T c9a02595d5e340be8cf9484066cf9cc7 P b1daf23b3538498bb795a60d627b6ac0: stopping tablet replica
I20260709 13:09:33.686074 18300 raft_consensus.cc:2243] T c9a02595d5e340be8cf9484066cf9cc7 P b1daf23b3538498bb795a60d627b6ac0 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:33.686579 18300 raft_consensus.cc:2272] T c9a02595d5e340be8cf9484066cf9cc7 P b1daf23b3538498bb795a60d627b6ac0 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:09:33.688225 30514 consensus_peers.cc:597] T c9a02595d5e340be8cf9484066cf9cc7 P d7def43826924f03b8858383f0dc69f4 -> Peer b1daf23b3538498bb795a60d627b6ac0 (127.17.223.1:36109): Couldn't send request to peer b1daf23b3538498bb795a60d627b6ac0. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:33.689175 18300 tablet_replica.cc:333] T 93f7bd85158a4f47aabfeb6b20b664e7 P b1daf23b3538498bb795a60d627b6ac0: stopping tablet replica
I20260709 13:09:33.689823 18300 raft_consensus.cc:2243] T 93f7bd85158a4f47aabfeb6b20b664e7 P b1daf23b3538498bb795a60d627b6ac0 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:33.690276 18300 raft_consensus.cc:2272] T 93f7bd85158a4f47aabfeb6b20b664e7 P b1daf23b3538498bb795a60d627b6ac0 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:33.692333 18300 tablet_replica.cc:333] T 7ce7118b2aff46f38de8e9d6f5301e41 P b1daf23b3538498bb795a60d627b6ac0: stopping tablet replica
I20260709 13:09:33.692926 18300 raft_consensus.cc:2243] T 7ce7118b2aff46f38de8e9d6f5301e41 P b1daf23b3538498bb795a60d627b6ac0 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:09:33.693674 18300 raft_consensus.cc:2272] T 7ce7118b2aff46f38de8e9d6f5301e41 P b1daf23b3538498bb795a60d627b6ac0 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:33.695770 18300 tablet_replica.cc:333] T 905b37e519a4428995623c0c8357fc0f P b1daf23b3538498bb795a60d627b6ac0: stopping tablet replica
I20260709 13:09:33.696529 18300 raft_consensus.cc:2243] T 905b37e519a4428995623c0c8357fc0f P b1daf23b3538498bb795a60d627b6ac0 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:33.697075 18300 raft_consensus.cc:2272] T 905b37e519a4428995623c0c8357fc0f P b1daf23b3538498bb795a60d627b6ac0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:33.699790 18300 tablet_replica.cc:333] T 052373021b584e2e84d1d9dee352aebd P b1daf23b3538498bb795a60d627b6ac0: stopping tablet replica
I20260709 13:09:33.700558 18300 raft_consensus.cc:2243] T 052373021b584e2e84d1d9dee352aebd P b1daf23b3538498bb795a60d627b6ac0 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:09:33.701462 18300 raft_consensus.cc:2272] T 052373021b584e2e84d1d9dee352aebd P b1daf23b3538498bb795a60d627b6ac0 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:33.703954 18300 tablet_replica.cc:333] T 19335986fe9c4f738db226a45653127a P b1daf23b3538498bb795a60d627b6ac0: stopping tablet replica
I20260709 13:09:33.704567 18300 raft_consensus.cc:2243] T 19335986fe9c4f738db226a45653127a P b1daf23b3538498bb795a60d627b6ac0 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:33.705034 18300 raft_consensus.cc:2272] T 19335986fe9c4f738db226a45653127a P b1daf23b3538498bb795a60d627b6ac0 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:33.707173 18300 tablet_replica.cc:333] T 17519d8368db4b08a84e4d7335c6fc4f P b1daf23b3538498bb795a60d627b6ac0: stopping tablet replica
I20260709 13:09:33.707728 18300 raft_consensus.cc:2243] T 17519d8368db4b08a84e4d7335c6fc4f P b1daf23b3538498bb795a60d627b6ac0 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:09:33.708520 18300 raft_consensus.cc:2272] T 17519d8368db4b08a84e4d7335c6fc4f P b1daf23b3538498bb795a60d627b6ac0 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:33.710635 18300 tablet_replica.cc:333] T d121c37db92f49c4a789269d64b00a12 P b1daf23b3538498bb795a60d627b6ac0: stopping tablet replica
I20260709 13:09:33.711282 18300 raft_consensus.cc:2243] T d121c37db92f49c4a789269d64b00a12 P b1daf23b3538498bb795a60d627b6ac0 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:09:33.712042 18300 raft_consensus.cc:2272] T d121c37db92f49c4a789269d64b00a12 P b1daf23b3538498bb795a60d627b6ac0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:33.714596 18300 tablet_replica.cc:333] T f406da2fcdaa4facbd59848fdd5eeeb3 P b1daf23b3538498bb795a60d627b6ac0: stopping tablet replica
I20260709 13:09:33.715236 18300 raft_consensus.cc:2243] T f406da2fcdaa4facbd59848fdd5eeeb3 P b1daf23b3538498bb795a60d627b6ac0 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:33.715638 18300 raft_consensus.cc:2272] T f406da2fcdaa4facbd59848fdd5eeeb3 P b1daf23b3538498bb795a60d627b6ac0 [term 3 FOLLOWER]: Raft consensus is shut down!
W20260709 13:09:33.716094 30514 consensus_peers.cc:597] T 734911241b624e74aadb0e38ed5b0362 P d7def43826924f03b8858383f0dc69f4 -> Peer b1daf23b3538498bb795a60d627b6ac0 (127.17.223.1:36109): Couldn't send request to peer b1daf23b3538498bb795a60d627b6ac0. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:33.718235 18300 tablet_replica.cc:333] T 4ad6f5c1312c488b8d331c1ecb412800 P b1daf23b3538498bb795a60d627b6ac0: stopping tablet replica
I20260709 13:09:33.718950 18300 raft_consensus.cc:2243] T 4ad6f5c1312c488b8d331c1ecb412800 P b1daf23b3538498bb795a60d627b6ac0 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:33.719422 18300 raft_consensus.cc:2272] T 4ad6f5c1312c488b8d331c1ecb412800 P b1daf23b3538498bb795a60d627b6ac0 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:33.721645 18300 tablet_replica.cc:333] T 734911241b624e74aadb0e38ed5b0362 P b1daf23b3538498bb795a60d627b6ac0: stopping tablet replica
I20260709 13:09:33.722225 18300 raft_consensus.cc:2243] T 734911241b624e74aadb0e38ed5b0362 P b1daf23b3538498bb795a60d627b6ac0 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:33.722767 18300 raft_consensus.cc:2272] T 734911241b624e74aadb0e38ed5b0362 P b1daf23b3538498bb795a60d627b6ac0 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:33.724886 18300 tablet_replica.cc:333] T 131d025784b94fe8bab12c27e5176e73 P b1daf23b3538498bb795a60d627b6ac0: stopping tablet replica
I20260709 13:09:33.725442 18300 raft_consensus.cc:2243] T 131d025784b94fe8bab12c27e5176e73 P b1daf23b3538498bb795a60d627b6ac0 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:09:33.726361 18300 raft_consensus.cc:2272] T 131d025784b94fe8bab12c27e5176e73 P b1daf23b3538498bb795a60d627b6ac0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:33.728466 18300 tablet_replica.cc:333] T 687db47721c34eb3918dc02f98170722 P b1daf23b3538498bb795a60d627b6ac0: stopping tablet replica
I20260709 13:09:33.729000 18300 raft_consensus.cc:2243] T 687db47721c34eb3918dc02f98170722 P b1daf23b3538498bb795a60d627b6ac0 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:33.729413 18300 raft_consensus.cc:2272] T 687db47721c34eb3918dc02f98170722 P b1daf23b3538498bb795a60d627b6ac0 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:33.732563 18300 tablet_replica.cc:333] T ad8233fe86c64f6380f513881e6c3268 P b1daf23b3538498bb795a60d627b6ac0: stopping tablet replica
I20260709 13:09:33.733078 18300 raft_consensus.cc:2243] T ad8233fe86c64f6380f513881e6c3268 P b1daf23b3538498bb795a60d627b6ac0 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:33.733556 18300 raft_consensus.cc:2272] T ad8233fe86c64f6380f513881e6c3268 P b1daf23b3538498bb795a60d627b6ac0 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:33.735713 18300 tablet_replica.cc:333] T d6e07afd07294d7d80ca32fa1f97e4a1 P b1daf23b3538498bb795a60d627b6ac0: stopping tablet replica
I20260709 13:09:33.736208 18300 raft_consensus.cc:2243] T d6e07afd07294d7d80ca32fa1f97e4a1 P b1daf23b3538498bb795a60d627b6ac0 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:33.736649 18300 raft_consensus.cc:2272] T d6e07afd07294d7d80ca32fa1f97e4a1 P b1daf23b3538498bb795a60d627b6ac0 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:09:33.770893 30588 consensus_peers.cc:597] T 93f7bd85158a4f47aabfeb6b20b664e7 P eaa6f3dc13d643b9acfd8df1263a456d -> Peer b1daf23b3538498bb795a60d627b6ac0 (127.17.223.1:36109): Couldn't send request to peer b1daf23b3538498bb795a60d627b6ac0. Status: Network error: Client connection negotiation failed: client connection to 127.17.223.1:36109: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:33.777177 18300 tablet_server.cc:196] TabletServer@127.17.223.1:0 shutdown complete.
I20260709 13:09:33.814147 18300 tablet_server.cc:179] TabletServer@127.17.223.2:0 shutting down...
W20260709 13:09:33.843782 30514 consensus_peers.cc:597] T 19335986fe9c4f738db226a45653127a P d7def43826924f03b8858383f0dc69f4 -> Peer b1daf23b3538498bb795a60d627b6ac0 (127.17.223.1:36109): Couldn't send request to peer b1daf23b3538498bb795a60d627b6ac0. Status: Network error: Client connection negotiation failed: client connection to 127.17.223.1:36109: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:33.848178 18300 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:09:33.849031 18300 tablet_replica.cc:333] T 035d977bcb604138a0c5e70d38013012 P d7def43826924f03b8858383f0dc69f4: stopping tablet replica
I20260709 13:09:33.849965 18300 raft_consensus.cc:2243] T 035d977bcb604138a0c5e70d38013012 P d7def43826924f03b8858383f0dc69f4 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:09:33.850869 18300 raft_consensus.cc:2272] T 035d977bcb604138a0c5e70d38013012 P d7def43826924f03b8858383f0dc69f4 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:33.853061 18300 tablet_replica.cc:333] T b90351987d7741299d85cc7599d58d07 P d7def43826924f03b8858383f0dc69f4: stopping tablet replica
I20260709 13:09:33.853860 18300 raft_consensus.cc:2243] T b90351987d7741299d85cc7599d58d07 P d7def43826924f03b8858383f0dc69f4 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:33.854732 18300 raft_consensus.cc:2272] T b90351987d7741299d85cc7599d58d07 P d7def43826924f03b8858383f0dc69f4 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:33.856779 18300 tablet_replica.cc:333] T f657c3787a9d497f91e05a50c36622f2 P d7def43826924f03b8858383f0dc69f4: stopping tablet replica
I20260709 13:09:33.857331 18300 raft_consensus.cc:2243] T f657c3787a9d497f91e05a50c36622f2 P d7def43826924f03b8858383f0dc69f4 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:33.857760 18300 raft_consensus.cc:2272] T f657c3787a9d497f91e05a50c36622f2 P d7def43826924f03b8858383f0dc69f4 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:33.859907 18300 tablet_replica.cc:333] T 7ce7118b2aff46f38de8e9d6f5301e41 P d7def43826924f03b8858383f0dc69f4: stopping tablet replica
I20260709 13:09:33.860467 18300 raft_consensus.cc:2243] T 7ce7118b2aff46f38de8e9d6f5301e41 P d7def43826924f03b8858383f0dc69f4 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:33.860993 18300 raft_consensus.cc:2272] T 7ce7118b2aff46f38de8e9d6f5301e41 P d7def43826924f03b8858383f0dc69f4 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:33.862941 18300 tablet_replica.cc:333] T 93f7bd85158a4f47aabfeb6b20b664e7 P d7def43826924f03b8858383f0dc69f4: stopping tablet replica
I20260709 13:09:33.863521 18300 raft_consensus.cc:2243] T 93f7bd85158a4f47aabfeb6b20b664e7 P d7def43826924f03b8858383f0dc69f4 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:33.863967 18300 raft_consensus.cc:2272] T 93f7bd85158a4f47aabfeb6b20b664e7 P d7def43826924f03b8858383f0dc69f4 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:33.865878 18300 tablet_replica.cc:333] T c9a02595d5e340be8cf9484066cf9cc7 P d7def43826924f03b8858383f0dc69f4: stopping tablet replica
I20260709 13:09:33.866431 18300 raft_consensus.cc:2243] T c9a02595d5e340be8cf9484066cf9cc7 P d7def43826924f03b8858383f0dc69f4 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:09:33.867296 18300 raft_consensus.cc:2272] T c9a02595d5e340be8cf9484066cf9cc7 P d7def43826924f03b8858383f0dc69f4 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:33.869240 18300 tablet_replica.cc:333] T 905b37e519a4428995623c0c8357fc0f P d7def43826924f03b8858383f0dc69f4: stopping tablet replica
I20260709 13:09:33.869796 18300 raft_consensus.cc:2243] T 905b37e519a4428995623c0c8357fc0f P d7def43826924f03b8858383f0dc69f4 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:09:33.870551 18300 raft_consensus.cc:2272] T 905b37e519a4428995623c0c8357fc0f P d7def43826924f03b8858383f0dc69f4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:33.872560 18300 tablet_replica.cc:333] T 052373021b584e2e84d1d9dee352aebd P d7def43826924f03b8858383f0dc69f4: stopping tablet replica
I20260709 13:09:33.873068 18300 raft_consensus.cc:2243] T 052373021b584e2e84d1d9dee352aebd P d7def43826924f03b8858383f0dc69f4 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:33.873514 18300 raft_consensus.cc:2272] T 052373021b584e2e84d1d9dee352aebd P d7def43826924f03b8858383f0dc69f4 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:33.875490 18300 tablet_replica.cc:333] T 687db47721c34eb3918dc02f98170722 P d7def43826924f03b8858383f0dc69f4: stopping tablet replica
I20260709 13:09:33.876060 18300 raft_consensus.cc:2243] T 687db47721c34eb3918dc02f98170722 P d7def43826924f03b8858383f0dc69f4 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:33.876472 18300 raft_consensus.cc:2272] T 687db47721c34eb3918dc02f98170722 P d7def43826924f03b8858383f0dc69f4 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:33.879102 18300 tablet_replica.cc:333] T 131d025784b94fe8bab12c27e5176e73 P d7def43826924f03b8858383f0dc69f4: stopping tablet replica
I20260709 13:09:33.879668 18300 raft_consensus.cc:2243] T 131d025784b94fe8bab12c27e5176e73 P d7def43826924f03b8858383f0dc69f4 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:33.880101 18300 raft_consensus.cc:2272] T 131d025784b94fe8bab12c27e5176e73 P d7def43826924f03b8858383f0dc69f4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:33.882148 18300 tablet_replica.cc:333] T 4ad6f5c1312c488b8d331c1ecb412800 P d7def43826924f03b8858383f0dc69f4: stopping tablet replica
I20260709 13:09:33.882745 18300 raft_consensus.cc:2243] T 4ad6f5c1312c488b8d331c1ecb412800 P d7def43826924f03b8858383f0dc69f4 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:09:33.883522 18300 raft_consensus.cc:2272] T 4ad6f5c1312c488b8d331c1ecb412800 P d7def43826924f03b8858383f0dc69f4 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:33.885394 18300 tablet_replica.cc:333] T d121c37db92f49c4a789269d64b00a12 P d7def43826924f03b8858383f0dc69f4: stopping tablet replica
I20260709 13:09:33.885897 18300 raft_consensus.cc:2243] T d121c37db92f49c4a789269d64b00a12 P d7def43826924f03b8858383f0dc69f4 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:33.886337 18300 raft_consensus.cc:2272] T d121c37db92f49c4a789269d64b00a12 P d7def43826924f03b8858383f0dc69f4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:33.888283 18300 tablet_replica.cc:333] T f406da2fcdaa4facbd59848fdd5eeeb3 P d7def43826924f03b8858383f0dc69f4: stopping tablet replica
I20260709 13:09:33.888772 18300 raft_consensus.cc:2243] T f406da2fcdaa4facbd59848fdd5eeeb3 P d7def43826924f03b8858383f0dc69f4 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:33.889175 18300 raft_consensus.cc:2272] T f406da2fcdaa4facbd59848fdd5eeeb3 P d7def43826924f03b8858383f0dc69f4 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:33.892166 18300 tablet_replica.cc:333] T 19335986fe9c4f738db226a45653127a P d7def43826924f03b8858383f0dc69f4: stopping tablet replica
I20260709 13:09:33.892706 18300 raft_consensus.cc:2243] T 19335986fe9c4f738db226a45653127a P d7def43826924f03b8858383f0dc69f4 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:09:33.893445 18300 raft_consensus.cc:2272] T 19335986fe9c4f738db226a45653127a P d7def43826924f03b8858383f0dc69f4 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:09:33.895151 30588 consensus_peers.cc:597] T 687db47721c34eb3918dc02f98170722 P eaa6f3dc13d643b9acfd8df1263a456d -> Peer d7def43826924f03b8858383f0dc69f4 (127.17.223.2:40053): Couldn't send request to peer d7def43826924f03b8858383f0dc69f4. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:33.895955 18300 tablet_replica.cc:333] T 17519d8368db4b08a84e4d7335c6fc4f P d7def43826924f03b8858383f0dc69f4: stopping tablet replica
I20260709 13:09:33.896546 18300 raft_consensus.cc:2243] T 17519d8368db4b08a84e4d7335c6fc4f P d7def43826924f03b8858383f0dc69f4 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:33.897012 18300 raft_consensus.cc:2272] T 17519d8368db4b08a84e4d7335c6fc4f P d7def43826924f03b8858383f0dc69f4 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:33.899118 18300 tablet_replica.cc:333] T ad8233fe86c64f6380f513881e6c3268 P d7def43826924f03b8858383f0dc69f4: stopping tablet replica
I20260709 13:09:33.899611 18300 raft_consensus.cc:2243] T ad8233fe86c64f6380f513881e6c3268 P d7def43826924f03b8858383f0dc69f4 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:33.900019 18300 raft_consensus.cc:2272] T ad8233fe86c64f6380f513881e6c3268 P d7def43826924f03b8858383f0dc69f4 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:33.902040 18300 tablet_replica.cc:333] T d6e07afd07294d7d80ca32fa1f97e4a1 P d7def43826924f03b8858383f0dc69f4: stopping tablet replica
I20260709 13:09:33.902531 18300 raft_consensus.cc:2243] T d6e07afd07294d7d80ca32fa1f97e4a1 P d7def43826924f03b8858383f0dc69f4 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:09:33.903383 18300 raft_consensus.cc:2272] T d6e07afd07294d7d80ca32fa1f97e4a1 P d7def43826924f03b8858383f0dc69f4 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:33.905449 18300 tablet_replica.cc:333] T 734911241b624e74aadb0e38ed5b0362 P d7def43826924f03b8858383f0dc69f4: stopping tablet replica
I20260709 13:09:33.905911 18300 raft_consensus.cc:2243] T 734911241b624e74aadb0e38ed5b0362 P d7def43826924f03b8858383f0dc69f4 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:09:33.906642 18300 raft_consensus.cc:2272] T 734911241b624e74aadb0e38ed5b0362 P d7def43826924f03b8858383f0dc69f4 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:09:33.940111 30588 consensus_peers.cc:597] T f406da2fcdaa4facbd59848fdd5eeeb3 P eaa6f3dc13d643b9acfd8df1263a456d -> Peer b1daf23b3538498bb795a60d627b6ac0 (127.17.223.1:36109): Couldn't send request to peer b1daf23b3538498bb795a60d627b6ac0. Status: Network error: Client connection negotiation failed: client connection to 127.17.223.1:36109: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:33.946501 18300 tablet_server.cc:196] TabletServer@127.17.223.2:0 shutdown complete.
I20260709 13:09:33.982364 18300 tablet_server.cc:179] TabletServer@127.17.223.3:0 shutting down...
W20260709 13:09:33.987677 30588 consensus_peers.cc:597] T 93f7bd85158a4f47aabfeb6b20b664e7 P eaa6f3dc13d643b9acfd8df1263a456d -> Peer d7def43826924f03b8858383f0dc69f4 (127.17.223.2:40053): Couldn't send request to peer d7def43826924f03b8858383f0dc69f4. Status: Network error: Client connection negotiation failed: client connection to 127.17.223.2:40053: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:09:34.010248 30588 consensus_peers.cc:597] T f406da2fcdaa4facbd59848fdd5eeeb3 P eaa6f3dc13d643b9acfd8df1263a456d -> Peer d7def43826924f03b8858383f0dc69f4 (127.17.223.2:40053): Couldn't send request to peer d7def43826924f03b8858383f0dc69f4. Status: Network error: Client connection negotiation failed: client connection to 127.17.223.2:40053: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:34.013903 18300 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:09:34.014742 18300 tablet_replica.cc:333] T f657c3787a9d497f91e05a50c36622f2 P eaa6f3dc13d643b9acfd8df1263a456d: stopping tablet replica
I20260709 13:09:34.015440 18300 raft_consensus.cc:2243] T f657c3787a9d497f91e05a50c36622f2 P eaa6f3dc13d643b9acfd8df1263a456d [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:34.015987 18300 raft_consensus.cc:2272] T f657c3787a9d497f91e05a50c36622f2 P eaa6f3dc13d643b9acfd8df1263a456d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:34.018036 18300 tablet_replica.cc:333] T 93f7bd85158a4f47aabfeb6b20b664e7 P eaa6f3dc13d643b9acfd8df1263a456d: stopping tablet replica
I20260709 13:09:34.018738 18300 raft_consensus.cc:2243] T 93f7bd85158a4f47aabfeb6b20b664e7 P eaa6f3dc13d643b9acfd8df1263a456d [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:09:34.019543 18300 raft_consensus.cc:2272] T 93f7bd85158a4f47aabfeb6b20b664e7 P eaa6f3dc13d643b9acfd8df1263a456d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:34.021634 18300 tablet_replica.cc:333] T 7ce7118b2aff46f38de8e9d6f5301e41 P eaa6f3dc13d643b9acfd8df1263a456d: stopping tablet replica
I20260709 13:09:34.022238 18300 raft_consensus.cc:2243] T 7ce7118b2aff46f38de8e9d6f5301e41 P eaa6f3dc13d643b9acfd8df1263a456d [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:34.022780 18300 raft_consensus.cc:2272] T 7ce7118b2aff46f38de8e9d6f5301e41 P eaa6f3dc13d643b9acfd8df1263a456d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:34.024705 18300 tablet_replica.cc:333] T 905b37e519a4428995623c0c8357fc0f P eaa6f3dc13d643b9acfd8df1263a456d: stopping tablet replica
I20260709 13:09:34.025250 18300 raft_consensus.cc:2243] T 905b37e519a4428995623c0c8357fc0f P eaa6f3dc13d643b9acfd8df1263a456d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:34.025671 18300 raft_consensus.cc:2272] T 905b37e519a4428995623c0c8357fc0f P eaa6f3dc13d643b9acfd8df1263a456d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:34.027635 18300 tablet_replica.cc:333] T b90351987d7741299d85cc7599d58d07 P eaa6f3dc13d643b9acfd8df1263a456d: stopping tablet replica
I20260709 13:09:34.028187 18300 raft_consensus.cc:2243] T b90351987d7741299d85cc7599d58d07 P eaa6f3dc13d643b9acfd8df1263a456d [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:34.028658 18300 raft_consensus.cc:2272] T b90351987d7741299d85cc7599d58d07 P eaa6f3dc13d643b9acfd8df1263a456d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:34.030550 18300 tablet_replica.cc:333] T c9a02595d5e340be8cf9484066cf9cc7 P eaa6f3dc13d643b9acfd8df1263a456d: stopping tablet replica
I20260709 13:09:34.031106 18300 raft_consensus.cc:2243] T c9a02595d5e340be8cf9484066cf9cc7 P eaa6f3dc13d643b9acfd8df1263a456d [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:34.031524 18300 raft_consensus.cc:2272] T c9a02595d5e340be8cf9484066cf9cc7 P eaa6f3dc13d643b9acfd8df1263a456d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:34.033392 18300 tablet_replica.cc:333] T 052373021b584e2e84d1d9dee352aebd P eaa6f3dc13d643b9acfd8df1263a456d: stopping tablet replica
I20260709 13:09:34.033915 18300 raft_consensus.cc:2243] T 052373021b584e2e84d1d9dee352aebd P eaa6f3dc13d643b9acfd8df1263a456d [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:34.034351 18300 raft_consensus.cc:2272] T 052373021b584e2e84d1d9dee352aebd P eaa6f3dc13d643b9acfd8df1263a456d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:34.036204 18300 tablet_replica.cc:333] T 035d977bcb604138a0c5e70d38013012 P eaa6f3dc13d643b9acfd8df1263a456d: stopping tablet replica
I20260709 13:09:34.036698 18300 raft_consensus.cc:2243] T 035d977bcb604138a0c5e70d38013012 P eaa6f3dc13d643b9acfd8df1263a456d [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:34.037113 18300 raft_consensus.cc:2272] T 035d977bcb604138a0c5e70d38013012 P eaa6f3dc13d643b9acfd8df1263a456d [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:34.039031 18300 tablet_replica.cc:333] T 734911241b624e74aadb0e38ed5b0362 P eaa6f3dc13d643b9acfd8df1263a456d: stopping tablet replica
I20260709 13:09:34.039783 18300 raft_consensus.cc:2243] T 734911241b624e74aadb0e38ed5b0362 P eaa6f3dc13d643b9acfd8df1263a456d [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:34.040238 18300 raft_consensus.cc:2272] T 734911241b624e74aadb0e38ed5b0362 P eaa6f3dc13d643b9acfd8df1263a456d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:34.042975 18300 tablet_replica.cc:333] T d6e07afd07294d7d80ca32fa1f97e4a1 P eaa6f3dc13d643b9acfd8df1263a456d: stopping tablet replica
I20260709 13:09:34.043614 18300 raft_consensus.cc:2243] T d6e07afd07294d7d80ca32fa1f97e4a1 P eaa6f3dc13d643b9acfd8df1263a456d [term 2 FOLLOWER]: Raft consensus shutting down.
W20260709 13:09:34.043972 30588 consensus_peers.cc:597] T 687db47721c34eb3918dc02f98170722 P eaa6f3dc13d643b9acfd8df1263a456d -> Peer b1daf23b3538498bb795a60d627b6ac0 (127.17.223.1:36109): Couldn't send request to peer b1daf23b3538498bb795a60d627b6ac0. Status: Network error: Client connection negotiation failed: client connection to 127.17.223.1:36109: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:34.044179 18300 raft_consensus.cc:2272] T d6e07afd07294d7d80ca32fa1f97e4a1 P eaa6f3dc13d643b9acfd8df1263a456d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:34.046412 18300 tablet_replica.cc:333] T 131d025784b94fe8bab12c27e5176e73 P eaa6f3dc13d643b9acfd8df1263a456d: stopping tablet replica
I20260709 13:09:34.046983 18300 raft_consensus.cc:2243] T 131d025784b94fe8bab12c27e5176e73 P eaa6f3dc13d643b9acfd8df1263a456d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:34.047358 18300 raft_consensus.cc:2272] T 131d025784b94fe8bab12c27e5176e73 P eaa6f3dc13d643b9acfd8df1263a456d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:34.049513 18300 tablet_replica.cc:333] T 687db47721c34eb3918dc02f98170722 P eaa6f3dc13d643b9acfd8df1263a456d: stopping tablet replica
I20260709 13:09:34.050065 18300 raft_consensus.cc:2243] T 687db47721c34eb3918dc02f98170722 P eaa6f3dc13d643b9acfd8df1263a456d [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:09:34.050889 18300 raft_consensus.cc:2272] T 687db47721c34eb3918dc02f98170722 P eaa6f3dc13d643b9acfd8df1263a456d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:34.052855 18300 tablet_replica.cc:333] T f406da2fcdaa4facbd59848fdd5eeeb3 P eaa6f3dc13d643b9acfd8df1263a456d: stopping tablet replica
I20260709 13:09:34.053411 18300 raft_consensus.cc:2243] T f406da2fcdaa4facbd59848fdd5eeeb3 P eaa6f3dc13d643b9acfd8df1263a456d [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:09:34.054143 18300 raft_consensus.cc:2272] T f406da2fcdaa4facbd59848fdd5eeeb3 P eaa6f3dc13d643b9acfd8df1263a456d [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:34.056568 18300 tablet_replica.cc:333] T d121c37db92f49c4a789269d64b00a12 P eaa6f3dc13d643b9acfd8df1263a456d: stopping tablet replica
I20260709 13:09:34.057101 18300 raft_consensus.cc:2243] T d121c37db92f49c4a789269d64b00a12 P eaa6f3dc13d643b9acfd8df1263a456d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:34.057528 18300 raft_consensus.cc:2272] T d121c37db92f49c4a789269d64b00a12 P eaa6f3dc13d643b9acfd8df1263a456d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:34.059667 18300 tablet_replica.cc:333] T ad8233fe86c64f6380f513881e6c3268 P eaa6f3dc13d643b9acfd8df1263a456d: stopping tablet replica
I20260709 13:09:34.060292 18300 raft_consensus.cc:2243] T ad8233fe86c64f6380f513881e6c3268 P eaa6f3dc13d643b9acfd8df1263a456d [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:09:34.061087 18300 raft_consensus.cc:2272] T ad8233fe86c64f6380f513881e6c3268 P eaa6f3dc13d643b9acfd8df1263a456d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:34.063081 18300 tablet_replica.cc:333] T 19335986fe9c4f738db226a45653127a P eaa6f3dc13d643b9acfd8df1263a456d: stopping tablet replica
I20260709 13:09:34.063563 18300 raft_consensus.cc:2243] T 19335986fe9c4f738db226a45653127a P eaa6f3dc13d643b9acfd8df1263a456d [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:34.063997 18300 raft_consensus.cc:2272] T 19335986fe9c4f738db226a45653127a P eaa6f3dc13d643b9acfd8df1263a456d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:34.065794 18300 tablet_replica.cc:333] T 17519d8368db4b08a84e4d7335c6fc4f P eaa6f3dc13d643b9acfd8df1263a456d: stopping tablet replica
I20260709 13:09:34.066258 18300 raft_consensus.cc:2243] T 17519d8368db4b08a84e4d7335c6fc4f P eaa6f3dc13d643b9acfd8df1263a456d [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:34.066656 18300 raft_consensus.cc:2272] T 17519d8368db4b08a84e4d7335c6fc4f P eaa6f3dc13d643b9acfd8df1263a456d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:34.068562 18300 tablet_replica.cc:333] T 4ad6f5c1312c488b8d331c1ecb412800 P eaa6f3dc13d643b9acfd8df1263a456d: stopping tablet replica
I20260709 13:09:34.069008 18300 raft_consensus.cc:2243] T 4ad6f5c1312c488b8d331c1ecb412800 P eaa6f3dc13d643b9acfd8df1263a456d [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:34.069459 18300 raft_consensus.cc:2272] T 4ad6f5c1312c488b8d331c1ecb412800 P eaa6f3dc13d643b9acfd8df1263a456d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:34.109452 18300 tablet_server.cc:196] TabletServer@127.17.223.3:0 shutdown complete.
I20260709 13:09:34.142791 18300 master.cc:562] Master@127.17.223.62:33533 shutting down...
I20260709 13:09:34.163241 18300 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 35ae1a007c404b71bd68dd0180693be7 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:09:34.163805 18300 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 35ae1a007c404b71bd68dd0180693be7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:34.164147 18300 tablet_replica.cc:333] T 00000000000000000000000000000000 P 35ae1a007c404b71bd68dd0180693be7: stopping tablet replica
I20260709 13:09:34.184942 18300 master.cc:584] Master@127.17.223.62:33533 shutdown complete.
[       OK ] FilterSoftDeletedTableTest.TestFilterSofteDeletedTable/1 (12913 ms)
[----------] 2 tests from FilterSoftDeletedTableTest (25878 ms total)

[----------] Global test environment tear-down
[==========] 8 tests from 2 test suites ran. (353461 ms total)
[  PASSED  ] 7 tests.
[  FAILED  ] 1 test, listed below:
[  FAILED  ] LeaderRebalancerTest.AddTserver

 1 FAILED TEST
I20260709 13:09:34.239672 18300 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tablet/tablet_mm_ops.cc:220: suppressed but not reported on 411 messages since previous log ~15 seconds ago
I20260709 13:09:34.239930 18300 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tablet/tablet_mm_ops.cc:304: suppressed but not reported on 411 messages since previous log ~15 seconds ago
I20260709 13:09:34.240118 18300 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tablet/tablet_mm_ops.cc:139: suppressed but not reported on 405 messages since previous log ~15 seconds ago
I20260709 13:09:34.240330 18300 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tserver/ts_tablet_manager.cc:600: suppressed but not reported on 9 messages since previous log ~34 seconds ago
I20260709 13:09:34.240531 18300 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tserver/ts_tablet_manager.cc:548: suppressed but not reported on 9 messages since previous log ~34 seconds ago
I20260709 13:09:34.240744 18300 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/master/catalog_manager.cc:5227: suppressed but not reported on 5 messages since previous log ~129 seconds ago
I20260709 13:09:34.240936 18300 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tserver/heartbeater.cc:646: suppressed but not reported on 2 messages since previous log ~138 seconds ago
I20260709 13:09:34.241200 18300 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/rpc/proxy.cc:239: suppressed but not reported on 8 messages since previous log ~0 seconds ago
I20260709 13:09:34.241501 18300 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tablet/tablet.cc:2406: suppressed but not reported on 26 messages since previous log ~7 seconds ago
